2023-06-10T18:38:06.213 INFO:root:teuthology version: 0.0.1.dev120+g2ef0dcd 2023-06-10T18:38:06.215 DEBUG:teuthology.run:Teuthology command: teuthology --name pdonnell-2023-06-10_18:20:34-fs:functional-main-distro-default-smithi --archive /home/teuthworker/archive/pdonnell-2023-06-10_18:20:34-fs:functional-main-distro-default-smithi/7301169 --verbose --owner scheduled_pdonnell@teuthology --description fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client-recovery} -- /home/teuthworker/archive/pdonnell-2023-06-10_18:20:34-fs:functional-main-distro-default-smithi/7301169/orig.config.yaml 2023-06-10T18:38:06.258 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-10T18:38:06.351 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2023-06-10_18:20:34-fs:functional-main-distro-default-smithi/7301169 branch: main description: fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client-recovery} email: pdonnell@redhat.com first_in_suite: false job_id: '7301169' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2023-06-10_18:20:34-fs:functional-main-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: main ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - evicting unresponsive client - but it is still running - slow request - MDS_CLIENT_LATE_RELEASE - t responding to mclientcaps - file system flag refuse_client_session is set sha1: 219d315c3a0b2075e570fb1964be2ad33fe7a9c8 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 219d315c3a0b2075e570fb1964be2ad33fe7a9c8 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: i61409 sha1: 3486dd872ffd89042ca079d680841ce3ef6f4b6f owner: scheduled_pdonnell@teuthology priority: 70 repo: https://github.com/ceph/ceph.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 5151 sha1: 219d315c3a0b2075e570fb1964be2ad33fe7a9c8 sleep_before_teardown: 0 suite: fs:functional suite_branch: i61409 suite_path: /home/teuthworker/src/github.com_batrick_ceph_3486dd872ffd89042ca079d680841ce3ef6f4b6f/qa suite_relpath: qa suite_repo: https://github.com/batrick/ceph.git suite_sha1: 3486dd872ffd89042ca079d680841ce3ef6f4b6f syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi053.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHz4PxkQkTGV6jwRgxFhPAgth/TCBaJB3bBrMbuw6PzG5yhit1j1UVyscUib1Yka9nD5My81qLIgHIXI+nLH7+o= smithi117.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMFGdcnpx7UyasrmBsPuKd1gCTau9Ir5lsSaADej0mNv7LfREvUcqD+KHP7YdcDf/eteIdQLCeea67ezwjp63Hc= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - ceph-fuse: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_client_recovery teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 2ef0dcdee569e9851c9d2ffb6acfd4b80d031e61 timestamp: 2023-06-10_18:20:34 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.23459 2023-06-10T18:38:06.352 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_batrick_ceph_3486dd872ffd89042ca079d680841ce3ef6f4b6f/qa; will attempt to use it 2023-06-10T18:38:06.353 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_batrick_ceph_3486dd872ffd89042ca079d680841ce3ef6f4b6f/qa/tasks 2023-06-10T18:38:06.353 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-06-10T18:38:06.355 INFO:teuthology.task.internal:Checking packages... 2023-06-10T18:38:06.388 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '219d315c3a0b2075e570fb1964be2ad33fe7a9c8' 2023-06-10T18:38:06.388 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-06-10T18:38:06.389 INFO:teuthology.packaging:ref: None 2023-06-10T18:38:06.389 INFO:teuthology.packaging:tag: None 2023-06-10T18:38:06.389 INFO:teuthology.packaging:branch: main 2023-06-10T18:38:06.390 INFO:teuthology.packaging:sha1: 219d315c3a0b2075e570fb1964be2ad33fe7a9c8 2023-06-10T18:38:06.390 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=main 2023-06-10T18:38:06.619 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-4359-g219d315c-1jammy 2023-06-10T18:38:06.620 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-06-10T18:38:06.627 INFO:teuthology.task.internal:no buildpackages task found 2023-06-10T18:38:06.627 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-06-10T18:38:06.648 INFO:teuthology.task.internal:Saving configuration 2023-06-10T18:38:06.665 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-06-10T18:38:06.672 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-10T18:38:06.699 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi053.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-06-10_18:20:34-fs:functional-main-distro-default-smithi/7301169', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-10 18:32:28.327238', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDXA3aY7gRglIeWsPH7HIcUc/5+0NasBHmJKLZ73BOoL'} 2023-06-10T18:38:06.725 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi117.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-06-10_18:20:34-fs:functional-main-distro-default-smithi/7301169', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-10 18:32:28.329155', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIJ8Lvkz0S2z11SgtjluF478LHQtM94raQuGpvc5U5d6O'} 2023-06-10T18:38:06.726 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-06-10T18:38:06.732 INFO:teuthology.task.internal:roles: ubuntu@smithi053.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-06-10T18:38:06.733 INFO:teuthology.task.internal:roles: ubuntu@smithi117.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-06-10T18:38:06.733 INFO:teuthology.run_tasks:Running task console_log... 2023-06-10T18:38:06.829 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa908c09f70>, signals=[15]) 2023-06-10T18:38:06.831 INFO:teuthology.run_tasks:Running task internal.connect... 2023-06-10T18:38:06.837 INFO:teuthology.task.internal:Opening connections... 2023-06-10T18:38:06.838 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi053.front.sepia.ceph.com 2023-06-10T18:38:06.840 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-10T18:38:06.920 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi117.front.sepia.ceph.com 2023-06-10T18:38:06.921 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-10T18:38:06.993 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-06-10T18:38:07.000 DEBUG:teuthology.orchestra.run.smithi053:> uname -m 2023-06-10T18:38:07.006 INFO:teuthology.orchestra.run.smithi053.stdout:x86_64 2023-06-10T18:38:07.006 DEBUG:teuthology.orchestra.run.smithi053:> cat /etc/os-release 2023-06-10T18:38:07.054 INFO:teuthology.orchestra.run.smithi053.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-06-10T18:38:07.054 INFO:teuthology.orchestra.run.smithi053.stdout:NAME="Ubuntu" 2023-06-10T18:38:07.054 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION_ID="22.04" 2023-06-10T18:38:07.054 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-06-10T18:38:07.055 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION_CODENAME=jammy 2023-06-10T18:38:07.055 INFO:teuthology.orchestra.run.smithi053.stdout:ID=ubuntu 2023-06-10T18:38:07.055 INFO:teuthology.orchestra.run.smithi053.stdout:ID_LIKE=debian 2023-06-10T18:38:07.055 INFO:teuthology.orchestra.run.smithi053.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-10T18:38:07.055 INFO:teuthology.orchestra.run.smithi053.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-10T18:38:07.055 INFO:teuthology.orchestra.run.smithi053.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-10T18:38:07.055 INFO:teuthology.orchestra.run.smithi053.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-10T18:38:07.055 INFO:teuthology.orchestra.run.smithi053.stdout:UBUNTU_CODENAME=jammy 2023-06-10T18:38:07.056 INFO:teuthology.lock.ops:Updating smithi053.front.sepia.ceph.com on lock server 2023-06-10T18:38:07.080 DEBUG:teuthology.orchestra.run.smithi117:> uname -m 2023-06-10T18:38:07.086 INFO:teuthology.orchestra.run.smithi117.stdout:x86_64 2023-06-10T18:38:07.087 DEBUG:teuthology.orchestra.run.smithi117:> cat /etc/os-release 2023-06-10T18:38:07.132 INFO:teuthology.orchestra.run.smithi117.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-06-10T18:38:07.133 INFO:teuthology.orchestra.run.smithi117.stdout:NAME="Ubuntu" 2023-06-10T18:38:07.133 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_ID="22.04" 2023-06-10T18:38:07.133 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-06-10T18:38:07.133 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_CODENAME=jammy 2023-06-10T18:38:07.133 INFO:teuthology.orchestra.run.smithi117.stdout:ID=ubuntu 2023-06-10T18:38:07.134 INFO:teuthology.orchestra.run.smithi117.stdout:ID_LIKE=debian 2023-06-10T18:38:07.134 INFO:teuthology.orchestra.run.smithi117.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-10T18:38:07.134 INFO:teuthology.orchestra.run.smithi117.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-10T18:38:07.134 INFO:teuthology.orchestra.run.smithi117.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-10T18:38:07.134 INFO:teuthology.orchestra.run.smithi117.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-10T18:38:07.137 INFO:teuthology.orchestra.run.smithi117.stdout:UBUNTU_CODENAME=jammy 2023-06-10T18:38:07.138 INFO:teuthology.lock.ops:Updating smithi117.front.sepia.ceph.com on lock server 2023-06-10T18:38:07.163 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-06-10T18:38:07.172 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-06-10T18:38:07.190 INFO:teuthology.task.internal:Checking for old test directory... 2023-06-10T18:38:07.191 DEBUG:teuthology.orchestra.run.smithi053:> test '!' -e /home/ubuntu/cephtest 2023-06-10T18:38:07.194 DEBUG:teuthology.orchestra.run.smithi117:> test '!' -e /home/ubuntu/cephtest 2023-06-10T18:38:07.199 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-06-10T18:38:07.215 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-06-10T18:38:07.215 DEBUG:teuthology.orchestra.run.smithi053:> test -z $(ls -A /var/lib/ceph) 2023-06-10T18:38:07.239 DEBUG:teuthology.orchestra.run.smithi117:> test -z $(ls -A /var/lib/ceph) 2023-06-10T18:38:07.262 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-06-10T18:38:07.322 INFO:teuthology.run_tasks:Running task kernel... 2023-06-10T18:38:07.341 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-06-10T18:38:07.342 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-06-10T18:38:07.343 DEBUG:teuthology.orchestra.run.smithi053:> test -f /run/.containerenv -o -f /.dockerenv 2023-06-10T18:38:07.344 DEBUG:teuthology.orchestra.run.smithi117:> test -f /run/.containerenv -o -f /.dockerenv 2023-06-10T18:38:07.356 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-10T18:38:07.357 DEBUG:teuthology.orchestra.run.smithi053:> uname -r 2023-06-10T18:38:07.358 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-10T18:38:07.359 DEBUG:teuthology.orchestra.run.smithi117:> uname -r 2023-06-10T18:38:07.405 INFO:teuthology.orchestra.run.smithi117.stdout:5.15.0-56-generic 2023-06-10T18:38:07.406 INFO:teuthology.task.kernel:Running kernel on smithi117: 5.15.0-56-generic 2023-06-10T18:38:07.406 DEBUG:teuthology.orchestra.run.smithi117:> sudo apt-get clean 2023-06-10T18:38:07.408 INFO:teuthology.orchestra.run.smithi053.stdout:5.15.0-56-generic 2023-06-10T18:38:07.408 INFO:teuthology.task.kernel:Running kernel on smithi053: 5.15.0-56-generic 2023-06-10T18:38:07.409 DEBUG:teuthology.orchestra.run.smithi053:> sudo apt-get clean 2023-06-10T18:38:07.531 DEBUG:teuthology.orchestra.run.smithi053:> sudo apt-get update 2023-06-10T18:38:07.536 DEBUG:teuthology.orchestra.run.smithi117:> sudo apt-get update 2023-06-10T18:38:07.665 INFO:teuthology.orchestra.run.smithi117.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-06-10T18:38:07.666 INFO:teuthology.orchestra.run.smithi117.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2023-06-10T18:38:07.666 INFO:teuthology.orchestra.run.smithi117.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2023-06-10T18:38:07.675 INFO:teuthology.orchestra.run.smithi053.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-06-10T18:38:07.689 INFO:teuthology.orchestra.run.smithi053.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2023-06-10T18:38:07.733 INFO:teuthology.orchestra.run.smithi117.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [108 kB] 2023-06-10T18:38:07.751 INFO:teuthology.orchestra.run.smithi053.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [108 kB] 2023-06-10T18:38:07.787 INFO:teuthology.orchestra.run.smithi053.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2023-06-10T18:38:07.903 INFO:teuthology.orchestra.run.smithi117.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [234 kB] 2023-06-10T18:38:07.919 INFO:teuthology.orchestra.run.smithi053.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [419 kB] 2023-06-10T18:38:07.960 INFO:teuthology.orchestra.run.smithi117.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [455 kB] 2023-06-10T18:38:07.976 INFO:teuthology.orchestra.run.smithi117.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [122 kB] 2023-06-10T18:38:07.977 INFO:teuthology.orchestra.run.smithi117.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [672 kB] 2023-06-10T18:38:07.982 INFO:teuthology.orchestra.run.smithi117.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [10.1 kB] 2023-06-10T18:38:07.982 INFO:teuthology.orchestra.run.smithi117.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [349 kB] 2023-06-10T18:38:07.992 INFO:teuthology.orchestra.run.smithi117.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [28.0 kB] 2023-06-10T18:38:08.005 INFO:teuthology.orchestra.run.smithi053.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [672 kB] 2023-06-10T18:38:08.007 INFO:teuthology.orchestra.run.smithi117.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [52.6 kB] 2023-06-10T18:38:08.008 INFO:teuthology.orchestra.run.smithi117.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [604 B] 2023-06-10T18:38:08.008 INFO:teuthology.orchestra.run.smithi117.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [533 kB] 2023-06-10T18:38:08.013 INFO:teuthology.orchestra.run.smithi117.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [732 kB] 2023-06-10T18:38:08.025 INFO:teuthology.orchestra.run.smithi053.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [182 kB] 2023-06-10T18:38:08.030 INFO:teuthology.orchestra.run.smithi053.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [15.0 kB] 2023-06-10T18:38:08.031 INFO:teuthology.orchestra.run.smithi053.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [28.3 kB] 2023-06-10T18:38:08.031 INFO:teuthology.orchestra.run.smithi053.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [350 kB] 2023-06-10T18:38:08.039 INFO:teuthology.orchestra.run.smithi117.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [419 kB] 2023-06-10T18:38:08.040 INFO:teuthology.orchestra.run.smithi053.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [52.8 kB] 2023-06-10T18:38:08.040 INFO:teuthology.orchestra.run.smithi053.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [604 B] 2023-06-10T18:38:08.046 INFO:teuthology.orchestra.run.smithi117.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [182 kB] 2023-06-10T18:38:08.049 INFO:teuthology.orchestra.run.smithi117.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [15.0 kB] 2023-06-10T18:38:08.049 INFO:teuthology.orchestra.run.smithi117.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [350 kB] 2023-06-10T18:38:08.055 INFO:teuthology.orchestra.run.smithi117.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [129 kB] 2023-06-10T18:38:08.058 INFO:teuthology.orchestra.run.smithi117.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [28.3 kB] 2023-06-10T18:38:08.058 INFO:teuthology.orchestra.run.smithi117.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [52.8 kB] 2023-06-10T18:38:08.059 INFO:teuthology.orchestra.run.smithi117.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [604 B] 2023-06-10T18:38:08.075 INFO:teuthology.orchestra.run.smithi053.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [622 kB] 2023-06-10T18:38:08.094 INFO:teuthology.orchestra.run.smithi117.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [622 kB] 2023-06-10T18:38:08.131 INFO:teuthology.orchestra.run.smithi117.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [15.6 kB] 2023-06-10T18:38:08.132 INFO:teuthology.orchestra.run.smithi117.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [30.2 kB] 2023-06-10T18:38:08.135 INFO:teuthology.orchestra.run.smithi117.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [5,828 B] 2023-06-10T18:38:08.136 INFO:teuthology.orchestra.run.smithi117.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [252 B] 2023-06-10T18:38:08.192 INFO:teuthology.orchestra.run.smithi053.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [920 kB] 2023-06-10T18:38:08.212 INFO:teuthology.orchestra.run.smithi117.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [920 kB] 2023-06-10T18:38:08.214 INFO:teuthology.orchestra.run.smithi053.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [194 kB] 2023-06-10T18:38:08.218 INFO:teuthology.orchestra.run.smithi053.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [20.0 kB] 2023-06-10T18:38:08.219 INFO:teuthology.orchestra.run.smithi053.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [35.3 kB] 2023-06-10T18:38:08.220 INFO:teuthology.orchestra.run.smithi053.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [3,884 B] 2023-06-10T18:38:08.221 INFO:teuthology.orchestra.run.smithi053.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [8,452 B] 2023-06-10T18:38:08.221 INFO:teuthology.orchestra.run.smithi053.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [468 B] 2023-06-10T18:38:08.221 INFO:teuthology.orchestra.run.smithi053.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [33.7 kB] 2023-06-10T18:38:08.221 INFO:teuthology.orchestra.run.smithi053.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [40.9 kB] 2023-06-10T18:38:08.225 INFO:teuthology.orchestra.run.smithi053.stdout:Get:23 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [455 kB] 2023-06-10T18:38:08.235 INFO:teuthology.orchestra.run.smithi117.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [194 kB] 2023-06-10T18:38:08.239 INFO:teuthology.orchestra.run.smithi117.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [20.0 kB] 2023-06-10T18:38:08.240 INFO:teuthology.orchestra.run.smithi117.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [35.3 kB] 2023-06-10T18:38:08.241 INFO:teuthology.orchestra.run.smithi117.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [3,884 B] 2023-06-10T18:38:08.241 INFO:teuthology.orchestra.run.smithi117.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [8,452 B] 2023-06-10T18:38:08.242 INFO:teuthology.orchestra.run.smithi117.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [468 B] 2023-06-10T18:38:08.242 INFO:teuthology.orchestra.run.smithi117.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [33.7 kB] 2023-06-10T18:38:08.243 INFO:teuthology.orchestra.run.smithi117.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [40.9 kB] 2023-06-10T18:38:08.256 INFO:teuthology.orchestra.run.smithi053.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [10.2 kB] 2023-06-10T18:38:08.257 INFO:teuthology.orchestra.run.smithi053.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2023-06-10T18:38:08.258 INFO:teuthology.orchestra.run.smithi053.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [23.4 kB] 2023-06-10T18:38:08.278 INFO:teuthology.orchestra.run.smithi117.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [10.2 kB] 2023-06-10T18:38:08.279 INFO:teuthology.orchestra.run.smithi117.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2023-06-10T18:38:08.279 INFO:teuthology.orchestra.run.smithi117.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [23.4 kB] 2023-06-10T18:38:08.282 INFO:teuthology.orchestra.run.smithi053.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [13.9 kB] 2023-06-10T18:38:08.293 INFO:teuthology.orchestra.run.smithi053.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [15.0 kB] 2023-06-10T18:38:08.298 INFO:teuthology.orchestra.run.smithi053.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [548 B] 2023-06-10T18:38:08.304 INFO:teuthology.orchestra.run.smithi117.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [13.9 kB] 2023-06-10T18:38:08.314 INFO:teuthology.orchestra.run.smithi117.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [15.0 kB] 2023-06-10T18:38:08.320 INFO:teuthology.orchestra.run.smithi117.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [548 B] 2023-06-10T18:38:08.509 INFO:teuthology.orchestra.run.smithi053.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [234 kB] 2023-06-10T18:38:08.536 INFO:teuthology.orchestra.run.smithi053.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [122 kB] 2023-06-10T18:38:08.549 INFO:teuthology.orchestra.run.smithi053.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [10.1 kB] 2023-06-10T18:38:08.550 INFO:teuthology.orchestra.run.smithi053.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [349 kB] 2023-06-10T18:38:08.611 INFO:teuthology.orchestra.run.smithi053.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [28.0 kB] 2023-06-10T18:38:08.613 INFO:teuthology.orchestra.run.smithi053.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [52.6 kB] 2023-06-10T18:38:08.620 INFO:teuthology.orchestra.run.smithi053.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [604 B] 2023-06-10T18:38:08.620 INFO:teuthology.orchestra.run.smithi053.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [732 kB] 2023-06-10T18:38:08.684 INFO:teuthology.orchestra.run.smithi053.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [533 kB] 2023-06-10T18:38:08.875 INFO:teuthology.orchestra.run.smithi053.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [129 kB] 2023-06-10T18:38:09.244 INFO:teuthology.orchestra.run.smithi053.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [15.6 kB] 2023-06-10T18:38:09.251 INFO:teuthology.orchestra.run.smithi053.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [30.2 kB] 2023-06-10T18:38:09.265 INFO:teuthology.orchestra.run.smithi053.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [5,828 B] 2023-06-10T18:38:09.268 INFO:teuthology.orchestra.run.smithi053.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [252 B] 2023-06-10T18:38:12.899 INFO:teuthology.orchestra.run.smithi117.stdout:Fetched 6,697 kB in 1s (6,269 kB/s) 2023-06-10T18:38:13.619 INFO:teuthology.orchestra.run.smithi053.stdout:Fetched 6,697 kB in 2s (4,013 kB/s) 2023-06-10T18:38:14.012 INFO:teuthology.orchestra.run.smithi117.stdout:Reading package lists... 2023-06-10T18:38:14.029 DEBUG:teuthology.orchestra.run.smithi117:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-06-10T18:38:14.089 INFO:teuthology.orchestra.run.smithi117.stdout:Reading package lists... 2023-06-10T18:38:14.262 INFO:teuthology.orchestra.run.smithi117.stdout:Building dependency tree... 2023-06-10T18:38:14.262 INFO:teuthology.orchestra.run.smithi117.stdout:Reading state information... 2023-06-10T18:38:14.409 INFO:teuthology.orchestra.run.smithi117.stdout:The following packages were automatically installed and are no longer required: 2023-06-10T18:38:14.409 INFO:teuthology.orchestra.run.smithi117.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-06-10T18:38:14.410 INFO:teuthology.orchestra.run.smithi117.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-06-10T18:38:14.410 INFO:teuthology.orchestra.run.smithi117.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-06-10T18:38:14.410 INFO:teuthology.orchestra.run.smithi117.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2023-06-10T18:38:14.410 INFO:teuthology.orchestra.run.smithi117.stdout: python2.7-minimal 2023-06-10T18:38:14.411 INFO:teuthology.orchestra.run.smithi117.stdout:Use 'sudo apt autoremove' to remove them. 2023-06-10T18:38:14.411 INFO:teuthology.orchestra.run.smithi117.stdout:The following additional packages will be installed: 2023-06-10T18:38:14.411 INFO:teuthology.orchestra.run.smithi117.stdout: linux-generic linux-headers-5.15.0-73 linux-headers-5.15.0-73-generic 2023-06-10T18:38:14.411 INFO:teuthology.orchestra.run.smithi117.stdout: linux-headers-generic linux-image-5.15.0-73-generic 2023-06-10T18:38:14.412 INFO:teuthology.orchestra.run.smithi117.stdout: linux-modules-5.15.0-73-generic linux-modules-extra-5.15.0-73-generic 2023-06-10T18:38:14.412 INFO:teuthology.orchestra.run.smithi117.stdout:Suggested packages: 2023-06-10T18:38:14.412 INFO:teuthology.orchestra.run.smithi117.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2023-06-10T18:38:14.413 INFO:teuthology.orchestra.run.smithi117.stdout:Recommended packages: 2023-06-10T18:38:14.413 INFO:teuthology.orchestra.run.smithi117.stdout: thermald 2023-06-10T18:38:14.469 INFO:teuthology.orchestra.run.smithi117.stdout:The following NEW packages will be installed: 2023-06-10T18:38:14.469 INFO:teuthology.orchestra.run.smithi117.stdout: linux-headers-5.15.0-73 linux-headers-5.15.0-73-generic 2023-06-10T18:38:14.469 INFO:teuthology.orchestra.run.smithi117.stdout: linux-image-5.15.0-73-generic linux-modules-5.15.0-73-generic 2023-06-10T18:38:14.470 INFO:teuthology.orchestra.run.smithi117.stdout: linux-modules-extra-5.15.0-73-generic 2023-06-10T18:38:14.470 INFO:teuthology.orchestra.run.smithi117.stdout:The following packages will be upgraded: 2023-06-10T18:38:14.471 INFO:teuthology.orchestra.run.smithi117.stdout: linux-generic linux-headers-generic linux-image-generic 2023-06-10T18:38:14.649 INFO:teuthology.orchestra.run.smithi117.stdout:3 upgraded, 5 newly installed, 0 to remove and 201 not upgraded. 2023-06-10T18:38:14.649 INFO:teuthology.orchestra.run.smithi117.stdout:Need to get 114 MB of archives. 2023-06-10T18:38:14.649 INFO:teuthology.orchestra.run.smithi117.stdout:After this operation, 596 MB of additional disk space will be used. 2023-06-10T18:38:14.649 INFO:teuthology.orchestra.run.smithi117.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-73-generic amd64 5.15.0-73.80 [23.2 MB] 2023-06-10T18:38:14.950 INFO:teuthology.orchestra.run.smithi053.stdout:Reading package lists... 2023-06-10T18:38:14.967 DEBUG:teuthology.orchestra.run.smithi053:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-06-10T18:38:15.078 INFO:teuthology.orchestra.run.smithi053.stdout:Reading package lists... 2023-06-10T18:38:15.254 INFO:teuthology.orchestra.run.smithi053.stdout:Building dependency tree... 2023-06-10T18:38:15.255 INFO:teuthology.orchestra.run.smithi053.stdout:Reading state information... 2023-06-10T18:38:15.408 INFO:teuthology.orchestra.run.smithi053.stdout:The following packages were automatically installed and are no longer required: 2023-06-10T18:38:15.408 INFO:teuthology.orchestra.run.smithi053.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-06-10T18:38:15.408 INFO:teuthology.orchestra.run.smithi053.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-06-10T18:38:15.409 INFO:teuthology.orchestra.run.smithi053.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-06-10T18:38:15.409 INFO:teuthology.orchestra.run.smithi053.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2023-06-10T18:38:15.409 INFO:teuthology.orchestra.run.smithi053.stdout: python2.7-minimal 2023-06-10T18:38:15.409 INFO:teuthology.orchestra.run.smithi053.stdout:Use 'sudo apt autoremove' to remove them. 2023-06-10T18:38:15.410 INFO:teuthology.orchestra.run.smithi053.stdout:The following additional packages will be installed: 2023-06-10T18:38:15.410 INFO:teuthology.orchestra.run.smithi053.stdout: linux-generic linux-headers-5.15.0-73 linux-headers-5.15.0-73-generic 2023-06-10T18:38:15.411 INFO:teuthology.orchestra.run.smithi053.stdout: linux-headers-generic linux-image-5.15.0-73-generic 2023-06-10T18:38:15.411 INFO:teuthology.orchestra.run.smithi053.stdout: linux-modules-5.15.0-73-generic linux-modules-extra-5.15.0-73-generic 2023-06-10T18:38:15.411 INFO:teuthology.orchestra.run.smithi053.stdout:Suggested packages: 2023-06-10T18:38:15.411 INFO:teuthology.orchestra.run.smithi053.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2023-06-10T18:38:15.412 INFO:teuthology.orchestra.run.smithi053.stdout:Recommended packages: 2023-06-10T18:38:15.412 INFO:teuthology.orchestra.run.smithi053.stdout: thermald 2023-06-10T18:38:15.468 INFO:teuthology.orchestra.run.smithi053.stdout:The following NEW packages will be installed: 2023-06-10T18:38:15.468 INFO:teuthology.orchestra.run.smithi053.stdout: linux-headers-5.15.0-73 linux-headers-5.15.0-73-generic 2023-06-10T18:38:15.469 INFO:teuthology.orchestra.run.smithi053.stdout: linux-image-5.15.0-73-generic linux-modules-5.15.0-73-generic 2023-06-10T18:38:15.469 INFO:teuthology.orchestra.run.smithi053.stdout: linux-modules-extra-5.15.0-73-generic 2023-06-10T18:38:15.470 INFO:teuthology.orchestra.run.smithi053.stdout:The following packages will be upgraded: 2023-06-10T18:38:15.470 INFO:teuthology.orchestra.run.smithi053.stdout: linux-generic linux-headers-generic linux-image-generic 2023-06-10T18:38:15.650 INFO:teuthology.orchestra.run.smithi053.stdout:3 upgraded, 5 newly installed, 0 to remove and 201 not upgraded. 2023-06-10T18:38:15.650 INFO:teuthology.orchestra.run.smithi053.stdout:Need to get 114 MB of archives. 2023-06-10T18:38:15.651 INFO:teuthology.orchestra.run.smithi053.stdout:After this operation, 596 MB of additional disk space will be used. 2023-06-10T18:38:15.651 INFO:teuthology.orchestra.run.smithi053.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-73-generic amd64 5.15.0-73.80 [23.2 MB] 2023-06-10T18:38:16.067 INFO:teuthology.orchestra.run.smithi117.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-73-generic amd64 5.15.0-73.80 [11.4 MB] 2023-06-10T18:38:16.411 INFO:teuthology.orchestra.run.smithi117.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-73-generic amd64 5.15.0-73.80 [64.2 MB] 2023-06-10T18:38:17.045 INFO:teuthology.orchestra.run.smithi053.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-73-generic amd64 5.15.0-73.80 [11.4 MB] 2023-06-10T18:38:17.400 INFO:teuthology.orchestra.run.smithi053.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-73-generic amd64 5.15.0-73.80 [64.2 MB] 2023-06-10T18:38:18.603 INFO:teuthology.orchestra.run.smithi117.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.73.71 [1,698 B] 2023-06-10T18:38:18.603 INFO:teuthology.orchestra.run.smithi117.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.73.71 [2,456 B] 2023-06-10T18:38:18.603 INFO:teuthology.orchestra.run.smithi117.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-73 all 5.15.0-73.80 [12.3 MB] 2023-06-10T18:38:19.597 INFO:teuthology.orchestra.run.smithi053.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.73.71 [1,698 B] 2023-06-10T18:38:19.598 INFO:teuthology.orchestra.run.smithi053.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.73.71 [2,456 B] 2023-06-10T18:38:19.598 INFO:teuthology.orchestra.run.smithi053.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-73 all 5.15.0-73.80 [12.3 MB] 2023-06-10T18:38:19.685 INFO:teuthology.orchestra.run.smithi117.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-73-generic amd64 5.15.0-73.80 [2,874 kB] 2023-06-10T18:38:19.825 INFO:teuthology.orchestra.run.smithi117.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.73.71 [2,312 B] 2023-06-10T18:38:20.219 INFO:teuthology.orchestra.run.smithi117.stdout:Fetched 114 MB in 5s (21.3 MB/s) 2023-06-10T18:38:20.388 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package linux-modules-5.15.0-73-generic. 2023-06-10T18:38:20.420 INFO:teuthology.orchestra.run.smithi053.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-73-generic amd64 5.15.0-73.80 [2,874 kB] 2023-06-10T18:38:20.547 INFO:teuthology.orchestra.run.smithi053.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.73.71 [2,312 B] 2023-06-10T18:38:20.941 INFO:teuthology.orchestra.run.smithi053.stdout:Fetched 114 MB in 5s (22.5 MB/s) 2023-06-10T18:38:21.141 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package linux-modules-5.15.0-73-generic. 2023-06-10T18:38:22.345 INFO:teuthology.orchestra.run.smithi117.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2023-06-10T18:38:22.349 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../0-linux-modules-5.15.0-73-generic_5.15.0-73.80_amd64.deb ... 2023-06-10T18:38:22.410 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking linux-modules-5.15.0-73-generic (5.15.0-73.80) ... 2023-06-10T18:38:23.169 INFO:teuthology.orchestra.run.smithi053.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2023-06-10T18:38:23.175 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../0-linux-modules-5.15.0-73-generic_5.15.0-73.80_amd64.deb ... 2023-06-10T18:38:23.272 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking linux-modules-5.15.0-73-generic (5.15.0-73.80) ... 2023-06-10T18:38:24.645 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package linux-image-5.15.0-73-generic. 2023-06-10T18:38:24.666 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../1-linux-image-5.15.0-73-generic_5.15.0-73.80_amd64.deb ... 2023-06-10T18:38:24.753 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking linux-image-5.15.0-73-generic (5.15.0-73.80) ... 2023-06-10T18:38:25.206 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-73-generic. 2023-06-10T18:38:25.226 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-73-generic_5.15.0-73.80_amd64.deb ... 2023-06-10T18:38:25.272 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking linux-modules-extra-5.15.0-73-generic (5.15.0-73.80) ... 2023-06-10T18:38:26.124 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package linux-image-5.15.0-73-generic. 2023-06-10T18:38:26.145 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../1-linux-image-5.15.0-73-generic_5.15.0-73.80_amd64.deb ... 2023-06-10T18:38:26.226 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking linux-image-5.15.0-73-generic (5.15.0-73.80) ... 2023-06-10T18:38:26.694 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-73-generic. 2023-06-10T18:38:26.715 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-73-generic_5.15.0-73.80_amd64.deb ... 2023-06-10T18:38:26.744 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking linux-modules-extra-5.15.0-73-generic (5.15.0-73.80) ... 2023-06-10T18:38:31.973 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../3-linux-generic_5.15.0.73.71_amd64.deb ... 2023-06-10T18:38:32.090 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking linux-generic (5.15.0.73.71) over (5.15.0.56.54) ... 2023-06-10T18:38:32.414 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.73.71_amd64.deb ... 2023-06-10T18:38:32.535 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking linux-image-generic (5.15.0.73.71) over (5.15.0.56.54) ... 2023-06-10T18:38:32.854 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package linux-headers-5.15.0-73. 2023-06-10T18:38:32.877 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../5-linux-headers-5.15.0-73_5.15.0-73.80_all.deb ... 2023-06-10T18:38:32.921 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking linux-headers-5.15.0-73 (5.15.0-73.80) ... 2023-06-10T18:38:33.080 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../3-linux-generic_5.15.0.73.71_amd64.deb ... 2023-06-10T18:38:33.200 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking linux-generic (5.15.0.73.71) over (5.15.0.56.54) ... 2023-06-10T18:38:33.491 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.73.71_amd64.deb ... 2023-06-10T18:38:33.619 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking linux-image-generic (5.15.0.73.71) over (5.15.0.56.54) ... 2023-06-10T18:38:33.964 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package linux-headers-5.15.0-73. 2023-06-10T18:38:33.987 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../5-linux-headers-5.15.0-73_5.15.0-73.80_all.deb ... 2023-06-10T18:38:34.031 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking linux-headers-5.15.0-73 (5.15.0-73.80) ... 2023-06-10T18:38:38.994 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package linux-headers-5.15.0-73-generic. 2023-06-10T18:38:39.030 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../6-linux-headers-5.15.0-73-generic_5.15.0-73.80_amd64.deb ... 2023-06-10T18:38:39.069 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking linux-headers-5.15.0-73-generic (5.15.0-73.80) ... 2023-06-10T18:38:39.696 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package linux-headers-5.15.0-73-generic. 2023-06-10T18:38:39.715 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../6-linux-headers-5.15.0-73-generic_5.15.0-73.80_amd64.deb ... 2023-06-10T18:38:39.754 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking linux-headers-5.15.0-73-generic (5.15.0-73.80) ... 2023-06-10T18:38:41.637 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.73.71_amd64.deb ... 2023-06-10T18:38:41.762 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking linux-headers-generic (5.15.0.73.71) over (5.15.0.56.54) ... 2023-06-10T18:38:42.086 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up linux-headers-5.15.0-73 (5.15.0-73.80) ... 2023-06-10T18:38:42.191 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up linux-headers-5.15.0-73-generic (5.15.0-73.80) ... 2023-06-10T18:38:42.292 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up linux-headers-generic (5.15.0.73.71) ... 2023-06-10T18:38:42.397 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up linux-image-5.15.0-73-generic (5.15.0-73.80) ... 2023-06-10T18:38:43.397 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.73.71_amd64.deb ... 2023-06-10T18:38:43.721 INFO:teuthology.orchestra.run.smithi117.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2023-06-10T18:38:43.722 INFO:teuthology.orchestra.run.smithi117.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2023-06-10T18:38:43.722 INFO:teuthology.orchestra.run.smithi117.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-73-generic 2023-06-10T18:38:43.722 INFO:teuthology.orchestra.run.smithi117.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-73-generic 2023-06-10T18:38:43.730 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking linux-headers-generic (5.15.0.73.71) over (5.15.0.56.54) ... 2023-06-10T18:38:43.881 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up linux-modules-5.15.0-73-generic (5.15.0-73.80) ... 2023-06-10T18:38:44.080 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up linux-headers-5.15.0-73 (5.15.0-73.80) ... 2023-06-10T18:38:44.201 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up linux-headers-5.15.0-73-generic (5.15.0-73.80) ... 2023-06-10T18:38:44.303 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up linux-headers-generic (5.15.0.73.71) ... 2023-06-10T18:38:44.432 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up linux-image-5.15.0-73-generic (5.15.0-73.80) ... 2023-06-10T18:38:45.265 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up linux-modules-extra-5.15.0-73-generic (5.15.0-73.80) ... 2023-06-10T18:38:45.810 INFO:teuthology.orchestra.run.smithi053.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2023-06-10T18:38:45.810 INFO:teuthology.orchestra.run.smithi053.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2023-06-10T18:38:45.810 INFO:teuthology.orchestra.run.smithi053.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-73-generic 2023-06-10T18:38:45.810 INFO:teuthology.orchestra.run.smithi053.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-73-generic 2023-06-10T18:38:45.983 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up linux-modules-5.15.0-73-generic (5.15.0-73.80) ... 2023-06-10T18:38:46.650 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up linux-image-generic (5.15.0.73.71) ... 2023-06-10T18:38:46.751 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up linux-generic (5.15.0.73.71) ... 2023-06-10T18:38:46.852 INFO:teuthology.orchestra.run.smithi117.stdout:Processing triggers for linux-image-5.15.0-73-generic (5.15.0-73.80) ... 2023-06-10T18:38:46.916 INFO:teuthology.orchestra.run.smithi117.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-06-10T18:38:46.916 INFO:teuthology.orchestra.run.smithi117.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-73-generic 2023-06-10T18:38:47.411 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up linux-modules-extra-5.15.0-73-generic (5.15.0-73.80) ... 2023-06-10T18:38:49.429 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up linux-image-generic (5.15.0.73.71) ... 2023-06-10T18:38:49.563 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up linux-generic (5.15.0.73.71) ... 2023-06-10T18:38:49.689 INFO:teuthology.orchestra.run.smithi053.stdout:Processing triggers for linux-image-5.15.0-73-generic (5.15.0-73.80) ... 2023-06-10T18:38:49.765 INFO:teuthology.orchestra.run.smithi053.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-06-10T18:38:49.765 INFO:teuthology.orchestra.run.smithi053.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-73-generic 2023-06-10T18:39:00.723 INFO:teuthology.orchestra.run.smithi117.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-06-10T18:39:00.724 INFO:teuthology.orchestra.run.smithi117.stdout:Sourcing file `/etc/default/grub' 2023-06-10T18:39:00.731 INFO:teuthology.orchestra.run.smithi117.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-06-10T18:39:00.750 INFO:teuthology.orchestra.run.smithi117.stdout:Generating grub configuration file ... 2023-06-10T18:39:01.051 INFO:teuthology.orchestra.run.smithi117.stdout:Found linux image: /boot/vmlinuz-5.15.0-73-generic 2023-06-10T18:39:01.074 INFO:teuthology.orchestra.run.smithi117.stdout:Found initrd image: /boot/initrd.img-5.15.0-73-generic 2023-06-10T18:39:01.356 INFO:teuthology.orchestra.run.smithi117.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-06-10T18:39:01.362 INFO:teuthology.orchestra.run.smithi117.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-06-10T18:39:01.428 INFO:teuthology.orchestra.run.smithi117.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-06-10T18:39:01.434 INFO:teuthology.orchestra.run.smithi117.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-06-10T18:39:01.600 INFO:teuthology.orchestra.run.smithi117.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2023-06-10T18:39:01.600 INFO:teuthology.orchestra.run.smithi117.stdout:Systems on them will not be added to the GRUB boot configuration. 2023-06-10T18:39:01.600 INFO:teuthology.orchestra.run.smithi117.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-06-10T18:39:01.649 INFO:teuthology.orchestra.run.smithi117.stdout:done 2023-06-10T18:39:02.167 DEBUG:teuthology.orchestra.run.smithi117:> dpkg -s linux-image-generic 2023-06-10T18:39:02.187 INFO:teuthology.orchestra.run.smithi117.stdout:Package: linux-image-generic 2023-06-10T18:39:02.187 INFO:teuthology.orchestra.run.smithi117.stdout:Status: install ok installed 2023-06-10T18:39:02.187 INFO:teuthology.orchestra.run.smithi117.stdout:Priority: optional 2023-06-10T18:39:02.187 INFO:teuthology.orchestra.run.smithi117.stdout:Section: kernel 2023-06-10T18:39:02.188 INFO:teuthology.orchestra.run.smithi117.stdout:Installed-Size: 20 2023-06-10T18:39:02.188 INFO:teuthology.orchestra.run.smithi117.stdout:Maintainer: Ubuntu Kernel Team 2023-06-10T18:39:02.188 INFO:teuthology.orchestra.run.smithi117.stdout:Architecture: amd64 2023-06-10T18:39:02.188 INFO:teuthology.orchestra.run.smithi117.stdout:Source: linux-meta 2023-06-10T18:39:02.188 INFO:teuthology.orchestra.run.smithi117.stdout:Version: 5.15.0.73.71 2023-06-10T18:39:02.188 INFO:teuthology.orchestra.run.smithi117.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-73), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-06-10T18:39:02.188 INFO:teuthology.orchestra.run.smithi117.stdout:Depends: linux-image-5.15.0-73-generic, linux-modules-extra-5.15.0-73-generic, linux-firmware, intel-microcode, amd64-microcode 2023-06-10T18:39:02.189 INFO:teuthology.orchestra.run.smithi117.stdout:Recommends: thermald 2023-06-10T18:39:02.189 INFO:teuthology.orchestra.run.smithi117.stdout:Description: Generic Linux kernel image 2023-06-10T18:39:02.189 INFO:teuthology.orchestra.run.smithi117.stdout: This package will always depend on the latest generic kernel image 2023-06-10T18:39:02.189 INFO:teuthology.orchestra.run.smithi117.stdout: available. 2023-06-10T18:39:02.189 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-73-generic 2023-06-10T18:39:02.190 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-06-10T18:39:02.190 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-06-10T18:39:02.190 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2023-06-10T18:39:02.190 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi117.front.sepia.ceph.com, path=None, version=distro) 2023-06-10T18:39:02.190 DEBUG:teuthology.orchestra.run.smithi117:> sudo apt-get clean 2023-06-10T18:39:02.345 DEBUG:teuthology.orchestra.run.smithi117:> sudo apt-get update 2023-06-10T18:39:02.600 INFO:teuthology.orchestra.run.smithi117.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-06-10T18:39:02.608 INFO:teuthology.orchestra.run.smithi117.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-06-10T18:39:02.670 INFO:teuthology.orchestra.run.smithi117.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-06-10T18:39:02.753 INFO:teuthology.orchestra.run.smithi117.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-06-10T18:39:03.836 INFO:teuthology.orchestra.run.smithi117.stdout:Reading package lists... 2023-06-10T18:39:03.853 DEBUG:teuthology.orchestra.run.smithi117:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-06-10T18:39:03.903 INFO:teuthology.orchestra.run.smithi117.stdout:Reading package lists... 2023-06-10T18:39:04.068 INFO:teuthology.orchestra.run.smithi117.stdout:Building dependency tree... 2023-06-10T18:39:04.069 INFO:teuthology.orchestra.run.smithi117.stdout:Reading state information... 2023-06-10T18:39:04.203 INFO:teuthology.orchestra.run.smithi117.stdout:linux-image-generic is already the newest version (5.15.0.73.71). 2023-06-10T18:39:04.203 INFO:teuthology.orchestra.run.smithi117.stdout:The following packages were automatically installed and are no longer required: 2023-06-10T18:39:04.203 INFO:teuthology.orchestra.run.smithi117.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-06-10T18:39:04.203 INFO:teuthology.orchestra.run.smithi117.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-06-10T18:39:04.203 INFO:teuthology.orchestra.run.smithi117.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-06-10T18:39:04.204 INFO:teuthology.orchestra.run.smithi117.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-06-10T18:39:04.204 INFO:teuthology.orchestra.run.smithi117.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-06-10T18:39:04.204 INFO:teuthology.orchestra.run.smithi117.stdout:Use 'sudo apt autoremove' to remove them. 2023-06-10T18:39:04.236 INFO:teuthology.orchestra.run.smithi117.stdout:0 upgraded, 0 newly installed, 0 to remove and 201 not upgraded. 2023-06-10T18:39:04.238 DEBUG:teuthology.orchestra.run.smithi117:> dpkg -s linux-image-generic 2023-06-10T18:39:04.291 INFO:teuthology.orchestra.run.smithi117.stdout:Package: linux-image-generic 2023-06-10T18:39:04.292 INFO:teuthology.orchestra.run.smithi117.stdout:Status: install ok installed 2023-06-10T18:39:04.292 INFO:teuthology.orchestra.run.smithi117.stdout:Priority: optional 2023-06-10T18:39:04.292 INFO:teuthology.orchestra.run.smithi117.stdout:Section: kernel 2023-06-10T18:39:04.293 INFO:teuthology.orchestra.run.smithi117.stdout:Installed-Size: 20 2023-06-10T18:39:04.293 INFO:teuthology.orchestra.run.smithi117.stdout:Maintainer: Ubuntu Kernel Team 2023-06-10T18:39:04.293 INFO:teuthology.orchestra.run.smithi117.stdout:Architecture: amd64 2023-06-10T18:39:04.294 INFO:teuthology.orchestra.run.smithi117.stdout:Source: linux-meta 2023-06-10T18:39:04.294 INFO:teuthology.orchestra.run.smithi117.stdout:Version: 5.15.0.73.71 2023-06-10T18:39:04.294 INFO:teuthology.orchestra.run.smithi117.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-73), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-06-10T18:39:04.294 INFO:teuthology.orchestra.run.smithi117.stdout:Depends: linux-image-5.15.0-73-generic, linux-modules-extra-5.15.0-73-generic, linux-firmware, intel-microcode, amd64-microcode 2023-06-10T18:39:04.295 INFO:teuthology.orchestra.run.smithi117.stdout:Recommends: thermald 2023-06-10T18:39:04.295 INFO:teuthology.orchestra.run.smithi117.stdout:Description: Generic Linux kernel image 2023-06-10T18:39:04.295 INFO:teuthology.orchestra.run.smithi117.stdout: This package will always depend on the latest generic kernel image 2023-06-10T18:39:04.296 INFO:teuthology.orchestra.run.smithi117.stdout: available. 2023-06-10T18:39:04.296 DEBUG:teuthology.orchestra.run.smithi117:> mktemp 2023-06-10T18:39:04.336 INFO:teuthology.orchestra.run.smithi117.stdout:/tmp/tmp.157sv3uiCb 2023-06-10T18:39:04.336 DEBUG:teuthology.orchestra.run.smithi117:> sudo cp /boot/grub/grub.cfg /tmp/tmp.157sv3uiCb 2023-06-10T18:39:04.392 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 0666 /tmp/tmp.157sv3uiCb 2023-06-10T18:39:04.429 INFO:teuthology.orchestra.run.smithi053.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-06-10T18:39:04.429 INFO:teuthology.orchestra.run.smithi053.stdout:Sourcing file `/etc/default/grub' 2023-06-10T18:39:04.451 INFO:teuthology.orchestra.run.smithi053.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-06-10T18:39:04.477 INFO:teuthology.orchestra.run.smithi053.stdout:Generating grub configuration file ... 2023-06-10T18:39:04.511 DEBUG:teuthology.orchestra.remote:smithi117:/tmp/tmp.157sv3uiCb is 10KB 2023-06-10T18:39:04.522 DEBUG:teuthology.orchestra.run.smithi117:> rm -fr /tmp/tmp.157sv3uiCb 2023-06-10T18:39:04.527 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-06-10T18:39:04.580 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T18:39:04.580 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-06-10T18:39:04.580 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-06-10T18:39:04.654 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-73-generic 2023-06-10T18:39:04.654 DEBUG:teuthology.orchestra.run.smithi117:> sudo update-grub 2023-06-10T18:39:04.714 INFO:teuthology.orchestra.run.smithi053.stdout:Found linux image: /boot/vmlinuz-5.15.0-73-generic 2023-06-10T18:39:04.741 INFO:teuthology.orchestra.run.smithi053.stdout:Found initrd image: /boot/initrd.img-5.15.0-73-generic 2023-06-10T18:39:05.074 INFO:teuthology.orchestra.run.smithi053.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-06-10T18:39:05.079 INFO:teuthology.orchestra.run.smithi053.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-06-10T18:39:05.145 INFO:teuthology.orchestra.run.smithi053.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-06-10T18:39:05.151 INFO:teuthology.orchestra.run.smithi053.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-06-10T18:39:05.314 INFO:teuthology.orchestra.run.smithi053.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2023-06-10T18:39:05.315 INFO:teuthology.orchestra.run.smithi053.stdout:Systems on them will not be added to the GRUB boot configuration. 2023-06-10T18:39:05.315 INFO:teuthology.orchestra.run.smithi053.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-06-10T18:39:05.353 INFO:teuthology.orchestra.run.smithi053.stdout:done 2023-06-10T18:39:05.727 INFO:teuthology.orchestra.run.smithi117.stderr:Sourcing file `/etc/default/grub' 2023-06-10T18:39:05.728 INFO:teuthology.orchestra.run.smithi117.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-06-10T18:39:05.731 INFO:teuthology.orchestra.run.smithi117.stderr:Generating grub configuration file ... 2023-06-10T18:39:05.826 DEBUG:teuthology.orchestra.run.smithi053:> dpkg -s linux-image-generic 2023-06-10T18:39:05.912 INFO:teuthology.orchestra.run.smithi117.stderr:Found linux image: /boot/vmlinuz-5.15.0-73-generic 2023-06-10T18:39:05.918 INFO:teuthology.orchestra.run.smithi117.stderr:Found initrd image: /boot/initrd.img-5.15.0-73-generic 2023-06-10T18:39:05.952 INFO:teuthology.orchestra.run.smithi053.stdout:Package: linux-image-generic 2023-06-10T18:39:05.952 INFO:teuthology.orchestra.run.smithi053.stdout:Status: install ok installed 2023-06-10T18:39:05.953 INFO:teuthology.orchestra.run.smithi053.stdout:Priority: optional 2023-06-10T18:39:05.953 INFO:teuthology.orchestra.run.smithi053.stdout:Section: kernel 2023-06-10T18:39:05.953 INFO:teuthology.orchestra.run.smithi053.stdout:Installed-Size: 20 2023-06-10T18:39:05.953 INFO:teuthology.orchestra.run.smithi053.stdout:Maintainer: Ubuntu Kernel Team 2023-06-10T18:39:05.953 INFO:teuthology.orchestra.run.smithi053.stdout:Architecture: amd64 2023-06-10T18:39:05.953 INFO:teuthology.orchestra.run.smithi053.stdout:Source: linux-meta 2023-06-10T18:39:05.953 INFO:teuthology.orchestra.run.smithi053.stdout:Version: 5.15.0.73.71 2023-06-10T18:39:05.954 INFO:teuthology.orchestra.run.smithi053.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-73), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-06-10T18:39:05.954 INFO:teuthology.orchestra.run.smithi053.stdout:Depends: linux-image-5.15.0-73-generic, linux-modules-extra-5.15.0-73-generic, linux-firmware, intel-microcode, amd64-microcode 2023-06-10T18:39:05.954 INFO:teuthology.orchestra.run.smithi053.stdout:Recommends: thermald 2023-06-10T18:39:05.954 INFO:teuthology.orchestra.run.smithi053.stdout:Description: Generic Linux kernel image 2023-06-10T18:39:05.954 INFO:teuthology.orchestra.run.smithi053.stdout: This package will always depend on the latest generic kernel image 2023-06-10T18:39:05.954 INFO:teuthology.orchestra.run.smithi053.stdout: available. 2023-06-10T18:39:05.955 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-73-generic 2023-06-10T18:39:05.955 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-06-10T18:39:05.956 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-06-10T18:39:05.956 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-06-10T18:39:05.956 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi053.front.sepia.ceph.com, path=None, version=distro) 2023-06-10T18:39:05.956 DEBUG:teuthology.orchestra.run.smithi053:> sudo apt-get clean 2023-06-10T18:39:06.089 DEBUG:teuthology.orchestra.run.smithi053:> sudo apt-get update 2023-06-10T18:39:06.200 INFO:teuthology.orchestra.run.smithi117.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-06-10T18:39:06.206 INFO:teuthology.orchestra.run.smithi117.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-06-10T18:39:06.246 INFO:teuthology.orchestra.run.smithi117.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-06-10T18:39:06.251 INFO:teuthology.orchestra.run.smithi117.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-06-10T18:39:06.340 INFO:teuthology.orchestra.run.smithi053.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-06-10T18:39:06.341 INFO:teuthology.orchestra.run.smithi053.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-06-10T18:39:06.350 INFO:teuthology.orchestra.run.smithi117.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-06-10T18:39:06.350 INFO:teuthology.orchestra.run.smithi117.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-06-10T18:39:06.350 INFO:teuthology.orchestra.run.smithi117.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-06-10T18:39:06.358 INFO:teuthology.orchestra.run.smithi117.stderr:done 2023-06-10T18:39:06.360 DEBUG:teuthology.orchestra.run.smithi117:> sudo shutdown -r now 2023-06-10T18:39:06.410 INFO:teuthology.orchestra.run.smithi053.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-06-10T18:39:06.492 INFO:teuthology.orchestra.run.smithi053.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-06-10T18:39:07.597 INFO:teuthology.orchestra.run.smithi053.stdout:Reading package lists... 2023-06-10T18:39:07.617 DEBUG:teuthology.orchestra.run.smithi053:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-06-10T18:39:07.679 INFO:teuthology.orchestra.run.smithi053.stdout:Reading package lists... 2023-06-10T18:39:07.852 INFO:teuthology.orchestra.run.smithi053.stdout:Building dependency tree... 2023-06-10T18:39:07.853 INFO:teuthology.orchestra.run.smithi053.stdout:Reading state information... 2023-06-10T18:39:08.006 INFO:teuthology.orchestra.run.smithi053.stdout:linux-image-generic is already the newest version (5.15.0.73.71). 2023-06-10T18:39:08.006 INFO:teuthology.orchestra.run.smithi053.stdout:The following packages were automatically installed and are no longer required: 2023-06-10T18:39:08.007 INFO:teuthology.orchestra.run.smithi053.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-06-10T18:39:08.007 INFO:teuthology.orchestra.run.smithi053.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-06-10T18:39:08.007 INFO:teuthology.orchestra.run.smithi053.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-06-10T18:39:08.007 INFO:teuthology.orchestra.run.smithi053.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-06-10T18:39:08.008 INFO:teuthology.orchestra.run.smithi053.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-06-10T18:39:08.008 INFO:teuthology.orchestra.run.smithi053.stdout:Use 'sudo apt autoremove' to remove them. 2023-06-10T18:39:08.041 INFO:teuthology.orchestra.run.smithi053.stdout:0 upgraded, 0 newly installed, 0 to remove and 201 not upgraded. 2023-06-10T18:39:08.043 DEBUG:teuthology.orchestra.run.smithi053:> dpkg -s linux-image-generic 2023-06-10T18:39:08.060 INFO:teuthology.orchestra.run.smithi053.stdout:Package: linux-image-generic 2023-06-10T18:39:08.060 INFO:teuthology.orchestra.run.smithi053.stdout:Status: install ok installed 2023-06-10T18:39:08.060 INFO:teuthology.orchestra.run.smithi053.stdout:Priority: optional 2023-06-10T18:39:08.061 INFO:teuthology.orchestra.run.smithi053.stdout:Section: kernel 2023-06-10T18:39:08.061 INFO:teuthology.orchestra.run.smithi053.stdout:Installed-Size: 20 2023-06-10T18:39:08.061 INFO:teuthology.orchestra.run.smithi053.stdout:Maintainer: Ubuntu Kernel Team 2023-06-10T18:39:08.061 INFO:teuthology.orchestra.run.smithi053.stdout:Architecture: amd64 2023-06-10T18:39:08.061 INFO:teuthology.orchestra.run.smithi053.stdout:Source: linux-meta 2023-06-10T18:39:08.062 INFO:teuthology.orchestra.run.smithi053.stdout:Version: 5.15.0.73.71 2023-06-10T18:39:08.062 INFO:teuthology.orchestra.run.smithi053.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-73), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-06-10T18:39:08.062 INFO:teuthology.orchestra.run.smithi053.stdout:Depends: linux-image-5.15.0-73-generic, linux-modules-extra-5.15.0-73-generic, linux-firmware, intel-microcode, amd64-microcode 2023-06-10T18:39:08.062 INFO:teuthology.orchestra.run.smithi053.stdout:Recommends: thermald 2023-06-10T18:39:08.062 INFO:teuthology.orchestra.run.smithi053.stdout:Description: Generic Linux kernel image 2023-06-10T18:39:08.062 INFO:teuthology.orchestra.run.smithi053.stdout: This package will always depend on the latest generic kernel image 2023-06-10T18:39:08.062 INFO:teuthology.orchestra.run.smithi053.stdout: available. 2023-06-10T18:39:08.063 DEBUG:teuthology.orchestra.run.smithi053:> mktemp 2023-06-10T18:39:08.105 INFO:teuthology.orchestra.run.smithi053.stdout:/tmp/tmp.5IiiD1Ijq6 2023-06-10T18:39:08.105 DEBUG:teuthology.orchestra.run.smithi053:> sudo cp /boot/grub/grub.cfg /tmp/tmp.5IiiD1Ijq6 2023-06-10T18:39:08.172 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 0666 /tmp/tmp.5IiiD1Ijq6 2023-06-10T18:39:08.284 DEBUG:teuthology.orchestra.remote:smithi053:/tmp/tmp.5IiiD1Ijq6 is 10KB 2023-06-10T18:39:08.297 DEBUG:teuthology.orchestra.run.smithi053:> rm -fr /tmp/tmp.5IiiD1Ijq6 2023-06-10T18:39:08.303 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-06-10T18:39:08.357 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T18:39:08.358 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-06-10T18:39:08.358 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-06-10T18:39:08.444 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-73-generic 2023-06-10T18:39:08.444 DEBUG:teuthology.orchestra.run.smithi053:> sudo update-grub 2023-06-10T18:39:09.612 INFO:teuthology.orchestra.run.smithi053.stderr:Sourcing file `/etc/default/grub' 2023-06-10T18:39:09.613 INFO:teuthology.orchestra.run.smithi053.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-06-10T18:39:09.616 INFO:teuthology.orchestra.run.smithi053.stderr:Generating grub configuration file ... 2023-06-10T18:39:09.923 INFO:teuthology.orchestra.run.smithi053.stderr:Found linux image: /boot/vmlinuz-5.15.0-73-generic 2023-06-10T18:39:09.929 INFO:teuthology.orchestra.run.smithi053.stderr:Found initrd image: /boot/initrd.img-5.15.0-73-generic 2023-06-10T18:39:10.353 INFO:teuthology.orchestra.run.smithi053.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-06-10T18:39:10.359 INFO:teuthology.orchestra.run.smithi053.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-06-10T18:39:10.408 INFO:teuthology.orchestra.run.smithi053.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-06-10T18:39:10.414 INFO:teuthology.orchestra.run.smithi053.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-06-10T18:39:10.535 INFO:teuthology.orchestra.run.smithi053.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-06-10T18:39:10.536 INFO:teuthology.orchestra.run.smithi053.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-06-10T18:39:10.536 INFO:teuthology.orchestra.run.smithi053.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-06-10T18:39:10.548 INFO:teuthology.orchestra.run.smithi053.stderr:done 2023-06-10T18:39:10.549 DEBUG:teuthology.orchestra.run.smithi053:> sudo shutdown -r now 2023-06-10T18:39:36.430 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-06-10T18:39:36.430 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2023-06-10T18:39:36.431 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-10T18:39:40.599 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-06-10T18:39:40.600 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com' 2023-06-10T18:39:40.600 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-10T18:39:54.996 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.117 2023-06-10T18:39:59.088 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.53 2023-06-10T18:40:25.020 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2023-06-10T18:40:25.021 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-10T18:40:28.080 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.117 2023-06-10T18:40:29.090 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com' 2023-06-10T18:40:29.090 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-10T18:40:47.472 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.53 2023-06-10T18:40:58.092 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2023-06-10T18:40:58.093 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-10T18:40:58.460 DEBUG:teuthology.orchestra.run.smithi117:> true 2023-06-10T18:40:59.101 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi117.front.sepia.ceph.com' 2023-06-10T18:40:59.101 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-73-generic"... 2023-06-10T18:40:59.101 DEBUG:teuthology.orchestra.run.smithi117:> uname -r 2023-06-10T18:40:59.149 INFO:teuthology.orchestra.run.smithi117.stdout:5.15.0-73-generic 2023-06-10T18:40:59.150 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-73-generic vs 5.15.0-73-generic 2023-06-10T18:40:59.150 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-06-10T18:40:59.150 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-06-10T18:41:00.151 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-06-10T18:41:00.152 DEBUG:teuthology.orchestra.run.smithi117:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-06-10T18:41:00.485 INFO:teuthology.orchestra.run.smithi117.stdout:ttyS1 2023-06-10T18:41:00.519 DEBUG:teuthology.parallel:result is None 2023-06-10T18:41:17.474 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com' 2023-06-10T18:41:17.474 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-10T18:41:17.804 DEBUG:teuthology.orchestra.run.smithi053:> true 2023-06-10T18:41:18.428 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi053.front.sepia.ceph.com' 2023-06-10T18:41:18.428 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-73-generic"... 2023-06-10T18:41:18.429 DEBUG:teuthology.orchestra.run.smithi053:> uname -r 2023-06-10T18:41:18.477 INFO:teuthology.orchestra.run.smithi053.stdout:5.15.0-73-generic 2023-06-10T18:41:18.478 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-73-generic vs 5.15.0-73-generic 2023-06-10T18:41:18.478 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-06-10T18:41:18.478 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-06-10T18:41:19.479 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-06-10T18:41:19.480 DEBUG:teuthology.orchestra.run.smithi053:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-06-10T18:41:19.560 INFO:teuthology.orchestra.run.smithi053.stdout:ttyS1 2023-06-10T18:41:19.590 DEBUG:teuthology.parallel:result is None 2023-06-10T18:41:19.591 INFO:teuthology.run_tasks:Running task internal.base... 2023-06-10T18:41:19.598 INFO:teuthology.task.internal:Creating test directory... 2023-06-10T18:41:19.598 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-06-10T18:41:19.601 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-06-10T18:41:19.606 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-06-10T18:41:19.637 INFO:teuthology.run_tasks:Running task internal.archive... 2023-06-10T18:41:19.687 INFO:teuthology.task.internal:Creating archive directory... 2023-06-10T18:41:19.688 DEBUG:teuthology.orchestra.run.smithi053:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-06-10T18:41:19.690 DEBUG:teuthology.orchestra.run.smithi117:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-06-10T18:41:19.713 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-06-10T18:41:19.737 INFO:teuthology.task.internal:Enabling coredump saving... 2023-06-10T18:41:19.738 DEBUG:teuthology.orchestra.run.smithi053:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-06-10T18:41:19.746 DEBUG:teuthology.orchestra.run.smithi117:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-06-10T18:41:19.771 INFO:teuthology.orchestra.run.smithi117.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-10T18:41:19.772 INFO:teuthology.orchestra.run.smithi053.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-10T18:41:19.779 INFO:teuthology.orchestra.run.smithi117.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-10T18:41:19.779 INFO:teuthology.orchestra.run.smithi053.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-10T18:41:19.781 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-06-10T18:41:19.787 INFO:teuthology.task.internal:Configuring sudo... 2023-06-10T18:41:19.788 DEBUG:teuthology.orchestra.run.smithi053:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-06-10T18:41:19.830 DEBUG:teuthology.orchestra.run.smithi117:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-06-10T18:41:19.842 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-06-10T18:41:19.851 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-06-10T18:41:19.852 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-06-10T18:41:19.886 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-06-10T18:41:19.891 DEBUG:teuthology.orchestra.run.smithi053:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-06-10T18:41:19.937 DEBUG:teuthology.orchestra.run.smithi053:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-06-10T18:41:19.985 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T18:41:19.986 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-06-10T18:41:20.051 DEBUG:teuthology.orchestra.run.smithi117:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-06-10T18:41:20.057 DEBUG:teuthology.orchestra.run.smithi117:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-06-10T18:41:20.105 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T18:41:20.105 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-06-10T18:41:20.173 DEBUG:teuthology.orchestra.run.smithi053:> sudo service rsyslog restart 2023-06-10T18:41:20.175 DEBUG:teuthology.orchestra.run.smithi117:> sudo service rsyslog restart 2023-06-10T18:41:20.268 INFO:teuthology.run_tasks:Running task internal.timer... 2023-06-10T18:41:20.275 INFO:teuthology.task.internal:Starting timer... 2023-06-10T18:41:20.276 INFO:teuthology.run_tasks:Running task pcp... 2023-06-10T18:41:20.299 INFO:teuthology.run_tasks:Running task selinux... 2023-06-10T18:41:20.348 DEBUG:teuthology.task.selinux:Excluding smithi053: OS 'ubuntu' does not support SELinux 2023-06-10T18:41:20.349 DEBUG:teuthology.task.selinux:Excluding smithi117: OS 'ubuntu' does not support SELinux 2023-06-10T18:41:20.349 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-06-10T18:41:20.349 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-06-10T18:41:20.350 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-06-10T18:41:20.350 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-06-10T18:41:20.399 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-06-10T18:41:20.400 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-06-10T18:41:20.423 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-06-10T18:41:20.425 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi053.front.sepia.ceph.com,smithi117.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-06-10T18:48:58.482 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi053.front.sepia.ceph.com'), Remote(name='ubuntu@smithi117.front.sepia.ceph.com')] 2023-06-10T18:48:58.502 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com' 2023-06-10T18:48:58.503 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-10T18:48:58.620 DEBUG:teuthology.orchestra.run.smithi053:> true 2023-06-10T18:48:58.728 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2023-06-10T18:48:58.729 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-10T18:48:58.806 DEBUG:teuthology.orchestra.run.smithi117:> true 2023-06-10T18:48:58.920 INFO:teuthology.run_tasks:Running task clock... 2023-06-10T18:48:58.935 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-06-10T18:48:58.935 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-06-10T18:48:58.938 DEBUG:teuthology.orchestra.run.smithi053:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-06-10T18:48:58.941 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-06-10T18:48:58.941 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-06-10T18:48:58.970 INFO:teuthology.orchestra.run.smithi053.stdout:10 Jun 18:48:58 ntpd[27244]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-06-10T18:48:58.971 INFO:teuthology.orchestra.run.smithi053.stdout:10 Jun 18:48:58 ntpd[27244]: Command line: ntpd -gq 2023-06-10T18:48:58.971 INFO:teuthology.orchestra.run.smithi053.stdout:10 Jun 18:48:58 ntpd[27244]: ---------------------------------------------------- 2023-06-10T18:48:58.971 INFO:teuthology.orchestra.run.smithi053.stdout:10 Jun 18:48:58 ntpd[27244]: ntp-4 is maintained by Network Time Foundation, 2023-06-10T18:48:58.972 INFO:teuthology.orchestra.run.smithi053.stdout:10 Jun 18:48:58 ntpd[27244]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-06-10T18:48:58.972 INFO:teuthology.orchestra.run.smithi053.stdout:10 Jun 18:48:58 ntpd[27244]: corporation. Support and training for ntp-4 are 2023-06-10T18:48:58.972 INFO:teuthology.orchestra.run.smithi053.stdout:10 Jun 18:48:58 ntpd[27244]: available at https://www.nwtime.org/support 2023-06-10T18:48:58.972 INFO:teuthology.orchestra.run.smithi053.stdout:10 Jun 18:48:58 ntpd[27244]: ---------------------------------------------------- 2023-06-10T18:48:58.973 INFO:teuthology.orchestra.run.smithi053.stdout:10 Jun 18:48:58 ntpd[27244]: proto: precision = 0.063 usec (-24) 2023-06-10T18:48:58.973 INFO:teuthology.orchestra.run.smithi053.stdout:10 Jun 18:48:58 ntpd[27244]: basedate set to 2022-02-04 2023-06-10T18:48:58.973 INFO:teuthology.orchestra.run.smithi053.stdout:10 Jun 18:48:58 ntpd[27244]: gps base set to 2022-02-06 (week 2196) 2023-06-10T18:48:58.974 INFO:teuthology.orchestra.run.smithi053.stdout:10 Jun 18:48:58 ntpd[27244]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-06-10T18:48:58.974 INFO:teuthology.orchestra.run.smithi053.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-06-10T18:48:58.975 INFO:teuthology.orchestra.run.smithi053.stderr:restrict ::: KOD does nothing without LIMITED. 2023-06-10T18:48:58.976 INFO:teuthology.orchestra.run.smithi053.stdout:10 Jun 18:48:58 ntpd[27244]: restrict ::: KOD does nothing without LIMITED. 2023-06-10T18:48:58.976 INFO:teuthology.orchestra.run.smithi053.stdout:10 Jun 18:48:58 ntpd[27244]: Listen and drop on 0 v6wildcard [::]:123 2023-06-10T18:48:58.976 INFO:teuthology.orchestra.run.smithi053.stdout:10 Jun 18:48:58 ntpd[27244]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-06-10T18:48:58.977 INFO:teuthology.orchestra.run.smithi053.stdout:10 Jun 18:48:58 ntpd[27244]: Listen normally on 2 lo 127.0.0.1:123 2023-06-10T18:48:58.977 INFO:teuthology.orchestra.run.smithi053.stdout:10 Jun 18:48:58 ntpd[27244]: Listen normally on 3 ens1f0 172.21.15.53:123 2023-06-10T18:48:58.977 INFO:teuthology.orchestra.run.smithi053.stdout:10 Jun 18:48:58 ntpd[27244]: Listen normally on 4 lo [::1]:123 2023-06-10T18:48:58.977 INFO:teuthology.orchestra.run.smithi053.stdout:10 Jun 18:48:58 ntpd[27244]: Listen normally on 5 ens1f0 [fe80::ae1f:6bff:fef8:3718%4]:123 2023-06-10T18:48:58.978 INFO:teuthology.orchestra.run.smithi053.stdout:10 Jun 18:48:58 ntpd[27244]: Listening on routing socket on fd #22 for interface updates 2023-06-10T18:48:58.988 INFO:teuthology.orchestra.run.smithi117.stdout:10 Jun 18:48:58 ntpd[27368]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-06-10T18:48:58.988 INFO:teuthology.orchestra.run.smithi117.stdout:10 Jun 18:48:58 ntpd[27368]: Command line: ntpd -gq 2023-06-10T18:48:58.988 INFO:teuthology.orchestra.run.smithi117.stdout:10 Jun 18:48:58 ntpd[27368]: ---------------------------------------------------- 2023-06-10T18:48:58.988 INFO:teuthology.orchestra.run.smithi117.stdout:10 Jun 18:48:58 ntpd[27368]: ntp-4 is maintained by Network Time Foundation, 2023-06-10T18:48:58.988 INFO:teuthology.orchestra.run.smithi117.stdout:10 Jun 18:48:58 ntpd[27368]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-06-10T18:48:58.988 INFO:teuthology.orchestra.run.smithi117.stdout:10 Jun 18:48:58 ntpd[27368]: corporation. Support and training for ntp-4 are 2023-06-10T18:48:58.989 INFO:teuthology.orchestra.run.smithi117.stdout:10 Jun 18:48:58 ntpd[27368]: available at https://www.nwtime.org/support 2023-06-10T18:48:58.989 INFO:teuthology.orchestra.run.smithi117.stdout:10 Jun 18:48:58 ntpd[27368]: ---------------------------------------------------- 2023-06-10T18:48:58.989 INFO:teuthology.orchestra.run.smithi117.stdout:10 Jun 18:48:58 ntpd[27368]: proto: precision = 0.044 usec (-24) 2023-06-10T18:48:58.990 INFO:teuthology.orchestra.run.smithi117.stdout:10 Jun 18:48:58 ntpd[27368]: basedate set to 2022-02-04 2023-06-10T18:48:58.990 INFO:teuthology.orchestra.run.smithi117.stdout:10 Jun 18:48:58 ntpd[27368]: gps base set to 2022-02-06 (week 2196) 2023-06-10T18:48:58.990 INFO:teuthology.orchestra.run.smithi117.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-06-10T18:48:58.991 INFO:teuthology.orchestra.run.smithi117.stdout:10 Jun 18:48:58 ntpd[27368]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-06-10T18:48:58.992 INFO:teuthology.orchestra.run.smithi117.stdout:10 Jun 18:48:58 ntpd[27368]: restrict ::: KOD does nothing without LIMITED. 2023-06-10T18:48:58.992 INFO:teuthology.orchestra.run.smithi117.stderr:restrict ::: KOD does nothing without LIMITED. 2023-06-10T18:48:58.994 INFO:teuthology.orchestra.run.smithi117.stdout:10 Jun 18:48:58 ntpd[27368]: Listen and drop on 0 v6wildcard [::]:123 2023-06-10T18:48:58.994 INFO:teuthology.orchestra.run.smithi117.stdout:10 Jun 18:48:58 ntpd[27368]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-06-10T18:48:58.995 INFO:teuthology.orchestra.run.smithi117.stdout:10 Jun 18:48:58 ntpd[27368]: Listen normally on 2 lo 127.0.0.1:123 2023-06-10T18:48:58.995 INFO:teuthology.orchestra.run.smithi117.stdout:10 Jun 18:48:58 ntpd[27368]: Listen normally on 3 enp3s0f1 172.21.15.117:123 2023-06-10T18:48:58.995 INFO:teuthology.orchestra.run.smithi117.stdout:10 Jun 18:48:58 ntpd[27368]: Listen normally on 4 lo [::1]:123 2023-06-10T18:48:58.995 INFO:teuthology.orchestra.run.smithi117.stdout:10 Jun 18:48:58 ntpd[27368]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:4463%5]:123 2023-06-10T18:48:58.996 INFO:teuthology.orchestra.run.smithi117.stdout:10 Jun 18:48:58 ntpd[27368]: Listening on routing socket on fd #22 for interface updates 2023-06-10T18:48:59.970 INFO:teuthology.orchestra.run.smithi053.stderr:10 Jun 18:48:59 ntpd[27244]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-10T18:48:59.971 INFO:teuthology.orchestra.run.smithi053.stderr:10 Jun 18:48:59 ntpd[27244]: can't open /var/log/ntpstats/rawstats.20230610: Permission denied 2023-06-10T18:48:59.971 INFO:teuthology.orchestra.run.smithi053.stderr:10 Jun 18:48:59 ntpd[27244]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-10T18:48:59.971 INFO:teuthology.orchestra.run.smithi053.stderr:10 Jun 18:48:59 ntpd[27244]: can't open /var/log/ntpstats/rawstats.20230610: Permission denied 2023-06-10T18:48:59.972 INFO:teuthology.orchestra.run.smithi053.stderr:10 Jun 18:48:59 ntpd[27244]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-10T18:48:59.972 INFO:teuthology.orchestra.run.smithi053.stderr:10 Jun 18:48:59 ntpd[27244]: can't open /var/log/ntpstats/rawstats.20230610: Permission denied 2023-06-10T18:48:59.972 INFO:teuthology.orchestra.run.smithi053.stderr:10 Jun 18:48:59 ntpd[27244]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-10T18:48:59.972 INFO:teuthology.orchestra.run.smithi053.stderr:10 Jun 18:48:59 ntpd[27244]: can't open /var/log/ntpstats/peerstats.20230610: Permission denied 2023-06-10T18:48:59.988 INFO:teuthology.orchestra.run.smithi117.stderr:10 Jun 18:48:59 ntpd[27368]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-10T18:48:59.989 INFO:teuthology.orchestra.run.smithi117.stderr:10 Jun 18:48:59 ntpd[27368]: can't open /var/log/ntpstats/rawstats.20230610: Permission denied 2023-06-10T18:48:59.989 INFO:teuthology.orchestra.run.smithi117.stderr:10 Jun 18:48:59 ntpd[27368]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-10T18:48:59.989 INFO:teuthology.orchestra.run.smithi117.stderr:10 Jun 18:48:59 ntpd[27368]: can't open /var/log/ntpstats/rawstats.20230610: Permission denied 2023-06-10T18:48:59.989 INFO:teuthology.orchestra.run.smithi117.stderr:10 Jun 18:48:59 ntpd[27368]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-10T18:48:59.989 INFO:teuthology.orchestra.run.smithi117.stderr:10 Jun 18:48:59 ntpd[27368]: can't open /var/log/ntpstats/peerstats.20230610: Permission denied 2023-06-10T18:49:00.988 INFO:teuthology.orchestra.run.smithi117.stderr:10 Jun 18:49:00 ntpd[27368]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-10T18:49:00.989 INFO:teuthology.orchestra.run.smithi117.stderr:10 Jun 18:49:00 ntpd[27368]: can't open /var/log/ntpstats/rawstats.20230610: Permission denied 2023-06-10T18:49:00.989 INFO:teuthology.orchestra.run.smithi117.stderr:10 Jun 18:49:00 ntpd[27368]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-10T18:49:00.989 INFO:teuthology.orchestra.run.smithi117.stderr:10 Jun 18:49:00 ntpd[27368]: can't open /var/log/ntpstats/rawstats.20230610: Permission denied 2023-06-10T18:49:00.989 INFO:teuthology.orchestra.run.smithi117.stderr:10 Jun 18:49:00 ntpd[27368]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-10T18:49:00.989 INFO:teuthology.orchestra.run.smithi117.stderr:10 Jun 18:49:00 ntpd[27368]: can't open /var/log/ntpstats/rawstats.20230610: Permission denied 2023-06-10T18:49:00.989 INFO:teuthology.orchestra.run.smithi117.stderr:10 Jun 18:49:00 ntpd[27368]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-10T18:49:00.989 INFO:teuthology.orchestra.run.smithi117.stderr:10 Jun 18:49:00 ntpd[27368]: can't open /var/log/ntpstats/peerstats.20230610: Permission denied 2023-06-10T18:49:00.990 INFO:teuthology.orchestra.run.smithi117.stderr:10 Jun 18:49:00 ntpd[27368]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-10T18:49:00.990 INFO:teuthology.orchestra.run.smithi117.stderr:10 Jun 18:49:00 ntpd[27368]: can't open /var/log/ntpstats/rawstats.20230610: Permission denied 2023-06-10T18:49:00.990 INFO:teuthology.orchestra.run.smithi117.stderr:10 Jun 18:49:00 ntpd[27368]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-10T18:49:00.990 INFO:teuthology.orchestra.run.smithi117.stderr:10 Jun 18:49:00 ntpd[27368]: can't open /var/log/ntpstats/peerstats.20230610: Permission denied 2023-06-10T18:49:01.970 INFO:teuthology.orchestra.run.smithi053.stderr:10 Jun 18:49:01 ntpd[27244]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-10T18:49:01.970 INFO:teuthology.orchestra.run.smithi053.stderr:10 Jun 18:49:01 ntpd[27244]: can't open /var/log/ntpstats/rawstats.20230610: Permission denied 2023-06-10T18:49:01.971 INFO:teuthology.orchestra.run.smithi053.stderr:10 Jun 18:49:01 ntpd[27244]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-10T18:49:01.971 INFO:teuthology.orchestra.run.smithi053.stderr:10 Jun 18:49:01 ntpd[27244]: can't open /var/log/ntpstats/rawstats.20230610: Permission denied 2023-06-10T18:49:01.971 INFO:teuthology.orchestra.run.smithi053.stderr:10 Jun 18:49:01 ntpd[27244]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-10T18:49:01.971 INFO:teuthology.orchestra.run.smithi053.stderr:10 Jun 18:49:01 ntpd[27244]: can't open /var/log/ntpstats/peerstats.20230610: Permission denied 2023-06-10T18:49:01.988 INFO:teuthology.orchestra.run.smithi117.stderr:10 Jun 18:49:01 ntpd[27368]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-10T18:49:01.989 INFO:teuthology.orchestra.run.smithi117.stderr:10 Jun 18:49:01 ntpd[27368]: can't open /var/log/ntpstats/rawstats.20230610: Permission denied 2023-06-10T18:49:01.989 INFO:teuthology.orchestra.run.smithi117.stderr:10 Jun 18:49:01 ntpd[27368]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-10T18:49:01.989 INFO:teuthology.orchestra.run.smithi117.stderr:10 Jun 18:49:01 ntpd[27368]: can't open /var/log/ntpstats/rawstats.20230610: Permission denied 2023-06-10T18:49:01.989 INFO:teuthology.orchestra.run.smithi117.stderr:10 Jun 18:49:01 ntpd[27368]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-10T18:49:01.989 INFO:teuthology.orchestra.run.smithi117.stderr:10 Jun 18:49:01 ntpd[27368]: can't open /var/log/ntpstats/rawstats.20230610: Permission denied 2023-06-10T18:49:01.989 INFO:teuthology.orchestra.run.smithi117.stderr:10 Jun 18:49:01 ntpd[27368]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-10T18:49:01.989 INFO:teuthology.orchestra.run.smithi117.stderr:10 Jun 18:49:01 ntpd[27368]: can't open /var/log/ntpstats/peerstats.20230610: Permission denied 2023-06-10T18:49:02.989 INFO:teuthology.orchestra.run.smithi117.stderr:10 Jun 18:49:02 ntpd[27368]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-10T18:49:02.990 INFO:teuthology.orchestra.run.smithi117.stderr:10 Jun 18:49:02 ntpd[27368]: can't open /var/log/ntpstats/rawstats.20230610: Permission denied 2023-06-10T18:49:02.990 INFO:teuthology.orchestra.run.smithi117.stderr:10 Jun 18:49:02 ntpd[27368]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-10T18:49:02.990 INFO:teuthology.orchestra.run.smithi117.stderr:10 Jun 18:49:02 ntpd[27368]: can't open /var/log/ntpstats/rawstats.20230610: Permission denied 2023-06-10T18:49:02.990 INFO:teuthology.orchestra.run.smithi117.stderr:10 Jun 18:49:02 ntpd[27368]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-10T18:49:02.990 INFO:teuthology.orchestra.run.smithi117.stderr:10 Jun 18:49:02 ntpd[27368]: can't open /var/log/ntpstats/rawstats.20230610: Permission denied 2023-06-10T18:49:02.990 INFO:teuthology.orchestra.run.smithi117.stderr:10 Jun 18:49:02 ntpd[27368]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-10T18:49:02.991 INFO:teuthology.orchestra.run.smithi117.stderr:10 Jun 18:49:02 ntpd[27368]: can't open /var/log/ntpstats/peerstats.20230610: Permission denied 2023-06-10T18:49:02.991 INFO:teuthology.orchestra.run.smithi117.stderr:10 Jun 18:49:02 ntpd[27368]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-10T18:49:02.991 INFO:teuthology.orchestra.run.smithi117.stderr:10 Jun 18:49:02 ntpd[27368]: can't open /var/log/ntpstats/rawstats.20230610: Permission denied 2023-06-10T18:49:02.991 INFO:teuthology.orchestra.run.smithi117.stderr:10 Jun 18:49:02 ntpd[27368]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-10T18:49:02.991 INFO:teuthology.orchestra.run.smithi117.stderr:10 Jun 18:49:02 ntpd[27368]: can't open /var/log/ntpstats/peerstats.20230610: Permission denied 2023-06-10T18:49:03.975 INFO:teuthology.orchestra.run.smithi053.stderr:10 Jun 18:49:03 ntpd[27244]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-10T18:49:03.976 INFO:teuthology.orchestra.run.smithi053.stderr:10 Jun 18:49:03 ntpd[27244]: can't open /var/log/ntpstats/rawstats.20230610: Permission denied 2023-06-10T18:49:03.976 INFO:teuthology.orchestra.run.smithi053.stderr:10 Jun 18:49:03 ntpd[27244]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-10T18:49:03.978 INFO:teuthology.orchestra.run.smithi053.stderr:10 Jun 18:49:03 ntpd[27244]: can't open /var/log/ntpstats/rawstats.20230610: Permission denied 2023-06-10T18:49:03.978 INFO:teuthology.orchestra.run.smithi053.stderr:10 Jun 18:49:03 ntpd[27244]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-10T18:49:03.978 INFO:teuthology.orchestra.run.smithi053.stderr:10 Jun 18:49:03 ntpd[27244]: can't open /var/log/ntpstats/rawstats.20230610: Permission denied 2023-06-10T18:49:03.978 INFO:teuthology.orchestra.run.smithi053.stderr:10 Jun 18:49:03 ntpd[27244]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-10T18:49:03.979 INFO:teuthology.orchestra.run.smithi053.stderr:10 Jun 18:49:03 ntpd[27244]: can't open /var/log/ntpstats/rawstats.20230610: Permission denied 2023-06-10T18:49:03.979 INFO:teuthology.orchestra.run.smithi053.stderr:10 Jun 18:49:03 ntpd[27244]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-10T18:49:03.979 INFO:teuthology.orchestra.run.smithi053.stderr:10 Jun 18:49:03 ntpd[27244]: can't open /var/log/ntpstats/peerstats.20230610: Permission denied 2023-06-10T18:49:03.979 INFO:teuthology.orchestra.run.smithi053.stderr:10 Jun 18:49:03 ntpd[27244]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-10T18:49:03.980 INFO:teuthology.orchestra.run.smithi053.stderr:10 Jun 18:49:03 ntpd[27244]: can't open /var/log/ntpstats/rawstats.20230610: Permission denied 2023-06-10T18:49:03.980 INFO:teuthology.orchestra.run.smithi053.stderr:10 Jun 18:49:03 ntpd[27244]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-10T18:49:03.980 INFO:teuthology.orchestra.run.smithi053.stderr:10 Jun 18:49:03 ntpd[27244]: can't open /var/log/ntpstats/peerstats.20230610: Permission denied 2023-06-10T18:49:03.980 INFO:teuthology.orchestra.run.smithi053.stderr:10 Jun 18:49:03 ntpd[27244]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-10T18:49:03.981 INFO:teuthology.orchestra.run.smithi053.stderr:10 Jun 18:49:03 ntpd[27244]: can't open /var/log/ntpstats/rawstats.20230610: Permission denied 2023-06-10T18:49:03.982 INFO:teuthology.orchestra.run.smithi053.stderr:10 Jun 18:49:03 ntpd[27244]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-10T18:49:03.982 INFO:teuthology.orchestra.run.smithi053.stderr:10 Jun 18:49:03 ntpd[27244]: can't open /var/log/ntpstats/peerstats.20230610: Permission denied 2023-06-10T18:49:03.989 INFO:teuthology.orchestra.run.smithi117.stderr:10 Jun 18:49:03 ntpd[27368]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-10T18:49:03.989 INFO:teuthology.orchestra.run.smithi117.stderr:10 Jun 18:49:03 ntpd[27368]: can't open /var/log/ntpstats/rawstats.20230610: Permission denied 2023-06-10T18:49:03.990 INFO:teuthology.orchestra.run.smithi117.stderr:10 Jun 18:49:03 ntpd[27368]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-10T18:49:03.990 INFO:teuthology.orchestra.run.smithi117.stderr:10 Jun 18:49:03 ntpd[27368]: can't open /var/log/ntpstats/rawstats.20230610: Permission denied 2023-06-10T18:49:03.990 INFO:teuthology.orchestra.run.smithi117.stderr:10 Jun 18:49:03 ntpd[27368]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-10T18:49:03.990 INFO:teuthology.orchestra.run.smithi117.stderr:10 Jun 18:49:03 ntpd[27368]: can't open /var/log/ntpstats/peerstats.20230610: Permission denied 2023-06-10T18:49:04.988 INFO:teuthology.orchestra.run.smithi117.stderr:10 Jun 18:49:04 ntpd[27368]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-10T18:49:04.989 INFO:teuthology.orchestra.run.smithi117.stderr:10 Jun 18:49:04 ntpd[27368]: can't open /var/log/ntpstats/rawstats.20230610: Permission denied 2023-06-10T18:49:04.989 INFO:teuthology.orchestra.run.smithi117.stderr:10 Jun 18:49:04 ntpd[27368]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-10T18:49:04.989 INFO:teuthology.orchestra.run.smithi117.stderr:10 Jun 18:49:04 ntpd[27368]: can't open /var/log/ntpstats/rawstats.20230610: Permission denied 2023-06-10T18:49:04.989 INFO:teuthology.orchestra.run.smithi117.stderr:10 Jun 18:49:04 ntpd[27368]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-10T18:49:04.989 INFO:teuthology.orchestra.run.smithi117.stderr:10 Jun 18:49:04 ntpd[27368]: can't open /var/log/ntpstats/rawstats.20230610: Permission denied 2023-06-10T18:49:04.990 INFO:teuthology.orchestra.run.smithi117.stderr:10 Jun 18:49:04 ntpd[27368]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-10T18:49:04.990 INFO:teuthology.orchestra.run.smithi117.stderr:10 Jun 18:49:04 ntpd[27368]: can't open /var/log/ntpstats/peerstats.20230610: Permission denied 2023-06-10T18:49:04.990 INFO:teuthology.orchestra.run.smithi117.stderr:10 Jun 18:49:04 ntpd[27368]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-10T18:49:04.990 INFO:teuthology.orchestra.run.smithi117.stderr:10 Jun 18:49:04 ntpd[27368]: can't open /var/log/ntpstats/rawstats.20230610: Permission denied 2023-06-10T18:49:04.990 INFO:teuthology.orchestra.run.smithi117.stderr:10 Jun 18:49:04 ntpd[27368]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-10T18:49:04.990 INFO:teuthology.orchestra.run.smithi117.stderr:10 Jun 18:49:04 ntpd[27368]: can't open /var/log/ntpstats/peerstats.20230610: Permission denied 2023-06-10T18:49:05.970 INFO:teuthology.orchestra.run.smithi053.stderr:10 Jun 18:49:05 ntpd[27244]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-10T18:49:05.971 INFO:teuthology.orchestra.run.smithi053.stderr:10 Jun 18:49:05 ntpd[27244]: can't open /var/log/ntpstats/rawstats.20230610: Permission denied 2023-06-10T18:49:05.971 INFO:teuthology.orchestra.run.smithi053.stderr:10 Jun 18:49:05 ntpd[27244]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-10T18:49:05.971 INFO:teuthology.orchestra.run.smithi053.stderr:10 Jun 18:49:05 ntpd[27244]: can't open /var/log/ntpstats/rawstats.20230610: Permission denied 2023-06-10T18:49:05.972 INFO:teuthology.orchestra.run.smithi053.stderr:10 Jun 18:49:05 ntpd[27244]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-10T18:49:05.972 INFO:teuthology.orchestra.run.smithi053.stderr:10 Jun 18:49:05 ntpd[27244]: can't open /var/log/ntpstats/rawstats.20230610: Permission denied 2023-06-10T18:49:05.972 INFO:teuthology.orchestra.run.smithi053.stderr:10 Jun 18:49:05 ntpd[27244]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-10T18:49:05.972 INFO:teuthology.orchestra.run.smithi053.stderr:10 Jun 18:49:05 ntpd[27244]: can't open /var/log/ntpstats/rawstats.20230610: Permission denied 2023-06-10T18:49:05.972 INFO:teuthology.orchestra.run.smithi053.stderr:10 Jun 18:49:05 ntpd[27244]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-10T18:49:05.972 INFO:teuthology.orchestra.run.smithi053.stderr:10 Jun 18:49:05 ntpd[27244]: can't open /var/log/ntpstats/peerstats.20230610: Permission denied 2023-06-10T18:49:05.973 INFO:teuthology.orchestra.run.smithi053.stdout:10 Jun 18:49:05 ntpd[27244]: ntpd: time slew -0.005306 s 2023-06-10T18:49:05.973 INFO:teuthology.orchestra.run.smithi053.stdout:ntpd: time slew -0.005306s 2023-06-10T18:49:05.973 INFO:teuthology.orchestra.run.smithi053.stderr:10 Jun 18:49:05 ntpd[27244]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-06-10T18:49:05.973 INFO:teuthology.orchestra.run.smithi053.stderr:10 Jun 18:49:05 ntpd[27244]: can't open /var/log/ntpstats/loopstats.20230610: Permission denied 2023-06-10T18:49:05.989 INFO:teuthology.orchestra.run.smithi117.stderr:10 Jun 18:49:05 ntpd[27368]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-10T18:49:05.989 INFO:teuthology.orchestra.run.smithi117.stderr:10 Jun 18:49:05 ntpd[27368]: can't open /var/log/ntpstats/rawstats.20230610: Permission denied 2023-06-10T18:49:05.989 INFO:teuthology.orchestra.run.smithi117.stderr:10 Jun 18:49:05 ntpd[27368]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-10T18:49:05.990 INFO:teuthology.orchestra.run.smithi117.stderr:10 Jun 18:49:05 ntpd[27368]: can't open /var/log/ntpstats/rawstats.20230610: Permission denied 2023-06-10T18:49:05.990 INFO:teuthology.orchestra.run.smithi117.stderr:10 Jun 18:49:05 ntpd[27368]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-10T18:49:05.990 INFO:teuthology.orchestra.run.smithi117.stderr:10 Jun 18:49:05 ntpd[27368]: can't open /var/log/ntpstats/peerstats.20230610: Permission denied 2023-06-10T18:49:05.991 INFO:teuthology.orchestra.run.smithi117.stdout:10 Jun 18:49:05 ntpd[27368]: ntpd: time slew -0.005234 s 2023-06-10T18:49:05.991 INFO:teuthology.orchestra.run.smithi117.stdout:ntpd: time slew -0.005234s 2023-06-10T18:49:05.992 INFO:teuthology.orchestra.run.smithi117.stderr:10 Jun 18:49:05 ntpd[27368]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-06-10T18:49:05.992 INFO:teuthology.orchestra.run.smithi117.stderr:10 Jun 18:49:05 ntpd[27368]: can't open /var/log/ntpstats/loopstats.20230610: Permission denied 2023-06-10T18:49:06.047 INFO:teuthology.orchestra.run.smithi053.stdout: remote refid st t when poll reach delay offset jitter 2023-06-10T18:49:06.047 INFO:teuthology.orchestra.run.smithi053.stdout:============================================================================== 2023-06-10T18:49:06.048 INFO:teuthology.orchestra.run.smithi053.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-06-10T18:49:06.048 INFO:teuthology.orchestra.run.smithi053.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-06-10T18:49:06.048 INFO:teuthology.orchestra.run.smithi053.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-06-10T18:49:06.048 INFO:teuthology.orchestra.run.smithi053.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-06-10T18:49:06.084 INFO:teuthology.orchestra.run.smithi117.stdout: remote refid st t when poll reach delay offset jitter 2023-06-10T18:49:06.084 INFO:teuthology.orchestra.run.smithi117.stdout:============================================================================== 2023-06-10T18:49:06.084 INFO:teuthology.orchestra.run.smithi117.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-06-10T18:49:06.085 INFO:teuthology.orchestra.run.smithi117.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-06-10T18:49:06.085 INFO:teuthology.orchestra.run.smithi117.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-06-10T18:49:06.085 INFO:teuthology.orchestra.run.smithi117.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-06-10T18:49:06.086 INFO:teuthology.run_tasks:Running task install... 2023-06-10T18:49:06.094 DEBUG:teuthology.task.install:project ceph 2023-06-10T18:49:06.095 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '219d315c3a0b2075e570fb1964be2ad33fe7a9c8'}} 2023-06-10T18:49:06.095 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '219d315c3a0b2075e570fb1964be2ad33fe7a9c8'} 2023-06-10T18:49:06.095 INFO:teuthology.task.install:Using flavor: default 2023-06-10T18:49:06.122 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-06-10T18:49:06.122 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-06-10T18:49:06.123 DEBUG:teuthology.orchestra.run.smithi053:> sudo apt-key list | grep Ceph 2023-06-10T18:49:06.123 DEBUG:teuthology.orchestra.run.smithi117:> sudo apt-key list | grep Ceph 2023-06-10T18:49:06.182 INFO:teuthology.orchestra.run.smithi117.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-06-10T18:49:06.185 INFO:teuthology.orchestra.run.smithi053.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-06-10T18:49:06.209 INFO:teuthology.orchestra.run.smithi117.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-06-10T18:49:06.210 INFO:teuthology.orchestra.run.smithi117.stdout:uid [ unknown] Ceph.com (release key) 2023-06-10T18:49:06.210 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-06-10T18:49:06.210 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-06-10T18:49:06.211 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=219d315c3a0b2075e570fb1964be2ad33fe7a9c8 2023-06-10T18:49:06.216 INFO:teuthology.orchestra.run.smithi053.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-06-10T18:49:06.216 INFO:teuthology.orchestra.run.smithi053.stdout:uid [ unknown] Ceph.com (release key) 2023-06-10T18:49:06.217 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-06-10T18:49:06.217 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-06-10T18:49:06.217 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=219d315c3a0b2075e570fb1964be2ad33fe7a9c8 2023-06-10T18:49:06.360 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/main/219d315c3a0b2075e570fb1964be2ad33fe7a9c8/ubuntu/jammy/flavors/default/ 2023-06-10T18:49:06.360 INFO:teuthology.task.install.deb:Package version is 18.0.0-4359-g219d315c-1jammy 2023-06-10T18:49:06.456 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/main/219d315c3a0b2075e570fb1964be2ad33fe7a9c8/ubuntu/jammy/flavors/default/ 2023-06-10T18:49:06.456 INFO:teuthology.task.install.deb:Package version is 18.0.0-4359-g219d315c-1jammy 2023-06-10T18:49:06.469 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T18:49:06.469 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-06-10T18:49:06.483 DEBUG:teuthology.orchestra.run.smithi053:> sudo apt-get update 2023-06-10T18:49:06.668 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T18:49:06.669 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-06-10T18:49:06.671 INFO:teuthology.orchestra.run.smithi053.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-06-10T18:49:06.683 DEBUG:teuthology.orchestra.run.smithi117:> sudo apt-get update 2023-06-10T18:49:06.773 INFO:teuthology.orchestra.run.smithi053.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-06-10T18:49:06.812 INFO:teuthology.orchestra.run.smithi053.stdout:Ign:3 https://1.chacra.ceph.com/r/ceph/main/219d315c3a0b2075e570fb1964be2ad33fe7a9c8/ubuntu/jammy/flavors/default jammy InRelease 2023-06-10T18:49:06.857 INFO:teuthology.orchestra.run.smithi053.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-06-10T18:49:06.857 INFO:teuthology.orchestra.run.smithi053.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/main/219d315c3a0b2075e570fb1964be2ad33fe7a9c8/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-06-10T18:49:06.904 INFO:teuthology.orchestra.run.smithi053.stdout:Ign:6 https://1.chacra.ceph.com/r/ceph/main/219d315c3a0b2075e570fb1964be2ad33fe7a9c8/ubuntu/jammy/flavors/default jammy Release.gpg 2023-06-10T18:49:06.936 INFO:teuthology.orchestra.run.smithi053.stdout:Hit:7 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-06-10T18:49:06.951 INFO:teuthology.orchestra.run.smithi053.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/main/219d315c3a0b2075e570fb1964be2ad33fe7a9c8/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,419 B] 2023-06-10T18:49:06.978 INFO:teuthology.orchestra.run.smithi117.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-06-10T18:49:06.978 INFO:teuthology.orchestra.run.smithi117.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-06-10T18:49:07.002 INFO:teuthology.orchestra.run.smithi117.stdout:Ign:3 https://1.chacra.ceph.com/r/ceph/main/219d315c3a0b2075e570fb1964be2ad33fe7a9c8/ubuntu/jammy/flavors/default jammy InRelease 2023-06-10T18:49:07.002 INFO:teuthology.orchestra.run.smithi053.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/main/219d315c3a0b2075e570fb1964be2ad33fe7a9c8/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2023-06-10T18:49:07.049 INFO:teuthology.orchestra.run.smithi117.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/main/219d315c3a0b2075e570fb1964be2ad33fe7a9c8/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-06-10T18:49:07.051 INFO:teuthology.orchestra.run.smithi117.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-06-10T18:49:07.076 INFO:teuthology.orchestra.run.smithi053.stdout:Fetched 28.5 kB in 0s (68.8 kB/s) 2023-06-10T18:49:07.097 INFO:teuthology.orchestra.run.smithi117.stdout:Ign:6 https://1.chacra.ceph.com/r/ceph/main/219d315c3a0b2075e570fb1964be2ad33fe7a9c8/ubuntu/jammy/flavors/default jammy Release.gpg 2023-06-10T18:49:07.137 INFO:teuthology.orchestra.run.smithi117.stdout:Hit:7 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-06-10T18:49:07.144 INFO:teuthology.orchestra.run.smithi117.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/main/219d315c3a0b2075e570fb1964be2ad33fe7a9c8/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2023-06-10T18:49:07.241 INFO:teuthology.orchestra.run.smithi117.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/main/219d315c3a0b2075e570fb1964be2ad33fe7a9c8/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,419 B] 2023-06-10T18:49:07.336 INFO:teuthology.orchestra.run.smithi117.stdout:Fetched 28.5 kB in 0s (59.7 kB/s) 2023-06-10T18:49:07.879 INFO:teuthology.orchestra.run.smithi053.stdout:Reading package lists... 2023-06-10T18:49:07.896 DEBUG:teuthology.orchestra.run.smithi053:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-4359-g219d315c-1jammy cephadm=18.0.0-4359-g219d315c-1jammy ceph-mds=18.0.0-4359-g219d315c-1jammy ceph-mgr=18.0.0-4359-g219d315c-1jammy ceph-common=18.0.0-4359-g219d315c-1jammy ceph-fuse=18.0.0-4359-g219d315c-1jammy ceph-test=18.0.0-4359-g219d315c-1jammy ceph-volume=18.0.0-4359-g219d315c-1jammy radosgw=18.0.0-4359-g219d315c-1jammy python3-rados=18.0.0-4359-g219d315c-1jammy python3-rgw=18.0.0-4359-g219d315c-1jammy python3-cephfs=18.0.0-4359-g219d315c-1jammy python3-rbd=18.0.0-4359-g219d315c-1jammy libcephfs2=18.0.0-4359-g219d315c-1jammy libcephfs-dev=18.0.0-4359-g219d315c-1jammy librados2=18.0.0-4359-g219d315c-1jammy librbd1=18.0.0-4359-g219d315c-1jammy rbd-fuse=18.0.0-4359-g219d315c-1jammy python3-cephfs=18.0.0-4359-g219d315c-1jammy cephfs-shell=18.0.0-4359-g219d315c-1jammy cephfs-top=18.0.0-4359-g219d315c-1jammy cephfs-mirror=18.0.0-4359-g219d315c-1jammy 2023-06-10T18:49:07.956 INFO:teuthology.orchestra.run.smithi053.stdout:Reading package lists... 2023-06-10T18:49:08.062 INFO:teuthology.orchestra.run.smithi117.stdout:Reading package lists... 2023-06-10T18:49:08.079 DEBUG:teuthology.orchestra.run.smithi117:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-4359-g219d315c-1jammy cephadm=18.0.0-4359-g219d315c-1jammy ceph-mds=18.0.0-4359-g219d315c-1jammy ceph-mgr=18.0.0-4359-g219d315c-1jammy ceph-common=18.0.0-4359-g219d315c-1jammy ceph-fuse=18.0.0-4359-g219d315c-1jammy ceph-test=18.0.0-4359-g219d315c-1jammy ceph-volume=18.0.0-4359-g219d315c-1jammy radosgw=18.0.0-4359-g219d315c-1jammy python3-rados=18.0.0-4359-g219d315c-1jammy python3-rgw=18.0.0-4359-g219d315c-1jammy python3-cephfs=18.0.0-4359-g219d315c-1jammy python3-rbd=18.0.0-4359-g219d315c-1jammy libcephfs2=18.0.0-4359-g219d315c-1jammy libcephfs-dev=18.0.0-4359-g219d315c-1jammy librados2=18.0.0-4359-g219d315c-1jammy librbd1=18.0.0-4359-g219d315c-1jammy rbd-fuse=18.0.0-4359-g219d315c-1jammy python3-cephfs=18.0.0-4359-g219d315c-1jammy cephfs-shell=18.0.0-4359-g219d315c-1jammy cephfs-top=18.0.0-4359-g219d315c-1jammy cephfs-mirror=18.0.0-4359-g219d315c-1jammy 2023-06-10T18:49:08.132 INFO:teuthology.orchestra.run.smithi053.stdout:Building dependency tree... 2023-06-10T18:49:08.133 INFO:teuthology.orchestra.run.smithi053.stdout:Reading state information... 2023-06-10T18:49:08.139 INFO:teuthology.orchestra.run.smithi117.stdout:Reading package lists... 2023-06-10T18:49:08.298 INFO:teuthology.orchestra.run.smithi053.stdout:The following packages were automatically installed and are no longer required: 2023-06-10T18:49:08.298 INFO:teuthology.orchestra.run.smithi053.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-06-10T18:49:08.298 INFO:teuthology.orchestra.run.smithi053.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-06-10T18:49:08.299 INFO:teuthology.orchestra.run.smithi053.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-06-10T18:49:08.299 INFO:teuthology.orchestra.run.smithi053.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-06-10T18:49:08.300 INFO:teuthology.orchestra.run.smithi053.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-06-10T18:49:08.300 INFO:teuthology.orchestra.run.smithi053.stdout:Use 'sudo apt autoremove' to remove them. 2023-06-10T18:49:08.300 INFO:teuthology.orchestra.run.smithi053.stdout:The following additional packages will be installed: 2023-06-10T18:49:08.301 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-06-10T18:49:08.301 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-06-10T18:49:08.301 INFO:teuthology.orchestra.run.smithi053.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-06-10T18:49:08.301 INFO:teuthology.orchestra.run.smithi053.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-06-10T18:49:08.301 INFO:teuthology.orchestra.run.smithi053.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-06-10T18:49:08.301 INFO:teuthology.orchestra.run.smithi053.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-06-10T18:49:08.301 INFO:teuthology.orchestra.run.smithi053.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-06-10T18:49:08.302 INFO:teuthology.orchestra.run.smithi053.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-06-10T18:49:08.302 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-06-10T18:49:08.302 INFO:teuthology.orchestra.run.smithi053.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-06-10T18:49:08.302 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-06-10T18:49:08.303 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-06-10T18:49:08.303 INFO:teuthology.orchestra.run.smithi053.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-06-10T18:49:08.303 INFO:teuthology.orchestra.run.smithi053.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-06-10T18:49:08.303 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-06-10T18:49:08.303 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-06-10T18:49:08.304 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-06-10T18:49:08.304 INFO:teuthology.orchestra.run.smithi053.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-06-10T18:49:08.304 INFO:teuthology.orchestra.run.smithi053.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-06-10T18:49:08.304 INFO:teuthology.orchestra.run.smithi053.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-06-10T18:49:08.304 INFO:teuthology.orchestra.run.smithi053.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-06-10T18:49:08.304 INFO:teuthology.orchestra.run.smithi053.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-06-10T18:49:08.305 INFO:teuthology.orchestra.run.smithi053.stdout: qttranslations5-l10n socat xmlstarlet 2023-06-10T18:49:08.305 INFO:teuthology.orchestra.run.smithi053.stdout:Suggested packages: 2023-06-10T18:49:08.305 INFO:teuthology.orchestra.run.smithi053.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-06-10T18:49:08.305 INFO:teuthology.orchestra.run.smithi053.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-06-10T18:49:08.305 INFO:teuthology.orchestra.run.smithi053.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-06-10T18:49:08.306 INFO:teuthology.orchestra.run.smithi053.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-06-10T18:49:08.306 INFO:teuthology.orchestra.run.smithi053.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-06-10T18:49:08.306 INFO:teuthology.orchestra.run.smithi053.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-06-10T18:49:08.306 INFO:teuthology.orchestra.run.smithi053.stdout: python3-watchdog 2023-06-10T18:49:08.306 INFO:teuthology.orchestra.run.smithi053.stdout:Recommended packages: 2023-06-10T18:49:08.306 INFO:teuthology.orchestra.run.smithi053.stdout: btrfs-tools 2023-06-10T18:49:08.313 INFO:teuthology.orchestra.run.smithi117.stdout:Building dependency tree... 2023-06-10T18:49:08.313 INFO:teuthology.orchestra.run.smithi117.stdout:Reading state information... 2023-06-10T18:49:08.407 INFO:teuthology.orchestra.run.smithi053.stdout:The following NEW packages will be installed: 2023-06-10T18:49:08.407 INFO:teuthology.orchestra.run.smithi053.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-06-10T18:49:08.408 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-06-10T18:49:08.408 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-06-10T18:49:08.410 INFO:teuthology.orchestra.run.smithi053.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-06-10T18:49:08.410 INFO:teuthology.orchestra.run.smithi053.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-06-10T18:49:08.410 INFO:teuthology.orchestra.run.smithi053.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-06-10T18:49:08.410 INFO:teuthology.orchestra.run.smithi053.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2023-06-10T18:49:08.411 INFO:teuthology.orchestra.run.smithi053.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-06-10T18:49:08.411 INFO:teuthology.orchestra.run.smithi053.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-06-10T18:49:08.411 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-06-10T18:49:08.411 INFO:teuthology.orchestra.run.smithi053.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-06-10T18:49:08.412 INFO:teuthology.orchestra.run.smithi053.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-06-10T18:49:08.412 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-06-10T18:49:08.412 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-06-10T18:49:08.413 INFO:teuthology.orchestra.run.smithi053.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-06-10T18:49:08.413 INFO:teuthology.orchestra.run.smithi053.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-06-10T18:49:08.413 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-06-10T18:49:08.413 INFO:teuthology.orchestra.run.smithi053.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-06-10T18:49:08.413 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-06-10T18:49:08.413 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-06-10T18:49:08.413 INFO:teuthology.orchestra.run.smithi053.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-06-10T18:49:08.413 INFO:teuthology.orchestra.run.smithi053.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-06-10T18:49:08.414 INFO:teuthology.orchestra.run.smithi053.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-06-10T18:49:08.414 INFO:teuthology.orchestra.run.smithi053.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-06-10T18:49:08.414 INFO:teuthology.orchestra.run.smithi053.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-06-10T18:49:08.414 INFO:teuthology.orchestra.run.smithi053.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-06-10T18:49:08.415 INFO:teuthology.orchestra.run.smithi053.stdout: socat xmlstarlet 2023-06-10T18:49:08.468 INFO:teuthology.orchestra.run.smithi053.stdout:0 upgraded, 115 newly installed, 0 to remove and 189 not upgraded. 2023-06-10T18:49:08.468 INFO:teuthology.orchestra.run.smithi053.stdout:Need to get 183 MB of archives. 2023-06-10T18:49:08.468 INFO:teuthology.orchestra.run.smithi053.stdout:After this operation, 820 MB of additional disk space will be used. 2023-06-10T18:49:08.468 INFO:teuthology.orchestra.run.smithi053.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-06-10T18:49:08.471 INFO:teuthology.orchestra.run.smithi117.stdout:The following packages were automatically installed and are no longer required: 2023-06-10T18:49:08.471 INFO:teuthology.orchestra.run.smithi117.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-06-10T18:49:08.471 INFO:teuthology.orchestra.run.smithi117.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-06-10T18:49:08.472 INFO:teuthology.orchestra.run.smithi117.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-06-10T18:49:08.472 INFO:teuthology.orchestra.run.smithi117.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-06-10T18:49:08.472 INFO:teuthology.orchestra.run.smithi117.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-06-10T18:49:08.472 INFO:teuthology.orchestra.run.smithi117.stdout:Use 'sudo apt autoremove' to remove them. 2023-06-10T18:49:08.473 INFO:teuthology.orchestra.run.smithi117.stdout:The following additional packages will be installed: 2023-06-10T18:49:08.473 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-06-10T18:49:08.474 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-06-10T18:49:08.474 INFO:teuthology.orchestra.run.smithi117.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-06-10T18:49:08.474 INFO:teuthology.orchestra.run.smithi117.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-06-10T18:49:08.474 INFO:teuthology.orchestra.run.smithi117.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-06-10T18:49:08.474 INFO:teuthology.orchestra.run.smithi117.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-06-10T18:49:08.474 INFO:teuthology.orchestra.run.smithi117.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-06-10T18:49:08.474 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-06-10T18:49:08.475 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-06-10T18:49:08.475 INFO:teuthology.orchestra.run.smithi117.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-06-10T18:49:08.475 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-06-10T18:49:08.475 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-06-10T18:49:08.475 INFO:teuthology.orchestra.run.smithi117.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-06-10T18:49:08.475 INFO:teuthology.orchestra.run.smithi117.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-06-10T18:49:08.475 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-06-10T18:49:08.475 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-06-10T18:49:08.476 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-06-10T18:49:08.476 INFO:teuthology.orchestra.run.smithi117.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-06-10T18:49:08.476 INFO:teuthology.orchestra.run.smithi117.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-06-10T18:49:08.476 INFO:teuthology.orchestra.run.smithi117.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-06-10T18:49:08.477 INFO:teuthology.orchestra.run.smithi117.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-06-10T18:49:08.477 INFO:teuthology.orchestra.run.smithi117.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-06-10T18:49:08.477 INFO:teuthology.orchestra.run.smithi117.stdout: qttranslations5-l10n socat xmlstarlet 2023-06-10T18:49:08.477 INFO:teuthology.orchestra.run.smithi117.stdout:Suggested packages: 2023-06-10T18:49:08.477 INFO:teuthology.orchestra.run.smithi117.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-06-10T18:49:08.478 INFO:teuthology.orchestra.run.smithi117.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-06-10T18:49:08.478 INFO:teuthology.orchestra.run.smithi117.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-06-10T18:49:08.478 INFO:teuthology.orchestra.run.smithi117.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-06-10T18:49:08.478 INFO:teuthology.orchestra.run.smithi117.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-06-10T18:49:08.478 INFO:teuthology.orchestra.run.smithi117.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-06-10T18:49:08.478 INFO:teuthology.orchestra.run.smithi117.stdout: python3-watchdog 2023-06-10T18:49:08.479 INFO:teuthology.orchestra.run.smithi117.stdout:Recommended packages: 2023-06-10T18:49:08.479 INFO:teuthology.orchestra.run.smithi117.stdout: btrfs-tools 2023-06-10T18:49:08.485 INFO:teuthology.orchestra.run.smithi053.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-06-10T18:49:08.495 INFO:teuthology.orchestra.run.smithi053.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-06-10T18:49:08.536 INFO:teuthology.orchestra.run.smithi053.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2023-06-10T18:49:08.544 INFO:teuthology.orchestra.run.smithi053.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-06-10T18:49:08.551 INFO:teuthology.orchestra.run.smithi053.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/main/219d315c3a0b2075e570fb1964be2ad33fe7a9c8/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-4359-g219d315c-1jammy [3,401 kB] 2023-06-10T18:49:08.560 INFO:teuthology.orchestra.run.smithi053.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-06-10T18:49:08.562 INFO:teuthology.orchestra.run.smithi053.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-06-10T18:49:08.574 INFO:teuthology.orchestra.run.smithi053.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-06-10T18:49:08.575 INFO:teuthology.orchestra.run.smithi117.stdout:The following NEW packages will be installed: 2023-06-10T18:49:08.576 INFO:teuthology.orchestra.run.smithi117.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-06-10T18:49:08.576 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-06-10T18:49:08.576 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-06-10T18:49:08.577 INFO:teuthology.orchestra.run.smithi117.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-06-10T18:49:08.577 INFO:teuthology.orchestra.run.smithi117.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-06-10T18:49:08.578 INFO:teuthology.orchestra.run.smithi117.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-06-10T18:49:08.578 INFO:teuthology.orchestra.run.smithi117.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2023-06-10T18:49:08.578 INFO:teuthology.orchestra.run.smithi117.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-06-10T18:49:08.578 INFO:teuthology.orchestra.run.smithi117.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-06-10T18:49:08.578 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-06-10T18:49:08.578 INFO:teuthology.orchestra.run.smithi117.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-06-10T18:49:08.578 INFO:teuthology.orchestra.run.smithi117.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-06-10T18:49:08.579 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-06-10T18:49:08.579 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-06-10T18:49:08.579 INFO:teuthology.orchestra.run.smithi117.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-06-10T18:49:08.579 INFO:teuthology.orchestra.run.smithi117.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-06-10T18:49:08.579 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-06-10T18:49:08.579 INFO:teuthology.orchestra.run.smithi117.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-06-10T18:49:08.579 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-06-10T18:49:08.579 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-06-10T18:49:08.580 INFO:teuthology.orchestra.run.smithi117.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-06-10T18:49:08.580 INFO:teuthology.orchestra.run.smithi117.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-06-10T18:49:08.580 INFO:teuthology.orchestra.run.smithi117.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-06-10T18:49:08.580 INFO:teuthology.orchestra.run.smithi117.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-06-10T18:49:08.580 INFO:teuthology.orchestra.run.smithi117.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-06-10T18:49:08.580 INFO:teuthology.orchestra.run.smithi117.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-06-10T18:49:08.581 INFO:teuthology.orchestra.run.smithi117.stdout: socat xmlstarlet 2023-06-10T18:49:08.622 INFO:teuthology.orchestra.run.smithi053.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-06-10T18:49:08.627 INFO:teuthology.orchestra.run.smithi053.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-06-10T18:49:08.636 INFO:teuthology.orchestra.run.smithi117.stdout:0 upgraded, 115 newly installed, 0 to remove and 189 not upgraded. 2023-06-10T18:49:08.636 INFO:teuthology.orchestra.run.smithi117.stdout:Need to get 183 MB of archives. 2023-06-10T18:49:08.636 INFO:teuthology.orchestra.run.smithi117.stdout:After this operation, 820 MB of additional disk space will be used. 2023-06-10T18:49:08.636 INFO:teuthology.orchestra.run.smithi117.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-06-10T18:49:08.639 INFO:teuthology.orchestra.run.smithi053.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-06-10T18:49:08.654 INFO:teuthology.orchestra.run.smithi117.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-06-10T18:49:08.663 INFO:teuthology.orchestra.run.smithi117.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-06-10T18:49:08.677 INFO:teuthology.orchestra.run.smithi053.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-06-10T18:49:08.704 INFO:teuthology.orchestra.run.smithi117.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2023-06-10T18:49:08.713 INFO:teuthology.orchestra.run.smithi117.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-06-10T18:49:08.719 INFO:teuthology.orchestra.run.smithi053.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-06-10T18:49:08.720 INFO:teuthology.orchestra.run.smithi117.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/main/219d315c3a0b2075e570fb1964be2ad33fe7a9c8/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-4359-g219d315c-1jammy [3,401 kB] 2023-06-10T18:49:08.729 INFO:teuthology.orchestra.run.smithi117.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-06-10T18:49:08.731 INFO:teuthology.orchestra.run.smithi117.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-06-10T18:49:08.741 INFO:teuthology.orchestra.run.smithi117.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-06-10T18:49:08.787 INFO:teuthology.orchestra.run.smithi117.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-06-10T18:49:08.791 INFO:teuthology.orchestra.run.smithi117.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-06-10T18:49:08.794 INFO:teuthology.orchestra.run.smithi053.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-06-10T18:49:08.795 INFO:teuthology.orchestra.run.smithi053.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-06-10T18:49:08.796 INFO:teuthology.orchestra.run.smithi053.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-06-10T18:49:08.798 INFO:teuthology.orchestra.run.smithi053.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-06-10T18:49:08.799 INFO:teuthology.orchestra.run.smithi053.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-06-10T18:49:08.800 INFO:teuthology.orchestra.run.smithi053.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-06-10T18:49:08.800 INFO:teuthology.orchestra.run.smithi053.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-06-10T18:49:08.801 INFO:teuthology.orchestra.run.smithi053.stdout:Get:22 https://1.chacra.ceph.com/r/ceph/main/219d315c3a0b2075e570fb1964be2ad33fe7a9c8/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-4359-g219d315c-1jammy [3,095 kB] 2023-06-10T18:49:08.802 INFO:teuthology.orchestra.run.smithi117.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-06-10T18:49:08.837 INFO:teuthology.orchestra.run.smithi053.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-06-10T18:49:08.838 INFO:teuthology.orchestra.run.smithi053.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-06-10T18:49:08.839 INFO:teuthology.orchestra.run.smithi117.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-06-10T18:49:08.855 INFO:teuthology.orchestra.run.smithi053.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-06-10T18:49:08.881 INFO:teuthology.orchestra.run.smithi117.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-06-10T18:49:08.911 INFO:teuthology.orchestra.run.smithi053.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-06-10T18:49:08.915 INFO:teuthology.orchestra.run.smithi053.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-06-10T18:49:08.917 INFO:teuthology.orchestra.run.smithi053.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-06-10T18:49:08.917 INFO:teuthology.orchestra.run.smithi053.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-06-10T18:49:08.922 INFO:teuthology.orchestra.run.smithi053.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-06-10T18:49:08.923 INFO:teuthology.orchestra.run.smithi053.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-06-10T18:49:08.924 INFO:teuthology.orchestra.run.smithi053.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-06-10T18:49:08.929 INFO:teuthology.orchestra.run.smithi053.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-06-10T18:49:08.957 INFO:teuthology.orchestra.run.smithi117.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-06-10T18:49:08.958 INFO:teuthology.orchestra.run.smithi053.stdout:Get:34 https://1.chacra.ceph.com/r/ceph/main/219d315c3a0b2075e570fb1964be2ad33fe7a9c8/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-4359-g219d315c-1jammy [656 kB] 2023-06-10T18:49:08.958 INFO:teuthology.orchestra.run.smithi117.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-06-10T18:49:08.959 INFO:teuthology.orchestra.run.smithi117.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-06-10T18:49:08.961 INFO:teuthology.orchestra.run.smithi117.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-06-10T18:49:08.962 INFO:teuthology.orchestra.run.smithi117.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-06-10T18:49:08.962 INFO:teuthology.orchestra.run.smithi117.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-06-10T18:49:08.963 INFO:teuthology.orchestra.run.smithi117.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-06-10T18:49:08.966 INFO:teuthology.orchestra.run.smithi053.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-06-10T18:49:08.994 INFO:teuthology.orchestra.run.smithi053.stdout:Get:36 https://1.chacra.ceph.com/r/ceph/main/219d315c3a0b2075e570fb1964be2ad33fe7a9c8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-4359-g219d315c-1jammy [344 kB] 2023-06-10T18:49:08.999 INFO:teuthology.orchestra.run.smithi117.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-06-10T18:49:09.000 INFO:teuthology.orchestra.run.smithi117.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-06-10T18:49:09.000 INFO:teuthology.orchestra.run.smithi053.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-06-10T18:49:09.017 INFO:teuthology.orchestra.run.smithi117.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-06-10T18:49:09.020 INFO:teuthology.orchestra.run.smithi053.stdout:Get:38 https://1.chacra.ceph.com/r/ceph/main/219d315c3a0b2075e570fb1964be2ad33fe7a9c8/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-4359-g219d315c-1jammy [23.0 kB] 2023-06-10T18:49:09.021 INFO:teuthology.orchestra.run.smithi053.stdout:Get:39 https://1.chacra.ceph.com/r/ceph/main/219d315c3a0b2075e570fb1964be2ad33fe7a9c8/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-4359-g219d315c-1jammy [170 kB] 2023-06-10T18:49:09.026 INFO:teuthology.orchestra.run.smithi053.stdout:Get:40 https://1.chacra.ceph.com/r/ceph/main/219d315c3a0b2075e570fb1964be2ad33fe7a9c8/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-4359-g219d315c-1jammy [49.0 kB] 2023-06-10T18:49:09.028 INFO:teuthology.orchestra.run.smithi053.stdout:Get:41 https://1.chacra.ceph.com/r/ceph/main/219d315c3a0b2075e570fb1964be2ad33fe7a9c8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-4359-g219d315c-1jammy [319 kB] 2023-06-10T18:49:09.039 INFO:teuthology.orchestra.run.smithi053.stdout:Get:42 https://1.chacra.ceph.com/r/ceph/main/219d315c3a0b2075e570fb1964be2ad33fe7a9c8/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-4359-g219d315c-1jammy [6,057 kB] 2023-06-10T18:49:09.070 INFO:teuthology.orchestra.run.smithi117.stdout:Get:25 https://1.chacra.ceph.com/r/ceph/main/219d315c3a0b2075e570fb1964be2ad33fe7a9c8/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-4359-g219d315c-1jammy [3,095 kB] 2023-06-10T18:49:09.073 INFO:teuthology.orchestra.run.smithi117.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-06-10T18:49:09.076 INFO:teuthology.orchestra.run.smithi053.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-06-10T18:49:09.077 INFO:teuthology.orchestra.run.smithi053.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-06-10T18:49:09.077 INFO:teuthology.orchestra.run.smithi117.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-06-10T18:49:09.078 INFO:teuthology.orchestra.run.smithi053.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-06-10T18:49:09.080 INFO:teuthology.orchestra.run.smithi117.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-06-10T18:49:09.080 INFO:teuthology.orchestra.run.smithi117.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-06-10T18:49:09.081 INFO:teuthology.orchestra.run.smithi053.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-06-10T18:49:09.083 INFO:teuthology.orchestra.run.smithi053.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-06-10T18:49:09.085 INFO:teuthology.orchestra.run.smithi117.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-06-10T18:49:09.085 INFO:teuthology.orchestra.run.smithi117.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-06-10T18:49:09.086 INFO:teuthology.orchestra.run.smithi117.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-06-10T18:49:09.089 INFO:teuthology.orchestra.run.smithi053.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-06-10T18:49:09.091 INFO:teuthology.orchestra.run.smithi053.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-urllib3 all 1.26.5-1~exp1 [96.4 kB] 2023-06-10T18:49:09.091 INFO:teuthology.orchestra.run.smithi117.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-06-10T18:49:09.094 INFO:teuthology.orchestra.run.smithi053.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-requests all 2.25.1+dfsg-2 [47.9 kB] 2023-06-10T18:49:09.096 INFO:teuthology.orchestra.run.smithi053.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-06-10T18:49:09.128 INFO:teuthology.orchestra.run.smithi117.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-06-10T18:49:09.136 INFO:teuthology.orchestra.run.smithi053.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-06-10T18:49:09.163 INFO:teuthology.orchestra.run.smithi117.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-06-10T18:49:09.187 INFO:teuthology.orchestra.run.smithi053.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-06-10T18:49:09.225 INFO:teuthology.orchestra.run.smithi053.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-06-10T18:49:09.238 INFO:teuthology.orchestra.run.smithi117.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-06-10T18:49:09.239 INFO:teuthology.orchestra.run.smithi117.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-06-10T18:49:09.240 INFO:teuthology.orchestra.run.smithi117.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-06-10T18:49:09.241 INFO:teuthology.orchestra.run.smithi117.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-06-10T18:49:09.246 INFO:teuthology.orchestra.run.smithi117.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-06-10T18:49:09.251 INFO:teuthology.orchestra.run.smithi117.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-06-10T18:49:09.252 INFO:teuthology.orchestra.run.smithi117.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-urllib3 all 1.26.5-1~exp1 [96.4 kB] 2023-06-10T18:49:09.255 INFO:teuthology.orchestra.run.smithi117.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-requests all 2.25.1+dfsg-2 [47.9 kB] 2023-06-10T18:49:09.257 INFO:teuthology.orchestra.run.smithi117.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-06-10T18:49:09.296 INFO:teuthology.orchestra.run.smithi117.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-06-10T18:49:09.312 INFO:teuthology.orchestra.run.smithi117.stdout:Get:46 https://1.chacra.ceph.com/r/ceph/main/219d315c3a0b2075e570fb1964be2ad33fe7a9c8/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-4359-g219d315c-1jammy [656 kB] 2023-06-10T18:49:09.343 INFO:teuthology.orchestra.run.smithi053.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-06-10T18:49:09.344 INFO:teuthology.orchestra.run.smithi053.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-06-10T18:49:09.346 INFO:teuthology.orchestra.run.smithi053.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-06-10T18:49:09.346 INFO:teuthology.orchestra.run.smithi053.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-06-10T18:49:09.346 INFO:teuthology.orchestra.run.smithi053.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-06-10T18:49:09.348 INFO:teuthology.orchestra.run.smithi053.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-06-10T18:49:09.348 INFO:teuthology.orchestra.run.smithi117.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-06-10T18:49:09.365 INFO:teuthology.orchestra.run.smithi117.stdout:Get:48 https://1.chacra.ceph.com/r/ceph/main/219d315c3a0b2075e570fb1964be2ad33fe7a9c8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-4359-g219d315c-1jammy [344 kB] 2023-06-10T18:49:09.366 INFO:teuthology.orchestra.run.smithi053.stdout:Get:61 https://1.chacra.ceph.com/r/ceph/main/219d315c3a0b2075e570fb1964be2ad33fe7a9c8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-4359-g219d315c-1jammy [102 kB] 2023-06-10T18:49:09.367 INFO:teuthology.orchestra.run.smithi053.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-06-10T18:49:09.369 INFO:teuthology.orchestra.run.smithi053.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-06-10T18:49:09.378 INFO:teuthology.orchestra.run.smithi053.stdout:Get:64 https://1.chacra.ceph.com/r/ceph/main/219d315c3a0b2075e570fb1964be2ad33fe7a9c8/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-4359-g219d315c-1jammy [429 kB] 2023-06-10T18:49:09.386 INFO:teuthology.orchestra.run.smithi117.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-06-10T18:49:09.392 INFO:teuthology.orchestra.run.smithi053.stdout:Get:65 https://1.chacra.ceph.com/r/ceph/main/219d315c3a0b2075e570fb1964be2ad33fe7a9c8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-4359-g219d315c-1jammy [22.3 MB] 2023-06-10T18:49:09.404 INFO:teuthology.orchestra.run.smithi053.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-06-10T18:49:09.409 INFO:teuthology.orchestra.run.smithi117.stdout:Get:50 https://1.chacra.ceph.com/r/ceph/main/219d315c3a0b2075e570fb1964be2ad33fe7a9c8/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-4359-g219d315c-1jammy [23.0 kB] 2023-06-10T18:49:09.410 INFO:teuthology.orchestra.run.smithi117.stdout:Get:51 https://1.chacra.ceph.com/r/ceph/main/219d315c3a0b2075e570fb1964be2ad33fe7a9c8/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-4359-g219d315c-1jammy [170 kB] 2023-06-10T18:49:09.415 INFO:teuthology.orchestra.run.smithi117.stdout:Get:52 https://1.chacra.ceph.com/r/ceph/main/219d315c3a0b2075e570fb1964be2ad33fe7a9c8/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-4359-g219d315c-1jammy [49.0 kB] 2023-06-10T18:49:09.417 INFO:teuthology.orchestra.run.smithi117.stdout:Get:53 https://1.chacra.ceph.com/r/ceph/main/219d315c3a0b2075e570fb1964be2ad33fe7a9c8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-4359-g219d315c-1jammy [319 kB] 2023-06-10T18:49:09.429 INFO:teuthology.orchestra.run.smithi117.stdout:Get:54 https://1.chacra.ceph.com/r/ceph/main/219d315c3a0b2075e570fb1964be2ad33fe7a9c8/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-4359-g219d315c-1jammy [6,057 kB] 2023-06-10T18:49:09.496 INFO:teuthology.orchestra.run.smithi117.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-06-10T18:49:09.497 INFO:teuthology.orchestra.run.smithi117.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-06-10T18:49:09.499 INFO:teuthology.orchestra.run.smithi117.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-06-10T18:49:09.499 INFO:teuthology.orchestra.run.smithi117.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-06-10T18:49:09.500 INFO:teuthology.orchestra.run.smithi117.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-06-10T18:49:09.501 INFO:teuthology.orchestra.run.smithi117.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-06-10T18:49:09.520 INFO:teuthology.orchestra.run.smithi117.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-06-10T18:49:09.522 INFO:teuthology.orchestra.run.smithi117.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-06-10T18:49:09.554 INFO:teuthology.orchestra.run.smithi053.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-06-10T18:49:09.554 INFO:teuthology.orchestra.run.smithi053.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-06-10T18:49:09.556 INFO:teuthology.orchestra.run.smithi117.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-06-10T18:49:09.556 INFO:teuthology.orchestra.run.smithi053.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-06-10T18:49:09.558 INFO:teuthology.orchestra.run.smithi053.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-06-10T18:49:09.559 INFO:teuthology.orchestra.run.smithi053.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-06-10T18:49:09.561 INFO:teuthology.orchestra.run.smithi053.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-06-10T18:49:09.561 INFO:teuthology.orchestra.run.smithi053.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-06-10T18:49:09.563 INFO:teuthology.orchestra.run.smithi053.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-06-10T18:49:09.571 INFO:teuthology.orchestra.run.smithi053.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-06-10T18:49:09.576 INFO:teuthology.orchestra.run.smithi053.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-06-10T18:49:09.614 INFO:teuthology.orchestra.run.smithi053.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-06-10T18:49:09.668 INFO:teuthology.orchestra.run.smithi053.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-06-10T18:49:09.709 INFO:teuthology.orchestra.run.smithi117.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-06-10T18:49:09.710 INFO:teuthology.orchestra.run.smithi117.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-06-10T18:49:09.711 INFO:teuthology.orchestra.run.smithi117.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-06-10T18:49:09.712 INFO:teuthology.orchestra.run.smithi117.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-06-10T18:49:09.713 INFO:teuthology.orchestra.run.smithi117.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-06-10T18:49:09.715 INFO:teuthology.orchestra.run.smithi117.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-06-10T18:49:09.716 INFO:teuthology.orchestra.run.smithi117.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-06-10T18:49:09.717 INFO:teuthology.orchestra.run.smithi117.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-06-10T18:49:09.718 INFO:teuthology.orchestra.run.smithi053.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-06-10T18:49:09.725 INFO:teuthology.orchestra.run.smithi117.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-06-10T18:49:09.730 INFO:teuthology.orchestra.run.smithi117.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-06-10T18:49:09.732 INFO:teuthology.orchestra.run.smithi053.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-06-10T18:49:09.734 INFO:teuthology.orchestra.run.smithi053.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-06-10T18:49:09.747 INFO:teuthology.orchestra.run.smithi053.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-06-10T18:49:09.755 INFO:teuthology.orchestra.run.smithi053.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-06-10T18:49:09.755 INFO:teuthology.orchestra.run.smithi053.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-06-10T18:49:09.757 INFO:teuthology.orchestra.run.smithi053.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-06-10T18:49:09.758 INFO:teuthology.orchestra.run.smithi053.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-06-10T18:49:09.762 INFO:teuthology.orchestra.run.smithi053.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-06-10T18:49:09.767 INFO:teuthology.orchestra.run.smithi117.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-06-10T18:49:09.799 INFO:teuthology.orchestra.run.smithi053.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-06-10T18:49:09.823 INFO:teuthology.orchestra.run.smithi117.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-06-10T18:49:09.873 INFO:teuthology.orchestra.run.smithi117.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-06-10T18:49:09.887 INFO:teuthology.orchestra.run.smithi117.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-06-10T18:49:09.888 INFO:teuthology.orchestra.run.smithi117.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-06-10T18:49:09.901 INFO:teuthology.orchestra.run.smithi117.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-06-10T18:49:09.909 INFO:teuthology.orchestra.run.smithi117.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-06-10T18:49:09.910 INFO:teuthology.orchestra.run.smithi117.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-06-10T18:49:09.912 INFO:teuthology.orchestra.run.smithi117.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-06-10T18:49:09.913 INFO:teuthology.orchestra.run.smithi117.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-06-10T18:49:09.918 INFO:teuthology.orchestra.run.smithi117.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-06-10T18:49:09.920 INFO:teuthology.orchestra.run.smithi053.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-06-10T18:49:09.922 INFO:teuthology.orchestra.run.smithi053.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-06-10T18:49:09.923 INFO:teuthology.orchestra.run.smithi053.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-06-10T18:49:09.928 INFO:teuthology.orchestra.run.smithi053.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-06-10T18:49:09.930 INFO:teuthology.orchestra.run.smithi053.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-06-10T18:49:09.953 INFO:teuthology.orchestra.run.smithi117.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-06-10T18:49:10.031 INFO:teuthology.orchestra.run.smithi117.stdout:Get:86 https://1.chacra.ceph.com/r/ceph/main/219d315c3a0b2075e570fb1964be2ad33fe7a9c8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-4359-g219d315c-1jammy [102 kB] 2023-06-10T18:49:10.034 INFO:teuthology.orchestra.run.smithi117.stdout:Get:87 https://1.chacra.ceph.com/r/ceph/main/219d315c3a0b2075e570fb1964be2ad33fe7a9c8/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-4359-g219d315c-1jammy [429 kB] 2023-06-10T18:49:10.042 INFO:teuthology.orchestra.run.smithi117.stdout:Get:88 https://1.chacra.ceph.com/r/ceph/main/219d315c3a0b2075e570fb1964be2ad33fe7a9c8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-4359-g219d315c-1jammy [22.3 MB] 2023-06-10T18:49:10.074 INFO:teuthology.orchestra.run.smithi117.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-06-10T18:49:10.075 INFO:teuthology.orchestra.run.smithi117.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-06-10T18:49:10.075 INFO:teuthology.orchestra.run.smithi117.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-06-10T18:49:10.081 INFO:teuthology.orchestra.run.smithi117.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-06-10T18:49:10.082 INFO:teuthology.orchestra.run.smithi117.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-06-10T18:49:10.720 INFO:teuthology.orchestra.run.smithi053.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/main/219d315c3a0b2075e570fb1964be2ad33fe7a9c8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-4359-g219d315c-1jammy [6,824 kB] 2023-06-10T18:49:11.014 INFO:teuthology.orchestra.run.smithi053.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/main/219d315c3a0b2075e570fb1964be2ad33fe7a9c8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-4359-g219d315c-1jammy [226 kB] 2023-06-10T18:49:11.026 INFO:teuthology.orchestra.run.smithi053.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/main/219d315c3a0b2075e570fb1964be2ad33fe7a9c8/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-4359-g219d315c-1jammy [114 kB] 2023-06-10T18:49:11.029 INFO:teuthology.orchestra.run.smithi053.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/main/219d315c3a0b2075e570fb1964be2ad33fe7a9c8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-4359-g219d315c-1jammy [1,469 kB] 2023-06-10T18:49:11.104 INFO:teuthology.orchestra.run.smithi053.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/main/219d315c3a0b2075e570fb1964be2ad33fe7a9c8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-4359-g219d315c-1jammy [9,865 kB] 2023-06-10T18:49:11.698 INFO:teuthology.orchestra.run.smithi053.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/main/219d315c3a0b2075e570fb1964be2ad33fe7a9c8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-4359-g219d315c-1jammy [31.5 MB] 2023-06-10T18:49:11.828 INFO:teuthology.orchestra.run.smithi117.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/main/219d315c3a0b2075e570fb1964be2ad33fe7a9c8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-4359-g219d315c-1jammy [6,824 kB] 2023-06-10T18:49:12.315 INFO:teuthology.orchestra.run.smithi117.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/main/219d315c3a0b2075e570fb1964be2ad33fe7a9c8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-4359-g219d315c-1jammy [226 kB] 2023-06-10T18:49:12.321 INFO:teuthology.orchestra.run.smithi117.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/main/219d315c3a0b2075e570fb1964be2ad33fe7a9c8/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-4359-g219d315c-1jammy [114 kB] 2023-06-10T18:49:12.360 INFO:teuthology.orchestra.run.smithi117.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/main/219d315c3a0b2075e570fb1964be2ad33fe7a9c8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-4359-g219d315c-1jammy [1,469 kB] 2023-06-10T18:49:12.460 INFO:teuthology.orchestra.run.smithi117.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/main/219d315c3a0b2075e570fb1964be2ad33fe7a9c8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-4359-g219d315c-1jammy [9,865 kB] 2023-06-10T18:49:13.280 INFO:teuthology.orchestra.run.smithi117.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/main/219d315c3a0b2075e570fb1964be2ad33fe7a9c8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-4359-g219d315c-1jammy [31.5 MB] 2023-06-10T18:49:13.502 INFO:teuthology.orchestra.run.smithi053.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/main/219d315c3a0b2075e570fb1964be2ad33fe7a9c8/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-4359-g219d315c-1jammy [3,590 B] 2023-06-10T18:49:13.502 INFO:teuthology.orchestra.run.smithi053.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/main/219d315c3a0b2075e570fb1964be2ad33fe7a9c8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-4359-g219d315c-1jammy [810 kB] 2023-06-10T18:49:13.518 INFO:teuthology.orchestra.run.smithi053.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/main/219d315c3a0b2075e570fb1964be2ad33fe7a9c8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-4359-g219d315c-1jammy [2,161 kB] 2023-06-10T18:49:13.564 INFO:teuthology.orchestra.run.smithi053.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/main/219d315c3a0b2075e570fb1964be2ad33fe7a9c8/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-4359-g219d315c-1jammy [211 kB] 2023-06-10T18:49:13.574 INFO:teuthology.orchestra.run.smithi053.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/main/219d315c3a0b2075e570fb1964be2ad33fe7a9c8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-4359-g219d315c-1jammy [124 kB] 2023-06-10T18:49:13.576 INFO:teuthology.orchestra.run.smithi053.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/main/219d315c3a0b2075e570fb1964be2ad33fe7a9c8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-4359-g219d315c-1jammy [1,841 kB] 2023-06-10T18:49:13.693 INFO:teuthology.orchestra.run.smithi053.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/main/219d315c3a0b2075e570fb1964be2ad33fe7a9c8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-4359-g219d315c-1jammy [8,615 kB] 2023-06-10T18:49:14.151 INFO:teuthology.orchestra.run.smithi053.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/main/219d315c3a0b2075e570fb1964be2ad33fe7a9c8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-4359-g219d315c-1jammy [3,720 B] 2023-06-10T18:49:14.152 INFO:teuthology.orchestra.run.smithi053.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/main/219d315c3a0b2075e570fb1964be2ad33fe7a9c8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-4359-g219d315c-1jammy [47.4 MB] 2023-06-10T18:49:16.373 INFO:teuthology.orchestra.run.smithi117.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/main/219d315c3a0b2075e570fb1964be2ad33fe7a9c8/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-4359-g219d315c-1jammy [3,590 B] 2023-06-10T18:49:16.373 INFO:teuthology.orchestra.run.smithi117.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/main/219d315c3a0b2075e570fb1964be2ad33fe7a9c8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-4359-g219d315c-1jammy [810 kB] 2023-06-10T18:49:16.389 INFO:teuthology.orchestra.run.smithi117.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/main/219d315c3a0b2075e570fb1964be2ad33fe7a9c8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-4359-g219d315c-1jammy [2,161 kB] 2023-06-10T18:49:16.518 INFO:teuthology.orchestra.run.smithi117.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/main/219d315c3a0b2075e570fb1964be2ad33fe7a9c8/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-4359-g219d315c-1jammy [211 kB] 2023-06-10T18:49:16.524 INFO:teuthology.orchestra.run.smithi117.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/main/219d315c3a0b2075e570fb1964be2ad33fe7a9c8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-4359-g219d315c-1jammy [124 kB] 2023-06-10T18:49:16.541 INFO:teuthology.orchestra.run.smithi117.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/main/219d315c3a0b2075e570fb1964be2ad33fe7a9c8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-4359-g219d315c-1jammy [1,841 kB] 2023-06-10T18:49:16.673 INFO:teuthology.orchestra.run.smithi117.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/main/219d315c3a0b2075e570fb1964be2ad33fe7a9c8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-4359-g219d315c-1jammy [8,615 kB] 2023-06-10T18:49:16.688 INFO:teuthology.orchestra.run.smithi053.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/main/219d315c3a0b2075e570fb1964be2ad33fe7a9c8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-4359-g219d315c-1jammy [231 kB] 2023-06-10T18:49:16.693 INFO:teuthology.orchestra.run.smithi053.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/main/219d315c3a0b2075e570fb1964be2ad33fe7a9c8/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-4359-g219d315c-1jammy [214 kB] 2023-06-10T18:49:16.697 INFO:teuthology.orchestra.run.smithi053.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/main/219d315c3a0b2075e570fb1964be2ad33fe7a9c8/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-4359-g219d315c-1jammy [23.8 kB] 2023-06-10T18:49:16.698 INFO:teuthology.orchestra.run.smithi053.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/main/219d315c3a0b2075e570fb1964be2ad33fe7a9c8/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-4359-g219d315c-1jammy [13.2 kB] 2023-06-10T18:49:16.699 INFO:teuthology.orchestra.run.smithi053.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/main/219d315c3a0b2075e570fb1964be2ad33fe7a9c8/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-4359-g219d315c-1jammy [28.3 kB] 2023-06-10T18:49:16.700 INFO:teuthology.orchestra.run.smithi053.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/main/219d315c3a0b2075e570fb1964be2ad33fe7a9c8/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-4359-g219d315c-1jammy [12.0 MB] 2023-06-10T18:49:17.206 INFO:teuthology.orchestra.run.smithi053.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/main/219d315c3a0b2075e570fb1964be2ad33fe7a9c8/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-4359-g219d315c-1jammy [82.1 kB] 2023-06-10T18:49:17.248 INFO:teuthology.orchestra.run.smithi117.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/main/219d315c3a0b2075e570fb1964be2ad33fe7a9c8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-4359-g219d315c-1jammy [3,720 B] 2023-06-10T18:49:17.249 INFO:teuthology.orchestra.run.smithi117.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/main/219d315c3a0b2075e570fb1964be2ad33fe7a9c8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-4359-g219d315c-1jammy [47.4 MB] 2023-06-10T18:49:17.763 INFO:teuthology.orchestra.run.smithi053.stdout:Fetched 183 MB in 9s (20.8 MB/s) 2023-06-10T18:49:17.897 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-pyperclip. 2023-06-10T18:49:17.990 INFO:teuthology.orchestra.run.smithi053.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165999 files and directories currently installed.) 2023-06-10T18:49:17.996 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-06-10T18:49:18.046 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-06-10T18:49:18.357 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-wcwidth. 2023-06-10T18:49:18.384 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-06-10T18:49:18.424 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-06-10T18:49:18.702 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-cmd2. 2023-06-10T18:49:18.718 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-06-10T18:49:18.752 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-06-10T18:49:19.012 INFO:teuthology.orchestra.run.smithi117.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/main/219d315c3a0b2075e570fb1964be2ad33fe7a9c8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-4359-g219d315c-1jammy [231 kB] 2023-06-10T18:49:19.017 INFO:teuthology.orchestra.run.smithi117.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/main/219d315c3a0b2075e570fb1964be2ad33fe7a9c8/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-4359-g219d315c-1jammy [214 kB] 2023-06-10T18:49:19.021 INFO:teuthology.orchestra.run.smithi117.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/main/219d315c3a0b2075e570fb1964be2ad33fe7a9c8/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-4359-g219d315c-1jammy [23.8 kB] 2023-06-10T18:49:19.038 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libfmt8:amd64. 2023-06-10T18:49:19.065 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2023-06-10T18:49:19.080 INFO:teuthology.orchestra.run.smithi117.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/main/219d315c3a0b2075e570fb1964be2ad33fe7a9c8/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-4359-g219d315c-1jammy [13.2 kB] 2023-06-10T18:49:19.080 INFO:teuthology.orchestra.run.smithi117.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/main/219d315c3a0b2075e570fb1964be2ad33fe7a9c8/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-4359-g219d315c-1jammy [28.3 kB] 2023-06-10T18:49:19.081 INFO:teuthology.orchestra.run.smithi117.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/main/219d315c3a0b2075e570fb1964be2ad33fe7a9c8/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-4359-g219d315c-1jammy [12.0 MB] 2023-06-10T18:49:19.138 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2023-06-10T18:49:19.364 INFO:teuthology.orchestra.run.smithi117.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/main/219d315c3a0b2075e570fb1964be2ad33fe7a9c8/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-4359-g219d315c-1jammy [82.1 kB] 2023-06-10T18:49:19.458 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-06-10T18:49:19.485 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-06-10T18:49:19.525 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-06-10T18:49:19.895 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-06-10T18:49:19.921 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-06-10T18:49:19.926 INFO:teuthology.orchestra.run.smithi117.stdout:Fetched 183 MB in 11s (16.9 MB/s) 2023-06-10T18:49:19.961 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-06-10T18:49:20.066 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-pyperclip. 2023-06-10T18:49:20.161 INFO:teuthology.orchestra.run.smithi117.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165999 files and directories currently installed.) 2023-06-10T18:49:20.167 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-06-10T18:49:20.222 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-06-10T18:49:20.256 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-06-10T18:49:20.283 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-06-10T18:49:20.314 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-06-10T18:49:20.492 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-wcwidth. 2023-06-10T18:49:20.518 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-06-10T18:49:20.550 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-06-10T18:49:20.752 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-06-10T18:49:20.779 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-06-10T18:49:20.827 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-06-10T18:49:20.845 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-cmd2. 2023-06-10T18:49:20.871 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-06-10T18:49:20.911 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-06-10T18:49:21.230 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-06-10T18:49:21.230 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libfmt8:amd64. 2023-06-10T18:49:21.256 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-06-10T18:49:21.257 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2023-06-10T18:49:21.347 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2023-06-10T18:49:21.415 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-06-10T18:49:21.692 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-06-10T18:49:21.718 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-06-10T18:49:21.758 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-06-10T18:49:21.816 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-06-10T18:49:21.843 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-06-10T18:49:21.883 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-06-10T18:49:22.228 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-06-10T18:49:22.255 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-06-10T18:49:22.294 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-06-10T18:49:22.303 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-06-10T18:49:22.387 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-06-10T18:49:22.388 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-06-10T18:49:22.606 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package librados2. 2023-06-10T18:49:22.633 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../011-librados2_18.0.0-4359-g219d315c-1jammy_amd64.deb ... 2023-06-10T18:49:22.672 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking librados2 (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:49:22.673 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-06-10T18:49:22.699 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-06-10T18:49:22.739 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-06-10T18:49:23.092 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package librbd1. 2023-06-10T18:49:23.119 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../012-librbd1_18.0.0-4359-g219d315c-1jammy_amd64.deb ... 2023-06-10T18:49:23.158 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking librbd1 (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:49:23.185 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-06-10T18:49:23.211 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-06-10T18:49:23.259 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-06-10T18:49:23.587 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libcephfs2. 2023-06-10T18:49:23.613 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-06-10T18:49:23.613 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../013-libcephfs2_18.0.0-4359-g219d315c-1jammy_amd64.deb ... 2023-06-10T18:49:23.639 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-06-10T18:49:23.653 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libcephfs2 (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:49:23.679 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-06-10T18:49:23.914 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-rados. 2023-06-10T18:49:23.930 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../014-python3-rados_18.0.0-4359-g219d315c-1jammy_amd64.deb ... 2023-06-10T18:49:23.972 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-rados (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:49:23.991 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-06-10T18:49:24.017 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-06-10T18:49:24.057 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-06-10T18:49:24.267 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-06-10T18:49:24.294 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.0.0-4359-g219d315c-1jammy_all.deb ... 2023-06-10T18:49:24.333 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-ceph-argparse (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:49:24.394 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-06-10T18:49:24.420 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-06-10T18:49:24.460 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-06-10T18:49:24.586 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-cephfs. 2023-06-10T18:49:24.613 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../016-python3-cephfs_18.0.0-4359-g219d315c-1jammy_amd64.deb ... 2023-06-10T18:49:24.653 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-cephfs (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:49:24.788 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package librados2. 2023-06-10T18:49:24.814 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../011-librados2_18.0.0-4359-g219d315c-1jammy_amd64.deb ... 2023-06-10T18:49:24.854 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking librados2 (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:49:24.964 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-ceph-common. 2023-06-10T18:49:24.991 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../017-python3-ceph-common_18.0.0-4359-g219d315c-1jammy_all.deb ... 2023-06-10T18:49:25.030 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-ceph-common (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:49:25.299 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package librbd1. 2023-06-10T18:49:25.325 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../012-librbd1_18.0.0-4359-g219d315c-1jammy_amd64.deb ... 2023-06-10T18:49:25.350 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-prettytable. 2023-06-10T18:49:25.365 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking librbd1 (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:49:25.366 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2023-06-10T18:49:25.400 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-06-10T18:49:25.647 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-rbd. 2023-06-10T18:49:25.658 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../019-python3-rbd_18.0.0-4359-g219d315c-1jammy_amd64.deb ... 2023-06-10T18:49:25.695 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-rbd (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:49:25.769 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libcephfs2. 2023-06-10T18:49:25.795 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../013-libcephfs2_18.0.0-4359-g219d315c-1jammy_amd64.deb ... 2023-06-10T18:49:25.835 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libcephfs2 (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:49:26.034 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-06-10T18:49:26.058 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-06-10T18:49:26.098 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-06-10T18:49:26.108 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-rados. 2023-06-10T18:49:26.130 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../014-python3-rados_18.0.0-4359-g219d315c-1jammy_amd64.deb ... 2023-06-10T18:49:26.174 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-rados (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:49:26.451 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package librgw2. 2023-06-10T18:49:26.479 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../021-librgw2_18.0.0-4359-g219d315c-1jammy_amd64.deb ... 2023-06-10T18:49:26.498 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-06-10T18:49:26.518 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking librgw2 (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:49:26.525 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.0.0-4359-g219d315c-1jammy_all.deb ... 2023-06-10T18:49:26.565 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-ceph-argparse (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:49:26.818 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-cephfs. 2023-06-10T18:49:26.833 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../016-python3-cephfs_18.0.0-4359-g219d315c-1jammy_amd64.deb ... 2023-06-10T18:49:26.868 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-cephfs (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:49:27.037 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-rgw. 2023-06-10T18:49:27.053 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../022-python3-rgw_18.0.0-4359-g219d315c-1jammy_amd64.deb ... 2023-06-10T18:49:27.095 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-rgw (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:49:27.195 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-ceph-common. 2023-06-10T18:49:27.221 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../017-python3-ceph-common_18.0.0-4359-g219d315c-1jammy_all.deb ... 2023-06-10T18:49:27.278 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-ceph-common (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:49:27.423 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package liboath0:amd64. 2023-06-10T18:49:27.450 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2023-06-10T18:49:27.490 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-06-10T18:49:27.589 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-prettytable. 2023-06-10T18:49:27.616 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2023-06-10T18:49:27.656 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-06-10T18:49:27.793 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libradosstriper1. 2023-06-10T18:49:27.820 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../024-libradosstriper1_18.0.0-4359-g219d315c-1jammy_amd64.deb ... 2023-06-10T18:49:27.859 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libradosstriper1 (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:49:27.926 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-rbd. 2023-06-10T18:49:27.952 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../019-python3-rbd_18.0.0-4359-g219d315c-1jammy_amd64.deb ... 2023-06-10T18:49:27.992 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-rbd (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:49:28.205 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph-common. 2023-06-10T18:49:28.231 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../025-ceph-common_18.0.0-4359-g219d315c-1jammy_amd64.deb ... 2023-06-10T18:49:28.271 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph-common (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:49:28.353 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-06-10T18:49:28.380 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-06-10T18:49:28.420 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-06-10T18:49:28.723 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package librgw2. 2023-06-10T18:49:28.748 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../021-librgw2_18.0.0-4359-g219d315c-1jammy_amd64.deb ... 2023-06-10T18:49:28.789 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking librgw2 (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:49:29.250 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-rgw. 2023-06-10T18:49:29.265 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../022-python3-rgw_18.0.0-4359-g219d315c-1jammy_amd64.deb ... 2023-06-10T18:49:29.300 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-rgw (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:49:29.535 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph-base. 2023-06-10T18:49:29.562 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../026-ceph-base_18.0.0-4359-g219d315c-1jammy_amd64.deb ... 2023-06-10T18:49:29.612 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph-base (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:49:29.636 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package liboath0:amd64. 2023-06-10T18:49:29.662 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2023-06-10T18:49:29.702 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-06-10T18:49:29.997 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libradosstriper1. 2023-06-10T18:49:30.023 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../024-libradosstriper1_18.0.0-4359-g219d315c-1jammy_amd64.deb ... 2023-06-10T18:49:30.063 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libradosstriper1 (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:49:30.248 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-06-10T18:49:30.264 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-06-10T18:49:30.306 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-06-10T18:49:30.425 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-common. 2023-06-10T18:49:30.451 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../025-ceph-common_18.0.0-4359-g219d315c-1jammy_amd64.deb ... 2023-06-10T18:49:30.483 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-common (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:49:30.643 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-cheroot. 2023-06-10T18:49:30.670 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-06-10T18:49:30.709 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-06-10T18:49:31.004 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-06-10T18:49:31.031 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-06-10T18:49:31.070 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-06-10T18:49:31.374 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-jaraco.text. 2023-06-10T18:49:31.400 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2023-06-10T18:49:31.440 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-06-10T18:49:31.714 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-base. 2023-06-10T18:49:31.718 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-06-10T18:49:31.740 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../026-ceph-base_18.0.0-4359-g219d315c-1jammy_amd64.deb ... 2023-06-10T18:49:31.745 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-06-10T18:49:31.780 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-06-10T18:49:31.789 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-base (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:49:32.221 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-tempora. 2023-06-10T18:49:32.248 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2023-06-10T18:49:32.288 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-06-10T18:49:32.592 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-portend. 2023-06-10T18:49:32.618 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2023-06-10T18:49:32.643 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-06-10T18:49:32.657 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-06-10T18:49:32.669 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-06-10T18:49:32.709 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-06-10T18:49:32.944 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-06-10T18:49:32.971 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2023-06-10T18:49:32.995 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-cheroot. 2023-06-10T18:49:33.010 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-06-10T18:49:33.021 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-06-10T18:49:33.062 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-06-10T18:49:33.263 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-cherrypy3. 2023-06-10T18:49:33.290 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2023-06-10T18:49:33.330 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-06-10T18:49:33.331 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-06-10T18:49:33.357 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-06-10T18:49:33.389 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-06-10T18:49:33.684 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-natsort. 2023-06-10T18:49:33.701 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-jaraco.text. 2023-06-10T18:49:33.711 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2023-06-10T18:49:33.727 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2023-06-10T18:49:33.750 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-06-10T18:49:33.767 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-06-10T18:49:34.020 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-logutils. 2023-06-10T18:49:34.028 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-06-10T18:49:34.044 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-06-10T18:49:34.047 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2023-06-10T18:49:34.078 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-06-10T18:49:34.079 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-06-10T18:49:34.323 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-markupsafe. 2023-06-10T18:49:34.340 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-06-10T18:49:34.348 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-tempora. 2023-06-10T18:49:34.363 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2023-06-10T18:49:34.373 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-06-10T18:49:34.398 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-06-10T18:49:34.676 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-portend. 2023-06-10T18:49:34.684 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-mako. 2023-06-10T18:49:34.702 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2023-06-10T18:49:34.712 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-06-10T18:49:34.742 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-06-10T18:49:34.751 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-06-10T18:49:35.045 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-06-10T18:49:35.072 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2023-06-10T18:49:35.079 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-simplegeneric. 2023-06-10T18:49:35.106 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2023-06-10T18:49:35.111 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-06-10T18:49:35.146 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-06-10T18:49:35.449 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-singledispatch. 2023-06-10T18:49:35.456 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-cherrypy3. 2023-06-10T18:49:35.476 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-06-10T18:49:35.482 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2023-06-10T18:49:35.515 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-06-10T18:49:35.522 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-06-10T18:49:35.785 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-webob. 2023-06-10T18:49:35.812 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-06-10T18:49:35.843 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-06-10T18:49:35.876 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-natsort. 2023-06-10T18:49:35.903 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2023-06-10T18:49:35.943 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-06-10T18:49:36.163 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-waitress. 2023-06-10T18:49:36.190 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-06-10T18:49:36.233 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-06-10T18:49:36.254 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-logutils. 2023-06-10T18:49:36.280 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2023-06-10T18:49:36.321 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-06-10T18:49:36.524 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-tempita. 2023-06-10T18:49:36.551 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-06-10T18:49:36.591 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-06-10T18:49:36.623 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-markupsafe. 2023-06-10T18:49:36.649 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-06-10T18:49:36.690 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-06-10T18:49:36.861 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-paste. 2023-06-10T18:49:36.887 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-06-10T18:49:36.927 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-06-10T18:49:36.951 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-mako. 2023-06-10T18:49:36.966 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-06-10T18:49:37.001 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-06-10T18:49:37.256 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-06-10T18:49:37.271 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-06-10T18:49:37.313 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-simplegeneric. 2023-06-10T18:49:37.314 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-06-10T18:49:37.339 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2023-06-10T18:49:37.379 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-06-10T18:49:37.617 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-pastedeploy. 2023-06-10T18:49:37.644 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2023-06-10T18:49:37.682 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-singledispatch. 2023-06-10T18:49:37.708 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-06-10T18:49:37.717 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-06-10T18:49:37.890 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-06-10T18:49:37.995 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-webtest. 2023-06-10T18:49:38.018 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2023-06-10T18:49:38.053 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-06-10T18:49:38.201 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-webob. 2023-06-10T18:49:38.228 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-06-10T18:49:38.267 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-06-10T18:49:38.323 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-pecan. 2023-06-10T18:49:38.339 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-06-10T18:49:38.373 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-06-10T18:49:38.587 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-waitress. 2023-06-10T18:49:38.614 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-06-10T18:49:38.674 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-06-10T18:49:38.728 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-certifi. 2023-06-10T18:49:38.755 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2023-06-10T18:49:38.794 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-06-10T18:49:38.957 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-tempita. 2023-06-10T18:49:38.983 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-06-10T18:49:39.015 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-06-10T18:49:39.114 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-idna. 2023-06-10T18:49:39.141 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2023-06-10T18:49:39.180 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-idna (3.3-1) ... 2023-06-10T18:49:39.345 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-paste. 2023-06-10T18:49:39.371 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-06-10T18:49:39.411 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-06-10T18:49:39.459 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-urllib3. 2023-06-10T18:49:39.486 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1_all.deb ... 2023-06-10T18:49:39.534 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1) ... 2023-06-10T18:49:39.731 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-06-10T18:49:39.758 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-06-10T18:49:39.797 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-06-10T18:49:39.837 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-requests. 2023-06-10T18:49:39.853 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2_all.deb ... 2023-06-10T18:49:39.887 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-requests (2.25.1+dfsg-2) ... 2023-06-10T18:49:40.125 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-pastedeploy. 2023-06-10T18:49:40.140 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-werkzeug. 2023-06-10T18:49:40.151 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2023-06-10T18:49:40.167 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-06-10T18:49:40.191 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-06-10T18:49:40.198 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-06-10T18:49:40.453 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-webtest. 2023-06-10T18:49:40.479 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2023-06-10T18:49:40.484 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-06-10T18:49:40.501 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.0.0-4359-g219d315c-1jammy_all.deb ... 2023-06-10T18:49:40.511 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-06-10T18:49:40.534 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph-mgr-modules-core (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:49:40.797 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-pecan. 2023-06-10T18:49:40.824 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-06-10T18:49:40.864 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-06-10T18:49:40.915 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-06-10T18:49:40.942 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.0.0-4359-g219d315c-1jammy_amd64.deb ... 2023-06-10T18:49:40.981 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:49:41.244 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-certifi. 2023-06-10T18:49:41.270 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2023-06-10T18:49:41.310 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-06-10T18:49:41.317 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-openssl. 2023-06-10T18:49:41.345 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2023-06-10T18:49:41.384 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-06-10T18:49:41.597 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-idna. 2023-06-10T18:49:41.623 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2023-06-10T18:49:41.655 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-idna (3.3-1) ... 2023-06-10T18:49:41.721 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph-mgr. 2023-06-10T18:49:41.748 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../058-ceph-mgr_18.0.0-4359-g219d315c-1jammy_amd64.deb ... 2023-06-10T18:49:41.787 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph-mgr (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:49:42.633 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-urllib3. 2023-06-10T18:49:42.660 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1_all.deb ... 2023-06-10T18:49:42.699 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1) ... 2023-06-10T18:49:42.958 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph-mon. 2023-06-10T18:49:42.986 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../059-ceph-mon_18.0.0-4359-g219d315c-1jammy_amd64.deb ... 2023-06-10T18:49:43.024 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph-mon (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:49:43.186 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-requests. 2023-06-10T18:49:43.213 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2_all.deb ... 2023-06-10T18:49:43.253 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-requests (2.25.1+dfsg-2) ... 2023-06-10T18:49:43.597 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-werkzeug. 2023-06-10T18:49:43.623 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-06-10T18:49:43.663 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-06-10T18:49:43.925 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-06-10T18:49:43.940 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.0.0-4359-g219d315c-1jammy_all.deb ... 2023-06-10T18:49:43.983 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-mgr-modules-core (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:49:44.004 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph-osd. 2023-06-10T18:49:44.030 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../060-ceph-osd_18.0.0-4359-g219d315c-1jammy_amd64.deb ... 2023-06-10T18:49:44.069 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph-osd (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:49:44.355 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-06-10T18:49:44.381 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.0.0-4359-g219d315c-1jammy_amd64.deb ... 2023-06-10T18:49:44.421 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:49:44.690 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-openssl. 2023-06-10T18:49:44.705 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2023-06-10T18:49:44.748 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-06-10T18:49:45.077 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-mgr. 2023-06-10T18:49:45.103 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../058-ceph-mgr_18.0.0-4359-g219d315c-1jammy_amd64.deb ... 2023-06-10T18:49:45.152 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-mgr (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:49:45.513 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-mon. 2023-06-10T18:49:45.539 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../059-ceph-mon_18.0.0-4359-g219d315c-1jammy_amd64.deb ... 2023-06-10T18:49:45.579 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-mon (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:49:45.898 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph. 2023-06-10T18:49:45.914 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../061-ceph_18.0.0-4359-g219d315c-1jammy_amd64.deb ... 2023-06-10T18:49:45.948 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:49:46.251 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph-fuse. 2023-06-10T18:49:46.278 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../062-ceph-fuse_18.0.0-4359-g219d315c-1jammy_amd64.deb ... 2023-06-10T18:49:46.317 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph-fuse (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:49:46.499 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-osd. 2023-06-10T18:49:46.526 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../060-ceph-osd_18.0.0-4359-g219d315c-1jammy_amd64.deb ... 2023-06-10T18:49:46.566 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-osd (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:49:46.679 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph-mds. 2023-06-10T18:49:46.706 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../063-ceph-mds_18.0.0-4359-g219d315c-1jammy_amd64.deb ... 2023-06-10T18:49:46.746 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph-mds (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:49:47.090 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package cephadm. 2023-06-10T18:49:47.107 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../064-cephadm_18.0.0-4359-g219d315c-1jammy_amd64.deb ... 2023-06-10T18:49:47.140 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking cephadm (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:49:47.444 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-asyncssh. 2023-06-10T18:49:47.471 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2023-06-10T18:49:47.510 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-06-10T18:49:47.822 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python-babel-localedata. 2023-06-10T18:49:47.849 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-06-10T18:49:47.888 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-06-10T18:49:48.361 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph. 2023-06-10T18:49:48.376 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../061-ceph_18.0.0-4359-g219d315c-1jammy_amd64.deb ... 2023-06-10T18:49:48.419 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:49:48.755 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-fuse. 2023-06-10T18:49:48.781 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../062-ceph-fuse_18.0.0-4359-g219d315c-1jammy_amd64.deb ... 2023-06-10T18:49:48.821 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-fuse (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:49:48.920 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-babel. 2023-06-10T18:49:48.948 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-06-10T18:49:48.978 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-06-10T18:49:49.175 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-mds. 2023-06-10T18:49:49.201 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../063-ceph-mds_18.0.0-4359-g219d315c-1jammy_amd64.deb ... 2023-06-10T18:49:49.241 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-mds (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:49:49.281 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-jinja2. 2023-06-10T18:49:49.298 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2023-06-10T18:49:49.331 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-06-10T18:49:49.611 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package cephadm. 2023-06-10T18:49:49.634 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-06-10T18:49:49.638 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../064-cephadm_18.0.0-4359-g219d315c-1jammy_amd64.deb ... 2023-06-10T18:49:49.651 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.0.0-4359-g219d315c-1jammy_all.deb ... 2023-06-10T18:49:49.678 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking cephadm (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:49:49.684 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph-mgr-cephadm (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:49:49.989 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-asyncssh. 2023-06-10T18:49:50.016 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2023-06-10T18:49:50.038 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-bcrypt. 2023-06-10T18:49:50.055 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-06-10T18:49:50.066 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-06-10T18:49:50.104 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-06-10T18:49:50.366 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-repoze.lru. 2023-06-10T18:49:50.367 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python-babel-localedata. 2023-06-10T18:49:50.393 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../071-python3-repoze.lru_0.7-2_all.deb ... 2023-06-10T18:49:50.394 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-06-10T18:49:50.424 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-06-10T18:49:50.433 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-06-10T18:49:50.702 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-routes. 2023-06-10T18:49:50.729 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../072-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-06-10T18:49:50.768 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-06-10T18:49:51.072 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-06-10T18:49:51.099 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../073-ceph-mgr-dashboard_18.0.0-4359-g219d315c-1jammy_all.deb ... 2023-06-10T18:49:51.138 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph-mgr-dashboard (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:49:51.396 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-babel. 2023-06-10T18:49:51.423 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-06-10T18:49:51.463 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-06-10T18:49:51.575 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-06-10T18:49:51.591 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-06-10T18:49:51.633 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-06-10T18:49:51.807 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-jinja2. 2023-06-10T18:49:51.834 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2023-06-10T18:49:51.874 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-06-10T18:49:52.112 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-joblib. 2023-06-10T18:49:52.139 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../075-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-06-10T18:49:52.170 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-06-10T18:49:52.219 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-06-10T18:49:52.246 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.0.0-4359-g219d315c-1jammy_all.deb ... 2023-06-10T18:49:52.285 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-mgr-cephadm (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:49:52.568 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-06-10T18:49:52.596 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../076-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-06-10T18:49:52.622 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-bcrypt. 2023-06-10T18:49:52.649 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-06-10T18:49:52.689 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-06-10T18:49:52.740 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-06-10T18:49:52.991 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-repoze.lru. 2023-06-10T18:49:53.018 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../071-python3-repoze.lru_0.7-2_all.deb ... 2023-06-10T18:49:53.035 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-sklearn. 2023-06-10T18:49:53.058 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-06-10T18:49:53.062 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../077-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-06-10T18:49:53.101 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-06-10T18:49:53.503 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-routes. 2023-06-10T18:49:53.529 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../072-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-06-10T18:49:53.569 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-06-10T18:49:53.818 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-06-10T18:49:53.846 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../078-ceph-mgr-diskprediction-local_18.0.0-4359-g219d315c-1jammy_all.deb ... 2023-06-10T18:49:53.872 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-06-10T18:49:53.884 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:49:53.899 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../073-ceph-mgr-dashboard_18.0.0-4359-g219d315c-1jammy_all.deb ... 2023-06-10T18:49:53.939 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-mgr-dashboard (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:49:54.359 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-06-10T18:49:54.385 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-06-10T18:49:54.425 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-06-10T18:49:54.804 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-cachetools. 2023-06-10T18:49:54.832 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../079-python3-cachetools_5.0.0-1_all.deb ... 2023-06-10T18:49:54.871 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-06-10T18:49:54.921 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-joblib. 2023-06-10T18:49:54.948 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../075-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-06-10T18:49:54.987 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-06-10T18:49:55.174 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-pyasn1. 2023-06-10T18:49:55.201 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../080-python3-pyasn1_0.4.8-1_all.deb ... 2023-06-10T18:49:55.240 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-06-10T18:49:55.332 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-06-10T18:49:55.360 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../076-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-06-10T18:49:55.399 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-06-10T18:49:55.585 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-06-10T18:49:55.613 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../081-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-06-10T18:49:55.660 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-06-10T18:49:55.710 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-sklearn. 2023-06-10T18:49:55.737 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../077-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-06-10T18:49:55.776 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-06-10T18:49:55.979 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-rsa. 2023-06-10T18:49:56.007 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../082-python3-rsa_4.8-1_all.deb ... 2023-06-10T18:49:56.046 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-rsa (4.8-1) ... 2023-06-10T18:49:56.435 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-06-10T18:49:56.451 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-google-auth. 2023-06-10T18:49:56.463 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../078-ceph-mgr-diskprediction-local_18.0.0-4359-g219d315c-1jammy_all.deb ... 2023-06-10T18:49:56.479 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../083-python3-google-auth_1.5.1-3_all.deb ... 2023-06-10T18:49:56.501 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:49:56.517 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-06-10T18:49:56.838 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-06-10T18:49:56.866 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../084-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-06-10T18:49:56.904 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-06-10T18:49:57.216 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-websocket. 2023-06-10T18:49:57.244 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../085-python3-websocket_1.2.3-1_all.deb ... 2023-06-10T18:49:57.282 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-06-10T18:49:57.422 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-cachetools. 2023-06-10T18:49:57.449 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../079-python3-cachetools_5.0.0-1_all.deb ... 2023-06-10T18:49:57.487 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-06-10T18:49:57.577 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-kubernetes. 2023-06-10T18:49:57.605 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../086-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-06-10T18:49:57.643 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-06-10T18:49:57.774 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-pyasn1. 2023-06-10T18:49:57.801 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../080-python3-pyasn1_0.4.8-1_all.deb ... 2023-06-10T18:49:57.840 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-06-10T18:49:58.194 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-06-10T18:49:58.221 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../081-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-06-10T18:49:58.260 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-06-10T18:49:58.341 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-06-10T18:49:58.358 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../087-ceph-mgr-k8sevents_18.0.0-4359-g219d315c-1jammy_all.deb ... 2023-06-10T18:49:58.390 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:49:58.547 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-rsa. 2023-06-10T18:49:58.574 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../082-python3-rsa_4.8-1_all.deb ... 2023-06-10T18:49:58.604 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-rsa (4.8-1) ... 2023-06-10T18:49:58.685 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libonig5:amd64. 2023-06-10T18:49:58.713 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../088-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-06-10T18:49:58.751 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-06-10T18:49:59.010 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-google-auth. 2023-06-10T18:49:59.037 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../083-python3-google-auth_1.5.1-3_all.deb ... 2023-06-10T18:49:59.076 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-06-10T18:49:59.088 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libjq1:amd64. 2023-06-10T18:49:59.116 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../089-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-06-10T18:49:59.154 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-06-10T18:49:59.396 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-06-10T18:49:59.423 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../084-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-06-10T18:49:59.424 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package jq. 2023-06-10T18:49:59.440 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../090-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-06-10T18:49:59.463 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-06-10T18:49:59.482 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-06-10T18:49:59.709 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package socat. 2023-06-10T18:49:59.726 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../091-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-06-10T18:49:59.749 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-websocket. 2023-06-10T18:49:59.759 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-06-10T18:49:59.776 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../085-python3-websocket_1.2.3-1_all.deb ... 2023-06-10T18:49:59.816 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-06-10T18:50:00.038 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package xmlstarlet. 2023-06-10T18:50:00.054 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../092-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-06-10T18:50:00.096 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-06-10T18:50:00.127 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-kubernetes. 2023-06-10T18:50:00.154 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../086-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-06-10T18:50:00.194 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-06-10T18:50:00.433 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph-test. 2023-06-10T18:50:00.450 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../093-ceph-test_18.0.0-4359-g219d315c-1jammy_amd64.deb ... 2023-06-10T18:50:00.483 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph-test (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:00.799 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-06-10T18:50:00.827 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../087-ceph-mgr-k8sevents_18.0.0-4359-g219d315c-1jammy_all.deb ... 2023-06-10T18:50:00.874 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:01.169 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libonig5:amd64. 2023-06-10T18:50:01.196 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../088-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-06-10T18:50:01.235 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-06-10T18:50:01.563 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libjq1:amd64. 2023-06-10T18:50:01.590 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../089-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-06-10T18:50:01.629 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-06-10T18:50:01.882 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package jq. 2023-06-10T18:50:01.898 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../090-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-06-10T18:50:01.940 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-06-10T18:50:02.202 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package socat. 2023-06-10T18:50:02.229 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../091-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-06-10T18:50:02.268 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-06-10T18:50:02.538 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package xmlstarlet. 2023-06-10T18:50:02.554 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../092-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-06-10T18:50:02.596 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-06-10T18:50:02.653 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph-volume. 2023-06-10T18:50:02.670 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../094-ceph-volume_18.0.0-4359-g219d315c-1jammy_all.deb ... 2023-06-10T18:50:02.711 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph-volume (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:02.933 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-test. 2023-06-10T18:50:02.960 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../093-ceph-test_18.0.0-4359-g219d315c-1jammy_amd64.deb ... 2023-06-10T18:50:02.991 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-test (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:03.408 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package cephfs-mirror. 2023-06-10T18:50:03.425 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../095-cephfs-mirror_18.0.0-4359-g219d315c-1jammy_amd64.deb ... 2023-06-10T18:50:03.466 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking cephfs-mirror (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:03.778 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-colorama. 2023-06-10T18:50:03.805 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../096-python3-colorama_0.4.4-1_all.deb ... 2023-06-10T18:50:03.844 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-06-10T18:50:04.097 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package cephfs-shell. 2023-06-10T18:50:04.125 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../097-cephfs-shell_18.0.0-4359-g219d315c-1jammy_all.deb ... 2023-06-10T18:50:04.163 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking cephfs-shell (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:04.391 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package cephfs-top. 2023-06-10T18:50:04.408 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../098-cephfs-top_18.0.0-4359-g219d315c-1jammy_all.deb ... 2023-06-10T18:50:04.449 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking cephfs-top (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:04.702 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libcephfs-dev. 2023-06-10T18:50:04.718 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../099-libcephfs-dev_18.0.0-4359-g219d315c-1jammy_amd64.deb ... 2023-06-10T18:50:04.760 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libcephfs-dev (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:05.147 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package nvme-cli. 2023-06-10T18:50:05.175 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../100-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-06-10T18:50:05.213 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-06-10T18:50:05.261 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ceph-volume. 2023-06-10T18:50:05.277 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../094-ceph-volume_18.0.0-4359-g219d315c-1jammy_all.deb ... 2023-06-10T18:50:05.320 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ceph-volume (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:05.560 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-06-10T18:50:05.588 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../101-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-06-10T18:50:05.624 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package cephfs-mirror. 2023-06-10T18:50:05.626 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-06-10T18:50:05.637 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../095-cephfs-mirror_18.0.0-4359-g219d315c-1jammy_amd64.deb ... 2023-06-10T18:50:05.665 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking cephfs-mirror (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:05.977 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-colorama. 2023-06-10T18:50:06.004 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../096-python3-colorama_0.4.4-1_all.deb ... 2023-06-10T18:50:06.043 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-06-10T18:50:06.055 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-iniconfig. 2023-06-10T18:50:06.082 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../102-python3-iniconfig_1.1.1-2_all.deb ... 2023-06-10T18:50:06.121 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-06-10T18:50:06.304 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package cephfs-shell. 2023-06-10T18:50:06.332 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../097-cephfs-shell_18.0.0-4359-g219d315c-1jammy_all.deb ... 2023-06-10T18:50:06.371 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking cephfs-shell (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:06.432 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-pastescript. 2023-06-10T18:50:06.460 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../103-python3-pastescript_2.0.2-4_all.deb ... 2023-06-10T18:50:06.490 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-06-10T18:50:06.632 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package cephfs-top. 2023-06-10T18:50:06.648 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../098-cephfs-top_18.0.0-4359-g219d315c-1jammy_all.deb ... 2023-06-10T18:50:06.690 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking cephfs-top (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:06.810 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-pluggy. 2023-06-10T18:50:06.839 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../104-python3-pluggy_0.13.0-7.1_all.deb ... 2023-06-10T18:50:06.876 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-06-10T18:50:06.909 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libcephfs-dev. 2023-06-10T18:50:06.925 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../099-libcephfs-dev_18.0.0-4359-g219d315c-1jammy_amd64.deb ... 2023-06-10T18:50:06.968 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libcephfs-dev (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:07.197 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-psutil. 2023-06-10T18:50:07.224 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../105-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-06-10T18:50:07.263 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-06-10T18:50:07.329 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package nvme-cli. 2023-06-10T18:50:07.356 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../100-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-06-10T18:50:07.396 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-06-10T18:50:07.591 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-py. 2023-06-10T18:50:07.619 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../106-python3-py_1.10.0-1_all.deb ... 2023-06-10T18:50:07.657 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-py (1.10.0-1) ... 2023-06-10T18:50:07.734 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-06-10T18:50:07.761 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../101-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-06-10T18:50:07.800 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-06-10T18:50:07.977 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-pygments. 2023-06-10T18:50:08.005 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../107-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-06-10T18:50:08.044 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-06-10T18:50:08.254 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-iniconfig. 2023-06-10T18:50:08.281 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../102-python3-iniconfig_1.1.1-2_all.deb ... 2023-06-10T18:50:08.311 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-06-10T18:50:08.523 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-pyinotify. 2023-06-10T18:50:08.551 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../108-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-06-10T18:50:08.589 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-06-10T18:50:08.598 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-pastescript. 2023-06-10T18:50:08.625 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../103-python3-pastescript_2.0.2-4_all.deb ... 2023-06-10T18:50:08.664 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-06-10T18:50:08.842 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-toml. 2023-06-10T18:50:08.870 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../109-python3-toml_0.10.2-1_all.deb ... 2023-06-10T18:50:08.900 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-06-10T18:50:09.001 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-pluggy. 2023-06-10T18:50:09.028 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../104-python3-pluggy_0.13.0-7.1_all.deb ... 2023-06-10T18:50:09.067 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-06-10T18:50:09.195 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-pytest. 2023-06-10T18:50:09.223 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../110-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-06-10T18:50:09.261 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-06-10T18:50:09.379 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-psutil. 2023-06-10T18:50:09.406 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../105-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-06-10T18:50:09.445 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-06-10T18:50:09.615 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-simplejson. 2023-06-10T18:50:09.643 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-06-10T18:50:09.681 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-06-10T18:50:09.765 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-py. 2023-06-10T18:50:09.792 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../106-python3-py_1.10.0-1_all.deb ... 2023-06-10T18:50:09.831 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-py (1.10.0-1) ... 2023-06-10T18:50:09.984 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-06-10T18:50:10.012 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-06-10T18:50:10.050 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-06-10T18:50:10.135 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-pygments. 2023-06-10T18:50:10.162 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../107-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-06-10T18:50:10.201 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-06-10T18:50:10.655 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-pyinotify. 2023-06-10T18:50:10.682 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../108-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-06-10T18:50:10.721 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-06-10T18:50:10.746 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package radosgw. 2023-06-10T18:50:10.774 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../113-radosgw_18.0.0-4359-g219d315c-1jammy_amd64.deb ... 2023-06-10T18:50:10.812 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking radosgw (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:10.974 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-toml. 2023-06-10T18:50:11.001 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../109-python3-toml_0.10.2-1_all.deb ... 2023-06-10T18:50:11.041 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-06-10T18:50:11.352 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-pytest. 2023-06-10T18:50:11.379 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../110-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-06-10T18:50:11.418 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-06-10T18:50:11.549 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package rbd-fuse. 2023-06-10T18:50:11.565 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../114-rbd-fuse_18.0.0-4359-g219d315c-1jammy_amd64.deb ... 2023-06-10T18:50:11.598 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking rbd-fuse (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:11.764 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package python3-simplejson. 2023-06-10T18:50:11.791 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-06-10T18:50:11.830 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-06-10T18:50:11.887 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-06-10T18:50:12.132 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-06-10T18:50:12.145 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-06-10T18:50:12.160 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-06-10T18:50:12.199 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-06-10T18:50:12.271 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-06-10T18:50:12.537 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-06-10T18:50:12.888 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-06-10T18:50:12.928 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package radosgw. 2023-06-10T18:50:12.956 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../113-radosgw_18.0.0-4359-g219d315c-1jammy_amd64.deb ... 2023-06-10T18:50:12.994 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking radosgw (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:13.324 INFO:teuthology.orchestra.run.smithi053.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-06-10T18:50:13.389 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up cephadm (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:13.722 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package rbd-fuse. 2023-06-10T18:50:13.738 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../114-rbd-fuse_18.0.0-4359-g219d315c-1jammy_amd64.deb ... 2023-06-10T18:50:13.772 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking rbd-fuse (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:13.959 INFO:teuthology.orchestra.run.smithi053.stdout:Adding system user cephadm....done 2023-06-10T18:50:14.068 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-06-10T18:50:14.113 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-06-10T18:50:14.310 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-06-10T18:50:14.397 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-06-10T18:50:14.428 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-06-10T18:50:14.667 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-06-10T18:50:14.669 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-06-10T18:50:14.774 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-06-10T18:50:15.006 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-06-10T18:50:15.009 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-06-10T18:50:15.277 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-06-10T18:50:15.403 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-py (1.10.0-1) ... 2023-06-10T18:50:15.471 INFO:teuthology.orchestra.run.smithi117.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-06-10T18:50:15.521 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up cephadm (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:15.705 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-06-10T18:50:16.073 INFO:teuthology.orchestra.run.smithi117.stdout:Adding system user cephadm....done 2023-06-10T18:50:16.073 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-06-10T18:50:16.269 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-06-10T18:50:16.333 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-06-10T18:50:16.545 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-06-10T18:50:16.584 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-06-10T18:50:16.779 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-06-10T18:50:16.869 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-06-10T18:50:16.905 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-06-10T18:50:17.153 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-06-10T18:50:17.157 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-06-10T18:50:17.412 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-06-10T18:50:17.416 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-06-10T18:50:17.542 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-py (1.10.0-1) ... 2023-06-10T18:50:17.705 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-ceph-argparse (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:17.835 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-06-10T18:50:17.973 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-06-10T18:50:18.099 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-06-10T18:50:18.179 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-06-10T18:50:18.358 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-06-10T18:50:18.430 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-06-10T18:50:18.601 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-06-10T18:50:18.698 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-06-10T18:50:18.727 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-06-10T18:50:18.966 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-06-10T18:50:19.086 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-06-10T18:50:19.229 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-06-10T18:50:19.475 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-06-10T18:50:19.505 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-06-10T18:50:19.773 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-06-10T18:50:19.851 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-06-10T18:50:20.083 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-06-10T18:50:20.094 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-ceph-argparse (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:20.337 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-06-10T18:50:20.463 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-06-10T18:50:20.714 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-06-10T18:50:20.735 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-06-10T18:50:20.973 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-06-10T18:50:20.994 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-06-10T18:50:21.099 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-06-10T18:50:21.120 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-06-10T18:50:21.246 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-06-10T18:50:21.467 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-06-10T18:50:21.581 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-06-10T18:50:21.593 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-06-10T18:50:21.844 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-06-10T18:50:22.015 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-06-10T18:50:22.087 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-06-10T18:50:22.249 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-06-10T18:50:22.371 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-06-10T18:50:22.618 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-06-10T18:50:22.911 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-06-10T18:50:23.007 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-06-10T18:50:23.220 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-06-10T18:50:23.260 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-06-10T18:50:23.361 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-06-10T18:50:23.487 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-06-10T18:50:23.614 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-06-10T18:50:23.788 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-06-10T18:50:23.873 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-06-10T18:50:23.999 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-ceph-common (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:24.172 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-06-10T18:50:24.342 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-idna (3.3-1) ... 2023-06-10T18:50:24.432 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-06-10T18:50:24.643 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-06-10T18:50:24.817 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-06-10T18:50:25.093 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-06-10T18:50:25.377 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-06-10T18:50:25.695 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-06-10T18:50:25.890 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-06-10T18:50:25.947 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-06-10T18:50:26.000 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-toml (0.10.2-1) ... 2023-06-10T18:50:26.072 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-ceph-common (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:26.242 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-06-10T18:50:26.365 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-idna (3.3-1) ... 2023-06-10T18:50:26.368 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-06-10T18:50:26.494 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-urllib3 (1.26.5-1~exp1) ... 2023-06-10T18:50:26.683 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-06-10T18:50:26.804 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-06-10T18:50:27.080 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-06-10T18:50:27.340 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-06-10T18:50:27.466 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2023-06-10T18:50:27.575 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-06-10T18:50:27.863 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-06-10T18:50:27.918 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-06-10T18:50:27.989 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-toml (0.10.2-1) ... 2023-06-10T18:50:28.177 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-06-10T18:50:28.240 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-06-10T18:50:28.366 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-06-10T18:50:28.446 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-06-10T18:50:28.509 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-urllib3 (1.26.5-1~exp1) ... 2023-06-10T18:50:28.722 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-06-10T18:50:28.794 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-06-10T18:50:28.989 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-06-10T18:50:29.045 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-06-10T18:50:29.257 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-06-10T18:50:29.296 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-06-10T18:50:29.358 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-06-10T18:50:29.422 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2023-06-10T18:50:29.548 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-06-10T18:50:29.626 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-06-10T18:50:29.743 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-06-10T18:50:29.849 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-06-10T18:50:30.045 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-06-10T18:50:30.100 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-06-10T18:50:30.354 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-06-10T18:50:30.368 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-06-10T18:50:30.602 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-06-10T18:50:30.622 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-06-10T18:50:30.862 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-06-10T18:50:30.996 INFO:teuthology.orchestra.run.smithi053.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-06-10T18:50:31.113 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-06-10T18:50:31.239 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-06-10T18:50:31.258 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-06-10T18:50:31.384 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-06-10T18:50:31.515 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-06-10T18:50:31.641 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-06-10T18:50:31.810 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-06-10T18:50:31.933 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-06-10T18:50:32.078 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-portend (3.0.0-1) ... 2023-06-10T18:50:32.218 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-06-10T18:50:32.337 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-06-10T18:50:32.461 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-06-10T18:50:32.465 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-06-10T18:50:32.784 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-06-10T18:50:32.876 INFO:teuthology.orchestra.run.smithi117.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-06-10T18:50:33.085 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-requests (2.25.1+dfsg-2) ... 2023-06-10T18:50:33.122 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-06-10T18:50:33.248 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-06-10T18:50:33.369 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-06-10T18:50:33.561 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-rsa (4.8-1) ... 2023-06-10T18:50:33.624 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-06-10T18:50:33.883 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-portend (3.0.0-1) ... 2023-06-10T18:50:34.126 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-06-10T18:50:34.146 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-06-10T18:50:34.252 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-06-10T18:50:34.422 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-06-10T18:50:34.562 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-06-10T18:50:34.673 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-06-10T18:50:34.855 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-requests (2.25.1+dfsg-2) ... 2023-06-10T18:50:35.075 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-06-10T18:50:35.130 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-06-10T18:50:35.257 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-rsa (4.8-1) ... 2023-06-10T18:50:35.384 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-06-10T18:50:35.524 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-06-10T18:50:35.770 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-06-10T18:50:35.809 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-06-10T18:50:35.896 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up librados2 (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:36.022 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up librgw2 (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:36.068 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-06-10T18:50:36.225 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libsqlite3-mod-ceph (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:36.351 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libcephfs2 (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:36.470 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-06-10T18:50:36.494 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libradosstriper1 (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:36.620 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-06-10T18:50:36.754 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-06-10T18:50:36.905 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up librbd1 (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:37.031 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph-mgr-modules-core (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:37.114 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-06-10T18:50:37.165 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph-fuse (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:37.240 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up librados2 (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:37.367 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up librgw2 (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:37.372 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-06-10T18:50:37.373 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-06-10T18:50:37.569 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libsqlite3-mod-ceph (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:37.695 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libcephfs2 (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:37.821 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libradosstriper1 (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:37.917 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libcephfs-dev (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:37.947 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-06-10T18:50:38.068 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-rados (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:38.203 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up cephfs-top (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:38.232 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up librbd1 (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:38.320 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-06-10T18:50:38.358 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-mgr-modules-core (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:38.476 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-fuse (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:38.689 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-06-10T18:50:38.689 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-06-10T18:50:39.244 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libcephfs-dev (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:39.362 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-rados (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:39.488 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up cephfs-top (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:39.601 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-rbd (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:39.613 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-06-10T18:50:39.727 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up rbd-fuse (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:39.836 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-rgw (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:39.937 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-cephfs (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:40.038 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up cephfs-shell (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:40.164 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph-common (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:40.766 INFO:teuthology.orchestra.run.smithi053.stdout:Adding group ceph....done 2023-06-10T18:50:40.859 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-rbd (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:40.985 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up rbd-fuse (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:41.083 INFO:teuthology.orchestra.run.smithi053.stdout:Adding system user ceph....done 2023-06-10T18:50:41.111 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-rgw (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:41.235 INFO:teuthology.orchestra.run.smithi053.stdout:Setting system user ceph properties....done 2023-06-10T18:50:41.237 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up python3-cephfs (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:41.247 INFO:teuthology.orchestra.run.smithi053.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-06-10T18:50:41.363 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up cephfs-shell (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:41.388 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-06-10T18:50:41.489 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-common (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:41.726 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-06-10T18:50:41.999 INFO:teuthology.orchestra.run.smithi117.stdout:Adding group ceph....done 2023-06-10T18:50:42.265 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up cephfs-mirror (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:42.391 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph-test (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:42.392 INFO:teuthology.orchestra.run.smithi117.stdout:Adding system user ceph....done 2023-06-10T18:50:42.517 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up radosgw (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:42.560 INFO:teuthology.orchestra.run.smithi117.stdout:Setting system user ceph properties....done 2023-06-10T18:50:42.575 INFO:teuthology.orchestra.run.smithi117.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-06-10T18:50:42.709 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-06-10T18:50:42.790 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-06-10T18:50:42.790 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-06-10T18:50:43.100 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-06-10T18:50:43.569 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph-base (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:43.640 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up cephfs-mirror (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:43.792 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-test (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:43.916 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-06-10T18:50:44.025 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up radosgw (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:44.279 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-06-10T18:50:44.279 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-06-10T18:50:44.446 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph-mds (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:44.692 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-06-10T18:50:44.692 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-06-10T18:50:45.181 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph-mgr (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:45.278 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-base (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:45.411 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-06-10T18:50:45.412 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-06-10T18:50:45.616 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-06-10T18:50:45.933 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph-osd (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:46.130 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-mds (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:46.302 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-06-10T18:50:46.302 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-06-10T18:50:46.354 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-06-10T18:50:46.354 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-06-10T18:50:46.843 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph-mgr-k8sevents (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:46.914 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-mgr (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:46.969 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:47.103 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph-mon (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:47.128 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-06-10T18:50:47.129 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-06-10T18:50:47.302 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-06-10T18:50:47.303 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-06-10T18:50:47.657 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-osd (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:47.804 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph-mgr-cephadm (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:47.947 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:47.968 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-06-10T18:50:47.969 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-06-10T18:50:48.073 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph-mgr-dashboard (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:48.208 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph-volume (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:48.335 INFO:teuthology.orchestra.run.smithi053.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-06-10T18:50:48.517 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-mgr-k8sevents (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:48.627 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:48.761 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-mon (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:48.976 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-06-10T18:50:48.977 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-06-10T18:50:49.402 INFO:teuthology.orchestra.run.smithi053.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-06-10T18:50:49.503 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-mgr-cephadm (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:49.646 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:49.772 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-mgr-dashboard (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:49.855 INFO:teuthology.orchestra.run.smithi053.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-06-10T18:50:49.857 DEBUG:teuthology.orchestra.run.smithi053:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-06-10T18:50:49.913 INFO:teuthology.orchestra.run.smithi053.stdout:Reading package lists... 2023-06-10T18:50:49.915 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ceph-volume (18.0.0-4359-g219d315c-1jammy) ... 2023-06-10T18:50:50.025 INFO:teuthology.orchestra.run.smithi117.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-06-10T18:50:50.093 INFO:teuthology.orchestra.run.smithi053.stdout:Building dependency tree... 2023-06-10T18:50:50.094 INFO:teuthology.orchestra.run.smithi053.stdout:Reading state information... 2023-06-10T18:50:50.257 INFO:teuthology.orchestra.run.smithi053.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-06-10T18:50:50.257 INFO:teuthology.orchestra.run.smithi053.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-06-10T18:50:50.257 INFO:teuthology.orchestra.run.smithi053.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-06-10T18:50:50.257 INFO:teuthology.orchestra.run.smithi053.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-06-10T18:50:50.257 INFO:teuthology.orchestra.run.smithi053.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-06-10T18:50:50.258 INFO:teuthology.orchestra.run.smithi053.stdout:The following packages were automatically installed and are no longer required: 2023-06-10T18:50:50.258 INFO:teuthology.orchestra.run.smithi053.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-06-10T18:50:50.258 INFO:teuthology.orchestra.run.smithi053.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-06-10T18:50:50.258 INFO:teuthology.orchestra.run.smithi053.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-06-10T18:50:50.259 INFO:teuthology.orchestra.run.smithi053.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-06-10T18:50:50.259 INFO:teuthology.orchestra.run.smithi053.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-06-10T18:50:50.259 INFO:teuthology.orchestra.run.smithi053.stdout:Use 'sudo apt autoremove' to remove them. 2023-06-10T18:50:50.259 INFO:teuthology.orchestra.run.smithi053.stdout:The following additional packages will be installed: 2023-06-10T18:50:50.259 INFO:teuthology.orchestra.run.smithi053.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-06-10T18:50:50.260 INFO:teuthology.orchestra.run.smithi053.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-06-10T18:50:50.260 INFO:teuthology.orchestra.run.smithi053.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-06-10T18:50:50.260 INFO:teuthology.orchestra.run.smithi053.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-06-10T18:50:50.260 INFO:teuthology.orchestra.run.smithi053.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-06-10T18:50:50.260 INFO:teuthology.orchestra.run.smithi053.stdout:Suggested packages: 2023-06-10T18:50:50.261 INFO:teuthology.orchestra.run.smithi053.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-06-10T18:50:50.261 INFO:teuthology.orchestra.run.smithi053.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-06-10T18:50:50.261 INFO:teuthology.orchestra.run.smithi053.stdout: libengine-pkcs11-openssl 2023-06-10T18:50:50.296 INFO:teuthology.orchestra.run.smithi053.stdout:The following NEW packages will be installed: 2023-06-10T18:50:50.296 INFO:teuthology.orchestra.run.smithi053.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-06-10T18:50:50.297 INFO:teuthology.orchestra.run.smithi053.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-06-10T18:50:50.297 INFO:teuthology.orchestra.run.smithi053.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-06-10T18:50:50.297 INFO:teuthology.orchestra.run.smithi053.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-06-10T18:50:50.297 INFO:teuthology.orchestra.run.smithi053.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-06-10T18:50:50.297 INFO:teuthology.orchestra.run.smithi053.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-06-10T18:50:50.298 INFO:teuthology.orchestra.run.smithi053.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-06-10T18:50:50.298 INFO:teuthology.orchestra.run.smithi053.stdout:The following packages will be upgraded: 2023-06-10T18:50:50.298 INFO:teuthology.orchestra.run.smithi053.stdout: libssl3 2023-06-10T18:50:50.368 INFO:teuthology.orchestra.run.smithi053.stdout:1 upgraded, 39 newly installed, 0 to remove and 188 not upgraded. 2023-06-10T18:50:50.368 INFO:teuthology.orchestra.run.smithi053.stdout:Need to get 54.6 MB of archives. 2023-06-10T18:50:50.368 INFO:teuthology.orchestra.run.smithi053.stdout:After this operation, 202 MB of additional disk space will be used. 2023-06-10T18:50:50.368 INFO:teuthology.orchestra.run.smithi053.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-06-10T18:50:50.466 INFO:teuthology.orchestra.run.smithi053.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.10 [1,901 kB] 2023-06-10T18:50:50.528 INFO:teuthology.orchestra.run.smithi053.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-06-10T18:50:50.543 INFO:teuthology.orchestra.run.smithi053.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-06-10T18:50:50.544 INFO:teuthology.orchestra.run.smithi053.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-06-10T18:50:50.547 INFO:teuthology.orchestra.run.smithi053.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 indent amd64 2.2.12-1build2 [90.8 kB] 2023-06-10T18:50:50.549 INFO:teuthology.orchestra.run.smithi053.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-06-10T18:50:50.550 INFO:teuthology.orchestra.run.smithi053.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-06-10T18:50:50.551 INFO:teuthology.orchestra.run.smithi053.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-06-10T18:50:50.552 INFO:teuthology.orchestra.run.smithi053.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-06-10T18:50:50.588 INFO:teuthology.orchestra.run.smithi053.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-06-10T18:50:50.589 INFO:teuthology.orchestra.run.smithi053.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-06-10T18:50:50.638 INFO:teuthology.orchestra.run.smithi053.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1 [24.0 MB] 2023-06-10T18:50:51.031 INFO:teuthology.orchestra.run.smithi053.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-06-10T18:50:51.033 INFO:teuthology.orchestra.run.smithi053.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-06-10T18:50:51.033 INFO:teuthology.orchestra.run.smithi053.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.1 [263 kB] 2023-06-10T18:50:51.035 INFO:teuthology.orchestra.run.smithi053.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-06-10T18:50:51.036 INFO:teuthology.orchestra.run.smithi053.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-06-10T18:50:51.040 INFO:teuthology.orchestra.run.smithi053.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.8-0ubuntu0.22.04.1 [141 kB] 2023-06-10T18:50:51.041 INFO:teuthology.orchestra.run.smithi053.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-06-10T18:50:51.048 INFO:teuthology.orchestra.run.smithi053.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-06-10T18:50:51.082 INFO:teuthology.orchestra.run.smithi053.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.10 [2,372 kB] 2023-06-10T18:50:51.126 INFO:teuthology.orchestra.run.smithi117.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-06-10T18:50:51.242 INFO:teuthology.orchestra.run.smithi053.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-06-10T18:50:51.243 INFO:teuthology.orchestra.run.smithi053.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.1 [1,094 kB] 2023-06-10T18:50:51.267 INFO:teuthology.orchestra.run.smithi053.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-06-10T18:50:51.302 INFO:teuthology.orchestra.run.smithi053.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-06-10T18:50:51.306 INFO:teuthology.orchestra.run.smithi053.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-06-10T18:50:51.307 INFO:teuthology.orchestra.run.smithi053.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-06-10T18:50:51.307 INFO:teuthology.orchestra.run.smithi053.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-06-10T18:50:51.308 INFO:teuthology.orchestra.run.smithi053.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.8-0ubuntu0.22.04.1 [1,221 kB] 2023-06-10T18:50:51.322 INFO:teuthology.orchestra.run.smithi053.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-06-10T18:50:51.324 INFO:teuthology.orchestra.run.smithi053.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.8-0ubuntu0.22.04.1 [16.1 MB] 2023-06-10T18:50:51.564 INFO:teuthology.orchestra.run.smithi053.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-06-10T18:50:51.582 INFO:teuthology.orchestra.run.smithi053.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-06-10T18:50:51.582 INFO:teuthology.orchestra.run.smithi053.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-06-10T18:50:51.582 INFO:teuthology.orchestra.run.smithi053.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-06-10T18:50:51.596 INFO:teuthology.orchestra.run.smithi117.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-06-10T18:50:51.598 DEBUG:teuthology.orchestra.run.smithi117:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-06-10T18:50:51.600 INFO:teuthology.orchestra.run.smithi053.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-06-10T18:50:51.601 INFO:teuthology.orchestra.run.smithi053.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-06-10T18:50:51.651 INFO:teuthology.orchestra.run.smithi117.stdout:Reading package lists... 2023-06-10T18:50:51.700 INFO:teuthology.orchestra.run.smithi053.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-06-10T18:50:51.701 INFO:teuthology.orchestra.run.smithi053.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-06-10T18:50:51.824 INFO:teuthology.orchestra.run.smithi117.stdout:Building dependency tree... 2023-06-10T18:50:51.825 INFO:teuthology.orchestra.run.smithi117.stdout:Reading state information... 2023-06-10T18:50:51.982 INFO:teuthology.orchestra.run.smithi117.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-06-10T18:50:51.982 INFO:teuthology.orchestra.run.smithi117.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-06-10T18:50:51.982 INFO:teuthology.orchestra.run.smithi117.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-06-10T18:50:51.982 INFO:teuthology.orchestra.run.smithi117.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-06-10T18:50:51.982 INFO:teuthology.orchestra.run.smithi117.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-06-10T18:50:51.982 INFO:teuthology.orchestra.run.smithi117.stdout:The following packages were automatically installed and are no longer required: 2023-06-10T18:50:51.983 INFO:teuthology.orchestra.run.smithi117.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-06-10T18:50:51.983 INFO:teuthology.orchestra.run.smithi117.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-06-10T18:50:51.983 INFO:teuthology.orchestra.run.smithi117.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-06-10T18:50:51.984 INFO:teuthology.orchestra.run.smithi117.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-06-10T18:50:51.984 INFO:teuthology.orchestra.run.smithi117.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-06-10T18:50:51.984 INFO:teuthology.orchestra.run.smithi117.stdout:Use 'sudo apt autoremove' to remove them. 2023-06-10T18:50:51.984 INFO:teuthology.orchestra.run.smithi117.stdout:The following additional packages will be installed: 2023-06-10T18:50:51.984 INFO:teuthology.orchestra.run.smithi117.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-06-10T18:50:51.984 INFO:teuthology.orchestra.run.smithi117.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-06-10T18:50:51.985 INFO:teuthology.orchestra.run.smithi117.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-06-10T18:50:51.985 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-06-10T18:50:51.985 INFO:teuthology.orchestra.run.smithi117.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-06-10T18:50:51.985 INFO:teuthology.orchestra.run.smithi117.stdout:Suggested packages: 2023-06-10T18:50:51.985 INFO:teuthology.orchestra.run.smithi117.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-06-10T18:50:51.986 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-06-10T18:50:51.986 INFO:teuthology.orchestra.run.smithi117.stdout: libengine-pkcs11-openssl 2023-06-10T18:50:52.021 INFO:teuthology.orchestra.run.smithi117.stdout:The following NEW packages will be installed: 2023-06-10T18:50:52.021 INFO:teuthology.orchestra.run.smithi117.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-06-10T18:50:52.022 INFO:teuthology.orchestra.run.smithi117.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-06-10T18:50:52.022 INFO:teuthology.orchestra.run.smithi117.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-06-10T18:50:52.022 INFO:teuthology.orchestra.run.smithi117.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-06-10T18:50:52.023 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-06-10T18:50:52.023 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-06-10T18:50:52.023 INFO:teuthology.orchestra.run.smithi117.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-06-10T18:50:52.023 INFO:teuthology.orchestra.run.smithi117.stdout:The following packages will be upgraded: 2023-06-10T18:50:52.024 INFO:teuthology.orchestra.run.smithi117.stdout: libssl3 2023-06-10T18:50:52.073 INFO:teuthology.orchestra.run.smithi117.stdout:1 upgraded, 39 newly installed, 0 to remove and 188 not upgraded. 2023-06-10T18:50:52.074 INFO:teuthology.orchestra.run.smithi117.stdout:Need to get 54.6 MB of archives. 2023-06-10T18:50:52.074 INFO:teuthology.orchestra.run.smithi117.stdout:After this operation, 202 MB of additional disk space will be used. 2023-06-10T18:50:52.074 INFO:teuthology.orchestra.run.smithi117.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-06-10T18:50:52.119 INFO:teuthology.orchestra.run.smithi053.stdout:Preconfiguring packages ... 2023-06-10T18:50:52.173 INFO:teuthology.orchestra.run.smithi117.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.10 [1,901 kB] 2023-06-10T18:50:52.233 INFO:teuthology.orchestra.run.smithi117.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-06-10T18:50:52.248 INFO:teuthology.orchestra.run.smithi117.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-06-10T18:50:52.249 INFO:teuthology.orchestra.run.smithi117.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-06-10T18:50:52.251 INFO:teuthology.orchestra.run.smithi117.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 indent amd64 2.2.12-1build2 [90.8 kB] 2023-06-10T18:50:52.253 INFO:teuthology.orchestra.run.smithi117.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-06-10T18:50:52.254 INFO:teuthology.orchestra.run.smithi117.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-06-10T18:50:52.255 INFO:teuthology.orchestra.run.smithi117.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-06-10T18:50:52.256 INFO:teuthology.orchestra.run.smithi117.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-06-10T18:50:52.265 INFO:teuthology.orchestra.run.smithi053.stdout:Fetched 54.6 MB in 1s (39.1 MB/s) 2023-06-10T18:50:52.292 INFO:teuthology.orchestra.run.smithi117.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-06-10T18:50:52.292 INFO:teuthology.orchestra.run.smithi117.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-06-10T18:50:52.342 INFO:teuthology.orchestra.run.smithi117.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1 [24.0 MB] 2023-06-10T18:50:52.385 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package flex. 2023-06-10T18:50:52.479 INFO:teuthology.orchestra.run.smithi053.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 172968 files and directories currently installed.) 2023-06-10T18:50:52.484 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-06-10T18:50:52.525 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking flex (2.6.4-8build2) ... 2023-06-10T18:50:52.746 INFO:teuthology.orchestra.run.smithi117.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-06-10T18:50:52.748 INFO:teuthology.orchestra.run.smithi117.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-06-10T18:50:52.748 INFO:teuthology.orchestra.run.smithi117.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.1 [263 kB] 2023-06-10T18:50:52.751 INFO:teuthology.orchestra.run.smithi117.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-06-10T18:50:52.751 INFO:teuthology.orchestra.run.smithi117.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-06-10T18:50:52.755 INFO:teuthology.orchestra.run.smithi117.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.8-0ubuntu0.22.04.1 [141 kB] 2023-06-10T18:50:52.757 INFO:teuthology.orchestra.run.smithi117.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-06-10T18:50:52.764 INFO:teuthology.orchestra.run.smithi117.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-06-10T18:50:52.799 INFO:teuthology.orchestra.run.smithi117.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.10 [2,372 kB] 2023-06-10T18:50:52.957 INFO:teuthology.orchestra.run.smithi117.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-06-10T18:50:52.957 INFO:teuthology.orchestra.run.smithi117.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.1 [1,094 kB] 2023-06-10T18:50:52.979 INFO:teuthology.orchestra.run.smithi117.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-06-10T18:50:53.012 INFO:teuthology.orchestra.run.smithi117.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-06-10T18:50:53.017 INFO:teuthology.orchestra.run.smithi117.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-06-10T18:50:53.017 INFO:teuthology.orchestra.run.smithi117.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-06-10T18:50:53.018 INFO:teuthology.orchestra.run.smithi117.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-06-10T18:50:53.019 INFO:teuthology.orchestra.run.smithi117.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.8-0ubuntu0.22.04.1 [1,221 kB] 2023-06-10T18:50:53.032 INFO:teuthology.orchestra.run.smithi117.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-06-10T18:50:53.033 INFO:teuthology.orchestra.run.smithi117.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.8-0ubuntu0.22.04.1 [16.1 MB] 2023-06-10T18:50:53.075 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.10_amd64.deb ... 2023-06-10T18:50:53.213 INFO:teuthology.orchestra.run.smithi117.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-06-10T18:50:53.230 INFO:teuthology.orchestra.run.smithi117.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-06-10T18:50:53.231 INFO:teuthology.orchestra.run.smithi117.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-06-10T18:50:53.231 INFO:teuthology.orchestra.run.smithi117.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-06-10T18:50:53.247 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.10) over (3.0.2-0ubuntu1.7) ... 2023-06-10T18:50:53.249 INFO:teuthology.orchestra.run.smithi117.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-06-10T18:50:53.250 INFO:teuthology.orchestra.run.smithi117.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-06-10T18:50:53.349 INFO:teuthology.orchestra.run.smithi117.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-06-10T18:50:53.350 INFO:teuthology.orchestra.run.smithi117.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-06-10T18:50:53.649 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.10) ... 2023-06-10T18:50:53.752 INFO:teuthology.orchestra.run.smithi117.stdout:Preconfiguring packages ... 2023-06-10T18:50:53.892 INFO:teuthology.orchestra.run.smithi117.stdout:Fetched 54.6 MB in 1s (41.3 MB/s) 2023-06-10T18:50:54.015 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package flex. 2023-06-10T18:50:54.084 INFO:teuthology.orchestra.run.smithi117.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 172968 files and directories currently installed.) 2023-06-10T18:50:54.090 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-06-10T18:50:54.130 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking flex (2.6.4-8build2) ... 2023-06-10T18:50:54.148 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package bison. 2023-06-10T18:50:54.240 INFO:teuthology.orchestra.run.smithi053.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173041 files and directories currently installed.) 2023-06-10T18:50:54.246 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-06-10T18:50:54.284 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-06-10T18:50:54.718 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-06-10T18:50:54.746 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-06-10T18:50:54.785 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-06-10T18:50:54.847 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.10_amd64.deb ... 2023-06-10T18:50:55.011 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.10) over (3.0.2-0ubuntu1.7) ... 2023-06-10T18:50:55.197 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package dump. 2023-06-10T18:50:55.225 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-06-10T18:50:55.263 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking dump (0.4b47-3) ... 2023-06-10T18:50:55.412 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.10) ... 2023-06-10T18:50:55.517 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package indent. 2023-06-10T18:50:55.534 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../03-indent_2.2.12-1build2_amd64.deb ... 2023-06-10T18:50:55.575 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking indent (2.2.12-1build2) ... 2023-06-10T18:50:55.836 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-06-10T18:50:55.853 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-06-10T18:50:55.894 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-06-10T18:50:55.937 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package bison. 2023-06-10T18:50:56.041 INFO:teuthology.orchestra.run.smithi117.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173041 files and directories currently installed.) 2023-06-10T18:50:56.046 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-06-10T18:50:56.106 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-06-10T18:50:56.189 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-06-10T18:50:56.217 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-06-10T18:50:56.256 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-06-10T18:50:56.492 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-06-10T18:50:56.509 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-06-10T18:50:56.591 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-06-10T18:50:56.618 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-06-10T18:50:56.654 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-06-10T18:50:56.657 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-06-10T18:50:56.968 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package dump. 2023-06-10T18:50:56.996 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-06-10T18:50:57.003 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libfl2:amd64. 2023-06-10T18:50:57.031 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-06-10T18:50:57.035 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking dump (0.4b47-3) ... 2023-06-10T18:50:57.070 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-06-10T18:50:57.322 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-06-10T18:50:57.338 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package indent. 2023-06-10T18:50:57.339 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-06-10T18:50:57.354 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../03-indent_2.2.12-1build2_amd64.deb ... 2023-06-10T18:50:57.380 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-06-10T18:50:57.396 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking indent (2.2.12-1build2) ... 2023-06-10T18:50:57.625 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libjson-perl. 2023-06-10T18:50:57.642 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-06-10T18:50:57.649 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-06-10T18:50:57.675 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-06-10T18:50:57.676 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-06-10T18:50:57.715 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-06-10T18:50:57.969 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libllvm14:amd64. 2023-06-10T18:50:57.986 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1_amd64.deb ... 2023-06-10T18:50:58.027 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1) ... 2023-06-10T18:50:58.036 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-06-10T18:50:58.063 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-06-10T18:50:58.094 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-06-10T18:50:58.329 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-06-10T18:50:58.346 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-06-10T18:50:58.388 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-06-10T18:50:58.749 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libfl2:amd64. 2023-06-10T18:50:58.777 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-06-10T18:50:58.816 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-06-10T18:50:59.068 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-06-10T18:50:59.096 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-06-10T18:50:59.135 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-06-10T18:50:59.379 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libjson-perl. 2023-06-10T18:50:59.394 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-06-10T18:50:59.429 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-06-10T18:50:59.707 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libllvm14:amd64. 2023-06-10T18:50:59.734 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1_amd64.deb ... 2023-06-10T18:50:59.747 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-06-10T18:50:59.773 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1) ... 2023-06-10T18:50:59.775 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-06-10T18:50:59.813 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-06-10T18:51:00.091 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libmbim-proxy. 2023-06-10T18:51:00.110 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-06-10T18:51:00.251 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-06-10T18:51:00.553 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-06-10T18:51:00.581 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.1_amd64.deb ... 2023-06-10T18:51:00.620 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.1) ... 2023-06-10T18:51:00.956 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libndp0:amd64. 2023-06-10T18:51:00.984 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-06-10T18:51:01.022 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-06-10T18:51:01.342 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libnm0:amd64. 2023-06-10T18:51:01.370 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-06-10T18:51:01.409 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-06-10T18:51:01.495 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-06-10T18:51:01.523 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-06-10T18:51:01.585 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-06-10T18:51:01.712 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libpq5:amd64. 2023-06-10T18:51:01.740 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../16-libpq5_14.8-0ubuntu0.22.04.1_amd64.deb ... 2023-06-10T18:51:01.778 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libpq5:amd64 (14.8-0ubuntu0.22.04.1) ... 2023-06-10T18:51:01.829 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libmbim-proxy. 2023-06-10T18:51:01.856 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-06-10T18:51:01.895 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-06-10T18:51:02.148 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-06-10T18:51:02.176 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-06-10T18:51:02.181 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-06-10T18:51:02.209 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.1_amd64.deb ... 2023-06-10T18:51:02.214 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-06-10T18:51:02.248 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.1) ... 2023-06-10T18:51:02.525 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libqmi-proxy. 2023-06-10T18:51:02.542 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-06-10T18:51:02.583 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-06-10T18:51:02.592 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libndp0:amd64. 2023-06-10T18:51:02.620 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-06-10T18:51:02.659 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-06-10T18:51:02.802 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-06-10T18:51:02.819 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.10_amd64.deb ... 2023-06-10T18:51:02.852 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-06-10T18:51:02.986 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libnm0:amd64. 2023-06-10T18:51:03.014 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-06-10T18:51:03.053 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-06-10T18:51:03.289 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-06-10T18:51:03.318 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-06-10T18:51:03.356 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-06-10T18:51:03.364 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libpq5:amd64. 2023-06-10T18:51:03.391 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../16-libpq5_14.8-0ubuntu0.22.04.1_amd64.deb ... 2023-06-10T18:51:03.430 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libpq5:amd64 (14.8-0ubuntu0.22.04.1) ... 2023-06-10T18:51:03.726 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package modemmanager. 2023-06-10T18:51:03.750 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-06-10T18:51:03.754 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.1_amd64.deb ... 2023-06-10T18:51:03.777 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-06-10T18:51:03.792 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.1) ... 2023-06-10T18:51:03.816 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-06-10T18:51:04.110 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libqmi-proxy. 2023-06-10T18:51:04.126 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-06-10T18:51:04.169 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-06-10T18:51:04.348 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package network-manager. 2023-06-10T18:51:04.376 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-06-10T18:51:04.412 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-06-10T18:51:04.428 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.10_amd64.deb ... 2023-06-10T18:51:04.440 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-06-10T18:51:04.470 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-06-10T18:51:04.983 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-06-10T18:51:05.010 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-06-10T18:51:05.022 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ppp. 2023-06-10T18:51:05.049 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-06-10T18:51:05.050 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-06-10T18:51:05.360 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-06-10T18:51:05.435 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package modemmanager. 2023-06-10T18:51:05.463 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.1_amd64.deb ... 2023-06-10T18:51:05.502 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.1) ... 2023-06-10T18:51:05.886 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package pptp-linux. 2023-06-10T18:51:05.914 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-06-10T18:51:05.952 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-06-10T18:51:06.074 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package network-manager. 2023-06-10T18:51:06.102 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-06-10T18:51:06.149 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-06-10T18:51:06.205 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package network-manager-pptp. 2023-06-10T18:51:06.221 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-06-10T18:51:06.263 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-06-10T18:51:06.558 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package postgresql-client-common. 2023-06-10T18:51:06.586 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-06-10T18:51:06.616 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking postgresql-client-common (238) ... 2023-06-10T18:51:06.823 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package ppp. 2023-06-10T18:51:06.851 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-06-10T18:51:06.920 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package postgresql-client-14. 2023-06-10T18:51:06.948 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../27-postgresql-client-14_14.8-0ubuntu0.22.04.1_amd64.deb ... 2023-06-10T18:51:06.986 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking postgresql-client-14 (14.8-0ubuntu0.22.04.1) ... 2023-06-10T18:51:07.152 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-06-10T18:51:07.461 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package pptp-linux. 2023-06-10T18:51:07.477 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-06-10T18:51:07.519 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-06-10T18:51:07.617 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package postgresql-common. 2023-06-10T18:51:07.645 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-06-10T18:51:07.702 INFO:teuthology.orchestra.run.smithi053.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-06-10T18:51:07.731 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking postgresql-common (238) ... 2023-06-10T18:51:07.788 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package network-manager-pptp. 2023-06-10T18:51:07.815 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-06-10T18:51:07.854 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-06-10T18:51:08.165 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package postgresql-14. 2023-06-10T18:51:08.166 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package postgresql-client-common. 2023-06-10T18:51:08.194 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../29-postgresql-14_14.8-0ubuntu0.22.04.1_amd64.deb ... 2023-06-10T18:51:08.194 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-06-10T18:51:08.232 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking postgresql-client-common (238) ... 2023-06-10T18:51:08.235 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking postgresql-14 (14.8-0ubuntu0.22.04.1) ... 2023-06-10T18:51:08.511 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package postgresql-client-14. 2023-06-10T18:51:08.538 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../27-postgresql-client-14_14.8-0ubuntu0.22.04.1_amd64.deb ... 2023-06-10T18:51:08.569 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking postgresql-client-14 (14.8-0ubuntu0.22.04.1) ... 2023-06-10T18:51:09.157 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package postgresql-common. 2023-06-10T18:51:09.185 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-06-10T18:51:09.234 INFO:teuthology.orchestra.run.smithi117.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-06-10T18:51:09.263 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking postgresql-common (238) ... 2023-06-10T18:51:09.460 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package postgresql. 2023-06-10T18:51:09.478 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-06-10T18:51:09.518 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking postgresql (14+238) ... 2023-06-10T18:51:09.731 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package postgresql-14. 2023-06-10T18:51:09.758 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../29-postgresql-14_14.8-0ubuntu0.22.04.1_amd64.deb ... 2023-06-10T18:51:09.770 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package postgresql-client. 2023-06-10T18:51:09.788 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-06-10T18:51:09.801 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking postgresql-14 (14.8-0ubuntu0.22.04.1) ... 2023-06-10T18:51:09.829 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking postgresql-client (14+238) ... 2023-06-10T18:51:10.039 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package postgresql-contrib. 2023-06-10T18:51:10.056 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-06-10T18:51:10.089 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking postgresql-contrib (14+238) ... 2023-06-10T18:51:10.425 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package tcl8.6. 2023-06-10T18:51:10.454 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-06-10T18:51:10.492 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-06-10T18:51:11.022 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package tcl. 2023-06-10T18:51:11.051 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-06-10T18:51:11.086 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-06-10T18:51:11.251 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package postgresql. 2023-06-10T18:51:11.268 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-06-10T18:51:11.309 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking postgresql (14+238) ... 2023-06-10T18:51:11.408 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package wpasupplicant. 2023-06-10T18:51:11.437 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-06-10T18:51:11.475 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-06-10T18:51:11.528 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package postgresql-client. 2023-06-10T18:51:11.544 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-06-10T18:51:11.586 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking postgresql-client (14+238) ... 2023-06-10T18:51:11.846 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-06-10T18:51:11.863 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-06-10T18:51:11.904 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-06-10T18:51:12.274 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package usb-modeswitch. 2023-06-10T18:51:12.303 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-06-10T18:51:12.349 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-06-10T18:51:12.465 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package postgresql-contrib. 2023-06-10T18:51:12.493 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-06-10T18:51:12.531 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking postgresql-contrib (14+238) ... 2023-06-10T18:51:12.611 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up postgresql-client-common (238) ... 2023-06-10T18:51:12.803 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package tcl8.6. 2023-06-10T18:51:12.821 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up flex (2.6.4-8build2) ... 2023-06-10T18:51:12.831 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-06-10T18:51:12.861 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-06-10T18:51:12.947 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-06-10T18:51:13.073 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libpq5:amd64 (14.8-0ubuntu0.22.04.1) ... 2023-06-10T18:51:13.147 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package tcl. 2023-06-10T18:51:13.175 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-06-10T18:51:13.199 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-06-10T18:51:13.218 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-06-10T18:51:13.317 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-06-10T18:51:13.418 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up postgresql-client-14 (14.8-0ubuntu0.22.04.1) ... 2023-06-10T18:51:13.550 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package wpasupplicant. 2023-06-10T18:51:13.578 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-06-10T18:51:13.608 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-06-10T18:51:13.937 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-06-10T18:51:13.954 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-06-10T18:51:13.965 INFO:teuthology.orchestra.run.smithi053.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-06-10T18:51:13.987 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-06-10T18:51:14.048 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-06-10T18:51:14.365 INFO:teuthology.orchestra.run.smithi117.stdout:Selecting previously unselected package usb-modeswitch. 2023-06-10T18:51:14.393 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-06-10T18:51:14.437 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-06-10T18:51:14.437 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-06-10T18:51:14.441 INFO:teuthology.orchestra.run.smithi117.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-06-10T18:51:14.726 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up postgresql-client-common (238) ... 2023-06-10T18:51:14.904 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up flex (2.6.4-8build2) ... 2023-06-10T18:51:14.960 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-06-10T18:51:15.030 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-06-10T18:51:15.061 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-06-10T18:51:15.156 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libpq5:amd64 (14.8-0ubuntu0.22.04.1) ... 2023-06-10T18:51:15.195 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-06-10T18:51:15.282 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-06-10T18:51:15.321 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-06-10T18:51:15.408 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-06-10T18:51:15.447 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-06-10T18:51:15.534 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up postgresql-client-14 (14.8-0ubuntu0.22.04.1) ... 2023-06-10T18:51:15.573 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-06-10T18:51:15.699 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-06-10T18:51:16.005 INFO:teuthology.orchestra.run.smithi117.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-06-10T18:51:16.090 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-06-10T18:51:16.348 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1) ... 2023-06-10T18:51:16.472 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-06-10T18:51:16.472 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-06-10T18:51:16.474 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up dump (0.4b47-3) ... 2023-06-10T18:51:16.568 INFO:teuthology.orchestra.run.smithi053.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-06-10T18:51:16.634 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.1) ... 2023-06-10T18:51:16.735 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-06-10T18:51:16.895 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up tcl (8.6.11+1build2) ... 2023-06-10T18:51:16.993 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-06-10T18:51:17.021 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libjson-perl (4.04000-1) ... 2023-06-10T18:51:17.119 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-06-10T18:51:17.147 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-06-10T18:51:17.236 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-06-10T18:51:17.237 INFO:teuthology.orchestra.run.smithi053.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-06-10T18:51:17.307 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up indent (2.2.12-1build2) ... 2023-06-10T18:51:17.379 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-06-10T18:51:17.433 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-06-10T18:51:17.505 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-06-10T18:51:17.609 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-06-10T18:51:17.656 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-06-10T18:51:17.710 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-06-10T18:51:17.782 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-06-10T18:51:17.812 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-06-10T18:51:17.971 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up postgresql-client (14+238) ... 2023-06-10T18:51:18.122 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-06-10T18:51:18.412 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1) ... 2023-06-10T18:51:18.538 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up dump (0.4b47-3) ... 2023-06-10T18:51:18.593 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:51:18.593 INFO:teuthology.orchestra.run.smithi053.stdout:The following network interfaces were found in /etc/network/interfaces 2023-06-10T18:51:18.593 INFO:teuthology.orchestra.run.smithi053.stdout:which means they are currently configured by ifupdown: 2023-06-10T18:51:18.593 INFO:teuthology.orchestra.run.smithi053.stdout:- ens1f0 2023-06-10T18:51:18.593 INFO:teuthology.orchestra.run.smithi053.stdout:If you want to manage those interfaces with NetworkManager instead 2023-06-10T18:51:18.593 INFO:teuthology.orchestra.run.smithi053.stdout:remove their configuration from /etc/network/interfaces. 2023-06-10T18:51:18.594 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:51:18.632 INFO:teuthology.orchestra.run.smithi117.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-06-10T18:51:18.698 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.1) ... 2023-06-10T18:51:18.710 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-06-10T18:51:18.824 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-06-10T18:51:18.950 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up tcl (8.6.11+1build2) ... 2023-06-10T18:51:19.048 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-06-10T18:51:19.076 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libjson-perl (4.04000-1) ... 2023-06-10T18:51:19.202 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-06-10T18:51:19.276 INFO:teuthology.orchestra.run.smithi117.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-06-10T18:51:19.345 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up indent (2.2.12-1build2) ... 2023-06-10T18:51:19.417 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-06-10T18:51:19.471 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-06-10T18:51:19.647 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-06-10T18:51:19.773 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-06-10T18:51:19.899 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-06-10T18:51:19.950 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-06-10T18:51:20.067 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up postgresql-client (14+238) ... 2023-06-10T18:51:20.082 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-06-10T18:51:20.186 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-06-10T18:51:20.193 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-06-10T18:51:20.287 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up postgresql-common (238) ... 2023-06-10T18:51:20.665 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-06-10T18:51:20.665 INFO:teuthology.orchestra.run.smithi117.stdout:The following network interfaces were found in /etc/network/interfaces 2023-06-10T18:51:20.665 INFO:teuthology.orchestra.run.smithi117.stdout:which means they are currently configured by ifupdown: 2023-06-10T18:51:20.666 INFO:teuthology.orchestra.run.smithi117.stdout:- enp3s0f1 2023-06-10T18:51:20.666 INFO:teuthology.orchestra.run.smithi117.stdout:If you want to manage those interfaces with NetworkManager instead 2023-06-10T18:51:20.666 INFO:teuthology.orchestra.run.smithi117.stdout:remove their configuration from /etc/network/interfaces. 2023-06-10T18:51:20.666 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-06-10T18:51:20.782 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-06-10T18:51:21.100 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-06-10T18:51:21.443 INFO:teuthology.orchestra.run.smithi053.stdout:Adding user postgres to group ssl-cert 2023-06-10T18:51:21.469 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-06-10T18:51:21.664 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:51:21.664 INFO:teuthology.orchestra.run.smithi053.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-06-10T18:51:21.845 INFO:teuthology.orchestra.run.smithi053.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-06-10T18:51:21.845 INFO:teuthology.orchestra.run.smithi053.stdout:Removing obsolete dictionary files: 2023-06-10T18:51:22.012 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-06-10T18:51:22.155 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-06-10T18:51:22.281 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-06-10T18:51:22.407 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up postgresql-common (238) ... 2023-06-10T18:51:22.441 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-06-10T18:51:22.814 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up postgresql-14 (14.8-0ubuntu0.22.04.1) ... 2023-06-10T18:51:23.166 INFO:teuthology.orchestra.run.smithi053.stdout:Creating new PostgreSQL cluster 14/main ... 2023-06-10T18:51:23.176 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-06-10T18:51:23.222 INFO:teuthology.orchestra.run.smithi053.stdout:The files belonging to this database system will be owned by user "postgres". 2023-06-10T18:51:23.222 INFO:teuthology.orchestra.run.smithi053.stdout:This user must also own the server process. 2023-06-10T18:51:23.222 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:51:23.222 INFO:teuthology.orchestra.run.smithi053.stdout:The database cluster will be initialized with locale "en_US". 2023-06-10T18:51:23.223 INFO:teuthology.orchestra.run.smithi053.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-06-10T18:51:23.223 INFO:teuthology.orchestra.run.smithi053.stdout:The default text search configuration will be set to "english". 2023-06-10T18:51:23.223 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:51:23.223 INFO:teuthology.orchestra.run.smithi053.stdout:Data page checksums are disabled. 2023-06-10T18:51:23.223 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:51:23.223 INFO:teuthology.orchestra.run.smithi053.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-06-10T18:51:23.224 INFO:teuthology.orchestra.run.smithi053.stdout:creating subdirectories ... ok 2023-06-10T18:51:23.224 INFO:teuthology.orchestra.run.smithi053.stdout:selecting dynamic shared memory implementation ... posix 2023-06-10T18:51:23.236 INFO:teuthology.orchestra.run.smithi053.stdout:selecting default max_connections ... 100 2023-06-10T18:51:23.258 INFO:teuthology.orchestra.run.smithi053.stdout:selecting default shared_buffers ... 128MB 2023-06-10T18:51:23.268 INFO:teuthology.orchestra.run.smithi053.stdout:selecting default time zone ... Etc/UTC 2023-06-10T18:51:23.269 INFO:teuthology.orchestra.run.smithi053.stdout:creating configuration files ... ok 2023-06-10T18:51:23.388 INFO:teuthology.orchestra.run.smithi053.stdout:running bootstrap script ... ok 2023-06-10T18:51:23.624 INFO:teuthology.orchestra.run.smithi117.stdout:Adding user postgres to group ssl-cert 2023-06-10T18:51:23.843 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-06-10T18:51:23.843 INFO:teuthology.orchestra.run.smithi117.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-06-10T18:51:24.005 INFO:teuthology.orchestra.run.smithi053.stdout:performing post-bootstrap initialization ... ok 2023-06-10T18:51:24.029 INFO:teuthology.orchestra.run.smithi117.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-06-10T18:51:24.029 INFO:teuthology.orchestra.run.smithi117.stdout:Removing obsolete dictionary files: 2023-06-10T18:51:24.609 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-06-10T18:51:24.650 INFO:teuthology.orchestra.run.smithi053.stdout:syncing data to disk ... ok 2023-06-10T18:51:25.034 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up postgresql-14 (14.8-0ubuntu0.22.04.1) ... 2023-06-10T18:51:25.056 INFO:teuthology.orchestra.run.smithi053.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-06-10T18:51:25.363 INFO:teuthology.orchestra.run.smithi117.stdout:Creating new PostgreSQL cluster 14/main ... 2023-06-10T18:51:25.388 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-06-10T18:51:25.437 INFO:teuthology.orchestra.run.smithi117.stdout:The files belonging to this database system will be owned by user "postgres". 2023-06-10T18:51:25.438 INFO:teuthology.orchestra.run.smithi117.stdout:This user must also own the server process. 2023-06-10T18:51:25.438 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-06-10T18:51:25.438 INFO:teuthology.orchestra.run.smithi117.stdout:The database cluster will be initialized with locale "en_US". 2023-06-10T18:51:25.438 INFO:teuthology.orchestra.run.smithi117.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-06-10T18:51:25.438 INFO:teuthology.orchestra.run.smithi117.stdout:The default text search configuration will be set to "english". 2023-06-10T18:51:25.438 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-06-10T18:51:25.438 INFO:teuthology.orchestra.run.smithi117.stdout:Data page checksums are disabled. 2023-06-10T18:51:25.439 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-06-10T18:51:25.439 INFO:teuthology.orchestra.run.smithi117.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-06-10T18:51:25.439 INFO:teuthology.orchestra.run.smithi117.stdout:creating subdirectories ... ok 2023-06-10T18:51:25.439 INFO:teuthology.orchestra.run.smithi117.stdout:selecting dynamic shared memory implementation ... posix 2023-06-10T18:51:25.453 INFO:teuthology.orchestra.run.smithi117.stdout:selecting default max_connections ... 100 2023-06-10T18:51:25.473 INFO:teuthology.orchestra.run.smithi117.stdout:selecting default shared_buffers ... 128MB 2023-06-10T18:51:25.483 INFO:teuthology.orchestra.run.smithi117.stdout:selecting default time zone ... Etc/UTC 2023-06-10T18:51:25.483 INFO:teuthology.orchestra.run.smithi117.stdout:creating configuration files ... ok 2023-06-10T18:51:25.595 INFO:teuthology.orchestra.run.smithi117.stdout:running bootstrap script ... ok 2023-06-10T18:51:26.224 INFO:teuthology.orchestra.run.smithi117.stdout:performing post-bootstrap initialization ... ok 2023-06-10T18:51:27.109 INFO:teuthology.orchestra.run.smithi117.stdout:syncing data to disk ... ok 2023-06-10T18:51:27.558 INFO:teuthology.orchestra.run.smithi117.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-06-10T18:51:27.888 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-06-10T18:51:28.014 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up postgresql-contrib (14+238) ... 2023-06-10T18:51:28.140 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up postgresql (14+238) ... 2023-06-10T18:51:28.266 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-06-10T18:51:28.392 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.1) ... 2023-06-10T18:51:28.660 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-06-10T18:51:28.660 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-06-10T18:51:29.262 INFO:teuthology.orchestra.run.smithi053.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-06-10T18:51:29.539 INFO:teuthology.orchestra.run.smithi053.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-06-10T18:51:29.690 INFO:teuthology.orchestra.run.smithi053.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-06-10T18:51:30.366 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-06-10T18:51:30.492 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up postgresql-contrib (14+238) ... 2023-06-10T18:51:30.618 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up postgresql (14+238) ... 2023-06-10T18:51:30.736 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-06-10T18:51:30.845 INFO:teuthology.orchestra.run.smithi117.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.1) ... 2023-06-10T18:51:31.010 INFO:teuthology.orchestra.run.smithi053.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-06-10T18:51:31.083 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-06-10T18:51:31.084 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-06-10T18:51:31.110 INFO:teuthology.orchestra.run.smithi053.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-06-10T18:51:31.689 INFO:teuthology.orchestra.run.smithi117.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-06-10T18:51:31.706 INFO:teuthology.orchestra.run.smithi053.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-06-10T18:51:31.708 DEBUG:teuthology.parallel:result is None 2023-06-10T18:51:31.991 INFO:teuthology.orchestra.run.smithi117.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-06-10T18:51:32.168 INFO:teuthology.orchestra.run.smithi117.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-06-10T18:51:33.479 INFO:teuthology.orchestra.run.smithi117.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-06-10T18:51:33.579 INFO:teuthology.orchestra.run.smithi117.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-06-10T18:51:34.187 INFO:teuthology.orchestra.run.smithi117.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-06-10T18:51:34.189 DEBUG:teuthology.parallel:result is None 2023-06-10T18:51:34.190 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=219d315c3a0b2075e570fb1964be2ad33fe7a9c8 2023-06-10T18:51:34.505 DEBUG:teuthology.orchestra.run.smithi053:> dpkg-query -W -f '${Version}' ceph 2023-06-10T18:51:34.525 INFO:teuthology.orchestra.run.smithi053.stdout:18.0.0-4359-g219d315c-1jammy 2023-06-10T18:51:34.526 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4359-g219d315c-1jammy 2023-06-10T18:51:34.526 INFO:teuthology.task.install:The correct ceph version 18.0.0-4359-g219d315c-1jammy is installed. 2023-06-10T18:51:34.527 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=219d315c3a0b2075e570fb1964be2ad33fe7a9c8 2023-06-10T18:51:34.855 DEBUG:teuthology.orchestra.run.smithi117:> dpkg-query -W -f '${Version}' ceph 2023-06-10T18:51:34.877 INFO:teuthology.orchestra.run.smithi117.stdout:18.0.0-4359-g219d315c-1jammy 2023-06-10T18:51:34.877 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4359-g219d315c-1jammy 2023-06-10T18:51:34.877 INFO:teuthology.task.install:The correct ceph version 18.0.0-4359-g219d315c-1jammy is installed. 2023-06-10T18:51:34.878 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-06-10T18:51:34.878 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T18:51:34.879 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-06-10T18:51:34.893 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T18:51:34.894 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-06-10T18:51:34.935 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-06-10T18:51:34.935 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T18:51:34.935 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/usr/bin/daemon-helper 2023-06-10T18:51:34.949 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-06-10T18:51:35.005 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T18:51:35.005 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/usr/bin/daemon-helper 2023-06-10T18:51:35.017 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-06-10T18:51:35.073 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-06-10T18:51:35.073 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T18:51:35.074 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/usr/bin/adjust-ulimits 2023-06-10T18:51:35.087 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-06-10T18:51:35.141 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T18:51:35.141 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/usr/bin/adjust-ulimits 2023-06-10T18:51:35.154 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-06-10T18:51:35.209 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-06-10T18:51:35.209 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T18:51:35.209 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/usr/bin/stdin-killer 2023-06-10T18:51:35.223 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-06-10T18:51:35.277 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T18:51:35.277 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/usr/bin/stdin-killer 2023-06-10T18:51:35.290 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-06-10T18:51:35.345 INFO:teuthology.run_tasks:Running task ceph... 2023-06-10T18:51:35.419 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-06-10T18:51:35.420 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 777 /var/log/ceph 2023-06-10T18:51:35.422 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 777 /var/log/ceph 2023-06-10T18:51:35.434 INFO:tasks.ceph:Disabling ceph logrotate... 2023-06-10T18:51:35.435 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -f -- /etc/logrotate.d/ceph 2023-06-10T18:51:35.478 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f -- /etc/logrotate.d/ceph 2023-06-10T18:51:35.491 INFO:tasks.ceph:Creating extra log directories... 2023-06-10T18:51:35.491 DEBUG:teuthology.orchestra.run.smithi053:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-06-10T18:51:35.530 DEBUG:teuthology.orchestra.run.smithi117:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-06-10T18:51:35.550 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-06-10T18:51:35.550 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-06-10T18:51:35.552 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-06-10T18:51:35.552 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T18:51:35.552 DEBUG:teuthology.orchestra.run.smithi053:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-06-10T18:51:35.593 DEBUG:teuthology.orchestra.run.smithi053:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-06-10T18:51:35.673 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T18:51:35.674 DEBUG:teuthology.orchestra.run.smithi117:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-06-10T18:51:35.679 DEBUG:teuthology.orchestra.run.smithi117:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-06-10T18:51:35.758 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-06-10T18:51:35.758 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'evicting unresponsive client', 'but it is still running', 'slow request', 'MDS_CLIENT_LATE_RELEASE', 't responding to mclientcaps', 'file system flag refuse_client_session is set'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-06-10T18:51:35.758 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2023-06-10_18:20:34-fs:functional-main-distro-default-smithi/7301169', 'branch': 'main', 'description': 'fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client-recovery}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7301169', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'pdonnell-2023-06-10_18:20:34-fs:functional-main-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'evicting unresponsive client', 'but it is still running', 'slow request', 'MDS_CLIENT_LATE_RELEASE', 't responding to mclientcaps', 'file system flag refuse_client_session is set'], 'sha1': '219d315c3a0b2075e570fb1964be2ad33fe7a9c8'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '219d315c3a0b2075e570fb1964be2ad33fe7a9c8'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'i61409', 'sha1': '3486dd872ffd89042ca079d680841ce3ef6f4b6f'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 70, 'repo': 'https://github.com/ceph/ceph.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 5151, 'sha1': '219d315c3a0b2075e570fb1964be2ad33fe7a9c8', 'sleep_before_teardown': 0, 'suite': 'fs:functional', 'suite_branch': 'i61409', 'suite_path': '/home/teuthworker/src/github.com_batrick_ceph_3486dd872ffd89042ca079d680841ce3ef6f4b6f/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/batrick/ceph.git', 'suite_sha1': '3486dd872ffd89042ca079d680841ce3ef6f4b6f', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi053.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHz4PxkQkTGV6jwRgxFhPAgth/TCBaJB3bBrMbuw6PzG5yhit1j1UVyscUib1Yka9nD5My81qLIgHIXI+nLH7+o=', 'smithi117.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMFGdcnpx7UyasrmBsPuKd1gCTau9Ir5lsSaADej0mNv7LfREvUcqD+KHP7YdcDf/eteIdQLCeea67ezwjp63Hc='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '219d315c3a0b2075e570fb1964be2ad33fe7a9c8'}}, {'ceph': None}, {'ceph-fuse': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_client_recovery']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '2ef0dcdee569e9851c9d2ffb6acfd4b80d031e61', 'timestamp': '2023-06-10_18:20:34', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.23459'} 2023-06-10T18:51:35.760 DEBUG:teuthology.orchestra.run.smithi053:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-06-10T18:51:35.762 DEBUG:teuthology.orchestra.run.smithi117:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-06-10T18:51:35.806 DEBUG:teuthology.orchestra.run.smithi053:> sudo install -d -m0777 -- /var/run/ceph 2023-06-10T18:51:35.818 DEBUG:teuthology.orchestra.run.smithi117:> sudo install -d -m0777 -- /var/run/ceph 2023-06-10T18:51:35.862 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T18:51:35.862 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/scratch_devs of=/dev/stdout 2023-06-10T18:51:35.877 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-06-10T18:51:35.878 DEBUG:teuthology.orchestra.run.smithi053:> stat /dev/vg_nvme/lv_1 2023-06-10T18:51:35.925 INFO:teuthology.orchestra.run.smithi053.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-06-10T18:51:35.926 INFO:teuthology.orchestra.run.smithi053.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-10T18:51:35.926 INFO:teuthology.orchestra.run.smithi053.stdout:Device: 5h/5d Inode: 876 Links: 1 2023-06-10T18:51:35.926 INFO:teuthology.orchestra.run.smithi053.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-10T18:51:35.926 INFO:teuthology.orchestra.run.smithi053.stdout:Access: 2023-06-10 18:45:34.043575637 +0000 2023-06-10T18:51:35.926 INFO:teuthology.orchestra.run.smithi053.stdout:Modify: 2023-06-10 18:45:33.651579139 +0000 2023-06-10T18:51:35.927 INFO:teuthology.orchestra.run.smithi053.stdout:Change: 2023-06-10 18:45:33.651579139 +0000 2023-06-10T18:51:35.927 INFO:teuthology.orchestra.run.smithi053.stdout: Birth: - 2023-06-10T18:51:35.927 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-06-10T18:51:35.980 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2023-06-10T18:51:35.980 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2023-06-10T18:51:35.980 INFO:teuthology.orchestra.run.smithi053.stderr:512 bytes copied, 0.000319368 s, 1.6 MB/s 2023-06-10T18:51:35.981 DEBUG:teuthology.orchestra.run.smithi053:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-06-10T18:51:36.030 DEBUG:teuthology.orchestra.run.smithi053:> stat /dev/vg_nvme/lv_2 2023-06-10T18:51:36.077 INFO:teuthology.orchestra.run.smithi053.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-06-10T18:51:36.078 INFO:teuthology.orchestra.run.smithi053.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-10T18:51:36.078 INFO:teuthology.orchestra.run.smithi053.stdout:Device: 5h/5d Inode: 892 Links: 1 2023-06-10T18:51:36.078 INFO:teuthology.orchestra.run.smithi053.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-10T18:51:36.078 INFO:teuthology.orchestra.run.smithi053.stdout:Access: 2023-06-10 18:45:34.659570130 +0000 2023-06-10T18:51:36.078 INFO:teuthology.orchestra.run.smithi053.stdout:Modify: 2023-06-10 18:45:34.279573527 +0000 2023-06-10T18:51:36.078 INFO:teuthology.orchestra.run.smithi053.stdout:Change: 2023-06-10 18:45:34.279573527 +0000 2023-06-10T18:51:36.079 INFO:teuthology.orchestra.run.smithi053.stdout: Birth: - 2023-06-10T18:51:36.079 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-06-10T18:51:36.132 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2023-06-10T18:51:36.133 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2023-06-10T18:51:36.133 INFO:teuthology.orchestra.run.smithi053.stderr:512 bytes copied, 0.000256821 s, 2.0 MB/s 2023-06-10T18:51:36.134 DEBUG:teuthology.orchestra.run.smithi053:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-06-10T18:51:36.183 DEBUG:teuthology.orchestra.run.smithi053:> stat /dev/vg_nvme/lv_3 2023-06-10T18:51:36.230 INFO:teuthology.orchestra.run.smithi053.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-06-10T18:51:36.230 INFO:teuthology.orchestra.run.smithi053.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-10T18:51:36.230 INFO:teuthology.orchestra.run.smithi053.stdout:Device: 5h/5d Inode: 906 Links: 1 2023-06-10T18:51:36.231 INFO:teuthology.orchestra.run.smithi053.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-10T18:51:36.232 INFO:teuthology.orchestra.run.smithi053.stdout:Access: 2023-06-10 18:45:35.279564588 +0000 2023-06-10T18:51:36.232 INFO:teuthology.orchestra.run.smithi053.stdout:Modify: 2023-06-10 18:45:34.887568093 +0000 2023-06-10T18:51:36.232 INFO:teuthology.orchestra.run.smithi053.stdout:Change: 2023-06-10 18:45:34.887568093 +0000 2023-06-10T18:51:36.232 INFO:teuthology.orchestra.run.smithi053.stdout: Birth: - 2023-06-10T18:51:36.233 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-06-10T18:51:36.284 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2023-06-10T18:51:36.284 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2023-06-10T18:51:36.284 INFO:teuthology.orchestra.run.smithi053.stderr:512 bytes copied, 0.000199422 s, 2.6 MB/s 2023-06-10T18:51:36.285 DEBUG:teuthology.orchestra.run.smithi053:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-06-10T18:51:36.335 DEBUG:teuthology.orchestra.run.smithi053:> stat /dev/vg_nvme/lv_4 2023-06-10T18:51:36.381 INFO:teuthology.orchestra.run.smithi053.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-06-10T18:51:36.382 INFO:teuthology.orchestra.run.smithi053.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-10T18:51:36.382 INFO:teuthology.orchestra.run.smithi053.stdout:Device: 5h/5d Inode: 920 Links: 1 2023-06-10T18:51:36.382 INFO:teuthology.orchestra.run.smithi053.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-10T18:51:36.382 INFO:teuthology.orchestra.run.smithi053.stdout:Access: 2023-06-10 18:45:35.855559441 +0000 2023-06-10T18:51:36.382 INFO:teuthology.orchestra.run.smithi053.stdout:Modify: 2023-06-10 18:45:35.515562479 +0000 2023-06-10T18:51:36.382 INFO:teuthology.orchestra.run.smithi053.stdout:Change: 2023-06-10 18:45:35.515562479 +0000 2023-06-10T18:51:36.383 INFO:teuthology.orchestra.run.smithi053.stdout: Birth: - 2023-06-10T18:51:36.383 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-06-10T18:51:36.436 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2023-06-10T18:51:36.436 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2023-06-10T18:51:36.436 INFO:teuthology.orchestra.run.smithi053.stderr:512 bytes copied, 0.000203461 s, 2.5 MB/s 2023-06-10T18:51:36.437 DEBUG:teuthology.orchestra.run.smithi053:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-06-10T18:51:36.486 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-10T18:51:36.487 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T18:51:36.487 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/scratch_devs of=/dev/stdout 2023-06-10T18:51:36.493 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-06-10T18:51:36.493 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_1 2023-06-10T18:51:36.542 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-06-10T18:51:36.542 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-10T18:51:36.542 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 5h/5d Inode: 879 Links: 1 2023-06-10T18:51:36.543 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-10T18:51:36.543 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2023-06-10 18:45:28.869932701 +0000 2023-06-10T18:51:36.543 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2023-06-10 18:45:28.549935559 +0000 2023-06-10T18:51:36.543 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2023-06-10 18:45:28.549935559 +0000 2023-06-10T18:51:36.543 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: - 2023-06-10T18:51:36.543 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-06-10T18:51:36.596 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2023-06-10T18:51:36.597 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2023-06-10T18:51:36.597 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000450094 s, 1.1 MB/s 2023-06-10T18:51:36.598 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-06-10T18:51:36.647 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_2 2023-06-10T18:51:36.693 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-06-10T18:51:36.694 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-10T18:51:36.694 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 5h/5d Inode: 897 Links: 1 2023-06-10T18:51:36.694 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-10T18:51:36.694 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2023-06-10 18:45:29.481927234 +0000 2023-06-10T18:51:36.694 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2023-06-10 18:45:29.097930664 +0000 2023-06-10T18:51:36.694 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2023-06-10 18:45:29.097930664 +0000 2023-06-10T18:51:36.694 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: - 2023-06-10T18:51:36.695 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-06-10T18:51:36.748 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2023-06-10T18:51:36.748 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2023-06-10T18:51:36.748 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000350211 s, 1.5 MB/s 2023-06-10T18:51:36.749 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-06-10T18:51:36.798 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_3 2023-06-10T18:51:36.847 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-06-10T18:51:36.847 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-10T18:51:36.847 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 5h/5d Inode: 909 Links: 1 2023-06-10T18:51:36.848 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-10T18:51:36.848 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2023-06-10 18:45:30.085921840 +0000 2023-06-10T18:51:36.848 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2023-06-10 18:45:29.725925055 +0000 2023-06-10T18:51:36.848 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2023-06-10 18:45:29.725925055 +0000 2023-06-10T18:51:36.848 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: - 2023-06-10T18:51:36.848 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-06-10T18:51:36.900 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2023-06-10T18:51:36.900 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2023-06-10T18:51:36.901 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000415706 s, 1.2 MB/s 2023-06-10T18:51:36.901 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-06-10T18:51:36.951 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_4 2023-06-10T18:51:36.998 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-06-10T18:51:36.998 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-10T18:51:36.998 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 5h/5d Inode: 932 Links: 1 2023-06-10T18:51:36.999 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-10T18:51:36.999 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2023-06-10 18:45:30.665916659 +0000 2023-06-10T18:51:36.999 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2023-06-10 18:45:30.317919768 +0000 2023-06-10T18:51:36.999 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2023-06-10 18:45:30.317919768 +0000 2023-06-10T18:51:36.999 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: - 2023-06-10T18:51:37.000 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-06-10T18:51:37.052 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2023-06-10T18:51:37.052 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2023-06-10T18:51:37.052 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.00041571 s, 1.2 MB/s 2023-06-10T18:51:37.053 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-06-10T18:51:37.102 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-10T18:51:37.103 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi053.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi117.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-06-10T18:51:37.103 INFO:tasks.ceph:Generating config... 2023-06-10T18:51:37.106 INFO:tasks.ceph:[client] client mount timeout = 600 2023-06-10T18:51:37.106 INFO:tasks.ceph:[client] debug client = 20 2023-06-10T18:51:37.106 INFO:tasks.ceph:[client] debug ms = 1 2023-06-10T18:51:37.106 INFO:tasks.ceph:[client] pid file = 2023-06-10T18:51:37.106 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-06-10T18:51:37.107 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-06-10T18:51:37.107 INFO:tasks.ceph:[mds] debug mds = 20 2023-06-10T18:51:37.107 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-06-10T18:51:37.107 INFO:tasks.ceph:[mds] debug ms = 1 2023-06-10T18:51:37.107 INFO:tasks.ceph:[mds] mds debug frag = True 2023-06-10T18:51:37.108 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-06-10T18:51:37.108 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-06-10T18:51:37.108 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-06-10T18:51:37.108 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-06-10T18:51:37.108 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-06-10T18:51:37.109 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-06-10T18:51:37.109 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-06-10T18:51:37.109 INFO:tasks.ceph:[mgr] debug ms = 1 2023-06-10T18:51:37.109 INFO:tasks.ceph:[mon] debug mon = 20 2023-06-10T18:51:37.109 INFO:tasks.ceph:[mon] debug ms = 1 2023-06-10T18:51:37.110 INFO:tasks.ceph:[mon] debug paxos = 20 2023-06-10T18:51:37.110 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-06-10T18:51:37.110 INFO:tasks.ceph:[osd] bdev async discard = True 2023-06-10T18:51:37.110 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-06-10T18:51:37.111 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-06-10T18:51:37.111 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-06-10T18:51:37.111 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-06-10T18:51:37.111 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-06-10T18:51:37.111 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-06-10T18:51:37.112 INFO:tasks.ceph:[osd] debug ms = 1 2023-06-10T18:51:37.112 INFO:tasks.ceph:[osd] debug osd = 20 2023-06-10T18:51:37.112 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-06-10T18:51:37.112 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-06-10T18:51:37.112 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-06-10T18:51:37.113 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-06-10T18:51:37.113 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-06-10T18:51:37.113 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-06-10T18:51:37.113 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-06-10T18:51:37.113 INFO:tasks.ceph:Setting up mon.a... 2023-06-10T18:51:37.114 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-06-10T18:51:37.149 INFO:teuthology.orchestra.run.smithi053.stdout:creating /etc/ceph/ceph.keyring 2023-06-10T18:51:37.162 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-06-10T18:51:37.235 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-06-10T18:51:37.288 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.53'), ('mon.b', '172.21.15.117'), ('mon.c', '[v2:172.21.15.117:3301,v1:172.21.15.117:6790]')] 2023-06-10T18:51:37.289 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.53,172.21.15.117,[v2:172.21.15.117:3301,v1:172.21.15.117:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-06-10T18:51:37.290 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T18:51:37.290 DEBUG:teuthology.orchestra.run.smithi053:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-06-10T18:51:37.337 DEBUG:teuthology.orchestra.run.smithi053:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.53 --add b 172.21.15.117 --addv c '[v2:172.21.15.117:3301,v1:172.21.15.117:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-06-10T18:51:37.424 INFO:teuthology.orchestra.run.smithi053.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-06-10T18:51:37.424 INFO:teuthology.orchestra.run.smithi053.stdout:monmaptool: generated fsid c8c64bed-c406-4936-93f9-d16335f1067d 2023-06-10T18:51:37.424 INFO:teuthology.orchestra.run.smithi053.stdout:setting min_mon_release = pacific 2023-06-10T18:51:37.424 INFO:teuthology.orchestra.run.smithi053.stdout:epoch 0 2023-06-10T18:51:37.424 INFO:teuthology.orchestra.run.smithi053.stdout:fsid c8c64bed-c406-4936-93f9-d16335f1067d 2023-06-10T18:51:37.425 INFO:teuthology.orchestra.run.smithi053.stdout:last_changed 2023-06-10T18:51:37.418165+0000 2023-06-10T18:51:37.425 INFO:teuthology.orchestra.run.smithi053.stdout:created 2023-06-10T18:51:37.418165+0000 2023-06-10T18:51:37.425 INFO:teuthology.orchestra.run.smithi053.stdout:min_mon_release 16 (pacific) 2023-06-10T18:51:37.425 INFO:teuthology.orchestra.run.smithi053.stdout:election_strategy: 1 2023-06-10T18:51:37.425 INFO:teuthology.orchestra.run.smithi053.stdout:0: [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] mon.a 2023-06-10T18:51:37.425 INFO:teuthology.orchestra.run.smithi053.stdout:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2023-06-10T18:51:37.425 INFO:teuthology.orchestra.run.smithi053.stdout:2: [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] mon.c 2023-06-10T18:51:37.425 INFO:teuthology.orchestra.run.smithi053.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-06-10T18:51:37.427 DEBUG:teuthology.orchestra.run.smithi053:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-06-10T18:51:37.473 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID c8c64bed-c406-4936-93f9-d16335f1067d... 2023-06-10T18:51:37.474 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-06-10T18:51:37.518 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-06-10T18:51:37.548 INFO:teuthology.orchestra.run.smithi053.stdout:[global] 2023-06-10T18:51:37.549 INFO:teuthology.orchestra.run.smithi053.stdout: chdir = "" 2023-06-10T18:51:37.549 INFO:teuthology.orchestra.run.smithi053.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-06-10T18:51:37.549 INFO:teuthology.orchestra.run.smithi053.stdout: auth supported = cephx 2023-06-10T18:51:37.550 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:51:37.550 INFO:teuthology.orchestra.run.smithi053.stdout: filestore xattr use omap = true 2023-06-10T18:51:37.550 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:51:37.550 INFO:teuthology.orchestra.run.smithi053.stdout: mon clock drift allowed = 1.000 2023-06-10T18:51:37.551 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:51:37.551 INFO:teuthology.orchestra.run.smithi053.stdout: osd crush chooseleaf type = 0 2023-06-10T18:51:37.551 INFO:teuthology.orchestra.run.smithi053.stdout: auth debug = true 2023-06-10T18:51:37.551 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:51:37.552 INFO:teuthology.orchestra.run.smithi053.stdout: ms die on old message = true 2023-06-10T18:51:37.552 INFO:teuthology.orchestra.run.smithi053.stdout: ms die on bug = true 2023-06-10T18:51:37.552 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:51:37.553 INFO:teuthology.orchestra.run.smithi053.stdout: mon max pg per osd = 10000 # >= luminous 2023-06-10T18:51:37.553 INFO:teuthology.orchestra.run.smithi053.stdout: mon pg warn max object skew = 0 2023-06-10T18:51:37.553 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:51:37.553 INFO:teuthology.orchestra.run.smithi053.stdout: # disable pg_autoscaler by default for new pools 2023-06-10T18:51:37.554 INFO:teuthology.orchestra.run.smithi053.stdout: osd_pool_default_pg_autoscale_mode = off 2023-06-10T18:51:37.554 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:51:37.554 INFO:teuthology.orchestra.run.smithi053.stdout: osd pool default size = 2 2023-06-10T18:51:37.554 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:51:37.555 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd allow primary affinity = true 2023-06-10T18:51:37.555 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd allow pg remap = true 2023-06-10T18:51:37.555 INFO:teuthology.orchestra.run.smithi053.stdout: mon warn on legacy crush tunables = false 2023-06-10T18:51:37.556 INFO:teuthology.orchestra.run.smithi053.stdout: mon warn on crush straw calc version zero = false 2023-06-10T18:51:37.556 INFO:teuthology.orchestra.run.smithi053.stdout: mon warn on no sortbitwise = false 2023-06-10T18:51:37.556 INFO:teuthology.orchestra.run.smithi053.stdout: mon warn on osd down out interval zero = false 2023-06-10T18:51:37.557 INFO:teuthology.orchestra.run.smithi053.stdout: mon warn on too few osds = false 2023-06-10T18:51:37.557 INFO:teuthology.orchestra.run.smithi053.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-06-10T18:51:37.557 INFO:teuthology.orchestra.run.smithi053.stdout: mon_warn_on_pool_no_redundancy = false 2023-06-10T18:51:37.557 INFO:teuthology.orchestra.run.smithi053.stdout: mon_allow_pool_size_one = true 2023-06-10T18:51:37.558 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:51:37.558 INFO:teuthology.orchestra.run.smithi053.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-06-10T18:51:37.558 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:51:37.558 INFO:teuthology.orchestra.run.smithi053.stdout: osd default data pool replay window = 5 2023-06-10T18:51:37.559 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:51:37.559 INFO:teuthology.orchestra.run.smithi053.stdout: mon allow pool delete = true 2023-06-10T18:51:37.559 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:51:37.559 INFO:teuthology.orchestra.run.smithi053.stdout: mon cluster log file level = debug 2023-06-10T18:51:37.560 INFO:teuthology.orchestra.run.smithi053.stdout: debug asserts on shutdown = true 2023-06-10T18:51:37.560 INFO:teuthology.orchestra.run.smithi053.stdout: mon health detail to clog = false 2023-06-10T18:51:37.560 INFO:teuthology.orchestra.run.smithi053.stdout: mon host = "172.21.15.53,172.21.15.117,[v2:172.21.15.117:3301,v1:172.21.15.117:6790]" 2023-06-10T18:51:37.561 INFO:teuthology.orchestra.run.smithi053.stdout: fsid = c8c64bed-c406-4936-93f9-d16335f1067d 2023-06-10T18:51:37.561 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:51:37.561 INFO:teuthology.orchestra.run.smithi053.stdout:[osd] 2023-06-10T18:51:37.561 INFO:teuthology.orchestra.run.smithi053.stdout: osd journal size = 100 2023-06-10T18:51:37.562 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:51:37.562 INFO:teuthology.orchestra.run.smithi053.stdout: osd scrub load threshold = 5.0 2023-06-10T18:51:37.562 INFO:teuthology.orchestra.run.smithi053.stdout: osd scrub max interval = 600 2023-06-10T18:51:37.563 INFO:teuthology.orchestra.run.smithi053.stdout: osd mclock profile = high_recovery_ops 2023-06-10T18:51:37.563 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:51:37.563 INFO:teuthology.orchestra.run.smithi053.stdout: osd recover clone overlap = true 2023-06-10T18:51:37.563 INFO:teuthology.orchestra.run.smithi053.stdout: osd recovery max chunk = 1048576 2023-06-10T18:51:37.564 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:51:37.564 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug shutdown = true 2023-06-10T18:51:37.564 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug op order = true 2023-06-10T18:51:37.564 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug verify stray on activate = true 2023-06-10T18:51:37.565 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:51:37.565 INFO:teuthology.orchestra.run.smithi053.stdout: osd open classes on start = true 2023-06-10T18:51:37.565 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug pg log writeout = true 2023-06-10T18:51:37.566 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:51:37.566 INFO:teuthology.orchestra.run.smithi053.stdout: osd deep scrub update digest min age = 30 2023-06-10T18:51:37.566 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:51:37.566 INFO:teuthology.orchestra.run.smithi053.stdout: osd map max advance = 10 2023-06-10T18:51:37.566 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:51:37.567 INFO:teuthology.orchestra.run.smithi053.stdout: journal zero on create = true 2023-06-10T18:51:37.567 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:51:37.567 INFO:teuthology.orchestra.run.smithi053.stdout: filestore ondisk finisher threads = 3 2023-06-10T18:51:37.567 INFO:teuthology.orchestra.run.smithi053.stdout: filestore apply finisher threads = 3 2023-06-10T18:51:37.568 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:51:37.568 INFO:teuthology.orchestra.run.smithi053.stdout: bdev debug aio = true 2023-06-10T18:51:37.568 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug misdirected ops = true 2023-06-10T18:51:37.569 INFO:teuthology.orchestra.run.smithi053.stdout: bdev async discard = True 2023-06-10T18:51:37.569 INFO:teuthology.orchestra.run.smithi053.stdout: bdev enable discard = True 2023-06-10T18:51:37.569 INFO:teuthology.orchestra.run.smithi053.stdout: bluestore allocator = bitmap 2023-06-10T18:51:37.569 INFO:teuthology.orchestra.run.smithi053.stdout: bluestore block size = 96636764160 2023-06-10T18:51:37.570 INFO:teuthology.orchestra.run.smithi053.stdout: bluestore fsck on mount = True 2023-06-10T18:51:37.570 INFO:teuthology.orchestra.run.smithi053.stdout: debug bluefs = 1/20 2023-06-10T18:51:37.570 INFO:teuthology.orchestra.run.smithi053.stdout: debug bluestore = 1/20 2023-06-10T18:51:37.571 INFO:teuthology.orchestra.run.smithi053.stdout: debug ms = 1 2023-06-10T18:51:37.571 INFO:teuthology.orchestra.run.smithi053.stdout: debug osd = 20 2023-06-10T18:51:37.571 INFO:teuthology.orchestra.run.smithi053.stdout: debug rocksdb = 4/10 2023-06-10T18:51:37.571 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd backfillfull_ratio = 0.85 2023-06-10T18:51:37.572 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd full ratio = 0.9 2023-06-10T18:51:37.572 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd nearfull ratio = 0.8 2023-06-10T18:51:37.572 INFO:teuthology.orchestra.run.smithi053.stdout: osd failsafe full ratio = 0.95 2023-06-10T18:51:37.572 INFO:teuthology.orchestra.run.smithi053.stdout: osd objectstore = bluestore 2023-06-10T18:51:37.573 INFO:teuthology.orchestra.run.smithi053.stdout: osd op complaint time = 180 2023-06-10T18:51:37.573 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:51:37.573 INFO:teuthology.orchestra.run.smithi053.stdout:[mgr] 2023-06-10T18:51:37.573 INFO:teuthology.orchestra.run.smithi053.stdout: debug ms = 1 2023-06-10T18:51:37.574 INFO:teuthology.orchestra.run.smithi053.stdout: debug mgr = 20 2023-06-10T18:51:37.574 INFO:teuthology.orchestra.run.smithi053.stdout: debug mon = 20 2023-06-10T18:51:37.574 INFO:teuthology.orchestra.run.smithi053.stdout: debug auth = 20 2023-06-10T18:51:37.574 INFO:teuthology.orchestra.run.smithi053.stdout: mon reweight min pgs per osd = 4 2023-06-10T18:51:37.575 INFO:teuthology.orchestra.run.smithi053.stdout: mon reweight min bytes per osd = 10 2023-06-10T18:51:37.575 INFO:teuthology.orchestra.run.smithi053.stdout: mgr/telemetry/nag = false 2023-06-10T18:51:37.575 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:51:37.575 INFO:teuthology.orchestra.run.smithi053.stdout:[mon] 2023-06-10T18:51:37.576 INFO:teuthology.orchestra.run.smithi053.stdout: debug ms = 1 2023-06-10T18:51:37.576 INFO:teuthology.orchestra.run.smithi053.stdout: debug mon = 20 2023-06-10T18:51:37.576 INFO:teuthology.orchestra.run.smithi053.stdout: debug paxos = 20 2023-06-10T18:51:37.576 INFO:teuthology.orchestra.run.smithi053.stdout: debug auth = 20 2023-06-10T18:51:37.577 INFO:teuthology.orchestra.run.smithi053.stdout: mon data avail warn = 5 2023-06-10T18:51:37.577 INFO:teuthology.orchestra.run.smithi053.stdout: mon mgr mkfs grace = 240 2023-06-10T18:51:37.577 INFO:teuthology.orchestra.run.smithi053.stdout: mon reweight min pgs per osd = 4 2023-06-10T18:51:37.577 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd reporter subtree level = osd 2023-06-10T18:51:37.578 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd prime pg temp = true 2023-06-10T18:51:37.578 INFO:teuthology.orchestra.run.smithi053.stdout: mon reweight min bytes per osd = 10 2023-06-10T18:51:37.578 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:51:37.578 INFO:teuthology.orchestra.run.smithi053.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-06-10T18:51:37.579 INFO:teuthology.orchestra.run.smithi053.stdout: auth mon ticket ttl = 660 # 11m 2023-06-10T18:51:37.579 INFO:teuthology.orchestra.run.smithi053.stdout: auth service ticket ttl = 240 # 4m 2023-06-10T18:51:37.579 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:51:37.579 INFO:teuthology.orchestra.run.smithi053.stdout: # don't complain about insecure global_id in the test suite 2023-06-10T18:51:37.579 INFO:teuthology.orchestra.run.smithi053.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-06-10T18:51:37.580 INFO:teuthology.orchestra.run.smithi053.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-06-10T18:51:37.580 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:51:37.580 INFO:teuthology.orchestra.run.smithi053.stdout: # 1m isn't quite enough 2023-06-10T18:51:37.581 INFO:teuthology.orchestra.run.smithi053.stdout: mon_down_mkfs_grace = 2m 2023-06-10T18:51:37.581 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:51:37.581 INFO:teuthology.orchestra.run.smithi053.stdout: mon_warn_on_filestore_osds = false 2023-06-10T18:51:37.581 INFO:teuthology.orchestra.run.smithi053.stdout: mon op complaint time = 120 2023-06-10T18:51:37.581 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:51:37.581 INFO:teuthology.orchestra.run.smithi053.stdout:[client] 2023-06-10T18:51:37.581 INFO:teuthology.orchestra.run.smithi053.stdout: rgw cache enabled = true 2023-06-10T18:51:37.582 INFO:teuthology.orchestra.run.smithi053.stdout: rgw enable ops log = true 2023-06-10T18:51:37.582 INFO:teuthology.orchestra.run.smithi053.stdout: rgw enable usage log = true 2023-06-10T18:51:37.582 INFO:teuthology.orchestra.run.smithi053.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-06-10T18:51:37.582 INFO:teuthology.orchestra.run.smithi053.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-06-10T18:51:37.582 INFO:teuthology.orchestra.run.smithi053.stdout: client mount timeout = 600 2023-06-10T18:51:37.582 INFO:teuthology.orchestra.run.smithi053.stdout: debug client = 20 2023-06-10T18:51:37.582 INFO:teuthology.orchestra.run.smithi053.stdout: debug ms = 1 2023-06-10T18:51:37.583 INFO:teuthology.orchestra.run.smithi053.stdout: pid file = "" 2023-06-10T18:51:37.583 INFO:teuthology.orchestra.run.smithi053.stdout: rados mon op timeout = 900 2023-06-10T18:51:37.583 INFO:teuthology.orchestra.run.smithi053.stdout: rados osd op timeout = 900 2023-06-10T18:51:37.583 INFO:teuthology.orchestra.run.smithi053.stdout:[mon.a] 2023-06-10T18:51:37.583 INFO:teuthology.orchestra.run.smithi053.stdout:[mon.b] 2023-06-10T18:51:37.583 INFO:teuthology.orchestra.run.smithi053.stdout:[mon.c] 2023-06-10T18:51:37.583 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.a] 2023-06-10T18:51:37.583 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.c] 2023-06-10T18:51:37.584 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.b] 2023-06-10T18:51:37.584 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.d] 2023-06-10T18:51:37.584 INFO:teuthology.orchestra.run.smithi053.stdout:[mds] 2023-06-10T18:51:37.584 INFO:teuthology.orchestra.run.smithi053.stdout: debug mds = 20 2023-06-10T18:51:37.584 INFO:teuthology.orchestra.run.smithi053.stdout: debug mds balancer = 20 2023-06-10T18:51:37.584 INFO:teuthology.orchestra.run.smithi053.stdout: debug ms = 1 2023-06-10T18:51:37.584 INFO:teuthology.orchestra.run.smithi053.stdout: mds debug frag = True 2023-06-10T18:51:37.584 INFO:teuthology.orchestra.run.smithi053.stdout: mds debug scatterstat = True 2023-06-10T18:51:37.585 INFO:teuthology.orchestra.run.smithi053.stdout: mds op complaint time = 180 2023-06-10T18:51:37.585 INFO:teuthology.orchestra.run.smithi053.stdout: mds verify scatter = True 2023-06-10T18:51:37.585 INFO:teuthology.orchestra.run.smithi053.stdout: osd op complaint time = 180 2023-06-10T18:51:37.585 INFO:teuthology.orchestra.run.smithi053.stdout: rados mon op timeout = 900 2023-06-10T18:51:37.585 INFO:teuthology.orchestra.run.smithi053.stdout: rados osd op timeout = 900 2023-06-10T18:51:37.586 INFO:teuthology.orchestra.run.smithi117.stdout:[global] 2023-06-10T18:51:37.587 INFO:teuthology.orchestra.run.smithi117.stdout: chdir = "" 2023-06-10T18:51:37.587 INFO:teuthology.orchestra.run.smithi117.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-06-10T18:51:37.587 INFO:teuthology.orchestra.run.smithi117.stdout: auth supported = cephx 2023-06-10T18:51:37.587 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-06-10T18:51:37.587 INFO:teuthology.orchestra.run.smithi117.stdout: filestore xattr use omap = true 2023-06-10T18:51:37.587 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-06-10T18:51:37.587 INFO:teuthology.orchestra.run.smithi117.stdout: mon clock drift allowed = 1.000 2023-06-10T18:51:37.588 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-06-10T18:51:37.588 INFO:teuthology.orchestra.run.smithi117.stdout: osd crush chooseleaf type = 0 2023-06-10T18:51:37.588 INFO:teuthology.orchestra.run.smithi117.stdout: auth debug = true 2023-06-10T18:51:37.588 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-06-10T18:51:37.588 INFO:teuthology.orchestra.run.smithi117.stdout: ms die on old message = true 2023-06-10T18:51:37.588 INFO:teuthology.orchestra.run.smithi117.stdout: ms die on bug = true 2023-06-10T18:51:37.588 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-06-10T18:51:37.589 INFO:teuthology.orchestra.run.smithi117.stdout: mon max pg per osd = 10000 # >= luminous 2023-06-10T18:51:37.589 INFO:teuthology.orchestra.run.smithi117.stdout: mon pg warn max object skew = 0 2023-06-10T18:51:37.589 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-06-10T18:51:37.589 INFO:teuthology.orchestra.run.smithi117.stdout: # disable pg_autoscaler by default for new pools 2023-06-10T18:51:37.589 INFO:teuthology.orchestra.run.smithi117.stdout: osd_pool_default_pg_autoscale_mode = off 2023-06-10T18:51:37.589 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-06-10T18:51:37.589 INFO:teuthology.orchestra.run.smithi117.stdout: osd pool default size = 2 2023-06-10T18:51:37.589 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-06-10T18:51:37.590 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd allow primary affinity = true 2023-06-10T18:51:37.590 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd allow pg remap = true 2023-06-10T18:51:37.590 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on legacy crush tunables = false 2023-06-10T18:51:37.590 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on crush straw calc version zero = false 2023-06-10T18:51:37.590 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on no sortbitwise = false 2023-06-10T18:51:37.590 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on osd down out interval zero = false 2023-06-10T18:51:37.590 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on too few osds = false 2023-06-10T18:51:37.590 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-06-10T18:51:37.591 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_pool_no_redundancy = false 2023-06-10T18:51:37.591 INFO:teuthology.orchestra.run.smithi117.stdout: mon_allow_pool_size_one = true 2023-06-10T18:51:37.591 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-06-10T18:51:37.591 INFO:teuthology.orchestra.run.smithi117.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-06-10T18:51:37.591 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-06-10T18:51:37.591 INFO:teuthology.orchestra.run.smithi117.stdout: osd default data pool replay window = 5 2023-06-10T18:51:37.591 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-06-10T18:51:37.591 INFO:teuthology.orchestra.run.smithi117.stdout: mon allow pool delete = true 2023-06-10T18:51:37.592 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-06-10T18:51:37.592 INFO:teuthology.orchestra.run.smithi117.stdout: mon cluster log file level = debug 2023-06-10T18:51:37.592 INFO:teuthology.orchestra.run.smithi117.stdout: debug asserts on shutdown = true 2023-06-10T18:51:37.592 INFO:teuthology.orchestra.run.smithi117.stdout: mon health detail to clog = false 2023-06-10T18:51:37.592 INFO:teuthology.orchestra.run.smithi117.stdout: mon host = "172.21.15.53,172.21.15.117,[v2:172.21.15.117:3301,v1:172.21.15.117:6790]" 2023-06-10T18:51:37.592 INFO:teuthology.orchestra.run.smithi117.stdout: fsid = c8c64bed-c406-4936-93f9-d16335f1067d 2023-06-10T18:51:37.592 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-06-10T18:51:37.593 INFO:teuthology.orchestra.run.smithi117.stdout:[osd] 2023-06-10T18:51:37.593 INFO:teuthology.orchestra.run.smithi117.stdout: osd journal size = 100 2023-06-10T18:51:37.593 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-06-10T18:51:37.593 INFO:teuthology.orchestra.run.smithi117.stdout: osd scrub load threshold = 5.0 2023-06-10T18:51:37.593 INFO:teuthology.orchestra.run.smithi117.stdout: osd scrub max interval = 600 2023-06-10T18:51:37.593 INFO:teuthology.orchestra.run.smithi117.stdout: osd mclock profile = high_recovery_ops 2023-06-10T18:51:37.593 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-06-10T18:51:37.593 INFO:teuthology.orchestra.run.smithi117.stdout: osd recover clone overlap = true 2023-06-10T18:51:37.594 INFO:teuthology.orchestra.run.smithi117.stdout: osd recovery max chunk = 1048576 2023-06-10T18:51:37.594 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-06-10T18:51:37.594 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug shutdown = true 2023-06-10T18:51:37.594 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug op order = true 2023-06-10T18:51:37.594 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug verify stray on activate = true 2023-06-10T18:51:37.594 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-06-10T18:51:37.594 INFO:teuthology.orchestra.run.smithi117.stdout: osd open classes on start = true 2023-06-10T18:51:37.594 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug pg log writeout = true 2023-06-10T18:51:37.595 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-06-10T18:51:37.595 INFO:teuthology.orchestra.run.smithi117.stdout: osd deep scrub update digest min age = 30 2023-06-10T18:51:37.595 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-06-10T18:51:37.595 INFO:teuthology.orchestra.run.smithi117.stdout: osd map max advance = 10 2023-06-10T18:51:37.595 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-06-10T18:51:37.595 INFO:teuthology.orchestra.run.smithi117.stdout: journal zero on create = true 2023-06-10T18:51:37.595 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-06-10T18:51:37.595 INFO:teuthology.orchestra.run.smithi117.stdout: filestore ondisk finisher threads = 3 2023-06-10T18:51:37.596 INFO:teuthology.orchestra.run.smithi117.stdout: filestore apply finisher threads = 3 2023-06-10T18:51:37.596 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-06-10T18:51:37.596 INFO:teuthology.orchestra.run.smithi117.stdout: bdev debug aio = true 2023-06-10T18:51:37.596 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug misdirected ops = true 2023-06-10T18:51:37.596 INFO:teuthology.orchestra.run.smithi117.stdout: bdev async discard = True 2023-06-10T18:51:37.596 INFO:teuthology.orchestra.run.smithi117.stdout: bdev enable discard = True 2023-06-10T18:51:37.596 INFO:teuthology.orchestra.run.smithi117.stdout: bluestore allocator = bitmap 2023-06-10T18:51:37.596 INFO:teuthology.orchestra.run.smithi117.stdout: bluestore block size = 96636764160 2023-06-10T18:51:37.597 INFO:teuthology.orchestra.run.smithi117.stdout: bluestore fsck on mount = True 2023-06-10T18:51:37.597 INFO:teuthology.orchestra.run.smithi117.stdout: debug bluefs = 1/20 2023-06-10T18:51:37.597 INFO:teuthology.orchestra.run.smithi117.stdout: debug bluestore = 1/20 2023-06-10T18:51:37.597 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2023-06-10T18:51:37.597 INFO:teuthology.orchestra.run.smithi117.stdout: debug osd = 20 2023-06-10T18:51:37.597 INFO:teuthology.orchestra.run.smithi117.stdout: debug rocksdb = 4/10 2023-06-10T18:51:37.597 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd backfillfull_ratio = 0.85 2023-06-10T18:51:37.598 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd full ratio = 0.9 2023-06-10T18:51:37.598 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd nearfull ratio = 0.8 2023-06-10T18:51:37.598 INFO:teuthology.orchestra.run.smithi117.stdout: osd failsafe full ratio = 0.95 2023-06-10T18:51:37.598 INFO:teuthology.orchestra.run.smithi117.stdout: osd objectstore = bluestore 2023-06-10T18:51:37.598 INFO:teuthology.orchestra.run.smithi117.stdout: osd op complaint time = 180 2023-06-10T18:51:37.598 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-06-10T18:51:37.598 INFO:teuthology.orchestra.run.smithi117.stdout:[mgr] 2023-06-10T18:51:37.598 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2023-06-10T18:51:37.599 INFO:teuthology.orchestra.run.smithi117.stdout: debug mgr = 20 2023-06-10T18:51:37.599 INFO:teuthology.orchestra.run.smithi117.stdout: debug mon = 20 2023-06-10T18:51:37.599 INFO:teuthology.orchestra.run.smithi117.stdout: debug auth = 20 2023-06-10T18:51:37.599 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min pgs per osd = 4 2023-06-10T18:51:37.599 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min bytes per osd = 10 2023-06-10T18:51:37.599 INFO:teuthology.orchestra.run.smithi117.stdout: mgr/telemetry/nag = false 2023-06-10T18:51:37.599 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-06-10T18:51:37.599 INFO:teuthology.orchestra.run.smithi117.stdout:[mon] 2023-06-10T18:51:37.600 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2023-06-10T18:51:37.600 INFO:teuthology.orchestra.run.smithi117.stdout: debug mon = 20 2023-06-10T18:51:37.600 INFO:teuthology.orchestra.run.smithi117.stdout: debug paxos = 20 2023-06-10T18:51:37.600 INFO:teuthology.orchestra.run.smithi117.stdout: debug auth = 20 2023-06-10T18:51:37.600 INFO:teuthology.orchestra.run.smithi117.stdout: mon data avail warn = 5 2023-06-10T18:51:37.600 INFO:teuthology.orchestra.run.smithi117.stdout: mon mgr mkfs grace = 240 2023-06-10T18:51:37.600 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min pgs per osd = 4 2023-06-10T18:51:37.600 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd reporter subtree level = osd 2023-06-10T18:51:37.601 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd prime pg temp = true 2023-06-10T18:51:37.601 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min bytes per osd = 10 2023-06-10T18:51:37.601 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-06-10T18:51:37.601 INFO:teuthology.orchestra.run.smithi117.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-06-10T18:51:37.601 INFO:teuthology.orchestra.run.smithi117.stdout: auth mon ticket ttl = 660 # 11m 2023-06-10T18:51:37.601 INFO:teuthology.orchestra.run.smithi117.stdout: auth service ticket ttl = 240 # 4m 2023-06-10T18:51:37.601 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-06-10T18:51:37.601 INFO:teuthology.orchestra.run.smithi117.stdout: # don't complain about insecure global_id in the test suite 2023-06-10T18:51:37.602 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-06-10T18:51:37.602 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-06-10T18:51:37.602 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-06-10T18:51:37.602 INFO:teuthology.orchestra.run.smithi117.stdout: # 1m isn't quite enough 2023-06-10T18:51:37.602 INFO:teuthology.orchestra.run.smithi117.stdout: mon_down_mkfs_grace = 2m 2023-06-10T18:51:37.602 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-06-10T18:51:37.602 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_filestore_osds = false 2023-06-10T18:51:37.602 INFO:teuthology.orchestra.run.smithi117.stdout: mon op complaint time = 120 2023-06-10T18:51:37.603 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-06-10T18:51:37.603 INFO:teuthology.orchestra.run.smithi117.stdout:[client] 2023-06-10T18:51:37.603 INFO:teuthology.orchestra.run.smithi117.stdout: rgw cache enabled = true 2023-06-10T18:51:37.603 INFO:teuthology.orchestra.run.smithi117.stdout: rgw enable ops log = true 2023-06-10T18:51:37.603 INFO:teuthology.orchestra.run.smithi117.stdout: rgw enable usage log = true 2023-06-10T18:51:37.603 INFO:teuthology.orchestra.run.smithi117.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-06-10T18:51:37.603 INFO:teuthology.orchestra.run.smithi117.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-06-10T18:51:37.603 INFO:teuthology.orchestra.run.smithi117.stdout: client mount timeout = 600 2023-06-10T18:51:37.604 INFO:teuthology.orchestra.run.smithi117.stdout: debug client = 20 2023-06-10T18:51:37.604 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2023-06-10T18:51:37.604 INFO:teuthology.orchestra.run.smithi117.stdout: pid file = "" 2023-06-10T18:51:37.604 INFO:teuthology.orchestra.run.smithi117.stdout: rados mon op timeout = 900 2023-06-10T18:51:37.604 INFO:teuthology.orchestra.run.smithi117.stdout: rados osd op timeout = 900 2023-06-10T18:51:37.604 INFO:teuthology.orchestra.run.smithi117.stdout:[mon.a] 2023-06-10T18:51:37.604 INFO:teuthology.orchestra.run.smithi117.stdout:[mon.b] 2023-06-10T18:51:37.604 INFO:teuthology.orchestra.run.smithi117.stdout:[mon.c] 2023-06-10T18:51:37.605 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.a] 2023-06-10T18:51:37.605 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.c] 2023-06-10T18:51:37.605 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.b] 2023-06-10T18:51:37.605 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.d] 2023-06-10T18:51:37.605 INFO:teuthology.orchestra.run.smithi117.stdout:[mds] 2023-06-10T18:51:37.605 INFO:teuthology.orchestra.run.smithi117.stdout: debug mds = 20 2023-06-10T18:51:37.605 INFO:teuthology.orchestra.run.smithi117.stdout: debug mds balancer = 20 2023-06-10T18:51:37.605 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2023-06-10T18:51:37.606 INFO:teuthology.orchestra.run.smithi117.stdout: mds debug frag = True 2023-06-10T18:51:37.606 INFO:teuthology.orchestra.run.smithi117.stdout: mds debug scatterstat = True 2023-06-10T18:51:37.606 INFO:teuthology.orchestra.run.smithi117.stdout: mds op complaint time = 180 2023-06-10T18:51:37.606 INFO:teuthology.orchestra.run.smithi117.stdout: mds verify scatter = True 2023-06-10T18:51:37.606 INFO:teuthology.orchestra.run.smithi117.stdout: osd op complaint time = 180 2023-06-10T18:51:37.606 INFO:teuthology.orchestra.run.smithi117.stdout: rados mon op timeout = 900 2023-06-10T18:51:37.606 INFO:teuthology.orchestra.run.smithi117.stdout: rados osd op timeout = 900 2023-06-10T18:51:37.607 INFO:tasks.ceph:Creating admin key on mon.a... 2023-06-10T18:51:37.607 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-06-10T18:51:37.682 INFO:tasks.ceph:Copying monmap to all nodes... 2023-06-10T18:51:37.683 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T18:51:37.683 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-06-10T18:51:37.688 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T18:51:37.689 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-06-10T18:51:37.733 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi053.front.sepia.ceph.com 2023-06-10T18:51:37.734 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T18:51:37.734 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/etc/ceph/ceph.keyring 2023-06-10T18:51:37.734 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-06-10T18:51:37.836 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T18:51:37.837 DEBUG:teuthology.orchestra.run.smithi053:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-06-10T18:51:37.884 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi117.front.sepia.ceph.com 2023-06-10T18:51:37.884 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T18:51:37.885 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/ceph/ceph.keyring 2023-06-10T18:51:37.886 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-06-10T18:51:37.910 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T18:51:37.910 DEBUG:teuthology.orchestra.run.smithi117:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-06-10T18:51:37.958 INFO:tasks.ceph:Setting up mon nodes... 2023-06-10T18:51:37.959 INFO:tasks.ceph:Setting up mgr nodes... 2023-06-10T18:51:37.959 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-06-10T18:51:38.004 INFO:teuthology.orchestra.run.smithi053.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-06-10T18:51:38.007 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-06-10T18:51:38.051 INFO:teuthology.orchestra.run.smithi117.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-06-10T18:51:38.064 INFO:tasks.ceph:Setting up mds nodes... 2023-06-10T18:51:38.065 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-06-10T18:51:38.107 INFO:teuthology.orchestra.run.smithi053.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-06-10T18:51:38.110 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-06-10T18:51:38.169 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-06-10T18:51:38.254 INFO:teuthology.orchestra.run.smithi053.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-06-10T18:51:38.257 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-06-10T18:51:38.317 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-06-10T18:51:38.362 INFO:teuthology.orchestra.run.smithi117.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-06-10T18:51:38.365 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-06-10T18:51:38.378 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-06-10T18:51:38.461 INFO:teuthology.orchestra.run.smithi117.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-06-10T18:51:38.464 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-06-10T18:51:38.517 INFO:tasks.ceph_client:Setting up client nodes... 2023-06-10T18:51:38.518 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-06-10T18:51:38.554 INFO:teuthology.orchestra.run.smithi053.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-06-10T18:51:38.566 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-06-10T18:51:38.641 INFO:teuthology.orchestra.run.smithi053.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-06-10T18:51:38.651 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-06-10T18:51:38.686 INFO:teuthology.orchestra.run.smithi117.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-06-10T18:51:38.697 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-06-10T18:51:38.771 INFO:teuthology.orchestra.run.smithi117.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-06-10T18:51:38.782 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-06-10T18:51:38.782 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi053.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi117.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-06-10T18:51:38.783 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-06-10T18:51:38.797 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-10T18:51:38.797 INFO:tasks.ceph:role: osd.0 2023-06-10T18:51:38.797 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi053.front.sepia.ceph.com 2023-06-10T18:51:38.798 DEBUG:teuthology.orchestra.run.smithi053:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-06-10T18:51:38.853 INFO:teuthology.orchestra.run.smithi053.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-06-10T18:51:38.854 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-10T18:51:38.854 INFO:teuthology.orchestra.run.smithi053.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-10T18:51:38.854 INFO:teuthology.orchestra.run.smithi053.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-10T18:51:38.854 INFO:teuthology.orchestra.run.smithi053.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-10T18:51:38.854 INFO:teuthology.orchestra.run.smithi053.stdout: = sunit=0 swidth=0 blks 2023-06-10T18:51:38.854 INFO:teuthology.orchestra.run.smithi053.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-10T18:51:38.855 INFO:teuthology.orchestra.run.smithi053.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-10T18:51:38.855 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-10T18:51:38.855 INFO:teuthology.orchestra.run.smithi053.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-10T18:51:38.878 INFO:teuthology.orchestra.run.smithi053.stdout:Discarding blocks...Done. 2023-06-10T18:51:38.879 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi053.front.sepia.ceph.com -o noatime 2023-06-10T18:51:38.880 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-06-10T18:51:38.937 DEBUG:teuthology.orchestra.run.smithi053:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-06-10T18:51:38.989 INFO:teuthology.orchestra.run.smithi053.stderr:sudo: /sbin/restorecon: command not found 2023-06-10T18:51:38.990 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-10T18:51:38.990 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-06-10T18:51:39.042 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-10T18:51:39.042 INFO:tasks.ceph:role: osd.1 2023-06-10T18:51:39.042 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi053.front.sepia.ceph.com 2023-06-10T18:51:39.043 DEBUG:teuthology.orchestra.run.smithi053:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-06-10T18:51:39.098 INFO:teuthology.orchestra.run.smithi053.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-06-10T18:51:39.099 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-10T18:51:39.099 INFO:teuthology.orchestra.run.smithi053.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-10T18:51:39.099 INFO:teuthology.orchestra.run.smithi053.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-10T18:51:39.099 INFO:teuthology.orchestra.run.smithi053.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-10T18:51:39.099 INFO:teuthology.orchestra.run.smithi053.stdout: = sunit=0 swidth=0 blks 2023-06-10T18:51:39.099 INFO:teuthology.orchestra.run.smithi053.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-10T18:51:39.099 INFO:teuthology.orchestra.run.smithi053.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-10T18:51:39.099 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-10T18:51:39.100 INFO:teuthology.orchestra.run.smithi053.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-10T18:51:39.122 INFO:teuthology.orchestra.run.smithi053.stdout:Discarding blocks...Done. 2023-06-10T18:51:39.123 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi053.front.sepia.ceph.com -o noatime 2023-06-10T18:51:39.123 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-06-10T18:51:39.181 DEBUG:teuthology.orchestra.run.smithi053:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-06-10T18:51:39.234 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-10T18:51:39.235 INFO:teuthology.orchestra.run.smithi053.stderr:sudo: /sbin/restorecon: command not found 2023-06-10T18:51:39.235 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-06-10T18:51:39.287 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-10T18:51:39.287 INFO:tasks.ceph:role: osd.2 2023-06-10T18:51:39.288 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi053.front.sepia.ceph.com 2023-06-10T18:51:39.288 DEBUG:teuthology.orchestra.run.smithi053:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-06-10T18:51:39.341 INFO:teuthology.orchestra.run.smithi053.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-06-10T18:51:39.342 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-10T18:51:39.342 INFO:teuthology.orchestra.run.smithi053.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-10T18:51:39.342 INFO:teuthology.orchestra.run.smithi053.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-10T18:51:39.342 INFO:teuthology.orchestra.run.smithi053.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-10T18:51:39.342 INFO:teuthology.orchestra.run.smithi053.stdout: = sunit=0 swidth=0 blks 2023-06-10T18:51:39.342 INFO:teuthology.orchestra.run.smithi053.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-10T18:51:39.343 INFO:teuthology.orchestra.run.smithi053.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-10T18:51:39.343 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-10T18:51:39.343 INFO:teuthology.orchestra.run.smithi053.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-10T18:51:39.368 INFO:teuthology.orchestra.run.smithi053.stdout:Discarding blocks...Done. 2023-06-10T18:51:39.369 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi053.front.sepia.ceph.com -o noatime 2023-06-10T18:51:39.370 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-06-10T18:51:39.427 DEBUG:teuthology.orchestra.run.smithi053:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-06-10T18:51:39.478 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-10T18:51:39.478 INFO:teuthology.orchestra.run.smithi053.stderr:sudo: /sbin/restorecon: command not found 2023-06-10T18:51:39.479 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-06-10T18:51:39.533 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-10T18:51:39.533 INFO:tasks.ceph:role: osd.3 2023-06-10T18:51:39.533 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi053.front.sepia.ceph.com 2023-06-10T18:51:39.534 DEBUG:teuthology.orchestra.run.smithi053:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-06-10T18:51:39.593 INFO:teuthology.orchestra.run.smithi053.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-06-10T18:51:39.593 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-10T18:51:39.594 INFO:teuthology.orchestra.run.smithi053.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-10T18:51:39.594 INFO:teuthology.orchestra.run.smithi053.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-10T18:51:39.594 INFO:teuthology.orchestra.run.smithi053.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-10T18:51:39.594 INFO:teuthology.orchestra.run.smithi053.stdout: = sunit=0 swidth=0 blks 2023-06-10T18:51:39.594 INFO:teuthology.orchestra.run.smithi053.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-10T18:51:39.594 INFO:teuthology.orchestra.run.smithi053.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-10T18:51:39.594 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-10T18:51:39.595 INFO:teuthology.orchestra.run.smithi053.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-10T18:51:39.620 INFO:teuthology.orchestra.run.smithi053.stdout:Discarding blocks...Done. 2023-06-10T18:51:39.621 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi053.front.sepia.ceph.com -o noatime 2023-06-10T18:51:39.622 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-06-10T18:51:39.682 DEBUG:teuthology.orchestra.run.smithi053:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-06-10T18:51:39.735 INFO:teuthology.orchestra.run.smithi053.stderr:sudo: /sbin/restorecon: command not found 2023-06-10T18:51:39.736 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-10T18:51:39.737 DEBUG:teuthology.orchestra.run.smithi053:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-10T18:51:39.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:51:39.841+0000 7f719a75a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-06-10T18:51:39.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:51:39.841+0000 7f719a75a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-06-10T18:51:39.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:51:39.841+0000 7f719a75a640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-06-10T18:51:39.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:51:39.841+0000 7f719a75a640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-06-10T18:51:39.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:51:39.841+0000 7f719a75a640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-06-10T18:51:39.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:51:39.841+0000 7f719a75a640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-06-10T18:51:42.851 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-06-10T18:51:42.865 DEBUG:teuthology.orchestra.run.smithi053:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-10T18:51:42.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:51:42.941+0000 7f3d85c33640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-06-10T18:51:42.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:51:42.941+0000 7f3d85c33640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-06-10T18:51:42.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:51:42.941+0000 7f3d85c33640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-06-10T18:51:42.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:51:42.941+0000 7f3d85c33640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-06-10T18:51:42.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:51:42.941+0000 7f3d85c33640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-06-10T18:51:42.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:51:42.941+0000 7f3d85c33640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-06-10T18:51:45.955 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-06-10T18:51:46.010 DEBUG:teuthology.orchestra.run.smithi053:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-10T18:51:46.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:51:46.089+0000 7fa716f1c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-06-10T18:51:46.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:51:46.089+0000 7fa716f1c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-06-10T18:51:46.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:51:46.089+0000 7fa716f1c640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-06-10T18:51:46.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:51:46.089+0000 7fa716f1c640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-06-10T18:51:46.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:51:46.089+0000 7fa716f1c640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-06-10T18:51:46.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:51:46.089+0000 7fa716f1c640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-06-10T18:51:49.098 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-06-10T18:51:49.154 DEBUG:teuthology.orchestra.run.smithi053:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-10T18:51:49.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:51:49.229+0000 7f51f533e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-06-10T18:51:49.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:51:49.229+0000 7f51f533e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-06-10T18:51:49.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:51:49.233+0000 7f51f533e640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-06-10T18:51:49.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:51:49.233+0000 7f51f533e640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-06-10T18:51:49.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:51:49.233+0000 7f51f533e640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-06-10T18:51:49.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:51:49.233+0000 7f51f533e640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-06-10T18:51:52.243 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-06-10T18:51:52.297 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-06-10T18:51:52.312 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-10T18:51:52.312 INFO:tasks.ceph:role: osd.4 2023-06-10T18:51:52.313 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi117.front.sepia.ceph.com 2023-06-10T18:51:52.313 DEBUG:teuthology.orchestra.run.smithi117:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-06-10T18:51:52.372 INFO:teuthology.orchestra.run.smithi117.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-06-10T18:51:52.373 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-10T18:51:52.373 INFO:teuthology.orchestra.run.smithi117.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-10T18:51:52.373 INFO:teuthology.orchestra.run.smithi117.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-10T18:51:52.373 INFO:teuthology.orchestra.run.smithi117.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-10T18:51:52.373 INFO:teuthology.orchestra.run.smithi117.stdout: = sunit=0 swidth=0 blks 2023-06-10T18:51:52.373 INFO:teuthology.orchestra.run.smithi117.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-10T18:51:52.373 INFO:teuthology.orchestra.run.smithi117.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-10T18:51:52.374 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-10T18:51:52.374 INFO:teuthology.orchestra.run.smithi117.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-10T18:51:52.830 INFO:teuthology.orchestra.run.smithi117.stdout:Discarding blocks...Done. 2023-06-10T18:51:52.832 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi117.front.sepia.ceph.com -o noatime 2023-06-10T18:51:52.833 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-06-10T18:51:52.971 DEBUG:teuthology.orchestra.run.smithi117:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-06-10T18:51:52.982 INFO:teuthology.orchestra.run.smithi117.stderr:sudo: /sbin/restorecon: command not found 2023-06-10T18:51:52.983 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-10T18:51:52.983 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-06-10T18:51:53.037 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-10T18:51:53.037 INFO:tasks.ceph:role: osd.5 2023-06-10T18:51:53.037 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi117.front.sepia.ceph.com 2023-06-10T18:51:53.038 DEBUG:teuthology.orchestra.run.smithi117:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-06-10T18:51:53.101 INFO:teuthology.orchestra.run.smithi117.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-06-10T18:51:53.101 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-10T18:51:53.101 INFO:teuthology.orchestra.run.smithi117.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-10T18:51:53.102 INFO:teuthology.orchestra.run.smithi117.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-10T18:51:53.102 INFO:teuthology.orchestra.run.smithi117.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-10T18:51:53.102 INFO:teuthology.orchestra.run.smithi117.stdout: = sunit=0 swidth=0 blks 2023-06-10T18:51:53.102 INFO:teuthology.orchestra.run.smithi117.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-10T18:51:53.102 INFO:teuthology.orchestra.run.smithi117.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-10T18:51:53.102 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-10T18:51:53.102 INFO:teuthology.orchestra.run.smithi117.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-10T18:51:53.528 INFO:teuthology.orchestra.run.smithi117.stdout:Discarding blocks...Done. 2023-06-10T18:51:53.530 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi117.front.sepia.ceph.com -o noatime 2023-06-10T18:51:53.531 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-06-10T18:51:53.593 DEBUG:teuthology.orchestra.run.smithi117:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-06-10T18:51:53.645 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-10T18:51:53.646 INFO:teuthology.orchestra.run.smithi117.stderr:sudo: /sbin/restorecon: command not found 2023-06-10T18:51:53.646 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-06-10T18:51:53.699 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-10T18:51:53.700 INFO:tasks.ceph:role: osd.6 2023-06-10T18:51:53.700 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi117.front.sepia.ceph.com 2023-06-10T18:51:53.701 DEBUG:teuthology.orchestra.run.smithi117:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-06-10T18:51:53.761 INFO:teuthology.orchestra.run.smithi117.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-06-10T18:51:53.762 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-10T18:51:53.762 INFO:teuthology.orchestra.run.smithi117.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-10T18:51:53.762 INFO:teuthology.orchestra.run.smithi117.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-10T18:51:53.762 INFO:teuthology.orchestra.run.smithi117.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-10T18:51:53.762 INFO:teuthology.orchestra.run.smithi117.stdout: = sunit=0 swidth=0 blks 2023-06-10T18:51:53.762 INFO:teuthology.orchestra.run.smithi117.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-10T18:51:53.762 INFO:teuthology.orchestra.run.smithi117.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-10T18:51:53.762 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-10T18:51:53.763 INFO:teuthology.orchestra.run.smithi117.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-10T18:51:54.224 INFO:teuthology.orchestra.run.smithi117.stdout:Discarding blocks...Done. 2023-06-10T18:51:54.226 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi117.front.sepia.ceph.com -o noatime 2023-06-10T18:51:54.227 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-06-10T18:51:54.315 DEBUG:teuthology.orchestra.run.smithi117:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-06-10T18:51:54.324 INFO:teuthology.orchestra.run.smithi117.stderr:sudo: /sbin/restorecon: command not found 2023-06-10T18:51:54.325 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-10T18:51:54.326 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-06-10T18:51:54.379 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-10T18:51:54.379 INFO:tasks.ceph:role: osd.7 2023-06-10T18:51:54.379 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi117.front.sepia.ceph.com 2023-06-10T18:51:54.380 DEBUG:teuthology.orchestra.run.smithi117:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-06-10T18:51:54.442 INFO:teuthology.orchestra.run.smithi117.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-06-10T18:51:54.442 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-10T18:51:54.442 INFO:teuthology.orchestra.run.smithi117.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-10T18:51:54.442 INFO:teuthology.orchestra.run.smithi117.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-10T18:51:54.443 INFO:teuthology.orchestra.run.smithi117.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-10T18:51:54.443 INFO:teuthology.orchestra.run.smithi117.stdout: = sunit=0 swidth=0 blks 2023-06-10T18:51:54.443 INFO:teuthology.orchestra.run.smithi117.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-10T18:51:54.443 INFO:teuthology.orchestra.run.smithi117.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-10T18:51:54.443 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-10T18:51:54.443 INFO:teuthology.orchestra.run.smithi117.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-10T18:51:54.902 INFO:teuthology.orchestra.run.smithi117.stdout:Discarding blocks...Done. 2023-06-10T18:51:54.905 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi117.front.sepia.ceph.com -o noatime 2023-06-10T18:51:54.905 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-06-10T18:51:55.051 DEBUG:teuthology.orchestra.run.smithi117:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-06-10T18:51:55.063 INFO:teuthology.orchestra.run.smithi117.stderr:sudo: /sbin/restorecon: command not found 2023-06-10T18:51:55.063 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-10T18:51:55.064 DEBUG:teuthology.orchestra.run.smithi117:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-10T18:51:55.184 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:51:55.171+0000 7f422f0fd640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-06-10T18:51:55.189 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:51:55.175+0000 7f422f0fd640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-06-10T18:51:55.189 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:51:55.175+0000 7f422f0fd640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-06-10T18:51:55.189 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:51:55.175+0000 7f422f0fd640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-06-10T18:51:55.189 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:51:55.175+0000 7f422f0fd640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-06-10T18:51:55.195 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:51:55.183+0000 7f422f0fd640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-06-10T18:51:58.468 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-06-10T18:51:58.482 DEBUG:teuthology.orchestra.run.smithi117:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-10T18:51:58.568 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:51:58.555+0000 7f3802f28640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-06-10T18:51:58.569 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:51:58.555+0000 7f3802f28640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-06-10T18:51:58.569 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:51:58.555+0000 7f3802f28640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-06-10T18:51:58.569 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:51:58.555+0000 7f3802f28640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-06-10T18:51:58.569 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:51:58.555+0000 7f3802f28640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-06-10T18:51:58.569 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:51:58.559+0000 7f3802f28640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-06-10T18:52:01.568 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-06-10T18:52:01.620 DEBUG:teuthology.orchestra.run.smithi117:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-10T18:52:01.700 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:01.687+0000 7f3f16a24640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-06-10T18:52:01.701 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:01.687+0000 7f3f16a24640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-06-10T18:52:01.701 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:01.687+0000 7f3f16a24640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-06-10T18:52:01.701 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:01.687+0000 7f3f16a24640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-06-10T18:52:01.701 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:01.687+0000 7f3f16a24640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-06-10T18:52:01.701 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:01.691+0000 7f3f16a24640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-06-10T18:52:04.713 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-06-10T18:52:04.769 DEBUG:teuthology.orchestra.run.smithi117:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-10T18:52:04.855 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:04.843+0000 7faf834d7640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-06-10T18:52:04.856 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:04.843+0000 7faf834d7640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-06-10T18:52:04.856 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:04.843+0000 7faf834d7640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-06-10T18:52:04.856 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:04.843+0000 7faf834d7640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-06-10T18:52:04.856 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:04.843+0000 7faf834d7640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-06-10T18:52:04.857 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:04.843+0000 7faf834d7640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-06-10T18:52:05.761 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-10T18:52:05.763 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-10T18:52:07.859 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-06-10T18:52:07.872 INFO:tasks.ceph:Reading keys from all nodes... 2023-06-10T18:52:07.873 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T18:52:07.873 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-06-10T18:52:07.887 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T18:52:07.887 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-06-10T18:52:07.941 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T18:52:07.942 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-06-10T18:52:08.001 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T18:52:08.001 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-06-10T18:52:08.057 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T18:52:08.057 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-06-10T18:52:08.112 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T18:52:08.113 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-06-10T18:52:08.168 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T18:52:08.168 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-06-10T18:52:08.224 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T18:52:08.225 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-06-10T18:52:08.238 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T18:52:08.238 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-06-10T18:52:08.293 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T18:52:08.293 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-06-10T18:52:08.348 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T18:52:08.349 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-06-10T18:52:08.401 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T18:52:08.402 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-06-10T18:52:08.456 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T18:52:08.457 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-06-10T18:52:08.512 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T18:52:08.512 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-06-10T18:52:08.565 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T18:52:08.565 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-06-10T18:52:08.571 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T18:52:08.571 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-06-10T18:52:08.617 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T18:52:08.617 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-06-10T18:52:08.622 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T18:52:08.623 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-06-10T18:52:08.669 INFO:tasks.ceph:Adding keys to all mons... 2023-06-10T18:52:08.669 DEBUG:teuthology.orchestra.run.smithi053:> sudo tee -a /etc/ceph/ceph.keyring 2023-06-10T18:52:08.671 DEBUG:teuthology.orchestra.run.smithi117:> sudo tee -a /etc/ceph/ceph.keyring 2023-06-10T18:52:08.715 INFO:teuthology.orchestra.run.smithi053.stdout:[mgr.y] 2023-06-10T18:52:08.715 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQA5xoRkBriKOxAA6G+T7Yp2rH7XV7z37lvMYQ== 2023-06-10T18:52:08.716 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.a] 2023-06-10T18:52:08.716 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQA6xoRkWqEQBhAAW+iEw0Gxfw744rsYc/tfTQ== 2023-06-10T18:52:08.716 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.c] 2023-06-10T18:52:08.716 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQA6xoRk19/ODhAAodfGGNLP7UbNhHySgaukrg== 2023-06-10T18:52:08.716 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.0] 2023-06-10T18:52:08.717 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQA7xoRkoj1OMhAAYFc4W5kAlMBqY2yzeJZXQw== 2023-06-10T18:52:08.717 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.1] 2023-06-10T18:52:08.717 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQA+xoRk6FpDOBAALjxW3eaIh3Gu9b1rmMmqfw== 2023-06-10T18:52:08.717 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.2] 2023-06-10T18:52:08.717 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQBCxoRkaO2GBRAA0Xr5en+n5DxhZDg8kVswpQ== 2023-06-10T18:52:08.717 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.3] 2023-06-10T18:52:08.717 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQBFxoRkjfsBDhAAArYYrPnmXu5VcUMGVjQXZg== 2023-06-10T18:52:08.718 INFO:teuthology.orchestra.run.smithi053.stdout:[mgr.x] 2023-06-10T18:52:08.718 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQA6xoRkzWG3AhAAh3NFYHAbp4fgn4FZeRRNuw== 2023-06-10T18:52:08.718 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.b] 2023-06-10T18:52:08.718 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQA6xoRkSu02FRAAFpo6NpcwDLZUt2Rgk/wm8w== 2023-06-10T18:52:08.718 INFO:teuthology.orchestra.run.smithi053.stdout:[mds.d] 2023-06-10T18:52:08.718 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQA6xoRkogwkGxAAIavVKa8GtML1XQDEMwwokQ== 2023-06-10T18:52:08.718 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.4] 2023-06-10T18:52:08.718 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQBLxoRkybumChAAdym/nl9bzyI71flvuy9Vtw== 2023-06-10T18:52:08.719 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.5] 2023-06-10T18:52:08.719 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQBOxoRkinSGIRAAwLbgYKI4NsbHKqGo9O4WuQ== 2023-06-10T18:52:08.719 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.6] 2023-06-10T18:52:08.719 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQBRxoRkj7VlKRAAs2ReBZ5iqtr17Nli9kUtGQ== 2023-06-10T18:52:08.719 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.7] 2023-06-10T18:52:08.719 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQBUxoRk48CnMhAASfbeuCo9jDuHQrYDQ8Vt3A== 2023-06-10T18:52:08.719 INFO:teuthology.orchestra.run.smithi053.stdout:[client.0] 2023-06-10T18:52:08.719 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQA6xoRkgey1IBAAkNYrXMgUOnavBY/5uGyFrw== 2023-06-10T18:52:08.720 INFO:teuthology.orchestra.run.smithi053.stdout:[client.2] 2023-06-10T18:52:08.720 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQA6xoRkewjeJRAA4pmIEVJ3Z7GKQFmA54CZ5Q== 2023-06-10T18:52:08.720 INFO:teuthology.orchestra.run.smithi053.stdout:[client.1] 2023-06-10T18:52:08.720 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQA6xoRkBw+UKBAAuvT+vXmJLG5CvQVg5xItDQ== 2023-06-10T18:52:08.720 INFO:teuthology.orchestra.run.smithi053.stdout:[client.3] 2023-06-10T18:52:08.720 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQA6xoRkHwCiLRAAWGt8UoWxGlG1Y1zSPbKUCg== 2023-06-10T18:52:08.723 INFO:teuthology.orchestra.run.smithi117.stdout:[mgr.y] 2023-06-10T18:52:08.723 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQA5xoRkBriKOxAA6G+T7Yp2rH7XV7z37lvMYQ== 2023-06-10T18:52:08.724 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.a] 2023-06-10T18:52:08.724 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQA6xoRkWqEQBhAAW+iEw0Gxfw744rsYc/tfTQ== 2023-06-10T18:52:08.724 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.c] 2023-06-10T18:52:08.724 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQA6xoRk19/ODhAAodfGGNLP7UbNhHySgaukrg== 2023-06-10T18:52:08.724 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.0] 2023-06-10T18:52:08.724 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQA7xoRkoj1OMhAAYFc4W5kAlMBqY2yzeJZXQw== 2023-06-10T18:52:08.724 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.1] 2023-06-10T18:52:08.725 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQA+xoRk6FpDOBAALjxW3eaIh3Gu9b1rmMmqfw== 2023-06-10T18:52:08.725 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.2] 2023-06-10T18:52:08.725 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQBCxoRkaO2GBRAA0Xr5en+n5DxhZDg8kVswpQ== 2023-06-10T18:52:08.725 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.3] 2023-06-10T18:52:08.725 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQBFxoRkjfsBDhAAArYYrPnmXu5VcUMGVjQXZg== 2023-06-10T18:52:08.725 INFO:teuthology.orchestra.run.smithi117.stdout:[mgr.x] 2023-06-10T18:52:08.725 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQA6xoRkzWG3AhAAh3NFYHAbp4fgn4FZeRRNuw== 2023-06-10T18:52:08.725 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.b] 2023-06-10T18:52:08.726 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQA6xoRkSu02FRAAFpo6NpcwDLZUt2Rgk/wm8w== 2023-06-10T18:52:08.726 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.d] 2023-06-10T18:52:08.726 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQA6xoRkogwkGxAAIavVKa8GtML1XQDEMwwokQ== 2023-06-10T18:52:08.726 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.4] 2023-06-10T18:52:08.726 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQBLxoRkybumChAAdym/nl9bzyI71flvuy9Vtw== 2023-06-10T18:52:08.726 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.5] 2023-06-10T18:52:08.726 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQBOxoRkinSGIRAAwLbgYKI4NsbHKqGo9O4WuQ== 2023-06-10T18:52:08.727 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.6] 2023-06-10T18:52:08.727 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQBRxoRkj7VlKRAAs2ReBZ5iqtr17Nli9kUtGQ== 2023-06-10T18:52:08.727 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.7] 2023-06-10T18:52:08.727 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQBUxoRk48CnMhAASfbeuCo9jDuHQrYDQ8Vt3A== 2023-06-10T18:52:08.727 INFO:teuthology.orchestra.run.smithi117.stdout:[client.0] 2023-06-10T18:52:08.727 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQA6xoRkgey1IBAAkNYrXMgUOnavBY/5uGyFrw== 2023-06-10T18:52:08.727 INFO:teuthology.orchestra.run.smithi117.stdout:[client.2] 2023-06-10T18:52:08.727 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQA6xoRkewjeJRAA4pmIEVJ3Z7GKQFmA54CZ5Q== 2023-06-10T18:52:08.728 INFO:teuthology.orchestra.run.smithi117.stdout:[client.1] 2023-06-10T18:52:08.728 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQA6xoRkBw+UKBAAuvT+vXmJLG5CvQVg5xItDQ== 2023-06-10T18:52:08.728 INFO:teuthology.orchestra.run.smithi117.stdout:[client.3] 2023-06-10T18:52:08.728 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQA6xoRkHwCiLRAAWGt8UoWxGlG1Y1zSPbKUCg== 2023-06-10T18:52:08.729 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-06-10T18:52:08.766 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-06-10T18:52:08.817 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-10T18:52:08.819 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-10T18:52:08.907 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-10T18:52:08.909 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-10T18:52:08.957 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-10T18:52:08.960 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-10T18:52:09.030 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-10T18:52:09.046 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-10T18:52:09.116 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-10T18:52:09.130 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-10T18:52:09.200 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-10T18:52:09.214 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-10T18:52:09.280 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-06-10T18:52:09.298 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-06-10T18:52:09.359 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-10T18:52:09.361 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-10T18:52:09.442 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-10T18:52:09.453 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-10T18:52:09.527 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-10T18:52:09.542 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-10T18:52:09.611 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-10T18:52:09.613 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-10T18:52:09.696 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-10T18:52:09.698 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-10T18:52:09.777 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-10T18:52:09.782 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-10T18:52:09.863 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-10T18:52:09.865 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-10T18:52:09.947 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-10T18:52:09.954 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-10T18:52:10.035 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-10T18:52:10.038 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-10T18:52:10.125 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-10T18:52:10.127 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-10T18:52:10.169 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-06-10T18:52:10.169 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-06-10T18:52:10.180 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-06-10T18:52:10.274 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-06-10T18:52:10.285 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-06-10T18:52:10.298 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-06-10T18:52:10.394 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-06-10T18:52:10.404 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-06-10T18:52:10.454 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-06-10T18:52:10.550 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-06-10T18:52:10.602 DEBUG:teuthology.orchestra.run.smithi053:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-06-10T18:52:10.605 DEBUG:teuthology.orchestra.run.smithi117:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-06-10T18:52:10.649 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-06-10T18:52:10.649 INFO:tasks.ceph.mon.a:Restarting daemon 2023-06-10T18:52:10.650 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-06-10T18:52:10.654 INFO:tasks.ceph.mon.a:Started 2023-06-10T18:52:10.654 INFO:tasks.ceph.mon.b:Restarting daemon 2023-06-10T18:52:10.654 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-06-10T18:52:10.694 INFO:tasks.ceph.mon.b:Started 2023-06-10T18:52:10.695 INFO:tasks.ceph.mon.c:Restarting daemon 2023-06-10T18:52:10.695 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-06-10T18:52:10.699 INFO:tasks.ceph.mon.c:Started 2023-06-10T18:52:10.699 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-06-10T18:52:10.699 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-06-10T18:52:10.700 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-06-10T18:52:10.702 INFO:tasks.ceph.mgr.y:Started 2023-06-10T18:52:10.702 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-06-10T18:52:10.703 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-06-10T18:52:10.704 INFO:tasks.ceph.mgr.x:Started 2023-06-10T18:52:10.705 INFO:tasks.ceph:Setting crush tunables to default 2023-06-10T18:52:10.705 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --cluster ceph osd crush tunables default 2023-06-10T18:52:10.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:10.813+0000 7f8915977640 1 Processor -- start 2023-06-10T18:52:10.824 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:10.813+0000 7f8915977640 1 -- start start 2023-06-10T18:52:10.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:10.813+0000 7f8915977640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8910069450 0x7f89100698f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:10.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:10.813+0000 7f8915977640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8910070f10 con 0x7f8910159630 2023-06-10T18:52:10.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:10.813+0000 7f8915977640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f891015db60 con 0x7f89100ad730 2023-06-10T18:52:10.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:10.813+0000 7f8915977640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f891015d970 con 0x7f8910069450 2023-06-10T18:52:10.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:10.813+0000 7f890effd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f8910159630 0x7f891015d260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:49856/0 (socket says 172.21.15.53:49856) 2023-06-10T18:52:10.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:10.813+0000 7f890effd640 1 -- 172.21.15.53:0/1099552787 learned_addr learned my addr 172.21.15.53:0/1099552787 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:52:10.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:10.817+0000 7f890f7fe640 1 --2- 172.21.15.53:0/1099552787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8910069450 0x7f89100698f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:10.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:10.817+0000 7f890f7fe640 1 -- 172.21.15.53:0/1099552787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8910069450 msgr2=0x7f89100698f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-06-10T18:52:10.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:10.817+0000 7f890f7fe640 1 -- 172.21.15.53:0/1099552787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8910069450 msgr2=0x7f89100698f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-10T18:52:10.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:10.817+0000 7f890f7fe640 1 --2- 172.21.15.53:0/1099552787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8910069450 0x7f89100698f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-10T18:52:10.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:10.817+0000 7f890f7fe640 1 --2- 172.21.15.53:0/1099552787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8910069450 0x7f89100698f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-06-10T18:52:11.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:11.021+0000 7f890f7fe640 1 --2- 172.21.15.53:0/1099552787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8910069450 0x7f89100698f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:11.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:11.021+0000 7f890f7fe640 1 -- 172.21.15.53:0/1099552787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8910069450 msgr2=0x7f89100698f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-06-10T18:52:11.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:11.021+0000 7f890f7fe640 1 -- 172.21.15.53:0/1099552787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8910069450 msgr2=0x7f89100698f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-10T18:52:11.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:11.021+0000 7f890f7fe640 1 --2- 172.21.15.53:0/1099552787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8910069450 0x7f89100698f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-10T18:52:11.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:11.021+0000 7f890f7fe640 1 --2- 172.21.15.53:0/1099552787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8910069450 0x7f89100698f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-06-10T18:52:11.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:11.425+0000 7f890f7fe640 1 --2- 172.21.15.53:0/1099552787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8910069450 0x7f89100698f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:11.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:11.425+0000 7f890f7fe640 1 -- 172.21.15.53:0/1099552787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8910069450 msgr2=0x7f89100698f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-06-10T18:52:11.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:11.425+0000 7f890f7fe640 1 -- 172.21.15.53:0/1099552787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8910069450 msgr2=0x7f89100698f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-10T18:52:11.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:11.425+0000 7f890f7fe640 1 --2- 172.21.15.53:0/1099552787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8910069450 0x7f89100698f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-10T18:52:11.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:11.425+0000 7f890f7fe640 1 --2- 172.21.15.53:0/1099552787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8910069450 0x7f89100698f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-06-10T18:52:12.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:12.229+0000 7f890f7fe640 1 --2- 172.21.15.53:0/1099552787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8910069450 0x7f89100698f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:12.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:12.229+0000 7f890f7fe640 1 -- 172.21.15.53:0/1099552787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8910069450 msgr2=0x7f89100698f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-06-10T18:52:12.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:12.229+0000 7f890f7fe640 1 -- 172.21.15.53:0/1099552787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8910069450 msgr2=0x7f89100698f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-10T18:52:12.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:12.229+0000 7f890f7fe640 1 --2- 172.21.15.53:0/1099552787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8910069450 0x7f89100698f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-10T18:52:12.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:12.229+0000 7f890f7fe640 1 --2- 172.21.15.53:0/1099552787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8910069450 0x7f89100698f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-06-10T18:52:13.824 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:13.813+0000 7f890cff9640 1 -- 172.21.15.53:0/1099552787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8910069450 msgr2=0x7f89100698f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-10T18:52:13.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:13.813+0000 7f890cff9640 1 --2- 172.21.15.53:0/1099552787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8910069450 0x7f89100698f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:13.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:13.813+0000 7f890cff9640 1 -- 172.21.15.53:0/1099552787 >> v1:172.21.15.117:6789/0 conn(0x7f89100ad730 legacy=0x7f89100713a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:13.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:13.813+0000 7f890cff9640 1 -- 172.21.15.53:0/1099552787 >> v1:172.21.15.53:6789/0 conn(0x7f8910159630 legacy=0x7f891015d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:13.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:13.813+0000 7f890cff9640 1 --2- 172.21.15.53:0/1099552787 >> v2:172.21.15.53:3300/0 conn(0x7f88fc003720 0x7f88fc005b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:13.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:13.813+0000 7f890cff9640 1 --2- 172.21.15.53:0/1099552787 >> v2:172.21.15.117:3300/0 conn(0x7f88fc0061e0 0x7f88fc008690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:13.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:13.813+0000 7f890cff9640 1 -- 172.21.15.53:0/1099552787 --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88fc008d10 con 0x7f88fc003720 2023-06-10T18:52:13.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:13.813+0000 7f890cff9640 1 -- 172.21.15.53:0/1099552787 --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88fc008e80 con 0x7f88fc0061e0 2023-06-10T18:52:13.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:13.817+0000 7f890effd640 1 --2- 172.21.15.53:0/1099552787 >> v2:172.21.15.53:3300/0 conn(0x7f88fc003720 0x7f88fc005b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:13.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:13.817+0000 7f890e7fc640 1 --2- 172.21.15.53:0/1099552787 >> v2:172.21.15.117:3300/0 conn(0x7f88fc0061e0 0x7f88fc008690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:13.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:13.817+0000 7f890effd640 1 -- 172.21.15.53:0/1099552787 >> v2:172.21.15.53:3300/0 conn(0x7f88fc003720 msgr2=0x7f88fc005b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-06-10T18:52:13.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:13.817+0000 7f890effd640 1 -- 172.21.15.53:0/1099552787 >> v2:172.21.15.53:3300/0 conn(0x7f88fc003720 msgr2=0x7f88fc005b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-10T18:52:13.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:13.817+0000 7f890effd640 1 --2- 172.21.15.53:0/1099552787 >> v2:172.21.15.53:3300/0 conn(0x7f88fc003720 0x7f88fc005b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-10T18:52:13.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:13.817+0000 7f890effd640 1 --2- 172.21.15.53:0/1099552787 >> v2:172.21.15.53:3300/0 conn(0x7f88fc003720 0x7f88fc005b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-06-10T18:52:13.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:13.817+0000 7f890e7fc640 1 -- 172.21.15.53:0/1099552787 >> v2:172.21.15.117:3300/0 conn(0x7f88fc0061e0 msgr2=0x7f88fc008690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-06-10T18:52:13.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:13.817+0000 7f890e7fc640 1 -- 172.21.15.53:0/1099552787 >> v2:172.21.15.117:3300/0 conn(0x7f88fc0061e0 msgr2=0x7f88fc008690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-10T18:52:13.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:13.817+0000 7f890e7fc640 1 --2- 172.21.15.53:0/1099552787 >> v2:172.21.15.117:3300/0 conn(0x7f88fc0061e0 0x7f88fc008690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-10T18:52:13.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:13.817+0000 7f890e7fc640 1 --2- 172.21.15.53:0/1099552787 >> v2:172.21.15.117:3300/0 conn(0x7f88fc0061e0 0x7f88fc008690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-06-10T18:52:14.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:14.021+0000 7f890effd640 1 --2- 172.21.15.53:0/1099552787 >> v2:172.21.15.53:3300/0 conn(0x7f88fc003720 0x7f88fc005b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:14.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:14.021+0000 7f890e7fc640 1 --2- 172.21.15.53:0/1099552787 >> v2:172.21.15.117:3300/0 conn(0x7f88fc0061e0 0x7f88fc008690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:14.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:14.021+0000 7f890effd640 1 -- 172.21.15.53:0/1099552787 >> v2:172.21.15.53:3300/0 conn(0x7f88fc003720 msgr2=0x7f88fc005b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-06-10T18:52:14.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:14.021+0000 7f890effd640 1 -- 172.21.15.53:0/1099552787 >> v2:172.21.15.53:3300/0 conn(0x7f88fc003720 msgr2=0x7f88fc005b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-10T18:52:14.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:14.021+0000 7f890effd640 1 --2- 172.21.15.53:0/1099552787 >> v2:172.21.15.53:3300/0 conn(0x7f88fc003720 0x7f88fc005b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-10T18:52:14.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:14.021+0000 7f890effd640 1 --2- 172.21.15.53:0/1099552787 >> v2:172.21.15.53:3300/0 conn(0x7f88fc003720 0x7f88fc005b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-06-10T18:52:14.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:14.021+0000 7f890e7fc640 1 -- 172.21.15.53:0/1099552787 >> v2:172.21.15.117:3300/0 conn(0x7f88fc0061e0 msgr2=0x7f88fc008690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-06-10T18:52:14.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:14.021+0000 7f890e7fc640 1 -- 172.21.15.53:0/1099552787 >> v2:172.21.15.117:3300/0 conn(0x7f88fc0061e0 msgr2=0x7f88fc008690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-10T18:52:14.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:14.021+0000 7f890e7fc640 1 --2- 172.21.15.53:0/1099552787 >> v2:172.21.15.117:3300/0 conn(0x7f88fc0061e0 0x7f88fc008690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-10T18:52:14.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:14.021+0000 7f890e7fc640 1 --2- 172.21.15.53:0/1099552787 >> v2:172.21.15.117:3300/0 conn(0x7f88fc0061e0 0x7f88fc008690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-06-10T18:52:14.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:14.425+0000 7f890effd640 1 --2- 172.21.15.53:0/1099552787 >> v2:172.21.15.53:3300/0 conn(0x7f88fc003720 0x7f88fc005b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:14.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:14.425+0000 7f890e7fc640 1 --2- 172.21.15.53:0/1099552787 >> v2:172.21.15.117:3300/0 conn(0x7f88fc0061e0 0x7f88fc008690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:14.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:14.425+0000 7f890effd640 1 -- 172.21.15.53:0/1099552787 >> v2:172.21.15.53:3300/0 conn(0x7f88fc003720 msgr2=0x7f88fc005b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-06-10T18:52:14.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:14.425+0000 7f890effd640 1 -- 172.21.15.53:0/1099552787 >> v2:172.21.15.53:3300/0 conn(0x7f88fc003720 msgr2=0x7f88fc005b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-10T18:52:14.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:14.425+0000 7f890effd640 1 --2- 172.21.15.53:0/1099552787 >> v2:172.21.15.53:3300/0 conn(0x7f88fc003720 0x7f88fc005b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-10T18:52:14.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:14.425+0000 7f890e7fc640 1 -- 172.21.15.53:0/1099552787 >> v2:172.21.15.117:3300/0 conn(0x7f88fc0061e0 msgr2=0x7f88fc008690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-06-10T18:52:14.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:14.425+0000 7f890e7fc640 1 -- 172.21.15.53:0/1099552787 >> v2:172.21.15.117:3300/0 conn(0x7f88fc0061e0 msgr2=0x7f88fc008690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-10T18:52:14.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:14.425+0000 7f890effd640 1 --2- 172.21.15.53:0/1099552787 >> v2:172.21.15.53:3300/0 conn(0x7f88fc003720 0x7f88fc005b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-06-10T18:52:14.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:14.425+0000 7f890e7fc640 1 --2- 172.21.15.53:0/1099552787 >> v2:172.21.15.117:3300/0 conn(0x7f88fc0061e0 0x7f88fc008690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-10T18:52:14.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:14.425+0000 7f890e7fc640 1 --2- 172.21.15.53:0/1099552787 >> v2:172.21.15.117:3300/0 conn(0x7f88fc0061e0 0x7f88fc008690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-06-10T18:52:15.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:15.229+0000 7f890effd640 1 --2- 172.21.15.53:0/1099552787 >> v2:172.21.15.53:3300/0 conn(0x7f88fc003720 0x7f88fc005b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:15.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:15.229+0000 7f890e7fc640 1 --2- 172.21.15.53:0/1099552787 >> v2:172.21.15.117:3300/0 conn(0x7f88fc0061e0 0x7f88fc008690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:15.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:15.229+0000 7f890effd640 1 -- 172.21.15.53:0/1099552787 >> v2:172.21.15.53:3300/0 conn(0x7f88fc003720 msgr2=0x7f88fc005b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-06-10T18:52:15.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:15.229+0000 7f890effd640 1 -- 172.21.15.53:0/1099552787 >> v2:172.21.15.53:3300/0 conn(0x7f88fc003720 msgr2=0x7f88fc005b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-10T18:52:15.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:15.229+0000 7f890effd640 1 --2- 172.21.15.53:0/1099552787 >> v2:172.21.15.53:3300/0 conn(0x7f88fc003720 0x7f88fc005b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-10T18:52:15.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:15.229+0000 7f890effd640 1 --2- 172.21.15.53:0/1099552787 >> v2:172.21.15.53:3300/0 conn(0x7f88fc003720 0x7f88fc005b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-06-10T18:52:15.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:15.229+0000 7f890e7fc640 1 -- 172.21.15.53:0/1099552787 >> v2:172.21.15.117:3300/0 conn(0x7f88fc0061e0 msgr2=0x7f88fc008690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-06-10T18:52:15.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:15.229+0000 7f890e7fc640 1 -- 172.21.15.53:0/1099552787 >> v2:172.21.15.117:3300/0 conn(0x7f88fc0061e0 msgr2=0x7f88fc008690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-10T18:52:15.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:15.229+0000 7f890e7fc640 1 --2- 172.21.15.53:0/1099552787 >> v2:172.21.15.117:3300/0 conn(0x7f88fc0061e0 0x7f88fc008690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-10T18:52:15.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:15.229+0000 7f890e7fc640 1 --2- 172.21.15.53:0/1099552787 >> v2:172.21.15.117:3300/0 conn(0x7f88fc0061e0 0x7f88fc008690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-06-10T18:52:16.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:16.816+0000 7f890cff9640 1 -- 172.21.15.53:0/1099552787 >> v2:172.21.15.117:3300/0 conn(0x7f88fc0061e0 msgr2=0x7f88fc008690 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-10T18:52:16.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:16.816+0000 7f890cff9640 1 --2- 172.21.15.53:0/1099552787 >> v2:172.21.15.117:3300/0 conn(0x7f88fc0061e0 0x7f88fc008690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:16.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:16.816+0000 7f890cff9640 1 -- 172.21.15.53:0/1099552787 >> v2:172.21.15.53:3300/0 conn(0x7f88fc003720 msgr2=0x7f88fc005b90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-10T18:52:16.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:16.816+0000 7f890cff9640 1 --2- 172.21.15.53:0/1099552787 >> v2:172.21.15.53:3300/0 conn(0x7f88fc003720 0x7f88fc005b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:16.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:16.816+0000 7f890cff9640 1 --2- 172.21.15.53:0/1099552787 >> v2:172.21.15.53:3300/0 conn(0x7f88fc009230 0x7f88fc00b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:16.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:16.816+0000 7f890f7fe640 1 -- 172.21.15.53:0/1099552787 reap_dead start 2023-06-10T18:52:16.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:16.816+0000 7f890cff9640 1 --2- 172.21.15.53:0/1099552787 >> v2:172.21.15.117:3300/0 conn(0x7f88fc006680 0x7f88fc003b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:16.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:16.816+0000 7f890cff9640 1 -- 172.21.15.53:0/1099552787 --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f891015de40 con 0x7f88fc004060 2023-06-10T18:52:16.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:16.816+0000 7f890cff9640 1 -- 172.21.15.53:0/1099552787 --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88fc008d10 con 0x7f88fc009230 2023-06-10T18:52:16.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:16.816+0000 7f890cff9640 1 -- 172.21.15.53:0/1099552787 --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88fc008e80 con 0x7f88fc006680 2023-06-10T18:52:16.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:16.816+0000 7f890effd640 1 --2- 172.21.15.53:0/1099552787 >> v2:172.21.15.53:3300/0 conn(0x7f88fc009230 0x7f88fc00b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:16.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:16.816+0000 7f890e7fc640 1 --2- 172.21.15.53:0/1099552787 >> v2:172.21.15.117:3300/0 conn(0x7f88fc006680 0x7f88fc003b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:16.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:16.816+0000 7f890effd640 1 -- 172.21.15.53:0/1099552787 >> v2:172.21.15.53:3300/0 conn(0x7f88fc009230 msgr2=0x7f88fc00b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-06-10T18:52:16.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:16.816+0000 7f890effd640 1 -- 172.21.15.53:0/1099552787 >> v2:172.21.15.53:3300/0 conn(0x7f88fc009230 msgr2=0x7f88fc00b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-10T18:52:16.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:16.816+0000 7f890effd640 1 --2- 172.21.15.53:0/1099552787 >> v2:172.21.15.53:3300/0 conn(0x7f88fc009230 0x7f88fc00b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-10T18:52:16.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:16.816+0000 7f890effd640 1 --2- 172.21.15.53:0/1099552787 >> v2:172.21.15.53:3300/0 conn(0x7f88fc009230 0x7f88fc00b610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-06-10T18:52:16.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:16.816+0000 7f890e7fc640 1 -- 172.21.15.53:0/1099552787 >> v2:172.21.15.117:3300/0 conn(0x7f88fc006680 msgr2=0x7f88fc003b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-06-10T18:52:16.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:16.816+0000 7f890e7fc640 1 -- 172.21.15.53:0/1099552787 >> v2:172.21.15.117:3300/0 conn(0x7f88fc006680 msgr2=0x7f88fc003b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-10T18:52:16.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:16.816+0000 7f890e7fc640 1 --2- 172.21.15.53:0/1099552787 >> v2:172.21.15.117:3300/0 conn(0x7f88fc006680 0x7f88fc003b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-10T18:52:16.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:16.816+0000 7f890e7fc640 1 --2- 172.21.15.53:0/1099552787 >> v2:172.21.15.117:3300/0 conn(0x7f88fc006680 0x7f88fc003b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-06-10T18:52:17.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:17.020+0000 7f890effd640 1 --2- 172.21.15.53:0/1099552787 >> v2:172.21.15.53:3300/0 conn(0x7f88fc009230 0x7f88fc00b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:17.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:17.020+0000 7f890e7fc640 1 --2- 172.21.15.53:0/1099552787 >> v2:172.21.15.117:3300/0 conn(0x7f88fc006680 0x7f88fc003b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:17.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:17.020+0000 7f890effd640 1 -- 172.21.15.53:0/1099552787 >> v2:172.21.15.53:3300/0 conn(0x7f88fc009230 msgr2=0x7f88fc00b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-06-10T18:52:17.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:17.020+0000 7f890effd640 1 -- 172.21.15.53:0/1099552787 >> v2:172.21.15.53:3300/0 conn(0x7f88fc009230 msgr2=0x7f88fc00b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-10T18:52:17.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:17.020+0000 7f890effd640 1 --2- 172.21.15.53:0/1099552787 >> v2:172.21.15.53:3300/0 conn(0x7f88fc009230 0x7f88fc00b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-10T18:52:17.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:17.020+0000 7f890effd640 1 --2- 172.21.15.53:0/1099552787 >> v2:172.21.15.53:3300/0 conn(0x7f88fc009230 0x7f88fc00b610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-06-10T18:52:17.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:17.020+0000 7f890e7fc640 1 -- 172.21.15.53:0/1099552787 >> v2:172.21.15.117:3300/0 conn(0x7f88fc006680 msgr2=0x7f88fc003b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-06-10T18:52:17.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:17.020+0000 7f890e7fc640 1 -- 172.21.15.53:0/1099552787 >> v2:172.21.15.117:3300/0 conn(0x7f88fc006680 msgr2=0x7f88fc003b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-10T18:52:17.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:17.020+0000 7f890e7fc640 1 --2- 172.21.15.53:0/1099552787 >> v2:172.21.15.117:3300/0 conn(0x7f88fc006680 0x7f88fc003b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-10T18:52:17.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:17.020+0000 7f890e7fc640 1 --2- 172.21.15.53:0/1099552787 >> v2:172.21.15.117:3300/0 conn(0x7f88fc006680 0x7f88fc003b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-06-10T18:52:17.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:17.424+0000 7f890effd640 1 --2- 172.21.15.53:0/1099552787 >> v2:172.21.15.53:3300/0 conn(0x7f88fc009230 0x7f88fc00b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:17.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:17.424+0000 7f890e7fc640 1 --2- 172.21.15.53:0/1099552787 >> v2:172.21.15.117:3300/0 conn(0x7f88fc006680 0x7f88fc003b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:17.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:17.424+0000 7f890effd640 1 -- 172.21.15.53:0/1099552787 >> v2:172.21.15.53:3300/0 conn(0x7f88fc009230 msgr2=0x7f88fc00b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-06-10T18:52:17.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:17.424+0000 7f890effd640 1 -- 172.21.15.53:0/1099552787 >> v2:172.21.15.53:3300/0 conn(0x7f88fc009230 msgr2=0x7f88fc00b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-10T18:52:17.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:17.424+0000 7f890effd640 1 --2- 172.21.15.53:0/1099552787 >> v2:172.21.15.53:3300/0 conn(0x7f88fc009230 0x7f88fc00b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-10T18:52:17.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:17.424+0000 7f890effd640 1 --2- 172.21.15.53:0/1099552787 >> v2:172.21.15.53:3300/0 conn(0x7f88fc009230 0x7f88fc00b610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-06-10T18:52:17.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:17.424+0000 7f890e7fc640 1 -- 172.21.15.53:0/1099552787 >> v2:172.21.15.117:3300/0 conn(0x7f88fc006680 msgr2=0x7f88fc003b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-06-10T18:52:17.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:17.424+0000 7f890e7fc640 1 -- 172.21.15.53:0/1099552787 >> v2:172.21.15.117:3300/0 conn(0x7f88fc006680 msgr2=0x7f88fc003b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-10T18:52:17.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:17.424+0000 7f890e7fc640 1 --2- 172.21.15.53:0/1099552787 >> v2:172.21.15.117:3300/0 conn(0x7f88fc006680 0x7f88fc003b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-10T18:52:17.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:17.424+0000 7f890e7fc640 1 --2- 172.21.15.53:0/1099552787 >> v2:172.21.15.117:3300/0 conn(0x7f88fc006680 0x7f88fc003b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-06-10T18:52:18.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:18.228+0000 7f890effd640 1 --2- 172.21.15.53:0/1099552787 >> v2:172.21.15.53:3300/0 conn(0x7f88fc009230 0x7f88fc00b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:18.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:18.228+0000 7f890e7fc640 1 --2- 172.21.15.53:0/1099552787 >> v2:172.21.15.117:3300/0 conn(0x7f88fc006680 0x7f88fc003b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:18.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:18.228+0000 7f890effd640 1 -- 172.21.15.53:0/1099552787 >> v2:172.21.15.53:3300/0 conn(0x7f88fc009230 msgr2=0x7f88fc00b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-06-10T18:52:18.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:18.228+0000 7f890effd640 1 -- 172.21.15.53:0/1099552787 >> v2:172.21.15.53:3300/0 conn(0x7f88fc009230 msgr2=0x7f88fc00b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-10T18:52:18.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:18.228+0000 7f890effd640 1 --2- 172.21.15.53:0/1099552787 >> v2:172.21.15.53:3300/0 conn(0x7f88fc009230 0x7f88fc00b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-10T18:52:18.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:18.228+0000 7f890effd640 1 --2- 172.21.15.53:0/1099552787 >> v2:172.21.15.53:3300/0 conn(0x7f88fc009230 0x7f88fc00b610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-06-10T18:52:18.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:18.228+0000 7f890e7fc640 1 -- 172.21.15.53:0/1099552787 >> v2:172.21.15.117:3300/0 conn(0x7f88fc006680 msgr2=0x7f88fc003b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-06-10T18:52:18.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:18.228+0000 7f890e7fc640 1 -- 172.21.15.53:0/1099552787 >> v2:172.21.15.117:3300/0 conn(0x7f88fc006680 msgr2=0x7f88fc003b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-10T18:52:18.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:18.228+0000 7f890e7fc640 1 --2- 172.21.15.53:0/1099552787 >> v2:172.21.15.117:3300/0 conn(0x7f88fc006680 0x7f88fc003b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-10T18:52:18.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:18.228+0000 7f890e7fc640 1 --2- 172.21.15.53:0/1099552787 >> v2:172.21.15.117:3300/0 conn(0x7f88fc006680 0x7f88fc003b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-06-10T18:52:19.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:19.816+0000 7f890cff9640 1 -- 172.21.15.53:0/1099552787 >> v2:172.21.15.117:3300/0 conn(0x7f88fc006680 msgr2=0x7f88fc003b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-10T18:52:19.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:19.816+0000 7f890cff9640 1 --2- 172.21.15.53:0/1099552787 >> v2:172.21.15.117:3300/0 conn(0x7f88fc006680 0x7f88fc003b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:19.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:19.816+0000 7f890cff9640 1 -- 172.21.15.53:0/1099552787 >> v2:172.21.15.53:3300/0 conn(0x7f88fc009230 msgr2=0x7f88fc00b610 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-10T18:52:19.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:19.816+0000 7f890cff9640 1 --2- 172.21.15.53:0/1099552787 >> v2:172.21.15.53:3300/0 conn(0x7f88fc009230 0x7f88fc00b610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:19.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:19.816+0000 7f890cff9640 1 -- 172.21.15.53:0/1099552787 >> v1:172.21.15.117:6789/0 conn(0x7f88fc004060 legacy=0x7f88fc004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:19.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:19.816+0000 7f890cff9640 1 --2- 172.21.15.53:0/1099552787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88fc00dd80 0x7f88fc010160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:19.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:19.816+0000 7f890cff9640 1 -- 172.21.15.53:0/1099552787 --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88fc005e80 con 0x7f88fc010870 2023-06-10T18:52:19.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:19.816+0000 7f890cff9640 1 -- 172.21.15.53:0/1099552787 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88fc008d10 con 0x7f88fc00dd80 2023-06-10T18:52:19.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:19.816+0000 7f890effd640 1 --2- 172.21.15.53:0/1099552787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88fc00dd80 0x7f88fc010160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:19.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:19.816+0000 7f890effd640 1 -- 172.21.15.53:0/1099552787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88fc00dd80 msgr2=0x7f88fc010160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-06-10T18:52:19.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:19.816+0000 7f890effd640 1 -- 172.21.15.53:0/1099552787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88fc00dd80 msgr2=0x7f88fc010160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-10T18:52:19.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:19.816+0000 7f890effd640 1 --2- 172.21.15.53:0/1099552787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88fc00dd80 0x7f88fc010160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-10T18:52:19.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:19.816+0000 7f890effd640 1 --2- 172.21.15.53:0/1099552787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88fc00dd80 0x7f88fc010160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-06-10T18:52:20.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:20.020+0000 7f890effd640 1 --2- 172.21.15.53:0/1099552787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88fc00dd80 0x7f88fc010160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:20.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:20.020+0000 7f890effd640 1 -- 172.21.15.53:0/1099552787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88fc00dd80 msgr2=0x7f88fc010160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-06-10T18:52:20.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:20.020+0000 7f890effd640 1 -- 172.21.15.53:0/1099552787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88fc00dd80 msgr2=0x7f88fc010160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-10T18:52:20.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:20.020+0000 7f890effd640 1 --2- 172.21.15.53:0/1099552787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88fc00dd80 0x7f88fc010160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-10T18:52:20.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:20.020+0000 7f890effd640 1 --2- 172.21.15.53:0/1099552787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88fc00dd80 0x7f88fc010160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-06-10T18:52:20.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:20.424+0000 7f890effd640 1 --2- 172.21.15.53:0/1099552787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88fc00dd80 0x7f88fc010160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:20.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:20.424+0000 7f890effd640 1 -- 172.21.15.53:0/1099552787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88fc00dd80 msgr2=0x7f88fc010160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-06-10T18:52:20.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:20.424+0000 7f890effd640 1 -- 172.21.15.53:0/1099552787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88fc00dd80 msgr2=0x7f88fc010160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-10T18:52:20.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:20.424+0000 7f890effd640 1 --2- 172.21.15.53:0/1099552787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88fc00dd80 0x7f88fc010160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-10T18:52:20.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:20.424+0000 7f890effd640 1 --2- 172.21.15.53:0/1099552787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88fc00dd80 0x7f88fc010160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-06-10T18:52:21.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:21.092+0000 7f890dffb640 1 -- 172.21.15.53:0/1099552787 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 94431616 0 0) 0x7f88fc005e80 con 0x7f88fc010870 2023-06-10T18:52:21.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:21.092+0000 7f890dffb640 1 -- 172.21.15.53:0/1099552787 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88f8003530 con 0x7f88fc010870 2023-06-10T18:52:21.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:21.092+0000 7f890dffb640 1 -- 172.21.15.53:0/1099552787 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4281529737 0 0) 0x7f88f8003530 con 0x7f88fc010870 2023-06-10T18:52:21.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:21.092+0000 7f890dffb640 1 -- 172.21.15.53:0/1099552787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88fc00dd80 msgr2=0x7f88fc010160 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-10T18:52:21.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:21.092+0000 7f890dffb640 1 --2- 172.21.15.53:0/1099552787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88fc00dd80 0x7f88fc010160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:21.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:21.092+0000 7f890dffb640 1 -- 172.21.15.53:0/1099552787 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88fc015530 con 0x7f88fc010870 2023-06-10T18:52:21.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:21.092+0000 7f890dffb640 1 -- 172.21.15.53:0/1099552787 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f8904007d80 con 0x7f88fc010870 2023-06-10T18:52:21.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:21.092+0000 7f890dffb640 1 -- 172.21.15.53:0/1099552787 >> v1:172.21.15.53:6789/0 conn(0x7f88fc010870 legacy=0x7f88fc012c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:21.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:21.092+0000 7f890f7fe640 1 -- 172.21.15.53:0/1099552787 reap_dead start 2023-06-10T18:52:21.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:21.092+0000 7f890dffb640 1 --2- 172.21.15.53:0/1099552787 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88f80039b0 0x7f88f8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:21.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:21.092+0000 7f890dffb640 1 --2- 172.21.15.53:0/1099552787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88f80047d0 0x7f88f8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:21.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:21.092+0000 7f890dffb640 1 --2- 172.21.15.53:0/1099552787 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88f80051d0 0x7f88f800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:21.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:21.092+0000 7f890dffb640 1 -- 172.21.15.53:0/1099552787 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88fc008d10 con 0x7f88f80039b0 2023-06-10T18:52:21.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:21.092+0000 7f890dffb640 1 -- 172.21.15.53:0/1099552787 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f800c0e0 con 0x7f88f80051d0 2023-06-10T18:52:21.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:21.092+0000 7f890dffb640 1 -- 172.21.15.53:0/1099552787 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88f800c2a0 con 0x7f88f80047d0 2023-06-10T18:52:21.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:21.092+0000 7f890effd640 1 --2- 172.21.15.53:0/1099552787 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88f80039b0 0x7f88f8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:21.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:21.092+0000 7f890e7fc640 1 --2- 172.21.15.53:0/1099552787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88f80047d0 0x7f88f8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:21.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:21.092+0000 7f890f7fe640 1 --2- 172.21.15.53:0/1099552787 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88f80051d0 0x7f88f800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:21.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:21.092+0000 7f890effd640 1 -- 172.21.15.53:0/1099552787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88f80047d0 msgr2=0x7f88f8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:21.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:21.092+0000 7f890effd640 1 --2- 172.21.15.53:0/1099552787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88f80047d0 0x7f88f8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:21.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:21.092+0000 7f890effd640 1 -- 172.21.15.53:0/1099552787 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88f80051d0 msgr2=0x7f88f800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:21.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:21.092+0000 7f890effd640 1 --2- 172.21.15.53:0/1099552787 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88f80051d0 0x7f88f800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:21.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:21.092+0000 7f890effd640 1 -- 172.21.15.53:0/1099552787 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88f8003530 con 0x7f88f80039b0 2023-06-10T18:52:21.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:21.096+0000 7f890effd640 1 --2- 172.21.15.53:0/1099552787 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88f80039b0 0x7f88f8003da0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f88fc006120 tx=0x7f8900009230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ab06b06fdc4e8a5 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:21.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:21.096+0000 7f890dffb640 1 -- 172.21.15.53:0/1099552787 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89000a69d0 con 0x7f88f80039b0 2023-06-10T18:52:21.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:21.096+0000 7f890dffb640 1 -- 172.21.15.53:0/1099552787 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89000a6b30 con 0x7f88f80039b0 2023-06-10T18:52:21.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:21.096+0000 7f890dffb640 1 -- 172.21.15.53:0/1099552787 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89000ae440 con 0x7f88f80039b0 2023-06-10T18:52:21.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:21.100+0000 7f8915977640 1 -- 172.21.15.53:0/1099552787 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88f80039b0 msgr2=0x7f88f8003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:21.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:21.100+0000 7f8915977640 1 --2- 172.21.15.53:0/1099552787 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88f80039b0 0x7f88f8003da0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f88fc006120 tx=0x7f8900009230 comp rx=0 tx=0).stop 2023-06-10T18:52:21.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:21.100+0000 7f8915977640 1 -- 172.21.15.53:0/1099552787 shutdown_connections 2023-06-10T18:52:21.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:21.100+0000 7f8915977640 1 --2- 172.21.15.53:0/1099552787 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88f80051d0 0x7f88f800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:21.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:21.100+0000 7f8915977640 1 --2- 172.21.15.53:0/1099552787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88f80047d0 0x7f88f8004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:21.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:21.100+0000 7f8915977640 1 --2- 172.21.15.53:0/1099552787 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88f80039b0 0x7f88f8003da0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:21.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:21.100+0000 7f8915977640 1 -- 172.21.15.53:0/1099552787 >> 172.21.15.53:0/1099552787 conn(0x7f89100cafc0 msgr2=0x7f89100cb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:21.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:21.100+0000 7f8915977640 1 -- 172.21.15.53:0/1099552787 shutdown_connections 2023-06-10T18:52:21.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:21.100+0000 7f8915977640 1 -- 172.21.15.53:0/1099552787 wait complete. 2023-06-10T18:52:21.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:21.100+0000 7f8915977640 1 Processor -- start 2023-06-10T18:52:21.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:21.100+0000 7f8915977640 1 -- start start 2023-06-10T18:52:21.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:21.104+0000 7f8915977640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88f80039b0 0x7f89101f6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:21.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:21.104+0000 7f8915977640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88f80047d0 0x7f89101543b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:21.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:21.104+0000 7f8915977640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88f80051d0 0x7f89100b3200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:21.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:21.104+0000 7f8915977640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89101f67c0 con 0x7f88f80051d0 2023-06-10T18:52:21.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:21.104+0000 7f8915977640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f891015b2f0 con 0x7f88f80039b0 2023-06-10T18:52:21.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:21.104+0000 7f8915977640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f891015b010 con 0x7f88f80047d0 2023-06-10T18:52:21.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:21.104+0000 7f890f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88f80051d0 0x7f89100b3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:21.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:21.104+0000 7f890f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88f80051d0 0x7f89100b3200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60014/0 (socket says 172.21.15.53:60014) 2023-06-10T18:52:21.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:21.104+0000 7f890f7fe640 1 -- 172.21.15.53:0/2868025665 learned_addr learned my addr 172.21.15.53:0/2868025665 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:21.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:21.104+0000 7f890e7fc640 1 --2- 172.21.15.53:0/2868025665 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88f80047d0 0x7f89101543b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:21.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:21.104+0000 7f890effd640 1 --2- 172.21.15.53:0/2868025665 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88f80039b0 0x7f89101f6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:21.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:21.104+0000 7f890f7fe640 1 -- 172.21.15.53:0/2868025665 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88f80047d0 msgr2=0x7f89101543b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:21.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:21.104+0000 7f890f7fe640 1 --2- 172.21.15.53:0/2868025665 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88f80047d0 0x7f89101543b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:21.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:21.104+0000 7f890f7fe640 1 -- 172.21.15.53:0/2868025665 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88f80039b0 msgr2=0x7f89101f6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:21.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:21.104+0000 7f890f7fe640 1 --2- 172.21.15.53:0/2868025665 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88f80039b0 0x7f89101f6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:21.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:21.104+0000 7f890f7fe640 1 -- 172.21.15.53:0/2868025665 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f891015b6c0 con 0x7f88f80051d0 2023-06-10T18:52:21.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:21.104+0000 7f890f7fe640 1 --2- 172.21.15.53:0/2868025665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88f80051d0 0x7f89100b3200 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f89100cf640 tx=0x7f89080046a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:21.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:21.104+0000 7f88f7fff640 1 -- 172.21.15.53:0/2868025665 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8908017650 con 0x7f88f80051d0 2023-06-10T18:52:21.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:21.104+0000 7f88f7fff640 1 -- 172.21.15.53:0/2868025665 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f890800f040 con 0x7f88f80051d0 2023-06-10T18:52:21.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:21.104+0000 7f8915977640 1 -- 172.21.15.53:0/2868025665 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f891015b9a0 con 0x7f88f80051d0 2023-06-10T18:52:21.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:21.104+0000 7f88f7fff640 1 -- 172.21.15.53:0/2868025665 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8908017a30 con 0x7f88f80051d0 2023-06-10T18:52:21.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:21.104+0000 7f8915977640 1 -- 172.21.15.53:0/2868025665 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89100a7fb0 con 0x7f88f80051d0 2023-06-10T18:52:21.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:21.104+0000 7f88f7fff640 1 -- 172.21.15.53:0/2868025665 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f8908023460 con 0x7f88f80051d0 2023-06-10T18:52:21.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:21.104+0000 7f88f7fff640 1 -- 172.21.15.53:0/2868025665 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f8908022490 con 0x7f88f80051d0 2023-06-10T18:52:21.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:21.104+0000 7f8915977640 1 -- 172.21.15.53:0/2868025665 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89100cbd00 con 0x7f88f80051d0 2023-06-10T18:52:21.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:21.108+0000 7f88f7fff640 1 -- 172.21.15.53:0/2868025665 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f89080226a0 con 0x7f88f80051d0 2023-06-10T18:52:21.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:21.172+0000 7f8915977640 1 -- 172.21.15.53:0/2868025665 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f891015bec0 con 0x7f88f80051d0 2023-06-10T18:52:21.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:21.176+0000 7f88f7fff640 1 -- 172.21.15.53:0/2868025665 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f891015bec0 con 0x7f88f80051d0 2023-06-10T18:52:21.187 INFO:teuthology.orchestra.run.smithi053.stderr:adjusted tunables profile to default 2023-06-10T18:52:21.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:21.176+0000 7f8915977640 1 -- 172.21.15.53:0/2868025665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88f80051d0 msgr2=0x7f89100b3200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:21.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:21.176+0000 7f8915977640 1 --2- 172.21.15.53:0/2868025665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88f80051d0 0x7f89100b3200 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f89100cf640 tx=0x7f89080046a0 comp rx=0 tx=0).stop 2023-06-10T18:52:21.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:21.176+0000 7f8915977640 1 -- 172.21.15.53:0/2868025665 shutdown_connections 2023-06-10T18:52:21.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:21.176+0000 7f8915977640 1 --2- 172.21.15.53:0/2868025665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88f80051d0 0x7f89100b3200 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:21.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:21.176+0000 7f8915977640 1 --2- 172.21.15.53:0/2868025665 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88f80047d0 0x7f89101543b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:21.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:21.176+0000 7f8915977640 1 --2- 172.21.15.53:0/2868025665 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88f80039b0 0x7f89101f6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:21.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:21.176+0000 7f8915977640 1 -- 172.21.15.53:0/2868025665 >> 172.21.15.53:0/2868025665 conn(0x7f89100cafc0 msgr2=0x7f89100b1630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:21.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:21.176+0000 7f8915977640 1 -- 172.21.15.53:0/2868025665 shutdown_connections 2023-06-10T18:52:21.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:21.176+0000 7f8915977640 1 -- 172.21.15.53:0/2868025665 wait complete. 2023-06-10T18:52:21.207 INFO:tasks.ceph:check_enable_crimson: False 2023-06-10T18:52:21.207 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-06-10T18:52:21.207 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T18:52:21.208 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-06-10T18:52:21.220 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T18:52:21.221 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-06-10T18:52:21.279 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T18:52:21.279 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-06-10T18:52:21.304 INFO:tasks.ceph.mgr.x.smithi117.stderr:2023-06-10T18:52:21.295+0000 7f28f183f180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-06-10T18:52:21.333 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T18:52:21.333 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-06-10T18:52:21.389 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T18:52:21.389 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-06-10T18:52:21.401 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T18:52:21.401 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-06-10T18:52:21.456 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T18:52:21.456 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-06-10T18:52:21.457 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-06-10T18:52:21.444+0000 7fb19a0b5180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-06-10T18:52:21.507 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T18:52:21.507 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-06-10T18:52:21.559 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new 96556046-db90-4d65-9ada-e415ee0a0990 0 2023-06-10T18:52:21.715 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.707+0000 7f05814cc640 1 Processor -- start 2023-06-10T18:52:21.716 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.707+0000 7f05814cc640 1 -- start start 2023-06-10T18:52:21.717 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.707+0000 7f05814cc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f057c15b870 0x7f057c06a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:21.717 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.707+0000 7f05814cc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f057c0affc0 0x7f057c0b03f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:21.717 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.707+0000 7f05814cc640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f057c06ae70 con 0x7f057c069450 2023-06-10T18:52:21.718 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.707+0000 7f05814cc640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f057c0b0930 con 0x7f057c0affc0 2023-06-10T18:52:21.718 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.707+0000 7f05814cc640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f057c0655c0 con 0x7f057c15b870 2023-06-10T18:52:21.718 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.711+0000 7f057affd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f057c15b870 0x7f057c06a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:21.718 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.711+0000 7f057affd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f057c15b870 0x7f057c06a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.117:56314/0 (socket says 172.21.15.117:56314) 2023-06-10T18:52:21.718 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.711+0000 7f057affd640 1 -- 172.21.15.117:0/685294537 learned_addr learned my addr 172.21.15.117:0/685294537 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-06-10T18:52:21.718 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.711+0000 7f057a7fc640 1 --2- 172.21.15.117:0/685294537 >> v2:172.21.15.53:3300/0 conn(0x7f057c0affc0 0x7f057c0b03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:21.718 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.711+0000 7f057affd640 1 -- 172.21.15.117:0/685294537 >> v2:172.21.15.53:3300/0 conn(0x7f057c0affc0 msgr2=0x7f057c0b03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:21.719 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.711+0000 7f057affd640 1 --2- 172.21.15.117:0/685294537 >> v2:172.21.15.53:3300/0 conn(0x7f057c0affc0 0x7f057c0b03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:21.719 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.711+0000 7f057affd640 1 -- 172.21.15.117:0/685294537 >> v1:172.21.15.53:6789/0 conn(0x7f057c069450 legacy=0x7f057c0698d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:21.719 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.711+0000 7f057affd640 1 -- 172.21.15.117:0/685294537 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f057c0cc110 con 0x7f057c15b870 2023-06-10T18:52:21.719 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.711+0000 7f057a7fc640 1 --2- 172.21.15.117:0/685294537 >> v2:172.21.15.53:3300/0 conn(0x7f057c0affc0 0x7f057c0b03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:52:21.720 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.711+0000 7f057affd640 1 --2- 172.21.15.117:0/685294537 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f057c15b870 0x7f057c06a930 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0570009870 tx=0x7f057001c440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2010da2864822bc0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:21.720 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.711+0000 7f0579ffb640 1 -- 172.21.15.117:0/685294537 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05700ab600 con 0x7f057c15b870 2023-06-10T18:52:21.720 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.711+0000 7f0579ffb640 1 -- 172.21.15.117:0/685294537 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05700a7050 con 0x7f057c15b870 2023-06-10T18:52:21.721 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.711+0000 7f0579ffb640 1 -- 172.21.15.117:0/685294537 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05700ab980 con 0x7f057c15b870 2023-06-10T18:52:21.721 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.711+0000 7f05814cc640 1 -- 172.21.15.117:0/685294537 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f057c15b870 msgr2=0x7f057c06a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:21.721 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.711+0000 7f05814cc640 1 --2- 172.21.15.117:0/685294537 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f057c15b870 0x7f057c06a930 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0570009870 tx=0x7f057001c440 comp rx=0 tx=0).stop 2023-06-10T18:52:21.721 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.711+0000 7f05814cc640 1 -- 172.21.15.117:0/685294537 shutdown_connections 2023-06-10T18:52:21.721 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.711+0000 7f05814cc640 1 --2- 172.21.15.117:0/685294537 >> v2:172.21.15.53:3300/0 conn(0x7f057c0affc0 0x7f057c0b03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:21.721 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.711+0000 7f05814cc640 1 --2- 172.21.15.117:0/685294537 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f057c15b870 0x7f057c06a930 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:21.722 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.711+0000 7f05814cc640 1 -- 172.21.15.117:0/685294537 >> 172.21.15.117:0/685294537 conn(0x7f057c0cafc0 msgr2=0x7f057c0cb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:21.722 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.711+0000 7f05814cc640 1 -- 172.21.15.117:0/685294537 shutdown_connections 2023-06-10T18:52:21.722 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.711+0000 7f05814cc640 1 -- 172.21.15.117:0/685294537 wait complete. 2023-06-10T18:52:21.724 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.715+0000 7f05814cc640 1 Processor -- start 2023-06-10T18:52:21.724 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.715+0000 7f05814cc640 1 -- start start 2023-06-10T18:52:21.724 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.715+0000 7f05814cc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f057c069450 0x7f057c149e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:21.724 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.715+0000 7f05814cc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f057c0affc0 0x7f057c15d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:21.724 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.715+0000 7f05814cc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f057c15b870 0x7f057c1520c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:21.724 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.715+0000 7f05814cc640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f057c15bde0 con 0x7f057c15b870 2023-06-10T18:52:21.725 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.715+0000 7f05814cc640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f057c15c0c0 con 0x7f057c069450 2023-06-10T18:52:21.725 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.715+0000 7f05814cc640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f057c15c3a0 con 0x7f057c0affc0 2023-06-10T18:52:21.725 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.715+0000 7f057a7fc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f057c0affc0 0x7f057c15d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:21.725 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.715+0000 7f057a7fc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f057c0affc0 0x7f057c15d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.117:56326/0 (socket says 172.21.15.117:56326) 2023-06-10T18:52:21.725 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.715+0000 7f057affd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f057c069450 0x7f057c149e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:21.725 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.715+0000 7f057a7fc640 1 -- 172.21.15.117:0/1444775025 learned_addr learned my addr 172.21.15.117:0/1444775025 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-06-10T18:52:21.725 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.715+0000 7f057b7fe640 1 --2- 172.21.15.117:0/1444775025 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f057c15b870 0x7f057c1520c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:21.725 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.715+0000 7f057a7fc640 1 -- 172.21.15.117:0/1444775025 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f057c069450 msgr2=0x7f057c149e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:21.726 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.715+0000 7f057a7fc640 1 --2- 172.21.15.117:0/1444775025 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f057c069450 0x7f057c149e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:21.726 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.715+0000 7f057a7fc640 1 -- 172.21.15.117:0/1444775025 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f057c15b870 msgr2=0x7f057c1520c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:21.726 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.715+0000 7f057a7fc640 1 --2- 172.21.15.117:0/1444775025 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f057c15b870 0x7f057c1520c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:21.726 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.715+0000 7f057a7fc640 1 -- 172.21.15.117:0/1444775025 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05700094d0 con 0x7f057c0affc0 2023-06-10T18:52:21.726 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.715+0000 7f057affd640 1 --2- 172.21.15.117:0/1444775025 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f057c069450 0x7f057c149e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-10T18:52:21.726 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.715+0000 7f057a7fc640 1 --2- 172.21.15.117:0/1444775025 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f057c0affc0 0x7f057c15d490 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f056c00c7f0 tx=0x7f056c00ccb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:21.726 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.715+0000 7f05637fe640 1 -- 172.21.15.117:0/1444775025 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f056c007820 con 0x7f057c0affc0 2023-06-10T18:52:21.727 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.715+0000 7f05637fe640 1 -- 172.21.15.117:0/1444775025 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f056c007980 con 0x7f057c0affc0 2023-06-10T18:52:21.727 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.715+0000 7f05814cc640 1 -- 172.21.15.117:0/1444775025 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f057c15c680 con 0x7f057c0affc0 2023-06-10T18:52:21.727 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.715+0000 7f05637fe640 1 -- 172.21.15.117:0/1444775025 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f056c007d30 con 0x7f057c0affc0 2023-06-10T18:52:21.727 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.715+0000 7f05814cc640 1 -- 172.21.15.117:0/1444775025 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f057c15cfa0 con 0x7f057c0affc0 2023-06-10T18:52:21.727 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.715+0000 7f05637fe640 1 -- 172.21.15.117:0/1444775025 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f056c01a660 con 0x7f057c0affc0 2023-06-10T18:52:21.727 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.715+0000 7f05637fe640 1 -- 172.21.15.117:0/1444775025 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f056c0119e0 con 0x7f057c0affc0 2023-06-10T18:52:21.728 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.715+0000 7f05814cc640 1 -- 172.21.15.117:0/1444775025 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f057c14a380 con 0x7f057c0affc0 2023-06-10T18:52:21.732 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.723+0000 7f05637fe640 1 -- 172.21.15.117:0/1444775025 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f056c039b00 con 0x7f057c0affc0 2023-06-10T18:52:21.783 INFO:tasks.ceph.mgr.x.smithi117.stderr:2023-06-10T18:52:21.775+0000 7f28f183f180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-06-10T18:52:21.799 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.791+0000 7f05814cc640 1 -- 172.21.15.117:0/1444775025 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd new", "uuid": "96556046-db90-4d65-9ada-e415ee0a0990", "id": 0} v 0) v1 -- 0x7f057c04d790 con 0x7f057c0affc0 2023-06-10T18:52:21.807 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.799+0000 7f05637fe640 1 -- 172.21.15.117:0/1444775025 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "96556046-db90-4d65-9ada-e415ee0a0990", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f056c028030 con 0x7f057c0affc0 2023-06-10T18:52:21.808 INFO:teuthology.orchestra.run.smithi117.stdout:0 2023-06-10T18:52:21.809 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.803+0000 7f05814cc640 1 -- 172.21.15.117:0/1444775025 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f057c0affc0 msgr2=0x7f057c15d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:21.809 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.803+0000 7f05814cc640 1 --2- 172.21.15.117:0/1444775025 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f057c0affc0 0x7f057c15d490 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f056c00c7f0 tx=0x7f056c00ccb0 comp rx=0 tx=0).stop 2023-06-10T18:52:21.809 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.803+0000 7f05814cc640 1 -- 172.21.15.117:0/1444775025 shutdown_connections 2023-06-10T18:52:21.809 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.803+0000 7f05814cc640 1 --2- 172.21.15.117:0/1444775025 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f057c15b870 0x7f057c1520c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:21.810 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.803+0000 7f05814cc640 1 --2- 172.21.15.117:0/1444775025 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f057c0affc0 0x7f057c15d490 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:21.810 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.803+0000 7f05814cc640 1 --2- 172.21.15.117:0/1444775025 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f057c069450 0x7f057c149e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:21.810 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.803+0000 7f05814cc640 1 -- 172.21.15.117:0/1444775025 >> 172.21.15.117:0/1444775025 conn(0x7f057c0cafc0 msgr2=0x7f057c0aecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:21.810 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.803+0000 7f05814cc640 1 -- 172.21.15.117:0/1444775025 shutdown_connections 2023-06-10T18:52:21.810 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.803+0000 7f05814cc640 1 -- 172.21.15.117:0/1444775025 wait complete. 2023-06-10T18:52:21.824 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new 09f1ac84-a357-41c6-b200-7a300b2e0650 1 2023-06-10T18:52:21.935 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.927+0000 7f8497bb9640 1 Processor -- start 2023-06-10T18:52:21.935 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.927+0000 7f8497bb9640 1 -- start start 2023-06-10T18:52:21.936 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.927+0000 7f8497bb9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f849006c7d0 0x7f84901586f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:21.937 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.927+0000 7f8497bb9640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f849015c260 con 0x7f849006c400 2023-06-10T18:52:21.937 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.927+0000 7f8497bb9640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f849015c540 con 0x7f84900ccc90 2023-06-10T18:52:21.937 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.927+0000 7f8497bb9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f849015cee0 con 0x7f849006c7d0 2023-06-10T18:52:21.937 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.931+0000 7f8496156640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f84900ccc90 0x7f84900cd130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:52148/0 (socket says 172.21.15.117:52148) 2023-06-10T18:52:21.937 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.931+0000 7f8496156640 1 -- 172.21.15.117:0/454664596 learned_addr learned my addr 172.21.15.117:0/454664596 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-06-10T18:52:21.937 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.931+0000 7f8495154640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f849006c7d0 0x7f84901586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:21.938 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.931+0000 7f8494953640 1 -- 172.21.15.117:0/454664596 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3981813997 0 0) 0x7f849015c540 con 0x7f84900ccc90 2023-06-10T18:52:21.938 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.931+0000 7f8494953640 1 -- 172.21.15.117:0/454664596 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f847c003530 con 0x7f84900ccc90 2023-06-10T18:52:21.938 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.931+0000 7f8495154640 1 -- 172.21.15.117:0/454664596 >> v1:172.21.15.117:6789/0 conn(0x7f84900ccc90 legacy=0x7f84900cd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:21.938 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.931+0000 7f8495154640 1 -- 172.21.15.117:0/454664596 >> v1:172.21.15.53:6789/0 conn(0x7f849006c400 legacy=0x7f8490157fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:21.939 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.931+0000 7f8495154640 1 -- 172.21.15.117:0/454664596 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f849015c820 con 0x7f849006c7d0 2023-06-10T18:52:21.939 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.931+0000 7f8495154640 1 --2- 172.21.15.117:0/454664596 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f849006c7d0 0x7f84901586f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8480009820 tx=0x7f848001c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f3679b40608045a server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:21.939 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.931+0000 7f8494953640 1 -- 172.21.15.117:0/454664596 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84800ab600 con 0x7f849006c7d0 2023-06-10T18:52:21.939 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.931+0000 7f8494953640 1 -- 172.21.15.117:0/454664596 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84800a7050 con 0x7f849006c7d0 2023-06-10T18:52:21.940 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.931+0000 7f8494953640 1 -- 172.21.15.117:0/454664596 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84800ab980 con 0x7f849006c7d0 2023-06-10T18:52:21.940 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.931+0000 7f8497bb9640 1 -- 172.21.15.117:0/454664596 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f849006c7d0 msgr2=0x7f84901586f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:21.940 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.931+0000 7f8497bb9640 1 --2- 172.21.15.117:0/454664596 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f849006c7d0 0x7f84901586f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8480009820 tx=0x7f848001c410 comp rx=0 tx=0).stop 2023-06-10T18:52:21.941 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.931+0000 7f8497bb9640 1 -- 172.21.15.117:0/454664596 shutdown_connections 2023-06-10T18:52:21.941 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.931+0000 7f8497bb9640 1 --2- 172.21.15.117:0/454664596 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f849006c7d0 0x7f84901586f0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:21.941 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.931+0000 7f8497bb9640 1 -- 172.21.15.117:0/454664596 >> 172.21.15.117:0/454664596 conn(0x7f849006a560 msgr2=0x7f849006a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:21.941 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.931+0000 7f8497bb9640 1 -- 172.21.15.117:0/454664596 shutdown_connections 2023-06-10T18:52:21.941 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.931+0000 7f8497bb9640 1 -- 172.21.15.117:0/454664596 wait complete. 2023-06-10T18:52:21.942 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.935+0000 7f8497bb9640 1 Processor -- start 2023-06-10T18:52:21.942 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.935+0000 7f8497bb9640 1 -- start start 2023-06-10T18:52:21.943 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.935+0000 7f8497bb9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f849006c400 0x7f8490146f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:21.943 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.935+0000 7f8497bb9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f849006c7d0 0x7f84900c16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:21.943 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.935+0000 7f8497bb9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84900ccc90 0x7f84900bf8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:21.943 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.935+0000 7f8497bb9640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84900c1250 con 0x7f84900ccc90 2023-06-10T18:52:21.944 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.935+0000 7f8497bb9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84900c0880 con 0x7f849006c7d0 2023-06-10T18:52:21.944 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.935+0000 7f8497bb9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84900c02c0 con 0x7f849006c400 2023-06-10T18:52:21.944 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.935+0000 7f8495955640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f849006c400 0x7f8490146f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:21.944 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.935+0000 7f8495154640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f849006c7d0 0x7f84900c16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:21.944 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.935+0000 7f8495955640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f849006c400 0x7f8490146f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.117:56348/0 (socket says 172.21.15.117:56348) 2023-06-10T18:52:21.944 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.935+0000 7f8495955640 1 -- 172.21.15.117:0/3638922925 learned_addr learned my addr 172.21.15.117:0/3638922925 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-06-10T18:52:21.944 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.935+0000 7f8496156640 1 --2- 172.21.15.117:0/3638922925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84900ccc90 0x7f84900bf8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:21.945 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.935+0000 7f8495955640 1 -- 172.21.15.117:0/3638922925 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f849006c7d0 msgr2=0x7f84900c16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:21.945 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.935+0000 7f8495955640 1 --2- 172.21.15.117:0/3638922925 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f849006c7d0 0x7f84900c16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:21.945 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.935+0000 7f8495955640 1 -- 172.21.15.117:0/3638922925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84900ccc90 msgr2=0x7f84900bf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:21.945 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.935+0000 7f8495955640 1 --2- 172.21.15.117:0/3638922925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84900ccc90 0x7f84900bf8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:21.945 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.935+0000 7f8495955640 1 -- 172.21.15.117:0/3638922925 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8480009420 con 0x7f849006c400 2023-06-10T18:52:21.945 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.935+0000 7f8496156640 1 --2- 172.21.15.117:0/3638922925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84900ccc90 0x7f84900bf8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:52:21.945 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.935+0000 7f8495955640 1 --2- 172.21.15.117:0/3638922925 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f849006c400 0x7f8490146f00 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f848c00c500 tx=0x7f848c00c9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:21.945 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.935+0000 7f84867fc640 1 -- 172.21.15.117:0/3638922925 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848c005220 con 0x7f849006c400 2023-06-10T18:52:21.946 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.935+0000 7f84867fc640 1 -- 172.21.15.117:0/3638922925 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f848c005380 con 0x7f849006c400 2023-06-10T18:52:21.946 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.935+0000 7f84867fc640 1 -- 172.21.15.117:0/3638922925 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848c007270 con 0x7f849006c400 2023-06-10T18:52:21.946 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.935+0000 7f8497bb9640 1 -- 172.21.15.117:0/3638922925 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84900c05a0 con 0x7f849006c400 2023-06-10T18:52:21.946 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.935+0000 7f8497bb9640 1 -- 172.21.15.117:0/3638922925 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84900c1c20 con 0x7f849006c400 2023-06-10T18:52:21.946 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.935+0000 7f84867fc640 1 -- 172.21.15.117:0/3638922925 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f848c0067e0 con 0x7f849006c400 2023-06-10T18:52:21.946 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.935+0000 7f84867fc640 1 -- 172.21.15.117:0/3638922925 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f848c0129a0 con 0x7f849006c400 2023-06-10T18:52:21.947 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.935+0000 7f8497bb9640 1 -- 172.21.15.117:0/3638922925 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f849004d790 con 0x7f849006c400 2023-06-10T18:52:21.947 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:21.939+0000 7f84867fc640 1 -- 172.21.15.117:0/3638922925 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f848c016020 con 0x7f849006c400 2023-06-10T18:52:21.956 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-06-10T18:52:21.944+0000 7fb19a0b5180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-06-10T18:52:21.966 INFO:tasks.ceph.mgr.x.smithi117.stderr:2023-06-10T18:52:21.959+0000 7f28f183f180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-06-10T18:52:22.013 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.007+0000 7f8497bb9640 1 -- 172.21.15.117:0/3638922925 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd new", "uuid": "09f1ac84-a357-41c6-b200-7a300b2e0650", "id": 1} v 0) v1 -- 0x7f84900b4d30 con 0x7f849006c400 2023-06-10T18:52:22.021 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.015+0000 7f84867fc640 1 -- 172.21.15.117:0/3638922925 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "09f1ac84-a357-41c6-b200-7a300b2e0650", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f848c02a0b0 con 0x7f849006c400 2023-06-10T18:52:22.023 INFO:teuthology.orchestra.run.smithi117.stdout:1 2023-06-10T18:52:22.024 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.015+0000 7f8497bb9640 1 -- 172.21.15.117:0/3638922925 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f849006c400 msgr2=0x7f8490146f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:22.025 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.015+0000 7f8497bb9640 1 --2- 172.21.15.117:0/3638922925 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f849006c400 0x7f8490146f00 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f848c00c500 tx=0x7f848c00c9c0 comp rx=0 tx=0).stop 2023-06-10T18:52:22.025 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.015+0000 7f8497bb9640 1 -- 172.21.15.117:0/3638922925 shutdown_connections 2023-06-10T18:52:22.025 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.015+0000 7f8497bb9640 1 --2- 172.21.15.117:0/3638922925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84900ccc90 0x7f84900bf8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:22.026 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.015+0000 7f8497bb9640 1 --2- 172.21.15.117:0/3638922925 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f849006c7d0 0x7f84900c16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:22.026 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.015+0000 7f8497bb9640 1 --2- 172.21.15.117:0/3638922925 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f849006c400 0x7f8490146f00 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:22.026 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.015+0000 7f8497bb9640 1 -- 172.21.15.117:0/3638922925 >> 172.21.15.117:0/3638922925 conn(0x7f849006a560 msgr2=0x7f849015ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:22.027 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.015+0000 7f8497bb9640 1 -- 172.21.15.117:0/3638922925 shutdown_connections 2023-06-10T18:52:22.027 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.015+0000 7f8497bb9640 1 -- 172.21.15.117:0/3638922925 wait complete. 2023-06-10T18:52:22.038 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new 42d95fe8-549b-40d4-bdd3-4a17a6fbb729 2 2023-06-10T18:52:22.144 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-06-10T18:52:22.132+0000 7fb19a0b5180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-06-10T18:52:22.155 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.147+0000 7fde625e2640 1 Processor -- start 2023-06-10T18:52:22.155 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.147+0000 7fde625e2640 1 -- start start 2023-06-10T18:52:22.156 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.147+0000 7fde625e2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde5c06b780 0x7fde5c15c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:22.157 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.147+0000 7fde625e2640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fde5c0ceb20 0x7fde5c0cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:22.157 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.147+0000 7fde625e2640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde5c0af530 con 0x7fde5c06bb50 2023-06-10T18:52:22.157 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.147+0000 7fde625e2640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde5c15c3d0 con 0x7fde5c0ceb20 2023-06-10T18:52:22.157 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.147+0000 7fde625e2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde5c15fd70 con 0x7fde5c06b780 2023-06-10T18:52:22.157 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.147+0000 7fde5bfff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde5c06b780 0x7fde5c15c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:22.157 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.147+0000 7fde5bfff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde5c06b780 0x7fde5c15c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.117:56358/0 (socket says 172.21.15.117:56358) 2023-06-10T18:52:22.157 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.147+0000 7fde5bfff640 1 -- 172.21.15.117:0/3676493040 learned_addr learned my addr 172.21.15.117:0/3676493040 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-06-10T18:52:22.158 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.147+0000 7fde60b7f640 1 --2- 172.21.15.117:0/3676493040 >> v2:172.21.15.53:3300/0 conn(0x7fde5c0ceb20 0x7fde5c0cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:22.158 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.147+0000 7fde5bfff640 1 -- 172.21.15.117:0/3676493040 >> v2:172.21.15.53:3300/0 conn(0x7fde5c0ceb20 msgr2=0x7fde5c0cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:22.158 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.147+0000 7fde5bfff640 1 --2- 172.21.15.117:0/3676493040 >> v2:172.21.15.53:3300/0 conn(0x7fde5c0ceb20 0x7fde5c0cefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:22.158 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.147+0000 7fde5bfff640 1 -- 172.21.15.117:0/3676493040 >> v1:172.21.15.53:6789/0 conn(0x7fde5c06bb50 legacy=0x7fde5c15f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:22.158 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.147+0000 7fde5bfff640 1 -- 172.21.15.117:0/3676493040 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde5c160050 con 0x7fde5c06b780 2023-06-10T18:52:22.159 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.151+0000 7fde5bfff640 1 --2- 172.21.15.117:0/3676493040 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde5c06b780 0x7fde5c15c7f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fde4c009870 tx=0x7fde4c01c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2e5afac9f4dc83d server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:22.159 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.151+0000 7fde5b7fe640 1 -- 172.21.15.117:0/3676493040 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4c0ab600 con 0x7fde5c06b780 2023-06-10T18:52:22.159 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.151+0000 7fde5b7fe640 1 -- 172.21.15.117:0/3676493040 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde4c0a7050 con 0x7fde5c06b780 2023-06-10T18:52:22.160 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.151+0000 7fde5b7fe640 1 -- 172.21.15.117:0/3676493040 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4c0ab980 con 0x7fde5c06b780 2023-06-10T18:52:22.160 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.151+0000 7fde625e2640 1 -- 172.21.15.117:0/3676493040 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde5c06b780 msgr2=0x7fde5c15c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:22.160 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.151+0000 7fde625e2640 1 --2- 172.21.15.117:0/3676493040 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde5c06b780 0x7fde5c15c7f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fde4c009870 tx=0x7fde4c01c470 comp rx=0 tx=0).stop 2023-06-10T18:52:22.160 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.151+0000 7fde625e2640 1 -- 172.21.15.117:0/3676493040 shutdown_connections 2023-06-10T18:52:22.160 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.151+0000 7fde625e2640 1 --2- 172.21.15.117:0/3676493040 >> v2:172.21.15.53:3300/0 conn(0x7fde5c0ceb20 0x7fde5c0cefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:22.160 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.151+0000 7fde625e2640 1 --2- 172.21.15.117:0/3676493040 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde5c06b780 0x7fde5c15c7f0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:22.161 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.151+0000 7fde625e2640 1 -- 172.21.15.117:0/3676493040 >> 172.21.15.117:0/3676493040 conn(0x7fde5c06a090 msgr2=0x7fde5c06d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:22.161 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.151+0000 7fde625e2640 1 -- 172.21.15.117:0/3676493040 shutdown_connections 2023-06-10T18:52:22.161 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.151+0000 7fde625e2640 1 -- 172.21.15.117:0/3676493040 wait complete. 2023-06-10T18:52:22.163 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.151+0000 7fde625e2640 1 Processor -- start 2023-06-10T18:52:22.163 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.151+0000 7fde625e2640 1 -- start start 2023-06-10T18:52:22.163 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.155+0000 7fde625e2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde5c06b780 0x7fde5c153410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:22.163 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.155+0000 7fde625e2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde5c06bb50 0x7fde5c0b3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:22.163 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.155+0000 7fde625e2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde5c0ceb20 0x7fde5c154bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:22.163 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.155+0000 7fde625e2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde5c153950 con 0x7fde5c06bb50 2023-06-10T18:52:22.163 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.155+0000 7fde625e2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde5c153b20 con 0x7fde5c0ceb20 2023-06-10T18:52:22.164 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.155+0000 7fde625e2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde5c153e00 con 0x7fde5c06b780 2023-06-10T18:52:22.164 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.155+0000 7fde5bfff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde5c06b780 0x7fde5c153410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:22.164 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.155+0000 7fde5bfff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde5c06b780 0x7fde5c153410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.117:56372/0 (socket says 172.21.15.117:56372) 2023-06-10T18:52:22.164 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.155+0000 7fde60b7f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde5c0ceb20 0x7fde5c154bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:22.164 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.155+0000 7fde5bfff640 1 -- 172.21.15.117:0/1653951576 learned_addr learned my addr 172.21.15.117:0/1653951576 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-06-10T18:52:22.164 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.155+0000 7fde53fff640 1 --2- 172.21.15.117:0/1653951576 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde5c06bb50 0x7fde5c0b3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:22.164 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.155+0000 7fde5bfff640 1 -- 172.21.15.117:0/1653951576 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde5c0ceb20 msgr2=0x7fde5c154bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:22.165 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.155+0000 7fde5bfff640 1 --2- 172.21.15.117:0/1653951576 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde5c0ceb20 0x7fde5c154bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:22.165 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.155+0000 7fde5bfff640 1 -- 172.21.15.117:0/1653951576 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde5c06bb50 msgr2=0x7fde5c0b3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:22.165 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.155+0000 7fde5bfff640 1 --2- 172.21.15.117:0/1653951576 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde5c06bb50 0x7fde5c0b3d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:22.165 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.155+0000 7fde5bfff640 1 -- 172.21.15.117:0/1653951576 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde4c0094d0 con 0x7fde5c06b780 2023-06-10T18:52:22.165 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.155+0000 7fde53fff640 1 --2- 172.21.15.117:0/1653951576 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde5c06bb50 0x7fde5c0b3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:52:22.165 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.155+0000 7fde60b7f640 1 --2- 172.21.15.117:0/1653951576 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde5c0ceb20 0x7fde5c154bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-10T18:52:22.165 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.155+0000 7fde5bfff640 1 --2- 172.21.15.117:0/1653951576 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde5c06b780 0x7fde5c153410 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fde4c01cd10 tx=0x7fde4c019210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:22.165 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.155+0000 7fde597fa640 1 -- 172.21.15.117:0/1653951576 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4c0b37d0 con 0x7fde5c06b780 2023-06-10T18:52:22.166 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.155+0000 7fde597fa640 1 -- 172.21.15.117:0/1653951576 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde4c0b3930 con 0x7fde5c06b780 2023-06-10T18:52:22.166 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.155+0000 7fde625e2640 1 -- 172.21.15.117:0/1653951576 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde5c1540e0 con 0x7fde5c06b780 2023-06-10T18:52:22.166 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.155+0000 7fde597fa640 1 -- 172.21.15.117:0/1653951576 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4c0b3cc0 con 0x7fde5c06b780 2023-06-10T18:52:22.166 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.155+0000 7fde625e2640 1 -- 172.21.15.117:0/1653951576 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde5c1546a0 con 0x7fde5c06b780 2023-06-10T18:52:22.166 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.155+0000 7fde597fa640 1 -- 172.21.15.117:0/1653951576 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fde4c0b2070 con 0x7fde5c06b780 2023-06-10T18:52:22.166 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.155+0000 7fde597fa640 1 -- 172.21.15.117:0/1653951576 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fde4c0b3e20 con 0x7fde5c06b780 2023-06-10T18:52:22.166 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.155+0000 7fde625e2640 1 -- 172.21.15.117:0/1653951576 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde5c06bf80 con 0x7fde5c06b780 2023-06-10T18:52:22.167 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.159+0000 7fde597fa640 1 -- 172.21.15.117:0/1653951576 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fde5c06bf80 con 0x7fde5c06b780 2023-06-10T18:52:22.233 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.227+0000 7fde625e2640 1 -- 172.21.15.117:0/1653951576 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd new", "uuid": "42d95fe8-549b-40d4-bdd3-4a17a6fbb729", "id": 2} v 0) v1 -- 0x7fde5c04d790 con 0x7fde5c06b780 2023-06-10T18:52:22.239 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.231+0000 7fde597fa640 1 -- 172.21.15.117:0/1653951576 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "42d95fe8-549b-40d4-bdd3-4a17a6fbb729", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fde4c0b0070 con 0x7fde5c06b780 2023-06-10T18:52:22.240 INFO:teuthology.orchestra.run.smithi117.stdout:2 2023-06-10T18:52:22.241 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.231+0000 7fde625e2640 1 -- 172.21.15.117:0/1653951576 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde5c06b780 msgr2=0x7fde5c153410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:22.241 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.235+0000 7fde625e2640 1 --2- 172.21.15.117:0/1653951576 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde5c06b780 0x7fde5c153410 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fde4c01cd10 tx=0x7fde4c019210 comp rx=0 tx=0).stop 2023-06-10T18:52:22.241 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.235+0000 7fde625e2640 1 -- 172.21.15.117:0/1653951576 shutdown_connections 2023-06-10T18:52:22.241 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.235+0000 7fde625e2640 1 --2- 172.21.15.117:0/1653951576 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde5c0ceb20 0x7fde5c154bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:22.241 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.235+0000 7fde625e2640 1 --2- 172.21.15.117:0/1653951576 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde5c06bb50 0x7fde5c0b3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:22.241 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.235+0000 7fde625e2640 1 --2- 172.21.15.117:0/1653951576 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde5c06b780 0x7fde5c153410 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:22.242 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.235+0000 7fde625e2640 1 -- 172.21.15.117:0/1653951576 >> 172.21.15.117:0/1653951576 conn(0x7fde5c06a090 msgr2=0x7fde5c15e640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:22.242 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.235+0000 7fde625e2640 1 -- 172.21.15.117:0/1653951576 shutdown_connections 2023-06-10T18:52:22.242 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.235+0000 7fde625e2640 1 -- 172.21.15.117:0/1653951576 wait complete. 2023-06-10T18:52:22.255 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new 74802362-5157-494d-a04a-661be6f4a802 3 2023-06-10T18:52:22.373 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.363+0000 7f1d6d03b640 1 Processor -- start 2023-06-10T18:52:22.373 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.367+0000 7f1d6d03b640 1 -- start start 2023-06-10T18:52:22.374 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.367+0000 7f1d6d03b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1d6806a110 0x7f1d680caee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:22.375 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.367+0000 7f1d6d03b640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d68158520 con 0x7f1d68158150 2023-06-10T18:52:22.375 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.367+0000 7f1d6d03b640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d680cb8a0 con 0x7f1d680cb420 2023-06-10T18:52:22.375 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.367+0000 7f1d6d03b640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d6806f8c0 con 0x7f1d6806a110 2023-06-10T18:52:22.375 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.367+0000 7f1d6759e640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f1d680cb420 0x7f1d680cd220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:52160/0 (socket says 172.21.15.117:52160) 2023-06-10T18:52:22.375 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.367+0000 7f1d6759e640 1 -- 172.21.15.117:0/3274376697 learned_addr learned my addr 172.21.15.117:0/3274376697 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-06-10T18:52:22.375 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.367+0000 7f1d5e59c640 1 --2- 172.21.15.117:0/3274376697 >> v2:172.21.15.117:3300/0 conn(0x7f1d6806a110 0x7f1d680caee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:22.375 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.367+0000 7f1d6659c640 1 -- 172.21.15.117:0/3274376697 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1999346178 0 0) 0x7f1d680cb8a0 con 0x7f1d680cb420 2023-06-10T18:52:22.376 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.367+0000 7f1d6659c640 1 -- 172.21.15.117:0/3274376697 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d54004640 con 0x7f1d680cb420 2023-06-10T18:52:22.376 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.367+0000 7f1d5e59c640 1 -- 172.21.15.117:0/3274376697 >> v1:172.21.15.117:6789/0 conn(0x7f1d680cb420 legacy=0x7f1d680cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:22.376 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.367+0000 7f1d5e59c640 1 -- 172.21.15.117:0/3274376697 >> v1:172.21.15.53:6789/0 conn(0x7f1d68158150 legacy=0x7f1d680c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:22.376 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.367+0000 7f1d5e59c640 1 -- 172.21.15.117:0/3274376697 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d680c93f0 con 0x7f1d6806a110 2023-06-10T18:52:22.377 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.371+0000 7f1d5e59c640 1 --2- 172.21.15.117:0/3274376697 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d6806a110 0x7f1d680caee0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1d500097c0 tx=0x7f1d5001c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a964ba85829d79a server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:22.377 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.371+0000 7f1d6659c640 1 -- 172.21.15.117:0/3274376697 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d500a8050 con 0x7f1d6806a110 2023-06-10T18:52:22.377 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.371+0000 7f1d6659c640 1 -- 172.21.15.117:0/3274376697 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d500ac5f0 con 0x7f1d6806a110 2023-06-10T18:52:22.377 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.371+0000 7f1d6659c640 1 -- 172.21.15.117:0/3274376697 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d500ac980 con 0x7f1d6806a110 2023-06-10T18:52:22.378 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.371+0000 7f1d6d03b640 1 -- 172.21.15.117:0/3274376697 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d6806a110 msgr2=0x7f1d680caee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:22.378 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.371+0000 7f1d6d03b640 1 --2- 172.21.15.117:0/3274376697 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d6806a110 0x7f1d680caee0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1d500097c0 tx=0x7f1d5001c410 comp rx=0 tx=0).stop 2023-06-10T18:52:22.378 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.371+0000 7f1d6d03b640 1 -- 172.21.15.117:0/3274376697 shutdown_connections 2023-06-10T18:52:22.378 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.371+0000 7f1d6d03b640 1 --2- 172.21.15.117:0/3274376697 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d6806a110 0x7f1d680caee0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:22.378 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.371+0000 7f1d6d03b640 1 -- 172.21.15.117:0/3274376697 >> 172.21.15.117:0/3274376697 conn(0x7f1d680b00a0 msgr2=0x7f1d680b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:22.379 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.371+0000 7f1d6d03b640 1 -- 172.21.15.117:0/3274376697 shutdown_connections 2023-06-10T18:52:22.379 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.371+0000 7f1d6d03b640 1 -- 172.21.15.117:0/3274376697 wait complete. 2023-06-10T18:52:22.380 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.371+0000 7f1d6d03b640 1 Processor -- start 2023-06-10T18:52:22.380 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.371+0000 7f1d6d03b640 1 -- start start 2023-06-10T18:52:22.380 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.371+0000 7f1d6d03b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d6806a110 0x7f1d68071560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:22.380 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.371+0000 7f1d6d03b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d680cb420 0x7f1d6814faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:22.381 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.371+0000 7f1d6d03b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1d68158150 0x7f1d6806fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:22.381 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.371+0000 7f1d6d03b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d680704c0 con 0x7f1d68158150 2023-06-10T18:52:22.381 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.371+0000 7f1d6d03b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d680707a0 con 0x7f1d6806a110 2023-06-10T18:52:22.381 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.371+0000 7f1d6d03b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d68070a80 con 0x7f1d680cb420 2023-06-10T18:52:22.381 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.371+0000 7f1d5e59c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d680cb420 0x7f1d6814faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:22.381 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.371+0000 7f1d66d9d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d6806a110 0x7f1d68071560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:22.382 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.371+0000 7f1d5e59c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d680cb420 0x7f1d6814faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.117:56382/0 (socket says 172.21.15.117:56382) 2023-06-10T18:52:22.382 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.371+0000 7f1d66d9d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d6806a110 0x7f1d68071560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:42244/0 (socket says 172.21.15.117:42244) 2023-06-10T18:52:22.382 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.371+0000 7f1d5e59c640 1 -- 172.21.15.117:0/1269080710 learned_addr learned my addr 172.21.15.117:0/1269080710 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-06-10T18:52:22.382 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.371+0000 7f1d6759e640 1 --2- 172.21.15.117:0/1269080710 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1d68158150 0x7f1d6806fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:22.382 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.371+0000 7f1d5e59c640 1 -- 172.21.15.117:0/1269080710 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d6806a110 msgr2=0x7f1d68071560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:22.382 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.371+0000 7f1d5e59c640 1 --2- 172.21.15.117:0/1269080710 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d6806a110 0x7f1d68071560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:22.382 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.371+0000 7f1d5e59c640 1 -- 172.21.15.117:0/1269080710 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1d68158150 msgr2=0x7f1d6806fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:22.383 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.371+0000 7f1d5e59c640 1 --2- 172.21.15.117:0/1269080710 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1d68158150 0x7f1d6806fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:22.383 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.371+0000 7f1d5e59c640 1 -- 172.21.15.117:0/1269080710 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d50009420 con 0x7f1d680cb420 2023-06-10T18:52:22.383 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.371+0000 7f1d66d9d640 1 --2- 172.21.15.117:0/1269080710 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d6806a110 0x7f1d68071560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-10T18:52:22.383 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.371+0000 7f1d6759e640 1 --2- 172.21.15.117:0/1269080710 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1d68158150 0x7f1d6806fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:52:22.383 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.371+0000 7f1d5e59c640 1 --2- 172.21.15.117:0/1269080710 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d680cb420 0x7f1d6814faf0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1d500af040 tx=0x7f1d500191b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:22.384 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.371+0000 7f1d5ffff640 1 -- 172.21.15.117:0/1269080710 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d500a8040 con 0x7f1d680cb420 2023-06-10T18:52:22.384 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.371+0000 7f1d5ffff640 1 -- 172.21.15.117:0/1269080710 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d500ace40 con 0x7f1d680cb420 2023-06-10T18:52:22.384 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.371+0000 7f1d6d03b640 1 -- 172.21.15.117:0/1269080710 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d68070d60 con 0x7f1d680cb420 2023-06-10T18:52:22.384 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.371+0000 7f1d5ffff640 1 -- 172.21.15.117:0/1269080710 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d500b5880 con 0x7f1d680cb420 2023-06-10T18:52:22.385 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.371+0000 7f1d6d03b640 1 -- 172.21.15.117:0/1269080710 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d680b3c20 con 0x7f1d680cb420 2023-06-10T18:52:22.385 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.375+0000 7f1d5ffff640 1 -- 172.21.15.117:0/1269080710 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f1d500b3040 con 0x7f1d680cb420 2023-06-10T18:52:22.385 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.375+0000 7f1d5ffff640 1 -- 172.21.15.117:0/1269080710 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f1d500ab390 con 0x7f1d680cb420 2023-06-10T18:52:22.385 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.375+0000 7f1d6d03b640 1 -- 172.21.15.117:0/1269080710 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d6804d790 con 0x7f1d680cb420 2023-06-10T18:52:22.385 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.375+0000 7f1d5ffff640 1 -- 172.21.15.117:0/1269080710 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f1d500c3060 con 0x7f1d680cb420 2023-06-10T18:52:22.450 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.443+0000 7f1d6d03b640 1 -- 172.21.15.117:0/1269080710 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd new", "uuid": "74802362-5157-494d-a04a-661be6f4a802", "id": 3} v 0) v1 -- 0x7f1d68071210 con 0x7f1d680cb420 2023-06-10T18:52:22.457 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.451+0000 7f1d5ffff640 1 -- 172.21.15.117:0/1269080710 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "74802362-5157-494d-a04a-661be6f4a802", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1d500b9070 con 0x7f1d680cb420 2023-06-10T18:52:22.457 INFO:teuthology.orchestra.run.smithi117.stdout:3 2023-06-10T18:52:22.458 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.451+0000 7f1d6d03b640 1 -- 172.21.15.117:0/1269080710 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d680cb420 msgr2=0x7f1d6814faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:22.458 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.451+0000 7f1d6d03b640 1 --2- 172.21.15.117:0/1269080710 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d680cb420 0x7f1d6814faf0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1d500af040 tx=0x7f1d500191b0 comp rx=0 tx=0).stop 2023-06-10T18:52:22.459 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.451+0000 7f1d6d03b640 1 -- 172.21.15.117:0/1269080710 shutdown_connections 2023-06-10T18:52:22.459 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.451+0000 7f1d6d03b640 1 --2- 172.21.15.117:0/1269080710 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1d68158150 0x7f1d6806fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:22.459 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.451+0000 7f1d6d03b640 1 --2- 172.21.15.117:0/1269080710 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d680cb420 0x7f1d6814faf0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:22.459 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.451+0000 7f1d6d03b640 1 --2- 172.21.15.117:0/1269080710 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d6806a110 0x7f1d68071560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:22.459 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.451+0000 7f1d6d03b640 1 -- 172.21.15.117:0/1269080710 >> 172.21.15.117:0/1269080710 conn(0x7f1d680b00a0 msgr2=0x7f1d680b0470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:22.459 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.451+0000 7f1d6d03b640 1 -- 172.21.15.117:0/1269080710 shutdown_connections 2023-06-10T18:52:22.459 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.451+0000 7f1d6d03b640 1 -- 172.21.15.117:0/1269080710 wait complete. 2023-06-10T18:52:22.475 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new 21e7d693-ea15-42f4-8047-fa5bd40de030 4 2023-06-10T18:52:22.550 INFO:tasks.ceph.mgr.x.smithi117.stderr:2023-06-10T18:52:22.543+0000 7f28f183f180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-06-10T18:52:22.591 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.583+0000 7fa57206c640 1 Processor -- start 2023-06-10T18:52:22.592 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.583+0000 7fa57206c640 1 -- start start 2023-06-10T18:52:22.592 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.583+0000 7fa57206c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa56c06c400 0x7fa56c157fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:22.593 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.583+0000 7fa57206c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa56c0ccc90 0x7fa56c0cd130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:22.593 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.583+0000 7fa57206c640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa56c15c260 con 0x7fa56c06c7d0 2023-06-10T18:52:22.593 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.583+0000 7fa57206c640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa56c15cee0 con 0x7fa56c06c400 2023-06-10T18:52:22.593 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.583+0000 7fa57206c640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa56c15c540 con 0x7fa56c0ccc90 2023-06-10T18:52:22.593 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.587+0000 7fa56affd640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fa56c06c7d0 0x7fa56c158520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:52166/0 (socket says 172.21.15.117:52166) 2023-06-10T18:52:22.593 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.587+0000 7fa56affd640 1 -- 172.21.15.117:0/2190952022 learned_addr learned my addr 172.21.15.117:0/2190952022 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-06-10T18:52:22.593 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.587+0000 7fa56bfff640 1 --2- 172.21.15.117:0/2190952022 >> v2:172.21.15.117:3300/0 conn(0x7fa56c0ccc90 0x7fa56c0cd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:22.594 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.587+0000 7fa56b7fe640 1 --2- 172.21.15.117:0/2190952022 >> v2:172.21.15.53:3300/0 conn(0x7fa56c06c400 0x7fa56c157fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:22.595 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.587+0000 7fa56bfff640 1 -- 172.21.15.117:0/2190952022 >> v2:172.21.15.53:3300/0 conn(0x7fa56c06c400 msgr2=0x7fa56c157fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:22.595 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.587+0000 7fa56bfff640 1 --2- 172.21.15.117:0/2190952022 >> v2:172.21.15.53:3300/0 conn(0x7fa56c06c400 0x7fa56c157fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:22.595 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.587+0000 7fa56bfff640 1 -- 172.21.15.117:0/2190952022 >> v1:172.21.15.117:6789/0 conn(0x7fa56c06c7d0 legacy=0x7fa56c158520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:22.595 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.587+0000 7fa56bfff640 1 -- 172.21.15.117:0/2190952022 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa56c15c820 con 0x7fa56c0ccc90 2023-06-10T18:52:22.595 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.587+0000 7fa56b7fe640 1 --2- 172.21.15.117:0/2190952022 >> v2:172.21.15.53:3300/0 conn(0x7fa56c06c400 0x7fa56c157fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:52:22.596 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.587+0000 7fa56bfff640 1 --2- 172.21.15.117:0/2190952022 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa56c0ccc90 0x7fa56c0cd130 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa56c0ce780 tx=0x7fa55c01c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9cc30e56a0bb167e server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:22.596 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.587+0000 7fa56a7fc640 1 -- 172.21.15.117:0/2190952022 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55c0ab600 con 0x7fa56c0ccc90 2023-06-10T18:52:22.596 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.587+0000 7fa56a7fc640 1 -- 172.21.15.117:0/2190952022 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa55c0a7050 con 0x7fa56c0ccc90 2023-06-10T18:52:22.597 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.587+0000 7fa56a7fc640 1 -- 172.21.15.117:0/2190952022 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55c0ab980 con 0x7fa56c0ccc90 2023-06-10T18:52:22.597 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.587+0000 7fa57206c640 1 -- 172.21.15.117:0/2190952022 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa56c0ccc90 msgr2=0x7fa56c0cd130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:22.597 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.587+0000 7fa57206c640 1 --2- 172.21.15.117:0/2190952022 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa56c0ccc90 0x7fa56c0cd130 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa56c0ce780 tx=0x7fa55c01c3a0 comp rx=0 tx=0).stop 2023-06-10T18:52:22.597 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.587+0000 7fa57206c640 1 -- 172.21.15.117:0/2190952022 shutdown_connections 2023-06-10T18:52:22.597 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.587+0000 7fa57206c640 1 --2- 172.21.15.117:0/2190952022 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa56c0ccc90 0x7fa56c0cd130 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:22.597 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.587+0000 7fa57206c640 1 --2- 172.21.15.117:0/2190952022 >> v2:172.21.15.53:3300/0 conn(0x7fa56c06c400 0x7fa56c157fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:22.597 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.587+0000 7fa57206c640 1 -- 172.21.15.117:0/2190952022 >> 172.21.15.117:0/2190952022 conn(0x7fa56c06a560 msgr2=0x7fa56c06a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:22.598 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.587+0000 7fa57206c640 1 -- 172.21.15.117:0/2190952022 shutdown_connections 2023-06-10T18:52:22.598 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.587+0000 7fa57206c640 1 -- 172.21.15.117:0/2190952022 wait complete. 2023-06-10T18:52:22.599 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.591+0000 7fa57206c640 1 Processor -- start 2023-06-10T18:52:22.600 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.591+0000 7fa57206c640 1 -- start start 2023-06-10T18:52:22.600 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.591+0000 7fa57206c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa56c06c400 0x7fa56c0b10b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:22.600 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.591+0000 7fa57206c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa56c06c7d0 0x7fa56c1f7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:22.600 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.591+0000 7fa57206c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa56c0ccc90 0x7fa56c149e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:22.600 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.591+0000 7fa57206c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa56c151ef0 con 0x7fa56c06c400 2023-06-10T18:52:22.600 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.591+0000 7fa57206c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa56c0c51f0 con 0x7fa56c06c7d0 2023-06-10T18:52:22.600 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.591+0000 7fa57206c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa56c0c4950 con 0x7fa56c0ccc90 2023-06-10T18:52:22.601 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.591+0000 7fa56affd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa56c06c7d0 0x7fa56c1f7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:22.601 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.591+0000 7fa56affd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa56c06c7d0 0x7fa56c1f7470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:42262/0 (socket says 172.21.15.117:42262) 2023-06-10T18:52:22.601 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.591+0000 7fa56affd640 1 -- 172.21.15.117:0/2117330589 learned_addr learned my addr 172.21.15.117:0/2117330589 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-06-10T18:52:22.601 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.591+0000 7fa56bfff640 1 --2- 172.21.15.117:0/2117330589 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa56c0ccc90 0x7fa56c149e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:22.601 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.591+0000 7fa56b7fe640 1 --2- 172.21.15.117:0/2117330589 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa56c06c400 0x7fa56c0b10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:22.601 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.591+0000 7fa56affd640 1 -- 172.21.15.117:0/2117330589 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa56c0ccc90 msgr2=0x7fa56c149e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:22.601 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.591+0000 7fa56affd640 1 --2- 172.21.15.117:0/2117330589 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa56c0ccc90 0x7fa56c149e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:22.601 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.591+0000 7fa56affd640 1 -- 172.21.15.117:0/2117330589 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa56c06c400 msgr2=0x7fa56c0b10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:22.602 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.591+0000 7fa56affd640 1 --2- 172.21.15.117:0/2117330589 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa56c06c400 0x7fa56c0b10b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:22.602 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.591+0000 7fa56affd640 1 -- 172.21.15.117:0/2117330589 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa55c009420 con 0x7fa56c06c7d0 2023-06-10T18:52:22.602 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.591+0000 7fa56affd640 1 --2- 172.21.15.117:0/2117330589 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa56c06c7d0 0x7fa56c1f7470 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa56000c500 tx=0x7fa56000c9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:22.602 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.591+0000 7fa553fff640 1 -- 172.21.15.117:0/2117330589 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa560005cf0 con 0x7fa56c06c7d0 2023-06-10T18:52:22.602 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.591+0000 7fa553fff640 1 -- 172.21.15.117:0/2117330589 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa560005e50 con 0x7fa56c06c7d0 2023-06-10T18:52:22.602 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.591+0000 7fa553fff640 1 -- 172.21.15.117:0/2117330589 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5600072f0 con 0x7fa56c06c7d0 2023-06-10T18:52:22.602 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.591+0000 7fa57206c640 1 -- 172.21.15.117:0/2117330589 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa56c0c4c30 con 0x7fa56c06c7d0 2023-06-10T18:52:22.602 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.591+0000 7fa57206c640 1 -- 172.21.15.117:0/2117330589 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa56c0b15f0 con 0x7fa56c06c7d0 2023-06-10T18:52:22.603 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.591+0000 7fa553fff640 1 -- 172.21.15.117:0/2117330589 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa56001c440 con 0x7fa56c06c7d0 2023-06-10T18:52:22.603 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.591+0000 7fa553fff640 1 -- 172.21.15.117:0/2117330589 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fa560012910 con 0x7fa56c06c7d0 2023-06-10T18:52:22.603 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.591+0000 7fa57206c640 1 -- 172.21.15.117:0/2117330589 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa56c152030 con 0x7fa56c06c7d0 2023-06-10T18:52:22.603 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.595+0000 7fa553fff640 1 -- 172.21.15.117:0/2117330589 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fa56c152030 con 0x7fa56c06c7d0 2023-06-10T18:52:22.607 INFO:tasks.ceph.mgr.x.smithi117.stderr:2023-06-10T18:52:22.599+0000 7f28f183f180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-06-10T18:52:22.660 INFO:tasks.ceph.mgr.x.smithi117.stderr:2023-06-10T18:52:22.651+0000 7f28f183f180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-06-10T18:52:22.669 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.663+0000 7fa57206c640 1 -- 172.21.15.117:0/2117330589 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd new", "uuid": "21e7d693-ea15-42f4-8047-fa5bd40de030", "id": 4} v 0) v1 -- 0x7fa56c04d790 con 0x7fa56c06c7d0 2023-06-10T18:52:22.677 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.671+0000 7fa553fff640 1 -- 172.21.15.117:0/2117330589 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "21e7d693-ea15-42f4-8047-fa5bd40de030", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa560021060 con 0x7fa56c06c7d0 2023-06-10T18:52:22.677 INFO:teuthology.orchestra.run.smithi117.stdout:4 2023-06-10T18:52:22.678 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.671+0000 7fa57206c640 1 -- 172.21.15.117:0/2117330589 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa56c06c7d0 msgr2=0x7fa56c1f7470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:22.678 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.671+0000 7fa57206c640 1 --2- 172.21.15.117:0/2117330589 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa56c06c7d0 0x7fa56c1f7470 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa56000c500 tx=0x7fa56000c9c0 comp rx=0 tx=0).stop 2023-06-10T18:52:22.679 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.671+0000 7fa57206c640 1 -- 172.21.15.117:0/2117330589 shutdown_connections 2023-06-10T18:52:22.679 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.671+0000 7fa57206c640 1 --2- 172.21.15.117:0/2117330589 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa56c0ccc90 0x7fa56c149e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:22.679 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.671+0000 7fa57206c640 1 --2- 172.21.15.117:0/2117330589 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa56c06c7d0 0x7fa56c1f7470 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:22.679 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.671+0000 7fa57206c640 1 --2- 172.21.15.117:0/2117330589 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa56c06c400 0x7fa56c0b10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:22.679 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.671+0000 7fa57206c640 1 -- 172.21.15.117:0/2117330589 >> 172.21.15.117:0/2117330589 conn(0x7fa56c06a560 msgr2=0x7fa56c0cad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:22.679 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.671+0000 7fa57206c640 1 -- 172.21.15.117:0/2117330589 shutdown_connections 2023-06-10T18:52:22.679 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.671+0000 7fa57206c640 1 -- 172.21.15.117:0/2117330589 wait complete. 2023-06-10T18:52:22.693 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new 222cc807-6586-4c9f-b77b-c50f39939699 5 2023-06-10T18:52:22.721 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-06-10T18:52:22.712+0000 7fb19a0b5180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-06-10T18:52:22.741 INFO:tasks.ceph.mgr.x.smithi117.stderr:2023-06-10T18:52:22.735+0000 7f28f183f180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-06-10T18:52:22.776 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-06-10T18:52:22.768+0000 7fb19a0b5180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-06-10T18:52:22.794 INFO:tasks.ceph.mgr.x.smithi117.stderr:2023-06-10T18:52:22.787+0000 7f28f183f180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-06-10T18:52:22.807 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.799+0000 7fcf424e0640 1 Processor -- start 2023-06-10T18:52:22.808 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.799+0000 7fcf424e0640 1 -- start start 2023-06-10T18:52:22.809 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.799+0000 7fcf424e0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcf3c159450 0x7fcf3c15d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:22.809 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.799+0000 7fcf424e0640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fcf3c15d680 0x7fcf3c0cec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:22.810 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.799+0000 7fcf424e0640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf3c0cbac0 con 0x7fcf3c0cf180 2023-06-10T18:52:22.810 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.799+0000 7fcf424e0640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf3c0cf600 con 0x7fcf3c15d680 2023-06-10T18:52:22.810 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.799+0000 7fcf424e0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3c15dc00 con 0x7fcf3c159450 2023-06-10T18:52:22.811 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.799+0000 7fcf3bfff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcf3c159450 0x7fcf3c15d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:22.811 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.799+0000 7fcf3b7fe640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fcf3c15d680 0x7fcf3c0cec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:22.811 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.799+0000 7fcf3bfff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcf3c159450 0x7fcf3c15d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.117:56398/0 (socket says 172.21.15.117:56398) 2023-06-10T18:52:22.811 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.799+0000 7fcf3bfff640 1 -- 172.21.15.117:0/4217154770 learned_addr learned my addr 172.21.15.117:0/4217154770 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-06-10T18:52:22.812 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.803+0000 7fcf3bfff640 1 -- 172.21.15.117:0/4217154770 >> v2:172.21.15.117:3300/0 conn(0x7fcf3c15d680 msgr2=0x7fcf3c0cec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:22.812 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.803+0000 7fcf3bfff640 1 --2- 172.21.15.117:0/4217154770 >> v2:172.21.15.117:3300/0 conn(0x7fcf3c15d680 0x7fcf3c0cec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:22.812 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.803+0000 7fcf3bfff640 1 -- 172.21.15.117:0/4217154770 >> v1:172.21.15.53:6789/0 conn(0x7fcf3c0cf180 legacy=0x7fcf3c0cda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:22.813 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.803+0000 7fcf3bfff640 1 -- 172.21.15.117:0/4217154770 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf3c15dee0 con 0x7fcf3c159450 2023-06-10T18:52:22.816 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.803+0000 7fcf3bfff640 1 --2- 172.21.15.117:0/4217154770 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcf3c159450 0x7fcf3c15d140 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c009870 tx=0x7fcf2c01c440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc4516de46b04cb8 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:22.817 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.803+0000 7fcf3affd640 1 -- 172.21.15.117:0/4217154770 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2c0ac620 con 0x7fcf3c159450 2023-06-10T18:52:22.817 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.803+0000 7fcf3affd640 1 -- 172.21.15.117:0/4217154770 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf2c0ac780 con 0x7fcf3c159450 2023-06-10T18:52:22.817 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.803+0000 7fcf3affd640 1 -- 172.21.15.117:0/4217154770 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2c0acb10 con 0x7fcf3c159450 2023-06-10T18:52:22.817 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.803+0000 7fcf424e0640 1 -- 172.21.15.117:0/4217154770 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcf3c159450 msgr2=0x7fcf3c15d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:22.818 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.803+0000 7fcf424e0640 1 --2- 172.21.15.117:0/4217154770 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcf3c159450 0x7fcf3c15d140 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c009870 tx=0x7fcf2c01c440 comp rx=0 tx=0).stop 2023-06-10T18:52:22.818 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.803+0000 7fcf424e0640 1 -- 172.21.15.117:0/4217154770 shutdown_connections 2023-06-10T18:52:22.818 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.803+0000 7fcf424e0640 1 --2- 172.21.15.117:0/4217154770 >> v2:172.21.15.117:3300/0 conn(0x7fcf3c15d680 0x7fcf3c0cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:22.818 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.803+0000 7fcf424e0640 1 --2- 172.21.15.117:0/4217154770 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcf3c159450 0x7fcf3c15d140 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:22.818 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.803+0000 7fcf424e0640 1 -- 172.21.15.117:0/4217154770 >> 172.21.15.117:0/4217154770 conn(0x7fcf3c06a090 msgr2=0x7fcf3c06d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:22.819 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.803+0000 7fcf424e0640 1 -- 172.21.15.117:0/4217154770 shutdown_connections 2023-06-10T18:52:22.819 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.803+0000 7fcf424e0640 1 -- 172.21.15.117:0/4217154770 wait complete. 2023-06-10T18:52:22.819 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.807+0000 7fcf424e0640 1 Processor -- start 2023-06-10T18:52:22.819 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.807+0000 7fcf424e0640 1 -- start start 2023-06-10T18:52:22.820 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.807+0000 7fcf424e0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf3c0cf180 0x7fcf3c14d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:22.820 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.807+0000 7fcf424e0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcf3c159450 0x7fcf3c157fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:22.820 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.807+0000 7fcf424e0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf3c15d680 0x7fcf3c0b0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:22.820 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.807+0000 7fcf424e0640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3c14e850 con 0x7fcf3c0cf180 2023-06-10T18:52:22.821 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.807+0000 7fcf424e0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3c0c8810 con 0x7fcf3c15d680 2023-06-10T18:52:22.821 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.807+0000 7fcf424e0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3c14eab0 con 0x7fcf3c159450 2023-06-10T18:52:22.821 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.807+0000 7fcf3b7fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcf3c159450 0x7fcf3c157fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:22.821 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.807+0000 7fcf3b7fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcf3c159450 0x7fcf3c157fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.117:56402/0 (socket says 172.21.15.117:56402) 2023-06-10T18:52:22.821 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.807+0000 7fcf3b7fe640 1 -- 172.21.15.117:0/903044162 learned_addr learned my addr 172.21.15.117:0/903044162 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-06-10T18:52:22.822 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.807+0000 7fcf40a7d640 1 --2- 172.21.15.117:0/903044162 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf3c15d680 0x7fcf3c0b0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:22.822 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.807+0000 7fcf3bfff640 1 --2- 172.21.15.117:0/903044162 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf3c0cf180 0x7fcf3c14d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:22.822 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.807+0000 7fcf3b7fe640 1 -- 172.21.15.117:0/903044162 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf3c15d680 msgr2=0x7fcf3c0b0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:22.822 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.807+0000 7fcf3b7fe640 1 --2- 172.21.15.117:0/903044162 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf3c15d680 0x7fcf3c0b0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:22.822 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.807+0000 7fcf3b7fe640 1 -- 172.21.15.117:0/903044162 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf3c0cf180 msgr2=0x7fcf3c14d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:22.823 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.807+0000 7fcf3b7fe640 1 --2- 172.21.15.117:0/903044162 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf3c0cf180 0x7fcf3c14d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:22.823 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.807+0000 7fcf3b7fe640 1 -- 172.21.15.117:0/903044162 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf2c0094d0 con 0x7fcf3c159450 2023-06-10T18:52:22.823 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.807+0000 7fcf3b7fe640 1 --2- 172.21.15.117:0/903044162 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcf3c159450 0x7fcf3c157fa0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fcf3000e930 tx=0x7fcf3000edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:22.823 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.807+0000 7fcf38ff9640 1 -- 172.21.15.117:0/903044162 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf30009690 con 0x7fcf3c159450 2023-06-10T18:52:22.823 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.807+0000 7fcf38ff9640 1 -- 172.21.15.117:0/903044162 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf3000ca00 con 0x7fcf3c159450 2023-06-10T18:52:22.823 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.807+0000 7fcf424e0640 1 -- 172.21.15.117:0/903044162 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf3c14ed90 con 0x7fcf3c159450 2023-06-10T18:52:22.824 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.807+0000 7fcf38ff9640 1 -- 172.21.15.117:0/903044162 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf3000cd70 con 0x7fcf3c159450 2023-06-10T18:52:22.824 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.807+0000 7fcf424e0640 1 -- 172.21.15.117:0/903044162 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf3c14dc10 con 0x7fcf3c159450 2023-06-10T18:52:22.824 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.807+0000 7fcf38ff9640 1 -- 172.21.15.117:0/903044162 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fcf30005ca0 con 0x7fcf3c159450 2023-06-10T18:52:22.824 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.807+0000 7fcf38ff9640 1 -- 172.21.15.117:0/903044162 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fcf300139f0 con 0x7fcf3c159450 2023-06-10T18:52:22.824 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.807+0000 7fcf424e0640 1 -- 172.21.15.117:0/903044162 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf3c0cefb0 con 0x7fcf3c159450 2023-06-10T18:52:22.825 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.811+0000 7fcf38ff9640 1 -- 172.21.15.117:0/903044162 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fcf30021060 con 0x7fcf3c159450 2023-06-10T18:52:22.831 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-06-10T18:52:22.820+0000 7fb19a0b5180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-06-10T18:52:22.874 INFO:tasks.ceph.mgr.x.smithi117.stderr:2023-06-10T18:52:22.867+0000 7f28f183f180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-06-10T18:52:22.885 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.879+0000 7fcf424e0640 1 -- 172.21.15.117:0/903044162 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd new", "uuid": "222cc807-6586-4c9f-b77b-c50f39939699", "id": 5} v 0) v1 -- 0x7fcf3c04d790 con 0x7fcf3c159450 2023-06-10T18:52:22.892 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.883+0000 7fcf38ff9640 1 -- 172.21.15.117:0/903044162 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "222cc807-6586-4c9f-b77b-c50f39939699", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fcf30017070 con 0x7fcf3c159450 2023-06-10T18:52:22.892 INFO:teuthology.orchestra.run.smithi117.stdout:5 2023-06-10T18:52:22.893 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.887+0000 7fcf424e0640 1 -- 172.21.15.117:0/903044162 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcf3c159450 msgr2=0x7fcf3c157fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:22.893 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.887+0000 7fcf424e0640 1 --2- 172.21.15.117:0/903044162 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcf3c159450 0x7fcf3c157fa0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fcf3000e930 tx=0x7fcf3000edf0 comp rx=0 tx=0).stop 2023-06-10T18:52:22.894 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.887+0000 7fcf424e0640 1 -- 172.21.15.117:0/903044162 shutdown_connections 2023-06-10T18:52:22.894 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.887+0000 7fcf424e0640 1 --2- 172.21.15.117:0/903044162 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf3c15d680 0x7fcf3c0b0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:22.894 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.887+0000 7fcf424e0640 1 --2- 172.21.15.117:0/903044162 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcf3c159450 0x7fcf3c157fa0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:22.894 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.887+0000 7fcf424e0640 1 --2- 172.21.15.117:0/903044162 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf3c0cf180 0x7fcf3c14d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:22.894 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.887+0000 7fcf424e0640 1 -- 172.21.15.117:0/903044162 >> 172.21.15.117:0/903044162 conn(0x7fcf3c06a090 msgr2=0x7fcf3c152210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:22.894 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.887+0000 7fcf424e0640 1 -- 172.21.15.117:0/903044162 shutdown_connections 2023-06-10T18:52:22.894 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:22.887+0000 7fcf424e0640 1 -- 172.21.15.117:0/903044162 wait complete. 2023-06-10T18:52:22.909 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new c1e3a10b-f324-4e66-85ae-a97ba498c5fd 6 2023-06-10T18:52:22.911 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-06-10T18:52:22.900+0000 7fb19a0b5180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-06-10T18:52:22.929 INFO:tasks.ceph.mgr.x.smithi117.stderr:2023-06-10T18:52:22.923+0000 7f28f183f180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-06-10T18:52:22.965 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-06-10T18:52:22.956+0000 7fb19a0b5180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-06-10T18:52:23.027 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.019+0000 7f3dde50b640 1 Processor -- start 2023-06-10T18:52:23.027 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.019+0000 7f3dde50b640 1 -- start start 2023-06-10T18:52:23.028 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.019+0000 7f3dde50b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3dd8159450 0x7f3dd815d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:23.028 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.019+0000 7f3dde50b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3dd815d680 0x7f3dd80cec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:23.029 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.019+0000 7f3dde50b640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dd80cbac0 con 0x7f3dd80cf180 2023-06-10T18:52:23.029 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.019+0000 7f3dde50b640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dd80cf5c0 con 0x7f3dd815d680 2023-06-10T18:52:23.029 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.019+0000 7f3dde50b640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dd815dc00 con 0x7f3dd8159450 2023-06-10T18:52:23.029 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.019+0000 7f3dd7fff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3dd8159450 0x7f3dd815d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:23.029 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.019+0000 7f3dd7fff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3dd8159450 0x7f3dd815d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:42290/0 (socket says 172.21.15.117:42290) 2023-06-10T18:52:23.029 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.019+0000 7f3dd7fff640 1 -- 172.21.15.117:0/3847016093 learned_addr learned my addr 172.21.15.117:0/3847016093 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-06-10T18:52:23.029 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.019+0000 7f3dd7fff640 1 -- 172.21.15.117:0/3847016093 >> v2:172.21.15.53:3300/0 conn(0x7f3dd815d680 msgr2=0x7f3dd80cec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:23.029 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.019+0000 7f3dd77fe640 1 --2- 172.21.15.117:0/3847016093 >> v2:172.21.15.53:3300/0 conn(0x7f3dd815d680 0x7f3dd80cec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:23.030 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.019+0000 7f3dd7fff640 1 --2- 172.21.15.117:0/3847016093 >> v2:172.21.15.53:3300/0 conn(0x7f3dd815d680 0x7f3dd80cec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:23.030 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.019+0000 7f3dd7fff640 1 -- 172.21.15.117:0/3847016093 >> v1:172.21.15.53:6789/0 conn(0x7f3dd80cf180 legacy=0x7f3dd80cda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:23.030 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.019+0000 7f3dd7fff640 1 -- 172.21.15.117:0/3847016093 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dd815dee0 con 0x7f3dd8159450 2023-06-10T18:52:23.031 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.023+0000 7f3dd7fff640 1 --2- 172.21.15.117:0/3847016093 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3dd8159450 0x7f3dd815d140 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3dd80b29a0 tx=0x7f3dd001c960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3a713034d09c384 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:23.032 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.023+0000 7f3dd6ffd640 1 -- 172.21.15.117:0/3847016093 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd00a57e0 con 0x7f3dd8159450 2023-06-10T18:52:23.032 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.023+0000 7f3dd6ffd640 1 -- 172.21.15.117:0/3847016093 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dd00a5940 con 0x7f3dd8159450 2023-06-10T18:52:23.032 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.023+0000 7f3dd6ffd640 1 -- 172.21.15.117:0/3847016093 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd00a5cd0 con 0x7f3dd8159450 2023-06-10T18:52:23.033 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.023+0000 7f3dde50b640 1 -- 172.21.15.117:0/3847016093 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3dd8159450 msgr2=0x7f3dd815d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:23.033 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.023+0000 7f3dde50b640 1 --2- 172.21.15.117:0/3847016093 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3dd8159450 0x7f3dd815d140 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3dd80b29a0 tx=0x7f3dd001c960 comp rx=0 tx=0).stop 2023-06-10T18:52:23.033 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.023+0000 7f3dde50b640 1 -- 172.21.15.117:0/3847016093 shutdown_connections 2023-06-10T18:52:23.033 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.023+0000 7f3dde50b640 1 --2- 172.21.15.117:0/3847016093 >> v2:172.21.15.53:3300/0 conn(0x7f3dd815d680 0x7f3dd80cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:23.033 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.023+0000 7f3dde50b640 1 --2- 172.21.15.117:0/3847016093 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3dd8159450 0x7f3dd815d140 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:23.034 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.023+0000 7f3dde50b640 1 -- 172.21.15.117:0/3847016093 >> 172.21.15.117:0/3847016093 conn(0x7f3dd806a090 msgr2=0x7f3dd806d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:23.034 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.023+0000 7f3dde50b640 1 -- 172.21.15.117:0/3847016093 shutdown_connections 2023-06-10T18:52:23.034 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.023+0000 7f3dde50b640 1 -- 172.21.15.117:0/3847016093 wait complete. 2023-06-10T18:52:23.037 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.023+0000 7f3dde50b640 1 Processor -- start 2023-06-10T18:52:23.037 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.023+0000 7f3dde50b640 1 -- start start 2023-06-10T18:52:23.037 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.027+0000 7f3dde50b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3dd80cf180 0x7f3dd80c67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:23.037 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.027+0000 7f3dde50b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3dd8159450 0x7f3dd8156220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:23.037 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.027+0000 7f3dde50b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3dd815d680 0x7f3dd8150d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:23.037 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.027+0000 7f3dde50b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd8153f70 con 0x7f3dd815d680 2023-06-10T18:52:23.038 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.027+0000 7f3dde50b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd8154a20 con 0x7f3dd8159450 2023-06-10T18:52:23.038 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.027+0000 7f3dde50b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd8154180 con 0x7f3dd80cf180 2023-06-10T18:52:23.038 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.027+0000 7f3dd7fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3dd80cf180 0x7f3dd80c67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:23.038 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.027+0000 7f3dd77fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3dd8159450 0x7f3dd8156220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:23.038 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.027+0000 7f3dd7fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3dd80cf180 0x7f3dd80c67a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.117:56408/0 (socket says 172.21.15.117:56408) 2023-06-10T18:52:23.038 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.027+0000 7f3dd7fff640 1 -- 172.21.15.117:0/35858077 learned_addr learned my addr 172.21.15.117:0/35858077 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-06-10T18:52:23.038 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.027+0000 7f3ddcaa8640 1 --2- 172.21.15.117:0/35858077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3dd815d680 0x7f3dd8150d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:23.039 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.027+0000 7f3dd7fff640 1 -- 172.21.15.117:0/35858077 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3dd8159450 msgr2=0x7f3dd8156220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:23.039 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.027+0000 7f3dd7fff640 1 --2- 172.21.15.117:0/35858077 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3dd8159450 0x7f3dd8156220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:23.039 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.027+0000 7f3dd7fff640 1 -- 172.21.15.117:0/35858077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3dd815d680 msgr2=0x7f3dd8150d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:23.039 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.027+0000 7f3dd7fff640 1 --2- 172.21.15.117:0/35858077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3dd815d680 0x7f3dd8150d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:23.039 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.027+0000 7f3dd7fff640 1 -- 172.21.15.117:0/35858077 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dd0009b30 con 0x7f3dd80cf180 2023-06-10T18:52:23.039 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.027+0000 7f3dd77fe640 1 --2- 172.21.15.117:0/35858077 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3dd8159450 0x7f3dd8156220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-10T18:52:23.039 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.027+0000 7f3ddcaa8640 1 --2- 172.21.15.117:0/35858077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3dd815d680 0x7f3dd8150d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:52:23.040 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.027+0000 7f3dd7fff640 1 --2- 172.21.15.117:0/35858077 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3dd80cf180 0x7f3dd80c67a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3dd00af040 tx=0x7f3dd0019700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:23.040 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.027+0000 7f3dd4ff9640 1 -- 172.21.15.117:0/35858077 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd00b8670 con 0x7f3dd80cf180 2023-06-10T18:52:23.040 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.027+0000 7f3dd4ff9640 1 -- 172.21.15.117:0/35858077 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dd00b87d0 con 0x7f3dd80cf180 2023-06-10T18:52:23.040 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.027+0000 7f3dde50b640 1 -- 172.21.15.117:0/35858077 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dd8154460 con 0x7f3dd80cf180 2023-06-10T18:52:23.040 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.027+0000 7f3dd4ff9640 1 -- 172.21.15.117:0/35858077 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd00b8b80 con 0x7f3dd80cf180 2023-06-10T18:52:23.040 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.027+0000 7f3dde50b640 1 -- 172.21.15.117:0/35858077 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dd8152c60 con 0x7f3dd80cf180 2023-06-10T18:52:23.040 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.027+0000 7f3dd4ff9640 1 -- 172.21.15.117:0/35858077 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f3dd00039a0 con 0x7f3dd80cf180 2023-06-10T18:52:23.040 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.027+0000 7f3dd4ff9640 1 -- 172.21.15.117:0/35858077 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f3dd0004610 con 0x7f3dd80cf180 2023-06-10T18:52:23.041 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.027+0000 7f3dde50b640 1 -- 172.21.15.117:0/35858077 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dd804d790 con 0x7f3dd80cf180 2023-06-10T18:52:23.041 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.027+0000 7f3dd4ff9640 1 -- 172.21.15.117:0/35858077 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f3dd00bc020 con 0x7f3dd80cf180 2023-06-10T18:52:23.045 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-06-10T18:52:23.036+0000 7fb19a0b5180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-06-10T18:52:23.072 INFO:tasks.ceph.mgr.x.smithi117.stderr:2023-06-10T18:52:23.063+0000 7f28f183f180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-06-10T18:52:23.099 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-06-10T18:52:23.088+0000 7fb19a0b5180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-06-10T18:52:23.104 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.099+0000 7f3dde50b640 1 -- 172.21.15.117:0/35858077 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c1e3a10b-f324-4e66-85ae-a97ba498c5fd", "id": 6} v 0) v1 -- 0x7f3dd80cec40 con 0x7f3dd80cf180 2023-06-10T18:52:23.111 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.103+0000 7f3dd4ff9640 1 -- 172.21.15.117:0/35858077 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c1e3a10b-f324-4e66-85ae-a97ba498c5fd", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3dd0003de0 con 0x7f3dd80cf180 2023-06-10T18:52:23.111 INFO:teuthology.orchestra.run.smithi117.stdout:6 2023-06-10T18:52:23.112 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.103+0000 7f3dde50b640 1 -- 172.21.15.117:0/35858077 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3dd80cf180 msgr2=0x7f3dd80c67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:23.112 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.103+0000 7f3dde50b640 1 --2- 172.21.15.117:0/35858077 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3dd80cf180 0x7f3dd80c67a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3dd00af040 tx=0x7f3dd0019700 comp rx=0 tx=0).stop 2023-06-10T18:52:23.112 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.103+0000 7f3dde50b640 1 -- 172.21.15.117:0/35858077 shutdown_connections 2023-06-10T18:52:23.112 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.103+0000 7f3dde50b640 1 --2- 172.21.15.117:0/35858077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3dd815d680 0x7f3dd8150d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:23.112 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.103+0000 7f3dde50b640 1 --2- 172.21.15.117:0/35858077 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3dd8159450 0x7f3dd8156220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:23.112 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.103+0000 7f3dde50b640 1 --2- 172.21.15.117:0/35858077 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3dd80cf180 0x7f3dd80c67a0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:23.113 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.103+0000 7f3dde50b640 1 -- 172.21.15.117:0/35858077 >> 172.21.15.117:0/35858077 conn(0x7f3dd806a090 msgr2=0x7f3dd80b1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:23.113 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.103+0000 7f3dde50b640 1 -- 172.21.15.117:0/35858077 shutdown_connections 2023-06-10T18:52:23.113 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.103+0000 7f3dde50b640 1 -- 172.21.15.117:0/35858077 wait complete. 2023-06-10T18:52:23.126 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new 14525ac7-f008-4749-aeb5-23e979497b78 7 2023-06-10T18:52:23.136 INFO:tasks.ceph.mgr.x.smithi117.stderr:2023-06-10T18:52:23.127+0000 7f28f183f180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-06-10T18:52:23.242 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-06-10T18:52:23.232+0000 7fb19a0b5180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-06-10T18:52:23.247 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.239+0000 7f0628ddb640 1 Processor -- start 2023-06-10T18:52:23.247 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.239+0000 7f0628ddb640 1 -- start start 2023-06-10T18:52:23.248 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.239+0000 7f0628ddb640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f062406b780 0x7f062415c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:23.248 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.239+0000 7f0628ddb640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f062406bb50 0x7f062415f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:23.249 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.239+0000 7f0628ddb640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06240af530 con 0x7f062415f860 2023-06-10T18:52:23.249 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.239+0000 7f0628ddb640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f062415c3d0 con 0x7f062406bb50 2023-06-10T18:52:23.249 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.239+0000 7f0628ddb640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f062415fd70 con 0x7f062406b780 2023-06-10T18:52:23.249 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.239+0000 7f062259c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f062406b780 0x7f062415c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:23.249 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.239+0000 7f0622d9d640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f062415f860 0x7f06240ceb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:52170/0 (socket says 172.21.15.117:52170) 2023-06-10T18:52:23.249 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.239+0000 7f0622d9d640 1 -- 172.21.15.117:0/4239517813 learned_addr learned my addr 172.21.15.117:0/4239517813 (peer_addr_for_me v1:172.21.15.117:0/0) 2023-06-10T18:52:23.250 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.239+0000 7f0621d9b640 1 --2- 172.21.15.117:0/4239517813 >> v2:172.21.15.53:3300/0 conn(0x7f062406bb50 0x7f062415f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:23.250 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.239+0000 7f062159a640 1 -- 172.21.15.117:0/4239517813 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4273960472 0 0) 0x7f06240af530 con 0x7f062415f860 2023-06-10T18:52:23.250 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.239+0000 7f062259c640 1 -- 172.21.15.117:0/4239517813 >> v2:172.21.15.53:3300/0 conn(0x7f062406bb50 msgr2=0x7f062415f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:23.250 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.239+0000 7f062259c640 1 --2- 172.21.15.117:0/4239517813 >> v2:172.21.15.53:3300/0 conn(0x7f062406bb50 0x7f062415f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:23.250 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.239+0000 7f062259c640 1 -- 172.21.15.117:0/4239517813 >> v1:172.21.15.117:6789/0 conn(0x7f062415f860 legacy=0x7f06240ceb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:23.250 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.239+0000 7f062259c640 1 -- 172.21.15.117:0/4239517813 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0624160050 con 0x7f062406b780 2023-06-10T18:52:23.251 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.243+0000 7f062259c640 1 --2- 172.21.15.117:0/4239517813 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f062406b780 0x7f062415c7f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f06240d0f20 tx=0x7f061401c3d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3bf33a524b27d424 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:23.251 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.243+0000 7f062159a640 1 -- 172.21.15.117:0/4239517813 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06140ab600 con 0x7f062406b780 2023-06-10T18:52:23.251 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.243+0000 7f062159a640 1 -- 172.21.15.117:0/4239517813 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06140a7050 con 0x7f062406b780 2023-06-10T18:52:23.251 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.243+0000 7f062159a640 1 -- 172.21.15.117:0/4239517813 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06140ab980 con 0x7f062406b780 2023-06-10T18:52:23.252 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.243+0000 7f0628ddb640 1 -- 172.21.15.117:0/4239517813 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f062406b780 msgr2=0x7f062415c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:23.252 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.243+0000 7f0628ddb640 1 --2- 172.21.15.117:0/4239517813 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f062406b780 0x7f062415c7f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f06240d0f20 tx=0x7f061401c3d0 comp rx=0 tx=0).stop 2023-06-10T18:52:23.252 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.243+0000 7f0628ddb640 1 -- 172.21.15.117:0/4239517813 shutdown_connections 2023-06-10T18:52:23.253 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.243+0000 7f0628ddb640 1 --2- 172.21.15.117:0/4239517813 >> v2:172.21.15.53:3300/0 conn(0x7f062406bb50 0x7f062415f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:23.253 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.243+0000 7f0628ddb640 1 --2- 172.21.15.117:0/4239517813 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f062406b780 0x7f062415c7f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:23.253 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.243+0000 7f0628ddb640 1 -- 172.21.15.117:0/4239517813 >> 172.21.15.117:0/4239517813 conn(0x7f062406a090 msgr2=0x7f062406d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:23.253 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.243+0000 7f0628ddb640 1 -- 172.21.15.117:0/4239517813 shutdown_connections 2023-06-10T18:52:23.253 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.243+0000 7f0628ddb640 1 -- 172.21.15.117:0/4239517813 wait complete. 2023-06-10T18:52:23.255 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.247+0000 7f0628ddb640 1 Processor -- start 2023-06-10T18:52:23.255 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.247+0000 7f0628ddb640 1 -- start start 2023-06-10T18:52:23.255 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.247+0000 7f0628ddb640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f062406bb50 0x7f0624156fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:23.255 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.247+0000 7f0628ddb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f062415f860 0x7f062415e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:23.255 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.247+0000 7f0628ddb640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0624157540 0x7f06240c7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:23.255 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.247+0000 7f0628ddb640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0624156000 con 0x7f062415f860 2023-06-10T18:52:23.256 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.247+0000 7f0628ddb640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f062415ecf0 con 0x7f062406bb50 2023-06-10T18:52:23.256 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.247+0000 7f0628ddb640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0624156b40 con 0x7f0624157540 2023-06-10T18:52:23.256 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.247+0000 7f062259c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f062406bb50 0x7f0624156fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:23.256 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.247+0000 7f0622d9d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0624157540 0x7f06240c7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:23.256 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.247+0000 7f062259c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f062406bb50 0x7f0624156fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:42320/0 (socket says 172.21.15.117:42320) 2023-06-10T18:52:23.256 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.247+0000 7f062259c640 1 -- 172.21.15.117:0/711357878 learned_addr learned my addr 172.21.15.117:0/711357878 (peer_addr_for_me v2:172.21.15.117:0/0) 2023-06-10T18:52:23.256 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.247+0000 7f0621d9b640 1 --2- 172.21.15.117:0/711357878 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f062415f860 0x7f062415e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:23.257 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.247+0000 7f062259c640 1 -- 172.21.15.117:0/711357878 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0624157540 msgr2=0x7f06240c7180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:23.257 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.247+0000 7f062259c640 1 --2- 172.21.15.117:0/711357878 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0624157540 0x7f06240c7180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:23.257 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.247+0000 7f062259c640 1 -- 172.21.15.117:0/711357878 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f062415f860 msgr2=0x7f062415e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:23.257 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.247+0000 7f062259c640 1 --2- 172.21.15.117:0/711357878 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f062415f860 0x7f062415e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:23.257 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.247+0000 7f062259c640 1 -- 172.21.15.117:0/711357878 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0614009420 con 0x7f062406bb50 2023-06-10T18:52:23.257 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.247+0000 7f0622d9d640 1 --2- 172.21.15.117:0/711357878 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0624157540 0x7f06240c7180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-10T18:52:23.257 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.247+0000 7f062259c640 1 --2- 172.21.15.117:0/711357878 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f062406bb50 0x7f0624156fd0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f061401a000 tx=0x7f0614019170 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:23.257 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.247+0000 7f061affd640 1 -- 172.21.15.117:0/711357878 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06140b7450 con 0x7f062406bb50 2023-06-10T18:52:23.258 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.247+0000 7f061affd640 1 -- 172.21.15.117:0/711357878 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06140b75b0 con 0x7f062406bb50 2023-06-10T18:52:23.258 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.247+0000 7f0628ddb640 1 -- 172.21.15.117:0/711357878 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0624156210 con 0x7f062406bb50 2023-06-10T18:52:23.258 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.247+0000 7f061affd640 1 -- 172.21.15.117:0/711357878 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06140b7960 con 0x7f062406bb50 2023-06-10T18:52:23.258 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.247+0000 7f0628ddb640 1 -- 172.21.15.117:0/711357878 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06241567d0 con 0x7f062406bb50 2023-06-10T18:52:23.258 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.247+0000 7f061affd640 1 -- 172.21.15.117:0/711357878 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f06140c0400 con 0x7f062406bb50 2023-06-10T18:52:23.258 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.247+0000 7f061affd640 1 -- 172.21.15.117:0/711357878 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f06140b7dc0 con 0x7f062406bb50 2023-06-10T18:52:23.258 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.247+0000 7f0628ddb640 1 -- 172.21.15.117:0/711357878 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f062404d790 con 0x7f062406bb50 2023-06-10T18:52:23.259 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.251+0000 7f061affd640 1 -- 172.21.15.117:0/711357878 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f06140bb020 con 0x7f062406bb50 2023-06-10T18:52:23.304 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-06-10T18:52:23.292+0000 7fb19a0b5180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-06-10T18:52:23.323 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.315+0000 7f0628ddb640 1 -- 172.21.15.117:0/711357878 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd new", "uuid": "14525ac7-f008-4749-aeb5-23e979497b78", "id": 7} v 0) v1 -- 0x7f062406df70 con 0x7f062406bb50 2023-06-10T18:52:23.333 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.327+0000 7f061affd640 1 -- 172.21.15.117:0/711357878 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "14525ac7-f008-4749-aeb5-23e979497b78", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f06140b0070 con 0x7f062406bb50 2023-06-10T18:52:23.333 INFO:teuthology.orchestra.run.smithi117.stdout:7 2023-06-10T18:52:23.334 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.327+0000 7f0628ddb640 1 -- 172.21.15.117:0/711357878 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f062406bb50 msgr2=0x7f0624156fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:23.334 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.327+0000 7f0628ddb640 1 --2- 172.21.15.117:0/711357878 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f062406bb50 0x7f0624156fd0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f061401a000 tx=0x7f0614019170 comp rx=0 tx=0).stop 2023-06-10T18:52:23.334 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.327+0000 7f0628ddb640 1 -- 172.21.15.117:0/711357878 shutdown_connections 2023-06-10T18:52:23.335 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.327+0000 7f0628ddb640 1 --2- 172.21.15.117:0/711357878 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0624157540 0x7f06240c7180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:23.335 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.327+0000 7f0628ddb640 1 --2- 172.21.15.117:0/711357878 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f062415f860 0x7f062415e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:23.335 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.327+0000 7f0628ddb640 1 --2- 172.21.15.117:0/711357878 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f062406bb50 0x7f0624156fd0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:23.335 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.327+0000 7f0628ddb640 1 -- 172.21.15.117:0/711357878 >> 172.21.15.117:0/711357878 conn(0x7f062406a090 msgr2=0x7f062406f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:23.335 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.327+0000 7f0628ddb640 1 -- 172.21.15.117:0/711357878 shutdown_connections 2023-06-10T18:52:23.335 INFO:teuthology.orchestra.run.smithi117.stderr:2023-06-10T18:52:23.327+0000 7f0628ddb640 1 -- 172.21.15.117:0/711357878 wait complete. 2023-06-10T18:52:23.349 INFO:tasks.ceph.osd.0:Restarting daemon 2023-06-10T18:52:23.349 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-06-10T18:52:23.351 INFO:tasks.ceph.osd.0:Started 2023-06-10T18:52:23.352 INFO:tasks.ceph.osd.1:Restarting daemon 2023-06-10T18:52:23.352 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-06-10T18:52:23.354 INFO:tasks.ceph.osd.1:Started 2023-06-10T18:52:23.355 INFO:tasks.ceph.osd.2:Restarting daemon 2023-06-10T18:52:23.355 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-06-10T18:52:23.357 INFO:tasks.ceph.osd.2:Started 2023-06-10T18:52:23.357 INFO:tasks.ceph.osd.3:Restarting daemon 2023-06-10T18:52:23.357 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-06-10T18:52:23.359 INFO:tasks.ceph.osd.3:Started 2023-06-10T18:52:23.360 INFO:tasks.ceph.osd.4:Restarting daemon 2023-06-10T18:52:23.360 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-06-10T18:52:23.361 INFO:tasks.ceph.osd.4:Started 2023-06-10T18:52:23.362 INFO:tasks.ceph.osd.5:Restarting daemon 2023-06-10T18:52:23.362 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-06-10T18:52:23.363 INFO:tasks.ceph.osd.5:Started 2023-06-10T18:52:23.364 INFO:tasks.ceph.osd.6:Restarting daemon 2023-06-10T18:52:23.364 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-06-10T18:52:23.365 INFO:tasks.ceph.osd.6:Started 2023-06-10T18:52:23.366 INFO:tasks.ceph.osd.7:Restarting daemon 2023-06-10T18:52:23.366 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-06-10T18:52:23.368 INFO:tasks.ceph.osd.7:Started 2023-06-10T18:52:23.368 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T18:52:23.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:23.500+0000 7ffb3efde640 1 Processor -- start 2023-06-10T18:52:23.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:23.500+0000 7ffb3efde640 1 -- start start 2023-06-10T18:52:23.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:23.504+0000 7ffb3efde640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ffb38070f80 0x7ffb380ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:23.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:23.504+0000 7ffb3efde640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb3815f2c0 con 0x7ffb3815eef0 2023-06-10T18:52:23.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:23.504+0000 7ffb3efde640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb3815fdc0 con 0x7ffb380ce990 2023-06-10T18:52:23.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:23.504+0000 7ffb3efde640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb381600a0 con 0x7ffb38070f80 2023-06-10T18:52:23.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:23.504+0000 7ffb37fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ffb38070f80 0x7ffb380ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:23.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:23.504+0000 7ffb3cd7a640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ffb3815eef0 0x7ffb3815f570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56728/0 (socket says 172.21.15.53:56728) 2023-06-10T18:52:23.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:23.504+0000 7ffb3cd7a640 1 -- 172.21.15.53:0/2457883252 learned_addr learned my addr 172.21.15.53:0/2457883252 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:52:23.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:23.504+0000 7ffb37fff640 1 -- 172.21.15.53:0/2457883252 >> v1:172.21.15.117:6789/0 conn(0x7ffb380ce990 legacy=0x7ffb38069450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:23.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:23.504+0000 7ffb37fff640 1 -- 172.21.15.53:0/2457883252 >> v1:172.21.15.53:6789/0 conn(0x7ffb3815eef0 legacy=0x7ffb3815f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:23.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:23.504+0000 7ffb377fe640 1 -- 172.21.15.53:0/2457883252 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3679945134 0 0) 0x7ffb3815f2c0 con 0x7ffb3815eef0 2023-06-10T18:52:23.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:23.504+0000 7ffb37fff640 1 -- 172.21.15.53:0/2457883252 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb38160380 con 0x7ffb38070f80 2023-06-10T18:52:23.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:23.504+0000 7ffb37fff640 1 --2- 172.21.15.53:0/2457883252 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb38070f80 0x7ffb380ce450 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c0097c0 tx=0x7ffb2c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d15363c42e40911 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:23.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:23.504+0000 7ffb377fe640 1 -- 172.21.15.53:0/2457883252 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2c0a8050 con 0x7ffb38070f80 2023-06-10T18:52:23.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:23.504+0000 7ffb377fe640 1 -- 172.21.15.53:0/2457883252 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb2c0ac5f0 con 0x7ffb38070f80 2023-06-10T18:52:23.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:23.504+0000 7ffb377fe640 1 -- 172.21.15.53:0/2457883252 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2c0ac980 con 0x7ffb38070f80 2023-06-10T18:52:23.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:23.504+0000 7ffb3efde640 1 -- 172.21.15.53:0/2457883252 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb38070f80 msgr2=0x7ffb380ce450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:23.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:23.504+0000 7ffb3efde640 1 --2- 172.21.15.53:0/2457883252 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb38070f80 0x7ffb380ce450 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c0097c0 tx=0x7ffb2c01c480 comp rx=0 tx=0).stop 2023-06-10T18:52:23.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:23.508+0000 7ffb3efde640 1 -- 172.21.15.53:0/2457883252 shutdown_connections 2023-06-10T18:52:23.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:23.508+0000 7ffb3efde640 1 --2- 172.21.15.53:0/2457883252 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb38070f80 0x7ffb380ce450 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:23.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:23.508+0000 7ffb3efde640 1 -- 172.21.15.53:0/2457883252 >> 172.21.15.53:0/2457883252 conn(0x7ffb3806a560 msgr2=0x7ffb3806a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:23.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:23.508+0000 7ffb3efde640 1 -- 172.21.15.53:0/2457883252 shutdown_connections 2023-06-10T18:52:23.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:23.508+0000 7ffb3efde640 1 -- 172.21.15.53:0/2457883252 wait complete. 2023-06-10T18:52:23.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:23.508+0000 7ffb3efde640 1 Processor -- start 2023-06-10T18:52:23.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:23.508+0000 7ffb3efde640 1 -- start start 2023-06-10T18:52:23.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:23.508+0000 7ffb3efde640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb38070f80 0x7ffb380c32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:23.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:23.508+0000 7ffb3efde640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb380ce990 0x7ffb380704c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:23.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:23.508+0000 7ffb3efde640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb3815eef0 0x7ffb381554f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:23.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:23.508+0000 7ffb3efde640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb380c57a0 con 0x7ffb3815eef0 2023-06-10T18:52:23.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:23.508+0000 7ffb3efde640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb380c3b20 con 0x7ffb38070f80 2023-06-10T18:52:23.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:23.508+0000 7ffb3efde640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb380c2b10 con 0x7ffb380ce990 2023-06-10T18:52:23.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:23.508+0000 7ffb3d57b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb3815eef0 0x7ffb381554f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:23.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:23.508+0000 7ffb3cd7a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb38070f80 0x7ffb380c32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:23.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:23.508+0000 7ffb3d57b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb3815eef0 0x7ffb381554f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60996/0 (socket says 172.21.15.53:60996) 2023-06-10T18:52:23.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:23.508+0000 7ffb3d57b640 1 -- 172.21.15.53:0/24919657 learned_addr learned my addr 172.21.15.53:0/24919657 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:23.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:23.508+0000 7ffb37fff640 1 --2- 172.21.15.53:0/24919657 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb380ce990 0x7ffb380704c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:23.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:23.508+0000 7ffb3d57b640 1 -- 172.21.15.53:0/24919657 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb380ce990 msgr2=0x7ffb380704c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:23.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:23.508+0000 7ffb3d57b640 1 --2- 172.21.15.53:0/24919657 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb380ce990 0x7ffb380704c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:23.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:23.508+0000 7ffb3d57b640 1 -- 172.21.15.53:0/24919657 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb38070f80 msgr2=0x7ffb380c32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:23.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:23.508+0000 7ffb3d57b640 1 --2- 172.21.15.53:0/24919657 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb38070f80 0x7ffb380c32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:23.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:23.508+0000 7ffb3d57b640 1 -- 172.21.15.53:0/24919657 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb2c009420 con 0x7ffb3815eef0 2023-06-10T18:52:23.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:23.508+0000 7ffb3d57b640 1 --2- 172.21.15.53:0/24919657 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb3815eef0 0x7ffb381554f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ffb3000c7a0 tx=0x7ffb3000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:23.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:23.508+0000 7ffb357fa640 1 -- 172.21.15.53:0/24919657 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb30003b80 con 0x7ffb3815eef0 2023-06-10T18:52:23.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:23.508+0000 7ffb357fa640 1 -- 172.21.15.53:0/24919657 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb30003ce0 con 0x7ffb3815eef0 2023-06-10T18:52:23.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:23.508+0000 7ffb3efde640 1 -- 172.21.15.53:0/24919657 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb380c51e0 con 0x7ffb3815eef0 2023-06-10T18:52:23.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:23.508+0000 7ffb357fa640 1 -- 172.21.15.53:0/24919657 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb3000aa90 con 0x7ffb3815eef0 2023-06-10T18:52:23.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:23.508+0000 7ffb3efde640 1 -- 172.21.15.53:0/24919657 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb380c4ef0 con 0x7ffb3815eef0 2023-06-10T18:52:23.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:23.508+0000 7ffb357fa640 1 -- 172.21.15.53:0/24919657 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ffb300050d0 con 0x7ffb3815eef0 2023-06-10T18:52:23.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:23.508+0000 7ffb357fa640 1 -- 172.21.15.53:0/24919657 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7ffb30012b40 con 0x7ffb3815eef0 2023-06-10T18:52:23.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:23.508+0000 7ffb3efde640 1 -- 172.21.15.53:0/24919657 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb380b1840 con 0x7ffb3815eef0 2023-06-10T18:52:23.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:23.512+0000 7ffb357fa640 1 -- 172.21.15.53:0/24919657 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7ffb30012e20 con 0x7ffb3815eef0 2023-06-10T18:52:23.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:23.568+0000 7ffb3efde640 1 -- 172.21.15.53:0/24919657 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffb3804d790 con 0x7ffb3815eef0 2023-06-10T18:52:23.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:23.568+0000 7ffb357fa640 1 -- 172.21.15.53:0/24919657 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7ffb30005560 con 0x7ffb3815eef0 2023-06-10T18:52:23.579 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:52:23.580 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":10,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T18:52:23.319802+0000","last_up_change":"0.000000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T18:52:23.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:23.568+0000 7ffb3efde640 1 -- 172.21.15.53:0/24919657 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb3815eef0 msgr2=0x7ffb381554f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:23.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:23.568+0000 7ffb3efde640 1 --2- 172.21.15.53:0/24919657 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb3815eef0 0x7ffb381554f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ffb3000c7a0 tx=0x7ffb3000cc60 comp rx=0 tx=0).stop 2023-06-10T18:52:23.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:23.568+0000 7ffb3efde640 1 -- 172.21.15.53:0/24919657 shutdown_connections 2023-06-10T18:52:23.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:23.568+0000 7ffb3efde640 1 --2- 172.21.15.53:0/24919657 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb3815eef0 0x7ffb381554f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:23.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:23.568+0000 7ffb3efde640 1 --2- 172.21.15.53:0/24919657 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb380ce990 0x7ffb380704c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:23.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:23.568+0000 7ffb3efde640 1 --2- 172.21.15.53:0/24919657 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb38070f80 0x7ffb380c32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:23.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:23.568+0000 7ffb3efde640 1 -- 172.21.15.53:0/24919657 >> 172.21.15.53:0/24919657 conn(0x7ffb3806a560 msgr2=0x7ffb380ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:23.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:23.568+0000 7ffb3efde640 1 -- 172.21.15.53:0/24919657 shutdown_connections 2023-06-10T18:52:23.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:23.568+0000 7ffb3efde640 1 -- 172.21.15.53:0/24919657 wait complete. 2023-06-10T18:52:23.595 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-06-10T18:52:23.595 INFO:tasks.ceph:Waiting for OSDs to come up 2023-06-10T18:52:23.744 INFO:tasks.ceph.mgr.x.smithi117.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-06-10T18:52:23.744 INFO:tasks.ceph.mgr.x.smithi117.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-06-10T18:52:23.745 INFO:tasks.ceph.mgr.x.smithi117.stderr: from numpy import show_config as show_numpy_config 2023-06-10T18:52:23.746 INFO:tasks.ceph.osd.6.smithi117.stderr:2023-06-10T18:52:23.739+0000 7f375c826640 -1 Falling back to public interface 2023-06-10T18:52:23.778 INFO:tasks.ceph.osd.5.smithi117.stderr:2023-06-10T18:52:23.771+0000 7fc72962e640 -1 Falling back to public interface 2023-06-10T18:52:23.819 INFO:tasks.ceph.mgr.x.smithi117.stderr:2023-06-10T18:52:23.811+0000 7f28f183f180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-06-10T18:52:23.954 INFO:tasks.ceph.osd.2.smithi053.stderr:2023-06-10T18:52:23.944+0000 7fdff3dd0640 -1 Falling back to public interface 2023-06-10T18:52:23.961 INFO:tasks.ceph.mgr.x.smithi117.stderr:2023-06-10T18:52:23.955+0000 7f28f183f180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-06-10T18:52:23.969 INFO:tasks.ceph.osd.1.smithi053.stderr:2023-06-10T18:52:23.960+0000 7f3b661df640 -1 Falling back to public interface 2023-06-10T18:52:23.986 INFO:tasks.ceph.osd.0.smithi053.stderr:2023-06-10T18:52:23.976+0000 7f1486425640 -1 Falling back to public interface 2023-06-10T18:52:23.989 INFO:tasks.ceph.mgr.y.smithi053.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-06-10T18:52:23.989 INFO:tasks.ceph.mgr.y.smithi053.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-06-10T18:52:23.989 INFO:tasks.ceph.mgr.y.smithi053.stderr: from numpy import show_config as show_numpy_config 2023-06-10T18:52:23.990 INFO:tasks.ceph.osd.3.smithi053.stderr:2023-06-10T18:52:23.980+0000 7f7020f9a640 -1 Falling back to public interface 2023-06-10T18:52:23.998 INFO:tasks.ceph.osd.7.smithi117.stderr:2023-06-10T18:52:23.991+0000 7f86b7721640 -1 Falling back to public interface 2023-06-10T18:52:24.010 INFO:tasks.ceph.osd.4.smithi117.stderr:2023-06-10T18:52:24.003+0000 7f6038d0f640 -1 Falling back to public interface 2023-06-10T18:52:24.035 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-06-10T18:52:24.024+0000 7fb19a0b5180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-06-10T18:52:24.124 INFO:tasks.ceph.mgr.x.smithi117.stderr:2023-06-10T18:52:24.115+0000 7f28f183f180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-06-10T18:52:24.167 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-06-10T18:52:24.156+0000 7fb19a0b5180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-06-10T18:52:24.186 INFO:tasks.ceph.mgr.x.smithi117.stderr:2023-06-10T18:52:24.179+0000 7f28f183f180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-06-10T18:52:24.307 INFO:tasks.ceph.mgr.x.smithi117.stderr:2023-06-10T18:52:24.299+0000 7f28f183f180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-06-10T18:52:24.331 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-06-10T18:52:24.320+0000 7fb19a0b5180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-06-10T18:52:24.397 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-06-10T18:52:24.388+0000 7fb19a0b5180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-06-10T18:52:24.401 DEBUG:teuthology.orchestra.run.smithi053:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-06-10T18:52:24.516 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:24.504+0000 7ff19e555640 1 Processor -- start 2023-06-10T18:52:24.516 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:24.504+0000 7ff19e555640 1 -- start start 2023-06-10T18:52:24.517 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:24.508+0000 7ff19e555640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff1980708c0 0x7ff198070c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:24.517 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:24.508+0000 7ff19e555640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1980c87d0 0x7ff1980acef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:24.517 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:24.508+0000 7ff19e555640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1980cdfd0 con 0x7ff1980ad430 2023-06-10T18:52:24.518 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:24.508+0000 7ff19e555640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1980c8c00 con 0x7ff1980708c0 2023-06-10T18:52:24.518 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:24.508+0000 7ff19e555640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff198071620 con 0x7ff1980c87d0 2023-06-10T18:52:24.518 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:24.508+0000 7ff197fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff1980708c0 0x7ff198070c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:24.518 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:24.508+0000 7ff197fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff1980708c0 0x7ff198070c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:32774/0 (socket says 172.21.15.53:32774) 2023-06-10T18:52:24.518 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:24.508+0000 7ff197fff640 1 -- 172.21.15.53:0/2997379680 learned_addr learned my addr 172.21.15.53:0/2997379680 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:24.518 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:24.508+0000 7ff1977fe640 1 --2- 172.21.15.53:0/2997379680 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1980c87d0 0x7ff1980acef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:24.518 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:24.508+0000 7ff197fff640 1 -- 172.21.15.53:0/2997379680 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1980c87d0 msgr2=0x7ff1980acef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:24.519 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:24.508+0000 7ff197fff640 1 --2- 172.21.15.53:0/2997379680 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1980c87d0 0x7ff1980acef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:24.519 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:24.508+0000 7ff197fff640 1 -- 172.21.15.53:0/2997379680 >> v1:172.21.15.117:6789/0 conn(0x7ff1980ad430 legacy=0x7ff1980cbd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:24.519 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:24.508+0000 7ff197fff640 1 -- 172.21.15.53:0/2997379680 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1980cd980 con 0x7ff1980708c0 2023-06-10T18:52:24.519 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:24.508+0000 7ff197fff640 1 --2- 172.21.15.53:0/2997379680 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1980708c0 0x7ff198070c90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff188006fd0 tx=0x7ff18801eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=223c92546463eeb2 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:24.520 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:24.508+0000 7ff196ffd640 1 -- 172.21.15.53:0/2997379680 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1880a7ac0 con 0x7ff1980708c0 2023-06-10T18:52:24.520 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:24.508+0000 7ff196ffd640 1 -- 172.21.15.53:0/2997379680 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1880a7c20 con 0x7ff1980708c0 2023-06-10T18:52:24.520 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:24.508+0000 7ff196ffd640 1 -- 172.21.15.53:0/2997379680 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1880af440 con 0x7ff1980708c0 2023-06-10T18:52:24.521 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:24.508+0000 7ff19e555640 1 -- 172.21.15.53:0/2997379680 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1980708c0 msgr2=0x7ff198070c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:24.521 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:24.508+0000 7ff19e555640 1 --2- 172.21.15.53:0/2997379680 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1980708c0 0x7ff198070c90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff188006fd0 tx=0x7ff18801eb60 comp rx=0 tx=0).stop 2023-06-10T18:52:24.521 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:24.512+0000 7ff19e555640 1 -- 172.21.15.53:0/2997379680 shutdown_connections 2023-06-10T18:52:24.521 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:24.512+0000 7ff19e555640 1 --2- 172.21.15.53:0/2997379680 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1980c87d0 0x7ff1980acef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:24.521 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:24.512+0000 7ff19e555640 1 --2- 172.21.15.53:0/2997379680 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1980708c0 0x7ff198070c90 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:24.521 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:24.512+0000 7ff19e555640 1 -- 172.21.15.53:0/2997379680 >> 172.21.15.53:0/2997379680 conn(0x7ff1980cac00 msgr2=0x7ff1980cb000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:24.522 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:24.512+0000 7ff19e555640 1 -- 172.21.15.53:0/2997379680 shutdown_connections 2023-06-10T18:52:24.522 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:24.512+0000 7ff19e555640 1 -- 172.21.15.53:0/2997379680 wait complete. 2023-06-10T18:52:24.523 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:24.512+0000 7ff19e555640 1 Processor -- start 2023-06-10T18:52:24.523 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:24.512+0000 7ff19e555640 1 -- start start 2023-06-10T18:52:24.524 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:24.512+0000 7ff19e555640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1980708c0 0x7ff1980acb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:24.524 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:24.512+0000 7ff19e555640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1980ad430 0x7ff198149f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:24.524 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:24.512+0000 7ff19e555640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1980c87d0 0x7ff198158520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:24.524 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:24.512+0000 7ff19e555640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff19814f600 con 0x7ff1980ad430 2023-06-10T18:52:24.524 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:24.512+0000 7ff19e555640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff19814e980 con 0x7ff1980708c0 2023-06-10T18:52:24.524 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:24.512+0000 7ff19e555640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff19814ec60 con 0x7ff1980c87d0 2023-06-10T18:52:24.524 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:24.512+0000 7ff1977fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1980ad430 0x7ff198149f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:24.526 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:24.512+0000 7ff1977fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1980ad430 0x7ff198149f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:32784/0 (socket says 172.21.15.53:32784) 2023-06-10T18:52:24.526 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:24.512+0000 7ff1977fe640 1 -- 172.21.15.53:0/3393946791 learned_addr learned my addr 172.21.15.53:0/3393946791 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:24.526 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:24.512+0000 7ff197fff640 1 --2- 172.21.15.53:0/3393946791 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1980708c0 0x7ff1980acb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:24.527 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:24.512+0000 7ff19caf2640 1 --2- 172.21.15.53:0/3393946791 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1980c87d0 0x7ff198158520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:24.527 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:24.512+0000 7ff1977fe640 1 -- 172.21.15.53:0/3393946791 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1980c87d0 msgr2=0x7ff198158520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:24.527 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:24.512+0000 7ff1977fe640 1 --2- 172.21.15.53:0/3393946791 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1980c87d0 0x7ff198158520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:24.527 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:24.512+0000 7ff1977fe640 1 -- 172.21.15.53:0/3393946791 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1980708c0 msgr2=0x7ff1980acb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:24.527 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:24.512+0000 7ff1977fe640 1 --2- 172.21.15.53:0/3393946791 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1980708c0 0x7ff1980acb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:24.527 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:24.512+0000 7ff1977fe640 1 -- 172.21.15.53:0/3393946791 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff18800b720 con 0x7ff1980ad430 2023-06-10T18:52:24.527 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:24.512+0000 7ff197fff640 1 --2- 172.21.15.53:0/3393946791 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1980708c0 0x7ff1980acb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:52:24.528 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:24.512+0000 7ff1977fe640 1 --2- 172.21.15.53:0/3393946791 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1980ad430 0x7ff198149f30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff18c00d5f0 tx=0x7ff18c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:24.528 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:24.512+0000 7ff194ff9640 1 -- 172.21.15.53:0/3393946791 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff18c0125f0 con 0x7ff1980ad430 2023-06-10T18:52:24.528 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:24.512+0000 7ff194ff9640 1 -- 172.21.15.53:0/3393946791 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff18c012750 con 0x7ff1980ad430 2023-06-10T18:52:24.528 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:24.512+0000 7ff19e555640 1 -- 172.21.15.53:0/3393946791 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff19814ef40 con 0x7ff1980ad430 2023-06-10T18:52:24.528 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:24.512+0000 7ff194ff9640 1 -- 172.21.15.53:0/3393946791 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff18c012ae0 con 0x7ff1980ad430 2023-06-10T18:52:24.528 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:24.512+0000 7ff19e555640 1 -- 172.21.15.53:0/3393946791 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff19814a820 con 0x7ff1980ad430 2023-06-10T18:52:24.528 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:24.512+0000 7ff194ff9640 1 -- 172.21.15.53:0/3393946791 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff18c01e460 con 0x7ff1980ad430 2023-06-10T18:52:24.528 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:24.512+0000 7ff194ff9640 1 -- 172.21.15.53:0/3393946791 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7ff18c014b50 con 0x7ff1980ad430 2023-06-10T18:52:24.529 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:24.512+0000 7ff19e555640 1 -- 172.21.15.53:0/3393946791 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff19814f740 con 0x7ff1980ad430 2023-06-10T18:52:24.529 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:24.516+0000 7ff194ff9640 1 -- 172.21.15.53:0/3393946791 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7ff19814f740 con 0x7ff1980ad430 2023-06-10T18:52:24.529 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-06-10T18:52:24.516+0000 7fb19a0b5180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-06-10T18:52:24.583 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:24.572+0000 7ff19e555640 1 -- 172.21.15.53:0/3393946791 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff19804d790 con 0x7ff1980ad430 2023-06-10T18:52:24.584 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:24.572+0000 7ff194ff9640 1 -- 172.21.15.53:0/3393946791 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7ff18c014480 con 0x7ff1980ad430 2023-06-10T18:52:24.584 INFO:teuthology.misc.health.smithi053.stdout: 2023-06-10T18:52:24.585 INFO:teuthology.misc.health.smithi053.stdout:{"epoch":10,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T18:52:23.319802+0000","last_up_change":"0.000000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T18:52:24.585 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:24.576+0000 7ff19e555640 1 -- 172.21.15.53:0/3393946791 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1980ad430 msgr2=0x7ff198149f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:24.586 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:24.576+0000 7ff19e555640 1 --2- 172.21.15.53:0/3393946791 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1980ad430 0x7ff198149f30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff18c00d5f0 tx=0x7ff18c00dab0 comp rx=0 tx=0).stop 2023-06-10T18:52:24.586 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:24.576+0000 7ff19e555640 1 -- 172.21.15.53:0/3393946791 shutdown_connections 2023-06-10T18:52:24.586 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:24.576+0000 7ff19e555640 1 --2- 172.21.15.53:0/3393946791 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1980c87d0 0x7ff198158520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:24.586 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:24.576+0000 7ff19e555640 1 --2- 172.21.15.53:0/3393946791 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1980ad430 0x7ff198149f30 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:24.586 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:24.576+0000 7ff19e555640 1 --2- 172.21.15.53:0/3393946791 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1980708c0 0x7ff1980acb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:24.586 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:24.576+0000 7ff19e555640 1 -- 172.21.15.53:0/3393946791 >> 172.21.15.53:0/3393946791 conn(0x7ff1980cac00 msgr2=0x7ff1980c8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:24.586 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:24.576+0000 7ff19e555640 1 -- 172.21.15.53:0/3393946791 shutdown_connections 2023-06-10T18:52:24.586 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:24.576+0000 7ff19e555640 1 -- 172.21.15.53:0/3393946791 wait complete. 2023-06-10T18:52:24.599 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-06-10T18:52:24.910 INFO:tasks.ceph.mgr.x.smithi117.stderr:2023-06-10T18:52:24.903+0000 7f28f183f180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-06-10T18:52:24.984 INFO:tasks.ceph.mgr.x.smithi117.stderr:2023-06-10T18:52:24.975+0000 7f28f183f180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-06-10T18:52:25.143 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-06-10T18:52:25.132+0000 7fb19a0b5180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-06-10T18:52:25.153 INFO:tasks.ceph.mgr.x.smithi117.stderr:2023-06-10T18:52:25.147+0000 7f28f183f180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-06-10T18:52:25.221 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-06-10T18:52:25.212+0000 7fb19a0b5180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-06-10T18:52:25.227 INFO:tasks.ceph.mgr.x.smithi117.stderr:2023-06-10T18:52:25.219+0000 7f28f183f180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-06-10T18:52:25.397 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-06-10T18:52:25.388+0000 7fb19a0b5180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-06-10T18:52:25.469 INFO:tasks.ceph.mgr.x.smithi117.stderr:2023-06-10T18:52:25.463+0000 7f28f183f180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-06-10T18:52:25.473 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-06-10T18:52:25.464+0000 7fb19a0b5180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-06-10T18:52:25.528 INFO:tasks.ceph.mgr.x.smithi117.stderr:2023-06-10T18:52:25.519+0000 7f28f183f180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-06-10T18:52:25.729 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-06-10T18:52:25.720+0000 7fb19a0b5180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-06-10T18:52:25.792 INFO:tasks.ceph.mgr.y.smithi053.stderr:2023-06-10T18:52:25.780+0000 7fb19a0b5180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-06-10T18:52:26.574 INFO:tasks.ceph.mgr.x.smithi117.stderr:2023-06-10T18:52:26.567+0000 7f28993fa640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-06-10T18:52:26.576 INFO:tasks.ceph.mgr.x.smithi117.stderr:2023-06-10T18:52:26.567+0000 7f28993fa640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-06-10T18:52:27.669 INFO:tasks.ceph.osd.6.smithi117.stderr:2023-06-10T18:52:27.663+0000 7f375c826640 -1 osd.6 0 log_to_monitors true 2023-06-10T18:52:27.755 INFO:tasks.ceph.osd.5.smithi117.stderr:2023-06-10T18:52:27.747+0000 7fc72962e640 -1 osd.5 0 log_to_monitors true 2023-06-10T18:52:27.773 INFO:tasks.ceph.osd.2.smithi053.stderr:2023-06-10T18:52:27.764+0000 7fdff3dd0640 -1 osd.2 0 log_to_monitors true 2023-06-10T18:52:27.849 INFO:tasks.ceph.osd.7.smithi117.stderr:2023-06-10T18:52:27.843+0000 7f86b7721640 -1 osd.7 0 log_to_monitors true 2023-06-10T18:52:27.869 INFO:tasks.ceph.osd.1.smithi053.stderr:2023-06-10T18:52:27.860+0000 7f3b661df640 -1 osd.1 0 log_to_monitors true 2023-06-10T18:52:27.869 INFO:tasks.ceph.osd.0.smithi053.stderr:2023-06-10T18:52:27.860+0000 7f1486425640 -1 osd.0 0 log_to_monitors true 2023-06-10T18:52:27.890 INFO:tasks.ceph.osd.4.smithi117.stderr:2023-06-10T18:52:27.883+0000 7f6038d0f640 -1 osd.4 0 log_to_monitors true 2023-06-10T18:52:27.924 INFO:tasks.ceph.osd.3.smithi053.stderr:2023-06-10T18:52:27.912+0000 7f7020f9a640 -1 osd.3 0 log_to_monitors true 2023-06-10T18:52:31.224 INFO:tasks.ceph.osd.2.smithi053.stderr:2023-06-10T18:52:31.216+0000 7fdfef552640 -1 osd.2 0 waiting for initial osdmap 2023-06-10T18:52:31.260 INFO:tasks.ceph.osd.2.smithi053.stderr:2023-06-10T18:52:31.252+0000 7fdfe7b97640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-10T18:52:31.269 INFO:tasks.ceph.osd.0.smithi053.stderr:2023-06-10T18:52:31.260+0000 7f1481ba7640 -1 osd.0 0 waiting for initial osdmap 2023-06-10T18:52:31.292 INFO:tasks.ceph.osd.0.smithi053.stderr:2023-06-10T18:52:31.284+0000 7f147a1ec640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-10T18:52:31.300 INFO:tasks.ceph.osd.1.smithi053.stderr:2023-06-10T18:52:31.292+0000 7f3b6319c640 -1 osd.1 0 waiting for initial osdmap 2023-06-10T18:52:31.328 INFO:tasks.ceph.osd.3.smithi053.stderr:2023-06-10T18:52:31.316+0000 7f701c71c640 -1 osd.3 0 waiting for initial osdmap 2023-06-10T18:52:31.336 INFO:tasks.ceph.osd.1.smithi053.stderr:2023-06-10T18:52:31.328+0000 7f3b59fa6640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-10T18:52:31.348 INFO:tasks.ceph.osd.3.smithi053.stderr:2023-06-10T18:52:31.340+0000 7f7014d61640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-10T18:52:31.406 DEBUG:teuthology.orchestra.run.smithi053:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-06-10T18:52:31.520 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.508+0000 7fef0a300640 1 Processor -- start 2023-06-10T18:52:31.520 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.508+0000 7fef0a300640 1 -- start start 2023-06-10T18:52:31.521 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.512+0000 7fef0a300640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fef040698b0 0x7fef040c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:31.521 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.512+0000 7fef0a300640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef04159db0 con 0x7fef041599e0 2023-06-10T18:52:31.522 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.512+0000 7fef0a300640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef0406c280 con 0x7fef04069450 2023-06-10T18:52:31.522 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.512+0000 7fef0a300640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef040703e0 con 0x7fef040698b0 2023-06-10T18:52:31.522 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.512+0000 7fef03fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fef041599e0 0x7fef0406c6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:33674/0 (socket says 172.21.15.53:33674) 2023-06-10T18:52:31.522 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.512+0000 7fef03fff640 1 -- 172.21.15.53:0/2999342898 learned_addr learned my addr 172.21.15.53:0/2999342898 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:52:31.522 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.512+0000 7fef0889d640 1 --2- 172.21.15.53:0/2999342898 >> v2:172.21.15.117:3300/0 conn(0x7fef040698b0 0x7fef040c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:31.523 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.512+0000 7fef02ffd640 1 -- 172.21.15.53:0/2999342898 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2252932037 0 0) 0x7fef04159db0 con 0x7fef041599e0 2023-06-10T18:52:31.524 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.512+0000 7fef02ffd640 1 -- 172.21.15.53:0/2999342898 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feeec003530 con 0x7fef041599e0 2023-06-10T18:52:31.524 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.512+0000 7fef02ffd640 1 -- 172.21.15.53:0/2999342898 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 981336938 0 0) 0x7feeec003530 con 0x7fef041599e0 2023-06-10T18:52:31.524 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.512+0000 7fef02ffd640 1 -- 172.21.15.53:0/2999342898 >> v2:172.21.15.117:3300/0 conn(0x7fef040698b0 msgr2=0x7fef040c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:31.524 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.512+0000 7fef02ffd640 1 --2- 172.21.15.53:0/2999342898 >> v2:172.21.15.117:3300/0 conn(0x7fef040698b0 0x7fef040c8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:31.524 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.512+0000 7fef02ffd640 1 -- 172.21.15.53:0/2999342898 >> v1:172.21.15.117:6789/0 conn(0x7fef04069450 legacy=0x7fef040c8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:31.524 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.512+0000 7fef02ffd640 1 -- 172.21.15.53:0/2999342898 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef040705d0 con 0x7fef041599e0 2023-06-10T18:52:31.525 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.512+0000 7fef02ffd640 1 -- 172.21.15.53:0/2999342898 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7feef4001680 con 0x7fef041599e0 2023-06-10T18:52:31.525 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.512+0000 7fef02ffd640 1 -- 172.21.15.53:0/2999342898 >> v1:172.21.15.53:6789/0 conn(0x7fef041599e0 legacy=0x7fef0406c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:31.525 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.512+0000 7fef02ffd640 1 --2- 172.21.15.53:0/2999342898 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feeec003980 0x7feeec003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:31.525 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.512+0000 7fef02ffd640 1 --2- 172.21.15.53:0/2999342898 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feeec0047d0 0x7feeec004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:31.525 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.512+0000 7fef02ffd640 1 --2- 172.21.15.53:0/2999342898 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feeec005180 0x7feeec00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:31.525 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.512+0000 7fef02ffd640 1 -- 172.21.15.53:0/2999342898 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeec00bfd0 con 0x7feeec005180 2023-06-10T18:52:31.525 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.512+0000 7fef02ffd640 1 -- 172.21.15.53:0/2999342898 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeec00c140 con 0x7feeec0047d0 2023-06-10T18:52:31.526 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.512+0000 7fef02ffd640 1 -- 172.21.15.53:0/2999342898 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeec00c300 con 0x7feeec003980 2023-06-10T18:52:31.526 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.512+0000 7fef0889d640 1 --2- 172.21.15.53:0/2999342898 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feeec005180 0x7feeec00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:31.526 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.512+0000 7fef037fe640 1 --2- 172.21.15.53:0/2999342898 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feeec0047d0 0x7feeec004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:31.526 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.512+0000 7fef03fff640 1 --2- 172.21.15.53:0/2999342898 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feeec003980 0x7feeec003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:31.526 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.512+0000 7fef0889d640 1 -- 172.21.15.53:0/2999342898 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feeec003980 msgr2=0x7feeec003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:31.526 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.512+0000 7fef0889d640 1 --2- 172.21.15.53:0/2999342898 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feeec003980 0x7feeec003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:31.526 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.512+0000 7fef0889d640 1 -- 172.21.15.53:0/2999342898 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feeec0047d0 msgr2=0x7feeec004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:31.526 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.512+0000 7fef0889d640 1 --2- 172.21.15.53:0/2999342898 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feeec0047d0 0x7feeec004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:31.527 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.512+0000 7fef0889d640 1 -- 172.21.15.53:0/2999342898 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeec003530 con 0x7feeec005180 2023-06-10T18:52:31.529 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.516+0000 7fef0889d640 1 -- 172.21.15.53:0/2999342898 reap_dead start 2023-06-10T18:52:31.529 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.516+0000 7fef0889d640 1 --2- 172.21.15.53:0/2999342898 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feeec005180 0x7feeec00b990 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7feefc009fc0 tx=0x7feefc01cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6eda1513a40c303 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:31.529 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.516+0000 7fef02ffd640 1 -- 172.21.15.53:0/2999342898 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feefc0a5cb0 con 0x7feeec005180 2023-06-10T18:52:31.529 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.516+0000 7fef02ffd640 1 -- 172.21.15.53:0/2999342898 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feefc00f040 con 0x7feeec005180 2023-06-10T18:52:31.529 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.516+0000 7fef02ffd640 1 -- 172.21.15.53:0/2999342898 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feefc003be0 con 0x7feeec005180 2023-06-10T18:52:31.529 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.516+0000 7fef0a300640 1 -- 172.21.15.53:0/2999342898 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feeec005180 msgr2=0x7feeec00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:31.529 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.516+0000 7fef0a300640 1 --2- 172.21.15.53:0/2999342898 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feeec005180 0x7feeec00b990 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7feefc009fc0 tx=0x7feefc01cca0 comp rx=0 tx=0).stop 2023-06-10T18:52:31.530 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.516+0000 7fef0a300640 1 -- 172.21.15.53:0/2999342898 shutdown_connections 2023-06-10T18:52:31.530 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.516+0000 7fef0a300640 1 --2- 172.21.15.53:0/2999342898 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feeec005180 0x7feeec00b990 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:31.530 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.516+0000 7fef0a300640 1 -- 172.21.15.53:0/2999342898 >> 172.21.15.53:0/2999342898 conn(0x7fef040cdee0 msgr2=0x7fef040ce2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:31.530 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.516+0000 7fef0a300640 1 -- 172.21.15.53:0/2999342898 shutdown_connections 2023-06-10T18:52:31.530 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.516+0000 7fef0a300640 1 -- 172.21.15.53:0/2999342898 wait complete. 2023-06-10T18:52:31.530 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.516+0000 7fef0a300640 1 Processor -- start 2023-06-10T18:52:31.530 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.516+0000 7fef0a300640 1 -- start start 2023-06-10T18:52:31.531 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.516+0000 7fef0a300640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feeec005180 0x7fef04148f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:31.531 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.516+0000 7fef0a300640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef04154150 0x7fef041545c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:31.531 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.516+0000 7fef0a300640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef0415b970 0x7fef0415be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:31.531 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.516+0000 7fef0a300640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef04154b00 con 0x7fef0415b970 2023-06-10T18:52:31.531 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.516+0000 7fef0a300640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef04149480 con 0x7fef04154150 2023-06-10T18:52:31.531 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.516+0000 7fef0a300640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef04099b60 con 0x7feeec005180 2023-06-10T18:52:31.531 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.516+0000 7fef03fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feeec005180 0x7fef04148f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:31.532 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.516+0000 7fef03fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feeec005180 0x7fef04148f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.53:57380/0 (socket says 172.21.15.53:57380) 2023-06-10T18:52:31.532 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.516+0000 7fef03fff640 1 -- 172.21.15.53:0/2707163984 learned_addr learned my addr 172.21.15.53:0/2707163984 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:31.532 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.516+0000 7fef037fe640 1 --2- 172.21.15.53:0/2707163984 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef04154150 0x7fef041545c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:31.532 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.516+0000 7fef0889d640 1 --2- 172.21.15.53:0/2707163984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef0415b970 0x7fef0415be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:31.532 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.516+0000 7fef037fe640 1 -- 172.21.15.53:0/2707163984 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feeec005180 msgr2=0x7fef04148f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:31.532 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.516+0000 7fef037fe640 1 --2- 172.21.15.53:0/2707163984 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feeec005180 0x7fef04148f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:31.532 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.516+0000 7fef037fe640 1 -- 172.21.15.53:0/2707163984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef0415b970 msgr2=0x7fef0415be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:31.533 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.516+0000 7fef037fe640 1 --2- 172.21.15.53:0/2707163984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef0415b970 0x7fef0415be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:31.533 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.516+0000 7fef037fe640 1 -- 172.21.15.53:0/2707163984 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef04099e40 con 0x7fef04154150 2023-06-10T18:52:31.533 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.520+0000 7fef037fe640 1 --2- 172.21.15.53:0/2707163984 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef04154150 0x7fef041545c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7feef800f5f0 tx=0x7feef800fab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:31.533 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.520+0000 7fef00ff9640 1 -- 172.21.15.53:0/2707163984 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef80053a0 con 0x7fef04154150 2023-06-10T18:52:31.533 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.520+0000 7fef00ff9640 1 -- 172.21.15.53:0/2707163984 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feef8003600 con 0x7fef04154150 2023-06-10T18:52:31.533 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.520+0000 7fef0a300640 1 -- 172.21.15.53:0/2707163984 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef0409a120 con 0x7fef04154150 2023-06-10T18:52:31.533 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.520+0000 7fef00ff9640 1 -- 172.21.15.53:0/2707163984 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef80039d0 con 0x7fef04154150 2023-06-10T18:52:31.533 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.520+0000 7fef0a300640 1 -- 172.21.15.53:0/2707163984 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef0415c6e0 con 0x7fef04154150 2023-06-10T18:52:31.534 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.520+0000 7fef0a300640 1 -- 172.21.15.53:0/2707163984 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef0404d790 con 0x7fef04154150 2023-06-10T18:52:31.534 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.520+0000 7fef00ff9640 1 -- 172.21.15.53:0/2707163984 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 4) v1 ==== 85602+0+0 (secure 0 0 0) 0x7feef8003b30 con 0x7fef04154150 2023-06-10T18:52:31.535 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.520+0000 7fef00ff9640 1 --2- 172.21.15.53:0/2707163984 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7feef0066220 0x7feef00686d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:31.535 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.520+0000 7fef00ff9640 1 -- 172.21.15.53:0/2707163984 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7feef80834d0 con 0x7fef04154150 2023-06-10T18:52:31.535 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.520+0000 7fef03fff640 1 --2- 172.21.15.53:0/2707163984 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7feef0066220 0x7feef00686d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:31.535 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.520+0000 7fef03fff640 1 --2- 172.21.15.53:0/2707163984 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7feef0066220 0x7feef00686d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7feef4001060 tx=0x7feef4000f90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:31.539 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.528+0000 7fef00ff9640 1 -- 172.21.15.53:0/2707163984 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7feef80519c0 con 0x7fef04154150 2023-06-10T18:52:31.690 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.680+0000 7fef0a300640 1 -- 172.21.15.53:0/2707163984 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fef04153470 con 0x7fef04154150 2023-06-10T18:52:31.691 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.680+0000 7fef00ff9640 1 -- 172.21.15.53:0/2707163984 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7feef8054fe0 con 0x7fef04154150 2023-06-10T18:52:31.691 INFO:teuthology.misc.health.smithi053.stdout: 2023-06-10T18:52:31.692 INFO:teuthology.misc.health.smithi053.stdout:{"epoch":12,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T18:52:29.573620+0000","last_up_change":"0.000000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T18:52:31.693 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.684+0000 7fef0a300640 1 -- 172.21.15.53:0/2707163984 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7feef0066220 msgr2=0x7feef00686d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:31.693 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.684+0000 7fef0a300640 1 --2- 172.21.15.53:0/2707163984 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7feef0066220 0x7feef00686d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7feef4001060 tx=0x7feef4000f90 comp rx=0 tx=0).stop 2023-06-10T18:52:31.693 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.684+0000 7fef0a300640 1 -- 172.21.15.53:0/2707163984 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef04154150 msgr2=0x7fef041545c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:31.694 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.684+0000 7fef0a300640 1 --2- 172.21.15.53:0/2707163984 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef04154150 0x7fef041545c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7feef800f5f0 tx=0x7feef800fab0 comp rx=0 tx=0).stop 2023-06-10T18:52:31.694 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.684+0000 7fef0a300640 1 -- 172.21.15.53:0/2707163984 shutdown_connections 2023-06-10T18:52:31.694 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.684+0000 7fef0a300640 1 --2- 172.21.15.53:0/2707163984 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7feef0066220 0x7feef00686d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:31.694 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.684+0000 7fef0a300640 1 --2- 172.21.15.53:0/2707163984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef0415b970 0x7fef0415be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:31.694 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.684+0000 7fef0a300640 1 --2- 172.21.15.53:0/2707163984 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef04154150 0x7fef041545c0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:31.694 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.684+0000 7fef0a300640 1 --2- 172.21.15.53:0/2707163984 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feeec005180 0x7fef04148f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:31.694 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.684+0000 7fef0a300640 1 -- 172.21.15.53:0/2707163984 >> 172.21.15.53:0/2707163984 conn(0x7fef040cdee0 msgr2=0x7fef04157bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:31.695 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.684+0000 7fef0a300640 1 -- 172.21.15.53:0/2707163984 shutdown_connections 2023-06-10T18:52:31.695 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:31.684+0000 7fef0a300640 1 -- 172.21.15.53:0/2707163984 wait complete. 2023-06-10T18:52:31.709 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-06-10T18:52:31.865 INFO:tasks.ceph.osd.6.smithi117.stderr:2023-06-10T18:52:31.859+0000 7f3757fa8640 -1 osd.6 0 waiting for initial osdmap 2023-06-10T18:52:31.866 INFO:tasks.ceph.osd.7.smithi117.stderr:2023-06-10T18:52:31.859+0000 7f86b2ea3640 -1 osd.7 0 waiting for initial osdmap 2023-06-10T18:52:31.885 INFO:tasks.ceph.osd.5.smithi117.stderr:2023-06-10T18:52:31.879+0000 7fc724db0640 -1 osd.5 0 waiting for initial osdmap 2023-06-10T18:52:31.901 INFO:tasks.ceph.osd.7.smithi117.stderr:2023-06-10T18:52:31.895+0000 7f86ab4e8640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-10T18:52:31.902 INFO:tasks.ceph.osd.6.smithi117.stderr:2023-06-10T18:52:31.895+0000 7f37505ed640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-10T18:52:31.917 INFO:tasks.ceph.osd.5.smithi117.stderr:2023-06-10T18:52:31.911+0000 7fc71d3f5640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-10T18:52:31.926 INFO:tasks.ceph.osd.4.smithi117.stderr:2023-06-10T18:52:31.919+0000 7f6035ccc640 -1 osd.4 0 waiting for initial osdmap 2023-06-10T18:52:31.953 INFO:tasks.ceph.osd.4.smithi117.stderr:2023-06-10T18:52:31.947+0000 7f602cad6640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-10T18:52:35.838 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-10T18:52:35.841 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-10T18:52:38.515 DEBUG:teuthology.orchestra.run.smithi053:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-06-10T18:52:38.640 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:38.632+0000 7fbc6ee75640 1 Processor -- start 2023-06-10T18:52:38.641 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:38.632+0000 7fbc6ee75640 1 -- start start 2023-06-10T18:52:38.641 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:38.632+0000 7fbc6ee75640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbc681599e0 0x7fbc6806c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:38.642 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:38.632+0000 7fbc6ee75640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbc68069b60 0x7fbc680c8530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:38.642 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:38.632+0000 7fbc6ee75640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc68159db0 con 0x7fbc6806cc30 2023-06-10T18:52:38.642 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:38.632+0000 7fbc6ee75640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc680703e0 con 0x7fbc68069b60 2023-06-10T18:52:38.642 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:38.632+0000 7fbc6ee75640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc6806c280 con 0x7fbc681599e0 2023-06-10T18:52:38.642 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:38.632+0000 7fbc6d412640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbc68069b60 0x7fbc680c8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:38.642 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:38.632+0000 7fbc67fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fbc6806cc30 0x7fbc68069450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:33676/0 (socket says 172.21.15.53:33676) 2023-06-10T18:52:38.643 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:38.632+0000 7fbc6d412640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbc68069b60 0x7fbc680c8530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40974/0 (socket says 172.21.15.53:40974) 2023-06-10T18:52:38.643 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:38.632+0000 7fbc67fff640 1 -- 172.21.15.53:0/18770934 learned_addr learned my addr 172.21.15.53:0/18770934 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:52:38.643 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:38.632+0000 7fbc6cc11640 1 --2- 172.21.15.53:0/18770934 >> v2:172.21.15.117:3300/0 conn(0x7fbc681599e0 0x7fbc6806c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:38.643 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:38.632+0000 7fbc6d412640 1 -- 172.21.15.53:0/18770934 >> v2:172.21.15.117:3300/0 conn(0x7fbc681599e0 msgr2=0x7fbc6806c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:38.644 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:38.632+0000 7fbc6d412640 1 --2- 172.21.15.53:0/18770934 >> v2:172.21.15.117:3300/0 conn(0x7fbc681599e0 0x7fbc6806c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:38.644 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:38.632+0000 7fbc6d412640 1 -- 172.21.15.53:0/18770934 >> v1:172.21.15.53:6789/0 conn(0x7fbc6806cc30 legacy=0x7fbc68069450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:38.644 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:38.632+0000 7fbc6d412640 1 -- 172.21.15.53:0/18770934 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc680705d0 con 0x7fbc68069b60 2023-06-10T18:52:38.645 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:38.636+0000 7fbc6d412640 1 --2- 172.21.15.53:0/18770934 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc68069b60 0x7fbc680c8530 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fbc680ca8c0 tx=0x7fbc6001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7983e59b9ea0f7fc server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:38.645 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:38.636+0000 7fbc677fe640 1 -- 172.21.15.53:0/18770934 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc600a58c0 con 0x7fbc68069b60 2023-06-10T18:52:38.645 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:38.636+0000 7fbc677fe640 1 -- 172.21.15.53:0/18770934 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc600a5a20 con 0x7fbc68069b60 2023-06-10T18:52:38.645 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:38.636+0000 7fbc677fe640 1 -- 172.21.15.53:0/18770934 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc600a5db0 con 0x7fbc68069b60 2023-06-10T18:52:38.645 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:38.636+0000 7fbc6ee75640 1 -- 172.21.15.53:0/18770934 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc68069b60 msgr2=0x7fbc680c8530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:38.646 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:38.636+0000 7fbc6ee75640 1 --2- 172.21.15.53:0/18770934 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc68069b60 0x7fbc680c8530 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fbc680ca8c0 tx=0x7fbc6001c910 comp rx=0 tx=0).stop 2023-06-10T18:52:38.646 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:38.636+0000 7fbc6ee75640 1 -- 172.21.15.53:0/18770934 shutdown_connections 2023-06-10T18:52:38.646 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:38.636+0000 7fbc6ee75640 1 --2- 172.21.15.53:0/18770934 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc68069b60 0x7fbc680c8530 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:38.646 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:38.636+0000 7fbc6ee75640 1 --2- 172.21.15.53:0/18770934 >> v2:172.21.15.117:3300/0 conn(0x7fbc681599e0 0x7fbc6806c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:38.646 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:38.636+0000 7fbc6ee75640 1 -- 172.21.15.53:0/18770934 >> 172.21.15.53:0/18770934 conn(0x7fbc680cdee0 msgr2=0x7fbc680ce2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:38.646 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:38.636+0000 7fbc6ee75640 1 -- 172.21.15.53:0/18770934 shutdown_connections 2023-06-10T18:52:38.646 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:38.636+0000 7fbc6ee75640 1 -- 172.21.15.53:0/18770934 wait complete. 2023-06-10T18:52:38.648 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:38.636+0000 7fbc6ee75640 1 Processor -- start 2023-06-10T18:52:38.648 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:38.636+0000 7fbc6ee75640 1 -- start start 2023-06-10T18:52:38.648 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:38.636+0000 7fbc6ee75640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc68069b60 0x7fbc680b0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:38.648 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:38.636+0000 7fbc6ee75640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc6806cc30 0x7fbc680c4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:38.648 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:38.636+0000 7fbc6ee75640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc681599e0 0x7fbc680c6a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:38.649 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:38.636+0000 7fbc6ee75640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc680c65f0 con 0x7fbc681599e0 2023-06-10T18:52:38.649 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:38.636+0000 7fbc6ee75640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc680c59e0 con 0x7fbc68069b60 2023-06-10T18:52:38.649 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:38.636+0000 7fbc6ee75640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc680c5cc0 con 0x7fbc6806cc30 2023-06-10T18:52:38.649 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:38.636+0000 7fbc6d412640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc681599e0 0x7fbc680c6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:38.649 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:38.636+0000 7fbc6d412640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc681599e0 0x7fbc680c6a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40988/0 (socket says 172.21.15.53:40988) 2023-06-10T18:52:38.649 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:38.636+0000 7fbc6d412640 1 -- 172.21.15.53:0/213330539 learned_addr learned my addr 172.21.15.53:0/213330539 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:38.649 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:38.636+0000 7fbc6cc11640 1 --2- 172.21.15.53:0/213330539 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc68069b60 0x7fbc680b0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:38.650 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:38.636+0000 7fbc6d412640 1 -- 172.21.15.53:0/213330539 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc6806cc30 msgr2=0x7fbc680c4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:38.650 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:38.636+0000 7fbc6d412640 1 --2- 172.21.15.53:0/213330539 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc6806cc30 0x7fbc680c4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:38.650 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:38.636+0000 7fbc6d412640 1 -- 172.21.15.53:0/213330539 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc68069b60 msgr2=0x7fbc680b0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:38.650 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:38.636+0000 7fbc6d412640 1 --2- 172.21.15.53:0/213330539 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc68069b60 0x7fbc680b0090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:38.650 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:38.636+0000 7fbc6d412640 1 -- 172.21.15.53:0/213330539 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc60009a70 con 0x7fbc681599e0 2023-06-10T18:52:38.650 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:38.636+0000 7fbc6d412640 1 --2- 172.21.15.53:0/213330539 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc681599e0 0x7fbc680c6a80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbc60019520 tx=0x7fbc600196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:38.650 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:38.636+0000 7fbc657fa640 1 -- 172.21.15.53:0/213330539 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc600b9860 con 0x7fbc681599e0 2023-06-10T18:52:38.651 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:38.636+0000 7fbc657fa640 1 -- 172.21.15.53:0/213330539 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc600b99c0 con 0x7fbc681599e0 2023-06-10T18:52:38.651 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:38.636+0000 7fbc6ee75640 1 -- 172.21.15.53:0/213330539 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc680c5fa0 con 0x7fbc681599e0 2023-06-10T18:52:38.651 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:38.636+0000 7fbc657fa640 1 -- 172.21.15.53:0/213330539 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc600b9d70 con 0x7fbc681599e0 2023-06-10T18:52:38.651 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:38.636+0000 7fbc6ee75640 1 -- 172.21.15.53:0/213330539 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc6815be50 con 0x7fbc681599e0 2023-06-10T18:52:38.652 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:38.640+0000 7fbc6ee75640 1 -- 172.21.15.53:0/213330539 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc680c6760 con 0x7fbc681599e0 2023-06-10T18:52:38.652 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:38.640+0000 7fbc657fa640 1 -- 172.21.15.53:0/213330539 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbc600c4460 con 0x7fbc681599e0 2023-06-10T18:52:38.652 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:38.640+0000 7fbc657fa640 1 --2- 172.21.15.53:0/213330539 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbc4c066280 0x7fbc4c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:38.652 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:38.640+0000 7fbc657fa640 1 -- 172.21.15.53:0/213330539 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fbc6011ec70 con 0x7fbc681599e0 2023-06-10T18:52:38.653 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:38.640+0000 7fbc6cc11640 1 --2- 172.21.15.53:0/213330539 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbc4c066280 0x7fbc4c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:38.653 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:38.640+0000 7fbc6cc11640 1 --2- 172.21.15.53:0/213330539 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbc4c066280 0x7fbc4c068730 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c0096f0 tx=0x7fbc5c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:38.667 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:38.656+0000 7fbc657fa640 1 -- 172.21.15.53:0/213330539 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbc600ec6c0 con 0x7fbc681599e0 2023-06-10T18:52:38.821 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:38.812+0000 7fbc6ee75640 1 -- 172.21.15.53:0/213330539 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbc6804d790 con 0x7fbc681599e0 2023-06-10T18:52:38.823 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:38.812+0000 7fbc657fa640 1 -- 172.21.15.53:0/213330539 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12838 (secure 0 0 0) 0x7fbc600efce0 con 0x7fbc681599e0 2023-06-10T18:52:38.824 INFO:teuthology.misc.health.smithi053.stdout: 2023-06-10T18:52:38.824 INFO:teuthology.misc.health.smithi053.stdout:{"epoch":16,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T18:52:35.867184+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T18:52:38.825 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:38.816+0000 7fbc6ee75640 1 -- 172.21.15.53:0/213330539 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbc4c066280 msgr2=0x7fbc4c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:38.826 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:38.816+0000 7fbc6ee75640 1 --2- 172.21.15.53:0/213330539 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbc4c066280 0x7fbc4c068730 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c0096f0 tx=0x7fbc5c008040 comp rx=0 tx=0).stop 2023-06-10T18:52:38.826 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:38.816+0000 7fbc6ee75640 1 -- 172.21.15.53:0/213330539 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc681599e0 msgr2=0x7fbc680c6a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:38.826 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:38.816+0000 7fbc6ee75640 1 --2- 172.21.15.53:0/213330539 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc681599e0 0x7fbc680c6a80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbc60019520 tx=0x7fbc600196b0 comp rx=0 tx=0).stop 2023-06-10T18:52:38.826 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:38.816+0000 7fbc6ee75640 1 -- 172.21.15.53:0/213330539 shutdown_connections 2023-06-10T18:52:38.826 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:38.816+0000 7fbc6ee75640 1 --2- 172.21.15.53:0/213330539 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbc4c066280 0x7fbc4c068730 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:38.826 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:38.816+0000 7fbc6ee75640 1 --2- 172.21.15.53:0/213330539 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc681599e0 0x7fbc680c6a80 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:38.826 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:38.816+0000 7fbc6ee75640 1 --2- 172.21.15.53:0/213330539 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc6806cc30 0x7fbc680c4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:38.827 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:38.816+0000 7fbc6ee75640 1 --2- 172.21.15.53:0/213330539 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc68069b60 0x7fbc680b0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:38.827 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:38.816+0000 7fbc6ee75640 1 -- 172.21.15.53:0/213330539 >> 172.21.15.53:0/213330539 conn(0x7fbc680cdee0 msgr2=0x7fbc6806b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:38.827 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:38.816+0000 7fbc6ee75640 1 -- 172.21.15.53:0/213330539 shutdown_connections 2023-06-10T18:52:38.827 INFO:teuthology.misc.health.smithi053.stderr:2023-06-10T18:52:38.816+0000 7fbc6ee75640 1 -- 172.21.15.53:0/213330539 wait complete. 2023-06-10T18:52:38.841 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-06-10T18:52:38.842 INFO:tasks.ceph:Creating RBD pool 2023-06-10T18:52:38.842 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --cluster ceph osd pool create rbd 8 2023-06-10T18:52:38.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:38.960+0000 7f389cd0a640 1 Processor -- start 2023-06-10T18:52:38.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:38.960+0000 7f389cd0a640 1 -- start start 2023-06-10T18:52:38.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:38.960+0000 7f389cd0a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3898156180 0x7f38980cd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:38.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:38.960+0000 7f389cd0a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f389815c4f0 0x7f3898159190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:38.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:38.960+0000 7f389cd0a640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f389806b090 con 0x7f389815c070 2023-06-10T18:52:38.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:38.960+0000 7f389cd0a640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f389806efa0 con 0x7f3898156180 2023-06-10T18:52:38.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:38.960+0000 7f389cd0a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38980cc720 con 0x7f389815c4f0 2023-06-10T18:52:38.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:38.960+0000 7f389659c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3898156180 0x7f38980cd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:38.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:38.960+0000 7f389659c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3898156180 0x7f38980cd4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41004/0 (socket says 172.21.15.53:41004) 2023-06-10T18:52:38.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:38.960+0000 7f389659c640 1 -- 172.21.15.53:0/3961835794 learned_addr learned my addr 172.21.15.53:0/3961835794 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:38.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:38.960+0000 7f3896d9d640 1 --2- 172.21.15.53:0/3961835794 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f389815c4f0 0x7f3898159190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:38.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:38.960+0000 7f389659c640 1 -- 172.21.15.53:0/3961835794 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f389815c4f0 msgr2=0x7f3898159190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:38.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:38.960+0000 7f389659c640 1 --2- 172.21.15.53:0/3961835794 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f389815c4f0 0x7f3898159190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:38.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:38.960+0000 7f389659c640 1 -- 172.21.15.53:0/3961835794 >> v1:172.21.15.117:6789/0 conn(0x7f389815c070 legacy=0x7f3898158a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:38.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:38.960+0000 7f389659c640 1 -- 172.21.15.53:0/3961835794 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38980cc9a0 con 0x7f3898156180 2023-06-10T18:52:38.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:38.964+0000 7f389659c640 1 --2- 172.21.15.53:0/3961835794 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3898156180 0x7f38980cd4a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f388800bb10 tx=0x7f388801ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48d7019213f57b84 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:38.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:38.964+0000 7f3895d9b640 1 -- 172.21.15.53:0/3961835794 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38880a7a50 con 0x7f3898156180 2023-06-10T18:52:38.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:38.964+0000 7f3895d9b640 1 -- 172.21.15.53:0/3961835794 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38880a7bb0 con 0x7f3898156180 2023-06-10T18:52:38.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:38.964+0000 7f3895d9b640 1 -- 172.21.15.53:0/3961835794 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38880af440 con 0x7f3898156180 2023-06-10T18:52:38.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:38.964+0000 7f389cd0a640 1 -- 172.21.15.53:0/3961835794 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3898156180 msgr2=0x7f38980cd4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:38.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:38.964+0000 7f389cd0a640 1 --2- 172.21.15.53:0/3961835794 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3898156180 0x7f38980cd4a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f388800bb10 tx=0x7f388801ebd0 comp rx=0 tx=0).stop 2023-06-10T18:52:38.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:38.964+0000 7f389cd0a640 1 -- 172.21.15.53:0/3961835794 shutdown_connections 2023-06-10T18:52:38.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:38.964+0000 7f389cd0a640 1 --2- 172.21.15.53:0/3961835794 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f389815c4f0 0x7f3898159190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:38.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:38.964+0000 7f389cd0a640 1 --2- 172.21.15.53:0/3961835794 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3898156180 0x7f38980cd4a0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:38.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:38.964+0000 7f389cd0a640 1 -- 172.21.15.53:0/3961835794 >> 172.21.15.53:0/3961835794 conn(0x7f389806a0e0 msgr2=0x7f38980cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:38.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:38.964+0000 7f389cd0a640 1 -- 172.21.15.53:0/3961835794 shutdown_connections 2023-06-10T18:52:38.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:38.964+0000 7f389cd0a640 1 -- 172.21.15.53:0/3961835794 wait complete. 2023-06-10T18:52:38.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:38.964+0000 7f389cd0a640 1 Processor -- start 2023-06-10T18:52:38.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:38.964+0000 7f389cd0a640 1 -- start start 2023-06-10T18:52:38.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:38.964+0000 7f389cd0a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3898156180 0x7f38980b0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:38.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:38.964+0000 7f389cd0a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f389815c070 0x7f38980c5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:38.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:38.964+0000 7f389cd0a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f389815c4f0 0x7f38980c5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:38.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:38.964+0000 7f389cd0a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38980b1190 con 0x7f389815c070 2023-06-10T18:52:38.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:38.964+0000 7f389cd0a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38981522e0 con 0x7f389815c4f0 2023-06-10T18:52:38.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:38.964+0000 7f389cd0a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38980c4d20 con 0x7f3898156180 2023-06-10T18:52:38.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:38.964+0000 7f388ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f389815c070 0x7f38980c5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:38.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:38.964+0000 7f388ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f389815c070 0x7f38980c5a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41016/0 (socket says 172.21.15.53:41016) 2023-06-10T18:52:38.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:38.964+0000 7f388ffff640 1 -- 172.21.15.53:0/1163767395 learned_addr learned my addr 172.21.15.53:0/1163767395 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:38.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:38.964+0000 7f389659c640 1 --2- 172.21.15.53:0/1163767395 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3898156180 0x7f38980b0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:38.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:38.964+0000 7f3896d9d640 1 --2- 172.21.15.53:0/1163767395 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f389815c4f0 0x7f38980c5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:38.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:38.964+0000 7f388ffff640 1 -- 172.21.15.53:0/1163767395 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3898156180 msgr2=0x7f38980b0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:38.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:38.964+0000 7f388ffff640 1 --2- 172.21.15.53:0/1163767395 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3898156180 0x7f38980b0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:38.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:38.964+0000 7f388ffff640 1 -- 172.21.15.53:0/1163767395 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f389815c4f0 msgr2=0x7f38980c5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:38.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:38.964+0000 7f388ffff640 1 --2- 172.21.15.53:0/1163767395 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f389815c4f0 0x7f38980c5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:38.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:38.964+0000 7f388ffff640 1 -- 172.21.15.53:0/1163767395 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f388800b770 con 0x7f389815c070 2023-06-10T18:52:38.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:38.964+0000 7f389659c640 1 --2- 172.21.15.53:0/1163767395 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3898156180 0x7f38980b0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:52:38.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:38.964+0000 7f3896d9d640 1 --2- 172.21.15.53:0/1163767395 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f389815c4f0 0x7f38980c5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:52:38.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:38.964+0000 7f388ffff640 1 --2- 172.21.15.53:0/1163767395 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f389815c070 0x7f38980c5a50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f388000c580 tx=0x7f388000ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:38.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:38.968+0000 7f388effd640 1 -- 172.21.15.53:0/1163767395 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3880012830 con 0x7f389815c070 2023-06-10T18:52:38.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:38.968+0000 7f388effd640 1 -- 172.21.15.53:0/1163767395 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38800129b0 con 0x7f389815c070 2023-06-10T18:52:38.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:38.968+0000 7f389cd0a640 1 -- 172.21.15.53:0/1163767395 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38980c55c0 con 0x7f389815c070 2023-06-10T18:52:38.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:38.968+0000 7f388effd640 1 -- 172.21.15.53:0/1163767395 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3880012d60 con 0x7f389815c070 2023-06-10T18:52:38.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:38.968+0000 7f389cd0a640 1 -- 172.21.15.53:0/1163767395 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38980c5250 con 0x7f389815c070 2023-06-10T18:52:38.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:38.968+0000 7f389cd0a640 1 -- 172.21.15.53:0/1163767395 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38980c5750 con 0x7f389815c070 2023-06-10T18:52:38.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:38.968+0000 7f388effd640 1 -- 172.21.15.53:0/1163767395 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f388001b400 con 0x7f389815c070 2023-06-10T18:52:38.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:38.968+0000 7f388effd640 1 --2- 172.21.15.53:0/1163767395 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3878066280 0x7f3878068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:38.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:38.968+0000 7f388effd640 1 -- 172.21.15.53:0/1163767395 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3880083ad0 con 0x7f389815c070 2023-06-10T18:52:38.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:38.968+0000 7f389659c640 1 --2- 172.21.15.53:0/1163767395 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3878066280 0x7f3878068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:38.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:38.968+0000 7f389659c640 1 --2- 172.21.15.53:0/1163767395 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3878066280 0x7f3878068730 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f38880b1000 tx=0x7f38880a9070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:38.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:38.972+0000 7f388effd640 1 -- 172.21.15.53:0/1163767395 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3880051490 con 0x7f389815c070 2023-06-10T18:52:39.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.124+0000 7f389cd0a640 1 -- 172.21.15.53:0/1163767395 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f389804d790 con 0x7f389815c070 2023-06-10T18:52:39.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.488+0000 7f388effd640 1 -- 172.21.15.53:0/1163767395 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v17) v1 ==== 109+0+0 (secure 0 0 0) 0x7f3880016070 con 0x7f389815c070 2023-06-10T18:52:39.497 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'rbd' created 2023-06-10T18:52:39.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.488+0000 7f389cd0a640 1 -- 172.21.15.53:0/1163767395 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3878066280 msgr2=0x7f3878068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:39.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.488+0000 7f389cd0a640 1 --2- 172.21.15.53:0/1163767395 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3878066280 0x7f3878068730 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f38880b1000 tx=0x7f38880a9070 comp rx=0 tx=0).stop 2023-06-10T18:52:39.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.488+0000 7f389cd0a640 1 -- 172.21.15.53:0/1163767395 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f389815c070 msgr2=0x7f38980c5a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:39.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.488+0000 7f389cd0a640 1 --2- 172.21.15.53:0/1163767395 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f389815c070 0x7f38980c5a50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f388000c580 tx=0x7f388000ca40 comp rx=0 tx=0).stop 2023-06-10T18:52:39.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.488+0000 7f389cd0a640 1 -- 172.21.15.53:0/1163767395 shutdown_connections 2023-06-10T18:52:39.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.488+0000 7f389cd0a640 1 --2- 172.21.15.53:0/1163767395 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3878066280 0x7f3878068730 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:39.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.488+0000 7f389cd0a640 1 --2- 172.21.15.53:0/1163767395 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f389815c4f0 0x7f38980c5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:39.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.488+0000 7f389cd0a640 1 --2- 172.21.15.53:0/1163767395 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f389815c070 0x7f38980c5a50 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:39.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.488+0000 7f389cd0a640 1 --2- 172.21.15.53:0/1163767395 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3898156180 0x7f38980b0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:39.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.488+0000 7f389cd0a640 1 -- 172.21.15.53:0/1163767395 >> 172.21.15.53:0/1163767395 conn(0x7f389806a0e0 msgr2=0x7f3898158860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:39.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.488+0000 7f389cd0a640 1 -- 172.21.15.53:0/1163767395 shutdown_connections 2023-06-10T18:52:39.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.488+0000 7f389cd0a640 1 -- 172.21.15.53:0/1163767395 wait complete. 2023-06-10T18:52:39.523 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-06-10T18:52:39.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.644+0000 7fa1e3152640 1 Processor -- start 2023-06-10T18:52:39.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.644+0000 7fa1e3152640 1 -- start start 2023-06-10T18:52:39.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.648+0000 7fa1e3152640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1dc15b930 0x7fa1dc15f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:39.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.648+0000 7fa1e3152640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa1dc0b1490 0x7fa1dc15f940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:39.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.648+0000 7fa1e3152640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1dc0d0c40 con 0x7fa1dc15fe80 2023-06-10T18:52:39.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.648+0000 7fa1e3152640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1dc0cf5e0 con 0x7fa1dc0b1490 2023-06-10T18:52:39.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.648+0000 7fa1e3152640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1dc15bd00 con 0x7fa1dc15b930 2023-06-10T18:52:39.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.648+0000 7fa1e16ef640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fa1dc15fe80 0x7fa1dc0b3ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:33680/0 (socket says 172.21.15.53:33680) 2023-06-10T18:52:39.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.648+0000 7fa1e16ef640 1 -- 172.21.15.53:0/645042329 learned_addr learned my addr 172.21.15.53:0/645042329 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:52:39.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.648+0000 7fa1dbfff640 1 --2- 172.21.15.53:0/645042329 >> v2:172.21.15.117:3300/0 conn(0x7fa1dc0b1490 0x7fa1dc15f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:39.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.648+0000 7fa1e0eee640 1 --2- 172.21.15.53:0/645042329 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1dc15b930 0x7fa1dc15f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:39.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.648+0000 7fa1db7fe640 1 -- 172.21.15.53:0/645042329 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1130388098 0 0) 0x7fa1dc0d0c40 con 0x7fa1dc15fe80 2023-06-10T18:52:39.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.648+0000 7fa1db7fe640 1 -- 172.21.15.53:0/645042329 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1c8003530 con 0x7fa1dc15fe80 2023-06-10T18:52:39.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.648+0000 7fa1db7fe640 1 -- 172.21.15.53:0/645042329 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2021362808 0 0) 0x7fa1c8003530 con 0x7fa1dc15fe80 2023-06-10T18:52:39.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.648+0000 7fa1db7fe640 1 -- 172.21.15.53:0/645042329 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1dc15b930 msgr2=0x7fa1dc15f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:39.660 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.648+0000 7fa1db7fe640 1 --2- 172.21.15.53:0/645042329 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1dc15b930 0x7fa1dc15f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:39.660 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.648+0000 7fa1db7fe640 1 -- 172.21.15.53:0/645042329 >> v2:172.21.15.117:3300/0 conn(0x7fa1dc0b1490 msgr2=0x7fa1dc15f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:39.660 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.648+0000 7fa1db7fe640 1 --2- 172.21.15.53:0/645042329 >> v2:172.21.15.117:3300/0 conn(0x7fa1dc0b1490 0x7fa1dc15f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:39.660 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.648+0000 7fa1db7fe640 1 -- 172.21.15.53:0/645042329 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1dc0cf020 con 0x7fa1dc15fe80 2023-06-10T18:52:39.660 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.648+0000 7fa1db7fe640 1 -- 172.21.15.53:0/645042329 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fa1d4001680 con 0x7fa1dc15fe80 2023-06-10T18:52:39.660 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.648+0000 7fa1db7fe640 1 -- 172.21.15.53:0/645042329 >> v1:172.21.15.53:6789/0 conn(0x7fa1dc15fe80 legacy=0x7fa1dc0b3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:39.660 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.648+0000 7fa1db7fe640 1 --2- 172.21.15.53:0/645042329 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1c8003980 0x7fa1c8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:39.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.648+0000 7fa1db7fe640 1 --2- 172.21.15.53:0/645042329 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1c80043b0 0x7fa1c8004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:39.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.648+0000 7fa1db7fe640 1 --2- 172.21.15.53:0/645042329 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1dc15b930 0x7fa1c8004f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:39.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.648+0000 7fa1db7fe640 1 -- 172.21.15.53:0/645042329 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1dc0cf5e0 con 0x7fa1c8003980 2023-06-10T18:52:39.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.648+0000 7fa1db7fe640 1 -- 172.21.15.53:0/645042329 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1dc15bd00 con 0x7fa1c80043b0 2023-06-10T18:52:39.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.648+0000 7fa1db7fe640 1 -- 172.21.15.53:0/645042329 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c800b990 con 0x7fa1dc15b930 2023-06-10T18:52:39.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.648+0000 7fa1e0eee640 1 --2- 172.21.15.53:0/645042329 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1c8003980 0x7fa1c8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:39.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.648+0000 7fa1dbfff640 1 --2- 172.21.15.53:0/645042329 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1c80043b0 0x7fa1c8004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:39.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.648+0000 7fa1e16ef640 1 --2- 172.21.15.53:0/645042329 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1dc15b930 0x7fa1c8004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:39.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.648+0000 7fa1e0eee640 1 -- 172.21.15.53:0/645042329 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1dc15b930 msgr2=0x7fa1c8004f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:39.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.648+0000 7fa1e0eee640 1 --2- 172.21.15.53:0/645042329 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1dc15b930 0x7fa1c8004f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:39.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.648+0000 7fa1e0eee640 1 -- 172.21.15.53:0/645042329 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1c80043b0 msgr2=0x7fa1c8004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:39.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.648+0000 7fa1e0eee640 1 --2- 172.21.15.53:0/645042329 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1c80043b0 0x7fa1c8004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:39.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.648+0000 7fa1e0eee640 1 -- 172.21.15.53:0/645042329 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1c8003530 con 0x7fa1c8003980 2023-06-10T18:52:39.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.648+0000 7fa1e16ef640 1 --2- 172.21.15.53:0/645042329 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1dc15b930 0x7fa1c8004f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:52:39.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.648+0000 7fa1e0eee640 1 --2- 172.21.15.53:0/645042329 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1c8003980 0x7fa1c8003d90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc009ae0 tx=0x7fa1cc01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a3ddcbc5dd7f936 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:39.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.648+0000 7fa1db7fe640 1 -- 172.21.15.53:0/645042329 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1cc0a6430 con 0x7fa1c8003980 2023-06-10T18:52:39.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.648+0000 7fa1db7fe640 1 -- 172.21.15.53:0/645042329 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1cc0a6590 con 0x7fa1c8003980 2023-06-10T18:52:39.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.648+0000 7fa1db7fe640 1 -- 172.21.15.53:0/645042329 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1cc0a6940 con 0x7fa1c8003980 2023-06-10T18:52:39.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.652+0000 7fa1e3152640 1 -- 172.21.15.53:0/645042329 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1c8003980 msgr2=0x7fa1c8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:39.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.652+0000 7fa1e3152640 1 --2- 172.21.15.53:0/645042329 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1c8003980 0x7fa1c8003d90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc009ae0 tx=0x7fa1cc01ca50 comp rx=0 tx=0).stop 2023-06-10T18:52:39.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.652+0000 7fa1e16ef640 1 -- 172.21.15.53:0/645042329 reap_dead start 2023-06-10T18:52:39.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.652+0000 7fa1e3152640 1 -- 172.21.15.53:0/645042329 shutdown_connections 2023-06-10T18:52:39.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.652+0000 7fa1e3152640 1 -- 172.21.15.53:0/645042329 >> 172.21.15.53:0/645042329 conn(0x7fa1dc069d70 msgr2=0x7fa1dc06a170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:39.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.652+0000 7fa1e3152640 1 -- 172.21.15.53:0/645042329 shutdown_connections 2023-06-10T18:52:39.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.652+0000 7fa1e3152640 1 -- 172.21.15.53:0/645042329 wait complete. 2023-06-10T18:52:39.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.652+0000 7fa1e3152640 1 Processor -- start 2023-06-10T18:52:39.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.652+0000 7fa1e3152640 1 -- start start 2023-06-10T18:52:39.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.652+0000 7fa1e3152640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1c8003980 0x7fa1dc1519c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:39.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.652+0000 7fa1e3152640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1dc0c5b90 0x7fa1dc0b66c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:39.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.652+0000 7fa1e3152640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1dc0c5fe0 0x7fa1dc0b6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:39.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.652+0000 7fa1e3152640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1dc151f00 con 0x7fa1c8003980 2023-06-10T18:52:39.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.652+0000 7fa1e3152640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1dc153380 con 0x7fa1dc0c5b90 2023-06-10T18:52:39.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.652+0000 7fa1e3152640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1dc153660 con 0x7fa1dc0c5fe0 2023-06-10T18:52:39.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.652+0000 7fa1e0eee640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1c8003980 0x7fa1dc1519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:39.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.652+0000 7fa1e0eee640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1c8003980 0x7fa1dc1519c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41044/0 (socket says 172.21.15.53:41044) 2023-06-10T18:52:39.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.652+0000 7fa1e0eee640 1 -- 172.21.15.53:0/2695102975 learned_addr learned my addr 172.21.15.53:0/2695102975 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:39.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.652+0000 7fa1dbfff640 1 --2- 172.21.15.53:0/2695102975 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1dc0c5b90 0x7fa1dc0b66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:39.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.652+0000 7fa1e16ef640 1 --2- 172.21.15.53:0/2695102975 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1dc0c5fe0 0x7fa1dc0b6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:39.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.652+0000 7fa1e0eee640 1 -- 172.21.15.53:0/2695102975 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1dc0c5fe0 msgr2=0x7fa1dc0b6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:39.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.652+0000 7fa1e0eee640 1 --2- 172.21.15.53:0/2695102975 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1dc0c5fe0 0x7fa1dc0b6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:39.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.652+0000 7fa1e0eee640 1 -- 172.21.15.53:0/2695102975 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1dc0c5b90 msgr2=0x7fa1dc0b66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:39.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.652+0000 7fa1e0eee640 1 --2- 172.21.15.53:0/2695102975 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1dc0c5b90 0x7fa1dc0b66c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:39.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.652+0000 7fa1e0eee640 1 -- 172.21.15.53:0/2695102975 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1dc153940 con 0x7fa1c8003980 2023-06-10T18:52:39.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.652+0000 7fa1dbfff640 1 --2- 172.21.15.53:0/2695102975 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1dc0c5b90 0x7fa1dc0b66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:52:39.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.652+0000 7fa1e0eee640 1 --2- 172.21.15.53:0/2695102975 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1c8003980 0x7fa1dc1519c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc009a00 tx=0x7fa1c8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:39.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.652+0000 7fa1d97fa640 1 -- 172.21.15.53:0/2695102975 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1cc00f000 con 0x7fa1c8003980 2023-06-10T18:52:39.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.652+0000 7fa1d97fa640 1 -- 172.21.15.53:0/2695102975 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1cc0a6d20 con 0x7fa1c8003980 2023-06-10T18:52:39.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.652+0000 7fa1e3152640 1 -- 172.21.15.53:0/2695102975 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1dc153c20 con 0x7fa1c8003980 2023-06-10T18:52:39.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.652+0000 7fa1d97fa640 1 -- 172.21.15.53:0/2695102975 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1cc0b9650 con 0x7fa1c8003980 2023-06-10T18:52:39.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.652+0000 7fa1e3152640 1 -- 172.21.15.53:0/2695102975 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1dc154310 con 0x7fa1c8003980 2023-06-10T18:52:39.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.656+0000 7fa1e3152640 1 -- 172.21.15.53:0/2695102975 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1dc04d790 con 0x7fa1c8003980 2023-06-10T18:52:39.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.656+0000 7fa1d97fa640 1 -- 172.21.15.53:0/2695102975 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa1cc0b97b0 con 0x7fa1c8003980 2023-06-10T18:52:39.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.656+0000 7fa1d97fa640 1 --2- 172.21.15.53:0/2695102975 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa1bc066280 0x7fa1bc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:39.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.656+0000 7fa1d97fa640 1 -- 172.21.15.53:0/2695102975 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5199+0+0 (secure 0 0 0) 0x7fa1cc11d4e0 con 0x7fa1c8003980 2023-06-10T18:52:39.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.656+0000 7fa1dbfff640 1 --2- 172.21.15.53:0/2695102975 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa1bc066280 0x7fa1bc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:39.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.656+0000 7fa1dbfff640 1 --2- 172.21.15.53:0/2695102975 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa1bc066280 0x7fa1bc068730 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc157280 tx=0x7fa1c400b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:39.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.660+0000 7fa1d97fa640 1 -- 172.21.15.53:0/2695102975 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa1cc0eab90 con 0x7fa1c8003980 2023-06-10T18:52:39.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:39.820+0000 7fa1e3152640 1 -- 172.21.15.53:0/2695102975 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fa1dc151f00 con 0x7fa1c8003980 2023-06-10T18:52:40.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.496+0000 7fa1d97fa640 1 -- 172.21.15.53:0/2695102975 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v18) v1 ==== 173+0+0 (secure 0 0 0) 0x7fa1cc0be0c0 con 0x7fa1c8003980 2023-06-10T18:52:40.508 INFO:teuthology.orchestra.run.smithi053.stderr:enabled application 'rbd' on pool 'rbd' 2023-06-10T18:52:40.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.500+0000 7fa1e3152640 1 -- 172.21.15.53:0/2695102975 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa1bc066280 msgr2=0x7fa1bc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:40.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.500+0000 7fa1e3152640 1 --2- 172.21.15.53:0/2695102975 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa1bc066280 0x7fa1bc068730 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc157280 tx=0x7fa1c400b040 comp rx=0 tx=0).stop 2023-06-10T18:52:40.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.500+0000 7fa1e3152640 1 -- 172.21.15.53:0/2695102975 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1c8003980 msgr2=0x7fa1dc1519c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:40.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.500+0000 7fa1e3152640 1 --2- 172.21.15.53:0/2695102975 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1c8003980 0x7fa1dc1519c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc009a00 tx=0x7fa1c8005800 comp rx=0 tx=0).stop 2023-06-10T18:52:40.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.500+0000 7fa1e3152640 1 -- 172.21.15.53:0/2695102975 shutdown_connections 2023-06-10T18:52:40.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.500+0000 7fa1e3152640 1 --2- 172.21.15.53:0/2695102975 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa1bc066280 0x7fa1bc068730 secure :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc157280 tx=0x7fa1c400b040 comp rx=0 tx=0).stop 2023-06-10T18:52:40.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.500+0000 7fa1e3152640 1 --2- 172.21.15.53:0/2695102975 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1dc0c5fe0 0x7fa1dc0b6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:40.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.500+0000 7fa1e3152640 1 --2- 172.21.15.53:0/2695102975 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1dc0c5b90 0x7fa1dc0b66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:40.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.500+0000 7fa1e3152640 1 --2- 172.21.15.53:0/2695102975 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1c8003980 0x7fa1dc1519c0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:40.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.500+0000 7fa1e3152640 1 -- 172.21.15.53:0/2695102975 >> 172.21.15.53:0/2695102975 conn(0x7fa1dc069d70 msgr2=0x7fa1dc0b39f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:40.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.504+0000 7fa1e3152640 1 -- 172.21.15.53:0/2695102975 shutdown_connections 2023-06-10T18:52:40.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.504+0000 7fa1e3152640 1 -- 172.21.15.53:0/2695102975 wait complete. 2023-06-10T18:52:40.536 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-06-10T18:52:40.537 INFO:tasks.ceph.mds.a:Restarting daemon 2023-06-10T18:52:40.537 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-06-10T18:52:40.539 INFO:tasks.ceph.mds.a:Started 2023-06-10T18:52:40.539 INFO:tasks.ceph.mds.c:Restarting daemon 2023-06-10T18:52:40.539 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-06-10T18:52:40.541 INFO:tasks.ceph.mds.c:Started 2023-06-10T18:52:40.542 INFO:tasks.ceph.mds.b:Restarting daemon 2023-06-10T18:52:40.542 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-06-10T18:52:40.544 INFO:tasks.ceph.mds.b:Started 2023-06-10T18:52:40.545 INFO:tasks.ceph.mds.d:Restarting daemon 2023-06-10T18:52:40.545 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-06-10T18:52:40.547 INFO:tasks.ceph.mds.d:Started 2023-06-10T18:52:40.548 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-06-10T18:52:40.548 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T18:52:40.626 INFO:tasks.ceph.mds.c.smithi053.stdout:starting mds.c at 2023-06-10T18:52:40.627 INFO:tasks.ceph.mds.a.smithi053.stdout:starting mds.a at 2023-06-10T18:52:40.632 INFO:tasks.ceph.mds.d.smithi117.stdout:starting mds.d at 2023-06-10T18:52:40.635 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2023-06-10T18:52:40.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.656+0000 7fcca60f7640 1 Processor -- start 2023-06-10T18:52:40.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.656+0000 7fcca60f7640 1 -- start start 2023-06-10T18:52:40.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.656+0000 7fcca60f7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fcca015c7f0 0x7fcca015f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:40.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.656+0000 7fcca60f7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcca015f860 0x7fcca00ceb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:40.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.656+0000 7fcca60f7640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcca015cc40 con 0x7fcca006b780 2023-06-10T18:52:40.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.656+0000 7fcca60f7640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcca015c3d0 con 0x7fcca015c7f0 2023-06-10T18:52:40.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.656+0000 7fcca60f7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcca00af530 con 0x7fcca015f860 2023-06-10T18:52:40.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.656+0000 7fcc9effd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fcca015c7f0 0x7fcca015f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:40.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.656+0000 7fcc9effd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fcca015c7f0 0x7fcca015f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41084/0 (socket says 172.21.15.53:41084) 2023-06-10T18:52:40.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.656+0000 7fcc9effd640 1 -- 172.21.15.53:0/4125632373 learned_addr learned my addr 172.21.15.53:0/4125632373 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:40.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.656+0000 7fcc9ffff640 1 --2- 172.21.15.53:0/4125632373 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcca015f860 0x7fcca00ceb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:40.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.656+0000 7fcc9effd640 1 -- 172.21.15.53:0/4125632373 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcca015f860 msgr2=0x7fcca00ceb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:40.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.656+0000 7fcc9effd640 1 --2- 172.21.15.53:0/4125632373 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcca015f860 0x7fcca00ceb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:40.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.656+0000 7fcc9effd640 1 -- 172.21.15.53:0/4125632373 >> v1:172.21.15.117:6789/0 conn(0x7fcca006b780 legacy=0x7fcca006bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:40.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.656+0000 7fcc9e7fc640 1 -- 172.21.15.53:0/4125632373 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3801633826 0 0) 0x7fcca015cc40 con 0x7fcca006b780 2023-06-10T18:52:40.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.656+0000 7fcc9effd640 1 -- 172.21.15.53:0/4125632373 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcca015fd70 con 0x7fcca015c7f0 2023-06-10T18:52:40.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.660+0000 7fcc9effd640 1 --2- 172.21.15.53:0/4125632373 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcca015c7f0 0x7fcca015f320 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fcc88009870 tx=0x7fcc8801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4de8d378a9aeed9 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:40.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.660+0000 7fcc9e7fc640 1 -- 172.21.15.53:0/4125632373 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc880aa610 con 0x7fcca015c7f0 2023-06-10T18:52:40.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.660+0000 7fcc9e7fc640 1 -- 172.21.15.53:0/4125632373 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc880a6040 con 0x7fcca015c7f0 2023-06-10T18:52:40.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.660+0000 7fcc9e7fc640 1 -- 172.21.15.53:0/4125632373 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc880aa990 con 0x7fcca015c7f0 2023-06-10T18:52:40.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.660+0000 7fcca60f7640 1 -- 172.21.15.53:0/4125632373 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcca015c7f0 msgr2=0x7fcca015f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:40.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.660+0000 7fcca60f7640 1 --2- 172.21.15.53:0/4125632373 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcca015c7f0 0x7fcca015f320 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fcc88009870 tx=0x7fcc8801c4b0 comp rx=0 tx=0).stop 2023-06-10T18:52:40.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.660+0000 7fcca60f7640 1 -- 172.21.15.53:0/4125632373 shutdown_connections 2023-06-10T18:52:40.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.660+0000 7fcca60f7640 1 --2- 172.21.15.53:0/4125632373 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcca015f860 0x7fcca00ceb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:40.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.660+0000 7fcca60f7640 1 --2- 172.21.15.53:0/4125632373 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcca015c7f0 0x7fcca015f320 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:40.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.660+0000 7fcca60f7640 1 -- 172.21.15.53:0/4125632373 >> 172.21.15.53:0/4125632373 conn(0x7fcca006a090 msgr2=0x7fcca006d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:40.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.660+0000 7fcca60f7640 1 -- 172.21.15.53:0/4125632373 shutdown_connections 2023-06-10T18:52:40.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.660+0000 7fcca60f7640 1 -- 172.21.15.53:0/4125632373 wait complete. 2023-06-10T18:52:40.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.660+0000 7fcca60f7640 1 Processor -- start 2023-06-10T18:52:40.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.660+0000 7fcca60f7640 1 -- start start 2023-06-10T18:52:40.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.660+0000 7fcca60f7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcca006b780 0x7fcca015b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:40.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.660+0000 7fcca60f7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcca015c7f0 0x7fcca0151fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:40.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.660+0000 7fcca60f7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcca015f860 0x7fcca01528a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:40.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.660+0000 7fcca60f7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca00b3fa0 con 0x7fcca015f860 2023-06-10T18:52:40.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.660+0000 7fcca60f7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca00b41d0 con 0x7fcca006b780 2023-06-10T18:52:40.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.660+0000 7fcca60f7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcca00b44b0 con 0x7fcca015c7f0 2023-06-10T18:52:40.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.660+0000 7fcc9ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcca015f860 0x7fcca01528a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:40.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.660+0000 7fcc9ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcca015f860 0x7fcca01528a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41094/0 (socket says 172.21.15.53:41094) 2023-06-10T18:52:40.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.660+0000 7fcc9ffff640 1 -- 172.21.15.53:0/316251239 learned_addr learned my addr 172.21.15.53:0/316251239 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:40.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.660+0000 7fcc9effd640 1 --2- 172.21.15.53:0/316251239 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcca015c7f0 0x7fcca0151fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:40.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.660+0000 7fcc9f7fe640 1 --2- 172.21.15.53:0/316251239 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcca006b780 0x7fcca015b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:40.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.664+0000 7fcc9ffff640 1 -- 172.21.15.53:0/316251239 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcca015c7f0 msgr2=0x7fcca0151fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:40.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.664+0000 7fcc9ffff640 1 --2- 172.21.15.53:0/316251239 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcca015c7f0 0x7fcca0151fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:40.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.664+0000 7fcc9ffff640 1 -- 172.21.15.53:0/316251239 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcca006b780 msgr2=0x7fcca015b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:40.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.664+0000 7fcc9ffff640 1 --2- 172.21.15.53:0/316251239 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcca006b780 0x7fcca015b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:40.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.664+0000 7fcc9ffff640 1 -- 172.21.15.53:0/316251239 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc880094d0 con 0x7fcca015f860 2023-06-10T18:52:40.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.664+0000 7fcc9ffff640 1 --2- 172.21.15.53:0/316251239 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcca015f860 0x7fcca01528a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fcc9800e880 tx=0x7fcc9800ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:40.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.664+0000 7fcc97fff640 1 -- 172.21.15.53:0/316251239 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc98009650 con 0x7fcca015f860 2023-06-10T18:52:40.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.664+0000 7fcc97fff640 1 -- 172.21.15.53:0/316251239 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc9800c940 con 0x7fcca015f860 2023-06-10T18:52:40.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.664+0000 7fcc97fff640 1 -- 172.21.15.53:0/316251239 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9800ccd0 con 0x7fcca015f860 2023-06-10T18:52:40.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.664+0000 7fcca60f7640 1 -- 172.21.15.53:0/316251239 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcca00b4790 con 0x7fcca015f860 2023-06-10T18:52:40.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.664+0000 7fcca60f7640 1 -- 172.21.15.53:0/316251239 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcca00b4d50 con 0x7fcca015f860 2023-06-10T18:52:40.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.664+0000 7fcca60f7640 1 -- 172.21.15.53:0/316251239 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcca004d790 con 0x7fcca015f860 2023-06-10T18:52:40.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.668+0000 7fcc97fff640 1 -- 172.21.15.53:0/316251239 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcc98013470 con 0x7fcca015f860 2023-06-10T18:52:40.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.668+0000 7fcc97fff640 1 --2- 172.21.15.53:0/316251239 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcc80066280 0x7fcc80068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:40.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.668+0000 7fcc97fff640 1 -- 172.21.15.53:0/316251239 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fcc980842f0 con 0x7fcca015f860 2023-06-10T18:52:40.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.668+0000 7fcc9f7fe640 1 --2- 172.21.15.53:0/316251239 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcc80066280 0x7fcc80068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:40.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.668+0000 7fcc9f7fe640 1 --2- 172.21.15.53:0/316251239 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcc80066280 0x7fcc80068730 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fcc900012f0 tx=0x7fcc90009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:40.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.672+0000 7fcc97fff640 1 -- 172.21.15.53:0/316251239 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcc98051be0 con 0x7fcca015f860 2023-06-10T18:52:40.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.824+0000 7fcca60f7640 1 -- 172.21.15.53:0/316251239 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcca0166490 con 0x7fcca015f860 2023-06-10T18:52:40.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.828+0000 7fcc97fff640 1 -- 172.21.15.53:0/316251239 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+14637 (secure 0 0 0) 0x7fcc98055200 con 0x7fcca015f860 2023-06-10T18:52:40.838 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:52:40.838 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":18,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T18:52:40.487006+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T18:52:40.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.828+0000 7fcca60f7640 1 -- 172.21.15.53:0/316251239 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcc80066280 msgr2=0x7fcc80068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:40.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.828+0000 7fcca60f7640 1 --2- 172.21.15.53:0/316251239 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcc80066280 0x7fcc80068730 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fcc900012f0 tx=0x7fcc90009040 comp rx=0 tx=0).stop 2023-06-10T18:52:40.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.828+0000 7fcca60f7640 1 -- 172.21.15.53:0/316251239 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcca015f860 msgr2=0x7fcca01528a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:40.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.828+0000 7fcca60f7640 1 --2- 172.21.15.53:0/316251239 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcca015f860 0x7fcca01528a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fcc9800e880 tx=0x7fcc9800ed40 comp rx=0 tx=0).stop 2023-06-10T18:52:40.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.828+0000 7fcca60f7640 1 -- 172.21.15.53:0/316251239 shutdown_connections 2023-06-10T18:52:40.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.828+0000 7fcca60f7640 1 --2- 172.21.15.53:0/316251239 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcc80066280 0x7fcc80068730 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:40.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.828+0000 7fcca60f7640 1 --2- 172.21.15.53:0/316251239 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcca015f860 0x7fcca01528a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:40.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.828+0000 7fcca60f7640 1 --2- 172.21.15.53:0/316251239 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcca015c7f0 0x7fcca0151fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:40.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.828+0000 7fcca60f7640 1 --2- 172.21.15.53:0/316251239 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcca006b780 0x7fcca015b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:40.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.828+0000 7fcca60f7640 1 -- 172.21.15.53:0/316251239 >> 172.21.15.53:0/316251239 conn(0x7fcca006a090 msgr2=0x7fcca00af730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:40.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.828+0000 7fcca60f7640 1 -- 172.21.15.53:0/316251239 shutdown_connections 2023-06-10T18:52:40.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.832+0000 7fcca60f7640 1 -- 172.21.15.53:0/316251239 wait complete. 2023-06-10T18:52:40.857 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-10T18:52:33.633114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-10T18:52:39.171487+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-10T18:52:40.857 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-10T18:52:40.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.980+0000 7f65767c7640 1 Processor -- start 2023-06-10T18:52:40.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.980+0000 7f65767c7640 1 -- start start 2023-06-10T18:52:40.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.980+0000 7f65767c7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6570159690 0x7f6570070950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:40.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.980+0000 7f65767c7640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f65700b0f30 0x7f65700cbe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:40.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.980+0000 7f65767c7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6570159a60 0x7f65700c2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:40.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.980+0000 7f65767c7640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6570070e90 con 0x7f6570159690 2023-06-10T18:52:40.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.980+0000 7f65767c7640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f657006d450 con 0x7f65700b0f30 2023-06-10T18:52:40.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.980+0000 7f65767c7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65700cb080 con 0x7f6570159a60 2023-06-10T18:52:40.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.980+0000 7f656ffff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6570159690 0x7f6570070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:40.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.980+0000 7f656ffff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6570159690 0x7f6570070950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41108/0 (socket says 172.21.15.53:41108) 2023-06-10T18:52:40.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.980+0000 7f656ffff640 1 -- 172.21.15.53:0/1652848493 learned_addr learned my addr 172.21.15.53:0/1652848493 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:40.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.980+0000 7f6574d64640 1 --2- 172.21.15.53:0/1652848493 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6570159a60 0x7f65700c2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:40.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.980+0000 7f656f7fe640 1 --2- 172.21.15.53:0/1652848493 >> v2:172.21.15.117:3300/0 conn(0x7f65700b0f30 0x7f65700cbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:40.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.980+0000 7f656ffff640 1 -- 172.21.15.53:0/1652848493 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6570159a60 msgr2=0x7f65700c2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:40.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.980+0000 7f656ffff640 1 --2- 172.21.15.53:0/1652848493 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6570159a60 0x7f65700c2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:40.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.980+0000 7f656ffff640 1 -- 172.21.15.53:0/1652848493 >> v2:172.21.15.117:3300/0 conn(0x7f65700b0f30 msgr2=0x7f65700cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:40.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.980+0000 7f656ffff640 1 --2- 172.21.15.53:0/1652848493 >> v2:172.21.15.117:3300/0 conn(0x7f65700b0f30 0x7f65700cbe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:40.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.980+0000 7f656ffff640 1 -- 172.21.15.53:0/1652848493 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65700cb320 con 0x7f6570159690 2023-06-10T18:52:40.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.984+0000 7f656ffff640 1 --2- 172.21.15.53:0/1652848493 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6570159690 0x7f6570070950 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f65700cec80 tx=0x7f656001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37a65dd4381b994f server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:40.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.984+0000 7f656effd640 1 -- 172.21.15.53:0/1652848493 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65600ac600 con 0x7f6570159690 2023-06-10T18:52:40.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.984+0000 7f656effd640 1 -- 172.21.15.53:0/1652848493 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65600a8050 con 0x7f6570159690 2023-06-10T18:52:40.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.984+0000 7f656effd640 1 -- 172.21.15.53:0/1652848493 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65600ac980 con 0x7f6570159690 2023-06-10T18:52:40.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.984+0000 7f65767c7640 1 -- 172.21.15.53:0/1652848493 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6570159690 msgr2=0x7f6570070950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:40.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.984+0000 7f65767c7640 1 --2- 172.21.15.53:0/1652848493 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6570159690 0x7f6570070950 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f65700cec80 tx=0x7f656001c4d0 comp rx=0 tx=0).stop 2023-06-10T18:52:40.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.984+0000 7f65767c7640 1 -- 172.21.15.53:0/1652848493 shutdown_connections 2023-06-10T18:52:40.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.984+0000 7f65767c7640 1 --2- 172.21.15.53:0/1652848493 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6570159a60 0x7f65700c2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:40.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.984+0000 7f65767c7640 1 --2- 172.21.15.53:0/1652848493 >> v2:172.21.15.117:3300/0 conn(0x7f65700b0f30 0x7f65700cbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:40.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.984+0000 7f65767c7640 1 --2- 172.21.15.53:0/1652848493 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6570159690 0x7f6570070950 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:40.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.984+0000 7f65767c7640 1 -- 172.21.15.53:0/1652848493 >> 172.21.15.53:0/1652848493 conn(0x7f657006a560 msgr2=0x7f657006a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:40.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.984+0000 7f65767c7640 1 -- 172.21.15.53:0/1652848493 shutdown_connections 2023-06-10T18:52:40.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.984+0000 7f65767c7640 1 -- 172.21.15.53:0/1652848493 wait complete. 2023-06-10T18:52:40.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.984+0000 7f65767c7640 1 Processor -- start 2023-06-10T18:52:40.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.984+0000 7f65767c7640 1 -- start start 2023-06-10T18:52:40.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.988+0000 7f65767c7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65700b0f30 0x7f65700ad690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:40.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.988+0000 7f65767c7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6570159690 0x7f6570153660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:40.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.988+0000 7f65767c7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6570159a60 0x7f6570151f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:40.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.988+0000 7f65767c7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65700ac8d0 con 0x7f6570159a60 2023-06-10T18:52:40.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.988+0000 7f65767c7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65700acbb0 con 0x7f65700b0f30 2023-06-10T18:52:40.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.988+0000 7f65767c7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65700ace90 con 0x7f6570159690 2023-06-10T18:52:40.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.988+0000 7f6574d64640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6570159a60 0x7f6570151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:40.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.988+0000 7f6574d64640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6570159a60 0x7f6570151f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41112/0 (socket says 172.21.15.53:41112) 2023-06-10T18:52:40.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.988+0000 7f6574d64640 1 -- 172.21.15.53:0/1041462046 learned_addr learned my addr 172.21.15.53:0/1041462046 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:40.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.988+0000 7f656ffff640 1 --2- 172.21.15.53:0/1041462046 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65700b0f30 0x7f65700ad690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:40.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.988+0000 7f656f7fe640 1 --2- 172.21.15.53:0/1041462046 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6570159690 0x7f6570153660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:40.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.988+0000 7f6574d64640 1 -- 172.21.15.53:0/1041462046 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6570159690 msgr2=0x7f6570153660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:40.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.988+0000 7f6574d64640 1 --2- 172.21.15.53:0/1041462046 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6570159690 0x7f6570153660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:40.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.988+0000 7f6574d64640 1 -- 172.21.15.53:0/1041462046 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65700b0f30 msgr2=0x7f65700ad690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:40.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.988+0000 7f6574d64640 1 --2- 172.21.15.53:0/1041462046 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65700b0f30 0x7f65700ad690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:40.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.988+0000 7f6574d64640 1 -- 172.21.15.53:0/1041462046 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65600094d0 con 0x7f6570159a60 2023-06-10T18:52:41.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.988+0000 7f6574d64640 1 --2- 172.21.15.53:0/1041462046 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6570159a60 0x7f6570151f70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6568007e40 tx=0x7f656800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:41.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.988+0000 7f656cff9640 1 -- 172.21.15.53:0/1041462046 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6568014620 con 0x7f6570159a60 2023-06-10T18:52:41.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.988+0000 7f656cff9640 1 -- 172.21.15.53:0/1041462046 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f656800ee90 con 0x7f6570159a60 2023-06-10T18:52:41.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.988+0000 7f656cff9640 1 -- 172.21.15.53:0/1041462046 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65680149e0 con 0x7f6570159a60 2023-06-10T18:52:41.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.988+0000 7f65767c7640 1 -- 172.21.15.53:0/1041462046 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65700ad170 con 0x7f6570159a60 2023-06-10T18:52:41.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.988+0000 7f65767c7640 1 -- 172.21.15.53:0/1041462046 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6570153ba0 con 0x7f6570159a60 2023-06-10T18:52:41.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.988+0000 7f65767c7640 1 -- 172.21.15.53:0/1041462046 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f657004d790 con 0x7f6570159a60 2023-06-10T18:52:41.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.988+0000 7f656cff9640 1 -- 172.21.15.53:0/1041462046 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6568014b40 con 0x7f6570159a60 2023-06-10T18:52:41.002 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.988+0000 7f656cff9640 1 --2- 172.21.15.53:0/1041462046 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f655c066280 0x7f655c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:41.002 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.988+0000 7f656cff9640 1 -- 172.21.15.53:0/1041462046 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6568084280 con 0x7f6570159a60 2023-06-10T18:52:41.002 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.988+0000 7f656ffff640 1 --2- 172.21.15.53:0/1041462046 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f655c066280 0x7f655c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:41.002 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.992+0000 7f656ffff640 1 --2- 172.21.15.53:0/1041462046 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f655c066280 0x7f655c068730 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f65600ae000 tx=0x7f65600a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:41.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:40.992+0000 7f656cff9640 1 -- 172.21.15.53:0/1041462046 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6568051a30 con 0x7f6570159a60 2023-06-10T18:52:41.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.148+0000 7f65767c7640 1 -- 172.21.15.53:0/1041462046 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f65700aca10 con 0x7f6570159a60 2023-06-10T18:52:41.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.148+0000 7f656cff9640 1 -- 172.21.15.53:0/1041462046 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7f65700aca10 con 0x7f6570159a60 2023-06-10T18:52:41.159 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-06-10T18:52:41.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.152+0000 7f65767c7640 1 -- 172.21.15.53:0/1041462046 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f655c066280 msgr2=0x7f655c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:41.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.152+0000 7f65767c7640 1 --2- 172.21.15.53:0/1041462046 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f655c066280 0x7f655c068730 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f65600ae000 tx=0x7f65600a7000 comp rx=0 tx=0).stop 2023-06-10T18:52:41.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.152+0000 7f65767c7640 1 -- 172.21.15.53:0/1041462046 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6570159a60 msgr2=0x7f6570151f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:41.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.152+0000 7f65767c7640 1 --2- 172.21.15.53:0/1041462046 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6570159a60 0x7f6570151f70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6568007e40 tx=0x7f656800e4b0 comp rx=0 tx=0).stop 2023-06-10T18:52:41.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.152+0000 7f65767c7640 1 -- 172.21.15.53:0/1041462046 shutdown_connections 2023-06-10T18:52:41.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.152+0000 7f65767c7640 1 --2- 172.21.15.53:0/1041462046 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f655c066280 0x7f655c068730 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:41.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.152+0000 7f65767c7640 1 --2- 172.21.15.53:0/1041462046 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6570159a60 0x7f6570151f70 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:41.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.152+0000 7f65767c7640 1 --2- 172.21.15.53:0/1041462046 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6570159690 0x7f6570153660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:41.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.152+0000 7f65767c7640 1 --2- 172.21.15.53:0/1041462046 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65700b0f30 0x7f65700ad690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:41.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.152+0000 7f65767c7640 1 -- 172.21.15.53:0/1041462046 >> 172.21.15.53:0/1041462046 conn(0x7f657006a560 msgr2=0x7f6570157730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:41.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.152+0000 7f65767c7640 1 -- 172.21.15.53:0/1041462046 shutdown_connections 2023-06-10T18:52:41.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.152+0000 7f65767c7640 1 -- 172.21.15.53:0/1041462046 wait complete. 2023-06-10T18:52:41.177 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-10T18:52:41.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.296+0000 7fd7c5cf3640 1 Processor -- start 2023-06-10T18:52:41.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.296+0000 7fd7c5cf3640 1 -- start start 2023-06-10T18:52:41.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.300+0000 7fd7c5cf3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7c00c9fa0 0x7fd7c006bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:41.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.300+0000 7fd7c5cf3640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd7c00af760 0x7fd7c00afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:41.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.300+0000 7fd7c5cf3640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7c006b090 con 0x7fd7c006c020 2023-06-10T18:52:41.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.300+0000 7fd7c5cf3640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7c00b0120 con 0x7fd7c00af760 2023-06-10T18:52:41.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.300+0000 7fd7c5cf3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c00ca370 con 0x7fd7c00c9fa0 2023-06-10T18:52:41.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.300+0000 7fd7beffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fd7c006c020 0x7fd7c00c82a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52792/0 (socket says 172.21.15.53:52792) 2023-06-10T18:52:41.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.300+0000 7fd7beffd640 1 -- 172.21.15.53:0/712008142 learned_addr learned my addr 172.21.15.53:0/712008142 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:52:41.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.300+0000 7fd7bf7fe640 1 --2- 172.21.15.53:0/712008142 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7c00c9fa0 0x7fd7c006bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:41.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.300+0000 7fd7bffff640 1 --2- 172.21.15.53:0/712008142 >> v2:172.21.15.117:3300/0 conn(0x7fd7c00af760 0x7fd7c00afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:41.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.300+0000 7fd7be7fc640 1 -- 172.21.15.53:0/712008142 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 761887521 0 0) 0x7fd7c006b090 con 0x7fd7c006c020 2023-06-10T18:52:41.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.300+0000 7fd7be7fc640 1 -- 172.21.15.53:0/712008142 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7a8003530 con 0x7fd7c006c020 2023-06-10T18:52:41.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.300+0000 7fd7be7fc640 1 -- 172.21.15.53:0/712008142 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3972271904 0 0) 0x7fd7a8003530 con 0x7fd7c006c020 2023-06-10T18:52:41.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.300+0000 7fd7be7fc640 1 -- 172.21.15.53:0/712008142 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7c00c9fa0 msgr2=0x7fd7c006bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:41.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.300+0000 7fd7be7fc640 1 --2- 172.21.15.53:0/712008142 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7c00c9fa0 0x7fd7c006bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:41.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.300+0000 7fd7be7fc640 1 -- 172.21.15.53:0/712008142 >> v2:172.21.15.117:3300/0 conn(0x7fd7c00af760 msgr2=0x7fd7c00afbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:41.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.300+0000 7fd7be7fc640 1 --2- 172.21.15.53:0/712008142 >> v2:172.21.15.117:3300/0 conn(0x7fd7c00af760 0x7fd7c00afbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:41.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.300+0000 7fd7be7fc640 1 -- 172.21.15.53:0/712008142 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7c0070d50 con 0x7fd7c006c020 2023-06-10T18:52:41.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.300+0000 7fd7be7fc640 1 -- 172.21.15.53:0/712008142 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fd7b4001680 con 0x7fd7c006c020 2023-06-10T18:52:41.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.300+0000 7fd7be7fc640 1 -- 172.21.15.53:0/712008142 >> v1:172.21.15.53:6789/0 conn(0x7fd7c006c020 legacy=0x7fd7c00c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:41.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.300+0000 7fd7be7fc640 1 --2- 172.21.15.53:0/712008142 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7c00c9fa0 0x7fd7a8003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:41.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.300+0000 7fd7be7fc640 1 --2- 172.21.15.53:0/712008142 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7a8003f00 0x7fd7a80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:41.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.300+0000 7fd7be7fc640 1 --2- 172.21.15.53:0/712008142 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7a8004d10 0x7fd7a8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:41.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.300+0000 7fd7be7fc640 1 -- 172.21.15.53:0/712008142 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c00b0120 con 0x7fd7a8003f00 2023-06-10T18:52:41.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.300+0000 7fd7be7fc640 1 -- 172.21.15.53:0/712008142 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c00ca370 con 0x7fd7a8004d10 2023-06-10T18:52:41.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.300+0000 7fd7be7fc640 1 -- 172.21.15.53:0/712008142 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a800b9c0 con 0x7fd7c00c9fa0 2023-06-10T18:52:41.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.300+0000 7fd7beffd640 1 --2- 172.21.15.53:0/712008142 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7a8003f00 0x7fd7a80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:41.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.300+0000 7fd7bffff640 1 --2- 172.21.15.53:0/712008142 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7a8004d10 0x7fd7a8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:41.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.300+0000 7fd7bf7fe640 1 --2- 172.21.15.53:0/712008142 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7c00c9fa0 0x7fd7a8003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:41.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.300+0000 7fd7beffd640 1 -- 172.21.15.53:0/712008142 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7c00c9fa0 msgr2=0x7fd7a8003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:41.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.300+0000 7fd7beffd640 1 --2- 172.21.15.53:0/712008142 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7c00c9fa0 0x7fd7a8003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:41.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.300+0000 7fd7beffd640 1 -- 172.21.15.53:0/712008142 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7a8004d10 msgr2=0x7fd7a8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:41.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.300+0000 7fd7beffd640 1 --2- 172.21.15.53:0/712008142 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7a8004d10 0x7fd7a8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:41.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.300+0000 7fd7beffd640 1 -- 172.21.15.53:0/712008142 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7a8003530 con 0x7fd7a8003f00 2023-06-10T18:52:41.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.304+0000 7fd7beffd640 1 --2- 172.21.15.53:0/712008142 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7a8003f00 0x7fd7a80047d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd7b400c290 tx=0x7fd7b401cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b318cc47f5b6a9b6 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:41.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.304+0000 7fd7be7fc640 1 -- 172.21.15.53:0/712008142 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b40058e0 con 0x7fd7a8003f00 2023-06-10T18:52:41.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.304+0000 7fd7be7fc640 1 -- 172.21.15.53:0/712008142 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7b4005a40 con 0x7fd7a8003f00 2023-06-10T18:52:41.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.304+0000 7fd7be7fc640 1 -- 172.21.15.53:0/712008142 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b4005df0 con 0x7fd7a8003f00 2023-06-10T18:52:41.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.304+0000 7fd7c5cf3640 1 -- 172.21.15.53:0/712008142 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7a8003f00 msgr2=0x7fd7a80047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:41.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.304+0000 7fd7c5cf3640 1 --2- 172.21.15.53:0/712008142 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7a8003f00 0x7fd7a80047d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd7b400c290 tx=0x7fd7b401cc50 comp rx=0 tx=0).stop 2023-06-10T18:52:41.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.304+0000 7fd7bffff640 1 -- 172.21.15.53:0/712008142 reap_dead start 2023-06-10T18:52:41.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.304+0000 7fd7c5cf3640 1 -- 172.21.15.53:0/712008142 shutdown_connections 2023-06-10T18:52:41.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.304+0000 7fd7c5cf3640 1 -- 172.21.15.53:0/712008142 >> 172.21.15.53:0/712008142 conn(0x7fd7c006a0e0 msgr2=0x7fd7c00cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:41.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.304+0000 7fd7c5cf3640 1 -- 172.21.15.53:0/712008142 shutdown_connections 2023-06-10T18:52:41.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.304+0000 7fd7c5cf3640 1 -- 172.21.15.53:0/712008142 wait complete. 2023-06-10T18:52:41.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.304+0000 7fd7c5cf3640 1 Processor -- start 2023-06-10T18:52:41.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.304+0000 7fd7c5cf3640 1 -- start start 2023-06-10T18:52:41.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.304+0000 7fd7c5cf3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7a8003f00 0x7fd7c0157b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:41.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.304+0000 7fd7c5cf3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7c00a7500 0x7fd7c0158390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:41.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.304+0000 7fd7c5cf3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7c01588d0 0x7fd7c01e78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:41.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.304+0000 7fd7c5cf3640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c015a840 con 0x7fd7a8003f00 2023-06-10T18:52:41.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.304+0000 7fd7c5cf3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c015ae00 con 0x7fd7c01588d0 2023-06-10T18:52:41.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.304+0000 7fd7c5cf3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c01e6d60 con 0x7fd7c00a7500 2023-06-10T18:52:41.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.304+0000 7fd7bf7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7a8003f00 0x7fd7c0157b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:41.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.308+0000 7fd7bf7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7a8003f00 0x7fd7c0157b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55962/0 (socket says 172.21.15.53:55962) 2023-06-10T18:52:41.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.308+0000 7fd7bf7fe640 1 -- 172.21.15.53:0/2067860249 learned_addr learned my addr 172.21.15.53:0/2067860249 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:41.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.308+0000 7fd7beffd640 1 --2- 172.21.15.53:0/2067860249 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7c00a7500 0x7fd7c0158390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:41.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.308+0000 7fd7bffff640 1 --2- 172.21.15.53:0/2067860249 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7c01588d0 0x7fd7c01e78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:41.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.308+0000 7fd7bf7fe640 1 -- 172.21.15.53:0/2067860249 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7c00a7500 msgr2=0x7fd7c0158390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:41.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.308+0000 7fd7bf7fe640 1 --2- 172.21.15.53:0/2067860249 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7c00a7500 0x7fd7c0158390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:41.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.308+0000 7fd7bf7fe640 1 -- 172.21.15.53:0/2067860249 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7c01588d0 msgr2=0x7fd7c01e78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:41.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.308+0000 7fd7bf7fe640 1 --2- 172.21.15.53:0/2067860249 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7c01588d0 0x7fd7c01e78f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:41.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.308+0000 7fd7bf7fe640 1 -- 172.21.15.53:0/2067860249 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7c01e7040 con 0x7fd7a8003f00 2023-06-10T18:52:41.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.308+0000 7fd7bf7fe640 1 --2- 172.21.15.53:0/2067860249 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7a8003f00 0x7fd7c0157b60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd7b0011610 tx=0x7fd7b0011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:41.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.308+0000 7fd7a7fff640 1 -- 172.21.15.53:0/2067860249 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b0015870 con 0x7fd7a8003f00 2023-06-10T18:52:41.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.308+0000 7fd7a7fff640 1 -- 172.21.15.53:0/2067860249 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7b00159d0 con 0x7fd7a8003f00 2023-06-10T18:52:41.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.308+0000 7fd7c5cf3640 1 -- 172.21.15.53:0/2067860249 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7c015aa90 con 0x7fd7a8003f00 2023-06-10T18:52:41.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.308+0000 7fd7a7fff640 1 -- 172.21.15.53:0/2067860249 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b0015d40 con 0x7fd7a8003f00 2023-06-10T18:52:41.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.308+0000 7fd7c5cf3640 1 -- 172.21.15.53:0/2067860249 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7c01e7e30 con 0x7fd7a8003f00 2023-06-10T18:52:41.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.308+0000 7fd7c5cf3640 1 -- 172.21.15.53:0/2067860249 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7c004d790 con 0x7fd7a8003f00 2023-06-10T18:52:41.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.308+0000 7fd7a7fff640 1 -- 172.21.15.53:0/2067860249 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd7b000f480 con 0x7fd7a8003f00 2023-06-10T18:52:41.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.308+0000 7fd7a7fff640 1 --2- 172.21.15.53:0/2067860249 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd7ac066280 0x7fd7ac068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:41.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.308+0000 7fd7a7fff640 1 -- 172.21.15.53:0/2067860249 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fd7b00841c0 con 0x7fd7a8003f00 2023-06-10T18:52:41.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.308+0000 7fd7beffd640 1 --2- 172.21.15.53:0/2067860249 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd7ac066280 0x7fd7ac068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:41.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.312+0000 7fd7beffd640 1 --2- 172.21.15.53:0/2067860249 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd7ac066280 0x7fd7ac068730 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd7b40aa000 tx=0x7fd7b4001a10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:41.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.312+0000 7fd7a7fff640 1 -- 172.21.15.53:0/2067860249 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd7b00519e0 con 0x7fd7a8003f00 2023-06-10T18:52:41.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.464+0000 7fd7c5cf3640 1 -- 172.21.15.53:0/2067860249 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd7c01e71d0 con 0x7fd7a8003f00 2023-06-10T18:52:41.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.464+0000 7fd7a7fff640 1 -- 172.21.15.53:0/2067860249 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v18) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd7b0055000 con 0x7fd7a8003f00 2023-06-10T18:52:41.475 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-06-10T18:52:41.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.468+0000 7fd7c5cf3640 1 -- 172.21.15.53:0/2067860249 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd7ac066280 msgr2=0x7fd7ac068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:41.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.468+0000 7fd7c5cf3640 1 --2- 172.21.15.53:0/2067860249 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd7ac066280 0x7fd7ac068730 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd7b40aa000 tx=0x7fd7b4001a10 comp rx=0 tx=0).stop 2023-06-10T18:52:41.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.468+0000 7fd7c5cf3640 1 -- 172.21.15.53:0/2067860249 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7a8003f00 msgr2=0x7fd7c0157b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:41.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.468+0000 7fd7c5cf3640 1 --2- 172.21.15.53:0/2067860249 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7a8003f00 0x7fd7c0157b60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd7b0011610 tx=0x7fd7b0011ad0 comp rx=0 tx=0).stop 2023-06-10T18:52:41.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.468+0000 7fd7c5cf3640 1 -- 172.21.15.53:0/2067860249 shutdown_connections 2023-06-10T18:52:41.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.468+0000 7fd7c5cf3640 1 --2- 172.21.15.53:0/2067860249 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd7ac066280 0x7fd7ac068730 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:41.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.468+0000 7fd7c5cf3640 1 --2- 172.21.15.53:0/2067860249 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7c01588d0 0x7fd7c01e78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:41.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.468+0000 7fd7c5cf3640 1 --2- 172.21.15.53:0/2067860249 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7c00a7500 0x7fd7c0158390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:41.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.468+0000 7fd7c5cf3640 1 --2- 172.21.15.53:0/2067860249 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7a8003f00 0x7fd7c0157b60 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:41.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.468+0000 7fd7c5cf3640 1 -- 172.21.15.53:0/2067860249 >> 172.21.15.53:0/2067860249 conn(0x7fd7c006a0e0 msgr2=0x7fd7c00b3510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:41.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.468+0000 7fd7c5cf3640 1 -- 172.21.15.53:0/2067860249 shutdown_connections 2023-06-10T18:52:41.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.468+0000 7fd7c5cf3640 1 -- 172.21.15.53:0/2067860249 wait complete. 2023-06-10T18:52:41.493 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T18:52:41.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.608+0000 7f190812a640 1 Processor -- start 2023-06-10T18:52:41.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.608+0000 7f190812a640 1 -- start start 2023-06-10T18:52:41.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.608+0000 7f190812a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1900070f40 0x7f190006bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:41.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.608+0000 7f190812a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f190006c4c0 0x7f190015c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:41.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.608+0000 7f190812a640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1900070080 con 0x7f190015c0b0 2023-06-10T18:52:41.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.608+0000 7f190812a640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19000cc460 con 0x7f190006c4c0 2023-06-10T18:52:41.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.608+0000 7f190812a640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19000705c0 con 0x7f1900070f40 2023-06-10T18:52:41.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.608+0000 7f19066c7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f190006c4c0 0x7f190015c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:41.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.608+0000 7f19066c7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f190006c4c0 0x7f190015c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55968/0 (socket says 172.21.15.53:55968) 2023-06-10T18:52:41.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.608+0000 7f19066c7640 1 -- 172.21.15.53:0/376989965 learned_addr learned my addr 172.21.15.53:0/376989965 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:41.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.608+0000 7f19056c5640 1 --2- 172.21.15.53:0/376989965 >> v2:172.21.15.117:3300/0 conn(0x7f1900070f40 0x7f190006bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:41.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.608+0000 7f19066c7640 1 -- 172.21.15.53:0/376989965 >> v2:172.21.15.117:3300/0 conn(0x7f1900070f40 msgr2=0x7f190006bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:41.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.608+0000 7f19066c7640 1 --2- 172.21.15.53:0/376989965 >> v2:172.21.15.117:3300/0 conn(0x7f1900070f40 0x7f190006bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:41.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.608+0000 7f19066c7640 1 -- 172.21.15.53:0/376989965 >> v1:172.21.15.117:6789/0 conn(0x7f190015c0b0 legacy=0x7f19000cbd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:41.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.608+0000 7f19066c7640 1 -- 172.21.15.53:0/376989965 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19000c8e30 con 0x7f190006c4c0 2023-06-10T18:52:41.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.612+0000 7f19066c7640 1 --2- 172.21.15.53:0/376989965 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f190006c4c0 0x7f190015c480 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f19000ad6d0 tx=0x7f18f801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c68886e5409b2e3 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:41.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.612+0000 7f1904ec4640 1 -- 172.21.15.53:0/376989965 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f80a5660 con 0x7f190006c4c0 2023-06-10T18:52:41.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.612+0000 7f1904ec4640 1 -- 172.21.15.53:0/376989965 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18f80a57c0 con 0x7f190006c4c0 2023-06-10T18:52:41.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.612+0000 7f1904ec4640 1 -- 172.21.15.53:0/376989965 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f80a5b50 con 0x7f190006c4c0 2023-06-10T18:52:41.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.612+0000 7f190812a640 1 -- 172.21.15.53:0/376989965 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f190006c4c0 msgr2=0x7f190015c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:41.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.612+0000 7f190812a640 1 --2- 172.21.15.53:0/376989965 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f190006c4c0 0x7f190015c480 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f19000ad6d0 tx=0x7f18f801c9a0 comp rx=0 tx=0).stop 2023-06-10T18:52:41.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.612+0000 7f190812a640 1 -- 172.21.15.53:0/376989965 shutdown_connections 2023-06-10T18:52:41.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.612+0000 7f190812a640 1 --2- 172.21.15.53:0/376989965 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f190006c4c0 0x7f190015c480 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:41.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.612+0000 7f190812a640 1 --2- 172.21.15.53:0/376989965 >> v2:172.21.15.117:3300/0 conn(0x7f1900070f40 0x7f190006bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:41.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.612+0000 7f190812a640 1 -- 172.21.15.53:0/376989965 >> 172.21.15.53:0/376989965 conn(0x7f190006a0d0 msgr2=0x7f19000ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:41.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.612+0000 7f190812a640 1 -- 172.21.15.53:0/376989965 shutdown_connections 2023-06-10T18:52:41.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.612+0000 7f190812a640 1 -- 172.21.15.53:0/376989965 wait complete. 2023-06-10T18:52:41.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.612+0000 7f190812a640 1 Processor -- start 2023-06-10T18:52:41.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.612+0000 7f190812a640 1 -- start start 2023-06-10T18:52:41.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.612+0000 7f190812a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f190006c4c0 0x7f190014b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:41.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.612+0000 7f190812a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1900070f40 0x7f19000ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:41.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.612+0000 7f190812a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f190015c0b0 0x7f19000cd150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:41.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.612+0000 7f190812a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19000b3120 con 0x7f190006c4c0 2023-06-10T18:52:41.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.612+0000 7f190812a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f190014b860 con 0x7f1900070f40 2023-06-10T18:52:41.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.612+0000 7f190812a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19000b2510 con 0x7f190015c0b0 2023-06-10T18:52:41.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.612+0000 7f1905ec6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f190006c4c0 0x7f190014b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:41.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.612+0000 7f1905ec6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f190006c4c0 0x7f190014b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55982/0 (socket says 172.21.15.53:55982) 2023-06-10T18:52:41.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.612+0000 7f1905ec6640 1 -- 172.21.15.53:0/836755822 learned_addr learned my addr 172.21.15.53:0/836755822 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:41.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.612+0000 7f19066c7640 1 --2- 172.21.15.53:0/836755822 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f190015c0b0 0x7f19000cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:41.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.612+0000 7f1905ec6640 1 -- 172.21.15.53:0/836755822 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f190015c0b0 msgr2=0x7f19000cd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:41.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.612+0000 7f1905ec6640 1 --2- 172.21.15.53:0/836755822 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f190015c0b0 0x7f19000cd150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:41.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.612+0000 7f1905ec6640 1 -- 172.21.15.53:0/836755822 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1900070f40 msgr2=0x7f19000ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:41.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.612+0000 7f1905ec6640 1 --2- 172.21.15.53:0/836755822 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1900070f40 0x7f19000ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:41.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.612+0000 7f1905ec6640 1 -- 172.21.15.53:0/836755822 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18f8009b30 con 0x7f190006c4c0 2023-06-10T18:52:41.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.616+0000 7f1905ec6640 1 --2- 172.21.15.53:0/836755822 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f190006c4c0 0x7f190014b320 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f18fc00c3c0 tx=0x7f18fc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:41.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.616+0000 7f18f67fc640 1 -- 172.21.15.53:0/836755822 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18fc0052d0 con 0x7f190006c4c0 2023-06-10T18:52:41.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.616+0000 7f18f67fc640 1 -- 172.21.15.53:0/836755822 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18fc005430 con 0x7f190006c4c0 2023-06-10T18:52:41.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.616+0000 7f190812a640 1 -- 172.21.15.53:0/836755822 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19000b27f0 con 0x7f190006c4c0 2023-06-10T18:52:41.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.616+0000 7f18f67fc640 1 -- 172.21.15.53:0/836755822 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18fc003840 con 0x7f190006c4c0 2023-06-10T18:52:41.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.616+0000 7f190812a640 1 -- 172.21.15.53:0/836755822 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19000b2db0 con 0x7f190006c4c0 2023-06-10T18:52:41.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.616+0000 7f190812a640 1 -- 172.21.15.53:0/836755822 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f190004d790 con 0x7f190006c4c0 2023-06-10T18:52:41.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.616+0000 7f18f67fc640 1 -- 172.21.15.53:0/836755822 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f18fc0039a0 con 0x7f190006c4c0 2023-06-10T18:52:41.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.616+0000 7f18f67fc640 1 --2- 172.21.15.53:0/836755822 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f18e4066280 0x7f18e4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:41.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.616+0000 7f18f67fc640 1 -- 172.21.15.53:0/836755822 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f18fc082f70 con 0x7f190006c4c0 2023-06-10T18:52:41.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.616+0000 7f19056c5640 1 --2- 172.21.15.53:0/836755822 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f18e4066280 0x7f18e4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:41.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.616+0000 7f19056c5640 1 --2- 172.21.15.53:0/836755822 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f18e4066280 0x7f18e4068730 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f19000cd7b0 tx=0x7f18f0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:41.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.620+0000 7f18f67fc640 1 -- 172.21.15.53:0/836755822 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f18fc050730 con 0x7f190006c4c0 2023-06-10T18:52:41.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.808+0000 7f190812a640 1 -- 172.21.15.53:0/836755822 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f19000b3c20 con 0x7f190006c4c0 2023-06-10T18:52:41.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.808+0000 7f18f67fc640 1 -- 172.21.15.53:0/836755822 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3527 (secure 0 0 0) 0x7f18fc017de0 con 0x7f190006c4c0 2023-06-10T18:52:41.820 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:52:41.820 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4236,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/1767214403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":1767214403},{"type":"v1","addr":"172.21.15.53:6834","nonce":1767214403}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/184933647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":184933647},{"type":"v1","addr":"172.21.15.117:6837","nonce":184933647}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/1556542558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":1556542558},{"type":"v1","addr":"172.21.15.53:6835","nonce":1556542558}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1492134415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1492134415},{"type":"v1","addr":"172.21.15.117:6835","nonce":1492134415}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-06-10T18:52:41.821 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 3 2023-06-10T18:52:41.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.812+0000 7f190812a640 1 -- 172.21.15.53:0/836755822 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f18e4066280 msgr2=0x7f18e4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:41.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.812+0000 7f190812a640 1 --2- 172.21.15.53:0/836755822 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f18e4066280 0x7f18e4068730 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f19000cd7b0 tx=0x7f18f0008040 comp rx=0 tx=0).stop 2023-06-10T18:52:41.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.812+0000 7f190812a640 1 -- 172.21.15.53:0/836755822 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f190006c4c0 msgr2=0x7f190014b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:41.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.812+0000 7f190812a640 1 --2- 172.21.15.53:0/836755822 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f190006c4c0 0x7f190014b320 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f18fc00c3c0 tx=0x7f18fc00c880 comp rx=0 tx=0).stop 2023-06-10T18:52:41.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.812+0000 7f190812a640 1 -- 172.21.15.53:0/836755822 shutdown_connections 2023-06-10T18:52:41.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.812+0000 7f190812a640 1 --2- 172.21.15.53:0/836755822 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f18e4066280 0x7f18e4068730 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:41.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.812+0000 7f190812a640 1 --2- 172.21.15.53:0/836755822 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f190015c0b0 0x7f19000cd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:41.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.812+0000 7f190812a640 1 --2- 172.21.15.53:0/836755822 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1900070f40 0x7f19000ccc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:41.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.812+0000 7f190812a640 1 --2- 172.21.15.53:0/836755822 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f190006c4c0 0x7f190014b320 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:41.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.812+0000 7f190812a640 1 -- 172.21.15.53:0/836755822 >> 172.21.15.53:0/836755822 conn(0x7f190006a0d0 msgr2=0x7f19000ce4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:41.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.812+0000 7f190812a640 1 -- 172.21.15.53:0/836755822 shutdown_connections 2023-06-10T18:52:41.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.812+0000 7f190812a640 1 -- 172.21.15.53:0/836755822 wait complete. 2023-06-10T18:52:41.839 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T18:52:41.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.948+0000 7f1c5c394640 1 Processor -- start 2023-06-10T18:52:41.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.948+0000 7f1c5c394640 1 -- start start 2023-06-10T18:52:41.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.948+0000 7f1c5c394640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1c540b3ac0 0x7f1c540b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:41.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.948+0000 7f1c5c394640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1c540cc690 0x7f1c5415f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:41.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.948+0000 7f1c5c394640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c540d0020 con 0x7f1c540ccae0 2023-06-10T18:52:41.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.948+0000 7f1c5c394640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c540b43d0 con 0x7f1c540cc690 2023-06-10T18:52:41.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.948+0000 7f1c5c394640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c540cef40 con 0x7f1c540b3ac0 2023-06-10T18:52:41.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.948+0000 7f1c5992f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1c540cc690 0x7f1c5415f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:41.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.948+0000 7f1c5a931640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f1c540ccae0 0x7f1c5415f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52806/0 (socket says 172.21.15.53:52806) 2023-06-10T18:52:41.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.948+0000 7f1c5a931640 1 -- 172.21.15.53:0/801540475 learned_addr learned my addr 172.21.15.53:0/801540475 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:52:41.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.948+0000 7f1c5a130640 1 --2- 172.21.15.53:0/801540475 >> v2:172.21.15.117:3300/0 conn(0x7f1c540b3ac0 0x7f1c540b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:41.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.948+0000 7f1c5992f640 1 -- 172.21.15.53:0/801540475 >> v2:172.21.15.117:3300/0 conn(0x7f1c540b3ac0 msgr2=0x7f1c540b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:41.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.948+0000 7f1c5992f640 1 --2- 172.21.15.53:0/801540475 >> v2:172.21.15.117:3300/0 conn(0x7f1c540b3ac0 0x7f1c540b3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:41.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.948+0000 7f1c5992f640 1 -- 172.21.15.53:0/801540475 >> v1:172.21.15.53:6789/0 conn(0x7f1c540ccae0 legacy=0x7f1c5415f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:41.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.948+0000 7f1c5992f640 1 -- 172.21.15.53:0/801540475 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c540cf220 con 0x7f1c540cc690 2023-06-10T18:52:41.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.948+0000 7f1c5912e640 1 -- 172.21.15.53:0/801540475 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3203327767 0 0) 0x7f1c540d0020 con 0x7f1c540ccae0 2023-06-10T18:52:41.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.952+0000 7f1c5992f640 1 --2- 172.21.15.53:0/801540475 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c540cc690 0x7f1c5415f370 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1c540b4ba0 tx=0x7f1c4401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b5ec1f126a46b1a server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:41.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.952+0000 7f1c5912e640 1 -- 172.21.15.53:0/801540475 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c440a7070 con 0x7f1c540cc690 2023-06-10T18:52:41.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.952+0000 7f1c5912e640 1 -- 172.21.15.53:0/801540475 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c440ab430 con 0x7f1c540cc690 2023-06-10T18:52:41.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.952+0000 7f1c5912e640 1 -- 172.21.15.53:0/801540475 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c440ab7c0 con 0x7f1c540cc690 2023-06-10T18:52:41.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.952+0000 7f1c5c394640 1 -- 172.21.15.53:0/801540475 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c540cc690 msgr2=0x7f1c5415f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:41.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.952+0000 7f1c5c394640 1 --2- 172.21.15.53:0/801540475 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c540cc690 0x7f1c5415f370 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1c540b4ba0 tx=0x7f1c4401c430 comp rx=0 tx=0).stop 2023-06-10T18:52:41.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.952+0000 7f1c5c394640 1 -- 172.21.15.53:0/801540475 shutdown_connections 2023-06-10T18:52:41.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.952+0000 7f1c5c394640 1 --2- 172.21.15.53:0/801540475 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c540cc690 0x7f1c5415f370 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:41.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.952+0000 7f1c5c394640 1 --2- 172.21.15.53:0/801540475 >> v2:172.21.15.117:3300/0 conn(0x7f1c540b3ac0 0x7f1c540b3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:41.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.952+0000 7f1c5c394640 1 -- 172.21.15.53:0/801540475 >> 172.21.15.53:0/801540475 conn(0x7f1c54071790 msgr2=0x7f1c54069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:41.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.952+0000 7f1c5c394640 1 -- 172.21.15.53:0/801540475 shutdown_connections 2023-06-10T18:52:41.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.952+0000 7f1c5c394640 1 -- 172.21.15.53:0/801540475 wait complete. 2023-06-10T18:52:41.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.952+0000 7f1c5c394640 1 Processor -- start 2023-06-10T18:52:41.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.952+0000 7f1c5c394640 1 -- start start 2023-06-10T18:52:41.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.952+0000 7f1c5c394640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c540b3ac0 0x7f1c5415f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:41.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.952+0000 7f1c5c394640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c540cc690 0x7f1c54159f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:41.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.952+0000 7f1c5c394640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c540ccae0 0x7f1c540cb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:41.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.952+0000 7f1c5c394640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c5415b600 con 0x7f1c540ccae0 2023-06-10T18:52:41.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.952+0000 7f1c5c394640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c5415a980 con 0x7f1c540b3ac0 2023-06-10T18:52:41.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.952+0000 7f1c5c394640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c5415ac60 con 0x7f1c540cc690 2023-06-10T18:52:41.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.952+0000 7f1c5a931640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c540ccae0 0x7f1c540cb5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:41.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.952+0000 7f1c5a931640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c540ccae0 0x7f1c540cb5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56002/0 (socket says 172.21.15.53:56002) 2023-06-10T18:52:41.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.952+0000 7f1c5a931640 1 -- 172.21.15.53:0/3847278869 learned_addr learned my addr 172.21.15.53:0/3847278869 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:41.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.952+0000 7f1c5992f640 1 --2- 172.21.15.53:0/3847278869 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c540cc690 0x7f1c54159f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:41.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.952+0000 7f1c5a130640 1 --2- 172.21.15.53:0/3847278869 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c540b3ac0 0x7f1c5415f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:41.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.952+0000 7f1c5a931640 1 -- 172.21.15.53:0/3847278869 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c540cc690 msgr2=0x7f1c54159f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:41.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.952+0000 7f1c5a931640 1 --2- 172.21.15.53:0/3847278869 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c540cc690 0x7f1c54159f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:41.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.952+0000 7f1c5a931640 1 -- 172.21.15.53:0/3847278869 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c540b3ac0 msgr2=0x7f1c5415f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:41.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.952+0000 7f1c5a931640 1 --2- 172.21.15.53:0/3847278869 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c540b3ac0 0x7f1c5415f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:41.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.952+0000 7f1c5a931640 1 -- 172.21.15.53:0/3847278869 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c44009420 con 0x7f1c540ccae0 2023-06-10T18:52:41.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.952+0000 7f1c5a130640 1 --2- 172.21.15.53:0/3847278869 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c540b3ac0 0x7f1c5415f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:52:41.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.956+0000 7f1c5a931640 1 --2- 172.21.15.53:0/3847278869 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c540ccae0 0x7f1c540cb5b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c001570 tx=0x7f1c4c00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:41.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.956+0000 7f1c4affd640 1 -- 172.21.15.53:0/3847278869 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c4c00a640 con 0x7f1c540ccae0 2023-06-10T18:52:41.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.956+0000 7f1c4affd640 1 -- 172.21.15.53:0/3847278869 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c4c00a7c0 con 0x7f1c540ccae0 2023-06-10T18:52:41.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.956+0000 7f1c4affd640 1 -- 172.21.15.53:0/3847278869 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c4c00ab70 con 0x7f1c540ccae0 2023-06-10T18:52:41.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.956+0000 7f1c5c394640 1 -- 172.21.15.53:0/3847278869 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c5415af40 con 0x7f1c540ccae0 2023-06-10T18:52:41.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.956+0000 7f1c5c394640 1 -- 172.21.15.53:0/3847278869 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c5415f850 con 0x7f1c540ccae0 2023-06-10T18:52:41.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.956+0000 7f1c5c394640 1 -- 172.21.15.53:0/3847278869 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c540c5910 con 0x7f1c540ccae0 2023-06-10T18:52:41.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.956+0000 7f1c4affd640 1 -- 172.21.15.53:0/3847278869 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1c4c00acd0 con 0x7f1c540ccae0 2023-06-10T18:52:41.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.956+0000 7f1c4affd640 1 --2- 172.21.15.53:0/3847278869 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1c380662b0 0x7f1c38068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:41.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.956+0000 7f1c4affd640 1 -- 172.21.15.53:0/3847278869 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f1c4c082e80 con 0x7f1c540ccae0 2023-06-10T18:52:41.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.956+0000 7f1c5a130640 1 --2- 172.21.15.53:0/3847278869 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1c380662b0 0x7f1c38068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:41.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.956+0000 7f1c5a130640 1 --2- 172.21.15.53:0/3847278869 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1c380662b0 0x7f1c38068760 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1c500097a0 tx=0x7f1c50008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:41.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:41.960+0000 7f1c4affd640 1 -- 172.21.15.53:0/3847278869 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1c4c050630 con 0x7f1c540ccae0 2023-06-10T18:52:42.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.112+0000 7f1c5c394640 1 -- 172.21.15.53:0/3847278869 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1c5404d790 con 0x7f1c540ccae0 2023-06-10T18:52:42.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.116+0000 7f1c4affd640 1 -- 172.21.15.53:0/3847278869 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+14624 (secure 0 0 0) 0x7f1c4c018090 con 0x7f1c540ccae0 2023-06-10T18:52:42.125 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:52:42.126 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":19,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T18:52:41.496690+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T18:52:42.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.116+0000 7f1c5c394640 1 -- 172.21.15.53:0/3847278869 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1c380662b0 msgr2=0x7f1c38068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:42.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.116+0000 7f1c5c394640 1 --2- 172.21.15.53:0/3847278869 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1c380662b0 0x7f1c38068760 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1c500097a0 tx=0x7f1c50008040 comp rx=0 tx=0).stop 2023-06-10T18:52:42.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.116+0000 7f1c5c394640 1 -- 172.21.15.53:0/3847278869 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c540ccae0 msgr2=0x7f1c540cb5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:42.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.116+0000 7f1c5c394640 1 --2- 172.21.15.53:0/3847278869 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c540ccae0 0x7f1c540cb5b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c001570 tx=0x7f1c4c00cca0 comp rx=0 tx=0).stop 2023-06-10T18:52:42.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.116+0000 7f1c5c394640 1 -- 172.21.15.53:0/3847278869 shutdown_connections 2023-06-10T18:52:42.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.116+0000 7f1c5c394640 1 --2- 172.21.15.53:0/3847278869 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1c380662b0 0x7f1c38068760 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:42.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.116+0000 7f1c5c394640 1 --2- 172.21.15.53:0/3847278869 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c540ccae0 0x7f1c540cb5b0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:42.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.116+0000 7f1c5c394640 1 --2- 172.21.15.53:0/3847278869 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c540cc690 0x7f1c54159f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:42.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.116+0000 7f1c5c394640 1 --2- 172.21.15.53:0/3847278869 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c540b3ac0 0x7f1c5415f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:42.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.116+0000 7f1c5c394640 1 -- 172.21.15.53:0/3847278869 >> 172.21.15.53:0/3847278869 conn(0x7f1c54071790 msgr2=0x7f1c540b6270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:42.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.116+0000 7f1c5c394640 1 -- 172.21.15.53:0/3847278869 shutdown_connections 2023-06-10T18:52:42.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.116+0000 7f1c5c394640 1 -- 172.21.15.53:0/3847278869 wait complete. 2023-06-10T18:52:42.144 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-10T18:52:33.633114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-10T18:52:39.171487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-10T18:52:42.145 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-10T18:52:42.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.256+0000 7f667bfb5640 1 Processor -- start 2023-06-10T18:52:42.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.256+0000 7f667bfb5640 1 -- start start 2023-06-10T18:52:42.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.260+0000 7f667bfb5640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f66740c9fa0 0x7f667406bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:42.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.260+0000 7f667bfb5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f667406c020 0x7f66740c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:42.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.260+0000 7f667bfb5640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f66740c87e0 0x7f66740af760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:42.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.260+0000 7f667bfb5640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f667406b090 con 0x7f66740c87e0 2023-06-10T18:52:42.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.260+0000 7f667bfb5640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66740ca370 con 0x7f66740c9fa0 2023-06-10T18:52:42.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.260+0000 7f667bfb5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6674070d50 con 0x7f667406c020 2023-06-10T18:52:42.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.260+0000 7f667a552640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f66740c87e0 0x7f66740af760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:42.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.260+0000 7f667a552640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f66740c87e0 0x7f66740af760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56018/0 (socket says 172.21.15.53:56018) 2023-06-10T18:52:42.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.260+0000 7f667a552640 1 -- 172.21.15.53:0/4168471853 learned_addr learned my addr 172.21.15.53:0/4168471853 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:42.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.260+0000 7f6679550640 1 --2- 172.21.15.53:0/4168471853 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f667406c020 0x7f66740c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:42.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.260+0000 7f6679d51640 1 --2- 172.21.15.53:0/4168471853 >> v2:172.21.15.117:3300/0 conn(0x7f66740c9fa0 0x7f667406bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:42.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.260+0000 7f667a552640 1 -- 172.21.15.53:0/4168471853 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f667406c020 msgr2=0x7f66740c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:42.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.260+0000 7f667a552640 1 --2- 172.21.15.53:0/4168471853 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f667406c020 0x7f66740c82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:42.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.260+0000 7f667a552640 1 -- 172.21.15.53:0/4168471853 >> v2:172.21.15.117:3300/0 conn(0x7f66740c9fa0 msgr2=0x7f667406bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:42.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.260+0000 7f667a552640 1 --2- 172.21.15.53:0/4168471853 >> v2:172.21.15.117:3300/0 conn(0x7f66740c9fa0 0x7f667406bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:42.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.260+0000 7f667a552640 1 -- 172.21.15.53:0/4168471853 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6674071030 con 0x7f66740c87e0 2023-06-10T18:52:42.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.260+0000 7f6679d51640 1 --2- 172.21.15.53:0/4168471853 >> v2:172.21.15.117:3300/0 conn(0x7f66740c9fa0 0x7f667406bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:52:42.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.260+0000 7f667a552640 1 --2- 172.21.15.53:0/4168471853 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66740c87e0 0x7f66740af760 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f667406e9d0 tx=0x7f666c01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c47430403e5bfff server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:42.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.260+0000 7f6678d4f640 1 -- 172.21.15.53:0/4168471853 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f666c0a56a0 con 0x7f66740c87e0 2023-06-10T18:52:42.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.260+0000 7f6678d4f640 1 -- 172.21.15.53:0/4168471853 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f666c0a5800 con 0x7f66740c87e0 2023-06-10T18:52:42.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.260+0000 7f6678d4f640 1 -- 172.21.15.53:0/4168471853 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f666c0a5b90 con 0x7f66740c87e0 2023-06-10T18:52:42.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.264+0000 7f667bfb5640 1 -- 172.21.15.53:0/4168471853 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66740c87e0 msgr2=0x7f66740af760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:42.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.264+0000 7f667bfb5640 1 --2- 172.21.15.53:0/4168471853 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66740c87e0 0x7f66740af760 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f667406e9d0 tx=0x7f666c01c910 comp rx=0 tx=0).stop 2023-06-10T18:52:42.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.264+0000 7f667bfb5640 1 -- 172.21.15.53:0/4168471853 shutdown_connections 2023-06-10T18:52:42.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.264+0000 7f667bfb5640 1 --2- 172.21.15.53:0/4168471853 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66740c87e0 0x7f66740af760 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:42.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.264+0000 7f667bfb5640 1 --2- 172.21.15.53:0/4168471853 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f667406c020 0x7f66740c82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:42.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.264+0000 7f667bfb5640 1 --2- 172.21.15.53:0/4168471853 >> v2:172.21.15.117:3300/0 conn(0x7f66740c9fa0 0x7f667406bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:42.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.264+0000 7f667bfb5640 1 -- 172.21.15.53:0/4168471853 >> 172.21.15.53:0/4168471853 conn(0x7f667406a0e0 msgr2=0x7f66740cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:42.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.264+0000 7f667bfb5640 1 -- 172.21.15.53:0/4168471853 shutdown_connections 2023-06-10T18:52:42.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.264+0000 7f667bfb5640 1 -- 172.21.15.53:0/4168471853 wait complete. 2023-06-10T18:52:42.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.264+0000 7f667bfb5640 1 Processor -- start 2023-06-10T18:52:42.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.264+0000 7f667bfb5640 1 -- start start 2023-06-10T18:52:42.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.264+0000 7f667bfb5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f667406c020 0x7f6674161070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:42.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.264+0000 7f667bfb5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66740c87e0 0x7f6674157560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:42.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.264+0000 7f667bfb5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66740c9fa0 0x7f6674162ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:42.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.264+0000 7f667bfb5640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f667415e7a0 con 0x7f66740c87e0 2023-06-10T18:52:42.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.264+0000 7f667bfb5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6674157aa0 con 0x7f66740c9fa0 2023-06-10T18:52:42.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.264+0000 7f667bfb5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6674161fa0 con 0x7f667406c020 2023-06-10T18:52:42.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.264+0000 7f6679550640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66740c87e0 0x7f6674157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:42.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.268+0000 7f6679550640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66740c87e0 0x7f6674157560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56032/0 (socket says 172.21.15.53:56032) 2023-06-10T18:52:42.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.268+0000 7f6679550640 1 -- 172.21.15.53:0/982059371 learned_addr learned my addr 172.21.15.53:0/982059371 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:42.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.268+0000 7f667a552640 1 --2- 172.21.15.53:0/982059371 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66740c9fa0 0x7f6674162ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:42.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.268+0000 7f6679d51640 1 --2- 172.21.15.53:0/982059371 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f667406c020 0x7f6674161070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:42.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.268+0000 7f6679550640 1 -- 172.21.15.53:0/982059371 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f667406c020 msgr2=0x7f6674161070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:42.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.268+0000 7f6679550640 1 --2- 172.21.15.53:0/982059371 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f667406c020 0x7f6674161070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:42.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.268+0000 7f6679550640 1 -- 172.21.15.53:0/982059371 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66740c9fa0 msgr2=0x7f6674162ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:42.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.268+0000 7f6679550640 1 --2- 172.21.15.53:0/982059371 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66740c9fa0 0x7f6674162ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:42.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.268+0000 7f6679550640 1 -- 172.21.15.53:0/982059371 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f666c009b30 con 0x7f66740c87e0 2023-06-10T18:52:42.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.268+0000 7f6679550640 1 --2- 172.21.15.53:0/982059371 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66740c87e0 0x7f6674157560 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f666400e900 tx=0x7f666400edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:42.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.268+0000 7f666a7fc640 1 -- 172.21.15.53:0/982059371 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6664009630 con 0x7f66740c87e0 2023-06-10T18:52:42.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.268+0000 7f666a7fc640 1 -- 172.21.15.53:0/982059371 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f666400ca00 con 0x7f66740c87e0 2023-06-10T18:52:42.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.268+0000 7f667bfb5640 1 -- 172.21.15.53:0/982059371 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6674161700 con 0x7f66740c87e0 2023-06-10T18:52:42.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.268+0000 7f666a7fc640 1 -- 172.21.15.53:0/982059371 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f666400cd90 con 0x7f66740c87e0 2023-06-10T18:52:42.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.268+0000 7f667bfb5640 1 -- 172.21.15.53:0/982059371 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6674161cc0 con 0x7f66740c87e0 2023-06-10T18:52:42.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.268+0000 7f667bfb5640 1 -- 172.21.15.53:0/982059371 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f667404d790 con 0x7f66740c87e0 2023-06-10T18:52:42.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.268+0000 7f666a7fc640 1 -- 172.21.15.53:0/982059371 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6664013470 con 0x7f66740c87e0 2023-06-10T18:52:42.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.268+0000 7f666a7fc640 1 --2- 172.21.15.53:0/982059371 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6658066280 0x7f6658068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:42.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.268+0000 7f666a7fc640 1 -- 172.21.15.53:0/982059371 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6664083b90 con 0x7f66740c87e0 2023-06-10T18:52:42.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.268+0000 7f6679d51640 1 --2- 172.21.15.53:0/982059371 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6658066280 0x7f6658068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:42.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.272+0000 7f6679d51640 1 --2- 172.21.15.53:0/982059371 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6658066280 0x7f6658068730 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f66741f5940 tx=0x7f6670008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:42.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.276+0000 7f666a7fc640 1 -- 172.21.15.53:0/982059371 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6664051360 con 0x7f66740c87e0 2023-06-10T18:52:42.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.428+0000 7f667bfb5640 1 -- 172.21.15.53:0/982059371 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f66740ce670 con 0x7f66740c87e0 2023-06-10T18:52:42.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.432+0000 7f666a7fc640 1 -- 172.21.15.53:0/982059371 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7f66640170a0 con 0x7f66740c87e0 2023-06-10T18:52:42.441 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-06-10T18:52:42.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.432+0000 7f667bfb5640 1 -- 172.21.15.53:0/982059371 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6658066280 msgr2=0x7f6658068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:42.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.432+0000 7f667bfb5640 1 --2- 172.21.15.53:0/982059371 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6658066280 0x7f6658068730 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f66741f5940 tx=0x7f6670008040 comp rx=0 tx=0).stop 2023-06-10T18:52:42.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.432+0000 7f667bfb5640 1 -- 172.21.15.53:0/982059371 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66740c87e0 msgr2=0x7f6674157560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:42.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.432+0000 7f667bfb5640 1 --2- 172.21.15.53:0/982059371 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66740c87e0 0x7f6674157560 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f666400e900 tx=0x7f666400edc0 comp rx=0 tx=0).stop 2023-06-10T18:52:42.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.432+0000 7f667bfb5640 1 -- 172.21.15.53:0/982059371 shutdown_connections 2023-06-10T18:52:42.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.432+0000 7f667bfb5640 1 --2- 172.21.15.53:0/982059371 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6658066280 0x7f6658068730 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:42.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.432+0000 7f667bfb5640 1 --2- 172.21.15.53:0/982059371 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66740c9fa0 0x7f6674162ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:42.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.432+0000 7f667bfb5640 1 --2- 172.21.15.53:0/982059371 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66740c87e0 0x7f6674157560 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:42.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.432+0000 7f667bfb5640 1 --2- 172.21.15.53:0/982059371 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f667406c020 0x7f6674161070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:42.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.432+0000 7f667bfb5640 1 -- 172.21.15.53:0/982059371 >> 172.21.15.53:0/982059371 conn(0x7f667406a0e0 msgr2=0x7f66740b0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:42.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.432+0000 7f667bfb5640 1 -- 172.21.15.53:0/982059371 shutdown_connections 2023-06-10T18:52:42.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.432+0000 7f667bfb5640 1 -- 172.21.15.53:0/982059371 wait complete. 2023-06-10T18:52:42.459 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-10T18:52:42.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.572+0000 7f52551d5640 1 Processor -- start 2023-06-10T18:52:42.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.572+0000 7f52551d5640 1 -- start start 2023-06-10T18:52:42.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.572+0000 7f52551d5640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f525015eef0 0x7f5250070f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:42.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.572+0000 7f52551d5640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f525015f570 0x7f52500ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:42.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.572+0000 7f52551d5640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f525015f2c0 con 0x7f52500ce990 2023-06-10T18:52:42.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.576+0000 7f52551d5640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f525015fdc0 con 0x7f525015f570 2023-06-10T18:52:42.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.576+0000 7f52551d5640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52501600a0 con 0x7f525015eef0 2023-06-10T18:52:42.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.576+0000 7f524e59c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f525015f570 0x7f52500ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:42.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.576+0000 7f524e59c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f525015f570 0x7f52500ce450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56048/0 (socket says 172.21.15.53:56048) 2023-06-10T18:52:42.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.576+0000 7f524e59c640 1 -- 172.21.15.53:0/4027782868 learned_addr learned my addr 172.21.15.53:0/4027782868 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:42.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.576+0000 7f524ed9d640 1 --2- 172.21.15.53:0/4027782868 >> v2:172.21.15.117:3300/0 conn(0x7f525015eef0 0x7f5250070f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:42.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.576+0000 7f524e59c640 1 -- 172.21.15.53:0/4027782868 >> v2:172.21.15.117:3300/0 conn(0x7f525015eef0 msgr2=0x7f5250070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:42.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.576+0000 7f524e59c640 1 --2- 172.21.15.53:0/4027782868 >> v2:172.21.15.117:3300/0 conn(0x7f525015eef0 0x7f5250070f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:42.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.576+0000 7f524e59c640 1 -- 172.21.15.53:0/4027782868 >> v1:172.21.15.117:6789/0 conn(0x7f52500ce990 legacy=0x7f5250069450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:42.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.576+0000 7f524e59c640 1 -- 172.21.15.53:0/4027782868 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5250160380 con 0x7f525015f570 2023-06-10T18:52:42.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.576+0000 7f524e59c640 1 --2- 172.21.15.53:0/4027782868 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f525015f570 0x7f52500ce450 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f525006b4f0 tx=0x7f524001c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d81d56ddfbf22457 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:42.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.576+0000 7f524dd9b640 1 -- 172.21.15.53:0/4027782868 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52400ac630 con 0x7f525015f570 2023-06-10T18:52:42.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.576+0000 7f524dd9b640 1 -- 172.21.15.53:0/4027782868 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52400ac790 con 0x7f525015f570 2023-06-10T18:52:42.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.576+0000 7f524dd9b640 1 -- 172.21.15.53:0/4027782868 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52400acb20 con 0x7f525015f570 2023-06-10T18:52:42.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.576+0000 7f52551d5640 1 -- 172.21.15.53:0/4027782868 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f525015f570 msgr2=0x7f52500ce450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:42.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.576+0000 7f52551d5640 1 --2- 172.21.15.53:0/4027782868 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f525015f570 0x7f52500ce450 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f525006b4f0 tx=0x7f524001c4c0 comp rx=0 tx=0).stop 2023-06-10T18:52:42.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.576+0000 7f52551d5640 1 -- 172.21.15.53:0/4027782868 shutdown_connections 2023-06-10T18:52:42.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.576+0000 7f52551d5640 1 --2- 172.21.15.53:0/4027782868 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f525015f570 0x7f52500ce450 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:42.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.576+0000 7f52551d5640 1 --2- 172.21.15.53:0/4027782868 >> v2:172.21.15.117:3300/0 conn(0x7f525015eef0 0x7f5250070f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:42.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.576+0000 7f52551d5640 1 -- 172.21.15.53:0/4027782868 >> 172.21.15.53:0/4027782868 conn(0x7f525006a560 msgr2=0x7f525006a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:42.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.576+0000 7f52551d5640 1 -- 172.21.15.53:0/4027782868 shutdown_connections 2023-06-10T18:52:42.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.576+0000 7f52551d5640 1 -- 172.21.15.53:0/4027782868 wait complete. 2023-06-10T18:52:42.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.580+0000 7f52551d5640 1 Processor -- start 2023-06-10T18:52:42.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.580+0000 7f52551d5640 1 -- start start 2023-06-10T18:52:42.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.580+0000 7f52551d5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f52500ce990 0x7f525006ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:42.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.580+0000 7f52551d5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f525015eef0 0x7f525014a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:42.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.580+0000 7f52551d5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f525015f570 0x7f52500c3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:42.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.580+0000 7f52551d5640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52500c3120 con 0x7f525015f570 2023-06-10T18:52:42.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.580+0000 7f52551d5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f525014d310 con 0x7f52500ce990 2023-06-10T18:52:42.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.580+0000 7f52551d5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5250155af0 con 0x7f525015eef0 2023-06-10T18:52:42.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.580+0000 7f524f59e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f525015f570 0x7f52500c3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:42.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.580+0000 7f524f59e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f525015f570 0x7f52500c3540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56064/0 (socket says 172.21.15.53:56064) 2023-06-10T18:52:42.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.580+0000 7f524f59e640 1 -- 172.21.15.53:0/1049937570 learned_addr learned my addr 172.21.15.53:0/1049937570 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:42.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.580+0000 7f524e59c640 1 --2- 172.21.15.53:0/1049937570 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f525015eef0 0x7f525014a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:42.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.580+0000 7f524ed9d640 1 --2- 172.21.15.53:0/1049937570 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f52500ce990 0x7f525006ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:42.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.580+0000 7f524f59e640 1 -- 172.21.15.53:0/1049937570 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f525015eef0 msgr2=0x7f525014a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:42.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.580+0000 7f524f59e640 1 --2- 172.21.15.53:0/1049937570 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f525015eef0 0x7f525014a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:42.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.580+0000 7f524f59e640 1 -- 172.21.15.53:0/1049937570 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f52500ce990 msgr2=0x7f525006ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:42.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.580+0000 7f524f59e640 1 --2- 172.21.15.53:0/1049937570 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f52500ce990 0x7f525006ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:42.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.580+0000 7f524f59e640 1 -- 172.21.15.53:0/1049937570 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52400094d0 con 0x7f525015f570 2023-06-10T18:52:42.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.580+0000 7f524e59c640 1 --2- 172.21.15.53:0/1049937570 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f525015eef0 0x7f525014a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:52:42.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.580+0000 7f524ed9d640 1 --2- 172.21.15.53:0/1049937570 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f52500ce990 0x7f525006ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:52:42.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.580+0000 7f524f59e640 1 --2- 172.21.15.53:0/1049937570 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f525015f570 0x7f52500c3540 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f524800b970 tx=0x7f524800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:42.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.580+0000 7f52377fe640 1 -- 172.21.15.53:0/1049937570 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f524800cb40 con 0x7f525015f570 2023-06-10T18:52:42.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.580+0000 7f52377fe640 1 -- 172.21.15.53:0/1049937570 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f524800cca0 con 0x7f525015f570 2023-06-10T18:52:42.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.580+0000 7f52551d5640 1 -- 172.21.15.53:0/1049937570 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52500c2a60 con 0x7f525015f570 2023-06-10T18:52:42.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.580+0000 7f52377fe640 1 -- 172.21.15.53:0/1049937570 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5248014680 con 0x7f525015f570 2023-06-10T18:52:42.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.580+0000 7f52551d5640 1 -- 172.21.15.53:0/1049937570 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5250155780 con 0x7f525015f570 2023-06-10T18:52:42.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.580+0000 7f52551d5640 1 -- 172.21.15.53:0/1049937570 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f525004d790 con 0x7f525015f570 2023-06-10T18:52:42.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.584+0000 7f52377fe640 1 -- 172.21.15.53:0/1049937570 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f524801d3b0 con 0x7f525015f570 2023-06-10T18:52:42.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.584+0000 7f52377fe640 1 --2- 172.21.15.53:0/1049937570 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f523c066280 0x7f523c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:42.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.584+0000 7f52377fe640 1 -- 172.21.15.53:0/1049937570 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f52480837c0 con 0x7f525015f570 2023-06-10T18:52:42.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.584+0000 7f524ed9d640 1 --2- 172.21.15.53:0/1049937570 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f523c066280 0x7f523c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:42.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.584+0000 7f524ed9d640 1 --2- 172.21.15.53:0/1049937570 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f523c066280 0x7f523c068730 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f52500ca580 tx=0x7f5244008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:42.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.588+0000 7f52377fe640 1 -- 172.21.15.53:0/1049937570 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5248051020 con 0x7f525015f570 2023-06-10T18:52:42.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.744+0000 7f52551d5640 1 -- 172.21.15.53:0/1049937570 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f52500b4d30 con 0x7f525015f570 2023-06-10T18:52:42.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.744+0000 7f52377fe640 1 -- 172.21.15.53:0/1049937570 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5248054640 con 0x7f525015f570 2023-06-10T18:52:42.753 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-06-10T18:52:42.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.744+0000 7f52551d5640 1 -- 172.21.15.53:0/1049937570 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f523c066280 msgr2=0x7f523c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:42.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.744+0000 7f52551d5640 1 --2- 172.21.15.53:0/1049937570 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f523c066280 0x7f523c068730 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f52500ca580 tx=0x7f5244008040 comp rx=0 tx=0).stop 2023-06-10T18:52:42.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.744+0000 7f52551d5640 1 -- 172.21.15.53:0/1049937570 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f525015f570 msgr2=0x7f52500c3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:42.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.744+0000 7f52551d5640 1 --2- 172.21.15.53:0/1049937570 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f525015f570 0x7f52500c3540 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f524800b970 tx=0x7f524800be30 comp rx=0 tx=0).stop 2023-06-10T18:52:42.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.744+0000 7f52551d5640 1 -- 172.21.15.53:0/1049937570 shutdown_connections 2023-06-10T18:52:42.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.744+0000 7f52551d5640 1 --2- 172.21.15.53:0/1049937570 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f523c066280 0x7f523c068730 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:42.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.744+0000 7f52551d5640 1 --2- 172.21.15.53:0/1049937570 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f525015f570 0x7f52500c3540 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:42.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.744+0000 7f52551d5640 1 --2- 172.21.15.53:0/1049937570 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f525015eef0 0x7f525014a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:42.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.744+0000 7f52551d5640 1 --2- 172.21.15.53:0/1049937570 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f52500ce990 0x7f525006ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:42.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.744+0000 7f52551d5640 1 -- 172.21.15.53:0/1049937570 >> 172.21.15.53:0/1049937570 conn(0x7f525006a560 msgr2=0x7f525015a970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:42.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.744+0000 7f52551d5640 1 -- 172.21.15.53:0/1049937570 shutdown_connections 2023-06-10T18:52:42.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.744+0000 7f52551d5640 1 -- 172.21.15.53:0/1049937570 wait complete. 2023-06-10T18:52:42.772 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-06-10T18:52:42.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.876+0000 7fb6b2534640 1 Processor -- start 2023-06-10T18:52:42.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.876+0000 7fb6b2534640 1 -- start start 2023-06-10T18:52:42.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.876+0000 7fb6b2534640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb6ac161180 0x7fb6ac163560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:42.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.876+0000 7fb6b2534640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6ac158a90 con 0x7fb6ac0c8d00 2023-06-10T18:52:42.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.876+0000 7fb6b2534640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6ac06f780 con 0x7fb6ac06b2f0 2023-06-10T18:52:42.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.876+0000 7fb6b2534640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6ac0705d0 con 0x7fb6ac161180 2023-06-10T18:52:42.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.876+0000 7fb6ab7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fb6ac0c8d00 0x7fb6ac06b6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52808/0 (socket says 172.21.15.53:52808) 2023-06-10T18:52:42.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.876+0000 7fb6ab7fe640 1 -- 172.21.15.53:0/3302143827 learned_addr learned my addr 172.21.15.53:0/3302143827 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:52:42.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.876+0000 7fb6b0ad1640 1 --2- 172.21.15.53:0/3302143827 >> v2:172.21.15.53:3300/0 conn(0x7fb6ac161180 0x7fb6ac163560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:42.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.880+0000 7fb6b0ad1640 1 -- 172.21.15.53:0/3302143827 >> v1:172.21.15.117:6789/0 conn(0x7fb6ac06b2f0 legacy=0x7fb6ac06f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:42.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.880+0000 7fb6b0ad1640 1 -- 172.21.15.53:0/3302143827 >> v1:172.21.15.53:6789/0 conn(0x7fb6ac0c8d00 legacy=0x7fb6ac06b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:42.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.880+0000 7fb6aaffd640 1 -- 172.21.15.53:0/3302143827 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2641345432 0 0) 0x7fb6a0001120 con 0x7fb6ac0c8d00 2023-06-10T18:52:42.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.880+0000 7fb6b0ad1640 1 -- 172.21.15.53:0/3302143827 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6ac0cce10 con 0x7fb6ac161180 2023-06-10T18:52:42.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.880+0000 7fb6b0ad1640 1 --2- 172.21.15.53:0/3302143827 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6ac161180 0x7fb6ac163560 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb6a4009d90 tx=0x7fb6a401f100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c76dda2e5c69f859 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:42.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.880+0000 7fb6aaffd640 1 -- 172.21.15.53:0/3302143827 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a40af600 con 0x7fb6ac161180 2023-06-10T18:52:42.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.880+0000 7fb6aaffd640 1 -- 172.21.15.53:0/3302143827 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6a40ab050 con 0x7fb6ac161180 2023-06-10T18:52:42.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.880+0000 7fb6aaffd640 1 -- 172.21.15.53:0/3302143827 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a40af980 con 0x7fb6ac161180 2023-06-10T18:52:42.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.880+0000 7fb6b2534640 1 -- 172.21.15.53:0/3302143827 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6ac161180 msgr2=0x7fb6ac163560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:42.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.880+0000 7fb6b2534640 1 --2- 172.21.15.53:0/3302143827 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6ac161180 0x7fb6ac163560 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb6a4009d90 tx=0x7fb6a401f100 comp rx=0 tx=0).stop 2023-06-10T18:52:42.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.880+0000 7fb6b2534640 1 -- 172.21.15.53:0/3302143827 shutdown_connections 2023-06-10T18:52:42.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.880+0000 7fb6b2534640 1 --2- 172.21.15.53:0/3302143827 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6ac161180 0x7fb6ac163560 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:42.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.880+0000 7fb6b2534640 1 -- 172.21.15.53:0/3302143827 >> 172.21.15.53:0/3302143827 conn(0x7fb6ac06a0d0 msgr2=0x7fb6ac0ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:42.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.880+0000 7fb6b2534640 1 -- 172.21.15.53:0/3302143827 shutdown_connections 2023-06-10T18:52:42.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.880+0000 7fb6b2534640 1 -- 172.21.15.53:0/3302143827 wait complete. 2023-06-10T18:52:42.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.884+0000 7fb6b2534640 1 Processor -- start 2023-06-10T18:52:42.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.884+0000 7fb6b2534640 1 -- start start 2023-06-10T18:52:42.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.884+0000 7fb6b2534640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb6ac06b2f0 0x7fb6ac14ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:42.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.884+0000 7fb6b2534640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6ac0c8d00 0x7fb6ac06c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:42.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.884+0000 7fb6b2534640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb6ac161180 0x7fb6ac06c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:42.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.884+0000 7fb6b2534640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ac0b2390 con 0x7fb6ac0c8d00 2023-06-10T18:52:42.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.884+0000 7fb6b2534640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ac0b14e0 con 0x7fb6ac06b2f0 2023-06-10T18:52:42.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.884+0000 7fb6b2534640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ac0b1780 con 0x7fb6ac161180 2023-06-10T18:52:42.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.884+0000 7fb6ab7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6ac0c8d00 0x7fb6ac06c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:42.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.884+0000 7fb6ab7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6ac0c8d00 0x7fb6ac06c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56078/0 (socket says 172.21.15.53:56078) 2023-06-10T18:52:42.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.884+0000 7fb6ab7fe640 1 -- 172.21.15.53:0/49427604 learned_addr learned my addr 172.21.15.53:0/49427604 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:42.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.884+0000 7fb6b0ad1640 1 --2- 172.21.15.53:0/49427604 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb6ac161180 0x7fb6ac06c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:42.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.884+0000 7fb6abfff640 1 --2- 172.21.15.53:0/49427604 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb6ac06b2f0 0x7fb6ac14ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:42.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.884+0000 7fb6ab7fe640 1 -- 172.21.15.53:0/49427604 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb6ac161180 msgr2=0x7fb6ac06c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:42.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.884+0000 7fb6ab7fe640 1 --2- 172.21.15.53:0/49427604 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb6ac161180 0x7fb6ac06c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:42.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.884+0000 7fb6ab7fe640 1 -- 172.21.15.53:0/49427604 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb6ac06b2f0 msgr2=0x7fb6ac14ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:42.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.884+0000 7fb6ab7fe640 1 --2- 172.21.15.53:0/49427604 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb6ac06b2f0 0x7fb6ac14ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:42.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.884+0000 7fb6ab7fe640 1 -- 172.21.15.53:0/49427604 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6a4009a70 con 0x7fb6ac0c8d00 2023-06-10T18:52:42.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.884+0000 7fb6abfff640 1 --2- 172.21.15.53:0/49427604 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb6ac06b2f0 0x7fb6ac14ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:52:42.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.884+0000 7fb6ab7fe640 1 --2- 172.21.15.53:0/49427604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6ac0c8d00 0x7fb6ac06c120 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb6a000c780 tx=0x7fb6a000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:42.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.884+0000 7fb6a8ff9640 1 -- 172.21.15.53:0/49427604 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a00072d0 con 0x7fb6ac0c8d00 2023-06-10T18:52:42.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.884+0000 7fb6a8ff9640 1 -- 172.21.15.53:0/49427604 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6a0007450 con 0x7fb6ac0c8d00 2023-06-10T18:52:42.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.884+0000 7fb6b2534640 1 -- 172.21.15.53:0/49427604 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6ac0b1a60 con 0x7fb6ac0c8d00 2023-06-10T18:52:42.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.884+0000 7fb6a8ff9640 1 -- 172.21.15.53:0/49427604 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a00047f0 con 0x7fb6ac0c8d00 2023-06-10T18:52:42.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.884+0000 7fb6b2534640 1 -- 172.21.15.53:0/49427604 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6ac0b2020 con 0x7fb6ac0c8d00 2023-06-10T18:52:42.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.884+0000 7fb6b2534640 1 -- 172.21.15.53:0/49427604 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6ac0b2540 con 0x7fb6ac0c8d00 2023-06-10T18:52:42.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.884+0000 7fb6a8ff9640 1 -- 172.21.15.53:0/49427604 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb6a0004950 con 0x7fb6ac0c8d00 2023-06-10T18:52:42.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.888+0000 7fb6a8ff9640 1 --2- 172.21.15.53:0/49427604 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb698066280 0x7fb698068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:42.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.888+0000 7fb6a8ff9640 1 -- 172.21.15.53:0/49427604 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fb6a0082dd0 con 0x7fb6ac0c8d00 2023-06-10T18:52:42.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.888+0000 7fb6abfff640 1 --2- 172.21.15.53:0/49427604 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb698066280 0x7fb698068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:42.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.888+0000 7fb6abfff640 1 --2- 172.21.15.53:0/49427604 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb698066280 0x7fb698068730 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb69c003e40 tx=0x7fb69c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:42.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:42.892+0000 7fb6a8ff9640 1 -- 172.21.15.53:0/49427604 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb6ac0b2540 con 0x7fb6ac0c8d00 2023-06-10T18:52:43.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.040+0000 7fb6b2534640 1 -- 172.21.15.53:0/49427604 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fb6ac158a90 con 0x7fb6ac0c8d00 2023-06-10T18:52:43.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.040+0000 7fb6a8ff9640 1 -- 172.21.15.53:0/49427604 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) v1 ==== 84+0+126 (secure 0 0 0) 0x7fb6ac158a90 con 0x7fb6ac0c8d00 2023-06-10T18:52:43.050 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:52:43.050 INFO:teuthology.orchestra.run.smithi053.stdout:[ 2023-06-10T18:52:43.050 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T18:52:43.051 INFO:teuthology.orchestra.run.smithi053.stdout: "poolnum": 1, 2023-06-10T18:52:43.051 INFO:teuthology.orchestra.run.smithi053.stdout: "poolname": ".mgr" 2023-06-10T18:52:43.051 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:52:43.051 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T18:52:43.051 INFO:teuthology.orchestra.run.smithi053.stdout: "poolnum": 2, 2023-06-10T18:52:43.052 INFO:teuthology.orchestra.run.smithi053.stdout: "poolname": "rbd" 2023-06-10T18:52:43.052 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:52:43.052 INFO:teuthology.orchestra.run.smithi053.stdout:] 2023-06-10T18:52:43.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.040+0000 7fb6b2534640 1 -- 172.21.15.53:0/49427604 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb698066280 msgr2=0x7fb698068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:43.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.040+0000 7fb6b2534640 1 --2- 172.21.15.53:0/49427604 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb698066280 0x7fb698068730 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb69c003e40 tx=0x7fb69c009040 comp rx=0 tx=0).stop 2023-06-10T18:52:43.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.040+0000 7fb6b2534640 1 -- 172.21.15.53:0/49427604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6ac0c8d00 msgr2=0x7fb6ac06c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:43.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.040+0000 7fb6b2534640 1 --2- 172.21.15.53:0/49427604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6ac0c8d00 0x7fb6ac06c120 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb6a000c780 tx=0x7fb6a000cc40 comp rx=0 tx=0).stop 2023-06-10T18:52:43.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.044+0000 7fb6b2534640 1 -- 172.21.15.53:0/49427604 shutdown_connections 2023-06-10T18:52:43.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.044+0000 7fb6b2534640 1 --2- 172.21.15.53:0/49427604 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb698066280 0x7fb698068730 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:43.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.044+0000 7fb6b2534640 1 --2- 172.21.15.53:0/49427604 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb6ac161180 0x7fb6ac06c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:43.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.044+0000 7fb6b2534640 1 --2- 172.21.15.53:0/49427604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6ac0c8d00 0x7fb6ac06c120 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:43.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.044+0000 7fb6b2534640 1 --2- 172.21.15.53:0/49427604 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb6ac06b2f0 0x7fb6ac14ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:43.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.044+0000 7fb6b2534640 1 -- 172.21.15.53:0/49427604 >> 172.21.15.53:0/49427604 conn(0x7fb6ac06a0d0 msgr2=0x7fb6ac0b33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:43.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.044+0000 7fb6b2534640 1 -- 172.21.15.53:0/49427604 shutdown_connections 2023-06-10T18:52:43.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.044+0000 7fb6b2534640 1 -- 172.21.15.53:0/49427604 wait complete. 2023-06-10T18:52:43.067 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-06-10T18:52:43.067 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-06-10T18:52:43.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.184+0000 7f9564fd8640 1 Processor -- start 2023-06-10T18:52:43.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.184+0000 7f9564fd8640 1 -- start start 2023-06-10T18:52:43.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.184+0000 7f9564fd8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f95600b3d80 0x7f9560069550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:43.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.184+0000 7f9564fd8640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f956015bed0 con 0x7f956006ba00 2023-06-10T18:52:43.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.184+0000 7f9564fd8640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f956015c1b0 con 0x7f95600b41d0 2023-06-10T18:52:43.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.184+0000 7f9564fd8640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f956015cb50 con 0x7f95600b3d80 2023-06-10T18:52:43.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.188+0000 7f955dd9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f95600b3d80 0x7f9560069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:43.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.188+0000 7f955dd9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f95600b3d80 0x7f9560069550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56086/0 (socket says 172.21.15.53:56086) 2023-06-10T18:52:43.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.188+0000 7f955dd9b640 1 -- 172.21.15.53:0/1484862785 learned_addr learned my addr 172.21.15.53:0/1484862785 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:43.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.188+0000 7f955e59c640 1 --1- 172.21.15.53:0/1484862785 >> v1:172.21.15.53:6789/0 conn(0x7f956006ba00 0x7f956006bdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52812/0 (socket says 172.21.15.53:52812) 2023-06-10T18:52:43.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.188+0000 7f955dd9b640 1 -- 172.21.15.53:0/1484862785 >> v1:172.21.15.117:6789/0 conn(0x7f95600b41d0 legacy=0x7f9560069a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:43.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.188+0000 7f955dd9b640 1 -- 172.21.15.53:0/1484862785 >> v1:172.21.15.53:6789/0 conn(0x7f956006ba00 legacy=0x7f956006bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:43.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.188+0000 7f955d59a640 1 -- 172.21.15.53:0/1484862785 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 221809163 0 0) 0x7f956015bed0 con 0x7f956006ba00 2023-06-10T18:52:43.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.188+0000 7f955dd9b640 1 -- 172.21.15.53:0/1484862785 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f956015c490 con 0x7f95600b3d80 2023-06-10T18:52:43.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.188+0000 7f955dd9b640 1 --2- 172.21.15.53:0/1484862785 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f95600b3d80 0x7f9560069550 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9554009870 tx=0x7f955401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=498ce241da827f1f server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:43.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.188+0000 7f955d59a640 1 -- 172.21.15.53:0/1484862785 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95540a6040 con 0x7f95600b3d80 2023-06-10T18:52:43.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.188+0000 7f955d59a640 1 -- 172.21.15.53:0/1484862785 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95540aa600 con 0x7f95600b3d80 2023-06-10T18:52:43.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.188+0000 7f955d59a640 1 -- 172.21.15.53:0/1484862785 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95540aa990 con 0x7f95600b3d80 2023-06-10T18:52:43.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.188+0000 7f9564fd8640 1 -- 172.21.15.53:0/1484862785 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f95600b3d80 msgr2=0x7f9560069550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:43.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.188+0000 7f9564fd8640 1 --2- 172.21.15.53:0/1484862785 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f95600b3d80 0x7f9560069550 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9554009870 tx=0x7f955401c480 comp rx=0 tx=0).stop 2023-06-10T18:52:43.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.188+0000 7f9564fd8640 1 -- 172.21.15.53:0/1484862785 shutdown_connections 2023-06-10T18:52:43.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.188+0000 7f9564fd8640 1 --2- 172.21.15.53:0/1484862785 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f95600b3d80 0x7f9560069550 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:43.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.188+0000 7f9564fd8640 1 -- 172.21.15.53:0/1484862785 >> 172.21.15.53:0/1484862785 conn(0x7f95600cf170 msgr2=0x7f95600b3670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:43.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.188+0000 7f9564fd8640 1 -- 172.21.15.53:0/1484862785 shutdown_connections 2023-06-10T18:52:43.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.188+0000 7f9564fd8640 1 -- 172.21.15.53:0/1484862785 wait complete. 2023-06-10T18:52:43.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.192+0000 7f9564fd8640 1 Processor -- start 2023-06-10T18:52:43.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.192+0000 7f9564fd8640 1 -- start start 2023-06-10T18:52:43.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.192+0000 7f9564fd8640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f956006ba00 0x7f95600cd900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:43.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.192+0000 7f9564fd8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95600b3d80 0x7f9560153330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:43.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.192+0000 7f9564fd8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f95600b41d0 0x7f956014ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:43.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.192+0000 7f9564fd8640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95600cb890 con 0x7f95600b41d0 2023-06-10T18:52:43.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.192+0000 7f9564fd8640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95600cde40 con 0x7f95600b3d80 2023-06-10T18:52:43.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.192+0000 7f9564fd8640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f956014e310 con 0x7f956006ba00 2023-06-10T18:52:43.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.192+0000 7f955ed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f95600b41d0 0x7f956014ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:43.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.192+0000 7f955ed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f95600b41d0 0x7f956014ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56090/0 (socket says 172.21.15.53:56090) 2023-06-10T18:52:43.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.192+0000 7f955ed9d640 1 -- 172.21.15.53:0/649158700 learned_addr learned my addr 172.21.15.53:0/649158700 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:43.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.192+0000 7f955e59c640 1 --2- 172.21.15.53:0/649158700 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f956006ba00 0x7f95600cd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:43.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.192+0000 7f955dd9b640 1 --2- 172.21.15.53:0/649158700 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95600b3d80 0x7f9560153330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:43.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.192+0000 7f955ed9d640 1 -- 172.21.15.53:0/649158700 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f956006ba00 msgr2=0x7f95600cd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:43.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.192+0000 7f955ed9d640 1 --2- 172.21.15.53:0/649158700 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f956006ba00 0x7f95600cd900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:43.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.192+0000 7f955ed9d640 1 -- 172.21.15.53:0/649158700 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95600b3d80 msgr2=0x7f9560153330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:43.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.192+0000 7f955ed9d640 1 --2- 172.21.15.53:0/649158700 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95600b3d80 0x7f9560153330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:43.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.192+0000 7f955ed9d640 1 -- 172.21.15.53:0/649158700 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95540094d0 con 0x7f95600b41d0 2023-06-10T18:52:43.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.192+0000 7f955e59c640 1 --2- 172.21.15.53:0/649158700 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f956006ba00 0x7f95600cd900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:52:43.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.192+0000 7f955ed9d640 1 --2- 172.21.15.53:0/649158700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f95600b41d0 0x7f956014ae40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f955800c760 tx=0x7f955800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:43.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.192+0000 7f954effd640 1 -- 172.21.15.53:0/649158700 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9558003b80 con 0x7f95600b41d0 2023-06-10T18:52:43.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.192+0000 7f954effd640 1 -- 172.21.15.53:0/649158700 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9558003ce0 con 0x7f95600b41d0 2023-06-10T18:52:43.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.192+0000 7f954effd640 1 -- 172.21.15.53:0/649158700 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f955800aa30 con 0x7f95600b41d0 2023-06-10T18:52:43.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.192+0000 7f9564fd8640 1 -- 172.21.15.53:0/649158700 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95600ccab0 con 0x7f95600b41d0 2023-06-10T18:52:43.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.192+0000 7f9564fd8640 1 -- 172.21.15.53:0/649158700 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95600cb1d0 con 0x7f95600b41d0 2023-06-10T18:52:43.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.192+0000 7f9564fd8640 1 -- 172.21.15.53:0/649158700 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95600cb9d0 con 0x7f95600b41d0 2023-06-10T18:52:43.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.196+0000 7f954effd640 1 -- 172.21.15.53:0/649158700 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f955800ab90 con 0x7f95600b41d0 2023-06-10T18:52:43.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.196+0000 7f954effd640 1 --2- 172.21.15.53:0/649158700 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9540066280 0x7f9540068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:43.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.196+0000 7f954effd640 1 -- 172.21.15.53:0/649158700 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f9558083700 con 0x7f95600b41d0 2023-06-10T18:52:43.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.196+0000 7f955e59c640 1 --2- 172.21.15.53:0/649158700 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9540066280 0x7f9540068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:43.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.196+0000 7f955e59c640 1 --2- 172.21.15.53:0/649158700 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9540066280 0x7f9540068730 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9550000f70 tx=0x7f9550009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:43.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.200+0000 7f954effd640 1 -- 172.21.15.53:0/649158700 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f95600cb9d0 con 0x7f95600b41d0 2023-06-10T18:52:43.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.352+0000 7f9564fd8640 1 -- 172.21.15.53:0/649158700 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f95600cb9d0 con 0x7f95600b41d0 2023-06-10T18:52:43.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.524+0000 7f954effd640 1 -- 172.21.15.53:0/649158700 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v20) v1 ==== 138+0+0 (secure 0 0 0) 0x7f95600cb9d0 con 0x7f95600b41d0 2023-06-10T18:52:43.533 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_metadata' created 2023-06-10T18:52:43.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.532+0000 7f9564fd8640 1 -- 172.21.15.53:0/649158700 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9540066280 msgr2=0x7f9540068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:43.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.532+0000 7f9564fd8640 1 --2- 172.21.15.53:0/649158700 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9540066280 0x7f9540068730 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9550000f70 tx=0x7f9550009040 comp rx=0 tx=0).stop 2023-06-10T18:52:43.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.532+0000 7f9564fd8640 1 -- 172.21.15.53:0/649158700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f95600b41d0 msgr2=0x7f956014ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:43.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.532+0000 7f9564fd8640 1 --2- 172.21.15.53:0/649158700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f95600b41d0 0x7f956014ae40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f955800c760 tx=0x7f955800cc20 comp rx=0 tx=0).stop 2023-06-10T18:52:43.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.532+0000 7f9564fd8640 1 -- 172.21.15.53:0/649158700 shutdown_connections 2023-06-10T18:52:43.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.532+0000 7f9564fd8640 1 --2- 172.21.15.53:0/649158700 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9540066280 0x7f9540068730 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:43.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.532+0000 7f9564fd8640 1 --2- 172.21.15.53:0/649158700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f95600b41d0 0x7f956014ae40 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:43.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.532+0000 7f9564fd8640 1 --2- 172.21.15.53:0/649158700 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95600b3d80 0x7f9560153330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:43.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.532+0000 7f9564fd8640 1 --2- 172.21.15.53:0/649158700 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f956006ba00 0x7f95600cd900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:43.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.532+0000 7f9564fd8640 1 -- 172.21.15.53:0/649158700 >> 172.21.15.53:0/649158700 conn(0x7f95600cf170 msgr2=0x7f9560151750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:43.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.532+0000 7f9564fd8640 1 -- 172.21.15.53:0/649158700 shutdown_connections 2023-06-10T18:52:43.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.532+0000 7f9564fd8640 1 -- 172.21.15.53:0/649158700 wait complete. 2023-06-10T18:52:43.566 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-06-10T18:52:43.697 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.688+0000 7f83a9a4f640 1 Processor -- start 2023-06-10T18:52:43.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.688+0000 7f83a9a4f640 1 -- start start 2023-06-10T18:52:43.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.688+0000 7f83a9a4f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f83a40ac920 0x7f83a406c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:43.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.688+0000 7f83a9a4f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83a415fec0 0x7f83a41559c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:43.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.688+0000 7f83a9a4f640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83a406ca30 con 0x7f83a40af810 2023-06-10T18:52:43.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.688+0000 7f83a9a4f640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83a40acdc0 con 0x7f83a40ac920 2023-06-10T18:52:43.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.688+0000 7f83a9a4f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83a415fa30 con 0x7f83a415fec0 2023-06-10T18:52:43.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.688+0000 7f83a27fc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f83a40ac920 0x7f83a406c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:43.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.688+0000 7f83a27fc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f83a40ac920 0x7f83a406c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56106/0 (socket says 172.21.15.53:56106) 2023-06-10T18:52:43.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.688+0000 7f83a27fc640 1 -- 172.21.15.53:0/287005174 learned_addr learned my addr 172.21.15.53:0/287005174 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:43.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.688+0000 7f83a37fe640 1 --2- 172.21.15.53:0/287005174 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83a415fec0 0x7f83a41559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:43.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.688+0000 7f83a27fc640 1 -- 172.21.15.53:0/287005174 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83a415fec0 msgr2=0x7f83a41559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:43.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.688+0000 7f83a27fc640 1 --2- 172.21.15.53:0/287005174 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83a415fec0 0x7f83a41559c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:43.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.688+0000 7f83a27fc640 1 -- 172.21.15.53:0/287005174 >> v1:172.21.15.117:6789/0 conn(0x7f83a40af810 legacy=0x7f83a40afbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:43.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.688+0000 7f83a27fc640 1 -- 172.21.15.53:0/287005174 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83a40acfb0 con 0x7f83a40ac920 2023-06-10T18:52:43.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.692+0000 7f83a27fc640 1 --2- 172.21.15.53:0/287005174 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83a40ac920 0x7f83a406c4f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f838c009870 tx=0x7f838c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a3e10ff58a50b85 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:43.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.692+0000 7f83a1ffb640 1 -- 172.21.15.53:0/287005174 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838c0ab680 con 0x7f83a40ac920 2023-06-10T18:52:43.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.692+0000 7f83a1ffb640 1 -- 172.21.15.53:0/287005174 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f838c0ab7e0 con 0x7f83a40ac920 2023-06-10T18:52:43.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.692+0000 7f83a1ffb640 1 -- 172.21.15.53:0/287005174 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838c0abb70 con 0x7f83a40ac920 2023-06-10T18:52:43.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.692+0000 7f83a9a4f640 1 -- 172.21.15.53:0/287005174 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83a40ac920 msgr2=0x7f83a406c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:43.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.692+0000 7f83a9a4f640 1 --2- 172.21.15.53:0/287005174 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83a40ac920 0x7f83a406c4f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f838c009870 tx=0x7f838c01c480 comp rx=0 tx=0).stop 2023-06-10T18:52:43.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.692+0000 7f83a9a4f640 1 -- 172.21.15.53:0/287005174 shutdown_connections 2023-06-10T18:52:43.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.692+0000 7f83a9a4f640 1 --2- 172.21.15.53:0/287005174 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83a415fec0 0x7f83a41559c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:43.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.692+0000 7f83a9a4f640 1 --2- 172.21.15.53:0/287005174 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83a40ac920 0x7f83a406c4f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:43.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.692+0000 7f83a9a4f640 1 -- 172.21.15.53:0/287005174 >> 172.21.15.53:0/287005174 conn(0x7f83a406a0e0 msgr2=0x7f83a40ca810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:43.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.692+0000 7f83a9a4f640 1 -- 172.21.15.53:0/287005174 shutdown_connections 2023-06-10T18:52:43.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.692+0000 7f83a9a4f640 1 -- 172.21.15.53:0/287005174 wait complete. 2023-06-10T18:52:43.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.692+0000 7f83a9a4f640 1 Processor -- start 2023-06-10T18:52:43.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.692+0000 7f83a9a4f640 1 -- start start 2023-06-10T18:52:43.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.696+0000 7f83a9a4f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83a40ac920 0x7f83a415c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:43.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.696+0000 7f83a9a4f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83a40af810 0x7f83a40c5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:43.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.696+0000 7f83a9a4f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83a415fec0 0x7f83a40c64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:43.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.696+0000 7f83a9a4f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a41487c0 con 0x7f83a40ac920 2023-06-10T18:52:43.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.696+0000 7f83a9a4f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a4145d10 con 0x7f83a40af810 2023-06-10T18:52:43.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.696+0000 7f83a9a4f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83a415f240 con 0x7f83a415fec0 2023-06-10T18:52:43.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.696+0000 7f83a2ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83a40ac920 0x7f83a415c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:43.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.696+0000 7f83a2ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83a40ac920 0x7f83a415c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56112/0 (socket says 172.21.15.53:56112) 2023-06-10T18:52:43.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.696+0000 7f83a2ffd640 1 -- 172.21.15.53:0/368215449 learned_addr learned my addr 172.21.15.53:0/368215449 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:43.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.696+0000 7f83a37fe640 1 --2- 172.21.15.53:0/368215449 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83a415fec0 0x7f83a40c64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:43.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.696+0000 7f83a27fc640 1 --2- 172.21.15.53:0/368215449 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83a40af810 0x7f83a40c5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:43.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.696+0000 7f83a2ffd640 1 -- 172.21.15.53:0/368215449 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83a415fec0 msgr2=0x7f83a40c64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:43.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.696+0000 7f83a2ffd640 1 --2- 172.21.15.53:0/368215449 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83a415fec0 0x7f83a40c64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:43.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.696+0000 7f83a2ffd640 1 -- 172.21.15.53:0/368215449 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83a40af810 msgr2=0x7f83a40c5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:43.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.696+0000 7f83a2ffd640 1 --2- 172.21.15.53:0/368215449 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83a40af810 0x7f83a40c5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:43.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.696+0000 7f83a2ffd640 1 -- 172.21.15.53:0/368215449 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f838c0094d0 con 0x7f83a40ac920 2023-06-10T18:52:43.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.696+0000 7f83a27fc640 1 --2- 172.21.15.53:0/368215449 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83a40af810 0x7f83a40c5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:52:43.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.696+0000 7f83a2ffd640 1 --2- 172.21.15.53:0/368215449 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83a40ac920 0x7f83a415c100 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f839400c500 tx=0x7f839400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:43.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.696+0000 7f839bfff640 1 -- 172.21.15.53:0/368215449 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8394005220 con 0x7f83a40ac920 2023-06-10T18:52:43.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.696+0000 7f839bfff640 1 -- 172.21.15.53:0/368215449 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8394005380 con 0x7f83a40ac920 2023-06-10T18:52:43.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.696+0000 7f83a9a4f640 1 -- 172.21.15.53:0/368215449 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83a40c6a20 con 0x7f83a40ac920 2023-06-10T18:52:43.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.696+0000 7f839bfff640 1 -- 172.21.15.53:0/368215449 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8394007270 con 0x7f83a40ac920 2023-06-10T18:52:43.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.696+0000 7f83a9a4f640 1 -- 172.21.15.53:0/368215449 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83a415ef60 con 0x7f83a40ac920 2023-06-10T18:52:43.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.696+0000 7f83a9a4f640 1 -- 172.21.15.53:0/368215449 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83a4145ea0 con 0x7f83a40ac920 2023-06-10T18:52:43.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.696+0000 7f839bfff640 1 -- 172.21.15.53:0/368215449 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f83940073d0 con 0x7f83a40ac920 2023-06-10T18:52:43.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.696+0000 7f839bfff640 1 --2- 172.21.15.53:0/368215449 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8384066280 0x7f8384068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:43.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.696+0000 7f839bfff640 1 -- 172.21.15.53:0/368215449 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f8394083560 con 0x7f83a40ac920 2023-06-10T18:52:43.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.696+0000 7f83a27fc640 1 --2- 172.21.15.53:0/368215449 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8384066280 0x7f8384068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:43.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.700+0000 7f83a27fc640 1 --2- 172.21.15.53:0/368215449 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8384066280 0x7f8384068730 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f838c0af000 tx=0x7f838c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:43.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.700+0000 7f839bfff640 1 -- 172.21.15.53:0/368215449 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8394050c30 con 0x7f83a40ac920 2023-06-10T18:52:43.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:43.848+0000 7f83a9a4f640 1 -- 172.21.15.53:0/368215449 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f83a406ca30 con 0x7f83a40ac920 2023-06-10T18:52:44.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.528+0000 7f839bfff640 1 -- 172.21.15.53:0/368215449 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v21) v1 ==== 170+0+0 (secure 0 0 0) 0x7f83a406ca30 con 0x7f83a40ac920 2023-06-10T18:52:44.539 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_data' created 2023-06-10T18:52:44.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.544+0000 7f83a9a4f640 1 -- 172.21.15.53:0/368215449 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8384066280 msgr2=0x7f8384068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:44.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.544+0000 7f83a9a4f640 1 --2- 172.21.15.53:0/368215449 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8384066280 0x7f8384068730 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f838c0af000 tx=0x7f838c008040 comp rx=0 tx=0).stop 2023-06-10T18:52:44.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.544+0000 7f83a9a4f640 1 -- 172.21.15.53:0/368215449 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83a40ac920 msgr2=0x7f83a415c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:44.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.544+0000 7f83a9a4f640 1 --2- 172.21.15.53:0/368215449 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83a40ac920 0x7f83a415c100 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f839400c500 tx=0x7f839400c9c0 comp rx=0 tx=0).stop 2023-06-10T18:52:44.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.548+0000 7f83a9a4f640 1 -- 172.21.15.53:0/368215449 shutdown_connections 2023-06-10T18:52:44.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.548+0000 7f83a9a4f640 1 --2- 172.21.15.53:0/368215449 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8384066280 0x7f8384068730 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:44.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.548+0000 7f83a9a4f640 1 --2- 172.21.15.53:0/368215449 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83a415fec0 0x7f83a40c64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:44.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.548+0000 7f83a9a4f640 1 --2- 172.21.15.53:0/368215449 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83a40af810 0x7f83a40c5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:44.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.548+0000 7f83a9a4f640 1 --2- 172.21.15.53:0/368215449 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83a40ac920 0x7f83a415c100 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:44.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.548+0000 7f83a9a4f640 1 -- 172.21.15.53:0/368215449 >> 172.21.15.53:0/368215449 conn(0x7f83a406a0e0 msgr2=0x7f83a406fa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:44.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.548+0000 7f83a9a4f640 1 -- 172.21.15.53:0/368215449 shutdown_connections 2023-06-10T18:52:44.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.548+0000 7f83a9a4f640 1 -- 172.21.15.53:0/368215449 wait complete. 2023-06-10T18:52:44.586 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-06-10T18:52:44.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.700+0000 7f7457d5b640 1 Processor -- start 2023-06-10T18:52:44.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.700+0000 7f7457d5b640 1 -- start start 2023-06-10T18:52:44.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.704+0000 7f7457d5b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f745015c060 0x7f74500cc020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:44.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.704+0000 7f7457d5b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7450070de0 0x7f745015c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:44.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.704+0000 7f7457d5b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f745015c970 0x7f745006bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:44.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.704+0000 7f7457d5b640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74500c8d50 con 0x7f7450070de0 2023-06-10T18:52:44.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.704+0000 7f7457d5b640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74500c9030 con 0x7f745015c970 2023-06-10T18:52:44.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.704+0000 7f7457d5b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7450070300 con 0x7f745015c060 2023-06-10T18:52:44.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.704+0000 7f74552f6640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7450070de0 0x7f745015c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:44.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.704+0000 7f74552f6640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7450070de0 0x7f745015c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56114/0 (socket says 172.21.15.53:56114) 2023-06-10T18:52:44.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.704+0000 7f74552f6640 1 -- 172.21.15.53:0/4091992545 learned_addr learned my addr 172.21.15.53:0/4091992545 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:44.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.704+0000 7f7455af7640 1 --2- 172.21.15.53:0/4091992545 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f745015c060 0x7f74500cc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:44.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.704+0000 7f74562f8640 1 --2- 172.21.15.53:0/4091992545 >> v2:172.21.15.117:3300/0 conn(0x7f745015c970 0x7f745006bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:44.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.704+0000 7f74552f6640 1 -- 172.21.15.53:0/4091992545 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f745015c060 msgr2=0x7f74500cc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:44.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.704+0000 7f74552f6640 1 --2- 172.21.15.53:0/4091992545 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f745015c060 0x7f74500cc020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:44.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.704+0000 7f74552f6640 1 -- 172.21.15.53:0/4091992545 >> v2:172.21.15.117:3300/0 conn(0x7f745015c970 msgr2=0x7f745006bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:44.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.704+0000 7f74552f6640 1 --2- 172.21.15.53:0/4091992545 >> v2:172.21.15.117:3300/0 conn(0x7f745015c970 0x7f745006bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:44.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.704+0000 7f74552f6640 1 -- 172.21.15.53:0/4091992545 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74500705e0 con 0x7f7450070de0 2023-06-10T18:52:44.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.704+0000 7f74562f8640 1 --2- 172.21.15.53:0/4091992545 >> v2:172.21.15.117:3300/0 conn(0x7f745015c970 0x7f745006bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:52:44.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.704+0000 7f7455af7640 1 --2- 172.21.15.53:0/4091992545 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f745015c060 0x7f74500cc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:52:44.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.704+0000 7f74552f6640 1 --2- 172.21.15.53:0/4091992545 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7450070de0 0x7f745015c430 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f74500ceb60 tx=0x7f744001e680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2af01cff483f8e0d server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:44.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.704+0000 7f7454af5640 1 -- 172.21.15.53:0/4091992545 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74400ab630 con 0x7f7450070de0 2023-06-10T18:52:44.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.704+0000 7f7454af5640 1 -- 172.21.15.53:0/4091992545 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74400ab790 con 0x7f7450070de0 2023-06-10T18:52:44.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.704+0000 7f7454af5640 1 -- 172.21.15.53:0/4091992545 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74400abb20 con 0x7f7450070de0 2023-06-10T18:52:44.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.708+0000 7f7457d5b640 1 -- 172.21.15.53:0/4091992545 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7450070de0 msgr2=0x7f745015c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:44.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.708+0000 7f7457d5b640 1 --2- 172.21.15.53:0/4091992545 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7450070de0 0x7f745015c430 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f74500ceb60 tx=0x7f744001e680 comp rx=0 tx=0).stop 2023-06-10T18:52:44.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.708+0000 7f7457d5b640 1 -- 172.21.15.53:0/4091992545 shutdown_connections 2023-06-10T18:52:44.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.708+0000 7f7457d5b640 1 --2- 172.21.15.53:0/4091992545 >> v2:172.21.15.117:3300/0 conn(0x7f745015c970 0x7f745006bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:44.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.708+0000 7f7457d5b640 1 --2- 172.21.15.53:0/4091992545 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7450070de0 0x7f745015c430 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:44.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.708+0000 7f7457d5b640 1 --2- 172.21.15.53:0/4091992545 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f745015c060 0x7f74500cc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:44.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.708+0000 7f7457d5b640 1 -- 172.21.15.53:0/4091992545 >> 172.21.15.53:0/4091992545 conn(0x7f745006a0e0 msgr2=0x7f74500cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:44.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.708+0000 7f7457d5b640 1 -- 172.21.15.53:0/4091992545 shutdown_connections 2023-06-10T18:52:44.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.708+0000 7f7457d5b640 1 -- 172.21.15.53:0/4091992545 wait complete. 2023-06-10T18:52:44.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.708+0000 7f7457d5b640 1 Processor -- start 2023-06-10T18:52:44.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.708+0000 7f7457d5b640 1 -- start start 2023-06-10T18:52:44.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.708+0000 7f7457d5b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7450070de0 0x7f745014a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:44.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.708+0000 7f7457d5b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f745015c060 0x7f74500b33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:44.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.708+0000 7f7457d5b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f745015c970 0x7f74501574a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:44.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.708+0000 7f7457d5b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74500c1780 con 0x7f7450070de0 2023-06-10T18:52:44.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.708+0000 7f7457d5b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f745014a740 con 0x7f745015c060 2023-06-10T18:52:44.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.708+0000 7f7457d5b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f745015a8c0 con 0x7f745015c970 2023-06-10T18:52:44.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.708+0000 7f7455af7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7450070de0 0x7f745014a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:44.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.708+0000 7f7455af7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7450070de0 0x7f745014a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56116/0 (socket says 172.21.15.53:56116) 2023-06-10T18:52:44.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.708+0000 7f7455af7640 1 -- 172.21.15.53:0/1875157725 learned_addr learned my addr 172.21.15.53:0/1875157725 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:44.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.708+0000 7f74562f8640 1 --2- 172.21.15.53:0/1875157725 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f745015c970 0x7f74501574a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:44.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.708+0000 7f74552f6640 1 --2- 172.21.15.53:0/1875157725 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f745015c060 0x7f74500b33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:44.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.708+0000 7f7455af7640 1 -- 172.21.15.53:0/1875157725 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f745015c970 msgr2=0x7f74501574a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:44.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.708+0000 7f7455af7640 1 --2- 172.21.15.53:0/1875157725 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f745015c970 0x7f74501574a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:44.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.708+0000 7f7455af7640 1 -- 172.21.15.53:0/1875157725 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f745015c060 msgr2=0x7f74500b33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:44.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.708+0000 7f7455af7640 1 --2- 172.21.15.53:0/1875157725 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f745015c060 0x7f74500b33e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:44.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.708+0000 7f7455af7640 1 -- 172.21.15.53:0/1875157725 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74400094d0 con 0x7f7450070de0 2023-06-10T18:52:44.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.708+0000 7f7455af7640 1 --2- 172.21.15.53:0/1875157725 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7450070de0 0x7f745014a200 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f744c00c7c0 tx=0x7f744c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:44.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.708+0000 7f74467fc640 1 -- 172.21.15.53:0/1875157725 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744c007a30 con 0x7f7450070de0 2023-06-10T18:52:44.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.708+0000 7f74467fc640 1 -- 172.21.15.53:0/1875157725 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f744c007b90 con 0x7f7450070de0 2023-06-10T18:52:44.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.712+0000 7f74467fc640 1 -- 172.21.15.53:0/1875157725 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744c00ce70 con 0x7f7450070de0 2023-06-10T18:52:44.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.712+0000 7f7457d5b640 1 -- 172.21.15.53:0/1875157725 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f745015aba0 con 0x7f7450070de0 2023-06-10T18:52:44.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.712+0000 7f7457d5b640 1 -- 172.21.15.53:0/1875157725 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f745015b160 con 0x7f7450070de0 2023-06-10T18:52:44.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.712+0000 7f7457d5b640 1 -- 172.21.15.53:0/1875157725 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74500c19a0 con 0x7f7450070de0 2023-06-10T18:52:44.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.712+0000 7f74467fc640 1 -- 172.21.15.53:0/1875157725 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f744c0113f0 con 0x7f7450070de0 2023-06-10T18:52:44.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.712+0000 7f74467fc640 1 --2- 172.21.15.53:0/1875157725 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7434066280 0x7f7434068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:44.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.712+0000 7f74467fc640 1 -- 172.21.15.53:0/1875157725 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f744c083ea0 con 0x7f7450070de0 2023-06-10T18:52:44.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.712+0000 7f74552f6640 1 --2- 172.21.15.53:0/1875157725 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7434066280 0x7f7434068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:44.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.712+0000 7f74552f6640 1 --2- 172.21.15.53:0/1875157725 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7434066280 0x7f7434068730 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f74400b0000 tx=0x7f7440008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:44.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.716+0000 7f74467fc640 1 -- 172.21.15.53:0/1875157725 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f74500c19a0 con 0x7f7450070de0 2023-06-10T18:52:44.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.912+0000 7f7457d5b640 1 -- 172.21.15.53:0/1875157725 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f745004d790 con 0x7f7450070de0 2023-06-10T18:52:44.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.924+0000 7f74467fc640 1 -- 172.21.15.53:0/1875157725 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f744c054e10 con 0x7f7450070de0 2023-06-10T18:52:44.933 INFO:teuthology.orchestra.run.smithi053.stderr:new fs with metadata pool 3 and data pool 4 2023-06-10T18:52:44.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.928+0000 7f7457d5b640 1 -- 172.21.15.53:0/1875157725 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7434066280 msgr2=0x7f7434068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:44.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.928+0000 7f7457d5b640 1 --2- 172.21.15.53:0/1875157725 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7434066280 0x7f7434068730 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f74400b0000 tx=0x7f7440008040 comp rx=0 tx=0).stop 2023-06-10T18:52:44.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.928+0000 7f7457d5b640 1 -- 172.21.15.53:0/1875157725 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7450070de0 msgr2=0x7f745014a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:44.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.928+0000 7f7457d5b640 1 --2- 172.21.15.53:0/1875157725 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7450070de0 0x7f745014a200 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f744c00c7c0 tx=0x7f744c00cc80 comp rx=0 tx=0).stop 2023-06-10T18:52:44.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.932+0000 7f7457d5b640 1 -- 172.21.15.53:0/1875157725 shutdown_connections 2023-06-10T18:52:44.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.932+0000 7f7457d5b640 1 --2- 172.21.15.53:0/1875157725 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7434066280 0x7f7434068730 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:44.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.932+0000 7f7457d5b640 1 --2- 172.21.15.53:0/1875157725 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f745015c970 0x7f74501574a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:44.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.932+0000 7f7457d5b640 1 --2- 172.21.15.53:0/1875157725 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f745015c060 0x7f74500b33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:44.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.932+0000 7f7457d5b640 1 --2- 172.21.15.53:0/1875157725 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7450070de0 0x7f745014a200 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:44.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.932+0000 7f7457d5b640 1 -- 172.21.15.53:0/1875157725 >> 172.21.15.53:0/1875157725 conn(0x7f745006a0e0 msgr2=0x7f74500aef20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:44.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.932+0000 7f7457d5b640 1 -- 172.21.15.53:0/1875157725 shutdown_connections 2023-06-10T18:52:44.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:44.932+0000 7f7457d5b640 1 -- 172.21.15.53:0/1875157725 wait complete. 2023-06-10T18:52:44.975 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T18:52:45.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.084+0000 7fd566554640 1 Processor -- start 2023-06-10T18:52:45.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.088+0000 7fd566554640 1 -- start start 2023-06-10T18:52:45.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.088+0000 7fd566554640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd56015b870 0x7fd56006a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:45.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.088+0000 7fd566554640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd5600affc0 0x7fd5600b03f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:45.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.088+0000 7fd566554640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd560069450 0x7fd5600698d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:45.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.088+0000 7fd566554640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd56006ae70 con 0x7fd560069450 2023-06-10T18:52:45.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.088+0000 7fd566554640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5600b0930 con 0x7fd5600affc0 2023-06-10T18:52:45.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.088+0000 7fd566554640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5600655c0 con 0x7fd56015b870 2023-06-10T18:52:45.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.088+0000 7fd564af1640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd560069450 0x7fd5600698d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:45.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.088+0000 7fd564af1640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd560069450 0x7fd5600698d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56128/0 (socket says 172.21.15.53:56128) 2023-06-10T18:52:45.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.088+0000 7fd564af1640 1 -- 172.21.15.53:0/597673796 learned_addr learned my addr 172.21.15.53:0/597673796 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:45.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.088+0000 7fd557fff640 1 --2- 172.21.15.53:0/597673796 >> v2:172.21.15.117:3300/0 conn(0x7fd5600affc0 0x7fd5600b03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:45.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.088+0000 7fd55ffff640 1 --2- 172.21.15.53:0/597673796 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd56015b870 0x7fd56006a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:45.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.088+0000 7fd564af1640 1 -- 172.21.15.53:0/597673796 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd56015b870 msgr2=0x7fd56006a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:45.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.088+0000 7fd564af1640 1 --2- 172.21.15.53:0/597673796 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd56015b870 0x7fd56006a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:45.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.088+0000 7fd564af1640 1 -- 172.21.15.53:0/597673796 >> v2:172.21.15.117:3300/0 conn(0x7fd5600affc0 msgr2=0x7fd5600b03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:45.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.088+0000 7fd564af1640 1 --2- 172.21.15.53:0/597673796 >> v2:172.21.15.117:3300/0 conn(0x7fd5600affc0 0x7fd5600b03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:45.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.088+0000 7fd564af1640 1 -- 172.21.15.53:0/597673796 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5600cc110 con 0x7fd560069450 2023-06-10T18:52:45.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.092+0000 7fd564af1640 1 --2- 172.21.15.53:0/597673796 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd560069450 0x7fd5600698d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd5600cc0c0 tx=0x7fd55801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4803548b853b234a server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:45.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.092+0000 7fd55f7fe640 1 -- 172.21.15.53:0/597673796 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5580a5790 con 0x7fd560069450 2023-06-10T18:52:45.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.092+0000 7fd55f7fe640 1 -- 172.21.15.53:0/597673796 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5580a58f0 con 0x7fd560069450 2023-06-10T18:52:45.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.092+0000 7fd55f7fe640 1 -- 172.21.15.53:0/597673796 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5580a5c80 con 0x7fd560069450 2023-06-10T18:52:45.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.092+0000 7fd566554640 1 -- 172.21.15.53:0/597673796 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd560069450 msgr2=0x7fd5600698d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:45.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.092+0000 7fd566554640 1 --2- 172.21.15.53:0/597673796 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd560069450 0x7fd5600698d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd5600cc0c0 tx=0x7fd55801c910 comp rx=0 tx=0).stop 2023-06-10T18:52:45.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.092+0000 7fd566554640 1 -- 172.21.15.53:0/597673796 shutdown_connections 2023-06-10T18:52:45.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.092+0000 7fd566554640 1 --2- 172.21.15.53:0/597673796 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd560069450 0x7fd5600698d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:45.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.092+0000 7fd566554640 1 --2- 172.21.15.53:0/597673796 >> v2:172.21.15.117:3300/0 conn(0x7fd5600affc0 0x7fd5600b03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:45.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.092+0000 7fd566554640 1 --2- 172.21.15.53:0/597673796 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd56015b870 0x7fd56006a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:45.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.092+0000 7fd566554640 1 -- 172.21.15.53:0/597673796 >> 172.21.15.53:0/597673796 conn(0x7fd5600cafc0 msgr2=0x7fd5600cb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:45.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.092+0000 7fd566554640 1 -- 172.21.15.53:0/597673796 shutdown_connections 2023-06-10T18:52:45.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.092+0000 7fd566554640 1 -- 172.21.15.53:0/597673796 wait complete. 2023-06-10T18:52:45.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.092+0000 7fd566554640 1 Processor -- start 2023-06-10T18:52:45.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.092+0000 7fd566554640 1 -- start start 2023-06-10T18:52:45.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.092+0000 7fd566554640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd560069450 0x7fd56015e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:45.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.092+0000 7fd566554640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5600affc0 0x7fd5600c4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:45.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.092+0000 7fd566554640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd56015b870 0x7fd5600b3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:45.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.092+0000 7fd566554640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd560152ad0 con 0x7fd5600affc0 2023-06-10T18:52:45.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.092+0000 7fd566554640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5600c50e0 con 0x7fd560069450 2023-06-10T18:52:45.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.092+0000 7fd566554640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5600c4840 con 0x7fd56015b870 2023-06-10T18:52:45.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.092+0000 7fd557fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5600affc0 0x7fd5600c4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:45.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.092+0000 7fd557fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5600affc0 0x7fd5600c4180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56130/0 (socket says 172.21.15.53:56130) 2023-06-10T18:52:45.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.092+0000 7fd557fff640 1 -- 172.21.15.53:0/797230487 learned_addr learned my addr 172.21.15.53:0/797230487 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:45.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.092+0000 7fd55ffff640 1 --2- 172.21.15.53:0/797230487 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd560069450 0x7fd56015e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:45.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.092+0000 7fd564af1640 1 --2- 172.21.15.53:0/797230487 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd56015b870 0x7fd5600b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:45.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.092+0000 7fd557fff640 1 -- 172.21.15.53:0/797230487 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd56015b870 msgr2=0x7fd5600b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:45.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.092+0000 7fd557fff640 1 --2- 172.21.15.53:0/797230487 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd56015b870 0x7fd5600b3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:45.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.092+0000 7fd557fff640 1 -- 172.21.15.53:0/797230487 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd560069450 msgr2=0x7fd56015e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:45.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.092+0000 7fd557fff640 1 --2- 172.21.15.53:0/797230487 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd560069450 0x7fd56015e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:45.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.092+0000 7fd557fff640 1 -- 172.21.15.53:0/797230487 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd558009b30 con 0x7fd5600affc0 2023-06-10T18:52:45.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.096+0000 7fd557fff640 1 --2- 172.21.15.53:0/797230487 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5600affc0 0x7fd5600c4180 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd54800d5f0 tx=0x7fd54800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:45.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.096+0000 7fd55d7fa640 1 -- 172.21.15.53:0/797230487 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5480125f0 con 0x7fd5600affc0 2023-06-10T18:52:45.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.096+0000 7fd55d7fa640 1 -- 172.21.15.53:0/797230487 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd548012750 con 0x7fd5600affc0 2023-06-10T18:52:45.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.096+0000 7fd566554640 1 -- 172.21.15.53:0/797230487 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5600c4b20 con 0x7fd5600affc0 2023-06-10T18:52:45.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.096+0000 7fd55d7fa640 1 -- 172.21.15.53:0/797230487 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd548012ae0 con 0x7fd5600affc0 2023-06-10T18:52:45.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.096+0000 7fd566554640 1 -- 172.21.15.53:0/797230487 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd56015bd70 con 0x7fd5600affc0 2023-06-10T18:52:45.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.096+0000 7fd566554640 1 -- 172.21.15.53:0/797230487 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd56004d790 con 0x7fd5600affc0 2023-06-10T18:52:45.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.096+0000 7fd55d7fa640 1 -- 172.21.15.53:0/797230487 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd548012c40 con 0x7fd5600affc0 2023-06-10T18:52:45.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.096+0000 7fd55d7fa640 1 --2- 172.21.15.53:0/797230487 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd540066280 0x7fd540068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:45.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.096+0000 7fd55d7fa640 1 -- 172.21.15.53:0/797230487 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd548084120 con 0x7fd5600affc0 2023-06-10T18:52:45.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.096+0000 7fd55ffff640 1 --2- 172.21.15.53:0/797230487 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd540066280 0x7fd540068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:45.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.096+0000 7fd55ffff640 1 --2- 172.21.15.53:0/797230487 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd540066280 0x7fd540068730 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd560066610 tx=0x7fd550008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:45.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.100+0000 7fd55d7fa640 1 -- 172.21.15.53:0/797230487 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd548051630 con 0x7fd5600affc0 2023-06-10T18:52:45.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.252+0000 7fd566554640 1 -- 172.21.15.53:0/797230487 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd5600b0ad0 con 0x7fd5600affc0 2023-06-10T18:52:45.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.256+0000 7fd55d7fa640 1 -- 172.21.15.53:0/797230487 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+18280 (secure 0 0 0) 0x7fd548054c50 con 0x7fd5600affc0 2023-06-10T18:52:45.266 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:52:45.266 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":22,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T18:52:44.917970+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-10T18:52:43.396243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-10T18:52:43.894228+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T18:52:45.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.256+0000 7fd566554640 1 -- 172.21.15.53:0/797230487 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd540066280 msgr2=0x7fd540068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:45.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.256+0000 7fd566554640 1 --2- 172.21.15.53:0/797230487 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd540066280 0x7fd540068730 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd560066610 tx=0x7fd550008040 comp rx=0 tx=0).stop 2023-06-10T18:52:45.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.256+0000 7fd566554640 1 -- 172.21.15.53:0/797230487 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5600affc0 msgr2=0x7fd5600c4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:45.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.256+0000 7fd566554640 1 --2- 172.21.15.53:0/797230487 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5600affc0 0x7fd5600c4180 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd54800d5f0 tx=0x7fd54800dab0 comp rx=0 tx=0).stop 2023-06-10T18:52:45.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.256+0000 7fd566554640 1 -- 172.21.15.53:0/797230487 shutdown_connections 2023-06-10T18:52:45.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.256+0000 7fd566554640 1 --2- 172.21.15.53:0/797230487 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd540066280 0x7fd540068730 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:45.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.256+0000 7fd566554640 1 --2- 172.21.15.53:0/797230487 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd56015b870 0x7fd5600b3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:45.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.256+0000 7fd566554640 1 --2- 172.21.15.53:0/797230487 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5600affc0 0x7fd5600c4180 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:45.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.256+0000 7fd566554640 1 --2- 172.21.15.53:0/797230487 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd560069450 0x7fd56015e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:45.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.256+0000 7fd566554640 1 -- 172.21.15.53:0/797230487 >> 172.21.15.53:0/797230487 conn(0x7fd5600cafc0 msgr2=0x7fd5600af870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:45.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.260+0000 7fd566554640 1 -- 172.21.15.53:0/797230487 shutdown_connections 2023-06-10T18:52:45.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.260+0000 7fd566554640 1 -- 172.21.15.53:0/797230487 wait complete. 2023-06-10T18:52:45.286 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T18:52:45.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.396+0000 7f86456f1640 1 Processor -- start 2023-06-10T18:52:45.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.396+0000 7f86456f1640 1 -- start start 2023-06-10T18:52:45.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.400+0000 7f86456f1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8640070f40 0x7f864006bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:45.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.400+0000 7f86456f1640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8640070080 con 0x7f864006c4c0 2023-06-10T18:52:45.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.400+0000 7f86456f1640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86400705c0 con 0x7f864015c0b0 2023-06-10T18:52:45.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.400+0000 7f86456f1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86400cc460 con 0x7f8640070f40 2023-06-10T18:52:45.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.400+0000 7f863f7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f864006c4c0 0x7f864015c480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52828/0 (socket says 172.21.15.53:52828) 2023-06-10T18:52:45.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.400+0000 7f863f7fe640 1 -- 172.21.15.53:0/3341648935 learned_addr learned my addr 172.21.15.53:0/3341648935 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:52:45.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.400+0000 7f863e7fc640 1 --2- 172.21.15.53:0/3341648935 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8640070f40 0x7f864006bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:45.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.400+0000 7f863dffb640 1 -- 172.21.15.53:0/3341648935 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 842539522 0 0) 0x7f8640070080 con 0x7f864006c4c0 2023-06-10T18:52:45.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.400+0000 7f863dffb640 1 -- 172.21.15.53:0/3341648935 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f862c003530 con 0x7f864006c4c0 2023-06-10T18:52:45.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.400+0000 7f863dffb640 1 -- 172.21.15.53:0/3341648935 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3028170705 0 0) 0x7f86400705c0 con 0x7f864015c0b0 2023-06-10T18:52:45.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.400+0000 7f863dffb640 1 -- 172.21.15.53:0/3341648935 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8640070080 con 0x7f864015c0b0 2023-06-10T18:52:45.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.400+0000 7f863dffb640 1 -- 172.21.15.53:0/3341648935 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 714713453 0 0) 0x7f862c003530 con 0x7f864006c4c0 2023-06-10T18:52:45.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.400+0000 7f863e7fc640 1 -- 172.21.15.53:0/3341648935 >> v1:172.21.15.117:6789/0 conn(0x7f864015c0b0 legacy=0x7f86400cbd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:45.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.400+0000 7f863e7fc640 1 -- 172.21.15.53:0/3341648935 >> v1:172.21.15.53:6789/0 conn(0x7f864006c4c0 legacy=0x7f864015c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:45.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.400+0000 7f863e7fc640 1 -- 172.21.15.53:0/3341648935 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86400c8e30 con 0x7f8640070f40 2023-06-10T18:52:45.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.400+0000 7f863e7fc640 1 --2- 172.21.15.53:0/3341648935 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8640070f40 0x7f864006bf80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f86280097f0 tx=0x7f862801c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3440359ff62baad server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:45.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.400+0000 7f863dffb640 1 -- 172.21.15.53:0/3341648935 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8638001600 con 0x7f8640070f40 2023-06-10T18:52:45.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.400+0000 7f863dffb640 1 -- 172.21.15.53:0/3341648935 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86280a7050 con 0x7f8640070f40 2023-06-10T18:52:45.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.400+0000 7f863dffb640 1 -- 172.21.15.53:0/3341648935 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86280ab620 con 0x7f8640070f40 2023-06-10T18:52:45.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.404+0000 7f86456f1640 1 -- 172.21.15.53:0/3341648935 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8640070f40 msgr2=0x7f864006bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:45.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.404+0000 7f86456f1640 1 --2- 172.21.15.53:0/3341648935 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8640070f40 0x7f864006bf80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f86280097f0 tx=0x7f862801c3e0 comp rx=0 tx=0).stop 2023-06-10T18:52:45.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.404+0000 7f86456f1640 1 -- 172.21.15.53:0/3341648935 shutdown_connections 2023-06-10T18:52:45.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.404+0000 7f86456f1640 1 --2- 172.21.15.53:0/3341648935 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8640070f40 0x7f864006bf80 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:45.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.404+0000 7f86456f1640 1 -- 172.21.15.53:0/3341648935 >> 172.21.15.53:0/3341648935 conn(0x7f864006a0d0 msgr2=0x7f86400ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:45.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.404+0000 7f86456f1640 1 -- 172.21.15.53:0/3341648935 shutdown_connections 2023-06-10T18:52:45.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.404+0000 7f86456f1640 1 -- 172.21.15.53:0/3341648935 wait complete. 2023-06-10T18:52:45.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.404+0000 7f86456f1640 1 Processor -- start 2023-06-10T18:52:45.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.404+0000 7f86456f1640 1 -- start start 2023-06-10T18:52:45.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.404+0000 7f86456f1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f864006c4c0 0x7f864014d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:45.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.404+0000 7f86456f1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8640070f40 0x7f86400c17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:45.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.404+0000 7f86456f1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f864015c0b0 0x7f86400ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:45.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.404+0000 7f86456f1640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86400c2020 con 0x7f864015c0b0 2023-06-10T18:52:45.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.404+0000 7f86456f1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86400c2300 con 0x7f8640070f40 2023-06-10T18:52:45.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.404+0000 7f86456f1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86400c25e0 con 0x7f864006c4c0 2023-06-10T18:52:45.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.404+0000 7f863f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f864015c0b0 0x7f86400ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:45.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.404+0000 7f863f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f864015c0b0 0x7f86400ccbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56146/0 (socket says 172.21.15.53:56146) 2023-06-10T18:52:45.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.404+0000 7f863f7fe640 1 -- 172.21.15.53:0/3612398217 learned_addr learned my addr 172.21.15.53:0/3612398217 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:45.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.404+0000 7f863effd640 1 --2- 172.21.15.53:0/3612398217 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f864006c4c0 0x7f864014d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:45.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.404+0000 7f863e7fc640 1 --2- 172.21.15.53:0/3612398217 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8640070f40 0x7f86400c17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:45.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.404+0000 7f863f7fe640 1 -- 172.21.15.53:0/3612398217 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f864006c4c0 msgr2=0x7f864014d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:45.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.404+0000 7f863f7fe640 1 --2- 172.21.15.53:0/3612398217 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f864006c4c0 0x7f864014d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:45.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.404+0000 7f863f7fe640 1 -- 172.21.15.53:0/3612398217 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8640070f40 msgr2=0x7f86400c17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:45.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.404+0000 7f863f7fe640 1 --2- 172.21.15.53:0/3612398217 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8640070f40 0x7f86400c17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:45.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.404+0000 7f863f7fe640 1 -- 172.21.15.53:0/3612398217 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8628009420 con 0x7f864015c0b0 2023-06-10T18:52:45.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.404+0000 7f863effd640 1 --2- 172.21.15.53:0/3612398217 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f864006c4c0 0x7f864014d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:52:45.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.404+0000 7f863e7fc640 1 --2- 172.21.15.53:0/3612398217 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8640070f40 0x7f86400c17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:52:45.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.408+0000 7f863f7fe640 1 --2- 172.21.15.53:0/3612398217 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f864015c0b0 0x7f86400ccbc0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8638001ec0 tx=0x7f863800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:45.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.408+0000 7f86377fe640 1 -- 172.21.15.53:0/3612398217 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8638005cf0 con 0x7f864015c0b0 2023-06-10T18:52:45.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.408+0000 7f86377fe640 1 -- 172.21.15.53:0/3612398217 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8638005e70 con 0x7f864015c0b0 2023-06-10T18:52:45.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.408+0000 7f86456f1640 1 -- 172.21.15.53:0/3612398217 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86400c28c0 con 0x7f864015c0b0 2023-06-10T18:52:45.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.408+0000 7f86377fe640 1 -- 172.21.15.53:0/3612398217 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8638007290 con 0x7f864015c0b0 2023-06-10T18:52:45.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.408+0000 7f86456f1640 1 -- 172.21.15.53:0/3612398217 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86400b1020 con 0x7f864015c0b0 2023-06-10T18:52:45.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.408+0000 7f86377fe640 1 -- 172.21.15.53:0/3612398217 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f86380073f0 con 0x7f864015c0b0 2023-06-10T18:52:45.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.408+0000 7f86456f1640 1 -- 172.21.15.53:0/3612398217 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f864004d790 con 0x7f864015c0b0 2023-06-10T18:52:45.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.408+0000 7f86377fe640 1 --2- 172.21.15.53:0/3612398217 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8620066280 0x7f8620068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:45.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.408+0000 7f86377fe640 1 -- 172.21.15.53:0/3612398217 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8638083930 con 0x7f864015c0b0 2023-06-10T18:52:45.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.408+0000 7f863effd640 1 --2- 172.21.15.53:0/3612398217 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8620066280 0x7f8620068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:45.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.408+0000 7f863effd640 1 --2- 172.21.15.53:0/3612398217 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8620066280 0x7f8620068730 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8630007fd0 tx=0x7f8630009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:45.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.416+0000 7f86377fe640 1 -- 172.21.15.53:0/3612398217 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8638050db0 con 0x7f864015c0b0 2023-06-10T18:52:45.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.568+0000 7f86456f1640 1 -- 172.21.15.53:0/3612398217 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f86400b3c20 con 0x7f864015c0b0 2023-06-10T18:52:45.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.576+0000 7f86377fe640 1 -- 172.21.15.53:0/3612398217 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+18280 (secure 0 0 0) 0x7f86380543d0 con 0x7f864015c0b0 2023-06-10T18:52:45.585 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:52:45.585 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":22,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T18:52:44.917970+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-10T18:52:43.396243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-10T18:52:43.894228+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T18:52:45.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.576+0000 7f86456f1640 1 -- 172.21.15.53:0/3612398217 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8620066280 msgr2=0x7f8620068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:45.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.576+0000 7f86456f1640 1 --2- 172.21.15.53:0/3612398217 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8620066280 0x7f8620068730 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8630007fd0 tx=0x7f8630009040 comp rx=0 tx=0).stop 2023-06-10T18:52:45.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.576+0000 7f86456f1640 1 -- 172.21.15.53:0/3612398217 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f864015c0b0 msgr2=0x7f86400ccbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:45.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.576+0000 7f86456f1640 1 --2- 172.21.15.53:0/3612398217 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f864015c0b0 0x7f86400ccbc0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8638001ec0 tx=0x7f863800c9b0 comp rx=0 tx=0).stop 2023-06-10T18:52:45.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.576+0000 7f86456f1640 1 -- 172.21.15.53:0/3612398217 shutdown_connections 2023-06-10T18:52:45.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.576+0000 7f86456f1640 1 --2- 172.21.15.53:0/3612398217 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8620066280 0x7f8620068730 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:45.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.576+0000 7f86456f1640 1 --2- 172.21.15.53:0/3612398217 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f864015c0b0 0x7f86400ccbc0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:45.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.576+0000 7f86456f1640 1 --2- 172.21.15.53:0/3612398217 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8640070f40 0x7f86400c17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:45.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.576+0000 7f86456f1640 1 --2- 172.21.15.53:0/3612398217 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f864006c4c0 0x7f864014d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:45.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.576+0000 7f86456f1640 1 -- 172.21.15.53:0/3612398217 >> 172.21.15.53:0/3612398217 conn(0x7f864006a0d0 msgr2=0x7f86400cbd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:45.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.576+0000 7f86456f1640 1 -- 172.21.15.53:0/3612398217 shutdown_connections 2023-06-10T18:52:45.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.576+0000 7f86456f1640 1 -- 172.21.15.53:0/3612398217 wait complete. 2023-06-10T18:52:45.604 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-06-10T18:52:45.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.716+0000 7f09303a4640 1 Processor -- start 2023-06-10T18:52:45.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.716+0000 7f09303a4640 1 -- start start 2023-06-10T18:52:45.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.716+0000 7f09303a4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0928159690 0x7f0928070950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:45.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.716+0000 7f09303a4640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f09280b0f30 0x7f09280cbe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:45.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.716+0000 7f09303a4640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09280cb080 con 0x7f0928159a60 2023-06-10T18:52:45.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.716+0000 7f09303a4640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0928070e90 con 0x7f09280b0f30 2023-06-10T18:52:45.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.716+0000 7f09303a4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f092806d450 con 0x7f0928159690 2023-06-10T18:52:45.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.716+0000 7f092e140640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0928159690 0x7f0928070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:45.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.716+0000 7f092e140640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0928159690 0x7f0928070950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.53:39238/0 (socket says 172.21.15.53:39238) 2023-06-10T18:52:45.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.716+0000 7f092e140640 1 -- 172.21.15.53:0/1436189088 learned_addr learned my addr 172.21.15.53:0/1436189088 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:45.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.716+0000 7f092d93f640 1 --2- 172.21.15.53:0/1436189088 >> v2:172.21.15.117:3300/0 conn(0x7f09280b0f30 0x7f09280cbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:45.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.716+0000 7f092e140640 1 -- 172.21.15.53:0/1436189088 >> v2:172.21.15.117:3300/0 conn(0x7f09280b0f30 msgr2=0x7f09280cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:45.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.716+0000 7f092e140640 1 --2- 172.21.15.53:0/1436189088 >> v2:172.21.15.117:3300/0 conn(0x7f09280b0f30 0x7f09280cbe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:45.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.716+0000 7f092e140640 1 -- 172.21.15.53:0/1436189088 >> v1:172.21.15.117:6789/0 conn(0x7f0928159a60 legacy=0x7f09280c2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:45.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.716+0000 7f092e140640 1 -- 172.21.15.53:0/1436189088 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09280cb320 con 0x7f0928159690 2023-06-10T18:52:45.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.716+0000 7f092d93f640 1 --2- 172.21.15.53:0/1436189088 >> v2:172.21.15.117:3300/0 conn(0x7f09280b0f30 0x7f09280cbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-10T18:52:45.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.720+0000 7f092e140640 1 --2- 172.21.15.53:0/1436189088 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0928159690 0x7f0928070950 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0920009e50 tx=0x7f092001c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50de3524956e6399 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:45.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.720+0000 7f092d13e640 1 -- 172.21.15.53:0/1436189088 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09200a57c0 con 0x7f0928159690 2023-06-10T18:52:45.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.720+0000 7f092d13e640 1 -- 172.21.15.53:0/1436189088 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09200a5920 con 0x7f0928159690 2023-06-10T18:52:45.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.720+0000 7f092d13e640 1 -- 172.21.15.53:0/1436189088 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09200a5cb0 con 0x7f0928159690 2023-06-10T18:52:45.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.720+0000 7f09303a4640 1 -- 172.21.15.53:0/1436189088 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0928159690 msgr2=0x7f0928070950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:45.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.720+0000 7f09303a4640 1 --2- 172.21.15.53:0/1436189088 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0928159690 0x7f0928070950 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0920009e50 tx=0x7f092001c9e0 comp rx=0 tx=0).stop 2023-06-10T18:52:45.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.720+0000 7f09303a4640 1 -- 172.21.15.53:0/1436189088 shutdown_connections 2023-06-10T18:52:45.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.720+0000 7f09303a4640 1 --2- 172.21.15.53:0/1436189088 >> v2:172.21.15.117:3300/0 conn(0x7f09280b0f30 0x7f09280cbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:45.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.720+0000 7f09303a4640 1 --2- 172.21.15.53:0/1436189088 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0928159690 0x7f0928070950 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:45.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.720+0000 7f09303a4640 1 -- 172.21.15.53:0/1436189088 >> 172.21.15.53:0/1436189088 conn(0x7f092806a560 msgr2=0x7f092806a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:45.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.720+0000 7f09303a4640 1 -- 172.21.15.53:0/1436189088 shutdown_connections 2023-06-10T18:52:45.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.720+0000 7f09303a4640 1 -- 172.21.15.53:0/1436189088 wait complete. 2023-06-10T18:52:45.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.720+0000 7f09303a4640 1 Processor -- start 2023-06-10T18:52:45.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.720+0000 7f09303a4640 1 -- start start 2023-06-10T18:52:45.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.724+0000 7f09303a4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09280b0f30 0x7f0928155890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:45.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.724+0000 7f09303a4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0928159690 0x7f09281462b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:45.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.724+0000 7f09303a4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0928159a60 0x7f09280c3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:45.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.724+0000 7f09303a4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09281467f0 con 0x7f0928159690 2023-06-10T18:52:45.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.724+0000 7f09303a4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09280cd6b0 con 0x7f09280b0f30 2023-06-10T18:52:45.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.724+0000 7f09303a4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09280c3bc0 con 0x7f0928159a60 2023-06-10T18:52:45.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.724+0000 7f092d93f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0928159690 0x7f09281462b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:45.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.724+0000 7f092d93f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0928159690 0x7f09281462b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56162/0 (socket says 172.21.15.53:56162) 2023-06-10T18:52:45.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.724+0000 7f092d93f640 1 -- 172.21.15.53:0/605576804 learned_addr learned my addr 172.21.15.53:0/605576804 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:45.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.724+0000 7f092e941640 1 --2- 172.21.15.53:0/605576804 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0928159a60 0x7f09280c3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:45.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.724+0000 7f092e140640 1 --2- 172.21.15.53:0/605576804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09280b0f30 0x7f0928155890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:45.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.724+0000 7f092d93f640 1 -- 172.21.15.53:0/605576804 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0928159a60 msgr2=0x7f09280c3370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:45.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.724+0000 7f092d93f640 1 --2- 172.21.15.53:0/605576804 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0928159a60 0x7f09280c3370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:45.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.724+0000 7f092d93f640 1 -- 172.21.15.53:0/605576804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09280b0f30 msgr2=0x7f0928155890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:45.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.724+0000 7f092d93f640 1 --2- 172.21.15.53:0/605576804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09280b0f30 0x7f0928155890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:45.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.724+0000 7f092d93f640 1 -- 172.21.15.53:0/605576804 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0918009420 con 0x7f0928159690 2023-06-10T18:52:45.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.724+0000 7f092e140640 1 --2- 172.21.15.53:0/605576804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09280b0f30 0x7f0928155890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:52:45.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.724+0000 7f092e941640 1 --2- 172.21.15.53:0/605576804 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0928159a60 0x7f09280c3370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:52:45.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.724+0000 7f092d93f640 1 --2- 172.21.15.53:0/605576804 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0928159690 0x7f09281462b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f091800e980 tx=0x7f091800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:45.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.724+0000 7f091effd640 1 -- 172.21.15.53:0/605576804 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091800ca00 con 0x7f0928159690 2023-06-10T18:52:45.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.724+0000 7f091effd640 1 -- 172.21.15.53:0/605576804 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f091800cb60 con 0x7f0928159690 2023-06-10T18:52:45.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.724+0000 7f09303a4640 1 -- 172.21.15.53:0/605576804 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0920009b30 con 0x7f0928159690 2023-06-10T18:52:45.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.724+0000 7f091effd640 1 -- 172.21.15.53:0/605576804 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0918013470 con 0x7f0928159690 2023-06-10T18:52:45.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.724+0000 7f09303a4640 1 -- 172.21.15.53:0/605576804 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09280c4180 con 0x7f0928159690 2023-06-10T18:52:45.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.724+0000 7f09303a4640 1 -- 172.21.15.53:0/605576804 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f092804d790 con 0x7f0928159690 2023-06-10T18:52:45.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.724+0000 7f091effd640 1 -- 172.21.15.53:0/605576804 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f09180135d0 con 0x7f0928159690 2023-06-10T18:52:45.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.724+0000 7f091effd640 1 --2- 172.21.15.53:0/605576804 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f090c0662b0 0x7f090c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:45.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.724+0000 7f091effd640 1 -- 172.21.15.53:0/605576804 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0918083ea0 con 0x7f0928159690 2023-06-10T18:52:45.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.724+0000 7f092e140640 1 --2- 172.21.15.53:0/605576804 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f090c0662b0 0x7f090c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:45.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.728+0000 7f092e140640 1 --2- 172.21.15.53:0/605576804 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f090c0662b0 0x7f090c068760 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f09200ae000 tx=0x7f09200a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:45.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.728+0000 7f091effd640 1 -- 172.21.15.53:0/605576804 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f09180513b0 con 0x7f0928159690 2023-06-10T18:52:45.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:45.920+0000 7f09303a4640 1 -- 172.21.15.53:0/605576804 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f09281573e0 con 0x7f0928159690 2023-06-10T18:52:46.667 INFO:tasks.ceph.mds.d.smithi117.stderr:2023-06-10T18:52:46.658+0000 7f9dfaea6640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-06-10T18:52:46.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:46.924+0000 7f091effd640 1 -- 172.21.15.53:0/605576804 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) v1 ==== 118+0+0 (secure 0 0 0) 0x7f09180549d0 con 0x7f0928159690 2023-06-10T18:52:46.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:46.928+0000 7f09303a4640 1 -- 172.21.15.53:0/605576804 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f090c0662b0 msgr2=0x7f090c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:46.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:46.928+0000 7f09303a4640 1 --2- 172.21.15.53:0/605576804 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f090c0662b0 0x7f090c068760 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f09200ae000 tx=0x7f09200a7070 comp rx=0 tx=0).stop 2023-06-10T18:52:46.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:46.932+0000 7f09303a4640 1 -- 172.21.15.53:0/605576804 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0928159690 msgr2=0x7f09281462b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:46.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:46.932+0000 7f09303a4640 1 --2- 172.21.15.53:0/605576804 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0928159690 0x7f09281462b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f091800e980 tx=0x7f091800ee40 comp rx=0 tx=0).stop 2023-06-10T18:52:46.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:46.932+0000 7f09303a4640 1 -- 172.21.15.53:0/605576804 shutdown_connections 2023-06-10T18:52:46.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:46.932+0000 7f09303a4640 1 --2- 172.21.15.53:0/605576804 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f090c0662b0 0x7f090c068760 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:46.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:46.932+0000 7f09303a4640 1 --2- 172.21.15.53:0/605576804 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0928159a60 0x7f09280c3370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:46.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:46.932+0000 7f09303a4640 1 --2- 172.21.15.53:0/605576804 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0928159690 0x7f09281462b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:46.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:46.932+0000 7f09303a4640 1 --2- 172.21.15.53:0/605576804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09280b0f30 0x7f0928155890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:46.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:46.932+0000 7f09303a4640 1 -- 172.21.15.53:0/605576804 >> 172.21.15.53:0/605576804 conn(0x7f092806a560 msgr2=0x7f09280c28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:46.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:46.932+0000 7f09303a4640 1 -- 172.21.15.53:0/605576804 shutdown_connections 2023-06-10T18:52:46.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:46.932+0000 7f09303a4640 1 -- 172.21.15.53:0/605576804 wait complete. 2023-06-10T18:52:46.964 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-06-10T18:52:46.965 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-06-10T18:52:47.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:47.092+0000 7fdc30968640 1 Processor -- start 2023-06-10T18:52:47.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:47.092+0000 7fdc30968640 1 -- start start 2023-06-10T18:52:47.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:47.092+0000 7fdc30968640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fdc2c15eef0 0x7fdc2c070f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:47.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:47.092+0000 7fdc30968640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc2c069450 0x7fdc2c069850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:47.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:47.092+0000 7fdc30968640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc2c069d90 con 0x7fdc2c15f570 2023-06-10T18:52:47.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:47.092+0000 7fdc30968640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc2c15f2c0 con 0x7fdc2c15eef0 2023-06-10T18:52:47.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:47.092+0000 7fdc30968640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc2c15fdc0 con 0x7fdc2c069450 2023-06-10T18:52:47.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:47.092+0000 7fdc2a59c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fdc2c15eef0 0x7fdc2c070f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:47.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:47.092+0000 7fdc21d9b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fdc2c15f570 0x7fdc2c0ce450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52842/0 (socket says 172.21.15.53:52842) 2023-06-10T18:52:47.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:47.092+0000 7fdc21d9b640 1 -- 172.21.15.53:0/1393077844 learned_addr learned my addr 172.21.15.53:0/1393077844 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:52:47.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:47.092+0000 7fdc2ad9d640 1 --2- 172.21.15.53:0/1393077844 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc2c069450 0x7fdc2c069850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:47.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:47.092+0000 7fdc2a59c640 1 -- 172.21.15.53:0/1393077844 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc2c069450 msgr2=0x7fdc2c069850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:47.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:47.092+0000 7fdc2a59c640 1 --2- 172.21.15.53:0/1393077844 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc2c069450 0x7fdc2c069850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:47.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:47.092+0000 7fdc2a59c640 1 -- 172.21.15.53:0/1393077844 >> v1:172.21.15.53:6789/0 conn(0x7fdc2c15f570 legacy=0x7fdc2c0ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:47.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:47.092+0000 7fdc29d9b640 1 -- 172.21.15.53:0/1393077844 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3164982362 0 0) 0x7fdc2c069d90 con 0x7fdc2c15f570 2023-06-10T18:52:47.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:47.092+0000 7fdc2a59c640 1 -- 172.21.15.53:0/1393077844 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc2c1600a0 con 0x7fdc2c15eef0 2023-06-10T18:52:47.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:47.096+0000 7fdc2a59c640 1 --2- 172.21.15.53:0/1393077844 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc2c15eef0 0x7fdc2c070f80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c0097c0 tx=0x7fdc1c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78c92ec75d19604f server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:47.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:47.096+0000 7fdc29d9b640 1 -- 172.21.15.53:0/1393077844 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc1c0ab600 con 0x7fdc2c15eef0 2023-06-10T18:52:47.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:47.096+0000 7fdc29d9b640 1 -- 172.21.15.53:0/1393077844 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc1c0a7050 con 0x7fdc2c15eef0 2023-06-10T18:52:47.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:47.096+0000 7fdc29d9b640 1 -- 172.21.15.53:0/1393077844 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc1c0ab980 con 0x7fdc2c15eef0 2023-06-10T18:52:47.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:47.096+0000 7fdc30968640 1 -- 172.21.15.53:0/1393077844 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc2c15eef0 msgr2=0x7fdc2c070f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:47.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:47.096+0000 7fdc30968640 1 --2- 172.21.15.53:0/1393077844 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc2c15eef0 0x7fdc2c070f80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c0097c0 tx=0x7fdc1c01c480 comp rx=0 tx=0).stop 2023-06-10T18:52:47.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:47.096+0000 7fdc30968640 1 -- 172.21.15.53:0/1393077844 shutdown_connections 2023-06-10T18:52:47.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:47.096+0000 7fdc30968640 1 --2- 172.21.15.53:0/1393077844 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc2c069450 0x7fdc2c069850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:47.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:47.096+0000 7fdc30968640 1 --2- 172.21.15.53:0/1393077844 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc2c15eef0 0x7fdc2c070f80 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:47.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:47.096+0000 7fdc30968640 1 -- 172.21.15.53:0/1393077844 >> 172.21.15.53:0/1393077844 conn(0x7fdc2c06a560 msgr2=0x7fdc2c06a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:47.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:47.096+0000 7fdc30968640 1 -- 172.21.15.53:0/1393077844 shutdown_connections 2023-06-10T18:52:47.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:47.096+0000 7fdc30968640 1 -- 172.21.15.53:0/1393077844 wait complete. 2023-06-10T18:52:47.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:47.096+0000 7fdc30968640 1 Processor -- start 2023-06-10T18:52:47.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:47.096+0000 7fdc30968640 1 -- start start 2023-06-10T18:52:47.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:47.096+0000 7fdc30968640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdc2c069450 0x7fdc2c151700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:47.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:47.096+0000 7fdc30968640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc2c15eef0 0x7fdc2c153b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:47.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:47.096+0000 7fdc30968640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc2c15f570 0x7fdc2c14d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:47.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:47.096+0000 7fdc30968640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc2c151270 con 0x7fdc2c15f570 2023-06-10T18:52:47.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:47.096+0000 7fdc30968640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc2c152c70 con 0x7fdc2c069450 2023-06-10T18:52:47.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:47.096+0000 7fdc30968640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc2c152f50 con 0x7fdc2c15eef0 2023-06-10T18:52:47.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:47.096+0000 7fdc2ad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc2c15f570 0x7fdc2c14d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:47.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:47.096+0000 7fdc2ad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc2c15f570 0x7fdc2c14d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56184/0 (socket says 172.21.15.53:56184) 2023-06-10T18:52:47.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:47.096+0000 7fdc2ad9d640 1 -- 172.21.15.53:0/1293491721 learned_addr learned my addr 172.21.15.53:0/1293491721 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:47.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:47.100+0000 7fdc21d9b640 1 --2- 172.21.15.53:0/1293491721 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc2c15eef0 0x7fdc2c153b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:47.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:47.100+0000 7fdc2a59c640 1 --2- 172.21.15.53:0/1293491721 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdc2c069450 0x7fdc2c151700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:47.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:47.100+0000 7fdc2ad9d640 1 -- 172.21.15.53:0/1293491721 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc2c15eef0 msgr2=0x7fdc2c153b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:47.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:47.100+0000 7fdc2ad9d640 1 --2- 172.21.15.53:0/1293491721 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc2c15eef0 0x7fdc2c153b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:47.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:47.100+0000 7fdc2ad9d640 1 -- 172.21.15.53:0/1293491721 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdc2c069450 msgr2=0x7fdc2c151700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:47.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:47.100+0000 7fdc2ad9d640 1 --2- 172.21.15.53:0/1293491721 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdc2c069450 0x7fdc2c151700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:47.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:47.100+0000 7fdc2ad9d640 1 -- 172.21.15.53:0/1293491721 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc1c009420 con 0x7fdc2c15f570 2023-06-10T18:52:47.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:47.100+0000 7fdc2ad9d640 1 --2- 172.21.15.53:0/1293491721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc2c15f570 0x7fdc2c14d0f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fdc2400cd70 tx=0x7fdc2400a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:47.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:47.100+0000 7fdc237fe640 1 -- 172.21.15.53:0/1293491721 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc24003ba0 con 0x7fdc2c15f570 2023-06-10T18:52:47.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:47.100+0000 7fdc237fe640 1 -- 172.21.15.53:0/1293491721 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc24003d00 con 0x7fdc2c15f570 2023-06-10T18:52:47.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:47.100+0000 7fdc30968640 1 -- 172.21.15.53:0/1293491721 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc2c150c20 con 0x7fdc2c15f570 2023-06-10T18:52:47.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:47.100+0000 7fdc237fe640 1 -- 172.21.15.53:0/1293491721 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc24004240 con 0x7fdc2c15f570 2023-06-10T18:52:47.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:47.100+0000 7fdc30968640 1 -- 172.21.15.53:0/1293491721 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc2c1500f0 con 0x7fdc2c15f570 2023-06-10T18:52:47.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:47.100+0000 7fdc30968640 1 -- 172.21.15.53:0/1293491721 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc2c151420 con 0x7fdc2c15f570 2023-06-10T18:52:47.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:47.100+0000 7fdc237fe640 1 -- 172.21.15.53:0/1293491721 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdc240043a0 con 0x7fdc2c15f570 2023-06-10T18:52:47.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:47.100+0000 7fdc237fe640 1 --2- 172.21.15.53:0/1293491721 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdc0c066280 0x7fdc0c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:47.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:47.100+0000 7fdc237fe640 1 -- 172.21.15.53:0/1293491721 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdc24012070 con 0x7fdc2c15f570 2023-06-10T18:52:47.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:47.100+0000 7fdc2a59c640 1 --2- 172.21.15.53:0/1293491721 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdc0c066280 0x7fdc0c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:47.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:47.100+0000 7fdc2a59c640 1 --2- 172.21.15.53:0/1293491721 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdc0c066280 0x7fdc0c068730 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c0ad000 tx=0x7fdc1c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:47.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:47.104+0000 7fdc237fe640 1 -- 172.21.15.53:0/1293491721 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdc24051b30 con 0x7fdc2c15f570 2023-06-10T18:52:47.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:47.296+0000 7fdc30968640 1 -- 172.21.15.53:0/1293491721 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fdc2c04d790 con 0x7fdc2c15f570 2023-06-10T18:52:47.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:47.928+0000 7fdc237fe640 1 -- 172.21.15.53:0/1293491721 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) v1 ==== 122+0+0 (secure 0 0 0) 0x7fdc24055150 con 0x7fdc2c15f570 2023-06-10T18:52:47.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:47.932+0000 7fdc30968640 1 -- 172.21.15.53:0/1293491721 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdc0c066280 msgr2=0x7fdc0c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:47.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:47.932+0000 7fdc30968640 1 --2- 172.21.15.53:0/1293491721 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdc0c066280 0x7fdc0c068730 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c0ad000 tx=0x7fdc1c008040 comp rx=0 tx=0).stop 2023-06-10T18:52:47.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:47.932+0000 7fdc30968640 1 -- 172.21.15.53:0/1293491721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc2c15f570 msgr2=0x7fdc2c14d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:47.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:47.932+0000 7fdc30968640 1 --2- 172.21.15.53:0/1293491721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc2c15f570 0x7fdc2c14d0f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fdc2400cd70 tx=0x7fdc2400a660 comp rx=0 tx=0).stop 2023-06-10T18:52:47.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:47.932+0000 7fdc30968640 1 -- 172.21.15.53:0/1293491721 shutdown_connections 2023-06-10T18:52:47.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:47.932+0000 7fdc30968640 1 --2- 172.21.15.53:0/1293491721 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdc0c066280 0x7fdc0c068730 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:47.944 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:47.932+0000 7fdc30968640 1 --2- 172.21.15.53:0/1293491721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc2c15f570 0x7fdc2c14d0f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:47.944 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:47.932+0000 7fdc30968640 1 --2- 172.21.15.53:0/1293491721 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc2c15eef0 0x7fdc2c153b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:47.944 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:47.932+0000 7fdc30968640 1 --2- 172.21.15.53:0/1293491721 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdc2c069450 0x7fdc2c151700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:47.944 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:47.932+0000 7fdc30968640 1 -- 172.21.15.53:0/1293491721 >> 172.21.15.53:0/1293491721 conn(0x7fdc2c06a560 msgr2=0x7fdc2c0c6070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:47.944 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:47.932+0000 7fdc30968640 1 -- 172.21.15.53:0/1293491721 shutdown_connections 2023-06-10T18:52:47.944 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:47.932+0000 7fdc30968640 1 -- 172.21.15.53:0/1293491721 wait complete. 2023-06-10T18:52:47.963 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-06-10T18:52:47.963 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T18:52:48.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.080+0000 7fc44e2cf640 1 Processor -- start 2023-06-10T18:52:48.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.080+0000 7fc44e2cf640 1 -- start start 2023-06-10T18:52:48.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.084+0000 7fc44e2cf640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc448159630 0x7fc44815d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:48.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.084+0000 7fc44e2cf640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4480ad730 0x7fc4480713a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:48.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.084+0000 7fc44e2cf640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc4480718e0 0x7fc448069450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:48.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.084+0000 7fc44e2cf640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc448070f10 con 0x7fc448159630 2023-06-10T18:52:48.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.084+0000 7fc44e2cf640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc44815db60 con 0x7fc4480718e0 2023-06-10T18:52:48.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.084+0000 7fc44e2cf640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc44815de40 con 0x7fc4480ad730 2023-06-10T18:52:48.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.084+0000 7fc447fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc448159630 0x7fc44815d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:48.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.084+0000 7fc447fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc448159630 0x7fc44815d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56192/0 (socket says 172.21.15.53:56192) 2023-06-10T18:52:48.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.084+0000 7fc447fff640 1 -- 172.21.15.53:0/2614036371 learned_addr learned my addr 172.21.15.53:0/2614036371 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:48.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.084+0000 7fc43f7fe640 1 --2- 172.21.15.53:0/2614036371 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4480ad730 0x7fc4480713a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:48.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.084+0000 7fc44c86c640 1 --2- 172.21.15.53:0/2614036371 >> v2:172.21.15.117:3300/0 conn(0x7fc4480718e0 0x7fc448069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:48.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.084+0000 7fc447fff640 1 -- 172.21.15.53:0/2614036371 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4480ad730 msgr2=0x7fc4480713a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:48.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.084+0000 7fc447fff640 1 --2- 172.21.15.53:0/2614036371 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4480ad730 0x7fc4480713a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:48.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.084+0000 7fc447fff640 1 -- 172.21.15.53:0/2614036371 >> v2:172.21.15.117:3300/0 conn(0x7fc4480718e0 msgr2=0x7fc448069450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:48.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.084+0000 7fc447fff640 1 --2- 172.21.15.53:0/2614036371 >> v2:172.21.15.117:3300/0 conn(0x7fc4480718e0 0x7fc448069450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:48.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.084+0000 7fc447fff640 1 -- 172.21.15.53:0/2614036371 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc44815e120 con 0x7fc448159630 2023-06-10T18:52:48.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.084+0000 7fc447fff640 1 --2- 172.21.15.53:0/2614036371 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc448159630 0x7fc44815d260 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc4480add50 tx=0x7fc43801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b674cfa584087eaf server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:48.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.084+0000 7fc4477fe640 1 -- 172.21.15.53:0/2614036371 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4380ac600 con 0x7fc448159630 2023-06-10T18:52:48.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.084+0000 7fc4477fe640 1 -- 172.21.15.53:0/2614036371 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4380a8050 con 0x7fc448159630 2023-06-10T18:52:48.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.084+0000 7fc4477fe640 1 -- 172.21.15.53:0/2614036371 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4380ac980 con 0x7fc448159630 2023-06-10T18:52:48.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.088+0000 7fc44e2cf640 1 -- 172.21.15.53:0/2614036371 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc448159630 msgr2=0x7fc44815d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:48.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.088+0000 7fc44e2cf640 1 --2- 172.21.15.53:0/2614036371 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc448159630 0x7fc44815d260 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc4480add50 tx=0x7fc43801c4d0 comp rx=0 tx=0).stop 2023-06-10T18:52:48.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.088+0000 7fc44e2cf640 1 -- 172.21.15.53:0/2614036371 shutdown_connections 2023-06-10T18:52:48.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.088+0000 7fc44e2cf640 1 --2- 172.21.15.53:0/2614036371 >> v2:172.21.15.117:3300/0 conn(0x7fc4480718e0 0x7fc448069450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:48.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.088+0000 7fc44e2cf640 1 --2- 172.21.15.53:0/2614036371 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4480ad730 0x7fc4480713a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:48.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.088+0000 7fc44e2cf640 1 --2- 172.21.15.53:0/2614036371 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc448159630 0x7fc44815d260 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:48.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.088+0000 7fc44e2cf640 1 -- 172.21.15.53:0/2614036371 >> 172.21.15.53:0/2614036371 conn(0x7fc4480cafc0 msgr2=0x7fc4480cb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:48.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.088+0000 7fc44e2cf640 1 -- 172.21.15.53:0/2614036371 shutdown_connections 2023-06-10T18:52:48.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.088+0000 7fc44e2cf640 1 -- 172.21.15.53:0/2614036371 wait complete. 2023-06-10T18:52:48.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.088+0000 7fc44e2cf640 1 Processor -- start 2023-06-10T18:52:48.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.088+0000 7fc44e2cf640 1 -- start start 2023-06-10T18:52:48.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.088+0000 7fc44e2cf640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4480718e0 0x7fc4481f9a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:48.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.088+0000 7fc44e2cf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc4480ad730 0x7fc448155ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:48.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.088+0000 7fc44e2cf640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc448159630 0x7fc448156410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:48.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.088+0000 7fc44e2cf640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4480c6920 con 0x7fc4480ad730 2023-06-10T18:52:48.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.088+0000 7fc44e2cf640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4480c6c00 con 0x7fc4480718e0 2023-06-10T18:52:48.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.088+0000 7fc44e2cf640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4480c6ee0 con 0x7fc448159630 2023-06-10T18:52:48.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.088+0000 7fc43f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc4480ad730 0x7fc448155ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:48.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.088+0000 7fc43f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc4480ad730 0x7fc448155ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56200/0 (socket says 172.21.15.53:56200) 2023-06-10T18:52:48.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.088+0000 7fc43f7fe640 1 -- 172.21.15.53:0/583528325 learned_addr learned my addr 172.21.15.53:0/583528325 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:48.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.088+0000 7fc44c86c640 1 --2- 172.21.15.53:0/583528325 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc448159630 0x7fc448156410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:48.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.088+0000 7fc447fff640 1 --2- 172.21.15.53:0/583528325 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4480718e0 0x7fc4481f9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:48.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.088+0000 7fc43f7fe640 1 -- 172.21.15.53:0/583528325 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc448159630 msgr2=0x7fc448156410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:48.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.088+0000 7fc43f7fe640 1 --2- 172.21.15.53:0/583528325 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc448159630 0x7fc448156410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:48.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.088+0000 7fc43f7fe640 1 -- 172.21.15.53:0/583528325 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4480718e0 msgr2=0x7fc4481f9a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:48.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.088+0000 7fc43f7fe640 1 --2- 172.21.15.53:0/583528325 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4480718e0 0x7fc4481f9a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:48.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.088+0000 7fc43f7fe640 1 -- 172.21.15.53:0/583528325 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4380094d0 con 0x7fc4480ad730 2023-06-10T18:52:48.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.088+0000 7fc447fff640 1 --2- 172.21.15.53:0/583528325 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4480718e0 0x7fc4481f9a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:52:48.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.088+0000 7fc43f7fe640 1 --2- 172.21.15.53:0/583528325 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc4480ad730 0x7fc448155ed0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc43000d800 tx=0x7fc43000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:48.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.088+0000 7fc4457fa640 1 -- 172.21.15.53:0/583528325 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc43000b6c0 con 0x7fc4480ad730 2023-06-10T18:52:48.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.088+0000 7fc4457fa640 1 -- 172.21.15.53:0/583528325 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc43000b820 con 0x7fc4480ad730 2023-06-10T18:52:48.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.088+0000 7fc44e2cf640 1 -- 172.21.15.53:0/583528325 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4480c71c0 con 0x7fc4480ad730 2023-06-10T18:52:48.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.088+0000 7fc4457fa640 1 -- 172.21.15.53:0/583528325 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc43000bb90 con 0x7fc4480ad730 2023-06-10T18:52:48.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.088+0000 7fc44e2cf640 1 -- 172.21.15.53:0/583528325 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4480cda10 con 0x7fc4480ad730 2023-06-10T18:52:48.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.092+0000 7fc44e2cf640 1 -- 172.21.15.53:0/583528325 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4480cbd00 con 0x7fc4480ad730 2023-06-10T18:52:48.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.092+0000 7fc4457fa640 1 -- 172.21.15.53:0/583528325 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc43000bcf0 con 0x7fc4480ad730 2023-06-10T18:52:48.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.092+0000 7fc4457fa640 1 --2- 172.21.15.53:0/583528325 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc4280662b0 0x7fc428068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:48.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.092+0000 7fc4457fa640 1 -- 172.21.15.53:0/583528325 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc430084220 con 0x7fc4480ad730 2023-06-10T18:52:48.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.092+0000 7fc447fff640 1 --2- 172.21.15.53:0/583528325 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc4280662b0 0x7fc428068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:48.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.092+0000 7fc447fff640 1 --2- 172.21.15.53:0/583528325 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc4280662b0 0x7fc428068760 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc4380ae000 tx=0x7fc438008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:48.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.096+0000 7fc4457fa640 1 -- 172.21.15.53:0/583528325 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc430055090 con 0x7fc4480ad730 2023-06-10T18:52:48.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.284+0000 7fc44e2cf640 1 -- 172.21.15.53:0/583528325 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc44804d790 con 0x7fc4480ad730 2023-06-10T18:52:48.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.284+0000 7fc4457fa640 1 -- 172.21.15.53:0/583528325 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4668 (secure 0 0 0) 0x7fc430054c20 con 0x7fc4480ad730 2023-06-10T18:52:48.295 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:52:48.296 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4236,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/1767214403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":1767214403},{"type":"v1","addr":"172.21.15.53:6834","nonce":1767214403}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/184933647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":184933647},{"type":"v1","addr":"172.21.15.117:6837","nonce":184933647}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/1556542558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":1556542558},{"type":"v1","addr":"172.21.15.53:6835","nonce":1556542558}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T18:52:44.918376+0000","modified":"2023-06-10T18:52:47.927154+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6835/1492134415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1492134415},{"type":"v1","addr":"172.21.15.117:6835","nonce":1492134415}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-10T18:52:48.296 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 7 2023-06-10T18:52:48.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.288+0000 7fc44e2cf640 1 -- 172.21.15.53:0/583528325 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc4280662b0 msgr2=0x7fc428068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:48.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.288+0000 7fc44e2cf640 1 --2- 172.21.15.53:0/583528325 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc4280662b0 0x7fc428068760 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc4380ae000 tx=0x7fc438008040 comp rx=0 tx=0).stop 2023-06-10T18:52:48.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.288+0000 7fc44e2cf640 1 -- 172.21.15.53:0/583528325 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc4480ad730 msgr2=0x7fc448155ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:48.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.288+0000 7fc44e2cf640 1 --2- 172.21.15.53:0/583528325 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc4480ad730 0x7fc448155ed0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc43000d800 tx=0x7fc43000dcc0 comp rx=0 tx=0).stop 2023-06-10T18:52:48.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.288+0000 7fc44e2cf640 1 -- 172.21.15.53:0/583528325 shutdown_connections 2023-06-10T18:52:48.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.288+0000 7fc44e2cf640 1 --2- 172.21.15.53:0/583528325 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc4280662b0 0x7fc428068760 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:48.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.288+0000 7fc44e2cf640 1 --2- 172.21.15.53:0/583528325 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc448159630 0x7fc448156410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:48.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.288+0000 7fc44e2cf640 1 --2- 172.21.15.53:0/583528325 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc4480ad730 0x7fc448155ed0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:48.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.288+0000 7fc44e2cf640 1 --2- 172.21.15.53:0/583528325 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4480718e0 0x7fc4481f9a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:48.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.288+0000 7fc44e2cf640 1 -- 172.21.15.53:0/583528325 >> 172.21.15.53:0/583528325 conn(0x7fc4480cafc0 msgr2=0x7fc4480cb390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:48.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.288+0000 7fc44e2cf640 1 -- 172.21.15.53:0/583528325 shutdown_connections 2023-06-10T18:52:48.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.288+0000 7fc44e2cf640 1 -- 172.21.15.53:0/583528325 wait complete. 2023-06-10T18:52:48.314 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T18:52:48.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.424+0000 7f6cdc8c1640 1 Processor -- start 2023-06-10T18:52:48.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.424+0000 7f6cdc8c1640 1 -- start start 2023-06-10T18:52:48.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.424+0000 7f6cdc8c1640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6cd80b06d0 0x7f6cd806a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:48.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.424+0000 7f6cdc8c1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6cd815f450 0x7f6cd815f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:48.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.424+0000 7f6cdc8c1640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cd806ae70 con 0x7f6cd815b870 2023-06-10T18:52:48.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.424+0000 7f6cdc8c1640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cd80655c0 con 0x7f6cd80b06d0 2023-06-10T18:52:48.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.424+0000 7f6cdc8c1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd80cc110 con 0x7f6cd815f450 2023-06-10T18:52:48.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.424+0000 7f6cd6d9d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6cd815f450 0x7f6cd815f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:48.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.424+0000 7f6cd6d9d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6cd815f450 0x7f6cd815f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.53:39320/0 (socket says 172.21.15.53:39320) 2023-06-10T18:52:48.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.424+0000 7f6cd6d9d640 1 -- 172.21.15.53:0/3029224041 learned_addr learned my addr 172.21.15.53:0/3029224041 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:48.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.424+0000 7f6cd5d9b640 1 --2- 172.21.15.53:0/3029224041 >> v2:172.21.15.117:3300/0 conn(0x7f6cd80b06d0 0x7f6cd806a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:48.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.424+0000 7f6cd6d9d640 1 -- 172.21.15.53:0/3029224041 >> v2:172.21.15.117:3300/0 conn(0x7f6cd80b06d0 msgr2=0x7f6cd806a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:48.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.424+0000 7f6cd6d9d640 1 --2- 172.21.15.53:0/3029224041 >> v2:172.21.15.117:3300/0 conn(0x7f6cd80b06d0 0x7f6cd806a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:48.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.424+0000 7f6cd6d9d640 1 -- 172.21.15.53:0/3029224041 >> v1:172.21.15.117:6789/0 conn(0x7f6cd815b870 legacy=0x7f6cd80affc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:48.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.424+0000 7f6cd6d9d640 1 -- 172.21.15.53:0/3029224041 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cd80cc3f0 con 0x7f6cd815f450 2023-06-10T18:52:48.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.428+0000 7f6cd6d9d640 1 --2- 172.21.15.53:0/3029224041 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6cd815f450 0x7f6cd815f8f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6cd0009e50 tx=0x7f6cd001c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b1946c7c4893873 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:48.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.428+0000 7f6cd559a640 1 -- 172.21.15.53:0/3029224041 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd00a5680 con 0x7f6cd815f450 2023-06-10T18:52:48.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.428+0000 7f6cd559a640 1 -- 172.21.15.53:0/3029224041 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cd00a57e0 con 0x7f6cd815f450 2023-06-10T18:52:48.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.428+0000 7f6cd559a640 1 -- 172.21.15.53:0/3029224041 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd00a5b70 con 0x7f6cd815f450 2023-06-10T18:52:48.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.428+0000 7f6cdc8c1640 1 -- 172.21.15.53:0/3029224041 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6cd815f450 msgr2=0x7f6cd815f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:48.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.428+0000 7f6cdc8c1640 1 --2- 172.21.15.53:0/3029224041 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6cd815f450 0x7f6cd815f8f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6cd0009e50 tx=0x7f6cd001c8c0 comp rx=0 tx=0).stop 2023-06-10T18:52:48.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.428+0000 7f6cdc8c1640 1 -- 172.21.15.53:0/3029224041 shutdown_connections 2023-06-10T18:52:48.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.428+0000 7f6cdc8c1640 1 --2- 172.21.15.53:0/3029224041 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6cd815f450 0x7f6cd815f8f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:48.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.428+0000 7f6cdc8c1640 1 --2- 172.21.15.53:0/3029224041 >> v2:172.21.15.117:3300/0 conn(0x7f6cd80b06d0 0x7f6cd806a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:48.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.428+0000 7f6cdc8c1640 1 -- 172.21.15.53:0/3029224041 >> 172.21.15.53:0/3029224041 conn(0x7f6cd80cafc0 msgr2=0x7f6cd80cb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:48.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.428+0000 7f6cdc8c1640 1 -- 172.21.15.53:0/3029224041 shutdown_connections 2023-06-10T18:52:48.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.428+0000 7f6cdc8c1640 1 -- 172.21.15.53:0/3029224041 wait complete. 2023-06-10T18:52:48.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.428+0000 7f6cdc8c1640 1 Processor -- start 2023-06-10T18:52:48.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.428+0000 7f6cdc8c1640 1 -- start start 2023-06-10T18:52:48.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.432+0000 7f6cdc8c1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6cd80b06d0 0x7f6cd815d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:48.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.432+0000 7f6cdc8c1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6cd815b870 0x7f6cd81536c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:48.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.432+0000 7f6cdc8c1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6cd815f450 0x7f6cd80c3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:48.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.432+0000 7f6cdc8c1640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd815c7d0 con 0x7f6cd815f450 2023-06-10T18:52:48.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.432+0000 7f6cdc8c1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd815cab0 con 0x7f6cd815b870 2023-06-10T18:52:48.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.432+0000 7f6cdc8c1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd815cd90 con 0x7f6cd80b06d0 2023-06-10T18:52:48.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.432+0000 7f6cd6d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6cd815f450 0x7f6cd80c3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:48.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.432+0000 7f6cd6d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6cd815f450 0x7f6cd80c3fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56212/0 (socket says 172.21.15.53:56212) 2023-06-10T18:52:48.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.432+0000 7f6cd6d9d640 1 -- 172.21.15.53:0/2649843592 learned_addr learned my addr 172.21.15.53:0/2649843592 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:48.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.432+0000 7f6cd5d9b640 1 --2- 172.21.15.53:0/2649843592 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6cd815b870 0x7f6cd81536c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:48.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.432+0000 7f6cd659c640 1 --2- 172.21.15.53:0/2649843592 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6cd80b06d0 0x7f6cd815d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:48.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.432+0000 7f6cd6d9d640 1 -- 172.21.15.53:0/2649843592 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6cd80b06d0 msgr2=0x7f6cd815d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:48.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.432+0000 7f6cd6d9d640 1 --2- 172.21.15.53:0/2649843592 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6cd80b06d0 0x7f6cd815d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:48.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.432+0000 7f6cd6d9d640 1 -- 172.21.15.53:0/2649843592 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6cd815b870 msgr2=0x7f6cd81536c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:48.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.432+0000 7f6cd6d9d640 1 --2- 172.21.15.53:0/2649843592 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6cd815b870 0x7f6cd81536c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:48.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.432+0000 7f6cd6d9d640 1 -- 172.21.15.53:0/2649843592 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cd0009b30 con 0x7f6cd815f450 2023-06-10T18:52:48.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.432+0000 7f6cd5d9b640 1 --2- 172.21.15.53:0/2649843592 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6cd815b870 0x7f6cd81536c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:52:48.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.432+0000 7f6cd659c640 1 --2- 172.21.15.53:0/2649843592 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6cd80b06d0 0x7f6cd815d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:52:48.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.432+0000 7f6cd6d9d640 1 --2- 172.21.15.53:0/2649843592 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6cd815f450 0x7f6cd80c3fc0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6cd00af040 tx=0x7f6cd0019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:48.445 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.432+0000 7f6cc6ffd640 1 -- 172.21.15.53:0/2649843592 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd00b8640 con 0x7f6cd815f450 2023-06-10T18:52:48.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.432+0000 7f6cc6ffd640 1 -- 172.21.15.53:0/2649843592 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cd00b87a0 con 0x7f6cd815f450 2023-06-10T18:52:48.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.432+0000 7f6cc6ffd640 1 -- 172.21.15.53:0/2649843592 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd00b8b10 con 0x7f6cd815f450 2023-06-10T18:52:48.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.432+0000 7f6cdc8c1640 1 -- 172.21.15.53:0/2649843592 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cd815d070 con 0x7f6cd815f450 2023-06-10T18:52:48.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.432+0000 7f6cdc8c1640 1 -- 172.21.15.53:0/2649843592 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cd8153dd0 con 0x7f6cd815f450 2023-06-10T18:52:48.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.432+0000 7f6cdc8c1640 1 -- 172.21.15.53:0/2649843592 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cd804d790 con 0x7f6cd815f450 2023-06-10T18:52:48.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.432+0000 7f6cc6ffd640 1 -- 172.21.15.53:0/2649843592 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6cd00b8c70 con 0x7f6cd815f450 2023-06-10T18:52:48.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.432+0000 7f6cc6ffd640 1 --2- 172.21.15.53:0/2649843592 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6cb8066280 0x7f6cb8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:48.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.432+0000 7f6cc6ffd640 1 -- 172.21.15.53:0/2649843592 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6cd011ed10 con 0x7f6cd815f450 2023-06-10T18:52:48.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.436+0000 7f6cd659c640 1 --2- 172.21.15.53:0/2649843592 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6cb8066280 0x7f6cb8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:48.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.436+0000 7f6cd659c640 1 --2- 172.21.15.53:0/2649843592 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6cb8066280 0x7f6cb8068730 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6cc8000f70 tx=0x7f6cc8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:48.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.436+0000 7f6cc6ffd640 1 -- 172.21.15.53:0/2649843592 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6cd0124020 con 0x7f6cd815f450 2023-06-10T18:52:48.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.596+0000 7f6cdc8c1640 1 -- 172.21.15.53:0/2649843592 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6cd8153dd0 con 0x7f6cd815f450 2023-06-10T18:52:48.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.596+0000 7f6cc6ffd640 1 -- 172.21.15.53:0/2649843592 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18267 (secure 0 0 0) 0x7f6cd8153dd0 con 0x7f6cd815f450 2023-06-10T18:52:48.606 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:52:48.606 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":23,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T18:52:45.921586+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-10T18:52:43.396243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-10T18:52:43.894228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T18:52:48.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.600+0000 7f6cdc8c1640 1 -- 172.21.15.53:0/2649843592 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6cb8066280 msgr2=0x7f6cb8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:48.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.600+0000 7f6cdc8c1640 1 --2- 172.21.15.53:0/2649843592 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6cb8066280 0x7f6cb8068730 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6cc8000f70 tx=0x7f6cc8009040 comp rx=0 tx=0).stop 2023-06-10T18:52:48.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.600+0000 7f6cdc8c1640 1 -- 172.21.15.53:0/2649843592 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6cd815f450 msgr2=0x7f6cd80c3fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:48.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.600+0000 7f6cdc8c1640 1 --2- 172.21.15.53:0/2649843592 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6cd815f450 0x7f6cd80c3fc0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6cd00af040 tx=0x7f6cd0019660 comp rx=0 tx=0).stop 2023-06-10T18:52:48.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.600+0000 7f6cdc8c1640 1 -- 172.21.15.53:0/2649843592 shutdown_connections 2023-06-10T18:52:48.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.600+0000 7f6cdc8c1640 1 --2- 172.21.15.53:0/2649843592 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6cb8066280 0x7f6cb8068730 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:48.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.600+0000 7f6cdc8c1640 1 --2- 172.21.15.53:0/2649843592 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6cd815f450 0x7f6cd80c3fc0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:48.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.600+0000 7f6cdc8c1640 1 --2- 172.21.15.53:0/2649843592 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6cd815b870 0x7f6cd81536c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:48.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.600+0000 7f6cdc8c1640 1 --2- 172.21.15.53:0/2649843592 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6cd80b06d0 0x7f6cd815d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:48.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.600+0000 7f6cdc8c1640 1 -- 172.21.15.53:0/2649843592 >> 172.21.15.53:0/2649843592 conn(0x7f6cd80cafc0 msgr2=0x7f6cd80cb390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:48.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.600+0000 7f6cdc8c1640 1 -- 172.21.15.53:0/2649843592 shutdown_connections 2023-06-10T18:52:48.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.600+0000 7f6cdc8c1640 1 -- 172.21.15.53:0/2649843592 wait complete. 2023-06-10T18:52:48.625 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-06-10T18:52:48.626 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-10T18:52:48.747 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.736+0000 7ff470b10640 1 Processor -- start 2023-06-10T18:52:48.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.736+0000 7ff470b10640 1 -- start start 2023-06-10T18:52:48.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.740+0000 7ff470b10640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff46c15cdb0 0x7ff46c0b30e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:48.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.740+0000 7ff470b10640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff46c0c9f50 0x7ff46c0b3620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:48.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.740+0000 7ff470b10640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff46c06c620 con 0x7ff46c071060 2023-06-10T18:52:48.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.740+0000 7ff470b10640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff46c0702a0 con 0x7ff46c0c9f50 2023-06-10T18:52:48.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.740+0000 7ff470b10640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff46c070580 con 0x7ff46c15cdb0 2023-06-10T18:52:48.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.740+0000 7ff46ad9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff46c0c9f50 0x7ff46c0b3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:48.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.740+0000 7ff469d9b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ff46c071060 0x7ff46c0c9840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52844/0 (socket says 172.21.15.53:52844) 2023-06-10T18:52:48.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.740+0000 7ff469d9b640 1 -- 172.21.15.53:0/1424895312 learned_addr learned my addr 172.21.15.53:0/1424895312 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:52:48.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.740+0000 7ff46a59c640 1 --2- 172.21.15.53:0/1424895312 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff46c15cdb0 0x7ff46c0b30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:48.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.740+0000 7ff46959a640 1 -- 172.21.15.53:0/1424895312 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2504205142 0 0) 0x7ff46c06c620 con 0x7ff46c071060 2023-06-10T18:52:48.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.740+0000 7ff46959a640 1 -- 172.21.15.53:0/1424895312 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff458003530 con 0x7ff46c071060 2023-06-10T18:52:48.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.740+0000 7ff46ad9d640 1 -- 172.21.15.53:0/1424895312 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff46c15cdb0 msgr2=0x7ff46c0b30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:48.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.740+0000 7ff46ad9d640 1 --2- 172.21.15.53:0/1424895312 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff46c15cdb0 0x7ff46c0b30e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:48.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.740+0000 7ff46ad9d640 1 -- 172.21.15.53:0/1424895312 >> v1:172.21.15.53:6789/0 conn(0x7ff46c071060 legacy=0x7ff46c0c9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:48.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.740+0000 7ff46ad9d640 1 -- 172.21.15.53:0/1424895312 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff46c070860 con 0x7ff46c0c9f50 2023-06-10T18:52:48.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.740+0000 7ff46a59c640 1 --2- 172.21.15.53:0/1424895312 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff46c15cdb0 0x7ff46c0b30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:52:48.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.740+0000 7ff46ad9d640 1 --2- 172.21.15.53:0/1424895312 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff46c0c9f50 0x7ff46c0b3620 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff45c0097c0 tx=0x7ff45c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3addf72e99d35bd server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:48.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.740+0000 7ff46959a640 1 -- 172.21.15.53:0/1424895312 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff45c0ab600 con 0x7ff46c0c9f50 2023-06-10T18:52:48.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.740+0000 7ff46959a640 1 -- 172.21.15.53:0/1424895312 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff45c0a7050 con 0x7ff46c0c9f50 2023-06-10T18:52:48.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.740+0000 7ff46959a640 1 -- 172.21.15.53:0/1424895312 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff45c0ab980 con 0x7ff46c0c9f50 2023-06-10T18:52:48.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.744+0000 7ff470b10640 1 -- 172.21.15.53:0/1424895312 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff46c0c9f50 msgr2=0x7ff46c0b3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:48.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.744+0000 7ff470b10640 1 --2- 172.21.15.53:0/1424895312 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff46c0c9f50 0x7ff46c0b3620 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff45c0097c0 tx=0x7ff45c01c450 comp rx=0 tx=0).stop 2023-06-10T18:52:48.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.744+0000 7ff470b10640 1 -- 172.21.15.53:0/1424895312 shutdown_connections 2023-06-10T18:52:48.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.744+0000 7ff470b10640 1 --2- 172.21.15.53:0/1424895312 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff46c0c9f50 0x7ff46c0b3620 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:48.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.744+0000 7ff470b10640 1 --2- 172.21.15.53:0/1424895312 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff46c15cdb0 0x7ff46c0b30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:48.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.744+0000 7ff470b10640 1 -- 172.21.15.53:0/1424895312 >> 172.21.15.53:0/1424895312 conn(0x7ff46c06a0d0 msgr2=0x7ff46c0ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:48.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.744+0000 7ff470b10640 1 -- 172.21.15.53:0/1424895312 shutdown_connections 2023-06-10T18:52:48.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.744+0000 7ff470b10640 1 -- 172.21.15.53:0/1424895312 wait complete. 2023-06-10T18:52:48.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.744+0000 7ff470b10640 1 Processor -- start 2023-06-10T18:52:48.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.744+0000 7ff470b10640 1 -- start start 2023-06-10T18:52:48.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.744+0000 7ff470b10640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff46c071060 0x7ff46c1f5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:48.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.744+0000 7ff470b10640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff46c0c9f50 0x7ff46c0c7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:48.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.744+0000 7ff470b10640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff46c15cdb0 0x7ff46c0c4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:48.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.744+0000 7ff470b10640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff46c156a50 con 0x7ff46c0c9f50 2023-06-10T18:52:48.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.744+0000 7ff470b10640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff46c1f5650 con 0x7ff46c15cdb0 2023-06-10T18:52:48.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.744+0000 7ff470b10640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff46c1f5070 con 0x7ff46c071060 2023-06-10T18:52:48.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.744+0000 7ff469d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff46c0c9f50 0x7ff46c0c7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:48.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.744+0000 7ff46a59c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff46c071060 0x7ff46c1f5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:48.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.744+0000 7ff469d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff46c0c9f50 0x7ff46c0c7440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56232/0 (socket says 172.21.15.53:56232) 2023-06-10T18:52:48.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.744+0000 7ff469d9b640 1 -- 172.21.15.53:0/3735500313 learned_addr learned my addr 172.21.15.53:0/3735500313 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:48.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.744+0000 7ff46ad9d640 1 --2- 172.21.15.53:0/3735500313 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff46c15cdb0 0x7ff46c0c4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:48.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.744+0000 7ff469d9b640 1 -- 172.21.15.53:0/3735500313 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff46c071060 msgr2=0x7ff46c1f5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:48.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.744+0000 7ff469d9b640 1 --2- 172.21.15.53:0/3735500313 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff46c071060 0x7ff46c1f5ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:48.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.744+0000 7ff469d9b640 1 -- 172.21.15.53:0/3735500313 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff46c15cdb0 msgr2=0x7ff46c0c4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:48.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.744+0000 7ff469d9b640 1 --2- 172.21.15.53:0/3735500313 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff46c15cdb0 0x7ff46c0c4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:48.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.744+0000 7ff469d9b640 1 -- 172.21.15.53:0/3735500313 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff45c009420 con 0x7ff46c0c9f50 2023-06-10T18:52:48.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.744+0000 7ff469d9b640 1 --2- 172.21.15.53:0/3735500313 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff46c0c9f50 0x7ff46c0c7440 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff45400c4d0 tx=0x7ff45400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:48.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.744+0000 7ff462ffd640 1 -- 172.21.15.53:0/3735500313 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff454005cf0 con 0x7ff46c0c9f50 2023-06-10T18:52:48.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.744+0000 7ff462ffd640 1 -- 172.21.15.53:0/3735500313 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff454005e50 con 0x7ff46c0c9f50 2023-06-10T18:52:48.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.744+0000 7ff470b10640 1 -- 172.21.15.53:0/3735500313 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff46c0c5830 con 0x7ff46c0c9f50 2023-06-10T18:52:48.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.744+0000 7ff462ffd640 1 -- 172.21.15.53:0/3735500313 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff454007270 con 0x7ff46c0c9f50 2023-06-10T18:52:48.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.744+0000 7ff470b10640 1 -- 172.21.15.53:0/3735500313 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff46c156fa0 con 0x7ff46c0c9f50 2023-06-10T18:52:48.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.748+0000 7ff470b10640 1 -- 172.21.15.53:0/3735500313 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff46c04d790 con 0x7ff46c0c9f50 2023-06-10T18:52:48.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.748+0000 7ff462ffd640 1 -- 172.21.15.53:0/3735500313 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff4540073d0 con 0x7ff46c0c9f50 2023-06-10T18:52:48.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.748+0000 7ff462ffd640 1 --2- 172.21.15.53:0/3735500313 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff44c0662a0 0x7ff44c068750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:48.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.748+0000 7ff462ffd640 1 -- 172.21.15.53:0/3735500313 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff4540830f0 con 0x7ff46c0c9f50 2023-06-10T18:52:48.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.748+0000 7ff46a59c640 1 --2- 172.21.15.53:0/3735500313 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff44c0662a0 0x7ff44c068750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:48.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.748+0000 7ff46a59c640 1 --2- 172.21.15.53:0/3735500313 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff44c0662a0 0x7ff44c068750 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff464009fd0 tx=0x7ff4640097f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:48.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.752+0000 7ff462ffd640 1 -- 172.21.15.53:0/3735500313 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff4540507c0 con 0x7ff46c0c9f50 2023-06-10T18:52:48.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.900+0000 7ff470b10640 1 -- 172.21.15.53:0/3735500313 --> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff46c0667c0 con 0x7ff44c0662a0 2023-06-10T18:52:48.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.924+0000 7ff462ffd640 1 -- 172.21.15.53:0/3735500313 <== mgr.4105 v2:172.21.15.117:6832/3061986771 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+271996 (secure 0 0 0) 0x7ff46400f040 con 0x7ff44c0662a0 2023-06-10T18:52:48.934 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:52:48.937 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-06-10T18:52:48.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.928+0000 7ff470b10640 1 -- 172.21.15.53:0/3735500313 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff44c0662a0 msgr2=0x7ff44c068750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:48.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.928+0000 7ff470b10640 1 --2- 172.21.15.53:0/3735500313 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff44c0662a0 0x7ff44c068750 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff464009fd0 tx=0x7ff4640097f0 comp rx=0 tx=0).stop 2023-06-10T18:52:48.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.928+0000 7ff470b10640 1 -- 172.21.15.53:0/3735500313 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff46c0c9f50 msgr2=0x7ff46c0c7440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:48.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.928+0000 7ff470b10640 1 --2- 172.21.15.53:0/3735500313 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff46c0c9f50 0x7ff46c0c7440 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff45400c4d0 tx=0x7ff45400c990 comp rx=0 tx=0).stop 2023-06-10T18:52:48.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.928+0000 7ff470b10640 1 -- 172.21.15.53:0/3735500313 shutdown_connections 2023-06-10T18:52:48.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.928+0000 7ff470b10640 1 --2- 172.21.15.53:0/3735500313 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff44c0662a0 0x7ff44c068750 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:48.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.928+0000 7ff470b10640 1 --2- 172.21.15.53:0/3735500313 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff46c15cdb0 0x7ff46c0c4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:48.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.928+0000 7ff470b10640 1 --2- 172.21.15.53:0/3735500313 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff46c0c9f50 0x7ff46c0c7440 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:48.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.928+0000 7ff470b10640 1 --2- 172.21.15.53:0/3735500313 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff46c071060 0x7ff46c1f5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:48.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.928+0000 7ff470b10640 1 -- 172.21.15.53:0/3735500313 >> 172.21.15.53:0/3735500313 conn(0x7ff46c06a0d0 msgr2=0x7ff46c151300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:48.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.928+0000 7ff470b10640 1 -- 172.21.15.53:0/3735500313 shutdown_connections 2023-06-10T18:52:48.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:48.928+0000 7ff470b10640 1 -- 172.21.15.53:0/3735500313 wait complete. 2023-06-10T18:52:48.954 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-06-10T18:52:47.558729+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":234604,"kb_used_data":2604,"kb_used_omap":0,"kb_used_meta":231936,"kb_avail":754740116,"statfs":{"total":773094113280,"available":772853878784,"internally_reserved":0,"allocated":2666496,"data_stored":1658911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":237502464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.034847"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:43.517233+0000","last_change":"2023-06-10T18:52:43.517233+0000","last_active":"2023-06-10T18:52:43.517233+0000","last_peered":"2023-06-10T18:52:43.517233+0000","last_clean":"2023-06-10T18:52:43.517233+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:43.517233+0000","last_undegraded":"2023-06-10T18:52:43.517233+0000","last_fullsized":"2023-06-10T18:52:43.517233+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:43.517233+0000","last_change":"2023-06-10T18:52:43.517233+0000","last_active":"2023-06-10T18:52:43.517233+0000","last_peered":"2023-06-10T18:52:43.517233+0000","last_clean":"2023-06-10T18:52:43.517233+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:43.517233+0000","last_undegraded":"2023-06-10T18:52:43.517233+0000","last_fullsized":"2023-06-10T18:52:43.517233+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:43.517233+0000","last_change":"2023-06-10T18:52:43.517233+0000","last_active":"2023-06-10T18:52:43.517233+0000","last_peered":"2023-06-10T18:52:43.517233+0000","last_clean":"2023-06-10T18:52:43.517233+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:43.517233+0000","last_undegraded":"2023-06-10T18:52:43.517233+0000","last_fullsized":"2023-06-10T18:52:43.517233+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:43.517233+0000","last_change":"2023-06-10T18:52:43.517233+0000","last_active":"2023-06-10T18:52:43.517233+0000","last_peered":"2023-06-10T18:52:43.517233+0000","last_clean":"2023-06-10T18:52:43.517233+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:43.517233+0000","last_undegraded":"2023-06-10T18:52:43.517233+0000","last_fullsized":"2023-06-10T18:52:43.517233+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:43.517233+0000","last_change":"2023-06-10T18:52:43.517233+0000","last_active":"2023-06-10T18:52:43.517233+0000","last_peered":"2023-06-10T18:52:43.517233+0000","last_clean":"2023-06-10T18:52:43.517233+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:43.517233+0000","last_undegraded":"2023-06-10T18:52:43.517233+0000","last_fullsized":"2023-06-10T18:52:43.517233+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:43.517233+0000","last_change":"2023-06-10T18:52:43.517233+0000","last_active":"2023-06-10T18:52:43.517233+0000","last_peered":"2023-06-10T18:52:43.517233+0000","last_clean":"2023-06-10T18:52:43.517233+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:43.517233+0000","last_undegraded":"2023-06-10T18:52:43.517233+0000","last_fullsized":"2023-06-10T18:52:43.517233+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:43.517233+0000","last_change":"2023-06-10T18:52:43.517233+0000","last_active":"2023-06-10T18:52:43.517233+0000","last_peered":"2023-06-10T18:52:43.517233+0000","last_clean":"2023-06-10T18:52:43.517233+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:43.517233+0000","last_undegraded":"2023-06-10T18:52:43.517233+0000","last_fullsized":"2023-06-10T18:52:43.517233+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:43.517233+0000","last_change":"2023-06-10T18:52:43.517233+0000","last_active":"2023-06-10T18:52:43.517233+0000","last_peered":"2023-06-10T18:52:43.517233+0000","last_clean":"2023-06-10T18:52:43.517233+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:43.517233+0000","last_undegraded":"2023-06-10T18:52:43.517233+0000","last_fullsized":"2023-06-10T18:52:43.517233+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:43.517233+0000","last_change":"2023-06-10T18:52:43.517233+0000","last_active":"2023-06-10T18:52:43.517233+0000","last_peered":"2023-06-10T18:52:43.517233+0000","last_clean":"2023-06-10T18:52:43.517233+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:43.517233+0000","last_undegraded":"2023-06-10T18:52:43.517233+0000","last_fullsized":"2023-06-10T18:52:43.517233+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:43.517233+0000","last_change":"2023-06-10T18:52:43.517233+0000","last_active":"2023-06-10T18:52:43.517233+0000","last_peered":"2023-06-10T18:52:43.517233+0000","last_clean":"2023-06-10T18:52:43.517233+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:43.517233+0000","last_undegraded":"2023-06-10T18:52:43.517233+0000","last_fullsized":"2023-06-10T18:52:43.517233+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:43.517233+0000","last_change":"2023-06-10T18:52:43.517233+0000","last_active":"2023-06-10T18:52:43.517233+0000","last_peered":"2023-06-10T18:52:43.517233+0000","last_clean":"2023-06-10T18:52:43.517233+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:43.517233+0000","last_undegraded":"2023-06-10T18:52:43.517233+0000","last_fullsized":"2023-06-10T18:52:43.517233+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:43.517233+0000","last_change":"2023-06-10T18:52:43.517233+0000","last_active":"2023-06-10T18:52:43.517233+0000","last_peered":"2023-06-10T18:52:43.517233+0000","last_clean":"2023-06-10T18:52:43.517233+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:43.517233+0000","last_undegraded":"2023-06-10T18:52:43.517233+0000","last_fullsized":"2023-06-10T18:52:43.517233+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":167,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-06-10T18:52:41.752111+0000","last_change":"2023-06-10T18:52:34.951528+0000","last_active":"2023-06-10T18:52:41.752111+0000","last_peered":"2023-06-10T18:52:41.752111+0000","last_clean":"2023-06-10T18:52:41.752111+0000","last_became_active":"2023-06-10T18:52:34.949099+0000","last_became_peered":"2023-06-10T18:52:34.949099+0000","last_unstale":"2023-06-10T18:52:41.752111+0000","last_undegraded":"2023-06-10T18:52:41.752111+0000","last_fullsized":"2023-06-10T18:52:41.752111+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_clean_scrub_stamp":"2023-06-10T18:52:33.633295+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:48:51.704734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-06-10T18:52:42.370978+0000","last_change":"2023-06-10T18:52:40.506384+0000","last_active":"2023-06-10T18:52:42.370978+0000","last_peered":"2023-06-10T18:52:42.370978+0000","last_clean":"2023-06-10T18:52:42.370978+0000","last_became_active":"2023-06-10T18:52:40.505701+0000","last_became_peered":"2023-06-10T18:52:40.505701+0000","last_unstale":"2023-06-10T18:52:42.370978+0000","last_undegraded":"2023-06-10T18:52:42.370978+0000","last_fullsized":"2023-06-10T18:52:42.370978+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:54:21.690066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:43.517233+0000","last_change":"2023-06-10T18:52:43.517233+0000","last_active":"2023-06-10T18:52:43.517233+0000","last_peered":"2023-06-10T18:52:43.517233+0000","last_clean":"2023-06-10T18:52:43.517233+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:43.517233+0000","last_undegraded":"2023-06-10T18:52:43.517233+0000","last_fullsized":"2023-06-10T18:52:43.517233+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-06-10T18:52:41.752181+0000","last_change":"2023-06-10T18:52:40.512015+0000","last_active":"2023-06-10T18:52:41.752181+0000","last_peered":"2023-06-10T18:52:41.752181+0000","last_clean":"2023-06-10T18:52:41.752181+0000","last_became_active":"2023-06-10T18:52:40.511382+0000","last_became_peered":"2023-06-10T18:52:40.511382+0000","last_unstale":"2023-06-10T18:52:41.752181+0000","last_undegraded":"2023-06-10T18:52:41.752181+0000","last_fullsized":"2023-06-10T18:52:41.752181+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:43:06.477676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:43.517233+0000","last_change":"2023-06-10T18:52:43.517233+0000","last_active":"2023-06-10T18:52:43.517233+0000","last_peered":"2023-06-10T18:52:43.517233+0000","last_clean":"2023-06-10T18:52:43.517233+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:43.517233+0000","last_undegraded":"2023-06-10T18:52:43.517233+0000","last_fullsized":"2023-06-10T18:52:43.517233+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-06-10T18:52:42.370512+0000","last_change":"2023-06-10T18:52:40.671725+0000","last_active":"2023-06-10T18:52:42.370512+0000","last_peered":"2023-06-10T18:52:42.370512+0000","last_clean":"2023-06-10T18:52:42.370512+0000","last_became_active":"2023-06-10T18:52:40.671442+0000","last_became_peered":"2023-06-10T18:52:40.671442+0000","last_unstale":"2023-06-10T18:52:42.370512+0000","last_undegraded":"2023-06-10T18:52:42.370512+0000","last_fullsized":"2023-06-10T18:52:42.370512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:51:33.222135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:43.517233+0000","last_change":"2023-06-10T18:52:43.517233+0000","last_active":"2023-06-10T18:52:43.517233+0000","last_peered":"2023-06-10T18:52:43.517233+0000","last_clean":"2023-06-10T18:52:43.517233+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:43.517233+0000","last_undegraded":"2023-06-10T18:52:43.517233+0000","last_fullsized":"2023-06-10T18:52:43.517233+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-06-10T18:52:42.370885+0000","last_change":"2023-06-10T18:52:40.510258+0000","last_active":"2023-06-10T18:52:42.370885+0000","last_peered":"2023-06-10T18:52:42.370885+0000","last_clean":"2023-06-10T18:52:42.370885+0000","last_became_active":"2023-06-10T18:52:40.509560+0000","last_became_peered":"2023-06-10T18:52:40.509560+0000","last_unstale":"2023-06-10T18:52:42.370885+0000","last_undegraded":"2023-06-10T18:52:42.370885+0000","last_fullsized":"2023-06-10T18:52:42.370885+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:42:02.803050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:43.517233+0000","last_change":"2023-06-10T18:52:43.517233+0000","last_active":"2023-06-10T18:52:43.517233+0000","last_peered":"2023-06-10T18:52:43.517233+0000","last_clean":"2023-06-10T18:52:43.517233+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:43.517233+0000","last_undegraded":"2023-06-10T18:52:43.517233+0000","last_fullsized":"2023-06-10T18:52:43.517233+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:43.517233+0000","last_change":"2023-06-10T18:52:43.517233+0000","last_active":"2023-06-10T18:52:43.517233+0000","last_peered":"2023-06-10T18:52:43.517233+0000","last_clean":"2023-06-10T18:52:43.517233+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:43.517233+0000","last_undegraded":"2023-06-10T18:52:43.517233+0000","last_fullsized":"2023-06-10T18:52:43.517233+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-06-10T18:52:41.509447+0000","last_change":"2023-06-10T18:52:40.672266+0000","last_active":"2023-06-10T18:52:41.509447+0000","last_peered":"2023-06-10T18:52:41.509447+0000","last_clean":"2023-06-10T18:52:41.509447+0000","last_became_active":"2023-06-10T18:52:40.671966+0000","last_became_peered":"2023-06-10T18:52:40.671966+0000","last_unstale":"2023-06-10T18:52:41.509447+0000","last_undegraded":"2023-06-10T18:52:41.509447+0000","last_fullsized":"2023-06-10T18:52:41.509447+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:58:47.201807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:43.517233+0000","last_change":"2023-06-10T18:52:43.517233+0000","last_active":"2023-06-10T18:52:43.517233+0000","last_peered":"2023-06-10T18:52:43.517233+0000","last_clean":"2023-06-10T18:52:43.517233+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:43.517233+0000","last_undegraded":"2023-06-10T18:52:43.517233+0000","last_fullsized":"2023-06-10T18:52:43.517233+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-06-10T18:52:41.752257+0000","last_change":"2023-06-10T18:52:40.671084+0000","last_active":"2023-06-10T18:52:41.752257+0000","last_peered":"2023-06-10T18:52:41.752257+0000","last_clean":"2023-06-10T18:52:41.752257+0000","last_became_active":"2023-06-10T18:52:40.670697+0000","last_became_peered":"2023-06-10T18:52:40.670697+0000","last_unstale":"2023-06-10T18:52:41.752257+0000","last_undegraded":"2023-06-10T18:52:41.752257+0000","last_fullsized":"2023-06-10T18:52:41.752257+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:52:34.794241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:43.517233+0000","last_change":"2023-06-10T18:52:43.517233+0000","last_active":"2023-06-10T18:52:43.517233+0000","last_peered":"2023-06-10T18:52:43.517233+0000","last_clean":"2023-06-10T18:52:43.517233+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:43.517233+0000","last_undegraded":"2023-06-10T18:52:43.517233+0000","last_fullsized":"2023-06-10T18:52:43.517233+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-06-10T18:52:41.509516+0000","last_change":"2023-06-10T18:52:40.514114+0000","last_active":"2023-06-10T18:52:41.509516+0000","last_peered":"2023-06-10T18:52:41.509516+0000","last_clean":"2023-06-10T18:52:41.509516+0000","last_became_active":"2023-06-10T18:52:40.513638+0000","last_became_peered":"2023-06-10T18:52:40.513638+0000","last_unstale":"2023-06-10T18:52:41.509516+0000","last_undegraded":"2023-06-10T18:52:41.509516+0000","last_fullsized":"2023-06-10T18:52:41.509516+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:43:40.468614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:43.517233+0000","last_change":"2023-06-10T18:52:43.517233+0000","last_active":"2023-06-10T18:52:43.517233+0000","last_peered":"2023-06-10T18:52:43.517233+0000","last_clean":"2023-06-10T18:52:43.517233+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:43.517233+0000","last_undegraded":"2023-06-10T18:52:43.517233+0000","last_fullsized":"2023-06-10T18:52:43.517233+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-06-10T18:52:42.170932+0000","last_change":"2023-06-10T18:52:40.515396+0000","last_active":"2023-06-10T18:52:42.170932+0000","last_peered":"2023-06-10T18:52:42.170932+0000","last_clean":"2023-06-10T18:52:42.170932+0000","last_became_active":"2023-06-10T18:52:40.514663+0000","last_became_peered":"2023-06-10T18:52:40.514663+0000","last_unstale":"2023-06-10T18:52:42.170932+0000","last_undegraded":"2023-06-10T18:52:42.170932+0000","last_fullsized":"2023-06-10T18:52:42.170932+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:58:47.201807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:43.517233+0000","last_change":"2023-06-10T18:52:43.517233+0000","last_active":"2023-06-10T18:52:43.517233+0000","last_peered":"2023-06-10T18:52:43.517233+0000","last_clean":"2023-06-10T18:52:43.517233+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:43.517233+0000","last_undegraded":"2023-06-10T18:52:43.517233+0000","last_fullsized":"2023-06-10T18:52:43.517233+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:43.517233+0000","last_change":"2023-06-10T18:52:43.517233+0000","last_active":"2023-06-10T18:52:43.517233+0000","last_peered":"2023-06-10T18:52:43.517233+0000","last_clean":"2023-06-10T18:52:43.517233+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:43.517233+0000","last_undegraded":"2023-06-10T18:52:43.517233+0000","last_fullsized":"2023-06-10T18:52:43.517233+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:43.517233+0000","last_change":"2023-06-10T18:52:43.517233+0000","last_active":"2023-06-10T18:52:43.517233+0000","last_peered":"2023-06-10T18:52:43.517233+0000","last_clean":"2023-06-10T18:52:43.517233+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:43.517233+0000","last_undegraded":"2023-06-10T18:52:43.517233+0000","last_fullsized":"2023-06-10T18:52:43.517233+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:43.517233+0000","last_change":"2023-06-10T18:52:43.517233+0000","last_active":"2023-06-10T18:52:43.517233+0000","last_peered":"2023-06-10T18:52:43.517233+0000","last_clean":"2023-06-10T18:52:43.517233+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:43.517233+0000","last_undegraded":"2023-06-10T18:52:43.517233+0000","last_fullsized":"2023-06-10T18:52:43.517233+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:43.517233+0000","last_change":"2023-06-10T18:52:43.517233+0000","last_active":"2023-06-10T18:52:43.517233+0000","last_peered":"2023-06-10T18:52:43.517233+0000","last_clean":"2023-06-10T18:52:43.517233+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:43.517233+0000","last_undegraded":"2023-06-10T18:52:43.517233+0000","last_fullsized":"2023-06-10T18:52:43.517233+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:43.517233+0000","last_change":"2023-06-10T18:52:43.517233+0000","last_active":"2023-06-10T18:52:43.517233+0000","last_peered":"2023-06-10T18:52:43.517233+0000","last_clean":"2023-06-10T18:52:43.517233+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:43.517233+0000","last_undegraded":"2023-06-10T18:52:43.517233+0000","last_fullsized":"2023-06-10T18:52:43.517233+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:43.517233+0000","last_change":"2023-06-10T18:52:43.517233+0000","last_active":"2023-06-10T18:52:43.517233+0000","last_peered":"2023-06-10T18:52:43.517233+0000","last_clean":"2023-06-10T18:52:43.517233+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:43.517233+0000","last_undegraded":"2023-06-10T18:52:43.517233+0000","last_fullsized":"2023-06-10T18:52:43.517233+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:43.517233+0000","last_change":"2023-06-10T18:52:43.517233+0000","last_active":"2023-06-10T18:52:43.517233+0000","last_peered":"2023-06-10T18:52:43.517233+0000","last_clean":"2023-06-10T18:52:43.517233+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:43.517233+0000","last_undegraded":"2023-06-10T18:52:43.517233+0000","last_fullsized":"2023-06-10T18:52:43.517233+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:43.517233+0000","last_change":"2023-06-10T18:52:43.517233+0000","last_active":"2023-06-10T18:52:43.517233+0000","last_peered":"2023-06-10T18:52:43.517233+0000","last_clean":"2023-06-10T18:52:43.517233+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:43.517233+0000","last_undegraded":"2023-06-10T18:52:43.517233+0000","last_fullsized":"2023-06-10T18:52:43.517233+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:43.517233+0000","last_change":"2023-06-10T18:52:43.517233+0000","last_active":"2023-06-10T18:52:43.517233+0000","last_peered":"2023-06-10T18:52:43.517233+0000","last_clean":"2023-06-10T18:52:43.517233+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:43.517233+0000","last_undegraded":"2023-06-10T18:52:43.517233+0000","last_fullsized":"2023-06-10T18:52:43.517233+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:43.517233+0000","last_change":"2023-06-10T18:52:43.517233+0000","last_active":"2023-06-10T18:52:43.517233+0000","last_peered":"2023-06-10T18:52:43.517233+0000","last_clean":"2023-06-10T18:52:43.517233+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:43.517233+0000","last_undegraded":"2023-06-10T18:52:43.517233+0000","last_fullsized":"2023-06-10T18:52:43.517233+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:43.517233+0000","last_change":"2023-06-10T18:52:43.517233+0000","last_active":"2023-06-10T18:52:43.517233+0000","last_peered":"2023-06-10T18:52:43.517233+0000","last_clean":"2023-06-10T18:52:43.517233+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:43.517233+0000","last_undegraded":"2023-06-10T18:52:43.517233+0000","last_fullsized":"2023-06-10T18:52:43.517233+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27720,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344120,"statfs":{"total":96636764160,"available":96608378880,"internally_reserved":0,"allocated":786432,"data_stored":653396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0109999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4470000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0549999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.53}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27128,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344712,"statfs":{"total":96636764160,"available":96608985088,"internally_reserved":0,"allocated":180224,"data_stored":57280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1279999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0980000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2849999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27128,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344712,"statfs":{"total":96636764160,"available":96608985088,"internally_reserved":0,"allocated":180224,"data_stored":57280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2809999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95299999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.073}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1439999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3120000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27140,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344700,"statfs":{"total":96636764160,"available":96608972800,"internally_reserved":0,"allocated":192512,"data_stored":63028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0249999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1200000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31220,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340620,"statfs":{"total":96636764160,"available":96604794880,"internally_reserved":0,"allocated":176128,"data_stored":56261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.371}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2789999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.236}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31224,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340616,"statfs":{"total":96636764160,"available":96604790784,"internally_reserved":0,"allocated":180224,"data_stored":57280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1180000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0309999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3759999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31232,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340608,"statfs":{"total":96636764160,"available":96604782592,"internally_reserved":0,"allocated":188416,"data_stored":62009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31812,"kb_used_data":764,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340028,"statfs":{"total":96636764160,"available":96604188672,"internally_reserved":0,"allocated":782336,"data_stored":652377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96199999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2829999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0580000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3560000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92600000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-10T18:52:48.961 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-10T18:52:49.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.116+0000 7f1307dfa640 1 Processor -- start 2023-06-10T18:52:49.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.116+0000 7f1307dfa640 1 -- start start 2023-06-10T18:52:49.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.116+0000 7f1307dfa640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f13000b3ac0 0x7f13000b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:49.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.116+0000 7f1307dfa640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13000cc690 0x7f130015f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:49.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.116+0000 7f1307dfa640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13000d0020 con 0x7f13000ccae0 2023-06-10T18:52:49.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.116+0000 7f1307dfa640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13000b43d0 con 0x7f13000b3ac0 2023-06-10T18:52:49.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.116+0000 7f1307dfa640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13000cef40 con 0x7f13000cc690 2023-06-10T18:52:49.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.116+0000 7f1305b96640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f13000b3ac0 0x7f13000b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:49.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.116+0000 7f1306397640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f13000ccae0 0x7f130015f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52856/0 (socket says 172.21.15.53:52856) 2023-06-10T18:52:49.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.116+0000 7f1305b96640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f13000b3ac0 0x7f13000b3e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56234/0 (socket says 172.21.15.53:56234) 2023-06-10T18:52:49.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.116+0000 7f1306397640 1 -- 172.21.15.53:0/2565055492 learned_addr learned my addr 172.21.15.53:0/2565055492 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:52:49.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.116+0000 7f1305395640 1 --2- 172.21.15.53:0/2565055492 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13000cc690 0x7f130015f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:49.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.116+0000 7f1305b96640 1 -- 172.21.15.53:0/2565055492 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13000cc690 msgr2=0x7f130015f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:49.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.116+0000 7f1305b96640 1 --2- 172.21.15.53:0/2565055492 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13000cc690 0x7f130015f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:49.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.116+0000 7f1305b96640 1 -- 172.21.15.53:0/2565055492 >> v1:172.21.15.53:6789/0 conn(0x7f13000ccae0 legacy=0x7f130015f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:49.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.116+0000 7f1305b96640 1 -- 172.21.15.53:0/2565055492 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13000cf220 con 0x7f13000b3ac0 2023-06-10T18:52:49.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.120+0000 7f1305b96640 1 --2- 172.21.15.53:0/2565055492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13000b3ac0 0x7f13000b3e90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f12fc009d90 tx=0x7f12fc01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e76a95dc6f82e6c0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:49.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.120+0000 7f1304b94640 1 -- 172.21.15.53:0/2565055492 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12fc0a58f0 con 0x7f13000b3ac0 2023-06-10T18:52:49.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.120+0000 7f1304b94640 1 -- 172.21.15.53:0/2565055492 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12fc0a5a50 con 0x7f13000b3ac0 2023-06-10T18:52:49.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.120+0000 7f1304b94640 1 -- 172.21.15.53:0/2565055492 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12fc0a5de0 con 0x7f13000b3ac0 2023-06-10T18:52:49.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.120+0000 7f1307dfa640 1 -- 172.21.15.53:0/2565055492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13000b3ac0 msgr2=0x7f13000b3e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:49.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.120+0000 7f1307dfa640 1 --2- 172.21.15.53:0/2565055492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13000b3ac0 0x7f13000b3e90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f12fc009d90 tx=0x7f12fc01c920 comp rx=0 tx=0).stop 2023-06-10T18:52:49.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.120+0000 7f1307dfa640 1 -- 172.21.15.53:0/2565055492 shutdown_connections 2023-06-10T18:52:49.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.120+0000 7f1307dfa640 1 --2- 172.21.15.53:0/2565055492 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13000cc690 0x7f130015f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:49.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.120+0000 7f1307dfa640 1 --2- 172.21.15.53:0/2565055492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13000b3ac0 0x7f13000b3e90 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:49.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.120+0000 7f1307dfa640 1 -- 172.21.15.53:0/2565055492 >> 172.21.15.53:0/2565055492 conn(0x7f1300071790 msgr2=0x7f1300069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:49.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.120+0000 7f1307dfa640 1 -- 172.21.15.53:0/2565055492 shutdown_connections 2023-06-10T18:52:49.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.120+0000 7f1307dfa640 1 -- 172.21.15.53:0/2565055492 wait complete. 2023-06-10T18:52:49.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.120+0000 7f1307dfa640 1 Processor -- start 2023-06-10T18:52:49.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.120+0000 7f1307dfa640 1 -- start start 2023-06-10T18:52:49.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.120+0000 7f1307dfa640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f13000b3ac0 0x7f13000cba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:49.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.120+0000 7f1307dfa640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13000cc690 0x7f130015e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:49.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.120+0000 7f1307dfa640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13000ccae0 0x7f13000ca120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:49.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.120+0000 7f1307dfa640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f130015ebc0 con 0x7f13000ccae0 2023-06-10T18:52:49.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.120+0000 7f1307dfa640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13000c9110 con 0x7f13000b3ac0 2023-06-10T18:52:49.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.120+0000 7f1307dfa640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13000c9c90 con 0x7f13000cc690 2023-06-10T18:52:49.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.120+0000 7f1306397640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13000ccae0 0x7f13000ca120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:49.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.120+0000 7f1306397640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13000ccae0 0x7f13000ca120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56242/0 (socket says 172.21.15.53:56242) 2023-06-10T18:52:49.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.120+0000 7f1306397640 1 -- 172.21.15.53:0/363227396 learned_addr learned my addr 172.21.15.53:0/363227396 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:49.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.124+0000 7f1305395640 1 --2- 172.21.15.53:0/363227396 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13000cc690 0x7f130015e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:49.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.124+0000 7f1305b96640 1 --2- 172.21.15.53:0/363227396 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f13000b3ac0 0x7f13000cba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:49.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.124+0000 7f1306397640 1 -- 172.21.15.53:0/363227396 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13000cc690 msgr2=0x7f130015e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:49.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.124+0000 7f1306397640 1 --2- 172.21.15.53:0/363227396 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13000cc690 0x7f130015e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:49.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.124+0000 7f1306397640 1 -- 172.21.15.53:0/363227396 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f13000b3ac0 msgr2=0x7f13000cba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:49.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.124+0000 7f1306397640 1 --2- 172.21.15.53:0/363227396 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f13000b3ac0 0x7f13000cba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:49.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.124+0000 7f1306397640 1 -- 172.21.15.53:0/363227396 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12fc009a70 con 0x7f13000ccae0 2023-06-10T18:52:49.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.124+0000 7f1305b96640 1 --2- 172.21.15.53:0/363227396 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f13000b3ac0 0x7f13000cba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:52:49.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.124+0000 7f1306397640 1 --2- 172.21.15.53:0/363227396 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13000ccae0 0x7f13000ca120 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f12f800c3f0 tx=0x7f12f800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:49.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.124+0000 7f12f67fc640 1 -- 172.21.15.53:0/363227396 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f8005cf0 con 0x7f13000ccae0 2023-06-10T18:52:49.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.124+0000 7f12f67fc640 1 -- 172.21.15.53:0/363227396 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12f8005e50 con 0x7f13000ccae0 2023-06-10T18:52:49.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.124+0000 7f12f67fc640 1 -- 172.21.15.53:0/363227396 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f80072f0 con 0x7f13000ccae0 2023-06-10T18:52:49.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.124+0000 7f1307dfa640 1 -- 172.21.15.53:0/363227396 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13000c9360 con 0x7f13000ccae0 2023-06-10T18:52:49.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.124+0000 7f1307dfa640 1 -- 172.21.15.53:0/363227396 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13000c9920 con 0x7f13000ccae0 2023-06-10T18:52:49.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.124+0000 7f1307dfa640 1 -- 172.21.15.53:0/363227396 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13000c9e20 con 0x7f13000ccae0 2023-06-10T18:52:49.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.124+0000 7f12f67fc640 1 -- 172.21.15.53:0/363227396 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f12f8007450 con 0x7f13000ccae0 2023-06-10T18:52:49.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.124+0000 7f12f67fc640 1 --2- 172.21.15.53:0/363227396 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f12e40662b0 0x7f12e4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:49.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.124+0000 7f12f67fc640 1 -- 172.21.15.53:0/363227396 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f12f8083210 con 0x7f13000ccae0 2023-06-10T18:52:49.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.124+0000 7f1305b96640 1 --2- 172.21.15.53:0/363227396 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f12e40662b0 0x7f12e4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:49.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.124+0000 7f1305b96640 1 --2- 172.21.15.53:0/363227396 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f12e40662b0 0x7f12e4068760 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f12fc0af000 tx=0x7f12fc0a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:49.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.128+0000 7f12f67fc640 1 -- 172.21.15.53:0/363227396 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f12f8050720 con 0x7f13000ccae0 2023-06-10T18:52:49.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.284+0000 7f1307dfa640 1 -- 172.21.15.53:0/363227396 --> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f13000b7a20 con 0x7f12e40662b0 2023-06-10T18:52:49.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.300+0000 7f12f67fc640 1 -- 172.21.15.53:0/363227396 <== mgr.4105 v2:172.21.15.117:6832/3061986771 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+271996 (secure 0 0 0) 0x7f12fc0a5d40 con 0x7f12e40662b0 2023-06-10T18:52:49.312 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:52:49.315 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-06-10T18:52:49.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.304+0000 7f1307dfa640 1 -- 172.21.15.53:0/363227396 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f12e40662b0 msgr2=0x7f12e4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:49.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.304+0000 7f1307dfa640 1 --2- 172.21.15.53:0/363227396 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f12e40662b0 0x7f12e4068760 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f12fc0af000 tx=0x7f12fc0a7070 comp rx=0 tx=0).stop 2023-06-10T18:52:49.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.304+0000 7f1307dfa640 1 -- 172.21.15.53:0/363227396 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13000ccae0 msgr2=0x7f13000ca120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:49.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.304+0000 7f1307dfa640 1 --2- 172.21.15.53:0/363227396 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13000ccae0 0x7f13000ca120 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f12f800c3f0 tx=0x7f12f800c8b0 comp rx=0 tx=0).stop 2023-06-10T18:52:49.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.308+0000 7f1307dfa640 1 -- 172.21.15.53:0/363227396 shutdown_connections 2023-06-10T18:52:49.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.308+0000 7f1307dfa640 1 --2- 172.21.15.53:0/363227396 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f12e40662b0 0x7f12e4068760 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:49.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.308+0000 7f1307dfa640 1 --2- 172.21.15.53:0/363227396 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13000ccae0 0x7f13000ca120 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:49.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.308+0000 7f1307dfa640 1 --2- 172.21.15.53:0/363227396 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13000cc690 0x7f130015e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:49.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.308+0000 7f1307dfa640 1 --2- 172.21.15.53:0/363227396 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f13000b3ac0 0x7f13000cba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:49.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.308+0000 7f1307dfa640 1 -- 172.21.15.53:0/363227396 >> 172.21.15.53:0/363227396 conn(0x7f1300071790 msgr2=0x7f13000b6d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:49.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.308+0000 7f1307dfa640 1 -- 172.21.15.53:0/363227396 shutdown_connections 2023-06-10T18:52:49.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.308+0000 7f1307dfa640 1 -- 172.21.15.53:0/363227396 wait complete. 2023-06-10T18:52:49.334 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-06-10T18:52:47.558729+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":234604,"kb_used_data":2604,"kb_used_omap":0,"kb_used_meta":231936,"kb_avail":754740116,"statfs":{"total":773094113280,"available":772853878784,"internally_reserved":0,"allocated":2666496,"data_stored":1658911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":237502464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.034847"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:43.517233+0000","last_change":"2023-06-10T18:52:43.517233+0000","last_active":"2023-06-10T18:52:43.517233+0000","last_peered":"2023-06-10T18:52:43.517233+0000","last_clean":"2023-06-10T18:52:43.517233+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:43.517233+0000","last_undegraded":"2023-06-10T18:52:43.517233+0000","last_fullsized":"2023-06-10T18:52:43.517233+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:43.517233+0000","last_change":"2023-06-10T18:52:43.517233+0000","last_active":"2023-06-10T18:52:43.517233+0000","last_peered":"2023-06-10T18:52:43.517233+0000","last_clean":"2023-06-10T18:52:43.517233+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:43.517233+0000","last_undegraded":"2023-06-10T18:52:43.517233+0000","last_fullsized":"2023-06-10T18:52:43.517233+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:43.517233+0000","last_change":"2023-06-10T18:52:43.517233+0000","last_active":"2023-06-10T18:52:43.517233+0000","last_peered":"2023-06-10T18:52:43.517233+0000","last_clean":"2023-06-10T18:52:43.517233+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:43.517233+0000","last_undegraded":"2023-06-10T18:52:43.517233+0000","last_fullsized":"2023-06-10T18:52:43.517233+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:43.517233+0000","last_change":"2023-06-10T18:52:43.517233+0000","last_active":"2023-06-10T18:52:43.517233+0000","last_peered":"2023-06-10T18:52:43.517233+0000","last_clean":"2023-06-10T18:52:43.517233+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:43.517233+0000","last_undegraded":"2023-06-10T18:52:43.517233+0000","last_fullsized":"2023-06-10T18:52:43.517233+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:43.517233+0000","last_change":"2023-06-10T18:52:43.517233+0000","last_active":"2023-06-10T18:52:43.517233+0000","last_peered":"2023-06-10T18:52:43.517233+0000","last_clean":"2023-06-10T18:52:43.517233+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:43.517233+0000","last_undegraded":"2023-06-10T18:52:43.517233+0000","last_fullsized":"2023-06-10T18:52:43.517233+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:43.517233+0000","last_change":"2023-06-10T18:52:43.517233+0000","last_active":"2023-06-10T18:52:43.517233+0000","last_peered":"2023-06-10T18:52:43.517233+0000","last_clean":"2023-06-10T18:52:43.517233+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:43.517233+0000","last_undegraded":"2023-06-10T18:52:43.517233+0000","last_fullsized":"2023-06-10T18:52:43.517233+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:43.517233+0000","last_change":"2023-06-10T18:52:43.517233+0000","last_active":"2023-06-10T18:52:43.517233+0000","last_peered":"2023-06-10T18:52:43.517233+0000","last_clean":"2023-06-10T18:52:43.517233+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:43.517233+0000","last_undegraded":"2023-06-10T18:52:43.517233+0000","last_fullsized":"2023-06-10T18:52:43.517233+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:43.517233+0000","last_change":"2023-06-10T18:52:43.517233+0000","last_active":"2023-06-10T18:52:43.517233+0000","last_peered":"2023-06-10T18:52:43.517233+0000","last_clean":"2023-06-10T18:52:43.517233+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:43.517233+0000","last_undegraded":"2023-06-10T18:52:43.517233+0000","last_fullsized":"2023-06-10T18:52:43.517233+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:43.517233+0000","last_change":"2023-06-10T18:52:43.517233+0000","last_active":"2023-06-10T18:52:43.517233+0000","last_peered":"2023-06-10T18:52:43.517233+0000","last_clean":"2023-06-10T18:52:43.517233+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:43.517233+0000","last_undegraded":"2023-06-10T18:52:43.517233+0000","last_fullsized":"2023-06-10T18:52:43.517233+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:43.517233+0000","last_change":"2023-06-10T18:52:43.517233+0000","last_active":"2023-06-10T18:52:43.517233+0000","last_peered":"2023-06-10T18:52:43.517233+0000","last_clean":"2023-06-10T18:52:43.517233+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:43.517233+0000","last_undegraded":"2023-06-10T18:52:43.517233+0000","last_fullsized":"2023-06-10T18:52:43.517233+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:43.517233+0000","last_change":"2023-06-10T18:52:43.517233+0000","last_active":"2023-06-10T18:52:43.517233+0000","last_peered":"2023-06-10T18:52:43.517233+0000","last_clean":"2023-06-10T18:52:43.517233+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:43.517233+0000","last_undegraded":"2023-06-10T18:52:43.517233+0000","last_fullsized":"2023-06-10T18:52:43.517233+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:43.517233+0000","last_change":"2023-06-10T18:52:43.517233+0000","last_active":"2023-06-10T18:52:43.517233+0000","last_peered":"2023-06-10T18:52:43.517233+0000","last_clean":"2023-06-10T18:52:43.517233+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:43.517233+0000","last_undegraded":"2023-06-10T18:52:43.517233+0000","last_fullsized":"2023-06-10T18:52:43.517233+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":167,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-06-10T18:52:41.752111+0000","last_change":"2023-06-10T18:52:34.951528+0000","last_active":"2023-06-10T18:52:41.752111+0000","last_peered":"2023-06-10T18:52:41.752111+0000","last_clean":"2023-06-10T18:52:41.752111+0000","last_became_active":"2023-06-10T18:52:34.949099+0000","last_became_peered":"2023-06-10T18:52:34.949099+0000","last_unstale":"2023-06-10T18:52:41.752111+0000","last_undegraded":"2023-06-10T18:52:41.752111+0000","last_fullsized":"2023-06-10T18:52:41.752111+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_clean_scrub_stamp":"2023-06-10T18:52:33.633295+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:48:51.704734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-06-10T18:52:42.370978+0000","last_change":"2023-06-10T18:52:40.506384+0000","last_active":"2023-06-10T18:52:42.370978+0000","last_peered":"2023-06-10T18:52:42.370978+0000","last_clean":"2023-06-10T18:52:42.370978+0000","last_became_active":"2023-06-10T18:52:40.505701+0000","last_became_peered":"2023-06-10T18:52:40.505701+0000","last_unstale":"2023-06-10T18:52:42.370978+0000","last_undegraded":"2023-06-10T18:52:42.370978+0000","last_fullsized":"2023-06-10T18:52:42.370978+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:54:21.690066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:43.517233+0000","last_change":"2023-06-10T18:52:43.517233+0000","last_active":"2023-06-10T18:52:43.517233+0000","last_peered":"2023-06-10T18:52:43.517233+0000","last_clean":"2023-06-10T18:52:43.517233+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:43.517233+0000","last_undegraded":"2023-06-10T18:52:43.517233+0000","last_fullsized":"2023-06-10T18:52:43.517233+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-06-10T18:52:41.752181+0000","last_change":"2023-06-10T18:52:40.512015+0000","last_active":"2023-06-10T18:52:41.752181+0000","last_peered":"2023-06-10T18:52:41.752181+0000","last_clean":"2023-06-10T18:52:41.752181+0000","last_became_active":"2023-06-10T18:52:40.511382+0000","last_became_peered":"2023-06-10T18:52:40.511382+0000","last_unstale":"2023-06-10T18:52:41.752181+0000","last_undegraded":"2023-06-10T18:52:41.752181+0000","last_fullsized":"2023-06-10T18:52:41.752181+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:43:06.477676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:43.517233+0000","last_change":"2023-06-10T18:52:43.517233+0000","last_active":"2023-06-10T18:52:43.517233+0000","last_peered":"2023-06-10T18:52:43.517233+0000","last_clean":"2023-06-10T18:52:43.517233+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:43.517233+0000","last_undegraded":"2023-06-10T18:52:43.517233+0000","last_fullsized":"2023-06-10T18:52:43.517233+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-06-10T18:52:42.370512+0000","last_change":"2023-06-10T18:52:40.671725+0000","last_active":"2023-06-10T18:52:42.370512+0000","last_peered":"2023-06-10T18:52:42.370512+0000","last_clean":"2023-06-10T18:52:42.370512+0000","last_became_active":"2023-06-10T18:52:40.671442+0000","last_became_peered":"2023-06-10T18:52:40.671442+0000","last_unstale":"2023-06-10T18:52:42.370512+0000","last_undegraded":"2023-06-10T18:52:42.370512+0000","last_fullsized":"2023-06-10T18:52:42.370512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:51:33.222135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:43.517233+0000","last_change":"2023-06-10T18:52:43.517233+0000","last_active":"2023-06-10T18:52:43.517233+0000","last_peered":"2023-06-10T18:52:43.517233+0000","last_clean":"2023-06-10T18:52:43.517233+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:43.517233+0000","last_undegraded":"2023-06-10T18:52:43.517233+0000","last_fullsized":"2023-06-10T18:52:43.517233+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-06-10T18:52:42.370885+0000","last_change":"2023-06-10T18:52:40.510258+0000","last_active":"2023-06-10T18:52:42.370885+0000","last_peered":"2023-06-10T18:52:42.370885+0000","last_clean":"2023-06-10T18:52:42.370885+0000","last_became_active":"2023-06-10T18:52:40.509560+0000","last_became_peered":"2023-06-10T18:52:40.509560+0000","last_unstale":"2023-06-10T18:52:42.370885+0000","last_undegraded":"2023-06-10T18:52:42.370885+0000","last_fullsized":"2023-06-10T18:52:42.370885+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:42:02.803050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:43.517233+0000","last_change":"2023-06-10T18:52:43.517233+0000","last_active":"2023-06-10T18:52:43.517233+0000","last_peered":"2023-06-10T18:52:43.517233+0000","last_clean":"2023-06-10T18:52:43.517233+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:43.517233+0000","last_undegraded":"2023-06-10T18:52:43.517233+0000","last_fullsized":"2023-06-10T18:52:43.517233+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:43.517233+0000","last_change":"2023-06-10T18:52:43.517233+0000","last_active":"2023-06-10T18:52:43.517233+0000","last_peered":"2023-06-10T18:52:43.517233+0000","last_clean":"2023-06-10T18:52:43.517233+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:43.517233+0000","last_undegraded":"2023-06-10T18:52:43.517233+0000","last_fullsized":"2023-06-10T18:52:43.517233+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-06-10T18:52:41.509447+0000","last_change":"2023-06-10T18:52:40.672266+0000","last_active":"2023-06-10T18:52:41.509447+0000","last_peered":"2023-06-10T18:52:41.509447+0000","last_clean":"2023-06-10T18:52:41.509447+0000","last_became_active":"2023-06-10T18:52:40.671966+0000","last_became_peered":"2023-06-10T18:52:40.671966+0000","last_unstale":"2023-06-10T18:52:41.509447+0000","last_undegraded":"2023-06-10T18:52:41.509447+0000","last_fullsized":"2023-06-10T18:52:41.509447+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:58:47.201807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:43.517233+0000","last_change":"2023-06-10T18:52:43.517233+0000","last_active":"2023-06-10T18:52:43.517233+0000","last_peered":"2023-06-10T18:52:43.517233+0000","last_clean":"2023-06-10T18:52:43.517233+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:43.517233+0000","last_undegraded":"2023-06-10T18:52:43.517233+0000","last_fullsized":"2023-06-10T18:52:43.517233+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-06-10T18:52:41.752257+0000","last_change":"2023-06-10T18:52:40.671084+0000","last_active":"2023-06-10T18:52:41.752257+0000","last_peered":"2023-06-10T18:52:41.752257+0000","last_clean":"2023-06-10T18:52:41.752257+0000","last_became_active":"2023-06-10T18:52:40.670697+0000","last_became_peered":"2023-06-10T18:52:40.670697+0000","last_unstale":"2023-06-10T18:52:41.752257+0000","last_undegraded":"2023-06-10T18:52:41.752257+0000","last_fullsized":"2023-06-10T18:52:41.752257+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:52:34.794241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:43.517233+0000","last_change":"2023-06-10T18:52:43.517233+0000","last_active":"2023-06-10T18:52:43.517233+0000","last_peered":"2023-06-10T18:52:43.517233+0000","last_clean":"2023-06-10T18:52:43.517233+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:43.517233+0000","last_undegraded":"2023-06-10T18:52:43.517233+0000","last_fullsized":"2023-06-10T18:52:43.517233+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-06-10T18:52:41.509516+0000","last_change":"2023-06-10T18:52:40.514114+0000","last_active":"2023-06-10T18:52:41.509516+0000","last_peered":"2023-06-10T18:52:41.509516+0000","last_clean":"2023-06-10T18:52:41.509516+0000","last_became_active":"2023-06-10T18:52:40.513638+0000","last_became_peered":"2023-06-10T18:52:40.513638+0000","last_unstale":"2023-06-10T18:52:41.509516+0000","last_undegraded":"2023-06-10T18:52:41.509516+0000","last_fullsized":"2023-06-10T18:52:41.509516+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:43:40.468614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:43.517233+0000","last_change":"2023-06-10T18:52:43.517233+0000","last_active":"2023-06-10T18:52:43.517233+0000","last_peered":"2023-06-10T18:52:43.517233+0000","last_clean":"2023-06-10T18:52:43.517233+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:43.517233+0000","last_undegraded":"2023-06-10T18:52:43.517233+0000","last_fullsized":"2023-06-10T18:52:43.517233+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-06-10T18:52:42.170932+0000","last_change":"2023-06-10T18:52:40.515396+0000","last_active":"2023-06-10T18:52:42.170932+0000","last_peered":"2023-06-10T18:52:42.170932+0000","last_clean":"2023-06-10T18:52:42.170932+0000","last_became_active":"2023-06-10T18:52:40.514663+0000","last_became_peered":"2023-06-10T18:52:40.514663+0000","last_unstale":"2023-06-10T18:52:42.170932+0000","last_undegraded":"2023-06-10T18:52:42.170932+0000","last_fullsized":"2023-06-10T18:52:42.170932+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:58:47.201807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:43.517233+0000","last_change":"2023-06-10T18:52:43.517233+0000","last_active":"2023-06-10T18:52:43.517233+0000","last_peered":"2023-06-10T18:52:43.517233+0000","last_clean":"2023-06-10T18:52:43.517233+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:43.517233+0000","last_undegraded":"2023-06-10T18:52:43.517233+0000","last_fullsized":"2023-06-10T18:52:43.517233+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:43.517233+0000","last_change":"2023-06-10T18:52:43.517233+0000","last_active":"2023-06-10T18:52:43.517233+0000","last_peered":"2023-06-10T18:52:43.517233+0000","last_clean":"2023-06-10T18:52:43.517233+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:43.517233+0000","last_undegraded":"2023-06-10T18:52:43.517233+0000","last_fullsized":"2023-06-10T18:52:43.517233+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:43.517233+0000","last_change":"2023-06-10T18:52:43.517233+0000","last_active":"2023-06-10T18:52:43.517233+0000","last_peered":"2023-06-10T18:52:43.517233+0000","last_clean":"2023-06-10T18:52:43.517233+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:43.517233+0000","last_undegraded":"2023-06-10T18:52:43.517233+0000","last_fullsized":"2023-06-10T18:52:43.517233+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:43.517233+0000","last_change":"2023-06-10T18:52:43.517233+0000","last_active":"2023-06-10T18:52:43.517233+0000","last_peered":"2023-06-10T18:52:43.517233+0000","last_clean":"2023-06-10T18:52:43.517233+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:43.517233+0000","last_undegraded":"2023-06-10T18:52:43.517233+0000","last_fullsized":"2023-06-10T18:52:43.517233+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:43.517233+0000","last_change":"2023-06-10T18:52:43.517233+0000","last_active":"2023-06-10T18:52:43.517233+0000","last_peered":"2023-06-10T18:52:43.517233+0000","last_clean":"2023-06-10T18:52:43.517233+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:43.517233+0000","last_undegraded":"2023-06-10T18:52:43.517233+0000","last_fullsized":"2023-06-10T18:52:43.517233+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:43.517233+0000","last_change":"2023-06-10T18:52:43.517233+0000","last_active":"2023-06-10T18:52:43.517233+0000","last_peered":"2023-06-10T18:52:43.517233+0000","last_clean":"2023-06-10T18:52:43.517233+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:43.517233+0000","last_undegraded":"2023-06-10T18:52:43.517233+0000","last_fullsized":"2023-06-10T18:52:43.517233+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:43.517233+0000","last_change":"2023-06-10T18:52:43.517233+0000","last_active":"2023-06-10T18:52:43.517233+0000","last_peered":"2023-06-10T18:52:43.517233+0000","last_clean":"2023-06-10T18:52:43.517233+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:43.517233+0000","last_undegraded":"2023-06-10T18:52:43.517233+0000","last_fullsized":"2023-06-10T18:52:43.517233+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:43.517233+0000","last_change":"2023-06-10T18:52:43.517233+0000","last_active":"2023-06-10T18:52:43.517233+0000","last_peered":"2023-06-10T18:52:43.517233+0000","last_clean":"2023-06-10T18:52:43.517233+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:43.517233+0000","last_undegraded":"2023-06-10T18:52:43.517233+0000","last_fullsized":"2023-06-10T18:52:43.517233+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:43.517233+0000","last_change":"2023-06-10T18:52:43.517233+0000","last_active":"2023-06-10T18:52:43.517233+0000","last_peered":"2023-06-10T18:52:43.517233+0000","last_clean":"2023-06-10T18:52:43.517233+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:43.517233+0000","last_undegraded":"2023-06-10T18:52:43.517233+0000","last_fullsized":"2023-06-10T18:52:43.517233+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:43.517233+0000","last_change":"2023-06-10T18:52:43.517233+0000","last_active":"2023-06-10T18:52:43.517233+0000","last_peered":"2023-06-10T18:52:43.517233+0000","last_clean":"2023-06-10T18:52:43.517233+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:43.517233+0000","last_undegraded":"2023-06-10T18:52:43.517233+0000","last_fullsized":"2023-06-10T18:52:43.517233+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:43.517233+0000","last_change":"2023-06-10T18:52:43.517233+0000","last_active":"2023-06-10T18:52:43.517233+0000","last_peered":"2023-06-10T18:52:43.517233+0000","last_clean":"2023-06-10T18:52:43.517233+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:43.517233+0000","last_undegraded":"2023-06-10T18:52:43.517233+0000","last_fullsized":"2023-06-10T18:52:43.517233+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:44.521236+0000","last_change":"2023-06-10T18:52:44.521236+0000","last_active":"2023-06-10T18:52:44.521236+0000","last_peered":"2023-06-10T18:52:44.521236+0000","last_clean":"2023-06-10T18:52:44.521236+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:44.521236+0000","last_undegraded":"2023-06-10T18:52:44.521236+0000","last_fullsized":"2023-06-10T18:52:44.521236+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:52:43.517233+0000","last_change":"2023-06-10T18:52:43.517233+0000","last_active":"2023-06-10T18:52:43.517233+0000","last_peered":"2023-06-10T18:52:43.517233+0000","last_clean":"2023-06-10T18:52:43.517233+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:52:43.517233+0000","last_undegraded":"2023-06-10T18:52:43.517233+0000","last_fullsized":"2023-06-10T18:52:43.517233+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27720,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344120,"statfs":{"total":96636764160,"available":96608378880,"internally_reserved":0,"allocated":786432,"data_stored":653396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0109999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4470000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0549999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.53}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27128,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344712,"statfs":{"total":96636764160,"available":96608985088,"internally_reserved":0,"allocated":180224,"data_stored":57280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1279999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0980000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2849999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27128,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344712,"statfs":{"total":96636764160,"available":96608985088,"internally_reserved":0,"allocated":180224,"data_stored":57280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2809999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95299999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.073}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1439999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3120000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27140,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344700,"statfs":{"total":96636764160,"available":96608972800,"internally_reserved":0,"allocated":192512,"data_stored":63028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0249999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1200000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31220,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340620,"statfs":{"total":96636764160,"available":96604794880,"internally_reserved":0,"allocated":176128,"data_stored":56261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.371}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2789999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.236}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31224,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340616,"statfs":{"total":96636764160,"available":96604790784,"internally_reserved":0,"allocated":180224,"data_stored":57280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1180000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0309999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3759999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31232,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340608,"statfs":{"total":96636764160,"available":96604782592,"internally_reserved":0,"allocated":188416,"data_stored":62009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31812,"kb_used_data":764,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340028,"statfs":{"total":96636764160,"available":96604188672,"internally_reserved":0,"allocated":782336,"data_stored":652377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96199999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2829999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0580000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3560000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92600000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-10T18:52:49.339 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-10T18:52:49.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.488+0000 7f898b85c640 1 Processor -- start 2023-06-10T18:52:49.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.488+0000 7f898b85c640 1 -- start start 2023-06-10T18:52:49.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.492+0000 7f898b85c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f89840afe30 0x7f898406efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:49.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.492+0000 7f898b85c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f898406bb30 0x7f89840ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:49.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.492+0000 7f898b85c640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89840c9e50 con 0x7f8984157e10 2023-06-10T18:52:49.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.492+0000 7f898b85c640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89840cd520 con 0x7f89840afe30 2023-06-10T18:52:49.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.492+0000 7f898b85c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f898406bf50 con 0x7f898406bb30 2023-06-10T18:52:49.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.492+0000 7f8989df9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f898406bb30 0x7f89840ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:49.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.492+0000 7f8989df9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f898406bb30 0x7f89840ccfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.53:39372/0 (socket says 172.21.15.53:39372) 2023-06-10T18:52:49.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.492+0000 7f8988df7640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f89840afe30 0x7f898406efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:49.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.492+0000 7f8989df9640 1 -- 172.21.15.53:0/1931299848 learned_addr learned my addr 172.21.15.53:0/1931299848 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:49.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.492+0000 7f8989df9640 1 -- 172.21.15.53:0/1931299848 >> v2:172.21.15.117:3300/0 conn(0x7f89840afe30 msgr2=0x7f898406efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:49.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.492+0000 7f8989df9640 1 --2- 172.21.15.53:0/1931299848 >> v2:172.21.15.117:3300/0 conn(0x7f89840afe30 0x7f898406efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:49.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.492+0000 7f8989df9640 1 -- 172.21.15.53:0/1931299848 >> v1:172.21.15.117:6789/0 conn(0x7f8984157e10 legacy=0x7f89840af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:49.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.492+0000 7f8989df9640 1 -- 172.21.15.53:0/1931299848 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89840c82f0 con 0x7f898406bb30 2023-06-10T18:52:49.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.496+0000 7f8989df9640 1 --2- 172.21.15.53:0/1931299848 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f898406bb30 0x7f89840ccfe0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f898000bb10 tx=0x7f898001eb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3883198cebf94706 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:49.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.496+0000 7f897bfff640 1 -- 172.21.15.53:0/1931299848 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89800a7ba0 con 0x7f898406bb30 2023-06-10T18:52:49.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.496+0000 7f897bfff640 1 -- 172.21.15.53:0/1931299848 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89800a7d00 con 0x7f898406bb30 2023-06-10T18:52:49.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.496+0000 7f897bfff640 1 -- 172.21.15.53:0/1931299848 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89800af660 con 0x7f898406bb30 2023-06-10T18:52:49.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.496+0000 7f898b85c640 1 -- 172.21.15.53:0/1931299848 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f898406bb30 msgr2=0x7f89840ccfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:49.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.496+0000 7f898b85c640 1 --2- 172.21.15.53:0/1931299848 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f898406bb30 0x7f89840ccfe0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f898000bb10 tx=0x7f898001eb50 comp rx=0 tx=0).stop 2023-06-10T18:52:49.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.496+0000 7f898b85c640 1 -- 172.21.15.53:0/1931299848 shutdown_connections 2023-06-10T18:52:49.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.496+0000 7f898b85c640 1 --2- 172.21.15.53:0/1931299848 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f898406bb30 0x7f89840ccfe0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:49.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.496+0000 7f898b85c640 1 --2- 172.21.15.53:0/1931299848 >> v2:172.21.15.117:3300/0 conn(0x7f89840afe30 0x7f898406efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:49.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.496+0000 7f898b85c640 1 -- 172.21.15.53:0/1931299848 >> 172.21.15.53:0/1931299848 conn(0x7f898406a0d0 msgr2=0x7f89840ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:49.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.496+0000 7f898b85c640 1 -- 172.21.15.53:0/1931299848 shutdown_connections 2023-06-10T18:52:49.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.496+0000 7f898b85c640 1 -- 172.21.15.53:0/1931299848 wait complete. 2023-06-10T18:52:49.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.496+0000 7f898b85c640 1 Processor -- start 2023-06-10T18:52:49.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.496+0000 7f898b85c640 1 -- start start 2023-06-10T18:52:49.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.496+0000 7f898b85c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f898406bb30 0x7f898414e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:49.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.496+0000 7f898b85c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89840afe30 0x7f898414d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:49.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.496+0000 7f898b85c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8984157e10 0x7f898415a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:49.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.496+0000 7f898b85c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89840b3ab0 con 0x7f89840afe30 2023-06-10T18:52:49.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.496+0000 7f898b85c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89840c40c0 con 0x7f8984157e10 2023-06-10T18:52:49.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.496+0000 7f898b85c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89840b1160 con 0x7f898406bb30 2023-06-10T18:52:49.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.496+0000 7f8988df7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89840afe30 0x7f898414d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:49.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.496+0000 7f8988df7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89840afe30 0x7f898414d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56256/0 (socket says 172.21.15.53:56256) 2023-06-10T18:52:49.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.496+0000 7f8988df7640 1 -- 172.21.15.53:0/1366750372 learned_addr learned my addr 172.21.15.53:0/1366750372 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:49.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.496+0000 7f89895f8640 1 --2- 172.21.15.53:0/1366750372 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f898406bb30 0x7f898414e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:49.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.496+0000 7f8989df9640 1 --2- 172.21.15.53:0/1366750372 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8984157e10 0x7f898415a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:49.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.496+0000 7f8988df7640 1 -- 172.21.15.53:0/1366750372 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f898406bb30 msgr2=0x7f898414e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:49.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.496+0000 7f8988df7640 1 --2- 172.21.15.53:0/1366750372 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f898406bb30 0x7f898414e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:49.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.496+0000 7f8988df7640 1 -- 172.21.15.53:0/1366750372 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8984157e10 msgr2=0x7f898415a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:49.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.496+0000 7f8988df7640 1 --2- 172.21.15.53:0/1366750372 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8984157e10 0x7f898415a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:49.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.496+0000 7f8988df7640 1 -- 172.21.15.53:0/1366750372 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f898000b770 con 0x7f89840afe30 2023-06-10T18:52:49.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.496+0000 7f8988df7640 1 --2- 172.21.15.53:0/1366750372 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89840afe30 0x7f898414d780 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f897400e900 tx=0x7f897400edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:49.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.500+0000 7f8979ffb640 1 -- 172.21.15.53:0/1366750372 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8974009690 con 0x7f89840afe30 2023-06-10T18:52:49.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.500+0000 7f8979ffb640 1 -- 172.21.15.53:0/1366750372 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f897400ca00 con 0x7f89840afe30 2023-06-10T18:52:49.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.500+0000 7f898b85c640 1 -- 172.21.15.53:0/1366750372 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89840b1440 con 0x7f89840afe30 2023-06-10T18:52:49.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.500+0000 7f8979ffb640 1 -- 172.21.15.53:0/1366750372 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897400cdb0 con 0x7f89840afe30 2023-06-10T18:52:49.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.500+0000 7f898b85c640 1 -- 172.21.15.53:0/1366750372 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f898414dcc0 con 0x7f89840afe30 2023-06-10T18:52:49.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.500+0000 7f898b85c640 1 -- 172.21.15.53:0/1366750372 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89840b0fc0 con 0x7f89840afe30 2023-06-10T18:52:49.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.500+0000 7f8979ffb640 1 -- 172.21.15.53:0/1366750372 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8974013470 con 0x7f89840afe30 2023-06-10T18:52:49.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.500+0000 7f8979ffb640 1 --2- 172.21.15.53:0/1366750372 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8968066280 0x7f8968068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:49.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.500+0000 7f8979ffb640 1 -- 172.21.15.53:0/1366750372 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8974083fb0 con 0x7f89840afe30 2023-06-10T18:52:49.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.500+0000 7f89895f8640 1 --2- 172.21.15.53:0/1366750372 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8968066280 0x7f8968068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:49.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.500+0000 7f89895f8640 1 --2- 172.21.15.53:0/1366750372 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8968066280 0x7f8968068730 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f897c0012f0 tx=0x7f897c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:49.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.504+0000 7f8979ffb640 1 -- 172.21.15.53:0/1366750372 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f89740b4700 con 0x7f89840afe30 2023-06-10T18:52:49.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.652+0000 7f898b85c640 1 -- 172.21.15.53:0/1366750372 --> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f89840b12d0 con 0x7f8968066280 2023-06-10T18:52:49.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.676+0000 7f8979ffb640 1 -- 172.21.15.53:0/1366750372 <== mgr.4105 v2:172.21.15.117:6832/3061986771 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286636 (secure 0 0 0) 0x7f89840b12d0 con 0x7f8968066280 2023-06-10T18:52:49.686 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:52:49.687 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-06-10T18:52:49.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.676+0000 7f898b85c640 1 -- 172.21.15.53:0/1366750372 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8968066280 msgr2=0x7f8968068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:49.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.676+0000 7f898b85c640 1 --2- 172.21.15.53:0/1366750372 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8968066280 0x7f8968068730 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f897c0012f0 tx=0x7f897c009040 comp rx=0 tx=0).stop 2023-06-10T18:52:49.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.676+0000 7f898b85c640 1 -- 172.21.15.53:0/1366750372 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89840afe30 msgr2=0x7f898414d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:49.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.676+0000 7f898b85c640 1 --2- 172.21.15.53:0/1366750372 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89840afe30 0x7f898414d780 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f897400e900 tx=0x7f897400edc0 comp rx=0 tx=0).stop 2023-06-10T18:52:49.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.676+0000 7f898b85c640 1 -- 172.21.15.53:0/1366750372 shutdown_connections 2023-06-10T18:52:49.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.676+0000 7f898b85c640 1 --2- 172.21.15.53:0/1366750372 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8968066280 0x7f8968068730 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:49.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.676+0000 7f898b85c640 1 --2- 172.21.15.53:0/1366750372 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8984157e10 0x7f898415a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:49.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.676+0000 7f898b85c640 1 --2- 172.21.15.53:0/1366750372 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89840afe30 0x7f898414d780 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:49.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.676+0000 7f898b85c640 1 --2- 172.21.15.53:0/1366750372 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f898406bb30 0x7f898414e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:49.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.676+0000 7f898b85c640 1 -- 172.21.15.53:0/1366750372 >> 172.21.15.53:0/1366750372 conn(0x7f898406a0d0 msgr2=0x7f89840cc360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:49.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.680+0000 7f898b85c640 1 -- 172.21.15.53:0/1366750372 shutdown_connections 2023-06-10T18:52:49.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.680+0000 7f898b85c640 1 -- 172.21.15.53:0/1366750372 wait complete. 2023-06-10T18:52:49.705 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-06-10T18:52:49.559373+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":173,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235052,"kb_used_data":3052,"kb_used_omap":0,"kb_used_meta":231936,"kb_avail":754739668,"statfs":{"total":773094113280,"available":772853420032,"internally_reserved":0,"allocated":3125248,"data_stored":1872583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":237502464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":54,"apply_latency_ms":54,"commit_latency_ns":54000000,"apply_latency_ns":54000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001839"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.093989+0000","last_change":"2023-06-10T18:52:44.947732+0000","last_active":"2023-06-10T18:52:47.093989+0000","last_peered":"2023-06-10T18:52:47.093989+0000","last_clean":"2023-06-10T18:52:47.093989+0000","last_became_active":"2023-06-10T18:52:44.947398+0000","last_became_peered":"2023-06-10T18:52:44.947398+0000","last_unstale":"2023-06-10T18:52:47.093989+0000","last_undegraded":"2023-06-10T18:52:47.093989+0000","last_fullsized":"2023-06-10T18:52:47.093989+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:06:36.663322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.935057+0000","last_change":"2023-06-10T18:52:44.961438+0000","last_active":"2023-06-10T18:52:45.935057+0000","last_peered":"2023-06-10T18:52:45.935057+0000","last_clean":"2023-06-10T18:52:45.935057+0000","last_became_active":"2023-06-10T18:52:44.961134+0000","last_became_peered":"2023-06-10T18:52:44.961134+0000","last_unstale":"2023-06-10T18:52:45.935057+0000","last_undegraded":"2023-06-10T18:52:45.935057+0000","last_fullsized":"2023-06-10T18:52:45.935057+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:49:49.618852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.931821+0000","last_change":"2023-06-10T18:52:44.955647+0000","last_active":"2023-06-10T18:52:45.931821+0000","last_peered":"2023-06-10T18:52:45.931821+0000","last_clean":"2023-06-10T18:52:45.931821+0000","last_became_active":"2023-06-10T18:52:44.955093+0000","last_became_peered":"2023-06-10T18:52:44.955093+0000","last_unstale":"2023-06-10T18:52:45.931821+0000","last_undegraded":"2023-06-10T18:52:45.931821+0000","last_fullsized":"2023-06-10T18:52:45.931821+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:37:28.673117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.095194+0000","last_change":"2023-06-10T18:52:44.940992+0000","last_active":"2023-06-10T18:52:47.095194+0000","last_peered":"2023-06-10T18:52:47.095194+0000","last_clean":"2023-06-10T18:52:47.095194+0000","last_became_active":"2023-06-10T18:52:44.940703+0000","last_became_peered":"2023-06-10T18:52:44.940703+0000","last_unstale":"2023-06-10T18:52:47.095194+0000","last_undegraded":"2023-06-10T18:52:47.095194+0000","last_fullsized":"2023-06-10T18:52:47.095194+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:17:13.902888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.074101+0000","last_change":"2023-06-10T18:52:44.954034+0000","last_active":"2023-06-10T18:52:47.074101+0000","last_peered":"2023-06-10T18:52:47.074101+0000","last_clean":"2023-06-10T18:52:47.074101+0000","last_became_active":"2023-06-10T18:52:44.953626+0000","last_became_peered":"2023-06-10T18:52:44.953626+0000","last_unstale":"2023-06-10T18:52:47.074101+0000","last_undegraded":"2023-06-10T18:52:47.074101+0000","last_fullsized":"2023-06-10T18:52:47.074101+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:41:13.376627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.932554+0000","last_change":"2023-06-10T18:52:44.944206+0000","last_active":"2023-06-10T18:52:45.932554+0000","last_peered":"2023-06-10T18:52:45.932554+0000","last_clean":"2023-06-10T18:52:45.932554+0000","last_became_active":"2023-06-10T18:52:44.943687+0000","last_became_peered":"2023-06-10T18:52:44.943687+0000","last_unstale":"2023-06-10T18:52:45.932554+0000","last_undegraded":"2023-06-10T18:52:45.932554+0000","last_fullsized":"2023-06-10T18:52:45.932554+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:02:43.231973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.095766+0000","last_change":"2023-06-10T18:52:44.958696+0000","last_active":"2023-06-10T18:52:47.095766+0000","last_peered":"2023-06-10T18:52:47.095766+0000","last_clean":"2023-06-10T18:52:47.095766+0000","last_became_active":"2023-06-10T18:52:44.958075+0000","last_became_peered":"2023-06-10T18:52:44.958075+0000","last_unstale":"2023-06-10T18:52:47.095766+0000","last_undegraded":"2023-06-10T18:52:47.095766+0000","last_fullsized":"2023-06-10T18:52:47.095766+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T18:54:16.713072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.934329+0000","last_change":"2023-06-10T18:52:44.945375+0000","last_active":"2023-06-10T18:52:45.934329+0000","last_peered":"2023-06-10T18:52:45.934329+0000","last_clean":"2023-06-10T18:52:45.934329+0000","last_became_active":"2023-06-10T18:52:44.945059+0000","last_became_peered":"2023-06-10T18:52:44.945059+0000","last_unstale":"2023-06-10T18:52:45.934329+0000","last_undegraded":"2023-06-10T18:52:45.934329+0000","last_fullsized":"2023-06-10T18:52:45.934329+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:59:51.325397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.073399+0000","last_change":"2023-06-10T18:52:44.960556+0000","last_active":"2023-06-10T18:52:47.073399+0000","last_peered":"2023-06-10T18:52:47.073399+0000","last_clean":"2023-06-10T18:52:47.073399+0000","last_became_active":"2023-06-10T18:52:44.960174+0000","last_became_peered":"2023-06-10T18:52:44.960174+0000","last_unstale":"2023-06-10T18:52:47.073399+0000","last_undegraded":"2023-06-10T18:52:47.073399+0000","last_fullsized":"2023-06-10T18:52:47.073399+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:53:28.618960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.935372+0000","last_change":"2023-06-10T18:52:44.961025+0000","last_active":"2023-06-10T18:52:45.935372+0000","last_peered":"2023-06-10T18:52:45.935372+0000","last_clean":"2023-06-10T18:52:45.935372+0000","last_became_active":"2023-06-10T18:52:44.960661+0000","last_became_peered":"2023-06-10T18:52:44.960661+0000","last_unstale":"2023-06-10T18:52:45.935372+0000","last_undegraded":"2023-06-10T18:52:45.935372+0000","last_fullsized":"2023-06-10T18:52:45.935372+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:02:43.231973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.932039+0000","last_change":"2023-06-10T18:52:44.958300+0000","last_active":"2023-06-10T18:52:45.932039+0000","last_peered":"2023-06-10T18:52:45.932039+0000","last_clean":"2023-06-10T18:52:45.932039+0000","last_became_active":"2023-06-10T18:52:44.958013+0000","last_became_peered":"2023-06-10T18:52:44.958013+0000","last_unstale":"2023-06-10T18:52:45.932039+0000","last_undegraded":"2023-06-10T18:52:45.932039+0000","last_fullsized":"2023-06-10T18:52:45.932039+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:39:10.018608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.094202+0000","last_change":"2023-06-10T18:52:44.951808+0000","last_active":"2023-06-10T18:52:47.094202+0000","last_peered":"2023-06-10T18:52:47.094202+0000","last_clean":"2023-06-10T18:52:47.094202+0000","last_became_active":"2023-06-10T18:52:44.951348+0000","last_became_peered":"2023-06-10T18:52:44.951348+0000","last_unstale":"2023-06-10T18:52:47.094202+0000","last_undegraded":"2023-06-10T18:52:47.094202+0000","last_fullsized":"2023-06-10T18:52:47.094202+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:41:10.737097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.093897+0000","last_change":"2023-06-10T18:52:44.941608+0000","last_active":"2023-06-10T18:52:47.093897+0000","last_peered":"2023-06-10T18:52:47.093897+0000","last_clean":"2023-06-10T18:52:47.093897+0000","last_became_active":"2023-06-10T18:52:44.941232+0000","last_became_peered":"2023-06-10T18:52:44.941232+0000","last_unstale":"2023-06-10T18:52:47.093897+0000","last_undegraded":"2023-06-10T18:52:47.093897+0000","last_fullsized":"2023-06-10T18:52:47.093897+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:34:30.103416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.935166+0000","last_change":"2023-06-10T18:52:44.946464+0000","last_active":"2023-06-10T18:52:45.935166+0000","last_peered":"2023-06-10T18:52:45.935166+0000","last_clean":"2023-06-10T18:52:45.935166+0000","last_became_active":"2023-06-10T18:52:44.946097+0000","last_became_peered":"2023-06-10T18:52:44.946097+0000","last_unstale":"2023-06-10T18:52:45.935166+0000","last_undegraded":"2023-06-10T18:52:45.935166+0000","last_fullsized":"2023-06-10T18:52:45.935166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:37:26.347275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.096155+0000","last_change":"2023-06-10T18:52:44.958946+0000","last_active":"2023-06-10T18:52:47.096155+0000","last_peered":"2023-06-10T18:52:47.096155+0000","last_clean":"2023-06-10T18:52:47.096155+0000","last_became_active":"2023-06-10T18:52:44.958439+0000","last_became_peered":"2023-06-10T18:52:44.958439+0000","last_unstale":"2023-06-10T18:52:47.096155+0000","last_undegraded":"2023-06-10T18:52:47.096155+0000","last_fullsized":"2023-06-10T18:52:47.096155+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:14:11.506328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.931732+0000","last_change":"2023-06-10T18:52:44.946069+0000","last_active":"2023-06-10T18:52:45.931732+0000","last_peered":"2023-06-10T18:52:45.931732+0000","last_clean":"2023-06-10T18:52:45.931732+0000","last_became_active":"2023-06-10T18:52:44.945560+0000","last_became_peered":"2023-06-10T18:52:44.945560+0000","last_unstale":"2023-06-10T18:52:45.931732+0000","last_undegraded":"2023-06-10T18:52:45.931732+0000","last_fullsized":"2023-06-10T18:52:45.931732+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:08:50.331605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.073341+0000","last_change":"2023-06-10T18:52:44.961858+0000","last_active":"2023-06-10T18:52:47.073341+0000","last_peered":"2023-06-10T18:52:47.073341+0000","last_clean":"2023-06-10T18:52:47.073341+0000","last_became_active":"2023-06-10T18:52:44.961540+0000","last_became_peered":"2023-06-10T18:52:44.961540+0000","last_unstale":"2023-06-10T18:52:47.073341+0000","last_undegraded":"2023-06-10T18:52:47.073341+0000","last_fullsized":"2023-06-10T18:52:47.073341+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:08:50.331605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.932034+0000","last_change":"2023-06-10T18:52:44.939005+0000","last_active":"2023-06-10T18:52:45.932034+0000","last_peered":"2023-06-10T18:52:45.932034+0000","last_clean":"2023-06-10T18:52:45.932034+0000","last_became_active":"2023-06-10T18:52:44.938775+0000","last_became_peered":"2023-06-10T18:52:44.938775+0000","last_unstale":"2023-06-10T18:52:45.932034+0000","last_undegraded":"2023-06-10T18:52:45.932034+0000","last_fullsized":"2023-06-10T18:52:45.932034+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:42:51.947168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.094083+0000","last_change":"2023-06-10T18:52:44.941417+0000","last_active":"2023-06-10T18:52:47.094083+0000","last_peered":"2023-06-10T18:52:47.094083+0000","last_clean":"2023-06-10T18:52:47.094083+0000","last_became_active":"2023-06-10T18:52:44.940980+0000","last_became_peered":"2023-06-10T18:52:44.940980+0000","last_unstale":"2023-06-10T18:52:47.094083+0000","last_undegraded":"2023-06-10T18:52:47.094083+0000","last_fullsized":"2023-06-10T18:52:47.094083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:33:22.583233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.932218+0000","last_change":"2023-06-10T18:52:44.944705+0000","last_active":"2023-06-10T18:52:45.932218+0000","last_peered":"2023-06-10T18:52:45.932218+0000","last_clean":"2023-06-10T18:52:45.932218+0000","last_became_active":"2023-06-10T18:52:44.944399+0000","last_became_peered":"2023-06-10T18:52:44.944399+0000","last_unstale":"2023-06-10T18:52:45.932218+0000","last_undegraded":"2023-06-10T18:52:45.932218+0000","last_fullsized":"2023-06-10T18:52:45.932218+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:39:06.207720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.096145+0000","last_change":"2023-06-10T18:52:44.959863+0000","last_active":"2023-06-10T18:52:47.096145+0000","last_peered":"2023-06-10T18:52:47.096145+0000","last_clean":"2023-06-10T18:52:47.096145+0000","last_became_active":"2023-06-10T18:52:44.959556+0000","last_became_peered":"2023-06-10T18:52:44.959556+0000","last_unstale":"2023-06-10T18:52:47.096145+0000","last_undegraded":"2023-06-10T18:52:47.096145+0000","last_fullsized":"2023-06-10T18:52:47.096145+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:02:43.231973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.073202+0000","last_change":"2023-06-10T18:52:44.961343+0000","last_active":"2023-06-10T18:52:47.073202+0000","last_peered":"2023-06-10T18:52:47.073202+0000","last_clean":"2023-06-10T18:52:47.073202+0000","last_became_active":"2023-06-10T18:52:44.960957+0000","last_became_peered":"2023-06-10T18:52:44.960957+0000","last_unstale":"2023-06-10T18:52:47.073202+0000","last_undegraded":"2023-06-10T18:52:47.073202+0000","last_fullsized":"2023-06-10T18:52:47.073202+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:54:34.871667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.929467+0000","last_change":"2023-06-10T18:52:44.952488+0000","last_active":"2023-06-10T18:52:45.929467+0000","last_peered":"2023-06-10T18:52:45.929467+0000","last_clean":"2023-06-10T18:52:45.929467+0000","last_became_active":"2023-06-10T18:52:44.951957+0000","last_became_peered":"2023-06-10T18:52:44.951957+0000","last_unstale":"2023-06-10T18:52:45.929467+0000","last_undegraded":"2023-06-10T18:52:45.929467+0000","last_fullsized":"2023-06-10T18:52:45.929467+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:31:20.946172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.094882+0000","last_change":"2023-06-10T18:52:44.960097+0000","last_active":"2023-06-10T18:52:47.094882+0000","last_peered":"2023-06-10T18:52:47.094882+0000","last_clean":"2023-06-10T18:52:47.094882+0000","last_became_active":"2023-06-10T18:52:44.959605+0000","last_became_peered":"2023-06-10T18:52:44.959605+0000","last_unstale":"2023-06-10T18:52:47.094882+0000","last_undegraded":"2023-06-10T18:52:47.094882+0000","last_fullsized":"2023-06-10T18:52:47.094882+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:08:04.480136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.095654+0000","last_change":"2023-06-10T18:52:44.956446+0000","last_active":"2023-06-10T18:52:47.095654+0000","last_peered":"2023-06-10T18:52:47.095654+0000","last_clean":"2023-06-10T18:52:47.095654+0000","last_became_active":"2023-06-10T18:52:44.954175+0000","last_became_peered":"2023-06-10T18:52:44.954175+0000","last_unstale":"2023-06-10T18:52:47.095654+0000","last_undegraded":"2023-06-10T18:52:47.095654+0000","last_fullsized":"2023-06-10T18:52:47.095654+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T18:54:16.713072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.095401+0000","last_change":"2023-06-10T18:52:44.956942+0000","last_active":"2023-06-10T18:52:47.095401+0000","last_peered":"2023-06-10T18:52:47.095401+0000","last_clean":"2023-06-10T18:52:47.095401+0000","last_became_active":"2023-06-10T18:52:44.953322+0000","last_became_peered":"2023-06-10T18:52:44.953322+0000","last_unstale":"2023-06-10T18:52:47.095401+0000","last_undegraded":"2023-06-10T18:52:47.095401+0000","last_fullsized":"2023-06-10T18:52:47.095401+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:39:10.018608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.934856+0000","last_change":"2023-06-10T18:52:44.942786+0000","last_active":"2023-06-10T18:52:45.934856+0000","last_peered":"2023-06-10T18:52:45.934856+0000","last_clean":"2023-06-10T18:52:45.934856+0000","last_became_active":"2023-06-10T18:52:44.942216+0000","last_became_peered":"2023-06-10T18:52:44.942216+0000","last_unstale":"2023-06-10T18:52:45.934856+0000","last_undegraded":"2023-06-10T18:52:45.934856+0000","last_fullsized":"2023-06-10T18:52:45.934856+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:08:04.480136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.095440+0000","last_change":"2023-06-10T18:52:44.958527+0000","last_active":"2023-06-10T18:52:47.095440+0000","last_peered":"2023-06-10T18:52:47.095440+0000","last_clean":"2023-06-10T18:52:47.095440+0000","last_became_active":"2023-06-10T18:52:44.958233+0000","last_became_peered":"2023-06-10T18:52:44.958233+0000","last_unstale":"2023-06-10T18:52:47.095440+0000","last_undegraded":"2023-06-10T18:52:47.095440+0000","last_fullsized":"2023-06-10T18:52:47.095440+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:08:04.480136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.930241+0000","last_change":"2023-06-10T18:52:44.946412+0000","last_active":"2023-06-10T18:52:45.930241+0000","last_peered":"2023-06-10T18:52:45.930241+0000","last_clean":"2023-06-10T18:52:45.930241+0000","last_became_active":"2023-06-10T18:52:44.945955+0000","last_became_peered":"2023-06-10T18:52:44.945955+0000","last_unstale":"2023-06-10T18:52:45.930241+0000","last_undegraded":"2023-06-10T18:52:45.930241+0000","last_fullsized":"2023-06-10T18:52:45.930241+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:08:04.480136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.932719+0000","last_change":"2023-06-10T18:52:44.942149+0000","last_active":"2023-06-10T18:52:45.932719+0000","last_peered":"2023-06-10T18:52:45.932719+0000","last_clean":"2023-06-10T18:52:45.932719+0000","last_became_active":"2023-06-10T18:52:44.939204+0000","last_became_peered":"2023-06-10T18:52:44.939204+0000","last_unstale":"2023-06-10T18:52:45.932719+0000","last_undegraded":"2023-06-10T18:52:45.932719+0000","last_fullsized":"2023-06-10T18:52:45.932719+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:14:11.506328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.929536+0000","last_change":"2023-06-10T18:52:44.960157+0000","last_active":"2023-06-10T18:52:45.929536+0000","last_peered":"2023-06-10T18:52:45.929536+0000","last_clean":"2023-06-10T18:52:45.929536+0000","last_became_active":"2023-06-10T18:52:44.959460+0000","last_became_peered":"2023-06-10T18:52:44.959460+0000","last_unstale":"2023-06-10T18:52:45.929536+0000","last_undegraded":"2023-06-10T18:52:45.929536+0000","last_fullsized":"2023-06-10T18:52:45.929536+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:53:28.618960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.094637+0000","last_change":"2023-06-10T18:52:44.937198+0000","last_active":"2023-06-10T18:52:47.094637+0000","last_peered":"2023-06-10T18:52:47.094637+0000","last_clean":"2023-06-10T18:52:47.094637+0000","last_became_active":"2023-06-10T18:52:44.936793+0000","last_became_peered":"2023-06-10T18:52:44.936793+0000","last_unstale":"2023-06-10T18:52:47.094637+0000","last_undegraded":"2023-06-10T18:52:47.094637+0000","last_fullsized":"2023-06-10T18:52:47.094637+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:46:29.935621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.929593+0000","last_change":"2023-06-10T18:52:44.955794+0000","last_active":"2023-06-10T18:52:45.929593+0000","last_peered":"2023-06-10T18:52:45.929593+0000","last_clean":"2023-06-10T18:52:45.929593+0000","last_became_active":"2023-06-10T18:52:44.955013+0000","last_became_peered":"2023-06-10T18:52:44.955013+0000","last_unstale":"2023-06-10T18:52:45.929593+0000","last_undegraded":"2023-06-10T18:52:45.929593+0000","last_fullsized":"2023-06-10T18:52:45.929593+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:37:28.673117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.096398+0000","last_change":"2023-06-10T18:52:44.586121+0000","last_active":"2023-06-10T18:52:47.096398+0000","last_peered":"2023-06-10T18:52:47.096398+0000","last_clean":"2023-06-10T18:52:47.096398+0000","last_became_active":"2023-06-10T18:52:44.584334+0000","last_became_peered":"2023-06-10T18:52:44.584334+0000","last_unstale":"2023-06-10T18:52:47.096398+0000","last_undegraded":"2023-06-10T18:52:47.096398+0000","last_fullsized":"2023-06-10T18:52:47.096398+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:44:27.810129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.934843+0000","last_change":"2023-06-10T18:52:44.942980+0000","last_active":"2023-06-10T18:52:45.934843+0000","last_peered":"2023-06-10T18:52:45.934843+0000","last_clean":"2023-06-10T18:52:45.934843+0000","last_became_active":"2023-06-10T18:52:44.942538+0000","last_became_peered":"2023-06-10T18:52:44.942538+0000","last_unstale":"2023-06-10T18:52:45.934843+0000","last_undegraded":"2023-06-10T18:52:45.934843+0000","last_fullsized":"2023-06-10T18:52:45.934843+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:39:06.207720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.073250+0000","last_change":"2023-06-10T18:52:44.573070+0000","last_active":"2023-06-10T18:52:47.073250+0000","last_peered":"2023-06-10T18:52:47.073250+0000","last_clean":"2023-06-10T18:52:47.073250+0000","last_became_active":"2023-06-10T18:52:44.572659+0000","last_became_peered":"2023-06-10T18:52:44.572659+0000","last_unstale":"2023-06-10T18:52:47.073250+0000","last_undegraded":"2023-06-10T18:52:47.073250+0000","last_fullsized":"2023-06-10T18:52:47.073250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:31:19.942168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.073865+0000","last_change":"2023-06-10T18:52:44.966527+0000","last_active":"2023-06-10T18:52:47.073865+0000","last_peered":"2023-06-10T18:52:47.073865+0000","last_clean":"2023-06-10T18:52:47.073865+0000","last_became_active":"2023-06-10T18:52:44.962455+0000","last_became_peered":"2023-06-10T18:52:44.962455+0000","last_unstale":"2023-06-10T18:52:47.073865+0000","last_undegraded":"2023-06-10T18:52:47.073865+0000","last_fullsized":"2023-06-10T18:52:47.073865+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:39:06.207720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.096102+0000","last_change":"2023-06-10T18:52:44.584545+0000","last_active":"2023-06-10T18:52:47.096102+0000","last_peered":"2023-06-10T18:52:47.096102+0000","last_clean":"2023-06-10T18:52:47.096102+0000","last_became_active":"2023-06-10T18:52:44.583973+0000","last_became_peered":"2023-06-10T18:52:44.583973+0000","last_unstale":"2023-06-10T18:52:47.096102+0000","last_undegraded":"2023-06-10T18:52:47.096102+0000","last_fullsized":"2023-06-10T18:52:47.096102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:37:25.343271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.929677+0000","last_change":"2023-06-10T18:52:44.946578+0000","last_active":"2023-06-10T18:52:45.929677+0000","last_peered":"2023-06-10T18:52:45.929677+0000","last_clean":"2023-06-10T18:52:45.929677+0000","last_became_active":"2023-06-10T18:52:44.945951+0000","last_became_peered":"2023-06-10T18:52:44.945951+0000","last_unstale":"2023-06-10T18:52:45.929677+0000","last_undegraded":"2023-06-10T18:52:45.929677+0000","last_fullsized":"2023-06-10T18:52:45.929677+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:59:51.325397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.094726+0000","last_change":"2023-06-10T18:52:44.556644+0000","last_active":"2023-06-10T18:52:47.094726+0000","last_peered":"2023-06-10T18:52:47.094726+0000","last_clean":"2023-06-10T18:52:47.094726+0000","last_became_active":"2023-06-10T18:52:44.554676+0000","last_became_peered":"2023-06-10T18:52:44.554676+0000","last_unstale":"2023-06-10T18:52:47.094726+0000","last_undegraded":"2023-06-10T18:52:47.094726+0000","last_fullsized":"2023-06-10T18:52:47.094726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:39:58.210679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.096897+0000","last_change":"2023-06-10T18:52:44.586426+0000","last_active":"2023-06-10T18:52:47.096897+0000","last_peered":"2023-06-10T18:52:47.096897+0000","last_clean":"2023-06-10T18:52:47.096897+0000","last_became_active":"2023-06-10T18:52:44.585486+0000","last_became_peered":"2023-06-10T18:52:44.585486+0000","last_unstale":"2023-06-10T18:52:47.096897+0000","last_undegraded":"2023-06-10T18:52:47.096897+0000","last_fullsized":"2023-06-10T18:52:47.096897+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:21:48.058795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.934330+0000","last_change":"2023-06-10T18:52:44.948157+0000","last_active":"2023-06-10T18:52:45.934330+0000","last_peered":"2023-06-10T18:52:45.934330+0000","last_clean":"2023-06-10T18:52:45.934330+0000","last_became_active":"2023-06-10T18:52:44.947864+0000","last_became_peered":"2023-06-10T18:52:44.947864+0000","last_unstale":"2023-06-10T18:52:45.934330+0000","last_undegraded":"2023-06-10T18:52:45.934330+0000","last_fullsized":"2023-06-10T18:52:45.934330+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:42:51.947168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.096656+0000","last_change":"2023-06-10T18:52:44.585679+0000","last_active":"2023-06-10T18:52:47.096656+0000","last_peered":"2023-06-10T18:52:47.096656+0000","last_clean":"2023-06-10T18:52:47.096656+0000","last_became_active":"2023-06-10T18:52:44.585190+0000","last_became_peered":"2023-06-10T18:52:44.585190+0000","last_unstale":"2023-06-10T18:52:47.096656+0000","last_undegraded":"2023-06-10T18:52:47.096656+0000","last_fullsized":"2023-06-10T18:52:47.096656+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:28:02.644430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.932803+0000","last_change":"2023-06-10T18:52:44.958947+0000","last_active":"2023-06-10T18:52:45.932803+0000","last_peered":"2023-06-10T18:52:45.932803+0000","last_clean":"2023-06-10T18:52:45.932803+0000","last_became_active":"2023-06-10T18:52:44.958289+0000","last_became_peered":"2023-06-10T18:52:44.958289+0000","last_unstale":"2023-06-10T18:52:45.932803+0000","last_undegraded":"2023-06-10T18:52:45.932803+0000","last_fullsized":"2023-06-10T18:52:45.932803+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:34:51.394045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.096353+0000","last_change":"2023-06-10T18:52:44.581981+0000","last_active":"2023-06-10T18:52:47.096353+0000","last_peered":"2023-06-10T18:52:47.096353+0000","last_clean":"2023-06-10T18:52:47.096353+0000","last_became_active":"2023-06-10T18:52:44.581382+0000","last_became_peered":"2023-06-10T18:52:44.581382+0000","last_unstale":"2023-06-10T18:52:47.096353+0000","last_undegraded":"2023-06-10T18:52:47.096353+0000","last_fullsized":"2023-06-10T18:52:47.096353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:34:50.390041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.094856+0000","last_change":"2023-06-10T18:52:44.958474+0000","last_active":"2023-06-10T18:52:47.094856+0000","last_peered":"2023-06-10T18:52:47.094856+0000","last_clean":"2023-06-10T18:52:47.094856+0000","last_became_active":"2023-06-10T18:52:44.958186+0000","last_became_peered":"2023-06-10T18:52:44.958186+0000","last_unstale":"2023-06-10T18:52:47.094856+0000","last_undegraded":"2023-06-10T18:52:47.094856+0000","last_fullsized":"2023-06-10T18:52:47.094856+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:38:29.923050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.934807+0000","last_change":"2023-06-10T18:52:44.559256+0000","last_active":"2023-06-10T18:52:45.934807+0000","last_peered":"2023-06-10T18:52:45.934807+0000","last_clean":"2023-06-10T18:52:45.934807+0000","last_became_active":"2023-06-10T18:52:44.558447+0000","last_became_peered":"2023-06-10T18:52:44.558447+0000","last_unstale":"2023-06-10T18:52:45.934807+0000","last_undegraded":"2023-06-10T18:52:45.934807+0000","last_fullsized":"2023-06-10T18:52:45.934807+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:39:09.014604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.073739+0000","last_change":"2023-06-10T18:52:44.962607+0000","last_active":"2023-06-10T18:52:47.073739+0000","last_peered":"2023-06-10T18:52:47.073739+0000","last_clean":"2023-06-10T18:52:47.073739+0000","last_became_active":"2023-06-10T18:52:44.962105+0000","last_became_peered":"2023-06-10T18:52:44.962105+0000","last_unstale":"2023-06-10T18:52:47.073739+0000","last_undegraded":"2023-06-10T18:52:47.073739+0000","last_fullsized":"2023-06-10T18:52:47.073739+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:39:10.888321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.930610+0000","last_change":"2023-06-10T18:52:44.559397+0000","last_active":"2023-06-10T18:52:45.930610+0000","last_peered":"2023-06-10T18:52:45.930610+0000","last_clean":"2023-06-10T18:52:45.930610+0000","last_became_active":"2023-06-10T18:52:44.558955+0000","last_became_peered":"2023-06-10T18:52:44.558955+0000","last_unstale":"2023-06-10T18:52:45.930610+0000","last_undegraded":"2023-06-10T18:52:45.930610+0000","last_fullsized":"2023-06-10T18:52:45.930610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:49:48.614848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.931811+0000","last_change":"2023-06-10T18:52:44.955143+0000","last_active":"2023-06-10T18:52:45.931811+0000","last_peered":"2023-06-10T18:52:45.931811+0000","last_clean":"2023-06-10T18:52:45.931811+0000","last_became_active":"2023-06-10T18:52:44.954157+0000","last_became_peered":"2023-06-10T18:52:44.954157+0000","last_unstale":"2023-06-10T18:52:45.931811+0000","last_undegraded":"2023-06-10T18:52:45.931811+0000","last_fullsized":"2023-06-10T18:52:45.931811+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:53:28.618960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.095432+0000","last_change":"2023-06-10T18:52:44.575768+0000","last_active":"2023-06-10T18:52:47.095432+0000","last_peered":"2023-06-10T18:52:47.095432+0000","last_clean":"2023-06-10T18:52:47.095432+0000","last_became_active":"2023-06-10T18:52:44.575122+0000","last_became_peered":"2023-06-10T18:52:44.575122+0000","last_unstale":"2023-06-10T18:52:47.095432+0000","last_undegraded":"2023-06-10T18:52:47.095432+0000","last_fullsized":"2023-06-10T18:52:47.095432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:01:26.727248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.932347+0000","last_change":"2023-06-10T18:52:44.938302+0000","last_active":"2023-06-10T18:52:45.932347+0000","last_peered":"2023-06-10T18:52:45.932347+0000","last_clean":"2023-06-10T18:52:45.932347+0000","last_became_active":"2023-06-10T18:52:44.938005+0000","last_became_peered":"2023-06-10T18:52:44.938005+0000","last_unstale":"2023-06-10T18:52:45.932347+0000","last_undegraded":"2023-06-10T18:52:45.932347+0000","last_fullsized":"2023-06-10T18:52:45.932347+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:49:49.618852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.932470+0000","last_change":"2023-06-10T18:52:44.561044+0000","last_active":"2023-06-10T18:52:45.932470+0000","last_peered":"2023-06-10T18:52:45.932470+0000","last_clean":"2023-06-10T18:52:45.932470+0000","last_became_active":"2023-06-10T18:52:44.560233+0000","last_became_peered":"2023-06-10T18:52:44.560233+0000","last_unstale":"2023-06-10T18:52:45.932470+0000","last_undegraded":"2023-06-10T18:52:45.932470+0000","last_fullsized":"2023-06-10T18:52:45.932470+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:37:25.343271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.932395+0000","last_change":"2023-06-10T18:52:44.951038+0000","last_active":"2023-06-10T18:52:45.932395+0000","last_peered":"2023-06-10T18:52:45.932395+0000","last_clean":"2023-06-10T18:52:45.932395+0000","last_became_active":"2023-06-10T18:52:44.942868+0000","last_became_peered":"2023-06-10T18:52:44.942868+0000","last_unstale":"2023-06-10T18:52:45.932395+0000","last_undegraded":"2023-06-10T18:52:45.932395+0000","last_fullsized":"2023-06-10T18:52:45.932395+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:41:13.376627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.929453+0000","last_change":"2023-06-10T18:52:44.558548+0000","last_active":"2023-06-10T18:52:45.929453+0000","last_peered":"2023-06-10T18:52:45.929453+0000","last_clean":"2023-06-10T18:52:45.929453+0000","last_became_active":"2023-06-10T18:52:44.558194+0000","last_became_peered":"2023-06-10T18:52:44.558194+0000","last_unstale":"2023-06-10T18:52:45.929453+0000","last_undegraded":"2023-06-10T18:52:45.929453+0000","last_fullsized":"2023-06-10T18:52:45.929453+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:54:33.867663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.094869+0000","last_change":"2023-06-10T18:52:44.967155+0000","last_active":"2023-06-10T18:52:47.094869+0000","last_peered":"2023-06-10T18:52:47.094869+0000","last_clean":"2023-06-10T18:52:47.094869+0000","last_became_active":"2023-06-10T18:52:44.966889+0000","last_became_peered":"2023-06-10T18:52:44.966889+0000","last_unstale":"2023-06-10T18:52:47.094869+0000","last_undegraded":"2023-06-10T18:52:47.094869+0000","last_fullsized":"2023-06-10T18:52:47.094869+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:42:51.947168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":175,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.095406+0000","last_change":"2023-06-10T18:52:34.951528+0000","last_active":"2023-06-10T18:52:47.095406+0000","last_peered":"2023-06-10T18:52:47.095406+0000","last_clean":"2023-06-10T18:52:47.095406+0000","last_became_active":"2023-06-10T18:52:34.949099+0000","last_became_peered":"2023-06-10T18:52:34.949099+0000","last_unstale":"2023-06-10T18:52:47.095406+0000","last_undegraded":"2023-06-10T18:52:47.095406+0000","last_fullsized":"2023-06-10T18:52:47.095406+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_clean_scrub_stamp":"2023-06-10T18:52:33.633295+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:41:02.488686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.934561+0000","last_change":"2023-06-10T18:52:40.506384+0000","last_active":"2023-06-10T18:52:45.934561+0000","last_peered":"2023-06-10T18:52:45.934561+0000","last_clean":"2023-06-10T18:52:45.934561+0000","last_became_active":"2023-06-10T18:52:40.505701+0000","last_became_peered":"2023-06-10T18:52:40.505701+0000","last_unstale":"2023-06-10T18:52:45.934561+0000","last_undegraded":"2023-06-10T18:52:45.934561+0000","last_fullsized":"2023-06-10T18:52:45.934561+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:39:05.841926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.929409+0000","last_change":"2023-06-10T18:52:44.563326+0000","last_active":"2023-06-10T18:52:45.929409+0000","last_peered":"2023-06-10T18:52:45.929409+0000","last_clean":"2023-06-10T18:52:45.929409+0000","last_became_active":"2023-06-10T18:52:44.562901+0000","last_became_peered":"2023-06-10T18:52:44.562901+0000","last_unstale":"2023-06-10T18:52:45.929409+0000","last_undegraded":"2023-06-10T18:52:45.929409+0000","last_fullsized":"2023-06-10T18:52:45.929409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:29:32.049058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.095326+0000","last_change":"2023-06-10T18:52:44.940336+0000","last_active":"2023-06-10T18:52:47.095326+0000","last_peered":"2023-06-10T18:52:47.095326+0000","last_clean":"2023-06-10T18:52:47.095326+0000","last_became_active":"2023-06-10T18:52:44.939935+0000","last_became_peered":"2023-06-10T18:52:44.939935+0000","last_unstale":"2023-06-10T18:52:47.095326+0000","last_undegraded":"2023-06-10T18:52:47.095326+0000","last_fullsized":"2023-06-10T18:52:47.095326+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:42:44.531042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.095044+0000","last_change":"2023-06-10T18:52:40.512015+0000","last_active":"2023-06-10T18:52:47.095044+0000","last_peered":"2023-06-10T18:52:47.095044+0000","last_clean":"2023-06-10T18:52:47.095044+0000","last_became_active":"2023-06-10T18:52:40.511382+0000","last_became_peered":"2023-06-10T18:52:40.511382+0000","last_unstale":"2023-06-10T18:52:47.095044+0000","last_undegraded":"2023-06-10T18:52:47.095044+0000","last_fullsized":"2023-06-10T18:52:47.095044+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:49:44.572458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.073029+0000","last_change":"2023-06-10T18:52:44.575339+0000","last_active":"2023-06-10T18:52:47.073029+0000","last_peered":"2023-06-10T18:52:47.073029+0000","last_clean":"2023-06-10T18:52:47.073029+0000","last_became_active":"2023-06-10T18:52:44.575020+0000","last_became_peered":"2023-06-10T18:52:44.575020+0000","last_unstale":"2023-06-10T18:52:47.073029+0000","last_undegraded":"2023-06-10T18:52:47.073029+0000","last_fullsized":"2023-06-10T18:52:47.073029+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:29:32.049058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.073832+0000","last_change":"2023-06-10T18:52:44.960817+0000","last_active":"2023-06-10T18:52:47.073832+0000","last_peered":"2023-06-10T18:52:47.073832+0000","last_clean":"2023-06-10T18:52:47.073832+0000","last_became_active":"2023-06-10T18:52:44.960128+0000","last_became_peered":"2023-06-10T18:52:44.960128+0000","last_unstale":"2023-06-10T18:52:47.073832+0000","last_undegraded":"2023-06-10T18:52:47.073832+0000","last_fullsized":"2023-06-10T18:52:47.073832+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:39:10.018608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.093628+0000","last_change":"2023-06-10T18:52:40.671725+0000","last_active":"2023-06-10T18:52:47.093628+0000","last_peered":"2023-06-10T18:52:47.093628+0000","last_clean":"2023-06-10T18:52:47.093628+0000","last_became_active":"2023-06-10T18:52:40.671442+0000","last_became_peered":"2023-06-10T18:52:40.671442+0000","last_unstale":"2023-06-10T18:52:47.093628+0000","last_undegraded":"2023-06-10T18:52:47.093628+0000","last_fullsized":"2023-06-10T18:52:47.093628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:50:04.521612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.094350+0000","last_change":"2023-06-10T18:52:44.554010+0000","last_active":"2023-06-10T18:52:47.094350+0000","last_peered":"2023-06-10T18:52:47.094350+0000","last_clean":"2023-06-10T18:52:47.094350+0000","last_became_active":"2023-06-10T18:52:44.553706+0000","last_became_peered":"2023-06-10T18:52:44.553706+0000","last_unstale":"2023-06-10T18:52:47.094350+0000","last_undegraded":"2023-06-10T18:52:47.094350+0000","last_fullsized":"2023-06-10T18:52:47.094350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:08:49.327602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.094957+0000","last_change":"2023-06-10T18:52:44.954070+0000","last_active":"2023-06-10T18:52:47.094957+0000","last_peered":"2023-06-10T18:52:47.094957+0000","last_clean":"2023-06-10T18:52:47.094957+0000","last_became_active":"2023-06-10T18:52:44.953811+0000","last_became_peered":"2023-06-10T18:52:44.953811+0000","last_unstale":"2023-06-10T18:52:47.094957+0000","last_undegraded":"2023-06-10T18:52:47.094957+0000","last_fullsized":"2023-06-10T18:52:47.094957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:39:10.888321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.935370+0000","last_change":"2023-06-10T18:52:40.510258+0000","last_active":"2023-06-10T18:52:45.935370+0000","last_peered":"2023-06-10T18:52:45.935370+0000","last_clean":"2023-06-10T18:52:45.935370+0000","last_became_active":"2023-06-10T18:52:40.509560+0000","last_became_peered":"2023-06-10T18:52:40.509560+0000","last_unstale":"2023-06-10T18:52:45.935370+0000","last_undegraded":"2023-06-10T18:52:45.935370+0000","last_fullsized":"2023-06-10T18:52:45.935370+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:14:06.459934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.932037+0000","last_change":"2023-06-10T18:52:44.574974+0000","last_active":"2023-06-10T18:52:45.932037+0000","last_peered":"2023-06-10T18:52:45.932037+0000","last_clean":"2023-06-10T18:52:45.932037+0000","last_became_active":"2023-06-10T18:52:44.574115+0000","last_became_peered":"2023-06-10T18:52:44.574115+0000","last_unstale":"2023-06-10T18:52:45.932037+0000","last_undegraded":"2023-06-10T18:52:45.932037+0000","last_fullsized":"2023-06-10T18:52:45.932037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:39:09.884317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.095249+0000","last_change":"2023-06-10T18:52:44.954466+0000","last_active":"2023-06-10T18:52:47.095249+0000","last_peered":"2023-06-10T18:52:47.095249+0000","last_clean":"2023-06-10T18:52:47.095249+0000","last_became_active":"2023-06-10T18:52:44.953993+0000","last_became_peered":"2023-06-10T18:52:44.953993+0000","last_unstale":"2023-06-10T18:52:47.095249+0000","last_undegraded":"2023-06-10T18:52:47.095249+0000","last_fullsized":"2023-06-10T18:52:47.095249+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:50:18.328232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.935077+0000","last_change":"2023-06-10T18:52:44.558952+0000","last_active":"2023-06-10T18:52:45.935077+0000","last_peered":"2023-06-10T18:52:45.935077+0000","last_clean":"2023-06-10T18:52:45.935077+0000","last_became_active":"2023-06-10T18:52:44.558238+0000","last_became_peered":"2023-06-10T18:52:44.558238+0000","last_unstale":"2023-06-10T18:52:45.935077+0000","last_undegraded":"2023-06-10T18:52:45.935077+0000","last_fullsized":"2023-06-10T18:52:45.935077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T18:54:15.709068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.095574+0000","last_change":"2023-06-10T18:52:40.672266+0000","last_active":"2023-06-10T18:52:47.095574+0000","last_peered":"2023-06-10T18:52:47.095574+0000","last_clean":"2023-06-10T18:52:47.095574+0000","last_became_active":"2023-06-10T18:52:40.671966+0000","last_became_peered":"2023-06-10T18:52:40.671966+0000","last_unstale":"2023-06-10T18:52:47.095574+0000","last_undegraded":"2023-06-10T18:52:47.095574+0000","last_fullsized":"2023-06-10T18:52:47.095574+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:41:08.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.094687+0000","last_change":"2023-06-10T18:52:44.953256+0000","last_active":"2023-06-10T18:52:47.094687+0000","last_peered":"2023-06-10T18:52:47.094687+0000","last_clean":"2023-06-10T18:52:47.094687+0000","last_became_active":"2023-06-10T18:52:44.952882+0000","last_became_peered":"2023-06-10T18:52:44.952882+0000","last_unstale":"2023-06-10T18:52:47.094687+0000","last_undegraded":"2023-06-10T18:52:47.094687+0000","last_fullsized":"2023-06-10T18:52:47.094687+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:37:28.673117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.095401+0000","last_change":"2023-06-10T18:52:44.555209+0000","last_active":"2023-06-10T18:52:47.095401+0000","last_peered":"2023-06-10T18:52:47.095401+0000","last_clean":"2023-06-10T18:52:47.095401+0000","last_became_active":"2023-06-10T18:52:44.554807+0000","last_became_peered":"2023-06-10T18:52:44.554807+0000","last_unstale":"2023-06-10T18:52:47.095401+0000","last_undegraded":"2023-06-10T18:52:47.095401+0000","last_fullsized":"2023-06-10T18:52:47.095401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:39:05.203717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.096653+0000","last_change":"2023-06-10T18:52:40.671084+0000","last_active":"2023-06-10T18:52:47.096653+0000","last_peered":"2023-06-10T18:52:47.096653+0000","last_clean":"2023-06-10T18:52:47.096653+0000","last_became_active":"2023-06-10T18:52:40.670697+0000","last_became_peered":"2023-06-10T18:52:40.670697+0000","last_unstale":"2023-06-10T18:52:47.096653+0000","last_undegraded":"2023-06-10T18:52:47.096653+0000","last_fullsized":"2023-06-10T18:52:47.096653+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:32:49.983600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.073669+0000","last_change":"2023-06-10T18:52:44.952636+0000","last_active":"2023-06-10T18:52:47.073669+0000","last_peered":"2023-06-10T18:52:47.073669+0000","last_clean":"2023-06-10T18:52:47.073669+0000","last_became_active":"2023-06-10T18:52:44.952234+0000","last_became_peered":"2023-06-10T18:52:44.952234+0000","last_unstale":"2023-06-10T18:52:47.073669+0000","last_undegraded":"2023-06-10T18:52:47.073669+0000","last_fullsized":"2023-06-10T18:52:47.073669+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:59:51.325397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.929887+0000","last_change":"2023-06-10T18:52:44.573554+0000","last_active":"2023-06-10T18:52:45.929887+0000","last_peered":"2023-06-10T18:52:45.929887+0000","last_clean":"2023-06-10T18:52:45.929887+0000","last_became_active":"2023-06-10T18:52:44.573142+0000","last_became_peered":"2023-06-10T18:52:44.573142+0000","last_unstale":"2023-06-10T18:52:45.929887+0000","last_undegraded":"2023-06-10T18:52:45.929887+0000","last_fullsized":"2023-06-10T18:52:45.929887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:39:05.203717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.095517+0000","last_change":"2023-06-10T18:52:40.514114+0000","last_active":"2023-06-10T18:52:47.095517+0000","last_peered":"2023-06-10T18:52:47.095517+0000","last_clean":"2023-06-10T18:52:47.095517+0000","last_became_active":"2023-06-10T18:52:40.513638+0000","last_became_peered":"2023-06-10T18:52:40.513638+0000","last_unstale":"2023-06-10T18:52:47.095517+0000","last_undegraded":"2023-06-10T18:52:47.095517+0000","last_fullsized":"2023-06-10T18:52:47.095517+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:49:44.572458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.929271+0000","last_change":"2023-06-10T18:52:44.949048+0000","last_active":"2023-06-10T18:52:45.929271+0000","last_peered":"2023-06-10T18:52:45.929271+0000","last_clean":"2023-06-10T18:52:45.929271+0000","last_became_active":"2023-06-10T18:52:44.948643+0000","last_became_peered":"2023-06-10T18:52:44.948643+0000","last_unstale":"2023-06-10T18:52:45.929271+0000","last_undegraded":"2023-06-10T18:52:45.929271+0000","last_fullsized":"2023-06-10T18:52:45.929271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:38:52.793572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.073972+0000","last_change":"2023-06-10T18:52:44.555532+0000","last_active":"2023-06-10T18:52:47.073972+0000","last_peered":"2023-06-10T18:52:47.073972+0000","last_clean":"2023-06-10T18:52:47.073972+0000","last_became_active":"2023-06-10T18:52:44.555234+0000","last_became_peered":"2023-06-10T18:52:44.555234+0000","last_unstale":"2023-06-10T18:52:47.073972+0000","last_undegraded":"2023-06-10T18:52:47.073972+0000","last_fullsized":"2023-06-10T18:52:47.073972+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:08:03.476132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.095638+0000","last_change":"2023-06-10T18:52:40.515396+0000","last_active":"2023-06-10T18:52:47.095638+0000","last_peered":"2023-06-10T18:52:47.095638+0000","last_clean":"2023-06-10T18:52:47.095638+0000","last_became_active":"2023-06-10T18:52:40.514663+0000","last_became_peered":"2023-06-10T18:52:40.514663+0000","last_unstale":"2023-06-10T18:52:47.095638+0000","last_undegraded":"2023-06-10T18:52:47.095638+0000","last_fullsized":"2023-06-10T18:52:47.095638+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:29:28.006668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.932272+0000","last_change":"2023-06-10T18:52:44.946073+0000","last_active":"2023-06-10T18:52:45.932272+0000","last_peered":"2023-06-10T18:52:45.932272+0000","last_clean":"2023-06-10T18:52:45.932272+0000","last_became_active":"2023-06-10T18:52:44.945497+0000","last_became_peered":"2023-06-10T18:52:44.945497+0000","last_unstale":"2023-06-10T18:52:45.932272+0000","last_undegraded":"2023-06-10T18:52:45.932272+0000","last_fullsized":"2023-06-10T18:52:45.932272+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:08:04.480136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.931851+0000","last_change":"2023-06-10T18:52:44.943166+0000","last_active":"2023-06-10T18:52:45.931851+0000","last_peered":"2023-06-10T18:52:45.931851+0000","last_clean":"2023-06-10T18:52:45.931851+0000","last_became_active":"2023-06-10T18:52:44.942777+0000","last_became_peered":"2023-06-10T18:52:44.942777+0000","last_unstale":"2023-06-10T18:52:45.931851+0000","last_undegraded":"2023-06-10T18:52:45.931851+0000","last_fullsized":"2023-06-10T18:52:45.931851+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:59:51.325397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"22'6","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.932027+0000","last_change":"2023-06-10T18:52:44.575890+0000","last_active":"2023-06-10T18:52:45.932027+0000","last_peered":"2023-06-10T18:52:45.932027+0000","last_clean":"2023-06-10T18:52:45.932027+0000","last_became_active":"2023-06-10T18:52:44.573780+0000","last_became_peered":"2023-06-10T18:52:44.573780+0000","last_unstale":"2023-06-10T18:52:45.932027+0000","last_undegraded":"2023-06-10T18:52:45.932027+0000","last_fullsized":"2023-06-10T18:52:45.932027+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:50:17.324228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.094568+0000","last_change":"2023-06-10T18:52:44.955836+0000","last_active":"2023-06-10T18:52:47.094568+0000","last_peered":"2023-06-10T18:52:47.094568+0000","last_clean":"2023-06-10T18:52:47.094568+0000","last_became_active":"2023-06-10T18:52:44.955427+0000","last_became_peered":"2023-06-10T18:52:44.955427+0000","last_unstale":"2023-06-10T18:52:47.094568+0000","last_undegraded":"2023-06-10T18:52:47.094568+0000","last_fullsized":"2023-06-10T18:52:47.094568+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:53:28.618960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.096692+0000","last_change":"2023-06-10T18:52:44.583026+0000","last_active":"2023-06-10T18:52:47.096692+0000","last_peered":"2023-06-10T18:52:47.096692+0000","last_clean":"2023-06-10T18:52:47.096692+0000","last_became_active":"2023-06-10T18:52:44.582436+0000","last_became_peered":"2023-06-10T18:52:44.582436+0000","last_unstale":"2023-06-10T18:52:47.096692+0000","last_undegraded":"2023-06-10T18:52:47.096692+0000","last_fullsized":"2023-06-10T18:52:47.096692+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:15:28.452018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.935637+0000","last_change":"2023-06-10T18:52:44.573591+0000","last_active":"2023-06-10T18:52:45.935637+0000","last_peered":"2023-06-10T18:52:45.935637+0000","last_clean":"2023-06-10T18:52:45.935637+0000","last_became_active":"2023-06-10T18:52:44.572802+0000","last_became_peered":"2023-06-10T18:52:44.572802+0000","last_unstale":"2023-06-10T18:52:45.935637+0000","last_undegraded":"2023-06-10T18:52:45.935637+0000","last_fullsized":"2023-06-10T18:52:45.935637+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:34:50.390041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.929760+0000","last_change":"2023-06-10T18:52:44.944441+0000","last_active":"2023-06-10T18:52:45.929760+0000","last_peered":"2023-06-10T18:52:45.929760+0000","last_clean":"2023-06-10T18:52:45.929760+0000","last_became_active":"2023-06-10T18:52:44.944031+0000","last_became_peered":"2023-06-10T18:52:44.944031+0000","last_unstale":"2023-06-10T18:52:45.929760+0000","last_undegraded":"2023-06-10T18:52:45.929760+0000","last_fullsized":"2023-06-10T18:52:45.929760+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:39:10.888321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.073751+0000","last_change":"2023-06-10T18:52:44.563525+0000","last_active":"2023-06-10T18:52:47.073751+0000","last_peered":"2023-06-10T18:52:47.073751+0000","last_clean":"2023-06-10T18:52:47.073751+0000","last_became_active":"2023-06-10T18:52:44.563140+0000","last_became_peered":"2023-06-10T18:52:44.563140+0000","last_unstale":"2023-06-10T18:52:47.073751+0000","last_undegraded":"2023-06-10T18:52:47.073751+0000","last_fullsized":"2023-06-10T18:52:47.073751+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:50:17.324228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.929241+0000","last_change":"2023-06-10T18:52:44.953481+0000","last_active":"2023-06-10T18:52:45.929241+0000","last_peered":"2023-06-10T18:52:45.929241+0000","last_clean":"2023-06-10T18:52:45.929241+0000","last_became_active":"2023-06-10T18:52:44.953139+0000","last_became_peered":"2023-06-10T18:52:44.953139+0000","last_unstale":"2023-06-10T18:52:45.929241+0000","last_undegraded":"2023-06-10T18:52:45.929241+0000","last_fullsized":"2023-06-10T18:52:45.929241+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:01:27.731251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.095689+0000","last_change":"2023-06-10T18:52:44.946900+0000","last_active":"2023-06-10T18:52:47.095689+0000","last_peered":"2023-06-10T18:52:47.095689+0000","last_clean":"2023-06-10T18:52:47.095689+0000","last_became_active":"2023-06-10T18:52:44.946612+0000","last_became_peered":"2023-06-10T18:52:44.946612+0000","last_unstale":"2023-06-10T18:52:47.095689+0000","last_undegraded":"2023-06-10T18:52:47.095689+0000","last_fullsized":"2023-06-10T18:52:47.095689+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:38:52.793572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.929494+0000","last_change":"2023-06-10T18:52:44.561213+0000","last_active":"2023-06-10T18:52:45.929494+0000","last_peered":"2023-06-10T18:52:45.929494+0000","last_clean":"2023-06-10T18:52:45.929494+0000","last_became_active":"2023-06-10T18:52:44.560946+0000","last_became_peered":"2023-06-10T18:52:44.560946+0000","last_unstale":"2023-06-10T18:52:45.929494+0000","last_undegraded":"2023-06-10T18:52:45.929494+0000","last_fullsized":"2023-06-10T18:52:45.929494+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:08:49.327602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.073688+0000","last_change":"2023-06-10T18:52:44.951860+0000","last_active":"2023-06-10T18:52:47.073688+0000","last_peered":"2023-06-10T18:52:47.073688+0000","last_clean":"2023-06-10T18:52:47.073688+0000","last_became_active":"2023-06-10T18:52:44.949078+0000","last_became_peered":"2023-06-10T18:52:44.949078+0000","last_unstale":"2023-06-10T18:52:47.073688+0000","last_undegraded":"2023-06-10T18:52:47.073688+0000","last_fullsized":"2023-06-10T18:52:47.073688+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:42:51.947168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.094812+0000","last_change":"2023-06-10T18:52:44.559767+0000","last_active":"2023-06-10T18:52:47.094812+0000","last_peered":"2023-06-10T18:52:47.094812+0000","last_clean":"2023-06-10T18:52:47.094812+0000","last_became_active":"2023-06-10T18:52:44.559451+0000","last_became_peered":"2023-06-10T18:52:44.559451+0000","last_unstale":"2023-06-10T18:52:47.094812+0000","last_undegraded":"2023-06-10T18:52:47.094812+0000","last_fullsized":"2023-06-10T18:52:47.094812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:59:50.321394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.929761+0000","last_change":"2023-06-10T18:52:44.960896+0000","last_active":"2023-06-10T18:52:45.929761+0000","last_peered":"2023-06-10T18:52:45.929761+0000","last_clean":"2023-06-10T18:52:45.929761+0000","last_became_active":"2023-06-10T18:52:44.960188+0000","last_became_peered":"2023-06-10T18:52:44.960188+0000","last_unstale":"2023-06-10T18:52:45.929761+0000","last_undegraded":"2023-06-10T18:52:45.929761+0000","last_fullsized":"2023-06-10T18:52:45.929761+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:50:18.328232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.932875+0000","last_change":"2023-06-10T18:52:44.552411+0000","last_active":"2023-06-10T18:52:45.932875+0000","last_peered":"2023-06-10T18:52:45.932875+0000","last_clean":"2023-06-10T18:52:45.932875+0000","last_became_active":"2023-06-10T18:52:44.551312+0000","last_became_peered":"2023-06-10T18:52:44.551312+0000","last_unstale":"2023-06-10T18:52:45.932875+0000","last_undegraded":"2023-06-10T18:52:45.932875+0000","last_fullsized":"2023-06-10T18:52:45.932875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:44:27.810129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.094468+0000","last_change":"2023-06-10T18:52:44.965460+0000","last_active":"2023-06-10T18:52:47.094468+0000","last_peered":"2023-06-10T18:52:47.094468+0000","last_clean":"2023-06-10T18:52:47.094468+0000","last_became_active":"2023-06-10T18:52:44.964988+0000","last_became_peered":"2023-06-10T18:52:44.964988+0000","last_unstale":"2023-06-10T18:52:47.094468+0000","last_undegraded":"2023-06-10T18:52:47.094468+0000","last_fullsized":"2023-06-10T18:52:47.094468+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:46:29.935621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.074090+0000","last_change":"2023-06-10T18:52:44.576675+0000","last_active":"2023-06-10T18:52:47.074090+0000","last_peered":"2023-06-10T18:52:47.074090+0000","last_clean":"2023-06-10T18:52:47.074090+0000","last_became_active":"2023-06-10T18:52:44.576362+0000","last_became_peered":"2023-06-10T18:52:44.576362+0000","last_unstale":"2023-06-10T18:52:47.074090+0000","last_undegraded":"2023-06-10T18:52:47.074090+0000","last_fullsized":"2023-06-10T18:52:47.074090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:49:48.614848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.931722+0000","last_change":"2023-06-10T18:52:44.941939+0000","last_active":"2023-06-10T18:52:45.931722+0000","last_peered":"2023-06-10T18:52:45.931722+0000","last_clean":"2023-06-10T18:52:45.931722+0000","last_became_active":"2023-06-10T18:52:44.939408+0000","last_became_peered":"2023-06-10T18:52:44.939408+0000","last_unstale":"2023-06-10T18:52:45.931722+0000","last_undegraded":"2023-06-10T18:52:45.931722+0000","last_fullsized":"2023-06-10T18:52:45.931722+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:31:20.946172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.934658+0000","last_change":"2023-06-10T18:52:44.574956+0000","last_active":"2023-06-10T18:52:45.934658+0000","last_peered":"2023-06-10T18:52:45.934658+0000","last_clean":"2023-06-10T18:52:45.934658+0000","last_became_active":"2023-06-10T18:52:44.574184+0000","last_became_peered":"2023-06-10T18:52:44.574184+0000","last_unstale":"2023-06-10T18:52:45.934658+0000","last_undegraded":"2023-06-10T18:52:45.934658+0000","last_fullsized":"2023-06-10T18:52:45.934658+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:50:17.324228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.932406+0000","last_change":"2023-06-10T18:52:44.944962+0000","last_active":"2023-06-10T18:52:45.932406+0000","last_peered":"2023-06-10T18:52:45.932406+0000","last_clean":"2023-06-10T18:52:45.932406+0000","last_became_active":"2023-06-10T18:52:44.944702+0000","last_became_peered":"2023-06-10T18:52:44.944702+0000","last_unstale":"2023-06-10T18:52:45.932406+0000","last_undegraded":"2023-06-10T18:52:45.932406+0000","last_fullsized":"2023-06-10T18:52:45.932406+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T18:54:16.713072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.935077+0000","last_change":"2023-06-10T18:52:44.576687+0000","last_active":"2023-06-10T18:52:45.935077+0000","last_peered":"2023-06-10T18:52:45.935077+0000","last_clean":"2023-06-10T18:52:45.935077+0000","last_became_active":"2023-06-10T18:52:44.575964+0000","last_became_peered":"2023-06-10T18:52:44.575964+0000","last_unstale":"2023-06-10T18:52:45.935077+0000","last_undegraded":"2023-06-10T18:52:45.935077+0000","last_fullsized":"2023-06-10T18:52:45.935077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:41:12.372624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.929739+0000","last_change":"2023-06-10T18:52:44.937999+0000","last_active":"2023-06-10T18:52:45.929739+0000","last_peered":"2023-06-10T18:52:45.929739+0000","last_clean":"2023-06-10T18:52:45.929739+0000","last_became_active":"2023-06-10T18:52:44.937614+0000","last_became_peered":"2023-06-10T18:52:44.937614+0000","last_unstale":"2023-06-10T18:52:45.929739+0000","last_undegraded":"2023-06-10T18:52:45.929739+0000","last_fullsized":"2023-06-10T18:52:45.929739+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:42:51.947168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.929840+0000","last_change":"2023-06-10T18:52:44.563109+0000","last_active":"2023-06-10T18:52:45.929840+0000","last_peered":"2023-06-10T18:52:45.929840+0000","last_clean":"2023-06-10T18:52:45.929840+0000","last_became_active":"2023-06-10T18:52:44.562809+0000","last_became_peered":"2023-06-10T18:52:44.562809+0000","last_unstale":"2023-06-10T18:52:45.929840+0000","last_undegraded":"2023-06-10T18:52:45.929840+0000","last_fullsized":"2023-06-10T18:52:45.929840+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:39:09.014604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.931609+0000","last_change":"2023-06-10T18:52:44.945839+0000","last_active":"2023-06-10T18:52:45.931609+0000","last_peered":"2023-06-10T18:52:45.931609+0000","last_clean":"2023-06-10T18:52:45.931609+0000","last_became_active":"2023-06-10T18:52:44.945171+0000","last_became_peered":"2023-06-10T18:52:44.945171+0000","last_unstale":"2023-06-10T18:52:45.931609+0000","last_undegraded":"2023-06-10T18:52:45.931609+0000","last_fullsized":"2023-06-10T18:52:45.931609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:54:34.871667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.073610+0000","last_change":"2023-06-10T18:52:44.563708+0000","last_active":"2023-06-10T18:52:47.073610+0000","last_peered":"2023-06-10T18:52:47.073610+0000","last_clean":"2023-06-10T18:52:47.073610+0000","last_became_active":"2023-06-10T18:52:44.563327+0000","last_became_peered":"2023-06-10T18:52:44.563327+0000","last_unstale":"2023-06-10T18:52:47.073610+0000","last_undegraded":"2023-06-10T18:52:47.073610+0000","last_fullsized":"2023-06-10T18:52:47.073610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:37:27.669113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":844,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":864256,"data_stored":681747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.075}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0920000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0289999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":229376,"data_stored":82946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.123}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.161}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":249856,"data_stored":90251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.877}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.137}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":262144,"data_stored":91219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0760000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.228}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4610000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31284,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340556,"statfs":{"total":96636764160,"available":96604729344,"internally_reserved":0,"allocated":241664,"data_stored":88670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94599999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.155}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3919999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31272,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340568,"statfs":{"total":96636764160,"available":96604741632,"internally_reserved":0,"allocated":229376,"data_stored":82946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0629999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1120000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0860000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0049999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31268,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340572,"statfs":{"total":96636764160,"available":96604745728,"internally_reserved":0,"allocated":225280,"data_stored":81927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90500000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31852,"kb_used_data":804,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339988,"statfs":{"total":96636764160,"available":96604147712,"internally_reserved":0,"allocated":823296,"data_stored":672877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.091}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1659999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.274}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-10T18:52:49.711 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-06-10T18:52:49.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.852+0000 7f4e35beb640 1 Processor -- start 2023-06-10T18:52:49.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.852+0000 7f4e35beb640 1 -- start start 2023-06-10T18:52:49.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.852+0000 7f4e35beb640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4e300b3ac0 0x7f4e300b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:49.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.852+0000 7f4e35beb640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4e300d14c0 0x7f4e3015fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:49.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.852+0000 7f4e35beb640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e300d0020 con 0x7f4e300cc690 2023-06-10T18:52:49.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.852+0000 7f4e35beb640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e300b43d0 con 0x7f4e300b3ac0 2023-06-10T18:52:49.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.852+0000 7f4e35beb640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e300cef40 con 0x7f4e300d14c0 2023-06-10T18:52:49.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.852+0000 7f4e2f7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4e300b3ac0 0x7f4e300b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:49.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.852+0000 7f4e2effd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f4e300cc690 0x7f4e3015f370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52870/0 (socket says 172.21.15.53:52870) 2023-06-10T18:52:49.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.852+0000 7f4e2f7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4e300b3ac0 0x7f4e300b3e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56272/0 (socket says 172.21.15.53:56272) 2023-06-10T18:52:49.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.852+0000 7f4e2f7fe640 1 -- 172.21.15.53:0/2747021865 learned_addr learned my addr 172.21.15.53:0/2747021865 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:49.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.856+0000 7f4e2f7fe640 1 -- 172.21.15.53:0/2747021865 >> v2:172.21.15.117:3300/0 conn(0x7f4e300d14c0 msgr2=0x7f4e3015fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:49.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.856+0000 7f4e2f7fe640 1 --2- 172.21.15.53:0/2747021865 >> v2:172.21.15.117:3300/0 conn(0x7f4e300d14c0 0x7f4e3015fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:49.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.856+0000 7f4e2f7fe640 1 -- 172.21.15.53:0/2747021865 >> v1:172.21.15.53:6789/0 conn(0x7f4e300cc690 legacy=0x7f4e3015f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:49.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.856+0000 7f4e2f7fe640 1 -- 172.21.15.53:0/2747021865 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e300cf220 con 0x7f4e300b3ac0 2023-06-10T18:52:49.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.856+0000 7f4e2f7fe640 1 --2- 172.21.15.53:0/2747021865 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e300b3ac0 0x7f4e300b3e90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4e30160410 tx=0x7f4e2401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e81991acacf32193 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:49.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.856+0000 7f4e2e7fc640 1 -- 172.21.15.53:0/2747021865 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e240ac640 con 0x7f4e300b3ac0 2023-06-10T18:52:49.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.856+0000 7f4e2e7fc640 1 -- 172.21.15.53:0/2747021865 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e240ac7a0 con 0x7f4e300b3ac0 2023-06-10T18:52:49.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.856+0000 7f4e2e7fc640 1 -- 172.21.15.53:0/2747021865 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e240acb30 con 0x7f4e300b3ac0 2023-06-10T18:52:49.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.856+0000 7f4e35beb640 1 -- 172.21.15.53:0/2747021865 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e300b3ac0 msgr2=0x7f4e300b3e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:49.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.856+0000 7f4e35beb640 1 --2- 172.21.15.53:0/2747021865 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e300b3ac0 0x7f4e300b3e90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4e30160410 tx=0x7f4e2401c4d0 comp rx=0 tx=0).stop 2023-06-10T18:52:49.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.856+0000 7f4e35beb640 1 -- 172.21.15.53:0/2747021865 shutdown_connections 2023-06-10T18:52:49.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.856+0000 7f4e35beb640 1 --2- 172.21.15.53:0/2747021865 >> v2:172.21.15.117:3300/0 conn(0x7f4e300d14c0 0x7f4e3015fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:49.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.856+0000 7f4e35beb640 1 --2- 172.21.15.53:0/2747021865 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e300b3ac0 0x7f4e300b3e90 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:49.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.856+0000 7f4e35beb640 1 -- 172.21.15.53:0/2747021865 >> 172.21.15.53:0/2747021865 conn(0x7f4e30071790 msgr2=0x7f4e30069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:49.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.856+0000 7f4e35beb640 1 -- 172.21.15.53:0/2747021865 shutdown_connections 2023-06-10T18:52:49.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.856+0000 7f4e35beb640 1 -- 172.21.15.53:0/2747021865 wait complete. 2023-06-10T18:52:49.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.860+0000 7f4e35beb640 1 Processor -- start 2023-06-10T18:52:49.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.860+0000 7f4e35beb640 1 -- start start 2023-06-10T18:52:49.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.860+0000 7f4e35beb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e300b3ac0 0x7f4e3014e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:49.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.860+0000 7f4e35beb640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e300cc690 0x7f4e3014da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:49.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.860+0000 7f4e35beb640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e300d14c0 0x7f4e3014c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:49.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.860+0000 7f4e35beb640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3014e980 con 0x7f4e300b3ac0 2023-06-10T18:52:49.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.860+0000 7f4e35beb640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3014dfa0 con 0x7f4e300d14c0 2023-06-10T18:52:49.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.860+0000 7f4e35beb640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3014ca90 con 0x7f4e300cc690 2023-06-10T18:52:49.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.860+0000 7f4e2f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e300b3ac0 0x7f4e3014e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:49.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.860+0000 7f4e2f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e300b3ac0 0x7f4e3014e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56284/0 (socket says 172.21.15.53:56284) 2023-06-10T18:52:49.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.860+0000 7f4e2f7fe640 1 -- 172.21.15.53:0/2438180575 learned_addr learned my addr 172.21.15.53:0/2438180575 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:49.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.860+0000 7f4e2effd640 1 --2- 172.21.15.53:0/2438180575 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e300cc690 0x7f4e3014da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:49.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.860+0000 7f4e2ffff640 1 --2- 172.21.15.53:0/2438180575 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e300d14c0 0x7f4e3014c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:49.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.860+0000 7f4e2f7fe640 1 -- 172.21.15.53:0/2438180575 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e300cc690 msgr2=0x7f4e3014da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:49.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.860+0000 7f4e2f7fe640 1 --2- 172.21.15.53:0/2438180575 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e300cc690 0x7f4e3014da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:49.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.860+0000 7f4e2f7fe640 1 -- 172.21.15.53:0/2438180575 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e300d14c0 msgr2=0x7f4e3014c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:49.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.860+0000 7f4e2f7fe640 1 --2- 172.21.15.53:0/2438180575 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e300d14c0 0x7f4e3014c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:49.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.860+0000 7f4e2f7fe640 1 -- 172.21.15.53:0/2438180575 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e240094d0 con 0x7f4e300b3ac0 2023-06-10T18:52:49.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.860+0000 7f4e2f7fe640 1 --2- 172.21.15.53:0/2438180575 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e300b3ac0 0x7f4e3014e1e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4e240190e0 tx=0x7f4e2401ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:49.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.860+0000 7f4e17fff640 1 -- 172.21.15.53:0/2438180575 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e240b7860 con 0x7f4e300b3ac0 2023-06-10T18:52:49.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.860+0000 7f4e17fff640 1 -- 172.21.15.53:0/2438180575 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e240b79c0 con 0x7f4e300b3ac0 2023-06-10T18:52:49.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.860+0000 7f4e35beb640 1 -- 172.21.15.53:0/2438180575 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e300c82b0 con 0x7f4e300b3ac0 2023-06-10T18:52:49.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.860+0000 7f4e17fff640 1 -- 172.21.15.53:0/2438180575 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e240b7d30 con 0x7f4e300b3ac0 2023-06-10T18:52:49.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.860+0000 7f4e35beb640 1 -- 172.21.15.53:0/2438180575 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e3014cca0 con 0x7f4e300b3ac0 2023-06-10T18:52:49.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.860+0000 7f4e35beb640 1 -- 172.21.15.53:0/2438180575 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e3004d790 con 0x7f4e300b3ac0 2023-06-10T18:52:49.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.860+0000 7f4e17fff640 1 -- 172.21.15.53:0/2438180575 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4e240b3070 con 0x7f4e300b3ac0 2023-06-10T18:52:49.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.860+0000 7f4e17fff640 1 --2- 172.21.15.53:0/2438180575 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4e1c066280 0x7f4e1c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:49.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.860+0000 7f4e17fff640 1 -- 172.21.15.53:0/2438180575 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4e2411e880 con 0x7f4e300b3ac0 2023-06-10T18:52:49.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.864+0000 7f4e2effd640 1 --2- 172.21.15.53:0/2438180575 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4e1c066280 0x7f4e1c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:49.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.864+0000 7f4e2effd640 1 --2- 172.21.15.53:0/2438180575 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4e1c066280 0x7f4e1c068730 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4e300b2fb0 tx=0x7f4e20007c90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:49.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:49.868+0000 7f4e17fff640 1 -- 172.21.15.53:0/2438180575 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4e240ebc60 con 0x7f4e300b3ac0 2023-06-10T18:52:50.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.096+0000 7f4e35beb640 1 -- 172.21.15.53:0/2438180575 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f4e3015bae0 con 0x7f4e300b3ac0 2023-06-10T18:52:50.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.096+0000 7f4e17fff640 1 -- 172.21.15.53:0/2438180575 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1012 (secure 0 0 0) 0x7f4e240ef280 con 0x7f4e300b3ac0 2023-06-10T18:52:50.108 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:52:50.108 INFO:teuthology.orchestra.run.smithi053.stdout:{"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":29,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":23,"num_osds":8,"num_up_osds":8,"osd_up_since":1686423152,"num_in_osds":8,"osd_in_since":1686423143,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":23,"data_bytes":592730,"bytes_used":240693248,"bytes_avail":772853420032,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":7,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"d","status":"up:active","gid":4291}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2023-06-10T18:52:21.052578+0000","services":{}},"progress_events":{}} 2023-06-10T18:52:50.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.100+0000 7f4e35beb640 1 -- 172.21.15.53:0/2438180575 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4e1c066280 msgr2=0x7f4e1c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:50.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.100+0000 7f4e35beb640 1 --2- 172.21.15.53:0/2438180575 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4e1c066280 0x7f4e1c068730 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4e300b2fb0 tx=0x7f4e20007c90 comp rx=0 tx=0).stop 2023-06-10T18:52:50.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.100+0000 7f4e35beb640 1 -- 172.21.15.53:0/2438180575 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e300b3ac0 msgr2=0x7f4e3014e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:50.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.100+0000 7f4e35beb640 1 --2- 172.21.15.53:0/2438180575 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e300b3ac0 0x7f4e3014e1e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4e240190e0 tx=0x7f4e2401ad10 comp rx=0 tx=0).stop 2023-06-10T18:52:50.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.100+0000 7f4e35beb640 1 -- 172.21.15.53:0/2438180575 shutdown_connections 2023-06-10T18:52:50.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.100+0000 7f4e35beb640 1 --2- 172.21.15.53:0/2438180575 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4e1c066280 0x7f4e1c068730 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:50.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.100+0000 7f4e35beb640 1 --2- 172.21.15.53:0/2438180575 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e300d14c0 0x7f4e3014c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:50.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.100+0000 7f4e35beb640 1 --2- 172.21.15.53:0/2438180575 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e300cc690 0x7f4e3014da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:50.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.100+0000 7f4e35beb640 1 --2- 172.21.15.53:0/2438180575 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e300b3ac0 0x7f4e3014e1e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:50.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.100+0000 7f4e35beb640 1 -- 172.21.15.53:0/2438180575 >> 172.21.15.53:0/2438180575 conn(0x7f4e30071790 msgr2=0x7f4e301583d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:50.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.100+0000 7f4e35beb640 1 -- 172.21.15.53:0/2438180575 shutdown_connections 2023-06-10T18:52:50.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.100+0000 7f4e35beb640 1 -- 172.21.15.53:0/2438180575 wait complete. 2023-06-10T18:52:50.124 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-06-10T18:52:50.125 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-10T18:52:50.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.228+0000 7f4865003640 1 Processor -- start 2023-06-10T18:52:50.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.228+0000 7f4865003640 1 -- start start 2023-06-10T18:52:50.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.228+0000 7f4865003640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4860159630 0x7f486015d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:50.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.228+0000 7f4865003640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f48600ad730 0x7f48600713a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:50.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.228+0000 7f4865003640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48600718e0 0x7f4860069450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:50.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.228+0000 7f4865003640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4860070f10 con 0x7f48600ad730 2023-06-10T18:52:50.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.228+0000 7f4865003640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f486015db60 con 0x7f4860159630 2023-06-10T18:52:50.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.228+0000 7f4865003640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f486015de40 con 0x7f48600718e0 2023-06-10T18:52:50.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.228+0000 7f485e59c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f48600ad730 0x7f48600713a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:50.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.228+0000 7f485e59c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f48600ad730 0x7f48600713a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56294/0 (socket says 172.21.15.53:56294) 2023-06-10T18:52:50.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.228+0000 7f485e59c640 1 -- 172.21.15.53:0/2506900330 learned_addr learned my addr 172.21.15.53:0/2506900330 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:50.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.228+0000 7f485ed9d640 1 --2- 172.21.15.53:0/2506900330 >> v2:172.21.15.117:3300/0 conn(0x7f4860159630 0x7f486015d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:50.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.228+0000 7f485f59e640 1 --2- 172.21.15.53:0/2506900330 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48600718e0 0x7f4860069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:50.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.228+0000 7f485e59c640 1 -- 172.21.15.53:0/2506900330 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48600718e0 msgr2=0x7f4860069450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:50.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.228+0000 7f485e59c640 1 --2- 172.21.15.53:0/2506900330 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48600718e0 0x7f4860069450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:50.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.228+0000 7f485e59c640 1 -- 172.21.15.53:0/2506900330 >> v2:172.21.15.117:3300/0 conn(0x7f4860159630 msgr2=0x7f486015d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:50.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.228+0000 7f485e59c640 1 --2- 172.21.15.53:0/2506900330 >> v2:172.21.15.117:3300/0 conn(0x7f4860159630 0x7f486015d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:50.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.228+0000 7f485e59c640 1 -- 172.21.15.53:0/2506900330 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f486015e120 con 0x7f48600ad730 2023-06-10T18:52:50.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.232+0000 7f485e59c640 1 --2- 172.21.15.53:0/2506900330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48600ad730 0x7f48600713a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f486006d680 tx=0x7f485401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96cee51bf70df454 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:50.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.232+0000 7f485dd9b640 1 -- 172.21.15.53:0/2506900330 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48540ac600 con 0x7f48600ad730 2023-06-10T18:52:50.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.232+0000 7f485dd9b640 1 -- 172.21.15.53:0/2506900330 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48540a8050 con 0x7f48600ad730 2023-06-10T18:52:50.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.232+0000 7f485dd9b640 1 -- 172.21.15.53:0/2506900330 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48540ac980 con 0x7f48600ad730 2023-06-10T18:52:50.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.232+0000 7f4865003640 1 -- 172.21.15.53:0/2506900330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48600ad730 msgr2=0x7f48600713a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:50.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.232+0000 7f4865003640 1 --2- 172.21.15.53:0/2506900330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48600ad730 0x7f48600713a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f486006d680 tx=0x7f485401c4d0 comp rx=0 tx=0).stop 2023-06-10T18:52:50.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.232+0000 7f4865003640 1 -- 172.21.15.53:0/2506900330 shutdown_connections 2023-06-10T18:52:50.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.232+0000 7f4865003640 1 --2- 172.21.15.53:0/2506900330 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48600718e0 0x7f4860069450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:50.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.232+0000 7f4865003640 1 --2- 172.21.15.53:0/2506900330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48600ad730 0x7f48600713a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:50.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.232+0000 7f4865003640 1 --2- 172.21.15.53:0/2506900330 >> v2:172.21.15.117:3300/0 conn(0x7f4860159630 0x7f486015d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:50.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.232+0000 7f4865003640 1 -- 172.21.15.53:0/2506900330 >> 172.21.15.53:0/2506900330 conn(0x7f48600cafc0 msgr2=0x7f48600cb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:50.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.232+0000 7f4865003640 1 -- 172.21.15.53:0/2506900330 shutdown_connections 2023-06-10T18:52:50.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.232+0000 7f4865003640 1 -- 172.21.15.53:0/2506900330 wait complete. 2023-06-10T18:52:50.244 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.232+0000 7f4865003640 1 Processor -- start 2023-06-10T18:52:50.244 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.232+0000 7f4865003640 1 -- start start 2023-06-10T18:52:50.244 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.232+0000 7f4865003640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48600718e0 0x7f4860151f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:50.244 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.232+0000 7f4865003640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48600ad730 0x7f48601547e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:50.244 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.232+0000 7f4865003640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4860159630 0x7f4860154d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:50.245 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.232+0000 7f4865003640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4860153950 con 0x7f48600718e0 2023-06-10T18:52:50.245 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.232+0000 7f4865003640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48601525d0 con 0x7f4860159630 2023-06-10T18:52:50.245 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.232+0000 7f4865003640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48601528b0 con 0x7f48600ad730 2023-06-10T18:52:50.245 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.232+0000 7f485ed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48600718e0 0x7f4860151f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:50.245 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.232+0000 7f485ed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48600718e0 0x7f4860151f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56310/0 (socket says 172.21.15.53:56310) 2023-06-10T18:52:50.246 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.232+0000 7f485ed9d640 1 -- 172.21.15.53:0/534351015 learned_addr learned my addr 172.21.15.53:0/534351015 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:50.246 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.232+0000 7f485e59c640 1 --2- 172.21.15.53:0/534351015 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48600ad730 0x7f48601547e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:50.246 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.232+0000 7f485f59e640 1 --2- 172.21.15.53:0/534351015 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4860159630 0x7f4860154d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:50.246 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.232+0000 7f485ed9d640 1 -- 172.21.15.53:0/534351015 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48600ad730 msgr2=0x7f48601547e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:50.246 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.232+0000 7f485ed9d640 1 --2- 172.21.15.53:0/534351015 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48600ad730 0x7f48601547e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:50.246 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.232+0000 7f485ed9d640 1 -- 172.21.15.53:0/534351015 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4860159630 msgr2=0x7f4860154d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:50.247 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.232+0000 7f485ed9d640 1 --2- 172.21.15.53:0/534351015 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4860159630 0x7f4860154d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:50.247 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.232+0000 7f485ed9d640 1 -- 172.21.15.53:0/534351015 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48540094d0 con 0x7f48600718e0 2023-06-10T18:52:50.247 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.232+0000 7f485ed9d640 1 --2- 172.21.15.53:0/534351015 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48600718e0 0x7f4860151f50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f485000d5f0 tx=0x7f485000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:50.247 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.232+0000 7f48477fe640 1 -- 172.21.15.53:0/534351015 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48500125f0 con 0x7f48600718e0 2023-06-10T18:52:50.247 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.236+0000 7f48477fe640 1 -- 172.21.15.53:0/534351015 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4850012750 con 0x7f48600718e0 2023-06-10T18:52:50.247 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.236+0000 7f4865003640 1 -- 172.21.15.53:0/534351015 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4860152b90 con 0x7f48600718e0 2023-06-10T18:52:50.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.236+0000 7f48477fe640 1 -- 172.21.15.53:0/534351015 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4850012ae0 con 0x7f48600718e0 2023-06-10T18:52:50.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.236+0000 7f4865003640 1 -- 172.21.15.53:0/534351015 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4860153150 con 0x7f48600718e0 2023-06-10T18:52:50.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.236+0000 7f4865003640 1 -- 172.21.15.53:0/534351015 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48600cbd00 con 0x7f48600718e0 2023-06-10T18:52:50.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.236+0000 7f48477fe640 1 -- 172.21.15.53:0/534351015 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4850012c40 con 0x7f48600718e0 2023-06-10T18:52:50.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.236+0000 7f48477fe640 1 --2- 172.21.15.53:0/534351015 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f484c0662b0 0x7f484c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:50.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.236+0000 7f48477fe640 1 -- 172.21.15.53:0/534351015 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4850084170 con 0x7f48600718e0 2023-06-10T18:52:50.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.236+0000 7f485e59c640 1 --2- 172.21.15.53:0/534351015 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f484c0662b0 0x7f484c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:50.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.236+0000 7f485e59c640 1 --2- 172.21.15.53:0/534351015 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f484c0662b0 0x7f484c068760 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f48540ae000 tx=0x7f4854008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:50.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.240+0000 7f48477fe640 1 -- 172.21.15.53:0/534351015 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4850051680 con 0x7f48600718e0 2023-06-10T18:52:50.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.392+0000 7f4865003640 1 -- 172.21.15.53:0/534351015 --> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f48600c8b90 con 0x7f484c0662b0 2023-06-10T18:52:50.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.412+0000 7f48477fe640 1 -- 172.21.15.53:0/534351015 <== mgr.4105 v2:172.21.15.117:6832/3061986771 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286636 (secure 0 0 0) 0x7f48540ac6c0 con 0x7f484c0662b0 2023-06-10T18:52:50.425 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:52:50.426 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-06-10T18:52:50.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.416+0000 7f4865003640 1 -- 172.21.15.53:0/534351015 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f484c0662b0 msgr2=0x7f484c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:50.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.416+0000 7f4865003640 1 --2- 172.21.15.53:0/534351015 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f484c0662b0 0x7f484c068760 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f48540ae000 tx=0x7f4854008040 comp rx=0 tx=0).stop 2023-06-10T18:52:50.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.416+0000 7f4865003640 1 -- 172.21.15.53:0/534351015 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48600718e0 msgr2=0x7f4860151f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:50.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.416+0000 7f4865003640 1 --2- 172.21.15.53:0/534351015 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48600718e0 0x7f4860151f50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f485000d5f0 tx=0x7f485000dab0 comp rx=0 tx=0).stop 2023-06-10T18:52:50.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.416+0000 7f4865003640 1 -- 172.21.15.53:0/534351015 shutdown_connections 2023-06-10T18:52:50.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.416+0000 7f4865003640 1 --2- 172.21.15.53:0/534351015 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f484c0662b0 0x7f484c068760 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:50.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.416+0000 7f4865003640 1 --2- 172.21.15.53:0/534351015 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4860159630 0x7f4860154d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:50.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.416+0000 7f4865003640 1 --2- 172.21.15.53:0/534351015 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48600ad730 0x7f48601547e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:50.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.416+0000 7f4865003640 1 --2- 172.21.15.53:0/534351015 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48600718e0 0x7f4860151f50 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:50.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.416+0000 7f4865003640 1 -- 172.21.15.53:0/534351015 >> 172.21.15.53:0/534351015 conn(0x7f48600cafc0 msgr2=0x7f4860158630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:50.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.416+0000 7f4865003640 1 -- 172.21.15.53:0/534351015 shutdown_connections 2023-06-10T18:52:50.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:50.416+0000 7f4865003640 1 -- 172.21.15.53:0/534351015 wait complete. 2023-06-10T18:52:50.443 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-06-10T18:52:49.559373+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":173,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235052,"kb_used_data":3052,"kb_used_omap":0,"kb_used_meta":231936,"kb_avail":754739668,"statfs":{"total":773094113280,"available":772853420032,"internally_reserved":0,"allocated":3125248,"data_stored":1872583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":237502464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":54,"apply_latency_ms":54,"commit_latency_ns":54000000,"apply_latency_ns":54000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001839"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.093989+0000","last_change":"2023-06-10T18:52:44.947732+0000","last_active":"2023-06-10T18:52:47.093989+0000","last_peered":"2023-06-10T18:52:47.093989+0000","last_clean":"2023-06-10T18:52:47.093989+0000","last_became_active":"2023-06-10T18:52:44.947398+0000","last_became_peered":"2023-06-10T18:52:44.947398+0000","last_unstale":"2023-06-10T18:52:47.093989+0000","last_undegraded":"2023-06-10T18:52:47.093989+0000","last_fullsized":"2023-06-10T18:52:47.093989+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:06:36.663322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.935057+0000","last_change":"2023-06-10T18:52:44.961438+0000","last_active":"2023-06-10T18:52:45.935057+0000","last_peered":"2023-06-10T18:52:45.935057+0000","last_clean":"2023-06-10T18:52:45.935057+0000","last_became_active":"2023-06-10T18:52:44.961134+0000","last_became_peered":"2023-06-10T18:52:44.961134+0000","last_unstale":"2023-06-10T18:52:45.935057+0000","last_undegraded":"2023-06-10T18:52:45.935057+0000","last_fullsized":"2023-06-10T18:52:45.935057+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:49:49.618852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.931821+0000","last_change":"2023-06-10T18:52:44.955647+0000","last_active":"2023-06-10T18:52:45.931821+0000","last_peered":"2023-06-10T18:52:45.931821+0000","last_clean":"2023-06-10T18:52:45.931821+0000","last_became_active":"2023-06-10T18:52:44.955093+0000","last_became_peered":"2023-06-10T18:52:44.955093+0000","last_unstale":"2023-06-10T18:52:45.931821+0000","last_undegraded":"2023-06-10T18:52:45.931821+0000","last_fullsized":"2023-06-10T18:52:45.931821+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:37:28.673117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.095194+0000","last_change":"2023-06-10T18:52:44.940992+0000","last_active":"2023-06-10T18:52:47.095194+0000","last_peered":"2023-06-10T18:52:47.095194+0000","last_clean":"2023-06-10T18:52:47.095194+0000","last_became_active":"2023-06-10T18:52:44.940703+0000","last_became_peered":"2023-06-10T18:52:44.940703+0000","last_unstale":"2023-06-10T18:52:47.095194+0000","last_undegraded":"2023-06-10T18:52:47.095194+0000","last_fullsized":"2023-06-10T18:52:47.095194+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:17:13.902888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.074101+0000","last_change":"2023-06-10T18:52:44.954034+0000","last_active":"2023-06-10T18:52:47.074101+0000","last_peered":"2023-06-10T18:52:47.074101+0000","last_clean":"2023-06-10T18:52:47.074101+0000","last_became_active":"2023-06-10T18:52:44.953626+0000","last_became_peered":"2023-06-10T18:52:44.953626+0000","last_unstale":"2023-06-10T18:52:47.074101+0000","last_undegraded":"2023-06-10T18:52:47.074101+0000","last_fullsized":"2023-06-10T18:52:47.074101+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:41:13.376627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.932554+0000","last_change":"2023-06-10T18:52:44.944206+0000","last_active":"2023-06-10T18:52:45.932554+0000","last_peered":"2023-06-10T18:52:45.932554+0000","last_clean":"2023-06-10T18:52:45.932554+0000","last_became_active":"2023-06-10T18:52:44.943687+0000","last_became_peered":"2023-06-10T18:52:44.943687+0000","last_unstale":"2023-06-10T18:52:45.932554+0000","last_undegraded":"2023-06-10T18:52:45.932554+0000","last_fullsized":"2023-06-10T18:52:45.932554+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:02:43.231973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.095766+0000","last_change":"2023-06-10T18:52:44.958696+0000","last_active":"2023-06-10T18:52:47.095766+0000","last_peered":"2023-06-10T18:52:47.095766+0000","last_clean":"2023-06-10T18:52:47.095766+0000","last_became_active":"2023-06-10T18:52:44.958075+0000","last_became_peered":"2023-06-10T18:52:44.958075+0000","last_unstale":"2023-06-10T18:52:47.095766+0000","last_undegraded":"2023-06-10T18:52:47.095766+0000","last_fullsized":"2023-06-10T18:52:47.095766+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T18:54:16.713072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.934329+0000","last_change":"2023-06-10T18:52:44.945375+0000","last_active":"2023-06-10T18:52:45.934329+0000","last_peered":"2023-06-10T18:52:45.934329+0000","last_clean":"2023-06-10T18:52:45.934329+0000","last_became_active":"2023-06-10T18:52:44.945059+0000","last_became_peered":"2023-06-10T18:52:44.945059+0000","last_unstale":"2023-06-10T18:52:45.934329+0000","last_undegraded":"2023-06-10T18:52:45.934329+0000","last_fullsized":"2023-06-10T18:52:45.934329+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:59:51.325397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.073399+0000","last_change":"2023-06-10T18:52:44.960556+0000","last_active":"2023-06-10T18:52:47.073399+0000","last_peered":"2023-06-10T18:52:47.073399+0000","last_clean":"2023-06-10T18:52:47.073399+0000","last_became_active":"2023-06-10T18:52:44.960174+0000","last_became_peered":"2023-06-10T18:52:44.960174+0000","last_unstale":"2023-06-10T18:52:47.073399+0000","last_undegraded":"2023-06-10T18:52:47.073399+0000","last_fullsized":"2023-06-10T18:52:47.073399+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:53:28.618960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.935372+0000","last_change":"2023-06-10T18:52:44.961025+0000","last_active":"2023-06-10T18:52:45.935372+0000","last_peered":"2023-06-10T18:52:45.935372+0000","last_clean":"2023-06-10T18:52:45.935372+0000","last_became_active":"2023-06-10T18:52:44.960661+0000","last_became_peered":"2023-06-10T18:52:44.960661+0000","last_unstale":"2023-06-10T18:52:45.935372+0000","last_undegraded":"2023-06-10T18:52:45.935372+0000","last_fullsized":"2023-06-10T18:52:45.935372+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:02:43.231973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.932039+0000","last_change":"2023-06-10T18:52:44.958300+0000","last_active":"2023-06-10T18:52:45.932039+0000","last_peered":"2023-06-10T18:52:45.932039+0000","last_clean":"2023-06-10T18:52:45.932039+0000","last_became_active":"2023-06-10T18:52:44.958013+0000","last_became_peered":"2023-06-10T18:52:44.958013+0000","last_unstale":"2023-06-10T18:52:45.932039+0000","last_undegraded":"2023-06-10T18:52:45.932039+0000","last_fullsized":"2023-06-10T18:52:45.932039+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:39:10.018608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.094202+0000","last_change":"2023-06-10T18:52:44.951808+0000","last_active":"2023-06-10T18:52:47.094202+0000","last_peered":"2023-06-10T18:52:47.094202+0000","last_clean":"2023-06-10T18:52:47.094202+0000","last_became_active":"2023-06-10T18:52:44.951348+0000","last_became_peered":"2023-06-10T18:52:44.951348+0000","last_unstale":"2023-06-10T18:52:47.094202+0000","last_undegraded":"2023-06-10T18:52:47.094202+0000","last_fullsized":"2023-06-10T18:52:47.094202+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:41:10.737097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.093897+0000","last_change":"2023-06-10T18:52:44.941608+0000","last_active":"2023-06-10T18:52:47.093897+0000","last_peered":"2023-06-10T18:52:47.093897+0000","last_clean":"2023-06-10T18:52:47.093897+0000","last_became_active":"2023-06-10T18:52:44.941232+0000","last_became_peered":"2023-06-10T18:52:44.941232+0000","last_unstale":"2023-06-10T18:52:47.093897+0000","last_undegraded":"2023-06-10T18:52:47.093897+0000","last_fullsized":"2023-06-10T18:52:47.093897+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:34:30.103416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.935166+0000","last_change":"2023-06-10T18:52:44.946464+0000","last_active":"2023-06-10T18:52:45.935166+0000","last_peered":"2023-06-10T18:52:45.935166+0000","last_clean":"2023-06-10T18:52:45.935166+0000","last_became_active":"2023-06-10T18:52:44.946097+0000","last_became_peered":"2023-06-10T18:52:44.946097+0000","last_unstale":"2023-06-10T18:52:45.935166+0000","last_undegraded":"2023-06-10T18:52:45.935166+0000","last_fullsized":"2023-06-10T18:52:45.935166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:37:26.347275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.096155+0000","last_change":"2023-06-10T18:52:44.958946+0000","last_active":"2023-06-10T18:52:47.096155+0000","last_peered":"2023-06-10T18:52:47.096155+0000","last_clean":"2023-06-10T18:52:47.096155+0000","last_became_active":"2023-06-10T18:52:44.958439+0000","last_became_peered":"2023-06-10T18:52:44.958439+0000","last_unstale":"2023-06-10T18:52:47.096155+0000","last_undegraded":"2023-06-10T18:52:47.096155+0000","last_fullsized":"2023-06-10T18:52:47.096155+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:14:11.506328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.931732+0000","last_change":"2023-06-10T18:52:44.946069+0000","last_active":"2023-06-10T18:52:45.931732+0000","last_peered":"2023-06-10T18:52:45.931732+0000","last_clean":"2023-06-10T18:52:45.931732+0000","last_became_active":"2023-06-10T18:52:44.945560+0000","last_became_peered":"2023-06-10T18:52:44.945560+0000","last_unstale":"2023-06-10T18:52:45.931732+0000","last_undegraded":"2023-06-10T18:52:45.931732+0000","last_fullsized":"2023-06-10T18:52:45.931732+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:08:50.331605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.073341+0000","last_change":"2023-06-10T18:52:44.961858+0000","last_active":"2023-06-10T18:52:47.073341+0000","last_peered":"2023-06-10T18:52:47.073341+0000","last_clean":"2023-06-10T18:52:47.073341+0000","last_became_active":"2023-06-10T18:52:44.961540+0000","last_became_peered":"2023-06-10T18:52:44.961540+0000","last_unstale":"2023-06-10T18:52:47.073341+0000","last_undegraded":"2023-06-10T18:52:47.073341+0000","last_fullsized":"2023-06-10T18:52:47.073341+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:08:50.331605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.932034+0000","last_change":"2023-06-10T18:52:44.939005+0000","last_active":"2023-06-10T18:52:45.932034+0000","last_peered":"2023-06-10T18:52:45.932034+0000","last_clean":"2023-06-10T18:52:45.932034+0000","last_became_active":"2023-06-10T18:52:44.938775+0000","last_became_peered":"2023-06-10T18:52:44.938775+0000","last_unstale":"2023-06-10T18:52:45.932034+0000","last_undegraded":"2023-06-10T18:52:45.932034+0000","last_fullsized":"2023-06-10T18:52:45.932034+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:42:51.947168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.094083+0000","last_change":"2023-06-10T18:52:44.941417+0000","last_active":"2023-06-10T18:52:47.094083+0000","last_peered":"2023-06-10T18:52:47.094083+0000","last_clean":"2023-06-10T18:52:47.094083+0000","last_became_active":"2023-06-10T18:52:44.940980+0000","last_became_peered":"2023-06-10T18:52:44.940980+0000","last_unstale":"2023-06-10T18:52:47.094083+0000","last_undegraded":"2023-06-10T18:52:47.094083+0000","last_fullsized":"2023-06-10T18:52:47.094083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:33:22.583233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.932218+0000","last_change":"2023-06-10T18:52:44.944705+0000","last_active":"2023-06-10T18:52:45.932218+0000","last_peered":"2023-06-10T18:52:45.932218+0000","last_clean":"2023-06-10T18:52:45.932218+0000","last_became_active":"2023-06-10T18:52:44.944399+0000","last_became_peered":"2023-06-10T18:52:44.944399+0000","last_unstale":"2023-06-10T18:52:45.932218+0000","last_undegraded":"2023-06-10T18:52:45.932218+0000","last_fullsized":"2023-06-10T18:52:45.932218+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:39:06.207720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.096145+0000","last_change":"2023-06-10T18:52:44.959863+0000","last_active":"2023-06-10T18:52:47.096145+0000","last_peered":"2023-06-10T18:52:47.096145+0000","last_clean":"2023-06-10T18:52:47.096145+0000","last_became_active":"2023-06-10T18:52:44.959556+0000","last_became_peered":"2023-06-10T18:52:44.959556+0000","last_unstale":"2023-06-10T18:52:47.096145+0000","last_undegraded":"2023-06-10T18:52:47.096145+0000","last_fullsized":"2023-06-10T18:52:47.096145+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:02:43.231973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.073202+0000","last_change":"2023-06-10T18:52:44.961343+0000","last_active":"2023-06-10T18:52:47.073202+0000","last_peered":"2023-06-10T18:52:47.073202+0000","last_clean":"2023-06-10T18:52:47.073202+0000","last_became_active":"2023-06-10T18:52:44.960957+0000","last_became_peered":"2023-06-10T18:52:44.960957+0000","last_unstale":"2023-06-10T18:52:47.073202+0000","last_undegraded":"2023-06-10T18:52:47.073202+0000","last_fullsized":"2023-06-10T18:52:47.073202+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:54:34.871667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.929467+0000","last_change":"2023-06-10T18:52:44.952488+0000","last_active":"2023-06-10T18:52:45.929467+0000","last_peered":"2023-06-10T18:52:45.929467+0000","last_clean":"2023-06-10T18:52:45.929467+0000","last_became_active":"2023-06-10T18:52:44.951957+0000","last_became_peered":"2023-06-10T18:52:44.951957+0000","last_unstale":"2023-06-10T18:52:45.929467+0000","last_undegraded":"2023-06-10T18:52:45.929467+0000","last_fullsized":"2023-06-10T18:52:45.929467+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:31:20.946172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.094882+0000","last_change":"2023-06-10T18:52:44.960097+0000","last_active":"2023-06-10T18:52:47.094882+0000","last_peered":"2023-06-10T18:52:47.094882+0000","last_clean":"2023-06-10T18:52:47.094882+0000","last_became_active":"2023-06-10T18:52:44.959605+0000","last_became_peered":"2023-06-10T18:52:44.959605+0000","last_unstale":"2023-06-10T18:52:47.094882+0000","last_undegraded":"2023-06-10T18:52:47.094882+0000","last_fullsized":"2023-06-10T18:52:47.094882+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:08:04.480136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.095654+0000","last_change":"2023-06-10T18:52:44.956446+0000","last_active":"2023-06-10T18:52:47.095654+0000","last_peered":"2023-06-10T18:52:47.095654+0000","last_clean":"2023-06-10T18:52:47.095654+0000","last_became_active":"2023-06-10T18:52:44.954175+0000","last_became_peered":"2023-06-10T18:52:44.954175+0000","last_unstale":"2023-06-10T18:52:47.095654+0000","last_undegraded":"2023-06-10T18:52:47.095654+0000","last_fullsized":"2023-06-10T18:52:47.095654+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T18:54:16.713072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.095401+0000","last_change":"2023-06-10T18:52:44.956942+0000","last_active":"2023-06-10T18:52:47.095401+0000","last_peered":"2023-06-10T18:52:47.095401+0000","last_clean":"2023-06-10T18:52:47.095401+0000","last_became_active":"2023-06-10T18:52:44.953322+0000","last_became_peered":"2023-06-10T18:52:44.953322+0000","last_unstale":"2023-06-10T18:52:47.095401+0000","last_undegraded":"2023-06-10T18:52:47.095401+0000","last_fullsized":"2023-06-10T18:52:47.095401+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:39:10.018608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.934856+0000","last_change":"2023-06-10T18:52:44.942786+0000","last_active":"2023-06-10T18:52:45.934856+0000","last_peered":"2023-06-10T18:52:45.934856+0000","last_clean":"2023-06-10T18:52:45.934856+0000","last_became_active":"2023-06-10T18:52:44.942216+0000","last_became_peered":"2023-06-10T18:52:44.942216+0000","last_unstale":"2023-06-10T18:52:45.934856+0000","last_undegraded":"2023-06-10T18:52:45.934856+0000","last_fullsized":"2023-06-10T18:52:45.934856+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:08:04.480136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.095440+0000","last_change":"2023-06-10T18:52:44.958527+0000","last_active":"2023-06-10T18:52:47.095440+0000","last_peered":"2023-06-10T18:52:47.095440+0000","last_clean":"2023-06-10T18:52:47.095440+0000","last_became_active":"2023-06-10T18:52:44.958233+0000","last_became_peered":"2023-06-10T18:52:44.958233+0000","last_unstale":"2023-06-10T18:52:47.095440+0000","last_undegraded":"2023-06-10T18:52:47.095440+0000","last_fullsized":"2023-06-10T18:52:47.095440+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:08:04.480136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.930241+0000","last_change":"2023-06-10T18:52:44.946412+0000","last_active":"2023-06-10T18:52:45.930241+0000","last_peered":"2023-06-10T18:52:45.930241+0000","last_clean":"2023-06-10T18:52:45.930241+0000","last_became_active":"2023-06-10T18:52:44.945955+0000","last_became_peered":"2023-06-10T18:52:44.945955+0000","last_unstale":"2023-06-10T18:52:45.930241+0000","last_undegraded":"2023-06-10T18:52:45.930241+0000","last_fullsized":"2023-06-10T18:52:45.930241+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:08:04.480136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.932719+0000","last_change":"2023-06-10T18:52:44.942149+0000","last_active":"2023-06-10T18:52:45.932719+0000","last_peered":"2023-06-10T18:52:45.932719+0000","last_clean":"2023-06-10T18:52:45.932719+0000","last_became_active":"2023-06-10T18:52:44.939204+0000","last_became_peered":"2023-06-10T18:52:44.939204+0000","last_unstale":"2023-06-10T18:52:45.932719+0000","last_undegraded":"2023-06-10T18:52:45.932719+0000","last_fullsized":"2023-06-10T18:52:45.932719+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:14:11.506328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.929536+0000","last_change":"2023-06-10T18:52:44.960157+0000","last_active":"2023-06-10T18:52:45.929536+0000","last_peered":"2023-06-10T18:52:45.929536+0000","last_clean":"2023-06-10T18:52:45.929536+0000","last_became_active":"2023-06-10T18:52:44.959460+0000","last_became_peered":"2023-06-10T18:52:44.959460+0000","last_unstale":"2023-06-10T18:52:45.929536+0000","last_undegraded":"2023-06-10T18:52:45.929536+0000","last_fullsized":"2023-06-10T18:52:45.929536+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:53:28.618960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.094637+0000","last_change":"2023-06-10T18:52:44.937198+0000","last_active":"2023-06-10T18:52:47.094637+0000","last_peered":"2023-06-10T18:52:47.094637+0000","last_clean":"2023-06-10T18:52:47.094637+0000","last_became_active":"2023-06-10T18:52:44.936793+0000","last_became_peered":"2023-06-10T18:52:44.936793+0000","last_unstale":"2023-06-10T18:52:47.094637+0000","last_undegraded":"2023-06-10T18:52:47.094637+0000","last_fullsized":"2023-06-10T18:52:47.094637+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:46:29.935621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.929593+0000","last_change":"2023-06-10T18:52:44.955794+0000","last_active":"2023-06-10T18:52:45.929593+0000","last_peered":"2023-06-10T18:52:45.929593+0000","last_clean":"2023-06-10T18:52:45.929593+0000","last_became_active":"2023-06-10T18:52:44.955013+0000","last_became_peered":"2023-06-10T18:52:44.955013+0000","last_unstale":"2023-06-10T18:52:45.929593+0000","last_undegraded":"2023-06-10T18:52:45.929593+0000","last_fullsized":"2023-06-10T18:52:45.929593+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:37:28.673117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.096398+0000","last_change":"2023-06-10T18:52:44.586121+0000","last_active":"2023-06-10T18:52:47.096398+0000","last_peered":"2023-06-10T18:52:47.096398+0000","last_clean":"2023-06-10T18:52:47.096398+0000","last_became_active":"2023-06-10T18:52:44.584334+0000","last_became_peered":"2023-06-10T18:52:44.584334+0000","last_unstale":"2023-06-10T18:52:47.096398+0000","last_undegraded":"2023-06-10T18:52:47.096398+0000","last_fullsized":"2023-06-10T18:52:47.096398+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:44:27.810129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.934843+0000","last_change":"2023-06-10T18:52:44.942980+0000","last_active":"2023-06-10T18:52:45.934843+0000","last_peered":"2023-06-10T18:52:45.934843+0000","last_clean":"2023-06-10T18:52:45.934843+0000","last_became_active":"2023-06-10T18:52:44.942538+0000","last_became_peered":"2023-06-10T18:52:44.942538+0000","last_unstale":"2023-06-10T18:52:45.934843+0000","last_undegraded":"2023-06-10T18:52:45.934843+0000","last_fullsized":"2023-06-10T18:52:45.934843+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:39:06.207720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.073250+0000","last_change":"2023-06-10T18:52:44.573070+0000","last_active":"2023-06-10T18:52:47.073250+0000","last_peered":"2023-06-10T18:52:47.073250+0000","last_clean":"2023-06-10T18:52:47.073250+0000","last_became_active":"2023-06-10T18:52:44.572659+0000","last_became_peered":"2023-06-10T18:52:44.572659+0000","last_unstale":"2023-06-10T18:52:47.073250+0000","last_undegraded":"2023-06-10T18:52:47.073250+0000","last_fullsized":"2023-06-10T18:52:47.073250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:31:19.942168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.073865+0000","last_change":"2023-06-10T18:52:44.966527+0000","last_active":"2023-06-10T18:52:47.073865+0000","last_peered":"2023-06-10T18:52:47.073865+0000","last_clean":"2023-06-10T18:52:47.073865+0000","last_became_active":"2023-06-10T18:52:44.962455+0000","last_became_peered":"2023-06-10T18:52:44.962455+0000","last_unstale":"2023-06-10T18:52:47.073865+0000","last_undegraded":"2023-06-10T18:52:47.073865+0000","last_fullsized":"2023-06-10T18:52:47.073865+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:39:06.207720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.096102+0000","last_change":"2023-06-10T18:52:44.584545+0000","last_active":"2023-06-10T18:52:47.096102+0000","last_peered":"2023-06-10T18:52:47.096102+0000","last_clean":"2023-06-10T18:52:47.096102+0000","last_became_active":"2023-06-10T18:52:44.583973+0000","last_became_peered":"2023-06-10T18:52:44.583973+0000","last_unstale":"2023-06-10T18:52:47.096102+0000","last_undegraded":"2023-06-10T18:52:47.096102+0000","last_fullsized":"2023-06-10T18:52:47.096102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:37:25.343271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.929677+0000","last_change":"2023-06-10T18:52:44.946578+0000","last_active":"2023-06-10T18:52:45.929677+0000","last_peered":"2023-06-10T18:52:45.929677+0000","last_clean":"2023-06-10T18:52:45.929677+0000","last_became_active":"2023-06-10T18:52:44.945951+0000","last_became_peered":"2023-06-10T18:52:44.945951+0000","last_unstale":"2023-06-10T18:52:45.929677+0000","last_undegraded":"2023-06-10T18:52:45.929677+0000","last_fullsized":"2023-06-10T18:52:45.929677+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:59:51.325397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.094726+0000","last_change":"2023-06-10T18:52:44.556644+0000","last_active":"2023-06-10T18:52:47.094726+0000","last_peered":"2023-06-10T18:52:47.094726+0000","last_clean":"2023-06-10T18:52:47.094726+0000","last_became_active":"2023-06-10T18:52:44.554676+0000","last_became_peered":"2023-06-10T18:52:44.554676+0000","last_unstale":"2023-06-10T18:52:47.094726+0000","last_undegraded":"2023-06-10T18:52:47.094726+0000","last_fullsized":"2023-06-10T18:52:47.094726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:39:58.210679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.096897+0000","last_change":"2023-06-10T18:52:44.586426+0000","last_active":"2023-06-10T18:52:47.096897+0000","last_peered":"2023-06-10T18:52:47.096897+0000","last_clean":"2023-06-10T18:52:47.096897+0000","last_became_active":"2023-06-10T18:52:44.585486+0000","last_became_peered":"2023-06-10T18:52:44.585486+0000","last_unstale":"2023-06-10T18:52:47.096897+0000","last_undegraded":"2023-06-10T18:52:47.096897+0000","last_fullsized":"2023-06-10T18:52:47.096897+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:21:48.058795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.934330+0000","last_change":"2023-06-10T18:52:44.948157+0000","last_active":"2023-06-10T18:52:45.934330+0000","last_peered":"2023-06-10T18:52:45.934330+0000","last_clean":"2023-06-10T18:52:45.934330+0000","last_became_active":"2023-06-10T18:52:44.947864+0000","last_became_peered":"2023-06-10T18:52:44.947864+0000","last_unstale":"2023-06-10T18:52:45.934330+0000","last_undegraded":"2023-06-10T18:52:45.934330+0000","last_fullsized":"2023-06-10T18:52:45.934330+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:42:51.947168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.096656+0000","last_change":"2023-06-10T18:52:44.585679+0000","last_active":"2023-06-10T18:52:47.096656+0000","last_peered":"2023-06-10T18:52:47.096656+0000","last_clean":"2023-06-10T18:52:47.096656+0000","last_became_active":"2023-06-10T18:52:44.585190+0000","last_became_peered":"2023-06-10T18:52:44.585190+0000","last_unstale":"2023-06-10T18:52:47.096656+0000","last_undegraded":"2023-06-10T18:52:47.096656+0000","last_fullsized":"2023-06-10T18:52:47.096656+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:28:02.644430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.932803+0000","last_change":"2023-06-10T18:52:44.958947+0000","last_active":"2023-06-10T18:52:45.932803+0000","last_peered":"2023-06-10T18:52:45.932803+0000","last_clean":"2023-06-10T18:52:45.932803+0000","last_became_active":"2023-06-10T18:52:44.958289+0000","last_became_peered":"2023-06-10T18:52:44.958289+0000","last_unstale":"2023-06-10T18:52:45.932803+0000","last_undegraded":"2023-06-10T18:52:45.932803+0000","last_fullsized":"2023-06-10T18:52:45.932803+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:34:51.394045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.096353+0000","last_change":"2023-06-10T18:52:44.581981+0000","last_active":"2023-06-10T18:52:47.096353+0000","last_peered":"2023-06-10T18:52:47.096353+0000","last_clean":"2023-06-10T18:52:47.096353+0000","last_became_active":"2023-06-10T18:52:44.581382+0000","last_became_peered":"2023-06-10T18:52:44.581382+0000","last_unstale":"2023-06-10T18:52:47.096353+0000","last_undegraded":"2023-06-10T18:52:47.096353+0000","last_fullsized":"2023-06-10T18:52:47.096353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:34:50.390041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.094856+0000","last_change":"2023-06-10T18:52:44.958474+0000","last_active":"2023-06-10T18:52:47.094856+0000","last_peered":"2023-06-10T18:52:47.094856+0000","last_clean":"2023-06-10T18:52:47.094856+0000","last_became_active":"2023-06-10T18:52:44.958186+0000","last_became_peered":"2023-06-10T18:52:44.958186+0000","last_unstale":"2023-06-10T18:52:47.094856+0000","last_undegraded":"2023-06-10T18:52:47.094856+0000","last_fullsized":"2023-06-10T18:52:47.094856+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:38:29.923050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.934807+0000","last_change":"2023-06-10T18:52:44.559256+0000","last_active":"2023-06-10T18:52:45.934807+0000","last_peered":"2023-06-10T18:52:45.934807+0000","last_clean":"2023-06-10T18:52:45.934807+0000","last_became_active":"2023-06-10T18:52:44.558447+0000","last_became_peered":"2023-06-10T18:52:44.558447+0000","last_unstale":"2023-06-10T18:52:45.934807+0000","last_undegraded":"2023-06-10T18:52:45.934807+0000","last_fullsized":"2023-06-10T18:52:45.934807+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:39:09.014604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.073739+0000","last_change":"2023-06-10T18:52:44.962607+0000","last_active":"2023-06-10T18:52:47.073739+0000","last_peered":"2023-06-10T18:52:47.073739+0000","last_clean":"2023-06-10T18:52:47.073739+0000","last_became_active":"2023-06-10T18:52:44.962105+0000","last_became_peered":"2023-06-10T18:52:44.962105+0000","last_unstale":"2023-06-10T18:52:47.073739+0000","last_undegraded":"2023-06-10T18:52:47.073739+0000","last_fullsized":"2023-06-10T18:52:47.073739+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:39:10.888321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.930610+0000","last_change":"2023-06-10T18:52:44.559397+0000","last_active":"2023-06-10T18:52:45.930610+0000","last_peered":"2023-06-10T18:52:45.930610+0000","last_clean":"2023-06-10T18:52:45.930610+0000","last_became_active":"2023-06-10T18:52:44.558955+0000","last_became_peered":"2023-06-10T18:52:44.558955+0000","last_unstale":"2023-06-10T18:52:45.930610+0000","last_undegraded":"2023-06-10T18:52:45.930610+0000","last_fullsized":"2023-06-10T18:52:45.930610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:49:48.614848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.931811+0000","last_change":"2023-06-10T18:52:44.955143+0000","last_active":"2023-06-10T18:52:45.931811+0000","last_peered":"2023-06-10T18:52:45.931811+0000","last_clean":"2023-06-10T18:52:45.931811+0000","last_became_active":"2023-06-10T18:52:44.954157+0000","last_became_peered":"2023-06-10T18:52:44.954157+0000","last_unstale":"2023-06-10T18:52:45.931811+0000","last_undegraded":"2023-06-10T18:52:45.931811+0000","last_fullsized":"2023-06-10T18:52:45.931811+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:53:28.618960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.095432+0000","last_change":"2023-06-10T18:52:44.575768+0000","last_active":"2023-06-10T18:52:47.095432+0000","last_peered":"2023-06-10T18:52:47.095432+0000","last_clean":"2023-06-10T18:52:47.095432+0000","last_became_active":"2023-06-10T18:52:44.575122+0000","last_became_peered":"2023-06-10T18:52:44.575122+0000","last_unstale":"2023-06-10T18:52:47.095432+0000","last_undegraded":"2023-06-10T18:52:47.095432+0000","last_fullsized":"2023-06-10T18:52:47.095432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:01:26.727248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.932347+0000","last_change":"2023-06-10T18:52:44.938302+0000","last_active":"2023-06-10T18:52:45.932347+0000","last_peered":"2023-06-10T18:52:45.932347+0000","last_clean":"2023-06-10T18:52:45.932347+0000","last_became_active":"2023-06-10T18:52:44.938005+0000","last_became_peered":"2023-06-10T18:52:44.938005+0000","last_unstale":"2023-06-10T18:52:45.932347+0000","last_undegraded":"2023-06-10T18:52:45.932347+0000","last_fullsized":"2023-06-10T18:52:45.932347+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:49:49.618852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.932470+0000","last_change":"2023-06-10T18:52:44.561044+0000","last_active":"2023-06-10T18:52:45.932470+0000","last_peered":"2023-06-10T18:52:45.932470+0000","last_clean":"2023-06-10T18:52:45.932470+0000","last_became_active":"2023-06-10T18:52:44.560233+0000","last_became_peered":"2023-06-10T18:52:44.560233+0000","last_unstale":"2023-06-10T18:52:45.932470+0000","last_undegraded":"2023-06-10T18:52:45.932470+0000","last_fullsized":"2023-06-10T18:52:45.932470+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:37:25.343271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.932395+0000","last_change":"2023-06-10T18:52:44.951038+0000","last_active":"2023-06-10T18:52:45.932395+0000","last_peered":"2023-06-10T18:52:45.932395+0000","last_clean":"2023-06-10T18:52:45.932395+0000","last_became_active":"2023-06-10T18:52:44.942868+0000","last_became_peered":"2023-06-10T18:52:44.942868+0000","last_unstale":"2023-06-10T18:52:45.932395+0000","last_undegraded":"2023-06-10T18:52:45.932395+0000","last_fullsized":"2023-06-10T18:52:45.932395+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:41:13.376627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.929453+0000","last_change":"2023-06-10T18:52:44.558548+0000","last_active":"2023-06-10T18:52:45.929453+0000","last_peered":"2023-06-10T18:52:45.929453+0000","last_clean":"2023-06-10T18:52:45.929453+0000","last_became_active":"2023-06-10T18:52:44.558194+0000","last_became_peered":"2023-06-10T18:52:44.558194+0000","last_unstale":"2023-06-10T18:52:45.929453+0000","last_undegraded":"2023-06-10T18:52:45.929453+0000","last_fullsized":"2023-06-10T18:52:45.929453+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:54:33.867663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.094869+0000","last_change":"2023-06-10T18:52:44.967155+0000","last_active":"2023-06-10T18:52:47.094869+0000","last_peered":"2023-06-10T18:52:47.094869+0000","last_clean":"2023-06-10T18:52:47.094869+0000","last_became_active":"2023-06-10T18:52:44.966889+0000","last_became_peered":"2023-06-10T18:52:44.966889+0000","last_unstale":"2023-06-10T18:52:47.094869+0000","last_undegraded":"2023-06-10T18:52:47.094869+0000","last_fullsized":"2023-06-10T18:52:47.094869+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:42:51.947168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":175,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.095406+0000","last_change":"2023-06-10T18:52:34.951528+0000","last_active":"2023-06-10T18:52:47.095406+0000","last_peered":"2023-06-10T18:52:47.095406+0000","last_clean":"2023-06-10T18:52:47.095406+0000","last_became_active":"2023-06-10T18:52:34.949099+0000","last_became_peered":"2023-06-10T18:52:34.949099+0000","last_unstale":"2023-06-10T18:52:47.095406+0000","last_undegraded":"2023-06-10T18:52:47.095406+0000","last_fullsized":"2023-06-10T18:52:47.095406+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_clean_scrub_stamp":"2023-06-10T18:52:33.633295+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:41:02.488686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.934561+0000","last_change":"2023-06-10T18:52:40.506384+0000","last_active":"2023-06-10T18:52:45.934561+0000","last_peered":"2023-06-10T18:52:45.934561+0000","last_clean":"2023-06-10T18:52:45.934561+0000","last_became_active":"2023-06-10T18:52:40.505701+0000","last_became_peered":"2023-06-10T18:52:40.505701+0000","last_unstale":"2023-06-10T18:52:45.934561+0000","last_undegraded":"2023-06-10T18:52:45.934561+0000","last_fullsized":"2023-06-10T18:52:45.934561+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:39:05.841926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.929409+0000","last_change":"2023-06-10T18:52:44.563326+0000","last_active":"2023-06-10T18:52:45.929409+0000","last_peered":"2023-06-10T18:52:45.929409+0000","last_clean":"2023-06-10T18:52:45.929409+0000","last_became_active":"2023-06-10T18:52:44.562901+0000","last_became_peered":"2023-06-10T18:52:44.562901+0000","last_unstale":"2023-06-10T18:52:45.929409+0000","last_undegraded":"2023-06-10T18:52:45.929409+0000","last_fullsized":"2023-06-10T18:52:45.929409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:29:32.049058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.095326+0000","last_change":"2023-06-10T18:52:44.940336+0000","last_active":"2023-06-10T18:52:47.095326+0000","last_peered":"2023-06-10T18:52:47.095326+0000","last_clean":"2023-06-10T18:52:47.095326+0000","last_became_active":"2023-06-10T18:52:44.939935+0000","last_became_peered":"2023-06-10T18:52:44.939935+0000","last_unstale":"2023-06-10T18:52:47.095326+0000","last_undegraded":"2023-06-10T18:52:47.095326+0000","last_fullsized":"2023-06-10T18:52:47.095326+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:42:44.531042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.095044+0000","last_change":"2023-06-10T18:52:40.512015+0000","last_active":"2023-06-10T18:52:47.095044+0000","last_peered":"2023-06-10T18:52:47.095044+0000","last_clean":"2023-06-10T18:52:47.095044+0000","last_became_active":"2023-06-10T18:52:40.511382+0000","last_became_peered":"2023-06-10T18:52:40.511382+0000","last_unstale":"2023-06-10T18:52:47.095044+0000","last_undegraded":"2023-06-10T18:52:47.095044+0000","last_fullsized":"2023-06-10T18:52:47.095044+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:49:44.572458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.073029+0000","last_change":"2023-06-10T18:52:44.575339+0000","last_active":"2023-06-10T18:52:47.073029+0000","last_peered":"2023-06-10T18:52:47.073029+0000","last_clean":"2023-06-10T18:52:47.073029+0000","last_became_active":"2023-06-10T18:52:44.575020+0000","last_became_peered":"2023-06-10T18:52:44.575020+0000","last_unstale":"2023-06-10T18:52:47.073029+0000","last_undegraded":"2023-06-10T18:52:47.073029+0000","last_fullsized":"2023-06-10T18:52:47.073029+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:29:32.049058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.073832+0000","last_change":"2023-06-10T18:52:44.960817+0000","last_active":"2023-06-10T18:52:47.073832+0000","last_peered":"2023-06-10T18:52:47.073832+0000","last_clean":"2023-06-10T18:52:47.073832+0000","last_became_active":"2023-06-10T18:52:44.960128+0000","last_became_peered":"2023-06-10T18:52:44.960128+0000","last_unstale":"2023-06-10T18:52:47.073832+0000","last_undegraded":"2023-06-10T18:52:47.073832+0000","last_fullsized":"2023-06-10T18:52:47.073832+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:39:10.018608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.093628+0000","last_change":"2023-06-10T18:52:40.671725+0000","last_active":"2023-06-10T18:52:47.093628+0000","last_peered":"2023-06-10T18:52:47.093628+0000","last_clean":"2023-06-10T18:52:47.093628+0000","last_became_active":"2023-06-10T18:52:40.671442+0000","last_became_peered":"2023-06-10T18:52:40.671442+0000","last_unstale":"2023-06-10T18:52:47.093628+0000","last_undegraded":"2023-06-10T18:52:47.093628+0000","last_fullsized":"2023-06-10T18:52:47.093628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:50:04.521612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.094350+0000","last_change":"2023-06-10T18:52:44.554010+0000","last_active":"2023-06-10T18:52:47.094350+0000","last_peered":"2023-06-10T18:52:47.094350+0000","last_clean":"2023-06-10T18:52:47.094350+0000","last_became_active":"2023-06-10T18:52:44.553706+0000","last_became_peered":"2023-06-10T18:52:44.553706+0000","last_unstale":"2023-06-10T18:52:47.094350+0000","last_undegraded":"2023-06-10T18:52:47.094350+0000","last_fullsized":"2023-06-10T18:52:47.094350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:08:49.327602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.094957+0000","last_change":"2023-06-10T18:52:44.954070+0000","last_active":"2023-06-10T18:52:47.094957+0000","last_peered":"2023-06-10T18:52:47.094957+0000","last_clean":"2023-06-10T18:52:47.094957+0000","last_became_active":"2023-06-10T18:52:44.953811+0000","last_became_peered":"2023-06-10T18:52:44.953811+0000","last_unstale":"2023-06-10T18:52:47.094957+0000","last_undegraded":"2023-06-10T18:52:47.094957+0000","last_fullsized":"2023-06-10T18:52:47.094957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:39:10.888321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.935370+0000","last_change":"2023-06-10T18:52:40.510258+0000","last_active":"2023-06-10T18:52:45.935370+0000","last_peered":"2023-06-10T18:52:45.935370+0000","last_clean":"2023-06-10T18:52:45.935370+0000","last_became_active":"2023-06-10T18:52:40.509560+0000","last_became_peered":"2023-06-10T18:52:40.509560+0000","last_unstale":"2023-06-10T18:52:45.935370+0000","last_undegraded":"2023-06-10T18:52:45.935370+0000","last_fullsized":"2023-06-10T18:52:45.935370+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:14:06.459934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.932037+0000","last_change":"2023-06-10T18:52:44.574974+0000","last_active":"2023-06-10T18:52:45.932037+0000","last_peered":"2023-06-10T18:52:45.932037+0000","last_clean":"2023-06-10T18:52:45.932037+0000","last_became_active":"2023-06-10T18:52:44.574115+0000","last_became_peered":"2023-06-10T18:52:44.574115+0000","last_unstale":"2023-06-10T18:52:45.932037+0000","last_undegraded":"2023-06-10T18:52:45.932037+0000","last_fullsized":"2023-06-10T18:52:45.932037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:39:09.884317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.095249+0000","last_change":"2023-06-10T18:52:44.954466+0000","last_active":"2023-06-10T18:52:47.095249+0000","last_peered":"2023-06-10T18:52:47.095249+0000","last_clean":"2023-06-10T18:52:47.095249+0000","last_became_active":"2023-06-10T18:52:44.953993+0000","last_became_peered":"2023-06-10T18:52:44.953993+0000","last_unstale":"2023-06-10T18:52:47.095249+0000","last_undegraded":"2023-06-10T18:52:47.095249+0000","last_fullsized":"2023-06-10T18:52:47.095249+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:50:18.328232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.935077+0000","last_change":"2023-06-10T18:52:44.558952+0000","last_active":"2023-06-10T18:52:45.935077+0000","last_peered":"2023-06-10T18:52:45.935077+0000","last_clean":"2023-06-10T18:52:45.935077+0000","last_became_active":"2023-06-10T18:52:44.558238+0000","last_became_peered":"2023-06-10T18:52:44.558238+0000","last_unstale":"2023-06-10T18:52:45.935077+0000","last_undegraded":"2023-06-10T18:52:45.935077+0000","last_fullsized":"2023-06-10T18:52:45.935077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T18:54:15.709068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.095574+0000","last_change":"2023-06-10T18:52:40.672266+0000","last_active":"2023-06-10T18:52:47.095574+0000","last_peered":"2023-06-10T18:52:47.095574+0000","last_clean":"2023-06-10T18:52:47.095574+0000","last_became_active":"2023-06-10T18:52:40.671966+0000","last_became_peered":"2023-06-10T18:52:40.671966+0000","last_unstale":"2023-06-10T18:52:47.095574+0000","last_undegraded":"2023-06-10T18:52:47.095574+0000","last_fullsized":"2023-06-10T18:52:47.095574+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:41:08.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.094687+0000","last_change":"2023-06-10T18:52:44.953256+0000","last_active":"2023-06-10T18:52:47.094687+0000","last_peered":"2023-06-10T18:52:47.094687+0000","last_clean":"2023-06-10T18:52:47.094687+0000","last_became_active":"2023-06-10T18:52:44.952882+0000","last_became_peered":"2023-06-10T18:52:44.952882+0000","last_unstale":"2023-06-10T18:52:47.094687+0000","last_undegraded":"2023-06-10T18:52:47.094687+0000","last_fullsized":"2023-06-10T18:52:47.094687+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:37:28.673117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.095401+0000","last_change":"2023-06-10T18:52:44.555209+0000","last_active":"2023-06-10T18:52:47.095401+0000","last_peered":"2023-06-10T18:52:47.095401+0000","last_clean":"2023-06-10T18:52:47.095401+0000","last_became_active":"2023-06-10T18:52:44.554807+0000","last_became_peered":"2023-06-10T18:52:44.554807+0000","last_unstale":"2023-06-10T18:52:47.095401+0000","last_undegraded":"2023-06-10T18:52:47.095401+0000","last_fullsized":"2023-06-10T18:52:47.095401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:39:05.203717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.096653+0000","last_change":"2023-06-10T18:52:40.671084+0000","last_active":"2023-06-10T18:52:47.096653+0000","last_peered":"2023-06-10T18:52:47.096653+0000","last_clean":"2023-06-10T18:52:47.096653+0000","last_became_active":"2023-06-10T18:52:40.670697+0000","last_became_peered":"2023-06-10T18:52:40.670697+0000","last_unstale":"2023-06-10T18:52:47.096653+0000","last_undegraded":"2023-06-10T18:52:47.096653+0000","last_fullsized":"2023-06-10T18:52:47.096653+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:32:49.983600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.073669+0000","last_change":"2023-06-10T18:52:44.952636+0000","last_active":"2023-06-10T18:52:47.073669+0000","last_peered":"2023-06-10T18:52:47.073669+0000","last_clean":"2023-06-10T18:52:47.073669+0000","last_became_active":"2023-06-10T18:52:44.952234+0000","last_became_peered":"2023-06-10T18:52:44.952234+0000","last_unstale":"2023-06-10T18:52:47.073669+0000","last_undegraded":"2023-06-10T18:52:47.073669+0000","last_fullsized":"2023-06-10T18:52:47.073669+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:59:51.325397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.929887+0000","last_change":"2023-06-10T18:52:44.573554+0000","last_active":"2023-06-10T18:52:45.929887+0000","last_peered":"2023-06-10T18:52:45.929887+0000","last_clean":"2023-06-10T18:52:45.929887+0000","last_became_active":"2023-06-10T18:52:44.573142+0000","last_became_peered":"2023-06-10T18:52:44.573142+0000","last_unstale":"2023-06-10T18:52:45.929887+0000","last_undegraded":"2023-06-10T18:52:45.929887+0000","last_fullsized":"2023-06-10T18:52:45.929887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:39:05.203717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.095517+0000","last_change":"2023-06-10T18:52:40.514114+0000","last_active":"2023-06-10T18:52:47.095517+0000","last_peered":"2023-06-10T18:52:47.095517+0000","last_clean":"2023-06-10T18:52:47.095517+0000","last_became_active":"2023-06-10T18:52:40.513638+0000","last_became_peered":"2023-06-10T18:52:40.513638+0000","last_unstale":"2023-06-10T18:52:47.095517+0000","last_undegraded":"2023-06-10T18:52:47.095517+0000","last_fullsized":"2023-06-10T18:52:47.095517+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:49:44.572458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.929271+0000","last_change":"2023-06-10T18:52:44.949048+0000","last_active":"2023-06-10T18:52:45.929271+0000","last_peered":"2023-06-10T18:52:45.929271+0000","last_clean":"2023-06-10T18:52:45.929271+0000","last_became_active":"2023-06-10T18:52:44.948643+0000","last_became_peered":"2023-06-10T18:52:44.948643+0000","last_unstale":"2023-06-10T18:52:45.929271+0000","last_undegraded":"2023-06-10T18:52:45.929271+0000","last_fullsized":"2023-06-10T18:52:45.929271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:38:52.793572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.073972+0000","last_change":"2023-06-10T18:52:44.555532+0000","last_active":"2023-06-10T18:52:47.073972+0000","last_peered":"2023-06-10T18:52:47.073972+0000","last_clean":"2023-06-10T18:52:47.073972+0000","last_became_active":"2023-06-10T18:52:44.555234+0000","last_became_peered":"2023-06-10T18:52:44.555234+0000","last_unstale":"2023-06-10T18:52:47.073972+0000","last_undegraded":"2023-06-10T18:52:47.073972+0000","last_fullsized":"2023-06-10T18:52:47.073972+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:08:03.476132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.095638+0000","last_change":"2023-06-10T18:52:40.515396+0000","last_active":"2023-06-10T18:52:47.095638+0000","last_peered":"2023-06-10T18:52:47.095638+0000","last_clean":"2023-06-10T18:52:47.095638+0000","last_became_active":"2023-06-10T18:52:40.514663+0000","last_became_peered":"2023-06-10T18:52:40.514663+0000","last_unstale":"2023-06-10T18:52:47.095638+0000","last_undegraded":"2023-06-10T18:52:47.095638+0000","last_fullsized":"2023-06-10T18:52:47.095638+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:29:28.006668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.932272+0000","last_change":"2023-06-10T18:52:44.946073+0000","last_active":"2023-06-10T18:52:45.932272+0000","last_peered":"2023-06-10T18:52:45.932272+0000","last_clean":"2023-06-10T18:52:45.932272+0000","last_became_active":"2023-06-10T18:52:44.945497+0000","last_became_peered":"2023-06-10T18:52:44.945497+0000","last_unstale":"2023-06-10T18:52:45.932272+0000","last_undegraded":"2023-06-10T18:52:45.932272+0000","last_fullsized":"2023-06-10T18:52:45.932272+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:08:04.480136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.931851+0000","last_change":"2023-06-10T18:52:44.943166+0000","last_active":"2023-06-10T18:52:45.931851+0000","last_peered":"2023-06-10T18:52:45.931851+0000","last_clean":"2023-06-10T18:52:45.931851+0000","last_became_active":"2023-06-10T18:52:44.942777+0000","last_became_peered":"2023-06-10T18:52:44.942777+0000","last_unstale":"2023-06-10T18:52:45.931851+0000","last_undegraded":"2023-06-10T18:52:45.931851+0000","last_fullsized":"2023-06-10T18:52:45.931851+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:59:51.325397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"22'6","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.932027+0000","last_change":"2023-06-10T18:52:44.575890+0000","last_active":"2023-06-10T18:52:45.932027+0000","last_peered":"2023-06-10T18:52:45.932027+0000","last_clean":"2023-06-10T18:52:45.932027+0000","last_became_active":"2023-06-10T18:52:44.573780+0000","last_became_peered":"2023-06-10T18:52:44.573780+0000","last_unstale":"2023-06-10T18:52:45.932027+0000","last_undegraded":"2023-06-10T18:52:45.932027+0000","last_fullsized":"2023-06-10T18:52:45.932027+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:50:17.324228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.094568+0000","last_change":"2023-06-10T18:52:44.955836+0000","last_active":"2023-06-10T18:52:47.094568+0000","last_peered":"2023-06-10T18:52:47.094568+0000","last_clean":"2023-06-10T18:52:47.094568+0000","last_became_active":"2023-06-10T18:52:44.955427+0000","last_became_peered":"2023-06-10T18:52:44.955427+0000","last_unstale":"2023-06-10T18:52:47.094568+0000","last_undegraded":"2023-06-10T18:52:47.094568+0000","last_fullsized":"2023-06-10T18:52:47.094568+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:53:28.618960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.096692+0000","last_change":"2023-06-10T18:52:44.583026+0000","last_active":"2023-06-10T18:52:47.096692+0000","last_peered":"2023-06-10T18:52:47.096692+0000","last_clean":"2023-06-10T18:52:47.096692+0000","last_became_active":"2023-06-10T18:52:44.582436+0000","last_became_peered":"2023-06-10T18:52:44.582436+0000","last_unstale":"2023-06-10T18:52:47.096692+0000","last_undegraded":"2023-06-10T18:52:47.096692+0000","last_fullsized":"2023-06-10T18:52:47.096692+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:15:28.452018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.935637+0000","last_change":"2023-06-10T18:52:44.573591+0000","last_active":"2023-06-10T18:52:45.935637+0000","last_peered":"2023-06-10T18:52:45.935637+0000","last_clean":"2023-06-10T18:52:45.935637+0000","last_became_active":"2023-06-10T18:52:44.572802+0000","last_became_peered":"2023-06-10T18:52:44.572802+0000","last_unstale":"2023-06-10T18:52:45.935637+0000","last_undegraded":"2023-06-10T18:52:45.935637+0000","last_fullsized":"2023-06-10T18:52:45.935637+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:34:50.390041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.929760+0000","last_change":"2023-06-10T18:52:44.944441+0000","last_active":"2023-06-10T18:52:45.929760+0000","last_peered":"2023-06-10T18:52:45.929760+0000","last_clean":"2023-06-10T18:52:45.929760+0000","last_became_active":"2023-06-10T18:52:44.944031+0000","last_became_peered":"2023-06-10T18:52:44.944031+0000","last_unstale":"2023-06-10T18:52:45.929760+0000","last_undegraded":"2023-06-10T18:52:45.929760+0000","last_fullsized":"2023-06-10T18:52:45.929760+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:39:10.888321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.073751+0000","last_change":"2023-06-10T18:52:44.563525+0000","last_active":"2023-06-10T18:52:47.073751+0000","last_peered":"2023-06-10T18:52:47.073751+0000","last_clean":"2023-06-10T18:52:47.073751+0000","last_became_active":"2023-06-10T18:52:44.563140+0000","last_became_peered":"2023-06-10T18:52:44.563140+0000","last_unstale":"2023-06-10T18:52:47.073751+0000","last_undegraded":"2023-06-10T18:52:47.073751+0000","last_fullsized":"2023-06-10T18:52:47.073751+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:50:17.324228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.929241+0000","last_change":"2023-06-10T18:52:44.953481+0000","last_active":"2023-06-10T18:52:45.929241+0000","last_peered":"2023-06-10T18:52:45.929241+0000","last_clean":"2023-06-10T18:52:45.929241+0000","last_became_active":"2023-06-10T18:52:44.953139+0000","last_became_peered":"2023-06-10T18:52:44.953139+0000","last_unstale":"2023-06-10T18:52:45.929241+0000","last_undegraded":"2023-06-10T18:52:45.929241+0000","last_fullsized":"2023-06-10T18:52:45.929241+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:01:27.731251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.095689+0000","last_change":"2023-06-10T18:52:44.946900+0000","last_active":"2023-06-10T18:52:47.095689+0000","last_peered":"2023-06-10T18:52:47.095689+0000","last_clean":"2023-06-10T18:52:47.095689+0000","last_became_active":"2023-06-10T18:52:44.946612+0000","last_became_peered":"2023-06-10T18:52:44.946612+0000","last_unstale":"2023-06-10T18:52:47.095689+0000","last_undegraded":"2023-06-10T18:52:47.095689+0000","last_fullsized":"2023-06-10T18:52:47.095689+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:38:52.793572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.929494+0000","last_change":"2023-06-10T18:52:44.561213+0000","last_active":"2023-06-10T18:52:45.929494+0000","last_peered":"2023-06-10T18:52:45.929494+0000","last_clean":"2023-06-10T18:52:45.929494+0000","last_became_active":"2023-06-10T18:52:44.560946+0000","last_became_peered":"2023-06-10T18:52:44.560946+0000","last_unstale":"2023-06-10T18:52:45.929494+0000","last_undegraded":"2023-06-10T18:52:45.929494+0000","last_fullsized":"2023-06-10T18:52:45.929494+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:08:49.327602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.073688+0000","last_change":"2023-06-10T18:52:44.951860+0000","last_active":"2023-06-10T18:52:47.073688+0000","last_peered":"2023-06-10T18:52:47.073688+0000","last_clean":"2023-06-10T18:52:47.073688+0000","last_became_active":"2023-06-10T18:52:44.949078+0000","last_became_peered":"2023-06-10T18:52:44.949078+0000","last_unstale":"2023-06-10T18:52:47.073688+0000","last_undegraded":"2023-06-10T18:52:47.073688+0000","last_fullsized":"2023-06-10T18:52:47.073688+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:42:51.947168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.094812+0000","last_change":"2023-06-10T18:52:44.559767+0000","last_active":"2023-06-10T18:52:47.094812+0000","last_peered":"2023-06-10T18:52:47.094812+0000","last_clean":"2023-06-10T18:52:47.094812+0000","last_became_active":"2023-06-10T18:52:44.559451+0000","last_became_peered":"2023-06-10T18:52:44.559451+0000","last_unstale":"2023-06-10T18:52:47.094812+0000","last_undegraded":"2023-06-10T18:52:47.094812+0000","last_fullsized":"2023-06-10T18:52:47.094812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:59:50.321394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.929761+0000","last_change":"2023-06-10T18:52:44.960896+0000","last_active":"2023-06-10T18:52:45.929761+0000","last_peered":"2023-06-10T18:52:45.929761+0000","last_clean":"2023-06-10T18:52:45.929761+0000","last_became_active":"2023-06-10T18:52:44.960188+0000","last_became_peered":"2023-06-10T18:52:44.960188+0000","last_unstale":"2023-06-10T18:52:45.929761+0000","last_undegraded":"2023-06-10T18:52:45.929761+0000","last_fullsized":"2023-06-10T18:52:45.929761+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:50:18.328232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.932875+0000","last_change":"2023-06-10T18:52:44.552411+0000","last_active":"2023-06-10T18:52:45.932875+0000","last_peered":"2023-06-10T18:52:45.932875+0000","last_clean":"2023-06-10T18:52:45.932875+0000","last_became_active":"2023-06-10T18:52:44.551312+0000","last_became_peered":"2023-06-10T18:52:44.551312+0000","last_unstale":"2023-06-10T18:52:45.932875+0000","last_undegraded":"2023-06-10T18:52:45.932875+0000","last_fullsized":"2023-06-10T18:52:45.932875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:44:27.810129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.094468+0000","last_change":"2023-06-10T18:52:44.965460+0000","last_active":"2023-06-10T18:52:47.094468+0000","last_peered":"2023-06-10T18:52:47.094468+0000","last_clean":"2023-06-10T18:52:47.094468+0000","last_became_active":"2023-06-10T18:52:44.964988+0000","last_became_peered":"2023-06-10T18:52:44.964988+0000","last_unstale":"2023-06-10T18:52:47.094468+0000","last_undegraded":"2023-06-10T18:52:47.094468+0000","last_fullsized":"2023-06-10T18:52:47.094468+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:46:29.935621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.074090+0000","last_change":"2023-06-10T18:52:44.576675+0000","last_active":"2023-06-10T18:52:47.074090+0000","last_peered":"2023-06-10T18:52:47.074090+0000","last_clean":"2023-06-10T18:52:47.074090+0000","last_became_active":"2023-06-10T18:52:44.576362+0000","last_became_peered":"2023-06-10T18:52:44.576362+0000","last_unstale":"2023-06-10T18:52:47.074090+0000","last_undegraded":"2023-06-10T18:52:47.074090+0000","last_fullsized":"2023-06-10T18:52:47.074090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:49:48.614848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.931722+0000","last_change":"2023-06-10T18:52:44.941939+0000","last_active":"2023-06-10T18:52:45.931722+0000","last_peered":"2023-06-10T18:52:45.931722+0000","last_clean":"2023-06-10T18:52:45.931722+0000","last_became_active":"2023-06-10T18:52:44.939408+0000","last_became_peered":"2023-06-10T18:52:44.939408+0000","last_unstale":"2023-06-10T18:52:45.931722+0000","last_undegraded":"2023-06-10T18:52:45.931722+0000","last_fullsized":"2023-06-10T18:52:45.931722+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:31:20.946172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.934658+0000","last_change":"2023-06-10T18:52:44.574956+0000","last_active":"2023-06-10T18:52:45.934658+0000","last_peered":"2023-06-10T18:52:45.934658+0000","last_clean":"2023-06-10T18:52:45.934658+0000","last_became_active":"2023-06-10T18:52:44.574184+0000","last_became_peered":"2023-06-10T18:52:44.574184+0000","last_unstale":"2023-06-10T18:52:45.934658+0000","last_undegraded":"2023-06-10T18:52:45.934658+0000","last_fullsized":"2023-06-10T18:52:45.934658+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:50:17.324228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.932406+0000","last_change":"2023-06-10T18:52:44.944962+0000","last_active":"2023-06-10T18:52:45.932406+0000","last_peered":"2023-06-10T18:52:45.932406+0000","last_clean":"2023-06-10T18:52:45.932406+0000","last_became_active":"2023-06-10T18:52:44.944702+0000","last_became_peered":"2023-06-10T18:52:44.944702+0000","last_unstale":"2023-06-10T18:52:45.932406+0000","last_undegraded":"2023-06-10T18:52:45.932406+0000","last_fullsized":"2023-06-10T18:52:45.932406+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T18:54:16.713072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.935077+0000","last_change":"2023-06-10T18:52:44.576687+0000","last_active":"2023-06-10T18:52:45.935077+0000","last_peered":"2023-06-10T18:52:45.935077+0000","last_clean":"2023-06-10T18:52:45.935077+0000","last_became_active":"2023-06-10T18:52:44.575964+0000","last_became_peered":"2023-06-10T18:52:44.575964+0000","last_unstale":"2023-06-10T18:52:45.935077+0000","last_undegraded":"2023-06-10T18:52:45.935077+0000","last_fullsized":"2023-06-10T18:52:45.935077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:41:12.372624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.929739+0000","last_change":"2023-06-10T18:52:44.937999+0000","last_active":"2023-06-10T18:52:45.929739+0000","last_peered":"2023-06-10T18:52:45.929739+0000","last_clean":"2023-06-10T18:52:45.929739+0000","last_became_active":"2023-06-10T18:52:44.937614+0000","last_became_peered":"2023-06-10T18:52:44.937614+0000","last_unstale":"2023-06-10T18:52:45.929739+0000","last_undegraded":"2023-06-10T18:52:45.929739+0000","last_fullsized":"2023-06-10T18:52:45.929739+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:42:51.947168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.929840+0000","last_change":"2023-06-10T18:52:44.563109+0000","last_active":"2023-06-10T18:52:45.929840+0000","last_peered":"2023-06-10T18:52:45.929840+0000","last_clean":"2023-06-10T18:52:45.929840+0000","last_became_active":"2023-06-10T18:52:44.562809+0000","last_became_peered":"2023-06-10T18:52:44.562809+0000","last_unstale":"2023-06-10T18:52:45.929840+0000","last_undegraded":"2023-06-10T18:52:45.929840+0000","last_fullsized":"2023-06-10T18:52:45.929840+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:39:09.014604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.931609+0000","last_change":"2023-06-10T18:52:44.945839+0000","last_active":"2023-06-10T18:52:45.931609+0000","last_peered":"2023-06-10T18:52:45.931609+0000","last_clean":"2023-06-10T18:52:45.931609+0000","last_became_active":"2023-06-10T18:52:44.945171+0000","last_became_peered":"2023-06-10T18:52:44.945171+0000","last_unstale":"2023-06-10T18:52:45.931609+0000","last_undegraded":"2023-06-10T18:52:45.931609+0000","last_fullsized":"2023-06-10T18:52:45.931609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:54:34.871667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.073610+0000","last_change":"2023-06-10T18:52:44.563708+0000","last_active":"2023-06-10T18:52:47.073610+0000","last_peered":"2023-06-10T18:52:47.073610+0000","last_clean":"2023-06-10T18:52:47.073610+0000","last_became_active":"2023-06-10T18:52:44.563327+0000","last_became_peered":"2023-06-10T18:52:44.563327+0000","last_unstale":"2023-06-10T18:52:47.073610+0000","last_undegraded":"2023-06-10T18:52:47.073610+0000","last_fullsized":"2023-06-10T18:52:47.073610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:37:27.669113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":844,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":864256,"data_stored":681747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.075}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0920000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0289999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":229376,"data_stored":82946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.123}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.161}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":249856,"data_stored":90251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.877}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.137}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":262144,"data_stored":91219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0760000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.228}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4610000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31284,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340556,"statfs":{"total":96636764160,"available":96604729344,"internally_reserved":0,"allocated":241664,"data_stored":88670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94599999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.155}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3919999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31272,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340568,"statfs":{"total":96636764160,"available":96604741632,"internally_reserved":0,"allocated":229376,"data_stored":82946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0629999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1120000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0860000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0049999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31268,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340572,"statfs":{"total":96636764160,"available":96604745728,"internally_reserved":0,"allocated":225280,"data_stored":81927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90500000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31852,"kb_used_data":804,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339988,"statfs":{"total":96636764160,"available":96604147712,"internally_reserved":0,"allocated":823296,"data_stored":672877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.091}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1659999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.274}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-10T18:52:53.451 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-10T18:52:53.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.572+0000 7fc7b07f7640 1 Processor -- start 2023-06-10T18:52:53.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.572+0000 7fc7b07f7640 1 -- start start 2023-06-10T18:52:53.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.576+0000 7fc7b07f7640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc7a8159450 0x7fc7a815d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:53.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.576+0000 7fc7b07f7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7a815d680 0x7fc7a80cec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:53.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.576+0000 7fc7b07f7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc7a80cf180 0x7fc7a80cda20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:53.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.576+0000 7fc7b07f7640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7a80cf600 con 0x7fc7a80cf180 2023-06-10T18:52:53.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.576+0000 7fc7b07f7640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7a80cbac0 con 0x7fc7a8159450 2023-06-10T18:52:53.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.576+0000 7fc7b07f7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a815dc00 con 0x7fc7a815d680 2023-06-10T18:52:53.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.576+0000 7fc7aed94640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc7a80cf180 0x7fc7a80cda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:53.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.576+0000 7fc7aed94640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc7a80cf180 0x7fc7a80cda20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34920/0 (socket says 172.21.15.53:34920) 2023-06-10T18:52:53.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.576+0000 7fc7aed94640 1 -- 172.21.15.53:0/3192594122 learned_addr learned my addr 172.21.15.53:0/3192594122 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:53.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.576+0000 7fc7add92640 1 --2- 172.21.15.53:0/3192594122 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7a815d680 0x7fc7a80cec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:53.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.576+0000 7fc7ae593640 1 --2- 172.21.15.53:0/3192594122 >> v2:172.21.15.117:3300/0 conn(0x7fc7a8159450 0x7fc7a815d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:53.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.576+0000 7fc7aed94640 1 -- 172.21.15.53:0/3192594122 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7a815d680 msgr2=0x7fc7a80cec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:53.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.576+0000 7fc7aed94640 1 --2- 172.21.15.53:0/3192594122 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7a815d680 0x7fc7a80cec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:53.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.576+0000 7fc7aed94640 1 -- 172.21.15.53:0/3192594122 >> v2:172.21.15.117:3300/0 conn(0x7fc7a8159450 msgr2=0x7fc7a815d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:53.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.576+0000 7fc7aed94640 1 --2- 172.21.15.53:0/3192594122 >> v2:172.21.15.117:3300/0 conn(0x7fc7a8159450 0x7fc7a815d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:53.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.576+0000 7fc7aed94640 1 -- 172.21.15.53:0/3192594122 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7a815dee0 con 0x7fc7a80cf180 2023-06-10T18:52:53.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.576+0000 7fc7aed94640 1 --2- 172.21.15.53:0/3192594122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7a80cf180 0x7fc7a80cda20 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc7a80b29a0 tx=0x7fc7a001c650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ba089e822fc41e3 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:53.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.580+0000 7fc7ad591640 1 -- 172.21.15.53:0/3192594122 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a00a64a0 con 0x7fc7a80cf180 2023-06-10T18:52:53.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.580+0000 7fc7ad591640 1 -- 172.21.15.53:0/3192594122 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7a00a6600 con 0x7fc7a80cf180 2023-06-10T18:52:53.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.580+0000 7fc7ad591640 1 -- 172.21.15.53:0/3192594122 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a00a6990 con 0x7fc7a80cf180 2023-06-10T18:52:53.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.580+0000 7fc7b07f7640 1 -- 172.21.15.53:0/3192594122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7a80cf180 msgr2=0x7fc7a80cda20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:53.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.580+0000 7fc7b07f7640 1 --2- 172.21.15.53:0/3192594122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7a80cf180 0x7fc7a80cda20 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc7a80b29a0 tx=0x7fc7a001c650 comp rx=0 tx=0).stop 2023-06-10T18:52:53.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.580+0000 7fc7b07f7640 1 -- 172.21.15.53:0/3192594122 shutdown_connections 2023-06-10T18:52:53.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.580+0000 7fc7b07f7640 1 --2- 172.21.15.53:0/3192594122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7a80cf180 0x7fc7a80cda20 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:53.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.580+0000 7fc7b07f7640 1 --2- 172.21.15.53:0/3192594122 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7a815d680 0x7fc7a80cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:53.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.580+0000 7fc7b07f7640 1 --2- 172.21.15.53:0/3192594122 >> v2:172.21.15.117:3300/0 conn(0x7fc7a8159450 0x7fc7a815d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:53.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.580+0000 7fc7b07f7640 1 -- 172.21.15.53:0/3192594122 >> 172.21.15.53:0/3192594122 conn(0x7fc7a806a090 msgr2=0x7fc7a806d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:53.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.580+0000 7fc7b07f7640 1 -- 172.21.15.53:0/3192594122 shutdown_connections 2023-06-10T18:52:53.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.580+0000 7fc7b07f7640 1 -- 172.21.15.53:0/3192594122 wait complete. 2023-06-10T18:52:53.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.580+0000 7fc7b07f7640 1 Processor -- start 2023-06-10T18:52:53.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.580+0000 7fc7b07f7640 1 -- start start 2023-06-10T18:52:53.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.580+0000 7fc7b07f7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7a80cf180 0x7fc7a80c5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:53.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.580+0000 7fc7b07f7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7a8159450 0x7fc7a8150f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:53.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.580+0000 7fc7b07f7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7a815d680 0x7fc7a813d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:53.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.580+0000 7fc7b07f7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a815b340 con 0x7fc7a8159450 2023-06-10T18:52:53.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.580+0000 7fc7b07f7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a815a730 con 0x7fc7a815d680 2023-06-10T18:52:53.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.580+0000 7fc7b07f7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a815aa10 con 0x7fc7a80cf180 2023-06-10T18:52:53.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.580+0000 7fc7add92640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7a8159450 0x7fc7a8150f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:53.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.580+0000 7fc7add92640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7a8159450 0x7fc7a8150f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34930/0 (socket says 172.21.15.53:34930) 2023-06-10T18:52:53.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.580+0000 7fc7add92640 1 -- 172.21.15.53:0/4133827120 learned_addr learned my addr 172.21.15.53:0/4133827120 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:53.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.580+0000 7fc7ae593640 1 --2- 172.21.15.53:0/4133827120 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7a80cf180 0x7fc7a80c5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:53.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.580+0000 7fc7aed94640 1 --2- 172.21.15.53:0/4133827120 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7a815d680 0x7fc7a813d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:53.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.580+0000 7fc7add92640 1 -- 172.21.15.53:0/4133827120 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7a80cf180 msgr2=0x7fc7a80c5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:53.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.580+0000 7fc7add92640 1 --2- 172.21.15.53:0/4133827120 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7a80cf180 0x7fc7a80c5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:53.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.580+0000 7fc7add92640 1 -- 172.21.15.53:0/4133827120 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7a815d680 msgr2=0x7fc7a813d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:53.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.580+0000 7fc7add92640 1 --2- 172.21.15.53:0/4133827120 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7a815d680 0x7fc7a813d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:53.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.580+0000 7fc7add92640 1 -- 172.21.15.53:0/4133827120 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7a0009b30 con 0x7fc7a8159450 2023-06-10T18:52:53.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.580+0000 7fc7add92640 1 --2- 172.21.15.53:0/4133827120 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7a8159450 0x7fc7a8150f10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc7a400d800 tx=0x7fc7a400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:53.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.580+0000 7fc79effd640 1 -- 172.21.15.53:0/4133827120 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a400b6c0 con 0x7fc7a8159450 2023-06-10T18:52:53.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.580+0000 7fc79effd640 1 -- 172.21.15.53:0/4133827120 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7a400b820 con 0x7fc7a8159450 2023-06-10T18:52:53.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.580+0000 7fc7b07f7640 1 -- 172.21.15.53:0/4133827120 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7a815acf0 con 0x7fc7a8159450 2023-06-10T18:52:53.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.580+0000 7fc79effd640 1 -- 172.21.15.53:0/4133827120 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a400bb90 con 0x7fc7a8159450 2023-06-10T18:52:53.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.580+0000 7fc7b07f7640 1 -- 172.21.15.53:0/4133827120 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7a80c6230 con 0x7fc7a8159450 2023-06-10T18:52:53.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.584+0000 7fc7b07f7640 1 -- 172.21.15.53:0/4133827120 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7a815b4b0 con 0x7fc7a8159450 2023-06-10T18:52:53.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.584+0000 7fc79effd640 1 -- 172.21.15.53:0/4133827120 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc7a400bcf0 con 0x7fc7a8159450 2023-06-10T18:52:53.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.584+0000 7fc79effd640 1 --2- 172.21.15.53:0/4133827120 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc78c0662b0 0x7fc78c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:53.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.584+0000 7fc79effd640 1 -- 172.21.15.53:0/4133827120 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc7a40842c0 con 0x7fc7a8159450 2023-06-10T18:52:53.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.584+0000 7fc7ae593640 1 --2- 172.21.15.53:0/4133827120 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc78c0662b0 0x7fc78c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:53.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.584+0000 7fc7ae593640 1 --2- 172.21.15.53:0/4133827120 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc78c0662b0 0x7fc78c068760 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc79800a8d0 tx=0x7fc798008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:53.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.588+0000 7fc79effd640 1 -- 172.21.15.53:0/4133827120 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc7a40516a0 con 0x7fc7a8159450 2023-06-10T18:52:53.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.740+0000 7fc7b07f7640 1 -- 172.21.15.53:0/4133827120 --> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc7a80b1af0 con 0x7fc78c0662b0 2023-06-10T18:52:53.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.760+0000 7fc79effd640 1 -- 172.21.15.53:0/4133827120 <== mgr.4105 v2:172.21.15.117:6832/3061986771 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286578 (secure 0 0 0) 0x7fc79800c050 con 0x7fc78c0662b0 2023-06-10T18:52:53.772 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:52:53.773 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-06-10T18:52:53.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.764+0000 7fc7b07f7640 1 -- 172.21.15.53:0/4133827120 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc78c0662b0 msgr2=0x7fc78c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:53.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.764+0000 7fc7b07f7640 1 --2- 172.21.15.53:0/4133827120 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc78c0662b0 0x7fc78c068760 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc79800a8d0 tx=0x7fc798008040 comp rx=0 tx=0).stop 2023-06-10T18:52:53.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.764+0000 7fc7b07f7640 1 -- 172.21.15.53:0/4133827120 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7a8159450 msgr2=0x7fc7a8150f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:53.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.764+0000 7fc7b07f7640 1 --2- 172.21.15.53:0/4133827120 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7a8159450 0x7fc7a8150f10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc7a400d800 tx=0x7fc7a400dcc0 comp rx=0 tx=0).stop 2023-06-10T18:52:53.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.764+0000 7fc7b07f7640 1 -- 172.21.15.53:0/4133827120 shutdown_connections 2023-06-10T18:52:53.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.764+0000 7fc7b07f7640 1 --2- 172.21.15.53:0/4133827120 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc78c0662b0 0x7fc78c068760 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:53.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.764+0000 7fc7b07f7640 1 --2- 172.21.15.53:0/4133827120 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7a815d680 0x7fc7a813d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:53.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.764+0000 7fc7b07f7640 1 --2- 172.21.15.53:0/4133827120 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7a8159450 0x7fc7a8150f10 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:53.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.764+0000 7fc7b07f7640 1 --2- 172.21.15.53:0/4133827120 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7a80cf180 0x7fc7a80c5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:53.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.764+0000 7fc7b07f7640 1 -- 172.21.15.53:0/4133827120 >> 172.21.15.53:0/4133827120 conn(0x7fc7a806a090 msgr2=0x7fc7a80b1020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:53.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.764+0000 7fc7b07f7640 1 -- 172.21.15.53:0/4133827120 shutdown_connections 2023-06-10T18:52:53.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.764+0000 7fc7b07f7640 1 -- 172.21.15.53:0/4133827120 wait complete. 2023-06-10T18:52:53.790 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-06-10T18:52:53.560815+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235100,"kb_used_data":3100,"kb_used_omap":0,"kb_used_meta":231936,"kb_avail":754739620,"statfs":{"total":773094113280,"available":772853370880,"internally_reserved":0,"allocated":3174400,"data_stored":1899195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":237502464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.637166"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.093989+0000","last_change":"2023-06-10T18:52:44.947732+0000","last_active":"2023-06-10T18:52:47.093989+0000","last_peered":"2023-06-10T18:52:47.093989+0000","last_clean":"2023-06-10T18:52:47.093989+0000","last_became_active":"2023-06-10T18:52:44.947398+0000","last_became_peered":"2023-06-10T18:52:44.947398+0000","last_unstale":"2023-06-10T18:52:47.093989+0000","last_undegraded":"2023-06-10T18:52:47.093989+0000","last_fullsized":"2023-06-10T18:52:47.093989+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:06:36.663322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.935057+0000","last_change":"2023-06-10T18:52:44.961438+0000","last_active":"2023-06-10T18:52:45.935057+0000","last_peered":"2023-06-10T18:52:45.935057+0000","last_clean":"2023-06-10T18:52:45.935057+0000","last_became_active":"2023-06-10T18:52:44.961134+0000","last_became_peered":"2023-06-10T18:52:44.961134+0000","last_unstale":"2023-06-10T18:52:45.935057+0000","last_undegraded":"2023-06-10T18:52:45.935057+0000","last_fullsized":"2023-06-10T18:52:45.935057+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:49:49.618852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.931821+0000","last_change":"2023-06-10T18:52:44.955647+0000","last_active":"2023-06-10T18:52:45.931821+0000","last_peered":"2023-06-10T18:52:45.931821+0000","last_clean":"2023-06-10T18:52:45.931821+0000","last_became_active":"2023-06-10T18:52:44.955093+0000","last_became_peered":"2023-06-10T18:52:44.955093+0000","last_unstale":"2023-06-10T18:52:45.931821+0000","last_undegraded":"2023-06-10T18:52:45.931821+0000","last_fullsized":"2023-06-10T18:52:45.931821+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:37:28.673117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.095194+0000","last_change":"2023-06-10T18:52:44.940992+0000","last_active":"2023-06-10T18:52:47.095194+0000","last_peered":"2023-06-10T18:52:47.095194+0000","last_clean":"2023-06-10T18:52:47.095194+0000","last_became_active":"2023-06-10T18:52:44.940703+0000","last_became_peered":"2023-06-10T18:52:44.940703+0000","last_unstale":"2023-06-10T18:52:47.095194+0000","last_undegraded":"2023-06-10T18:52:47.095194+0000","last_fullsized":"2023-06-10T18:52:47.095194+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:17:13.902888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.074101+0000","last_change":"2023-06-10T18:52:44.954034+0000","last_active":"2023-06-10T18:52:47.074101+0000","last_peered":"2023-06-10T18:52:47.074101+0000","last_clean":"2023-06-10T18:52:47.074101+0000","last_became_active":"2023-06-10T18:52:44.953626+0000","last_became_peered":"2023-06-10T18:52:44.953626+0000","last_unstale":"2023-06-10T18:52:47.074101+0000","last_undegraded":"2023-06-10T18:52:47.074101+0000","last_fullsized":"2023-06-10T18:52:47.074101+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:41:13.376627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.932554+0000","last_change":"2023-06-10T18:52:44.944206+0000","last_active":"2023-06-10T18:52:45.932554+0000","last_peered":"2023-06-10T18:52:45.932554+0000","last_clean":"2023-06-10T18:52:45.932554+0000","last_became_active":"2023-06-10T18:52:44.943687+0000","last_became_peered":"2023-06-10T18:52:44.943687+0000","last_unstale":"2023-06-10T18:52:45.932554+0000","last_undegraded":"2023-06-10T18:52:45.932554+0000","last_fullsized":"2023-06-10T18:52:45.932554+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:02:43.231973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.095766+0000","last_change":"2023-06-10T18:52:44.958696+0000","last_active":"2023-06-10T18:52:47.095766+0000","last_peered":"2023-06-10T18:52:47.095766+0000","last_clean":"2023-06-10T18:52:47.095766+0000","last_became_active":"2023-06-10T18:52:44.958075+0000","last_became_peered":"2023-06-10T18:52:44.958075+0000","last_unstale":"2023-06-10T18:52:47.095766+0000","last_undegraded":"2023-06-10T18:52:47.095766+0000","last_fullsized":"2023-06-10T18:52:47.095766+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T18:54:16.713072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.934329+0000","last_change":"2023-06-10T18:52:44.945375+0000","last_active":"2023-06-10T18:52:45.934329+0000","last_peered":"2023-06-10T18:52:45.934329+0000","last_clean":"2023-06-10T18:52:45.934329+0000","last_became_active":"2023-06-10T18:52:44.945059+0000","last_became_peered":"2023-06-10T18:52:44.945059+0000","last_unstale":"2023-06-10T18:52:45.934329+0000","last_undegraded":"2023-06-10T18:52:45.934329+0000","last_fullsized":"2023-06-10T18:52:45.934329+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:59:51.325397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.073399+0000","last_change":"2023-06-10T18:52:44.960556+0000","last_active":"2023-06-10T18:52:47.073399+0000","last_peered":"2023-06-10T18:52:47.073399+0000","last_clean":"2023-06-10T18:52:47.073399+0000","last_became_active":"2023-06-10T18:52:44.960174+0000","last_became_peered":"2023-06-10T18:52:44.960174+0000","last_unstale":"2023-06-10T18:52:47.073399+0000","last_undegraded":"2023-06-10T18:52:47.073399+0000","last_fullsized":"2023-06-10T18:52:47.073399+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:53:28.618960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.935372+0000","last_change":"2023-06-10T18:52:44.961025+0000","last_active":"2023-06-10T18:52:45.935372+0000","last_peered":"2023-06-10T18:52:45.935372+0000","last_clean":"2023-06-10T18:52:45.935372+0000","last_became_active":"2023-06-10T18:52:44.960661+0000","last_became_peered":"2023-06-10T18:52:44.960661+0000","last_unstale":"2023-06-10T18:52:45.935372+0000","last_undegraded":"2023-06-10T18:52:45.935372+0000","last_fullsized":"2023-06-10T18:52:45.935372+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:02:43.231973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.932039+0000","last_change":"2023-06-10T18:52:44.958300+0000","last_active":"2023-06-10T18:52:45.932039+0000","last_peered":"2023-06-10T18:52:45.932039+0000","last_clean":"2023-06-10T18:52:45.932039+0000","last_became_active":"2023-06-10T18:52:44.958013+0000","last_became_peered":"2023-06-10T18:52:44.958013+0000","last_unstale":"2023-06-10T18:52:45.932039+0000","last_undegraded":"2023-06-10T18:52:45.932039+0000","last_fullsized":"2023-06-10T18:52:45.932039+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:39:10.018608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.094202+0000","last_change":"2023-06-10T18:52:44.951808+0000","last_active":"2023-06-10T18:52:47.094202+0000","last_peered":"2023-06-10T18:52:47.094202+0000","last_clean":"2023-06-10T18:52:47.094202+0000","last_became_active":"2023-06-10T18:52:44.951348+0000","last_became_peered":"2023-06-10T18:52:44.951348+0000","last_unstale":"2023-06-10T18:52:47.094202+0000","last_undegraded":"2023-06-10T18:52:47.094202+0000","last_fullsized":"2023-06-10T18:52:47.094202+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:41:10.737097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.093897+0000","last_change":"2023-06-10T18:52:44.941608+0000","last_active":"2023-06-10T18:52:47.093897+0000","last_peered":"2023-06-10T18:52:47.093897+0000","last_clean":"2023-06-10T18:52:47.093897+0000","last_became_active":"2023-06-10T18:52:44.941232+0000","last_became_peered":"2023-06-10T18:52:44.941232+0000","last_unstale":"2023-06-10T18:52:47.093897+0000","last_undegraded":"2023-06-10T18:52:47.093897+0000","last_fullsized":"2023-06-10T18:52:47.093897+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:34:30.103416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.935166+0000","last_change":"2023-06-10T18:52:44.946464+0000","last_active":"2023-06-10T18:52:45.935166+0000","last_peered":"2023-06-10T18:52:45.935166+0000","last_clean":"2023-06-10T18:52:45.935166+0000","last_became_active":"2023-06-10T18:52:44.946097+0000","last_became_peered":"2023-06-10T18:52:44.946097+0000","last_unstale":"2023-06-10T18:52:45.935166+0000","last_undegraded":"2023-06-10T18:52:45.935166+0000","last_fullsized":"2023-06-10T18:52:45.935166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:37:26.347275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.096155+0000","last_change":"2023-06-10T18:52:44.958946+0000","last_active":"2023-06-10T18:52:47.096155+0000","last_peered":"2023-06-10T18:52:47.096155+0000","last_clean":"2023-06-10T18:52:47.096155+0000","last_became_active":"2023-06-10T18:52:44.958439+0000","last_became_peered":"2023-06-10T18:52:44.958439+0000","last_unstale":"2023-06-10T18:52:47.096155+0000","last_undegraded":"2023-06-10T18:52:47.096155+0000","last_fullsized":"2023-06-10T18:52:47.096155+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:14:11.506328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.931732+0000","last_change":"2023-06-10T18:52:44.946069+0000","last_active":"2023-06-10T18:52:45.931732+0000","last_peered":"2023-06-10T18:52:45.931732+0000","last_clean":"2023-06-10T18:52:45.931732+0000","last_became_active":"2023-06-10T18:52:44.945560+0000","last_became_peered":"2023-06-10T18:52:44.945560+0000","last_unstale":"2023-06-10T18:52:45.931732+0000","last_undegraded":"2023-06-10T18:52:45.931732+0000","last_fullsized":"2023-06-10T18:52:45.931732+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:08:50.331605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.073341+0000","last_change":"2023-06-10T18:52:44.961858+0000","last_active":"2023-06-10T18:52:47.073341+0000","last_peered":"2023-06-10T18:52:47.073341+0000","last_clean":"2023-06-10T18:52:47.073341+0000","last_became_active":"2023-06-10T18:52:44.961540+0000","last_became_peered":"2023-06-10T18:52:44.961540+0000","last_unstale":"2023-06-10T18:52:47.073341+0000","last_undegraded":"2023-06-10T18:52:47.073341+0000","last_fullsized":"2023-06-10T18:52:47.073341+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:08:50.331605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.932034+0000","last_change":"2023-06-10T18:52:44.939005+0000","last_active":"2023-06-10T18:52:45.932034+0000","last_peered":"2023-06-10T18:52:45.932034+0000","last_clean":"2023-06-10T18:52:45.932034+0000","last_became_active":"2023-06-10T18:52:44.938775+0000","last_became_peered":"2023-06-10T18:52:44.938775+0000","last_unstale":"2023-06-10T18:52:45.932034+0000","last_undegraded":"2023-06-10T18:52:45.932034+0000","last_fullsized":"2023-06-10T18:52:45.932034+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:42:51.947168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.094083+0000","last_change":"2023-06-10T18:52:44.941417+0000","last_active":"2023-06-10T18:52:47.094083+0000","last_peered":"2023-06-10T18:52:47.094083+0000","last_clean":"2023-06-10T18:52:47.094083+0000","last_became_active":"2023-06-10T18:52:44.940980+0000","last_became_peered":"2023-06-10T18:52:44.940980+0000","last_unstale":"2023-06-10T18:52:47.094083+0000","last_undegraded":"2023-06-10T18:52:47.094083+0000","last_fullsized":"2023-06-10T18:52:47.094083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:33:22.583233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.932218+0000","last_change":"2023-06-10T18:52:44.944705+0000","last_active":"2023-06-10T18:52:45.932218+0000","last_peered":"2023-06-10T18:52:45.932218+0000","last_clean":"2023-06-10T18:52:45.932218+0000","last_became_active":"2023-06-10T18:52:44.944399+0000","last_became_peered":"2023-06-10T18:52:44.944399+0000","last_unstale":"2023-06-10T18:52:45.932218+0000","last_undegraded":"2023-06-10T18:52:45.932218+0000","last_fullsized":"2023-06-10T18:52:45.932218+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:39:06.207720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.096145+0000","last_change":"2023-06-10T18:52:44.959863+0000","last_active":"2023-06-10T18:52:47.096145+0000","last_peered":"2023-06-10T18:52:47.096145+0000","last_clean":"2023-06-10T18:52:47.096145+0000","last_became_active":"2023-06-10T18:52:44.959556+0000","last_became_peered":"2023-06-10T18:52:44.959556+0000","last_unstale":"2023-06-10T18:52:47.096145+0000","last_undegraded":"2023-06-10T18:52:47.096145+0000","last_fullsized":"2023-06-10T18:52:47.096145+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:02:43.231973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.073202+0000","last_change":"2023-06-10T18:52:44.961343+0000","last_active":"2023-06-10T18:52:47.073202+0000","last_peered":"2023-06-10T18:52:47.073202+0000","last_clean":"2023-06-10T18:52:47.073202+0000","last_became_active":"2023-06-10T18:52:44.960957+0000","last_became_peered":"2023-06-10T18:52:44.960957+0000","last_unstale":"2023-06-10T18:52:47.073202+0000","last_undegraded":"2023-06-10T18:52:47.073202+0000","last_fullsized":"2023-06-10T18:52:47.073202+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:54:34.871667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.929467+0000","last_change":"2023-06-10T18:52:44.952488+0000","last_active":"2023-06-10T18:52:45.929467+0000","last_peered":"2023-06-10T18:52:45.929467+0000","last_clean":"2023-06-10T18:52:45.929467+0000","last_became_active":"2023-06-10T18:52:44.951957+0000","last_became_peered":"2023-06-10T18:52:44.951957+0000","last_unstale":"2023-06-10T18:52:45.929467+0000","last_undegraded":"2023-06-10T18:52:45.929467+0000","last_fullsized":"2023-06-10T18:52:45.929467+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:31:20.946172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.094882+0000","last_change":"2023-06-10T18:52:44.960097+0000","last_active":"2023-06-10T18:52:47.094882+0000","last_peered":"2023-06-10T18:52:47.094882+0000","last_clean":"2023-06-10T18:52:47.094882+0000","last_became_active":"2023-06-10T18:52:44.959605+0000","last_became_peered":"2023-06-10T18:52:44.959605+0000","last_unstale":"2023-06-10T18:52:47.094882+0000","last_undegraded":"2023-06-10T18:52:47.094882+0000","last_fullsized":"2023-06-10T18:52:47.094882+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:08:04.480136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.095654+0000","last_change":"2023-06-10T18:52:44.956446+0000","last_active":"2023-06-10T18:52:47.095654+0000","last_peered":"2023-06-10T18:52:47.095654+0000","last_clean":"2023-06-10T18:52:47.095654+0000","last_became_active":"2023-06-10T18:52:44.954175+0000","last_became_peered":"2023-06-10T18:52:44.954175+0000","last_unstale":"2023-06-10T18:52:47.095654+0000","last_undegraded":"2023-06-10T18:52:47.095654+0000","last_fullsized":"2023-06-10T18:52:47.095654+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T18:54:16.713072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.095401+0000","last_change":"2023-06-10T18:52:44.956942+0000","last_active":"2023-06-10T18:52:47.095401+0000","last_peered":"2023-06-10T18:52:47.095401+0000","last_clean":"2023-06-10T18:52:47.095401+0000","last_became_active":"2023-06-10T18:52:44.953322+0000","last_became_peered":"2023-06-10T18:52:44.953322+0000","last_unstale":"2023-06-10T18:52:47.095401+0000","last_undegraded":"2023-06-10T18:52:47.095401+0000","last_fullsized":"2023-06-10T18:52:47.095401+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:39:10.018608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.934856+0000","last_change":"2023-06-10T18:52:44.942786+0000","last_active":"2023-06-10T18:52:45.934856+0000","last_peered":"2023-06-10T18:52:45.934856+0000","last_clean":"2023-06-10T18:52:45.934856+0000","last_became_active":"2023-06-10T18:52:44.942216+0000","last_became_peered":"2023-06-10T18:52:44.942216+0000","last_unstale":"2023-06-10T18:52:45.934856+0000","last_undegraded":"2023-06-10T18:52:45.934856+0000","last_fullsized":"2023-06-10T18:52:45.934856+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:08:04.480136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.095440+0000","last_change":"2023-06-10T18:52:44.958527+0000","last_active":"2023-06-10T18:52:47.095440+0000","last_peered":"2023-06-10T18:52:47.095440+0000","last_clean":"2023-06-10T18:52:47.095440+0000","last_became_active":"2023-06-10T18:52:44.958233+0000","last_became_peered":"2023-06-10T18:52:44.958233+0000","last_unstale":"2023-06-10T18:52:47.095440+0000","last_undegraded":"2023-06-10T18:52:47.095440+0000","last_fullsized":"2023-06-10T18:52:47.095440+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:08:04.480136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.930241+0000","last_change":"2023-06-10T18:52:44.946412+0000","last_active":"2023-06-10T18:52:45.930241+0000","last_peered":"2023-06-10T18:52:45.930241+0000","last_clean":"2023-06-10T18:52:45.930241+0000","last_became_active":"2023-06-10T18:52:44.945955+0000","last_became_peered":"2023-06-10T18:52:44.945955+0000","last_unstale":"2023-06-10T18:52:45.930241+0000","last_undegraded":"2023-06-10T18:52:45.930241+0000","last_fullsized":"2023-06-10T18:52:45.930241+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:08:04.480136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.932719+0000","last_change":"2023-06-10T18:52:44.942149+0000","last_active":"2023-06-10T18:52:45.932719+0000","last_peered":"2023-06-10T18:52:45.932719+0000","last_clean":"2023-06-10T18:52:45.932719+0000","last_became_active":"2023-06-10T18:52:44.939204+0000","last_became_peered":"2023-06-10T18:52:44.939204+0000","last_unstale":"2023-06-10T18:52:45.932719+0000","last_undegraded":"2023-06-10T18:52:45.932719+0000","last_fullsized":"2023-06-10T18:52:45.932719+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:14:11.506328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.929536+0000","last_change":"2023-06-10T18:52:44.960157+0000","last_active":"2023-06-10T18:52:45.929536+0000","last_peered":"2023-06-10T18:52:45.929536+0000","last_clean":"2023-06-10T18:52:45.929536+0000","last_became_active":"2023-06-10T18:52:44.959460+0000","last_became_peered":"2023-06-10T18:52:44.959460+0000","last_unstale":"2023-06-10T18:52:45.929536+0000","last_undegraded":"2023-06-10T18:52:45.929536+0000","last_fullsized":"2023-06-10T18:52:45.929536+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:53:28.618960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.094637+0000","last_change":"2023-06-10T18:52:44.937198+0000","last_active":"2023-06-10T18:52:47.094637+0000","last_peered":"2023-06-10T18:52:47.094637+0000","last_clean":"2023-06-10T18:52:47.094637+0000","last_became_active":"2023-06-10T18:52:44.936793+0000","last_became_peered":"2023-06-10T18:52:44.936793+0000","last_unstale":"2023-06-10T18:52:47.094637+0000","last_undegraded":"2023-06-10T18:52:47.094637+0000","last_fullsized":"2023-06-10T18:52:47.094637+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:46:29.935621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.929593+0000","last_change":"2023-06-10T18:52:44.955794+0000","last_active":"2023-06-10T18:52:45.929593+0000","last_peered":"2023-06-10T18:52:45.929593+0000","last_clean":"2023-06-10T18:52:45.929593+0000","last_became_active":"2023-06-10T18:52:44.955013+0000","last_became_peered":"2023-06-10T18:52:44.955013+0000","last_unstale":"2023-06-10T18:52:45.929593+0000","last_undegraded":"2023-06-10T18:52:45.929593+0000","last_fullsized":"2023-06-10T18:52:45.929593+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:37:28.673117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.096398+0000","last_change":"2023-06-10T18:52:44.586121+0000","last_active":"2023-06-10T18:52:47.096398+0000","last_peered":"2023-06-10T18:52:47.096398+0000","last_clean":"2023-06-10T18:52:47.096398+0000","last_became_active":"2023-06-10T18:52:44.584334+0000","last_became_peered":"2023-06-10T18:52:44.584334+0000","last_unstale":"2023-06-10T18:52:47.096398+0000","last_undegraded":"2023-06-10T18:52:47.096398+0000","last_fullsized":"2023-06-10T18:52:47.096398+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:44:27.810129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.934843+0000","last_change":"2023-06-10T18:52:44.942980+0000","last_active":"2023-06-10T18:52:45.934843+0000","last_peered":"2023-06-10T18:52:45.934843+0000","last_clean":"2023-06-10T18:52:45.934843+0000","last_became_active":"2023-06-10T18:52:44.942538+0000","last_became_peered":"2023-06-10T18:52:44.942538+0000","last_unstale":"2023-06-10T18:52:45.934843+0000","last_undegraded":"2023-06-10T18:52:45.934843+0000","last_fullsized":"2023-06-10T18:52:45.934843+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:39:06.207720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.073250+0000","last_change":"2023-06-10T18:52:44.573070+0000","last_active":"2023-06-10T18:52:47.073250+0000","last_peered":"2023-06-10T18:52:47.073250+0000","last_clean":"2023-06-10T18:52:47.073250+0000","last_became_active":"2023-06-10T18:52:44.572659+0000","last_became_peered":"2023-06-10T18:52:44.572659+0000","last_unstale":"2023-06-10T18:52:47.073250+0000","last_undegraded":"2023-06-10T18:52:47.073250+0000","last_fullsized":"2023-06-10T18:52:47.073250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:31:19.942168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.073865+0000","last_change":"2023-06-10T18:52:44.966527+0000","last_active":"2023-06-10T18:52:47.073865+0000","last_peered":"2023-06-10T18:52:47.073865+0000","last_clean":"2023-06-10T18:52:47.073865+0000","last_became_active":"2023-06-10T18:52:44.962455+0000","last_became_peered":"2023-06-10T18:52:44.962455+0000","last_unstale":"2023-06-10T18:52:47.073865+0000","last_undegraded":"2023-06-10T18:52:47.073865+0000","last_fullsized":"2023-06-10T18:52:47.073865+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:39:06.207720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.096102+0000","last_change":"2023-06-10T18:52:44.584545+0000","last_active":"2023-06-10T18:52:47.096102+0000","last_peered":"2023-06-10T18:52:47.096102+0000","last_clean":"2023-06-10T18:52:47.096102+0000","last_became_active":"2023-06-10T18:52:44.583973+0000","last_became_peered":"2023-06-10T18:52:44.583973+0000","last_unstale":"2023-06-10T18:52:47.096102+0000","last_undegraded":"2023-06-10T18:52:47.096102+0000","last_fullsized":"2023-06-10T18:52:47.096102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:37:25.343271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.929677+0000","last_change":"2023-06-10T18:52:44.946578+0000","last_active":"2023-06-10T18:52:45.929677+0000","last_peered":"2023-06-10T18:52:45.929677+0000","last_clean":"2023-06-10T18:52:45.929677+0000","last_became_active":"2023-06-10T18:52:44.945951+0000","last_became_peered":"2023-06-10T18:52:44.945951+0000","last_unstale":"2023-06-10T18:52:45.929677+0000","last_undegraded":"2023-06-10T18:52:45.929677+0000","last_fullsized":"2023-06-10T18:52:45.929677+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:59:51.325397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.094726+0000","last_change":"2023-06-10T18:52:44.556644+0000","last_active":"2023-06-10T18:52:47.094726+0000","last_peered":"2023-06-10T18:52:47.094726+0000","last_clean":"2023-06-10T18:52:47.094726+0000","last_became_active":"2023-06-10T18:52:44.554676+0000","last_became_peered":"2023-06-10T18:52:44.554676+0000","last_unstale":"2023-06-10T18:52:47.094726+0000","last_undegraded":"2023-06-10T18:52:47.094726+0000","last_fullsized":"2023-06-10T18:52:47.094726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:39:58.210679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.096897+0000","last_change":"2023-06-10T18:52:44.586426+0000","last_active":"2023-06-10T18:52:47.096897+0000","last_peered":"2023-06-10T18:52:47.096897+0000","last_clean":"2023-06-10T18:52:47.096897+0000","last_became_active":"2023-06-10T18:52:44.585486+0000","last_became_peered":"2023-06-10T18:52:44.585486+0000","last_unstale":"2023-06-10T18:52:47.096897+0000","last_undegraded":"2023-06-10T18:52:47.096897+0000","last_fullsized":"2023-06-10T18:52:47.096897+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:21:48.058795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.934330+0000","last_change":"2023-06-10T18:52:44.948157+0000","last_active":"2023-06-10T18:52:45.934330+0000","last_peered":"2023-06-10T18:52:45.934330+0000","last_clean":"2023-06-10T18:52:45.934330+0000","last_became_active":"2023-06-10T18:52:44.947864+0000","last_became_peered":"2023-06-10T18:52:44.947864+0000","last_unstale":"2023-06-10T18:52:45.934330+0000","last_undegraded":"2023-06-10T18:52:45.934330+0000","last_fullsized":"2023-06-10T18:52:45.934330+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:42:51.947168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.096656+0000","last_change":"2023-06-10T18:52:44.585679+0000","last_active":"2023-06-10T18:52:47.096656+0000","last_peered":"2023-06-10T18:52:47.096656+0000","last_clean":"2023-06-10T18:52:47.096656+0000","last_became_active":"2023-06-10T18:52:44.585190+0000","last_became_peered":"2023-06-10T18:52:44.585190+0000","last_unstale":"2023-06-10T18:52:47.096656+0000","last_undegraded":"2023-06-10T18:52:47.096656+0000","last_fullsized":"2023-06-10T18:52:47.096656+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:28:02.644430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.932803+0000","last_change":"2023-06-10T18:52:44.958947+0000","last_active":"2023-06-10T18:52:45.932803+0000","last_peered":"2023-06-10T18:52:45.932803+0000","last_clean":"2023-06-10T18:52:45.932803+0000","last_became_active":"2023-06-10T18:52:44.958289+0000","last_became_peered":"2023-06-10T18:52:44.958289+0000","last_unstale":"2023-06-10T18:52:45.932803+0000","last_undegraded":"2023-06-10T18:52:45.932803+0000","last_fullsized":"2023-06-10T18:52:45.932803+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:34:51.394045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.096353+0000","last_change":"2023-06-10T18:52:44.581981+0000","last_active":"2023-06-10T18:52:47.096353+0000","last_peered":"2023-06-10T18:52:47.096353+0000","last_clean":"2023-06-10T18:52:47.096353+0000","last_became_active":"2023-06-10T18:52:44.581382+0000","last_became_peered":"2023-06-10T18:52:44.581382+0000","last_unstale":"2023-06-10T18:52:47.096353+0000","last_undegraded":"2023-06-10T18:52:47.096353+0000","last_fullsized":"2023-06-10T18:52:47.096353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:34:50.390041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.094856+0000","last_change":"2023-06-10T18:52:44.958474+0000","last_active":"2023-06-10T18:52:47.094856+0000","last_peered":"2023-06-10T18:52:47.094856+0000","last_clean":"2023-06-10T18:52:47.094856+0000","last_became_active":"2023-06-10T18:52:44.958186+0000","last_became_peered":"2023-06-10T18:52:44.958186+0000","last_unstale":"2023-06-10T18:52:47.094856+0000","last_undegraded":"2023-06-10T18:52:47.094856+0000","last_fullsized":"2023-06-10T18:52:47.094856+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:38:29.923050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.934807+0000","last_change":"2023-06-10T18:52:44.559256+0000","last_active":"2023-06-10T18:52:45.934807+0000","last_peered":"2023-06-10T18:52:45.934807+0000","last_clean":"2023-06-10T18:52:45.934807+0000","last_became_active":"2023-06-10T18:52:44.558447+0000","last_became_peered":"2023-06-10T18:52:44.558447+0000","last_unstale":"2023-06-10T18:52:45.934807+0000","last_undegraded":"2023-06-10T18:52:45.934807+0000","last_fullsized":"2023-06-10T18:52:45.934807+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:39:09.014604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.073739+0000","last_change":"2023-06-10T18:52:44.962607+0000","last_active":"2023-06-10T18:52:47.073739+0000","last_peered":"2023-06-10T18:52:47.073739+0000","last_clean":"2023-06-10T18:52:47.073739+0000","last_became_active":"2023-06-10T18:52:44.962105+0000","last_became_peered":"2023-06-10T18:52:44.962105+0000","last_unstale":"2023-06-10T18:52:47.073739+0000","last_undegraded":"2023-06-10T18:52:47.073739+0000","last_fullsized":"2023-06-10T18:52:47.073739+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:39:10.888321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.930610+0000","last_change":"2023-06-10T18:52:44.559397+0000","last_active":"2023-06-10T18:52:45.930610+0000","last_peered":"2023-06-10T18:52:45.930610+0000","last_clean":"2023-06-10T18:52:45.930610+0000","last_became_active":"2023-06-10T18:52:44.558955+0000","last_became_peered":"2023-06-10T18:52:44.558955+0000","last_unstale":"2023-06-10T18:52:45.930610+0000","last_undegraded":"2023-06-10T18:52:45.930610+0000","last_fullsized":"2023-06-10T18:52:45.930610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:49:48.614848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.931811+0000","last_change":"2023-06-10T18:52:44.955143+0000","last_active":"2023-06-10T18:52:45.931811+0000","last_peered":"2023-06-10T18:52:45.931811+0000","last_clean":"2023-06-10T18:52:45.931811+0000","last_became_active":"2023-06-10T18:52:44.954157+0000","last_became_peered":"2023-06-10T18:52:44.954157+0000","last_unstale":"2023-06-10T18:52:45.931811+0000","last_undegraded":"2023-06-10T18:52:45.931811+0000","last_fullsized":"2023-06-10T18:52:45.931811+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:53:28.618960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.095432+0000","last_change":"2023-06-10T18:52:44.575768+0000","last_active":"2023-06-10T18:52:47.095432+0000","last_peered":"2023-06-10T18:52:47.095432+0000","last_clean":"2023-06-10T18:52:47.095432+0000","last_became_active":"2023-06-10T18:52:44.575122+0000","last_became_peered":"2023-06-10T18:52:44.575122+0000","last_unstale":"2023-06-10T18:52:47.095432+0000","last_undegraded":"2023-06-10T18:52:47.095432+0000","last_fullsized":"2023-06-10T18:52:47.095432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:01:26.727248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.932347+0000","last_change":"2023-06-10T18:52:44.938302+0000","last_active":"2023-06-10T18:52:45.932347+0000","last_peered":"2023-06-10T18:52:45.932347+0000","last_clean":"2023-06-10T18:52:45.932347+0000","last_became_active":"2023-06-10T18:52:44.938005+0000","last_became_peered":"2023-06-10T18:52:44.938005+0000","last_unstale":"2023-06-10T18:52:45.932347+0000","last_undegraded":"2023-06-10T18:52:45.932347+0000","last_fullsized":"2023-06-10T18:52:45.932347+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:49:49.618852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.932470+0000","last_change":"2023-06-10T18:52:44.561044+0000","last_active":"2023-06-10T18:52:45.932470+0000","last_peered":"2023-06-10T18:52:45.932470+0000","last_clean":"2023-06-10T18:52:45.932470+0000","last_became_active":"2023-06-10T18:52:44.560233+0000","last_became_peered":"2023-06-10T18:52:44.560233+0000","last_unstale":"2023-06-10T18:52:45.932470+0000","last_undegraded":"2023-06-10T18:52:45.932470+0000","last_fullsized":"2023-06-10T18:52:45.932470+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:37:25.343271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.932395+0000","last_change":"2023-06-10T18:52:44.951038+0000","last_active":"2023-06-10T18:52:45.932395+0000","last_peered":"2023-06-10T18:52:45.932395+0000","last_clean":"2023-06-10T18:52:45.932395+0000","last_became_active":"2023-06-10T18:52:44.942868+0000","last_became_peered":"2023-06-10T18:52:44.942868+0000","last_unstale":"2023-06-10T18:52:45.932395+0000","last_undegraded":"2023-06-10T18:52:45.932395+0000","last_fullsized":"2023-06-10T18:52:45.932395+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:41:13.376627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.929453+0000","last_change":"2023-06-10T18:52:44.558548+0000","last_active":"2023-06-10T18:52:45.929453+0000","last_peered":"2023-06-10T18:52:45.929453+0000","last_clean":"2023-06-10T18:52:45.929453+0000","last_became_active":"2023-06-10T18:52:44.558194+0000","last_became_peered":"2023-06-10T18:52:44.558194+0000","last_unstale":"2023-06-10T18:52:45.929453+0000","last_undegraded":"2023-06-10T18:52:45.929453+0000","last_fullsized":"2023-06-10T18:52:45.929453+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:54:33.867663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.094869+0000","last_change":"2023-06-10T18:52:44.967155+0000","last_active":"2023-06-10T18:52:47.094869+0000","last_peered":"2023-06-10T18:52:47.094869+0000","last_clean":"2023-06-10T18:52:47.094869+0000","last_became_active":"2023-06-10T18:52:44.966889+0000","last_became_peered":"2023-06-10T18:52:44.966889+0000","last_unstale":"2023-06-10T18:52:47.094869+0000","last_undegraded":"2023-06-10T18:52:47.094869+0000","last_fullsized":"2023-06-10T18:52:47.094869+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:42:51.947168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":175,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.095406+0000","last_change":"2023-06-10T18:52:34.951528+0000","last_active":"2023-06-10T18:52:47.095406+0000","last_peered":"2023-06-10T18:52:47.095406+0000","last_clean":"2023-06-10T18:52:47.095406+0000","last_became_active":"2023-06-10T18:52:34.949099+0000","last_became_peered":"2023-06-10T18:52:34.949099+0000","last_unstale":"2023-06-10T18:52:47.095406+0000","last_undegraded":"2023-06-10T18:52:47.095406+0000","last_fullsized":"2023-06-10T18:52:47.095406+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_clean_scrub_stamp":"2023-06-10T18:52:33.633295+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:41:02.488686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.934561+0000","last_change":"2023-06-10T18:52:40.506384+0000","last_active":"2023-06-10T18:52:45.934561+0000","last_peered":"2023-06-10T18:52:45.934561+0000","last_clean":"2023-06-10T18:52:45.934561+0000","last_became_active":"2023-06-10T18:52:40.505701+0000","last_became_peered":"2023-06-10T18:52:40.505701+0000","last_unstale":"2023-06-10T18:52:45.934561+0000","last_undegraded":"2023-06-10T18:52:45.934561+0000","last_fullsized":"2023-06-10T18:52:45.934561+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:39:05.841926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.929409+0000","last_change":"2023-06-10T18:52:44.563326+0000","last_active":"2023-06-10T18:52:45.929409+0000","last_peered":"2023-06-10T18:52:45.929409+0000","last_clean":"2023-06-10T18:52:45.929409+0000","last_became_active":"2023-06-10T18:52:44.562901+0000","last_became_peered":"2023-06-10T18:52:44.562901+0000","last_unstale":"2023-06-10T18:52:45.929409+0000","last_undegraded":"2023-06-10T18:52:45.929409+0000","last_fullsized":"2023-06-10T18:52:45.929409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:29:32.049058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.095326+0000","last_change":"2023-06-10T18:52:44.940336+0000","last_active":"2023-06-10T18:52:47.095326+0000","last_peered":"2023-06-10T18:52:47.095326+0000","last_clean":"2023-06-10T18:52:47.095326+0000","last_became_active":"2023-06-10T18:52:44.939935+0000","last_became_peered":"2023-06-10T18:52:44.939935+0000","last_unstale":"2023-06-10T18:52:47.095326+0000","last_undegraded":"2023-06-10T18:52:47.095326+0000","last_fullsized":"2023-06-10T18:52:47.095326+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:42:44.531042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.095044+0000","last_change":"2023-06-10T18:52:40.512015+0000","last_active":"2023-06-10T18:52:47.095044+0000","last_peered":"2023-06-10T18:52:47.095044+0000","last_clean":"2023-06-10T18:52:47.095044+0000","last_became_active":"2023-06-10T18:52:40.511382+0000","last_became_peered":"2023-06-10T18:52:40.511382+0000","last_unstale":"2023-06-10T18:52:47.095044+0000","last_undegraded":"2023-06-10T18:52:47.095044+0000","last_fullsized":"2023-06-10T18:52:47.095044+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:49:44.572458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.073029+0000","last_change":"2023-06-10T18:52:44.575339+0000","last_active":"2023-06-10T18:52:47.073029+0000","last_peered":"2023-06-10T18:52:47.073029+0000","last_clean":"2023-06-10T18:52:47.073029+0000","last_became_active":"2023-06-10T18:52:44.575020+0000","last_became_peered":"2023-06-10T18:52:44.575020+0000","last_unstale":"2023-06-10T18:52:47.073029+0000","last_undegraded":"2023-06-10T18:52:47.073029+0000","last_fullsized":"2023-06-10T18:52:47.073029+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:29:32.049058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.073832+0000","last_change":"2023-06-10T18:52:44.960817+0000","last_active":"2023-06-10T18:52:47.073832+0000","last_peered":"2023-06-10T18:52:47.073832+0000","last_clean":"2023-06-10T18:52:47.073832+0000","last_became_active":"2023-06-10T18:52:44.960128+0000","last_became_peered":"2023-06-10T18:52:44.960128+0000","last_unstale":"2023-06-10T18:52:47.073832+0000","last_undegraded":"2023-06-10T18:52:47.073832+0000","last_fullsized":"2023-06-10T18:52:47.073832+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:39:10.018608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.093628+0000","last_change":"2023-06-10T18:52:40.671725+0000","last_active":"2023-06-10T18:52:47.093628+0000","last_peered":"2023-06-10T18:52:47.093628+0000","last_clean":"2023-06-10T18:52:47.093628+0000","last_became_active":"2023-06-10T18:52:40.671442+0000","last_became_peered":"2023-06-10T18:52:40.671442+0000","last_unstale":"2023-06-10T18:52:47.093628+0000","last_undegraded":"2023-06-10T18:52:47.093628+0000","last_fullsized":"2023-06-10T18:52:47.093628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:50:04.521612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.094350+0000","last_change":"2023-06-10T18:52:44.554010+0000","last_active":"2023-06-10T18:52:47.094350+0000","last_peered":"2023-06-10T18:52:47.094350+0000","last_clean":"2023-06-10T18:52:47.094350+0000","last_became_active":"2023-06-10T18:52:44.553706+0000","last_became_peered":"2023-06-10T18:52:44.553706+0000","last_unstale":"2023-06-10T18:52:47.094350+0000","last_undegraded":"2023-06-10T18:52:47.094350+0000","last_fullsized":"2023-06-10T18:52:47.094350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:08:49.327602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.094957+0000","last_change":"2023-06-10T18:52:44.954070+0000","last_active":"2023-06-10T18:52:47.094957+0000","last_peered":"2023-06-10T18:52:47.094957+0000","last_clean":"2023-06-10T18:52:47.094957+0000","last_became_active":"2023-06-10T18:52:44.953811+0000","last_became_peered":"2023-06-10T18:52:44.953811+0000","last_unstale":"2023-06-10T18:52:47.094957+0000","last_undegraded":"2023-06-10T18:52:47.094957+0000","last_fullsized":"2023-06-10T18:52:47.094957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:39:10.888321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.935370+0000","last_change":"2023-06-10T18:52:40.510258+0000","last_active":"2023-06-10T18:52:45.935370+0000","last_peered":"2023-06-10T18:52:45.935370+0000","last_clean":"2023-06-10T18:52:45.935370+0000","last_became_active":"2023-06-10T18:52:40.509560+0000","last_became_peered":"2023-06-10T18:52:40.509560+0000","last_unstale":"2023-06-10T18:52:45.935370+0000","last_undegraded":"2023-06-10T18:52:45.935370+0000","last_fullsized":"2023-06-10T18:52:45.935370+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:14:06.459934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.932037+0000","last_change":"2023-06-10T18:52:44.574974+0000","last_active":"2023-06-10T18:52:45.932037+0000","last_peered":"2023-06-10T18:52:45.932037+0000","last_clean":"2023-06-10T18:52:45.932037+0000","last_became_active":"2023-06-10T18:52:44.574115+0000","last_became_peered":"2023-06-10T18:52:44.574115+0000","last_unstale":"2023-06-10T18:52:45.932037+0000","last_undegraded":"2023-06-10T18:52:45.932037+0000","last_fullsized":"2023-06-10T18:52:45.932037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:39:09.884317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.095249+0000","last_change":"2023-06-10T18:52:44.954466+0000","last_active":"2023-06-10T18:52:47.095249+0000","last_peered":"2023-06-10T18:52:47.095249+0000","last_clean":"2023-06-10T18:52:47.095249+0000","last_became_active":"2023-06-10T18:52:44.953993+0000","last_became_peered":"2023-06-10T18:52:44.953993+0000","last_unstale":"2023-06-10T18:52:47.095249+0000","last_undegraded":"2023-06-10T18:52:47.095249+0000","last_fullsized":"2023-06-10T18:52:47.095249+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:50:18.328232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.935077+0000","last_change":"2023-06-10T18:52:44.558952+0000","last_active":"2023-06-10T18:52:45.935077+0000","last_peered":"2023-06-10T18:52:45.935077+0000","last_clean":"2023-06-10T18:52:45.935077+0000","last_became_active":"2023-06-10T18:52:44.558238+0000","last_became_peered":"2023-06-10T18:52:44.558238+0000","last_unstale":"2023-06-10T18:52:45.935077+0000","last_undegraded":"2023-06-10T18:52:45.935077+0000","last_fullsized":"2023-06-10T18:52:45.935077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T18:54:15.709068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.095574+0000","last_change":"2023-06-10T18:52:40.672266+0000","last_active":"2023-06-10T18:52:47.095574+0000","last_peered":"2023-06-10T18:52:47.095574+0000","last_clean":"2023-06-10T18:52:47.095574+0000","last_became_active":"2023-06-10T18:52:40.671966+0000","last_became_peered":"2023-06-10T18:52:40.671966+0000","last_unstale":"2023-06-10T18:52:47.095574+0000","last_undegraded":"2023-06-10T18:52:47.095574+0000","last_fullsized":"2023-06-10T18:52:47.095574+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:41:08.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.094687+0000","last_change":"2023-06-10T18:52:44.953256+0000","last_active":"2023-06-10T18:52:47.094687+0000","last_peered":"2023-06-10T18:52:47.094687+0000","last_clean":"2023-06-10T18:52:47.094687+0000","last_became_active":"2023-06-10T18:52:44.952882+0000","last_became_peered":"2023-06-10T18:52:44.952882+0000","last_unstale":"2023-06-10T18:52:47.094687+0000","last_undegraded":"2023-06-10T18:52:47.094687+0000","last_fullsized":"2023-06-10T18:52:47.094687+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:37:28.673117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.095401+0000","last_change":"2023-06-10T18:52:44.555209+0000","last_active":"2023-06-10T18:52:47.095401+0000","last_peered":"2023-06-10T18:52:47.095401+0000","last_clean":"2023-06-10T18:52:47.095401+0000","last_became_active":"2023-06-10T18:52:44.554807+0000","last_became_peered":"2023-06-10T18:52:44.554807+0000","last_unstale":"2023-06-10T18:52:47.095401+0000","last_undegraded":"2023-06-10T18:52:47.095401+0000","last_fullsized":"2023-06-10T18:52:47.095401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:39:05.203717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.096653+0000","last_change":"2023-06-10T18:52:40.671084+0000","last_active":"2023-06-10T18:52:47.096653+0000","last_peered":"2023-06-10T18:52:47.096653+0000","last_clean":"2023-06-10T18:52:47.096653+0000","last_became_active":"2023-06-10T18:52:40.670697+0000","last_became_peered":"2023-06-10T18:52:40.670697+0000","last_unstale":"2023-06-10T18:52:47.096653+0000","last_undegraded":"2023-06-10T18:52:47.096653+0000","last_fullsized":"2023-06-10T18:52:47.096653+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:32:49.983600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.073669+0000","last_change":"2023-06-10T18:52:44.952636+0000","last_active":"2023-06-10T18:52:47.073669+0000","last_peered":"2023-06-10T18:52:47.073669+0000","last_clean":"2023-06-10T18:52:47.073669+0000","last_became_active":"2023-06-10T18:52:44.952234+0000","last_became_peered":"2023-06-10T18:52:44.952234+0000","last_unstale":"2023-06-10T18:52:47.073669+0000","last_undegraded":"2023-06-10T18:52:47.073669+0000","last_fullsized":"2023-06-10T18:52:47.073669+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:59:51.325397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.929887+0000","last_change":"2023-06-10T18:52:44.573554+0000","last_active":"2023-06-10T18:52:45.929887+0000","last_peered":"2023-06-10T18:52:45.929887+0000","last_clean":"2023-06-10T18:52:45.929887+0000","last_became_active":"2023-06-10T18:52:44.573142+0000","last_became_peered":"2023-06-10T18:52:44.573142+0000","last_unstale":"2023-06-10T18:52:45.929887+0000","last_undegraded":"2023-06-10T18:52:45.929887+0000","last_fullsized":"2023-06-10T18:52:45.929887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:39:05.203717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.095517+0000","last_change":"2023-06-10T18:52:40.514114+0000","last_active":"2023-06-10T18:52:47.095517+0000","last_peered":"2023-06-10T18:52:47.095517+0000","last_clean":"2023-06-10T18:52:47.095517+0000","last_became_active":"2023-06-10T18:52:40.513638+0000","last_became_peered":"2023-06-10T18:52:40.513638+0000","last_unstale":"2023-06-10T18:52:47.095517+0000","last_undegraded":"2023-06-10T18:52:47.095517+0000","last_fullsized":"2023-06-10T18:52:47.095517+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:49:44.572458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.929271+0000","last_change":"2023-06-10T18:52:44.949048+0000","last_active":"2023-06-10T18:52:45.929271+0000","last_peered":"2023-06-10T18:52:45.929271+0000","last_clean":"2023-06-10T18:52:45.929271+0000","last_became_active":"2023-06-10T18:52:44.948643+0000","last_became_peered":"2023-06-10T18:52:44.948643+0000","last_unstale":"2023-06-10T18:52:45.929271+0000","last_undegraded":"2023-06-10T18:52:45.929271+0000","last_fullsized":"2023-06-10T18:52:45.929271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:38:52.793572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.596864+0000","last_change":"2023-06-10T18:52:44.555532+0000","last_active":"2023-06-10T18:52:47.596864+0000","last_peered":"2023-06-10T18:52:47.596864+0000","last_clean":"2023-06-10T18:52:47.596864+0000","last_became_active":"2023-06-10T18:52:44.555234+0000","last_became_peered":"2023-06-10T18:52:44.555234+0000","last_unstale":"2023-06-10T18:52:47.596864+0000","last_undegraded":"2023-06-10T18:52:47.596864+0000","last_fullsized":"2023-06-10T18:52:47.596864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:08:03.476132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.095638+0000","last_change":"2023-06-10T18:52:40.515396+0000","last_active":"2023-06-10T18:52:47.095638+0000","last_peered":"2023-06-10T18:52:47.095638+0000","last_clean":"2023-06-10T18:52:47.095638+0000","last_became_active":"2023-06-10T18:52:40.514663+0000","last_became_peered":"2023-06-10T18:52:40.514663+0000","last_unstale":"2023-06-10T18:52:47.095638+0000","last_undegraded":"2023-06-10T18:52:47.095638+0000","last_fullsized":"2023-06-10T18:52:47.095638+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:29:28.006668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.932272+0000","last_change":"2023-06-10T18:52:44.946073+0000","last_active":"2023-06-10T18:52:45.932272+0000","last_peered":"2023-06-10T18:52:45.932272+0000","last_clean":"2023-06-10T18:52:45.932272+0000","last_became_active":"2023-06-10T18:52:44.945497+0000","last_became_peered":"2023-06-10T18:52:44.945497+0000","last_unstale":"2023-06-10T18:52:45.932272+0000","last_undegraded":"2023-06-10T18:52:45.932272+0000","last_fullsized":"2023-06-10T18:52:45.932272+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:08:04.480136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.931851+0000","last_change":"2023-06-10T18:52:44.943166+0000","last_active":"2023-06-10T18:52:45.931851+0000","last_peered":"2023-06-10T18:52:45.931851+0000","last_clean":"2023-06-10T18:52:45.931851+0000","last_became_active":"2023-06-10T18:52:44.942777+0000","last_became_peered":"2023-06-10T18:52:44.942777+0000","last_unstale":"2023-06-10T18:52:45.931851+0000","last_undegraded":"2023-06-10T18:52:45.931851+0000","last_fullsized":"2023-06-10T18:52:45.931851+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:59:51.325397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"22'6","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.932027+0000","last_change":"2023-06-10T18:52:44.575890+0000","last_active":"2023-06-10T18:52:45.932027+0000","last_peered":"2023-06-10T18:52:45.932027+0000","last_clean":"2023-06-10T18:52:45.932027+0000","last_became_active":"2023-06-10T18:52:44.573780+0000","last_became_peered":"2023-06-10T18:52:44.573780+0000","last_unstale":"2023-06-10T18:52:45.932027+0000","last_undegraded":"2023-06-10T18:52:45.932027+0000","last_fullsized":"2023-06-10T18:52:45.932027+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:50:17.324228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.094568+0000","last_change":"2023-06-10T18:52:44.955836+0000","last_active":"2023-06-10T18:52:47.094568+0000","last_peered":"2023-06-10T18:52:47.094568+0000","last_clean":"2023-06-10T18:52:47.094568+0000","last_became_active":"2023-06-10T18:52:44.955427+0000","last_became_peered":"2023-06-10T18:52:44.955427+0000","last_unstale":"2023-06-10T18:52:47.094568+0000","last_undegraded":"2023-06-10T18:52:47.094568+0000","last_fullsized":"2023-06-10T18:52:47.094568+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:53:28.618960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.096692+0000","last_change":"2023-06-10T18:52:44.583026+0000","last_active":"2023-06-10T18:52:47.096692+0000","last_peered":"2023-06-10T18:52:47.096692+0000","last_clean":"2023-06-10T18:52:47.096692+0000","last_became_active":"2023-06-10T18:52:44.582436+0000","last_became_peered":"2023-06-10T18:52:44.582436+0000","last_unstale":"2023-06-10T18:52:47.096692+0000","last_undegraded":"2023-06-10T18:52:47.096692+0000","last_fullsized":"2023-06-10T18:52:47.096692+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:15:28.452018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.935637+0000","last_change":"2023-06-10T18:52:44.573591+0000","last_active":"2023-06-10T18:52:45.935637+0000","last_peered":"2023-06-10T18:52:45.935637+0000","last_clean":"2023-06-10T18:52:45.935637+0000","last_became_active":"2023-06-10T18:52:44.572802+0000","last_became_peered":"2023-06-10T18:52:44.572802+0000","last_unstale":"2023-06-10T18:52:45.935637+0000","last_undegraded":"2023-06-10T18:52:45.935637+0000","last_fullsized":"2023-06-10T18:52:45.935637+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:34:50.390041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.929760+0000","last_change":"2023-06-10T18:52:44.944441+0000","last_active":"2023-06-10T18:52:45.929760+0000","last_peered":"2023-06-10T18:52:45.929760+0000","last_clean":"2023-06-10T18:52:45.929760+0000","last_became_active":"2023-06-10T18:52:44.944031+0000","last_became_peered":"2023-06-10T18:52:44.944031+0000","last_unstale":"2023-06-10T18:52:45.929760+0000","last_undegraded":"2023-06-10T18:52:45.929760+0000","last_fullsized":"2023-06-10T18:52:45.929760+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:39:10.888321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.073751+0000","last_change":"2023-06-10T18:52:44.563525+0000","last_active":"2023-06-10T18:52:47.073751+0000","last_peered":"2023-06-10T18:52:47.073751+0000","last_clean":"2023-06-10T18:52:47.073751+0000","last_became_active":"2023-06-10T18:52:44.563140+0000","last_became_peered":"2023-06-10T18:52:44.563140+0000","last_unstale":"2023-06-10T18:52:47.073751+0000","last_undegraded":"2023-06-10T18:52:47.073751+0000","last_fullsized":"2023-06-10T18:52:47.073751+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:50:17.324228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.929241+0000","last_change":"2023-06-10T18:52:44.953481+0000","last_active":"2023-06-10T18:52:45.929241+0000","last_peered":"2023-06-10T18:52:45.929241+0000","last_clean":"2023-06-10T18:52:45.929241+0000","last_became_active":"2023-06-10T18:52:44.953139+0000","last_became_peered":"2023-06-10T18:52:44.953139+0000","last_unstale":"2023-06-10T18:52:45.929241+0000","last_undegraded":"2023-06-10T18:52:45.929241+0000","last_fullsized":"2023-06-10T18:52:45.929241+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:01:27.731251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.095689+0000","last_change":"2023-06-10T18:52:44.946900+0000","last_active":"2023-06-10T18:52:47.095689+0000","last_peered":"2023-06-10T18:52:47.095689+0000","last_clean":"2023-06-10T18:52:47.095689+0000","last_became_active":"2023-06-10T18:52:44.946612+0000","last_became_peered":"2023-06-10T18:52:44.946612+0000","last_unstale":"2023-06-10T18:52:47.095689+0000","last_undegraded":"2023-06-10T18:52:47.095689+0000","last_fullsized":"2023-06-10T18:52:47.095689+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:38:52.793572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.929494+0000","last_change":"2023-06-10T18:52:44.561213+0000","last_active":"2023-06-10T18:52:45.929494+0000","last_peered":"2023-06-10T18:52:45.929494+0000","last_clean":"2023-06-10T18:52:45.929494+0000","last_became_active":"2023-06-10T18:52:44.560946+0000","last_became_peered":"2023-06-10T18:52:44.560946+0000","last_unstale":"2023-06-10T18:52:45.929494+0000","last_undegraded":"2023-06-10T18:52:45.929494+0000","last_fullsized":"2023-06-10T18:52:45.929494+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:08:49.327602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.073688+0000","last_change":"2023-06-10T18:52:44.951860+0000","last_active":"2023-06-10T18:52:47.073688+0000","last_peered":"2023-06-10T18:52:47.073688+0000","last_clean":"2023-06-10T18:52:47.073688+0000","last_became_active":"2023-06-10T18:52:44.949078+0000","last_became_peered":"2023-06-10T18:52:44.949078+0000","last_unstale":"2023-06-10T18:52:47.073688+0000","last_undegraded":"2023-06-10T18:52:47.073688+0000","last_fullsized":"2023-06-10T18:52:47.073688+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:42:51.947168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.094812+0000","last_change":"2023-06-10T18:52:44.559767+0000","last_active":"2023-06-10T18:52:47.094812+0000","last_peered":"2023-06-10T18:52:47.094812+0000","last_clean":"2023-06-10T18:52:47.094812+0000","last_became_active":"2023-06-10T18:52:44.559451+0000","last_became_peered":"2023-06-10T18:52:44.559451+0000","last_unstale":"2023-06-10T18:52:47.094812+0000","last_undegraded":"2023-06-10T18:52:47.094812+0000","last_fullsized":"2023-06-10T18:52:47.094812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:59:50.321394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.929761+0000","last_change":"2023-06-10T18:52:44.960896+0000","last_active":"2023-06-10T18:52:45.929761+0000","last_peered":"2023-06-10T18:52:45.929761+0000","last_clean":"2023-06-10T18:52:45.929761+0000","last_became_active":"2023-06-10T18:52:44.960188+0000","last_became_peered":"2023-06-10T18:52:44.960188+0000","last_unstale":"2023-06-10T18:52:45.929761+0000","last_undegraded":"2023-06-10T18:52:45.929761+0000","last_fullsized":"2023-06-10T18:52:45.929761+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:50:18.328232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.932875+0000","last_change":"2023-06-10T18:52:44.552411+0000","last_active":"2023-06-10T18:52:45.932875+0000","last_peered":"2023-06-10T18:52:45.932875+0000","last_clean":"2023-06-10T18:52:45.932875+0000","last_became_active":"2023-06-10T18:52:44.551312+0000","last_became_peered":"2023-06-10T18:52:44.551312+0000","last_unstale":"2023-06-10T18:52:45.932875+0000","last_undegraded":"2023-06-10T18:52:45.932875+0000","last_fullsized":"2023-06-10T18:52:45.932875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:44:27.810129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.094468+0000","last_change":"2023-06-10T18:52:44.965460+0000","last_active":"2023-06-10T18:52:47.094468+0000","last_peered":"2023-06-10T18:52:47.094468+0000","last_clean":"2023-06-10T18:52:47.094468+0000","last_became_active":"2023-06-10T18:52:44.964988+0000","last_became_peered":"2023-06-10T18:52:44.964988+0000","last_unstale":"2023-06-10T18:52:47.094468+0000","last_undegraded":"2023-06-10T18:52:47.094468+0000","last_fullsized":"2023-06-10T18:52:47.094468+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:46:29.935621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.074090+0000","last_change":"2023-06-10T18:52:44.576675+0000","last_active":"2023-06-10T18:52:47.074090+0000","last_peered":"2023-06-10T18:52:47.074090+0000","last_clean":"2023-06-10T18:52:47.074090+0000","last_became_active":"2023-06-10T18:52:44.576362+0000","last_became_peered":"2023-06-10T18:52:44.576362+0000","last_unstale":"2023-06-10T18:52:47.074090+0000","last_undegraded":"2023-06-10T18:52:47.074090+0000","last_fullsized":"2023-06-10T18:52:47.074090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:49:48.614848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.931722+0000","last_change":"2023-06-10T18:52:44.941939+0000","last_active":"2023-06-10T18:52:45.931722+0000","last_peered":"2023-06-10T18:52:45.931722+0000","last_clean":"2023-06-10T18:52:45.931722+0000","last_became_active":"2023-06-10T18:52:44.939408+0000","last_became_peered":"2023-06-10T18:52:44.939408+0000","last_unstale":"2023-06-10T18:52:45.931722+0000","last_undegraded":"2023-06-10T18:52:45.931722+0000","last_fullsized":"2023-06-10T18:52:45.931722+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:31:20.946172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.934658+0000","last_change":"2023-06-10T18:52:44.574956+0000","last_active":"2023-06-10T18:52:45.934658+0000","last_peered":"2023-06-10T18:52:45.934658+0000","last_clean":"2023-06-10T18:52:45.934658+0000","last_became_active":"2023-06-10T18:52:44.574184+0000","last_became_peered":"2023-06-10T18:52:44.574184+0000","last_unstale":"2023-06-10T18:52:45.934658+0000","last_undegraded":"2023-06-10T18:52:45.934658+0000","last_fullsized":"2023-06-10T18:52:45.934658+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:50:17.324228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.932406+0000","last_change":"2023-06-10T18:52:44.944962+0000","last_active":"2023-06-10T18:52:45.932406+0000","last_peered":"2023-06-10T18:52:45.932406+0000","last_clean":"2023-06-10T18:52:45.932406+0000","last_became_active":"2023-06-10T18:52:44.944702+0000","last_became_peered":"2023-06-10T18:52:44.944702+0000","last_unstale":"2023-06-10T18:52:45.932406+0000","last_undegraded":"2023-06-10T18:52:45.932406+0000","last_fullsized":"2023-06-10T18:52:45.932406+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T18:54:16.713072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.935077+0000","last_change":"2023-06-10T18:52:44.576687+0000","last_active":"2023-06-10T18:52:45.935077+0000","last_peered":"2023-06-10T18:52:45.935077+0000","last_clean":"2023-06-10T18:52:45.935077+0000","last_became_active":"2023-06-10T18:52:44.575964+0000","last_became_peered":"2023-06-10T18:52:44.575964+0000","last_unstale":"2023-06-10T18:52:45.935077+0000","last_undegraded":"2023-06-10T18:52:45.935077+0000","last_fullsized":"2023-06-10T18:52:45.935077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:41:12.372624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.929739+0000","last_change":"2023-06-10T18:52:44.937999+0000","last_active":"2023-06-10T18:52:45.929739+0000","last_peered":"2023-06-10T18:52:45.929739+0000","last_clean":"2023-06-10T18:52:45.929739+0000","last_became_active":"2023-06-10T18:52:44.937614+0000","last_became_peered":"2023-06-10T18:52:44.937614+0000","last_unstale":"2023-06-10T18:52:45.929739+0000","last_undegraded":"2023-06-10T18:52:45.929739+0000","last_fullsized":"2023-06-10T18:52:45.929739+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:42:51.947168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.929840+0000","last_change":"2023-06-10T18:52:44.563109+0000","last_active":"2023-06-10T18:52:45.929840+0000","last_peered":"2023-06-10T18:52:45.929840+0000","last_clean":"2023-06-10T18:52:45.929840+0000","last_became_active":"2023-06-10T18:52:44.562809+0000","last_became_peered":"2023-06-10T18:52:44.562809+0000","last_unstale":"2023-06-10T18:52:45.929840+0000","last_undegraded":"2023-06-10T18:52:45.929840+0000","last_fullsized":"2023-06-10T18:52:45.929840+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:39:09.014604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.931609+0000","last_change":"2023-06-10T18:52:44.945839+0000","last_active":"2023-06-10T18:52:45.931609+0000","last_peered":"2023-06-10T18:52:45.931609+0000","last_clean":"2023-06-10T18:52:45.931609+0000","last_became_active":"2023-06-10T18:52:44.945171+0000","last_became_peered":"2023-06-10T18:52:44.945171+0000","last_unstale":"2023-06-10T18:52:45.931609+0000","last_undegraded":"2023-06-10T18:52:45.931609+0000","last_fullsized":"2023-06-10T18:52:45.931609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:54:34.871667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.073610+0000","last_change":"2023-06-10T18:52:44.563708+0000","last_active":"2023-06-10T18:52:47.073610+0000","last_peered":"2023-06-10T18:52:47.073610+0000","last_clean":"2023-06-10T18:52:47.073610+0000","last_became_active":"2023-06-10T18:52:44.563327+0000","last_became_peered":"2023-06-10T18:52:44.563327+0000","last_unstale":"2023-06-10T18:52:47.073610+0000","last_undegraded":"2023-06-10T18:52:47.073610+0000","last_fullsized":"2023-06-10T18:52:47.073610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:37:27.669113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":844,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":864256,"data_stored":681747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92400000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.022}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.016}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.113}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95799999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":249856,"data_stored":90251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2490000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":262144,"data_stored":91219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0840000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.133}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0209999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0569999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31284,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340556,"statfs":{"total":96636764160,"available":96604729344,"internally_reserved":0,"allocated":241664,"data_stored":88670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.296}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31284,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340556,"statfs":{"total":96636764160,"available":96604729344,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1779999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0089999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2569999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31280,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340560,"statfs":{"total":96636764160,"available":96604733440,"internally_reserved":0,"allocated":237568,"data_stored":88580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.165}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0549999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31864,"kb_used_data":816,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339976,"statfs":{"total":96636764160,"available":96604135424,"internally_reserved":0,"allocated":835584,"data_stored":679530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.313}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-10T18:52:53.797 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-06-10T18:52:53.798 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-06-10T18:52:53.798 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-06-10T18:52:53.798 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-06-10T18:52:53.799 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-06-10T18:52:53.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.944+0000 7f7e89d72640 1 Processor -- start 2023-06-10T18:52:53.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.944+0000 7f7e89d72640 1 -- start start 2023-06-10T18:52:53.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.944+0000 7f7e89d72640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7e8415eef0 0x7f7e84070f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:53.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.944+0000 7f7e89d72640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e8415f570 0x7f7e840ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:53.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.944+0000 7f7e89d72640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e8415f2c0 con 0x7f7e840ce990 2023-06-10T18:52:53.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.944+0000 7f7e89d72640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e8415fdc0 con 0x7f7e8415eef0 2023-06-10T18:52:53.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.944+0000 7f7e89d72640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e841600a0 con 0x7f7e8415f570 2023-06-10T18:52:53.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.944+0000 7f7e837fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7e8415eef0 0x7f7e84070f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:53.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.944+0000 7f7e837fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7e8415eef0 0x7f7e84070f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34940/0 (socket says 172.21.15.53:34940) 2023-06-10T18:52:53.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.944+0000 7f7e837fe640 1 -- 172.21.15.53:0/1325579940 learned_addr learned my addr 172.21.15.53:0/1325579940 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:53.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.944+0000 7f7e82ffd640 1 --2- 172.21.15.53:0/1325579940 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e8415f570 0x7f7e840ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:53.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.944+0000 7f7e837fe640 1 -- 172.21.15.53:0/1325579940 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e8415f570 msgr2=0x7f7e840ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:53.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.944+0000 7f7e837fe640 1 --2- 172.21.15.53:0/1325579940 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e8415f570 0x7f7e840ce450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:53.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.944+0000 7f7e837fe640 1 -- 172.21.15.53:0/1325579940 >> v1:172.21.15.117:6789/0 conn(0x7f7e840ce990 legacy=0x7f7e84069450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:53.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.944+0000 7f7e837fe640 1 -- 172.21.15.53:0/1325579940 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e84160380 con 0x7f7e8415eef0 2023-06-10T18:52:53.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.948+0000 7f7e837fe640 1 --2- 172.21.15.53:0/1325579940 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e8415eef0 0x7f7e84070f80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7e74009870 tx=0x7f7e7401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf62d9b2e7fc583f server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:53.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.948+0000 7f7e827fc640 1 -- 172.21.15.53:0/1325579940 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e740ab650 con 0x7f7e8415eef0 2023-06-10T18:52:53.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.948+0000 7f7e827fc640 1 -- 172.21.15.53:0/1325579940 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e740ab7b0 con 0x7f7e8415eef0 2023-06-10T18:52:53.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.948+0000 7f7e827fc640 1 -- 172.21.15.53:0/1325579940 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e740abb40 con 0x7f7e8415eef0 2023-06-10T18:52:53.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.948+0000 7f7e89d72640 1 -- 172.21.15.53:0/1325579940 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e8415eef0 msgr2=0x7f7e84070f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:53.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.948+0000 7f7e89d72640 1 --2- 172.21.15.53:0/1325579940 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e8415eef0 0x7f7e84070f80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7e74009870 tx=0x7f7e7401c540 comp rx=0 tx=0).stop 2023-06-10T18:52:53.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.948+0000 7f7e89d72640 1 -- 172.21.15.53:0/1325579940 shutdown_connections 2023-06-10T18:52:53.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.948+0000 7f7e89d72640 1 --2- 172.21.15.53:0/1325579940 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e8415f570 0x7f7e840ce450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:53.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.948+0000 7f7e89d72640 1 --2- 172.21.15.53:0/1325579940 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e8415eef0 0x7f7e84070f80 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:53.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.948+0000 7f7e89d72640 1 -- 172.21.15.53:0/1325579940 >> 172.21.15.53:0/1325579940 conn(0x7f7e8406a560 msgr2=0x7f7e8406a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:53.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.948+0000 7f7e89d72640 1 -- 172.21.15.53:0/1325579940 shutdown_connections 2023-06-10T18:52:53.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.948+0000 7f7e89d72640 1 -- 172.21.15.53:0/1325579940 wait complete. 2023-06-10T18:52:53.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.948+0000 7f7e89d72640 1 Processor -- start 2023-06-10T18:52:53.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.948+0000 7f7e89d72640 1 -- start start 2023-06-10T18:52:53.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.952+0000 7f7e89d72640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e840ce990 0x7f7e840c37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:53.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.952+0000 7f7e89d72640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e8415eef0 0x7f7e840c5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:53.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.952+0000 7f7e89d72640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e8415f570 0x7f7e840c7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:53.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.952+0000 7f7e89d72640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e840c56c0 con 0x7f7e8415f570 2023-06-10T18:52:53.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.952+0000 7f7e89d72640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e840c3e20 con 0x7f7e840ce990 2023-06-10T18:52:53.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.952+0000 7f7e89d72640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e840c4100 con 0x7f7e8415eef0 2023-06-10T18:52:53.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.952+0000 7f7e83fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e8415f570 0x7f7e840c7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:53.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.952+0000 7f7e83fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e8415f570 0x7f7e840c7e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34944/0 (socket says 172.21.15.53:34944) 2023-06-10T18:52:53.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.952+0000 7f7e83fff640 1 -- 172.21.15.53:0/1891817567 learned_addr learned my addr 172.21.15.53:0/1891817567 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:53.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.952+0000 7f7e837fe640 1 --2- 172.21.15.53:0/1891817567 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e840ce990 0x7f7e840c37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:53.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.952+0000 7f7e82ffd640 1 --2- 172.21.15.53:0/1891817567 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e8415eef0 0x7f7e840c5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:53.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.952+0000 7f7e83fff640 1 -- 172.21.15.53:0/1891817567 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e8415eef0 msgr2=0x7f7e840c5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:53.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.952+0000 7f7e83fff640 1 --2- 172.21.15.53:0/1891817567 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e8415eef0 0x7f7e840c5180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:53.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.952+0000 7f7e83fff640 1 -- 172.21.15.53:0/1891817567 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e840ce990 msgr2=0x7f7e840c37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:53.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.952+0000 7f7e83fff640 1 --2- 172.21.15.53:0/1891817567 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e840ce990 0x7f7e840c37f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:53.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.952+0000 7f7e83fff640 1 -- 172.21.15.53:0/1891817567 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e740094d0 con 0x7f7e8415f570 2023-06-10T18:52:53.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.952+0000 7f7e83fff640 1 --2- 172.21.15.53:0/1891817567 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e8415f570 0x7f7e840c7e60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c00c7a0 tx=0x7f7e7c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:53.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.952+0000 7f7e6bfff640 1 -- 172.21.15.53:0/1891817567 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e7c003b80 con 0x7f7e8415f570 2023-06-10T18:52:53.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.952+0000 7f7e6bfff640 1 -- 172.21.15.53:0/1891817567 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e7c003ce0 con 0x7f7e8415f570 2023-06-10T18:52:53.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.952+0000 7f7e89d72640 1 -- 172.21.15.53:0/1891817567 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e840c43e0 con 0x7f7e8415f570 2023-06-10T18:52:53.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.952+0000 7f7e6bfff640 1 -- 172.21.15.53:0/1891817567 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e7c00aa30 con 0x7f7e8415f570 2023-06-10T18:52:53.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.952+0000 7f7e89d72640 1 -- 172.21.15.53:0/1891817567 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e840c49a0 con 0x7f7e8415f570 2023-06-10T18:52:53.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.952+0000 7f7e89d72640 1 -- 172.21.15.53:0/1891817567 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e840c4b90 con 0x7f7e8415f570 2023-06-10T18:52:53.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.952+0000 7f7e6bfff640 1 -- 172.21.15.53:0/1891817567 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7e7c00ab90 con 0x7f7e8415f570 2023-06-10T18:52:53.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.952+0000 7f7e6bfff640 1 --2- 172.21.15.53:0/1891817567 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7e70066280 0x7f7e70068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:53.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.952+0000 7f7e6bfff640 1 -- 172.21.15.53:0/1891817567 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7e7c083b80 con 0x7f7e8415f570 2023-06-10T18:52:53.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.952+0000 7f7e837fe640 1 --2- 172.21.15.53:0/1891817567 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7e70066280 0x7f7e70068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:53.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.956+0000 7f7e837fe640 1 --2- 172.21.15.53:0/1891817567 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7e70066280 0x7f7e70068730 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7e740af000 tx=0x7f7e740a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:53.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:53.956+0000 7f7e6bfff640 1 -- 172.21.15.53:0/1891817567 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7e7c051000 con 0x7f7e8415f570 2023-06-10T18:52:54.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.140+0000 7f7e89d72640 1 -- 172.21.15.53:0/1891817567 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f7e8404d790 con 0x7f7e8415f570 2023-06-10T18:52:54.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.148+0000 7f7e6bfff640 1 -- 172.21.15.53:0/1891817567 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164248 (secure 0 0 0) 0x7f7e7c054620 con 0x7f7e8415f570 2023-06-10T18:52:54.158 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:52:54.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.148+0000 7f7e89d72640 1 -- 172.21.15.53:0/1891817567 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7e70066280 msgr2=0x7f7e70068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:54.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.148+0000 7f7e89d72640 1 --2- 172.21.15.53:0/1891817567 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7e70066280 0x7f7e70068730 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7e740af000 tx=0x7f7e740a7000 comp rx=0 tx=0).stop 2023-06-10T18:52:54.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.148+0000 7f7e89d72640 1 -- 172.21.15.53:0/1891817567 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e8415f570 msgr2=0x7f7e840c7e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:54.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.148+0000 7f7e89d72640 1 --2- 172.21.15.53:0/1891817567 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e8415f570 0x7f7e840c7e60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c00c7a0 tx=0x7f7e7c00cc60 comp rx=0 tx=0).stop 2023-06-10T18:52:54.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.148+0000 7f7e89d72640 1 -- 172.21.15.53:0/1891817567 shutdown_connections 2023-06-10T18:52:54.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.148+0000 7f7e89d72640 1 --2- 172.21.15.53:0/1891817567 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7e70066280 0x7f7e70068730 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:54.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.148+0000 7f7e89d72640 1 --2- 172.21.15.53:0/1891817567 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e8415f570 0x7f7e840c7e60 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:54.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.148+0000 7f7e89d72640 1 --2- 172.21.15.53:0/1891817567 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e8415eef0 0x7f7e840c5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:54.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.148+0000 7f7e89d72640 1 --2- 172.21.15.53:0/1891817567 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e840ce990 0x7f7e840c37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:54.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.148+0000 7f7e89d72640 1 -- 172.21.15.53:0/1891817567 >> 172.21.15.53:0/1891817567 conn(0x7f7e8406a560 msgr2=0x7f7e840cf750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:54.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.148+0000 7f7e89d72640 1 -- 172.21.15.53:0/1891817567 shutdown_connections 2023-06-10T18:52:54.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.148+0000 7f7e89d72640 1 -- 172.21.15.53:0/1891817567 wait complete. 2023-06-10T18:52:54.174 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":5,"active_gid":4105,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3061986771},{"type":"v1","addr":"172.21.15.117:6833","nonce":3061986771}]},"active_addr":"172.21.15.117:6833/3061986771","active_change":"2023-06-10T18:52:25.541950+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4110,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.117:0","nonce":894707313}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.117:0","nonce":4277194173}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.117:0","nonce":2172163736}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.117:0","nonce":4063446529}]}]} 2023-06-10T18:52:54.179 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-06-10T18:52:54.180 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-06-10T18:52:54.180 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T18:52:54.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.292+0000 7f3d6d3d2640 1 Processor -- start 2023-06-10T18:52:54.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.292+0000 7f3d6d3d2640 1 -- start start 2023-06-10T18:52:54.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.292+0000 7f3d6d3d2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d680c9840 0x7f3d680c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:54.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.292+0000 7f3d6d3d2640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3d6806b090 0x7f3d6806b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:54.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.292+0000 7f3d6d3d2640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d68159b50 con 0x7f3d68071060 2023-06-10T18:52:54.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.292+0000 7f3d6d3d2640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d680ca150 con 0x7f3d6806b090 2023-06-10T18:52:54.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.292+0000 7f3d6d3d2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d680702a0 con 0x7f3d680c9840 2023-06-10T18:52:54.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.292+0000 7f3d677fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3d6806b090 0x7f3d6806b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:54.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.292+0000 7f3d677fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3d6806b090 0x7f3d6806b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34952/0 (socket says 172.21.15.53:34952) 2023-06-10T18:52:54.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.292+0000 7f3d677fe640 1 -- 172.21.15.53:0/983928151 learned_addr learned my addr 172.21.15.53:0/983928151 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:54.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.292+0000 7f3d66ffd640 1 --2- 172.21.15.53:0/983928151 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d680c9840 0x7f3d680c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:54.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.292+0000 7f3d677fe640 1 -- 172.21.15.53:0/983928151 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d680c9840 msgr2=0x7f3d680c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:54.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.292+0000 7f3d677fe640 1 --2- 172.21.15.53:0/983928151 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d680c9840 0x7f3d680c9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:54.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.292+0000 7f3d677fe640 1 -- 172.21.15.53:0/983928151 >> v1:172.21.15.53:6789/0 conn(0x7f3d68071060 legacy=0x7f3d680af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:54.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.292+0000 7f3d677fe640 1 -- 172.21.15.53:0/983928151 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d68070580 con 0x7f3d6806b090 2023-06-10T18:52:54.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.292+0000 7f3d667fc640 1 -- 172.21.15.53:0/983928151 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3772339407 0 0) 0x7f3d68159b50 con 0x7f3d68071060 2023-06-10T18:52:54.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.296+0000 7f3d677fe640 1 --2- 172.21.15.53:0/983928151 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d6806b090 0x7f3d6806b530 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3d60009e50 tx=0x7f3d6001c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3610fecd534d8aa9 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:54.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.296+0000 7f3d667fc640 1 -- 172.21.15.53:0/983928151 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d600a58a0 con 0x7f3d6806b090 2023-06-10T18:52:54.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.296+0000 7f3d667fc640 1 -- 172.21.15.53:0/983928151 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d600a5a00 con 0x7f3d6806b090 2023-06-10T18:52:54.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.296+0000 7f3d667fc640 1 -- 172.21.15.53:0/983928151 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d600a5d90 con 0x7f3d6806b090 2023-06-10T18:52:54.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.296+0000 7f3d6d3d2640 1 -- 172.21.15.53:0/983928151 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d6806b090 msgr2=0x7f3d6806b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:54.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.296+0000 7f3d6d3d2640 1 --2- 172.21.15.53:0/983928151 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d6806b090 0x7f3d6806b530 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3d60009e50 tx=0x7f3d6001c9e0 comp rx=0 tx=0).stop 2023-06-10T18:52:54.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.296+0000 7f3d6d3d2640 1 -- 172.21.15.53:0/983928151 shutdown_connections 2023-06-10T18:52:54.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.296+0000 7f3d6d3d2640 1 --2- 172.21.15.53:0/983928151 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d6806b090 0x7f3d6806b530 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:54.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.296+0000 7f3d6d3d2640 1 --2- 172.21.15.53:0/983928151 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d680c9840 0x7f3d680c9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:54.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.296+0000 7f3d6d3d2640 1 -- 172.21.15.53:0/983928151 >> 172.21.15.53:0/983928151 conn(0x7f3d6806a0d0 msgr2=0x7f3d680ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:54.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.296+0000 7f3d6d3d2640 1 -- 172.21.15.53:0/983928151 shutdown_connections 2023-06-10T18:52:54.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.296+0000 7f3d6d3d2640 1 -- 172.21.15.53:0/983928151 wait complete. 2023-06-10T18:52:54.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.296+0000 7f3d6d3d2640 1 Processor -- start 2023-06-10T18:52:54.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.296+0000 7f3d6d3d2640 1 -- start start 2023-06-10T18:52:54.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.296+0000 7f3d6d3d2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d6806b090 0x7f3d680b0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:54.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.296+0000 7f3d6d3d2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d68071060 0x7f3d6814ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:54.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.296+0000 7f3d6d3d2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d680c9840 0x7f3d68162800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:54.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.296+0000 7f3d6d3d2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d680cc790 con 0x7f3d680c9840 2023-06-10T18:52:54.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.296+0000 7f3d6d3d2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d680b1010 con 0x7f3d68071060 2023-06-10T18:52:54.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.296+0000 7f3d6d3d2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d680cbc10 con 0x7f3d6806b090 2023-06-10T18:52:54.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.296+0000 7f3d677fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d680c9840 0x7f3d68162800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:54.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.296+0000 7f3d677fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d680c9840 0x7f3d68162800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34960/0 (socket says 172.21.15.53:34960) 2023-06-10T18:52:54.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.296+0000 7f3d677fe640 1 -- 172.21.15.53:0/2189330322 learned_addr learned my addr 172.21.15.53:0/2189330322 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:54.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.296+0000 7f3d66ffd640 1 --2- 172.21.15.53:0/2189330322 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d6806b090 0x7f3d680b0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:54.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.296+0000 7f3d5ffff640 1 --2- 172.21.15.53:0/2189330322 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d68071060 0x7f3d6814ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:54.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.296+0000 7f3d677fe640 1 -- 172.21.15.53:0/2189330322 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d6806b090 msgr2=0x7f3d680b0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:54.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.296+0000 7f3d677fe640 1 --2- 172.21.15.53:0/2189330322 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d6806b090 0x7f3d680b0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:54.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.296+0000 7f3d677fe640 1 -- 172.21.15.53:0/2189330322 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d68071060 msgr2=0x7f3d6814ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:54.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.296+0000 7f3d677fe640 1 --2- 172.21.15.53:0/2189330322 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d68071060 0x7f3d6814ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:54.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.296+0000 7f3d677fe640 1 -- 172.21.15.53:0/2189330322 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d60009b30 con 0x7f3d680c9840 2023-06-10T18:52:54.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.296+0000 7f3d5ffff640 1 --2- 172.21.15.53:0/2189330322 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d68071060 0x7f3d6814ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:52:54.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.296+0000 7f3d677fe640 1 --2- 172.21.15.53:0/2189330322 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d680c9840 0x7f3d68162800 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3d600af040 tx=0x7f3d60019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:54.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.300+0000 7f3d5f7fe640 1 -- 172.21.15.53:0/2189330322 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d60009210 con 0x7f3d680c9840 2023-06-10T18:52:54.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.300+0000 7f3d5f7fe640 1 -- 172.21.15.53:0/2189330322 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d600b8680 con 0x7f3d680c9840 2023-06-10T18:52:54.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.300+0000 7f3d5f7fe640 1 -- 172.21.15.53:0/2189330322 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d600b89f0 con 0x7f3d680c9840 2023-06-10T18:52:54.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.300+0000 7f3d6d3d2640 1 -- 172.21.15.53:0/2189330322 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d680cbef0 con 0x7f3d680c9840 2023-06-10T18:52:54.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.300+0000 7f3d6d3d2640 1 -- 172.21.15.53:0/2189330322 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d680cc4b0 con 0x7f3d680c9840 2023-06-10T18:52:54.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.300+0000 7f3d6d3d2640 1 -- 172.21.15.53:0/2189330322 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d6804d790 con 0x7f3d680c9840 2023-06-10T18:52:54.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.300+0000 7f3d5f7fe640 1 -- 172.21.15.53:0/2189330322 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3d600b8b50 con 0x7f3d680c9840 2023-06-10T18:52:54.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.300+0000 7f3d5f7fe640 1 --2- 172.21.15.53:0/2189330322 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3d48066280 0x7f3d48068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:54.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.300+0000 7f3d5f7fe640 1 -- 172.21.15.53:0/2189330322 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3d6011ed70 con 0x7f3d680c9840 2023-06-10T18:52:54.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.300+0000 7f3d66ffd640 1 --2- 172.21.15.53:0/2189330322 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3d48066280 0x7f3d48068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:54.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.300+0000 7f3d66ffd640 1 --2- 172.21.15.53:0/2189330322 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3d48066280 0x7f3d48068730 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3d5800b930 tx=0x7f3d58008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:54.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.304+0000 7f3d5f7fe640 1 -- 172.21.15.53:0/2189330322 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3d600ec3a0 con 0x7f3d680c9840 2023-06-10T18:52:54.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.460+0000 7f3d6d3d2640 1 -- 172.21.15.53:0/2189330322 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3d68164330 con 0x7f3d680c9840 2023-06-10T18:52:54.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.460+0000 7f3d5f7fe640 1 -- 172.21.15.53:0/2189330322 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18267 (secure 0 0 0) 0x7f3d600ef9c0 con 0x7f3d680c9840 2023-06-10T18:52:54.471 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:52:54.472 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":23,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T18:52:45.921586+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-10T18:52:43.396243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-10T18:52:43.894228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T18:52:54.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.464+0000 7f3d6d3d2640 1 -- 172.21.15.53:0/2189330322 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3d48066280 msgr2=0x7f3d48068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:54.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.464+0000 7f3d6d3d2640 1 --2- 172.21.15.53:0/2189330322 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3d48066280 0x7f3d48068730 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3d5800b930 tx=0x7f3d58008040 comp rx=0 tx=0).stop 2023-06-10T18:52:54.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.464+0000 7f3d6d3d2640 1 -- 172.21.15.53:0/2189330322 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d680c9840 msgr2=0x7f3d68162800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:54.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.464+0000 7f3d6d3d2640 1 --2- 172.21.15.53:0/2189330322 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d680c9840 0x7f3d68162800 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3d600af040 tx=0x7f3d60019780 comp rx=0 tx=0).stop 2023-06-10T18:52:54.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.464+0000 7f3d6d3d2640 1 -- 172.21.15.53:0/2189330322 shutdown_connections 2023-06-10T18:52:54.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.464+0000 7f3d6d3d2640 1 --2- 172.21.15.53:0/2189330322 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3d48066280 0x7f3d48068730 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:54.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.464+0000 7f3d6d3d2640 1 --2- 172.21.15.53:0/2189330322 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d680c9840 0x7f3d68162800 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:54.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.464+0000 7f3d6d3d2640 1 --2- 172.21.15.53:0/2189330322 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d68071060 0x7f3d6814ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:54.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.464+0000 7f3d6d3d2640 1 --2- 172.21.15.53:0/2189330322 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d6806b090 0x7f3d680b0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:54.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.464+0000 7f3d6d3d2640 1 -- 172.21.15.53:0/2189330322 >> 172.21.15.53:0/2189330322 conn(0x7f3d6806a0d0 msgr2=0x7f3d680c8b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:54.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.464+0000 7f3d6d3d2640 1 -- 172.21.15.53:0/2189330322 shutdown_connections 2023-06-10T18:52:54.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.464+0000 7f3d6d3d2640 1 -- 172.21.15.53:0/2189330322 wait complete. 2023-06-10T18:52:54.491 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-06-10T18:52:54.491 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T18:52:54.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.596+0000 7fd720c36640 1 Processor -- start 2023-06-10T18:52:54.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.596+0000 7fd720c36640 1 -- start start 2023-06-10T18:52:54.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.600+0000 7fd720c36640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd71c0cc690 0x7fd71c0d04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:54.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.600+0000 7fd720c36640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd71c0d0020 con 0x7fd71c0ccae0 2023-06-10T18:52:54.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.600+0000 7fd720c36640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd71c0cef40 con 0x7fd71c0b3ac0 2023-06-10T18:52:54.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.600+0000 7fd720c36640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd71c0cf220 con 0x7fd71c0cc690 2023-06-10T18:52:54.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.600+0000 7fd71ad9d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fd71c0ccae0 0x7fd71c0d09f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:35932/0 (socket says 172.21.15.53:35932) 2023-06-10T18:52:54.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.600+0000 7fd71ad9d640 1 -- 172.21.15.53:0/1359330712 learned_addr learned my addr 172.21.15.53:0/1359330712 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:52:54.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.600+0000 7fd719d9b640 1 --2- 172.21.15.53:0/1359330712 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd71c0cc690 0x7fd71c0d04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:54.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.600+0000 7fd71959a640 1 -- 172.21.15.53:0/1359330712 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4129551588 0 0) 0x7fd71c0d0020 con 0x7fd71c0ccae0 2023-06-10T18:52:54.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.600+0000 7fd71959a640 1 -- 172.21.15.53:0/1359330712 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd704003530 con 0x7fd71c0ccae0 2023-06-10T18:52:54.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.600+0000 7fd71959a640 1 -- 172.21.15.53:0/1359330712 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2616945820 0 0) 0x7fd704003530 con 0x7fd71c0ccae0 2023-06-10T18:52:54.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.600+0000 7fd71959a640 1 -- 172.21.15.53:0/1359330712 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd71c0cc690 msgr2=0x7fd71c0d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:54.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.600+0000 7fd71959a640 1 --2- 172.21.15.53:0/1359330712 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd71c0cc690 0x7fd71c0d04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:54.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.600+0000 7fd71959a640 1 -- 172.21.15.53:0/1359330712 >> v1:172.21.15.117:6789/0 conn(0x7fd71c0b3ac0 legacy=0x7fd71c0b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:54.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.600+0000 7fd71959a640 1 -- 172.21.15.53:0/1359330712 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd71c0cf500 con 0x7fd71c0ccae0 2023-06-10T18:52:54.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.600+0000 7fd71959a640 1 -- 172.21.15.53:0/1359330712 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fd714001a00 con 0x7fd71c0ccae0 2023-06-10T18:52:54.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.600+0000 7fd71959a640 1 -- 172.21.15.53:0/1359330712 >> v1:172.21.15.53:6789/0 conn(0x7fd71c0ccae0 legacy=0x7fd71c0d09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:54.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.600+0000 7fd71959a640 1 --2- 172.21.15.53:0/1359330712 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd704003a20 0x7fd704003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:54.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.600+0000 7fd71959a640 1 --2- 172.21.15.53:0/1359330712 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd71c0cc690 0x7fd7040047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:54.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.600+0000 7fd71959a640 1 --2- 172.21.15.53:0/1359330712 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd704004d10 0x7fd704005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:54.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.600+0000 7fd71959a640 1 -- 172.21.15.53:0/1359330712 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd71c0cf220 con 0x7fd704004d10 2023-06-10T18:52:54.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.600+0000 7fd71959a640 1 -- 172.21.15.53:0/1359330712 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd70400ba70 con 0x7fd704003a20 2023-06-10T18:52:54.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.600+0000 7fd71959a640 1 -- 172.21.15.53:0/1359330712 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd70400bc30 con 0x7fd71c0cc690 2023-06-10T18:52:54.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.600+0000 7fd71ad9d640 1 --2- 172.21.15.53:0/1359330712 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd704004d10 0x7fd704005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:54.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.600+0000 7fd71a59c640 1 --2- 172.21.15.53:0/1359330712 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd704003a20 0x7fd704003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:54.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.600+0000 7fd719d9b640 1 --2- 172.21.15.53:0/1359330712 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd71c0cc690 0x7fd7040047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:54.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.600+0000 7fd71ad9d640 1 -- 172.21.15.53:0/1359330712 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd71c0cc690 msgr2=0x7fd7040047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:54.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.600+0000 7fd71ad9d640 1 --2- 172.21.15.53:0/1359330712 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd71c0cc690 0x7fd7040047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:54.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.600+0000 7fd71ad9d640 1 -- 172.21.15.53:0/1359330712 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd704003a20 msgr2=0x7fd704003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:54.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.600+0000 7fd71ad9d640 1 --2- 172.21.15.53:0/1359330712 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd704003a20 0x7fd704003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:54.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.600+0000 7fd71ad9d640 1 -- 172.21.15.53:0/1359330712 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd704003530 con 0x7fd704004d10 2023-06-10T18:52:54.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.600+0000 7fd719d9b640 1 --2- 172.21.15.53:0/1359330712 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd71c0cc690 0x7fd7040047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:52:54.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.604+0000 7fd71ad9d640 1 --2- 172.21.15.53:0/1359330712 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd704004d10 0x7fd704005180 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd71400a830 tx=0x7fd71401d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebc4d338defefd74 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:54.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.604+0000 7fd71959a640 1 -- 172.21.15.53:0/1359330712 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7140072d0 con 0x7fd704004d10 2023-06-10T18:52:54.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.604+0000 7fd71959a640 1 -- 172.21.15.53:0/1359330712 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7140a8070 con 0x7fd704004d10 2023-06-10T18:52:54.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.604+0000 7fd71959a640 1 -- 172.21.15.53:0/1359330712 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7140076b0 con 0x7fd704004d10 2023-06-10T18:52:54.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.604+0000 7fd720c36640 1 -- 172.21.15.53:0/1359330712 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd704004d10 msgr2=0x7fd704005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:54.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.604+0000 7fd720c36640 1 --2- 172.21.15.53:0/1359330712 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd704004d10 0x7fd704005180 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd71400a830 tx=0x7fd71401d340 comp rx=0 tx=0).stop 2023-06-10T18:52:54.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.604+0000 7fd71ad9d640 1 -- 172.21.15.53:0/1359330712 reap_dead start 2023-06-10T18:52:54.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.604+0000 7fd720c36640 1 -- 172.21.15.53:0/1359330712 shutdown_connections 2023-06-10T18:52:54.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.604+0000 7fd720c36640 1 -- 172.21.15.53:0/1359330712 >> 172.21.15.53:0/1359330712 conn(0x7fd71c071790 msgr2=0x7fd71c069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:54.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.604+0000 7fd720c36640 1 -- 172.21.15.53:0/1359330712 shutdown_connections 2023-06-10T18:52:54.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.604+0000 7fd720c36640 1 -- 172.21.15.53:0/1359330712 wait complete. 2023-06-10T18:52:54.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.604+0000 7fd720c36640 1 Processor -- start 2023-06-10T18:52:54.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.604+0000 7fd720c36640 1 -- start start 2023-06-10T18:52:54.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.608+0000 7fd720c36640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd71c15ab80 0x7fd71c152690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:54.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.608+0000 7fd720c36640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd71c0cba40 0x7fd71c15f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:54.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.608+0000 7fd720c36640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd71c15f880 0x7fd71c1f4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:54.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.608+0000 7fd720c36640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd71c15fcf0 con 0x7fd71c15f880 2023-06-10T18:52:54.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.608+0000 7fd720c36640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd71c1f2140 con 0x7fd71c15ab80 2023-06-10T18:52:54.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.608+0000 7fd720c36640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd71c1f15c0 con 0x7fd71c0cba40 2023-06-10T18:52:54.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.608+0000 7fd71ad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd71c15f880 0x7fd71c1f4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:54.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.608+0000 7fd71ad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd71c15f880 0x7fd71c1f4b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34976/0 (socket says 172.21.15.53:34976) 2023-06-10T18:52:54.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.608+0000 7fd71ad9d640 1 -- 172.21.15.53:0/164780688 learned_addr learned my addr 172.21.15.53:0/164780688 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:54.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.608+0000 7fd719d9b640 1 --2- 172.21.15.53:0/164780688 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd71c0cba40 0x7fd71c15f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:54.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.608+0000 7fd71a59c640 1 --2- 172.21.15.53:0/164780688 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd71c15ab80 0x7fd71c152690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:54.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.608+0000 7fd71ad9d640 1 -- 172.21.15.53:0/164780688 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd71c0cba40 msgr2=0x7fd71c15f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:54.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.608+0000 7fd71ad9d640 1 --2- 172.21.15.53:0/164780688 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd71c0cba40 0x7fd71c15f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:54.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.608+0000 7fd71ad9d640 1 -- 172.21.15.53:0/164780688 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd71c15ab80 msgr2=0x7fd71c152690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:54.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.608+0000 7fd71ad9d640 1 --2- 172.21.15.53:0/164780688 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd71c15ab80 0x7fd71c152690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:54.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.608+0000 7fd71ad9d640 1 -- 172.21.15.53:0/164780688 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd71c1f18a0 con 0x7fd71c15f880 2023-06-10T18:52:54.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.608+0000 7fd71a59c640 1 --2- 172.21.15.53:0/164780688 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd71c15ab80 0x7fd71c152690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:52:54.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.608+0000 7fd71ad9d640 1 --2- 172.21.15.53:0/164780688 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd71c15f880 0x7fd71c1f4b40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd71401cdb0 tx=0x7fd704005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:54.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.608+0000 7fd70affd640 1 -- 172.21.15.53:0/164780688 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7140ba070 con 0x7fd71c15f880 2023-06-10T18:52:54.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.608+0000 7fd70affd640 1 -- 172.21.15.53:0/164780688 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7140011d0 con 0x7fd71c15f880 2023-06-10T18:52:54.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.608+0000 7fd720c36640 1 -- 172.21.15.53:0/164780688 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd71c1f1b80 con 0x7fd71c15f880 2023-06-10T18:52:54.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.608+0000 7fd70affd640 1 -- 172.21.15.53:0/164780688 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7140019c0 con 0x7fd71c15f880 2023-06-10T18:52:54.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.608+0000 7fd720c36640 1 -- 172.21.15.53:0/164780688 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd71c152bd0 con 0x7fd71c15f880 2023-06-10T18:52:54.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.608+0000 7fd720c36640 1 -- 172.21.15.53:0/164780688 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd71c1f4860 con 0x7fd71c15f880 2023-06-10T18:52:54.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.608+0000 7fd70affd640 1 -- 172.21.15.53:0/164780688 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd7140aa030 con 0x7fd71c15f880 2023-06-10T18:52:54.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.608+0000 7fd70affd640 1 --2- 172.21.15.53:0/164780688 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd6fc0662b0 0x7fd6fc068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:54.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.608+0000 7fd70affd640 1 -- 172.21.15.53:0/164780688 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd71411d4b0 con 0x7fd71c15f880 2023-06-10T18:52:54.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.608+0000 7fd71a59c640 1 --2- 172.21.15.53:0/164780688 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd6fc0662b0 0x7fd6fc068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:54.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.612+0000 7fd71a59c640 1 --2- 172.21.15.53:0/164780688 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd6fc0662b0 0x7fd6fc068760 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd71c0b6bd0 tx=0x7fd70c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:54.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.612+0000 7fd70affd640 1 -- 172.21.15.53:0/164780688 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd71c1f4860 con 0x7fd71c15f880 2023-06-10T18:52:54.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.760+0000 7fd720c36640 1 -- 172.21.15.53:0/164780688 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd71c1f4860 con 0x7fd71c15f880 2023-06-10T18:52:54.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.764+0000 7fd70affd640 1 -- 172.21.15.53:0/164780688 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18267 (secure 0 0 0) 0x7fd71c1f4860 con 0x7fd71c15f880 2023-06-10T18:52:54.775 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:52:54.775 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":23,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T18:52:45.921586+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-10T18:52:43.396243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-10T18:52:43.894228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T18:52:54.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.768+0000 7fd720c36640 1 -- 172.21.15.53:0/164780688 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd6fc0662b0 msgr2=0x7fd6fc068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:54.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.768+0000 7fd720c36640 1 --2- 172.21.15.53:0/164780688 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd6fc0662b0 0x7fd6fc068760 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd71c0b6bd0 tx=0x7fd70c009040 comp rx=0 tx=0).stop 2023-06-10T18:52:54.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.768+0000 7fd720c36640 1 -- 172.21.15.53:0/164780688 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd71c15f880 msgr2=0x7fd71c1f4b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:54.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.768+0000 7fd720c36640 1 --2- 172.21.15.53:0/164780688 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd71c15f880 0x7fd71c1f4b40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd71401cdb0 tx=0x7fd704005800 comp rx=0 tx=0).stop 2023-06-10T18:52:54.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.768+0000 7fd720c36640 1 -- 172.21.15.53:0/164780688 shutdown_connections 2023-06-10T18:52:54.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.768+0000 7fd720c36640 1 --2- 172.21.15.53:0/164780688 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd6fc0662b0 0x7fd6fc068760 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:54.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.768+0000 7fd720c36640 1 --2- 172.21.15.53:0/164780688 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd71c15f880 0x7fd71c1f4b40 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:54.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.768+0000 7fd720c36640 1 --2- 172.21.15.53:0/164780688 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd71c0cba40 0x7fd71c15f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:54.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.768+0000 7fd720c36640 1 --2- 172.21.15.53:0/164780688 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd71c15ab80 0x7fd71c152690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:54.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.768+0000 7fd720c36640 1 -- 172.21.15.53:0/164780688 >> 172.21.15.53:0/164780688 conn(0x7fd71c071790 msgr2=0x7fd71c0b5640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:54.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.768+0000 7fd720c36640 1 -- 172.21.15.53:0/164780688 shutdown_connections 2023-06-10T18:52:54.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.768+0000 7fd720c36640 1 -- 172.21.15.53:0/164780688 wait complete. 2023-06-10T18:52:54.792 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-06-10T18:52:54.793 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-06-10T18:52:54.794 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-06-10T18:52:54.794 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-06-10T18:52:54.794 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-06-10T18:52:54.795 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-06-10T18:52:54.795 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-06-10T18:52:54.796 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-06-10T18:52:54.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.964+0000 7fd940b10640 1 Processor -- start 2023-06-10T18:52:54.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.964+0000 7fd940b10640 1 -- start start 2023-06-10T18:52:54.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.964+0000 7f28d08ab640 1 Processor -- start 2023-06-10T18:52:54.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.964+0000 7fd940b10640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd93c0afd30 0x7fd93c0cb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:54.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.964+0000 7fd940b10640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd93c0c9660 con 0x7fd93c0cd650 2023-06-10T18:52:54.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.964+0000 7fd940b10640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd93c0cc0a0 con 0x7fd93c0cbc00 2023-06-10T18:52:54.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.964+0000 7fd940b10640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd93c0cc380 con 0x7fd93c0afd30 2023-06-10T18:52:54.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.964+0000 7f28d08ab640 1 -- start start 2023-06-10T18:52:54.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.964+0000 7fd93a59c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd93c0afd30 0x7fd93c0cb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:54.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.964+0000 7fd93a59c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd93c0afd30 0x7fd93c0cb6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34978/0 (socket says 172.21.15.53:34978) 2023-06-10T18:52:54.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.964+0000 7fd93a59c640 1 -- 172.21.15.53:0/1369780456 learned_addr learned my addr 172.21.15.53:0/1369780456 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:54.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.964+0000 7f28d08ab640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28cc0c0cf0 0x7f28cc0c1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:54.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.964+0000 7f28d08ab640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f28cc0ca380 0x7f28cc0ca800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:54.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.964+0000 7f28d08ab640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28cc0c1680 con 0x7f28cc0cd9d0 2023-06-10T18:52:54.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.964+0000 7f28d08ab640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28cc164630 con 0x7f28cc0ca380 2023-06-10T18:52:54.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.964+0000 7f28d08ab640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28cc15ff70 con 0x7f28cc0c0cf0 2023-06-10T18:52:54.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.964+0000 7f28cad9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f28cc0ca380 0x7f28cc0ca800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:54.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.964+0000 7f28cad9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f28cc0ca380 0x7f28cc0ca800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34992/0 (socket says 172.21.15.53:34992) 2023-06-10T18:52:54.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.964+0000 7f28cad9d640 1 -- 172.21.15.53:0/3478232628 learned_addr learned my addr 172.21.15.53:0/3478232628 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:54.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.964+0000 7f434359e640 1 Processor -- start 2023-06-10T18:52:54.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.964+0000 7f28cad9d640 1 -- 172.21.15.53:0/3478232628 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28cc0c0cf0 msgr2=0x7f28cc0c1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:54.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.964+0000 7f28cad9d640 1 --2- 172.21.15.53:0/3478232628 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28cc0c0cf0 0x7f28cc0c1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:54.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.964+0000 7f28cad9d640 1 -- 172.21.15.53:0/3478232628 >> v1:172.21.15.53:6789/0 conn(0x7f28cc0cd9d0 legacy=0x7f28cc163620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:54.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.964+0000 7f28cad9d640 1 -- 172.21.15.53:0/3478232628 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28cc0c98e0 con 0x7f28cc0ca380 2023-06-10T18:52:54.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.964+0000 7fd93a59c640 1 -- 172.21.15.53:0/1369780456 >> v1:172.21.15.117:6789/0 conn(0x7fd93c0cbc00 legacy=0x7fd93c0ccf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:54.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.964+0000 7fd93a59c640 1 -- 172.21.15.53:0/1369780456 >> v1:172.21.15.53:6789/0 conn(0x7fd93c0cd650 legacy=0x7fd93c0c9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:54.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.964+0000 7fd93a59c640 1 -- 172.21.15.53:0/1369780456 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd93c0cc660 con 0x7fd93c0afd30 2023-06-10T18:52:54.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.964+0000 7f434359e640 1 -- start start 2023-06-10T18:52:54.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.968+0000 7f434359e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f43440698b0 0x7f4344070630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:54.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.968+0000 7f434359e640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43440cd870 con 0x7f4344069450 2023-06-10T18:52:54.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.968+0000 7f434359e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43440cdb50 con 0x7f434406d3e0 2023-06-10T18:52:54.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.968+0000 7f434359e640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43440ce4f0 con 0x7f43440698b0 2023-06-10T18:52:54.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.968+0000 7f0894b53640 1 Processor -- start 2023-06-10T18:52:54.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.968+0000 7f4341d9b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f4344069450 0x7f434406ff20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:35972/0 (socket says 172.21.15.53:35972) 2023-06-10T18:52:54.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.968+0000 7f4341d9b640 1 -- 172.21.15.53:0/182379566 learned_addr learned my addr 172.21.15.53:0/182379566 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:52:54.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.968+0000 7fc17828a640 1 Processor -- start 2023-06-10T18:52:54.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.968+0000 7ff21d4af640 1 Processor -- start 2023-06-10T18:52:54.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.968+0000 7f0894b53640 1 -- start start 2023-06-10T18:52:54.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.968+0000 7ff21d4af640 1 -- start start 2023-06-10T18:52:54.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.968+0000 7f434159a640 1 -- 172.21.15.53:0/182379566 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 26528796 0 0) 0x7f43440cd870 con 0x7f4344069450 2023-06-10T18:52:54.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.968+0000 7f434159a640 1 -- 172.21.15.53:0/182379566 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f432c003530 con 0x7f4344069450 2023-06-10T18:52:54.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.968+0000 7fc17828a640 1 -- start start 2023-06-10T18:52:54.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.968+0000 7f28cad9d640 1 --2- 172.21.15.53:0/3478232628 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28cc0ca380 0x7f28cc0ca800 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f28c0009870 tx=0x7f28c001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b4d9e153c56277 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:54.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.968+0000 7f0894b53640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f08900afee0 0x7f089016ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:54.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.968+0000 7f0894b53640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f089006a8b0 con 0x7f0890160020 2023-06-10T18:52:54.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.968+0000 7f0894b53640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f089006ab00 con 0x7f089015fc50 2023-06-10T18:52:54.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.968+0000 7f0894b53640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f089006ade0 con 0x7f08900afee0 2023-06-10T18:52:54.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.968+0000 7f088dd9b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f0890160020 0x7f08900cd010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:35974/0 (socket says 172.21.15.53:35974) 2023-06-10T18:52:54.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.968+0000 7f088dd9b640 1 -- 172.21.15.53:0/2477756111 learned_addr learned my addr 172.21.15.53:0/2477756111 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:52:54.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.968+0000 7f088ed9d640 1 --2- 172.21.15.53:0/2477756111 >> v2:172.21.15.53:3300/0 conn(0x7f08900afee0 0x7f089016ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:54.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.968+0000 7f434159a640 1 -- 172.21.15.53:0/182379566 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4031147850 0 0) 0x7f432c003530 con 0x7f4344069450 2023-06-10T18:52:54.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.968+0000 7f4342d9d640 1 --2- 172.21.15.53:0/182379566 >> v2:172.21.15.53:3300/0 conn(0x7f43440698b0 0x7f4344070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:54.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.968+0000 7f434159a640 1 -- 172.21.15.53:0/182379566 >> v2:172.21.15.53:3300/0 conn(0x7f43440698b0 msgr2=0x7f4344070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:54.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.968+0000 7f434159a640 1 --2- 172.21.15.53:0/182379566 >> v2:172.21.15.53:3300/0 conn(0x7f43440698b0 0x7f4344070630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:54.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.968+0000 7f434159a640 1 -- 172.21.15.53:0/182379566 >> v1:172.21.15.117:6789/0 conn(0x7f434406d3e0 legacy=0x7f4344160640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:54.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.968+0000 7f434159a640 1 -- 172.21.15.53:0/182379566 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43440cde30 con 0x7f4344069450 2023-06-10T18:52:54.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.968+0000 7f434159a640 1 -- 172.21.15.53:0/182379566 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f433c001a00 con 0x7f4344069450 2023-06-10T18:52:54.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.968+0000 7f434159a640 1 -- 172.21.15.53:0/182379566 >> v1:172.21.15.53:6789/0 conn(0x7f4344069450 legacy=0x7f434406ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:54.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.968+0000 7f434159a640 1 --2- 172.21.15.53:0/182379566 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f432c003980 0x7f432c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:54.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.968+0000 7f434159a640 1 --2- 172.21.15.53:0/182379566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f432c0047d0 0x7f432c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:54.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.968+0000 7f434159a640 1 --2- 172.21.15.53:0/182379566 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f432c005380 0x7f432c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:54.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.968+0000 7f434159a640 1 -- 172.21.15.53:0/182379566 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43440ce4f0 con 0x7f432c0047d0 2023-06-10T18:52:54.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.968+0000 7f434159a640 1 -- 172.21.15.53:0/182379566 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f432c00c270 con 0x7f432c003980 2023-06-10T18:52:54.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.968+0000 7f434159a640 1 -- 172.21.15.53:0/182379566 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f432c00c430 con 0x7f432c005380 2023-06-10T18:52:54.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.968+0000 7f4342d9d640 1 --2- 172.21.15.53:0/182379566 >> v2:172.21.15.53:3300/0 conn(0x7f43440698b0 0x7f4344070630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:52:54.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.968+0000 7f088ed9d640 1 -- 172.21.15.53:0/2477756111 >> v1:172.21.15.117:6789/0 conn(0x7f089015fc50 legacy=0x7f08900af7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:54.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.968+0000 7f088ed9d640 1 -- 172.21.15.53:0/2477756111 >> v1:172.21.15.53:6789/0 conn(0x7f0890160020 legacy=0x7f08900cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:54.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.968+0000 7f088ed9d640 1 -- 172.21.15.53:0/2477756111 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f089006b0c0 con 0x7f08900afee0 2023-06-10T18:52:54.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.968+0000 7f4341d9b640 1 --2- 172.21.15.53:0/182379566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f432c0047d0 0x7f432c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:54.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.968+0000 7f434259c640 1 --2- 172.21.15.53:0/182379566 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f432c003980 0x7f432c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:54.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.968+0000 7f4342d9d640 1 --2- 172.21.15.53:0/182379566 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f432c005380 0x7f432c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:54.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.968+0000 7f4341d9b640 1 -- 172.21.15.53:0/182379566 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f432c005380 msgr2=0x7f432c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:54.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.968+0000 7f4341d9b640 1 --2- 172.21.15.53:0/182379566 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f432c005380 0x7f432c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:54.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.968+0000 7f4341d9b640 1 -- 172.21.15.53:0/182379566 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f432c003980 msgr2=0x7f432c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:54.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.968+0000 7f4341d9b640 1 --2- 172.21.15.53:0/182379566 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f432c003980 0x7f432c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:54.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.968+0000 7f4341d9b640 1 -- 172.21.15.53:0/182379566 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43440cde30 con 0x7f432c0047d0 2023-06-10T18:52:54.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.968+0000 7f4342d9d640 1 -- 172.21.15.53:0/182379566 reap_dead start 2023-06-10T18:52:54.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.968+0000 7fc17828a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc168037f00 0x7fc168039570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:54.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.968+0000 7fc17828a640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc168007080 con 0x7fc168037aa0 2023-06-10T18:52:54.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.968+0000 7fc17828a640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc168034340 con 0x7fc168033f70 2023-06-10T18:52:54.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.968+0000 7fc17828a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc168054840 con 0x7fc168037f00 2023-06-10T18:52:54.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.968+0000 7fc175825640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fc168037aa0 0x7fc1680366d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:35978/0 (socket says 172.21.15.53:35978) 2023-06-10T18:52:54.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.968+0000 7fc175825640 1 -- 172.21.15.53:0/335229777 learned_addr learned my addr 172.21.15.53:0/335229777 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:52:54.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.968+0000 7fc176827640 1 --2- 172.21.15.53:0/335229777 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc168037f00 0x7fc168039570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:54.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.968+0000 7f28c959a640 1 -- 172.21.15.53:0/3478232628 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c00aa5f0 con 0x7f28cc0ca380 2023-06-10T18:52:54.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.968+0000 7f28c959a640 1 -- 172.21.15.53:0/3478232628 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28c00aa750 con 0x7f28cc0ca380 2023-06-10T18:52:54.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.968+0000 7f28c959a640 1 -- 172.21.15.53:0/3478232628 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c00aaae0 con 0x7f28cc0ca380 2023-06-10T18:52:54.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.972+0000 7f28d08ab640 1 -- 172.21.15.53:0/3478232628 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28cc0ca380 msgr2=0x7f28cc0ca800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:54.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.972+0000 7f28d08ab640 1 --2- 172.21.15.53:0/3478232628 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28cc0ca380 0x7f28cc0ca800 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f28c0009870 tx=0x7f28c001c4d0 comp rx=0 tx=0).stop 2023-06-10T18:52:54.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.972+0000 7f28d08ab640 1 -- 172.21.15.53:0/3478232628 shutdown_connections 2023-06-10T18:52:54.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.972+0000 7f28d08ab640 1 --2- 172.21.15.53:0/3478232628 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28cc0ca380 0x7f28cc0ca800 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:54.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.972+0000 7f28d08ab640 1 --2- 172.21.15.53:0/3478232628 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28cc0c0cf0 0x7f28cc0c1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:54.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.972+0000 7f28d08ab640 1 -- 172.21.15.53:0/3478232628 >> 172.21.15.53:0/3478232628 conn(0x7f28cc069450 msgr2=0x7f28cc069850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:54.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.972+0000 7fd93a59c640 1 --2- 172.21.15.53:0/1369780456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd93c0afd30 0x7fd93c0cb6c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd934009e50 tx=0x7fd93401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32a55b4c418540dd server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:54.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.972+0000 7fc175024640 1 -- 172.21.15.53:0/335229777 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 270276237 0 0) 0x7fc168007080 con 0x7fc168037aa0 2023-06-10T18:52:54.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.972+0000 7fc175024640 1 -- 172.21.15.53:0/335229777 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc15c003530 con 0x7fc168037aa0 2023-06-10T18:52:54.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.972+0000 7fc175024640 1 -- 172.21.15.53:0/335229777 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1244887513 0 0) 0x7fc168034340 con 0x7fc168033f70 2023-06-10T18:52:54.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.972+0000 7fc175024640 1 -- 172.21.15.53:0/335229777 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc168007080 con 0x7fc168033f70 2023-06-10T18:52:54.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.972+0000 7fc175024640 1 -- 172.21.15.53:0/335229777 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 119395532 0 0) 0x7fc15c003530 con 0x7fc168037aa0 2023-06-10T18:52:54.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.972+0000 7fc175024640 1 -- 172.21.15.53:0/335229777 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc168037f00 msgr2=0x7fc168039570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:54.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.972+0000 7fc175024640 1 --2- 172.21.15.53:0/335229777 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc168037f00 0x7fc168039570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:54.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.972+0000 7fc175024640 1 -- 172.21.15.53:0/335229777 >> v1:172.21.15.117:6789/0 conn(0x7fc168033f70 legacy=0x7fc16804fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:54.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.972+0000 7fc175024640 1 -- 172.21.15.53:0/335229777 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc168006da0 con 0x7fc168037aa0 2023-06-10T18:52:54.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.972+0000 7fc175024640 1 -- 172.21.15.53:0/335229777 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fc16c001680 con 0x7fc168037aa0 2023-06-10T18:52:54.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.972+0000 7ff21d4af640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff2180cc120 0x7ff2180cc570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:54.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.972+0000 7ff21d4af640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff2180ca3a0 0x7ff2180ca820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:54.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.972+0000 7ff21d4af640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2180ccab0 con 0x7ff21815bab0 2023-06-10T18:52:54.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.972+0000 7ff21d4af640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2180ca160 con 0x7ff2180ca3a0 2023-06-10T18:52:54.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.972+0000 7ff21d4af640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff21806a390 con 0x7ff2180cc120 2023-06-10T18:52:54.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.972+0000 7ff216ffd640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7ff21815bab0 0x7ff2180cdde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.53:47624/0 (socket says 172.21.15.53:47624) 2023-06-10T18:52:54.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.972+0000 7ff216ffd640 1 -- 172.21.15.53:0/1995781901 learned_addr learned my addr 172.21.15.53:0/1995781901 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:52:54.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.972+0000 7fc175024640 1 -- 172.21.15.53:0/335229777 >> v1:172.21.15.53:6789/0 conn(0x7fc168037aa0 legacy=0x7fc1680366d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:54.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.972+0000 7fc175024640 1 --2- 172.21.15.53:0/335229777 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc15c003b40 0x7fc15c003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:54.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.972+0000 7fc175024640 1 --2- 172.21.15.53:0/335229777 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc15c0047d0 0x7fc15c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:54.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.972+0000 7fc175024640 1 --2- 172.21.15.53:0/335229777 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc15c005180 0x7fc15c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.972+0000 7fc175024640 1 -- 172.21.15.53:0/335229777 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc168054840 con 0x7fc15c003b40 2023-06-10T18:52:55.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.972+0000 7fc175024640 1 -- 172.21.15.53:0/335229777 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc15c00bed0 con 0x7fc15c0047d0 2023-06-10T18:52:55.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.972+0000 7fc175024640 1 -- 172.21.15.53:0/335229777 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc15c00c010 con 0x7fc15c005180 2023-06-10T18:52:55.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.972+0000 7fc176026640 1 --2- 172.21.15.53:0/335229777 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc15c003b40 0x7fc15c003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.972+0000 7fc175825640 1 --2- 172.21.15.53:0/335229777 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc15c0047d0 0x7fc15c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.972+0000 7fc176827640 1 --2- 172.21.15.53:0/335229777 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc15c005180 0x7fc15c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.972+0000 7fc176026640 1 -- 172.21.15.53:0/335229777 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc15c005180 msgr2=0x7fc15c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:55.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.972+0000 7fc176026640 1 --2- 172.21.15.53:0/335229777 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc15c005180 0x7fc15c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.972+0000 7fc176026640 1 -- 172.21.15.53:0/335229777 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc15c0047d0 msgr2=0x7fc15c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:55.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.972+0000 7fc176026640 1 --2- 172.21.15.53:0/335229777 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc15c0047d0 0x7fc15c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.002 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.972+0000 7fc176026640 1 -- 172.21.15.53:0/335229777 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc168006da0 con 0x7fc15c003b40 2023-06-10T18:52:55.002 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.972+0000 7ff2167fc640 1 --2- 172.21.15.53:0/1995781901 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff2180cc120 0x7ff2180cc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.002 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.972+0000 7ff2177fe640 1 --2- 172.21.15.53:0/1995781901 >> v2:172.21.15.117:3300/0 conn(0x7ff2180ca3a0 0x7ff2180ca820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.972+0000 7ff049595640 1 Processor -- start 2023-06-10T18:52:55.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.972+0000 7ff049595640 1 -- start start 2023-06-10T18:52:55.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.972+0000 7fd93959a640 1 -- 172.21.15.53:0/1369780456 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9340a57f0 con 0x7fd93c0afd30 2023-06-10T18:52:55.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.972+0000 7ff215ffb640 1 -- 172.21.15.53:0/1995781901 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1071922345 0 0) 0x7ff2100014a0 con 0x7ff21815bab0 2023-06-10T18:52:55.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.972+0000 7ff215ffb640 1 -- 172.21.15.53:0/1995781901 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff200003530 con 0x7ff21815bab0 2023-06-10T18:52:55.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.972+0000 7fd93959a640 1 -- 172.21.15.53:0/1369780456 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9340a5950 con 0x7fd93c0afd30 2023-06-10T18:52:55.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.972+0000 7fd93959a640 1 -- 172.21.15.53:0/1369780456 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9340a5ce0 con 0x7fd93c0afd30 2023-06-10T18:52:55.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.972+0000 7ff049595640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff04416c830 0x7ff0440ccb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.972+0000 7ff049595640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0440cd070 0x7ff04406c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.972+0000 7ff049595640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff04406d0e0 con 0x7ff04406cc80 2023-06-10T18:52:55.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.972+0000 7ff049595640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0440cc470 con 0x7ff04416c830 2023-06-10T18:52:55.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.972+0000 7ff049595640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0440cb860 con 0x7ff0440cd070 2023-06-10T18:52:55.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.972+0000 7ff042ffd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff04416c830 0x7ff0440ccb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.972+0000 7ff042ffd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff04416c830 0x7ff0440ccb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.53:50504/0 (socket says 172.21.15.53:50504) 2023-06-10T18:52:55.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.972+0000 7ff042ffd640 1 -- 172.21.15.53:0/925883995 learned_addr learned my addr 172.21.15.53:0/925883995 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:55.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.972+0000 7f28d08ab640 1 -- 172.21.15.53:0/3478232628 shutdown_connections 2023-06-10T18:52:55.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.972+0000 7f28d08ab640 1 -- 172.21.15.53:0/3478232628 wait complete. 2023-06-10T18:52:55.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.972+0000 7f088ed9d640 1 --2- 172.21.15.53:0/2477756111 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f08900afee0 0x7f089016ace0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f08800097c0 tx=0x7f088001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7808601afb9b5c2c server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:55.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.972+0000 7fd940b10640 1 -- 172.21.15.53:0/1369780456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd93c0afd30 msgr2=0x7fd93c0cb6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.972+0000 7fd940b10640 1 --2- 172.21.15.53:0/1369780456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd93c0afd30 0x7fd93c0cb6c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd934009e50 tx=0x7fd93401ca30 comp rx=0 tx=0).stop 2023-06-10T18:52:55.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.972+0000 7fc176026640 1 --2- 172.21.15.53:0/335229777 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc15c003b40 0x7fc15c003f30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc17004eaa0 tx=0x7fc1700982e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa5a83e58faea24 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:55.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.976+0000 7fc175024640 1 -- 172.21.15.53:0/335229777 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc170129440 con 0x7fc15c003b40 2023-06-10T18:52:55.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.976+0000 7fc175024640 1 -- 172.21.15.53:0/335229777 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1701295c0 con 0x7fc15c003b40 2023-06-10T18:52:55.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.976+0000 7fc175024640 1 -- 172.21.15.53:0/335229777 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc170129a30 con 0x7fc15c003b40 2023-06-10T18:52:55.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.976+0000 7fd940b10640 1 -- 172.21.15.53:0/1369780456 shutdown_connections 2023-06-10T18:52:55.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.976+0000 7fd940b10640 1 --2- 172.21.15.53:0/1369780456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd93c0afd30 0x7fd93c0cb6c0 secure :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd934009e50 tx=0x7fd93401ca30 comp rx=0 tx=0).stop 2023-06-10T18:52:55.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.976+0000 7fd940b10640 1 -- 172.21.15.53:0/1369780456 >> 172.21.15.53:0/1369780456 conn(0x7fd93c06a0e0 msgr2=0x7fd93c0af620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:55.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.976+0000 7f088d59a640 1 -- 172.21.15.53:0/2477756111 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08800ab660 con 0x7f08900afee0 2023-06-10T18:52:55.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.976+0000 7f088d59a640 1 -- 172.21.15.53:0/2477756111 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08800ab7c0 con 0x7f08900afee0 2023-06-10T18:52:55.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.976+0000 7fd940b10640 1 -- 172.21.15.53:0/1369780456 shutdown_connections 2023-06-10T18:52:55.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.976+0000 7fd940b10640 1 -- 172.21.15.53:0/1369780456 wait complete. 2023-06-10T18:52:55.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.976+0000 7f28d08ab640 1 Processor -- start 2023-06-10T18:52:55.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.976+0000 7f088d59a640 1 -- 172.21.15.53:0/2477756111 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08800abb50 con 0x7f08900afee0 2023-06-10T18:52:55.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.976+0000 7f0894b53640 1 -- 172.21.15.53:0/2477756111 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f08900afee0 msgr2=0x7f089016ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.976+0000 7f0894b53640 1 --2- 172.21.15.53:0/2477756111 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f08900afee0 0x7f089016ace0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f08800097c0 tx=0x7f088001c440 comp rx=0 tx=0).stop 2023-06-10T18:52:55.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.972+0000 7ff2177fe640 1 -- 172.21.15.53:0/1995781901 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff2180cc120 msgr2=0x7ff2180cc570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:55.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.972+0000 7ff2177fe640 1 --2- 172.21.15.53:0/1995781901 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff2180cc120 0x7ff2180cc570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.972+0000 7ff2177fe640 1 -- 172.21.15.53:0/1995781901 >> v1:172.21.15.117:6789/0 conn(0x7ff21815bab0 legacy=0x7ff2180cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.972+0000 7ff2177fe640 1 -- 172.21.15.53:0/1995781901 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff218069780 con 0x7ff2180ca3a0 2023-06-10T18:52:55.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.976+0000 7f28d08ab640 1 -- start start 2023-06-10T18:52:55.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.976+0000 7f28d08ab640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28cc0c0cf0 0x7f28cc06fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.976+0000 7f28d08ab640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28cc0ca380 0x7f28cc070200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.976+0000 7f28d08ab640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28cc0cd9d0 0x7f28cc150320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.976+0000 7f0894b53640 1 -- 172.21.15.53:0/2477756111 shutdown_connections 2023-06-10T18:52:55.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.976+0000 7f0894b53640 1 --2- 172.21.15.53:0/2477756111 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f08900afee0 0x7f089016ace0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.976+0000 7f0894b53640 1 -- 172.21.15.53:0/2477756111 >> 172.21.15.53:0/2477756111 conn(0x7f08900ce9e0 msgr2=0x7f08900ca7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:55.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.972+0000 7ff042ffd640 1 -- 172.21.15.53:0/925883995 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0440cd070 msgr2=0x7ff04406c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:55.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.972+0000 7ff042ffd640 1 --2- 172.21.15.53:0/925883995 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0440cd070 0x7ff04406c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.972+0000 7ff042ffd640 1 -- 172.21.15.53:0/925883995 >> v1:172.21.15.117:6789/0 conn(0x7ff04406cc80 legacy=0x7ff044089060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.972+0000 7ff042ffd640 1 -- 172.21.15.53:0/925883995 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0440cbb40 con 0x7ff04416c830 2023-06-10T18:52:55.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.976+0000 7f0894b53640 1 -- 172.21.15.53:0/2477756111 shutdown_connections 2023-06-10T18:52:55.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.976+0000 7f28c9d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28cc0ca380 0x7f28cc070200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.976+0000 7f28c9d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28cc0ca380 0x7f28cc070200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35028/0 (socket says 172.21.15.53:35028) 2023-06-10T18:52:55.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.976+0000 7ff2177fe640 1 --2- 172.21.15.53:0/1995781901 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2180ca3a0 0x7ff2180ca820 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff20c0097c0 tx=0x7ff20c01c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a1d3b4d61cd1f86 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:55.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.976+0000 7fd940b10640 1 Processor -- start 2023-06-10T18:52:55.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.976+0000 7f28d08ab640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28cc1515a0 con 0x7f28cc0ca380 2023-06-10T18:52:55.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.976+0000 7f28d08ab640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28cc162bb0 con 0x7f28cc0c0cf0 2023-06-10T18:52:55.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.976+0000 7f28d08ab640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28cc162e90 con 0x7f28cc0cd9d0 2023-06-10T18:52:55.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.976+0000 7f28c9d9b640 1 -- 172.21.15.53:0/4227873236 learned_addr learned my addr 172.21.15.53:0/4227873236 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:55.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.976+0000 7f4341d9b640 1 --2- 172.21.15.53:0/182379566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f432c0047d0 0x7f432c004c40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f433c00a920 tx=0x7f433c01d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e8c6f1631720796 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:55.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.976+0000 7ff215ffb640 1 -- 172.21.15.53:0/1995781901 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20c0ab600 con 0x7ff2180ca3a0 2023-06-10T18:52:55.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.976+0000 7ff215ffb640 1 -- 172.21.15.53:0/1995781901 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff20c0a7050 con 0x7ff2180ca3a0 2023-06-10T18:52:55.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.976+0000 7ff215ffb640 1 -- 172.21.15.53:0/1995781901 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20c0ab980 con 0x7ff2180ca3a0 2023-06-10T18:52:55.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.976+0000 7f28cad9d640 1 --2- 172.21.15.53:0/4227873236 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28cc0cd9d0 0x7f28cc150320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.976+0000 7f28ca59c640 1 --2- 172.21.15.53:0/4227873236 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28cc0c0cf0 0x7f28cc06fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.976+0000 7fd940b10640 1 -- start start 2023-06-10T18:52:55.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.976+0000 7f28c9d9b640 1 -- 172.21.15.53:0/4227873236 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28cc0cd9d0 msgr2=0x7f28cc150320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.976+0000 7f28c9d9b640 1 --2- 172.21.15.53:0/4227873236 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28cc0cd9d0 0x7f28cc150320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.976+0000 7f28c9d9b640 1 -- 172.21.15.53:0/4227873236 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28cc0c0cf0 msgr2=0x7f28cc06fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.976+0000 7f28c9d9b640 1 --2- 172.21.15.53:0/4227873236 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28cc0c0cf0 0x7f28cc06fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.976+0000 7f28c9d9b640 1 -- 172.21.15.53:0/4227873236 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28c00094d0 con 0x7f28cc0ca380 2023-06-10T18:52:55.020 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.976+0000 7f434159a640 1 -- 172.21.15.53:0/182379566 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f433c007310 con 0x7f432c0047d0 2023-06-10T18:52:55.020 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.976+0000 7f28c9d9b640 1 --2- 172.21.15.53:0/4227873236 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28cc0ca380 0x7f28cc070200 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f28c400ba50 tx=0x7f28c400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:55.020 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.976+0000 7f434159a640 1 -- 172.21.15.53:0/182379566 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f433c0a8070 con 0x7f432c0047d0 2023-06-10T18:52:55.020 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.976+0000 7f434159a640 1 -- 172.21.15.53:0/182379566 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f433c0076d0 con 0x7f432c0047d0 2023-06-10T18:52:55.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.976+0000 7ff21d4af640 1 -- 172.21.15.53:0/1995781901 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2180ca3a0 msgr2=0x7ff2180ca820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.976+0000 7ff21d4af640 1 --2- 172.21.15.53:0/1995781901 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2180ca3a0 0x7ff2180ca820 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff20c0097c0 tx=0x7ff20c01c480 comp rx=0 tx=0).stop 2023-06-10T18:52:55.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.976+0000 7ff21d4af640 1 -- 172.21.15.53:0/1995781901 shutdown_connections 2023-06-10T18:52:55.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.976+0000 7f0894b53640 1 -- 172.21.15.53:0/2477756111 wait complete. 2023-06-10T18:52:55.022 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.976+0000 7ff21d4af640 1 --2- 172.21.15.53:0/1995781901 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2180ca3a0 0x7ff2180ca820 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.022 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.976+0000 7ff21d4af640 1 --2- 172.21.15.53:0/1995781901 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff2180cc120 0x7ff2180cc570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.022 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.976+0000 7f0894b53640 1 Processor -- start 2023-06-10T18:52:55.023 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.976+0000 7fd940b10640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd93c0cbc00 0x7fd93c1f8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.023 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.976+0000 7fd940b10640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd93c0cd650 0x7fd93c150f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.023 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.976+0000 7ff21d4af640 1 -- 172.21.15.53:0/1995781901 >> 172.21.15.53:0/1995781901 conn(0x7ff2180b00a0 msgr2=0x7ff2180b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:55.023 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.976+0000 7f0894b53640 1 -- start start 2023-06-10T18:52:55.024 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.976+0000 7fb3c1e1c640 1 Processor -- start 2023-06-10T18:52:55.024 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.976+0000 7fd940b10640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd93c156bd0 0x7fd93c0b2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.024 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.976+0000 7fd940b10640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd93c15ab20 con 0x7fd93c0cbc00 2023-06-10T18:52:55.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.976+0000 7fd940b10640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd93c0c2ab0 con 0x7fd93c0cd650 2023-06-10T18:52:55.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.976+0000 7fd940b10640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd93c1f91d0 con 0x7fd93c156bd0 2023-06-10T18:52:55.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7ff21d4af640 1 -- 172.21.15.53:0/1995781901 shutdown_connections 2023-06-10T18:52:55.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.976+0000 7fc17828a640 1 -- 172.21.15.53:0/335229777 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc15c003b40 msgr2=0x7fc15c003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.976+0000 7fc17828a640 1 --2- 172.21.15.53:0/335229777 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc15c003b40 0x7fc15c003f30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc17004eaa0 tx=0x7fc1700982e0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7fc176827640 1 -- 172.21.15.53:0/335229777 reap_dead start 2023-06-10T18:52:55.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7f434359e640 1 -- 172.21.15.53:0/182379566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f432c0047d0 msgr2=0x7f432c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7f434359e640 1 --2- 172.21.15.53:0/182379566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f432c0047d0 0x7f432c004c40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f433c00a920 tx=0x7f433c01d3b0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7fb3c1e1c640 1 -- start start 2023-06-10T18:52:55.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7f28baffd640 1 -- 172.21.15.53:0/4227873236 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c400cbe0 con 0x7f28cc0ca380 2023-06-10T18:52:55.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7fc17828a640 1 -- 172.21.15.53:0/335229777 shutdown_connections 2023-06-10T18:52:55.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7fc17828a640 1 -- 172.21.15.53:0/335229777 >> 172.21.15.53:0/335229777 conn(0x7fc1680516d0 msgr2=0x7fc168051ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:55.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7fc17828a640 1 -- 172.21.15.53:0/335229777 shutdown_connections 2023-06-10T18:52:55.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7fd939d9b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd93c0cd650 0x7fd93c150f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7fd939d9b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd93c0cd650 0x7fd93c150f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.53:50518/0 (socket says 172.21.15.53:50518) 2023-06-10T18:52:55.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7fd939d9b640 1 -- 172.21.15.53:0/507421006 learned_addr learned my addr 172.21.15.53:0/507421006 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:55.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7fd93ad9d640 1 --2- 172.21.15.53:0/507421006 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd93c156bd0 0x7fd93c0b2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7f28baffd640 1 -- 172.21.15.53:0/4227873236 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28c400cd60 con 0x7f28cc0ca380 2023-06-10T18:52:55.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7f28baffd640 1 -- 172.21.15.53:0/4227873236 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c4014680 con 0x7f28cc0ca380 2023-06-10T18:52:55.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7f434359e640 1 -- 172.21.15.53:0/182379566 shutdown_connections 2023-06-10T18:52:55.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7f434359e640 1 --2- 172.21.15.53:0/182379566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f432c0047d0 0x7f432c004c40 secure :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f433c00a920 tx=0x7f433c01d3b0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7f434359e640 1 -- 172.21.15.53:0/182379566 >> 172.21.15.53:0/182379566 conn(0x7f43440cb600 msgr2=0x7f43440cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:55.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7fd93a59c640 1 --2- 172.21.15.53:0/507421006 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd93c0cbc00 0x7fd93c1f8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7f0894b53640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08900afee0 0x7f08900c45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7f0894b53640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f089015fc50 0x7f08900b3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7f434359e640 1 -- 172.21.15.53:0/182379566 shutdown_connections 2023-06-10T18:52:55.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7fd93ad9d640 1 -- 172.21.15.53:0/507421006 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd93c0cd650 msgr2=0x7fd93c150f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7fd93ad9d640 1 --2- 172.21.15.53:0/507421006 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd93c0cd650 0x7fd93c150f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7fd93ad9d640 1 -- 172.21.15.53:0/507421006 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd93c0cbc00 msgr2=0x7fd93c1f8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7fd93ad9d640 1 --2- 172.21.15.53:0/507421006 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd93c0cbc00 0x7fd93c1f8c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7fd93ad9d640 1 -- 172.21.15.53:0/507421006 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd934009b30 con 0x7fd93c156bd0 2023-06-10T18:52:55.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7f0894b53640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0890160020 0x7f08902006f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7f0894b53640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08900c4120 con 0x7f089015fc50 2023-06-10T18:52:55.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7f0894b53640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08900c3510 con 0x7f0890160020 2023-06-10T18:52:55.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7f0894b53640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08900c37f0 con 0x7f08900afee0 2023-06-10T18:52:55.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7f088dd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f089015fc50 0x7f08900b3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7f088dd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f089015fc50 0x7f08900b3640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35040/0 (socket says 172.21.15.53:35040) 2023-06-10T18:52:55.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7f088dd9b640 1 -- 172.21.15.53:0/2678087252 learned_addr learned my addr 172.21.15.53:0/2678087252 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:55.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7f088dd9b640 1 -- 172.21.15.53:0/2678087252 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08900afee0 msgr2=0x7f08900c45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7f088dd9b640 1 --2- 172.21.15.53:0/2678087252 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08900afee0 0x7f08900c45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7f088dd9b640 1 -- 172.21.15.53:0/2678087252 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0890160020 msgr2=0x7f08902006f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-06-10T18:52:55.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7f088dd9b640 1 --2- 172.21.15.53:0/2678087252 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0890160020 0x7f08902006f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7f088dd9b640 1 -- 172.21.15.53:0/2678087252 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0880009420 con 0x7f089015fc50 2023-06-10T18:52:55.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7fb3c1e1c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3bc0cd9d0 0x7fb3bc163620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7fb3c1e1c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb3bc163b60 0x7fb3bc0c0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7fb3c1e1c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb3bc0c1230 0x7fb3bc0cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7f088dd9b640 1 --2- 172.21.15.53:0/2678087252 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f089015fc50 0x7f08900b3640 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f088400c500 tx=0x7f088400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:55.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7ff21d4af640 1 -- 172.21.15.53:0/1995781901 wait complete. 2023-06-10T18:52:55.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7ff21d4af640 1 Processor -- start 2023-06-10T18:52:55.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7fb3c1e1c640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3bc164630 con 0x7fb3bc163b60 2023-06-10T18:52:55.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7fb3c1e1c640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3bc15ff70 con 0x7fb3bc0c1230 2023-06-10T18:52:55.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7fb3c1e1c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3bc0c16d0 con 0x7fb3bc0cd9d0 2023-06-10T18:52:55.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7fb3bb7fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3bc0cd9d0 0x7fb3bc163620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7ff042ffd640 1 --2- 172.21.15.53:0/925883995 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff04416c830 0x7ff0440ccb30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff034009870 tx=0x7ff03401c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd8752b148722f88 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:55.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7fb3bb7fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3bc0cd9d0 0x7fb3bc163620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.53:34682/0 (socket says 172.21.15.53:34682) 2023-06-10T18:52:55.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7fb3bb7fe640 1 -- 172.21.15.53:0/1472049771 learned_addr learned my addr 172.21.15.53:0/1472049771 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:55.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7fb3bbfff640 1 --2- 172.21.15.53:0/1472049771 >> v2:172.21.15.117:3300/0 conn(0x7fb3bc0c1230 0x7fb3bc0cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7fd93ad9d640 1 --2- 172.21.15.53:0/507421006 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd93c156bd0 0x7fd93c0b2e10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd92c00c390 tx=0x7fd92c00c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:55.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7fc17828a640 1 -- 172.21.15.53:0/335229777 wait complete. 2023-06-10T18:52:55.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7ff21d4af640 1 -- start start 2023-06-10T18:52:55.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7fc17828a640 1 Processor -- start 2023-06-10T18:52:55.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7f087effd640 1 -- 172.21.15.53:0/2678087252 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0884005cf0 con 0x7f089015fc50 2023-06-10T18:52:55.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7f087effd640 1 -- 172.21.15.53:0/2678087252 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0884005e50 con 0x7f089015fc50 2023-06-10T18:52:55.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7f087effd640 1 -- 172.21.15.53:0/2678087252 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08840072f0 con 0x7f089015fc50 2023-06-10T18:52:55.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7ff041ffb640 1 -- 172.21.15.53:0/925883995 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0340ad640 con 0x7ff04416c830 2023-06-10T18:52:55.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7ff041ffb640 1 -- 172.21.15.53:0/925883995 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0340ad7a0 con 0x7ff04416c830 2023-06-10T18:52:55.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7f0894b53640 1 -- 172.21.15.53:0/2678087252 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08900c3ad0 con 0x7f089015fc50 2023-06-10T18:52:55.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7f0894b53640 1 -- 172.21.15.53:0/2678087252 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08900b3b80 con 0x7f089015fc50 2023-06-10T18:52:55.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7ff041ffb640 1 -- 172.21.15.53:0/925883995 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0340adb30 con 0x7ff04416c830 2023-06-10T18:52:55.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7f434359e640 1 -- 172.21.15.53:0/182379566 wait complete. 2023-06-10T18:52:55.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7f434359e640 1 Processor -- start 2023-06-10T18:52:55.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7ff21d4af640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2180ca3a0 0x7ff218200a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7ff21d4af640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2180cc120 0x7ff2180c6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7ff21d4af640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff21815bab0 0x7ff2180c6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7ff21d4af640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2180c5200 con 0x7ff2180ca3a0 2023-06-10T18:52:55.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7ff21d4af640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff218152860 con 0x7ff2180cc120 2023-06-10T18:52:55.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7ff21d4af640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff218152b40 con 0x7ff21815bab0 2023-06-10T18:52:55.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7ff216ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2180ca3a0 0x7ff218200a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7ff216ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2180ca3a0 0x7ff218200a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35060/0 (socket says 172.21.15.53:35060) 2023-06-10T18:52:55.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7ff216ffd640 1 -- 172.21.15.53:0/1171033652 learned_addr learned my addr 172.21.15.53:0/1171033652 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:55.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7ff2167fc640 1 --2- 172.21.15.53:0/1171033652 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2180cc120 0x7ff2180c6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7ff2177fe640 1 --2- 172.21.15.53:0/1171033652 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff21815bab0 0x7ff2180c6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7ff216ffd640 1 -- 172.21.15.53:0/1171033652 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff21815bab0 msgr2=0x7ff2180c6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7ff216ffd640 1 --2- 172.21.15.53:0/1171033652 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff21815bab0 0x7ff2180c6bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7ff216ffd640 1 -- 172.21.15.53:0/1171033652 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2180cc120 msgr2=0x7ff2180c6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7ff216ffd640 1 --2- 172.21.15.53:0/1171033652 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2180cc120 0x7ff2180c6670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7ff216ffd640 1 -- 172.21.15.53:0/1171033652 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff20c009420 con 0x7ff2180ca3a0 2023-06-10T18:52:55.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7ff216ffd640 1 --2- 172.21.15.53:0/1171033652 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2180ca3a0 0x7ff218200a00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff21000cbb0 tx=0x7ff21000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:55.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7f0894b53640 1 -- 172.21.15.53:0/2678087252 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f089004d790 con 0x7f089015fc50 2023-06-10T18:52:55.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7fc17828a640 1 -- start start 2023-06-10T18:52:55.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7fc17828a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc15c003b40 0x7fc1680d4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7ff049595640 1 -- 172.21.15.53:0/925883995 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff04416c830 msgr2=0x7ff0440ccb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7ff049595640 1 --2- 172.21.15.53:0/925883995 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff04416c830 0x7ff0440ccb30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff034009870 tx=0x7ff03401c480 comp rx=0 tx=0).stop 2023-06-10T18:52:55.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7f434359e640 1 -- start start 2023-06-10T18:52:55.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7f434359e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f434414e5e0 0x7f434415c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7fc17828a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1680e1440 0x7fc16804e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7fc17828a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc168039e40 0x7fc16803a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7fc17828a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc16803a7f0 con 0x7fc1680e1440 2023-06-10T18:52:55.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7fc17828a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc16804c6f0 con 0x7fc168039e40 2023-06-10T18:52:55.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7fc17828a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1680d5430 con 0x7fc15c003b40 2023-06-10T18:52:55.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.984+0000 7fc175825640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1680e1440 0x7fc16804e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7ff049595640 1 -- 172.21.15.53:0/925883995 shutdown_connections 2023-06-10T18:52:55.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7ff049595640 1 --2- 172.21.15.53:0/925883995 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0440cd070 0x7ff04406c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7ff049595640 1 --2- 172.21.15.53:0/925883995 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff04416c830 0x7ff0440ccb30 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7ff049595640 1 -- 172.21.15.53:0/925883995 >> 172.21.15.53:0/925883995 conn(0x7ff04406a0e0 msgr2=0x7ff0440af620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:55.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.984+0000 7fc175825640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1680e1440 0x7fc16804e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35064/0 (socket says 172.21.15.53:35064) 2023-06-10T18:52:55.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.984+0000 7fc175825640 1 -- 172.21.15.53:0/2417684783 learned_addr learned my addr 172.21.15.53:0/2417684783 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:55.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.984+0000 7ff049595640 1 -- 172.21.15.53:0/925883995 shutdown_connections 2023-06-10T18:52:55.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.984+0000 7f28d08ab640 1 -- 172.21.15.53:0/4227873236 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28cc163170 con 0x7f28cc0ca380 2023-06-10T18:52:55.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.984+0000 7fc176827640 1 --2- 172.21.15.53:0/2417684783 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc168039e40 0x7fc16803a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.984+0000 7f434359e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f434414e9b0 0x7f4344155f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.984+0000 7fc175825640 1 -- 172.21.15.53:0/2417684783 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc15c003b40 msgr2=0x7fc1680d4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.984+0000 7fc175825640 1 --2- 172.21.15.53:0/2417684783 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc15c003b40 0x7fc1680d4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.984+0000 7fc175825640 1 -- 172.21.15.53:0/2417684783 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc168039e40 msgr2=0x7fc16803a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.984+0000 7fc175825640 1 --2- 172.21.15.53:0/2417684783 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc168039e40 0x7fc16803a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.984+0000 7fc175825640 1 -- 172.21.15.53:0/2417684783 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc16804bdc0 con 0x7fc1680e1440 2023-06-10T18:52:55.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.984+0000 7ff1ff7fe640 1 -- 172.21.15.53:0/1171033652 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21000ad40 con 0x7ff2180ca3a0 2023-06-10T18:52:55.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.984+0000 7ff1ff7fe640 1 -- 172.21.15.53:0/1171033652 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff210012400 con 0x7ff2180ca3a0 2023-06-10T18:52:55.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.984+0000 7ff1ff7fe640 1 -- 172.21.15.53:0/1171033652 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21000aea0 con 0x7ff2180ca3a0 2023-06-10T18:52:55.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.984+0000 7f434359e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f434414ee20 0x7f4344156490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.984+0000 7f434359e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43440c53e0 con 0x7f434414e5e0 2023-06-10T18:52:55.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.984+0000 7f28d08ab640 1 -- 172.21.15.53:0/4227873236 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28cc163730 con 0x7f28cc0ca380 2023-06-10T18:52:55.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.984+0000 7f434359e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43440c26b0 con 0x7f434414e9b0 2023-06-10T18:52:55.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.984+0000 7f4342d9d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f434414ee20 0x7f4344156490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.984+0000 7f4342d9d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f434414ee20 0x7f4344156490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.53:34698/0 (socket says 172.21.15.53:34698) 2023-06-10T18:52:55.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.984+0000 7f4342d9d640 1 -- 172.21.15.53:0/3462337002 learned_addr learned my addr 172.21.15.53:0/3462337002 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:55.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.984+0000 7f434359e640 1 -- 172.21.15.53:0/3462337002 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43440c2970 con 0x7f434414ee20 2023-06-10T18:52:55.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7fd92affd640 1 -- 172.21.15.53:0/507421006 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd92c0052d0 con 0x7fd93c156bd0 2023-06-10T18:52:55.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7fd92affd640 1 -- 172.21.15.53:0/507421006 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd92c005430 con 0x7fd93c156bd0 2023-06-10T18:52:55.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7fd92affd640 1 -- 172.21.15.53:0/507421006 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd92c011890 con 0x7fd93c156bd0 2023-06-10T18:52:55.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.984+0000 7ff21d4af640 1 -- 172.21.15.53:0/1171033652 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff218152e20 con 0x7ff2180ca3a0 2023-06-10T18:52:55.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.984+0000 7ff21d4af640 1 -- 172.21.15.53:0/1171033652 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff218201110 con 0x7ff2180ca3a0 2023-06-10T18:52:55.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.984+0000 7f434259c640 1 --2- 172.21.15.53:0/3462337002 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f434414e5e0 0x7f434415c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.984+0000 7ff21d4af640 1 -- 172.21.15.53:0/1171033652 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff21806a020 con 0x7ff2180ca3a0 2023-06-10T18:52:55.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.984+0000 7fc175825640 1 --2- 172.21.15.53:0/2417684783 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1680e1440 0x7fc16804e700 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc16c00e800 tx=0x7fc16c00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:55.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.984+0000 7f434259c640 1 -- 172.21.15.53:0/3462337002 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f434414ee20 msgr2=0x7f4344156490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.984+0000 7f434259c640 1 --2- 172.21.15.53:0/3462337002 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f434414ee20 0x7f4344156490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.984+0000 7f434259c640 1 -- 172.21.15.53:0/3462337002 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f434414e9b0 msgr2=0x7f4344155f50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-06-10T18:52:55.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.984+0000 7f434259c640 1 --2- 172.21.15.53:0/3462337002 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f434414e9b0 0x7f4344155f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.984+0000 7f434259c640 1 -- 172.21.15.53:0/3462337002 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43440c4d90 con 0x7f434414e5e0 2023-06-10T18:52:55.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.984+0000 7f087effd640 1 -- 172.21.15.53:0/2678087252 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0884007450 con 0x7f089015fc50 2023-06-10T18:52:55.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.984+0000 7ff049595640 1 -- 172.21.15.53:0/925883995 wait complete. 2023-06-10T18:52:55.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.984+0000 7ff049595640 1 Processor -- start 2023-06-10T18:52:55.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.984+0000 7f28d08ab640 1 -- 172.21.15.53:0/4227873236 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f28cc0c9e60 con 0x7f28cc0ca380 2023-06-10T18:52:55.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.984+0000 7ff049595640 1 -- start start 2023-06-10T18:52:55.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7fb3bb7fe640 1 -- 172.21.15.53:0/1472049771 >> v2:172.21.15.117:3300/0 conn(0x7fb3bc0c1230 msgr2=0x7fb3bc0cdda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:55.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7fb3bb7fe640 1 --2- 172.21.15.53:0/1472049771 >> v2:172.21.15.117:3300/0 conn(0x7fb3bc0c1230 0x7fb3bc0cdda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7fb3bb7fe640 1 -- 172.21.15.53:0/1472049771 >> v2:172.21.15.53:3300/0 conn(0x7fb3bc163b60 msgr2=0x7fb3bc0c0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:55.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7fb3bb7fe640 1 --2- 172.21.15.53:0/1472049771 >> v2:172.21.15.53:3300/0 conn(0x7fb3bc163b60 0x7fb3bc0c0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.980+0000 7fb3bb7fe640 1 -- 172.21.15.53:0/1472049771 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3bc0c98e0 con 0x7fb3bc0cd9d0 2023-06-10T18:52:55.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.984+0000 7f434259c640 1 --2- 172.21.15.53:0/3462337002 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f434414e5e0 0x7f434415c890 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f43440c2070 tx=0x7f433400f600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:55.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.984+0000 7fd940b10640 1 -- 172.21.15.53:0/507421006 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd93c157070 con 0x7fd93c156bd0 2023-06-10T18:52:55.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.984+0000 7f087effd640 1 --2- 172.21.15.53:0/2678087252 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0870066350 0x7f0870068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.984+0000 7fb3bb7fe640 1 --2- 172.21.15.53:0/1472049771 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3bc0cd9d0 0x7fb3bc163620 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc071c30 tx=0x7fb3ac01c4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a289a66b6c067cb server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:55.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.984+0000 7f087effd640 1 -- 172.21.15.53:0/2678087252 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0884083d60 con 0x7f089015fc50 2023-06-10T18:52:55.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.984+0000 7fd940b10640 1 -- 172.21.15.53:0/507421006 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd93c0c2d30 con 0x7fd93c156bd0 2023-06-10T18:52:55.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.984+0000 7f087effd640 1 --2- 172.21.15.53:0/2678087252 >> [v2:172.21.15.117:6808/1805352380,v1:172.21.15.117:6809/1805352380] conn(0x7f087006ec00 0x7f0870071010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.984+0000 7f087effd640 1 -- 172.21.15.53:0/2678087252 --> [v2:172.21.15.117:6808/1805352380,v1:172.21.15.117:6809/1805352380] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f08700716c0 con 0x7f087006ec00 2023-06-10T18:52:55.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.984+0000 7f087effd640 1 -- 172.21.15.53:0/2678087252 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0884084110 con 0x7f089015fc50 2023-06-10T18:52:55.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.984+0000 7f088e59c640 1 --2- 172.21.15.53:0/2678087252 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0870066350 0x7f0870068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.984+0000 7f088ed9d640 1 --2- 172.21.15.53:0/2678087252 >> [v2:172.21.15.117:6808/1805352380,v1:172.21.15.117:6809/1805352380] conn(0x7f087006ec00 0x7f0870071010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.984+0000 7ff049595640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff04406cc80 0x7ff0442117b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.984+0000 7ff049595640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0440cd070 0x7ff0440c73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.984+0000 7ff049595640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff04416c830 0x7ff0440b2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.984+0000 7ff049595640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0440c6bb0 con 0x7ff04416c830 2023-06-10T18:52:55.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.984+0000 7ff049595640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff04416de40 con 0x7ff0440cd070 2023-06-10T18:52:55.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.984+0000 7ff049595640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0440c6030 con 0x7ff04406cc80 2023-06-10T18:52:55.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.984+0000 7fc166ffd640 1 -- 172.21.15.53:0/2417684783 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16c00c870 con 0x7fc1680e1440 2023-06-10T18:52:55.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.984+0000 7fc17828a640 1 -- 172.21.15.53:0/2417684783 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc16804c0a0 con 0x7fc1680e1440 2023-06-10T18:52:55.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.984+0000 7fc17828a640 1 -- 172.21.15.53:0/2417684783 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1680534e0 con 0x7fc1680e1440 2023-06-10T18:52:55.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.984+0000 7ff0427fc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0440cd070 0x7ff0440c73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.984+0000 7ff0427fc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0440cd070 0x7ff0440c73f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.53:50554/0 (socket says 172.21.15.53:50554) 2023-06-10T18:52:55.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.984+0000 7ff0427fc640 1 -- 172.21.15.53:0/3343098679 learned_addr learned my addr 172.21.15.53:0/3343098679 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:55.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.984+0000 7f4332ffd640 1 -- 172.21.15.53:0/3462337002 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43340050d0 con 0x7f434414e5e0 2023-06-10T18:52:55.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.984+0000 7f4332ffd640 1 -- 172.21.15.53:0/3462337002 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4334005230 con 0x7f434414e5e0 2023-06-10T18:52:55.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.984+0000 7f4332ffd640 1 -- 172.21.15.53:0/3462337002 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4334003600 con 0x7f434414e5e0 2023-06-10T18:52:55.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.984+0000 7fb3baffd640 1 -- 172.21.15.53:0/1472049771 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3ac0aa610 con 0x7fb3bc0cd9d0 2023-06-10T18:52:55.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.984+0000 7fb3baffd640 1 -- 172.21.15.53:0/1472049771 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3ac0a6040 con 0x7fb3bc0cd9d0 2023-06-10T18:52:55.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.984+0000 7fb3baffd640 1 -- 172.21.15.53:0/1472049771 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3ac0aa9d0 con 0x7fb3bc0cd9d0 2023-06-10T18:52:55.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.988+0000 7f434359e640 1 -- 172.21.15.53:0/3462337002 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43440c5070 con 0x7f434414e5e0 2023-06-10T18:52:55.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.988+0000 7f434359e640 1 -- 172.21.15.53:0/3462337002 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43441540b0 con 0x7f434414e5e0 2023-06-10T18:52:55.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.988+0000 7ff0437fe640 1 --2- 172.21.15.53:0/3343098679 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff04416c830 0x7ff0440b2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.988+0000 7fb3c1e1c640 1 -- 172.21.15.53:0/1472049771 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3bc0cd9d0 msgr2=0x7fb3bc163620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.988+0000 7fb3c1e1c640 1 --2- 172.21.15.53:0/1472049771 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3bc0cd9d0 0x7fb3bc163620 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc071c30 tx=0x7fb3ac01c4f0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.988+0000 7fb3c1e1c640 1 -- 172.21.15.53:0/1472049771 shutdown_connections 2023-06-10T18:52:55.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.988+0000 7fb3c1e1c640 1 --2- 172.21.15.53:0/1472049771 >> v2:172.21.15.117:3300/0 conn(0x7fb3bc0c1230 0x7fb3bc0cdda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.988+0000 7fb3c1e1c640 1 --2- 172.21.15.53:0/1472049771 >> v2:172.21.15.53:3300/0 conn(0x7fb3bc163b60 0x7fb3bc0c0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.988+0000 7fb3c1e1c640 1 --2- 172.21.15.53:0/1472049771 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3bc0cd9d0 0x7fb3bc163620 secure :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc071c30 tx=0x7fb3ac01c4f0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.988+0000 7fb3c1e1c640 1 -- 172.21.15.53:0/1472049771 >> 172.21.15.53:0/1472049771 conn(0x7fb3bc069450 msgr2=0x7fb3bc069850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:55.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.988+0000 7ff0437fe640 1 -- 172.21.15.53:0/3343098679 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff04406cc80 msgr2=0x7ff0442117b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-06-10T18:52:55.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.988+0000 7ff0437fe640 1 --2- 172.21.15.53:0/3343098679 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff04406cc80 0x7ff0442117b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.988+0000 7ff0437fe640 1 -- 172.21.15.53:0/3343098679 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0440cd070 msgr2=0x7ff0440c73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.988+0000 7ff0437fe640 1 --2- 172.21.15.53:0/3343098679 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0440cd070 0x7ff0440c73f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.988+0000 7ff0437fe640 1 -- 172.21.15.53:0/3343098679 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0340094d0 con 0x7ff04416c830 2023-06-10T18:52:55.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.988+0000 7ff1ff7fe640 1 -- 172.21.15.53:0/1171033652 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff2100127d0 con 0x7ff2180ca3a0 2023-06-10T18:52:55.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.988+0000 7f434359e640 1 -- 172.21.15.53:0/3462337002 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4344069cb0 con 0x7f434414e5e0 2023-06-10T18:52:55.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.988+0000 7f088ed9d640 1 --2- 172.21.15.53:0/2678087252 >> [v2:172.21.15.117:6808/1805352380,v1:172.21.15.117:6809/1805352380] conn(0x7f087006ec00 0x7f0870071010 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:55.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.988+0000 7ff1ff7fe640 1 --2- 172.21.15.53:0/1171033652 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff204066280 0x7ff204068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.988+0000 7ff1ff7fe640 1 -- 172.21.15.53:0/1171033652 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff2100840f0 con 0x7ff2180ca3a0 2023-06-10T18:52:55.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.988+0000 7fb3c1e1c640 1 -- 172.21.15.53:0/1472049771 shutdown_connections 2023-06-10T18:52:55.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.988+0000 7ff1ff7fe640 1 --2- 172.21.15.53:0/1171033652 >> [v2:172.21.15.117:6824/86798558,v1:172.21.15.117:6825/86798558] conn(0x7ff20406eb30 0x7ff204070f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.988+0000 7ff1ff7fe640 1 -- 172.21.15.53:0/1171033652 --> [v2:172.21.15.117:6824/86798558,v1:172.21.15.117:6825/86798558] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff2040715f0 con 0x7ff20406eb30 2023-06-10T18:52:55.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.988+0000 7ff1ff7fe640 1 -- 172.21.15.53:0/1171033652 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff2100844a0 con 0x7ff2180ca3a0 2023-06-10T18:52:55.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.988+0000 7fc17828a640 1 -- 172.21.15.53:0/2417684783 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc16804f690 con 0x7fc1680e1440 2023-06-10T18:52:55.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.988+0000 7ff2167fc640 1 --2- 172.21.15.53:0/1171033652 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff204066280 0x7ff204068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.079 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.988+0000 7fd92affd640 1 -- 172.21.15.53:0/507421006 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd92c0119f0 con 0x7fd93c156bd0 2023-06-10T18:52:55.079 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.988+0000 7fd940b10640 1 -- 172.21.15.53:0/507421006 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd93c15b620 con 0x7fd93c156bd0 2023-06-10T18:52:55.079 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.988+0000 7ff0437fe640 1 --2- 172.21.15.53:0/3343098679 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff04416c830 0x7ff0440b2930 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff03c00c700 tx=0x7ff03c00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:55.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.988+0000 7f088e59c640 1 --2- 172.21.15.53:0/2678087252 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0870066350 0x7f0870068800 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0888001cc0 tx=0x7f0888007d70 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:55.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.988+0000 7ff02b7fe640 1 -- 172.21.15.53:0/3343098679 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff03c003b80 con 0x7ff04416c830 2023-06-10T18:52:55.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.988+0000 7ff02b7fe640 1 -- 172.21.15.53:0/3343098679 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff03c003ce0 con 0x7ff04416c830 2023-06-10T18:52:55.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.988+0000 7ff049595640 1 -- 172.21.15.53:0/3343098679 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0440c6310 con 0x7ff04416c830 2023-06-10T18:52:55.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.988+0000 7ff02b7fe640 1 -- 172.21.15.53:0/3343098679 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff03c005310 con 0x7ff04416c830 2023-06-10T18:52:55.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.988+0000 7ff049595640 1 -- 172.21.15.53:0/3343098679 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0440c68d0 con 0x7ff04416c830 2023-06-10T18:52:55.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.988+0000 7f087effd640 1 -- 172.21.15.53:0/2678087252 <== osd.5 v2:172.21.15.117:6808/1805352380 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f08700716c0 con 0x7f087006ec00 2023-06-10T18:52:55.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.988+0000 7ff2177fe640 1 --2- 172.21.15.53:0/1171033652 >> [v2:172.21.15.117:6824/86798558,v1:172.21.15.117:6825/86798558] conn(0x7ff20406eb30 0x7ff204070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.988+0000 7fb3c1e1c640 1 -- 172.21.15.53:0/1472049771 wait complete. 2023-06-10T18:52:55.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.988+0000 7fb3c1e1c640 1 Processor -- start 2023-06-10T18:52:55.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.988+0000 7ff0297fa640 1 -- 172.21.15.53:0/3343098679 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff01c000fd0 con 0x7ff04416c830 2023-06-10T18:52:55.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.988+0000 7f4332ffd640 1 -- 172.21.15.53:0/3462337002 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4334003760 con 0x7f434414e5e0 2023-06-10T18:52:55.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.988+0000 7f4332ffd640 1 --2- 172.21.15.53:0/3462337002 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4324066350 0x7f4324068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.988+0000 7f4332ffd640 1 -- 172.21.15.53:0/3462337002 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4334084210 con 0x7f434414e5e0 2023-06-10T18:52:55.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.988+0000 7f4332ffd640 1 --2- 172.21.15.53:0/3462337002 >> [v2:172.21.15.53:6816/1931565522,v1:172.21.15.53:6817/1931565522] conn(0x7f432406ec00 0x7f4324071010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.988+0000 7f4332ffd640 1 -- 172.21.15.53:0/3462337002 --> [v2:172.21.15.53:6816/1931565522,v1:172.21.15.53:6817/1931565522] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f43240716c0 con 0x7f432406ec00 2023-06-10T18:52:55.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.988+0000 7f4332ffd640 1 -- 172.21.15.53:0/3462337002 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f43340845c0 con 0x7f434414e5e0 2023-06-10T18:52:55.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.988+0000 7fd92affd640 1 --2- 172.21.15.53:0/507421006 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd91c0662d0 0x7fd91c068780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.988+0000 7fd92affd640 1 -- 172.21.15.53:0/507421006 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd92c083110 con 0x7fd93c156bd0 2023-06-10T18:52:55.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.988+0000 7fd92affd640 1 --2- 172.21.15.53:0/507421006 >> [v2:172.21.15.53:6800/3437315773,v1:172.21.15.53:6801/3437315773] conn(0x7fd91c06eb00 0x7fd91c070f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.988+0000 7fd92affd640 1 -- 172.21.15.53:0/507421006 --> [v2:172.21.15.53:6800/3437315773,v1:172.21.15.53:6801/3437315773] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd91c0715c0 con 0x7fd91c06eb00 2023-06-10T18:52:55.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.988+0000 7fd93a59c640 1 --2- 172.21.15.53:0/507421006 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd91c0662d0 0x7fd91c068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.988+0000 7fd939d9b640 1 --2- 172.21.15.53:0/507421006 >> [v2:172.21.15.53:6800/3437315773,v1:172.21.15.53:6801/3437315773] conn(0x7fd91c06eb00 0x7fd91c070f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.988+0000 7fd939d9b640 1 --2- 172.21.15.53:0/507421006 >> [v2:172.21.15.53:6800/3437315773,v1:172.21.15.53:6801/3437315773] conn(0x7fd91c06eb00 0x7fd91c070f10 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:55.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.992+0000 7fd92affd640 1 -- 172.21.15.53:0/507421006 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd92c050720 con 0x7fd93c156bd0 2023-06-10T18:52:55.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.992+0000 7f28baffd640 1 -- 172.21.15.53:0/4227873236 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f28c401d3b0 con 0x7f28cc0ca380 2023-06-10T18:52:55.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.992+0000 7f4342d9d640 1 --2- 172.21.15.53:0/3462337002 >> [v2:172.21.15.53:6816/1931565522,v1:172.21.15.53:6817/1931565522] conn(0x7f432406ec00 0x7f4324071010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.992+0000 7ff2167fc640 1 --2- 172.21.15.53:0/1171033652 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff204066280 0x7ff204068730 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff218204710 tx=0x7ff208009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:55.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.992+0000 7ff2177fe640 1 --2- 172.21.15.53:0/1171033652 >> [v2:172.21.15.117:6824/86798558,v1:172.21.15.117:6825/86798558] conn(0x7ff20406eb30 0x7ff204070f40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:55.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.992+0000 7ff02b7fe640 1 -- 172.21.15.53:0/3343098679 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff03c005470 con 0x7ff04416c830 2023-06-10T18:52:55.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.988+0000 7fb3c1e1c640 1 -- start start 2023-06-10T18:52:55.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.992+0000 7fb3c1e1c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3bc0c1230 0x7fb3bc070150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.992+0000 7fb3c1e1c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3bc163b60 0x7fb3bc15c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.992+0000 7fb3c1e1c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3bc15c670 0x7fb3bc2007c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.992+0000 7fd92affd640 1 -- 172.21.15.53:0/507421006 <== osd.2 v2:172.21.15.53:6800/3437315773 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fd91c0715c0 con 0x7fd91c06eb00 2023-06-10T18:52:55.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.992+0000 7fb3c1e1c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3bc15cb10 con 0x7fb3bc163b60 2023-06-10T18:52:55.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.992+0000 7fb3c1e1c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3bc0c60a0 con 0x7fb3bc0c1230 2023-06-10T18:52:55.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.992+0000 7fb3c1e1c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3bc06f140 con 0x7fb3bc15c670 2023-06-10T18:52:55.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.992+0000 7f28baffd640 1 --2- 172.21.15.53:0/4227873236 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f28ac066350 0x7f28ac068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.992+0000 7f4342d9d640 1 --2- 172.21.15.53:0/3462337002 >> [v2:172.21.15.53:6816/1931565522,v1:172.21.15.53:6817/1931565522] conn(0x7f432406ec00 0x7f4324071010 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:55.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.992+0000 7f4341d9b640 1 --2- 172.21.15.53:0/3462337002 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4324066350 0x7f4324068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.992+0000 7f28baffd640 1 -- 172.21.15.53:0/4227873236 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f28c4084440 con 0x7f28cc0ca380 2023-06-10T18:52:55.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.992+0000 7fd93a59c640 1 --2- 172.21.15.53:0/507421006 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd91c0662d0 0x7fd91c068780 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd9340ae000 tx=0x7fd9340a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:55.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.992+0000 7fb3bbfff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3bc15c670 0x7fb3bc2007c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.992+0000 7ff02b7fe640 1 --2- 172.21.15.53:0/3343098679 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff030066280 0x7ff030068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.992+0000 7fb3bbfff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3bc15c670 0x7fb3bc2007c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.53:34722/0 (socket says 172.21.15.53:34722) 2023-06-10T18:52:55.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.992+0000 7fb3bbfff640 1 -- 172.21.15.53:0/2559631586 learned_addr learned my addr 172.21.15.53:0/2559631586 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:55.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.992+0000 7f28ca59c640 1 --2- 172.21.15.53:0/4227873236 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f28ac066350 0x7f28ac068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.992+0000 7f28baffd640 1 --2- 172.21.15.53:0/4227873236 >> [v2:172.21.15.53:6808/1927955833,v1:172.21.15.53:6809/1927955833] conn(0x7f28ac06ec00 0x7f28ac071010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.992+0000 7ff02b7fe640 1 -- 172.21.15.53:0/3343098679 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff03c0839a0 con 0x7ff04416c830 2023-06-10T18:52:55.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.992+0000 7ff02b7fe640 1 --2- 172.21.15.53:0/3343098679 >> [v2:172.21.15.117:6816/4204353710,v1:172.21.15.117:6817/4204353710] conn(0x7ff03006eab0 0x7ff030070ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.992+0000 7fc166ffd640 1 -- 172.21.15.53:0/2417684783 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc16c00c9d0 con 0x7fc1680e1440 2023-06-10T18:52:55.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.992+0000 7fc166ffd640 1 -- 172.21.15.53:0/2417684783 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16c0015f0 con 0x7fc1680e1440 2023-06-10T18:52:55.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.992+0000 7fc166ffd640 1 -- 172.21.15.53:0/2417684783 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc16c00cd80 con 0x7fc1680e1440 2023-06-10T18:52:55.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.992+0000 7ff02b7fe640 1 -- 172.21.15.53:0/3343098679 --> [v2:172.21.15.117:6816/4204353710,v1:172.21.15.117:6817/4204353710] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff030071570 con 0x7ff03006eab0 2023-06-10T18:52:55.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.992+0000 7ff02b7fe640 1 -- 172.21.15.53:0/3343098679 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff03c0882c0 con 0x7ff04416c830 2023-06-10T18:52:55.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.992+0000 7ff042ffd640 1 --2- 172.21.15.53:0/3343098679 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff030066280 0x7ff030068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.992+0000 7fc166ffd640 1 --2- 172.21.15.53:0/2417684783 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc154066330 0x7fc1540687e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.992+0000 7fc166ffd640 1 -- 172.21.15.53:0/2417684783 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc16c084720 con 0x7fc1680e1440 2023-06-10T18:52:55.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.992+0000 7fc166ffd640 1 --2- 172.21.15.53:0/2417684783 >> [v2:172.21.15.117:6800/2391250751,v1:172.21.15.117:6801/2391250751] conn(0x7fc15406ebe0 0x7fc154070ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.992+0000 7fb3bb7fe640 1 --2- 172.21.15.53:0/2559631586 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3bc0c1230 0x7fb3bc070150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.992+0000 7fc166ffd640 1 -- 172.21.15.53:0/2417684783 --> [v2:172.21.15.117:6800/2391250751,v1:172.21.15.117:6801/2391250751] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc1540716a0 con 0x7fc15406ebe0 2023-06-10T18:52:55.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.992+0000 7fc166ffd640 1 -- 172.21.15.53:0/2417684783 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc16c084a80 con 0x7fc1680e1440 2023-06-10T18:52:55.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.992+0000 7f4341d9b640 1 --2- 172.21.15.53:0/3462337002 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4324066350 0x7f4324068800 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f433c0ab000 tx=0x7f433c0a5f90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:55.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.992+0000 7fb3bbfff640 1 -- 172.21.15.53:0/2559631586 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3bc0c1230 msgr2=0x7fb3bc070150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.992+0000 7fb3bbfff640 1 --2- 172.21.15.53:0/2559631586 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3bc0c1230 0x7fb3bc070150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.992+0000 7fb3bbfff640 1 -- 172.21.15.53:0/2559631586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3bc163b60 msgr2=0x7fb3bc15c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.992+0000 7fb3bbfff640 1 --2- 172.21.15.53:0/2559631586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3bc163b60 0x7fb3bc15c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.992+0000 7fb3bbfff640 1 -- 172.21.15.53:0/2559631586 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3ac0094d0 con 0x7fb3bc15c670 2023-06-10T18:52:55.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.992+0000 7f4332ffd640 1 -- 172.21.15.53:0/3462337002 <== osd.0 v2:172.21.15.53:6816/1931565522 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f43240716c0 con 0x7f432406ec00 2023-06-10T18:52:55.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.992+0000 7ff1ff7fe640 1 -- 172.21.15.53:0/1171033652 <== osd.4 v2:172.21.15.117:6824/86798558 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7ff2040715f0 con 0x7ff20406eb30 2023-06-10T18:52:55.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.992+0000 7ff042ffd640 1 --2- 172.21.15.53:0/3343098679 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff030066280 0x7ff030068730 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff0340af000 tx=0x7ff0340a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:55.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.992+0000 7fc176026640 1 --2- 172.21.15.53:0/2417684783 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc154066330 0x7fc1540687e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.992+0000 7fc176827640 1 --2- 172.21.15.53:0/2417684783 >> [v2:172.21.15.117:6800/2391250751,v1:172.21.15.117:6801/2391250751] conn(0x7fc15406ebe0 0x7fc154070ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.992+0000 7f28baffd640 1 -- 172.21.15.53:0/4227873236 --> [v2:172.21.15.53:6808/1927955833,v1:172.21.15.53:6809/1927955833] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f28ac0716c0 con 0x7f28ac06ec00 2023-06-10T18:52:55.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.992+0000 7f28baffd640 1 -- 172.21.15.53:0/4227873236 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f28c40847f0 con 0x7f28cc0ca380 2023-06-10T18:52:55.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.992+0000 7f28cad9d640 1 --2- 172.21.15.53:0/4227873236 >> [v2:172.21.15.53:6808/1927955833,v1:172.21.15.53:6809/1927955833] conn(0x7f28ac06ec00 0x7f28ac071010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.992+0000 7f28cad9d640 1 --2- 172.21.15.53:0/4227873236 >> [v2:172.21.15.53:6808/1927955833,v1:172.21.15.53:6809/1927955833] conn(0x7f28ac06ec00 0x7f28ac071010 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:55.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.992+0000 7f28ca59c640 1 --2- 172.21.15.53:0/4227873236 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f28ac066350 0x7f28ac068800 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f28bc004e30 tx=0x7f28bc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:55.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.992+0000 7fb3bbfff640 1 --2- 172.21.15.53:0/2559631586 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3bc15c670 0x7fb3bc2007c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb3b400efc0 tx=0x7fb3b400c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:55.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.992+0000 7fb3b8ff9640 1 -- 172.21.15.53:0/2559631586 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b4014480 con 0x7fb3bc15c670 2023-06-10T18:52:55.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.992+0000 7fb3c1e1c640 1 -- 172.21.15.53:0/2559631586 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3bc06f390 con 0x7fb3bc15c670 2023-06-10T18:52:55.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.992+0000 7fb3c1e1c640 1 -- 172.21.15.53:0/2559631586 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3bc06f950 con 0x7fb3bc15c670 2023-06-10T18:52:55.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.992+0000 7fb3b8ff9640 1 -- 172.21.15.53:0/2559631586 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3b400f040 con 0x7fb3bc15c670 2023-06-10T18:52:55.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.992+0000 7fb3b8ff9640 1 -- 172.21.15.53:0/2559631586 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b4014820 con 0x7fb3bc15c670 2023-06-10T18:52:55.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.996+0000 7fb3b1ffb640 1 -- 172.21.15.53:0/2559631586 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb394000fd0 con 0x7fb3bc15c670 2023-06-10T18:52:55.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.992+0000 7fc176827640 1 --2- 172.21.15.53:0/2417684783 >> [v2:172.21.15.117:6800/2391250751,v1:172.21.15.117:6801/2391250751] conn(0x7fc15406ebe0 0x7fc154070ff0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:55.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.992+0000 7fc176026640 1 --2- 172.21.15.53:0/2417684783 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc154066330 0x7fc1540687e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc15c0056d0 tx=0x7fc170123040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:55.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.996+0000 7fc166ffd640 1 -- 172.21.15.53:0/2417684783 <== osd.6 v2:172.21.15.117:6800/2391250751 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fc1540716a0 con 0x7fc15406ebe0 2023-06-10T18:52:55.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.992+0000 7ff0427fc640 1 --2- 172.21.15.53:0/3343098679 >> [v2:172.21.15.117:6816/4204353710,v1:172.21.15.117:6817/4204353710] conn(0x7ff03006eab0 0x7ff030070ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.996+0000 7ff0427fc640 1 --2- 172.21.15.53:0/3343098679 >> [v2:172.21.15.117:6816/4204353710,v1:172.21.15.117:6817/4204353710] conn(0x7ff03006eab0 0x7ff030070ec0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:55.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.996+0000 7ff02b7fe640 1 -- 172.21.15.53:0/3343098679 <== osd.7 v2:172.21.15.117:6816/4204353710 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7ff030071570 con 0x7ff03006eab0 2023-06-10T18:52:55.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.996+0000 7f28baffd640 1 -- 172.21.15.53:0/4227873236 <== osd.1 v2:172.21.15.53:6808/1927955833 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f28ac0716c0 con 0x7f28ac06ec00 2023-06-10T18:52:55.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.996+0000 7fb3b8ff9640 1 -- 172.21.15.53:0/2559631586 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb3b4014980 con 0x7fb3bc15c670 2023-06-10T18:52:55.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.996+0000 7fb3b8ff9640 1 --2- 172.21.15.53:0/2559631586 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb39c0662b0 0x7fb39c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.996+0000 7fb3b8ff9640 1 -- 172.21.15.53:0/2559631586 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb3b4085540 con 0x7fb3bc15c670 2023-06-10T18:52:55.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.996+0000 7fb3b8ff9640 1 --2- 172.21.15.53:0/2559631586 >> [v2:172.21.15.53:6824/1444622980,v1:172.21.15.53:6825/1444622980] conn(0x7fb39c06eb60 0x7fb39c070f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.996+0000 7fb3b8ff9640 1 -- 172.21.15.53:0/2559631586 --> [v2:172.21.15.53:6824/1444622980,v1:172.21.15.53:6825/1444622980] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb39c071620 con 0x7fb39c06eb60 2023-06-10T18:52:55.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.996+0000 7fb3b8ff9640 1 -- 172.21.15.53:0/2559631586 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb3b40858f0 con 0x7fb3bc15c670 2023-06-10T18:52:55.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:54.996+0000 7fb3b3fff640 1 --2- 172.21.15.53:0/2559631586 >> [v2:172.21.15.53:6824/1444622980,v1:172.21.15.53:6825/1444622980] conn(0x7fb39c06eb60 0x7fb39c070f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.000+0000 7fb3bb7fe640 1 --2- 172.21.15.53:0/2559631586 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb39c0662b0 0x7fb39c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.000+0000 7fb3b3fff640 1 --2- 172.21.15.53:0/2559631586 >> [v2:172.21.15.53:6824/1444622980,v1:172.21.15.53:6825/1444622980] conn(0x7fb39c06eb60 0x7fb39c070f70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:55.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.000+0000 7fb3bb7fe640 1 --2- 172.21.15.53:0/2559631586 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb39c0662b0 0x7fb39c068760 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac0ae000 tx=0x7fb3ac008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:55.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.000+0000 7fb3b8ff9640 1 -- 172.21.15.53:0/2559631586 <== osd.3 v2:172.21.15.53:6824/1444622980 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fb39c071620 con 0x7fb39c06eb60 2023-06-10T18:52:55.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.008+0000 7ff21d4af640 1 -- 172.21.15.53:0/1171033652 --> [v2:172.21.15.117:6824/86798558,v1:172.21.15.117:6825/86798558] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff218069450 con 0x7ff20406eb30 2023-06-10T18:52:55.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.008+0000 7ff1ff7fe640 1 -- 172.21.15.53:0/1171033652 <== osd.4 v2:172.21.15.117:6824/86798558 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff20c0ab660 con 0x7ff20406eb30 2023-06-10T18:52:55.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.008+0000 7ff21d4af640 1 -- 172.21.15.53:0/1171033652 >> [v2:172.21.15.117:6824/86798558,v1:172.21.15.117:6825/86798558] conn(0x7ff20406eb30 msgr2=0x7ff204070f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.008+0000 7ff21d4af640 1 --2- 172.21.15.53:0/1171033652 >> [v2:172.21.15.117:6824/86798558,v1:172.21.15.117:6825/86798558] conn(0x7ff20406eb30 0x7ff204070f40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.008+0000 7ff21d4af640 1 -- 172.21.15.53:0/1171033652 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff204066280 msgr2=0x7ff204068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.008+0000 7ff21d4af640 1 --2- 172.21.15.53:0/1171033652 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff204066280 0x7ff204068730 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff218204710 tx=0x7ff208009190 comp rx=0 tx=0).stop 2023-06-10T18:52:55.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.008+0000 7ff21d4af640 1 -- 172.21.15.53:0/1171033652 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2180ca3a0 msgr2=0x7ff218200a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.008+0000 7ff21d4af640 1 --2- 172.21.15.53:0/1171033652 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2180ca3a0 0x7ff218200a00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff21000cbb0 tx=0x7ff21000a430 comp rx=0 tx=0).stop 2023-06-10T18:52:55.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.008+0000 7ff2177fe640 1 -- 172.21.15.53:0/1171033652 reap_dead start 2023-06-10T18:52:55.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.008+0000 7ff21d4af640 1 -- 172.21.15.53:0/1171033652 shutdown_connections 2023-06-10T18:52:55.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.008+0000 7ff21d4af640 1 -- 172.21.15.53:0/1171033652 >> 172.21.15.53:0/1171033652 conn(0x7ff2180b00a0 msgr2=0x7ff2180b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:55.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.008+0000 7ff21d4af640 1 -- 172.21.15.53:0/1171033652 shutdown_connections 2023-06-10T18:52:55.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.008+0000 7ff21d4af640 1 -- 172.21.15.53:0/1171033652 wait complete. 2023-06-10T18:52:55.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.016+0000 7f434359e640 1 -- 172.21.15.53:0/3462337002 --> [v2:172.21.15.53:6816/1931565522,v1:172.21.15.53:6817/1931565522] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4344070f80 con 0x7f432406ec00 2023-06-10T18:52:55.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.016+0000 7f4332ffd640 1 -- 172.21.15.53:0/3462337002 <== osd.0 v2:172.21.15.53:6816/1931565522 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f433800c040 con 0x7f432406ec00 2023-06-10T18:52:55.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.016+0000 7f434359e640 1 -- 172.21.15.53:0/3462337002 >> [v2:172.21.15.53:6816/1931565522,v1:172.21.15.53:6817/1931565522] conn(0x7f432406ec00 msgr2=0x7f4324071010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.016+0000 7f434359e640 1 --2- 172.21.15.53:0/3462337002 >> [v2:172.21.15.53:6816/1931565522,v1:172.21.15.53:6817/1931565522] conn(0x7f432406ec00 0x7f4324071010 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.016+0000 7f434359e640 1 -- 172.21.15.53:0/3462337002 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4324066350 msgr2=0x7f4324068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.016+0000 7f434359e640 1 --2- 172.21.15.53:0/3462337002 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4324066350 0x7f4324068800 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f433c0ab000 tx=0x7f433c0a5f90 comp rx=0 tx=0).stop 2023-06-10T18:52:55.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.016+0000 7f434359e640 1 -- 172.21.15.53:0/3462337002 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f434414e5e0 msgr2=0x7f434415c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.016+0000 7f434359e640 1 --2- 172.21.15.53:0/3462337002 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f434414e5e0 0x7f434415c890 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f43440c2070 tx=0x7f433400f600 comp rx=0 tx=0).stop 2023-06-10T18:52:55.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.016+0000 7f4342d9d640 1 -- 172.21.15.53:0/3462337002 reap_dead start 2023-06-10T18:52:55.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.016+0000 7f434359e640 1 -- 172.21.15.53:0/3462337002 shutdown_connections 2023-06-10T18:52:55.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.016+0000 7f434359e640 1 -- 172.21.15.53:0/3462337002 >> 172.21.15.53:0/3462337002 conn(0x7f43440cb600 msgr2=0x7f434406ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:55.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.016+0000 7f434359e640 1 -- 172.21.15.53:0/3462337002 shutdown_connections 2023-06-10T18:52:55.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.016+0000 7f434359e640 1 -- 172.21.15.53:0/3462337002 wait complete. 2023-06-10T18:52:55.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.020+0000 7f0894b53640 1 -- 172.21.15.53:0/2678087252 --> [v2:172.21.15.117:6808/1805352380,v1:172.21.15.117:6809/1805352380] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f08900c4260 con 0x7f087006ec00 2023-06-10T18:52:55.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.020+0000 7f087effd640 1 -- 172.21.15.53:0/2678087252 <== osd.5 v2:172.21.15.117:6808/1805352380 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f08800ab460 con 0x7f087006ec00 2023-06-10T18:52:55.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.024+0000 7f0894b53640 1 -- 172.21.15.53:0/2678087252 >> [v2:172.21.15.117:6808/1805352380,v1:172.21.15.117:6809/1805352380] conn(0x7f087006ec00 msgr2=0x7f0870071010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.024+0000 7f0894b53640 1 --2- 172.21.15.53:0/2678087252 >> [v2:172.21.15.117:6808/1805352380,v1:172.21.15.117:6809/1805352380] conn(0x7f087006ec00 0x7f0870071010 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.024+0000 7fd940b10640 1 -- 172.21.15.53:0/507421006 --> [v2:172.21.15.53:6800/3437315773,v1:172.21.15.53:6801/3437315773] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd93c04dfe0 con 0x7fd91c06eb00 2023-06-10T18:52:55.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.024+0000 7f0894b53640 1 -- 172.21.15.53:0/2678087252 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0870066350 msgr2=0x7f0870068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.024+0000 7f0894b53640 1 --2- 172.21.15.53:0/2678087252 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0870066350 0x7f0870068800 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0888001cc0 tx=0x7f0888007d70 comp rx=0 tx=0).stop 2023-06-10T18:52:55.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.024+0000 7f0894b53640 1 -- 172.21.15.53:0/2678087252 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f089015fc50 msgr2=0x7f08900b3640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.024+0000 7f0894b53640 1 --2- 172.21.15.53:0/2678087252 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f089015fc50 0x7f08900b3640 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f088400c500 tx=0x7f088400c9c0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.024+0000 7f088ed9d640 1 -- 172.21.15.53:0/2678087252 reap_dead start 2023-06-10T18:52:55.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.024+0000 7f0894b53640 1 -- 172.21.15.53:0/2678087252 shutdown_connections 2023-06-10T18:52:55.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.024+0000 7f0894b53640 1 -- 172.21.15.53:0/2678087252 >> 172.21.15.53:0/2678087252 conn(0x7f08900ce9e0 msgr2=0x7f08900ae6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:55.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.024+0000 7f0894b53640 1 -- 172.21.15.53:0/2678087252 shutdown_connections 2023-06-10T18:52:55.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.024+0000 7fd92affd640 1 -- 172.21.15.53:0/507421006 <== osd.2 v2:172.21.15.53:6800/3437315773 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd93c04dfe0 con 0x7fd91c06eb00 2023-06-10T18:52:55.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.024+0000 7f0894b53640 1 -- 172.21.15.53:0/2678087252 wait complete. 2023-06-10T18:52:55.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.024+0000 7fc17828a640 1 -- 172.21.15.53:0/2417684783 --> [v2:172.21.15.117:6800/2391250751,v1:172.21.15.117:6801/2391250751] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc16804f3b0 con 0x7fc15406ebe0 2023-06-10T18:52:55.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.028+0000 7fc166ffd640 1 -- 172.21.15.53:0/2417684783 <== osd.6 v2:172.21.15.117:6800/2391250751 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc160009a20 con 0x7fc15406ebe0 2023-06-10T18:52:55.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.028+0000 7f28d08ab640 1 -- 172.21.15.53:0/4227873236 --> [v2:172.21.15.53:6808/1927955833,v1:172.21.15.53:6809/1927955833] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f28cc163000 con 0x7f28ac06ec00 2023-06-10T18:52:55.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.028+0000 7fc17828a640 1 -- 172.21.15.53:0/2417684783 >> [v2:172.21.15.117:6800/2391250751,v1:172.21.15.117:6801/2391250751] conn(0x7fc15406ebe0 msgr2=0x7fc154070ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.028+0000 7fc17828a640 1 --2- 172.21.15.53:0/2417684783 >> [v2:172.21.15.117:6800/2391250751,v1:172.21.15.117:6801/2391250751] conn(0x7fc15406ebe0 0x7fc154070ff0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.028+0000 7fc17828a640 1 -- 172.21.15.53:0/2417684783 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc154066330 msgr2=0x7fc1540687e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.028+0000 7fc17828a640 1 --2- 172.21.15.53:0/2417684783 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc154066330 0x7fc1540687e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc15c0056d0 tx=0x7fc170123040 comp rx=0 tx=0).stop 2023-06-10T18:52:55.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.028+0000 7fc17828a640 1 -- 172.21.15.53:0/2417684783 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1680e1440 msgr2=0x7fc16804e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.028+0000 7fc17828a640 1 --2- 172.21.15.53:0/2417684783 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1680e1440 0x7fc16804e700 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc16c00e800 tx=0x7fc16c00ecc0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.028+0000 7fc176827640 1 -- 172.21.15.53:0/2417684783 reap_dead start 2023-06-10T18:52:55.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.028+0000 7fc17828a640 1 -- 172.21.15.53:0/2417684783 shutdown_connections 2023-06-10T18:52:55.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.028+0000 7fc17828a640 1 -- 172.21.15.53:0/2417684783 >> 172.21.15.53:0/2417684783 conn(0x7fc1680516d0 msgr2=0x7fc168051ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:55.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.028+0000 7fc17828a640 1 -- 172.21.15.53:0/2417684783 shutdown_connections 2023-06-10T18:52:55.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.028+0000 7fc17828a640 1 -- 172.21.15.53:0/2417684783 wait complete. 2023-06-10T18:52:55.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.028+0000 7fd940b10640 1 -- 172.21.15.53:0/507421006 >> [v2:172.21.15.53:6800/3437315773,v1:172.21.15.53:6801/3437315773] conn(0x7fd91c06eb00 msgr2=0x7fd91c070f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.028+0000 7fd940b10640 1 --2- 172.21.15.53:0/507421006 >> [v2:172.21.15.53:6800/3437315773,v1:172.21.15.53:6801/3437315773] conn(0x7fd91c06eb00 0x7fd91c070f10 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.028+0000 7f28baffd640 1 -- 172.21.15.53:0/4227873236 <== osd.1 v2:172.21.15.53:6808/1927955833 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f28cc163000 con 0x7f28ac06ec00 2023-06-10T18:52:55.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.028+0000 7fd940b10640 1 -- 172.21.15.53:0/507421006 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd91c0662d0 msgr2=0x7fd91c068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.028+0000 7fd940b10640 1 --2- 172.21.15.53:0/507421006 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd91c0662d0 0x7fd91c068780 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd9340ae000 tx=0x7fd9340a7070 comp rx=0 tx=0).stop 2023-06-10T18:52:55.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.028+0000 7fd940b10640 1 -- 172.21.15.53:0/507421006 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd93c156bd0 msgr2=0x7fd93c0b2e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.028+0000 7fd940b10640 1 --2- 172.21.15.53:0/507421006 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd93c156bd0 0x7fd93c0b2e10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd92c00c390 tx=0x7fd92c00c850 comp rx=0 tx=0).stop 2023-06-10T18:52:55.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.028+0000 7fd93ad9d640 1 -- 172.21.15.53:0/507421006 reap_dead start 2023-06-10T18:52:55.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.028+0000 7fd940b10640 1 -- 172.21.15.53:0/507421006 shutdown_connections 2023-06-10T18:52:55.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.028+0000 7fd940b10640 1 -- 172.21.15.53:0/507421006 >> 172.21.15.53:0/507421006 conn(0x7fd93c06a0e0 msgr2=0x7fd93c0aee10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:55.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.028+0000 7f28d08ab640 1 -- 172.21.15.53:0/4227873236 >> [v2:172.21.15.53:6808/1927955833,v1:172.21.15.53:6809/1927955833] conn(0x7f28ac06ec00 msgr2=0x7f28ac071010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.028+0000 7f28d08ab640 1 --2- 172.21.15.53:0/4227873236 >> [v2:172.21.15.53:6808/1927955833,v1:172.21.15.53:6809/1927955833] conn(0x7f28ac06ec00 0x7f28ac071010 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.028+0000 7f28d08ab640 1 -- 172.21.15.53:0/4227873236 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f28ac066350 msgr2=0x7f28ac068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.028+0000 7f28d08ab640 1 --2- 172.21.15.53:0/4227873236 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f28ac066350 0x7f28ac068800 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f28bc004e30 tx=0x7f28bc009040 comp rx=0 tx=0).stop 2023-06-10T18:52:55.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.028+0000 7f28d08ab640 1 -- 172.21.15.53:0/4227873236 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28cc0ca380 msgr2=0x7f28cc070200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.028+0000 7f28d08ab640 1 --2- 172.21.15.53:0/4227873236 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28cc0ca380 0x7f28cc070200 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f28c400ba50 tx=0x7f28c400bf10 comp rx=0 tx=0).stop 2023-06-10T18:52:55.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.028+0000 7f28cad9d640 1 -- 172.21.15.53:0/4227873236 reap_dead start 2023-06-10T18:52:55.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.028+0000 7fd940b10640 1 -- 172.21.15.53:0/507421006 shutdown_connections 2023-06-10T18:52:55.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.028+0000 7fd940b10640 1 -- 172.21.15.53:0/507421006 wait complete. 2023-06-10T18:52:55.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.028+0000 7f28d08ab640 1 -- 172.21.15.53:0/4227873236 shutdown_connections 2023-06-10T18:52:55.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.028+0000 7f28d08ab640 1 -- 172.21.15.53:0/4227873236 >> 172.21.15.53:0/4227873236 conn(0x7f28cc069450 msgr2=0x7f28cc155860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:55.123 INFO:teuthology.orchestra.run.smithi053.stdout:55834574855 2023-06-10T18:52:55.123 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-06-10T18:52:55.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.028+0000 7f28d08ab640 1 -- 172.21.15.53:0/4227873236 shutdown_connections 2023-06-10T18:52:55.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.028+0000 7f28d08ab640 1 -- 172.21.15.53:0/4227873236 wait complete. 2023-06-10T18:52:55.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.032+0000 7ff0297fa640 1 -- 172.21.15.53:0/3343098679 --> [v2:172.21.15.117:6816/4204353710,v1:172.21.15.117:6817/4204353710] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff01c002cc0 con 0x7ff03006eab0 2023-06-10T18:52:55.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.032+0000 7ff02b7fe640 1 -- 172.21.15.53:0/3343098679 <== osd.7 v2:172.21.15.117:6816/4204353710 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff01c002cc0 con 0x7ff03006eab0 2023-06-10T18:52:55.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.032+0000 7ff0297fa640 1 -- 172.21.15.53:0/3343098679 >> [v2:172.21.15.117:6816/4204353710,v1:172.21.15.117:6817/4204353710] conn(0x7ff03006eab0 msgr2=0x7ff030070ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.032+0000 7ff0297fa640 1 --2- 172.21.15.53:0/3343098679 >> [v2:172.21.15.117:6816/4204353710,v1:172.21.15.117:6817/4204353710] conn(0x7ff03006eab0 0x7ff030070ec0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.032+0000 7ff0297fa640 1 -- 172.21.15.53:0/3343098679 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff030066280 msgr2=0x7ff030068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.032+0000 7ff0297fa640 1 --2- 172.21.15.53:0/3343098679 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff030066280 0x7ff030068730 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff0340af000 tx=0x7ff0340a7070 comp rx=0 tx=0).stop 2023-06-10T18:52:55.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.032+0000 7ff0297fa640 1 -- 172.21.15.53:0/3343098679 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff04416c830 msgr2=0x7ff0440b2930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.032+0000 7ff0297fa640 1 --2- 172.21.15.53:0/3343098679 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff04416c830 0x7ff0440b2930 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff03c00c700 tx=0x7ff03c00cbc0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.032+0000 7ff0437fe640 1 -- 172.21.15.53:0/3343098679 reap_dead start 2023-06-10T18:52:55.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.032+0000 7ff0297fa640 1 -- 172.21.15.53:0/3343098679 shutdown_connections 2023-06-10T18:52:55.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.032+0000 7ff0297fa640 1 -- 172.21.15.53:0/3343098679 >> 172.21.15.53:0/3343098679 conn(0x7ff04406a0e0 msgr2=0x7ff0440ae300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:55.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.032+0000 7ff0297fa640 1 -- 172.21.15.53:0/3343098679 shutdown_connections 2023-06-10T18:52:55.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.032+0000 7ff0297fa640 1 -- 172.21.15.53:0/3343098679 wait complete. 2023-06-10T18:52:55.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.044+0000 7fb3b1ffb640 1 -- 172.21.15.53:0/2559631586 --> [v2:172.21.15.53:6824/1444622980,v1:172.21.15.53:6825/1444622980] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb394002cc0 con 0x7fb39c06eb60 2023-06-10T18:52:55.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.044+0000 7fb3b8ff9640 1 -- 172.21.15.53:0/2559631586 <== osd.3 v2:172.21.15.53:6824/1444622980 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb394002cc0 con 0x7fb39c06eb60 2023-06-10T18:52:55.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.044+0000 7fb3b1ffb640 1 -- 172.21.15.53:0/2559631586 >> [v2:172.21.15.53:6824/1444622980,v1:172.21.15.53:6825/1444622980] conn(0x7fb39c06eb60 msgr2=0x7fb39c070f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.044+0000 7fb3b1ffb640 1 --2- 172.21.15.53:0/2559631586 >> [v2:172.21.15.53:6824/1444622980,v1:172.21.15.53:6825/1444622980] conn(0x7fb39c06eb60 0x7fb39c070f70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.044+0000 7fb3b1ffb640 1 -- 172.21.15.53:0/2559631586 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb39c0662b0 msgr2=0x7fb39c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.044+0000 7fb3b1ffb640 1 --2- 172.21.15.53:0/2559631586 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb39c0662b0 0x7fb39c068760 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac0ae000 tx=0x7fb3ac008040 comp rx=0 tx=0).stop 2023-06-10T18:52:55.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.044+0000 7fb3b1ffb640 1 -- 172.21.15.53:0/2559631586 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3bc15c670 msgr2=0x7fb3bc2007c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.044+0000 7fb3b1ffb640 1 --2- 172.21.15.53:0/2559631586 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3bc15c670 0x7fb3bc2007c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb3b400efc0 tx=0x7fb3b400c490 comp rx=0 tx=0).stop 2023-06-10T18:52:55.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.044+0000 7fb3bbfff640 1 -- 172.21.15.53:0/2559631586 reap_dead start 2023-06-10T18:52:55.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.044+0000 7fb3b1ffb640 1 -- 172.21.15.53:0/2559631586 shutdown_connections 2023-06-10T18:52:55.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.044+0000 7fb3b1ffb640 1 -- 172.21.15.53:0/2559631586 >> 172.21.15.53:0/2559631586 conn(0x7fb3bc069450 msgr2=0x7fb3bc0ca380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:55.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.044+0000 7fb3b1ffb640 1 -- 172.21.15.53:0/2559631586 shutdown_connections 2023-06-10T18:52:55.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.044+0000 7fb3b1ffb640 1 -- 172.21.15.53:0/2559631586 wait complete. 2023-06-10T18:52:55.130 INFO:teuthology.orchestra.run.smithi053.stdout:55834574856 2023-06-10T18:52:55.130 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-06-10T18:52:55.131 INFO:teuthology.orchestra.run.smithi053.stdout:55834574856 2023-06-10T18:52:55.131 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-06-10T18:52:55.132 INFO:teuthology.orchestra.run.smithi053.stdout:55834574856 2023-06-10T18:52:55.132 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-06-10T18:52:55.133 INFO:teuthology.orchestra.run.smithi053.stdout:55834574857 2023-06-10T18:52:55.133 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-06-10T18:52:55.134 INFO:teuthology.orchestra.run.smithi053.stdout:55834574855 2023-06-10T18:52:55.134 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-06-10T18:52:55.135 INFO:teuthology.orchestra.run.smithi053.stdout:55834574855 2023-06-10T18:52:55.135 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-06-10T18:52:55.136 INFO:teuthology.orchestra.run.smithi053.stdout:55834574854 2023-06-10T18:52:55.137 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-06-10T18:52:55.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.332+0000 7f4cf135a640 1 Processor -- start 2023-06-10T18:52:55.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.332+0000 7f4cf135a640 1 -- start start 2023-06-10T18:52:55.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.332+0000 7f4cf135a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4cec0cd3a0 0x7f4cec0ca1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.332+0000 7f4cf135a640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cec0c9660 con 0x7f4cec1579a0 2023-06-10T18:52:55.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.332+0000 7f4cf135a640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cec0cbdd0 con 0x7f4cec0ccf40 2023-06-10T18:52:55.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.332+0000 7f4cf135a640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cec0cc0a0 con 0x7f4cec0cd3a0 2023-06-10T18:52:55.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.336+0000 7f4ceaffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f4cec1579a0 0x7f4cec0cb6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:35992/0 (socket says 172.21.15.53:35992) 2023-06-10T18:52:55.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.336+0000 7f4ceaffd640 1 -- 172.21.15.53:0/4236608743 learned_addr learned my addr 172.21.15.53:0/4236608743 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:52:55.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.336+0000 7f4ceb7fe640 1 --2- 172.21.15.53:0/4236608743 >> v2:172.21.15.53:3300/0 conn(0x7f4cec0cd3a0 0x7f4cec0ca1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.336+0000 7f4ce9ffb640 1 -- 172.21.15.53:0/4236608743 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 5998066 0 0) 0x7f4cec0c9660 con 0x7f4cec1579a0 2023-06-10T18:52:55.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.336+0000 7f4ce9ffb640 1 -- 172.21.15.53:0/4236608743 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4cd4003530 con 0x7f4cec1579a0 2023-06-10T18:52:55.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.336+0000 7f4ce9ffb640 1 -- 172.21.15.53:0/4236608743 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1322132340 0 0) 0x7f4cec0cbdd0 con 0x7f4cec0ccf40 2023-06-10T18:52:55.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.336+0000 7f4ce9ffb640 1 -- 172.21.15.53:0/4236608743 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4cec0c9660 con 0x7f4cec0ccf40 2023-06-10T18:52:55.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.336+0000 7f4ceb7fe640 1 -- 172.21.15.53:0/4236608743 >> v1:172.21.15.117:6789/0 conn(0x7f4cec0ccf40 legacy=0x7f4cec0c9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.336+0000 7f4ce9ffb640 1 -- 172.21.15.53:0/4236608743 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 621644422 0 0) 0x7f4cd4003530 con 0x7f4cec1579a0 2023-06-10T18:52:55.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.336+0000 7f4ceb7fe640 1 -- 172.21.15.53:0/4236608743 >> v1:172.21.15.53:6789/0 conn(0x7f4cec1579a0 legacy=0x7f4cec0cb6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.336+0000 7f4ceb7fe640 1 -- 172.21.15.53:0/4236608743 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cec0cc380 con 0x7f4cec0cd3a0 2023-06-10T18:52:55.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.336+0000 7fad65cdc640 1 Processor -- start 2023-06-10T18:52:55.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.336+0000 7fad65cdc640 1 -- start start 2023-06-10T18:52:55.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.336+0000 7fad65cdc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fad6015b8e0 0x7fad6015fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.336+0000 7fad65cdc640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fad600b3910 0x7fad600b3d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.336+0000 7fad65cdc640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad601601f0 con 0x7fad600b42a0 2023-06-10T18:52:55.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.336+0000 7fad65cdc640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad600cfa60 con 0x7fad6015b8e0 2023-06-10T18:52:55.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.336+0000 7fad65cdc640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad600b4740 con 0x7fad600b3910 2023-06-10T18:52:55.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.340+0000 7fad5effd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fad600b3910 0x7fad600b3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.340+0000 7fad5effd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fad600b3910 0x7fad600b3d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.53:50566/0 (socket says 172.21.15.53:50566) 2023-06-10T18:52:55.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.340+0000 7fad5effd640 1 -- 172.21.15.53:0/4129359289 learned_addr learned my addr 172.21.15.53:0/4129359289 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:55.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.340+0000 7fad5f7fe640 1 --2- 172.21.15.53:0/4129359289 >> v2:172.21.15.53:3300/0 conn(0x7fad6015b8e0 0x7fad6015fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.340+0000 7f4ceb7fe640 1 --2- 172.21.15.53:0/4236608743 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4cec0cd3a0 0x7f4cec0ca1e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4ce00097c0 tx=0x7f4ce001eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93eaa897561ca590 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:55.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.340+0000 7fad5effd640 1 -- 172.21.15.53:0/4129359289 >> v2:172.21.15.53:3300/0 conn(0x7fad6015b8e0 msgr2=0x7fad6015fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:55.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.340+0000 7fad5effd640 1 --2- 172.21.15.53:0/4129359289 >> v2:172.21.15.53:3300/0 conn(0x7fad6015b8e0 0x7fad6015fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.340+0000 7fad5effd640 1 -- 172.21.15.53:0/4129359289 >> v1:172.21.15.117:6789/0 conn(0x7fad600b42a0 legacy=0x7fad600ce150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.340+0000 7fad5effd640 1 -- 172.21.15.53:0/4129359289 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad600cc580 con 0x7fad600b3910 2023-06-10T18:52:55.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.340+0000 7fad5f7fe640 1 --2- 172.21.15.53:0/4129359289 >> v2:172.21.15.53:3300/0 conn(0x7fad6015b8e0 0x7fad6015fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:52:55.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.340+0000 7f4ce9ffb640 1 -- 172.21.15.53:0/4236608743 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce4001a00 con 0x7f4cec0cd3a0 2023-06-10T18:52:55.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.340+0000 7f8bb1a5a640 1 Processor -- start 2023-06-10T18:52:55.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.340+0000 7f8bb1a5a640 1 -- start start 2023-06-10T18:52:55.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.340+0000 7f4ce9ffb640 1 -- 172.21.15.53:0/4236608743 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ce00a8610 con 0x7f4cec0cd3a0 2023-06-10T18:52:55.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.340+0000 7f4ce9ffb640 1 -- 172.21.15.53:0/4236608743 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce4001a00 con 0x7f4cec0cd3a0 2023-06-10T18:52:55.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.340+0000 7f8bb1a5a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8bac0cd000 0x7f8bac0cd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.340+0000 7f8bb1a5a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8bac0af7d0 0x7f8bac0afc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.340+0000 7f4cf135a640 1 -- 172.21.15.53:0/4236608743 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4cec0cd3a0 msgr2=0x7f4cec0ca1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.340+0000 7f4cf135a640 1 --2- 172.21.15.53:0/4236608743 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4cec0cd3a0 0x7f4cec0ca1e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4ce00097c0 tx=0x7f4ce001eb90 comp rx=0 tx=0).stop 2023-06-10T18:52:55.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.340+0000 7f7449962640 1 Processor -- start 2023-06-10T18:52:55.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.340+0000 7f4cf135a640 1 -- 172.21.15.53:0/4236608743 shutdown_connections 2023-06-10T18:52:55.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.340+0000 7f4cf135a640 1 --2- 172.21.15.53:0/4236608743 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4cec0cd3a0 0x7f4cec0ca1e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.340+0000 7f4cf135a640 1 -- 172.21.15.53:0/4236608743 >> 172.21.15.53:0/4236608743 conn(0x7f4cec06a0e0 msgr2=0x7f4cec0af620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:55.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.340+0000 7f8ba3fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8bac0af7d0 0x7f8bac0afc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.340+0000 7f8ba3fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8bac0af7d0 0x7f8bac0afc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35124/0 (socket says 172.21.15.53:35124) 2023-06-10T18:52:55.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.340+0000 7f0a3e54f640 1 Processor -- start 2023-06-10T18:52:55.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.340+0000 7f0a3e54f640 1 -- start start 2023-06-10T18:52:55.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.344+0000 7f0a3e54f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0a30036db0 0x7f0a300e2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.344+0000 7f0a3e54f640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0a300527f0 0x7f0a30052d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.344+0000 7f0a3e54f640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a30033c00 con 0x7f0a300e1ec0 2023-06-10T18:52:55.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.344+0000 7f0a3e54f640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a300e2ac0 con 0x7f0a30036db0 2023-06-10T18:52:55.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.344+0000 7f0a3e54f640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a30033920 con 0x7f0a300527f0 2023-06-10T18:52:55.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.340+0000 7f353f858640 1 Processor -- start 2023-06-10T18:52:55.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.340+0000 7f353f858640 1 -- start start 2023-06-10T18:52:55.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.344+0000 7f353f858640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35300df710 0x7f35300525c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.344+0000 7f353f858640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f353000d180 0x7f3530052b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.344+0000 7f353f858640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f353000ccf0 con 0x7f35300e3100 2023-06-10T18:52:55.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.344+0000 7f353f858640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35300e4080 con 0x7f353000d180 2023-06-10T18:52:55.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.344+0000 7f353f858640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f353000c400 con 0x7f35300df710 2023-06-10T18:52:55.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.340+0000 7fad5effd640 1 --2- 172.21.15.53:0/4129359289 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad600b3910 0x7fad600b3d60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fad600b4990 tx=0x7fad5801c9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7716376acafc0d2 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:55.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.344+0000 7fad5e7fc640 1 -- 172.21.15.53:0/4129359289 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad580a5860 con 0x7fad600b3910 2023-06-10T18:52:55.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.344+0000 7fad5e7fc640 1 -- 172.21.15.53:0/4129359289 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad580a59c0 con 0x7fad600b3910 2023-06-10T18:52:55.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.344+0000 7fad5e7fc640 1 -- 172.21.15.53:0/4129359289 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad580a5d50 con 0x7fad600b3910 2023-06-10T18:52:55.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.340+0000 7f4cf135a640 1 -- 172.21.15.53:0/4236608743 shutdown_connections 2023-06-10T18:52:55.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.340+0000 7f4cf135a640 1 -- 172.21.15.53:0/4236608743 wait complete. 2023-06-10T18:52:55.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.340+0000 7f7449962640 1 -- start start 2023-06-10T18:52:55.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.344+0000 7f7449962640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7444157a80 0x7f74440ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.344+0000 7f7449962640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f744415b410 con 0x7f74440cac00 2023-06-10T18:52:55.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.344+0000 7f7449962640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f744415b940 con 0x7f74440cd2e0 2023-06-10T18:52:55.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.344+0000 7f7449962640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74440cd780 con 0x7f7444157a80 2023-06-10T18:52:55.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.340+0000 7fcedb12e640 1 Processor -- start 2023-06-10T18:52:55.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.340+0000 7fcedb12e640 1 -- start start 2023-06-10T18:52:55.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.340+0000 7fcedb12e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcecc0e6d80 0x7fcecc04f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.340+0000 7fcedb12e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fcecc0eade0 0x7fcecc0eb260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.340+0000 7fcedb12e640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcecc0ea950 con 0x7fcecc04f7b0 2023-06-10T18:52:55.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.340+0000 7fcedb12e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcecc0e7150 con 0x7fcecc0eade0 2023-06-10T18:52:55.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.340+0000 7fcedb12e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcecc054a60 con 0x7fcecc0e6d80 2023-06-10T18:52:55.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.340+0000 7fceda92d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fcecc0eade0 0x7fcecc0eb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.340+0000 7fceda92d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fcecc0eade0 0x7fcecc0eb260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.53:50588/0 (socket says 172.21.15.53:50588) 2023-06-10T18:52:55.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.340+0000 7fceda92d640 1 -- 172.21.15.53:0/189329905 learned_addr learned my addr 172.21.15.53:0/189329905 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:55.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.340+0000 7fceda12c640 1 --2- 172.21.15.53:0/189329905 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcecc0e6d80 0x7fcecc04f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.344+0000 7fceda12c640 1 -- 172.21.15.53:0/189329905 >> v2:172.21.15.117:3300/0 conn(0x7fcecc0eade0 msgr2=0x7fcecc0eb260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:55.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.344+0000 7fceda12c640 1 --2- 172.21.15.53:0/189329905 >> v2:172.21.15.117:3300/0 conn(0x7fcecc0eade0 0x7fcecc0eb260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.344+0000 7fceda12c640 1 -- 172.21.15.53:0/189329905 >> v1:172.21.15.53:6789/0 conn(0x7fcecc04f7b0 legacy=0x7fcecc0527f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.344+0000 7fceda12c640 1 -- 172.21.15.53:0/189329905 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcecc0541c0 con 0x7fcecc0e6d80 2023-06-10T18:52:55.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.344+0000 7f7449161640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f74440cd2e0 0x7f74440c9590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.53:47668/0 (socket says 172.21.15.53:47668) 2023-06-10T18:52:55.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.344+0000 7f7449161640 1 -- 172.21.15.53:0/3028333656 learned_addr learned my addr 172.21.15.53:0/3028333656 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:52:55.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.344+0000 7f4cf135a640 1 Processor -- start 2023-06-10T18:52:55.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.344+0000 7f353cdf3640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f353000d180 0x7f3530052b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.344+0000 7fad65cdc640 1 -- 172.21.15.53:0/4129359289 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad600b3910 msgr2=0x7fad600b3d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.344+0000 7fad65cdc640 1 --2- 172.21.15.53:0/4129359289 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad600b3910 0x7fad600b3d60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fad600b4990 tx=0x7fad5801c9e0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.344+0000 7f4cf135a640 1 -- start start 2023-06-10T18:52:55.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.344+0000 7f353ddf5640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f35300e3100 0x7f35300e3580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:36024/0 (socket says 172.21.15.53:36024) 2023-06-10T18:52:55.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.344+0000 7f353ddf5640 1 -- 172.21.15.53:0/290578558 learned_addr learned my addr 172.21.15.53:0/290578558 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:52:55.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.344+0000 7f353cdf3640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f353000d180 0x7f3530052b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.53:50592/0 (socket says 172.21.15.53:50592) 2023-06-10T18:52:55.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.344+0000 7f353d5f4640 1 --2- 172.21.15.53:0/290578558 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35300df710 0x7f35300525c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.344+0000 7f8baaffd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8bac0cd000 0x7f8bac0cd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.344+0000 7f8baaffd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8bac0cd000 0x7f8bac0cd3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.53:50582/0 (socket says 172.21.15.53:50582) 2023-06-10T18:52:55.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.344+0000 7f8bb1a5a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8bac089770 0x7f8bac06a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.344+0000 7f8bb1a5a640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bac0cd910 con 0x7f8bac0af7d0 2023-06-10T18:52:55.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.344+0000 7f8bb1a5a640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bac0b0160 con 0x7f8bac0cd000 2023-06-10T18:52:55.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.344+0000 7f8bb1a5a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bac16c9f0 con 0x7f8bac089770 2023-06-10T18:52:55.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.344+0000 7f7443fff640 1 --2- 172.21.15.53:0/3028333656 >> v2:172.21.15.53:3300/0 conn(0x7f7444157a80 0x7f74440ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.344+0000 7f0a3cd4c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0a30036db0 0x7f0a300e2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.344+0000 7f0a3cd4c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0a30036db0 0x7f0a300e2ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35140/0 (socket says 172.21.15.53:35140) 2023-06-10T18:52:55.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.344+0000 7f0a3cd4c640 1 -- 172.21.15.53:0/103092082 learned_addr learned my addr 172.21.15.53:0/103092082 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:55.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.344+0000 7f0a3dd4e640 1 --2- 172.21.15.53:0/103092082 >> v2:172.21.15.117:3300/0 conn(0x7f0a300527f0 0x7f0a30052d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.344+0000 7f8ba3fff640 1 -- 172.21.15.53:0/499228059 learned_addr learned my addr 172.21.15.53:0/499228059 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:55.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.344+0000 7f8bab7fe640 1 --2- 172.21.15.53:0/499228059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8bac089770 0x7f8bac06a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.344+0000 7f74437fe640 1 -- 172.21.15.53:0/3028333656 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2652994054 0 0) 0x7f744415b410 con 0x7f74440cac00 2023-06-10T18:52:55.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.344+0000 7f74437fe640 1 -- 172.21.15.53:0/3028333656 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7434003530 con 0x7f74440cac00 2023-06-10T18:52:55.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.344+0000 7f74437fe640 1 -- 172.21.15.53:0/3028333656 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 216359029 0 0) 0x7f744415b940 con 0x7f74440cd2e0 2023-06-10T18:52:55.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.344+0000 7f74437fe640 1 -- 172.21.15.53:0/3028333656 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f744415b410 con 0x7f74440cd2e0 2023-06-10T18:52:55.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.344+0000 7f353cdf3640 1 -- 172.21.15.53:0/290578558 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35300df710 msgr2=0x7f35300525c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:55.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.344+0000 7f7443fff640 1 -- 172.21.15.53:0/3028333656 >> v1:172.21.15.117:6789/0 conn(0x7f74440cd2e0 legacy=0x7f74440c9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.344+0000 7f353cdf3640 1 --2- 172.21.15.53:0/290578558 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35300df710 0x7f35300525c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.344+0000 7f7443fff640 1 -- 172.21.15.53:0/3028333656 >> v1:172.21.15.53:6789/0 conn(0x7f74440cac00 legacy=0x7f74440acaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.344+0000 7f353cdf3640 1 -- 172.21.15.53:0/290578558 >> v1:172.21.15.53:6789/0 conn(0x7f35300e3100 legacy=0x7f35300e3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.344+0000 7f4cf135a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4cec0ccf40 0x7f4cec0c55d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.344+0000 7f7443fff640 1 -- 172.21.15.53:0/3028333656 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f744415e730 con 0x7f7444157a80 2023-06-10T18:52:55.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.344+0000 7f353cdf3640 1 -- 172.21.15.53:0/290578558 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35300e3da0 con 0x7f353000d180 2023-06-10T18:52:55.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.344+0000 7f8baaffd640 1 -- 172.21.15.53:0/499228059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8bac089770 msgr2=0x7f8bac06a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:55.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.344+0000 7f8baaffd640 1 --2- 172.21.15.53:0/499228059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8bac089770 0x7f8bac06a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.344+0000 7f8baaffd640 1 -- 172.21.15.53:0/499228059 >> v2:172.21.15.53:3300/0 conn(0x7f8bac0af7d0 msgr2=0x7f8bac0afc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:55.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.344+0000 7f8baaffd640 1 --2- 172.21.15.53:0/499228059 >> v2:172.21.15.53:3300/0 conn(0x7f8bac0af7d0 0x7f8bac0afc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.344+0000 7f8baaffd640 1 -- 172.21.15.53:0/499228059 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bac16c0c0 con 0x7f8bac0cd000 2023-06-10T18:52:55.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.344+0000 7f4ceaffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4cec0ccf40 0x7f4cec0c55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.344+0000 7f4ceaffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4cec0ccf40 0x7f4cec0c55d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35172/0 (socket says 172.21.15.53:35172) 2023-06-10T18:52:55.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.344+0000 7f4ceaffd640 1 -- 172.21.15.53:0/4154800800 learned_addr learned my addr 172.21.15.53:0/4154800800 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:55.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.344+0000 7f4cf135a640 1 --2- 172.21.15.53:0/4154800800 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4cec0cd3a0 0x7f4cec1fd290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.344+0000 7f4cf135a640 1 --2- 172.21.15.53:0/4154800800 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4cec0c7410 0x7f4cec0b2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.344+0000 7f4cf135a640 1 -- 172.21.15.53:0/4154800800 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cec0c5db0 con 0x7f4cec0ccf40 2023-06-10T18:52:55.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.344+0000 7f4cf135a640 1 -- 172.21.15.53:0/4154800800 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cec1541a0 con 0x7f4cec0c7410 2023-06-10T18:52:55.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.344+0000 7f4cf135a640 1 -- 172.21.15.53:0/4154800800 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cec0c5b10 con 0x7f4cec0cd3a0 2023-06-10T18:52:55.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.344+0000 7fad65cdc640 1 -- 172.21.15.53:0/4129359289 shutdown_connections 2023-06-10T18:52:55.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.344+0000 7fad65cdc640 1 --2- 172.21.15.53:0/4129359289 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad600b3910 0x7fad600b3d60 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.344+0000 7fad65cdc640 1 --2- 172.21.15.53:0/4129359289 >> v2:172.21.15.53:3300/0 conn(0x7fad6015b8e0 0x7fad6015fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.344+0000 7fad65cdc640 1 -- 172.21.15.53:0/4129359289 >> 172.21.15.53:0/4129359289 conn(0x7fad600717d0 msgr2=0x7fad60069bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:55.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.344+0000 7fad65cdc640 1 -- 172.21.15.53:0/4129359289 shutdown_connections 2023-06-10T18:52:55.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.348+0000 7fad65cdc640 1 -- 172.21.15.53:0/4129359289 wait complete. 2023-06-10T18:52:55.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.344+0000 7f4ceb7fe640 1 --2- 172.21.15.53:0/4154800800 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4cec0c7410 0x7f4cec0b2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.344+0000 7f4cea7fc640 1 --2- 172.21.15.53:0/4154800800 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4cec0cd3a0 0x7f4cec1fd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.348+0000 7f4ceaffd640 1 -- 172.21.15.53:0/4154800800 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4cec0cd3a0 msgr2=0x7f4cec1fd290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.348+0000 7f4ceaffd640 1 --2- 172.21.15.53:0/4154800800 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4cec0cd3a0 0x7f4cec1fd290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.348+0000 7f4ceaffd640 1 -- 172.21.15.53:0/4154800800 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4cec0c7410 msgr2=0x7f4cec0b2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.348+0000 7f4ceaffd640 1 --2- 172.21.15.53:0/4154800800 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4cec0c7410 0x7f4cec0b2af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.348+0000 7f4ceaffd640 1 -- 172.21.15.53:0/4154800800 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ce0009420 con 0x7f4cec0ccf40 2023-06-10T18:52:55.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.348+0000 7f4ceaffd640 1 --2- 172.21.15.53:0/4154800800 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4cec0ccf40 0x7f4cec0c55d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4ce4008b90 tx=0x7f4ce400d4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:55.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.348+0000 7f4cd37fe640 1 -- 172.21.15.53:0/4154800800 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce400ddc0 con 0x7f4cec0ccf40 2023-06-10T18:52:55.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.348+0000 7f4cd37fe640 1 -- 172.21.15.53:0/4154800800 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ce4008e60 con 0x7f4cec0ccf40 2023-06-10T18:52:55.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.348+0000 7f4cd37fe640 1 -- 172.21.15.53:0/4154800800 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce4004db0 con 0x7f4cec0ccf40 2023-06-10T18:52:55.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.348+0000 7f4cf135a640 1 -- 172.21.15.53:0/4154800800 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cec157f50 con 0x7f4cec0ccf40 2023-06-10T18:52:55.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.348+0000 7f0a3dd4e640 1 -- 172.21.15.53:0/103092082 >> v2:172.21.15.53:3300/0 conn(0x7f0a30036db0 msgr2=0x7f0a300e2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:55.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.348+0000 7f0a3dd4e640 1 --2- 172.21.15.53:0/103092082 >> v2:172.21.15.53:3300/0 conn(0x7f0a30036db0 0x7f0a300e2ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.348+0000 7f0a3dd4e640 1 -- 172.21.15.53:0/103092082 >> v1:172.21.15.117:6789/0 conn(0x7f0a300e1ec0 legacy=0x7f0a300366a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-10T18:52:55.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.348+0000 7f0a3dd4e640 1 -- 172.21.15.53:0/103092082 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a300e2400 con 0x7f0a300527f0 2023-06-10T18:52:55.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.348+0000 7f8baaffd640 1 --2- 172.21.15.53:0/499228059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8bac0cd000 0x7f8bac0cd3d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8bac06eba0 tx=0x7f8b9c0204a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d15c116721882403 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:55.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.348+0000 7f8baa7fc640 1 -- 172.21.15.53:0/499228059 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b9c00d2d0 con 0x7f8bac0cd000 2023-06-10T18:52:55.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.348+0000 7f8baa7fc640 1 -- 172.21.15.53:0/499228059 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b9c00b450 con 0x7f8bac0cd000 2023-06-10T18:52:55.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.348+0000 7fad65cdc640 1 Processor -- start 2023-06-10T18:52:55.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.348+0000 7fceda12c640 1 --2- 172.21.15.53:0/189329905 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcecc0e6d80 0x7fcecc04f270 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fced00097c0 tx=0x7fced001c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=871bb18239d92bb5 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:55.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.348+0000 7f8baa7fc640 1 -- 172.21.15.53:0/499228059 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b9c00b7e0 con 0x7f8bac0cd000 2023-06-10T18:52:55.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.348+0000 7f4cf135a640 1 -- 172.21.15.53:0/4154800800 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cec158510 con 0x7f4cec0ccf40 2023-06-10T18:52:55.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.348+0000 7fced912a640 1 -- 172.21.15.53:0/189329905 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced00ab600 con 0x7fcecc0e6d80 2023-06-10T18:52:55.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.348+0000 7fced912a640 1 -- 172.21.15.53:0/189329905 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fced00a7050 con 0x7fcecc0e6d80 2023-06-10T18:52:55.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.348+0000 7fced912a640 1 -- 172.21.15.53:0/189329905 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced00ab980 con 0x7fcecc0e6d80 2023-06-10T18:52:55.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.348+0000 7f4cf135a640 1 -- 172.21.15.53:0/4154800800 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cec04dfe0 con 0x7f4cec0ccf40 2023-06-10T18:52:55.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.348+0000 7fad65cdc640 1 -- start start 2023-06-10T18:52:55.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.348+0000 7f8bb1a5a640 1 -- 172.21.15.53:0/499228059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8bac0cd000 msgr2=0x7f8bac0cd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.348+0000 7f8bb1a5a640 1 --2- 172.21.15.53:0/499228059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8bac0cd000 0x7f8bac0cd3d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8bac06eba0 tx=0x7f8b9c0204a0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.348+0000 7f8bb1a5a640 1 -- 172.21.15.53:0/499228059 shutdown_connections 2023-06-10T18:52:55.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.348+0000 7f8bb1a5a640 1 --2- 172.21.15.53:0/499228059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8bac089770 0x7f8bac06a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.348+0000 7f8bb1a5a640 1 --2- 172.21.15.53:0/499228059 >> v2:172.21.15.53:3300/0 conn(0x7f8bac0af7d0 0x7f8bac0afc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.348+0000 7f8bb1a5a640 1 --2- 172.21.15.53:0/499228059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8bac0cd000 0x7f8bac0cd3d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.348+0000 7f8bb1a5a640 1 -- 172.21.15.53:0/499228059 >> 172.21.15.53:0/499228059 conn(0x7f8bac0ce9e0 msgr2=0x7f8bac0ca7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:55.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.348+0000 7fad65cdc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fad600b3910 0x7fad601540d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.348+0000 7f7443fff640 1 --2- 172.21.15.53:0/3028333656 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7444157a80 0x7f74440ccda0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f74300097c0 tx=0x7f743001eab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=217aaa8372b905c server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:55.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.348+0000 7fcedb12e640 1 -- 172.21.15.53:0/189329905 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcecc0e6d80 msgr2=0x7fcecc04f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.348+0000 7fcedb12e640 1 --2- 172.21.15.53:0/189329905 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcecc0e6d80 0x7fcecc04f270 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fced00097c0 tx=0x7fced001c430 comp rx=0 tx=0).stop 2023-06-10T18:52:55.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.348+0000 7f353cdf3640 1 --2- 172.21.15.53:0/290578558 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f353000d180 0x7f3530052b00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3538000b70 tx=0x7f3538095830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3f8b031a80ef831 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:55.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.348+0000 7f8bb1a5a640 1 -- 172.21.15.53:0/499228059 shutdown_connections 2023-06-10T18:52:55.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.348+0000 7fad65cdc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad600b42a0 0x7fad60154680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.348+0000 7f0a3dd4e640 1 --2- 172.21.15.53:0/103092082 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a300527f0 0x7f0a30052d00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0a38000b70 tx=0x7f0a380958a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23adeb144f91d7ad server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:55.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.348+0000 7fad5f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fad600b3910 0x7fad601540d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.348+0000 7fad5f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fad600b3910 0x7fad601540d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35174/0 (socket says 172.21.15.53:35174) 2023-06-10T18:52:55.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.348+0000 7fad65cdc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fad6015b8e0 0x7fad600ca930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.348+0000 7fcedb12e640 1 -- 172.21.15.53:0/189329905 shutdown_connections 2023-06-10T18:52:55.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.348+0000 7fcedb12e640 1 --2- 172.21.15.53:0/189329905 >> v2:172.21.15.117:3300/0 conn(0x7fcecc0eade0 0x7fcecc0eb260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.348+0000 7fcedb12e640 1 --2- 172.21.15.53:0/189329905 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcecc0e6d80 0x7fcecc04f270 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.348+0000 7fcedb12e640 1 -- 172.21.15.53:0/189329905 >> 172.21.15.53:0/189329905 conn(0x7fcecc0516a0 msgr2=0x7fcecc051aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:55.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.348+0000 7fad65cdc640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad600ca420 con 0x7fad600b3910 2023-06-10T18:52:55.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.348+0000 7fad65cdc640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad60154bc0 con 0x7fad600b42a0 2023-06-10T18:52:55.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.348+0000 7fad65cdc640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad6015bdd0 con 0x7fad6015b8e0 2023-06-10T18:52:55.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.348+0000 7fcedb12e640 1 -- 172.21.15.53:0/189329905 shutdown_connections 2023-06-10T18:52:55.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.348+0000 7fad5f7fe640 1 -- 172.21.15.53:0/903384939 learned_addr learned my addr 172.21.15.53:0/903384939 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:55.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.348+0000 7f0a2ffff640 1 -- 172.21.15.53:0/103092082 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a3811f750 con 0x7f0a300527f0 2023-06-10T18:52:55.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.348+0000 7f0a2ffff640 1 -- 172.21.15.53:0/103092082 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a3811f8b0 con 0x7f0a300527f0 2023-06-10T18:52:55.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.348+0000 7f0a2ffff640 1 -- 172.21.15.53:0/103092082 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a3811fd00 con 0x7f0a300527f0 2023-06-10T18:52:55.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.348+0000 7fcedb12e640 1 -- 172.21.15.53:0/189329905 wait complete. 2023-06-10T18:52:55.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.352+0000 7f352ffff640 1 -- 172.21.15.53:0/290578558 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35381216e0 con 0x7f353000d180 2023-06-10T18:52:55.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.352+0000 7f352ffff640 1 -- 172.21.15.53:0/290578558 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3538121840 con 0x7f353000d180 2023-06-10T18:52:55.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.352+0000 7f352ffff640 1 -- 172.21.15.53:0/290578558 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3538121c90 con 0x7f353000d180 2023-06-10T18:52:55.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.352+0000 7fad5ffff640 1 --2- 172.21.15.53:0/903384939 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fad6015b8e0 0x7fad600ca930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.352+0000 7fad5effd640 1 --2- 172.21.15.53:0/903384939 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad600b42a0 0x7fad60154680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.348+0000 7f8bb1a5a640 1 -- 172.21.15.53:0/499228059 wait complete. 2023-06-10T18:52:55.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.352+0000 7f4cd37fe640 1 -- 172.21.15.53:0/4154800800 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4ce40064f0 con 0x7f4cec0ccf40 2023-06-10T18:52:55.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.352+0000 7f0a3e54f640 1 -- 172.21.15.53:0/103092082 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a300527f0 msgr2=0x7f0a30052d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.352+0000 7f0a3e54f640 1 --2- 172.21.15.53:0/103092082 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a300527f0 0x7f0a30052d00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0a38000b70 tx=0x7f0a380958a0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.352+0000 7f353f858640 1 -- 172.21.15.53:0/290578558 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f353000d180 msgr2=0x7f3530052b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.352+0000 7f353f858640 1 --2- 172.21.15.53:0/290578558 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f353000d180 0x7f3530052b00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3538000b70 tx=0x7f3538095830 comp rx=0 tx=0).stop 2023-06-10T18:52:55.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.352+0000 7fad5f7fe640 1 -- 172.21.15.53:0/903384939 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fad6015b8e0 msgr2=0x7fad600ca930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.352+0000 7fad5f7fe640 1 --2- 172.21.15.53:0/903384939 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fad6015b8e0 0x7fad600ca930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.352+0000 7fad5f7fe640 1 -- 172.21.15.53:0/903384939 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad600b42a0 msgr2=0x7fad60154680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.352+0000 7fad5f7fe640 1 --2- 172.21.15.53:0/903384939 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad600b42a0 0x7fad60154680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.352+0000 7fad5f7fe640 1 -- 172.21.15.53:0/903384939 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad58009b30 con 0x7fad600b3910 2023-06-10T18:52:55.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.352+0000 7f4cd37fe640 1 --2- 172.21.15.53:0/4154800800 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4cd8066280 0x7f4cd8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.352+0000 7f4cd37fe640 1 -- 172.21.15.53:0/4154800800 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4ce4084260 con 0x7f4cec0ccf40 2023-06-10T18:52:55.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.352+0000 7f0a3e54f640 1 -- 172.21.15.53:0/103092082 shutdown_connections 2023-06-10T18:52:55.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.352+0000 7f0a3e54f640 1 --2- 172.21.15.53:0/103092082 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a300527f0 0x7f0a30052d00 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.352+0000 7f0a3e54f640 1 --2- 172.21.15.53:0/103092082 >> v2:172.21.15.53:3300/0 conn(0x7f0a30036db0 0x7f0a300e2ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.352+0000 7f0a3e54f640 1 -- 172.21.15.53:0/103092082 >> 172.21.15.53:0/103092082 conn(0x7f0a300516a0 msgr2=0x7f0a30051aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:55.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.352+0000 7f353f858640 1 -- 172.21.15.53:0/290578558 shutdown_connections 2023-06-10T18:52:55.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.352+0000 7f353f858640 1 --2- 172.21.15.53:0/290578558 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f353000d180 0x7f3530052b00 secure :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3538000b70 tx=0x7f3538095830 comp rx=0 tx=0).stop 2023-06-10T18:52:55.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.352+0000 7f353f858640 1 --2- 172.21.15.53:0/290578558 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35300df710 0x7f35300525c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.352+0000 7f353f858640 1 -- 172.21.15.53:0/290578558 >> 172.21.15.53:0/290578558 conn(0x7f3530038d20 msgr2=0x7f3530039120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:55.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.352+0000 7f8bb1a5a640 1 Processor -- start 2023-06-10T18:52:55.395 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.352+0000 7f0a3e54f640 1 -- 172.21.15.53:0/103092082 shutdown_connections 2023-06-10T18:52:55.395 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.352+0000 7f0a3e54f640 1 -- 172.21.15.53:0/103092082 wait complete. 2023-06-10T18:52:55.395 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.352+0000 7f0a3e54f640 1 Processor -- start 2023-06-10T18:52:55.395 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.352+0000 7f353f858640 1 -- 172.21.15.53:0/290578558 shutdown_connections 2023-06-10T18:52:55.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.352+0000 7f8bb1a5a640 1 -- start start 2023-06-10T18:52:55.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.352+0000 7f8bb1a5a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8bac089770 0x7f8bac1694e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.352+0000 7f8bb1a5a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8bac0af7d0 0x7f8bac0b32c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.352+0000 7f8bb1a5a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8bac0cd000 0x7f8bac0c5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.352+0000 7f8bb1a5a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bac169d40 con 0x7f8bac089770 2023-06-10T18:52:55.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.352+0000 7f8bb1a5a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bac16a300 con 0x7f8bac0af7d0 2023-06-10T18:52:55.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.352+0000 7f8bb1a5a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bac0b18a0 con 0x7f8bac0cd000 2023-06-10T18:52:55.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.352+0000 7fad5f7fe640 1 --2- 172.21.15.53:0/903384939 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fad600b3910 0x7fad601540d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fad5400e810 tx=0x7fad5400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:55.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.352+0000 7f4cea7fc640 1 --2- 172.21.15.53:0/4154800800 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4cd8066280 0x7f4cd8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.352+0000 7f4cea7fc640 1 --2- 172.21.15.53:0/4154800800 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4cd8066280 0x7f4cd8068730 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4cec0b3640 tx=0x7f4cdc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:55.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.352+0000 7f74437fe640 1 -- 172.21.15.53:0/3028333656 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74380015b0 con 0x7f7444157a80 2023-06-10T18:52:55.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.352+0000 7f74437fe640 1 -- 172.21.15.53:0/3028333656 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74300a8570 con 0x7f7444157a80 2023-06-10T18:52:55.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.352+0000 7f74437fe640 1 -- 172.21.15.53:0/3028333656 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74300a8900 con 0x7f7444157a80 2023-06-10T18:52:55.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.352+0000 7f7449962640 1 -- 172.21.15.53:0/3028333656 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7444157a80 msgr2=0x7f74440ccda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.352+0000 7f7449962640 1 --2- 172.21.15.53:0/3028333656 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7444157a80 0x7f74440ccda0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f74300097c0 tx=0x7f743001eab0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.352+0000 7fcedb12e640 1 Processor -- start 2023-06-10T18:52:55.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.352+0000 7f7449962640 1 -- 172.21.15.53:0/3028333656 shutdown_connections 2023-06-10T18:52:55.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.352+0000 7f7449962640 1 --2- 172.21.15.53:0/3028333656 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7444157a80 0x7f74440ccda0 secure :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f74300097c0 tx=0x7f743001eab0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.352+0000 7f7449962640 1 -- 172.21.15.53:0/3028333656 >> 172.21.15.53:0/3028333656 conn(0x7f744406a090 msgr2=0x7f74440ca4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:55.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.352+0000 7f7449962640 1 -- 172.21.15.53:0/3028333656 shutdown_connections 2023-06-10T18:52:55.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.352+0000 7f8baaffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8bac089770 0x7f8bac1694e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.352+0000 7f8baaffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8bac089770 0x7f8bac1694e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35176/0 (socket says 172.21.15.53:35176) 2023-06-10T18:52:55.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.352+0000 7f8baaffd640 1 -- 172.21.15.53:0/1698705842 learned_addr learned my addr 172.21.15.53:0/1698705842 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:55.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.352+0000 7f353f858640 1 -- 172.21.15.53:0/290578558 wait complete. 2023-06-10T18:52:55.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.352+0000 7f353f858640 1 Processor -- start 2023-06-10T18:52:55.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.352+0000 7f8baaffd640 1 -- 172.21.15.53:0/1698705842 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8bac0cd000 msgr2=0x7f8bac0c5940 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-06-10T18:52:55.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.352+0000 7f8baaffd640 1 --2- 172.21.15.53:0/1698705842 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8bac0cd000 0x7f8bac0c5940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.352+0000 7f8baaffd640 1 -- 172.21.15.53:0/1698705842 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8bac0af7d0 msgr2=0x7f8bac0b32c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-06-10T18:52:55.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.352+0000 7f8baaffd640 1 --2- 172.21.15.53:0/1698705842 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8bac0af7d0 0x7f8bac0b32c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.352+0000 7f8baaffd640 1 -- 172.21.15.53:0/1698705842 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b9c00d8c0 con 0x7f8bac089770 2023-06-10T18:52:55.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.352+0000 7f0a3e54f640 1 -- start start 2023-06-10T18:52:55.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.352+0000 7f8baaffd640 1 --2- 172.21.15.53:0/1698705842 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8bac089770 0x7f8bac1694e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c020d40 tx=0x7f8b9c01ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:55.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.352+0000 7f0a3e54f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0a30036db0 0x7f0a300d93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.352+0000 7f0a3e54f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a300527f0 0x7f0a3004df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.352+0000 7f7449962640 1 -- 172.21.15.53:0/3028333656 wait complete. 2023-06-10T18:52:55.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.356+0000 7f7449962640 1 Processor -- start 2023-06-10T18:52:55.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.352+0000 7fcedb12e640 1 -- start start 2023-06-10T18:52:55.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.356+0000 7fcedb12e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcecc04f7b0 0x7fcecc0d1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.356+0000 7fcedb12e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcecc0e6d80 0x7fcecc049130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.356+0000 7f0a3d54d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0a30036db0 0x7f0a300d93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.356+0000 7f0a3d54d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0a30036db0 0x7f0a300d93e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35180/0 (socket says 172.21.15.53:35180) 2023-06-10T18:52:55.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.356+0000 7fcedb12e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcecc0eade0 0x7fcecc0063b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.356+0000 7fcedb12e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcecc0db120 con 0x7fcecc0eade0 2023-06-10T18:52:55.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.356+0000 7fcedb12e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcecc0394a0 con 0x7fcecc04f7b0 2023-06-10T18:52:55.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.356+0000 7fcedb12e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcecc0d2170 con 0x7fcecc0e6d80 2023-06-10T18:52:55.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.356+0000 7f0a3d54d640 1 -- 172.21.15.53:0/2174322035 learned_addr learned my addr 172.21.15.53:0/2174322035 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:55.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.356+0000 7f0a3e54f640 1 --2- 172.21.15.53:0/2174322035 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a300e1ec0 0x7f0a3004e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.356+0000 7fceda92d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcecc0eade0 0x7fcecc0063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.356+0000 7fceda92d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcecc0eade0 0x7fcecc0063b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35182/0 (socket says 172.21.15.53:35182) 2023-06-10T18:52:55.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.356+0000 7fceda92d640 1 -- 172.21.15.53:0/2245861688 learned_addr learned my addr 172.21.15.53:0/2245861688 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:55.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.356+0000 7f0a3e54f640 1 -- 172.21.15.53:0/2174322035 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a300df700 con 0x7f0a30036db0 2023-06-10T18:52:55.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.356+0000 7f0a3e54f640 1 -- 172.21.15.53:0/2174322035 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a30038d50 con 0x7f0a300527f0 2023-06-10T18:52:55.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.356+0000 7f0a3cd4c640 1 --2- 172.21.15.53:0/2174322035 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a300527f0 0x7f0a3004df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.356+0000 7f0a3e54f640 1 -- 172.21.15.53:0/2174322035 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3004ead0 con 0x7f0a300e1ec0 2023-06-10T18:52:55.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.356+0000 7fceda92d640 1 -- 172.21.15.53:0/2245861688 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcecc0e6d80 msgr2=0x7fcecc049130 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-06-10T18:52:55.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.356+0000 7fceda92d640 1 --2- 172.21.15.53:0/2245861688 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcecc0e6d80 0x7fcecc049130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.356+0000 7fceda92d640 1 -- 172.21.15.53:0/2245861688 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcecc04f7b0 msgr2=0x7fcecc0d1c30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-06-10T18:52:55.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.356+0000 7fceda92d640 1 --2- 172.21.15.53:0/2245861688 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcecc04f7b0 0x7fcecc0d1c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.356+0000 7fceda92d640 1 -- 172.21.15.53:0/2245861688 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fced0009420 con 0x7fcecc0eade0 2023-06-10T18:52:55.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.352+0000 7f353f858640 1 -- start start 2023-06-10T18:52:55.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.356+0000 7f353f858640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35300df710 0x7f353017fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.356+0000 7f353f858640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f35300e3100 0x7f3530034be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.356+0000 7f353f858640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3530035120 0x7f3530049870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.356+0000 7f353f858640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3530035590 con 0x7f35300e3100 2023-06-10T18:52:55.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.356+0000 7f353f858640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f353004a480 con 0x7f3530035120 2023-06-10T18:52:55.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.356+0000 7f353f858640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f353004a760 con 0x7f35300df710 2023-06-10T18:52:55.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.356+0000 7f353d5f4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35300df710 0x7f353017fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.356+0000 7f0a3dd4e640 1 --2- 172.21.15.53:0/2174322035 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a300e1ec0 0x7f0a3004e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.356+0000 7fceda92d640 1 --2- 172.21.15.53:0/2245861688 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcecc0eade0 0x7fcecc0063b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fced4000b70 tx=0x7fced4066800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:55.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.356+0000 7f353cdf3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f35300e3100 0x7f3530034be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.356+0000 7f353cdf3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f35300e3100 0x7f3530034be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35196/0 (socket says 172.21.15.53:35196) 2023-06-10T18:52:55.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.356+0000 7f353d5f4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35300df710 0x7f353017fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.53:34812/0 (socket says 172.21.15.53:34812) 2023-06-10T18:52:55.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.356+0000 7f353cdf3640 1 -- 172.21.15.53:0/349033836 learned_addr learned my addr 172.21.15.53:0/349033836 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:55.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.356+0000 7f353ddf5640 1 --2- 172.21.15.53:0/349033836 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3530035120 0x7f3530049870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.356+0000 7f7449962640 1 -- start start 2023-06-10T18:52:55.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.356+0000 7f7449962640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74440cac00 0x7f7444200d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.356+0000 7f0a3d54d640 1 -- 172.21.15.53:0/2174322035 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a300e1ec0 msgr2=0x7f0a3004e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.356+0000 7f0a3d54d640 1 --2- 172.21.15.53:0/2174322035 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a300e1ec0 0x7f0a3004e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.356+0000 7f0a3d54d640 1 -- 172.21.15.53:0/2174322035 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a300527f0 msgr2=0x7f0a3004df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.356+0000 7f0a3d54d640 1 --2- 172.21.15.53:0/2174322035 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a300527f0 0x7f0a3004df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.356+0000 7f0a3d54d640 1 -- 172.21.15.53:0/2174322035 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a3804e720 con 0x7f0a30036db0 2023-06-10T18:52:55.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.356+0000 7f7449962640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f74440cd2e0 0x7f74440c4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.356+0000 7f7449962640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f744414ff30 0x7f74440c5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.356+0000 7f7449962640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74440c5930 con 0x7f74440cac00 2023-06-10T18:52:55.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.356+0000 7f7449962640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74440c5c10 con 0x7f74440cd2e0 2023-06-10T18:52:55.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.356+0000 7f7449962640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74440c5ef0 con 0x7f744414ff30 2023-06-10T18:52:55.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.356+0000 7f0a3d54d640 1 --2- 172.21.15.53:0/2174322035 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0a30036db0 0x7f0a300d93e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0a2800b3f0 tx=0x7f0a2800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:55.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.356+0000 7f7449161640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f744414ff30 0x7f74440c5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.356+0000 7f353cdf3640 1 -- 172.21.15.53:0/349033836 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35300df710 msgr2=0x7f353017fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.356+0000 7f353cdf3640 1 --2- 172.21.15.53:0/349033836 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35300df710 0x7f353017fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.356+0000 7f353cdf3640 1 -- 172.21.15.53:0/349033836 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3530035120 msgr2=0x7f3530049870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.356+0000 7f353cdf3640 1 --2- 172.21.15.53:0/349033836 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3530035120 0x7f3530049870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.356+0000 7f353cdf3640 1 -- 172.21.15.53:0/349033836 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f353804e720 con 0x7f35300e3100 2023-06-10T18:52:55.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.356+0000 7f7449161640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f744414ff30 0x7f74440c5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.53:34816/0 (socket says 172.21.15.53:34816) 2023-06-10T18:52:55.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.356+0000 7f7449161640 1 -- 172.21.15.53:0/1741824723 learned_addr learned my addr 172.21.15.53:0/1741824723 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:55.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.356+0000 7f7448960640 1 --2- 172.21.15.53:0/1741824723 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74440cac00 0x7f7444200d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.356+0000 7f7443fff640 1 --2- 172.21.15.53:0/1741824723 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f74440cd2e0 0x7f74440c4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.356+0000 7f7448960640 1 -- 172.21.15.53:0/1741824723 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f744414ff30 msgr2=0x7f74440c5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.356+0000 7f7448960640 1 --2- 172.21.15.53:0/1741824723 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f744414ff30 0x7f74440c5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.356+0000 7f7448960640 1 -- 172.21.15.53:0/1741824723 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f74440cd2e0 msgr2=0x7f74440c4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.356+0000 7f7448960640 1 --2- 172.21.15.53:0/1741824723 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f74440cd2e0 0x7f74440c4b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.356+0000 7f353cdf3640 1 --2- 172.21.15.53:0/349033836 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f35300e3100 0x7f3530034be0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3538068810 tx=0x7f3538092670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:55.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.356+0000 7f7448960640 1 -- 172.21.15.53:0/1741824723 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7430009420 con 0x7f74440cac00 2023-06-10T18:52:55.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.356+0000 7f7448960640 1 --2- 172.21.15.53:0/1741824723 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74440cac00 0x7f7444200d70 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f743800c780 tx=0x7f743800cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:55.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.356+0000 7f358b094640 1 Processor -- start 2023-06-10T18:52:55.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.356+0000 7f358b094640 1 -- start start 2023-06-10T18:52:55.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.356+0000 7f8ba8ff9640 1 -- 172.21.15.53:0/1698705842 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b9c0bc070 con 0x7f8bac089770 2023-06-10T18:52:55.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.356+0000 7f0a2dffb640 1 -- 172.21.15.53:0/2174322035 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a28011830 con 0x7f0a30036db0 2023-06-10T18:52:55.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.356+0000 7f8bb1a5a640 1 -- 172.21.15.53:0/1698705842 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bac16d000 con 0x7f8bac089770 2023-06-10T18:52:55.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.356+0000 7f8bb1a5a640 1 -- 172.21.15.53:0/1698705842 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bac0b1200 con 0x7f8bac089770 2023-06-10T18:52:55.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.356+0000 7f4cd37fe640 1 -- 172.21.15.53:0/4154800800 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4ce4051790 con 0x7f4cec0ccf40 2023-06-10T18:52:55.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.356+0000 7fcecaffd640 1 -- 172.21.15.53:0/2245861688 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced406ab90 con 0x7fcecc0eade0 2023-06-10T18:52:55.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.356+0000 7fad47fff640 1 -- 172.21.15.53:0/903384939 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5400c6d0 con 0x7fad600b3910 2023-06-10T18:52:55.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.356+0000 7f74417fa640 1 -- 172.21.15.53:0/1741824723 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7438005270 con 0x7f74440cac00 2023-06-10T18:52:55.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.360+0000 7fcedb12e640 1 -- 172.21.15.53:0/2245861688 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcecc038be0 con 0x7fcecc0eade0 2023-06-10T18:52:55.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.360+0000 7fcedb12e640 1 -- 172.21.15.53:0/2245861688 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcecc039130 con 0x7fcecc0eade0 2023-06-10T18:52:55.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.360+0000 7fad65cdc640 1 -- 172.21.15.53:0/903384939 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad600cb840 con 0x7fad600b3910 2023-06-10T18:52:55.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.360+0000 7fad65cdc640 1 -- 172.21.15.53:0/903384939 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad600cbe00 con 0x7fad600b3910 2023-06-10T18:52:55.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.360+0000 7fad47fff640 1 -- 172.21.15.53:0/903384939 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad5400c830 con 0x7fad600b3910 2023-06-10T18:52:55.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.360+0000 7fad47fff640 1 -- 172.21.15.53:0/903384939 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5400cba0 con 0x7fad600b3910 2023-06-10T18:52:55.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.356+0000 7f0a3e54f640 1 -- 172.21.15.53:0/2174322035 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a30047d80 con 0x7f0a30036db0 2023-06-10T18:52:55.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.356+0000 7f0a3e54f640 1 -- 172.21.15.53:0/2174322035 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a300df040 con 0x7f0a30036db0 2023-06-10T18:52:55.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.360+0000 7f7449962640 1 -- 172.21.15.53:0/1741824723 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74440c55c0 con 0x7f74440cac00 2023-06-10T18:52:55.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.360+0000 7f7449962640 1 -- 172.21.15.53:0/1741824723 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f744415cc70 con 0x7f74440cac00 2023-06-10T18:52:55.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.360+0000 7f0a3e54f640 1 -- 172.21.15.53:0/2174322035 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a300054a0 con 0x7f0a30036db0 2023-06-10T18:52:55.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.360+0000 7fcedb12e640 1 -- 172.21.15.53:0/2245861688 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcecc0054a0 con 0x7fcecc0eade0 2023-06-10T18:52:55.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.360+0000 7f8bb1a5a640 1 -- 172.21.15.53:0/1698705842 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bac16ce60 con 0x7f8bac089770 2023-06-10T18:52:55.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.360+0000 7f8ba8ff9640 1 -- 172.21.15.53:0/1698705842 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b9c006e20 con 0x7f8bac089770 2023-06-10T18:52:55.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.360+0000 7f8ba8ff9640 1 -- 172.21.15.53:0/1698705842 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b9c00be20 con 0x7f8bac089770 2023-06-10T18:52:55.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.360+0000 7fad65cdc640 1 -- 172.21.15.53:0/903384939 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad40005260 con 0x7fad600b3910 2023-06-10T18:52:55.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.360+0000 7f352dffb640 1 -- 172.21.15.53:0/349033836 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35381296d0 con 0x7f35300e3100 2023-06-10T18:52:55.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.360+0000 7f358b094640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f357c036280 0x7f357c039c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.360+0000 7f358b094640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f357c053b60 0x7f357c0e4160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.360+0000 7f358b094640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f357c052fe0 con 0x7f357c056900 2023-06-10T18:52:55.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.360+0000 7f358b094640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f357c00e010 con 0x7f357c036280 2023-06-10T18:52:55.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.360+0000 7f358b094640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f357c055410 con 0x7f357c053b60 2023-06-10T18:52:55.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.360+0000 7f7449962640 1 -- 172.21.15.53:0/1741824723 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f744404dfe0 con 0x7f74440cac00 2023-06-10T18:52:55.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.360+0000 7f3589891640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f357c056900 0x7f357c053450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.53:47676/0 (socket says 172.21.15.53:47676) 2023-06-10T18:52:55.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.360+0000 7f3589891640 1 -- 172.21.15.53:0/441291692 learned_addr learned my addr 172.21.15.53:0/441291692 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:52:55.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.360+0000 7f358a893640 1 --2- 172.21.15.53:0/441291692 >> v2:172.21.15.117:3300/0 conn(0x7f357c053b60 0x7f357c0e4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.360+0000 7f358a092640 1 --2- 172.21.15.53:0/441291692 >> v2:172.21.15.53:3300/0 conn(0x7f357c036280 0x7f357c039c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.360+0000 7f358a092640 1 -- 172.21.15.53:0/441291692 >> v2:172.21.15.117:3300/0 conn(0x7f357c053b60 msgr2=0x7f357c0e4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:55.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.360+0000 7f358a092640 1 --2- 172.21.15.53:0/441291692 >> v2:172.21.15.117:3300/0 conn(0x7f357c053b60 0x7f357c0e4160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.360+0000 7f358a092640 1 -- 172.21.15.53:0/441291692 >> v1:172.21.15.117:6789/0 conn(0x7f357c056900 legacy=0x7f357c053450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.360+0000 7f358a092640 1 -- 172.21.15.53:0/441291692 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f357c0556f0 con 0x7f357c036280 2023-06-10T18:52:55.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.360+0000 7f353f858640 1 -- 172.21.15.53:0/349033836 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f353004aa40 con 0x7f35300e3100 2023-06-10T18:52:55.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.360+0000 7f353f858640 1 -- 172.21.15.53:0/349033836 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35300e03e0 con 0x7f35300e3100 2023-06-10T18:52:55.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.360+0000 7f353f858640 1 -- 172.21.15.53:0/349033836 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3530054cd0 con 0x7f35300e3100 2023-06-10T18:52:55.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.364+0000 7fcecaffd640 1 -- 172.21.15.53:0/2245861688 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fced406acf0 con 0x7fcecc0eade0 2023-06-10T18:52:55.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.364+0000 7fcecaffd640 1 -- 172.21.15.53:0/2245861688 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced409c640 con 0x7fcecc0eade0 2023-06-10T18:52:55.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.364+0000 7f352dffb640 1 -- 172.21.15.53:0/349033836 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3538129830 con 0x7f35300e3100 2023-06-10T18:52:55.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.364+0000 7f352dffb640 1 -- 172.21.15.53:0/349033836 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3538129ba0 con 0x7f35300e3100 2023-06-10T18:52:55.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.364+0000 7f0a2dffb640 1 -- 172.21.15.53:0/2174322035 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a28009220 con 0x7f0a30036db0 2023-06-10T18:52:55.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.364+0000 7f0a2dffb640 1 -- 172.21.15.53:0/2174322035 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a28011b90 con 0x7f0a30036db0 2023-06-10T18:52:55.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.364+0000 7f74417fa640 1 -- 172.21.15.53:0/1741824723 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74380053d0 con 0x7f74440cac00 2023-06-10T18:52:55.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.364+0000 7f74417fa640 1 -- 172.21.15.53:0/1741824723 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f743800a840 con 0x7f74440cac00 2023-06-10T18:52:55.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.364+0000 7f8ba8ff9640 1 -- 172.21.15.53:0/1698705842 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8b9c00d0d0 con 0x7f8bac089770 2023-06-10T18:52:55.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.364+0000 7f8ba8ff9640 1 --2- 172.21.15.53:0/1698705842 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8b8c066280 0x7f8b8c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.364+0000 7fcecaffd640 1 -- 172.21.15.53:0/2245861688 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fced40711c0 con 0x7fcecc0eade0 2023-06-10T18:52:55.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.364+0000 7f8ba8ff9640 1 -- 172.21.15.53:0/1698705842 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8b9c11e810 con 0x7f8bac089770 2023-06-10T18:52:55.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.364+0000 7f8ba3fff640 1 --2- 172.21.15.53:0/1698705842 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8b8c066280 0x7f8b8c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.364+0000 7f0a2dffb640 1 -- 172.21.15.53:0/2174322035 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0a28011cf0 con 0x7f0a30036db0 2023-06-10T18:52:55.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.364+0000 7f0a2dffb640 1 --2- 172.21.15.53:0/2174322035 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0a1c066280 0x7f0a1c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.364+0000 7f358a092640 1 --2- 172.21.15.53:0/441291692 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f357c036280 0x7f357c039c80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f357c00e2a0 tx=0x7f3580020750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62f898a6d1fb0164 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:55.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.364+0000 7fad47fff640 1 -- 172.21.15.53:0/903384939 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fad5400cd00 con 0x7fad600b3910 2023-06-10T18:52:55.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.364+0000 7fad47fff640 1 --2- 172.21.15.53:0/903384939 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fad4c0662b0 0x7fad4c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.364+0000 7fcecaffd640 1 --2- 172.21.15.53:0/2245861688 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fceb80662b0 0x7fceb8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.364+0000 7fcecaffd640 1 -- 172.21.15.53:0/2245861688 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fced40fcc30 con 0x7fcecc0eade0 2023-06-10T18:52:55.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.368+0000 7f0a3cd4c640 1 --2- 172.21.15.53:0/2174322035 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0a1c066280 0x7f0a1c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.368+0000 7fad5effd640 1 --2- 172.21.15.53:0/903384939 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fad4c0662b0 0x7fad4c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.368+0000 7fceda12c640 1 --2- 172.21.15.53:0/2245861688 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fceb80662b0 0x7fceb8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.368+0000 7f8ba3fff640 1 --2- 172.21.15.53:0/1698705842 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8b8c066280 0x7f8b8c068730 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8bac2028b0 tx=0x7f8b9400d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:55.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.368+0000 7fad47fff640 1 -- 172.21.15.53:0/903384939 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fad540590a0 con 0x7fad600b3910 2023-06-10T18:52:55.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.368+0000 7f352dffb640 1 -- 172.21.15.53:0/349033836 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3538129d00 con 0x7f35300e3100 2023-06-10T18:52:55.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.368+0000 7fad5effd640 1 --2- 172.21.15.53:0/903384939 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fad4c0662b0 0x7fad4c068760 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fad580ae000 tx=0x7fad580a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:55.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.368+0000 7fceda12c640 1 --2- 172.21.15.53:0/2245861688 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fceb80662b0 0x7fceb8068760 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fced00ad000 tx=0x7fced00a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:55.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.368+0000 7f0a2dffb640 1 -- 172.21.15.53:0/2174322035 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0a28055480 con 0x7f0a30036db0 2023-06-10T18:52:55.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.368+0000 7f0a3cd4c640 1 --2- 172.21.15.53:0/2174322035 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0a1c066280 0x7f0a1c068730 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0a300e1050 tx=0x7f0a3400d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:55.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.368+0000 7f352dffb640 1 --2- 172.21.15.53:0/349033836 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f351c0662b0 0x7f351c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.368+0000 7f352dffb640 1 -- 172.21.15.53:0/349033836 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3538197900 con 0x7f35300e3100 2023-06-10T18:52:55.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.368+0000 7f353d5f4640 1 --2- 172.21.15.53:0/349033836 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f351c0662b0 0x7f351c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.368+0000 7f74417fa640 1 -- 172.21.15.53:0/1741824723 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f743800a9a0 con 0x7f74440cac00 2023-06-10T18:52:55.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.368+0000 7f74417fa640 1 --2- 172.21.15.53:0/1741824723 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f74280662b0 0x7f7428068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.368+0000 7f74417fa640 1 -- 172.21.15.53:0/1741824723 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7438083ce0 con 0x7f74440cac00 2023-06-10T18:52:55.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.368+0000 7f353d5f4640 1 --2- 172.21.15.53:0/349033836 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f351c0662b0 0x7f351c068760 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3534009b60 tx=0x7f3534009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:55.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.368+0000 7f7443fff640 1 --2- 172.21.15.53:0/1741824723 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f74280662b0 0x7f7428068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.368+0000 7f7443fff640 1 --2- 172.21.15.53:0/1741824723 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f74280662b0 0x7f7428068760 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f74300b2000 tx=0x7f74300aa070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:55.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.372+0000 7fad47fff640 1 -- 172.21.15.53:0/903384939 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fad540514d0 con 0x7fad600b3910 2023-06-10T18:52:55.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.376+0000 7f8ba8ff9640 1 -- 172.21.15.53:0/1698705842 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8b9c0ebd10 con 0x7f8bac089770 2023-06-10T18:52:55.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.388+0000 7f0a2dffb640 1 -- 172.21.15.53:0/2174322035 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0a28054fc0 con 0x7f0a30036db0 2023-06-10T18:52:55.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.396+0000 7fcecaffd640 1 -- 172.21.15.53:0/2245861688 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fced40ca030 con 0x7fcecc0eade0 2023-06-10T18:52:55.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.404+0000 7f352dffb640 1 -- 172.21.15.53:0/349033836 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3538164e30 con 0x7f35300e3100 2023-06-10T18:52:55.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.412+0000 7f74417fa640 1 -- 172.21.15.53:0/1741824723 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f74380511a0 con 0x7f74440cac00 2023-06-10T18:52:55.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.412+0000 7f3589090640 1 -- 172.21.15.53:0/441291692 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358000d0d0 con 0x7f357c036280 2023-06-10T18:52:55.445 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.412+0000 7f3589090640 1 -- 172.21.15.53:0/441291692 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f358000d230 con 0x7f357c036280 2023-06-10T18:52:55.445 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.412+0000 7f3589090640 1 -- 172.21.15.53:0/441291692 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35800a9760 con 0x7f357c036280 2023-06-10T18:52:55.445 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.412+0000 7f358b094640 1 -- 172.21.15.53:0/441291692 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f357c036280 msgr2=0x7f357c039c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.445 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.412+0000 7f358b094640 1 --2- 172.21.15.53:0/441291692 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f357c036280 0x7f357c039c80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f357c00e2a0 tx=0x7f3580020750 comp rx=0 tx=0).stop 2023-06-10T18:52:55.445 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.412+0000 7f358b094640 1 -- 172.21.15.53:0/441291692 shutdown_connections 2023-06-10T18:52:55.445 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.412+0000 7f358b094640 1 --2- 172.21.15.53:0/441291692 >> v2:172.21.15.117:3300/0 conn(0x7f357c053b60 0x7f357c0e4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.445 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.412+0000 7f358b094640 1 --2- 172.21.15.53:0/441291692 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f357c036280 0x7f357c039c80 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.412+0000 7f358b094640 1 -- 172.21.15.53:0/441291692 >> 172.21.15.53:0/441291692 conn(0x7f357c00c320 msgr2=0x7f357c00c720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:55.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.416+0000 7f358b094640 1 -- 172.21.15.53:0/441291692 shutdown_connections 2023-06-10T18:52:55.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.416+0000 7f358b094640 1 -- 172.21.15.53:0/441291692 wait complete. 2023-06-10T18:52:55.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.416+0000 7f358b094640 1 Processor -- start 2023-06-10T18:52:55.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.416+0000 7f358b094640 1 -- start start 2023-06-10T18:52:55.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.416+0000 7f358b094640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f357c036280 0x7f357c0d06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.416+0000 7f358a092640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f357c036280 0x7f357c0d06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.416+0000 7f358a092640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f357c036280 0x7f357c0d06a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35216/0 (socket says 172.21.15.53:35216) 2023-06-10T18:52:55.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.416+0000 7f358b094640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f357c053b60 0x7f357c04d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.416+0000 7f358b094640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f357c056900 0x7f357c04d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.416+0000 7f358b094640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f357c0d0520 con 0x7f357c036280 2023-06-10T18:52:55.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.416+0000 7f358b094640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f357c04dd60 con 0x7f357c053b60 2023-06-10T18:52:55.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.416+0000 7f358b094640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f357c03b440 con 0x7f357c056900 2023-06-10T18:52:55.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.416+0000 7f358a092640 1 -- 172.21.15.53:0/2824377952 learned_addr learned my addr 172.21.15.53:0/2824377952 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:55.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.420+0000 7f3589891640 1 --2- 172.21.15.53:0/2824377952 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f357c053b60 0x7f357c04d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.420+0000 7f358a893640 1 --2- 172.21.15.53:0/2824377952 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f357c056900 0x7f357c04d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.420+0000 7f358a092640 1 -- 172.21.15.53:0/2824377952 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f357c056900 msgr2=0x7f357c04d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.420+0000 7f358a092640 1 --2- 172.21.15.53:0/2824377952 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f357c056900 0x7f357c04d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.420+0000 7f358a092640 1 -- 172.21.15.53:0/2824377952 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f357c053b60 msgr2=0x7f357c04d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.420+0000 7f358a092640 1 --2- 172.21.15.53:0/2824377952 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f357c053b60 0x7f357c04d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.420+0000 7f358a092640 1 -- 172.21.15.53:0/2824377952 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f358000d850 con 0x7f357c036280 2023-06-10T18:52:55.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.420+0000 7f358a092640 1 --2- 172.21.15.53:0/2824377952 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f357c036280 0x7f357c0d06a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f358001e380 tx=0x7f358001d4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:55.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.420+0000 7f357affd640 1 -- 172.21.15.53:0/2824377952 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35800c1070 con 0x7f357c036280 2023-06-10T18:52:55.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.420+0000 7f358b094640 1 -- 172.21.15.53:0/2824377952 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f357c03a830 con 0x7f357c036280 2023-06-10T18:52:55.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.420+0000 7f358b094640 1 -- 172.21.15.53:0/2824377952 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f357c03adf0 con 0x7f357c036280 2023-06-10T18:52:55.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.424+0000 7f357affd640 1 -- 172.21.15.53:0/2824377952 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3580006dc0 con 0x7f357c036280 2023-06-10T18:52:55.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.424+0000 7f357affd640 1 -- 172.21.15.53:0/2824377952 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358000d0d0 con 0x7f357c036280 2023-06-10T18:52:55.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.424+0000 7f357affd640 1 -- 172.21.15.53:0/2824377952 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f35800bc6b0 con 0x7f357c036280 2023-06-10T18:52:55.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.424+0000 7f357affd640 1 --2- 172.21.15.53:0/2824377952 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f35680663d0 0x7f3568068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:55.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.424+0000 7f357affd640 1 -- 172.21.15.53:0/2824377952 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3580122a70 con 0x7f357c036280 2023-06-10T18:52:55.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.424+0000 7f3589891640 1 --2- 172.21.15.53:0/2824377952 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f35680663d0 0x7f3568068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:55.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.424+0000 7f3589891640 1 --2- 172.21.15.53:0/2824377952 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f35680663d0 0x7f3568068880 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f357c03b790 tx=0x7f3574009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:55.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.440+0000 7f358b094640 1 -- 172.21.15.53:0/2824377952 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f356c005260 con 0x7f357c036280 2023-06-10T18:52:55.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.448+0000 7f357affd640 1 -- 172.21.15.53:0/2824377952 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f35800efed0 con 0x7f357c036280 2023-06-10T18:52:55.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.624+0000 7fad65cdc640 1 -- 172.21.15.53:0/903384939 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fad400057e0 con 0x7fad600b3910 2023-06-10T18:52:55.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.624+0000 7fad47fff640 1 -- 172.21.15.53:0/903384939 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fad54021020 con 0x7fad600b3910 2023-06-10T18:52:55.638 INFO:teuthology.orchestra.run.smithi053.stdout:55834574855 2023-06-10T18:52:55.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.628+0000 7fad65cdc640 1 -- 172.21.15.53:0/903384939 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fad4c0662b0 msgr2=0x7fad4c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.628+0000 7fad65cdc640 1 --2- 172.21.15.53:0/903384939 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fad4c0662b0 0x7fad4c068760 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fad580ae000 tx=0x7fad580a7070 comp rx=0 tx=0).stop 2023-06-10T18:52:55.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.628+0000 7fad65cdc640 1 -- 172.21.15.53:0/903384939 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fad600b3910 msgr2=0x7fad601540d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.628+0000 7fad65cdc640 1 --2- 172.21.15.53:0/903384939 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fad600b3910 0x7fad601540d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fad5400e810 tx=0x7fad5400ecd0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.628+0000 7fad65cdc640 1 -- 172.21.15.53:0/903384939 shutdown_connections 2023-06-10T18:52:55.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.628+0000 7fad65cdc640 1 --2- 172.21.15.53:0/903384939 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fad4c0662b0 0x7fad4c068760 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.628+0000 7fad65cdc640 1 --2- 172.21.15.53:0/903384939 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fad6015b8e0 0x7fad600ca930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.628+0000 7fad65cdc640 1 --2- 172.21.15.53:0/903384939 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad600b42a0 0x7fad60154680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.628+0000 7fad65cdc640 1 --2- 172.21.15.53:0/903384939 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fad600b3910 0x7fad601540d0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.628+0000 7fad65cdc640 1 -- 172.21.15.53:0/903384939 >> 172.21.15.53:0/903384939 conn(0x7fad600717d0 msgr2=0x7fad6015a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:55.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.628+0000 7fad65cdc640 1 -- 172.21.15.53:0/903384939 shutdown_connections 2023-06-10T18:52:55.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.628+0000 7fad65cdc640 1 -- 172.21.15.53:0/903384939 wait complete. 2023-06-10T18:52:55.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.640+0000 7f4cf135a640 1 -- 172.21.15.53:0/4154800800 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4cec06b300 con 0x7f4cec0ccf40 2023-06-10T18:52:55.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.640+0000 7f4cd37fe640 1 -- 172.21.15.53:0/4154800800 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4ce4054db0 con 0x7f4cec0ccf40 2023-06-10T18:52:55.652 INFO:teuthology.orchestra.run.smithi053.stdout:55834574856 2023-06-10T18:52:55.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.644+0000 7f4cd17fa640 1 -- 172.21.15.53:0/4154800800 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4cd8066280 msgr2=0x7f4cd8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.644+0000 7f4cd17fa640 1 --2- 172.21.15.53:0/4154800800 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4cd8066280 0x7f4cd8068730 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4cec0b3640 tx=0x7f4cdc009040 comp rx=0 tx=0).stop 2023-06-10T18:52:55.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.644+0000 7f4cd17fa640 1 -- 172.21.15.53:0/4154800800 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4cec0ccf40 msgr2=0x7f4cec0c55d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.644+0000 7f4cd17fa640 1 --2- 172.21.15.53:0/4154800800 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4cec0ccf40 0x7f4cec0c55d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4ce4008b90 tx=0x7f4ce400d4b0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.644+0000 7f4cd17fa640 1 -- 172.21.15.53:0/4154800800 shutdown_connections 2023-06-10T18:52:55.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.644+0000 7f4cd17fa640 1 --2- 172.21.15.53:0/4154800800 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4cd8066280 0x7f4cd8068730 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.644+0000 7f4cd17fa640 1 --2- 172.21.15.53:0/4154800800 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4cec0c7410 0x7f4cec0b2af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.644+0000 7f4cd17fa640 1 --2- 172.21.15.53:0/4154800800 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4cec0cd3a0 0x7f4cec1fd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.644+0000 7f4cd17fa640 1 --2- 172.21.15.53:0/4154800800 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4cec0ccf40 0x7f4cec0c55d0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.644+0000 7f4cd17fa640 1 -- 172.21.15.53:0/4154800800 >> 172.21.15.53:0/4154800800 conn(0x7f4cec06a0e0 msgr2=0x7f4cec06cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:55.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.644+0000 7f4cd17fa640 1 -- 172.21.15.53:0/4154800800 shutdown_connections 2023-06-10T18:52:55.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.644+0000 7f4cd17fa640 1 -- 172.21.15.53:0/4154800800 wait complete. 2023-06-10T18:52:55.662 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.5 2023-06-10T18:52:55.676 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.1 2023-06-10T18:52:55.693 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.684+0000 7f8bb1a5a640 1 -- 172.21.15.53:0/1698705842 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f8bac16ce60 con 0x7f8bac089770 2023-06-10T18:52:55.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.684+0000 7f8ba8ff9640 1 -- 172.21.15.53:0/1698705842 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8bac16ce60 con 0x7f8bac089770 2023-06-10T18:52:55.695 INFO:teuthology.orchestra.run.smithi053.stdout:55834574855 2023-06-10T18:52:55.697 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.688+0000 7f8bb1a5a640 1 -- 172.21.15.53:0/1698705842 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8b8c066280 msgr2=0x7f8b8c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.697 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.688+0000 7f8bb1a5a640 1 --2- 172.21.15.53:0/1698705842 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8b8c066280 0x7f8b8c068730 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8bac2028b0 tx=0x7f8b9400d040 comp rx=0 tx=0).stop 2023-06-10T18:52:55.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.688+0000 7f8bb1a5a640 1 -- 172.21.15.53:0/1698705842 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8bac089770 msgr2=0x7f8bac1694e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.688+0000 7f8bb1a5a640 1 --2- 172.21.15.53:0/1698705842 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8bac089770 0x7f8bac1694e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c020d40 tx=0x7f8b9c01ece0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.688+0000 7f8bb1a5a640 1 -- 172.21.15.53:0/1698705842 shutdown_connections 2023-06-10T18:52:55.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.688+0000 7f8bb1a5a640 1 --2- 172.21.15.53:0/1698705842 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8b8c066280 0x7f8b8c068730 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.688+0000 7f8bb1a5a640 1 --2- 172.21.15.53:0/1698705842 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8bac0cd000 0x7f8bac0c5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.688+0000 7f8bb1a5a640 1 --2- 172.21.15.53:0/1698705842 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8bac0af7d0 0x7f8bac0b32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.688+0000 7f8bb1a5a640 1 --2- 172.21.15.53:0/1698705842 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8bac089770 0x7f8bac1694e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.688+0000 7f8bb1a5a640 1 -- 172.21.15.53:0/1698705842 >> 172.21.15.53:0/1698705842 conn(0x7f8bac0ce9e0 msgr2=0x7f8bac167f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:55.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.688+0000 7f8bb1a5a640 1 -- 172.21.15.53:0/1698705842 shutdown_connections 2023-06-10T18:52:55.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.688+0000 7f8bb1a5a640 1 -- 172.21.15.53:0/1698705842 wait complete. 2023-06-10T18:52:55.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.692+0000 7f7449962640 1 -- 172.21.15.53:0/1741824723 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f74440c5a70 con 0x7f74440cac00 2023-06-10T18:52:55.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.692+0000 7f74417fa640 1 -- 172.21.15.53:0/1741824723 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f74440c5a70 con 0x7f74440cac00 2023-06-10T18:52:55.702 INFO:teuthology.orchestra.run.smithi053.stdout:55834574854 2023-06-10T18:52:55.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.692+0000 7f353f858640 1 -- 172.21.15.53:0/349033836 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f35300e0600 con 0x7f35300e3100 2023-06-10T18:52:55.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.692+0000 7f352dffb640 1 -- 172.21.15.53:0/349033836 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3538168450 con 0x7f35300e3100 2023-06-10T18:52:55.703 INFO:teuthology.orchestra.run.smithi053.stdout:55834574854 2023-06-10T18:52:55.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.692+0000 7f7449962640 1 -- 172.21.15.53:0/1741824723 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f74280662b0 msgr2=0x7f7428068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.692+0000 7f7449962640 1 --2- 172.21.15.53:0/1741824723 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f74280662b0 0x7f7428068760 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f74300b2000 tx=0x7f74300aa070 comp rx=0 tx=0).stop 2023-06-10T18:52:55.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.692+0000 7f7449962640 1 -- 172.21.15.53:0/1741824723 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74440cac00 msgr2=0x7f7444200d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.692+0000 7f7449962640 1 --2- 172.21.15.53:0/1741824723 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74440cac00 0x7f7444200d70 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f743800c780 tx=0x7f743800cb80 comp rx=0 tx=0).stop 2023-06-10T18:52:55.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.692+0000 7f7449962640 1 -- 172.21.15.53:0/1741824723 shutdown_connections 2023-06-10T18:52:55.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.692+0000 7f7449962640 1 --2- 172.21.15.53:0/1741824723 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f74280662b0 0x7f7428068760 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.692+0000 7f7449962640 1 --2- 172.21.15.53:0/1741824723 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f744414ff30 0x7f74440c5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.692+0000 7f7449962640 1 --2- 172.21.15.53:0/1741824723 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f74440cd2e0 0x7f74440c4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.692+0000 7f7449962640 1 --2- 172.21.15.53:0/1741824723 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74440cac00 0x7f7444200d70 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.692+0000 7f7449962640 1 -- 172.21.15.53:0/1741824723 >> 172.21.15.53:0/1741824723 conn(0x7f744406a090 msgr2=0x7f74440c9550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:55.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.692+0000 7f7449962640 1 -- 172.21.15.53:0/1741824723 shutdown_connections 2023-06-10T18:52:55.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.692+0000 7f7449962640 1 -- 172.21.15.53:0/1741824723 wait complete. 2023-06-10T18:52:55.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.700+0000 7f353f858640 1 -- 172.21.15.53:0/349033836 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f351c0662b0 msgr2=0x7f351c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.700+0000 7f353f858640 1 --2- 172.21.15.53:0/349033836 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f351c0662b0 0x7f351c068760 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3534009b60 tx=0x7f3534009190 comp rx=0 tx=0).stop 2023-06-10T18:52:55.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.700+0000 7f353f858640 1 -- 172.21.15.53:0/349033836 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f35300e3100 msgr2=0x7f3530034be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.700+0000 7f353f858640 1 --2- 172.21.15.53:0/349033836 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f35300e3100 0x7f3530034be0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3538068810 tx=0x7f3538092670 comp rx=0 tx=0).stop 2023-06-10T18:52:55.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.700+0000 7f353f858640 1 -- 172.21.15.53:0/349033836 shutdown_connections 2023-06-10T18:52:55.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.700+0000 7f353f858640 1 --2- 172.21.15.53:0/349033836 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f351c0662b0 0x7f351c068760 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.700+0000 7f353f858640 1 --2- 172.21.15.53:0/349033836 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3530035120 0x7f3530049870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.700+0000 7f353f858640 1 --2- 172.21.15.53:0/349033836 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f35300e3100 0x7f3530034be0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.700+0000 7f353f858640 1 --2- 172.21.15.53:0/349033836 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35300df710 0x7f353017fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.700+0000 7f353f858640 1 -- 172.21.15.53:0/349033836 >> 172.21.15.53:0/349033836 conn(0x7f3530038d20 msgr2=0x7f3530037c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:55.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.700+0000 7f353f858640 1 -- 172.21.15.53:0/349033836 shutdown_connections 2023-06-10T18:52:55.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.700+0000 7f353f858640 1 -- 172.21.15.53:0/349033836 wait complete. 2023-06-10T18:52:55.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.700+0000 7f0a3e54f640 1 -- 172.21.15.53:0/2174322035 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0a300e16f0 con 0x7f0a30036db0 2023-06-10T18:52:55.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.700+0000 7f0a2dffb640 1 -- 172.21.15.53:0/2174322035 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0a28015090 con 0x7f0a30036db0 2023-06-10T18:52:55.711 INFO:teuthology.orchestra.run.smithi053.stdout:55834574855 2023-06-10T18:52:55.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.704+0000 7f0a3e54f640 1 -- 172.21.15.53:0/2174322035 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0a1c066280 msgr2=0x7f0a1c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.704+0000 7f0a3e54f640 1 --2- 172.21.15.53:0/2174322035 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0a1c066280 0x7f0a1c068730 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0a300e1050 tx=0x7f0a3400d040 comp rx=0 tx=0).stop 2023-06-10T18:52:55.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.704+0000 7f0a3e54f640 1 -- 172.21.15.53:0/2174322035 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0a30036db0 msgr2=0x7f0a300d93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.704+0000 7f0a3e54f640 1 --2- 172.21.15.53:0/2174322035 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0a30036db0 0x7f0a300d93e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0a2800b3f0 tx=0x7f0a2800b8b0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.704+0000 7f0a3e54f640 1 -- 172.21.15.53:0/2174322035 shutdown_connections 2023-06-10T18:52:55.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.704+0000 7f0a3e54f640 1 --2- 172.21.15.53:0/2174322035 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0a1c066280 0x7f0a1c068730 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.704+0000 7f0a3e54f640 1 --2- 172.21.15.53:0/2174322035 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a300e1ec0 0x7f0a3004e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.704+0000 7f0a3e54f640 1 --2- 172.21.15.53:0/2174322035 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a300527f0 0x7f0a3004df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.704+0000 7f0a3e54f640 1 --2- 172.21.15.53:0/2174322035 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0a30036db0 0x7f0a300d93e0 secure :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0a2800b3f0 tx=0x7f0a2800b8b0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.704+0000 7f0a3e54f640 1 -- 172.21.15.53:0/2174322035 >> 172.21.15.53:0/2174322035 conn(0x7f0a300516a0 msgr2=0x7f0a3004bcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:55.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.704+0000 7f0a3e54f640 1 -- 172.21.15.53:0/2174322035 shutdown_connections 2023-06-10T18:52:55.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.704+0000 7f0a3e54f640 1 -- 172.21.15.53:0/2174322035 wait complete. 2023-06-10T18:52:55.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.712+0000 7fcedb12e640 1 -- 172.21.15.53:0/2245861688 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fcecc0e9f70 con 0x7fcecc0eade0 2023-06-10T18:52:55.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.712+0000 7fcecaffd640 1 -- 172.21.15.53:0/2245861688 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fced4097090 con 0x7fcecc0eade0 2023-06-10T18:52:55.721 INFO:teuthology.orchestra.run.smithi053.stdout:55834574853 2023-06-10T18:52:55.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.712+0000 7fcedb12e640 1 -- 172.21.15.53:0/2245861688 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fceb80662b0 msgr2=0x7fceb8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.712+0000 7fcedb12e640 1 --2- 172.21.15.53:0/2245861688 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fceb80662b0 0x7fceb8068760 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fced00ad000 tx=0x7fced00a6000 comp rx=0 tx=0).stop 2023-06-10T18:52:55.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.712+0000 7fcedb12e640 1 -- 172.21.15.53:0/2245861688 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcecc0eade0 msgr2=0x7fcecc0063b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.712+0000 7fcedb12e640 1 --2- 172.21.15.53:0/2245861688 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcecc0eade0 0x7fcecc0063b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fced4000b70 tx=0x7fced4066800 comp rx=0 tx=0).stop 2023-06-10T18:52:55.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.712+0000 7fcedb12e640 1 -- 172.21.15.53:0/2245861688 shutdown_connections 2023-06-10T18:52:55.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.712+0000 7fcedb12e640 1 --2- 172.21.15.53:0/2245861688 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fceb80662b0 0x7fceb8068760 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.712+0000 7fcedb12e640 1 --2- 172.21.15.53:0/2245861688 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcecc0eade0 0x7fcecc0063b0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.712+0000 7fcedb12e640 1 --2- 172.21.15.53:0/2245861688 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcecc0e6d80 0x7fcecc049130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.712+0000 7fcedb12e640 1 --2- 172.21.15.53:0/2245861688 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcecc04f7b0 0x7fcecc0d1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.712+0000 7fcedb12e640 1 -- 172.21.15.53:0/2245861688 >> 172.21.15.53:0/2245861688 conn(0x7fcecc0516a0 msgr2=0x7fcecc0e7290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:55.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.712+0000 7fcedb12e640 1 -- 172.21.15.53:0/2245861688 shutdown_connections 2023-06-10T18:52:55.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.712+0000 7fcedb12e640 1 -- 172.21.15.53:0/2245861688 wait complete. 2023-06-10T18:52:55.726 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.6 2023-06-10T18:52:55.731 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.2 2023-06-10T18:52:55.737 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.4 2023-06-10T18:52:55.737 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.0 2023-06-10T18:52:55.742 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.3 2023-06-10T18:52:55.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.736+0000 7f358b094640 1 -- 172.21.15.53:0/2824377952 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f356c005510 con 0x7f357c036280 2023-06-10T18:52:55.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.736+0000 7f357affd640 1 -- 172.21.15.53:0/2824377952 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f35800f34f0 con 0x7f357c036280 2023-06-10T18:52:55.745 INFO:teuthology.orchestra.run.smithi053.stdout:55834574854 2023-06-10T18:52:55.747 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.736+0000 7f358b094640 1 -- 172.21.15.53:0/2824377952 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f35680663d0 msgr2=0x7f3568068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.747 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.736+0000 7f358b094640 1 --2- 172.21.15.53:0/2824377952 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f35680663d0 0x7f3568068880 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f357c03b790 tx=0x7f3574009040 comp rx=0 tx=0).stop 2023-06-10T18:52:55.747 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.736+0000 7f358b094640 1 -- 172.21.15.53:0/2824377952 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f357c036280 msgr2=0x7f357c0d06a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:55.747 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.736+0000 7f358b094640 1 --2- 172.21.15.53:0/2824377952 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f357c036280 0x7f357c0d06a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f358001e380 tx=0x7f358001d4f0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.736+0000 7f358b094640 1 -- 172.21.15.53:0/2824377952 shutdown_connections 2023-06-10T18:52:55.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.736+0000 7f358b094640 1 --2- 172.21.15.53:0/2824377952 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f35680663d0 0x7f3568068880 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.736+0000 7f358b094640 1 --2- 172.21.15.53:0/2824377952 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f357c056900 0x7f357c04d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.736+0000 7f358b094640 1 --2- 172.21.15.53:0/2824377952 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f357c053b60 0x7f357c04d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.736+0000 7f358b094640 1 --2- 172.21.15.53:0/2824377952 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f357c036280 0x7f357c0d06a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:55.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.736+0000 7f358b094640 1 -- 172.21.15.53:0/2824377952 >> 172.21.15.53:0/2824377952 conn(0x7f357c00c320 msgr2=0x7f357c036890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:55.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.736+0000 7f358b094640 1 -- 172.21.15.53:0/2824377952 shutdown_connections 2023-06-10T18:52:55.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:55.736+0000 7f358b094640 1 -- 172.21.15.53:0/2824377952 wait complete. 2023-06-10T18:52:55.762 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.7 2023-06-10T18:52:56.662 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-06-10T18:52:56.678 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-06-10T18:52:56.727 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-06-10T18:52:56.732 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-06-10T18:52:56.738 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-06-10T18:52:56.739 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-06-10T18:52:56.743 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-06-10T18:52:56.763 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-06-10T18:52:56.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.804+0000 7f4115451640 1 Processor -- start 2023-06-10T18:52:56.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.804+0000 7f4115451640 1 -- start start 2023-06-10T18:52:56.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.804+0000 7f4115451640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4110157df0 0x7f4110069e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:56.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.804+0000 7f4115451640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41100c92d0 con 0x7f41100ca880 2023-06-10T18:52:56.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.804+0000 7f4115451640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f411006a3a0 con 0x7f41100b06d0 2023-06-10T18:52:56.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.804+0000 7f4115451640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41100c8d10 con 0x7f4110157df0 2023-06-10T18:52:56.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.804+0000 7f410effd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4110157df0 0x7f4110069e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:56.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.804+0000 7f410effd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4110157df0 0x7f4110069e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35226/0 (socket says 172.21.15.53:35226) 2023-06-10T18:52:56.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.804+0000 7f410effd640 1 -- 172.21.15.53:0/695207958 learned_addr learned my addr 172.21.15.53:0/695207958 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:56.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.804+0000 7f410effd640 1 -- 172.21.15.53:0/695207958 >> v1:172.21.15.117:6789/0 conn(0x7f41100b06d0 legacy=0x7f4110070240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:56.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.804+0000 7f410effd640 1 -- 172.21.15.53:0/695207958 >> v1:172.21.15.53:6789/0 conn(0x7f41100ca880 legacy=0x7f41100affc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:56.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.804+0000 7f410effd640 1 -- 172.21.15.53:0/695207958 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41100c8ff0 con 0x7f4110157df0 2023-06-10T18:52:56.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.808+0000 7f410effd640 1 --2- 172.21.15.53:0/695207958 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4110157df0 0x7f4110069e60 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4100006fd0 tx=0x7f410001e900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70b4a4e9049ca234 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:56.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.808+0000 7f410dffb640 1 -- 172.21.15.53:0/695207958 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4100004230 con 0x7f4110157df0 2023-06-10T18:52:56.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.808+0000 7f410dffb640 1 -- 172.21.15.53:0/695207958 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41000ab070 con 0x7f4110157df0 2023-06-10T18:52:56.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.808+0000 7f410dffb640 1 -- 172.21.15.53:0/695207958 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41000a7750 con 0x7f4110157df0 2023-06-10T18:52:56.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.808+0000 7f4115451640 1 -- 172.21.15.53:0/695207958 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4110157df0 msgr2=0x7f4110069e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:56.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.808+0000 7f4115451640 1 --2- 172.21.15.53:0/695207958 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4110157df0 0x7f4110069e60 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4100006fd0 tx=0x7f410001e900 comp rx=0 tx=0).stop 2023-06-10T18:52:56.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.812+0000 7f4115451640 1 -- 172.21.15.53:0/695207958 shutdown_connections 2023-06-10T18:52:56.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.812+0000 7f4115451640 1 --2- 172.21.15.53:0/695207958 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4110157df0 0x7f4110069e60 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:56.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.812+0000 7f4115451640 1 -- 172.21.15.53:0/695207958 >> 172.21.15.53:0/695207958 conn(0x7f41100cafc0 msgr2=0x7f41100cb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:56.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.812+0000 7f4115451640 1 -- 172.21.15.53:0/695207958 shutdown_connections 2023-06-10T18:52:56.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.812+0000 7f4115451640 1 -- 172.21.15.53:0/695207958 wait complete. 2023-06-10T18:52:56.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.812+0000 7f4115451640 1 Processor -- start 2023-06-10T18:52:56.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.812+0000 7f4115451640 1 -- start start 2023-06-10T18:52:56.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.812+0000 7f4115451640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f41100b06d0 0x7f41100b3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:56.824 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.816+0000 7f410effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f41100b06d0 0x7f41100b3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:56.824 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.816+0000 7f410effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f41100b06d0 0x7f41100b3f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35236/0 (socket says 172.21.15.53:35236) 2023-06-10T18:52:56.824 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.816+0000 7f410effd640 1 -- 172.21.15.53:0/1161977442 learned_addr learned my addr 172.21.15.53:0/1161977442 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:56.824 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.816+0000 7f4115451640 1 --2- 172.21.15.53:0/1161977442 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41100ca880 0x7f4110155460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:56.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.816+0000 7f4115451640 1 --2- 172.21.15.53:0/1161977442 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4110157df0 0x7f41100b1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:56.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.816+0000 7f4115451640 1 -- 172.21.15.53:0/1161977442 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41100b28b0 con 0x7f41100b06d0 2023-06-10T18:52:56.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.816+0000 7f4115451640 1 -- 172.21.15.53:0/1161977442 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41100b25d0 con 0x7f41100ca880 2023-06-10T18:52:56.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.816+0000 7f4115451640 1 -- 172.21.15.53:0/1161977442 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f411014e080 con 0x7f4110157df0 2023-06-10T18:52:56.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.816+0000 7f410f7fe640 1 --2- 172.21.15.53:0/1161977442 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4110157df0 0x7f41100b1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:56.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.816+0000 7f410effd640 1 -- 172.21.15.53:0/1161977442 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4110157df0 msgr2=0x7f41100b1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:56.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.816+0000 7f410effd640 1 --2- 172.21.15.53:0/1161977442 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4110157df0 0x7f41100b1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:56.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.816+0000 7f410effd640 1 -- 172.21.15.53:0/1161977442 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41100ca880 msgr2=0x7f4110155460 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-06-10T18:52:56.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.816+0000 7f410effd640 1 --2- 172.21.15.53:0/1161977442 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41100ca880 0x7f4110155460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:56.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.816+0000 7f410effd640 1 -- 172.21.15.53:0/1161977442 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f410000b780 con 0x7f41100b06d0 2023-06-10T18:52:56.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.816+0000 7f410effd640 1 --2- 172.21.15.53:0/1161977442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f41100b06d0 0x7f41100b3f50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4100006fd0 tx=0x7f410001b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:56.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.816+0000 7f40f77fe640 1 -- 172.21.15.53:0/1161977442 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41000a7e10 con 0x7f41100b06d0 2023-06-10T18:52:56.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.816+0000 7f4115451640 1 -- 172.21.15.53:0/1161977442 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f411014e360 con 0x7f41100b06d0 2023-06-10T18:52:56.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.816+0000 7f4115451640 1 -- 172.21.15.53:0/1161977442 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41100b22e0 con 0x7f41100b06d0 2023-06-10T18:52:56.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.820+0000 7f40f77fe640 1 -- 172.21.15.53:0/1161977442 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4100003620 con 0x7f41100b06d0 2023-06-10T18:52:56.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.820+0000 7f40f77fe640 1 -- 172.21.15.53:0/1161977442 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41000039d0 con 0x7f41100b06d0 2023-06-10T18:52:56.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.820+0000 7f40f77fe640 1 -- 172.21.15.53:0/1161977442 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4100003bb0 con 0x7f41100b06d0 2023-06-10T18:52:56.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.820+0000 7f40f77fe640 1 --2- 172.21.15.53:0/1161977442 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f40fc0663d0 0x7f40fc068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:56.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.820+0000 7f40f77fe640 1 -- 172.21.15.53:0/1161977442 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f410011e330 con 0x7f41100b06d0 2023-06-10T18:52:56.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.820+0000 7f410e7fc640 1 --2- 172.21.15.53:0/1161977442 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f40fc0663d0 0x7f40fc068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:56.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.820+0000 7f4115451640 1 -- 172.21.15.53:0/1161977442 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40f0005260 con 0x7f41100b06d0 2023-06-10T18:52:56.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.828+0000 7f410e7fc640 1 --2- 172.21.15.53:0/1161977442 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f40fc0663d0 0x7f40fc068880 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4104007fd0 tx=0x7f41040079a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:56.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.832+0000 7f40f77fe640 1 -- 172.21.15.53:0/1161977442 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f41000eb8b0 con 0x7f41100b06d0 2023-06-10T18:52:56.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.876+0000 7f63db42f640 1 Processor -- start 2023-06-10T18:52:56.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.876+0000 7f63db42f640 1 -- start start 2023-06-10T18:52:56.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.880+0000 7f63db42f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f63d41579a0 0x7f63d40cb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:56.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.880+0000 7f63db42f640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63d40c9660 con 0x7f63d40cd650 2023-06-10T18:52:56.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.880+0000 7f63db42f640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63d40cc0a0 con 0x7f63d40cbc00 2023-06-10T18:52:56.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.880+0000 7f63db42f640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63d40cc380 con 0x7f63d41579a0 2023-06-10T18:52:56.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.880+0000 7f63d91cb640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f63d41579a0 0x7f63d40cb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:56.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.880+0000 7f63d91cb640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f63d41579a0 0x7f63d40cb6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35242/0 (socket says 172.21.15.53:35242) 2023-06-10T18:52:56.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.880+0000 7f63d91cb640 1 -- 172.21.15.53:0/1518658366 learned_addr learned my addr 172.21.15.53:0/1518658366 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:56.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.880+0000 7f63d91cb640 1 -- 172.21.15.53:0/1518658366 >> v1:172.21.15.117:6789/0 conn(0x7f63d40cbc00 legacy=0x7f63d40ccf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:56.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.880+0000 7f63d91cb640 1 -- 172.21.15.53:0/1518658366 >> v1:172.21.15.53:6789/0 conn(0x7f63d40cd650 legacy=0x7f63d40c9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:56.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.880+0000 7f63d91cb640 1 -- 172.21.15.53:0/1518658366 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63d40cc660 con 0x7f63d41579a0 2023-06-10T18:52:56.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.884+0000 7f63d91cb640 1 --2- 172.21.15.53:0/1518658366 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63d41579a0 0x7f63d40cb6c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f63cc0077f0 tx=0x7f63cc020590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afc9d24296f1903a server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:56.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.884+0000 7f63cbfff640 1 -- 172.21.15.53:0/1518658366 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63cc0b1660 con 0x7f63d41579a0 2023-06-10T18:52:56.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.884+0000 7f63cbfff640 1 -- 172.21.15.53:0/1518658366 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63cc0b17c0 con 0x7f63d41579a0 2023-06-10T18:52:56.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.884+0000 7f63db42f640 1 -- 172.21.15.53:0/1518658366 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63d41579a0 msgr2=0x7f63d40cb6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:56.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.884+0000 7f63db42f640 1 --2- 172.21.15.53:0/1518658366 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63d41579a0 0x7f63d40cb6c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f63cc0077f0 tx=0x7f63cc020590 comp rx=0 tx=0).stop 2023-06-10T18:52:56.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.884+0000 7f63db42f640 1 -- 172.21.15.53:0/1518658366 shutdown_connections 2023-06-10T18:52:56.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.884+0000 7f63db42f640 1 --2- 172.21.15.53:0/1518658366 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63d41579a0 0x7f63d40cb6c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:56.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.884+0000 7f63db42f640 1 -- 172.21.15.53:0/1518658366 >> 172.21.15.53:0/1518658366 conn(0x7f63d406a0e0 msgr2=0x7f63d40af620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:56.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.884+0000 7f63db42f640 1 -- 172.21.15.53:0/1518658366 shutdown_connections 2023-06-10T18:52:56.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.884+0000 7f63db42f640 1 -- 172.21.15.53:0/1518658366 wait complete. 2023-06-10T18:52:56.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.888+0000 7f63db42f640 1 Processor -- start 2023-06-10T18:52:56.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.888+0000 7f63db42f640 1 -- start start 2023-06-10T18:52:56.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.888+0000 7f63db42f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63d40cbc00 0x7f63d40b2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:56.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.888+0000 7f63db42f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63d40cd650 0x7f63d40c5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:56.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.888+0000 7f63db42f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63d40c62f0 0x7f63d4151f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:56.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.888+0000 7f63db42f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d40c0a00 con 0x7f63d40c62f0 2023-06-10T18:52:56.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.888+0000 7f63db42f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d40c45d0 con 0x7f63d40cbc00 2023-06-10T18:52:56.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.888+0000 7f63db42f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63d40c0c50 con 0x7f63d40cd650 2023-06-10T18:52:56.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.888+0000 7f63d89ca640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63d40cd650 0x7f63d40c5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:56.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.888+0000 7f63d99cc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63d40c62f0 0x7f63d4151f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:56.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.888+0000 7f63d91cb640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63d40cbc00 0x7f63d40b2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:56.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.888+0000 7f63d99cc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63d40c62f0 0x7f63d4151f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35248/0 (socket says 172.21.15.53:35248) 2023-06-10T18:52:56.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.888+0000 7f63d99cc640 1 -- 172.21.15.53:0/3557039179 learned_addr learned my addr 172.21.15.53:0/3557039179 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:56.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.888+0000 7f63d99cc640 1 -- 172.21.15.53:0/3557039179 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63d40cd650 msgr2=0x7f63d40c5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:56.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.888+0000 7f63d99cc640 1 --2- 172.21.15.53:0/3557039179 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63d40cd650 0x7f63d40c5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:56.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.888+0000 7f63d99cc640 1 -- 172.21.15.53:0/3557039179 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63d40cbc00 msgr2=0x7f63d40b2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:56.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.888+0000 7f63d99cc640 1 --2- 172.21.15.53:0/3557039179 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63d40cbc00 0x7f63d40b2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:56.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.888+0000 7f63d99cc640 1 -- 172.21.15.53:0/3557039179 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63cc007450 con 0x7f63d40c62f0 2023-06-10T18:52:56.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.888+0000 7f63d99cc640 1 --2- 172.21.15.53:0/3557039179 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63d40c62f0 0x7f63d4151f80 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f63c400c390 tx=0x7f63c400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:56.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.888+0000 7f63c9ffb640 1 -- 172.21.15.53:0/3557039179 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c40052d0 con 0x7f63d40c62f0 2023-06-10T18:52:56.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.888+0000 7f63db42f640 1 -- 172.21.15.53:0/3557039179 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63d40c0f30 con 0x7f63d40c62f0 2023-06-10T18:52:56.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.888+0000 7f63db42f640 1 -- 172.21.15.53:0/3557039179 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63d40c18e0 con 0x7f63d40c62f0 2023-06-10T18:52:56.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.892+0000 7f63c9ffb640 1 -- 172.21.15.53:0/3557039179 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63c4005430 con 0x7f63d40c62f0 2023-06-10T18:52:56.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.892+0000 7f63c9ffb640 1 -- 172.21.15.53:0/3557039179 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c4007240 con 0x7f63d40c62f0 2023-06-10T18:52:56.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.892+0000 7f63c9ffb640 1 -- 172.21.15.53:0/3557039179 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f63c4007460 con 0x7f63d40c62f0 2023-06-10T18:52:56.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.892+0000 7f63c9ffb640 1 --2- 172.21.15.53:0/3557039179 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f63c00663f0 0x7f63c00688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:56.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.892+0000 7f63c9ffb640 1 -- 172.21.15.53:0/3557039179 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f63c4082f60 con 0x7f63d40c62f0 2023-06-10T18:52:56.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.892+0000 7f63d91cb640 1 --2- 172.21.15.53:0/3557039179 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f63c00663f0 0x7f63c00688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:56.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.892+0000 7f63d91cb640 1 --2- 172.21.15.53:0/3557039179 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f63c00663f0 0x7f63c00688a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f63cc0b3000 tx=0x7f63cc0ac000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:56.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.900+0000 7f63db42f640 1 -- 172.21.15.53:0/3557039179 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63b4005260 con 0x7f63d40c62f0 2023-06-10T18:52:56.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.908+0000 7f63c9ffb640 1 -- 172.21.15.53:0/3557039179 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f63c4050590 con 0x7f63d40c62f0 2023-06-10T18:52:56.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.912+0000 7f0df4907640 1 Processor -- start 2023-06-10T18:52:56.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.912+0000 7f0df4907640 1 -- start start 2023-06-10T18:52:56.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.912+0000 7f0df4907640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0df00acbe0 0x7f0df006a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:56.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.912+0000 7f0df4907640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0df00afc00 0x7f0df00c9600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:56.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.912+0000 7f0df4907640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0df00c9190 con 0x7f0df0089b00 2023-06-10T18:52:56.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.912+0000 7f0df4907640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0df00cc5a0 con 0x7f0df00acbe0 2023-06-10T18:52:56.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.912+0000 7f0df4907640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0df00cba20 con 0x7f0df00afc00 2023-06-10T18:52:56.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.912+0000 7f0def7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0df00acbe0 0x7f0df006a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:56.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.912+0000 7f0def7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0df00acbe0 0x7f0df006a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35262/0 (socket says 172.21.15.53:35262) 2023-06-10T18:52:56.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.912+0000 7f0def7fe640 1 -- 172.21.15.53:0/2573170204 learned_addr learned my addr 172.21.15.53:0/2573170204 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:56.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.916+0000 7f0deffff640 1 --2- 172.21.15.53:0/2573170204 >> v2:172.21.15.117:3300/0 conn(0x7f0df00afc00 0x7f0df00c9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:56.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.916+0000 7f0def7fe640 1 -- 172.21.15.53:0/2573170204 >> v2:172.21.15.117:3300/0 conn(0x7f0df00afc00 msgr2=0x7f0df00c9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:56.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.916+0000 7f0def7fe640 1 --2- 172.21.15.53:0/2573170204 >> v2:172.21.15.117:3300/0 conn(0x7f0df00afc00 0x7f0df00c9600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:56.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.916+0000 7f0def7fe640 1 -- 172.21.15.53:0/2573170204 >> v1:172.21.15.117:6789/0 conn(0x7f0df0089b00 legacy=0x7f0df00af4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:56.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.916+0000 7f0def7fe640 1 -- 172.21.15.53:0/2573170204 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0df00cbd00 con 0x7f0df00acbe0 2023-06-10T18:52:56.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.916+0000 7effc0835640 1 Processor -- start 2023-06-10T18:52:56.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.916+0000 7f0def7fe640 1 --2- 172.21.15.53:0/2573170204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0df00acbe0 0x7f0df006a7c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0df0071620 tx=0x7f0de0024db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4c8b654d758c29 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:56.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.920+0000 7f0dee7fc640 1 -- 172.21.15.53:0/2573170204 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de00ade80 con 0x7f0df00acbe0 2023-06-10T18:52:56.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.920+0000 7f0dee7fc640 1 -- 172.21.15.53:0/2573170204 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0de00b53f0 con 0x7f0df00acbe0 2023-06-10T18:52:56.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.920+0000 7f0dee7fc640 1 -- 172.21.15.53:0/2573170204 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de00b5760 con 0x7f0df00acbe0 2023-06-10T18:52:56.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.916+0000 7effc0835640 1 -- start start 2023-06-10T18:52:56.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.920+0000 7effc0835640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7effbc15ae00 0x7effbc06ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:56.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.920+0000 7effc0835640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7effbc0c9a80 0x7effbc0c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:56.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.920+0000 7effc0835640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effbc15b1d0 con 0x7effbc0cd170 2023-06-10T18:52:56.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.920+0000 7effc0835640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effbc0cc6b0 con 0x7effbc15ae00 2023-06-10T18:52:56.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.920+0000 7effc0835640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effbc0cba30 con 0x7effbc0c9a80 2023-06-10T18:52:56.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.920+0000 7f0df4907640 1 -- 172.21.15.53:0/2573170204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0df00acbe0 msgr2=0x7f0df006a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:56.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.920+0000 7f0df4907640 1 --2- 172.21.15.53:0/2573170204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0df00acbe0 0x7f0df006a7c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0df0071620 tx=0x7f0de0024db0 comp rx=0 tx=0).stop 2023-06-10T18:52:56.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.920+0000 7effb9d9b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7effbc0cd170 0x7effbc0cd5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:36038/0 (socket says 172.21.15.53:36038) 2023-06-10T18:52:56.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.920+0000 7effb9d9b640 1 -- 172.21.15.53:0/989737682 learned_addr learned my addr 172.21.15.53:0/989737682 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:52:56.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.920+0000 7effbad9d640 1 --2- 172.21.15.53:0/989737682 >> v2:172.21.15.117:3300/0 conn(0x7effbc0c9a80 0x7effbc0c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:56.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.920+0000 7f0df4907640 1 -- 172.21.15.53:0/2573170204 shutdown_connections 2023-06-10T18:52:56.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.920+0000 7f0df4907640 1 --2- 172.21.15.53:0/2573170204 >> v2:172.21.15.117:3300/0 conn(0x7f0df00afc00 0x7f0df00c9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:56.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.920+0000 7f0df4907640 1 --2- 172.21.15.53:0/2573170204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0df00acbe0 0x7f0df006a7c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:56.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.920+0000 7f0df4907640 1 -- 172.21.15.53:0/2573170204 >> 172.21.15.53:0/2573170204 conn(0x7f0df006a090 msgr2=0x7f0df00ca4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:56.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.920+0000 7effb959a640 1 -- 172.21.15.53:0/989737682 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2777471622 0 0) 0x7effbc15b1d0 con 0x7effbc0cd170 2023-06-10T18:52:56.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.920+0000 7f0df4907640 1 -- 172.21.15.53:0/2573170204 shutdown_connections 2023-06-10T18:52:56.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.920+0000 7effb959a640 1 -- 172.21.15.53:0/989737682 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effa4003530 con 0x7effbc0cd170 2023-06-10T18:52:56.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.920+0000 7f0df4907640 1 -- 172.21.15.53:0/2573170204 wait complete. 2023-06-10T18:52:56.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.920+0000 7f0df4907640 1 Processor -- start 2023-06-10T18:52:56.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.920+0000 7f0df4907640 1 -- start start 2023-06-10T18:52:56.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.920+0000 7f0df4907640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0df0089b00 0x7f0df00c0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:56.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.924+0000 7f4b13240640 1 Processor -- start 2023-06-10T18:52:56.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.920+0000 7effbad9d640 1 -- 172.21.15.53:0/989737682 >> v2:172.21.15.53:3300/0 conn(0x7effbc15ae00 msgr2=0x7effbc06ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:56.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.920+0000 7effbad9d640 1 --2- 172.21.15.53:0/989737682 >> v2:172.21.15.53:3300/0 conn(0x7effbc15ae00 0x7effbc06ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:56.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.920+0000 7effbad9d640 1 -- 172.21.15.53:0/989737682 >> v1:172.21.15.53:6789/0 conn(0x7effbc0cd170 legacy=0x7effbc0cd5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:56.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.920+0000 7effbad9d640 1 -- 172.21.15.53:0/989737682 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effbc0cbd10 con 0x7effbc0c9a80 2023-06-10T18:52:56.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.920+0000 7f0df4907640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0df00acbe0 0x7f0df00be280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:56.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.920+0000 7f0df4907640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0df00afc00 0x7f0df00700f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:56.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.920+0000 7f0df4907640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df00c7230 con 0x7f0df00acbe0 2023-06-10T18:52:56.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.920+0000 7f0df4907640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df00be7c0 con 0x7f0df00afc00 2023-06-10T18:52:56.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.920+0000 7f0df4907640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0df00c6610 con 0x7f0df0089b00 2023-06-10T18:52:56.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.924+0000 7f0deeffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0df00acbe0 0x7f0df00be280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:56.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.924+0000 7f0deeffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0df00acbe0 0x7f0df00be280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35284/0 (socket says 172.21.15.53:35284) 2023-06-10T18:52:56.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.924+0000 7f0deeffd640 1 -- 172.21.15.53:0/1694930273 learned_addr learned my addr 172.21.15.53:0/1694930273 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:56.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.924+0000 7f0def7fe640 1 --2- 172.21.15.53:0/1694930273 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0df0089b00 0x7f0df00c0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:56.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.924+0000 7f0deeffd640 1 -- 172.21.15.53:0/1694930273 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0df0089b00 msgr2=0x7f0df00c0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:56.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.924+0000 7f0deeffd640 1 --2- 172.21.15.53:0/1694930273 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0df0089b00 0x7f0df00c0ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:56.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.924+0000 7f0deeffd640 1 -- 172.21.15.53:0/1694930273 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0df00afc00 msgr2=0x7f0df00700f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-06-10T18:52:56.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.924+0000 7f0deeffd640 1 --2- 172.21.15.53:0/1694930273 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0df00afc00 0x7f0df00700f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:56.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.924+0000 7f0deeffd640 1 -- 172.21.15.53:0/1694930273 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0de0008550 con 0x7f0df00acbe0 2023-06-10T18:52:56.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.924+0000 7f0deeffd640 1 --2- 172.21.15.53:0/1694930273 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0df00acbe0 0x7f0df00be280 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0de800c7d0 tx=0x7f0de800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:56.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.924+0000 7f0dd7fff640 1 -- 172.21.15.53:0/1694930273 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de8003b80 con 0x7f0df00acbe0 2023-06-10T18:52:56.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.924+0000 7f0df4907640 1 -- 172.21.15.53:0/1694930273 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0df00c6890 con 0x7f0df00acbe0 2023-06-10T18:52:56.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.924+0000 7f0df4907640 1 -- 172.21.15.53:0/1694930273 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0df00c6e50 con 0x7f0df00acbe0 2023-06-10T18:52:56.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.924+0000 7effbad9d640 1 --2- 172.21.15.53:0/989737682 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effbc0c9a80 0x7effbc0c9e80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7effbc0c15a0 tx=0x7effac01d790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25c1127436415b8e server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:56.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.924+0000 7effb959a640 1 -- 172.21.15.53:0/989737682 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effac0a6840 con 0x7effbc0c9a80 2023-06-10T18:52:56.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.924+0000 7effb959a640 1 -- 172.21.15.53:0/989737682 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effac0a69a0 con 0x7effbc0c9a80 2023-06-10T18:52:56.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.924+0000 7effb959a640 1 -- 172.21.15.53:0/989737682 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effac0a6d10 con 0x7effbc0c9a80 2023-06-10T18:52:56.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.924+0000 7f0dd7fff640 1 -- 172.21.15.53:0/1694930273 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0de8003ce0 con 0x7f0df00acbe0 2023-06-10T18:52:56.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.924+0000 7f0dd7fff640 1 -- 172.21.15.53:0/1694930273 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de800aa70 con 0x7f0df00acbe0 2023-06-10T18:52:56.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.924+0000 7effc0835640 1 -- 172.21.15.53:0/989737682 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effbc0c9a80 msgr2=0x7effbc0c9e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:56.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.924+0000 7effc0835640 1 --2- 172.21.15.53:0/989737682 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effbc0c9a80 0x7effbc0c9e80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7effbc0c15a0 tx=0x7effac01d790 comp rx=0 tx=0).stop 2023-06-10T18:52:56.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.924+0000 7f4b13240640 1 -- start start 2023-06-10T18:52:56.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.924+0000 7f4b13240640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4b0c15ae00 0x7f4b0c06ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:56.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.924+0000 7f4b13240640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b0c0cd170 0x7f4b0c0cd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:56.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.924+0000 7f4b13240640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b0c0cdb30 con 0x7f4b0c0c9a80 2023-06-10T18:52:56.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.924+0000 7f4b13240640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b0c0cc6b0 con 0x7f4b0c15ae00 2023-06-10T18:52:56.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.924+0000 7f4b13240640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0c15b1d0 con 0x7f4b0c0cd170 2023-06-10T18:52:56.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.924+0000 7f4b0bfff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b0c0cd170 0x7f4b0c0cd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:56.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.924+0000 7f4b0bfff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b0c0cd170 0x7f4b0c0cd5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.53:34852/0 (socket says 172.21.15.53:34852) 2023-06-10T18:52:56.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.924+0000 7f4b0bfff640 1 -- 172.21.15.53:0/2750638748 learned_addr learned my addr 172.21.15.53:0/2750638748 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:56.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.924+0000 7f4b10fdc640 1 --2- 172.21.15.53:0/2750638748 >> v2:172.21.15.53:3300/0 conn(0x7f4b0c15ae00 0x7f4b0c06ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:56.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.924+0000 7f4b0bfff640 1 -- 172.21.15.53:0/2750638748 >> v2:172.21.15.53:3300/0 conn(0x7f4b0c15ae00 msgr2=0x7f4b0c06ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:56.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.924+0000 7f4b0bfff640 1 --2- 172.21.15.53:0/2750638748 >> v2:172.21.15.53:3300/0 conn(0x7f4b0c15ae00 0x7f4b0c06ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:56.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.924+0000 7f4b0bfff640 1 -- 172.21.15.53:0/2750638748 >> v1:172.21.15.53:6789/0 conn(0x7f4b0c0c9a80 legacy=0x7f4b0c0c9ec0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-10T18:52:56.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.924+0000 7f4b0bfff640 1 -- 172.21.15.53:0/2750638748 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b0c0cba30 con 0x7f4b0c0cd170 2023-06-10T18:52:56.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.924+0000 7effc0835640 1 -- 172.21.15.53:0/989737682 shutdown_connections 2023-06-10T18:52:56.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.924+0000 7effc0835640 1 --2- 172.21.15.53:0/989737682 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effbc0c9a80 0x7effbc0c9e80 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:56.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.924+0000 7effc0835640 1 --2- 172.21.15.53:0/989737682 >> v2:172.21.15.53:3300/0 conn(0x7effbc15ae00 0x7effbc06ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:56.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.924+0000 7effc0835640 1 -- 172.21.15.53:0/989737682 >> 172.21.15.53:0/989737682 conn(0x7effbc0ce9e0 msgr2=0x7effbc0ca7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:56.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.924+0000 7effc0835640 1 -- 172.21.15.53:0/989737682 shutdown_connections 2023-06-10T18:52:56.944 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.924+0000 7effc0835640 1 -- 172.21.15.53:0/989737682 wait complete. 2023-06-10T18:52:56.944 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.924+0000 7f7e30d68640 1 Processor -- start 2023-06-10T18:52:56.944 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.924+0000 7f7e30d68640 1 -- start start 2023-06-10T18:52:56.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.924+0000 7f0dd7fff640 1 -- 172.21.15.53:0/1694930273 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0de800abd0 con 0x7f0df00acbe0 2023-06-10T18:52:56.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.928+0000 7f0dd7fff640 1 --2- 172.21.15.53:0/1694930273 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0ddc0662b0 0x7f0ddc068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:56.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.928+0000 7f0dd7fff640 1 -- 172.21.15.53:0/1694930273 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0de8083be0 con 0x7f0df00acbe0 2023-06-10T18:52:56.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.928+0000 7f0def7fe640 1 --2- 172.21.15.53:0/1694930273 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0ddc0662b0 0x7f0ddc068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:56.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.928+0000 7f4b10fdc640 1 --2- 172.21.15.53:0/2750638748 >> v2:172.21.15.53:3300/0 conn(0x7f4b0c15ae00 0x7f4b0c06ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:52:56.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.928+0000 7effc0835640 1 Processor -- start 2023-06-10T18:52:56.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.928+0000 7f7e30d68640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7e2c070d10 0x7f7e2c06ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:56.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.928+0000 7f0def7fe640 1 --2- 172.21.15.53:0/1694930273 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0ddc0662b0 0x7f0ddc068760 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0de00b6000 tx=0x7f0de00af070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:56.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.928+0000 7effc0835640 1 -- start start 2023-06-10T18:52:56.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.928+0000 7f7e2b7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f7e2c1584c0 0x7f7e2c0b0600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:36054/0 (socket says 172.21.15.53:36054) 2023-06-10T18:52:56.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.928+0000 7f7e30d68640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e2c0b1250 con 0x7f7e2c1584c0 2023-06-10T18:52:56.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.928+0000 7f7e30d68640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e2c0b0d10 con 0x7f7e2c0cc750 2023-06-10T18:52:56.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.928+0000 7f7e30d68640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e2c06cf60 con 0x7f7e2c070d10 2023-06-10T18:52:56.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.928+0000 7f7e2affd640 1 --2- 172.21.15.53:0/4069830125 >> v2:172.21.15.117:3300/0 conn(0x7f7e2c070d10 0x7f7e2c06ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:56.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.928+0000 7f7e2b7fe640 1 -- 172.21.15.53:0/4069830125 learned_addr learned my addr 172.21.15.53:0/4069830125 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:52:56.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.928+0000 7f7e2affd640 1 -- 172.21.15.53:0/4069830125 >> v1:172.21.15.117:6789/0 conn(0x7f7e2c0cc750 legacy=0x7f7e2c0ccb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:56.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.928+0000 7f7e2affd640 1 -- 172.21.15.53:0/4069830125 >> v1:172.21.15.53:6789/0 conn(0x7f7e2c1584c0 legacy=0x7f7e2c0b0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:56.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.928+0000 7f7e2affd640 1 -- 172.21.15.53:0/4069830125 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e2c06bf80 con 0x7f7e2c070d10 2023-06-10T18:52:56.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.928+0000 7f7e2a7fc640 1 -- 172.21.15.53:0/4069830125 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2275732111 0 0) 0x7f7e2c0b1250 con 0x7f7e2c1584c0 2023-06-10T18:52:56.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.928+0000 7effc0835640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7effbc0c9a80 0x7effbc1479c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:56.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.928+0000 7effc0835640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effbc0cd170 0x7effbc149880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:56.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.928+0000 7effc0835640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effbc15ae00 0x7effbc0aece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:56.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.928+0000 7effc0835640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effbc149dc0 con 0x7effbc0c9a80 2023-06-10T18:52:56.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.928+0000 7effc0835640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effbc152950 con 0x7effbc15ae00 2023-06-10T18:52:56.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.928+0000 7effc0835640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effbc0af960 con 0x7effbc0cd170 2023-06-10T18:52:56.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.928+0000 7effba59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7effbc0c9a80 0x7effbc1479c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:56.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.928+0000 7effba59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7effbc0c9a80 0x7effbc1479c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35310/0 (socket says 172.21.15.53:35310) 2023-06-10T18:52:56.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.928+0000 7effba59c640 1 -- 172.21.15.53:0/2810231211 learned_addr learned my addr 172.21.15.53:0/2810231211 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:56.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.928+0000 7effbad9d640 1 --2- 172.21.15.53:0/2810231211 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effbc15ae00 0x7effbc0aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:56.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.928+0000 7effb9d9b640 1 --2- 172.21.15.53:0/2810231211 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effbc0cd170 0x7effbc149880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:56.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.928+0000 7f0df4907640 1 -- 172.21.15.53:0/1694930273 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dd0005260 con 0x7f0df00acbe0 2023-06-10T18:52:56.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.928+0000 7f4b0bfff640 1 --2- 172.21.15.53:0/2750638748 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b0c0cd170 0x7f4b0c0cd5f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4b04009e50 tx=0x7f4b0401c930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c01147575c8379a6 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:56.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.928+0000 7effba59c640 1 -- 172.21.15.53:0/2810231211 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effbc0cd170 msgr2=0x7effbc149880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:56.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.928+0000 7effba59c640 1 --2- 172.21.15.53:0/2810231211 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effbc0cd170 0x7effbc149880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:56.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.928+0000 7effba59c640 1 -- 172.21.15.53:0/2810231211 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effbc15ae00 msgr2=0x7effbc0aece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:56.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.928+0000 7effba59c640 1 --2- 172.21.15.53:0/2810231211 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effbc15ae00 0x7effbc0aece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:56.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.928+0000 7effba59c640 1 -- 172.21.15.53:0/2810231211 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effac00a5c0 con 0x7effbc0c9a80 2023-06-10T18:52:56.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.932+0000 7f4b0b7fe640 1 -- 172.21.15.53:0/2750638748 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b040a5790 con 0x7f4b0c0cd170 2023-06-10T18:52:56.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.932+0000 7f4b0b7fe640 1 -- 172.21.15.53:0/2750638748 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b040a58f0 con 0x7f4b0c0cd170 2023-06-10T18:52:56.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.932+0000 7f4b0b7fe640 1 -- 172.21.15.53:0/2750638748 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b040a5c80 con 0x7f4b0c0cd170 2023-06-10T18:52:56.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.932+0000 7effba59c640 1 --2- 172.21.15.53:0/2810231211 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7effbc0c9a80 0x7effbc1479c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7effb000b410 tx=0x7effb000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:56.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.932+0000 7f4b13240640 1 -- 172.21.15.53:0/2750638748 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b0c0cd170 msgr2=0x7f4b0c0cd5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:56.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.932+0000 7f4b13240640 1 --2- 172.21.15.53:0/2750638748 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b0c0cd170 0x7f4b0c0cd5f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4b04009e50 tx=0x7f4b0401c930 comp rx=0 tx=0).stop 2023-06-10T18:52:56.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.932+0000 7f4b13240640 1 -- 172.21.15.53:0/2750638748 shutdown_connections 2023-06-10T18:52:56.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.932+0000 7f4b13240640 1 --2- 172.21.15.53:0/2750638748 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b0c0cd170 0x7f4b0c0cd5f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:56.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.932+0000 7f4b13240640 1 --2- 172.21.15.53:0/2750638748 >> v2:172.21.15.53:3300/0 conn(0x7f4b0c15ae00 0x7f4b0c06ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:56.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.932+0000 7f4b13240640 1 -- 172.21.15.53:0/2750638748 >> 172.21.15.53:0/2750638748 conn(0x7f4b0c0ce9e0 msgr2=0x7f4b0c0ca7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:56.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.932+0000 7f4b13240640 1 -- 172.21.15.53:0/2750638748 shutdown_connections 2023-06-10T18:52:56.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.932+0000 7f4b13240640 1 -- 172.21.15.53:0/2750638748 wait complete. 2023-06-10T18:52:56.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.932+0000 7f7e2affd640 1 --2- 172.21.15.53:0/4069830125 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e2c070d10 0x7f7e2c06ca20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7e200097c0 tx=0x7f7e2001c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=77249a0a2b69a8fe server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:56.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.932+0000 7f7e2a7fc640 1 -- 172.21.15.53:0/4069830125 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e200ac620 con 0x7f7e2c070d10 2023-06-10T18:52:56.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.932+0000 7f7e2a7fc640 1 -- 172.21.15.53:0/4069830125 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e200ac780 con 0x7f7e2c070d10 2023-06-10T18:52:56.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.932+0000 7f7e2a7fc640 1 -- 172.21.15.53:0/4069830125 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e200acb10 con 0x7f7e2c070d10 2023-06-10T18:52:56.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.932+0000 7ff75ca44640 1 Processor -- start 2023-06-10T18:52:56.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.932+0000 7f4b13240640 1 Processor -- start 2023-06-10T18:52:56.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.936+0000 7f7e30d68640 1 -- 172.21.15.53:0/4069830125 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e2c070d10 msgr2=0x7f7e2c06ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:56.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.936+0000 7f7e30d68640 1 --2- 172.21.15.53:0/4069830125 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e2c070d10 0x7f7e2c06ca20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7e200097c0 tx=0x7f7e2001c3c0 comp rx=0 tx=0).stop 2023-06-10T18:52:56.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.932+0000 7ff75ca44640 1 -- start start 2023-06-10T18:52:56.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.936+0000 7ff75ca44640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff7500e6c30 0x7ff7500eb160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:56.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.936+0000 7ff75ca44640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff75004a240 0x7ff7500e7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:56.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.936+0000 7ff75ca44640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7500e7fd0 con 0x7ff7500548f0 2023-06-10T18:52:56.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.936+0000 7ff75ca44640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff750056970 con 0x7ff7500e6c30 2023-06-10T18:52:56.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.936+0000 7ff75ca44640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff750054d60 con 0x7ff75004a240 2023-06-10T18:52:56.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.936+0000 7ff75659c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff7500e6c30 0x7ff7500eb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:56.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.936+0000 7ff75659c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff7500e6c30 0x7ff7500eb160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35322/0 (socket says 172.21.15.53:35322) 2023-06-10T18:52:56.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.936+0000 7ff75659c640 1 -- 172.21.15.53:0/1838261973 learned_addr learned my addr 172.21.15.53:0/1838261973 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:56.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.936+0000 7f4b13240640 1 -- start start 2023-06-10T18:52:56.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.936+0000 7ff756d9d640 1 --2- 172.21.15.53:0/1838261973 >> v2:172.21.15.117:3300/0 conn(0x7ff75004a240 0x7ff7500e7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:56.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.936+0000 7f7e30d68640 1 -- 172.21.15.53:0/4069830125 shutdown_connections 2023-06-10T18:52:56.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.936+0000 7f7e30d68640 1 --2- 172.21.15.53:0/4069830125 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e2c070d10 0x7f7e2c06ca20 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:56.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.936+0000 7f7e30d68640 1 -- 172.21.15.53:0/4069830125 >> 172.21.15.53:0/4069830125 conn(0x7f7e2c0cb600 msgr2=0x7f7e2c0cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:56.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.936+0000 7f0dd7fff640 1 -- 172.21.15.53:0/1694930273 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0de8050fc0 con 0x7f0df00acbe0 2023-06-10T18:52:56.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.936+0000 7effaaffd640 1 -- 172.21.15.53:0/2810231211 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb0010a90 con 0x7effbc0c9a80 2023-06-10T18:52:56.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.936+0000 7effc0835640 1 -- 172.21.15.53:0/2810231211 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effbc152ba0 con 0x7effbc0c9a80 2023-06-10T18:52:56.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.936+0000 7effc0835640 1 -- 172.21.15.53:0/2810231211 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effbc153160 con 0x7effbc0c9a80 2023-06-10T18:52:56.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.936+0000 7effaaffd640 1 -- 172.21.15.53:0/2810231211 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effb0010bf0 con 0x7effbc0c9a80 2023-06-10T18:52:56.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.936+0000 7effaaffd640 1 -- 172.21.15.53:0/2810231211 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb0022440 con 0x7effbc0c9a80 2023-06-10T18:52:56.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.940+0000 7effaaffd640 1 -- 172.21.15.53:0/2810231211 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7effb00225a0 con 0x7effbc0c9a80 2023-06-10T18:52:56.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.940+0000 7effaaffd640 1 --2- 172.21.15.53:0/2810231211 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7eff9c066280 0x7eff9c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:56.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.940+0000 7effaaffd640 1 -- 172.21.15.53:0/2810231211 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7effb0058870 con 0x7effbc0c9a80 2023-06-10T18:52:56.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.940+0000 7effb9d9b640 1 --2- 172.21.15.53:0/2810231211 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7eff9c066280 0x7eff9c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:56.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.940+0000 7f4b13240640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b0c0c9a80 0x7f4b0c1f7a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:56.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.940+0000 7f4b13240640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b0c0cd170 0x7f4b0c150ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:56.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.936+0000 7ff75659c640 1 -- 172.21.15.53:0/1838261973 >> v2:172.21.15.117:3300/0 conn(0x7ff75004a240 msgr2=0x7ff7500e7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:56.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.940+0000 7f4b13240640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4b0c15ae00 0x7f4b0c151020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:56.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.940+0000 7f4b10fdc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b0c0c9a80 0x7f4b0c1f7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:56.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.936+0000 7ff75659c640 1 --2- 172.21.15.53:0/1838261973 >> v2:172.21.15.117:3300/0 conn(0x7ff75004a240 0x7ff7500e7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:56.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.940+0000 7f4b13240640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0c149ce0 con 0x7f4b0c15ae00 2023-06-10T18:52:56.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.936+0000 7ff75659c640 1 -- 172.21.15.53:0/1838261973 >> v1:172.21.15.117:6789/0 conn(0x7ff7500548f0 legacy=0x7ff750049b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:56.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.940+0000 7f4b13240640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0c06f530 con 0x7f4b0c0c9a80 2023-06-10T18:52:56.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.940+0000 7f4b13240640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0c14f4d0 con 0x7f4b0c0cd170 2023-06-10T18:52:56.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.940+0000 7f4b10fdc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b0c0c9a80 0x7f4b0c1f7a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.53:50718/0 (socket says 172.21.15.53:50718) 2023-06-10T18:52:56.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.940+0000 7f4b10fdc640 1 -- 172.21.15.53:0/4109150184 learned_addr learned my addr 172.21.15.53:0/4109150184 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:56.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.940+0000 7f4b0bfff640 1 --2- 172.21.15.53:0/4109150184 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b0c0cd170 0x7f4b0c150ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:56.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.940+0000 7f7e30d68640 1 -- 172.21.15.53:0/4069830125 shutdown_connections 2023-06-10T18:52:56.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.936+0000 7ff75659c640 1 -- 172.21.15.53:0/1838261973 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff750055040 con 0x7ff7500e6c30 2023-06-10T18:52:56.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.940+0000 7ff75659c640 1 --2- 172.21.15.53:0/1838261973 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff7500e6c30 0x7ff7500eb160 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff750051320 tx=0x7ff74801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66036769bae891e1 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:56.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.940+0000 7ff75559a640 1 -- 172.21.15.53:0/1838261973 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7480ab5f0 con 0x7ff7500e6c30 2023-06-10T18:52:56.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.940+0000 7ff75559a640 1 -- 172.21.15.53:0/1838261973 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7480ab750 con 0x7ff7500e6c30 2023-06-10T18:52:56.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.940+0000 7ff75559a640 1 -- 172.21.15.53:0/1838261973 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7480abae0 con 0x7ff7500e6c30 2023-06-10T18:52:56.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.940+0000 7effc0835640 1 -- 172.21.15.53:0/2810231211 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effa0005260 con 0x7effbc0c9a80 2023-06-10T18:52:56.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.940+0000 7f4b117dd640 1 --2- 172.21.15.53:0/4109150184 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4b0c15ae00 0x7f4b0c151020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:56.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.940+0000 7f4b117dd640 1 -- 172.21.15.53:0/4109150184 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b0c0cd170 msgr2=0x7f4b0c150ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:56.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.940+0000 7f4b117dd640 1 --2- 172.21.15.53:0/4109150184 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b0c0cd170 0x7f4b0c150ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:56.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.940+0000 7f4b117dd640 1 -- 172.21.15.53:0/4109150184 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b0c0c9a80 msgr2=0x7f4b0c1f7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:56.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.940+0000 7f4b117dd640 1 --2- 172.21.15.53:0/4109150184 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b0c0c9a80 0x7f4b0c1f7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:56.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.940+0000 7f4b117dd640 1 -- 172.21.15.53:0/4109150184 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b04009b30 con 0x7f4b0c15ae00 2023-06-10T18:52:56.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.940+0000 7f4b117dd640 1 --2- 172.21.15.53:0/4109150184 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4b0c15ae00 0x7f4b0c151020 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4afc00b410 tx=0x7f4afc00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:56.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.940+0000 7ff75ca44640 1 -- 172.21.15.53:0/1838261973 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff7500e6c30 msgr2=0x7ff7500eb160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:56.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.940+0000 7ff75ca44640 1 --2- 172.21.15.53:0/1838261973 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff7500e6c30 0x7ff7500eb160 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff750051320 tx=0x7ff74801c4d0 comp rx=0 tx=0).stop 2023-06-10T18:52:56.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.940+0000 7f7e30d68640 1 -- 172.21.15.53:0/4069830125 wait complete. 2023-06-10T18:52:56.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.940+0000 7f7e30d68640 1 Processor -- start 2023-06-10T18:52:56.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.940+0000 7ff75ca44640 1 -- 172.21.15.53:0/1838261973 shutdown_connections 2023-06-10T18:52:56.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.940+0000 7ff75ca44640 1 --2- 172.21.15.53:0/1838261973 >> v2:172.21.15.117:3300/0 conn(0x7ff75004a240 0x7ff7500e7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:56.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.940+0000 7ff75ca44640 1 --2- 172.21.15.53:0/1838261973 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff7500e6c30 0x7ff7500eb160 secure :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff750051320 tx=0x7ff74801c4d0 comp rx=0 tx=0).stop 2023-06-10T18:52:56.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.940+0000 7ff75ca44640 1 -- 172.21.15.53:0/1838261973 >> 172.21.15.53:0/1838261973 conn(0x7ff75000c210 msgr2=0x7ff75000c610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:56.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.940+0000 7f7e30d68640 1 -- start start 2023-06-10T18:52:56.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.944+0000 7f7e30d68640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e2c070d10 0x7f7e2c0c31c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:56.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.944+0000 7ff75ca44640 1 -- 172.21.15.53:0/1838261973 shutdown_connections 2023-06-10T18:52:56.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.944+0000 7f7e2b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e2c070d10 0x7f7e2c0c31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:56.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.944+0000 7f7e2b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e2c070d10 0x7f7e2c0c31c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35342/0 (socket says 172.21.15.53:35342) 2023-06-10T18:52:56.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.944+0000 7f7e2b7fe640 1 -- 172.21.15.53:0/1744644687 learned_addr learned my addr 172.21.15.53:0/1744644687 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:56.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.944+0000 7f7e30d68640 1 --2- 172.21.15.53:0/1744644687 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e2c0cc750 0x7f7e2c0c18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:56.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.944+0000 7f7e30d68640 1 --2- 172.21.15.53:0/1744644687 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e2c1584c0 0x7f7e2c0c48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:56.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.944+0000 7f7e30d68640 1 -- 172.21.15.53:0/1744644687 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2c158920 con 0x7f7e2c070d10 2023-06-10T18:52:56.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.944+0000 7f7e30d68640 1 -- 172.21.15.53:0/1744644687 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2c0c4440 con 0x7f7e2c1584c0 2023-06-10T18:52:56.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.944+0000 7f7e2affd640 1 --2- 172.21.15.53:0/1744644687 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e2c0cc750 0x7f7e2c0c18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:56.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.944+0000 7f7e2bfff640 1 --2- 172.21.15.53:0/1744644687 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e2c1584c0 0x7f7e2c0c48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:56.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.944+0000 7f7e30d68640 1 -- 172.21.15.53:0/1744644687 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2c0b4800 con 0x7f7e2c0cc750 2023-06-10T18:52:56.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.944+0000 7effaaffd640 1 -- 172.21.15.53:0/2810231211 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7effb0054bb0 con 0x7effbc0c9a80 2023-06-10T18:52:56.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.944+0000 7effb9d9b640 1 --2- 172.21.15.53:0/2810231211 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7eff9c066280 0x7eff9c068730 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7effbc06f4d0 tx=0x7effb400a040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:56.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.944+0000 7f4b097fa640 1 -- 172.21.15.53:0/4109150184 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4afc011830 con 0x7f4b0c15ae00 2023-06-10T18:52:56.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.944+0000 7f7e2b7fe640 1 -- 172.21.15.53:0/1744644687 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e2c0cc750 msgr2=0x7f7e2c0c18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:56.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.944+0000 7f7e2b7fe640 1 --2- 172.21.15.53:0/1744644687 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e2c0cc750 0x7f7e2c0c18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:56.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.944+0000 7f7e2b7fe640 1 -- 172.21.15.53:0/1744644687 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e2c1584c0 msgr2=0x7f7e2c0c48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:56.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.944+0000 7f7e2b7fe640 1 --2- 172.21.15.53:0/1744644687 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e2c1584c0 0x7f7e2c0c48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:56.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.944+0000 7f7e2b7fe640 1 -- 172.21.15.53:0/1744644687 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e20009420 con 0x7f7e2c070d10 2023-06-10T18:52:56.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.944+0000 7f7e2b7fe640 1 --2- 172.21.15.53:0/1744644687 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e2c070d10 0x7f7e2c0c31c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c007fd0 tx=0x7f7e1c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:56.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.944+0000 7ff75ca44640 1 -- 172.21.15.53:0/1838261973 wait complete. 2023-06-10T18:52:56.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.944+0000 7ff75ca44640 1 Processor -- start 2023-06-10T18:52:56.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.944+0000 7ff75ca44640 1 -- start start 2023-06-10T18:52:56.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.944+0000 7f4b13240640 1 -- 172.21.15.53:0/4109150184 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b0c151560 con 0x7f4b0c15ae00 2023-06-10T18:52:56.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.944+0000 7f4b13240640 1 -- 172.21.15.53:0/4109150184 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b0c14ee80 con 0x7f4b0c15ae00 2023-06-10T18:52:56.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.948+0000 7f4b13240640 1 -- 172.21.15.53:0/4109150184 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b0c06f6a0 con 0x7f4b0c15ae00 2023-06-10T18:52:56.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.948+0000 7f7e13fff640 1 -- 172.21.15.53:0/1744644687 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1c005cf0 con 0x7f7e2c070d10 2023-06-10T18:52:56.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.948+0000 7f7e30d68640 1 -- 172.21.15.53:0/1744644687 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e2c0c3830 con 0x7f7e2c070d10 2023-06-10T18:52:56.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.948+0000 7f7e30d68640 1 -- 172.21.15.53:0/1744644687 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e2c0c3df0 con 0x7f7e2c070d10 2023-06-10T18:52:56.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.948+0000 7ff75ca44640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff75004a240 0x7ff750187270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:56.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.948+0000 7ff75ca44640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7500548f0 0x7ff75004ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:56.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.948+0000 7ff75ca44640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff75004f450 0x7ff75004bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:56.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.948+0000 7ff75ca44640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff75004d4b0 con 0x7ff75004f450 2023-06-10T18:52:56.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.948+0000 7ff75659c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff75004a240 0x7ff750187270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:56.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.948+0000 7ff755d9b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7500548f0 0x7ff75004ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:56.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.948+0000 7ff755d9b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7500548f0 0x7ff75004ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.53:50734/0 (socket says 172.21.15.53:50734) 2023-06-10T18:52:56.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.948+0000 7ff755d9b640 1 -- 172.21.15.53:0/4029391918 learned_addr learned my addr 172.21.15.53:0/4029391918 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:56.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.948+0000 7f7e13fff640 1 -- 172.21.15.53:0/1744644687 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e1c005e70 con 0x7f7e2c070d10 2023-06-10T18:52:56.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.948+0000 7f7e30d68640 1 -- 172.21.15.53:0/1744644687 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e2c04dfe0 con 0x7f7e2c070d10 2023-06-10T18:52:56.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.948+0000 7ff75ca44640 1 -- 172.21.15.53:0/4029391918 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff75004f8f0 con 0x7ff7500548f0 2023-06-10T18:52:56.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.948+0000 7ff75ca44640 1 -- 172.21.15.53:0/4029391918 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff750039ed0 con 0x7ff75004a240 2023-06-10T18:52:56.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.948+0000 7f7e13fff640 1 -- 172.21.15.53:0/1744644687 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1c0072f0 con 0x7f7e2c070d10 2023-06-10T18:52:56.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.948+0000 7ff756d9d640 1 --2- 172.21.15.53:0/4029391918 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff75004f450 0x7ff75004bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:56.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.948+0000 7ff755d9b640 1 -- 172.21.15.53:0/4029391918 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff75004a240 msgr2=0x7ff750187270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:56.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.948+0000 7ff755d9b640 1 --2- 172.21.15.53:0/4029391918 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff75004a240 0x7ff750187270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:56.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.948+0000 7ff755d9b640 1 -- 172.21.15.53:0/4029391918 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff75004f450 msgr2=0x7ff75004bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:56.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.948+0000 7ff755d9b640 1 --2- 172.21.15.53:0/4029391918 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff75004f450 0x7ff75004bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:56.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.948+0000 7ff755d9b640 1 -- 172.21.15.53:0/4029391918 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff748009480 con 0x7ff7500548f0 2023-06-10T18:52:56.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.948+0000 7ff755d9b640 1 --2- 172.21.15.53:0/4029391918 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7500548f0 0x7ff75004ef10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff74c00c370 tx=0x7ff74c00c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:56.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.948+0000 7f4b097fa640 1 -- 172.21.15.53:0/4109150184 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4afc011990 con 0x7f4b0c15ae00 2023-06-10T18:52:56.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.948+0000 7f4b097fa640 1 -- 172.21.15.53:0/4109150184 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4afc011d00 con 0x7f4b0c15ae00 2023-06-10T18:52:56.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.948+0000 7f4b097fa640 1 -- 172.21.15.53:0/4109150184 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4afc01a400 con 0x7f4b0c15ae00 2023-06-10T18:52:56.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.948+0000 7ff746ffd640 1 -- 172.21.15.53:0/4029391918 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff74c0052d0 con 0x7ff7500548f0 2023-06-10T18:52:56.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.948+0000 7ff746ffd640 1 -- 172.21.15.53:0/4029391918 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff74c005430 con 0x7ff7500548f0 2023-06-10T18:52:56.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.948+0000 7ff746ffd640 1 -- 172.21.15.53:0/4029391918 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff74c007260 con 0x7ff7500548f0 2023-06-10T18:52:56.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.948+0000 7ff75ca44640 1 -- 172.21.15.53:0/4029391918 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff75004c830 con 0x7ff7500548f0 2023-06-10T18:52:56.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.948+0000 7f4b097fa640 1 --2- 172.21.15.53:0/4109150184 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4af8066330 0x7f4af80687e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:56.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.948+0000 7ff75ca44640 1 -- 172.21.15.53:0/4029391918 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff75004cdf0 con 0x7ff7500548f0 2023-06-10T18:52:56.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.952+0000 7f4b097fa640 1 -- 172.21.15.53:0/4109150184 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4afc0838c0 con 0x7f4b0c15ae00 2023-06-10T18:52:56.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.952+0000 7f4b10fdc640 1 --2- 172.21.15.53:0/4109150184 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4af8066330 0x7f4af80687e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:56.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.952+0000 7f4b10fdc640 1 --2- 172.21.15.53:0/4109150184 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4af8066330 0x7f4af80687e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4b00006fd0 tx=0x7f4b00008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:56.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.952+0000 7ff75ca44640 1 -- 172.21.15.53:0/4029391918 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff73c005260 con 0x7ff7500548f0 2023-06-10T18:52:56.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.952+0000 7ff746ffd640 1 -- 172.21.15.53:0/4029391918 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff74c0073c0 con 0x7ff7500548f0 2023-06-10T18:52:56.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.952+0000 7ff746ffd640 1 --2- 172.21.15.53:0/4029391918 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff738066280 0x7ff738068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:56.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.952+0000 7ff746ffd640 1 -- 172.21.15.53:0/4029391918 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff74c083530 con 0x7ff7500548f0 2023-06-10T18:52:56.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.952+0000 7f4b097fa640 1 -- 172.21.15.53:0/4109150184 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4afc050e60 con 0x7f4b0c15ae00 2023-06-10T18:52:56.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.952+0000 7ff75659c640 1 --2- 172.21.15.53:0/4029391918 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff738066280 0x7ff738068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:56.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.956+0000 7ff75659c640 1 --2- 172.21.15.53:0/4029391918 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff738066280 0x7ff738068730 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff7480af000 tx=0x7ff7480a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:56.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.956+0000 7f7e13fff640 1 -- 172.21.15.53:0/1744644687 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7e1c007450 con 0x7f7e2c070d10 2023-06-10T18:52:56.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.956+0000 7f7e13fff640 1 --2- 172.21.15.53:0/1744644687 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7e18066350 0x7f7e18068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:56.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.956+0000 7f7e13fff640 1 -- 172.21.15.53:0/1744644687 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7e1c083780 con 0x7f7e2c070d10 2023-06-10T18:52:56.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.956+0000 7f7e2affd640 1 --2- 172.21.15.53:0/1744644687 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7e18066350 0x7f7e18068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:56.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.956+0000 7f7e2affd640 1 --2- 172.21.15.53:0/1744644687 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7e18066350 0x7f7e18068800 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7e200ae000 tx=0x7f7e200a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:56.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.960+0000 7f7e13fff640 1 -- 172.21.15.53:0/1744644687 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7e1c050d20 con 0x7f7e2c070d10 2023-06-10T18:52:56.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:56.964+0000 7ff746ffd640 1 -- 172.21.15.53:0/4029391918 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff74c050a50 con 0x7ff7500548f0 2023-06-10T18:52:57.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.016+0000 7f501b4de640 1 Processor -- start 2023-06-10T18:52:57.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.016+0000 7f501b4de640 1 -- start start 2023-06-10T18:52:57.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.016+0000 7f501b4de640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50140cd8f0 0x7f50140c9660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:57.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.016+0000 7f501b4de640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f50140c1010 0x7f50141609f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:57.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.016+0000 7f501b4de640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5014160560 con 0x7f5014160f30 2023-06-10T18:52:57.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.016+0000 7f501b4de640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50140ca570 con 0x7f50140c1010 2023-06-10T18:52:57.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.016+0000 7f501b4de640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50141602c0 con 0x7f50140cd8f0 2023-06-10T18:52:57.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.016+0000 7f5019a7b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f5014160f30 0x7f50141638b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:36058/0 (socket says 172.21.15.53:36058) 2023-06-10T18:52:57.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.016+0000 7f5019a7b640 1 -- 172.21.15.53:0/3187687793 learned_addr learned my addr 172.21.15.53:0/3187687793 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:52:57.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.016+0000 7f501927a640 1 --2- 172.21.15.53:0/3187687793 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50140cd8f0 0x7f50140c9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:57.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.016+0000 7f5018a79640 1 --2- 172.21.15.53:0/3187687793 >> v2:172.21.15.117:3300/0 conn(0x7f50140c1010 0x7f50141609f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:57.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.016+0000 7f501927a640 1 -- 172.21.15.53:0/3187687793 >> v2:172.21.15.117:3300/0 conn(0x7f50140c1010 msgr2=0x7f50141609f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:57.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.016+0000 7f501927a640 1 --2- 172.21.15.53:0/3187687793 >> v2:172.21.15.117:3300/0 conn(0x7f50140c1010 0x7f50141609f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:57.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.016+0000 7f501927a640 1 -- 172.21.15.53:0/3187687793 >> v1:172.21.15.53:6789/0 conn(0x7f5014160f30 legacy=0x7f50141638b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:57.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.016+0000 7f501927a640 1 -- 172.21.15.53:0/3187687793 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50140c9cd0 con 0x7f50140cd8f0 2023-06-10T18:52:57.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.016+0000 7f500bfff640 1 -- 172.21.15.53:0/3187687793 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2429583272 0 0) 0x7f5014160560 con 0x7f5014160f30 2023-06-10T18:52:57.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.020+0000 7f501927a640 1 --2- 172.21.15.53:0/3187687793 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50140cd8f0 0x7f50140c9660 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f500c009d90 tx=0x7f500c01c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee643cfbb43219dd server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:57.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.020+0000 7f500bfff640 1 -- 172.21.15.53:0/3187687793 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f500c0a58f0 con 0x7f50140cd8f0 2023-06-10T18:52:57.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.020+0000 7f500bfff640 1 -- 172.21.15.53:0/3187687793 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f500c0a5a50 con 0x7f50140cd8f0 2023-06-10T18:52:57.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.020+0000 7f501b4de640 1 -- 172.21.15.53:0/3187687793 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50140cd8f0 msgr2=0x7f50140c9660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:57.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.020+0000 7f501b4de640 1 --2- 172.21.15.53:0/3187687793 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50140cd8f0 0x7f50140c9660 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f500c009d90 tx=0x7f500c01c850 comp rx=0 tx=0).stop 2023-06-10T18:52:57.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.020+0000 7f501b4de640 1 -- 172.21.15.53:0/3187687793 shutdown_connections 2023-06-10T18:52:57.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.020+0000 7f501b4de640 1 --2- 172.21.15.53:0/3187687793 >> v2:172.21.15.117:3300/0 conn(0x7f50140c1010 0x7f50141609f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:57.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.020+0000 7f501b4de640 1 --2- 172.21.15.53:0/3187687793 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50140cd8f0 0x7f50140c9660 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:57.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.020+0000 7f501b4de640 1 -- 172.21.15.53:0/3187687793 >> 172.21.15.53:0/3187687793 conn(0x7f50140ce9e0 msgr2=0x7f50140ca7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:57.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.024+0000 7f501b4de640 1 -- 172.21.15.53:0/3187687793 shutdown_connections 2023-06-10T18:52:57.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.024+0000 7f501b4de640 1 -- 172.21.15.53:0/3187687793 wait complete. 2023-06-10T18:52:57.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.024+0000 7f501b4de640 1 Processor -- start 2023-06-10T18:52:57.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.024+0000 7f501b4de640 1 -- start start 2023-06-10T18:52:57.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.024+0000 7f501b4de640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50140c1010 0x7f501414cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:57.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.024+0000 7f501b4de640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50140cd8f0 0x7f50140c6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:57.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.024+0000 7f501b4de640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5014160f30 0x7f50141534d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:57.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.024+0000 7f501b4de640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50140c6b40 con 0x7f5014160f30 2023-06-10T18:52:57.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.024+0000 7f501b4de640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5014153a10 con 0x7f50140cd8f0 2023-06-10T18:52:57.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.024+0000 7f501b4de640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f501406f0a0 con 0x7f50140c1010 2023-06-10T18:52:57.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.028+0000 7f5019a7b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5014160f30 0x7f50141534d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:57.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.028+0000 7f5019a7b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5014160f30 0x7f50141534d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35362/0 (socket says 172.21.15.53:35362) 2023-06-10T18:52:57.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.028+0000 7f5019a7b640 1 -- 172.21.15.53:0/1808389126 learned_addr learned my addr 172.21.15.53:0/1808389126 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:57.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.028+0000 7f501927a640 1 --2- 172.21.15.53:0/1808389126 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50140c1010 0x7f501414cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:57.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.028+0000 7f5018a79640 1 --2- 172.21.15.53:0/1808389126 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50140cd8f0 0x7f50140c6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:57.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.028+0000 7f5019a7b640 1 -- 172.21.15.53:0/1808389126 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50140c1010 msgr2=0x7f501414cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:57.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.028+0000 7f5019a7b640 1 --2- 172.21.15.53:0/1808389126 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50140c1010 0x7f501414cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:57.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.028+0000 7f5019a7b640 1 -- 172.21.15.53:0/1808389126 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50140cd8f0 msgr2=0x7f50140c6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:57.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.028+0000 7f5019a7b640 1 --2- 172.21.15.53:0/1808389126 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50140cd8f0 0x7f50140c6600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:57.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.028+0000 7f5019a7b640 1 -- 172.21.15.53:0/1808389126 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f500c009a70 con 0x7f5014160f30 2023-06-10T18:52:57.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.028+0000 7f5019a7b640 1 --2- 172.21.15.53:0/1808389126 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5014160f30 0x7f50141534d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f501000c3e0 tx=0x7f501000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:57.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.028+0000 7f5009ffb640 1 -- 172.21.15.53:0/1808389126 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50100074e0 con 0x7f5014160f30 2023-06-10T18:52:57.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.028+0000 7f5009ffb640 1 -- 172.21.15.53:0/1808389126 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5010007660 con 0x7f5014160f30 2023-06-10T18:52:57.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.028+0000 7f5009ffb640 1 -- 172.21.15.53:0/1808389126 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5010004a30 con 0x7f5014160f30 2023-06-10T18:52:57.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.028+0000 7f501b4de640 1 -- 172.21.15.53:0/1808389126 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50140c7610 con 0x7f5014160f30 2023-06-10T18:52:57.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.028+0000 7f501b4de640 1 -- 172.21.15.53:0/1808389126 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50140c7050 con 0x7f5014160f30 2023-06-10T18:52:57.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.032+0000 7f5009ffb640 1 -- 172.21.15.53:0/1808389126 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5010004b90 con 0x7f5014160f30 2023-06-10T18:52:57.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.032+0000 7f5009ffb640 1 --2- 172.21.15.53:0/1808389126 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4ff8066350 0x7f4ff8068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:57.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.032+0000 7f5009ffb640 1 -- 172.21.15.53:0/1808389126 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f50100838b0 con 0x7f5014160f30 2023-06-10T18:52:57.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.032+0000 7f501927a640 1 --2- 172.21.15.53:0/1808389126 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4ff8066350 0x7f4ff8068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:57.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.032+0000 7f501b4de640 1 -- 172.21.15.53:0/1808389126 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ff4005260 con 0x7f5014160f30 2023-06-10T18:52:57.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.044+0000 7f5009ffb640 1 -- 172.21.15.53:0/1808389126 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f50100548e0 con 0x7f5014160f30 2023-06-10T18:52:57.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.044+0000 7f501927a640 1 --2- 172.21.15.53:0/1808389126 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4ff8066350 0x7f4ff8068800 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f500c0af000 tx=0x7f500c0a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:57.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.160+0000 7f4115451640 1 -- 172.21.15.53:0/1161977442 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f40f0005510 con 0x7f41100b06d0 2023-06-10T18:52:57.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.160+0000 7f40f77fe640 1 -- 172.21.15.53:0/1161977442 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f41000ad090 con 0x7f41100b06d0 2023-06-10T18:52:57.172 INFO:teuthology.orchestra.run.smithi053.stdout:55834574856 2023-06-10T18:52:57.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.168+0000 7f40f57fa640 1 -- 172.21.15.53:0/1161977442 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f40fc0663d0 msgr2=0x7f40fc068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:57.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.168+0000 7f40f57fa640 1 --2- 172.21.15.53:0/1161977442 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f40fc0663d0 0x7f40fc068880 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4104007fd0 tx=0x7f41040079a0 comp rx=0 tx=0).stop 2023-06-10T18:52:57.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.168+0000 7f40f57fa640 1 -- 172.21.15.53:0/1161977442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f41100b06d0 msgr2=0x7f41100b3f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:57.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.168+0000 7f40f57fa640 1 --2- 172.21.15.53:0/1161977442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f41100b06d0 0x7f41100b3f50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4100006fd0 tx=0x7f410001b6a0 comp rx=0 tx=0).stop 2023-06-10T18:52:57.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.168+0000 7f40f57fa640 1 -- 172.21.15.53:0/1161977442 shutdown_connections 2023-06-10T18:52:57.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.168+0000 7f40f57fa640 1 --2- 172.21.15.53:0/1161977442 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f40fc0663d0 0x7f40fc068880 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:57.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.168+0000 7f40f57fa640 1 --2- 172.21.15.53:0/1161977442 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4110157df0 0x7f41100b1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:57.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.168+0000 7f40f57fa640 1 --2- 172.21.15.53:0/1161977442 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41100ca880 0x7f4110155460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:57.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.168+0000 7f40f57fa640 1 --2- 172.21.15.53:0/1161977442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f41100b06d0 0x7f41100b3f50 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:57.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.168+0000 7f40f57fa640 1 -- 172.21.15.53:0/1161977442 >> 172.21.15.53:0/1161977442 conn(0x7f41100cafc0 msgr2=0x7f41100afd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:57.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.168+0000 7f40f57fa640 1 -- 172.21.15.53:0/1161977442 shutdown_connections 2023-06-10T18:52:57.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.168+0000 7f40f57fa640 1 -- 172.21.15.53:0/1161977442 wait complete. 2023-06-10T18:52:57.198 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.5 2023-06-10T18:52:57.198 DEBUG:teuthology.parallel:result is None 2023-06-10T18:52:57.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.212+0000 7f0df4907640 1 -- 172.21.15.53:0/1694930273 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f0dd0005510 con 0x7f0df00acbe0 2023-06-10T18:52:57.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.212+0000 7f0dd7fff640 1 -- 172.21.15.53:0/1694930273 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0de8001820 con 0x7f0df00acbe0 2023-06-10T18:52:57.223 INFO:teuthology.orchestra.run.smithi053.stdout:55834574855 2023-06-10T18:52:57.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.216+0000 7f0df4907640 1 -- 172.21.15.53:0/1694930273 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0ddc0662b0 msgr2=0x7f0ddc068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:57.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.216+0000 7f0df4907640 1 --2- 172.21.15.53:0/1694930273 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0ddc0662b0 0x7f0ddc068760 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0de00b6000 tx=0x7f0de00af070 comp rx=0 tx=0).stop 2023-06-10T18:52:57.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.216+0000 7f0df4907640 1 -- 172.21.15.53:0/1694930273 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0df00acbe0 msgr2=0x7f0df00be280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:57.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.216+0000 7f0df4907640 1 --2- 172.21.15.53:0/1694930273 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0df00acbe0 0x7f0df00be280 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0de800c7d0 tx=0x7f0de800cc90 comp rx=0 tx=0).stop 2023-06-10T18:52:57.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.216+0000 7f0df4907640 1 -- 172.21.15.53:0/1694930273 shutdown_connections 2023-06-10T18:52:57.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.216+0000 7f0df4907640 1 --2- 172.21.15.53:0/1694930273 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0ddc0662b0 0x7f0ddc068760 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:57.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.216+0000 7f0df4907640 1 --2- 172.21.15.53:0/1694930273 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0df00afc00 0x7f0df00700f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:57.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.216+0000 7f0df4907640 1 --2- 172.21.15.53:0/1694930273 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0df00acbe0 0x7f0df00be280 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:57.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.216+0000 7f0df4907640 1 --2- 172.21.15.53:0/1694930273 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0df0089b00 0x7f0df00c0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:57.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.216+0000 7f0df4907640 1 -- 172.21.15.53:0/1694930273 >> 172.21.15.53:0/1694930273 conn(0x7f0df006a090 msgr2=0x7f0df00adec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:57.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.216+0000 7f0df4907640 1 -- 172.21.15.53:0/1694930273 shutdown_connections 2023-06-10T18:52:57.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.216+0000 7f0df4907640 1 -- 172.21.15.53:0/1694930273 wait complete. 2023-06-10T18:52:57.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.220+0000 7f63db42f640 1 -- 172.21.15.53:0/3557039179 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f63b40057e0 con 0x7f63d40c62f0 2023-06-10T18:52:57.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.220+0000 7f63c9ffb640 1 -- 172.21.15.53:0/3557039179 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f63c4053bb0 con 0x7f63d40c62f0 2023-06-10T18:52:57.232 INFO:teuthology.orchestra.run.smithi053.stdout:55834574857 2023-06-10T18:52:57.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.224+0000 7f63db42f640 1 -- 172.21.15.53:0/3557039179 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f63c00663f0 msgr2=0x7f63c00688a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:57.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.224+0000 7f63db42f640 1 --2- 172.21.15.53:0/3557039179 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f63c00663f0 0x7f63c00688a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f63cc0b3000 tx=0x7f63cc0ac000 comp rx=0 tx=0).stop 2023-06-10T18:52:57.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.224+0000 7f63db42f640 1 -- 172.21.15.53:0/3557039179 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63d40c62f0 msgr2=0x7f63d4151f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:57.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.224+0000 7f63db42f640 1 --2- 172.21.15.53:0/3557039179 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63d40c62f0 0x7f63d4151f80 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f63c400c390 tx=0x7f63c400c850 comp rx=0 tx=0).stop 2023-06-10T18:52:57.235 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.224+0000 7f63db42f640 1 -- 172.21.15.53:0/3557039179 shutdown_connections 2023-06-10T18:52:57.235 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.224+0000 7f63db42f640 1 --2- 172.21.15.53:0/3557039179 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f63c00663f0 0x7f63c00688a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:57.235 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.224+0000 7f63db42f640 1 --2- 172.21.15.53:0/3557039179 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63d40c62f0 0x7f63d4151f80 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:57.235 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.224+0000 7f63db42f640 1 --2- 172.21.15.53:0/3557039179 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63d40cd650 0x7f63d40c5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:57.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.224+0000 7f63db42f640 1 --2- 172.21.15.53:0/3557039179 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63d40cbc00 0x7f63d40b2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:57.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.224+0000 7f63db42f640 1 -- 172.21.15.53:0/3557039179 >> 172.21.15.53:0/3557039179 conn(0x7f63d406a0e0 msgr2=0x7f63d406f020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:57.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.224+0000 7f63db42f640 1 -- 172.21.15.53:0/3557039179 shutdown_connections 2023-06-10T18:52:57.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.224+0000 7f63db42f640 1 -- 172.21.15.53:0/3557039179 wait complete. 2023-06-10T18:52:57.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.228+0000 7f4b13240640 1 -- 172.21.15.53:0/4109150184 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4b0c04d790 con 0x7f4b0c15ae00 2023-06-10T18:52:57.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.228+0000 7f4b097fa640 1 -- 172.21.15.53:0/4109150184 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4afc015020 con 0x7f4b0c15ae00 2023-06-10T18:52:57.238 INFO:teuthology.orchestra.run.smithi053.stdout:55834574855 2023-06-10T18:52:57.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.232+0000 7f4b13240640 1 -- 172.21.15.53:0/4109150184 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4af8066330 msgr2=0x7f4af80687e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:57.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.232+0000 7f4b13240640 1 --2- 172.21.15.53:0/4109150184 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4af8066330 0x7f4af80687e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4b00006fd0 tx=0x7f4b00008040 comp rx=0 tx=0).stop 2023-06-10T18:52:57.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.232+0000 7f4b13240640 1 -- 172.21.15.53:0/4109150184 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4b0c15ae00 msgr2=0x7f4b0c151020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:57.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.232+0000 7f4b13240640 1 --2- 172.21.15.53:0/4109150184 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4b0c15ae00 0x7f4b0c151020 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4afc00b410 tx=0x7f4afc00b8d0 comp rx=0 tx=0).stop 2023-06-10T18:52:57.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.232+0000 7f4b13240640 1 -- 172.21.15.53:0/4109150184 shutdown_connections 2023-06-10T18:52:57.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.232+0000 7f4b13240640 1 --2- 172.21.15.53:0/4109150184 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4af8066330 0x7f4af80687e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:57.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.232+0000 7f4b13240640 1 --2- 172.21.15.53:0/4109150184 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4b0c15ae00 0x7f4b0c151020 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:57.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.232+0000 7f4b13240640 1 --2- 172.21.15.53:0/4109150184 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b0c0cd170 0x7f4b0c150ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:57.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.232+0000 7f4b13240640 1 --2- 172.21.15.53:0/4109150184 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b0c0c9a80 0x7f4b0c1f7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:57.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.232+0000 7f4b13240640 1 -- 172.21.15.53:0/4109150184 >> 172.21.15.53:0/4109150184 conn(0x7f4b0c0ce9e0 msgr2=0x7f4b0c159c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:57.243 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.232+0000 7f4b13240640 1 -- 172.21.15.53:0/4109150184 shutdown_connections 2023-06-10T18:52:57.243 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.232+0000 7f4b13240640 1 -- 172.21.15.53:0/4109150184 wait complete. 2023-06-10T18:52:57.255 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.4 2023-06-10T18:52:57.255 DEBUG:teuthology.parallel:result is None 2023-06-10T18:52:57.260 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.2 2023-06-10T18:52:57.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.252+0000 7effc0835640 1 -- 172.21.15.53:0/2810231211 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7effa00057e0 con 0x7effbc0c9a80 2023-06-10T18:52:57.261 DEBUG:teuthology.parallel:result is None 2023-06-10T18:52:57.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.252+0000 7effaaffd640 1 -- 172.21.15.53:0/2810231211 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7effb001d030 con 0x7effbc0c9a80 2023-06-10T18:52:57.262 INFO:teuthology.orchestra.run.smithi053.stdout:55834574854 2023-06-10T18:52:57.263 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.1 2023-06-10T18:52:57.264 DEBUG:teuthology.parallel:result is None 2023-06-10T18:52:57.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.252+0000 7effc0835640 1 -- 172.21.15.53:0/2810231211 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7eff9c066280 msgr2=0x7eff9c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:57.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.252+0000 7effc0835640 1 --2- 172.21.15.53:0/2810231211 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7eff9c066280 0x7eff9c068730 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7effbc06f4d0 tx=0x7effb400a040 comp rx=0 tx=0).stop 2023-06-10T18:52:57.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.252+0000 7effc0835640 1 -- 172.21.15.53:0/2810231211 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7effbc0c9a80 msgr2=0x7effbc1479c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:57.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.252+0000 7effc0835640 1 --2- 172.21.15.53:0/2810231211 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7effbc0c9a80 0x7effbc1479c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7effb000b410 tx=0x7effb000b8d0 comp rx=0 tx=0).stop 2023-06-10T18:52:57.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.252+0000 7effc0835640 1 -- 172.21.15.53:0/2810231211 shutdown_connections 2023-06-10T18:52:57.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.252+0000 7effc0835640 1 --2- 172.21.15.53:0/2810231211 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7eff9c066280 0x7eff9c068730 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:57.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.252+0000 7effc0835640 1 --2- 172.21.15.53:0/2810231211 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effbc15ae00 0x7effbc0aece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:57.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.252+0000 7effc0835640 1 --2- 172.21.15.53:0/2810231211 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effbc0cd170 0x7effbc149880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:57.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.252+0000 7effc0835640 1 --2- 172.21.15.53:0/2810231211 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7effbc0c9a80 0x7effbc1479c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:57.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.252+0000 7effc0835640 1 -- 172.21.15.53:0/2810231211 >> 172.21.15.53:0/2810231211 conn(0x7effbc0ce9e0 msgr2=0x7effbc070a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:57.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.252+0000 7effc0835640 1 -- 172.21.15.53:0/2810231211 shutdown_connections 2023-06-10T18:52:57.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.252+0000 7effc0835640 1 -- 172.21.15.53:0/2810231211 wait complete. 2023-06-10T18:52:57.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.260+0000 7f7e30d68640 1 -- 172.21.15.53:0/1744644687 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f7e2c0cc170 con 0x7f7e2c070d10 2023-06-10T18:52:57.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.260+0000 7f7e13fff640 1 -- 172.21.15.53:0/1744644687 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7e1c054340 con 0x7f7e2c070d10 2023-06-10T18:52:57.271 INFO:teuthology.orchestra.run.smithi053.stdout:55834574856 2023-06-10T18:52:57.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.264+0000 7f7e30d68640 1 -- 172.21.15.53:0/1744644687 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7e18066350 msgr2=0x7f7e18068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:57.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.264+0000 7f7e30d68640 1 --2- 172.21.15.53:0/1744644687 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7e18066350 0x7f7e18068800 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7e200ae000 tx=0x7f7e200a7000 comp rx=0 tx=0).stop 2023-06-10T18:52:57.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.264+0000 7f7e30d68640 1 -- 172.21.15.53:0/1744644687 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e2c070d10 msgr2=0x7f7e2c0c31c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:57.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.264+0000 7f7e30d68640 1 --2- 172.21.15.53:0/1744644687 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e2c070d10 0x7f7e2c0c31c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c007fd0 tx=0x7f7e1c00c8e0 comp rx=0 tx=0).stop 2023-06-10T18:52:57.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.264+0000 7f7e30d68640 1 -- 172.21.15.53:0/1744644687 shutdown_connections 2023-06-10T18:52:57.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.264+0000 7f7e30d68640 1 --2- 172.21.15.53:0/1744644687 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7e18066350 0x7f7e18068800 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:57.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.264+0000 7f7e30d68640 1 --2- 172.21.15.53:0/1744644687 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e2c1584c0 0x7f7e2c0c48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:57.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.264+0000 7f7e30d68640 1 --2- 172.21.15.53:0/1744644687 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e2c0cc750 0x7f7e2c0c18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:57.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.264+0000 7f7e30d68640 1 --2- 172.21.15.53:0/1744644687 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e2c070d10 0x7f7e2c0c31c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:57.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.264+0000 7f7e30d68640 1 -- 172.21.15.53:0/1744644687 >> 172.21.15.53:0/1744644687 conn(0x7f7e2c0cb600 msgr2=0x7f7e2c0ca9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:57.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.264+0000 7f7e30d68640 1 -- 172.21.15.53:0/1744644687 shutdown_connections 2023-06-10T18:52:57.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.264+0000 7f7e30d68640 1 -- 172.21.15.53:0/1744644687 wait complete. 2023-06-10T18:52:57.281 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.3 2023-06-10T18:52:57.281 DEBUG:teuthology.parallel:result is None 2023-06-10T18:52:57.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.276+0000 7ff75ca44640 1 -- 172.21.15.53:0/4029391918 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff73c0057e0 con 0x7ff7500548f0 2023-06-10T18:52:57.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.280+0000 7ff746ffd640 1 -- 172.21.15.53:0/4029391918 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff74c054070 con 0x7ff7500548f0 2023-06-10T18:52:57.288 INFO:teuthology.orchestra.run.smithi053.stdout:55834574856 2023-06-10T18:52:57.289 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.6 2023-06-10T18:52:57.289 DEBUG:teuthology.parallel:result is None 2023-06-10T18:52:57.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.280+0000 7ff75ca44640 1 -- 172.21.15.53:0/4029391918 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff738066280 msgr2=0x7ff738068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:57.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.280+0000 7ff75ca44640 1 --2- 172.21.15.53:0/4029391918 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff738066280 0x7ff738068730 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff7480af000 tx=0x7ff7480a7000 comp rx=0 tx=0).stop 2023-06-10T18:52:57.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.280+0000 7ff75ca44640 1 -- 172.21.15.53:0/4029391918 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7500548f0 msgr2=0x7ff75004ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:57.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.280+0000 7ff75ca44640 1 --2- 172.21.15.53:0/4029391918 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7500548f0 0x7ff75004ef10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff74c00c370 tx=0x7ff74c00c830 comp rx=0 tx=0).stop 2023-06-10T18:52:57.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.280+0000 7ff75ca44640 1 -- 172.21.15.53:0/4029391918 shutdown_connections 2023-06-10T18:52:57.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.280+0000 7ff75ca44640 1 --2- 172.21.15.53:0/4029391918 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff738066280 0x7ff738068730 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:57.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.280+0000 7ff75ca44640 1 --2- 172.21.15.53:0/4029391918 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff75004f450 0x7ff75004bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:57.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.280+0000 7ff75ca44640 1 --2- 172.21.15.53:0/4029391918 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7500548f0 0x7ff75004ef10 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:57.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.280+0000 7ff75ca44640 1 --2- 172.21.15.53:0/4029391918 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff75004a240 0x7ff750187270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:57.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.280+0000 7ff75ca44640 1 -- 172.21.15.53:0/4029391918 >> 172.21.15.53:0/4029391918 conn(0x7ff75000c210 msgr2=0x7ff750051850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:57.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.280+0000 7ff75ca44640 1 -- 172.21.15.53:0/4029391918 shutdown_connections 2023-06-10T18:52:57.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.280+0000 7ff75ca44640 1 -- 172.21.15.53:0/4029391918 wait complete. 2023-06-10T18:52:57.311 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.0 2023-06-10T18:52:57.311 DEBUG:teuthology.parallel:result is None 2023-06-10T18:52:57.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.324+0000 7f501b4de640 1 -- 172.21.15.53:0/1808389126 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f4ff4005510 con 0x7f5014160f30 2023-06-10T18:52:57.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.324+0000 7f5009ffb640 1 -- 172.21.15.53:0/1808389126 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5010001090 con 0x7f5014160f30 2023-06-10T18:52:57.335 INFO:teuthology.orchestra.run.smithi053.stdout:55834574855 2023-06-10T18:52:57.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.328+0000 7f501b4de640 1 -- 172.21.15.53:0/1808389126 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4ff8066350 msgr2=0x7f4ff8068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:57.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.328+0000 7f501b4de640 1 --2- 172.21.15.53:0/1808389126 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4ff8066350 0x7f4ff8068800 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f500c0af000 tx=0x7f500c0a7070 comp rx=0 tx=0).stop 2023-06-10T18:52:57.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.328+0000 7f501b4de640 1 -- 172.21.15.53:0/1808389126 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5014160f30 msgr2=0x7f50141534d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:57.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.328+0000 7f501b4de640 1 --2- 172.21.15.53:0/1808389126 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5014160f30 0x7f50141534d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f501000c3e0 tx=0x7f501000c8a0 comp rx=0 tx=0).stop 2023-06-10T18:52:57.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.328+0000 7f501b4de640 1 -- 172.21.15.53:0/1808389126 shutdown_connections 2023-06-10T18:52:57.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.328+0000 7f501b4de640 1 --2- 172.21.15.53:0/1808389126 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4ff8066350 0x7f4ff8068800 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:57.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.328+0000 7f501b4de640 1 --2- 172.21.15.53:0/1808389126 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5014160f30 0x7f50141534d0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:57.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.328+0000 7f501b4de640 1 --2- 172.21.15.53:0/1808389126 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50140cd8f0 0x7f50140c6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:57.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.328+0000 7f501b4de640 1 --2- 172.21.15.53:0/1808389126 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50140c1010 0x7f501414cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:57.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.328+0000 7f501b4de640 1 -- 172.21.15.53:0/1808389126 >> 172.21.15.53:0/1808389126 conn(0x7f50140ce9e0 msgr2=0x7f50140c8620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:57.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.328+0000 7f501b4de640 1 -- 172.21.15.53:0/1808389126 shutdown_connections 2023-06-10T18:52:57.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.328+0000 7f501b4de640 1 -- 172.21.15.53:0/1808389126 wait complete. 2023-06-10T18:52:57.351 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.7 2023-06-10T18:52:57.351 DEBUG:teuthology.parallel:result is None 2023-06-10T18:52:57.351 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-06-10T18:52:57.351 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-10T18:52:57.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.488+0000 7fcb66ee9640 1 Processor -- start 2023-06-10T18:52:57.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.488+0000 7fcb66ee9640 1 -- start start 2023-06-10T18:52:57.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.492+0000 7fcb66ee9640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fcb60071060 0x7fcb600af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:57.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.492+0000 7fcb66ee9640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fcb600afc60 0x7fcb6006b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:57.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.492+0000 7fcb66ee9640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb60159b50 con 0x7fcb600c9840 2023-06-10T18:52:57.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.492+0000 7fcb66ee9640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb600702a0 con 0x7fcb600afc60 2023-06-10T18:52:57.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.492+0000 7fcb66ee9640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb60070580 con 0x7fcb60071060 2023-06-10T18:52:57.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.492+0000 7fcb64c85640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fcb600c9840 0x7fcb600c9c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:36072/0 (socket says 172.21.15.53:36072) 2023-06-10T18:52:57.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.492+0000 7fcb64c85640 1 -- 172.21.15.53:0/253691588 learned_addr learned my addr 172.21.15.53:0/253691588 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:52:57.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.492+0000 7fcb65486640 1 --2- 172.21.15.53:0/253691588 >> v2:172.21.15.53:3300/0 conn(0x7fcb600afc60 0x7fcb6006b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:57.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.492+0000 7fcb5f7fe640 1 -- 172.21.15.53:0/253691588 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3470795105 0 0) 0x7fcb60159b50 con 0x7fcb600c9840 2023-06-10T18:52:57.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.492+0000 7fcb5ffff640 1 --2- 172.21.15.53:0/253691588 >> v2:172.21.15.117:3300/0 conn(0x7fcb60071060 0x7fcb600af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:57.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.492+0000 7fcb5f7fe640 1 -- 172.21.15.53:0/253691588 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb50003530 con 0x7fcb600c9840 2023-06-10T18:52:57.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.492+0000 7fcb65486640 1 -- 172.21.15.53:0/253691588 >> v2:172.21.15.117:3300/0 conn(0x7fcb60071060 msgr2=0x7fcb600af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:57.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.492+0000 7fcb65486640 1 --2- 172.21.15.53:0/253691588 >> v2:172.21.15.117:3300/0 conn(0x7fcb60071060 0x7fcb600af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:57.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.492+0000 7fcb65486640 1 -- 172.21.15.53:0/253691588 >> v1:172.21.15.53:6789/0 conn(0x7fcb600c9840 legacy=0x7fcb600c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:57.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.492+0000 7fcb65486640 1 -- 172.21.15.53:0/253691588 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb60070860 con 0x7fcb600afc60 2023-06-10T18:52:57.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.496+0000 7fcb65486640 1 --2- 172.21.15.53:0/253691588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb600afc60 0x7fcb6006b090 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fcb6006e650 tx=0x7fcb5801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ba2c852c991c596 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:57.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.496+0000 7fcb5f7fe640 1 -- 172.21.15.53:0/253691588 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb580a59c0 con 0x7fcb600afc60 2023-06-10T18:52:57.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.496+0000 7fcb5f7fe640 1 -- 172.21.15.53:0/253691588 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb580a5b20 con 0x7fcb600afc60 2023-06-10T18:52:57.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.496+0000 7fcb5f7fe640 1 -- 172.21.15.53:0/253691588 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb580ad440 con 0x7fcb600afc60 2023-06-10T18:52:57.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.496+0000 7fcb66ee9640 1 -- 172.21.15.53:0/253691588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb600afc60 msgr2=0x7fcb6006b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:57.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.496+0000 7fcb66ee9640 1 --2- 172.21.15.53:0/253691588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb600afc60 0x7fcb6006b090 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fcb6006e650 tx=0x7fcb5801c8e0 comp rx=0 tx=0).stop 2023-06-10T18:52:57.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.496+0000 7fcb66ee9640 1 -- 172.21.15.53:0/253691588 shutdown_connections 2023-06-10T18:52:57.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.496+0000 7fcb66ee9640 1 --2- 172.21.15.53:0/253691588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb600afc60 0x7fcb6006b090 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:57.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.496+0000 7fcb66ee9640 1 --2- 172.21.15.53:0/253691588 >> v2:172.21.15.117:3300/0 conn(0x7fcb60071060 0x7fcb600af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:57.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.496+0000 7fcb66ee9640 1 -- 172.21.15.53:0/253691588 >> 172.21.15.53:0/253691588 conn(0x7fcb6006a0d0 msgr2=0x7fcb600ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:57.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.496+0000 7fcb66ee9640 1 -- 172.21.15.53:0/253691588 shutdown_connections 2023-06-10T18:52:57.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.496+0000 7fcb66ee9640 1 -- 172.21.15.53:0/253691588 wait complete. 2023-06-10T18:52:57.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.496+0000 7fcb66ee9640 1 Processor -- start 2023-06-10T18:52:57.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.496+0000 7fcb66ee9640 1 -- start start 2023-06-10T18:52:57.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.496+0000 7fcb66ee9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb60071060 0x7fcb6014c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:57.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.496+0000 7fcb66ee9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb600afc60 0x7fcb600c17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:57.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.496+0000 7fcb66ee9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb600c9840 0x7fcb600b2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:57.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.496+0000 7fcb66ee9640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6014c7e0 con 0x7fcb60071060 2023-06-10T18:52:57.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.496+0000 7fcb66ee9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6014d330 con 0x7fcb600c9840 2023-06-10T18:52:57.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.496+0000 7fcb66ee9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb600c1d10 con 0x7fcb600afc60 2023-06-10T18:52:57.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.500+0000 7fcb64c85640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb60071060 0x7fcb6014c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:57.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.500+0000 7fcb64c85640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb60071060 0x7fcb6014c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35368/0 (socket says 172.21.15.53:35368) 2023-06-10T18:52:57.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.500+0000 7fcb64c85640 1 -- 172.21.15.53:0/2863249190 learned_addr learned my addr 172.21.15.53:0/2863249190 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:57.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.500+0000 7fcb5ffff640 1 --2- 172.21.15.53:0/2863249190 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb600afc60 0x7fcb600c17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:57.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.500+0000 7fcb65486640 1 --2- 172.21.15.53:0/2863249190 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb600c9840 0x7fcb600b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:57.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.500+0000 7fcb64c85640 1 -- 172.21.15.53:0/2863249190 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb600afc60 msgr2=0x7fcb600c17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:57.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.500+0000 7fcb64c85640 1 --2- 172.21.15.53:0/2863249190 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb600afc60 0x7fcb600c17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:57.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.500+0000 7fcb64c85640 1 -- 172.21.15.53:0/2863249190 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb600c9840 msgr2=0x7fcb600b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:57.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.500+0000 7fcb64c85640 1 --2- 172.21.15.53:0/2863249190 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb600c9840 0x7fcb600b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:57.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.500+0000 7fcb64c85640 1 -- 172.21.15.53:0/2863249190 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb58009a70 con 0x7fcb60071060 2023-06-10T18:52:57.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.500+0000 7fcb64c85640 1 --2- 172.21.15.53:0/2863249190 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb60071060 0x7fcb6014c2a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fcb5400c420 tx=0x7fcb5400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:57.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.500+0000 7fcb5d7fa640 1 -- 172.21.15.53:0/2863249190 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb54005cf0 con 0x7fcb60071060 2023-06-10T18:52:57.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.500+0000 7fcb5d7fa640 1 -- 172.21.15.53:0/2863249190 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb54005e50 con 0x7fcb60071060 2023-06-10T18:52:57.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.500+0000 7fcb66ee9640 1 -- 172.21.15.53:0/2863249190 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb600b2e70 con 0x7fcb60071060 2023-06-10T18:52:57.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.500+0000 7fcb5d7fa640 1 -- 172.21.15.53:0/2863249190 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb540072d0 con 0x7fcb60071060 2023-06-10T18:52:57.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.500+0000 7fcb66ee9640 1 -- 172.21.15.53:0/2863249190 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb6014cce0 con 0x7fcb60071060 2023-06-10T18:52:57.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.500+0000 7fcb66ee9640 1 -- 172.21.15.53:0/2863249190 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb6004d790 con 0x7fcb60071060 2023-06-10T18:52:57.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.500+0000 7fcb5d7fa640 1 -- 172.21.15.53:0/2863249190 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcb54007430 con 0x7fcb60071060 2023-06-10T18:52:57.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.500+0000 7fcb5d7fa640 1 --2- 172.21.15.53:0/2863249190 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcb44066280 0x7fcb44068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:57.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.500+0000 7fcb5d7fa640 1 -- 172.21.15.53:0/2863249190 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcb540836b0 con 0x7fcb60071060 2023-06-10T18:52:57.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.500+0000 7fcb5ffff640 1 --2- 172.21.15.53:0/2863249190 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcb44066280 0x7fcb44068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:57.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.500+0000 7fcb5ffff640 1 --2- 172.21.15.53:0/2863249190 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcb44066280 0x7fcb44068730 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fcb6015dfe0 tx=0x7fcb4c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:57.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.504+0000 7fcb5d7fa640 1 -- 172.21.15.53:0/2863249190 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcb54054750 con 0x7fcb60071060 2023-06-10T18:52:57.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.648+0000 7fcb66ee9640 1 -- 172.21.15.53:0/2863249190 --> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcb6015aba0 con 0x7fcb44066280 2023-06-10T18:52:57.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.668+0000 7fcb5d7fa640 1 -- 172.21.15.53:0/2863249190 <== mgr.4105 v2:172.21.15.117:6832/3061986771 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286539 (secure 0 0 0) 0x7fcb4c00b670 con 0x7fcb44066280 2023-06-10T18:52:57.680 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:52:57.683 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-06-10T18:52:57.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.672+0000 7fcb66ee9640 1 -- 172.21.15.53:0/2863249190 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcb44066280 msgr2=0x7fcb44068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:57.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.672+0000 7fcb66ee9640 1 --2- 172.21.15.53:0/2863249190 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcb44066280 0x7fcb44068730 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fcb6015dfe0 tx=0x7fcb4c008040 comp rx=0 tx=0).stop 2023-06-10T18:52:57.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.672+0000 7fcb66ee9640 1 -- 172.21.15.53:0/2863249190 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb60071060 msgr2=0x7fcb6014c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:57.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.672+0000 7fcb66ee9640 1 --2- 172.21.15.53:0/2863249190 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb60071060 0x7fcb6014c2a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fcb5400c420 tx=0x7fcb5400c8e0 comp rx=0 tx=0).stop 2023-06-10T18:52:57.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.672+0000 7fcb66ee9640 1 -- 172.21.15.53:0/2863249190 shutdown_connections 2023-06-10T18:52:57.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.672+0000 7fcb66ee9640 1 --2- 172.21.15.53:0/2863249190 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcb44066280 0x7fcb44068730 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:57.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.672+0000 7fcb66ee9640 1 --2- 172.21.15.53:0/2863249190 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb600c9840 0x7fcb600b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:57.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.672+0000 7fcb66ee9640 1 --2- 172.21.15.53:0/2863249190 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb600afc60 0x7fcb600c17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:57.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.672+0000 7fcb66ee9640 1 --2- 172.21.15.53:0/2863249190 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb60071060 0x7fcb6014c2a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:57.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.672+0000 7fcb66ee9640 1 -- 172.21.15.53:0/2863249190 >> 172.21.15.53:0/2863249190 conn(0x7fcb6006a0d0 msgr2=0x7fcb60152330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:57.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.676+0000 7fcb66ee9640 1 -- 172.21.15.53:0/2863249190 shutdown_connections 2023-06-10T18:52:57.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.676+0000 7fcb66ee9640 1 -- 172.21.15.53:0/2863249190 wait complete. 2023-06-10T18:52:57.699 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2023-06-10T18:52:57.562757+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235100,"kb_used_data":3100,"kb_used_omap":0,"kb_used_meta":231936,"kb_avail":754739620,"statfs":{"total":773094113280,"available":772853370880,"internally_reserved":0,"allocated":3174400,"data_stored":1899195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":237502464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.634235"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.093989+0000","last_change":"2023-06-10T18:52:44.947732+0000","last_active":"2023-06-10T18:52:47.093989+0000","last_peered":"2023-06-10T18:52:47.093989+0000","last_clean":"2023-06-10T18:52:47.093989+0000","last_became_active":"2023-06-10T18:52:44.947398+0000","last_became_peered":"2023-06-10T18:52:44.947398+0000","last_unstale":"2023-06-10T18:52:47.093989+0000","last_undegraded":"2023-06-10T18:52:47.093989+0000","last_fullsized":"2023-06-10T18:52:47.093989+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:06:36.663322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.935057+0000","last_change":"2023-06-10T18:52:44.961438+0000","last_active":"2023-06-10T18:52:45.935057+0000","last_peered":"2023-06-10T18:52:45.935057+0000","last_clean":"2023-06-10T18:52:45.935057+0000","last_became_active":"2023-06-10T18:52:44.961134+0000","last_became_peered":"2023-06-10T18:52:44.961134+0000","last_unstale":"2023-06-10T18:52:45.935057+0000","last_undegraded":"2023-06-10T18:52:45.935057+0000","last_fullsized":"2023-06-10T18:52:45.935057+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:49:49.618852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.931821+0000","last_change":"2023-06-10T18:52:44.955647+0000","last_active":"2023-06-10T18:52:45.931821+0000","last_peered":"2023-06-10T18:52:45.931821+0000","last_clean":"2023-06-10T18:52:45.931821+0000","last_became_active":"2023-06-10T18:52:44.955093+0000","last_became_peered":"2023-06-10T18:52:44.955093+0000","last_unstale":"2023-06-10T18:52:45.931821+0000","last_undegraded":"2023-06-10T18:52:45.931821+0000","last_fullsized":"2023-06-10T18:52:45.931821+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:37:28.673117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.095194+0000","last_change":"2023-06-10T18:52:44.940992+0000","last_active":"2023-06-10T18:52:47.095194+0000","last_peered":"2023-06-10T18:52:47.095194+0000","last_clean":"2023-06-10T18:52:47.095194+0000","last_became_active":"2023-06-10T18:52:44.940703+0000","last_became_peered":"2023-06-10T18:52:44.940703+0000","last_unstale":"2023-06-10T18:52:47.095194+0000","last_undegraded":"2023-06-10T18:52:47.095194+0000","last_fullsized":"2023-06-10T18:52:47.095194+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:17:13.902888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.074101+0000","last_change":"2023-06-10T18:52:44.954034+0000","last_active":"2023-06-10T18:52:47.074101+0000","last_peered":"2023-06-10T18:52:47.074101+0000","last_clean":"2023-06-10T18:52:47.074101+0000","last_became_active":"2023-06-10T18:52:44.953626+0000","last_became_peered":"2023-06-10T18:52:44.953626+0000","last_unstale":"2023-06-10T18:52:47.074101+0000","last_undegraded":"2023-06-10T18:52:47.074101+0000","last_fullsized":"2023-06-10T18:52:47.074101+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:41:13.376627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.932554+0000","last_change":"2023-06-10T18:52:44.944206+0000","last_active":"2023-06-10T18:52:45.932554+0000","last_peered":"2023-06-10T18:52:45.932554+0000","last_clean":"2023-06-10T18:52:45.932554+0000","last_became_active":"2023-06-10T18:52:44.943687+0000","last_became_peered":"2023-06-10T18:52:44.943687+0000","last_unstale":"2023-06-10T18:52:45.932554+0000","last_undegraded":"2023-06-10T18:52:45.932554+0000","last_fullsized":"2023-06-10T18:52:45.932554+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:02:43.231973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.095766+0000","last_change":"2023-06-10T18:52:44.958696+0000","last_active":"2023-06-10T18:52:47.095766+0000","last_peered":"2023-06-10T18:52:47.095766+0000","last_clean":"2023-06-10T18:52:47.095766+0000","last_became_active":"2023-06-10T18:52:44.958075+0000","last_became_peered":"2023-06-10T18:52:44.958075+0000","last_unstale":"2023-06-10T18:52:47.095766+0000","last_undegraded":"2023-06-10T18:52:47.095766+0000","last_fullsized":"2023-06-10T18:52:47.095766+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T18:54:16.713072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.934329+0000","last_change":"2023-06-10T18:52:44.945375+0000","last_active":"2023-06-10T18:52:45.934329+0000","last_peered":"2023-06-10T18:52:45.934329+0000","last_clean":"2023-06-10T18:52:45.934329+0000","last_became_active":"2023-06-10T18:52:44.945059+0000","last_became_peered":"2023-06-10T18:52:44.945059+0000","last_unstale":"2023-06-10T18:52:45.934329+0000","last_undegraded":"2023-06-10T18:52:45.934329+0000","last_fullsized":"2023-06-10T18:52:45.934329+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:59:51.325397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.073399+0000","last_change":"2023-06-10T18:52:44.960556+0000","last_active":"2023-06-10T18:52:47.073399+0000","last_peered":"2023-06-10T18:52:47.073399+0000","last_clean":"2023-06-10T18:52:47.073399+0000","last_became_active":"2023-06-10T18:52:44.960174+0000","last_became_peered":"2023-06-10T18:52:44.960174+0000","last_unstale":"2023-06-10T18:52:47.073399+0000","last_undegraded":"2023-06-10T18:52:47.073399+0000","last_fullsized":"2023-06-10T18:52:47.073399+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:53:28.618960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.935372+0000","last_change":"2023-06-10T18:52:44.961025+0000","last_active":"2023-06-10T18:52:45.935372+0000","last_peered":"2023-06-10T18:52:45.935372+0000","last_clean":"2023-06-10T18:52:45.935372+0000","last_became_active":"2023-06-10T18:52:44.960661+0000","last_became_peered":"2023-06-10T18:52:44.960661+0000","last_unstale":"2023-06-10T18:52:45.935372+0000","last_undegraded":"2023-06-10T18:52:45.935372+0000","last_fullsized":"2023-06-10T18:52:45.935372+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:02:43.231973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.932039+0000","last_change":"2023-06-10T18:52:44.958300+0000","last_active":"2023-06-10T18:52:45.932039+0000","last_peered":"2023-06-10T18:52:45.932039+0000","last_clean":"2023-06-10T18:52:45.932039+0000","last_became_active":"2023-06-10T18:52:44.958013+0000","last_became_peered":"2023-06-10T18:52:44.958013+0000","last_unstale":"2023-06-10T18:52:45.932039+0000","last_undegraded":"2023-06-10T18:52:45.932039+0000","last_fullsized":"2023-06-10T18:52:45.932039+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:39:10.018608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.094202+0000","last_change":"2023-06-10T18:52:44.951808+0000","last_active":"2023-06-10T18:52:47.094202+0000","last_peered":"2023-06-10T18:52:47.094202+0000","last_clean":"2023-06-10T18:52:47.094202+0000","last_became_active":"2023-06-10T18:52:44.951348+0000","last_became_peered":"2023-06-10T18:52:44.951348+0000","last_unstale":"2023-06-10T18:52:47.094202+0000","last_undegraded":"2023-06-10T18:52:47.094202+0000","last_fullsized":"2023-06-10T18:52:47.094202+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:41:10.737097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.093897+0000","last_change":"2023-06-10T18:52:44.941608+0000","last_active":"2023-06-10T18:52:47.093897+0000","last_peered":"2023-06-10T18:52:47.093897+0000","last_clean":"2023-06-10T18:52:47.093897+0000","last_became_active":"2023-06-10T18:52:44.941232+0000","last_became_peered":"2023-06-10T18:52:44.941232+0000","last_unstale":"2023-06-10T18:52:47.093897+0000","last_undegraded":"2023-06-10T18:52:47.093897+0000","last_fullsized":"2023-06-10T18:52:47.093897+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:34:30.103416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.935166+0000","last_change":"2023-06-10T18:52:44.946464+0000","last_active":"2023-06-10T18:52:45.935166+0000","last_peered":"2023-06-10T18:52:45.935166+0000","last_clean":"2023-06-10T18:52:45.935166+0000","last_became_active":"2023-06-10T18:52:44.946097+0000","last_became_peered":"2023-06-10T18:52:44.946097+0000","last_unstale":"2023-06-10T18:52:45.935166+0000","last_undegraded":"2023-06-10T18:52:45.935166+0000","last_fullsized":"2023-06-10T18:52:45.935166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:37:26.347275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.096155+0000","last_change":"2023-06-10T18:52:44.958946+0000","last_active":"2023-06-10T18:52:47.096155+0000","last_peered":"2023-06-10T18:52:47.096155+0000","last_clean":"2023-06-10T18:52:47.096155+0000","last_became_active":"2023-06-10T18:52:44.958439+0000","last_became_peered":"2023-06-10T18:52:44.958439+0000","last_unstale":"2023-06-10T18:52:47.096155+0000","last_undegraded":"2023-06-10T18:52:47.096155+0000","last_fullsized":"2023-06-10T18:52:47.096155+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:14:11.506328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.931732+0000","last_change":"2023-06-10T18:52:44.946069+0000","last_active":"2023-06-10T18:52:45.931732+0000","last_peered":"2023-06-10T18:52:45.931732+0000","last_clean":"2023-06-10T18:52:45.931732+0000","last_became_active":"2023-06-10T18:52:44.945560+0000","last_became_peered":"2023-06-10T18:52:44.945560+0000","last_unstale":"2023-06-10T18:52:45.931732+0000","last_undegraded":"2023-06-10T18:52:45.931732+0000","last_fullsized":"2023-06-10T18:52:45.931732+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:08:50.331605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.073341+0000","last_change":"2023-06-10T18:52:44.961858+0000","last_active":"2023-06-10T18:52:47.073341+0000","last_peered":"2023-06-10T18:52:47.073341+0000","last_clean":"2023-06-10T18:52:47.073341+0000","last_became_active":"2023-06-10T18:52:44.961540+0000","last_became_peered":"2023-06-10T18:52:44.961540+0000","last_unstale":"2023-06-10T18:52:47.073341+0000","last_undegraded":"2023-06-10T18:52:47.073341+0000","last_fullsized":"2023-06-10T18:52:47.073341+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:08:50.331605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.932034+0000","last_change":"2023-06-10T18:52:44.939005+0000","last_active":"2023-06-10T18:52:45.932034+0000","last_peered":"2023-06-10T18:52:45.932034+0000","last_clean":"2023-06-10T18:52:45.932034+0000","last_became_active":"2023-06-10T18:52:44.938775+0000","last_became_peered":"2023-06-10T18:52:44.938775+0000","last_unstale":"2023-06-10T18:52:45.932034+0000","last_undegraded":"2023-06-10T18:52:45.932034+0000","last_fullsized":"2023-06-10T18:52:45.932034+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:42:51.947168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.094083+0000","last_change":"2023-06-10T18:52:44.941417+0000","last_active":"2023-06-10T18:52:47.094083+0000","last_peered":"2023-06-10T18:52:47.094083+0000","last_clean":"2023-06-10T18:52:47.094083+0000","last_became_active":"2023-06-10T18:52:44.940980+0000","last_became_peered":"2023-06-10T18:52:44.940980+0000","last_unstale":"2023-06-10T18:52:47.094083+0000","last_undegraded":"2023-06-10T18:52:47.094083+0000","last_fullsized":"2023-06-10T18:52:47.094083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:33:22.583233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.932218+0000","last_change":"2023-06-10T18:52:44.944705+0000","last_active":"2023-06-10T18:52:45.932218+0000","last_peered":"2023-06-10T18:52:45.932218+0000","last_clean":"2023-06-10T18:52:45.932218+0000","last_became_active":"2023-06-10T18:52:44.944399+0000","last_became_peered":"2023-06-10T18:52:44.944399+0000","last_unstale":"2023-06-10T18:52:45.932218+0000","last_undegraded":"2023-06-10T18:52:45.932218+0000","last_fullsized":"2023-06-10T18:52:45.932218+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:39:06.207720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.096145+0000","last_change":"2023-06-10T18:52:44.959863+0000","last_active":"2023-06-10T18:52:47.096145+0000","last_peered":"2023-06-10T18:52:47.096145+0000","last_clean":"2023-06-10T18:52:47.096145+0000","last_became_active":"2023-06-10T18:52:44.959556+0000","last_became_peered":"2023-06-10T18:52:44.959556+0000","last_unstale":"2023-06-10T18:52:47.096145+0000","last_undegraded":"2023-06-10T18:52:47.096145+0000","last_fullsized":"2023-06-10T18:52:47.096145+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:02:43.231973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.073202+0000","last_change":"2023-06-10T18:52:44.961343+0000","last_active":"2023-06-10T18:52:47.073202+0000","last_peered":"2023-06-10T18:52:47.073202+0000","last_clean":"2023-06-10T18:52:47.073202+0000","last_became_active":"2023-06-10T18:52:44.960957+0000","last_became_peered":"2023-06-10T18:52:44.960957+0000","last_unstale":"2023-06-10T18:52:47.073202+0000","last_undegraded":"2023-06-10T18:52:47.073202+0000","last_fullsized":"2023-06-10T18:52:47.073202+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:54:34.871667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.929467+0000","last_change":"2023-06-10T18:52:44.952488+0000","last_active":"2023-06-10T18:52:45.929467+0000","last_peered":"2023-06-10T18:52:45.929467+0000","last_clean":"2023-06-10T18:52:45.929467+0000","last_became_active":"2023-06-10T18:52:44.951957+0000","last_became_peered":"2023-06-10T18:52:44.951957+0000","last_unstale":"2023-06-10T18:52:45.929467+0000","last_undegraded":"2023-06-10T18:52:45.929467+0000","last_fullsized":"2023-06-10T18:52:45.929467+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:31:20.946172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.094882+0000","last_change":"2023-06-10T18:52:44.960097+0000","last_active":"2023-06-10T18:52:47.094882+0000","last_peered":"2023-06-10T18:52:47.094882+0000","last_clean":"2023-06-10T18:52:47.094882+0000","last_became_active":"2023-06-10T18:52:44.959605+0000","last_became_peered":"2023-06-10T18:52:44.959605+0000","last_unstale":"2023-06-10T18:52:47.094882+0000","last_undegraded":"2023-06-10T18:52:47.094882+0000","last_fullsized":"2023-06-10T18:52:47.094882+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:08:04.480136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.095654+0000","last_change":"2023-06-10T18:52:44.956446+0000","last_active":"2023-06-10T18:52:47.095654+0000","last_peered":"2023-06-10T18:52:47.095654+0000","last_clean":"2023-06-10T18:52:47.095654+0000","last_became_active":"2023-06-10T18:52:44.954175+0000","last_became_peered":"2023-06-10T18:52:44.954175+0000","last_unstale":"2023-06-10T18:52:47.095654+0000","last_undegraded":"2023-06-10T18:52:47.095654+0000","last_fullsized":"2023-06-10T18:52:47.095654+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T18:54:16.713072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.095401+0000","last_change":"2023-06-10T18:52:44.956942+0000","last_active":"2023-06-10T18:52:47.095401+0000","last_peered":"2023-06-10T18:52:47.095401+0000","last_clean":"2023-06-10T18:52:47.095401+0000","last_became_active":"2023-06-10T18:52:44.953322+0000","last_became_peered":"2023-06-10T18:52:44.953322+0000","last_unstale":"2023-06-10T18:52:47.095401+0000","last_undegraded":"2023-06-10T18:52:47.095401+0000","last_fullsized":"2023-06-10T18:52:47.095401+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:39:10.018608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.934856+0000","last_change":"2023-06-10T18:52:44.942786+0000","last_active":"2023-06-10T18:52:45.934856+0000","last_peered":"2023-06-10T18:52:45.934856+0000","last_clean":"2023-06-10T18:52:45.934856+0000","last_became_active":"2023-06-10T18:52:44.942216+0000","last_became_peered":"2023-06-10T18:52:44.942216+0000","last_unstale":"2023-06-10T18:52:45.934856+0000","last_undegraded":"2023-06-10T18:52:45.934856+0000","last_fullsized":"2023-06-10T18:52:45.934856+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:08:04.480136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.095440+0000","last_change":"2023-06-10T18:52:44.958527+0000","last_active":"2023-06-10T18:52:47.095440+0000","last_peered":"2023-06-10T18:52:47.095440+0000","last_clean":"2023-06-10T18:52:47.095440+0000","last_became_active":"2023-06-10T18:52:44.958233+0000","last_became_peered":"2023-06-10T18:52:44.958233+0000","last_unstale":"2023-06-10T18:52:47.095440+0000","last_undegraded":"2023-06-10T18:52:47.095440+0000","last_fullsized":"2023-06-10T18:52:47.095440+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:08:04.480136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.930241+0000","last_change":"2023-06-10T18:52:44.946412+0000","last_active":"2023-06-10T18:52:45.930241+0000","last_peered":"2023-06-10T18:52:45.930241+0000","last_clean":"2023-06-10T18:52:45.930241+0000","last_became_active":"2023-06-10T18:52:44.945955+0000","last_became_peered":"2023-06-10T18:52:44.945955+0000","last_unstale":"2023-06-10T18:52:45.930241+0000","last_undegraded":"2023-06-10T18:52:45.930241+0000","last_fullsized":"2023-06-10T18:52:45.930241+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:08:04.480136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.932719+0000","last_change":"2023-06-10T18:52:44.942149+0000","last_active":"2023-06-10T18:52:45.932719+0000","last_peered":"2023-06-10T18:52:45.932719+0000","last_clean":"2023-06-10T18:52:45.932719+0000","last_became_active":"2023-06-10T18:52:44.939204+0000","last_became_peered":"2023-06-10T18:52:44.939204+0000","last_unstale":"2023-06-10T18:52:45.932719+0000","last_undegraded":"2023-06-10T18:52:45.932719+0000","last_fullsized":"2023-06-10T18:52:45.932719+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:14:11.506328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.929536+0000","last_change":"2023-06-10T18:52:44.960157+0000","last_active":"2023-06-10T18:52:45.929536+0000","last_peered":"2023-06-10T18:52:45.929536+0000","last_clean":"2023-06-10T18:52:45.929536+0000","last_became_active":"2023-06-10T18:52:44.959460+0000","last_became_peered":"2023-06-10T18:52:44.959460+0000","last_unstale":"2023-06-10T18:52:45.929536+0000","last_undegraded":"2023-06-10T18:52:45.929536+0000","last_fullsized":"2023-06-10T18:52:45.929536+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:53:28.618960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.094637+0000","last_change":"2023-06-10T18:52:44.937198+0000","last_active":"2023-06-10T18:52:47.094637+0000","last_peered":"2023-06-10T18:52:47.094637+0000","last_clean":"2023-06-10T18:52:47.094637+0000","last_became_active":"2023-06-10T18:52:44.936793+0000","last_became_peered":"2023-06-10T18:52:44.936793+0000","last_unstale":"2023-06-10T18:52:47.094637+0000","last_undegraded":"2023-06-10T18:52:47.094637+0000","last_fullsized":"2023-06-10T18:52:47.094637+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:46:29.935621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.929593+0000","last_change":"2023-06-10T18:52:44.955794+0000","last_active":"2023-06-10T18:52:45.929593+0000","last_peered":"2023-06-10T18:52:45.929593+0000","last_clean":"2023-06-10T18:52:45.929593+0000","last_became_active":"2023-06-10T18:52:44.955013+0000","last_became_peered":"2023-06-10T18:52:44.955013+0000","last_unstale":"2023-06-10T18:52:45.929593+0000","last_undegraded":"2023-06-10T18:52:45.929593+0000","last_fullsized":"2023-06-10T18:52:45.929593+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:37:28.673117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.096398+0000","last_change":"2023-06-10T18:52:44.586121+0000","last_active":"2023-06-10T18:52:47.096398+0000","last_peered":"2023-06-10T18:52:47.096398+0000","last_clean":"2023-06-10T18:52:47.096398+0000","last_became_active":"2023-06-10T18:52:44.584334+0000","last_became_peered":"2023-06-10T18:52:44.584334+0000","last_unstale":"2023-06-10T18:52:47.096398+0000","last_undegraded":"2023-06-10T18:52:47.096398+0000","last_fullsized":"2023-06-10T18:52:47.096398+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:44:27.810129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.934843+0000","last_change":"2023-06-10T18:52:44.942980+0000","last_active":"2023-06-10T18:52:45.934843+0000","last_peered":"2023-06-10T18:52:45.934843+0000","last_clean":"2023-06-10T18:52:45.934843+0000","last_became_active":"2023-06-10T18:52:44.942538+0000","last_became_peered":"2023-06-10T18:52:44.942538+0000","last_unstale":"2023-06-10T18:52:45.934843+0000","last_undegraded":"2023-06-10T18:52:45.934843+0000","last_fullsized":"2023-06-10T18:52:45.934843+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:39:06.207720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.073250+0000","last_change":"2023-06-10T18:52:44.573070+0000","last_active":"2023-06-10T18:52:47.073250+0000","last_peered":"2023-06-10T18:52:47.073250+0000","last_clean":"2023-06-10T18:52:47.073250+0000","last_became_active":"2023-06-10T18:52:44.572659+0000","last_became_peered":"2023-06-10T18:52:44.572659+0000","last_unstale":"2023-06-10T18:52:47.073250+0000","last_undegraded":"2023-06-10T18:52:47.073250+0000","last_fullsized":"2023-06-10T18:52:47.073250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:31:19.942168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.073865+0000","last_change":"2023-06-10T18:52:44.966527+0000","last_active":"2023-06-10T18:52:47.073865+0000","last_peered":"2023-06-10T18:52:47.073865+0000","last_clean":"2023-06-10T18:52:47.073865+0000","last_became_active":"2023-06-10T18:52:44.962455+0000","last_became_peered":"2023-06-10T18:52:44.962455+0000","last_unstale":"2023-06-10T18:52:47.073865+0000","last_undegraded":"2023-06-10T18:52:47.073865+0000","last_fullsized":"2023-06-10T18:52:47.073865+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:39:06.207720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.096102+0000","last_change":"2023-06-10T18:52:44.584545+0000","last_active":"2023-06-10T18:52:47.096102+0000","last_peered":"2023-06-10T18:52:47.096102+0000","last_clean":"2023-06-10T18:52:47.096102+0000","last_became_active":"2023-06-10T18:52:44.583973+0000","last_became_peered":"2023-06-10T18:52:44.583973+0000","last_unstale":"2023-06-10T18:52:47.096102+0000","last_undegraded":"2023-06-10T18:52:47.096102+0000","last_fullsized":"2023-06-10T18:52:47.096102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:37:25.343271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.929677+0000","last_change":"2023-06-10T18:52:44.946578+0000","last_active":"2023-06-10T18:52:45.929677+0000","last_peered":"2023-06-10T18:52:45.929677+0000","last_clean":"2023-06-10T18:52:45.929677+0000","last_became_active":"2023-06-10T18:52:44.945951+0000","last_became_peered":"2023-06-10T18:52:44.945951+0000","last_unstale":"2023-06-10T18:52:45.929677+0000","last_undegraded":"2023-06-10T18:52:45.929677+0000","last_fullsized":"2023-06-10T18:52:45.929677+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:59:51.325397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.094726+0000","last_change":"2023-06-10T18:52:44.556644+0000","last_active":"2023-06-10T18:52:47.094726+0000","last_peered":"2023-06-10T18:52:47.094726+0000","last_clean":"2023-06-10T18:52:47.094726+0000","last_became_active":"2023-06-10T18:52:44.554676+0000","last_became_peered":"2023-06-10T18:52:44.554676+0000","last_unstale":"2023-06-10T18:52:47.094726+0000","last_undegraded":"2023-06-10T18:52:47.094726+0000","last_fullsized":"2023-06-10T18:52:47.094726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:39:58.210679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.096897+0000","last_change":"2023-06-10T18:52:44.586426+0000","last_active":"2023-06-10T18:52:47.096897+0000","last_peered":"2023-06-10T18:52:47.096897+0000","last_clean":"2023-06-10T18:52:47.096897+0000","last_became_active":"2023-06-10T18:52:44.585486+0000","last_became_peered":"2023-06-10T18:52:44.585486+0000","last_unstale":"2023-06-10T18:52:47.096897+0000","last_undegraded":"2023-06-10T18:52:47.096897+0000","last_fullsized":"2023-06-10T18:52:47.096897+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:21:48.058795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.934330+0000","last_change":"2023-06-10T18:52:44.948157+0000","last_active":"2023-06-10T18:52:45.934330+0000","last_peered":"2023-06-10T18:52:45.934330+0000","last_clean":"2023-06-10T18:52:45.934330+0000","last_became_active":"2023-06-10T18:52:44.947864+0000","last_became_peered":"2023-06-10T18:52:44.947864+0000","last_unstale":"2023-06-10T18:52:45.934330+0000","last_undegraded":"2023-06-10T18:52:45.934330+0000","last_fullsized":"2023-06-10T18:52:45.934330+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:42:51.947168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.096656+0000","last_change":"2023-06-10T18:52:44.585679+0000","last_active":"2023-06-10T18:52:47.096656+0000","last_peered":"2023-06-10T18:52:47.096656+0000","last_clean":"2023-06-10T18:52:47.096656+0000","last_became_active":"2023-06-10T18:52:44.585190+0000","last_became_peered":"2023-06-10T18:52:44.585190+0000","last_unstale":"2023-06-10T18:52:47.096656+0000","last_undegraded":"2023-06-10T18:52:47.096656+0000","last_fullsized":"2023-06-10T18:52:47.096656+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:28:02.644430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.932803+0000","last_change":"2023-06-10T18:52:44.958947+0000","last_active":"2023-06-10T18:52:45.932803+0000","last_peered":"2023-06-10T18:52:45.932803+0000","last_clean":"2023-06-10T18:52:45.932803+0000","last_became_active":"2023-06-10T18:52:44.958289+0000","last_became_peered":"2023-06-10T18:52:44.958289+0000","last_unstale":"2023-06-10T18:52:45.932803+0000","last_undegraded":"2023-06-10T18:52:45.932803+0000","last_fullsized":"2023-06-10T18:52:45.932803+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:34:51.394045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.096353+0000","last_change":"2023-06-10T18:52:44.581981+0000","last_active":"2023-06-10T18:52:47.096353+0000","last_peered":"2023-06-10T18:52:47.096353+0000","last_clean":"2023-06-10T18:52:47.096353+0000","last_became_active":"2023-06-10T18:52:44.581382+0000","last_became_peered":"2023-06-10T18:52:44.581382+0000","last_unstale":"2023-06-10T18:52:47.096353+0000","last_undegraded":"2023-06-10T18:52:47.096353+0000","last_fullsized":"2023-06-10T18:52:47.096353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:34:50.390041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.094856+0000","last_change":"2023-06-10T18:52:44.958474+0000","last_active":"2023-06-10T18:52:47.094856+0000","last_peered":"2023-06-10T18:52:47.094856+0000","last_clean":"2023-06-10T18:52:47.094856+0000","last_became_active":"2023-06-10T18:52:44.958186+0000","last_became_peered":"2023-06-10T18:52:44.958186+0000","last_unstale":"2023-06-10T18:52:47.094856+0000","last_undegraded":"2023-06-10T18:52:47.094856+0000","last_fullsized":"2023-06-10T18:52:47.094856+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:38:29.923050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.934807+0000","last_change":"2023-06-10T18:52:44.559256+0000","last_active":"2023-06-10T18:52:45.934807+0000","last_peered":"2023-06-10T18:52:45.934807+0000","last_clean":"2023-06-10T18:52:45.934807+0000","last_became_active":"2023-06-10T18:52:44.558447+0000","last_became_peered":"2023-06-10T18:52:44.558447+0000","last_unstale":"2023-06-10T18:52:45.934807+0000","last_undegraded":"2023-06-10T18:52:45.934807+0000","last_fullsized":"2023-06-10T18:52:45.934807+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:39:09.014604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.073739+0000","last_change":"2023-06-10T18:52:44.962607+0000","last_active":"2023-06-10T18:52:47.073739+0000","last_peered":"2023-06-10T18:52:47.073739+0000","last_clean":"2023-06-10T18:52:47.073739+0000","last_became_active":"2023-06-10T18:52:44.962105+0000","last_became_peered":"2023-06-10T18:52:44.962105+0000","last_unstale":"2023-06-10T18:52:47.073739+0000","last_undegraded":"2023-06-10T18:52:47.073739+0000","last_fullsized":"2023-06-10T18:52:47.073739+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:39:10.888321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.930610+0000","last_change":"2023-06-10T18:52:44.559397+0000","last_active":"2023-06-10T18:52:45.930610+0000","last_peered":"2023-06-10T18:52:45.930610+0000","last_clean":"2023-06-10T18:52:45.930610+0000","last_became_active":"2023-06-10T18:52:44.558955+0000","last_became_peered":"2023-06-10T18:52:44.558955+0000","last_unstale":"2023-06-10T18:52:45.930610+0000","last_undegraded":"2023-06-10T18:52:45.930610+0000","last_fullsized":"2023-06-10T18:52:45.930610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:49:48.614848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.931811+0000","last_change":"2023-06-10T18:52:44.955143+0000","last_active":"2023-06-10T18:52:45.931811+0000","last_peered":"2023-06-10T18:52:45.931811+0000","last_clean":"2023-06-10T18:52:45.931811+0000","last_became_active":"2023-06-10T18:52:44.954157+0000","last_became_peered":"2023-06-10T18:52:44.954157+0000","last_unstale":"2023-06-10T18:52:45.931811+0000","last_undegraded":"2023-06-10T18:52:45.931811+0000","last_fullsized":"2023-06-10T18:52:45.931811+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:53:28.618960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.095432+0000","last_change":"2023-06-10T18:52:44.575768+0000","last_active":"2023-06-10T18:52:47.095432+0000","last_peered":"2023-06-10T18:52:47.095432+0000","last_clean":"2023-06-10T18:52:47.095432+0000","last_became_active":"2023-06-10T18:52:44.575122+0000","last_became_peered":"2023-06-10T18:52:44.575122+0000","last_unstale":"2023-06-10T18:52:47.095432+0000","last_undegraded":"2023-06-10T18:52:47.095432+0000","last_fullsized":"2023-06-10T18:52:47.095432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:01:26.727248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.932347+0000","last_change":"2023-06-10T18:52:44.938302+0000","last_active":"2023-06-10T18:52:45.932347+0000","last_peered":"2023-06-10T18:52:45.932347+0000","last_clean":"2023-06-10T18:52:45.932347+0000","last_became_active":"2023-06-10T18:52:44.938005+0000","last_became_peered":"2023-06-10T18:52:44.938005+0000","last_unstale":"2023-06-10T18:52:45.932347+0000","last_undegraded":"2023-06-10T18:52:45.932347+0000","last_fullsized":"2023-06-10T18:52:45.932347+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:49:49.618852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.932470+0000","last_change":"2023-06-10T18:52:44.561044+0000","last_active":"2023-06-10T18:52:45.932470+0000","last_peered":"2023-06-10T18:52:45.932470+0000","last_clean":"2023-06-10T18:52:45.932470+0000","last_became_active":"2023-06-10T18:52:44.560233+0000","last_became_peered":"2023-06-10T18:52:44.560233+0000","last_unstale":"2023-06-10T18:52:45.932470+0000","last_undegraded":"2023-06-10T18:52:45.932470+0000","last_fullsized":"2023-06-10T18:52:45.932470+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:37:25.343271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.932395+0000","last_change":"2023-06-10T18:52:44.951038+0000","last_active":"2023-06-10T18:52:45.932395+0000","last_peered":"2023-06-10T18:52:45.932395+0000","last_clean":"2023-06-10T18:52:45.932395+0000","last_became_active":"2023-06-10T18:52:44.942868+0000","last_became_peered":"2023-06-10T18:52:44.942868+0000","last_unstale":"2023-06-10T18:52:45.932395+0000","last_undegraded":"2023-06-10T18:52:45.932395+0000","last_fullsized":"2023-06-10T18:52:45.932395+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:41:13.376627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.929453+0000","last_change":"2023-06-10T18:52:44.558548+0000","last_active":"2023-06-10T18:52:45.929453+0000","last_peered":"2023-06-10T18:52:45.929453+0000","last_clean":"2023-06-10T18:52:45.929453+0000","last_became_active":"2023-06-10T18:52:44.558194+0000","last_became_peered":"2023-06-10T18:52:44.558194+0000","last_unstale":"2023-06-10T18:52:45.929453+0000","last_undegraded":"2023-06-10T18:52:45.929453+0000","last_fullsized":"2023-06-10T18:52:45.929453+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:54:33.867663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.094869+0000","last_change":"2023-06-10T18:52:44.967155+0000","last_active":"2023-06-10T18:52:47.094869+0000","last_peered":"2023-06-10T18:52:47.094869+0000","last_clean":"2023-06-10T18:52:47.094869+0000","last_became_active":"2023-06-10T18:52:44.966889+0000","last_became_peered":"2023-06-10T18:52:44.966889+0000","last_unstale":"2023-06-10T18:52:47.094869+0000","last_undegraded":"2023-06-10T18:52:47.094869+0000","last_fullsized":"2023-06-10T18:52:47.094869+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:42:51.947168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":175,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.095406+0000","last_change":"2023-06-10T18:52:34.951528+0000","last_active":"2023-06-10T18:52:47.095406+0000","last_peered":"2023-06-10T18:52:47.095406+0000","last_clean":"2023-06-10T18:52:47.095406+0000","last_became_active":"2023-06-10T18:52:34.949099+0000","last_became_peered":"2023-06-10T18:52:34.949099+0000","last_unstale":"2023-06-10T18:52:47.095406+0000","last_undegraded":"2023-06-10T18:52:47.095406+0000","last_fullsized":"2023-06-10T18:52:47.095406+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_clean_scrub_stamp":"2023-06-10T18:52:33.633295+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:41:02.488686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.934561+0000","last_change":"2023-06-10T18:52:40.506384+0000","last_active":"2023-06-10T18:52:45.934561+0000","last_peered":"2023-06-10T18:52:45.934561+0000","last_clean":"2023-06-10T18:52:45.934561+0000","last_became_active":"2023-06-10T18:52:40.505701+0000","last_became_peered":"2023-06-10T18:52:40.505701+0000","last_unstale":"2023-06-10T18:52:45.934561+0000","last_undegraded":"2023-06-10T18:52:45.934561+0000","last_fullsized":"2023-06-10T18:52:45.934561+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:39:05.841926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.929409+0000","last_change":"2023-06-10T18:52:44.563326+0000","last_active":"2023-06-10T18:52:45.929409+0000","last_peered":"2023-06-10T18:52:45.929409+0000","last_clean":"2023-06-10T18:52:45.929409+0000","last_became_active":"2023-06-10T18:52:44.562901+0000","last_became_peered":"2023-06-10T18:52:44.562901+0000","last_unstale":"2023-06-10T18:52:45.929409+0000","last_undegraded":"2023-06-10T18:52:45.929409+0000","last_fullsized":"2023-06-10T18:52:45.929409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:29:32.049058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.095326+0000","last_change":"2023-06-10T18:52:44.940336+0000","last_active":"2023-06-10T18:52:47.095326+0000","last_peered":"2023-06-10T18:52:47.095326+0000","last_clean":"2023-06-10T18:52:47.095326+0000","last_became_active":"2023-06-10T18:52:44.939935+0000","last_became_peered":"2023-06-10T18:52:44.939935+0000","last_unstale":"2023-06-10T18:52:47.095326+0000","last_undegraded":"2023-06-10T18:52:47.095326+0000","last_fullsized":"2023-06-10T18:52:47.095326+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:42:44.531042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.095044+0000","last_change":"2023-06-10T18:52:40.512015+0000","last_active":"2023-06-10T18:52:47.095044+0000","last_peered":"2023-06-10T18:52:47.095044+0000","last_clean":"2023-06-10T18:52:47.095044+0000","last_became_active":"2023-06-10T18:52:40.511382+0000","last_became_peered":"2023-06-10T18:52:40.511382+0000","last_unstale":"2023-06-10T18:52:47.095044+0000","last_undegraded":"2023-06-10T18:52:47.095044+0000","last_fullsized":"2023-06-10T18:52:47.095044+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:49:44.572458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.073029+0000","last_change":"2023-06-10T18:52:44.575339+0000","last_active":"2023-06-10T18:52:47.073029+0000","last_peered":"2023-06-10T18:52:47.073029+0000","last_clean":"2023-06-10T18:52:47.073029+0000","last_became_active":"2023-06-10T18:52:44.575020+0000","last_became_peered":"2023-06-10T18:52:44.575020+0000","last_unstale":"2023-06-10T18:52:47.073029+0000","last_undegraded":"2023-06-10T18:52:47.073029+0000","last_fullsized":"2023-06-10T18:52:47.073029+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:29:32.049058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.073832+0000","last_change":"2023-06-10T18:52:44.960817+0000","last_active":"2023-06-10T18:52:47.073832+0000","last_peered":"2023-06-10T18:52:47.073832+0000","last_clean":"2023-06-10T18:52:47.073832+0000","last_became_active":"2023-06-10T18:52:44.960128+0000","last_became_peered":"2023-06-10T18:52:44.960128+0000","last_unstale":"2023-06-10T18:52:47.073832+0000","last_undegraded":"2023-06-10T18:52:47.073832+0000","last_fullsized":"2023-06-10T18:52:47.073832+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:39:10.018608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.093628+0000","last_change":"2023-06-10T18:52:40.671725+0000","last_active":"2023-06-10T18:52:47.093628+0000","last_peered":"2023-06-10T18:52:47.093628+0000","last_clean":"2023-06-10T18:52:47.093628+0000","last_became_active":"2023-06-10T18:52:40.671442+0000","last_became_peered":"2023-06-10T18:52:40.671442+0000","last_unstale":"2023-06-10T18:52:47.093628+0000","last_undegraded":"2023-06-10T18:52:47.093628+0000","last_fullsized":"2023-06-10T18:52:47.093628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:50:04.521612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.094350+0000","last_change":"2023-06-10T18:52:44.554010+0000","last_active":"2023-06-10T18:52:47.094350+0000","last_peered":"2023-06-10T18:52:47.094350+0000","last_clean":"2023-06-10T18:52:47.094350+0000","last_became_active":"2023-06-10T18:52:44.553706+0000","last_became_peered":"2023-06-10T18:52:44.553706+0000","last_unstale":"2023-06-10T18:52:47.094350+0000","last_undegraded":"2023-06-10T18:52:47.094350+0000","last_fullsized":"2023-06-10T18:52:47.094350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:08:49.327602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.094957+0000","last_change":"2023-06-10T18:52:44.954070+0000","last_active":"2023-06-10T18:52:47.094957+0000","last_peered":"2023-06-10T18:52:47.094957+0000","last_clean":"2023-06-10T18:52:47.094957+0000","last_became_active":"2023-06-10T18:52:44.953811+0000","last_became_peered":"2023-06-10T18:52:44.953811+0000","last_unstale":"2023-06-10T18:52:47.094957+0000","last_undegraded":"2023-06-10T18:52:47.094957+0000","last_fullsized":"2023-06-10T18:52:47.094957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:39:10.888321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.935370+0000","last_change":"2023-06-10T18:52:40.510258+0000","last_active":"2023-06-10T18:52:45.935370+0000","last_peered":"2023-06-10T18:52:45.935370+0000","last_clean":"2023-06-10T18:52:45.935370+0000","last_became_active":"2023-06-10T18:52:40.509560+0000","last_became_peered":"2023-06-10T18:52:40.509560+0000","last_unstale":"2023-06-10T18:52:45.935370+0000","last_undegraded":"2023-06-10T18:52:45.935370+0000","last_fullsized":"2023-06-10T18:52:45.935370+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:14:06.459934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.932037+0000","last_change":"2023-06-10T18:52:44.574974+0000","last_active":"2023-06-10T18:52:45.932037+0000","last_peered":"2023-06-10T18:52:45.932037+0000","last_clean":"2023-06-10T18:52:45.932037+0000","last_became_active":"2023-06-10T18:52:44.574115+0000","last_became_peered":"2023-06-10T18:52:44.574115+0000","last_unstale":"2023-06-10T18:52:45.932037+0000","last_undegraded":"2023-06-10T18:52:45.932037+0000","last_fullsized":"2023-06-10T18:52:45.932037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:39:09.884317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.095249+0000","last_change":"2023-06-10T18:52:44.954466+0000","last_active":"2023-06-10T18:52:47.095249+0000","last_peered":"2023-06-10T18:52:47.095249+0000","last_clean":"2023-06-10T18:52:47.095249+0000","last_became_active":"2023-06-10T18:52:44.953993+0000","last_became_peered":"2023-06-10T18:52:44.953993+0000","last_unstale":"2023-06-10T18:52:47.095249+0000","last_undegraded":"2023-06-10T18:52:47.095249+0000","last_fullsized":"2023-06-10T18:52:47.095249+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:50:18.328232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.935077+0000","last_change":"2023-06-10T18:52:44.558952+0000","last_active":"2023-06-10T18:52:45.935077+0000","last_peered":"2023-06-10T18:52:45.935077+0000","last_clean":"2023-06-10T18:52:45.935077+0000","last_became_active":"2023-06-10T18:52:44.558238+0000","last_became_peered":"2023-06-10T18:52:44.558238+0000","last_unstale":"2023-06-10T18:52:45.935077+0000","last_undegraded":"2023-06-10T18:52:45.935077+0000","last_fullsized":"2023-06-10T18:52:45.935077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T18:54:15.709068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.095574+0000","last_change":"2023-06-10T18:52:40.672266+0000","last_active":"2023-06-10T18:52:47.095574+0000","last_peered":"2023-06-10T18:52:47.095574+0000","last_clean":"2023-06-10T18:52:47.095574+0000","last_became_active":"2023-06-10T18:52:40.671966+0000","last_became_peered":"2023-06-10T18:52:40.671966+0000","last_unstale":"2023-06-10T18:52:47.095574+0000","last_undegraded":"2023-06-10T18:52:47.095574+0000","last_fullsized":"2023-06-10T18:52:47.095574+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:41:08.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.094687+0000","last_change":"2023-06-10T18:52:44.953256+0000","last_active":"2023-06-10T18:52:47.094687+0000","last_peered":"2023-06-10T18:52:47.094687+0000","last_clean":"2023-06-10T18:52:47.094687+0000","last_became_active":"2023-06-10T18:52:44.952882+0000","last_became_peered":"2023-06-10T18:52:44.952882+0000","last_unstale":"2023-06-10T18:52:47.094687+0000","last_undegraded":"2023-06-10T18:52:47.094687+0000","last_fullsized":"2023-06-10T18:52:47.094687+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:37:28.673117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.095401+0000","last_change":"2023-06-10T18:52:44.555209+0000","last_active":"2023-06-10T18:52:47.095401+0000","last_peered":"2023-06-10T18:52:47.095401+0000","last_clean":"2023-06-10T18:52:47.095401+0000","last_became_active":"2023-06-10T18:52:44.554807+0000","last_became_peered":"2023-06-10T18:52:44.554807+0000","last_unstale":"2023-06-10T18:52:47.095401+0000","last_undegraded":"2023-06-10T18:52:47.095401+0000","last_fullsized":"2023-06-10T18:52:47.095401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:39:05.203717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.096653+0000","last_change":"2023-06-10T18:52:40.671084+0000","last_active":"2023-06-10T18:52:47.096653+0000","last_peered":"2023-06-10T18:52:47.096653+0000","last_clean":"2023-06-10T18:52:47.096653+0000","last_became_active":"2023-06-10T18:52:40.670697+0000","last_became_peered":"2023-06-10T18:52:40.670697+0000","last_unstale":"2023-06-10T18:52:47.096653+0000","last_undegraded":"2023-06-10T18:52:47.096653+0000","last_fullsized":"2023-06-10T18:52:47.096653+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:32:49.983600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.073669+0000","last_change":"2023-06-10T18:52:44.952636+0000","last_active":"2023-06-10T18:52:47.073669+0000","last_peered":"2023-06-10T18:52:47.073669+0000","last_clean":"2023-06-10T18:52:47.073669+0000","last_became_active":"2023-06-10T18:52:44.952234+0000","last_became_peered":"2023-06-10T18:52:44.952234+0000","last_unstale":"2023-06-10T18:52:47.073669+0000","last_undegraded":"2023-06-10T18:52:47.073669+0000","last_fullsized":"2023-06-10T18:52:47.073669+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:59:51.325397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.929887+0000","last_change":"2023-06-10T18:52:44.573554+0000","last_active":"2023-06-10T18:52:45.929887+0000","last_peered":"2023-06-10T18:52:45.929887+0000","last_clean":"2023-06-10T18:52:45.929887+0000","last_became_active":"2023-06-10T18:52:44.573142+0000","last_became_peered":"2023-06-10T18:52:44.573142+0000","last_unstale":"2023-06-10T18:52:45.929887+0000","last_undegraded":"2023-06-10T18:52:45.929887+0000","last_fullsized":"2023-06-10T18:52:45.929887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:39:05.203717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.095517+0000","last_change":"2023-06-10T18:52:40.514114+0000","last_active":"2023-06-10T18:52:47.095517+0000","last_peered":"2023-06-10T18:52:47.095517+0000","last_clean":"2023-06-10T18:52:47.095517+0000","last_became_active":"2023-06-10T18:52:40.513638+0000","last_became_peered":"2023-06-10T18:52:40.513638+0000","last_unstale":"2023-06-10T18:52:47.095517+0000","last_undegraded":"2023-06-10T18:52:47.095517+0000","last_fullsized":"2023-06-10T18:52:47.095517+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:49:44.572458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.929271+0000","last_change":"2023-06-10T18:52:44.949048+0000","last_active":"2023-06-10T18:52:45.929271+0000","last_peered":"2023-06-10T18:52:45.929271+0000","last_clean":"2023-06-10T18:52:45.929271+0000","last_became_active":"2023-06-10T18:52:44.948643+0000","last_became_peered":"2023-06-10T18:52:44.948643+0000","last_unstale":"2023-06-10T18:52:45.929271+0000","last_undegraded":"2023-06-10T18:52:45.929271+0000","last_fullsized":"2023-06-10T18:52:45.929271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:38:52.793572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.596864+0000","last_change":"2023-06-10T18:52:44.555532+0000","last_active":"2023-06-10T18:52:47.596864+0000","last_peered":"2023-06-10T18:52:47.596864+0000","last_clean":"2023-06-10T18:52:47.596864+0000","last_became_active":"2023-06-10T18:52:44.555234+0000","last_became_peered":"2023-06-10T18:52:44.555234+0000","last_unstale":"2023-06-10T18:52:47.596864+0000","last_undegraded":"2023-06-10T18:52:47.596864+0000","last_fullsized":"2023-06-10T18:52:47.596864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:08:03.476132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.095638+0000","last_change":"2023-06-10T18:52:40.515396+0000","last_active":"2023-06-10T18:52:47.095638+0000","last_peered":"2023-06-10T18:52:47.095638+0000","last_clean":"2023-06-10T18:52:47.095638+0000","last_became_active":"2023-06-10T18:52:40.514663+0000","last_became_peered":"2023-06-10T18:52:40.514663+0000","last_unstale":"2023-06-10T18:52:47.095638+0000","last_undegraded":"2023-06-10T18:52:47.095638+0000","last_fullsized":"2023-06-10T18:52:47.095638+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:29:28.006668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.932272+0000","last_change":"2023-06-10T18:52:44.946073+0000","last_active":"2023-06-10T18:52:45.932272+0000","last_peered":"2023-06-10T18:52:45.932272+0000","last_clean":"2023-06-10T18:52:45.932272+0000","last_became_active":"2023-06-10T18:52:44.945497+0000","last_became_peered":"2023-06-10T18:52:44.945497+0000","last_unstale":"2023-06-10T18:52:45.932272+0000","last_undegraded":"2023-06-10T18:52:45.932272+0000","last_fullsized":"2023-06-10T18:52:45.932272+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:08:04.480136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.931851+0000","last_change":"2023-06-10T18:52:44.943166+0000","last_active":"2023-06-10T18:52:45.931851+0000","last_peered":"2023-06-10T18:52:45.931851+0000","last_clean":"2023-06-10T18:52:45.931851+0000","last_became_active":"2023-06-10T18:52:44.942777+0000","last_became_peered":"2023-06-10T18:52:44.942777+0000","last_unstale":"2023-06-10T18:52:45.931851+0000","last_undegraded":"2023-06-10T18:52:45.931851+0000","last_fullsized":"2023-06-10T18:52:45.931851+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:59:51.325397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"22'6","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.932027+0000","last_change":"2023-06-10T18:52:44.575890+0000","last_active":"2023-06-10T18:52:45.932027+0000","last_peered":"2023-06-10T18:52:45.932027+0000","last_clean":"2023-06-10T18:52:45.932027+0000","last_became_active":"2023-06-10T18:52:44.573780+0000","last_became_peered":"2023-06-10T18:52:44.573780+0000","last_unstale":"2023-06-10T18:52:45.932027+0000","last_undegraded":"2023-06-10T18:52:45.932027+0000","last_fullsized":"2023-06-10T18:52:45.932027+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:50:17.324228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.094568+0000","last_change":"2023-06-10T18:52:44.955836+0000","last_active":"2023-06-10T18:52:47.094568+0000","last_peered":"2023-06-10T18:52:47.094568+0000","last_clean":"2023-06-10T18:52:47.094568+0000","last_became_active":"2023-06-10T18:52:44.955427+0000","last_became_peered":"2023-06-10T18:52:44.955427+0000","last_unstale":"2023-06-10T18:52:47.094568+0000","last_undegraded":"2023-06-10T18:52:47.094568+0000","last_fullsized":"2023-06-10T18:52:47.094568+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:53:28.618960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.096692+0000","last_change":"2023-06-10T18:52:44.583026+0000","last_active":"2023-06-10T18:52:47.096692+0000","last_peered":"2023-06-10T18:52:47.096692+0000","last_clean":"2023-06-10T18:52:47.096692+0000","last_became_active":"2023-06-10T18:52:44.582436+0000","last_became_peered":"2023-06-10T18:52:44.582436+0000","last_unstale":"2023-06-10T18:52:47.096692+0000","last_undegraded":"2023-06-10T18:52:47.096692+0000","last_fullsized":"2023-06-10T18:52:47.096692+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:15:28.452018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.935637+0000","last_change":"2023-06-10T18:52:44.573591+0000","last_active":"2023-06-10T18:52:45.935637+0000","last_peered":"2023-06-10T18:52:45.935637+0000","last_clean":"2023-06-10T18:52:45.935637+0000","last_became_active":"2023-06-10T18:52:44.572802+0000","last_became_peered":"2023-06-10T18:52:44.572802+0000","last_unstale":"2023-06-10T18:52:45.935637+0000","last_undegraded":"2023-06-10T18:52:45.935637+0000","last_fullsized":"2023-06-10T18:52:45.935637+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:34:50.390041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.929760+0000","last_change":"2023-06-10T18:52:44.944441+0000","last_active":"2023-06-10T18:52:45.929760+0000","last_peered":"2023-06-10T18:52:45.929760+0000","last_clean":"2023-06-10T18:52:45.929760+0000","last_became_active":"2023-06-10T18:52:44.944031+0000","last_became_peered":"2023-06-10T18:52:44.944031+0000","last_unstale":"2023-06-10T18:52:45.929760+0000","last_undegraded":"2023-06-10T18:52:45.929760+0000","last_fullsized":"2023-06-10T18:52:45.929760+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:39:10.888321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.073751+0000","last_change":"2023-06-10T18:52:44.563525+0000","last_active":"2023-06-10T18:52:47.073751+0000","last_peered":"2023-06-10T18:52:47.073751+0000","last_clean":"2023-06-10T18:52:47.073751+0000","last_became_active":"2023-06-10T18:52:44.563140+0000","last_became_peered":"2023-06-10T18:52:44.563140+0000","last_unstale":"2023-06-10T18:52:47.073751+0000","last_undegraded":"2023-06-10T18:52:47.073751+0000","last_fullsized":"2023-06-10T18:52:47.073751+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:50:17.324228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.929241+0000","last_change":"2023-06-10T18:52:44.953481+0000","last_active":"2023-06-10T18:52:45.929241+0000","last_peered":"2023-06-10T18:52:45.929241+0000","last_clean":"2023-06-10T18:52:45.929241+0000","last_became_active":"2023-06-10T18:52:44.953139+0000","last_became_peered":"2023-06-10T18:52:44.953139+0000","last_unstale":"2023-06-10T18:52:45.929241+0000","last_undegraded":"2023-06-10T18:52:45.929241+0000","last_fullsized":"2023-06-10T18:52:45.929241+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:01:27.731251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.095689+0000","last_change":"2023-06-10T18:52:44.946900+0000","last_active":"2023-06-10T18:52:47.095689+0000","last_peered":"2023-06-10T18:52:47.095689+0000","last_clean":"2023-06-10T18:52:47.095689+0000","last_became_active":"2023-06-10T18:52:44.946612+0000","last_became_peered":"2023-06-10T18:52:44.946612+0000","last_unstale":"2023-06-10T18:52:47.095689+0000","last_undegraded":"2023-06-10T18:52:47.095689+0000","last_fullsized":"2023-06-10T18:52:47.095689+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:38:52.793572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.929494+0000","last_change":"2023-06-10T18:52:44.561213+0000","last_active":"2023-06-10T18:52:45.929494+0000","last_peered":"2023-06-10T18:52:45.929494+0000","last_clean":"2023-06-10T18:52:45.929494+0000","last_became_active":"2023-06-10T18:52:44.560946+0000","last_became_peered":"2023-06-10T18:52:44.560946+0000","last_unstale":"2023-06-10T18:52:45.929494+0000","last_undegraded":"2023-06-10T18:52:45.929494+0000","last_fullsized":"2023-06-10T18:52:45.929494+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:08:49.327602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.073688+0000","last_change":"2023-06-10T18:52:44.951860+0000","last_active":"2023-06-10T18:52:47.073688+0000","last_peered":"2023-06-10T18:52:47.073688+0000","last_clean":"2023-06-10T18:52:47.073688+0000","last_became_active":"2023-06-10T18:52:44.949078+0000","last_became_peered":"2023-06-10T18:52:44.949078+0000","last_unstale":"2023-06-10T18:52:47.073688+0000","last_undegraded":"2023-06-10T18:52:47.073688+0000","last_fullsized":"2023-06-10T18:52:47.073688+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:42:51.947168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.094812+0000","last_change":"2023-06-10T18:52:44.559767+0000","last_active":"2023-06-10T18:52:47.094812+0000","last_peered":"2023-06-10T18:52:47.094812+0000","last_clean":"2023-06-10T18:52:47.094812+0000","last_became_active":"2023-06-10T18:52:44.559451+0000","last_became_peered":"2023-06-10T18:52:44.559451+0000","last_unstale":"2023-06-10T18:52:47.094812+0000","last_undegraded":"2023-06-10T18:52:47.094812+0000","last_fullsized":"2023-06-10T18:52:47.094812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:59:50.321394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.929761+0000","last_change":"2023-06-10T18:52:44.960896+0000","last_active":"2023-06-10T18:52:45.929761+0000","last_peered":"2023-06-10T18:52:45.929761+0000","last_clean":"2023-06-10T18:52:45.929761+0000","last_became_active":"2023-06-10T18:52:44.960188+0000","last_became_peered":"2023-06-10T18:52:44.960188+0000","last_unstale":"2023-06-10T18:52:45.929761+0000","last_undegraded":"2023-06-10T18:52:45.929761+0000","last_fullsized":"2023-06-10T18:52:45.929761+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:50:18.328232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.932875+0000","last_change":"2023-06-10T18:52:44.552411+0000","last_active":"2023-06-10T18:52:45.932875+0000","last_peered":"2023-06-10T18:52:45.932875+0000","last_clean":"2023-06-10T18:52:45.932875+0000","last_became_active":"2023-06-10T18:52:44.551312+0000","last_became_peered":"2023-06-10T18:52:44.551312+0000","last_unstale":"2023-06-10T18:52:45.932875+0000","last_undegraded":"2023-06-10T18:52:45.932875+0000","last_fullsized":"2023-06-10T18:52:45.932875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:44:27.810129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.094468+0000","last_change":"2023-06-10T18:52:44.965460+0000","last_active":"2023-06-10T18:52:47.094468+0000","last_peered":"2023-06-10T18:52:47.094468+0000","last_clean":"2023-06-10T18:52:47.094468+0000","last_became_active":"2023-06-10T18:52:44.964988+0000","last_became_peered":"2023-06-10T18:52:44.964988+0000","last_unstale":"2023-06-10T18:52:47.094468+0000","last_undegraded":"2023-06-10T18:52:47.094468+0000","last_fullsized":"2023-06-10T18:52:47.094468+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:46:29.935621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.074090+0000","last_change":"2023-06-10T18:52:44.576675+0000","last_active":"2023-06-10T18:52:47.074090+0000","last_peered":"2023-06-10T18:52:47.074090+0000","last_clean":"2023-06-10T18:52:47.074090+0000","last_became_active":"2023-06-10T18:52:44.576362+0000","last_became_peered":"2023-06-10T18:52:44.576362+0000","last_unstale":"2023-06-10T18:52:47.074090+0000","last_undegraded":"2023-06-10T18:52:47.074090+0000","last_fullsized":"2023-06-10T18:52:47.074090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:49:48.614848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.931722+0000","last_change":"2023-06-10T18:52:44.941939+0000","last_active":"2023-06-10T18:52:45.931722+0000","last_peered":"2023-06-10T18:52:45.931722+0000","last_clean":"2023-06-10T18:52:45.931722+0000","last_became_active":"2023-06-10T18:52:44.939408+0000","last_became_peered":"2023-06-10T18:52:44.939408+0000","last_unstale":"2023-06-10T18:52:45.931722+0000","last_undegraded":"2023-06-10T18:52:45.931722+0000","last_fullsized":"2023-06-10T18:52:45.931722+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:31:20.946172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.934658+0000","last_change":"2023-06-10T18:52:44.574956+0000","last_active":"2023-06-10T18:52:45.934658+0000","last_peered":"2023-06-10T18:52:45.934658+0000","last_clean":"2023-06-10T18:52:45.934658+0000","last_became_active":"2023-06-10T18:52:44.574184+0000","last_became_peered":"2023-06-10T18:52:44.574184+0000","last_unstale":"2023-06-10T18:52:45.934658+0000","last_undegraded":"2023-06-10T18:52:45.934658+0000","last_fullsized":"2023-06-10T18:52:45.934658+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:50:17.324228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.932406+0000","last_change":"2023-06-10T18:52:44.944962+0000","last_active":"2023-06-10T18:52:45.932406+0000","last_peered":"2023-06-10T18:52:45.932406+0000","last_clean":"2023-06-10T18:52:45.932406+0000","last_became_active":"2023-06-10T18:52:44.944702+0000","last_became_peered":"2023-06-10T18:52:44.944702+0000","last_unstale":"2023-06-10T18:52:45.932406+0000","last_undegraded":"2023-06-10T18:52:45.932406+0000","last_fullsized":"2023-06-10T18:52:45.932406+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T18:54:16.713072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.935077+0000","last_change":"2023-06-10T18:52:44.576687+0000","last_active":"2023-06-10T18:52:45.935077+0000","last_peered":"2023-06-10T18:52:45.935077+0000","last_clean":"2023-06-10T18:52:45.935077+0000","last_became_active":"2023-06-10T18:52:44.575964+0000","last_became_peered":"2023-06-10T18:52:44.575964+0000","last_unstale":"2023-06-10T18:52:45.935077+0000","last_undegraded":"2023-06-10T18:52:45.935077+0000","last_fullsized":"2023-06-10T18:52:45.935077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:41:12.372624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.929739+0000","last_change":"2023-06-10T18:52:44.937999+0000","last_active":"2023-06-10T18:52:45.929739+0000","last_peered":"2023-06-10T18:52:45.929739+0000","last_clean":"2023-06-10T18:52:45.929739+0000","last_became_active":"2023-06-10T18:52:44.937614+0000","last_became_peered":"2023-06-10T18:52:44.937614+0000","last_unstale":"2023-06-10T18:52:45.929739+0000","last_undegraded":"2023-06-10T18:52:45.929739+0000","last_fullsized":"2023-06-10T18:52:45.929739+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:42:51.947168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.929840+0000","last_change":"2023-06-10T18:52:44.563109+0000","last_active":"2023-06-10T18:52:45.929840+0000","last_peered":"2023-06-10T18:52:45.929840+0000","last_clean":"2023-06-10T18:52:45.929840+0000","last_became_active":"2023-06-10T18:52:44.562809+0000","last_became_peered":"2023-06-10T18:52:44.562809+0000","last_unstale":"2023-06-10T18:52:45.929840+0000","last_undegraded":"2023-06-10T18:52:45.929840+0000","last_fullsized":"2023-06-10T18:52:45.929840+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:39:09.014604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.931609+0000","last_change":"2023-06-10T18:52:44.945839+0000","last_active":"2023-06-10T18:52:45.931609+0000","last_peered":"2023-06-10T18:52:45.931609+0000","last_clean":"2023-06-10T18:52:45.931609+0000","last_became_active":"2023-06-10T18:52:44.945171+0000","last_became_peered":"2023-06-10T18:52:44.945171+0000","last_unstale":"2023-06-10T18:52:45.931609+0000","last_undegraded":"2023-06-10T18:52:45.931609+0000","last_fullsized":"2023-06-10T18:52:45.931609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:54:34.871667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.073610+0000","last_change":"2023-06-10T18:52:44.563708+0000","last_active":"2023-06-10T18:52:47.073610+0000","last_peered":"2023-06-10T18:52:47.073610+0000","last_clean":"2023-06-10T18:52:47.073610+0000","last_became_active":"2023-06-10T18:52:44.563327+0000","last_became_peered":"2023-06-10T18:52:44.563327+0000","last_unstale":"2023-06-10T18:52:47.073610+0000","last_undegraded":"2023-06-10T18:52:47.073610+0000","last_fullsized":"2023-06-10T18:52:47.073610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:37:27.669113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":844,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":864256,"data_stored":681747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0269999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0149999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1120000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97399999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":249856,"data_stored":90251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.135}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1080000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":262144,"data_stored":91219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0109999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.032}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.079}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.877}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31284,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340556,"statfs":{"total":96636764160,"available":96604729344,"internally_reserved":0,"allocated":241664,"data_stored":88670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31284,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340556,"statfs":{"total":96636764160,"available":96604729344,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.204}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.073}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2889999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.266}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31280,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340560,"statfs":{"total":96636764160,"available":96604733440,"internally_reserved":0,"allocated":237568,"data_stored":88580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.165}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0549999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31864,"kb_used_data":816,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339976,"statfs":{"total":96636764160,"available":96604135424,"internally_reserved":0,"allocated":835584,"data_stored":679530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.307}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93799999999999994}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-10T18:52:57.706 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-10T18:52:57.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.852+0000 7fe6e3720640 1 Processor -- start 2023-06-10T18:52:57.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.852+0000 7fe6e3720640 1 -- start start 2023-06-10T18:52:57.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.856+0000 7fe6e3720640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe6dc162640 0x7fe6dc164a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:57.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.856+0000 7fe6e3720640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6dc159b50 con 0x7fe6dc0c9840 2023-06-10T18:52:57.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.856+0000 7fe6e3720640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6dc0702a0 con 0x7fe6dc071060 2023-06-10T18:52:57.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.856+0000 7fe6e3720640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6dc070580 con 0x7fe6dc162640 2023-06-10T18:52:57.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.856+0000 7fe6e14bc640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fe6dc0c9840 0x7fe6dc0c9c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:36076/0 (socket says 172.21.15.53:36076) 2023-06-10T18:52:57.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.856+0000 7fe6e14bc640 1 -- 172.21.15.53:0/3042258621 learned_addr learned my addr 172.21.15.53:0/3042258621 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:52:57.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.856+0000 7fe6e1cbd640 1 --2- 172.21.15.53:0/3042258621 >> v2:172.21.15.53:3300/0 conn(0x7fe6dc162640 0x7fe6dc164a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:57.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.856+0000 7fe6d3fff640 1 -- 172.21.15.53:0/3042258621 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3249515973 0 0) 0x7fe6dc159b50 con 0x7fe6dc0c9840 2023-06-10T18:52:57.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.856+0000 7fe6d3fff640 1 -- 172.21.15.53:0/3042258621 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6c8003530 con 0x7fe6dc0c9840 2023-06-10T18:52:57.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.856+0000 7fe6e1cbd640 1 -- 172.21.15.53:0/3042258621 >> v1:172.21.15.117:6789/0 conn(0x7fe6dc071060 legacy=0x7fe6dc0af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:57.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.856+0000 7fe6e1cbd640 1 -- 172.21.15.53:0/3042258621 >> v1:172.21.15.53:6789/0 conn(0x7fe6dc0c9840 legacy=0x7fe6dc0c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:57.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.856+0000 7fe6e1cbd640 1 -- 172.21.15.53:0/3042258621 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6dc070860 con 0x7fe6dc162640 2023-06-10T18:52:57.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.856+0000 7fe6e1cbd640 1 --2- 172.21.15.53:0/3042258621 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6dc162640 0x7fe6dc164a20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe6d4009d90 tx=0x7fe6d401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d20aa620aa1a0ed5 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:57.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.856+0000 7fe6d3fff640 1 -- 172.21.15.53:0/3042258621 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d40a59c0 con 0x7fe6dc162640 2023-06-10T18:52:57.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.856+0000 7fe6d3fff640 1 -- 172.21.15.53:0/3042258621 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6d40a5b20 con 0x7fe6dc162640 2023-06-10T18:52:57.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.856+0000 7fe6d3fff640 1 -- 172.21.15.53:0/3042258621 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d40a5e90 con 0x7fe6dc162640 2023-06-10T18:52:57.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.856+0000 7fe6e3720640 1 -- 172.21.15.53:0/3042258621 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6dc162640 msgr2=0x7fe6dc164a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:57.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.856+0000 7fe6e3720640 1 --2- 172.21.15.53:0/3042258621 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6dc162640 0x7fe6dc164a20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe6d4009d90 tx=0x7fe6d401c8e0 comp rx=0 tx=0).stop 2023-06-10T18:52:57.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.856+0000 7fe6e3720640 1 -- 172.21.15.53:0/3042258621 shutdown_connections 2023-06-10T18:52:57.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.856+0000 7fe6e3720640 1 --2- 172.21.15.53:0/3042258621 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6dc162640 0x7fe6dc164a20 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:57.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.856+0000 7fe6e3720640 1 -- 172.21.15.53:0/3042258621 >> 172.21.15.53:0/3042258621 conn(0x7fe6dc06a0d0 msgr2=0x7fe6dc0ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:57.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.856+0000 7fe6e3720640 1 -- 172.21.15.53:0/3042258621 shutdown_connections 2023-06-10T18:52:57.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.856+0000 7fe6e3720640 1 -- 172.21.15.53:0/3042258621 wait complete. 2023-06-10T18:52:57.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.860+0000 7fe6e3720640 1 Processor -- start 2023-06-10T18:52:57.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.860+0000 7fe6e3720640 1 -- start start 2023-06-10T18:52:57.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.860+0000 7fe6e3720640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6dc071060 0x7fe6dc149ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:57.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.860+0000 7fe6e3720640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6dc0c9840 0x7fe6dc14d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:57.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.860+0000 7fe6e3720640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6dc162640 0x7fe6dc14b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:57.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.860+0000 7fe6e3720640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6dc14c790 con 0x7fe6dc071060 2023-06-10T18:52:57.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.860+0000 7fe6e3720640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6dc14ccc0 con 0x7fe6dc162640 2023-06-10T18:52:57.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.860+0000 7fe6e3720640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6dc14c9e0 con 0x7fe6dc0c9840 2023-06-10T18:52:57.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.860+0000 7fe6e14bc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6dc071060 0x7fe6dc149ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:57.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.860+0000 7fe6e14bc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6dc071060 0x7fe6dc149ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35384/0 (socket says 172.21.15.53:35384) 2023-06-10T18:52:57.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.860+0000 7fe6e14bc640 1 -- 172.21.15.53:0/3170716455 learned_addr learned my addr 172.21.15.53:0/3170716455 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:57.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.860+0000 7fe6e1cbd640 1 --2- 172.21.15.53:0/3170716455 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6dc162640 0x7fe6dc14b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:57.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.860+0000 7fe6e0cbb640 1 --2- 172.21.15.53:0/3170716455 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6dc0c9840 0x7fe6dc14d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:57.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.860+0000 7fe6e14bc640 1 -- 172.21.15.53:0/3170716455 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6dc0c9840 msgr2=0x7fe6dc14d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:57.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.860+0000 7fe6e14bc640 1 --2- 172.21.15.53:0/3170716455 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6dc0c9840 0x7fe6dc14d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:57.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.860+0000 7fe6e14bc640 1 -- 172.21.15.53:0/3170716455 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6dc162640 msgr2=0x7fe6dc14b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:57.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.860+0000 7fe6e14bc640 1 --2- 172.21.15.53:0/3170716455 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6dc162640 0x7fe6dc14b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:57.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.860+0000 7fe6e14bc640 1 -- 172.21.15.53:0/3170716455 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6d4009a70 con 0x7fe6dc071060 2023-06-10T18:52:57.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.860+0000 7fe6e1cbd640 1 --2- 172.21.15.53:0/3170716455 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6dc162640 0x7fe6dc14b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:52:57.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.860+0000 7fe6e0cbb640 1 --2- 172.21.15.53:0/3170716455 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6dc0c9840 0x7fe6dc14d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:52:57.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.860+0000 7fe6e14bc640 1 --2- 172.21.15.53:0/3170716455 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6dc071060 0x7fe6dc149ec0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe6d800c450 tx=0x7fe6d800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:57.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.860+0000 7fe6d1ffb640 1 -- 172.21.15.53:0/3170716455 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d8005cf0 con 0x7fe6dc071060 2023-06-10T18:52:57.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.860+0000 7fe6d1ffb640 1 -- 172.21.15.53:0/3170716455 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6d8005e50 con 0x7fe6dc071060 2023-06-10T18:52:57.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.860+0000 7fe6e3720640 1 -- 172.21.15.53:0/3170716455 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6dc14ab50 con 0x7fe6dc071060 2023-06-10T18:52:57.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.860+0000 7fe6d1ffb640 1 -- 172.21.15.53:0/3170716455 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d8007290 con 0x7fe6dc071060 2023-06-10T18:52:57.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.860+0000 7fe6e3720640 1 -- 172.21.15.53:0/3170716455 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6dc14b110 con 0x7fe6dc071060 2023-06-10T18:52:57.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.860+0000 7fe6e3720640 1 -- 172.21.15.53:0/3170716455 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6dc14b300 con 0x7fe6dc071060 2023-06-10T18:52:57.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.860+0000 7fe6d1ffb640 1 -- 172.21.15.53:0/3170716455 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe6d80073f0 con 0x7fe6dc071060 2023-06-10T18:52:57.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.864+0000 7fe6d1ffb640 1 --2- 172.21.15.53:0/3170716455 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe6c0066280 0x7fe6c0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:57.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.864+0000 7fe6d1ffb640 1 -- 172.21.15.53:0/3170716455 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe6d8083290 con 0x7fe6dc071060 2023-06-10T18:52:57.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.864+0000 7fe6e0cbb640 1 --2- 172.21.15.53:0/3170716455 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe6c0066280 0x7fe6c0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:57.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.864+0000 7fe6e0cbb640 1 --2- 172.21.15.53:0/3170716455 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe6c0066280 0x7fe6c0068730 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc14f690 tx=0x7fe6cc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:57.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:57.868+0000 7fe6d1ffb640 1 -- 172.21.15.53:0/3170716455 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe6d80507a0 con 0x7fe6dc071060 2023-06-10T18:52:58.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.012+0000 7fe6e3720640 1 -- 172.21.15.53:0/3170716455 --> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe6dc0afe30 con 0x7fe6c0066280 2023-06-10T18:52:58.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.032+0000 7fe6d1ffb640 1 -- 172.21.15.53:0/3170716455 <== mgr.4105 v2:172.21.15.117:6832/3061986771 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286539 (secure 0 0 0) 0x7fe6cc0053f0 con 0x7fe6c0066280 2023-06-10T18:52:58.043 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:52:58.047 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-06-10T18:52:58.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.036+0000 7fe6e3720640 1 -- 172.21.15.53:0/3170716455 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe6c0066280 msgr2=0x7fe6c0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:58.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.036+0000 7fe6e3720640 1 --2- 172.21.15.53:0/3170716455 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe6c0066280 0x7fe6c0068730 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc14f690 tx=0x7fe6cc009040 comp rx=0 tx=0).stop 2023-06-10T18:52:58.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.036+0000 7fe6e3720640 1 -- 172.21.15.53:0/3170716455 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6dc071060 msgr2=0x7fe6dc149ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:58.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.036+0000 7fe6e3720640 1 --2- 172.21.15.53:0/3170716455 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6dc071060 0x7fe6dc149ec0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe6d800c450 tx=0x7fe6d800c910 comp rx=0 tx=0).stop 2023-06-10T18:52:58.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.036+0000 7fe6e3720640 1 -- 172.21.15.53:0/3170716455 shutdown_connections 2023-06-10T18:52:58.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.036+0000 7fe6e3720640 1 --2- 172.21.15.53:0/3170716455 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe6c0066280 0x7fe6c0068730 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:58.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.036+0000 7fe6e3720640 1 --2- 172.21.15.53:0/3170716455 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6dc162640 0x7fe6dc14b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:58.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.036+0000 7fe6e3720640 1 --2- 172.21.15.53:0/3170716455 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6dc0c9840 0x7fe6dc14d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:58.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.036+0000 7fe6e3720640 1 --2- 172.21.15.53:0/3170716455 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6dc071060 0x7fe6dc149ec0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:58.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.036+0000 7fe6e3720640 1 -- 172.21.15.53:0/3170716455 >> 172.21.15.53:0/3170716455 conn(0x7fe6dc06a0d0 msgr2=0x7fe6dc0add50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:58.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.036+0000 7fe6e3720640 1 -- 172.21.15.53:0/3170716455 shutdown_connections 2023-06-10T18:52:58.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.036+0000 7fe6e3720640 1 -- 172.21.15.53:0/3170716455 wait complete. 2023-06-10T18:52:58.063 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2023-06-10T18:52:57.562757+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235100,"kb_used_data":3100,"kb_used_omap":0,"kb_used_meta":231936,"kb_avail":754739620,"statfs":{"total":773094113280,"available":772853370880,"internally_reserved":0,"allocated":3174400,"data_stored":1899195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":237502464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.634235"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.093989+0000","last_change":"2023-06-10T18:52:44.947732+0000","last_active":"2023-06-10T18:52:47.093989+0000","last_peered":"2023-06-10T18:52:47.093989+0000","last_clean":"2023-06-10T18:52:47.093989+0000","last_became_active":"2023-06-10T18:52:44.947398+0000","last_became_peered":"2023-06-10T18:52:44.947398+0000","last_unstale":"2023-06-10T18:52:47.093989+0000","last_undegraded":"2023-06-10T18:52:47.093989+0000","last_fullsized":"2023-06-10T18:52:47.093989+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:06:36.663322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.935057+0000","last_change":"2023-06-10T18:52:44.961438+0000","last_active":"2023-06-10T18:52:45.935057+0000","last_peered":"2023-06-10T18:52:45.935057+0000","last_clean":"2023-06-10T18:52:45.935057+0000","last_became_active":"2023-06-10T18:52:44.961134+0000","last_became_peered":"2023-06-10T18:52:44.961134+0000","last_unstale":"2023-06-10T18:52:45.935057+0000","last_undegraded":"2023-06-10T18:52:45.935057+0000","last_fullsized":"2023-06-10T18:52:45.935057+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:49:49.618852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.931821+0000","last_change":"2023-06-10T18:52:44.955647+0000","last_active":"2023-06-10T18:52:45.931821+0000","last_peered":"2023-06-10T18:52:45.931821+0000","last_clean":"2023-06-10T18:52:45.931821+0000","last_became_active":"2023-06-10T18:52:44.955093+0000","last_became_peered":"2023-06-10T18:52:44.955093+0000","last_unstale":"2023-06-10T18:52:45.931821+0000","last_undegraded":"2023-06-10T18:52:45.931821+0000","last_fullsized":"2023-06-10T18:52:45.931821+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:37:28.673117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.095194+0000","last_change":"2023-06-10T18:52:44.940992+0000","last_active":"2023-06-10T18:52:47.095194+0000","last_peered":"2023-06-10T18:52:47.095194+0000","last_clean":"2023-06-10T18:52:47.095194+0000","last_became_active":"2023-06-10T18:52:44.940703+0000","last_became_peered":"2023-06-10T18:52:44.940703+0000","last_unstale":"2023-06-10T18:52:47.095194+0000","last_undegraded":"2023-06-10T18:52:47.095194+0000","last_fullsized":"2023-06-10T18:52:47.095194+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:17:13.902888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.074101+0000","last_change":"2023-06-10T18:52:44.954034+0000","last_active":"2023-06-10T18:52:47.074101+0000","last_peered":"2023-06-10T18:52:47.074101+0000","last_clean":"2023-06-10T18:52:47.074101+0000","last_became_active":"2023-06-10T18:52:44.953626+0000","last_became_peered":"2023-06-10T18:52:44.953626+0000","last_unstale":"2023-06-10T18:52:47.074101+0000","last_undegraded":"2023-06-10T18:52:47.074101+0000","last_fullsized":"2023-06-10T18:52:47.074101+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:41:13.376627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.932554+0000","last_change":"2023-06-10T18:52:44.944206+0000","last_active":"2023-06-10T18:52:45.932554+0000","last_peered":"2023-06-10T18:52:45.932554+0000","last_clean":"2023-06-10T18:52:45.932554+0000","last_became_active":"2023-06-10T18:52:44.943687+0000","last_became_peered":"2023-06-10T18:52:44.943687+0000","last_unstale":"2023-06-10T18:52:45.932554+0000","last_undegraded":"2023-06-10T18:52:45.932554+0000","last_fullsized":"2023-06-10T18:52:45.932554+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:02:43.231973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.095766+0000","last_change":"2023-06-10T18:52:44.958696+0000","last_active":"2023-06-10T18:52:47.095766+0000","last_peered":"2023-06-10T18:52:47.095766+0000","last_clean":"2023-06-10T18:52:47.095766+0000","last_became_active":"2023-06-10T18:52:44.958075+0000","last_became_peered":"2023-06-10T18:52:44.958075+0000","last_unstale":"2023-06-10T18:52:47.095766+0000","last_undegraded":"2023-06-10T18:52:47.095766+0000","last_fullsized":"2023-06-10T18:52:47.095766+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T18:54:16.713072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.934329+0000","last_change":"2023-06-10T18:52:44.945375+0000","last_active":"2023-06-10T18:52:45.934329+0000","last_peered":"2023-06-10T18:52:45.934329+0000","last_clean":"2023-06-10T18:52:45.934329+0000","last_became_active":"2023-06-10T18:52:44.945059+0000","last_became_peered":"2023-06-10T18:52:44.945059+0000","last_unstale":"2023-06-10T18:52:45.934329+0000","last_undegraded":"2023-06-10T18:52:45.934329+0000","last_fullsized":"2023-06-10T18:52:45.934329+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:59:51.325397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.073399+0000","last_change":"2023-06-10T18:52:44.960556+0000","last_active":"2023-06-10T18:52:47.073399+0000","last_peered":"2023-06-10T18:52:47.073399+0000","last_clean":"2023-06-10T18:52:47.073399+0000","last_became_active":"2023-06-10T18:52:44.960174+0000","last_became_peered":"2023-06-10T18:52:44.960174+0000","last_unstale":"2023-06-10T18:52:47.073399+0000","last_undegraded":"2023-06-10T18:52:47.073399+0000","last_fullsized":"2023-06-10T18:52:47.073399+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:53:28.618960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.935372+0000","last_change":"2023-06-10T18:52:44.961025+0000","last_active":"2023-06-10T18:52:45.935372+0000","last_peered":"2023-06-10T18:52:45.935372+0000","last_clean":"2023-06-10T18:52:45.935372+0000","last_became_active":"2023-06-10T18:52:44.960661+0000","last_became_peered":"2023-06-10T18:52:44.960661+0000","last_unstale":"2023-06-10T18:52:45.935372+0000","last_undegraded":"2023-06-10T18:52:45.935372+0000","last_fullsized":"2023-06-10T18:52:45.935372+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:02:43.231973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.932039+0000","last_change":"2023-06-10T18:52:44.958300+0000","last_active":"2023-06-10T18:52:45.932039+0000","last_peered":"2023-06-10T18:52:45.932039+0000","last_clean":"2023-06-10T18:52:45.932039+0000","last_became_active":"2023-06-10T18:52:44.958013+0000","last_became_peered":"2023-06-10T18:52:44.958013+0000","last_unstale":"2023-06-10T18:52:45.932039+0000","last_undegraded":"2023-06-10T18:52:45.932039+0000","last_fullsized":"2023-06-10T18:52:45.932039+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:39:10.018608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.094202+0000","last_change":"2023-06-10T18:52:44.951808+0000","last_active":"2023-06-10T18:52:47.094202+0000","last_peered":"2023-06-10T18:52:47.094202+0000","last_clean":"2023-06-10T18:52:47.094202+0000","last_became_active":"2023-06-10T18:52:44.951348+0000","last_became_peered":"2023-06-10T18:52:44.951348+0000","last_unstale":"2023-06-10T18:52:47.094202+0000","last_undegraded":"2023-06-10T18:52:47.094202+0000","last_fullsized":"2023-06-10T18:52:47.094202+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:41:10.737097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.093897+0000","last_change":"2023-06-10T18:52:44.941608+0000","last_active":"2023-06-10T18:52:47.093897+0000","last_peered":"2023-06-10T18:52:47.093897+0000","last_clean":"2023-06-10T18:52:47.093897+0000","last_became_active":"2023-06-10T18:52:44.941232+0000","last_became_peered":"2023-06-10T18:52:44.941232+0000","last_unstale":"2023-06-10T18:52:47.093897+0000","last_undegraded":"2023-06-10T18:52:47.093897+0000","last_fullsized":"2023-06-10T18:52:47.093897+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:34:30.103416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.935166+0000","last_change":"2023-06-10T18:52:44.946464+0000","last_active":"2023-06-10T18:52:45.935166+0000","last_peered":"2023-06-10T18:52:45.935166+0000","last_clean":"2023-06-10T18:52:45.935166+0000","last_became_active":"2023-06-10T18:52:44.946097+0000","last_became_peered":"2023-06-10T18:52:44.946097+0000","last_unstale":"2023-06-10T18:52:45.935166+0000","last_undegraded":"2023-06-10T18:52:45.935166+0000","last_fullsized":"2023-06-10T18:52:45.935166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:37:26.347275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.096155+0000","last_change":"2023-06-10T18:52:44.958946+0000","last_active":"2023-06-10T18:52:47.096155+0000","last_peered":"2023-06-10T18:52:47.096155+0000","last_clean":"2023-06-10T18:52:47.096155+0000","last_became_active":"2023-06-10T18:52:44.958439+0000","last_became_peered":"2023-06-10T18:52:44.958439+0000","last_unstale":"2023-06-10T18:52:47.096155+0000","last_undegraded":"2023-06-10T18:52:47.096155+0000","last_fullsized":"2023-06-10T18:52:47.096155+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:14:11.506328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.931732+0000","last_change":"2023-06-10T18:52:44.946069+0000","last_active":"2023-06-10T18:52:45.931732+0000","last_peered":"2023-06-10T18:52:45.931732+0000","last_clean":"2023-06-10T18:52:45.931732+0000","last_became_active":"2023-06-10T18:52:44.945560+0000","last_became_peered":"2023-06-10T18:52:44.945560+0000","last_unstale":"2023-06-10T18:52:45.931732+0000","last_undegraded":"2023-06-10T18:52:45.931732+0000","last_fullsized":"2023-06-10T18:52:45.931732+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:08:50.331605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.073341+0000","last_change":"2023-06-10T18:52:44.961858+0000","last_active":"2023-06-10T18:52:47.073341+0000","last_peered":"2023-06-10T18:52:47.073341+0000","last_clean":"2023-06-10T18:52:47.073341+0000","last_became_active":"2023-06-10T18:52:44.961540+0000","last_became_peered":"2023-06-10T18:52:44.961540+0000","last_unstale":"2023-06-10T18:52:47.073341+0000","last_undegraded":"2023-06-10T18:52:47.073341+0000","last_fullsized":"2023-06-10T18:52:47.073341+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:08:50.331605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.932034+0000","last_change":"2023-06-10T18:52:44.939005+0000","last_active":"2023-06-10T18:52:45.932034+0000","last_peered":"2023-06-10T18:52:45.932034+0000","last_clean":"2023-06-10T18:52:45.932034+0000","last_became_active":"2023-06-10T18:52:44.938775+0000","last_became_peered":"2023-06-10T18:52:44.938775+0000","last_unstale":"2023-06-10T18:52:45.932034+0000","last_undegraded":"2023-06-10T18:52:45.932034+0000","last_fullsized":"2023-06-10T18:52:45.932034+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:42:51.947168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.094083+0000","last_change":"2023-06-10T18:52:44.941417+0000","last_active":"2023-06-10T18:52:47.094083+0000","last_peered":"2023-06-10T18:52:47.094083+0000","last_clean":"2023-06-10T18:52:47.094083+0000","last_became_active":"2023-06-10T18:52:44.940980+0000","last_became_peered":"2023-06-10T18:52:44.940980+0000","last_unstale":"2023-06-10T18:52:47.094083+0000","last_undegraded":"2023-06-10T18:52:47.094083+0000","last_fullsized":"2023-06-10T18:52:47.094083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:33:22.583233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.932218+0000","last_change":"2023-06-10T18:52:44.944705+0000","last_active":"2023-06-10T18:52:45.932218+0000","last_peered":"2023-06-10T18:52:45.932218+0000","last_clean":"2023-06-10T18:52:45.932218+0000","last_became_active":"2023-06-10T18:52:44.944399+0000","last_became_peered":"2023-06-10T18:52:44.944399+0000","last_unstale":"2023-06-10T18:52:45.932218+0000","last_undegraded":"2023-06-10T18:52:45.932218+0000","last_fullsized":"2023-06-10T18:52:45.932218+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:39:06.207720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.096145+0000","last_change":"2023-06-10T18:52:44.959863+0000","last_active":"2023-06-10T18:52:47.096145+0000","last_peered":"2023-06-10T18:52:47.096145+0000","last_clean":"2023-06-10T18:52:47.096145+0000","last_became_active":"2023-06-10T18:52:44.959556+0000","last_became_peered":"2023-06-10T18:52:44.959556+0000","last_unstale":"2023-06-10T18:52:47.096145+0000","last_undegraded":"2023-06-10T18:52:47.096145+0000","last_fullsized":"2023-06-10T18:52:47.096145+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:02:43.231973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.073202+0000","last_change":"2023-06-10T18:52:44.961343+0000","last_active":"2023-06-10T18:52:47.073202+0000","last_peered":"2023-06-10T18:52:47.073202+0000","last_clean":"2023-06-10T18:52:47.073202+0000","last_became_active":"2023-06-10T18:52:44.960957+0000","last_became_peered":"2023-06-10T18:52:44.960957+0000","last_unstale":"2023-06-10T18:52:47.073202+0000","last_undegraded":"2023-06-10T18:52:47.073202+0000","last_fullsized":"2023-06-10T18:52:47.073202+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:54:34.871667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.929467+0000","last_change":"2023-06-10T18:52:44.952488+0000","last_active":"2023-06-10T18:52:45.929467+0000","last_peered":"2023-06-10T18:52:45.929467+0000","last_clean":"2023-06-10T18:52:45.929467+0000","last_became_active":"2023-06-10T18:52:44.951957+0000","last_became_peered":"2023-06-10T18:52:44.951957+0000","last_unstale":"2023-06-10T18:52:45.929467+0000","last_undegraded":"2023-06-10T18:52:45.929467+0000","last_fullsized":"2023-06-10T18:52:45.929467+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:31:20.946172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.094882+0000","last_change":"2023-06-10T18:52:44.960097+0000","last_active":"2023-06-10T18:52:47.094882+0000","last_peered":"2023-06-10T18:52:47.094882+0000","last_clean":"2023-06-10T18:52:47.094882+0000","last_became_active":"2023-06-10T18:52:44.959605+0000","last_became_peered":"2023-06-10T18:52:44.959605+0000","last_unstale":"2023-06-10T18:52:47.094882+0000","last_undegraded":"2023-06-10T18:52:47.094882+0000","last_fullsized":"2023-06-10T18:52:47.094882+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:08:04.480136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.095654+0000","last_change":"2023-06-10T18:52:44.956446+0000","last_active":"2023-06-10T18:52:47.095654+0000","last_peered":"2023-06-10T18:52:47.095654+0000","last_clean":"2023-06-10T18:52:47.095654+0000","last_became_active":"2023-06-10T18:52:44.954175+0000","last_became_peered":"2023-06-10T18:52:44.954175+0000","last_unstale":"2023-06-10T18:52:47.095654+0000","last_undegraded":"2023-06-10T18:52:47.095654+0000","last_fullsized":"2023-06-10T18:52:47.095654+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T18:54:16.713072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.095401+0000","last_change":"2023-06-10T18:52:44.956942+0000","last_active":"2023-06-10T18:52:47.095401+0000","last_peered":"2023-06-10T18:52:47.095401+0000","last_clean":"2023-06-10T18:52:47.095401+0000","last_became_active":"2023-06-10T18:52:44.953322+0000","last_became_peered":"2023-06-10T18:52:44.953322+0000","last_unstale":"2023-06-10T18:52:47.095401+0000","last_undegraded":"2023-06-10T18:52:47.095401+0000","last_fullsized":"2023-06-10T18:52:47.095401+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:39:10.018608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.934856+0000","last_change":"2023-06-10T18:52:44.942786+0000","last_active":"2023-06-10T18:52:45.934856+0000","last_peered":"2023-06-10T18:52:45.934856+0000","last_clean":"2023-06-10T18:52:45.934856+0000","last_became_active":"2023-06-10T18:52:44.942216+0000","last_became_peered":"2023-06-10T18:52:44.942216+0000","last_unstale":"2023-06-10T18:52:45.934856+0000","last_undegraded":"2023-06-10T18:52:45.934856+0000","last_fullsized":"2023-06-10T18:52:45.934856+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:08:04.480136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.095440+0000","last_change":"2023-06-10T18:52:44.958527+0000","last_active":"2023-06-10T18:52:47.095440+0000","last_peered":"2023-06-10T18:52:47.095440+0000","last_clean":"2023-06-10T18:52:47.095440+0000","last_became_active":"2023-06-10T18:52:44.958233+0000","last_became_peered":"2023-06-10T18:52:44.958233+0000","last_unstale":"2023-06-10T18:52:47.095440+0000","last_undegraded":"2023-06-10T18:52:47.095440+0000","last_fullsized":"2023-06-10T18:52:47.095440+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:08:04.480136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.930241+0000","last_change":"2023-06-10T18:52:44.946412+0000","last_active":"2023-06-10T18:52:45.930241+0000","last_peered":"2023-06-10T18:52:45.930241+0000","last_clean":"2023-06-10T18:52:45.930241+0000","last_became_active":"2023-06-10T18:52:44.945955+0000","last_became_peered":"2023-06-10T18:52:44.945955+0000","last_unstale":"2023-06-10T18:52:45.930241+0000","last_undegraded":"2023-06-10T18:52:45.930241+0000","last_fullsized":"2023-06-10T18:52:45.930241+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:08:04.480136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.932719+0000","last_change":"2023-06-10T18:52:44.942149+0000","last_active":"2023-06-10T18:52:45.932719+0000","last_peered":"2023-06-10T18:52:45.932719+0000","last_clean":"2023-06-10T18:52:45.932719+0000","last_became_active":"2023-06-10T18:52:44.939204+0000","last_became_peered":"2023-06-10T18:52:44.939204+0000","last_unstale":"2023-06-10T18:52:45.932719+0000","last_undegraded":"2023-06-10T18:52:45.932719+0000","last_fullsized":"2023-06-10T18:52:45.932719+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:14:11.506328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.929536+0000","last_change":"2023-06-10T18:52:44.960157+0000","last_active":"2023-06-10T18:52:45.929536+0000","last_peered":"2023-06-10T18:52:45.929536+0000","last_clean":"2023-06-10T18:52:45.929536+0000","last_became_active":"2023-06-10T18:52:44.959460+0000","last_became_peered":"2023-06-10T18:52:44.959460+0000","last_unstale":"2023-06-10T18:52:45.929536+0000","last_undegraded":"2023-06-10T18:52:45.929536+0000","last_fullsized":"2023-06-10T18:52:45.929536+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:53:28.618960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.094637+0000","last_change":"2023-06-10T18:52:44.937198+0000","last_active":"2023-06-10T18:52:47.094637+0000","last_peered":"2023-06-10T18:52:47.094637+0000","last_clean":"2023-06-10T18:52:47.094637+0000","last_became_active":"2023-06-10T18:52:44.936793+0000","last_became_peered":"2023-06-10T18:52:44.936793+0000","last_unstale":"2023-06-10T18:52:47.094637+0000","last_undegraded":"2023-06-10T18:52:47.094637+0000","last_fullsized":"2023-06-10T18:52:47.094637+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:46:29.935621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.929593+0000","last_change":"2023-06-10T18:52:44.955794+0000","last_active":"2023-06-10T18:52:45.929593+0000","last_peered":"2023-06-10T18:52:45.929593+0000","last_clean":"2023-06-10T18:52:45.929593+0000","last_became_active":"2023-06-10T18:52:44.955013+0000","last_became_peered":"2023-06-10T18:52:44.955013+0000","last_unstale":"2023-06-10T18:52:45.929593+0000","last_undegraded":"2023-06-10T18:52:45.929593+0000","last_fullsized":"2023-06-10T18:52:45.929593+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:37:28.673117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.096398+0000","last_change":"2023-06-10T18:52:44.586121+0000","last_active":"2023-06-10T18:52:47.096398+0000","last_peered":"2023-06-10T18:52:47.096398+0000","last_clean":"2023-06-10T18:52:47.096398+0000","last_became_active":"2023-06-10T18:52:44.584334+0000","last_became_peered":"2023-06-10T18:52:44.584334+0000","last_unstale":"2023-06-10T18:52:47.096398+0000","last_undegraded":"2023-06-10T18:52:47.096398+0000","last_fullsized":"2023-06-10T18:52:47.096398+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:44:27.810129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.934843+0000","last_change":"2023-06-10T18:52:44.942980+0000","last_active":"2023-06-10T18:52:45.934843+0000","last_peered":"2023-06-10T18:52:45.934843+0000","last_clean":"2023-06-10T18:52:45.934843+0000","last_became_active":"2023-06-10T18:52:44.942538+0000","last_became_peered":"2023-06-10T18:52:44.942538+0000","last_unstale":"2023-06-10T18:52:45.934843+0000","last_undegraded":"2023-06-10T18:52:45.934843+0000","last_fullsized":"2023-06-10T18:52:45.934843+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:39:06.207720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.073250+0000","last_change":"2023-06-10T18:52:44.573070+0000","last_active":"2023-06-10T18:52:47.073250+0000","last_peered":"2023-06-10T18:52:47.073250+0000","last_clean":"2023-06-10T18:52:47.073250+0000","last_became_active":"2023-06-10T18:52:44.572659+0000","last_became_peered":"2023-06-10T18:52:44.572659+0000","last_unstale":"2023-06-10T18:52:47.073250+0000","last_undegraded":"2023-06-10T18:52:47.073250+0000","last_fullsized":"2023-06-10T18:52:47.073250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:31:19.942168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.073865+0000","last_change":"2023-06-10T18:52:44.966527+0000","last_active":"2023-06-10T18:52:47.073865+0000","last_peered":"2023-06-10T18:52:47.073865+0000","last_clean":"2023-06-10T18:52:47.073865+0000","last_became_active":"2023-06-10T18:52:44.962455+0000","last_became_peered":"2023-06-10T18:52:44.962455+0000","last_unstale":"2023-06-10T18:52:47.073865+0000","last_undegraded":"2023-06-10T18:52:47.073865+0000","last_fullsized":"2023-06-10T18:52:47.073865+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:39:06.207720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.096102+0000","last_change":"2023-06-10T18:52:44.584545+0000","last_active":"2023-06-10T18:52:47.096102+0000","last_peered":"2023-06-10T18:52:47.096102+0000","last_clean":"2023-06-10T18:52:47.096102+0000","last_became_active":"2023-06-10T18:52:44.583973+0000","last_became_peered":"2023-06-10T18:52:44.583973+0000","last_unstale":"2023-06-10T18:52:47.096102+0000","last_undegraded":"2023-06-10T18:52:47.096102+0000","last_fullsized":"2023-06-10T18:52:47.096102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:37:25.343271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.929677+0000","last_change":"2023-06-10T18:52:44.946578+0000","last_active":"2023-06-10T18:52:45.929677+0000","last_peered":"2023-06-10T18:52:45.929677+0000","last_clean":"2023-06-10T18:52:45.929677+0000","last_became_active":"2023-06-10T18:52:44.945951+0000","last_became_peered":"2023-06-10T18:52:44.945951+0000","last_unstale":"2023-06-10T18:52:45.929677+0000","last_undegraded":"2023-06-10T18:52:45.929677+0000","last_fullsized":"2023-06-10T18:52:45.929677+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:59:51.325397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.094726+0000","last_change":"2023-06-10T18:52:44.556644+0000","last_active":"2023-06-10T18:52:47.094726+0000","last_peered":"2023-06-10T18:52:47.094726+0000","last_clean":"2023-06-10T18:52:47.094726+0000","last_became_active":"2023-06-10T18:52:44.554676+0000","last_became_peered":"2023-06-10T18:52:44.554676+0000","last_unstale":"2023-06-10T18:52:47.094726+0000","last_undegraded":"2023-06-10T18:52:47.094726+0000","last_fullsized":"2023-06-10T18:52:47.094726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:39:58.210679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.096897+0000","last_change":"2023-06-10T18:52:44.586426+0000","last_active":"2023-06-10T18:52:47.096897+0000","last_peered":"2023-06-10T18:52:47.096897+0000","last_clean":"2023-06-10T18:52:47.096897+0000","last_became_active":"2023-06-10T18:52:44.585486+0000","last_became_peered":"2023-06-10T18:52:44.585486+0000","last_unstale":"2023-06-10T18:52:47.096897+0000","last_undegraded":"2023-06-10T18:52:47.096897+0000","last_fullsized":"2023-06-10T18:52:47.096897+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:21:48.058795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.934330+0000","last_change":"2023-06-10T18:52:44.948157+0000","last_active":"2023-06-10T18:52:45.934330+0000","last_peered":"2023-06-10T18:52:45.934330+0000","last_clean":"2023-06-10T18:52:45.934330+0000","last_became_active":"2023-06-10T18:52:44.947864+0000","last_became_peered":"2023-06-10T18:52:44.947864+0000","last_unstale":"2023-06-10T18:52:45.934330+0000","last_undegraded":"2023-06-10T18:52:45.934330+0000","last_fullsized":"2023-06-10T18:52:45.934330+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:42:51.947168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.096656+0000","last_change":"2023-06-10T18:52:44.585679+0000","last_active":"2023-06-10T18:52:47.096656+0000","last_peered":"2023-06-10T18:52:47.096656+0000","last_clean":"2023-06-10T18:52:47.096656+0000","last_became_active":"2023-06-10T18:52:44.585190+0000","last_became_peered":"2023-06-10T18:52:44.585190+0000","last_unstale":"2023-06-10T18:52:47.096656+0000","last_undegraded":"2023-06-10T18:52:47.096656+0000","last_fullsized":"2023-06-10T18:52:47.096656+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:28:02.644430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.932803+0000","last_change":"2023-06-10T18:52:44.958947+0000","last_active":"2023-06-10T18:52:45.932803+0000","last_peered":"2023-06-10T18:52:45.932803+0000","last_clean":"2023-06-10T18:52:45.932803+0000","last_became_active":"2023-06-10T18:52:44.958289+0000","last_became_peered":"2023-06-10T18:52:44.958289+0000","last_unstale":"2023-06-10T18:52:45.932803+0000","last_undegraded":"2023-06-10T18:52:45.932803+0000","last_fullsized":"2023-06-10T18:52:45.932803+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:34:51.394045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.096353+0000","last_change":"2023-06-10T18:52:44.581981+0000","last_active":"2023-06-10T18:52:47.096353+0000","last_peered":"2023-06-10T18:52:47.096353+0000","last_clean":"2023-06-10T18:52:47.096353+0000","last_became_active":"2023-06-10T18:52:44.581382+0000","last_became_peered":"2023-06-10T18:52:44.581382+0000","last_unstale":"2023-06-10T18:52:47.096353+0000","last_undegraded":"2023-06-10T18:52:47.096353+0000","last_fullsized":"2023-06-10T18:52:47.096353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:34:50.390041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.094856+0000","last_change":"2023-06-10T18:52:44.958474+0000","last_active":"2023-06-10T18:52:47.094856+0000","last_peered":"2023-06-10T18:52:47.094856+0000","last_clean":"2023-06-10T18:52:47.094856+0000","last_became_active":"2023-06-10T18:52:44.958186+0000","last_became_peered":"2023-06-10T18:52:44.958186+0000","last_unstale":"2023-06-10T18:52:47.094856+0000","last_undegraded":"2023-06-10T18:52:47.094856+0000","last_fullsized":"2023-06-10T18:52:47.094856+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:38:29.923050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.934807+0000","last_change":"2023-06-10T18:52:44.559256+0000","last_active":"2023-06-10T18:52:45.934807+0000","last_peered":"2023-06-10T18:52:45.934807+0000","last_clean":"2023-06-10T18:52:45.934807+0000","last_became_active":"2023-06-10T18:52:44.558447+0000","last_became_peered":"2023-06-10T18:52:44.558447+0000","last_unstale":"2023-06-10T18:52:45.934807+0000","last_undegraded":"2023-06-10T18:52:45.934807+0000","last_fullsized":"2023-06-10T18:52:45.934807+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:39:09.014604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.073739+0000","last_change":"2023-06-10T18:52:44.962607+0000","last_active":"2023-06-10T18:52:47.073739+0000","last_peered":"2023-06-10T18:52:47.073739+0000","last_clean":"2023-06-10T18:52:47.073739+0000","last_became_active":"2023-06-10T18:52:44.962105+0000","last_became_peered":"2023-06-10T18:52:44.962105+0000","last_unstale":"2023-06-10T18:52:47.073739+0000","last_undegraded":"2023-06-10T18:52:47.073739+0000","last_fullsized":"2023-06-10T18:52:47.073739+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:39:10.888321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.930610+0000","last_change":"2023-06-10T18:52:44.559397+0000","last_active":"2023-06-10T18:52:45.930610+0000","last_peered":"2023-06-10T18:52:45.930610+0000","last_clean":"2023-06-10T18:52:45.930610+0000","last_became_active":"2023-06-10T18:52:44.558955+0000","last_became_peered":"2023-06-10T18:52:44.558955+0000","last_unstale":"2023-06-10T18:52:45.930610+0000","last_undegraded":"2023-06-10T18:52:45.930610+0000","last_fullsized":"2023-06-10T18:52:45.930610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:49:48.614848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.931811+0000","last_change":"2023-06-10T18:52:44.955143+0000","last_active":"2023-06-10T18:52:45.931811+0000","last_peered":"2023-06-10T18:52:45.931811+0000","last_clean":"2023-06-10T18:52:45.931811+0000","last_became_active":"2023-06-10T18:52:44.954157+0000","last_became_peered":"2023-06-10T18:52:44.954157+0000","last_unstale":"2023-06-10T18:52:45.931811+0000","last_undegraded":"2023-06-10T18:52:45.931811+0000","last_fullsized":"2023-06-10T18:52:45.931811+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:53:28.618960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.095432+0000","last_change":"2023-06-10T18:52:44.575768+0000","last_active":"2023-06-10T18:52:47.095432+0000","last_peered":"2023-06-10T18:52:47.095432+0000","last_clean":"2023-06-10T18:52:47.095432+0000","last_became_active":"2023-06-10T18:52:44.575122+0000","last_became_peered":"2023-06-10T18:52:44.575122+0000","last_unstale":"2023-06-10T18:52:47.095432+0000","last_undegraded":"2023-06-10T18:52:47.095432+0000","last_fullsized":"2023-06-10T18:52:47.095432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:01:26.727248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.932347+0000","last_change":"2023-06-10T18:52:44.938302+0000","last_active":"2023-06-10T18:52:45.932347+0000","last_peered":"2023-06-10T18:52:45.932347+0000","last_clean":"2023-06-10T18:52:45.932347+0000","last_became_active":"2023-06-10T18:52:44.938005+0000","last_became_peered":"2023-06-10T18:52:44.938005+0000","last_unstale":"2023-06-10T18:52:45.932347+0000","last_undegraded":"2023-06-10T18:52:45.932347+0000","last_fullsized":"2023-06-10T18:52:45.932347+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:49:49.618852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.932470+0000","last_change":"2023-06-10T18:52:44.561044+0000","last_active":"2023-06-10T18:52:45.932470+0000","last_peered":"2023-06-10T18:52:45.932470+0000","last_clean":"2023-06-10T18:52:45.932470+0000","last_became_active":"2023-06-10T18:52:44.560233+0000","last_became_peered":"2023-06-10T18:52:44.560233+0000","last_unstale":"2023-06-10T18:52:45.932470+0000","last_undegraded":"2023-06-10T18:52:45.932470+0000","last_fullsized":"2023-06-10T18:52:45.932470+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:37:25.343271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.932395+0000","last_change":"2023-06-10T18:52:44.951038+0000","last_active":"2023-06-10T18:52:45.932395+0000","last_peered":"2023-06-10T18:52:45.932395+0000","last_clean":"2023-06-10T18:52:45.932395+0000","last_became_active":"2023-06-10T18:52:44.942868+0000","last_became_peered":"2023-06-10T18:52:44.942868+0000","last_unstale":"2023-06-10T18:52:45.932395+0000","last_undegraded":"2023-06-10T18:52:45.932395+0000","last_fullsized":"2023-06-10T18:52:45.932395+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:41:13.376627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.929453+0000","last_change":"2023-06-10T18:52:44.558548+0000","last_active":"2023-06-10T18:52:45.929453+0000","last_peered":"2023-06-10T18:52:45.929453+0000","last_clean":"2023-06-10T18:52:45.929453+0000","last_became_active":"2023-06-10T18:52:44.558194+0000","last_became_peered":"2023-06-10T18:52:44.558194+0000","last_unstale":"2023-06-10T18:52:45.929453+0000","last_undegraded":"2023-06-10T18:52:45.929453+0000","last_fullsized":"2023-06-10T18:52:45.929453+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:54:33.867663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.094869+0000","last_change":"2023-06-10T18:52:44.967155+0000","last_active":"2023-06-10T18:52:47.094869+0000","last_peered":"2023-06-10T18:52:47.094869+0000","last_clean":"2023-06-10T18:52:47.094869+0000","last_became_active":"2023-06-10T18:52:44.966889+0000","last_became_peered":"2023-06-10T18:52:44.966889+0000","last_unstale":"2023-06-10T18:52:47.094869+0000","last_undegraded":"2023-06-10T18:52:47.094869+0000","last_fullsized":"2023-06-10T18:52:47.094869+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:42:51.947168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":175,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.095406+0000","last_change":"2023-06-10T18:52:34.951528+0000","last_active":"2023-06-10T18:52:47.095406+0000","last_peered":"2023-06-10T18:52:47.095406+0000","last_clean":"2023-06-10T18:52:47.095406+0000","last_became_active":"2023-06-10T18:52:34.949099+0000","last_became_peered":"2023-06-10T18:52:34.949099+0000","last_unstale":"2023-06-10T18:52:47.095406+0000","last_undegraded":"2023-06-10T18:52:47.095406+0000","last_fullsized":"2023-06-10T18:52:47.095406+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_clean_scrub_stamp":"2023-06-10T18:52:33.633295+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:41:02.488686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.934561+0000","last_change":"2023-06-10T18:52:40.506384+0000","last_active":"2023-06-10T18:52:45.934561+0000","last_peered":"2023-06-10T18:52:45.934561+0000","last_clean":"2023-06-10T18:52:45.934561+0000","last_became_active":"2023-06-10T18:52:40.505701+0000","last_became_peered":"2023-06-10T18:52:40.505701+0000","last_unstale":"2023-06-10T18:52:45.934561+0000","last_undegraded":"2023-06-10T18:52:45.934561+0000","last_fullsized":"2023-06-10T18:52:45.934561+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:39:05.841926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.929409+0000","last_change":"2023-06-10T18:52:44.563326+0000","last_active":"2023-06-10T18:52:45.929409+0000","last_peered":"2023-06-10T18:52:45.929409+0000","last_clean":"2023-06-10T18:52:45.929409+0000","last_became_active":"2023-06-10T18:52:44.562901+0000","last_became_peered":"2023-06-10T18:52:44.562901+0000","last_unstale":"2023-06-10T18:52:45.929409+0000","last_undegraded":"2023-06-10T18:52:45.929409+0000","last_fullsized":"2023-06-10T18:52:45.929409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:29:32.049058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.095326+0000","last_change":"2023-06-10T18:52:44.940336+0000","last_active":"2023-06-10T18:52:47.095326+0000","last_peered":"2023-06-10T18:52:47.095326+0000","last_clean":"2023-06-10T18:52:47.095326+0000","last_became_active":"2023-06-10T18:52:44.939935+0000","last_became_peered":"2023-06-10T18:52:44.939935+0000","last_unstale":"2023-06-10T18:52:47.095326+0000","last_undegraded":"2023-06-10T18:52:47.095326+0000","last_fullsized":"2023-06-10T18:52:47.095326+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:42:44.531042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.095044+0000","last_change":"2023-06-10T18:52:40.512015+0000","last_active":"2023-06-10T18:52:47.095044+0000","last_peered":"2023-06-10T18:52:47.095044+0000","last_clean":"2023-06-10T18:52:47.095044+0000","last_became_active":"2023-06-10T18:52:40.511382+0000","last_became_peered":"2023-06-10T18:52:40.511382+0000","last_unstale":"2023-06-10T18:52:47.095044+0000","last_undegraded":"2023-06-10T18:52:47.095044+0000","last_fullsized":"2023-06-10T18:52:47.095044+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:49:44.572458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.073029+0000","last_change":"2023-06-10T18:52:44.575339+0000","last_active":"2023-06-10T18:52:47.073029+0000","last_peered":"2023-06-10T18:52:47.073029+0000","last_clean":"2023-06-10T18:52:47.073029+0000","last_became_active":"2023-06-10T18:52:44.575020+0000","last_became_peered":"2023-06-10T18:52:44.575020+0000","last_unstale":"2023-06-10T18:52:47.073029+0000","last_undegraded":"2023-06-10T18:52:47.073029+0000","last_fullsized":"2023-06-10T18:52:47.073029+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:29:32.049058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.073832+0000","last_change":"2023-06-10T18:52:44.960817+0000","last_active":"2023-06-10T18:52:47.073832+0000","last_peered":"2023-06-10T18:52:47.073832+0000","last_clean":"2023-06-10T18:52:47.073832+0000","last_became_active":"2023-06-10T18:52:44.960128+0000","last_became_peered":"2023-06-10T18:52:44.960128+0000","last_unstale":"2023-06-10T18:52:47.073832+0000","last_undegraded":"2023-06-10T18:52:47.073832+0000","last_fullsized":"2023-06-10T18:52:47.073832+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:39:10.018608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.093628+0000","last_change":"2023-06-10T18:52:40.671725+0000","last_active":"2023-06-10T18:52:47.093628+0000","last_peered":"2023-06-10T18:52:47.093628+0000","last_clean":"2023-06-10T18:52:47.093628+0000","last_became_active":"2023-06-10T18:52:40.671442+0000","last_became_peered":"2023-06-10T18:52:40.671442+0000","last_unstale":"2023-06-10T18:52:47.093628+0000","last_undegraded":"2023-06-10T18:52:47.093628+0000","last_fullsized":"2023-06-10T18:52:47.093628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:50:04.521612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.094350+0000","last_change":"2023-06-10T18:52:44.554010+0000","last_active":"2023-06-10T18:52:47.094350+0000","last_peered":"2023-06-10T18:52:47.094350+0000","last_clean":"2023-06-10T18:52:47.094350+0000","last_became_active":"2023-06-10T18:52:44.553706+0000","last_became_peered":"2023-06-10T18:52:44.553706+0000","last_unstale":"2023-06-10T18:52:47.094350+0000","last_undegraded":"2023-06-10T18:52:47.094350+0000","last_fullsized":"2023-06-10T18:52:47.094350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:08:49.327602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.094957+0000","last_change":"2023-06-10T18:52:44.954070+0000","last_active":"2023-06-10T18:52:47.094957+0000","last_peered":"2023-06-10T18:52:47.094957+0000","last_clean":"2023-06-10T18:52:47.094957+0000","last_became_active":"2023-06-10T18:52:44.953811+0000","last_became_peered":"2023-06-10T18:52:44.953811+0000","last_unstale":"2023-06-10T18:52:47.094957+0000","last_undegraded":"2023-06-10T18:52:47.094957+0000","last_fullsized":"2023-06-10T18:52:47.094957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:39:10.888321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.935370+0000","last_change":"2023-06-10T18:52:40.510258+0000","last_active":"2023-06-10T18:52:45.935370+0000","last_peered":"2023-06-10T18:52:45.935370+0000","last_clean":"2023-06-10T18:52:45.935370+0000","last_became_active":"2023-06-10T18:52:40.509560+0000","last_became_peered":"2023-06-10T18:52:40.509560+0000","last_unstale":"2023-06-10T18:52:45.935370+0000","last_undegraded":"2023-06-10T18:52:45.935370+0000","last_fullsized":"2023-06-10T18:52:45.935370+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:14:06.459934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.932037+0000","last_change":"2023-06-10T18:52:44.574974+0000","last_active":"2023-06-10T18:52:45.932037+0000","last_peered":"2023-06-10T18:52:45.932037+0000","last_clean":"2023-06-10T18:52:45.932037+0000","last_became_active":"2023-06-10T18:52:44.574115+0000","last_became_peered":"2023-06-10T18:52:44.574115+0000","last_unstale":"2023-06-10T18:52:45.932037+0000","last_undegraded":"2023-06-10T18:52:45.932037+0000","last_fullsized":"2023-06-10T18:52:45.932037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:39:09.884317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.095249+0000","last_change":"2023-06-10T18:52:44.954466+0000","last_active":"2023-06-10T18:52:47.095249+0000","last_peered":"2023-06-10T18:52:47.095249+0000","last_clean":"2023-06-10T18:52:47.095249+0000","last_became_active":"2023-06-10T18:52:44.953993+0000","last_became_peered":"2023-06-10T18:52:44.953993+0000","last_unstale":"2023-06-10T18:52:47.095249+0000","last_undegraded":"2023-06-10T18:52:47.095249+0000","last_fullsized":"2023-06-10T18:52:47.095249+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:50:18.328232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.935077+0000","last_change":"2023-06-10T18:52:44.558952+0000","last_active":"2023-06-10T18:52:45.935077+0000","last_peered":"2023-06-10T18:52:45.935077+0000","last_clean":"2023-06-10T18:52:45.935077+0000","last_became_active":"2023-06-10T18:52:44.558238+0000","last_became_peered":"2023-06-10T18:52:44.558238+0000","last_unstale":"2023-06-10T18:52:45.935077+0000","last_undegraded":"2023-06-10T18:52:45.935077+0000","last_fullsized":"2023-06-10T18:52:45.935077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T18:54:15.709068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.095574+0000","last_change":"2023-06-10T18:52:40.672266+0000","last_active":"2023-06-10T18:52:47.095574+0000","last_peered":"2023-06-10T18:52:47.095574+0000","last_clean":"2023-06-10T18:52:47.095574+0000","last_became_active":"2023-06-10T18:52:40.671966+0000","last_became_peered":"2023-06-10T18:52:40.671966+0000","last_unstale":"2023-06-10T18:52:47.095574+0000","last_undegraded":"2023-06-10T18:52:47.095574+0000","last_fullsized":"2023-06-10T18:52:47.095574+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:41:08.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.094687+0000","last_change":"2023-06-10T18:52:44.953256+0000","last_active":"2023-06-10T18:52:47.094687+0000","last_peered":"2023-06-10T18:52:47.094687+0000","last_clean":"2023-06-10T18:52:47.094687+0000","last_became_active":"2023-06-10T18:52:44.952882+0000","last_became_peered":"2023-06-10T18:52:44.952882+0000","last_unstale":"2023-06-10T18:52:47.094687+0000","last_undegraded":"2023-06-10T18:52:47.094687+0000","last_fullsized":"2023-06-10T18:52:47.094687+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:37:28.673117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.095401+0000","last_change":"2023-06-10T18:52:44.555209+0000","last_active":"2023-06-10T18:52:47.095401+0000","last_peered":"2023-06-10T18:52:47.095401+0000","last_clean":"2023-06-10T18:52:47.095401+0000","last_became_active":"2023-06-10T18:52:44.554807+0000","last_became_peered":"2023-06-10T18:52:44.554807+0000","last_unstale":"2023-06-10T18:52:47.095401+0000","last_undegraded":"2023-06-10T18:52:47.095401+0000","last_fullsized":"2023-06-10T18:52:47.095401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:39:05.203717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.096653+0000","last_change":"2023-06-10T18:52:40.671084+0000","last_active":"2023-06-10T18:52:47.096653+0000","last_peered":"2023-06-10T18:52:47.096653+0000","last_clean":"2023-06-10T18:52:47.096653+0000","last_became_active":"2023-06-10T18:52:40.670697+0000","last_became_peered":"2023-06-10T18:52:40.670697+0000","last_unstale":"2023-06-10T18:52:47.096653+0000","last_undegraded":"2023-06-10T18:52:47.096653+0000","last_fullsized":"2023-06-10T18:52:47.096653+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:32:49.983600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.073669+0000","last_change":"2023-06-10T18:52:44.952636+0000","last_active":"2023-06-10T18:52:47.073669+0000","last_peered":"2023-06-10T18:52:47.073669+0000","last_clean":"2023-06-10T18:52:47.073669+0000","last_became_active":"2023-06-10T18:52:44.952234+0000","last_became_peered":"2023-06-10T18:52:44.952234+0000","last_unstale":"2023-06-10T18:52:47.073669+0000","last_undegraded":"2023-06-10T18:52:47.073669+0000","last_fullsized":"2023-06-10T18:52:47.073669+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:59:51.325397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.929887+0000","last_change":"2023-06-10T18:52:44.573554+0000","last_active":"2023-06-10T18:52:45.929887+0000","last_peered":"2023-06-10T18:52:45.929887+0000","last_clean":"2023-06-10T18:52:45.929887+0000","last_became_active":"2023-06-10T18:52:44.573142+0000","last_became_peered":"2023-06-10T18:52:44.573142+0000","last_unstale":"2023-06-10T18:52:45.929887+0000","last_undegraded":"2023-06-10T18:52:45.929887+0000","last_fullsized":"2023-06-10T18:52:45.929887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:39:05.203717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.095517+0000","last_change":"2023-06-10T18:52:40.514114+0000","last_active":"2023-06-10T18:52:47.095517+0000","last_peered":"2023-06-10T18:52:47.095517+0000","last_clean":"2023-06-10T18:52:47.095517+0000","last_became_active":"2023-06-10T18:52:40.513638+0000","last_became_peered":"2023-06-10T18:52:40.513638+0000","last_unstale":"2023-06-10T18:52:47.095517+0000","last_undegraded":"2023-06-10T18:52:47.095517+0000","last_fullsized":"2023-06-10T18:52:47.095517+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:49:44.572458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.929271+0000","last_change":"2023-06-10T18:52:44.949048+0000","last_active":"2023-06-10T18:52:45.929271+0000","last_peered":"2023-06-10T18:52:45.929271+0000","last_clean":"2023-06-10T18:52:45.929271+0000","last_became_active":"2023-06-10T18:52:44.948643+0000","last_became_peered":"2023-06-10T18:52:44.948643+0000","last_unstale":"2023-06-10T18:52:45.929271+0000","last_undegraded":"2023-06-10T18:52:45.929271+0000","last_fullsized":"2023-06-10T18:52:45.929271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:38:52.793572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.596864+0000","last_change":"2023-06-10T18:52:44.555532+0000","last_active":"2023-06-10T18:52:47.596864+0000","last_peered":"2023-06-10T18:52:47.596864+0000","last_clean":"2023-06-10T18:52:47.596864+0000","last_became_active":"2023-06-10T18:52:44.555234+0000","last_became_peered":"2023-06-10T18:52:44.555234+0000","last_unstale":"2023-06-10T18:52:47.596864+0000","last_undegraded":"2023-06-10T18:52:47.596864+0000","last_fullsized":"2023-06-10T18:52:47.596864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:08:03.476132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.095638+0000","last_change":"2023-06-10T18:52:40.515396+0000","last_active":"2023-06-10T18:52:47.095638+0000","last_peered":"2023-06-10T18:52:47.095638+0000","last_clean":"2023-06-10T18:52:47.095638+0000","last_became_active":"2023-06-10T18:52:40.514663+0000","last_became_peered":"2023-06-10T18:52:40.514663+0000","last_unstale":"2023-06-10T18:52:47.095638+0000","last_undegraded":"2023-06-10T18:52:47.095638+0000","last_fullsized":"2023-06-10T18:52:47.095638+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:29:28.006668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.932272+0000","last_change":"2023-06-10T18:52:44.946073+0000","last_active":"2023-06-10T18:52:45.932272+0000","last_peered":"2023-06-10T18:52:45.932272+0000","last_clean":"2023-06-10T18:52:45.932272+0000","last_became_active":"2023-06-10T18:52:44.945497+0000","last_became_peered":"2023-06-10T18:52:44.945497+0000","last_unstale":"2023-06-10T18:52:45.932272+0000","last_undegraded":"2023-06-10T18:52:45.932272+0000","last_fullsized":"2023-06-10T18:52:45.932272+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:08:04.480136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.931851+0000","last_change":"2023-06-10T18:52:44.943166+0000","last_active":"2023-06-10T18:52:45.931851+0000","last_peered":"2023-06-10T18:52:45.931851+0000","last_clean":"2023-06-10T18:52:45.931851+0000","last_became_active":"2023-06-10T18:52:44.942777+0000","last_became_peered":"2023-06-10T18:52:44.942777+0000","last_unstale":"2023-06-10T18:52:45.931851+0000","last_undegraded":"2023-06-10T18:52:45.931851+0000","last_fullsized":"2023-06-10T18:52:45.931851+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:59:51.325397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"22'6","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.932027+0000","last_change":"2023-06-10T18:52:44.575890+0000","last_active":"2023-06-10T18:52:45.932027+0000","last_peered":"2023-06-10T18:52:45.932027+0000","last_clean":"2023-06-10T18:52:45.932027+0000","last_became_active":"2023-06-10T18:52:44.573780+0000","last_became_peered":"2023-06-10T18:52:44.573780+0000","last_unstale":"2023-06-10T18:52:45.932027+0000","last_undegraded":"2023-06-10T18:52:45.932027+0000","last_fullsized":"2023-06-10T18:52:45.932027+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:50:17.324228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.094568+0000","last_change":"2023-06-10T18:52:44.955836+0000","last_active":"2023-06-10T18:52:47.094568+0000","last_peered":"2023-06-10T18:52:47.094568+0000","last_clean":"2023-06-10T18:52:47.094568+0000","last_became_active":"2023-06-10T18:52:44.955427+0000","last_became_peered":"2023-06-10T18:52:44.955427+0000","last_unstale":"2023-06-10T18:52:47.094568+0000","last_undegraded":"2023-06-10T18:52:47.094568+0000","last_fullsized":"2023-06-10T18:52:47.094568+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:53:28.618960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.096692+0000","last_change":"2023-06-10T18:52:44.583026+0000","last_active":"2023-06-10T18:52:47.096692+0000","last_peered":"2023-06-10T18:52:47.096692+0000","last_clean":"2023-06-10T18:52:47.096692+0000","last_became_active":"2023-06-10T18:52:44.582436+0000","last_became_peered":"2023-06-10T18:52:44.582436+0000","last_unstale":"2023-06-10T18:52:47.096692+0000","last_undegraded":"2023-06-10T18:52:47.096692+0000","last_fullsized":"2023-06-10T18:52:47.096692+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:15:28.452018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.935637+0000","last_change":"2023-06-10T18:52:44.573591+0000","last_active":"2023-06-10T18:52:45.935637+0000","last_peered":"2023-06-10T18:52:45.935637+0000","last_clean":"2023-06-10T18:52:45.935637+0000","last_became_active":"2023-06-10T18:52:44.572802+0000","last_became_peered":"2023-06-10T18:52:44.572802+0000","last_unstale":"2023-06-10T18:52:45.935637+0000","last_undegraded":"2023-06-10T18:52:45.935637+0000","last_fullsized":"2023-06-10T18:52:45.935637+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:34:50.390041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.929760+0000","last_change":"2023-06-10T18:52:44.944441+0000","last_active":"2023-06-10T18:52:45.929760+0000","last_peered":"2023-06-10T18:52:45.929760+0000","last_clean":"2023-06-10T18:52:45.929760+0000","last_became_active":"2023-06-10T18:52:44.944031+0000","last_became_peered":"2023-06-10T18:52:44.944031+0000","last_unstale":"2023-06-10T18:52:45.929760+0000","last_undegraded":"2023-06-10T18:52:45.929760+0000","last_fullsized":"2023-06-10T18:52:45.929760+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:39:10.888321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.073751+0000","last_change":"2023-06-10T18:52:44.563525+0000","last_active":"2023-06-10T18:52:47.073751+0000","last_peered":"2023-06-10T18:52:47.073751+0000","last_clean":"2023-06-10T18:52:47.073751+0000","last_became_active":"2023-06-10T18:52:44.563140+0000","last_became_peered":"2023-06-10T18:52:44.563140+0000","last_unstale":"2023-06-10T18:52:47.073751+0000","last_undegraded":"2023-06-10T18:52:47.073751+0000","last_fullsized":"2023-06-10T18:52:47.073751+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:50:17.324228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.929241+0000","last_change":"2023-06-10T18:52:44.953481+0000","last_active":"2023-06-10T18:52:45.929241+0000","last_peered":"2023-06-10T18:52:45.929241+0000","last_clean":"2023-06-10T18:52:45.929241+0000","last_became_active":"2023-06-10T18:52:44.953139+0000","last_became_peered":"2023-06-10T18:52:44.953139+0000","last_unstale":"2023-06-10T18:52:45.929241+0000","last_undegraded":"2023-06-10T18:52:45.929241+0000","last_fullsized":"2023-06-10T18:52:45.929241+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:01:27.731251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.095689+0000","last_change":"2023-06-10T18:52:44.946900+0000","last_active":"2023-06-10T18:52:47.095689+0000","last_peered":"2023-06-10T18:52:47.095689+0000","last_clean":"2023-06-10T18:52:47.095689+0000","last_became_active":"2023-06-10T18:52:44.946612+0000","last_became_peered":"2023-06-10T18:52:44.946612+0000","last_unstale":"2023-06-10T18:52:47.095689+0000","last_undegraded":"2023-06-10T18:52:47.095689+0000","last_fullsized":"2023-06-10T18:52:47.095689+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:38:52.793572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.929494+0000","last_change":"2023-06-10T18:52:44.561213+0000","last_active":"2023-06-10T18:52:45.929494+0000","last_peered":"2023-06-10T18:52:45.929494+0000","last_clean":"2023-06-10T18:52:45.929494+0000","last_became_active":"2023-06-10T18:52:44.560946+0000","last_became_peered":"2023-06-10T18:52:44.560946+0000","last_unstale":"2023-06-10T18:52:45.929494+0000","last_undegraded":"2023-06-10T18:52:45.929494+0000","last_fullsized":"2023-06-10T18:52:45.929494+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:08:49.327602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.073688+0000","last_change":"2023-06-10T18:52:44.951860+0000","last_active":"2023-06-10T18:52:47.073688+0000","last_peered":"2023-06-10T18:52:47.073688+0000","last_clean":"2023-06-10T18:52:47.073688+0000","last_became_active":"2023-06-10T18:52:44.949078+0000","last_became_peered":"2023-06-10T18:52:44.949078+0000","last_unstale":"2023-06-10T18:52:47.073688+0000","last_undegraded":"2023-06-10T18:52:47.073688+0000","last_fullsized":"2023-06-10T18:52:47.073688+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:42:51.947168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.094812+0000","last_change":"2023-06-10T18:52:44.559767+0000","last_active":"2023-06-10T18:52:47.094812+0000","last_peered":"2023-06-10T18:52:47.094812+0000","last_clean":"2023-06-10T18:52:47.094812+0000","last_became_active":"2023-06-10T18:52:44.559451+0000","last_became_peered":"2023-06-10T18:52:44.559451+0000","last_unstale":"2023-06-10T18:52:47.094812+0000","last_undegraded":"2023-06-10T18:52:47.094812+0000","last_fullsized":"2023-06-10T18:52:47.094812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:59:50.321394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.929761+0000","last_change":"2023-06-10T18:52:44.960896+0000","last_active":"2023-06-10T18:52:45.929761+0000","last_peered":"2023-06-10T18:52:45.929761+0000","last_clean":"2023-06-10T18:52:45.929761+0000","last_became_active":"2023-06-10T18:52:44.960188+0000","last_became_peered":"2023-06-10T18:52:44.960188+0000","last_unstale":"2023-06-10T18:52:45.929761+0000","last_undegraded":"2023-06-10T18:52:45.929761+0000","last_fullsized":"2023-06-10T18:52:45.929761+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:50:18.328232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.932875+0000","last_change":"2023-06-10T18:52:44.552411+0000","last_active":"2023-06-10T18:52:45.932875+0000","last_peered":"2023-06-10T18:52:45.932875+0000","last_clean":"2023-06-10T18:52:45.932875+0000","last_became_active":"2023-06-10T18:52:44.551312+0000","last_became_peered":"2023-06-10T18:52:44.551312+0000","last_unstale":"2023-06-10T18:52:45.932875+0000","last_undegraded":"2023-06-10T18:52:45.932875+0000","last_fullsized":"2023-06-10T18:52:45.932875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:44:27.810129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.094468+0000","last_change":"2023-06-10T18:52:44.965460+0000","last_active":"2023-06-10T18:52:47.094468+0000","last_peered":"2023-06-10T18:52:47.094468+0000","last_clean":"2023-06-10T18:52:47.094468+0000","last_became_active":"2023-06-10T18:52:44.964988+0000","last_became_peered":"2023-06-10T18:52:44.964988+0000","last_unstale":"2023-06-10T18:52:47.094468+0000","last_undegraded":"2023-06-10T18:52:47.094468+0000","last_fullsized":"2023-06-10T18:52:47.094468+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:46:29.935621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.074090+0000","last_change":"2023-06-10T18:52:44.576675+0000","last_active":"2023-06-10T18:52:47.074090+0000","last_peered":"2023-06-10T18:52:47.074090+0000","last_clean":"2023-06-10T18:52:47.074090+0000","last_became_active":"2023-06-10T18:52:44.576362+0000","last_became_peered":"2023-06-10T18:52:44.576362+0000","last_unstale":"2023-06-10T18:52:47.074090+0000","last_undegraded":"2023-06-10T18:52:47.074090+0000","last_fullsized":"2023-06-10T18:52:47.074090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:49:48.614848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.931722+0000","last_change":"2023-06-10T18:52:44.941939+0000","last_active":"2023-06-10T18:52:45.931722+0000","last_peered":"2023-06-10T18:52:45.931722+0000","last_clean":"2023-06-10T18:52:45.931722+0000","last_became_active":"2023-06-10T18:52:44.939408+0000","last_became_peered":"2023-06-10T18:52:44.939408+0000","last_unstale":"2023-06-10T18:52:45.931722+0000","last_undegraded":"2023-06-10T18:52:45.931722+0000","last_fullsized":"2023-06-10T18:52:45.931722+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:31:20.946172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.934658+0000","last_change":"2023-06-10T18:52:44.574956+0000","last_active":"2023-06-10T18:52:45.934658+0000","last_peered":"2023-06-10T18:52:45.934658+0000","last_clean":"2023-06-10T18:52:45.934658+0000","last_became_active":"2023-06-10T18:52:44.574184+0000","last_became_peered":"2023-06-10T18:52:44.574184+0000","last_unstale":"2023-06-10T18:52:45.934658+0000","last_undegraded":"2023-06-10T18:52:45.934658+0000","last_fullsized":"2023-06-10T18:52:45.934658+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:50:17.324228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.932406+0000","last_change":"2023-06-10T18:52:44.944962+0000","last_active":"2023-06-10T18:52:45.932406+0000","last_peered":"2023-06-10T18:52:45.932406+0000","last_clean":"2023-06-10T18:52:45.932406+0000","last_became_active":"2023-06-10T18:52:44.944702+0000","last_became_peered":"2023-06-10T18:52:44.944702+0000","last_unstale":"2023-06-10T18:52:45.932406+0000","last_undegraded":"2023-06-10T18:52:45.932406+0000","last_fullsized":"2023-06-10T18:52:45.932406+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T18:54:16.713072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.935077+0000","last_change":"2023-06-10T18:52:44.576687+0000","last_active":"2023-06-10T18:52:45.935077+0000","last_peered":"2023-06-10T18:52:45.935077+0000","last_clean":"2023-06-10T18:52:45.935077+0000","last_became_active":"2023-06-10T18:52:44.575964+0000","last_became_peered":"2023-06-10T18:52:44.575964+0000","last_unstale":"2023-06-10T18:52:45.935077+0000","last_undegraded":"2023-06-10T18:52:45.935077+0000","last_fullsized":"2023-06-10T18:52:45.935077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:41:12.372624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.929739+0000","last_change":"2023-06-10T18:52:44.937999+0000","last_active":"2023-06-10T18:52:45.929739+0000","last_peered":"2023-06-10T18:52:45.929739+0000","last_clean":"2023-06-10T18:52:45.929739+0000","last_became_active":"2023-06-10T18:52:44.937614+0000","last_became_peered":"2023-06-10T18:52:44.937614+0000","last_unstale":"2023-06-10T18:52:45.929739+0000","last_undegraded":"2023-06-10T18:52:45.929739+0000","last_fullsized":"2023-06-10T18:52:45.929739+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:42:51.947168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.929840+0000","last_change":"2023-06-10T18:52:44.563109+0000","last_active":"2023-06-10T18:52:45.929840+0000","last_peered":"2023-06-10T18:52:45.929840+0000","last_clean":"2023-06-10T18:52:45.929840+0000","last_became_active":"2023-06-10T18:52:44.562809+0000","last_became_peered":"2023-06-10T18:52:44.562809+0000","last_unstale":"2023-06-10T18:52:45.929840+0000","last_undegraded":"2023-06-10T18:52:45.929840+0000","last_fullsized":"2023-06-10T18:52:45.929840+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:39:09.014604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:45.931609+0000","last_change":"2023-06-10T18:52:44.945839+0000","last_active":"2023-06-10T18:52:45.931609+0000","last_peered":"2023-06-10T18:52:45.931609+0000","last_clean":"2023-06-10T18:52:45.931609+0000","last_became_active":"2023-06-10T18:52:44.945171+0000","last_became_peered":"2023-06-10T18:52:44.945171+0000","last_unstale":"2023-06-10T18:52:45.931609+0000","last_undegraded":"2023-06-10T18:52:45.931609+0000","last_fullsized":"2023-06-10T18:52:45.931609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:44.521236+0000","last_clean_scrub_stamp":"2023-06-10T18:52:44.521236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:54:34.871667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-06-10T18:52:47.073610+0000","last_change":"2023-06-10T18:52:44.563708+0000","last_active":"2023-06-10T18:52:47.073610+0000","last_peered":"2023-06-10T18:52:47.073610+0000","last_clean":"2023-06-10T18:52:47.073610+0000","last_became_active":"2023-06-10T18:52:44.563327+0000","last_became_peered":"2023-06-10T18:52:44.563327+0000","last_unstale":"2023-06-10T18:52:47.073610+0000","last_undegraded":"2023-06-10T18:52:47.073610+0000","last_fullsized":"2023-06-10T18:52:47.073610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:43.517233+0000","last_clean_scrub_stamp":"2023-06-10T18:52:43.517233+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:37:27.669113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":844,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":864256,"data_stored":681747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0269999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0149999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1120000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97399999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":249856,"data_stored":90251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.135}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1080000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":262144,"data_stored":91219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0109999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.032}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.079}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.877}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31284,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340556,"statfs":{"total":96636764160,"available":96604729344,"internally_reserved":0,"allocated":241664,"data_stored":88670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31284,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340556,"statfs":{"total":96636764160,"available":96604729344,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.204}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.073}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2889999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.266}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31280,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340560,"statfs":{"total":96636764160,"available":96604733440,"internally_reserved":0,"allocated":237568,"data_stored":88580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.165}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0549999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31864,"kb_used_data":816,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339976,"statfs":{"total":96636764160,"available":96604135424,"internally_reserved":0,"allocated":835584,"data_stored":679530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.307}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93799999999999994}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-10T18:52:58.071 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-06-10T18:52:58.071 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-06-10T18:52:58.072 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-06-10T18:52:58.072 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-06-10T18:52:58.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.216+0000 7fef2cd3d640 1 Processor -- start 2023-06-10T18:52:58.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.216+0000 7fef2cd3d640 1 -- start start 2023-06-10T18:52:58.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.216+0000 7fef2cd3d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fef28157e10 0x7fef2806efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:58.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.216+0000 7fef2cd3d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef2806bb30 0x7fef280ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:58.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.216+0000 7fef2cd3d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef280c9e50 con 0x7fef280af720 2023-06-10T18:52:58.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.216+0000 7fef2cd3d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef280cd520 con 0x7fef28157e10 2023-06-10T18:52:58.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.216+0000 7fef2cd3d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef280c82f0 con 0x7fef2806bb30 2023-06-10T18:52:58.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.216+0000 7fef26d9d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fef280af720 0x7fef2815bc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:36088/0 (socket says 172.21.15.53:36088) 2023-06-10T18:52:58.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.216+0000 7fef26d9d640 1 -- 172.21.15.53:0/3966519138 learned_addr learned my addr 172.21.15.53:0/3966519138 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:52:58.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.216+0000 7fef2659c640 1 --2- 172.21.15.53:0/3966519138 >> v2:172.21.15.117:3300/0 conn(0x7fef28157e10 0x7fef2806efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:58.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.216+0000 7fef25d9b640 1 --2- 172.21.15.53:0/3966519138 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef2806bb30 0x7fef280ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:58.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.216+0000 7fef2559a640 1 -- 172.21.15.53:0/3966519138 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 84067565 0 0) 0x7fef280c9e50 con 0x7fef280af720 2023-06-10T18:52:58.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.216+0000 7fef2559a640 1 -- 172.21.15.53:0/3966519138 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef14004640 con 0x7fef280af720 2023-06-10T18:52:58.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.220+0000 7fef2559a640 1 -- 172.21.15.53:0/3966519138 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1801700747 0 0) 0x7fef14004640 con 0x7fef280af720 2023-06-10T18:52:58.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.220+0000 7fef2559a640 1 -- 172.21.15.53:0/3966519138 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef2806bb30 msgr2=0x7fef280ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:58.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.220+0000 7fef2559a640 1 --2- 172.21.15.53:0/3966519138 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef2806bb30 0x7fef280ccfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:58.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.220+0000 7fef2559a640 1 -- 172.21.15.53:0/3966519138 >> v2:172.21.15.117:3300/0 conn(0x7fef28157e10 msgr2=0x7fef2806efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:58.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.220+0000 7fef2559a640 1 --2- 172.21.15.53:0/3966519138 >> v2:172.21.15.117:3300/0 conn(0x7fef28157e10 0x7fef2806efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:58.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.220+0000 7fef2559a640 1 -- 172.21.15.53:0/3966519138 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef2806bf80 con 0x7fef280af720 2023-06-10T18:52:58.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.220+0000 7fef2559a640 1 -- 172.21.15.53:0/3966519138 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fef20001680 con 0x7fef280af720 2023-06-10T18:52:58.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.220+0000 7fef2559a640 1 -- 172.21.15.53:0/3966519138 >> v1:172.21.15.53:6789/0 conn(0x7fef280af720 legacy=0x7fef2815bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:58.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.220+0000 7fef2559a640 1 --2- 172.21.15.53:0/3966519138 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef2806bb30 0x7fef14004b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:58.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.220+0000 7fef2559a640 1 --2- 172.21.15.53:0/3966519138 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef14005080 0x7fef140058e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:58.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.220+0000 7fef2559a640 1 --2- 172.21.15.53:0/3966519138 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef14005e20 0x7fef14006290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:58.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.220+0000 7fef2559a640 1 -- 172.21.15.53:0/3966519138 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef280cd520 con 0x7fef14005e20 2023-06-10T18:52:58.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.220+0000 7fef2559a640 1 -- 172.21.15.53:0/3966519138 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef280c82f0 con 0x7fef14005080 2023-06-10T18:52:58.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.220+0000 7fef2559a640 1 -- 172.21.15.53:0/3966519138 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef14003500 con 0x7fef2806bb30 2023-06-10T18:52:58.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.220+0000 7fef26d9d640 1 --2- 172.21.15.53:0/3966519138 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef14005e20 0x7fef14006290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:58.232 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.220+0000 7fef25d9b640 1 --2- 172.21.15.53:0/3966519138 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef14005080 0x7fef140058e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:58.232 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.220+0000 7fef2659c640 1 --2- 172.21.15.53:0/3966519138 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef2806bb30 0x7fef14004b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:58.232 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.220+0000 7fef26d9d640 1 -- 172.21.15.53:0/3966519138 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef2806bb30 msgr2=0x7fef14004b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:58.232 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.220+0000 7fef26d9d640 1 --2- 172.21.15.53:0/3966519138 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef2806bb30 0x7fef14004b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:58.232 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.220+0000 7fef26d9d640 1 -- 172.21.15.53:0/3966519138 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef14005080 msgr2=0x7fef140058e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:58.232 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.220+0000 7fef26d9d640 1 --2- 172.21.15.53:0/3966519138 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef14005080 0x7fef140058e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:58.232 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.220+0000 7fef26d9d640 1 -- 172.21.15.53:0/3966519138 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef14004640 con 0x7fef14005e20 2023-06-10T18:52:58.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.220+0000 7fef26d9d640 1 --2- 172.21.15.53:0/3966519138 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef14005e20 0x7fef14006290 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fef20001060 tx=0x7fef2001f410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eab0203777697969 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:58.235 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.220+0000 7fef2559a640 1 -- 172.21.15.53:0/3966519138 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef20005ae0 con 0x7fef14005e20 2023-06-10T18:52:58.235 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.220+0000 7fef2559a640 1 -- 172.21.15.53:0/3966519138 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef200ab070 con 0x7fef14005e20 2023-06-10T18:52:58.235 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.220+0000 7fef2559a640 1 -- 172.21.15.53:0/3966519138 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef20005e80 con 0x7fef14005e20 2023-06-10T18:52:58.235 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.220+0000 7fef2cd3d640 1 -- 172.21.15.53:0/3966519138 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef14005e20 msgr2=0x7fef14006290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:58.235 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.220+0000 7fef2cd3d640 1 --2- 172.21.15.53:0/3966519138 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef14005e20 0x7fef14006290 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fef20001060 tx=0x7fef2001f410 comp rx=0 tx=0).stop 2023-06-10T18:52:58.235 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.220+0000 7fef26d9d640 1 -- 172.21.15.53:0/3966519138 reap_dead start 2023-06-10T18:52:58.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.220+0000 7fef2cd3d640 1 -- 172.21.15.53:0/3966519138 shutdown_connections 2023-06-10T18:52:58.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.220+0000 7fef2cd3d640 1 -- 172.21.15.53:0/3966519138 >> 172.21.15.53:0/3966519138 conn(0x7fef2806a0d0 msgr2=0x7fef280ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:58.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.220+0000 7fef2cd3d640 1 -- 172.21.15.53:0/3966519138 shutdown_connections 2023-06-10T18:52:58.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.220+0000 7fef2cd3d640 1 -- 172.21.15.53:0/3966519138 wait complete. 2023-06-10T18:52:58.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.224+0000 7fef2cd3d640 1 Processor -- start 2023-06-10T18:52:58.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.224+0000 7fef2cd3d640 1 -- start start 2023-06-10T18:52:58.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.224+0000 7fef2cd3d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef14005e20 0x7fef280c1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:58.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.224+0000 7fef2cd3d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef280c20d0 0x7fef280c3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:58.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.224+0000 7fef2cd3d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef280c3cc0 0x7fef280ae9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:58.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.224+0000 7fef2cd3d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef280b1150 con 0x7fef280c20d0 2023-06-10T18:52:58.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.224+0000 7fef2cd3d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef280b0b70 con 0x7fef14005e20 2023-06-10T18:52:58.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.224+0000 7fef2cd3d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef280c4260 con 0x7fef280c3cc0 2023-06-10T18:52:58.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.224+0000 7fef25d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef280c20d0 0x7fef280c3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:58.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.224+0000 7fef25d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef280c20d0 0x7fef280c3780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35408/0 (socket says 172.21.15.53:35408) 2023-06-10T18:52:58.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.224+0000 7fef25d9b640 1 -- 172.21.15.53:0/2135542570 learned_addr learned my addr 172.21.15.53:0/2135542570 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:58.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.224+0000 7fef2659c640 1 --2- 172.21.15.53:0/2135542570 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef14005e20 0x7fef280c1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:58.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.224+0000 7fef26d9d640 1 --2- 172.21.15.53:0/2135542570 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef280c3cc0 0x7fef280ae9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:58.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.224+0000 7fef25d9b640 1 -- 172.21.15.53:0/2135542570 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef280c3cc0 msgr2=0x7fef280ae9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:58.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.224+0000 7fef25d9b640 1 --2- 172.21.15.53:0/2135542570 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef280c3cc0 0x7fef280ae9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:58.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.224+0000 7fef25d9b640 1 -- 172.21.15.53:0/2135542570 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef14005e20 msgr2=0x7fef280c1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:58.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.224+0000 7fef25d9b640 1 --2- 172.21.15.53:0/2135542570 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef14005e20 0x7fef280c1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:58.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.224+0000 7fef25d9b640 1 -- 172.21.15.53:0/2135542570 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef280b0de0 con 0x7fef280c20d0 2023-06-10T18:52:58.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.224+0000 7fef26d9d640 1 --2- 172.21.15.53:0/2135542570 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef280c3cc0 0x7fef280ae9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:52:58.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.224+0000 7fef25d9b640 1 --2- 172.21.15.53:0/2135542570 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef280c20d0 0x7fef280c3780 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fef10011590 tx=0x7fef10011a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:58.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.224+0000 7fef1effd640 1 -- 172.21.15.53:0/2135542570 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef10015930 con 0x7fef280c20d0 2023-06-10T18:52:58.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.224+0000 7fef1effd640 1 -- 172.21.15.53:0/2135542570 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef10015a90 con 0x7fef280c20d0 2023-06-10T18:52:58.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.224+0000 7fef1effd640 1 -- 172.21.15.53:0/2135542570 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef10015e20 con 0x7fef280c20d0 2023-06-10T18:52:58.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.224+0000 7fef2cd3d640 1 -- 172.21.15.53:0/2135542570 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef280c4540 con 0x7fef280c20d0 2023-06-10T18:52:58.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.224+0000 7fef2cd3d640 1 -- 172.21.15.53:0/2135542570 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef2814c220 con 0x7fef280c20d0 2023-06-10T18:52:58.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.224+0000 7fef2cd3d640 1 -- 172.21.15.53:0/2135542570 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef280b12c0 con 0x7fef280c20d0 2023-06-10T18:52:58.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.224+0000 7fef1effd640 1 -- 172.21.15.53:0/2135542570 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fef1000f460 con 0x7fef280c20d0 2023-06-10T18:52:58.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.224+0000 7fef1effd640 1 --2- 172.21.15.53:0/2135542570 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fef080662b0 0x7fef08068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:58.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.224+0000 7fef1effd640 1 -- 172.21.15.53:0/2135542570 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fef100844d0 con 0x7fef280c20d0 2023-06-10T18:52:58.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.228+0000 7fef2659c640 1 --2- 172.21.15.53:0/2135542570 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fef080662b0 0x7fef08068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:58.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.228+0000 7fef2659c640 1 --2- 172.21.15.53:0/2135542570 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fef080662b0 0x7fef08068760 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fef180074a0 tx=0x7fef1800b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:58.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.232+0000 7fef1effd640 1 -- 172.21.15.53:0/2135542570 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fef100553e0 con 0x7fef280c20d0 2023-06-10T18:52:58.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.412+0000 7fef2cd3d640 1 -- 172.21.15.53:0/2135542570 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fef2804d790 con 0x7fef280c20d0 2023-06-10T18:52:58.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.412+0000 7fef1effd640 1 -- 172.21.15.53:0/2135542570 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fef10054f70 con 0x7fef280c20d0 2023-06-10T18:52:58.424 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:52:58.424 INFO:teuthology.orchestra.run.smithi053.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-06-10T18:52:58.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.412+0000 7fef2cd3d640 1 -- 172.21.15.53:0/2135542570 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fef080662b0 msgr2=0x7fef08068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:58.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.412+0000 7fef2cd3d640 1 --2- 172.21.15.53:0/2135542570 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fef080662b0 0x7fef08068760 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fef180074a0 tx=0x7fef1800b040 comp rx=0 tx=0).stop 2023-06-10T18:52:58.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.412+0000 7fef2cd3d640 1 -- 172.21.15.53:0/2135542570 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef280c20d0 msgr2=0x7fef280c3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:58.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.412+0000 7fef2cd3d640 1 --2- 172.21.15.53:0/2135542570 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef280c20d0 0x7fef280c3780 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fef10011590 tx=0x7fef10011a50 comp rx=0 tx=0).stop 2023-06-10T18:52:58.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.412+0000 7fef2cd3d640 1 -- 172.21.15.53:0/2135542570 shutdown_connections 2023-06-10T18:52:58.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.412+0000 7fef2cd3d640 1 --2- 172.21.15.53:0/2135542570 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fef080662b0 0x7fef08068760 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:58.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.416+0000 7fef2cd3d640 1 --2- 172.21.15.53:0/2135542570 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef280c3cc0 0x7fef280ae9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:58.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.416+0000 7fef2cd3d640 1 --2- 172.21.15.53:0/2135542570 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef280c20d0 0x7fef280c3780 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:58.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.416+0000 7fef2cd3d640 1 --2- 172.21.15.53:0/2135542570 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef14005e20 0x7fef280c1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:58.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.416+0000 7fef2cd3d640 1 -- 172.21.15.53:0/2135542570 >> 172.21.15.53:0/2135542570 conn(0x7fef2806a0d0 msgr2=0x7fef280afb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:58.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.416+0000 7fef2cd3d640 1 -- 172.21.15.53:0/2135542570 shutdown_connections 2023-06-10T18:52:58.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.416+0000 7fef2cd3d640 1 -- 172.21.15.53:0/2135542570 wait complete. 2023-06-10T18:52:58.439 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-06-10T18:52:58.440 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T18:52:58.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.536+0000 7f7288521640 1 Processor -- start 2023-06-10T18:52:58.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.536+0000 7f7288521640 1 -- start start 2023-06-10T18:52:58.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.536+0000 7f7288521640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7280162640 0x7f7280164a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:58.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.536+0000 7f7288521640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7280159b50 con 0x7f7280071060 2023-06-10T18:52:58.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.536+0000 7f7288521640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72800702a0 con 0x7f72800c9840 2023-06-10T18:52:58.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.536+0000 7f7288521640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7280070580 con 0x7f7280162640 2023-06-10T18:52:58.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.540+0000 7f7285abc640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f7280071060 0x7f72800af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:36094/0 (socket says 172.21.15.53:36094) 2023-06-10T18:52:58.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.540+0000 7f7285abc640 1 -- 172.21.15.53:0/1950835541 learned_addr learned my addr 172.21.15.53:0/1950835541 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:52:58.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.540+0000 7f7286abe640 1 --2- 172.21.15.53:0/1950835541 >> v2:172.21.15.117:3300/0 conn(0x7f7280162640 0x7f7280164a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:58.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.540+0000 7f72852bb640 1 -- 172.21.15.53:0/1950835541 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3398518334 0 0) 0x7f7280159b50 con 0x7f7280071060 2023-06-10T18:52:58.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.540+0000 7f72852bb640 1 -- 172.21.15.53:0/1950835541 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f726c003530 con 0x7f7280071060 2023-06-10T18:52:58.550 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.540+0000 7f72852bb640 1 -- 172.21.15.53:0/1950835541 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2187371113 0 0) 0x7f726c003530 con 0x7f7280071060 2023-06-10T18:52:58.551 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.540+0000 7f72852bb640 1 -- 172.21.15.53:0/1950835541 >> v2:172.21.15.117:3300/0 conn(0x7f7280162640 msgr2=0x7f7280164a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:58.551 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.540+0000 7f72852bb640 1 --2- 172.21.15.53:0/1950835541 >> v2:172.21.15.117:3300/0 conn(0x7f7280162640 0x7f7280164a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:58.551 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.540+0000 7f72852bb640 1 -- 172.21.15.53:0/1950835541 >> v1:172.21.15.117:6789/0 conn(0x7f72800c9840 legacy=0x7f72800c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:58.551 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.540+0000 7f72852bb640 1 -- 172.21.15.53:0/1950835541 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7280070860 con 0x7f7280071060 2023-06-10T18:52:58.551 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.540+0000 7f72852bb640 1 -- 172.21.15.53:0/1950835541 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f7270001680 con 0x7f7280071060 2023-06-10T18:52:58.551 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.540+0000 7f72852bb640 1 -- 172.21.15.53:0/1950835541 >> v1:172.21.15.53:6789/0 conn(0x7f7280071060 legacy=0x7f72800af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:58.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.540+0000 7f72852bb640 1 --2- 172.21.15.53:0/1950835541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f726c0039f0 0x7f726c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:58.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.540+0000 7f72852bb640 1 --2- 172.21.15.53:0/1950835541 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f726c0047d0 0x7f726c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:58.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.540+0000 7f72852bb640 1 --2- 172.21.15.53:0/1950835541 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f726c005180 0x7f726c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:58.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.540+0000 7f72852bb640 1 -- 172.21.15.53:0/1950835541 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7280070580 con 0x7f726c005180 2023-06-10T18:52:58.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.540+0000 7f72852bb640 1 -- 172.21.15.53:0/1950835541 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f726c00c060 con 0x7f726c0047d0 2023-06-10T18:52:58.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.540+0000 7f72852bb640 1 -- 172.21.15.53:0/1950835541 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f726c00c220 con 0x7f726c0039f0 2023-06-10T18:52:58.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.540+0000 7f7286abe640 1 --2- 172.21.15.53:0/1950835541 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f726c005180 0x7f726c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:58.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.540+0000 7f7285abc640 1 --2- 172.21.15.53:0/1950835541 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f726c0047d0 0x7f726c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:58.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.540+0000 7f72862bd640 1 --2- 172.21.15.53:0/1950835541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f726c0039f0 0x7f726c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:58.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.540+0000 7f7286abe640 1 -- 172.21.15.53:0/1950835541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f726c0039f0 msgr2=0x7f726c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:58.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.540+0000 7f7286abe640 1 --2- 172.21.15.53:0/1950835541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f726c0039f0 0x7f726c003e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:58.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.540+0000 7f7286abe640 1 -- 172.21.15.53:0/1950835541 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f726c0047d0 msgr2=0x7f726c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:58.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.540+0000 7f7286abe640 1 --2- 172.21.15.53:0/1950835541 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f726c0047d0 0x7f726c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:58.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.540+0000 7f7286abe640 1 -- 172.21.15.53:0/1950835541 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f726c003530 con 0x7f726c005180 2023-06-10T18:52:58.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.540+0000 7f7285abc640 1 --2- 172.21.15.53:0/1950835541 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f726c0047d0 0x7f726c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:52:58.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.540+0000 7f7286abe640 1 -- 172.21.15.53:0/1950835541 reap_dead start 2023-06-10T18:52:58.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.540+0000 7f7286abe640 1 --2- 172.21.15.53:0/1950835541 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f726c005180 0x7f726c00b990 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f728006e7e0 tx=0x7f727801cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc4188fd140e7223 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:58.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.540+0000 7f72852bb640 1 -- 172.21.15.53:0/1950835541 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72780a5c50 con 0x7f726c005180 2023-06-10T18:52:58.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.540+0000 7f72852bb640 1 -- 172.21.15.53:0/1950835541 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f727800f040 con 0x7f726c005180 2023-06-10T18:52:58.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.540+0000 7f72852bb640 1 -- 172.21.15.53:0/1950835541 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72780ad440 con 0x7f726c005180 2023-06-10T18:52:58.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.540+0000 7f7288521640 1 -- 172.21.15.53:0/1950835541 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f726c005180 msgr2=0x7f726c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:58.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.540+0000 7f7288521640 1 --2- 172.21.15.53:0/1950835541 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f726c005180 0x7f726c00b990 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f728006e7e0 tx=0x7f727801cc40 comp rx=0 tx=0).stop 2023-06-10T18:52:58.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.540+0000 7f7288521640 1 -- 172.21.15.53:0/1950835541 shutdown_connections 2023-06-10T18:52:58.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.540+0000 7f7288521640 1 --2- 172.21.15.53:0/1950835541 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f726c005180 0x7f726c00b990 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:58.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.540+0000 7f7288521640 1 -- 172.21.15.53:0/1950835541 >> 172.21.15.53:0/1950835541 conn(0x7f728006a0d0 msgr2=0x7f72800ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:58.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.540+0000 7f7288521640 1 -- 172.21.15.53:0/1950835541 shutdown_connections 2023-06-10T18:52:58.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.544+0000 7f7288521640 1 -- 172.21.15.53:0/1950835541 wait complete. 2023-06-10T18:52:58.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.544+0000 7f7288521640 1 Processor -- start 2023-06-10T18:52:58.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.544+0000 7f7288521640 1 -- start start 2023-06-10T18:52:58.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.544+0000 7f7288521640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f726c005180 0x7f72800c2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:58.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.544+0000 7f7288521640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72800c4130 0x7f72800b31d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:58.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.544+0000 7f7288521640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f728014e490 0x7f728014e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:58.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.544+0000 7f7288521640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72800c37b0 con 0x7f726c005180 2023-06-10T18:52:58.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.544+0000 7f7288521640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f728014ee20 con 0x7f728014e490 2023-06-10T18:52:58.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.544+0000 7f7288521640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72800c2ba0 con 0x7f72800c4130 2023-06-10T18:52:58.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.544+0000 7f72862bd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f726c005180 0x7f72800c2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:58.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.544+0000 7f72862bd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f726c005180 0x7f72800c2530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35414/0 (socket says 172.21.15.53:35414) 2023-06-10T18:52:58.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.544+0000 7f72862bd640 1 -- 172.21.15.53:0/4189254702 learned_addr learned my addr 172.21.15.53:0/4189254702 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:58.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.544+0000 7f72862bd640 1 -- 172.21.15.53:0/4189254702 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72800c4130 msgr2=0x7f72800b31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:58.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.544+0000 7f7286abe640 1 --2- 172.21.15.53:0/4189254702 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f728014e490 0x7f728014e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:58.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.544+0000 7f72862bd640 1 --2- 172.21.15.53:0/4189254702 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72800c4130 0x7f72800b31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:58.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.544+0000 7f72862bd640 1 -- 172.21.15.53:0/4189254702 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f728014e490 msgr2=0x7f728014e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:58.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.544+0000 7f72862bd640 1 --2- 172.21.15.53:0/4189254702 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f728014e490 0x7f728014e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:58.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.544+0000 7f72862bd640 1 -- 172.21.15.53:0/4189254702 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72800c2e80 con 0x7f726c005180 2023-06-10T18:52:58.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.544+0000 7f72862bd640 1 --2- 172.21.15.53:0/4189254702 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f726c005180 0x7f72800c2530 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f727c00d4c0 tx=0x7f727c00d980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:58.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.544+0000 7f7276ffd640 1 -- 172.21.15.53:0/4189254702 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f727c005480 con 0x7f726c005180 2023-06-10T18:52:58.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.544+0000 7f7276ffd640 1 -- 172.21.15.53:0/4189254702 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f727c003620 con 0x7f726c005180 2023-06-10T18:52:58.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.544+0000 7f7276ffd640 1 -- 172.21.15.53:0/4189254702 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f727c0039f0 con 0x7f726c005180 2023-06-10T18:52:58.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.544+0000 7f7288521640 1 -- 172.21.15.53:0/4189254702 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72800c3160 con 0x7f726c005180 2023-06-10T18:52:58.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.544+0000 7f7288521640 1 -- 172.21.15.53:0/4189254702 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72800c4580 con 0x7f726c005180 2023-06-10T18:52:58.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.544+0000 7f7288521640 1 -- 172.21.15.53:0/4189254702 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f728004d790 con 0x7f726c005180 2023-06-10T18:52:58.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.548+0000 7f7276ffd640 1 -- 172.21.15.53:0/4189254702 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f727c003b50 con 0x7f726c005180 2023-06-10T18:52:58.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.548+0000 7f7276ffd640 1 --2- 172.21.15.53:0/4189254702 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7264066280 0x7f7264068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:58.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.548+0000 7f7276ffd640 1 -- 172.21.15.53:0/4189254702 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f727c083bc0 con 0x7f726c005180 2023-06-10T18:52:58.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.548+0000 7f7285abc640 1 --2- 172.21.15.53:0/4189254702 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7264066280 0x7f7264068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:58.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.548+0000 7f7285abc640 1 --2- 172.21.15.53:0/4189254702 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7264066280 0x7f7264068730 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f72700017b0 tx=0x7f7270009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:58.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.552+0000 7f7276ffd640 1 -- 172.21.15.53:0/4189254702 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f727c051040 con 0x7f726c005180 2023-06-10T18:52:58.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.700+0000 7f7288521640 1 -- 172.21.15.53:0/4189254702 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f72800cb140 con 0x7f726c005180 2023-06-10T18:52:58.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.700+0000 7f7276ffd640 1 -- 172.21.15.53:0/4189254702 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18267 (secure 0 0 0) 0x7f727c054660 con 0x7f726c005180 2023-06-10T18:52:58.711 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:52:58.711 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":23,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T18:52:45.921586+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-10T18:52:43.396243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-10T18:52:43.894228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T18:52:58.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.704+0000 7f7288521640 1 -- 172.21.15.53:0/4189254702 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7264066280 msgr2=0x7f7264068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:58.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.704+0000 7f7288521640 1 --2- 172.21.15.53:0/4189254702 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7264066280 0x7f7264068730 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f72700017b0 tx=0x7f7270009040 comp rx=0 tx=0).stop 2023-06-10T18:52:58.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.704+0000 7f7288521640 1 -- 172.21.15.53:0/4189254702 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f726c005180 msgr2=0x7f72800c2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:58.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.704+0000 7f7288521640 1 --2- 172.21.15.53:0/4189254702 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f726c005180 0x7f72800c2530 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f727c00d4c0 tx=0x7f727c00d980 comp rx=0 tx=0).stop 2023-06-10T18:52:58.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.704+0000 7f7288521640 1 -- 172.21.15.53:0/4189254702 shutdown_connections 2023-06-10T18:52:58.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.704+0000 7f7288521640 1 --2- 172.21.15.53:0/4189254702 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7264066280 0x7f7264068730 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:58.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.704+0000 7f7288521640 1 --2- 172.21.15.53:0/4189254702 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f728014e490 0x7f728014e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:58.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.704+0000 7f7288521640 1 --2- 172.21.15.53:0/4189254702 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72800c4130 0x7f72800b31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:58.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.704+0000 7f7288521640 1 --2- 172.21.15.53:0/4189254702 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f726c005180 0x7f72800c2530 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:58.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.704+0000 7f7288521640 1 -- 172.21.15.53:0/4189254702 >> 172.21.15.53:0/4189254702 conn(0x7f728006a0d0 msgr2=0x7f72800ca370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:58.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.704+0000 7f7288521640 1 -- 172.21.15.53:0/4189254702 shutdown_connections 2023-06-10T18:52:58.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.704+0000 7f7288521640 1 -- 172.21.15.53:0/4189254702 wait complete. 2023-06-10T18:52:58.728 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-10T18:52:33.633114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-10T18:52:39.171487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-10T18:52:43.396243+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-10T18:52:43.894228+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-10T18:52:58.729 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-10T18:52:58.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.836+0000 7f2bc9009640 1 Processor -- start 2023-06-10T18:52:58.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.836+0000 7f2bc9009640 1 -- start start 2023-06-10T18:52:58.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.836+0000 7f2bc9009640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2bc40c9fa0 0x7f2bc406bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:58.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.836+0000 7f2bc9009640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2bc40af760 0x7f2bc40afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:58.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.836+0000 7f2bc9009640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bc406b090 con 0x7f2bc406c020 2023-06-10T18:52:58.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.836+0000 7f2bc9009640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bc40b0120 con 0x7f2bc40c9fa0 2023-06-10T18:52:58.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.836+0000 7f2bc9009640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bc40ca370 con 0x7f2bc40af760 2023-06-10T18:52:58.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.836+0000 7f2bc2d9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2bc40c9fa0 0x7f2bc406bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:58.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.836+0000 7f2bc2d9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2bc40c9fa0 0x7f2bc406bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35430/0 (socket says 172.21.15.53:35430) 2023-06-10T18:52:58.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.836+0000 7f2bc2d9d640 1 -- 172.21.15.53:0/2942599781 learned_addr learned my addr 172.21.15.53:0/2942599781 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:58.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.836+0000 7f2bc359e640 1 --2- 172.21.15.53:0/2942599781 >> v2:172.21.15.117:3300/0 conn(0x7f2bc40af760 0x7f2bc40afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:58.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.836+0000 7f2bc2d9d640 1 -- 172.21.15.53:0/2942599781 >> v2:172.21.15.117:3300/0 conn(0x7f2bc40af760 msgr2=0x7f2bc40afbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:58.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.836+0000 7f2bc2d9d640 1 --2- 172.21.15.53:0/2942599781 >> v2:172.21.15.117:3300/0 conn(0x7f2bc40af760 0x7f2bc40afbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:58.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.836+0000 7f2bc2d9d640 1 -- 172.21.15.53:0/2942599781 >> v1:172.21.15.117:6789/0 conn(0x7f2bc406c020 legacy=0x7f2bc40c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:58.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.836+0000 7f2bc2d9d640 1 -- 172.21.15.53:0/2942599781 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bc4070d50 con 0x7f2bc40c9fa0 2023-06-10T18:52:58.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.840+0000 7f2bc2d9d640 1 --2- 172.21.15.53:0/2942599781 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bc40c9fa0 0x7f2bc406bae0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2bc406fc20 tx=0x7f2bb401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a6962e6b01338ee server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:58.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.840+0000 7f2bc1d9b640 1 -- 172.21.15.53:0/2942599781 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb4004230 con 0x7f2bc40c9fa0 2023-06-10T18:52:58.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.840+0000 7f2bc1d9b640 1 -- 172.21.15.53:0/2942599781 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bb40a7050 con 0x7f2bc40c9fa0 2023-06-10T18:52:58.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.840+0000 7f2bc1d9b640 1 -- 172.21.15.53:0/2942599781 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb4003620 con 0x7f2bc40c9fa0 2023-06-10T18:52:58.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.840+0000 7f2bc9009640 1 -- 172.21.15.53:0/2942599781 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bc40c9fa0 msgr2=0x7f2bc406bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:58.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.840+0000 7f2bc9009640 1 --2- 172.21.15.53:0/2942599781 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bc40c9fa0 0x7f2bc406bae0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2bc406fc20 tx=0x7f2bb401c440 comp rx=0 tx=0).stop 2023-06-10T18:52:58.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.840+0000 7f2bc9009640 1 -- 172.21.15.53:0/2942599781 shutdown_connections 2023-06-10T18:52:58.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.840+0000 7f2bc9009640 1 --2- 172.21.15.53:0/2942599781 >> v2:172.21.15.117:3300/0 conn(0x7f2bc40af760 0x7f2bc40afbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:58.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.840+0000 7f2bc9009640 1 --2- 172.21.15.53:0/2942599781 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bc40c9fa0 0x7f2bc406bae0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:58.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.840+0000 7f2bc9009640 1 -- 172.21.15.53:0/2942599781 >> 172.21.15.53:0/2942599781 conn(0x7f2bc406a0e0 msgr2=0x7f2bc40cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:58.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.840+0000 7f2bc9009640 1 -- 172.21.15.53:0/2942599781 shutdown_connections 2023-06-10T18:52:58.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.840+0000 7f2bc9009640 1 -- 172.21.15.53:0/2942599781 wait complete. 2023-06-10T18:52:58.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.844+0000 7f2bc9009640 1 Processor -- start 2023-06-10T18:52:58.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.844+0000 7f2bc9009640 1 -- start start 2023-06-10T18:52:58.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.844+0000 7f2bc9009640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2bc406c020 0x7f2bc40cd170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:58.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.844+0000 7f2bc9009640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bc40af760 0x7f2bc40b0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:58.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.844+0000 7f2bc9009640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2bc40c9fa0 0x7f2bc41f45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:58.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.844+0000 7f2bc9009640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc4154490 con 0x7f2bc40af760 2023-06-10T18:52:58.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.844+0000 7f2bc9009640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc4155e90 con 0x7f2bc40c9fa0 2023-06-10T18:52:58.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.844+0000 7f2bc9009640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc41558d0 con 0x7f2bc406c020 2023-06-10T18:52:58.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.844+0000 7f2bc259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bc40af760 0x7f2bc40b0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:58.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.844+0000 7f2bc259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bc40af760 0x7f2bc40b0d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35434/0 (socket says 172.21.15.53:35434) 2023-06-10T18:52:58.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.844+0000 7f2bc259c640 1 -- 172.21.15.53:0/2747618101 learned_addr learned my addr 172.21.15.53:0/2747618101 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:58.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.844+0000 7f2bc2d9d640 1 --2- 172.21.15.53:0/2747618101 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2bc406c020 0x7f2bc40cd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:58.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.844+0000 7f2bc359e640 1 --2- 172.21.15.53:0/2747618101 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2bc40c9fa0 0x7f2bc41f45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:58.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.844+0000 7f2bc259c640 1 -- 172.21.15.53:0/2747618101 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2bc406c020 msgr2=0x7f2bc40cd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:58.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.844+0000 7f2bc259c640 1 --2- 172.21.15.53:0/2747618101 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2bc406c020 0x7f2bc40cd170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:58.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.844+0000 7f2bc259c640 1 -- 172.21.15.53:0/2747618101 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2bc40c9fa0 msgr2=0x7f2bc41f45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:58.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.844+0000 7f2bc259c640 1 --2- 172.21.15.53:0/2747618101 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2bc40c9fa0 0x7f2bc41f45a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:58.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.844+0000 7f2bc259c640 1 -- 172.21.15.53:0/2747618101 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bb40094d0 con 0x7f2bc40af760 2023-06-10T18:52:58.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.844+0000 7f2bc259c640 1 --2- 172.21.15.53:0/2747618101 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bc40af760 0x7f2bc40b0d70 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2bb800c500 tx=0x7f2bb800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:58.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.844+0000 7f2bab7fe640 1 -- 172.21.15.53:0/2747618101 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb8005220 con 0x7f2bc40af760 2023-06-10T18:52:58.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.844+0000 7f2bab7fe640 1 -- 172.21.15.53:0/2747618101 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bb8005380 con 0x7f2bc40af760 2023-06-10T18:52:58.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.844+0000 7f2bc9009640 1 -- 172.21.15.53:0/2747618101 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bc4155bb0 con 0x7f2bc40af760 2023-06-10T18:52:58.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.844+0000 7f2bab7fe640 1 -- 172.21.15.53:0/2747618101 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb8007270 con 0x7f2bc40af760 2023-06-10T18:52:58.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.844+0000 7f2bc9009640 1 -- 172.21.15.53:0/2747618101 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bc40cd6b0 con 0x7f2bc40af760 2023-06-10T18:52:58.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.844+0000 7f2bc9009640 1 -- 172.21.15.53:0/2747618101 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bc404d790 con 0x7f2bc40af760 2023-06-10T18:52:58.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.844+0000 7f2bab7fe640 1 -- 172.21.15.53:0/2747618101 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2bb80073d0 con 0x7f2bc40af760 2023-06-10T18:52:58.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.844+0000 7f2bab7fe640 1 --2- 172.21.15.53:0/2747618101 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2bb00662b0 0x7f2bb0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:58.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.844+0000 7f2bab7fe640 1 -- 172.21.15.53:0/2747618101 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2bb80835d0 con 0x7f2bc40af760 2023-06-10T18:52:58.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.848+0000 7f2bc2d9d640 1 --2- 172.21.15.53:0/2747618101 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2bb00662b0 0x7f2bb0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:58.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.848+0000 7f2bc2d9d640 1 --2- 172.21.15.53:0/2747618101 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2bb00662b0 0x7f2bb0068760 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2bb40ad000 tx=0x7f2bb4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:58.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.848+0000 7f2bab7fe640 1 -- 172.21.15.53:0/2747618101 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2bb8050a60 con 0x7f2bc40af760 2023-06-10T18:52:59.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:58.996+0000 7f2bc9009640 1 -- 172.21.15.53:0/2747618101 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2bc4143050 con 0x7f2bc40af760 2023-06-10T18:52:59.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.000+0000 7f2bab7fe640 1 -- 172.21.15.53:0/2747618101 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2bb8054080 con 0x7f2bc40af760 2023-06-10T18:52:59.008 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-06-10T18:52:59.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.000+0000 7f2bc9009640 1 -- 172.21.15.53:0/2747618101 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2bb00662b0 msgr2=0x7f2bb0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:59.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.000+0000 7f2bc9009640 1 --2- 172.21.15.53:0/2747618101 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2bb00662b0 0x7f2bb0068760 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2bb40ad000 tx=0x7f2bb4008040 comp rx=0 tx=0).stop 2023-06-10T18:52:59.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.000+0000 7f2bc9009640 1 -- 172.21.15.53:0/2747618101 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bc40af760 msgr2=0x7f2bc40b0d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:59.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.000+0000 7f2bc9009640 1 --2- 172.21.15.53:0/2747618101 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bc40af760 0x7f2bc40b0d70 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2bb800c500 tx=0x7f2bb800c9c0 comp rx=0 tx=0).stop 2023-06-10T18:52:59.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.000+0000 7f2bc9009640 1 -- 172.21.15.53:0/2747618101 shutdown_connections 2023-06-10T18:52:59.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.000+0000 7f2bc9009640 1 --2- 172.21.15.53:0/2747618101 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2bb00662b0 0x7f2bb0068760 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:59.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.000+0000 7f2bc9009640 1 --2- 172.21.15.53:0/2747618101 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2bc40c9fa0 0x7f2bc41f45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:59.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.000+0000 7f2bc9009640 1 --2- 172.21.15.53:0/2747618101 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bc40af760 0x7f2bc40b0d70 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:59.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.000+0000 7f2bc9009640 1 --2- 172.21.15.53:0/2747618101 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2bc406c020 0x7f2bc40cd170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:59.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.000+0000 7f2bc9009640 1 -- 172.21.15.53:0/2747618101 >> 172.21.15.53:0/2747618101 conn(0x7f2bc406a0e0 msgr2=0x7f2bc40c4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:59.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.000+0000 7f2bc9009640 1 -- 172.21.15.53:0/2747618101 shutdown_connections 2023-06-10T18:52:59.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.000+0000 7f2bc9009640 1 -- 172.21.15.53:0/2747618101 wait complete. 2023-06-10T18:52:59.026 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-10T18:52:59.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.132+0000 7f5be3dcc640 1 Processor -- start 2023-06-10T18:52:59.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.132+0000 7f5be3dcc640 1 -- start start 2023-06-10T18:52:59.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.136+0000 7f5be3dcc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5bdc159690 0x7f5bdc070950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:59.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.136+0000 7f5be3dcc640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bdc0cb080 con 0x7f5bdc0b0f30 2023-06-10T18:52:59.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.136+0000 7f5be3dcc640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bdc0cb320 con 0x7f5bdc159a60 2023-06-10T18:52:59.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.136+0000 7f5be3dcc640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bdc070e90 con 0x7f5bdc159690 2023-06-10T18:52:59.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.136+0000 7f5be1367640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f5bdc0b0f30 0x7f5bdc0cbe00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:36108/0 (socket says 172.21.15.53:36108) 2023-06-10T18:52:59.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.136+0000 7f5be1367640 1 -- 172.21.15.53:0/334753094 learned_addr learned my addr 172.21.15.53:0/334753094 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:52:59.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.136+0000 7f5be1b68640 1 --2- 172.21.15.53:0/334753094 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5bdc159690 0x7f5bdc070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:59.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.136+0000 7f5be0b66640 1 -- 172.21.15.53:0/334753094 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2162306350 0 0) 0x7f5bdc0cb080 con 0x7f5bdc0b0f30 2023-06-10T18:52:59.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.136+0000 7f5be0b66640 1 -- 172.21.15.53:0/334753094 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5bc8003530 con 0x7f5bdc0b0f30 2023-06-10T18:52:59.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.136+0000 7f5be0b66640 1 -- 172.21.15.53:0/334753094 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4278357952 0 0) 0x7f5bc8003530 con 0x7f5bdc0b0f30 2023-06-10T18:52:59.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.136+0000 7f5be0b66640 1 -- 172.21.15.53:0/334753094 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5bdc159690 msgr2=0x7f5bdc070950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:59.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.136+0000 7f5be0b66640 1 --2- 172.21.15.53:0/334753094 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5bdc159690 0x7f5bdc070950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:59.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.136+0000 7f5be0b66640 1 -- 172.21.15.53:0/334753094 >> v1:172.21.15.117:6789/0 conn(0x7f5bdc159a60 legacy=0x7f5bdc0c2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:59.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.136+0000 7f5be0b66640 1 -- 172.21.15.53:0/334753094 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bdc0cb600 con 0x7f5bdc0b0f30 2023-06-10T18:52:59.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.136+0000 7f5be0b66640 1 -- 172.21.15.53:0/334753094 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f5bcc001680 con 0x7f5bdc0b0f30 2023-06-10T18:52:59.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.136+0000 7f5be0b66640 1 -- 172.21.15.53:0/334753094 >> v1:172.21.15.53:6789/0 conn(0x7f5bdc0b0f30 legacy=0x7f5bdc0cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:59.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.136+0000 7f5be0b66640 1 --2- 172.21.15.53:0/334753094 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5bc80039b0 0x7f5bc8003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:59.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.136+0000 7f5be0b66640 1 --2- 172.21.15.53:0/334753094 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5bc8004350 0x7f5bc8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:59.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.136+0000 7f5be0b66640 1 --2- 172.21.15.53:0/334753094 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5bdc159690 0x7f5bc8005070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:59.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.136+0000 7f5be0b66640 1 -- 172.21.15.53:0/334753094 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bdc070e90 con 0x7f5bc80039b0 2023-06-10T18:52:59.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.136+0000 7f5be0b66640 1 -- 172.21.15.53:0/334753094 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc800b990 con 0x7f5bc8004350 2023-06-10T18:52:59.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.136+0000 7f5be0b66640 1 -- 172.21.15.53:0/334753094 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc800bb20 con 0x7f5bdc159690 2023-06-10T18:52:59.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.136+0000 7f5be1b68640 1 --2- 172.21.15.53:0/334753094 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5bc80039b0 0x7f5bc8003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:59.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.136+0000 7f5be1b68640 1 -- 172.21.15.53:0/334753094 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5bdc159690 msgr2=0x7f5bc8005070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:59.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.136+0000 7f5be1b68640 1 --2- 172.21.15.53:0/334753094 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5bdc159690 0x7f5bc8005070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:59.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.136+0000 7f5be1b68640 1 -- 172.21.15.53:0/334753094 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5bc8004350 msgr2=0x7f5bc8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:59.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.136+0000 7f5be1367640 1 --2- 172.21.15.53:0/334753094 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5bc8004350 0x7f5bc8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:59.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.136+0000 7f5be1b68640 1 --2- 172.21.15.53:0/334753094 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5bc8004350 0x7f5bc8004810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:59.150 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.136+0000 7f5be1b68640 1 -- 172.21.15.53:0/334753094 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bc8003530 con 0x7f5bc80039b0 2023-06-10T18:52:59.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.140+0000 7f5be1b68640 1 --2- 172.21.15.53:0/334753094 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5bc80039b0 0x7f5bc8003d80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5bd8009ae0 tx=0x7f5bd801ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4193adea06b04d81 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:59.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.140+0000 7f5be0b66640 1 -- 172.21.15.53:0/334753094 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd80a5680 con 0x7f5bc80039b0 2023-06-10T18:52:59.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.140+0000 7f5be0b66640 1 -- 172.21.15.53:0/334753094 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bd80a57e0 con 0x7f5bc80039b0 2023-06-10T18:52:59.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.140+0000 7f5be0b66640 1 -- 172.21.15.53:0/334753094 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd80a5b90 con 0x7f5bc80039b0 2023-06-10T18:52:59.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.140+0000 7f5be3dcc640 1 -- 172.21.15.53:0/334753094 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5bc80039b0 msgr2=0x7f5bc8003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:59.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.140+0000 7f5be3dcc640 1 --2- 172.21.15.53:0/334753094 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5bc80039b0 0x7f5bc8003d80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5bd8009ae0 tx=0x7f5bd801ca90 comp rx=0 tx=0).stop 2023-06-10T18:52:59.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.140+0000 7f5be2369640 1 -- 172.21.15.53:0/334753094 reap_dead start 2023-06-10T18:52:59.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.140+0000 7f5be3dcc640 1 -- 172.21.15.53:0/334753094 shutdown_connections 2023-06-10T18:52:59.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.140+0000 7f5be3dcc640 1 -- 172.21.15.53:0/334753094 >> 172.21.15.53:0/334753094 conn(0x7f5bdc06a560 msgr2=0x7f5bdc06a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:59.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.140+0000 7f5be3dcc640 1 -- 172.21.15.53:0/334753094 shutdown_connections 2023-06-10T18:52:59.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.140+0000 7f5be3dcc640 1 -- 172.21.15.53:0/334753094 wait complete. 2023-06-10T18:52:59.154 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.140+0000 7f5be3dcc640 1 Processor -- start 2023-06-10T18:52:59.154 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.140+0000 7f5be3dcc640 1 -- start start 2023-06-10T18:52:59.154 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.140+0000 7f5be3dcc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5bdc0aec70 0x7f5bdc0cc980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:59.154 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.140+0000 7f5be3dcc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5bdc0b46d0 0x7f5bdc0b2a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:59.154 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.140+0000 7f5be3dcc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5bdc0af040 0x7f5bdc14ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:59.154 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.140+0000 7f5be3dcc640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bdc0cd820 con 0x7f5bdc0b46d0 2023-06-10T18:52:59.154 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.140+0000 7f5be3dcc640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bdc0ad1b0 con 0x7f5bdc0af040 2023-06-10T18:52:59.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.140+0000 7f5be3dcc640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bdc0cd260 con 0x7f5bdc0aec70 2023-06-10T18:52:59.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.140+0000 7f5be1367640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5bdc0b46d0 0x7f5bdc0b2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:59.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.140+0000 7f5be1367640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5bdc0b46d0 0x7f5bdc0b2a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35446/0 (socket says 172.21.15.53:35446) 2023-06-10T18:52:59.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.140+0000 7f5be1367640 1 -- 172.21.15.53:0/667118080 learned_addr learned my addr 172.21.15.53:0/667118080 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:59.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.140+0000 7f5be1b68640 1 --2- 172.21.15.53:0/667118080 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5bdc0aec70 0x7f5bdc0cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:59.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.140+0000 7f5be2369640 1 --2- 172.21.15.53:0/667118080 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5bdc0af040 0x7f5bdc14ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:59.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.140+0000 7f5be1367640 1 -- 172.21.15.53:0/667118080 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5bdc0aec70 msgr2=0x7f5bdc0cc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:59.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.140+0000 7f5be1367640 1 --2- 172.21.15.53:0/667118080 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5bdc0aec70 0x7f5bdc0cc980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:59.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.140+0000 7f5be1367640 1 -- 172.21.15.53:0/667118080 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5bdc0af040 msgr2=0x7f5bdc14ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:59.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.140+0000 7f5be1367640 1 --2- 172.21.15.53:0/667118080 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5bdc0af040 0x7f5bdc14ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:59.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.140+0000 7f5be1367640 1 -- 172.21.15.53:0/667118080 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bdc0cd540 con 0x7f5bdc0b46d0 2023-06-10T18:52:59.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.140+0000 7f5be2369640 1 --2- 172.21.15.53:0/667118080 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5bdc0af040 0x7f5bdc14ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:52:59.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.140+0000 7f5be1367640 1 --2- 172.21.15.53:0/667118080 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5bdc0b46d0 0x7f5bdc0b2a40 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc00d8d0 tx=0x7f5bcc00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:59.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.140+0000 7f5bd27fc640 1 -- 172.21.15.53:0/667118080 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bcc004cc0 con 0x7f5bdc0b46d0 2023-06-10T18:52:59.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.140+0000 7f5bd27fc640 1 -- 172.21.15.53:0/667118080 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bcc004e20 con 0x7f5bdc0b46d0 2023-06-10T18:52:59.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.140+0000 7f5be3dcc640 1 -- 172.21.15.53:0/667118080 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bdc0ace40 con 0x7f5bdc0b46d0 2023-06-10T18:52:59.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.140+0000 7f5bd27fc640 1 -- 172.21.15.53:0/667118080 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bcc0072d0 con 0x7f5bdc0b46d0 2023-06-10T18:52:59.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.140+0000 7f5be3dcc640 1 -- 172.21.15.53:0/667118080 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bdc0b2f80 con 0x7f5bdc0b46d0 2023-06-10T18:52:59.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.144+0000 7f5be3dcc640 1 -- 172.21.15.53:0/667118080 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bdc04d790 con 0x7f5bdc0b46d0 2023-06-10T18:52:59.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.144+0000 7f5bd27fc640 1 -- 172.21.15.53:0/667118080 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5bcc007430 con 0x7f5bdc0b46d0 2023-06-10T18:52:59.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.144+0000 7f5bd27fc640 1 --2- 172.21.15.53:0/667118080 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5bc0066280 0x7f5bc0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:59.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.144+0000 7f5bd27fc640 1 -- 172.21.15.53:0/667118080 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5bcc0836d0 con 0x7f5bdc0b46d0 2023-06-10T18:52:59.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.144+0000 7f5be1b68640 1 --2- 172.21.15.53:0/667118080 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5bc0066280 0x7f5bc0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:59.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.144+0000 7f5be1b68640 1 --2- 172.21.15.53:0/667118080 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5bc0066280 0x7f5bc0068730 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5bd80af000 tx=0x7f5bd8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:59.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.148+0000 7f5bd27fc640 1 -- 172.21.15.53:0/667118080 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5bcc054670 con 0x7f5bdc0b46d0 2023-06-10T18:52:59.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.296+0000 7f5be3dcc640 1 -- 172.21.15.53:0/667118080 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5bdc0ad2f0 con 0x7f5bdc0b46d0 2023-06-10T18:52:59.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.300+0000 7f5bd27fc640 1 -- 172.21.15.53:0/667118080 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5bcc054200 con 0x7f5bdc0b46d0 2023-06-10T18:52:59.308 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-06-10T18:52:59.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.300+0000 7f5be3dcc640 1 -- 172.21.15.53:0/667118080 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5bc0066280 msgr2=0x7f5bc0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:59.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.300+0000 7f5be3dcc640 1 --2- 172.21.15.53:0/667118080 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5bc0066280 0x7f5bc0068730 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5bd80af000 tx=0x7f5bd8008040 comp rx=0 tx=0).stop 2023-06-10T18:52:59.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.300+0000 7f5be3dcc640 1 -- 172.21.15.53:0/667118080 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5bdc0b46d0 msgr2=0x7f5bdc0b2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:59.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.300+0000 7f5be3dcc640 1 --2- 172.21.15.53:0/667118080 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5bdc0b46d0 0x7f5bdc0b2a40 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc00d8d0 tx=0x7f5bcc00dd90 comp rx=0 tx=0).stop 2023-06-10T18:52:59.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.300+0000 7f5be3dcc640 1 -- 172.21.15.53:0/667118080 shutdown_connections 2023-06-10T18:52:59.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.300+0000 7f5be3dcc640 1 --2- 172.21.15.53:0/667118080 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5bc0066280 0x7f5bc0068730 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:59.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.300+0000 7f5be3dcc640 1 --2- 172.21.15.53:0/667118080 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5bdc0af040 0x7f5bdc14ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:59.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.300+0000 7f5be3dcc640 1 --2- 172.21.15.53:0/667118080 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5bdc0b46d0 0x7f5bdc0b2a40 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:59.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.300+0000 7f5be3dcc640 1 --2- 172.21.15.53:0/667118080 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5bdc0aec70 0x7f5bdc0cc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:59.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.300+0000 7f5be3dcc640 1 -- 172.21.15.53:0/667118080 >> 172.21.15.53:0/667118080 conn(0x7f5bdc06a560 msgr2=0x7f5bdc1562c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:59.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.300+0000 7f5be3dcc640 1 -- 172.21.15.53:0/667118080 shutdown_connections 2023-06-10T18:52:59.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.300+0000 7f5be3dcc640 1 -- 172.21.15.53:0/667118080 wait complete. 2023-06-10T18:52:59.327 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-10T18:52:59.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.440+0000 7fdf9dd5a640 1 Processor -- start 2023-06-10T18:52:59.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.440+0000 7fdf9dd5a640 1 -- start start 2023-06-10T18:52:59.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.444+0000 7fdf9dd5a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fdf98070de0 0x7fdf9815cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:59.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.444+0000 7fdf9dd5a640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf980c8d50 con 0x7fdf980cc020 2023-06-10T18:52:59.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.444+0000 7fdf9dd5a640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf980c9030 con 0x7fdf9815c060 2023-06-10T18:52:59.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.444+0000 7fdf9dd5a640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf98070300 con 0x7fdf98070de0 2023-06-10T18:52:59.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.444+0000 7fdf97fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fdf980cc020 0x7fdf9806bd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:36114/0 (socket says 172.21.15.53:36114) 2023-06-10T18:52:59.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.444+0000 7fdf97fff640 1 -- 172.21.15.53:0/3782507548 learned_addr learned my addr 172.21.15.53:0/3782507548 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:52:59.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.444+0000 7fdf96ffd640 1 --2- 172.21.15.53:0/3782507548 >> v2:172.21.15.117:3300/0 conn(0x7fdf98070de0 0x7fdf9815cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:59.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.444+0000 7fdf967fc640 1 -- 172.21.15.53:0/3782507548 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3343236250 0 0) 0x7fdf980c8d50 con 0x7fdf980cc020 2023-06-10T18:52:59.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.444+0000 7fdf967fc640 1 -- 172.21.15.53:0/3782507548 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf84003530 con 0x7fdf980cc020 2023-06-10T18:52:59.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.444+0000 7fdf967fc640 1 -- 172.21.15.53:0/3782507548 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2714585941 0 0) 0x7fdf84003530 con 0x7fdf980cc020 2023-06-10T18:52:59.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.444+0000 7fdf967fc640 1 -- 172.21.15.53:0/3782507548 >> v2:172.21.15.117:3300/0 conn(0x7fdf98070de0 msgr2=0x7fdf9815cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:59.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.444+0000 7fdf967fc640 1 --2- 172.21.15.53:0/3782507548 >> v2:172.21.15.117:3300/0 conn(0x7fdf98070de0 0x7fdf9815cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:59.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.444+0000 7fdf967fc640 1 -- 172.21.15.53:0/3782507548 >> v1:172.21.15.117:6789/0 conn(0x7fdf9815c060 legacy=0x7fdf9815c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:59.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.444+0000 7fdf967fc640 1 -- 172.21.15.53:0/3782507548 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf980705e0 con 0x7fdf980cc020 2023-06-10T18:52:59.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.444+0000 7fdf967fc640 1 -- 172.21.15.53:0/3782507548 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fdf90001a00 con 0x7fdf980cc020 2023-06-10T18:52:59.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.444+0000 7fdf967fc640 1 -- 172.21.15.53:0/3782507548 >> v1:172.21.15.53:6789/0 conn(0x7fdf980cc020 legacy=0x7fdf9806bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:59.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.444+0000 7fdf967fc640 1 --2- 172.21.15.53:0/3782507548 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdf840039d0 0x7fdf84003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:59.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.444+0000 7fdf967fc640 1 --2- 172.21.15.53:0/3782507548 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf840047d0 0x7fdf84004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:59.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.444+0000 7fdf967fc640 1 --2- 172.21.15.53:0/3782507548 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf840051d0 0x7fdf8400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:59.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.444+0000 7fdf967fc640 1 -- 172.21.15.53:0/3782507548 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf98070300 con 0x7fdf840051d0 2023-06-10T18:52:59.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.444+0000 7fdf967fc640 1 -- 172.21.15.53:0/3782507548 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8400c0e0 con 0x7fdf840047d0 2023-06-10T18:52:59.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.444+0000 7fdf967fc640 1 -- 172.21.15.53:0/3782507548 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8400c2a0 con 0x7fdf840039d0 2023-06-10T18:52:59.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.444+0000 7fdf97fff640 1 --2- 172.21.15.53:0/3782507548 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf840051d0 0x7fdf8400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:59.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.444+0000 7fdf96ffd640 1 --2- 172.21.15.53:0/3782507548 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf840047d0 0x7fdf84004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:59.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.444+0000 7fdf977fe640 1 --2- 172.21.15.53:0/3782507548 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdf840039d0 0x7fdf84003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:59.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.444+0000 7fdf97fff640 1 -- 172.21.15.53:0/3782507548 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdf840039d0 msgr2=0x7fdf84003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:59.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.444+0000 7fdf97fff640 1 --2- 172.21.15.53:0/3782507548 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdf840039d0 0x7fdf84003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:59.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.444+0000 7fdf97fff640 1 -- 172.21.15.53:0/3782507548 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf840047d0 msgr2=0x7fdf84004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:52:59.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.444+0000 7fdf97fff640 1 --2- 172.21.15.53:0/3782507548 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf840047d0 0x7fdf84004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:59.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.444+0000 7fdf97fff640 1 -- 172.21.15.53:0/3782507548 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf84003530 con 0x7fdf840051d0 2023-06-10T18:52:59.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.448+0000 7fdf97fff640 1 -- 172.21.15.53:0/3782507548 reap_dead start 2023-06-10T18:52:59.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.448+0000 7fdf97fff640 1 --2- 172.21.15.53:0/3782507548 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf840051d0 0x7fdf8400b990 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fdf9000a370 tx=0x7fdf90021bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38c72adc5481f6c7 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:59.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.448+0000 7fdf967fc640 1 -- 172.21.15.53:0/3782507548 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf900ab810 con 0x7fdf840051d0 2023-06-10T18:52:59.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.448+0000 7fdf967fc640 1 -- 172.21.15.53:0/3782507548 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf900ab9b0 con 0x7fdf840051d0 2023-06-10T18:52:59.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.448+0000 7fdf967fc640 1 -- 172.21.15.53:0/3782507548 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf900abd60 con 0x7fdf840051d0 2023-06-10T18:52:59.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.448+0000 7fdf9dd5a640 1 -- 172.21.15.53:0/3782507548 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf840051d0 msgr2=0x7fdf8400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:59.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.448+0000 7fdf9dd5a640 1 --2- 172.21.15.53:0/3782507548 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf840051d0 0x7fdf8400b990 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fdf9000a370 tx=0x7fdf90021bf0 comp rx=0 tx=0).stop 2023-06-10T18:52:59.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.448+0000 7fdf9dd5a640 1 -- 172.21.15.53:0/3782507548 shutdown_connections 2023-06-10T18:52:59.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.448+0000 7fdf9dd5a640 1 --2- 172.21.15.53:0/3782507548 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf840051d0 0x7fdf8400b990 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:59.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.448+0000 7fdf9dd5a640 1 -- 172.21.15.53:0/3782507548 >> 172.21.15.53:0/3782507548 conn(0x7fdf9806a0e0 msgr2=0x7fdf980cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:59.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.448+0000 7fdf9dd5a640 1 -- 172.21.15.53:0/3782507548 shutdown_connections 2023-06-10T18:52:59.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.448+0000 7fdf9dd5a640 1 -- 172.21.15.53:0/3782507548 wait complete. 2023-06-10T18:52:59.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.448+0000 7fdf9dd5a640 1 Processor -- start 2023-06-10T18:52:59.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.448+0000 7fdf9dd5a640 1 -- start start 2023-06-10T18:52:59.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.448+0000 7fdf9dd5a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf840051d0 0x7fdf98151210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:59.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.448+0000 7fdf9dd5a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdf980cda80 0x7fdf980cdef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:59.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.448+0000 7fdf9dd5a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf980b3020 0x7fdf980b3470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:59.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.448+0000 7fdf9dd5a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf980b39b0 con 0x7fdf980b3020 2023-06-10T18:52:59.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.448+0000 7fdf9dd5a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf980b2030 con 0x7fdf840051d0 2023-06-10T18:52:59.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.448+0000 7fdf9dd5a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf980b2310 con 0x7fdf980cda80 2023-06-10T18:52:59.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.448+0000 7fdf97fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf980b3020 0x7fdf980b3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:59.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.448+0000 7fdf97fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf980b3020 0x7fdf980b3470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35452/0 (socket says 172.21.15.53:35452) 2023-06-10T18:52:59.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.448+0000 7fdf97fff640 1 -- 172.21.15.53:0/3053721660 learned_addr learned my addr 172.21.15.53:0/3053721660 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:59.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.452+0000 7fdf96ffd640 1 --2- 172.21.15.53:0/3053721660 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdf980cda80 0x7fdf980cdef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:59.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.452+0000 7fdf977fe640 1 --2- 172.21.15.53:0/3053721660 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf840051d0 0x7fdf98151210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:59.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.452+0000 7fdf97fff640 1 -- 172.21.15.53:0/3053721660 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdf980cda80 msgr2=0x7fdf980cdef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:59.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.452+0000 7fdf97fff640 1 --2- 172.21.15.53:0/3053721660 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdf980cda80 0x7fdf980cdef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:59.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.452+0000 7fdf97fff640 1 -- 172.21.15.53:0/3053721660 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf840051d0 msgr2=0x7fdf98151210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:59.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.452+0000 7fdf97fff640 1 --2- 172.21.15.53:0/3053721660 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf840051d0 0x7fdf98151210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:59.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.452+0000 7fdf97fff640 1 -- 172.21.15.53:0/3053721660 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf980b25f0 con 0x7fdf980b3020 2023-06-10T18:52:59.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.452+0000 7fdf96ffd640 1 --2- 172.21.15.53:0/3053721660 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdf980cda80 0x7fdf980cdef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:52:59.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.452+0000 7fdf977fe640 1 --2- 172.21.15.53:0/3053721660 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf840051d0 0x7fdf98151210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:52:59.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.452+0000 7fdf97fff640 1 --2- 172.21.15.53:0/3053721660 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf980b3020 0x7fdf980b3470 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fdf90021a20 tx=0x7fdf84005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:59.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.452+0000 7fdf8ffff640 1 -- 172.21.15.53:0/3053721660 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf90001a00 con 0x7fdf980b3020 2023-06-10T18:52:59.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.452+0000 7fdf8ffff640 1 -- 172.21.15.53:0/3053721660 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf90001260 con 0x7fdf980b3020 2023-06-10T18:52:59.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.452+0000 7fdf9dd5a640 1 -- 172.21.15.53:0/3053721660 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf980b28d0 con 0x7fdf980b3020 2023-06-10T18:52:59.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.452+0000 7fdf8ffff640 1 -- 172.21.15.53:0/3053721660 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf900ab810 con 0x7fdf980b3020 2023-06-10T18:52:59.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.452+0000 7fdf9dd5a640 1 -- 172.21.15.53:0/3053721660 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf980b1c90 con 0x7fdf980b3020 2023-06-10T18:52:59.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.452+0000 7fdf9dd5a640 1 -- 172.21.15.53:0/3053721660 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf980c1720 con 0x7fdf980b3020 2023-06-10T18:52:59.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.452+0000 7fdf8ffff640 1 -- 172.21.15.53:0/3053721660 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdf900b9070 con 0x7fdf980b3020 2023-06-10T18:52:59.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.452+0000 7fdf8ffff640 1 --2- 172.21.15.53:0/3053721660 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdf78066280 0x7fdf78068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:59.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.452+0000 7fdf8ffff640 1 -- 172.21.15.53:0/3053721660 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdf90121750 con 0x7fdf980b3020 2023-06-10T18:52:59.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.452+0000 7fdf977fe640 1 --2- 172.21.15.53:0/3053721660 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdf78066280 0x7fdf78068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:59.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.452+0000 7fdf977fe640 1 --2- 172.21.15.53:0/3053721660 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdf78066280 0x7fdf78068730 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fdf980ce4e0 tx=0x7fdf80009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:59.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.456+0000 7fdf8ffff640 1 -- 172.21.15.53:0/3053721660 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdf900eebd0 con 0x7fdf980b3020 2023-06-10T18:52:59.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.608+0000 7fdf9dd5a640 1 -- 172.21.15.53:0/3053721660 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdf980b2450 con 0x7fdf980b3020 2023-06-10T18:52:59.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.612+0000 7fdf8ffff640 1 -- 172.21.15.53:0/3053721660 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdf980b2450 con 0x7fdf980b3020 2023-06-10T18:52:59.621 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-06-10T18:52:59.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.612+0000 7fdf9dd5a640 1 -- 172.21.15.53:0/3053721660 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdf78066280 msgr2=0x7fdf78068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:59.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.612+0000 7fdf9dd5a640 1 --2- 172.21.15.53:0/3053721660 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdf78066280 0x7fdf78068730 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fdf980ce4e0 tx=0x7fdf80009040 comp rx=0 tx=0).stop 2023-06-10T18:52:59.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.612+0000 7fdf9dd5a640 1 -- 172.21.15.53:0/3053721660 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf980b3020 msgr2=0x7fdf980b3470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:59.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.612+0000 7fdf9dd5a640 1 --2- 172.21.15.53:0/3053721660 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf980b3020 0x7fdf980b3470 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fdf90021a20 tx=0x7fdf84005800 comp rx=0 tx=0).stop 2023-06-10T18:52:59.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.612+0000 7fdf9dd5a640 1 -- 172.21.15.53:0/3053721660 shutdown_connections 2023-06-10T18:52:59.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.612+0000 7fdf9dd5a640 1 --2- 172.21.15.53:0/3053721660 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdf78066280 0x7fdf78068730 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:59.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.612+0000 7fdf9dd5a640 1 --2- 172.21.15.53:0/3053721660 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf980b3020 0x7fdf980b3470 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:59.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.612+0000 7fdf9dd5a640 1 --2- 172.21.15.53:0/3053721660 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdf980cda80 0x7fdf980cdef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:59.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.612+0000 7fdf9dd5a640 1 --2- 172.21.15.53:0/3053721660 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf840051d0 0x7fdf98151210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:59.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.612+0000 7fdf9dd5a640 1 -- 172.21.15.53:0/3053721660 >> 172.21.15.53:0/3053721660 conn(0x7fdf9806a0e0 msgr2=0x7fdf98152140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:59.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.612+0000 7fdf9dd5a640 1 -- 172.21.15.53:0/3053721660 shutdown_connections 2023-06-10T18:52:59.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.612+0000 7fdf9dd5a640 1 -- 172.21.15.53:0/3053721660 wait complete. 2023-06-10T18:52:59.639 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-10T18:52:59.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.756+0000 7f4849f4b640 1 Processor -- start 2023-06-10T18:52:59.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.756+0000 7f4849f4b640 1 -- start start 2023-06-10T18:52:59.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.756+0000 7f4849f4b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4844069450 0x7f4844069850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:59.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.756+0000 7f4849f4b640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4844069d90 con 0x7f484415eef0 2023-06-10T18:52:59.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.756+0000 7f4849f4b640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f484415f2c0 con 0x7f4844070f80 2023-06-10T18:52:59.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.756+0000 7f4849f4b640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f484415fdc0 con 0x7f4844069450 2023-06-10T18:52:59.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.756+0000 7f48437fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f484415eef0 0x7f484415f570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:36126/0 (socket says 172.21.15.53:36126) 2023-06-10T18:52:59.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.756+0000 7f48437fe640 1 -- 172.21.15.53:0/2200787464 learned_addr learned my addr 172.21.15.53:0/2200787464 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:52:59.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.756+0000 7f4843fff640 1 --2- 172.21.15.53:0/2200787464 >> v2:172.21.15.53:3300/0 conn(0x7f4844069450 0x7f4844069850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:59.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.756+0000 7f4842ffd640 1 -- 172.21.15.53:0/2200787464 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2145708355 0 0) 0x7f4844069d90 con 0x7f484415eef0 2023-06-10T18:52:59.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.756+0000 7f4842ffd640 1 -- 172.21.15.53:0/2200787464 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4830003530 con 0x7f484415eef0 2023-06-10T18:52:59.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.756+0000 7f4843fff640 1 -- 172.21.15.53:0/2200787464 >> v1:172.21.15.117:6789/0 conn(0x7f4844070f80 legacy=0x7f48440ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:59.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.756+0000 7f4843fff640 1 -- 172.21.15.53:0/2200787464 >> v1:172.21.15.53:6789/0 conn(0x7f484415eef0 legacy=0x7f484415f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:59.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.756+0000 7f4843fff640 1 -- 172.21.15.53:0/2200787464 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48441600a0 con 0x7f4844069450 2023-06-10T18:52:59.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.760+0000 7f4843fff640 1 --2- 172.21.15.53:0/2200787464 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4844069450 0x7f4844069850 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f483c009d90 tx=0x7f483c01c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdff128ff23ee44c server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:59.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.760+0000 7f4842ffd640 1 -- 172.21.15.53:0/2200787464 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f483c0a5810 con 0x7f4844069450 2023-06-10T18:52:59.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.760+0000 7f4842ffd640 1 -- 172.21.15.53:0/2200787464 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f483c0a5970 con 0x7f4844069450 2023-06-10T18:52:59.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.760+0000 7f4842ffd640 1 -- 172.21.15.53:0/2200787464 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f483c0a5d00 con 0x7f4844069450 2023-06-10T18:52:59.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.760+0000 7f4849f4b640 1 -- 172.21.15.53:0/2200787464 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4844069450 msgr2=0x7f4844069850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:59.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.760+0000 7f4849f4b640 1 --2- 172.21.15.53:0/2200787464 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4844069450 0x7f4844069850 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f483c009d90 tx=0x7f483c01c950 comp rx=0 tx=0).stop 2023-06-10T18:52:59.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.760+0000 7f4849f4b640 1 -- 172.21.15.53:0/2200787464 shutdown_connections 2023-06-10T18:52:59.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.760+0000 7f4849f4b640 1 --2- 172.21.15.53:0/2200787464 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4844069450 0x7f4844069850 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:59.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.760+0000 7f4849f4b640 1 -- 172.21.15.53:0/2200787464 >> 172.21.15.53:0/2200787464 conn(0x7f484406a560 msgr2=0x7f484406a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:59.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.760+0000 7f4849f4b640 1 -- 172.21.15.53:0/2200787464 shutdown_connections 2023-06-10T18:52:59.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.760+0000 7f4849f4b640 1 -- 172.21.15.53:0/2200787464 wait complete. 2023-06-10T18:52:59.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.760+0000 7f4849f4b640 1 Processor -- start 2023-06-10T18:52:59.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.760+0000 7f4849f4b640 1 -- start start 2023-06-10T18:52:59.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.760+0000 7f4849f4b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4844069450 0x7f484415e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:59.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.760+0000 7f4849f4b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4844070f80 0x7f4844154d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:59.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.760+0000 7f4849f4b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f484415eef0 0x7f4844151870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:59.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.760+0000 7f4849f4b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4844151db0 con 0x7f4844069450 2023-06-10T18:52:59.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.760+0000 7f4849f4b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48440b36e0 con 0x7f484415eef0 2023-06-10T18:52:59.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.760+0000 7f4849f4b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4844156710 con 0x7f4844070f80 2023-06-10T18:52:59.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.760+0000 7f48437fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4844069450 0x7f484415e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:59.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.760+0000 7f48437fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4844069450 0x7f484415e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35474/0 (socket says 172.21.15.53:35474) 2023-06-10T18:52:59.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.760+0000 7f48437fe640 1 -- 172.21.15.53:0/2867116726 learned_addr learned my addr 172.21.15.53:0/2867116726 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:52:59.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.760+0000 7f4843fff640 1 --2- 172.21.15.53:0/2867116726 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f484415eef0 0x7f4844151870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:59.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.760+0000 7f483bfff640 1 --2- 172.21.15.53:0/2867116726 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4844070f80 0x7f4844154d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:59.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.760+0000 7f48437fe640 1 -- 172.21.15.53:0/2867116726 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4844070f80 msgr2=0x7f4844154d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:59.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.760+0000 7f48437fe640 1 --2- 172.21.15.53:0/2867116726 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4844070f80 0x7f4844154d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:59.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.760+0000 7f48437fe640 1 -- 172.21.15.53:0/2867116726 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f484415eef0 msgr2=0x7f4844151870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:59.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.760+0000 7f48437fe640 1 --2- 172.21.15.53:0/2867116726 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f484415eef0 0x7f4844151870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:59.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.760+0000 7f48437fe640 1 -- 172.21.15.53:0/2867116726 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f483c009a70 con 0x7f4844069450 2023-06-10T18:52:59.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.760+0000 7f483bfff640 1 --2- 172.21.15.53:0/2867116726 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4844070f80 0x7f4844154d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:52:59.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.760+0000 7f4843fff640 1 --2- 172.21.15.53:0/2867116726 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f484415eef0 0x7f4844151870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:52:59.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.760+0000 7f48437fe640 1 --2- 172.21.15.53:0/2867116726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4844069450 0x7f484415e730 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f483400c420 tx=0x7f483400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:59.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.760+0000 7f4840ff9640 1 -- 172.21.15.53:0/2867116726 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4834005cf0 con 0x7f4844069450 2023-06-10T18:52:59.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.760+0000 7f4840ff9640 1 -- 172.21.15.53:0/2867116726 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4834005e50 con 0x7f4844069450 2023-06-10T18:52:59.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.760+0000 7f4849f4b640 1 -- 172.21.15.53:0/2867116726 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48440b3980 con 0x7f4844069450 2023-06-10T18:52:59.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.760+0000 7f4840ff9640 1 -- 172.21.15.53:0/2867116726 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48340072d0 con 0x7f4844069450 2023-06-10T18:52:59.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.760+0000 7f4849f4b640 1 -- 172.21.15.53:0/2867116726 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48441569f0 con 0x7f4844069450 2023-06-10T18:52:59.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.764+0000 7f4849f4b640 1 -- 172.21.15.53:0/2867116726 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f484404d790 con 0x7f4844069450 2023-06-10T18:52:59.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.764+0000 7f4840ff9640 1 -- 172.21.15.53:0/2867116726 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4834007430 con 0x7f4844069450 2023-06-10T18:52:59.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.764+0000 7f4840ff9640 1 --2- 172.21.15.53:0/2867116726 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4824066280 0x7f4824068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:52:59.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.764+0000 7f4840ff9640 1 -- 172.21.15.53:0/2867116726 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4834083230 con 0x7f4844069450 2023-06-10T18:52:59.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.764+0000 7f483bfff640 1 --2- 172.21.15.53:0/2867116726 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4824066280 0x7f4824068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:52:59.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.764+0000 7f483bfff640 1 --2- 172.21.15.53:0/2867116726 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4824066280 0x7f4824068730 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f484415e070 tx=0x7f482c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:52:59.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.768+0000 7f4840ff9640 1 -- 172.21.15.53:0/2867116726 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4834050760 con 0x7f4844069450 2023-06-10T18:52:59.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.916+0000 7f4849f4b640 1 -- 172.21.15.53:0/2867116726 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f48440c5b40 con 0x7f4844069450 2023-06-10T18:52:59.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.916+0000 7f4840ff9640 1 -- 172.21.15.53:0/2867116726 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4834053d80 con 0x7f4844069450 2023-06-10T18:52:59.925 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-06-10T18:52:59.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.916+0000 7f4849f4b640 1 -- 172.21.15.53:0/2867116726 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4824066280 msgr2=0x7f4824068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:59.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.916+0000 7f4849f4b640 1 --2- 172.21.15.53:0/2867116726 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4824066280 0x7f4824068730 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f484415e070 tx=0x7f482c009040 comp rx=0 tx=0).stop 2023-06-10T18:52:59.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.916+0000 7f4849f4b640 1 -- 172.21.15.53:0/2867116726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4844069450 msgr2=0x7f484415e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:52:59.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.916+0000 7f4849f4b640 1 --2- 172.21.15.53:0/2867116726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4844069450 0x7f484415e730 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f483400c420 tx=0x7f483400c8e0 comp rx=0 tx=0).stop 2023-06-10T18:52:59.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.916+0000 7f4849f4b640 1 -- 172.21.15.53:0/2867116726 shutdown_connections 2023-06-10T18:52:59.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.916+0000 7f4849f4b640 1 --2- 172.21.15.53:0/2867116726 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4824066280 0x7f4824068730 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:59.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.916+0000 7f4849f4b640 1 --2- 172.21.15.53:0/2867116726 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f484415eef0 0x7f4844151870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:59.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.916+0000 7f4849f4b640 1 --2- 172.21.15.53:0/2867116726 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4844070f80 0x7f4844154d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:59.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.916+0000 7f4849f4b640 1 --2- 172.21.15.53:0/2867116726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4844069450 0x7f484415e730 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:52:59.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.916+0000 7f4849f4b640 1 -- 172.21.15.53:0/2867116726 >> 172.21.15.53:0/2867116726 conn(0x7f484406a560 msgr2=0x7f48440c5f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:52:59.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.916+0000 7f4849f4b640 1 -- 172.21.15.53:0/2867116726 shutdown_connections 2023-06-10T18:52:59.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:52:59.916+0000 7f4849f4b640 1 -- 172.21.15.53:0/2867116726 wait complete. 2023-06-10T18:52:59.943 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T18:53:00.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.040+0000 7ff59f821640 1 Processor -- start 2023-06-10T18:53:00.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.040+0000 7ff59f821640 1 -- start start 2023-06-10T18:53:00.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.044+0000 7ff59f821640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff59815c810 0x7ff5980cd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:00.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.044+0000 7ff59f821640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff5980cbfc0 0x7ff5980c8d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:00.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.044+0000 7ff59f821640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5980c9270 con 0x7ff59815ba70 2023-06-10T18:53:00.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.044+0000 7ff59f821640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5980cc6c0 con 0x7ff59815c810 2023-06-10T18:53:00.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.044+0000 7ff59f821640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5980cc9a0 con 0x7ff5980cbfc0 2023-06-10T18:53:00.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.044+0000 7ff59cdbc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff59815c810 0x7ff5980cd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:00.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.044+0000 7ff59cdbc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff59815c810 0x7ff5980cd760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35482/0 (socket says 172.21.15.53:35482) 2023-06-10T18:53:00.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.044+0000 7ff59cdbc640 1 -- 172.21.15.53:0/790009354 learned_addr learned my addr 172.21.15.53:0/790009354 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:00.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.044+0000 7ff59cdbc640 1 -- 172.21.15.53:0/790009354 >> v2:172.21.15.117:3300/0 conn(0x7ff5980cbfc0 msgr2=0x7ff5980c8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:00.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.044+0000 7ff59cdbc640 1 --2- 172.21.15.53:0/790009354 >> v2:172.21.15.117:3300/0 conn(0x7ff5980cbfc0 0x7ff5980c8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:00.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.044+0000 7ff59cdbc640 1 -- 172.21.15.53:0/790009354 >> v1:172.21.15.117:6789/0 conn(0x7ff59815ba70 legacy=0x7ff59815c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:00.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.044+0000 7ff59cdbc640 1 -- 172.21.15.53:0/790009354 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5980ccc80 con 0x7ff59815c810 2023-06-10T18:53:00.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.044+0000 7ff59cdbc640 1 --2- 172.21.15.53:0/790009354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff59815c810 0x7ff5980cd760 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff59806ed90 tx=0x7ff59401c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=311cd9abf5baa565 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:00.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.044+0000 7ff58bfff640 1 -- 172.21.15.53:0/790009354 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5940a5790 con 0x7ff59815c810 2023-06-10T18:53:00.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.044+0000 7ff58bfff640 1 -- 172.21.15.53:0/790009354 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5940a58f0 con 0x7ff59815c810 2023-06-10T18:53:00.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.044+0000 7ff58bfff640 1 -- 172.21.15.53:0/790009354 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5940a5c80 con 0x7ff59815c810 2023-06-10T18:53:00.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.048+0000 7ff59f821640 1 -- 172.21.15.53:0/790009354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff59815c810 msgr2=0x7ff5980cd760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:00.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.048+0000 7ff59f821640 1 --2- 172.21.15.53:0/790009354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff59815c810 0x7ff5980cd760 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff59806ed90 tx=0x7ff59401c8d0 comp rx=0 tx=0).stop 2023-06-10T18:53:00.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.048+0000 7ff59f821640 1 -- 172.21.15.53:0/790009354 shutdown_connections 2023-06-10T18:53:00.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.048+0000 7ff59f821640 1 --2- 172.21.15.53:0/790009354 >> v2:172.21.15.117:3300/0 conn(0x7ff5980cbfc0 0x7ff5980c8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:00.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.048+0000 7ff59f821640 1 --2- 172.21.15.53:0/790009354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff59815c810 0x7ff5980cd760 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:00.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.048+0000 7ff59f821640 1 -- 172.21.15.53:0/790009354 >> 172.21.15.53:0/790009354 conn(0x7ff59806a0d0 msgr2=0x7ff5980ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:00.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.048+0000 7ff59f821640 1 -- 172.21.15.53:0/790009354 shutdown_connections 2023-06-10T18:53:00.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.048+0000 7ff59f821640 1 -- 172.21.15.53:0/790009354 wait complete. 2023-06-10T18:53:00.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.048+0000 7ff59f821640 1 Processor -- start 2023-06-10T18:53:00.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.048+0000 7ff59f821640 1 -- start start 2023-06-10T18:53:00.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.048+0000 7ff59f821640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff5980cbfc0 0x7ff59814ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:00.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.048+0000 7ff59f821640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff59815ba70 0x7ff5980b11f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:00.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.048+0000 7ff59f821640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff59815c810 0x7ff5980b1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:00.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.048+0000 7ff59f821640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff598159a50 con 0x7ff59815ba70 2023-06-10T18:53:00.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.048+0000 7ff59f821640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5980b34f0 con 0x7ff5980cbfc0 2023-06-10T18:53:00.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.048+0000 7ff59f821640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5980b37d0 con 0x7ff59815c810 2023-06-10T18:53:00.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.048+0000 7ff59cdbc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff59815ba70 0x7ff5980b11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:00.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.048+0000 7ff59cdbc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff59815ba70 0x7ff5980b11f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35484/0 (socket says 172.21.15.53:35484) 2023-06-10T18:53:00.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.048+0000 7ff59cdbc640 1 -- 172.21.15.53:0/1381671394 learned_addr learned my addr 172.21.15.53:0/1381671394 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:00.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.048+0000 7ff59d5bd640 1 --2- 172.21.15.53:0/1381671394 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff5980cbfc0 0x7ff59814ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:00.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.048+0000 7ff59ddbe640 1 --2- 172.21.15.53:0/1381671394 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff59815c810 0x7ff5980b1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:00.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.048+0000 7ff59cdbc640 1 -- 172.21.15.53:0/1381671394 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff59815c810 msgr2=0x7ff5980b1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:00.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.048+0000 7ff59cdbc640 1 --2- 172.21.15.53:0/1381671394 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff59815c810 0x7ff5980b1730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:00.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.048+0000 7ff59cdbc640 1 -- 172.21.15.53:0/1381671394 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff5980cbfc0 msgr2=0x7ff59814ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:00.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.048+0000 7ff59cdbc640 1 --2- 172.21.15.53:0/1381671394 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff5980cbfc0 0x7ff59814ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:00.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.048+0000 7ff59cdbc640 1 -- 172.21.15.53:0/1381671394 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff594009b30 con 0x7ff59815ba70 2023-06-10T18:53:00.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.048+0000 7ff59d5bd640 1 --2- 172.21.15.53:0/1381671394 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff5980cbfc0 0x7ff59814ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:00.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.048+0000 7ff59cdbc640 1 --2- 172.21.15.53:0/1381671394 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff59815ba70 0x7ff5980b11f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff5940af040 tx=0x7ff594019670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:00.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.048+0000 7ff589ffb640 1 -- 172.21.15.53:0/1381671394 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5940b8670 con 0x7ff59815ba70 2023-06-10T18:53:00.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.048+0000 7ff589ffb640 1 -- 172.21.15.53:0/1381671394 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5940b87d0 con 0x7ff59815ba70 2023-06-10T18:53:00.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.048+0000 7ff59f821640 1 -- 172.21.15.53:0/1381671394 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5980b1da0 con 0x7ff59815ba70 2023-06-10T18:53:00.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.048+0000 7ff589ffb640 1 -- 172.21.15.53:0/1381671394 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5940b8b80 con 0x7ff59815ba70 2023-06-10T18:53:00.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.048+0000 7ff59f821640 1 -- 172.21.15.53:0/1381671394 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff598152c90 con 0x7ff59815ba70 2023-06-10T18:53:00.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.052+0000 7ff59f821640 1 -- 172.21.15.53:0/1381671394 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5980ca040 con 0x7ff59815ba70 2023-06-10T18:53:00.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.052+0000 7ff589ffb640 1 -- 172.21.15.53:0/1381671394 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff5940b8ce0 con 0x7ff59815ba70 2023-06-10T18:53:00.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.052+0000 7ff589ffb640 1 --2- 172.21.15.53:0/1381671394 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff57c066280 0x7ff57c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:00.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.052+0000 7ff589ffb640 1 -- 172.21.15.53:0/1381671394 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff59411f1e0 con 0x7ff59815ba70 2023-06-10T18:53:00.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.052+0000 7ff59d5bd640 1 --2- 172.21.15.53:0/1381671394 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff57c066280 0x7ff57c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:00.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.052+0000 7ff59d5bd640 1 --2- 172.21.15.53:0/1381671394 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff57c066280 0x7ff57c068730 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff59806bb60 tx=0x7ff590009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:00.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.056+0000 7ff589ffb640 1 -- 172.21.15.53:0/1381671394 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff5940ec6f0 con 0x7ff59815ba70 2023-06-10T18:53:00.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.244+0000 7ff59f821640 1 -- 172.21.15.53:0/1381671394 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff5980b3350 con 0x7ff59815ba70 2023-06-10T18:53:00.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.244+0000 7ff589ffb640 1 -- 172.21.15.53:0/1381671394 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4668 (secure 0 0 0) 0x7ff5980b3350 con 0x7ff59815ba70 2023-06-10T18:53:00.254 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:53:00.254 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4236,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/1767214403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":1767214403},{"type":"v1","addr":"172.21.15.53:6834","nonce":1767214403}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/184933647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":184933647},{"type":"v1","addr":"172.21.15.117:6837","nonce":184933647}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/1556542558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":1556542558},{"type":"v1","addr":"172.21.15.53:6835","nonce":1556542558}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T18:52:44.918376+0000","modified":"2023-06-10T18:52:47.927154+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6835/1492134415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1492134415},{"type":"v1","addr":"172.21.15.117:6835","nonce":1492134415}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-10T18:53:00.254 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 7 2023-06-10T18:53:00.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.244+0000 7ff59f821640 1 -- 172.21.15.53:0/1381671394 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff57c066280 msgr2=0x7ff57c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:00.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.244+0000 7ff59f821640 1 --2- 172.21.15.53:0/1381671394 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff57c066280 0x7ff57c068730 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff59806bb60 tx=0x7ff590009040 comp rx=0 tx=0).stop 2023-06-10T18:53:00.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.244+0000 7ff59f821640 1 -- 172.21.15.53:0/1381671394 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff59815ba70 msgr2=0x7ff5980b11f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:00.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.244+0000 7ff59f821640 1 --2- 172.21.15.53:0/1381671394 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff59815ba70 0x7ff5980b11f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff5940af040 tx=0x7ff594019670 comp rx=0 tx=0).stop 2023-06-10T18:53:00.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.244+0000 7ff59f821640 1 -- 172.21.15.53:0/1381671394 shutdown_connections 2023-06-10T18:53:00.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.244+0000 7ff59f821640 1 --2- 172.21.15.53:0/1381671394 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff57c066280 0x7ff57c068730 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:00.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.244+0000 7ff59f821640 1 --2- 172.21.15.53:0/1381671394 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff59815c810 0x7ff5980b1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:00.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.244+0000 7ff59f821640 1 --2- 172.21.15.53:0/1381671394 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff59815ba70 0x7ff5980b11f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:00.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.244+0000 7ff59f821640 1 --2- 172.21.15.53:0/1381671394 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff5980cbfc0 0x7ff59814ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:00.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.248+0000 7ff59f821640 1 -- 172.21.15.53:0/1381671394 >> 172.21.15.53:0/1381671394 conn(0x7ff59806a0d0 msgr2=0x7ff59806b090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:00.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.248+0000 7ff59f821640 1 -- 172.21.15.53:0/1381671394 shutdown_connections 2023-06-10T18:53:00.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.248+0000 7ff59f821640 1 -- 172.21.15.53:0/1381671394 wait complete. 2023-06-10T18:53:00.272 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T18:53:00.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.376+0000 7f7574a41640 1 Processor -- start 2023-06-10T18:53:00.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.380+0000 7f7574a41640 1 -- start start 2023-06-10T18:53:00.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.380+0000 7f7574a41640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f757006b2f0 0x7f757006f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:00.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.380+0000 7f7574a41640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f75700c8d00 0x7f757006b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:00.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.380+0000 7f7574a41640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f757006bc00 0x7f75700cbe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:00.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.380+0000 7f7574a41640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7570158a90 con 0x7f75700c8d00 2023-06-10T18:53:00.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.380+0000 7f7574a41640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75700705d0 con 0x7f757006bc00 2023-06-10T18:53:00.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.380+0000 7f7574a41640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f757006f9c0 con 0x7f757006b2f0 2023-06-10T18:53:00.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.380+0000 7f756dd9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f75700c8d00 0x7f757006b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:00.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.380+0000 7f756dd9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f75700c8d00 0x7f757006b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35492/0 (socket says 172.21.15.53:35492) 2023-06-10T18:53:00.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.380+0000 7f756dd9b640 1 -- 172.21.15.53:0/916658240 learned_addr learned my addr 172.21.15.53:0/916658240 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:00.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.380+0000 7f756ed9d640 1 --2- 172.21.15.53:0/916658240 >> v2:172.21.15.117:3300/0 conn(0x7f757006bc00 0x7f75700cbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:00.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.380+0000 7f756e59c640 1 --2- 172.21.15.53:0/916658240 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f757006b2f0 0x7f757006f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:00.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.380+0000 7f756dd9b640 1 -- 172.21.15.53:0/916658240 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f757006b2f0 msgr2=0x7f757006f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:00.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.380+0000 7f756dd9b640 1 --2- 172.21.15.53:0/916658240 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f757006b2f0 0x7f757006f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:00.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.380+0000 7f756dd9b640 1 -- 172.21.15.53:0/916658240 >> v2:172.21.15.117:3300/0 conn(0x7f757006bc00 msgr2=0x7f75700cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:00.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.380+0000 7f756dd9b640 1 --2- 172.21.15.53:0/916658240 >> v2:172.21.15.117:3300/0 conn(0x7f757006bc00 0x7f75700cbe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:00.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.380+0000 7f756dd9b640 1 -- 172.21.15.53:0/916658240 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f757006fca0 con 0x7f75700c8d00 2023-06-10T18:53:00.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.384+0000 7f756dd9b640 1 --2- 172.21.15.53:0/916658240 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f75700c8d00 0x7f757006b6c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7564009870 tx=0x7f756401ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5e4ddb811a0fd23 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:00.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.384+0000 7f756d59a640 1 -- 172.21.15.53:0/916658240 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75640a89b0 con 0x7f75700c8d00 2023-06-10T18:53:00.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.384+0000 7f756d59a640 1 -- 172.21.15.53:0/916658240 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75640a8b10 con 0x7f75700c8d00 2023-06-10T18:53:00.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.384+0000 7f756d59a640 1 -- 172.21.15.53:0/916658240 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75640a8ea0 con 0x7f75700c8d00 2023-06-10T18:53:00.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.384+0000 7f7574a41640 1 -- 172.21.15.53:0/916658240 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f75700c8d00 msgr2=0x7f757006b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:00.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.384+0000 7f7574a41640 1 --2- 172.21.15.53:0/916658240 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f75700c8d00 0x7f757006b6c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7564009870 tx=0x7f756401ecf0 comp rx=0 tx=0).stop 2023-06-10T18:53:00.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.384+0000 7f7574a41640 1 -- 172.21.15.53:0/916658240 shutdown_connections 2023-06-10T18:53:00.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.384+0000 7f7574a41640 1 --2- 172.21.15.53:0/916658240 >> v2:172.21.15.117:3300/0 conn(0x7f757006bc00 0x7f75700cbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:00.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.384+0000 7f7574a41640 1 --2- 172.21.15.53:0/916658240 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f75700c8d00 0x7f757006b6c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:00.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.384+0000 7f7574a41640 1 --2- 172.21.15.53:0/916658240 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f757006b2f0 0x7f757006f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:00.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.384+0000 7f7574a41640 1 -- 172.21.15.53:0/916658240 >> 172.21.15.53:0/916658240 conn(0x7f757006a0d0 msgr2=0x7f75700ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:00.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.384+0000 7f7574a41640 1 -- 172.21.15.53:0/916658240 shutdown_connections 2023-06-10T18:53:00.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.384+0000 7f7574a41640 1 -- 172.21.15.53:0/916658240 wait complete. 2023-06-10T18:53:00.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.384+0000 7f7574a41640 1 Processor -- start 2023-06-10T18:53:00.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.384+0000 7f7574a41640 1 -- start start 2023-06-10T18:53:00.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.384+0000 7f7574a41640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f757006b2f0 0x7f757014f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:00.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.384+0000 7f7574a41640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f757006bc00 0x7f75700c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:00.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.384+0000 7f7574a41640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75700c8d00 0x7f75700c2de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:00.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.384+0000 7f7574a41640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7570150980 con 0x7f757006bc00 2023-06-10T18:53:00.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.384+0000 7f7574a41640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75700c3b60 con 0x7f75700c8d00 2023-06-10T18:53:00.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.384+0000 7f7574a41640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75700c3e40 con 0x7f757006b2f0 2023-06-10T18:53:00.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.384+0000 7f756dd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f757006bc00 0x7f75700c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:00.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.384+0000 7f756dd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f757006bc00 0x7f75700c7fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35496/0 (socket says 172.21.15.53:35496) 2023-06-10T18:53:00.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.384+0000 7f756dd9b640 1 -- 172.21.15.53:0/2147280677 learned_addr learned my addr 172.21.15.53:0/2147280677 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:00.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.384+0000 7f756ed9d640 1 --2- 172.21.15.53:0/2147280677 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75700c8d00 0x7f75700c2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:00.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.384+0000 7f756e59c640 1 --2- 172.21.15.53:0/2147280677 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f757006b2f0 0x7f757014f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:00.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.384+0000 7f756dd9b640 1 -- 172.21.15.53:0/2147280677 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f757006b2f0 msgr2=0x7f757014f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:00.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.384+0000 7f756dd9b640 1 --2- 172.21.15.53:0/2147280677 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f757006b2f0 0x7f757014f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:00.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.384+0000 7f756dd9b640 1 -- 172.21.15.53:0/2147280677 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75700c8d00 msgr2=0x7f75700c2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:00.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.384+0000 7f756dd9b640 1 --2- 172.21.15.53:0/2147280677 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75700c8d00 0x7f75700c2de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:00.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.384+0000 7f756dd9b640 1 -- 172.21.15.53:0/2147280677 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75640094d0 con 0x7f757006bc00 2023-06-10T18:53:00.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.384+0000 7f756dd9b640 1 --2- 172.21.15.53:0/2147280677 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f757006bc00 0x7f75700c7fb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f75640b3040 tx=0x7f756401ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:00.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.384+0000 7f755effd640 1 -- 172.21.15.53:0/2147280677 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75640be070 con 0x7f757006bc00 2023-06-10T18:53:00.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.384+0000 7f755effd640 1 -- 172.21.15.53:0/2147280677 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75640ba400 con 0x7f757006bc00 2023-06-10T18:53:00.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.384+0000 7f7574a41640 1 -- 172.21.15.53:0/2147280677 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75700c4120 con 0x7f757006bc00 2023-06-10T18:53:00.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.384+0000 7f755effd640 1 -- 172.21.15.53:0/2147280677 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75640ba7b0 con 0x7f757006bc00 2023-06-10T18:53:00.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.384+0000 7f7574a41640 1 -- 172.21.15.53:0/2147280677 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f757014fbb0 con 0x7f757006bc00 2023-06-10T18:53:00.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.388+0000 7f7574a41640 1 -- 172.21.15.53:0/2147280677 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f757004d790 con 0x7f757006bc00 2023-06-10T18:53:00.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.388+0000 7f755effd640 1 -- 172.21.15.53:0/2147280677 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f75640ba910 con 0x7f757006bc00 2023-06-10T18:53:00.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.388+0000 7f755effd640 1 --2- 172.21.15.53:0/2147280677 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f75500662b0 0x7f7550068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:00.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.388+0000 7f755effd640 1 -- 172.21.15.53:0/2147280677 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f75641228a0 con 0x7f757006bc00 2023-06-10T18:53:00.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.388+0000 7f756e59c640 1 --2- 172.21.15.53:0/2147280677 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f75500662b0 0x7f7550068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:00.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.388+0000 7f756e59c640 1 --2- 172.21.15.53:0/2147280677 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f75500662b0 0x7f7550068760 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7560008d40 tx=0x7f7560008290 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:00.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.392+0000 7f755effd640 1 -- 172.21.15.53:0/2147280677 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f75640efe90 con 0x7f757006bc00 2023-06-10T18:53:00.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.540+0000 7f7574a41640 1 -- 172.21.15.53:0/2147280677 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7570150da0 con 0x7f757006bc00 2023-06-10T18:53:00.551 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.540+0000 7f755effd640 1 -- 172.21.15.53:0/2147280677 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18267 (secure 0 0 0) 0x7f7564120e60 con 0x7f757006bc00 2023-06-10T18:53:00.551 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:53:00.552 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":23,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T18:52:45.921586+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-10T18:52:43.396243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-10T18:52:43.894228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T18:53:00.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.544+0000 7f7574a41640 1 -- 172.21.15.53:0/2147280677 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f75500662b0 msgr2=0x7f7550068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:00.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.544+0000 7f7574a41640 1 --2- 172.21.15.53:0/2147280677 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f75500662b0 0x7f7550068760 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7560008d40 tx=0x7f7560008290 comp rx=0 tx=0).stop 2023-06-10T18:53:00.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.544+0000 7f7574a41640 1 -- 172.21.15.53:0/2147280677 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f757006bc00 msgr2=0x7f75700c7fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:00.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.544+0000 7f7574a41640 1 --2- 172.21.15.53:0/2147280677 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f757006bc00 0x7f75700c7fb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f75640b3040 tx=0x7f756401ba90 comp rx=0 tx=0).stop 2023-06-10T18:53:00.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.544+0000 7f7574a41640 1 -- 172.21.15.53:0/2147280677 shutdown_connections 2023-06-10T18:53:00.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.544+0000 7f7574a41640 1 --2- 172.21.15.53:0/2147280677 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f75500662b0 0x7f7550068760 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:00.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.544+0000 7f7574a41640 1 --2- 172.21.15.53:0/2147280677 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75700c8d00 0x7f75700c2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:00.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.544+0000 7f7574a41640 1 --2- 172.21.15.53:0/2147280677 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f757006bc00 0x7f75700c7fb0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:00.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.544+0000 7f7574a41640 1 --2- 172.21.15.53:0/2147280677 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f757006b2f0 0x7f757014f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:00.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.544+0000 7f7574a41640 1 -- 172.21.15.53:0/2147280677 >> 172.21.15.53:0/2147280677 conn(0x7f757006a0d0 msgr2=0x7f75700ae1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:00.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.544+0000 7f7574a41640 1 -- 172.21.15.53:0/2147280677 shutdown_connections 2023-06-10T18:53:00.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.544+0000 7f7574a41640 1 -- 172.21.15.53:0/2147280677 wait complete. 2023-06-10T18:53:00.570 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-10T18:52:33.633114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-10T18:52:39.171487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-10T18:52:43.396243+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-10T18:52:43.894228+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-10T18:53:00.571 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-10T18:53:00.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.676+0000 7fc85e352640 1 Processor -- start 2023-06-10T18:53:00.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.676+0000 7fc85e352640 1 -- start start 2023-06-10T18:53:00.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.676+0000 7fc85e352640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc8580c9fa0 0x7fc85806bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:00.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.676+0000 7fc85e352640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8580af760 0x7fc8580afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:00.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.676+0000 7fc85e352640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc85806b090 con 0x7fc85806c020 2023-06-10T18:53:00.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.676+0000 7fc85e352640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8580b0120 con 0x7fc8580c9fa0 2023-06-10T18:53:00.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.676+0000 7fc85e352640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8580ca370 con 0x7fc8580af760 2023-06-10T18:53:00.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.676+0000 7fc8577fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fc85806c020 0x7fc8580c82a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:36140/0 (socket says 172.21.15.53:36140) 2023-06-10T18:53:00.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.676+0000 7fc8577fe640 1 -- 172.21.15.53:0/1770097303 learned_addr learned my addr 172.21.15.53:0/1770097303 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:53:00.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.676+0000 7fc857fff640 1 --2- 172.21.15.53:0/1770097303 >> v2:172.21.15.53:3300/0 conn(0x7fc8580c9fa0 0x7fc85806bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:00.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.676+0000 7fc85c8ef640 1 --2- 172.21.15.53:0/1770097303 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8580af760 0x7fc8580afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:00.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.676+0000 7fc856ffd640 1 -- 172.21.15.53:0/1770097303 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2275256545 0 0) 0x7fc85806b090 con 0x7fc85806c020 2023-06-10T18:53:00.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.676+0000 7fc856ffd640 1 -- 172.21.15.53:0/1770097303 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc840003530 con 0x7fc85806c020 2023-06-10T18:53:00.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.676+0000 7fc856ffd640 1 -- 172.21.15.53:0/1770097303 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2762463871 0 0) 0x7fc840003530 con 0x7fc85806c020 2023-06-10T18:53:00.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.676+0000 7fc857fff640 1 -- 172.21.15.53:0/1770097303 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8580af760 msgr2=0x7fc8580afbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:00.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.676+0000 7fc857fff640 1 --2- 172.21.15.53:0/1770097303 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8580af760 0x7fc8580afbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:00.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.676+0000 7fc857fff640 1 -- 172.21.15.53:0/1770097303 >> v1:172.21.15.53:6789/0 conn(0x7fc85806c020 legacy=0x7fc8580c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:00.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.676+0000 7fc857fff640 1 -- 172.21.15.53:0/1770097303 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc858070d50 con 0x7fc8580c9fa0 2023-06-10T18:53:00.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.680+0000 7fc857fff640 1 --2- 172.21.15.53:0/1770097303 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8580c9fa0 0x7fc85806bae0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc8480097c0 tx=0x7fc84801c2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcfbebba0a7520ce server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:00.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.680+0000 7fc856ffd640 1 -- 172.21.15.53:0/1770097303 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc84c001680 con 0x7fc8580c9fa0 2023-06-10T18:53:00.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.680+0000 7fc856ffd640 1 -- 172.21.15.53:0/1770097303 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8480a7050 con 0x7fc8580c9fa0 2023-06-10T18:53:00.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.680+0000 7fc856ffd640 1 -- 172.21.15.53:0/1770097303 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8480ab620 con 0x7fc8580c9fa0 2023-06-10T18:53:00.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.680+0000 7fc85e352640 1 -- 172.21.15.53:0/1770097303 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8580c9fa0 msgr2=0x7fc85806bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:00.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.680+0000 7fc85e352640 1 --2- 172.21.15.53:0/1770097303 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8580c9fa0 0x7fc85806bae0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc8480097c0 tx=0x7fc84801c2e0 comp rx=0 tx=0).stop 2023-06-10T18:53:00.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.680+0000 7fc85e352640 1 -- 172.21.15.53:0/1770097303 shutdown_connections 2023-06-10T18:53:00.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.680+0000 7fc85e352640 1 --2- 172.21.15.53:0/1770097303 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8580af760 0x7fc8580afbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:00.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.680+0000 7fc85e352640 1 --2- 172.21.15.53:0/1770097303 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8580c9fa0 0x7fc85806bae0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:00.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.680+0000 7fc85e352640 1 -- 172.21.15.53:0/1770097303 >> 172.21.15.53:0/1770097303 conn(0x7fc85806a0e0 msgr2=0x7fc8580cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:00.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.680+0000 7fc85e352640 1 -- 172.21.15.53:0/1770097303 shutdown_connections 2023-06-10T18:53:00.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.680+0000 7fc85e352640 1 -- 172.21.15.53:0/1770097303 wait complete. 2023-06-10T18:53:00.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.680+0000 7fc85e352640 1 Processor -- start 2023-06-10T18:53:00.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.680+0000 7fc85e352640 1 -- start start 2023-06-10T18:53:00.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.680+0000 7fc85e352640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc85806c020 0x7fc858156cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:00.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.680+0000 7fc85e352640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8580af760 0x7fc8580c3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:00.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.680+0000 7fc85e352640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8580c9fa0 0x7fc8580c3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:00.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.680+0000 7fc85e352640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc858157230 con 0x7fc8580c9fa0 2023-06-10T18:53:00.693 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.680+0000 7fc85e352640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8580a7450 con 0x7fc85806c020 2023-06-10T18:53:00.693 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.680+0000 7fc85e352640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8581f5e20 con 0x7fc8580af760 2023-06-10T18:53:00.693 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.680+0000 7fc85c8ef640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8580c9fa0 0x7fc8580c3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:00.693 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.680+0000 7fc85c8ef640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8580c9fa0 0x7fc8580c3e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35514/0 (socket says 172.21.15.53:35514) 2023-06-10T18:53:00.693 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.680+0000 7fc85c8ef640 1 -- 172.21.15.53:0/3089506797 learned_addr learned my addr 172.21.15.53:0/3089506797 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:00.693 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.680+0000 7fc8577fe640 1 --2- 172.21.15.53:0/3089506797 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8580af760 0x7fc8580c3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:00.693 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.680+0000 7fc857fff640 1 --2- 172.21.15.53:0/3089506797 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc85806c020 0x7fc858156cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:00.693 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.680+0000 7fc85c8ef640 1 -- 172.21.15.53:0/3089506797 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8580af760 msgr2=0x7fc8580c3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:00.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.680+0000 7fc85c8ef640 1 --2- 172.21.15.53:0/3089506797 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8580af760 0x7fc8580c3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:00.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.680+0000 7fc85c8ef640 1 -- 172.21.15.53:0/3089506797 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc85806c020 msgr2=0x7fc858156cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:00.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.680+0000 7fc85c8ef640 1 --2- 172.21.15.53:0/3089506797 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc85806c020 0x7fc858156cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:00.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.680+0000 7fc85c8ef640 1 -- 172.21.15.53:0/3089506797 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc848009420 con 0x7fc8580c9fa0 2023-06-10T18:53:00.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.680+0000 7fc8577fe640 1 --2- 172.21.15.53:0/3089506797 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8580af760 0x7fc8580c3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:00.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.680+0000 7fc85c8ef640 1 --2- 172.21.15.53:0/3089506797 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8580c9fa0 0x7fc8580c3e70 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc85000efc0 tx=0x7fc85000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:00.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.680+0000 7fc854ff9640 1 -- 172.21.15.53:0/3089506797 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc850014480 con 0x7fc8580c9fa0 2023-06-10T18:53:00.695 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.680+0000 7fc854ff9640 1 -- 172.21.15.53:0/3089506797 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc85000f040 con 0x7fc8580c9fa0 2023-06-10T18:53:00.695 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.680+0000 7fc854ff9640 1 -- 172.21.15.53:0/3089506797 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc850014820 con 0x7fc8580c9fa0 2023-06-10T18:53:00.695 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.680+0000 7fc85e352640 1 -- 172.21.15.53:0/3089506797 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8580a7660 con 0x7fc8580c9fa0 2023-06-10T18:53:00.695 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.680+0000 7fc85e352640 1 -- 172.21.15.53:0/3089506797 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8580a7c20 con 0x7fc8580c9fa0 2023-06-10T18:53:00.696 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.684+0000 7fc85e352640 1 -- 172.21.15.53:0/3089506797 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc85804d790 con 0x7fc8580c9fa0 2023-06-10T18:53:00.696 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.684+0000 7fc854ff9640 1 -- 172.21.15.53:0/3089506797 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc850014980 con 0x7fc8580c9fa0 2023-06-10T18:53:00.696 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.684+0000 7fc854ff9640 1 --2- 172.21.15.53:0/3089506797 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc844066280 0x7fc844068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:00.696 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.684+0000 7fc854ff9640 1 -- 172.21.15.53:0/3089506797 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc850084980 con 0x7fc8580c9fa0 2023-06-10T18:53:00.696 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.684+0000 7fc857fff640 1 --2- 172.21.15.53:0/3089506797 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc844066280 0x7fc844068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:00.697 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.684+0000 7fc857fff640 1 --2- 172.21.15.53:0/3089506797 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc844066280 0x7fc844068730 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc8480ad000 tx=0x7fc848008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:00.697 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.688+0000 7fc854ff9640 1 -- 172.21.15.53:0/3089506797 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc850051d60 con 0x7fc8580c9fa0 2023-06-10T18:53:00.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.836+0000 7fc85e352640 1 -- 172.21.15.53:0/3089506797 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc8580ce670 con 0x7fc8580c9fa0 2023-06-10T18:53:00.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.836+0000 7fc854ff9640 1 -- 172.21.15.53:0/3089506797 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc850018020 con 0x7fc8580c9fa0 2023-06-10T18:53:00.845 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-06-10T18:53:00.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.836+0000 7fc85e352640 1 -- 172.21.15.53:0/3089506797 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc844066280 msgr2=0x7fc844068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:00.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.836+0000 7fc85e352640 1 --2- 172.21.15.53:0/3089506797 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc844066280 0x7fc844068730 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc8480ad000 tx=0x7fc848008040 comp rx=0 tx=0).stop 2023-06-10T18:53:00.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.836+0000 7fc85e352640 1 -- 172.21.15.53:0/3089506797 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8580c9fa0 msgr2=0x7fc8580c3e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:00.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.836+0000 7fc85e352640 1 --2- 172.21.15.53:0/3089506797 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8580c9fa0 0x7fc8580c3e70 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc85000efc0 tx=0x7fc85000c490 comp rx=0 tx=0).stop 2023-06-10T18:53:00.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.836+0000 7fc85e352640 1 -- 172.21.15.53:0/3089506797 shutdown_connections 2023-06-10T18:53:00.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.836+0000 7fc85e352640 1 --2- 172.21.15.53:0/3089506797 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc844066280 0x7fc844068730 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:00.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.836+0000 7fc85e352640 1 --2- 172.21.15.53:0/3089506797 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8580c9fa0 0x7fc8580c3e70 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:00.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.836+0000 7fc85e352640 1 --2- 172.21.15.53:0/3089506797 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8580af760 0x7fc8580c3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:00.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.836+0000 7fc85e352640 1 --2- 172.21.15.53:0/3089506797 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc85806c020 0x7fc858156cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:00.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.836+0000 7fc85e352640 1 -- 172.21.15.53:0/3089506797 >> 172.21.15.53:0/3089506797 conn(0x7fc85806a0e0 msgr2=0x7fc8580b1260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:00.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.836+0000 7fc85e352640 1 -- 172.21.15.53:0/3089506797 shutdown_connections 2023-06-10T18:53:00.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.836+0000 7fc85e352640 1 -- 172.21.15.53:0/3089506797 wait complete. 2023-06-10T18:53:00.862 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-10T18:53:00.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.964+0000 7f873106b640 1 Processor -- start 2023-06-10T18:53:00.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.964+0000 7f873106b640 1 -- start start 2023-06-10T18:53:00.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.964+0000 7f873106b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f872c15c090 0x7f872c0b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:00.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.964+0000 7f873106b640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f872c0cc7c0 con 0x7f872c0b0b90 2023-06-10T18:53:00.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.964+0000 7f873106b640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f872c0ccaa0 con 0x7f872c0b7e30 2023-06-10T18:53:00.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.964+0000 7f873106b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f872c0ccd80 con 0x7f872c15c090 2023-06-10T18:53:00.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.964+0000 7f872a59c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f872c0b0b90 0x7f872c0b7720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:36154/0 (socket says 172.21.15.53:36154) 2023-06-10T18:53:00.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.964+0000 7f872a59c640 1 -- 172.21.15.53:0/2841689244 learned_addr learned my addr 172.21.15.53:0/2841689244 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:53:00.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.964+0000 7f872ad9d640 1 --2- 172.21.15.53:0/2841689244 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f872c15c090 0x7f872c0b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:00.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.964+0000 7f8729d9b640 1 -- 172.21.15.53:0/2841689244 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2225018582 0 0) 0x7f872c0cc7c0 con 0x7f872c0b0b90 2023-06-10T18:53:00.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.964+0000 7f8729d9b640 1 -- 172.21.15.53:0/2841689244 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8714003530 con 0x7f872c0b0b90 2023-06-10T18:53:00.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.964+0000 7f8729d9b640 1 -- 172.21.15.53:0/2841689244 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3871494156 0 0) 0x7f8714003530 con 0x7f872c0b0b90 2023-06-10T18:53:00.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.964+0000 7f8729d9b640 1 -- 172.21.15.53:0/2841689244 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f872c15c090 msgr2=0x7f872c0b10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:00.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.964+0000 7f8729d9b640 1 --2- 172.21.15.53:0/2841689244 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f872c15c090 0x7f872c0b10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:00.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.964+0000 7f8729d9b640 1 -- 172.21.15.53:0/2841689244 >> v1:172.21.15.117:6789/0 conn(0x7f872c0b7e30 legacy=0x7f872c0d04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:00.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.964+0000 7f8729d9b640 1 -- 172.21.15.53:0/2841689244 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f872c0cd060 con 0x7f872c0b0b90 2023-06-10T18:53:00.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.964+0000 7f8729d9b640 1 -- 172.21.15.53:0/2841689244 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f8720001680 con 0x7f872c0b0b90 2023-06-10T18:53:00.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.964+0000 7f8729d9b640 1 -- 172.21.15.53:0/2841689244 >> v1:172.21.15.53:6789/0 conn(0x7f872c0b0b90 legacy=0x7f872c0b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:00.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.964+0000 7f8729d9b640 1 --2- 172.21.15.53:0/2841689244 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87140039b0 0x7f8714003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:00.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.964+0000 7f8729d9b640 1 --2- 172.21.15.53:0/2841689244 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f872c15c090 0x7f87140047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:00.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.964+0000 7f8729d9b640 1 --2- 172.21.15.53:0/2841689244 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8714004d10 0x7f8714005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:00.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.964+0000 7f8729d9b640 1 -- 172.21.15.53:0/2841689244 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f872c0ccd80 con 0x7f87140039b0 2023-06-10T18:53:00.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.964+0000 7f8729d9b640 1 -- 172.21.15.53:0/2841689244 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f871400bb20 con 0x7f8714004d10 2023-06-10T18:53:00.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.964+0000 7f8729d9b640 1 -- 172.21.15.53:0/2841689244 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f871400bcb0 con 0x7f872c15c090 2023-06-10T18:53:00.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.964+0000 7f872ad9d640 1 --2- 172.21.15.53:0/2841689244 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87140039b0 0x7f8714003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:00.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.964+0000 7f872ad9d640 1 -- 172.21.15.53:0/2841689244 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f872c15c090 msgr2=0x7f87140047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:00.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.964+0000 7f872ad9d640 1 --2- 172.21.15.53:0/2841689244 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f872c15c090 0x7f87140047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:00.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.964+0000 7f872ad9d640 1 -- 172.21.15.53:0/2841689244 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8714004d10 msgr2=0x7f8714005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:00.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.964+0000 7f872b59e640 1 --2- 172.21.15.53:0/2841689244 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8714004d10 0x7f8714005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:00.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.964+0000 7f872ad9d640 1 --2- 172.21.15.53:0/2841689244 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8714004d10 0x7f8714005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:00.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.964+0000 7f872ad9d640 1 -- 172.21.15.53:0/2841689244 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8714003530 con 0x7f87140039b0 2023-06-10T18:53:00.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.968+0000 7f872ad9d640 1 --2- 172.21.15.53:0/2841689244 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87140039b0 0x7f8714003dc0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f871c009ae0 tx=0x7f871c01ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b7c2adbbbd3b7e9 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:00.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.968+0000 7f8729d9b640 1 -- 172.21.15.53:0/2841689244 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871c0a5540 con 0x7f87140039b0 2023-06-10T18:53:00.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.968+0000 7f8729d9b640 1 -- 172.21.15.53:0/2841689244 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f871c0a56a0 con 0x7f87140039b0 2023-06-10T18:53:00.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.968+0000 7f8729d9b640 1 -- 172.21.15.53:0/2841689244 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871c0a5a50 con 0x7f87140039b0 2023-06-10T18:53:00.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.968+0000 7f873106b640 1 -- 172.21.15.53:0/2841689244 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87140039b0 msgr2=0x7f8714003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:00.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.968+0000 7f873106b640 1 --2- 172.21.15.53:0/2841689244 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87140039b0 0x7f8714003dc0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f871c009ae0 tx=0x7f871c01ca60 comp rx=0 tx=0).stop 2023-06-10T18:53:00.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.968+0000 7f872b59e640 1 -- 172.21.15.53:0/2841689244 reap_dead start 2023-06-10T18:53:00.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.968+0000 7f873106b640 1 -- 172.21.15.53:0/2841689244 shutdown_connections 2023-06-10T18:53:00.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.968+0000 7f873106b640 1 -- 172.21.15.53:0/2841689244 >> 172.21.15.53:0/2841689244 conn(0x7f872c069e20 msgr2=0x7f872c06a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:00.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.968+0000 7f873106b640 1 -- 172.21.15.53:0/2841689244 shutdown_connections 2023-06-10T18:53:00.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.968+0000 7f873106b640 1 -- 172.21.15.53:0/2841689244 wait complete. 2023-06-10T18:53:00.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.968+0000 7f873106b640 1 Processor -- start 2023-06-10T18:53:00.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.968+0000 7f873106b640 1 -- start start 2023-06-10T18:53:00.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.968+0000 7f873106b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87140039b0 0x7f872c0b36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:00.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.968+0000 7f873106b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f872c1f4400 0x7f872c0b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:00.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.968+0000 7f873106b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f872c15ad90 0x7f872c15b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:00.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.968+0000 7f873106b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f872c15cad0 con 0x7f872c15ad90 2023-06-10T18:53:00.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.968+0000 7f873106b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f872c0b4ae0 con 0x7f872c1f4400 2023-06-10T18:53:00.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.968+0000 7f873106b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f872c0c89d0 con 0x7f87140039b0 2023-06-10T18:53:00.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.968+0000 7f872b59e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f872c15ad90 0x7f872c15b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:00.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.968+0000 7f872b59e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f872c15ad90 0x7f872c15b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35536/0 (socket says 172.21.15.53:35536) 2023-06-10T18:53:00.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.968+0000 7f872b59e640 1 -- 172.21.15.53:0/2964354235 learned_addr learned my addr 172.21.15.53:0/2964354235 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:00.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.968+0000 7f872a59c640 1 --2- 172.21.15.53:0/2964354235 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f872c1f4400 0x7f872c0b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:00.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.968+0000 7f872ad9d640 1 --2- 172.21.15.53:0/2964354235 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87140039b0 0x7f872c0b36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:00.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.968+0000 7f872b59e640 1 -- 172.21.15.53:0/2964354235 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87140039b0 msgr2=0x7f872c0b36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:00.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.968+0000 7f872b59e640 1 --2- 172.21.15.53:0/2964354235 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87140039b0 0x7f872c0b36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:00.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.968+0000 7f872b59e640 1 -- 172.21.15.53:0/2964354235 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f872c1f4400 msgr2=0x7f872c0b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:00.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.968+0000 7f872b59e640 1 --2- 172.21.15.53:0/2964354235 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f872c1f4400 0x7f872c0b3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:00.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.968+0000 7f872b59e640 1 -- 172.21.15.53:0/2964354235 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f872c15b740 con 0x7f872c15ad90 2023-06-10T18:53:00.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.968+0000 7f872b59e640 1 --2- 172.21.15.53:0/2964354235 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f872c15ad90 0x7f872c15b200 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f87240012f0 tx=0x7f872400d830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:00.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.968+0000 7f87137fe640 1 -- 172.21.15.53:0/2964354235 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8724003980 con 0x7f872c15ad90 2023-06-10T18:53:00.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.968+0000 7f87137fe640 1 -- 172.21.15.53:0/2964354235 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8724003b00 con 0x7f872c15ad90 2023-06-10T18:53:00.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.968+0000 7f873106b640 1 -- 172.21.15.53:0/2964354235 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f872c0b4240 con 0x7f872c15ad90 2023-06-10T18:53:00.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.968+0000 7f87137fe640 1 -- 172.21.15.53:0/2964354235 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87240050d0 con 0x7f872c15ad90 2023-06-10T18:53:00.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.968+0000 7f873106b640 1 -- 172.21.15.53:0/2964354235 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f872c0b4800 con 0x7f872c15ad90 2023-06-10T18:53:00.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.972+0000 7f873106b640 1 -- 172.21.15.53:0/2964354235 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f872c04d790 con 0x7f872c15ad90 2023-06-10T18:53:00.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.972+0000 7f87137fe640 1 -- 172.21.15.53:0/2964354235 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8724005230 con 0x7f872c15ad90 2023-06-10T18:53:00.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.972+0000 7f87137fe640 1 --2- 172.21.15.53:0/2964354235 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8718066280 0x7f8718068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:00.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.972+0000 7f87137fe640 1 -- 172.21.15.53:0/2964354235 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8724082a70 con 0x7f872c15ad90 2023-06-10T18:53:00.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.972+0000 7f872ad9d640 1 --2- 172.21.15.53:0/2964354235 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8718066280 0x7f8718068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:00.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.972+0000 7f872ad9d640 1 --2- 172.21.15.53:0/2964354235 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8718066280 0x7f8718068730 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f871c0af000 tx=0x7f871c0046d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:00.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:00.976+0000 7f87137fe640 1 -- 172.21.15.53:0/2964354235 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f872404fe50 con 0x7f872c15ad90 2023-06-10T18:53:01.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.128+0000 7f873106b640 1 -- 172.21.15.53:0/2964354235 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f872c15c8a0 con 0x7f872c15ad90 2023-06-10T18:53:01.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.128+0000 7f87137fe640 1 -- 172.21.15.53:0/2964354235 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8724053470 con 0x7f872c15ad90 2023-06-10T18:53:01.139 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-06-10T18:53:01.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.132+0000 7f873106b640 1 -- 172.21.15.53:0/2964354235 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8718066280 msgr2=0x7f8718068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:01.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.132+0000 7f873106b640 1 --2- 172.21.15.53:0/2964354235 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8718066280 0x7f8718068730 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f871c0af000 tx=0x7f871c0046d0 comp rx=0 tx=0).stop 2023-06-10T18:53:01.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.132+0000 7f873106b640 1 -- 172.21.15.53:0/2964354235 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f872c15ad90 msgr2=0x7f872c15b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:01.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.132+0000 7f873106b640 1 --2- 172.21.15.53:0/2964354235 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f872c15ad90 0x7f872c15b200 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f87240012f0 tx=0x7f872400d830 comp rx=0 tx=0).stop 2023-06-10T18:53:01.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.132+0000 7f873106b640 1 -- 172.21.15.53:0/2964354235 shutdown_connections 2023-06-10T18:53:01.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.132+0000 7f873106b640 1 --2- 172.21.15.53:0/2964354235 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8718066280 0x7f8718068730 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:01.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.132+0000 7f873106b640 1 --2- 172.21.15.53:0/2964354235 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f872c15ad90 0x7f872c15b200 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:01.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.132+0000 7f873106b640 1 --2- 172.21.15.53:0/2964354235 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f872c1f4400 0x7f872c0b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:01.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.132+0000 7f873106b640 1 --2- 172.21.15.53:0/2964354235 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87140039b0 0x7f872c0b36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:01.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.132+0000 7f873106b640 1 -- 172.21.15.53:0/2964354235 >> 172.21.15.53:0/2964354235 conn(0x7f872c069e20 msgr2=0x7f872c06a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:01.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.132+0000 7f873106b640 1 -- 172.21.15.53:0/2964354235 shutdown_connections 2023-06-10T18:53:01.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.132+0000 7f873106b640 1 -- 172.21.15.53:0/2964354235 wait complete. 2023-06-10T18:53:01.157 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-10T18:53:01.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.264+0000 7f677944b640 1 Processor -- start 2023-06-10T18:53:01.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.264+0000 7f677944b640 1 -- start start 2023-06-10T18:53:01.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.264+0000 7f677944b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f67740c9fa0 0x7f677406bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:01.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.264+0000 7f677944b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f677406c020 0x7f67740c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:01.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.264+0000 7f677944b640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f677406b090 con 0x7f67740c87e0 2023-06-10T18:53:01.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.264+0000 7f677944b640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67740ca370 con 0x7f67740c9fa0 2023-06-10T18:53:01.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.264+0000 7f677944b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6774070d50 con 0x7f677406c020 2023-06-10T18:53:01.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.264+0000 7f6772ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f67740c9fa0 0x7f677406bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:01.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.264+0000 7f67737fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f67740c87e0 0x7f67740af760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:43090/0 (socket says 172.21.15.53:43090) 2023-06-10T18:53:01.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.264+0000 7f67737fe640 1 -- 172.21.15.53:0/3338228823 learned_addr learned my addr 172.21.15.53:0/3338228823 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:53:01.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.264+0000 7f67727fc640 1 --2- 172.21.15.53:0/3338228823 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f677406c020 0x7f67740c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:01.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.264+0000 7f6772ffd640 1 -- 172.21.15.53:0/3338228823 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f677406c020 msgr2=0x7f67740c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:01.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.264+0000 7f6772ffd640 1 --2- 172.21.15.53:0/3338228823 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f677406c020 0x7f67740c82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:01.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.264+0000 7f6772ffd640 1 -- 172.21.15.53:0/3338228823 >> v1:172.21.15.53:6789/0 conn(0x7f67740c87e0 legacy=0x7f67740af760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:01.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.264+0000 7f6772ffd640 1 -- 172.21.15.53:0/3338228823 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6774071030 con 0x7f67740c9fa0 2023-06-10T18:53:01.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.264+0000 7f6771ffb640 1 -- 172.21.15.53:0/3338228823 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1989994932 0 0) 0x7f677406b090 con 0x7f67740c87e0 2023-06-10T18:53:01.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.264+0000 7f67727fc640 1 --2- 172.21.15.53:0/3338228823 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f677406c020 0x7f67740c82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:01.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.268+0000 7f6772ffd640 1 --2- 172.21.15.53:0/3338228823 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67740c9fa0 0x7f677406bae0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f67640097c0 tx=0x7f676401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db8a929f5f19724a server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:01.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.268+0000 7f6771ffb640 1 -- 172.21.15.53:0/3338228823 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67640ab600 con 0x7f67740c9fa0 2023-06-10T18:53:01.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.268+0000 7f6771ffb640 1 -- 172.21.15.53:0/3338228823 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67640a7050 con 0x7f67740c9fa0 2023-06-10T18:53:01.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.268+0000 7f6771ffb640 1 -- 172.21.15.53:0/3338228823 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67640ab980 con 0x7f67740c9fa0 2023-06-10T18:53:01.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.268+0000 7f677944b640 1 -- 172.21.15.53:0/3338228823 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67740c9fa0 msgr2=0x7f677406bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:01.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.268+0000 7f677944b640 1 --2- 172.21.15.53:0/3338228823 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67740c9fa0 0x7f677406bae0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f67640097c0 tx=0x7f676401c3c0 comp rx=0 tx=0).stop 2023-06-10T18:53:01.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.268+0000 7f677944b640 1 -- 172.21.15.53:0/3338228823 shutdown_connections 2023-06-10T18:53:01.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.268+0000 7f677944b640 1 --2- 172.21.15.53:0/3338228823 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f677406c020 0x7f67740c82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:01.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.268+0000 7f677944b640 1 --2- 172.21.15.53:0/3338228823 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67740c9fa0 0x7f677406bae0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:01.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.268+0000 7f677944b640 1 -- 172.21.15.53:0/3338228823 >> 172.21.15.53:0/3338228823 conn(0x7f677406a0e0 msgr2=0x7f67740cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:01.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.268+0000 7f677944b640 1 -- 172.21.15.53:0/3338228823 shutdown_connections 2023-06-10T18:53:01.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.268+0000 7f677944b640 1 -- 172.21.15.53:0/3338228823 wait complete. 2023-06-10T18:53:01.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.268+0000 7f677944b640 1 Processor -- start 2023-06-10T18:53:01.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.268+0000 7f677944b640 1 -- start start 2023-06-10T18:53:01.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.268+0000 7f677944b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f677406c020 0x7f6774142a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:01.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.268+0000 7f677944b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67740c87e0 0x7f677415bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:01.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.268+0000 7f677944b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67740c9fa0 0x7f6774155b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:01.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.268+0000 7f677944b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f677415c840 con 0x7f677406c020 2023-06-10T18:53:01.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.268+0000 7f677944b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67740c54a0 con 0x7f67740c87e0 2023-06-10T18:53:01.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.268+0000 7f677944b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6774142f80 con 0x7f67740c9fa0 2023-06-10T18:53:01.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.268+0000 7f6772ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f677406c020 0x7f6774142a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:01.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.268+0000 7f6772ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f677406c020 0x7f6774142a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56712/0 (socket says 172.21.15.53:56712) 2023-06-10T18:53:01.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.268+0000 7f6772ffd640 1 -- 172.21.15.53:0/111675610 learned_addr learned my addr 172.21.15.53:0/111675610 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:01.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.268+0000 7f67737fe640 1 --2- 172.21.15.53:0/111675610 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67740c9fa0 0x7f6774155b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:01.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.268+0000 7f67727fc640 1 --2- 172.21.15.53:0/111675610 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67740c87e0 0x7f677415bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:01.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.272+0000 7f6772ffd640 1 -- 172.21.15.53:0/111675610 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67740c9fa0 msgr2=0x7f6774155b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:01.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.272+0000 7f6772ffd640 1 --2- 172.21.15.53:0/111675610 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67740c9fa0 0x7f6774155b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:01.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.272+0000 7f6772ffd640 1 -- 172.21.15.53:0/111675610 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67740c87e0 msgr2=0x7f677415bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:01.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.272+0000 7f6772ffd640 1 --2- 172.21.15.53:0/111675610 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67740c87e0 0x7f677415bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:01.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.272+0000 7f6772ffd640 1 -- 172.21.15.53:0/111675610 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6764009420 con 0x7f677406c020 2023-06-10T18:53:01.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.272+0000 7f6772ffd640 1 --2- 172.21.15.53:0/111675610 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f677406c020 0x7f6774142a40 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f67640097c0 tx=0x7f676401ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:01.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.272+0000 7f675b7fe640 1 -- 172.21.15.53:0/111675610 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6764004230 con 0x7f677406c020 2023-06-10T18:53:01.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.272+0000 7f675b7fe640 1 -- 172.21.15.53:0/111675610 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6764004390 con 0x7f677406c020 2023-06-10T18:53:01.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.272+0000 7f677944b640 1 -- 172.21.15.53:0/111675610 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f677415c560 con 0x7f677406c020 2023-06-10T18:53:01.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.272+0000 7f675b7fe640 1 -- 172.21.15.53:0/111675610 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6764003820 con 0x7f677406c020 2023-06-10T18:53:01.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.272+0000 7f677944b640 1 -- 172.21.15.53:0/111675610 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67740c5130 con 0x7f677406c020 2023-06-10T18:53:01.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.272+0000 7f677944b640 1 -- 172.21.15.53:0/111675610 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f677404d790 con 0x7f677406c020 2023-06-10T18:53:01.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.272+0000 7f675b7fe640 1 -- 172.21.15.53:0/111675610 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6764003980 con 0x7f677406c020 2023-06-10T18:53:01.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.272+0000 7f675b7fe640 1 --2- 172.21.15.53:0/111675610 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6760066280 0x7f6760068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:01.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.272+0000 7f675b7fe640 1 -- 172.21.15.53:0/111675610 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f676411e890 con 0x7f677406c020 2023-06-10T18:53:01.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.272+0000 7f67727fc640 1 --2- 172.21.15.53:0/111675610 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6760066280 0x7f6760068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:01.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.272+0000 7f67727fc640 1 --2- 172.21.15.53:0/111675610 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6760066280 0x7f6760068730 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6774152540 tx=0x7f6768008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:01.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.276+0000 7f675b7fe640 1 -- 172.21.15.53:0/111675610 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f67640ebec0 con 0x7f677406c020 2023-06-10T18:53:01.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.420+0000 7f677944b640 1 -- 172.21.15.53:0/111675610 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f67740ce670 con 0x7f677406c020 2023-06-10T18:53:01.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.424+0000 7f675b7fe640 1 -- 172.21.15.53:0/111675610 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f67640ef4e0 con 0x7f677406c020 2023-06-10T18:53:01.432 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-06-10T18:53:01.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.424+0000 7f677944b640 1 -- 172.21.15.53:0/111675610 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6760066280 msgr2=0x7f6760068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:01.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.424+0000 7f677944b640 1 --2- 172.21.15.53:0/111675610 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6760066280 0x7f6760068730 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6774152540 tx=0x7f6768008040 comp rx=0 tx=0).stop 2023-06-10T18:53:01.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.424+0000 7f677944b640 1 -- 172.21.15.53:0/111675610 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f677406c020 msgr2=0x7f6774142a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:01.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.424+0000 7f677944b640 1 --2- 172.21.15.53:0/111675610 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f677406c020 0x7f6774142a40 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f67640097c0 tx=0x7f676401ac00 comp rx=0 tx=0).stop 2023-06-10T18:53:01.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.424+0000 7f677944b640 1 -- 172.21.15.53:0/111675610 shutdown_connections 2023-06-10T18:53:01.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.424+0000 7f677944b640 1 --2- 172.21.15.53:0/111675610 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6760066280 0x7f6760068730 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:01.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.424+0000 7f677944b640 1 --2- 172.21.15.53:0/111675610 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67740c9fa0 0x7f6774155b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:01.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.424+0000 7f677944b640 1 --2- 172.21.15.53:0/111675610 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67740c87e0 0x7f677415bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:01.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.424+0000 7f677944b640 1 --2- 172.21.15.53:0/111675610 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f677406c020 0x7f6774142a40 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:01.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.424+0000 7f677944b640 1 -- 172.21.15.53:0/111675610 >> 172.21.15.53:0/111675610 conn(0x7f677406a0e0 msgr2=0x7f67740ae2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:01.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.424+0000 7f677944b640 1 -- 172.21.15.53:0/111675610 shutdown_connections 2023-06-10T18:53:01.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.424+0000 7f677944b640 1 -- 172.21.15.53:0/111675610 wait complete. 2023-06-10T18:53:01.450 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-10T18:53:01.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.564+0000 7fde3018e640 1 Processor -- start 2023-06-10T18:53:01.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.564+0000 7fde3018e640 1 -- start start 2023-06-10T18:53:01.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.564+0000 7fde3018e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fde280c9fa0 0x7fde2806bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:01.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.564+0000 7fde3018e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde2806c020 0x7fde280c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:01.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.564+0000 7fde3018e640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde2806b090 con 0x7fde280c87e0 2023-06-10T18:53:01.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.564+0000 7fde3018e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde280ca370 con 0x7fde280c9fa0 2023-06-10T18:53:01.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.564+0000 7fde3018e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde28070d50 con 0x7fde2806c020 2023-06-10T18:53:01.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.564+0000 7fde2e72b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fde280c87e0 0x7fde280af760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:43094/0 (socket says 172.21.15.53:43094) 2023-06-10T18:53:01.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.564+0000 7fde2e72b640 1 -- 172.21.15.53:0/3706320636 learned_addr learned my addr 172.21.15.53:0/3706320636 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:53:01.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.568+0000 7fde2df2a640 1 --2- 172.21.15.53:0/3706320636 >> v2:172.21.15.117:3300/0 conn(0x7fde280c9fa0 0x7fde2806bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:01.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.568+0000 7fde2d729640 1 --2- 172.21.15.53:0/3706320636 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde2806c020 0x7fde280c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:01.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.568+0000 7fde2cf28640 1 -- 172.21.15.53:0/3706320636 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3008808800 0 0) 0x7fde2806b090 con 0x7fde280c87e0 2023-06-10T18:53:01.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.568+0000 7fde2cf28640 1 -- 172.21.15.53:0/3706320636 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde14003530 con 0x7fde280c87e0 2023-06-10T18:53:01.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.568+0000 7fde2cf28640 1 -- 172.21.15.53:0/3706320636 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3472679496 0 0) 0x7fde14003530 con 0x7fde280c87e0 2023-06-10T18:53:01.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.568+0000 7fde2cf28640 1 -- 172.21.15.53:0/3706320636 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde2806c020 msgr2=0x7fde280c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:01.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.568+0000 7fde2cf28640 1 --2- 172.21.15.53:0/3706320636 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde2806c020 0x7fde280c82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:01.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.568+0000 7fde2cf28640 1 -- 172.21.15.53:0/3706320636 >> v2:172.21.15.117:3300/0 conn(0x7fde280c9fa0 msgr2=0x7fde2806bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:01.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.568+0000 7fde2cf28640 1 --2- 172.21.15.53:0/3706320636 >> v2:172.21.15.117:3300/0 conn(0x7fde280c9fa0 0x7fde2806bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:01.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.568+0000 7fde2cf28640 1 -- 172.21.15.53:0/3706320636 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde28071030 con 0x7fde280c87e0 2023-06-10T18:53:01.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.568+0000 7fde2cf28640 1 -- 172.21.15.53:0/3706320636 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fde20001a00 con 0x7fde280c87e0 2023-06-10T18:53:01.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.568+0000 7fde2cf28640 1 -- 172.21.15.53:0/3706320636 >> v1:172.21.15.53:6789/0 conn(0x7fde280c87e0 legacy=0x7fde280af760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:01.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.568+0000 7fde2cf28640 1 --2- 172.21.15.53:0/3706320636 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde14003980 0x7fde14003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:01.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.568+0000 7fde2cf28640 1 --2- 172.21.15.53:0/3706320636 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde140043b0 0x7fde14004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:01.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.568+0000 7fde2cf28640 1 --2- 172.21.15.53:0/3706320636 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde2806c020 0x7fde14004fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:01.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.568+0000 7fde2cf28640 1 -- 172.21.15.53:0/3706320636 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde280ca370 con 0x7fde14003980 2023-06-10T18:53:01.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.568+0000 7fde2cf28640 1 -- 172.21.15.53:0/3706320636 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde28070d50 con 0x7fde140043b0 2023-06-10T18:53:01.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.568+0000 7fde2cf28640 1 -- 172.21.15.53:0/3706320636 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde1400b990 con 0x7fde2806c020 2023-06-10T18:53:01.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.568+0000 7fde2df2a640 1 --2- 172.21.15.53:0/3706320636 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde14003980 0x7fde14003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:01.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.568+0000 7fde2df2a640 1 -- 172.21.15.53:0/3706320636 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde2806c020 msgr2=0x7fde14004fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:01.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.568+0000 7fde2df2a640 1 --2- 172.21.15.53:0/3706320636 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde2806c020 0x7fde14004fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:01.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.568+0000 7fde2df2a640 1 -- 172.21.15.53:0/3706320636 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde140043b0 msgr2=0x7fde14004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:01.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.568+0000 7fde2df2a640 1 --2- 172.21.15.53:0/3706320636 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde140043b0 0x7fde14004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:01.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.568+0000 7fde2df2a640 1 -- 172.21.15.53:0/3706320636 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde14003530 con 0x7fde14003980 2023-06-10T18:53:01.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.568+0000 7fde2df2a640 1 --2- 172.21.15.53:0/3706320636 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde14003980 0x7fde14003d90 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fde18009b10 tx=0x7fde1801ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1387a6038f2a1d32 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:01.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.568+0000 7fde2cf28640 1 -- 172.21.15.53:0/3706320636 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde180a5540 con 0x7fde14003980 2023-06-10T18:53:01.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.568+0000 7fde2cf28640 1 -- 172.21.15.53:0/3706320636 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde180a56a0 con 0x7fde14003980 2023-06-10T18:53:01.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.568+0000 7fde2cf28640 1 -- 172.21.15.53:0/3706320636 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde180a5a50 con 0x7fde14003980 2023-06-10T18:53:01.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.568+0000 7fde3018e640 1 -- 172.21.15.53:0/3706320636 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde14003980 msgr2=0x7fde14003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:01.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.568+0000 7fde3018e640 1 --2- 172.21.15.53:0/3706320636 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde14003980 0x7fde14003d90 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fde18009b10 tx=0x7fde1801ca60 comp rx=0 tx=0).stop 2023-06-10T18:53:01.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.568+0000 7fde2e72b640 1 -- 172.21.15.53:0/3706320636 reap_dead start 2023-06-10T18:53:01.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.568+0000 7fde3018e640 1 -- 172.21.15.53:0/3706320636 shutdown_connections 2023-06-10T18:53:01.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.568+0000 7fde3018e640 1 -- 172.21.15.53:0/3706320636 >> 172.21.15.53:0/3706320636 conn(0x7fde2806a0e0 msgr2=0x7fde280cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:01.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.568+0000 7fde3018e640 1 -- 172.21.15.53:0/3706320636 shutdown_connections 2023-06-10T18:53:01.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.568+0000 7fde3018e640 1 -- 172.21.15.53:0/3706320636 wait complete. 2023-06-10T18:53:01.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.572+0000 7fde3018e640 1 Processor -- start 2023-06-10T18:53:01.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.572+0000 7fde3018e640 1 -- start start 2023-06-10T18:53:01.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.572+0000 7fde3018e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde14003980 0x7fde280ab860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:01.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.572+0000 7fde3018e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde280c43b0 0x7fde280c19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:01.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.572+0000 7fde3018e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde280adab0 0x7fde281f6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:01.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.572+0000 7fde3018e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde280cc260 con 0x7fde280adab0 2023-06-10T18:53:01.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.572+0000 7fde3018e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde280c37d0 con 0x7fde14003980 2023-06-10T18:53:01.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.572+0000 7fde3018e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde280abda0 con 0x7fde280c43b0 2023-06-10T18:53:01.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.572+0000 7fde2e72b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde280adab0 0x7fde281f6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:01.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.572+0000 7fde2e72b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde280adab0 0x7fde281f6ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56724/0 (socket says 172.21.15.53:56724) 2023-06-10T18:53:01.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.572+0000 7fde2e72b640 1 -- 172.21.15.53:0/120397598 learned_addr learned my addr 172.21.15.53:0/120397598 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:01.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.572+0000 7fde2df2a640 1 --2- 172.21.15.53:0/120397598 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde14003980 0x7fde280ab860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:01.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.572+0000 7fde2d729640 1 --2- 172.21.15.53:0/120397598 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde280c43b0 0x7fde280c19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:01.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.572+0000 7fde2e72b640 1 -- 172.21.15.53:0/120397598 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde280c43b0 msgr2=0x7fde280c19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:01.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.572+0000 7fde2e72b640 1 --2- 172.21.15.53:0/120397598 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde280c43b0 0x7fde280c19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:01.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.572+0000 7fde2e72b640 1 -- 172.21.15.53:0/120397598 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde14003980 msgr2=0x7fde280ab860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:01.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.572+0000 7fde2e72b640 1 --2- 172.21.15.53:0/120397598 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde14003980 0x7fde280ab860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:01.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.572+0000 7fde2e72b640 1 -- 172.21.15.53:0/120397598 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde28150ac0 con 0x7fde280adab0 2023-06-10T18:53:01.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.572+0000 7fde2e72b640 1 --2- 172.21.15.53:0/120397598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde280adab0 0x7fde281f6ae0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fde2806edc0 tx=0x7fde2000caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:01.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.572+0000 7fde1e7fc640 1 -- 172.21.15.53:0/120397598 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde20004d70 con 0x7fde280adab0 2023-06-10T18:53:01.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.572+0000 7fde1e7fc640 1 -- 172.21.15.53:0/120397598 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde200070d0 con 0x7fde280adab0 2023-06-10T18:53:01.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.572+0000 7fde3018e640 1 -- 172.21.15.53:0/120397598 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde280ad840 con 0x7fde280adab0 2023-06-10T18:53:01.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.572+0000 7fde1e7fc640 1 -- 172.21.15.53:0/120397598 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde20007480 con 0x7fde280adab0 2023-06-10T18:53:01.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.572+0000 7fde3018e640 1 -- 172.21.15.53:0/120397598 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde280cb8c0 con 0x7fde280adab0 2023-06-10T18:53:01.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.572+0000 7fde3018e640 1 -- 172.21.15.53:0/120397598 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde280cc3a0 con 0x7fde280adab0 2023-06-10T18:53:01.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.572+0000 7fde1e7fc640 1 -- 172.21.15.53:0/120397598 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fde200075e0 con 0x7fde280adab0 2023-06-10T18:53:01.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.576+0000 7fde1e7fc640 1 --2- 172.21.15.53:0/120397598 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fde0c066280 0x7fde0c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:01.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.576+0000 7fde1e7fc640 1 -- 172.21.15.53:0/120397598 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fde20082dd0 con 0x7fde280adab0 2023-06-10T18:53:01.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.576+0000 7fde2df2a640 1 --2- 172.21.15.53:0/120397598 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fde0c066280 0x7fde0c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:01.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.576+0000 7fde2df2a640 1 --2- 172.21.15.53:0/120397598 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fde0c066280 0x7fde0c068730 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fde180af000 tx=0x7fde180046d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:01.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.580+0000 7fde1e7fc640 1 -- 172.21.15.53:0/120397598 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fde280cc3a0 con 0x7fde280adab0 2023-06-10T18:53:01.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.724+0000 7fde3018e640 1 -- 172.21.15.53:0/120397598 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fde280cc3a0 con 0x7fde280adab0 2023-06-10T18:53:01.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.724+0000 7fde1e7fc640 1 -- 172.21.15.53:0/120397598 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7fde280cc3a0 con 0x7fde280adab0 2023-06-10T18:53:01.734 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-06-10T18:53:01.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.728+0000 7fde3018e640 1 -- 172.21.15.53:0/120397598 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fde0c066280 msgr2=0x7fde0c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:01.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.728+0000 7fde3018e640 1 --2- 172.21.15.53:0/120397598 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fde0c066280 0x7fde0c068730 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fde180af000 tx=0x7fde180046d0 comp rx=0 tx=0).stop 2023-06-10T18:53:01.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.728+0000 7fde3018e640 1 -- 172.21.15.53:0/120397598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde280adab0 msgr2=0x7fde281f6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:01.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.728+0000 7fde3018e640 1 --2- 172.21.15.53:0/120397598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde280adab0 0x7fde281f6ae0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fde2806edc0 tx=0x7fde2000caf0 comp rx=0 tx=0).stop 2023-06-10T18:53:01.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.728+0000 7fde3018e640 1 -- 172.21.15.53:0/120397598 shutdown_connections 2023-06-10T18:53:01.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.728+0000 7fde3018e640 1 --2- 172.21.15.53:0/120397598 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fde0c066280 0x7fde0c068730 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:01.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.728+0000 7fde3018e640 1 --2- 172.21.15.53:0/120397598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde280adab0 0x7fde281f6ae0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:01.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.728+0000 7fde3018e640 1 --2- 172.21.15.53:0/120397598 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde280c43b0 0x7fde280c19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:01.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.728+0000 7fde3018e640 1 --2- 172.21.15.53:0/120397598 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde14003980 0x7fde280ab860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:01.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.728+0000 7fde3018e640 1 -- 172.21.15.53:0/120397598 >> 172.21.15.53:0/120397598 conn(0x7fde2806a0e0 msgr2=0x7fde281577e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:01.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.728+0000 7fde3018e640 1 -- 172.21.15.53:0/120397598 shutdown_connections 2023-06-10T18:53:01.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.728+0000 7fde3018e640 1 -- 172.21.15.53:0/120397598 wait complete. 2023-06-10T18:53:01.753 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T18:53:01.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.864+0000 7f3eb9ee5640 1 Processor -- start 2023-06-10T18:53:01.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.864+0000 7f3eb9ee5640 1 -- start start 2023-06-10T18:53:01.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.864+0000 7f3eb9ee5640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3eb40cb870 0x7f3eb40af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:01.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.864+0000 7f3eb9ee5640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3eb40b00a0 con 0x7f3eb40c9750 2023-06-10T18:53:01.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.864+0000 7f3eb9ee5640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3eb41600d0 con 0x7f3eb40afc60 2023-06-10T18:53:01.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.864+0000 7f3eb9ee5640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3eb40cd990 con 0x7f3eb40cb870 2023-06-10T18:53:01.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.864+0000 7f3eb37fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f3eb40c9750 0x7f3eb40aced0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:43104/0 (socket says 172.21.15.53:43104) 2023-06-10T18:53:01.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.864+0000 7f3eb37fe640 1 -- 172.21.15.53:0/3298319616 learned_addr learned my addr 172.21.15.53:0/3298319616 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:53:01.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.868+0000 7f3eb2ffd640 1 --2- 172.21.15.53:0/3298319616 >> v2:172.21.15.117:3300/0 conn(0x7f3eb40cb870 0x7f3eb40af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:01.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.868+0000 7f3eb27fc640 1 -- 172.21.15.53:0/3298319616 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1937145129 0 0) 0x7f3eb40b00a0 con 0x7f3eb40c9750 2023-06-10T18:53:01.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.868+0000 7f3eb27fc640 1 -- 172.21.15.53:0/3298319616 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e9c003530 con 0x7f3eb40c9750 2023-06-10T18:53:01.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.868+0000 7f3eb27fc640 1 -- 172.21.15.53:0/3298319616 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3390713791 0 0) 0x7f3e9c003530 con 0x7f3eb40c9750 2023-06-10T18:53:01.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.868+0000 7f3eb27fc640 1 -- 172.21.15.53:0/3298319616 >> v2:172.21.15.117:3300/0 conn(0x7f3eb40cb870 msgr2=0x7f3eb40af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:01.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.868+0000 7f3eb27fc640 1 --2- 172.21.15.53:0/3298319616 >> v2:172.21.15.117:3300/0 conn(0x7f3eb40cb870 0x7f3eb40af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:01.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.868+0000 7f3eb27fc640 1 -- 172.21.15.53:0/3298319616 >> v1:172.21.15.117:6789/0 conn(0x7f3eb40afc60 legacy=0x7f3eb40aba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:01.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.868+0000 7f3eb27fc640 1 -- 172.21.15.53:0/3298319616 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eb4160370 con 0x7f3eb40c9750 2023-06-10T18:53:01.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.868+0000 7f3eb27fc640 1 -- 172.21.15.53:0/3298319616 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f3ea4001680 con 0x7f3eb40c9750 2023-06-10T18:53:01.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.868+0000 7f3eb27fc640 1 -- 172.21.15.53:0/3298319616 >> v1:172.21.15.53:6789/0 conn(0x7f3eb40c9750 legacy=0x7f3eb40aced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:01.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.868+0000 7f3eb27fc640 1 --2- 172.21.15.53:0/3298319616 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e9c0039f0 0x7f3e9c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:01.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.868+0000 7f3eb27fc640 1 --2- 172.21.15.53:0/3298319616 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3e9c0047d0 0x7f3e9c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:01.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.868+0000 7f3eb27fc640 1 --2- 172.21.15.53:0/3298319616 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3e9c005180 0x7f3e9c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:01.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.868+0000 7f3eb27fc640 1 -- 172.21.15.53:0/3298319616 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb40cd990 con 0x7f3e9c0039f0 2023-06-10T18:53:01.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.868+0000 7f3eb27fc640 1 -- 172.21.15.53:0/3298319616 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9c00c060 con 0x7f3e9c005180 2023-06-10T18:53:01.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.868+0000 7f3eb27fc640 1 -- 172.21.15.53:0/3298319616 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9c00c220 con 0x7f3e9c0047d0 2023-06-10T18:53:01.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.868+0000 7f3eb37fe640 1 --2- 172.21.15.53:0/3298319616 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e9c0039f0 0x7f3e9c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:01.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.868+0000 7f3eb2ffd640 1 --2- 172.21.15.53:0/3298319616 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3e9c0047d0 0x7f3e9c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:01.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.868+0000 7f3eb3fff640 1 --2- 172.21.15.53:0/3298319616 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3e9c005180 0x7f3e9c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:01.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.868+0000 7f3eb37fe640 1 -- 172.21.15.53:0/3298319616 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3e9c0047d0 msgr2=0x7f3e9c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:01.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.868+0000 7f3eb37fe640 1 --2- 172.21.15.53:0/3298319616 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3e9c0047d0 0x7f3e9c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:01.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.868+0000 7f3eb37fe640 1 -- 172.21.15.53:0/3298319616 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3e9c005180 msgr2=0x7f3e9c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:01.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.868+0000 7f3eb37fe640 1 --2- 172.21.15.53:0/3298319616 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3e9c005180 0x7f3e9c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:01.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.868+0000 7f3eb3fff640 1 -- 172.21.15.53:0/3298319616 reap_dead start 2023-06-10T18:53:01.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.868+0000 7f3eb37fe640 1 -- 172.21.15.53:0/3298319616 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e9c003530 con 0x7f3e9c0039f0 2023-06-10T18:53:01.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.868+0000 7f3eb37fe640 1 --2- 172.21.15.53:0/3298319616 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e9c0039f0 0x7f3e9c003e00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3ea400c240 tx=0x7f3ea401cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2363a57c387cf171 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:01.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.868+0000 7f3eb27fc640 1 -- 172.21.15.53:0/3298319616 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea4005ae0 con 0x7f3e9c0039f0 2023-06-10T18:53:01.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.868+0000 7f3eb27fc640 1 -- 172.21.15.53:0/3298319616 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea4005c60 con 0x7f3e9c0039f0 2023-06-10T18:53:01.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.868+0000 7f3eb27fc640 1 -- 172.21.15.53:0/3298319616 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea40a5890 con 0x7f3e9c0039f0 2023-06-10T18:53:01.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.868+0000 7f3eb9ee5640 1 -- 172.21.15.53:0/3298319616 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e9c0039f0 msgr2=0x7f3e9c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:01.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.868+0000 7f3eb9ee5640 1 --2- 172.21.15.53:0/3298319616 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e9c0039f0 0x7f3e9c003e00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3ea400c240 tx=0x7f3ea401cc10 comp rx=0 tx=0).stop 2023-06-10T18:53:01.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.872+0000 7f3eb9ee5640 1 -- 172.21.15.53:0/3298319616 shutdown_connections 2023-06-10T18:53:01.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.872+0000 7f3eb9ee5640 1 --2- 172.21.15.53:0/3298319616 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e9c0039f0 0x7f3e9c003e00 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:01.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.872+0000 7f3eb9ee5640 1 -- 172.21.15.53:0/3298319616 >> 172.21.15.53:0/3298319616 conn(0x7f3eb406a0d0 msgr2=0x7f3eb40ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:01.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.872+0000 7f3eb9ee5640 1 -- 172.21.15.53:0/3298319616 shutdown_connections 2023-06-10T18:53:01.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.872+0000 7f3eb9ee5640 1 -- 172.21.15.53:0/3298319616 wait complete. 2023-06-10T18:53:01.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.872+0000 7f3eb9ee5640 1 Processor -- start 2023-06-10T18:53:01.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.872+0000 7f3eb9ee5640 1 -- start start 2023-06-10T18:53:01.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.872+0000 7f3eb9ee5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e9c0039f0 0x7f3eb4150d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:01.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.872+0000 7f3eb9ee5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3eb415d940 0x7f3eb415ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:01.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.872+0000 7f3eb9ee5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3eb406ff10 0x7f3eb40703b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:01.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.872+0000 7f3eb9ee5640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb40708f0 con 0x7f3e9c0039f0 2023-06-10T18:53:01.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.872+0000 7f3eb9ee5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb415e2f0 con 0x7f3eb415d940 2023-06-10T18:53:01.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.872+0000 7f3eb9ee5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb40b0e40 con 0x7f3eb406ff10 2023-06-10T18:53:01.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.872+0000 7f3eb37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e9c0039f0 0x7f3eb4150d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:01.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.872+0000 7f3eb37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e9c0039f0 0x7f3eb4150d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56744/0 (socket says 172.21.15.53:56744) 2023-06-10T18:53:01.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.872+0000 7f3eb37fe640 1 -- 172.21.15.53:0/273711794 learned_addr learned my addr 172.21.15.53:0/273711794 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:01.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.872+0000 7f3eb3fff640 1 --2- 172.21.15.53:0/273711794 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3eb406ff10 0x7f3eb40703b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:01.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.872+0000 7f3eb2ffd640 1 --2- 172.21.15.53:0/273711794 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3eb415d940 0x7f3eb415ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:01.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.872+0000 7f3eb37fe640 1 -- 172.21.15.53:0/273711794 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3eb406ff10 msgr2=0x7f3eb40703b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:01.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.872+0000 7f3eb37fe640 1 --2- 172.21.15.53:0/273711794 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3eb406ff10 0x7f3eb40703b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:01.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.872+0000 7f3eb37fe640 1 -- 172.21.15.53:0/273711794 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3eb415d940 msgr2=0x7f3eb415ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:01.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.872+0000 7f3eb37fe640 1 --2- 172.21.15.53:0/273711794 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3eb415d940 0x7f3eb415ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:01.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.872+0000 7f3eb37fe640 1 -- 172.21.15.53:0/273711794 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eb40b1120 con 0x7f3e9c0039f0 2023-06-10T18:53:01.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.872+0000 7f3eb2ffd640 1 --2- 172.21.15.53:0/273711794 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3eb415d940 0x7f3eb415ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:53:01.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.872+0000 7f3eb37fe640 1 --2- 172.21.15.53:0/273711794 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e9c0039f0 0x7f3eb4150d10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3ea4001940 tx=0x7f3e9c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:01.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.872+0000 7f3e9bfff640 1 -- 172.21.15.53:0/273711794 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea40b4070 con 0x7f3e9c0039f0 2023-06-10T18:53:01.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.872+0000 7f3e9bfff640 1 -- 172.21.15.53:0/273711794 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea4005e90 con 0x7f3e9c0039f0 2023-06-10T18:53:01.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.872+0000 7f3eb9ee5640 1 -- 172.21.15.53:0/273711794 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3eb40b1400 con 0x7f3e9c0039f0 2023-06-10T18:53:01.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.872+0000 7f3e9bfff640 1 -- 172.21.15.53:0/273711794 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea40a5890 con 0x7f3e9c0039f0 2023-06-10T18:53:01.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.872+0000 7f3eb9ee5640 1 -- 172.21.15.53:0/273711794 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3eb40b19c0 con 0x7f3e9c0039f0 2023-06-10T18:53:01.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.872+0000 7f3eb9ee5640 1 -- 172.21.15.53:0/273711794 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3eb40b1bb0 con 0x7f3e9c0039f0 2023-06-10T18:53:01.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.876+0000 7f3e9bfff640 1 -- 172.21.15.53:0/273711794 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3ea40a59f0 con 0x7f3e9c0039f0 2023-06-10T18:53:01.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.876+0000 7f3e9bfff640 1 --2- 172.21.15.53:0/273711794 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3ea00662b0 0x7f3ea0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:01.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.876+0000 7f3e9bfff640 1 -- 172.21.15.53:0/273711794 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3ea411d780 con 0x7f3e9c0039f0 2023-06-10T18:53:01.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.876+0000 7f3eb2ffd640 1 --2- 172.21.15.53:0/273711794 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3ea00662b0 0x7f3ea0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:01.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.876+0000 7f3eb2ffd640 1 --2- 172.21.15.53:0/273711794 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3ea00662b0 0x7f3ea0068760 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3eb41f8130 tx=0x7f3ea8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:01.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:01.880+0000 7f3e9bfff640 1 -- 172.21.15.53:0/273711794 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3ea40eac00 con 0x7f3e9c0039f0 2023-06-10T18:53:02.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.060+0000 7f3eb9ee5640 1 -- 172.21.15.53:0/273711794 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3eb404d790 con 0x7f3e9c0039f0 2023-06-10T18:53:02.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.064+0000 7f3e9bfff640 1 -- 172.21.15.53:0/273711794 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4668 (secure 0 0 0) 0x7f3ea40ee220 con 0x7f3e9c0039f0 2023-06-10T18:53:02.073 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:53:02.073 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4236,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/1767214403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":1767214403},{"type":"v1","addr":"172.21.15.53:6834","nonce":1767214403}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/184933647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":184933647},{"type":"v1","addr":"172.21.15.117:6837","nonce":184933647}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/1556542558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":1556542558},{"type":"v1","addr":"172.21.15.53:6835","nonce":1556542558}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T18:52:44.918376+0000","modified":"2023-06-10T18:52:47.927154+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6835/1492134415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1492134415},{"type":"v1","addr":"172.21.15.117:6835","nonce":1492134415}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-10T18:53:02.073 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 7 2023-06-10T18:53:02.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.064+0000 7f3eb9ee5640 1 -- 172.21.15.53:0/273711794 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3ea00662b0 msgr2=0x7f3ea0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:02.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.064+0000 7f3eb9ee5640 1 --2- 172.21.15.53:0/273711794 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3ea00662b0 0x7f3ea0068760 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3eb41f8130 tx=0x7f3ea8008040 comp rx=0 tx=0).stop 2023-06-10T18:53:02.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.064+0000 7f3eb9ee5640 1 -- 172.21.15.53:0/273711794 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e9c0039f0 msgr2=0x7f3eb4150d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:02.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.064+0000 7f3eb9ee5640 1 --2- 172.21.15.53:0/273711794 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e9c0039f0 0x7f3eb4150d10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3ea4001940 tx=0x7f3e9c005800 comp rx=0 tx=0).stop 2023-06-10T18:53:02.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.064+0000 7f3eb9ee5640 1 -- 172.21.15.53:0/273711794 shutdown_connections 2023-06-10T18:53:02.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.064+0000 7f3eb9ee5640 1 --2- 172.21.15.53:0/273711794 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3ea00662b0 0x7f3ea0068760 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:02.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.064+0000 7f3eb9ee5640 1 --2- 172.21.15.53:0/273711794 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3eb406ff10 0x7f3eb40703b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:02.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.064+0000 7f3eb9ee5640 1 --2- 172.21.15.53:0/273711794 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3eb415d940 0x7f3eb415ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:02.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.064+0000 7f3eb9ee5640 1 --2- 172.21.15.53:0/273711794 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e9c0039f0 0x7f3eb4150d10 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:02.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.064+0000 7f3eb9ee5640 1 -- 172.21.15.53:0/273711794 >> 172.21.15.53:0/273711794 conn(0x7f3eb406a0d0 msgr2=0x7f3eb40c82d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:02.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.064+0000 7f3eb9ee5640 1 -- 172.21.15.53:0/273711794 shutdown_connections 2023-06-10T18:53:02.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.064+0000 7f3eb9ee5640 1 -- 172.21.15.53:0/273711794 wait complete. 2023-06-10T18:53:02.090 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T18:53:02.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.200+0000 7f6ac05e2640 1 Processor -- start 2023-06-10T18:53:02.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.200+0000 7f6ac05e2640 1 -- start start 2023-06-10T18:53:02.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.204+0000 7f6ac05e2640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6ab80cd760 0x7f6ab80cbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:02.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.204+0000 7f6ac05e2640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ab80cc6c0 con 0x7f6ab815ba70 2023-06-10T18:53:02.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.204+0000 7f6ac05e2640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ab80cc9a0 con 0x7f6ab815c810 2023-06-10T18:53:02.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.204+0000 7f6ac05e2640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ab80cdb30 con 0x7f6ab80cd760 2023-06-10T18:53:02.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.204+0000 7f6abe37e640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f6ab815ba70 0x7f6ab815c100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:43114/0 (socket says 172.21.15.53:43114) 2023-06-10T18:53:02.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.204+0000 7f6abe37e640 1 -- 172.21.15.53:0/4100241681 learned_addr learned my addr 172.21.15.53:0/4100241681 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:53:02.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.204+0000 7f6abeb7f640 1 --2- 172.21.15.53:0/4100241681 >> v2:172.21.15.117:3300/0 conn(0x7f6ab80cd760 0x7f6ab80cbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:02.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.204+0000 7f6abd37c640 1 -- 172.21.15.53:0/4100241681 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2673025115 0 0) 0x7f6ab80cc6c0 con 0x7f6ab815ba70 2023-06-10T18:53:02.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.204+0000 7f6abd37c640 1 -- 172.21.15.53:0/4100241681 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6aa4003530 con 0x7f6ab815ba70 2023-06-10T18:53:02.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.204+0000 7f6abd37c640 1 -- 172.21.15.53:0/4100241681 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 840536086 0 0) 0x7f6aa4003530 con 0x7f6ab815ba70 2023-06-10T18:53:02.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.204+0000 7f6abd37c640 1 -- 172.21.15.53:0/4100241681 >> v2:172.21.15.117:3300/0 conn(0x7f6ab80cd760 msgr2=0x7f6ab80cbfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:02.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.204+0000 7f6abd37c640 1 --2- 172.21.15.53:0/4100241681 >> v2:172.21.15.117:3300/0 conn(0x7f6ab80cd760 0x7f6ab80cbfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:02.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.204+0000 7f6abd37c640 1 -- 172.21.15.53:0/4100241681 >> v1:172.21.15.117:6789/0 conn(0x7f6ab815c810 legacy=0x7f6ab806efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:02.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.204+0000 7f6abd37c640 1 -- 172.21.15.53:0/4100241681 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab80ccc80 con 0x7f6ab815ba70 2023-06-10T18:53:02.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.204+0000 7f6abd37c640 1 -- 172.21.15.53:0/4100241681 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f6ab4001680 con 0x7f6ab815ba70 2023-06-10T18:53:02.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.204+0000 7f6abd37c640 1 -- 172.21.15.53:0/4100241681 >> v1:172.21.15.53:6789/0 conn(0x7f6ab815ba70 legacy=0x7f6ab815c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:02.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.204+0000 7f6abd37c640 1 --2- 172.21.15.53:0/4100241681 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6aa40039f0 0x7f6aa4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:02.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.204+0000 7f6abd37c640 1 --2- 172.21.15.53:0/4100241681 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6aa40047d0 0x7f6aa4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:02.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.204+0000 7f6abd37c640 1 --2- 172.21.15.53:0/4100241681 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6aa40051d0 0x7f6aa400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:02.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.204+0000 7f6abd37c640 1 -- 172.21.15.53:0/4100241681 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab80cdb30 con 0x7f6aa40051d0 2023-06-10T18:53:02.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.204+0000 7f6abd37c640 1 -- 172.21.15.53:0/4100241681 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa400c110 con 0x7f6aa40039f0 2023-06-10T18:53:02.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.204+0000 7f6abd37c640 1 -- 172.21.15.53:0/4100241681 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa400c2d0 con 0x7f6aa40047d0 2023-06-10T18:53:02.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.204+0000 7f6abeb7f640 1 --2- 172.21.15.53:0/4100241681 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6aa40051d0 0x7f6aa400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:02.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.204+0000 7f6abe37e640 1 --2- 172.21.15.53:0/4100241681 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6aa40039f0 0x7f6aa4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:02.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.204+0000 7f6abdb7d640 1 --2- 172.21.15.53:0/4100241681 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6aa40047d0 0x7f6aa4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:02.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.204+0000 7f6abeb7f640 1 -- 172.21.15.53:0/4100241681 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6aa40047d0 msgr2=0x7f6aa4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:02.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.204+0000 7f6abeb7f640 1 --2- 172.21.15.53:0/4100241681 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6aa40047d0 0x7f6aa4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:02.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.204+0000 7f6abeb7f640 1 -- 172.21.15.53:0/4100241681 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6aa40039f0 msgr2=0x7f6aa4003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:02.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.204+0000 7f6abeb7f640 1 --2- 172.21.15.53:0/4100241681 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6aa40039f0 0x7f6aa4003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:02.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.204+0000 7f6abeb7f640 1 -- 172.21.15.53:0/4100241681 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aa4003530 con 0x7f6aa40051d0 2023-06-10T18:53:02.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.204+0000 7f6abdb7d640 1 --2- 172.21.15.53:0/4100241681 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6aa40047d0 0x7f6aa4004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:02.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.204+0000 7f6abe37e640 1 --2- 172.21.15.53:0/4100241681 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6aa40039f0 0x7f6aa4003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:02.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.204+0000 7f6abeb7f640 1 -- 172.21.15.53:0/4100241681 reap_dead start 2023-06-10T18:53:02.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.204+0000 7f6abeb7f640 1 --2- 172.21.15.53:0/4100241681 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6aa40051d0 0x7f6aa400b990 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6ab0009f90 tx=0x7f6ab001cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2b4575c30d8bd36 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:02.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.204+0000 7f6abd37c640 1 -- 172.21.15.53:0/4100241681 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab00a5c70 con 0x7f6aa40051d0 2023-06-10T18:53:02.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.204+0000 7f6abd37c640 1 -- 172.21.15.53:0/4100241681 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ab4001d80 con 0x7f6aa40051d0 2023-06-10T18:53:02.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.208+0000 7f6abd37c640 1 -- 172.21.15.53:0/4100241681 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab00039a0 con 0x7f6aa40051d0 2023-06-10T18:53:02.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.208+0000 7f6ac05e2640 1 -- 172.21.15.53:0/4100241681 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6aa40051d0 msgr2=0x7f6aa400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:02.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.208+0000 7f6ac05e2640 1 --2- 172.21.15.53:0/4100241681 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6aa40051d0 0x7f6aa400b990 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6ab0009f90 tx=0x7f6ab001cc60 comp rx=0 tx=0).stop 2023-06-10T18:53:02.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.208+0000 7f6ac05e2640 1 -- 172.21.15.53:0/4100241681 shutdown_connections 2023-06-10T18:53:02.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.208+0000 7f6ac05e2640 1 --2- 172.21.15.53:0/4100241681 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6aa40051d0 0x7f6aa400b990 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:02.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.208+0000 7f6ac05e2640 1 -- 172.21.15.53:0/4100241681 >> 172.21.15.53:0/4100241681 conn(0x7f6ab806a0d0 msgr2=0x7f6ab80ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:02.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.208+0000 7f6ac05e2640 1 -- 172.21.15.53:0/4100241681 shutdown_connections 2023-06-10T18:53:02.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.208+0000 7f6ac05e2640 1 -- 172.21.15.53:0/4100241681 wait complete. 2023-06-10T18:53:02.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.208+0000 7f6ac05e2640 1 Processor -- start 2023-06-10T18:53:02.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.208+0000 7f6ac05e2640 1 -- start start 2023-06-10T18:53:02.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.208+0000 7f6ac05e2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6aa40051d0 0x7f6ab8152750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:02.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.208+0000 7f6ac05e2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ab8159d80 0x7f6ab80ac250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:02.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.208+0000 7f6ac05e2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ab815a1f0 0x7f6ab80ac790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:02.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.208+0000 7f6ac05e2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab80c4fe0 con 0x7f6aa40051d0 2023-06-10T18:53:02.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.208+0000 7f6ac05e2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab8152c90 con 0x7f6ab8159d80 2023-06-10T18:53:02.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.208+0000 7f6ac05e2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab815a6f0 con 0x7f6ab815a1f0 2023-06-10T18:53:02.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.208+0000 7f6abe37e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6aa40051d0 0x7f6ab8152750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:02.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.208+0000 7f6abe37e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6aa40051d0 0x7f6ab8152750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56760/0 (socket says 172.21.15.53:56760) 2023-06-10T18:53:02.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.208+0000 7f6abe37e640 1 -- 172.21.15.53:0/3016499582 learned_addr learned my addr 172.21.15.53:0/3016499582 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:02.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.208+0000 7f6abeb7f640 1 --2- 172.21.15.53:0/3016499582 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ab815a1f0 0x7f6ab80ac790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:02.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.208+0000 7f6abdb7d640 1 --2- 172.21.15.53:0/3016499582 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ab8159d80 0x7f6ab80ac250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:02.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.208+0000 7f6abe37e640 1 -- 172.21.15.53:0/3016499582 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ab815a1f0 msgr2=0x7f6ab80ac790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:02.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.208+0000 7f6abe37e640 1 --2- 172.21.15.53:0/3016499582 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ab815a1f0 0x7f6ab80ac790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:02.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.208+0000 7f6abe37e640 1 -- 172.21.15.53:0/3016499582 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ab8159d80 msgr2=0x7f6ab80ac250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:02.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.208+0000 7f6abe37e640 1 --2- 172.21.15.53:0/3016499582 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ab8159d80 0x7f6ab80ac250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:02.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.208+0000 7f6abe37e640 1 -- 172.21.15.53:0/3016499582 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab815a9d0 con 0x7f6aa40051d0 2023-06-10T18:53:02.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.208+0000 7f6abeb7f640 1 --2- 172.21.15.53:0/3016499582 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ab815a1f0 0x7f6ab80ac790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:02.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.208+0000 7f6abe37e640 1 --2- 172.21.15.53:0/3016499582 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6aa40051d0 0x7f6ab8152750 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6ab4000fc0 tx=0x7f6ab400e100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:02.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.208+0000 7f6aaeffd640 1 -- 172.21.15.53:0/3016499582 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab400ece0 con 0x7f6aa40051d0 2023-06-10T18:53:02.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.208+0000 7f6aaeffd640 1 -- 172.21.15.53:0/3016499582 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ab400ee40 con 0x7f6aa40051d0 2023-06-10T18:53:02.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.208+0000 7f6aaeffd640 1 -- 172.21.15.53:0/3016499582 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab40145c0 con 0x7f6aa40051d0 2023-06-10T18:53:02.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.212+0000 7f6ac05e2640 1 -- 172.21.15.53:0/3016499582 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ab815acb0 con 0x7f6aa40051d0 2023-06-10T18:53:02.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.212+0000 7f6ac05e2640 1 -- 172.21.15.53:0/3016499582 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ab80aecc0 con 0x7f6aa40051d0 2023-06-10T18:53:02.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.212+0000 7f6ac05e2640 1 -- 172.21.15.53:0/3016499582 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ab80ca040 con 0x7f6aa40051d0 2023-06-10T18:53:02.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.212+0000 7f6aaeffd640 1 -- 172.21.15.53:0/3016499582 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6ab4014720 con 0x7f6aa40051d0 2023-06-10T18:53:02.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.212+0000 7f6aaeffd640 1 --2- 172.21.15.53:0/3016499582 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6a9c0662b0 0x7f6a9c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:02.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.212+0000 7f6aaeffd640 1 -- 172.21.15.53:0/3016499582 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6ab4086a10 con 0x7f6aa40051d0 2023-06-10T18:53:02.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.212+0000 7f6abdb7d640 1 --2- 172.21.15.53:0/3016499582 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6a9c0662b0 0x7f6a9c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:02.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.212+0000 7f6abdb7d640 1 --2- 172.21.15.53:0/3016499582 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6a9c0662b0 0x7f6a9c068760 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6aa8000f70 tx=0x7f6aa8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:02.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.216+0000 7f6aaeffd640 1 -- 172.21.15.53:0/3016499582 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6ab4053df0 con 0x7f6aa40051d0 2023-06-10T18:53:02.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.368+0000 7f6ac05e2640 1 -- 172.21.15.53:0/3016499582 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6ab80c5120 con 0x7f6aa40051d0 2023-06-10T18:53:02.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.372+0000 7f6aaeffd640 1 -- 172.21.15.53:0/3016499582 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18267 (secure 0 0 0) 0x7f6ab401b090 con 0x7f6aa40051d0 2023-06-10T18:53:02.381 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:53:02.381 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":23,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T18:52:45.921586+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-10T18:52:43.396243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-10T18:52:43.894228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T18:53:02.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.372+0000 7f6ac05e2640 1 -- 172.21.15.53:0/3016499582 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6a9c0662b0 msgr2=0x7f6a9c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:02.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.372+0000 7f6ac05e2640 1 --2- 172.21.15.53:0/3016499582 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6a9c0662b0 0x7f6a9c068760 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6aa8000f70 tx=0x7f6aa8009040 comp rx=0 tx=0).stop 2023-06-10T18:53:02.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.372+0000 7f6ac05e2640 1 -- 172.21.15.53:0/3016499582 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6aa40051d0 msgr2=0x7f6ab8152750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:02.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.372+0000 7f6ac05e2640 1 --2- 172.21.15.53:0/3016499582 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6aa40051d0 0x7f6ab8152750 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6ab4000fc0 tx=0x7f6ab400e100 comp rx=0 tx=0).stop 2023-06-10T18:53:02.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.372+0000 7f6ac05e2640 1 -- 172.21.15.53:0/3016499582 shutdown_connections 2023-06-10T18:53:02.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.372+0000 7f6ac05e2640 1 --2- 172.21.15.53:0/3016499582 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6a9c0662b0 0x7f6a9c068760 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:02.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.372+0000 7f6ac05e2640 1 --2- 172.21.15.53:0/3016499582 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ab815a1f0 0x7f6ab80ac790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:02.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.372+0000 7f6ac05e2640 1 --2- 172.21.15.53:0/3016499582 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ab8159d80 0x7f6ab80ac250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:02.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.372+0000 7f6ac05e2640 1 --2- 172.21.15.53:0/3016499582 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6aa40051d0 0x7f6ab8152750 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:02.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.372+0000 7f6ac05e2640 1 -- 172.21.15.53:0/3016499582 >> 172.21.15.53:0/3016499582 conn(0x7f6ab806a0d0 msgr2=0x7f6ab806bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:02.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.372+0000 7f6ac05e2640 1 -- 172.21.15.53:0/3016499582 shutdown_connections 2023-06-10T18:53:02.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.372+0000 7f6ac05e2640 1 -- 172.21.15.53:0/3016499582 wait complete. 2023-06-10T18:53:02.401 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T18:53:02.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.520+0000 7fd38d274640 1 Processor -- start 2023-06-10T18:53:02.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.520+0000 7fd38d274640 1 -- start start 2023-06-10T18:53:02.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.520+0000 7fd38d274640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd38815eef0 0x7fd388070f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:02.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.520+0000 7fd38d274640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd388069450 0x7fd388069850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:02.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.520+0000 7fd38d274640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd388069d90 con 0x7fd38815f570 2023-06-10T18:53:02.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.520+0000 7fd38d274640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd38815f2c0 con 0x7fd388069450 2023-06-10T18:53:02.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.520+0000 7fd38d274640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd38815fdc0 con 0x7fd38815eef0 2023-06-10T18:53:02.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.520+0000 7fd3877fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd388069450 0x7fd388069850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:02.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.520+0000 7fd3877fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd388069450 0x7fd388069850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56770/0 (socket says 172.21.15.53:56770) 2023-06-10T18:53:02.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.520+0000 7fd3877fe640 1 -- 172.21.15.53:0/2625866254 learned_addr learned my addr 172.21.15.53:0/2625866254 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:02.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.520+0000 7fd386ffd640 1 --2- 172.21.15.53:0/2625866254 >> v2:172.21.15.117:3300/0 conn(0x7fd38815eef0 0x7fd388070f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:02.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.520+0000 7fd3877fe640 1 -- 172.21.15.53:0/2625866254 >> v2:172.21.15.117:3300/0 conn(0x7fd38815eef0 msgr2=0x7fd388070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:02.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.520+0000 7fd3877fe640 1 --2- 172.21.15.53:0/2625866254 >> v2:172.21.15.117:3300/0 conn(0x7fd38815eef0 0x7fd388070f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:02.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.520+0000 7fd3877fe640 1 -- 172.21.15.53:0/2625866254 >> v1:172.21.15.117:6789/0 conn(0x7fd38815f570 legacy=0x7fd3880ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:02.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.520+0000 7fd3877fe640 1 -- 172.21.15.53:0/2625866254 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3881600a0 con 0x7fd388069450 2023-06-10T18:53:02.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.524+0000 7fd3877fe640 1 --2- 172.21.15.53:0/2625866254 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd388069450 0x7fd388069850 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd38806b4f0 tx=0x7fd38001c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7c98d26a3814085 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:02.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.524+0000 7fd385ffb640 1 -- 172.21.15.53:0/2625866254 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3800a5740 con 0x7fd388069450 2023-06-10T18:53:02.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.524+0000 7fd385ffb640 1 -- 172.21.15.53:0/2625866254 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3800a58a0 con 0x7fd388069450 2023-06-10T18:53:02.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.524+0000 7fd385ffb640 1 -- 172.21.15.53:0/2625866254 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3800a5c30 con 0x7fd388069450 2023-06-10T18:53:02.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.524+0000 7fd38d274640 1 -- 172.21.15.53:0/2625866254 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd388069450 msgr2=0x7fd388069850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:02.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.524+0000 7fd38d274640 1 --2- 172.21.15.53:0/2625866254 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd388069450 0x7fd388069850 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd38806b4f0 tx=0x7fd38001c990 comp rx=0 tx=0).stop 2023-06-10T18:53:02.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.524+0000 7fd38d274640 1 -- 172.21.15.53:0/2625866254 shutdown_connections 2023-06-10T18:53:02.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.524+0000 7fd38d274640 1 --2- 172.21.15.53:0/2625866254 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd388069450 0x7fd388069850 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:02.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.524+0000 7fd38d274640 1 --2- 172.21.15.53:0/2625866254 >> v2:172.21.15.117:3300/0 conn(0x7fd38815eef0 0x7fd388070f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:02.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.524+0000 7fd38d274640 1 -- 172.21.15.53:0/2625866254 >> 172.21.15.53:0/2625866254 conn(0x7fd38806a560 msgr2=0x7fd38806a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:02.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.524+0000 7fd38d274640 1 -- 172.21.15.53:0/2625866254 shutdown_connections 2023-06-10T18:53:02.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.524+0000 7fd38d274640 1 -- 172.21.15.53:0/2625866254 wait complete. 2023-06-10T18:53:02.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.524+0000 7fd38d274640 1 Processor -- start 2023-06-10T18:53:02.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.524+0000 7fd38d274640 1 -- start start 2023-06-10T18:53:02.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.524+0000 7fd38d274640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd388069450 0x7fd3880b3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:02.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.524+0000 7fd38d274640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd38815eef0 0x7fd3881f7d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:02.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.524+0000 7fd38d274640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd38815f570 0x7fd3881f8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:02.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.524+0000 7fd38d274640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3880c78a0 con 0x7fd38815eef0 2023-06-10T18:53:02.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.524+0000 7fd38d274640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3880c7b80 con 0x7fd388069450 2023-06-10T18:53:02.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.524+0000 7fd38d274640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3880c7e60 con 0x7fd38815f570 2023-06-10T18:53:02.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.524+0000 7fd3867fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd38815eef0 0x7fd3881f7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:02.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.524+0000 7fd3867fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd38815eef0 0x7fd3881f7d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56784/0 (socket says 172.21.15.53:56784) 2023-06-10T18:53:02.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.524+0000 7fd3867fc640 1 -- 172.21.15.53:0/679164152 learned_addr learned my addr 172.21.15.53:0/679164152 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:02.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.524+0000 7fd3877fe640 1 --2- 172.21.15.53:0/679164152 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd38815f570 0x7fd3881f8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:02.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.524+0000 7fd386ffd640 1 --2- 172.21.15.53:0/679164152 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd388069450 0x7fd3880b3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:02.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.524+0000 7fd3867fc640 1 -- 172.21.15.53:0/679164152 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd38815f570 msgr2=0x7fd3881f8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:02.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.524+0000 7fd3867fc640 1 --2- 172.21.15.53:0/679164152 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd38815f570 0x7fd3881f8280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:02.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.524+0000 7fd3867fc640 1 -- 172.21.15.53:0/679164152 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd388069450 msgr2=0x7fd3880b3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:02.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.524+0000 7fd3867fc640 1 --2- 172.21.15.53:0/679164152 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd388069450 0x7fd3880b3cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:02.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.524+0000 7fd3867fc640 1 -- 172.21.15.53:0/679164152 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd380009b30 con 0x7fd38815eef0 2023-06-10T18:53:02.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.524+0000 7fd3877fe640 1 --2- 172.21.15.53:0/679164152 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd38815f570 0x7fd3881f8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:53:02.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.524+0000 7fd3867fc640 1 --2- 172.21.15.53:0/679164152 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd38815eef0 0x7fd3881f7d40 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd37c00b410 tx=0x7fd37c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:02.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.528+0000 7fd36f7fe640 1 -- 172.21.15.53:0/679164152 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37c004020 con 0x7fd38815eef0 2023-06-10T18:53:02.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.528+0000 7fd36f7fe640 1 -- 172.21.15.53:0/679164152 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd37c004180 con 0x7fd38815eef0 2023-06-10T18:53:02.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.528+0000 7fd38d274640 1 -- 172.21.15.53:0/679164152 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3880c8140 con 0x7fd38815eef0 2023-06-10T18:53:02.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.528+0000 7fd36f7fe640 1 -- 172.21.15.53:0/679164152 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37c011630 con 0x7fd38815eef0 2023-06-10T18:53:02.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.528+0000 7fd38d274640 1 -- 172.21.15.53:0/679164152 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3880c8940 con 0x7fd38815eef0 2023-06-10T18:53:02.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.528+0000 7fd38d274640 1 -- 172.21.15.53:0/679164152 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd38804d790 con 0x7fd38815eef0 2023-06-10T18:53:02.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.528+0000 7fd36f7fe640 1 -- 172.21.15.53:0/679164152 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd37c011790 con 0x7fd38815eef0 2023-06-10T18:53:02.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.528+0000 7fd36f7fe640 1 --2- 172.21.15.53:0/679164152 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd374066280 0x7fd374068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:02.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.528+0000 7fd36f7fe640 1 -- 172.21.15.53:0/679164152 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd37c083a80 con 0x7fd38815eef0 2023-06-10T18:53:02.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.528+0000 7fd386ffd640 1 --2- 172.21.15.53:0/679164152 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd374066280 0x7fd374068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:02.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.528+0000 7fd386ffd640 1 --2- 172.21.15.53:0/679164152 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd374066280 0x7fd374068730 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd3880b3270 tx=0x7fd378008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:02.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.532+0000 7fd36f7fe640 1 -- 172.21.15.53:0/679164152 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd37c050f00 con 0x7fd38815eef0 2023-06-10T18:53:02.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.716+0000 7fd38d274640 1 -- 172.21.15.53:0/679164152 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd3880c85f0 con 0x7fd38815eef0 2023-06-10T18:53:02.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.716+0000 7fd36f7fe640 1 -- 172.21.15.53:0/679164152 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4668 (secure 0 0 0) 0x7fd37c054520 con 0x7fd38815eef0 2023-06-10T18:53:02.727 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:53:02.727 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4236,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/1767214403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":1767214403},{"type":"v1","addr":"172.21.15.53:6834","nonce":1767214403}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/184933647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":184933647},{"type":"v1","addr":"172.21.15.117:6837","nonce":184933647}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/1556542558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":1556542558},{"type":"v1","addr":"172.21.15.53:6835","nonce":1556542558}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T18:52:44.918376+0000","modified":"2023-06-10T18:52:47.927154+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6835/1492134415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1492134415},{"type":"v1","addr":"172.21.15.117:6835","nonce":1492134415}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-10T18:53:02.728 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 7 2023-06-10T18:53:02.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.720+0000 7fd38d274640 1 -- 172.21.15.53:0/679164152 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd374066280 msgr2=0x7fd374068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:02.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.720+0000 7fd38d274640 1 --2- 172.21.15.53:0/679164152 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd374066280 0x7fd374068730 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd3880b3270 tx=0x7fd378008040 comp rx=0 tx=0).stop 2023-06-10T18:53:02.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.720+0000 7fd38d274640 1 -- 172.21.15.53:0/679164152 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd38815eef0 msgr2=0x7fd3881f7d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:02.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.720+0000 7fd38d274640 1 --2- 172.21.15.53:0/679164152 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd38815eef0 0x7fd3881f7d40 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd37c00b410 tx=0x7fd37c00b8d0 comp rx=0 tx=0).stop 2023-06-10T18:53:02.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.720+0000 7fd38d274640 1 -- 172.21.15.53:0/679164152 shutdown_connections 2023-06-10T18:53:02.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.720+0000 7fd38d274640 1 --2- 172.21.15.53:0/679164152 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd374066280 0x7fd374068730 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:02.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.720+0000 7fd38d274640 1 --2- 172.21.15.53:0/679164152 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd38815f570 0x7fd3881f8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:02.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.720+0000 7fd38d274640 1 --2- 172.21.15.53:0/679164152 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd38815eef0 0x7fd3881f7d40 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:02.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.720+0000 7fd38d274640 1 --2- 172.21.15.53:0/679164152 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd388069450 0x7fd3880b3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:02.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.720+0000 7fd38d274640 1 -- 172.21.15.53:0/679164152 >> 172.21.15.53:0/679164152 conn(0x7fd38806a560 msgr2=0x7fd38815aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:02.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.720+0000 7fd38d274640 1 -- 172.21.15.53:0/679164152 shutdown_connections 2023-06-10T18:53:02.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:02.720+0000 7fd38d274640 1 -- 172.21.15.53:0/679164152 wait complete. 2023-06-10T18:53:03.146 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-06-10T18:52:44.918376+0000', 'modified': '2023-06-10T18:52:47.927154+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4291}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4291': {'gid': 4291, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.117:6835/1492134415', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6834', 'nonce': 1492134415}, {'type': 'v1', 'addr': '172.21.15.117:6835', 'nonce': 1492134415}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-06-10T18:53:03.147 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-06-10T18:53:03.147 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-06-10T18:53:03.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.272+0000 7f5f2bef4640 1 Processor -- start 2023-06-10T18:53:03.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.272+0000 7f5f2bef4640 1 -- start start 2023-06-10T18:53:03.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.276+0000 7f5f2bef4640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5f240cc690 0x7f5f240d00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:03.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.276+0000 7f5f2bef4640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5f240d1b00 0x7f5f240d05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:03.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.276+0000 7f5f2bef4640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f240ccde0 con 0x7f5f240b3ac0 2023-06-10T18:53:03.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.276+0000 7f5f2bef4640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f240ced00 con 0x7f5f240cc690 2023-06-10T18:53:03.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.276+0000 7f5f2bef4640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f240cfc10 con 0x7f5f240d1b00 2023-06-10T18:53:03.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.276+0000 7f5f29c90640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f5f240b3ac0 0x7f5f240b3e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:43124/0 (socket says 172.21.15.53:43124) 2023-06-10T18:53:03.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.276+0000 7f5f29c90640 1 -- 172.21.15.53:0/1083866832 learned_addr learned my addr 172.21.15.53:0/1083866832 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:53:03.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.276+0000 7f5f2948f640 1 --2- 172.21.15.53:0/1083866832 >> v2:172.21.15.53:3300/0 conn(0x7f5f240cc690 0x7f5f240d00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:03.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.276+0000 7f5f2a491640 1 --2- 172.21.15.53:0/1083866832 >> v2:172.21.15.117:3300/0 conn(0x7f5f240d1b00 0x7f5f240d05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:03.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.276+0000 7f5f28c8e640 1 -- 172.21.15.53:0/1083866832 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3963857300 0 0) 0x7f5f240ccde0 con 0x7f5f240b3ac0 2023-06-10T18:53:03.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.276+0000 7f5f28c8e640 1 -- 172.21.15.53:0/1083866832 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f10003530 con 0x7f5f240b3ac0 2023-06-10T18:53:03.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.276+0000 7f5f2948f640 1 -- 172.21.15.53:0/1083866832 >> v2:172.21.15.117:3300/0 conn(0x7f5f240d1b00 msgr2=0x7f5f240d05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:03.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.276+0000 7f5f2948f640 1 --2- 172.21.15.53:0/1083866832 >> v2:172.21.15.117:3300/0 conn(0x7f5f240d1b00 0x7f5f240d05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:03.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.276+0000 7f5f2948f640 1 -- 172.21.15.53:0/1083866832 >> v1:172.21.15.53:6789/0 conn(0x7f5f240b3ac0 legacy=0x7f5f240b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:03.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.276+0000 7f5f28c8e640 1 -- 172.21.15.53:0/1083866832 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4173077647 0 0) 0x7f5f10003530 con 0x7f5f240b3ac0 2023-06-10T18:53:03.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.276+0000 7f5f2948f640 1 -- 172.21.15.53:0/1083866832 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f240b7b50 con 0x7f5f240cc690 2023-06-10T18:53:03.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.276+0000 7f5f2948f640 1 --2- 172.21.15.53:0/1083866832 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5f240cc690 0x7f5f240d00a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5f240b8110 tx=0x7f5f1401c230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5af60a0e3245b798 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:03.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.276+0000 7f5f28c8e640 1 -- 172.21.15.53:0/1083866832 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f20001680 con 0x7f5f240cc690 2023-06-10T18:53:03.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.280+0000 7f5f28c8e640 1 -- 172.21.15.53:0/1083866832 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f140a7050 con 0x7f5f240cc690 2023-06-10T18:53:03.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.280+0000 7f5f28c8e640 1 -- 172.21.15.53:0/1083866832 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f140ab620 con 0x7f5f240cc690 2023-06-10T18:53:03.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.280+0000 7f5f2bef4640 1 -- 172.21.15.53:0/1083866832 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5f240cc690 msgr2=0x7f5f240d00a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:03.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.280+0000 7f5f2bef4640 1 --2- 172.21.15.53:0/1083866832 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5f240cc690 0x7f5f240d00a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5f240b8110 tx=0x7f5f1401c230 comp rx=0 tx=0).stop 2023-06-10T18:53:03.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.280+0000 7f5f2bef4640 1 -- 172.21.15.53:0/1083866832 shutdown_connections 2023-06-10T18:53:03.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.280+0000 7f5f2bef4640 1 --2- 172.21.15.53:0/1083866832 >> v2:172.21.15.117:3300/0 conn(0x7f5f240d1b00 0x7f5f240d05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:03.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.280+0000 7f5f2bef4640 1 --2- 172.21.15.53:0/1083866832 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5f240cc690 0x7f5f240d00a0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:03.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.280+0000 7f5f2bef4640 1 -- 172.21.15.53:0/1083866832 >> 172.21.15.53:0/1083866832 conn(0x7f5f24069de0 msgr2=0x7f5f2406a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:03.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.280+0000 7f5f2bef4640 1 -- 172.21.15.53:0/1083866832 shutdown_connections 2023-06-10T18:53:03.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.280+0000 7f5f2bef4640 1 -- 172.21.15.53:0/1083866832 wait complete. 2023-06-10T18:53:03.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.280+0000 7f5f2bef4640 1 Processor -- start 2023-06-10T18:53:03.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.280+0000 7f5f2bef4640 1 -- start start 2023-06-10T18:53:03.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.280+0000 7f5f2bef4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5f240b3ac0 0x7f5f24153790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:03.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.280+0000 7f5f2bef4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f240cc690 0x7f5f241590f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:03.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.280+0000 7f5f2bef4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f240d1b00 0x7f5f24154a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:03.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.280+0000 7f5f2bef4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f24153cd0 con 0x7f5f240b3ac0 2023-06-10T18:53:03.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.280+0000 7f5f2bef4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f24159630 con 0x7f5f240cc690 2023-06-10T18:53:03.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.280+0000 7f5f2bef4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2415ce50 con 0x7f5f240d1b00 2023-06-10T18:53:03.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.280+0000 7f5f29c90640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5f240b3ac0 0x7f5f24153790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:03.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.280+0000 7f5f29c90640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5f240b3ac0 0x7f5f24153790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56808/0 (socket says 172.21.15.53:56808) 2023-06-10T18:53:03.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.280+0000 7f5f29c90640 1 -- 172.21.15.53:0/20233709 learned_addr learned my addr 172.21.15.53:0/20233709 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:03.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.280+0000 7f5f2a491640 1 --2- 172.21.15.53:0/20233709 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f240d1b00 0x7f5f24154a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:03.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.280+0000 7f5f2948f640 1 --2- 172.21.15.53:0/20233709 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f240cc690 0x7f5f241590f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:03.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.280+0000 7f5f29c90640 1 -- 172.21.15.53:0/20233709 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f240d1b00 msgr2=0x7f5f24154a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:03.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.280+0000 7f5f29c90640 1 --2- 172.21.15.53:0/20233709 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f240d1b00 0x7f5f24154a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:03.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.280+0000 7f5f29c90640 1 -- 172.21.15.53:0/20233709 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f240cc690 msgr2=0x7f5f241590f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:03.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.280+0000 7f5f29c90640 1 --2- 172.21.15.53:0/20233709 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f240cc690 0x7f5f241590f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:03.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.280+0000 7f5f29c90640 1 -- 172.21.15.53:0/20233709 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f14009420 con 0x7f5f240b3ac0 2023-06-10T18:53:03.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.280+0000 7f5f29c90640 1 --2- 172.21.15.53:0/20233709 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5f240b3ac0 0x7f5f24153790 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5f2000c760 tx=0x7f5f2000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:03.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.280+0000 7f5f1a7fc640 1 -- 172.21.15.53:0/20233709 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f20005ae0 con 0x7f5f240b3ac0 2023-06-10T18:53:03.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.280+0000 7f5f1a7fc640 1 -- 172.21.15.53:0/20233709 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f20005c40 con 0x7f5f240b3ac0 2023-06-10T18:53:03.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.280+0000 7f5f2bef4640 1 -- 172.21.15.53:0/20233709 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f2415d130 con 0x7f5f240b3ac0 2023-06-10T18:53:03.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.280+0000 7f5f1a7fc640 1 -- 172.21.15.53:0/20233709 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f20007070 con 0x7f5f240b3ac0 2023-06-10T18:53:03.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.280+0000 7f5f2bef4640 1 -- 172.21.15.53:0/20233709 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f2415d6f0 con 0x7f5f240b3ac0 2023-06-10T18:53:03.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.284+0000 7f5f1a7fc640 1 -- 172.21.15.53:0/20233709 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5f200071d0 con 0x7f5f240b3ac0 2023-06-10T18:53:03.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.284+0000 7f5f1a7fc640 1 --2- 172.21.15.53:0/20233709 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5f08066280 0x7f5f08068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:03.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.284+0000 7f5f1a7fc640 1 -- 172.21.15.53:0/20233709 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5f20083ac0 con 0x7f5f240b3ac0 2023-06-10T18:53:03.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.284+0000 7f5f2948f640 1 --2- 172.21.15.53:0/20233709 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5f08066280 0x7f5f08068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:03.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.284+0000 7f5f2f010000 1 Processor -- start 2023-06-10T18:53:03.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.284+0000 7f5f2f010000 1 -- start start 2023-06-10T18:53:03.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.284+0000 7f5f2948f640 1 --2- 172.21.15.53:0/20233709 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5f08066280 0x7f5f08068730 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5f140ad000 tx=0x7f5f14008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:03.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.284+0000 7f5f2f010000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b831dc6740 0x55b831dc6b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:03.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.284+0000 7f5f2f010000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b831dc7050 0x55b831d7c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:03.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.284+0000 7f5f2f010000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b831d7cd80 0x55b831d7d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:03.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.284+0000 7f5f2f010000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b831c44ac0 con 0x55b831d7cd80 2023-06-10T18:53:03.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.284+0000 7f5f2f010000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b831b7e840 con 0x55b831dc7050 2023-06-10T18:53:03.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.284+0000 7f5f2f010000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b831bd22e0 con 0x55b831dc6740 2023-06-10T18:53:03.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.284+0000 7f5f2a491640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b831d7cd80 0x55b831d7d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:03.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.284+0000 7f5f2a491640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b831d7cd80 0x55b831d7d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56820/0 (socket says 172.21.15.53:56820) 2023-06-10T18:53:03.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.284+0000 7f5f2a491640 1 -- 172.21.15.53:0/4261951013 learned_addr learned my addr 172.21.15.53:0/4261951013 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:03.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.284+0000 7f5f29c90640 1 --2- 172.21.15.53:0/4261951013 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b831dc6740 0x55b831dc6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:03.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.284+0000 7f5f2948f640 1 --2- 172.21.15.53:0/4261951013 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b831dc7050 0x55b831d7c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:03.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.284+0000 7f5f2a491640 1 -- 172.21.15.53:0/4261951013 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b831dc6740 msgr2=0x55b831dc6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:03.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.284+0000 7f5f2a491640 1 --2- 172.21.15.53:0/4261951013 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b831dc6740 0x55b831dc6b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:03.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.288+0000 7f5f2a491640 1 -- 172.21.15.53:0/4261951013 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b831dc7050 msgr2=0x55b831d7c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:03.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.288+0000 7f5f2a491640 1 --2- 172.21.15.53:0/4261951013 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b831dc7050 0x55b831d7c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:03.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.288+0000 7f5f2a491640 1 -- 172.21.15.53:0/4261951013 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b8318c7890 con 0x55b831d7cd80 2023-06-10T18:53:03.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.288+0000 7f5f2a491640 1 --2- 172.21.15.53:0/4261951013 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b831d7cd80 0x55b831d7d150 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c011360 tx=0x7f5f1c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7cf74f7ead61522 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:03.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.288+0000 7f5f077fe640 1 -- 172.21.15.53:0/4261951013 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f1c00e040 con 0x55b831d7cd80 2023-06-10T18:53:03.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.288+0000 7f5f077fe640 1 -- 172.21.15.53:0/4261951013 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f1c00f040 con 0x55b831d7cd80 2023-06-10T18:53:03.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.288+0000 7f5f077fe640 1 -- 172.21.15.53:0/4261951013 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f1c015a40 con 0x55b831d7cd80 2023-06-10T18:53:03.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.288+0000 7f5f2f010000 1 -- 172.21.15.53:0/4261951013 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b831d7cd80 msgr2=0x55b831d7d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:03.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.288+0000 7f5f2f010000 1 --2- 172.21.15.53:0/4261951013 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b831d7cd80 0x55b831d7d150 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c011360 tx=0x7f5f1c009750 comp rx=0 tx=0).stop 2023-06-10T18:53:03.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.288+0000 7f5f2f010000 1 -- 172.21.15.53:0/4261951013 shutdown_connections 2023-06-10T18:53:03.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.288+0000 7f5f2f010000 1 --2- 172.21.15.53:0/4261951013 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b831d7cd80 0x55b831d7d150 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:03.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.288+0000 7f5f2f010000 1 --2- 172.21.15.53:0/4261951013 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b831dc7050 0x55b831d7c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:03.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.288+0000 7f5f2f010000 1 --2- 172.21.15.53:0/4261951013 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b831dc6740 0x55b831dc6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:03.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.288+0000 7f5f2f010000 1 -- 172.21.15.53:0/4261951013 >> 172.21.15.53:0/4261951013 conn(0x55b831d74800 msgr2=0x55b831d83800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:03.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.288+0000 7f5f2f010000 1 -- 172.21.15.53:0/4261951013 shutdown_connections 2023-06-10T18:53:03.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.288+0000 7f5f2f010000 1 -- 172.21.15.53:0/4261951013 wait complete. 2023-06-10T18:53:03.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.288+0000 7f5f2f010000 1 -- start start 2023-06-10T18:53:03.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.288+0000 7f5f2f010000 1 Processor -- start 2023-06-10T18:53:03.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.288+0000 7f5f2f010000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b831d7cd80 0x55b831d82940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:03.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.288+0000 7f5f2f010000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b831dc6740 0x55b831d880e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:03.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.288+0000 7f5f2f010000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b831dc7050 0x55b831d88620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:03.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.288+0000 7f5f2f010000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b831bcb380 con 0x55b831dc7050 2023-06-10T18:53:03.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.288+0000 7f5f2f010000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b831b87ae0 con 0x55b831d7cd80 2023-06-10T18:53:03.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.288+0000 7f5f2f010000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b831b87780 con 0x55b831dc6740 2023-06-10T18:53:03.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.288+0000 7f5f2f010000 10 client.0 _ll_register_callbacks cb 0x55b831d68e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-10T18:53:03.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.288+0000 7f5f2a491640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b831dc7050 0x55b831d88620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:03.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.288+0000 7f5f2a491640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b831dc7050 0x55b831d88620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56830/0 (socket says 172.21.15.53:56830) 2023-06-10T18:53:03.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.288+0000 7f5f2a491640 1 -- 172.21.15.53:0/2866658661 learned_addr learned my addr 172.21.15.53:0/2866658661 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:03.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.288+0000 7f5f2948f640 1 --2- 172.21.15.53:0/2866658661 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b831dc6740 0x55b831d880e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:03.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.288+0000 7f5f29c90640 1 --2- 172.21.15.53:0/2866658661 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b831d7cd80 0x55b831d82940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:03.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.288+0000 7f5f2a491640 1 -- 172.21.15.53:0/2866658661 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b831dc6740 msgr2=0x55b831d880e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:03.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.288+0000 7f5f2a491640 1 --2- 172.21.15.53:0/2866658661 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b831dc6740 0x55b831d880e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:03.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.288+0000 7f5f2a491640 1 -- 172.21.15.53:0/2866658661 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b831d7cd80 msgr2=0x55b831d82940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:03.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.288+0000 7f5f2a491640 1 --2- 172.21.15.53:0/2866658661 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b831d7cd80 0x55b831d82940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:03.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.288+0000 7f5f2a491640 1 -- 172.21.15.53:0/2866658661 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f1c009dd0 con 0x55b831dc7050 2023-06-10T18:53:03.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.288+0000 7f5f29c90640 1 --2- 172.21.15.53:0/2866658661 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b831d7cd80 0x55b831d82940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:03.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.288+0000 7f5f2a491640 1 --2- 172.21.15.53:0/2866658661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b831dc7050 0x55b831d88620 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c009790 tx=0x7f5f1c004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1960ec7def09321b server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:03.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.288+0000 7f5f04ff9640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-06-10T18:53:03.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.288+0000 7f5f04ff9640 1 -- 172.21.15.53:0/2866658661 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f1c00e040 con 0x55b831dc7050 2023-06-10T18:53:03.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.288+0000 7f5f04ff9640 1 -- 172.21.15.53:0/2866658661 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5f1c003e30 con 0x55b831dc7050 2023-06-10T18:53:03.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.288+0000 7f5f2f010000 1 -- 172.21.15.53:0/2866658661 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b831b92a20 con 0x55b831dc7050 2023-06-10T18:53:03.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.288+0000 7f5f04ff9640 1 -- 172.21.15.53:0/2866658661 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5f1c015e00 con 0x55b831dc7050 2023-06-10T18:53:03.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.288+0000 7f5f2f010000 10 client.4692 fetch_fsmap learned FSMap version 7 2023-06-10T18:53:03.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.288+0000 7f5f2f010000 1 -- 172.21.15.53:0/2866658661 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55b831b8fd10 con 0x55b831dc7050 2023-06-10T18:53:03.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.288+0000 7f5f04ff9640 1 -- 172.21.15.53:0/2866658661 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b831b92a20 con 0x55b831dc7050 2023-06-10T18:53:03.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.288+0000 7f5f04ff9640 1 -- 172.21.15.53:0/2866658661 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 7) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f5f1c01b020 con 0x55b831dc7050 2023-06-10T18:53:03.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.288+0000 7f5f2f010000 10 client.4692 fetch_fsmap finished waiting for FSMap version 7 2023-06-10T18:53:03.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.288+0000 7f5f2f010000 10 client.4692 resolve_mds: resolved name 'd' to daemon mds.d 2023-06-10T18:53:03.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.288+0000 7f5f2f010000 20 client.4692 populate_metadata read hostname 'smithi053' 2023-06-10T18:53:03.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.288+0000 7f5f2f010000 1 --2- 172.21.15.53:0/2866658661 >> [v2:172.21.15.117:6834/1492134415,v1:172.21.15.117:6835/1492134415] conn(0x55b831dd5c80 0x55b831dd8060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:03.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.288+0000 7f5f2f010000 4 client.4692 mds_command: new command op to 4291 tid=0[{"prefix": "get_command_descriptions"}] 2023-06-10T18:53:03.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.288+0000 7f5f2f010000 1 -- 172.21.15.53:0/2866658661 --> [v2:172.21.15.117:6834/1492134415,v1:172.21.15.117:6835/1492134415] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b831bfa710 con 0x55b831dd5c80 2023-06-10T18:53:03.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.292+0000 7f5f29c90640 1 --2- 172.21.15.53:0/2866658661 >> [v2:172.21.15.117:6834/1492134415,v1:172.21.15.117:6835/1492134415] conn(0x55b831dd5c80 0x55b831dd8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:03.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.292+0000 7f5f04ff9640 10 client.4692 ms_handle_connect on v2:172.21.15.117:6834/1492134415 2023-06-10T18:53:03.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.292+0000 7f5f29c90640 1 --2- 172.21.15.53:0/2866658661 >> [v2:172.21.15.117:6834/1492134415,v1:172.21.15.117:6835/1492134415] conn(0x55b831dd5c80 0x55b831dd8060 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=79f3b29874d76eeb server_cookie=8ab2bed38f53bd73 in_seq=0 out_seq=0 2023-06-10T18:53:03.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.292+0000 7f5f04ff9640 1 -- 172.21.15.53:0/2866658661 <== mds.0 v2:172.21.15.117:6834/1492134415 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55b831bfa710 con 0x55b831dd5c80 2023-06-10T18:53:03.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.292+0000 7f5f04ff9640 10 client.4692 handle_command_reply: tid=0 2023-06-10T18:53:03.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.292+0000 7f5f2f010000 1 client.4692 shutdown 2023-06-10T18:53:03.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.292+0000 7f5f2f010000 1 -- 172.21.15.53:0/2866658661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b831dc7050 msgr2=0x55b831d88620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:03.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.292+0000 7f5f2f010000 1 --2- 172.21.15.53:0/2866658661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b831dc7050 0x55b831d88620 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c009790 tx=0x7f5f1c004ac0 comp rx=0 tx=0).stop 2023-06-10T18:53:03.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.292+0000 7f5f2f010000 1 -- 172.21.15.53:0/2866658661 shutdown_connections 2023-06-10T18:53:03.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.292+0000 7f5f2f010000 1 --2- 172.21.15.53:0/2866658661 >> [v2:172.21.15.117:6834/1492134415,v1:172.21.15.117:6835/1492134415] conn(0x55b831dd5c80 0x55b831dd8060 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:03.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.292+0000 7f5f2f010000 1 --2- 172.21.15.53:0/2866658661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b831dc7050 0x55b831d88620 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:03.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.292+0000 7f5f2f010000 1 --2- 172.21.15.53:0/2866658661 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b831dc6740 0x55b831d880e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:03.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.292+0000 7f5f04ff9640 0 client.4692 ms_handle_reset on v2:172.21.15.117:6834/1492134415 2023-06-10T18:53:03.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.292+0000 7f5f2f010000 1 --2- 172.21.15.53:0/2866658661 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b831d7cd80 0x55b831d82940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:03.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.292+0000 7f5f2f010000 1 -- 172.21.15.53:0/2866658661 >> 172.21.15.53:0/2866658661 conn(0x55b831d74800 msgr2=0x55b831d7b830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:03.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.292+0000 7f5f2f010000 1 -- 172.21.15.53:0/2866658661 shutdown_connections 2023-06-10T18:53:03.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.292+0000 7f5f2f010000 1 -- 172.21.15.53:0/2866658661 wait complete. 2023-06-10T18:53:03.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.292+0000 7f5f2f010000 20 client.4692 trim_cache size 0 max 16384 2023-06-10T18:53:03.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.308+0000 7f5f2f010000 1 Processor -- start 2023-06-10T18:53:03.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.308+0000 7f5f2f010000 1 -- start start 2023-06-10T18:53:03.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.308+0000 7f5f2f010000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b831d7cd80 0x55b831dd9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:03.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.308+0000 7f5f2f010000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b831dc6740 0x55b831dd6050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:03.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.308+0000 7f5f2f010000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b831dc7050 0x55b831dd6590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:03.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.308+0000 7f5f2f010000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b831888940 con 0x55b831dc7050 2023-06-10T18:53:03.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.308+0000 7f5f2f010000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b831d81340 con 0x55b831dc6740 2023-06-10T18:53:03.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.308+0000 7f5f2f010000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b831c0ead0 con 0x55b831d7cd80 2023-06-10T18:53:03.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.308+0000 7f5f2a491640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b831dc7050 0x55b831dd6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:03.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.308+0000 7f5f2a491640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b831dc7050 0x55b831dd6590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56840/0 (socket says 172.21.15.53:56840) 2023-06-10T18:53:03.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.308+0000 7f5f2a491640 1 -- 172.21.15.53:0/216517174 learned_addr learned my addr 172.21.15.53:0/216517174 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:03.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.308+0000 7f5f2a491640 1 -- 172.21.15.53:0/216517174 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b831d7cd80 msgr2=0x55b831dd9fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:03.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.308+0000 7f5f2a491640 1 --2- 172.21.15.53:0/216517174 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b831d7cd80 0x55b831dd9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:03.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.308+0000 7f5f2948f640 1 --2- 172.21.15.53:0/216517174 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b831dc6740 0x55b831dd6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:03.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.308+0000 7f5f2a491640 1 -- 172.21.15.53:0/216517174 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b831dc6740 msgr2=0x55b831dd6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:03.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.308+0000 7f5f2a491640 1 --2- 172.21.15.53:0/216517174 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b831dc6740 0x55b831dd6050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:03.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.308+0000 7f5f2a491640 1 -- 172.21.15.53:0/216517174 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b831d7f450 con 0x55b831dc7050 2023-06-10T18:53:03.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.308+0000 7f5f2a491640 1 --2- 172.21.15.53:0/216517174 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b831dc7050 0x55b831dd6590 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c000f90 tx=0x7f5f1c021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33de204928bb689a server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:03.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.308+0000 7f5f07fff640 1 -- 172.21.15.53:0/216517174 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f1c003cb0 con 0x55b831dc7050 2023-06-10T18:53:03.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.308+0000 7f5f07fff640 1 -- 172.21.15.53:0/216517174 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f1c003e10 con 0x55b831dc7050 2023-06-10T18:53:03.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.308+0000 7f5f07fff640 1 -- 172.21.15.53:0/216517174 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f1c015e40 con 0x55b831dc7050 2023-06-10T18:53:03.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.312+0000 7f5f2f010000 1 -- 172.21.15.53:0/216517174 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b831dc7050 msgr2=0x55b831dd6590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:03.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.312+0000 7f5f2f010000 1 --2- 172.21.15.53:0/216517174 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b831dc7050 0x55b831dd6590 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c000f90 tx=0x7f5f1c021000 comp rx=0 tx=0).stop 2023-06-10T18:53:03.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.312+0000 7f5f2f010000 1 -- 172.21.15.53:0/216517174 shutdown_connections 2023-06-10T18:53:03.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.312+0000 7f5f2f010000 1 --2- 172.21.15.53:0/216517174 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b831dc7050 0x55b831dd6590 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:03.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.312+0000 7f5f2f010000 1 --2- 172.21.15.53:0/216517174 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b831dc6740 0x55b831dd6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:03.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.312+0000 7f5f2f010000 1 --2- 172.21.15.53:0/216517174 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b831d7cd80 0x55b831dd9fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:03.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.312+0000 7f5f2f010000 1 -- 172.21.15.53:0/216517174 >> 172.21.15.53:0/216517174 conn(0x55b831d74800 msgr2=0x55b831d7beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:03.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.312+0000 7f5f2f010000 1 -- 172.21.15.53:0/216517174 shutdown_connections 2023-06-10T18:53:03.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.312+0000 7f5f2f010000 1 -- 172.21.15.53:0/216517174 wait complete. 2023-06-10T18:53:03.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.312+0000 7f5f2f010000 1 -- start start 2023-06-10T18:53:03.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.312+0000 7f5f2f010000 1 Processor -- start 2023-06-10T18:53:03.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.312+0000 7f5f2f010000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b831d7cd80 0x55b831dd9710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:03.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.312+0000 7f5f2f010000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b831dc6740 0x55b831de14c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:03.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.312+0000 7f5f2f010000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b831dc7050 0x55b831de1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:03.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.312+0000 7f5f2f010000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b831b73450 con 0x55b831dc7050 2023-06-10T18:53:03.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.312+0000 7f5f2f010000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b831b9a320 con 0x55b831d7cd80 2023-06-10T18:53:03.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.312+0000 7f5f2f010000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b831bc6cf0 con 0x55b831dc6740 2023-06-10T18:53:03.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.312+0000 7f5f2f010000 10 client.0 _ll_register_callbacks cb 0x55b831b8f7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-10T18:53:03.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.312+0000 7f5f2a491640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b831dc7050 0x55b831de1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:03.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.312+0000 7f5f2a491640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b831dc7050 0x55b831de1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56854/0 (socket says 172.21.15.53:56854) 2023-06-10T18:53:03.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.312+0000 7f5f2a491640 1 -- 172.21.15.53:0/569991024 learned_addr learned my addr 172.21.15.53:0/569991024 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:03.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.312+0000 7f5f2948f640 1 --2- 172.21.15.53:0/569991024 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b831dc6740 0x55b831de14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:03.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.312+0000 7f5f29c90640 1 --2- 172.21.15.53:0/569991024 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b831d7cd80 0x55b831dd9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:03.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.312+0000 7f5f2a491640 1 -- 172.21.15.53:0/569991024 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b831dc6740 msgr2=0x55b831de14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:03.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.312+0000 7f5f2a491640 1 --2- 172.21.15.53:0/569991024 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b831dc6740 0x55b831de14c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:03.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.312+0000 7f5f2a491640 1 -- 172.21.15.53:0/569991024 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b831d7cd80 msgr2=0x55b831dd9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:03.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.312+0000 7f5f2a491640 1 --2- 172.21.15.53:0/569991024 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b831d7cd80 0x55b831dd9710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:03.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.312+0000 7f5f2a491640 1 -- 172.21.15.53:0/569991024 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b831b8fd10 con 0x55b831dc7050 2023-06-10T18:53:03.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.312+0000 7f5f2a491640 1 --2- 172.21.15.53:0/569991024 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b831dc7050 0x55b831de1a00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c0112e0 tx=0x7f5f1c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=521f9bee69ef7947 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:03.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.312+0000 7f5f04ff9640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-06-10T18:53:03.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.312+0000 7f5f04ff9640 1 -- 172.21.15.53:0/569991024 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f1c003cb0 con 0x55b831dc7050 2023-06-10T18:53:03.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.312+0000 7f5f04ff9640 1 -- 172.21.15.53:0/569991024 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5f1c03a450 con 0x55b831dc7050 2023-06-10T18:53:03.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.312+0000 7f5f2f010000 1 -- 172.21.15.53:0/569991024 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b831d806e0 con 0x55b831dc7050 2023-06-10T18:53:03.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.312+0000 7f5f04ff9640 1 -- 172.21.15.53:0/569991024 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5f1c03a610 con 0x55b831dc7050 2023-06-10T18:53:03.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.312+0000 7f5f2f010000 10 client.4698 fetch_fsmap learned FSMap version 7 2023-06-10T18:53:03.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.312+0000 7f5f2f010000 1 -- 172.21.15.53:0/569991024 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55b831b75fa0 con 0x55b831dc7050 2023-06-10T18:53:03.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.312+0000 7f5f04ff9640 1 -- 172.21.15.53:0/569991024 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b831d806e0 con 0x55b831dc7050 2023-06-10T18:53:03.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.312+0000 7f5f04ff9640 1 -- 172.21.15.53:0/569991024 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 7) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f5f1c01b040 con 0x55b831dc7050 2023-06-10T18:53:03.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.312+0000 7f5f2f010000 10 client.4698 fetch_fsmap finished waiting for FSMap version 7 2023-06-10T18:53:03.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.312+0000 7f5f2f010000 10 client.4698 resolve_mds: resolved name 'd' to daemon mds.d 2023-06-10T18:53:03.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.312+0000 7f5f2f010000 20 client.4698 populate_metadata read hostname 'smithi053' 2023-06-10T18:53:03.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.312+0000 7f5f2f010000 1 --2- 172.21.15.53:0/569991024 >> [v2:172.21.15.117:6834/1492134415,v1:172.21.15.117:6835/1492134415] conn(0x55b831e24d10 0x55b831e250e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:03.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.312+0000 7f5f2f010000 4 client.4698 mds_command: new command op to 4291 tid=0[{"prefix": "status"}] 2023-06-10T18:53:03.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.312+0000 7f5f2f010000 1 -- 172.21.15.53:0/569991024 --> [v2:172.21.15.117:6834/1492134415,v1:172.21.15.117:6835/1492134415] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55b831bc9cd0 con 0x55b831e24d10 2023-06-10T18:53:03.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.312+0000 7f5f29c90640 1 --2- 172.21.15.53:0/569991024 >> [v2:172.21.15.117:6834/1492134415,v1:172.21.15.117:6835/1492134415] conn(0x55b831e24d10 0x55b831e250e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:03.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.316+0000 7f5f04ff9640 10 client.4698 ms_handle_connect on v2:172.21.15.117:6834/1492134415 2023-06-10T18:53:03.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.316+0000 7f5f29c90640 1 --2- 172.21.15.53:0/569991024 >> [v2:172.21.15.117:6834/1492134415,v1:172.21.15.117:6835/1492134415] conn(0x55b831e24d10 0x55b831e250e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44854e6d05abbf64 server_cookie=9e3a4e3412e1e686 in_seq=0 out_seq=0 2023-06-10T18:53:03.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.316+0000 7f5f04ff9640 1 -- 172.21.15.53:0/569991024 <== mds.0 v2:172.21.15.117:6834/1492134415 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x7f5f2007f160 con 0x55b831e24d10 2023-06-10T18:53:03.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.316+0000 7f5f04ff9640 10 client.4698 handle_command_reply: tid=0 2023-06-10T18:53:03.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.316+0000 7f5f2f010000 1 client.4698 shutdown 2023-06-10T18:53:03.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.316+0000 7f5f2f010000 1 -- 172.21.15.53:0/569991024 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b831dc7050 msgr2=0x55b831de1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:03.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.316+0000 7f5f2f010000 1 --2- 172.21.15.53:0/569991024 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b831dc7050 0x55b831de1a00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c0112e0 tx=0x7f5f1c00b040 comp rx=0 tx=0).stop 2023-06-10T18:53:03.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.316+0000 7f5f2f010000 1 -- 172.21.15.53:0/569991024 shutdown_connections 2023-06-10T18:53:03.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.316+0000 7f5f2f010000 1 --2- 172.21.15.53:0/569991024 >> [v2:172.21.15.117:6834/1492134415,v1:172.21.15.117:6835/1492134415] conn(0x55b831e24d10 0x55b831e250e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:03.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.316+0000 7f5f2f010000 1 --2- 172.21.15.53:0/569991024 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b831dc7050 0x55b831de1a00 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:03.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.316+0000 7f5f2f010000 1 --2- 172.21.15.53:0/569991024 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55b831dc6740 0x55b831de14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:03.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.316+0000 7f5f04ff9640 0 client.4698 ms_handle_reset on v2:172.21.15.117:6834/1492134415 2023-06-10T18:53:03.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.316+0000 7f5f2f010000 1 --2- 172.21.15.53:0/569991024 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b831d7cd80 0x55b831dd9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:03.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.316+0000 7f5f2f010000 1 -- 172.21.15.53:0/569991024 >> 172.21.15.53:0/569991024 conn(0x55b831d74800 msgr2=0x55b831dc5070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:03.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.316+0000 7f5f2f010000 1 -- 172.21.15.53:0/569991024 shutdown_connections 2023-06-10T18:53:03.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.316+0000 7f5f2f010000 1 -- 172.21.15.53:0/569991024 wait complete. 2023-06-10T18:53:03.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.316+0000 7f5f2f010000 20 client.4698 trim_cache size 0 max 16384 2023-06-10T18:53:03.333 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-06-10T18:53:03.334 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_fsid": "c8c64bed-c406-4936-93f9-d16335f1067d", 2023-06-10T18:53:03.334 INFO:teuthology.orchestra.run.smithi053.stdout: "whoami": 0, 2023-06-10T18:53:03.334 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 4291, 2023-06-10T18:53:03.334 INFO:teuthology.orchestra.run.smithi053.stdout: "want_state": "up:active", 2023-06-10T18:53:03.334 INFO:teuthology.orchestra.run.smithi053.stdout: "state": "up:active", 2023-06-10T18:53:03.334 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs", 2023-06-10T18:53:03.334 INFO:teuthology.orchestra.run.smithi053.stdout: "rank_uptime": 18.394902636000001, 2023-06-10T18:53:03.335 INFO:teuthology.orchestra.run.smithi053.stdout: "mdsmap_epoch": 7, 2023-06-10T18:53:03.335 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch": 23, 2023-06-10T18:53:03.335 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch_barrier": 23, 2023-06-10T18:53:03.335 INFO:teuthology.orchestra.run.smithi053.stdout: "uptime": 22.690178357000001 2023-06-10T18:53:03.335 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-06-10T18:53:03.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.316+0000 7f5f2bef4640 1 -- 172.21.15.53:0/20233709 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5f08066280 msgr2=0x7f5f08068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:03.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.316+0000 7f5f2bef4640 1 --2- 172.21.15.53:0/20233709 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5f08066280 0x7f5f08068730 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5f140ad000 tx=0x7f5f14008040 comp rx=0 tx=0).stop 2023-06-10T18:53:03.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.316+0000 7f5f2bef4640 1 -- 172.21.15.53:0/20233709 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5f240b3ac0 msgr2=0x7f5f24153790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:03.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.316+0000 7f5f2bef4640 1 --2- 172.21.15.53:0/20233709 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5f240b3ac0 0x7f5f24153790 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5f2000c760 tx=0x7f5f2000cc20 comp rx=0 tx=0).stop 2023-06-10T18:53:03.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.316+0000 7f5f2bef4640 1 -- 172.21.15.53:0/20233709 shutdown_connections 2023-06-10T18:53:03.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.316+0000 7f5f2bef4640 1 --2- 172.21.15.53:0/20233709 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5f08066280 0x7f5f08068730 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:03.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.316+0000 7f5f2bef4640 1 --2- 172.21.15.53:0/20233709 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f240d1b00 0x7f5f24154a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:03.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.316+0000 7f5f2bef4640 1 --2- 172.21.15.53:0/20233709 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f240cc690 0x7f5f241590f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:03.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.316+0000 7f5f2bef4640 1 --2- 172.21.15.53:0/20233709 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5f240b3ac0 0x7f5f24153790 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:03.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.316+0000 7f5f2bef4640 1 -- 172.21.15.53:0/20233709 >> 172.21.15.53:0/20233709 conn(0x7f5f24069de0 msgr2=0x7f5f240b4f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:03.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.316+0000 7f5f2bef4640 1 -- 172.21.15.53:0/20233709 shutdown_connections 2023-06-10T18:53:03.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.316+0000 7f5f2bef4640 1 -- 172.21.15.53:0/20233709 wait complete. 2023-06-10T18:53:03.341 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-06-10T18:53:03.364 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-06-10T18:53:03.365 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-06-10T18:53:03.365 INFO:tasks.ceph_fuse:client.0 config is {} 2023-06-10T18:53:03.365 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-06-10T18:53:03.366 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-06-10T18:53:03.366 INFO:tasks.ceph_fuse:client.2 config is {} 2023-06-10T18:53:03.366 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-06-10T18:53:03.366 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-06-10T18:53:03.367 INFO:tasks.ceph_fuse:client.1 config is {} 2023-06-10T18:53:03.367 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-06-10T18:53:03.367 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-06-10T18:53:03.367 INFO:tasks.ceph_fuse:client.3 config is {} 2023-06-10T18:53:03.367 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-06-10T18:53:03.367 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-06-10T18:53:03.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:53:03.368 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list 2023-06-10T18:53:03.375 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:53:03.376 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link delete ceph-brx 2023-06-10T18:53:03.434 INFO:teuthology.orchestra.run.smithi117.stderr:Cannot find device "ceph-brx" 2023-06-10T18:53:03.436 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-10T18:53:03.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:53:03.437 DEBUG:teuthology.orchestra.run.smithi053:> ip netns list 2023-06-10T18:53:03.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:53:03.444 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link delete ceph-brx 2023-06-10T18:53:03.504 INFO:teuthology.orchestra.run.smithi053.stderr:Cannot find device "ceph-brx" 2023-06-10T18:53:03.505 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-10T18:53:03.506 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-06-10T18:53:03.506 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-10T18:53:03.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.668+0000 7fe4f527d640 1 Processor -- start 2023-06-10T18:53:03.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.668+0000 7fe4f527d640 1 -- start start 2023-06-10T18:53:03.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.668+0000 7fe4f527d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe4f006b2f0 0x7fe4f006f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:03.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.668+0000 7fe4f527d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4f00c8d00 0x7fe4f006b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:03.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.668+0000 7fe4f527d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe4f006bc00 0x7fe4f00cbe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:03.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.668+0000 7fe4f527d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4f0158a90 con 0x7fe4f006b2f0 2023-06-10T18:53:03.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.668+0000 7fe4f527d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4f00705d0 con 0x7fe4f006bc00 2023-06-10T18:53:03.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.668+0000 7fe4f527d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f006f9c0 con 0x7fe4f00c8d00 2023-06-10T18:53:03.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.668+0000 7fe4eeffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe4f006b2f0 0x7fe4f006f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:03.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.668+0000 7fe4eeffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe4f006b2f0 0x7fe4f006f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56868/0 (socket says 172.21.15.53:56868) 2023-06-10T18:53:03.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.668+0000 7fe4eeffd640 1 -- 172.21.15.53:0/3691801363 learned_addr learned my addr 172.21.15.53:0/3691801363 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:03.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.668+0000 7fe4ee7fc640 1 --2- 172.21.15.53:0/3691801363 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4f00c8d00 0x7fe4f006b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:03.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.668+0000 7fe4ef7fe640 1 --2- 172.21.15.53:0/3691801363 >> v2:172.21.15.117:3300/0 conn(0x7fe4f006bc00 0x7fe4f00cbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:03.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.668+0000 7fe4eeffd640 1 -- 172.21.15.53:0/3691801363 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4f00c8d00 msgr2=0x7fe4f006b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:03.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.668+0000 7fe4eeffd640 1 --2- 172.21.15.53:0/3691801363 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4f00c8d00 0x7fe4f006b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:03.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.668+0000 7fe4eeffd640 1 -- 172.21.15.53:0/3691801363 >> v2:172.21.15.117:3300/0 conn(0x7fe4f006bc00 msgr2=0x7fe4f00cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:03.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.668+0000 7fe4eeffd640 1 --2- 172.21.15.53:0/3691801363 >> v2:172.21.15.117:3300/0 conn(0x7fe4f006bc00 0x7fe4f00cbe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:03.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.668+0000 7fe4eeffd640 1 -- 172.21.15.53:0/3691801363 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4f006fca0 con 0x7fe4f006b2f0 2023-06-10T18:53:03.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.668+0000 7fe4ee7fc640 1 --2- 172.21.15.53:0/3691801363 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4f00c8d00 0x7fe4f006b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:03.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.668+0000 7fe4ef7fe640 1 --2- 172.21.15.53:0/3691801363 >> v2:172.21.15.117:3300/0 conn(0x7fe4f006bc00 0x7fe4f00cbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:03.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.672+0000 7fe4eeffd640 1 --2- 172.21.15.53:0/3691801363 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4f006b2f0 0x7fe4f006f070 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe4e4009870 tx=0x7fe4e401ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d9da35f5a2fe4a server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:03.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.672+0000 7fe4edffb640 1 -- 172.21.15.53:0/3691801363 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e40a89b0 con 0x7fe4f006b2f0 2023-06-10T18:53:03.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.672+0000 7fe4edffb640 1 -- 172.21.15.53:0/3691801363 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4e40a8b10 con 0x7fe4f006b2f0 2023-06-10T18:53:03.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.672+0000 7fe4edffb640 1 -- 172.21.15.53:0/3691801363 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e40a8ea0 con 0x7fe4f006b2f0 2023-06-10T18:53:03.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.672+0000 7fe4f527d640 1 -- 172.21.15.53:0/3691801363 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4f006b2f0 msgr2=0x7fe4f006f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:03.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.672+0000 7fe4f527d640 1 --2- 172.21.15.53:0/3691801363 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4f006b2f0 0x7fe4f006f070 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe4e4009870 tx=0x7fe4e401ecf0 comp rx=0 tx=0).stop 2023-06-10T18:53:03.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.672+0000 7fe4f527d640 1 -- 172.21.15.53:0/3691801363 shutdown_connections 2023-06-10T18:53:03.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.672+0000 7fe4f527d640 1 --2- 172.21.15.53:0/3691801363 >> v2:172.21.15.117:3300/0 conn(0x7fe4f006bc00 0x7fe4f00cbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:03.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.672+0000 7fe4f527d640 1 --2- 172.21.15.53:0/3691801363 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4f00c8d00 0x7fe4f006b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:03.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.672+0000 7fe4f527d640 1 --2- 172.21.15.53:0/3691801363 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4f006b2f0 0x7fe4f006f070 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:03.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.672+0000 7fe4f527d640 1 -- 172.21.15.53:0/3691801363 >> 172.21.15.53:0/3691801363 conn(0x7fe4f006a0d0 msgr2=0x7fe4f00ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:03.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.672+0000 7fe4f527d640 1 -- 172.21.15.53:0/3691801363 shutdown_connections 2023-06-10T18:53:03.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.672+0000 7fe4f527d640 1 -- 172.21.15.53:0/3691801363 wait complete. 2023-06-10T18:53:03.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.672+0000 7fe4f527d640 1 Processor -- start 2023-06-10T18:53:03.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.672+0000 7fe4f527d640 1 -- start start 2023-06-10T18:53:03.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.672+0000 7fe4f527d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4f006b2f0 0x7fe4f014f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:03.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.672+0000 7fe4f527d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4f006bc00 0x7fe4f0150e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:03.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.672+0000 7fe4f527d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4f00c8d00 0x7fe4f01513d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:03.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.672+0000 7fe4f527d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f00b1df0 con 0x7fe4f006b2f0 2023-06-10T18:53:03.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.672+0000 7fe4f527d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f015a180 con 0x7fe4f006bc00 2023-06-10T18:53:03.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.672+0000 7fe4f527d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f00b2040 con 0x7fe4f00c8d00 2023-06-10T18:53:03.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.672+0000 7fe4eeffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4f006b2f0 0x7fe4f014f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:03.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.672+0000 7fe4eeffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4f006b2f0 0x7fe4f014f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56876/0 (socket says 172.21.15.53:56876) 2023-06-10T18:53:03.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.676+0000 7fe4eeffd640 1 -- 172.21.15.53:0/2272079108 learned_addr learned my addr 172.21.15.53:0/2272079108 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:03.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.676+0000 7fe4ee7fc640 1 --2- 172.21.15.53:0/2272079108 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4f006bc00 0x7fe4f0150e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:03.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.676+0000 7fe4ef7fe640 1 --2- 172.21.15.53:0/2272079108 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4f00c8d00 0x7fe4f01513d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:03.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.676+0000 7fe4eeffd640 1 -- 172.21.15.53:0/2272079108 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4f00c8d00 msgr2=0x7fe4f01513d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:03.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.676+0000 7fe4eeffd640 1 --2- 172.21.15.53:0/2272079108 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4f00c8d00 0x7fe4f01513d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:03.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.676+0000 7fe4eeffd640 1 -- 172.21.15.53:0/2272079108 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4f006bc00 msgr2=0x7fe4f0150e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:03.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.676+0000 7fe4eeffd640 1 --2- 172.21.15.53:0/2272079108 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4f006bc00 0x7fe4f0150e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:03.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.676+0000 7fe4eeffd640 1 -- 172.21.15.53:0/2272079108 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4e40094d0 con 0x7fe4f006b2f0 2023-06-10T18:53:03.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.676+0000 7fe4eeffd640 1 --2- 172.21.15.53:0/2272079108 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4f006b2f0 0x7fe4f014f010 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe4e40b3040 tx=0x7fe4e401ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:03.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.676+0000 7fe4d77fe640 1 -- 172.21.15.53:0/2272079108 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e40be070 con 0x7fe4f006b2f0 2023-06-10T18:53:03.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.676+0000 7fe4d77fe640 1 -- 172.21.15.53:0/2272079108 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4e40ba400 con 0x7fe4f006b2f0 2023-06-10T18:53:03.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.676+0000 7fe4f527d640 1 -- 172.21.15.53:0/2272079108 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4f00b2320 con 0x7fe4f006b2f0 2023-06-10T18:53:03.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.676+0000 7fe4d77fe640 1 -- 172.21.15.53:0/2272079108 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e40ba7b0 con 0x7fe4f006b2f0 2023-06-10T18:53:03.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.676+0000 7fe4f527d640 1 -- 172.21.15.53:0/2272079108 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4f014f550 con 0x7fe4f006b2f0 2023-06-10T18:53:03.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.676+0000 7fe4f527d640 1 -- 172.21.15.53:0/2272079108 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4f004d790 con 0x7fe4f006b2f0 2023-06-10T18:53:03.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.676+0000 7fe4d77fe640 1 -- 172.21.15.53:0/2272079108 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe4e40ba910 con 0x7fe4f006b2f0 2023-06-10T18:53:03.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.676+0000 7fe4d77fe640 1 --2- 172.21.15.53:0/2272079108 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe4dc066280 0x7fe4dc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:03.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.676+0000 7fe4d77fe640 1 -- 172.21.15.53:0/2272079108 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe4e4121b30 con 0x7fe4f006b2f0 2023-06-10T18:53:03.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.676+0000 7fe4ee7fc640 1 --2- 172.21.15.53:0/2272079108 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe4dc066280 0x7fe4dc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:03.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.676+0000 7fe4ee7fc640 1 --2- 172.21.15.53:0/2272079108 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe4dc066280 0x7fe4dc068730 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe4e0006fd0 tx=0x7fe4e0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:03.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.680+0000 7fe4d77fe640 1 -- 172.21.15.53:0/2272079108 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe4e40ef040 con 0x7fe4f006b2f0 2023-06-10T18:53:03.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.872+0000 7fe4f527d640 1 -- 172.21.15.53:0/2272079108 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe4f00af360 con 0x7fe4f006b2f0 2023-06-10T18:53:03.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.872+0000 7fe4d77fe640 1 -- 172.21.15.53:0/2272079108 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe4e40b5060 con 0x7fe4f006b2f0 2023-06-10T18:53:03.881 INFO:teuthology.orchestra.run.smithi053.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-06-10T18:53:03.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.872+0000 7fe4f527d640 1 -- 172.21.15.53:0/2272079108 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe4dc066280 msgr2=0x7fe4dc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:03.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.872+0000 7fe4f527d640 1 --2- 172.21.15.53:0/2272079108 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe4dc066280 0x7fe4dc068730 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe4e0006fd0 tx=0x7fe4e0008040 comp rx=0 tx=0).stop 2023-06-10T18:53:03.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.872+0000 7fe4f527d640 1 -- 172.21.15.53:0/2272079108 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4f006b2f0 msgr2=0x7fe4f014f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:03.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.872+0000 7fe4f527d640 1 --2- 172.21.15.53:0/2272079108 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4f006b2f0 0x7fe4f014f010 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe4e40b3040 tx=0x7fe4e401ba90 comp rx=0 tx=0).stop 2023-06-10T18:53:03.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.872+0000 7fe4f527d640 1 -- 172.21.15.53:0/2272079108 shutdown_connections 2023-06-10T18:53:03.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.872+0000 7fe4f527d640 1 --2- 172.21.15.53:0/2272079108 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe4dc066280 0x7fe4dc068730 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:03.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.872+0000 7fe4f527d640 1 --2- 172.21.15.53:0/2272079108 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4f00c8d00 0x7fe4f01513d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:03.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.872+0000 7fe4f527d640 1 --2- 172.21.15.53:0/2272079108 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4f006bc00 0x7fe4f0150e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:03.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.872+0000 7fe4f527d640 1 --2- 172.21.15.53:0/2272079108 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4f006b2f0 0x7fe4f014f010 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:03.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.872+0000 7fe4f527d640 1 -- 172.21.15.53:0/2272079108 >> 172.21.15.53:0/2272079108 conn(0x7fe4f006a0d0 msgr2=0x7fe4f01545e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:03.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.872+0000 7fe4f527d640 1 -- 172.21.15.53:0/2272079108 shutdown_connections 2023-06-10T18:53:03.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:03.872+0000 7fe4f527d640 1 -- 172.21.15.53:0/2272079108 wait complete. 2023-06-10T18:53:03.900 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-10T18:53:03.900 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-10T18:53:03.900 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi053.front.sepia.ceph.com 2023-06-10T18:53:03.901 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-06-10T18:53:03.901 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-06-10T18:53:03.901 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-10T18:53:03.901 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-10T18:53:03.901 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-10T18:53:03.902 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-06-10T18:53:03.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:53:03.902 DEBUG:teuthology.orchestra.run.smithi053:> ip addr 2023-06-10T18:53:03.907 INFO:teuthology.orchestra.run.smithi053.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-10T18:53:03.908 INFO:teuthology.orchestra.run.smithi053.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-10T18:53:03.908 INFO:teuthology.orchestra.run.smithi053.stdout: inet 127.0.0.1/8 scope host lo 2023-06-10T18:53:03.908 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:53:03.908 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 ::1/128 scope host 2023-06-10T18:53:03.908 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:53:03.908 INFO:teuthology.orchestra.run.smithi053.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T18:53:03.909 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:da brd ff:ff:ff:ff:ff:ff 2023-06-10T18:53:03.909 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f0 2023-06-10T18:53:03.909 INFO:teuthology.orchestra.run.smithi053.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T18:53:03.909 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:db brd ff:ff:ff:ff:ff:ff 2023-06-10T18:53:03.909 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f1 2023-06-10T18:53:03.909 INFO:teuthology.orchestra.run.smithi053.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-10T18:53:03.909 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:18 brd ff:ff:ff:ff:ff:ff 2023-06-10T18:53:03.910 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f0 2023-06-10T18:53:03.910 INFO:teuthology.orchestra.run.smithi053.stdout: inet 172.21.15.53/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-06-10T18:53:03.910 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft 42465sec preferred_lft 42465sec 2023-06-10T18:53:03.910 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::ae1f:6bff:fef8:3718/64 scope link 2023-06-10T18:53:03.910 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:53:03.910 INFO:teuthology.orchestra.run.smithi053.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T18:53:03.910 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:19 brd ff:ff:ff:ff:ff:ff 2023-06-10T18:53:03.910 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f1 2023-06-10T18:53:03.911 INFO:teuthology.orchestra.run.smithi053.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-06-10T18:53:03.911 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 02:42:49:3d:ee:1e brd ff:ff:ff:ff:ff:ff 2023-06-10T18:53:03.911 INFO:teuthology.orchestra.run.smithi053.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-06-10T18:53:03.911 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:53:03.911 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-06-10T18:53:03.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:53:03.912 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec bash -c ' 2023-06-10T18:53:03.912 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2023-06-10T18:53:03.912 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link add name ceph-brx type bridge 2023-06-10T18:53:03.913 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip addr flush dev ceph-brx 2023-06-10T18:53:03.913 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link set ceph-brx up 2023-06-10T18:53:03.913 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-06-10T18:53:03.913 DEBUG:teuthology.orchestra.run.smithi053:> ') 2023-06-10T18:53:03.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:53:03.989 DEBUG:teuthology.orchestra.run.smithi053:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-10T18:53:04.044 INFO:teuthology.orchestra.run.smithi053.stdout:1 2023-06-10T18:53:04.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:53:04.046 DEBUG:teuthology.orchestra.run.smithi053:> route 2023-06-10T18:53:04.110 INFO:teuthology.orchestra.run.smithi053.stdout:Kernel IP routing table 2023-06-10T18:53:04.110 INFO:teuthology.orchestra.run.smithi053.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-10T18:53:04.110 INFO:teuthology.orchestra.run.smithi053.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-06-10T18:53:04.111 INFO:teuthology.orchestra.run.smithi053.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-06-10T18:53:04.111 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-06-10T18:53:04.111 INFO:teuthology.orchestra.run.smithi053.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-10T18:53:04.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:53:04.112 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec bash -c ' 2023-06-10T18:53:04.113 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2023-06-10T18:53:04.113 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-06-10T18:53:04.113 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-06-10T18:53:04.114 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-06-10T18:53:04.114 DEBUG:teuthology.orchestra.run.smithi053:> ') 2023-06-10T18:53:04.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:53:04.186 DEBUG:teuthology.orchestra.run.smithi053:> ip netns list 2023-06-10T18:53:04.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:53:04.234 DEBUG:teuthology.orchestra.run.smithi053:> ip netns list-id 2023-06-10T18:53:04.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:53:04.282 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec bash -c ' 2023-06-10T18:53:04.282 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2023-06-10T18:53:04.282 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-06-10T18:53:04.283 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-06-10T18:53:04.283 DEBUG:teuthology.orchestra.run.smithi053:> ') 2023-06-10T18:53:04.351 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-06-10T18:53:04.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:53:04.352 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec bash -c ' 2023-06-10T18:53:04.353 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2023-06-10T18:53:04.353 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-06-10T18:53:04.353 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-06-10T18:53:04.353 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-06-10T18:53:04.353 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-06-10T18:53:04.354 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-06-10T18:53:04.354 DEBUG:teuthology.orchestra.run.smithi053:> ') 2023-06-10T18:53:04.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:53:04.470 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec bash -c ' 2023-06-10T18:53:04.470 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2023-06-10T18:53:04.470 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link set brx.0 up 2023-06-10T18:53:04.470 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link set dev brx.0 master ceph-brx 2023-06-10T18:53:04.471 DEBUG:teuthology.orchestra.run.smithi053:> ') 2023-06-10T18:53:04.489 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-06-10T18:53:04.490 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-10T18:53:04.490 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-06-10T18:53:04.540 INFO:teuthology.orchestra.run.smithi053.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-06-10T18:53:04.540 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-10T18:53:04.540 DEBUG:teuthology.orchestra.run.smithi053:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-06-10T18:53:04.587 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2023-06-10T18:53:04.649 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T18:53:04.650 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T18:53:04.704 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T18:53:04.705 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T18:53:04.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:53:04.706 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2023-06-10T18:53:04.752 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-06-10T18:53:04.753 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-06-10T18:53:04.797 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2023-06-10T18:53:04.812 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T18:53:04.812 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T18:53:04.866 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T18:53:04.867 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T18:53:04.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:53:04.868 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2023-06-10T18:53:04.891 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:2023-06-10T18:53:04.880+0000 7f16c4cca580 -1 init, newargv = 0x55918677c010 newargc=15 2023-06-10T18:53:04.892 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[44436]: starting ceph client 2023-06-10T18:53:04.900 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[44436]: starting fuse 2023-06-10T18:53:05.897 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-10T18:53:05.900 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-10T18:53:05.998 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2023-06-10T18:53:06.014 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T18:53:06.015 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T18:53:06.068 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T18:53:06.069 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T18:53:06.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:53:06.070 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2023-06-10T18:53:06.121 INFO:teuthology.orchestra.run.smithi053.stdout:45 2023-06-10T18:53:06.122 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-06-10T18:53:06.122 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-06-10T18:53:06.123 DEBUG:teuthology.orchestra.run.smithi053:> import glob 2023-06-10T18:53:06.123 DEBUG:teuthology.orchestra.run.smithi053:> import re 2023-06-10T18:53:06.123 DEBUG:teuthology.orchestra.run.smithi053:> import os 2023-06-10T18:53:06.124 DEBUG:teuthology.orchestra.run.smithi053:> import subprocess 2023-06-10T18:53:06.125 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T18:53:06.126 DEBUG:teuthology.orchestra.run.smithi053:> def _find_admin_socket(client_name): 2023-06-10T18:53:06.126 DEBUG:teuthology.orchestra.run.smithi053:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-06-10T18:53:06.126 DEBUG:teuthology.orchestra.run.smithi053:> files = glob.glob(asok_path) 2023-06-10T18:53:06.126 DEBUG:teuthology.orchestra.run.smithi053:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-06-10T18:53:06.127 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T18:53:06.127 DEBUG:teuthology.orchestra.run.smithi053:> # Given a non-glob path, it better be there 2023-06-10T18:53:06.127 DEBUG:teuthology.orchestra.run.smithi053:> if "*" not in asok_path: 2023-06-10T18:53:06.127 DEBUG:teuthology.orchestra.run.smithi053:> assert(len(files) == 1) 2023-06-10T18:53:06.127 DEBUG:teuthology.orchestra.run.smithi053:> return files[0] 2023-06-10T18:53:06.128 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T18:53:06.128 DEBUG:teuthology.orchestra.run.smithi053:> for f in files: 2023-06-10T18:53:06.128 DEBUG:teuthology.orchestra.run.smithi053:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-06-10T18:53:06.128 DEBUG:teuthology.orchestra.run.smithi053:> if os.path.exists("/proc/{0}".format(pid)): 2023-06-10T18:53:06.129 DEBUG:teuthology.orchestra.run.smithi053:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-06-10T18:53:06.129 DEBUG:teuthology.orchestra.run.smithi053:> contents = proc_f.read() 2023-06-10T18:53:06.129 DEBUG:teuthology.orchestra.run.smithi053:> if mountpoint in contents: 2023-06-10T18:53:06.129 DEBUG:teuthology.orchestra.run.smithi053:> return f 2023-06-10T18:53:06.129 DEBUG:teuthology.orchestra.run.smithi053:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-06-10T18:53:06.130 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T18:53:06.130 DEBUG:teuthology.orchestra.run.smithi053:> print(_find_admin_socket("client.0")) 2023-06-10T18:53:06.130 DEBUG:teuthology.orchestra.run.smithi053:> ' 2023-06-10T18:53:06.243 INFO:teuthology.orchestra.run.smithi053.stdout:/var/run/ceph/ceph-client.0.44436.asok 2023-06-10T18:53:06.424 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.44436.asok 2023-06-10T18:53:06.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:53:06.425 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.44436.asok status 2023-06-10T18:53:06.586 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-06-10T18:53:06.587 INFO:teuthology.orchestra.run.smithi053.stdout: "metadata": { 2023-06-10T18:53:06.587 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_sha1": "219d315c3a0b2075e570fb1964be2ad33fe7a9c8", 2023-06-10T18:53:06.587 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_version": "ceph version 18.0.0-4359-g219d315c (219d315c3a0b2075e570fb1964be2ad33fe7a9c8) reef (dev)", 2023-06-10T18:53:06.587 INFO:teuthology.orchestra.run.smithi053.stdout: "entity_id": "0", 2023-06-10T18:53:06.587 INFO:teuthology.orchestra.run.smithi053.stdout: "hostname": "smithi053", 2023-06-10T18:53:06.587 INFO:teuthology.orchestra.run.smithi053.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-06-10T18:53:06.587 INFO:teuthology.orchestra.run.smithi053.stdout: "pid": "44436", 2023-06-10T18:53:06.588 INFO:teuthology.orchestra.run.smithi053.stdout: "root": "/" 2023-06-10T18:53:06.588 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:53:06.588 INFO:teuthology.orchestra.run.smithi053.stdout: "dentry_count": 0, 2023-06-10T18:53:06.588 INFO:teuthology.orchestra.run.smithi053.stdout: "dentry_pinned_count": 0, 2023-06-10T18:53:06.588 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 4710, 2023-06-10T18:53:06.588 INFO:teuthology.orchestra.run.smithi053.stdout: "inst": { 2023-06-10T18:53:06.588 INFO:teuthology.orchestra.run.smithi053.stdout: "name": { 2023-06-10T18:53:06.589 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "client", 2023-06-10T18:53:06.589 INFO:teuthology.orchestra.run.smithi053.stdout: "num": 4710 2023-06-10T18:53:06.589 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:53:06.589 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": { 2023-06-10T18:53:06.589 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2023-06-10T18:53:06.589 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "192.168.0.1:0", 2023-06-10T18:53:06.589 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 1166325784 2023-06-10T18:53:06.589 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:53:06.590 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:53:06.590 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": { 2023-06-10T18:53:06.590 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2023-06-10T18:53:06.590 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "192.168.0.1:0", 2023-06-10T18:53:06.590 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 1166325784 2023-06-10T18:53:06.590 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:53:06.590 INFO:teuthology.orchestra.run.smithi053.stdout: "inst_str": "client.4710 192.168.0.1:0/1166325784", 2023-06-10T18:53:06.591 INFO:teuthology.orchestra.run.smithi053.stdout: "addr_str": "192.168.0.1:0/1166325784", 2023-06-10T18:53:06.591 INFO:teuthology.orchestra.run.smithi053.stdout: "inode_count": 1, 2023-06-10T18:53:06.591 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_epoch": 7, 2023-06-10T18:53:06.591 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_epoch": 23, 2023-06-10T18:53:06.591 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_epoch_barrier": 0, 2023-06-10T18:53:06.591 INFO:teuthology.orchestra.run.smithi053.stdout: "blocklisted": false, 2023-06-10T18:53:06.592 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs" 2023-06-10T18:53:06.592 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-06-10T18:53:06.599 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-10T18:53:06.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:06.716+0000 7fdcb0cc9640 1 Processor -- start 2023-06-10T18:53:06.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:06.716+0000 7fdcb0cc9640 1 -- start start 2023-06-10T18:53:06.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:06.716+0000 7fdcb0cc9640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fdcac06b2f0 0x7fdcac06f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:06.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:06.716+0000 7fdcb0cc9640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcac158a90 con 0x7fdcac160170 2023-06-10T18:53:06.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:06.716+0000 7fdcb0cc9640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcac0705d0 con 0x7fdcac0c8d00 2023-06-10T18:53:06.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:06.716+0000 7fdcb0cc9640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcac0cce10 con 0x7fdcac06b2f0 2023-06-10T18:53:06.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:06.716+0000 7fdcaad9d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fdcac160170 0x7fdcac162550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:43126/0 (socket says 172.21.15.53:43126) 2023-06-10T18:53:06.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:06.716+0000 7fdcaad9d640 1 -- 172.21.15.53:0/2993158928 learned_addr learned my addr 172.21.15.53:0/2993158928 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:53:06.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:06.716+0000 7fdcaa59c640 1 --2- 172.21.15.53:0/2993158928 >> v2:172.21.15.117:3300/0 conn(0x7fdcac06b2f0 0x7fdcac06f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:06.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:06.716+0000 7fdca959a640 1 -- 172.21.15.53:0/2993158928 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 364610187 0 0) 0x7fdca4001120 con 0x7fdcac160170 2023-06-10T18:53:06.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:06.716+0000 7fdca959a640 1 -- 172.21.15.53:0/2993158928 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc94003530 con 0x7fdcac160170 2023-06-10T18:53:06.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:06.716+0000 7fdcaa59c640 1 -- 172.21.15.53:0/2993158928 >> v1:172.21.15.117:6789/0 conn(0x7fdcac0c8d00 legacy=0x7fdcac06b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:06.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:06.716+0000 7fdcaa59c640 1 -- 172.21.15.53:0/2993158928 >> v1:172.21.15.53:6789/0 conn(0x7fdcac160170 legacy=0x7fdcac162550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:06.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:06.716+0000 7fdca959a640 1 -- 172.21.15.53:0/2993158928 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4029743595 0 0) 0x7fdc94003530 con 0x7fdcac160170 2023-06-10T18:53:06.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:06.716+0000 7fdcaa59c640 1 -- 172.21.15.53:0/2993158928 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcac06f9c0 con 0x7fdcac06b2f0 2023-06-10T18:53:06.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:06.720+0000 7fdcaa59c640 1 --2- 172.21.15.53:0/2993158928 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdcac06b2f0 0x7fdcac06f070 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c009d90 tx=0x7fdc9c01f060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89c5bb5b020a122b server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:06.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:06.720+0000 7fdca959a640 1 -- 172.21.15.53:0/2993158928 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca4001810 con 0x7fdcac06b2f0 2023-06-10T18:53:06.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:06.720+0000 7fdca959a640 1 -- 172.21.15.53:0/2993158928 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc9c0a8bf0 con 0x7fdcac06b2f0 2023-06-10T18:53:06.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:06.720+0000 7fdca959a640 1 -- 172.21.15.53:0/2993158928 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9c0b0440 con 0x7fdcac06b2f0 2023-06-10T18:53:06.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:06.720+0000 7fdcb0cc9640 1 -- 172.21.15.53:0/2993158928 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdcac06b2f0 msgr2=0x7fdcac06f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:06.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:06.720+0000 7fdcb0cc9640 1 --2- 172.21.15.53:0/2993158928 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdcac06b2f0 0x7fdcac06f070 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c009d90 tx=0x7fdc9c01f060 comp rx=0 tx=0).stop 2023-06-10T18:53:06.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:06.720+0000 7fdcb0cc9640 1 -- 172.21.15.53:0/2993158928 shutdown_connections 2023-06-10T18:53:06.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:06.720+0000 7fdcb0cc9640 1 --2- 172.21.15.53:0/2993158928 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdcac06b2f0 0x7fdcac06f070 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:06.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:06.720+0000 7fdcb0cc9640 1 -- 172.21.15.53:0/2993158928 >> 172.21.15.53:0/2993158928 conn(0x7fdcac06a0d0 msgr2=0x7fdcac0ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:06.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:06.720+0000 7fdcb0cc9640 1 -- 172.21.15.53:0/2993158928 shutdown_connections 2023-06-10T18:53:06.732 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:06.720+0000 7fdcb0cc9640 1 -- 172.21.15.53:0/2993158928 wait complete. 2023-06-10T18:53:06.732 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:06.724+0000 7fdcb0cc9640 1 Processor -- start 2023-06-10T18:53:06.732 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:06.724+0000 7fdcb0cc9640 1 -- start start 2023-06-10T18:53:06.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:06.724+0000 7fdcb0cc9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdcac0c8d00 0x7fdcac0c4110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:06.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:06.724+0000 7fdcb0cc9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdcac160170 0x7fdcac14aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:06.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:06.724+0000 7fdcb0cc9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdcac0c18f0 0x7fdcac0b2940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:06.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:06.724+0000 7fdcb0cc9640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcac0b2520 con 0x7fdcac0c8d00 2023-06-10T18:53:06.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:06.724+0000 7fdcb0cc9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcac14b580 con 0x7fdcac0c18f0 2023-06-10T18:53:06.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:06.724+0000 7fdcb0cc9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcac1f0f40 con 0x7fdcac160170 2023-06-10T18:53:06.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:06.724+0000 7fdcaa59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdcac0c8d00 0x7fdcac0c4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:06.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:06.724+0000 7fdcaa59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdcac0c8d00 0x7fdcac0c4110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56886/0 (socket says 172.21.15.53:56886) 2023-06-10T18:53:06.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:06.724+0000 7fdcaa59c640 1 -- 172.21.15.53:0/3452784795 learned_addr learned my addr 172.21.15.53:0/3452784795 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:06.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:06.724+0000 7fdcaad9d640 1 --2- 172.21.15.53:0/3452784795 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdcac0c18f0 0x7fdcac0b2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:06.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:06.724+0000 7fdca9d9b640 1 --2- 172.21.15.53:0/3452784795 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdcac160170 0x7fdcac14aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:06.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:06.724+0000 7fdcaa59c640 1 -- 172.21.15.53:0/3452784795 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdcac160170 msgr2=0x7fdcac14aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:06.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:06.724+0000 7fdcaa59c640 1 --2- 172.21.15.53:0/3452784795 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdcac160170 0x7fdcac14aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:06.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:06.724+0000 7fdcaa59c640 1 -- 172.21.15.53:0/3452784795 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdcac0c18f0 msgr2=0x7fdcac0b2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:06.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:06.724+0000 7fdcaa59c640 1 --2- 172.21.15.53:0/3452784795 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdcac0c18f0 0x7fdcac0b2940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:06.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:06.724+0000 7fdcaa59c640 1 -- 172.21.15.53:0/3452784795 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc9c009a70 con 0x7fdcac0c8d00 2023-06-10T18:53:06.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:06.724+0000 7fdca9d9b640 1 --2- 172.21.15.53:0/3452784795 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdcac160170 0x7fdcac14aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:53:06.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:06.724+0000 7fdcaa59c640 1 --2- 172.21.15.53:0/3452784795 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdcac0c8d00 0x7fdcac0c4110 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c009e80 tx=0x7fdc9c01be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:06.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:06.724+0000 7fdc9affd640 1 -- 172.21.15.53:0/3452784795 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9c004240 con 0x7fdcac0c8d00 2023-06-10T18:53:06.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:06.724+0000 7fdc9affd640 1 -- 172.21.15.53:0/3452784795 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc9c0043a0 con 0x7fdcac0c8d00 2023-06-10T18:53:06.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:06.724+0000 7fdcb0cc9640 1 -- 172.21.15.53:0/3452784795 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcac0b1bc0 con 0x7fdcac0c8d00 2023-06-10T18:53:06.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:06.724+0000 7fdc9affd640 1 -- 172.21.15.53:0/3452784795 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9c004710 con 0x7fdcac0c8d00 2023-06-10T18:53:06.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:06.724+0000 7fdcb0cc9640 1 -- 172.21.15.53:0/3452784795 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcac0b2140 con 0x7fdcac0c8d00 2023-06-10T18:53:06.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:06.724+0000 7fdcb0cc9640 1 -- 172.21.15.53:0/3452784795 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcac04d790 con 0x7fdcac0c8d00 2023-06-10T18:53:06.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:06.724+0000 7fdc9affd640 1 -- 172.21.15.53:0/3452784795 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdc9c0b7070 con 0x7fdcac0c8d00 2023-06-10T18:53:06.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:06.728+0000 7fdc9affd640 1 --2- 172.21.15.53:0/3452784795 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdc8c0662b0 0x7fdc8c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:06.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:06.728+0000 7fdc9affd640 1 -- 172.21.15.53:0/3452784795 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdc9c121eb0 con 0x7fdcac0c8d00 2023-06-10T18:53:06.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:06.728+0000 7fdca9d9b640 1 --2- 172.21.15.53:0/3452784795 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdc8c0662b0 0x7fdc8c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:06.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:06.728+0000 7fdca9d9b640 1 --2- 172.21.15.53:0/3452784795 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdc8c0662b0 0x7fdc8c068760 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fdcac06f310 tx=0x7fdca0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:06.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:06.732+0000 7fdc9affd640 1 -- 172.21.15.53:0/3452784795 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdc9c0ef460 con 0x7fdcac0c8d00 2023-06-10T18:53:06.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:06.916+0000 7fdcb0cc9640 1 -- 172.21.15.53:0/3452784795 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fdcac0c1570 con 0x7fdcac0c8d00 2023-06-10T18:53:06.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:06.920+0000 7fdc9affd640 1 -- 172.21.15.53:0/3452784795 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7fdc9c0b5020 con 0x7fdcac0c8d00 2023-06-10T18:53:06.928 INFO:teuthology.orchestra.run.smithi053.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-06-10T18:53:06.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:06.920+0000 7fdcb0cc9640 1 -- 172.21.15.53:0/3452784795 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdc8c0662b0 msgr2=0x7fdc8c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:06.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:06.920+0000 7fdcb0cc9640 1 --2- 172.21.15.53:0/3452784795 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdc8c0662b0 0x7fdc8c068760 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fdcac06f310 tx=0x7fdca0009040 comp rx=0 tx=0).stop 2023-06-10T18:53:06.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:06.920+0000 7fdcb0cc9640 1 -- 172.21.15.53:0/3452784795 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdcac0c8d00 msgr2=0x7fdcac0c4110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:06.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:06.920+0000 7fdcb0cc9640 1 --2- 172.21.15.53:0/3452784795 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdcac0c8d00 0x7fdcac0c4110 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c009e80 tx=0x7fdc9c01be00 comp rx=0 tx=0).stop 2023-06-10T18:53:06.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:06.920+0000 7fdcb0cc9640 1 -- 172.21.15.53:0/3452784795 shutdown_connections 2023-06-10T18:53:06.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:06.920+0000 7fdcb0cc9640 1 --2- 172.21.15.53:0/3452784795 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdc8c0662b0 0x7fdc8c068760 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:06.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:06.920+0000 7fdcb0cc9640 1 --2- 172.21.15.53:0/3452784795 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdcac0c18f0 0x7fdcac0b2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:06.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:06.920+0000 7fdcb0cc9640 1 --2- 172.21.15.53:0/3452784795 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdcac160170 0x7fdcac14aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:06.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:06.920+0000 7fdcb0cc9640 1 --2- 172.21.15.53:0/3452784795 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdcac0c8d00 0x7fdcac0c4110 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:06.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:06.920+0000 7fdcb0cc9640 1 -- 172.21.15.53:0/3452784795 >> 172.21.15.53:0/3452784795 conn(0x7fdcac06a0d0 msgr2=0x7fdcac158160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:06.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:06.920+0000 7fdcb0cc9640 1 -- 172.21.15.53:0/3452784795 shutdown_connections 2023-06-10T18:53:06.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:06.920+0000 7fdcb0cc9640 1 -- 172.21.15.53:0/3452784795 wait complete. 2023-06-10T18:53:06.948 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-10T18:53:06.949 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-10T18:53:06.949 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi053.front.sepia.ceph.com 2023-06-10T18:53:06.949 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-06-10T18:53:06.949 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-06-10T18:53:06.949 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-10T18:53:06.950 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-10T18:53:06.950 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-10T18:53:06.950 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-06-10T18:53:06.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:53:06.951 DEBUG:teuthology.orchestra.run.smithi053:> ip addr 2023-06-10T18:53:06.958 INFO:teuthology.orchestra.run.smithi053.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-10T18:53:06.958 INFO:teuthology.orchestra.run.smithi053.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-10T18:53:06.958 INFO:teuthology.orchestra.run.smithi053.stdout: inet 127.0.0.1/8 scope host lo 2023-06-10T18:53:06.958 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:53:06.958 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 ::1/128 scope host 2023-06-10T18:53:06.958 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:53:06.959 INFO:teuthology.orchestra.run.smithi053.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T18:53:06.959 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:da brd ff:ff:ff:ff:ff:ff 2023-06-10T18:53:06.959 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f0 2023-06-10T18:53:06.959 INFO:teuthology.orchestra.run.smithi053.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T18:53:06.959 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:db brd ff:ff:ff:ff:ff:ff 2023-06-10T18:53:06.959 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f1 2023-06-10T18:53:06.959 INFO:teuthology.orchestra.run.smithi053.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-10T18:53:06.959 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:18 brd ff:ff:ff:ff:ff:ff 2023-06-10T18:53:06.960 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f0 2023-06-10T18:53:06.960 INFO:teuthology.orchestra.run.smithi053.stdout: inet 172.21.15.53/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-06-10T18:53:06.960 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft 42462sec preferred_lft 42462sec 2023-06-10T18:53:06.960 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::ae1f:6bff:fef8:3718/64 scope link 2023-06-10T18:53:06.960 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:53:06.960 INFO:teuthology.orchestra.run.smithi053.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T18:53:06.960 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:19 brd ff:ff:ff:ff:ff:ff 2023-06-10T18:53:06.961 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f1 2023-06-10T18:53:06.961 INFO:teuthology.orchestra.run.smithi053.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-06-10T18:53:06.961 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 02:42:49:3d:ee:1e brd ff:ff:ff:ff:ff:ff 2023-06-10T18:53:06.961 INFO:teuthology.orchestra.run.smithi053.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-06-10T18:53:06.961 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:53:06.961 INFO:teuthology.orchestra.run.smithi053.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-10T18:53:06.961 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-06-10T18:53:06.962 INFO:teuthology.orchestra.run.smithi053.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-06-10T18:53:06.962 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:53:06.962 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-06-10T18:53:06.962 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:53:06.962 INFO:teuthology.orchestra.run.smithi053.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-10T18:53:06.962 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-06-10T18:53:06.962 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-06-10T18:53:06.962 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:53:06.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:53:06.963 DEBUG:teuthology.orchestra.run.smithi053:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-10T18:53:07.008 INFO:teuthology.orchestra.run.smithi053.stdout:1 2023-06-10T18:53:07.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:53:07.010 DEBUG:teuthology.orchestra.run.smithi053:> route 2023-06-10T18:53:07.056 INFO:teuthology.orchestra.run.smithi053.stdout:Kernel IP routing table 2023-06-10T18:53:07.057 INFO:teuthology.orchestra.run.smithi053.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-10T18:53:07.057 INFO:teuthology.orchestra.run.smithi053.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-06-10T18:53:07.057 INFO:teuthology.orchestra.run.smithi053.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-06-10T18:53:07.057 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-06-10T18:53:07.057 INFO:teuthology.orchestra.run.smithi053.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-10T18:53:07.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:53:07.058 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec bash -c ' 2023-06-10T18:53:07.058 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2023-06-10T18:53:07.058 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-06-10T18:53:07.059 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-06-10T18:53:07.059 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-06-10T18:53:07.059 DEBUG:teuthology.orchestra.run.smithi053:> ') 2023-06-10T18:53:07.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:53:07.136 DEBUG:teuthology.orchestra.run.smithi053:> ip netns list 2023-06-10T18:53:07.189 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-06-10T18:53:07.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:53:07.189 DEBUG:teuthology.orchestra.run.smithi053:> ip netns list-id 2023-06-10T18:53:07.236 INFO:teuthology.orchestra.run.smithi053.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-06-10T18:53:07.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:53:07.237 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec bash -c ' 2023-06-10T18:53:07.238 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2023-06-10T18:53:07.238 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-06-10T18:53:07.238 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-06-10T18:53:07.238 DEBUG:teuthology.orchestra.run.smithi053:> ') 2023-06-10T18:53:07.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:53:07.308 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-06-10T18:53:07.363 INFO:teuthology.orchestra.run.smithi053.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-10T18:53:07.364 INFO:teuthology.orchestra.run.smithi053.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-10T18:53:07.364 INFO:teuthology.orchestra.run.smithi053.stdout: inet 127.0.0.1/8 scope host lo 2023-06-10T18:53:07.364 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:53:07.364 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 ::1/128 scope host 2023-06-10T18:53:07.364 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:53:07.364 INFO:teuthology.orchestra.run.smithi053.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-10T18:53:07.365 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 9e:f5:0d:ef:b4:0f brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-06-10T18:53:07.365 INFO:teuthology.orchestra.run.smithi053.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-06-10T18:53:07.365 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:53:07.365 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::9cf5:dff:feef:b40f/64 scope link 2023-06-10T18:53:07.365 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:53:07.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:53:07.367 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-06-10T18:53:07.420 INFO:teuthology.orchestra.run.smithi053.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-10T18:53:07.421 INFO:teuthology.orchestra.run.smithi053.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-10T18:53:07.421 INFO:teuthology.orchestra.run.smithi053.stdout: inet 127.0.0.1/8 scope host lo 2023-06-10T18:53:07.421 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:53:07.422 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 ::1/128 scope host 2023-06-10T18:53:07.422 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:53:07.422 INFO:teuthology.orchestra.run.smithi053.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-10T18:53:07.422 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 9e:f5:0d:ef:b4:0f brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-06-10T18:53:07.423 INFO:teuthology.orchestra.run.smithi053.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-06-10T18:53:07.423 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:53:07.423 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::9cf5:dff:feef:b40f/64 scope link 2023-06-10T18:53:07.423 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:53:07.425 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-06-10T18:53:07.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:53:07.426 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec bash -c ' 2023-06-10T18:53:07.426 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2023-06-10T18:53:07.426 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-06-10T18:53:07.427 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-06-10T18:53:07.427 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-06-10T18:53:07.427 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-06-10T18:53:07.427 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-06-10T18:53:07.428 DEBUG:teuthology.orchestra.run.smithi053:> ') 2023-06-10T18:53:07.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:53:07.521 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec bash -c ' 2023-06-10T18:53:07.521 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2023-06-10T18:53:07.521 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link set brx.1 up 2023-06-10T18:53:07.522 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link set dev brx.1 master ceph-brx 2023-06-10T18:53:07.522 DEBUG:teuthology.orchestra.run.smithi053:> ') 2023-06-10T18:53:07.542 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2023-06-10T18:53:07.542 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-10T18:53:07.542 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-06-10T18:53:07.587 INFO:teuthology.orchestra.run.smithi053.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-06-10T18:53:07.588 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-10T18:53:07.588 DEBUG:teuthology.orchestra.run.smithi053:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-06-10T18:53:07.635 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2023-06-10T18:53:07.694 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T18:53:07.694 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T18:53:07.748 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T18:53:07.749 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T18:53:07.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:53:07.750 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2023-06-10T18:53:07.796 INFO:teuthology.orchestra.run.smithi053.stdout:45 2023-06-10T18:53:07.796 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [45] 2023-06-10T18:53:07.796 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2023-06-10T18:53:07.840 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2023-06-10T18:53:07.855 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T18:53:07.856 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T18:53:07.910 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T18:53:07.910 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T18:53:07.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:53:07.911 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2023-06-10T18:53:07.919 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi053.stderr:2023-06-10T18:53:07.908+0000 7ff16e2df580 -1 init, newargv = 0x5653ea16af50 newargc=15 2023-06-10T18:53:07.919 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi053.stderr:ceph-fuse[44576]: starting ceph client 2023-06-10T18:53:07.922 INFO:teuthology.orchestra.run.smithi053.stdout:45 2023-06-10T18:53:07.927 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi053.stderr:ceph-fuse[44576]: starting fuse 2023-06-10T18:53:09.024 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2023-06-10T18:53:09.041 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T18:53:09.042 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T18:53:09.100 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T18:53:09.102 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T18:53:09.103 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:53:09.103 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2023-06-10T18:53:09.152 INFO:teuthology.orchestra.run.smithi053.stdout:45 2023-06-10T18:53:09.153 INFO:teuthology.orchestra.run.smithi053.stdout:46 2023-06-10T18:53:09.153 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45, 46] 2023-06-10T18:53:09.153 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-06-10T18:53:09.154 DEBUG:teuthology.orchestra.run.smithi053:> import glob 2023-06-10T18:53:09.154 DEBUG:teuthology.orchestra.run.smithi053:> import re 2023-06-10T18:53:09.154 DEBUG:teuthology.orchestra.run.smithi053:> import os 2023-06-10T18:53:09.154 DEBUG:teuthology.orchestra.run.smithi053:> import subprocess 2023-06-10T18:53:09.154 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T18:53:09.155 DEBUG:teuthology.orchestra.run.smithi053:> def _find_admin_socket(client_name): 2023-06-10T18:53:09.155 DEBUG:teuthology.orchestra.run.smithi053:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2023-06-10T18:53:09.155 DEBUG:teuthology.orchestra.run.smithi053:> files = glob.glob(asok_path) 2023-06-10T18:53:09.155 DEBUG:teuthology.orchestra.run.smithi053:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2023-06-10T18:53:09.156 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T18:53:09.156 DEBUG:teuthology.orchestra.run.smithi053:> # Given a non-glob path, it better be there 2023-06-10T18:53:09.156 DEBUG:teuthology.orchestra.run.smithi053:> if "*" not in asok_path: 2023-06-10T18:53:09.156 DEBUG:teuthology.orchestra.run.smithi053:> assert(len(files) == 1) 2023-06-10T18:53:09.157 DEBUG:teuthology.orchestra.run.smithi053:> return files[0] 2023-06-10T18:53:09.157 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T18:53:09.157 DEBUG:teuthology.orchestra.run.smithi053:> for f in files: 2023-06-10T18:53:09.157 DEBUG:teuthology.orchestra.run.smithi053:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-06-10T18:53:09.158 DEBUG:teuthology.orchestra.run.smithi053:> if os.path.exists("/proc/{0}".format(pid)): 2023-06-10T18:53:09.158 DEBUG:teuthology.orchestra.run.smithi053:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-06-10T18:53:09.158 DEBUG:teuthology.orchestra.run.smithi053:> contents = proc_f.read() 2023-06-10T18:53:09.158 DEBUG:teuthology.orchestra.run.smithi053:> if mountpoint in contents: 2023-06-10T18:53:09.159 DEBUG:teuthology.orchestra.run.smithi053:> return f 2023-06-10T18:53:09.159 DEBUG:teuthology.orchestra.run.smithi053:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-06-10T18:53:09.159 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T18:53:09.160 DEBUG:teuthology.orchestra.run.smithi053:> print(_find_admin_socket("client.2")) 2023-06-10T18:53:09.160 DEBUG:teuthology.orchestra.run.smithi053:> ' 2023-06-10T18:53:09.277 INFO:teuthology.orchestra.run.smithi053.stdout:/var/run/ceph/ceph-client.2.44576.asok 2023-06-10T18:53:09.457 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.44576.asok 2023-06-10T18:53:09.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:53:09.458 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.44576.asok status 2023-06-10T18:53:09.620 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-06-10T18:53:09.620 INFO:teuthology.orchestra.run.smithi053.stdout: "metadata": { 2023-06-10T18:53:09.620 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_sha1": "219d315c3a0b2075e570fb1964be2ad33fe7a9c8", 2023-06-10T18:53:09.621 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_version": "ceph version 18.0.0-4359-g219d315c (219d315c3a0b2075e570fb1964be2ad33fe7a9c8) reef (dev)", 2023-06-10T18:53:09.622 INFO:teuthology.orchestra.run.smithi053.stdout: "entity_id": "2", 2023-06-10T18:53:09.622 INFO:teuthology.orchestra.run.smithi053.stdout: "hostname": "smithi053", 2023-06-10T18:53:09.622 INFO:teuthology.orchestra.run.smithi053.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2023-06-10T18:53:09.622 INFO:teuthology.orchestra.run.smithi053.stdout: "pid": "44576", 2023-06-10T18:53:09.623 INFO:teuthology.orchestra.run.smithi053.stdout: "root": "/" 2023-06-10T18:53:09.623 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:53:09.623 INFO:teuthology.orchestra.run.smithi053.stdout: "dentry_count": 0, 2023-06-10T18:53:09.623 INFO:teuthology.orchestra.run.smithi053.stdout: "dentry_pinned_count": 0, 2023-06-10T18:53:09.624 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 4722, 2023-06-10T18:53:09.624 INFO:teuthology.orchestra.run.smithi053.stdout: "inst": { 2023-06-10T18:53:09.624 INFO:teuthology.orchestra.run.smithi053.stdout: "name": { 2023-06-10T18:53:09.624 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "client", 2023-06-10T18:53:09.625 INFO:teuthology.orchestra.run.smithi053.stdout: "num": 4722 2023-06-10T18:53:09.625 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:53:09.625 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": { 2023-06-10T18:53:09.625 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2023-06-10T18:53:09.625 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "192.168.0.2:0", 2023-06-10T18:53:09.626 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 753062345 2023-06-10T18:53:09.626 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:53:09.626 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:53:09.627 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": { 2023-06-10T18:53:09.627 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2023-06-10T18:53:09.627 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "192.168.0.2:0", 2023-06-10T18:53:09.628 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 753062345 2023-06-10T18:53:09.629 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:53:09.629 INFO:teuthology.orchestra.run.smithi053.stdout: "inst_str": "client.4722 192.168.0.2:0/753062345", 2023-06-10T18:53:09.629 INFO:teuthology.orchestra.run.smithi053.stdout: "addr_str": "192.168.0.2:0/753062345", 2023-06-10T18:53:09.629 INFO:teuthology.orchestra.run.smithi053.stdout: "inode_count": 1, 2023-06-10T18:53:09.630 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_epoch": 7, 2023-06-10T18:53:09.630 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_epoch": 23, 2023-06-10T18:53:09.630 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_epoch_barrier": 0, 2023-06-10T18:53:09.631 INFO:teuthology.orchestra.run.smithi053.stdout: "blocklisted": false, 2023-06-10T18:53:09.631 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs" 2023-06-10T18:53:09.631 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-06-10T18:53:09.633 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-10T18:53:09.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:09.752+0000 7f131ddcb640 1 Processor -- start 2023-06-10T18:53:09.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:09.752+0000 7f131ddcb640 1 -- start start 2023-06-10T18:53:09.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:09.752+0000 7f131ddcb640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f13180b3ac0 0x7f13180b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:09.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:09.752+0000 7f131ddcb640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f13180d14c0 0x7f131815fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:09.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:09.752+0000 7f131ddcb640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13180d0020 con 0x7f13180cc690 2023-06-10T18:53:09.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:09.752+0000 7f131ddcb640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13180b43d0 con 0x7f13180d14c0 2023-06-10T18:53:09.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:09.752+0000 7f131ddcb640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13180cef40 con 0x7f13180b3ac0 2023-06-10T18:53:09.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:09.752+0000 7f1317fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f13180d14c0 0x7f131815fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:09.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:09.752+0000 7f1317fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f13180d14c0 0x7f131815fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56894/0 (socket says 172.21.15.53:56894) 2023-06-10T18:53:09.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:09.752+0000 7f1317fff640 1 -- 172.21.15.53:0/2073270024 learned_addr learned my addr 172.21.15.53:0/2073270024 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:09.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:09.752+0000 7f13177fe640 1 --2- 172.21.15.53:0/2073270024 >> v2:172.21.15.117:3300/0 conn(0x7f13180b3ac0 0x7f13180b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:09.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:09.752+0000 7f1317fff640 1 -- 172.21.15.53:0/2073270024 >> v2:172.21.15.117:3300/0 conn(0x7f13180b3ac0 msgr2=0x7f13180b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:09.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:09.752+0000 7f1317fff640 1 --2- 172.21.15.53:0/2073270024 >> v2:172.21.15.117:3300/0 conn(0x7f13180b3ac0 0x7f13180b3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:09.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:09.752+0000 7f1317fff640 1 -- 172.21.15.53:0/2073270024 >> v1:172.21.15.117:6789/0 conn(0x7f13180cc690 legacy=0x7f131815f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:09.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:09.752+0000 7f1317fff640 1 -- 172.21.15.53:0/2073270024 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13180cf220 con 0x7f13180d14c0 2023-06-10T18:53:09.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:09.756+0000 7f1317fff640 1 --2- 172.21.15.53:0/2073270024 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13180d14c0 0x7f131815fa80 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f13180b4ba0 tx=0x7f131001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b6ff0941679a15a server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:09.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:09.756+0000 7f13167fc640 1 -- 172.21.15.53:0/2073270024 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13100a5770 con 0x7f13180d14c0 2023-06-10T18:53:09.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:09.756+0000 7f13167fc640 1 -- 172.21.15.53:0/2073270024 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13100a58d0 con 0x7f13180d14c0 2023-06-10T18:53:09.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:09.756+0000 7f13167fc640 1 -- 172.21.15.53:0/2073270024 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13100a5c60 con 0x7f13180d14c0 2023-06-10T18:53:09.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:09.756+0000 7f131ddcb640 1 -- 172.21.15.53:0/2073270024 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13180d14c0 msgr2=0x7f131815fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:09.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:09.756+0000 7f131ddcb640 1 --2- 172.21.15.53:0/2073270024 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13180d14c0 0x7f131815fa80 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f13180b4ba0 tx=0x7f131001c9a0 comp rx=0 tx=0).stop 2023-06-10T18:53:09.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:09.756+0000 7f131ddcb640 1 -- 172.21.15.53:0/2073270024 shutdown_connections 2023-06-10T18:53:09.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:09.756+0000 7f131ddcb640 1 --2- 172.21.15.53:0/2073270024 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13180d14c0 0x7f131815fa80 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:09.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:09.756+0000 7f131ddcb640 1 --2- 172.21.15.53:0/2073270024 >> v2:172.21.15.117:3300/0 conn(0x7f13180b3ac0 0x7f13180b3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:09.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:09.756+0000 7f131ddcb640 1 -- 172.21.15.53:0/2073270024 >> 172.21.15.53:0/2073270024 conn(0x7f1318071790 msgr2=0x7f1318069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:09.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:09.756+0000 7f131ddcb640 1 -- 172.21.15.53:0/2073270024 shutdown_connections 2023-06-10T18:53:09.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:09.756+0000 7f131ddcb640 1 -- 172.21.15.53:0/2073270024 wait complete. 2023-06-10T18:53:09.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:09.756+0000 7f131ddcb640 1 Processor -- start 2023-06-10T18:53:09.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:09.756+0000 7f131ddcb640 1 -- start start 2023-06-10T18:53:09.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:09.756+0000 7f131ddcb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13180b3ac0 0x7f131815b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:09.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:09.756+0000 7f131ddcb640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13180cc690 0x7f1318151ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:09.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:09.756+0000 7f131ddcb640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f13180d14c0 0x7f1318152020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:09.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:09.756+0000 7f131ddcb640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1318157500 con 0x7f13180b3ac0 2023-06-10T18:53:09.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:09.756+0000 7f131ddcb640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1318152560 con 0x7f13180d14c0 2023-06-10T18:53:09.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:09.756+0000 7f131ddcb640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13181f56a0 con 0x7f13180cc690 2023-06-10T18:53:09.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:09.760+0000 7f13177fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13180b3ac0 0x7f131815b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:09.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:09.760+0000 7f13177fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13180b3ac0 0x7f131815b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56896/0 (socket says 172.21.15.53:56896) 2023-06-10T18:53:09.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:09.760+0000 7f13177fe640 1 -- 172.21.15.53:0/2084376906 learned_addr learned my addr 172.21.15.53:0/2084376906 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:09.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:09.760+0000 7f1317fff640 1 --2- 172.21.15.53:0/2084376906 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f13180d14c0 0x7f1318152020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:09.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:09.760+0000 7f1316ffd640 1 --2- 172.21.15.53:0/2084376906 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13180cc690 0x7f1318151ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:09.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:09.760+0000 7f13177fe640 1 -- 172.21.15.53:0/2084376906 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13180cc690 msgr2=0x7f1318151ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:09.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:09.760+0000 7f13177fe640 1 --2- 172.21.15.53:0/2084376906 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13180cc690 0x7f1318151ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:09.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:09.760+0000 7f13177fe640 1 -- 172.21.15.53:0/2084376906 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f13180d14c0 msgr2=0x7f1318152020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:09.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:09.760+0000 7f13177fe640 1 --2- 172.21.15.53:0/2084376906 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f13180d14c0 0x7f1318152020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:09.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:09.760+0000 7f13177fe640 1 -- 172.21.15.53:0/2084376906 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1310009b30 con 0x7f13180b3ac0 2023-06-10T18:53:09.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:09.760+0000 7f13177fe640 1 --2- 172.21.15.53:0/2084376906 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13180b3ac0 0x7f131815b080 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f130800e870 tx=0x7f130800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:09.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:09.760+0000 7f12fffff640 1 -- 172.21.15.53:0/2084376906 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1308009510 con 0x7f13180b3ac0 2023-06-10T18:53:09.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:09.760+0000 7f12fffff640 1 -- 172.21.15.53:0/2084376906 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f130800eec0 con 0x7f13180b3ac0 2023-06-10T18:53:09.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:09.760+0000 7f12fffff640 1 -- 172.21.15.53:0/2084376906 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130800cb40 con 0x7f13180b3ac0 2023-06-10T18:53:09.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:09.760+0000 7f131ddcb640 1 -- 172.21.15.53:0/2084376906 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13181f5940 con 0x7f13180b3ac0 2023-06-10T18:53:09.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:09.760+0000 7f131ddcb640 1 -- 172.21.15.53:0/2084376906 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13181f5f00 con 0x7f13180b3ac0 2023-06-10T18:53:09.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:09.760+0000 7f131ddcb640 1 -- 172.21.15.53:0/2084376906 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f131804d790 con 0x7f13180b3ac0 2023-06-10T18:53:09.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:09.760+0000 7f12fffff640 1 -- 172.21.15.53:0/2084376906 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f130800cca0 con 0x7f13180b3ac0 2023-06-10T18:53:09.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:09.760+0000 7f12fffff640 1 --2- 172.21.15.53:0/2084376906 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1304066280 0x7f1304068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:09.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:09.760+0000 7f12fffff640 1 -- 172.21.15.53:0/2084376906 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1308083e20 con 0x7f13180b3ac0 2023-06-10T18:53:09.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:09.760+0000 7f1316ffd640 1 --2- 172.21.15.53:0/2084376906 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1304066280 0x7f1304068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:09.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:09.764+0000 7f1316ffd640 1 --2- 172.21.15.53:0/2084376906 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1304066280 0x7f1304068730 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f13180c5bf0 tx=0x7f130c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:09.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:09.764+0000 7f12fffff640 1 -- 172.21.15.53:0/2084376906 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f13080512c0 con 0x7f13180b3ac0 2023-06-10T18:53:09.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:09.956+0000 7f131ddcb640 1 -- 172.21.15.53:0/2084376906 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f131808a200 con 0x7f13180b3ac0 2023-06-10T18:53:09.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:09.956+0000 7f12fffff640 1 -- 172.21.15.53:0/2084376906 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1308021070 con 0x7f13180b3ac0 2023-06-10T18:53:09.965 INFO:teuthology.orchestra.run.smithi053.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-06-10T18:53:09.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:09.956+0000 7f131ddcb640 1 -- 172.21.15.53:0/2084376906 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1304066280 msgr2=0x7f1304068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:09.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:09.956+0000 7f131ddcb640 1 --2- 172.21.15.53:0/2084376906 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1304066280 0x7f1304068730 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f13180c5bf0 tx=0x7f130c009040 comp rx=0 tx=0).stop 2023-06-10T18:53:09.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:09.956+0000 7f131ddcb640 1 -- 172.21.15.53:0/2084376906 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13180b3ac0 msgr2=0x7f131815b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:09.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:09.956+0000 7f131ddcb640 1 --2- 172.21.15.53:0/2084376906 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13180b3ac0 0x7f131815b080 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f130800e870 tx=0x7f130800ec70 comp rx=0 tx=0).stop 2023-06-10T18:53:09.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:09.956+0000 7f131ddcb640 1 -- 172.21.15.53:0/2084376906 shutdown_connections 2023-06-10T18:53:09.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:09.956+0000 7f131ddcb640 1 --2- 172.21.15.53:0/2084376906 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1304066280 0x7f1304068730 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:09.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:09.956+0000 7f131ddcb640 1 --2- 172.21.15.53:0/2084376906 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f13180d14c0 0x7f1318152020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:09.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:09.956+0000 7f131ddcb640 1 --2- 172.21.15.53:0/2084376906 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13180cc690 0x7f1318151ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:09.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:09.956+0000 7f131ddcb640 1 --2- 172.21.15.53:0/2084376906 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13180b3ac0 0x7f131815b080 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:09.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:09.956+0000 7f131ddcb640 1 -- 172.21.15.53:0/2084376906 >> 172.21.15.53:0/2084376906 conn(0x7f1318071790 msgr2=0x7f131815fc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:09.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:09.956+0000 7f131ddcb640 1 -- 172.21.15.53:0/2084376906 shutdown_connections 2023-06-10T18:53:09.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:09.956+0000 7f131ddcb640 1 -- 172.21.15.53:0/2084376906 wait complete. 2023-06-10T18:53:09.984 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-10T18:53:09.984 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-10T18:53:09.985 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi117.front.sepia.ceph.com 2023-06-10T18:53:09.985 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-06-10T18:53:09.985 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-06-10T18:53:09.986 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-10T18:53:09.986 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-10T18:53:09.987 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-10T18:53:09.987 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-06-10T18:53:09.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:53:09.988 DEBUG:teuthology.orchestra.run.smithi117:> ip addr 2023-06-10T18:53:09.995 INFO:teuthology.orchestra.run.smithi117.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-10T18:53:09.995 INFO:teuthology.orchestra.run.smithi117.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-10T18:53:09.996 INFO:teuthology.orchestra.run.smithi117.stdout: inet 127.0.0.1/8 scope host lo 2023-06-10T18:53:09.996 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:53:09.996 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 ::1/128 scope host 2023-06-10T18:53:09.996 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:53:09.997 INFO:teuthology.orchestra.run.smithi117.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T18:53:09.997 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8a brd ff:ff:ff:ff:ff:ff 2023-06-10T18:53:09.997 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f0 2023-06-10T18:53:09.997 INFO:teuthology.orchestra.run.smithi117.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T18:53:09.998 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8b brd ff:ff:ff:ff:ff:ff 2023-06-10T18:53:09.998 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f1 2023-06-10T18:53:09.998 INFO:teuthology.orchestra.run.smithi117.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T18:53:09.998 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:62 brd ff:ff:ff:ff:ff:ff 2023-06-10T18:53:09.999 INFO:teuthology.orchestra.run.smithi117.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-10T18:53:09.999 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:63 brd ff:ff:ff:ff:ff:ff 2023-06-10T18:53:09.999 INFO:teuthology.orchestra.run.smithi117.stdout: inet 172.21.15.117/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-06-10T18:53:09.999 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft 42459sec preferred_lft 42459sec 2023-06-10T18:53:09.999 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::ec4:7aff:fe8f:4463/64 scope link 2023-06-10T18:53:09.999 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:53:10.000 INFO:teuthology.orchestra.run.smithi117.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-06-10T18:53:10.000 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 02:42:f8:40:b2:dc brd ff:ff:ff:ff:ff:ff 2023-06-10T18:53:10.000 INFO:teuthology.orchestra.run.smithi117.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-06-10T18:53:10.000 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:53:10.000 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-06-10T18:53:10.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:53:10.001 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec bash -c ' 2023-06-10T18:53:10.001 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2023-06-10T18:53:10.001 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link add name ceph-brx type bridge 2023-06-10T18:53:10.002 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip addr flush dev ceph-brx 2023-06-10T18:53:10.002 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link set ceph-brx up 2023-06-10T18:53:10.002 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-06-10T18:53:10.002 DEBUG:teuthology.orchestra.run.smithi117:> ') 2023-06-10T18:53:10.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:53:10.078 DEBUG:teuthology.orchestra.run.smithi117:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-10T18:53:10.130 INFO:teuthology.orchestra.run.smithi117.stdout:1 2023-06-10T18:53:10.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:53:10.132 DEBUG:teuthology.orchestra.run.smithi117:> route 2023-06-10T18:53:10.208 INFO:teuthology.orchestra.run.smithi117.stdout:Kernel IP routing table 2023-06-10T18:53:10.208 INFO:teuthology.orchestra.run.smithi117.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-10T18:53:10.209 INFO:teuthology.orchestra.run.smithi117.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-06-10T18:53:10.209 INFO:teuthology.orchestra.run.smithi117.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-06-10T18:53:10.209 INFO:teuthology.orchestra.run.smithi117.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-06-10T18:53:10.209 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-06-10T18:53:10.209 INFO:teuthology.orchestra.run.smithi117.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-10T18:53:10.209 INFO:teuthology.orchestra.run.smithi117.stdout:ns2.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-10T18:53:10.209 INFO:teuthology.orchestra.run.smithi117.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-10T18:53:10.210 INFO:teuthology.orchestra.run.smithi117.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-10T18:53:10.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:53:10.210 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec bash -c ' 2023-06-10T18:53:10.210 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2023-06-10T18:53:10.211 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-06-10T18:53:10.211 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-06-10T18:53:10.211 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-06-10T18:53:10.211 DEBUG:teuthology.orchestra.run.smithi117:> ') 2023-06-10T18:53:10.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:53:10.284 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list 2023-06-10T18:53:10.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:53:10.331 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list-id 2023-06-10T18:53:10.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:53:10.381 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec bash -c ' 2023-06-10T18:53:10.382 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2023-06-10T18:53:10.382 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-06-10T18:53:10.383 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-06-10T18:53:10.383 DEBUG:teuthology.orchestra.run.smithi117:> ') 2023-06-10T18:53:10.444 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-06-10T18:53:10.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:53:10.445 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec bash -c ' 2023-06-10T18:53:10.445 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2023-06-10T18:53:10.445 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-06-10T18:53:10.445 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-06-10T18:53:10.446 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-06-10T18:53:10.446 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-06-10T18:53:10.447 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-06-10T18:53:10.447 DEBUG:teuthology.orchestra.run.smithi117:> ') 2023-06-10T18:53:10.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:53:10.542 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec bash -c ' 2023-06-10T18:53:10.543 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2023-06-10T18:53:10.543 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link set brx.0 up 2023-06-10T18:53:10.543 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link set dev brx.0 master ceph-brx 2023-06-10T18:53:10.543 DEBUG:teuthology.orchestra.run.smithi117:> ') 2023-06-10T18:53:10.561 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-06-10T18:53:10.562 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-10T18:53:10.562 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-06-10T18:53:10.609 INFO:teuthology.orchestra.run.smithi117.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-06-10T18:53:10.609 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-10T18:53:10.610 DEBUG:teuthology.orchestra.run.smithi117:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-06-10T18:53:10.653 DEBUG:teuthology.orchestra.run.smithi117:> sudo modprobe fuse 2023-06-10T18:53:10.706 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T18:53:10.707 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T18:53:10.764 INFO:teuthology.orchestra.run.smithi117.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T18:53:10.765 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T18:53:10.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:53:10.766 DEBUG:teuthology.orchestra.run.smithi117:> ls /sys/fs/fuse/connections 2023-06-10T18:53:10.814 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-06-10T18:53:10.814 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-06-10T18:53:10.859 DEBUG:teuthology.orchestra.run.smithi117:> sudo modprobe fuse 2023-06-10T18:53:10.871 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T18:53:10.871 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T18:53:10.929 INFO:teuthology.orchestra.run.smithi117.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T18:53:10.930 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T18:53:10.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:53:10.931 DEBUG:teuthology.orchestra.run.smithi117:> ls /sys/fs/fuse/connections 2023-06-10T18:53:10.940 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi117.stderr:2023-06-10T18:53:10.929+0000 7fc4e7b05580 -1 init, newargv = 0x55fec0ecbe50 newargc=15 2023-06-10T18:53:10.941 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi117.stderr:ceph-fuse[43833]: starting ceph client 2023-06-10T18:53:10.945 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi117.stderr:ceph-fuse[43833]: starting fuse 2023-06-10T18:53:12.045 DEBUG:teuthology.orchestra.run.smithi117:> sudo modprobe fuse 2023-06-10T18:53:12.079 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T18:53:12.079 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T18:53:12.132 INFO:teuthology.orchestra.run.smithi117.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T18:53:12.133 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T18:53:12.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:53:12.134 DEBUG:teuthology.orchestra.run.smithi117:> ls /sys/fs/fuse/connections 2023-06-10T18:53:12.182 INFO:teuthology.orchestra.run.smithi117.stdout:45 2023-06-10T18:53:12.183 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-06-10T18:53:12.183 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-06-10T18:53:12.183 DEBUG:teuthology.orchestra.run.smithi117:> import glob 2023-06-10T18:53:12.184 DEBUG:teuthology.orchestra.run.smithi117:> import re 2023-06-10T18:53:12.184 DEBUG:teuthology.orchestra.run.smithi117:> import os 2023-06-10T18:53:12.184 DEBUG:teuthology.orchestra.run.smithi117:> import subprocess 2023-06-10T18:53:12.184 DEBUG:teuthology.orchestra.run.smithi117:> 2023-06-10T18:53:12.185 DEBUG:teuthology.orchestra.run.smithi117:> def _find_admin_socket(client_name): 2023-06-10T18:53:12.185 DEBUG:teuthology.orchestra.run.smithi117:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-06-10T18:53:12.185 DEBUG:teuthology.orchestra.run.smithi117:> files = glob.glob(asok_path) 2023-06-10T18:53:12.185 DEBUG:teuthology.orchestra.run.smithi117:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-06-10T18:53:12.186 DEBUG:teuthology.orchestra.run.smithi117:> 2023-06-10T18:53:12.186 DEBUG:teuthology.orchestra.run.smithi117:> # Given a non-glob path, it better be there 2023-06-10T18:53:12.186 DEBUG:teuthology.orchestra.run.smithi117:> if "*" not in asok_path: 2023-06-10T18:53:12.186 DEBUG:teuthology.orchestra.run.smithi117:> assert(len(files) == 1) 2023-06-10T18:53:12.187 DEBUG:teuthology.orchestra.run.smithi117:> return files[0] 2023-06-10T18:53:12.187 DEBUG:teuthology.orchestra.run.smithi117:> 2023-06-10T18:53:12.187 DEBUG:teuthology.orchestra.run.smithi117:> for f in files: 2023-06-10T18:53:12.187 DEBUG:teuthology.orchestra.run.smithi117:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-06-10T18:53:12.187 DEBUG:teuthology.orchestra.run.smithi117:> if os.path.exists("/proc/{0}".format(pid)): 2023-06-10T18:53:12.188 DEBUG:teuthology.orchestra.run.smithi117:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-06-10T18:53:12.188 DEBUG:teuthology.orchestra.run.smithi117:> contents = proc_f.read() 2023-06-10T18:53:12.188 DEBUG:teuthology.orchestra.run.smithi117:> if mountpoint in contents: 2023-06-10T18:53:12.188 DEBUG:teuthology.orchestra.run.smithi117:> return f 2023-06-10T18:53:12.189 DEBUG:teuthology.orchestra.run.smithi117:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-06-10T18:53:12.189 DEBUG:teuthology.orchestra.run.smithi117:> 2023-06-10T18:53:12.189 DEBUG:teuthology.orchestra.run.smithi117:> print(_find_admin_socket("client.1")) 2023-06-10T18:53:12.189 DEBUG:teuthology.orchestra.run.smithi117:> ' 2023-06-10T18:53:12.303 INFO:teuthology.orchestra.run.smithi117.stdout:/var/run/ceph/ceph-client.1.43833.asok 2023-06-10T18:53:12.486 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.43833.asok 2023-06-10T18:53:12.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:53:12.486 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.43833.asok status 2023-06-10T18:53:12.645 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2023-06-10T18:53:12.645 INFO:teuthology.orchestra.run.smithi117.stdout: "metadata": { 2023-06-10T18:53:12.645 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_sha1": "219d315c3a0b2075e570fb1964be2ad33fe7a9c8", 2023-06-10T18:53:12.645 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_version": "ceph version 18.0.0-4359-g219d315c (219d315c3a0b2075e570fb1964be2ad33fe7a9c8) reef (dev)", 2023-06-10T18:53:12.645 INFO:teuthology.orchestra.run.smithi117.stdout: "entity_id": "1", 2023-06-10T18:53:12.646 INFO:teuthology.orchestra.run.smithi117.stdout: "hostname": "smithi117", 2023-06-10T18:53:12.646 INFO:teuthology.orchestra.run.smithi117.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-06-10T18:53:12.646 INFO:teuthology.orchestra.run.smithi117.stdout: "pid": "43833", 2023-06-10T18:53:12.646 INFO:teuthology.orchestra.run.smithi117.stdout: "root": "/" 2023-06-10T18:53:12.646 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-06-10T18:53:12.646 INFO:teuthology.orchestra.run.smithi117.stdout: "dentry_count": 0, 2023-06-10T18:53:12.646 INFO:teuthology.orchestra.run.smithi117.stdout: "dentry_pinned_count": 0, 2023-06-10T18:53:12.646 INFO:teuthology.orchestra.run.smithi117.stdout: "id": 4645, 2023-06-10T18:53:12.647 INFO:teuthology.orchestra.run.smithi117.stdout: "inst": { 2023-06-10T18:53:12.647 INFO:teuthology.orchestra.run.smithi117.stdout: "name": { 2023-06-10T18:53:12.647 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "client", 2023-06-10T18:53:12.647 INFO:teuthology.orchestra.run.smithi117.stdout: "num": 4645 2023-06-10T18:53:12.647 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-06-10T18:53:12.647 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": { 2023-06-10T18:53:12.647 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "v1", 2023-06-10T18:53:12.648 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": "192.168.0.1:0", 2023-06-10T18:53:12.648 INFO:teuthology.orchestra.run.smithi117.stdout: "nonce": 3188664872 2023-06-10T18:53:12.648 INFO:teuthology.orchestra.run.smithi117.stdout: } 2023-06-10T18:53:12.648 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-06-10T18:53:12.648 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": { 2023-06-10T18:53:12.648 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "v1", 2023-06-10T18:53:12.648 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": "192.168.0.1:0", 2023-06-10T18:53:12.648 INFO:teuthology.orchestra.run.smithi117.stdout: "nonce": 3188664872 2023-06-10T18:53:12.649 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-06-10T18:53:12.649 INFO:teuthology.orchestra.run.smithi117.stdout: "inst_str": "client.4645 192.168.0.1:0/3188664872", 2023-06-10T18:53:12.649 INFO:teuthology.orchestra.run.smithi117.stdout: "addr_str": "192.168.0.1:0/3188664872", 2023-06-10T18:53:12.649 INFO:teuthology.orchestra.run.smithi117.stdout: "inode_count": 1, 2023-06-10T18:53:12.649 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_epoch": 7, 2023-06-10T18:53:12.649 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_epoch": 23, 2023-06-10T18:53:12.649 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_epoch_barrier": 0, 2023-06-10T18:53:12.650 INFO:teuthology.orchestra.run.smithi117.stdout: "blocklisted": false, 2023-06-10T18:53:12.650 INFO:teuthology.orchestra.run.smithi117.stdout: "fs_name": "cephfs" 2023-06-10T18:53:12.650 INFO:teuthology.orchestra.run.smithi117.stdout:} 2023-06-10T18:53:12.658 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-10T18:53:12.795 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:12.784+0000 7fdeb71a4640 1 Processor -- start 2023-06-10T18:53:12.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:12.784+0000 7fdeb71a4640 1 -- start start 2023-06-10T18:53:12.797 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:12.788+0000 7fdeb71a4640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fdeb00b3ac0 0x7fdeb00b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:12.797 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:12.788+0000 7fdeb71a4640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fdeb00cc690 0x7fdeb015f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:12.797 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:12.788+0000 7fdeb71a4640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdeb00d0020 con 0x7fdeb00ccae0 2023-06-10T18:53:12.797 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:12.788+0000 7fdeb71a4640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdeb00b43d0 con 0x7fdeb00cc690 2023-06-10T18:53:12.797 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:12.788+0000 7fdeb71a4640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdeb00cef40 con 0x7fdeb00b3ac0 2023-06-10T18:53:12.797 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:12.788+0000 7fdeb5741640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fdeb00ccae0 0x7fdeb015f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:37872/0 (socket says 172.21.15.53:37872) 2023-06-10T18:53:12.797 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:12.788+0000 7fdeb5741640 1 -- 172.21.15.53:0/3856898204 learned_addr learned my addr 172.21.15.53:0/3856898204 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:53:12.798 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:12.788+0000 7fdeaffff640 1 --2- 172.21.15.53:0/3856898204 >> v2:172.21.15.53:3300/0 conn(0x7fdeb00cc690 0x7fdeb015f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:12.798 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:12.788+0000 7fdeb4f40640 1 --2- 172.21.15.53:0/3856898204 >> v2:172.21.15.117:3300/0 conn(0x7fdeb00b3ac0 0x7fdeb00b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:12.798 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:12.788+0000 7fdeaf7fe640 1 -- 172.21.15.53:0/3856898204 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 485668636 0 0) 0x7fdeb00d0020 con 0x7fdeb00ccae0 2023-06-10T18:53:12.798 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:12.788+0000 7fdeaf7fe640 1 -- 172.21.15.53:0/3856898204 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde9c003530 con 0x7fdeb00ccae0 2023-06-10T18:53:12.798 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:12.788+0000 7fdeaffff640 1 -- 172.21.15.53:0/3856898204 >> v2:172.21.15.117:3300/0 conn(0x7fdeb00b3ac0 msgr2=0x7fdeb00b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:12.799 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:12.788+0000 7fdeaffff640 1 --2- 172.21.15.53:0/3856898204 >> v2:172.21.15.117:3300/0 conn(0x7fdeb00b3ac0 0x7fdeb00b3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:12.799 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:12.788+0000 7fdeaffff640 1 -- 172.21.15.53:0/3856898204 >> v1:172.21.15.53:6789/0 conn(0x7fdeb00ccae0 legacy=0x7fdeb015f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:12.799 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:12.788+0000 7fdeaffff640 1 -- 172.21.15.53:0/3856898204 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeb00cf220 con 0x7fdeb00cc690 2023-06-10T18:53:12.800 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:12.788+0000 7fdeaffff640 1 --2- 172.21.15.53:0/3856898204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdeb00cc690 0x7fdeb015f370 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fdeb00b4ba0 tx=0x7fdea001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6da630d0bd06867c server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:12.800 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:12.792+0000 7fdeaf7fe640 1 -- 172.21.15.53:0/3856898204 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea00a58b0 con 0x7fdeb00cc690 2023-06-10T18:53:12.800 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:12.792+0000 7fdeaf7fe640 1 -- 172.21.15.53:0/3856898204 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdea00a5a10 con 0x7fdeb00cc690 2023-06-10T18:53:12.800 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:12.792+0000 7fdeaf7fe640 1 -- 172.21.15.53:0/3856898204 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea00a5da0 con 0x7fdeb00cc690 2023-06-10T18:53:12.801 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:12.792+0000 7fdeb71a4640 1 -- 172.21.15.53:0/3856898204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdeb00cc690 msgr2=0x7fdeb015f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:12.801 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:12.792+0000 7fdeb71a4640 1 --2- 172.21.15.53:0/3856898204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdeb00cc690 0x7fdeb015f370 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fdeb00b4ba0 tx=0x7fdea001c8e0 comp rx=0 tx=0).stop 2023-06-10T18:53:12.801 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:12.792+0000 7fdeb71a4640 1 -- 172.21.15.53:0/3856898204 shutdown_connections 2023-06-10T18:53:12.801 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:12.792+0000 7fdeb71a4640 1 --2- 172.21.15.53:0/3856898204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdeb00cc690 0x7fdeb015f370 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:12.801 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:12.792+0000 7fdeb71a4640 1 --2- 172.21.15.53:0/3856898204 >> v2:172.21.15.117:3300/0 conn(0x7fdeb00b3ac0 0x7fdeb00b3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:12.801 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:12.792+0000 7fdeb71a4640 1 -- 172.21.15.53:0/3856898204 >> 172.21.15.53:0/3856898204 conn(0x7fdeb0071790 msgr2=0x7fdeb0069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:12.801 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:12.792+0000 7fdeb71a4640 1 -- 172.21.15.53:0/3856898204 shutdown_connections 2023-06-10T18:53:12.801 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:12.792+0000 7fdeb71a4640 1 -- 172.21.15.53:0/3856898204 wait complete. 2023-06-10T18:53:12.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:12.792+0000 7fdeb71a4640 1 Processor -- start 2023-06-10T18:53:12.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:12.792+0000 7fdeb71a4640 1 -- start start 2023-06-10T18:53:12.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:12.792+0000 7fdeb71a4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdeb00b3ac0 0x7fdeb01539c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:12.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:12.792+0000 7fdeb71a4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdeb00cc690 0x7fdeb00cbb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:12.804 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:12.792+0000 7fdeb71a4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdeb00ccae0 0x7fdeb015f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:12.804 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:12.792+0000 7fdeb71a4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb00c9640 con 0x7fdeb00b3ac0 2023-06-10T18:53:12.804 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:12.792+0000 7fdeb71a4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb00c9920 con 0x7fdeb00ccae0 2023-06-10T18:53:12.804 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:12.792+0000 7fdeb71a4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb00c9c00 con 0x7fdeb00cc690 2023-06-10T18:53:12.804 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:12.792+0000 7fdeb4f40640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdeb00b3ac0 0x7fdeb01539c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:12.804 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:12.792+0000 7fdeb4f40640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdeb00b3ac0 0x7fdeb01539c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40354/0 (socket says 172.21.15.53:40354) 2023-06-10T18:53:12.804 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:12.792+0000 7fdeb4f40640 1 -- 172.21.15.53:0/2232526423 learned_addr learned my addr 172.21.15.53:0/2232526423 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:12.804 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:12.792+0000 7fdeb5741640 1 --2- 172.21.15.53:0/2232526423 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdeb00ccae0 0x7fdeb015f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:12.805 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:12.792+0000 7fdeaffff640 1 --2- 172.21.15.53:0/2232526423 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdeb00cc690 0x7fdeb00cbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:12.805 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:12.792+0000 7fdeb4f40640 1 -- 172.21.15.53:0/2232526423 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdeb00cc690 msgr2=0x7fdeb00cbb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:12.805 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:12.792+0000 7fdeb4f40640 1 --2- 172.21.15.53:0/2232526423 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdeb00cc690 0x7fdeb00cbb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:12.805 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:12.792+0000 7fdeb4f40640 1 -- 172.21.15.53:0/2232526423 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdeb00ccae0 msgr2=0x7fdeb015f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:12.805 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:12.792+0000 7fdeb4f40640 1 --2- 172.21.15.53:0/2232526423 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdeb00ccae0 0x7fdeb015f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:12.805 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:12.792+0000 7fdeb4f40640 1 -- 172.21.15.53:0/2232526423 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdea0009a70 con 0x7fdeb00b3ac0 2023-06-10T18:53:12.805 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:12.792+0000 7fdeb4f40640 1 --2- 172.21.15.53:0/2232526423 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdeb00b3ac0 0x7fdeb01539c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fde9800e870 tx=0x7fde9800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:12.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:12.792+0000 7fdead7fa640 1 -- 172.21.15.53:0/2232526423 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde98009510 con 0x7fdeb00b3ac0 2023-06-10T18:53:12.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:12.792+0000 7fdead7fa640 1 -- 172.21.15.53:0/2232526423 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde9800eec0 con 0x7fdeb00b3ac0 2023-06-10T18:53:12.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:12.792+0000 7fdeb71a4640 1 -- 172.21.15.53:0/2232526423 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdeb00c9ee0 con 0x7fdeb00b3ac0 2023-06-10T18:53:12.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:12.792+0000 7fdead7fa640 1 -- 172.21.15.53:0/2232526423 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde9800cb40 con 0x7fdeb00b3ac0 2023-06-10T18:53:12.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:12.792+0000 7fdeb71a4640 1 -- 172.21.15.53:0/2232526423 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdeb00cae30 con 0x7fdeb00b3ac0 2023-06-10T18:53:12.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:12.796+0000 7fdeb71a4640 1 -- 172.21.15.53:0/2232526423 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdeb004d790 con 0x7fdeb00b3ac0 2023-06-10T18:53:12.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:12.796+0000 7fdead7fa640 1 -- 172.21.15.53:0/2232526423 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fde9800cca0 con 0x7fdeb00b3ac0 2023-06-10T18:53:12.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:12.796+0000 7fdead7fa640 1 --2- 172.21.15.53:0/2232526423 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fde90066280 0x7fde90068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:12.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:12.796+0000 7fdead7fa640 1 -- 172.21.15.53:0/2232526423 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fde98083df0 con 0x7fdeb00b3ac0 2023-06-10T18:53:12.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:12.796+0000 7fdeaffff640 1 --2- 172.21.15.53:0/2232526423 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fde90066280 0x7fde90068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:12.808 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:12.796+0000 7fdeaffff640 1 --2- 172.21.15.53:0/2232526423 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fde90066280 0x7fde90068730 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdea00af000 tx=0x7fdea00a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:12.809 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:12.800+0000 7fdead7fa640 1 -- 172.21.15.53:0/2232526423 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fde98051300 con 0x7fdeb00b3ac0 2023-06-10T18:53:12.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:12.988+0000 7fdeb71a4640 1 -- 172.21.15.53:0/2232526423 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fdeb008a200 con 0x7fdeb00b3ac0 2023-06-10T18:53:12.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:12.988+0000 7fdead7fa640 1 -- 172.21.15.53:0/2232526423 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7fde98017070 con 0x7fdeb00b3ac0 2023-06-10T18:53:12.997 INFO:teuthology.orchestra.run.smithi053.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-06-10T18:53:12.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:12.988+0000 7fdeb71a4640 1 -- 172.21.15.53:0/2232526423 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fde90066280 msgr2=0x7fde90068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:12.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:12.988+0000 7fdeb71a4640 1 --2- 172.21.15.53:0/2232526423 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fde90066280 0x7fde90068730 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdea00af000 tx=0x7fdea00a7070 comp rx=0 tx=0).stop 2023-06-10T18:53:12.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:12.988+0000 7fdeb71a4640 1 -- 172.21.15.53:0/2232526423 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdeb00b3ac0 msgr2=0x7fdeb01539c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:12.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:12.988+0000 7fdeb71a4640 1 --2- 172.21.15.53:0/2232526423 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdeb00b3ac0 0x7fdeb01539c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fde9800e870 tx=0x7fde9800ec70 comp rx=0 tx=0).stop 2023-06-10T18:53:12.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:12.988+0000 7fdeb71a4640 1 -- 172.21.15.53:0/2232526423 shutdown_connections 2023-06-10T18:53:12.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:12.988+0000 7fdeb71a4640 1 --2- 172.21.15.53:0/2232526423 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fde90066280 0x7fde90068730 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:12.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:12.988+0000 7fdeb71a4640 1 --2- 172.21.15.53:0/2232526423 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdeb00ccae0 0x7fdeb015f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:12.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:12.988+0000 7fdeb71a4640 1 --2- 172.21.15.53:0/2232526423 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdeb00cc690 0x7fdeb00cbb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:12.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:12.988+0000 7fdeb71a4640 1 --2- 172.21.15.53:0/2232526423 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdeb00b3ac0 0x7fdeb01539c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:12.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:12.988+0000 7fdeb71a4640 1 -- 172.21.15.53:0/2232526423 >> 172.21.15.53:0/2232526423 conn(0x7fdeb0071790 msgr2=0x7fdeb00ce250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:13.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:12.988+0000 7fdeb71a4640 1 -- 172.21.15.53:0/2232526423 shutdown_connections 2023-06-10T18:53:13.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:12.988+0000 7fdeb71a4640 1 -- 172.21.15.53:0/2232526423 wait complete. 2023-06-10T18:53:13.014 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-10T18:53:13.014 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-10T18:53:13.014 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi117.front.sepia.ceph.com 2023-06-10T18:53:13.014 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-06-10T18:53:13.015 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-06-10T18:53:13.015 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-10T18:53:13.015 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-10T18:53:13.015 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-10T18:53:13.015 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-06-10T18:53:13.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:53:13.016 DEBUG:teuthology.orchestra.run.smithi117:> ip addr 2023-06-10T18:53:13.023 INFO:teuthology.orchestra.run.smithi117.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-10T18:53:13.023 INFO:teuthology.orchestra.run.smithi117.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-10T18:53:13.023 INFO:teuthology.orchestra.run.smithi117.stdout: inet 127.0.0.1/8 scope host lo 2023-06-10T18:53:13.023 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:53:13.023 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 ::1/128 scope host 2023-06-10T18:53:13.024 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:53:13.024 INFO:teuthology.orchestra.run.smithi117.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T18:53:13.024 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8a brd ff:ff:ff:ff:ff:ff 2023-06-10T18:53:13.024 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f0 2023-06-10T18:53:13.024 INFO:teuthology.orchestra.run.smithi117.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T18:53:13.024 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8b brd ff:ff:ff:ff:ff:ff 2023-06-10T18:53:13.024 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f1 2023-06-10T18:53:13.025 INFO:teuthology.orchestra.run.smithi117.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T18:53:13.025 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:62 brd ff:ff:ff:ff:ff:ff 2023-06-10T18:53:13.025 INFO:teuthology.orchestra.run.smithi117.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-10T18:53:13.025 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:63 brd ff:ff:ff:ff:ff:ff 2023-06-10T18:53:13.025 INFO:teuthology.orchestra.run.smithi117.stdout: inet 172.21.15.117/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-06-10T18:53:13.025 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft 42456sec preferred_lft 42456sec 2023-06-10T18:53:13.026 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::ec4:7aff:fe8f:4463/64 scope link 2023-06-10T18:53:13.026 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:53:13.026 INFO:teuthology.orchestra.run.smithi117.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-06-10T18:53:13.026 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 02:42:f8:40:b2:dc brd ff:ff:ff:ff:ff:ff 2023-06-10T18:53:13.026 INFO:teuthology.orchestra.run.smithi117.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-06-10T18:53:13.026 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:53:13.026 INFO:teuthology.orchestra.run.smithi117.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-10T18:53:13.027 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-06-10T18:53:13.027 INFO:teuthology.orchestra.run.smithi117.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-06-10T18:53:13.027 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:53:13.027 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-06-10T18:53:13.027 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:53:13.027 INFO:teuthology.orchestra.run.smithi117.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-10T18:53:13.027 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-06-10T18:53:13.027 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-06-10T18:53:13.028 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:53:13.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:53:13.028 DEBUG:teuthology.orchestra.run.smithi117:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-10T18:53:13.079 INFO:teuthology.orchestra.run.smithi117.stdout:1 2023-06-10T18:53:13.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:53:13.081 DEBUG:teuthology.orchestra.run.smithi117:> route 2023-06-10T18:53:13.129 INFO:teuthology.orchestra.run.smithi117.stdout:Kernel IP routing table 2023-06-10T18:53:13.129 INFO:teuthology.orchestra.run.smithi117.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-10T18:53:13.129 INFO:teuthology.orchestra.run.smithi117.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-06-10T18:53:13.130 INFO:teuthology.orchestra.run.smithi117.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-06-10T18:53:13.130 INFO:teuthology.orchestra.run.smithi117.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-06-10T18:53:13.130 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-06-10T18:53:13.130 INFO:teuthology.orchestra.run.smithi117.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-10T18:53:13.130 INFO:teuthology.orchestra.run.smithi117.stdout:ns2.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-10T18:53:13.131 INFO:teuthology.orchestra.run.smithi117.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-10T18:53:13.131 INFO:teuthology.orchestra.run.smithi117.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-10T18:53:13.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:53:13.131 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec bash -c ' 2023-06-10T18:53:13.132 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2023-06-10T18:53:13.132 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-06-10T18:53:13.132 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-06-10T18:53:13.132 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-06-10T18:53:13.132 DEBUG:teuthology.orchestra.run.smithi117:> ') 2023-06-10T18:53:13.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:53:13.206 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list 2023-06-10T18:53:13.254 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-06-10T18:53:13.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:53:13.255 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list-id 2023-06-10T18:53:13.303 INFO:teuthology.orchestra.run.smithi117.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-06-10T18:53:13.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:53:13.304 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec bash -c ' 2023-06-10T18:53:13.304 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2023-06-10T18:53:13.304 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-06-10T18:53:13.304 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-06-10T18:53:13.304 DEBUG:teuthology.orchestra.run.smithi117:> ') 2023-06-10T18:53:13.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:53:13.372 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-06-10T18:53:13.427 INFO:teuthology.orchestra.run.smithi117.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-10T18:53:13.427 INFO:teuthology.orchestra.run.smithi117.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-10T18:53:13.428 INFO:teuthology.orchestra.run.smithi117.stdout: inet 127.0.0.1/8 scope host lo 2023-06-10T18:53:13.428 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:53:13.428 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 ::1/128 scope host 2023-06-10T18:53:13.428 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:53:13.428 INFO:teuthology.orchestra.run.smithi117.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-10T18:53:13.428 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether aa:17:4f:12:be:bc brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-06-10T18:53:13.428 INFO:teuthology.orchestra.run.smithi117.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-06-10T18:53:13.429 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:53:13.429 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::a817:4fff:fe12:bebc/64 scope link 2023-06-10T18:53:13.429 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:53:13.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:53:13.430 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-06-10T18:53:13.485 INFO:teuthology.orchestra.run.smithi117.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-10T18:53:13.486 INFO:teuthology.orchestra.run.smithi117.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-10T18:53:13.486 INFO:teuthology.orchestra.run.smithi117.stdout: inet 127.0.0.1/8 scope host lo 2023-06-10T18:53:13.486 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:53:13.486 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 ::1/128 scope host 2023-06-10T18:53:13.486 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:53:13.486 INFO:teuthology.orchestra.run.smithi117.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-10T18:53:13.486 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether aa:17:4f:12:be:bc brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-06-10T18:53:13.487 INFO:teuthology.orchestra.run.smithi117.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-06-10T18:53:13.487 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:53:13.487 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::a817:4fff:fe12:bebc/64 scope link 2023-06-10T18:53:13.487 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:53:13.488 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-06-10T18:53:13.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:53:13.489 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec bash -c ' 2023-06-10T18:53:13.489 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2023-06-10T18:53:13.489 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-06-10T18:53:13.489 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-06-10T18:53:13.490 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-06-10T18:53:13.490 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-06-10T18:53:13.490 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-06-10T18:53:13.490 DEBUG:teuthology.orchestra.run.smithi117:> ') 2023-06-10T18:53:13.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:53:13.585 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec bash -c ' 2023-06-10T18:53:13.585 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2023-06-10T18:53:13.585 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link set brx.1 up 2023-06-10T18:53:13.586 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link set dev brx.1 master ceph-brx 2023-06-10T18:53:13.586 DEBUG:teuthology.orchestra.run.smithi117:> ') 2023-06-10T18:53:13.606 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2023-06-10T18:53:13.606 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-10T18:53:13.607 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-06-10T18:53:13.657 INFO:teuthology.orchestra.run.smithi117.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-06-10T18:53:13.658 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-10T18:53:13.658 DEBUG:teuthology.orchestra.run.smithi117:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-06-10T18:53:13.706 DEBUG:teuthology.orchestra.run.smithi117:> sudo modprobe fuse 2023-06-10T18:53:13.768 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T18:53:13.768 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T18:53:13.820 INFO:teuthology.orchestra.run.smithi117.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T18:53:13.821 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T18:53:13.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:53:13.822 DEBUG:teuthology.orchestra.run.smithi117:> ls /sys/fs/fuse/connections 2023-06-10T18:53:13.870 INFO:teuthology.orchestra.run.smithi117.stdout:45 2023-06-10T18:53:13.870 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [45] 2023-06-10T18:53:13.871 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2023-06-10T18:53:13.915 DEBUG:teuthology.orchestra.run.smithi117:> sudo modprobe fuse 2023-06-10T18:53:13.930 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T18:53:13.931 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T18:53:13.984 INFO:teuthology.orchestra.run.smithi117.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T18:53:13.985 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T18:53:13.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:53:13.986 DEBUG:teuthology.orchestra.run.smithi117:> ls /sys/fs/fuse/connections 2023-06-10T18:53:13.992 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi117.stderr:2023-06-10T18:53:13.981+0000 7faec3aa6580 -1 init, newargv = 0x55c8789c8eb0 newargc=15 2023-06-10T18:53:13.992 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi117.stderr:ceph-fuse[43946]: starting ceph client 2023-06-10T18:53:13.995 INFO:teuthology.orchestra.run.smithi117.stdout:45 2023-06-10T18:53:13.997 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi117.stderr:ceph-fuse[43946]: starting fuse 2023-06-10T18:53:15.097 DEBUG:teuthology.orchestra.run.smithi117:> sudo modprobe fuse 2023-06-10T18:53:15.113 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T18:53:15.113 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T18:53:15.168 INFO:teuthology.orchestra.run.smithi117.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T18:53:15.169 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T18:53:15.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:53:15.170 DEBUG:teuthology.orchestra.run.smithi117:> ls /sys/fs/fuse/connections 2023-06-10T18:53:15.218 INFO:teuthology.orchestra.run.smithi117.stdout:45 2023-06-10T18:53:15.218 INFO:teuthology.orchestra.run.smithi117.stdout:46 2023-06-10T18:53:15.218 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45, 46] 2023-06-10T18:53:15.219 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-06-10T18:53:15.219 DEBUG:teuthology.orchestra.run.smithi117:> import glob 2023-06-10T18:53:15.219 DEBUG:teuthology.orchestra.run.smithi117:> import re 2023-06-10T18:53:15.220 DEBUG:teuthology.orchestra.run.smithi117:> import os 2023-06-10T18:53:15.220 DEBUG:teuthology.orchestra.run.smithi117:> import subprocess 2023-06-10T18:53:15.220 DEBUG:teuthology.orchestra.run.smithi117:> 2023-06-10T18:53:15.220 DEBUG:teuthology.orchestra.run.smithi117:> def _find_admin_socket(client_name): 2023-06-10T18:53:15.221 DEBUG:teuthology.orchestra.run.smithi117:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2023-06-10T18:53:15.221 DEBUG:teuthology.orchestra.run.smithi117:> files = glob.glob(asok_path) 2023-06-10T18:53:15.221 DEBUG:teuthology.orchestra.run.smithi117:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2023-06-10T18:53:15.221 DEBUG:teuthology.orchestra.run.smithi117:> 2023-06-10T18:53:15.222 DEBUG:teuthology.orchestra.run.smithi117:> # Given a non-glob path, it better be there 2023-06-10T18:53:15.222 DEBUG:teuthology.orchestra.run.smithi117:> if "*" not in asok_path: 2023-06-10T18:53:15.222 DEBUG:teuthology.orchestra.run.smithi117:> assert(len(files) == 1) 2023-06-10T18:53:15.223 DEBUG:teuthology.orchestra.run.smithi117:> return files[0] 2023-06-10T18:53:15.223 DEBUG:teuthology.orchestra.run.smithi117:> 2023-06-10T18:53:15.223 DEBUG:teuthology.orchestra.run.smithi117:> for f in files: 2023-06-10T18:53:15.224 DEBUG:teuthology.orchestra.run.smithi117:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-06-10T18:53:15.224 DEBUG:teuthology.orchestra.run.smithi117:> if os.path.exists("/proc/{0}".format(pid)): 2023-06-10T18:53:15.224 DEBUG:teuthology.orchestra.run.smithi117:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-06-10T18:53:15.224 DEBUG:teuthology.orchestra.run.smithi117:> contents = proc_f.read() 2023-06-10T18:53:15.224 DEBUG:teuthology.orchestra.run.smithi117:> if mountpoint in contents: 2023-06-10T18:53:15.225 DEBUG:teuthology.orchestra.run.smithi117:> return f 2023-06-10T18:53:15.225 DEBUG:teuthology.orchestra.run.smithi117:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-06-10T18:53:15.225 DEBUG:teuthology.orchestra.run.smithi117:> 2023-06-10T18:53:15.225 DEBUG:teuthology.orchestra.run.smithi117:> print(_find_admin_socket("client.3")) 2023-06-10T18:53:15.226 DEBUG:teuthology.orchestra.run.smithi117:> ' 2023-06-10T18:53:15.339 INFO:teuthology.orchestra.run.smithi117.stdout:/var/run/ceph/ceph-client.3.43946.asok 2023-06-10T18:53:15.522 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.43946.asok 2023-06-10T18:53:15.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:53:15.522 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.43946.asok status 2023-06-10T18:53:15.682 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2023-06-10T18:53:15.682 INFO:teuthology.orchestra.run.smithi117.stdout: "metadata": { 2023-06-10T18:53:15.682 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_sha1": "219d315c3a0b2075e570fb1964be2ad33fe7a9c8", 2023-06-10T18:53:15.683 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_version": "ceph version 18.0.0-4359-g219d315c (219d315c3a0b2075e570fb1964be2ad33fe7a9c8) reef (dev)", 2023-06-10T18:53:15.683 INFO:teuthology.orchestra.run.smithi117.stdout: "entity_id": "3", 2023-06-10T18:53:15.683 INFO:teuthology.orchestra.run.smithi117.stdout: "hostname": "smithi117", 2023-06-10T18:53:15.683 INFO:teuthology.orchestra.run.smithi117.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2023-06-10T18:53:15.683 INFO:teuthology.orchestra.run.smithi117.stdout: "pid": "43946", 2023-06-10T18:53:15.683 INFO:teuthology.orchestra.run.smithi117.stdout: "root": "/" 2023-06-10T18:53:15.683 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-06-10T18:53:15.683 INFO:teuthology.orchestra.run.smithi117.stdout: "dentry_count": 0, 2023-06-10T18:53:15.684 INFO:teuthology.orchestra.run.smithi117.stdout: "dentry_pinned_count": 0, 2023-06-10T18:53:15.684 INFO:teuthology.orchestra.run.smithi117.stdout: "id": 4654, 2023-06-10T18:53:15.684 INFO:teuthology.orchestra.run.smithi117.stdout: "inst": { 2023-06-10T18:53:15.684 INFO:teuthology.orchestra.run.smithi117.stdout: "name": { 2023-06-10T18:53:15.684 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "client", 2023-06-10T18:53:15.684 INFO:teuthology.orchestra.run.smithi117.stdout: "num": 4654 2023-06-10T18:53:15.684 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-06-10T18:53:15.685 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": { 2023-06-10T18:53:15.685 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "v1", 2023-06-10T18:53:15.685 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": "192.168.0.2:0", 2023-06-10T18:53:15.685 INFO:teuthology.orchestra.run.smithi117.stdout: "nonce": 2752037697 2023-06-10T18:53:15.685 INFO:teuthology.orchestra.run.smithi117.stdout: } 2023-06-10T18:53:15.685 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-06-10T18:53:15.685 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": { 2023-06-10T18:53:15.685 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "v1", 2023-06-10T18:53:15.686 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": "192.168.0.2:0", 2023-06-10T18:53:15.686 INFO:teuthology.orchestra.run.smithi117.stdout: "nonce": 2752037697 2023-06-10T18:53:15.686 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-06-10T18:53:15.686 INFO:teuthology.orchestra.run.smithi117.stdout: "inst_str": "client.4654 192.168.0.2:0/2752037697", 2023-06-10T18:53:15.686 INFO:teuthology.orchestra.run.smithi117.stdout: "addr_str": "192.168.0.2:0/2752037697", 2023-06-10T18:53:15.686 INFO:teuthology.orchestra.run.smithi117.stdout: "inode_count": 1, 2023-06-10T18:53:15.686 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_epoch": 7, 2023-06-10T18:53:15.686 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_epoch": 23, 2023-06-10T18:53:15.687 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_epoch_barrier": 0, 2023-06-10T18:53:15.687 INFO:teuthology.orchestra.run.smithi117.stdout: "blocklisted": false, 2023-06-10T18:53:15.687 INFO:teuthology.orchestra.run.smithi117.stdout: "fs_name": "cephfs" 2023-06-10T18:53:15.687 INFO:teuthology.orchestra.run.smithi117.stdout:} 2023-06-10T18:53:15.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:53:15.696 DEBUG:teuthology.orchestra.run.smithi053:> stat --file-system '--printf=%T 2023-06-10T18:53:15.696 DEBUG:teuthology.orchestra.run.smithi053:> ' -- /home/ubuntu/cephtest/mnt.0 2023-06-10T18:53:15.703 INFO:teuthology.orchestra.run.smithi053.stdout:fuseblk 2023-06-10T18:53:15.704 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-06-10T18:53:15.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:53:15.705 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-06-10T18:53:15.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:53:15.764 DEBUG:teuthology.orchestra.run.smithi053:> stat --file-system '--printf=%T 2023-06-10T18:53:15.764 DEBUG:teuthology.orchestra.run.smithi053:> ' -- /home/ubuntu/cephtest/mnt.2 2023-06-10T18:53:15.813 INFO:teuthology.orchestra.run.smithi053.stdout:fuseblk 2023-06-10T18:53:15.813 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2023-06-10T18:53:15.814 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:53:15.814 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-06-10T18:53:15.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:53:15.875 DEBUG:teuthology.orchestra.run.smithi117:> stat --file-system '--printf=%T 2023-06-10T18:53:15.875 DEBUG:teuthology.orchestra.run.smithi117:> ' -- /home/ubuntu/cephtest/mnt.1 2023-06-10T18:53:15.882 INFO:teuthology.orchestra.run.smithi117.stdout:fuseblk 2023-06-10T18:53:15.882 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-06-10T18:53:15.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:53:15.883 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-06-10T18:53:15.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:53:15.939 DEBUG:teuthology.orchestra.run.smithi117:> stat --file-system '--printf=%T 2023-06-10T18:53:15.939 DEBUG:teuthology.orchestra.run.smithi117:> ' -- /home/ubuntu/cephtest/mnt.3 2023-06-10T18:53:15.987 INFO:teuthology.orchestra.run.smithi117.stdout:fuseblk 2023-06-10T18:53:15.988 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2023-06-10T18:53:15.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:53:15.989 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-06-10T18:53:16.042 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-06-10T18:53:16.061 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T18:53:16.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.188+0000 7fde418b6640 1 Processor -- start 2023-06-10T18:53:16.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.188+0000 7fde418b6640 1 -- start start 2023-06-10T18:53:16.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.188+0000 7fde418b6640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fde3c06b780 0x7fde3c15c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:16.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.188+0000 7fde418b6640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde3c0af530 con 0x7fde3c0ceb20 2023-06-10T18:53:16.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.188+0000 7fde418b6640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde3c15fd70 con 0x7fde3c06bb50 2023-06-10T18:53:16.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.188+0000 7fde418b6640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde3c15c3d0 con 0x7fde3c06b780 2023-06-10T18:53:16.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.188+0000 7fde3affd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fde3c06b780 0x7fde3c15c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:16.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.188+0000 7fde3b7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fde3c0ceb20 0x7fde3c0cefa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:37884/0 (socket says 172.21.15.53:37884) 2023-06-10T18:53:16.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.188+0000 7fde3b7fe640 1 -- 172.21.15.53:0/3047105603 learned_addr learned my addr 172.21.15.53:0/3047105603 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:53:16.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.188+0000 7fde3affd640 1 -- 172.21.15.53:0/3047105603 >> v1:172.21.15.117:6789/0 conn(0x7fde3c06bb50 legacy=0x7fde3c15f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:16.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.188+0000 7fde3affd640 1 -- 172.21.15.53:0/3047105603 >> v1:172.21.15.53:6789/0 conn(0x7fde3c0ceb20 legacy=0x7fde3c0cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:16.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.188+0000 7fde39ffb640 1 -- 172.21.15.53:0/3047105603 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4182539277 0 0) 0x7fde3c0af530 con 0x7fde3c0ceb20 2023-06-10T18:53:16.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.188+0000 7fde3affd640 1 -- 172.21.15.53:0/3047105603 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde3c160050 con 0x7fde3c06b780 2023-06-10T18:53:16.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.192+0000 7fde3affd640 1 --2- 172.21.15.53:0/3047105603 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde3c06b780 0x7fde3c15c7f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fde2c0097c0 tx=0x7fde2c01c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7f87714b2c4615 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:16.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.192+0000 7fde39ffb640 1 -- 172.21.15.53:0/3047105603 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde2c0ab600 con 0x7fde3c06b780 2023-06-10T18:53:16.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.192+0000 7fde39ffb640 1 -- 172.21.15.53:0/3047105603 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde2c0a7050 con 0x7fde3c06b780 2023-06-10T18:53:16.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.192+0000 7fde39ffb640 1 -- 172.21.15.53:0/3047105603 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde2c0ab980 con 0x7fde3c06b780 2023-06-10T18:53:16.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.192+0000 7fde418b6640 1 -- 172.21.15.53:0/3047105603 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde3c06b780 msgr2=0x7fde3c15c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:16.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.192+0000 7fde418b6640 1 --2- 172.21.15.53:0/3047105603 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde3c06b780 0x7fde3c15c7f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fde2c0097c0 tx=0x7fde2c01c3b0 comp rx=0 tx=0).stop 2023-06-10T18:53:16.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.192+0000 7fde418b6640 1 -- 172.21.15.53:0/3047105603 shutdown_connections 2023-06-10T18:53:16.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.192+0000 7fde418b6640 1 --2- 172.21.15.53:0/3047105603 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde3c06b780 0x7fde3c15c7f0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:16.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.192+0000 7fde418b6640 1 -- 172.21.15.53:0/3047105603 >> 172.21.15.53:0/3047105603 conn(0x7fde3c06a090 msgr2=0x7fde3c06d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:16.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.192+0000 7fde418b6640 1 -- 172.21.15.53:0/3047105603 shutdown_connections 2023-06-10T18:53:16.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.192+0000 7fde418b6640 1 -- 172.21.15.53:0/3047105603 wait complete. 2023-06-10T18:53:16.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.192+0000 7fde418b6640 1 Processor -- start 2023-06-10T18:53:16.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.192+0000 7fde418b6640 1 -- start start 2023-06-10T18:53:16.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.192+0000 7fde418b6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde3c06b780 0x7fde3c0b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:16.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.192+0000 7fde418b6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde3c06bb50 0x7fde3c1540d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:16.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.192+0000 7fde418b6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde3c0ceb20 0x7fde3c0cffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:16.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.192+0000 7fde418b6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde3c1592a0 con 0x7fde3c06bb50 2023-06-10T18:53:16.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.192+0000 7fde418b6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde3c154610 con 0x7fde3c0ceb20 2023-06-10T18:53:16.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.192+0000 7fde418b6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde3c0b5400 con 0x7fde3c06b780 2023-06-10T18:53:16.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.192+0000 7fde3a7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde3c06bb50 0x7fde3c1540d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:16.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.192+0000 7fde3a7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde3c06bb50 0x7fde3c1540d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40374/0 (socket says 172.21.15.53:40374) 2023-06-10T18:53:16.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.192+0000 7fde3a7fc640 1 -- 172.21.15.53:0/1300188528 learned_addr learned my addr 172.21.15.53:0/1300188528 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:16.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.192+0000 7fde3affd640 1 --2- 172.21.15.53:0/1300188528 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde3c06b780 0x7fde3c0b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:16.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.192+0000 7fde3b7fe640 1 --2- 172.21.15.53:0/1300188528 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde3c0ceb20 0x7fde3c0cffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:16.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.192+0000 7fde3a7fc640 1 -- 172.21.15.53:0/1300188528 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde3c06b780 msgr2=0x7fde3c0b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:16.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.192+0000 7fde3a7fc640 1 --2- 172.21.15.53:0/1300188528 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde3c06b780 0x7fde3c0b4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:16.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.192+0000 7fde3a7fc640 1 -- 172.21.15.53:0/1300188528 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde3c0ceb20 msgr2=0x7fde3c0cffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:16.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.192+0000 7fde3a7fc640 1 --2- 172.21.15.53:0/1300188528 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde3c0ceb20 0x7fde3c0cffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:16.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.192+0000 7fde3a7fc640 1 -- 172.21.15.53:0/1300188528 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde2c009420 con 0x7fde3c06bb50 2023-06-10T18:53:16.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.192+0000 7fde3affd640 1 --2- 172.21.15.53:0/1300188528 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde3c06b780 0x7fde3c0b4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:16.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.192+0000 7fde3b7fe640 1 --2- 172.21.15.53:0/1300188528 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde3c0ceb20 0x7fde3c0cffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:16.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.192+0000 7fde3a7fc640 1 --2- 172.21.15.53:0/1300188528 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde3c06bb50 0x7fde3c1540d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fde3000c450 tx=0x7fde3000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:16.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.192+0000 7fde23fff640 1 -- 172.21.15.53:0/1300188528 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde30012830 con 0x7fde3c06bb50 2023-06-10T18:53:16.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.192+0000 7fde23fff640 1 -- 172.21.15.53:0/1300188528 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde300129b0 con 0x7fde3c06bb50 2023-06-10T18:53:16.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.192+0000 7fde23fff640 1 -- 172.21.15.53:0/1300188528 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde30012d60 con 0x7fde3c06bb50 2023-06-10T18:53:16.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.192+0000 7fde418b6640 1 -- 172.21.15.53:0/1300188528 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde3c0b56e0 con 0x7fde3c06bb50 2023-06-10T18:53:16.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.192+0000 7fde418b6640 1 -- 172.21.15.53:0/1300188528 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde3c158ec0 con 0x7fde3c06bb50 2023-06-10T18:53:16.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.196+0000 7fde418b6640 1 -- 172.21.15.53:0/1300188528 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde3c04d790 con 0x7fde3c06bb50 2023-06-10T18:53:16.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.196+0000 7fde23fff640 1 -- 172.21.15.53:0/1300188528 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fde3001c460 con 0x7fde3c06bb50 2023-06-10T18:53:16.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.196+0000 7fde23fff640 1 --2- 172.21.15.53:0/1300188528 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fde28066280 0x7fde28068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:16.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.196+0000 7fde23fff640 1 -- 172.21.15.53:0/1300188528 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fde30083b40 con 0x7fde3c06bb50 2023-06-10T18:53:16.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.196+0000 7fde3affd640 1 --2- 172.21.15.53:0/1300188528 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fde28066280 0x7fde28068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:16.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.196+0000 7fde3affd640 1 --2- 172.21.15.53:0/1300188528 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fde28066280 0x7fde28068730 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fde3c070730 tx=0x7fde2c0a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:16.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.200+0000 7fde23fff640 1 -- 172.21.15.53:0/1300188528 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fde30051050 con 0x7fde3c06bb50 2023-06-10T18:53:16.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.352+0000 7fde418b6640 1 -- 172.21.15.53:0/1300188528 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fde3c06df70 con 0x7fde3c06bb50 2023-06-10T18:53:16.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.356+0000 7fde23fff640 1 -- 172.21.15.53:0/1300188528 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18267 (secure 0 0 0) 0x7fde30054670 con 0x7fde3c06bb50 2023-06-10T18:53:16.366 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:53:16.366 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":23,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T18:52:45.921586+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-10T18:52:43.396243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-10T18:52:43.894228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T18:53:16.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.360+0000 7fde418b6640 1 -- 172.21.15.53:0/1300188528 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fde28066280 msgr2=0x7fde28068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:16.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.360+0000 7fde418b6640 1 --2- 172.21.15.53:0/1300188528 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fde28066280 0x7fde28068730 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fde3c070730 tx=0x7fde2c0a6000 comp rx=0 tx=0).stop 2023-06-10T18:53:16.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.360+0000 7fde418b6640 1 -- 172.21.15.53:0/1300188528 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde3c06bb50 msgr2=0x7fde3c1540d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:16.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.360+0000 7fde418b6640 1 --2- 172.21.15.53:0/1300188528 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde3c06bb50 0x7fde3c1540d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fde3000c450 tx=0x7fde3000c910 comp rx=0 tx=0).stop 2023-06-10T18:53:16.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.360+0000 7fde418b6640 1 -- 172.21.15.53:0/1300188528 shutdown_connections 2023-06-10T18:53:16.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.360+0000 7fde418b6640 1 --2- 172.21.15.53:0/1300188528 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fde28066280 0x7fde28068730 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:16.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.360+0000 7fde418b6640 1 --2- 172.21.15.53:0/1300188528 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde3c0ceb20 0x7fde3c0cffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:16.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.360+0000 7fde418b6640 1 --2- 172.21.15.53:0/1300188528 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde3c06bb50 0x7fde3c1540d0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:16.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.360+0000 7fde418b6640 1 --2- 172.21.15.53:0/1300188528 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde3c06b780 0x7fde3c0b4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:16.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.360+0000 7fde418b6640 1 -- 172.21.15.53:0/1300188528 >> 172.21.15.53:0/1300188528 conn(0x7fde3c06a090 msgr2=0x7fde3c0b0720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:16.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.360+0000 7fde418b6640 1 -- 172.21.15.53:0/1300188528 shutdown_connections 2023-06-10T18:53:16.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.360+0000 7fde418b6640 1 -- 172.21.15.53:0/1300188528 wait complete. 2023-06-10T18:53:16.384 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-10T18:52:33.633114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-10T18:52:39.171487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-10T18:52:43.396243+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-10T18:52:43.894228+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-10T18:53:16.384 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-10T18:53:16.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.492+0000 7f60d7098640 1 Processor -- start 2023-06-10T18:53:16.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.492+0000 7f60d7098640 1 -- start start 2023-06-10T18:53:16.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.492+0000 7f60d7098640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60d00c9fa0 0x7f60d006bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:16.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.492+0000 7f60d7098640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f60d00af760 0x7f60d00afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:16.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.492+0000 7f60d7098640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60d006b090 con 0x7f60d006c020 2023-06-10T18:53:16.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.492+0000 7f60d7098640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60d00b0120 con 0x7f60d00af760 2023-06-10T18:53:16.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.492+0000 7f60d7098640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60d00ca370 con 0x7f60d00c9fa0 2023-06-10T18:53:16.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.492+0000 7f60cffff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f60d006c020 0x7f60d00c82a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:37888/0 (socket says 172.21.15.53:37888) 2023-06-10T18:53:16.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.492+0000 7f60cffff640 1 -- 172.21.15.53:0/3857554709 learned_addr learned my addr 172.21.15.53:0/3857554709 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:53:16.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.492+0000 7f60d4e34640 1 --2- 172.21.15.53:0/3857554709 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60d00c9fa0 0x7f60d006bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:16.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.492+0000 7f60d5635640 1 --2- 172.21.15.53:0/3857554709 >> v2:172.21.15.117:3300/0 conn(0x7f60d00af760 0x7f60d00afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:16.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.492+0000 7f60cf7fe640 1 -- 172.21.15.53:0/3857554709 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3747057907 0 0) 0x7f60d006b090 con 0x7f60d006c020 2023-06-10T18:53:16.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.492+0000 7f60cf7fe640 1 -- 172.21.15.53:0/3857554709 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60b8003530 con 0x7f60d006c020 2023-06-10T18:53:16.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.492+0000 7f60cf7fe640 1 -- 172.21.15.53:0/3857554709 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1546173718 0 0) 0x7f60b8003530 con 0x7f60d006c020 2023-06-10T18:53:16.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.492+0000 7f60cf7fe640 1 -- 172.21.15.53:0/3857554709 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60d00c9fa0 msgr2=0x7f60d006bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:16.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.492+0000 7f60cf7fe640 1 --2- 172.21.15.53:0/3857554709 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60d00c9fa0 0x7f60d006bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:16.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.492+0000 7f60cf7fe640 1 -- 172.21.15.53:0/3857554709 >> v2:172.21.15.117:3300/0 conn(0x7f60d00af760 msgr2=0x7f60d00afbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:16.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.492+0000 7f60cf7fe640 1 --2- 172.21.15.53:0/3857554709 >> v2:172.21.15.117:3300/0 conn(0x7f60d00af760 0x7f60d00afbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:16.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.492+0000 7f60cf7fe640 1 -- 172.21.15.53:0/3857554709 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60d0070d50 con 0x7f60d006c020 2023-06-10T18:53:16.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.492+0000 7f60cf7fe640 1 -- 172.21.15.53:0/3857554709 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f60c0001680 con 0x7f60d006c020 2023-06-10T18:53:16.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.492+0000 7f60cf7fe640 1 -- 172.21.15.53:0/3857554709 >> v1:172.21.15.53:6789/0 conn(0x7f60d006c020 legacy=0x7f60d00c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:16.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.492+0000 7f60cf7fe640 1 --2- 172.21.15.53:0/3857554709 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60b8003980 0x7f60b8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:16.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.492+0000 7f60cf7fe640 1 --2- 172.21.15.53:0/3857554709 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60b80043b0 0x7f60b8004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:16.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.492+0000 7f60cf7fe640 1 --2- 172.21.15.53:0/3857554709 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60d00c9fa0 0x7f60b8004fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:16.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.492+0000 7f60cf7fe640 1 -- 172.21.15.53:0/3857554709 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60d00b0120 con 0x7f60b80043b0 2023-06-10T18:53:16.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.492+0000 7f60cf7fe640 1 -- 172.21.15.53:0/3857554709 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60d00ca370 con 0x7f60b8003980 2023-06-10T18:53:16.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.492+0000 7f60cf7fe640 1 -- 172.21.15.53:0/3857554709 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60b800b990 con 0x7f60d00c9fa0 2023-06-10T18:53:16.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.492+0000 7f60cffff640 1 --2- 172.21.15.53:0/3857554709 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60b80043b0 0x7f60b8004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:16.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.492+0000 7f60d4e34640 1 --2- 172.21.15.53:0/3857554709 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60b8003980 0x7f60b8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:16.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.492+0000 7f60cffff640 1 -- 172.21.15.53:0/3857554709 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60d00c9fa0 msgr2=0x7f60b8004fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:16.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.492+0000 7f60cffff640 1 --2- 172.21.15.53:0/3857554709 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60d00c9fa0 0x7f60b8004fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:16.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.492+0000 7f60cffff640 1 -- 172.21.15.53:0/3857554709 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60b8003980 msgr2=0x7f60b8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:16.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.492+0000 7f60cffff640 1 --2- 172.21.15.53:0/3857554709 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60b8003980 0x7f60b8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:16.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.492+0000 7f60cffff640 1 -- 172.21.15.53:0/3857554709 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60b8003530 con 0x7f60b80043b0 2023-06-10T18:53:16.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.492+0000 7f60d4e34640 1 --2- 172.21.15.53:0/3857554709 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60b8003980 0x7f60b8003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:16.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.496+0000 7f60cffff640 1 --2- 172.21.15.53:0/3857554709 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60b80043b0 0x7f60b8004870 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f60c000c270 tx=0x7f60c001cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a00562c8031d9725 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:16.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.496+0000 7f60cf7fe640 1 -- 172.21.15.53:0/3857554709 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c00058e0 con 0x7f60b80043b0 2023-06-10T18:53:16.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.496+0000 7f60cf7fe640 1 -- 172.21.15.53:0/3857554709 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60c0005a40 con 0x7f60b80043b0 2023-06-10T18:53:16.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.496+0000 7f60cf7fe640 1 -- 172.21.15.53:0/3857554709 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c0005e10 con 0x7f60b80043b0 2023-06-10T18:53:16.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.496+0000 7f60d7098640 1 -- 172.21.15.53:0/3857554709 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60b80043b0 msgr2=0x7f60b8004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:16.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.496+0000 7f60d7098640 1 --2- 172.21.15.53:0/3857554709 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60b80043b0 0x7f60b8004870 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f60c000c270 tx=0x7f60c001cc30 comp rx=0 tx=0).stop 2023-06-10T18:53:16.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.496+0000 7f60d5635640 1 -- 172.21.15.53:0/3857554709 reap_dead start 2023-06-10T18:53:16.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.496+0000 7f60d7098640 1 -- 172.21.15.53:0/3857554709 shutdown_connections 2023-06-10T18:53:16.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.496+0000 7f60d7098640 1 -- 172.21.15.53:0/3857554709 >> 172.21.15.53:0/3857554709 conn(0x7f60d006a0e0 msgr2=0x7f60d00cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:16.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.496+0000 7f60d7098640 1 -- 172.21.15.53:0/3857554709 shutdown_connections 2023-06-10T18:53:16.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.496+0000 7f60d7098640 1 -- 172.21.15.53:0/3857554709 wait complete. 2023-06-10T18:53:16.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.496+0000 7f60d7098640 1 Processor -- start 2023-06-10T18:53:16.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.496+0000 7f60d7098640 1 -- start start 2023-06-10T18:53:16.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.496+0000 7f60d7098640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60b80043b0 0x7f60d01544c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:16.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.496+0000 7f60d7098640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60d00aa9d0 0x7f60d00ad670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:16.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.496+0000 7f60d7098640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60d00adbb0 0x7f60d00ae9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:16.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.496+0000 7f60d7098640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60d00aa540 con 0x7f60d00adbb0 2023-06-10T18:53:16.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.496+0000 7f60d7098640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60d00a9930 con 0x7f60d00aa9d0 2023-06-10T18:53:16.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.496+0000 7f60d7098640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60d00a9c10 con 0x7f60b80043b0 2023-06-10T18:53:16.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.496+0000 7f60d5635640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60d00adbb0 0x7f60d00ae9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:16.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.496+0000 7f60d5635640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60d00adbb0 0x7f60d00ae9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40396/0 (socket says 172.21.15.53:40396) 2023-06-10T18:53:16.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.496+0000 7f60d5635640 1 -- 172.21.15.53:0/3247202889 learned_addr learned my addr 172.21.15.53:0/3247202889 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:16.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.496+0000 7f60cffff640 1 --2- 172.21.15.53:0/3247202889 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60d00aa9d0 0x7f60d00ad670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:16.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.496+0000 7f60d4e34640 1 --2- 172.21.15.53:0/3247202889 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60b80043b0 0x7f60d01544c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:16.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.496+0000 7f60d5635640 1 -- 172.21.15.53:0/3247202889 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60b80043b0 msgr2=0x7f60d01544c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:16.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.496+0000 7f60d5635640 1 --2- 172.21.15.53:0/3247202889 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60b80043b0 0x7f60d01544c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:16.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.496+0000 7f60d5635640 1 -- 172.21.15.53:0/3247202889 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60d00aa9d0 msgr2=0x7f60d00ad670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:16.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.496+0000 7f60d5635640 1 --2- 172.21.15.53:0/3247202889 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60d00aa9d0 0x7f60d00ad670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:16.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.496+0000 7f60d5635640 1 -- 172.21.15.53:0/3247202889 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60d00a9ef0 con 0x7f60d00adbb0 2023-06-10T18:53:16.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.500+0000 7f60d5635640 1 --2- 172.21.15.53:0/3247202889 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60d00adbb0 0x7f60d00ae9f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f60d00cdc20 tx=0x7f60c800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:16.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.500+0000 7f60cd7fa640 1 -- 172.21.15.53:0/3247202889 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c8010040 con 0x7f60d00adbb0 2023-06-10T18:53:16.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.500+0000 7f60cd7fa640 1 -- 172.21.15.53:0/3247202889 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60c8014810 con 0x7f60d00adbb0 2023-06-10T18:53:16.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.500+0000 7f60d7098640 1 -- 172.21.15.53:0/3247202889 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60d00aa1d0 con 0x7f60d00adbb0 2023-06-10T18:53:16.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.500+0000 7f60cd7fa640 1 -- 172.21.15.53:0/3247202889 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c8009b10 con 0x7f60d00adbb0 2023-06-10T18:53:16.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.500+0000 7f60d7098640 1 -- 172.21.15.53:0/3247202889 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60d00aae40 con 0x7f60d00adbb0 2023-06-10T18:53:16.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.500+0000 7f60d7098640 1 -- 172.21.15.53:0/3247202889 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60d004d790 con 0x7f60d00adbb0 2023-06-10T18:53:16.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.500+0000 7f60cd7fa640 1 -- 172.21.15.53:0/3247202889 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f60c8014bc0 con 0x7f60d00adbb0 2023-06-10T18:53:16.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.500+0000 7f60cd7fa640 1 --2- 172.21.15.53:0/3247202889 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f60bc0662b0 0x7f60bc068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:16.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.500+0000 7f60cd7fa640 1 -- 172.21.15.53:0/3247202889 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f60c8083830 con 0x7f60d00adbb0 2023-06-10T18:53:16.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.500+0000 7f60d4e34640 1 --2- 172.21.15.53:0/3247202889 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f60bc0662b0 0x7f60bc068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:16.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.500+0000 7f60d4e34640 1 --2- 172.21.15.53:0/3247202889 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f60bc0662b0 0x7f60bc068760 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f60c40099e0 tx=0x7f60c4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:16.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.504+0000 7f60cd7fa640 1 -- 172.21.15.53:0/3247202889 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f60c8050cb0 con 0x7f60d00adbb0 2023-06-10T18:53:16.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.652+0000 7f60d7098640 1 -- 172.21.15.53:0/3247202889 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f60d00aca40 con 0x7f60d00adbb0 2023-06-10T18:53:16.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.652+0000 7f60cd7fa640 1 -- 172.21.15.53:0/3247202889 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f60c80542d0 con 0x7f60d00adbb0 2023-06-10T18:53:16.664 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-06-10T18:53:16.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.656+0000 7f60d7098640 1 -- 172.21.15.53:0/3247202889 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f60bc0662b0 msgr2=0x7f60bc068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:16.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.656+0000 7f60d7098640 1 --2- 172.21.15.53:0/3247202889 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f60bc0662b0 0x7f60bc068760 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f60c40099e0 tx=0x7f60c4008040 comp rx=0 tx=0).stop 2023-06-10T18:53:16.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.656+0000 7f60d7098640 1 -- 172.21.15.53:0/3247202889 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60d00adbb0 msgr2=0x7f60d00ae9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:16.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.656+0000 7f60d7098640 1 --2- 172.21.15.53:0/3247202889 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60d00adbb0 0x7f60d00ae9f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f60d00cdc20 tx=0x7f60c800ee80 comp rx=0 tx=0).stop 2023-06-10T18:53:16.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.656+0000 7f60d7098640 1 -- 172.21.15.53:0/3247202889 shutdown_connections 2023-06-10T18:53:16.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.656+0000 7f60d7098640 1 --2- 172.21.15.53:0/3247202889 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f60bc0662b0 0x7f60bc068760 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:16.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.656+0000 7f60d7098640 1 --2- 172.21.15.53:0/3247202889 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60d00adbb0 0x7f60d00ae9f0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:16.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.656+0000 7f60d7098640 1 --2- 172.21.15.53:0/3247202889 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60d00aa9d0 0x7f60d00ad670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:16.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.656+0000 7f60d7098640 1 --2- 172.21.15.53:0/3247202889 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60b80043b0 0x7f60d01544c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:16.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.656+0000 7f60d7098640 1 -- 172.21.15.53:0/3247202889 >> 172.21.15.53:0/3247202889 conn(0x7f60d006a0e0 msgr2=0x7f60d00b1190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:16.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.656+0000 7f60d7098640 1 -- 172.21.15.53:0/3247202889 shutdown_connections 2023-06-10T18:53:16.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.656+0000 7f60d7098640 1 -- 172.21.15.53:0/3247202889 wait complete. 2023-06-10T18:53:16.681 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-10T18:53:16.808 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.800+0000 7f6766267640 1 Processor -- start 2023-06-10T18:53:16.809 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.800+0000 7f6766267640 1 -- start start 2023-06-10T18:53:16.809 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.800+0000 7f6766267640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f67600c9fa0 0x7f676006bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:16.809 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.800+0000 7f6766267640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f676006c020 0x7f67600c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:16.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.800+0000 7f6766267640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f67600c87e0 0x7f67600af760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:16.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.800+0000 7f6766267640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f676006b090 con 0x7f67600c9fa0 2023-06-10T18:53:16.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.800+0000 7f6766267640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67600ca370 con 0x7f67600c87e0 2023-06-10T18:53:16.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.800+0000 7f6766267640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6760070d50 con 0x7f676006c020 2023-06-10T18:53:16.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.800+0000 7f675ffff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f67600c9fa0 0x7f676006bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:16.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.800+0000 7f675ffff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f67600c9fa0 0x7f676006bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40412/0 (socket says 172.21.15.53:40412) 2023-06-10T18:53:16.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.800+0000 7f675ffff640 1 -- 172.21.15.53:0/2646625942 learned_addr learned my addr 172.21.15.53:0/2646625942 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:16.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.800+0000 7f675f7fe640 1 --2- 172.21.15.53:0/2646625942 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f676006c020 0x7f67600c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:16.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.800+0000 7f6764804640 1 --2- 172.21.15.53:0/2646625942 >> v2:172.21.15.117:3300/0 conn(0x7f67600c87e0 0x7f67600af760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:16.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.800+0000 7f675ffff640 1 -- 172.21.15.53:0/2646625942 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f676006c020 msgr2=0x7f67600c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:16.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.800+0000 7f675ffff640 1 --2- 172.21.15.53:0/2646625942 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f676006c020 0x7f67600c82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:16.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.800+0000 7f675ffff640 1 -- 172.21.15.53:0/2646625942 >> v2:172.21.15.117:3300/0 conn(0x7f67600c87e0 msgr2=0x7f67600af760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:16.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.800+0000 7f675ffff640 1 --2- 172.21.15.53:0/2646625942 >> v2:172.21.15.117:3300/0 conn(0x7f67600c87e0 0x7f67600af760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:16.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.800+0000 7f675ffff640 1 -- 172.21.15.53:0/2646625942 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6760071030 con 0x7f67600c9fa0 2023-06-10T18:53:16.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.804+0000 7f675ffff640 1 --2- 172.21.15.53:0/2646625942 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67600c9fa0 0x7f676006bae0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f67600c81a0 tx=0x7f675001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21421edff2e9f084 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:16.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.804+0000 7f675effd640 1 -- 172.21.15.53:0/2646625942 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67500ac640 con 0x7f67600c9fa0 2023-06-10T18:53:16.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.804+0000 7f675effd640 1 -- 172.21.15.53:0/2646625942 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67500ac7a0 con 0x7f67600c9fa0 2023-06-10T18:53:16.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.804+0000 7f675effd640 1 -- 172.21.15.53:0/2646625942 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67500acb30 con 0x7f67600c9fa0 2023-06-10T18:53:16.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.804+0000 7f6766267640 1 -- 172.21.15.53:0/2646625942 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67600c9fa0 msgr2=0x7f676006bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:16.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.804+0000 7f6766267640 1 --2- 172.21.15.53:0/2646625942 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67600c9fa0 0x7f676006bae0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f67600c81a0 tx=0x7f675001c440 comp rx=0 tx=0).stop 2023-06-10T18:53:16.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.804+0000 7f6766267640 1 -- 172.21.15.53:0/2646625942 shutdown_connections 2023-06-10T18:53:16.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.804+0000 7f6766267640 1 --2- 172.21.15.53:0/2646625942 >> v2:172.21.15.117:3300/0 conn(0x7f67600c87e0 0x7f67600af760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:16.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.804+0000 7f6766267640 1 --2- 172.21.15.53:0/2646625942 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f676006c020 0x7f67600c82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:16.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.804+0000 7f6766267640 1 --2- 172.21.15.53:0/2646625942 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67600c9fa0 0x7f676006bae0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:16.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.804+0000 7f6766267640 1 -- 172.21.15.53:0/2646625942 >> 172.21.15.53:0/2646625942 conn(0x7f676006a0e0 msgr2=0x7f67600cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:16.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.804+0000 7f6766267640 1 -- 172.21.15.53:0/2646625942 shutdown_connections 2023-06-10T18:53:16.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.804+0000 7f6766267640 1 -- 172.21.15.53:0/2646625942 wait complete. 2023-06-10T18:53:16.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.804+0000 7f6766267640 1 Processor -- start 2023-06-10T18:53:16.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.804+0000 7f6766267640 1 -- start start 2023-06-10T18:53:16.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.804+0000 7f6766267640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f676006c020 0x7f67601f2690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:16.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.804+0000 7f6766267640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67600c87e0 0x7f67600b1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:16.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.804+0000 7f6766267640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67600c9fa0 0x7f6760147770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:16.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.804+0000 7f6766267640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67601f3c80 con 0x7f67600c87e0 2023-06-10T18:53:16.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.804+0000 7f6766267640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67601f3000 con 0x7f67600c9fa0 2023-06-10T18:53:16.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.804+0000 7f6766267640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67601f32e0 con 0x7f676006c020 2023-06-10T18:53:16.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.804+0000 7f675f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67600c87e0 0x7f67600b1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:16.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.804+0000 7f675f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67600c87e0 0x7f67600b1d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40418/0 (socket says 172.21.15.53:40418) 2023-06-10T18:53:16.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.804+0000 7f675f7fe640 1 -- 172.21.15.53:0/693604536 learned_addr learned my addr 172.21.15.53:0/693604536 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:16.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.808+0000 7f675ffff640 1 --2- 172.21.15.53:0/693604536 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f676006c020 0x7f67601f2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:16.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.808+0000 7f6764804640 1 --2- 172.21.15.53:0/693604536 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67600c9fa0 0x7f6760147770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:16.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.808+0000 7f675f7fe640 1 -- 172.21.15.53:0/693604536 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f676006c020 msgr2=0x7f67601f2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:16.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.808+0000 7f675f7fe640 1 --2- 172.21.15.53:0/693604536 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f676006c020 0x7f67601f2690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:16.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.808+0000 7f675f7fe640 1 -- 172.21.15.53:0/693604536 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67600c9fa0 msgr2=0x7f6760147770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:16.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.808+0000 7f675f7fe640 1 --2- 172.21.15.53:0/693604536 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67600c9fa0 0x7f6760147770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:16.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.808+0000 7f675f7fe640 1 -- 172.21.15.53:0/693604536 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67500094d0 con 0x7f67600c87e0 2023-06-10T18:53:16.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.808+0000 7f675f7fe640 1 --2- 172.21.15.53:0/693604536 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67600c87e0 0x7f67600b1d50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f675400d800 tx=0x7f675400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:16.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.808+0000 7f675cff9640 1 -- 172.21.15.53:0/693604536 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67540096a0 con 0x7f67600c87e0 2023-06-10T18:53:16.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.808+0000 7f675cff9640 1 -- 172.21.15.53:0/693604536 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6754009800 con 0x7f67600c87e0 2023-06-10T18:53:16.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.808+0000 7f6766267640 1 -- 172.21.15.53:0/693604536 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67601f35c0 con 0x7f67600c87e0 2023-06-10T18:53:16.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.808+0000 7f675cff9640 1 -- 172.21.15.53:0/693604536 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6754009b70 con 0x7f67600c87e0 2023-06-10T18:53:16.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.808+0000 7f6766267640 1 -- 172.21.15.53:0/693604536 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67601f2bd0 con 0x7f67600c87e0 2023-06-10T18:53:16.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.808+0000 7f6766267640 1 -- 172.21.15.53:0/693604536 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f676004d790 con 0x7f67600c87e0 2023-06-10T18:53:16.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.808+0000 7f675cff9640 1 -- 172.21.15.53:0/693604536 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6754009cd0 con 0x7f67600c87e0 2023-06-10T18:53:16.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.808+0000 7f675cff9640 1 --2- 172.21.15.53:0/693604536 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f674c0662b0 0x7f674c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:16.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.808+0000 7f675cff9640 1 -- 172.21.15.53:0/693604536 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6754084530 con 0x7f67600c87e0 2023-06-10T18:53:16.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.808+0000 7f675ffff640 1 --2- 172.21.15.53:0/693604536 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f674c0662b0 0x7f674c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:16.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.808+0000 7f675ffff640 1 --2- 172.21.15.53:0/693604536 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f674c0662b0 0x7f674c068760 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f67500ae000 tx=0x7f6750008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:16.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.812+0000 7f675cff9640 1 -- 172.21.15.53:0/693604536 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6754051920 con 0x7f67600c87e0 2023-06-10T18:53:16.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.972+0000 7f6766267640 1 -- 172.21.15.53:0/693604536 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f67600ce670 con 0x7f67600c87e0 2023-06-10T18:53:16.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.972+0000 7f675cff9640 1 -- 172.21.15.53:0/693604536 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6754054f40 con 0x7f67600c87e0 2023-06-10T18:53:16.981 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-06-10T18:53:16.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.972+0000 7f6766267640 1 -- 172.21.15.53:0/693604536 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f674c0662b0 msgr2=0x7f674c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:16.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.972+0000 7f6766267640 1 --2- 172.21.15.53:0/693604536 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f674c0662b0 0x7f674c068760 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f67500ae000 tx=0x7f6750008040 comp rx=0 tx=0).stop 2023-06-10T18:53:16.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.972+0000 7f6766267640 1 -- 172.21.15.53:0/693604536 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67600c87e0 msgr2=0x7f67600b1d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:16.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.972+0000 7f6766267640 1 --2- 172.21.15.53:0/693604536 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67600c87e0 0x7f67600b1d50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f675400d800 tx=0x7f675400dcc0 comp rx=0 tx=0).stop 2023-06-10T18:53:16.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.972+0000 7f6766267640 1 -- 172.21.15.53:0/693604536 shutdown_connections 2023-06-10T18:53:16.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.972+0000 7f6766267640 1 --2- 172.21.15.53:0/693604536 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f674c0662b0 0x7f674c068760 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:16.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.972+0000 7f6766267640 1 --2- 172.21.15.53:0/693604536 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67600c9fa0 0x7f6760147770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:16.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.972+0000 7f6766267640 1 --2- 172.21.15.53:0/693604536 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67600c87e0 0x7f67600b1d50 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:16.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.972+0000 7f6766267640 1 --2- 172.21.15.53:0/693604536 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f676006c020 0x7f67601f2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:16.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.972+0000 7f6766267640 1 -- 172.21.15.53:0/693604536 >> 172.21.15.53:0/693604536 conn(0x7f676006a0e0 msgr2=0x7f67600c9260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:16.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.972+0000 7f6766267640 1 -- 172.21.15.53:0/693604536 shutdown_connections 2023-06-10T18:53:16.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:16.972+0000 7f6766267640 1 -- 172.21.15.53:0/693604536 wait complete. 2023-06-10T18:53:17.000 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-10T18:53:17.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.116+0000 7f33b1135640 1 Processor -- start 2023-06-10T18:53:17.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.120+0000 7f33b1135640 1 -- start start 2023-06-10T18:53:17.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.120+0000 7f33b1135640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33ac0c9fa0 0x7f33ac06bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:17.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.120+0000 7f33b1135640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f33ac0af760 0x7f33ac0afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:17.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.120+0000 7f33b1135640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33ac06b090 con 0x7f33ac06c020 2023-06-10T18:53:17.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.120+0000 7f33b1135640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33ac0b0120 con 0x7f33ac0af760 2023-06-10T18:53:17.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.120+0000 7f33b1135640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33ac0ca370 con 0x7f33ac0c9fa0 2023-06-10T18:53:17.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.120+0000 7f33aa59c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f33ac06c020 0x7f33ac0c82a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:37898/0 (socket says 172.21.15.53:37898) 2023-06-10T18:53:17.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.120+0000 7f33aa59c640 1 -- 172.21.15.53:0/3657941915 learned_addr learned my addr 172.21.15.53:0/3657941915 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:53:17.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.120+0000 7f33ab59e640 1 --2- 172.21.15.53:0/3657941915 >> v2:172.21.15.117:3300/0 conn(0x7f33ac0af760 0x7f33ac0afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:17.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.120+0000 7f33aad9d640 1 --2- 172.21.15.53:0/3657941915 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33ac0c9fa0 0x7f33ac06bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:17.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.120+0000 7f33a9d9b640 1 -- 172.21.15.53:0/3657941915 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 841218500 0 0) 0x7f33ac06b090 con 0x7f33ac06c020 2023-06-10T18:53:17.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.120+0000 7f33a9d9b640 1 -- 172.21.15.53:0/3657941915 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3394003530 con 0x7f33ac06c020 2023-06-10T18:53:17.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.120+0000 7f33a9d9b640 1 -- 172.21.15.53:0/3657941915 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3021766890 0 0) 0x7f3394003530 con 0x7f33ac06c020 2023-06-10T18:53:17.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.120+0000 7f33a9d9b640 1 -- 172.21.15.53:0/3657941915 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33ac0c9fa0 msgr2=0x7f33ac06bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:17.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.120+0000 7f33a9d9b640 1 --2- 172.21.15.53:0/3657941915 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33ac0c9fa0 0x7f33ac06bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:17.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.120+0000 7f33a9d9b640 1 -- 172.21.15.53:0/3657941915 >> v2:172.21.15.117:3300/0 conn(0x7f33ac0af760 msgr2=0x7f33ac0afbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:17.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.120+0000 7f33a9d9b640 1 --2- 172.21.15.53:0/3657941915 >> v2:172.21.15.117:3300/0 conn(0x7f33ac0af760 0x7f33ac0afbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:17.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.120+0000 7f33a9d9b640 1 -- 172.21.15.53:0/3657941915 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33ac070d50 con 0x7f33ac06c020 2023-06-10T18:53:17.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.120+0000 7f33a9d9b640 1 -- 172.21.15.53:0/3657941915 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f33a0001680 con 0x7f33ac06c020 2023-06-10T18:53:17.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.120+0000 7f33a9d9b640 1 -- 172.21.15.53:0/3657941915 >> v1:172.21.15.53:6789/0 conn(0x7f33ac06c020 legacy=0x7f33ac0c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:17.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.120+0000 7f33a9d9b640 1 --2- 172.21.15.53:0/3657941915 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33ac0c9fa0 0x7f3394003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:17.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.120+0000 7f33a9d9b640 1 --2- 172.21.15.53:0/3657941915 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3394003f00 0x7f33940047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:17.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.120+0000 7f33a9d9b640 1 --2- 172.21.15.53:0/3657941915 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3394004d10 0x7f3394005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:17.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.120+0000 7f33a9d9b640 1 -- 172.21.15.53:0/3657941915 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33ac0b0120 con 0x7f3394003f00 2023-06-10T18:53:17.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.120+0000 7f33a9d9b640 1 -- 172.21.15.53:0/3657941915 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33ac0ca370 con 0x7f3394004d10 2023-06-10T18:53:17.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.120+0000 7f33a9d9b640 1 -- 172.21.15.53:0/3657941915 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f339400b9c0 con 0x7f33ac0c9fa0 2023-06-10T18:53:17.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.120+0000 7f33aa59c640 1 --2- 172.21.15.53:0/3657941915 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3394003f00 0x7f33940047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:17.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.120+0000 7f33aad9d640 1 --2- 172.21.15.53:0/3657941915 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33ac0c9fa0 0x7f3394003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:17.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.120+0000 7f33ab59e640 1 --2- 172.21.15.53:0/3657941915 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3394004d10 0x7f3394005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:17.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.120+0000 7f33aa59c640 1 -- 172.21.15.53:0/3657941915 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33ac0c9fa0 msgr2=0x7f3394003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:17.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.120+0000 7f33aa59c640 1 --2- 172.21.15.53:0/3657941915 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33ac0c9fa0 0x7f3394003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:17.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.120+0000 7f33aa59c640 1 -- 172.21.15.53:0/3657941915 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3394004d10 msgr2=0x7f3394005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:17.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.120+0000 7f33aa59c640 1 --2- 172.21.15.53:0/3657941915 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3394004d10 0x7f3394005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:17.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.120+0000 7f33aa59c640 1 -- 172.21.15.53:0/3657941915 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3394003530 con 0x7f3394003f00 2023-06-10T18:53:17.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.124+0000 7f33aa59c640 1 --2- 172.21.15.53:0/3657941915 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3394003f00 0x7f33940047d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f33a000c290 tx=0x7f33a001cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e48b95b77e1d4da server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:17.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.124+0000 7f33a9d9b640 1 -- 172.21.15.53:0/3657941915 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a00058e0 con 0x7f3394003f00 2023-06-10T18:53:17.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.124+0000 7f33a9d9b640 1 -- 172.21.15.53:0/3657941915 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33a0005a40 con 0x7f3394003f00 2023-06-10T18:53:17.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.124+0000 7f33a9d9b640 1 -- 172.21.15.53:0/3657941915 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a0005df0 con 0x7f3394003f00 2023-06-10T18:53:17.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.124+0000 7f33b1135640 1 -- 172.21.15.53:0/3657941915 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3394003f00 msgr2=0x7f33940047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:17.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.124+0000 7f33b1135640 1 --2- 172.21.15.53:0/3657941915 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3394003f00 0x7f33940047d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f33a000c290 tx=0x7f33a001cc50 comp rx=0 tx=0).stop 2023-06-10T18:53:17.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.124+0000 7f33ab59e640 1 -- 172.21.15.53:0/3657941915 reap_dead start 2023-06-10T18:53:17.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.124+0000 7f33b1135640 1 -- 172.21.15.53:0/3657941915 shutdown_connections 2023-06-10T18:53:17.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.124+0000 7f33b1135640 1 -- 172.21.15.53:0/3657941915 >> 172.21.15.53:0/3657941915 conn(0x7f33ac06a0e0 msgr2=0x7f33ac0cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:17.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.124+0000 7f33b1135640 1 -- 172.21.15.53:0/3657941915 shutdown_connections 2023-06-10T18:53:17.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.124+0000 7f33b1135640 1 -- 172.21.15.53:0/3657941915 wait complete. 2023-06-10T18:53:17.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.124+0000 7f33b1135640 1 Processor -- start 2023-06-10T18:53:17.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.124+0000 7f33b1135640 1 -- start start 2023-06-10T18:53:17.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.124+0000 7f33b1135640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3394003f00 0x7f33ac1e9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:17.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.124+0000 7f33b1135640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33ac1e9d80 0x7f33ac0a7940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:17.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.124+0000 7f33b1135640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f33ac0a7e80 0x7f33ac1f7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:17.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.124+0000 7f33b1135640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33ac0a8320 con 0x7f33ac0a7e80 2023-06-10T18:53:17.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.124+0000 7f33b1135640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33ac1f86c0 con 0x7f33ac1e9d80 2023-06-10T18:53:17.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.124+0000 7f33b1135640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33ac1f45d0 con 0x7f3394003f00 2023-06-10T18:53:17.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.124+0000 7f33ab59e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f33ac0a7e80 0x7f33ac1f7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:17.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.124+0000 7f33ab59e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f33ac0a7e80 0x7f33ac1f7950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40442/0 (socket says 172.21.15.53:40442) 2023-06-10T18:53:17.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.124+0000 7f33ab59e640 1 -- 172.21.15.53:0/4123623905 learned_addr learned my addr 172.21.15.53:0/4123623905 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:17.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.124+0000 7f33aad9d640 1 --2- 172.21.15.53:0/4123623905 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3394003f00 0x7f33ac1e9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:17.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.124+0000 7f33aa59c640 1 --2- 172.21.15.53:0/4123623905 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33ac1e9d80 0x7f33ac0a7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:17.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.124+0000 7f33ab59e640 1 -- 172.21.15.53:0/4123623905 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3394003f00 msgr2=0x7f33ac1e9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:17.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.124+0000 7f33ab59e640 1 --2- 172.21.15.53:0/4123623905 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3394003f00 0x7f33ac1e9840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:17.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.124+0000 7f33ab59e640 1 -- 172.21.15.53:0/4123623905 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33ac1e9d80 msgr2=0x7f33ac0a7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:17.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.124+0000 7f33ab59e640 1 --2- 172.21.15.53:0/4123623905 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33ac1e9d80 0x7f33ac0a7940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:17.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.124+0000 7f33ab59e640 1 -- 172.21.15.53:0/4123623905 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33ac1f48b0 con 0x7f33ac0a7e80 2023-06-10T18:53:17.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.128+0000 7f33ab59e640 1 --2- 172.21.15.53:0/4123623905 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f33ac0a7e80 0x7f33ac1f7950 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f33ac0cdc20 tx=0x7f33a4007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:17.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.128+0000 7f33937fe640 1 -- 172.21.15.53:0/4123623905 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a400e070 con 0x7f33ac0a7e80 2023-06-10T18:53:17.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.128+0000 7f33937fe640 1 -- 172.21.15.53:0/4123623905 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33a4003c70 con 0x7f33ac0a7e80 2023-06-10T18:53:17.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.128+0000 7f33b1135640 1 -- 172.21.15.53:0/4123623905 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33ac1f4b90 con 0x7f33ac0a7e80 2023-06-10T18:53:17.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.128+0000 7f33937fe640 1 -- 172.21.15.53:0/4123623905 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a4003e20 con 0x7f33ac0a7e80 2023-06-10T18:53:17.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.128+0000 7f33b1135640 1 -- 172.21.15.53:0/4123623905 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33ac1f50b0 con 0x7f33ac0a7e80 2023-06-10T18:53:17.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.128+0000 7f33b1135640 1 -- 172.21.15.53:0/4123623905 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33ac1f4d80 con 0x7f33ac0a7e80 2023-06-10T18:53:17.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.128+0000 7f33937fe640 1 -- 172.21.15.53:0/4123623905 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f33a4004030 con 0x7f33ac0a7e80 2023-06-10T18:53:17.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.128+0000 7f33937fe640 1 --2- 172.21.15.53:0/4123623905 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3398066280 0x7f3398068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:17.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.128+0000 7f33937fe640 1 -- 172.21.15.53:0/4123623905 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f33a40838c0 con 0x7f33ac0a7e80 2023-06-10T18:53:17.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.128+0000 7f33aad9d640 1 --2- 172.21.15.53:0/4123623905 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3398066280 0x7f3398068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:17.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.128+0000 7f33aad9d640 1 --2- 172.21.15.53:0/4123623905 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3398066280 0x7f3398068730 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f339c009b00 tx=0x7f339c009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:17.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.132+0000 7f33937fe640 1 -- 172.21.15.53:0/4123623905 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f33a4050d40 con 0x7f33ac0a7e80 2023-06-10T18:53:17.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.288+0000 7f33b1135640 1 -- 172.21.15.53:0/4123623905 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f33ac04d790 con 0x7f33ac0a7e80 2023-06-10T18:53:17.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.288+0000 7f33937fe640 1 -- 172.21.15.53:0/4123623905 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f33a4054360 con 0x7f33ac0a7e80 2023-06-10T18:53:17.297 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-06-10T18:53:17.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.288+0000 7f33b1135640 1 -- 172.21.15.53:0/4123623905 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3398066280 msgr2=0x7f3398068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:17.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.288+0000 7f33b1135640 1 --2- 172.21.15.53:0/4123623905 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3398066280 0x7f3398068730 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f339c009b00 tx=0x7f339c009190 comp rx=0 tx=0).stop 2023-06-10T18:53:17.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.288+0000 7f33b1135640 1 -- 172.21.15.53:0/4123623905 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f33ac0a7e80 msgr2=0x7f33ac1f7950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:17.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.288+0000 7f33b1135640 1 --2- 172.21.15.53:0/4123623905 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f33ac0a7e80 0x7f33ac1f7950 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f33ac0cdc20 tx=0x7f33a4007d10 comp rx=0 tx=0).stop 2023-06-10T18:53:17.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.288+0000 7f33b1135640 1 -- 172.21.15.53:0/4123623905 shutdown_connections 2023-06-10T18:53:17.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.288+0000 7f33b1135640 1 --2- 172.21.15.53:0/4123623905 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3398066280 0x7f3398068730 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:17.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.288+0000 7f33b1135640 1 --2- 172.21.15.53:0/4123623905 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f33ac0a7e80 0x7f33ac1f7950 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:17.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.288+0000 7f33b1135640 1 --2- 172.21.15.53:0/4123623905 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33ac1e9d80 0x7f33ac0a7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:17.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.288+0000 7f33b1135640 1 --2- 172.21.15.53:0/4123623905 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3394003f00 0x7f33ac1e9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:17.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.288+0000 7f33b1135640 1 -- 172.21.15.53:0/4123623905 >> 172.21.15.53:0/4123623905 conn(0x7f33ac06a0e0 msgr2=0x7f33ac0b3510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:17.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.288+0000 7f33b1135640 1 -- 172.21.15.53:0/4123623905 shutdown_connections 2023-06-10T18:53:17.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.288+0000 7f33b1135640 1 -- 172.21.15.53:0/4123623905 wait complete. 2023-06-10T18:53:17.317 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-10T18:53:17.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.440+0000 7f3e1d97c640 1 Processor -- start 2023-06-10T18:53:17.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.440+0000 7f3e1d97c640 1 -- start start 2023-06-10T18:53:17.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.440+0000 7f3e1d97c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3e18159630 0x7f3e1815d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:17.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.440+0000 7f3e1d97c640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e18070f10 con 0x7f3e18069450 2023-06-10T18:53:17.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.440+0000 7f3e1d97c640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e1815db60 con 0x7f3e180ad730 2023-06-10T18:53:17.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.440+0000 7f3e1d97c640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e1815de40 con 0x7f3e18159630 2023-06-10T18:53:17.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.440+0000 7f3e177fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f3e18069450 0x7f3e180affc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:37912/0 (socket says 172.21.15.53:37912) 2023-06-10T18:53:17.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.440+0000 7f3e177fe640 1 -- 172.21.15.53:0/1357561729 learned_addr learned my addr 172.21.15.53:0/1357561729 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:53:17.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.440+0000 7f3e16ffd640 1 --2- 172.21.15.53:0/1357561729 >> v2:172.21.15.117:3300/0 conn(0x7f3e18159630 0x7f3e1815d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:17.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.440+0000 7f3e15ffb640 1 -- 172.21.15.53:0/1357561729 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 820835425 0 0) 0x7f3e18070f10 con 0x7f3e18069450 2023-06-10T18:53:17.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.440+0000 7f3e15ffb640 1 -- 172.21.15.53:0/1357561729 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e00003530 con 0x7f3e18069450 2023-06-10T18:53:17.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.440+0000 7f3e15ffb640 1 -- 172.21.15.53:0/1357561729 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1744706286 0 0) 0x7f3e00003530 con 0x7f3e18069450 2023-06-10T18:53:17.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.440+0000 7f3e15ffb640 1 -- 172.21.15.53:0/1357561729 >> v2:172.21.15.117:3300/0 conn(0x7f3e18159630 msgr2=0x7f3e1815d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:17.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.440+0000 7f3e15ffb640 1 --2- 172.21.15.53:0/1357561729 >> v2:172.21.15.117:3300/0 conn(0x7f3e18159630 0x7f3e1815d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:17.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.440+0000 7f3e15ffb640 1 -- 172.21.15.53:0/1357561729 >> v1:172.21.15.117:6789/0 conn(0x7f3e180ad730 legacy=0x7f3e180713a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:17.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.440+0000 7f3e15ffb640 1 -- 172.21.15.53:0/1357561729 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e1815e120 con 0x7f3e18069450 2023-06-10T18:53:17.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.440+0000 7f3e15ffb640 1 -- 172.21.15.53:0/1357561729 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f3e10001a00 con 0x7f3e18069450 2023-06-10T18:53:17.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.440+0000 7f3e15ffb640 1 -- 172.21.15.53:0/1357561729 >> v1:172.21.15.53:6789/0 conn(0x7f3e18069450 legacy=0x7f3e180affc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:17.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.440+0000 7f3e15ffb640 1 --2- 172.21.15.53:0/1357561729 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e00003980 0x7f3e00003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:17.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.440+0000 7f3e15ffb640 1 --2- 172.21.15.53:0/1357561729 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3e000047d0 0x7f3e00004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:17.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.440+0000 7f3e15ffb640 1 --2- 172.21.15.53:0/1357561729 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3e00005180 0x7f3e0000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:17.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.440+0000 7f3e15ffb640 1 -- 172.21.15.53:0/1357561729 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1815de40 con 0x7f3e00003980 2023-06-10T18:53:17.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.440+0000 7f3e15ffb640 1 -- 172.21.15.53:0/1357561729 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e0000c000 con 0x7f3e00005180 2023-06-10T18:53:17.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.440+0000 7f3e15ffb640 1 -- 172.21.15.53:0/1357561729 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e0000c1c0 con 0x7f3e000047d0 2023-06-10T18:53:17.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.440+0000 7f3e16ffd640 1 --2- 172.21.15.53:0/1357561729 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e00003980 0x7f3e00003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:17.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.440+0000 7f3e177fe640 1 --2- 172.21.15.53:0/1357561729 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3e00005180 0x7f3e0000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:17.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.440+0000 7f3e167fc640 1 --2- 172.21.15.53:0/1357561729 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3e000047d0 0x7f3e00004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:17.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.440+0000 7f3e16ffd640 1 -- 172.21.15.53:0/1357561729 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3e000047d0 msgr2=0x7f3e00004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:17.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.440+0000 7f3e16ffd640 1 --2- 172.21.15.53:0/1357561729 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3e000047d0 0x7f3e00004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:17.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.440+0000 7f3e16ffd640 1 -- 172.21.15.53:0/1357561729 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3e00005180 msgr2=0x7f3e0000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:17.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.440+0000 7f3e16ffd640 1 --2- 172.21.15.53:0/1357561729 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3e00005180 0x7f3e0000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:17.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.440+0000 7f3e16ffd640 1 -- 172.21.15.53:0/1357561729 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e00003530 con 0x7f3e00003980 2023-06-10T18:53:17.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.440+0000 7f3e177fe640 1 -- 172.21.15.53:0/1357561729 reap_dead start 2023-06-10T18:53:17.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.444+0000 7f3e16ffd640 1 --2- 172.21.15.53:0/1357561729 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e00003980 0x7f3e00003d90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3e08009ae0 tx=0x7f3e0801ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5794a5b561c52766 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:17.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.444+0000 7f3e15ffb640 1 -- 172.21.15.53:0/1357561729 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e080a8460 con 0x7f3e00003980 2023-06-10T18:53:17.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.444+0000 7f3e15ffb640 1 -- 172.21.15.53:0/1357561729 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e080a85c0 con 0x7f3e00003980 2023-06-10T18:53:17.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.444+0000 7f3e15ffb640 1 -- 172.21.15.53:0/1357561729 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e080a8970 con 0x7f3e00003980 2023-06-10T18:53:17.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.444+0000 7f3e1d97c640 1 -- 172.21.15.53:0/1357561729 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e00003980 msgr2=0x7f3e00003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:17.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.444+0000 7f3e1d97c640 1 --2- 172.21.15.53:0/1357561729 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e00003980 0x7f3e00003d90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3e08009ae0 tx=0x7f3e0801ca20 comp rx=0 tx=0).stop 2023-06-10T18:53:17.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.444+0000 7f3e1d97c640 1 -- 172.21.15.53:0/1357561729 shutdown_connections 2023-06-10T18:53:17.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.444+0000 7f3e1d97c640 1 --2- 172.21.15.53:0/1357561729 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e00003980 0x7f3e00003d90 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:17.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.444+0000 7f3e1d97c640 1 -- 172.21.15.53:0/1357561729 >> 172.21.15.53:0/1357561729 conn(0x7f3e180cafc0 msgr2=0x7f3e180cb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:17.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.444+0000 7f3e1d97c640 1 -- 172.21.15.53:0/1357561729 shutdown_connections 2023-06-10T18:53:17.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.444+0000 7f3e1d97c640 1 -- 172.21.15.53:0/1357561729 wait complete. 2023-06-10T18:53:17.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.444+0000 7f3e1d97c640 1 Processor -- start 2023-06-10T18:53:17.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.444+0000 7f3e1d97c640 1 -- start start 2023-06-10T18:53:17.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.448+0000 7f3e1d97c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3e00003980 0x7f3e180c78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:17.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.448+0000 7f3e1d97c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e180c5ff0 0x7f3e18153c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:17.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.448+0000 7f3e1d97c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3e181f6020 0x7f3e181f6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:17.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.448+0000 7f3e1d97c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e181f5b90 con 0x7f3e180c5ff0 2023-06-10T18:53:17.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.448+0000 7f3e1d97c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e180c6460 con 0x7f3e00003980 2023-06-10T18:53:17.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.448+0000 7f3e1d97c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e180c8770 con 0x7f3e181f6020 2023-06-10T18:53:17.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.448+0000 7f3e167fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e180c5ff0 0x7f3e18153c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:17.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.448+0000 7f3e167fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e180c5ff0 0x7f3e18153c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40464/0 (socket says 172.21.15.53:40464) 2023-06-10T18:53:17.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.448+0000 7f3e167fc640 1 -- 172.21.15.53:0/247773059 learned_addr learned my addr 172.21.15.53:0/247773059 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:17.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.448+0000 7f3e16ffd640 1 --2- 172.21.15.53:0/247773059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3e00003980 0x7f3e180c78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:17.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.448+0000 7f3e177fe640 1 --2- 172.21.15.53:0/247773059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3e181f6020 0x7f3e181f6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:17.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.448+0000 7f3e167fc640 1 -- 172.21.15.53:0/247773059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3e181f6020 msgr2=0x7f3e181f6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:17.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.448+0000 7f3e167fc640 1 --2- 172.21.15.53:0/247773059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3e181f6020 0x7f3e181f6490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:17.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.448+0000 7f3e167fc640 1 -- 172.21.15.53:0/247773059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3e00003980 msgr2=0x7f3e180c78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:17.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.448+0000 7f3e167fc640 1 --2- 172.21.15.53:0/247773059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3e00003980 0x7f3e180c78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:17.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.448+0000 7f3e167fc640 1 -- 172.21.15.53:0/247773059 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e180c7ed0 con 0x7f3e180c5ff0 2023-06-10T18:53:17.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.448+0000 7f3e167fc640 1 --2- 172.21.15.53:0/247773059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e180c5ff0 0x7f3e18153c40 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c00f7f0 tx=0x7f3e0c00fcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:17.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.448+0000 7f3dfffff640 1 -- 172.21.15.53:0/247773059 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c0050d0 con 0x7f3e180c5ff0 2023-06-10T18:53:17.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.448+0000 7f3dfffff640 1 -- 172.21.15.53:0/247773059 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e0c005230 con 0x7f3e180c5ff0 2023-06-10T18:53:17.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.448+0000 7f3e1d97c640 1 -- 172.21.15.53:0/247773059 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e180c81b0 con 0x7f3e180c5ff0 2023-06-10T18:53:17.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.448+0000 7f3dfffff640 1 -- 172.21.15.53:0/247773059 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c00d730 con 0x7f3e180c5ff0 2023-06-10T18:53:17.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.448+0000 7f3e1d97c640 1 -- 172.21.15.53:0/247773059 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e18153830 con 0x7f3e180c5ff0 2023-06-10T18:53:17.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.448+0000 7f3e1d97c640 1 -- 172.21.15.53:0/247773059 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e180cbd00 con 0x7f3e180c5ff0 2023-06-10T18:53:17.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.448+0000 7f3dfffff640 1 -- 172.21.15.53:0/247773059 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3e0c00d890 con 0x7f3e180c5ff0 2023-06-10T18:53:17.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.448+0000 7f3dfffff640 1 --2- 172.21.15.53:0/247773059 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3e040662b0 0x7f3e04068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:17.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.448+0000 7f3dfffff640 1 -- 172.21.15.53:0/247773059 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3e0c083b10 con 0x7f3e180c5ff0 2023-06-10T18:53:17.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.448+0000 7f3e16ffd640 1 --2- 172.21.15.53:0/247773059 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3e040662b0 0x7f3e04068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:17.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.452+0000 7f3e16ffd640 1 --2- 172.21.15.53:0/247773059 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3e040662b0 0x7f3e04068760 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3e080af000 tx=0x7f3e080b2040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:17.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.452+0000 7f3dfffff640 1 -- 172.21.15.53:0/247773059 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3e0c051020 con 0x7f3e180c5ff0 2023-06-10T18:53:17.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.608+0000 7f3e1d97c640 1 -- 172.21.15.53:0/247773059 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3e1804d790 con 0x7f3e180c5ff0 2023-06-10T18:53:17.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.608+0000 7f3dfffff640 1 -- 172.21.15.53:0/247773059 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3e0c054640 con 0x7f3e180c5ff0 2023-06-10T18:53:17.617 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-06-10T18:53:17.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.608+0000 7f3e1d97c640 1 -- 172.21.15.53:0/247773059 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3e040662b0 msgr2=0x7f3e04068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:17.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.608+0000 7f3e1d97c640 1 --2- 172.21.15.53:0/247773059 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3e040662b0 0x7f3e04068760 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3e080af000 tx=0x7f3e080b2040 comp rx=0 tx=0).stop 2023-06-10T18:53:17.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.608+0000 7f3e1d97c640 1 -- 172.21.15.53:0/247773059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e180c5ff0 msgr2=0x7f3e18153c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:17.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.608+0000 7f3e1d97c640 1 --2- 172.21.15.53:0/247773059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e180c5ff0 0x7f3e18153c40 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c00f7f0 tx=0x7f3e0c00fcb0 comp rx=0 tx=0).stop 2023-06-10T18:53:17.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.608+0000 7f3e1d97c640 1 -- 172.21.15.53:0/247773059 shutdown_connections 2023-06-10T18:53:17.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.608+0000 7f3e1d97c640 1 --2- 172.21.15.53:0/247773059 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3e040662b0 0x7f3e04068760 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:17.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.608+0000 7f3e1d97c640 1 --2- 172.21.15.53:0/247773059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3e181f6020 0x7f3e181f6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:17.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.608+0000 7f3e1d97c640 1 --2- 172.21.15.53:0/247773059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e180c5ff0 0x7f3e18153c40 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:17.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.608+0000 7f3e1d97c640 1 --2- 172.21.15.53:0/247773059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3e00003980 0x7f3e180c78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:17.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.608+0000 7f3e1d97c640 1 -- 172.21.15.53:0/247773059 >> 172.21.15.53:0/247773059 conn(0x7f3e180cafc0 msgr2=0x7f3e180b1390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:17.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.608+0000 7f3e1d97c640 1 -- 172.21.15.53:0/247773059 shutdown_connections 2023-06-10T18:53:17.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.608+0000 7f3e1d97c640 1 -- 172.21.15.53:0/247773059 wait complete. 2023-06-10T18:53:17.637 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T18:53:17.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.748+0000 7fd810c1a640 1 Processor -- start 2023-06-10T18:53:17.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.748+0000 7fd810c1a640 1 -- start start 2023-06-10T18:53:17.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.748+0000 7fd810c1a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd80c0c9840 0x7fd80c0c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:17.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.748+0000 7fd810c1a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd80c06b090 0x7fd80c06b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:17.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.748+0000 7fd810c1a640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd80c159b50 con 0x7fd80c071060 2023-06-10T18:53:17.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.748+0000 7fd810c1a640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd80c0ca150 con 0x7fd80c06b090 2023-06-10T18:53:17.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.748+0000 7fd810c1a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd80c0702a0 con 0x7fd80c0c9840 2023-06-10T18:53:17.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.748+0000 7fd80ad9d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd80c06b090 0x7fd80c06b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:17.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.748+0000 7fd80a59c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd80c0c9840 0x7fd80c0c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:17.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.748+0000 7fd809d9b640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fd80c071060 0x7fd80c0af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.53:48128/0 (socket says 172.21.15.53:48128) 2023-06-10T18:53:17.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.748+0000 7fd80ad9d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd80c06b090 0x7fd80c06b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.53:58100/0 (socket says 172.21.15.53:58100) 2023-06-10T18:53:17.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.748+0000 7fd809d9b640 1 -- 172.21.15.53:0/3062280117 learned_addr learned my addr 172.21.15.53:0/3062280117 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:53:17.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.748+0000 7fd80ad9d640 1 -- 172.21.15.53:0/3062280117 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd80c0c9840 msgr2=0x7fd80c0c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:17.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.748+0000 7fd80ad9d640 1 --2- 172.21.15.53:0/3062280117 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd80c0c9840 0x7fd80c0c9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:17.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.748+0000 7fd80ad9d640 1 -- 172.21.15.53:0/3062280117 >> v1:172.21.15.117:6789/0 conn(0x7fd80c071060 legacy=0x7fd80c0af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:17.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.748+0000 7fd80ad9d640 1 -- 172.21.15.53:0/3062280117 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd80c070580 con 0x7fd80c06b090 2023-06-10T18:53:17.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.748+0000 7fd80959a640 1 -- 172.21.15.53:0/3062280117 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1675277826 0 0) 0x7fd80c159b50 con 0x7fd80c071060 2023-06-10T18:53:17.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.748+0000 7fd80a59c640 1 --2- 172.21.15.53:0/3062280117 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd80c0c9840 0x7fd80c0c9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-10T18:53:17.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.752+0000 7fd80ad9d640 1 --2- 172.21.15.53:0/3062280117 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd80c06b090 0x7fd80c06b530 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd804009d90 tx=0x7fd80401c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1c19243cfd08bb7 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:17.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.752+0000 7fd80959a640 1 -- 172.21.15.53:0/3062280117 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8040a59e0 con 0x7fd80c06b090 2023-06-10T18:53:17.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.752+0000 7fd80959a640 1 -- 172.21.15.53:0/3062280117 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8040a5b40 con 0x7fd80c06b090 2023-06-10T18:53:17.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.752+0000 7fd80959a640 1 -- 172.21.15.53:0/3062280117 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8040ad440 con 0x7fd80c06b090 2023-06-10T18:53:17.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.752+0000 7fd810c1a640 1 -- 172.21.15.53:0/3062280117 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd80c06b090 msgr2=0x7fd80c06b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:17.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.752+0000 7fd810c1a640 1 --2- 172.21.15.53:0/3062280117 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd80c06b090 0x7fd80c06b530 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd804009d90 tx=0x7fd80401c920 comp rx=0 tx=0).stop 2023-06-10T18:53:17.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.752+0000 7fd810c1a640 1 -- 172.21.15.53:0/3062280117 shutdown_connections 2023-06-10T18:53:17.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.752+0000 7fd810c1a640 1 --2- 172.21.15.53:0/3062280117 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd80c06b090 0x7fd80c06b530 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:17.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.752+0000 7fd810c1a640 1 --2- 172.21.15.53:0/3062280117 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd80c0c9840 0x7fd80c0c9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:17.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.752+0000 7fd810c1a640 1 -- 172.21.15.53:0/3062280117 >> 172.21.15.53:0/3062280117 conn(0x7fd80c06a0d0 msgr2=0x7fd80c0ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:17.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.752+0000 7fd810c1a640 1 -- 172.21.15.53:0/3062280117 shutdown_connections 2023-06-10T18:53:17.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.752+0000 7fd810c1a640 1 -- 172.21.15.53:0/3062280117 wait complete. 2023-06-10T18:53:17.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.752+0000 7fd810c1a640 1 Processor -- start 2023-06-10T18:53:17.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.752+0000 7fd810c1a640 1 -- start start 2023-06-10T18:53:17.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.756+0000 7fd810c1a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd80c06b090 0x7fd80c150cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:17.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.756+0000 7fd810c1a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd80c071060 0x7fd80c0ad700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:17.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.756+0000 7fd810c1a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd80c0c9840 0x7fd80c0adc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:17.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.756+0000 7fd810c1a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd80c151630 con 0x7fd80c071060 2023-06-10T18:53:17.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.756+0000 7fd810c1a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd80c151910 con 0x7fd80c06b090 2023-06-10T18:53:17.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.756+0000 7fd810c1a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd80c151bf0 con 0x7fd80c0c9840 2023-06-10T18:53:17.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.756+0000 7fd809d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd80c071060 0x7fd80c0ad700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:17.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.756+0000 7fd809d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd80c071060 0x7fd80c0ad700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40472/0 (socket says 172.21.15.53:40472) 2023-06-10T18:53:17.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.756+0000 7fd809d9b640 1 -- 172.21.15.53:0/312610282 learned_addr learned my addr 172.21.15.53:0/312610282 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:17.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.756+0000 7fd80ad9d640 1 --2- 172.21.15.53:0/312610282 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd80c0c9840 0x7fd80c0adc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:17.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.756+0000 7fd80a59c640 1 --2- 172.21.15.53:0/312610282 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd80c06b090 0x7fd80c150cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:17.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.756+0000 7fd809d9b640 1 -- 172.21.15.53:0/312610282 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd80c0c9840 msgr2=0x7fd80c0adc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:17.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.756+0000 7fd809d9b640 1 --2- 172.21.15.53:0/312610282 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd80c0c9840 0x7fd80c0adc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:17.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.756+0000 7fd809d9b640 1 -- 172.21.15.53:0/312610282 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd80c06b090 msgr2=0x7fd80c150cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:17.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.756+0000 7fd809d9b640 1 --2- 172.21.15.53:0/312610282 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd80c06b090 0x7fd80c150cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:17.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.756+0000 7fd809d9b640 1 -- 172.21.15.53:0/312610282 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7fc009420 con 0x7fd80c071060 2023-06-10T18:53:17.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.756+0000 7fd809d9b640 1 --2- 172.21.15.53:0/312610282 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd80c071060 0x7fd80c0ad700 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd80000c4b0 tx=0x7fd80000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:17.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.756+0000 7fd7faffd640 1 -- 172.21.15.53:0/312610282 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8000074e0 con 0x7fd80c071060 2023-06-10T18:53:17.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.756+0000 7fd7faffd640 1 -- 172.21.15.53:0/312610282 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd800007660 con 0x7fd80c071060 2023-06-10T18:53:17.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.756+0000 7fd7faffd640 1 -- 172.21.15.53:0/312610282 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd800004a30 con 0x7fd80c071060 2023-06-10T18:53:17.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.756+0000 7fd810c1a640 1 -- 172.21.15.53:0/312610282 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd804009a70 con 0x7fd80c071060 2023-06-10T18:53:17.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.756+0000 7fd810c1a640 1 -- 172.21.15.53:0/312610282 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd80c1521b0 con 0x7fd80c071060 2023-06-10T18:53:17.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.756+0000 7fd810c1a640 1 -- 172.21.15.53:0/312610282 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd80c04d790 con 0x7fd80c071060 2023-06-10T18:53:17.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.756+0000 7fd7faffd640 1 -- 172.21.15.53:0/312610282 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd80001b360 con 0x7fd80c071060 2023-06-10T18:53:17.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.760+0000 7fd7faffd640 1 --2- 172.21.15.53:0/312610282 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd7ec066280 0x7fd7ec068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:17.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.760+0000 7fd7faffd640 1 -- 172.21.15.53:0/312610282 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd8000833d0 con 0x7fd80c071060 2023-06-10T18:53:17.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.760+0000 7fd80a59c640 1 --2- 172.21.15.53:0/312610282 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd7ec066280 0x7fd7ec068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:17.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.760+0000 7fd80a59c640 1 --2- 172.21.15.53:0/312610282 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd7ec066280 0x7fd7ec068730 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc009be0 tx=0x7fd7fc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:17.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.760+0000 7fd7faffd640 1 -- 172.21.15.53:0/312610282 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd800050980 con 0x7fd80c071060 2023-06-10T18:53:17.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.916+0000 7fd810c1a640 1 -- 172.21.15.53:0/312610282 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd80c070b10 con 0x7fd80c071060 2023-06-10T18:53:17.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.916+0000 7fd7faffd640 1 -- 172.21.15.53:0/312610282 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18267 (secure 0 0 0) 0x7fd800018090 con 0x7fd80c071060 2023-06-10T18:53:17.928 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:53:17.928 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":23,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T18:52:45.921586+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-10T18:52:43.396243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-10T18:52:43.894228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T18:53:17.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.920+0000 7fd810c1a640 1 -- 172.21.15.53:0/312610282 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd7ec066280 msgr2=0x7fd7ec068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:17.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.920+0000 7fd810c1a640 1 --2- 172.21.15.53:0/312610282 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd7ec066280 0x7fd7ec068730 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc009be0 tx=0x7fd7fc008040 comp rx=0 tx=0).stop 2023-06-10T18:53:17.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.920+0000 7fd810c1a640 1 -- 172.21.15.53:0/312610282 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd80c071060 msgr2=0x7fd80c0ad700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:17.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.920+0000 7fd810c1a640 1 --2- 172.21.15.53:0/312610282 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd80c071060 0x7fd80c0ad700 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd80000c4b0 tx=0x7fd80000c970 comp rx=0 tx=0).stop 2023-06-10T18:53:17.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.920+0000 7fd810c1a640 1 -- 172.21.15.53:0/312610282 shutdown_connections 2023-06-10T18:53:17.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.920+0000 7fd810c1a640 1 --2- 172.21.15.53:0/312610282 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd7ec066280 0x7fd7ec068730 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:17.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.920+0000 7fd810c1a640 1 --2- 172.21.15.53:0/312610282 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd80c0c9840 0x7fd80c0adc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:17.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.920+0000 7fd810c1a640 1 --2- 172.21.15.53:0/312610282 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd80c071060 0x7fd80c0ad700 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:17.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.920+0000 7fd810c1a640 1 --2- 172.21.15.53:0/312610282 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd80c06b090 0x7fd80c150cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:17.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.920+0000 7fd810c1a640 1 -- 172.21.15.53:0/312610282 >> 172.21.15.53:0/312610282 conn(0x7fd80c06a0d0 msgr2=0x7fd80c153110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:17.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.920+0000 7fd810c1a640 1 -- 172.21.15.53:0/312610282 shutdown_connections 2023-06-10T18:53:17.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:17.920+0000 7fd810c1a640 1 -- 172.21.15.53:0/312610282 wait complete. 2023-06-10T18:53:17.947 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-10T18:52:33.633114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-10T18:52:39.171487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-10T18:52:43.396243+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-10T18:52:43.894228+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-10T18:53:17.948 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-10T18:53:18.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.072+0000 7ff1ea97f640 1 Processor -- start 2023-06-10T18:53:18.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.072+0000 7ff1ea97f640 1 -- start start 2023-06-10T18:53:18.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.072+0000 7ff1ea97f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff1e415c090 0x7ff1e40b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:18.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.072+0000 7ff1ea97f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1e40b0b90 0x7ff1e40b7720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:18.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.072+0000 7ff1ea97f640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1e40cc7c0 con 0x7ff1e40b7c60 2023-06-10T18:53:18.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.072+0000 7ff1ea97f640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1e40b80e0 con 0x7ff1e415c090 2023-06-10T18:53:18.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.072+0000 7ff1ea97f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e40ccaa0 con 0x7ff1e40b0b90 2023-06-10T18:53:18.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.072+0000 7ff1e3fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff1e415c090 0x7ff1e40b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:18.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.072+0000 7ff1e8f1c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ff1e40b7c60 0x7ff1e40b3b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:37924/0 (socket says 172.21.15.53:37924) 2023-06-10T18:53:18.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.072+0000 7ff1e8f1c640 1 -- 172.21.15.53:0/423231022 learned_addr learned my addr 172.21.15.53:0/423231022 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:53:18.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.072+0000 7ff1e37fe640 1 --2- 172.21.15.53:0/423231022 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1e40b0b90 0x7ff1e40b7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:18.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.072+0000 7ff1e3fff640 1 -- 172.21.15.53:0/423231022 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1e40b0b90 msgr2=0x7ff1e40b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:18.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.072+0000 7ff1e3fff640 1 --2- 172.21.15.53:0/423231022 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1e40b0b90 0x7ff1e40b7720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:18.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.072+0000 7ff1e3fff640 1 -- 172.21.15.53:0/423231022 >> v1:172.21.15.53:6789/0 conn(0x7ff1e40b7c60 legacy=0x7ff1e40b3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:18.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.072+0000 7ff1e3fff640 1 -- 172.21.15.53:0/423231022 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1e40ccd80 con 0x7ff1e415c090 2023-06-10T18:53:18.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.076+0000 7ff1e3fff640 1 --2- 172.21.15.53:0/423231022 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1e415c090 0x7ff1e40b10c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff1d40097c0 tx=0x7ff1d401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc692b4b07915741 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:18.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.076+0000 7ff1e2ffd640 1 -- 172.21.15.53:0/423231022 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d40ab600 con 0x7ff1e415c090 2023-06-10T18:53:18.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.076+0000 7ff1e2ffd640 1 -- 172.21.15.53:0/423231022 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1d40a7050 con 0x7ff1e415c090 2023-06-10T18:53:18.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.076+0000 7ff1e2ffd640 1 -- 172.21.15.53:0/423231022 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d40ab980 con 0x7ff1e415c090 2023-06-10T18:53:18.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.076+0000 7ff1ea97f640 1 -- 172.21.15.53:0/423231022 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1e415c090 msgr2=0x7ff1e40b10c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:18.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.076+0000 7ff1ea97f640 1 --2- 172.21.15.53:0/423231022 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1e415c090 0x7ff1e40b10c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff1d40097c0 tx=0x7ff1d401c3c0 comp rx=0 tx=0).stop 2023-06-10T18:53:18.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.076+0000 7ff1ea97f640 1 -- 172.21.15.53:0/423231022 shutdown_connections 2023-06-10T18:53:18.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.076+0000 7ff1ea97f640 1 --2- 172.21.15.53:0/423231022 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1e40b0b90 0x7ff1e40b7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:18.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.076+0000 7ff1ea97f640 1 --2- 172.21.15.53:0/423231022 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1e415c090 0x7ff1e40b10c0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:18.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.076+0000 7ff1ea97f640 1 -- 172.21.15.53:0/423231022 >> 172.21.15.53:0/423231022 conn(0x7ff1e4069e20 msgr2=0x7ff1e406a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:18.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.076+0000 7ff1ea97f640 1 -- 172.21.15.53:0/423231022 shutdown_connections 2023-06-10T18:53:18.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.076+0000 7ff1ea97f640 1 -- 172.21.15.53:0/423231022 wait complete. 2023-06-10T18:53:18.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.080+0000 7ff1ea97f640 1 Processor -- start 2023-06-10T18:53:18.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.080+0000 7ff1ea97f640 1 -- start start 2023-06-10T18:53:18.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.080+0000 7ff1ea97f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1e40b0b90 0x7ff1e40c84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:18.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.080+0000 7ff1ea97f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1e40b7c60 0x7ff1e40b30c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:18.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.080+0000 7ff1ea97f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1e415c090 0x7ff1e4150200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:18.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.080+0000 7ff1ea97f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e40cbea0 con 0x7ff1e415c090 2023-06-10T18:53:18.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.080+0000 7ff1ea97f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e40c89e0 con 0x7ff1e40b0b90 2023-06-10T18:53:18.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.080+0000 7ff1ea97f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e40b3600 con 0x7ff1e40b7c60 2023-06-10T18:53:18.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.080+0000 7ff1e8f1c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1e415c090 0x7ff1e4150200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:18.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.080+0000 7ff1e8f1c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1e415c090 0x7ff1e4150200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40484/0 (socket says 172.21.15.53:40484) 2023-06-10T18:53:18.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.080+0000 7ff1e8f1c640 1 -- 172.21.15.53:0/2497026748 learned_addr learned my addr 172.21.15.53:0/2497026748 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:18.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.080+0000 7ff1e3fff640 1 --2- 172.21.15.53:0/2497026748 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1e40b0b90 0x7ff1e40c84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:18.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.080+0000 7ff1e37fe640 1 --2- 172.21.15.53:0/2497026748 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1e40b7c60 0x7ff1e40b30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:18.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.080+0000 7ff1e8f1c640 1 -- 172.21.15.53:0/2497026748 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1e40b7c60 msgr2=0x7ff1e40b30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:18.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.080+0000 7ff1e8f1c640 1 --2- 172.21.15.53:0/2497026748 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1e40b7c60 0x7ff1e40b30c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:18.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.080+0000 7ff1e8f1c640 1 -- 172.21.15.53:0/2497026748 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1e40b0b90 msgr2=0x7ff1e40c84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:18.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.080+0000 7ff1e8f1c640 1 --2- 172.21.15.53:0/2497026748 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1e40b0b90 0x7ff1e40c84a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:18.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.080+0000 7ff1e8f1c640 1 -- 172.21.15.53:0/2497026748 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1d4009420 con 0x7ff1e415c090 2023-06-10T18:53:18.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.080+0000 7ff1e8f1c640 1 --2- 172.21.15.53:0/2497026748 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1e415c090 0x7ff1e4150200 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc00cbc0 tx=0x7ff1dc00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:18.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.080+0000 7ff1e0ff9640 1 -- 172.21.15.53:0/2497026748 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1dc00ad40 con 0x7ff1e415c090 2023-06-10T18:53:18.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.080+0000 7ff1e0ff9640 1 -- 172.21.15.53:0/2497026748 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1dc012400 con 0x7ff1e415c090 2023-06-10T18:53:18.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.080+0000 7ff1ea97f640 1 -- 172.21.15.53:0/2497026748 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1e4151db0 con 0x7ff1e415c090 2023-06-10T18:53:18.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.080+0000 7ff1e0ff9640 1 -- 172.21.15.53:0/2497026748 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1dc00aea0 con 0x7ff1e415c090 2023-06-10T18:53:18.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.080+0000 7ff1ea97f640 1 -- 172.21.15.53:0/2497026748 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1e40b28c0 con 0x7ff1e415c090 2023-06-10T18:53:18.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.080+0000 7ff1ea97f640 1 -- 172.21.15.53:0/2497026748 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1e404d790 con 0x7ff1e415c090 2023-06-10T18:53:18.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.084+0000 7ff1e0ff9640 1 -- 172.21.15.53:0/2497026748 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff1dc007070 con 0x7ff1e415c090 2023-06-10T18:53:18.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.084+0000 7ff1e0ff9640 1 --2- 172.21.15.53:0/2497026748 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff1d0066280 0x7ff1d0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:18.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.084+0000 7ff1e0ff9640 1 -- 172.21.15.53:0/2497026748 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff1dc083b30 con 0x7ff1e415c090 2023-06-10T18:53:18.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.084+0000 7ff1e3fff640 1 --2- 172.21.15.53:0/2497026748 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff1d0066280 0x7ff1d0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:18.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.084+0000 7ff1e3fff640 1 --2- 172.21.15.53:0/2497026748 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff1d0066280 0x7ff1d0068730 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff1d40ad000 tx=0x7ff1d40a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:18.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.088+0000 7ff1e0ff9640 1 -- 172.21.15.53:0/2497026748 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff1dc0510f0 con 0x7ff1e415c090 2023-06-10T18:53:18.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.240+0000 7ff1ea97f640 1 -- 172.21.15.53:0/2497026748 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff1e40b72f0 con 0x7ff1e415c090 2023-06-10T18:53:18.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.240+0000 7ff1e0ff9640 1 -- 172.21.15.53:0/2497026748 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff1dc0170a0 con 0x7ff1e415c090 2023-06-10T18:53:18.251 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-06-10T18:53:18.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.244+0000 7ff1ea97f640 1 -- 172.21.15.53:0/2497026748 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff1d0066280 msgr2=0x7ff1d0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:18.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.244+0000 7ff1ea97f640 1 --2- 172.21.15.53:0/2497026748 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff1d0066280 0x7ff1d0068730 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff1d40ad000 tx=0x7ff1d40a6000 comp rx=0 tx=0).stop 2023-06-10T18:53:18.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.244+0000 7ff1ea97f640 1 -- 172.21.15.53:0/2497026748 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1e415c090 msgr2=0x7ff1e4150200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:18.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.244+0000 7ff1ea97f640 1 --2- 172.21.15.53:0/2497026748 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1e415c090 0x7ff1e4150200 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc00cbc0 tx=0x7ff1dc00a430 comp rx=0 tx=0).stop 2023-06-10T18:53:18.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.244+0000 7ff1ea97f640 1 -- 172.21.15.53:0/2497026748 shutdown_connections 2023-06-10T18:53:18.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.244+0000 7ff1ea97f640 1 --2- 172.21.15.53:0/2497026748 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff1d0066280 0x7ff1d0068730 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:18.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.244+0000 7ff1ea97f640 1 --2- 172.21.15.53:0/2497026748 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1e415c090 0x7ff1e4150200 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:18.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.244+0000 7ff1ea97f640 1 --2- 172.21.15.53:0/2497026748 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1e40b7c60 0x7ff1e40b30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:18.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.244+0000 7ff1ea97f640 1 --2- 172.21.15.53:0/2497026748 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1e40b0b90 0x7ff1e40c84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:18.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.244+0000 7ff1ea97f640 1 -- 172.21.15.53:0/2497026748 >> 172.21.15.53:0/2497026748 conn(0x7ff1e4069e20 msgr2=0x7ff1e41523d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:18.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.244+0000 7ff1ea97f640 1 -- 172.21.15.53:0/2497026748 shutdown_connections 2023-06-10T18:53:18.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.244+0000 7ff1ea97f640 1 -- 172.21.15.53:0/2497026748 wait complete. 2023-06-10T18:53:18.271 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-10T18:53:18.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.392+0000 7f0c24cfa640 1 Processor -- start 2023-06-10T18:53:18.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.392+0000 7f0c24cfa640 1 -- start start 2023-06-10T18:53:18.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.392+0000 7f0c24cfa640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0c20159690 0x7f0c20070950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:18.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.392+0000 7f0c24cfa640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c200cb080 con 0x7f0c200b0f30 2023-06-10T18:53:18.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.392+0000 7f0c24cfa640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c200cb320 con 0x7f0c20159a60 2023-06-10T18:53:18.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.392+0000 7f0c24cfa640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c20070e90 con 0x7f0c20159690 2023-06-10T18:53:18.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.392+0000 7f0c1dd9b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f0c200b0f30 0x7f0c200cbe00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:37930/0 (socket says 172.21.15.53:37930) 2023-06-10T18:53:18.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.392+0000 7f0c1dd9b640 1 -- 172.21.15.53:0/2613095359 learned_addr learned my addr 172.21.15.53:0/2613095359 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:53:18.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.392+0000 7f0c1e59c640 1 --2- 172.21.15.53:0/2613095359 >> v2:172.21.15.53:3300/0 conn(0x7f0c20159690 0x7f0c20070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:18.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.392+0000 7f0c1d59a640 1 -- 172.21.15.53:0/2613095359 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 646234831 0 0) 0x7f0c200cb080 con 0x7f0c200b0f30 2023-06-10T18:53:18.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.392+0000 7f0c1d59a640 1 -- 172.21.15.53:0/2613095359 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c08003530 con 0x7f0c200b0f30 2023-06-10T18:53:18.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.392+0000 7f0c1e59c640 1 -- 172.21.15.53:0/2613095359 >> v1:172.21.15.117:6789/0 conn(0x7f0c20159a60 legacy=0x7f0c200c2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:18.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.392+0000 7f0c1e59c640 1 -- 172.21.15.53:0/2613095359 >> v1:172.21.15.53:6789/0 conn(0x7f0c200b0f30 legacy=0x7f0c200cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:18.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.392+0000 7f0c1e59c640 1 -- 172.21.15.53:0/2613095359 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c200cb600 con 0x7f0c20159690 2023-06-10T18:53:18.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.396+0000 7f0c1e59c640 1 --2- 172.21.15.53:0/2613095359 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c20159690 0x7f0c20070950 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f0c100097c0 tx=0x7f0c1001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6de52bd409ade040 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:18.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.396+0000 7f0c1d59a640 1 -- 172.21.15.53:0/2613095359 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c100ab600 con 0x7f0c20159690 2023-06-10T18:53:18.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.396+0000 7f0c1d59a640 1 -- 172.21.15.53:0/2613095359 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c100a7050 con 0x7f0c20159690 2023-06-10T18:53:18.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.396+0000 7f0c1d59a640 1 -- 172.21.15.53:0/2613095359 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c100ab980 con 0x7f0c20159690 2023-06-10T18:53:18.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.396+0000 7f0c24cfa640 1 -- 172.21.15.53:0/2613095359 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c20159690 msgr2=0x7f0c20070950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:18.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.396+0000 7f0c24cfa640 1 --2- 172.21.15.53:0/2613095359 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c20159690 0x7f0c20070950 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f0c100097c0 tx=0x7f0c1001c480 comp rx=0 tx=0).stop 2023-06-10T18:53:18.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.396+0000 7f0c24cfa640 1 -- 172.21.15.53:0/2613095359 shutdown_connections 2023-06-10T18:53:18.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.396+0000 7f0c24cfa640 1 --2- 172.21.15.53:0/2613095359 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c20159690 0x7f0c20070950 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:18.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.396+0000 7f0c24cfa640 1 -- 172.21.15.53:0/2613095359 >> 172.21.15.53:0/2613095359 conn(0x7f0c2006a560 msgr2=0x7f0c2006a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:18.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.396+0000 7f0c24cfa640 1 -- 172.21.15.53:0/2613095359 shutdown_connections 2023-06-10T18:53:18.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.396+0000 7f0c24cfa640 1 -- 172.21.15.53:0/2613095359 wait complete. 2023-06-10T18:53:18.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.396+0000 7f0c24cfa640 1 Processor -- start 2023-06-10T18:53:18.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.396+0000 7f0c24cfa640 1 -- start start 2023-06-10T18:53:18.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.396+0000 7f0c24cfa640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c200b0f30 0x7f0c200ae220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:18.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.396+0000 7f0c24cfa640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0c20159690 0x7f0c200ceff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:18.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.396+0000 7f0c24cfa640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c20159a60 0x7f0c2014fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:18.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.396+0000 7f0c24cfa640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c200ae760 con 0x7f0c200b0f30 2023-06-10T18:53:18.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.396+0000 7f0c24cfa640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c200ccb10 con 0x7f0c20159a60 2023-06-10T18:53:18.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.396+0000 7f0c24cfa640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c200acba0 con 0x7f0c20159690 2023-06-10T18:53:18.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.400+0000 7f0c1e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c200b0f30 0x7f0c200ae220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:18.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.400+0000 7f0c1e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c200b0f30 0x7f0c200ae220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40500/0 (socket says 172.21.15.53:40500) 2023-06-10T18:53:18.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.400+0000 7f0c1e59c640 1 -- 172.21.15.53:0/755661866 learned_addr learned my addr 172.21.15.53:0/755661866 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:18.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.400+0000 7f0c1dd9b640 1 --2- 172.21.15.53:0/755661866 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0c20159690 0x7f0c200ceff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:18.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.400+0000 7f0c1ed9d640 1 --2- 172.21.15.53:0/755661866 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c20159a60 0x7f0c2014fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:18.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.400+0000 7f0c1e59c640 1 -- 172.21.15.53:0/755661866 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0c20159690 msgr2=0x7f0c200ceff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:18.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.400+0000 7f0c1e59c640 1 --2- 172.21.15.53:0/755661866 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0c20159690 0x7f0c200ceff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:18.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.400+0000 7f0c1e59c640 1 -- 172.21.15.53:0/755661866 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c20159a60 msgr2=0x7f0c2014fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:18.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.400+0000 7f0c1e59c640 1 --2- 172.21.15.53:0/755661866 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c20159a60 0x7f0c2014fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:18.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.400+0000 7f0c1e59c640 1 -- 172.21.15.53:0/755661866 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c10009420 con 0x7f0c200b0f30 2023-06-10T18:53:18.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.400+0000 7f0c1ed9d640 1 --2- 172.21.15.53:0/755661866 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c20159a60 0x7f0c2014fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:18.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.400+0000 7f0c1e59c640 1 --2- 172.21.15.53:0/755661866 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c200b0f30 0x7f0c200ae220 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0c10019090 tx=0x7f0c10019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:18.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.400+0000 7f0c0effd640 1 -- 172.21.15.53:0/755661866 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c100b4410 con 0x7f0c200b0f30 2023-06-10T18:53:18.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.400+0000 7f0c0effd640 1 -- 172.21.15.53:0/755661866 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c100b4570 con 0x7f0c200b0f30 2023-06-10T18:53:18.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.400+0000 7f0c24cfa640 1 -- 172.21.15.53:0/755661866 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c200ccd60 con 0x7f0c200b0f30 2023-06-10T18:53:18.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.400+0000 7f0c24cfa640 1 -- 172.21.15.53:0/755661866 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c2014e1a0 con 0x7f0c200b0f30 2023-06-10T18:53:18.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.400+0000 7f0c0effd640 1 -- 172.21.15.53:0/755661866 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c100b4920 con 0x7f0c200b0f30 2023-06-10T18:53:18.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.400+0000 7f0c24cfa640 1 -- 172.21.15.53:0/755661866 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c04005260 con 0x7f0c200b0f30 2023-06-10T18:53:18.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.400+0000 7f0c0effd640 1 -- 172.21.15.53:0/755661866 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0c100b2040 con 0x7f0c200b0f30 2023-06-10T18:53:18.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.400+0000 7f0c0effd640 1 --2- 172.21.15.53:0/755661866 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0c00066280 0x7f0c00068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:18.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.400+0000 7f0c0effd640 1 -- 172.21.15.53:0/755661866 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0c1011dd90 con 0x7f0c200b0f30 2023-06-10T18:53:18.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.400+0000 7f0c1dd9b640 1 --2- 172.21.15.53:0/755661866 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0c00066280 0x7f0c00068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:18.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.400+0000 7f0c1dd9b640 1 --2- 172.21.15.53:0/755661866 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0c00066280 0x7f0c00068730 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0c200ab910 tx=0x7f0c14009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:18.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.404+0000 7f0c0effd640 1 -- 172.21.15.53:0/755661866 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0c100eb200 con 0x7f0c200b0f30 2023-06-10T18:53:18.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.556+0000 7f0c24cfa640 1 -- 172.21.15.53:0/755661866 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0c04005a90 con 0x7f0c200b0f30 2023-06-10T18:53:18.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.556+0000 7f0c0effd640 1 -- 172.21.15.53:0/755661866 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0c100c20a0 con 0x7f0c200b0f30 2023-06-10T18:53:18.567 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-06-10T18:53:18.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.560+0000 7f0c24cfa640 1 -- 172.21.15.53:0/755661866 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0c00066280 msgr2=0x7f0c00068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:18.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.560+0000 7f0c24cfa640 1 --2- 172.21.15.53:0/755661866 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0c00066280 0x7f0c00068730 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0c200ab910 tx=0x7f0c14009040 comp rx=0 tx=0).stop 2023-06-10T18:53:18.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.560+0000 7f0c24cfa640 1 -- 172.21.15.53:0/755661866 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c200b0f30 msgr2=0x7f0c200ae220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:18.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.560+0000 7f0c24cfa640 1 --2- 172.21.15.53:0/755661866 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c200b0f30 0x7f0c200ae220 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0c10019090 tx=0x7f0c10019220 comp rx=0 tx=0).stop 2023-06-10T18:53:18.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.560+0000 7f0c24cfa640 1 -- 172.21.15.53:0/755661866 shutdown_connections 2023-06-10T18:53:18.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.560+0000 7f0c24cfa640 1 --2- 172.21.15.53:0/755661866 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0c00066280 0x7f0c00068730 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:18.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.560+0000 7f0c24cfa640 1 --2- 172.21.15.53:0/755661866 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c20159a60 0x7f0c2014fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:18.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.560+0000 7f0c24cfa640 1 --2- 172.21.15.53:0/755661866 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0c20159690 0x7f0c200ceff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:18.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.560+0000 7f0c24cfa640 1 --2- 172.21.15.53:0/755661866 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c200b0f30 0x7f0c200ae220 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:18.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.560+0000 7f0c24cfa640 1 -- 172.21.15.53:0/755661866 >> 172.21.15.53:0/755661866 conn(0x7f0c2006a560 msgr2=0x7f0c200723f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:18.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.560+0000 7f0c24cfa640 1 -- 172.21.15.53:0/755661866 shutdown_connections 2023-06-10T18:53:18.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.560+0000 7f0c24cfa640 1 -- 172.21.15.53:0/755661866 wait complete. 2023-06-10T18:53:18.586 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-10T18:53:18.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.704+0000 7f8a370ea640 1 Processor -- start 2023-06-10T18:53:18.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.704+0000 7f8a370ea640 1 -- start start 2023-06-10T18:53:18.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.704+0000 7f8a370ea640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8a300c82a0 0x7f8a300c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:18.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.704+0000 7f8a370ea640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8a300af760 0x7f8a300afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:18.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.704+0000 7f8a370ea640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a3006b090 con 0x7f8a300c9fa0 2023-06-10T18:53:18.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.704+0000 7f8a370ea640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a300b0120 con 0x7f8a300af760 2023-06-10T18:53:18.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.704+0000 7f8a370ea640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a300ca370 con 0x7f8a300c82a0 2023-06-10T18:53:18.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.704+0000 7f8a35687640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8a300af760 0x7f8a300afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:18.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.704+0000 7f8a35687640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8a300af760 0x7f8a300afbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40514/0 (socket says 172.21.15.53:40514) 2023-06-10T18:53:18.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.704+0000 7f8a35687640 1 -- 172.21.15.53:0/889282922 learned_addr learned my addr 172.21.15.53:0/889282922 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:18.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.704+0000 7f8a2ffff640 1 --2- 172.21.15.53:0/889282922 >> v2:172.21.15.117:3300/0 conn(0x7f8a300c82a0 0x7f8a300c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:18.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.704+0000 7f8a35687640 1 -- 172.21.15.53:0/889282922 >> v2:172.21.15.117:3300/0 conn(0x7f8a300c82a0 msgr2=0x7f8a300c86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:18.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.704+0000 7f8a35687640 1 --2- 172.21.15.53:0/889282922 >> v2:172.21.15.117:3300/0 conn(0x7f8a300c82a0 0x7f8a300c86f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:18.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.704+0000 7f8a35687640 1 -- 172.21.15.53:0/889282922 >> v1:172.21.15.117:6789/0 conn(0x7f8a300c9fa0 legacy=0x7f8a3006bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:18.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.704+0000 7f8a35687640 1 -- 172.21.15.53:0/889282922 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a30070d50 con 0x7f8a300af760 2023-06-10T18:53:18.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.708+0000 7f8a35687640 1 --2- 172.21.15.53:0/889282922 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a300af760 0x7f8a300afbe0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8a3006ecb0 tx=0x7f8a2801c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1b8c9e7aebf3b07 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:18.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.708+0000 7f8a2f7fe640 1 -- 172.21.15.53:0/889282922 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a280a5790 con 0x7f8a300af760 2023-06-10T18:53:18.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.708+0000 7f8a2f7fe640 1 -- 172.21.15.53:0/889282922 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a280a58f0 con 0x7f8a300af760 2023-06-10T18:53:18.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.708+0000 7f8a2f7fe640 1 -- 172.21.15.53:0/889282922 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a280a5c80 con 0x7f8a300af760 2023-06-10T18:53:18.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.708+0000 7f8a370ea640 1 -- 172.21.15.53:0/889282922 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a300af760 msgr2=0x7f8a300afbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:18.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.708+0000 7f8a370ea640 1 --2- 172.21.15.53:0/889282922 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a300af760 0x7f8a300afbe0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8a3006ecb0 tx=0x7f8a2801c8d0 comp rx=0 tx=0).stop 2023-06-10T18:53:18.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.708+0000 7f8a370ea640 1 -- 172.21.15.53:0/889282922 shutdown_connections 2023-06-10T18:53:18.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.708+0000 7f8a370ea640 1 --2- 172.21.15.53:0/889282922 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a300af760 0x7f8a300afbe0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:18.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.708+0000 7f8a370ea640 1 --2- 172.21.15.53:0/889282922 >> v2:172.21.15.117:3300/0 conn(0x7f8a300c82a0 0x7f8a300c86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:18.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.708+0000 7f8a370ea640 1 -- 172.21.15.53:0/889282922 >> 172.21.15.53:0/889282922 conn(0x7f8a3006a0e0 msgr2=0x7f8a300cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:18.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.708+0000 7f8a370ea640 1 -- 172.21.15.53:0/889282922 shutdown_connections 2023-06-10T18:53:18.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.708+0000 7f8a370ea640 1 -- 172.21.15.53:0/889282922 wait complete. 2023-06-10T18:53:18.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.708+0000 7f8a370ea640 1 Processor -- start 2023-06-10T18:53:18.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.708+0000 7f8a370ea640 1 -- start start 2023-06-10T18:53:18.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.708+0000 7f8a370ea640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a300af760 0x7f8a300ae010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:18.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.708+0000 7f8a370ea640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a300c82a0 0x7f8a301535c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:18.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.708+0000 7f8a370ea640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8a300c9fa0 0x7f8a30156210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:18.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.708+0000 7f8a370ea640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a30153b00 con 0x7f8a300af760 2023-06-10T18:53:18.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.708+0000 7f8a370ea640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a300c1b00 con 0x7f8a300c82a0 2023-06-10T18:53:18.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.708+0000 7f8a370ea640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a300c1de0 con 0x7f8a300c9fa0 2023-06-10T18:53:18.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.708+0000 7f8a34e86640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a300af760 0x7f8a300ae010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:18.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.708+0000 7f8a34e86640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a300af760 0x7f8a300ae010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40528/0 (socket says 172.21.15.53:40528) 2023-06-10T18:53:18.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.708+0000 7f8a34e86640 1 -- 172.21.15.53:0/2720257633 learned_addr learned my addr 172.21.15.53:0/2720257633 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:18.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.708+0000 7f8a35687640 1 --2- 172.21.15.53:0/2720257633 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8a300c9fa0 0x7f8a30156210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:18.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.708+0000 7f8a2ffff640 1 --2- 172.21.15.53:0/2720257633 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a300c82a0 0x7f8a301535c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:18.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.708+0000 7f8a34e86640 1 -- 172.21.15.53:0/2720257633 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8a300c9fa0 msgr2=0x7f8a30156210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:18.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.708+0000 7f8a34e86640 1 --2- 172.21.15.53:0/2720257633 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8a300c9fa0 0x7f8a30156210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:18.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.708+0000 7f8a34e86640 1 -- 172.21.15.53:0/2720257633 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a300c82a0 msgr2=0x7f8a301535c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:18.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.708+0000 7f8a34e86640 1 --2- 172.21.15.53:0/2720257633 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a300c82a0 0x7f8a301535c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:18.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.708+0000 7f8a34e86640 1 -- 172.21.15.53:0/2720257633 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a28009b30 con 0x7f8a300af760 2023-06-10T18:53:18.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.708+0000 7f8a2ffff640 1 --2- 172.21.15.53:0/2720257633 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a300c82a0 0x7f8a301535c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:18.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.708+0000 7f8a34e86640 1 --2- 172.21.15.53:0/2720257633 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a300af760 0x7f8a300ae010 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8a2000b410 tx=0x7f8a2000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:18.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.712+0000 7f8a2d7fa640 1 -- 172.21.15.53:0/2720257633 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a20004020 con 0x7f8a300af760 2023-06-10T18:53:18.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.712+0000 7f8a2d7fa640 1 -- 172.21.15.53:0/2720257633 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a20004180 con 0x7f8a300af760 2023-06-10T18:53:18.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.712+0000 7f8a370ea640 1 -- 172.21.15.53:0/2720257633 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a300c20c0 con 0x7f8a300af760 2023-06-10T18:53:18.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.712+0000 7f8a2d7fa640 1 -- 172.21.15.53:0/2720257633 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a20011630 con 0x7f8a300af760 2023-06-10T18:53:18.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.712+0000 7f8a370ea640 1 -- 172.21.15.53:0/2720257633 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a300c2680 con 0x7f8a300af760 2023-06-10T18:53:18.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.712+0000 7f8a370ea640 1 -- 172.21.15.53:0/2720257633 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a300b3cc0 con 0x7f8a300af760 2023-06-10T18:53:18.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.712+0000 7f8a2d7fa640 1 -- 172.21.15.53:0/2720257633 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8a20011790 con 0x7f8a300af760 2023-06-10T18:53:18.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.712+0000 7f8a2d7fa640 1 --2- 172.21.15.53:0/2720257633 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8a10066280 0x7f8a10068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:18.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.712+0000 7f8a2d7fa640 1 -- 172.21.15.53:0/2720257633 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8a20083a90 con 0x7f8a300af760 2023-06-10T18:53:18.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.712+0000 7f8a2ffff640 1 --2- 172.21.15.53:0/2720257633 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8a10066280 0x7f8a10068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:18.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.712+0000 7f8a2ffff640 1 --2- 172.21.15.53:0/2720257633 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8a10066280 0x7f8a10068730 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8a18006fd0 tx=0x7f8a18008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:18.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.716+0000 7f8a2d7fa640 1 -- 172.21.15.53:0/2720257633 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8a20050f10 con 0x7f8a300af760 2023-06-10T18:53:18.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.876+0000 7f8a370ea640 1 -- 172.21.15.53:0/2720257633 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8a300c28a0 con 0x7f8a300af760 2023-06-10T18:53:18.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.876+0000 7f8a2d7fa640 1 -- 172.21.15.53:0/2720257633 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8a20054530 con 0x7f8a300af760 2023-06-10T18:53:18.888 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-06-10T18:53:18.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.880+0000 7f8a370ea640 1 -- 172.21.15.53:0/2720257633 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8a10066280 msgr2=0x7f8a10068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:18.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.880+0000 7f8a370ea640 1 --2- 172.21.15.53:0/2720257633 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8a10066280 0x7f8a10068730 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8a18006fd0 tx=0x7f8a18008040 comp rx=0 tx=0).stop 2023-06-10T18:53:18.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.880+0000 7f8a370ea640 1 -- 172.21.15.53:0/2720257633 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a300af760 msgr2=0x7f8a300ae010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:18.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.880+0000 7f8a370ea640 1 --2- 172.21.15.53:0/2720257633 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a300af760 0x7f8a300ae010 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8a2000b410 tx=0x7f8a2000b8d0 comp rx=0 tx=0).stop 2023-06-10T18:53:18.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.880+0000 7f8a370ea640 1 -- 172.21.15.53:0/2720257633 shutdown_connections 2023-06-10T18:53:18.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.880+0000 7f8a370ea640 1 --2- 172.21.15.53:0/2720257633 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8a10066280 0x7f8a10068730 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:18.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.880+0000 7f8a370ea640 1 --2- 172.21.15.53:0/2720257633 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8a300c9fa0 0x7f8a30156210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:18.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.880+0000 7f8a370ea640 1 --2- 172.21.15.53:0/2720257633 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a300c82a0 0x7f8a301535c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:18.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.880+0000 7f8a370ea640 1 --2- 172.21.15.53:0/2720257633 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a300af760 0x7f8a300ae010 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:18.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.880+0000 7f8a370ea640 1 -- 172.21.15.53:0/2720257633 >> 172.21.15.53:0/2720257633 conn(0x7f8a3006a0e0 msgr2=0x7f8a300b2d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:18.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.880+0000 7f8a370ea640 1 -- 172.21.15.53:0/2720257633 shutdown_connections 2023-06-10T18:53:18.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:18.880+0000 7f8a370ea640 1 -- 172.21.15.53:0/2720257633 wait complete. 2023-06-10T18:53:18.906 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-10T18:53:19.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.024+0000 7fbdc23be640 1 Processor -- start 2023-06-10T18:53:19.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.024+0000 7fbdc23be640 1 -- start start 2023-06-10T18:53:19.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.024+0000 7fbdc23be640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbdbc06f3b0 0x7fbdbc0cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:19.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.024+0000 7fbdc23be640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbdbc0cda10 0x7fbdbc0cde70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:19.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.024+0000 7fbdc23be640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdbc0ce3b0 con 0x7fbdbc159b20 2023-06-10T18:53:19.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.024+0000 7fbdc23be640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdbc0cbb30 con 0x7fbdbc06f3b0 2023-06-10T18:53:19.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.024+0000 7fbdc23be640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdbc0ce620 con 0x7fbdbc0cda10 2023-06-10T18:53:19.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.024+0000 7fbdbb7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbdbc06f3b0 0x7fbdbc0cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:19.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.024+0000 7fbdbb7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbdbc06f3b0 0x7fbdbc0cf6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40544/0 (socket says 172.21.15.53:40544) 2023-06-10T18:53:19.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.024+0000 7fbdbb7fe640 1 -- 172.21.15.53:0/462381811 learned_addr learned my addr 172.21.15.53:0/462381811 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:19.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.024+0000 7fbdc095b640 1 --2- 172.21.15.53:0/462381811 >> v2:172.21.15.117:3300/0 conn(0x7fbdbc0cda10 0x7fbdbc0cde70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:19.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.024+0000 7fbdbb7fe640 1 -- 172.21.15.53:0/462381811 >> v2:172.21.15.117:3300/0 conn(0x7fbdbc0cda10 msgr2=0x7fbdbc0cde70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:19.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.024+0000 7fbdbb7fe640 1 --2- 172.21.15.53:0/462381811 >> v2:172.21.15.117:3300/0 conn(0x7fbdbc0cda10 0x7fbdbc0cde70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:19.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.024+0000 7fbdbb7fe640 1 -- 172.21.15.53:0/462381811 >> v1:172.21.15.117:6789/0 conn(0x7fbdbc159b20 legacy=0x7fbdbc06eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:19.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.024+0000 7fbdbb7fe640 1 -- 172.21.15.53:0/462381811 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdbc0ce900 con 0x7fbdbc06f3b0 2023-06-10T18:53:19.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.028+0000 7fbdbb7fe640 1 --2- 172.21.15.53:0/462381811 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbdbc06f3b0 0x7fbdbc0cf6c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc0ccec0 tx=0x7fbdb001c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85c93582228d525a server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:19.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.028+0000 7fbdbaffd640 1 -- 172.21.15.53:0/462381811 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb00ac410 con 0x7fbdbc06f3b0 2023-06-10T18:53:19.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.028+0000 7fbdbaffd640 1 -- 172.21.15.53:0/462381811 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdb00ac570 con 0x7fbdbc06f3b0 2023-06-10T18:53:19.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.028+0000 7fbdbaffd640 1 -- 172.21.15.53:0/462381811 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb00ac900 con 0x7fbdbc06f3b0 2023-06-10T18:53:19.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.028+0000 7fbdc23be640 1 -- 172.21.15.53:0/462381811 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbdbc06f3b0 msgr2=0x7fbdbc0cf6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:19.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.028+0000 7fbdc23be640 1 --2- 172.21.15.53:0/462381811 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbdbc06f3b0 0x7fbdbc0cf6c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc0ccec0 tx=0x7fbdb001c4c0 comp rx=0 tx=0).stop 2023-06-10T18:53:19.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.028+0000 7fbdc23be640 1 -- 172.21.15.53:0/462381811 shutdown_connections 2023-06-10T18:53:19.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.028+0000 7fbdc23be640 1 --2- 172.21.15.53:0/462381811 >> v2:172.21.15.117:3300/0 conn(0x7fbdbc0cda10 0x7fbdbc0cde70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:19.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.028+0000 7fbdc23be640 1 --2- 172.21.15.53:0/462381811 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbdbc06f3b0 0x7fbdbc0cf6c0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:19.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.028+0000 7fbdc23be640 1 -- 172.21.15.53:0/462381811 >> 172.21.15.53:0/462381811 conn(0x7fbdbc06a0e0 msgr2=0x7fbdbc06d270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:19.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.028+0000 7fbdc23be640 1 -- 172.21.15.53:0/462381811 shutdown_connections 2023-06-10T18:53:19.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.028+0000 7fbdc23be640 1 -- 172.21.15.53:0/462381811 wait complete. 2023-06-10T18:53:19.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.028+0000 7fbdc23be640 1 Processor -- start 2023-06-10T18:53:19.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.028+0000 7fbdc23be640 1 -- start start 2023-06-10T18:53:19.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.032+0000 7fbdc23be640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbdbc06f3b0 0x7fbdbc1574f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:19.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.032+0000 7fbdc23be640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbdbc0cda10 0x7fbdbc06db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:19.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.032+0000 7fbdc23be640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbdbc159b20 0x7fbdbc0b4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:19.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.032+0000 7fbdc23be640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdbc15c890 con 0x7fbdbc159b20 2023-06-10T18:53:19.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.032+0000 7fbdc23be640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdbc0c4750 con 0x7fbdbc0cda10 2023-06-10T18:53:19.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.032+0000 7fbdc23be640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdbc0c4420 con 0x7fbdbc06f3b0 2023-06-10T18:53:19.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.032+0000 7fbdc095b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbdbc159b20 0x7fbdbc0b4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:19.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.032+0000 7fbdc095b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbdbc159b20 0x7fbdbc0b4390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40560/0 (socket says 172.21.15.53:40560) 2023-06-10T18:53:19.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.032+0000 7fbdc095b640 1 -- 172.21.15.53:0/1646190782 learned_addr learned my addr 172.21.15.53:0/1646190782 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:19.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.032+0000 7fbdbbfff640 1 --2- 172.21.15.53:0/1646190782 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbdbc06f3b0 0x7fbdbc1574f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:19.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.032+0000 7fbdbb7fe640 1 --2- 172.21.15.53:0/1646190782 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbdbc0cda10 0x7fbdbc06db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:19.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.032+0000 7fbdc095b640 1 -- 172.21.15.53:0/1646190782 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbdbc06f3b0 msgr2=0x7fbdbc1574f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:19.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.032+0000 7fbdc095b640 1 --2- 172.21.15.53:0/1646190782 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbdbc06f3b0 0x7fbdbc1574f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:19.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.032+0000 7fbdc095b640 1 -- 172.21.15.53:0/1646190782 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbdbc0cda10 msgr2=0x7fbdbc06db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:19.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.032+0000 7fbdc095b640 1 --2- 172.21.15.53:0/1646190782 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbdbc0cda10 0x7fbdbc06db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:19.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.032+0000 7fbdc095b640 1 -- 172.21.15.53:0/1646190782 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdb00094d0 con 0x7fbdbc159b20 2023-06-10T18:53:19.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.032+0000 7fbdc095b640 1 --2- 172.21.15.53:0/1646190782 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbdbc159b20 0x7fbdbc0b4390 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fbdb400d800 tx=0x7fbdb400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:19.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.032+0000 7fbdb8ff9640 1 -- 172.21.15.53:0/1646190782 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb400b6c0 con 0x7fbdbc159b20 2023-06-10T18:53:19.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.032+0000 7fbdb8ff9640 1 -- 172.21.15.53:0/1646190782 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdb400b820 con 0x7fbdbc159b20 2023-06-10T18:53:19.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.032+0000 7fbdb8ff9640 1 -- 172.21.15.53:0/1646190782 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb400bbd0 con 0x7fbdbc159b20 2023-06-10T18:53:19.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.032+0000 7fbdc23be640 1 -- 172.21.15.53:0/1646190782 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdbc15caa0 con 0x7fbdbc159b20 2023-06-10T18:53:19.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.032+0000 7fbdc23be640 1 -- 172.21.15.53:0/1646190782 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdbc15cd80 con 0x7fbdbc159b20 2023-06-10T18:53:19.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.032+0000 7fbdc23be640 1 -- 172.21.15.53:0/1646190782 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdbc0c48e0 con 0x7fbdbc159b20 2023-06-10T18:53:19.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.032+0000 7fbdb8ff9640 1 -- 172.21.15.53:0/1646190782 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbdb400bd30 con 0x7fbdbc159b20 2023-06-10T18:53:19.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.032+0000 7fbdb8ff9640 1 --2- 172.21.15.53:0/1646190782 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbda80662b0 0x7fbda8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:19.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.032+0000 7fbdb8ff9640 1 -- 172.21.15.53:0/1646190782 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbdb4084260 con 0x7fbdbc159b20 2023-06-10T18:53:19.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.032+0000 7fbdbbfff640 1 --2- 172.21.15.53:0/1646190782 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbda80662b0 0x7fbda8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:19.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.036+0000 7fbdbbfff640 1 --2- 172.21.15.53:0/1646190782 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbda80662b0 0x7fbda8068760 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fbdac009f20 tx=0x7fbdac0094d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:19.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.036+0000 7fbdb8ff9640 1 -- 172.21.15.53:0/1646190782 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbdb40516e0 con 0x7fbdbc159b20 2023-06-10T18:53:19.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.184+0000 7fbdc23be640 1 -- 172.21.15.53:0/1646190782 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbdbc04d790 con 0x7fbdbc159b20 2023-06-10T18:53:19.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.184+0000 7fbdb8ff9640 1 -- 172.21.15.53:0/1646190782 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbdb4054d00 con 0x7fbdbc159b20 2023-06-10T18:53:19.195 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-06-10T18:53:19.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.188+0000 7fbdc23be640 1 -- 172.21.15.53:0/1646190782 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbda80662b0 msgr2=0x7fbda8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:19.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.188+0000 7fbdc23be640 1 --2- 172.21.15.53:0/1646190782 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbda80662b0 0x7fbda8068760 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fbdac009f20 tx=0x7fbdac0094d0 comp rx=0 tx=0).stop 2023-06-10T18:53:19.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.188+0000 7fbdc23be640 1 -- 172.21.15.53:0/1646190782 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbdbc159b20 msgr2=0x7fbdbc0b4390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:19.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.188+0000 7fbdc23be640 1 --2- 172.21.15.53:0/1646190782 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbdbc159b20 0x7fbdbc0b4390 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fbdb400d800 tx=0x7fbdb400dcc0 comp rx=0 tx=0).stop 2023-06-10T18:53:19.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.188+0000 7fbdc23be640 1 -- 172.21.15.53:0/1646190782 shutdown_connections 2023-06-10T18:53:19.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.188+0000 7fbdc23be640 1 --2- 172.21.15.53:0/1646190782 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbda80662b0 0x7fbda8068760 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:19.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.188+0000 7fbdc23be640 1 --2- 172.21.15.53:0/1646190782 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbdbc159b20 0x7fbdbc0b4390 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:19.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.188+0000 7fbdc23be640 1 --2- 172.21.15.53:0/1646190782 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbdbc0cda10 0x7fbdbc06db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:19.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.188+0000 7fbdc23be640 1 --2- 172.21.15.53:0/1646190782 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbdbc06f3b0 0x7fbdbc1574f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:19.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.188+0000 7fbdc23be640 1 -- 172.21.15.53:0/1646190782 >> 172.21.15.53:0/1646190782 conn(0x7fbdbc06a0e0 msgr2=0x7fbdbc156470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:19.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.188+0000 7fbdc23be640 1 -- 172.21.15.53:0/1646190782 shutdown_connections 2023-06-10T18:53:19.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.188+0000 7fbdc23be640 1 -- 172.21.15.53:0/1646190782 wait complete. 2023-06-10T18:53:19.213 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T18:53:19.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.328+0000 7f9e29fdf640 1 Processor -- start 2023-06-10T18:53:19.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.328+0000 7f9e29fdf640 1 -- start start 2023-06-10T18:53:19.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.328+0000 7f9e29fdf640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9e2406b2f0 0x7f9e2406f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:19.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.328+0000 7f9e29fdf640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9e240c8d00 0x7f9e2406b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:19.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.328+0000 7f9e29fdf640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e24158a90 con 0x7f9e2406bc00 2023-06-10T18:53:19.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.328+0000 7f9e29fdf640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e240705d0 con 0x7f9e2406b2f0 2023-06-10T18:53:19.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.328+0000 7f9e29fdf640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e2406f9c0 con 0x7f9e240c8d00 2023-06-10T18:53:19.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.328+0000 7f9e237fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9e2406b2f0 0x7f9e2406f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:19.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.328+0000 7f9e23fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f9e2406bc00 0x7f9e240cbe00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:37934/0 (socket says 172.21.15.53:37934) 2023-06-10T18:53:19.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.328+0000 7f9e23fff640 1 -- 172.21.15.53:0/4019804676 learned_addr learned my addr 172.21.15.53:0/4019804676 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:53:19.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.328+0000 7f9e22ffd640 1 --2- 172.21.15.53:0/4019804676 >> v2:172.21.15.117:3300/0 conn(0x7f9e240c8d00 0x7f9e2406b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:19.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.328+0000 7f9e237fe640 1 -- 172.21.15.53:0/4019804676 >> v2:172.21.15.117:3300/0 conn(0x7f9e240c8d00 msgr2=0x7f9e2406b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:19.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.328+0000 7f9e237fe640 1 --2- 172.21.15.53:0/4019804676 >> v2:172.21.15.117:3300/0 conn(0x7f9e240c8d00 0x7f9e2406b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:19.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.328+0000 7f9e237fe640 1 -- 172.21.15.53:0/4019804676 >> v1:172.21.15.53:6789/0 conn(0x7f9e2406bc00 legacy=0x7f9e240cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:19.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.328+0000 7f9e237fe640 1 -- 172.21.15.53:0/4019804676 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e2406fca0 con 0x7f9e2406b2f0 2023-06-10T18:53:19.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.328+0000 7f9e22ffd640 1 --2- 172.21.15.53:0/4019804676 >> v2:172.21.15.117:3300/0 conn(0x7f9e240c8d00 0x7f9e2406b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:19.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.328+0000 7f9e237fe640 1 --2- 172.21.15.53:0/4019804676 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9e2406b2f0 0x7f9e2406f070 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9e2415c0b0 tx=0x7f9e1401ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce644a7f7b202b8d server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:19.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.332+0000 7f9e227fc640 1 -- 172.21.15.53:0/4019804676 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e140a8950 con 0x7f9e2406b2f0 2023-06-10T18:53:19.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.332+0000 7f9e227fc640 1 -- 172.21.15.53:0/4019804676 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e140a8ab0 con 0x7f9e2406b2f0 2023-06-10T18:53:19.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.332+0000 7f9e227fc640 1 -- 172.21.15.53:0/4019804676 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e140a8e40 con 0x7f9e2406b2f0 2023-06-10T18:53:19.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.332+0000 7f9e29fdf640 1 -- 172.21.15.53:0/4019804676 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9e2406b2f0 msgr2=0x7f9e2406f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:19.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.332+0000 7f9e29fdf640 1 --2- 172.21.15.53:0/4019804676 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9e2406b2f0 0x7f9e2406f070 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9e2415c0b0 tx=0x7f9e1401ec50 comp rx=0 tx=0).stop 2023-06-10T18:53:19.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.332+0000 7f9e29fdf640 1 -- 172.21.15.53:0/4019804676 shutdown_connections 2023-06-10T18:53:19.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.332+0000 7f9e29fdf640 1 --2- 172.21.15.53:0/4019804676 >> v2:172.21.15.117:3300/0 conn(0x7f9e240c8d00 0x7f9e2406b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:19.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.332+0000 7f9e29fdf640 1 --2- 172.21.15.53:0/4019804676 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9e2406b2f0 0x7f9e2406f070 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:19.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.332+0000 7f9e29fdf640 1 -- 172.21.15.53:0/4019804676 >> 172.21.15.53:0/4019804676 conn(0x7f9e2406a0d0 msgr2=0x7f9e240ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:19.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.332+0000 7f9e29fdf640 1 -- 172.21.15.53:0/4019804676 shutdown_connections 2023-06-10T18:53:19.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.332+0000 7f9e29fdf640 1 -- 172.21.15.53:0/4019804676 wait complete. 2023-06-10T18:53:19.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.332+0000 7f9e29fdf640 1 Processor -- start 2023-06-10T18:53:19.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.332+0000 7f9e29fdf640 1 -- start start 2023-06-10T18:53:19.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.332+0000 7f9e29fdf640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e2406b2f0 0x7f9e241f38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:19.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.332+0000 7f9e29fdf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9e2406bc00 0x7f9e24145fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:19.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.332+0000 7f9e29fdf640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e240c8d00 0x7f9e24146520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:19.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.332+0000 7f9e29fdf640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e240b1b30 con 0x7f9e2406bc00 2023-06-10T18:53:19.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.332+0000 7f9e29fdf640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e240b0ad0 con 0x7f9e240c8d00 2023-06-10T18:53:19.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.332+0000 7f9e29fdf640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e240b0d70 con 0x7f9e2406b2f0 2023-06-10T18:53:19.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.332+0000 7f9e22ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9e2406bc00 0x7f9e24145fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:19.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.332+0000 7f9e22ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9e2406bc00 0x7f9e24145fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40570/0 (socket says 172.21.15.53:40570) 2023-06-10T18:53:19.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.332+0000 7f9e22ffd640 1 -- 172.21.15.53:0/698444522 learned_addr learned my addr 172.21.15.53:0/698444522 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:19.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.332+0000 7f9e237fe640 1 --2- 172.21.15.53:0/698444522 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e2406b2f0 0x7f9e241f38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:19.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.332+0000 7f9e23fff640 1 --2- 172.21.15.53:0/698444522 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e240c8d00 0x7f9e24146520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:19.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.332+0000 7f9e22ffd640 1 -- 172.21.15.53:0/698444522 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e2406b2f0 msgr2=0x7f9e241f38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:19.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.332+0000 7f9e22ffd640 1 --2- 172.21.15.53:0/698444522 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e2406b2f0 0x7f9e241f38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:19.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.332+0000 7f9e22ffd640 1 -- 172.21.15.53:0/698444522 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e240c8d00 msgr2=0x7f9e24146520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:19.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.332+0000 7f9e22ffd640 1 --2- 172.21.15.53:0/698444522 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e240c8d00 0x7f9e24146520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:19.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.332+0000 7f9e22ffd640 1 -- 172.21.15.53:0/698444522 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e14009420 con 0x7f9e2406bc00 2023-06-10T18:53:19.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.332+0000 7f9e23fff640 1 --2- 172.21.15.53:0/698444522 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e240c8d00 0x7f9e24146520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:19.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.332+0000 7f9e22ffd640 1 --2- 172.21.15.53:0/698444522 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9e2406bc00 0x7f9e24145fe0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9e1800c7f0 tx=0x7f9e1800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:19.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.332+0000 7f9e0bfff640 1 -- 172.21.15.53:0/698444522 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e18007820 con 0x7f9e2406bc00 2023-06-10T18:53:19.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.332+0000 7f9e0bfff640 1 -- 172.21.15.53:0/698444522 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e18007980 con 0x7f9e2406bc00 2023-06-10T18:53:19.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.332+0000 7f9e0bfff640 1 -- 172.21.15.53:0/698444522 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e18007d30 con 0x7f9e2406bc00 2023-06-10T18:53:19.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.336+0000 7f9e29fdf640 1 -- 172.21.15.53:0/698444522 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e240b1050 con 0x7f9e2406bc00 2023-06-10T18:53:19.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.336+0000 7f9e29fdf640 1 -- 172.21.15.53:0/698444522 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e240b1610 con 0x7f9e2406bc00 2023-06-10T18:53:19.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.336+0000 7f9e29fdf640 1 -- 172.21.15.53:0/698444522 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e240b17d0 con 0x7f9e2406bc00 2023-06-10T18:53:19.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.336+0000 7f9e0bfff640 1 -- 172.21.15.53:0/698444522 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9e180113f0 con 0x7f9e2406bc00 2023-06-10T18:53:19.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.336+0000 7f9e0bfff640 1 --2- 172.21.15.53:0/698444522 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9e100662b0 0x7f9e10068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:19.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.336+0000 7f9e0bfff640 1 -- 172.21.15.53:0/698444522 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9e18083f30 con 0x7f9e2406bc00 2023-06-10T18:53:19.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.336+0000 7f9e237fe640 1 --2- 172.21.15.53:0/698444522 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9e100662b0 0x7f9e10068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:19.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.336+0000 7f9e237fe640 1 --2- 172.21.15.53:0/698444522 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9e100662b0 0x7f9e10068760 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9e140b2000 tx=0x7f9e14008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:19.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.340+0000 7f9e0bfff640 1 -- 172.21.15.53:0/698444522 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9e18051440 con 0x7f9e2406bc00 2023-06-10T18:53:19.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.496+0000 7f9e29fdf640 1 -- 172.21.15.53:0/698444522 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9e24070a40 con 0x7f9e2406bc00 2023-06-10T18:53:19.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.496+0000 7f9e0bfff640 1 -- 172.21.15.53:0/698444522 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18267 (secure 0 0 0) 0x7f9e24070a40 con 0x7f9e2406bc00 2023-06-10T18:53:19.507 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:53:19.507 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":23,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T18:52:45.921586+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-10T18:52:43.396243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-10T18:52:43.894228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T18:53:19.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.500+0000 7f9e29fdf640 1 -- 172.21.15.53:0/698444522 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9e100662b0 msgr2=0x7f9e10068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:19.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.500+0000 7f9e29fdf640 1 --2- 172.21.15.53:0/698444522 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9e100662b0 0x7f9e10068760 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9e140b2000 tx=0x7f9e14008040 comp rx=0 tx=0).stop 2023-06-10T18:53:19.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.500+0000 7f9e29fdf640 1 -- 172.21.15.53:0/698444522 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9e2406bc00 msgr2=0x7f9e24145fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:19.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.500+0000 7f9e29fdf640 1 --2- 172.21.15.53:0/698444522 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9e2406bc00 0x7f9e24145fe0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9e1800c7f0 tx=0x7f9e1800ccb0 comp rx=0 tx=0).stop 2023-06-10T18:53:19.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.500+0000 7f9e29fdf640 1 -- 172.21.15.53:0/698444522 shutdown_connections 2023-06-10T18:53:19.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.500+0000 7f9e29fdf640 1 --2- 172.21.15.53:0/698444522 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9e100662b0 0x7f9e10068760 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:19.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.500+0000 7f9e29fdf640 1 --2- 172.21.15.53:0/698444522 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e240c8d00 0x7f9e24146520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:19.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.500+0000 7f9e29fdf640 1 --2- 172.21.15.53:0/698444522 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9e2406bc00 0x7f9e24145fe0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:19.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.500+0000 7f9e29fdf640 1 --2- 172.21.15.53:0/698444522 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e2406b2f0 0x7f9e241f38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:19.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.500+0000 7f9e29fdf640 1 -- 172.21.15.53:0/698444522 >> 172.21.15.53:0/698444522 conn(0x7f9e2406a0d0 msgr2=0x7f9e240ccbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:19.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.500+0000 7f9e29fdf640 1 -- 172.21.15.53:0/698444522 shutdown_connections 2023-06-10T18:53:19.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.500+0000 7f9e29fdf640 1 -- 172.21.15.53:0/698444522 wait complete. 2023-06-10T18:53:19.526 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-10T18:52:33.633114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-10T18:52:39.171487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-10T18:52:43.396243+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-10T18:52:43.894228+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-10T18:53:19.527 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-10T18:53:19.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.644+0000 7fda37c86640 1 Processor -- start 2023-06-10T18:53:19.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.644+0000 7fda37c86640 1 -- start start 2023-06-10T18:53:19.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.644+0000 7fda37c86640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda30159450 0x7fda3015d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:19.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.644+0000 7fda37c86640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda300cbac0 con 0x7fda300cf350 2023-06-10T18:53:19.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.644+0000 7fda37c86640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda3015dc00 con 0x7fda3015d680 2023-06-10T18:53:19.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.644+0000 7fda37c86640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda3015dee0 con 0x7fda30159450 2023-06-10T18:53:19.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.644+0000 7fda36223640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fda300cf350 0x7fda300cbf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:37938/0 (socket says 172.21.15.53:37938) 2023-06-10T18:53:19.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.644+0000 7fda36223640 1 -- 172.21.15.53:0/596511393 learned_addr learned my addr 172.21.15.53:0/596511393 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:53:19.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.644+0000 7fda35a22640 1 --2- 172.21.15.53:0/596511393 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda30159450 0x7fda3015d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:19.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.644+0000 7fda34a20640 1 -- 172.21.15.53:0/596511393 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1290816997 0 0) 0x7fda300cbac0 con 0x7fda300cf350 2023-06-10T18:53:19.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.644+0000 7fda34a20640 1 -- 172.21.15.53:0/596511393 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda1c003530 con 0x7fda300cf350 2023-06-10T18:53:19.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.644+0000 7fda34a20640 1 -- 172.21.15.53:0/596511393 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 122780128 0 0) 0x7fda1c003530 con 0x7fda300cf350 2023-06-10T18:53:19.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.644+0000 7fda34a20640 1 -- 172.21.15.53:0/596511393 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda30159450 msgr2=0x7fda3015d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:19.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.644+0000 7fda34a20640 1 --2- 172.21.15.53:0/596511393 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda30159450 0x7fda3015d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:19.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.644+0000 7fda34a20640 1 -- 172.21.15.53:0/596511393 >> v1:172.21.15.117:6789/0 conn(0x7fda3015d680 legacy=0x7fda300cec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:19.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.644+0000 7fda34a20640 1 -- 172.21.15.53:0/596511393 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda300cb750 con 0x7fda300cf350 2023-06-10T18:53:19.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.644+0000 7fda34a20640 1 -- 172.21.15.53:0/596511393 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fda28001a00 con 0x7fda300cf350 2023-06-10T18:53:19.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.644+0000 7fda34a20640 1 -- 172.21.15.53:0/596511393 >> v1:172.21.15.53:6789/0 conn(0x7fda300cf350 legacy=0x7fda300cbf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:19.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.644+0000 7fda34a20640 1 --2- 172.21.15.53:0/596511393 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda1c0039b0 0x7fda1c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:19.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.644+0000 7fda34a20640 1 --2- 172.21.15.53:0/596511393 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda30159450 0x7fda1c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:19.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.644+0000 7fda34a20640 1 --2- 172.21.15.53:0/596511393 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda1c004d10 0x7fda1c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:19.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.644+0000 7fda34a20640 1 -- 172.21.15.53:0/596511393 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda3015dee0 con 0x7fda1c004d10 2023-06-10T18:53:19.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.644+0000 7fda34a20640 1 -- 172.21.15.53:0/596511393 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda1c00baa0 con 0x7fda1c0039b0 2023-06-10T18:53:19.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.644+0000 7fda34a20640 1 -- 172.21.15.53:0/596511393 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda1c00bc60 con 0x7fda30159450 2023-06-10T18:53:19.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.644+0000 7fda36223640 1 --2- 172.21.15.53:0/596511393 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda1c004d10 0x7fda1c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:19.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.644+0000 7fda35a22640 1 --2- 172.21.15.53:0/596511393 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda1c0039b0 0x7fda1c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:19.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.644+0000 7fda35221640 1 --2- 172.21.15.53:0/596511393 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda30159450 0x7fda1c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:19.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.644+0000 7fda36223640 1 -- 172.21.15.53:0/596511393 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda30159450 msgr2=0x7fda1c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:19.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.644+0000 7fda36223640 1 --2- 172.21.15.53:0/596511393 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda30159450 0x7fda1c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:19.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.644+0000 7fda36223640 1 -- 172.21.15.53:0/596511393 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda1c0039b0 msgr2=0x7fda1c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:19.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.644+0000 7fda36223640 1 --2- 172.21.15.53:0/596511393 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda1c0039b0 0x7fda1c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:19.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.644+0000 7fda36223640 1 -- 172.21.15.53:0/596511393 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda1c003530 con 0x7fda1c004d10 2023-06-10T18:53:19.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.644+0000 7fda35221640 1 --2- 172.21.15.53:0/596511393 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda30159450 0x7fda1c0047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:53:19.660 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.648+0000 7fda36223640 1 --2- 172.21.15.53:0/596511393 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda1c004d10 0x7fda1c005180 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fda3006f2d0 tx=0x7fda2801fa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2aed920ffab263 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:19.660 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.648+0000 7fda34a20640 1 -- 172.21.15.53:0/596511393 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda280aa670 con 0x7fda1c004d10 2023-06-10T18:53:19.660 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.648+0000 7fda34a20640 1 -- 172.21.15.53:0/596511393 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda280aa7f0 con 0x7fda1c004d10 2023-06-10T18:53:19.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.648+0000 7fda34a20640 1 -- 172.21.15.53:0/596511393 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda280aaba0 con 0x7fda1c004d10 2023-06-10T18:53:19.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.648+0000 7fda37c86640 1 -- 172.21.15.53:0/596511393 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda1c004d10 msgr2=0x7fda1c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:19.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.648+0000 7fda37c86640 1 --2- 172.21.15.53:0/596511393 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda1c004d10 0x7fda1c005180 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fda3006f2d0 tx=0x7fda2801fa40 comp rx=0 tx=0).stop 2023-06-10T18:53:19.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.648+0000 7fda36223640 1 -- 172.21.15.53:0/596511393 reap_dead start 2023-06-10T18:53:19.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.648+0000 7fda37c86640 1 -- 172.21.15.53:0/596511393 shutdown_connections 2023-06-10T18:53:19.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.648+0000 7fda37c86640 1 -- 172.21.15.53:0/596511393 >> 172.21.15.53:0/596511393 conn(0x7fda3006a090 msgr2=0x7fda3006d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:19.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.648+0000 7fda37c86640 1 -- 172.21.15.53:0/596511393 shutdown_connections 2023-06-10T18:53:19.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.648+0000 7fda37c86640 1 -- 172.21.15.53:0/596511393 wait complete. 2023-06-10T18:53:19.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.648+0000 7fda37c86640 1 Processor -- start 2023-06-10T18:53:19.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.648+0000 7fda37c86640 1 -- start start 2023-06-10T18:53:19.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.648+0000 7fda37c86640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda300aed20 0x7fda3014a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:19.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.648+0000 7fda37c86640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda300af0f0 0x7fda3014aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:19.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.648+0000 7fda37c86640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda3014b430 0x7fda300c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:19.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.648+0000 7fda37c86640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda300b3370 con 0x7fda3014b430 2023-06-10T18:53:19.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.648+0000 7fda37c86640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda3006bc70 con 0x7fda300aed20 2023-06-10T18:53:19.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.648+0000 7fda37c86640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda3006bf50 con 0x7fda300af0f0 2023-06-10T18:53:19.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.648+0000 7fda36223640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda3014b430 0x7fda300c8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:19.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.648+0000 7fda36223640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda3014b430 0x7fda300c8c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40590/0 (socket says 172.21.15.53:40590) 2023-06-10T18:53:19.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.648+0000 7fda36223640 1 -- 172.21.15.53:0/1551124385 learned_addr learned my addr 172.21.15.53:0/1551124385 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:19.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.652+0000 7fda35221640 1 --2- 172.21.15.53:0/1551124385 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda300af0f0 0x7fda3014aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:19.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.652+0000 7fda35a22640 1 --2- 172.21.15.53:0/1551124385 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda300aed20 0x7fda3014a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:19.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.652+0000 7fda36223640 1 -- 172.21.15.53:0/1551124385 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda300af0f0 msgr2=0x7fda3014aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:19.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.652+0000 7fda36223640 1 --2- 172.21.15.53:0/1551124385 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda300af0f0 0x7fda3014aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:19.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.652+0000 7fda36223640 1 -- 172.21.15.53:0/1551124385 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda300aed20 msgr2=0x7fda3014a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:19.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.652+0000 7fda36223640 1 --2- 172.21.15.53:0/1551124385 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda300aed20 0x7fda3014a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:19.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.652+0000 7fda36223640 1 -- 172.21.15.53:0/1551124385 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda300b2d20 con 0x7fda3014b430 2023-06-10T18:53:19.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.652+0000 7fda35a22640 1 --2- 172.21.15.53:0/1551124385 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda300aed20 0x7fda3014a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:19.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.652+0000 7fda36223640 1 --2- 172.21.15.53:0/1551124385 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda3014b430 0x7fda300c8c90 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fda2800a8c0 tx=0x7fda1c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:19.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.652+0000 7fda267fc640 1 -- 172.21.15.53:0/1551124385 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda28001fb0 con 0x7fda3014b430 2023-06-10T18:53:19.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.652+0000 7fda267fc640 1 -- 172.21.15.53:0/1551124385 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda280aae40 con 0x7fda3014b430 2023-06-10T18:53:19.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.652+0000 7fda37c86640 1 -- 172.21.15.53:0/1551124385 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda300b3370 con 0x7fda3014b430 2023-06-10T18:53:19.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.652+0000 7fda267fc640 1 -- 172.21.15.53:0/1551124385 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda280aa670 con 0x7fda3014b430 2023-06-10T18:53:19.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.652+0000 7fda37c86640 1 -- 172.21.15.53:0/1551124385 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda300c91d0 con 0x7fda3014b430 2023-06-10T18:53:19.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.652+0000 7fda37c86640 1 -- 172.21.15.53:0/1551124385 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda300cb400 con 0x7fda3014b430 2023-06-10T18:53:19.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.652+0000 7fda267fc640 1 -- 172.21.15.53:0/1551124385 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fda280017c0 con 0x7fda3014b430 2023-06-10T18:53:19.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.652+0000 7fda267fc640 1 --2- 172.21.15.53:0/1551124385 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fda14066280 0x7fda14068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:19.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.652+0000 7fda267fc640 1 -- 172.21.15.53:0/1551124385 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fda28121820 con 0x7fda3014b430 2023-06-10T18:53:19.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.652+0000 7fda35a22640 1 --2- 172.21.15.53:0/1551124385 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fda14066280 0x7fda14068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:19.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.652+0000 7fda35a22640 1 --2- 172.21.15.53:0/1551124385 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fda14066280 0x7fda14068730 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fda2c0099a0 tx=0x7fda2c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:19.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.656+0000 7fda267fc640 1 -- 172.21.15.53:0/1551124385 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fda280eeb70 con 0x7fda3014b430 2023-06-10T18:53:19.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.804+0000 7fda37c86640 1 -- 172.21.15.53:0/1551124385 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fda300b3500 con 0x7fda3014b430 2023-06-10T18:53:19.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.804+0000 7fda267fc640 1 -- 172.21.15.53:0/1551124385 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7fda280c3020 con 0x7fda3014b430 2023-06-10T18:53:19.815 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-06-10T18:53:19.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.808+0000 7fda37c86640 1 -- 172.21.15.53:0/1551124385 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fda14066280 msgr2=0x7fda14068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:19.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.808+0000 7fda37c86640 1 --2- 172.21.15.53:0/1551124385 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fda14066280 0x7fda14068730 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fda2c0099a0 tx=0x7fda2c008040 comp rx=0 tx=0).stop 2023-06-10T18:53:19.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.808+0000 7fda37c86640 1 -- 172.21.15.53:0/1551124385 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda3014b430 msgr2=0x7fda300c8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:19.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.808+0000 7fda37c86640 1 --2- 172.21.15.53:0/1551124385 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda3014b430 0x7fda300c8c90 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fda2800a8c0 tx=0x7fda1c005800 comp rx=0 tx=0).stop 2023-06-10T18:53:19.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.808+0000 7fda37c86640 1 -- 172.21.15.53:0/1551124385 shutdown_connections 2023-06-10T18:53:19.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.808+0000 7fda37c86640 1 --2- 172.21.15.53:0/1551124385 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fda14066280 0x7fda14068730 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:19.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.808+0000 7fda37c86640 1 --2- 172.21.15.53:0/1551124385 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda3014b430 0x7fda300c8c90 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:19.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.808+0000 7fda37c86640 1 --2- 172.21.15.53:0/1551124385 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda300af0f0 0x7fda3014aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:19.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.808+0000 7fda37c86640 1 --2- 172.21.15.53:0/1551124385 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda300aed20 0x7fda3014a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:19.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.808+0000 7fda37c86640 1 -- 172.21.15.53:0/1551124385 >> 172.21.15.53:0/1551124385 conn(0x7fda3006a090 msgr2=0x7fda3006f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:19.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.808+0000 7fda37c86640 1 -- 172.21.15.53:0/1551124385 shutdown_connections 2023-06-10T18:53:19.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.808+0000 7fda37c86640 1 -- 172.21.15.53:0/1551124385 wait complete. 2023-06-10T18:53:19.832 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-10T18:53:19.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.948+0000 7f572fab4640 1 Processor -- start 2023-06-10T18:53:19.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.948+0000 7f572fab4640 1 -- start start 2023-06-10T18:53:19.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.952+0000 7f572fab4640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f57280c9fa0 0x7f572806bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:19.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.952+0000 7f572fab4640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f57280af760 0x7f57280afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:19.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.952+0000 7f572fab4640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f572806b090 con 0x7f572806c020 2023-06-10T18:53:19.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.952+0000 7f572fab4640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57280b0120 con 0x7f57280af760 2023-06-10T18:53:19.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.952+0000 7f572fab4640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57280ca370 con 0x7f57280c9fa0 2023-06-10T18:53:19.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.952+0000 7f572e051640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f57280af760 0x7f57280afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:19.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.952+0000 7f572e051640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f57280af760 0x7f57280afbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40600/0 (socket says 172.21.15.53:40600) 2023-06-10T18:53:19.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.952+0000 7f572e051640 1 -- 172.21.15.53:0/1151160498 learned_addr learned my addr 172.21.15.53:0/1151160498 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:19.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.952+0000 7f572d850640 1 --2- 172.21.15.53:0/1151160498 >> v2:172.21.15.117:3300/0 conn(0x7f57280c9fa0 0x7f572806bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:19.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.952+0000 7f572e051640 1 -- 172.21.15.53:0/1151160498 >> v2:172.21.15.117:3300/0 conn(0x7f57280c9fa0 msgr2=0x7f572806bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:19.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.952+0000 7f572e051640 1 --2- 172.21.15.53:0/1151160498 >> v2:172.21.15.117:3300/0 conn(0x7f57280c9fa0 0x7f572806bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:19.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.952+0000 7f572e051640 1 -- 172.21.15.53:0/1151160498 >> v1:172.21.15.117:6789/0 conn(0x7f572806c020 legacy=0x7f57280c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:19.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.952+0000 7f572e051640 1 -- 172.21.15.53:0/1151160498 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5728070d50 con 0x7f57280af760 2023-06-10T18:53:19.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.952+0000 7f572e051640 1 --2- 172.21.15.53:0/1151160498 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57280af760 0x7f57280afbe0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f572806e9d0 tx=0x7f572001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecea1b34479b3e2e server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:19.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.952+0000 7f572c84e640 1 -- 172.21.15.53:0/1151160498 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57200a56e0 con 0x7f57280af760 2023-06-10T18:53:19.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.952+0000 7f572c84e640 1 -- 172.21.15.53:0/1151160498 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57200a5840 con 0x7f57280af760 2023-06-10T18:53:19.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.952+0000 7f572c84e640 1 -- 172.21.15.53:0/1151160498 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57200a5bd0 con 0x7f57280af760 2023-06-10T18:53:19.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.956+0000 7f572fab4640 1 -- 172.21.15.53:0/1151160498 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57280af760 msgr2=0x7f57280afbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:19.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.956+0000 7f572fab4640 1 --2- 172.21.15.53:0/1151160498 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57280af760 0x7f57280afbe0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f572806e9d0 tx=0x7f572001c910 comp rx=0 tx=0).stop 2023-06-10T18:53:19.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.956+0000 7f572fab4640 1 -- 172.21.15.53:0/1151160498 shutdown_connections 2023-06-10T18:53:19.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.956+0000 7f572fab4640 1 --2- 172.21.15.53:0/1151160498 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57280af760 0x7f57280afbe0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:19.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.956+0000 7f572fab4640 1 --2- 172.21.15.53:0/1151160498 >> v2:172.21.15.117:3300/0 conn(0x7f57280c9fa0 0x7f572806bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:19.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.956+0000 7f572fab4640 1 -- 172.21.15.53:0/1151160498 >> 172.21.15.53:0/1151160498 conn(0x7f572806a0e0 msgr2=0x7f57280cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:19.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.956+0000 7f572fab4640 1 -- 172.21.15.53:0/1151160498 shutdown_connections 2023-06-10T18:53:19.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.956+0000 7f572fab4640 1 -- 172.21.15.53:0/1151160498 wait complete. 2023-06-10T18:53:19.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.956+0000 7f572fab4640 1 Processor -- start 2023-06-10T18:53:19.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.956+0000 7f572fab4640 1 -- start start 2023-06-10T18:53:19.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.956+0000 7f572fab4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f572806c020 0x7f57281590a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:19.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.956+0000 7f572fab4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57280af760 0x7f5728141c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:19.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.956+0000 7f572fab4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57280c9fa0 0x7f57280b2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:19.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.956+0000 7f572fab4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5728149730 con 0x7f57280c9fa0 2023-06-10T18:53:19.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.956+0000 7f572fab4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5728158c10 con 0x7f572806c020 2023-06-10T18:53:19.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.956+0000 7f572fab4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5728158000 con 0x7f57280af760 2023-06-10T18:53:19.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.956+0000 7f572e051640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57280c9fa0 0x7f57280b2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:19.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.956+0000 7f572e051640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57280c9fa0 0x7f57280b2d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40604/0 (socket says 172.21.15.53:40604) 2023-06-10T18:53:19.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.956+0000 7f572e051640 1 -- 172.21.15.53:0/2168538819 learned_addr learned my addr 172.21.15.53:0/2168538819 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:19.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.956+0000 7f572d850640 1 --2- 172.21.15.53:0/2168538819 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f572806c020 0x7f57281590a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:19.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.956+0000 7f572d04f640 1 --2- 172.21.15.53:0/2168538819 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57280af760 0x7f5728141c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:19.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.956+0000 7f572e051640 1 -- 172.21.15.53:0/2168538819 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57280af760 msgr2=0x7f5728141c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:19.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.956+0000 7f572e051640 1 --2- 172.21.15.53:0/2168538819 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57280af760 0x7f5728141c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:19.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.956+0000 7f572e051640 1 -- 172.21.15.53:0/2168538819 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f572806c020 msgr2=0x7f57281590a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:19.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.956+0000 7f572e051640 1 --2- 172.21.15.53:0/2168538819 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f572806c020 0x7f57281590a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:19.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.956+0000 7f572e051640 1 -- 172.21.15.53:0/2168538819 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5720009b30 con 0x7f57280c9fa0 2023-06-10T18:53:19.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.956+0000 7f572e051640 1 --2- 172.21.15.53:0/2168538819 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57280c9fa0 0x7f57280b2d70 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f57200af040 tx=0x7f57200196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:19.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.956+0000 7f571e7fc640 1 -- 172.21.15.53:0/2168538819 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57200b8670 con 0x7f57280c9fa0 2023-06-10T18:53:19.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.956+0000 7f571e7fc640 1 -- 172.21.15.53:0/2168538819 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57200b87d0 con 0x7f57280c9fa0 2023-06-10T18:53:19.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.956+0000 7f572fab4640 1 -- 172.21.15.53:0/2168538819 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57281582e0 con 0x7f57280c9fa0 2023-06-10T18:53:19.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.956+0000 7f571e7fc640 1 -- 172.21.15.53:0/2168538819 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57200b8b60 con 0x7f57280c9fa0 2023-06-10T18:53:19.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.956+0000 7f572fab4640 1 -- 172.21.15.53:0/2168538819 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57281588a0 con 0x7f57280c9fa0 2023-06-10T18:53:19.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.960+0000 7f572fab4640 1 -- 172.21.15.53:0/2168538819 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57280b3cc0 con 0x7f57280c9fa0 2023-06-10T18:53:19.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.960+0000 7f571e7fc640 1 -- 172.21.15.53:0/2168538819 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f57200b8cc0 con 0x7f57280c9fa0 2023-06-10T18:53:19.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.960+0000 7f571e7fc640 1 --2- 172.21.15.53:0/2168538819 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f570c066280 0x7f570c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:19.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.960+0000 7f571e7fc640 1 -- 172.21.15.53:0/2168538819 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f572011f180 con 0x7f57280c9fa0 2023-06-10T18:53:19.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.960+0000 7f572d850640 1 --2- 172.21.15.53:0/2168538819 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f570c066280 0x7f570c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:19.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.960+0000 7f572d850640 1 --2- 172.21.15.53:0/2168538819 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f570c066280 0x7f570c068730 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5724009a50 tx=0x7f5724008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:19.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:19.964+0000 7f571e7fc640 1 -- 172.21.15.53:0/2168538819 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f57200ec800 con 0x7f57280c9fa0 2023-06-10T18:53:20.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.120+0000 7f572fab4640 1 -- 172.21.15.53:0/2168538819 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5728158d80 con 0x7f57280c9fa0 2023-06-10T18:53:20.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.120+0000 7f571e7fc640 1 -- 172.21.15.53:0/2168538819 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5720009510 con 0x7f57280c9fa0 2023-06-10T18:53:20.129 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-06-10T18:53:20.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.120+0000 7f572fab4640 1 -- 172.21.15.53:0/2168538819 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f570c066280 msgr2=0x7f570c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:20.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.120+0000 7f572fab4640 1 --2- 172.21.15.53:0/2168538819 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f570c066280 0x7f570c068730 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5724009a50 tx=0x7f5724008040 comp rx=0 tx=0).stop 2023-06-10T18:53:20.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.120+0000 7f572fab4640 1 -- 172.21.15.53:0/2168538819 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57280c9fa0 msgr2=0x7f57280b2d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:20.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.120+0000 7f572fab4640 1 --2- 172.21.15.53:0/2168538819 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57280c9fa0 0x7f57280b2d70 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f57200af040 tx=0x7f57200196b0 comp rx=0 tx=0).stop 2023-06-10T18:53:20.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.120+0000 7f572fab4640 1 -- 172.21.15.53:0/2168538819 shutdown_connections 2023-06-10T18:53:20.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.120+0000 7f572fab4640 1 --2- 172.21.15.53:0/2168538819 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f570c066280 0x7f570c068730 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:20.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.120+0000 7f572fab4640 1 --2- 172.21.15.53:0/2168538819 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57280c9fa0 0x7f57280b2d70 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:20.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.120+0000 7f572fab4640 1 --2- 172.21.15.53:0/2168538819 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57280af760 0x7f5728141c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:20.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.120+0000 7f572fab4640 1 --2- 172.21.15.53:0/2168538819 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f572806c020 0x7f57281590a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:20.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.120+0000 7f572fab4640 1 -- 172.21.15.53:0/2168538819 >> 172.21.15.53:0/2168538819 conn(0x7f572806a0e0 msgr2=0x7f57280c8280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:20.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.120+0000 7f572fab4640 1 -- 172.21.15.53:0/2168538819 shutdown_connections 2023-06-10T18:53:20.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.120+0000 7f572fab4640 1 -- 172.21.15.53:0/2168538819 wait complete. 2023-06-10T18:53:20.148 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-10T18:53:20.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.268+0000 7fd84ca77640 1 Processor -- start 2023-06-10T18:53:20.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.268+0000 7fd84ca77640 1 -- start start 2023-06-10T18:53:20.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.268+0000 7fd84ca77640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8480c82a0 0x7fd8480c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:20.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.268+0000 7fd84ca77640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd8480af760 0x7fd8480afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:20.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.268+0000 7fd84ca77640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd84806b090 con 0x7fd8480c9fa0 2023-06-10T18:53:20.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.268+0000 7fd84ca77640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8480b0120 con 0x7fd8480af760 2023-06-10T18:53:20.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.268+0000 7fd84ca77640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8480ca370 con 0x7fd8480c82a0 2023-06-10T18:53:20.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.268+0000 7fd846d9d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd8480af760 0x7fd8480afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:20.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.268+0000 7fd845d9b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8480c82a0 0x7fd8480c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:20.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.268+0000 7fd846d9d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd8480af760 0x7fd8480afbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.53:58188/0 (socket says 172.21.15.53:58188) 2023-06-10T18:53:20.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.268+0000 7fd845d9b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8480c82a0 0x7fd8480c86f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.53:60066/0 (socket says 172.21.15.53:60066) 2023-06-10T18:53:20.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.268+0000 7fd846d9d640 1 -- 172.21.15.53:0/1661376801 learned_addr learned my addr 172.21.15.53:0/1661376801 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:20.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.268+0000 7fd84659c640 1 --1- 172.21.15.53:0/1661376801 >> v1:172.21.15.117:6789/0 conn(0x7fd8480c9fa0 0x7fd84806bae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.53:48184/0 (socket says 172.21.15.53:48184) 2023-06-10T18:53:20.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.268+0000 7fd846d9d640 1 -- 172.21.15.53:0/1661376801 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8480c82a0 msgr2=0x7fd8480c86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:20.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.268+0000 7fd846d9d640 1 --2- 172.21.15.53:0/1661376801 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8480c82a0 0x7fd8480c86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:20.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.268+0000 7fd846d9d640 1 -- 172.21.15.53:0/1661376801 >> v1:172.21.15.117:6789/0 conn(0x7fd8480c9fa0 legacy=0x7fd84806bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:20.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.268+0000 7fd846d9d640 1 -- 172.21.15.53:0/1661376801 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd848070d50 con 0x7fd8480af760 2023-06-10T18:53:20.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.272+0000 7fd846d9d640 1 --2- 172.21.15.53:0/1661376801 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8480af760 0x7fd8480afbe0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd840009e50 tx=0x7fd84001c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a306ec1a2ad441ee server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:20.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.272+0000 7fd84559a640 1 -- 172.21.15.53:0/1661376801 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8400a5810 con 0x7fd8480af760 2023-06-10T18:53:20.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.272+0000 7fd84559a640 1 -- 172.21.15.53:0/1661376801 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8400a5970 con 0x7fd8480af760 2023-06-10T18:53:20.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.272+0000 7fd84559a640 1 -- 172.21.15.53:0/1661376801 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8400a5d00 con 0x7fd8480af760 2023-06-10T18:53:20.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.272+0000 7fd84ca77640 1 -- 172.21.15.53:0/1661376801 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8480af760 msgr2=0x7fd8480afbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:20.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.272+0000 7fd84ca77640 1 --2- 172.21.15.53:0/1661376801 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8480af760 0x7fd8480afbe0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd840009e50 tx=0x7fd84001c950 comp rx=0 tx=0).stop 2023-06-10T18:53:20.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.272+0000 7fd84ca77640 1 -- 172.21.15.53:0/1661376801 shutdown_connections 2023-06-10T18:53:20.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.272+0000 7fd84ca77640 1 --2- 172.21.15.53:0/1661376801 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8480af760 0x7fd8480afbe0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:20.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.272+0000 7fd84ca77640 1 --2- 172.21.15.53:0/1661376801 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8480c82a0 0x7fd8480c86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:20.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.272+0000 7fd84ca77640 1 -- 172.21.15.53:0/1661376801 >> 172.21.15.53:0/1661376801 conn(0x7fd84806a0e0 msgr2=0x7fd8480cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:20.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.272+0000 7fd84ca77640 1 -- 172.21.15.53:0/1661376801 shutdown_connections 2023-06-10T18:53:20.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.272+0000 7fd84ca77640 1 -- 172.21.15.53:0/1661376801 wait complete. 2023-06-10T18:53:20.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.272+0000 7fd84ca77640 1 Processor -- start 2023-06-10T18:53:20.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.272+0000 7fd84ca77640 1 -- start start 2023-06-10T18:53:20.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.276+0000 7fd84ca77640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8480af760 0x7fd8480c5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:20.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.276+0000 7fd84ca77640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8480c82a0 0x7fd8480c6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:20.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.276+0000 7fd84ca77640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8480c9fa0 0x7fd848150290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:20.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.276+0000 7fd84ca77640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8480c5d40 con 0x7fd8480c9fa0 2023-06-10T18:53:20.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.276+0000 7fd84ca77640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd848159310 con 0x7fd8480c82a0 2023-06-10T18:53:20.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.276+0000 7fd84ca77640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8481595f0 con 0x7fd8480af760 2023-06-10T18:53:20.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.276+0000 7fd846d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8480c9fa0 0x7fd848150290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:20.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.276+0000 7fd846d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8480c9fa0 0x7fd848150290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40614/0 (socket says 172.21.15.53:40614) 2023-06-10T18:53:20.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.276+0000 7fd846d9d640 1 -- 172.21.15.53:0/3640629164 learned_addr learned my addr 172.21.15.53:0/3640629164 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:20.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.276+0000 7fd845d9b640 1 --2- 172.21.15.53:0/3640629164 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8480c82a0 0x7fd8480c6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:20.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.276+0000 7fd84659c640 1 --2- 172.21.15.53:0/3640629164 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8480af760 0x7fd8480c5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:20.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.276+0000 7fd846d9d640 1 -- 172.21.15.53:0/3640629164 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8480af760 msgr2=0x7fd8480c5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:20.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.276+0000 7fd846d9d640 1 --2- 172.21.15.53:0/3640629164 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8480af760 0x7fd8480c5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:20.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.276+0000 7fd846d9d640 1 -- 172.21.15.53:0/3640629164 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8480c82a0 msgr2=0x7fd8480c6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:20.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.276+0000 7fd846d9d640 1 --2- 172.21.15.53:0/3640629164 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8480c82a0 0x7fd8480c6ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:20.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.276+0000 7fd846d9d640 1 -- 172.21.15.53:0/3640629164 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd840009b30 con 0x7fd8480c9fa0 2023-06-10T18:53:20.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.276+0000 7fd845d9b640 1 --2- 172.21.15.53:0/3640629164 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8480c82a0 0x7fd8480c6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:53:20.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.276+0000 7fd846d9d640 1 --2- 172.21.15.53:0/3640629164 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8480c9fa0 0x7fd848150290 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd84001a580 tx=0x7fd8400196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:20.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.276+0000 7fd836ffd640 1 -- 172.21.15.53:0/3640629164 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8400b8670 con 0x7fd8480c9fa0 2023-06-10T18:53:20.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.276+0000 7fd836ffd640 1 -- 172.21.15.53:0/3640629164 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8400b87d0 con 0x7fd8480c9fa0 2023-06-10T18:53:20.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.276+0000 7fd84ca77640 1 -- 172.21.15.53:0/3640629164 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8480c4d20 con 0x7fd8480c9fa0 2023-06-10T18:53:20.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.276+0000 7fd836ffd640 1 -- 172.21.15.53:0/3640629164 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8400b8b60 con 0x7fd8480c9fa0 2023-06-10T18:53:20.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.276+0000 7fd84ca77640 1 -- 172.21.15.53:0/3640629164 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8480c52e0 con 0x7fd8480c9fa0 2023-06-10T18:53:20.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.276+0000 7fd84ca77640 1 -- 172.21.15.53:0/3640629164 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8480c54d0 con 0x7fd8480c9fa0 2023-06-10T18:53:20.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.276+0000 7fd836ffd640 1 -- 172.21.15.53:0/3640629164 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd8400b8cc0 con 0x7fd8480c9fa0 2023-06-10T18:53:20.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.276+0000 7fd836ffd640 1 --2- 172.21.15.53:0/3640629164 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd8280662b0 0x7fd828068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:20.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.276+0000 7fd836ffd640 1 -- 172.21.15.53:0/3640629164 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd84011f230 con 0x7fd8480c9fa0 2023-06-10T18:53:20.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.276+0000 7fd84659c640 1 --2- 172.21.15.53:0/3640629164 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd8280662b0 0x7fd828068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:20.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.280+0000 7fd84659c640 1 --2- 172.21.15.53:0/3640629164 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd8280662b0 0x7fd828068760 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd838000f70 tx=0x7fd838007cf0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:20.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.280+0000 7fd836ffd640 1 -- 172.21.15.53:0/3640629164 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd8400ec740 con 0x7fd8480c9fa0 2023-06-10T18:53:20.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.428+0000 7fd84ca77640 1 -- 172.21.15.53:0/3640629164 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd848159730 con 0x7fd8480c9fa0 2023-06-10T18:53:20.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.428+0000 7fd836ffd640 1 -- 172.21.15.53:0/3640629164 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd848159730 con 0x7fd8480c9fa0 2023-06-10T18:53:20.437 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-06-10T18:53:20.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.428+0000 7fd84ca77640 1 -- 172.21.15.53:0/3640629164 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd8280662b0 msgr2=0x7fd828068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:20.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.428+0000 7fd84ca77640 1 --2- 172.21.15.53:0/3640629164 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd8280662b0 0x7fd828068760 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd838000f70 tx=0x7fd838007cf0 comp rx=0 tx=0).stop 2023-06-10T18:53:20.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.428+0000 7fd84ca77640 1 -- 172.21.15.53:0/3640629164 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8480c9fa0 msgr2=0x7fd848150290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:20.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.428+0000 7fd84ca77640 1 --2- 172.21.15.53:0/3640629164 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8480c9fa0 0x7fd848150290 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd84001a580 tx=0x7fd8400196f0 comp rx=0 tx=0).stop 2023-06-10T18:53:20.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.432+0000 7fd84ca77640 1 -- 172.21.15.53:0/3640629164 shutdown_connections 2023-06-10T18:53:20.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.432+0000 7fd84ca77640 1 --2- 172.21.15.53:0/3640629164 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd8280662b0 0x7fd828068760 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:20.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.432+0000 7fd84ca77640 1 --2- 172.21.15.53:0/3640629164 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8480c9fa0 0x7fd848150290 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:20.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.432+0000 7fd84ca77640 1 --2- 172.21.15.53:0/3640629164 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8480c82a0 0x7fd8480c6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:20.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.432+0000 7fd84ca77640 1 --2- 172.21.15.53:0/3640629164 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8480af760 0x7fd8480c5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:20.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.432+0000 7fd84ca77640 1 -- 172.21.15.53:0/3640629164 >> 172.21.15.53:0/3640629164 conn(0x7fd84806a0e0 msgr2=0x7fd8480b1540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:20.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.432+0000 7fd84ca77640 1 -- 172.21.15.53:0/3640629164 shutdown_connections 2023-06-10T18:53:20.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.432+0000 7fd84ca77640 1 -- 172.21.15.53:0/3640629164 wait complete. 2023-06-10T18:53:20.455 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-10T18:53:20.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.572+0000 7f143f6fe640 1 Processor -- start 2023-06-10T18:53:20.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.572+0000 7f143f6fe640 1 -- start start 2023-06-10T18:53:20.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.572+0000 7f143f6fe640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f14380b0f30 0x7f1438070950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:20.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.572+0000 7f143f6fe640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14380cb080 con 0x7f1438159690 2023-06-10T18:53:20.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.572+0000 7f143f6fe640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14380cb320 con 0x7f1438159a60 2023-06-10T18:53:20.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.572+0000 7f143f6fe640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1438070e90 con 0x7f14380b0f30 2023-06-10T18:53:20.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.572+0000 7f143d49a640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f1438159690 0x7f14380cbe00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:37940/0 (socket says 172.21.15.53:37940) 2023-06-10T18:53:20.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.572+0000 7f143d49a640 1 -- 172.21.15.53:0/3181068054 learned_addr learned my addr 172.21.15.53:0/3181068054 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:53:20.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.572+0000 7f143cc99640 1 --2- 172.21.15.53:0/3181068054 >> v2:172.21.15.117:3300/0 conn(0x7f14380b0f30 0x7f1438070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:20.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.572+0000 7f142ffff640 1 -- 172.21.15.53:0/3181068054 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 409007742 0 0) 0x7f14380cb080 con 0x7f1438159690 2023-06-10T18:53:20.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.572+0000 7f142ffff640 1 -- 172.21.15.53:0/3181068054 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1424003530 con 0x7f1438159690 2023-06-10T18:53:20.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.572+0000 7f142ffff640 1 -- 172.21.15.53:0/3181068054 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3974945789 0 0) 0x7f1424003530 con 0x7f1438159690 2023-06-10T18:53:20.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.572+0000 7f142ffff640 1 -- 172.21.15.53:0/3181068054 >> v2:172.21.15.117:3300/0 conn(0x7f14380b0f30 msgr2=0x7f1438070950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:20.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.572+0000 7f142ffff640 1 --2- 172.21.15.53:0/3181068054 >> v2:172.21.15.117:3300/0 conn(0x7f14380b0f30 0x7f1438070950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:20.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.572+0000 7f142ffff640 1 -- 172.21.15.53:0/3181068054 >> v1:172.21.15.117:6789/0 conn(0x7f1438159a60 legacy=0x7f14380c2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:20.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.572+0000 7f142ffff640 1 -- 172.21.15.53:0/3181068054 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14380cb600 con 0x7f1438159690 2023-06-10T18:53:20.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.572+0000 7f142ffff640 1 -- 172.21.15.53:0/3181068054 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f1434001680 con 0x7f1438159690 2023-06-10T18:53:20.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.572+0000 7f142ffff640 1 -- 172.21.15.53:0/3181068054 >> v1:172.21.15.53:6789/0 conn(0x7f1438159690 legacy=0x7f14380cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:20.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.572+0000 7f142ffff640 1 --2- 172.21.15.53:0/3181068054 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1424003980 0x7f1424003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:20.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.572+0000 7f142ffff640 1 --2- 172.21.15.53:0/3181068054 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f14240047d0 0x7f1424004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:20.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.572+0000 7f142ffff640 1 --2- 172.21.15.53:0/3181068054 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1424005180 0x7f142400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:20.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.572+0000 7f142ffff640 1 -- 172.21.15.53:0/3181068054 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1438070e90 con 0x7f14240047d0 2023-06-10T18:53:20.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.572+0000 7f142ffff640 1 -- 172.21.15.53:0/3181068054 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f142400c000 con 0x7f1424005180 2023-06-10T18:53:20.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.572+0000 7f142ffff640 1 -- 172.21.15.53:0/3181068054 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f142400c1c0 con 0x7f1424003980 2023-06-10T18:53:20.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.572+0000 7f143cc99640 1 --2- 172.21.15.53:0/3181068054 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f14240047d0 0x7f1424004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:20.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.572+0000 7f143d49a640 1 --2- 172.21.15.53:0/3181068054 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1424003980 0x7f1424003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:20.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.572+0000 7f143dc9b640 1 --2- 172.21.15.53:0/3181068054 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1424005180 0x7f142400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:20.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.572+0000 7f143cc99640 1 -- 172.21.15.53:0/3181068054 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1424003980 msgr2=0x7f1424003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:20.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.572+0000 7f143cc99640 1 --2- 172.21.15.53:0/3181068054 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1424003980 0x7f1424003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:20.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.572+0000 7f143cc99640 1 -- 172.21.15.53:0/3181068054 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1424005180 msgr2=0x7f142400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:20.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.572+0000 7f143cc99640 1 --2- 172.21.15.53:0/3181068054 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1424005180 0x7f142400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:20.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.572+0000 7f143cc99640 1 -- 172.21.15.53:0/3181068054 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1424003530 con 0x7f14240047d0 2023-06-10T18:53:20.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.572+0000 7f143dc9b640 1 --2- 172.21.15.53:0/3181068054 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1424005180 0x7f142400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:53:20.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.572+0000 7f143dc9b640 1 -- 172.21.15.53:0/3181068054 reap_dead start 2023-06-10T18:53:20.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.576+0000 7f143cc99640 1 --2- 172.21.15.53:0/3181068054 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f14240047d0 0x7f1424004c40 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f1428009ae0 tx=0x7f142801ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4f3131e910fdf4c server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:20.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.576+0000 7f142ffff640 1 -- 172.21.15.53:0/3181068054 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14280a6460 con 0x7f14240047d0 2023-06-10T18:53:20.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.576+0000 7f142ffff640 1 -- 172.21.15.53:0/3181068054 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14280a65c0 con 0x7f14240047d0 2023-06-10T18:53:20.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.576+0000 7f142ffff640 1 -- 172.21.15.53:0/3181068054 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14280a6970 con 0x7f14240047d0 2023-06-10T18:53:20.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.576+0000 7f143f6fe640 1 -- 172.21.15.53:0/3181068054 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f14240047d0 msgr2=0x7f1424004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:20.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.576+0000 7f143f6fe640 1 --2- 172.21.15.53:0/3181068054 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f14240047d0 0x7f1424004c40 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f1428009ae0 tx=0x7f142801ca50 comp rx=0 tx=0).stop 2023-06-10T18:53:20.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.576+0000 7f143f6fe640 1 -- 172.21.15.53:0/3181068054 shutdown_connections 2023-06-10T18:53:20.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.576+0000 7f143f6fe640 1 --2- 172.21.15.53:0/3181068054 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f14240047d0 0x7f1424004c40 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:20.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.576+0000 7f143f6fe640 1 -- 172.21.15.53:0/3181068054 >> 172.21.15.53:0/3181068054 conn(0x7f143806a560 msgr2=0x7f143806a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:20.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.576+0000 7f143f6fe640 1 -- 172.21.15.53:0/3181068054 shutdown_connections 2023-06-10T18:53:20.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.576+0000 7f143f6fe640 1 -- 172.21.15.53:0/3181068054 wait complete. 2023-06-10T18:53:20.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.576+0000 7f143f6fe640 1 Processor -- start 2023-06-10T18:53:20.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.576+0000 7f143f6fe640 1 -- start start 2023-06-10T18:53:20.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.576+0000 7f143f6fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14240047d0 0x7f1438155d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:20.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.576+0000 7f143f6fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f14380c65e0 0x7f14380c6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:20.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.576+0000 7f143f6fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14380c3930 0x7f14380c3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:20.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.576+0000 7f143f6fe640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14380c7940 con 0x7f14380c65e0 2023-06-10T18:53:20.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.576+0000 7f143f6fe640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14380c42f0 con 0x7f14240047d0 2023-06-10T18:53:20.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.576+0000 7f143f6fe640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14380b1be0 con 0x7f14380c3930 2023-06-10T18:53:20.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.580+0000 7f143cc99640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f14380c65e0 0x7f14380c6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:20.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.580+0000 7f143cc99640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f14380c65e0 0x7f14380c6a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40628/0 (socket says 172.21.15.53:40628) 2023-06-10T18:53:20.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.580+0000 7f143cc99640 1 -- 172.21.15.53:0/1144431681 learned_addr learned my addr 172.21.15.53:0/1144431681 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:20.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.580+0000 7f143d49a640 1 --2- 172.21.15.53:0/1144431681 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14240047d0 0x7f1438155d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:20.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.580+0000 7f143dc9b640 1 --2- 172.21.15.53:0/1144431681 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14380c3930 0x7f14380c3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:20.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.580+0000 7f143cc99640 1 -- 172.21.15.53:0/1144431681 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14380c3930 msgr2=0x7f14380c3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:20.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.580+0000 7f143cc99640 1 --2- 172.21.15.53:0/1144431681 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14380c3930 0x7f14380c3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:20.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.580+0000 7f143cc99640 1 -- 172.21.15.53:0/1144431681 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14240047d0 msgr2=0x7f1438155d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:20.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.580+0000 7f143cc99640 1 --2- 172.21.15.53:0/1144431681 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14240047d0 0x7f1438155d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:20.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.580+0000 7f143cc99640 1 -- 172.21.15.53:0/1144431681 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14380aca00 con 0x7f14380c65e0 2023-06-10T18:53:20.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.580+0000 7f143cc99640 1 --2- 172.21.15.53:0/1144431681 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f14380c65e0 0x7f14380c6a50 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1428009ae0 tx=0x7f14280197f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:20.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.580+0000 7f142dffb640 1 -- 172.21.15.53:0/1144431681 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14280b9640 con 0x7f14380c65e0 2023-06-10T18:53:20.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.580+0000 7f142dffb640 1 -- 172.21.15.53:0/1144431681 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14280b97a0 con 0x7f14380c65e0 2023-06-10T18:53:20.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.580+0000 7f143f6fe640 1 -- 172.21.15.53:0/1144431681 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1438156280 con 0x7f14380c65e0 2023-06-10T18:53:20.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.580+0000 7f142dffb640 1 -- 172.21.15.53:0/1144431681 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14280b9b10 con 0x7f14380c65e0 2023-06-10T18:53:20.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.580+0000 7f143f6fe640 1 -- 172.21.15.53:0/1144431681 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14380c7380 con 0x7f14380c65e0 2023-06-10T18:53:20.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.580+0000 7f143f6fe640 1 -- 172.21.15.53:0/1144431681 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f143804d790 con 0x7f14380c65e0 2023-06-10T18:53:20.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.580+0000 7f142dffb640 1 -- 172.21.15.53:0/1144431681 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f14280a7440 con 0x7f14380c65e0 2023-06-10T18:53:20.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.580+0000 7f142dffb640 1 --2- 172.21.15.53:0/1144431681 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f141c066280 0x7f141c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:20.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.580+0000 7f142dffb640 1 -- 172.21.15.53:0/1144431681 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f142811e6d0 con 0x7f14380c65e0 2023-06-10T18:53:20.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.580+0000 7f143d49a640 1 --2- 172.21.15.53:0/1144431681 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f141c066280 0x7f141c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:20.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.584+0000 7f143d49a640 1 --2- 172.21.15.53:0/1144431681 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f141c066280 0x7f141c068730 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f14340017b0 tx=0x7f1434001480 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:20.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.584+0000 7f142dffb640 1 -- 172.21.15.53:0/1144431681 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f14280ef670 con 0x7f14380c65e0 2023-06-10T18:53:20.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.740+0000 7f143f6fe640 1 -- 172.21.15.53:0/1144431681 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f143806d400 con 0x7f14380c65e0 2023-06-10T18:53:20.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.740+0000 7f142dffb640 1 -- 172.21.15.53:0/1144431681 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f14280ef200 con 0x7f14380c65e0 2023-06-10T18:53:20.750 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-06-10T18:53:20.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.744+0000 7f143f6fe640 1 -- 172.21.15.53:0/1144431681 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f141c066280 msgr2=0x7f141c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:20.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.744+0000 7f143f6fe640 1 --2- 172.21.15.53:0/1144431681 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f141c066280 0x7f141c068730 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f14340017b0 tx=0x7f1434001480 comp rx=0 tx=0).stop 2023-06-10T18:53:20.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.744+0000 7f143f6fe640 1 -- 172.21.15.53:0/1144431681 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f14380c65e0 msgr2=0x7f14380c6a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:20.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.744+0000 7f143f6fe640 1 --2- 172.21.15.53:0/1144431681 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f14380c65e0 0x7f14380c6a50 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1428009ae0 tx=0x7f14280197f0 comp rx=0 tx=0).stop 2023-06-10T18:53:20.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.744+0000 7f143f6fe640 1 -- 172.21.15.53:0/1144431681 shutdown_connections 2023-06-10T18:53:20.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.744+0000 7f143f6fe640 1 --2- 172.21.15.53:0/1144431681 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f141c066280 0x7f141c068730 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:20.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.744+0000 7f143f6fe640 1 --2- 172.21.15.53:0/1144431681 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14380c3930 0x7f14380c3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:20.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.744+0000 7f143f6fe640 1 --2- 172.21.15.53:0/1144431681 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f14380c65e0 0x7f14380c6a50 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:20.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.744+0000 7f143f6fe640 1 --2- 172.21.15.53:0/1144431681 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14240047d0 0x7f1438155d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:20.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.744+0000 7f143f6fe640 1 -- 172.21.15.53:0/1144431681 >> 172.21.15.53:0/1144431681 conn(0x7f143806a560 msgr2=0x7f1438156a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:20.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.744+0000 7f143f6fe640 1 -- 172.21.15.53:0/1144431681 shutdown_connections 2023-06-10T18:53:20.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.744+0000 7f143f6fe640 1 -- 172.21.15.53:0/1144431681 wait complete. 2023-06-10T18:53:20.770 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T18:53:20.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.884+0000 7f4012c54640 1 Processor -- start 2023-06-10T18:53:20.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.884+0000 7f4012c54640 1 -- start start 2023-06-10T18:53:20.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.888+0000 7f4012c54640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f400c0b3390 0x7f400c0af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:20.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.888+0000 7f4012c54640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f400c070e30 0x7f400c0c8d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:20.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.888+0000 7f4012c54640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f400c0c9240 0x7f400c06b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:20.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.888+0000 7f4012c54640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f400c0c82f0 con 0x7f400c070e30 2023-06-10T18:53:20.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.888+0000 7f4012c54640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f400c0b3760 con 0x7f400c0c9240 2023-06-10T18:53:20.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.888+0000 7f4012c54640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f400c071280 con 0x7f400c0b3390 2023-06-10T18:53:20.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.888+0000 7f400bfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f400c070e30 0x7f400c0c8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:20.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.888+0000 7f400bfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f400c070e30 0x7f400c0c8d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40630/0 (socket says 172.21.15.53:40630) 2023-06-10T18:53:20.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.888+0000 7f400bfff640 1 -- 172.21.15.53:0/1619553504 learned_addr learned my addr 172.21.15.53:0/1619553504 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:20.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.888+0000 7f40109f0640 1 --2- 172.21.15.53:0/1619553504 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f400c0b3390 0x7f400c0af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:20.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.888+0000 7f40111f1640 1 --2- 172.21.15.53:0/1619553504 >> v2:172.21.15.117:3300/0 conn(0x7f400c0c9240 0x7f400c06b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:20.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.888+0000 7f400bfff640 1 -- 172.21.15.53:0/1619553504 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f400c0b3390 msgr2=0x7f400c0af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:20.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.888+0000 7f400bfff640 1 --2- 172.21.15.53:0/1619553504 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f400c0b3390 0x7f400c0af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:20.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.888+0000 7f400bfff640 1 -- 172.21.15.53:0/1619553504 >> v2:172.21.15.117:3300/0 conn(0x7f400c0c9240 msgr2=0x7f400c06b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:20.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.888+0000 7f400bfff640 1 --2- 172.21.15.53:0/1619553504 >> v2:172.21.15.117:3300/0 conn(0x7f400c0c9240 0x7f400c06b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:20.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.888+0000 7f400bfff640 1 -- 172.21.15.53:0/1619553504 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f400c0afe20 con 0x7f400c070e30 2023-06-10T18:53:20.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.892+0000 7f400bfff640 1 --2- 172.21.15.53:0/1619553504 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f400c070e30 0x7f400c0c8d00 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f400c06ef50 tx=0x7f3ff401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a60aeae59578fb7 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:20.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.892+0000 7f400b7fe640 1 -- 172.21.15.53:0/1619553504 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff40ac630 con 0x7f400c070e30 2023-06-10T18:53:20.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.892+0000 7f400b7fe640 1 -- 172.21.15.53:0/1619553504 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ff40ac790 con 0x7f400c070e30 2023-06-10T18:53:20.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.892+0000 7f400b7fe640 1 -- 172.21.15.53:0/1619553504 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff40acb20 con 0x7f400c070e30 2023-06-10T18:53:20.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.892+0000 7f4012c54640 1 -- 172.21.15.53:0/1619553504 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f400c070e30 msgr2=0x7f400c0c8d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:20.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.892+0000 7f4012c54640 1 --2- 172.21.15.53:0/1619553504 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f400c070e30 0x7f400c0c8d00 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f400c06ef50 tx=0x7f3ff401c500 comp rx=0 tx=0).stop 2023-06-10T18:53:20.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.892+0000 7f4012c54640 1 -- 172.21.15.53:0/1619553504 shutdown_connections 2023-06-10T18:53:20.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.892+0000 7f4012c54640 1 --2- 172.21.15.53:0/1619553504 >> v2:172.21.15.117:3300/0 conn(0x7f400c0c9240 0x7f400c06b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:20.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.892+0000 7f4012c54640 1 --2- 172.21.15.53:0/1619553504 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f400c070e30 0x7f400c0c8d00 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:20.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.892+0000 7f4012c54640 1 --2- 172.21.15.53:0/1619553504 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f400c0b3390 0x7f400c0af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:20.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.892+0000 7f4012c54640 1 -- 172.21.15.53:0/1619553504 >> 172.21.15.53:0/1619553504 conn(0x7f400c06a0d0 msgr2=0x7f400c0ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:20.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.892+0000 7f4012c54640 1 -- 172.21.15.53:0/1619553504 shutdown_connections 2023-06-10T18:53:20.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.892+0000 7f4012c54640 1 -- 172.21.15.53:0/1619553504 wait complete. 2023-06-10T18:53:20.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.892+0000 7f4012c54640 1 Processor -- start 2023-06-10T18:53:20.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.892+0000 7f4012c54640 1 -- start start 2023-06-10T18:53:20.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.892+0000 7f4012c54640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f400c070e30 0x7f400c14c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:20.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.892+0000 7f4012c54640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f400c0b3390 0x7f400c14ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:20.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.892+0000 7f4012c54640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f400c0c9240 0x7f400c0c2380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:20.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.892+0000 7f4012c54640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f400c0b1580 con 0x7f400c070e30 2023-06-10T18:53:20.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.892+0000 7f4012c54640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f400c0b1820 con 0x7f400c0b3390 2023-06-10T18:53:20.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.892+0000 7f4012c54640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f400c0b1b00 con 0x7f400c0c9240 2023-06-10T18:53:20.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.896+0000 7f40109f0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f400c070e30 0x7f400c14c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:20.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.896+0000 7f40109f0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f400c070e30 0x7f400c14c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40640/0 (socket says 172.21.15.53:40640) 2023-06-10T18:53:20.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.896+0000 7f40109f0640 1 -- 172.21.15.53:0/1912026017 learned_addr learned my addr 172.21.15.53:0/1912026017 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:20.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.896+0000 7f40111f1640 1 --2- 172.21.15.53:0/1912026017 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f400c0c9240 0x7f400c0c2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:20.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.896+0000 7f400bfff640 1 --2- 172.21.15.53:0/1912026017 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f400c0b3390 0x7f400c14ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:20.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.896+0000 7f40109f0640 1 -- 172.21.15.53:0/1912026017 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f400c0c9240 msgr2=0x7f400c0c2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:20.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.896+0000 7f40109f0640 1 --2- 172.21.15.53:0/1912026017 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f400c0c9240 0x7f400c0c2380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:20.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.896+0000 7f40109f0640 1 -- 172.21.15.53:0/1912026017 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f400c0b3390 msgr2=0x7f400c14ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:20.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.896+0000 7f40109f0640 1 --2- 172.21.15.53:0/1912026017 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f400c0b3390 0x7f400c14ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:20.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.896+0000 7f40109f0640 1 -- 172.21.15.53:0/1912026017 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ff40094d0 con 0x7f400c070e30 2023-06-10T18:53:20.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.896+0000 7f400bfff640 1 --2- 172.21.15.53:0/1912026017 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f400c0b3390 0x7f400c14ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:20.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.896+0000 7f40109f0640 1 --2- 172.21.15.53:0/1912026017 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f400c070e30 0x7f400c14c510 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4004007e60 tx=0x7f400400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:20.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.896+0000 7f40097fa640 1 -- 172.21.15.53:0/1912026017 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4004014620 con 0x7f400c070e30 2023-06-10T18:53:20.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.896+0000 7f40097fa640 1 -- 172.21.15.53:0/1912026017 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f400400ee90 con 0x7f400c070e30 2023-06-10T18:53:20.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.896+0000 7f40097fa640 1 -- 172.21.15.53:0/1912026017 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40040149c0 con 0x7f400c070e30 2023-06-10T18:53:20.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.896+0000 7f4012c54640 1 -- 172.21.15.53:0/1912026017 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f400c0b1de0 con 0x7f400c070e30 2023-06-10T18:53:20.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.896+0000 7f4012c54640 1 -- 172.21.15.53:0/1912026017 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f400c14ca50 con 0x7f400c070e30 2023-06-10T18:53:20.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.896+0000 7f4012c54640 1 -- 172.21.15.53:0/1912026017 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f400c04d790 con 0x7f400c070e30 2023-06-10T18:53:20.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.896+0000 7f40097fa640 1 -- 172.21.15.53:0/1912026017 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4004014b20 con 0x7f400c070e30 2023-06-10T18:53:20.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.896+0000 7f40097fa640 1 --2- 172.21.15.53:0/1912026017 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3fec066280 0x7f3fec068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:20.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.896+0000 7f40097fa640 1 -- 172.21.15.53:0/1912026017 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4004084740 con 0x7f400c070e30 2023-06-10T18:53:20.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.896+0000 7f400bfff640 1 --2- 172.21.15.53:0/1912026017 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3fec066280 0x7f3fec068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:20.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.900+0000 7f400bfff640 1 --2- 172.21.15.53:0/1912026017 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3fec066280 0x7f3fec068730 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3ff40ae000 tx=0x7f3ff4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:20.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:20.900+0000 7f40097fa640 1 -- 172.21.15.53:0/1912026017 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4004051b20 con 0x7f400c070e30 2023-06-10T18:53:21.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.056+0000 7f4012c54640 1 -- 172.21.15.53:0/1912026017 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f400c0cb3f0 con 0x7f400c070e30 2023-06-10T18:53:21.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.060+0000 7f40097fa640 1 -- 172.21.15.53:0/1912026017 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18267 (secure 0 0 0) 0x7f4004009a20 con 0x7f400c070e30 2023-06-10T18:53:21.069 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:53:21.069 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":23,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T18:52:45.921586+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-10T18:52:43.396243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-10T18:52:43.894228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T18:53:21.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.060+0000 7f4012c54640 1 -- 172.21.15.53:0/1912026017 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3fec066280 msgr2=0x7f3fec068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:21.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.060+0000 7f4012c54640 1 --2- 172.21.15.53:0/1912026017 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3fec066280 0x7f3fec068730 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3ff40ae000 tx=0x7f3ff4008040 comp rx=0 tx=0).stop 2023-06-10T18:53:21.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.060+0000 7f4012c54640 1 -- 172.21.15.53:0/1912026017 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f400c070e30 msgr2=0x7f400c14c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:21.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.060+0000 7f4012c54640 1 --2- 172.21.15.53:0/1912026017 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f400c070e30 0x7f400c14c510 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4004007e60 tx=0x7f400400e4b0 comp rx=0 tx=0).stop 2023-06-10T18:53:21.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.060+0000 7f4012c54640 1 -- 172.21.15.53:0/1912026017 shutdown_connections 2023-06-10T18:53:21.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.060+0000 7f4012c54640 1 --2- 172.21.15.53:0/1912026017 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3fec066280 0x7f3fec068730 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:21.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.060+0000 7f4012c54640 1 --2- 172.21.15.53:0/1912026017 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f400c0c9240 0x7f400c0c2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:21.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.060+0000 7f4012c54640 1 --2- 172.21.15.53:0/1912026017 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f400c0b3390 0x7f400c14ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:21.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.060+0000 7f4012c54640 1 --2- 172.21.15.53:0/1912026017 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f400c070e30 0x7f400c14c510 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:21.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.060+0000 7f4012c54640 1 -- 172.21.15.53:0/1912026017 >> 172.21.15.53:0/1912026017 conn(0x7f400c06a0d0 msgr2=0x7f400c0b2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:21.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.064+0000 7f4012c54640 1 -- 172.21.15.53:0/1912026017 shutdown_connections 2023-06-10T18:53:21.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.064+0000 7f4012c54640 1 -- 172.21.15.53:0/1912026017 wait complete. 2023-06-10T18:53:21.090 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-10T18:52:33.633114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-10T18:52:39.171487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-10T18:52:43.396243+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-10T18:52:43.894228+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-10T18:53:21.091 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-10T18:53:21.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.216+0000 7fcacd199640 1 Processor -- start 2023-06-10T18:53:21.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.216+0000 7fcacd199640 1 -- start start 2023-06-10T18:53:21.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.216+0000 7fcacd199640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcac815c090 0x7fcac80b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:21.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.216+0000 7fcacd199640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fcac80b0b90 0x7fcac80b7720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:21.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.216+0000 7fcacd199640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcac80cc7c0 con 0x7fcac80b7c60 2023-06-10T18:53:21.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.216+0000 7fcacd199640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcac80b80e0 con 0x7fcac80b0b90 2023-06-10T18:53:21.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.216+0000 7fcacd199640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcac80ccaa0 con 0x7fcac815c090 2023-06-10T18:53:21.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.216+0000 7fcac659c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fcac80b0b90 0x7fcac80b7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:21.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.216+0000 7fcac659c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fcac80b0b90 0x7fcac80b7720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50116/0 (socket says 172.21.15.53:50116) 2023-06-10T18:53:21.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.216+0000 7fcac659c640 1 -- 172.21.15.53:0/1389367837 learned_addr learned my addr 172.21.15.53:0/1389367837 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:21.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.216+0000 7fcac6d9d640 1 --2- 172.21.15.53:0/1389367837 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcac815c090 0x7fcac80b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:21.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.216+0000 7fcac659c640 1 -- 172.21.15.53:0/1389367837 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcac815c090 msgr2=0x7fcac80b10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:21.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.216+0000 7fcac659c640 1 --2- 172.21.15.53:0/1389367837 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcac815c090 0x7fcac80b10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:21.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.216+0000 7fcac659c640 1 -- 172.21.15.53:0/1389367837 >> v1:172.21.15.117:6789/0 conn(0x7fcac80b7c60 legacy=0x7fcac80b3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:21.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.216+0000 7fcac659c640 1 -- 172.21.15.53:0/1389367837 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcac80ccd80 con 0x7fcac80b0b90 2023-06-10T18:53:21.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.220+0000 7fcac659c640 1 --2- 172.21.15.53:0/1389367837 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcac80b0b90 0x7fcac80b7720 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fcabc009870 tx=0x7fcabc01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16f04399140b2e68 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:21.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.220+0000 7fcac5d9b640 1 -- 172.21.15.53:0/1389367837 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcabc0ac600 con 0x7fcac80b0b90 2023-06-10T18:53:21.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.220+0000 7fcac5d9b640 1 -- 172.21.15.53:0/1389367837 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcabc0a8050 con 0x7fcac80b0b90 2023-06-10T18:53:21.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.220+0000 7fcac5d9b640 1 -- 172.21.15.53:0/1389367837 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcabc0ac980 con 0x7fcac80b0b90 2023-06-10T18:53:21.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.220+0000 7fcacd199640 1 -- 172.21.15.53:0/1389367837 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcac80b0b90 msgr2=0x7fcac80b7720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:21.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.220+0000 7fcacd199640 1 --2- 172.21.15.53:0/1389367837 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcac80b0b90 0x7fcac80b7720 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fcabc009870 tx=0x7fcabc01c480 comp rx=0 tx=0).stop 2023-06-10T18:53:21.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.220+0000 7fcacd199640 1 -- 172.21.15.53:0/1389367837 shutdown_connections 2023-06-10T18:53:21.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.220+0000 7fcacd199640 1 --2- 172.21.15.53:0/1389367837 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcac80b0b90 0x7fcac80b7720 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:21.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.220+0000 7fcacd199640 1 --2- 172.21.15.53:0/1389367837 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcac815c090 0x7fcac80b10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:21.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.220+0000 7fcacd199640 1 -- 172.21.15.53:0/1389367837 >> 172.21.15.53:0/1389367837 conn(0x7fcac8069e20 msgr2=0x7fcac806a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:21.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.220+0000 7fcacd199640 1 -- 172.21.15.53:0/1389367837 shutdown_connections 2023-06-10T18:53:21.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.220+0000 7fcacd199640 1 -- 172.21.15.53:0/1389367837 wait complete. 2023-06-10T18:53:21.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.220+0000 7fcacd199640 1 Processor -- start 2023-06-10T18:53:21.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.220+0000 7fcacd199640 1 -- start start 2023-06-10T18:53:21.232 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.220+0000 7fcacd199640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcac80b0b90 0x7fcac80b24b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:21.232 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.220+0000 7fcacd199640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcac80b7c60 0x7fcac80b29f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:21.232 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.220+0000 7fcacd199640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcac815c090 0x7fcac8158500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:21.232 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.220+0000 7fcacd199640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac8157460 con 0x7fcac815c090 2023-06-10T18:53:21.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.220+0000 7fcacd199640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac8157740 con 0x7fcac80b0b90 2023-06-10T18:53:21.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.220+0000 7fcacd199640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcac8157a20 con 0x7fcac80b7c60 2023-06-10T18:53:21.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.224+0000 7fcac759e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcac815c090 0x7fcac8158500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:21.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.224+0000 7fcac759e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcac815c090 0x7fcac8158500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50126/0 (socket says 172.21.15.53:50126) 2023-06-10T18:53:21.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.224+0000 7fcac759e640 1 -- 172.21.15.53:0/3414862945 learned_addr learned my addr 172.21.15.53:0/3414862945 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:21.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.224+0000 7fcac659c640 1 --2- 172.21.15.53:0/3414862945 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcac80b7c60 0x7fcac80b29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:21.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.224+0000 7fcac6d9d640 1 --2- 172.21.15.53:0/3414862945 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcac80b0b90 0x7fcac80b24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:21.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.224+0000 7fcac759e640 1 -- 172.21.15.53:0/3414862945 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcac80b7c60 msgr2=0x7fcac80b29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:21.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.224+0000 7fcac759e640 1 --2- 172.21.15.53:0/3414862945 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcac80b7c60 0x7fcac80b29f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:21.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.224+0000 7fcac759e640 1 -- 172.21.15.53:0/3414862945 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcac80b0b90 msgr2=0x7fcac80b24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:21.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.224+0000 7fcac759e640 1 --2- 172.21.15.53:0/3414862945 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcac80b0b90 0x7fcac80b24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:21.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.224+0000 7fcac759e640 1 -- 172.21.15.53:0/3414862945 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcabc0094d0 con 0x7fcac815c090 2023-06-10T18:53:21.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.224+0000 7fcac759e640 1 --2- 172.21.15.53:0/3414862945 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcac815c090 0x7fcac8158500 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fcac000c770 tx=0x7fcac000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:21.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.224+0000 7fcaaf7fe640 1 -- 172.21.15.53:0/3414862945 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac0003b80 con 0x7fcac815c090 2023-06-10T18:53:21.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.224+0000 7fcaaf7fe640 1 -- 172.21.15.53:0/3414862945 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac0003ce0 con 0x7fcac815c090 2023-06-10T18:53:21.235 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.224+0000 7fcacd199640 1 -- 172.21.15.53:0/3414862945 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcac8157d00 con 0x7fcac815c090 2023-06-10T18:53:21.235 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.224+0000 7fcaaf7fe640 1 -- 172.21.15.53:0/3414862945 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac000aa90 con 0x7fcac815c090 2023-06-10T18:53:21.235 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.224+0000 7fcacd199640 1 -- 172.21.15.53:0/3414862945 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcac814b9d0 con 0x7fcac815c090 2023-06-10T18:53:21.235 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.224+0000 7fcacd199640 1 -- 172.21.15.53:0/3414862945 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcac804d790 con 0x7fcac815c090 2023-06-10T18:53:21.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.224+0000 7fcaaf7fe640 1 -- 172.21.15.53:0/3414862945 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcac000abf0 con 0x7fcac815c090 2023-06-10T18:53:21.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.224+0000 7fcaaf7fe640 1 --2- 172.21.15.53:0/3414862945 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcab4066280 0x7fcab4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:21.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.224+0000 7fcaaf7fe640 1 -- 172.21.15.53:0/3414862945 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcac0083be0 con 0x7fcac815c090 2023-06-10T18:53:21.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.224+0000 7fcac6d9d640 1 --2- 172.21.15.53:0/3414862945 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcab4066280 0x7fcab4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:21.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.224+0000 7fcac6d9d640 1 --2- 172.21.15.53:0/3414862945 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcab4066280 0x7fcab4068730 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fcab800b930 tx=0x7fcab8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:21.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.228+0000 7fcaaf7fe640 1 -- 172.21.15.53:0/3414862945 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcac0051060 con 0x7fcac815c090 2023-06-10T18:53:21.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.384+0000 7fcacd199640 1 -- 172.21.15.53:0/3414862945 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcac81581b0 con 0x7fcac815c090 2023-06-10T18:53:21.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.384+0000 7fcaaf7fe640 1 -- 172.21.15.53:0/3414862945 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcac0054680 con 0x7fcac815c090 2023-06-10T18:53:21.394 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-06-10T18:53:21.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.388+0000 7fcacd199640 1 -- 172.21.15.53:0/3414862945 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcab4066280 msgr2=0x7fcab4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:21.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.388+0000 7fcacd199640 1 --2- 172.21.15.53:0/3414862945 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcab4066280 0x7fcab4068730 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fcab800b930 tx=0x7fcab8008040 comp rx=0 tx=0).stop 2023-06-10T18:53:21.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.388+0000 7fcacd199640 1 -- 172.21.15.53:0/3414862945 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcac815c090 msgr2=0x7fcac8158500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:21.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.388+0000 7fcacd199640 1 --2- 172.21.15.53:0/3414862945 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcac815c090 0x7fcac8158500 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fcac000c770 tx=0x7fcac000cc30 comp rx=0 tx=0).stop 2023-06-10T18:53:21.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.388+0000 7fcacd199640 1 -- 172.21.15.53:0/3414862945 shutdown_connections 2023-06-10T18:53:21.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.388+0000 7fcacd199640 1 --2- 172.21.15.53:0/3414862945 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcab4066280 0x7fcab4068730 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:21.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.388+0000 7fcacd199640 1 --2- 172.21.15.53:0/3414862945 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcac815c090 0x7fcac8158500 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:21.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.388+0000 7fcacd199640 1 --2- 172.21.15.53:0/3414862945 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcac80b7c60 0x7fcac80b29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:21.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.388+0000 7fcacd199640 1 --2- 172.21.15.53:0/3414862945 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcac80b0b90 0x7fcac80b24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:21.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.388+0000 7fcacd199640 1 -- 172.21.15.53:0/3414862945 >> 172.21.15.53:0/3414862945 conn(0x7fcac8069e20 msgr2=0x7fcac806a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:21.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.388+0000 7fcacd199640 1 -- 172.21.15.53:0/3414862945 shutdown_connections 2023-06-10T18:53:21.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.388+0000 7fcacd199640 1 -- 172.21.15.53:0/3414862945 wait complete. 2023-06-10T18:53:21.413 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-10T18:53:21.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.524+0000 7f456509d640 1 Processor -- start 2023-06-10T18:53:21.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.524+0000 7f456509d640 1 -- start start 2023-06-10T18:53:21.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.528+0000 7f456509d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f45600afe70 0x7f45600c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:21.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.528+0000 7f456509d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f456006b090 con 0x7f45600c82a0 2023-06-10T18:53:21.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.528+0000 7f456509d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45600ca370 con 0x7f45600c9fa0 2023-06-10T18:53:21.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.528+0000 7f456509d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4560070d50 con 0x7f45600afe70 2023-06-10T18:53:21.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.528+0000 7f455e59c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f45600c82a0 0x7f45600af760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:37206/0 (socket says 172.21.15.53:37206) 2023-06-10T18:53:21.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.528+0000 7f455e59c640 1 -- 172.21.15.53:0/2169290483 learned_addr learned my addr 172.21.15.53:0/2169290483 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:53:21.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.528+0000 7f455f59e640 1 --2- 172.21.15.53:0/2169290483 >> v2:172.21.15.53:3300/0 conn(0x7f45600afe70 0x7f45600c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:21.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.528+0000 7f455dd9b640 1 -- 172.21.15.53:0/2169290483 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3552443825 0 0) 0x7f456006b090 con 0x7f45600c82a0 2023-06-10T18:53:21.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.528+0000 7f455dd9b640 1 -- 172.21.15.53:0/2169290483 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f454c003530 con 0x7f45600c82a0 2023-06-10T18:53:21.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.528+0000 7f455f59e640 1 -- 172.21.15.53:0/2169290483 >> v1:172.21.15.117:6789/0 conn(0x7f45600c9fa0 legacy=0x7f456006bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:21.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.528+0000 7f455f59e640 1 -- 172.21.15.53:0/2169290483 >> v1:172.21.15.53:6789/0 conn(0x7f45600c82a0 legacy=0x7f45600af760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:21.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.528+0000 7f455dd9b640 1 -- 172.21.15.53:0/2169290483 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1411513003 0 0) 0x7f454c003530 con 0x7f45600c82a0 2023-06-10T18:53:21.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.528+0000 7f455f59e640 1 -- 172.21.15.53:0/2169290483 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4560071030 con 0x7f45600afe70 2023-06-10T18:53:21.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.532+0000 7f455f59e640 1 --2- 172.21.15.53:0/2169290483 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45600afe70 0x7f45600c86f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4550009d90 tx=0x7f455001c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55236063368e2531 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:21.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.532+0000 7f455dd9b640 1 -- 172.21.15.53:0/2169290483 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4548001680 con 0x7f45600afe70 2023-06-10T18:53:21.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.532+0000 7f455dd9b640 1 -- 172.21.15.53:0/2169290483 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45500a55f0 con 0x7f45600afe70 2023-06-10T18:53:21.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.532+0000 7f455dd9b640 1 -- 172.21.15.53:0/2169290483 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45500a5960 con 0x7f45600afe70 2023-06-10T18:53:21.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.532+0000 7f456509d640 1 -- 172.21.15.53:0/2169290483 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45600afe70 msgr2=0x7f45600c86f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:21.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.532+0000 7f456509d640 1 --2- 172.21.15.53:0/2169290483 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45600afe70 0x7f45600c86f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4550009d90 tx=0x7f455001c7b0 comp rx=0 tx=0).stop 2023-06-10T18:53:21.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.532+0000 7f456509d640 1 -- 172.21.15.53:0/2169290483 shutdown_connections 2023-06-10T18:53:21.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.532+0000 7f456509d640 1 --2- 172.21.15.53:0/2169290483 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45600afe70 0x7f45600c86f0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:21.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.532+0000 7f456509d640 1 -- 172.21.15.53:0/2169290483 >> 172.21.15.53:0/2169290483 conn(0x7f456006a0e0 msgr2=0x7f45600cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:21.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.532+0000 7f456509d640 1 -- 172.21.15.53:0/2169290483 shutdown_connections 2023-06-10T18:53:21.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.532+0000 7f456509d640 1 -- 172.21.15.53:0/2169290483 wait complete. 2023-06-10T18:53:21.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.532+0000 7f456509d640 1 Processor -- start 2023-06-10T18:53:21.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.532+0000 7f456509d640 1 -- start start 2023-06-10T18:53:21.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.532+0000 7f456509d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45600afe70 0x7f45600c0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:21.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.532+0000 7f456509d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45600c82a0 0x7f45600c28a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:21.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.532+0000 7f456509d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45600c9fa0 0x7f4560156330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:21.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.532+0000 7f456509d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45600c2170 con 0x7f45600afe70 2023-06-10T18:53:21.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.532+0000 7f456509d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45600c70d0 con 0x7f45600c9fa0 2023-06-10T18:53:21.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.532+0000 7f456509d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45600c4970 con 0x7f45600c82a0 2023-06-10T18:53:21.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.532+0000 7f455ed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45600afe70 0x7f45600c0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:21.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.532+0000 7f455ed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45600afe70 0x7f45600c0bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50146/0 (socket says 172.21.15.53:50146) 2023-06-10T18:53:21.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.532+0000 7f455ed9d640 1 -- 172.21.15.53:0/3779627227 learned_addr learned my addr 172.21.15.53:0/3779627227 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:21.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.532+0000 7f455e59c640 1 --2- 172.21.15.53:0/3779627227 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45600c82a0 0x7f45600c28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:21.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.532+0000 7f455f59e640 1 --2- 172.21.15.53:0/3779627227 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45600c9fa0 0x7f4560156330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:21.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.532+0000 7f455ed9d640 1 -- 172.21.15.53:0/3779627227 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45600c82a0 msgr2=0x7f45600c28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:21.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.532+0000 7f455ed9d640 1 --2- 172.21.15.53:0/3779627227 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45600c82a0 0x7f45600c28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:21.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.532+0000 7f455ed9d640 1 -- 172.21.15.53:0/3779627227 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45600c9fa0 msgr2=0x7f4560156330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:21.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.532+0000 7f455ed9d640 1 --2- 172.21.15.53:0/3779627227 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45600c9fa0 0x7f4560156330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:21.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.532+0000 7f455ed9d640 1 -- 172.21.15.53:0/3779627227 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4550009a70 con 0x7f45600afe70 2023-06-10T18:53:21.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.532+0000 7f455e59c640 1 --2- 172.21.15.53:0/3779627227 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45600c82a0 0x7f45600c28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:21.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.532+0000 7f455f59e640 1 --2- 172.21.15.53:0/3779627227 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45600c9fa0 0x7f4560156330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:21.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.532+0000 7f455ed9d640 1 --2- 172.21.15.53:0/3779627227 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45600afe70 0x7f45600c0bc0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f455800c3c0 tx=0x7f455800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:21.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.536+0000 7f45577fe640 1 -- 172.21.15.53:0/3779627227 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45580052d0 con 0x7f45600afe70 2023-06-10T18:53:21.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.536+0000 7f45577fe640 1 -- 172.21.15.53:0/3779627227 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4558005430 con 0x7f45600afe70 2023-06-10T18:53:21.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.536+0000 7f456509d640 1 -- 172.21.15.53:0/3779627227 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45600c2380 con 0x7f45600afe70 2023-06-10T18:53:21.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.536+0000 7f45577fe640 1 -- 172.21.15.53:0/3779627227 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4558003840 con 0x7f45600afe70 2023-06-10T18:53:21.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.536+0000 7f456509d640 1 -- 172.21.15.53:0/3779627227 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45601526f0 con 0x7f45600afe70 2023-06-10T18:53:21.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.536+0000 7f456509d640 1 -- 172.21.15.53:0/3779627227 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45600b3cc0 con 0x7f45600afe70 2023-06-10T18:53:21.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.536+0000 7f45577fe640 1 -- 172.21.15.53:0/3779627227 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f45580039a0 con 0x7f45600afe70 2023-06-10T18:53:21.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.536+0000 7f45577fe640 1 --2- 172.21.15.53:0/3779627227 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4540066280 0x7f4540068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:21.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.536+0000 7f45577fe640 1 -- 172.21.15.53:0/3779627227 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4558083630 con 0x7f45600afe70 2023-06-10T18:53:21.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.536+0000 7f455e59c640 1 --2- 172.21.15.53:0/3779627227 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4540066280 0x7f4540068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:21.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.536+0000 7f455e59c640 1 --2- 172.21.15.53:0/3779627227 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4540066280 0x7f4540068730 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4560151f90 tx=0x7f4548009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:21.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.540+0000 7f45577fe640 1 -- 172.21.15.53:0/3779627227 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4558050b90 con 0x7f45600afe70 2023-06-10T18:53:21.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.692+0000 7f456509d640 1 -- 172.21.15.53:0/3779627227 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f45600c8a10 con 0x7f45600afe70 2023-06-10T18:53:21.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.696+0000 7f45577fe640 1 -- 172.21.15.53:0/3779627227 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f45580541b0 con 0x7f45600afe70 2023-06-10T18:53:21.704 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-06-10T18:53:21.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.696+0000 7f456509d640 1 -- 172.21.15.53:0/3779627227 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4540066280 msgr2=0x7f4540068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:21.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.696+0000 7f456509d640 1 --2- 172.21.15.53:0/3779627227 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4540066280 0x7f4540068730 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4560151f90 tx=0x7f4548009040 comp rx=0 tx=0).stop 2023-06-10T18:53:21.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.696+0000 7f456509d640 1 -- 172.21.15.53:0/3779627227 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45600afe70 msgr2=0x7f45600c0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:21.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.696+0000 7f456509d640 1 --2- 172.21.15.53:0/3779627227 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45600afe70 0x7f45600c0bc0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f455800c3c0 tx=0x7f455800c880 comp rx=0 tx=0).stop 2023-06-10T18:53:21.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.696+0000 7f456509d640 1 -- 172.21.15.53:0/3779627227 shutdown_connections 2023-06-10T18:53:21.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.696+0000 7f456509d640 1 --2- 172.21.15.53:0/3779627227 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4540066280 0x7f4540068730 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:21.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.696+0000 7f456509d640 1 --2- 172.21.15.53:0/3779627227 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45600c9fa0 0x7f4560156330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:21.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.696+0000 7f456509d640 1 --2- 172.21.15.53:0/3779627227 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45600c82a0 0x7f45600c28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:21.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.696+0000 7f456509d640 1 --2- 172.21.15.53:0/3779627227 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45600afe70 0x7f45600c0bc0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:21.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.696+0000 7f456509d640 1 -- 172.21.15.53:0/3779627227 >> 172.21.15.53:0/3779627227 conn(0x7f456006a0e0 msgr2=0x7f45600cda30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:21.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.696+0000 7f456509d640 1 -- 172.21.15.53:0/3779627227 shutdown_connections 2023-06-10T18:53:21.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.696+0000 7f456509d640 1 -- 172.21.15.53:0/3779627227 wait complete. 2023-06-10T18:53:21.723 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-10T18:53:21.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.844+0000 7f1e06f64640 1 Processor -- start 2023-06-10T18:53:21.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.844+0000 7f1e06f64640 1 -- start start 2023-06-10T18:53:21.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.844+0000 7f1e06f64640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1e00070de0 0x7f1e0015cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:21.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.844+0000 7f1e06f64640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e000c8d50 con 0x7f1e0015c060 2023-06-10T18:53:21.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.844+0000 7f1e06f64640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e000c9030 con 0x7f1e000cc020 2023-06-10T18:53:21.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.844+0000 7f1e06f64640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e00070300 con 0x7f1e00070de0 2023-06-10T18:53:21.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.844+0000 7f1dfffff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1e00070de0 0x7f1e0015cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:21.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.844+0000 7f1e04d00640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f1e0015c060 0x7f1e0015c430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:37220/0 (socket says 172.21.15.53:37220) 2023-06-10T18:53:21.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.844+0000 7f1e04d00640 1 -- 172.21.15.53:0/3697341477 learned_addr learned my addr 172.21.15.53:0/3697341477 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:53:21.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.844+0000 7f1dff7fe640 1 -- 172.21.15.53:0/3697341477 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2870346414 0 0) 0x7f1e000c8d50 con 0x7f1e0015c060 2023-06-10T18:53:21.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.844+0000 7f1dff7fe640 1 -- 172.21.15.53:0/3697341477 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1dec005740 con 0x7f1e0015c060 2023-06-10T18:53:21.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.844+0000 7f1dfffff640 1 -- 172.21.15.53:0/3697341477 >> v1:172.21.15.117:6789/0 conn(0x7f1e000cc020 legacy=0x7f1e0006bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:21.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.844+0000 7f1dfffff640 1 -- 172.21.15.53:0/3697341477 >> v1:172.21.15.53:6789/0 conn(0x7f1e0015c060 legacy=0x7f1e0015c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:21.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.844+0000 7f1dfffff640 1 -- 172.21.15.53:0/3697341477 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e000705e0 con 0x7f1e00070de0 2023-06-10T18:53:21.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.848+0000 7f1dfffff640 1 --2- 172.21.15.53:0/3697341477 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e00070de0 0x7f1e0015cb40 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1de80097c0 tx=0x7f1de801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a663246ed4a19a server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:21.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.848+0000 7f1dff7fe640 1 -- 172.21.15.53:0/3697341477 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de80ab600 con 0x7f1e00070de0 2023-06-10T18:53:21.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.848+0000 7f1dff7fe640 1 -- 172.21.15.53:0/3697341477 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1de80a7050 con 0x7f1e00070de0 2023-06-10T18:53:21.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.848+0000 7f1dff7fe640 1 -- 172.21.15.53:0/3697341477 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de80ab980 con 0x7f1e00070de0 2023-06-10T18:53:21.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.848+0000 7f1e06f64640 1 -- 172.21.15.53:0/3697341477 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e00070de0 msgr2=0x7f1e0015cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:21.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.848+0000 7f1e06f64640 1 --2- 172.21.15.53:0/3697341477 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e00070de0 0x7f1e0015cb40 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1de80097c0 tx=0x7f1de801c3f0 comp rx=0 tx=0).stop 2023-06-10T18:53:21.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.848+0000 7f1e06f64640 1 -- 172.21.15.53:0/3697341477 shutdown_connections 2023-06-10T18:53:21.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.848+0000 7f1e06f64640 1 --2- 172.21.15.53:0/3697341477 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e00070de0 0x7f1e0015cb40 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:21.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.848+0000 7f1e06f64640 1 -- 172.21.15.53:0/3697341477 >> 172.21.15.53:0/3697341477 conn(0x7f1e0006a0e0 msgr2=0x7f1e000cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:21.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.848+0000 7f1e06f64640 1 -- 172.21.15.53:0/3697341477 shutdown_connections 2023-06-10T18:53:21.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.848+0000 7f1e06f64640 1 -- 172.21.15.53:0/3697341477 wait complete. 2023-06-10T18:53:21.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.852+0000 7f1e06f64640 1 Processor -- start 2023-06-10T18:53:21.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.852+0000 7f1e06f64640 1 -- start start 2023-06-10T18:53:21.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.852+0000 7f1e06f64640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e00070de0 0x7f1e00144380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:21.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.852+0000 7f1e06f64640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e000cc020 0x7f1e000b1970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:21.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.852+0000 7f1e06f64640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e0015c060 0x7f1e001507c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:21.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.852+0000 7f1e06f64640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e000b2370 con 0x7f1e00070de0 2023-06-10T18:53:21.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.852+0000 7f1e06f64640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e000b2650 con 0x7f1e000cc020 2023-06-10T18:53:21.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.852+0000 7f1e06f64640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e000b2930 con 0x7f1e0015c060 2023-06-10T18:53:21.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.852+0000 7f1e04d00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e00070de0 0x7f1e00144380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:21.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.852+0000 7f1e04d00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e00070de0 0x7f1e00144380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50160/0 (socket says 172.21.15.53:50160) 2023-06-10T18:53:21.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.852+0000 7f1e04d00640 1 -- 172.21.15.53:0/1416405486 learned_addr learned my addr 172.21.15.53:0/1416405486 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:21.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.852+0000 7f1e05501640 1 --2- 172.21.15.53:0/1416405486 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e0015c060 0x7f1e001507c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:21.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.852+0000 7f1dfffff640 1 --2- 172.21.15.53:0/1416405486 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e000cc020 0x7f1e000b1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:21.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.852+0000 7f1e04d00640 1 -- 172.21.15.53:0/1416405486 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e0015c060 msgr2=0x7f1e001507c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:21.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.852+0000 7f1e04d00640 1 --2- 172.21.15.53:0/1416405486 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e0015c060 0x7f1e001507c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:21.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.852+0000 7f1e04d00640 1 -- 172.21.15.53:0/1416405486 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e000cc020 msgr2=0x7f1e000b1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:21.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.852+0000 7f1e04d00640 1 --2- 172.21.15.53:0/1416405486 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e000cc020 0x7f1e000b1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:21.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.852+0000 7f1e04d00640 1 -- 172.21.15.53:0/1416405486 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de8009420 con 0x7f1e00070de0 2023-06-10T18:53:21.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.852+0000 7f1dfffff640 1 --2- 172.21.15.53:0/1416405486 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e000cc020 0x7f1e000b1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:21.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.852+0000 7f1e04d00640 1 --2- 172.21.15.53:0/1416405486 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e00070de0 0x7f1e00144380 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1df800cbc0 tx=0x7f1df800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:21.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.852+0000 7f1dfd7fa640 1 -- 172.21.15.53:0/1416405486 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df800ad40 con 0x7f1e00070de0 2023-06-10T18:53:21.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.852+0000 7f1dfd7fa640 1 -- 172.21.15.53:0/1416405486 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1df8012400 con 0x7f1e00070de0 2023-06-10T18:53:21.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.852+0000 7f1e06f64640 1 -- 172.21.15.53:0/1416405486 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e000b2c10 con 0x7f1e00070de0 2023-06-10T18:53:21.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.852+0000 7f1dfd7fa640 1 -- 172.21.15.53:0/1416405486 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df800aea0 con 0x7f1e00070de0 2023-06-10T18:53:21.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.852+0000 7f1e06f64640 1 -- 172.21.15.53:0/1416405486 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e000b1eb0 con 0x7f1e00070de0 2023-06-10T18:53:21.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.852+0000 7f1e06f64640 1 -- 172.21.15.53:0/1416405486 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e0004d790 con 0x7f1e00070de0 2023-06-10T18:53:21.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.852+0000 7f1dfd7fa640 1 -- 172.21.15.53:0/1416405486 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1df8007070 con 0x7f1e00070de0 2023-06-10T18:53:21.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.856+0000 7f1dfd7fa640 1 --2- 172.21.15.53:0/1416405486 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1de0066280 0x7f1de0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:21.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.856+0000 7f1dfd7fa640 1 -- 172.21.15.53:0/1416405486 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1df8083e80 con 0x7f1e00070de0 2023-06-10T18:53:21.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.856+0000 7f1dfffff640 1 --2- 172.21.15.53:0/1416405486 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1de0066280 0x7f1de0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:21.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.856+0000 7f1dfffff640 1 --2- 172.21.15.53:0/1416405486 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1de0066280 0x7f1de0068730 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1de80ad000 tx=0x7f1de8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:21.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:21.860+0000 7f1dfd7fa640 1 -- 172.21.15.53:0/1416405486 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1df80511d0 con 0x7f1e00070de0 2023-06-10T18:53:22.022 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.012+0000 7f1e06f64640 1 -- 172.21.15.53:0/1416405486 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1e00158a70 con 0x7f1e00070de0 2023-06-10T18:53:22.023 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.012+0000 7f1dfd7fa640 1 -- 172.21.15.53:0/1416405486 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1df80170a0 con 0x7f1e00070de0 2023-06-10T18:53:22.023 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-06-10T18:53:22.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.016+0000 7f1e06f64640 1 -- 172.21.15.53:0/1416405486 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1de0066280 msgr2=0x7f1de0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:22.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.016+0000 7f1e06f64640 1 --2- 172.21.15.53:0/1416405486 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1de0066280 0x7f1de0068730 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1de80ad000 tx=0x7f1de8008040 comp rx=0 tx=0).stop 2023-06-10T18:53:22.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.016+0000 7f1e06f64640 1 -- 172.21.15.53:0/1416405486 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e00070de0 msgr2=0x7f1e00144380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:22.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.016+0000 7f1e06f64640 1 --2- 172.21.15.53:0/1416405486 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e00070de0 0x7f1e00144380 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1df800cbc0 tx=0x7f1df800a430 comp rx=0 tx=0).stop 2023-06-10T18:53:22.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.016+0000 7f1e06f64640 1 -- 172.21.15.53:0/1416405486 shutdown_connections 2023-06-10T18:53:22.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.016+0000 7f1e06f64640 1 --2- 172.21.15.53:0/1416405486 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1de0066280 0x7f1de0068730 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:22.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.016+0000 7f1e06f64640 1 --2- 172.21.15.53:0/1416405486 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e0015c060 0x7f1e001507c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:22.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.016+0000 7f1e06f64640 1 --2- 172.21.15.53:0/1416405486 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e000cc020 0x7f1e000b1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:22.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.016+0000 7f1e06f64640 1 --2- 172.21.15.53:0/1416405486 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e00070de0 0x7f1e00144380 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:22.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.016+0000 7f1e06f64640 1 -- 172.21.15.53:0/1416405486 >> 172.21.15.53:0/1416405486 conn(0x7f1e0006a0e0 msgr2=0x7f1e000ca6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:22.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.016+0000 7f1e06f64640 1 -- 172.21.15.53:0/1416405486 shutdown_connections 2023-06-10T18:53:22.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.016+0000 7f1e06f64640 1 -- 172.21.15.53:0/1416405486 wait complete. 2023-06-10T18:53:22.042 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-10T18:53:22.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.156+0000 7f9630889640 1 Processor -- start 2023-06-10T18:53:22.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.156+0000 7f9630889640 1 -- start start 2023-06-10T18:53:22.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.160+0000 7f9630889640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f962c0b7e30 0x7f962c0b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:22.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.160+0000 7f9630889640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f962c0cc7c0 con 0x7f962c15c090 2023-06-10T18:53:22.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.160+0000 7f9630889640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f962c0ccaa0 con 0x7f962c0b0b90 2023-06-10T18:53:22.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.160+0000 7f9630889640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f962c0ccd80 con 0x7f962c0b7e30 2023-06-10T18:53:22.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.160+0000 7f962a59c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f962c15c090 0x7f962c0b7720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:37230/0 (socket says 172.21.15.53:37230) 2023-06-10T18:53:22.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.160+0000 7f962a59c640 1 -- 172.21.15.53:0/444857293 learned_addr learned my addr 172.21.15.53:0/444857293 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:53:22.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.160+0000 7f9629d9b640 1 --2- 172.21.15.53:0/444857293 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f962c0b7e30 0x7f962c0b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:22.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.160+0000 7f962959a640 1 -- 172.21.15.53:0/444857293 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3426165920 0 0) 0x7f962c0cc7c0 con 0x7f962c15c090 2023-06-10T18:53:22.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.160+0000 7f962959a640 1 -- 172.21.15.53:0/444857293 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9614003530 con 0x7f962c15c090 2023-06-10T18:53:22.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.160+0000 7f962959a640 1 -- 172.21.15.53:0/444857293 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4103282093 0 0) 0x7f9614003530 con 0x7f962c15c090 2023-06-10T18:53:22.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.160+0000 7f962959a640 1 -- 172.21.15.53:0/444857293 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f962c0b7e30 msgr2=0x7f962c0b10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:22.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.160+0000 7f962959a640 1 --2- 172.21.15.53:0/444857293 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f962c0b7e30 0x7f962c0b10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:22.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.160+0000 7f962959a640 1 -- 172.21.15.53:0/444857293 >> v1:172.21.15.117:6789/0 conn(0x7f962c0b0b90 legacy=0x7f962c0d04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:22.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.160+0000 7f962959a640 1 -- 172.21.15.53:0/444857293 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f962c0cd060 con 0x7f962c15c090 2023-06-10T18:53:22.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.160+0000 7f962959a640 1 -- 172.21.15.53:0/444857293 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f961c001a00 con 0x7f962c15c090 2023-06-10T18:53:22.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.160+0000 7f962959a640 1 -- 172.21.15.53:0/444857293 >> v1:172.21.15.53:6789/0 conn(0x7f962c15c090 legacy=0x7f962c0b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:22.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.160+0000 7f962959a640 1 --2- 172.21.15.53:0/444857293 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f962c0b7e30 0x7f96140039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:22.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.160+0000 7f962959a640 1 --2- 172.21.15.53:0/444857293 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9614003f30 0x7f96140047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:22.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.160+0000 7f962959a640 1 --2- 172.21.15.53:0/444857293 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9614004d10 0x7f9614005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:22.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.160+0000 7f962959a640 1 -- 172.21.15.53:0/444857293 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f962c0ccd80 con 0x7f9614003f30 2023-06-10T18:53:22.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.160+0000 7f962959a640 1 -- 172.21.15.53:0/444857293 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f961400bb20 con 0x7f9614004d10 2023-06-10T18:53:22.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.160+0000 7f962959a640 1 -- 172.21.15.53:0/444857293 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f961400bce0 con 0x7f962c0b7e30 2023-06-10T18:53:22.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.160+0000 7f9629d9b640 1 --2- 172.21.15.53:0/444857293 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9614003f30 0x7f96140047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:22.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.160+0000 7f962a59c640 1 --2- 172.21.15.53:0/444857293 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f962c0b7e30 0x7f96140039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:22.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.160+0000 7f9629d9b640 1 -- 172.21.15.53:0/444857293 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f962c0b7e30 msgr2=0x7f96140039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:22.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.160+0000 7f9629d9b640 1 --2- 172.21.15.53:0/444857293 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f962c0b7e30 0x7f96140039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:22.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.160+0000 7f9629d9b640 1 -- 172.21.15.53:0/444857293 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9614004d10 msgr2=0x7f9614005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:22.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.160+0000 7f962ad9d640 1 --2- 172.21.15.53:0/444857293 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9614004d10 0x7f9614005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:22.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.160+0000 7f9629d9b640 1 --2- 172.21.15.53:0/444857293 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9614004d10 0x7f9614005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:22.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.160+0000 7f9629d9b640 1 -- 172.21.15.53:0/444857293 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9614003530 con 0x7f9614003f30 2023-06-10T18:53:22.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.160+0000 7f962ad9d640 1 --2- 172.21.15.53:0/444857293 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9614004d10 0x7f9614005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:22.175 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.160+0000 7f9629d9b640 1 --2- 172.21.15.53:0/444857293 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9614003f30 0x7f96140047d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f962c0b8220 tx=0x7f962001c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb0d0773dc97e44d server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:22.175 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.160+0000 7f962959a640 1 -- 172.21.15.53:0/444857293 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96200a64b0 con 0x7f9614003f30 2023-06-10T18:53:22.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.160+0000 7f962959a640 1 -- 172.21.15.53:0/444857293 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96200a6610 con 0x7f9614003f30 2023-06-10T18:53:22.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.160+0000 7f962959a640 1 -- 172.21.15.53:0/444857293 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96200a69c0 con 0x7f9614003f30 2023-06-10T18:53:22.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.164+0000 7f9630889640 1 -- 172.21.15.53:0/444857293 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9614003f30 msgr2=0x7f96140047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:22.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.164+0000 7f9630889640 1 --2- 172.21.15.53:0/444857293 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9614003f30 0x7f96140047d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f962c0b8220 tx=0x7f962001c9c0 comp rx=0 tx=0).stop 2023-06-10T18:53:22.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.164+0000 7f962ad9d640 1 -- 172.21.15.53:0/444857293 reap_dead start 2023-06-10T18:53:22.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.164+0000 7f9630889640 1 -- 172.21.15.53:0/444857293 shutdown_connections 2023-06-10T18:53:22.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.164+0000 7f9630889640 1 -- 172.21.15.53:0/444857293 >> 172.21.15.53:0/444857293 conn(0x7f962c069e20 msgr2=0x7f962c06a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:22.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.164+0000 7f9630889640 1 -- 172.21.15.53:0/444857293 shutdown_connections 2023-06-10T18:53:22.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.164+0000 7f9630889640 1 -- 172.21.15.53:0/444857293 wait complete. 2023-06-10T18:53:22.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.164+0000 7f9630889640 1 Processor -- start 2023-06-10T18:53:22.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.164+0000 7f9630889640 1 -- start start 2023-06-10T18:53:22.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.164+0000 7f9630889640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f962c14a980 0x7f962c14fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:22.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.164+0000 7f9630889640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f962c0c5c00 0x7f962c153120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:22.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.164+0000 7f9630889640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f962c150410 0x7f962c153660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:22.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.164+0000 7f9630889640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f962c14ad50 con 0x7f962c0c5c00 2023-06-10T18:53:22.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.164+0000 7f9630889640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f962c0ca940 con 0x7f962c150410 2023-06-10T18:53:22.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.164+0000 7f9630889640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f962c15a950 con 0x7f962c14a980 2023-06-10T18:53:22.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.164+0000 7f9629d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f962c0c5c00 0x7f962c153120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:22.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.164+0000 7f9629d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f962c0c5c00 0x7f962c153120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50180/0 (socket says 172.21.15.53:50180) 2023-06-10T18:53:22.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.164+0000 7f9629d9b640 1 -- 172.21.15.53:0/3595839758 learned_addr learned my addr 172.21.15.53:0/3595839758 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:22.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.164+0000 7f962a59c640 1 --2- 172.21.15.53:0/3595839758 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f962c14a980 0x7f962c14fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:22.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.164+0000 7f962ad9d640 1 --2- 172.21.15.53:0/3595839758 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f962c150410 0x7f962c153660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:22.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.164+0000 7f9629d9b640 1 -- 172.21.15.53:0/3595839758 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f962c14a980 msgr2=0x7f962c14fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:22.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.164+0000 7f9629d9b640 1 --2- 172.21.15.53:0/3595839758 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f962c14a980 0x7f962c14fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:22.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.164+0000 7f9629d9b640 1 -- 172.21.15.53:0/3595839758 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f962c150410 msgr2=0x7f962c153660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:22.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.164+0000 7f9629d9b640 1 --2- 172.21.15.53:0/3595839758 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f962c150410 0x7f962c153660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:22.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.164+0000 7f9629d9b640 1 -- 172.21.15.53:0/3595839758 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f962c15ac30 con 0x7f962c0c5c00 2023-06-10T18:53:22.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.164+0000 7f962ad9d640 1 --2- 172.21.15.53:0/3595839758 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f962c150410 0x7f962c153660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:22.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.164+0000 7f9629d9b640 1 --2- 172.21.15.53:0/3595839758 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f962c0c5c00 0x7f962c153120 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f962001cea0 tx=0x7f9614005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:22.180 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.164+0000 7f961affd640 1 -- 172.21.15.53:0/3595839758 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96200a64b0 con 0x7f962c0c5c00 2023-06-10T18:53:22.180 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.164+0000 7f961affd640 1 -- 172.21.15.53:0/3595839758 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9620005ca0 con 0x7f962c0c5c00 2023-06-10T18:53:22.180 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.164+0000 7f9630889640 1 -- 172.21.15.53:0/3595839758 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f962c15af10 con 0x7f962c0c5c00 2023-06-10T18:53:22.180 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.164+0000 7f961affd640 1 -- 172.21.15.53:0/3595839758 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96200a6980 con 0x7f962c0c5c00 2023-06-10T18:53:22.180 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.164+0000 7f9630889640 1 -- 172.21.15.53:0/3595839758 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f962c159dc0 con 0x7f962c0c5c00 2023-06-10T18:53:22.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.168+0000 7f9630889640 1 -- 172.21.15.53:0/3595839758 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f962c04d790 con 0x7f962c0c5c00 2023-06-10T18:53:22.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.168+0000 7f961affd640 1 -- 172.21.15.53:0/3595839758 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f96200a6ae0 con 0x7f962c0c5c00 2023-06-10T18:53:22.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.168+0000 7f961affd640 1 --2- 172.21.15.53:0/3595839758 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f960c0662b0 0x7f960c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:22.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.168+0000 7f961affd640 1 -- 172.21.15.53:0/3595839758 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f96200aa070 con 0x7f962c0c5c00 2023-06-10T18:53:22.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.168+0000 7f962a59c640 1 --2- 172.21.15.53:0/3595839758 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f960c0662b0 0x7f960c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:22.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.168+0000 7f962a59c640 1 --2- 172.21.15.53:0/3595839758 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f960c0662b0 0x7f960c068760 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f961c0013e0 tx=0x7f961c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:22.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.172+0000 7f961affd640 1 -- 172.21.15.53:0/3595839758 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f96200eb560 con 0x7f962c0c5c00 2023-06-10T18:53:22.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.324+0000 7f9630889640 1 -- 172.21.15.53:0/3595839758 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f962c158b90 con 0x7f962c0c5c00 2023-06-10T18:53:22.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.324+0000 7f961affd640 1 -- 172.21.15.53:0/3595839758 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f96200eeb80 con 0x7f962c0c5c00 2023-06-10T18:53:22.334 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-06-10T18:53:22.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.328+0000 7f9630889640 1 -- 172.21.15.53:0/3595839758 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f960c0662b0 msgr2=0x7f960c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:22.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.328+0000 7f9630889640 1 --2- 172.21.15.53:0/3595839758 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f960c0662b0 0x7f960c068760 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f961c0013e0 tx=0x7f961c009040 comp rx=0 tx=0).stop 2023-06-10T18:53:22.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.328+0000 7f9630889640 1 -- 172.21.15.53:0/3595839758 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f962c0c5c00 msgr2=0x7f962c153120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:22.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.328+0000 7f9630889640 1 --2- 172.21.15.53:0/3595839758 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f962c0c5c00 0x7f962c153120 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f962001cea0 tx=0x7f9614005800 comp rx=0 tx=0).stop 2023-06-10T18:53:22.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.328+0000 7f9630889640 1 -- 172.21.15.53:0/3595839758 shutdown_connections 2023-06-10T18:53:22.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.328+0000 7f9630889640 1 --2- 172.21.15.53:0/3595839758 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f960c0662b0 0x7f960c068760 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:22.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.328+0000 7f9630889640 1 --2- 172.21.15.53:0/3595839758 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f962c150410 0x7f962c153660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:22.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.328+0000 7f9630889640 1 --2- 172.21.15.53:0/3595839758 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f962c0c5c00 0x7f962c153120 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:22.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.328+0000 7f9630889640 1 --2- 172.21.15.53:0/3595839758 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f962c14a980 0x7f962c14fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:22.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.328+0000 7f9630889640 1 -- 172.21.15.53:0/3595839758 >> 172.21.15.53:0/3595839758 conn(0x7f962c069e20 msgr2=0x7f962c155520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:22.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.328+0000 7f9630889640 1 -- 172.21.15.53:0/3595839758 shutdown_connections 2023-06-10T18:53:22.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.328+0000 7f9630889640 1 -- 172.21.15.53:0/3595839758 wait complete. 2023-06-10T18:53:22.363 INFO:tasks.cephfs_test_runner:Starting test: test_network_death (tasks.cephfs.test_client_recovery.TestClientNetworkRecovery) 2023-06-10T18:53:22.365 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_client_recovery.TestClientNetworkRecovery.test_network_death' 2023-06-10T18:53:22.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.476+0000 7fb78d770640 1 Processor -- start 2023-06-10T18:53:22.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.476+0000 7fb78d770640 1 -- start start 2023-06-10T18:53:22.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.476+0000 7fb78d770640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb7880cc690 0x7fb7880d04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:22.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.476+0000 7fb78d770640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7880ccae0 0x7fb7880d09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:22.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.476+0000 7fb78d770640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7880d0020 con 0x7fb7880b3ac0 2023-06-10T18:53:22.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.476+0000 7fb78d770640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7880cef40 con 0x7fb7880cc690 2023-06-10T18:53:22.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.476+0000 7fb78d770640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7880cf220 con 0x7fb7880ccae0 2023-06-10T18:53:22.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.476+0000 7fb7867fc640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb7880cc690 0x7fb7880d04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:22.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.476+0000 7fb7877fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7880ccae0 0x7fb7880d09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:22.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.476+0000 7fb7867fc640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb7880cc690 0x7fb7880d04b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.53:52336/0 (socket says 172.21.15.53:52336) 2023-06-10T18:53:22.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.476+0000 7fb786ffd640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fb7880b3ac0 0x7fb7880b3e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.53:46438/0 (socket says 172.21.15.53:46438) 2023-06-10T18:53:22.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.476+0000 7fb7867fc640 1 -- 172.21.15.53:0/1499069330 learned_addr learned my addr 172.21.15.53:0/1499069330 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:22.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.476+0000 7fb7877fe640 1 -- 172.21.15.53:0/1499069330 >> v2:172.21.15.117:3300/0 conn(0x7fb7880cc690 msgr2=0x7fb7880d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:22.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.476+0000 7fb7877fe640 1 --2- 172.21.15.53:0/1499069330 >> v2:172.21.15.117:3300/0 conn(0x7fb7880cc690 0x7fb7880d04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:22.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.476+0000 7fb7877fe640 1 -- 172.21.15.53:0/1499069330 >> v1:172.21.15.117:6789/0 conn(0x7fb7880b3ac0 legacy=0x7fb7880b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:22.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.476+0000 7fb7877fe640 1 -- 172.21.15.53:0/1499069330 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7880cf500 con 0x7fb7880ccae0 2023-06-10T18:53:22.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.476+0000 7fb7867fc640 1 --2- 172.21.15.53:0/1499069330 >> v2:172.21.15.117:3300/0 conn(0x7fb7880cc690 0x7fb7880d04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-10T18:53:22.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.480+0000 7fb7877fe640 1 --2- 172.21.15.53:0/1499069330 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7880ccae0 0x7fb7880d09f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb780009d90 tx=0x7fb78001c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=404b41a7185ab7d2 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:22.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.480+0000 7fb785ffb640 1 -- 172.21.15.53:0/1499069330 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7800a5a00 con 0x7fb7880ccae0 2023-06-10T18:53:22.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.480+0000 7fb785ffb640 1 -- 172.21.15.53:0/1499069330 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7800a5b60 con 0x7fb7880ccae0 2023-06-10T18:53:22.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.480+0000 7fb785ffb640 1 -- 172.21.15.53:0/1499069330 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7800ad440 con 0x7fb7880ccae0 2023-06-10T18:53:22.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.480+0000 7fb78d770640 1 -- 172.21.15.53:0/1499069330 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7880ccae0 msgr2=0x7fb7880d09f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:22.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.480+0000 7fb78d770640 1 --2- 172.21.15.53:0/1499069330 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7880ccae0 0x7fb7880d09f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb780009d90 tx=0x7fb78001c920 comp rx=0 tx=0).stop 2023-06-10T18:53:22.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.480+0000 7fb78d770640 1 -- 172.21.15.53:0/1499069330 shutdown_connections 2023-06-10T18:53:22.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.480+0000 7fb78d770640 1 --2- 172.21.15.53:0/1499069330 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7880ccae0 0x7fb7880d09f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:22.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.480+0000 7fb78d770640 1 --2- 172.21.15.53:0/1499069330 >> v2:172.21.15.117:3300/0 conn(0x7fb7880cc690 0x7fb7880d04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:22.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.480+0000 7fb78d770640 1 -- 172.21.15.53:0/1499069330 >> 172.21.15.53:0/1499069330 conn(0x7fb788071790 msgr2=0x7fb788069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:22.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.480+0000 7fb78d770640 1 -- 172.21.15.53:0/1499069330 shutdown_connections 2023-06-10T18:53:22.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.480+0000 7fb78d770640 1 -- 172.21.15.53:0/1499069330 wait complete. 2023-06-10T18:53:22.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.480+0000 7fb78d770640 1 Processor -- start 2023-06-10T18:53:22.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.480+0000 7fb78d770640 1 -- start start 2023-06-10T18:53:22.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.484+0000 7fb78d770640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7880b3ac0 0x7fb7881f48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:22.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.484+0000 7fb78d770640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb7880cc690 0x7fb7880cb4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:22.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.484+0000 7fb78d770640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7880ccae0 0x7fb788151eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:22.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.484+0000 7fb78d770640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb78815c130 con 0x7fb7880cc690 2023-06-10T18:53:22.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.484+0000 7fb78d770640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7881f4e20 con 0x7fb7880b3ac0 2023-06-10T18:53:22.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.484+0000 7fb78d770640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb78815dd00 con 0x7fb7880ccae0 2023-06-10T18:53:22.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.484+0000 7fb7867fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb7880cc690 0x7fb7880cb4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:22.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.484+0000 7fb7867fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb7880cc690 0x7fb7880cb4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50194/0 (socket says 172.21.15.53:50194) 2023-06-10T18:53:22.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.484+0000 7fb7867fc640 1 -- 172.21.15.53:0/2082147022 learned_addr learned my addr 172.21.15.53:0/2082147022 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:22.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.484+0000 7fb7877fe640 1 --2- 172.21.15.53:0/2082147022 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7880ccae0 0x7fb788151eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:22.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.484+0000 7fb786ffd640 1 --2- 172.21.15.53:0/2082147022 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7880b3ac0 0x7fb7881f48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:22.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.484+0000 7fb7867fc640 1 -- 172.21.15.53:0/2082147022 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7880ccae0 msgr2=0x7fb788151eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:22.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.484+0000 7fb7867fc640 1 --2- 172.21.15.53:0/2082147022 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7880ccae0 0x7fb788151eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:22.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.484+0000 7fb7867fc640 1 -- 172.21.15.53:0/2082147022 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7880b3ac0 msgr2=0x7fb7881f48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:22.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.484+0000 7fb7867fc640 1 --2- 172.21.15.53:0/2082147022 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7880b3ac0 0x7fb7881f48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:22.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.484+0000 7fb7867fc640 1 -- 172.21.15.53:0/2082147022 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb77c0094d0 con 0x7fb7880cc690 2023-06-10T18:53:22.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.484+0000 7fb7867fc640 1 --2- 172.21.15.53:0/2082147022 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb7880cc690 0x7fb7880cb4f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb77c00e9d0 tx=0x7fb77c00ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:22.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.484+0000 7fb76f7fe640 1 -- 172.21.15.53:0/2082147022 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77c00ca60 con 0x7fb7880cc690 2023-06-10T18:53:22.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.484+0000 7fb76f7fe640 1 -- 172.21.15.53:0/2082147022 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb77c00cbc0 con 0x7fb7880cc690 2023-06-10T18:53:22.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.484+0000 7fb78d770640 1 -- 172.21.15.53:0/2082147022 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb780009a70 con 0x7fb7880cc690 2023-06-10T18:53:22.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.484+0000 7fb76f7fe640 1 -- 172.21.15.53:0/2082147022 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77c013470 con 0x7fb7880cc690 2023-06-10T18:53:22.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.484+0000 7fb78d770640 1 -- 172.21.15.53:0/2082147022 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb78815e2c0 con 0x7fb7880cc690 2023-06-10T18:53:22.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.484+0000 7fb78d770640 1 -- 172.21.15.53:0/2082147022 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb78804d790 con 0x7fb7880cc690 2023-06-10T18:53:22.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.484+0000 7fb76f7fe640 1 -- 172.21.15.53:0/2082147022 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb77c0135d0 con 0x7fb7880cc690 2023-06-10T18:53:22.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.484+0000 7fb76f7fe640 1 --2- 172.21.15.53:0/2082147022 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb774066280 0x7fb774068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:22.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.484+0000 7fb76f7fe640 1 -- 172.21.15.53:0/2082147022 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb77c084060 con 0x7fb7880cc690 2023-06-10T18:53:22.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.488+0000 7fb786ffd640 1 --2- 172.21.15.53:0/2082147022 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb774066280 0x7fb774068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:22.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.488+0000 7fb786ffd640 1 --2- 172.21.15.53:0/2082147022 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb774066280 0x7fb774068730 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb778000f70 tx=0x7fb778007cd0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:22.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.488+0000 7fb76f7fe640 1 -- 172.21.15.53:0/2082147022 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb77c051510 con 0x7fb7880cc690 2023-06-10T18:53:22.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:22.700+0000 7fb78d770640 1 -- 172.21.15.53:0/2082147022 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientNetworkRecovery.test_network_death"]} v 0) v1 -- 0x7fb78808a200 con 0x7fb7880cc690 2023-06-10T18:53:23.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.104+0000 7fb76f7fe640 1 -- 172.21.15.53:0/2082147022 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientNetworkRecovery.test_network_death"]}]=0 v56) v1 ==== 160+0+0 (secure 0 0 0) 0x7fb77c054b30 con 0x7fb7880cc690 2023-06-10T18:53:23.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.108+0000 7fb78d770640 1 -- 172.21.15.53:0/2082147022 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb774066280 msgr2=0x7fb774068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:23.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.108+0000 7fb78d770640 1 --2- 172.21.15.53:0/2082147022 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb774066280 0x7fb774068730 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb778000f70 tx=0x7fb778007cd0 comp rx=0 tx=0).stop 2023-06-10T18:53:23.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.108+0000 7fb78d770640 1 -- 172.21.15.53:0/2082147022 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb7880cc690 msgr2=0x7fb7880cb4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:23.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.108+0000 7fb78d770640 1 --2- 172.21.15.53:0/2082147022 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb7880cc690 0x7fb7880cb4f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb77c00e9d0 tx=0x7fb77c00ee90 comp rx=0 tx=0).stop 2023-06-10T18:53:23.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.108+0000 7fb78d770640 1 -- 172.21.15.53:0/2082147022 shutdown_connections 2023-06-10T18:53:23.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.108+0000 7fb78d770640 1 --2- 172.21.15.53:0/2082147022 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb774066280 0x7fb774068730 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:23.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.108+0000 7fb78d770640 1 --2- 172.21.15.53:0/2082147022 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb7880ccae0 0x7fb788151eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:23.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.108+0000 7fb78d770640 1 --2- 172.21.15.53:0/2082147022 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb7880cc690 0x7fb7880cb4f0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:23.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.108+0000 7fb78d770640 1 --2- 172.21.15.53:0/2082147022 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7880b3ac0 0x7fb7881f48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:23.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.108+0000 7fb78d770640 1 -- 172.21.15.53:0/2082147022 >> 172.21.15.53:0/2082147022 conn(0x7fb788071790 msgr2=0x7fb788158dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:23.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.108+0000 7fb78d770640 1 -- 172.21.15.53:0/2082147022 shutdown_connections 2023-06-10T18:53:23.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.108+0000 7fb78d770640 1 -- 172.21.15.53:0/2082147022 wait complete. 2023-06-10T18:53:23.139 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-06-10T18:53:23.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.264+0000 7f3040531640 1 Processor -- start 2023-06-10T18:53:23.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.264+0000 7f3040531640 1 -- start start 2023-06-10T18:53:23.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.264+0000 7f3040531640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f303815c090 0x7f30380b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:23.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.264+0000 7f3040531640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30380b7e30 0x7f30380d04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:23.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.264+0000 7f3040531640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30380cc7c0 con 0x7f30380b0b90 2023-06-10T18:53:23.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.264+0000 7f3040531640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30380ccaa0 con 0x7f303815c090 2023-06-10T18:53:23.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.264+0000 7f3040531640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30380ccd80 con 0x7f30380b7e30 2023-06-10T18:53:23.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.264+0000 7f303dacc640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f30380b0b90 0x7f30380b7720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:37238/0 (socket says 172.21.15.53:37238) 2023-06-10T18:53:23.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.264+0000 7f303e2cd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f303815c090 0x7f30380b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:23.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.264+0000 7f303dacc640 1 -- 172.21.15.53:0/1428623455 learned_addr learned my addr 172.21.15.53:0/1428623455 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:53:23.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.264+0000 7f303eace640 1 --2- 172.21.15.53:0/1428623455 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30380b7e30 0x7f30380d04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:23.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.264+0000 7f303e2cd640 1 -- 172.21.15.53:0/1428623455 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30380b7e30 msgr2=0x7f30380d04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:23.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.264+0000 7f303e2cd640 1 --2- 172.21.15.53:0/1428623455 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30380b7e30 0x7f30380d04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:23.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.264+0000 7f303e2cd640 1 -- 172.21.15.53:0/1428623455 >> v1:172.21.15.53:6789/0 conn(0x7f30380b0b90 legacy=0x7f30380b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:23.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.264+0000 7f303d2cb640 1 -- 172.21.15.53:0/1428623455 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3773538263 0 0) 0x7f30380cc7c0 con 0x7f30380b0b90 2023-06-10T18:53:23.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.264+0000 7f303e2cd640 1 -- 172.21.15.53:0/1428623455 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30380cd060 con 0x7f303815c090 2023-06-10T18:53:23.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.268+0000 7f303e2cd640 1 --2- 172.21.15.53:0/1428623455 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f303815c090 0x7f30380b10c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f302c0097c0 tx=0x7f302c01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eccd8cab2269ef77 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:23.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.268+0000 7f303d2cb640 1 -- 172.21.15.53:0/1428623455 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302c0ab600 con 0x7f303815c090 2023-06-10T18:53:23.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.268+0000 7f303d2cb640 1 -- 172.21.15.53:0/1428623455 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f302c0a7050 con 0x7f303815c090 2023-06-10T18:53:23.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.268+0000 7f303d2cb640 1 -- 172.21.15.53:0/1428623455 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302c0ab980 con 0x7f303815c090 2023-06-10T18:53:23.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.268+0000 7f3040531640 1 -- 172.21.15.53:0/1428623455 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f303815c090 msgr2=0x7f30380b10c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:23.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.268+0000 7f3040531640 1 --2- 172.21.15.53:0/1428623455 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f303815c090 0x7f30380b10c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f302c0097c0 tx=0x7f302c01c3c0 comp rx=0 tx=0).stop 2023-06-10T18:53:23.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.268+0000 7f3040531640 1 -- 172.21.15.53:0/1428623455 shutdown_connections 2023-06-10T18:53:23.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.268+0000 7f3040531640 1 --2- 172.21.15.53:0/1428623455 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30380b7e30 0x7f30380d04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:23.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.268+0000 7f3040531640 1 --2- 172.21.15.53:0/1428623455 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f303815c090 0x7f30380b10c0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:23.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.268+0000 7f3040531640 1 -- 172.21.15.53:0/1428623455 >> 172.21.15.53:0/1428623455 conn(0x7f3038069e20 msgr2=0x7f303806a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:23.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.268+0000 7f3040531640 1 -- 172.21.15.53:0/1428623455 shutdown_connections 2023-06-10T18:53:23.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.268+0000 7f3040531640 1 -- 172.21.15.53:0/1428623455 wait complete. 2023-06-10T18:53:23.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.268+0000 7f3040531640 1 Processor -- start 2023-06-10T18:53:23.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.268+0000 7f3040531640 1 -- start start 2023-06-10T18:53:23.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.268+0000 7f3040531640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30380b0b90 0x7f3038147e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:23.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.268+0000 7f3040531640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30380b7e30 0x7f30380cb1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:23.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.268+0000 7f3040531640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f303815c090 0x7f30380ce8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:23.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.268+0000 7f3040531640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30380cbc30 con 0x7f30380b0b90 2023-06-10T18:53:23.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.268+0000 7f3040531640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30380c5ca0 con 0x7f303815c090 2023-06-10T18:53:23.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.268+0000 7f3040531640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30380c5f80 con 0x7f30380b7e30 2023-06-10T18:53:23.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.268+0000 7f303e2cd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30380b0b90 0x7f3038147e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:23.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.268+0000 7f303e2cd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30380b0b90 0x7f3038147e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50198/0 (socket says 172.21.15.53:50198) 2023-06-10T18:53:23.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.268+0000 7f303e2cd640 1 -- 172.21.15.53:0/1501086796 learned_addr learned my addr 172.21.15.53:0/1501086796 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:23.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.268+0000 7f303dacc640 1 --2- 172.21.15.53:0/1501086796 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30380b7e30 0x7f30380cb1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:23.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.268+0000 7f303eace640 1 --2- 172.21.15.53:0/1501086796 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f303815c090 0x7f30380ce8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:23.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.268+0000 7f303e2cd640 1 -- 172.21.15.53:0/1501086796 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30380b7e30 msgr2=0x7f30380cb1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:23.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.268+0000 7f303e2cd640 1 --2- 172.21.15.53:0/1501086796 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30380b7e30 0x7f30380cb1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:23.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.268+0000 7f303e2cd640 1 -- 172.21.15.53:0/1501086796 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f303815c090 msgr2=0x7f30380ce8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:23.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.268+0000 7f303e2cd640 1 --2- 172.21.15.53:0/1501086796 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f303815c090 0x7f30380ce8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:23.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.268+0000 7f303e2cd640 1 -- 172.21.15.53:0/1501086796 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f302c009420 con 0x7f30380b0b90 2023-06-10T18:53:23.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.268+0000 7f303eace640 1 --2- 172.21.15.53:0/1501086796 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f303815c090 0x7f30380ce8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:23.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.268+0000 7f303e2cd640 1 --2- 172.21.15.53:0/1501086796 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30380b0b90 0x7f3038147e20 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f302c019ff0 tx=0x7f302c019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:23.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.268+0000 7f302affd640 1 -- 172.21.15.53:0/1501086796 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302c004220 con 0x7f30380b0b90 2023-06-10T18:53:23.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.268+0000 7f302affd640 1 -- 172.21.15.53:0/1501086796 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f302c004380 con 0x7f30380b0b90 2023-06-10T18:53:23.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.268+0000 7f3040531640 1 -- 172.21.15.53:0/1501086796 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30380c6260 con 0x7f30380b0b90 2023-06-10T18:53:23.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.268+0000 7f302affd640 1 -- 172.21.15.53:0/1501086796 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302c003820 con 0x7f30380b0b90 2023-06-10T18:53:23.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.268+0000 7f3040531640 1 -- 172.21.15.53:0/1501086796 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3038148360 con 0x7f30380b0b90 2023-06-10T18:53:23.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.272+0000 7f3040531640 1 -- 172.21.15.53:0/1501086796 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f303804d790 con 0x7f30380b0b90 2023-06-10T18:53:23.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.272+0000 7f302affd640 1 -- 172.21.15.53:0/1501086796 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f302c0b2040 con 0x7f30380b0b90 2023-06-10T18:53:23.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.272+0000 7f302affd640 1 --2- 172.21.15.53:0/1501086796 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f301c0662b0 0x7f301c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:23.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.272+0000 7f302affd640 1 -- 172.21.15.53:0/1501086796 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f302c11d3a0 con 0x7f30380b0b90 2023-06-10T18:53:23.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.272+0000 7f303dacc640 1 --2- 172.21.15.53:0/1501086796 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f301c0662b0 0x7f301c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:23.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.272+0000 7f303dacc640 1 --2- 172.21.15.53:0/1501086796 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f301c0662b0 0x7f301c068760 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3034007fd0 tx=0x7f3034007f20 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:23.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.276+0000 7f302affd640 1 -- 172.21.15.53:0/1501086796 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f302c0ea960 con 0x7f30380b0b90 2023-06-10T18:53:23.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.428+0000 7f3040531640 1 -- 172.21.15.53:0/1501086796 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f30380d2fe0 con 0x7f30380b0b90 2023-06-10T18:53:23.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.440+0000 7f302affd640 1 -- 172.21.15.53:0/1501086796 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f302c0044f0 con 0x7f30380b0b90 2023-06-10T18:53:23.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.440+0000 7f3040531640 1 -- 172.21.15.53:0/1501086796 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f301c0662b0 msgr2=0x7f301c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:23.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.440+0000 7f3040531640 1 --2- 172.21.15.53:0/1501086796 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f301c0662b0 0x7f301c068760 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3034007fd0 tx=0x7f3034007f20 comp rx=0 tx=0).stop 2023-06-10T18:53:23.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.440+0000 7f3040531640 1 -- 172.21.15.53:0/1501086796 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30380b0b90 msgr2=0x7f3038147e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:23.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.440+0000 7f3040531640 1 --2- 172.21.15.53:0/1501086796 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30380b0b90 0x7f3038147e20 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f302c019ff0 tx=0x7f302c019160 comp rx=0 tx=0).stop 2023-06-10T18:53:23.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.440+0000 7f3040531640 1 -- 172.21.15.53:0/1501086796 shutdown_connections 2023-06-10T18:53:23.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.440+0000 7f3040531640 1 --2- 172.21.15.53:0/1501086796 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f301c0662b0 0x7f301c068760 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:23.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.440+0000 7f3040531640 1 --2- 172.21.15.53:0/1501086796 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f303815c090 0x7f30380ce8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:23.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.440+0000 7f3040531640 1 --2- 172.21.15.53:0/1501086796 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30380b7e30 0x7f30380cb1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:23.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.440+0000 7f3040531640 1 --2- 172.21.15.53:0/1501086796 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30380b0b90 0x7f3038147e20 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:23.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.440+0000 7f3040531640 1 -- 172.21.15.53:0/1501086796 >> 172.21.15.53:0/1501086796 conn(0x7f3038069e20 msgr2=0x7f3038159370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:23.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.440+0000 7f3040531640 1 -- 172.21.15.53:0/1501086796 shutdown_connections 2023-06-10T18:53:23.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.440+0000 7f3040531640 1 -- 172.21.15.53:0/1501086796 wait complete. 2023-06-10T18:53:23.466 INFO:tasks.cephfs_test_runner:test_network_death (tasks.cephfs.test_client_recovery.TestClientNetworkRecovery) ... skipped 'Require first client to be on separate server from MDSs' 2023-06-10T18:53:23.467 INFO:tasks.cephfs_test_runner:Starting test: test_abort_conn (tasks.cephfs.test_client_recovery.TestClientRecovery) 2023-06-10T18:53:23.467 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_abort_conn' 2023-06-10T18:53:23.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.580+0000 7fd2928af640 1 Processor -- start 2023-06-10T18:53:23.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.584+0000 7fd2928af640 1 -- start start 2023-06-10T18:53:23.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.584+0000 7fd2928af640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd28c0afe30 0x7fd28c06efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:23.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.584+0000 7fd2928af640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd28c0c9e50 con 0x7fd28c157e10 2023-06-10T18:53:23.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.584+0000 7fd2928af640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd28c0c82f0 con 0x7fd28c06bb30 2023-06-10T18:53:23.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.584+0000 7fd2928af640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd28c06bf00 con 0x7fd28c0afe30 2023-06-10T18:53:23.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.584+0000 7fd28bfff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fd28c157e10 0x7fd28c0af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:37254/0 (socket says 172.21.15.53:37254) 2023-06-10T18:53:23.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.584+0000 7fd28bfff640 1 -- 172.21.15.53:0/144901738 learned_addr learned my addr 172.21.15.53:0/144901738 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:53:23.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.584+0000 7fd283fff640 1 --2- 172.21.15.53:0/144901738 >> v2:172.21.15.117:3300/0 conn(0x7fd28c0afe30 0x7fd28c06efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:23.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.584+0000 7fd28b7fe640 1 -- 172.21.15.53:0/144901738 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 141832846 0 0) 0x7fd28c0c9e50 con 0x7fd28c157e10 2023-06-10T18:53:23.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.584+0000 7fd28b7fe640 1 -- 172.21.15.53:0/144901738 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd278005740 con 0x7fd28c157e10 2023-06-10T18:53:23.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.584+0000 7fd28b7fe640 1 -- 172.21.15.53:0/144901738 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 834235716 0 0) 0x7fd278005740 con 0x7fd28c157e10 2023-06-10T18:53:23.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.584+0000 7fd28b7fe640 1 -- 172.21.15.53:0/144901738 >> v2:172.21.15.117:3300/0 conn(0x7fd28c0afe30 msgr2=0x7fd28c06efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:23.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.584+0000 7fd28b7fe640 1 --2- 172.21.15.53:0/144901738 >> v2:172.21.15.117:3300/0 conn(0x7fd28c0afe30 0x7fd28c06efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:23.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.584+0000 7fd28b7fe640 1 -- 172.21.15.53:0/144901738 >> v1:172.21.15.117:6789/0 conn(0x7fd28c06bb30 legacy=0x7fd28c15bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:23.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.584+0000 7fd28b7fe640 1 -- 172.21.15.53:0/144901738 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd28c0ca080 con 0x7fd28c157e10 2023-06-10T18:53:23.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.584+0000 7fd28b7fe640 1 -- 172.21.15.53:0/144901738 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fd27c001680 con 0x7fd28c157e10 2023-06-10T18:53:23.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.584+0000 7fd28b7fe640 1 -- 172.21.15.53:0/144901738 >> v1:172.21.15.53:6789/0 conn(0x7fd28c157e10 legacy=0x7fd28c0af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:23.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.584+0000 7fd28b7fe640 1 --2- 172.21.15.53:0/144901738 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd278005c00 0x7fd278006010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:23.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.584+0000 7fd28b7fe640 1 --2- 172.21.15.53:0/144901738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2780069e0 0x7fd278006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:23.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.584+0000 7fd28b7fe640 1 --2- 172.21.15.53:0/144901738 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd278007490 0x7fd27800dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:23.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.584+0000 7fd28b7fe640 1 -- 172.21.15.53:0/144901738 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd28c06bf00 con 0x7fd2780069e0 2023-06-10T18:53:23.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.584+0000 7fd28b7fe640 1 -- 172.21.15.53:0/144901738 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd27800e3c0 con 0x7fd278007490 2023-06-10T18:53:23.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.584+0000 7fd28b7fe640 1 -- 172.21.15.53:0/144901738 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd27800e580 con 0x7fd278005c00 2023-06-10T18:53:23.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.584+0000 7fd283fff640 1 --2- 172.21.15.53:0/144901738 >> v2:172.21.15.117:3300/0 conn(0x7fd28c0afe30 0x7fd28c06efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:53:23.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.584+0000 7fd283fff640 1 --2- 172.21.15.53:0/144901738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2780069e0 0x7fd278006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:23.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.584+0000 7fd290e4c640 1 --2- 172.21.15.53:0/144901738 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd278007490 0x7fd27800dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:23.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.584+0000 7fd28bfff640 1 --2- 172.21.15.53:0/144901738 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd278005c00 0x7fd278006010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:23.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.584+0000 7fd283fff640 1 -- 172.21.15.53:0/144901738 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd278005c00 msgr2=0x7fd278006010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:23.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.584+0000 7fd283fff640 1 --2- 172.21.15.53:0/144901738 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd278005c00 0x7fd278006010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:23.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.584+0000 7fd283fff640 1 -- 172.21.15.53:0/144901738 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd278007490 msgr2=0x7fd27800dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:23.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.584+0000 7fd283fff640 1 --2- 172.21.15.53:0/144901738 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd278007490 0x7fd27800dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:23.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.584+0000 7fd283fff640 1 -- 172.21.15.53:0/144901738 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd278005740 con 0x7fd2780069e0 2023-06-10T18:53:23.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.584+0000 7fd290e4c640 1 --2- 172.21.15.53:0/144901738 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd278007490 0x7fd27800dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:53:23.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.584+0000 7fd290e4c640 1 -- 172.21.15.53:0/144901738 reap_dead start 2023-06-10T18:53:23.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.588+0000 7fd283fff640 1 --2- 172.21.15.53:0/144901738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2780069e0 0x7fd278006e50 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd274009880 tx=0x7fd27401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3de4233721f85754 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:23.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.588+0000 7fd28b7fe640 1 -- 172.21.15.53:0/144901738 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2740af070 con 0x7fd2780069e0 2023-06-10T18:53:23.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.588+0000 7fd28b7fe640 1 -- 172.21.15.53:0/144901738 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd274004020 con 0x7fd2780069e0 2023-06-10T18:53:23.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.588+0000 7fd28b7fe640 1 -- 172.21.15.53:0/144901738 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2740043b0 con 0x7fd2780069e0 2023-06-10T18:53:23.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.588+0000 7fd2928af640 1 -- 172.21.15.53:0/144901738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2780069e0 msgr2=0x7fd278006e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:23.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.588+0000 7fd2928af640 1 --2- 172.21.15.53:0/144901738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2780069e0 0x7fd278006e50 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd274009880 tx=0x7fd27401c520 comp rx=0 tx=0).stop 2023-06-10T18:53:23.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.588+0000 7fd2928af640 1 -- 172.21.15.53:0/144901738 shutdown_connections 2023-06-10T18:53:23.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.588+0000 7fd2928af640 1 --2- 172.21.15.53:0/144901738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2780069e0 0x7fd278006e50 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:23.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.588+0000 7fd2928af640 1 -- 172.21.15.53:0/144901738 >> 172.21.15.53:0/144901738 conn(0x7fd28c06a0d0 msgr2=0x7fd28c0ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:23.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.588+0000 7fd2928af640 1 -- 172.21.15.53:0/144901738 shutdown_connections 2023-06-10T18:53:23.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.588+0000 7fd2928af640 1 -- 172.21.15.53:0/144901738 wait complete. 2023-06-10T18:53:23.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.588+0000 7fd2928af640 1 Processor -- start 2023-06-10T18:53:23.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.588+0000 7fd2928af640 1 -- start start 2023-06-10T18:53:23.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.588+0000 7fd2928af640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd2780069e0 0x7fd28c0c31f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:23.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.588+0000 7fd2928af640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd28c0c3e30 0x7fd28c0b2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:23.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.588+0000 7fd2928af640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd28c15a5d0 0x7fd28c154cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:23.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.588+0000 7fd2928af640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd28c0c46b0 con 0x7fd28c15a5d0 2023-06-10T18:53:23.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.588+0000 7fd2928af640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd28c0c43d0 con 0x7fd2780069e0 2023-06-10T18:53:23.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.588+0000 7fd2928af640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd28c0b2500 con 0x7fd28c0c3e30 2023-06-10T18:53:23.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.588+0000 7fd290e4c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd28c15a5d0 0x7fd28c154cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:23.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.588+0000 7fd290e4c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd28c15a5d0 0x7fd28c154cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50218/0 (socket says 172.21.15.53:50218) 2023-06-10T18:53:23.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.588+0000 7fd290e4c640 1 -- 172.21.15.53:0/1299745377 learned_addr learned my addr 172.21.15.53:0/1299745377 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:23.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.588+0000 7fd28bfff640 1 --2- 172.21.15.53:0/1299745377 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd2780069e0 0x7fd28c0c31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:23.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.588+0000 7fd283fff640 1 --2- 172.21.15.53:0/1299745377 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd28c0c3e30 0x7fd28c0b2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:23.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.592+0000 7fd290e4c640 1 -- 172.21.15.53:0/1299745377 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd28c0c3e30 msgr2=0x7fd28c0b2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:23.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.592+0000 7fd290e4c640 1 --2- 172.21.15.53:0/1299745377 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd28c0c3e30 0x7fd28c0b2fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:23.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.592+0000 7fd290e4c640 1 -- 172.21.15.53:0/1299745377 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd2780069e0 msgr2=0x7fd28c0c31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:23.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.592+0000 7fd290e4c640 1 --2- 172.21.15.53:0/1299745377 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd2780069e0 0x7fd28c0c31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:23.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.592+0000 7fd290e4c640 1 -- 172.21.15.53:0/1299745377 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd28c0b27e0 con 0x7fd28c15a5d0 2023-06-10T18:53:23.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.592+0000 7fd28bfff640 1 --2- 172.21.15.53:0/1299745377 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd2780069e0 0x7fd28c0c31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:53:23.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.592+0000 7fd290e4c640 1 --2- 172.21.15.53:0/1299745377 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd28c15a5d0 0x7fd28c154cf0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd28c06e510 tx=0x7fd28400e7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:23.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.592+0000 7fd2897fa640 1 -- 172.21.15.53:0/1299745377 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd28400ec60 con 0x7fd28c15a5d0 2023-06-10T18:53:23.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.592+0000 7fd2897fa640 1 -- 172.21.15.53:0/1299745377 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd28400edc0 con 0x7fd28c15a5d0 2023-06-10T18:53:23.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.592+0000 7fd2897fa640 1 -- 172.21.15.53:0/1299745377 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd284003b80 con 0x7fd28c15a5d0 2023-06-10T18:53:23.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.592+0000 7fd2928af640 1 -- 172.21.15.53:0/1299745377 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd28c0b2ac0 con 0x7fd28c15a5d0 2023-06-10T18:53:23.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.592+0000 7fd2928af640 1 -- 172.21.15.53:0/1299745377 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd28c0b3520 con 0x7fd28c15a5d0 2023-06-10T18:53:23.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.592+0000 7fd2928af640 1 -- 172.21.15.53:0/1299745377 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd28c0b2360 con 0x7fd28c15a5d0 2023-06-10T18:53:23.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.592+0000 7fd2897fa640 1 -- 172.21.15.53:0/1299745377 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd284003ce0 con 0x7fd28c15a5d0 2023-06-10T18:53:23.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.592+0000 7fd2897fa640 1 --2- 172.21.15.53:0/1299745377 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd26c0662b0 0x7fd26c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:23.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.592+0000 7fd2897fa640 1 -- 172.21.15.53:0/1299745377 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd284082da0 con 0x7fd28c15a5d0 2023-06-10T18:53:23.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.592+0000 7fd28bfff640 1 --2- 172.21.15.53:0/1299745377 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd26c0662b0 0x7fd26c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:23.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.592+0000 7fd28bfff640 1 --2- 172.21.15.53:0/1299745377 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd26c0662b0 0x7fd26c068760 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd28c0c9960 tx=0x7fd27c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:23.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.596+0000 7fd2897fa640 1 -- 172.21.15.53:0/1299745377 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd28c0b2360 con 0x7fd28c15a5d0 2023-06-10T18:53:23.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:23.808+0000 7fd2928af640 1 -- 172.21.15.53:0/1299745377 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_abort_conn"]} v 0) v1 -- 0x7fd28c0b2360 con 0x7fd28c15a5d0 2023-06-10T18:53:24.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.104+0000 7fd2897fa640 1 -- 172.21.15.53:0/1299745377 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_abort_conn"]}]=0 v57) v1 ==== 150+0+0 (secure 0 0 0) 0x7fd28c0b2360 con 0x7fd28c15a5d0 2023-06-10T18:53:24.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.108+0000 7fd2928af640 1 -- 172.21.15.53:0/1299745377 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd26c0662b0 msgr2=0x7fd26c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:24.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.108+0000 7fd2928af640 1 --2- 172.21.15.53:0/1299745377 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd26c0662b0 0x7fd26c068760 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd28c0c9960 tx=0x7fd27c009040 comp rx=0 tx=0).stop 2023-06-10T18:53:24.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.108+0000 7fd2928af640 1 -- 172.21.15.53:0/1299745377 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd28c15a5d0 msgr2=0x7fd28c154cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:24.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.108+0000 7fd2928af640 1 --2- 172.21.15.53:0/1299745377 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd28c15a5d0 0x7fd28c154cf0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd28c06e510 tx=0x7fd28400e7c0 comp rx=0 tx=0).stop 2023-06-10T18:53:24.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.108+0000 7fd2928af640 1 -- 172.21.15.53:0/1299745377 shutdown_connections 2023-06-10T18:53:24.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.108+0000 7fd2928af640 1 --2- 172.21.15.53:0/1299745377 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd26c0662b0 0x7fd26c068760 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:24.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.108+0000 7fd2928af640 1 --2- 172.21.15.53:0/1299745377 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd28c15a5d0 0x7fd28c154cf0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:24.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.108+0000 7fd2928af640 1 --2- 172.21.15.53:0/1299745377 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd28c0c3e30 0x7fd28c0b2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:24.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.108+0000 7fd2928af640 1 --2- 172.21.15.53:0/1299745377 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd2780069e0 0x7fd28c0c31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:24.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.108+0000 7fd2928af640 1 -- 172.21.15.53:0/1299745377 >> 172.21.15.53:0/1299745377 conn(0x7fd28c06a0d0 msgr2=0x7fd28c0cc710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:24.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.108+0000 7fd2928af640 1 -- 172.21.15.53:0/1299745377 shutdown_connections 2023-06-10T18:53:24.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.108+0000 7fd2928af640 1 -- 172.21.15.53:0/1299745377 wait complete. 2023-06-10T18:53:24.138 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-06-10T18:53:24.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.252+0000 7f45adc42640 1 Processor -- start 2023-06-10T18:53:24.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.252+0000 7f45adc42640 1 -- start start 2023-06-10T18:53:24.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.256+0000 7f45adc42640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f45a80c97d0 0x7f45a80cb820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:24.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.256+0000 7f45adc42640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45a80af760 0x7f45a80afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:24.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.256+0000 7f45adc42640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45a80ac910 con 0x7f45a806c350 2023-06-10T18:53:24.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.256+0000 7f45adc42640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45a80ca5c0 con 0x7f45a80c97d0 2023-06-10T18:53:24.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.256+0000 7f45adc42640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45a80b0120 con 0x7f45a80af760 2023-06-10T18:53:24.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.256+0000 7f45a77fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f45a80c97d0 0x7f45a80cb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:24.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.256+0000 7f45a77fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f45a80c97d0 0x7f45a80cb820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50234/0 (socket says 172.21.15.53:50234) 2023-06-10T18:53:24.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.256+0000 7f45a77fe640 1 -- 172.21.15.53:0/2244136495 learned_addr learned my addr 172.21.15.53:0/2244136495 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:24.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.256+0000 7f45a7fff640 1 --2- 172.21.15.53:0/2244136495 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45a80af760 0x7f45a80afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:24.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.256+0000 7f45a77fe640 1 -- 172.21.15.53:0/2244136495 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45a80af760 msgr2=0x7f45a80afbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:24.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.256+0000 7f45a77fe640 1 --2- 172.21.15.53:0/2244136495 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45a80af760 0x7f45a80afbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:24.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.256+0000 7f45a77fe640 1 -- 172.21.15.53:0/2244136495 >> v1:172.21.15.117:6789/0 conn(0x7f45a806c350 legacy=0x7f45a80ac200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:24.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.256+0000 7f45a77fe640 1 -- 172.21.15.53:0/2244136495 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a80cbd60 con 0x7f45a80c97d0 2023-06-10T18:53:24.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.260+0000 7f45a77fe640 1 --2- 172.21.15.53:0/2244136495 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45a80c97d0 0x7f45a80cb820 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f4598009e50 tx=0x7f459801c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7594c8c19fbecd49 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:24.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.260+0000 7f45a67fc640 1 -- 172.21.15.53:0/2244136495 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45980a5530 con 0x7f45a80c97d0 2023-06-10T18:53:24.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.260+0000 7f45a67fc640 1 -- 172.21.15.53:0/2244136495 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45980a5690 con 0x7f45a80c97d0 2023-06-10T18:53:24.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.260+0000 7f45a67fc640 1 -- 172.21.15.53:0/2244136495 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45980a5a20 con 0x7f45a80c97d0 2023-06-10T18:53:24.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.260+0000 7f45adc42640 1 -- 172.21.15.53:0/2244136495 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45a80c97d0 msgr2=0x7f45a80cb820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:24.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.260+0000 7f45adc42640 1 --2- 172.21.15.53:0/2244136495 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45a80c97d0 0x7f45a80cb820 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f4598009e50 tx=0x7f459801c8b0 comp rx=0 tx=0).stop 2023-06-10T18:53:24.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.260+0000 7f45adc42640 1 -- 172.21.15.53:0/2244136495 shutdown_connections 2023-06-10T18:53:24.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.260+0000 7f45adc42640 1 --2- 172.21.15.53:0/2244136495 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45a80af760 0x7f45a80afbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:24.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.260+0000 7f45adc42640 1 --2- 172.21.15.53:0/2244136495 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45a80c97d0 0x7f45a80cb820 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:24.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.260+0000 7f45adc42640 1 -- 172.21.15.53:0/2244136495 >> 172.21.15.53:0/2244136495 conn(0x7f45a806a0e0 msgr2=0x7f45a80cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:24.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.260+0000 7f45adc42640 1 -- 172.21.15.53:0/2244136495 shutdown_connections 2023-06-10T18:53:24.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.260+0000 7f45adc42640 1 -- 172.21.15.53:0/2244136495 wait complete. 2023-06-10T18:53:24.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.260+0000 7f45adc42640 1 Processor -- start 2023-06-10T18:53:24.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.260+0000 7f45adc42640 1 -- start start 2023-06-10T18:53:24.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.260+0000 7f45adc42640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45a806c350 0x7f45a814f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:24.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.260+0000 7f45adc42640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45a80af760 0x7f45a815a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:24.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.260+0000 7f45adc42640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45a80c97d0 0x7f45a8150f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:24.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.260+0000 7f45adc42640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a814fac0 con 0x7f45a80c97d0 2023-06-10T18:53:24.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.260+0000 7f45adc42640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a8151a00 con 0x7f45a80af760 2023-06-10T18:53:24.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.260+0000 7f45adc42640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45a8151ce0 con 0x7f45a806c350 2023-06-10T18:53:24.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.260+0000 7f45a7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45a80c97d0 0x7f45a8150f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:24.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.260+0000 7f45a7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45a80c97d0 0x7f45a8150f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50238/0 (socket says 172.21.15.53:50238) 2023-06-10T18:53:24.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.260+0000 7f45a7fff640 1 -- 172.21.15.53:0/2190492898 learned_addr learned my addr 172.21.15.53:0/2190492898 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:24.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.260+0000 7f45a77fe640 1 --2- 172.21.15.53:0/2190492898 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45a806c350 0x7f45a814f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:24.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.260+0000 7f45a6ffd640 1 --2- 172.21.15.53:0/2190492898 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45a80af760 0x7f45a815a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:24.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.260+0000 7f45a7fff640 1 -- 172.21.15.53:0/2190492898 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45a806c350 msgr2=0x7f45a814f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:24.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.260+0000 7f45a7fff640 1 --2- 172.21.15.53:0/2190492898 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45a806c350 0x7f45a814f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:24.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.260+0000 7f45a7fff640 1 -- 172.21.15.53:0/2190492898 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45a80af760 msgr2=0x7f45a815a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:24.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.260+0000 7f45a7fff640 1 --2- 172.21.15.53:0/2190492898 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45a80af760 0x7f45a815a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:24.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.260+0000 7f45a7fff640 1 -- 172.21.15.53:0/2190492898 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4598009b30 con 0x7f45a80c97d0 2023-06-10T18:53:24.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.260+0000 7f45a7fff640 1 --2- 172.21.15.53:0/2190492898 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45a80c97d0 0x7f45a8150f40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f45a000d800 tx=0x7f45a000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:24.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.264+0000 7f458ffff640 1 -- 172.21.15.53:0/2190492898 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a000b6c0 con 0x7f45a80c97d0 2023-06-10T18:53:24.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.264+0000 7f458ffff640 1 -- 172.21.15.53:0/2190492898 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45a000b820 con 0x7f45a80c97d0 2023-06-10T18:53:24.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.264+0000 7f45adc42640 1 -- 172.21.15.53:0/2190492898 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45a815a130 con 0x7f45a80c97d0 2023-06-10T18:53:24.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.264+0000 7f458ffff640 1 -- 172.21.15.53:0/2190492898 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a000bbd0 con 0x7f45a80c97d0 2023-06-10T18:53:24.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.264+0000 7f45adc42640 1 -- 172.21.15.53:0/2190492898 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45a815ec50 con 0x7f45a80c97d0 2023-06-10T18:53:24.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.264+0000 7f45adc42640 1 -- 172.21.15.53:0/2190492898 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45a815a650 con 0x7f45a80c97d0 2023-06-10T18:53:24.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.264+0000 7f458ffff640 1 -- 172.21.15.53:0/2190492898 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f45a000bd30 con 0x7f45a80c97d0 2023-06-10T18:53:24.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.264+0000 7f458ffff640 1 --2- 172.21.15.53:0/2190492898 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4594066280 0x7f4594068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:24.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.264+0000 7f458ffff640 1 -- 172.21.15.53:0/2190492898 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f45a00841e0 con 0x7f45a80c97d0 2023-06-10T18:53:24.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.264+0000 7f45a77fe640 1 --2- 172.21.15.53:0/2190492898 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4594066280 0x7f4594068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:24.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.264+0000 7f45a77fe640 1 --2- 172.21.15.53:0/2190492898 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4594066280 0x7f4594068730 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f45980ae000 tx=0x7f45980a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:24.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.268+0000 7f458ffff640 1 -- 172.21.15.53:0/2190492898 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f45a815a650 con 0x7f45a80c97d0 2023-06-10T18:53:24.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.416+0000 7f45adc42640 1 -- 172.21.15.53:0/2190492898 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f45a815a650 con 0x7f45a80c97d0 2023-06-10T18:53:24.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.420+0000 7f458ffff640 1 -- 172.21.15.53:0/2190492898 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f45a815a650 con 0x7f45a80c97d0 2023-06-10T18:53:24.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.420+0000 7f45adc42640 1 -- 172.21.15.53:0/2190492898 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4594066280 msgr2=0x7f4594068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:24.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.420+0000 7f45adc42640 1 --2- 172.21.15.53:0/2190492898 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4594066280 0x7f4594068730 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f45980ae000 tx=0x7f45980a7070 comp rx=0 tx=0).stop 2023-06-10T18:53:24.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.420+0000 7f45adc42640 1 -- 172.21.15.53:0/2190492898 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45a80c97d0 msgr2=0x7f45a8150f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:24.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.420+0000 7f45adc42640 1 --2- 172.21.15.53:0/2190492898 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45a80c97d0 0x7f45a8150f40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f45a000d800 tx=0x7f45a000dcc0 comp rx=0 tx=0).stop 2023-06-10T18:53:24.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.420+0000 7f45adc42640 1 -- 172.21.15.53:0/2190492898 shutdown_connections 2023-06-10T18:53:24.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.420+0000 7f45adc42640 1 --2- 172.21.15.53:0/2190492898 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4594066280 0x7f4594068730 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:24.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.420+0000 7f45adc42640 1 --2- 172.21.15.53:0/2190492898 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45a80c97d0 0x7f45a8150f40 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:24.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.420+0000 7f45adc42640 1 --2- 172.21.15.53:0/2190492898 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45a80af760 0x7f45a815a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:24.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.420+0000 7f45adc42640 1 --2- 172.21.15.53:0/2190492898 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45a806c350 0x7f45a814f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:24.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.420+0000 7f45adc42640 1 -- 172.21.15.53:0/2190492898 >> 172.21.15.53:0/2190492898 conn(0x7f45a806a0e0 msgr2=0x7f45a80ae880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:24.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.420+0000 7f45adc42640 1 -- 172.21.15.53:0/2190492898 shutdown_connections 2023-06-10T18:53:24.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.420+0000 7f45adc42640 1 -- 172.21.15.53:0/2190492898 wait complete. 2023-06-10T18:53:24.445 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-06-10T18:53:24.446 DEBUG:teuthology.orchestra.run.smithi053:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-06-10T18:53:24.509 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-06-10T18:53:24.547 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-06-10T18:53:24.548 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T18:53:24.548 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T18:53:24.553 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T18:53:24.554 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T18:53:24.600 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T18:53:24.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.752+0000 7f7833e3d640 1 Processor -- start 2023-06-10T18:53:24.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.752+0000 7f7833e3d640 1 -- start start 2023-06-10T18:53:24.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.752+0000 7f7833e3d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f782c0b3ac0 0x7f782c0b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:24.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.752+0000 7f7833e3d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f782c0d14c0 0x7f782c15fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:24.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.752+0000 7f7833e3d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f782c0d0020 con 0x7f782c0cc690 2023-06-10T18:53:24.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.752+0000 7f7833e3d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f782c0b43d0 con 0x7f782c0d14c0 2023-06-10T18:53:24.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.752+0000 7f7833e3d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f782c0cef40 con 0x7f782c0b3ac0 2023-06-10T18:53:24.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.756+0000 7f78323da640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f782c0d14c0 0x7f782c15fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:24.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.756+0000 7f78323da640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f782c0d14c0 0x7f782c15fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50240/0 (socket says 172.21.15.53:50240) 2023-06-10T18:53:24.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.756+0000 7f78323da640 1 -- 172.21.15.53:0/1801146248 learned_addr learned my addr 172.21.15.53:0/1801146248 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:24.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.756+0000 7f7831bd9640 1 --2- 172.21.15.53:0/1801146248 >> v2:172.21.15.117:3300/0 conn(0x7f782c0b3ac0 0x7f782c0b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:24.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.756+0000 7f78323da640 1 -- 172.21.15.53:0/1801146248 >> v2:172.21.15.117:3300/0 conn(0x7f782c0b3ac0 msgr2=0x7f782c0b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:24.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.756+0000 7f78323da640 1 --2- 172.21.15.53:0/1801146248 >> v2:172.21.15.117:3300/0 conn(0x7f782c0b3ac0 0x7f782c0b3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:24.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.756+0000 7f78323da640 1 -- 172.21.15.53:0/1801146248 >> v1:172.21.15.117:6789/0 conn(0x7f782c0cc690 legacy=0x7f782c15f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:24.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.756+0000 7f78323da640 1 -- 172.21.15.53:0/1801146248 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f782c0cf220 con 0x7f782c0d14c0 2023-06-10T18:53:24.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.756+0000 7f78323da640 1 --2- 172.21.15.53:0/1801146248 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f782c0d14c0 0x7f782c15fa80 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f782c0b4ba0 tx=0x7f782801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a483cf67015158c server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:24.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.756+0000 7f7830bd7640 1 -- 172.21.15.53:0/1801146248 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78280ac640 con 0x7f782c0d14c0 2023-06-10T18:53:24.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.756+0000 7f7830bd7640 1 -- 172.21.15.53:0/1801146248 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78280ac7a0 con 0x7f782c0d14c0 2023-06-10T18:53:24.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.756+0000 7f7830bd7640 1 -- 172.21.15.53:0/1801146248 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78280acb30 con 0x7f782c0d14c0 2023-06-10T18:53:24.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.756+0000 7f7833e3d640 1 -- 172.21.15.53:0/1801146248 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f782c0d14c0 msgr2=0x7f782c15fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:24.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.756+0000 7f7833e3d640 1 --2- 172.21.15.53:0/1801146248 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f782c0d14c0 0x7f782c15fa80 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f782c0b4ba0 tx=0x7f782801c4d0 comp rx=0 tx=0).stop 2023-06-10T18:53:24.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.756+0000 7f7833e3d640 1 -- 172.21.15.53:0/1801146248 shutdown_connections 2023-06-10T18:53:24.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.756+0000 7f7833e3d640 1 --2- 172.21.15.53:0/1801146248 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f782c0d14c0 0x7f782c15fa80 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:24.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.756+0000 7f7833e3d640 1 --2- 172.21.15.53:0/1801146248 >> v2:172.21.15.117:3300/0 conn(0x7f782c0b3ac0 0x7f782c0b3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:24.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.756+0000 7f7833e3d640 1 -- 172.21.15.53:0/1801146248 >> 172.21.15.53:0/1801146248 conn(0x7f782c071790 msgr2=0x7f782c069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:24.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.756+0000 7f7833e3d640 1 -- 172.21.15.53:0/1801146248 shutdown_connections 2023-06-10T18:53:24.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.756+0000 7f7833e3d640 1 -- 172.21.15.53:0/1801146248 wait complete. 2023-06-10T18:53:24.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.760+0000 7f7833e3d640 1 Processor -- start 2023-06-10T18:53:24.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.760+0000 7f7833e3d640 1 -- start start 2023-06-10T18:53:24.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.760+0000 7f7833e3d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f782c0b3ac0 0x7f782c159830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:24.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.760+0000 7f7833e3d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f782c0cc690 0x7f782c1f44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:24.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.760+0000 7f7833e3d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f782c0d14c0 0x7f782c1f4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:24.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.760+0000 7f7833e3d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f782c0c6ca0 con 0x7f782c0d14c0 2023-06-10T18:53:24.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.760+0000 7f7833e3d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f782c15a080 con 0x7f782c0cc690 2023-06-10T18:53:24.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.760+0000 7f7833e3d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f782c15a360 con 0x7f782c0b3ac0 2023-06-10T18:53:24.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.760+0000 7f78323da640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f782c0d14c0 0x7f782c1f4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:24.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.760+0000 7f78323da640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f782c0d14c0 0x7f782c1f4a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50248/0 (socket says 172.21.15.53:50248) 2023-06-10T18:53:24.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.760+0000 7f78323da640 1 -- 172.21.15.53:0/1613142404 learned_addr learned my addr 172.21.15.53:0/1613142404 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:24.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.760+0000 7f7831bd9640 1 --2- 172.21.15.53:0/1613142404 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f782c0b3ac0 0x7f782c159830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:24.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.760+0000 7f78313d8640 1 --2- 172.21.15.53:0/1613142404 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f782c0cc690 0x7f782c1f44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:24.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.760+0000 7f78323da640 1 -- 172.21.15.53:0/1613142404 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f782c0b3ac0 msgr2=0x7f782c159830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:24.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.760+0000 7f78323da640 1 --2- 172.21.15.53:0/1613142404 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f782c0b3ac0 0x7f782c159830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:24.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.760+0000 7f78323da640 1 -- 172.21.15.53:0/1613142404 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f782c0cc690 msgr2=0x7f782c1f44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:24.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.760+0000 7f78323da640 1 --2- 172.21.15.53:0/1613142404 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f782c0cc690 0x7f782c1f44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:24.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.760+0000 7f78323da640 1 -- 172.21.15.53:0/1613142404 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78280094d0 con 0x7f782c0d14c0 2023-06-10T18:53:24.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.760+0000 7f78323da640 1 --2- 172.21.15.53:0/1613142404 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f782c0d14c0 0x7f782c1f4a30 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f78280af040 tx=0x7f7828019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:24.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.760+0000 7f781e7fc640 1 -- 172.21.15.53:0/1613142404 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78280b7670 con 0x7f782c0d14c0 2023-06-10T18:53:24.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.760+0000 7f781e7fc640 1 -- 172.21.15.53:0/1613142404 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78280b77d0 con 0x7f782c0d14c0 2023-06-10T18:53:24.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.760+0000 7f7833e3d640 1 -- 172.21.15.53:0/1613142404 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f782c15a640 con 0x7f782c0d14c0 2023-06-10T18:53:24.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.760+0000 7f781e7fc640 1 -- 172.21.15.53:0/1613142404 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78280b7b40 con 0x7f782c0d14c0 2023-06-10T18:53:24.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.760+0000 7f7833e3d640 1 -- 172.21.15.53:0/1613142404 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f782c0c6870 con 0x7f782c0d14c0 2023-06-10T18:53:24.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.760+0000 7f7833e3d640 1 -- 172.21.15.53:0/1613142404 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f782c0c6a60 con 0x7f782c0d14c0 2023-06-10T18:53:24.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.764+0000 7f781e7fc640 1 -- 172.21.15.53:0/1613142404 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f78280b3070 con 0x7f782c0d14c0 2023-06-10T18:53:24.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.764+0000 7f781e7fc640 1 --2- 172.21.15.53:0/1613142404 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7810066280 0x7f7810068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:24.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.764+0000 7f781e7fc640 1 -- 172.21.15.53:0/1613142404 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f782811e780 con 0x7f782c0d14c0 2023-06-10T18:53:24.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.764+0000 7f7831bd9640 1 --2- 172.21.15.53:0/1613142404 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7810066280 0x7f7810068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:24.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.764+0000 7f7831bd9640 1 --2- 172.21.15.53:0/1613142404 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7810066280 0x7f7810068730 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7824003fd0 tx=0x7f78240039a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:24.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.768+0000 7f781e7fc640 1 -- 172.21.15.53:0/1613142404 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f78280ebc10 con 0x7f782c0d14c0 2023-06-10T18:53:24.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.920+0000 7f7833e3d640 1 -- 172.21.15.53:0/1613142404 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f782c15a800 con 0x7f782c0d14c0 2023-06-10T18:53:24.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.924+0000 7f781e7fc640 1 -- 172.21.15.53:0/1613142404 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18267 (secure 0 0 0) 0x7f78280ef230 con 0x7f782c0d14c0 2023-06-10T18:53:24.934 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:53:24.935 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":23,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T18:52:45.921586+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-10T18:52:43.396243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-10T18:52:43.894228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T18:53:24.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.928+0000 7f7833e3d640 1 -- 172.21.15.53:0/1613142404 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7810066280 msgr2=0x7f7810068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:24.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.928+0000 7f7833e3d640 1 --2- 172.21.15.53:0/1613142404 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7810066280 0x7f7810068730 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7824003fd0 tx=0x7f78240039a0 comp rx=0 tx=0).stop 2023-06-10T18:53:24.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.928+0000 7f7833e3d640 1 -- 172.21.15.53:0/1613142404 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f782c0d14c0 msgr2=0x7f782c1f4a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:24.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.928+0000 7f7833e3d640 1 --2- 172.21.15.53:0/1613142404 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f782c0d14c0 0x7f782c1f4a30 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f78280af040 tx=0x7f7828019270 comp rx=0 tx=0).stop 2023-06-10T18:53:24.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.928+0000 7f7833e3d640 1 -- 172.21.15.53:0/1613142404 shutdown_connections 2023-06-10T18:53:24.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.928+0000 7f7833e3d640 1 --2- 172.21.15.53:0/1613142404 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7810066280 0x7f7810068730 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:24.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.928+0000 7f7833e3d640 1 --2- 172.21.15.53:0/1613142404 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f782c0d14c0 0x7f782c1f4a30 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:24.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.928+0000 7f7833e3d640 1 --2- 172.21.15.53:0/1613142404 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f782c0cc690 0x7f782c1f44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:24.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.928+0000 7f7833e3d640 1 --2- 172.21.15.53:0/1613142404 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f782c0b3ac0 0x7f782c159830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:24.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.928+0000 7f7833e3d640 1 -- 172.21.15.53:0/1613142404 >> 172.21.15.53:0/1613142404 conn(0x7f782c071790 msgr2=0x7f782c154770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:24.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.928+0000 7f7833e3d640 1 -- 172.21.15.53:0/1613142404 shutdown_connections 2023-06-10T18:53:24.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:24.928+0000 7f7833e3d640 1 -- 172.21.15.53:0/1613142404 wait complete. 2023-06-10T18:53:24.955 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-10T18:52:33.633114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-10T18:52:39.171487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-10T18:52:43.396243+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-10T18:52:43.894228+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-10T18:53:24.956 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-10T18:53:25.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.072+0000 7f692d5d8640 1 Processor -- start 2023-06-10T18:53:25.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.072+0000 7f692d5d8640 1 -- start start 2023-06-10T18:53:25.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.076+0000 7f692d5d8640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f692815fc10 0x7f69280b0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:25.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.076+0000 7f692d5d8640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f692815ffe0 0x7f69280c9e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:25.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.076+0000 7f692d5d8640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6928160990 con 0x7f69280ca350 2023-06-10T18:53:25.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.076+0000 7f692d5d8640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6928160c70 con 0x7f692815fc10 2023-06-10T18:53:25.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.076+0000 7f692d5d8640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6928160f50 con 0x7f692815ffe0 2023-06-10T18:53:25.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.076+0000 7f69277fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f69280ca350 0x7f69280ccea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:37256/0 (socket says 172.21.15.53:37256) 2023-06-10T18:53:25.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.076+0000 7f69277fe640 1 -- 172.21.15.53:0/4135302526 learned_addr learned my addr 172.21.15.53:0/4135302526 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:53:25.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.076+0000 7f69267fc640 1 --2- 172.21.15.53:0/4135302526 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f692815ffe0 0x7f69280c9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:25.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.076+0000 7f6926ffd640 1 --2- 172.21.15.53:0/4135302526 >> v2:172.21.15.117:3300/0 conn(0x7f692815fc10 0x7f69280b0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:25.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.076+0000 7f6925ffb640 1 -- 172.21.15.53:0/4135302526 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 929244488 0 0) 0x7f6928160990 con 0x7f69280ca350 2023-06-10T18:53:25.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.076+0000 7f6925ffb640 1 -- 172.21.15.53:0/4135302526 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6910003530 con 0x7f69280ca350 2023-06-10T18:53:25.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.076+0000 7f6925ffb640 1 -- 172.21.15.53:0/4135302526 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2143900738 0 0) 0x7f6910003530 con 0x7f69280ca350 2023-06-10T18:53:25.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.076+0000 7f6925ffb640 1 -- 172.21.15.53:0/4135302526 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f692815ffe0 msgr2=0x7f69280c9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:25.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.076+0000 7f6925ffb640 1 --2- 172.21.15.53:0/4135302526 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f692815ffe0 0x7f69280c9e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:25.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.076+0000 7f6925ffb640 1 -- 172.21.15.53:0/4135302526 >> v2:172.21.15.117:3300/0 conn(0x7f692815fc10 msgr2=0x7f69280b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:25.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.076+0000 7f6925ffb640 1 --2- 172.21.15.53:0/4135302526 >> v2:172.21.15.117:3300/0 conn(0x7f692815fc10 0x7f69280b0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:25.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.076+0000 7f6925ffb640 1 -- 172.21.15.53:0/4135302526 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69280c98f0 con 0x7f69280ca350 2023-06-10T18:53:25.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.076+0000 7f6925ffb640 1 -- 172.21.15.53:0/4135302526 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f6918001680 con 0x7f69280ca350 2023-06-10T18:53:25.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.076+0000 7f6925ffb640 1 -- 172.21.15.53:0/4135302526 >> v1:172.21.15.53:6789/0 conn(0x7f69280ca350 legacy=0x7f69280ccea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:25.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.076+0000 7f6925ffb640 1 --2- 172.21.15.53:0/4135302526 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6910003980 0x7f6910003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:25.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.076+0000 7f6925ffb640 1 --2- 172.21.15.53:0/4135302526 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f69100043b0 0x7f6910004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:25.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.076+0000 7f6925ffb640 1 --2- 172.21.15.53:0/4135302526 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f692815ffe0 0x7f6910004f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:25.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.076+0000 7f6925ffb640 1 -- 172.21.15.53:0/4135302526 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6928160c70 con 0x7f6910003980 2023-06-10T18:53:25.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.076+0000 7f6925ffb640 1 -- 172.21.15.53:0/4135302526 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6928160f50 con 0x7f69100043b0 2023-06-10T18:53:25.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.076+0000 7f6925ffb640 1 -- 172.21.15.53:0/4135302526 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f691000b990 con 0x7f692815ffe0 2023-06-10T18:53:25.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.076+0000 7f6926ffd640 1 --2- 172.21.15.53:0/4135302526 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6910003980 0x7f6910003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:25.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.076+0000 7f69267fc640 1 --2- 172.21.15.53:0/4135302526 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f69100043b0 0x7f6910004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:25.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.076+0000 7f6926ffd640 1 -- 172.21.15.53:0/4135302526 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f692815ffe0 msgr2=0x7f6910004f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:25.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.076+0000 7f6926ffd640 1 --2- 172.21.15.53:0/4135302526 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f692815ffe0 0x7f6910004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:25.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.076+0000 7f6926ffd640 1 -- 172.21.15.53:0/4135302526 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f69100043b0 msgr2=0x7f6910004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:25.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.076+0000 7f6926ffd640 1 --2- 172.21.15.53:0/4135302526 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f69100043b0 0x7f6910004870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:25.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.076+0000 7f6926ffd640 1 -- 172.21.15.53:0/4135302526 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6910003530 con 0x7f6910003980 2023-06-10T18:53:25.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.080+0000 7f6926ffd640 1 --2- 172.21.15.53:0/4135302526 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6910003980 0x7f6910003d90 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6920009fc0 tx=0x7f692001cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb1cc3aa6e742f9e server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:25.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.080+0000 7f6925ffb640 1 -- 172.21.15.53:0/4135302526 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69200a5c30 con 0x7f6910003980 2023-06-10T18:53:25.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.080+0000 7f6925ffb640 1 -- 172.21.15.53:0/4135302526 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f692000f040 con 0x7f6910003980 2023-06-10T18:53:25.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.080+0000 7f6925ffb640 1 -- 172.21.15.53:0/4135302526 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69200ad440 con 0x7f6910003980 2023-06-10T18:53:25.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.080+0000 7f692d5d8640 1 -- 172.21.15.53:0/4135302526 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6910003980 msgr2=0x7f6910003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:25.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.080+0000 7f692d5d8640 1 --2- 172.21.15.53:0/4135302526 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6910003980 0x7f6910003d90 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6920009fc0 tx=0x7f692001cca0 comp rx=0 tx=0).stop 2023-06-10T18:53:25.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.080+0000 7f69277fe640 1 -- 172.21.15.53:0/4135302526 reap_dead start 2023-06-10T18:53:25.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.080+0000 7f692d5d8640 1 -- 172.21.15.53:0/4135302526 shutdown_connections 2023-06-10T18:53:25.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.080+0000 7f692d5d8640 1 -- 172.21.15.53:0/4135302526 >> 172.21.15.53:0/4135302526 conn(0x7f692806a0e0 msgr2=0x7f69280cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:25.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.080+0000 7f692d5d8640 1 -- 172.21.15.53:0/4135302526 shutdown_connections 2023-06-10T18:53:25.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.080+0000 7f692d5d8640 1 -- 172.21.15.53:0/4135302526 wait complete. 2023-06-10T18:53:25.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.080+0000 7f692d5d8640 1 Processor -- start 2023-06-10T18:53:25.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.080+0000 7f692d5d8640 1 -- start start 2023-06-10T18:53:25.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.080+0000 7f692d5d8640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6910003980 0x7f692814a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:25.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.080+0000 7f692d5d8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f692806efe0 0x7f692815dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:25.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.080+0000 7f692d5d8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69280c4d20 0x7f69281694d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:25.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.080+0000 7f692d5d8640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f692806f450 con 0x7f69280c4d20 2023-06-10T18:53:25.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.080+0000 7f692d5d8640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f692815a5b0 con 0x7f692806efe0 2023-06-10T18:53:25.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.080+0000 7f692d5d8640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f692815a890 con 0x7f6910003980 2023-06-10T18:53:25.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.084+0000 7f69277fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69280c4d20 0x7f69281694d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:25.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.084+0000 7f69277fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69280c4d20 0x7f69281694d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50272/0 (socket says 172.21.15.53:50272) 2023-06-10T18:53:25.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.084+0000 7f69277fe640 1 -- 172.21.15.53:0/3145850745 learned_addr learned my addr 172.21.15.53:0/3145850745 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:25.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.084+0000 7f69267fc640 1 --2- 172.21.15.53:0/3145850745 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f692806efe0 0x7f692815dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:25.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.084+0000 7f6926ffd640 1 --2- 172.21.15.53:0/3145850745 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6910003980 0x7f692814a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:25.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.084+0000 7f69277fe640 1 -- 172.21.15.53:0/3145850745 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6910003980 msgr2=0x7f692814a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:25.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.084+0000 7f69277fe640 1 --2- 172.21.15.53:0/3145850745 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6910003980 0x7f692814a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:25.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.084+0000 7f69277fe640 1 -- 172.21.15.53:0/3145850745 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f692806efe0 msgr2=0x7f692815dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:25.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.084+0000 7f69277fe640 1 --2- 172.21.15.53:0/3145850745 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f692806efe0 0x7f692815dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:25.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.084+0000 7f69277fe640 1 -- 172.21.15.53:0/3145850745 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f692815ab70 con 0x7f69280c4d20 2023-06-10T18:53:25.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.084+0000 7f69277fe640 1 --2- 172.21.15.53:0/3145850745 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69280c4d20 0x7f69281694d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6918000f70 tx=0x7f691800c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:25.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.084+0000 7f690f7fe640 1 -- 172.21.15.53:0/3145850745 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691800cee0 con 0x7f69280c4d20 2023-06-10T18:53:25.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.084+0000 7f690f7fe640 1 -- 172.21.15.53:0/3145850745 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69180070d0 con 0x7f69280c4d20 2023-06-10T18:53:25.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.084+0000 7f692d5d8640 1 -- 172.21.15.53:0/3145850745 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6928158b00 con 0x7f69280c4d20 2023-06-10T18:53:25.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.084+0000 7f690f7fe640 1 -- 172.21.15.53:0/3145850745 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6918007480 con 0x7f69280c4d20 2023-06-10T18:53:25.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.084+0000 7f692d5d8640 1 -- 172.21.15.53:0/3145850745 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f692815e170 con 0x7f69280c4d20 2023-06-10T18:53:25.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.084+0000 7f692d5d8640 1 -- 172.21.15.53:0/3145850745 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f692804d790 con 0x7f69280c4d20 2023-06-10T18:53:25.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.084+0000 7f690f7fe640 1 -- 172.21.15.53:0/3145850745 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f69180047f0 con 0x7f69280c4d20 2023-06-10T18:53:25.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.084+0000 7f690f7fe640 1 --2- 172.21.15.53:0/3145850745 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6914066280 0x7f6914068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:25.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.084+0000 7f690f7fe640 1 -- 172.21.15.53:0/3145850745 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6918082f90 con 0x7f69280c4d20 2023-06-10T18:53:25.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.084+0000 7f6926ffd640 1 --2- 172.21.15.53:0/3145850745 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6914066280 0x7f6914068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:25.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.088+0000 7f6926ffd640 1 --2- 172.21.15.53:0/3145850745 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6914066280 0x7f6914068730 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f69200af000 tx=0x7f69200a7040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:25.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.088+0000 7f690f7fe640 1 -- 172.21.15.53:0/3145850745 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f69180504a0 con 0x7f69280c4d20 2023-06-10T18:53:25.246 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.236+0000 7f692d5d8640 1 -- 172.21.15.53:0/3145850745 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6928158fb0 con 0x7f69280c4d20 2023-06-10T18:53:25.246 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.236+0000 7f690f7fe640 1 -- 172.21.15.53:0/3145850745 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6918053ac0 con 0x7f69280c4d20 2023-06-10T18:53:25.247 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-06-10T18:53:25.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.240+0000 7f692d5d8640 1 -- 172.21.15.53:0/3145850745 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6914066280 msgr2=0x7f6914068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:25.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.240+0000 7f692d5d8640 1 --2- 172.21.15.53:0/3145850745 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6914066280 0x7f6914068730 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f69200af000 tx=0x7f69200a7040 comp rx=0 tx=0).stop 2023-06-10T18:53:25.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.240+0000 7f692d5d8640 1 -- 172.21.15.53:0/3145850745 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69280c4d20 msgr2=0x7f69281694d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:25.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.240+0000 7f692d5d8640 1 --2- 172.21.15.53:0/3145850745 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69280c4d20 0x7f69281694d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6918000f70 tx=0x7f691800c7c0 comp rx=0 tx=0).stop 2023-06-10T18:53:25.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.240+0000 7f692d5d8640 1 -- 172.21.15.53:0/3145850745 shutdown_connections 2023-06-10T18:53:25.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.240+0000 7f692d5d8640 1 --2- 172.21.15.53:0/3145850745 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6914066280 0x7f6914068730 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:25.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.240+0000 7f692d5d8640 1 --2- 172.21.15.53:0/3145850745 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69280c4d20 0x7f69281694d0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:25.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.240+0000 7f692d5d8640 1 --2- 172.21.15.53:0/3145850745 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f692806efe0 0x7f692815dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:25.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.240+0000 7f692d5d8640 1 --2- 172.21.15.53:0/3145850745 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6910003980 0x7f692814a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:25.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.240+0000 7f692d5d8640 1 -- 172.21.15.53:0/3145850745 >> 172.21.15.53:0/3145850745 conn(0x7f692806a0e0 msgr2=0x7f692815ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:25.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.240+0000 7f692d5d8640 1 -- 172.21.15.53:0/3145850745 shutdown_connections 2023-06-10T18:53:25.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.240+0000 7f692d5d8640 1 -- 172.21.15.53:0/3145850745 wait complete. 2023-06-10T18:53:25.263 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-10T18:53:25.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.372+0000 7f886c6e3640 1 Processor -- start 2023-06-10T18:53:25.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.372+0000 7f886c6e3640 1 -- start start 2023-06-10T18:53:25.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.376+0000 7f886c6e3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88640c9fa0 0x7f886406bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:25.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.376+0000 7f886c6e3640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f88640af760 0x7f88640afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:25.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.376+0000 7f886c6e3640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f886406b090 con 0x7f886406c020 2023-06-10T18:53:25.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.376+0000 7f886c6e3640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88640b0120 con 0x7f88640af760 2023-06-10T18:53:25.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.376+0000 7f886c6e3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88640ca370 con 0x7f88640c9fa0 2023-06-10T18:53:25.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.376+0000 7f886ac80640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f88640af760 0x7f88640afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:25.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.376+0000 7f886ac80640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f88640af760 0x7f88640afbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50286/0 (socket says 172.21.15.53:50286) 2023-06-10T18:53:25.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.376+0000 7f886ac80640 1 -- 172.21.15.53:0/2232068926 learned_addr learned my addr 172.21.15.53:0/2232068926 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:25.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.376+0000 7f886a47f640 1 --2- 172.21.15.53:0/2232068926 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88640c9fa0 0x7f886406bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:25.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.376+0000 7f886ac80640 1 -- 172.21.15.53:0/2232068926 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88640c9fa0 msgr2=0x7f886406bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:25.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.376+0000 7f886ac80640 1 --2- 172.21.15.53:0/2232068926 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88640c9fa0 0x7f886406bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:25.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.376+0000 7f886ac80640 1 -- 172.21.15.53:0/2232068926 >> v1:172.21.15.117:6789/0 conn(0x7f886406c020 legacy=0x7f88640c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:25.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.376+0000 7f886ac80640 1 -- 172.21.15.53:0/2232068926 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8864070d50 con 0x7f88640af760 2023-06-10T18:53:25.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.376+0000 7f886ac80640 1 --2- 172.21.15.53:0/2232068926 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88640af760 0x7f88640afbe0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f885c009e50 tx=0x7f885c01c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfeaf0f4f33a7bfe server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:25.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.376+0000 7f886947d640 1 -- 172.21.15.53:0/2232068926 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885c0a5720 con 0x7f88640af760 2023-06-10T18:53:25.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.376+0000 7f886947d640 1 -- 172.21.15.53:0/2232068926 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f885c0a5880 con 0x7f88640af760 2023-06-10T18:53:25.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.376+0000 7f886947d640 1 -- 172.21.15.53:0/2232068926 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885c0a5c10 con 0x7f88640af760 2023-06-10T18:53:25.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.380+0000 7f886c6e3640 1 -- 172.21.15.53:0/2232068926 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88640af760 msgr2=0x7f88640afbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:25.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.380+0000 7f886c6e3640 1 --2- 172.21.15.53:0/2232068926 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88640af760 0x7f88640afbe0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f885c009e50 tx=0x7f885c01c950 comp rx=0 tx=0).stop 2023-06-10T18:53:25.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.380+0000 7f886c6e3640 1 -- 172.21.15.53:0/2232068926 shutdown_connections 2023-06-10T18:53:25.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.380+0000 7f886c6e3640 1 --2- 172.21.15.53:0/2232068926 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88640af760 0x7f88640afbe0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:25.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.380+0000 7f886c6e3640 1 --2- 172.21.15.53:0/2232068926 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88640c9fa0 0x7f886406bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:25.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.380+0000 7f886c6e3640 1 -- 172.21.15.53:0/2232068926 >> 172.21.15.53:0/2232068926 conn(0x7f886406a0e0 msgr2=0x7f88640cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:25.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.380+0000 7f886c6e3640 1 -- 172.21.15.53:0/2232068926 shutdown_connections 2023-06-10T18:53:25.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.380+0000 7f886c6e3640 1 -- 172.21.15.53:0/2232068926 wait complete. 2023-06-10T18:53:25.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.380+0000 7f886c6e3640 1 Processor -- start 2023-06-10T18:53:25.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.380+0000 7f886c6e3640 1 -- start start 2023-06-10T18:53:25.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.380+0000 7f886c6e3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f886406c020 0x7f88641573b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:25.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.380+0000 7f886c6e3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88640af760 0x7f88640b2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:25.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.380+0000 7f886c6e3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88640c9fa0 0x7f88640b33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:25.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.380+0000 7f886c6e3640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88640c4740 con 0x7f88640af760 2023-06-10T18:53:25.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.380+0000 7f886c6e3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88640c36a0 con 0x7f886406c020 2023-06-10T18:53:25.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.380+0000 7f886c6e3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88640c3980 con 0x7f88640c9fa0 2023-06-10T18:53:25.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.380+0000 7f8869c7e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88640af760 0x7f88640b2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:25.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.380+0000 7f8869c7e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88640af760 0x7f88640b2ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50290/0 (socket says 172.21.15.53:50290) 2023-06-10T18:53:25.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.380+0000 7f8869c7e640 1 -- 172.21.15.53:0/606193814 learned_addr learned my addr 172.21.15.53:0/606193814 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:25.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.380+0000 7f886ac80640 1 --2- 172.21.15.53:0/606193814 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88640c9fa0 0x7f88640b33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:25.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.380+0000 7f886a47f640 1 --2- 172.21.15.53:0/606193814 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f886406c020 0x7f88641573b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:25.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.380+0000 7f8869c7e640 1 -- 172.21.15.53:0/606193814 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88640c9fa0 msgr2=0x7f88640b33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:25.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.380+0000 7f8869c7e640 1 --2- 172.21.15.53:0/606193814 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88640c9fa0 0x7f88640b33e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:25.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.380+0000 7f8869c7e640 1 -- 172.21.15.53:0/606193814 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f886406c020 msgr2=0x7f88641573b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:25.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.380+0000 7f8869c7e640 1 --2- 172.21.15.53:0/606193814 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f886406c020 0x7f88641573b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:25.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.380+0000 7f8869c7e640 1 -- 172.21.15.53:0/606193814 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f885c009b30 con 0x7f88640af760 2023-06-10T18:53:25.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.380+0000 7f886a47f640 1 --2- 172.21.15.53:0/606193814 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f886406c020 0x7f88641573b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:25.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.380+0000 7f8869c7e640 1 --2- 172.21.15.53:0/606193814 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88640af760 0x7f88640b2ea0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f885400c3c0 tx=0x7f885400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:25.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.380+0000 7f885affd640 1 -- 172.21.15.53:0/606193814 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88540052d0 con 0x7f88640af760 2023-06-10T18:53:25.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.380+0000 7f885affd640 1 -- 172.21.15.53:0/606193814 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8854005430 con 0x7f88640af760 2023-06-10T18:53:25.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.380+0000 7f885affd640 1 -- 172.21.15.53:0/606193814 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8854003840 con 0x7f88640af760 2023-06-10T18:53:25.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.380+0000 7f886c6e3640 1 -- 172.21.15.53:0/606193814 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88640c3c60 con 0x7f88640af760 2023-06-10T18:53:25.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.380+0000 7f886c6e3640 1 -- 172.21.15.53:0/606193814 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88640c4220 con 0x7f88640af760 2023-06-10T18:53:25.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.384+0000 7f886c6e3640 1 -- 172.21.15.53:0/606193814 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88640c8990 con 0x7f88640af760 2023-06-10T18:53:25.395 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.384+0000 7f885affd640 1 -- 172.21.15.53:0/606193814 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f88540039a0 con 0x7f88640af760 2023-06-10T18:53:25.395 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.384+0000 7f885affd640 1 --2- 172.21.15.53:0/606193814 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8848066280 0x7f8848068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:25.395 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.384+0000 7f885affd640 1 -- 172.21.15.53:0/606193814 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8854083270 con 0x7f88640af760 2023-06-10T18:53:25.395 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.384+0000 7f886a47f640 1 --2- 172.21.15.53:0/606193814 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8848066280 0x7f8848068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:25.395 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.384+0000 7f886a47f640 1 --2- 172.21.15.53:0/606193814 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8848066280 0x7f8848068730 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8860009ae0 tx=0x7f8860008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:25.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.388+0000 7f885affd640 1 -- 172.21.15.53:0/606193814 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f88640c8990 con 0x7f88640af760 2023-06-10T18:53:25.550 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.540+0000 7f886c6e3640 1 -- 172.21.15.53:0/606193814 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f88640c8990 con 0x7f88640af760 2023-06-10T18:53:25.550 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.540+0000 7f885affd640 1 -- 172.21.15.53:0/606193814 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f88640c8990 con 0x7f88640af760 2023-06-10T18:53:25.550 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-06-10T18:53:25.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.544+0000 7f886c6e3640 1 -- 172.21.15.53:0/606193814 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8848066280 msgr2=0x7f8848068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:25.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.544+0000 7f886c6e3640 1 --2- 172.21.15.53:0/606193814 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8848066280 0x7f8848068730 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8860009ae0 tx=0x7f8860008040 comp rx=0 tx=0).stop 2023-06-10T18:53:25.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.544+0000 7f886c6e3640 1 -- 172.21.15.53:0/606193814 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88640af760 msgr2=0x7f88640b2ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:25.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.544+0000 7f886c6e3640 1 --2- 172.21.15.53:0/606193814 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88640af760 0x7f88640b2ea0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f885400c3c0 tx=0x7f885400c880 comp rx=0 tx=0).stop 2023-06-10T18:53:25.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.544+0000 7f886c6e3640 1 -- 172.21.15.53:0/606193814 shutdown_connections 2023-06-10T18:53:25.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.544+0000 7f886c6e3640 1 --2- 172.21.15.53:0/606193814 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8848066280 0x7f8848068730 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:25.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.544+0000 7f886c6e3640 1 --2- 172.21.15.53:0/606193814 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88640c9fa0 0x7f88640b33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:25.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.544+0000 7f886c6e3640 1 --2- 172.21.15.53:0/606193814 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88640af760 0x7f88640b2ea0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:25.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.544+0000 7f886c6e3640 1 --2- 172.21.15.53:0/606193814 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f886406c020 0x7f88641573b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:25.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.544+0000 7f886c6e3640 1 -- 172.21.15.53:0/606193814 >> 172.21.15.53:0/606193814 conn(0x7f886406a0e0 msgr2=0x7f88640b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:25.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.544+0000 7f886c6e3640 1 -- 172.21.15.53:0/606193814 shutdown_connections 2023-06-10T18:53:25.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.544+0000 7f886c6e3640 1 -- 172.21.15.53:0/606193814 wait complete. 2023-06-10T18:53:25.569 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-10T18:53:25.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.684+0000 7fcb98959640 1 Processor -- start 2023-06-10T18:53:25.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.684+0000 7fcb98959640 1 -- start start 2023-06-10T18:53:25.695 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.684+0000 7fcb98959640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb940c9fa0 0x7fcb9406bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:25.695 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.684+0000 7fcb98959640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fcb9406c020 0x7fcb940c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:25.695 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.684+0000 7fcb98959640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fcb940c87e0 0x7fcb940af760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:25.696 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.684+0000 7fcb98959640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb9406b090 con 0x7fcb940c87e0 2023-06-10T18:53:25.696 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.684+0000 7fcb98959640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb940ca370 con 0x7fcb9406c020 2023-06-10T18:53:25.696 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.684+0000 7fcb98959640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb94070d50 con 0x7fcb940c9fa0 2023-06-10T18:53:25.697 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.684+0000 7fcb92d9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fcb940c87e0 0x7fcb940af760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:25.697 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.684+0000 7fcb92d9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fcb940c87e0 0x7fcb940af760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50304/0 (socket says 172.21.15.53:50304) 2023-06-10T18:53:25.697 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.684+0000 7fcb92d9d640 1 -- 172.21.15.53:0/1699562674 learned_addr learned my addr 172.21.15.53:0/1699562674 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:25.697 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.684+0000 7fcb9259c640 1 --2- 172.21.15.53:0/1699562674 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb940c9fa0 0x7fcb9406bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:25.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.684+0000 7fcb8bfff640 1 --2- 172.21.15.53:0/1699562674 >> v2:172.21.15.117:3300/0 conn(0x7fcb9406c020 0x7fcb940c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:25.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.684+0000 7fcb92d9d640 1 -- 172.21.15.53:0/1699562674 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb940c9fa0 msgr2=0x7fcb9406bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:25.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.684+0000 7fcb92d9d640 1 --2- 172.21.15.53:0/1699562674 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb940c9fa0 0x7fcb9406bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:25.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.684+0000 7fcb92d9d640 1 -- 172.21.15.53:0/1699562674 >> v2:172.21.15.117:3300/0 conn(0x7fcb9406c020 msgr2=0x7fcb940c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:25.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.684+0000 7fcb92d9d640 1 --2- 172.21.15.53:0/1699562674 >> v2:172.21.15.117:3300/0 conn(0x7fcb9406c020 0x7fcb940c82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:25.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.684+0000 7fcb92d9d640 1 -- 172.21.15.53:0/1699562674 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb94071030 con 0x7fcb940c87e0 2023-06-10T18:53:25.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.684+0000 7fcb8bfff640 1 --2- 172.21.15.53:0/1699562674 >> v2:172.21.15.117:3300/0 conn(0x7fcb9406c020 0x7fcb940c82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:53:25.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.688+0000 7fcb92d9d640 1 --2- 172.21.15.53:0/1699562674 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb940c87e0 0x7fcb940af760 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fcb9406e7f0 tx=0x7fcb8c01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ce5bcaa89f580bb server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:25.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.688+0000 7fcb91d9b640 1 -- 172.21.15.53:0/1699562674 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8c0a56a0 con 0x7fcb940c87e0 2023-06-10T18:53:25.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.688+0000 7fcb91d9b640 1 -- 172.21.15.53:0/1699562674 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb8c0a5800 con 0x7fcb940c87e0 2023-06-10T18:53:25.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.688+0000 7fcb91d9b640 1 -- 172.21.15.53:0/1699562674 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8c0a5b90 con 0x7fcb940c87e0 2023-06-10T18:53:25.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.688+0000 7fcb98959640 1 -- 172.21.15.53:0/1699562674 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb940c87e0 msgr2=0x7fcb940af760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:25.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.688+0000 7fcb98959640 1 --2- 172.21.15.53:0/1699562674 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb940c87e0 0x7fcb940af760 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fcb9406e7f0 tx=0x7fcb8c01c910 comp rx=0 tx=0).stop 2023-06-10T18:53:25.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.688+0000 7fcb98959640 1 -- 172.21.15.53:0/1699562674 shutdown_connections 2023-06-10T18:53:25.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.688+0000 7fcb98959640 1 --2- 172.21.15.53:0/1699562674 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb940c87e0 0x7fcb940af760 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:25.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.688+0000 7fcb98959640 1 --2- 172.21.15.53:0/1699562674 >> v2:172.21.15.117:3300/0 conn(0x7fcb9406c020 0x7fcb940c82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:25.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.688+0000 7fcb98959640 1 --2- 172.21.15.53:0/1699562674 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb940c9fa0 0x7fcb9406bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:25.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.688+0000 7fcb98959640 1 -- 172.21.15.53:0/1699562674 >> 172.21.15.53:0/1699562674 conn(0x7fcb9406a0e0 msgr2=0x7fcb940cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:25.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.688+0000 7fcb98959640 1 -- 172.21.15.53:0/1699562674 shutdown_connections 2023-06-10T18:53:25.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.688+0000 7fcb98959640 1 -- 172.21.15.53:0/1699562674 wait complete. 2023-06-10T18:53:25.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.688+0000 7fcb98959640 1 Processor -- start 2023-06-10T18:53:25.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.688+0000 7fcb98959640 1 -- start start 2023-06-10T18:53:25.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.688+0000 7fcb98959640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb9406c020 0x7fcb940c7130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:25.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.688+0000 7fcb98959640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb940c87e0 0x7fcb94159a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:25.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.688+0000 7fcb98959640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb940c9fa0 0x7fcb940a7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:25.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.688+0000 7fcb98959640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb9415a9c0 con 0x7fcb940c9fa0 2023-06-10T18:53:25.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.688+0000 7fcb98959640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb941460c0 con 0x7fcb9406c020 2023-06-10T18:53:25.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.688+0000 7fcb98959640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb94147800 con 0x7fcb940c87e0 2023-06-10T18:53:25.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.688+0000 7fcb92d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb940c9fa0 0x7fcb940a7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:25.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.688+0000 7fcb92d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb940c9fa0 0x7fcb940a7450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50308/0 (socket says 172.21.15.53:50308) 2023-06-10T18:53:25.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.688+0000 7fcb92d9d640 1 -- 172.21.15.53:0/2363081581 learned_addr learned my addr 172.21.15.53:0/2363081581 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:25.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.692+0000 7fcb9259c640 1 --2- 172.21.15.53:0/2363081581 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb9406c020 0x7fcb940c7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:25.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.692+0000 7fcb8bfff640 1 --2- 172.21.15.53:0/2363081581 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb940c87e0 0x7fcb94159a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:25.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.692+0000 7fcb92d9d640 1 -- 172.21.15.53:0/2363081581 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb940c87e0 msgr2=0x7fcb94159a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:25.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.692+0000 7fcb92d9d640 1 --2- 172.21.15.53:0/2363081581 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb940c87e0 0x7fcb94159a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:25.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.692+0000 7fcb92d9d640 1 -- 172.21.15.53:0/2363081581 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb9406c020 msgr2=0x7fcb940c7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:25.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.692+0000 7fcb92d9d640 1 --2- 172.21.15.53:0/2363081581 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb9406c020 0x7fcb940c7130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:25.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.692+0000 7fcb92d9d640 1 -- 172.21.15.53:0/2363081581 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb8c009b30 con 0x7fcb940c9fa0 2023-06-10T18:53:25.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.692+0000 7fcb92d9d640 1 --2- 172.21.15.53:0/2363081581 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb940c9fa0 0x7fcb940a7450 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c0af040 tx=0x7fcb8c0196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:25.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.692+0000 7fcb8affd640 1 -- 172.21.15.53:0/2363081581 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8c0b8670 con 0x7fcb940c9fa0 2023-06-10T18:53:25.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.692+0000 7fcb8affd640 1 -- 172.21.15.53:0/2363081581 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb8c0b87d0 con 0x7fcb940c9fa0 2023-06-10T18:53:25.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.692+0000 7fcb98959640 1 -- 172.21.15.53:0/2363081581 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb9415a400 con 0x7fcb940c9fa0 2023-06-10T18:53:25.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.692+0000 7fcb8affd640 1 -- 172.21.15.53:0/2363081581 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8c0b8b80 con 0x7fcb940c9fa0 2023-06-10T18:53:25.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.692+0000 7fcb98959640 1 -- 172.21.15.53:0/2363081581 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb94145d50 con 0x7fcb940c9fa0 2023-06-10T18:53:25.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.692+0000 7fcb98959640 1 -- 172.21.15.53:0/2363081581 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb94145ee0 con 0x7fcb940c9fa0 2023-06-10T18:53:25.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.692+0000 7fcb8affd640 1 -- 172.21.15.53:0/2363081581 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcb8c0b8ce0 con 0x7fcb940c9fa0 2023-06-10T18:53:25.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.692+0000 7fcb8affd640 1 --2- 172.21.15.53:0/2363081581 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcb740662b0 0x7fcb74068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:25.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.692+0000 7fcb8affd640 1 -- 172.21.15.53:0/2363081581 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcb8c11f130 con 0x7fcb940c9fa0 2023-06-10T18:53:25.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.692+0000 7fcb9259c640 1 --2- 172.21.15.53:0/2363081581 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcb740662b0 0x7fcb74068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:25.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.692+0000 7fcb9259c640 1 --2- 172.21.15.53:0/2363081581 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcb740662b0 0x7fcb74068760 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c009a50 tx=0x7fcb7c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:25.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.696+0000 7fcb8affd640 1 -- 172.21.15.53:0/2363081581 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcb8c0ec7b0 con 0x7fcb940c9fa0 2023-06-10T18:53:25.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.852+0000 7fcb98959640 1 -- 172.21.15.53:0/2363081581 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcb9404d790 con 0x7fcb940c9fa0 2023-06-10T18:53:25.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.852+0000 7fcb8affd640 1 -- 172.21.15.53:0/2363081581 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcb8c009510 con 0x7fcb940c9fa0 2023-06-10T18:53:25.863 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-06-10T18:53:25.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.856+0000 7fcb98959640 1 -- 172.21.15.53:0/2363081581 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcb740662b0 msgr2=0x7fcb74068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:25.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.856+0000 7fcb98959640 1 --2- 172.21.15.53:0/2363081581 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcb740662b0 0x7fcb74068760 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c009a50 tx=0x7fcb7c008040 comp rx=0 tx=0).stop 2023-06-10T18:53:25.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.856+0000 7fcb98959640 1 -- 172.21.15.53:0/2363081581 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb940c9fa0 msgr2=0x7fcb940a7450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:25.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.856+0000 7fcb98959640 1 --2- 172.21.15.53:0/2363081581 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb940c9fa0 0x7fcb940a7450 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c0af040 tx=0x7fcb8c0196b0 comp rx=0 tx=0).stop 2023-06-10T18:53:25.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.856+0000 7fcb98959640 1 -- 172.21.15.53:0/2363081581 shutdown_connections 2023-06-10T18:53:25.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.856+0000 7fcb98959640 1 --2- 172.21.15.53:0/2363081581 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcb740662b0 0x7fcb74068760 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:25.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.856+0000 7fcb98959640 1 --2- 172.21.15.53:0/2363081581 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb940c9fa0 0x7fcb940a7450 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:25.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.856+0000 7fcb98959640 1 --2- 172.21.15.53:0/2363081581 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb940c87e0 0x7fcb94159a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:25.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.856+0000 7fcb98959640 1 --2- 172.21.15.53:0/2363081581 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb9406c020 0x7fcb940c7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:25.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.856+0000 7fcb98959640 1 -- 172.21.15.53:0/2363081581 >> 172.21.15.53:0/2363081581 conn(0x7fcb9406a0e0 msgr2=0x7fcb940b18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:25.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.856+0000 7fcb98959640 1 -- 172.21.15.53:0/2363081581 shutdown_connections 2023-06-10T18:53:25.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:25.856+0000 7fcb98959640 1 -- 172.21.15.53:0/2363081581 wait complete. 2023-06-10T18:53:25.882 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-10T18:53:26.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.004+0000 7f4afc099640 1 Processor -- start 2023-06-10T18:53:26.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.004+0000 7f4afc099640 1 -- start start 2023-06-10T18:53:26.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.004+0000 7f4afc099640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4af40c9fa0 0x7f4af406bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:26.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.004+0000 7f4afc099640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4af406c020 0x7f4af40c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:26.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.004+0000 7f4afc099640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4af406b090 con 0x7f4af40c87e0 2023-06-10T18:53:26.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.004+0000 7f4afc099640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4af40ca370 con 0x7f4af406c020 2023-06-10T18:53:26.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.004+0000 7f4afc099640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4af4070d50 con 0x7f4af40c9fa0 2023-06-10T18:53:26.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.004+0000 7f4af9634640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4af406c020 0x7f4af40c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:26.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.004+0000 7f4afa636640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f4af40c87e0 0x7f4af40af760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:37262/0 (socket says 172.21.15.53:37262) 2023-06-10T18:53:26.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.004+0000 7f4afa636640 1 -- 172.21.15.53:0/3708904436 learned_addr learned my addr 172.21.15.53:0/3708904436 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:53:26.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.004+0000 7f4af9e35640 1 --2- 172.21.15.53:0/3708904436 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4af40c9fa0 0x7f4af406bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:26.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.004+0000 7f4af9634640 1 -- 172.21.15.53:0/3708904436 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4af40c9fa0 msgr2=0x7f4af406bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:26.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.004+0000 7f4af9634640 1 --2- 172.21.15.53:0/3708904436 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4af40c9fa0 0x7f4af406bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:26.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.004+0000 7f4af9634640 1 -- 172.21.15.53:0/3708904436 >> v1:172.21.15.53:6789/0 conn(0x7f4af40c87e0 legacy=0x7f4af40af760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:26.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.004+0000 7f4af8e33640 1 -- 172.21.15.53:0/3708904436 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2060862596 0 0) 0x7f4af406b090 con 0x7f4af40c87e0 2023-06-10T18:53:26.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.004+0000 7f4af9634640 1 -- 172.21.15.53:0/3708904436 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4af4071030 con 0x7f4af406c020 2023-06-10T18:53:26.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.008+0000 7f4af9634640 1 --2- 172.21.15.53:0/3708904436 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4af406c020 0x7f4af40c82a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f4ae40097c0 tx=0x7f4ae401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a628db30f00f20d server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:26.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.008+0000 7f4af8e33640 1 -- 172.21.15.53:0/3708904436 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae40ab600 con 0x7f4af406c020 2023-06-10T18:53:26.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.008+0000 7f4af8e33640 1 -- 172.21.15.53:0/3708904436 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ae40a7050 con 0x7f4af406c020 2023-06-10T18:53:26.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.008+0000 7f4af8e33640 1 -- 172.21.15.53:0/3708904436 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae40ab980 con 0x7f4af406c020 2023-06-10T18:53:26.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.008+0000 7f4afc099640 1 -- 172.21.15.53:0/3708904436 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4af406c020 msgr2=0x7f4af40c82a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:26.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.008+0000 7f4afc099640 1 --2- 172.21.15.53:0/3708904436 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4af406c020 0x7f4af40c82a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f4ae40097c0 tx=0x7f4ae401c3c0 comp rx=0 tx=0).stop 2023-06-10T18:53:26.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.008+0000 7f4afc099640 1 -- 172.21.15.53:0/3708904436 shutdown_connections 2023-06-10T18:53:26.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.008+0000 7f4afc099640 1 --2- 172.21.15.53:0/3708904436 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4af406c020 0x7f4af40c82a0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:26.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.008+0000 7f4afc099640 1 --2- 172.21.15.53:0/3708904436 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4af40c9fa0 0x7f4af406bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:26.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.008+0000 7f4afc099640 1 -- 172.21.15.53:0/3708904436 >> 172.21.15.53:0/3708904436 conn(0x7f4af406a0e0 msgr2=0x7f4af40cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:26.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.008+0000 7f4afc099640 1 -- 172.21.15.53:0/3708904436 shutdown_connections 2023-06-10T18:53:26.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.008+0000 7f4afc099640 1 -- 172.21.15.53:0/3708904436 wait complete. 2023-06-10T18:53:26.020 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.008+0000 7f4afc099640 1 Processor -- start 2023-06-10T18:53:26.020 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.008+0000 7f4afc099640 1 -- start start 2023-06-10T18:53:26.020 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.008+0000 7f4afc099640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4af406c020 0x7f4af4159a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:26.020 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.008+0000 7f4afc099640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4af40c87e0 0x7f4af40b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:26.020 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.008+0000 7f4afc099640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4af40c9fa0 0x7f4af40be130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:26.020 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.008+0000 7f4afc099640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af415bdb0 con 0x7f4af40c87e0 2023-06-10T18:53:26.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.008+0000 7f4afc099640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af415bfe0 con 0x7f4af406c020 2023-06-10T18:53:26.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.008+0000 7f4afc099640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4af415c280 con 0x7f4af40c9fa0 2023-06-10T18:53:26.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.008+0000 7f4af9634640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4af40c87e0 0x7f4af40b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:26.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.008+0000 7f4af9634640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4af40c87e0 0x7f4af40b1dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50328/0 (socket says 172.21.15.53:50328) 2023-06-10T18:53:26.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.008+0000 7f4af9634640 1 -- 172.21.15.53:0/91717854 learned_addr learned my addr 172.21.15.53:0/91717854 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:26.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.008+0000 7f4af9634640 1 -- 172.21.15.53:0/91717854 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4af40c9fa0 msgr2=0x7f4af40be130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:26.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.008+0000 7f4af9634640 1 --2- 172.21.15.53:0/91717854 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4af40c9fa0 0x7f4af40be130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:26.022 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.008+0000 7f4af9634640 1 -- 172.21.15.53:0/91717854 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4af406c020 msgr2=0x7f4af4159a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:26.022 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.012+0000 7f4af9634640 1 --2- 172.21.15.53:0/91717854 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4af406c020 0x7f4af4159a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:26.022 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.012+0000 7f4af9634640 1 -- 172.21.15.53:0/91717854 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ae4009420 con 0x7f4af40c87e0 2023-06-10T18:53:26.022 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.012+0000 7f4af9634640 1 --2- 172.21.15.53:0/91717854 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4af40c87e0 0x7f4af40b1dc0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f4ae401aa70 tx=0x7f4ae4019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:26.022 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.012+0000 7f4aea7fc640 1 -- 172.21.15.53:0/91717854 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae4004230 con 0x7f4af40c87e0 2023-06-10T18:53:26.022 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.012+0000 7f4aea7fc640 1 -- 172.21.15.53:0/91717854 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ae4004390 con 0x7f4af40c87e0 2023-06-10T18:53:26.022 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.012+0000 7f4aea7fc640 1 -- 172.21.15.53:0/91717854 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae4003820 con 0x7f4af40c87e0 2023-06-10T18:53:26.023 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.012+0000 7f4afc099640 1 -- 172.21.15.53:0/91717854 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4af415c560 con 0x7f4af40c87e0 2023-06-10T18:53:26.023 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.012+0000 7f4afc099640 1 -- 172.21.15.53:0/91717854 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4af40c2400 con 0x7f4af40c87e0 2023-06-10T18:53:26.023 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.012+0000 7f4afc099640 1 -- 172.21.15.53:0/91717854 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4af40c25f0 con 0x7f4af40c87e0 2023-06-10T18:53:26.024 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.012+0000 7f4aea7fc640 1 -- 172.21.15.53:0/91717854 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4ae40b2040 con 0x7f4af40c87e0 2023-06-10T18:53:26.024 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.012+0000 7f4aea7fc640 1 --2- 172.21.15.53:0/91717854 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4ad80662b0 0x7f4ad8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:26.024 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.012+0000 7f4aea7fc640 1 -- 172.21.15.53:0/91717854 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4ae411dc40 con 0x7f4af40c87e0 2023-06-10T18:53:26.024 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.012+0000 7f4af9e35640 1 --2- 172.21.15.53:0/91717854 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4ad80662b0 0x7f4ad8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:26.024 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.012+0000 7f4af9e35640 1 --2- 172.21.15.53:0/91717854 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4ad80662b0 0x7f4ad8068760 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4af00070b0 tx=0x7f4af0007040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:26.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.016+0000 7f4aea7fc640 1 -- 172.21.15.53:0/91717854 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4ae40eb150 con 0x7f4af40c87e0 2023-06-10T18:53:26.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.176+0000 7f4afc099640 1 -- 172.21.15.53:0/91717854 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4af404d790 con 0x7f4af40c87e0 2023-06-10T18:53:26.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.176+0000 7f4aea7fc640 1 -- 172.21.15.53:0/91717854 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4ae40c2020 con 0x7f4af40c87e0 2023-06-10T18:53:26.187 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-06-10T18:53:26.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.180+0000 7f4afc099640 1 -- 172.21.15.53:0/91717854 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4ad80662b0 msgr2=0x7f4ad8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:26.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.180+0000 7f4afc099640 1 --2- 172.21.15.53:0/91717854 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4ad80662b0 0x7f4ad8068760 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4af00070b0 tx=0x7f4af0007040 comp rx=0 tx=0).stop 2023-06-10T18:53:26.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.180+0000 7f4afc099640 1 -- 172.21.15.53:0/91717854 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4af40c87e0 msgr2=0x7f4af40b1dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:26.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.180+0000 7f4afc099640 1 --2- 172.21.15.53:0/91717854 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4af40c87e0 0x7f4af40b1dc0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f4ae401aa70 tx=0x7f4ae4019160 comp rx=0 tx=0).stop 2023-06-10T18:53:26.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.180+0000 7f4afc099640 1 -- 172.21.15.53:0/91717854 shutdown_connections 2023-06-10T18:53:26.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.180+0000 7f4afc099640 1 --2- 172.21.15.53:0/91717854 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4ad80662b0 0x7f4ad8068760 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:26.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.180+0000 7f4afc099640 1 --2- 172.21.15.53:0/91717854 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4af40c9fa0 0x7f4af40be130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:26.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.180+0000 7f4afc099640 1 --2- 172.21.15.53:0/91717854 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4af40c87e0 0x7f4af40b1dc0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:26.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.180+0000 7f4afc099640 1 --2- 172.21.15.53:0/91717854 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4af406c020 0x7f4af4159a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:26.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.180+0000 7f4afc099640 1 -- 172.21.15.53:0/91717854 >> 172.21.15.53:0/91717854 conn(0x7f4af406a0e0 msgr2=0x7f4af40ae720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:26.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.180+0000 7f4afc099640 1 -- 172.21.15.53:0/91717854 shutdown_connections 2023-06-10T18:53:26.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.180+0000 7f4afc099640 1 -- 172.21.15.53:0/91717854 wait complete. 2023-06-10T18:53:26.206 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-10T18:53:26.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.320+0000 7f41e58e4640 1 Processor -- start 2023-06-10T18:53:26.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.320+0000 7f41e58e4640 1 -- start start 2023-06-10T18:53:26.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.320+0000 7f41e58e4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41e0152e70 0x7f41e00c8d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:26.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.320+0000 7f41e58e4640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f41e006bc30 0x7f41e015c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:26.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.320+0000 7f41e58e4640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41e015cbd0 con 0x7f41e015c240 2023-06-10T18:53:26.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.320+0000 7f41e58e4640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41e015d090 con 0x7f41e006bc30 2023-06-10T18:53:26.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.320+0000 7f41e58e4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41e00cdac0 con 0x7f41e0152e70 2023-06-10T18:53:26.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.324+0000 7f41df7fe640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f41e006bc30 0x7f41e015c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:26.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.324+0000 7f41deffd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41e0152e70 0x7f41e00c8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:26.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.324+0000 7f41d7fff640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f41e015c240 0x7f41e0158c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.53:46472/0 (socket says 172.21.15.53:46472) 2023-06-10T18:53:26.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.324+0000 7f41d7fff640 1 -- 172.21.15.53:0/3180948651 learned_addr learned my addr 172.21.15.53:0/3180948651 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:53:26.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.324+0000 7f41df7fe640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f41e006bc30 0x7f41e015c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.53:52488/0 (socket says 172.21.15.53:52488) 2023-06-10T18:53:26.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.324+0000 7f41df7fe640 1 -- 172.21.15.53:0/3180948651 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41e0152e70 msgr2=0x7f41e00c8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:26.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.324+0000 7f41df7fe640 1 --2- 172.21.15.53:0/3180948651 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41e0152e70 0x7f41e00c8d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:26.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.324+0000 7f41df7fe640 1 -- 172.21.15.53:0/3180948651 >> v1:172.21.15.117:6789/0 conn(0x7f41e015c240 legacy=0x7f41e0158c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:26.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.324+0000 7f41df7fe640 1 -- 172.21.15.53:0/3180948651 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41e00ccf40 con 0x7f41e006bc30 2023-06-10T18:53:26.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.324+0000 7f41deffd640 1 --2- 172.21.15.53:0/3180948651 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41e0152e70 0x7f41e00c8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-10T18:53:26.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.324+0000 7f41df7fe640 1 --2- 172.21.15.53:0/3180948651 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41e006bc30 0x7f41e015c690 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f41d8009dc0 tx=0x7f41d801c900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1c9e78a75dc3537 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:26.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.324+0000 7f41de7fc640 1 -- 172.21.15.53:0/3180948651 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d80a59c0 con 0x7f41e006bc30 2023-06-10T18:53:26.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.324+0000 7f41de7fc640 1 -- 172.21.15.53:0/3180948651 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41d80a5b20 con 0x7f41e006bc30 2023-06-10T18:53:26.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.324+0000 7f41de7fc640 1 -- 172.21.15.53:0/3180948651 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d80ad440 con 0x7f41e006bc30 2023-06-10T18:53:26.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.328+0000 7f41e58e4640 1 -- 172.21.15.53:0/3180948651 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41e006bc30 msgr2=0x7f41e015c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:26.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.328+0000 7f41e58e4640 1 --2- 172.21.15.53:0/3180948651 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41e006bc30 0x7f41e015c690 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f41d8009dc0 tx=0x7f41d801c900 comp rx=0 tx=0).stop 2023-06-10T18:53:26.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.328+0000 7f41e58e4640 1 -- 172.21.15.53:0/3180948651 shutdown_connections 2023-06-10T18:53:26.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.328+0000 7f41e58e4640 1 --2- 172.21.15.53:0/3180948651 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41e006bc30 0x7f41e015c690 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:26.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.328+0000 7f41e58e4640 1 --2- 172.21.15.53:0/3180948651 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41e0152e70 0x7f41e00c8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:26.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.328+0000 7f41e58e4640 1 -- 172.21.15.53:0/3180948651 >> 172.21.15.53:0/3180948651 conn(0x7f41e00ce9e0 msgr2=0x7f41e00ca7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:26.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.328+0000 7f41e58e4640 1 -- 172.21.15.53:0/3180948651 shutdown_connections 2023-06-10T18:53:26.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.328+0000 7f41e58e4640 1 -- 172.21.15.53:0/3180948651 wait complete. 2023-06-10T18:53:26.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.328+0000 7f41e58e4640 1 Processor -- start 2023-06-10T18:53:26.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.328+0000 7f41e58e4640 1 -- start start 2023-06-10T18:53:26.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.328+0000 7f41e58e4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41e006bc30 0x7f41e014de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:26.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.328+0000 7f41e58e4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41e0152e70 0x7f41e0159cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:26.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.328+0000 7f41e58e4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f41e015c240 0x7f41e015a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:26.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.328+0000 7f41e58e4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e014cd80 con 0x7f41e015c240 2023-06-10T18:53:26.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.328+0000 7f41e58e4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e014d060 con 0x7f41e006bc30 2023-06-10T18:53:26.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.328+0000 7f41e58e4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41e014d340 con 0x7f41e0152e70 2023-06-10T18:53:26.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.328+0000 7f41df7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f41e015c240 0x7f41e015a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:26.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.328+0000 7f41df7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f41e015c240 0x7f41e015a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50340/0 (socket says 172.21.15.53:50340) 2023-06-10T18:53:26.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.328+0000 7f41df7fe640 1 -- 172.21.15.53:0/2314347292 learned_addr learned my addr 172.21.15.53:0/2314347292 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:26.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.328+0000 7f41d7fff640 1 --2- 172.21.15.53:0/2314347292 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41e0152e70 0x7f41e0159cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:26.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.328+0000 7f41deffd640 1 --2- 172.21.15.53:0/2314347292 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41e006bc30 0x7f41e014de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:26.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.328+0000 7f41df7fe640 1 -- 172.21.15.53:0/2314347292 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41e0152e70 msgr2=0x7f41e0159cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:26.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.328+0000 7f41df7fe640 1 --2- 172.21.15.53:0/2314347292 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41e0152e70 0x7f41e0159cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:26.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.328+0000 7f41df7fe640 1 -- 172.21.15.53:0/2314347292 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41e006bc30 msgr2=0x7f41e014de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:26.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.328+0000 7f41df7fe640 1 --2- 172.21.15.53:0/2314347292 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41e006bc30 0x7f41e014de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:26.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.328+0000 7f41df7fe640 1 -- 172.21.15.53:0/2314347292 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41d00093b0 con 0x7f41e015c240 2023-06-10T18:53:26.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.328+0000 7f41d7fff640 1 --2- 172.21.15.53:0/2314347292 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41e0152e70 0x7f41e0159cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:53:26.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.328+0000 7f41deffd640 1 --2- 172.21.15.53:0/2314347292 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41e006bc30 0x7f41e014de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:53:26.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.328+0000 7f41df7fe640 1 --2- 172.21.15.53:0/2314347292 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f41e015c240 0x7f41e015a210 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f41d801a530 tx=0x7f41d80196a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:26.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.328+0000 7f41dcff9640 1 -- 172.21.15.53:0/2314347292 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d80add70 con 0x7f41e015c240 2023-06-10T18:53:26.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.328+0000 7f41dcff9640 1 -- 172.21.15.53:0/2314347292 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41d8009450 con 0x7f41e015c240 2023-06-10T18:53:26.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.328+0000 7f41e58e4640 1 -- 172.21.15.53:0/2314347292 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41d8009a70 con 0x7f41e015c240 2023-06-10T18:53:26.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.328+0000 7f41dcff9640 1 -- 172.21.15.53:0/2314347292 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d80b9690 con 0x7f41e015c240 2023-06-10T18:53:26.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.328+0000 7f41e58e4640 1 -- 172.21.15.53:0/2314347292 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41e014d900 con 0x7f41e015c240 2023-06-10T18:53:26.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.332+0000 7f41e58e4640 1 -- 172.21.15.53:0/2314347292 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41e004d790 con 0x7f41e015c240 2023-06-10T18:53:26.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.332+0000 7f41dcff9640 1 -- 172.21.15.53:0/2314347292 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f41d80b97f0 con 0x7f41e015c240 2023-06-10T18:53:26.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.332+0000 7f41dcff9640 1 --2- 172.21.15.53:0/2314347292 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f41c0066280 0x7f41c0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:26.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.332+0000 7f41dcff9640 1 -- 172.21.15.53:0/2314347292 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f41d811f440 con 0x7f41e015c240 2023-06-10T18:53:26.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.332+0000 7f41deffd640 1 --2- 172.21.15.53:0/2314347292 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f41c0066280 0x7f41c0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:26.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.332+0000 7f41deffd640 1 --2- 172.21.15.53:0/2314347292 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f41c0066280 0x7f41c0068730 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f41d0009d20 tx=0x7f41d0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:26.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.336+0000 7f41dcff9640 1 -- 172.21.15.53:0/2314347292 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f41d80ec800 con 0x7f41e015c240 2023-06-10T18:53:26.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.500+0000 7f41e58e4640 1 -- 172.21.15.53:0/2314347292 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f41e014ebd0 con 0x7f41e015c240 2023-06-10T18:53:26.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.504+0000 7f41dcff9640 1 -- 172.21.15.53:0/2314347292 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f41d80efe20 con 0x7f41e015c240 2023-06-10T18:53:26.512 INFO:teuthology.orchestra.run.smithi053.stderr:listed 0 entries 2023-06-10T18:53:26.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.504+0000 7f41e58e4640 1 -- 172.21.15.53:0/2314347292 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f41c0066280 msgr2=0x7f41c0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:26.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.504+0000 7f41e58e4640 1 --2- 172.21.15.53:0/2314347292 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f41c0066280 0x7f41c0068730 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f41d0009d20 tx=0x7f41d0008040 comp rx=0 tx=0).stop 2023-06-10T18:53:26.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.504+0000 7f41e58e4640 1 -- 172.21.15.53:0/2314347292 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f41e015c240 msgr2=0x7f41e015a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:26.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.504+0000 7f41e58e4640 1 --2- 172.21.15.53:0/2314347292 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f41e015c240 0x7f41e015a210 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f41d801a530 tx=0x7f41d80196a0 comp rx=0 tx=0).stop 2023-06-10T18:53:26.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.504+0000 7f41e58e4640 1 -- 172.21.15.53:0/2314347292 shutdown_connections 2023-06-10T18:53:26.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.504+0000 7f41e58e4640 1 --2- 172.21.15.53:0/2314347292 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f41c0066280 0x7f41c0068730 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:26.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.504+0000 7f41e58e4640 1 --2- 172.21.15.53:0/2314347292 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f41e015c240 0x7f41e015a210 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:26.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.504+0000 7f41e58e4640 1 --2- 172.21.15.53:0/2314347292 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41e0152e70 0x7f41e0159cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:26.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.504+0000 7f41e58e4640 1 --2- 172.21.15.53:0/2314347292 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41e006bc30 0x7f41e014de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:26.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.504+0000 7f41e58e4640 1 -- 172.21.15.53:0/2314347292 >> 172.21.15.53:0/2314347292 conn(0x7f41e00ce9e0 msgr2=0x7f41e006f830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:26.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.504+0000 7f41e58e4640 1 -- 172.21.15.53:0/2314347292 shutdown_connections 2023-06-10T18:53:26.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.504+0000 7f41e58e4640 1 -- 172.21.15.53:0/2314347292 wait complete. 2023-06-10T18:53:26.531 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T18:53:26.531 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T18:53:26.538 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T18:53:26.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.704+0000 7f5f675e9640 1 Processor -- start 2023-06-10T18:53:26.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.704+0000 7f5f675e9640 1 -- start start 2023-06-10T18:53:26.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.704+0000 7f5f675e9640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5f6006b2f0 0x7f5f6006f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:26.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.704+0000 7f5f675e9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f600c8d00 0x7f5f6006b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:26.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.704+0000 7f5f675e9640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f60158a90 con 0x7f5f6006bc00 2023-06-10T18:53:26.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.704+0000 7f5f675e9640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f600705d0 con 0x7f5f6006b2f0 2023-06-10T18:53:26.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.704+0000 7f5f675e9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6006f9c0 con 0x7f5f600c8d00 2023-06-10T18:53:26.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.704+0000 7f5f65385640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5f6006b2f0 0x7f5f6006f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:26.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.704+0000 7f5f64b84640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f600c8d00 0x7f5f6006b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:26.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.704+0000 7f5f65b86640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f5f6006bc00 0x7f5f600cbe00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.53:46480/0 (socket says 172.21.15.53:46480) 2023-06-10T18:53:26.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.704+0000 7f5f65385640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5f6006b2f0 0x7f5f6006f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.53:52512/0 (socket says 172.21.15.53:52512) 2023-06-10T18:53:26.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.704+0000 7f5f65b86640 1 -- 172.21.15.53:0/2453796267 learned_addr learned my addr 172.21.15.53:0/2453796267 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:53:26.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.704+0000 7f5f65385640 1 -- 172.21.15.53:0/2453796267 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f600c8d00 msgr2=0x7f5f6006b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:26.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.704+0000 7f5f65385640 1 --2- 172.21.15.53:0/2453796267 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f600c8d00 0x7f5f6006b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:26.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.704+0000 7f5f65385640 1 -- 172.21.15.53:0/2453796267 >> v1:172.21.15.117:6789/0 conn(0x7f5f6006bc00 legacy=0x7f5f600cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:26.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.704+0000 7f5f65385640 1 -- 172.21.15.53:0/2453796267 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f6006fca0 con 0x7f5f6006b2f0 2023-06-10T18:53:26.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.708+0000 7f5f65385640 1 --2- 172.21.15.53:0/2453796267 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f6006b2f0 0x7f5f6006f070 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c0097f0 tx=0x7f5f5c01ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92695334b8088e0c server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:26.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.708+0000 7f5f57fff640 1 -- 172.21.15.53:0/2453796267 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5c0a8970 con 0x7f5f6006b2f0 2023-06-10T18:53:26.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.708+0000 7f5f57fff640 1 -- 172.21.15.53:0/2453796267 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f5c0a8ad0 con 0x7f5f6006b2f0 2023-06-10T18:53:26.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.708+0000 7f5f57fff640 1 -- 172.21.15.53:0/2453796267 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5c0a8e60 con 0x7f5f6006b2f0 2023-06-10T18:53:26.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.708+0000 7f5f675e9640 1 -- 172.21.15.53:0/2453796267 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f6006b2f0 msgr2=0x7f5f6006f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:26.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.708+0000 7f5f675e9640 1 --2- 172.21.15.53:0/2453796267 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f6006b2f0 0x7f5f6006f070 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c0097f0 tx=0x7f5f5c01ec70 comp rx=0 tx=0).stop 2023-06-10T18:53:26.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.708+0000 7f5f675e9640 1 -- 172.21.15.53:0/2453796267 shutdown_connections 2023-06-10T18:53:26.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.708+0000 7f5f675e9640 1 --2- 172.21.15.53:0/2453796267 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f600c8d00 0x7f5f6006b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:26.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.708+0000 7f5f675e9640 1 --2- 172.21.15.53:0/2453796267 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f6006b2f0 0x7f5f6006f070 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:26.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.708+0000 7f5f675e9640 1 -- 172.21.15.53:0/2453796267 >> 172.21.15.53:0/2453796267 conn(0x7f5f6006a0d0 msgr2=0x7f5f600ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:26.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.708+0000 7f5f675e9640 1 -- 172.21.15.53:0/2453796267 shutdown_connections 2023-06-10T18:53:26.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.708+0000 7f5f675e9640 1 -- 172.21.15.53:0/2453796267 wait complete. 2023-06-10T18:53:26.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.708+0000 7f5f675e9640 1 Processor -- start 2023-06-10T18:53:26.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.708+0000 7f5f675e9640 1 -- start start 2023-06-10T18:53:26.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.708+0000 7f5f675e9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5f6006bc00 0x7f5f60159a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:26.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.708+0000 7f5f675e9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f600c8d00 0x7f5f600c3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:26.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.708+0000 7f5f675e9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f6015add0 0x7f5f600c6f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:26.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.708+0000 7f5f675e9640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6015b680 con 0x7f5f6006bc00 2023-06-10T18:53:26.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.708+0000 7f5f675e9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f600b0b70 con 0x7f5f600c8d00 2023-06-10T18:53:26.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.708+0000 7f5f675e9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f600b0e50 con 0x7f5f6015add0 2023-06-10T18:53:26.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.708+0000 7f5f65385640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5f6006bc00 0x7f5f60159a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:26.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.708+0000 7f5f65385640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5f6006bc00 0x7f5f60159a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50344/0 (socket says 172.21.15.53:50344) 2023-06-10T18:53:26.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.708+0000 7f5f65385640 1 -- 172.21.15.53:0/1896533554 learned_addr learned my addr 172.21.15.53:0/1896533554 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:26.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.708+0000 7f5f64b84640 1 --2- 172.21.15.53:0/1896533554 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f600c8d00 0x7f5f600c3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:26.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.708+0000 7f5f65b86640 1 --2- 172.21.15.53:0/1896533554 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f6015add0 0x7f5f600c6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:26.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.708+0000 7f5f65385640 1 -- 172.21.15.53:0/1896533554 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f6015add0 msgr2=0x7f5f600c6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:26.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.708+0000 7f5f65385640 1 --2- 172.21.15.53:0/1896533554 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f6015add0 0x7f5f600c6f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:26.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.708+0000 7f5f65385640 1 -- 172.21.15.53:0/1896533554 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f600c8d00 msgr2=0x7f5f600c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:26.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.708+0000 7f5f65385640 1 --2- 172.21.15.53:0/1896533554 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f600c8d00 0x7f5f600c3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:26.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.712+0000 7f5f65385640 1 -- 172.21.15.53:0/1896533554 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f5c009420 con 0x7f5f6006bc00 2023-06-10T18:53:26.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.712+0000 7f5f65385640 1 --2- 172.21.15.53:0/1896533554 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5f6006bc00 0x7f5f60159a00 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c0b3040 tx=0x7f5f5c01ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:26.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.712+0000 7f5f55ffb640 1 -- 172.21.15.53:0/1896533554 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5c0b9630 con 0x7f5f6006bc00 2023-06-10T18:53:26.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.712+0000 7f5f55ffb640 1 -- 172.21.15.53:0/1896533554 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f5c0b97b0 con 0x7f5f6006bc00 2023-06-10T18:53:26.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.712+0000 7f5f675e9640 1 -- 172.21.15.53:0/1896533554 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f600b1130 con 0x7f5f6006bc00 2023-06-10T18:53:26.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.712+0000 7f5f55ffb640 1 -- 172.21.15.53:0/1896533554 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5c0b9b60 con 0x7f5f6006bc00 2023-06-10T18:53:26.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.712+0000 7f5f675e9640 1 -- 172.21.15.53:0/1896533554 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f6015b960 con 0x7f5f6006bc00 2023-06-10T18:53:26.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.712+0000 7f5f675e9640 1 -- 172.21.15.53:0/1896533554 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f6004d790 con 0x7f5f6006bc00 2023-06-10T18:53:26.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.712+0000 7f5f55ffb640 1 -- 172.21.15.53:0/1896533554 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5f5c0b7040 con 0x7f5f6006bc00 2023-06-10T18:53:26.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.712+0000 7f5f55ffb640 1 --2- 172.21.15.53:0/1896533554 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5f44066280 0x7f5f44068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:26.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.712+0000 7f5f55ffb640 1 -- 172.21.15.53:0/1896533554 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f5f5c121bf0 con 0x7f5f6006bc00 2023-06-10T18:53:26.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.712+0000 7f5f64b84640 1 --2- 172.21.15.53:0/1896533554 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5f44066280 0x7f5f44068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:26.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.712+0000 7f5f64b84640 1 --2- 172.21.15.53:0/1896533554 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5f44066280 0x7f5f44068730 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5f600c8020 tx=0x7f5f50008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:26.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.716+0000 7f5f55ffb640 1 -- 172.21.15.53:0/1896533554 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5f5c0ef0c0 con 0x7f5f6006bc00 2023-06-10T18:53:26.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.876+0000 7f5f675e9640 1 -- 172.21.15.53:0/1896533554 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5f600ca7c0 con 0x7f5f6006bc00 2023-06-10T18:53:26.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.876+0000 7f5f55ffb640 1 -- 172.21.15.53:0/1896533554 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18363 (secure 0 0 0) 0x7f5f5c0b5090 con 0x7f5f6006bc00 2023-06-10T18:53:26.886 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:53:26.886 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":24,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T18:53:26.110006+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-10T18:52:43.396243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-10T18:52:43.894228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.23","mappings":[{"from":3,"to":2}]},{"pgid":"4.3e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T18:53:26.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.880+0000 7f5f675e9640 1 -- 172.21.15.53:0/1896533554 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5f44066280 msgr2=0x7f5f44068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:26.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.880+0000 7f5f675e9640 1 --2- 172.21.15.53:0/1896533554 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5f44066280 0x7f5f44068730 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5f600c8020 tx=0x7f5f50008040 comp rx=0 tx=0).stop 2023-06-10T18:53:26.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.880+0000 7f5f675e9640 1 -- 172.21.15.53:0/1896533554 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5f6006bc00 msgr2=0x7f5f60159a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:26.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.880+0000 7f5f675e9640 1 --2- 172.21.15.53:0/1896533554 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5f6006bc00 0x7f5f60159a00 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c0b3040 tx=0x7f5f5c01ba10 comp rx=0 tx=0).stop 2023-06-10T18:53:26.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.880+0000 7f5f675e9640 1 -- 172.21.15.53:0/1896533554 shutdown_connections 2023-06-10T18:53:26.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.880+0000 7f5f675e9640 1 --2- 172.21.15.53:0/1896533554 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5f44066280 0x7f5f44068730 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:26.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.880+0000 7f5f675e9640 1 --2- 172.21.15.53:0/1896533554 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f6015add0 0x7f5f600c6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:26.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.880+0000 7f5f675e9640 1 --2- 172.21.15.53:0/1896533554 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f600c8d00 0x7f5f600c3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:26.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.880+0000 7f5f675e9640 1 --2- 172.21.15.53:0/1896533554 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5f6006bc00 0x7f5f60159a00 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:26.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.880+0000 7f5f675e9640 1 -- 172.21.15.53:0/1896533554 >> 172.21.15.53:0/1896533554 conn(0x7f5f6006a0d0 msgr2=0x7f5f600ac3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:26.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.880+0000 7f5f675e9640 1 -- 172.21.15.53:0/1896533554 shutdown_connections 2023-06-10T18:53:26.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:26.880+0000 7f5f675e9640 1 -- 172.21.15.53:0/1896533554 wait complete. 2023-06-10T18:53:26.906 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-10T18:52:33.633114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-10T18:52:39.171487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-10T18:52:43.396243+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-10T18:52:43.894228+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-10T18:53:26.907 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-10T18:53:27.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.020+0000 7fb847408640 1 Processor -- start 2023-06-10T18:53:27.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.020+0000 7fb847408640 1 -- start start 2023-06-10T18:53:27.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.024+0000 7fb847408640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8400c9fa0 0x7fb84006bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:27.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.024+0000 7fb847408640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb8400af760 0x7fb8400afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:27.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.024+0000 7fb847408640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb84006b090 con 0x7fb84006c020 2023-06-10T18:53:27.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.024+0000 7fb847408640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8400b0120 con 0x7fb8400af760 2023-06-10T18:53:27.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.024+0000 7fb847408640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8400ca370 con 0x7fb8400c9fa0 2023-06-10T18:53:27.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.024+0000 7fb8459a5640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb8400af760 0x7fb8400afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:27.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.024+0000 7fb8449a3640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fb84006c020 0x7fb8400c82a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:37270/0 (socket says 172.21.15.53:37270) 2023-06-10T18:53:27.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.024+0000 7fb8449a3640 1 -- 172.21.15.53:0/2352205508 learned_addr learned my addr 172.21.15.53:0/2352205508 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:53:27.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.024+0000 7fb8451a4640 1 --2- 172.21.15.53:0/2352205508 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8400c9fa0 0x7fb84006bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:27.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.024+0000 7fb8459a5640 1 -- 172.21.15.53:0/2352205508 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8400c9fa0 msgr2=0x7fb84006bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:27.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.024+0000 7fb8459a5640 1 --2- 172.21.15.53:0/2352205508 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8400c9fa0 0x7fb84006bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:27.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.024+0000 7fb8459a5640 1 -- 172.21.15.53:0/2352205508 >> v1:172.21.15.53:6789/0 conn(0x7fb84006c020 legacy=0x7fb8400c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:27.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.024+0000 7fb83ffff640 1 -- 172.21.15.53:0/2352205508 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3137615778 0 0) 0x7fb84006b090 con 0x7fb84006c020 2023-06-10T18:53:27.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.024+0000 7fb8459a5640 1 -- 172.21.15.53:0/2352205508 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb840070d50 con 0x7fb8400af760 2023-06-10T18:53:27.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.024+0000 7fb8451a4640 1 --2- 172.21.15.53:0/2352205508 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8400c9fa0 0x7fb84006bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:27.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.024+0000 7fb8459a5640 1 --2- 172.21.15.53:0/2352205508 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8400af760 0x7fb8400afbe0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb8380097c0 tx=0x7fb83801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25a15b4572599c7d server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:27.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.024+0000 7fb83ffff640 1 -- 172.21.15.53:0/2352205508 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8380ac620 con 0x7fb8400af760 2023-06-10T18:53:27.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.024+0000 7fb83ffff640 1 -- 172.21.15.53:0/2352205508 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8380ac780 con 0x7fb8400af760 2023-06-10T18:53:27.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.024+0000 7fb83ffff640 1 -- 172.21.15.53:0/2352205508 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8380acb10 con 0x7fb8400af760 2023-06-10T18:53:27.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.024+0000 7fb847408640 1 -- 172.21.15.53:0/2352205508 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8400af760 msgr2=0x7fb8400afbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:27.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.024+0000 7fb847408640 1 --2- 172.21.15.53:0/2352205508 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8400af760 0x7fb8400afbe0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb8380097c0 tx=0x7fb83801c3c0 comp rx=0 tx=0).stop 2023-06-10T18:53:27.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.028+0000 7fb847408640 1 -- 172.21.15.53:0/2352205508 shutdown_connections 2023-06-10T18:53:27.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.028+0000 7fb847408640 1 --2- 172.21.15.53:0/2352205508 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8400af760 0x7fb8400afbe0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:27.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.028+0000 7fb847408640 1 --2- 172.21.15.53:0/2352205508 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8400c9fa0 0x7fb84006bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:27.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.028+0000 7fb847408640 1 -- 172.21.15.53:0/2352205508 >> 172.21.15.53:0/2352205508 conn(0x7fb84006a0e0 msgr2=0x7fb8400cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:27.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.028+0000 7fb847408640 1 -- 172.21.15.53:0/2352205508 shutdown_connections 2023-06-10T18:53:27.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.028+0000 7fb847408640 1 -- 172.21.15.53:0/2352205508 wait complete. 2023-06-10T18:53:27.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.028+0000 7fb847408640 1 Processor -- start 2023-06-10T18:53:27.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.028+0000 7fb847408640 1 -- start start 2023-06-10T18:53:27.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.028+0000 7fb847408640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb84006c020 0x7fb8400c3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:27.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.028+0000 7fb847408640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8400af760 0x7fb8400c4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:27.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.028+0000 7fb847408640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8400c9fa0 0x7fb840154b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:27.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.028+0000 7fb847408640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8401f35d0 con 0x7fb84006c020 2023-06-10T18:53:27.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.028+0000 7fb847408640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8400c6010 con 0x7fb8400c9fa0 2023-06-10T18:53:27.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.028+0000 7fb847408640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8400c5770 con 0x7fb8400af760 2023-06-10T18:53:27.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.028+0000 7fb8451a4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb84006c020 0x7fb8400c3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:27.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.028+0000 7fb8451a4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb84006c020 0x7fb8400c3b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50360/0 (socket says 172.21.15.53:50360) 2023-06-10T18:53:27.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.028+0000 7fb8451a4640 1 -- 172.21.15.53:0/3140498345 learned_addr learned my addr 172.21.15.53:0/3140498345 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:27.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.028+0000 7fb8449a3640 1 --2- 172.21.15.53:0/3140498345 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8400af760 0x7fb8400c4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:27.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.028+0000 7fb8459a5640 1 --2- 172.21.15.53:0/3140498345 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8400c9fa0 0x7fb840154b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:27.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.028+0000 7fb8451a4640 1 -- 172.21.15.53:0/3140498345 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8400af760 msgr2=0x7fb8400c4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:27.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.028+0000 7fb8451a4640 1 --2- 172.21.15.53:0/3140498345 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8400af760 0x7fb8400c4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:27.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.028+0000 7fb8451a4640 1 -- 172.21.15.53:0/3140498345 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8400c9fa0 msgr2=0x7fb840154b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:27.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.028+0000 7fb8451a4640 1 --2- 172.21.15.53:0/3140498345 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8400c9fa0 0x7fb840154b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:27.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.028+0000 7fb8451a4640 1 -- 172.21.15.53:0/3140498345 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb838009420 con 0x7fb84006c020 2023-06-10T18:53:27.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.028+0000 7fb8451a4640 1 --2- 172.21.15.53:0/3140498345 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb84006c020 0x7fb8400c3b40 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb83000ce00 tx=0x7fb83000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:27.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.028+0000 7fb83dffb640 1 -- 172.21.15.53:0/3140498345 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83000f890 con 0x7fb84006c020 2023-06-10T18:53:27.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.028+0000 7fb83dffb640 1 -- 172.21.15.53:0/3140498345 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb83000f9f0 con 0x7fb84006c020 2023-06-10T18:53:27.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.028+0000 7fb847408640 1 -- 172.21.15.53:0/3140498345 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8400c5a50 con 0x7fb84006c020 2023-06-10T18:53:27.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.028+0000 7fb83dffb640 1 -- 172.21.15.53:0/3140498345 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83000fdc0 con 0x7fb84006c020 2023-06-10T18:53:27.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.028+0000 7fb847408640 1 -- 172.21.15.53:0/3140498345 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8400c64d0 con 0x7fb84006c020 2023-06-10T18:53:27.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.032+0000 7fb847408640 1 -- 172.21.15.53:0/3140498345 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb84004d790 con 0x7fb84006c020 2023-06-10T18:53:27.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.032+0000 7fb83dffb640 1 -- 172.21.15.53:0/3140498345 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb83000b040 con 0x7fb84006c020 2023-06-10T18:53:27.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.032+0000 7fb83dffb640 1 --2- 172.21.15.53:0/3140498345 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb82c0662b0 0x7fb82c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:27.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.032+0000 7fb83dffb640 1 -- 172.21.15.53:0/3140498345 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fb830084660 con 0x7fb84006c020 2023-06-10T18:53:27.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.032+0000 7fb8449a3640 1 --2- 172.21.15.53:0/3140498345 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb82c0662b0 0x7fb82c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:27.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.032+0000 7fb8449a3640 1 --2- 172.21.15.53:0/3140498345 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb82c0662b0 0x7fb82c068760 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb8400ae830 tx=0x7fb834007b60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:27.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.036+0000 7fb83dffb640 1 -- 172.21.15.53:0/3140498345 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb830051b30 con 0x7fb84006c020 2023-06-10T18:53:27.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.192+0000 7fb847408640 1 -- 172.21.15.53:0/3140498345 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb84006b590 con 0x7fb84006c020 2023-06-10T18:53:27.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.192+0000 7fb83dffb640 1 -- 172.21.15.53:0/3140498345 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb830055150 con 0x7fb84006c020 2023-06-10T18:53:27.201 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-06-10T18:53:27.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.192+0000 7fb847408640 1 -- 172.21.15.53:0/3140498345 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb82c0662b0 msgr2=0x7fb82c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:27.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.192+0000 7fb847408640 1 --2- 172.21.15.53:0/3140498345 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb82c0662b0 0x7fb82c068760 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb8400ae830 tx=0x7fb834007b60 comp rx=0 tx=0).stop 2023-06-10T18:53:27.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.192+0000 7fb847408640 1 -- 172.21.15.53:0/3140498345 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb84006c020 msgr2=0x7fb8400c3b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:27.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.192+0000 7fb847408640 1 --2- 172.21.15.53:0/3140498345 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb84006c020 0x7fb8400c3b40 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb83000ce00 tx=0x7fb83000a650 comp rx=0 tx=0).stop 2023-06-10T18:53:27.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.192+0000 7fb847408640 1 -- 172.21.15.53:0/3140498345 shutdown_connections 2023-06-10T18:53:27.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.192+0000 7fb847408640 1 --2- 172.21.15.53:0/3140498345 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb82c0662b0 0x7fb82c068760 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:27.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.192+0000 7fb847408640 1 --2- 172.21.15.53:0/3140498345 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8400c9fa0 0x7fb840154b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:27.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.192+0000 7fb847408640 1 --2- 172.21.15.53:0/3140498345 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8400af760 0x7fb8400c4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:27.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.192+0000 7fb847408640 1 --2- 172.21.15.53:0/3140498345 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb84006c020 0x7fb8400c3b40 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:27.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.192+0000 7fb847408640 1 -- 172.21.15.53:0/3140498345 >> 172.21.15.53:0/3140498345 conn(0x7fb84006a0e0 msgr2=0x7fb8400b1c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:27.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.192+0000 7fb847408640 1 -- 172.21.15.53:0/3140498345 shutdown_connections 2023-06-10T18:53:27.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.196+0000 7fb847408640 1 -- 172.21.15.53:0/3140498345 wait complete. 2023-06-10T18:53:27.222 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-10T18:53:27.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.336+0000 7fe123626640 1 Processor -- start 2023-06-10T18:53:27.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.336+0000 7fe123626640 1 -- start start 2023-06-10T18:53:27.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.336+0000 7fe123626640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe11c0c9fa0 0x7fe11c06bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:27.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.336+0000 7fe123626640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe11c0af760 0x7fe11c0afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:27.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.336+0000 7fe123626640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe11c06b090 con 0x7fe11c06c020 2023-06-10T18:53:27.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.336+0000 7fe123626640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe11c0b0120 con 0x7fe11c0af760 2023-06-10T18:53:27.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.336+0000 7fe123626640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe11c0ca370 con 0x7fe11c0c9fa0 2023-06-10T18:53:27.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.336+0000 7fe1213c2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe11c0c9fa0 0x7fe11c06bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:27.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.336+0000 7fe121bc3640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe11c0af760 0x7fe11c0afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:27.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.336+0000 7fe120bc1640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fe11c06c020 0x7fe11c0c82a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.53:46494/0 (socket says 172.21.15.53:46494) 2023-06-10T18:53:27.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.336+0000 7fe1213c2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe11c0c9fa0 0x7fe11c06bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.53:48050/0 (socket says 172.21.15.53:48050) 2023-06-10T18:53:27.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.336+0000 7fe120bc1640 1 -- 172.21.15.53:0/2793809776 learned_addr learned my addr 172.21.15.53:0/2793809776 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:53:27.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.336+0000 7fe121bc3640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe11c0af760 0x7fe11c0afbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.53:52534/0 (socket says 172.21.15.53:52534) 2023-06-10T18:53:27.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.336+0000 7fe121bc3640 1 -- 172.21.15.53:0/2793809776 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe11c0c9fa0 msgr2=0x7fe11c06bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:27.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.336+0000 7fe121bc3640 1 --2- 172.21.15.53:0/2793809776 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe11c0c9fa0 0x7fe11c06bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:27.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.336+0000 7fe121bc3640 1 -- 172.21.15.53:0/2793809776 >> v1:172.21.15.117:6789/0 conn(0x7fe11c06c020 legacy=0x7fe11c0c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:27.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.336+0000 7fe121bc3640 1 -- 172.21.15.53:0/2793809776 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe11c070d50 con 0x7fe11c0af760 2023-06-10T18:53:27.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.336+0000 7fe113fff640 1 -- 172.21.15.53:0/2793809776 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2926046648 0 0) 0x7fe11c06b090 con 0x7fe11c06c020 2023-06-10T18:53:27.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.336+0000 7fe1213c2640 1 --2- 172.21.15.53:0/2793809776 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe11c0c9fa0 0x7fe11c06bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-10T18:53:27.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.340+0000 7fe121bc3640 1 --2- 172.21.15.53:0/2793809776 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe11c0af760 0x7fe11c0afbe0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe114009d90 tx=0x7fe11401c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27538b221e594977 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:27.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.340+0000 7fe113fff640 1 -- 172.21.15.53:0/2793809776 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1140a5950 con 0x7fe11c0af760 2023-06-10T18:53:27.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.340+0000 7fe113fff640 1 -- 172.21.15.53:0/2793809776 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1140a5ab0 con 0x7fe11c0af760 2023-06-10T18:53:27.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.340+0000 7fe113fff640 1 -- 172.21.15.53:0/2793809776 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1140a5e40 con 0x7fe11c0af760 2023-06-10T18:53:27.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.340+0000 7fe123626640 1 -- 172.21.15.53:0/2793809776 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe11c0af760 msgr2=0x7fe11c0afbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:27.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.340+0000 7fe123626640 1 --2- 172.21.15.53:0/2793809776 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe11c0af760 0x7fe11c0afbe0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe114009d90 tx=0x7fe11401c890 comp rx=0 tx=0).stop 2023-06-10T18:53:27.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.340+0000 7fe123626640 1 -- 172.21.15.53:0/2793809776 shutdown_connections 2023-06-10T18:53:27.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.340+0000 7fe123626640 1 --2- 172.21.15.53:0/2793809776 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe11c0af760 0x7fe11c0afbe0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:27.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.340+0000 7fe123626640 1 --2- 172.21.15.53:0/2793809776 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe11c0c9fa0 0x7fe11c06bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:27.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.340+0000 7fe123626640 1 -- 172.21.15.53:0/2793809776 >> 172.21.15.53:0/2793809776 conn(0x7fe11c06a0e0 msgr2=0x7fe11c0cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:27.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.340+0000 7fe123626640 1 -- 172.21.15.53:0/2793809776 shutdown_connections 2023-06-10T18:53:27.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.340+0000 7fe123626640 1 -- 172.21.15.53:0/2793809776 wait complete. 2023-06-10T18:53:27.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.340+0000 7fe123626640 1 Processor -- start 2023-06-10T18:53:27.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.340+0000 7fe123626640 1 -- start start 2023-06-10T18:53:27.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.344+0000 7fe123626640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe11c06c020 0x7fe11c0c3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:27.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.344+0000 7fe123626640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe11c0af760 0x7fe11c0a7660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:27.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.344+0000 7fe123626640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe11c0c9fa0 0x7fe11c0a7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:27.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.344+0000 7fe123626640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe11c0c7bf0 con 0x7fe11c06c020 2023-06-10T18:53:27.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.344+0000 7fe123626640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe11c0a80e0 con 0x7fe11c0c9fa0 2023-06-10T18:53:27.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.344+0000 7fe123626640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe11c0c7910 con 0x7fe11c0af760 2023-06-10T18:53:27.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.344+0000 7fe1213c2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe11c06c020 0x7fe11c0c3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:27.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.344+0000 7fe1213c2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe11c06c020 0x7fe11c0c3dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50364/0 (socket says 172.21.15.53:50364) 2023-06-10T18:53:27.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.344+0000 7fe1213c2640 1 -- 172.21.15.53:0/3509965538 learned_addr learned my addr 172.21.15.53:0/3509965538 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:27.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.344+0000 7fe120bc1640 1 --2- 172.21.15.53:0/3509965538 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe11c0af760 0x7fe11c0a7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:27.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.344+0000 7fe121bc3640 1 --2- 172.21.15.53:0/3509965538 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe11c0c9fa0 0x7fe11c0a7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:27.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.344+0000 7fe1213c2640 1 -- 172.21.15.53:0/3509965538 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe11c0af760 msgr2=0x7fe11c0a7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:27.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.344+0000 7fe1213c2640 1 --2- 172.21.15.53:0/3509965538 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe11c0af760 0x7fe11c0a7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:27.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.344+0000 7fe1213c2640 1 -- 172.21.15.53:0/3509965538 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe11c0c9fa0 msgr2=0x7fe11c0a7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:27.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.344+0000 7fe1213c2640 1 --2- 172.21.15.53:0/3509965538 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe11c0c9fa0 0x7fe11c0a7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:27.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.344+0000 7fe1213c2640 1 -- 172.21.15.53:0/3509965538 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe10c009420 con 0x7fe11c06c020 2023-06-10T18:53:27.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.344+0000 7fe1213c2640 1 --2- 172.21.15.53:0/3509965538 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe11c06c020 0x7fe11c0c3dd0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe10c00e980 tx=0x7fe10c00ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:27.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.344+0000 7fe111ffb640 1 -- 172.21.15.53:0/3509965538 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe10c00ca00 con 0x7fe11c06c020 2023-06-10T18:53:27.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.344+0000 7fe111ffb640 1 -- 172.21.15.53:0/3509965538 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe10c00cb60 con 0x7fe11c06c020 2023-06-10T18:53:27.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.344+0000 7fe123626640 1 -- 172.21.15.53:0/3509965538 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe114009a70 con 0x7fe11c06c020 2023-06-10T18:53:27.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.344+0000 7fe111ffb640 1 -- 172.21.15.53:0/3509965538 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe10c013470 con 0x7fe11c06c020 2023-06-10T18:53:27.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.344+0000 7fe123626640 1 -- 172.21.15.53:0/3509965538 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe11c0a8610 con 0x7fe11c06c020 2023-06-10T18:53:27.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.344+0000 7fe123626640 1 -- 172.21.15.53:0/3509965538 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe11c04d790 con 0x7fe11c06c020 2023-06-10T18:53:27.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.344+0000 7fe111ffb640 1 -- 172.21.15.53:0/3509965538 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe10c0135d0 con 0x7fe11c06c020 2023-06-10T18:53:27.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.344+0000 7fe111ffb640 1 --2- 172.21.15.53:0/3509965538 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe1000662b0 0x7fe100068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:27.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.344+0000 7fe111ffb640 1 -- 172.21.15.53:0/3509965538 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fe10c083f70 con 0x7fe11c06c020 2023-06-10T18:53:27.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.344+0000 7fe120bc1640 1 --2- 172.21.15.53:0/3509965538 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe1000662b0 0x7fe100068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:27.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.348+0000 7fe120bc1640 1 --2- 172.21.15.53:0/3509965538 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe1000662b0 0x7fe100068760 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe11c0b3b10 tx=0x7fe118007b60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:27.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.348+0000 7fe111ffb640 1 -- 172.21.15.53:0/3509965538 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe10c0b4700 con 0x7fe11c06c020 2023-06-10T18:53:27.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.508+0000 7fe123626640 1 -- 172.21.15.53:0/3509965538 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe11c0ce670 con 0x7fe11c06c020 2023-06-10T18:53:27.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.508+0000 7fe111ffb640 1 -- 172.21.15.53:0/3509965538 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe10c0170a0 con 0x7fe11c06c020 2023-06-10T18:53:27.517 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-06-10T18:53:27.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.508+0000 7fe123626640 1 -- 172.21.15.53:0/3509965538 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe1000662b0 msgr2=0x7fe100068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:27.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.508+0000 7fe123626640 1 --2- 172.21.15.53:0/3509965538 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe1000662b0 0x7fe100068760 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe11c0b3b10 tx=0x7fe118007b60 comp rx=0 tx=0).stop 2023-06-10T18:53:27.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.508+0000 7fe123626640 1 -- 172.21.15.53:0/3509965538 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe11c06c020 msgr2=0x7fe11c0c3dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:27.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.508+0000 7fe123626640 1 --2- 172.21.15.53:0/3509965538 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe11c06c020 0x7fe11c0c3dd0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe10c00e980 tx=0x7fe10c00ee40 comp rx=0 tx=0).stop 2023-06-10T18:53:27.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.508+0000 7fe123626640 1 -- 172.21.15.53:0/3509965538 shutdown_connections 2023-06-10T18:53:27.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.508+0000 7fe123626640 1 --2- 172.21.15.53:0/3509965538 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe1000662b0 0x7fe100068760 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:27.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.508+0000 7fe123626640 1 --2- 172.21.15.53:0/3509965538 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe11c0c9fa0 0x7fe11c0a7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:27.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.508+0000 7fe123626640 1 --2- 172.21.15.53:0/3509965538 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe11c0af760 0x7fe11c0a7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:27.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.508+0000 7fe123626640 1 --2- 172.21.15.53:0/3509965538 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe11c06c020 0x7fe11c0c3dd0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:27.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.508+0000 7fe123626640 1 -- 172.21.15.53:0/3509965538 >> 172.21.15.53:0/3509965538 conn(0x7fe11c06a0e0 msgr2=0x7fe11c158f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:27.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.508+0000 7fe123626640 1 -- 172.21.15.53:0/3509965538 shutdown_connections 2023-06-10T18:53:27.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.508+0000 7fe123626640 1 -- 172.21.15.53:0/3509965538 wait complete. 2023-06-10T18:53:27.535 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-10T18:53:27.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.656+0000 7f0269b55640 1 Processor -- start 2023-06-10T18:53:27.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.656+0000 7f0269b55640 1 -- start start 2023-06-10T18:53:27.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.660+0000 7f0269b55640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f02640c82a0 0x7f02640c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:27.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.660+0000 7f0269b55640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02640af760 0x7f02640afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:27.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.660+0000 7f0269b55640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f026406b090 con 0x7f02640c9fa0 2023-06-10T18:53:27.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.660+0000 7f0269b55640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02640b0120 con 0x7f02640c82a0 2023-06-10T18:53:27.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.660+0000 7f0269b55640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02640ca370 con 0x7f02640af760 2023-06-10T18:53:27.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.660+0000 7f0262ffd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f02640c82a0 0x7f02640c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:27.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.660+0000 7f0263fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02640af760 0x7f02640afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:27.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.660+0000 7f02637fe640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f02640c9fa0 0x7f026406bae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.53:46502/0 (socket says 172.21.15.53:46502) 2023-06-10T18:53:27.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.660+0000 7f0262ffd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f02640c82a0 0x7f02640c86f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.53:52546/0 (socket says 172.21.15.53:52546) 2023-06-10T18:53:27.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.660+0000 7f02637fe640 1 -- 172.21.15.53:0/1621176703 learned_addr learned my addr 172.21.15.53:0/1621176703 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:53:27.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.660+0000 7f0263fff640 1 -- 172.21.15.53:0/1621176703 >> v2:172.21.15.117:3300/0 conn(0x7f02640c82a0 msgr2=0x7f02640c86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:27.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.660+0000 7f0263fff640 1 --2- 172.21.15.53:0/1621176703 >> v2:172.21.15.117:3300/0 conn(0x7f02640c82a0 0x7f02640c86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:27.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.660+0000 7f0263fff640 1 -- 172.21.15.53:0/1621176703 >> v1:172.21.15.117:6789/0 conn(0x7f02640c9fa0 legacy=0x7f026406bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:27.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.660+0000 7f0263fff640 1 -- 172.21.15.53:0/1621176703 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0264070d50 con 0x7f02640af760 2023-06-10T18:53:27.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.660+0000 7f0262ffd640 1 --2- 172.21.15.53:0/1621176703 >> v2:172.21.15.117:3300/0 conn(0x7f02640c82a0 0x7f02640c86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-10T18:53:27.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.664+0000 7f0263fff640 1 --2- 172.21.15.53:0/1621176703 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02640af760 0x7f02640afbe0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f025c009d90 tx=0x7f025c01c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f1c7032cba4525f server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:27.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.664+0000 7f02627fc640 1 -- 172.21.15.53:0/1621176703 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025c0a5950 con 0x7f02640af760 2023-06-10T18:53:27.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.664+0000 7f02627fc640 1 -- 172.21.15.53:0/1621176703 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f025c0a5ab0 con 0x7f02640af760 2023-06-10T18:53:27.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.664+0000 7f02627fc640 1 -- 172.21.15.53:0/1621176703 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025c0a5e40 con 0x7f02640af760 2023-06-10T18:53:27.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.664+0000 7f0269b55640 1 -- 172.21.15.53:0/1621176703 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02640af760 msgr2=0x7f02640afbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:27.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.664+0000 7f0269b55640 1 --2- 172.21.15.53:0/1621176703 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02640af760 0x7f02640afbe0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f025c009d90 tx=0x7f025c01c890 comp rx=0 tx=0).stop 2023-06-10T18:53:27.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.664+0000 7f0269b55640 1 -- 172.21.15.53:0/1621176703 shutdown_connections 2023-06-10T18:53:27.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.664+0000 7f0269b55640 1 --2- 172.21.15.53:0/1621176703 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02640af760 0x7f02640afbe0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:27.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.664+0000 7f0269b55640 1 --2- 172.21.15.53:0/1621176703 >> v2:172.21.15.117:3300/0 conn(0x7f02640c82a0 0x7f02640c86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:27.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.664+0000 7f0269b55640 1 -- 172.21.15.53:0/1621176703 >> 172.21.15.53:0/1621176703 conn(0x7f026406a0e0 msgr2=0x7f02640cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:27.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.664+0000 7f0269b55640 1 -- 172.21.15.53:0/1621176703 shutdown_connections 2023-06-10T18:53:27.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.664+0000 7f0269b55640 1 -- 172.21.15.53:0/1621176703 wait complete. 2023-06-10T18:53:27.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.664+0000 7f0269b55640 1 Processor -- start 2023-06-10T18:53:27.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.664+0000 7f0269b55640 1 -- start start 2023-06-10T18:53:27.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.664+0000 7f0269b55640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02640af760 0x7f0264142240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:27.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.664+0000 7f0269b55640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02640c82a0 0x7f02640addb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:27.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.664+0000 7f0269b55640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02640c9fa0 0x7f02640ae2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:27.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.664+0000 7f0269b55640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02641597c0 con 0x7f02640c82a0 2023-06-10T18:53:27.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.664+0000 7f0269b55640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02640ac560 con 0x7f02640c9fa0 2023-06-10T18:53:27.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.664+0000 7f0269b55640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02640ac840 con 0x7f02640af760 2023-06-10T18:53:27.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.664+0000 7f0262ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02640c82a0 0x7f02640addb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:27.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.664+0000 7f0262ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02640c82a0 0x7f02640addb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50366/0 (socket says 172.21.15.53:50366) 2023-06-10T18:53:27.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.664+0000 7f0262ffd640 1 -- 172.21.15.53:0/1489791326 learned_addr learned my addr 172.21.15.53:0/1489791326 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:27.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.664+0000 7f0263fff640 1 --2- 172.21.15.53:0/1489791326 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02640c9fa0 0x7f02640ae2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:27.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.664+0000 7f02637fe640 1 --2- 172.21.15.53:0/1489791326 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02640af760 0x7f0264142240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:27.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.668+0000 7f0262ffd640 1 -- 172.21.15.53:0/1489791326 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02640af760 msgr2=0x7f0264142240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:27.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.668+0000 7f0262ffd640 1 --2- 172.21.15.53:0/1489791326 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02640af760 0x7f0264142240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:27.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.668+0000 7f0262ffd640 1 -- 172.21.15.53:0/1489791326 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02640c9fa0 msgr2=0x7f02640ae2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:27.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.668+0000 7f0262ffd640 1 --2- 172.21.15.53:0/1489791326 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02640c9fa0 0x7f02640ae2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:27.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.668+0000 7f0262ffd640 1 -- 172.21.15.53:0/1489791326 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f024c009420 con 0x7f02640c82a0 2023-06-10T18:53:27.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.668+0000 7f0262ffd640 1 --2- 172.21.15.53:0/1489791326 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02640c82a0 0x7f02640addb0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f024c00ebe0 tx=0x7f024c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:27.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.668+0000 7f025bfff640 1 -- 172.21.15.53:0/1489791326 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f024c00eee0 con 0x7f02640c82a0 2023-06-10T18:53:27.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.668+0000 7f025bfff640 1 -- 172.21.15.53:0/1489791326 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f024c00cc30 con 0x7f02640c82a0 2023-06-10T18:53:27.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.668+0000 7f025bfff640 1 -- 172.21.15.53:0/1489791326 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f024c013470 con 0x7f02640c82a0 2023-06-10T18:53:27.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.668+0000 7f0269b55640 1 -- 172.21.15.53:0/1489791326 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f025c009a70 con 0x7f02640c82a0 2023-06-10T18:53:27.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.668+0000 7f0269b55640 1 -- 172.21.15.53:0/1489791326 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02640ace00 con 0x7f02640c82a0 2023-06-10T18:53:27.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.668+0000 7f0269b55640 1 -- 172.21.15.53:0/1489791326 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f026404d790 con 0x7f02640c82a0 2023-06-10T18:53:27.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.668+0000 7f025bfff640 1 -- 172.21.15.53:0/1489791326 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f024c0135d0 con 0x7f02640c82a0 2023-06-10T18:53:27.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.668+0000 7f025bfff640 1 --2- 172.21.15.53:0/1489791326 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f02440662b0 0x7f0244068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:27.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.668+0000 7f025bfff640 1 -- 172.21.15.53:0/1489791326 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f024c0840b0 con 0x7f02640c82a0 2023-06-10T18:53:27.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.668+0000 7f02637fe640 1 --2- 172.21.15.53:0/1489791326 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f02440662b0 0x7f0244068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:27.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.672+0000 7f02637fe640 1 --2- 172.21.15.53:0/1489791326 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f02440662b0 0x7f0244068760 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0254000f70 tx=0x7f0254009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:27.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.672+0000 7f025bfff640 1 -- 172.21.15.53:0/1489791326 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f024c051450 con 0x7f02640c82a0 2023-06-10T18:53:27.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.824+0000 7f0269b55640 1 -- 172.21.15.53:0/1489791326 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f02640af100 con 0x7f02640c82a0 2023-06-10T18:53:27.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.824+0000 7f025bfff640 1 -- 172.21.15.53:0/1489791326 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f024c054a70 con 0x7f02640c82a0 2023-06-10T18:53:27.835 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-06-10T18:53:27.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.828+0000 7f0269b55640 1 -- 172.21.15.53:0/1489791326 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f02440662b0 msgr2=0x7f0244068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:27.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.828+0000 7f0269b55640 1 --2- 172.21.15.53:0/1489791326 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f02440662b0 0x7f0244068760 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0254000f70 tx=0x7f0254009040 comp rx=0 tx=0).stop 2023-06-10T18:53:27.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.828+0000 7f0269b55640 1 -- 172.21.15.53:0/1489791326 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02640c82a0 msgr2=0x7f02640addb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:27.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.828+0000 7f0269b55640 1 --2- 172.21.15.53:0/1489791326 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02640c82a0 0x7f02640addb0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f024c00ebe0 tx=0x7f024c00c520 comp rx=0 tx=0).stop 2023-06-10T18:53:27.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.828+0000 7f0269b55640 1 -- 172.21.15.53:0/1489791326 shutdown_connections 2023-06-10T18:53:27.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.828+0000 7f0269b55640 1 --2- 172.21.15.53:0/1489791326 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f02440662b0 0x7f0244068760 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:27.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.828+0000 7f0269b55640 1 --2- 172.21.15.53:0/1489791326 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02640c9fa0 0x7f02640ae2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:27.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.828+0000 7f0269b55640 1 --2- 172.21.15.53:0/1489791326 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02640c82a0 0x7f02640addb0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:27.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.828+0000 7f0269b55640 1 --2- 172.21.15.53:0/1489791326 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02640af760 0x7f0264142240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:27.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.828+0000 7f0269b55640 1 -- 172.21.15.53:0/1489791326 >> 172.21.15.53:0/1489791326 conn(0x7f026406a0e0 msgr2=0x7f02640723f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:27.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.828+0000 7f0269b55640 1 -- 172.21.15.53:0/1489791326 shutdown_connections 2023-06-10T18:53:27.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.828+0000 7f0269b55640 1 -- 172.21.15.53:0/1489791326 wait complete. 2023-06-10T18:53:27.854 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-10T18:53:27.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.976+0000 7f17ff94d640 1 Processor -- start 2023-06-10T18:53:27.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.976+0000 7f17ff94d640 1 -- start start 2023-06-10T18:53:27.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.976+0000 7f17ff94d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f17f81558e0 0x7f17f80c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:27.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.976+0000 7f17ff94d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f17f8158f40 0x7f17f80cb820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:27.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.976+0000 7f17ff94d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17f806c230 con 0x7f17f80cbd60 2023-06-10T18:53:27.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.976+0000 7f17ff94d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17f806ca40 con 0x7f17f8158f40 2023-06-10T18:53:27.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.976+0000 7f17ff94d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17f8155cb0 con 0x7f17f81558e0 2023-06-10T18:53:27.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.976+0000 7f17fcee8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f17f8158f40 0x7f17f80cb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:27.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.976+0000 7f17fcee8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f17f8158f40 0x7f17f80cb820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50370/0 (socket says 172.21.15.53:50370) 2023-06-10T18:53:27.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.976+0000 7f17fcee8640 1 -- 172.21.15.53:0/3728388556 learned_addr learned my addr 172.21.15.53:0/3728388556 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:27.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.976+0000 7f17fcee8640 1 -- 172.21.15.53:0/3728388556 >> v2:172.21.15.117:3300/0 conn(0x7f17f81558e0 msgr2=0x7f17f80c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:27.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.976+0000 7f17fd6e9640 1 --2- 172.21.15.53:0/3728388556 >> v2:172.21.15.117:3300/0 conn(0x7f17f81558e0 0x7f17f80c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:27.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.976+0000 7f17fcee8640 1 --2- 172.21.15.53:0/3728388556 >> v2:172.21.15.117:3300/0 conn(0x7f17f81558e0 0x7f17f80c82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:27.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.976+0000 7f17fcee8640 1 -- 172.21.15.53:0/3728388556 >> v1:172.21.15.117:6789/0 conn(0x7f17f80cbd60 legacy=0x7f17f806b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:27.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.976+0000 7f17fcee8640 1 -- 172.21.15.53:0/3728388556 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17f806c480 con 0x7f17f8158f40 2023-06-10T18:53:27.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.976+0000 7f17fd6e9640 1 --2- 172.21.15.53:0/3728388556 >> v2:172.21.15.117:3300/0 conn(0x7f17f81558e0 0x7f17f80c82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:27.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.980+0000 7f17fcee8640 1 --2- 172.21.15.53:0/3728388556 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17f8158f40 0x7f17f80cb820 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f17f806eac0 tx=0x7f17e801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91d767e0e26e8b2e server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:27.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.980+0000 7f17effff640 1 -- 172.21.15.53:0/3728388556 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e80ab600 con 0x7f17f8158f40 2023-06-10T18:53:27.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.980+0000 7f17effff640 1 -- 172.21.15.53:0/3728388556 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17e80a7050 con 0x7f17f8158f40 2023-06-10T18:53:27.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.980+0000 7f17effff640 1 -- 172.21.15.53:0/3728388556 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e80ab980 con 0x7f17f8158f40 2023-06-10T18:53:27.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.980+0000 7f17ff94d640 1 -- 172.21.15.53:0/3728388556 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17f8158f40 msgr2=0x7f17f80cb820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:27.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.980+0000 7f17ff94d640 1 --2- 172.21.15.53:0/3728388556 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17f8158f40 0x7f17f80cb820 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f17f806eac0 tx=0x7f17e801c370 comp rx=0 tx=0).stop 2023-06-10T18:53:27.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.980+0000 7f17ff94d640 1 -- 172.21.15.53:0/3728388556 shutdown_connections 2023-06-10T18:53:27.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.980+0000 7f17ff94d640 1 --2- 172.21.15.53:0/3728388556 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17f8158f40 0x7f17f80cb820 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:27.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.980+0000 7f17ff94d640 1 --2- 172.21.15.53:0/3728388556 >> v2:172.21.15.117:3300/0 conn(0x7f17f81558e0 0x7f17f80c82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:27.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.980+0000 7f17ff94d640 1 -- 172.21.15.53:0/3728388556 >> 172.21.15.53:0/3728388556 conn(0x7f17f806a0e0 msgr2=0x7f17f80cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:27.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.980+0000 7f17ff94d640 1 -- 172.21.15.53:0/3728388556 shutdown_connections 2023-06-10T18:53:27.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.980+0000 7f17ff94d640 1 -- 172.21.15.53:0/3728388556 wait complete. 2023-06-10T18:53:27.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.980+0000 7f17ff94d640 1 Processor -- start 2023-06-10T18:53:27.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.980+0000 7f17ff94d640 1 -- start start 2023-06-10T18:53:27.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.980+0000 7f17ff94d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17f80cbd60 0x7f17f814e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:27.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.980+0000 7f17ff94d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17f81558e0 0x7f17f814b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:27.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.980+0000 7f17ff94d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f17f8158f40 0x7f17f8146080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:27.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.980+0000 7f17ff94d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f8070e80 con 0x7f17f80cbd60 2023-06-10T18:53:27.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.980+0000 7f17ff94d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f814cd90 con 0x7f17f81558e0 2023-06-10T18:53:27.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.980+0000 7f17ff94d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17f80705e0 con 0x7f17f8158f40 2023-06-10T18:53:27.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.980+0000 7f17fd6e9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17f80cbd60 0x7f17f814e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:27.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.980+0000 7f17fd6e9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17f80cbd60 0x7f17f814e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50382/0 (socket says 172.21.15.53:50382) 2023-06-10T18:53:27.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.980+0000 7f17fd6e9640 1 -- 172.21.15.53:0/123245849 learned_addr learned my addr 172.21.15.53:0/123245849 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:27.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.980+0000 7f17fdeea640 1 --2- 172.21.15.53:0/123245849 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f17f8158f40 0x7f17f8146080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:27.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.980+0000 7f17fcee8640 1 --2- 172.21.15.53:0/123245849 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17f81558e0 0x7f17f814b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:27.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.980+0000 7f17fd6e9640 1 -- 172.21.15.53:0/123245849 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f17f8158f40 msgr2=0x7f17f8146080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:27.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.980+0000 7f17fd6e9640 1 --2- 172.21.15.53:0/123245849 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f17f8158f40 0x7f17f8146080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:27.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.980+0000 7f17fd6e9640 1 -- 172.21.15.53:0/123245849 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17f81558e0 msgr2=0x7f17f814b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:27.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.980+0000 7f17fd6e9640 1 --2- 172.21.15.53:0/123245849 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17f81558e0 0x7f17f814b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:27.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.980+0000 7f17fd6e9640 1 -- 172.21.15.53:0/123245849 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17e80094d0 con 0x7f17f80cbd60 2023-06-10T18:53:27.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.980+0000 7f17fdeea640 1 --2- 172.21.15.53:0/123245849 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f17f8158f40 0x7f17f8146080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:27.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.980+0000 7f17fd6e9640 1 --2- 172.21.15.53:0/123245849 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17f80cbd60 0x7f17f814e480 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f17f400c7f0 tx=0x7f17f400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:27.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.980+0000 7f17edffb640 1 -- 172.21.15.53:0/123245849 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f4007820 con 0x7f17f80cbd60 2023-06-10T18:53:27.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.984+0000 7f17edffb640 1 -- 172.21.15.53:0/123245849 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17f4007980 con 0x7f17f80cbd60 2023-06-10T18:53:27.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.984+0000 7f17ff94d640 1 -- 172.21.15.53:0/123245849 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17f80708c0 con 0x7f17f80cbd60 2023-06-10T18:53:27.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.984+0000 7f17edffb640 1 -- 172.21.15.53:0/123245849 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f4007d30 con 0x7f17f80cbd60 2023-06-10T18:53:27.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.984+0000 7f17ff94d640 1 -- 172.21.15.53:0/123245849 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17f814b660 con 0x7f17f80cbd60 2023-06-10T18:53:27.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.984+0000 7f17ff94d640 1 -- 172.21.15.53:0/123245849 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17f804d790 con 0x7f17f80cbd60 2023-06-10T18:53:27.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.984+0000 7f17edffb640 1 -- 172.21.15.53:0/123245849 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f17f4024480 con 0x7f17f80cbd60 2023-06-10T18:53:27.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.984+0000 7f17edffb640 1 --2- 172.21.15.53:0/123245849 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f17dc066280 0x7f17dc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:27.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.984+0000 7f17edffb640 1 -- 172.21.15.53:0/123245849 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f17f40844e0 con 0x7f17f80cbd60 2023-06-10T18:53:27.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.984+0000 7f17fcee8640 1 --2- 172.21.15.53:0/123245849 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f17dc066280 0x7f17dc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:27.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.984+0000 7f17fcee8640 1 --2- 172.21.15.53:0/123245849 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f17dc066280 0x7f17dc068730 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f17e80ad000 tx=0x7f17e8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:27.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:27.988+0000 7f17edffb640 1 -- 172.21.15.53:0/123245849 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f17f4051a00 con 0x7f17f80cbd60 2023-06-10T18:53:28.150 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.140+0000 7f17ff94d640 1 -- 172.21.15.53:0/123245849 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f17f8159e00 con 0x7f17f80cbd60 2023-06-10T18:53:28.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.144+0000 7f17edffb640 1 -- 172.21.15.53:0/123245849 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f17f4055020 con 0x7f17f80cbd60 2023-06-10T18:53:28.155 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-06-10T18:53:28.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.148+0000 7f17ff94d640 1 -- 172.21.15.53:0/123245849 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f17dc066280 msgr2=0x7f17dc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:28.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.148+0000 7f17ff94d640 1 --2- 172.21.15.53:0/123245849 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f17dc066280 0x7f17dc068730 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f17e80ad000 tx=0x7f17e8008040 comp rx=0 tx=0).stop 2023-06-10T18:53:28.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.148+0000 7f17ff94d640 1 -- 172.21.15.53:0/123245849 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17f80cbd60 msgr2=0x7f17f814e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:28.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.148+0000 7f17ff94d640 1 --2- 172.21.15.53:0/123245849 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17f80cbd60 0x7f17f814e480 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f17f400c7f0 tx=0x7f17f400ccb0 comp rx=0 tx=0).stop 2023-06-10T18:53:28.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.148+0000 7f17ff94d640 1 -- 172.21.15.53:0/123245849 shutdown_connections 2023-06-10T18:53:28.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.148+0000 7f17ff94d640 1 --2- 172.21.15.53:0/123245849 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f17dc066280 0x7f17dc068730 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:28.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.148+0000 7f17ff94d640 1 --2- 172.21.15.53:0/123245849 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f17f8158f40 0x7f17f8146080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:28.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.148+0000 7f17ff94d640 1 --2- 172.21.15.53:0/123245849 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17f81558e0 0x7f17f814b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:28.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.148+0000 7f17ff94d640 1 --2- 172.21.15.53:0/123245849 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17f80cbd60 0x7f17f814e480 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:28.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.148+0000 7f17ff94d640 1 -- 172.21.15.53:0/123245849 >> 172.21.15.53:0/123245849 conn(0x7f17f806a0e0 msgr2=0x7f17f8159460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:28.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.148+0000 7f17ff94d640 1 -- 172.21.15.53:0/123245849 shutdown_connections 2023-06-10T18:53:28.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.148+0000 7f17ff94d640 1 -- 172.21.15.53:0/123245849 wait complete. 2023-06-10T18:53:28.175 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-10T18:53:28.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.284+0000 7f45aca0d640 1 Processor -- start 2023-06-10T18:53:28.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.284+0000 7f45aca0d640 1 -- start start 2023-06-10T18:53:28.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.284+0000 7f45aca0d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f45a80cd6d0 0x7f45a815b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:28.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.284+0000 7f45aca0d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45a806b7a0 con 0x7f45a80c83c0 2023-06-10T18:53:28.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.284+0000 7f45aca0d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45a806a8b0 con 0x7f45a80afee0 2023-06-10T18:53:28.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.284+0000 7f45aca0d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45a806ab90 con 0x7f45a80cd6d0 2023-06-10T18:53:28.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.284+0000 7f45a5d9b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f45a80c83c0 0x7f45a80af7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:37272/0 (socket says 172.21.15.53:37272) 2023-06-10T18:53:28.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.284+0000 7f45a5d9b640 1 -- 172.21.15.53:0/1445490662 learned_addr learned my addr 172.21.15.53:0/1445490662 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:53:28.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.288+0000 7f45a659c640 1 --2- 172.21.15.53:0/1445490662 >> v2:172.21.15.117:3300/0 conn(0x7f45a80cd6d0 0x7f45a815b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:28.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.288+0000 7f45a559a640 1 -- 172.21.15.53:0/1445490662 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4222839849 0 0) 0x7f45a806b7a0 con 0x7f45a80c83c0 2023-06-10T18:53:28.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.288+0000 7f45a559a640 1 -- 172.21.15.53:0/1445490662 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4594003530 con 0x7f45a80c83c0 2023-06-10T18:53:28.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.288+0000 7f45a559a640 1 -- 172.21.15.53:0/1445490662 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1302697257 0 0) 0x7f4594003530 con 0x7f45a80c83c0 2023-06-10T18:53:28.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.288+0000 7f45a559a640 1 -- 172.21.15.53:0/1445490662 >> v2:172.21.15.117:3300/0 conn(0x7f45a80cd6d0 msgr2=0x7f45a815b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:28.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.288+0000 7f45a559a640 1 --2- 172.21.15.53:0/1445490662 >> v2:172.21.15.117:3300/0 conn(0x7f45a80cd6d0 0x7f45a815b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:28.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.288+0000 7f45a559a640 1 -- 172.21.15.53:0/1445490662 >> v1:172.21.15.117:6789/0 conn(0x7f45a80afee0 legacy=0x7f45a8158660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:28.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.288+0000 7f45a559a640 1 -- 172.21.15.53:0/1445490662 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a806ae70 con 0x7f45a80c83c0 2023-06-10T18:53:28.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.288+0000 7f45a559a640 1 -- 172.21.15.53:0/1445490662 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f4590001a00 con 0x7f45a80c83c0 2023-06-10T18:53:28.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.288+0000 7f45a559a640 1 -- 172.21.15.53:0/1445490662 >> v1:172.21.15.53:6789/0 conn(0x7f45a80c83c0 legacy=0x7f45a80af7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:28.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.288+0000 7f45a559a640 1 --2- 172.21.15.53:0/1445490662 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4594003980 0x7f4594003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:28.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.288+0000 7f45a559a640 1 --2- 172.21.15.53:0/1445490662 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45940047d0 0x7f4594004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:28.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.288+0000 7f45a559a640 1 --2- 172.21.15.53:0/1445490662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4594005180 0x7f459400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:28.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.288+0000 7f45a559a640 1 -- 172.21.15.53:0/1445490662 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a806ab90 con 0x7f4594005180 2023-06-10T18:53:28.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.288+0000 7f45a559a640 1 -- 172.21.15.53:0/1445490662 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f459400c000 con 0x7f45940047d0 2023-06-10T18:53:28.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.288+0000 7f45a559a640 1 -- 172.21.15.53:0/1445490662 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f459400c1c0 con 0x7f4594003980 2023-06-10T18:53:28.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.288+0000 7f45a6d9d640 1 --2- 172.21.15.53:0/1445490662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4594005180 0x7f459400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:28.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.288+0000 7f45a5d9b640 1 --2- 172.21.15.53:0/1445490662 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45940047d0 0x7f4594004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:28.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.288+0000 7f45a659c640 1 --2- 172.21.15.53:0/1445490662 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4594003980 0x7f4594003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:28.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.288+0000 7f45a6d9d640 1 -- 172.21.15.53:0/1445490662 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4594003980 msgr2=0x7f4594003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:28.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.288+0000 7f45a6d9d640 1 --2- 172.21.15.53:0/1445490662 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4594003980 0x7f4594003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:28.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.288+0000 7f45a6d9d640 1 -- 172.21.15.53:0/1445490662 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45940047d0 msgr2=0x7f4594004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:28.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.288+0000 7f45a6d9d640 1 --2- 172.21.15.53:0/1445490662 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45940047d0 0x7f4594004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:28.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.288+0000 7f45a6d9d640 1 -- 172.21.15.53:0/1445490662 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4594003530 con 0x7f4594005180 2023-06-10T18:53:28.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.288+0000 7f45a6d9d640 1 -- 172.21.15.53:0/1445490662 reap_dead start 2023-06-10T18:53:28.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.288+0000 7f45a6d9d640 1 --2- 172.21.15.53:0/1445490662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4594005180 0x7f459400b990 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4598001780 tx=0x7f459801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfd669e4cc2e30e0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:28.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.288+0000 7f45a559a640 1 -- 172.21.15.53:0/1445490662 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45980052d0 con 0x7f4594005180 2023-06-10T18:53:28.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.288+0000 7f45a559a640 1 -- 172.21.15.53:0/1445490662 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45980a7050 con 0x7f4594005180 2023-06-10T18:53:28.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.288+0000 7f45a559a640 1 -- 172.21.15.53:0/1445490662 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4598003840 con 0x7f4594005180 2023-06-10T18:53:28.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.288+0000 7f45aca0d640 1 -- 172.21.15.53:0/1445490662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4594005180 msgr2=0x7f459400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:28.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.288+0000 7f45aca0d640 1 --2- 172.21.15.53:0/1445490662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4594005180 0x7f459400b990 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4598001780 tx=0x7f459801c400 comp rx=0 tx=0).stop 2023-06-10T18:53:28.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.288+0000 7f45aca0d640 1 -- 172.21.15.53:0/1445490662 shutdown_connections 2023-06-10T18:53:28.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.288+0000 7f45aca0d640 1 --2- 172.21.15.53:0/1445490662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4594005180 0x7f459400b990 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:28.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.288+0000 7f45aca0d640 1 -- 172.21.15.53:0/1445490662 >> 172.21.15.53:0/1445490662 conn(0x7f45a80ce9e0 msgr2=0x7f45a80ca7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:28.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.292+0000 7f45aca0d640 1 -- 172.21.15.53:0/1445490662 shutdown_connections 2023-06-10T18:53:28.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.292+0000 7f45aca0d640 1 -- 172.21.15.53:0/1445490662 wait complete. 2023-06-10T18:53:28.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.292+0000 7f45aca0d640 1 Processor -- start 2023-06-10T18:53:28.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.292+0000 7f45aca0d640 1 -- start start 2023-06-10T18:53:28.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.292+0000 7f45aca0d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4594005180 0x7f45a81f0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:28.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.292+0000 7f45aca0d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45a80af3a0 0x7f45a8156dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:28.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.292+0000 7f45aca0d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45a814d420 0x7f45a8157300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:28.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.292+0000 7f45aca0d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a8159150 con 0x7f45a814d420 2023-06-10T18:53:28.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.292+0000 7f45aca0d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a814d8b0 con 0x7f4594005180 2023-06-10T18:53:28.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.292+0000 7f45aca0d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45a814db90 con 0x7f45a80af3a0 2023-06-10T18:53:28.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.292+0000 7f45a6d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45a814d420 0x7f45a8157300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:28.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.292+0000 7f45a6d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45a814d420 0x7f45a8157300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50404/0 (socket says 172.21.15.53:50404) 2023-06-10T18:53:28.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.292+0000 7f45a6d9d640 1 -- 172.21.15.53:0/797049902 learned_addr learned my addr 172.21.15.53:0/797049902 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:28.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.292+0000 7f45a659c640 1 --2- 172.21.15.53:0/797049902 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4594005180 0x7f45a81f0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:28.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.292+0000 7f45a5d9b640 1 --2- 172.21.15.53:0/797049902 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45a80af3a0 0x7f45a8156dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:28.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.292+0000 7f45a6d9d640 1 -- 172.21.15.53:0/797049902 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45a80af3a0 msgr2=0x7f45a8156dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:28.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.292+0000 7f45a6d9d640 1 --2- 172.21.15.53:0/797049902 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45a80af3a0 0x7f45a8156dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:28.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.292+0000 7f45a6d9d640 1 -- 172.21.15.53:0/797049902 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4594005180 msgr2=0x7f45a81f0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:28.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.292+0000 7f45a6d9d640 1 --2- 172.21.15.53:0/797049902 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4594005180 0x7f45a81f0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:28.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.292+0000 7f45a6d9d640 1 -- 172.21.15.53:0/797049902 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a814de70 con 0x7f45a814d420 2023-06-10T18:53:28.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.292+0000 7f45a659c640 1 --2- 172.21.15.53:0/797049902 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4594005180 0x7f45a81f0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:53:28.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.292+0000 7f45a6d9d640 1 --2- 172.21.15.53:0/797049902 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45a814d420 0x7f45a8157300 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f459801cca0 tx=0x7f4594005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:28.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.292+0000 7f459effd640 1 -- 172.21.15.53:0/797049902 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45980b0070 con 0x7f45a814d420 2023-06-10T18:53:28.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.292+0000 7f459effd640 1 -- 172.21.15.53:0/797049902 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4598003600 con 0x7f45a814d420 2023-06-10T18:53:28.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.292+0000 7f45aca0d640 1 -- 172.21.15.53:0/797049902 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45a814e150 con 0x7f45a814d420 2023-06-10T18:53:28.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.292+0000 7f459effd640 1 -- 172.21.15.53:0/797049902 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4598003990 con 0x7f45a814d420 2023-06-10T18:53:28.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.292+0000 7f45aca0d640 1 -- 172.21.15.53:0/797049902 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45a814f0a0 con 0x7f45a814d420 2023-06-10T18:53:28.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.296+0000 7f45aca0d640 1 -- 172.21.15.53:0/797049902 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45a814e670 con 0x7f45a814d420 2023-06-10T18:53:28.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.296+0000 7f459effd640 1 -- 172.21.15.53:0/797049902 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4598003af0 con 0x7f45a814d420 2023-06-10T18:53:28.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.296+0000 7f459effd640 1 --2- 172.21.15.53:0/797049902 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4588066280 0x7f4588068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:28.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.296+0000 7f459effd640 1 -- 172.21.15.53:0/797049902 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f459811c650 con 0x7f45a814d420 2023-06-10T18:53:28.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.296+0000 7f45a659c640 1 --2- 172.21.15.53:0/797049902 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4588066280 0x7f4588068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:28.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.296+0000 7f45a659c640 1 --2- 172.21.15.53:0/797049902 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4588066280 0x7f4588068730 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f45a80b3c30 tx=0x7f45a0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:28.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.300+0000 7f459effd640 1 -- 172.21.15.53:0/797049902 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f45a814e670 con 0x7f45a814d420 2023-06-10T18:53:28.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.460+0000 7f45aca0d640 1 -- 172.21.15.53:0/797049902 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f45a814e670 con 0x7f45a814d420 2023-06-10T18:53:28.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.460+0000 7f459effd640 1 -- 172.21.15.53:0/797049902 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7f45a814e670 con 0x7f45a814d420 2023-06-10T18:53:28.468 INFO:teuthology.orchestra.run.smithi053.stderr:listed 0 entries 2023-06-10T18:53:28.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.460+0000 7f45aca0d640 1 -- 172.21.15.53:0/797049902 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4588066280 msgr2=0x7f4588068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:28.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.460+0000 7f45aca0d640 1 --2- 172.21.15.53:0/797049902 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4588066280 0x7f4588068730 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f45a80b3c30 tx=0x7f45a0008040 comp rx=0 tx=0).stop 2023-06-10T18:53:28.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.460+0000 7f45aca0d640 1 -- 172.21.15.53:0/797049902 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45a814d420 msgr2=0x7f45a8157300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:28.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.460+0000 7f45aca0d640 1 --2- 172.21.15.53:0/797049902 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45a814d420 0x7f45a8157300 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f459801cca0 tx=0x7f4594005800 comp rx=0 tx=0).stop 2023-06-10T18:53:28.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.460+0000 7f45aca0d640 1 -- 172.21.15.53:0/797049902 shutdown_connections 2023-06-10T18:53:28.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.460+0000 7f45aca0d640 1 --2- 172.21.15.53:0/797049902 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4588066280 0x7f4588068730 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:28.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.460+0000 7f45aca0d640 1 --2- 172.21.15.53:0/797049902 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45a814d420 0x7f45a8157300 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:28.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.460+0000 7f45aca0d640 1 --2- 172.21.15.53:0/797049902 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45a80af3a0 0x7f45a8156dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:28.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.460+0000 7f45aca0d640 1 --2- 172.21.15.53:0/797049902 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4594005180 0x7f45a81f0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:28.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.460+0000 7f45aca0d640 1 -- 172.21.15.53:0/797049902 >> 172.21.15.53:0/797049902 conn(0x7f45a80ce9e0 msgr2=0x7f45a80cb890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:28.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.460+0000 7f45aca0d640 1 -- 172.21.15.53:0/797049902 shutdown_connections 2023-06-10T18:53:28.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.460+0000 7f45aca0d640 1 -- 172.21.15.53:0/797049902 wait complete. 2023-06-10T18:53:28.486 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi053.front.sepia.ceph.com... 2023-06-10T18:53:28.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:53:28.486 DEBUG:teuthology.orchestra.run.smithi053:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-06-10T18:53:28.509 INFO:teuthology.orchestra.run:waiting for 300 2023-06-10T18:53:28.509 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi053.front.sepia.ceph.com 2023-06-10T18:53:28.510 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:53:28.510 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-06-10T18:53:28.558 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T18:53:28.559 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T18:53:28.565 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T18:53:28.566 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T18:53:28.618 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T18:53:28.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.732+0000 7f1b7a097640 1 Processor -- start 2023-06-10T18:53:28.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.732+0000 7f1b7a097640 1 -- start start 2023-06-10T18:53:28.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.732+0000 7f1b7a097640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b740cc690 0x7f1b740d04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:28.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.732+0000 7f1b7a097640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1b740ccae0 0x7f1b740d09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:28.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.732+0000 7f1b7a097640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b740d0020 con 0x7f1b740b3ac0 2023-06-10T18:53:28.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.732+0000 7f1b7a097640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b740cef40 con 0x7f1b740ccae0 2023-06-10T18:53:28.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.732+0000 7f1b7a097640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b740cf220 con 0x7f1b740cc690 2023-06-10T18:53:28.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.732+0000 7f1b72ffd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b740cc690 0x7f1b740d04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:28.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.732+0000 7f1b73fff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1b740ccae0 0x7f1b740d09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:28.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.732+0000 7f1b737fe640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f1b740b3ac0 0x7f1b740b3e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.53:46530/0 (socket says 172.21.15.53:46530) 2023-06-10T18:53:28.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.732+0000 7f1b737fe640 1 -- 172.21.15.53:0/3677168527 learned_addr learned my addr 172.21.15.53:0/3677168527 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:53:28.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.736+0000 7f1b73fff640 1 -- 172.21.15.53:0/3677168527 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b740cc690 msgr2=0x7f1b740d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:28.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.736+0000 7f1b73fff640 1 --2- 172.21.15.53:0/3677168527 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b740cc690 0x7f1b740d04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:28.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.736+0000 7f1b73fff640 1 -- 172.21.15.53:0/3677168527 >> v1:172.21.15.117:6789/0 conn(0x7f1b740b3ac0 legacy=0x7f1b740b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:28.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.736+0000 7f1b73fff640 1 -- 172.21.15.53:0/3677168527 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b740cf500 con 0x7f1b740ccae0 2023-06-10T18:53:28.747 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.736+0000 7f1b73fff640 1 --2- 172.21.15.53:0/3677168527 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b740ccae0 0x7f1b740d09f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c009d90 tx=0x7f1b6c01c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cdc6e09d4070a7f2 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:28.747 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.736+0000 7f1b727fc640 1 -- 172.21.15.53:0/3677168527 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b6c0a5a00 con 0x7f1b740ccae0 2023-06-10T18:53:28.747 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.736+0000 7f1b727fc640 1 -- 172.21.15.53:0/3677168527 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b6c0a5b60 con 0x7f1b740ccae0 2023-06-10T18:53:28.747 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.736+0000 7f1b727fc640 1 -- 172.21.15.53:0/3677168527 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b6c0ad440 con 0x7f1b740ccae0 2023-06-10T18:53:28.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.736+0000 7f1b7a097640 1 -- 172.21.15.53:0/3677168527 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b740ccae0 msgr2=0x7f1b740d09f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:28.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.736+0000 7f1b7a097640 1 --2- 172.21.15.53:0/3677168527 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b740ccae0 0x7f1b740d09f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c009d90 tx=0x7f1b6c01c920 comp rx=0 tx=0).stop 2023-06-10T18:53:28.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.736+0000 7f1b7a097640 1 -- 172.21.15.53:0/3677168527 shutdown_connections 2023-06-10T18:53:28.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.736+0000 7f1b7a097640 1 --2- 172.21.15.53:0/3677168527 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b740ccae0 0x7f1b740d09f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:28.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.736+0000 7f1b7a097640 1 --2- 172.21.15.53:0/3677168527 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b740cc690 0x7f1b740d04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:28.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.736+0000 7f1b7a097640 1 -- 172.21.15.53:0/3677168527 >> 172.21.15.53:0/3677168527 conn(0x7f1b74071790 msgr2=0x7f1b74069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:28.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.736+0000 7f1b7a097640 1 -- 172.21.15.53:0/3677168527 shutdown_connections 2023-06-10T18:53:28.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.736+0000 7f1b7a097640 1 -- 172.21.15.53:0/3677168527 wait complete. 2023-06-10T18:53:28.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.740+0000 7f1b7a097640 1 Processor -- start 2023-06-10T18:53:28.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.740+0000 7f1b7a097640 1 -- start start 2023-06-10T18:53:28.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.740+0000 7f1b7a097640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b740b3ac0 0x7f1b74153ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:28.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.740+0000 7f1b7a097640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b740cc690 0x7f1b74151f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:28.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.740+0000 7f1b7a097640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b740ccae0 0x7f1b74152460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:28.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.740+0000 7f1b7a097640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b7415d220 con 0x7f1b740cc690 2023-06-10T18:53:28.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.740+0000 7f1b7a097640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b740ca430 con 0x7f1b740ccae0 2023-06-10T18:53:28.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.740+0000 7f1b7a097640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b740cbf30 con 0x7f1b740b3ac0 2023-06-10T18:53:28.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.740+0000 7f1b72ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b740cc690 0x7f1b74151f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:28.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.740+0000 7f1b72ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b740cc690 0x7f1b74151f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50418/0 (socket says 172.21.15.53:50418) 2023-06-10T18:53:28.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.740+0000 7f1b72ffd640 1 -- 172.21.15.53:0/3359583897 learned_addr learned my addr 172.21.15.53:0/3359583897 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:28.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.740+0000 7f1b737fe640 1 --2- 172.21.15.53:0/3359583897 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b740b3ac0 0x7f1b74153ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:28.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.740+0000 7f1b73fff640 1 --2- 172.21.15.53:0/3359583897 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b740ccae0 0x7f1b74152460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:28.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.740+0000 7f1b72ffd640 1 -- 172.21.15.53:0/3359583897 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b740b3ac0 msgr2=0x7f1b74153ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:28.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.740+0000 7f1b72ffd640 1 --2- 172.21.15.53:0/3359583897 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b740b3ac0 0x7f1b74153ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:28.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.740+0000 7f1b72ffd640 1 -- 172.21.15.53:0/3359583897 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b740ccae0 msgr2=0x7f1b74152460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:28.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.740+0000 7f1b72ffd640 1 --2- 172.21.15.53:0/3359583897 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b740ccae0 0x7f1b74152460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:28.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.740+0000 7f1b72ffd640 1 -- 172.21.15.53:0/3359583897 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b6c009a70 con 0x7f1b740cc690 2023-06-10T18:53:28.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.740+0000 7f1b737fe640 1 --2- 172.21.15.53:0/3359583897 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b740b3ac0 0x7f1b74153ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:53:28.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.740+0000 7f1b72ffd640 1 --2- 172.21.15.53:0/3359583897 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b740cc690 0x7f1b74151f20 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f1b6800e930 tx=0x7f1b6800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:28.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.740+0000 7f1b5bfff640 1 -- 172.21.15.53:0/3359583897 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b68009690 con 0x7f1b740cc690 2023-06-10T18:53:28.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.740+0000 7f1b5bfff640 1 -- 172.21.15.53:0/3359583897 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b6800ca00 con 0x7f1b740cc690 2023-06-10T18:53:28.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.740+0000 7f1b5bfff640 1 -- 172.21.15.53:0/3359583897 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b6800cd70 con 0x7f1b740cc690 2023-06-10T18:53:28.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.740+0000 7f1b7a097640 1 -- 172.21.15.53:0/3359583897 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b74153620 con 0x7f1b740cc690 2023-06-10T18:53:28.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.740+0000 7f1b7a097640 1 -- 172.21.15.53:0/3359583897 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b74153be0 con 0x7f1b740cc690 2023-06-10T18:53:28.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.740+0000 7f1b7a097640 1 -- 172.21.15.53:0/3359583897 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b7404d790 con 0x7f1b740cc690 2023-06-10T18:53:28.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.744+0000 7f1b5bfff640 1 -- 172.21.15.53:0/3359583897 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1b68013470 con 0x7f1b740cc690 2023-06-10T18:53:28.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.744+0000 7f1b5bfff640 1 --2- 172.21.15.53:0/3359583897 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1b60066280 0x7f1b60068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:28.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.744+0000 7f1b5bfff640 1 -- 172.21.15.53:0/3359583897 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f1b68083e80 con 0x7f1b740cc690 2023-06-10T18:53:28.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.744+0000 7f1b737fe640 1 --2- 172.21.15.53:0/3359583897 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1b60066280 0x7f1b60068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:28.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.744+0000 7f1b737fe640 1 --2- 172.21.15.53:0/3359583897 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1b60066280 0x7f1b60068730 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1b740b0f10 tx=0x7f1b64009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:28.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.748+0000 7f1b5bfff640 1 -- 172.21.15.53:0/3359583897 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1b680514c0 con 0x7f1b740cc690 2023-06-10T18:53:28.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.900+0000 7f1b7a097640 1 -- 172.21.15.53:0/3359583897 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1b7415d360 con 0x7f1b740cc690 2023-06-10T18:53:28.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.904+0000 7f1b5bfff640 1 -- 172.21.15.53:0/3359583897 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18363 (secure 0 0 0) 0x7f1b68017090 con 0x7f1b740cc690 2023-06-10T18:53:28.913 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:53:28.913 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":25,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T18:53:27.127355+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-10T18:52:43.396243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-10T18:52:43.894228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.23","mappings":[{"from":3,"to":2}]},{"pgid":"4.3e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T18:53:28.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.904+0000 7f1b7a097640 1 -- 172.21.15.53:0/3359583897 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1b60066280 msgr2=0x7f1b60068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:28.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.904+0000 7f1b7a097640 1 --2- 172.21.15.53:0/3359583897 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1b60066280 0x7f1b60068730 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1b740b0f10 tx=0x7f1b64009040 comp rx=0 tx=0).stop 2023-06-10T18:53:28.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.904+0000 7f1b7a097640 1 -- 172.21.15.53:0/3359583897 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b740cc690 msgr2=0x7f1b74151f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:28.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.904+0000 7f1b7a097640 1 --2- 172.21.15.53:0/3359583897 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b740cc690 0x7f1b74151f20 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f1b6800e930 tx=0x7f1b6800edf0 comp rx=0 tx=0).stop 2023-06-10T18:53:28.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.904+0000 7f1b7a097640 1 -- 172.21.15.53:0/3359583897 shutdown_connections 2023-06-10T18:53:28.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.904+0000 7f1b7a097640 1 --2- 172.21.15.53:0/3359583897 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1b60066280 0x7f1b60068730 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:28.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.904+0000 7f1b7a097640 1 --2- 172.21.15.53:0/3359583897 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b740ccae0 0x7f1b74152460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:28.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.904+0000 7f1b7a097640 1 --2- 172.21.15.53:0/3359583897 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b740cc690 0x7f1b74151f20 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:28.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.904+0000 7f1b7a097640 1 --2- 172.21.15.53:0/3359583897 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b740b3ac0 0x7f1b74153ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:28.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.904+0000 7f1b7a097640 1 -- 172.21.15.53:0/3359583897 >> 172.21.15.53:0/3359583897 conn(0x7f1b74071790 msgr2=0x7f1b74069ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:28.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.904+0000 7f1b7a097640 1 -- 172.21.15.53:0/3359583897 shutdown_connections 2023-06-10T18:53:28.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:28.908+0000 7f1b7a097640 1 -- 172.21.15.53:0/3359583897 wait complete. 2023-06-10T18:53:28.932 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-10T18:52:33.633114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-10T18:52:39.171487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-10T18:52:43.396243+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-10T18:52:43.894228+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-10T18:53:28.933 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-10T18:53:29.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.056+0000 7fce9ca3b640 1 Processor -- start 2023-06-10T18:53:29.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.056+0000 7fce9ca3b640 1 -- start start 2023-06-10T18:53:29.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.056+0000 7fce9ca3b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fce980c9fa0 0x7fce9806bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:29.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.056+0000 7fce9ca3b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fce980af760 0x7fce980afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:29.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.056+0000 7fce9ca3b640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce9806b090 con 0x7fce9806c020 2023-06-10T18:53:29.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.056+0000 7fce9ca3b640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce980b0120 con 0x7fce980af760 2023-06-10T18:53:29.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.056+0000 7fce9ca3b640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce980ca370 con 0x7fce980c9fa0 2023-06-10T18:53:29.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.056+0000 7fce96d9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fce980af760 0x7fce980afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:29.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.056+0000 7fce8dd9b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fce9806c020 0x7fce980c82a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:37284/0 (socket says 172.21.15.53:37284) 2023-06-10T18:53:29.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.056+0000 7fce8dd9b640 1 -- 172.21.15.53:0/1926234194 learned_addr learned my addr 172.21.15.53:0/1926234194 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:53:29.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.056+0000 7fce9659c640 1 --2- 172.21.15.53:0/1926234194 >> v2:172.21.15.117:3300/0 conn(0x7fce980c9fa0 0x7fce9806bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:29.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.056+0000 7fce96d9d640 1 -- 172.21.15.53:0/1926234194 >> v2:172.21.15.117:3300/0 conn(0x7fce980c9fa0 msgr2=0x7fce9806bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:29.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.056+0000 7fce96d9d640 1 --2- 172.21.15.53:0/1926234194 >> v2:172.21.15.117:3300/0 conn(0x7fce980c9fa0 0x7fce9806bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:29.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.056+0000 7fce96d9d640 1 -- 172.21.15.53:0/1926234194 >> v1:172.21.15.53:6789/0 conn(0x7fce9806c020 legacy=0x7fce980c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:29.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.056+0000 7fce96d9d640 1 -- 172.21.15.53:0/1926234194 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce98070d50 con 0x7fce980af760 2023-06-10T18:53:29.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.060+0000 7fce96d9d640 1 --2- 172.21.15.53:0/1926234194 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce980af760 0x7fce980afbe0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fce9806e9d0 tx=0x7fce9001c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c381cfc1f0f5e27 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:29.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.060+0000 7fce95d9b640 1 -- 172.21.15.53:0/1926234194 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce900a5820 con 0x7fce980af760 2023-06-10T18:53:29.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.060+0000 7fce95d9b640 1 -- 172.21.15.53:0/1926234194 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce900a5980 con 0x7fce980af760 2023-06-10T18:53:29.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.060+0000 7fce95d9b640 1 -- 172.21.15.53:0/1926234194 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce900a5d10 con 0x7fce980af760 2023-06-10T18:53:29.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.060+0000 7fce9ca3b640 1 -- 172.21.15.53:0/1926234194 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce980af760 msgr2=0x7fce980afbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:29.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.060+0000 7fce9ca3b640 1 --2- 172.21.15.53:0/1926234194 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce980af760 0x7fce980afbe0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fce9806e9d0 tx=0x7fce9001c850 comp rx=0 tx=0).stop 2023-06-10T18:53:29.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.060+0000 7fce9ca3b640 1 -- 172.21.15.53:0/1926234194 shutdown_connections 2023-06-10T18:53:29.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.060+0000 7fce9ca3b640 1 --2- 172.21.15.53:0/1926234194 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce980af760 0x7fce980afbe0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:29.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.060+0000 7fce9ca3b640 1 --2- 172.21.15.53:0/1926234194 >> v2:172.21.15.117:3300/0 conn(0x7fce980c9fa0 0x7fce9806bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:29.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.060+0000 7fce9ca3b640 1 -- 172.21.15.53:0/1926234194 >> 172.21.15.53:0/1926234194 conn(0x7fce9806a0e0 msgr2=0x7fce980cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:29.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.060+0000 7fce9ca3b640 1 -- 172.21.15.53:0/1926234194 shutdown_connections 2023-06-10T18:53:29.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.060+0000 7fce9ca3b640 1 -- 172.21.15.53:0/1926234194 wait complete. 2023-06-10T18:53:29.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.060+0000 7fce9ca3b640 1 Processor -- start 2023-06-10T18:53:29.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.060+0000 7fce9ca3b640 1 -- start start 2023-06-10T18:53:29.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.060+0000 7fce9ca3b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce9806c020 0x7fce98159360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:29.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.060+0000 7fce9ca3b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce980af760 0x7fce981f4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:29.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.060+0000 7fce9ca3b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce980c9fa0 0x7fce980ab860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:29.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.060+0000 7fce9ca3b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce980ae250 con 0x7fce9806c020 2023-06-10T18:53:29.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.060+0000 7fce9ca3b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce980aeb20 con 0x7fce980c9fa0 2023-06-10T18:53:29.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.060+0000 7fce9ca3b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce981f50c0 con 0x7fce980af760 2023-06-10T18:53:29.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.060+0000 7fce9659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce9806c020 0x7fce98159360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:29.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.060+0000 7fce9659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce9806c020 0x7fce98159360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50442/0 (socket says 172.21.15.53:50442) 2023-06-10T18:53:29.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.060+0000 7fce9659c640 1 -- 172.21.15.53:0/332275558 learned_addr learned my addr 172.21.15.53:0/332275558 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:29.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.060+0000 7fce96d9d640 1 --2- 172.21.15.53:0/332275558 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce980c9fa0 0x7fce980ab860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:29.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.060+0000 7fce8dd9b640 1 --2- 172.21.15.53:0/332275558 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce980af760 0x7fce981f4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:29.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.060+0000 7fce9659c640 1 -- 172.21.15.53:0/332275558 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce980af760 msgr2=0x7fce981f4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:29.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.060+0000 7fce9659c640 1 --2- 172.21.15.53:0/332275558 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce980af760 0x7fce981f4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:29.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.060+0000 7fce9659c640 1 -- 172.21.15.53:0/332275558 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce980c9fa0 msgr2=0x7fce980ab860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:29.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.060+0000 7fce9659c640 1 --2- 172.21.15.53:0/332275558 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce980c9fa0 0x7fce980ab860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:29.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.060+0000 7fce9659c640 1 -- 172.21.15.53:0/332275558 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce90009a70 con 0x7fce9806c020 2023-06-10T18:53:29.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.060+0000 7fce96d9d640 1 --2- 172.21.15.53:0/332275558 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce980c9fa0 0x7fce980ab860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:53:29.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.060+0000 7fce9659c640 1 --2- 172.21.15.53:0/332275558 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce9806c020 0x7fce98159360 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fce8800d5f0 tx=0x7fce8800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:29.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.064+0000 7fce8f7fe640 1 -- 172.21.15.53:0/332275558 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce880125f0 con 0x7fce9806c020 2023-06-10T18:53:29.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.064+0000 7fce8f7fe640 1 -- 172.21.15.53:0/332275558 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce88012750 con 0x7fce9806c020 2023-06-10T18:53:29.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.064+0000 7fce8f7fe640 1 -- 172.21.15.53:0/332275558 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce88012ae0 con 0x7fce9806c020 2023-06-10T18:53:29.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.064+0000 7fce9ca3b640 1 -- 172.21.15.53:0/332275558 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce980ad640 con 0x7fce9806c020 2023-06-10T18:53:29.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.064+0000 7fce9ca3b640 1 -- 172.21.15.53:0/332275558 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce980adc00 con 0x7fce9806c020 2023-06-10T18:53:29.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.064+0000 7fce9ca3b640 1 -- 172.21.15.53:0/332275558 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce9804d790 con 0x7fce9806c020 2023-06-10T18:53:29.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.064+0000 7fce8f7fe640 1 -- 172.21.15.53:0/332275558 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fce88012c40 con 0x7fce9806c020 2023-06-10T18:53:29.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.064+0000 7fce8f7fe640 1 --2- 172.21.15.53:0/332275558 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fce780662b0 0x7fce78068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:29.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.064+0000 7fce8f7fe640 1 -- 172.21.15.53:0/332275558 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fce88084260 con 0x7fce9806c020 2023-06-10T18:53:29.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.064+0000 7fce8dd9b640 1 --2- 172.21.15.53:0/332275558 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fce780662b0 0x7fce78068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:29.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.064+0000 7fce8dd9b640 1 --2- 172.21.15.53:0/332275558 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fce780662b0 0x7fce78068760 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fce980ac9f0 tx=0x7fce80009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:29.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.068+0000 7fce8f7fe640 1 -- 172.21.15.53:0/332275558 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fce880516a0 con 0x7fce9806c020 2023-06-10T18:53:29.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.220+0000 7fce9ca3b640 1 -- 172.21.15.53:0/332275558 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fce980b17a0 con 0x7fce9806c020 2023-06-10T18:53:29.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.220+0000 7fce8f7fe640 1 -- 172.21.15.53:0/332275558 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fce88054cc0 con 0x7fce9806c020 2023-06-10T18:53:29.232 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-06-10T18:53:29.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.224+0000 7fce9ca3b640 1 -- 172.21.15.53:0/332275558 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fce780662b0 msgr2=0x7fce78068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:29.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.224+0000 7fce9ca3b640 1 --2- 172.21.15.53:0/332275558 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fce780662b0 0x7fce78068760 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fce980ac9f0 tx=0x7fce80009040 comp rx=0 tx=0).stop 2023-06-10T18:53:29.235 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.224+0000 7fce9ca3b640 1 -- 172.21.15.53:0/332275558 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce9806c020 msgr2=0x7fce98159360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:29.235 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.224+0000 7fce9ca3b640 1 --2- 172.21.15.53:0/332275558 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce9806c020 0x7fce98159360 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fce8800d5f0 tx=0x7fce8800dab0 comp rx=0 tx=0).stop 2023-06-10T18:53:29.235 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.224+0000 7fce9ca3b640 1 -- 172.21.15.53:0/332275558 shutdown_connections 2023-06-10T18:53:29.235 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.224+0000 7fce9ca3b640 1 --2- 172.21.15.53:0/332275558 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fce780662b0 0x7fce78068760 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:29.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.224+0000 7fce9ca3b640 1 --2- 172.21.15.53:0/332275558 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce980c9fa0 0x7fce980ab860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:29.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.224+0000 7fce9ca3b640 1 --2- 172.21.15.53:0/332275558 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce980af760 0x7fce981f4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:29.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.224+0000 7fce9ca3b640 1 --2- 172.21.15.53:0/332275558 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce9806c020 0x7fce98159360 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:29.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.224+0000 7fce9ca3b640 1 -- 172.21.15.53:0/332275558 >> 172.21.15.53:0/332275558 conn(0x7fce9806a0e0 msgr2=0x7fce980c8280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:29.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.224+0000 7fce9ca3b640 1 -- 172.21.15.53:0/332275558 shutdown_connections 2023-06-10T18:53:29.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.224+0000 7fce9ca3b640 1 -- 172.21.15.53:0/332275558 wait complete. 2023-06-10T18:53:29.249 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-10T18:53:29.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.356+0000 7f130490a640 1 Processor -- start 2023-06-10T18:53:29.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.356+0000 7f130490a640 1 -- start start 2023-06-10T18:53:29.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.356+0000 7f130490a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f130015c090 0x7f13000b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:29.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.356+0000 7f130490a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f13000b7e30 0x7f13000d04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:29.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.356+0000 7f130490a640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13000cc7c0 con 0x7f13000b0b90 2023-06-10T18:53:29.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.356+0000 7f130490a640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13000ccaa0 con 0x7f13000b7e30 2023-06-10T18:53:29.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.356+0000 7f130490a640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13000ccd80 con 0x7f130015c090 2023-06-10T18:53:29.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.356+0000 7f12fed9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f13000b7e30 0x7f13000d04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:29.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.356+0000 7f12fed9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f13000b7e30 0x7f13000d04d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50448/0 (socket says 172.21.15.53:50448) 2023-06-10T18:53:29.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.356+0000 7f12fdd9b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f13000b0b90 0x7f13000b7720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:37286/0 (socket says 172.21.15.53:37286) 2023-06-10T18:53:29.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.356+0000 7f12fed9d640 1 -- 172.21.15.53:0/2486880992 learned_addr learned my addr 172.21.15.53:0/2486880992 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:29.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.356+0000 7f12fed9d640 1 -- 172.21.15.53:0/2486880992 >> v2:172.21.15.117:3300/0 conn(0x7f130015c090 msgr2=0x7f13000b10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:29.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.356+0000 7f12fed9d640 1 --2- 172.21.15.53:0/2486880992 >> v2:172.21.15.117:3300/0 conn(0x7f130015c090 0x7f13000b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:29.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.356+0000 7f12fed9d640 1 -- 172.21.15.53:0/2486880992 >> v1:172.21.15.53:6789/0 conn(0x7f13000b0b90 legacy=0x7f13000b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:29.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.356+0000 7f12fed9d640 1 -- 172.21.15.53:0/2486880992 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13000cd060 con 0x7f13000b7e30 2023-06-10T18:53:29.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.360+0000 7f12fed9d640 1 --2- 172.21.15.53:0/2486880992 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13000b7e30 0x7f13000d04d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f130008a080 tx=0x7f12f801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9af2f2ef1ce1d3 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:29.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.360+0000 7f12fd59a640 1 -- 172.21.15.53:0/2486880992 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f80a5730 con 0x7f13000b7e30 2023-06-10T18:53:29.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.360+0000 7f12fd59a640 1 -- 172.21.15.53:0/2486880992 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12f80a5890 con 0x7f13000b7e30 2023-06-10T18:53:29.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.360+0000 7f12fd59a640 1 -- 172.21.15.53:0/2486880992 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f80a5c20 con 0x7f13000b7e30 2023-06-10T18:53:29.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.360+0000 7f130490a640 1 -- 172.21.15.53:0/2486880992 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13000b7e30 msgr2=0x7f13000d04d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:29.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.360+0000 7f130490a640 1 --2- 172.21.15.53:0/2486880992 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13000b7e30 0x7f13000d04d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f130008a080 tx=0x7f12f801c910 comp rx=0 tx=0).stop 2023-06-10T18:53:29.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.360+0000 7f130490a640 1 -- 172.21.15.53:0/2486880992 shutdown_connections 2023-06-10T18:53:29.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.360+0000 7f130490a640 1 --2- 172.21.15.53:0/2486880992 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13000b7e30 0x7f13000d04d0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:29.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.360+0000 7f130490a640 1 --2- 172.21.15.53:0/2486880992 >> v2:172.21.15.117:3300/0 conn(0x7f130015c090 0x7f13000b10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:29.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.360+0000 7f130490a640 1 -- 172.21.15.53:0/2486880992 >> 172.21.15.53:0/2486880992 conn(0x7f1300069e20 msgr2=0x7f130006a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:29.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.360+0000 7f130490a640 1 -- 172.21.15.53:0/2486880992 shutdown_connections 2023-06-10T18:53:29.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.360+0000 7f130490a640 1 -- 172.21.15.53:0/2486880992 wait complete. 2023-06-10T18:53:29.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.360+0000 7f130490a640 1 Processor -- start 2023-06-10T18:53:29.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.360+0000 7f130490a640 1 -- start start 2023-06-10T18:53:29.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.360+0000 7f130490a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f13000b0b90 0x7f1300151340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:29.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.360+0000 7f130490a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13000b7e30 0x7f1300154660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:29.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.360+0000 7f130490a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f130015c090 0x7f1300152a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:29.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.360+0000 7f130490a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1300154ba0 con 0x7f13000b7e30 2023-06-10T18:53:29.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.360+0000 7f130490a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1300151990 con 0x7f13000b0b90 2023-06-10T18:53:29.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.360+0000 7f130490a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1300151c70 con 0x7f130015c090 2023-06-10T18:53:29.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.360+0000 7f12fdd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13000b7e30 0x7f1300154660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:29.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.360+0000 7f12fdd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13000b7e30 0x7f1300154660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50460/0 (socket says 172.21.15.53:50460) 2023-06-10T18:53:29.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.360+0000 7f12fdd9b640 1 -- 172.21.15.53:0/3575153610 learned_addr learned my addr 172.21.15.53:0/3575153610 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:29.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.360+0000 7f12fed9d640 1 --2- 172.21.15.53:0/3575153610 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f130015c090 0x7f1300152a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:29.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.360+0000 7f12fe59c640 1 --2- 172.21.15.53:0/3575153610 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f13000b0b90 0x7f1300151340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:29.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.360+0000 7f12fdd9b640 1 -- 172.21.15.53:0/3575153610 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f130015c090 msgr2=0x7f1300152a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:29.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.360+0000 7f12fdd9b640 1 --2- 172.21.15.53:0/3575153610 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f130015c090 0x7f1300152a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:29.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.360+0000 7f12fdd9b640 1 -- 172.21.15.53:0/3575153610 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f13000b0b90 msgr2=0x7f1300151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:29.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.360+0000 7f12fdd9b640 1 --2- 172.21.15.53:0/3575153610 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f13000b0b90 0x7f1300151340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:29.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.360+0000 7f12fdd9b640 1 -- 172.21.15.53:0/3575153610 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f8009b30 con 0x7f13000b7e30 2023-06-10T18:53:29.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.360+0000 7f12fdd9b640 1 --2- 172.21.15.53:0/3575153610 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13000b7e30 0x7f1300154660 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f12f400c430 tx=0x7f12f400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:29.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.360+0000 7f12eeffd640 1 -- 172.21.15.53:0/3575153610 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f40074e0 con 0x7f13000b7e30 2023-06-10T18:53:29.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.360+0000 7f12eeffd640 1 -- 172.21.15.53:0/3575153610 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12f4007640 con 0x7f13000b7e30 2023-06-10T18:53:29.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.364+0000 7f130490a640 1 -- 172.21.15.53:0/3575153610 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1300151f50 con 0x7f13000b7e30 2023-06-10T18:53:29.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.364+0000 7f12eeffd640 1 -- 172.21.15.53:0/3575153610 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f4004a30 con 0x7f13000b7e30 2023-06-10T18:53:29.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.364+0000 7f130490a640 1 -- 172.21.15.53:0/3575153610 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1300152510 con 0x7f13000b7e30 2023-06-10T18:53:29.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.364+0000 7f130490a640 1 -- 172.21.15.53:0/3575153610 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13001526a0 con 0x7f13000b7e30 2023-06-10T18:53:29.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.364+0000 7f12eeffd640 1 -- 172.21.15.53:0/3575153610 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f12f4004b90 con 0x7f13000b7e30 2023-06-10T18:53:29.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.364+0000 7f12eeffd640 1 --2- 172.21.15.53:0/3575153610 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f12e0066280 0x7f12e0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:29.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.364+0000 7f12eeffd640 1 -- 172.21.15.53:0/3575153610 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f12f40837e0 con 0x7f13000b7e30 2023-06-10T18:53:29.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.364+0000 7f12fe59c640 1 --2- 172.21.15.53:0/3575153610 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f12e0066280 0x7f12e0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:29.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.364+0000 7f12fe59c640 1 --2- 172.21.15.53:0/3575153610 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f12e0066280 0x7f12e0068730 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f12f0006fd0 tx=0x7f12f0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:29.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.368+0000 7f12eeffd640 1 -- 172.21.15.53:0/3575153610 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f12f40546b0 con 0x7f13000b7e30 2023-06-10T18:53:29.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.512+0000 7f130490a640 1 -- 172.21.15.53:0/3575153610 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f130004d790 con 0x7f13000b7e30 2023-06-10T18:53:29.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.516+0000 7f12eeffd640 1 -- 172.21.15.53:0/3575153610 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f12f4054240 con 0x7f13000b7e30 2023-06-10T18:53:29.524 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-06-10T18:53:29.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.516+0000 7f130490a640 1 -- 172.21.15.53:0/3575153610 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f12e0066280 msgr2=0x7f12e0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:29.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.516+0000 7f130490a640 1 --2- 172.21.15.53:0/3575153610 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f12e0066280 0x7f12e0068730 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f12f0006fd0 tx=0x7f12f0008040 comp rx=0 tx=0).stop 2023-06-10T18:53:29.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.516+0000 7f130490a640 1 -- 172.21.15.53:0/3575153610 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13000b7e30 msgr2=0x7f1300154660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:29.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.516+0000 7f130490a640 1 --2- 172.21.15.53:0/3575153610 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13000b7e30 0x7f1300154660 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f12f400c430 tx=0x7f12f400c8f0 comp rx=0 tx=0).stop 2023-06-10T18:53:29.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.516+0000 7f130490a640 1 -- 172.21.15.53:0/3575153610 shutdown_connections 2023-06-10T18:53:29.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.516+0000 7f130490a640 1 --2- 172.21.15.53:0/3575153610 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f12e0066280 0x7f12e0068730 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:29.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.516+0000 7f130490a640 1 --2- 172.21.15.53:0/3575153610 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f130015c090 0x7f1300152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:29.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.516+0000 7f130490a640 1 --2- 172.21.15.53:0/3575153610 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13000b7e30 0x7f1300154660 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:29.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.516+0000 7f130490a640 1 --2- 172.21.15.53:0/3575153610 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f13000b0b90 0x7f1300151340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:29.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.516+0000 7f130490a640 1 -- 172.21.15.53:0/3575153610 >> 172.21.15.53:0/3575153610 conn(0x7f1300069e20 msgr2=0x7f13000b5170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:29.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.516+0000 7f130490a640 1 -- 172.21.15.53:0/3575153610 shutdown_connections 2023-06-10T18:53:29.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.516+0000 7f130490a640 1 -- 172.21.15.53:0/3575153610 wait complete. 2023-06-10T18:53:29.541 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-10T18:53:29.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.656+0000 7fabf6245640 1 Processor -- start 2023-06-10T18:53:29.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.656+0000 7fabf6245640 1 -- start start 2023-06-10T18:53:29.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.656+0000 7fabf6245640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fabf00c82a0 0x7fabf00c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:29.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.656+0000 7fabf6245640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fabf00af760 0x7fabf00afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:29.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.656+0000 7fabf6245640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabf006b090 con 0x7fabf00c9fa0 2023-06-10T18:53:29.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.656+0000 7fabf6245640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabf00b0120 con 0x7fabf00af760 2023-06-10T18:53:29.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.656+0000 7fabf6245640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabf00ca370 con 0x7fabf00c82a0 2023-06-10T18:53:29.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.656+0000 7fabef7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fabf00c9fa0 0x7fabf006bae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:37298/0 (socket says 172.21.15.53:37298) 2023-06-10T18:53:29.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.656+0000 7fabef7fe640 1 -- 172.21.15.53:0/2603698163 learned_addr learned my addr 172.21.15.53:0/2603698163 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:53:29.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.656+0000 7fabeffff640 1 --2- 172.21.15.53:0/2603698163 >> v2:172.21.15.53:3300/0 conn(0x7fabf00af760 0x7fabf00afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:29.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.656+0000 7fabeeffd640 1 --2- 172.21.15.53:0/2603698163 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fabf00c82a0 0x7fabf00c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:29.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.656+0000 7fabee7fc640 1 -- 172.21.15.53:0/2603698163 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 718924105 0 0) 0x7fabf006b090 con 0x7fabf00c9fa0 2023-06-10T18:53:29.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.656+0000 7fabee7fc640 1 -- 172.21.15.53:0/2603698163 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabd8003530 con 0x7fabf00c9fa0 2023-06-10T18:53:29.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.656+0000 7fabeffff640 1 -- 172.21.15.53:0/2603698163 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fabf00c82a0 msgr2=0x7fabf00c86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:29.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.656+0000 7fabeffff640 1 --2- 172.21.15.53:0/2603698163 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fabf00c82a0 0x7fabf00c86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:29.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.656+0000 7fabeffff640 1 -- 172.21.15.53:0/2603698163 >> v1:172.21.15.53:6789/0 conn(0x7fabf00c9fa0 legacy=0x7fabf006bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:29.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.656+0000 7fabeffff640 1 -- 172.21.15.53:0/2603698163 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabf0070d50 con 0x7fabf00af760 2023-06-10T18:53:29.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.660+0000 7fabeffff640 1 --2- 172.21.15.53:0/2603698163 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fabf00af760 0x7fabf00afbe0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fabe8009d90 tx=0x7fabe801c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d51857460db5774e server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:29.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.660+0000 7fabee7fc640 1 -- 172.21.15.53:0/2603698163 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe80a5950 con 0x7fabf00af760 2023-06-10T18:53:29.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.660+0000 7fabee7fc640 1 -- 172.21.15.53:0/2603698163 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabe80a5ab0 con 0x7fabf00af760 2023-06-10T18:53:29.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.660+0000 7fabee7fc640 1 -- 172.21.15.53:0/2603698163 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe80a5e40 con 0x7fabf00af760 2023-06-10T18:53:29.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.660+0000 7fabf6245640 1 -- 172.21.15.53:0/2603698163 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fabf00af760 msgr2=0x7fabf00afbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:29.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.660+0000 7fabf6245640 1 --2- 172.21.15.53:0/2603698163 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fabf00af760 0x7fabf00afbe0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fabe8009d90 tx=0x7fabe801c890 comp rx=0 tx=0).stop 2023-06-10T18:53:29.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.660+0000 7fabf6245640 1 -- 172.21.15.53:0/2603698163 shutdown_connections 2023-06-10T18:53:29.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.660+0000 7fabf6245640 1 --2- 172.21.15.53:0/2603698163 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fabf00af760 0x7fabf00afbe0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:29.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.660+0000 7fabf6245640 1 --2- 172.21.15.53:0/2603698163 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fabf00c82a0 0x7fabf00c86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:29.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.660+0000 7fabf6245640 1 -- 172.21.15.53:0/2603698163 >> 172.21.15.53:0/2603698163 conn(0x7fabf006a0e0 msgr2=0x7fabf00cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:29.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.660+0000 7fabf6245640 1 -- 172.21.15.53:0/2603698163 shutdown_connections 2023-06-10T18:53:29.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.660+0000 7fabf6245640 1 -- 172.21.15.53:0/2603698163 wait complete. 2023-06-10T18:53:29.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.660+0000 7fabf6245640 1 Processor -- start 2023-06-10T18:53:29.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.660+0000 7fabf6245640 1 -- start start 2023-06-10T18:53:29.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.660+0000 7fabf6245640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fabf00af760 0x7fabf00c30a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:29.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.660+0000 7fabf6245640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fabf00c82a0 0x7fabf01f7a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:29.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.660+0000 7fabf6245640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fabf00c9fa0 0x7fabf01f7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:29.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.660+0000 7fabf6245640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf00b16b0 con 0x7fabf00af760 2023-06-10T18:53:29.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.660+0000 7fabf6245640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf01f89b0 con 0x7fabf00c82a0 2023-06-10T18:53:29.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.660+0000 7fabf6245640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabf01f8480 con 0x7fabf00c9fa0 2023-06-10T18:53:29.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.660+0000 7fabef7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fabf00af760 0x7fabf00c30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:29.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.660+0000 7fabef7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fabf00af760 0x7fabf00c30a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50482/0 (socket says 172.21.15.53:50482) 2023-06-10T18:53:29.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.660+0000 7fabef7fe640 1 -- 172.21.15.53:0/183427692 learned_addr learned my addr 172.21.15.53:0/183427692 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:29.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.660+0000 7fabeffff640 1 --2- 172.21.15.53:0/183427692 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fabf00c9fa0 0x7fabf01f7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:29.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.660+0000 7fabef7fe640 1 -- 172.21.15.53:0/183427692 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fabf00c9fa0 msgr2=0x7fabf01f7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:29.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.660+0000 7fabef7fe640 1 --2- 172.21.15.53:0/183427692 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fabf00c9fa0 0x7fabf01f7f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:29.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.660+0000 7fabef7fe640 1 -- 172.21.15.53:0/183427692 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fabf00c82a0 msgr2=0x7fabf01f7a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:29.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.660+0000 7fabef7fe640 1 --2- 172.21.15.53:0/183427692 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fabf00c82a0 0x7fabf01f7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:29.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.660+0000 7fabef7fe640 1 -- 172.21.15.53:0/183427692 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe8009a70 con 0x7fabf00af760 2023-06-10T18:53:29.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.664+0000 7fabef7fe640 1 --2- 172.21.15.53:0/183427692 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fabf00af760 0x7fabf00c30a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fabe000c420 tx=0x7fabe000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:29.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.664+0000 7fabd7fff640 1 -- 172.21.15.53:0/183427692 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe0005cf0 con 0x7fabf00af760 2023-06-10T18:53:29.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.664+0000 7fabd7fff640 1 -- 172.21.15.53:0/183427692 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabe0005e50 con 0x7fabf00af760 2023-06-10T18:53:29.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.664+0000 7fabd7fff640 1 -- 172.21.15.53:0/183427692 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe00072d0 con 0x7fabf00af760 2023-06-10T18:53:29.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.664+0000 7fabf6245640 1 -- 172.21.15.53:0/183427692 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabf01f86d0 con 0x7fabf00af760 2023-06-10T18:53:29.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.664+0000 7fabf6245640 1 -- 172.21.15.53:0/183427692 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabf00c7d30 con 0x7fabf00af760 2023-06-10T18:53:29.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.664+0000 7fabf6245640 1 -- 172.21.15.53:0/183427692 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabf00c7f50 con 0x7fabf00af760 2023-06-10T18:53:29.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.664+0000 7fabd7fff640 1 -- 172.21.15.53:0/183427692 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fabe0007430 con 0x7fabf00af760 2023-06-10T18:53:29.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.664+0000 7fabd7fff640 1 --2- 172.21.15.53:0/183427692 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fabdc0662b0 0x7fabdc068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:29.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.664+0000 7fabd7fff640 1 -- 172.21.15.53:0/183427692 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fabe0083180 con 0x7fabf00af760 2023-06-10T18:53:29.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.664+0000 7fabeeffd640 1 --2- 172.21.15.53:0/183427692 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fabdc0662b0 0x7fabdc068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:29.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.664+0000 7fabeeffd640 1 --2- 172.21.15.53:0/183427692 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fabdc0662b0 0x7fabdc068760 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fabf0153ea0 tx=0x7fabe4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:29.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.668+0000 7fabd7fff640 1 -- 172.21.15.53:0/183427692 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fabe0050700 con 0x7fabf00af760 2023-06-10T18:53:29.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.820+0000 7fabf6245640 1 -- 172.21.15.53:0/183427692 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fabf004d790 con 0x7fabf00af760 2023-06-10T18:53:29.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.820+0000 7fabd7fff640 1 -- 172.21.15.53:0/183427692 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fabe0053d20 con 0x7fabf00af760 2023-06-10T18:53:29.829 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-06-10T18:53:29.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.820+0000 7fabf6245640 1 -- 172.21.15.53:0/183427692 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fabdc0662b0 msgr2=0x7fabdc068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:29.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.820+0000 7fabf6245640 1 --2- 172.21.15.53:0/183427692 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fabdc0662b0 0x7fabdc068760 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fabf0153ea0 tx=0x7fabe4008040 comp rx=0 tx=0).stop 2023-06-10T18:53:29.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.820+0000 7fabf6245640 1 -- 172.21.15.53:0/183427692 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fabf00af760 msgr2=0x7fabf00c30a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:29.832 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.820+0000 7fabf6245640 1 --2- 172.21.15.53:0/183427692 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fabf00af760 0x7fabf00c30a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fabe000c420 tx=0x7fabe000c8e0 comp rx=0 tx=0).stop 2023-06-10T18:53:29.832 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.824+0000 7fabf6245640 1 -- 172.21.15.53:0/183427692 shutdown_connections 2023-06-10T18:53:29.832 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.824+0000 7fabf6245640 1 --2- 172.21.15.53:0/183427692 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fabdc0662b0 0x7fabdc068760 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:29.832 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.824+0000 7fabf6245640 1 --2- 172.21.15.53:0/183427692 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fabf00c9fa0 0x7fabf01f7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:29.832 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.824+0000 7fabf6245640 1 --2- 172.21.15.53:0/183427692 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fabf00c82a0 0x7fabf01f7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:29.832 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.824+0000 7fabf6245640 1 --2- 172.21.15.53:0/183427692 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fabf00af760 0x7fabf00c30a0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:29.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.824+0000 7fabf6245640 1 -- 172.21.15.53:0/183427692 >> 172.21.15.53:0/183427692 conn(0x7fabf006a0e0 msgr2=0x7fabf01590e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:29.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.824+0000 7fabf6245640 1 -- 172.21.15.53:0/183427692 shutdown_connections 2023-06-10T18:53:29.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.824+0000 7fabf6245640 1 -- 172.21.15.53:0/183427692 wait complete. 2023-06-10T18:53:29.849 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-10T18:53:29.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.964+0000 7fede887c640 1 Processor -- start 2023-06-10T18:53:29.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.964+0000 7fede887c640 1 -- start start 2023-06-10T18:53:29.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.964+0000 7fede887c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fede40c9fa0 0x7fede406bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:29.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.964+0000 7fede887c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fede40af760 0x7fede40afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:29.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.964+0000 7fede887c640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fede406b090 con 0x7fede406c020 2023-06-10T18:53:29.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.964+0000 7fede887c640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fede40b0120 con 0x7fede40af760 2023-06-10T18:53:29.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.964+0000 7fede887c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fede40ca370 con 0x7fede40c9fa0 2023-06-10T18:53:29.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.964+0000 7fede1d9b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fede406c020 0x7fede40c82a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:37306/0 (socket says 172.21.15.53:37306) 2023-06-10T18:53:29.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.964+0000 7fede1d9b640 1 -- 172.21.15.53:0/2184106087 learned_addr learned my addr 172.21.15.53:0/2184106087 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:53:29.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.964+0000 7fede259c640 1 --2- 172.21.15.53:0/2184106087 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fede40c9fa0 0x7fede406bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:29.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.964+0000 7fede2d9d640 1 --2- 172.21.15.53:0/2184106087 >> v2:172.21.15.117:3300/0 conn(0x7fede40af760 0x7fede40afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:29.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.964+0000 7fede159a640 1 -- 172.21.15.53:0/2184106087 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3847230717 0 0) 0x7fede406b090 con 0x7fede406c020 2023-06-10T18:53:29.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.964+0000 7fede159a640 1 -- 172.21.15.53:0/2184106087 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fedcc003530 con 0x7fede406c020 2023-06-10T18:53:29.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.964+0000 7fede159a640 1 -- 172.21.15.53:0/2184106087 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 970620216 0 0) 0x7fedcc003530 con 0x7fede406c020 2023-06-10T18:53:29.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.964+0000 7fede159a640 1 -- 172.21.15.53:0/2184106087 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fede40c9fa0 msgr2=0x7fede406bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:29.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.964+0000 7fede159a640 1 --2- 172.21.15.53:0/2184106087 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fede40c9fa0 0x7fede406bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:29.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.964+0000 7fede159a640 1 -- 172.21.15.53:0/2184106087 >> v2:172.21.15.117:3300/0 conn(0x7fede40af760 msgr2=0x7fede40afbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:29.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.964+0000 7fede159a640 1 --2- 172.21.15.53:0/2184106087 >> v2:172.21.15.117:3300/0 conn(0x7fede40af760 0x7fede40afbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:29.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.964+0000 7fede159a640 1 -- 172.21.15.53:0/2184106087 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fede4070d50 con 0x7fede406c020 2023-06-10T18:53:29.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.964+0000 7fede159a640 1 -- 172.21.15.53:0/2184106087 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fedd4001680 con 0x7fede406c020 2023-06-10T18:53:29.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.964+0000 7fede159a640 1 -- 172.21.15.53:0/2184106087 >> v1:172.21.15.53:6789/0 conn(0x7fede406c020 legacy=0x7fede40c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:29.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.964+0000 7fede159a640 1 --2- 172.21.15.53:0/2184106087 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fedcc003980 0x7fedcc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:29.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.964+0000 7fede159a640 1 --2- 172.21.15.53:0/2184106087 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fedcc0043b0 0x7fedcc004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:29.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.964+0000 7fede159a640 1 --2- 172.21.15.53:0/2184106087 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fede40c9fa0 0x7fedcc004fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:29.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.964+0000 7fede159a640 1 -- 172.21.15.53:0/2184106087 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede40b0120 con 0x7fedcc0043b0 2023-06-10T18:53:29.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.964+0000 7fede159a640 1 -- 172.21.15.53:0/2184106087 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede40ca370 con 0x7fedcc003980 2023-06-10T18:53:29.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.964+0000 7fede159a640 1 -- 172.21.15.53:0/2184106087 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedcc00b990 con 0x7fede40c9fa0 2023-06-10T18:53:29.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.964+0000 7fede2d9d640 1 --2- 172.21.15.53:0/2184106087 >> v2:172.21.15.117:3300/0 conn(0x7fede40af760 0x7fede40afbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-10T18:53:29.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.964+0000 7fede1d9b640 1 --2- 172.21.15.53:0/2184106087 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fedcc0043b0 0x7fedcc004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:29.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.964+0000 7fede259c640 1 --2- 172.21.15.53:0/2184106087 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fedcc003980 0x7fedcc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:29.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.964+0000 7fede2d9d640 1 --2- 172.21.15.53:0/2184106087 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fede40c9fa0 0x7fedcc004fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:29.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.964+0000 7fede1d9b640 1 -- 172.21.15.53:0/2184106087 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fede40c9fa0 msgr2=0x7fedcc004fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:29.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.964+0000 7fede1d9b640 1 --2- 172.21.15.53:0/2184106087 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fede40c9fa0 0x7fedcc004fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:29.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.964+0000 7fede1d9b640 1 -- 172.21.15.53:0/2184106087 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fedcc003980 msgr2=0x7fedcc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:29.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.964+0000 7fede1d9b640 1 --2- 172.21.15.53:0/2184106087 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fedcc003980 0x7fedcc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:29.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.964+0000 7fede1d9b640 1 -- 172.21.15.53:0/2184106087 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedcc003530 con 0x7fedcc0043b0 2023-06-10T18:53:29.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.964+0000 7fede259c640 1 --2- 172.21.15.53:0/2184106087 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fedcc003980 0x7fedcc003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:53:29.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.968+0000 7fede1d9b640 1 --2- 172.21.15.53:0/2184106087 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fedcc0043b0 0x7fedcc004870 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fedd400c240 tx=0x7fedd401cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70fc6575d0e27240 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:29.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.968+0000 7fede159a640 1 -- 172.21.15.53:0/2184106087 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd4005ae0 con 0x7fedcc0043b0 2023-06-10T18:53:29.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.968+0000 7fede159a640 1 -- 172.21.15.53:0/2184106087 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedd4005c60 con 0x7fedcc0043b0 2023-06-10T18:53:29.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.968+0000 7fede159a640 1 -- 172.21.15.53:0/2184106087 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd40a5820 con 0x7fedcc0043b0 2023-06-10T18:53:29.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.968+0000 7fede887c640 1 -- 172.21.15.53:0/2184106087 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fedcc0043b0 msgr2=0x7fedcc004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:29.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.968+0000 7fede887c640 1 --2- 172.21.15.53:0/2184106087 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fedcc0043b0 0x7fedcc004870 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fedd400c240 tx=0x7fedd401cc30 comp rx=0 tx=0).stop 2023-06-10T18:53:29.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.968+0000 7fede2d9d640 1 -- 172.21.15.53:0/2184106087 reap_dead start 2023-06-10T18:53:29.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.968+0000 7fede887c640 1 -- 172.21.15.53:0/2184106087 shutdown_connections 2023-06-10T18:53:29.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.968+0000 7fede887c640 1 -- 172.21.15.53:0/2184106087 >> 172.21.15.53:0/2184106087 conn(0x7fede406a0e0 msgr2=0x7fede40cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:29.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.968+0000 7fede887c640 1 -- 172.21.15.53:0/2184106087 shutdown_connections 2023-06-10T18:53:29.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.968+0000 7fede887c640 1 -- 172.21.15.53:0/2184106087 wait complete. 2023-06-10T18:53:29.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.968+0000 7fede887c640 1 Processor -- start 2023-06-10T18:53:29.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.968+0000 7fede887c640 1 -- start start 2023-06-10T18:53:29.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.972+0000 7fede887c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fedcc0043b0 0x7fede41582d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:29.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.972+0000 7fede887c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fede40ad660 0x7fede40cc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:29.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.972+0000 7fede887c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fede40ccb10 0x7fede41f4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:29.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.972+0000 7fede887c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede40ac5c0 con 0x7fede40ad660 2023-06-10T18:53:29.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.972+0000 7fede887c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede40ac8a0 con 0x7fede40ccb10 2023-06-10T18:53:29.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.972+0000 7fede887c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fede40acb80 con 0x7fedcc0043b0 2023-06-10T18:53:29.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.972+0000 7fede1d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fede40ad660 0x7fede40cc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:29.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.972+0000 7fede1d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fede40ad660 0x7fede40cc5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50492/0 (socket says 172.21.15.53:50492) 2023-06-10T18:53:29.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.972+0000 7fede1d9b640 1 -- 172.21.15.53:0/2666505631 learned_addr learned my addr 172.21.15.53:0/2666505631 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:29.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.972+0000 7fede2d9d640 1 --2- 172.21.15.53:0/2666505631 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fede40ccb10 0x7fede41f4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:29.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.972+0000 7fede259c640 1 --2- 172.21.15.53:0/2666505631 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fedcc0043b0 0x7fede41582d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:29.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.972+0000 7fede1d9b640 1 -- 172.21.15.53:0/2666505631 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fedcc0043b0 msgr2=0x7fede41582d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:29.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.972+0000 7fede1d9b640 1 --2- 172.21.15.53:0/2666505631 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fedcc0043b0 0x7fede41582d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:29.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.972+0000 7fede1d9b640 1 -- 172.21.15.53:0/2666505631 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fede40ccb10 msgr2=0x7fede41f4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:29.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.972+0000 7fede1d9b640 1 --2- 172.21.15.53:0/2666505631 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fede40ccb10 0x7fede41f4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:29.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.972+0000 7fede1d9b640 1 -- 172.21.15.53:0/2666505631 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fede40ace60 con 0x7fede40ad660 2023-06-10T18:53:29.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.972+0000 7fede2d9d640 1 --2- 172.21.15.53:0/2666505631 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fede40ccb10 0x7fede41f4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:53:29.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.972+0000 7fede1d9b640 1 --2- 172.21.15.53:0/2666505631 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fede40ad660 0x7fede40cc5d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fedd400c240 tx=0x7fedcc005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:29.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.972+0000 7fedd2ffd640 1 -- 172.21.15.53:0/2666505631 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd40b4070 con 0x7fede40ad660 2023-06-10T18:53:29.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.972+0000 7fedd2ffd640 1 -- 172.21.15.53:0/2666505631 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedd4001440 con 0x7fede40ad660 2023-06-10T18:53:29.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.972+0000 7fede887c640 1 -- 172.21.15.53:0/2666505631 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fede40ad140 con 0x7fede40ad660 2023-06-10T18:53:29.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.972+0000 7fedd2ffd640 1 -- 172.21.15.53:0/2666505631 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd40017f0 con 0x7fede40ad660 2023-06-10T18:53:29.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.972+0000 7fede887c640 1 -- 172.21.15.53:0/2666505631 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fede4158810 con 0x7fede40ad660 2023-06-10T18:53:29.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.972+0000 7fede887c640 1 -- 172.21.15.53:0/2666505631 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fede40ad2d0 con 0x7fede40ad660 2023-06-10T18:53:29.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.972+0000 7fedd2ffd640 1 -- 172.21.15.53:0/2666505631 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fedd40a5820 con 0x7fede40ad660 2023-06-10T18:53:29.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.972+0000 7fedd2ffd640 1 --2- 172.21.15.53:0/2666505631 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fedc40662b0 0x7fedc4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:29.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.972+0000 7fedd2ffd640 1 -- 172.21.15.53:0/2666505631 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fedd411d810 con 0x7fede40ad660 2023-06-10T18:53:29.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.972+0000 7fede259c640 1 --2- 172.21.15.53:0/2666505631 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fedc40662b0 0x7fedc4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:29.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.976+0000 7fede259c640 1 --2- 172.21.15.53:0/2666505631 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fedc40662b0 0x7fedc4068760 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fedd80098d0 tx=0x7fedd8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:29.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:29.980+0000 7fedd2ffd640 1 -- 172.21.15.53:0/2666505631 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fedd40eac50 con 0x7fede40ad660 2023-06-10T18:53:30.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.128+0000 7fede887c640 1 -- 172.21.15.53:0/2666505631 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fede406b590 con 0x7fede40ad660 2023-06-10T18:53:30.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.132+0000 7fedd2ffd640 1 -- 172.21.15.53:0/2666505631 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7fedd40ee270 con 0x7fede40ad660 2023-06-10T18:53:30.140 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-06-10T18:53:30.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.132+0000 7fede887c640 1 -- 172.21.15.53:0/2666505631 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fedc40662b0 msgr2=0x7fedc4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:30.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.132+0000 7fede887c640 1 --2- 172.21.15.53:0/2666505631 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fedc40662b0 0x7fedc4068760 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fedd80098d0 tx=0x7fedd8008040 comp rx=0 tx=0).stop 2023-06-10T18:53:30.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.132+0000 7fede887c640 1 -- 172.21.15.53:0/2666505631 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fede40ad660 msgr2=0x7fede40cc5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:30.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.132+0000 7fede887c640 1 --2- 172.21.15.53:0/2666505631 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fede40ad660 0x7fede40cc5d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fedd400c240 tx=0x7fedcc005800 comp rx=0 tx=0).stop 2023-06-10T18:53:30.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.132+0000 7fede887c640 1 -- 172.21.15.53:0/2666505631 shutdown_connections 2023-06-10T18:53:30.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.132+0000 7fede887c640 1 --2- 172.21.15.53:0/2666505631 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fedc40662b0 0x7fedc4068760 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:30.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.132+0000 7fede887c640 1 --2- 172.21.15.53:0/2666505631 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fede40ccb10 0x7fede41f4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:30.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.132+0000 7fede887c640 1 --2- 172.21.15.53:0/2666505631 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fede40ad660 0x7fede40cc5d0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:30.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.132+0000 7fede887c640 1 --2- 172.21.15.53:0/2666505631 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fedcc0043b0 0x7fede41582d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:30.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.132+0000 7fede887c640 1 -- 172.21.15.53:0/2666505631 >> 172.21.15.53:0/2666505631 conn(0x7fede406a0e0 msgr2=0x7fede40b1320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:30.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.132+0000 7fede887c640 1 -- 172.21.15.53:0/2666505631 shutdown_connections 2023-06-10T18:53:30.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.132+0000 7fede887c640 1 -- 172.21.15.53:0/2666505631 wait complete. 2023-06-10T18:53:30.158 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-10T18:53:30.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.284+0000 7fc6c182e640 1 Processor -- start 2023-06-10T18:53:30.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.284+0000 7fc6c182e640 1 -- start start 2023-06-10T18:53:30.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.284+0000 7fc6c182e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc6bc157df0 0x7fc6bc069e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:30.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.284+0000 7fc6c182e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6bc0b06d0 0x7fc6bc070240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:30.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.284+0000 7fc6c182e640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6bc0c92d0 con 0x7fc6bc0ca880 2023-06-10T18:53:30.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.284+0000 7fc6c182e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6bc06a3a0 con 0x7fc6bc157df0 2023-06-10T18:53:30.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.284+0000 7fc6c182e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6bc0c8d10 con 0x7fc6bc0b06d0 2023-06-10T18:53:30.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.284+0000 7fc6ba7fc640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fc6bc0ca880 0x7fc6bc0affc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:37310/0 (socket says 172.21.15.53:37310) 2023-06-10T18:53:30.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.284+0000 7fc6ba7fc640 1 -- 172.21.15.53:0/2330264353 learned_addr learned my addr 172.21.15.53:0/2330264353 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:53:30.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.284+0000 7fc6bb7fe640 1 --2- 172.21.15.53:0/2330264353 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6bc0b06d0 0x7fc6bc070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:30.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.284+0000 7fc6baffd640 1 --2- 172.21.15.53:0/2330264353 >> v2:172.21.15.117:3300/0 conn(0x7fc6bc157df0 0x7fc6bc069e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:30.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.284+0000 7fc6b9ffb640 1 -- 172.21.15.53:0/2330264353 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3215250273 0 0) 0x7fc6b0001120 con 0x7fc6bc0ca880 2023-06-10T18:53:30.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.284+0000 7fc6b9ffb640 1 -- 172.21.15.53:0/2330264353 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6a4003530 con 0x7fc6bc0ca880 2023-06-10T18:53:30.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.284+0000 7fc6b9ffb640 1 -- 172.21.15.53:0/2330264353 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3338194605 0 0) 0x7fc6a4003530 con 0x7fc6bc0ca880 2023-06-10T18:53:30.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.284+0000 7fc6b9ffb640 1 -- 172.21.15.53:0/2330264353 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6bc0b06d0 msgr2=0x7fc6bc070240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:30.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.284+0000 7fc6b9ffb640 1 --2- 172.21.15.53:0/2330264353 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6bc0b06d0 0x7fc6bc070240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:30.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.284+0000 7fc6b9ffb640 1 -- 172.21.15.53:0/2330264353 >> v2:172.21.15.117:3300/0 conn(0x7fc6bc157df0 msgr2=0x7fc6bc069e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:30.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.284+0000 7fc6b9ffb640 1 --2- 172.21.15.53:0/2330264353 >> v2:172.21.15.117:3300/0 conn(0x7fc6bc157df0 0x7fc6bc069e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:30.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.284+0000 7fc6b9ffb640 1 -- 172.21.15.53:0/2330264353 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6bc0c8ff0 con 0x7fc6bc0ca880 2023-06-10T18:53:30.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.284+0000 7fc6b9ffb640 1 -- 172.21.15.53:0/2330264353 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fc6b0001810 con 0x7fc6bc0ca880 2023-06-10T18:53:30.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.284+0000 7fc6bb7fe640 1 --2- 172.21.15.53:0/2330264353 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6bc0b06d0 0x7fc6bc070240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-10T18:53:30.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.284+0000 7fc6b9ffb640 1 -- 172.21.15.53:0/2330264353 >> v1:172.21.15.53:6789/0 conn(0x7fc6bc0ca880 legacy=0x7fc6bc0affc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:30.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.284+0000 7fc6b9ffb640 1 --2- 172.21.15.53:0/2330264353 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6bc0b06d0 0x7fc6a4003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:30.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.284+0000 7fc6b9ffb640 1 --2- 172.21.15.53:0/2330264353 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6a4003ec0 0x7fc6a40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:30.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.284+0000 7fc6b9ffb640 1 --2- 172.21.15.53:0/2330264353 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6a4004d10 0x7fc6a4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:30.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.284+0000 7fc6b9ffb640 1 -- 172.21.15.53:0/2330264353 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6bc06a3a0 con 0x7fc6a4003ec0 2023-06-10T18:53:30.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.284+0000 7fc6b9ffb640 1 -- 172.21.15.53:0/2330264353 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6bc0c8d10 con 0x7fc6a4004d10 2023-06-10T18:53:30.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.284+0000 7fc6b9ffb640 1 -- 172.21.15.53:0/2330264353 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a400b990 con 0x7fc6bc0b06d0 2023-06-10T18:53:30.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.284+0000 7fc6baffd640 1 --2- 172.21.15.53:0/2330264353 >> v2:172.21.15.117:3300/0 conn(0x7fc6bc157df0 0x7fc6bc069e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-10T18:53:30.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.284+0000 7fc6ba7fc640 1 --2- 172.21.15.53:0/2330264353 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6a4003ec0 0x7fc6a40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:30.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.284+0000 7fc6baffd640 1 --2- 172.21.15.53:0/2330264353 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6bc0b06d0 0x7fc6a4003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:30.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.284+0000 7fc6bb7fe640 1 --2- 172.21.15.53:0/2330264353 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6a4004d10 0x7fc6a4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:30.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.284+0000 7fc6ba7fc640 1 -- 172.21.15.53:0/2330264353 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6bc0b06d0 msgr2=0x7fc6a4003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:30.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.284+0000 7fc6ba7fc640 1 --2- 172.21.15.53:0/2330264353 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6bc0b06d0 0x7fc6a4003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:30.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.284+0000 7fc6ba7fc640 1 -- 172.21.15.53:0/2330264353 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6a4004d10 msgr2=0x7fc6a4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:30.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.284+0000 7fc6ba7fc640 1 --2- 172.21.15.53:0/2330264353 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6a4004d10 0x7fc6a4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:30.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.284+0000 7fc6ba7fc640 1 -- 172.21.15.53:0/2330264353 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6ac00b6c0 con 0x7fc6a4003ec0 2023-06-10T18:53:30.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.284+0000 7fc6bb7fe640 1 --2- 172.21.15.53:0/2330264353 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6a4004d10 0x7fc6a4005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:30.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.288+0000 7fc6ba7fc640 1 --2- 172.21.15.53:0/2330264353 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6a4003ec0 0x7fc6a40047d0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc0caca0 tx=0x7fc6b001cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5ad8c96331e1c7e server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:30.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.288+0000 7fc6b9ffb640 1 -- 172.21.15.53:0/2330264353 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b00058e0 con 0x7fc6a4003ec0 2023-06-10T18:53:30.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.288+0000 7fc6b9ffb640 1 -- 172.21.15.53:0/2330264353 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6b0005a60 con 0x7fc6a4003ec0 2023-06-10T18:53:30.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.288+0000 7fc6b9ffb640 1 -- 172.21.15.53:0/2330264353 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b0005e50 con 0x7fc6a4003ec0 2023-06-10T18:53:30.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.288+0000 7fc6c182e640 1 -- 172.21.15.53:0/2330264353 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6a4003ec0 msgr2=0x7fc6a40047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:30.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.288+0000 7fc6c182e640 1 --2- 172.21.15.53:0/2330264353 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6a4003ec0 0x7fc6a40047d0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc0caca0 tx=0x7fc6b001cc20 comp rx=0 tx=0).stop 2023-06-10T18:53:30.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.288+0000 7fc6bb7fe640 1 -- 172.21.15.53:0/2330264353 reap_dead start 2023-06-10T18:53:30.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.288+0000 7fc6c182e640 1 -- 172.21.15.53:0/2330264353 shutdown_connections 2023-06-10T18:53:30.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.288+0000 7fc6c182e640 1 -- 172.21.15.53:0/2330264353 >> 172.21.15.53:0/2330264353 conn(0x7fc6bc0cafc0 msgr2=0x7fc6bc0cb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:30.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.288+0000 7fc6c182e640 1 -- 172.21.15.53:0/2330264353 shutdown_connections 2023-06-10T18:53:30.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.288+0000 7fc6c182e640 1 -- 172.21.15.53:0/2330264353 wait complete. 2023-06-10T18:53:30.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.292+0000 7fc6c182e640 1 Processor -- start 2023-06-10T18:53:30.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.292+0000 7fc6c182e640 1 -- start start 2023-06-10T18:53:30.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.292+0000 7fc6c182e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6a4003ec0 0x7fc6bc0c64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:30.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.292+0000 7fc6c182e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6bc151070 0x7fc6bc14cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:30.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.292+0000 7fc6c182e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6bc152610 0x7fc6bc156830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:30.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.292+0000 7fc6c182e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6bc0c8340 con 0x7fc6bc152610 2023-06-10T18:53:30.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.292+0000 7fc6c182e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6bc0c6a00 con 0x7fc6bc151070 2023-06-10T18:53:30.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.292+0000 7fc6c182e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6bc151570 con 0x7fc6a4003ec0 2023-06-10T18:53:30.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.292+0000 7fc6bb7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6bc152610 0x7fc6bc156830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:30.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.292+0000 7fc6bb7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6bc152610 0x7fc6bc156830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50506/0 (socket says 172.21.15.53:50506) 2023-06-10T18:53:30.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.292+0000 7fc6bb7fe640 1 -- 172.21.15.53:0/3633783761 learned_addr learned my addr 172.21.15.53:0/3633783761 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:30.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.292+0000 7fc6baffd640 1 --2- 172.21.15.53:0/3633783761 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6a4003ec0 0x7fc6bc0c64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:30.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.292+0000 7fc6ba7fc640 1 --2- 172.21.15.53:0/3633783761 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6bc151070 0x7fc6bc14cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:30.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.292+0000 7fc6bb7fe640 1 -- 172.21.15.53:0/3633783761 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6a4003ec0 msgr2=0x7fc6bc0c64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:30.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.292+0000 7fc6bb7fe640 1 --2- 172.21.15.53:0/3633783761 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6a4003ec0 0x7fc6bc0c64c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:30.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.292+0000 7fc6bb7fe640 1 -- 172.21.15.53:0/3633783761 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6bc151070 msgr2=0x7fc6bc14cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:30.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.292+0000 7fc6bb7fe640 1 --2- 172.21.15.53:0/3633783761 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6bc151070 0x7fc6bc14cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:30.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.292+0000 7fc6bb7fe640 1 -- 172.21.15.53:0/3633783761 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6bc151850 con 0x7fc6bc152610 2023-06-10T18:53:30.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.292+0000 7fc6ba7fc640 1 --2- 172.21.15.53:0/3633783761 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6bc151070 0x7fc6bc14cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:30.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.292+0000 7fc6bb7fe640 1 --2- 172.21.15.53:0/3633783761 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6bc152610 0x7fc6bc156830 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc06f870 tx=0x7fc6ac00fb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:30.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.292+0000 7fc6a3fff640 1 -- 172.21.15.53:0/3633783761 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6ac004440 con 0x7fc6bc152610 2023-06-10T18:53:30.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.292+0000 7fc6a3fff640 1 -- 172.21.15.53:0/3633783761 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6ac003620 con 0x7fc6bc152610 2023-06-10T18:53:30.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.292+0000 7fc6c182e640 1 -- 172.21.15.53:0/3633783761 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6bc151b30 con 0x7fc6bc152610 2023-06-10T18:53:30.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.292+0000 7fc6a3fff640 1 -- 172.21.15.53:0/3633783761 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6ac0039d0 con 0x7fc6bc152610 2023-06-10T18:53:30.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.292+0000 7fc6c182e640 1 -- 172.21.15.53:0/3633783761 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6bc1520f0 con 0x7fc6bc152610 2023-06-10T18:53:30.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.292+0000 7fc6c182e640 1 -- 172.21.15.53:0/3633783761 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6bc04d790 con 0x7fc6bc152610 2023-06-10T18:53:30.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.292+0000 7fc6a3fff640 1 -- 172.21.15.53:0/3633783761 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc6ac003b30 con 0x7fc6bc152610 2023-06-10T18:53:30.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.292+0000 7fc6a3fff640 1 --2- 172.21.15.53:0/3633783761 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc6a8066280 0x7fc6a8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:30.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.292+0000 7fc6a3fff640 1 -- 172.21.15.53:0/3633783761 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fc6ac082e10 con 0x7fc6bc152610 2023-06-10T18:53:30.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.292+0000 7fc6baffd640 1 --2- 172.21.15.53:0/3633783761 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc6a8066280 0x7fc6a8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:30.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.296+0000 7fc6baffd640 1 --2- 172.21.15.53:0/3633783761 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc6a8066280 0x7fc6a8068730 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc0c7ce0 tx=0x7fc6b400b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:30.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.296+0000 7fc6a3fff640 1 -- 172.21.15.53:0/3633783761 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc6ac050250 con 0x7fc6bc152610 2023-06-10T18:53:30.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.464+0000 7fc6c182e640 1 -- 172.21.15.53:0/3633783761 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc6bc06a850 con 0x7fc6bc152610 2023-06-10T18:53:30.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.464+0000 7fc6a3fff640 1 -- 172.21.15.53:0/3633783761 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc6ac01a080 con 0x7fc6bc152610 2023-06-10T18:53:30.473 INFO:teuthology.orchestra.run.smithi053.stderr:listed 0 entries 2023-06-10T18:53:30.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.464+0000 7fc6c182e640 1 -- 172.21.15.53:0/3633783761 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc6a8066280 msgr2=0x7fc6a8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:30.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.464+0000 7fc6c182e640 1 --2- 172.21.15.53:0/3633783761 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc6a8066280 0x7fc6a8068730 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc0c7ce0 tx=0x7fc6b400b040 comp rx=0 tx=0).stop 2023-06-10T18:53:30.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.464+0000 7fc6c182e640 1 -- 172.21.15.53:0/3633783761 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6bc152610 msgr2=0x7fc6bc156830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:30.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.464+0000 7fc6c182e640 1 --2- 172.21.15.53:0/3633783761 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6bc152610 0x7fc6bc156830 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc06f870 tx=0x7fc6ac00fb10 comp rx=0 tx=0).stop 2023-06-10T18:53:30.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.464+0000 7fc6c182e640 1 -- 172.21.15.53:0/3633783761 shutdown_connections 2023-06-10T18:53:30.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.464+0000 7fc6c182e640 1 --2- 172.21.15.53:0/3633783761 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc6a8066280 0x7fc6a8068730 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:30.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.464+0000 7fc6c182e640 1 --2- 172.21.15.53:0/3633783761 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6bc152610 0x7fc6bc156830 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:30.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.464+0000 7fc6c182e640 1 --2- 172.21.15.53:0/3633783761 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6bc151070 0x7fc6bc14cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:30.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.464+0000 7fc6c182e640 1 --2- 172.21.15.53:0/3633783761 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6a4003ec0 0x7fc6bc0c64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:30.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.464+0000 7fc6c182e640 1 -- 172.21.15.53:0/3633783761 >> 172.21.15.53:0/3633783761 conn(0x7fc6bc0cafc0 msgr2=0x7fc6bc0ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:30.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.464+0000 7fc6c182e640 1 -- 172.21.15.53:0/3633783761 shutdown_connections 2023-06-10T18:53:30.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.464+0000 7fc6c182e640 1 -- 172.21.15.53:0/3633783761 wait complete. 2023-06-10T18:53:30.492 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T18:53:30.492 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T18:53:30.499 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T18:53:30.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.616+0000 7fa12e8e3640 1 Processor -- start 2023-06-10T18:53:30.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.616+0000 7fa12e8e3640 1 -- start start 2023-06-10T18:53:30.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.620+0000 7fa12e8e3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1280c8d00 0x7fa12806b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:30.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.620+0000 7fa12e8e3640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa12806bc00 0x7fa128162180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:30.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.620+0000 7fa12e8e3640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa128158a90 con 0x7fa12806b2f0 2023-06-10T18:53:30.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.620+0000 7fa12e8e3640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa12806f780 con 0x7fa12806bc00 2023-06-10T18:53:30.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.620+0000 7fa12e8e3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1280705d0 con 0x7fa1280c8d00 2023-06-10T18:53:30.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.620+0000 7fa127fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fa12806b2f0 0x7fa12806f070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:37312/0 (socket says 172.21.15.53:37312) 2023-06-10T18:53:30.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.620+0000 7fa127fff640 1 -- 172.21.15.53:0/3677061750 learned_addr learned my addr 172.21.15.53:0/3677061750 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:53:30.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.620+0000 7fa12ce80640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa12806bc00 0x7fa128162180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:30.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.620+0000 7fa1277fe640 1 --2- 172.21.15.53:0/3677061750 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1280c8d00 0x7fa12806b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:30.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.620+0000 7fa126ffd640 1 -- 172.21.15.53:0/3677061750 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2065385546 0 0) 0x7fa118001120 con 0x7fa12806b2f0 2023-06-10T18:53:30.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.620+0000 7fa126ffd640 1 -- 172.21.15.53:0/3677061750 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa110005740 con 0x7fa12806b2f0 2023-06-10T18:53:30.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.620+0000 7fa12ce80640 1 -- 172.21.15.53:0/3677061750 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1280c8d00 msgr2=0x7fa12806b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:30.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.620+0000 7fa12ce80640 1 --2- 172.21.15.53:0/3677061750 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1280c8d00 0x7fa12806b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:30.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.620+0000 7fa12ce80640 1 -- 172.21.15.53:0/3677061750 >> v1:172.21.15.53:6789/0 conn(0x7fa12806b2f0 legacy=0x7fa12806f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:30.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.620+0000 7fa12ce80640 1 -- 172.21.15.53:0/3677061750 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1280cce10 con 0x7fa12806bc00 2023-06-10T18:53:30.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.620+0000 7fa12ce80640 1 --2- 172.21.15.53:0/3677061750 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa12806bc00 0x7fa128162180 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa120009dc0 tx=0x7fa12001f120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e03b7a3240bca098 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:30.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.620+0000 7fa126ffd640 1 -- 172.21.15.53:0/3677061750 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1200af600 con 0x7fa12806bc00 2023-06-10T18:53:30.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.620+0000 7fa126ffd640 1 -- 172.21.15.53:0/3677061750 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1200ab050 con 0x7fa12806bc00 2023-06-10T18:53:30.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.620+0000 7fa126ffd640 1 -- 172.21.15.53:0/3677061750 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1200af980 con 0x7fa12806bc00 2023-06-10T18:53:30.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.624+0000 7fa12e8e3640 1 -- 172.21.15.53:0/3677061750 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa12806bc00 msgr2=0x7fa128162180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:30.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.624+0000 7fa12e8e3640 1 --2- 172.21.15.53:0/3677061750 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa12806bc00 0x7fa128162180 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa120009dc0 tx=0x7fa12001f120 comp rx=0 tx=0).stop 2023-06-10T18:53:30.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.624+0000 7fa12e8e3640 1 -- 172.21.15.53:0/3677061750 shutdown_connections 2023-06-10T18:53:30.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.624+0000 7fa12e8e3640 1 --2- 172.21.15.53:0/3677061750 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa12806bc00 0x7fa128162180 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:30.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.624+0000 7fa12e8e3640 1 --2- 172.21.15.53:0/3677061750 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1280c8d00 0x7fa12806b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:30.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.624+0000 7fa12e8e3640 1 -- 172.21.15.53:0/3677061750 >> 172.21.15.53:0/3677061750 conn(0x7fa12806a0d0 msgr2=0x7fa1280ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:30.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.624+0000 7fa12e8e3640 1 -- 172.21.15.53:0/3677061750 shutdown_connections 2023-06-10T18:53:30.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.624+0000 7fa12e8e3640 1 -- 172.21.15.53:0/3677061750 wait complete. 2023-06-10T18:53:30.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.624+0000 7fa12e8e3640 1 Processor -- start 2023-06-10T18:53:30.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.624+0000 7fa12e8e3640 1 -- start start 2023-06-10T18:53:30.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.624+0000 7fa12e8e3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa12806b2f0 0x7fa1280c7c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:30.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.624+0000 7fa12e8e3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa12806bc00 0x7fa12806c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:30.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.624+0000 7fa12e8e3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1280c8d00 0x7fa12806c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:30.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.624+0000 7fa12e8e3640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa128155d20 con 0x7fa1280c8d00 2023-06-10T18:53:30.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.624+0000 7fa12e8e3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa128158db0 con 0x7fa12806bc00 2023-06-10T18:53:30.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.624+0000 7fa12e8e3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1280ad0b0 con 0x7fa12806b2f0 2023-06-10T18:53:30.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.624+0000 7fa12ce80640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1280c8d00 0x7fa12806c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:30.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.624+0000 7fa12ce80640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1280c8d00 0x7fa12806c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50528/0 (socket says 172.21.15.53:50528) 2023-06-10T18:53:30.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.624+0000 7fa12ce80640 1 -- 172.21.15.53:0/2256029211 learned_addr learned my addr 172.21.15.53:0/2256029211 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:30.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.624+0000 7fa127fff640 1 --2- 172.21.15.53:0/2256029211 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa12806b2f0 0x7fa1280c7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:30.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.624+0000 7fa1277fe640 1 --2- 172.21.15.53:0/2256029211 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa12806bc00 0x7fa12806c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:30.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.624+0000 7fa12ce80640 1 -- 172.21.15.53:0/2256029211 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa12806b2f0 msgr2=0x7fa1280c7c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:30.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.624+0000 7fa12ce80640 1 --2- 172.21.15.53:0/2256029211 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa12806b2f0 0x7fa1280c7c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:30.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.624+0000 7fa12ce80640 1 -- 172.21.15.53:0/2256029211 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa12806bc00 msgr2=0x7fa12806c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:30.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.624+0000 7fa12ce80640 1 --2- 172.21.15.53:0/2256029211 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa12806bc00 0x7fa12806c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:30.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.624+0000 7fa12ce80640 1 -- 172.21.15.53:0/2256029211 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa120009a70 con 0x7fa1280c8d00 2023-06-10T18:53:30.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.624+0000 7fa12ce80640 1 --2- 172.21.15.53:0/2256029211 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1280c8d00 0x7fa12806c5e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fa12001cd50 tx=0x7fa12001bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:30.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.624+0000 7fa124ff9640 1 -- 172.21.15.53:0/2256029211 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1200b9610 con 0x7fa1280c8d00 2023-06-10T18:53:30.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.624+0000 7fa124ff9640 1 -- 172.21.15.53:0/2256029211 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1200b9770 con 0x7fa1280c8d00 2023-06-10T18:53:30.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.624+0000 7fa12e8e3640 1 -- 172.21.15.53:0/2256029211 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa128159070 con 0x7fa1280c8d00 2023-06-10T18:53:30.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.624+0000 7fa124ff9640 1 -- 172.21.15.53:0/2256029211 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1200b9b20 con 0x7fa1280c8d00 2023-06-10T18:53:30.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.624+0000 7fa12e8e3640 1 -- 172.21.15.53:0/2256029211 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1280acd60 con 0x7fa1280c8d00 2023-06-10T18:53:30.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.628+0000 7fa12e8e3640 1 -- 172.21.15.53:0/2256029211 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa12804d790 con 0x7fa1280c8d00 2023-06-10T18:53:30.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.628+0000 7fa124ff9640 1 -- 172.21.15.53:0/2256029211 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa1200b6050 con 0x7fa1280c8d00 2023-06-10T18:53:30.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.628+0000 7fa124ff9640 1 --2- 172.21.15.53:0/2256029211 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa114066280 0x7fa114068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:30.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.628+0000 7fa124ff9640 1 -- 172.21.15.53:0/2256029211 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fa1201224c0 con 0x7fa1280c8d00 2023-06-10T18:53:30.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.628+0000 7fa127fff640 1 --2- 172.21.15.53:0/2256029211 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa114066280 0x7fa114068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:30.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.628+0000 7fa127fff640 1 --2- 172.21.15.53:0/2256029211 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa114066280 0x7fa114068730 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa118001280 tx=0x7fa118009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:30.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.632+0000 7fa124ff9640 1 -- 172.21.15.53:0/2256029211 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa1200f3540 con 0x7fa1280c8d00 2023-06-10T18:53:30.795 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.788+0000 7fa12e8e3640 1 -- 172.21.15.53:0/2256029211 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa128159520 con 0x7fa1280c8d00 2023-06-10T18:53:30.798 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.788+0000 7fa124ff9640 1 -- 172.21.15.53:0/2256029211 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18363 (secure 0 0 0) 0x7fa120009450 con 0x7fa1280c8d00 2023-06-10T18:53:30.798 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:53:30.798 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":25,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T18:53:27.127355+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-10T18:52:43.396243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-10T18:52:43.894228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.23","mappings":[{"from":3,"to":2}]},{"pgid":"4.3e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T18:53:30.800 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.792+0000 7fa12e8e3640 1 -- 172.21.15.53:0/2256029211 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa114066280 msgr2=0x7fa114068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:30.801 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.792+0000 7fa12e8e3640 1 --2- 172.21.15.53:0/2256029211 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa114066280 0x7fa114068730 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa118001280 tx=0x7fa118009040 comp rx=0 tx=0).stop 2023-06-10T18:53:30.801 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.792+0000 7fa12e8e3640 1 -- 172.21.15.53:0/2256029211 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1280c8d00 msgr2=0x7fa12806c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:30.801 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.792+0000 7fa12e8e3640 1 --2- 172.21.15.53:0/2256029211 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1280c8d00 0x7fa12806c5e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fa12001cd50 tx=0x7fa12001bec0 comp rx=0 tx=0).stop 2023-06-10T18:53:30.801 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.792+0000 7fa12e8e3640 1 -- 172.21.15.53:0/2256029211 shutdown_connections 2023-06-10T18:53:30.801 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.792+0000 7fa12e8e3640 1 --2- 172.21.15.53:0/2256029211 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa114066280 0x7fa114068730 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:30.802 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.792+0000 7fa12e8e3640 1 --2- 172.21.15.53:0/2256029211 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1280c8d00 0x7fa12806c5e0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:30.802 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.792+0000 7fa12e8e3640 1 --2- 172.21.15.53:0/2256029211 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa12806bc00 0x7fa12806c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:30.802 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.792+0000 7fa12e8e3640 1 --2- 172.21.15.53:0/2256029211 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa12806b2f0 0x7fa1280c7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:30.802 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.792+0000 7fa12e8e3640 1 -- 172.21.15.53:0/2256029211 >> 172.21.15.53:0/2256029211 conn(0x7fa12806a0d0 msgr2=0x7fa128070960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:30.802 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.792+0000 7fa12e8e3640 1 -- 172.21.15.53:0/2256029211 shutdown_connections 2023-06-10T18:53:30.802 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.792+0000 7fa12e8e3640 1 -- 172.21.15.53:0/2256029211 wait complete. 2023-06-10T18:53:30.817 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-10T18:52:33.633114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-10T18:52:39.171487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-10T18:52:43.396243+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-10T18:52:43.894228+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-10T18:53:30.818 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-10T18:53:30.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.940+0000 7fe1ec45a640 1 Processor -- start 2023-06-10T18:53:30.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.940+0000 7fe1ec45a640 1 -- start start 2023-06-10T18:53:30.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.940+0000 7fe1ec45a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe1e40c9fa0 0x7fe1e406bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:30.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.940+0000 7fe1ec45a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe1e40af760 0x7fe1e40afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:30.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.940+0000 7fe1ec45a640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1e406b090 con 0x7fe1e406c020 2023-06-10T18:53:30.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.940+0000 7fe1ec45a640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1e40b0120 con 0x7fe1e40c9fa0 2023-06-10T18:53:30.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.940+0000 7fe1ec45a640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1e40ca370 con 0x7fe1e40af760 2023-06-10T18:53:30.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.940+0000 7fe1ea1f6640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe1e40c9fa0 0x7fe1e406bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:30.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.940+0000 7fe1ea1f6640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe1e40c9fa0 0x7fe1e406bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50532/0 (socket says 172.21.15.53:50532) 2023-06-10T18:53:30.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.940+0000 7fe1ea1f6640 1 -- 172.21.15.53:0/3487747477 learned_addr learned my addr 172.21.15.53:0/3487747477 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:30.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.940+0000 7fe1ea9f7640 1 --2- 172.21.15.53:0/3487747477 >> v2:172.21.15.117:3300/0 conn(0x7fe1e40af760 0x7fe1e40afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:30.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.940+0000 7fe1ea1f6640 1 -- 172.21.15.53:0/3487747477 >> v2:172.21.15.117:3300/0 conn(0x7fe1e40af760 msgr2=0x7fe1e40afbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:30.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.940+0000 7fe1ea1f6640 1 --2- 172.21.15.53:0/3487747477 >> v2:172.21.15.117:3300/0 conn(0x7fe1e40af760 0x7fe1e40afbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:30.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.940+0000 7fe1ea1f6640 1 -- 172.21.15.53:0/3487747477 >> v1:172.21.15.117:6789/0 conn(0x7fe1e406c020 legacy=0x7fe1e40c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:30.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.940+0000 7fe1ea1f6640 1 -- 172.21.15.53:0/3487747477 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e4070d50 con 0x7fe1e40c9fa0 2023-06-10T18:53:30.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.940+0000 7fe1ea9f7640 1 --2- 172.21.15.53:0/3487747477 >> v2:172.21.15.117:3300/0 conn(0x7fe1e40af760 0x7fe1e40afbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:30.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.940+0000 7fe1ea1f6640 1 --2- 172.21.15.53:0/3487747477 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1e40c9fa0 0x7fe1e406bae0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fe1e406fc20 tx=0x7fe1e001c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6e4c9c091632fa6 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:30.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.940+0000 7fe1e91f4640 1 -- 172.21.15.53:0/3487747477 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e00a5790 con 0x7fe1e40c9fa0 2023-06-10T18:53:30.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.944+0000 7fe1e91f4640 1 -- 172.21.15.53:0/3487747477 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1e00a58f0 con 0x7fe1e40c9fa0 2023-06-10T18:53:30.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.944+0000 7fe1e91f4640 1 -- 172.21.15.53:0/3487747477 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e00a5c80 con 0x7fe1e40c9fa0 2023-06-10T18:53:30.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.944+0000 7fe1ec45a640 1 -- 172.21.15.53:0/3487747477 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1e40c9fa0 msgr2=0x7fe1e406bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:30.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.944+0000 7fe1ec45a640 1 --2- 172.21.15.53:0/3487747477 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1e40c9fa0 0x7fe1e406bae0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fe1e406fc20 tx=0x7fe1e001c8d0 comp rx=0 tx=0).stop 2023-06-10T18:53:30.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.944+0000 7fe1ec45a640 1 -- 172.21.15.53:0/3487747477 shutdown_connections 2023-06-10T18:53:30.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.944+0000 7fe1ec45a640 1 --2- 172.21.15.53:0/3487747477 >> v2:172.21.15.117:3300/0 conn(0x7fe1e40af760 0x7fe1e40afbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:30.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.944+0000 7fe1ec45a640 1 --2- 172.21.15.53:0/3487747477 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1e40c9fa0 0x7fe1e406bae0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:30.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.944+0000 7fe1ec45a640 1 -- 172.21.15.53:0/3487747477 >> 172.21.15.53:0/3487747477 conn(0x7fe1e406a0e0 msgr2=0x7fe1e40cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:30.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.944+0000 7fe1ec45a640 1 -- 172.21.15.53:0/3487747477 shutdown_connections 2023-06-10T18:53:30.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.944+0000 7fe1ec45a640 1 -- 172.21.15.53:0/3487747477 wait complete. 2023-06-10T18:53:30.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.944+0000 7fe1ec45a640 1 Processor -- start 2023-06-10T18:53:30.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.944+0000 7fe1ec45a640 1 -- start start 2023-06-10T18:53:30.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.944+0000 7fe1ec45a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1e406c020 0x7fe1e40be4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:30.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.944+0000 7fe1ec45a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1e40af760 0x7fe1e40a7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:30.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.944+0000 7fe1ec45a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1e40c9fa0 0x7fe1e40bba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:30.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.944+0000 7fe1ec45a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e40beab0 con 0x7fe1e40af760 2023-06-10T18:53:30.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.944+0000 7fe1ec45a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e40c44f0 con 0x7fe1e40c9fa0 2023-06-10T18:53:30.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.944+0000 7fe1ec45a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e4152130 con 0x7fe1e406c020 2023-06-10T18:53:30.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.944+0000 7fe1e99f5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1e40af760 0x7fe1e40a7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:30.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.944+0000 7fe1e99f5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1e40af760 0x7fe1e40a7450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50540/0 (socket says 172.21.15.53:50540) 2023-06-10T18:53:30.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.944+0000 7fe1e99f5640 1 -- 172.21.15.53:0/1727139463 learned_addr learned my addr 172.21.15.53:0/1727139463 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:30.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.944+0000 7fe1ea1f6640 1 --2- 172.21.15.53:0/1727139463 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1e406c020 0x7fe1e40be4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:30.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.944+0000 7fe1ea9f7640 1 --2- 172.21.15.53:0/1727139463 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1e40c9fa0 0x7fe1e40bba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:30.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.944+0000 7fe1e99f5640 1 -- 172.21.15.53:0/1727139463 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1e406c020 msgr2=0x7fe1e40be4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:30.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.944+0000 7fe1e99f5640 1 --2- 172.21.15.53:0/1727139463 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1e406c020 0x7fe1e40be4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:30.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.944+0000 7fe1e99f5640 1 -- 172.21.15.53:0/1727139463 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1e40c9fa0 msgr2=0x7fe1e40bba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:30.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.944+0000 7fe1e99f5640 1 --2- 172.21.15.53:0/1727139463 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1e40c9fa0 0x7fe1e40bba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:30.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.944+0000 7fe1e99f5640 1 -- 172.21.15.53:0/1727139463 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e0009b30 con 0x7fe1e40af760 2023-06-10T18:53:30.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.944+0000 7fe1ea9f7640 1 --2- 172.21.15.53:0/1727139463 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1e40c9fa0 0x7fe1e40bba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:30.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.944+0000 7fe1e99f5640 1 --2- 172.21.15.53:0/1727139463 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1e40af760 0x7fe1e40a7450 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe1d400c490 tx=0x7fe1d4001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:30.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.944+0000 7fe1daffd640 1 -- 172.21.15.53:0/1727139463 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d4003600 con 0x7fe1e40af760 2023-06-10T18:53:30.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.944+0000 7fe1daffd640 1 -- 172.21.15.53:0/1727139463 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1d4003780 con 0x7fe1e40af760 2023-06-10T18:53:30.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.944+0000 7fe1daffd640 1 -- 172.21.15.53:0/1727139463 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d4003b70 con 0x7fe1e40af760 2023-06-10T18:53:30.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.948+0000 7fe1ec45a640 1 -- 172.21.15.53:0/1727139463 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1e41535b0 con 0x7fe1e40af760 2023-06-10T18:53:30.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.948+0000 7fe1ec45a640 1 -- 172.21.15.53:0/1727139463 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1e40c49d0 con 0x7fe1e40af760 2023-06-10T18:53:30.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.948+0000 7fe1ec45a640 1 -- 172.21.15.53:0/1727139463 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1e41522c0 con 0x7fe1e40af760 2023-06-10T18:53:30.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.948+0000 7fe1daffd640 1 -- 172.21.15.53:0/1727139463 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe1d4003cd0 con 0x7fe1e40af760 2023-06-10T18:53:30.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.948+0000 7fe1daffd640 1 --2- 172.21.15.53:0/1727139463 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe1c80662b0 0x7fe1c8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:30.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.948+0000 7fe1daffd640 1 -- 172.21.15.53:0/1727139463 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fe1d4082f10 con 0x7fe1e40af760 2023-06-10T18:53:30.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.948+0000 7fe1ea1f6640 1 --2- 172.21.15.53:0/1727139463 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe1c80662b0 0x7fe1c8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:30.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.948+0000 7fe1ea1f6640 1 --2- 172.21.15.53:0/1727139463 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe1c80662b0 0x7fe1c8068760 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe1e00ae000 tx=0x7fe1e00a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:30.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:30.952+0000 7fe1daffd640 1 -- 172.21.15.53:0/1727139463 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe1d4050350 con 0x7fe1e40af760 2023-06-10T18:53:31.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.108+0000 7fe1ec45a640 1 -- 172.21.15.53:0/1727139463 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe1e404d790 con 0x7fe1e40af760 2023-06-10T18:53:31.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.108+0000 7fe1daffd640 1 -- 172.21.15.53:0/1727139463 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe1d40170a0 con 0x7fe1e40af760 2023-06-10T18:53:31.117 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-06-10T18:53:31.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.108+0000 7fe1ec45a640 1 -- 172.21.15.53:0/1727139463 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe1c80662b0 msgr2=0x7fe1c8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:31.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.108+0000 7fe1ec45a640 1 --2- 172.21.15.53:0/1727139463 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe1c80662b0 0x7fe1c8068760 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe1e00ae000 tx=0x7fe1e00a7070 comp rx=0 tx=0).stop 2023-06-10T18:53:31.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.108+0000 7fe1ec45a640 1 -- 172.21.15.53:0/1727139463 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1e40af760 msgr2=0x7fe1e40a7450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:31.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.108+0000 7fe1ec45a640 1 --2- 172.21.15.53:0/1727139463 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1e40af760 0x7fe1e40a7450 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe1d400c490 tx=0x7fe1d4001e80 comp rx=0 tx=0).stop 2023-06-10T18:53:31.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.108+0000 7fe1ec45a640 1 -- 172.21.15.53:0/1727139463 shutdown_connections 2023-06-10T18:53:31.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.108+0000 7fe1ec45a640 1 --2- 172.21.15.53:0/1727139463 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe1c80662b0 0x7fe1c8068760 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:31.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.108+0000 7fe1ec45a640 1 --2- 172.21.15.53:0/1727139463 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1e40c9fa0 0x7fe1e40bba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:31.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.108+0000 7fe1ec45a640 1 --2- 172.21.15.53:0/1727139463 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1e40af760 0x7fe1e40a7450 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:31.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.108+0000 7fe1ec45a640 1 --2- 172.21.15.53:0/1727139463 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1e406c020 0x7fe1e40be4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:31.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.108+0000 7fe1ec45a640 1 -- 172.21.15.53:0/1727139463 >> 172.21.15.53:0/1727139463 conn(0x7fe1e406a0e0 msgr2=0x7fe1e40b27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:31.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.108+0000 7fe1ec45a640 1 -- 172.21.15.53:0/1727139463 shutdown_connections 2023-06-10T18:53:31.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.108+0000 7fe1ec45a640 1 -- 172.21.15.53:0/1727139463 wait complete. 2023-06-10T18:53:31.136 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-10T18:53:31.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.260+0000 7f685df26640 1 Processor -- start 2023-06-10T18:53:31.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.260+0000 7f685df26640 1 -- start start 2023-06-10T18:53:31.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.260+0000 7f685df26640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f68580c97d0 0x7f68580cb820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:31.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.260+0000 7f685df26640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68580ac910 con 0x7f68580af760 2023-06-10T18:53:31.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.260+0000 7f685df26640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68580cbd60 con 0x7f685806c350 2023-06-10T18:53:31.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.260+0000 7f685df26640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68580ca5c0 con 0x7f68580c97d0 2023-06-10T18:53:31.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.260+0000 7f6857fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f68580af760 0x7f685806b090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:55824/0 (socket says 172.21.15.53:55824) 2023-06-10T18:53:31.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.260+0000 7f6857fff640 1 -- 172.21.15.53:0/621973151 learned_addr learned my addr 172.21.15.53:0/621973151 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:53:31.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.260+0000 7f68577fe640 1 --2- 172.21.15.53:0/621973151 >> v2:172.21.15.53:3300/0 conn(0x7f68580c97d0 0x7f68580cb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:31.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.260+0000 7f68567fc640 1 -- 172.21.15.53:0/621973151 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 165800679 0 0) 0x7f68580ac910 con 0x7f68580af760 2023-06-10T18:53:31.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.260+0000 7f68567fc640 1 -- 172.21.15.53:0/621973151 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6840003530 con 0x7f68580af760 2023-06-10T18:53:31.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.260+0000 7f68577fe640 1 -- 172.21.15.53:0/621973151 >> v1:172.21.15.117:6789/0 conn(0x7f685806c350 legacy=0x7f68580ac200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:31.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.260+0000 7f68577fe640 1 -- 172.21.15.53:0/621973151 >> v1:172.21.15.53:6789/0 conn(0x7f68580af760 legacy=0x7f685806b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:31.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.260+0000 7f68577fe640 1 -- 172.21.15.53:0/621973151 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68580abd70 con 0x7f68580c97d0 2023-06-10T18:53:31.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.264+0000 7f68577fe640 1 --2- 172.21.15.53:0/621973151 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68580c97d0 0x7f68580cb820 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f68480097c0 tx=0x7f684801c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5bc55e16865ff4a server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:31.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.264+0000 7f68567fc640 1 -- 172.21.15.53:0/621973151 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68480ab600 con 0x7f68580c97d0 2023-06-10T18:53:31.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.264+0000 7f68567fc640 1 -- 172.21.15.53:0/621973151 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68480a7050 con 0x7f68580c97d0 2023-06-10T18:53:31.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.264+0000 7f68567fc640 1 -- 172.21.15.53:0/621973151 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68480ab960 con 0x7f68580c97d0 2023-06-10T18:53:31.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.264+0000 7f685df26640 1 -- 172.21.15.53:0/621973151 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68580c97d0 msgr2=0x7f68580cb820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:31.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.264+0000 7f685df26640 1 --2- 172.21.15.53:0/621973151 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68580c97d0 0x7f68580cb820 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f68480097c0 tx=0x7f684801c360 comp rx=0 tx=0).stop 2023-06-10T18:53:31.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.264+0000 7f685df26640 1 -- 172.21.15.53:0/621973151 shutdown_connections 2023-06-10T18:53:31.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.264+0000 7f685df26640 1 --2- 172.21.15.53:0/621973151 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68580c97d0 0x7f68580cb820 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:31.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.264+0000 7f685df26640 1 -- 172.21.15.53:0/621973151 >> 172.21.15.53:0/621973151 conn(0x7f685806a0e0 msgr2=0x7f68580cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:31.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.264+0000 7f685df26640 1 -- 172.21.15.53:0/621973151 shutdown_connections 2023-06-10T18:53:31.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.264+0000 7f685df26640 1 -- 172.21.15.53:0/621973151 wait complete. 2023-06-10T18:53:31.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.264+0000 7f685df26640 1 Processor -- start 2023-06-10T18:53:31.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.264+0000 7f685df26640 1 -- start start 2023-06-10T18:53:31.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.264+0000 7f685df26640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f685806c350 0x7f68581f73c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:31.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.264+0000 7f685df26640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68580af760 0x7f68580b23c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:31.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.264+0000 7f685df26640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f68580c97d0 0x7f68580b2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:31.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.264+0000 7f685df26640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68580b2f80 con 0x7f68580af760 2023-06-10T18:53:31.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.264+0000 7f685df26640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68580b3260 con 0x7f685806c350 2023-06-10T18:53:31.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.264+0000 7f685df26640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68580b3540 con 0x7f68580c97d0 2023-06-10T18:53:31.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.264+0000 7f6856ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68580af760 0x7f68580b23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:31.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.264+0000 7f6856ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68580af760 0x7f68580b23c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36748/0 (socket says 172.21.15.53:36748) 2023-06-10T18:53:31.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.264+0000 7f6856ffd640 1 -- 172.21.15.53:0/3488336200 learned_addr learned my addr 172.21.15.53:0/3488336200 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:31.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.264+0000 7f6857fff640 1 --2- 172.21.15.53:0/3488336200 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f68580c97d0 0x7f68580b2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:31.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.264+0000 7f68577fe640 1 --2- 172.21.15.53:0/3488336200 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f685806c350 0x7f68581f73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:31.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.264+0000 7f6856ffd640 1 -- 172.21.15.53:0/3488336200 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f68580c97d0 msgr2=0x7f68580b2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:31.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.264+0000 7f6856ffd640 1 --2- 172.21.15.53:0/3488336200 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f68580c97d0 0x7f68580b2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:31.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.264+0000 7f6856ffd640 1 -- 172.21.15.53:0/3488336200 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f685806c350 msgr2=0x7f68581f73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:31.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.264+0000 7f6856ffd640 1 --2- 172.21.15.53:0/3488336200 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f685806c350 0x7f68581f73c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:31.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.264+0000 7f6856ffd640 1 -- 172.21.15.53:0/3488336200 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6848009420 con 0x7f68580af760 2023-06-10T18:53:31.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.264+0000 7f68577fe640 1 --2- 172.21.15.53:0/3488336200 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f685806c350 0x7f68581f73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:31.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.268+0000 7f6856ffd640 1 --2- 172.21.15.53:0/3488336200 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68580af760 0x7f68580b23c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f684c00c370 tx=0x7f684c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:31.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.268+0000 7f683ffff640 1 -- 172.21.15.53:0/3488336200 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f684c0052d0 con 0x7f68580af760 2023-06-10T18:53:31.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.268+0000 7f683ffff640 1 -- 172.21.15.53:0/3488336200 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f684c005430 con 0x7f68580af760 2023-06-10T18:53:31.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.268+0000 7f683ffff640 1 -- 172.21.15.53:0/3488336200 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f684c007260 con 0x7f68580af760 2023-06-10T18:53:31.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.268+0000 7f685df26640 1 -- 172.21.15.53:0/3488336200 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68580b3820 con 0x7f68580af760 2023-06-10T18:53:31.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.268+0000 7f685df26640 1 -- 172.21.15.53:0/3488336200 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f685806fd30 con 0x7f68580af760 2023-06-10T18:53:31.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.268+0000 7f685df26640 1 -- 172.21.15.53:0/3488336200 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f685804d790 con 0x7f68580af760 2023-06-10T18:53:31.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.268+0000 7f683ffff640 1 -- 172.21.15.53:0/3488336200 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f684c0073c0 con 0x7f68580af760 2023-06-10T18:53:31.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.268+0000 7f683ffff640 1 --2- 172.21.15.53:0/3488336200 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f68440662b0 0x7f6844068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:31.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.268+0000 7f683ffff640 1 -- 172.21.15.53:0/3488336200 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f684c082fe0 con 0x7f68580af760 2023-06-10T18:53:31.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.268+0000 7f68577fe640 1 --2- 172.21.15.53:0/3488336200 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f68440662b0 0x7f6844068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:31.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.268+0000 7f68577fe640 1 --2- 172.21.15.53:0/3488336200 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f68440662b0 0x7f6844068760 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f68480ad000 tx=0x7f6848008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:31.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.272+0000 7f683ffff640 1 -- 172.21.15.53:0/3488336200 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f684c050380 con 0x7f68580af760 2023-06-10T18:53:31.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.428+0000 7f685df26640 1 -- 172.21.15.53:0/3488336200 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f68580cbd60 con 0x7f68580af760 2023-06-10T18:53:31.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.428+0000 7f683ffff640 1 -- 172.21.15.53:0/3488336200 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f68580cbd60 con 0x7f68580af760 2023-06-10T18:53:31.436 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-06-10T18:53:31.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.428+0000 7f685df26640 1 -- 172.21.15.53:0/3488336200 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f68440662b0 msgr2=0x7f6844068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:31.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.428+0000 7f685df26640 1 --2- 172.21.15.53:0/3488336200 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f68440662b0 0x7f6844068760 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f68480ad000 tx=0x7f6848008040 comp rx=0 tx=0).stop 2023-06-10T18:53:31.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.428+0000 7f685df26640 1 -- 172.21.15.53:0/3488336200 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68580af760 msgr2=0x7f68580b23c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:31.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.428+0000 7f685df26640 1 --2- 172.21.15.53:0/3488336200 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68580af760 0x7f68580b23c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f684c00c370 tx=0x7f684c00c830 comp rx=0 tx=0).stop 2023-06-10T18:53:31.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.428+0000 7f685df26640 1 -- 172.21.15.53:0/3488336200 shutdown_connections 2023-06-10T18:53:31.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.428+0000 7f685df26640 1 --2- 172.21.15.53:0/3488336200 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f68440662b0 0x7f6844068760 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:31.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.428+0000 7f685df26640 1 --2- 172.21.15.53:0/3488336200 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f68580c97d0 0x7f68580b2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:31.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.428+0000 7f685df26640 1 --2- 172.21.15.53:0/3488336200 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68580af760 0x7f68580b23c0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:31.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.428+0000 7f685df26640 1 --2- 172.21.15.53:0/3488336200 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f685806c350 0x7f68581f73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:31.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.428+0000 7f685df26640 1 -- 172.21.15.53:0/3488336200 >> 172.21.15.53:0/3488336200 conn(0x7f685806a0e0 msgr2=0x7f6858070610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:31.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.428+0000 7f685df26640 1 -- 172.21.15.53:0/3488336200 shutdown_connections 2023-06-10T18:53:31.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.428+0000 7f685df26640 1 -- 172.21.15.53:0/3488336200 wait complete. 2023-06-10T18:53:31.456 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-10T18:53:31.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.580+0000 7f85c6f12640 1 Processor -- start 2023-06-10T18:53:31.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.580+0000 7f85c6f12640 1 -- start start 2023-06-10T18:53:31.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.580+0000 7f85c6f12640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f85c00af760 0x7f85c00afb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:31.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.580+0000 7f85c6f12640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85c00b0070 con 0x7f85c00700e0 2023-06-10T18:53:31.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.580+0000 7f85c6f12640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85c0070910 con 0x7f85c015dae0 2023-06-10T18:53:31.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.580+0000 7f85c6f12640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85c0070bf0 con 0x7f85c00af760 2023-06-10T18:53:31.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.580+0000 7f85bffff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f85c00700e0 0x7f85c00c82a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:55828/0 (socket says 172.21.15.53:55828) 2023-06-10T18:53:31.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.580+0000 7f85bffff640 1 -- 172.21.15.53:0/2648543209 learned_addr learned my addr 172.21.15.53:0/2648543209 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:53:31.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.580+0000 7f85c4cae640 1 --2- 172.21.15.53:0/2648543209 >> v2:172.21.15.117:3300/0 conn(0x7f85c00af760 0x7f85c00afb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:31.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.580+0000 7f85bf7fe640 1 -- 172.21.15.53:0/2648543209 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4095680919 0 0) 0x7f85c00b0070 con 0x7f85c00700e0 2023-06-10T18:53:31.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.580+0000 7f85bf7fe640 1 -- 172.21.15.53:0/2648543209 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85a8007940 con 0x7f85c00700e0 2023-06-10T18:53:31.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.580+0000 7f85bf7fe640 1 -- 172.21.15.53:0/2648543209 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1094983473 0 0) 0x7f85a8007940 con 0x7f85c00700e0 2023-06-10T18:53:31.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.580+0000 7f85bf7fe640 1 -- 172.21.15.53:0/2648543209 >> v2:172.21.15.117:3300/0 conn(0x7f85c00af760 msgr2=0x7f85c00afb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:31.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.580+0000 7f85bf7fe640 1 --2- 172.21.15.53:0/2648543209 >> v2:172.21.15.117:3300/0 conn(0x7f85c00af760 0x7f85c00afb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:31.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.580+0000 7f85bf7fe640 1 -- 172.21.15.53:0/2648543209 >> v1:172.21.15.117:6789/0 conn(0x7f85c015dae0 legacy=0x7f85c006b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:31.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.580+0000 7f85bf7fe640 1 -- 172.21.15.53:0/2648543209 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c0070ed0 con 0x7f85c00700e0 2023-06-10T18:53:31.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.580+0000 7f85bf7fe640 1 -- 172.21.15.53:0/2648543209 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f85b4001680 con 0x7f85c00700e0 2023-06-10T18:53:31.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.580+0000 7f85bf7fe640 1 -- 172.21.15.53:0/2648543209 >> v1:172.21.15.53:6789/0 conn(0x7f85c00700e0 legacy=0x7f85c00c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:31.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.580+0000 7f85bf7fe640 1 --2- 172.21.15.53:0/2648543209 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85a8007d90 0x7f85a80081a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:31.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.580+0000 7f85bf7fe640 1 --2- 172.21.15.53:0/2648543209 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85a8008be0 0x7f85a8009050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:31.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.580+0000 7f85bf7fe640 1 --2- 172.21.15.53:0/2648543209 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85a8009590 0x7f85a800fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:31.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.580+0000 7f85bf7fe640 1 -- 172.21.15.53:0/2648543209 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c0070bf0 con 0x7f85a8007d90 2023-06-10T18:53:31.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.580+0000 7f85bf7fe640 1 -- 172.21.15.53:0/2648543209 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85a8010410 con 0x7f85a8009590 2023-06-10T18:53:31.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.580+0000 7f85bf7fe640 1 -- 172.21.15.53:0/2648543209 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85a80105d0 con 0x7f85a8008be0 2023-06-10T18:53:31.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.580+0000 7f85c4cae640 1 --2- 172.21.15.53:0/2648543209 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85a8007d90 0x7f85a80081a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:31.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.580+0000 7f85bffff640 1 --2- 172.21.15.53:0/2648543209 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85a8008be0 0x7f85a8009050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:31.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.580+0000 7f85c54af640 1 --2- 172.21.15.53:0/2648543209 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85a8009590 0x7f85a800fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:31.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.580+0000 7f85c4cae640 1 -- 172.21.15.53:0/2648543209 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85a8008be0 msgr2=0x7f85a8009050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:31.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.580+0000 7f85c4cae640 1 --2- 172.21.15.53:0/2648543209 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85a8008be0 0x7f85a8009050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:31.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.580+0000 7f85c4cae640 1 -- 172.21.15.53:0/2648543209 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85a8009590 msgr2=0x7f85a800fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:31.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.580+0000 7f85c4cae640 1 --2- 172.21.15.53:0/2648543209 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85a8009590 0x7f85a800fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:31.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.580+0000 7f85c4cae640 1 -- 172.21.15.53:0/2648543209 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85a8007940 con 0x7f85a8007d90 2023-06-10T18:53:31.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.580+0000 7f85c54af640 1 --2- 172.21.15.53:0/2648543209 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85a8009590 0x7f85a800fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:31.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.580+0000 7f85c54af640 1 -- 172.21.15.53:0/2648543209 reap_dead start 2023-06-10T18:53:31.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.584+0000 7f85c4cae640 1 --2- 172.21.15.53:0/2648543209 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85a8007d90 0x7f85a80081a0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f85b0009fc0 tx=0x7f85b001cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69ad73c14e60ed6e server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:31.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.584+0000 7f85bf7fe640 1 -- 172.21.15.53:0/2648543209 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b00a5a50 con 0x7f85a8007d90 2023-06-10T18:53:31.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.584+0000 7f85bf7fe640 1 -- 172.21.15.53:0/2648543209 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85b000f040 con 0x7f85a8007d90 2023-06-10T18:53:31.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.584+0000 7f85bf7fe640 1 -- 172.21.15.53:0/2648543209 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b00a5df0 con 0x7f85a8007d90 2023-06-10T18:53:31.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.584+0000 7f85c6f12640 1 -- 172.21.15.53:0/2648543209 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85a8007d90 msgr2=0x7f85a80081a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:31.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.584+0000 7f85c6f12640 1 --2- 172.21.15.53:0/2648543209 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85a8007d90 0x7f85a80081a0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f85b0009fc0 tx=0x7f85b001cc30 comp rx=0 tx=0).stop 2023-06-10T18:53:31.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.584+0000 7f85c6f12640 1 -- 172.21.15.53:0/2648543209 shutdown_connections 2023-06-10T18:53:31.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.584+0000 7f85c6f12640 1 --2- 172.21.15.53:0/2648543209 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85a8007d90 0x7f85a80081a0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:31.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.584+0000 7f85c6f12640 1 -- 172.21.15.53:0/2648543209 >> 172.21.15.53:0/2648543209 conn(0x7f85c006a0e0 msgr2=0x7f85c00cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:31.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.584+0000 7f85c6f12640 1 -- 172.21.15.53:0/2648543209 shutdown_connections 2023-06-10T18:53:31.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.584+0000 7f85c6f12640 1 -- 172.21.15.53:0/2648543209 wait complete. 2023-06-10T18:53:31.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.584+0000 7f85c6f12640 1 Processor -- start 2023-06-10T18:53:31.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.584+0000 7f85c6f12640 1 -- start start 2023-06-10T18:53:31.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.588+0000 7f85c6f12640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85a8007d90 0x7f85c01561c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:31.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.588+0000 7f85c6f12640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85c01e3000 0x7f85c01f36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:31.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.588+0000 7f85c6f12640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85c01e3470 0x7f85c01f3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:31.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.588+0000 7f85c6f12640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c01f4590 con 0x7f85c01e3000 2023-06-10T18:53:31.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.588+0000 7f85c6f12640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c015a140 con 0x7f85c01e3470 2023-06-10T18:53:31.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.588+0000 7f85c6f12640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85c015a420 con 0x7f85a8007d90 2023-06-10T18:53:31.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.588+0000 7f85bffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85c01e3000 0x7f85c01f36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:31.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.588+0000 7f85bffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85c01e3000 0x7f85c01f36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36754/0 (socket says 172.21.15.53:36754) 2023-06-10T18:53:31.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.588+0000 7f85bffff640 1 -- 172.21.15.53:0/1110455771 learned_addr learned my addr 172.21.15.53:0/1110455771 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:31.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.588+0000 7f85c54af640 1 --2- 172.21.15.53:0/1110455771 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85c01e3470 0x7f85c01f3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:31.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.588+0000 7f85c4cae640 1 --2- 172.21.15.53:0/1110455771 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85a8007d90 0x7f85c01561c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:31.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.588+0000 7f85bffff640 1 -- 172.21.15.53:0/1110455771 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85a8007d90 msgr2=0x7f85c01561c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:31.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.588+0000 7f85bffff640 1 --2- 172.21.15.53:0/1110455771 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85a8007d90 0x7f85c01561c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:31.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.588+0000 7f85bffff640 1 -- 172.21.15.53:0/1110455771 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85c01e3470 msgr2=0x7f85c01f3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:31.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.588+0000 7f85bffff640 1 --2- 172.21.15.53:0/1110455771 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85c01e3470 0x7f85c01f3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:31.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.588+0000 7f85bffff640 1 -- 172.21.15.53:0/1110455771 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c015a700 con 0x7f85c01e3000 2023-06-10T18:53:31.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.588+0000 7f85bffff640 1 --2- 172.21.15.53:0/1110455771 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85c01e3000 0x7f85c01f36f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f85b400d8b0 tx=0x7f85b400dd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:31.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.588+0000 7f85bd7fa640 1 -- 172.21.15.53:0/1110455771 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b40074e0 con 0x7f85c01e3000 2023-06-10T18:53:31.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.588+0000 7f85bd7fa640 1 -- 172.21.15.53:0/1110455771 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85b4007640 con 0x7f85c01e3000 2023-06-10T18:53:31.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.588+0000 7f85c6f12640 1 -- 172.21.15.53:0/1110455771 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85c015a9e0 con 0x7f85c01e3000 2023-06-10T18:53:31.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.588+0000 7f85bd7fa640 1 -- 172.21.15.53:0/1110455771 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b40049f0 con 0x7f85c01e3000 2023-06-10T18:53:31.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.588+0000 7f85c6f12640 1 -- 172.21.15.53:0/1110455771 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85c0156700 con 0x7f85c01e3000 2023-06-10T18:53:31.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.588+0000 7f85c6f12640 1 -- 172.21.15.53:0/1110455771 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85c004d790 con 0x7f85c01e3000 2023-06-10T18:53:31.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.588+0000 7f85bd7fa640 1 -- 172.21.15.53:0/1110455771 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f85b4004b50 con 0x7f85c01e3000 2023-06-10T18:53:31.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.588+0000 7f85bd7fa640 1 --2- 172.21.15.53:0/1110455771 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f85ac0662b0 0x7f85ac068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:31.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.588+0000 7f85bd7fa640 1 -- 172.21.15.53:0/1110455771 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f85b4083b30 con 0x7f85c01e3000 2023-06-10T18:53:31.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.588+0000 7f85c4cae640 1 --2- 172.21.15.53:0/1110455771 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f85ac0662b0 0x7f85ac068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:31.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.592+0000 7f85c4cae640 1 --2- 172.21.15.53:0/1110455771 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f85ac0662b0 0x7f85ac068760 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f85b00af000 tx=0x7f85b0004ac0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:31.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.592+0000 7f85bd7fa640 1 -- 172.21.15.53:0/1110455771 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f85b4050f70 con 0x7f85c01e3000 2023-06-10T18:53:31.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.744+0000 7f85c6f12640 1 -- 172.21.15.53:0/1110455771 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f85c015ae90 con 0x7f85c01e3000 2023-06-10T18:53:31.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.748+0000 7f85bd7fa640 1 -- 172.21.15.53:0/1110455771 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f85b4019020 con 0x7f85c01e3000 2023-06-10T18:53:31.756 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-06-10T18:53:31.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.748+0000 7f85c6f12640 1 -- 172.21.15.53:0/1110455771 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f85ac0662b0 msgr2=0x7f85ac068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:31.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.748+0000 7f85c6f12640 1 --2- 172.21.15.53:0/1110455771 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f85ac0662b0 0x7f85ac068760 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f85b00af000 tx=0x7f85b0004ac0 comp rx=0 tx=0).stop 2023-06-10T18:53:31.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.748+0000 7f85c6f12640 1 -- 172.21.15.53:0/1110455771 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85c01e3000 msgr2=0x7f85c01f36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:31.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.748+0000 7f85c6f12640 1 --2- 172.21.15.53:0/1110455771 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85c01e3000 0x7f85c01f36f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f85b400d8b0 tx=0x7f85b400dd70 comp rx=0 tx=0).stop 2023-06-10T18:53:31.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.748+0000 7f85c6f12640 1 -- 172.21.15.53:0/1110455771 shutdown_connections 2023-06-10T18:53:31.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.748+0000 7f85c6f12640 1 --2- 172.21.15.53:0/1110455771 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f85ac0662b0 0x7f85ac068760 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:31.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.748+0000 7f85c6f12640 1 --2- 172.21.15.53:0/1110455771 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85c01e3470 0x7f85c01f3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:31.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.748+0000 7f85c6f12640 1 --2- 172.21.15.53:0/1110455771 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85c01e3000 0x7f85c01f36f0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:31.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.748+0000 7f85c6f12640 1 --2- 172.21.15.53:0/1110455771 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85a8007d90 0x7f85c01561c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:31.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.748+0000 7f85c6f12640 1 -- 172.21.15.53:0/1110455771 >> 172.21.15.53:0/1110455771 conn(0x7f85c006a0e0 msgr2=0x7f85c00b0df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:31.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.748+0000 7f85c6f12640 1 -- 172.21.15.53:0/1110455771 shutdown_connections 2023-06-10T18:53:31.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.748+0000 7f85c6f12640 1 -- 172.21.15.53:0/1110455771 wait complete. 2023-06-10T18:53:31.775 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-10T18:53:31.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.896+0000 7f28faf24640 1 Processor -- start 2023-06-10T18:53:31.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.900+0000 7f28faf24640 1 -- start start 2023-06-10T18:53:31.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.900+0000 7f28faf24640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28f415c090 0x7f28f40b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:31.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.900+0000 7f28faf24640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f28f40b7e30 0x7f28f40d04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:31.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.900+0000 7f28faf24640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28f40cc7c0 con 0x7f28f40b0b90 2023-06-10T18:53:31.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.900+0000 7f28faf24640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28f40ccaa0 con 0x7f28f40b7e30 2023-06-10T18:53:31.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.900+0000 7f28faf24640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28f40ccd80 con 0x7f28f415c090 2023-06-10T18:53:31.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.900+0000 7f28f94c1640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f28f40b7e30 0x7f28f40d04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:31.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.900+0000 7f28f3fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f28f40b0b90 0x7f28f40b7720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:55844/0 (socket says 172.21.15.53:55844) 2023-06-10T18:53:31.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.900+0000 7f28f3fff640 1 -- 172.21.15.53:0/2986403055 learned_addr learned my addr 172.21.15.53:0/2986403055 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:53:31.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.900+0000 7f28f8cc0640 1 --2- 172.21.15.53:0/2986403055 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28f415c090 0x7f28f40b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:31.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.900+0000 7f28f94c1640 1 -- 172.21.15.53:0/2986403055 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28f415c090 msgr2=0x7f28f40b10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:31.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.900+0000 7f28f94c1640 1 --2- 172.21.15.53:0/2986403055 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28f415c090 0x7f28f40b10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:31.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.900+0000 7f28f94c1640 1 -- 172.21.15.53:0/2986403055 >> v1:172.21.15.53:6789/0 conn(0x7f28f40b0b90 legacy=0x7f28f40b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:31.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.900+0000 7f28f94c1640 1 -- 172.21.15.53:0/2986403055 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28f40cd060 con 0x7f28f40b7e30 2023-06-10T18:53:31.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.900+0000 7f28f37fe640 1 -- 172.21.15.53:0/2986403055 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3626369203 0 0) 0x7f28f40cc7c0 con 0x7f28f40b0b90 2023-06-10T18:53:31.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.904+0000 7f28f94c1640 1 --2- 172.21.15.53:0/2986403055 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28f40b7e30 0x7f28f40d04d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f28ec009d90 tx=0x7f28ec01c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c724a11b4f30b39 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:31.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.904+0000 7f28f37fe640 1 -- 172.21.15.53:0/2986403055 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28ec0a58b0 con 0x7f28f40b7e30 2023-06-10T18:53:31.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.904+0000 7f28f37fe640 1 -- 172.21.15.53:0/2986403055 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28ec0a5a10 con 0x7f28f40b7e30 2023-06-10T18:53:31.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.904+0000 7f28f37fe640 1 -- 172.21.15.53:0/2986403055 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28ec0a5da0 con 0x7f28f40b7e30 2023-06-10T18:53:31.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.904+0000 7f28faf24640 1 -- 172.21.15.53:0/2986403055 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28f40b7e30 msgr2=0x7f28f40d04d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:31.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.904+0000 7f28faf24640 1 --2- 172.21.15.53:0/2986403055 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28f40b7e30 0x7f28f40d04d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f28ec009d90 tx=0x7f28ec01c890 comp rx=0 tx=0).stop 2023-06-10T18:53:31.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.904+0000 7f28faf24640 1 -- 172.21.15.53:0/2986403055 shutdown_connections 2023-06-10T18:53:31.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.904+0000 7f28faf24640 1 --2- 172.21.15.53:0/2986403055 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28f40b7e30 0x7f28f40d04d0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:31.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.904+0000 7f28faf24640 1 --2- 172.21.15.53:0/2986403055 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28f415c090 0x7f28f40b10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:31.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.904+0000 7f28faf24640 1 -- 172.21.15.53:0/2986403055 >> 172.21.15.53:0/2986403055 conn(0x7f28f4069e20 msgr2=0x7f28f406a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:31.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.904+0000 7f28faf24640 1 -- 172.21.15.53:0/2986403055 shutdown_connections 2023-06-10T18:53:31.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.904+0000 7f28faf24640 1 -- 172.21.15.53:0/2986403055 wait complete. 2023-06-10T18:53:31.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.904+0000 7f28faf24640 1 Processor -- start 2023-06-10T18:53:31.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.904+0000 7f28faf24640 1 -- start start 2023-06-10T18:53:31.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.904+0000 7f28faf24640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28f40b0b90 0x7f28f415efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:31.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.904+0000 7f28faf24640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28f40b7e30 0x7f28f40c3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:31.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.904+0000 7f28faf24640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28f415c090 0x7f28f40c4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:31.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.904+0000 7f28faf24640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28f40c5480 con 0x7f28f40b0b90 2023-06-10T18:53:31.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.904+0000 7f28faf24640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28f40c3940 con 0x7f28f415c090 2023-06-10T18:53:31.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.904+0000 7f28faf24640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28f40c3c20 con 0x7f28f40b7e30 2023-06-10T18:53:31.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.904+0000 7f28f8cc0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28f40b0b90 0x7f28f415efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:31.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.904+0000 7f28f8cc0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28f40b0b90 0x7f28f415efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36768/0 (socket says 172.21.15.53:36768) 2023-06-10T18:53:31.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.904+0000 7f28f8cc0640 1 -- 172.21.15.53:0/4034208374 learned_addr learned my addr 172.21.15.53:0/4034208374 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:31.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.904+0000 7f28f3fff640 1 --2- 172.21.15.53:0/4034208374 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28f40b7e30 0x7f28f40c3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:31.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.904+0000 7f28f94c1640 1 --2- 172.21.15.53:0/4034208374 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28f415c090 0x7f28f40c4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:31.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.904+0000 7f28f8cc0640 1 -- 172.21.15.53:0/4034208374 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28f40b7e30 msgr2=0x7f28f40c3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:31.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.904+0000 7f28f8cc0640 1 --2- 172.21.15.53:0/4034208374 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28f40b7e30 0x7f28f40c3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:31.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.904+0000 7f28f8cc0640 1 -- 172.21.15.53:0/4034208374 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28f415c090 msgr2=0x7f28f40c4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:31.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.904+0000 7f28f8cc0640 1 --2- 172.21.15.53:0/4034208374 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28f415c090 0x7f28f40c4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:31.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.904+0000 7f28f8cc0640 1 -- 172.21.15.53:0/4034208374 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28ec009a70 con 0x7f28f40b0b90 2023-06-10T18:53:31.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.904+0000 7f28f94c1640 1 --2- 172.21.15.53:0/4034208374 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28f415c090 0x7f28f40c4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:53:31.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.904+0000 7f28f8cc0640 1 --2- 172.21.15.53:0/4034208374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28f40b0b90 0x7f28f415efa0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f28e400d5f0 tx=0x7f28e400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:31.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.908+0000 7f28f17fa640 1 -- 172.21.15.53:0/4034208374 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e40125f0 con 0x7f28f40b0b90 2023-06-10T18:53:31.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.908+0000 7f28f17fa640 1 -- 172.21.15.53:0/4034208374 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28e4012750 con 0x7f28f40b0b90 2023-06-10T18:53:31.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.908+0000 7f28f17fa640 1 -- 172.21.15.53:0/4034208374 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e4012ae0 con 0x7f28f40b0b90 2023-06-10T18:53:31.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.908+0000 7f28faf24640 1 -- 172.21.15.53:0/4034208374 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28f40c3f00 con 0x7f28f40b0b90 2023-06-10T18:53:31.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.908+0000 7f28faf24640 1 -- 172.21.15.53:0/4034208374 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28f40c44c0 con 0x7f28f40b0b90 2023-06-10T18:53:31.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.908+0000 7f28faf24640 1 -- 172.21.15.53:0/4034208374 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28f404d790 con 0x7f28f40b0b90 2023-06-10T18:53:31.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.908+0000 7f28f17fa640 1 -- 172.21.15.53:0/4034208374 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f28e4012c40 con 0x7f28f40b0b90 2023-06-10T18:53:31.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.908+0000 7f28f17fa640 1 --2- 172.21.15.53:0/4034208374 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f28e0066280 0x7f28e0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:31.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.908+0000 7f28f17fa640 1 -- 172.21.15.53:0/4034208374 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f28e4084190 con 0x7f28f40b0b90 2023-06-10T18:53:31.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.908+0000 7f28f3fff640 1 --2- 172.21.15.53:0/4034208374 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f28e0066280 0x7f28e0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:31.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.908+0000 7f28f3fff640 1 --2- 172.21.15.53:0/4034208374 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f28e0066280 0x7f28e0068730 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f28f41561d0 tx=0x7f28e8007d60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:31.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:31.912+0000 7f28f17fa640 1 -- 172.21.15.53:0/4034208374 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f28e40515d0 con 0x7f28f40b0b90 2023-06-10T18:53:32.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.064+0000 7f28faf24640 1 -- 172.21.15.53:0/4034208374 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f28f40b72f0 con 0x7f28f40b0b90 2023-06-10T18:53:32.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.064+0000 7f28f17fa640 1 -- 172.21.15.53:0/4034208374 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f28e4007380 con 0x7f28f40b0b90 2023-06-10T18:53:32.076 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-06-10T18:53:32.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.068+0000 7f28faf24640 1 -- 172.21.15.53:0/4034208374 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f28e0066280 msgr2=0x7f28e0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:32.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.068+0000 7f28faf24640 1 --2- 172.21.15.53:0/4034208374 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f28e0066280 0x7f28e0068730 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f28f41561d0 tx=0x7f28e8007d60 comp rx=0 tx=0).stop 2023-06-10T18:53:32.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.068+0000 7f28faf24640 1 -- 172.21.15.53:0/4034208374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28f40b0b90 msgr2=0x7f28f415efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:32.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.068+0000 7f28faf24640 1 --2- 172.21.15.53:0/4034208374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28f40b0b90 0x7f28f415efa0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f28e400d5f0 tx=0x7f28e400dab0 comp rx=0 tx=0).stop 2023-06-10T18:53:32.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.068+0000 7f28faf24640 1 -- 172.21.15.53:0/4034208374 shutdown_connections 2023-06-10T18:53:32.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.068+0000 7f28faf24640 1 --2- 172.21.15.53:0/4034208374 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f28e0066280 0x7f28e0068730 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:32.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.068+0000 7f28faf24640 1 --2- 172.21.15.53:0/4034208374 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28f415c090 0x7f28f40c4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:32.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.068+0000 7f28faf24640 1 --2- 172.21.15.53:0/4034208374 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28f40b7e30 0x7f28f40c3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:32.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.068+0000 7f28faf24640 1 --2- 172.21.15.53:0/4034208374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28f40b0b90 0x7f28f415efa0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:32.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.068+0000 7f28faf24640 1 -- 172.21.15.53:0/4034208374 >> 172.21.15.53:0/4034208374 conn(0x7f28f4069e20 msgr2=0x7f28f40ce8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:32.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.068+0000 7f28faf24640 1 -- 172.21.15.53:0/4034208374 shutdown_connections 2023-06-10T18:53:32.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.068+0000 7f28faf24640 1 -- 172.21.15.53:0/4034208374 wait complete. 2023-06-10T18:53:32.095 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-10T18:53:32.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.208+0000 7fb00c938640 1 Processor -- start 2023-06-10T18:53:32.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.208+0000 7fb00c938640 1 -- start start 2023-06-10T18:53:32.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.208+0000 7fb00c938640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb0080d1150 0x7fb008163780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:32.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.208+0000 7fb00c938640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb0080b3ac0 0x7fb0080d1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:32.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.208+0000 7fb00c938640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb008164600 con 0x7fb0080cfc10 2023-06-10T18:53:32.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.208+0000 7fb00c938640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0080cda90 con 0x7fb0080b3ac0 2023-06-10T18:53:32.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.208+0000 7fb00c938640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0080d1a60 con 0x7fb0080d1150 2023-06-10T18:53:32.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.208+0000 7fb005d9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb0080b3ac0 0x7fb0080d1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:32.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.208+0000 7fb005d9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb0080b3ac0 0x7fb0080d1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36774/0 (socket says 172.21.15.53:36774) 2023-06-10T18:53:32.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.208+0000 7fb005d9b640 1 -- 172.21.15.53:0/1562478411 learned_addr learned my addr 172.21.15.53:0/1562478411 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:32.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.208+0000 7fb00659c640 1 --2- 172.21.15.53:0/1562478411 >> v2:172.21.15.117:3300/0 conn(0x7fb0080d1150 0x7fb008163780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:32.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.208+0000 7fb005d9b640 1 -- 172.21.15.53:0/1562478411 >> v2:172.21.15.117:3300/0 conn(0x7fb0080d1150 msgr2=0x7fb008163780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:32.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.208+0000 7fb005d9b640 1 --2- 172.21.15.53:0/1562478411 >> v2:172.21.15.117:3300/0 conn(0x7fb0080d1150 0x7fb008163780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:32.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.208+0000 7fb005d9b640 1 -- 172.21.15.53:0/1562478411 >> v1:172.21.15.117:6789/0 conn(0x7fb0080cfc10 legacy=0x7fb0080d0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:32.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.208+0000 7fb005d9b640 1 -- 172.21.15.53:0/1562478411 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb008163d60 con 0x7fb0080b3ac0 2023-06-10T18:53:32.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.212+0000 7fb005d9b640 1 --2- 172.21.15.53:0/1562478411 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0080b3ac0 0x7fb0080d1520 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fb0080b4bd0 tx=0x7faff001c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a725a8b2963eb9b server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:32.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.212+0000 7fb00559a640 1 -- 172.21.15.53:0/1562478411 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff00a5820 con 0x7fb0080b3ac0 2023-06-10T18:53:32.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.212+0000 7fb00559a640 1 -- 172.21.15.53:0/1562478411 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faff00a5980 con 0x7fb0080b3ac0 2023-06-10T18:53:32.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.212+0000 7fb00559a640 1 -- 172.21.15.53:0/1562478411 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff00a5d10 con 0x7fb0080b3ac0 2023-06-10T18:53:32.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.212+0000 7fb00c938640 1 -- 172.21.15.53:0/1562478411 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0080b3ac0 msgr2=0x7fb0080d1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:32.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.212+0000 7fb00c938640 1 --2- 172.21.15.53:0/1562478411 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0080b3ac0 0x7fb0080d1520 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fb0080b4bd0 tx=0x7faff001c960 comp rx=0 tx=0).stop 2023-06-10T18:53:32.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.212+0000 7fb00c938640 1 -- 172.21.15.53:0/1562478411 shutdown_connections 2023-06-10T18:53:32.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.212+0000 7fb00c938640 1 --2- 172.21.15.53:0/1562478411 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0080b3ac0 0x7fb0080d1520 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:32.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.212+0000 7fb00c938640 1 --2- 172.21.15.53:0/1562478411 >> v2:172.21.15.117:3300/0 conn(0x7fb0080d1150 0x7fb008163780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:32.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.212+0000 7fb00c938640 1 -- 172.21.15.53:0/1562478411 >> 172.21.15.53:0/1562478411 conn(0x7fb008069de0 msgr2=0x7fb00806a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:32.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.212+0000 7fb00c938640 1 -- 172.21.15.53:0/1562478411 shutdown_connections 2023-06-10T18:53:32.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.212+0000 7fb00c938640 1 -- 172.21.15.53:0/1562478411 wait complete. 2023-06-10T18:53:32.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.212+0000 7fb00c938640 1 Processor -- start 2023-06-10T18:53:32.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.212+0000 7fb00c938640 1 -- start start 2023-06-10T18:53:32.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.212+0000 7fb00c938640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0080b3ac0 0x7fb008151650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:32.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.212+0000 7fb00c938640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0080cfc10 0x7fb008160c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:32.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.212+0000 7fb00c938640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0080d1150 0x7fb0080c7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:32.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.212+0000 7fb00c938640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0081621a0 con 0x7fb0080cfc10 2023-06-10T18:53:32.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.212+0000 7fb00c938640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb008151b90 con 0x7fb0080d1150 2023-06-10T18:53:32.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.212+0000 7fb00c938640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb008161590 con 0x7fb0080b3ac0 2023-06-10T18:53:32.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.212+0000 7fb005d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0080cfc10 0x7fb008160c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:32.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.216+0000 7fb005d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0080cfc10 0x7fb008160c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36776/0 (socket says 172.21.15.53:36776) 2023-06-10T18:53:32.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.216+0000 7fb005d9b640 1 -- 172.21.15.53:0/1407091221 learned_addr learned my addr 172.21.15.53:0/1407091221 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:32.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.216+0000 7fb00659c640 1 --2- 172.21.15.53:0/1407091221 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0080b3ac0 0x7fb008151650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:32.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.216+0000 7fb006d9d640 1 --2- 172.21.15.53:0/1407091221 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0080d1150 0x7fb0080c7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:32.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.216+0000 7fb005d9b640 1 -- 172.21.15.53:0/1407091221 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0080b3ac0 msgr2=0x7fb008151650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:32.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.216+0000 7fb005d9b640 1 --2- 172.21.15.53:0/1407091221 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0080b3ac0 0x7fb008151650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:32.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.216+0000 7fb005d9b640 1 -- 172.21.15.53:0/1407091221 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0080d1150 msgr2=0x7fb0080c7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:32.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.216+0000 7fb005d9b640 1 --2- 172.21.15.53:0/1407091221 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0080d1150 0x7fb0080c7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:32.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.216+0000 7fb005d9b640 1 -- 172.21.15.53:0/1407091221 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faff0009b30 con 0x7fb0080cfc10 2023-06-10T18:53:32.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.216+0000 7fb006d9d640 1 --2- 172.21.15.53:0/1407091221 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0080d1150 0x7fb0080c7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:32.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.216+0000 7fb005d9b640 1 --2- 172.21.15.53:0/1407091221 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0080cfc10 0x7fb008160c20 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7faff001a590 tx=0x7faff0019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:32.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.216+0000 7faffeffd640 1 -- 172.21.15.53:0/1407091221 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff00b8670 con 0x7fb0080cfc10 2023-06-10T18:53:32.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.216+0000 7faffeffd640 1 -- 172.21.15.53:0/1407091221 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faff00b87f0 con 0x7fb0080cfc10 2023-06-10T18:53:32.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.216+0000 7faffeffd640 1 -- 172.21.15.53:0/1407091221 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff00b8ba0 con 0x7fb0080cfc10 2023-06-10T18:53:32.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.216+0000 7fb00c938640 1 -- 172.21.15.53:0/1407091221 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb008161870 con 0x7fb0080cfc10 2023-06-10T18:53:32.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.216+0000 7fb00c938640 1 -- 172.21.15.53:0/1407091221 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb008161e30 con 0x7fb0080cfc10 2023-06-10T18:53:32.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.216+0000 7fb00c938640 1 -- 172.21.15.53:0/1407091221 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb00804d790 con 0x7fb0080cfc10 2023-06-10T18:53:32.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.216+0000 7faffeffd640 1 -- 172.21.15.53:0/1407091221 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7faff00b8d00 con 0x7fb0080cfc10 2023-06-10T18:53:32.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.216+0000 7faffeffd640 1 --2- 172.21.15.53:0/1407091221 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fafe8066280 0x7fafe8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:32.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.216+0000 7faffeffd640 1 -- 172.21.15.53:0/1407091221 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7faff011f320 con 0x7fb0080cfc10 2023-06-10T18:53:32.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.216+0000 7fb00659c640 1 --2- 172.21.15.53:0/1407091221 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fafe8066280 0x7fafe8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:32.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.220+0000 7fb00659c640 1 --2- 172.21.15.53:0/1407091221 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fafe8066280 0x7fafe8068730 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb0081fb7d0 tx=0x7fb000008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:32.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.220+0000 7faffeffd640 1 -- 172.21.15.53:0/1407091221 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7faff00ec880 con 0x7fb0080cfc10 2023-06-10T18:53:32.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.384+0000 7fb00c938640 1 -- 172.21.15.53:0/1407091221 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb00804d790 con 0x7fb0080cfc10 2023-06-10T18:53:32.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.384+0000 7faffeffd640 1 -- 172.21.15.53:0/1407091221 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7faff00efea0 con 0x7fb0080cfc10 2023-06-10T18:53:32.394 INFO:teuthology.orchestra.run.smithi053.stderr:listed 0 entries 2023-06-10T18:53:32.395 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.388+0000 7fb00c938640 1 -- 172.21.15.53:0/1407091221 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fafe8066280 msgr2=0x7fafe8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:32.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.388+0000 7fb00c938640 1 --2- 172.21.15.53:0/1407091221 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fafe8066280 0x7fafe8068730 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb0081fb7d0 tx=0x7fb000008040 comp rx=0 tx=0).stop 2023-06-10T18:53:32.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.388+0000 7fb00c938640 1 -- 172.21.15.53:0/1407091221 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0080cfc10 msgr2=0x7fb008160c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:32.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.388+0000 7fb00c938640 1 --2- 172.21.15.53:0/1407091221 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0080cfc10 0x7fb008160c20 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7faff001a590 tx=0x7faff0019700 comp rx=0 tx=0).stop 2023-06-10T18:53:32.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.388+0000 7fb00c938640 1 -- 172.21.15.53:0/1407091221 shutdown_connections 2023-06-10T18:53:32.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.388+0000 7fb00c938640 1 --2- 172.21.15.53:0/1407091221 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fafe8066280 0x7fafe8068730 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:32.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.388+0000 7fb00c938640 1 --2- 172.21.15.53:0/1407091221 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0080d1150 0x7fb0080c7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:32.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.388+0000 7fb00c938640 1 --2- 172.21.15.53:0/1407091221 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0080cfc10 0x7fb008160c20 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:32.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.388+0000 7fb00c938640 1 --2- 172.21.15.53:0/1407091221 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0080b3ac0 0x7fb008151650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:32.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.388+0000 7fb00c938640 1 -- 172.21.15.53:0/1407091221 >> 172.21.15.53:0/1407091221 conn(0x7fb008069de0 msgr2=0x7fb00815f2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:32.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.388+0000 7fb00c938640 1 -- 172.21.15.53:0/1407091221 shutdown_connections 2023-06-10T18:53:32.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.388+0000 7fb00c938640 1 -- 172.21.15.53:0/1407091221 wait complete. 2023-06-10T18:53:32.411 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi117.front.sepia.ceph.com... 2023-06-10T18:53:32.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:53:32.412 DEBUG:teuthology.orchestra.run.smithi117:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-06-10T18:53:32.436 INFO:teuthology.orchestra.run:waiting for 300 2023-06-10T18:53:32.437 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi117.front.sepia.ceph.com 2023-06-10T18:53:32.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:53:32.438 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-06-10T18:53:32.488 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T18:53:32.489 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T18:53:32.494 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T18:53:32.495 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T18:53:32.541 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T18:53:32.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.696+0000 7fcca6a3e640 1 Processor -- start 2023-06-10T18:53:32.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.696+0000 7fcca6a3e640 1 -- start start 2023-06-10T18:53:32.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.700+0000 7fcca6a3e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcca00c9840 0x7fcca00c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:32.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.700+0000 7fcca6a3e640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcca0159b50 con 0x7fcca0071060 2023-06-10T18:53:32.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.700+0000 7fcca6a3e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcca00ca150 con 0x7fcca006b090 2023-06-10T18:53:32.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.700+0000 7fcca6a3e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcca00702a0 con 0x7fcca00c9840 2023-06-10T18:53:32.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.700+0000 7fcc9f7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fcca0071060 0x7fcca00af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:55848/0 (socket says 172.21.15.53:55848) 2023-06-10T18:53:32.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.700+0000 7fcc9f7fe640 1 -- 172.21.15.53:0/2082204057 learned_addr learned my addr 172.21.15.53:0/2082204057 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:53:32.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.700+0000 7fcc9ffff640 1 --2- 172.21.15.53:0/2082204057 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcca00c9840 0x7fcca00c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:32.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.700+0000 7fcc9effd640 1 -- 172.21.15.53:0/2082204057 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 462671796 0 0) 0x7fcca0159b50 con 0x7fcca0071060 2023-06-10T18:53:32.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.700+0000 7fcc9effd640 1 -- 172.21.15.53:0/2082204057 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc88003530 con 0x7fcca0071060 2023-06-10T18:53:32.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.700+0000 7fcc9effd640 1 -- 172.21.15.53:0/2082204057 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2335562504 0 0) 0x7fcc88003530 con 0x7fcca0071060 2023-06-10T18:53:32.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.700+0000 7fcc9effd640 1 -- 172.21.15.53:0/2082204057 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcca00c9840 msgr2=0x7fcca00c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:32.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.700+0000 7fcc9effd640 1 --2- 172.21.15.53:0/2082204057 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcca00c9840 0x7fcca00c9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:32.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.700+0000 7fcc9effd640 1 -- 172.21.15.53:0/2082204057 >> v1:172.21.15.117:6789/0 conn(0x7fcca006b090 legacy=0x7fcca006b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:32.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.700+0000 7fcc9effd640 1 -- 172.21.15.53:0/2082204057 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcca0070580 con 0x7fcca0071060 2023-06-10T18:53:32.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.700+0000 7fcc9effd640 1 -- 172.21.15.53:0/2082204057 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fcc90001680 con 0x7fcca0071060 2023-06-10T18:53:32.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.700+0000 7fcc9effd640 1 -- 172.21.15.53:0/2082204057 >> v1:172.21.15.53:6789/0 conn(0x7fcca0071060 legacy=0x7fcca00af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:32.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.700+0000 7fcc9effd640 1 --2- 172.21.15.53:0/2082204057 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcc88003a20 0x7fcc88003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:32.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.700+0000 7fcc9effd640 1 --2- 172.21.15.53:0/2082204057 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcca00c9840 0x7fcc880047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:32.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.700+0000 7fcc9effd640 1 --2- 172.21.15.53:0/2082204057 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc88004d10 0x7fcc88005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:32.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.700+0000 7fcc9effd640 1 -- 172.21.15.53:0/2082204057 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca00702a0 con 0x7fcc88004d10 2023-06-10T18:53:32.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.700+0000 7fcc9effd640 1 -- 172.21.15.53:0/2082204057 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8800ba70 con 0x7fcc88003a20 2023-06-10T18:53:32.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.700+0000 7fcc9effd640 1 -- 172.21.15.53:0/2082204057 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8800bc30 con 0x7fcca00c9840 2023-06-10T18:53:32.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.700+0000 7fcca4fdb640 1 --2- 172.21.15.53:0/2082204057 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc88004d10 0x7fcc88005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:32.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.700+0000 7fcc9ffff640 1 --2- 172.21.15.53:0/2082204057 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcc88003a20 0x7fcc88003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:32.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.700+0000 7fcca4fdb640 1 -- 172.21.15.53:0/2082204057 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcca00c9840 msgr2=0x7fcc880047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:32.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.700+0000 7fcca4fdb640 1 --2- 172.21.15.53:0/2082204057 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcca00c9840 0x7fcc880047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:32.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.700+0000 7fcca4fdb640 1 -- 172.21.15.53:0/2082204057 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcc88003a20 msgr2=0x7fcc88003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:32.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.700+0000 7fcca4fdb640 1 --2- 172.21.15.53:0/2082204057 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcc88003a20 0x7fcc88003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:32.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.700+0000 7fcca4fdb640 1 -- 172.21.15.53:0/2082204057 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc88003530 con 0x7fcc88004d10 2023-06-10T18:53:32.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.704+0000 7fcca4fdb640 1 --2- 172.21.15.53:0/2082204057 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc88004d10 0x7fcc88005180 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fcc98001e70 tx=0x7fcc9801c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73f497a62e4f872b server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:32.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.704+0000 7fcc9effd640 1 -- 172.21.15.53:0/2082204057 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc98003b80 con 0x7fcc88004d10 2023-06-10T18:53:32.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.704+0000 7fcc9effd640 1 -- 172.21.15.53:0/2082204057 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc98003ce0 con 0x7fcc88004d10 2023-06-10T18:53:32.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.704+0000 7fcc9effd640 1 -- 172.21.15.53:0/2082204057 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc980052c0 con 0x7fcc88004d10 2023-06-10T18:53:32.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.704+0000 7fcca6a3e640 1 -- 172.21.15.53:0/2082204057 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc88004d10 msgr2=0x7fcc88005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:32.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.704+0000 7fcca6a3e640 1 --2- 172.21.15.53:0/2082204057 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc88004d10 0x7fcc88005180 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fcc98001e70 tx=0x7fcc9801c760 comp rx=0 tx=0).stop 2023-06-10T18:53:32.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.704+0000 7fcca4fdb640 1 -- 172.21.15.53:0/2082204057 reap_dead start 2023-06-10T18:53:32.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.704+0000 7fcca6a3e640 1 -- 172.21.15.53:0/2082204057 shutdown_connections 2023-06-10T18:53:32.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.704+0000 7fcca6a3e640 1 -- 172.21.15.53:0/2082204057 >> 172.21.15.53:0/2082204057 conn(0x7fcca006a0d0 msgr2=0x7fcca00ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:32.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.704+0000 7fcca6a3e640 1 -- 172.21.15.53:0/2082204057 shutdown_connections 2023-06-10T18:53:32.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.704+0000 7fcca6a3e640 1 -- 172.21.15.53:0/2082204057 wait complete. 2023-06-10T18:53:32.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.704+0000 7fcca6a3e640 1 Processor -- start 2023-06-10T18:53:32.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.704+0000 7fcca6a3e640 1 -- start start 2023-06-10T18:53:32.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.704+0000 7fcca6a3e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcc88004d10 0x7fcca015aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:32.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.704+0000 7fcca6a3e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcca00c5780 0x7fcca014e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:32.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.704+0000 7fcca6a3e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcca00b20c0 0x7fcca00b2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:32.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.704+0000 7fcca6a3e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca014e770 con 0x7fcca00c5780 2023-06-10T18:53:32.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.704+0000 7fcca6a3e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca00b2a70 con 0x7fcca00b20c0 2023-06-10T18:53:32.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.704+0000 7fcca6a3e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcca015bd90 con 0x7fcc88004d10 2023-06-10T18:53:32.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.704+0000 7fcc9f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcca00c5780 0x7fcca014e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:32.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.704+0000 7fcc9f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcca00c5780 0x7fcca014e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36808/0 (socket says 172.21.15.53:36808) 2023-06-10T18:53:32.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.704+0000 7fcc9f7fe640 1 -- 172.21.15.53:0/396838600 learned_addr learned my addr 172.21.15.53:0/396838600 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:32.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.704+0000 7fcc9ffff640 1 --2- 172.21.15.53:0/396838600 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcc88004d10 0x7fcca015aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:32.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.704+0000 7fcca4fdb640 1 --2- 172.21.15.53:0/396838600 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcca00b20c0 0x7fcca00b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:32.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.704+0000 7fcc9f7fe640 1 -- 172.21.15.53:0/396838600 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcc88004d10 msgr2=0x7fcca015aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:32.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.704+0000 7fcc9f7fe640 1 --2- 172.21.15.53:0/396838600 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcc88004d10 0x7fcca015aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:32.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.704+0000 7fcc9f7fe640 1 -- 172.21.15.53:0/396838600 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcca00b20c0 msgr2=0x7fcca00b2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:32.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.704+0000 7fcc9f7fe640 1 --2- 172.21.15.53:0/396838600 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcca00b20c0 0x7fcca00b2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:32.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.704+0000 7fcc9f7fe640 1 -- 172.21.15.53:0/396838600 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcca015b180 con 0x7fcca00c5780 2023-06-10T18:53:32.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.704+0000 7fcca4fdb640 1 --2- 172.21.15.53:0/396838600 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcca00b20c0 0x7fcca00b2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:32.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.704+0000 7fcc9f7fe640 1 --2- 172.21.15.53:0/396838600 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcca00c5780 0x7fcca014e230 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fcc9000c790 tx=0x7fcc9000cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:32.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.704+0000 7fcc9cff9640 1 -- 172.21.15.53:0/396838600 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9000cea0 con 0x7fcca00c5780 2023-06-10T18:53:32.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.704+0000 7fcc9cff9640 1 -- 172.21.15.53:0/396838600 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc900074e0 con 0x7fcca00c5780 2023-06-10T18:53:32.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.704+0000 7fcc9cff9640 1 -- 172.21.15.53:0/396838600 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc90004a30 con 0x7fcca00c5780 2023-06-10T18:53:32.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.708+0000 7fcca6a3e640 1 -- 172.21.15.53:0/396838600 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcca015b460 con 0x7fcca00c5780 2023-06-10T18:53:32.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.708+0000 7fcca6a3e640 1 -- 172.21.15.53:0/396838600 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcca015ba20 con 0x7fcca00c5780 2023-06-10T18:53:32.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.708+0000 7fcca6a3e640 1 -- 172.21.15.53:0/396838600 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcca004d790 con 0x7fcca00c5780 2023-06-10T18:53:32.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.708+0000 7fcc9cff9640 1 -- 172.21.15.53:0/396838600 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcc90004b90 con 0x7fcca00c5780 2023-06-10T18:53:32.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.708+0000 7fcc9cff9640 1 --2- 172.21.15.53:0/396838600 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcc8c066280 0x7fcc8c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:32.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.708+0000 7fcc9cff9640 1 -- 172.21.15.53:0/396838600 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fcc900831d0 con 0x7fcca00c5780 2023-06-10T18:53:32.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.708+0000 7fcc9ffff640 1 --2- 172.21.15.53:0/396838600 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcc8c066280 0x7fcc8c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:32.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.708+0000 7fcc9ffff640 1 --2- 172.21.15.53:0/396838600 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcc8c066280 0x7fcc8c068730 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fcca00c70d0 tx=0x7fcc94008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:32.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.712+0000 7fcc9cff9640 1 -- 172.21.15.53:0/396838600 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcc90050580 con 0x7fcca00c5780 2023-06-10T18:53:32.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.868+0000 7fcca6a3e640 1 -- 172.21.15.53:0/396838600 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcca015bed0 con 0x7fcca00c5780 2023-06-10T18:53:32.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.868+0000 7fcc9cff9640 1 -- 172.21.15.53:0/396838600 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18363 (secure 0 0 0) 0x7fcc90018090 con 0x7fcca00c5780 2023-06-10T18:53:32.879 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:53:32.879 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":25,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T18:53:27.127355+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-10T18:52:43.396243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-10T18:52:43.894228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.23","mappings":[{"from":3,"to":2}]},{"pgid":"4.3e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T18:53:32.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.872+0000 7fcca6a3e640 1 -- 172.21.15.53:0/396838600 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcc8c066280 msgr2=0x7fcc8c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:32.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.872+0000 7fcca6a3e640 1 --2- 172.21.15.53:0/396838600 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcc8c066280 0x7fcc8c068730 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fcca00c70d0 tx=0x7fcc94008040 comp rx=0 tx=0).stop 2023-06-10T18:53:32.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.872+0000 7fcca6a3e640 1 -- 172.21.15.53:0/396838600 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcca00c5780 msgr2=0x7fcca014e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:32.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.872+0000 7fcca6a3e640 1 --2- 172.21.15.53:0/396838600 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcca00c5780 0x7fcca014e230 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fcc9000c790 tx=0x7fcc9000cc50 comp rx=0 tx=0).stop 2023-06-10T18:53:32.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.872+0000 7fcca6a3e640 1 -- 172.21.15.53:0/396838600 shutdown_connections 2023-06-10T18:53:32.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.872+0000 7fcca6a3e640 1 --2- 172.21.15.53:0/396838600 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcc8c066280 0x7fcc8c068730 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:32.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.872+0000 7fcca6a3e640 1 --2- 172.21.15.53:0/396838600 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcca00b20c0 0x7fcca00b2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:32.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.872+0000 7fcca6a3e640 1 --2- 172.21.15.53:0/396838600 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcca00c5780 0x7fcca014e230 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:32.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.872+0000 7fcca6a3e640 1 --2- 172.21.15.53:0/396838600 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcc88004d10 0x7fcca015aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:32.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.872+0000 7fcca6a3e640 1 -- 172.21.15.53:0/396838600 >> 172.21.15.53:0/396838600 conn(0x7fcca006a0d0 msgr2=0x7fcca00c82d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:32.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.872+0000 7fcca6a3e640 1 -- 172.21.15.53:0/396838600 shutdown_connections 2023-06-10T18:53:32.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:32.872+0000 7fcca6a3e640 1 -- 172.21.15.53:0/396838600 wait complete. 2023-06-10T18:53:32.899 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-10T18:52:33.633114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-10T18:52:39.171487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-10T18:52:43.396243+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-10T18:52:43.894228+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-10T18:53:32.900 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-10T18:53:33.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.028+0000 7f16d4c58640 1 Processor -- start 2023-06-10T18:53:33.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.028+0000 7f16d4c58640 1 -- start start 2023-06-10T18:53:33.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.028+0000 7f16d4c58640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16d00c82a0 0x7f16d00c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:33.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.028+0000 7f16d4c58640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f16d00af760 0x7f16d00afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:33.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.028+0000 7f16d4c58640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16d006b090 con 0x7f16d00c9fa0 2023-06-10T18:53:33.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.028+0000 7f16d4c58640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16d00b0120 con 0x7f16d00af760 2023-06-10T18:53:33.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.028+0000 7f16d4c58640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16d00ca370 con 0x7f16d00c82a0 2023-06-10T18:53:33.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.028+0000 7f16ce59c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f16d00c9fa0 0x7f16d006bae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:55856/0 (socket says 172.21.15.53:55856) 2023-06-10T18:53:33.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.028+0000 7f16ce59c640 1 -- 172.21.15.53:0/772132635 learned_addr learned my addr 172.21.15.53:0/772132635 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:53:33.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.028+0000 7f16c7fff640 1 --2- 172.21.15.53:0/772132635 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16d00c82a0 0x7f16d00c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:33.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.028+0000 7f16ced9d640 1 --2- 172.21.15.53:0/772132635 >> v2:172.21.15.117:3300/0 conn(0x7f16d00af760 0x7f16d00afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:33.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.028+0000 7f16cdd9b640 1 -- 172.21.15.53:0/772132635 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3436662989 0 0) 0x7f16d006b090 con 0x7f16d00c9fa0 2023-06-10T18:53:33.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.028+0000 7f16cdd9b640 1 -- 172.21.15.53:0/772132635 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16bc003530 con 0x7f16d00c9fa0 2023-06-10T18:53:33.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.028+0000 7f16cdd9b640 1 -- 172.21.15.53:0/772132635 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1873870358 0 0) 0x7f16bc003530 con 0x7f16d00c9fa0 2023-06-10T18:53:33.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.028+0000 7f16cdd9b640 1 -- 172.21.15.53:0/772132635 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16d00c82a0 msgr2=0x7f16d00c86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:33.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.028+0000 7f16cdd9b640 1 --2- 172.21.15.53:0/772132635 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16d00c82a0 0x7f16d00c86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:33.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.028+0000 7f16cdd9b640 1 -- 172.21.15.53:0/772132635 >> v2:172.21.15.117:3300/0 conn(0x7f16d00af760 msgr2=0x7f16d00afbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:33.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.028+0000 7f16cdd9b640 1 --2- 172.21.15.53:0/772132635 >> v2:172.21.15.117:3300/0 conn(0x7f16d00af760 0x7f16d00afbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:33.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.028+0000 7f16cdd9b640 1 -- 172.21.15.53:0/772132635 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16d0070d50 con 0x7f16d00c9fa0 2023-06-10T18:53:33.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.028+0000 7f16cdd9b640 1 -- 172.21.15.53:0/772132635 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f16c0001680 con 0x7f16d00c9fa0 2023-06-10T18:53:33.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.028+0000 7f16cdd9b640 1 -- 172.21.15.53:0/772132635 >> v1:172.21.15.53:6789/0 conn(0x7f16d00c9fa0 legacy=0x7f16d006bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:33.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.028+0000 7f16cdd9b640 1 --2- 172.21.15.53:0/772132635 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16bc003980 0x7f16bc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:33.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.028+0000 7f16cdd9b640 1 --2- 172.21.15.53:0/772132635 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16bc0043b0 0x7f16bc004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:33.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.028+0000 7f16cdd9b640 1 --2- 172.21.15.53:0/772132635 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16d00c82a0 0x7f16bc004fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:33.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.028+0000 7f16cdd9b640 1 -- 172.21.15.53:0/772132635 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16d00b0120 con 0x7f16bc0043b0 2023-06-10T18:53:33.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.028+0000 7f16cdd9b640 1 -- 172.21.15.53:0/772132635 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16d00ca370 con 0x7f16bc003980 2023-06-10T18:53:33.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.028+0000 7f16cdd9b640 1 -- 172.21.15.53:0/772132635 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16bc00b990 con 0x7f16d00c82a0 2023-06-10T18:53:33.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.028+0000 7f16c7fff640 1 --2- 172.21.15.53:0/772132635 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16bc0043b0 0x7f16bc004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:33.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.028+0000 7f16ce59c640 1 --2- 172.21.15.53:0/772132635 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16bc003980 0x7f16bc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:33.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.028+0000 7f16ced9d640 1 --2- 172.21.15.53:0/772132635 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16d00c82a0 0x7f16bc004fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:33.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.028+0000 7f16c7fff640 1 -- 172.21.15.53:0/772132635 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16d00c82a0 msgr2=0x7f16bc004fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:33.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.028+0000 7f16c7fff640 1 --2- 172.21.15.53:0/772132635 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16d00c82a0 0x7f16bc004fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:33.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.028+0000 7f16c7fff640 1 -- 172.21.15.53:0/772132635 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16bc003980 msgr2=0x7f16bc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:33.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.028+0000 7f16c7fff640 1 --2- 172.21.15.53:0/772132635 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16bc003980 0x7f16bc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:33.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.028+0000 7f16c7fff640 1 -- 172.21.15.53:0/772132635 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16bc003530 con 0x7f16bc0043b0 2023-06-10T18:53:33.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.028+0000 7f16ced9d640 1 --2- 172.21.15.53:0/772132635 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16d00c82a0 0x7f16bc004fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:33.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.032+0000 7f16c7fff640 1 --2- 172.21.15.53:0/772132635 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16bc0043b0 0x7f16bc004870 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f16b8009b10 tx=0x7f16b801ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f40939b1c3348fe9 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:33.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.032+0000 7f16cdd9b640 1 -- 172.21.15.53:0/772132635 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b80a55f0 con 0x7f16bc0043b0 2023-06-10T18:53:33.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.032+0000 7f16cdd9b640 1 -- 172.21.15.53:0/772132635 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16b80a5750 con 0x7f16bc0043b0 2023-06-10T18:53:33.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.032+0000 7f16cdd9b640 1 -- 172.21.15.53:0/772132635 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b80a5b00 con 0x7f16bc0043b0 2023-06-10T18:53:33.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.032+0000 7f16d4c58640 1 -- 172.21.15.53:0/772132635 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16bc0043b0 msgr2=0x7f16bc004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:33.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.032+0000 7f16d4c58640 1 --2- 172.21.15.53:0/772132635 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16bc0043b0 0x7f16bc004870 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f16b8009b10 tx=0x7f16b801ca20 comp rx=0 tx=0).stop 2023-06-10T18:53:33.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.032+0000 7f16ced9d640 1 -- 172.21.15.53:0/772132635 reap_dead start 2023-06-10T18:53:33.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.032+0000 7f16d4c58640 1 -- 172.21.15.53:0/772132635 shutdown_connections 2023-06-10T18:53:33.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.032+0000 7f16d4c58640 1 -- 172.21.15.53:0/772132635 >> 172.21.15.53:0/772132635 conn(0x7f16d006a0e0 msgr2=0x7f16d00cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:33.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.032+0000 7f16d4c58640 1 -- 172.21.15.53:0/772132635 shutdown_connections 2023-06-10T18:53:33.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.032+0000 7f16d4c58640 1 -- 172.21.15.53:0/772132635 wait complete. 2023-06-10T18:53:33.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.032+0000 7f16d4c58640 1 Processor -- start 2023-06-10T18:53:33.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.032+0000 7f16d4c58640 1 -- start start 2023-06-10T18:53:33.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.036+0000 7f16d4c58640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16bc0043b0 0x7f16d01f3af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:33.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.036+0000 7f16d4c58640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16d01513f0 0x7f16d015a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:33.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.036+0000 7f16d4c58640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16d0151860 0x7f16d015a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:33.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.036+0000 7f16d4c58640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16d01529e0 con 0x7f16bc0043b0 2023-06-10T18:53:33.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.036+0000 7f16d4c58640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16d0152e70 con 0x7f16d0151860 2023-06-10T18:53:33.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.036+0000 7f16d4c58640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16d0151dd0 con 0x7f16d01513f0 2023-06-10T18:53:33.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.036+0000 7f16ce59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16bc0043b0 0x7f16d01f3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:33.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.036+0000 7f16ce59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16bc0043b0 0x7f16d01f3af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36826/0 (socket says 172.21.15.53:36826) 2023-06-10T18:53:33.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.036+0000 7f16ce59c640 1 -- 172.21.15.53:0/1339183274 learned_addr learned my addr 172.21.15.53:0/1339183274 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:33.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.036+0000 7f16c7fff640 1 --2- 172.21.15.53:0/1339183274 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16d01513f0 0x7f16d015a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:33.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.036+0000 7f16ced9d640 1 --2- 172.21.15.53:0/1339183274 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16d0151860 0x7f16d015a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:33.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.036+0000 7f16ce59c640 1 -- 172.21.15.53:0/1339183274 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16d01513f0 msgr2=0x7f16d015a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:33.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.036+0000 7f16ce59c640 1 --2- 172.21.15.53:0/1339183274 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16d01513f0 0x7f16d015a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:33.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.036+0000 7f16ce59c640 1 -- 172.21.15.53:0/1339183274 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16d0151860 msgr2=0x7f16d015a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:33.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.036+0000 7f16ce59c640 1 --2- 172.21.15.53:0/1339183274 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16d0151860 0x7f16d015a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:33.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.036+0000 7f16ce59c640 1 -- 172.21.15.53:0/1339183274 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16d01520b0 con 0x7f16bc0043b0 2023-06-10T18:53:33.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.036+0000 7f16c7fff640 1 --2- 172.21.15.53:0/1339183274 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16d01513f0 0x7f16d015a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:53:33.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.036+0000 7f16ced9d640 1 --2- 172.21.15.53:0/1339183274 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16d0151860 0x7f16d015a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:33.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.036+0000 7f16ce59c640 1 --2- 172.21.15.53:0/1339183274 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16bc0043b0 0x7f16d01f3af0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f16c000e7f0 tx=0x7f16c000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:33.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.036+0000 7f16c6ffd640 1 -- 172.21.15.53:0/1339183274 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c000c8d0 con 0x7f16bc0043b0 2023-06-10T18:53:33.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.036+0000 7f16c6ffd640 1 -- 172.21.15.53:0/1339183274 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16c000ca30 con 0x7f16bc0043b0 2023-06-10T18:53:33.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.036+0000 7f16d4c58640 1 -- 172.21.15.53:0/1339183274 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16d0152390 con 0x7f16bc0043b0 2023-06-10T18:53:33.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.036+0000 7f16c6ffd640 1 -- 172.21.15.53:0/1339183274 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c000cde0 con 0x7f16bc0043b0 2023-06-10T18:53:33.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.036+0000 7f16d4c58640 1 -- 172.21.15.53:0/1339183274 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16d01f4030 con 0x7f16bc0043b0 2023-06-10T18:53:33.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.036+0000 7f16d4c58640 1 -- 172.21.15.53:0/1339183274 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16d004d790 con 0x7f16bc0043b0 2023-06-10T18:53:33.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.036+0000 7f16c6ffd640 1 -- 172.21.15.53:0/1339183274 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f16c001d460 con 0x7f16bc0043b0 2023-06-10T18:53:33.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.036+0000 7f16c6ffd640 1 --2- 172.21.15.53:0/1339183274 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f16b0066280 0x7f16b0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:33.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.036+0000 7f16c6ffd640 1 -- 172.21.15.53:0/1339183274 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f16c0083e10 con 0x7f16bc0043b0 2023-06-10T18:53:33.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.036+0000 7f16c7fff640 1 --2- 172.21.15.53:0/1339183274 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f16b0066280 0x7f16b0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:33.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.040+0000 7f16c7fff640 1 --2- 172.21.15.53:0/1339183274 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f16b0066280 0x7f16b0068730 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f16b80af000 tx=0x7f16b80046d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:33.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.040+0000 7f16c6ffd640 1 -- 172.21.15.53:0/1339183274 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f16c0051250 con 0x7f16bc0043b0 2023-06-10T18:53:33.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.196+0000 7f16d4c58640 1 -- 172.21.15.53:0/1339183274 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f16d00ce670 con 0x7f16bc0043b0 2023-06-10T18:53:33.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.196+0000 7f16c6ffd640 1 -- 172.21.15.53:0/1339183274 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f16c0054870 con 0x7f16bc0043b0 2023-06-10T18:53:33.204 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-06-10T18:53:33.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.196+0000 7f16d4c58640 1 -- 172.21.15.53:0/1339183274 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f16b0066280 msgr2=0x7f16b0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:33.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.196+0000 7f16d4c58640 1 --2- 172.21.15.53:0/1339183274 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f16b0066280 0x7f16b0068730 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f16b80af000 tx=0x7f16b80046d0 comp rx=0 tx=0).stop 2023-06-10T18:53:33.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.196+0000 7f16d4c58640 1 -- 172.21.15.53:0/1339183274 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16bc0043b0 msgr2=0x7f16d01f3af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:33.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.196+0000 7f16d4c58640 1 --2- 172.21.15.53:0/1339183274 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16bc0043b0 0x7f16d01f3af0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f16c000e7f0 tx=0x7f16c000ecb0 comp rx=0 tx=0).stop 2023-06-10T18:53:33.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.196+0000 7f16d4c58640 1 -- 172.21.15.53:0/1339183274 shutdown_connections 2023-06-10T18:53:33.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.196+0000 7f16d4c58640 1 --2- 172.21.15.53:0/1339183274 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f16b0066280 0x7f16b0068730 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:33.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.196+0000 7f16d4c58640 1 --2- 172.21.15.53:0/1339183274 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16d0151860 0x7f16d015a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:33.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.196+0000 7f16d4c58640 1 --2- 172.21.15.53:0/1339183274 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16d01513f0 0x7f16d015a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:33.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.196+0000 7f16d4c58640 1 --2- 172.21.15.53:0/1339183274 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16bc0043b0 0x7f16d01f3af0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:33.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.196+0000 7f16d4c58640 1 -- 172.21.15.53:0/1339183274 >> 172.21.15.53:0/1339183274 conn(0x7f16d006a0e0 msgr2=0x7f16d00ca540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:33.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.196+0000 7f16d4c58640 1 -- 172.21.15.53:0/1339183274 shutdown_connections 2023-06-10T18:53:33.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.196+0000 7f16d4c58640 1 -- 172.21.15.53:0/1339183274 wait complete. 2023-06-10T18:53:33.224 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-10T18:53:33.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.340+0000 7f57e11b5640 1 Processor -- start 2023-06-10T18:53:33.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.340+0000 7f57e11b5640 1 -- start start 2023-06-10T18:53:33.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.340+0000 7f57e11b5640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f57dc15c060 0x7f57dc0cc020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:33.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.340+0000 7f57e11b5640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f57dc070de0 0x7f57dc15c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:33.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.340+0000 7f57e11b5640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57dc0c8d50 con 0x7f57dc15c970 2023-06-10T18:53:33.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.340+0000 7f57e11b5640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57dc0c9030 con 0x7f57dc15c060 2023-06-10T18:53:33.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.340+0000 7f57e11b5640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57dc070300 con 0x7f57dc070de0 2023-06-10T18:53:33.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.340+0000 7f57dad9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f57dc15c060 0x7f57dc0cc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:33.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.340+0000 7f57dad9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f57dc15c060 0x7f57dc0cc020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36832/0 (socket says 172.21.15.53:36832) 2023-06-10T18:53:33.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.340+0000 7f57dad9d640 1 -- 172.21.15.53:0/4157324157 learned_addr learned my addr 172.21.15.53:0/4157324157 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:33.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.340+0000 7f57db59e640 1 --1- 172.21.15.53:0/4157324157 >> v1:172.21.15.53:6789/0 conn(0x7f57dc15c970 0x7f57dc06bd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:55864/0 (socket says 172.21.15.53:55864) 2023-06-10T18:53:33.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.340+0000 7f57da59c640 1 --2- 172.21.15.53:0/4157324157 >> v2:172.21.15.117:3300/0 conn(0x7f57dc070de0 0x7f57dc15c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:33.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.340+0000 7f57dad9d640 1 -- 172.21.15.53:0/4157324157 >> v2:172.21.15.117:3300/0 conn(0x7f57dc070de0 msgr2=0x7f57dc15c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:33.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.340+0000 7f57dad9d640 1 --2- 172.21.15.53:0/4157324157 >> v2:172.21.15.117:3300/0 conn(0x7f57dc070de0 0x7f57dc15c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:33.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.340+0000 7f57dad9d640 1 -- 172.21.15.53:0/4157324157 >> v1:172.21.15.53:6789/0 conn(0x7f57dc15c970 legacy=0x7f57dc06bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:33.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.340+0000 7f57dad9d640 1 -- 172.21.15.53:0/4157324157 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57dc0705e0 con 0x7f57dc15c060 2023-06-10T18:53:33.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.340+0000 7f57da59c640 1 --2- 172.21.15.53:0/4157324157 >> v2:172.21.15.117:3300/0 conn(0x7f57dc070de0 0x7f57dc15c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:33.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.344+0000 7f57dad9d640 1 --2- 172.21.15.53:0/4157324157 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57dc15c060 0x7f57dc0cc020 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f57dc071450 tx=0x7f57c401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c591f46e4c484cf1 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:33.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.344+0000 7f57d9d9b640 1 -- 172.21.15.53:0/4157324157 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c40ad680 con 0x7f57dc15c060 2023-06-10T18:53:33.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.344+0000 7f57d9d9b640 1 -- 172.21.15.53:0/4157324157 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57c40ad7e0 con 0x7f57dc15c060 2023-06-10T18:53:33.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.344+0000 7f57d9d9b640 1 -- 172.21.15.53:0/4157324157 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c40adb70 con 0x7f57dc15c060 2023-06-10T18:53:33.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.344+0000 7f57e11b5640 1 -- 172.21.15.53:0/4157324157 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57dc15c060 msgr2=0x7f57dc0cc020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:33.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.344+0000 7f57e11b5640 1 --2- 172.21.15.53:0/4157324157 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57dc15c060 0x7f57dc0cc020 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f57dc071450 tx=0x7f57c401c470 comp rx=0 tx=0).stop 2023-06-10T18:53:33.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.344+0000 7f57e11b5640 1 -- 172.21.15.53:0/4157324157 shutdown_connections 2023-06-10T18:53:33.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.344+0000 7f57e11b5640 1 --2- 172.21.15.53:0/4157324157 >> v2:172.21.15.117:3300/0 conn(0x7f57dc070de0 0x7f57dc15c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:33.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.344+0000 7f57e11b5640 1 --2- 172.21.15.53:0/4157324157 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57dc15c060 0x7f57dc0cc020 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:33.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.344+0000 7f57e11b5640 1 -- 172.21.15.53:0/4157324157 >> 172.21.15.53:0/4157324157 conn(0x7f57dc06a0e0 msgr2=0x7f57dc0cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:33.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.344+0000 7f57e11b5640 1 -- 172.21.15.53:0/4157324157 shutdown_connections 2023-06-10T18:53:33.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.344+0000 7f57e11b5640 1 -- 172.21.15.53:0/4157324157 wait complete. 2023-06-10T18:53:33.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.344+0000 7f57e11b5640 1 Processor -- start 2023-06-10T18:53:33.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.344+0000 7f57e11b5640 1 -- start start 2023-06-10T18:53:33.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.344+0000 7f57e11b5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57dc070de0 0x7f57dc0c7b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:33.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.344+0000 7f57e11b5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57dc15c970 0x7f57dc0c4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:33.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.344+0000 7f57e11b5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57dc150b80 0x7f57dc150220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:33.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.344+0000 7f57e11b5640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57dc0c8040 con 0x7f57dc15c970 2023-06-10T18:53:33.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.344+0000 7f57e11b5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57dc0c39f0 con 0x7f57dc070de0 2023-06-10T18:53:33.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.344+0000 7f57e11b5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57dc0c3cd0 con 0x7f57dc150b80 2023-06-10T18:53:33.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.344+0000 7f57da59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57dc15c970 0x7f57dc0c4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:33.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.344+0000 7f57da59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57dc15c970 0x7f57dc0c4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36834/0 (socket says 172.21.15.53:36834) 2023-06-10T18:53:33.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.344+0000 7f57da59c640 1 -- 172.21.15.53:0/159638195 learned_addr learned my addr 172.21.15.53:0/159638195 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:33.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.344+0000 7f57dad9d640 1 --2- 172.21.15.53:0/159638195 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57dc070de0 0x7f57dc0c7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:33.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.344+0000 7f57db59e640 1 --2- 172.21.15.53:0/159638195 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57dc150b80 0x7f57dc150220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:33.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.348+0000 7f57da59c640 1 -- 172.21.15.53:0/159638195 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57dc150b80 msgr2=0x7f57dc150220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:33.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.348+0000 7f57da59c640 1 --2- 172.21.15.53:0/159638195 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57dc150b80 0x7f57dc150220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:33.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.348+0000 7f57da59c640 1 -- 172.21.15.53:0/159638195 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57dc070de0 msgr2=0x7f57dc0c7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:33.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.348+0000 7f57da59c640 1 --2- 172.21.15.53:0/159638195 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57dc070de0 0x7f57dc0c7b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:33.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.348+0000 7f57da59c640 1 -- 172.21.15.53:0/159638195 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c40094d0 con 0x7f57dc15c970 2023-06-10T18:53:33.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.348+0000 7f57da59c640 1 --2- 172.21.15.53:0/159638195 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57dc15c970 0x7f57dc0c4d20 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f57cc00ce00 tx=0x7f57cc00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:33.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.348+0000 7f57d37fe640 1 -- 172.21.15.53:0/159638195 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57cc00f890 con 0x7f57dc15c970 2023-06-10T18:53:33.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.348+0000 7f57d37fe640 1 -- 172.21.15.53:0/159638195 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57cc00f9f0 con 0x7f57dc15c970 2023-06-10T18:53:33.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.348+0000 7f57e11b5640 1 -- 172.21.15.53:0/159638195 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57dc158950 con 0x7f57dc15c970 2023-06-10T18:53:33.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.348+0000 7f57d37fe640 1 -- 172.21.15.53:0/159638195 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57cc00fdc0 con 0x7f57dc15c970 2023-06-10T18:53:33.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.348+0000 7f57e11b5640 1 -- 172.21.15.53:0/159638195 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57dc0c75e0 con 0x7f57dc15c970 2023-06-10T18:53:33.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.348+0000 7f57e11b5640 1 -- 172.21.15.53:0/159638195 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57dc04d790 con 0x7f57dc15c970 2023-06-10T18:53:33.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.348+0000 7f57d37fe640 1 -- 172.21.15.53:0/159638195 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f57cc00b040 con 0x7f57dc15c970 2023-06-10T18:53:33.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.348+0000 7f57d37fe640 1 --2- 172.21.15.53:0/159638195 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f57bc0662b0 0x7f57bc068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:33.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.348+0000 7f57d37fe640 1 -- 172.21.15.53:0/159638195 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f57cc084790 con 0x7f57dc15c970 2023-06-10T18:53:33.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.348+0000 7f57dad9d640 1 --2- 172.21.15.53:0/159638195 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f57bc0662b0 0x7f57bc068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:33.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.348+0000 7f57dad9d640 1 --2- 172.21.15.53:0/159638195 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f57bc0662b0 0x7f57bc068760 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f57c40af000 tx=0x7f57c4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:33.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.352+0000 7f57d37fe640 1 -- 172.21.15.53:0/159638195 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f57cc051c80 con 0x7f57dc15c970 2023-06-10T18:53:33.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.508+0000 7f57e11b5640 1 -- 172.21.15.53:0/159638195 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f57dc0c4ae0 con 0x7f57dc15c970 2023-06-10T18:53:33.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.512+0000 7f57d37fe640 1 -- 172.21.15.53:0/159638195 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f57cc0552a0 con 0x7f57dc15c970 2023-06-10T18:53:33.520 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-06-10T18:53:33.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.512+0000 7f57e11b5640 1 -- 172.21.15.53:0/159638195 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f57bc0662b0 msgr2=0x7f57bc068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:33.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.512+0000 7f57e11b5640 1 --2- 172.21.15.53:0/159638195 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f57bc0662b0 0x7f57bc068760 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f57c40af000 tx=0x7f57c4008040 comp rx=0 tx=0).stop 2023-06-10T18:53:33.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.512+0000 7f57e11b5640 1 -- 172.21.15.53:0/159638195 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57dc15c970 msgr2=0x7f57dc0c4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:33.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.512+0000 7f57e11b5640 1 --2- 172.21.15.53:0/159638195 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57dc15c970 0x7f57dc0c4d20 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f57cc00ce00 tx=0x7f57cc00a650 comp rx=0 tx=0).stop 2023-06-10T18:53:33.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.512+0000 7f57e11b5640 1 -- 172.21.15.53:0/159638195 shutdown_connections 2023-06-10T18:53:33.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.512+0000 7f57e11b5640 1 --2- 172.21.15.53:0/159638195 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f57bc0662b0 0x7f57bc068760 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:33.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.512+0000 7f57e11b5640 1 --2- 172.21.15.53:0/159638195 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57dc150b80 0x7f57dc150220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:33.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.512+0000 7f57e11b5640 1 --2- 172.21.15.53:0/159638195 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57dc15c970 0x7f57dc0c4d20 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:33.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.512+0000 7f57e11b5640 1 --2- 172.21.15.53:0/159638195 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57dc070de0 0x7f57dc0c7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:33.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.512+0000 7f57e11b5640 1 -- 172.21.15.53:0/159638195 >> 172.21.15.53:0/159638195 conn(0x7f57dc06a0e0 msgr2=0x7f57dc0b0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:33.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.512+0000 7f57e11b5640 1 -- 172.21.15.53:0/159638195 shutdown_connections 2023-06-10T18:53:33.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.512+0000 7f57e11b5640 1 -- 172.21.15.53:0/159638195 wait complete. 2023-06-10T18:53:33.539 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-10T18:53:33.660 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.652+0000 7f415392c640 1 Processor -- start 2023-06-10T18:53:33.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.652+0000 7f415392c640 1 -- start start 2023-06-10T18:53:33.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.652+0000 7f415392c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f414c15c060 0x7f414c0cc020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:33.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.652+0000 7f415392c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f414c070de0 0x7f414c15c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:33.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.652+0000 7f415392c640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f414c0c8d50 con 0x7f414c15c970 2023-06-10T18:53:33.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.652+0000 7f415392c640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f414c0c9030 con 0x7f414c15c060 2023-06-10T18:53:33.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.652+0000 7f415392c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f414c070300 con 0x7f414c070de0 2023-06-10T18:53:33.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.652+0000 7f4150ec7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f414c070de0 0x7f414c15c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:33.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.652+0000 7f41516c8640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f414c15c060 0x7f414c0cc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:33.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.652+0000 7f41516c8640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f414c15c060 0x7f414c0cc020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.53:43700/0 (socket says 172.21.15.53:43700) 2023-06-10T18:53:33.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.652+0000 7f41516c8640 1 -- 172.21.15.53:0/3391773282 learned_addr learned my addr 172.21.15.53:0/3391773282 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:33.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.652+0000 7f4150ec7640 1 -- 172.21.15.53:0/3391773282 >> v2:172.21.15.117:3300/0 conn(0x7f414c15c060 msgr2=0x7f414c0cc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:33.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.652+0000 7f4150ec7640 1 --2- 172.21.15.53:0/3391773282 >> v2:172.21.15.117:3300/0 conn(0x7f414c15c060 0x7f414c0cc020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:33.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.652+0000 7f4150ec7640 1 -- 172.21.15.53:0/3391773282 >> v1:172.21.15.117:6789/0 conn(0x7f414c15c970 legacy=0x7f414c06bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:33.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.652+0000 7f4150ec7640 1 -- 172.21.15.53:0/3391773282 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f414c0705e0 con 0x7f414c070de0 2023-06-10T18:53:33.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.656+0000 7f4150ec7640 1 --2- 172.21.15.53:0/3391773282 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f414c070de0 0x7f414c15c430 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f413c0097c0 tx=0x7f413c01c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54092bf6fc277732 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:33.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.656+0000 7f4143fff640 1 -- 172.21.15.53:0/3391773282 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413c0ab600 con 0x7f414c070de0 2023-06-10T18:53:33.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.656+0000 7f4143fff640 1 -- 172.21.15.53:0/3391773282 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f413c0a7050 con 0x7f414c070de0 2023-06-10T18:53:33.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.656+0000 7f4143fff640 1 -- 172.21.15.53:0/3391773282 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413c0ab980 con 0x7f414c070de0 2023-06-10T18:53:33.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.656+0000 7f415392c640 1 -- 172.21.15.53:0/3391773282 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f414c070de0 msgr2=0x7f414c15c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:33.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.656+0000 7f415392c640 1 --2- 172.21.15.53:0/3391773282 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f414c070de0 0x7f414c15c430 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f413c0097c0 tx=0x7f413c01c3f0 comp rx=0 tx=0).stop 2023-06-10T18:53:33.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.656+0000 7f415392c640 1 -- 172.21.15.53:0/3391773282 shutdown_connections 2023-06-10T18:53:33.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.656+0000 7f415392c640 1 --2- 172.21.15.53:0/3391773282 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f414c070de0 0x7f414c15c430 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:33.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.656+0000 7f415392c640 1 --2- 172.21.15.53:0/3391773282 >> v2:172.21.15.117:3300/0 conn(0x7f414c15c060 0x7f414c0cc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:33.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.656+0000 7f415392c640 1 -- 172.21.15.53:0/3391773282 >> 172.21.15.53:0/3391773282 conn(0x7f414c06a0e0 msgr2=0x7f414c0cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:33.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.656+0000 7f415392c640 1 -- 172.21.15.53:0/3391773282 shutdown_connections 2023-06-10T18:53:33.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.656+0000 7f415392c640 1 -- 172.21.15.53:0/3391773282 wait complete. 2023-06-10T18:53:33.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.656+0000 7f415392c640 1 Processor -- start 2023-06-10T18:53:33.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.656+0000 7f415392c640 1 -- start start 2023-06-10T18:53:33.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.660+0000 7f415392c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f414c070de0 0x7f414c0c6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:33.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.660+0000 7f415392c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f414c15c060 0x7f414c0c7010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:33.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.660+0000 7f415392c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f414c15c970 0x7f414c0c7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:33.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.660+0000 7f415392c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f414c14e800 con 0x7f414c070de0 2023-06-10T18:53:33.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.660+0000 7f415392c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f414c0c7a90 con 0x7f414c15c060 2023-06-10T18:53:33.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.660+0000 7f415392c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f414c14e4b0 con 0x7f414c15c970 2023-06-10T18:53:33.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.660+0000 7f41516c8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f414c070de0 0x7f414c0c6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:33.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.660+0000 7f41516c8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f414c070de0 0x7f414c0c6ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36846/0 (socket says 172.21.15.53:36846) 2023-06-10T18:53:33.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.660+0000 7f41516c8640 1 -- 172.21.15.53:0/2248210620 learned_addr learned my addr 172.21.15.53:0/2248210620 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:33.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.660+0000 7f4150ec7640 1 --2- 172.21.15.53:0/2248210620 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f414c15c060 0x7f414c0c7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:33.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.660+0000 7f4151ec9640 1 --2- 172.21.15.53:0/2248210620 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f414c15c970 0x7f414c0c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:33.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.660+0000 7f41516c8640 1 -- 172.21.15.53:0/2248210620 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f414c15c970 msgr2=0x7f414c0c7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:33.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.660+0000 7f41516c8640 1 --2- 172.21.15.53:0/2248210620 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f414c15c970 0x7f414c0c7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:33.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.660+0000 7f41516c8640 1 -- 172.21.15.53:0/2248210620 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f414c15c060 msgr2=0x7f414c0c7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:33.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.660+0000 7f41516c8640 1 --2- 172.21.15.53:0/2248210620 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f414c15c060 0x7f414c0c7010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:33.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.660+0000 7f41516c8640 1 -- 172.21.15.53:0/2248210620 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f413c009420 con 0x7f414c070de0 2023-06-10T18:53:33.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.660+0000 7f41516c8640 1 --2- 172.21.15.53:0/2248210620 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f414c070de0 0x7f414c0c6ad0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f414800e7f0 tx=0x7f414800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:33.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.660+0000 7f4141ffb640 1 -- 172.21.15.53:0/2248210620 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4148009580 con 0x7f414c070de0 2023-06-10T18:53:33.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.660+0000 7f4141ffb640 1 -- 172.21.15.53:0/2248210620 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f414800c940 con 0x7f414c070de0 2023-06-10T18:53:33.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.660+0000 7f4141ffb640 1 -- 172.21.15.53:0/2248210620 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f414800ccf0 con 0x7f414c070de0 2023-06-10T18:53:33.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.660+0000 7f415392c640 1 -- 172.21.15.53:0/2248210620 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f414c158950 con 0x7f414c070de0 2023-06-10T18:53:33.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.660+0000 7f415392c640 1 -- 172.21.15.53:0/2248210620 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f414c0c7f50 con 0x7f414c070de0 2023-06-10T18:53:33.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.660+0000 7f415392c640 1 -- 172.21.15.53:0/2248210620 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f414c04d790 con 0x7f414c070de0 2023-06-10T18:53:33.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.660+0000 7f4141ffb640 1 -- 172.21.15.53:0/2248210620 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4148013470 con 0x7f414c070de0 2023-06-10T18:53:33.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.660+0000 7f4141ffb640 1 --2- 172.21.15.53:0/2248210620 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4130066280 0x7f4130068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:33.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.660+0000 7f4141ffb640 1 -- 172.21.15.53:0/2248210620 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f4148083d10 con 0x7f414c070de0 2023-06-10T18:53:33.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.660+0000 7f4150ec7640 1 --2- 172.21.15.53:0/2248210620 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4130066280 0x7f4130068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:33.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.664+0000 7f4150ec7640 1 --2- 172.21.15.53:0/2248210620 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4130066280 0x7f4130068730 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f413c0ad000 tx=0x7f413c0a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:33.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.664+0000 7f4141ffb640 1 -- 172.21.15.53:0/2248210620 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4148051290 con 0x7f414c070de0 2023-06-10T18:53:33.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.812+0000 7f415392c640 1 -- 172.21.15.53:0/2248210620 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f414c14ea70 con 0x7f414c070de0 2023-06-10T18:53:33.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.812+0000 7f4141ffb640 1 -- 172.21.15.53:0/2248210620 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4148017020 con 0x7f414c070de0 2023-06-10T18:53:33.823 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-06-10T18:53:33.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.816+0000 7f415392c640 1 -- 172.21.15.53:0/2248210620 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4130066280 msgr2=0x7f4130068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:33.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.816+0000 7f415392c640 1 --2- 172.21.15.53:0/2248210620 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4130066280 0x7f4130068730 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f413c0ad000 tx=0x7f413c0a6000 comp rx=0 tx=0).stop 2023-06-10T18:53:33.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.816+0000 7f415392c640 1 -- 172.21.15.53:0/2248210620 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f414c070de0 msgr2=0x7f414c0c6ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:33.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.816+0000 7f415392c640 1 --2- 172.21.15.53:0/2248210620 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f414c070de0 0x7f414c0c6ad0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f414800e7f0 tx=0x7f414800ecb0 comp rx=0 tx=0).stop 2023-06-10T18:53:33.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.816+0000 7f415392c640 1 -- 172.21.15.53:0/2248210620 shutdown_connections 2023-06-10T18:53:33.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.816+0000 7f415392c640 1 --2- 172.21.15.53:0/2248210620 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4130066280 0x7f4130068730 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:33.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.816+0000 7f415392c640 1 --2- 172.21.15.53:0/2248210620 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f414c15c970 0x7f414c0c7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:33.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.816+0000 7f415392c640 1 --2- 172.21.15.53:0/2248210620 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f414c15c060 0x7f414c0c7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:33.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.816+0000 7f415392c640 1 --2- 172.21.15.53:0/2248210620 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f414c070de0 0x7f414c0c6ad0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:33.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.816+0000 7f415392c640 1 -- 172.21.15.53:0/2248210620 >> 172.21.15.53:0/2248210620 conn(0x7f414c06a0e0 msgr2=0x7f414c06eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:33.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.816+0000 7f415392c640 1 -- 172.21.15.53:0/2248210620 shutdown_connections 2023-06-10T18:53:33.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.816+0000 7f415392c640 1 -- 172.21.15.53:0/2248210620 wait complete. 2023-06-10T18:53:33.841 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-10T18:53:33.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.956+0000 7f1b6010d640 1 Processor -- start 2023-06-10T18:53:33.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.956+0000 7f1b6010d640 1 -- start start 2023-06-10T18:53:33.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.956+0000 7f1b6010d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b580700e0 0x7f1b580c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:33.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.956+0000 7f1b6010d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1b5815dae0 0x7f1b5806b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:33.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.956+0000 7f1b6010d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b58070910 con 0x7f1b580af760 2023-06-10T18:53:33.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.956+0000 7f1b6010d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b58070bf0 con 0x7f1b5815dae0 2023-06-10T18:53:33.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.956+0000 7f1b6010d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b58070ed0 con 0x7f1b580700e0 2023-06-10T18:53:33.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.956+0000 7f1b5e6aa640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1b5815dae0 0x7f1b5806b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:33.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.956+0000 7f1b5e6aa640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1b5815dae0 0x7f1b5806b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36854/0 (socket says 172.21.15.53:36854) 2023-06-10T18:53:33.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.956+0000 7f1b5e6aa640 1 -- 172.21.15.53:0/3539377340 learned_addr learned my addr 172.21.15.53:0/3539377340 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:33.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.956+0000 7f1b5d6a8640 1 --2- 172.21.15.53:0/3539377340 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b580700e0 0x7f1b580c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:33.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.956+0000 7f1b5e6aa640 1 -- 172.21.15.53:0/3539377340 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b580700e0 msgr2=0x7f1b580c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:33.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.956+0000 7f1b5e6aa640 1 --2- 172.21.15.53:0/3539377340 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b580700e0 0x7f1b580c82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:33.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.956+0000 7f1b5e6aa640 1 -- 172.21.15.53:0/3539377340 >> v1:172.21.15.117:6789/0 conn(0x7f1b580af760 legacy=0x7f1b580afb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:33.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.956+0000 7f1b5e6aa640 1 -- 172.21.15.53:0/3539377340 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b580711b0 con 0x7f1b5815dae0 2023-06-10T18:53:33.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.960+0000 7f1b5e6aa640 1 --2- 172.21.15.53:0/3539377340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b5815dae0 0x7f1b5806b650 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f1b50009870 tx=0x7f1b5001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79c4011cff3bee87 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:33.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.960+0000 7f1b5cea7640 1 -- 172.21.15.53:0/3539377340 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b500a7070 con 0x7f1b5815dae0 2023-06-10T18:53:33.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.960+0000 7f1b5cea7640 1 -- 172.21.15.53:0/3539377340 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b500ab430 con 0x7f1b5815dae0 2023-06-10T18:53:33.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.960+0000 7f1b5cea7640 1 -- 172.21.15.53:0/3539377340 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b500ab7c0 con 0x7f1b5815dae0 2023-06-10T18:53:33.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.960+0000 7f1b6010d640 1 -- 172.21.15.53:0/3539377340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b5815dae0 msgr2=0x7f1b5806b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:33.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.960+0000 7f1b6010d640 1 --2- 172.21.15.53:0/3539377340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b5815dae0 0x7f1b5806b650 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f1b50009870 tx=0x7f1b5001c4d0 comp rx=0 tx=0).stop 2023-06-10T18:53:33.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.960+0000 7f1b6010d640 1 -- 172.21.15.53:0/3539377340 shutdown_connections 2023-06-10T18:53:33.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.960+0000 7f1b6010d640 1 --2- 172.21.15.53:0/3539377340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b5815dae0 0x7f1b5806b650 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:33.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.960+0000 7f1b6010d640 1 --2- 172.21.15.53:0/3539377340 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b580700e0 0x7f1b580c82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:33.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.960+0000 7f1b6010d640 1 -- 172.21.15.53:0/3539377340 >> 172.21.15.53:0/3539377340 conn(0x7f1b5806a0e0 msgr2=0x7f1b580cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:33.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.960+0000 7f1b6010d640 1 -- 172.21.15.53:0/3539377340 shutdown_connections 2023-06-10T18:53:33.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.960+0000 7f1b6010d640 1 -- 172.21.15.53:0/3539377340 wait complete. 2023-06-10T18:53:33.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.960+0000 7f1b6010d640 1 Processor -- start 2023-06-10T18:53:33.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.960+0000 7f1b6010d640 1 -- start start 2023-06-10T18:53:33.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.960+0000 7f1b6010d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b580700e0 0x7f1b580b2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:33.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.964+0000 7f1b6010d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b580af760 0x7f1b580c0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:33.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.964+0000 7f1b6010d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b5815dae0 0x7f1b580cb820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:33.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.964+0000 7f1b6010d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b580c15d0 con 0x7f1b5815dae0 2023-06-10T18:53:33.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.964+0000 7f1b6010d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b58155560 con 0x7f1b580af760 2023-06-10T18:53:33.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.964+0000 7f1b6010d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b580c1100 con 0x7f1b580700e0 2023-06-10T18:53:33.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.964+0000 7f1b5e6aa640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b5815dae0 0x7f1b580cb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:33.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.964+0000 7f1b5e6aa640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b5815dae0 0x7f1b580cb820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36862/0 (socket says 172.21.15.53:36862) 2023-06-10T18:53:33.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.964+0000 7f1b5e6aa640 1 -- 172.21.15.53:0/1287466738 learned_addr learned my addr 172.21.15.53:0/1287466738 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:33.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.964+0000 7f1b5dea9640 1 --2- 172.21.15.53:0/1287466738 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b580700e0 0x7f1b580b2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:33.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.964+0000 7f1b5d6a8640 1 --2- 172.21.15.53:0/1287466738 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b580af760 0x7f1b580c0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:33.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.964+0000 7f1b5e6aa640 1 -- 172.21.15.53:0/1287466738 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b580700e0 msgr2=0x7f1b580b2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:33.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.964+0000 7f1b5e6aa640 1 --2- 172.21.15.53:0/1287466738 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b580700e0 0x7f1b580b2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:33.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.964+0000 7f1b5e6aa640 1 -- 172.21.15.53:0/1287466738 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b580af760 msgr2=0x7f1b580c0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:33.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.964+0000 7f1b5e6aa640 1 --2- 172.21.15.53:0/1287466738 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b580af760 0x7f1b580c0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:33.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.964+0000 7f1b5e6aa640 1 -- 172.21.15.53:0/1287466738 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b500094d0 con 0x7f1b5815dae0 2023-06-10T18:53:33.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.964+0000 7f1b5d6a8640 1 --2- 172.21.15.53:0/1287466738 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b580af760 0x7f1b580c0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:33.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.964+0000 7f1b5e6aa640 1 --2- 172.21.15.53:0/1287466738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b5815dae0 0x7f1b580cb820 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f1b5001ab80 tx=0x7f1b50019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:33.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.964+0000 7f1b4e7fc640 1 -- 172.21.15.53:0/1287466738 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b500b4830 con 0x7f1b5815dae0 2023-06-10T18:53:33.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.964+0000 7f1b4e7fc640 1 -- 172.21.15.53:0/1287466738 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b500b4990 con 0x7f1b5815dae0 2023-06-10T18:53:33.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.964+0000 7f1b6010d640 1 -- 172.21.15.53:0/1287466738 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b58155b20 con 0x7f1b5815dae0 2023-06-10T18:53:33.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.964+0000 7f1b4e7fc640 1 -- 172.21.15.53:0/1287466738 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b500b4d40 con 0x7f1b5815dae0 2023-06-10T18:53:33.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.964+0000 7f1b6010d640 1 -- 172.21.15.53:0/1287466738 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b580acb30 con 0x7f1b5815dae0 2023-06-10T18:53:33.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.964+0000 7f1b6010d640 1 -- 172.21.15.53:0/1287466738 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b580b3340 con 0x7f1b5815dae0 2023-06-10T18:53:33.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.964+0000 7f1b4e7fc640 1 -- 172.21.15.53:0/1287466738 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1b500c0460 con 0x7f1b5815dae0 2023-06-10T18:53:33.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.964+0000 7f1b4e7fc640 1 --2- 172.21.15.53:0/1287466738 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1b3c066280 0x7f1b3c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:33.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.964+0000 7f1b4e7fc640 1 -- 172.21.15.53:0/1287466738 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f1b5011e0b0 con 0x7f1b5815dae0 2023-06-10T18:53:33.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.964+0000 7f1b5dea9640 1 --2- 172.21.15.53:0/1287466738 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1b3c066280 0x7f1b3c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:33.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.964+0000 7f1b5dea9640 1 --2- 172.21.15.53:0/1287466738 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1b3c066280 0x7f1b3c068730 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1b580b3e20 tx=0x7f1b54009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:33.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:33.968+0000 7f1b4e7fc640 1 -- 172.21.15.53:0/1287466738 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1b500eb580 con 0x7f1b5815dae0 2023-06-10T18:53:34.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.120+0000 7f1b6010d640 1 -- 172.21.15.53:0/1287466738 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1b5804d790 con 0x7f1b5815dae0 2023-06-10T18:53:34.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.124+0000 7f1b4e7fc640 1 -- 172.21.15.53:0/1287466738 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1b500eeba0 con 0x7f1b5815dae0 2023-06-10T18:53:34.132 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-06-10T18:53:34.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.124+0000 7f1b6010d640 1 -- 172.21.15.53:0/1287466738 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1b3c066280 msgr2=0x7f1b3c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:34.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.124+0000 7f1b6010d640 1 --2- 172.21.15.53:0/1287466738 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1b3c066280 0x7f1b3c068730 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1b580b3e20 tx=0x7f1b54009040 comp rx=0 tx=0).stop 2023-06-10T18:53:34.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.124+0000 7f1b6010d640 1 -- 172.21.15.53:0/1287466738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b5815dae0 msgr2=0x7f1b580cb820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:34.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.124+0000 7f1b6010d640 1 --2- 172.21.15.53:0/1287466738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b5815dae0 0x7f1b580cb820 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f1b5001ab80 tx=0x7f1b50019270 comp rx=0 tx=0).stop 2023-06-10T18:53:34.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.124+0000 7f1b6010d640 1 -- 172.21.15.53:0/1287466738 shutdown_connections 2023-06-10T18:53:34.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.124+0000 7f1b6010d640 1 --2- 172.21.15.53:0/1287466738 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1b3c066280 0x7f1b3c068730 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:34.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.124+0000 7f1b6010d640 1 --2- 172.21.15.53:0/1287466738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b5815dae0 0x7f1b580cb820 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:34.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.124+0000 7f1b6010d640 1 --2- 172.21.15.53:0/1287466738 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b580af760 0x7f1b580c0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:34.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.124+0000 7f1b6010d640 1 --2- 172.21.15.53:0/1287466738 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b580700e0 0x7f1b580b2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:34.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.124+0000 7f1b6010d640 1 -- 172.21.15.53:0/1287466738 >> 172.21.15.53:0/1287466738 conn(0x7f1b5806a0e0 msgr2=0x7f1b580ad740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:34.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.124+0000 7f1b6010d640 1 -- 172.21.15.53:0/1287466738 shutdown_connections 2023-06-10T18:53:34.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.124+0000 7f1b6010d640 1 -- 172.21.15.53:0/1287466738 wait complete. 2023-06-10T18:53:34.151 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-10T18:53:34.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.260+0000 7fb5ee142640 1 Processor -- start 2023-06-10T18:53:34.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.260+0000 7fb5ee142640 1 -- start start 2023-06-10T18:53:34.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.260+0000 7fb5ee142640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb5e8070100 0x7fb5e80af7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:34.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.260+0000 7fb5ee142640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5e8071190 con 0x7fb5e81571a0 2023-06-10T18:53:34.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.260+0000 7fb5ee142640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5e8070580 con 0x7fb5e80afd10 2023-06-10T18:53:34.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.260+0000 7fb5ee142640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5e80b01b0 con 0x7fb5e8070100 2023-06-10T18:53:34.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.260+0000 7fb5e77fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fb5e81571a0 0x7fb5e80c9f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:55880/0 (socket says 172.21.15.53:55880) 2023-06-10T18:53:34.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.260+0000 7fb5e77fe640 1 -- 172.21.15.53:0/3905195432 learned_addr learned my addr 172.21.15.53:0/3905195432 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:53:34.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.260+0000 7fb5e6ffd640 1 --2- 172.21.15.53:0/3905195432 >> v2:172.21.15.117:3300/0 conn(0x7fb5e8070100 0x7fb5e80af7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:34.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.264+0000 7fb5e67fc640 1 -- 172.21.15.53:0/3905195432 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3170291561 0 0) 0x7fb5e8071190 con 0x7fb5e81571a0 2023-06-10T18:53:34.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.264+0000 7fb5e67fc640 1 -- 172.21.15.53:0/3905195432 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5d0003530 con 0x7fb5e81571a0 2023-06-10T18:53:34.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.264+0000 7fb5e67fc640 1 -- 172.21.15.53:0/3905195432 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3393118109 0 0) 0x7fb5d0003530 con 0x7fb5e81571a0 2023-06-10T18:53:34.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.264+0000 7fb5e67fc640 1 -- 172.21.15.53:0/3905195432 >> v2:172.21.15.117:3300/0 conn(0x7fb5e8070100 msgr2=0x7fb5e80af7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:34.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.264+0000 7fb5e67fc640 1 --2- 172.21.15.53:0/3905195432 >> v2:172.21.15.117:3300/0 conn(0x7fb5e8070100 0x7fb5e80af7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:34.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.264+0000 7fb5e67fc640 1 -- 172.21.15.53:0/3905195432 >> v1:172.21.15.117:6789/0 conn(0x7fb5e80afd10 legacy=0x7fb5e80c83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:34.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.264+0000 7fb5e67fc640 1 -- 172.21.15.53:0/3905195432 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5e8070860 con 0x7fb5e81571a0 2023-06-10T18:53:34.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.264+0000 7fb5e67fc640 1 -- 172.21.15.53:0/3905195432 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fb5d8001b80 con 0x7fb5e81571a0 2023-06-10T18:53:34.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.264+0000 7fb5e67fc640 1 -- 172.21.15.53:0/3905195432 >> v1:172.21.15.53:6789/0 conn(0x7fb5e81571a0 legacy=0x7fb5e80c9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:34.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.264+0000 7fb5e67fc640 1 --2- 172.21.15.53:0/3905195432 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5d0003980 0x7fb5d0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:34.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.264+0000 7fb5e67fc640 1 --2- 172.21.15.53:0/3905195432 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5d00047d0 0x7fb5d0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:34.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.264+0000 7fb5e67fc640 1 --2- 172.21.15.53:0/3905195432 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5d0005180 0x7fb5d000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:34.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.264+0000 7fb5e67fc640 1 -- 172.21.15.53:0/3905195432 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d000bfd0 con 0x7fb5d0003980 2023-06-10T18:53:34.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.264+0000 7fb5e67fc640 1 -- 172.21.15.53:0/3905195432 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d000c140 con 0x7fb5d00047d0 2023-06-10T18:53:34.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.264+0000 7fb5e67fc640 1 -- 172.21.15.53:0/3905195432 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d000c300 con 0x7fb5d0005180 2023-06-10T18:53:34.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.264+0000 7fb5e77fe640 1 --2- 172.21.15.53:0/3905195432 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5d0003980 0x7fb5d0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:34.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.264+0000 7fb5e6ffd640 1 --2- 172.21.15.53:0/3905195432 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5d00047d0 0x7fb5d0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:34.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.264+0000 7fb5e77fe640 1 -- 172.21.15.53:0/3905195432 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5d0005180 msgr2=0x7fb5d000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:34.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.264+0000 7fb5e7fff640 1 --2- 172.21.15.53:0/3905195432 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5d0005180 0x7fb5d000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:34.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.264+0000 7fb5e77fe640 1 --2- 172.21.15.53:0/3905195432 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5d0005180 0x7fb5d000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:34.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.264+0000 7fb5e77fe640 1 -- 172.21.15.53:0/3905195432 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5d00047d0 msgr2=0x7fb5d0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:34.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.264+0000 7fb5e77fe640 1 --2- 172.21.15.53:0/3905195432 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5d00047d0 0x7fb5d0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:34.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.264+0000 7fb5e77fe640 1 -- 172.21.15.53:0/3905195432 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5d0003530 con 0x7fb5d0003980 2023-06-10T18:53:34.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.264+0000 7fb5e6ffd640 1 --2- 172.21.15.53:0/3905195432 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5d00047d0 0x7fb5d0004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:53:34.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.264+0000 7fb5e7fff640 1 --2- 172.21.15.53:0/3905195432 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5d0005180 0x7fb5d000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:34.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.264+0000 7fb5e7fff640 1 -- 172.21.15.53:0/3905195432 reap_dead start 2023-06-10T18:53:34.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.264+0000 7fb5e77fe640 1 --2- 172.21.15.53:0/3905195432 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5d0003980 0x7fb5d0003d90 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fb5d800c520 tx=0x7fb5d801cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9ca34c3ad775f04 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:34.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.264+0000 7fb5e67fc640 1 -- 172.21.15.53:0/3905195432 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d8005d30 con 0x7fb5d0003980 2023-06-10T18:53:34.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.264+0000 7fb5e67fc640 1 -- 172.21.15.53:0/3905195432 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5d8005e90 con 0x7fb5d0003980 2023-06-10T18:53:34.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.264+0000 7fb5e67fc640 1 -- 172.21.15.53:0/3905195432 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d80a5c80 con 0x7fb5d0003980 2023-06-10T18:53:34.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.264+0000 7fb5ee142640 1 -- 172.21.15.53:0/3905195432 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5d0003980 msgr2=0x7fb5d0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:34.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.264+0000 7fb5ee142640 1 --2- 172.21.15.53:0/3905195432 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5d0003980 0x7fb5d0003d90 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fb5d800c520 tx=0x7fb5d801cf70 comp rx=0 tx=0).stop 2023-06-10T18:53:34.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.264+0000 7fb5ee142640 1 -- 172.21.15.53:0/3905195432 shutdown_connections 2023-06-10T18:53:34.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.264+0000 7fb5ee142640 1 --2- 172.21.15.53:0/3905195432 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5d0003980 0x7fb5d0003d90 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:34.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.264+0000 7fb5ee142640 1 -- 172.21.15.53:0/3905195432 >> 172.21.15.53:0/3905195432 conn(0x7fb5e80ce9e0 msgr2=0x7fb5e80ca7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:34.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.264+0000 7fb5ee142640 1 -- 172.21.15.53:0/3905195432 shutdown_connections 2023-06-10T18:53:34.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.264+0000 7fb5ee142640 1 -- 172.21.15.53:0/3905195432 wait complete. 2023-06-10T18:53:34.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.268+0000 7fb5ee142640 1 Processor -- start 2023-06-10T18:53:34.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.268+0000 7fb5ee142640 1 -- start start 2023-06-10T18:53:34.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.268+0000 7fb5ee142640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5d0003980 0x7fb5e80c3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:34.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.268+0000 7fb5ee142640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5e80ab860 0x7fb5e80c3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:34.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.268+0000 7fb5ee142640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5e80ace70 0x7fb5e806aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:34.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.268+0000 7fb5ee142640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e80abdd0 con 0x7fb5d0003980 2023-06-10T18:53:34.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.268+0000 7fb5ee142640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e80ac0b0 con 0x7fb5e80ab860 2023-06-10T18:53:34.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.268+0000 7fb5ee142640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e80ac390 con 0x7fb5e80ace70 2023-06-10T18:53:34.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.268+0000 7fb5e77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5d0003980 0x7fb5e80c3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:34.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.268+0000 7fb5e77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5d0003980 0x7fb5e80c3610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36884/0 (socket says 172.21.15.53:36884) 2023-06-10T18:53:34.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.268+0000 7fb5e77fe640 1 -- 172.21.15.53:0/685634466 learned_addr learned my addr 172.21.15.53:0/685634466 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:34.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.268+0000 7fb5e77fe640 1 -- 172.21.15.53:0/685634466 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5e80ace70 msgr2=0x7fb5e806aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:34.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.268+0000 7fb5e77fe640 1 --2- 172.21.15.53:0/685634466 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5e80ace70 0x7fb5e806aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:34.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.268+0000 7fb5e6ffd640 1 --2- 172.21.15.53:0/685634466 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5e80ab860 0x7fb5e80c3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:34.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.268+0000 7fb5e77fe640 1 -- 172.21.15.53:0/685634466 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5e80ab860 msgr2=0x7fb5e80c3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:34.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.268+0000 7fb5e77fe640 1 --2- 172.21.15.53:0/685634466 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5e80ab860 0x7fb5e80c3b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:34.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.268+0000 7fb5e77fe640 1 -- 172.21.15.53:0/685634466 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5e80ac670 con 0x7fb5d0003980 2023-06-10T18:53:34.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.268+0000 7fb5e6ffd640 1 --2- 172.21.15.53:0/685634466 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5e80ab860 0x7fb5e80c3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:34.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.268+0000 7fb5e77fe640 1 --2- 172.21.15.53:0/685634466 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5d0003980 0x7fb5e80c3610 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fb5d8001280 tx=0x7fb5d0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:34.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.268+0000 7fb5cffff640 1 -- 172.21.15.53:0/685634466 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d80b3070 con 0x7fb5d0003980 2023-06-10T18:53:34.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.268+0000 7fb5cffff640 1 -- 172.21.15.53:0/685634466 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5d8005b30 con 0x7fb5d0003980 2023-06-10T18:53:34.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.268+0000 7fb5ee142640 1 -- 172.21.15.53:0/685634466 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5e80ac950 con 0x7fb5d0003980 2023-06-10T18:53:34.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.268+0000 7fb5cffff640 1 -- 172.21.15.53:0/685634466 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d80a5c80 con 0x7fb5d0003980 2023-06-10T18:53:34.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.268+0000 7fb5ee142640 1 -- 172.21.15.53:0/685634466 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5e806b1d0 con 0x7fb5d0003980 2023-06-10T18:53:34.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.268+0000 7fb5ee142640 1 -- 172.21.15.53:0/685634466 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5e80acb90 con 0x7fb5d0003980 2023-06-10T18:53:34.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.272+0000 7fb5cffff640 1 -- 172.21.15.53:0/685634466 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb5d8007070 con 0x7fb5d0003980 2023-06-10T18:53:34.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.272+0000 7fb5cffff640 1 --2- 172.21.15.53:0/685634466 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb5d4066280 0x7fb5d4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:34.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.272+0000 7fb5cffff640 1 -- 172.21.15.53:0/685634466 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fb5d811d440 con 0x7fb5d0003980 2023-06-10T18:53:34.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.272+0000 7fb5e6ffd640 1 --2- 172.21.15.53:0/685634466 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb5d4066280 0x7fb5d4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:34.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.272+0000 7fb5e6ffd640 1 --2- 172.21.15.53:0/685634466 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb5d4066280 0x7fb5d4068730 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb5e80ad480 tx=0x7fb5dc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:34.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.276+0000 7fb5cffff640 1 -- 172.21.15.53:0/685634466 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb5e80acb90 con 0x7fb5d0003980 2023-06-10T18:53:34.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.440+0000 7fb5ee142640 1 -- 172.21.15.53:0/685634466 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb5e80acb90 con 0x7fb5d0003980 2023-06-10T18:53:34.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.440+0000 7fb5cffff640 1 -- 172.21.15.53:0/685634466 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb5e80acb90 con 0x7fb5d0003980 2023-06-10T18:53:34.450 INFO:teuthology.orchestra.run.smithi053.stderr:listed 0 entries 2023-06-10T18:53:34.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.444+0000 7fb5ee142640 1 -- 172.21.15.53:0/685634466 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb5d4066280 msgr2=0x7fb5d4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:34.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.444+0000 7fb5ee142640 1 --2- 172.21.15.53:0/685634466 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb5d4066280 0x7fb5d4068730 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb5e80ad480 tx=0x7fb5dc008040 comp rx=0 tx=0).stop 2023-06-10T18:53:34.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.444+0000 7fb5ee142640 1 -- 172.21.15.53:0/685634466 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5d0003980 msgr2=0x7fb5e80c3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:34.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.444+0000 7fb5ee142640 1 --2- 172.21.15.53:0/685634466 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5d0003980 0x7fb5e80c3610 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fb5d8001280 tx=0x7fb5d0005800 comp rx=0 tx=0).stop 2023-06-10T18:53:34.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.444+0000 7fb5ee142640 1 -- 172.21.15.53:0/685634466 shutdown_connections 2023-06-10T18:53:34.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.444+0000 7fb5ee142640 1 --2- 172.21.15.53:0/685634466 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb5d4066280 0x7fb5d4068730 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:34.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.444+0000 7fb5ee142640 1 --2- 172.21.15.53:0/685634466 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5e80ace70 0x7fb5e806aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:34.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.444+0000 7fb5ee142640 1 --2- 172.21.15.53:0/685634466 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5e80ab860 0x7fb5e80c3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:34.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.444+0000 7fb5ee142640 1 --2- 172.21.15.53:0/685634466 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5d0003980 0x7fb5e80c3610 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:34.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.444+0000 7fb5ee142640 1 -- 172.21.15.53:0/685634466 >> 172.21.15.53:0/685634466 conn(0x7fb5e80ce9e0 msgr2=0x7fb5e80cc2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:34.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.444+0000 7fb5ee142640 1 -- 172.21.15.53:0/685634466 shutdown_connections 2023-06-10T18:53:34.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.444+0000 7fb5ee142640 1 -- 172.21.15.53:0/685634466 wait complete. 2023-06-10T18:53:34.470 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T18:53:34.470 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T18:53:34.476 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T18:53:34.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.624+0000 7fda072e6640 1 Processor -- start 2023-06-10T18:53:34.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.624+0000 7fda072e6640 1 -- start start 2023-06-10T18:53:34.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.624+0000 7fda072e6640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fda000ccae0 0x7fda000d0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:34.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.624+0000 7fda072e6640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda000d0020 con 0x7fda000b3ac0 2023-06-10T18:53:34.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.624+0000 7fda072e6640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda000cef40 con 0x7fda000cc690 2023-06-10T18:53:34.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.624+0000 7fda072e6640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda000cf220 con 0x7fda000ccae0 2023-06-10T18:53:34.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.624+0000 7fda05883640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fda000ccae0 0x7fda000d0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:34.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.624+0000 7fda05082640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fda000b3ac0 0x7fda000b3e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:55890/0 (socket says 172.21.15.53:55890) 2023-06-10T18:53:34.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.624+0000 7fda05082640 1 -- 172.21.15.53:0/1363763741 learned_addr learned my addr 172.21.15.53:0/1363763741 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:53:34.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.624+0000 7fda05883640 1 --2- 172.21.15.53:0/1363763741 >> v2:172.21.15.53:3300/0 conn(0x7fda000ccae0 0x7fda000d0bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36886/0 (socket says 172.21.15.53:36886) 2023-06-10T18:53:34.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.624+0000 7fd9f7fff640 1 -- 172.21.15.53:0/1363763741 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4114520610 0 0) 0x7fda000d0020 con 0x7fda000b3ac0 2023-06-10T18:53:34.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.624+0000 7fda05883640 1 -- 172.21.15.53:0/1363763741 >> v1:172.21.15.117:6789/0 conn(0x7fda000cc690 legacy=0x7fda000d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:34.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.624+0000 7fda05883640 1 -- 172.21.15.53:0/1363763741 >> v1:172.21.15.53:6789/0 conn(0x7fda000b3ac0 legacy=0x7fda000b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:34.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.624+0000 7fda05883640 1 -- 172.21.15.53:0/1363763741 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda000cf500 con 0x7fda000ccae0 2023-06-10T18:53:34.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.628+0000 7fda05883640 1 --2- 172.21.15.53:0/1363763741 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda000ccae0 0x7fda000d0bc0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fd9f8009d90 tx=0x7fd9f801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8db87405dab2f8a6 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:34.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.628+0000 7fd9f7fff640 1 -- 172.21.15.53:0/1363763741 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f80a5a00 con 0x7fda000ccae0 2023-06-10T18:53:34.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.628+0000 7fd9f7fff640 1 -- 172.21.15.53:0/1363763741 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9f80a5b60 con 0x7fda000ccae0 2023-06-10T18:53:34.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.628+0000 7fd9f7fff640 1 -- 172.21.15.53:0/1363763741 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f80ad440 con 0x7fda000ccae0 2023-06-10T18:53:34.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.628+0000 7fda072e6640 1 -- 172.21.15.53:0/1363763741 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda000ccae0 msgr2=0x7fda000d0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:34.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.628+0000 7fda072e6640 1 --2- 172.21.15.53:0/1363763741 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda000ccae0 0x7fda000d0bc0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fd9f8009d90 tx=0x7fd9f801c920 comp rx=0 tx=0).stop 2023-06-10T18:53:34.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.628+0000 7fda072e6640 1 -- 172.21.15.53:0/1363763741 shutdown_connections 2023-06-10T18:53:34.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.628+0000 7fda072e6640 1 --2- 172.21.15.53:0/1363763741 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda000ccae0 0x7fda000d0bc0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:34.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.628+0000 7fda072e6640 1 -- 172.21.15.53:0/1363763741 >> 172.21.15.53:0/1363763741 conn(0x7fda00071790 msgr2=0x7fda00069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:34.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.628+0000 7fda072e6640 1 -- 172.21.15.53:0/1363763741 shutdown_connections 2023-06-10T18:53:34.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.628+0000 7fda072e6640 1 -- 172.21.15.53:0/1363763741 wait complete. 2023-06-10T18:53:34.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.628+0000 7fda072e6640 1 Processor -- start 2023-06-10T18:53:34.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.628+0000 7fda072e6640 1 -- start start 2023-06-10T18:53:34.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.628+0000 7fda072e6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda000b3ac0 0x7fda00156770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:34.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.628+0000 7fda072e6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda000cc690 0x7fda000b1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:34.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.628+0000 7fda072e6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda000ccae0 0x7fda000c61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:34.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.628+0000 7fda072e6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda0015e0e0 con 0x7fda000cc690 2023-06-10T18:53:34.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.628+0000 7fda072e6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda0015be00 con 0x7fda000ccae0 2023-06-10T18:53:34.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.628+0000 7fda072e6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda0015c0a0 con 0x7fda000b3ac0 2023-06-10T18:53:34.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.628+0000 7fda04881640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda000cc690 0x7fda000b1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:34.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.628+0000 7fda04881640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda000cc690 0x7fda000b1e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36900/0 (socket says 172.21.15.53:36900) 2023-06-10T18:53:34.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.628+0000 7fda04881640 1 -- 172.21.15.53:0/344893453 learned_addr learned my addr 172.21.15.53:0/344893453 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:34.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.632+0000 7fda05082640 1 --2- 172.21.15.53:0/344893453 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda000b3ac0 0x7fda00156770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:34.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.632+0000 7fda05883640 1 --2- 172.21.15.53:0/344893453 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda000ccae0 0x7fda000c61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:34.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.632+0000 7fda04881640 1 -- 172.21.15.53:0/344893453 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda000b3ac0 msgr2=0x7fda00156770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:34.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.632+0000 7fda04881640 1 --2- 172.21.15.53:0/344893453 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda000b3ac0 0x7fda00156770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:34.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.632+0000 7fda04881640 1 -- 172.21.15.53:0/344893453 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda000ccae0 msgr2=0x7fda000c61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:34.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.632+0000 7fda04881640 1 --2- 172.21.15.53:0/344893453 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda000ccae0 0x7fda000c61a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:34.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.632+0000 7fda04881640 1 -- 172.21.15.53:0/344893453 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9f8009a70 con 0x7fda000cc690 2023-06-10T18:53:34.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.632+0000 7fda05082640 1 --2- 172.21.15.53:0/344893453 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda000b3ac0 0x7fda00156770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:34.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.632+0000 7fda05883640 1 --2- 172.21.15.53:0/344893453 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda000ccae0 0x7fda000c61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:34.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.632+0000 7fda04881640 1 --2- 172.21.15.53:0/344893453 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda000cc690 0x7fda000b1e90 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fd9f000c500 tx=0x7fd9f000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:34.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.632+0000 7fd9f5ffb640 1 -- 172.21.15.53:0/344893453 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f0005220 con 0x7fda000cc690 2023-06-10T18:53:34.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.632+0000 7fd9f5ffb640 1 -- 172.21.15.53:0/344893453 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9f0005380 con 0x7fda000cc690 2023-06-10T18:53:34.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.632+0000 7fd9f5ffb640 1 -- 172.21.15.53:0/344893453 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f0007270 con 0x7fda000cc690 2023-06-10T18:53:34.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.632+0000 7fda072e6640 1 -- 172.21.15.53:0/344893453 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda0015d840 con 0x7fda000cc690 2023-06-10T18:53:34.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.632+0000 7fda072e6640 1 -- 172.21.15.53:0/344893453 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda0015de00 con 0x7fda000cc690 2023-06-10T18:53:34.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.632+0000 7fda072e6640 1 -- 172.21.15.53:0/344893453 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda0015c250 con 0x7fda000cc690 2023-06-10T18:53:34.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.632+0000 7fd9f5ffb640 1 -- 172.21.15.53:0/344893453 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd9f00073d0 con 0x7fda000cc690 2023-06-10T18:53:34.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.632+0000 7fd9f5ffb640 1 --2- 172.21.15.53:0/344893453 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd9e4066280 0x7fd9e4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:34.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.632+0000 7fd9f5ffb640 1 -- 172.21.15.53:0/344893453 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fd9f00833d0 con 0x7fda000cc690 2023-06-10T18:53:34.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.632+0000 7fda05082640 1 --2- 172.21.15.53:0/344893453 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd9e4066280 0x7fd9e4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:34.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.632+0000 7fda05082640 1 --2- 172.21.15.53:0/344893453 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd9e4066280 0x7fd9e4068730 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc000f70 tx=0x7fd9fc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:34.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.636+0000 7fd9f5ffb640 1 -- 172.21.15.53:0/344893453 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fda0015c250 con 0x7fda000cc690 2023-06-10T18:53:34.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.784+0000 7fda072e6640 1 -- 172.21.15.53:0/344893453 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fda0015c210 con 0x7fda000cc690 2023-06-10T18:53:34.795 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.788+0000 7fd9f5ffb640 1 -- 172.21.15.53:0/344893453 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18363 (secure 0 0 0) 0x7fd9f0050780 con 0x7fda000cc690 2023-06-10T18:53:34.796 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:53:34.796 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":25,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T18:53:27.127355+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-10T18:52:43.396243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-10T18:52:43.894228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.23","mappings":[{"from":3,"to":2}]},{"pgid":"4.3e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T18:53:34.797 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.788+0000 7fda072e6640 1 -- 172.21.15.53:0/344893453 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd9e4066280 msgr2=0x7fd9e4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:34.798 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.788+0000 7fda072e6640 1 --2- 172.21.15.53:0/344893453 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd9e4066280 0x7fd9e4068730 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc000f70 tx=0x7fd9fc009040 comp rx=0 tx=0).stop 2023-06-10T18:53:34.798 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.788+0000 7fda072e6640 1 -- 172.21.15.53:0/344893453 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda000cc690 msgr2=0x7fda000b1e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:34.798 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.788+0000 7fda072e6640 1 --2- 172.21.15.53:0/344893453 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda000cc690 0x7fda000b1e90 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fd9f000c500 tx=0x7fd9f000c9c0 comp rx=0 tx=0).stop 2023-06-10T18:53:34.798 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.788+0000 7fda072e6640 1 -- 172.21.15.53:0/344893453 shutdown_connections 2023-06-10T18:53:34.798 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.788+0000 7fda072e6640 1 --2- 172.21.15.53:0/344893453 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd9e4066280 0x7fd9e4068730 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:34.798 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.788+0000 7fda072e6640 1 --2- 172.21.15.53:0/344893453 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda000ccae0 0x7fda000c61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:34.799 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.788+0000 7fda072e6640 1 --2- 172.21.15.53:0/344893453 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda000cc690 0x7fda000b1e90 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:34.799 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.788+0000 7fda072e6640 1 --2- 172.21.15.53:0/344893453 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda000b3ac0 0x7fda00156770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:34.799 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.788+0000 7fda072e6640 1 -- 172.21.15.53:0/344893453 >> 172.21.15.53:0/344893453 conn(0x7fda00071790 msgr2=0x7fda00069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:34.799 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.788+0000 7fda072e6640 1 -- 172.21.15.53:0/344893453 shutdown_connections 2023-06-10T18:53:34.799 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.788+0000 7fda072e6640 1 -- 172.21.15.53:0/344893453 wait complete. 2023-06-10T18:53:34.813 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-10T18:52:33.633114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-10T18:52:39.171487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-10T18:52:43.396243+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-10T18:52:43.894228+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-10T18:53:34.814 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-10T18:53:34.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.932+0000 7f93adde4640 1 Processor -- start 2023-06-10T18:53:34.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.932+0000 7f93adde4640 1 -- start start 2023-06-10T18:53:34.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.932+0000 7f93adde4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93a815c090 0x7f93a80b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:34.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.932+0000 7f93adde4640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93a80cc7c0 con 0x7f93a80b0b90 2023-06-10T18:53:34.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.932+0000 7f93adde4640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93a80ccaa0 con 0x7f93a80b7e30 2023-06-10T18:53:34.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.932+0000 7f93adde4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93a80ccd80 con 0x7f93a815c090 2023-06-10T18:53:34.944 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.932+0000 7f93a6ffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f93a80b0b90 0x7f93a80b7720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:55904/0 (socket says 172.21.15.53:55904) 2023-06-10T18:53:34.944 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.932+0000 7f93a6ffd640 1 -- 172.21.15.53:0/1459157168 learned_addr learned my addr 172.21.15.53:0/1459157168 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:53:34.944 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.932+0000 7f93a77fe640 1 --2- 172.21.15.53:0/1459157168 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93a815c090 0x7f93a80b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:34.944 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.932+0000 7f93a67fc640 1 -- 172.21.15.53:0/1459157168 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1846037786 0 0) 0x7f93a80cc7c0 con 0x7f93a80b0b90 2023-06-10T18:53:34.944 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.932+0000 7f93a67fc640 1 -- 172.21.15.53:0/1459157168 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9390003530 con 0x7f93a80b0b90 2023-06-10T18:53:34.944 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.932+0000 7f93a67fc640 1 -- 172.21.15.53:0/1459157168 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3011530922 0 0) 0x7f9390003530 con 0x7f93a80b0b90 2023-06-10T18:53:34.944 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.932+0000 7f93a67fc640 1 -- 172.21.15.53:0/1459157168 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93a815c090 msgr2=0x7f93a80b10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:34.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.932+0000 7f93a67fc640 1 --2- 172.21.15.53:0/1459157168 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93a815c090 0x7f93a80b10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:34.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.932+0000 7f93a67fc640 1 -- 172.21.15.53:0/1459157168 >> v1:172.21.15.117:6789/0 conn(0x7f93a80b7e30 legacy=0x7f93a80d04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:34.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.932+0000 7f93a67fc640 1 -- 172.21.15.53:0/1459157168 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93a80cd060 con 0x7f93a80b0b90 2023-06-10T18:53:34.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.932+0000 7f93a67fc640 1 -- 172.21.15.53:0/1459157168 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f939c001680 con 0x7f93a80b0b90 2023-06-10T18:53:34.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.932+0000 7f93a67fc640 1 -- 172.21.15.53:0/1459157168 >> v1:172.21.15.53:6789/0 conn(0x7f93a80b0b90 legacy=0x7f93a80b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:34.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.932+0000 7f93a67fc640 1 --2- 172.21.15.53:0/1459157168 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93900039b0 0x7f9390003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:34.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.932+0000 7f93a67fc640 1 --2- 172.21.15.53:0/1459157168 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93900047d0 0x7f9390004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:34.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.932+0000 7f93a67fc640 1 --2- 172.21.15.53:0/1459157168 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93a815c090 0x7f93900051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:34.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.932+0000 7f93a67fc640 1 -- 172.21.15.53:0/1459157168 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93a80ccd80 con 0x7f93900047d0 2023-06-10T18:53:34.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.932+0000 7f93a67fc640 1 -- 172.21.15.53:0/1459157168 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f939000ba90 con 0x7f93900039b0 2023-06-10T18:53:34.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.932+0000 7f93a67fc640 1 -- 172.21.15.53:0/1459157168 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f939000bc50 con 0x7f93a815c090 2023-06-10T18:53:34.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.932+0000 7f93a6ffd640 1 --2- 172.21.15.53:0/1459157168 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93900047d0 0x7f9390004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:34.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.932+0000 7f93a77fe640 1 --2- 172.21.15.53:0/1459157168 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93900039b0 0x7f9390003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:34.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.932+0000 7f93a6ffd640 1 -- 172.21.15.53:0/1459157168 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93a815c090 msgr2=0x7f93900051a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:34.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.932+0000 7f93a7fff640 1 --2- 172.21.15.53:0/1459157168 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93a815c090 0x7f93900051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:34.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.932+0000 7f93a6ffd640 1 --2- 172.21.15.53:0/1459157168 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93a815c090 0x7f93900051a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:34.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.932+0000 7f93a6ffd640 1 -- 172.21.15.53:0/1459157168 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93900039b0 msgr2=0x7f9390003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:34.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.932+0000 7f93a6ffd640 1 --2- 172.21.15.53:0/1459157168 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93900039b0 0x7f9390003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:34.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.932+0000 7f93a6ffd640 1 -- 172.21.15.53:0/1459157168 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9390003530 con 0x7f93900047d0 2023-06-10T18:53:34.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.932+0000 7f93a7fff640 1 --2- 172.21.15.53:0/1459157168 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93a815c090 0x7f93900051a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:34.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.936+0000 7f93a6ffd640 1 --2- 172.21.15.53:0/1459157168 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93900047d0 0x7f9390004c40 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f939c00c240 tx=0x7f939c01cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=772a74562bcfa6fc server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:34.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.936+0000 7f93a67fc640 1 -- 172.21.15.53:0/1459157168 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939c005ae0 con 0x7f93900047d0 2023-06-10T18:53:34.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.936+0000 7f93a67fc640 1 -- 172.21.15.53:0/1459157168 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f939c005c40 con 0x7f93900047d0 2023-06-10T18:53:34.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.936+0000 7f93a67fc640 1 -- 172.21.15.53:0/1459157168 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939c0a5800 con 0x7f93900047d0 2023-06-10T18:53:34.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.936+0000 7f93adde4640 1 -- 172.21.15.53:0/1459157168 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93900047d0 msgr2=0x7f9390004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:34.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.936+0000 7f93adde4640 1 --2- 172.21.15.53:0/1459157168 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93900047d0 0x7f9390004c40 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f939c00c240 tx=0x7f939c01cc10 comp rx=0 tx=0).stop 2023-06-10T18:53:34.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.936+0000 7f93a7fff640 1 -- 172.21.15.53:0/1459157168 reap_dead start 2023-06-10T18:53:34.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.936+0000 7f93adde4640 1 -- 172.21.15.53:0/1459157168 shutdown_connections 2023-06-10T18:53:34.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.936+0000 7f93adde4640 1 -- 172.21.15.53:0/1459157168 >> 172.21.15.53:0/1459157168 conn(0x7f93a8069e20 msgr2=0x7f93a806a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:34.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.936+0000 7f93adde4640 1 -- 172.21.15.53:0/1459157168 shutdown_connections 2023-06-10T18:53:34.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.936+0000 7f93adde4640 1 -- 172.21.15.53:0/1459157168 wait complete. 2023-06-10T18:53:34.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.936+0000 7f93adde4640 1 Processor -- start 2023-06-10T18:53:34.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.936+0000 7f93adde4640 1 -- start start 2023-06-10T18:53:34.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.940+0000 7f93adde4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93900047d0 0x7f93a80b3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:34.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.940+0000 7f93adde4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93a8149460 0x7f93a815acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:34.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.940+0000 7f93adde4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93a815b210 0x7f93a815d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:34.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.940+0000 7f93adde4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93a815b680 con 0x7f93a8149460 2023-06-10T18:53:34.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.940+0000 7f93adde4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93a80b2d10 con 0x7f93900047d0 2023-06-10T18:53:34.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.940+0000 7f93adde4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93a80b2f60 con 0x7f93a815b210 2023-06-10T18:53:34.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.940+0000 7f93a6ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93a8149460 0x7f93a815acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:34.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.940+0000 7f93a6ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93a8149460 0x7f93a815acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36922/0 (socket says 172.21.15.53:36922) 2023-06-10T18:53:34.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.940+0000 7f93a6ffd640 1 -- 172.21.15.53:0/1323180282 learned_addr learned my addr 172.21.15.53:0/1323180282 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:34.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.940+0000 7f93a77fe640 1 --2- 172.21.15.53:0/1323180282 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93900047d0 0x7f93a80b3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:34.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.940+0000 7f93a7fff640 1 --2- 172.21.15.53:0/1323180282 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93a815b210 0x7f93a815d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:34.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.940+0000 7f93a6ffd640 1 -- 172.21.15.53:0/1323180282 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93a815b210 msgr2=0x7f93a815d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:34.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.940+0000 7f93a6ffd640 1 --2- 172.21.15.53:0/1323180282 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93a815b210 0x7f93a815d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:34.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.940+0000 7f93a6ffd640 1 -- 172.21.15.53:0/1323180282 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93900047d0 msgr2=0x7f93a80b3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:34.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.940+0000 7f93a6ffd640 1 --2- 172.21.15.53:0/1323180282 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93900047d0 0x7f93a80b3d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:34.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.940+0000 7f93a6ffd640 1 -- 172.21.15.53:0/1323180282 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93a80b3240 con 0x7f93a8149460 2023-06-10T18:53:34.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.940+0000 7f93a77fe640 1 --2- 172.21.15.53:0/1323180282 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93900047d0 0x7f93a80b3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:53:34.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.940+0000 7f93a6ffd640 1 --2- 172.21.15.53:0/1323180282 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93a8149460 0x7f93a815acd0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f939c01ca40 tx=0x7f9390005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:34.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.940+0000 7f938ffff640 1 -- 172.21.15.53:0/1323180282 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939c0b4070 con 0x7f93a8149460 2023-06-10T18:53:34.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.940+0000 7f938ffff640 1 -- 172.21.15.53:0/1323180282 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f939c001440 con 0x7f93a8149460 2023-06-10T18:53:34.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.940+0000 7f93adde4640 1 -- 172.21.15.53:0/1323180282 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93a80b3520 con 0x7f93a8149460 2023-06-10T18:53:34.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.940+0000 7f938ffff640 1 -- 172.21.15.53:0/1323180282 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939c0a5800 con 0x7f93a8149460 2023-06-10T18:53:34.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.940+0000 7f93adde4640 1 -- 172.21.15.53:0/1323180282 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93a80b4260 con 0x7f93a8149460 2023-06-10T18:53:34.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.940+0000 7f93adde4640 1 -- 172.21.15.53:0/1323180282 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93a804d790 con 0x7f93a8149460 2023-06-10T18:53:34.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.940+0000 7f938ffff640 1 -- 172.21.15.53:0/1323180282 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f939c0a5960 con 0x7f93a8149460 2023-06-10T18:53:34.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.940+0000 7f938ffff640 1 --2- 172.21.15.53:0/1323180282 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f93940662b0 0x7f9394068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:34.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.940+0000 7f938ffff640 1 -- 172.21.15.53:0/1323180282 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f939c11d6c0 con 0x7f93a8149460 2023-06-10T18:53:34.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.940+0000 7f93a77fe640 1 --2- 172.21.15.53:0/1323180282 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f93940662b0 0x7f9394068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:34.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.944+0000 7f93a77fe640 1 --2- 172.21.15.53:0/1323180282 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f93940662b0 0x7f9394068760 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9398009af0 tx=0x7f9398008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:34.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:34.944+0000 7f938ffff640 1 -- 172.21.15.53:0/1323180282 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f939c0eab90 con 0x7f93a8149460 2023-06-10T18:53:35.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.100+0000 7f93adde4640 1 -- 172.21.15.53:0/1323180282 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f93a8072a60 con 0x7f93a8149460 2023-06-10T18:53:35.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.100+0000 7f938ffff640 1 -- 172.21.15.53:0/1323180282 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f939c0ad3c0 con 0x7f93a8149460 2023-06-10T18:53:35.110 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-06-10T18:53:35.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.104+0000 7f93adde4640 1 -- 172.21.15.53:0/1323180282 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f93940662b0 msgr2=0x7f9394068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:35.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.104+0000 7f93adde4640 1 --2- 172.21.15.53:0/1323180282 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f93940662b0 0x7f9394068760 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9398009af0 tx=0x7f9398008040 comp rx=0 tx=0).stop 2023-06-10T18:53:35.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.104+0000 7f93adde4640 1 -- 172.21.15.53:0/1323180282 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93a8149460 msgr2=0x7f93a815acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:35.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.104+0000 7f93adde4640 1 --2- 172.21.15.53:0/1323180282 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93a8149460 0x7f93a815acd0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f939c01ca40 tx=0x7f9390005800 comp rx=0 tx=0).stop 2023-06-10T18:53:35.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.104+0000 7f93adde4640 1 -- 172.21.15.53:0/1323180282 shutdown_connections 2023-06-10T18:53:35.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.104+0000 7f93adde4640 1 --2- 172.21.15.53:0/1323180282 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f93940662b0 0x7f9394068760 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:35.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.104+0000 7f93adde4640 1 --2- 172.21.15.53:0/1323180282 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93a815b210 0x7f93a815d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:35.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.104+0000 7f93adde4640 1 --2- 172.21.15.53:0/1323180282 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93a8149460 0x7f93a815acd0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:35.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.104+0000 7f93adde4640 1 --2- 172.21.15.53:0/1323180282 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93900047d0 0x7f93a80b3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:35.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.104+0000 7f93adde4640 1 -- 172.21.15.53:0/1323180282 >> 172.21.15.53:0/1323180282 conn(0x7f93a8069e20 msgr2=0x7f93a80b6750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:35.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.104+0000 7f93adde4640 1 -- 172.21.15.53:0/1323180282 shutdown_connections 2023-06-10T18:53:35.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.104+0000 7f93adde4640 1 -- 172.21.15.53:0/1323180282 wait complete. 2023-06-10T18:53:35.130 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-10T18:53:35.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.252+0000 7f505044e640 1 Processor -- start 2023-06-10T18:53:35.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.256+0000 7f505044e640 1 -- start start 2023-06-10T18:53:35.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.256+0000 7f505044e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50480af760 0x7f50480c9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:35.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.256+0000 7f505044e640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50480706f0 con 0x7f5048070b80 2023-06-10T18:53:35.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.256+0000 7f505044e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f504815ab10 con 0x7f50480afb30 2023-06-10T18:53:35.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.256+0000 7f505044e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50480700e0 con 0x7f50480af760 2023-06-10T18:53:35.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.256+0000 7f504e9eb640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f5048070b80 0x7f504806b090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:55914/0 (socket says 172.21.15.53:55914) 2023-06-10T18:53:35.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.256+0000 7f504e9eb640 1 -- 172.21.15.53:0/39973093 learned_addr learned my addr 172.21.15.53:0/39973093 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:53:35.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.256+0000 7f504e1ea640 1 --2- 172.21.15.53:0/39973093 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50480af760 0x7f50480c9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:35.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.256+0000 7f504d1e8640 1 -- 172.21.15.53:0/39973093 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 773932735 0 0) 0x7f50480706f0 con 0x7f5048070b80 2023-06-10T18:53:35.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.256+0000 7f504d1e8640 1 -- 172.21.15.53:0/39973093 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5034003530 con 0x7f5048070b80 2023-06-10T18:53:35.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.256+0000 7f504d1e8640 1 -- 172.21.15.53:0/39973093 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1619226622 0 0) 0x7f5034003530 con 0x7f5048070b80 2023-06-10T18:53:35.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.256+0000 7f504d1e8640 1 -- 172.21.15.53:0/39973093 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50480af760 msgr2=0x7f50480c9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:35.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.256+0000 7f504d1e8640 1 --2- 172.21.15.53:0/39973093 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50480af760 0x7f50480c9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:35.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.256+0000 7f504d1e8640 1 -- 172.21.15.53:0/39973093 >> v1:172.21.15.117:6789/0 conn(0x7f50480afb30 legacy=0x7f504815dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:35.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.256+0000 7f504d1e8640 1 -- 172.21.15.53:0/39973093 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50480c9e10 con 0x7f5048070b80 2023-06-10T18:53:35.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.256+0000 7f504d1e8640 1 -- 172.21.15.53:0/39973093 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f5040001680 con 0x7f5048070b80 2023-06-10T18:53:35.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.256+0000 7f504d1e8640 1 -- 172.21.15.53:0/39973093 >> v1:172.21.15.53:6789/0 conn(0x7f5048070b80 legacy=0x7f504806b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:35.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.256+0000 7f504d1e8640 1 --2- 172.21.15.53:0/39973093 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50340039b0 0x7f5034003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:35.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.256+0000 7f504d1e8640 1 --2- 172.21.15.53:0/39973093 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50480af760 0x7f50340047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:35.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.256+0000 7f504d1e8640 1 --2- 172.21.15.53:0/39973093 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5034004d10 0x7f5034005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:35.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.256+0000 7f504d1e8640 1 -- 172.21.15.53:0/39973093 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50480700e0 con 0x7f5034004d10 2023-06-10T18:53:35.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.256+0000 7f504d1e8640 1 -- 172.21.15.53:0/39973093 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f503400ba70 con 0x7f50340039b0 2023-06-10T18:53:35.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.256+0000 7f504d1e8640 1 -- 172.21.15.53:0/39973093 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f503400bc30 con 0x7f50480af760 2023-06-10T18:53:35.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.256+0000 7f504e9eb640 1 --2- 172.21.15.53:0/39973093 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5034004d10 0x7f5034005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:35.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.256+0000 7f504e1ea640 1 --2- 172.21.15.53:0/39973093 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50340039b0 0x7f5034003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:35.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.256+0000 7f504e9eb640 1 -- 172.21.15.53:0/39973093 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50480af760 msgr2=0x7f50340047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:35.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.256+0000 7f504d9e9640 1 --2- 172.21.15.53:0/39973093 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50480af760 0x7f50340047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:35.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.256+0000 7f504e9eb640 1 --2- 172.21.15.53:0/39973093 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50480af760 0x7f50340047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:35.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.256+0000 7f504e9eb640 1 -- 172.21.15.53:0/39973093 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50340039b0 msgr2=0x7f5034003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:35.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.256+0000 7f504e9eb640 1 --2- 172.21.15.53:0/39973093 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50340039b0 0x7f5034003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:35.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.256+0000 7f504e9eb640 1 -- 172.21.15.53:0/39973093 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5034003530 con 0x7f5034004d10 2023-06-10T18:53:35.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.260+0000 7f504e9eb640 1 --2- 172.21.15.53:0/39973093 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5034004d10 0x7f5034005180 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f504000c0e0 tx=0x7f504001cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95de0769effbc7e9 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:35.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.260+0000 7f504d1e8640 1 -- 172.21.15.53:0/39973093 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5040005ae0 con 0x7f5034004d10 2023-06-10T18:53:35.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.260+0000 7f504d1e8640 1 -- 172.21.15.53:0/39973093 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5040005c40 con 0x7f5034004d10 2023-06-10T18:53:35.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.260+0000 7f504d1e8640 1 -- 172.21.15.53:0/39973093 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50400a5860 con 0x7f5034004d10 2023-06-10T18:53:35.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.260+0000 7f505044e640 1 -- 172.21.15.53:0/39973093 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5034004d10 msgr2=0x7f5034005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:35.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.260+0000 7f505044e640 1 --2- 172.21.15.53:0/39973093 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5034004d10 0x7f5034005180 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f504000c0e0 tx=0x7f504001cb60 comp rx=0 tx=0).stop 2023-06-10T18:53:35.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.260+0000 7f504e9eb640 1 -- 172.21.15.53:0/39973093 reap_dead start 2023-06-10T18:53:35.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.260+0000 7f505044e640 1 -- 172.21.15.53:0/39973093 shutdown_connections 2023-06-10T18:53:35.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.260+0000 7f505044e640 1 -- 172.21.15.53:0/39973093 >> 172.21.15.53:0/39973093 conn(0x7f504806a0e0 msgr2=0x7f50480cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:35.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.260+0000 7f505044e640 1 -- 172.21.15.53:0/39973093 shutdown_connections 2023-06-10T18:53:35.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.260+0000 7f505044e640 1 -- 172.21.15.53:0/39973093 wait complete. 2023-06-10T18:53:35.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.260+0000 7f505044e640 1 Processor -- start 2023-06-10T18:53:35.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.260+0000 7f505044e640 1 -- start start 2023-06-10T18:53:35.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.260+0000 7f505044e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50481ee870 0x7f50480ae350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:35.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.260+0000 7f505044e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5048151d90 0x7f50480c6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:35.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.260+0000 7f505044e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50480c7430 0x7f50481f2400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:35.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.260+0000 7f505044e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5048152200 con 0x7f50481ee870 2023-06-10T18:53:35.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.260+0000 7f505044e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50480c78a0 con 0x7f50480c7430 2023-06-10T18:53:35.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.260+0000 7f505044e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50480c2510 con 0x7f5048151d90 2023-06-10T18:53:35.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.260+0000 7f504e1ea640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50481ee870 0x7f50480ae350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:35.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.260+0000 7f504e1ea640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50481ee870 0x7f50480ae350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36946/0 (socket says 172.21.15.53:36946) 2023-06-10T18:53:35.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.264+0000 7f504e1ea640 1 -- 172.21.15.53:0/32103008 learned_addr learned my addr 172.21.15.53:0/32103008 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:35.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.264+0000 7f504d9e9640 1 --2- 172.21.15.53:0/32103008 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5048151d90 0x7f50480c6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:35.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.264+0000 7f504e9eb640 1 --2- 172.21.15.53:0/32103008 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50480c7430 0x7f50481f2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:35.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.264+0000 7f504e1ea640 1 -- 172.21.15.53:0/32103008 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5048151d90 msgr2=0x7f50480c6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:35.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.264+0000 7f504e1ea640 1 --2- 172.21.15.53:0/32103008 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5048151d90 0x7f50480c6ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:35.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.264+0000 7f504e1ea640 1 -- 172.21.15.53:0/32103008 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50480c7430 msgr2=0x7f50481f2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:35.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.264+0000 7f504e1ea640 1 --2- 172.21.15.53:0/32103008 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50480c7430 0x7f50481f2400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:35.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.264+0000 7f504e1ea640 1 -- 172.21.15.53:0/32103008 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50480c1900 con 0x7f50481ee870 2023-06-10T18:53:35.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.264+0000 7f504d9e9640 1 --2- 172.21.15.53:0/32103008 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5048151d90 0x7f50480c6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:53:35.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.264+0000 7f504e1ea640 1 --2- 172.21.15.53:0/32103008 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50481ee870 0x7f50480ae350 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f5044011e90 tx=0x7f504400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:35.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.264+0000 7f503effd640 1 -- 172.21.15.53:0/32103008 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f504400e040 con 0x7f50481ee870 2023-06-10T18:53:35.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.264+0000 7f503effd640 1 -- 172.21.15.53:0/32103008 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f504400f040 con 0x7f50481ee870 2023-06-10T18:53:35.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.264+0000 7f505044e640 1 -- 172.21.15.53:0/32103008 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50480c1be0 con 0x7f50481ee870 2023-06-10T18:53:35.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.264+0000 7f503effd640 1 -- 172.21.15.53:0/32103008 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5044015850 con 0x7f50481ee870 2023-06-10T18:53:35.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.264+0000 7f505044e640 1 -- 172.21.15.53:0/32103008 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50480c21a0 con 0x7f50481ee870 2023-06-10T18:53:35.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.264+0000 7f505044e640 1 -- 172.21.15.53:0/32103008 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f504804d790 con 0x7f50481ee870 2023-06-10T18:53:35.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.264+0000 7f503effd640 1 -- 172.21.15.53:0/32103008 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f50440159b0 con 0x7f50481ee870 2023-06-10T18:53:35.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.264+0000 7f503effd640 1 --2- 172.21.15.53:0/32103008 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f502c066280 0x7f502c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:35.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.264+0000 7f503effd640 1 -- 172.21.15.53:0/32103008 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f5044084b30 con 0x7f50481ee870 2023-06-10T18:53:35.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.264+0000 7f504d9e9640 1 --2- 172.21.15.53:0/32103008 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f502c066280 0x7f502c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:35.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.264+0000 7f504d9e9640 1 --2- 172.21.15.53:0/32103008 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f502c066280 0x7f502c068730 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f50480c48d0 tx=0x7f5038009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:35.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.268+0000 7f503effd640 1 -- 172.21.15.53:0/32103008 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5044051f70 con 0x7f50481ee870 2023-06-10T18:53:35.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.424+0000 7f505044e640 1 -- 172.21.15.53:0/32103008 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5048159480 con 0x7f50481ee870 2023-06-10T18:53:35.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.424+0000 7f503effd640 1 -- 172.21.15.53:0/32103008 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5044055590 con 0x7f50481ee870 2023-06-10T18:53:35.435 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-06-10T18:53:35.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.428+0000 7f505044e640 1 -- 172.21.15.53:0/32103008 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f502c066280 msgr2=0x7f502c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:35.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.428+0000 7f505044e640 1 --2- 172.21.15.53:0/32103008 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f502c066280 0x7f502c068730 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f50480c48d0 tx=0x7f5038009040 comp rx=0 tx=0).stop 2023-06-10T18:53:35.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.428+0000 7f505044e640 1 -- 172.21.15.53:0/32103008 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50481ee870 msgr2=0x7f50480ae350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:35.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.428+0000 7f505044e640 1 --2- 172.21.15.53:0/32103008 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50481ee870 0x7f50480ae350 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f5044011e90 tx=0x7f504400f580 comp rx=0 tx=0).stop 2023-06-10T18:53:35.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.428+0000 7f505044e640 1 -- 172.21.15.53:0/32103008 shutdown_connections 2023-06-10T18:53:35.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.428+0000 7f505044e640 1 --2- 172.21.15.53:0/32103008 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f502c066280 0x7f502c068730 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:35.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.428+0000 7f505044e640 1 --2- 172.21.15.53:0/32103008 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50480c7430 0x7f50481f2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:35.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.428+0000 7f505044e640 1 --2- 172.21.15.53:0/32103008 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5048151d90 0x7f50480c6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:35.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.428+0000 7f505044e640 1 --2- 172.21.15.53:0/32103008 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50481ee870 0x7f50480ae350 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:35.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.428+0000 7f505044e640 1 -- 172.21.15.53:0/32103008 >> 172.21.15.53:0/32103008 conn(0x7f504806a0e0 msgr2=0x7f50480b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:35.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.428+0000 7f505044e640 1 -- 172.21.15.53:0/32103008 shutdown_connections 2023-06-10T18:53:35.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.428+0000 7f505044e640 1 -- 172.21.15.53:0/32103008 wait complete. 2023-06-10T18:53:35.453 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-10T18:53:35.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.564+0000 7f451c294640 1 Processor -- start 2023-06-10T18:53:35.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.568+0000 7f451c294640 1 -- start start 2023-06-10T18:53:35.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.568+0000 7f451c294640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f451415c060 0x7f45140cc020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:35.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.568+0000 7f451c294640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f451415cb40 0x7f451406bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:35.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.568+0000 7f451c294640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f451415cf60 con 0x7f4514070de0 2023-06-10T18:53:35.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.568+0000 7f451c294640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45140c8d50 con 0x7f451415c060 2023-06-10T18:53:35.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.568+0000 7f451c294640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45140c9030 con 0x7f451415cb40 2023-06-10T18:53:35.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.568+0000 7f451a030640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f451415c060 0x7f45140cc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:35.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.568+0000 7f451a831640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f451415cb40 0x7f451406bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:35.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.568+0000 7f451a030640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f451415c060 0x7f45140cc020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.53:43762/0 (socket says 172.21.15.53:43762) 2023-06-10T18:53:35.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.568+0000 7f451a030640 1 -- 172.21.15.53:0/501790051 learned_addr learned my addr 172.21.15.53:0/501790051 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:35.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.568+0000 7f451a030640 1 -- 172.21.15.53:0/501790051 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f451415cb40 msgr2=0x7f451406bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:35.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.568+0000 7f451a030640 1 --2- 172.21.15.53:0/501790051 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f451415cb40 0x7f451406bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:35.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.568+0000 7f451a030640 1 -- 172.21.15.53:0/501790051 >> v1:172.21.15.117:6789/0 conn(0x7f4514070de0 legacy=0x7f451415c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:35.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.568+0000 7f451a030640 1 -- 172.21.15.53:0/501790051 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4514070300 con 0x7f451415c060 2023-06-10T18:53:35.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.572+0000 7f451a030640 1 --2- 172.21.15.53:0/501790051 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f451415c060 0x7f45140cc020 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4510009870 tx=0x7f451001c4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ccd3c043909b809a server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:35.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.572+0000 7f451902e640 1 -- 172.21.15.53:0/501790051 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45100ac620 con 0x7f451415c060 2023-06-10T18:53:35.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.572+0000 7f451902e640 1 -- 172.21.15.53:0/501790051 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45100ac780 con 0x7f451415c060 2023-06-10T18:53:35.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.572+0000 7f451902e640 1 -- 172.21.15.53:0/501790051 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45100acb10 con 0x7f451415c060 2023-06-10T18:53:35.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.572+0000 7f451c294640 1 -- 172.21.15.53:0/501790051 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f451415c060 msgr2=0x7f45140cc020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:35.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.572+0000 7f451c294640 1 --2- 172.21.15.53:0/501790051 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f451415c060 0x7f45140cc020 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4510009870 tx=0x7f451001c4b0 comp rx=0 tx=0).stop 2023-06-10T18:53:35.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.572+0000 7f451c294640 1 -- 172.21.15.53:0/501790051 shutdown_connections 2023-06-10T18:53:35.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.572+0000 7f451c294640 1 --2- 172.21.15.53:0/501790051 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f451415cb40 0x7f451406bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:35.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.572+0000 7f451c294640 1 --2- 172.21.15.53:0/501790051 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f451415c060 0x7f45140cc020 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:35.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.572+0000 7f451c294640 1 -- 172.21.15.53:0/501790051 >> 172.21.15.53:0/501790051 conn(0x7f451406a0e0 msgr2=0x7f45140cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:35.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.572+0000 7f451c294640 1 -- 172.21.15.53:0/501790051 shutdown_connections 2023-06-10T18:53:35.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.572+0000 7f451c294640 1 -- 172.21.15.53:0/501790051 wait complete. 2023-06-10T18:53:35.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.572+0000 7f451c294640 1 Processor -- start 2023-06-10T18:53:35.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.572+0000 7f451c294640 1 -- start start 2023-06-10T18:53:35.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.572+0000 7f451c294640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4514070de0 0x7f4514158a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:35.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.572+0000 7f451c294640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f451415c060 0x7f45141418d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:35.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.576+0000 7f451c294640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f451415cb40 0x7f4514151d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:35.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.576+0000 7f451c294640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45140c3780 con 0x7f4514070de0 2023-06-10T18:53:35.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.576+0000 7f451c294640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4514159100 con 0x7f451415c060 2023-06-10T18:53:35.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.576+0000 7f451c294640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45140c2e50 con 0x7f451415cb40 2023-06-10T18:53:35.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.576+0000 7f451a030640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4514070de0 0x7f4514158a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:35.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.576+0000 7f451a030640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4514070de0 0x7f4514158a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36960/0 (socket says 172.21.15.53:36960) 2023-06-10T18:53:35.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.576+0000 7f451a030640 1 -- 172.21.15.53:0/4065833348 learned_addr learned my addr 172.21.15.53:0/4065833348 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:35.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.576+0000 7f451a831640 1 --2- 172.21.15.53:0/4065833348 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f451415cb40 0x7f4514151d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:35.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.576+0000 7f451982f640 1 --2- 172.21.15.53:0/4065833348 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f451415c060 0x7f45141418d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:35.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.576+0000 7f451a030640 1 -- 172.21.15.53:0/4065833348 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f451415cb40 msgr2=0x7f4514151d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:35.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.576+0000 7f451a030640 1 --2- 172.21.15.53:0/4065833348 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f451415cb40 0x7f4514151d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:35.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.576+0000 7f451a030640 1 -- 172.21.15.53:0/4065833348 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f451415c060 msgr2=0x7f45141418d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:35.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.576+0000 7f451a030640 1 --2- 172.21.15.53:0/4065833348 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f451415c060 0x7f45141418d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:35.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.576+0000 7f451a030640 1 -- 172.21.15.53:0/4065833348 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45100094d0 con 0x7f4514070de0 2023-06-10T18:53:35.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.576+0000 7f451a030640 1 --2- 172.21.15.53:0/4065833348 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4514070de0 0x7f4514158a70 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f45100190c0 tx=0x7f4510019250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:35.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.576+0000 7f450affd640 1 -- 172.21.15.53:0/4065833348 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45100ac620 con 0x7f4514070de0 2023-06-10T18:53:35.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.576+0000 7f450affd640 1 -- 172.21.15.53:0/4065833348 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45100b6440 con 0x7f4514070de0 2023-06-10T18:53:35.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.576+0000 7f450affd640 1 -- 172.21.15.53:0/4065833348 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45100b67d0 con 0x7f4514070de0 2023-06-10T18:53:35.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.576+0000 7f451c294640 1 -- 172.21.15.53:0/4065833348 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45140c3130 con 0x7f4514070de0 2023-06-10T18:53:35.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.576+0000 7f451c294640 1 -- 172.21.15.53:0/4065833348 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4514141e10 con 0x7f4514070de0 2023-06-10T18:53:35.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.576+0000 7f451c294640 1 -- 172.21.15.53:0/4065833348 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f451404d790 con 0x7f4514070de0 2023-06-10T18:53:35.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.576+0000 7f450affd640 1 -- 172.21.15.53:0/4065833348 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f45100aa070 con 0x7f4514070de0 2023-06-10T18:53:35.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.576+0000 7f450affd640 1 --2- 172.21.15.53:0/4065833348 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f44f80662b0 0x7f44f8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:35.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.576+0000 7f450affd640 1 -- 172.21.15.53:0/4065833348 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f451011de90 con 0x7f4514070de0 2023-06-10T18:53:35.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.576+0000 7f451982f640 1 --2- 172.21.15.53:0/4065833348 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f44f80662b0 0x7f44f8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:35.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.580+0000 7f451982f640 1 --2- 172.21.15.53:0/4065833348 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f44f80662b0 0x7f44f8068760 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f45140c2c70 tx=0x7f4504009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:35.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.580+0000 7f450affd640 1 -- 172.21.15.53:0/4065833348 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f45100eb360 con 0x7f4514070de0 2023-06-10T18:53:35.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.728+0000 7f451c294640 1 -- 172.21.15.53:0/4065833348 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f45140b3c60 con 0x7f4514070de0 2023-06-10T18:53:35.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.728+0000 7f450affd640 1 -- 172.21.15.53:0/4065833348 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f45100ee980 con 0x7f4514070de0 2023-06-10T18:53:35.738 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-06-10T18:53:35.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.732+0000 7f451c294640 1 -- 172.21.15.53:0/4065833348 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f44f80662b0 msgr2=0x7f44f8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:35.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.732+0000 7f451c294640 1 --2- 172.21.15.53:0/4065833348 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f44f80662b0 0x7f44f8068760 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f45140c2c70 tx=0x7f4504009040 comp rx=0 tx=0).stop 2023-06-10T18:53:35.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.732+0000 7f451c294640 1 -- 172.21.15.53:0/4065833348 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4514070de0 msgr2=0x7f4514158a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:35.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.732+0000 7f451c294640 1 --2- 172.21.15.53:0/4065833348 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4514070de0 0x7f4514158a70 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f45100190c0 tx=0x7f4510019250 comp rx=0 tx=0).stop 2023-06-10T18:53:35.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.732+0000 7f451c294640 1 -- 172.21.15.53:0/4065833348 shutdown_connections 2023-06-10T18:53:35.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.732+0000 7f451c294640 1 --2- 172.21.15.53:0/4065833348 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f44f80662b0 0x7f44f8068760 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:35.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.732+0000 7f451c294640 1 --2- 172.21.15.53:0/4065833348 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f451415cb40 0x7f4514151d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:35.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.732+0000 7f451c294640 1 --2- 172.21.15.53:0/4065833348 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f451415c060 0x7f45141418d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:35.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.732+0000 7f451c294640 1 --2- 172.21.15.53:0/4065833348 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4514070de0 0x7f4514158a70 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:35.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.732+0000 7f451c294640 1 -- 172.21.15.53:0/4065833348 >> 172.21.15.53:0/4065833348 conn(0x7f451406a0e0 msgr2=0x7f451415c430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:35.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.732+0000 7f451c294640 1 -- 172.21.15.53:0/4065833348 shutdown_connections 2023-06-10T18:53:35.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.732+0000 7f451c294640 1 -- 172.21.15.53:0/4065833348 wait complete. 2023-06-10T18:53:35.755 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-10T18:53:35.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.864+0000 7f1820995640 1 Processor -- start 2023-06-10T18:53:35.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.864+0000 7f1820995640 1 -- start start 2023-06-10T18:53:35.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.864+0000 7f1820995640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f181c0afe70 0x7f181c0c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:35.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.864+0000 7f1820995640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f181c06b090 con 0x7f181c0c9fa0 2023-06-10T18:53:35.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.864+0000 7f1820995640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f181c0ca370 con 0x7f181c0c82a0 2023-06-10T18:53:35.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.864+0000 7f1820995640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f181c070d50 con 0x7f181c0afe70 2023-06-10T18:53:35.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.864+0000 7f181a59c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f181c0c9fa0 0x7f181c06bae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:55920/0 (socket says 172.21.15.53:55920) 2023-06-10T18:53:35.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.864+0000 7f181a59c640 1 -- 172.21.15.53:0/1101858981 learned_addr learned my addr 172.21.15.53:0/1101858981 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:53:35.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.864+0000 7f181ad9d640 1 --2- 172.21.15.53:0/1101858981 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f181c0afe70 0x7f181c0c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:35.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.864+0000 7f181959a640 1 -- 172.21.15.53:0/1101858981 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 17491277 0 0) 0x7f181c06b090 con 0x7f181c0c9fa0 2023-06-10T18:53:35.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.864+0000 7f181959a640 1 -- 172.21.15.53:0/1101858981 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1808003530 con 0x7f181c0c9fa0 2023-06-10T18:53:35.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.864+0000 7f181959a640 1 -- 172.21.15.53:0/1101858981 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3042023839 0 0) 0x7f1808003530 con 0x7f181c0c9fa0 2023-06-10T18:53:35.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.864+0000 7f181959a640 1 -- 172.21.15.53:0/1101858981 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f181c0afe70 msgr2=0x7f181c0c86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:35.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.864+0000 7f181959a640 1 --2- 172.21.15.53:0/1101858981 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f181c0afe70 0x7f181c0c86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:35.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.864+0000 7f181959a640 1 -- 172.21.15.53:0/1101858981 >> v1:172.21.15.117:6789/0 conn(0x7f181c0c82a0 legacy=0x7f181c0af760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:35.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.864+0000 7f181959a640 1 -- 172.21.15.53:0/1101858981 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f181c071030 con 0x7f181c0c9fa0 2023-06-10T18:53:35.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.864+0000 7f181959a640 1 -- 172.21.15.53:0/1101858981 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f1804001680 con 0x7f181c0c9fa0 2023-06-10T18:53:35.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.864+0000 7f181959a640 1 -- 172.21.15.53:0/1101858981 >> v1:172.21.15.53:6789/0 conn(0x7f181c0c9fa0 legacy=0x7f181c06bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:35.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.864+0000 7f181959a640 1 --2- 172.21.15.53:0/1101858981 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f18080039b0 0x7f1808003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:35.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.864+0000 7f181959a640 1 --2- 172.21.15.53:0/1101858981 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f181c0afe70 0x7f18080047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:35.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.864+0000 7f181959a640 1 --2- 172.21.15.53:0/1101858981 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1808004d10 0x7f1808005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:35.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.864+0000 7f181959a640 1 -- 172.21.15.53:0/1101858981 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f181c070d50 con 0x7f18080039b0 2023-06-10T18:53:35.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.864+0000 7f181959a640 1 -- 172.21.15.53:0/1101858981 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f180800bad0 con 0x7f1808004d10 2023-06-10T18:53:35.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.864+0000 7f181959a640 1 -- 172.21.15.53:0/1101858981 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f180800bc90 con 0x7f181c0afe70 2023-06-10T18:53:35.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.864+0000 7f181a59c640 1 --2- 172.21.15.53:0/1101858981 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f18080039b0 0x7f1808003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:35.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.864+0000 7f181ad9d640 1 --2- 172.21.15.53:0/1101858981 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1808004d10 0x7f1808005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:35.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.864+0000 7f181a59c640 1 -- 172.21.15.53:0/1101858981 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f181c0afe70 msgr2=0x7f18080047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:35.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.864+0000 7f181a59c640 1 --2- 172.21.15.53:0/1101858981 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f181c0afe70 0x7f18080047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:35.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.864+0000 7f181a59c640 1 -- 172.21.15.53:0/1101858981 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1808004d10 msgr2=0x7f1808005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:35.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.864+0000 7f181a59c640 1 --2- 172.21.15.53:0/1101858981 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1808004d10 0x7f1808005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:35.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.864+0000 7f181a59c640 1 -- 172.21.15.53:0/1101858981 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1808003530 con 0x7f18080039b0 2023-06-10T18:53:35.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.864+0000 7f181ad9d640 1 --2- 172.21.15.53:0/1101858981 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1808004d10 0x7f1808005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:35.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.868+0000 7f181a59c640 1 --2- 172.21.15.53:0/1101858981 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f18080039b0 0x7f1808003dc0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f180400c240 tx=0x7f180401cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45346225cf5f1ea server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:35.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.868+0000 7f181959a640 1 -- 172.21.15.53:0/1101858981 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18040a5af0 con 0x7f18080039b0 2023-06-10T18:53:35.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.868+0000 7f181959a640 1 -- 172.21.15.53:0/1101858981 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18040a5c70 con 0x7f18080039b0 2023-06-10T18:53:35.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.868+0000 7f181959a640 1 -- 172.21.15.53:0/1101858981 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18040058e0 con 0x7f18080039b0 2023-06-10T18:53:35.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.868+0000 7f1820995640 1 -- 172.21.15.53:0/1101858981 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f18080039b0 msgr2=0x7f1808003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:35.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.868+0000 7f1820995640 1 --2- 172.21.15.53:0/1101858981 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f18080039b0 0x7f1808003dc0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f180400c240 tx=0x7f180401cc10 comp rx=0 tx=0).stop 2023-06-10T18:53:35.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.868+0000 7f181ad9d640 1 -- 172.21.15.53:0/1101858981 reap_dead start 2023-06-10T18:53:35.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.868+0000 7f1820995640 1 -- 172.21.15.53:0/1101858981 shutdown_connections 2023-06-10T18:53:35.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.868+0000 7f1820995640 1 -- 172.21.15.53:0/1101858981 >> 172.21.15.53:0/1101858981 conn(0x7f181c06a0e0 msgr2=0x7f181c0cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:35.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.868+0000 7f1820995640 1 -- 172.21.15.53:0/1101858981 shutdown_connections 2023-06-10T18:53:35.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.868+0000 7f1820995640 1 -- 172.21.15.53:0/1101858981 wait complete. 2023-06-10T18:53:35.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.868+0000 7f1820995640 1 Processor -- start 2023-06-10T18:53:35.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.868+0000 7f1820995640 1 -- start start 2023-06-10T18:53:35.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.868+0000 7f1820995640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18080039b0 0x7f181c157e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:35.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.868+0000 7f1820995640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f181c1578d0 0x7f181c157080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:35.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.868+0000 7f1820995640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f181c0ac180 0x7f181c0ac5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:35.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.868+0000 7f1820995640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f181c0abcf0 con 0x7f181c0ac180 2023-06-10T18:53:35.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.868+0000 7f1820995640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f181c0ab0e0 con 0x7f181c1578d0 2023-06-10T18:53:35.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.868+0000 7f1820995640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f181c0ab3c0 con 0x7f18080039b0 2023-06-10T18:53:35.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.868+0000 7f181ad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f181c0ac180 0x7f181c0ac5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:35.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.868+0000 7f181ad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f181c0ac180 0x7f181c0ac5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36970/0 (socket says 172.21.15.53:36970) 2023-06-10T18:53:35.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.868+0000 7f181ad9d640 1 -- 172.21.15.53:0/1757423450 learned_addr learned my addr 172.21.15.53:0/1757423450 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:35.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.868+0000 7f1819d9b640 1 --2- 172.21.15.53:0/1757423450 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f181c1578d0 0x7f181c157080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:35.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.868+0000 7f181a59c640 1 --2- 172.21.15.53:0/1757423450 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18080039b0 0x7f181c157e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:35.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.872+0000 7f181ad9d640 1 -- 172.21.15.53:0/1757423450 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18080039b0 msgr2=0x7f181c157e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:35.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.872+0000 7f181ad9d640 1 --2- 172.21.15.53:0/1757423450 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18080039b0 0x7f181c157e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:35.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.872+0000 7f181ad9d640 1 -- 172.21.15.53:0/1757423450 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f181c1578d0 msgr2=0x7f181c157080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:35.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.872+0000 7f181ad9d640 1 --2- 172.21.15.53:0/1757423450 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f181c1578d0 0x7f181c157080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:35.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.872+0000 7f181ad9d640 1 -- 172.21.15.53:0/1757423450 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f181c0ab6a0 con 0x7f181c0ac180 2023-06-10T18:53:35.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.872+0000 7f1819d9b640 1 --2- 172.21.15.53:0/1757423450 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f181c1578d0 0x7f181c157080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:53:35.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.872+0000 7f181ad9d640 1 --2- 172.21.15.53:0/1757423450 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f181c0ac180 0x7f181c0ac5f0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f181c06d4d0 tx=0x7f1814007e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:35.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.872+0000 7f1812ffd640 1 -- 172.21.15.53:0/1757423450 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1814014760 con 0x7f181c0ac180 2023-06-10T18:53:35.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.872+0000 7f1812ffd640 1 -- 172.21.15.53:0/1757423450 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1814011040 con 0x7f181c0ac180 2023-06-10T18:53:35.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.872+0000 7f1820995640 1 -- 172.21.15.53:0/1757423450 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f181c0ab980 con 0x7f181c0ac180 2023-06-10T18:53:35.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.872+0000 7f1812ffd640 1 -- 172.21.15.53:0/1757423450 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1814014ae0 con 0x7f181c0ac180 2023-06-10T18:53:35.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.872+0000 7f1820995640 1 -- 172.21.15.53:0/1757423450 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f181c158470 con 0x7f181c0ac180 2023-06-10T18:53:35.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.872+0000 7f1820995640 1 -- 172.21.15.53:0/1757423450 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f181c0abb10 con 0x7f181c0ac180 2023-06-10T18:53:35.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.872+0000 7f1812ffd640 1 -- 172.21.15.53:0/1757423450 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1814014c40 con 0x7f181c0ac180 2023-06-10T18:53:35.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.872+0000 7f1812ffd640 1 --2- 172.21.15.53:0/1757423450 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f17fc0662b0 0x7f17fc068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:35.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.872+0000 7f1812ffd640 1 -- 172.21.15.53:0/1757423450 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f18140838d0 con 0x7f181c0ac180 2023-06-10T18:53:35.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.872+0000 7f181a59c640 1 --2- 172.21.15.53:0/1757423450 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f17fc0662b0 0x7f17fc068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:35.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.872+0000 7f181a59c640 1 --2- 172.21.15.53:0/1757423450 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f17fc0662b0 0x7f17fc068760 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f18040ab000 tx=0x7f18040a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:35.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:35.876+0000 7f1812ffd640 1 -- 172.21.15.53:0/1757423450 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1814050d00 con 0x7f181c0ac180 2023-06-10T18:53:35.945 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-10T18:53:35.948 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-10T18:53:36.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.024+0000 7f1820995640 1 -- 172.21.15.53:0/1757423450 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f181c04d790 con 0x7f181c0ac180 2023-06-10T18:53:36.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.024+0000 7f1812ffd640 1 -- 172.21.15.53:0/1757423450 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1814054320 con 0x7f181c0ac180 2023-06-10T18:53:36.033 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-06-10T18:53:36.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.024+0000 7f1820995640 1 -- 172.21.15.53:0/1757423450 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f17fc0662b0 msgr2=0x7f17fc068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:36.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.024+0000 7f1820995640 1 --2- 172.21.15.53:0/1757423450 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f17fc0662b0 0x7f17fc068760 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f18040ab000 tx=0x7f18040a7070 comp rx=0 tx=0).stop 2023-06-10T18:53:36.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.024+0000 7f1820995640 1 -- 172.21.15.53:0/1757423450 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f181c0ac180 msgr2=0x7f181c0ac5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:36.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.024+0000 7f1820995640 1 --2- 172.21.15.53:0/1757423450 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f181c0ac180 0x7f181c0ac5f0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f181c06d4d0 tx=0x7f1814007e90 comp rx=0 tx=0).stop 2023-06-10T18:53:36.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.024+0000 7f1820995640 1 -- 172.21.15.53:0/1757423450 shutdown_connections 2023-06-10T18:53:36.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.024+0000 7f1820995640 1 --2- 172.21.15.53:0/1757423450 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f17fc0662b0 0x7f17fc068760 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:36.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.024+0000 7f1820995640 1 --2- 172.21.15.53:0/1757423450 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f181c0ac180 0x7f181c0ac5f0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:36.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.024+0000 7f1820995640 1 --2- 172.21.15.53:0/1757423450 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f181c1578d0 0x7f181c157080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:36.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.024+0000 7f1820995640 1 --2- 172.21.15.53:0/1757423450 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18080039b0 0x7f181c157e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:36.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.024+0000 7f1820995640 1 -- 172.21.15.53:0/1757423450 >> 172.21.15.53:0/1757423450 conn(0x7f181c06a0e0 msgr2=0x7f181c0af6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:36.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.024+0000 7f1820995640 1 -- 172.21.15.53:0/1757423450 shutdown_connections 2023-06-10T18:53:36.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.024+0000 7f1820995640 1 -- 172.21.15.53:0/1757423450 wait complete. 2023-06-10T18:53:36.050 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-10T18:53:36.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.164+0000 7f20f76a2640 1 Processor -- start 2023-06-10T18:53:36.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.164+0000 7f20f76a2640 1 -- start start 2023-06-10T18:53:36.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.164+0000 7f20f76a2640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f20f01597e0 0x7f20f00b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:36.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.164+0000 7f20f76a2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20f00b39f0 0x7f20f00c9b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:36.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.164+0000 7f20f76a2640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f20f00ca060 0x7f20f00c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:36.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.164+0000 7f20f76a2640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20f0071820 con 0x7f20f01597e0 2023-06-10T18:53:36.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.164+0000 7f20f76a2640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20f00ca4a0 con 0x7f20f00ca060 2023-06-10T18:53:36.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.164+0000 7f20f76a2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20f0070780 con 0x7f20f00b39f0 2023-06-10T18:53:36.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.164+0000 7f20f543e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f20f01597e0 0x7f20f00b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:36.175 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.164+0000 7f20f543e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f20f01597e0 0x7f20f00b34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36984/0 (socket says 172.21.15.53:36984) 2023-06-10T18:53:36.175 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.164+0000 7f20f543e640 1 -- 172.21.15.53:0/2287530740 learned_addr learned my addr 172.21.15.53:0/2287530740 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:36.175 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.164+0000 7f20f4c3d640 1 --2- 172.21.15.53:0/2287530740 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20f00b39f0 0x7f20f00c9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:36.175 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.164+0000 7f20f5c3f640 1 --2- 172.21.15.53:0/2287530740 >> v2:172.21.15.117:3300/0 conn(0x7f20f00ca060 0x7f20f00c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:36.175 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.164+0000 7f20f543e640 1 -- 172.21.15.53:0/2287530740 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20f00b39f0 msgr2=0x7f20f00c9b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:36.175 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.164+0000 7f20f543e640 1 --2- 172.21.15.53:0/2287530740 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20f00b39f0 0x7f20f00c9b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:36.175 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.164+0000 7f20f543e640 1 -- 172.21.15.53:0/2287530740 >> v2:172.21.15.117:3300/0 conn(0x7f20f00ca060 msgr2=0x7f20f00c86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:36.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.164+0000 7f20f543e640 1 --2- 172.21.15.53:0/2287530740 >> v2:172.21.15.117:3300/0 conn(0x7f20f00ca060 0x7f20f00c86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:36.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.164+0000 7f20f543e640 1 -- 172.21.15.53:0/2287530740 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20f0070a60 con 0x7f20f01597e0 2023-06-10T18:53:36.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.168+0000 7f20f543e640 1 --2- 172.21.15.53:0/2287530740 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20f01597e0 0x7f20f00b34b0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f20f00cb8e0 tx=0x7f20ec01c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=defdca4fd3e6e059 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:36.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.168+0000 7f20e7fff640 1 -- 172.21.15.53:0/2287530740 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20ec0ab600 con 0x7f20f01597e0 2023-06-10T18:53:36.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.168+0000 7f20e7fff640 1 -- 172.21.15.53:0/2287530740 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20ec0a7050 con 0x7f20f01597e0 2023-06-10T18:53:36.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.168+0000 7f20e7fff640 1 -- 172.21.15.53:0/2287530740 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20ec0ab980 con 0x7f20f01597e0 2023-06-10T18:53:36.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.168+0000 7f20f76a2640 1 -- 172.21.15.53:0/2287530740 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20f01597e0 msgr2=0x7f20f00b34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:36.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.168+0000 7f20f76a2640 1 --2- 172.21.15.53:0/2287530740 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20f01597e0 0x7f20f00b34b0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f20f00cb8e0 tx=0x7f20ec01c240 comp rx=0 tx=0).stop 2023-06-10T18:53:36.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.168+0000 7f20f76a2640 1 -- 172.21.15.53:0/2287530740 shutdown_connections 2023-06-10T18:53:36.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.168+0000 7f20f76a2640 1 --2- 172.21.15.53:0/2287530740 >> v2:172.21.15.117:3300/0 conn(0x7f20f00ca060 0x7f20f00c86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:36.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.168+0000 7f20f76a2640 1 --2- 172.21.15.53:0/2287530740 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20f00b39f0 0x7f20f00c9b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:36.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.168+0000 7f20f76a2640 1 --2- 172.21.15.53:0/2287530740 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20f01597e0 0x7f20f00b34b0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:36.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.168+0000 7f20f76a2640 1 -- 172.21.15.53:0/2287530740 >> 172.21.15.53:0/2287530740 conn(0x7f20f006a0b0 msgr2=0x7f20f00afbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:36.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.168+0000 7f20f76a2640 1 -- 172.21.15.53:0/2287530740 shutdown_connections 2023-06-10T18:53:36.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.168+0000 7f20f76a2640 1 -- 172.21.15.53:0/2287530740 wait complete. 2023-06-10T18:53:36.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.168+0000 7f20f76a2640 1 Processor -- start 2023-06-10T18:53:36.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.168+0000 7f20f76a2640 1 -- start start 2023-06-10T18:53:36.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.172+0000 7f20f76a2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20f00b39f0 0x7f20f00c40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:36.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.172+0000 7f20f76a2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20f00ca060 0x7f20f0157df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:36.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.172+0000 7f20f76a2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20f01597e0 0x7f20f0150b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:36.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.172+0000 7f20f76a2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f0157960 con 0x7f20f01597e0 2023-06-10T18:53:36.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.172+0000 7f20f76a2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f0156d50 con 0x7f20f00ca060 2023-06-10T18:53:36.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.172+0000 7f20f76a2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20f0157030 con 0x7f20f00b39f0 2023-06-10T18:53:36.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.172+0000 7f20f5c3f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20f01597e0 0x7f20f0150b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:36.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.172+0000 7f20f5c3f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20f01597e0 0x7f20f0150b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36998/0 (socket says 172.21.15.53:36998) 2023-06-10T18:53:36.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.172+0000 7f20f5c3f640 1 -- 172.21.15.53:0/1206728663 learned_addr learned my addr 172.21.15.53:0/1206728663 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:36.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.172+0000 7f20f543e640 1 --2- 172.21.15.53:0/1206728663 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20f00b39f0 0x7f20f00c40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:36.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.172+0000 7f20f4c3d640 1 --2- 172.21.15.53:0/1206728663 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20f00ca060 0x7f20f0157df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:36.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.172+0000 7f20f5c3f640 1 -- 172.21.15.53:0/1206728663 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20f00b39f0 msgr2=0x7f20f00c40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:36.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.172+0000 7f20f5c3f640 1 --2- 172.21.15.53:0/1206728663 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20f00b39f0 0x7f20f00c40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:36.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.172+0000 7f20f5c3f640 1 -- 172.21.15.53:0/1206728663 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20f00ca060 msgr2=0x7f20f0157df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:36.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.172+0000 7f20f5c3f640 1 --2- 172.21.15.53:0/1206728663 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20f00ca060 0x7f20f0157df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:36.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.172+0000 7f20f5c3f640 1 -- 172.21.15.53:0/1206728663 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20ec0094d0 con 0x7f20f01597e0 2023-06-10T18:53:36.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.172+0000 7f20f5c3f640 1 --2- 172.21.15.53:0/1206728663 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20f01597e0 0x7f20f0150b20 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f20e8007e40 tx=0x7f20e800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:36.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.172+0000 7f20e5ffb640 1 -- 172.21.15.53:0/1206728663 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e8014620 con 0x7f20f01597e0 2023-06-10T18:53:36.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.172+0000 7f20e5ffb640 1 -- 172.21.15.53:0/1206728663 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20e800ee90 con 0x7f20f01597e0 2023-06-10T18:53:36.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.172+0000 7f20f76a2640 1 -- 172.21.15.53:0/1206728663 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20f0157310 con 0x7f20f01597e0 2023-06-10T18:53:36.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.172+0000 7f20e5ffb640 1 -- 172.21.15.53:0/1206728663 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e80149e0 con 0x7f20f01597e0 2023-06-10T18:53:36.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.172+0000 7f20f76a2640 1 -- 172.21.15.53:0/1206728663 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20f00c4620 con 0x7f20f01597e0 2023-06-10T18:53:36.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.172+0000 7f20f76a2640 1 -- 172.21.15.53:0/1206728663 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20f0157ad0 con 0x7f20f01597e0 2023-06-10T18:53:36.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.172+0000 7f20e5ffb640 1 -- 172.21.15.53:0/1206728663 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f20e8014b40 con 0x7f20f01597e0 2023-06-10T18:53:36.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.172+0000 7f20e5ffb640 1 --2- 172.21.15.53:0/1206728663 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f20d4066280 0x7f20d4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:36.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.172+0000 7f20e5ffb640 1 -- 172.21.15.53:0/1206728663 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f20e8084650 con 0x7f20f01597e0 2023-06-10T18:53:36.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.172+0000 7f20f543e640 1 --2- 172.21.15.53:0/1206728663 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f20d4066280 0x7f20d4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:36.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.172+0000 7f20f543e640 1 --2- 172.21.15.53:0/1206728663 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f20d4066280 0x7f20d4068730 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f20ec0ad000 tx=0x7f20ec008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:36.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.176+0000 7f20e5ffb640 1 -- 172.21.15.53:0/1206728663 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f20e8051b20 con 0x7f20f01597e0 2023-06-10T18:53:36.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.336+0000 7f20f76a2640 1 -- 172.21.15.53:0/1206728663 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f20f004d790 con 0x7f20f01597e0 2023-06-10T18:53:36.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.336+0000 7f20e5ffb640 1 -- 172.21.15.53:0/1206728663 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7f20e8055140 con 0x7f20f01597e0 2023-06-10T18:53:36.345 INFO:teuthology.orchestra.run.smithi053.stderr:listed 0 entries 2023-06-10T18:53:36.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.336+0000 7f20f76a2640 1 -- 172.21.15.53:0/1206728663 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f20d4066280 msgr2=0x7f20d4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:36.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.336+0000 7f20f76a2640 1 --2- 172.21.15.53:0/1206728663 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f20d4066280 0x7f20d4068730 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f20ec0ad000 tx=0x7f20ec008040 comp rx=0 tx=0).stop 2023-06-10T18:53:36.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.336+0000 7f20f76a2640 1 -- 172.21.15.53:0/1206728663 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20f01597e0 msgr2=0x7f20f0150b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:36.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.336+0000 7f20f76a2640 1 --2- 172.21.15.53:0/1206728663 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20f01597e0 0x7f20f0150b20 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f20e8007e40 tx=0x7f20e800e4b0 comp rx=0 tx=0).stop 2023-06-10T18:53:36.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.336+0000 7f20f76a2640 1 -- 172.21.15.53:0/1206728663 shutdown_connections 2023-06-10T18:53:36.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.336+0000 7f20f76a2640 1 --2- 172.21.15.53:0/1206728663 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f20d4066280 0x7f20d4068730 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:36.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.336+0000 7f20f76a2640 1 --2- 172.21.15.53:0/1206728663 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20f01597e0 0x7f20f0150b20 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:36.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.336+0000 7f20f76a2640 1 --2- 172.21.15.53:0/1206728663 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20f00ca060 0x7f20f0157df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:36.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.336+0000 7f20f76a2640 1 --2- 172.21.15.53:0/1206728663 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20f00b39f0 0x7f20f00c40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:36.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.336+0000 7f20f76a2640 1 -- 172.21.15.53:0/1206728663 >> 172.21.15.53:0/1206728663 conn(0x7f20f006a0b0 msgr2=0x7f20f0152330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:36.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.336+0000 7f20f76a2640 1 -- 172.21.15.53:0/1206728663 shutdown_connections 2023-06-10T18:53:36.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.336+0000 7f20f76a2640 1 -- 172.21.15.53:0/1206728663 wait complete. 2023-06-10T18:53:36.362 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi053.front.sepia.ceph.com... 2023-06-10T18:53:36.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:53:36.363 DEBUG:teuthology.orchestra.run.smithi053:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2023-06-10T18:53:36.375 INFO:teuthology.orchestra.run:waiting for 300 2023-06-10T18:53:36.375 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi053.front.sepia.ceph.com 2023-06-10T18:53:36.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:53:36.376 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-06-10T18:53:36.425 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T18:53:36.425 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T18:53:36.432 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T18:53:36.432 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T18:53:36.478 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T18:53:36.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.592+0000 7f3448063640 1 Processor -- start 2023-06-10T18:53:36.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.592+0000 7f3448063640 1 -- start start 2023-06-10T18:53:36.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.592+0000 7f3448063640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f34400b3ac0 0x7f34400b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:36.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.592+0000 7f3448063640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f34400d14c0 0x7f344015fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:36.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.592+0000 7f3448063640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34400d0020 con 0x7f34400cc690 2023-06-10T18:53:36.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.592+0000 7f3448063640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34400b43d0 con 0x7f34400b3ac0 2023-06-10T18:53:36.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.592+0000 7f3448063640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34400cef40 con 0x7f34400d14c0 2023-06-10T18:53:36.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.592+0000 7f34455fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f34400cc690 0x7f344015f370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:55928/0 (socket says 172.21.15.53:55928) 2023-06-10T18:53:36.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.592+0000 7f34455fe640 1 -- 172.21.15.53:0/2864518346 learned_addr learned my addr 172.21.15.53:0/2864518346 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:53:36.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.592+0000 7f3445dff640 1 --2- 172.21.15.53:0/2864518346 >> v2:172.21.15.117:3300/0 conn(0x7f34400b3ac0 0x7f34400b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:36.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.592+0000 7f3446600640 1 --2- 172.21.15.53:0/2864518346 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f34400d14c0 0x7f344015fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:36.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.592+0000 7f3444dfd640 1 -- 172.21.15.53:0/2864518346 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2470760607 0 0) 0x7f34400d0020 con 0x7f34400cc690 2023-06-10T18:53:36.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.592+0000 7f3444dfd640 1 -- 172.21.15.53:0/2864518346 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f342c003530 con 0x7f34400cc690 2023-06-10T18:53:36.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.592+0000 7f3445dff640 1 -- 172.21.15.53:0/2864518346 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f34400d14c0 msgr2=0x7f344015fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:36.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.592+0000 7f3445dff640 1 --2- 172.21.15.53:0/2864518346 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f34400d14c0 0x7f344015fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:36.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.592+0000 7f3445dff640 1 -- 172.21.15.53:0/2864518346 >> v1:172.21.15.53:6789/0 conn(0x7f34400cc690 legacy=0x7f344015f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:36.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.592+0000 7f3445dff640 1 -- 172.21.15.53:0/2864518346 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34400cf220 con 0x7f34400b3ac0 2023-06-10T18:53:36.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.596+0000 7f3445dff640 1 --2- 172.21.15.53:0/2864518346 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34400b3ac0 0x7f34400b3e90 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f343c0097c0 tx=0x7f343c01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6633952ff06d344 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:36.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.596+0000 7f3444dfd640 1 -- 172.21.15.53:0/2864518346 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f343c0ad660 con 0x7f34400b3ac0 2023-06-10T18:53:36.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.596+0000 7f3444dfd640 1 -- 172.21.15.53:0/2864518346 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f343c0ad7c0 con 0x7f34400b3ac0 2023-06-10T18:53:36.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.596+0000 7f3444dfd640 1 -- 172.21.15.53:0/2864518346 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f343c0adb30 con 0x7f34400b3ac0 2023-06-10T18:53:36.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.596+0000 7f3448063640 1 -- 172.21.15.53:0/2864518346 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34400b3ac0 msgr2=0x7f34400b3e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:36.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.596+0000 7f3448063640 1 --2- 172.21.15.53:0/2864518346 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34400b3ac0 0x7f34400b3e90 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f343c0097c0 tx=0x7f343c01c450 comp rx=0 tx=0).stop 2023-06-10T18:53:36.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.596+0000 7f3448063640 1 -- 172.21.15.53:0/2864518346 shutdown_connections 2023-06-10T18:53:36.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.596+0000 7f3448063640 1 --2- 172.21.15.53:0/2864518346 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f34400d14c0 0x7f344015fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:36.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.596+0000 7f3448063640 1 --2- 172.21.15.53:0/2864518346 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34400b3ac0 0x7f34400b3e90 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:36.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.596+0000 7f3448063640 1 -- 172.21.15.53:0/2864518346 >> 172.21.15.53:0/2864518346 conn(0x7f3440071790 msgr2=0x7f3440069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:36.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.596+0000 7f3448063640 1 -- 172.21.15.53:0/2864518346 shutdown_connections 2023-06-10T18:53:36.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.596+0000 7f3448063640 1 -- 172.21.15.53:0/2864518346 wait complete. 2023-06-10T18:53:36.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.596+0000 7f3448063640 1 Processor -- start 2023-06-10T18:53:36.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.596+0000 7f3448063640 1 -- start start 2023-06-10T18:53:36.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.596+0000 7f3448063640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34400b3ac0 0x7f3440148b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:36.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.596+0000 7f3448063640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34400cc690 0x7f3440150bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:36.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.596+0000 7f3448063640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f34400d14c0 0x7f34400b4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:36.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.596+0000 7f3448063640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34401490c0 con 0x7f34400cc690 2023-06-10T18:53:36.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.596+0000 7f3448063640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3440152140 con 0x7f34400b3ac0 2023-06-10T18:53:36.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.596+0000 7f3448063640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3440151400 con 0x7f34400d14c0 2023-06-10T18:53:36.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.596+0000 7f34455fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34400cc690 0x7f3440150bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:36.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.596+0000 7f34455fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34400cc690 0x7f3440150bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37010/0 (socket says 172.21.15.53:37010) 2023-06-10T18:53:36.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.596+0000 7f34455fe640 1 -- 172.21.15.53:0/2543563727 learned_addr learned my addr 172.21.15.53:0/2543563727 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:36.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.596+0000 7f3445dff640 1 --2- 172.21.15.53:0/2543563727 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34400b3ac0 0x7f3440148b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:36.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.596+0000 7f3446600640 1 --2- 172.21.15.53:0/2543563727 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f34400d14c0 0x7f34400b4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:36.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.596+0000 7f34455fe640 1 -- 172.21.15.53:0/2543563727 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f34400d14c0 msgr2=0x7f34400b4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:36.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.596+0000 7f34455fe640 1 --2- 172.21.15.53:0/2543563727 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f34400d14c0 0x7f34400b4e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:36.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.596+0000 7f34455fe640 1 -- 172.21.15.53:0/2543563727 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34400b3ac0 msgr2=0x7f3440148b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:36.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.596+0000 7f34455fe640 1 --2- 172.21.15.53:0/2543563727 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34400b3ac0 0x7f3440148b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:36.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.596+0000 7f34455fe640 1 -- 172.21.15.53:0/2543563727 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f343c009420 con 0x7f34400cc690 2023-06-10T18:53:36.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.596+0000 7f3446600640 1 --2- 172.21.15.53:0/2543563727 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f34400d14c0 0x7f34400b4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:36.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.596+0000 7f34455fe640 1 --2- 172.21.15.53:0/2543563727 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34400cc690 0x7f3440150bd0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f343000c450 tx=0x7f343000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:36.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.600+0000 7f34367fc640 1 -- 172.21.15.53:0/2543563727 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3430005cf0 con 0x7f34400cc690 2023-06-10T18:53:36.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.600+0000 7f34367fc640 1 -- 172.21.15.53:0/2543563727 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3430005e50 con 0x7f34400cc690 2023-06-10T18:53:36.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.600+0000 7f3448063640 1 -- 172.21.15.53:0/2543563727 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3440152390 con 0x7f34400cc690 2023-06-10T18:53:36.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.600+0000 7f34367fc640 1 -- 172.21.15.53:0/2543563727 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3430007290 con 0x7f34400cc690 2023-06-10T18:53:36.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.600+0000 7f3448063640 1 -- 172.21.15.53:0/2543563727 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3440152950 con 0x7f34400cc690 2023-06-10T18:53:36.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.600+0000 7f3448063640 1 -- 172.21.15.53:0/2543563727 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3440152b70 con 0x7f34400cc690 2023-06-10T18:53:36.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.600+0000 7f34367fc640 1 -- 172.21.15.53:0/2543563727 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f34300073f0 con 0x7f34400cc690 2023-06-10T18:53:36.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.600+0000 7f34367fc640 1 --2- 172.21.15.53:0/2543563727 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3424066280 0x7f3424068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:36.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.600+0000 7f34367fc640 1 -- 172.21.15.53:0/2543563727 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f3430083330 con 0x7f34400cc690 2023-06-10T18:53:36.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.600+0000 7f3445dff640 1 --2- 172.21.15.53:0/2543563727 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3424066280 0x7f3424068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:36.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.604+0000 7f3445dff640 1 --2- 172.21.15.53:0/2543563727 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3424066280 0x7f3424068730 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f343c0af000 tx=0x7f343c0a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:36.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.604+0000 7f34367fc640 1 -- 172.21.15.53:0/2543563727 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3430050770 con 0x7f34400cc690 2023-06-10T18:53:36.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.760+0000 7f3448063640 1 -- 172.21.15.53:0/2543563727 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f344004d790 con 0x7f34400cc690 2023-06-10T18:53:36.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.760+0000 7f34367fc640 1 -- 172.21.15.53:0/2543563727 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18363 (secure 0 0 0) 0x7f3430053d90 con 0x7f34400cc690 2023-06-10T18:53:36.771 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:53:36.772 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":25,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T18:53:27.127355+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-10T18:52:43.396243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-10T18:52:43.894228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.23","mappings":[{"from":3,"to":2}]},{"pgid":"4.3e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T18:53:36.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.764+0000 7f3448063640 1 -- 172.21.15.53:0/2543563727 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3424066280 msgr2=0x7f3424068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:36.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.764+0000 7f3448063640 1 --2- 172.21.15.53:0/2543563727 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3424066280 0x7f3424068730 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f343c0af000 tx=0x7f343c0a7000 comp rx=0 tx=0).stop 2023-06-10T18:53:36.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.764+0000 7f3448063640 1 -- 172.21.15.53:0/2543563727 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34400cc690 msgr2=0x7f3440150bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:36.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.764+0000 7f3448063640 1 --2- 172.21.15.53:0/2543563727 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34400cc690 0x7f3440150bd0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f343000c450 tx=0x7f343000c910 comp rx=0 tx=0).stop 2023-06-10T18:53:36.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.764+0000 7f3448063640 1 -- 172.21.15.53:0/2543563727 shutdown_connections 2023-06-10T18:53:36.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.764+0000 7f3448063640 1 --2- 172.21.15.53:0/2543563727 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3424066280 0x7f3424068730 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:36.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.764+0000 7f3448063640 1 --2- 172.21.15.53:0/2543563727 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f34400d14c0 0x7f34400b4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:36.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.764+0000 7f3448063640 1 --2- 172.21.15.53:0/2543563727 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34400cc690 0x7f3440150bd0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:36.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.764+0000 7f3448063640 1 --2- 172.21.15.53:0/2543563727 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34400b3ac0 0x7f3440148b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:36.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.764+0000 7f3448063640 1 -- 172.21.15.53:0/2543563727 >> 172.21.15.53:0/2543563727 conn(0x7f3440071790 msgr2=0x7f34400b2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:36.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.764+0000 7f3448063640 1 -- 172.21.15.53:0/2543563727 shutdown_connections 2023-06-10T18:53:36.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.764+0000 7f3448063640 1 -- 172.21.15.53:0/2543563727 wait complete. 2023-06-10T18:53:36.790 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-10T18:52:33.633114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-10T18:52:39.171487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-10T18:52:43.396243+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-10T18:52:43.894228+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-10T18:53:36.791 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-10T18:53:36.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.904+0000 7fdaeb3fa640 1 Processor -- start 2023-06-10T18:53:36.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.904+0000 7fdaeb3fa640 1 -- start start 2023-06-10T18:53:36.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.904+0000 7fdaeb3fa640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fdae415c7f0 0x7fdae415f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:36.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.904+0000 7fdaeb3fa640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdae415cc40 con 0x7fdae415f860 2023-06-10T18:53:36.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.904+0000 7fdaeb3fa640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdae40af530 con 0x7fdae406b780 2023-06-10T18:53:36.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.904+0000 7fdaeb3fa640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdae415c3d0 con 0x7fdae415c7f0 2023-06-10T18:53:36.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.904+0000 7fdae9997640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fdae415f860 0x7fdae40ceb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:55938/0 (socket says 172.21.15.53:55938) 2023-06-10T18:53:36.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.904+0000 7fdae8995640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fdae415c7f0 0x7fdae415f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:36.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.904+0000 7fdae9997640 1 -- 172.21.15.53:0/1323972903 learned_addr learned my addr 172.21.15.53:0/1323972903 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:53:36.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.904+0000 7fdae8995640 1 -- 172.21.15.53:0/1323972903 >> v1:172.21.15.117:6789/0 conn(0x7fdae406b780 legacy=0x7fdae406bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:36.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.904+0000 7fdae8995640 1 -- 172.21.15.53:0/1323972903 >> v1:172.21.15.53:6789/0 conn(0x7fdae415f860 legacy=0x7fdae40ceb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:36.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.904+0000 7fdadbfff640 1 -- 172.21.15.53:0/1323972903 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1145237303 0 0) 0x7fdae415cc40 con 0x7fdae415f860 2023-06-10T18:53:36.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.904+0000 7fdae8995640 1 -- 172.21.15.53:0/1323972903 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae415fd70 con 0x7fdae415c7f0 2023-06-10T18:53:36.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.908+0000 7fdae8995640 1 --2- 172.21.15.53:0/1323972903 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdae415c7f0 0x7fdae415f320 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fdad40097c0 tx=0x7fdad401c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5101966f3a71a2c6 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:36.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.908+0000 7fdadbfff640 1 -- 172.21.15.53:0/1323972903 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad40ac410 con 0x7fdae415c7f0 2023-06-10T18:53:36.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.908+0000 7fdadbfff640 1 -- 172.21.15.53:0/1323972903 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdad40ac570 con 0x7fdae415c7f0 2023-06-10T18:53:36.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.908+0000 7fdadbfff640 1 -- 172.21.15.53:0/1323972903 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad40ac900 con 0x7fdae415c7f0 2023-06-10T18:53:36.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.908+0000 7fdaeb3fa640 1 -- 172.21.15.53:0/1323972903 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdae415c7f0 msgr2=0x7fdae415f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:36.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.908+0000 7fdaeb3fa640 1 --2- 172.21.15.53:0/1323972903 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdae415c7f0 0x7fdae415f320 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fdad40097c0 tx=0x7fdad401c3b0 comp rx=0 tx=0).stop 2023-06-10T18:53:36.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.908+0000 7fdaeb3fa640 1 -- 172.21.15.53:0/1323972903 shutdown_connections 2023-06-10T18:53:36.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.908+0000 7fdaeb3fa640 1 --2- 172.21.15.53:0/1323972903 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdae415c7f0 0x7fdae415f320 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:36.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.908+0000 7fdaeb3fa640 1 -- 172.21.15.53:0/1323972903 >> 172.21.15.53:0/1323972903 conn(0x7fdae406a090 msgr2=0x7fdae406d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:36.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.908+0000 7fdaeb3fa640 1 -- 172.21.15.53:0/1323972903 shutdown_connections 2023-06-10T18:53:36.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.908+0000 7fdaeb3fa640 1 -- 172.21.15.53:0/1323972903 wait complete. 2023-06-10T18:53:36.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.908+0000 7fdaeb3fa640 1 Processor -- start 2023-06-10T18:53:36.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.908+0000 7fdaeb3fa640 1 -- start start 2023-06-10T18:53:36.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.908+0000 7fdaeb3fa640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdae406b780 0x7fdae40c7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:36.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.908+0000 7fdaeb3fa640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdae415c7f0 0x7fdae4157c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:36.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.908+0000 7fdaeb3fa640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdae415f860 0x7fdae40c54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:36.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.908+0000 7fdaeb3fa640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae40c85a0 con 0x7fdae406b780 2023-06-10T18:53:36.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.908+0000 7fdaeb3fa640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae40c7990 con 0x7fdae415f860 2023-06-10T18:53:36.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.908+0000 7fdaeb3fa640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdae40c7c70 con 0x7fdae415c7f0 2023-06-10T18:53:36.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.908+0000 7fdae9196640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdae406b780 0x7fdae40c7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:36.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.908+0000 7fdae9196640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdae406b780 0x7fdae40c7140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37024/0 (socket says 172.21.15.53:37024) 2023-06-10T18:53:36.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.908+0000 7fdae9196640 1 -- 172.21.15.53:0/1368269061 learned_addr learned my addr 172.21.15.53:0/1368269061 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:36.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.908+0000 7fdae9997640 1 --2- 172.21.15.53:0/1368269061 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdae415f860 0x7fdae40c54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:36.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.908+0000 7fdae9196640 1 -- 172.21.15.53:0/1368269061 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdae415c7f0 msgr2=0x7fdae4157c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:36.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.908+0000 7fdae8995640 1 --2- 172.21.15.53:0/1368269061 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdae415c7f0 0x7fdae4157c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:36.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.908+0000 7fdae9196640 1 --2- 172.21.15.53:0/1368269061 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdae415c7f0 0x7fdae4157c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:36.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.908+0000 7fdae9196640 1 -- 172.21.15.53:0/1368269061 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdae415f860 msgr2=0x7fdae40c54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:36.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.908+0000 7fdae9196640 1 --2- 172.21.15.53:0/1368269061 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdae415f860 0x7fdae40c54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:36.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.908+0000 7fdae9196640 1 -- 172.21.15.53:0/1368269061 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdad4009420 con 0x7fdae406b780 2023-06-10T18:53:36.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.908+0000 7fdae9997640 1 --2- 172.21.15.53:0/1368269061 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdae415f860 0x7fdae40c54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:36.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.908+0000 7fdae9196640 1 --2- 172.21.15.53:0/1368269061 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdae406b780 0x7fdae40c7140 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fdae000b410 tx=0x7fdae000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:36.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.908+0000 7fdad9ffb640 1 -- 172.21.15.53:0/1368269061 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae0004020 con 0x7fdae406b780 2023-06-10T18:53:36.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.912+0000 7fdad9ffb640 1 -- 172.21.15.53:0/1368269061 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdae0004180 con 0x7fdae406b780 2023-06-10T18:53:36.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.912+0000 7fdaeb3fa640 1 -- 172.21.15.53:0/1368269061 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdae40c7f50 con 0x7fdae406b780 2023-06-10T18:53:36.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.912+0000 7fdad9ffb640 1 -- 172.21.15.53:0/1368269061 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae0011630 con 0x7fdae406b780 2023-06-10T18:53:36.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.912+0000 7fdaeb3fa640 1 -- 172.21.15.53:0/1368269061 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdae40c7680 con 0x7fdae406b780 2023-06-10T18:53:36.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.912+0000 7fdaeb3fa640 1 -- 172.21.15.53:0/1368269061 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdae40b1a10 con 0x7fdae406b780 2023-06-10T18:53:36.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.912+0000 7fdad9ffb640 1 -- 172.21.15.53:0/1368269061 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdae0011790 con 0x7fdae406b780 2023-06-10T18:53:36.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.912+0000 7fdad9ffb640 1 --2- 172.21.15.53:0/1368269061 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdac80662b0 0x7fdac8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:36.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.912+0000 7fdad9ffb640 1 -- 172.21.15.53:0/1368269061 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fdae0083a30 con 0x7fdae406b780 2023-06-10T18:53:36.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.912+0000 7fdae8995640 1 --2- 172.21.15.53:0/1368269061 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdac80662b0 0x7fdac8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:36.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.912+0000 7fdae8995640 1 --2- 172.21.15.53:0/1368269061 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdac80662b0 0x7fdac8068760 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fdad40ae000 tx=0x7fdad4004740 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:36.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:36.916+0000 7fdad9ffb640 1 -- 172.21.15.53:0/1368269061 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdae0050f00 con 0x7fdae406b780 2023-06-10T18:53:37.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.064+0000 7fdaeb3fa640 1 -- 172.21.15.53:0/1368269061 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdae404d790 con 0x7fdae406b780 2023-06-10T18:53:37.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.064+0000 7fdad9ffb640 1 -- 172.21.15.53:0/1368269061 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdae00150a0 con 0x7fdae406b780 2023-06-10T18:53:37.073 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-06-10T18:53:37.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.064+0000 7fdaeb3fa640 1 -- 172.21.15.53:0/1368269061 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdac80662b0 msgr2=0x7fdac8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:37.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.064+0000 7fdaeb3fa640 1 --2- 172.21.15.53:0/1368269061 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdac80662b0 0x7fdac8068760 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fdad40ae000 tx=0x7fdad4004740 comp rx=0 tx=0).stop 2023-06-10T18:53:37.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.064+0000 7fdaeb3fa640 1 -- 172.21.15.53:0/1368269061 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdae406b780 msgr2=0x7fdae40c7140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:37.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.064+0000 7fdaeb3fa640 1 --2- 172.21.15.53:0/1368269061 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdae406b780 0x7fdae40c7140 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fdae000b410 tx=0x7fdae000b8d0 comp rx=0 tx=0).stop 2023-06-10T18:53:37.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.064+0000 7fdaeb3fa640 1 -- 172.21.15.53:0/1368269061 shutdown_connections 2023-06-10T18:53:37.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.064+0000 7fdaeb3fa640 1 --2- 172.21.15.53:0/1368269061 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdac80662b0 0x7fdac8068760 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:37.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.064+0000 7fdaeb3fa640 1 --2- 172.21.15.53:0/1368269061 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdae415f860 0x7fdae40c54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:37.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.064+0000 7fdaeb3fa640 1 --2- 172.21.15.53:0/1368269061 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdae415c7f0 0x7fdae4157c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:37.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.064+0000 7fdaeb3fa640 1 --2- 172.21.15.53:0/1368269061 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdae406b780 0x7fdae40c7140 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:37.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.064+0000 7fdaeb3fa640 1 -- 172.21.15.53:0/1368269061 >> 172.21.15.53:0/1368269061 conn(0x7fdae406a090 msgr2=0x7fdae40afaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:37.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.064+0000 7fdaeb3fa640 1 -- 172.21.15.53:0/1368269061 shutdown_connections 2023-06-10T18:53:37.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.064+0000 7fdaeb3fa640 1 -- 172.21.15.53:0/1368269061 wait complete. 2023-06-10T18:53:37.090 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-10T18:53:37.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.200+0000 7efc72beb640 1 Processor -- start 2023-06-10T18:53:37.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.200+0000 7efc72beb640 1 -- start start 2023-06-10T18:53:37.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.200+0000 7efc72beb640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7efc6c156180 0x7efc6c0cd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:37.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.200+0000 7efc72beb640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efc6c15c070 0x7efc6c15c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:37.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.200+0000 7efc72beb640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc6c15ca00 con 0x7efc6c158a80 2023-06-10T18:53:37.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.200+0000 7efc72beb640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc6c06b090 con 0x7efc6c156180 2023-06-10T18:53:37.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.200+0000 7efc72beb640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc6c06efa0 con 0x7efc6c15c070 2023-06-10T18:53:37.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.200+0000 7efc6bfff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efc6c15c070 0x7efc6c15c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:37.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.200+0000 7efc70987640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7efc6c156180 0x7efc6c0cd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:37.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.200+0000 7efc71188640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7efc6c158a80 0x7efc6c158ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.53:44662/0 (socket says 172.21.15.53:44662) 2023-06-10T18:53:37.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.200+0000 7efc70987640 1 --2- 172.21.15.53:0/3857094572 >> v2:172.21.15.117:3300/0 conn(0x7efc6c156180 0x7efc6c0cd4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.53:43826/0 (socket says 172.21.15.53:43826) 2023-06-10T18:53:37.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.200+0000 7efc71188640 1 -- 172.21.15.53:0/3857094572 learned_addr learned my addr 172.21.15.53:0/3857094572 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:53:37.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.200+0000 7efc6bfff640 1 --2- 172.21.15.53:0/3857094572 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efc6c15c070 0x7efc6c15c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.53:48000/0 (socket says 172.21.15.53:48000) 2023-06-10T18:53:37.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.200+0000 7efc70987640 1 -- 172.21.15.53:0/3857094572 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efc6c15c070 msgr2=0x7efc6c15c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:37.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.200+0000 7efc70987640 1 --2- 172.21.15.53:0/3857094572 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efc6c15c070 0x7efc6c15c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:37.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.200+0000 7efc70987640 1 -- 172.21.15.53:0/3857094572 >> v1:172.21.15.117:6789/0 conn(0x7efc6c158a80 legacy=0x7efc6c158ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:37.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.200+0000 7efc70987640 1 -- 172.21.15.53:0/3857094572 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc6c0cc720 con 0x7efc6c156180 2023-06-10T18:53:37.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.204+0000 7efc70987640 1 --2- 172.21.15.53:0/3857094572 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efc6c156180 0x7efc6c0cd4a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7efc600097c0 tx=0x7efc6001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f8593054ed874873 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:37.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.208+0000 7efc6b7fe640 1 -- 172.21.15.53:0/3857094572 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc600ab600 con 0x7efc6c156180 2023-06-10T18:53:37.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.208+0000 7efc6b7fe640 1 -- 172.21.15.53:0/3857094572 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc600a7050 con 0x7efc6c156180 2023-06-10T18:53:37.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.208+0000 7efc6b7fe640 1 -- 172.21.15.53:0/3857094572 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc600ab980 con 0x7efc6c156180 2023-06-10T18:53:37.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.208+0000 7efc72beb640 1 -- 172.21.15.53:0/3857094572 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efc6c156180 msgr2=0x7efc6c0cd4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:37.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.208+0000 7efc72beb640 1 --2- 172.21.15.53:0/3857094572 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efc6c156180 0x7efc6c0cd4a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7efc600097c0 tx=0x7efc6001c480 comp rx=0 tx=0).stop 2023-06-10T18:53:37.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.208+0000 7efc72beb640 1 -- 172.21.15.53:0/3857094572 shutdown_connections 2023-06-10T18:53:37.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.208+0000 7efc72beb640 1 --2- 172.21.15.53:0/3857094572 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efc6c15c070 0x7efc6c15c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:37.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.208+0000 7efc72beb640 1 --2- 172.21.15.53:0/3857094572 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efc6c156180 0x7efc6c0cd4a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:37.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.208+0000 7efc72beb640 1 -- 172.21.15.53:0/3857094572 >> 172.21.15.53:0/3857094572 conn(0x7efc6c06a0e0 msgr2=0x7efc6c0cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:37.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.208+0000 7efc72beb640 1 -- 172.21.15.53:0/3857094572 shutdown_connections 2023-06-10T18:53:37.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.208+0000 7efc72beb640 1 -- 172.21.15.53:0/3857094572 wait complete. 2023-06-10T18:53:37.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.208+0000 7efc72beb640 1 Processor -- start 2023-06-10T18:53:37.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.208+0000 7efc72beb640 1 -- start start 2023-06-10T18:53:37.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.212+0000 7efc72beb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc6c156180 0x7efc6c1525a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:37.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.212+0000 7efc72beb640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efc6c158a80 0x7efc6c0c74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:37.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.212+0000 7efc72beb640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efc6c15c070 0x7efc6c0af7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:37.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.212+0000 7efc72beb640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc6c0ae860 con 0x7efc6c156180 2023-06-10T18:53:37.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.212+0000 7efc72beb640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc6c0aeb00 con 0x7efc6c158a80 2023-06-10T18:53:37.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.212+0000 7efc72beb640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc6c0aede0 con 0x7efc6c15c070 2023-06-10T18:53:37.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.212+0000 7efc70987640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc6c156180 0x7efc6c1525a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:37.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.212+0000 7efc70987640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc6c156180 0x7efc6c1525a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37036/0 (socket says 172.21.15.53:37036) 2023-06-10T18:53:37.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.212+0000 7efc70987640 1 -- 172.21.15.53:0/3844752718 learned_addr learned my addr 172.21.15.53:0/3844752718 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:37.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.212+0000 7efc6bfff640 1 --2- 172.21.15.53:0/3844752718 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efc6c158a80 0x7efc6c0c74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:37.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.212+0000 7efc71188640 1 --2- 172.21.15.53:0/3844752718 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efc6c15c070 0x7efc6c0af7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:37.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.212+0000 7efc70987640 1 -- 172.21.15.53:0/3844752718 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efc6c15c070 msgr2=0x7efc6c0af7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:37.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.212+0000 7efc70987640 1 --2- 172.21.15.53:0/3844752718 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efc6c15c070 0x7efc6c0af7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:37.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.212+0000 7efc70987640 1 -- 172.21.15.53:0/3844752718 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efc6c158a80 msgr2=0x7efc6c0c74d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:37.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.212+0000 7efc70987640 1 --2- 172.21.15.53:0/3844752718 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efc6c158a80 0x7efc6c0c74d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:37.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.212+0000 7efc70987640 1 -- 172.21.15.53:0/3844752718 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc60009420 con 0x7efc6c156180 2023-06-10T18:53:37.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.212+0000 7efc70987640 1 --2- 172.21.15.53:0/3844752718 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc6c156180 0x7efc6c1525a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7efc6001a0b0 tx=0x7efc60019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:37.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.212+0000 7efc697fa640 1 -- 172.21.15.53:0/3844752718 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc600b4410 con 0x7efc6c156180 2023-06-10T18:53:37.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.212+0000 7efc697fa640 1 -- 172.21.15.53:0/3844752718 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc600b4570 con 0x7efc6c156180 2023-06-10T18:53:37.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.212+0000 7efc697fa640 1 -- 172.21.15.53:0/3844752718 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc600b4920 con 0x7efc6c156180 2023-06-10T18:53:37.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.212+0000 7efc72beb640 1 -- 172.21.15.53:0/3844752718 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc6c0af0c0 con 0x7efc6c156180 2023-06-10T18:53:37.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.212+0000 7efc72beb640 1 -- 172.21.15.53:0/3844752718 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc6c152ae0 con 0x7efc6c156180 2023-06-10T18:53:37.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.212+0000 7efc72beb640 1 -- 172.21.15.53:0/3844752718 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc6c04d790 con 0x7efc6c156180 2023-06-10T18:53:37.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.212+0000 7efc697fa640 1 -- 172.21.15.53:0/3844752718 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7efc600b2040 con 0x7efc6c156180 2023-06-10T18:53:37.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.212+0000 7efc697fa640 1 --2- 172.21.15.53:0/3844752718 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efc50066280 0x7efc50068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:37.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.212+0000 7efc697fa640 1 -- 172.21.15.53:0/3844752718 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7efc6011dcf0 con 0x7efc6c156180 2023-06-10T18:53:37.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.212+0000 7efc6bfff640 1 --2- 172.21.15.53:0/3844752718 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efc50066280 0x7efc50068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:37.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.216+0000 7efc6bfff640 1 --2- 172.21.15.53:0/3844752718 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efc50066280 0x7efc50068730 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7efc6c071050 tx=0x7efc58008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:37.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.216+0000 7efc697fa640 1 -- 172.21.15.53:0/3844752718 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7efc600eb090 con 0x7efc6c156180 2023-06-10T18:53:37.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.372+0000 7efc72beb640 1 -- 172.21.15.53:0/3844752718 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7efc6c0af570 con 0x7efc6c156180 2023-06-10T18:53:37.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.372+0000 7efc697fa640 1 -- 172.21.15.53:0/3844752718 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7efc600b0020 con 0x7efc6c156180 2023-06-10T18:53:37.381 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-06-10T18:53:37.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.372+0000 7efc72beb640 1 -- 172.21.15.53:0/3844752718 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efc50066280 msgr2=0x7efc50068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:37.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.372+0000 7efc72beb640 1 --2- 172.21.15.53:0/3844752718 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efc50066280 0x7efc50068730 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7efc6c071050 tx=0x7efc58008040 comp rx=0 tx=0).stop 2023-06-10T18:53:37.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.372+0000 7efc72beb640 1 -- 172.21.15.53:0/3844752718 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc6c156180 msgr2=0x7efc6c1525a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:37.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.372+0000 7efc72beb640 1 --2- 172.21.15.53:0/3844752718 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc6c156180 0x7efc6c1525a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7efc6001a0b0 tx=0x7efc60019220 comp rx=0 tx=0).stop 2023-06-10T18:53:37.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.376+0000 7efc72beb640 1 -- 172.21.15.53:0/3844752718 shutdown_connections 2023-06-10T18:53:37.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.376+0000 7efc72beb640 1 --2- 172.21.15.53:0/3844752718 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efc50066280 0x7efc50068730 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:37.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.376+0000 7efc72beb640 1 --2- 172.21.15.53:0/3844752718 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efc6c15c070 0x7efc6c0af7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:37.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.376+0000 7efc72beb640 1 --2- 172.21.15.53:0/3844752718 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efc6c158a80 0x7efc6c0c74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:37.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.376+0000 7efc72beb640 1 --2- 172.21.15.53:0/3844752718 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc6c156180 0x7efc6c1525a0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:37.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.376+0000 7efc72beb640 1 -- 172.21.15.53:0/3844752718 >> 172.21.15.53:0/3844752718 conn(0x7efc6c06a0e0 msgr2=0x7efc6c0cbd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:37.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.376+0000 7efc72beb640 1 -- 172.21.15.53:0/3844752718 shutdown_connections 2023-06-10T18:53:37.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.376+0000 7efc72beb640 1 -- 172.21.15.53:0/3844752718 wait complete. 2023-06-10T18:53:37.400 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-10T18:53:37.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.516+0000 7fa11f774640 1 Processor -- start 2023-06-10T18:53:37.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.516+0000 7fa11f774640 1 -- start start 2023-06-10T18:53:37.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.516+0000 7fa11f774640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa1180afe70 0x7fa1180c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:37.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.516+0000 7fa11f774640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa11806b090 con 0x7fa1180c82a0 2023-06-10T18:53:37.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.516+0000 7fa11f774640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1180ca370 con 0x7fa1180c9fa0 2023-06-10T18:53:37.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.516+0000 7fa11f774640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa118070d50 con 0x7fa1180afe70 2023-06-10T18:53:37.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.516+0000 7fa11dd11640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa1180afe70 0x7fa1180c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:37.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.516+0000 7fa11dd11640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa1180afe70 0x7fa1180c86f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37042/0 (socket says 172.21.15.53:37042) 2023-06-10T18:53:37.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.516+0000 7fa11dd11640 1 -- 172.21.15.53:0/2865010601 learned_addr learned my addr 172.21.15.53:0/2865010601 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:37.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.516+0000 7fa11cd0f640 1 --1- 172.21.15.53:0/2865010601 >> v1:172.21.15.53:6789/0 conn(0x7fa1180c82a0 0x7fa1180af760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:55954/0 (socket says 172.21.15.53:55954) 2023-06-10T18:53:37.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.516+0000 7fa11dd11640 1 -- 172.21.15.53:0/2865010601 >> v1:172.21.15.117:6789/0 conn(0x7fa1180c9fa0 legacy=0x7fa11806bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:37.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.516+0000 7fa11dd11640 1 -- 172.21.15.53:0/2865010601 >> v1:172.21.15.53:6789/0 conn(0x7fa1180c82a0 legacy=0x7fa1180af760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:37.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.516+0000 7fa10ffff640 1 -- 172.21.15.53:0/2865010601 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1301345553 0 0) 0x7fa11806b090 con 0x7fa1180c82a0 2023-06-10T18:53:37.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.516+0000 7fa11dd11640 1 -- 172.21.15.53:0/2865010601 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa118071030 con 0x7fa1180afe70 2023-06-10T18:53:37.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.520+0000 7fa11dd11640 1 --2- 172.21.15.53:0/2865010601 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1180afe70 0x7fa1180c86f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fa110009e50 tx=0x7fa11001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f3e4ad2a84d64c2 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:37.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.520+0000 7fa10ffff640 1 -- 172.21.15.53:0/2865010601 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1100a57d0 con 0x7fa1180afe70 2023-06-10T18:53:37.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.520+0000 7fa10ffff640 1 -- 172.21.15.53:0/2865010601 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1100a5930 con 0x7fa1180afe70 2023-06-10T18:53:37.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.520+0000 7fa10ffff640 1 -- 172.21.15.53:0/2865010601 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1100a5cc0 con 0x7fa1180afe70 2023-06-10T18:53:37.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.520+0000 7fa11f774640 1 -- 172.21.15.53:0/2865010601 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1180afe70 msgr2=0x7fa1180c86f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:37.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.520+0000 7fa11f774640 1 --2- 172.21.15.53:0/2865010601 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1180afe70 0x7fa1180c86f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fa110009e50 tx=0x7fa11001c910 comp rx=0 tx=0).stop 2023-06-10T18:53:37.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.520+0000 7fa11f774640 1 -- 172.21.15.53:0/2865010601 shutdown_connections 2023-06-10T18:53:37.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.520+0000 7fa11f774640 1 --2- 172.21.15.53:0/2865010601 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1180afe70 0x7fa1180c86f0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:37.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.520+0000 7fa11f774640 1 -- 172.21.15.53:0/2865010601 >> 172.21.15.53:0/2865010601 conn(0x7fa11806a0e0 msgr2=0x7fa1180cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:37.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.520+0000 7fa11f774640 1 -- 172.21.15.53:0/2865010601 shutdown_connections 2023-06-10T18:53:37.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.520+0000 7fa11f774640 1 -- 172.21.15.53:0/2865010601 wait complete. 2023-06-10T18:53:37.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.520+0000 7fa11f774640 1 Processor -- start 2023-06-10T18:53:37.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.520+0000 7fa11f774640 1 -- start start 2023-06-10T18:53:37.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.524+0000 7fa11f774640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1180afe70 0x7fa1180aa8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:37.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.524+0000 7fa11f774640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1180c82a0 0x7fa1180a87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:37.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.524+0000 7fa11f774640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1180c9fa0 0x7fa1180a8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:37.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.524+0000 7fa11f774640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1180c43a0 con 0x7fa1180c82a0 2023-06-10T18:53:37.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.524+0000 7fa11f774640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1180a8340 con 0x7fa1180afe70 2023-06-10T18:53:37.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.524+0000 7fa11f774640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1180a7450 con 0x7fa1180c9fa0 2023-06-10T18:53:37.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.524+0000 7fa11cd0f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1180c82a0 0x7fa1180a87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:37.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.524+0000 7fa11cd0f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1180c82a0 0x7fa1180a87d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37044/0 (socket says 172.21.15.53:37044) 2023-06-10T18:53:37.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.524+0000 7fa11cd0f640 1 -- 172.21.15.53:0/4233878969 learned_addr learned my addr 172.21.15.53:0/4233878969 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:37.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.524+0000 7fa11d510640 1 --2- 172.21.15.53:0/4233878969 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1180afe70 0x7fa1180aa8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:37.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.524+0000 7fa11dd11640 1 --2- 172.21.15.53:0/4233878969 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1180c9fa0 0x7fa1180a8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:37.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.524+0000 7fa11cd0f640 1 -- 172.21.15.53:0/4233878969 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1180c9fa0 msgr2=0x7fa1180a8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:37.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.524+0000 7fa11cd0f640 1 --2- 172.21.15.53:0/4233878969 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1180c9fa0 0x7fa1180a8d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:37.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.524+0000 7fa11cd0f640 1 -- 172.21.15.53:0/4233878969 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1180afe70 msgr2=0x7fa1180aa8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:37.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.524+0000 7fa11cd0f640 1 --2- 172.21.15.53:0/4233878969 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1180afe70 0x7fa1180aa8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:37.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.524+0000 7fa11cd0f640 1 -- 172.21.15.53:0/4233878969 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa110009b30 con 0x7fa1180c82a0 2023-06-10T18:53:37.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.524+0000 7fa11d510640 1 --2- 172.21.15.53:0/4233878969 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1180afe70 0x7fa1180aa8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:53:37.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.524+0000 7fa11cd0f640 1 --2- 172.21.15.53:0/4233878969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1180c82a0 0x7fa1180a87d0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fa1080011f0 tx=0x7fa10800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:37.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.524+0000 7fa10dffb640 1 -- 172.21.15.53:0/4233878969 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1080074e0 con 0x7fa1180c82a0 2023-06-10T18:53:37.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.524+0000 7fa10dffb640 1 -- 172.21.15.53:0/4233878969 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa108007640 con 0x7fa1180c82a0 2023-06-10T18:53:37.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.524+0000 7fa11f774640 1 -- 172.21.15.53:0/4233878969 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1180a7730 con 0x7fa1180c82a0 2023-06-10T18:53:37.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.524+0000 7fa10dffb640 1 -- 172.21.15.53:0/4233878969 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa108004a10 con 0x7fa1180c82a0 2023-06-10T18:53:37.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.524+0000 7fa11f774640 1 -- 172.21.15.53:0/4233878969 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1180a7cf0 con 0x7fa1180c82a0 2023-06-10T18:53:37.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.524+0000 7fa11f774640 1 -- 172.21.15.53:0/4233878969 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa11804d790 con 0x7fa1180c82a0 2023-06-10T18:53:37.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.524+0000 7fa10dffb640 1 -- 172.21.15.53:0/4233878969 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa108004b70 con 0x7fa1180c82a0 2023-06-10T18:53:37.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.524+0000 7fa10dffb640 1 --2- 172.21.15.53:0/4233878969 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa0fc066280 0x7fa0fc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:37.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.524+0000 7fa10dffb640 1 -- 172.21.15.53:0/4233878969 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fa1080832d0 con 0x7fa1180c82a0 2023-06-10T18:53:37.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.524+0000 7fa11d510640 1 --2- 172.21.15.53:0/4233878969 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa0fc066280 0x7fa0fc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:37.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.528+0000 7fa11d510640 1 --2- 172.21.15.53:0/4233878969 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa0fc066280 0x7fa0fc068730 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa1140098b0 tx=0x7fa114008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:37.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.528+0000 7fa10dffb640 1 -- 172.21.15.53:0/4233878969 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa108050710 con 0x7fa1180c82a0 2023-06-10T18:53:37.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.676+0000 7fa11f774640 1 -- 172.21.15.53:0/4233878969 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa1180a8480 con 0x7fa1180c82a0 2023-06-10T18:53:37.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.676+0000 7fa10dffb640 1 -- 172.21.15.53:0/4233878969 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa108053d30 con 0x7fa1180c82a0 2023-06-10T18:53:37.687 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-06-10T18:53:37.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.680+0000 7fa11f774640 1 -- 172.21.15.53:0/4233878969 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa0fc066280 msgr2=0x7fa0fc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:37.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.680+0000 7fa11f774640 1 --2- 172.21.15.53:0/4233878969 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa0fc066280 0x7fa0fc068730 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa1140098b0 tx=0x7fa114008040 comp rx=0 tx=0).stop 2023-06-10T18:53:37.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.680+0000 7fa11f774640 1 -- 172.21.15.53:0/4233878969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1180c82a0 msgr2=0x7fa1180a87d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:37.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.680+0000 7fa11f774640 1 --2- 172.21.15.53:0/4233878969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1180c82a0 0x7fa1180a87d0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fa1080011f0 tx=0x7fa10800c9b0 comp rx=0 tx=0).stop 2023-06-10T18:53:37.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.680+0000 7fa11f774640 1 -- 172.21.15.53:0/4233878969 shutdown_connections 2023-06-10T18:53:37.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.680+0000 7fa11f774640 1 --2- 172.21.15.53:0/4233878969 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa0fc066280 0x7fa0fc068730 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:37.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.680+0000 7fa11f774640 1 --2- 172.21.15.53:0/4233878969 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1180c9fa0 0x7fa1180a8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:37.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.680+0000 7fa11f774640 1 --2- 172.21.15.53:0/4233878969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1180c82a0 0x7fa1180a87d0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:37.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.680+0000 7fa11f774640 1 --2- 172.21.15.53:0/4233878969 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1180afe70 0x7fa1180aa8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:37.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.680+0000 7fa11f774640 1 -- 172.21.15.53:0/4233878969 >> 172.21.15.53:0/4233878969 conn(0x7fa11806a0e0 msgr2=0x7fa1180c4e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:37.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.680+0000 7fa11f774640 1 -- 172.21.15.53:0/4233878969 shutdown_connections 2023-06-10T18:53:37.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.680+0000 7fa11f774640 1 -- 172.21.15.53:0/4233878969 wait complete. 2023-06-10T18:53:37.704 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-10T18:53:37.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.820+0000 7fb8b57aa640 1 Processor -- start 2023-06-10T18:53:37.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.820+0000 7fb8b57aa640 1 -- start start 2023-06-10T18:53:37.832 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.824+0000 7fb8b57aa640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb8b00c9fa0 0x7fb8b006bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:37.832 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.824+0000 7fb8b57aa640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8b006b090 con 0x7fb8b006c020 2023-06-10T18:53:37.832 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.824+0000 7fb8b57aa640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8b00ca370 con 0x7fb8b00af760 2023-06-10T18:53:37.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.824+0000 7fb8b57aa640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8b0070d50 con 0x7fb8b00c9fa0 2023-06-10T18:53:37.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.824+0000 7fb8aeffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb8b00c9fa0 0x7fb8b006bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:37.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.824+0000 7fb8ae7fc640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fb8b006c020 0x7fb8b00c82a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:55970/0 (socket says 172.21.15.53:55970) 2023-06-10T18:53:37.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.824+0000 7fb8aeffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb8b00c9fa0 0x7fb8b006bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37052/0 (socket says 172.21.15.53:37052) 2023-06-10T18:53:37.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.824+0000 7fb8ae7fc640 1 -- 172.21.15.53:0/2259197065 learned_addr learned my addr 172.21.15.53:0/2259197065 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:53:37.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.824+0000 7fb8aeffd640 1 -- 172.21.15.53:0/2259197065 >> v1:172.21.15.117:6789/0 conn(0x7fb8b00af760 legacy=0x7fb8b00700e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:37.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.824+0000 7fb8aeffd640 1 -- 172.21.15.53:0/2259197065 >> v1:172.21.15.53:6789/0 conn(0x7fb8b006c020 legacy=0x7fb8b00c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:37.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.824+0000 7fb8adffb640 1 -- 172.21.15.53:0/2259197065 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 347175947 0 0) 0x7fb8b006b090 con 0x7fb8b006c020 2023-06-10T18:53:37.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.824+0000 7fb8aeffd640 1 -- 172.21.15.53:0/2259197065 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b0071030 con 0x7fb8b00c9fa0 2023-06-10T18:53:37.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.824+0000 7fb8aeffd640 1 --2- 172.21.15.53:0/2259197065 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8b00c9fa0 0x7fb8b006bae0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fb8a00097c0 tx=0x7fb8a001c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc21f8bf441eb406 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:37.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.824+0000 7fb8adffb640 1 -- 172.21.15.53:0/2259197065 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a00ad680 con 0x7fb8b00c9fa0 2023-06-10T18:53:37.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.824+0000 7fb8adffb640 1 -- 172.21.15.53:0/2259197065 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a00ad7e0 con 0x7fb8b00c9fa0 2023-06-10T18:53:37.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.824+0000 7fb8adffb640 1 -- 172.21.15.53:0/2259197065 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a00adb70 con 0x7fb8b00c9fa0 2023-06-10T18:53:37.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.828+0000 7fb8b57aa640 1 -- 172.21.15.53:0/2259197065 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8b00c9fa0 msgr2=0x7fb8b006bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:37.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.828+0000 7fb8b57aa640 1 --2- 172.21.15.53:0/2259197065 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8b00c9fa0 0x7fb8b006bae0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fb8a00097c0 tx=0x7fb8a001c380 comp rx=0 tx=0).stop 2023-06-10T18:53:37.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.828+0000 7fb8b57aa640 1 -- 172.21.15.53:0/2259197065 shutdown_connections 2023-06-10T18:53:37.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.828+0000 7fb8b57aa640 1 --2- 172.21.15.53:0/2259197065 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8b00c9fa0 0x7fb8b006bae0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:37.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.828+0000 7fb8b57aa640 1 -- 172.21.15.53:0/2259197065 >> 172.21.15.53:0/2259197065 conn(0x7fb8b006a0e0 msgr2=0x7fb8b00cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:37.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.828+0000 7fb8b57aa640 1 -- 172.21.15.53:0/2259197065 shutdown_connections 2023-06-10T18:53:37.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.828+0000 7fb8b57aa640 1 -- 172.21.15.53:0/2259197065 wait complete. 2023-06-10T18:53:37.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.828+0000 7fb8b57aa640 1 Processor -- start 2023-06-10T18:53:37.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.828+0000 7fb8b57aa640 1 -- start start 2023-06-10T18:53:37.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.828+0000 7fb8b57aa640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8b006c020 0x7fb8b01519e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:37.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.828+0000 7fb8b57aa640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8b00af760 0x7fb8b0154630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:37.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.828+0000 7fb8b57aa640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8b00c9fa0 0x7fb8b0153dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:37.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.828+0000 7fb8b57aa640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b0151f20 con 0x7fb8b006c020 2023-06-10T18:53:37.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.828+0000 7fb8b57aa640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b0152a40 con 0x7fb8b00af760 2023-06-10T18:53:37.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.828+0000 7fb8b57aa640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b0152d20 con 0x7fb8b00c9fa0 2023-06-10T18:53:37.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.828+0000 7fb8aeffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8b006c020 0x7fb8b01519e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:37.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.828+0000 7fb8aeffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8b006c020 0x7fb8b01519e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37066/0 (socket says 172.21.15.53:37066) 2023-06-10T18:53:37.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.828+0000 7fb8aeffd640 1 -- 172.21.15.53:0/4106334853 learned_addr learned my addr 172.21.15.53:0/4106334853 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:37.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.828+0000 7fb8ae7fc640 1 --2- 172.21.15.53:0/4106334853 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8b00af760 0x7fb8b0154630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:37.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.828+0000 7fb8af7fe640 1 --2- 172.21.15.53:0/4106334853 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8b00c9fa0 0x7fb8b0153dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:37.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.828+0000 7fb8aeffd640 1 -- 172.21.15.53:0/4106334853 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8b00c9fa0 msgr2=0x7fb8b0153dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:37.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.828+0000 7fb8aeffd640 1 --2- 172.21.15.53:0/4106334853 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8b00c9fa0 0x7fb8b0153dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:37.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.828+0000 7fb8aeffd640 1 -- 172.21.15.53:0/4106334853 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8b00af760 msgr2=0x7fb8b0154630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:37.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.828+0000 7fb8aeffd640 1 --2- 172.21.15.53:0/4106334853 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8b00af760 0x7fb8b0154630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:37.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.828+0000 7fb8aeffd640 1 -- 172.21.15.53:0/4106334853 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8a0009420 con 0x7fb8b006c020 2023-06-10T18:53:37.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.828+0000 7fb8af7fe640 1 --2- 172.21.15.53:0/4106334853 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8b00c9fa0 0x7fb8b0153dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:37.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.828+0000 7fb8aeffd640 1 --2- 172.21.15.53:0/4106334853 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8b006c020 0x7fb8b01519e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fb8a0018f90 tx=0x7fb8a0019120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:37.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.832+0000 7fb8a77fe640 1 -- 172.21.15.53:0/4106334853 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a00ade20 con 0x7fb8b006c020 2023-06-10T18:53:37.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.832+0000 7fb8a77fe640 1 -- 172.21.15.53:0/4106334853 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a0004020 con 0x7fb8b006c020 2023-06-10T18:53:37.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.832+0000 7fb8a77fe640 1 -- 172.21.15.53:0/4106334853 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a00043b0 con 0x7fb8b006c020 2023-06-10T18:53:37.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.832+0000 7fb8b57aa640 1 -- 172.21.15.53:0/4106334853 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8b0153000 con 0x7fb8b006c020 2023-06-10T18:53:37.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.832+0000 7fb8b57aa640 1 -- 172.21.15.53:0/4106334853 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8b01535c0 con 0x7fb8b006c020 2023-06-10T18:53:37.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.832+0000 7fb8b57aa640 1 -- 172.21.15.53:0/4106334853 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8b004d790 con 0x7fb8b006c020 2023-06-10T18:53:37.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.832+0000 7fb8a77fe640 1 -- 172.21.15.53:0/4106334853 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb8a00b4040 con 0x7fb8b006c020 2023-06-10T18:53:37.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.832+0000 7fb8a77fe640 1 --2- 172.21.15.53:0/4106334853 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb890066280 0x7fb890068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:37.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.832+0000 7fb8a77fe640 1 -- 172.21.15.53:0/4106334853 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fb8a011df70 con 0x7fb8b006c020 2023-06-10T18:53:37.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.832+0000 7fb8ae7fc640 1 --2- 172.21.15.53:0/4106334853 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb890066280 0x7fb890068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:37.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.832+0000 7fb8ae7fc640 1 --2- 172.21.15.53:0/4106334853 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb890066280 0x7fb890068730 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb898007fd0 tx=0x7fb898007ee0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:37.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.836+0000 7fb8a77fe640 1 -- 172.21.15.53:0/4106334853 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb8a00eb310 con 0x7fb8b006c020 2023-06-10T18:53:37.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.984+0000 7fb8b57aa640 1 -- 172.21.15.53:0/4106334853 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb8b0142a10 con 0x7fb8b006c020 2023-06-10T18:53:37.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.988+0000 7fb8a77fe640 1 -- 172.21.15.53:0/4106334853 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb8a00b2020 con 0x7fb8b006c020 2023-06-10T18:53:37.996 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-06-10T18:53:37.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.988+0000 7fb8b57aa640 1 -- 172.21.15.53:0/4106334853 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb890066280 msgr2=0x7fb890068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:37.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.988+0000 7fb8b57aa640 1 --2- 172.21.15.53:0/4106334853 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb890066280 0x7fb890068730 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb898007fd0 tx=0x7fb898007ee0 comp rx=0 tx=0).stop 2023-06-10T18:53:37.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.988+0000 7fb8b57aa640 1 -- 172.21.15.53:0/4106334853 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8b006c020 msgr2=0x7fb8b01519e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:37.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.988+0000 7fb8b57aa640 1 --2- 172.21.15.53:0/4106334853 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8b006c020 0x7fb8b01519e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fb8a0018f90 tx=0x7fb8a0019120 comp rx=0 tx=0).stop 2023-06-10T18:53:37.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.988+0000 7fb8b57aa640 1 -- 172.21.15.53:0/4106334853 shutdown_connections 2023-06-10T18:53:38.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.988+0000 7fb8b57aa640 1 --2- 172.21.15.53:0/4106334853 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb890066280 0x7fb890068730 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:38.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.988+0000 7fb8b57aa640 1 --2- 172.21.15.53:0/4106334853 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8b00c9fa0 0x7fb8b0153dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:38.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.988+0000 7fb8b57aa640 1 --2- 172.21.15.53:0/4106334853 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8b00af760 0x7fb8b0154630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:38.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.988+0000 7fb8b57aa640 1 --2- 172.21.15.53:0/4106334853 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8b006c020 0x7fb8b01519e0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:38.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.988+0000 7fb8b57aa640 1 -- 172.21.15.53:0/4106334853 >> 172.21.15.53:0/4106334853 conn(0x7fb8b006a0e0 msgr2=0x7fb8b00ac0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:38.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.988+0000 7fb8b57aa640 1 -- 172.21.15.53:0/4106334853 shutdown_connections 2023-06-10T18:53:38.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:37.988+0000 7fb8b57aa640 1 -- 172.21.15.53:0/4106334853 wait complete. 2023-06-10T18:53:38.015 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-10T18:53:38.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.120+0000 7fb22e21e640 1 Processor -- start 2023-06-10T18:53:38.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.120+0000 7fb22e21e640 1 -- start start 2023-06-10T18:53:38.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.120+0000 7fb22e21e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb228152e70 0x7fb2280c8d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:38.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.120+0000 7fb22e21e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb22815c240 0x7fb22815c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:38.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.120+0000 7fb22e21e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb228158c00 0x7fb228159080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:38.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.120+0000 7fb22e21e640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb22815cbd0 con 0x7fb22815c240 2023-06-10T18:53:38.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.120+0000 7fb22e21e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb22815d090 con 0x7fb228158c00 2023-06-10T18:53:38.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.120+0000 7fb22e21e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2280cdac0 con 0x7fb228152e70 2023-06-10T18:53:38.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.120+0000 7fb226ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb22815c240 0x7fb22815c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:38.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.120+0000 7fb226ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb22815c240 0x7fb22815c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37082/0 (socket says 172.21.15.53:37082) 2023-06-10T18:53:38.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.120+0000 7fb226ffd640 1 -- 172.21.15.53:0/2309449405 learned_addr learned my addr 172.21.15.53:0/2309449405 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:38.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.120+0000 7fb227fff640 1 --2- 172.21.15.53:0/2309449405 >> v2:172.21.15.117:3300/0 conn(0x7fb228158c00 0x7fb228159080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:38.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.120+0000 7fb2277fe640 1 --2- 172.21.15.53:0/2309449405 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb228152e70 0x7fb2280c8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:38.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.120+0000 7fb226ffd640 1 -- 172.21.15.53:0/2309449405 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb228152e70 msgr2=0x7fb2280c8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:38.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.120+0000 7fb226ffd640 1 --2- 172.21.15.53:0/2309449405 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb228152e70 0x7fb2280c8d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:38.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.120+0000 7fb226ffd640 1 -- 172.21.15.53:0/2309449405 >> v2:172.21.15.117:3300/0 conn(0x7fb228158c00 msgr2=0x7fb228159080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:38.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.120+0000 7fb226ffd640 1 --2- 172.21.15.53:0/2309449405 >> v2:172.21.15.117:3300/0 conn(0x7fb228158c00 0x7fb228159080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:38.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.120+0000 7fb226ffd640 1 -- 172.21.15.53:0/2309449405 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2280ccf40 con 0x7fb22815c240 2023-06-10T18:53:38.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.124+0000 7fb226ffd640 1 --2- 172.21.15.53:0/2309449405 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb22815c240 0x7fb22815c690 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fb22806ee50 tx=0x7fb21001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=779e7751aadf36a6 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:38.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.124+0000 7fb2267fc640 1 -- 172.21.15.53:0/2309449405 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2100aa5f0 con 0x7fb22815c240 2023-06-10T18:53:38.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.124+0000 7fb2267fc640 1 -- 172.21.15.53:0/2309449405 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2100aa750 con 0x7fb22815c240 2023-06-10T18:53:38.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.124+0000 7fb2267fc640 1 -- 172.21.15.53:0/2309449405 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2100aaae0 con 0x7fb22815c240 2023-06-10T18:53:38.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.124+0000 7fb22e21e640 1 -- 172.21.15.53:0/2309449405 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb22815c240 msgr2=0x7fb22815c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:38.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.124+0000 7fb22e21e640 1 --2- 172.21.15.53:0/2309449405 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb22815c240 0x7fb22815c690 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fb22806ee50 tx=0x7fb21001c4d0 comp rx=0 tx=0).stop 2023-06-10T18:53:38.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.124+0000 7fb22e21e640 1 -- 172.21.15.53:0/2309449405 shutdown_connections 2023-06-10T18:53:38.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.124+0000 7fb22e21e640 1 --2- 172.21.15.53:0/2309449405 >> v2:172.21.15.117:3300/0 conn(0x7fb228158c00 0x7fb228159080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:38.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.124+0000 7fb22e21e640 1 --2- 172.21.15.53:0/2309449405 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb22815c240 0x7fb22815c690 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:38.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.124+0000 7fb22e21e640 1 --2- 172.21.15.53:0/2309449405 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb228152e70 0x7fb2280c8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:38.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.124+0000 7fb22e21e640 1 -- 172.21.15.53:0/2309449405 >> 172.21.15.53:0/2309449405 conn(0x7fb2280ce9e0 msgr2=0x7fb2280ca7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:38.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.124+0000 7fb22e21e640 1 -- 172.21.15.53:0/2309449405 shutdown_connections 2023-06-10T18:53:38.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.124+0000 7fb22e21e640 1 -- 172.21.15.53:0/2309449405 wait complete. 2023-06-10T18:53:38.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.124+0000 7fb22e21e640 1 Processor -- start 2023-06-10T18:53:38.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.124+0000 7fb22e21e640 1 -- start start 2023-06-10T18:53:38.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.128+0000 7fb22e21e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb228152e70 0x7fb228070cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:38.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.128+0000 7fb22e21e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb228158c00 0x7fb22814ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:38.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.128+0000 7fb22e21e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb22815c240 0x7fb228146aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:38.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.128+0000 7fb22e21e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2280b38c0 con 0x7fb22815c240 2023-06-10T18:53:38.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.128+0000 7fb22e21e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2280c3940 con 0x7fb228152e70 2023-06-10T18:53:38.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.128+0000 7fb22e21e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2280c3c20 con 0x7fb228158c00 2023-06-10T18:53:38.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.128+0000 7fb227fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb22815c240 0x7fb228146aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:38.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.128+0000 7fb227fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb22815c240 0x7fb228146aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37084/0 (socket says 172.21.15.53:37084) 2023-06-10T18:53:38.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.128+0000 7fb227fff640 1 -- 172.21.15.53:0/1055137775 learned_addr learned my addr 172.21.15.53:0/1055137775 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:38.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.128+0000 7fb2277fe640 1 --2- 172.21.15.53:0/1055137775 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb228152e70 0x7fb228070cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:38.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.128+0000 7fb226ffd640 1 --2- 172.21.15.53:0/1055137775 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb228158c00 0x7fb22814ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:38.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.128+0000 7fb227fff640 1 -- 172.21.15.53:0/1055137775 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb228158c00 msgr2=0x7fb22814ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:38.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.128+0000 7fb227fff640 1 --2- 172.21.15.53:0/1055137775 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb228158c00 0x7fb22814ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:38.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.128+0000 7fb227fff640 1 -- 172.21.15.53:0/1055137775 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb228152e70 msgr2=0x7fb228070cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:38.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.128+0000 7fb227fff640 1 --2- 172.21.15.53:0/1055137775 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb228152e70 0x7fb228070cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:38.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.128+0000 7fb227fff640 1 -- 172.21.15.53:0/1055137775 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2100094d0 con 0x7fb22815c240 2023-06-10T18:53:38.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.128+0000 7fb2277fe640 1 --2- 172.21.15.53:0/1055137775 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb228152e70 0x7fb228070cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:53:38.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.128+0000 7fb227fff640 1 --2- 172.21.15.53:0/1055137775 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb22815c240 0x7fb228146aa0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fb21800d560 tx=0x7fb21800da20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:38.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.128+0000 7fb21ffff640 1 -- 172.21.15.53:0/1055137775 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2180125f0 con 0x7fb22815c240 2023-06-10T18:53:38.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.128+0000 7fb21ffff640 1 -- 172.21.15.53:0/1055137775 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb218012770 con 0x7fb22815c240 2023-06-10T18:53:38.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.128+0000 7fb22e21e640 1 -- 172.21.15.53:0/1055137775 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2280c3f00 con 0x7fb22815c240 2023-06-10T18:53:38.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.128+0000 7fb21ffff640 1 -- 172.21.15.53:0/1055137775 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb218012b20 con 0x7fb22815c240 2023-06-10T18:53:38.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.128+0000 7fb22e21e640 1 -- 172.21.15.53:0/1055137775 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2280c35f0 con 0x7fb22815c240 2023-06-10T18:53:38.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.128+0000 7fb22e21e640 1 -- 172.21.15.53:0/1055137775 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2280c4140 con 0x7fb22815c240 2023-06-10T18:53:38.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.128+0000 7fb21ffff640 1 -- 172.21.15.53:0/1055137775 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb218012c80 con 0x7fb22815c240 2023-06-10T18:53:38.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.128+0000 7fb21ffff640 1 --2- 172.21.15.53:0/1055137775 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb208066280 0x7fb208068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:38.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.128+0000 7fb21ffff640 1 -- 172.21.15.53:0/1055137775 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fb218084250 con 0x7fb22815c240 2023-06-10T18:53:38.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.128+0000 7fb2277fe640 1 --2- 172.21.15.53:0/1055137775 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb208066280 0x7fb208068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:38.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.132+0000 7fb2277fe640 1 --2- 172.21.15.53:0/1055137775 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb208066280 0x7fb208068730 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb22814d8c0 tx=0x7fb2200075f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:38.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.132+0000 7fb21ffff640 1 -- 172.21.15.53:0/1055137775 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb218051690 con 0x7fb22815c240 2023-06-10T18:53:38.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.300+0000 7fb22e21e640 1 -- 172.21.15.53:0/1055137775 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb22804d790 con 0x7fb22815c240 2023-06-10T18:53:38.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.300+0000 7fb21ffff640 1 -- 172.21.15.53:0/1055137775 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb218054cb0 con 0x7fb22815c240 2023-06-10T18:53:38.309 INFO:teuthology.orchestra.run.smithi053.stderr:listed 0 entries 2023-06-10T18:53:38.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.304+0000 7fb22e21e640 1 -- 172.21.15.53:0/1055137775 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb208066280 msgr2=0x7fb208068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:38.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.304+0000 7fb22e21e640 1 --2- 172.21.15.53:0/1055137775 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb208066280 0x7fb208068730 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb22814d8c0 tx=0x7fb2200075f0 comp rx=0 tx=0).stop 2023-06-10T18:53:38.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.304+0000 7fb22e21e640 1 -- 172.21.15.53:0/1055137775 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb22815c240 msgr2=0x7fb228146aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:38.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.304+0000 7fb22e21e640 1 --2- 172.21.15.53:0/1055137775 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb22815c240 0x7fb228146aa0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fb21800d560 tx=0x7fb21800da20 comp rx=0 tx=0).stop 2023-06-10T18:53:38.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.304+0000 7fb22e21e640 1 -- 172.21.15.53:0/1055137775 shutdown_connections 2023-06-10T18:53:38.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.304+0000 7fb22e21e640 1 --2- 172.21.15.53:0/1055137775 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb208066280 0x7fb208068730 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:38.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.304+0000 7fb22e21e640 1 --2- 172.21.15.53:0/1055137775 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb22815c240 0x7fb228146aa0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:38.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.304+0000 7fb22e21e640 1 --2- 172.21.15.53:0/1055137775 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb228158c00 0x7fb22814ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:38.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.304+0000 7fb22e21e640 1 --2- 172.21.15.53:0/1055137775 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb228152e70 0x7fb228070cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:38.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.304+0000 7fb22e21e640 1 -- 172.21.15.53:0/1055137775 >> 172.21.15.53:0/1055137775 conn(0x7fb2280ce9e0 msgr2=0x7fb2280aeb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:38.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.304+0000 7fb22e21e640 1 -- 172.21.15.53:0/1055137775 shutdown_connections 2023-06-10T18:53:38.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.304+0000 7fb22e21e640 1 -- 172.21.15.53:0/1055137775 wait complete. 2023-06-10T18:53:38.327 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T18:53:38.328 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T18:53:38.334 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T18:53:38.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.444+0000 7f06114a2640 1 Processor -- start 2023-06-10T18:53:38.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.444+0000 7f06114a2640 1 -- start start 2023-06-10T18:53:38.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.448+0000 7f06114a2640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f060c071060 0x7f060c0af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:38.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.448+0000 7f06114a2640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f060c0afc60 0x7f060c06b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:38.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.448+0000 7f06114a2640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f060c159b50 con 0x7f060c0c9840 2023-06-10T18:53:38.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.448+0000 7f06114a2640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f060c0702a0 con 0x7f060c071060 2023-06-10T18:53:38.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.448+0000 7f06114a2640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f060c070580 con 0x7f060c0afc60 2023-06-10T18:53:38.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.448+0000 7f060a7fc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f060c071060 0x7f060c0af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:38.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.448+0000 7f060a7fc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f060c071060 0x7f060c0af720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37100/0 (socket says 172.21.15.53:37100) 2023-06-10T18:53:38.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.448+0000 7f060a7fc640 1 -- 172.21.15.53:0/2761067503 learned_addr learned my addr 172.21.15.53:0/2761067503 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:38.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.448+0000 7f060b7fe640 1 --2- 172.21.15.53:0/2761067503 >> v2:172.21.15.117:3300/0 conn(0x7f060c0afc60 0x7f060c06b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:38.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.448+0000 7f060a7fc640 1 -- 172.21.15.53:0/2761067503 >> v2:172.21.15.117:3300/0 conn(0x7f060c0afc60 msgr2=0x7f060c06b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:38.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.448+0000 7f060a7fc640 1 --2- 172.21.15.53:0/2761067503 >> v2:172.21.15.117:3300/0 conn(0x7f060c0afc60 0x7f060c06b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:38.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.448+0000 7f060a7fc640 1 -- 172.21.15.53:0/2761067503 >> v1:172.21.15.117:6789/0 conn(0x7f060c0c9840 legacy=0x7f060c0c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:38.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.448+0000 7f060a7fc640 1 -- 172.21.15.53:0/2761067503 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f060c070860 con 0x7f060c071060 2023-06-10T18:53:38.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.448+0000 7f060b7fe640 1 --2- 172.21.15.53:0/2761067503 >> v2:172.21.15.117:3300/0 conn(0x7f060c0afc60 0x7f060c06b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:38.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.448+0000 7f060a7fc640 1 --2- 172.21.15.53:0/2761067503 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f060c071060 0x7f060c0af720 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f060c15e360 tx=0x7f060001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5b3482d23c49b2a server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:38.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.448+0000 7f0609ffb640 1 -- 172.21.15.53:0/2761067503 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06000aa610 con 0x7f060c071060 2023-06-10T18:53:38.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.448+0000 7f0609ffb640 1 -- 172.21.15.53:0/2761067503 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06000a6040 con 0x7f060c071060 2023-06-10T18:53:38.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.448+0000 7f0609ffb640 1 -- 172.21.15.53:0/2761067503 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06000aa990 con 0x7f060c071060 2023-06-10T18:53:38.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.448+0000 7f06114a2640 1 -- 172.21.15.53:0/2761067503 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f060c071060 msgr2=0x7f060c0af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:38.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.448+0000 7f06114a2640 1 --2- 172.21.15.53:0/2761067503 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f060c071060 0x7f060c0af720 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f060c15e360 tx=0x7f060001c490 comp rx=0 tx=0).stop 2023-06-10T18:53:38.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.448+0000 7f06114a2640 1 -- 172.21.15.53:0/2761067503 shutdown_connections 2023-06-10T18:53:38.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.448+0000 7f06114a2640 1 --2- 172.21.15.53:0/2761067503 >> v2:172.21.15.117:3300/0 conn(0x7f060c0afc60 0x7f060c06b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:38.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.448+0000 7f06114a2640 1 --2- 172.21.15.53:0/2761067503 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f060c071060 0x7f060c0af720 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:38.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.448+0000 7f06114a2640 1 -- 172.21.15.53:0/2761067503 >> 172.21.15.53:0/2761067503 conn(0x7f060c06a0d0 msgr2=0x7f060c0ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:38.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.448+0000 7f06114a2640 1 -- 172.21.15.53:0/2761067503 shutdown_connections 2023-06-10T18:53:38.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.448+0000 7f06114a2640 1 -- 172.21.15.53:0/2761067503 wait complete. 2023-06-10T18:53:38.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.452+0000 7f06114a2640 1 Processor -- start 2023-06-10T18:53:38.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.452+0000 7f06114a2640 1 -- start start 2023-06-10T18:53:38.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.452+0000 7f06114a2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f060c071060 0x7f060c142210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:38.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.452+0000 7f06114a2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f060c0afc60 0x7f060c1f3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:38.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.452+0000 7f06114a2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f060c0c9840 0x7f060c0aec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:38.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.452+0000 7f06114a2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f060c153700 con 0x7f060c0afc60 2023-06-10T18:53:38.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.452+0000 7f06114a2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f060c0c40d0 con 0x7f060c0c9840 2023-06-10T18:53:38.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.452+0000 7f06114a2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f060c142750 con 0x7f060c071060 2023-06-10T18:53:38.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.452+0000 7f060a7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f060c0afc60 0x7f060c1f3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:38.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.452+0000 7f060a7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f060c0afc60 0x7f060c1f3b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37112/0 (socket says 172.21.15.53:37112) 2023-06-10T18:53:38.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.452+0000 7f060a7fc640 1 -- 172.21.15.53:0/2494749579 learned_addr learned my addr 172.21.15.53:0/2494749579 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:38.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.452+0000 7f060b7fe640 1 --2- 172.21.15.53:0/2494749579 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f060c0c9840 0x7f060c0aec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:38.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.452+0000 7f060affd640 1 --2- 172.21.15.53:0/2494749579 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f060c071060 0x7f060c142210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:38.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.452+0000 7f060a7fc640 1 -- 172.21.15.53:0/2494749579 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f060c071060 msgr2=0x7f060c142210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:38.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.452+0000 7f060a7fc640 1 --2- 172.21.15.53:0/2494749579 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f060c071060 0x7f060c142210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:38.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.452+0000 7f060a7fc640 1 -- 172.21.15.53:0/2494749579 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f060c0c9840 msgr2=0x7f060c0aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:38.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.452+0000 7f060a7fc640 1 --2- 172.21.15.53:0/2494749579 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f060c0c9840 0x7f060c0aec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:38.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.452+0000 7f060a7fc640 1 -- 172.21.15.53:0/2494749579 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06000094d0 con 0x7f060c0afc60 2023-06-10T18:53:38.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.452+0000 7f060affd640 1 --2- 172.21.15.53:0/2494749579 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f060c071060 0x7f060c142210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:38.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.452+0000 7f060b7fe640 1 --2- 172.21.15.53:0/2494749579 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f060c0c9840 0x7f060c0aec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:38.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.452+0000 7f060a7fc640 1 --2- 172.21.15.53:0/2494749579 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f060c0afc60 0x7f060c1f3b80 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f060001a0c0 tx=0x7f060001acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:38.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.452+0000 7f05f37fe640 1 -- 172.21.15.53:0/2494749579 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06000bd5f0 con 0x7f060c0afc60 2023-06-10T18:53:38.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.452+0000 7f05f37fe640 1 -- 172.21.15.53:0/2494749579 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06000bd750 con 0x7f060c0afc60 2023-06-10T18:53:38.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.452+0000 7f06114a2640 1 -- 172.21.15.53:0/2494749579 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f060c145ac0 con 0x7f060c0afc60 2023-06-10T18:53:38.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.452+0000 7f05f37fe640 1 -- 172.21.15.53:0/2494749579 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06000bdb00 con 0x7f060c0afc60 2023-06-10T18:53:38.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.452+0000 7f06114a2640 1 -- 172.21.15.53:0/2494749579 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f060c0c37a0 con 0x7f060c0afc60 2023-06-10T18:53:38.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.452+0000 7f06114a2640 1 -- 172.21.15.53:0/2494749579 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f060c0c4260 con 0x7f060c0afc60 2023-06-10T18:53:38.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.456+0000 7f05f37fe640 1 -- 172.21.15.53:0/2494749579 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f06000b33f0 con 0x7f060c0afc60 2023-06-10T18:53:38.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.456+0000 7f05f37fe640 1 --2- 172.21.15.53:0/2494749579 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f05f8066280 0x7f05f8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:38.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.456+0000 7f05f37fe640 1 -- 172.21.15.53:0/2494749579 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f060011e9e0 con 0x7f060c0afc60 2023-06-10T18:53:38.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.456+0000 7f060affd640 1 --2- 172.21.15.53:0/2494749579 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f05f8066280 0x7f05f8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:38.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.456+0000 7f060affd640 1 --2- 172.21.15.53:0/2494749579 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f05f8066280 0x7f05f8068730 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f05fc00a850 tx=0x7f05fc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:38.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.456+0000 7f05f37fe640 1 -- 172.21.15.53:0/2494749579 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f06000ec040 con 0x7f060c0afc60 2023-06-10T18:53:38.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.612+0000 7f06114a2640 1 -- 172.21.15.53:0/2494749579 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f060c04d790 con 0x7f060c0afc60 2023-06-10T18:53:38.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.616+0000 7f05f37fe640 1 -- 172.21.15.53:0/2494749579 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18363 (secure 0 0 0) 0x7f06000ef660 con 0x7f060c0afc60 2023-06-10T18:53:38.624 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:53:38.624 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":25,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T18:53:27.127355+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-10T18:52:43.396243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-10T18:52:43.894228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.23","mappings":[{"from":3,"to":2}]},{"pgid":"4.3e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T18:53:38.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.616+0000 7f06114a2640 1 -- 172.21.15.53:0/2494749579 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f05f8066280 msgr2=0x7f05f8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:38.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.616+0000 7f06114a2640 1 --2- 172.21.15.53:0/2494749579 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f05f8066280 0x7f05f8068730 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f05fc00a850 tx=0x7f05fc008040 comp rx=0 tx=0).stop 2023-06-10T18:53:38.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.616+0000 7f06114a2640 1 -- 172.21.15.53:0/2494749579 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f060c0afc60 msgr2=0x7f060c1f3b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:38.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.616+0000 7f06114a2640 1 --2- 172.21.15.53:0/2494749579 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f060c0afc60 0x7f060c1f3b80 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f060001a0c0 tx=0x7f060001acd0 comp rx=0 tx=0).stop 2023-06-10T18:53:38.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.616+0000 7f06114a2640 1 -- 172.21.15.53:0/2494749579 shutdown_connections 2023-06-10T18:53:38.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.616+0000 7f06114a2640 1 --2- 172.21.15.53:0/2494749579 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f05f8066280 0x7f05f8068730 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:38.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.616+0000 7f06114a2640 1 --2- 172.21.15.53:0/2494749579 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f060c0c9840 0x7f060c0aec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:38.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.616+0000 7f06114a2640 1 --2- 172.21.15.53:0/2494749579 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f060c0afc60 0x7f060c1f3b80 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:38.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.616+0000 7f06114a2640 1 --2- 172.21.15.53:0/2494749579 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f060c071060 0x7f060c142210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:38.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.616+0000 7f06114a2640 1 -- 172.21.15.53:0/2494749579 >> 172.21.15.53:0/2494749579 conn(0x7f060c06a0d0 msgr2=0x7f060c0abd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:38.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.616+0000 7f06114a2640 1 -- 172.21.15.53:0/2494749579 shutdown_connections 2023-06-10T18:53:38.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.616+0000 7f06114a2640 1 -- 172.21.15.53:0/2494749579 wait complete. 2023-06-10T18:53:38.643 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-10T18:52:33.633114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-10T18:52:39.171487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-10T18:52:43.396243+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-10T18:52:43.894228+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-10T18:53:38.644 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-10T18:53:38.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.764+0000 7f5074987640 1 Processor -- start 2023-06-10T18:53:38.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.764+0000 7f5074987640 1 -- start start 2023-06-10T18:53:38.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.768+0000 7f5074987640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5070070de0 0x7f507015cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:38.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.768+0000 7f5074987640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50700cc460 con 0x7f50700cc020 2023-06-10T18:53:38.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.768+0000 7f5074987640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50700c8d50 con 0x7f507015c060 2023-06-10T18:53:38.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.768+0000 7f5074987640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50700c9030 con 0x7f5070070de0 2023-06-10T18:53:38.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.768+0000 7f506ed9d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f50700cc020 0x7f507006bd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:55980/0 (socket says 172.21.15.53:55980) 2023-06-10T18:53:38.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.768+0000 7f506ed9d640 1 -- 172.21.15.53:0/1106357680 learned_addr learned my addr 172.21.15.53:0/1106357680 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:53:38.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.768+0000 7f506dd9b640 1 --2- 172.21.15.53:0/1106357680 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5070070de0 0x7f507015cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:38.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.768+0000 7f506d59a640 1 -- 172.21.15.53:0/1106357680 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 234129104 0 0) 0x7f50700cc460 con 0x7f50700cc020 2023-06-10T18:53:38.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.768+0000 7f506d59a640 1 -- 172.21.15.53:0/1106357680 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5058003530 con 0x7f50700cc020 2023-06-10T18:53:38.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.768+0000 7f506d59a640 1 -- 172.21.15.53:0/1106357680 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3333140711 0 0) 0x7f5058003530 con 0x7f50700cc020 2023-06-10T18:53:38.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.768+0000 7f506d59a640 1 -- 172.21.15.53:0/1106357680 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5070070de0 msgr2=0x7f507015cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:38.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.768+0000 7f506d59a640 1 --2- 172.21.15.53:0/1106357680 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5070070de0 0x7f507015cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:38.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.768+0000 7f506d59a640 1 -- 172.21.15.53:0/1106357680 >> v1:172.21.15.117:6789/0 conn(0x7f507015c060 legacy=0x7f507015c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:38.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.768+0000 7f506d59a640 1 -- 172.21.15.53:0/1106357680 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5070070300 con 0x7f50700cc020 2023-06-10T18:53:38.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.768+0000 7f506d59a640 1 -- 172.21.15.53:0/1106357680 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f5068001a00 con 0x7f50700cc020 2023-06-10T18:53:38.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.768+0000 7f506d59a640 1 -- 172.21.15.53:0/1106357680 >> v1:172.21.15.53:6789/0 conn(0x7f50700cc020 legacy=0x7f507006bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:38.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.768+0000 7f506d59a640 1 --2- 172.21.15.53:0/1106357680 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50580039b0 0x7f5058003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:38.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.768+0000 7f506d59a640 1 --2- 172.21.15.53:0/1106357680 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50580047d0 0x7f5058004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:38.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.768+0000 7f506d59a640 1 --2- 172.21.15.53:0/1106357680 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5070070de0 0x7f50580051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:38.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.768+0000 7f506d59a640 1 -- 172.21.15.53:0/1106357680 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50700c9030 con 0x7f50580047d0 2023-06-10T18:53:38.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.768+0000 7f506d59a640 1 -- 172.21.15.53:0/1106357680 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f505800ba90 con 0x7f50580039b0 2023-06-10T18:53:38.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.768+0000 7f506d59a640 1 -- 172.21.15.53:0/1106357680 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f505800bc50 con 0x7f5070070de0 2023-06-10T18:53:38.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.768+0000 7f506dd9b640 1 --2- 172.21.15.53:0/1106357680 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50580047d0 0x7f5058004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:38.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.768+0000 7f506ed9d640 1 --2- 172.21.15.53:0/1106357680 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5070070de0 0x7f50580051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:38.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.768+0000 7f506e59c640 1 --2- 172.21.15.53:0/1106357680 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50580039b0 0x7f5058003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:38.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.768+0000 7f506dd9b640 1 -- 172.21.15.53:0/1106357680 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5070070de0 msgr2=0x7f50580051a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:38.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.768+0000 7f506dd9b640 1 --2- 172.21.15.53:0/1106357680 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5070070de0 0x7f50580051a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:38.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.768+0000 7f506dd9b640 1 -- 172.21.15.53:0/1106357680 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50580039b0 msgr2=0x7f5058003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:38.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.768+0000 7f506dd9b640 1 --2- 172.21.15.53:0/1106357680 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50580039b0 0x7f5058003dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:38.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.768+0000 7f506dd9b640 1 -- 172.21.15.53:0/1106357680 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5058003530 con 0x7f50580047d0 2023-06-10T18:53:38.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.768+0000 7f506ed9d640 1 --2- 172.21.15.53:0/1106357680 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5070070de0 0x7f50580051a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:38.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.772+0000 7f506dd9b640 1 --2- 172.21.15.53:0/1106357680 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50580047d0 0x7f5058004c40 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f506400bd80 tx=0x7f506401f370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d9614d47a0b74fc server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:38.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.772+0000 7f506d59a640 1 -- 172.21.15.53:0/1106357680 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50640ae600 con 0x7f50580047d0 2023-06-10T18:53:38.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.772+0000 7f506d59a640 1 -- 172.21.15.53:0/1106357680 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50640aa050 con 0x7f50580047d0 2023-06-10T18:53:38.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.772+0000 7f506d59a640 1 -- 172.21.15.53:0/1106357680 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50640ae9a0 con 0x7f50580047d0 2023-06-10T18:53:38.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.772+0000 7f5074987640 1 -- 172.21.15.53:0/1106357680 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50580047d0 msgr2=0x7f5058004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:38.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.772+0000 7f5074987640 1 --2- 172.21.15.53:0/1106357680 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50580047d0 0x7f5058004c40 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f506400bd80 tx=0x7f506401f370 comp rx=0 tx=0).stop 2023-06-10T18:53:38.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.772+0000 7f506ed9d640 1 -- 172.21.15.53:0/1106357680 reap_dead start 2023-06-10T18:53:38.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.772+0000 7f5074987640 1 -- 172.21.15.53:0/1106357680 shutdown_connections 2023-06-10T18:53:38.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.772+0000 7f5074987640 1 -- 172.21.15.53:0/1106357680 >> 172.21.15.53:0/1106357680 conn(0x7f507006a0e0 msgr2=0x7f50700cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:38.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.772+0000 7f5074987640 1 -- 172.21.15.53:0/1106357680 shutdown_connections 2023-06-10T18:53:38.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.772+0000 7f5074987640 1 -- 172.21.15.53:0/1106357680 wait complete. 2023-06-10T18:53:38.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.772+0000 7f5074987640 1 Processor -- start 2023-06-10T18:53:38.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.772+0000 7f5074987640 1 -- start start 2023-06-10T18:53:38.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.772+0000 7f5074987640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50580047d0 0x7f50700b3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:38.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.772+0000 7f5074987640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5070155dd0 0x7f5070156240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:38.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.772+0000 7f5074987640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5070153640 0x7f5070153ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:38.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.772+0000 7f5074987640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5070153ff0 con 0x7f5070155dd0 2023-06-10T18:53:38.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.772+0000 7f5074987640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f507014fda0 con 0x7f5070153640 2023-06-10T18:53:38.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.772+0000 7f5074987640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f507014f470 con 0x7f50580047d0 2023-06-10T18:53:38.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.772+0000 7f506dd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5070155dd0 0x7f5070156240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:38.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.772+0000 7f506dd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5070155dd0 0x7f5070156240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37136/0 (socket says 172.21.15.53:37136) 2023-06-10T18:53:38.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.772+0000 7f506dd9b640 1 -- 172.21.15.53:0/3609651496 learned_addr learned my addr 172.21.15.53:0/3609651496 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:38.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.772+0000 7f506ed9d640 1 --2- 172.21.15.53:0/3609651496 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5070153640 0x7f5070153ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:38.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.772+0000 7f506dd9b640 1 -- 172.21.15.53:0/3609651496 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50580047d0 msgr2=0x7f50700b3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:38.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.772+0000 7f506dd9b640 1 --2- 172.21.15.53:0/3609651496 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50580047d0 0x7f50700b3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:38.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.772+0000 7f506dd9b640 1 -- 172.21.15.53:0/3609651496 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5070153640 msgr2=0x7f5070153ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:38.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.772+0000 7f506dd9b640 1 --2- 172.21.15.53:0/3609651496 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5070153640 0x7f5070153ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:38.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.772+0000 7f506dd9b640 1 -- 172.21.15.53:0/3609651496 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f507014f750 con 0x7f5070155dd0 2023-06-10T18:53:38.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.772+0000 7f506dd9b640 1 --2- 172.21.15.53:0/3609651496 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5070155dd0 0x7f5070156240 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f506401f1a0 tx=0x7f506401c110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:38.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.772+0000 7f505effd640 1 -- 172.21.15.53:0/3609651496 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50640aed60 con 0x7f5070155dd0 2023-06-10T18:53:38.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.772+0000 7f505effd640 1 -- 172.21.15.53:0/3609651496 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50640b7430 con 0x7f5070155dd0 2023-06-10T18:53:38.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.772+0000 7f5074987640 1 -- 172.21.15.53:0/3609651496 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f507014fa30 con 0x7f5070155dd0 2023-06-10T18:53:38.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.772+0000 7f505effd640 1 -- 172.21.15.53:0/3609651496 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50640b77e0 con 0x7f5070155dd0 2023-06-10T18:53:38.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.776+0000 7f5074987640 1 -- 172.21.15.53:0/3609651496 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50700b3960 con 0x7f5070155dd0 2023-06-10T18:53:38.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.776+0000 7f5074987640 1 -- 172.21.15.53:0/3609651496 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f507004d790 con 0x7f5070155dd0 2023-06-10T18:53:38.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.776+0000 7f505effd640 1 -- 172.21.15.53:0/3609651496 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f50640b5040 con 0x7f5070155dd0 2023-06-10T18:53:38.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.776+0000 7f505effd640 1 --2- 172.21.15.53:0/3609651496 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5050066280 0x7f5050068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:38.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.776+0000 7f505effd640 1 -- 172.21.15.53:0/3609651496 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f50640a7e40 con 0x7f5070155dd0 2023-06-10T18:53:38.791 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.776+0000 7f506e59c640 1 --2- 172.21.15.53:0/3609651496 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5050066280 0x7f5050068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:38.791 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.776+0000 7f506e59c640 1 --2- 172.21.15.53:0/3609651496 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5050066280 0x7f5050068730 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5060007fd0 tx=0x7f5060009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:38.791 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.780+0000 7f505effd640 1 -- 172.21.15.53:0/3609651496 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f50640eb230 con 0x7f5070155dd0 2023-06-10T18:53:38.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.928+0000 7f5074987640 1 -- 172.21.15.53:0/3609651496 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f507014ff10 con 0x7f5070155dd0 2023-06-10T18:53:38.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.928+0000 7f505effd640 1 -- 172.21.15.53:0/3609651496 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f50640b30a0 con 0x7f5070155dd0 2023-06-10T18:53:38.937 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-06-10T18:53:38.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.928+0000 7f5074987640 1 -- 172.21.15.53:0/3609651496 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5050066280 msgr2=0x7f5050068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:38.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.928+0000 7f5074987640 1 --2- 172.21.15.53:0/3609651496 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5050066280 0x7f5050068730 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5060007fd0 tx=0x7f5060009040 comp rx=0 tx=0).stop 2023-06-10T18:53:38.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.928+0000 7f5074987640 1 -- 172.21.15.53:0/3609651496 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5070155dd0 msgr2=0x7f5070156240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:38.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.928+0000 7f5074987640 1 --2- 172.21.15.53:0/3609651496 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5070155dd0 0x7f5070156240 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f506401f1a0 tx=0x7f506401c110 comp rx=0 tx=0).stop 2023-06-10T18:53:38.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.928+0000 7f5074987640 1 -- 172.21.15.53:0/3609651496 shutdown_connections 2023-06-10T18:53:38.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.928+0000 7f5074987640 1 --2- 172.21.15.53:0/3609651496 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5050066280 0x7f5050068730 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:38.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.928+0000 7f5074987640 1 --2- 172.21.15.53:0/3609651496 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5070153640 0x7f5070153ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:38.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.928+0000 7f5074987640 1 --2- 172.21.15.53:0/3609651496 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5070155dd0 0x7f5070156240 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:38.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.928+0000 7f5074987640 1 --2- 172.21.15.53:0/3609651496 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50580047d0 0x7f50700b3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:38.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.928+0000 7f5074987640 1 -- 172.21.15.53:0/3609651496 >> 172.21.15.53:0/3609651496 conn(0x7f507006a0e0 msgr2=0x7f50700cd370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:38.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.928+0000 7f5074987640 1 -- 172.21.15.53:0/3609651496 shutdown_connections 2023-06-10T18:53:38.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:38.928+0000 7f5074987640 1 -- 172.21.15.53:0/3609651496 wait complete. 2023-06-10T18:53:38.955 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-10T18:53:39.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.072+0000 7f1cda974640 1 Processor -- start 2023-06-10T18:53:39.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.072+0000 7f1cda974640 1 -- start start 2023-06-10T18:53:39.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.072+0000 7f1cda974640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1cd41558e0 0x7f1cd40ce3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:39.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.072+0000 7f1cda974640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cd406c230 con 0x7f1cd4158f40 2023-06-10T18:53:39.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.072+0000 7f1cda974640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cd406ca40 con 0x7f1cd40cb820 2023-06-10T18:53:39.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.072+0000 7f1cda974640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cd4159310 con 0x7f1cd41558e0 2023-06-10T18:53:39.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.072+0000 7f1cd3fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f1cd4158f40 0x7f1cd40c82a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:55982/0 (socket says 172.21.15.53:55982) 2023-06-10T18:53:39.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.072+0000 7f1cd3fff640 1 -- 172.21.15.53:0/1217430876 learned_addr learned my addr 172.21.15.53:0/1217430876 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:53:39.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.072+0000 7f1cd37fe640 1 --2- 172.21.15.53:0/1217430876 >> v2:172.21.15.117:3300/0 conn(0x7f1cd41558e0 0x7f1cd40ce3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:39.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.072+0000 7f1cd2ffd640 1 -- 172.21.15.53:0/1217430876 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3443404210 0 0) 0x7f1cd406c230 con 0x7f1cd4158f40 2023-06-10T18:53:39.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.072+0000 7f1cd2ffd640 1 -- 172.21.15.53:0/1217430876 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1cbc003530 con 0x7f1cd4158f40 2023-06-10T18:53:39.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.072+0000 7f1cd2ffd640 1 -- 172.21.15.53:0/1217430876 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1222087300 0 0) 0x7f1cbc003530 con 0x7f1cd4158f40 2023-06-10T18:53:39.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.072+0000 7f1cd2ffd640 1 -- 172.21.15.53:0/1217430876 >> v2:172.21.15.117:3300/0 conn(0x7f1cd41558e0 msgr2=0x7f1cd40ce3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:39.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.072+0000 7f1cd2ffd640 1 --2- 172.21.15.53:0/1217430876 >> v2:172.21.15.117:3300/0 conn(0x7f1cd41558e0 0x7f1cd40ce3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:39.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.072+0000 7f1cd2ffd640 1 -- 172.21.15.53:0/1217430876 >> v1:172.21.15.117:6789/0 conn(0x7f1cd40cb820 legacy=0x7f1cd406b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:39.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.072+0000 7f1cd2ffd640 1 -- 172.21.15.53:0/1217430876 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cd406c480 con 0x7f1cd4158f40 2023-06-10T18:53:39.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.072+0000 7f1cd2ffd640 1 -- 172.21.15.53:0/1217430876 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f1cc4001680 con 0x7f1cd4158f40 2023-06-10T18:53:39.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.072+0000 7f1cd2ffd640 1 -- 172.21.15.53:0/1217430876 >> v1:172.21.15.53:6789/0 conn(0x7f1cd4158f40 legacy=0x7f1cd40c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:39.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.072+0000 7f1cd2ffd640 1 --2- 172.21.15.53:0/1217430876 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1cbc003980 0x7f1cbc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:39.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.072+0000 7f1cd2ffd640 1 --2- 172.21.15.53:0/1217430876 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cbc0047d0 0x7f1cbc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:39.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.072+0000 7f1cd2ffd640 1 --2- 172.21.15.53:0/1217430876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cbc0052a0 0x7f1cbc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:39.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.072+0000 7f1cd2ffd640 1 -- 172.21.15.53:0/1217430876 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cbc00c1a0 con 0x7f1cbc0052a0 2023-06-10T18:53:39.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.072+0000 7f1cd2ffd640 1 -- 172.21.15.53:0/1217430876 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cbc00c310 con 0x7f1cbc003980 2023-06-10T18:53:39.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.072+0000 7f1cd2ffd640 1 -- 172.21.15.53:0/1217430876 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cbc00c4d0 con 0x7f1cbc0047d0 2023-06-10T18:53:39.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.072+0000 7f1cd8f11640 1 --2- 172.21.15.53:0/1217430876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cbc0052a0 0x7f1cbc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:39.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.072+0000 7f1cd3fff640 1 --2- 172.21.15.53:0/1217430876 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1cbc003980 0x7f1cbc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:39.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.072+0000 7f1cd37fe640 1 --2- 172.21.15.53:0/1217430876 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cbc0047d0 0x7f1cbc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:39.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.072+0000 7f1cd8f11640 1 -- 172.21.15.53:0/1217430876 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cbc0047d0 msgr2=0x7f1cbc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:39.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.072+0000 7f1cd8f11640 1 --2- 172.21.15.53:0/1217430876 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cbc0047d0 0x7f1cbc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:39.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.072+0000 7f1cd8f11640 1 -- 172.21.15.53:0/1217430876 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1cbc003980 msgr2=0x7f1cbc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:39.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.072+0000 7f1cd8f11640 1 --2- 172.21.15.53:0/1217430876 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1cbc003980 0x7f1cbc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:39.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.072+0000 7f1cd8f11640 1 -- 172.21.15.53:0/1217430876 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cbc003530 con 0x7f1cbc0052a0 2023-06-10T18:53:39.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.072+0000 7f1cd3fff640 1 --2- 172.21.15.53:0/1217430876 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1cbc003980 0x7f1cbc003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:53:39.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.076+0000 7f1cd8f11640 1 -- 172.21.15.53:0/1217430876 reap_dead start 2023-06-10T18:53:39.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.076+0000 7f1cd8f11640 1 --2- 172.21.15.53:0/1217430876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cbc0052a0 0x7f1cbc00b990 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc001e70 tx=0x7f1ccc01c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92244c185170ea08 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:39.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.076+0000 7f1cd2ffd640 1 -- 172.21.15.53:0/1217430876 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ccc003b80 con 0x7f1cbc0052a0 2023-06-10T18:53:39.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.076+0000 7f1cd2ffd640 1 -- 172.21.15.53:0/1217430876 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ccc003d20 con 0x7f1cbc0052a0 2023-06-10T18:53:39.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.076+0000 7f1cd2ffd640 1 -- 172.21.15.53:0/1217430876 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ccc005310 con 0x7f1cbc0052a0 2023-06-10T18:53:39.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.076+0000 7f1cda974640 1 -- 172.21.15.53:0/1217430876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cbc0052a0 msgr2=0x7f1cbc00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:39.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.076+0000 7f1cda974640 1 --2- 172.21.15.53:0/1217430876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cbc0052a0 0x7f1cbc00b990 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc001e70 tx=0x7f1ccc01c760 comp rx=0 tx=0).stop 2023-06-10T18:53:39.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.076+0000 7f1cda974640 1 -- 172.21.15.53:0/1217430876 shutdown_connections 2023-06-10T18:53:39.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.076+0000 7f1cda974640 1 --2- 172.21.15.53:0/1217430876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cbc0052a0 0x7f1cbc00b990 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:39.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.076+0000 7f1cda974640 1 -- 172.21.15.53:0/1217430876 >> 172.21.15.53:0/1217430876 conn(0x7f1cd406a0e0 msgr2=0x7f1cd40cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:39.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.076+0000 7f1cda974640 1 -- 172.21.15.53:0/1217430876 shutdown_connections 2023-06-10T18:53:39.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.076+0000 7f1cda974640 1 -- 172.21.15.53:0/1217430876 wait complete. 2023-06-10T18:53:39.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.076+0000 7f1cda974640 1 Processor -- start 2023-06-10T18:53:39.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.076+0000 7f1cda974640 1 -- start start 2023-06-10T18:53:39.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.080+0000 7f1cda974640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1cbc0052a0 0x7f1cd4156ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:39.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.080+0000 7f1cda974640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cd414a790 0x7f1cd406eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:39.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.080+0000 7f1cda974640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cd414ac00 0x7f1cd406f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:39.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.080+0000 7f1cda974640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd40c11b0 con 0x7f1cd414ac00 2023-06-10T18:53:39.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.080+0000 7f1cda974640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd414b730 con 0x7f1cbc0052a0 2023-06-10T18:53:39.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.080+0000 7f1cda974640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd4157010 con 0x7f1cd414a790 2023-06-10T18:53:39.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.080+0000 7f1cd8f11640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cd414ac00 0x7f1cd406f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:39.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.080+0000 7f1cd8f11640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cd414ac00 0x7f1cd406f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37162/0 (socket says 172.21.15.53:37162) 2023-06-10T18:53:39.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.080+0000 7f1cd8f11640 1 -- 172.21.15.53:0/3480691020 learned_addr learned my addr 172.21.15.53:0/3480691020 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:39.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.080+0000 7f1cd3fff640 1 --2- 172.21.15.53:0/3480691020 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1cbc0052a0 0x7f1cd4156ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:39.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.080+0000 7f1cd37fe640 1 --2- 172.21.15.53:0/3480691020 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cd414a790 0x7f1cd406eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:39.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.080+0000 7f1cd8f11640 1 -- 172.21.15.53:0/3480691020 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cd414a790 msgr2=0x7f1cd406eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:39.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.080+0000 7f1cd8f11640 1 --2- 172.21.15.53:0/3480691020 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cd414a790 0x7f1cd406eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:39.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.080+0000 7f1cd8f11640 1 -- 172.21.15.53:0/3480691020 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1cbc0052a0 msgr2=0x7f1cd4156ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:39.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.080+0000 7f1cd8f11640 1 --2- 172.21.15.53:0/3480691020 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1cbc0052a0 0x7f1cd4156ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:39.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.080+0000 7f1cd8f11640 1 -- 172.21.15.53:0/3480691020 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cd414b170 con 0x7f1cd414ac00 2023-06-10T18:53:39.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.080+0000 7f1cd37fe640 1 --2- 172.21.15.53:0/3480691020 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cd414a790 0x7f1cd406eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:39.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.080+0000 7f1cd8f11640 1 --2- 172.21.15.53:0/3480691020 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cd414ac00 0x7f1cd406f400 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc01c590 tx=0x7f1cbc005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:39.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.080+0000 7f1cd0ff9640 1 -- 172.21.15.53:0/3480691020 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ccc007dc0 con 0x7f1cd414ac00 2023-06-10T18:53:39.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.080+0000 7f1cd0ff9640 1 -- 172.21.15.53:0/3480691020 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ccc003e90 con 0x7f1cd414ac00 2023-06-10T18:53:39.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.080+0000 7f1cda974640 1 -- 172.21.15.53:0/3480691020 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cd40c11b0 con 0x7f1cd414ac00 2023-06-10T18:53:39.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.080+0000 7f1cd0ff9640 1 -- 172.21.15.53:0/3480691020 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ccc003980 con 0x7f1cd414ac00 2023-06-10T18:53:39.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.080+0000 7f1cda974640 1 -- 172.21.15.53:0/3480691020 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cd40c0e40 con 0x7f1cd414ac00 2023-06-10T18:53:39.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.080+0000 7f1cda974640 1 -- 172.21.15.53:0/3480691020 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cd404d790 con 0x7f1cd414ac00 2023-06-10T18:53:39.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.080+0000 7f1cd0ff9640 1 -- 172.21.15.53:0/3480691020 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1ccc006b60 con 0x7f1cd414ac00 2023-06-10T18:53:39.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.080+0000 7f1cd0ff9640 1 --2- 172.21.15.53:0/3480691020 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1cc0066280 0x7f1cc0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:39.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.080+0000 7f1cd0ff9640 1 -- 172.21.15.53:0/3480691020 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f1ccc11cde0 con 0x7f1cd414ac00 2023-06-10T18:53:39.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.080+0000 7f1cd3fff640 1 --2- 172.21.15.53:0/3480691020 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1cc0066280 0x7f1cc0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:39.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.084+0000 7f1cd3fff640 1 --2- 172.21.15.53:0/3480691020 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1cc0066280 0x7f1cc0068730 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1cc4001000 tx=0x7f1cc4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:39.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.084+0000 7f1cd0ff9640 1 -- 172.21.15.53:0/3480691020 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1ccc0ea190 con 0x7f1cd414ac00 2023-06-10T18:53:39.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.240+0000 7f1cda974640 1 -- 172.21.15.53:0/3480691020 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1cd40c4190 con 0x7f1cd414ac00 2023-06-10T18:53:39.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.240+0000 7f1cd0ff9640 1 -- 172.21.15.53:0/3480691020 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1ccc0b8020 con 0x7f1cd414ac00 2023-06-10T18:53:39.249 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-06-10T18:53:39.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.244+0000 7f1cda974640 1 -- 172.21.15.53:0/3480691020 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1cc0066280 msgr2=0x7f1cc0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:39.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.244+0000 7f1cda974640 1 --2- 172.21.15.53:0/3480691020 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1cc0066280 0x7f1cc0068730 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1cc4001000 tx=0x7f1cc4009040 comp rx=0 tx=0).stop 2023-06-10T18:53:39.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.244+0000 7f1cda974640 1 -- 172.21.15.53:0/3480691020 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cd414ac00 msgr2=0x7f1cd406f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:39.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.244+0000 7f1cda974640 1 --2- 172.21.15.53:0/3480691020 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cd414ac00 0x7f1cd406f400 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc01c590 tx=0x7f1cbc005800 comp rx=0 tx=0).stop 2023-06-10T18:53:39.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.244+0000 7f1cda974640 1 -- 172.21.15.53:0/3480691020 shutdown_connections 2023-06-10T18:53:39.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.244+0000 7f1cda974640 1 --2- 172.21.15.53:0/3480691020 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1cc0066280 0x7f1cc0068730 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:39.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.244+0000 7f1cda974640 1 --2- 172.21.15.53:0/3480691020 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cd414ac00 0x7f1cd406f400 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:39.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.244+0000 7f1cda974640 1 --2- 172.21.15.53:0/3480691020 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cd414a790 0x7f1cd406eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:39.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.244+0000 7f1cda974640 1 --2- 172.21.15.53:0/3480691020 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1cbc0052a0 0x7f1cd4156ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:39.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.244+0000 7f1cda974640 1 -- 172.21.15.53:0/3480691020 >> 172.21.15.53:0/3480691020 conn(0x7f1cd406a0e0 msgr2=0x7f1cd414b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:39.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.244+0000 7f1cda974640 1 -- 172.21.15.53:0/3480691020 shutdown_connections 2023-06-10T18:53:39.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.244+0000 7f1cda974640 1 -- 172.21.15.53:0/3480691020 wait complete. 2023-06-10T18:53:39.268 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-10T18:53:39.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.392+0000 7f550ff00640 1 Processor -- start 2023-06-10T18:53:39.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.392+0000 7f550ff00640 1 -- start start 2023-06-10T18:53:39.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.392+0000 7f550ff00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55080b7e30 0x7f55080b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:39.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.392+0000 7f550ff00640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f55080b0b90 0x7f55080d04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:39.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.392+0000 7f550ff00640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55080cc7c0 con 0x7f550815c090 2023-06-10T18:53:39.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.392+0000 7f550ff00640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55080ccaa0 con 0x7f55080b0b90 2023-06-10T18:53:39.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.392+0000 7f550ff00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55080ccd80 con 0x7f55080b7e30 2023-06-10T18:53:39.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.392+0000 7f550e49d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f55080b0b90 0x7f55080d04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:39.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.392+0000 7f550dc9c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f550815c090 0x7f55080b7720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:55990/0 (socket says 172.21.15.53:55990) 2023-06-10T18:53:39.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.392+0000 7f550dc9c640 1 -- 172.21.15.53:0/3024043595 learned_addr learned my addr 172.21.15.53:0/3024043595 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:53:39.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.392+0000 7f550d49b640 1 --2- 172.21.15.53:0/3024043595 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55080b7e30 0x7f55080b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:39.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.392+0000 7f550cc9a640 1 -- 172.21.15.53:0/3024043595 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3225523917 0 0) 0x7f55080cc7c0 con 0x7f550815c090 2023-06-10T18:53:39.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.392+0000 7f550cc9a640 1 -- 172.21.15.53:0/3024043595 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54f4003530 con 0x7f550815c090 2023-06-10T18:53:39.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.392+0000 7f550e49d640 1 -- 172.21.15.53:0/3024043595 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55080b7e30 msgr2=0x7f55080b10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:39.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.392+0000 7f550e49d640 1 --2- 172.21.15.53:0/3024043595 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55080b7e30 0x7f55080b10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:39.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.392+0000 7f550e49d640 1 -- 172.21.15.53:0/3024043595 >> v1:172.21.15.53:6789/0 conn(0x7f550815c090 legacy=0x7f55080b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:39.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.392+0000 7f550e49d640 1 -- 172.21.15.53:0/3024043595 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55080cd060 con 0x7f55080b0b90 2023-06-10T18:53:39.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.392+0000 7f550d49b640 1 --2- 172.21.15.53:0/3024043595 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55080b7e30 0x7f55080b10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:53:39.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.396+0000 7f550e49d640 1 --2- 172.21.15.53:0/3024043595 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55080b0b90 0x7f55080d04d0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f5500009d90 tx=0x7f550001c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94d3c49362d0b157 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:39.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.396+0000 7f550cc9a640 1 -- 172.21.15.53:0/3024043595 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55000a58b0 con 0x7f55080b0b90 2023-06-10T18:53:39.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.396+0000 7f550cc9a640 1 -- 172.21.15.53:0/3024043595 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55000a5a10 con 0x7f55080b0b90 2023-06-10T18:53:39.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.396+0000 7f550cc9a640 1 -- 172.21.15.53:0/3024043595 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55000a5da0 con 0x7f55080b0b90 2023-06-10T18:53:39.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.396+0000 7f550ff00640 1 -- 172.21.15.53:0/3024043595 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55080b0b90 msgr2=0x7f55080d04d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:39.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.396+0000 7f550ff00640 1 --2- 172.21.15.53:0/3024043595 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55080b0b90 0x7f55080d04d0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f5500009d90 tx=0x7f550001c890 comp rx=0 tx=0).stop 2023-06-10T18:53:39.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.396+0000 7f550ff00640 1 -- 172.21.15.53:0/3024043595 shutdown_connections 2023-06-10T18:53:39.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.396+0000 7f550ff00640 1 --2- 172.21.15.53:0/3024043595 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55080b0b90 0x7f55080d04d0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:39.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.396+0000 7f550ff00640 1 --2- 172.21.15.53:0/3024043595 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55080b7e30 0x7f55080b10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:39.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.396+0000 7f550ff00640 1 -- 172.21.15.53:0/3024043595 >> 172.21.15.53:0/3024043595 conn(0x7f5508069e20 msgr2=0x7f550806a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:39.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.396+0000 7f550ff00640 1 -- 172.21.15.53:0/3024043595 shutdown_connections 2023-06-10T18:53:39.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.396+0000 7f550ff00640 1 -- 172.21.15.53:0/3024043595 wait complete. 2023-06-10T18:53:39.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.396+0000 7f550ff00640 1 Processor -- start 2023-06-10T18:53:39.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.396+0000 7f550ff00640 1 -- start start 2023-06-10T18:53:39.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.396+0000 7f550ff00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55080b0b90 0x7f550815efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:39.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.396+0000 7f550ff00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f55080b7e30 0x7f5508154360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:39.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.396+0000 7f550ff00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f550815c090 0x7f55081f4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:39.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.396+0000 7f550ff00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5508154a60 con 0x7f550815c090 2023-06-10T18:53:39.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.396+0000 7f550ff00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5508154d40 con 0x7f55080b7e30 2023-06-10T18:53:39.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.396+0000 7f550ff00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5508155020 con 0x7f55080b0b90 2023-06-10T18:53:39.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.396+0000 7f550e49d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f550815c090 0x7f55081f4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:39.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.396+0000 7f550e49d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f550815c090 0x7f55081f4ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37178/0 (socket says 172.21.15.53:37178) 2023-06-10T18:53:39.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.396+0000 7f550e49d640 1 -- 172.21.15.53:0/3919499404 learned_addr learned my addr 172.21.15.53:0/3919499404 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:39.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.396+0000 7f550dc9c640 1 --2- 172.21.15.53:0/3919499404 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55080b0b90 0x7f550815efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:39.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.400+0000 7f550d49b640 1 --2- 172.21.15.53:0/3919499404 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f55080b7e30 0x7f5508154360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:39.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.400+0000 7f550e49d640 1 -- 172.21.15.53:0/3919499404 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55080b0b90 msgr2=0x7f550815efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:39.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.400+0000 7f550e49d640 1 --2- 172.21.15.53:0/3919499404 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55080b0b90 0x7f550815efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:39.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.400+0000 7f550e49d640 1 -- 172.21.15.53:0/3919499404 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f55080b7e30 msgr2=0x7f5508154360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:39.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.400+0000 7f550e49d640 1 --2- 172.21.15.53:0/3919499404 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f55080b7e30 0x7f5508154360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:39.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.400+0000 7f550e49d640 1 -- 172.21.15.53:0/3919499404 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5500009a70 con 0x7f550815c090 2023-06-10T18:53:39.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.400+0000 7f550d49b640 1 --2- 172.21.15.53:0/3919499404 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f55080b7e30 0x7f5508154360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:39.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.400+0000 7f550e49d640 1 --2- 172.21.15.53:0/3919499404 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f550815c090 0x7f55081f4ca0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f550001af40 tx=0x7f5500019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:39.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.400+0000 7f54fe7fc640 1 -- 172.21.15.53:0/3919499404 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55000b9860 con 0x7f550815c090 2023-06-10T18:53:39.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.400+0000 7f54fe7fc640 1 -- 172.21.15.53:0/3919499404 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55000b99c0 con 0x7f550815c090 2023-06-10T18:53:39.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.400+0000 7f54fe7fc640 1 -- 172.21.15.53:0/3919499404 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55000b9d30 con 0x7f550815c090 2023-06-10T18:53:39.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.400+0000 7f550ff00640 1 -- 172.21.15.53:0/3919499404 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5508155300 con 0x7f550815c090 2023-06-10T18:53:39.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.400+0000 7f550ff00640 1 -- 172.21.15.53:0/3919499404 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55081f51e0 con 0x7f550815c090 2023-06-10T18:53:39.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.400+0000 7f550ff00640 1 -- 172.21.15.53:0/3919499404 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f550804d790 con 0x7f550815c090 2023-06-10T18:53:39.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.400+0000 7f54fe7fc640 1 -- 172.21.15.53:0/3919499404 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f55000ad440 con 0x7f550815c090 2023-06-10T18:53:39.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.400+0000 7f54fe7fc640 1 --2- 172.21.15.53:0/3919499404 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f54ec066280 0x7f54ec068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:39.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.400+0000 7f54fe7fc640 1 -- 172.21.15.53:0/3919499404 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f550011f1c0 con 0x7f550815c090 2023-06-10T18:53:39.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.400+0000 7f550dc9c640 1 --2- 172.21.15.53:0/3919499404 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f54ec066280 0x7f54ec068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:39.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.404+0000 7f550dc9c640 1 --2- 172.21.15.53:0/3919499404 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f54ec066280 0x7f54ec068730 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f55040011f0 tx=0x7f5504009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:39.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.404+0000 7f54fe7fc640 1 -- 172.21.15.53:0/3919499404 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f55000ec560 con 0x7f550815c090 2023-06-10T18:53:39.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.552+0000 7f550ff00640 1 -- 172.21.15.53:0/3919499404 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f55081561b0 con 0x7f550815c090 2023-06-10T18:53:39.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.552+0000 7f54fe7fc640 1 -- 172.21.15.53:0/3919499404 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f55000efb80 con 0x7f550815c090 2023-06-10T18:53:39.562 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-06-10T18:53:39.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.556+0000 7f550ff00640 1 -- 172.21.15.53:0/3919499404 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f54ec066280 msgr2=0x7f54ec068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:39.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.556+0000 7f550ff00640 1 --2- 172.21.15.53:0/3919499404 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f54ec066280 0x7f54ec068730 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f55040011f0 tx=0x7f5504009040 comp rx=0 tx=0).stop 2023-06-10T18:53:39.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.556+0000 7f550ff00640 1 -- 172.21.15.53:0/3919499404 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f550815c090 msgr2=0x7f55081f4ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:39.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.556+0000 7f550ff00640 1 --2- 172.21.15.53:0/3919499404 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f550815c090 0x7f55081f4ca0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f550001af40 tx=0x7f5500019630 comp rx=0 tx=0).stop 2023-06-10T18:53:39.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.556+0000 7f550ff00640 1 -- 172.21.15.53:0/3919499404 shutdown_connections 2023-06-10T18:53:39.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.556+0000 7f550ff00640 1 --2- 172.21.15.53:0/3919499404 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f54ec066280 0x7f54ec068730 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:39.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.556+0000 7f550ff00640 1 --2- 172.21.15.53:0/3919499404 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f550815c090 0x7f55081f4ca0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:39.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.556+0000 7f550ff00640 1 --2- 172.21.15.53:0/3919499404 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f55080b7e30 0x7f5508154360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:39.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.556+0000 7f550ff00640 1 --2- 172.21.15.53:0/3919499404 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55080b0b90 0x7f550815efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:39.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.556+0000 7f550ff00640 1 -- 172.21.15.53:0/3919499404 >> 172.21.15.53:0/3919499404 conn(0x7f5508069e20 msgr2=0x7f55080b5d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:39.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.556+0000 7f550ff00640 1 -- 172.21.15.53:0/3919499404 shutdown_connections 2023-06-10T18:53:39.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.556+0000 7f550ff00640 1 -- 172.21.15.53:0/3919499404 wait complete. 2023-06-10T18:53:39.579 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-10T18:53:39.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.692+0000 7ff349a29640 1 Processor -- start 2023-06-10T18:53:39.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.696+0000 7ff349a29640 1 -- start start 2023-06-10T18:53:39.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.696+0000 7ff349a29640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff344159450 0x7ff34415d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:39.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.696+0000 7ff349a29640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff3440cf350 0x7ff3440cbf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:39.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.696+0000 7ff349a29640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3440cbac0 con 0x7ff34415d680 2023-06-10T18:53:39.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.696+0000 7ff349a29640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff34415dc00 con 0x7ff3440cf350 2023-06-10T18:53:39.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.696+0000 7ff349a29640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff34415dee0 con 0x7ff344159450 2023-06-10T18:53:39.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.696+0000 7ff3437fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff3440cf350 0x7ff3440cbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:39.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.696+0000 7ff3437fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff3440cf350 0x7ff3440cbf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37182/0 (socket says 172.21.15.53:37182) 2023-06-10T18:53:39.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.696+0000 7ff3437fe640 1 -- 172.21.15.53:0/2349533339 learned_addr learned my addr 172.21.15.53:0/2349533339 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:39.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.696+0000 7ff342ffd640 1 --2- 172.21.15.53:0/2349533339 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff344159450 0x7ff34415d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:39.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.696+0000 7ff3437fe640 1 -- 172.21.15.53:0/2349533339 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff344159450 msgr2=0x7ff34415d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:39.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.696+0000 7ff3437fe640 1 --2- 172.21.15.53:0/2349533339 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff344159450 0x7ff34415d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:39.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.696+0000 7ff3437fe640 1 -- 172.21.15.53:0/2349533339 >> v1:172.21.15.117:6789/0 conn(0x7ff34415d680 legacy=0x7ff3440cec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:39.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.696+0000 7ff3437fe640 1 -- 172.21.15.53:0/2349533339 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3440cb750 con 0x7ff3440cf350 2023-06-10T18:53:39.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.696+0000 7ff342ffd640 1 --2- 172.21.15.53:0/2349533339 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff344159450 0x7ff34415d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:39.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.696+0000 7ff3437fe640 1 --2- 172.21.15.53:0/2349533339 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3440cf350 0x7ff3440cbf50 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7ff33c009e50 tx=0x7ff33c01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b03b7e54e2dac588 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:39.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.700+0000 7ff341ffb640 1 -- 172.21.15.53:0/2349533339 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33c0a5780 con 0x7ff3440cf350 2023-06-10T18:53:39.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.700+0000 7ff341ffb640 1 -- 172.21.15.53:0/2349533339 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff33c0a58e0 con 0x7ff3440cf350 2023-06-10T18:53:39.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.700+0000 7ff341ffb640 1 -- 172.21.15.53:0/2349533339 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33c0a5c70 con 0x7ff3440cf350 2023-06-10T18:53:39.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.700+0000 7ff349a29640 1 -- 172.21.15.53:0/2349533339 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3440cf350 msgr2=0x7ff3440cbf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:39.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.700+0000 7ff349a29640 1 --2- 172.21.15.53:0/2349533339 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3440cf350 0x7ff3440cbf50 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7ff33c009e50 tx=0x7ff33c01c8e0 comp rx=0 tx=0).stop 2023-06-10T18:53:39.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.700+0000 7ff349a29640 1 -- 172.21.15.53:0/2349533339 shutdown_connections 2023-06-10T18:53:39.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.700+0000 7ff349a29640 1 --2- 172.21.15.53:0/2349533339 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3440cf350 0x7ff3440cbf50 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:39.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.700+0000 7ff349a29640 1 --2- 172.21.15.53:0/2349533339 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff344159450 0x7ff34415d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:39.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.700+0000 7ff349a29640 1 -- 172.21.15.53:0/2349533339 >> 172.21.15.53:0/2349533339 conn(0x7ff34406a090 msgr2=0x7ff34406d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:39.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.700+0000 7ff349a29640 1 -- 172.21.15.53:0/2349533339 shutdown_connections 2023-06-10T18:53:39.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.700+0000 7ff349a29640 1 -- 172.21.15.53:0/2349533339 wait complete. 2023-06-10T18:53:39.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.700+0000 7ff349a29640 1 Processor -- start 2023-06-10T18:53:39.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.700+0000 7ff349a29640 1 -- start start 2023-06-10T18:53:39.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.700+0000 7ff349a29640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff3440cf350 0x7ff344152f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:39.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.700+0000 7ff349a29640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff344159450 0x7ff344156610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:39.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.700+0000 7ff349a29640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff34415d680 0x7ff3440b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:39.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.700+0000 7ff349a29640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3440b4940 con 0x7ff344159450 2023-06-10T18:53:39.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.700+0000 7ff349a29640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3440b3d30 con 0x7ff3440cf350 2023-06-10T18:53:39.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.700+0000 7ff349a29640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3440b4010 con 0x7ff34415d680 2023-06-10T18:53:39.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.700+0000 7ff3427fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff344159450 0x7ff344156610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:39.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.700+0000 7ff3427fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff344159450 0x7ff344156610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37190/0 (socket says 172.21.15.53:37190) 2023-06-10T18:53:39.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.700+0000 7ff3427fc640 1 -- 172.21.15.53:0/765043766 learned_addr learned my addr 172.21.15.53:0/765043766 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:39.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.700+0000 7ff3437fe640 1 --2- 172.21.15.53:0/765043766 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff34415d680 0x7ff3440b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:39.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.700+0000 7ff342ffd640 1 --2- 172.21.15.53:0/765043766 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff3440cf350 0x7ff344152f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:39.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.700+0000 7ff3427fc640 1 -- 172.21.15.53:0/765043766 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff34415d680 msgr2=0x7ff3440b4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:39.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.700+0000 7ff3427fc640 1 --2- 172.21.15.53:0/765043766 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff34415d680 0x7ff3440b4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:39.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.700+0000 7ff3427fc640 1 -- 172.21.15.53:0/765043766 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff3440cf350 msgr2=0x7ff344152f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:39.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.700+0000 7ff3427fc640 1 --2- 172.21.15.53:0/765043766 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff3440cf350 0x7ff344152f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:39.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.700+0000 7ff3427fc640 1 -- 172.21.15.53:0/765043766 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff33c009b30 con 0x7ff344159450 2023-06-10T18:53:39.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.700+0000 7ff3437fe640 1 --2- 172.21.15.53:0/765043766 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff34415d680 0x7ff3440b4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:39.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.700+0000 7ff342ffd640 1 --2- 172.21.15.53:0/765043766 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff3440cf350 0x7ff344152f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:39.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.700+0000 7ff3427fc640 1 --2- 172.21.15.53:0/765043766 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff344159450 0x7ff344156610 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff33800b410 tx=0x7ff33800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:39.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.700+0000 7ff32bfff640 1 -- 172.21.15.53:0/765043766 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff338004020 con 0x7ff344159450 2023-06-10T18:53:39.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.700+0000 7ff32bfff640 1 -- 172.21.15.53:0/765043766 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff338004180 con 0x7ff344159450 2023-06-10T18:53:39.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.700+0000 7ff32bfff640 1 -- 172.21.15.53:0/765043766 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff338011630 con 0x7ff344159450 2023-06-10T18:53:39.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.700+0000 7ff349a29640 1 -- 172.21.15.53:0/765043766 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3440b42f0 con 0x7ff344159450 2023-06-10T18:53:39.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.700+0000 7ff349a29640 1 -- 172.21.15.53:0/765043766 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3440c6980 con 0x7ff344159450 2023-06-10T18:53:39.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.704+0000 7ff349a29640 1 -- 172.21.15.53:0/765043766 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff34404d790 con 0x7ff344159450 2023-06-10T18:53:39.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.704+0000 7ff32bfff640 1 -- 172.21.15.53:0/765043766 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff338011790 con 0x7ff344159450 2023-06-10T18:53:39.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.704+0000 7ff32bfff640 1 --2- 172.21.15.53:0/765043766 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff330066280 0x7ff330068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:39.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.704+0000 7ff32bfff640 1 -- 172.21.15.53:0/765043766 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7ff338083bc0 con 0x7ff344159450 2023-06-10T18:53:39.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.704+0000 7ff342ffd640 1 --2- 172.21.15.53:0/765043766 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff330066280 0x7ff330068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:39.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.704+0000 7ff342ffd640 1 --2- 172.21.15.53:0/765043766 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff330066280 0x7ff330068730 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff334008930 tx=0x7ff334008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:39.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.708+0000 7ff32bfff640 1 -- 172.21.15.53:0/765043766 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff338050f60 con 0x7ff344159450 2023-06-10T18:53:39.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.864+0000 7ff349a29640 1 -- 172.21.15.53:0/765043766 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff3440b18d0 con 0x7ff344159450 2023-06-10T18:53:39.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.864+0000 7ff32bfff640 1 -- 172.21.15.53:0/765043766 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff338054580 con 0x7ff344159450 2023-06-10T18:53:39.873 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-06-10T18:53:39.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.864+0000 7ff349a29640 1 -- 172.21.15.53:0/765043766 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff330066280 msgr2=0x7ff330068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:39.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.864+0000 7ff349a29640 1 --2- 172.21.15.53:0/765043766 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff330066280 0x7ff330068730 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff334008930 tx=0x7ff334008040 comp rx=0 tx=0).stop 2023-06-10T18:53:39.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.864+0000 7ff349a29640 1 -- 172.21.15.53:0/765043766 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff344159450 msgr2=0x7ff344156610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:39.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.864+0000 7ff349a29640 1 --2- 172.21.15.53:0/765043766 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff344159450 0x7ff344156610 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff33800b410 tx=0x7ff33800b8d0 comp rx=0 tx=0).stop 2023-06-10T18:53:39.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.864+0000 7ff349a29640 1 -- 172.21.15.53:0/765043766 shutdown_connections 2023-06-10T18:53:39.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.864+0000 7ff349a29640 1 --2- 172.21.15.53:0/765043766 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff330066280 0x7ff330068730 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:39.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.864+0000 7ff349a29640 1 --2- 172.21.15.53:0/765043766 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff34415d680 0x7ff3440b4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:39.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.868+0000 7ff349a29640 1 --2- 172.21.15.53:0/765043766 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff344159450 0x7ff344156610 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:39.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.868+0000 7ff349a29640 1 --2- 172.21.15.53:0/765043766 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff3440cf350 0x7ff344152f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:39.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.868+0000 7ff349a29640 1 -- 172.21.15.53:0/765043766 >> 172.21.15.53:0/765043766 conn(0x7ff34406a090 msgr2=0x7ff3440b1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:39.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.868+0000 7ff349a29640 1 -- 172.21.15.53:0/765043766 shutdown_connections 2023-06-10T18:53:39.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:39.868+0000 7ff349a29640 1 -- 172.21.15.53:0/765043766 wait complete. 2023-06-10T18:53:39.892 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-10T18:53:40.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.000+0000 7f2d6412f640 1 Processor -- start 2023-06-10T18:53:40.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.000+0000 7f2d6412f640 1 -- start start 2023-06-10T18:53:40.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.000+0000 7f2d6412f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2d5c1571a0 0x7f2d5c0c9f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:40.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.000+0000 7f2d6412f640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2d5c0afee0 0x7f2d5c0c83f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:40.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.000+0000 7f2d6412f640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d5c071190 con 0x7f2d5c070100 2023-06-10T18:53:40.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.000+0000 7f2d6412f640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d5c0ca440 con 0x7f2d5c1571a0 2023-06-10T18:53:40.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.000+0000 7f2d6412f640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d5c070580 con 0x7f2d5c0afee0 2023-06-10T18:53:40.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.000+0000 7f2d61ecb640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2d5c1571a0 0x7f2d5c0c9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:40.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.000+0000 7f2d61ecb640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2d5c1571a0 0x7f2d5c0c9f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37198/0 (socket says 172.21.15.53:37198) 2023-06-10T18:53:40.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.000+0000 7f2d61ecb640 1 -- 172.21.15.53:0/3452430205 learned_addr learned my addr 172.21.15.53:0/3452430205 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:40.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.000+0000 7f2d626cc640 1 --2- 172.21.15.53:0/3452430205 >> v2:172.21.15.117:3300/0 conn(0x7f2d5c0afee0 0x7f2d5c0c83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:40.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.000+0000 7f2d61ecb640 1 -- 172.21.15.53:0/3452430205 >> v2:172.21.15.117:3300/0 conn(0x7f2d5c0afee0 msgr2=0x7f2d5c0c83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:40.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.000+0000 7f2d61ecb640 1 --2- 172.21.15.53:0/3452430205 >> v2:172.21.15.117:3300/0 conn(0x7f2d5c0afee0 0x7f2d5c0c83f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:40.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.000+0000 7f2d61ecb640 1 -- 172.21.15.53:0/3452430205 >> v1:172.21.15.117:6789/0 conn(0x7f2d5c070100 legacy=0x7f2d5c0af7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:40.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.000+0000 7f2d61ecb640 1 -- 172.21.15.53:0/3452430205 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d5c070860 con 0x7f2d5c1571a0 2023-06-10T18:53:40.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.000+0000 7f2d626cc640 1 --2- 172.21.15.53:0/3452430205 >> v2:172.21.15.117:3300/0 conn(0x7f2d5c0afee0 0x7f2d5c0c83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:53:40.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.004+0000 7f2d61ecb640 1 --2- 172.21.15.53:0/3452430205 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d5c1571a0 0x7f2d5c0c9f00 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c071100 tx=0x7f2d5001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5790e86e7700f5c server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:40.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.004+0000 7f2d60ec9640 1 -- 172.21.15.53:0/3452430205 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d500aa430 con 0x7f2d5c1571a0 2023-06-10T18:53:40.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.004+0000 7f2d60ec9640 1 -- 172.21.15.53:0/3452430205 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d500aa590 con 0x7f2d5c1571a0 2023-06-10T18:53:40.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.004+0000 7f2d60ec9640 1 -- 172.21.15.53:0/3452430205 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d500aa920 con 0x7f2d5c1571a0 2023-06-10T18:53:40.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.004+0000 7f2d6412f640 1 -- 172.21.15.53:0/3452430205 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d5c1571a0 msgr2=0x7f2d5c0c9f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:40.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.004+0000 7f2d6412f640 1 --2- 172.21.15.53:0/3452430205 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d5c1571a0 0x7f2d5c0c9f00 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c071100 tx=0x7f2d5001c4d0 comp rx=0 tx=0).stop 2023-06-10T18:53:40.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.004+0000 7f2d6412f640 1 -- 172.21.15.53:0/3452430205 shutdown_connections 2023-06-10T18:53:40.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.004+0000 7f2d6412f640 1 --2- 172.21.15.53:0/3452430205 >> v2:172.21.15.117:3300/0 conn(0x7f2d5c0afee0 0x7f2d5c0c83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:40.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.004+0000 7f2d6412f640 1 --2- 172.21.15.53:0/3452430205 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d5c1571a0 0x7f2d5c0c9f00 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:40.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.004+0000 7f2d6412f640 1 -- 172.21.15.53:0/3452430205 >> 172.21.15.53:0/3452430205 conn(0x7f2d5c0ce9e0 msgr2=0x7f2d5c0ca7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:40.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.004+0000 7f2d6412f640 1 -- 172.21.15.53:0/3452430205 shutdown_connections 2023-06-10T18:53:40.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.004+0000 7f2d6412f640 1 -- 172.21.15.53:0/3452430205 wait complete. 2023-06-10T18:53:40.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.008+0000 7f2d6412f640 1 Processor -- start 2023-06-10T18:53:40.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.008+0000 7f2d6412f640 1 -- start start 2023-06-10T18:53:40.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.008+0000 7f2d6412f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d5c0afee0 0x7f2d5c14e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:40.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.008+0000 7f2d6412f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d5c1571a0 0x7f2d5c0c3af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:40.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.008+0000 7f2d6412f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d5c06b660 0x7f2d5c159ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:40.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.008+0000 7f2d6412f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5c0c2840 con 0x7f2d5c1571a0 2023-06-10T18:53:40.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.008+0000 7f2d6412f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5c0c3660 con 0x7f2d5c06b660 2023-06-10T18:53:40.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.008+0000 7f2d6412f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5c14e790 con 0x7f2d5c0afee0 2023-06-10T18:53:40.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.008+0000 7f2d616ca640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d5c1571a0 0x7f2d5c0c3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:40.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.008+0000 7f2d616ca640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d5c1571a0 0x7f2d5c0c3af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37202/0 (socket says 172.21.15.53:37202) 2023-06-10T18:53:40.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.008+0000 7f2d616ca640 1 -- 172.21.15.53:0/889146614 learned_addr learned my addr 172.21.15.53:0/889146614 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:40.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.008+0000 7f2d61ecb640 1 --2- 172.21.15.53:0/889146614 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d5c0afee0 0x7f2d5c14e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:40.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.008+0000 7f2d626cc640 1 --2- 172.21.15.53:0/889146614 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d5c06b660 0x7f2d5c159ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:40.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.008+0000 7f2d616ca640 1 -- 172.21.15.53:0/889146614 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d5c0afee0 msgr2=0x7f2d5c14e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:40.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.008+0000 7f2d616ca640 1 --2- 172.21.15.53:0/889146614 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d5c0afee0 0x7f2d5c14e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:40.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.008+0000 7f2d616ca640 1 -- 172.21.15.53:0/889146614 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d5c06b660 msgr2=0x7f2d5c159ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:40.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.008+0000 7f2d616ca640 1 --2- 172.21.15.53:0/889146614 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d5c06b660 0x7f2d5c159ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:40.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.008+0000 7f2d616ca640 1 -- 172.21.15.53:0/889146614 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d50009480 con 0x7f2d5c1571a0 2023-06-10T18:53:40.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.008+0000 7f2d616ca640 1 --2- 172.21.15.53:0/889146614 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d5c1571a0 0x7f2d5c0c3af0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c00c7f0 tx=0x7f2d4c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:40.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.008+0000 7f2d5a7fc640 1 -- 172.21.15.53:0/889146614 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d4c003b80 con 0x7f2d5c1571a0 2023-06-10T18:53:40.020 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.008+0000 7f2d5a7fc640 1 -- 172.21.15.53:0/889146614 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d4c003ce0 con 0x7f2d5c1571a0 2023-06-10T18:53:40.020 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.008+0000 7f2d6412f640 1 -- 172.21.15.53:0/889146614 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d5c0c4030 con 0x7f2d5c1571a0 2023-06-10T18:53:40.020 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.008+0000 7f2d5a7fc640 1 -- 172.21.15.53:0/889146614 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d4c00aa90 con 0x7f2d5c1571a0 2023-06-10T18:53:40.020 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.008+0000 7f2d6412f640 1 -- 172.21.15.53:0/889146614 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d5c0c2d30 con 0x7f2d5c1571a0 2023-06-10T18:53:40.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.008+0000 7f2d6412f640 1 -- 172.21.15.53:0/889146614 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d5c0c37f0 con 0x7f2d5c1571a0 2023-06-10T18:53:40.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.008+0000 7f2d5a7fc640 1 -- 172.21.15.53:0/889146614 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2d4c00abf0 con 0x7f2d5c1571a0 2023-06-10T18:53:40.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.008+0000 7f2d5a7fc640 1 --2- 172.21.15.53:0/889146614 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2d480662b0 0x7f2d48068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:40.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.008+0000 7f2d5a7fc640 1 -- 172.21.15.53:0/889146614 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f2d4c083c10 con 0x7f2d5c1571a0 2023-06-10T18:53:40.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.008+0000 7f2d61ecb640 1 --2- 172.21.15.53:0/889146614 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2d480662b0 0x7f2d48068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:40.022 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.012+0000 7f2d61ecb640 1 --2- 172.21.15.53:0/889146614 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2d480662b0 0x7f2d48068760 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2d500ae000 tx=0x7f2d500a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:40.023 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.012+0000 7f2d5a7fc640 1 -- 172.21.15.53:0/889146614 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2d4c051050 con 0x7f2d5c1571a0 2023-06-10T18:53:40.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.172+0000 7f2d6412f640 1 -- 172.21.15.53:0/889146614 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f2d5c04d790 con 0x7f2d5c1571a0 2023-06-10T18:53:40.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.172+0000 7f2d5a7fc640 1 -- 172.21.15.53:0/889146614 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2d4c054670 con 0x7f2d5c1571a0 2023-06-10T18:53:40.181 INFO:teuthology.orchestra.run.smithi053.stderr:listed 0 entries 2023-06-10T18:53:40.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.176+0000 7f2d6412f640 1 -- 172.21.15.53:0/889146614 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2d480662b0 msgr2=0x7f2d48068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:40.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.176+0000 7f2d6412f640 1 --2- 172.21.15.53:0/889146614 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2d480662b0 0x7f2d48068760 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2d500ae000 tx=0x7f2d500a7000 comp rx=0 tx=0).stop 2023-06-10T18:53:40.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.176+0000 7f2d6412f640 1 -- 172.21.15.53:0/889146614 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d5c1571a0 msgr2=0x7f2d5c0c3af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:40.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.176+0000 7f2d6412f640 1 --2- 172.21.15.53:0/889146614 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d5c1571a0 0x7f2d5c0c3af0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c00c7f0 tx=0x7f2d4c00ccb0 comp rx=0 tx=0).stop 2023-06-10T18:53:40.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.176+0000 7f2d6412f640 1 -- 172.21.15.53:0/889146614 shutdown_connections 2023-06-10T18:53:40.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.176+0000 7f2d6412f640 1 --2- 172.21.15.53:0/889146614 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2d480662b0 0x7f2d48068760 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:40.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.176+0000 7f2d6412f640 1 --2- 172.21.15.53:0/889146614 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d5c06b660 0x7f2d5c159ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:40.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.176+0000 7f2d6412f640 1 --2- 172.21.15.53:0/889146614 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d5c1571a0 0x7f2d5c0c3af0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:40.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.176+0000 7f2d6412f640 1 --2- 172.21.15.53:0/889146614 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d5c0afee0 0x7f2d5c14e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:40.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.176+0000 7f2d6412f640 1 -- 172.21.15.53:0/889146614 >> 172.21.15.53:0/889146614 conn(0x7f2d5c0ce9e0 msgr2=0x7f2d5c159130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:40.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.176+0000 7f2d6412f640 1 -- 172.21.15.53:0/889146614 shutdown_connections 2023-06-10T18:53:40.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.176+0000 7f2d6412f640 1 -- 172.21.15.53:0/889146614 wait complete. 2023-06-10T18:53:40.199 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi117.front.sepia.ceph.com... 2023-06-10T18:53:40.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:53:40.199 DEBUG:teuthology.orchestra.run.smithi117:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2023-06-10T18:53:40.215 INFO:teuthology.orchestra.run:waiting for 300 2023-06-10T18:53:40.215 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi117.front.sepia.ceph.com 2023-06-10T18:53:40.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:53:40.216 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-06-10T18:53:40.263 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-06-10T18:53:40.264 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T18:53:40.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.376+0000 7f41d02be640 1 Processor -- start 2023-06-10T18:53:40.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.376+0000 7f41d02be640 1 -- start start 2023-06-10T18:53:40.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.380+0000 7f41d02be640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41c806b2f0 0x7f41c806f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:40.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.380+0000 7f41d02be640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f41c80c8d00 0x7f41c806b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:40.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.380+0000 7f41d02be640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f41c806bc00 0x7f41c80cbe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:40.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.380+0000 7f41d02be640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41c8158a90 con 0x7f41c806bc00 2023-06-10T18:53:40.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.380+0000 7f41d02be640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41c80705d0 con 0x7f41c80c8d00 2023-06-10T18:53:40.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.380+0000 7f41d02be640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41c806f9c0 con 0x7f41c806b2f0 2023-06-10T18:53:40.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.380+0000 7f41ce85b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f41c806bc00 0x7f41c80cbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:40.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.380+0000 7f41ce85b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f41c806bc00 0x7f41c80cbe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37214/0 (socket says 172.21.15.53:37214) 2023-06-10T18:53:40.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.380+0000 7f41ce85b640 1 -- 172.21.15.53:0/559828383 learned_addr learned my addr 172.21.15.53:0/559828383 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:40.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.380+0000 7f41ce05a640 1 --2- 172.21.15.53:0/559828383 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41c806b2f0 0x7f41c806f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:40.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.380+0000 7f41cd859640 1 --2- 172.21.15.53:0/559828383 >> v2:172.21.15.117:3300/0 conn(0x7f41c80c8d00 0x7f41c806b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:40.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.380+0000 7f41ce85b640 1 -- 172.21.15.53:0/559828383 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41c806b2f0 msgr2=0x7f41c806f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:40.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.380+0000 7f41ce85b640 1 --2- 172.21.15.53:0/559828383 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41c806b2f0 0x7f41c806f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:40.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.380+0000 7f41ce85b640 1 -- 172.21.15.53:0/559828383 >> v2:172.21.15.117:3300/0 conn(0x7f41c80c8d00 msgr2=0x7f41c806b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:40.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.380+0000 7f41ce85b640 1 --2- 172.21.15.53:0/559828383 >> v2:172.21.15.117:3300/0 conn(0x7f41c80c8d00 0x7f41c806b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:40.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.380+0000 7f41ce85b640 1 -- 172.21.15.53:0/559828383 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41c806fca0 con 0x7f41c806bc00 2023-06-10T18:53:40.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.380+0000 7f41ce05a640 1 --2- 172.21.15.53:0/559828383 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41c806b2f0 0x7f41c806f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:40.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.380+0000 7f41cd859640 1 --2- 172.21.15.53:0/559828383 >> v2:172.21.15.117:3300/0 conn(0x7f41c80c8d00 0x7f41c806b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:40.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.380+0000 7f41ce85b640 1 --2- 172.21.15.53:0/559828383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f41c806bc00 0x7f41c80cbe00 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f41c000d150 tx=0x7f41c00213c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2307acd30da89539 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:40.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.380+0000 7f41cd058640 1 -- 172.21.15.53:0/559828383 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c000b2d0 con 0x7f41c806bc00 2023-06-10T18:53:40.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.380+0000 7f41cd058640 1 -- 172.21.15.53:0/559828383 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41c00ad050 con 0x7f41c806bc00 2023-06-10T18:53:40.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.380+0000 7f41cd058640 1 -- 172.21.15.53:0/559828383 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c0009820 con 0x7f41c806bc00 2023-06-10T18:53:40.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.384+0000 7f41d02be640 1 -- 172.21.15.53:0/559828383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f41c806bc00 msgr2=0x7f41c80cbe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:40.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.384+0000 7f41d02be640 1 --2- 172.21.15.53:0/559828383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f41c806bc00 0x7f41c80cbe00 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f41c000d150 tx=0x7f41c00213c0 comp rx=0 tx=0).stop 2023-06-10T18:53:40.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.384+0000 7f41d02be640 1 -- 172.21.15.53:0/559828383 shutdown_connections 2023-06-10T18:53:40.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.384+0000 7f41d02be640 1 --2- 172.21.15.53:0/559828383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f41c806bc00 0x7f41c80cbe00 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:40.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.384+0000 7f41d02be640 1 --2- 172.21.15.53:0/559828383 >> v2:172.21.15.117:3300/0 conn(0x7f41c80c8d00 0x7f41c806b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:40.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.384+0000 7f41d02be640 1 --2- 172.21.15.53:0/559828383 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41c806b2f0 0x7f41c806f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:40.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.384+0000 7f41d02be640 1 -- 172.21.15.53:0/559828383 >> 172.21.15.53:0/559828383 conn(0x7f41c806a0d0 msgr2=0x7f41c80ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:40.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.384+0000 7f41d02be640 1 -- 172.21.15.53:0/559828383 shutdown_connections 2023-06-10T18:53:40.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.384+0000 7f41d02be640 1 -- 172.21.15.53:0/559828383 wait complete. 2023-06-10T18:53:40.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.384+0000 7f41d02be640 1 Processor -- start 2023-06-10T18:53:40.395 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.384+0000 7f41d02be640 1 -- start start 2023-06-10T18:53:40.395 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.384+0000 7f41d02be640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f41c806b2f0 0x7f41c80c14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:40.395 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.384+0000 7f41d02be640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41c806bc00 0x7f41c80c7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:40.395 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.384+0000 7f41d02be640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41c80c8d00 0x7f41c80ad700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:40.395 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.384+0000 7f41d02be640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c80ab990 con 0x7f41c806b2f0 2023-06-10T18:53:40.395 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.384+0000 7f41d02be640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c80abc70 con 0x7f41c80c8d00 2023-06-10T18:53:40.395 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.384+0000 7f41d02be640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41c80abf50 con 0x7f41c806bc00 2023-06-10T18:53:40.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.384+0000 7f41ce05a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f41c806b2f0 0x7f41c80c14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:40.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.384+0000 7f41ce05a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f41c806b2f0 0x7f41c80c14c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37218/0 (socket says 172.21.15.53:37218) 2023-06-10T18:53:40.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.384+0000 7f41ce05a640 1 -- 172.21.15.53:0/283822074 learned_addr learned my addr 172.21.15.53:0/283822074 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:40.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.384+0000 7f41ce85b640 1 --2- 172.21.15.53:0/283822074 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41c80c8d00 0x7f41c80ad700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:40.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.384+0000 7f41cd859640 1 --2- 172.21.15.53:0/283822074 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41c806bc00 0x7f41c80c7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:40.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.384+0000 7f41ce05a640 1 -- 172.21.15.53:0/283822074 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41c806bc00 msgr2=0x7f41c80c7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:40.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.384+0000 7f41ce05a640 1 --2- 172.21.15.53:0/283822074 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41c806bc00 0x7f41c80c7320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:40.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.384+0000 7f41ce05a640 1 -- 172.21.15.53:0/283822074 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41c80c8d00 msgr2=0x7f41c80ad700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:40.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.384+0000 7f41ce05a640 1 --2- 172.21.15.53:0/283822074 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41c80c8d00 0x7f41c80ad700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:40.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.384+0000 7f41ce05a640 1 -- 172.21.15.53:0/283822074 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41c000bd40 con 0x7f41c806b2f0 2023-06-10T18:53:40.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.384+0000 7f41ce05a640 1 --2- 172.21.15.53:0/283822074 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f41c806b2f0 0x7f41c80c14c0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f41bc00c7c0 tx=0x7f41bc00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:40.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.384+0000 7f41baffd640 1 -- 172.21.15.53:0/283822074 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41bc007a30 con 0x7f41c806b2f0 2023-06-10T18:53:40.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.384+0000 7f41baffd640 1 -- 172.21.15.53:0/283822074 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41bc007b90 con 0x7f41c806b2f0 2023-06-10T18:53:40.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.384+0000 7f41baffd640 1 -- 172.21.15.53:0/283822074 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41bc00ce70 con 0x7f41c806b2f0 2023-06-10T18:53:40.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.384+0000 7f41d02be640 1 -- 172.21.15.53:0/283822074 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41c80ac230 con 0x7f41c806b2f0 2023-06-10T18:53:40.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.384+0000 7f41d02be640 1 -- 172.21.15.53:0/283822074 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41c80c1a00 con 0x7f41c806b2f0 2023-06-10T18:53:40.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.388+0000 7f41d02be640 1 -- 172.21.15.53:0/283822074 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41c804d790 con 0x7f41c806b2f0 2023-06-10T18:53:40.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.388+0000 7f41baffd640 1 -- 172.21.15.53:0/283822074 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f41bc0113f0 con 0x7f41c806b2f0 2023-06-10T18:53:40.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.388+0000 7f41baffd640 1 --2- 172.21.15.53:0/283822074 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f41ac066280 0x7f41ac068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:40.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.388+0000 7f41baffd640 1 -- 172.21.15.53:0/283822074 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f41bc083e20 con 0x7f41c806b2f0 2023-06-10T18:53:40.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.388+0000 7f41cd859640 1 --2- 172.21.15.53:0/283822074 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f41ac066280 0x7f41ac068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:40.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.388+0000 7f41cd859640 1 --2- 172.21.15.53:0/283822074 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f41ac066280 0x7f41ac068730 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f41c4006fd0 tx=0x7f41c4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:40.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.392+0000 7f41baffd640 1 -- 172.21.15.53:0/283822074 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f41bc0512f0 con 0x7f41c806b2f0 2023-06-10T18:53:40.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.580+0000 7f41d02be640 1 -- 172.21.15.53:0/283822074 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f41c80cc3f0 con 0x7f41c806b2f0 2023-06-10T18:53:40.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.580+0000 7f41baffd640 1 -- 172.21.15.53:0/283822074 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4668 (secure 0 0 0) 0x7f41bc054910 con 0x7f41c806b2f0 2023-06-10T18:53:40.591 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:53:40.592 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4236,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/1767214403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":1767214403},{"type":"v1","addr":"172.21.15.53:6834","nonce":1767214403}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/184933647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":184933647},{"type":"v1","addr":"172.21.15.117:6837","nonce":184933647}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/1556542558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":1556542558},{"type":"v1","addr":"172.21.15.53:6835","nonce":1556542558}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T18:52:44.918376+0000","modified":"2023-06-10T18:52:47.927154+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6835/1492134415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1492134415},{"type":"v1","addr":"172.21.15.117:6835","nonce":1492134415}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-10T18:53:40.592 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 7 2023-06-10T18:53:40.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.584+0000 7f41d02be640 1 -- 172.21.15.53:0/283822074 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f41ac066280 msgr2=0x7f41ac068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:40.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.584+0000 7f41d02be640 1 --2- 172.21.15.53:0/283822074 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f41ac066280 0x7f41ac068730 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f41c4006fd0 tx=0x7f41c4008040 comp rx=0 tx=0).stop 2023-06-10T18:53:40.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.584+0000 7f41d02be640 1 -- 172.21.15.53:0/283822074 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f41c806b2f0 msgr2=0x7f41c80c14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:40.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.584+0000 7f41d02be640 1 --2- 172.21.15.53:0/283822074 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f41c806b2f0 0x7f41c80c14c0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f41bc00c7c0 tx=0x7f41bc00cc80 comp rx=0 tx=0).stop 2023-06-10T18:53:40.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.584+0000 7f41d02be640 1 -- 172.21.15.53:0/283822074 shutdown_connections 2023-06-10T18:53:40.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.584+0000 7f41d02be640 1 --2- 172.21.15.53:0/283822074 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f41ac066280 0x7f41ac068730 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:40.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.584+0000 7f41d02be640 1 --2- 172.21.15.53:0/283822074 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41c80c8d00 0x7f41c80ad700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:40.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.584+0000 7f41d02be640 1 --2- 172.21.15.53:0/283822074 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41c806bc00 0x7f41c80c7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:40.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.584+0000 7f41d02be640 1 --2- 172.21.15.53:0/283822074 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f41c806b2f0 0x7f41c80c14c0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:40.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.584+0000 7f41d02be640 1 -- 172.21.15.53:0/283822074 >> 172.21.15.53:0/283822074 conn(0x7f41c806a0d0 msgr2=0x7f41c80ccbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:40.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.584+0000 7f41d02be640 1 -- 172.21.15.53:0/283822074 shutdown_connections 2023-06-10T18:53:40.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.584+0000 7f41d02be640 1 -- 172.21.15.53:0/283822074 wait complete. 2023-06-10T18:53:40.611 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T18:53:40.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.724+0000 7f7301419640 1 Processor -- start 2023-06-10T18:53:40.732 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.724+0000 7f7301419640 1 -- start start 2023-06-10T18:53:40.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.724+0000 7f7301419640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72fc06c7d0 0x7f72fc1586f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:40.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.724+0000 7f7301419640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f72fc0ccc90 0x7f72fc0cd130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:40.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.724+0000 7f7301419640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72fc15c260 con 0x7f72fc06c400 2023-06-10T18:53:40.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.724+0000 7f7301419640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72fc15cee0 con 0x7f72fc0ccc90 2023-06-10T18:53:40.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.724+0000 7f7301419640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72fc15c540 con 0x7f72fc06c7d0 2023-06-10T18:53:40.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.724+0000 7f72fb7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f72fc0ccc90 0x7f72fc0cd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:40.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.724+0000 7f72fb7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f72fc0ccc90 0x7f72fc0cd130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37222/0 (socket says 172.21.15.53:37222) 2023-06-10T18:53:40.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.724+0000 7f72fb7fe640 1 -- 172.21.15.53:0/2963393488 learned_addr learned my addr 172.21.15.53:0/2963393488 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:40.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.724+0000 7f72fb7fe640 1 -- 172.21.15.53:0/2963393488 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72fc06c7d0 msgr2=0x7f72fc1586f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:40.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.724+0000 7f72f27fc640 1 --2- 172.21.15.53:0/2963393488 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72fc06c7d0 0x7f72fc1586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:40.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.724+0000 7f72fb7fe640 1 --2- 172.21.15.53:0/2963393488 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72fc06c7d0 0x7f72fc1586f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:40.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.724+0000 7f72fb7fe640 1 -- 172.21.15.53:0/2963393488 >> v1:172.21.15.117:6789/0 conn(0x7f72fc06c400 legacy=0x7f72fc157fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:40.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.724+0000 7f72fb7fe640 1 -- 172.21.15.53:0/2963393488 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72fc15c820 con 0x7f72fc0ccc90 2023-06-10T18:53:40.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.728+0000 7f72fb7fe640 1 --2- 172.21.15.53:0/2963393488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f72fc0ccc90 0x7f72fc0cd130 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f72f400bb40 tx=0x7f72f401eb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4604328ce315d087 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:40.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.728+0000 7f72fa7fc640 1 -- 172.21.15.53:0/2963393488 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f40a7a10 con 0x7f72fc0ccc90 2023-06-10T18:53:40.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.728+0000 7f72fa7fc640 1 -- 172.21.15.53:0/2963393488 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f40a7b70 con 0x7f72fc0ccc90 2023-06-10T18:53:40.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.728+0000 7f72fa7fc640 1 -- 172.21.15.53:0/2963393488 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f40af440 con 0x7f72fc0ccc90 2023-06-10T18:53:40.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.728+0000 7f7301419640 1 -- 172.21.15.53:0/2963393488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f72fc0ccc90 msgr2=0x7f72fc0cd130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:40.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.728+0000 7f7301419640 1 --2- 172.21.15.53:0/2963393488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f72fc0ccc90 0x7f72fc0cd130 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f72f400bb40 tx=0x7f72f401eb30 comp rx=0 tx=0).stop 2023-06-10T18:53:40.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.728+0000 7f7301419640 1 -- 172.21.15.53:0/2963393488 shutdown_connections 2023-06-10T18:53:40.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.728+0000 7f7301419640 1 --2- 172.21.15.53:0/2963393488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f72fc0ccc90 0x7f72fc0cd130 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:40.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.728+0000 7f7301419640 1 --2- 172.21.15.53:0/2963393488 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72fc06c7d0 0x7f72fc1586f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:40.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.728+0000 7f7301419640 1 -- 172.21.15.53:0/2963393488 >> 172.21.15.53:0/2963393488 conn(0x7f72fc06a560 msgr2=0x7f72fc06a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:40.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.728+0000 7f7301419640 1 -- 172.21.15.53:0/2963393488 shutdown_connections 2023-06-10T18:53:40.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.728+0000 7f7301419640 1 -- 172.21.15.53:0/2963393488 wait complete. 2023-06-10T18:53:40.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.728+0000 7f7301419640 1 Processor -- start 2023-06-10T18:53:40.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.728+0000 7f7301419640 1 -- start start 2023-06-10T18:53:40.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.728+0000 7f7301419640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72fc06c400 0x7f72fc0c44c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:40.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.728+0000 7f7301419640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72fc06c7d0 0x7f72fc0b0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:40.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.728+0000 7f7301419640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f72fc0ccc90 0x7f72fc15a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:40.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.728+0000 7f7301419640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72fc0c3420 con 0x7f72fc0ccc90 2023-06-10T18:53:40.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.728+0000 7f7301419640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72fc0c3700 con 0x7f72fc06c400 2023-06-10T18:53:40.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.728+0000 7f7301419640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72fc0c39e0 con 0x7f72fc06c7d0 2023-06-10T18:53:40.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.728+0000 7f72fb7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f72fc0ccc90 0x7f72fc15a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:40.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.728+0000 7f72fb7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f72fc0ccc90 0x7f72fc15a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37228/0 (socket says 172.21.15.53:37228) 2023-06-10T18:53:40.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.728+0000 7f72fb7fe640 1 -- 172.21.15.53:0/2939197591 learned_addr learned my addr 172.21.15.53:0/2939197591 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:40.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.728+0000 7f72faffd640 1 --2- 172.21.15.53:0/2939197591 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72fc06c400 0x7f72fc0c44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:40.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.728+0000 7f72f27fc640 1 --2- 172.21.15.53:0/2939197591 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72fc06c7d0 0x7f72fc0b0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:40.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.728+0000 7f72fb7fe640 1 -- 172.21.15.53:0/2939197591 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72fc06c7d0 msgr2=0x7f72fc0b0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:40.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.728+0000 7f72fb7fe640 1 --2- 172.21.15.53:0/2939197591 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72fc06c7d0 0x7f72fc0b0ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:40.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.728+0000 7f72fb7fe640 1 -- 172.21.15.53:0/2939197591 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72fc06c400 msgr2=0x7f72fc0c44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:40.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.728+0000 7f72fb7fe640 1 --2- 172.21.15.53:0/2939197591 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72fc06c400 0x7f72fc0c44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:40.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.728+0000 7f72fb7fe640 1 -- 172.21.15.53:0/2939197591 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72f400b770 con 0x7f72fc0ccc90 2023-06-10T18:53:40.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.728+0000 7f72f27fc640 1 --2- 172.21.15.53:0/2939197591 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72fc06c7d0 0x7f72fc0b0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:40.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.728+0000 7f72fb7fe640 1 --2- 172.21.15.53:0/2939197591 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f72fc0ccc90 0x7f72fc15a9b0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f72f400b2c0 tx=0x7f72f401b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:40.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.728+0000 7f72f3fff640 1 -- 172.21.15.53:0/2939197591 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f40afe40 con 0x7f72fc0ccc90 2023-06-10T18:53:40.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.728+0000 7f72f3fff640 1 -- 172.21.15.53:0/2939197591 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f40ba420 con 0x7f72fc0ccc90 2023-06-10T18:53:40.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.728+0000 7f7301419640 1 -- 172.21.15.53:0/2939197591 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72fc0c3cc0 con 0x7f72fc0ccc90 2023-06-10T18:53:40.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.728+0000 7f72f3fff640 1 -- 172.21.15.53:0/2939197591 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f40ba7d0 con 0x7f72fc0ccc90 2023-06-10T18:53:40.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.732+0000 7f7301419640 1 -- 172.21.15.53:0/2939197591 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72fc151c00 con 0x7f72fc0ccc90 2023-06-10T18:53:40.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.732+0000 7f7301419640 1 -- 172.21.15.53:0/2939197591 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72fc04d790 con 0x7f72fc0ccc90 2023-06-10T18:53:40.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.732+0000 7f72f3fff640 1 -- 172.21.15.53:0/2939197591 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f72f40b6040 con 0x7f72fc0ccc90 2023-06-10T18:53:40.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.732+0000 7f72f3fff640 1 --2- 172.21.15.53:0/2939197591 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f72dc066280 0x7f72dc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:40.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.732+0000 7f72f3fff640 1 -- 172.21.15.53:0/2939197591 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f72f41210a0 con 0x7f72fc0ccc90 2023-06-10T18:53:40.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.732+0000 7f72faffd640 1 --2- 172.21.15.53:0/2939197591 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f72dc066280 0x7f72dc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:40.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.732+0000 7f72faffd640 1 --2- 172.21.15.53:0/2939197591 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f72dc066280 0x7f72dc068730 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f72fc15a940 tx=0x7f72ec009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:40.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.736+0000 7f72f3fff640 1 -- 172.21.15.53:0/2939197591 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f72f40ee570 con 0x7f72fc0ccc90 2023-06-10T18:53:40.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.892+0000 7f7301419640 1 -- 172.21.15.53:0/2939197591 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f72fc0c4170 con 0x7f72fc0ccc90 2023-06-10T18:53:40.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.896+0000 7f72f3fff640 1 -- 172.21.15.53:0/2939197591 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18363 (secure 0 0 0) 0x7f72f40f1b90 con 0x7f72fc0ccc90 2023-06-10T18:53:40.904 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:53:40.904 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":25,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T18:53:27.127355+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-10T18:52:43.396243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-10T18:52:43.894228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.23","mappings":[{"from":3,"to":2}]},{"pgid":"4.3e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T18:53:40.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.896+0000 7f7301419640 1 -- 172.21.15.53:0/2939197591 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f72dc066280 msgr2=0x7f72dc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:40.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.896+0000 7f7301419640 1 --2- 172.21.15.53:0/2939197591 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f72dc066280 0x7f72dc068730 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f72fc15a940 tx=0x7f72ec009040 comp rx=0 tx=0).stop 2023-06-10T18:53:40.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.896+0000 7f7301419640 1 -- 172.21.15.53:0/2939197591 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f72fc0ccc90 msgr2=0x7f72fc15a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:40.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.896+0000 7f7301419640 1 --2- 172.21.15.53:0/2939197591 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f72fc0ccc90 0x7f72fc15a9b0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f72f400b2c0 tx=0x7f72f401b8d0 comp rx=0 tx=0).stop 2023-06-10T18:53:40.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.896+0000 7f7301419640 1 -- 172.21.15.53:0/2939197591 shutdown_connections 2023-06-10T18:53:40.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.896+0000 7f7301419640 1 --2- 172.21.15.53:0/2939197591 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f72dc066280 0x7f72dc068730 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:40.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.896+0000 7f7301419640 1 --2- 172.21.15.53:0/2939197591 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f72fc0ccc90 0x7f72fc15a9b0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:40.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.896+0000 7f7301419640 1 --2- 172.21.15.53:0/2939197591 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72fc06c7d0 0x7f72fc0b0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:40.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.896+0000 7f7301419640 1 --2- 172.21.15.53:0/2939197591 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72fc06c400 0x7f72fc0c44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:40.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.896+0000 7f7301419640 1 -- 172.21.15.53:0/2939197591 >> 172.21.15.53:0/2939197591 conn(0x7f72fc06a560 msgr2=0x7f72fc0707b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:40.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.896+0000 7f7301419640 1 -- 172.21.15.53:0/2939197591 shutdown_connections 2023-06-10T18:53:40.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:40.896+0000 7f7301419640 1 -- 172.21.15.53:0/2939197591 wait complete. 2023-06-10T18:53:40.924 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-10T18:52:33.633114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-10T18:52:39.171487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-10T18:52:43.396243+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-10T18:52:43.894228+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-10T18:53:40.925 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-10T18:53:41.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.040+0000 7fee5b389640 1 Processor -- start 2023-06-10T18:53:41.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.040+0000 7fee5b389640 1 -- start start 2023-06-10T18:53:41.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.044+0000 7fee5b389640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fee5415c090 0x7fee540b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:41.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.044+0000 7fee5b389640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee540cc7c0 con 0x7fee540b7e30 2023-06-10T18:53:41.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.044+0000 7fee5b389640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee540ccaa0 con 0x7fee540b0b90 2023-06-10T18:53:41.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.044+0000 7fee5b389640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee540ccd80 con 0x7fee5415c090 2023-06-10T18:53:41.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.044+0000 7fee59125640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fee5415c090 0x7fee540b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:41.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.044+0000 7fee59926640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fee540b7e30 0x7fee540d04d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:55992/0 (socket says 172.21.15.53:55992) 2023-06-10T18:53:41.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.044+0000 7fee59926640 1 -- 172.21.15.53:0/4026229737 learned_addr learned my addr 172.21.15.53:0/4026229737 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:53:41.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.044+0000 7fee59125640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fee5415c090 0x7fee540b10c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37236/0 (socket says 172.21.15.53:37236) 2023-06-10T18:53:41.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.044+0000 7fee59125640 1 -- 172.21.15.53:0/4026229737 >> v1:172.21.15.117:6789/0 conn(0x7fee540b0b90 legacy=0x7fee540b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:41.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.044+0000 7fee59125640 1 -- 172.21.15.53:0/4026229737 >> v1:172.21.15.53:6789/0 conn(0x7fee540b7e30 legacy=0x7fee540d04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:41.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.044+0000 7fee59125640 1 -- 172.21.15.53:0/4026229737 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee540cd060 con 0x7fee5415c090 2023-06-10T18:53:41.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.044+0000 7fee59125640 1 --2- 172.21.15.53:0/4026229737 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee5415c090 0x7fee540b10c0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fee500097c0 tx=0x7fee5001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1527ee298c9ebc3 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:41.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.044+0000 7fee4bfff640 1 -- 172.21.15.53:0/4026229737 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee500ab600 con 0x7fee5415c090 2023-06-10T18:53:41.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.044+0000 7fee4bfff640 1 -- 172.21.15.53:0/4026229737 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee500a7050 con 0x7fee5415c090 2023-06-10T18:53:41.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.048+0000 7fee4bfff640 1 -- 172.21.15.53:0/4026229737 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee500ab980 con 0x7fee5415c090 2023-06-10T18:53:41.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.048+0000 7fee5b389640 1 -- 172.21.15.53:0/4026229737 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee5415c090 msgr2=0x7fee540b10c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:41.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.048+0000 7fee5b389640 1 --2- 172.21.15.53:0/4026229737 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee5415c090 0x7fee540b10c0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fee500097c0 tx=0x7fee5001c3c0 comp rx=0 tx=0).stop 2023-06-10T18:53:41.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.048+0000 7fee5b389640 1 -- 172.21.15.53:0/4026229737 shutdown_connections 2023-06-10T18:53:41.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.048+0000 7fee5b389640 1 --2- 172.21.15.53:0/4026229737 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee5415c090 0x7fee540b10c0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:41.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.048+0000 7fee5b389640 1 -- 172.21.15.53:0/4026229737 >> 172.21.15.53:0/4026229737 conn(0x7fee54069e20 msgr2=0x7fee5406a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:41.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.048+0000 7fee5b389640 1 -- 172.21.15.53:0/4026229737 shutdown_connections 2023-06-10T18:53:41.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.048+0000 7fee5b389640 1 -- 172.21.15.53:0/4026229737 wait complete. 2023-06-10T18:53:41.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.048+0000 7fee5b389640 1 Processor -- start 2023-06-10T18:53:41.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.048+0000 7fee5b389640 1 -- start start 2023-06-10T18:53:41.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.048+0000 7fee5b389640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee540b0b90 0x7fee540c9b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:41.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.048+0000 7fee5b389640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee540b7e30 0x7fee5415dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:41.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.048+0000 7fee5b389640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee5415c090 0x7fee540c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:41.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.048+0000 7fee5b389640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee5415cf90 con 0x7fee540b0b90 2023-06-10T18:53:41.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.048+0000 7fee5b389640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee5415d230 con 0x7fee540b7e30 2023-06-10T18:53:41.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.048+0000 7fee5b389640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee5415d510 con 0x7fee5415c090 2023-06-10T18:53:41.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.048+0000 7fee59125640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee540b0b90 0x7fee540c9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:41.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.048+0000 7fee59125640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee540b0b90 0x7fee540c9b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37238/0 (socket says 172.21.15.53:37238) 2023-06-10T18:53:41.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.048+0000 7fee59125640 1 -- 172.21.15.53:0/1314831902 learned_addr learned my addr 172.21.15.53:0/1314831902 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:41.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.048+0000 7fee59125640 1 -- 172.21.15.53:0/1314831902 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee5415c090 msgr2=0x7fee540c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:41.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.048+0000 7fee59125640 1 --2- 172.21.15.53:0/1314831902 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee5415c090 0x7fee540c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:41.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.048+0000 7fee59125640 1 -- 172.21.15.53:0/1314831902 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee540b7e30 msgr2=0x7fee5415dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:41.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.048+0000 7fee59125640 1 --2- 172.21.15.53:0/1314831902 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee540b7e30 0x7fee5415dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:41.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.048+0000 7fee59125640 1 -- 172.21.15.53:0/1314831902 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee50009420 con 0x7fee540b0b90 2023-06-10T18:53:41.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.048+0000 7fee59125640 1 --2- 172.21.15.53:0/1314831902 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee540b0b90 0x7fee540c9b00 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fee500ae040 tx=0x7fee5001ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:41.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.048+0000 7fee49ffb640 1 -- 172.21.15.53:0/1314831902 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee500b7650 con 0x7fee540b0b90 2023-06-10T18:53:41.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.048+0000 7fee49ffb640 1 -- 172.21.15.53:0/1314831902 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee500b77d0 con 0x7fee540b0b90 2023-06-10T18:53:41.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.048+0000 7fee5b389640 1 -- 172.21.15.53:0/1314831902 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee5415d7f0 con 0x7fee540b0b90 2023-06-10T18:53:41.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.052+0000 7fee49ffb640 1 -- 172.21.15.53:0/1314831902 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee500b7b80 con 0x7fee540b0b90 2023-06-10T18:53:41.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.052+0000 7fee5b389640 1 -- 172.21.15.53:0/1314831902 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee540ca040 con 0x7fee540b0b90 2023-06-10T18:53:41.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.052+0000 7fee5b389640 1 -- 172.21.15.53:0/1314831902 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee540ca230 con 0x7fee540b0b90 2023-06-10T18:53:41.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.052+0000 7fee49ffb640 1 -- 172.21.15.53:0/1314831902 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fee500b7ce0 con 0x7fee540b0b90 2023-06-10T18:53:41.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.052+0000 7fee49ffb640 1 --2- 172.21.15.53:0/1314831902 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fee38066280 0x7fee38068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:41.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.052+0000 7fee49ffb640 1 -- 172.21.15.53:0/1314831902 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fee5011e690 con 0x7fee540b0b90 2023-06-10T18:53:41.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.052+0000 7fee58924640 1 --2- 172.21.15.53:0/1314831902 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fee38066280 0x7fee38068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:41.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.052+0000 7fee58924640 1 --2- 172.21.15.53:0/1314831902 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fee38066280 0x7fee38068730 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fee44000f70 tx=0x7fee440079c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:41.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.056+0000 7fee49ffb640 1 -- 172.21.15.53:0/1314831902 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fee500ebbf0 con 0x7fee540b0b90 2023-06-10T18:53:41.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.216+0000 7fee5b389640 1 -- 172.21.15.53:0/1314831902 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fee5404d790 con 0x7fee540b0b90 2023-06-10T18:53:41.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.216+0000 7fee49ffb640 1 -- 172.21.15.53:0/1314831902 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fee500ef210 con 0x7fee540b0b90 2023-06-10T18:53:41.224 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-06-10T18:53:41.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.216+0000 7fee5b389640 1 -- 172.21.15.53:0/1314831902 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fee38066280 msgr2=0x7fee38068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:41.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.216+0000 7fee5b389640 1 --2- 172.21.15.53:0/1314831902 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fee38066280 0x7fee38068730 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fee44000f70 tx=0x7fee440079c0 comp rx=0 tx=0).stop 2023-06-10T18:53:41.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.216+0000 7fee5b389640 1 -- 172.21.15.53:0/1314831902 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee540b0b90 msgr2=0x7fee540c9b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:41.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.216+0000 7fee5b389640 1 --2- 172.21.15.53:0/1314831902 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee540b0b90 0x7fee540c9b00 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fee500ae040 tx=0x7fee5001ac00 comp rx=0 tx=0).stop 2023-06-10T18:53:41.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.216+0000 7fee5b389640 1 -- 172.21.15.53:0/1314831902 shutdown_connections 2023-06-10T18:53:41.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.216+0000 7fee5b389640 1 --2- 172.21.15.53:0/1314831902 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fee38066280 0x7fee38068730 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:41.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.216+0000 7fee5b389640 1 --2- 172.21.15.53:0/1314831902 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee5415c090 0x7fee540c5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:41.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.216+0000 7fee5b389640 1 --2- 172.21.15.53:0/1314831902 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee540b7e30 0x7fee5415dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:41.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.216+0000 7fee5b389640 1 --2- 172.21.15.53:0/1314831902 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee540b0b90 0x7fee540c9b00 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:41.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.216+0000 7fee5b389640 1 -- 172.21.15.53:0/1314831902 >> 172.21.15.53:0/1314831902 conn(0x7fee54069e20 msgr2=0x7fee5415a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:41.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.216+0000 7fee5b389640 1 -- 172.21.15.53:0/1314831902 shutdown_connections 2023-06-10T18:53:41.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.216+0000 7fee5b389640 1 -- 172.21.15.53:0/1314831902 wait complete. 2023-06-10T18:53:41.243 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-10T18:53:41.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.368+0000 7fae83d4f640 1 Processor -- start 2023-06-10T18:53:41.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.368+0000 7fae83d4f640 1 -- start start 2023-06-10T18:53:41.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.368+0000 7fae83d4f640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fae7c15c090 0x7fae7c0b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:41.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.368+0000 7fae83d4f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fae7c0b0b90 0x7fae7c0b7720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:41.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.368+0000 7fae83d4f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae7c0b7c60 0x7fae7c0b3b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:41.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.368+0000 7fae83d4f640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae7c0b80e0 con 0x7fae7c0b0b90 2023-06-10T18:53:41.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.368+0000 7fae83d4f640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae7c0cc7c0 con 0x7fae7c15c090 2023-06-10T18:53:41.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.368+0000 7fae83d4f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae7c0ccaa0 con 0x7fae7c0b7c60 2023-06-10T18:53:41.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.368+0000 7fae812ea640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fae7c0b0b90 0x7fae7c0b7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:41.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.368+0000 7fae812ea640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fae7c0b0b90 0x7fae7c0b7720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34962/0 (socket says 172.21.15.53:34962) 2023-06-10T18:53:41.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.368+0000 7fae812ea640 1 -- 172.21.15.53:0/3164279927 learned_addr learned my addr 172.21.15.53:0/3164279927 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:41.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.368+0000 7fae81aeb640 1 --2- 172.21.15.53:0/3164279927 >> v2:172.21.15.117:3300/0 conn(0x7fae7c15c090 0x7fae7c0b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:41.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.368+0000 7fae822ec640 1 --2- 172.21.15.53:0/3164279927 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae7c0b7c60 0x7fae7c0b3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:41.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.368+0000 7fae812ea640 1 -- 172.21.15.53:0/3164279927 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae7c0b7c60 msgr2=0x7fae7c0b3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:41.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.368+0000 7fae812ea640 1 --2- 172.21.15.53:0/3164279927 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae7c0b7c60 0x7fae7c0b3b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:41.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.368+0000 7fae812ea640 1 -- 172.21.15.53:0/3164279927 >> v2:172.21.15.117:3300/0 conn(0x7fae7c15c090 msgr2=0x7fae7c0b10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:41.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.368+0000 7fae812ea640 1 --2- 172.21.15.53:0/3164279927 >> v2:172.21.15.117:3300/0 conn(0x7fae7c15c090 0x7fae7c0b10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:41.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.368+0000 7fae812ea640 1 -- 172.21.15.53:0/3164279927 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae7c0ccd80 con 0x7fae7c0b0b90 2023-06-10T18:53:41.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.372+0000 7fae812ea640 1 --2- 172.21.15.53:0/3164279927 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae7c0b0b90 0x7fae7c0b7720 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fae7c08a080 tx=0x7fae6c01c180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=449f3fa1539ba51 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:41.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.372+0000 7fae80ae9640 1 -- 172.21.15.53:0/3164279927 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6c0ab600 con 0x7fae7c0b0b90 2023-06-10T18:53:41.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.372+0000 7fae80ae9640 1 -- 172.21.15.53:0/3164279927 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae6c0a7050 con 0x7fae7c0b0b90 2023-06-10T18:53:41.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.372+0000 7fae80ae9640 1 -- 172.21.15.53:0/3164279927 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6c0ab980 con 0x7fae7c0b0b90 2023-06-10T18:53:41.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.372+0000 7fae83d4f640 1 -- 172.21.15.53:0/3164279927 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae7c0b0b90 msgr2=0x7fae7c0b7720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:41.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.372+0000 7fae83d4f640 1 --2- 172.21.15.53:0/3164279927 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae7c0b0b90 0x7fae7c0b7720 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fae7c08a080 tx=0x7fae6c01c180 comp rx=0 tx=0).stop 2023-06-10T18:53:41.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.372+0000 7fae83d4f640 1 -- 172.21.15.53:0/3164279927 shutdown_connections 2023-06-10T18:53:41.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.372+0000 7fae83d4f640 1 --2- 172.21.15.53:0/3164279927 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae7c0b7c60 0x7fae7c0b3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:41.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.372+0000 7fae83d4f640 1 --2- 172.21.15.53:0/3164279927 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae7c0b0b90 0x7fae7c0b7720 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:41.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.372+0000 7fae83d4f640 1 --2- 172.21.15.53:0/3164279927 >> v2:172.21.15.117:3300/0 conn(0x7fae7c15c090 0x7fae7c0b10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:41.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.372+0000 7fae83d4f640 1 -- 172.21.15.53:0/3164279927 >> 172.21.15.53:0/3164279927 conn(0x7fae7c069e20 msgr2=0x7fae7c06a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:41.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.372+0000 7fae83d4f640 1 -- 172.21.15.53:0/3164279927 shutdown_connections 2023-06-10T18:53:41.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.372+0000 7fae83d4f640 1 -- 172.21.15.53:0/3164279927 wait complete. 2023-06-10T18:53:41.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.372+0000 7fae83d4f640 1 Processor -- start 2023-06-10T18:53:41.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.372+0000 7fae83d4f640 1 -- start start 2023-06-10T18:53:41.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.372+0000 7fae83d4f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae7c0b0b90 0x7fae7c0b2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:41.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.372+0000 7fae83d4f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae7c0b7c60 0x7fae7c0b68c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:41.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.372+0000 7fae83d4f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae7c15c090 0x7fae7c14b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:41.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.372+0000 7fae83d4f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae7c150b10 con 0x7fae7c15c090 2023-06-10T18:53:41.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.372+0000 7fae83d4f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae7c0b2ae0 con 0x7fae7c0b7c60 2023-06-10T18:53:41.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.372+0000 7fae83d4f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae7c0b5de0 con 0x7fae7c0b0b90 2023-06-10T18:53:41.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.372+0000 7fae822ec640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae7c15c090 0x7fae7c14b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:41.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.372+0000 7fae822ec640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae7c15c090 0x7fae7c14b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34980/0 (socket says 172.21.15.53:34980) 2023-06-10T18:53:41.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.372+0000 7fae822ec640 1 -- 172.21.15.53:0/3238982547 learned_addr learned my addr 172.21.15.53:0/3238982547 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:41.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.372+0000 7fae81aeb640 1 --2- 172.21.15.53:0/3238982547 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae7c0b0b90 0x7fae7c0b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:41.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.372+0000 7fae812ea640 1 --2- 172.21.15.53:0/3238982547 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae7c0b7c60 0x7fae7c0b68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:41.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.372+0000 7fae822ec640 1 -- 172.21.15.53:0/3238982547 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae7c0b0b90 msgr2=0x7fae7c0b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:41.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.372+0000 7fae822ec640 1 --2- 172.21.15.53:0/3238982547 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae7c0b0b90 0x7fae7c0b2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:41.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.372+0000 7fae822ec640 1 -- 172.21.15.53:0/3238982547 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae7c0b7c60 msgr2=0x7fae7c0b68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:41.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.372+0000 7fae822ec640 1 --2- 172.21.15.53:0/3238982547 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae7c0b7c60 0x7fae7c0b68c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:41.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.372+0000 7fae822ec640 1 -- 172.21.15.53:0/3238982547 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae6c0094d0 con 0x7fae7c15c090 2023-06-10T18:53:41.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.372+0000 7fae812ea640 1 --2- 172.21.15.53:0/3238982547 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae7c0b7c60 0x7fae7c0b68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:41.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.372+0000 7fae81aeb640 1 --2- 172.21.15.53:0/3238982547 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae7c0b0b90 0x7fae7c0b2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:41.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.376+0000 7fae822ec640 1 --2- 172.21.15.53:0/3238982547 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae7c15c090 0x7fae7c14b520 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fae74007e60 tx=0x7fae7400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:41.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.376+0000 7fae727fc640 1 -- 172.21.15.53:0/3238982547 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae74014620 con 0x7fae7c15c090 2023-06-10T18:53:41.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.376+0000 7fae727fc640 1 -- 172.21.15.53:0/3238982547 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae7400ee90 con 0x7fae7c15c090 2023-06-10T18:53:41.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.376+0000 7fae83d4f640 1 -- 172.21.15.53:0/3238982547 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae7c0b60c0 con 0x7fae7c15c090 2023-06-10T18:53:41.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.376+0000 7fae727fc640 1 -- 172.21.15.53:0/3238982547 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae740149e0 con 0x7fae7c15c090 2023-06-10T18:53:41.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.376+0000 7fae83d4f640 1 -- 172.21.15.53:0/3238982547 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae7c0b2dc0 con 0x7fae7c15c090 2023-06-10T18:53:41.395 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.376+0000 7fae83d4f640 1 -- 172.21.15.53:0/3238982547 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae7c04d790 con 0x7fae7c15c090 2023-06-10T18:53:41.395 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.376+0000 7fae727fc640 1 -- 172.21.15.53:0/3238982547 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fae74014b40 con 0x7fae7c15c090 2023-06-10T18:53:41.395 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.376+0000 7fae727fc640 1 --2- 172.21.15.53:0/3238982547 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fae60066280 0x7fae60068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:41.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.376+0000 7fae727fc640 1 -- 172.21.15.53:0/3238982547 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fae740846b0 con 0x7fae7c15c090 2023-06-10T18:53:41.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.376+0000 7fae81aeb640 1 --2- 172.21.15.53:0/3238982547 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fae60066280 0x7fae60068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:41.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.376+0000 7fae81aeb640 1 --2- 172.21.15.53:0/3238982547 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fae60066280 0x7fae60068730 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fae7c0b3530 tx=0x7fae78008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:41.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.380+0000 7fae727fc640 1 -- 172.21.15.53:0/3238982547 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fae74051af0 con 0x7fae7c15c090 2023-06-10T18:53:41.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.536+0000 7fae83d4f640 1 -- 172.21.15.53:0/3238982547 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fae7c153d70 con 0x7fae7c15c090 2023-06-10T18:53:41.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.536+0000 7fae727fc640 1 -- 172.21.15.53:0/3238982547 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7fae74082e60 con 0x7fae7c15c090 2023-06-10T18:53:41.545 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-06-10T18:53:41.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.536+0000 7fae83d4f640 1 -- 172.21.15.53:0/3238982547 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fae60066280 msgr2=0x7fae60068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:41.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.536+0000 7fae83d4f640 1 --2- 172.21.15.53:0/3238982547 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fae60066280 0x7fae60068730 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fae7c0b3530 tx=0x7fae78008040 comp rx=0 tx=0).stop 2023-06-10T18:53:41.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.536+0000 7fae83d4f640 1 -- 172.21.15.53:0/3238982547 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae7c15c090 msgr2=0x7fae7c14b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:41.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.536+0000 7fae83d4f640 1 --2- 172.21.15.53:0/3238982547 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae7c15c090 0x7fae7c14b520 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fae74007e60 tx=0x7fae7400e4b0 comp rx=0 tx=0).stop 2023-06-10T18:53:41.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.536+0000 7fae83d4f640 1 -- 172.21.15.53:0/3238982547 shutdown_connections 2023-06-10T18:53:41.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.536+0000 7fae83d4f640 1 --2- 172.21.15.53:0/3238982547 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fae60066280 0x7fae60068730 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:41.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.536+0000 7fae83d4f640 1 --2- 172.21.15.53:0/3238982547 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae7c15c090 0x7fae7c14b520 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:41.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.536+0000 7fae83d4f640 1 --2- 172.21.15.53:0/3238982547 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae7c0b7c60 0x7fae7c0b68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:41.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.536+0000 7fae83d4f640 1 --2- 172.21.15.53:0/3238982547 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae7c0b0b90 0x7fae7c0b2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:41.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.536+0000 7fae83d4f640 1 -- 172.21.15.53:0/3238982547 >> 172.21.15.53:0/3238982547 conn(0x7fae7c069e20 msgr2=0x7fae7c153580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:41.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.536+0000 7fae83d4f640 1 -- 172.21.15.53:0/3238982547 shutdown_connections 2023-06-10T18:53:41.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.536+0000 7fae83d4f640 1 -- 172.21.15.53:0/3238982547 wait complete. 2023-06-10T18:53:41.564 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-10T18:53:41.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.684+0000 7f3b3af45640 1 Processor -- start 2023-06-10T18:53:41.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.684+0000 7f3b3af45640 1 -- start start 2023-06-10T18:53:41.693 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.684+0000 7f3b3af45640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b34159b20 0x7f3b340cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:41.693 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.684+0000 7f3b3af45640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3b340ce120 0x7f3b3406f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:41.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.684+0000 7f3b3af45640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b340ce620 con 0x7f3b3406eca0 2023-06-10T18:53:41.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.684+0000 7f3b3af45640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b340cbb30 con 0x7f3b340ce120 2023-06-10T18:53:41.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.684+0000 7f3b3af45640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3406f650 con 0x7f3b34159b20 2023-06-10T18:53:41.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.684+0000 7f3b33fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f3b3406eca0 0x7f3b340cda10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:47932/0 (socket says 172.21.15.53:47932) 2023-06-10T18:53:41.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.684+0000 7f3b33fff640 1 -- 172.21.15.53:0/1931064001 learned_addr learned my addr 172.21.15.53:0/1931064001 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:53:41.696 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.684+0000 7f3b38ce1640 1 --2- 172.21.15.53:0/1931064001 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b34159b20 0x7f3b340cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:41.697 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.684+0000 7f3b394e2640 1 --2- 172.21.15.53:0/1931064001 >> v2:172.21.15.117:3300/0 conn(0x7f3b340ce120 0x7f3b3406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:41.697 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.684+0000 7f3b337fe640 1 -- 172.21.15.53:0/1931064001 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1692128653 0 0) 0x7f3b340ce620 con 0x7f3b3406eca0 2023-06-10T18:53:41.697 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.684+0000 7f3b337fe640 1 -- 172.21.15.53:0/1931064001 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b1c003530 con 0x7f3b3406eca0 2023-06-10T18:53:41.697 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.684+0000 7f3b337fe640 1 -- 172.21.15.53:0/1931064001 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3606661722 0 0) 0x7f3b1c003530 con 0x7f3b3406eca0 2023-06-10T18:53:41.697 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.684+0000 7f3b337fe640 1 -- 172.21.15.53:0/1931064001 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b34159b20 msgr2=0x7f3b340cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:41.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.684+0000 7f3b337fe640 1 --2- 172.21.15.53:0/1931064001 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b34159b20 0x7f3b340cf6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:41.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.684+0000 7f3b337fe640 1 -- 172.21.15.53:0/1931064001 >> v2:172.21.15.117:3300/0 conn(0x7f3b340ce120 msgr2=0x7f3b3406f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:41.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.684+0000 7f3b337fe640 1 --2- 172.21.15.53:0/1931064001 >> v2:172.21.15.117:3300/0 conn(0x7f3b340ce120 0x7f3b3406f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:41.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.684+0000 7f3b337fe640 1 -- 172.21.15.53:0/1931064001 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b340ce900 con 0x7f3b3406eca0 2023-06-10T18:53:41.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.684+0000 7f3b337fe640 1 -- 172.21.15.53:0/1931064001 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f3b28001680 con 0x7f3b3406eca0 2023-06-10T18:53:41.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.684+0000 7f3b337fe640 1 -- 172.21.15.53:0/1931064001 >> v1:172.21.15.53:6789/0 conn(0x7f3b3406eca0 legacy=0x7f3b340cda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:41.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.684+0000 7f3b337fe640 1 --2- 172.21.15.53:0/1931064001 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b1c0039b0 0x7f3b1c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:41.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.684+0000 7f3b337fe640 1 --2- 172.21.15.53:0/1931064001 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b34159b20 0x7f3b1c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:41.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.684+0000 7f3b337fe640 1 --2- 172.21.15.53:0/1931064001 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b1c004d10 0x7f3b1c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:41.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.684+0000 7f3b337fe640 1 -- 172.21.15.53:0/1931064001 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b340cbb30 con 0x7f3b1c0039b0 2023-06-10T18:53:41.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.684+0000 7f3b337fe640 1 -- 172.21.15.53:0/1931064001 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3406f650 con 0x7f3b1c004d10 2023-06-10T18:53:41.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.684+0000 7f3b337fe640 1 -- 172.21.15.53:0/1931064001 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b1c00b990 con 0x7f3b34159b20 2023-06-10T18:53:41.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.684+0000 7f3b38ce1640 1 --2- 172.21.15.53:0/1931064001 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b1c0039b0 0x7f3b1c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:41.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.684+0000 7f3b394e2640 1 --2- 172.21.15.53:0/1931064001 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b1c004d10 0x7f3b1c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:41.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.684+0000 7f3b38ce1640 1 -- 172.21.15.53:0/1931064001 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b34159b20 msgr2=0x7f3b1c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:41.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.684+0000 7f3b38ce1640 1 --2- 172.21.15.53:0/1931064001 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b34159b20 0x7f3b1c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:41.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.684+0000 7f3b38ce1640 1 -- 172.21.15.53:0/1931064001 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b1c004d10 msgr2=0x7f3b1c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:41.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.684+0000 7f3b38ce1640 1 --2- 172.21.15.53:0/1931064001 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b1c004d10 0x7f3b1c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:41.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.684+0000 7f3b38ce1640 1 -- 172.21.15.53:0/1931064001 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b1c003530 con 0x7f3b1c0039b0 2023-06-10T18:53:41.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.684+0000 7f3b394e2640 1 --2- 172.21.15.53:0/1931064001 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b1c004d10 0x7f3b1c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:41.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.688+0000 7f3b38ce1640 1 --2- 172.21.15.53:0/1931064001 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b1c0039b0 0x7f3b1c003dc0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f3b24009ae0 tx=0x7f3b2401ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1238110674eb93b8 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:41.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.688+0000 7f3b337fe640 1 -- 172.21.15.53:0/1931064001 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b240a5630 con 0x7f3b1c0039b0 2023-06-10T18:53:41.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.688+0000 7f3b337fe640 1 -- 172.21.15.53:0/1931064001 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b240a5790 con 0x7f3b1c0039b0 2023-06-10T18:53:41.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.688+0000 7f3b337fe640 1 -- 172.21.15.53:0/1931064001 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b240a5b40 con 0x7f3b1c0039b0 2023-06-10T18:53:41.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.688+0000 7f3b3af45640 1 -- 172.21.15.53:0/1931064001 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b1c0039b0 msgr2=0x7f3b1c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:41.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.688+0000 7f3b3af45640 1 --2- 172.21.15.53:0/1931064001 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b1c0039b0 0x7f3b1c003dc0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f3b24009ae0 tx=0x7f3b2401ca60 comp rx=0 tx=0).stop 2023-06-10T18:53:41.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.688+0000 7f3b394e2640 1 -- 172.21.15.53:0/1931064001 reap_dead start 2023-06-10T18:53:41.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.688+0000 7f3b3af45640 1 -- 172.21.15.53:0/1931064001 shutdown_connections 2023-06-10T18:53:41.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.688+0000 7f3b3af45640 1 -- 172.21.15.53:0/1931064001 >> 172.21.15.53:0/1931064001 conn(0x7f3b3406a0e0 msgr2=0x7f3b3406d270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:41.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.688+0000 7f3b3af45640 1 -- 172.21.15.53:0/1931064001 shutdown_connections 2023-06-10T18:53:41.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.688+0000 7f3b3af45640 1 -- 172.21.15.53:0/1931064001 wait complete. 2023-06-10T18:53:41.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.688+0000 7f3b3af45640 1 Processor -- start 2023-06-10T18:53:41.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.688+0000 7f3b3af45640 1 -- start start 2023-06-10T18:53:41.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.692+0000 7f3b3af45640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b1c0039b0 0x7f3b34157d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:41.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.692+0000 7f3b3af45640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b34148e10 0x7f3b340b4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:41.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.692+0000 7f3b3af45640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b34158280 0x7f3b340b5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:41.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.692+0000 7f3b3af45640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3414a690 con 0x7f3b1c0039b0 2023-06-10T18:53:41.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.692+0000 7f3b3af45640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b34157990 con 0x7f3b34158280 2023-06-10T18:53:41.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.692+0000 7f3b3af45640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b34149df0 con 0x7f3b34148e10 2023-06-10T18:53:41.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.692+0000 7f3b38ce1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b1c0039b0 0x7f3b34157d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:41.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.692+0000 7f3b38ce1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b1c0039b0 0x7f3b34157d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35008/0 (socket says 172.21.15.53:35008) 2023-06-10T18:53:41.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.692+0000 7f3b38ce1640 1 -- 172.21.15.53:0/2311466487 learned_addr learned my addr 172.21.15.53:0/2311466487 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:41.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.692+0000 7f3b33fff640 1 --2- 172.21.15.53:0/2311466487 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b34148e10 0x7f3b340b4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:41.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.692+0000 7f3b38ce1640 1 -- 172.21.15.53:0/2311466487 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b34148e10 msgr2=0x7f3b340b4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:41.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.692+0000 7f3b38ce1640 1 --2- 172.21.15.53:0/2311466487 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b34148e10 0x7f3b340b4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:41.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.692+0000 7f3b38ce1640 1 -- 172.21.15.53:0/2311466487 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b34158280 msgr2=0x7f3b340b5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:41.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.692+0000 7f3b394e2640 1 --2- 172.21.15.53:0/2311466487 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b34158280 0x7f3b340b5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:41.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.692+0000 7f3b38ce1640 1 --2- 172.21.15.53:0/2311466487 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b34158280 0x7f3b340b5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:41.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.692+0000 7f3b38ce1640 1 -- 172.21.15.53:0/2311466487 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b3414a0d0 con 0x7f3b1c0039b0 2023-06-10T18:53:41.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.692+0000 7f3b394e2640 1 --2- 172.21.15.53:0/2311466487 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b34158280 0x7f3b340b5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:41.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.692+0000 7f3b38ce1640 1 --2- 172.21.15.53:0/2311466487 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b1c0039b0 0x7f3b34157d40 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f3b2401c890 tx=0x7f3b1c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:41.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.692+0000 7f3b317fa640 1 -- 172.21.15.53:0/2311466487 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b240bc070 con 0x7f3b1c0039b0 2023-06-10T18:53:41.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.692+0000 7f3b317fa640 1 -- 172.21.15.53:0/2311466487 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b2400f000 con 0x7f3b1c0039b0 2023-06-10T18:53:41.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.692+0000 7f3b3af45640 1 -- 172.21.15.53:0/2311466487 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b3414a3b0 con 0x7f3b1c0039b0 2023-06-10T18:53:41.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.692+0000 7f3b317fa640 1 -- 172.21.15.53:0/2311466487 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b24004240 con 0x7f3b1c0039b0 2023-06-10T18:53:41.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.692+0000 7f3b3af45640 1 -- 172.21.15.53:0/2311466487 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b34158e90 con 0x7f3b1c0039b0 2023-06-10T18:53:41.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.692+0000 7f3b3af45640 1 -- 172.21.15.53:0/2311466487 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b340c6ef0 con 0x7f3b1c0039b0 2023-06-10T18:53:41.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.692+0000 7f3b317fa640 1 -- 172.21.15.53:0/2311466487 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3b240b4040 con 0x7f3b1c0039b0 2023-06-10T18:53:41.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.692+0000 7f3b317fa640 1 --2- 172.21.15.53:0/2311466487 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3b20066280 0x7f3b20068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:41.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.692+0000 7f3b317fa640 1 -- 172.21.15.53:0/2311466487 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f3b2411dd60 con 0x7f3b1c0039b0 2023-06-10T18:53:41.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.692+0000 7f3b33fff640 1 --2- 172.21.15.53:0/2311466487 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3b20066280 0x7f3b20068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:41.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.696+0000 7f3b33fff640 1 --2- 172.21.15.53:0/2311466487 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3b20066280 0x7f3b20068730 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3b280017b0 tx=0x7f3b28001600 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:41.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.696+0000 7f3b317fa640 1 -- 172.21.15.53:0/2311466487 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3b240eb310 con 0x7f3b1c0039b0 2023-06-10T18:53:41.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.848+0000 7f3b3af45640 1 -- 172.21.15.53:0/2311466487 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3b340c6ef0 con 0x7f3b1c0039b0 2023-06-10T18:53:41.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.848+0000 7f3b317fa640 1 -- 172.21.15.53:0/2311466487 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3b340c6ef0 con 0x7f3b1c0039b0 2023-06-10T18:53:41.861 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-06-10T18:53:41.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.852+0000 7f3b3af45640 1 -- 172.21.15.53:0/2311466487 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3b20066280 msgr2=0x7f3b20068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:41.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.852+0000 7f3b3af45640 1 --2- 172.21.15.53:0/2311466487 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3b20066280 0x7f3b20068730 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3b280017b0 tx=0x7f3b28001600 comp rx=0 tx=0).stop 2023-06-10T18:53:41.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.852+0000 7f3b3af45640 1 -- 172.21.15.53:0/2311466487 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b1c0039b0 msgr2=0x7f3b34157d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:41.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.852+0000 7f3b3af45640 1 --2- 172.21.15.53:0/2311466487 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b1c0039b0 0x7f3b34157d40 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f3b2401c890 tx=0x7f3b1c005800 comp rx=0 tx=0).stop 2023-06-10T18:53:41.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.852+0000 7f3b3af45640 1 -- 172.21.15.53:0/2311466487 shutdown_connections 2023-06-10T18:53:41.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.852+0000 7f3b3af45640 1 --2- 172.21.15.53:0/2311466487 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3b20066280 0x7f3b20068730 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:41.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.852+0000 7f3b3af45640 1 --2- 172.21.15.53:0/2311466487 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b34158280 0x7f3b340b5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:41.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.852+0000 7f3b3af45640 1 --2- 172.21.15.53:0/2311466487 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b34148e10 0x7f3b340b4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:41.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.852+0000 7f3b3af45640 1 --2- 172.21.15.53:0/2311466487 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b1c0039b0 0x7f3b34157d40 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:41.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.852+0000 7f3b3af45640 1 -- 172.21.15.53:0/2311466487 >> 172.21.15.53:0/2311466487 conn(0x7f3b3406a0e0 msgr2=0x7f3b34154bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:41.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.852+0000 7f3b3af45640 1 -- 172.21.15.53:0/2311466487 shutdown_connections 2023-06-10T18:53:41.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:41.852+0000 7f3b3af45640 1 -- 172.21.15.53:0/2311466487 wait complete. 2023-06-10T18:53:41.879 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-10T18:53:42.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.000+0000 7f3668c1d640 1 Processor -- start 2023-06-10T18:53:42.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.000+0000 7f3668c1d640 1 -- start start 2023-06-10T18:53:42.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.000+0000 7f3668c1d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3664159450 0x7f366415d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:42.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.000+0000 7f3668c1d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36640cbac0 con 0x7f36640cf350 2023-06-10T18:53:42.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.000+0000 7f3668c1d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f366415dc00 con 0x7f366415d680 2023-06-10T18:53:42.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.000+0000 7f3668c1d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f366415dee0 con 0x7f3664159450 2023-06-10T18:53:42.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.000+0000 7f366259c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3664159450 0x7f366415d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:42.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.000+0000 7f3662d9d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f36640cf350 0x7f36640cbf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:47934/0 (socket says 172.21.15.53:47934) 2023-06-10T18:53:42.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.000+0000 7f3662d9d640 1 -- 172.21.15.53:0/965503474 learned_addr learned my addr 172.21.15.53:0/965503474 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:53:42.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.000+0000 7f366259c640 1 -- 172.21.15.53:0/965503474 >> v1:172.21.15.117:6789/0 conn(0x7f366415d680 legacy=0x7f36640cec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:42.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.000+0000 7f366159a640 1 -- 172.21.15.53:0/965503474 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 531519546 0 0) 0x7f36640cbac0 con 0x7f36640cf350 2023-06-10T18:53:42.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.000+0000 7f366259c640 1 -- 172.21.15.53:0/965503474 >> v1:172.21.15.53:6789/0 conn(0x7f36640cf350 legacy=0x7f36640cbf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:42.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.000+0000 7f366259c640 1 -- 172.21.15.53:0/965503474 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36640cb750 con 0x7f3664159450 2023-06-10T18:53:42.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.004+0000 7f366259c640 1 --2- 172.21.15.53:0/965503474 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3664159450 0x7f366415d140 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f365c009d90 tx=0x7f365c01c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0ba786e418ac209 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:42.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.004+0000 7f366159a640 1 -- 172.21.15.53:0/965503474 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f365c0a59d0 con 0x7f3664159450 2023-06-10T18:53:42.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.004+0000 7f366159a640 1 -- 172.21.15.53:0/965503474 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f365c0a5b30 con 0x7f3664159450 2023-06-10T18:53:42.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.004+0000 7f366159a640 1 -- 172.21.15.53:0/965503474 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f365c0ad440 con 0x7f3664159450 2023-06-10T18:53:42.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.004+0000 7f3668c1d640 1 -- 172.21.15.53:0/965503474 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3664159450 msgr2=0x7f366415d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:42.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.004+0000 7f3668c1d640 1 --2- 172.21.15.53:0/965503474 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3664159450 0x7f366415d140 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f365c009d90 tx=0x7f365c01c8f0 comp rx=0 tx=0).stop 2023-06-10T18:53:42.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.004+0000 7f3668c1d640 1 -- 172.21.15.53:0/965503474 shutdown_connections 2023-06-10T18:53:42.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.004+0000 7f3668c1d640 1 --2- 172.21.15.53:0/965503474 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3664159450 0x7f366415d140 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:42.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.004+0000 7f3668c1d640 1 -- 172.21.15.53:0/965503474 >> 172.21.15.53:0/965503474 conn(0x7f366406a090 msgr2=0x7f366406d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:42.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.004+0000 7f3668c1d640 1 -- 172.21.15.53:0/965503474 shutdown_connections 2023-06-10T18:53:42.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.004+0000 7f3668c1d640 1 -- 172.21.15.53:0/965503474 wait complete. 2023-06-10T18:53:42.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.004+0000 7f3668c1d640 1 Processor -- start 2023-06-10T18:53:42.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.004+0000 7f3668c1d640 1 -- start start 2023-06-10T18:53:42.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.004+0000 7f3668c1d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36640cf350 0x7f3664155af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:42.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.004+0000 7f3668c1d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3664159450 0x7f3664162f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:42.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.004+0000 7f3668c1d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f366415d680 0x7f3664150180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:42.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.004+0000 7f3668c1d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3664153de0 con 0x7f366415d680 2023-06-10T18:53:42.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.004+0000 7f3668c1d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3664153820 con 0x7f36640cf350 2023-06-10T18:53:42.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.004+0000 7f3668c1d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3664153b00 con 0x7f3664159450 2023-06-10T18:53:42.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.004+0000 7f3662d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f366415d680 0x7f3664150180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:42.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.004+0000 7f3662d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f366415d680 0x7f3664150180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35024/0 (socket says 172.21.15.53:35024) 2023-06-10T18:53:42.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.004+0000 7f3662d9d640 1 -- 172.21.15.53:0/2760328065 learned_addr learned my addr 172.21.15.53:0/2760328065 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:42.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.004+0000 7f366259c640 1 --2- 172.21.15.53:0/2760328065 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36640cf350 0x7f3664155af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:42.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.004+0000 7f3661d9b640 1 --2- 172.21.15.53:0/2760328065 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3664159450 0x7f3664162f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:42.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.004+0000 7f3662d9d640 1 -- 172.21.15.53:0/2760328065 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3664159450 msgr2=0x7f3664162f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:42.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.004+0000 7f3662d9d640 1 --2- 172.21.15.53:0/2760328065 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3664159450 0x7f3664162f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:42.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.004+0000 7f3662d9d640 1 -- 172.21.15.53:0/2760328065 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36640cf350 msgr2=0x7f3664155af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:42.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.004+0000 7f3662d9d640 1 --2- 172.21.15.53:0/2760328065 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36640cf350 0x7f3664155af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:42.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.004+0000 7f3662d9d640 1 -- 172.21.15.53:0/2760328065 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f365c009a70 con 0x7f366415d680 2023-06-10T18:53:42.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.004+0000 7f3661d9b640 1 --2- 172.21.15.53:0/2760328065 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3664159450 0x7f3664162f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:42.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.004+0000 7f3662d9d640 1 --2- 172.21.15.53:0/2760328065 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f366415d680 0x7f3664150180 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f365400c450 tx=0x7f365400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:42.020 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.008+0000 7f365affd640 1 -- 172.21.15.53:0/2760328065 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36540074e0 con 0x7f366415d680 2023-06-10T18:53:42.020 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.008+0000 7f365affd640 1 -- 172.21.15.53:0/2760328065 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3654007640 con 0x7f366415d680 2023-06-10T18:53:42.020 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.008+0000 7f3668c1d640 1 -- 172.21.15.53:0/2760328065 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36641552f0 con 0x7f366415d680 2023-06-10T18:53:42.020 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.008+0000 7f365affd640 1 -- 172.21.15.53:0/2760328065 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3654004a30 con 0x7f366415d680 2023-06-10T18:53:42.020 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.008+0000 7f3668c1d640 1 -- 172.21.15.53:0/2760328065 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3664156030 con 0x7f366415d680 2023-06-10T18:53:42.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.008+0000 7f3668c1d640 1 -- 172.21.15.53:0/2760328065 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f366404d790 con 0x7f366415d680 2023-06-10T18:53:42.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.008+0000 7f365affd640 1 -- 172.21.15.53:0/2760328065 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3654004b90 con 0x7f366415d680 2023-06-10T18:53:42.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.008+0000 7f365affd640 1 --2- 172.21.15.53:0/2760328065 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3644066280 0x7f3644068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:42.022 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.008+0000 7f365affd640 1 -- 172.21.15.53:0/2760328065 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f3654083ab0 con 0x7f366415d680 2023-06-10T18:53:42.022 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.008+0000 7f366259c640 1 --2- 172.21.15.53:0/2760328065 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3644066280 0x7f3644068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:42.022 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.008+0000 7f366259c640 1 --2- 172.21.15.53:0/2760328065 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3644066280 0x7f3644068730 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f365c0af000 tx=0x7f365c0a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:42.022 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.012+0000 7f365affd640 1 -- 172.21.15.53:0/2760328065 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3654050f80 con 0x7f366415d680 2023-06-10T18:53:42.175 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.164+0000 7f3668c1d640 1 -- 172.21.15.53:0/2760328065 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3664065460 con 0x7f366415d680 2023-06-10T18:53:42.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.168+0000 7f365affd640 1 -- 172.21.15.53:0/2760328065 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3654058e60 con 0x7f366415d680 2023-06-10T18:53:42.177 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-06-10T18:53:42.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.168+0000 7f3668c1d640 1 -- 172.21.15.53:0/2760328065 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3644066280 msgr2=0x7f3644068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:42.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.168+0000 7f3668c1d640 1 --2- 172.21.15.53:0/2760328065 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3644066280 0x7f3644068730 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f365c0af000 tx=0x7f365c0a7070 comp rx=0 tx=0).stop 2023-06-10T18:53:42.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.168+0000 7f3668c1d640 1 -- 172.21.15.53:0/2760328065 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f366415d680 msgr2=0x7f3664150180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:42.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.168+0000 7f3668c1d640 1 --2- 172.21.15.53:0/2760328065 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f366415d680 0x7f3664150180 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f365400c450 tx=0x7f365400c910 comp rx=0 tx=0).stop 2023-06-10T18:53:42.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.168+0000 7f3668c1d640 1 -- 172.21.15.53:0/2760328065 shutdown_connections 2023-06-10T18:53:42.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.168+0000 7f3668c1d640 1 --2- 172.21.15.53:0/2760328065 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3644066280 0x7f3644068730 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:42.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.168+0000 7f3668c1d640 1 --2- 172.21.15.53:0/2760328065 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f366415d680 0x7f3664150180 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:42.180 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.168+0000 7f3668c1d640 1 --2- 172.21.15.53:0/2760328065 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3664159450 0x7f3664162f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:42.180 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.168+0000 7f3668c1d640 1 --2- 172.21.15.53:0/2760328065 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36640cf350 0x7f3664155af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:42.180 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.168+0000 7f3668c1d640 1 -- 172.21.15.53:0/2760328065 >> 172.21.15.53:0/2760328065 conn(0x7f366406a090 msgr2=0x7f366406f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:42.180 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.168+0000 7f3668c1d640 1 -- 172.21.15.53:0/2760328065 shutdown_connections 2023-06-10T18:53:42.180 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.168+0000 7f3668c1d640 1 -- 172.21.15.53:0/2760328065 wait complete. 2023-06-10T18:53:42.195 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T18:53:42.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.312+0000 7f31076fe640 1 Processor -- start 2023-06-10T18:53:42.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.312+0000 7f31076fe640 1 -- start start 2023-06-10T18:53:42.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.312+0000 7f31076fe640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3100159630 0x7f310015d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:42.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.312+0000 7f31076fe640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3100070f10 con 0x7f31000ad730 2023-06-10T18:53:42.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.312+0000 7f31076fe640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f310015db60 con 0x7f3100069450 2023-06-10T18:53:42.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.312+0000 7f31076fe640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f310015de40 con 0x7f3100159630 2023-06-10T18:53:42.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.312+0000 7f3104c99640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f31000ad730 0x7f31000713a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:47950/0 (socket says 172.21.15.53:47950) 2023-06-10T18:53:42.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.312+0000 7f3104c99640 1 -- 172.21.15.53:0/2950026571 learned_addr learned my addr 172.21.15.53:0/2950026571 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:53:42.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.312+0000 7f310549a640 1 --2- 172.21.15.53:0/2950026571 >> v2:172.21.15.117:3300/0 conn(0x7f3100159630 0x7f310015d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:42.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.312+0000 7f30f7fff640 1 -- 172.21.15.53:0/2950026571 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1482974301 0 0) 0x7f3100070f10 con 0x7f31000ad730 2023-06-10T18:53:42.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.312+0000 7f30f7fff640 1 -- 172.21.15.53:0/2950026571 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30ec003530 con 0x7f31000ad730 2023-06-10T18:53:42.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.312+0000 7f30f7fff640 1 -- 172.21.15.53:0/2950026571 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 223577596 0 0) 0x7f30ec003530 con 0x7f31000ad730 2023-06-10T18:53:42.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.312+0000 7f30f7fff640 1 -- 172.21.15.53:0/2950026571 >> v2:172.21.15.117:3300/0 conn(0x7f3100159630 msgr2=0x7f310015d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:42.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.312+0000 7f30f7fff640 1 --2- 172.21.15.53:0/2950026571 >> v2:172.21.15.117:3300/0 conn(0x7f3100159630 0x7f310015d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:42.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.312+0000 7f30f7fff640 1 -- 172.21.15.53:0/2950026571 >> v1:172.21.15.117:6789/0 conn(0x7f3100069450 legacy=0x7f31000affc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:42.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.312+0000 7f30f7fff640 1 -- 172.21.15.53:0/2950026571 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f310015e120 con 0x7f31000ad730 2023-06-10T18:53:42.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.312+0000 7f30f7fff640 1 -- 172.21.15.53:0/2950026571 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f30f0001680 con 0x7f31000ad730 2023-06-10T18:53:42.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.312+0000 7f30f7fff640 1 -- 172.21.15.53:0/2950026571 >> v1:172.21.15.53:6789/0 conn(0x7f31000ad730 legacy=0x7f31000713a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:42.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.312+0000 7f30f7fff640 1 --2- 172.21.15.53:0/2950026571 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30ec003a40 0x7f30ec003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:42.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.312+0000 7f30f7fff640 1 --2- 172.21.15.53:0/2950026571 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30ec0047d0 0x7f30ec004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:42.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.312+0000 7f30f7fff640 1 --2- 172.21.15.53:0/2950026571 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30ec005180 0x7f30ec00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:42.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.312+0000 7f30f7fff640 1 -- 172.21.15.53:0/2950026571 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f310015de40 con 0x7f30ec0047d0 2023-06-10T18:53:42.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.312+0000 7f30f7fff640 1 -- 172.21.15.53:0/2950026571 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30ec00c0c0 con 0x7f30ec003a40 2023-06-10T18:53:42.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.312+0000 7f30f7fff640 1 -- 172.21.15.53:0/2950026571 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30ec00c280 con 0x7f30ec005180 2023-06-10T18:53:42.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.312+0000 7f3104c99640 1 --2- 172.21.15.53:0/2950026571 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30ec0047d0 0x7f30ec004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:42.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.312+0000 7f310549a640 1 --2- 172.21.15.53:0/2950026571 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30ec003a40 0x7f30ec003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:42.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.312+0000 7f3105c9b640 1 --2- 172.21.15.53:0/2950026571 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30ec005180 0x7f30ec00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:42.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.312+0000 7f3104c99640 1 -- 172.21.15.53:0/2950026571 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30ec005180 msgr2=0x7f30ec00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:42.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.312+0000 7f3104c99640 1 --2- 172.21.15.53:0/2950026571 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30ec005180 0x7f30ec00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:42.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.312+0000 7f3104c99640 1 -- 172.21.15.53:0/2950026571 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30ec003a40 msgr2=0x7f30ec003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:42.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.312+0000 7f3104c99640 1 --2- 172.21.15.53:0/2950026571 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30ec003a40 0x7f30ec003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:42.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.312+0000 7f3104c99640 1 -- 172.21.15.53:0/2950026571 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30ec003530 con 0x7f30ec0047d0 2023-06-10T18:53:42.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.312+0000 7f3105c9b640 1 -- 172.21.15.53:0/2950026571 reap_dead start 2023-06-10T18:53:42.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.316+0000 7f3104c99640 1 --2- 172.21.15.53:0/2950026571 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30ec0047d0 0x7f30ec004c40 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f30f0001ec0 tx=0x7f30f001f250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2096dfd9a029a619 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:42.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.316+0000 7f30f7fff640 1 -- 172.21.15.53:0/2950026571 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f00a8e70 con 0x7f30ec0047d0 2023-06-10T18:53:42.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.316+0000 7f30f7fff640 1 -- 172.21.15.53:0/2950026571 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30f00058e0 con 0x7f30ec0047d0 2023-06-10T18:53:42.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.316+0000 7f30f7fff640 1 -- 172.21.15.53:0/2950026571 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f0005cb0 con 0x7f30ec0047d0 2023-06-10T18:53:42.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.316+0000 7f31076fe640 1 -- 172.21.15.53:0/2950026571 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30ec0047d0 msgr2=0x7f30ec004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:42.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.316+0000 7f31076fe640 1 --2- 172.21.15.53:0/2950026571 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30ec0047d0 0x7f30ec004c40 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f30f0001ec0 tx=0x7f30f001f250 comp rx=0 tx=0).stop 2023-06-10T18:53:42.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.316+0000 7f31076fe640 1 -- 172.21.15.53:0/2950026571 shutdown_connections 2023-06-10T18:53:42.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.316+0000 7f31076fe640 1 --2- 172.21.15.53:0/2950026571 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30ec0047d0 0x7f30ec004c40 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:42.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.316+0000 7f31076fe640 1 -- 172.21.15.53:0/2950026571 >> 172.21.15.53:0/2950026571 conn(0x7f31000cafc0 msgr2=0x7f31000cb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:42.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.316+0000 7f31076fe640 1 -- 172.21.15.53:0/2950026571 shutdown_connections 2023-06-10T18:53:42.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.316+0000 7f31076fe640 1 -- 172.21.15.53:0/2950026571 wait complete. 2023-06-10T18:53:42.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.316+0000 7f31076fe640 1 Processor -- start 2023-06-10T18:53:42.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.316+0000 7f31076fe640 1 -- start start 2023-06-10T18:53:42.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.320+0000 7f31076fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30ec0047d0 0x7f3100155d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:42.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.320+0000 7f31076fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31000c64a0 0x7f3100154750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:42.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.320+0000 7f31076fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f310015b3a0 0x7f310015b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:42.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.320+0000 7f31076fe640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f310015bd50 con 0x7f31000c64a0 2023-06-10T18:53:42.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.320+0000 7f31076fe640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3100156b70 con 0x7f310015b3a0 2023-06-10T18:53:42.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.320+0000 7f31076fe640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31000c6f40 con 0x7f30ec0047d0 2023-06-10T18:53:42.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.320+0000 7f3104c99640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31000c64a0 0x7f3100154750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:42.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.320+0000 7f3104c99640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31000c64a0 0x7f3100154750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35034/0 (socket says 172.21.15.53:35034) 2023-06-10T18:53:42.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.320+0000 7f3104c99640 1 -- 172.21.15.53:0/2904912995 learned_addr learned my addr 172.21.15.53:0/2904912995 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:42.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.320+0000 7f3105c9b640 1 --2- 172.21.15.53:0/2904912995 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f310015b3a0 0x7f310015b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:42.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.320+0000 7f310549a640 1 --2- 172.21.15.53:0/2904912995 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30ec0047d0 0x7f3100155d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:42.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.320+0000 7f3104c99640 1 -- 172.21.15.53:0/2904912995 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30ec0047d0 msgr2=0x7f3100155d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:42.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.320+0000 7f3104c99640 1 --2- 172.21.15.53:0/2904912995 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30ec0047d0 0x7f3100155d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:42.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.320+0000 7f3104c99640 1 -- 172.21.15.53:0/2904912995 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f310015b3a0 msgr2=0x7f310015b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:42.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.320+0000 7f3104c99640 1 --2- 172.21.15.53:0/2904912995 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f310015b3a0 0x7f310015b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:42.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.320+0000 7f3104c99640 1 -- 172.21.15.53:0/2904912995 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31000c6980 con 0x7f31000c64a0 2023-06-10T18:53:42.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.320+0000 7f310549a640 1 --2- 172.21.15.53:0/2904912995 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30ec0047d0 0x7f3100155d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:42.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.320+0000 7f3104c99640 1 --2- 172.21.15.53:0/2904912995 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31000c64a0 0x7f3100154750 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f30f0001ec0 tx=0x7f30ec005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:42.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.320+0000 7f30f5ffb640 1 -- 172.21.15.53:0/2904912995 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f00b7070 con 0x7f31000c64a0 2023-06-10T18:53:42.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.320+0000 7f30f5ffb640 1 -- 172.21.15.53:0/2904912995 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30f00013c0 con 0x7f31000c64a0 2023-06-10T18:53:42.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.320+0000 7f30f5ffb640 1 -- 172.21.15.53:0/2904912995 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f00b2a50 con 0x7f31000c64a0 2023-06-10T18:53:42.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.320+0000 7f31076fe640 1 -- 172.21.15.53:0/2904912995 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31000c6c60 con 0x7f31000c64a0 2023-06-10T18:53:42.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.320+0000 7f31076fe640 1 -- 172.21.15.53:0/2904912995 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31001ef1c0 con 0x7f31000c64a0 2023-06-10T18:53:42.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.320+0000 7f31076fe640 1 -- 172.21.15.53:0/2904912995 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31000cbd00 con 0x7f31000c64a0 2023-06-10T18:53:42.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.320+0000 7f30f5ffb640 1 -- 172.21.15.53:0/2904912995 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f30f00b2bb0 con 0x7f31000c64a0 2023-06-10T18:53:42.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.320+0000 7f30f5ffb640 1 --2- 172.21.15.53:0/2904912995 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f30e40662b0 0x7f30e4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:42.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.320+0000 7f30f5ffb640 1 -- 172.21.15.53:0/2904912995 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f30f01206e0 con 0x7f31000c64a0 2023-06-10T18:53:42.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.320+0000 7f310549a640 1 --2- 172.21.15.53:0/2904912995 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f30e40662b0 0x7f30e4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:42.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.324+0000 7f310549a640 1 --2- 172.21.15.53:0/2904912995 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f30e40662b0 0x7f30e4068760 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f310004eaa0 tx=0x7f30fc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:42.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.324+0000 7f30f5ffb640 1 -- 172.21.15.53:0/2904912995 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f30f00edb10 con 0x7f31000c64a0 2023-06-10T18:53:42.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.516+0000 7f31076fe640 1 -- 172.21.15.53:0/2904912995 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3100156d00 con 0x7f31000c64a0 2023-06-10T18:53:42.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.516+0000 7f30f5ffb640 1 -- 172.21.15.53:0/2904912995 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4668 (secure 0 0 0) 0x7f30f00b2e60 con 0x7f31000c64a0 2023-06-10T18:53:42.526 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:53:42.526 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4236,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/1767214403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":1767214403},{"type":"v1","addr":"172.21.15.53:6834","nonce":1767214403}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/184933647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":184933647},{"type":"v1","addr":"172.21.15.117:6837","nonce":184933647}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/1556542558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":1556542558},{"type":"v1","addr":"172.21.15.53:6835","nonce":1556542558}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T18:52:44.918376+0000","modified":"2023-06-10T18:52:47.927154+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6835/1492134415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1492134415},{"type":"v1","addr":"172.21.15.117:6835","nonce":1492134415}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-10T18:53:42.527 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 7 2023-06-10T18:53:42.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.520+0000 7f31076fe640 1 -- 172.21.15.53:0/2904912995 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f30e40662b0 msgr2=0x7f30e4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:42.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.520+0000 7f31076fe640 1 --2- 172.21.15.53:0/2904912995 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f30e40662b0 0x7f30e4068760 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f310004eaa0 tx=0x7f30fc008040 comp rx=0 tx=0).stop 2023-06-10T18:53:42.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.520+0000 7f31076fe640 1 -- 172.21.15.53:0/2904912995 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31000c64a0 msgr2=0x7f3100154750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:42.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.520+0000 7f31076fe640 1 --2- 172.21.15.53:0/2904912995 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31000c64a0 0x7f3100154750 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f30f0001ec0 tx=0x7f30ec005800 comp rx=0 tx=0).stop 2023-06-10T18:53:42.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.520+0000 7f31076fe640 1 -- 172.21.15.53:0/2904912995 shutdown_connections 2023-06-10T18:53:42.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.520+0000 7f31076fe640 1 --2- 172.21.15.53:0/2904912995 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f30e40662b0 0x7f30e4068760 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:42.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.520+0000 7f31076fe640 1 --2- 172.21.15.53:0/2904912995 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f310015b3a0 0x7f310015b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:42.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.520+0000 7f31076fe640 1 --2- 172.21.15.53:0/2904912995 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31000c64a0 0x7f3100154750 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:42.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.520+0000 7f31076fe640 1 --2- 172.21.15.53:0/2904912995 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30ec0047d0 0x7f3100155d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:42.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.520+0000 7f31076fe640 1 -- 172.21.15.53:0/2904912995 >> 172.21.15.53:0/2904912995 conn(0x7f31000cafc0 msgr2=0x7f310006a140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:42.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.520+0000 7f31076fe640 1 -- 172.21.15.53:0/2904912995 shutdown_connections 2023-06-10T18:53:42.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.520+0000 7f31076fe640 1 -- 172.21.15.53:0/2904912995 wait complete. 2023-06-10T18:53:42.545 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T18:53:42.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.656+0000 7f03dc983640 1 Processor -- start 2023-06-10T18:53:42.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.656+0000 7f03dc983640 1 -- start start 2023-06-10T18:53:42.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.656+0000 7f03dc983640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f03d8071060 0x7f03d80af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:42.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.656+0000 7f03dc983640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f03d80afc60 0x7f03d806b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:42.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.656+0000 7f03dc983640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03d8159b50 con 0x7f03d80c9840 2023-06-10T18:53:42.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.656+0000 7f03dc983640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03d80702a0 con 0x7f03d80afc60 2023-06-10T18:53:42.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.656+0000 7f03dc983640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03d8070580 con 0x7f03d8071060 2023-06-10T18:53:42.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.656+0000 7f03d6d9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f03d80afc60 0x7f03d806b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:42.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.656+0000 7f03d6d9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f03d80afc60 0x7f03d806b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35038/0 (socket says 172.21.15.53:35038) 2023-06-10T18:53:42.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.656+0000 7f03d6d9d640 1 -- 172.21.15.53:0/2763738296 learned_addr learned my addr 172.21.15.53:0/2763738296 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:42.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.656+0000 7f03d5d9b640 1 --2- 172.21.15.53:0/2763738296 >> v2:172.21.15.117:3300/0 conn(0x7f03d8071060 0x7f03d80af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:42.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.660+0000 7f03d6d9d640 1 -- 172.21.15.53:0/2763738296 >> v2:172.21.15.117:3300/0 conn(0x7f03d8071060 msgr2=0x7f03d80af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:42.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.660+0000 7f03d6d9d640 1 --2- 172.21.15.53:0/2763738296 >> v2:172.21.15.117:3300/0 conn(0x7f03d8071060 0x7f03d80af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:42.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.660+0000 7f03d6d9d640 1 -- 172.21.15.53:0/2763738296 >> v1:172.21.15.117:6789/0 conn(0x7f03d80c9840 legacy=0x7f03d80c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:42.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.660+0000 7f03d6d9d640 1 -- 172.21.15.53:0/2763738296 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03d8070860 con 0x7f03d80afc60 2023-06-10T18:53:42.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.660+0000 7f03d6d9d640 1 --2- 172.21.15.53:0/2763738296 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03d80afc60 0x7f03d806b090 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f03d806e650 tx=0x7f03d001c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e55a3e6f7a5c58 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:42.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.660+0000 7f03d559a640 1 -- 172.21.15.53:0/2763738296 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d00a5840 con 0x7f03d80afc60 2023-06-10T18:53:42.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.660+0000 7f03d559a640 1 -- 172.21.15.53:0/2763738296 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03d00a59a0 con 0x7f03d80afc60 2023-06-10T18:53:42.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.660+0000 7f03d559a640 1 -- 172.21.15.53:0/2763738296 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d00a5d30 con 0x7f03d80afc60 2023-06-10T18:53:42.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.660+0000 7f03dc983640 1 -- 172.21.15.53:0/2763738296 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03d80afc60 msgr2=0x7f03d806b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:42.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.660+0000 7f03dc983640 1 --2- 172.21.15.53:0/2763738296 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03d80afc60 0x7f03d806b090 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f03d806e650 tx=0x7f03d001c960 comp rx=0 tx=0).stop 2023-06-10T18:53:42.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.660+0000 7f03dc983640 1 -- 172.21.15.53:0/2763738296 shutdown_connections 2023-06-10T18:53:42.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.660+0000 7f03dc983640 1 --2- 172.21.15.53:0/2763738296 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03d80afc60 0x7f03d806b090 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:42.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.660+0000 7f03dc983640 1 --2- 172.21.15.53:0/2763738296 >> v2:172.21.15.117:3300/0 conn(0x7f03d8071060 0x7f03d80af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:42.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.660+0000 7f03dc983640 1 -- 172.21.15.53:0/2763738296 >> 172.21.15.53:0/2763738296 conn(0x7f03d806a0d0 msgr2=0x7f03d80ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:42.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.660+0000 7f03dc983640 1 -- 172.21.15.53:0/2763738296 shutdown_connections 2023-06-10T18:53:42.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.660+0000 7f03dc983640 1 -- 172.21.15.53:0/2763738296 wait complete. 2023-06-10T18:53:42.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.664+0000 7f03dc983640 1 Processor -- start 2023-06-10T18:53:42.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.664+0000 7f03dc983640 1 -- start start 2023-06-10T18:53:42.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.664+0000 7f03dc983640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03d8071060 0x7f03d8150630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:42.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.664+0000 7f03dc983640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03d80afc60 0x7f03d80b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:42.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.664+0000 7f03dc983640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03d80c9840 0x7f03d80b3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:42.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.664+0000 7f03dc983640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03d80c78d0 con 0x7f03d80afc60 2023-06-10T18:53:42.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.664+0000 7f03dc983640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03d80b14b0 con 0x7f03d8071060 2023-06-10T18:53:42.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.664+0000 7f03dc983640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03d80b1a60 con 0x7f03d80c9840 2023-06-10T18:53:42.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.664+0000 7f03d5d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03d80afc60 0x7f03d80b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:42.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.664+0000 7f03d5d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03d80afc60 0x7f03d80b1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35046/0 (socket says 172.21.15.53:35046) 2023-06-10T18:53:42.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.664+0000 7f03d5d9b640 1 -- 172.21.15.53:0/926413040 learned_addr learned my addr 172.21.15.53:0/926413040 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:42.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.664+0000 7f03d659c640 1 --2- 172.21.15.53:0/926413040 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03d8071060 0x7f03d8150630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:42.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.664+0000 7f03d6d9d640 1 --2- 172.21.15.53:0/926413040 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03d80c9840 0x7f03d80b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:42.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.664+0000 7f03d5d9b640 1 -- 172.21.15.53:0/926413040 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03d80c9840 msgr2=0x7f03d80b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:42.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.664+0000 7f03d5d9b640 1 --2- 172.21.15.53:0/926413040 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03d80c9840 0x7f03d80b3290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:42.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.664+0000 7f03d5d9b640 1 -- 172.21.15.53:0/926413040 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03d8071060 msgr2=0x7f03d8150630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:42.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.664+0000 7f03d5d9b640 1 --2- 172.21.15.53:0/926413040 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03d8071060 0x7f03d8150630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:42.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.664+0000 7f03d5d9b640 1 -- 172.21.15.53:0/926413040 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03d0009b30 con 0x7f03d80afc60 2023-06-10T18:53:42.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.664+0000 7f03d659c640 1 --2- 172.21.15.53:0/926413040 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03d8071060 0x7f03d8150630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:42.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.664+0000 7f03d5d9b640 1 --2- 172.21.15.53:0/926413040 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03d80afc60 0x7f03d80b1ef0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f03cc00d800 tx=0x7f03cc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:42.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.664+0000 7f03c6ffd640 1 -- 172.21.15.53:0/926413040 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03cc00b660 con 0x7f03d80afc60 2023-06-10T18:53:42.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.664+0000 7f03c6ffd640 1 -- 172.21.15.53:0/926413040 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03cc00b7c0 con 0x7f03d80afc60 2023-06-10T18:53:42.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.664+0000 7f03dc983640 1 -- 172.21.15.53:0/926413040 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03d80c7310 con 0x7f03d80afc60 2023-06-10T18:53:42.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.664+0000 7f03c6ffd640 1 -- 172.21.15.53:0/926413040 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03cc00bb70 con 0x7f03d80afc60 2023-06-10T18:53:42.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.664+0000 7f03dc983640 1 -- 172.21.15.53:0/926413040 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03d80b16f0 con 0x7f03d80afc60 2023-06-10T18:53:42.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.664+0000 7f03dc983640 1 -- 172.21.15.53:0/926413040 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03d80b1bf0 con 0x7f03d80afc60 2023-06-10T18:53:42.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.664+0000 7f03c6ffd640 1 -- 172.21.15.53:0/926413040 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f03cc00bcd0 con 0x7f03d80afc60 2023-06-10T18:53:42.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.664+0000 7f03c6ffd640 1 --2- 172.21.15.53:0/926413040 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f03b8066280 0x7f03b8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:42.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.668+0000 7f03c6ffd640 1 -- 172.21.15.53:0/926413040 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f03cc084260 con 0x7f03d80afc60 2023-06-10T18:53:42.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.668+0000 7f03d659c640 1 --2- 172.21.15.53:0/926413040 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f03b8066280 0x7f03b8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:42.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.668+0000 7f03d659c640 1 --2- 172.21.15.53:0/926413040 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f03b8066280 0x7f03b8068730 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f03c800a850 tx=0x7f03c8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:42.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.672+0000 7f03c6ffd640 1 -- 172.21.15.53:0/926413040 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f03cc055130 con 0x7f03d80afc60 2023-06-10T18:53:42.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.824+0000 7f03dc983640 1 -- 172.21.15.53:0/926413040 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f03d804d790 con 0x7f03d80afc60 2023-06-10T18:53:42.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.828+0000 7f03c6ffd640 1 -- 172.21.15.53:0/926413040 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18363 (secure 0 0 0) 0x7f03cc054cc0 con 0x7f03d80afc60 2023-06-10T18:53:42.837 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:53:42.837 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":25,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T18:53:27.127355+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-10T18:52:43.396243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-10T18:52:43.894228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.23","mappings":[{"from":3,"to":2}]},{"pgid":"4.3e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T18:53:42.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.828+0000 7f03dc983640 1 -- 172.21.15.53:0/926413040 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f03b8066280 msgr2=0x7f03b8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:42.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.828+0000 7f03dc983640 1 --2- 172.21.15.53:0/926413040 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f03b8066280 0x7f03b8068730 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f03c800a850 tx=0x7f03c8008040 comp rx=0 tx=0).stop 2023-06-10T18:53:42.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.828+0000 7f03dc983640 1 -- 172.21.15.53:0/926413040 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03d80afc60 msgr2=0x7f03d80b1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:42.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.828+0000 7f03dc983640 1 --2- 172.21.15.53:0/926413040 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03d80afc60 0x7f03d80b1ef0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f03cc00d800 tx=0x7f03cc00dcc0 comp rx=0 tx=0).stop 2023-06-10T18:53:42.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.828+0000 7f03dc983640 1 -- 172.21.15.53:0/926413040 shutdown_connections 2023-06-10T18:53:42.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.828+0000 7f03dc983640 1 --2- 172.21.15.53:0/926413040 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f03b8066280 0x7f03b8068730 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:42.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.828+0000 7f03dc983640 1 --2- 172.21.15.53:0/926413040 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03d80c9840 0x7f03d80b3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:42.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.828+0000 7f03dc983640 1 --2- 172.21.15.53:0/926413040 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03d80afc60 0x7f03d80b1ef0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:42.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.828+0000 7f03dc983640 1 --2- 172.21.15.53:0/926413040 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03d8071060 0x7f03d8150630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:42.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.828+0000 7f03dc983640 1 -- 172.21.15.53:0/926413040 >> 172.21.15.53:0/926413040 conn(0x7f03d806a0d0 msgr2=0x7f03d80ce490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:42.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.828+0000 7f03dc983640 1 -- 172.21.15.53:0/926413040 shutdown_connections 2023-06-10T18:53:42.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.828+0000 7f03dc983640 1 -- 172.21.15.53:0/926413040 wait complete. 2023-06-10T18:53:42.856 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-06-10T18:53:42.857 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T18:53:42.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.976+0000 7f5dfa889640 1 Processor -- start 2023-06-10T18:53:43.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.976+0000 7f5dfa889640 1 -- start start 2023-06-10T18:53:43.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.976+0000 7f5dfa889640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5df40c9840 0x7f5df40c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:43.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.976+0000 7f5dfa889640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5df406b090 0x7f5df406b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:43.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.976+0000 7f5dfa889640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5df4159b50 con 0x7f5df4071060 2023-06-10T18:53:43.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.976+0000 7f5dfa889640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5df40ca150 con 0x7f5df406b090 2023-06-10T18:53:43.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.976+0000 7f5dfa889640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5df40702a0 con 0x7f5df40c9840 2023-06-10T18:53:43.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.976+0000 7f5df8e26640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5df406b090 0x7f5df406b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:43.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.976+0000 7f5df8e26640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5df406b090 0x7f5df406b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35054/0 (socket says 172.21.15.53:35054) 2023-06-10T18:53:43.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.976+0000 7f5df8e26640 1 -- 172.21.15.53:0/1372232096 learned_addr learned my addr 172.21.15.53:0/1372232096 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:43.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.976+0000 7f5df37fe640 1 --1- 172.21.15.53:0/1372232096 >> v1:172.21.15.53:6789/0 conn(0x7f5df4071060 0x7f5df40af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:47954/0 (socket says 172.21.15.53:47954) 2023-06-10T18:53:43.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.976+0000 7f5df3fff640 1 --2- 172.21.15.53:0/1372232096 >> v2:172.21.15.117:3300/0 conn(0x7f5df40c9840 0x7f5df40c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:43.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.976+0000 7f5df8e26640 1 -- 172.21.15.53:0/1372232096 >> v2:172.21.15.117:3300/0 conn(0x7f5df40c9840 msgr2=0x7f5df40c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:43.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.976+0000 7f5df8e26640 1 --2- 172.21.15.53:0/1372232096 >> v2:172.21.15.117:3300/0 conn(0x7f5df40c9840 0x7f5df40c9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:43.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.976+0000 7f5df8e26640 1 -- 172.21.15.53:0/1372232096 >> v1:172.21.15.53:6789/0 conn(0x7f5df4071060 legacy=0x7f5df40af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:43.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.976+0000 7f5df2ffd640 1 -- 172.21.15.53:0/1372232096 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2910220659 0 0) 0x7f5df4159b50 con 0x7f5df4071060 2023-06-10T18:53:43.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.976+0000 7f5df8e26640 1 -- 172.21.15.53:0/1372232096 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df4070580 con 0x7f5df406b090 2023-06-10T18:53:43.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.980+0000 7f5df8e26640 1 --2- 172.21.15.53:0/1372232096 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5df406b090 0x7f5df406b510 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f5df4071d80 tx=0x7f5de401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b60e44e86d65aca4 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:43.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.980+0000 7f5df2ffd640 1 -- 172.21.15.53:0/1372232096 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de40a5860 con 0x7f5df406b090 2023-06-10T18:53:43.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.980+0000 7f5df2ffd640 1 -- 172.21.15.53:0/1372232096 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5de40a59c0 con 0x7f5df406b090 2023-06-10T18:53:43.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.980+0000 7f5df2ffd640 1 -- 172.21.15.53:0/1372232096 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de40a5d50 con 0x7f5df406b090 2023-06-10T18:53:43.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.980+0000 7f5dfa889640 1 -- 172.21.15.53:0/1372232096 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5df406b090 msgr2=0x7f5df406b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:43.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.980+0000 7f5dfa889640 1 --2- 172.21.15.53:0/1372232096 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5df406b090 0x7f5df406b510 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f5df4071d80 tx=0x7f5de401c9a0 comp rx=0 tx=0).stop 2023-06-10T18:53:43.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.980+0000 7f5dfa889640 1 -- 172.21.15.53:0/1372232096 shutdown_connections 2023-06-10T18:53:43.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.980+0000 7f5dfa889640 1 --2- 172.21.15.53:0/1372232096 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5df406b090 0x7f5df406b510 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:43.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.980+0000 7f5dfa889640 1 --2- 172.21.15.53:0/1372232096 >> v2:172.21.15.117:3300/0 conn(0x7f5df40c9840 0x7f5df40c9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:43.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.980+0000 7f5dfa889640 1 -- 172.21.15.53:0/1372232096 >> 172.21.15.53:0/1372232096 conn(0x7f5df406a0d0 msgr2=0x7f5df40ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:43.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.980+0000 7f5dfa889640 1 -- 172.21.15.53:0/1372232096 shutdown_connections 2023-06-10T18:53:43.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.980+0000 7f5dfa889640 1 -- 172.21.15.53:0/1372232096 wait complete. 2023-06-10T18:53:43.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.984+0000 7f5dfa889640 1 Processor -- start 2023-06-10T18:53:43.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.984+0000 7f5dfa889640 1 -- start start 2023-06-10T18:53:43.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.984+0000 7f5dfa889640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5df406b090 0x7f5df414d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:43.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.984+0000 7f5dfa889640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5df4071060 0x7f5df4153550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:43.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.984+0000 7f5dfa889640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5df40c9840 0x7f5df414ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:43.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.984+0000 7f5dfa889640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df41531b0 con 0x7f5df40c9840 2023-06-10T18:53:43.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.984+0000 7f5dfa889640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df4163f10 con 0x7f5df406b090 2023-06-10T18:53:43.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.984+0000 7f5dfa889640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5df414d1f0 con 0x7f5df4071060 2023-06-10T18:53:43.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.984+0000 7f5df8e26640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5df40c9840 0x7f5df414ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:43.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.984+0000 7f5df8e26640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5df40c9840 0x7f5df414ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35068/0 (socket says 172.21.15.53:35068) 2023-06-10T18:53:43.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.984+0000 7f5df8e26640 1 -- 172.21.15.53:0/3678182565 learned_addr learned my addr 172.21.15.53:0/3678182565 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:43.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.984+0000 7f5df37fe640 1 --2- 172.21.15.53:0/3678182565 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5df4071060 0x7f5df4153550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:43.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.984+0000 7f5df3fff640 1 --2- 172.21.15.53:0/3678182565 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5df406b090 0x7f5df414d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:43.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.984+0000 7f5df8e26640 1 -- 172.21.15.53:0/3678182565 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5df4071060 msgr2=0x7f5df4153550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:43.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.984+0000 7f5df8e26640 1 --2- 172.21.15.53:0/3678182565 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5df4071060 0x7f5df4153550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:43.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.984+0000 7f5df8e26640 1 -- 172.21.15.53:0/3678182565 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5df406b090 msgr2=0x7f5df414d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:43.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.984+0000 7f5df8e26640 1 --2- 172.21.15.53:0/3678182565 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5df406b090 0x7f5df414d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:43.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.984+0000 7f5df8e26640 1 -- 172.21.15.53:0/3678182565 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5de4009b30 con 0x7f5df40c9840 2023-06-10T18:53:43.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.984+0000 7f5df8e26640 1 --2- 172.21.15.53:0/3678182565 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5df40c9840 0x7f5df414ccb0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f5de401ce80 tx=0x7f5de4019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:43.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.984+0000 7f5df0ff9640 1 -- 172.21.15.53:0/3678182565 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de40b8670 con 0x7f5df40c9840 2023-06-10T18:53:43.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.984+0000 7f5df0ff9640 1 -- 172.21.15.53:0/3678182565 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5de40b8810 con 0x7f5df40c9840 2023-06-10T18:53:43.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.984+0000 7f5dfa889640 1 -- 172.21.15.53:0/3678182565 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5df4163340 con 0x7f5df40c9840 2023-06-10T18:53:43.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.984+0000 7f5df0ff9640 1 -- 172.21.15.53:0/3678182565 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de40b8bc0 con 0x7f5df40c9840 2023-06-10T18:53:43.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.984+0000 7f5dfa889640 1 -- 172.21.15.53:0/3678182565 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5df41638c0 con 0x7f5df40c9840 2023-06-10T18:53:43.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.984+0000 7f5dfa889640 1 -- 172.21.15.53:0/3678182565 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5df404d790 con 0x7f5df40c9840 2023-06-10T18:53:43.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.984+0000 7f5df0ff9640 1 -- 172.21.15.53:0/3678182565 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5de40b8d20 con 0x7f5df40c9840 2023-06-10T18:53:43.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.984+0000 7f5df0ff9640 1 --2- 172.21.15.53:0/3678182565 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5dd40662b0 0x7f5dd4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:43.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.988+0000 7f5df0ff9640 1 -- 172.21.15.53:0/3678182565 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f5de411f010 con 0x7f5df40c9840 2023-06-10T18:53:43.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.988+0000 7f5df3fff640 1 --2- 172.21.15.53:0/3678182565 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5dd40662b0 0x7f5dd4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:43.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.988+0000 7f5df3fff640 1 --2- 172.21.15.53:0/3678182565 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5dd40662b0 0x7f5dd4068760 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5df4155060 tx=0x7f5dec008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:43.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:42.992+0000 7f5df0ff9640 1 -- 172.21.15.53:0/3678182565 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5de40ec460 con 0x7f5df40c9840 2023-06-10T18:53:43.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.176+0000 7f5dfa889640 1 -- 172.21.15.53:0/3678182565 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5df40cb140 con 0x7f5df40c9840 2023-06-10T18:53:43.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.176+0000 7f5df0ff9640 1 -- 172.21.15.53:0/3678182565 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4668 (secure 0 0 0) 0x7f5de40c1450 con 0x7f5df40c9840 2023-06-10T18:53:43.186 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:53:43.186 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4236,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/1767214403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":1767214403},{"type":"v1","addr":"172.21.15.53:6834","nonce":1767214403}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/184933647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":184933647},{"type":"v1","addr":"172.21.15.117:6837","nonce":184933647}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/1556542558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":1556542558},{"type":"v1","addr":"172.21.15.53:6835","nonce":1556542558}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T18:52:44.918376+0000","modified":"2023-06-10T18:52:47.927154+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6835/1492134415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1492134415},{"type":"v1","addr":"172.21.15.117:6835","nonce":1492134415}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-10T18:53:43.186 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 7 2023-06-10T18:53:43.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.180+0000 7f5dfa889640 1 -- 172.21.15.53:0/3678182565 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5dd40662b0 msgr2=0x7f5dd4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:43.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.180+0000 7f5dfa889640 1 --2- 172.21.15.53:0/3678182565 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5dd40662b0 0x7f5dd4068760 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5df4155060 tx=0x7f5dec008040 comp rx=0 tx=0).stop 2023-06-10T18:53:43.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.180+0000 7f5dfa889640 1 -- 172.21.15.53:0/3678182565 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5df40c9840 msgr2=0x7f5df414ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:43.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.180+0000 7f5dfa889640 1 --2- 172.21.15.53:0/3678182565 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5df40c9840 0x7f5df414ccb0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f5de401ce80 tx=0x7f5de4019740 comp rx=0 tx=0).stop 2023-06-10T18:53:43.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.180+0000 7f5dfa889640 1 -- 172.21.15.53:0/3678182565 shutdown_connections 2023-06-10T18:53:43.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.180+0000 7f5dfa889640 1 --2- 172.21.15.53:0/3678182565 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5dd40662b0 0x7f5dd4068760 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:43.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.180+0000 7f5dfa889640 1 --2- 172.21.15.53:0/3678182565 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5df40c9840 0x7f5df414ccb0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:43.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.180+0000 7f5dfa889640 1 --2- 172.21.15.53:0/3678182565 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5df4071060 0x7f5df4153550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:43.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.180+0000 7f5dfa889640 1 --2- 172.21.15.53:0/3678182565 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5df406b090 0x7f5df414d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:43.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.180+0000 7f5dfa889640 1 -- 172.21.15.53:0/3678182565 >> 172.21.15.53:0/3678182565 conn(0x7f5df406a0d0 msgr2=0x7f5df40c82d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:43.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.180+0000 7f5dfa889640 1 -- 172.21.15.53:0/3678182565 shutdown_connections 2023-06-10T18:53:43.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.180+0000 7f5dfa889640 1 -- 172.21.15.53:0/3678182565 wait complete. 2023-06-10T18:53:43.203 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T18:53:43.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.304+0000 7f73f5e9c640 1 Processor -- start 2023-06-10T18:53:43.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.304+0000 7f73f5e9c640 1 -- start start 2023-06-10T18:53:43.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.308+0000 7f73f5e9c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f73f00cc690 0x7f73f00d04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:43.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.308+0000 7f73f5e9c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73f00ccae0 0x7f73f00d09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:43.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.308+0000 7f73f5e9c640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73f00d0020 con 0x7f73f00b3ac0 2023-06-10T18:53:43.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.308+0000 7f73f5e9c640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73f00cef40 con 0x7f73f00cc690 2023-06-10T18:53:43.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.308+0000 7f73f5e9c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73f00cf220 con 0x7f73f00ccae0 2023-06-10T18:53:43.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.308+0000 7f73eeffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f73f00cc690 0x7f73f00d04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:43.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.308+0000 7f73eeffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f73f00cc690 0x7f73f00d04b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35084/0 (socket says 172.21.15.53:35084) 2023-06-10T18:53:43.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.308+0000 7f73eeffd640 1 -- 172.21.15.53:0/2956139016 learned_addr learned my addr 172.21.15.53:0/2956139016 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:43.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.308+0000 7f73effff640 1 --2- 172.21.15.53:0/2956139016 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73f00ccae0 0x7f73f00d09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:43.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.308+0000 7f73eeffd640 1 -- 172.21.15.53:0/2956139016 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73f00ccae0 msgr2=0x7f73f00d09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:43.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.308+0000 7f73eeffd640 1 --2- 172.21.15.53:0/2956139016 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73f00ccae0 0x7f73f00d09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:43.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.308+0000 7f73eeffd640 1 -- 172.21.15.53:0/2956139016 >> v1:172.21.15.117:6789/0 conn(0x7f73f00b3ac0 legacy=0x7f73f00b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:43.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.308+0000 7f73eeffd640 1 -- 172.21.15.53:0/2956139016 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73f00cf500 con 0x7f73f00cc690 2023-06-10T18:53:43.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.308+0000 7f73effff640 1 --2- 172.21.15.53:0/2956139016 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73f00ccae0 0x7f73f00d09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:43.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.308+0000 7f73eeffd640 1 --2- 172.21.15.53:0/2956139016 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73f00cc690 0x7f73f00d04b0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f73dc009870 tx=0x7f73dc01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f081e6a9fe9973fa server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:43.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.308+0000 7f73ee7fc640 1 -- 172.21.15.53:0/2956139016 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73dc0ac600 con 0x7f73f00cc690 2023-06-10T18:53:43.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.308+0000 7f73ee7fc640 1 -- 172.21.15.53:0/2956139016 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73dc0a8050 con 0x7f73f00cc690 2023-06-10T18:53:43.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.308+0000 7f73ee7fc640 1 -- 172.21.15.53:0/2956139016 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73dc0ac980 con 0x7f73f00cc690 2023-06-10T18:53:43.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.312+0000 7f73f5e9c640 1 -- 172.21.15.53:0/2956139016 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73f00cc690 msgr2=0x7f73f00d04b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:43.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.312+0000 7f73f5e9c640 1 --2- 172.21.15.53:0/2956139016 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73f00cc690 0x7f73f00d04b0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f73dc009870 tx=0x7f73dc01c4d0 comp rx=0 tx=0).stop 2023-06-10T18:53:43.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.312+0000 7f73f5e9c640 1 -- 172.21.15.53:0/2956139016 shutdown_connections 2023-06-10T18:53:43.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.312+0000 7f73f5e9c640 1 --2- 172.21.15.53:0/2956139016 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73f00ccae0 0x7f73f00d09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:43.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.312+0000 7f73f5e9c640 1 --2- 172.21.15.53:0/2956139016 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73f00cc690 0x7f73f00d04b0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:43.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.312+0000 7f73f5e9c640 1 -- 172.21.15.53:0/2956139016 >> 172.21.15.53:0/2956139016 conn(0x7f73f0071790 msgr2=0x7f73f0069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:43.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.312+0000 7f73f5e9c640 1 -- 172.21.15.53:0/2956139016 shutdown_connections 2023-06-10T18:53:43.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.312+0000 7f73f5e9c640 1 -- 172.21.15.53:0/2956139016 wait complete. 2023-06-10T18:53:43.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.312+0000 7f73f5e9c640 1 Processor -- start 2023-06-10T18:53:43.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.312+0000 7f73f5e9c640 1 -- start start 2023-06-10T18:53:43.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.312+0000 7f73f5e9c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73f00b3ac0 0x7f73f00b28b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:43.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.312+0000 7f73f5e9c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73f00cc690 0x7f73f0154710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:43.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.312+0000 7f73f5e9c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73f00ccae0 0x7f73f015a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:43.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.312+0000 7f73f5e9c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f00b2fb0 con 0x7f73f00cc690 2023-06-10T18:53:43.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.312+0000 7f73f5e9c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f015d350 con 0x7f73f00b3ac0 2023-06-10T18:53:43.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.312+0000 7f73f5e9c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73f0154c50 con 0x7f73f00ccae0 2023-06-10T18:53:43.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.312+0000 7f73eeffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73f00cc690 0x7f73f0154710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:43.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.312+0000 7f73eeffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73f00cc690 0x7f73f0154710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35088/0 (socket says 172.21.15.53:35088) 2023-06-10T18:53:43.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.312+0000 7f73eeffd640 1 -- 172.21.15.53:0/3421254793 learned_addr learned my addr 172.21.15.53:0/3421254793 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:43.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.312+0000 7f73effff640 1 --2- 172.21.15.53:0/3421254793 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73f00ccae0 0x7f73f015a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:43.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.312+0000 7f73ef7fe640 1 --2- 172.21.15.53:0/3421254793 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73f00b3ac0 0x7f73f00b28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:43.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.312+0000 7f73eeffd640 1 -- 172.21.15.53:0/3421254793 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73f00ccae0 msgr2=0x7f73f015a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:43.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.312+0000 7f73eeffd640 1 --2- 172.21.15.53:0/3421254793 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73f00ccae0 0x7f73f015a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:43.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.312+0000 7f73eeffd640 1 -- 172.21.15.53:0/3421254793 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73f00b3ac0 msgr2=0x7f73f00b28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:43.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.312+0000 7f73eeffd640 1 --2- 172.21.15.53:0/3421254793 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73f00b3ac0 0x7f73f00b28b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:43.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.312+0000 7f73eeffd640 1 -- 172.21.15.53:0/3421254793 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73dc0094d0 con 0x7f73f00cc690 2023-06-10T18:53:43.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.312+0000 7f73effff640 1 --2- 172.21.15.53:0/3421254793 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73f00ccae0 0x7f73f015a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:43.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.312+0000 7f73ef7fe640 1 --2- 172.21.15.53:0/3421254793 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73f00b3ac0 0x7f73f00b28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:43.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.312+0000 7f73eeffd640 1 --2- 172.21.15.53:0/3421254793 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73f00cc690 0x7f73f0154710 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f73dc0097c0 tx=0x7f73dc01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:43.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.312+0000 7f73e7fff640 1 -- 172.21.15.53:0/3421254793 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73dc0b7860 con 0x7f73f00cc690 2023-06-10T18:53:43.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.312+0000 7f73e7fff640 1 -- 172.21.15.53:0/3421254793 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73dc0b79c0 con 0x7f73f00cc690 2023-06-10T18:53:43.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.312+0000 7f73e7fff640 1 -- 172.21.15.53:0/3421254793 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73dc0b7d50 con 0x7f73f00cc690 2023-06-10T18:53:43.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.312+0000 7f73f5e9c640 1 -- 172.21.15.53:0/3421254793 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73f015b330 con 0x7f73f00cc690 2023-06-10T18:53:43.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.312+0000 7f73f5e9c640 1 -- 172.21.15.53:0/3421254793 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73f00ca070 con 0x7f73f00cc690 2023-06-10T18:53:43.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.316+0000 7f73f5e9c640 1 -- 172.21.15.53:0/3421254793 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73f015d490 con 0x7f73f00cc690 2023-06-10T18:53:43.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.316+0000 7f73e7fff640 1 -- 172.21.15.53:0/3421254793 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f73dc0b3070 con 0x7f73f00cc690 2023-06-10T18:53:43.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.316+0000 7f73e7fff640 1 --2- 172.21.15.53:0/3421254793 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f73d8066280 0x7f73d8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:43.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.316+0000 7f73e7fff640 1 -- 172.21.15.53:0/3421254793 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f73dc11e3b0 con 0x7f73f00cc690 2023-06-10T18:53:43.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.316+0000 7f73ef7fe640 1 --2- 172.21.15.53:0/3421254793 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f73d8066280 0x7f73d8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:43.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.316+0000 7f73ef7fe640 1 --2- 172.21.15.53:0/3421254793 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f73d8066280 0x7f73d8068730 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f73f015ee70 tx=0x7f73e0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:43.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.320+0000 7f73e7fff640 1 -- 172.21.15.53:0/3421254793 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f73f015d490 con 0x7f73f00cc690 2023-06-10T18:53:43.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.500+0000 7f73f5e9c640 1 -- 172.21.15.53:0/3421254793 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f73f00ca070 con 0x7f73f00cc690 2023-06-10T18:53:43.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.500+0000 7f73e7fff640 1 -- 172.21.15.53:0/3421254793 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4668 (secure 0 0 0) 0x7f73f00ca070 con 0x7f73f00cc690 2023-06-10T18:53:43.509 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:53:43.509 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4236,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6834/1767214403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6833","nonce":1767214403},{"type":"v1","addr":"172.21.15.53:6834","nonce":1767214403}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/184933647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":184933647},{"type":"v1","addr":"172.21.15.117:6837","nonce":184933647}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/1556542558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":1556542558},{"type":"v1","addr":"172.21.15.53:6835","nonce":1556542558}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T18:52:44.918376+0000","modified":"2023-06-10T18:52:47.927154+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6835/1492134415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1492134415},{"type":"v1","addr":"172.21.15.117:6835","nonce":1492134415}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-10T18:53:43.510 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 7 2023-06-10T18:53:43.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.500+0000 7f73f5e9c640 1 -- 172.21.15.53:0/3421254793 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f73d8066280 msgr2=0x7f73d8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:43.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.500+0000 7f73f5e9c640 1 --2- 172.21.15.53:0/3421254793 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f73d8066280 0x7f73d8068730 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f73f015ee70 tx=0x7f73e0009040 comp rx=0 tx=0).stop 2023-06-10T18:53:43.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.504+0000 7f73f5e9c640 1 -- 172.21.15.53:0/3421254793 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73f00cc690 msgr2=0x7f73f0154710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:43.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.504+0000 7f73f5e9c640 1 --2- 172.21.15.53:0/3421254793 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73f00cc690 0x7f73f0154710 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f73dc0097c0 tx=0x7f73dc01ad10 comp rx=0 tx=0).stop 2023-06-10T18:53:43.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.504+0000 7f73f5e9c640 1 -- 172.21.15.53:0/3421254793 shutdown_connections 2023-06-10T18:53:43.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.504+0000 7f73f5e9c640 1 --2- 172.21.15.53:0/3421254793 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f73d8066280 0x7f73d8068730 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:43.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.504+0000 7f73f5e9c640 1 --2- 172.21.15.53:0/3421254793 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73f00ccae0 0x7f73f015a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:43.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.504+0000 7f73f5e9c640 1 --2- 172.21.15.53:0/3421254793 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73f00cc690 0x7f73f0154710 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:43.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.504+0000 7f73f5e9c640 1 --2- 172.21.15.53:0/3421254793 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73f00b3ac0 0x7f73f00b28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:43.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.504+0000 7f73f5e9c640 1 -- 172.21.15.53:0/3421254793 >> 172.21.15.53:0/3421254793 conn(0x7f73f0071790 msgr2=0x7f73f0158460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:43.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.504+0000 7f73f5e9c640 1 -- 172.21.15.53:0/3421254793 shutdown_connections 2023-06-10T18:53:43.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.504+0000 7f73f5e9c640 1 -- 172.21.15.53:0/3421254793 wait complete. 2023-06-10T18:53:43.527 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T18:53:43.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.628+0000 7f20865fd640 1 Processor -- start 2023-06-10T18:53:43.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.628+0000 7f20865fd640 1 -- start start 2023-06-10T18:53:43.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.632+0000 7f20865fd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f20800cc690 0x7f20800d04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:43.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.632+0000 7f20865fd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f20800ccae0 0x7f20800d09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:43.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.632+0000 7f20865fd640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20800d0020 con 0x7f20800b3ac0 2023-06-10T18:53:43.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.632+0000 7f20865fd640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20800cef40 con 0x7f20800ccae0 2023-06-10T18:53:43.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.632+0000 7f20865fd640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20800cf220 con 0x7f20800cc690 2023-06-10T18:53:43.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.632+0000 7f207ffff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f20800b3ac0 0x7f20800b3e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:47964/0 (socket says 172.21.15.53:47964) 2023-06-10T18:53:43.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.632+0000 7f2084b9a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f20800ccae0 0x7f20800d09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:43.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.632+0000 7f207ffff640 1 -- 172.21.15.53:0/4068777918 learned_addr learned my addr 172.21.15.53:0/4068777918 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:53:43.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.632+0000 7f207f7fe640 1 --2- 172.21.15.53:0/4068777918 >> v2:172.21.15.117:3300/0 conn(0x7f20800cc690 0x7f20800d04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:43.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.632+0000 7f2084b9a640 1 -- 172.21.15.53:0/4068777918 >> v2:172.21.15.117:3300/0 conn(0x7f20800cc690 msgr2=0x7f20800d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:43.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.632+0000 7f2084b9a640 1 --2- 172.21.15.53:0/4068777918 >> v2:172.21.15.117:3300/0 conn(0x7f20800cc690 0x7f20800d04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:43.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.632+0000 7f2084b9a640 1 -- 172.21.15.53:0/4068777918 >> v1:172.21.15.53:6789/0 conn(0x7f20800b3ac0 legacy=0x7f20800b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:43.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.632+0000 7f207effd640 1 -- 172.21.15.53:0/4068777918 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3565067826 0 0) 0x7f20800d0020 con 0x7f20800b3ac0 2023-06-10T18:53:43.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.632+0000 7f2084b9a640 1 -- 172.21.15.53:0/4068777918 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20800cf500 con 0x7f20800ccae0 2023-06-10T18:53:43.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.632+0000 7f2084b9a640 1 --2- 172.21.15.53:0/4068777918 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20800ccae0 0x7f20800d09f0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f208008aa80 tx=0x7f207801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f814703e2b6472f server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:43.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.632+0000 7f207effd640 1 -- 172.21.15.53:0/4068777918 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20780a59c0 con 0x7f20800ccae0 2023-06-10T18:53:43.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.632+0000 7f207effd640 1 -- 172.21.15.53:0/4068777918 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20780a5b20 con 0x7f20800ccae0 2023-06-10T18:53:43.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.632+0000 7f207effd640 1 -- 172.21.15.53:0/4068777918 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20780ad440 con 0x7f20800ccae0 2023-06-10T18:53:43.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.636+0000 7f20865fd640 1 -- 172.21.15.53:0/4068777918 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20800ccae0 msgr2=0x7f20800d09f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:43.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.636+0000 7f20865fd640 1 --2- 172.21.15.53:0/4068777918 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20800ccae0 0x7f20800d09f0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f208008aa80 tx=0x7f207801c8e0 comp rx=0 tx=0).stop 2023-06-10T18:53:43.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.636+0000 7f20865fd640 1 -- 172.21.15.53:0/4068777918 shutdown_connections 2023-06-10T18:53:43.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.636+0000 7f20865fd640 1 --2- 172.21.15.53:0/4068777918 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20800ccae0 0x7f20800d09f0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:43.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.636+0000 7f20865fd640 1 --2- 172.21.15.53:0/4068777918 >> v2:172.21.15.117:3300/0 conn(0x7f20800cc690 0x7f20800d04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:43.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.636+0000 7f20865fd640 1 -- 172.21.15.53:0/4068777918 >> 172.21.15.53:0/4068777918 conn(0x7f2080071790 msgr2=0x7f2080069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:43.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.636+0000 7f20865fd640 1 -- 172.21.15.53:0/4068777918 shutdown_connections 2023-06-10T18:53:43.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.636+0000 7f20865fd640 1 -- 172.21.15.53:0/4068777918 wait complete. 2023-06-10T18:53:43.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.636+0000 7f20865fd640 1 Processor -- start 2023-06-10T18:53:43.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.636+0000 7f20865fd640 1 -- start start 2023-06-10T18:53:43.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.636+0000 7f20865fd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20800b3ac0 0x7f208015e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:43.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.636+0000 7f20865fd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20800cc690 0x7f208015be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:43.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.636+0000 7f20865fd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20800ccae0 0x7f208015c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:43.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.636+0000 7f20865fd640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20800cb5b0 con 0x7f20800ccae0 2023-06-10T18:53:43.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.636+0000 7f20865fd640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20800cb850 con 0x7f20800cc690 2023-06-10T18:53:43.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.636+0000 7f20865fd640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20800cbb30 con 0x7f20800b3ac0 2023-06-10T18:53:43.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.636+0000 7f2084b9a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20800ccae0 0x7f208015c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:43.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.636+0000 7f2084b9a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20800ccae0 0x7f208015c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35104/0 (socket says 172.21.15.53:35104) 2023-06-10T18:53:43.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.636+0000 7f2084b9a640 1 -- 172.21.15.53:0/3539064210 learned_addr learned my addr 172.21.15.53:0/3539064210 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:43.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.636+0000 7f207ffff640 1 --2- 172.21.15.53:0/3539064210 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20800b3ac0 0x7f208015e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:43.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.636+0000 7f207f7fe640 1 --2- 172.21.15.53:0/3539064210 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20800cc690 0x7f208015be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:43.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.636+0000 7f2084b9a640 1 -- 172.21.15.53:0/3539064210 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20800b3ac0 msgr2=0x7f208015e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:43.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.636+0000 7f2084b9a640 1 --2- 172.21.15.53:0/3539064210 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20800b3ac0 0x7f208015e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:43.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.636+0000 7f2084b9a640 1 -- 172.21.15.53:0/3539064210 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20800cc690 msgr2=0x7f208015be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:43.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.636+0000 7f2084b9a640 1 --2- 172.21.15.53:0/3539064210 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20800cc690 0x7f208015be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:43.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.636+0000 7f2084b9a640 1 -- 172.21.15.53:0/3539064210 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2078009a70 con 0x7f20800ccae0 2023-06-10T18:53:43.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.636+0000 7f207f7fe640 1 --2- 172.21.15.53:0/3539064210 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20800cc690 0x7f208015be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:43.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.636+0000 7f2084b9a640 1 --2- 172.21.15.53:0/3539064210 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20800ccae0 0x7f208015c340 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f20780194f0 tx=0x7f2078019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:43.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.636+0000 7f207cff9640 1 -- 172.21.15.53:0/3539064210 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20780ade00 con 0x7f20800ccae0 2023-06-10T18:53:43.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.636+0000 7f207cff9640 1 -- 172.21.15.53:0/3539064210 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2078009450 con 0x7f20800ccae0 2023-06-10T18:53:43.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.636+0000 7f20865fd640 1 -- 172.21.15.53:0/3539064210 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20800cbe10 con 0x7f20800ccae0 2023-06-10T18:53:43.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.636+0000 7f207cff9640 1 -- 172.21.15.53:0/3539064210 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20780b7650 con 0x7f20800ccae0 2023-06-10T18:53:43.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.636+0000 7f20865fd640 1 -- 172.21.15.53:0/3539064210 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20800c9460 con 0x7f20800ccae0 2023-06-10T18:53:43.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.640+0000 7f20865fd640 1 -- 172.21.15.53:0/3539064210 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f208004d790 con 0x7f20800ccae0 2023-06-10T18:53:43.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.640+0000 7f207cff9640 1 -- 172.21.15.53:0/3539064210 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f20780b4050 con 0x7f20800ccae0 2023-06-10T18:53:43.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.640+0000 7f207cff9640 1 --2- 172.21.15.53:0/3539064210 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f206c066280 0x7f206c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:43.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.640+0000 7f207cff9640 1 -- 172.21.15.53:0/3539064210 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f207811ef20 con 0x7f20800ccae0 2023-06-10T18:53:43.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.640+0000 7f207ffff640 1 --2- 172.21.15.53:0/3539064210 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f206c066280 0x7f206c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:43.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.640+0000 7f207ffff640 1 --2- 172.21.15.53:0/3539064210 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f206c066280 0x7f206c068730 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2074000f70 tx=0x7f2074007b60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:43.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.644+0000 7f207cff9640 1 -- 172.21.15.53:0/3539064210 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f20780ec2e0 con 0x7f20800ccae0 2023-06-10T18:53:43.799 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.788+0000 7f20865fd640 1 -- 172.21.15.53:0/3539064210 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f20800cc400 con 0x7f20800ccae0 2023-06-10T18:53:43.801 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.792+0000 7f207cff9640 1 -- 172.21.15.53:0/3539064210 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18363 (secure 0 0 0) 0x7f20780ef900 con 0x7f20800ccae0 2023-06-10T18:53:43.801 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:53:43.802 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":25,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T18:53:27.127355+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-10T18:52:43.396243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-10T18:52:43.894228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.23","mappings":[{"from":3,"to":2}]},{"pgid":"4.3e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T18:53:43.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.792+0000 7f20865fd640 1 -- 172.21.15.53:0/3539064210 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f206c066280 msgr2=0x7f206c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:43.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.792+0000 7f20865fd640 1 --2- 172.21.15.53:0/3539064210 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f206c066280 0x7f206c068730 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2074000f70 tx=0x7f2074007b60 comp rx=0 tx=0).stop 2023-06-10T18:53:43.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.792+0000 7f20865fd640 1 -- 172.21.15.53:0/3539064210 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20800ccae0 msgr2=0x7f208015c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:43.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.792+0000 7f20865fd640 1 --2- 172.21.15.53:0/3539064210 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20800ccae0 0x7f208015c340 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f20780194f0 tx=0x7f2078019680 comp rx=0 tx=0).stop 2023-06-10T18:53:43.804 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.792+0000 7f20865fd640 1 -- 172.21.15.53:0/3539064210 shutdown_connections 2023-06-10T18:53:43.804 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.792+0000 7f20865fd640 1 --2- 172.21.15.53:0/3539064210 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f206c066280 0x7f206c068730 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:43.804 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.792+0000 7f20865fd640 1 --2- 172.21.15.53:0/3539064210 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20800ccae0 0x7f208015c340 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:43.804 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.792+0000 7f20865fd640 1 --2- 172.21.15.53:0/3539064210 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20800cc690 0x7f208015be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:43.804 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.792+0000 7f20865fd640 1 --2- 172.21.15.53:0/3539064210 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20800b3ac0 0x7f208015e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:43.804 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.796+0000 7f20865fd640 1 -- 172.21.15.53:0/3539064210 >> 172.21.15.53:0/3539064210 conn(0x7f2080071790 msgr2=0x7f208015fba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:43.804 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.796+0000 7f20865fd640 1 -- 172.21.15.53:0/3539064210 shutdown_connections 2023-06-10T18:53:43.805 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.796+0000 7f20865fd640 1 -- 172.21.15.53:0/3539064210 wait complete. 2023-06-10T18:53:43.818 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-06-10T18:53:43.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.920+0000 7f40989c7640 1 Processor -- start 2023-06-10T18:53:43.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.920+0000 7f40989c7640 1 -- start start 2023-06-10T18:53:43.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.920+0000 7f40989c7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4094157df0 0x7f4094069e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:43.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.920+0000 7f40989c7640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f40940b06d0 0x7f4094070240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:43.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.920+0000 7f40989c7640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40940c92d0 con 0x7f40940ca880 2023-06-10T18:53:43.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.920+0000 7f40989c7640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f409406a3a0 con 0x7f40940b06d0 2023-06-10T18:53:43.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.920+0000 7f40989c7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40940c8d10 con 0x7f4094157df0 2023-06-10T18:53:43.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.924+0000 7f4092d9d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f40940b06d0 0x7f4094070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:43.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.924+0000 7f4092d9d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f40940b06d0 0x7f4094070240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.53:55066/0 (socket says 172.21.15.53:55066) 2023-06-10T18:53:43.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.924+0000 7f4092d9d640 1 -- 172.21.15.53:0/1174416168 learned_addr learned my addr 172.21.15.53:0/1174416168 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:43.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.924+0000 7f409259c640 1 --2- 172.21.15.53:0/1174416168 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4094157df0 0x7f4094069e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:43.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.924+0000 7f4092d9d640 1 -- 172.21.15.53:0/1174416168 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4094157df0 msgr2=0x7f4094069e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:43.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.924+0000 7f4092d9d640 1 --2- 172.21.15.53:0/1174416168 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4094157df0 0x7f4094069e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:43.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.924+0000 7f4092d9d640 1 -- 172.21.15.53:0/1174416168 >> v1:172.21.15.117:6789/0 conn(0x7f40940ca880 legacy=0x7f40940affc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:43.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.924+0000 7f4092d9d640 1 -- 172.21.15.53:0/1174416168 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40940c8ff0 con 0x7f40940b06d0 2023-06-10T18:53:43.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.924+0000 7f4092d9d640 1 --2- 172.21.15.53:0/1174416168 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40940b06d0 0x7f4094070240 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f408c009e50 tx=0x7f408c01c980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7c62c830812b090 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:43.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.924+0000 7f4091d9b640 1 -- 172.21.15.53:0/1174416168 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408c0a5840 con 0x7f40940b06d0 2023-06-10T18:53:43.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.924+0000 7f4091d9b640 1 -- 172.21.15.53:0/1174416168 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f408c0a59a0 con 0x7f40940b06d0 2023-06-10T18:53:43.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.924+0000 7f4091d9b640 1 -- 172.21.15.53:0/1174416168 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408c0a5d30 con 0x7f40940b06d0 2023-06-10T18:53:43.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.924+0000 7f40989c7640 1 -- 172.21.15.53:0/1174416168 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40940b06d0 msgr2=0x7f4094070240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:43.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.924+0000 7f40989c7640 1 --2- 172.21.15.53:0/1174416168 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40940b06d0 0x7f4094070240 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f408c009e50 tx=0x7f408c01c980 comp rx=0 tx=0).stop 2023-06-10T18:53:43.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.924+0000 7f40989c7640 1 -- 172.21.15.53:0/1174416168 shutdown_connections 2023-06-10T18:53:43.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.924+0000 7f40989c7640 1 --2- 172.21.15.53:0/1174416168 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40940b06d0 0x7f4094070240 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:43.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.924+0000 7f40989c7640 1 --2- 172.21.15.53:0/1174416168 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4094157df0 0x7f4094069e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:43.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.924+0000 7f40989c7640 1 -- 172.21.15.53:0/1174416168 >> 172.21.15.53:0/1174416168 conn(0x7f40940cafc0 msgr2=0x7f40940cb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:43.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.924+0000 7f40989c7640 1 -- 172.21.15.53:0/1174416168 shutdown_connections 2023-06-10T18:53:43.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.924+0000 7f40989c7640 1 -- 172.21.15.53:0/1174416168 wait complete. 2023-06-10T18:53:43.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.928+0000 7f40989c7640 1 Processor -- start 2023-06-10T18:53:43.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.928+0000 7f40989c7640 1 -- start start 2023-06-10T18:53:43.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.928+0000 7f40989c7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40940b06d0 0x7f40940cca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:43.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.928+0000 7f40989c7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40940ca880 0x7f40940b1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:43.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.928+0000 7f40989c7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4094157df0 0x7f40940b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:43.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.928+0000 7f40989c7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40940cd9a0 con 0x7f40940ca880 2023-06-10T18:53:43.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.928+0000 7f40989c7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40940cd100 con 0x7f4094157df0 2023-06-10T18:53:43.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.928+0000 7f40989c7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40940cd3e0 con 0x7f40940b06d0 2023-06-10T18:53:43.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.928+0000 7f408bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40940ca880 0x7f40940b1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:43.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.928+0000 7f408bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40940ca880 0x7f40940b1f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35120/0 (socket says 172.21.15.53:35120) 2023-06-10T18:53:43.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.928+0000 7f408bfff640 1 -- 172.21.15.53:0/3128117140 learned_addr learned my addr 172.21.15.53:0/3128117140 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:43.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.928+0000 7f4092d9d640 1 --2- 172.21.15.53:0/3128117140 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4094157df0 0x7f40940b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:43.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.928+0000 7f409259c640 1 --2- 172.21.15.53:0/3128117140 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40940b06d0 0x7f40940cca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:43.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.928+0000 7f408bfff640 1 -- 172.21.15.53:0/3128117140 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40940b06d0 msgr2=0x7f40940cca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:43.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.928+0000 7f408bfff640 1 --2- 172.21.15.53:0/3128117140 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40940b06d0 0x7f40940cca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:43.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.928+0000 7f408bfff640 1 -- 172.21.15.53:0/3128117140 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4094157df0 msgr2=0x7f40940b3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:43.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.928+0000 7f408bfff640 1 --2- 172.21.15.53:0/3128117140 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4094157df0 0x7f40940b3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:43.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.928+0000 7f408bfff640 1 -- 172.21.15.53:0/3128117140 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f408c009b30 con 0x7f40940ca880 2023-06-10T18:53:43.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.928+0000 7f408bfff640 1 --2- 172.21.15.53:0/3128117140 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40940ca880 0x7f40940b1f90 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f407c00c500 tx=0x7f407c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:43.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.928+0000 7f408affd640 1 -- 172.21.15.53:0/3128117140 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f407c005220 con 0x7f40940ca880 2023-06-10T18:53:43.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.928+0000 7f408affd640 1 -- 172.21.15.53:0/3128117140 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f407c005380 con 0x7f40940ca880 2023-06-10T18:53:43.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.928+0000 7f40989c7640 1 -- 172.21.15.53:0/3128117140 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40940cd6c0 con 0x7f40940ca880 2023-06-10T18:53:43.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.928+0000 7f408affd640 1 -- 172.21.15.53:0/3128117140 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f407c007270 con 0x7f40940ca880 2023-06-10T18:53:43.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.928+0000 7f40989c7640 1 -- 172.21.15.53:0/3128117140 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40940b24d0 con 0x7f40940ca880 2023-06-10T18:53:43.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.928+0000 7f40989c7640 1 -- 172.21.15.53:0/3128117140 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40940c65d0 con 0x7f40940ca880 2023-06-10T18:53:43.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.932+0000 7f408affd640 1 -- 172.21.15.53:0/3128117140 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f407c0073d0 con 0x7f40940ca880 2023-06-10T18:53:43.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.932+0000 7f408affd640 1 --2- 172.21.15.53:0/3128117140 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4074066280 0x7f4074068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:43.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.932+0000 7f408affd640 1 -- 172.21.15.53:0/3128117140 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f407c0834d0 con 0x7f40940ca880 2023-06-10T18:53:43.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.932+0000 7f409259c640 1 --2- 172.21.15.53:0/3128117140 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4074066280 0x7f4074068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:43.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.932+0000 7f409259c640 1 --2- 172.21.15.53:0/3128117140 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4074066280 0x7f4074068730 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4084009990 tx=0x7f4084008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:43.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:43.936+0000 7f408affd640 1 -- 172.21.15.53:0/3128117140 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f40940c65d0 con 0x7f40940ca880 2023-06-10T18:53:44.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:44.120+0000 7f40989c7640 1 -- 172.21.15.53:0/3128117140 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f40940c92d0 con 0x7f40940ca880 2023-06-10T18:53:44.249 INFO:tasks.ceph.mon.a.smithi053.stderr:2023-06-10T18:53:44.240+0000 7f74752c1640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-06-10T18:53:44.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:44.256+0000 7f408affd640 1 -- 172.21.15.53:0/3128117140 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) v1 ==== 161+0+0 (secure 0 0 0) 0x7f40940c92d0 con 0x7f40940ca880 2023-06-10T18:53:44.264 INFO:teuthology.orchestra.run.smithi053.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-06-10T18:53:44.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:44.260+0000 7f40989c7640 1 -- 172.21.15.53:0/3128117140 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4074066280 msgr2=0x7f4074068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:44.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:44.260+0000 7f40989c7640 1 --2- 172.21.15.53:0/3128117140 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4074066280 0x7f4074068730 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4084009990 tx=0x7f4084008040 comp rx=0 tx=0).stop 2023-06-10T18:53:44.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:44.260+0000 7f40989c7640 1 -- 172.21.15.53:0/3128117140 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40940ca880 msgr2=0x7f40940b1f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:44.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:44.260+0000 7f40989c7640 1 --2- 172.21.15.53:0/3128117140 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40940ca880 0x7f40940b1f90 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f407c00c500 tx=0x7f407c00c9c0 comp rx=0 tx=0).stop 2023-06-10T18:53:44.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:44.260+0000 7f40989c7640 1 -- 172.21.15.53:0/3128117140 shutdown_connections 2023-06-10T18:53:44.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:44.260+0000 7f40989c7640 1 --2- 172.21.15.53:0/3128117140 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4074066280 0x7f4074068730 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:44.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:44.260+0000 7f40989c7640 1 --2- 172.21.15.53:0/3128117140 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4094157df0 0x7f40940b3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:44.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:44.260+0000 7f40989c7640 1 --2- 172.21.15.53:0/3128117140 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40940ca880 0x7f40940b1f90 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:44.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:44.260+0000 7f40989c7640 1 --2- 172.21.15.53:0/3128117140 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40940b06d0 0x7f40940cca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:44.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:44.260+0000 7f40989c7640 1 -- 172.21.15.53:0/3128117140 >> 172.21.15.53:0/3128117140 conn(0x7f40940cafc0 msgr2=0x7f40940affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:44.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:44.260+0000 7f40989c7640 1 -- 172.21.15.53:0/3128117140 shutdown_connections 2023-06-10T18:53:44.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:44.260+0000 7f40989c7640 1 -- 172.21.15.53:0/3128117140 wait complete. 2023-06-10T18:53:44.270 INFO:tasks.ceph.mds.d.smithi117.stderr: -3336> 2023-06-10T18:52:46.658+0000 7f9dfaea6640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-06-10T18:53:44.286 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-06-10T18:53:44.332 INFO:tasks.ceph.mds.d.smithi117.stdout:starting mds.d at 2023-06-10T18:53:44.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:44.396+0000 7f55bab44640 1 Processor -- start 2023-06-10T18:53:44.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:44.396+0000 7f55bab44640 1 -- start start 2023-06-10T18:53:44.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:44.396+0000 7f55bab44640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55b40c9fa0 0x7f55b406bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:44.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:44.396+0000 7f55bab44640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f55b40af760 0x7f55b40afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:44.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:44.396+0000 7f55bab44640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55b406b090 con 0x7f55b406c020 2023-06-10T18:53:44.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:44.396+0000 7f55bab44640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55b40b0120 con 0x7f55b40af760 2023-06-10T18:53:44.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:44.396+0000 7f55bab44640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55b40ca370 con 0x7f55b40c9fa0 2023-06-10T18:53:44.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:44.400+0000 7f55b88e0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55b40c9fa0 0x7f55b406bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:44.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:44.400+0000 7f55b90e1640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f55b40af760 0x7f55b40afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:44.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:44.400+0000 7f55b90e1640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f55b40af760 0x7f55b40afbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.53:55084/0 (socket says 172.21.15.53:55084) 2023-06-10T18:53:44.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:44.400+0000 7f55b88e0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55b40c9fa0 0x7f55b406bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.53:39348/0 (socket says 172.21.15.53:39348) 2023-06-10T18:53:44.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:44.400+0000 7f55b90e1640 1 -- 172.21.15.53:0/3243313880 learned_addr learned my addr 172.21.15.53:0/3243313880 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:44.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:44.400+0000 7f55b3fff640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f55b406c020 0x7f55b40c82a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.53:43592/0 (socket says 172.21.15.53:43592) 2023-06-10T18:53:44.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:44.400+0000 7f55b90e1640 1 -- 172.21.15.53:0/3243313880 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55b40c9fa0 msgr2=0x7f55b406bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:44.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:44.400+0000 7f55b90e1640 1 --2- 172.21.15.53:0/3243313880 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55b40c9fa0 0x7f55b406bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:44.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:44.400+0000 7f55b90e1640 1 -- 172.21.15.53:0/3243313880 >> v1:172.21.15.117:6789/0 conn(0x7f55b406c020 legacy=0x7f55b40c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:44.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:44.400+0000 7f55b90e1640 1 -- 172.21.15.53:0/3243313880 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55b4070d50 con 0x7f55b40af760 2023-06-10T18:53:44.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:44.400+0000 7f55b90e1640 1 --2- 172.21.15.53:0/3243313880 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f55b40af760 0x7f55b40afbe0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f55ac009e50 tx=0x7f55ac01c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82aa2639d6c0cab1 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:44.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:44.400+0000 7f55b37fe640 1 -- 172.21.15.53:0/3243313880 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ac0a5720 con 0x7f55b40af760 2023-06-10T18:53:44.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:44.400+0000 7f55b37fe640 1 -- 172.21.15.53:0/3243313880 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55ac0a5880 con 0x7f55b40af760 2023-06-10T18:53:44.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:44.400+0000 7f55b37fe640 1 -- 172.21.15.53:0/3243313880 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ac0a5c10 con 0x7f55b40af760 2023-06-10T18:53:44.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:44.404+0000 7f55bab44640 1 -- 172.21.15.53:0/3243313880 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f55b40af760 msgr2=0x7f55b40afbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:44.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:44.404+0000 7f55bab44640 1 --2- 172.21.15.53:0/3243313880 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f55b40af760 0x7f55b40afbe0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f55ac009e50 tx=0x7f55ac01c950 comp rx=0 tx=0).stop 2023-06-10T18:53:44.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:44.404+0000 7f55bab44640 1 -- 172.21.15.53:0/3243313880 shutdown_connections 2023-06-10T18:53:44.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:44.404+0000 7f55bab44640 1 --2- 172.21.15.53:0/3243313880 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f55b40af760 0x7f55b40afbe0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:44.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:44.404+0000 7f55bab44640 1 --2- 172.21.15.53:0/3243313880 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55b40c9fa0 0x7f55b406bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:44.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:44.404+0000 7f55bab44640 1 -- 172.21.15.53:0/3243313880 >> 172.21.15.53:0/3243313880 conn(0x7f55b406a0e0 msgr2=0x7f55b40cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:44.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:44.404+0000 7f55bab44640 1 -- 172.21.15.53:0/3243313880 shutdown_connections 2023-06-10T18:53:44.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:44.404+0000 7f55bab44640 1 -- 172.21.15.53:0/3243313880 wait complete. 2023-06-10T18:53:44.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:44.404+0000 7f55bab44640 1 Processor -- start 2023-06-10T18:53:44.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:44.404+0000 7f55bab44640 1 -- start start 2023-06-10T18:53:44.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:44.404+0000 7f55bab44640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f55b406c020 0x7f55b40c0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:44.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:44.404+0000 7f55bab44640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55b40af760 0x7f55b41488a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:44.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:44.404+0000 7f55bab44640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55b40c9fa0 0x7f55b40c7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:44.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:44.404+0000 7f55bab44640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55b40c7310 con 0x7f55b40c9fa0 2023-06-10T18:53:44.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:44.404+0000 7f55bab44640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55b40c1090 con 0x7f55b406c020 2023-06-10T18:53:44.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:44.404+0000 7f55bab44640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55b40c6690 con 0x7f55b40af760 2023-06-10T18:53:44.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:44.404+0000 7f55b90e1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55b40c9fa0 0x7f55b40c7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:44.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:44.404+0000 7f55b90e1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55b40c9fa0 0x7f55b40c7730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35136/0 (socket says 172.21.15.53:35136) 2023-06-10T18:53:44.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:44.404+0000 7f55b90e1640 1 -- 172.21.15.53:0/4220588759 learned_addr learned my addr 172.21.15.53:0/4220588759 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:44.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:44.404+0000 7f55b88e0640 1 --2- 172.21.15.53:0/4220588759 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f55b406c020 0x7f55b40c0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:44.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:44.404+0000 7f55b3fff640 1 --2- 172.21.15.53:0/4220588759 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55b40af760 0x7f55b41488a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:44.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:44.404+0000 7f55b90e1640 1 -- 172.21.15.53:0/4220588759 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55b40af760 msgr2=0x7f55b41488a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:44.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:44.404+0000 7f55b90e1640 1 --2- 172.21.15.53:0/4220588759 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55b40af760 0x7f55b41488a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:44.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:44.404+0000 7f55b90e1640 1 -- 172.21.15.53:0/4220588759 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f55b406c020 msgr2=0x7f55b40c0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:44.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:44.404+0000 7f55b90e1640 1 --2- 172.21.15.53:0/4220588759 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f55b406c020 0x7f55b40c0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:44.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:44.404+0000 7f55b90e1640 1 -- 172.21.15.53:0/4220588759 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55ac009b30 con 0x7f55b40c9fa0 2023-06-10T18:53:44.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:44.404+0000 7f55b90e1640 1 --2- 172.21.15.53:0/4220588759 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55b40c9fa0 0x7f55b40c7730 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f55ac01a580 tx=0x7f55ac0196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:44.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:44.404+0000 7f55b17fa640 1 -- 172.21.15.53:0/4220588759 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ac0b8670 con 0x7f55b40c9fa0 2023-06-10T18:53:44.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:44.404+0000 7f55b17fa640 1 -- 172.21.15.53:0/4220588759 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55ac0b87f0 con 0x7f55b40c9fa0 2023-06-10T18:53:44.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:44.404+0000 7f55b17fa640 1 -- 172.21.15.53:0/4220588759 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ac0b8ba0 con 0x7f55b40c9fa0 2023-06-10T18:53:44.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:44.404+0000 7f55bab44640 1 -- 172.21.15.53:0/4220588759 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55b40c6970 con 0x7f55b40c9fa0 2023-06-10T18:53:44.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:44.404+0000 7f55bab44640 1 -- 172.21.15.53:0/4220588759 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55b40c6f30 con 0x7f55b40c9fa0 2023-06-10T18:53:44.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:44.404+0000 7f55bab44640 1 -- 172.21.15.53:0/4220588759 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55b40c7450 con 0x7f55b40c9fa0 2023-06-10T18:53:44.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:44.408+0000 7f55b17fa640 1 -- 172.21.15.53:0/4220588759 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f55ac0b8d00 con 0x7f55b40c9fa0 2023-06-10T18:53:44.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:44.408+0000 7f55b17fa640 1 --2- 172.21.15.53:0/4220588759 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f55980662b0 0x7f5598068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:44.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:44.408+0000 7f55b17fa640 1 -- 172.21.15.53:0/4220588759 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6206+0+0 (secure 0 0 0) 0x7f55ac11f250 con 0x7f55b40c9fa0 2023-06-10T18:53:44.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:44.408+0000 7f55b88e0640 1 --2- 172.21.15.53:0/4220588759 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f55980662b0 0x7f5598068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:44.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:44.408+0000 7f55b88e0640 1 --2- 172.21.15.53:0/4220588759 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f55980662b0 0x7f5598068760 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f55a8009af0 tx=0x7f55a8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:44.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:44.412+0000 7f55b17fa640 1 -- 172.21.15.53:0/4220588759 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f55b40c7450 con 0x7f55b40c9fa0 2023-06-10T18:53:44.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:44.592+0000 7f55bab44640 1 -- 172.21.15.53:0/4220588759 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f55b40c7450 con 0x7f55b40c9fa0 2023-06-10T18:53:45.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:45.264+0000 7f55b17fa640 1 -- 172.21.15.53:0/4220588759 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7f55b40c7450 con 0x7f55b40c9fa0 2023-06-10T18:53:45.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:45.268+0000 7f55bab44640 1 -- 172.21.15.53:0/4220588759 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f55980662b0 msgr2=0x7f5598068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:45.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:45.268+0000 7f55bab44640 1 --2- 172.21.15.53:0/4220588759 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f55980662b0 0x7f5598068760 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f55a8009af0 tx=0x7f55a8008040 comp rx=0 tx=0).stop 2023-06-10T18:53:45.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:45.268+0000 7f55bab44640 1 -- 172.21.15.53:0/4220588759 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55b40c9fa0 msgr2=0x7f55b40c7730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:45.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:45.268+0000 7f55bab44640 1 --2- 172.21.15.53:0/4220588759 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55b40c9fa0 0x7f55b40c7730 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f55ac01a580 tx=0x7f55ac0196f0 comp rx=0 tx=0).stop 2023-06-10T18:53:45.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:45.268+0000 7f55bab44640 1 -- 172.21.15.53:0/4220588759 shutdown_connections 2023-06-10T18:53:45.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:45.268+0000 7f55bab44640 1 --2- 172.21.15.53:0/4220588759 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f55980662b0 0x7f5598068760 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:45.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:45.268+0000 7f55bab44640 1 --2- 172.21.15.53:0/4220588759 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55b40c9fa0 0x7f55b40c7730 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:45.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:45.268+0000 7f55bab44640 1 --2- 172.21.15.53:0/4220588759 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55b40af760 0x7f55b41488a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:45.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:45.268+0000 7f55bab44640 1 --2- 172.21.15.53:0/4220588759 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f55b406c020 0x7f55b40c0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:45.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:45.268+0000 7f55bab44640 1 -- 172.21.15.53:0/4220588759 >> 172.21.15.53:0/4220588759 conn(0x7f55b406a0e0 msgr2=0x7f55b41544c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:45.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:45.268+0000 7f55bab44640 1 -- 172.21.15.53:0/4220588759 shutdown_connections 2023-06-10T18:53:45.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:45.268+0000 7f55bab44640 1 -- 172.21.15.53:0/4220588759 wait complete. 2023-06-10T18:53:45.300 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-06-10T18:53:45.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:45.424+0000 7fcf73921640 1 Processor -- start 2023-06-10T18:53:45.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:45.424+0000 7fcf73921640 1 -- start start 2023-06-10T18:53:45.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:45.424+0000 7fcf73921640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcf6c15b930 0x7fcf6c15f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:45.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:45.424+0000 7fcf73921640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fcf6c0cfc30 0x7fcf6c0d00b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:45.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:45.424+0000 7fcf73921640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf6c15bd00 con 0x7fcf6c0b1490 2023-06-10T18:53:45.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:45.424+0000 7fcf73921640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf6c0cf5e0 con 0x7fcf6c0cfc30 2023-06-10T18:53:45.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:45.424+0000 7fcf73921640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf6c0cf020 con 0x7fcf6c15b930 2023-06-10T18:53:45.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:45.428+0000 7fcf71ebe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fcf6c0cfc30 0x7fcf6c0d00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:45.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:45.428+0000 7fcf70ebc640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fcf6c0b1490 0x7fcf6c15f940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:47974/0 (socket says 172.21.15.53:47974) 2023-06-10T18:53:45.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:45.428+0000 7fcf70ebc640 1 -- 172.21.15.53:0/104406115 learned_addr learned my addr 172.21.15.53:0/104406115 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:53:45.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:45.428+0000 7fcf71ebe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fcf6c0cfc30 0x7fcf6c0d00b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35142/0 (socket says 172.21.15.53:35142) 2023-06-10T18:53:45.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:45.428+0000 7fcf716bd640 1 --2- 172.21.15.53:0/104406115 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcf6c15b930 0x7fcf6c15f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:45.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:45.428+0000 7fcf71ebe640 1 -- 172.21.15.53:0/104406115 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcf6c15b930 msgr2=0x7fcf6c15f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:45.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:45.428+0000 7fcf71ebe640 1 --2- 172.21.15.53:0/104406115 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcf6c15b930 0x7fcf6c15f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:45.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:45.428+0000 7fcf71ebe640 1 -- 172.21.15.53:0/104406115 >> v1:172.21.15.53:6789/0 conn(0x7fcf6c0b1490 legacy=0x7fcf6c15f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:45.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:45.428+0000 7fcf6bfff640 1 -- 172.21.15.53:0/104406115 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 50205442 0 0) 0x7fcf6c15bd00 con 0x7fcf6c0b1490 2023-06-10T18:53:45.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:45.428+0000 7fcf71ebe640 1 -- 172.21.15.53:0/104406115 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf6c0cf300 con 0x7fcf6c0cfc30 2023-06-10T18:53:45.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:45.428+0000 7fcf71ebe640 1 --2- 172.21.15.53:0/104406115 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf6c0cfc30 0x7fcf6c0d00b0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fcf640097c0 tx=0x7fcf6401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b1fd42620c8852 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:45.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:45.428+0000 7fcf6bfff640 1 -- 172.21.15.53:0/104406115 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf640ab600 con 0x7fcf6c0cfc30 2023-06-10T18:53:45.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:45.428+0000 7fcf6bfff640 1 -- 172.21.15.53:0/104406115 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf640a7050 con 0x7fcf6c0cfc30 2023-06-10T18:53:45.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:45.428+0000 7fcf6bfff640 1 -- 172.21.15.53:0/104406115 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf640ab980 con 0x7fcf6c0cfc30 2023-06-10T18:53:45.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:45.428+0000 7fcf73921640 1 -- 172.21.15.53:0/104406115 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf6c0cfc30 msgr2=0x7fcf6c0d00b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:45.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:45.428+0000 7fcf73921640 1 --2- 172.21.15.53:0/104406115 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf6c0cfc30 0x7fcf6c0d00b0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fcf640097c0 tx=0x7fcf6401c460 comp rx=0 tx=0).stop 2023-06-10T18:53:45.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:45.428+0000 7fcf73921640 1 -- 172.21.15.53:0/104406115 shutdown_connections 2023-06-10T18:53:45.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:45.428+0000 7fcf73921640 1 --2- 172.21.15.53:0/104406115 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf6c0cfc30 0x7fcf6c0d00b0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:45.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:45.428+0000 7fcf73921640 1 --2- 172.21.15.53:0/104406115 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcf6c15b930 0x7fcf6c15f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:45.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:45.428+0000 7fcf73921640 1 -- 172.21.15.53:0/104406115 >> 172.21.15.53:0/104406115 conn(0x7fcf6c069d70 msgr2=0x7fcf6c06a170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:45.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:45.428+0000 7fcf73921640 1 -- 172.21.15.53:0/104406115 shutdown_connections 2023-06-10T18:53:45.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:45.428+0000 7fcf73921640 1 -- 172.21.15.53:0/104406115 wait complete. 2023-06-10T18:53:45.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:45.432+0000 7fcf73921640 1 Processor -- start 2023-06-10T18:53:45.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:45.432+0000 7fcf73921640 1 -- start start 2023-06-10T18:53:45.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:45.432+0000 7fcf73921640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcf6c0b1490 0x7fcf6c15a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:45.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:45.432+0000 7fcf73921640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf6c0cfc30 0x7fcf6c0c7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:45.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:45.432+0000 7fcf73921640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf6c15b930 0x7fcf6c1515a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:45.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:45.432+0000 7fcf73921640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf6c0b55e0 con 0x7fcf6c15b930 2023-06-10T18:53:45.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:45.432+0000 7fcf73921640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf6c0b53e0 con 0x7fcf6c0cfc30 2023-06-10T18:53:45.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:45.432+0000 7fcf73921640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf6c0c6020 con 0x7fcf6c0b1490 2023-06-10T18:53:45.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:45.432+0000 7fcf71ebe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf6c15b930 0x7fcf6c1515a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:45.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:45.432+0000 7fcf71ebe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf6c15b930 0x7fcf6c1515a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35152/0 (socket says 172.21.15.53:35152) 2023-06-10T18:53:45.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:45.432+0000 7fcf71ebe640 1 -- 172.21.15.53:0/841712165 learned_addr learned my addr 172.21.15.53:0/841712165 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:45.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:45.432+0000 7fcf70ebc640 1 --2- 172.21.15.53:0/841712165 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf6c0cfc30 0x7fcf6c0c7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:45.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:45.432+0000 7fcf716bd640 1 --2- 172.21.15.53:0/841712165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcf6c0b1490 0x7fcf6c15a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:45.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:45.432+0000 7fcf71ebe640 1 -- 172.21.15.53:0/841712165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcf6c0b1490 msgr2=0x7fcf6c15a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:45.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:45.432+0000 7fcf71ebe640 1 --2- 172.21.15.53:0/841712165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcf6c0b1490 0x7fcf6c15a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:45.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:45.432+0000 7fcf71ebe640 1 -- 172.21.15.53:0/841712165 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf6c0cfc30 msgr2=0x7fcf6c0c7e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:45.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:45.432+0000 7fcf71ebe640 1 --2- 172.21.15.53:0/841712165 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf6c0cfc30 0x7fcf6c0c7e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:45.445 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:45.432+0000 7fcf71ebe640 1 -- 172.21.15.53:0/841712165 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf64009420 con 0x7fcf6c15b930 2023-06-10T18:53:45.445 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:45.432+0000 7fcf70ebc640 1 --2- 172.21.15.53:0/841712165 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf6c0cfc30 0x7fcf6c0c7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:45.445 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:45.432+0000 7fcf71ebe640 1 --2- 172.21.15.53:0/841712165 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf6c15b930 0x7fcf6c1515a0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fcf640097c0 tx=0x7fcf64019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:45.445 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:45.432+0000 7fcf69ffb640 1 -- 172.21.15.53:0/841712165 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf640b4430 con 0x7fcf6c15b930 2023-06-10T18:53:45.445 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:45.432+0000 7fcf69ffb640 1 -- 172.21.15.53:0/841712165 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf640b4590 con 0x7fcf6c15b930 2023-06-10T18:53:45.445 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:45.432+0000 7fcf73921640 1 -- 172.21.15.53:0/841712165 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf6c0c6300 con 0x7fcf6c15b930 2023-06-10T18:53:45.445 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:45.432+0000 7fcf69ffb640 1 -- 172.21.15.53:0/841712165 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf640b4920 con 0x7fcf6c15b930 2023-06-10T18:53:45.445 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:45.432+0000 7fcf73921640 1 -- 172.21.15.53:0/841712165 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf6c0c68c0 con 0x7fcf6c15b930 2023-06-10T18:53:45.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:45.432+0000 7fcf73921640 1 -- 172.21.15.53:0/841712165 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf6c0b5720 con 0x7fcf6c15b930 2023-06-10T18:53:45.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:45.432+0000 7fcf69ffb640 1 -- 172.21.15.53:0/841712165 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcf640b2040 con 0x7fcf6c15b930 2023-06-10T18:53:45.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:45.436+0000 7fcf69ffb640 1 --2- 172.21.15.53:0/841712165 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcf50066280 0x7fcf50068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:45.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:45.436+0000 7fcf69ffb640 1 -- 172.21.15.53:0/841712165 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6206+0+0 (secure 0 0 0) 0x7fcf6411dd40 con 0x7fcf6c15b930 2023-06-10T18:53:45.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:45.436+0000 7fcf716bd640 1 --2- 172.21.15.53:0/841712165 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcf50066280 0x7fcf50068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:45.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:45.436+0000 7fcf716bd640 1 --2- 172.21.15.53:0/841712165 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcf50066280 0x7fcf50068730 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fcf58009790 tx=0x7fcf58008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:45.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:45.440+0000 7fcf69ffb640 1 -- 172.21.15.53:0/841712165 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcf6c0b5720 con 0x7fcf6c15b930 2023-06-10T18:53:45.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:45.588+0000 7fcf73921640 1 -- 172.21.15.53:0/841712165 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fcf6c0b5720 con 0x7fcf6c15b930 2023-06-10T18:53:46.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:46.276+0000 7fcf69ffb640 1 -- 172.21.15.53:0/841712165 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v27) v1 ==== 181+0+0 (secure 0 0 0) 0x7fcf6c0b5720 con 0x7fcf6c15b930 2023-06-10T18:53:46.285 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_metadata' removed 2023-06-10T18:53:46.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:46.280+0000 7fcf73921640 1 -- 172.21.15.53:0/841712165 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcf50066280 msgr2=0x7fcf50068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:46.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:46.280+0000 7fcf73921640 1 --2- 172.21.15.53:0/841712165 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcf50066280 0x7fcf50068730 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fcf58009790 tx=0x7fcf58008040 comp rx=0 tx=0).stop 2023-06-10T18:53:46.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:46.280+0000 7fcf73921640 1 -- 172.21.15.53:0/841712165 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf6c15b930 msgr2=0x7fcf6c1515a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:46.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:46.280+0000 7fcf73921640 1 --2- 172.21.15.53:0/841712165 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf6c15b930 0x7fcf6c1515a0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fcf640097c0 tx=0x7fcf64019200 comp rx=0 tx=0).stop 2023-06-10T18:53:46.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:46.280+0000 7fcf73921640 1 -- 172.21.15.53:0/841712165 shutdown_connections 2023-06-10T18:53:46.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:46.280+0000 7fcf73921640 1 --2- 172.21.15.53:0/841712165 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcf50066280 0x7fcf50068730 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:46.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:46.284+0000 7fcf73921640 1 --2- 172.21.15.53:0/841712165 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf6c15b930 0x7fcf6c1515a0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:46.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:46.284+0000 7fcf73921640 1 --2- 172.21.15.53:0/841712165 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf6c0cfc30 0x7fcf6c0c7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:46.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:46.284+0000 7fcf73921640 1 --2- 172.21.15.53:0/841712165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcf6c0b1490 0x7fcf6c15a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:46.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:46.284+0000 7fcf73921640 1 -- 172.21.15.53:0/841712165 >> 172.21.15.53:0/841712165 conn(0x7fcf6c069d70 msgr2=0x7fcf6c0b4120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:46.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:46.284+0000 7fcf73921640 1 -- 172.21.15.53:0/841712165 shutdown_connections 2023-06-10T18:53:46.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:46.284+0000 7fcf73921640 1 -- 172.21.15.53:0/841712165 wait complete. 2023-06-10T18:53:46.311 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-06-10T18:53:46.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:46.436+0000 7f6df6f97640 1 Processor -- start 2023-06-10T18:53:46.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:46.436+0000 7f6df6f97640 1 -- start start 2023-06-10T18:53:46.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:46.436+0000 7f6df6f97640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6df006c210 0x7f6df006c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:46.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:46.436+0000 7f6df6f97640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6df015d0b0 0x7f6df00c8e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:46.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:46.436+0000 7f6df6f97640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6df0158bc0 0x7f6df00af830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:46.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:46.436+0000 7f6df6f97640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6df006cb20 con 0x7f6df0158bc0 2023-06-10T18:53:46.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:46.436+0000 7f6df6f97640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6df0159120 con 0x7f6df006c210 2023-06-10T18:53:46.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:46.436+0000 7f6df6f97640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6df0159400 con 0x7f6df015d0b0 2023-06-10T18:53:46.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:46.436+0000 7f6df5534640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6df0158bc0 0x7f6df00af830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:46.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:46.436+0000 7f6df5534640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6df0158bc0 0x7f6df00af830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35154/0 (socket says 172.21.15.53:35154) 2023-06-10T18:53:46.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:46.436+0000 7f6df5534640 1 -- 172.21.15.53:0/2098594605 learned_addr learned my addr 172.21.15.53:0/2098594605 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:46.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:46.436+0000 7f6df4d33640 1 --2- 172.21.15.53:0/2098594605 >> v2:172.21.15.117:3300/0 conn(0x7f6df006c210 0x7f6df006c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:46.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:46.436+0000 7f6df5534640 1 -- 172.21.15.53:0/2098594605 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6df015d0b0 msgr2=0x7f6df00c8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:46.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:46.436+0000 7f6df5534640 1 --2- 172.21.15.53:0/2098594605 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6df015d0b0 0x7f6df00c8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:46.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:46.436+0000 7f6df5534640 1 -- 172.21.15.53:0/2098594605 >> v2:172.21.15.117:3300/0 conn(0x7f6df006c210 msgr2=0x7f6df006c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:46.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:46.436+0000 7f6df5534640 1 --2- 172.21.15.53:0/2098594605 >> v2:172.21.15.117:3300/0 conn(0x7f6df006c210 0x7f6df006c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:46.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:46.436+0000 7f6df5534640 1 -- 172.21.15.53:0/2098594605 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6df01596e0 con 0x7f6df0158bc0 2023-06-10T18:53:46.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:46.436+0000 7f6df4d33640 1 --2- 172.21.15.53:0/2098594605 >> v2:172.21.15.117:3300/0 conn(0x7f6df006c210 0x7f6df006c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:46.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:46.440+0000 7f6df5534640 1 --2- 172.21.15.53:0/2098594605 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6df0158bc0 0x7f6df00af830 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f6df00cb910 tx=0x7f6de801c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5e4ed2c998e1250 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:46.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:46.440+0000 7f6def7fe640 1 -- 172.21.15.53:0/2098594605 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de80a5580 con 0x7f6df0158bc0 2023-06-10T18:53:46.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:46.440+0000 7f6def7fe640 1 -- 172.21.15.53:0/2098594605 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6de80a56e0 con 0x7f6df0158bc0 2023-06-10T18:53:46.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:46.440+0000 7f6def7fe640 1 -- 172.21.15.53:0/2098594605 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de80a5a70 con 0x7f6df0158bc0 2023-06-10T18:53:46.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:46.440+0000 7f6df6f97640 1 -- 172.21.15.53:0/2098594605 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6df0158bc0 msgr2=0x7f6df00af830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:46.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:46.440+0000 7f6df6f97640 1 --2- 172.21.15.53:0/2098594605 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6df0158bc0 0x7f6df00af830 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f6df00cb910 tx=0x7f6de801c6e0 comp rx=0 tx=0).stop 2023-06-10T18:53:46.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:46.440+0000 7f6df6f97640 1 -- 172.21.15.53:0/2098594605 shutdown_connections 2023-06-10T18:53:46.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:46.440+0000 7f6df6f97640 1 --2- 172.21.15.53:0/2098594605 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6df0158bc0 0x7f6df00af830 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:46.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:46.440+0000 7f6df6f97640 1 --2- 172.21.15.53:0/2098594605 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6df015d0b0 0x7f6df00c8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:46.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:46.440+0000 7f6df6f97640 1 --2- 172.21.15.53:0/2098594605 >> v2:172.21.15.117:3300/0 conn(0x7f6df006c210 0x7f6df006c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:46.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:46.440+0000 7f6df6f97640 1 -- 172.21.15.53:0/2098594605 >> 172.21.15.53:0/2098594605 conn(0x7f6df00ca830 msgr2=0x7f6df00cac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:46.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:46.440+0000 7f6df6f97640 1 -- 172.21.15.53:0/2098594605 shutdown_connections 2023-06-10T18:53:46.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:46.440+0000 7f6df6f97640 1 -- 172.21.15.53:0/2098594605 wait complete. 2023-06-10T18:53:46.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:46.440+0000 7f6df6f97640 1 Processor -- start 2023-06-10T18:53:46.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:46.440+0000 7f6df6f97640 1 -- start start 2023-06-10T18:53:46.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:46.440+0000 7f6df6f97640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6df006c210 0x7f6df01f3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:46.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:46.440+0000 7f6df6f97640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6df0158bc0 0x7f6df01f78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:46.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:46.440+0000 7f6df6f97640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6df015d0b0 0x7f6df01f7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:46.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:46.440+0000 7f6df6f97640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6df014fa90 con 0x7f6df006c210 2023-06-10T18:53:46.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:46.440+0000 7f6df6f97640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6df01f87f0 con 0x7f6df015d0b0 2023-06-10T18:53:46.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:46.440+0000 7f6df6f97640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6df00c42a0 con 0x7f6df0158bc0 2023-06-10T18:53:46.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:46.444+0000 7f6df4d33640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6df006c210 0x7f6df01f3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:46.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:46.444+0000 7f6df4d33640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6df006c210 0x7f6df01f3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35158/0 (socket says 172.21.15.53:35158) 2023-06-10T18:53:46.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:46.444+0000 7f6df4d33640 1 -- 172.21.15.53:0/2055848511 learned_addr learned my addr 172.21.15.53:0/2055848511 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:46.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:46.444+0000 7f6deffff640 1 --2- 172.21.15.53:0/2055848511 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6df0158bc0 0x7f6df01f78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:46.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:46.444+0000 7f6df5534640 1 --2- 172.21.15.53:0/2055848511 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6df015d0b0 0x7f6df01f7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:46.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:46.444+0000 7f6df4d33640 1 -- 172.21.15.53:0/2055848511 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6df0158bc0 msgr2=0x7f6df01f78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:46.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:46.444+0000 7f6df4d33640 1 --2- 172.21.15.53:0/2055848511 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6df0158bc0 0x7f6df01f78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:46.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:46.444+0000 7f6df4d33640 1 -- 172.21.15.53:0/2055848511 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6df015d0b0 msgr2=0x7f6df01f7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:46.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:46.444+0000 7f6df4d33640 1 --2- 172.21.15.53:0/2055848511 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6df015d0b0 0x7f6df01f7e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:46.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:46.444+0000 7f6df4d33640 1 -- 172.21.15.53:0/2055848511 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6de8009b30 con 0x7f6df006c210 2023-06-10T18:53:46.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:46.444+0000 7f6df5534640 1 --2- 172.21.15.53:0/2055848511 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6df015d0b0 0x7f6df01f7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:53:46.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:46.444+0000 7f6deffff640 1 --2- 172.21.15.53:0/2055848511 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6df0158bc0 0x7f6df01f78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:53:46.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:46.444+0000 7f6df4d33640 1 --2- 172.21.15.53:0/2055848511 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6df006c210 0x7f6df01f3bd0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f6de000c7c0 tx=0x7f6de000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:46.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:46.444+0000 7f6ded7fa640 1 -- 172.21.15.53:0/2055848511 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de0007a30 con 0x7f6df006c210 2023-06-10T18:53:46.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:46.444+0000 7f6ded7fa640 1 -- 172.21.15.53:0/2055848511 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6de0007b90 con 0x7f6df006c210 2023-06-10T18:53:46.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:46.444+0000 7f6df6f97640 1 -- 172.21.15.53:0/2055848511 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6df00c4580 con 0x7f6df006c210 2023-06-10T18:53:46.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:46.444+0000 7f6ded7fa640 1 -- 172.21.15.53:0/2055848511 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de000ce70 con 0x7f6df006c210 2023-06-10T18:53:46.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:46.444+0000 7f6df6f97640 1 -- 172.21.15.53:0/2055848511 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6df01f4110 con 0x7f6df006c210 2023-06-10T18:53:46.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:46.444+0000 7f6df6f97640 1 -- 172.21.15.53:0/2055848511 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6df004d790 con 0x7f6df006c210 2023-06-10T18:53:46.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:46.444+0000 7f6ded7fa640 1 -- 172.21.15.53:0/2055848511 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6de00113f0 con 0x7f6df006c210 2023-06-10T18:53:46.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:46.444+0000 7f6ded7fa640 1 --2- 172.21.15.53:0/2055848511 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6ddc066280 0x7f6ddc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:46.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:46.444+0000 7f6ded7fa640 1 -- 172.21.15.53:0/2055848511 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5768+0+0 (secure 0 0 0) 0x7f6de00840d0 con 0x7f6df006c210 2023-06-10T18:53:46.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:46.444+0000 7f6deffff640 1 --2- 172.21.15.53:0/2055848511 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6ddc066280 0x7f6ddc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:46.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:46.444+0000 7f6deffff640 1 --2- 172.21.15.53:0/2055848511 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6ddc066280 0x7f6ddc068730 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6de4006fd0 tx=0x7f6de4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:46.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:46.448+0000 7f6ded7fa640 1 -- 172.21.15.53:0/2055848511 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6de0051670 con 0x7f6df006c210 2023-06-10T18:53:46.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:46.620+0000 7f6df6f97640 1 -- 172.21.15.53:0/2055848511 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6df00b3d30 con 0x7f6df006c210 2023-06-10T18:53:47.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.280+0000 7f6ded7fa640 1 -- 172.21.15.53:0/2055848511 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v28) v1 ==== 169+0+0 (secure 0 0 0) 0x7f6de0054c90 con 0x7f6df006c210 2023-06-10T18:53:47.290 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_data' removed 2023-06-10T18:53:47.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.284+0000 7f6df6f97640 1 -- 172.21.15.53:0/2055848511 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6ddc066280 msgr2=0x7f6ddc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:47.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.284+0000 7f6df6f97640 1 --2- 172.21.15.53:0/2055848511 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6ddc066280 0x7f6ddc068730 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6de4006fd0 tx=0x7f6de4008040 comp rx=0 tx=0).stop 2023-06-10T18:53:47.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.284+0000 7f6df6f97640 1 -- 172.21.15.53:0/2055848511 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6df006c210 msgr2=0x7f6df01f3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:47.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.284+0000 7f6df6f97640 1 --2- 172.21.15.53:0/2055848511 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6df006c210 0x7f6df01f3bd0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f6de000c7c0 tx=0x7f6de000cc80 comp rx=0 tx=0).stop 2023-06-10T18:53:47.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.284+0000 7f6df6f97640 1 -- 172.21.15.53:0/2055848511 shutdown_connections 2023-06-10T18:53:47.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.284+0000 7f6df6f97640 1 --2- 172.21.15.53:0/2055848511 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6ddc066280 0x7f6ddc068730 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:47.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.284+0000 7f6df6f97640 1 --2- 172.21.15.53:0/2055848511 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6df015d0b0 0x7f6df01f7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:47.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.284+0000 7f6df6f97640 1 --2- 172.21.15.53:0/2055848511 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6df0158bc0 0x7f6df01f78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:47.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.284+0000 7f6df6f97640 1 --2- 172.21.15.53:0/2055848511 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6df006c210 0x7f6df01f3bd0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:47.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.284+0000 7f6df6f97640 1 -- 172.21.15.53:0/2055848511 >> 172.21.15.53:0/2055848511 conn(0x7f6df00ca830 msgr2=0x7f6df00ad6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:47.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.284+0000 7f6df6f97640 1 -- 172.21.15.53:0/2055848511 shutdown_connections 2023-06-10T18:53:47.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.284+0000 7f6df6f97640 1 -- 172.21.15.53:0/2055848511 wait complete. 2023-06-10T18:53:47.320 INFO:tasks.ceph.mds.a:Restarting daemon 2023-06-10T18:53:47.320 INFO:tasks.ceph.mds.a:Stopping old one... 2023-06-10T18:53:47.320 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-06-10T18:53:47.321 INFO:teuthology.orchestra.run:waiting for 300 2023-06-10T18:53:47.321 INFO:tasks.ceph.mds.c:Restarting daemon 2023-06-10T18:53:47.321 INFO:tasks.ceph.mds.c:Stopping old one... 2023-06-10T18:53:47.321 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-06-10T18:53:47.321 INFO:teuthology.orchestra.run:waiting for 300 2023-06-10T18:53:47.322 INFO:tasks.ceph.mds.b:Restarting daemon 2023-06-10T18:53:47.322 INFO:tasks.ceph.mds.b:Stopping old one... 2023-06-10T18:53:47.322 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-06-10T18:53:47.323 INFO:teuthology.orchestra.run:waiting for 300 2023-06-10T18:53:47.323 INFO:tasks.ceph.mds.d:Restarting daemon 2023-06-10T18:53:47.323 INFO:tasks.ceph.mds.d:Stopping old one... 2023-06-10T18:53:47.323 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-06-10T18:53:47.323 INFO:teuthology.orchestra.run:waiting for 300 2023-06-10T18:53:47.333 INFO:tasks.ceph.mds.c:Stopped 2023-06-10T18:53:47.333 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-06-10T18:53:47.334 INFO:tasks.ceph.mds.a:Stopped 2023-06-10T18:53:47.335 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-06-10T18:53:47.336 INFO:tasks.ceph.mds.b:Stopped 2023-06-10T18:53:47.337 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-06-10T18:53:47.338 INFO:tasks.ceph.mds.d:Stopped 2023-06-10T18:53:47.339 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-06-10T18:53:47.376 INFO:tasks.ceph.mds.c:Started 2023-06-10T18:53:47.377 DEBUG:teuthology.parallel:result is None 2023-06-10T18:53:47.378 INFO:tasks.ceph.mds.a:Started 2023-06-10T18:53:47.378 DEBUG:teuthology.parallel:result is None 2023-06-10T18:53:47.381 INFO:tasks.ceph.mds.b:Started 2023-06-10T18:53:47.382 DEBUG:teuthology.parallel:result is None 2023-06-10T18:53:47.383 INFO:tasks.ceph.mds.d:Started 2023-06-10T18:53:47.383 DEBUG:teuthology.parallel:result is None 2023-06-10T18:53:47.384 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-06-10T18:53:47.438 INFO:tasks.ceph.mds.c.smithi053.stdout:starting mds.c at 2023-06-10T18:53:47.443 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2023-06-10T18:53:47.444 INFO:tasks.ceph.mds.a.smithi053.stdout:starting mds.a at 2023-06-10T18:53:47.447 INFO:tasks.ceph.mds.d.smithi117.stdout:starting mds.d at 2023-06-10T18:53:47.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.516+0000 7f137befd640 1 Processor -- start 2023-06-10T18:53:47.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.516+0000 7f137befd640 1 -- start start 2023-06-10T18:53:47.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.516+0000 7f137befd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13740d1b00 0x7f13740d07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:47.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.516+0000 7f137befd640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13740ccde0 con 0x7f13740cc690 2023-06-10T18:53:47.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.516+0000 7f137befd640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13740ced00 con 0x7f13740b3ac0 2023-06-10T18:53:47.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.516+0000 7f137befd640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13740cfc10 con 0x7f13740d1b00 2023-06-10T18:53:47.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.516+0000 7f1379498640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f13740cc690 0x7f13740d00a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:48004/0 (socket says 172.21.15.53:48004) 2023-06-10T18:53:47.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.516+0000 7f1379498640 1 -- 172.21.15.53:0/946824735 learned_addr learned my addr 172.21.15.53:0/946824735 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:53:47.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.516+0000 7f137a49a640 1 --2- 172.21.15.53:0/946824735 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13740d1b00 0x7f13740d07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:47.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.516+0000 7f1378c97640 1 -- 172.21.15.53:0/946824735 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1557399942 0 0) 0x7f13740ccde0 con 0x7f13740cc690 2023-06-10T18:53:47.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.516+0000 7f1378c97640 1 -- 172.21.15.53:0/946824735 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f135c003530 con 0x7f13740cc690 2023-06-10T18:53:47.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.516+0000 7f1378c97640 1 -- 172.21.15.53:0/946824735 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2315978785 0 0) 0x7f135c003530 con 0x7f13740cc690 2023-06-10T18:53:47.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.516+0000 7f1378c97640 1 -- 172.21.15.53:0/946824735 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13740d1b00 msgr2=0x7f13740d07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:47.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.516+0000 7f1378c97640 1 --2- 172.21.15.53:0/946824735 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13740d1b00 0x7f13740d07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:47.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.516+0000 7f1378c97640 1 -- 172.21.15.53:0/946824735 >> v1:172.21.15.117:6789/0 conn(0x7f13740b3ac0 legacy=0x7f13740b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:47.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.516+0000 7f1378c97640 1 -- 172.21.15.53:0/946824735 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13740b7b50 con 0x7f13740cc690 2023-06-10T18:53:47.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.520+0000 7f1378c97640 1 -- 172.21.15.53:0/946824735 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f1368001680 con 0x7f13740cc690 2023-06-10T18:53:47.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.520+0000 7f1378c97640 1 -- 172.21.15.53:0/946824735 >> v1:172.21.15.53:6789/0 conn(0x7f13740cc690 legacy=0x7f13740d00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:47.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.520+0000 7f1378c97640 1 --2- 172.21.15.53:0/946824735 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f135c0039b0 0x7f135c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:47.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.520+0000 7f1378c97640 1 --2- 172.21.15.53:0/946824735 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f135c0047d0 0x7f135c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:47.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.520+0000 7f1378c97640 1 --2- 172.21.15.53:0/946824735 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f135c0052a0 0x7f135c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:47.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.520+0000 7f1378c97640 1 -- 172.21.15.53:0/946824735 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13740cfc10 con 0x7f135c0039b0 2023-06-10T18:53:47.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.520+0000 7f1378c97640 1 -- 172.21.15.53:0/946824735 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f135c00c160 con 0x7f135c0047d0 2023-06-10T18:53:47.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.520+0000 7f1378c97640 1 -- 172.21.15.53:0/946824735 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f135c00c320 con 0x7f135c0052a0 2023-06-10T18:53:47.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.520+0000 7f137a49a640 1 --2- 172.21.15.53:0/946824735 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13740d1b00 0x7f13740d07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:53:47.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.520+0000 7f1379c99640 1 --2- 172.21.15.53:0/946824735 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f135c0039b0 0x7f135c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:47.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.520+0000 7f1379498640 1 --2- 172.21.15.53:0/946824735 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f135c0047d0 0x7f135c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:47.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.520+0000 7f137a49a640 1 --2- 172.21.15.53:0/946824735 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f135c0052a0 0x7f135c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:47.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.520+0000 7f1379c99640 1 -- 172.21.15.53:0/946824735 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f135c0052a0 msgr2=0x7f135c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:47.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.520+0000 7f1379c99640 1 --2- 172.21.15.53:0/946824735 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f135c0052a0 0x7f135c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:47.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.520+0000 7f1379c99640 1 -- 172.21.15.53:0/946824735 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f135c0047d0 msgr2=0x7f135c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:47.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.520+0000 7f1379c99640 1 --2- 172.21.15.53:0/946824735 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f135c0047d0 0x7f135c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:47.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.520+0000 7f1379c99640 1 -- 172.21.15.53:0/946824735 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f135c003530 con 0x7f135c0039b0 2023-06-10T18:53:47.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.520+0000 7f1379c99640 1 --2- 172.21.15.53:0/946824735 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f135c0039b0 0x7f135c003dc0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f136c001780 tx=0x7f136c01c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47d2928283d8717e server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:47.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.520+0000 7f1378c97640 1 -- 172.21.15.53:0/946824735 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f136c0052d0 con 0x7f135c0039b0 2023-06-10T18:53:47.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.520+0000 7f1378c97640 1 -- 172.21.15.53:0/946824735 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f136c0a7050 con 0x7f135c0039b0 2023-06-10T18:53:47.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.520+0000 7f1378c97640 1 -- 172.21.15.53:0/946824735 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f136c003600 con 0x7f135c0039b0 2023-06-10T18:53:47.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.520+0000 7f137befd640 1 -- 172.21.15.53:0/946824735 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f135c0039b0 msgr2=0x7f135c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:47.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.520+0000 7f137befd640 1 --2- 172.21.15.53:0/946824735 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f135c0039b0 0x7f135c003dc0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f136c001780 tx=0x7f136c01c3d0 comp rx=0 tx=0).stop 2023-06-10T18:53:47.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.520+0000 7f137a49a640 1 -- 172.21.15.53:0/946824735 reap_dead start 2023-06-10T18:53:47.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.520+0000 7f137befd640 1 -- 172.21.15.53:0/946824735 shutdown_connections 2023-06-10T18:53:47.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.520+0000 7f137befd640 1 -- 172.21.15.53:0/946824735 >> 172.21.15.53:0/946824735 conn(0x7f1374069de0 msgr2=0x7f137406a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:47.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.520+0000 7f137befd640 1 -- 172.21.15.53:0/946824735 shutdown_connections 2023-06-10T18:53:47.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.520+0000 7f137befd640 1 -- 172.21.15.53:0/946824735 wait complete. 2023-06-10T18:53:47.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.524+0000 7f137befd640 1 Processor -- start 2023-06-10T18:53:47.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.524+0000 7f137befd640 1 -- start start 2023-06-10T18:53:47.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.524+0000 7f137befd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f135c0039b0 0x7f1374151510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:47.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.524+0000 7f137befd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f137415ae10 0x7f137415b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:47.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.524+0000 7f137befd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13740c99e0 0x7f13740c9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:47.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.524+0000 7f137befd640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f137415b7c0 con 0x7f137415ae10 2023-06-10T18:53:47.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.524+0000 7f137befd640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13740c78b0 con 0x7f135c0039b0 2023-06-10T18:53:47.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.524+0000 7f137befd640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13740caf70 con 0x7f13740c99e0 2023-06-10T18:53:47.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.524+0000 7f1379498640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f137415ae10 0x7f137415b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:47.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.524+0000 7f1379498640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f137415ae10 0x7f137415b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35188/0 (socket says 172.21.15.53:35188) 2023-06-10T18:53:47.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.524+0000 7f1379498640 1 -- 172.21.15.53:0/3093861042 learned_addr learned my addr 172.21.15.53:0/3093861042 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:47.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.524+0000 7f1379c99640 1 --2- 172.21.15.53:0/3093861042 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f135c0039b0 0x7f1374151510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:47.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.524+0000 7f137a49a640 1 --2- 172.21.15.53:0/3093861042 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13740c99e0 0x7f13740c9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:47.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.524+0000 7f1379498640 1 -- 172.21.15.53:0/3093861042 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13740c99e0 msgr2=0x7f13740c9e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:47.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.524+0000 7f1379498640 1 --2- 172.21.15.53:0/3093861042 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13740c99e0 0x7f13740c9e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:47.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.524+0000 7f1379498640 1 -- 172.21.15.53:0/3093861042 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f135c0039b0 msgr2=0x7f1374151510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:47.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.524+0000 7f1379498640 1 --2- 172.21.15.53:0/3093861042 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f135c0039b0 0x7f1374151510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:47.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.524+0000 7f1379498640 1 -- 172.21.15.53:0/3093861042 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13740ca6d0 con 0x7f137415ae10 2023-06-10T18:53:47.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.524+0000 7f137a49a640 1 --2- 172.21.15.53:0/3093861042 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13740c99e0 0x7f13740c9e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:53:47.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.524+0000 7f1379498640 1 --2- 172.21.15.53:0/3093861042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f137415ae10 0x7f137415b280 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f136800e7b0 tx=0x7f136800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:47.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.524+0000 7f13727fc640 1 -- 172.21.15.53:0/3093861042 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f136800ee60 con 0x7f137415ae10 2023-06-10T18:53:47.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.524+0000 7f13727fc640 1 -- 172.21.15.53:0/3093861042 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f136800c8d0 con 0x7f137415ae10 2023-06-10T18:53:47.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.524+0000 7f137befd640 1 -- 172.21.15.53:0/3093861042 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13740ca9b0 con 0x7f137415ae10 2023-06-10T18:53:47.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.524+0000 7f13727fc640 1 -- 172.21.15.53:0/3093861042 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f136800cc80 con 0x7f137415ae10 2023-06-10T18:53:47.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.524+0000 7f137befd640 1 -- 172.21.15.53:0/3093861042 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13740ca390 con 0x7f137415ae10 2023-06-10T18:53:47.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.524+0000 7f137befd640 1 -- 172.21.15.53:0/3093861042 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13740c76d0 con 0x7f137415ae10 2023-06-10T18:53:47.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.524+0000 7f13727fc640 1 -- 172.21.15.53:0/3093861042 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1368013420 con 0x7f137415ae10 2023-06-10T18:53:47.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.524+0000 7f13727fc640 1 --2- 172.21.15.53:0/3093861042 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f13600662b0 0x7f1360068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:47.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.524+0000 7f13727fc640 1 -- 172.21.15.53:0/3093861042 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f1368083460 con 0x7f137415ae10 2023-06-10T18:53:47.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.528+0000 7f1379c99640 1 --2- 172.21.15.53:0/3093861042 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f13600662b0 0x7f1360068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:47.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.528+0000 7f1379c99640 1 --2- 172.21.15.53:0/3093861042 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f13600662b0 0x7f1360068760 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f136c001750 tx=0x7f136c0011a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:47.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.528+0000 7f13727fc640 1 -- 172.21.15.53:0/3093861042 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1368050c70 con 0x7f137415ae10 2023-06-10T18:53:47.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:47.696+0000 7f137befd640 1 -- 172.21.15.53:0/3093861042 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f137404d790 con 0x7f137415ae10 2023-06-10T18:53:48.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.496+0000 7f13727fc640 1 -- 172.21.15.53:0/3093861042 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v33) v1 ==== 97+0+0 (secure 0 0 0) 0x7f1368054290 con 0x7f137415ae10 2023-06-10T18:53:48.503 INFO:teuthology.orchestra.run.smithi053.stderr: removed all blocklist entries 2023-06-10T18:53:48.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.496+0000 7f137befd640 1 -- 172.21.15.53:0/3093861042 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f13600662b0 msgr2=0x7f1360068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:48.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.500+0000 7f137befd640 1 --2- 172.21.15.53:0/3093861042 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f13600662b0 0x7f1360068760 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f136c001750 tx=0x7f136c0011a0 comp rx=0 tx=0).stop 2023-06-10T18:53:48.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.500+0000 7f137befd640 1 -- 172.21.15.53:0/3093861042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f137415ae10 msgr2=0x7f137415b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:48.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.500+0000 7f137befd640 1 --2- 172.21.15.53:0/3093861042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f137415ae10 0x7f137415b280 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f136800e7b0 tx=0x7f136800ec70 comp rx=0 tx=0).stop 2023-06-10T18:53:48.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.500+0000 7f137befd640 1 -- 172.21.15.53:0/3093861042 shutdown_connections 2023-06-10T18:53:48.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.500+0000 7f137befd640 1 --2- 172.21.15.53:0/3093861042 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f13600662b0 0x7f1360068760 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:48.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.500+0000 7f137befd640 1 --2- 172.21.15.53:0/3093861042 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13740c99e0 0x7f13740c9e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:48.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.500+0000 7f137befd640 1 --2- 172.21.15.53:0/3093861042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f137415ae10 0x7f137415b280 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:48.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.500+0000 7f137befd640 1 --2- 172.21.15.53:0/3093861042 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f135c0039b0 0x7f1374151510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:48.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.500+0000 7f137befd640 1 -- 172.21.15.53:0/3093861042 >> 172.21.15.53:0/3093861042 conn(0x7f1374069de0 msgr2=0x7f13740b3150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:48.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.500+0000 7f137befd640 1 -- 172.21.15.53:0/3093861042 shutdown_connections 2023-06-10T18:53:48.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.500+0000 7f137befd640 1 -- 172.21.15.53:0/3093861042 wait complete. 2023-06-10T18:53:48.530 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-06-10T18:53:48.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.648+0000 7f7bea1c1640 1 Processor -- start 2023-06-10T18:53:48.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.652+0000 7f7bea1c1640 1 -- start start 2023-06-10T18:53:48.660 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.652+0000 7f7bea1c1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7be4157e10 0x7f7be406efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:48.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.652+0000 7f7bea1c1640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7be40c9e50 con 0x7f7be406bb30 2023-06-10T18:53:48.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.652+0000 7f7bea1c1640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7be406bf80 con 0x7f7be40afe30 2023-06-10T18:53:48.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.652+0000 7f7bea1c1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7be40c82f0 con 0x7f7be4157e10 2023-06-10T18:53:48.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.652+0000 7f7be2ffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f7be406bb30 0x7f7be40af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:48020/0 (socket says 172.21.15.53:48020) 2023-06-10T18:53:48.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.652+0000 7f7be2ffd640 1 -- 172.21.15.53:0/2063044766 learned_addr learned my addr 172.21.15.53:0/2063044766 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:53:48.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.652+0000 7f7be37fe640 1 --2- 172.21.15.53:0/2063044766 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7be4157e10 0x7f7be406efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:48.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.652+0000 7f7be27fc640 1 -- 172.21.15.53:0/2063044766 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3549174109 0 0) 0x7f7be40c9e50 con 0x7f7be406bb30 2023-06-10T18:53:48.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.652+0000 7f7be27fc640 1 -- 172.21.15.53:0/2063044766 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bd0003530 con 0x7f7be406bb30 2023-06-10T18:53:48.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.652+0000 7f7be27fc640 1 -- 172.21.15.53:0/2063044766 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2574798815 0 0) 0x7f7bd0003530 con 0x7f7be406bb30 2023-06-10T18:53:48.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.652+0000 7f7be27fc640 1 -- 172.21.15.53:0/2063044766 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7be4157e10 msgr2=0x7f7be406efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:48.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.652+0000 7f7be27fc640 1 --2- 172.21.15.53:0/2063044766 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7be4157e10 0x7f7be406efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:48.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.652+0000 7f7be27fc640 1 -- 172.21.15.53:0/2063044766 >> v1:172.21.15.117:6789/0 conn(0x7f7be40afe30 legacy=0x7f7be415bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:48.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.652+0000 7f7be27fc640 1 -- 172.21.15.53:0/2063044766 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be40ca080 con 0x7f7be406bb30 2023-06-10T18:53:48.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.652+0000 7f7be27fc640 1 -- 172.21.15.53:0/2063044766 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f7bcc001680 con 0x7f7be406bb30 2023-06-10T18:53:48.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.652+0000 7f7be27fc640 1 -- 172.21.15.53:0/2063044766 >> v1:172.21.15.53:6789/0 conn(0x7f7be406bb30 legacy=0x7f7be40af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:48.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.652+0000 7f7be27fc640 1 --2- 172.21.15.53:0/2063044766 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7bd0003a20 0x7f7bd0003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:48.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.652+0000 7f7be27fc640 1 --2- 172.21.15.53:0/2063044766 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7bd00047d0 0x7f7bd0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:48.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.652+0000 7f7be27fc640 1 --2- 172.21.15.53:0/2063044766 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7be4157e10 0x7f7bd0005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:48.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.652+0000 7f7be27fc640 1 -- 172.21.15.53:0/2063044766 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be40c82f0 con 0x7f7bd0003a20 2023-06-10T18:53:48.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.652+0000 7f7be27fc640 1 -- 172.21.15.53:0/2063044766 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd000bb20 con 0x7f7bd00047d0 2023-06-10T18:53:48.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.652+0000 7f7be27fc640 1 -- 172.21.15.53:0/2063044766 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd000bce0 con 0x7f7be4157e10 2023-06-10T18:53:48.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.652+0000 7f7be37fe640 1 --2- 172.21.15.53:0/2063044766 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7bd0003a20 0x7f7bd0003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:48.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.652+0000 7f7be2ffd640 1 --2- 172.21.15.53:0/2063044766 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7bd00047d0 0x7f7bd0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:48.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.652+0000 7f7be37fe640 1 -- 172.21.15.53:0/2063044766 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7be4157e10 msgr2=0x7f7bd0005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:48.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.652+0000 7f7be37fe640 1 --2- 172.21.15.53:0/2063044766 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7be4157e10 0x7f7bd0005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:48.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.652+0000 7f7be37fe640 1 -- 172.21.15.53:0/2063044766 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7bd00047d0 msgr2=0x7f7bd0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:48.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.652+0000 7f7be37fe640 1 --2- 172.21.15.53:0/2063044766 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7bd00047d0 0x7f7bd0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:48.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.652+0000 7f7be37fe640 1 -- 172.21.15.53:0/2063044766 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bd0003530 con 0x7f7bd0003a20 2023-06-10T18:53:48.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.656+0000 7f7be37fe640 1 --2- 172.21.15.53:0/2063044766 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7bd0003a20 0x7f7bd0003e30 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f7bd4009ae0 tx=0x7f7bd401ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9ce48a5c4d1c45c server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:48.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.656+0000 7f7be27fc640 1 -- 172.21.15.53:0/2063044766 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd40a5540 con 0x7f7bd0003a20 2023-06-10T18:53:48.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.656+0000 7f7be27fc640 1 -- 172.21.15.53:0/2063044766 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bd40a56a0 con 0x7f7bd0003a20 2023-06-10T18:53:48.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.656+0000 7f7be27fc640 1 -- 172.21.15.53:0/2063044766 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd40a5a50 con 0x7f7bd0003a20 2023-06-10T18:53:48.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.656+0000 7f7bea1c1640 1 -- 172.21.15.53:0/2063044766 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7bd0003a20 msgr2=0x7f7bd0003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:48.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.656+0000 7f7bea1c1640 1 --2- 172.21.15.53:0/2063044766 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7bd0003a20 0x7f7bd0003e30 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f7bd4009ae0 tx=0x7f7bd401ca60 comp rx=0 tx=0).stop 2023-06-10T18:53:48.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.656+0000 7f7be3fff640 1 -- 172.21.15.53:0/2063044766 reap_dead start 2023-06-10T18:53:48.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.656+0000 7f7bea1c1640 1 -- 172.21.15.53:0/2063044766 shutdown_connections 2023-06-10T18:53:48.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.656+0000 7f7bea1c1640 1 -- 172.21.15.53:0/2063044766 >> 172.21.15.53:0/2063044766 conn(0x7f7be406a0d0 msgr2=0x7f7be40ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:48.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.656+0000 7f7bea1c1640 1 -- 172.21.15.53:0/2063044766 shutdown_connections 2023-06-10T18:53:48.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.656+0000 7f7bea1c1640 1 -- 172.21.15.53:0/2063044766 wait complete. 2023-06-10T18:53:48.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.656+0000 7f7bea1c1640 1 Processor -- start 2023-06-10T18:53:48.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.656+0000 7f7bea1c1640 1 -- start start 2023-06-10T18:53:48.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.656+0000 7f7bea1c1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7bd0003a20 0x7f7be414ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:48.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.656+0000 7f7bea1c1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7be406f7c0 0x7f7be406fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:48.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.656+0000 7f7bea1c1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7be414d630 0x7f7be414daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:48.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.656+0000 7f7bea1c1640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be414dfe0 con 0x7f7be414d630 2023-06-10T18:53:48.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.656+0000 7f7bea1c1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be40c3450 con 0x7f7bd0003a20 2023-06-10T18:53:48.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.656+0000 7f7bea1c1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7be40c44b0 con 0x7f7be406f7c0 2023-06-10T18:53:48.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.656+0000 7f7be3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7be414d630 0x7f7be414daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:48.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.656+0000 7f7be3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7be414d630 0x7f7be414daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35202/0 (socket says 172.21.15.53:35202) 2023-06-10T18:53:48.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.656+0000 7f7be3fff640 1 -- 172.21.15.53:0/1202920935 learned_addr learned my addr 172.21.15.53:0/1202920935 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:48.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.656+0000 7f7be2ffd640 1 --2- 172.21.15.53:0/1202920935 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7be406f7c0 0x7f7be406fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:48.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.656+0000 7f7be37fe640 1 --2- 172.21.15.53:0/1202920935 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7bd0003a20 0x7f7be414ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:48.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.660+0000 7f7be3fff640 1 -- 172.21.15.53:0/1202920935 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7be406f7c0 msgr2=0x7f7be406fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:48.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.660+0000 7f7be3fff640 1 --2- 172.21.15.53:0/1202920935 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7be406f7c0 0x7f7be406fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:48.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.660+0000 7f7be3fff640 1 -- 172.21.15.53:0/1202920935 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7bd0003a20 msgr2=0x7f7be414ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:48.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.660+0000 7f7be3fff640 1 --2- 172.21.15.53:0/1202920935 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7bd0003a20 0x7f7be414ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:48.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.660+0000 7f7be3fff640 1 -- 172.21.15.53:0/1202920935 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be40c36f0 con 0x7f7be414d630 2023-06-10T18:53:48.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.660+0000 7f7be3fff640 1 --2- 172.21.15.53:0/1202920935 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7be414d630 0x7f7be414daa0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f7be40ad6d0 tx=0x7f7bdc00c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:48.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.660+0000 7f7bdbfff640 1 -- 172.21.15.53:0/1202920935 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bdc00cad0 con 0x7f7be414d630 2023-06-10T18:53:48.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.660+0000 7f7bdbfff640 1 -- 172.21.15.53:0/1202920935 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bdc00cc50 con 0x7f7be414d630 2023-06-10T18:53:48.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.660+0000 7f7bea1c1640 1 -- 172.21.15.53:0/1202920935 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7be40c39d0 con 0x7f7be414d630 2023-06-10T18:53:48.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.660+0000 7f7bdbfff640 1 -- 172.21.15.53:0/1202920935 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bdc003980 con 0x7f7be414d630 2023-06-10T18:53:48.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.660+0000 7f7bea1c1640 1 -- 172.21.15.53:0/1202920935 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7be40c3f90 con 0x7f7be414d630 2023-06-10T18:53:48.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.660+0000 7f7bea1c1640 1 -- 172.21.15.53:0/1202920935 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7be40c8850 con 0x7f7be414d630 2023-06-10T18:53:48.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.660+0000 7f7bdbfff640 1 -- 172.21.15.53:0/1202920935 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7bdc0070d0 con 0x7f7be414d630 2023-06-10T18:53:48.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.660+0000 7f7bdbfff640 1 --2- 172.21.15.53:0/1202920935 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7bc40662b0 0x7f7bc4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:48.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.660+0000 7f7bdbfff640 1 -- 172.21.15.53:0/1202920935 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f7bdc082730 con 0x7f7be414d630 2023-06-10T18:53:48.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.660+0000 7f7be37fe640 1 --2- 172.21.15.53:0/1202920935 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7bc40662b0 0x7f7bc4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:48.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.660+0000 7f7be37fe640 1 --2- 172.21.15.53:0/1202920935 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7bc40662b0 0x7f7bc4068760 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7bd40af000 tx=0x7f7bd40046d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:48.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.664+0000 7f7bdbfff640 1 -- 172.21.15.53:0/1202920935 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7be40c8850 con 0x7f7be414d630 2023-06-10T18:53:48.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.872+0000 7f7bea1c1640 1 -- 172.21.15.53:0/1202920935 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f7be40c8820 con 0x7f7be414d630 2023-06-10T18:53:48.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.872+0000 7f7bdbfff640 1 -- 172.21.15.53:0/1202920935 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f7bdc04fef0 con 0x7f7be414d630 2023-06-10T18:53:48.882 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:53:48.882 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-06-10T18:53:48.883 INFO:teuthology.orchestra.run.smithi053.stdout: "auth_dump": [ 2023-06-10T18:53:48.883 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T18:53:48.883 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.a", 2023-06-10T18:53:48.883 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkWqEQBhAAW+iEw0Gxfw744rsYc/tfTQ==", 2023-06-10T18:53:48.883 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T18:53:48.883 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T18:53:48.883 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2023-06-10T18:53:48.884 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2023-06-10T18:53:48.884 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T18:53:48.884 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:53:48.884 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:53:48.884 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T18:53:48.884 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.b", 2023-06-10T18:53:48.884 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkSu02FRAAFpo6NpcwDLZUt2Rgk/wm8w==", 2023-06-10T18:53:48.884 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T18:53:48.885 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T18:53:48.885 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2023-06-10T18:53:48.885 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2023-06-10T18:53:48.885 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T18:53:48.885 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:53:48.885 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:53:48.885 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T18:53:48.886 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.c", 2023-06-10T18:53:48.886 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRk19/ODhAAodfGGNLP7UbNhHySgaukrg==", 2023-06-10T18:53:48.886 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T18:53:48.886 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T18:53:48.886 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2023-06-10T18:53:48.886 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2023-06-10T18:53:48.886 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T18:53:48.886 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:53:48.887 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:53:48.887 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T18:53:48.887 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.d", 2023-06-10T18:53:48.887 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkogwkGxAAIavVKa8GtML1XQDEMwwokQ==", 2023-06-10T18:53:48.888 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T18:53:48.888 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T18:53:48.889 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2023-06-10T18:53:48.889 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2023-06-10T18:53:48.889 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T18:53:48.889 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:53:48.889 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:53:48.889 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T18:53:48.889 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.0", 2023-06-10T18:53:48.890 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA7xoRkoj1OMhAAYFc4W5kAlMBqY2yzeJZXQw==", 2023-06-10T18:53:48.890 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T18:53:48.890 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T18:53:48.890 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T18:53:48.890 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T18:53:48.890 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:53:48.890 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:53:48.891 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T18:53:48.891 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.1", 2023-06-10T18:53:48.891 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA+xoRk6FpDOBAALjxW3eaIh3Gu9b1rmMmqfw==", 2023-06-10T18:53:48.891 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T18:53:48.891 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T18:53:48.891 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T18:53:48.891 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T18:53:48.891 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:53:48.892 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:53:48.892 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T18:53:48.892 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.2", 2023-06-10T18:53:48.892 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBCxoRkaO2GBRAA0Xr5en+n5DxhZDg8kVswpQ==", 2023-06-10T18:53:48.892 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T18:53:48.892 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T18:53:48.892 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T18:53:48.893 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T18:53:48.893 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:53:48.893 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:53:48.893 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T18:53:48.893 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.3", 2023-06-10T18:53:48.893 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBFxoRkjfsBDhAAArYYrPnmXu5VcUMGVjQXZg==", 2023-06-10T18:53:48.894 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T18:53:48.894 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T18:53:48.894 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T18:53:48.894 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T18:53:48.894 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:53:48.894 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:53:48.894 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T18:53:48.895 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.4", 2023-06-10T18:53:48.895 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBLxoRkybumChAAdym/nl9bzyI71flvuy9Vtw==", 2023-06-10T18:53:48.895 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T18:53:48.895 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T18:53:48.895 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T18:53:48.895 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T18:53:48.895 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:53:48.895 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:53:48.896 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T18:53:48.896 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.5", 2023-06-10T18:53:48.896 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBOxoRkinSGIRAAwLbgYKI4NsbHKqGo9O4WuQ==", 2023-06-10T18:53:48.896 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T18:53:48.896 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T18:53:48.896 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T18:53:48.896 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T18:53:48.896 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:53:48.897 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:53:48.897 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T18:53:48.897 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.6", 2023-06-10T18:53:48.897 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBRxoRkj7VlKRAAs2ReBZ5iqtr17Nli9kUtGQ==", 2023-06-10T18:53:48.897 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T18:53:48.897 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T18:53:48.897 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T18:53:48.897 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T18:53:48.898 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:53:48.898 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:53:48.898 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T18:53:48.898 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.7", 2023-06-10T18:53:48.898 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBUxoRk48CnMhAASfbeuCo9jDuHQrYDQ8Vt3A==", 2023-06-10T18:53:48.898 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T18:53:48.899 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T18:53:48.899 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T18:53:48.899 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T18:53:48.899 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:53:48.899 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:53:48.899 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T18:53:48.899 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.0", 2023-06-10T18:53:48.900 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkgey1IBAAkNYrXMgUOnavBY/5uGyFrw==", 2023-06-10T18:53:48.900 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T18:53:48.900 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T18:53:48.900 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow r", 2023-06-10T18:53:48.900 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow rw", 2023-06-10T18:53:48.900 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rwx" 2023-06-10T18:53:48.900 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:53:48.901 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:53:48.901 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T18:53:48.901 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.1", 2023-06-10T18:53:48.901 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkBw+UKBAAuvT+vXmJLG5CvQVg5xItDQ==", 2023-06-10T18:53:48.901 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T18:53:48.901 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T18:53:48.902 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow r", 2023-06-10T18:53:48.902 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow rw", 2023-06-10T18:53:48.902 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rwx" 2023-06-10T18:53:48.902 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:53:48.902 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:53:48.902 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T18:53:48.902 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.2", 2023-06-10T18:53:48.903 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkewjeJRAA4pmIEVJ3Z7GKQFmA54CZ5Q==", 2023-06-10T18:53:48.903 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T18:53:48.903 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T18:53:48.903 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow r", 2023-06-10T18:53:48.903 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow rw", 2023-06-10T18:53:48.903 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rwx" 2023-06-10T18:53:48.903 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:53:48.904 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:53:48.904 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T18:53:48.904 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.3", 2023-06-10T18:53:48.904 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkHwCiLRAAWGt8UoWxGlG1Y1zSPbKUCg==", 2023-06-10T18:53:48.904 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T18:53:48.904 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T18:53:48.905 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow r", 2023-06-10T18:53:48.905 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow rw", 2023-06-10T18:53:48.905 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rwx" 2023-06-10T18:53:48.905 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:53:48.905 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:53:48.905 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T18:53:48.906 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.admin", 2023-06-10T18:53:48.906 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA5xoRkIVgrKBAABIxiaOPe9h5ne2y2l50aMg==", 2023-06-10T18:53:48.906 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T18:53:48.906 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow *", 2023-06-10T18:53:48.906 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2023-06-10T18:53:48.906 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2023-06-10T18:53:48.906 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T18:53:48.907 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:53:48.907 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:53:48.907 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T18:53:48.907 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.bootstrap-mds", 2023-06-10T18:53:48.907 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBlxoRkPfD8AhAAl5tvyMdFFMPOhu+llTVzHg==", 2023-06-10T18:53:48.908 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T18:53:48.908 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile bootstrap-mds" 2023-06-10T18:53:48.908 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:53:48.908 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:53:48.908 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T18:53:48.908 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.bootstrap-mgr", 2023-06-10T18:53:48.909 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBlxoRk7wr9AhAA/af2DoJIoXjJxvRDb4Oxhw==", 2023-06-10T18:53:48.909 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T18:53:48.909 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile bootstrap-mgr" 2023-06-10T18:53:48.909 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:53:48.909 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:53:48.910 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T18:53:48.910 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.bootstrap-osd", 2023-06-10T18:53:48.910 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBlxoRkxCT9AhAARqsAzle37DTF0LrTcwifnA==", 2023-06-10T18:53:48.910 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T18:53:48.910 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile bootstrap-osd" 2023-06-10T18:53:48.910 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:53:48.910 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:53:48.910 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T18:53:48.911 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.bootstrap-rbd", 2023-06-10T18:53:48.911 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBlxoRkvzr9AhAApNGBo5FSxuLfKdvEWNPGqg==", 2023-06-10T18:53:48.911 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T18:53:48.911 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile bootstrap-rbd" 2023-06-10T18:53:48.911 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:53:48.911 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:53:48.912 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T18:53:48.912 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-06-10T18:53:48.912 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBlxoRkx1D9AhAAt2r+YlVuBIzLKA7AztuuvQ==", 2023-06-10T18:53:48.912 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T18:53:48.912 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-06-10T18:53:48.913 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:53:48.913 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:53:48.913 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T18:53:48.913 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.bootstrap-rgw", 2023-06-10T18:53:48.913 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBlxoRkq2f9AhAADo7D0I261/gERjMPhP1kYA==", 2023-06-10T18:53:48.913 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T18:53:48.914 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile bootstrap-rgw" 2023-06-10T18:53:48.914 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:53:48.914 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:53:48.914 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T18:53:48.914 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mgr.x", 2023-06-10T18:53:48.914 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkzWG3AhAAh3NFYHAbp4fgn4FZeRRNuw==", 2023-06-10T18:53:48.914 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T18:53:48.914 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow *", 2023-06-10T18:53:48.915 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile mgr", 2023-06-10T18:53:48.915 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T18:53:48.915 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:53:48.915 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:53:48.915 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T18:53:48.915 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mgr.y", 2023-06-10T18:53:48.915 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA5xoRkBriKOxAA6G+T7Yp2rH7XV7z37lvMYQ==", 2023-06-10T18:53:48.916 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T18:53:48.916 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow *", 2023-06-10T18:53:48.916 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile mgr", 2023-06-10T18:53:48.916 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T18:53:48.916 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:53:48.916 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:53:48.916 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2023-06-10T18:53:48.917 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-06-10T18:53:48.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.872+0000 7f7bea1c1640 1 -- 172.21.15.53:0/1202920935 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7bc40662b0 msgr2=0x7f7bc4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:48.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.872+0000 7f7bea1c1640 1 --2- 172.21.15.53:0/1202920935 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7bc40662b0 0x7f7bc4068760 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7bd40af000 tx=0x7f7bd40046d0 comp rx=0 tx=0).stop 2023-06-10T18:53:48.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.872+0000 7f7bea1c1640 1 -- 172.21.15.53:0/1202920935 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7be414d630 msgr2=0x7f7be414daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:48.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.872+0000 7f7bea1c1640 1 --2- 172.21.15.53:0/1202920935 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7be414d630 0x7f7be414daa0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f7be40ad6d0 tx=0x7f7bdc00c7c0 comp rx=0 tx=0).stop 2023-06-10T18:53:48.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.872+0000 7f7bea1c1640 1 -- 172.21.15.53:0/1202920935 shutdown_connections 2023-06-10T18:53:48.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.872+0000 7f7bea1c1640 1 --2- 172.21.15.53:0/1202920935 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7bc40662b0 0x7f7bc4068760 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:48.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.872+0000 7f7bea1c1640 1 --2- 172.21.15.53:0/1202920935 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7be414d630 0x7f7be414daa0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:48.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.872+0000 7f7bea1c1640 1 --2- 172.21.15.53:0/1202920935 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7be406f7c0 0x7f7be406fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:48.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.872+0000 7f7bea1c1640 1 --2- 172.21.15.53:0/1202920935 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7bd0003a20 0x7f7be414ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:48.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.872+0000 7f7bea1c1640 1 -- 172.21.15.53:0/1202920935 >> 172.21.15.53:0/1202920935 conn(0x7f7be406a0d0 msgr2=0x7f7be40ab860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:48.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.872+0000 7f7bea1c1640 1 -- 172.21.15.53:0/1202920935 shutdown_connections 2023-06-10T18:53:48.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:48.872+0000 7f7bea1c1640 1 -- 172.21.15.53:0/1202920935 wait complete. 2023-06-10T18:53:48.921 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-06-10T18:53:49.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.036+0000 7fd3f765c640 1 Processor -- start 2023-06-10T18:53:49.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.036+0000 7fd3f765c640 1 -- start start 2023-06-10T18:53:49.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.036+0000 7fd3f765c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd3f00afee0 0x7fd3f00aca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:49.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.036+0000 7fd3f765c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3f00ac320 0x7fd3f00c8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:49.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.036+0000 7fd3f765c640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3f00ad0e0 con 0x7fd3f015b870 2023-06-10T18:53:49.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.036+0000 7fd3f765c640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3f00ccd40 con 0x7fd3f00afee0 2023-06-10T18:53:49.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.036+0000 7fd3f765c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f00c8310 con 0x7fd3f00ac320 2023-06-10T18:53:49.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.036+0000 7fd3f4bf7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd3f00afee0 0x7fd3f00aca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:49.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.036+0000 7fd3f53f8640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fd3f015b870 0x7fd3f00af7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:48030/0 (socket says 172.21.15.53:48030) 2023-06-10T18:53:49.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.036+0000 7fd3f4bf7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd3f00afee0 0x7fd3f00aca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35212/0 (socket says 172.21.15.53:35212) 2023-06-10T18:53:49.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.036+0000 7fd3f53f8640 1 -- 172.21.15.53:0/3448647249 learned_addr learned my addr 172.21.15.53:0/3448647249 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:53:49.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.036+0000 7fd3f5bf9640 1 --2- 172.21.15.53:0/3448647249 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3f00ac320 0x7fd3f00c8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:49.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.036+0000 7fd3f4bf7640 1 -- 172.21.15.53:0/3448647249 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3f00ac320 msgr2=0x7fd3f00c8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:49.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.036+0000 7fd3f4bf7640 1 --2- 172.21.15.53:0/3448647249 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3f00ac320 0x7fd3f00c8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:49.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.036+0000 7fd3f4bf7640 1 -- 172.21.15.53:0/3448647249 >> v1:172.21.15.53:6789/0 conn(0x7fd3f015b870 legacy=0x7fd3f00af7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:49.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.036+0000 7fd3f4bf7640 1 -- 172.21.15.53:0/3448647249 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3f00cd400 con 0x7fd3f00afee0 2023-06-10T18:53:49.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.040+0000 7fd3f4bf7640 1 --2- 172.21.15.53:0/3448647249 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3f00afee0 0x7fd3f00aca00 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fd3e00097c0 tx=0x7fd3e001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2147b950d2906834 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:49.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.040+0000 7fd3e7fff640 1 -- 172.21.15.53:0/3448647249 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e00ab650 con 0x7fd3f00afee0 2023-06-10T18:53:49.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.040+0000 7fd3e7fff640 1 -- 172.21.15.53:0/3448647249 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3e00ab7b0 con 0x7fd3f00afee0 2023-06-10T18:53:49.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.040+0000 7fd3e7fff640 1 -- 172.21.15.53:0/3448647249 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e00abb40 con 0x7fd3f00afee0 2023-06-10T18:53:49.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.040+0000 7fd3f765c640 1 -- 172.21.15.53:0/3448647249 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3f00afee0 msgr2=0x7fd3f00aca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:49.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.040+0000 7fd3f765c640 1 --2- 172.21.15.53:0/3448647249 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3f00afee0 0x7fd3f00aca00 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fd3e00097c0 tx=0x7fd3e001c450 comp rx=0 tx=0).stop 2023-06-10T18:53:49.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.040+0000 7fd3f765c640 1 -- 172.21.15.53:0/3448647249 shutdown_connections 2023-06-10T18:53:49.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.040+0000 7fd3f765c640 1 --2- 172.21.15.53:0/3448647249 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3f00afee0 0x7fd3f00aca00 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:49.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.040+0000 7fd3f765c640 1 --2- 172.21.15.53:0/3448647249 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3f00ac320 0x7fd3f00c8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:49.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.040+0000 7fd3f765c640 1 -- 172.21.15.53:0/3448647249 >> 172.21.15.53:0/3448647249 conn(0x7fd3f00ce9e0 msgr2=0x7fd3f00ca7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:49.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.040+0000 7fd3f765c640 1 -- 172.21.15.53:0/3448647249 shutdown_connections 2023-06-10T18:53:49.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.040+0000 7fd3f765c640 1 -- 172.21.15.53:0/3448647249 wait complete. 2023-06-10T18:53:49.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.040+0000 7fd3f765c640 1 Processor -- start 2023-06-10T18:53:49.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.040+0000 7fd3f765c640 1 -- start start 2023-06-10T18:53:49.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.040+0000 7fd3f765c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3f00ac320 0x7fd3f0151070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:49.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.040+0000 7fd3f765c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3f00afee0 0x7fd3f00c3210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:49.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.040+0000 7fd3f765c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3f015b870 0x7fd3f0070160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:49.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.040+0000 7fd3f765c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f00b2fe0 con 0x7fd3f00ac320 2023-06-10T18:53:49.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.040+0000 7fd3f765c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f00b1f40 con 0x7fd3f015b870 2023-06-10T18:53:49.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.040+0000 7fd3f765c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f00b2220 con 0x7fd3f00afee0 2023-06-10T18:53:49.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.040+0000 7fd3f53f8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3f00ac320 0x7fd3f0151070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:49.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.040+0000 7fd3f53f8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3f00ac320 0x7fd3f0151070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35218/0 (socket says 172.21.15.53:35218) 2023-06-10T18:53:49.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.040+0000 7fd3f53f8640 1 -- 172.21.15.53:0/3592348033 learned_addr learned my addr 172.21.15.53:0/3592348033 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:49.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.040+0000 7fd3f4bf7640 1 --2- 172.21.15.53:0/3592348033 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3f00afee0 0x7fd3f00c3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:49.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.040+0000 7fd3f53f8640 1 -- 172.21.15.53:0/3592348033 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3f00afee0 msgr2=0x7fd3f00c3210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:49.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.040+0000 7fd3f53f8640 1 --2- 172.21.15.53:0/3592348033 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3f00afee0 0x7fd3f00c3210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:49.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.040+0000 7fd3f53f8640 1 -- 172.21.15.53:0/3592348033 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3f015b870 msgr2=0x7fd3f0070160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:49.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.040+0000 7fd3f53f8640 1 --2- 172.21.15.53:0/3592348033 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3f015b870 0x7fd3f0070160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:49.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.040+0000 7fd3f53f8640 1 -- 172.21.15.53:0/3592348033 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3e0009420 con 0x7fd3f00ac320 2023-06-10T18:53:49.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.040+0000 7fd3f53f8640 1 --2- 172.21.15.53:0/3592348033 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3f00ac320 0x7fd3f0151070 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec00c770 tx=0x7fd3ec00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:49.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.040+0000 7fd3e5ffb640 1 -- 172.21.15.53:0/3592348033 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3ec00ce80 con 0x7fd3f00ac320 2023-06-10T18:53:49.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.040+0000 7fd3e5ffb640 1 -- 172.21.15.53:0/3592348033 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3ec00a640 con 0x7fd3f00ac320 2023-06-10T18:53:49.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.040+0000 7fd3f765c640 1 -- 172.21.15.53:0/3592348033 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3f00b2500 con 0x7fd3f00ac320 2023-06-10T18:53:49.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.040+0000 7fd3e5ffb640 1 -- 172.21.15.53:0/3592348033 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3ec00a9f0 con 0x7fd3f00ac320 2023-06-10T18:53:49.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.040+0000 7fd3f765c640 1 -- 172.21.15.53:0/3592348033 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3f00b2ac0 con 0x7fd3f00ac320 2023-06-10T18:53:49.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.044+0000 7fd3f765c640 1 -- 172.21.15.53:0/3592348033 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3f004d790 con 0x7fd3f00ac320 2023-06-10T18:53:49.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.044+0000 7fd3e5ffb640 1 -- 172.21.15.53:0/3592348033 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd3ec00ab50 con 0x7fd3f00ac320 2023-06-10T18:53:49.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.044+0000 7fd3e5ffb640 1 --2- 172.21.15.53:0/3592348033 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd3d4066280 0x7fd3d4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:49.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.044+0000 7fd3e5ffb640 1 -- 172.21.15.53:0/3592348033 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fd3ec083100 con 0x7fd3f00ac320 2023-06-10T18:53:49.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.044+0000 7fd3f4bf7640 1 --2- 172.21.15.53:0/3592348033 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd3d4066280 0x7fd3d4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:49.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.044+0000 7fd3f4bf7640 1 --2- 172.21.15.53:0/3592348033 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd3d4066280 0x7fd3d4068730 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd3e00af000 tx=0x7fd3e0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:49.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.048+0000 7fd3e5ffb640 1 -- 172.21.15.53:0/3592348033 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd3ec050a10 con 0x7fd3f00ac320 2023-06-10T18:53:49.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.256+0000 7fd3f765c640 1 -- 172.21.15.53:0/3592348033 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fd3f00b3cd0 con 0x7fd3f00ac320 2023-06-10T18:53:49.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.264+0000 7fd3e5ffb640 1 -- 172.21.15.53:0/3592348033 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7fd3ec054030 con 0x7fd3f00ac320 2023-06-10T18:53:49.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.268+0000 7fd3f765c640 1 -- 172.21.15.53:0/3592348033 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd3d4066280 msgr2=0x7fd3d4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:49.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.268+0000 7fd3f765c640 1 --2- 172.21.15.53:0/3592348033 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd3d4066280 0x7fd3d4068730 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd3e00af000 tx=0x7fd3e0008040 comp rx=0 tx=0).stop 2023-06-10T18:53:49.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.268+0000 7fd3f765c640 1 -- 172.21.15.53:0/3592348033 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3f00ac320 msgr2=0x7fd3f0151070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:49.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.268+0000 7fd3f765c640 1 --2- 172.21.15.53:0/3592348033 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3f00ac320 0x7fd3f0151070 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec00c770 tx=0x7fd3ec00cc30 comp rx=0 tx=0).stop 2023-06-10T18:53:49.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.268+0000 7fd3f765c640 1 -- 172.21.15.53:0/3592348033 shutdown_connections 2023-06-10T18:53:49.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.268+0000 7fd3f765c640 1 --2- 172.21.15.53:0/3592348033 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd3d4066280 0x7fd3d4068730 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:49.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.268+0000 7fd3f765c640 1 --2- 172.21.15.53:0/3592348033 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3f015b870 0x7fd3f0070160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:49.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.268+0000 7fd3f765c640 1 --2- 172.21.15.53:0/3592348033 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3f00afee0 0x7fd3f00c3210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:49.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.268+0000 7fd3f765c640 1 --2- 172.21.15.53:0/3592348033 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3f00ac320 0x7fd3f0151070 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:49.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.268+0000 7fd3f765c640 1 -- 172.21.15.53:0/3592348033 >> 172.21.15.53:0/3592348033 conn(0x7fd3f00ce9e0 msgr2=0x7fd3f006b780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:49.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.268+0000 7fd3f765c640 1 -- 172.21.15.53:0/3592348033 shutdown_connections 2023-06-10T18:53:49.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.268+0000 7fd3f765c640 1 -- 172.21.15.53:0/3592348033 wait complete. 2023-06-10T18:53:49.292 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-06-10T18:53:49.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.400+0000 7f9b2d483640 1 Processor -- start 2023-06-10T18:53:49.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.400+0000 7f9b2d483640 1 -- start start 2023-06-10T18:53:49.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.400+0000 7f9b2d483640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9b2815c920 0x7f9b280c8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:49.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.400+0000 7f9b2d483640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b280c8850 con 0x7f9b28152bb0 2023-06-10T18:53:49.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.400+0000 7f9b2d483640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b280cc8f0 con 0x7f9b2806a9b0 2023-06-10T18:53:49.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.400+0000 7f9b2d483640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b280c8b90 con 0x7f9b2815c920 2023-06-10T18:53:49.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.400+0000 7f9b26ffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f9b28152bb0 0x7f9b2815c210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:48042/0 (socket says 172.21.15.53:48042) 2023-06-10T18:53:49.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.400+0000 7f9b26ffd640 1 -- 172.21.15.53:0/3386124599 learned_addr learned my addr 172.21.15.53:0/3386124599 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:53:49.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.400+0000 7f9b267fc640 1 --2- 172.21.15.53:0/3386124599 >> v2:172.21.15.117:3300/0 conn(0x7f9b2815c920 0x7f9b280c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:49.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.400+0000 7f9b25ffb640 1 -- 172.21.15.53:0/3386124599 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 798319625 0 0) 0x7f9b180012a0 con 0x7f9b28152bb0 2023-06-10T18:53:49.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.400+0000 7f9b25ffb640 1 -- 172.21.15.53:0/3386124599 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b10003530 con 0x7f9b28152bb0 2023-06-10T18:53:49.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.400+0000 7f9b25ffb640 1 -- 172.21.15.53:0/3386124599 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1033355187 0 0) 0x7f9b10003530 con 0x7f9b28152bb0 2023-06-10T18:53:49.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.400+0000 7f9b25ffb640 1 -- 172.21.15.53:0/3386124599 >> v2:172.21.15.117:3300/0 conn(0x7f9b2815c920 msgr2=0x7f9b280c8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:49.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.400+0000 7f9b25ffb640 1 --2- 172.21.15.53:0/3386124599 >> v2:172.21.15.117:3300/0 conn(0x7f9b2815c920 0x7f9b280c8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:49.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.400+0000 7f9b25ffb640 1 -- 172.21.15.53:0/3386124599 >> v1:172.21.15.117:6789/0 conn(0x7f9b2806a9b0 legacy=0x7f9b2806ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:49.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.400+0000 7f9b25ffb640 1 -- 172.21.15.53:0/3386124599 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b280c8e70 con 0x7f9b28152bb0 2023-06-10T18:53:49.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.400+0000 7f9b25ffb640 1 -- 172.21.15.53:0/3386124599 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f9b18001990 con 0x7f9b28152bb0 2023-06-10T18:53:49.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.400+0000 7f9b25ffb640 1 -- 172.21.15.53:0/3386124599 >> v1:172.21.15.53:6789/0 conn(0x7f9b28152bb0 legacy=0x7f9b2815c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:49.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.400+0000 7f9b25ffb640 1 --2- 172.21.15.53:0/3386124599 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b10003980 0x7f9b10003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:49.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.400+0000 7f9b25ffb640 1 --2- 172.21.15.53:0/3386124599 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b100047d0 0x7f9b10004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:49.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.400+0000 7f9b25ffb640 1 --2- 172.21.15.53:0/3386124599 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b10005180 0x7f9b1000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:49.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.400+0000 7f9b25ffb640 1 -- 172.21.15.53:0/3386124599 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b280c8b90 con 0x7f9b100047d0 2023-06-10T18:53:49.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.400+0000 7f9b25ffb640 1 -- 172.21.15.53:0/3386124599 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1000bfe0 con 0x7f9b10003980 2023-06-10T18:53:49.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.400+0000 7f9b25ffb640 1 -- 172.21.15.53:0/3386124599 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1000c1a0 con 0x7f9b10005180 2023-06-10T18:53:49.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.400+0000 7f9b267fc640 1 --2- 172.21.15.53:0/3386124599 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b100047d0 0x7f9b10004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:49.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.400+0000 7f9b26ffd640 1 --2- 172.21.15.53:0/3386124599 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b10003980 0x7f9b10003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:49.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.400+0000 7f9b267fc640 1 -- 172.21.15.53:0/3386124599 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b10005180 msgr2=0x7f9b1000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:49.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.400+0000 7f9b267fc640 1 --2- 172.21.15.53:0/3386124599 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b10005180 0x7f9b1000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:49.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.400+0000 7f9b267fc640 1 -- 172.21.15.53:0/3386124599 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b10003980 msgr2=0x7f9b10003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:49.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.400+0000 7f9b267fc640 1 --2- 172.21.15.53:0/3386124599 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b10003980 0x7f9b10003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:49.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.404+0000 7f9b267fc640 1 -- 172.21.15.53:0/3386124599 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b10003530 con 0x7f9b100047d0 2023-06-10T18:53:49.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.404+0000 7f9b277fe640 1 -- 172.21.15.53:0/3386124599 reap_dead start 2023-06-10T18:53:49.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.404+0000 7f9b267fc640 1 --2- 172.21.15.53:0/3386124599 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b100047d0 0x7f9b10004c40 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f9b2806cb10 tx=0x7f9b1c01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c1d7ffa99058295 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:49.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.404+0000 7f9b25ffb640 1 -- 172.21.15.53:0/3386124599 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b1c0a5620 con 0x7f9b100047d0 2023-06-10T18:53:49.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.404+0000 7f9b25ffb640 1 -- 172.21.15.53:0/3386124599 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b1c0a5780 con 0x7f9b100047d0 2023-06-10T18:53:49.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.404+0000 7f9b25ffb640 1 -- 172.21.15.53:0/3386124599 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b1c0a5b30 con 0x7f9b100047d0 2023-06-10T18:53:49.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.404+0000 7f9b2d483640 1 -- 172.21.15.53:0/3386124599 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b100047d0 msgr2=0x7f9b10004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:49.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.404+0000 7f9b2d483640 1 --2- 172.21.15.53:0/3386124599 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b100047d0 0x7f9b10004c40 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f9b2806cb10 tx=0x7f9b1c01ca30 comp rx=0 tx=0).stop 2023-06-10T18:53:49.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.404+0000 7f9b2d483640 1 -- 172.21.15.53:0/3386124599 shutdown_connections 2023-06-10T18:53:49.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.404+0000 7f9b2d483640 1 --2- 172.21.15.53:0/3386124599 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b100047d0 0x7f9b10004c40 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:49.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.404+0000 7f9b2d483640 1 -- 172.21.15.53:0/3386124599 >> 172.21.15.53:0/3386124599 conn(0x7f9b280ce9e0 msgr2=0x7f9b280ca7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:49.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.404+0000 7f9b2d483640 1 -- 172.21.15.53:0/3386124599 shutdown_connections 2023-06-10T18:53:49.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.404+0000 7f9b2d483640 1 -- 172.21.15.53:0/3386124599 wait complete. 2023-06-10T18:53:49.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.408+0000 7f9b2d483640 1 Processor -- start 2023-06-10T18:53:49.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.408+0000 7f9b2d483640 1 -- start start 2023-06-10T18:53:49.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.408+0000 7f9b2d483640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b100047d0 0x7f9b281510e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:49.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.408+0000 7f9b2d483640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b281ed660 0x7f9b28159380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:49.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.408+0000 7f9b2d483640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b280af820 0x7f9b280afc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:49.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.408+0000 7f9b2d483640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b280b2290 con 0x7f9b100047d0 2023-06-10T18:53:49.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.408+0000 7f9b2d483640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b280b01d0 con 0x7f9b280af820 2023-06-10T18:53:49.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.408+0000 7f9b2d483640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b280c56c0 con 0x7f9b281ed660 2023-06-10T18:53:49.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.408+0000 7f9b26ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b100047d0 0x7f9b281510e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:49.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.408+0000 7f9b26ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b100047d0 0x7f9b281510e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35244/0 (socket says 172.21.15.53:35244) 2023-06-10T18:53:49.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.408+0000 7f9b26ffd640 1 -- 172.21.15.53:0/2031553625 learned_addr learned my addr 172.21.15.53:0/2031553625 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:49.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.408+0000 7f9b267fc640 1 --2- 172.21.15.53:0/2031553625 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b281ed660 0x7f9b28159380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:49.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.408+0000 7f9b277fe640 1 --2- 172.21.15.53:0/2031553625 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b280af820 0x7f9b280afc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:49.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.408+0000 7f9b26ffd640 1 -- 172.21.15.53:0/2031553625 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b281ed660 msgr2=0x7f9b28159380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:49.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.408+0000 7f9b26ffd640 1 --2- 172.21.15.53:0/2031553625 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b281ed660 0x7f9b28159380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:49.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.408+0000 7f9b26ffd640 1 -- 172.21.15.53:0/2031553625 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b280af820 msgr2=0x7f9b280afc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:49.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.408+0000 7f9b26ffd640 1 --2- 172.21.15.53:0/2031553625 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b280af820 0x7f9b280afc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:49.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.408+0000 7f9b26ffd640 1 -- 172.21.15.53:0/2031553625 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b28151620 con 0x7f9b100047d0 2023-06-10T18:53:49.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.408+0000 7f9b267fc640 1 --2- 172.21.15.53:0/2031553625 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b281ed660 0x7f9b28159380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:53:49.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.408+0000 7f9b26ffd640 1 --2- 172.21.15.53:0/2031553625 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b100047d0 0x7f9b281510e0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f9b1800d7d0 tx=0x7f9b1800d8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:49.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.408+0000 7f9b0f7fe640 1 -- 172.21.15.53:0/2031553625 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b1800b070 con 0x7f9b100047d0 2023-06-10T18:53:49.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.408+0000 7f9b0f7fe640 1 -- 172.21.15.53:0/2031553625 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b180074e0 con 0x7f9b100047d0 2023-06-10T18:53:49.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.408+0000 7f9b2d483640 1 -- 172.21.15.53:0/2031553625 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b280c5910 con 0x7f9b100047d0 2023-06-10T18:53:49.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.408+0000 7f9b0f7fe640 1 -- 172.21.15.53:0/2031553625 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b180059b0 con 0x7f9b100047d0 2023-06-10T18:53:49.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.408+0000 7f9b2d483640 1 -- 172.21.15.53:0/2031553625 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b280b1bd0 con 0x7f9b100047d0 2023-06-10T18:53:49.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.408+0000 7f9b2d483640 1 -- 172.21.15.53:0/2031553625 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b2804d790 con 0x7f9b100047d0 2023-06-10T18:53:49.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.408+0000 7f9b0f7fe640 1 -- 172.21.15.53:0/2031553625 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9b18005b10 con 0x7f9b100047d0 2023-06-10T18:53:49.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.408+0000 7f9b0f7fe640 1 --2- 172.21.15.53:0/2031553625 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9b140662b0 0x7f9b14068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:49.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.408+0000 7f9b0f7fe640 1 -- 172.21.15.53:0/2031553625 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f9b18082fd0 con 0x7f9b100047d0 2023-06-10T18:53:49.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.412+0000 7f9b267fc640 1 --2- 172.21.15.53:0/2031553625 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9b140662b0 0x7f9b14068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:49.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.412+0000 7f9b267fc640 1 --2- 172.21.15.53:0/2031553625 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9b140662b0 0x7f9b14068760 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c0af000 tx=0x7f9b1c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:49.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.412+0000 7f9b0f7fe640 1 -- 172.21.15.53:0/2031553625 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9b18050850 con 0x7f9b100047d0 2023-06-10T18:53:49.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.612+0000 7f9b2d483640 1 -- 172.21.15.53:0/2031553625 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f9b28151800 con 0x7f9b100047d0 2023-06-10T18:53:49.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.620+0000 7f9b0f7fe640 1 -- 172.21.15.53:0/2031553625 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7f9b18053e70 con 0x7f9b100047d0 2023-06-10T18:53:49.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.620+0000 7f9b2d483640 1 -- 172.21.15.53:0/2031553625 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9b140662b0 msgr2=0x7f9b14068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:49.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.620+0000 7f9b2d483640 1 --2- 172.21.15.53:0/2031553625 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9b140662b0 0x7f9b14068760 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c0af000 tx=0x7f9b1c008040 comp rx=0 tx=0).stop 2023-06-10T18:53:49.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.620+0000 7f9b2d483640 1 -- 172.21.15.53:0/2031553625 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b100047d0 msgr2=0x7f9b281510e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:49.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.620+0000 7f9b2d483640 1 --2- 172.21.15.53:0/2031553625 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b100047d0 0x7f9b281510e0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f9b1800d7d0 tx=0x7f9b1800d8c0 comp rx=0 tx=0).stop 2023-06-10T18:53:49.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.620+0000 7f9b2d483640 1 -- 172.21.15.53:0/2031553625 shutdown_connections 2023-06-10T18:53:49.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.620+0000 7f9b2d483640 1 --2- 172.21.15.53:0/2031553625 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9b140662b0 0x7f9b14068760 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:49.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.620+0000 7f9b2d483640 1 --2- 172.21.15.53:0/2031553625 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b280af820 0x7f9b280afc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:49.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.620+0000 7f9b2d483640 1 --2- 172.21.15.53:0/2031553625 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b281ed660 0x7f9b28159380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:49.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.620+0000 7f9b2d483640 1 --2- 172.21.15.53:0/2031553625 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b100047d0 0x7f9b281510e0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:49.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.620+0000 7f9b2d483640 1 -- 172.21.15.53:0/2031553625 >> 172.21.15.53:0/2031553625 conn(0x7f9b280ce9e0 msgr2=0x7f9b28151f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:49.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.620+0000 7f9b2d483640 1 -- 172.21.15.53:0/2031553625 shutdown_connections 2023-06-10T18:53:49.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.620+0000 7f9b2d483640 1 -- 172.21.15.53:0/2031553625 wait complete. 2023-06-10T18:53:49.646 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-06-10T18:53:49.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.752+0000 7fc3cc46d640 1 Processor -- start 2023-06-10T18:53:49.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.752+0000 7fc3cc46d640 1 -- start start 2023-06-10T18:53:49.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.752+0000 7fc3cc46d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc3c4070100 0x7fc3c40af7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:49.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.752+0000 7fc3cc46d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc3c40afd10 0x7fc3c40c83f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:49.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.752+0000 7fc3cc46d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3c4071190 con 0x7fc3c41571a0 2023-06-10T18:53:49.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.752+0000 7fc3cc46d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3c40b01b0 con 0x7fc3c4070100 2023-06-10T18:53:49.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.752+0000 7fc3cc46d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3c4070580 con 0x7fc3c40afd10 2023-06-10T18:53:49.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.752+0000 7fc3c9a08640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc3c4070100 0x7fc3c40af7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:49.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.752+0000 7fc3c9a08640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc3c4070100 0x7fc3c40af7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35258/0 (socket says 172.21.15.53:35258) 2023-06-10T18:53:49.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.752+0000 7fc3c9a08640 1 -- 172.21.15.53:0/2894369765 learned_addr learned my addr 172.21.15.53:0/2894369765 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:49.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.752+0000 7fc3caa0a640 1 --2- 172.21.15.53:0/2894369765 >> v2:172.21.15.117:3300/0 conn(0x7fc3c40afd10 0x7fc3c40c83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:49.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.752+0000 7fc3c9a08640 1 -- 172.21.15.53:0/2894369765 >> v2:172.21.15.117:3300/0 conn(0x7fc3c40afd10 msgr2=0x7fc3c40c83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:49.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.752+0000 7fc3c9a08640 1 --2- 172.21.15.53:0/2894369765 >> v2:172.21.15.117:3300/0 conn(0x7fc3c40afd10 0x7fc3c40c83f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:49.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.752+0000 7fc3c9a08640 1 -- 172.21.15.53:0/2894369765 >> v1:172.21.15.117:6789/0 conn(0x7fc3c41571a0 legacy=0x7fc3c40c9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:49.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.752+0000 7fc3c9a08640 1 -- 172.21.15.53:0/2894369765 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3c4070860 con 0x7fc3c4070100 2023-06-10T18:53:49.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.756+0000 7fc3c9a08640 1 --2- 172.21.15.53:0/2894369765 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3c4070100 0x7fc3c40af7d0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fc3b4009870 tx=0x7fc3b401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65f092bd12a2d271 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:49.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.756+0000 7fc3c9207640 1 -- 172.21.15.53:0/2894369765 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b40aa430 con 0x7fc3c4070100 2023-06-10T18:53:49.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.756+0000 7fc3c9207640 1 -- 172.21.15.53:0/2894369765 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3b40aa590 con 0x7fc3c4070100 2023-06-10T18:53:49.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.756+0000 7fc3c9207640 1 -- 172.21.15.53:0/2894369765 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b40aa920 con 0x7fc3c4070100 2023-06-10T18:53:49.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.756+0000 7fc3cc46d640 1 -- 172.21.15.53:0/2894369765 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3c4070100 msgr2=0x7fc3c40af7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:49.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.756+0000 7fc3cc46d640 1 --2- 172.21.15.53:0/2894369765 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3c4070100 0x7fc3c40af7d0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fc3b4009870 tx=0x7fc3b401c4d0 comp rx=0 tx=0).stop 2023-06-10T18:53:49.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.756+0000 7fc3cc46d640 1 -- 172.21.15.53:0/2894369765 shutdown_connections 2023-06-10T18:53:49.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.756+0000 7fc3cc46d640 1 --2- 172.21.15.53:0/2894369765 >> v2:172.21.15.117:3300/0 conn(0x7fc3c40afd10 0x7fc3c40c83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:49.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.756+0000 7fc3cc46d640 1 --2- 172.21.15.53:0/2894369765 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3c4070100 0x7fc3c40af7d0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:49.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.756+0000 7fc3cc46d640 1 -- 172.21.15.53:0/2894369765 >> 172.21.15.53:0/2894369765 conn(0x7fc3c40ce9e0 msgr2=0x7fc3c40ca7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:49.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.756+0000 7fc3cc46d640 1 -- 172.21.15.53:0/2894369765 shutdown_connections 2023-06-10T18:53:49.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.756+0000 7fc3cc46d640 1 -- 172.21.15.53:0/2894369765 wait complete. 2023-06-10T18:53:49.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.756+0000 7fc3cc46d640 1 Processor -- start 2023-06-10T18:53:49.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.760+0000 7fc3cc46d640 1 -- start start 2023-06-10T18:53:49.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.760+0000 7fc3cc46d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3c40afd10 0x7fc3c4162780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:49.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.760+0000 7fc3cc46d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3c41571a0 0x7fc3c414f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:49.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.760+0000 7fc3cc46d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3c4150190 0x7fc3c414fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:49.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.760+0000 7fc3cc46d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c4150000 con 0x7fc3c40afd10 2023-06-10T18:53:49.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.760+0000 7fc3cc46d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c4151780 con 0x7fc3c4150190 2023-06-10T18:53:49.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.760+0000 7fc3cc46d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c4151a60 con 0x7fc3c41571a0 2023-06-10T18:53:49.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.760+0000 7fc3ca209640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3c40afd10 0x7fc3c4162780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:49.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.760+0000 7fc3ca209640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3c40afd10 0x7fc3c4162780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35266/0 (socket says 172.21.15.53:35266) 2023-06-10T18:53:49.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.760+0000 7fc3ca209640 1 -- 172.21.15.53:0/1695535051 learned_addr learned my addr 172.21.15.53:0/1695535051 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:49.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.760+0000 7fc3c9a08640 1 --2- 172.21.15.53:0/1695535051 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3c41571a0 0x7fc3c414f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:49.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.760+0000 7fc3caa0a640 1 --2- 172.21.15.53:0/1695535051 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3c4150190 0x7fc3c414fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:49.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.760+0000 7fc3ca209640 1 -- 172.21.15.53:0/1695535051 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3c41571a0 msgr2=0x7fc3c414f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:49.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.760+0000 7fc3ca209640 1 --2- 172.21.15.53:0/1695535051 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3c41571a0 0x7fc3c414f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:49.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.760+0000 7fc3ca209640 1 -- 172.21.15.53:0/1695535051 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3c4150190 msgr2=0x7fc3c414fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:49.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.760+0000 7fc3ca209640 1 --2- 172.21.15.53:0/1695535051 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3c4150190 0x7fc3c414fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:49.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.760+0000 7fc3ca209640 1 -- 172.21.15.53:0/1695535051 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3b40094d0 con 0x7fc3c40afd10 2023-06-10T18:53:49.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.760+0000 7fc3ca209640 1 --2- 172.21.15.53:0/1695535051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3c40afd10 0x7fc3c4162780 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fc3c000c430 tx=0x7fc3c000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:49.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.760+0000 7fc3baffd640 1 -- 172.21.15.53:0/1695535051 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c00052d0 con 0x7fc3c40afd10 2023-06-10T18:53:49.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.760+0000 7fc3baffd640 1 -- 172.21.15.53:0/1695535051 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3c0005430 con 0x7fc3c40afd10 2023-06-10T18:53:49.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.760+0000 7fc3cc46d640 1 -- 172.21.15.53:0/1695535051 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3c40b3ae0 con 0x7fc3c40afd10 2023-06-10T18:53:49.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.760+0000 7fc3baffd640 1 -- 172.21.15.53:0/1695535051 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c0003890 con 0x7fc3c40afd10 2023-06-10T18:53:49.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.760+0000 7fc3cc46d640 1 -- 172.21.15.53:0/1695535051 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3c41506e0 con 0x7fc3c40afd10 2023-06-10T18:53:49.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.760+0000 7fc3cc46d640 1 -- 172.21.15.53:0/1695535051 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3c41508d0 con 0x7fc3c40afd10 2023-06-10T18:53:49.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.760+0000 7fc3baffd640 1 -- 172.21.15.53:0/1695535051 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc3c00039f0 con 0x7fc3c40afd10 2023-06-10T18:53:49.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.760+0000 7fc3baffd640 1 --2- 172.21.15.53:0/1695535051 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc3a8066280 0x7fc3a8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:49.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.760+0000 7fc3baffd640 1 -- 172.21.15.53:0/1695535051 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fc3c0082f30 con 0x7fc3c40afd10 2023-06-10T18:53:49.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.760+0000 7fc3c9a08640 1 --2- 172.21.15.53:0/1695535051 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc3a8066280 0x7fc3a8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:49.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.764+0000 7fc3c9a08640 1 --2- 172.21.15.53:0/1695535051 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc3a8066280 0x7fc3a8068730 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc3b40ae000 tx=0x7fc3b4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:49.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.764+0000 7fc3baffd640 1 -- 172.21.15.53:0/1695535051 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc3c41508d0 con 0x7fc3c40afd10 2023-06-10T18:53:49.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.976+0000 7fc3cc46d640 1 -- 172.21.15.53:0/1695535051 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fc3c41508d0 con 0x7fc3c40afd10 2023-06-10T18:53:49.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.984+0000 7fc3baffd640 1 -- 172.21.15.53:0/1695535051 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7fc3c41508d0 con 0x7fc3c40afd10 2023-06-10T18:53:49.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.984+0000 7fc3cc46d640 1 -- 172.21.15.53:0/1695535051 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc3a8066280 msgr2=0x7fc3a8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:49.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.984+0000 7fc3cc46d640 1 --2- 172.21.15.53:0/1695535051 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc3a8066280 0x7fc3a8068730 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc3b40ae000 tx=0x7fc3b4008040 comp rx=0 tx=0).stop 2023-06-10T18:53:49.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.984+0000 7fc3cc46d640 1 -- 172.21.15.53:0/1695535051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3c40afd10 msgr2=0x7fc3c4162780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:49.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.984+0000 7fc3cc46d640 1 --2- 172.21.15.53:0/1695535051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3c40afd10 0x7fc3c4162780 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fc3c000c430 tx=0x7fc3c000c8f0 comp rx=0 tx=0).stop 2023-06-10T18:53:49.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.984+0000 7fc3cc46d640 1 -- 172.21.15.53:0/1695535051 shutdown_connections 2023-06-10T18:53:49.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.984+0000 7fc3cc46d640 1 --2- 172.21.15.53:0/1695535051 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc3a8066280 0x7fc3a8068730 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:49.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.984+0000 7fc3cc46d640 1 --2- 172.21.15.53:0/1695535051 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3c4150190 0x7fc3c414fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:49.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.984+0000 7fc3cc46d640 1 --2- 172.21.15.53:0/1695535051 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3c41571a0 0x7fc3c414f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:49.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.984+0000 7fc3cc46d640 1 --2- 172.21.15.53:0/1695535051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3c40afd10 0x7fc3c4162780 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:49.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.984+0000 7fc3cc46d640 1 -- 172.21.15.53:0/1695535051 >> 172.21.15.53:0/1695535051 conn(0x7fc3c40ce9e0 msgr2=0x7fc3c4159ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:49.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.984+0000 7fc3cc46d640 1 -- 172.21.15.53:0/1695535051 shutdown_connections 2023-06-10T18:53:49.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:49.984+0000 7fc3cc46d640 1 -- 172.21.15.53:0/1695535051 wait complete. 2023-06-10T18:53:50.012 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-06-10T18:53:50.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.120+0000 7f5ff7de7640 1 Processor -- start 2023-06-10T18:53:50.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.120+0000 7f5ff7de7640 1 -- start start 2023-06-10T18:53:50.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.120+0000 7f5ff7de7640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5ff00b06d0 0x7f5ff006a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:50.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.120+0000 7f5ff7de7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5ff00c9eb0 0x7f5ff00ca310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:50.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.120+0000 7f5ff7de7640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ff006ae70 con 0x7f5ff015b970 2023-06-10T18:53:50.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.120+0000 7f5ff7de7640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ff0069450 con 0x7f5ff00c9eb0 2023-06-10T18:53:50.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.120+0000 7f5ff7de7640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ff015bd40 con 0x7f5ff00b06d0 2023-06-10T18:53:50.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.120+0000 7f5ff6384640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5ff00c9eb0 0x7f5ff00ca310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:50.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.120+0000 7f5ff6384640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5ff00c9eb0 0x7f5ff00ca310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35280/0 (socket says 172.21.15.53:35280) 2023-06-10T18:53:50.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.120+0000 7f5ff6384640 1 -- 172.21.15.53:0/3666487549 learned_addr learned my addr 172.21.15.53:0/3666487549 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:50.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.120+0000 7f5ff5b83640 1 --1- 172.21.15.53:0/3666487549 >> v1:172.21.15.53:6789/0 conn(0x7f5ff015b970 0x7f5ff00affc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:48058/0 (socket says 172.21.15.53:48058) 2023-06-10T18:53:50.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.124+0000 7f5ff5382640 1 --2- 172.21.15.53:0/3666487549 >> v2:172.21.15.117:3300/0 conn(0x7f5ff00b06d0 0x7f5ff006a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:50.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.124+0000 7f5ff6384640 1 -- 172.21.15.53:0/3666487549 >> v2:172.21.15.117:3300/0 conn(0x7f5ff00b06d0 msgr2=0x7f5ff006a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:50.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.124+0000 7f5ff6384640 1 --2- 172.21.15.53:0/3666487549 >> v2:172.21.15.117:3300/0 conn(0x7f5ff00b06d0 0x7f5ff006a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:50.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.124+0000 7f5ff6384640 1 -- 172.21.15.53:0/3666487549 >> v1:172.21.15.53:6789/0 conn(0x7f5ff015b970 legacy=0x7f5ff00affc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:50.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.124+0000 7f5ff4b81640 1 -- 172.21.15.53:0/3666487549 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1125846934 0 0) 0x7f5fe0001120 con 0x7f5ff015b970 2023-06-10T18:53:50.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.124+0000 7f5ff6384640 1 -- 172.21.15.53:0/3666487549 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff00655a0 con 0x7f5ff00c9eb0 2023-06-10T18:53:50.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.124+0000 7f5ff6384640 1 --2- 172.21.15.53:0/3666487549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ff00c9eb0 0x7f5ff00ca310 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f5ff006f370 tx=0x7f5fe801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a83539565bbc4e96 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:50.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.124+0000 7f5ff4b81640 1 -- 172.21.15.53:0/3666487549 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe80a57d0 con 0x7f5ff00c9eb0 2023-06-10T18:53:50.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.124+0000 7f5ff4b81640 1 -- 172.21.15.53:0/3666487549 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe80a5930 con 0x7f5ff00c9eb0 2023-06-10T18:53:50.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.124+0000 7f5ff4b81640 1 -- 172.21.15.53:0/3666487549 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe80a5cc0 con 0x7f5ff00c9eb0 2023-06-10T18:53:50.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.124+0000 7f5ff7de7640 1 -- 172.21.15.53:0/3666487549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ff00c9eb0 msgr2=0x7f5ff00ca310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:50.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.124+0000 7f5ff7de7640 1 --2- 172.21.15.53:0/3666487549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ff00c9eb0 0x7f5ff00ca310 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f5ff006f370 tx=0x7f5fe801c910 comp rx=0 tx=0).stop 2023-06-10T18:53:50.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.124+0000 7f5ff7de7640 1 -- 172.21.15.53:0/3666487549 shutdown_connections 2023-06-10T18:53:50.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.124+0000 7f5ff7de7640 1 --2- 172.21.15.53:0/3666487549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ff00c9eb0 0x7f5ff00ca310 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:50.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.124+0000 7f5ff7de7640 1 --2- 172.21.15.53:0/3666487549 >> v2:172.21.15.117:3300/0 conn(0x7f5ff00b06d0 0x7f5ff006a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:50.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.124+0000 7f5ff7de7640 1 -- 172.21.15.53:0/3666487549 >> 172.21.15.53:0/3666487549 conn(0x7f5ff00cafc0 msgr2=0x7f5ff00cb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:50.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.124+0000 7f5ff7de7640 1 -- 172.21.15.53:0/3666487549 shutdown_connections 2023-06-10T18:53:50.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.124+0000 7f5ff7de7640 1 -- 172.21.15.53:0/3666487549 wait complete. 2023-06-10T18:53:50.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.128+0000 7f5ff7de7640 1 Processor -- start 2023-06-10T18:53:50.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.128+0000 7f5ff7de7640 1 -- start start 2023-06-10T18:53:50.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.128+0000 7f5ff7de7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ff00b06d0 0x7f5ff00c5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:50.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.128+0000 7f5ff7de7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ff00c9eb0 0x7f5ff0157280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:50.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.128+0000 7f5ff7de7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ff015b970 0x7f5ff01577c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:50.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.128+0000 7f5ff7de7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff00c5f40 con 0x7f5ff015b970 2023-06-10T18:53:50.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.128+0000 7f5ff7de7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff00c6220 con 0x7f5ff00c9eb0 2023-06-10T18:53:50.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.128+0000 7f5ff7de7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff00c6500 con 0x7f5ff00b06d0 2023-06-10T18:53:50.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.128+0000 7f5ff6384640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ff015b970 0x7f5ff01577c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:50.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.128+0000 7f5ff6384640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ff015b970 0x7f5ff01577c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35290/0 (socket says 172.21.15.53:35290) 2023-06-10T18:53:50.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.128+0000 7f5ff6384640 1 -- 172.21.15.53:0/1115417423 learned_addr learned my addr 172.21.15.53:0/1115417423 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:50.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.128+0000 7f5ff5382640 1 --2- 172.21.15.53:0/1115417423 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ff00c9eb0 0x7f5ff0157280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:50.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.128+0000 7f5ff5b83640 1 --2- 172.21.15.53:0/1115417423 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ff00b06d0 0x7f5ff00c5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:50.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.128+0000 7f5ff6384640 1 -- 172.21.15.53:0/1115417423 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ff00b06d0 msgr2=0x7f5ff00c5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:50.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.128+0000 7f5ff6384640 1 --2- 172.21.15.53:0/1115417423 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ff00b06d0 0x7f5ff00c5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:50.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.128+0000 7f5ff6384640 1 -- 172.21.15.53:0/1115417423 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ff00c9eb0 msgr2=0x7f5ff0157280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:50.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.128+0000 7f5ff6384640 1 --2- 172.21.15.53:0/1115417423 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ff00c9eb0 0x7f5ff0157280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:50.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.128+0000 7f5ff6384640 1 -- 172.21.15.53:0/1115417423 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fe8009b30 con 0x7f5ff015b970 2023-06-10T18:53:50.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.128+0000 7f5ff6384640 1 --2- 172.21.15.53:0/1115417423 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ff015b970 0x7f5ff01577c0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f5fe8019520 tx=0x7f5fe80196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:50.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.128+0000 7f5fe67fc640 1 -- 172.21.15.53:0/1115417423 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe80b8670 con 0x7f5ff015b970 2023-06-10T18:53:50.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.128+0000 7f5fe67fc640 1 -- 172.21.15.53:0/1115417423 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe80b87d0 con 0x7f5ff015b970 2023-06-10T18:53:50.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.128+0000 7f5ff7de7640 1 -- 172.21.15.53:0/1115417423 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ff00c67e0 con 0x7f5ff015b970 2023-06-10T18:53:50.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.128+0000 7f5fe67fc640 1 -- 172.21.15.53:0/1115417423 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe80b8b60 con 0x7f5ff015b970 2023-06-10T18:53:50.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.128+0000 7f5ff7de7640 1 -- 172.21.15.53:0/1115417423 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ff00c5b50 con 0x7f5ff015b970 2023-06-10T18:53:50.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.128+0000 7f5ff7de7640 1 -- 172.21.15.53:0/1115417423 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ff004d790 con 0x7f5ff015b970 2023-06-10T18:53:50.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.128+0000 7f5fe67fc640 1 -- 172.21.15.53:0/1115417423 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5fe80b8cc0 con 0x7f5ff015b970 2023-06-10T18:53:50.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.132+0000 7f5fe67fc640 1 --2- 172.21.15.53:0/1115417423 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5fd4066280 0x7f5fd4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:50.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.132+0000 7f5fe67fc640 1 -- 172.21.15.53:0/1115417423 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f5fe811f360 con 0x7f5ff015b970 2023-06-10T18:53:50.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.132+0000 7f5ff5b83640 1 --2- 172.21.15.53:0/1115417423 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5fd4066280 0x7f5fd4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:50.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.132+0000 7f5ff5b83640 1 --2- 172.21.15.53:0/1115417423 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5fd4066280 0x7f5fd4068730 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5fe0000f70 tx=0x7f5fe0007c10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:50.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.140+0000 7f5fe67fc640 1 -- 172.21.15.53:0/1115417423 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5fe80ecdc0 con 0x7f5ff015b970 2023-06-10T18:53:50.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.344+0000 7f5ff7de7640 1 -- 172.21.15.53:0/1115417423 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f5ff00b44c0 con 0x7f5ff015b970 2023-06-10T18:53:50.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.352+0000 7f5fe67fc640 1 -- 172.21.15.53:0/1115417423 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f5fe80f03e0 con 0x7f5ff015b970 2023-06-10T18:53:50.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.356+0000 7f5ff7de7640 1 -- 172.21.15.53:0/1115417423 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5fd4066280 msgr2=0x7f5fd4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:50.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.356+0000 7f5ff7de7640 1 --2- 172.21.15.53:0/1115417423 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5fd4066280 0x7f5fd4068730 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5fe0000f70 tx=0x7f5fe0007c10 comp rx=0 tx=0).stop 2023-06-10T18:53:50.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.356+0000 7f5ff7de7640 1 -- 172.21.15.53:0/1115417423 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ff015b970 msgr2=0x7f5ff01577c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:50.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.356+0000 7f5ff7de7640 1 --2- 172.21.15.53:0/1115417423 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ff015b970 0x7f5ff01577c0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f5fe8019520 tx=0x7f5fe80196b0 comp rx=0 tx=0).stop 2023-06-10T18:53:50.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.356+0000 7f5ff7de7640 1 -- 172.21.15.53:0/1115417423 shutdown_connections 2023-06-10T18:53:50.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.356+0000 7f5ff7de7640 1 --2- 172.21.15.53:0/1115417423 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5fd4066280 0x7f5fd4068730 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:50.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.356+0000 7f5ff7de7640 1 --2- 172.21.15.53:0/1115417423 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ff015b970 0x7f5ff01577c0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:50.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.356+0000 7f5ff7de7640 1 --2- 172.21.15.53:0/1115417423 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ff00c9eb0 0x7f5ff0157280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:50.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.356+0000 7f5ff7de7640 1 --2- 172.21.15.53:0/1115417423 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ff00b06d0 0x7f5ff00c5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:50.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.356+0000 7f5ff7de7640 1 -- 172.21.15.53:0/1115417423 >> 172.21.15.53:0/1115417423 conn(0x7f5ff00cafc0 msgr2=0x7f5ff00ccc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:50.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.356+0000 7f5ff7de7640 1 -- 172.21.15.53:0/1115417423 shutdown_connections 2023-06-10T18:53:50.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.356+0000 7f5ff7de7640 1 -- 172.21.15.53:0/1115417423 wait complete. 2023-06-10T18:53:50.379 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-06-10T18:53:50.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.500+0000 7ff155466640 1 Processor -- start 2023-06-10T18:53:50.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.500+0000 7ff155466640 1 -- start start 2023-06-10T18:53:50.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.500+0000 7ff155466640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff15006c7d0 0x7ff1501586f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:50.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.500+0000 7ff155466640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff15015c260 con 0x7ff1500ccc90 2023-06-10T18:53:50.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.500+0000 7ff155466640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff15015c540 con 0x7ff15006c400 2023-06-10T18:53:50.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.500+0000 7ff155466640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff15015cee0 con 0x7ff15006c7d0 2023-06-10T18:53:50.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.500+0000 7ff14e7fc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff15006c7d0 0x7ff1501586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:50.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.500+0000 7ff14f7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ff1500ccc90 0x7ff1500cd130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:48072/0 (socket says 172.21.15.53:48072) 2023-06-10T18:53:50.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.500+0000 7ff14f7fe640 1 -- 172.21.15.53:0/2678206782 learned_addr learned my addr 172.21.15.53:0/2678206782 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:53:50.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.500+0000 7ff14e7fc640 1 -- 172.21.15.53:0/2678206782 >> v1:172.21.15.117:6789/0 conn(0x7ff15006c400 legacy=0x7ff150157fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:50.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.500+0000 7ff14e7fc640 1 -- 172.21.15.53:0/2678206782 >> v1:172.21.15.53:6789/0 conn(0x7ff1500ccc90 legacy=0x7ff1500cd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:50.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.500+0000 7ff14e7fc640 1 -- 172.21.15.53:0/2678206782 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff15015c820 con 0x7ff15006c7d0 2023-06-10T18:53:50.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.500+0000 7ff14dffb640 1 -- 172.21.15.53:0/2678206782 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2761730728 0 0) 0x7ff15015c260 con 0x7ff1500ccc90 2023-06-10T18:53:50.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.504+0000 7ff14e7fc640 1 --2- 172.21.15.53:0/2678206782 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff15006c7d0 0x7ff1501586f0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7ff1380097c0 tx=0x7ff13801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef22446f28f05c83 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:50.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.504+0000 7ff14dffb640 1 -- 172.21.15.53:0/2678206782 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1380ab600 con 0x7ff15006c7d0 2023-06-10T18:53:50.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.504+0000 7ff14dffb640 1 -- 172.21.15.53:0/2678206782 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1380a7050 con 0x7ff15006c7d0 2023-06-10T18:53:50.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.504+0000 7ff14dffb640 1 -- 172.21.15.53:0/2678206782 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1380ab980 con 0x7ff15006c7d0 2023-06-10T18:53:50.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.504+0000 7ff155466640 1 -- 172.21.15.53:0/2678206782 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff15006c7d0 msgr2=0x7ff1501586f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:50.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.504+0000 7ff155466640 1 --2- 172.21.15.53:0/2678206782 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff15006c7d0 0x7ff1501586f0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7ff1380097c0 tx=0x7ff13801c3f0 comp rx=0 tx=0).stop 2023-06-10T18:53:50.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.504+0000 7ff155466640 1 -- 172.21.15.53:0/2678206782 shutdown_connections 2023-06-10T18:53:50.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.504+0000 7ff155466640 1 --2- 172.21.15.53:0/2678206782 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff15006c7d0 0x7ff1501586f0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:50.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.504+0000 7ff155466640 1 -- 172.21.15.53:0/2678206782 >> 172.21.15.53:0/2678206782 conn(0x7ff15006a560 msgr2=0x7ff15006a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:50.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.504+0000 7ff155466640 1 -- 172.21.15.53:0/2678206782 shutdown_connections 2023-06-10T18:53:50.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.504+0000 7ff155466640 1 -- 172.21.15.53:0/2678206782 wait complete. 2023-06-10T18:53:50.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.504+0000 7ff155466640 1 Processor -- start 2023-06-10T18:53:50.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.504+0000 7ff155466640 1 -- start start 2023-06-10T18:53:50.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.504+0000 7ff155466640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff15006c400 0x7ff15014e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:50.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.504+0000 7ff155466640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff15006c7d0 0x7ff1500ceed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:50.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.504+0000 7ff155466640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1500ccc90 0x7ff1500cf410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:50.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.504+0000 7ff155466640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff15014e850 con 0x7ff15006c7d0 2023-06-10T18:53:50.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.504+0000 7ff155466640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff150152780 con 0x7ff15006c400 2023-06-10T18:53:50.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.504+0000 7ff155466640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1500c36c0 con 0x7ff1500ccc90 2023-06-10T18:53:50.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.504+0000 7ff14e7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff15006c7d0 0x7ff1500ceed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:50.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.504+0000 7ff14e7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff15006c7d0 0x7ff1500ceed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35306/0 (socket says 172.21.15.53:35306) 2023-06-10T18:53:50.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.504+0000 7ff14e7fc640 1 -- 172.21.15.53:0/180288316 learned_addr learned my addr 172.21.15.53:0/180288316 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:50.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.504+0000 7ff14effd640 1 --2- 172.21.15.53:0/180288316 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff15006c400 0x7ff15014e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:50.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.504+0000 7ff14f7fe640 1 --2- 172.21.15.53:0/180288316 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1500ccc90 0x7ff1500cf410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:50.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.508+0000 7ff14e7fc640 1 -- 172.21.15.53:0/180288316 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1500ccc90 msgr2=0x7ff1500cf410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:50.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.508+0000 7ff14e7fc640 1 --2- 172.21.15.53:0/180288316 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1500ccc90 0x7ff1500cf410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:50.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.508+0000 7ff14e7fc640 1 -- 172.21.15.53:0/180288316 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff15006c400 msgr2=0x7ff15014e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:50.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.508+0000 7ff14e7fc640 1 --2- 172.21.15.53:0/180288316 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff15006c400 0x7ff15014e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:50.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.508+0000 7ff14e7fc640 1 -- 172.21.15.53:0/180288316 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff138009420 con 0x7ff15006c7d0 2023-06-10T18:53:50.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.508+0000 7ff14e7fc640 1 --2- 172.21.15.53:0/180288316 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff15006c7d0 0x7ff1500ceed0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7ff138019000 tx=0x7ff138019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:50.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.508+0000 7ff1477fe640 1 -- 172.21.15.53:0/180288316 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1380b4610 con 0x7ff15006c7d0 2023-06-10T18:53:50.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.508+0000 7ff1477fe640 1 -- 172.21.15.53:0/180288316 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1380abe90 con 0x7ff15006c7d0 2023-06-10T18:53:50.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.508+0000 7ff155466640 1 -- 172.21.15.53:0/180288316 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1500c39a0 con 0x7ff15006c7d0 2023-06-10T18:53:50.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.508+0000 7ff1477fe640 1 -- 172.21.15.53:0/180288316 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1380b49d0 con 0x7ff15006c7d0 2023-06-10T18:53:50.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.508+0000 7ff155466640 1 -- 172.21.15.53:0/180288316 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1500c2950 con 0x7ff15006c7d0 2023-06-10T18:53:50.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.508+0000 7ff155466640 1 -- 172.21.15.53:0/180288316 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1500c3be0 con 0x7ff15006c7d0 2023-06-10T18:53:50.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.508+0000 7ff1477fe640 1 -- 172.21.15.53:0/180288316 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff1380b2040 con 0x7ff15006c7d0 2023-06-10T18:53:50.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.508+0000 7ff1477fe640 1 --2- 172.21.15.53:0/180288316 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff1300662b0 0x7ff130068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:50.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.508+0000 7ff1477fe640 1 -- 172.21.15.53:0/180288316 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ff13811da80 con 0x7ff15006c7d0 2023-06-10T18:53:50.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.508+0000 7ff14effd640 1 --2- 172.21.15.53:0/180288316 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff1300662b0 0x7ff130068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:50.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.508+0000 7ff14effd640 1 --2- 172.21.15.53:0/180288316 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff1300662b0 0x7ff130068760 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff15006b420 tx=0x7ff148009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:50.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.512+0000 7ff1477fe640 1 -- 172.21.15.53:0/180288316 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff1500c3be0 con 0x7ff15006c7d0 2023-06-10T18:53:50.732 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.724+0000 7ff155466640 1 -- 172.21.15.53:0/180288316 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7ff1500c3be0 con 0x7ff15006c7d0 2023-06-10T18:53:50.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.732+0000 7ff1477fe640 1 -- 172.21.15.53:0/180288316 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7ff1500c3be0 con 0x7ff15006c7d0 2023-06-10T18:53:50.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.736+0000 7ff155466640 1 -- 172.21.15.53:0/180288316 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff1300662b0 msgr2=0x7ff130068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:50.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.736+0000 7ff155466640 1 --2- 172.21.15.53:0/180288316 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff1300662b0 0x7ff130068760 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff15006b420 tx=0x7ff148009040 comp rx=0 tx=0).stop 2023-06-10T18:53:50.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.736+0000 7ff155466640 1 -- 172.21.15.53:0/180288316 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff15006c7d0 msgr2=0x7ff1500ceed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:50.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.736+0000 7ff155466640 1 --2- 172.21.15.53:0/180288316 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff15006c7d0 0x7ff1500ceed0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7ff138019000 tx=0x7ff138019190 comp rx=0 tx=0).stop 2023-06-10T18:53:50.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.736+0000 7ff155466640 1 -- 172.21.15.53:0/180288316 shutdown_connections 2023-06-10T18:53:50.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.736+0000 7ff155466640 1 --2- 172.21.15.53:0/180288316 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff1300662b0 0x7ff130068760 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:50.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.736+0000 7ff155466640 1 --2- 172.21.15.53:0/180288316 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1500ccc90 0x7ff1500cf410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:50.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.736+0000 7ff155466640 1 --2- 172.21.15.53:0/180288316 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff15006c7d0 0x7ff1500ceed0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:50.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.736+0000 7ff155466640 1 --2- 172.21.15.53:0/180288316 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff15006c400 0x7ff15014e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:50.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.736+0000 7ff155466640 1 -- 172.21.15.53:0/180288316 >> 172.21.15.53:0/180288316 conn(0x7ff15006a560 msgr2=0x7ff1500c5170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:50.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.736+0000 7ff155466640 1 -- 172.21.15.53:0/180288316 shutdown_connections 2023-06-10T18:53:50.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.736+0000 7ff155466640 1 -- 172.21.15.53:0/180288316 wait complete. 2023-06-10T18:53:50.760 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-06-10T18:53:50.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.876+0000 7f023e698640 1 Processor -- start 2023-06-10T18:53:50.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.876+0000 7f023e698640 1 -- start start 2023-06-10T18:53:50.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.880+0000 7f023e698640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f02380cd6d0 0x7f023815b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:50.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.880+0000 7f023e698640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f023806b7a0 con 0x7f02380afee0 2023-06-10T18:53:50.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.880+0000 7f023e698640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f023806a8b0 con 0x7f02380c83c0 2023-06-10T18:53:50.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.880+0000 7f023e698640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f023806ab90 con 0x7f02380cd6d0 2023-06-10T18:53:50.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.880+0000 7f023cc35640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f02380afee0 0x7f0238158660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:48086/0 (socket says 172.21.15.53:48086) 2023-06-10T18:53:50.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.880+0000 7f023cc35640 1 -- 172.21.15.53:0/1434457272 learned_addr learned my addr 172.21.15.53:0/1434457272 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:53:50.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.880+0000 7f0237fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f02380cd6d0 0x7f023815b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:50.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.880+0000 7f0236ffd640 1 -- 172.21.15.53:0/1434457272 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 615735023 0 0) 0x7f023806b7a0 con 0x7f02380afee0 2023-06-10T18:53:50.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.880+0000 7f0236ffd640 1 -- 172.21.15.53:0/1434457272 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0220003530 con 0x7f02380afee0 2023-06-10T18:53:50.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.880+0000 7f0237fff640 1 -- 172.21.15.53:0/1434457272 >> v1:172.21.15.117:6789/0 conn(0x7f02380c83c0 legacy=0x7f02380af7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:50.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.880+0000 7f0237fff640 1 -- 172.21.15.53:0/1434457272 >> v1:172.21.15.53:6789/0 conn(0x7f02380afee0 legacy=0x7f0238158660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:50.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.880+0000 7f0237fff640 1 -- 172.21.15.53:0/1434457272 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f023806ae70 con 0x7f02380cd6d0 2023-06-10T18:53:50.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.880+0000 7f0237fff640 1 --2- 172.21.15.53:0/1434457272 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02380cd6d0 0x7f023815b900 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f022800a950 tx=0x7f022801d820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9f176c94f983eab server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:50.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.880+0000 7f0236ffd640 1 -- 172.21.15.53:0/1434457272 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02280a6850 con 0x7f02380cd6d0 2023-06-10T18:53:50.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.880+0000 7f0236ffd640 1 -- 172.21.15.53:0/1434457272 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02280a69b0 con 0x7f02380cd6d0 2023-06-10T18:53:50.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.880+0000 7f0236ffd640 1 -- 172.21.15.53:0/1434457272 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02280a6d40 con 0x7f02380cd6d0 2023-06-10T18:53:50.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.884+0000 7f023e698640 1 -- 172.21.15.53:0/1434457272 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02380cd6d0 msgr2=0x7f023815b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:50.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.884+0000 7f023e698640 1 --2- 172.21.15.53:0/1434457272 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02380cd6d0 0x7f023815b900 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f022800a950 tx=0x7f022801d820 comp rx=0 tx=0).stop 2023-06-10T18:53:50.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.884+0000 7f023e698640 1 -- 172.21.15.53:0/1434457272 shutdown_connections 2023-06-10T18:53:50.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.884+0000 7f023e698640 1 --2- 172.21.15.53:0/1434457272 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02380cd6d0 0x7f023815b900 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:50.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.884+0000 7f023e698640 1 -- 172.21.15.53:0/1434457272 >> 172.21.15.53:0/1434457272 conn(0x7f02380ce9e0 msgr2=0x7f02380ca7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:50.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.884+0000 7f023e698640 1 -- 172.21.15.53:0/1434457272 shutdown_connections 2023-06-10T18:53:50.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.884+0000 7f023e698640 1 -- 172.21.15.53:0/1434457272 wait complete. 2023-06-10T18:53:50.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.884+0000 7f023e698640 1 Processor -- start 2023-06-10T18:53:50.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.884+0000 7f023e698640 1 -- start start 2023-06-10T18:53:50.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.884+0000 7f023e698640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02380afee0 0x7f0238152300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:50.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.884+0000 7f023e698640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02380c83c0 0x7f0238155440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:50.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.884+0000 7f023e698640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02380cd6d0 0x7f0238153440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:50.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.884+0000 7f023e698640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0238155980 con 0x7f02380cd6d0 2023-06-10T18:53:50.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.884+0000 7f023e698640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02380c2280 con 0x7f02380afee0 2023-06-10T18:53:50.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.884+0000 7f023e698640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02380c2560 con 0x7f02380c83c0 2023-06-10T18:53:50.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.884+0000 7f023cc35640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02380cd6d0 0x7f0238153440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:50.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.884+0000 7f023cc35640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02380cd6d0 0x7f0238153440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35318/0 (socket says 172.21.15.53:35318) 2023-06-10T18:53:50.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.884+0000 7f023cc35640 1 -- 172.21.15.53:0/2987009927 learned_addr learned my addr 172.21.15.53:0/2987009927 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:50.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.884+0000 7f0237fff640 1 --2- 172.21.15.53:0/2987009927 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02380afee0 0x7f0238152300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:50.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.884+0000 7f02377fe640 1 --2- 172.21.15.53:0/2987009927 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02380c83c0 0x7f0238155440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:50.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.884+0000 7f023cc35640 1 -- 172.21.15.53:0/2987009927 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02380c83c0 msgr2=0x7f0238155440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:50.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.884+0000 7f023cc35640 1 --2- 172.21.15.53:0/2987009927 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02380c83c0 0x7f0238155440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:50.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.884+0000 7f023cc35640 1 -- 172.21.15.53:0/2987009927 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02380afee0 msgr2=0x7f0238152300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:50.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.884+0000 7f023cc35640 1 --2- 172.21.15.53:0/2987009927 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02380afee0 0x7f0238152300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:50.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.884+0000 7f023cc35640 1 -- 172.21.15.53:0/2987009927 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f022800a560 con 0x7f02380cd6d0 2023-06-10T18:53:50.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.884+0000 7f02377fe640 1 --2- 172.21.15.53:0/2987009927 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02380c83c0 0x7f0238155440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:53:50.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.884+0000 7f023cc35640 1 --2- 172.21.15.53:0/2987009927 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02380cd6d0 0x7f0238153440 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f023000caa0 tx=0x7f023000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:50.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.884+0000 7f0234ff9640 1 -- 172.21.15.53:0/2987009927 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f023000ac00 con 0x7f02380cd6d0 2023-06-10T18:53:50.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.884+0000 7f0234ff9640 1 -- 172.21.15.53:0/2987009927 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f023000ad60 con 0x7f02380cd6d0 2023-06-10T18:53:50.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.884+0000 7f023e698640 1 -- 172.21.15.53:0/2987009927 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02380c2840 con 0x7f02380cd6d0 2023-06-10T18:53:50.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.884+0000 7f0234ff9640 1 -- 172.21.15.53:0/2987009927 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0230012620 con 0x7f02380cd6d0 2023-06-10T18:53:50.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.888+0000 7f023e698640 1 -- 172.21.15.53:0/2987009927 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02380c2e00 con 0x7f02380cd6d0 2023-06-10T18:53:50.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.888+0000 7f023e698640 1 -- 172.21.15.53:0/2987009927 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02380c3020 con 0x7f02380cd6d0 2023-06-10T18:53:50.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.888+0000 7f0234ff9640 1 -- 172.21.15.53:0/2987009927 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0230007070 con 0x7f02380cd6d0 2023-06-10T18:53:50.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.888+0000 7f0234ff9640 1 --2- 172.21.15.53:0/2987009927 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0224066280 0x7f0224068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:50.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.888+0000 7f0234ff9640 1 -- 172.21.15.53:0/2987009927 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f02300839e0 con 0x7f02380cd6d0 2023-06-10T18:53:50.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.888+0000 7f0237fff640 1 --2- 172.21.15.53:0/2987009927 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0224066280 0x7f0224068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:50.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.888+0000 7f0237fff640 1 --2- 172.21.15.53:0/2987009927 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0224066280 0x7f0224068730 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f02280b0000 tx=0x7f0228008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:50.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:50.892+0000 7f0234ff9640 1 -- 172.21.15.53:0/2987009927 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0230051140 con 0x7f02380cd6d0 2023-06-10T18:53:51.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.100+0000 7f023e698640 1 -- 172.21.15.53:0/2987009927 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f023806f380 con 0x7f02380cd6d0 2023-06-10T18:53:51.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.108+0000 7f0234ff9640 1 -- 172.21.15.53:0/2987009927 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f0230054760 con 0x7f02380cd6d0 2023-06-10T18:53:51.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.112+0000 7f023e698640 1 -- 172.21.15.53:0/2987009927 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0224066280 msgr2=0x7f0224068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:51.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.112+0000 7f023e698640 1 --2- 172.21.15.53:0/2987009927 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0224066280 0x7f0224068730 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f02280b0000 tx=0x7f0228008040 comp rx=0 tx=0).stop 2023-06-10T18:53:51.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.112+0000 7f023e698640 1 -- 172.21.15.53:0/2987009927 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02380cd6d0 msgr2=0x7f0238153440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:51.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.112+0000 7f023e698640 1 --2- 172.21.15.53:0/2987009927 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02380cd6d0 0x7f0238153440 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f023000caa0 tx=0x7f023000cf60 comp rx=0 tx=0).stop 2023-06-10T18:53:51.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.112+0000 7f023e698640 1 -- 172.21.15.53:0/2987009927 shutdown_connections 2023-06-10T18:53:51.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.112+0000 7f023e698640 1 --2- 172.21.15.53:0/2987009927 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0224066280 0x7f0224068730 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:51.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.112+0000 7f023e698640 1 --2- 172.21.15.53:0/2987009927 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02380cd6d0 0x7f0238153440 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:51.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.112+0000 7f023e698640 1 --2- 172.21.15.53:0/2987009927 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02380c83c0 0x7f0238155440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:51.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.112+0000 7f023e698640 1 --2- 172.21.15.53:0/2987009927 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02380afee0 0x7f0238152300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:51.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.112+0000 7f023e698640 1 -- 172.21.15.53:0/2987009927 >> 172.21.15.53:0/2987009927 conn(0x7f02380ce9e0 msgr2=0x7f02380ca7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:51.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.112+0000 7f023e698640 1 -- 172.21.15.53:0/2987009927 shutdown_connections 2023-06-10T18:53:51.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.112+0000 7f023e698640 1 -- 172.21.15.53:0/2987009927 wait complete. 2023-06-10T18:53:51.138 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T18:53:51.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.252+0000 7fa6210d7640 1 Processor -- start 2023-06-10T18:53:51.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.252+0000 7fa6210d7640 1 -- start start 2023-06-10T18:53:51.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.256+0000 7fa6210d7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa61c15c0b0 0x7fa61c070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:51.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.256+0000 7fa6210d7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa61c0cc160 0x7fa61c15c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:51.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.256+0000 7fa6210d7640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa61c070080 con 0x7fa61c0cbd50 2023-06-10T18:53:51.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.256+0000 7fa6210d7640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa61c0705c0 con 0x7fa61c0cc160 2023-06-10T18:53:51.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.256+0000 7fa6210d7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa61c0c8e30 con 0x7fa61c15c0b0 2023-06-10T18:53:51.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.256+0000 7fa61b59e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa61c0cc160 0x7fa61c15c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:51.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.256+0000 7fa61a59c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fa61c0cbd50 0x7fa61c06bf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60952/0 (socket says 172.21.15.53:60952) 2023-06-10T18:53:51.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.256+0000 7fa61a59c640 1 -- 172.21.15.53:0/1520603597 learned_addr learned my addr 172.21.15.53:0/1520603597 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:53:51.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.256+0000 7fa61ad9d640 1 --2- 172.21.15.53:0/1520603597 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa61c15c0b0 0x7fa61c070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:51.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.256+0000 7fa61b59e640 1 -- 172.21.15.53:0/1520603597 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa61c15c0b0 msgr2=0x7fa61c070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:51.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.256+0000 7fa61b59e640 1 --2- 172.21.15.53:0/1520603597 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa61c15c0b0 0x7fa61c070f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:51.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.256+0000 7fa61b59e640 1 -- 172.21.15.53:0/1520603597 >> v1:172.21.15.53:6789/0 conn(0x7fa61c0cbd50 legacy=0x7fa61c06bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:51.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.256+0000 7fa619d9b640 1 -- 172.21.15.53:0/1520603597 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 942210861 0 0) 0x7fa61c070080 con 0x7fa61c0cbd50 2023-06-10T18:53:51.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.256+0000 7fa61b59e640 1 -- 172.21.15.53:0/1520603597 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa61c06baa0 con 0x7fa61c0cc160 2023-06-10T18:53:51.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.256+0000 7fa61b59e640 1 --2- 172.21.15.53:0/1520603597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa61c0cc160 0x7fa61c15c480 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fa61400bfa0 tx=0x7fa61401eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57103afe78e2a8f8 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:51.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.256+0000 7fa619d9b640 1 -- 172.21.15.53:0/1520603597 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61400b2d0 con 0x7fa61c0cc160 2023-06-10T18:53:51.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.256+0000 7fa619d9b640 1 -- 172.21.15.53:0/1520603597 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6140a7900 con 0x7fa61c0cc160 2023-06-10T18:53:51.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.256+0000 7fa619d9b640 1 -- 172.21.15.53:0/1520603597 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6140a7c90 con 0x7fa61c0cc160 2023-06-10T18:53:51.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.260+0000 7fa6210d7640 1 -- 172.21.15.53:0/1520603597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa61c0cc160 msgr2=0x7fa61c15c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:51.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.260+0000 7fa6210d7640 1 --2- 172.21.15.53:0/1520603597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa61c0cc160 0x7fa61c15c480 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fa61400bfa0 tx=0x7fa61401eb50 comp rx=0 tx=0).stop 2023-06-10T18:53:51.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.260+0000 7fa6210d7640 1 -- 172.21.15.53:0/1520603597 shutdown_connections 2023-06-10T18:53:51.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.260+0000 7fa6210d7640 1 --2- 172.21.15.53:0/1520603597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa61c0cc160 0x7fa61c15c480 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:51.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.260+0000 7fa6210d7640 1 --2- 172.21.15.53:0/1520603597 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa61c15c0b0 0x7fa61c070f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:51.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.260+0000 7fa6210d7640 1 -- 172.21.15.53:0/1520603597 >> 172.21.15.53:0/1520603597 conn(0x7fa61c06a0d0 msgr2=0x7fa61c0ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:51.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.260+0000 7fa6210d7640 1 -- 172.21.15.53:0/1520603597 shutdown_connections 2023-06-10T18:53:51.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.260+0000 7fa6210d7640 1 -- 172.21.15.53:0/1520603597 wait complete. 2023-06-10T18:53:51.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.260+0000 7fa6210d7640 1 Processor -- start 2023-06-10T18:53:51.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.260+0000 7fa6210d7640 1 -- start start 2023-06-10T18:53:51.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.260+0000 7fa6210d7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa61c0cbd50 0x7fa61c154200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:51.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.260+0000 7fa6210d7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa61c0cc160 0x7fa61c0b2e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:51.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.260+0000 7fa6210d7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa61c15c0b0 0x7fa61c0b3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:51.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.260+0000 7fa6210d7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa61c0c7090 con 0x7fa61c0cc160 2023-06-10T18:53:51.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.260+0000 7fa6210d7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa61c0c64e0 con 0x7fa61c0cbd50 2023-06-10T18:53:51.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.260+0000 7fa6210d7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa61c0c74b0 con 0x7fa61c15c0b0 2023-06-10T18:53:51.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.260+0000 7fa61a59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa61c0cc160 0x7fa61c0b2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:51.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.260+0000 7fa61a59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa61c0cc160 0x7fa61c0b2e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33540/0 (socket says 172.21.15.53:33540) 2023-06-10T18:53:51.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.260+0000 7fa61a59c640 1 -- 172.21.15.53:0/2713639693 learned_addr learned my addr 172.21.15.53:0/2713639693 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:51.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.260+0000 7fa61b59e640 1 --2- 172.21.15.53:0/2713639693 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa61c15c0b0 0x7fa61c0b3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:51.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.260+0000 7fa61ad9d640 1 --2- 172.21.15.53:0/2713639693 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa61c0cbd50 0x7fa61c154200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:51.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.260+0000 7fa61a59c640 1 -- 172.21.15.53:0/2713639693 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa61c15c0b0 msgr2=0x7fa61c0b3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:51.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.260+0000 7fa61a59c640 1 --2- 172.21.15.53:0/2713639693 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa61c15c0b0 0x7fa61c0b3390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:51.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.260+0000 7fa61a59c640 1 -- 172.21.15.53:0/2713639693 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa61c0cbd50 msgr2=0x7fa61c154200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:51.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.260+0000 7fa61a59c640 1 --2- 172.21.15.53:0/2713639693 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa61c0cbd50 0x7fa61c154200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:51.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.260+0000 7fa61a59c640 1 -- 172.21.15.53:0/2713639693 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa61400bc80 con 0x7fa61c0cc160 2023-06-10T18:53:51.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.260+0000 7fa61ad9d640 1 --2- 172.21.15.53:0/2713639693 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa61c0cbd50 0x7fa61c154200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:51.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.260+0000 7fa61a59c640 1 --2- 172.21.15.53:0/2713639693 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa61c0cc160 0x7fa61c0b2e50 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fa6100011f0 tx=0x7fa61000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:51.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.260+0000 7fa6037fe640 1 -- 172.21.15.53:0/2713639693 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6100074e0 con 0x7fa61c0cc160 2023-06-10T18:53:51.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.260+0000 7fa6037fe640 1 -- 172.21.15.53:0/2713639693 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa610007640 con 0x7fa61c0cc160 2023-06-10T18:53:51.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.260+0000 7fa6210d7640 1 -- 172.21.15.53:0/2713639693 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa61c0c66f0 con 0x7fa61c0cc160 2023-06-10T18:53:51.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.260+0000 7fa6037fe640 1 -- 172.21.15.53:0/2713639693 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa610004a10 con 0x7fa61c0cc160 2023-06-10T18:53:51.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.260+0000 7fa6210d7640 1 -- 172.21.15.53:0/2713639693 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa61c0c6cb0 con 0x7fa61c0cc160 2023-06-10T18:53:51.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.264+0000 7fa6210d7640 1 -- 172.21.15.53:0/2713639693 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa61c0c71d0 con 0x7fa61c0cc160 2023-06-10T18:53:51.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.264+0000 7fa6037fe640 1 -- 172.21.15.53:0/2713639693 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa610004b70 con 0x7fa61c0cc160 2023-06-10T18:53:51.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.264+0000 7fa6037fe640 1 --2- 172.21.15.53:0/2713639693 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa608066280 0x7fa608068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:51.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.264+0000 7fa6037fe640 1 -- 172.21.15.53:0/2713639693 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fa610082ec0 con 0x7fa61c0cc160 2023-06-10T18:53:51.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.264+0000 7fa61ad9d640 1 --2- 172.21.15.53:0/2713639693 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa608066280 0x7fa608068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:51.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.264+0000 7fa61ad9d640 1 --2- 172.21.15.53:0/2713639693 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa608066280 0x7fa608068730 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa61c0c9b70 tx=0x7fa60c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:51.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.268+0000 7fa6037fe640 1 -- 172.21.15.53:0/2713639693 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa61c0c71d0 con 0x7fa61c0cc160 2023-06-10T18:53:51.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.416+0000 7fa6210d7640 1 -- 172.21.15.53:0/2713639693 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa61c0c71d0 con 0x7fa61c0cc160 2023-06-10T18:53:51.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.420+0000 7fa6037fe640 1 -- 172.21.15.53:0/2713639693 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+14627 (secure 0 0 0) 0x7fa61c0c71d0 con 0x7fa61c0cc160 2023-06-10T18:53:51.428 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:53:51.429 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":33,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T18:53:48.485632+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T18:53:51.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.420+0000 7fa6210d7640 1 -- 172.21.15.53:0/2713639693 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa608066280 msgr2=0x7fa608068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:51.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.420+0000 7fa6210d7640 1 --2- 172.21.15.53:0/2713639693 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa608066280 0x7fa608068730 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa61c0c9b70 tx=0x7fa60c008040 comp rx=0 tx=0).stop 2023-06-10T18:53:51.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.420+0000 7fa6210d7640 1 -- 172.21.15.53:0/2713639693 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa61c0cc160 msgr2=0x7fa61c0b2e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:51.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.420+0000 7fa6210d7640 1 --2- 172.21.15.53:0/2713639693 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa61c0cc160 0x7fa61c0b2e50 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fa6100011f0 tx=0x7fa61000c9b0 comp rx=0 tx=0).stop 2023-06-10T18:53:51.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.420+0000 7fa6210d7640 1 -- 172.21.15.53:0/2713639693 shutdown_connections 2023-06-10T18:53:51.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.420+0000 7fa6210d7640 1 --2- 172.21.15.53:0/2713639693 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa608066280 0x7fa608068730 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:51.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.420+0000 7fa6210d7640 1 --2- 172.21.15.53:0/2713639693 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa61c15c0b0 0x7fa61c0b3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:51.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.420+0000 7fa6210d7640 1 --2- 172.21.15.53:0/2713639693 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa61c0cc160 0x7fa61c0b2e50 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:51.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.420+0000 7fa6210d7640 1 --2- 172.21.15.53:0/2713639693 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa61c0cbd50 0x7fa61c154200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:51.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.420+0000 7fa6210d7640 1 -- 172.21.15.53:0/2713639693 >> 172.21.15.53:0/2713639693 conn(0x7fa61c06a0d0 msgr2=0x7fa61c0cc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:51.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.420+0000 7fa6210d7640 1 -- 172.21.15.53:0/2713639693 shutdown_connections 2023-06-10T18:53:51.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.420+0000 7fa6210d7640 1 -- 172.21.15.53:0/2713639693 wait complete. 2023-06-10T18:53:51.446 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-10T18:52:33.633114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-10T18:52:39.171487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-10T18:53:51.446 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-10T18:53:51.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.556+0000 7f3b862f8640 1 Processor -- start 2023-06-10T18:53:51.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.556+0000 7f3b862f8640 1 -- start start 2023-06-10T18:53:51.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.556+0000 7f3b862f8640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3b8015c070 0x7f3b8015c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:51.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.556+0000 7f3b862f8640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b8006b090 con 0x7f3b8006b800 2023-06-10T18:53:51.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.556+0000 7f3b862f8640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b8006efa0 con 0x7f3b80156180 2023-06-10T18:53:51.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.556+0000 7f3b862f8640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b8015ca30 con 0x7f3b8015c070 2023-06-10T18:53:51.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.556+0000 7f3b84895640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f3b8006b800 0x7f3b8006bbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60960/0 (socket says 172.21.15.53:60960) 2023-06-10T18:53:51.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.556+0000 7f3b84895640 1 -- 172.21.15.53:0/3946995968 learned_addr learned my addr 172.21.15.53:0/3946995968 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:53:51.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.556+0000 7f3b7effd640 1 -- 172.21.15.53:0/3946995968 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3366001409 0 0) 0x7f3b8006b090 con 0x7f3b8006b800 2023-06-10T18:53:51.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.556+0000 7f3b7effd640 1 -- 172.21.15.53:0/3946995968 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b68003530 con 0x7f3b8006b800 2023-06-10T18:53:51.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.556+0000 7f3b7f7fe640 1 --2- 172.21.15.53:0/3946995968 >> v2:172.21.15.117:3300/0 conn(0x7f3b8015c070 0x7f3b8015c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:51.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.556+0000 7f3b7effd640 1 -- 172.21.15.53:0/3946995968 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2525385772 0 0) 0x7f3b68003530 con 0x7f3b8006b800 2023-06-10T18:53:51.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.556+0000 7f3b7effd640 1 -- 172.21.15.53:0/3946995968 >> v2:172.21.15.117:3300/0 conn(0x7f3b8015c070 msgr2=0x7f3b8015c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:51.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.556+0000 7f3b7effd640 1 --2- 172.21.15.53:0/3946995968 >> v2:172.21.15.117:3300/0 conn(0x7f3b8015c070 0x7f3b8015c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:51.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.556+0000 7f3b7effd640 1 -- 172.21.15.53:0/3946995968 >> v1:172.21.15.117:6789/0 conn(0x7f3b80156180 legacy=0x7f3b800cd4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:51.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.556+0000 7f3b7effd640 1 -- 172.21.15.53:0/3946995968 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b800cc720 con 0x7f3b8006b800 2023-06-10T18:53:51.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.556+0000 7f3b7effd640 1 -- 172.21.15.53:0/3946995968 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f3b78001a00 con 0x7f3b8006b800 2023-06-10T18:53:51.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.556+0000 7f3b7effd640 1 -- 172.21.15.53:0/3946995968 >> v1:172.21.15.53:6789/0 conn(0x7f3b8006b800 legacy=0x7f3b8006bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:51.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.556+0000 7f3b7effd640 1 --2- 172.21.15.53:0/3946995968 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b68003980 0x7f3b68003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:51.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.556+0000 7f3b7effd640 1 --2- 172.21.15.53:0/3946995968 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b680047d0 0x7f3b68004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:51.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.556+0000 7f3b7effd640 1 --2- 172.21.15.53:0/3946995968 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b68005180 0x7f3b6800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:51.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.556+0000 7f3b7effd640 1 -- 172.21.15.53:0/3946995968 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8015ca30 con 0x7f3b680047d0 2023-06-10T18:53:51.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.556+0000 7f3b7effd640 1 -- 172.21.15.53:0/3946995968 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b6800c000 con 0x7f3b68005180 2023-06-10T18:53:51.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.556+0000 7f3b7effd640 1 -- 172.21.15.53:0/3946995968 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b6800c1c0 con 0x7f3b68003980 2023-06-10T18:53:51.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.556+0000 7f3b7f7fe640 1 --2- 172.21.15.53:0/3946995968 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b680047d0 0x7f3b68004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:51.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.556+0000 7f3b84895640 1 --2- 172.21.15.53:0/3946995968 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b68005180 0x7f3b6800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:51.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.556+0000 7f3b7ffff640 1 --2- 172.21.15.53:0/3946995968 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b68003980 0x7f3b68003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:51.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.556+0000 7f3b7f7fe640 1 -- 172.21.15.53:0/3946995968 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b68003980 msgr2=0x7f3b68003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:51.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.556+0000 7f3b7f7fe640 1 --2- 172.21.15.53:0/3946995968 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b68003980 0x7f3b68003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:51.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.556+0000 7f3b7f7fe640 1 -- 172.21.15.53:0/3946995968 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b68005180 msgr2=0x7f3b6800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:51.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.556+0000 7f3b7f7fe640 1 --2- 172.21.15.53:0/3946995968 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b68005180 0x7f3b6800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:51.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.556+0000 7f3b84895640 1 -- 172.21.15.53:0/3946995968 reap_dead start 2023-06-10T18:53:51.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.556+0000 7f3b7f7fe640 1 -- 172.21.15.53:0/3946995968 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b68003530 con 0x7f3b680047d0 2023-06-10T18:53:51.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.560+0000 7f3b7f7fe640 1 --2- 172.21.15.53:0/3946995968 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b680047d0 0x7f3b68004c40 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f3b74009ae0 tx=0x7f3b7401ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8af2eb67f8b09e22 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:51.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.560+0000 7f3b7effd640 1 -- 172.21.15.53:0/3946995968 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b740a6460 con 0x7f3b680047d0 2023-06-10T18:53:51.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.560+0000 7f3b7effd640 1 -- 172.21.15.53:0/3946995968 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b740a65c0 con 0x7f3b680047d0 2023-06-10T18:53:51.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.560+0000 7f3b7effd640 1 -- 172.21.15.53:0/3946995968 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b740a6970 con 0x7f3b680047d0 2023-06-10T18:53:51.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.560+0000 7f3b862f8640 1 -- 172.21.15.53:0/3946995968 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b680047d0 msgr2=0x7f3b68004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:51.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.560+0000 7f3b862f8640 1 --2- 172.21.15.53:0/3946995968 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b680047d0 0x7f3b68004c40 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f3b74009ae0 tx=0x7f3b7401ca50 comp rx=0 tx=0).stop 2023-06-10T18:53:51.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.560+0000 7f3b862f8640 1 -- 172.21.15.53:0/3946995968 shutdown_connections 2023-06-10T18:53:51.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.560+0000 7f3b862f8640 1 --2- 172.21.15.53:0/3946995968 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b680047d0 0x7f3b68004c40 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:51.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.560+0000 7f3b862f8640 1 -- 172.21.15.53:0/3946995968 >> 172.21.15.53:0/3946995968 conn(0x7f3b8006a0e0 msgr2=0x7f3b800cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:51.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.560+0000 7f3b862f8640 1 -- 172.21.15.53:0/3946995968 shutdown_connections 2023-06-10T18:53:51.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.560+0000 7f3b862f8640 1 -- 172.21.15.53:0/3946995968 wait complete. 2023-06-10T18:53:51.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.560+0000 7f3b862f8640 1 Processor -- start 2023-06-10T18:53:51.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.560+0000 7f3b862f8640 1 -- start start 2023-06-10T18:53:51.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.560+0000 7f3b862f8640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b680047d0 0x7f3b800c7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:51.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.560+0000 7f3b862f8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b800c4d20 0x7f3b801ee660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:51.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.560+0000 7f3b862f8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b800aebd0 0x7f3b800af040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:51.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.560+0000 7f3b862f8640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b800c5190 con 0x7f3b800aebd0 2023-06-10T18:53:51.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.560+0000 7f3b862f8640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b800af580 con 0x7f3b800c4d20 2023-06-10T18:53:51.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.560+0000 7f3b862f8640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b80152fe0 con 0x7f3b680047d0 2023-06-10T18:53:51.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.560+0000 7f3b84895640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b800aebd0 0x7f3b800af040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:51.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.560+0000 7f3b84895640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b800aebd0 0x7f3b800af040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33566/0 (socket says 172.21.15.53:33566) 2023-06-10T18:53:51.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.560+0000 7f3b84895640 1 -- 172.21.15.53:0/1651537828 learned_addr learned my addr 172.21.15.53:0/1651537828 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:51.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.560+0000 7f3b7ffff640 1 --2- 172.21.15.53:0/1651537828 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b680047d0 0x7f3b800c7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:51.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.560+0000 7f3b7f7fe640 1 --2- 172.21.15.53:0/1651537828 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b800c4d20 0x7f3b801ee660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:51.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.560+0000 7f3b84895640 1 -- 172.21.15.53:0/1651537828 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b680047d0 msgr2=0x7f3b800c7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:51.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.560+0000 7f3b84895640 1 --2- 172.21.15.53:0/1651537828 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b680047d0 0x7f3b800c7e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:51.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.560+0000 7f3b84895640 1 -- 172.21.15.53:0/1651537828 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b800c4d20 msgr2=0x7f3b801ee660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:51.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.560+0000 7f3b84895640 1 --2- 172.21.15.53:0/1651537828 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b800c4d20 0x7f3b801ee660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:51.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.560+0000 7f3b84895640 1 -- 172.21.15.53:0/1651537828 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b800ae090 con 0x7f3b800aebd0 2023-06-10T18:53:51.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.560+0000 7f3b7ffff640 1 --2- 172.21.15.53:0/1651537828 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b680047d0 0x7f3b800c7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:53:51.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.564+0000 7f3b84895640 1 --2- 172.21.15.53:0/1651537828 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b800aebd0 0x7f3b800af040 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f3b78002240 tx=0x7f3b78011850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:51.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.564+0000 7f3b7cff9640 1 -- 172.21.15.53:0/1651537828 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b78014370 con 0x7f3b800aebd0 2023-06-10T18:53:51.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.564+0000 7f3b7cff9640 1 -- 172.21.15.53:0/1651537828 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b780144f0 con 0x7f3b800aebd0 2023-06-10T18:53:51.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.564+0000 7f3b862f8640 1 -- 172.21.15.53:0/1651537828 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b800c8470 con 0x7f3b800aebd0 2023-06-10T18:53:51.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.564+0000 7f3b7cff9640 1 -- 172.21.15.53:0/1651537828 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b780148a0 con 0x7f3b800aebd0 2023-06-10T18:53:51.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.564+0000 7f3b862f8640 1 -- 172.21.15.53:0/1651537828 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b800c5a10 con 0x7f3b800aebd0 2023-06-10T18:53:51.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.564+0000 7f3b862f8640 1 -- 172.21.15.53:0/1651537828 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b8004d790 con 0x7f3b800aebd0 2023-06-10T18:53:51.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.564+0000 7f3b7cff9640 1 -- 172.21.15.53:0/1651537828 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3b78014a00 con 0x7f3b800aebd0 2023-06-10T18:53:51.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.564+0000 7f3b7cff9640 1 --2- 172.21.15.53:0/1651537828 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3b6c066280 0x7f3b6c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:51.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.564+0000 7f3b7cff9640 1 -- 172.21.15.53:0/1651537828 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f3b78085c10 con 0x7f3b800aebd0 2023-06-10T18:53:51.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.564+0000 7f3b7ffff640 1 --2- 172.21.15.53:0/1651537828 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3b6c066280 0x7f3b6c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:51.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.564+0000 7f3b7ffff640 1 --2- 172.21.15.53:0/1651537828 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3b6c066280 0x7f3b6c068730 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3b70000c10 tx=0x7f3b70009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:51.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.568+0000 7f3b7cff9640 1 -- 172.21.15.53:0/1651537828 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3b78053340 con 0x7f3b800aebd0 2023-06-10T18:53:51.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.716+0000 7f3b862f8640 1 -- 172.21.15.53:0/1651537828 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3b800b3c60 con 0x7f3b800aebd0 2023-06-10T18:53:51.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.716+0000 7f3b7cff9640 1 -- 172.21.15.53:0/1651537828 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v33) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3b7801c070 con 0x7f3b800aebd0 2023-06-10T18:53:51.725 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-06-10T18:53:51.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.716+0000 7f3b862f8640 1 -- 172.21.15.53:0/1651537828 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3b6c066280 msgr2=0x7f3b6c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:51.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.716+0000 7f3b862f8640 1 --2- 172.21.15.53:0/1651537828 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3b6c066280 0x7f3b6c068730 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3b70000c10 tx=0x7f3b70009040 comp rx=0 tx=0).stop 2023-06-10T18:53:51.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.716+0000 7f3b862f8640 1 -- 172.21.15.53:0/1651537828 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b800aebd0 msgr2=0x7f3b800af040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:51.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.716+0000 7f3b862f8640 1 --2- 172.21.15.53:0/1651537828 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b800aebd0 0x7f3b800af040 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f3b78002240 tx=0x7f3b78011850 comp rx=0 tx=0).stop 2023-06-10T18:53:51.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.716+0000 7f3b862f8640 1 -- 172.21.15.53:0/1651537828 shutdown_connections 2023-06-10T18:53:51.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.716+0000 7f3b862f8640 1 --2- 172.21.15.53:0/1651537828 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3b6c066280 0x7f3b6c068730 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:51.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.716+0000 7f3b862f8640 1 --2- 172.21.15.53:0/1651537828 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b800aebd0 0x7f3b800af040 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:51.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.716+0000 7f3b862f8640 1 --2- 172.21.15.53:0/1651537828 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b800c4d20 0x7f3b801ee660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:51.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.716+0000 7f3b862f8640 1 --2- 172.21.15.53:0/1651537828 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b680047d0 0x7f3b800c7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:51.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.716+0000 7f3b862f8640 1 -- 172.21.15.53:0/1651537828 >> 172.21.15.53:0/1651537828 conn(0x7f3b8006a0e0 msgr2=0x7f3b800cd1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:51.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.716+0000 7f3b862f8640 1 -- 172.21.15.53:0/1651537828 shutdown_connections 2023-06-10T18:53:51.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.716+0000 7f3b862f8640 1 -- 172.21.15.53:0/1651537828 wait complete. 2023-06-10T18:53:51.742 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-10T18:53:51.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.864+0000 7f4b9c5cd640 1 Processor -- start 2023-06-10T18:53:51.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.864+0000 7f4b9c5cd640 1 -- start start 2023-06-10T18:53:51.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.864+0000 7f4b9c5cd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b9415c090 0x7f4b940b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:51.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.864+0000 7f4b9c5cd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4b940b0b90 0x7f4b940b7720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:51.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.864+0000 7f4b9c5cd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4b940b7c60 0x7f4b940b3b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:51.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.864+0000 7f4b9c5cd640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b940b80e0 con 0x7f4b940b7c60 2023-06-10T18:53:51.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.864+0000 7f4b9c5cd640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b940cc7c0 con 0x7f4b940b0b90 2023-06-10T18:53:51.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.864+0000 7f4b9c5cd640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b940ccaa0 con 0x7f4b9415c090 2023-06-10T18:53:51.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.864+0000 7f4b9ab6a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4b940b7c60 0x7f4b940b3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:51.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.864+0000 7f4b9ab6a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4b940b7c60 0x7f4b940b3b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33576/0 (socket says 172.21.15.53:33576) 2023-06-10T18:53:51.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.864+0000 7f4b9ab6a640 1 -- 172.21.15.53:0/3238434633 learned_addr learned my addr 172.21.15.53:0/3238434633 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:51.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.864+0000 7f4b9a369640 1 --2- 172.21.15.53:0/3238434633 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b9415c090 0x7f4b940b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:51.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.864+0000 7f4b99b68640 1 --2- 172.21.15.53:0/3238434633 >> v2:172.21.15.117:3300/0 conn(0x7f4b940b0b90 0x7f4b940b7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:51.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.864+0000 7f4b9ab6a640 1 -- 172.21.15.53:0/3238434633 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b9415c090 msgr2=0x7f4b940b10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:51.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.864+0000 7f4b9ab6a640 1 --2- 172.21.15.53:0/3238434633 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b9415c090 0x7f4b940b10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:51.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.864+0000 7f4b9ab6a640 1 -- 172.21.15.53:0/3238434633 >> v2:172.21.15.117:3300/0 conn(0x7f4b940b0b90 msgr2=0x7f4b940b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:51.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.864+0000 7f4b9ab6a640 1 --2- 172.21.15.53:0/3238434633 >> v2:172.21.15.117:3300/0 conn(0x7f4b940b0b90 0x7f4b940b7720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:51.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.864+0000 7f4b9ab6a640 1 -- 172.21.15.53:0/3238434633 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b940ccd80 con 0x7f4b940b7c60 2023-06-10T18:53:51.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.864+0000 7f4b99b68640 1 --2- 172.21.15.53:0/3238434633 >> v2:172.21.15.117:3300/0 conn(0x7f4b940b0b90 0x7f4b940b7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:51.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.864+0000 7f4b9ab6a640 1 --2- 172.21.15.53:0/3238434633 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4b940b7c60 0x7f4b940b3b50 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f4b9406b390 tx=0x7f4b8c01c650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9350abcb5d3d2dfa server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:51.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.864+0000 7f4b99367640 1 -- 172.21.15.53:0/3238434633 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8c0a64e0 con 0x7f4b940b7c60 2023-06-10T18:53:51.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.864+0000 7f4b99367640 1 -- 172.21.15.53:0/3238434633 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b8c0a6640 con 0x7f4b940b7c60 2023-06-10T18:53:51.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.864+0000 7f4b99367640 1 -- 172.21.15.53:0/3238434633 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8c0a69d0 con 0x7f4b940b7c60 2023-06-10T18:53:51.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.868+0000 7f4b9c5cd640 1 -- 172.21.15.53:0/3238434633 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4b940b7c60 msgr2=0x7f4b940b3b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:51.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.868+0000 7f4b9c5cd640 1 --2- 172.21.15.53:0/3238434633 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4b940b7c60 0x7f4b940b3b50 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f4b9406b390 tx=0x7f4b8c01c650 comp rx=0 tx=0).stop 2023-06-10T18:53:51.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.868+0000 7f4b9c5cd640 1 -- 172.21.15.53:0/3238434633 shutdown_connections 2023-06-10T18:53:51.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.868+0000 7f4b9c5cd640 1 --2- 172.21.15.53:0/3238434633 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4b940b7c60 0x7f4b940b3b50 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:51.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.868+0000 7f4b9c5cd640 1 --2- 172.21.15.53:0/3238434633 >> v2:172.21.15.117:3300/0 conn(0x7f4b940b0b90 0x7f4b940b7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:51.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.868+0000 7f4b9c5cd640 1 --2- 172.21.15.53:0/3238434633 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b9415c090 0x7f4b940b10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:51.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.868+0000 7f4b9c5cd640 1 -- 172.21.15.53:0/3238434633 >> 172.21.15.53:0/3238434633 conn(0x7f4b94069e20 msgr2=0x7f4b9406a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:51.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.868+0000 7f4b9c5cd640 1 -- 172.21.15.53:0/3238434633 shutdown_connections 2023-06-10T18:53:51.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.868+0000 7f4b9c5cd640 1 -- 172.21.15.53:0/3238434633 wait complete. 2023-06-10T18:53:51.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.868+0000 7f4b9c5cd640 1 Processor -- start 2023-06-10T18:53:51.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.868+0000 7f4b9c5cd640 1 -- start start 2023-06-10T18:53:51.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.868+0000 7f4b9c5cd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b940b0b90 0x7f4b9414f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:51.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.868+0000 7f4b9c5cd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b940b7c60 0x7f4b941568f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:51.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.868+0000 7f4b9c5cd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4b9415c090 0x7f4b940c91a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:51.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.868+0000 7f4b9c5cd640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9414fb70 con 0x7f4b9415c090 2023-06-10T18:53:51.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.868+0000 7f4b9c5cd640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b94157340 con 0x7f4b940b0b90 2023-06-10T18:53:51.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.868+0000 7f4b9c5cd640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b94157620 con 0x7f4b940b7c60 2023-06-10T18:53:51.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.868+0000 7f4b9ab6a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4b9415c090 0x7f4b940c91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:51.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.868+0000 7f4b9ab6a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4b9415c090 0x7f4b940c91a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33582/0 (socket says 172.21.15.53:33582) 2023-06-10T18:53:51.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.868+0000 7f4b9ab6a640 1 -- 172.21.15.53:0/2649847592 learned_addr learned my addr 172.21.15.53:0/2649847592 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:51.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.868+0000 7f4b9a369640 1 --2- 172.21.15.53:0/2649847592 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b940b0b90 0x7f4b9414f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:51.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.868+0000 7f4b99b68640 1 --2- 172.21.15.53:0/2649847592 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b940b7c60 0x7f4b941568f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:51.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.868+0000 7f4b9ab6a640 1 -- 172.21.15.53:0/2649847592 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b940b7c60 msgr2=0x7f4b941568f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:51.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.868+0000 7f4b9ab6a640 1 --2- 172.21.15.53:0/2649847592 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b940b7c60 0x7f4b941568f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:51.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.868+0000 7f4b9ab6a640 1 -- 172.21.15.53:0/2649847592 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b940b0b90 msgr2=0x7f4b9414f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:51.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.868+0000 7f4b9ab6a640 1 --2- 172.21.15.53:0/2649847592 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b940b0b90 0x7f4b9414f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:51.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.868+0000 7f4b9ab6a640 1 -- 172.21.15.53:0/2649847592 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b8c009b30 con 0x7f4b9415c090 2023-06-10T18:53:51.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.868+0000 7f4b9ab6a640 1 --2- 172.21.15.53:0/2649847592 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4b9415c090 0x7f4b940c91a0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c01cef0 tx=0x7f4b8c0193f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:51.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.868+0000 7f4b8affd640 1 -- 172.21.15.53:0/2649847592 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8c0b4070 con 0x7f4b9415c090 2023-06-10T18:53:51.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.872+0000 7f4b8affd640 1 -- 172.21.15.53:0/2649847592 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b8c0091d0 con 0x7f4b9415c090 2023-06-10T18:53:51.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.872+0000 7f4b9c5cd640 1 -- 172.21.15.53:0/2649847592 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b94157900 con 0x7f4b9415c090 2023-06-10T18:53:51.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.872+0000 7f4b8affd640 1 -- 172.21.15.53:0/2649847592 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8c0a69f0 con 0x7f4b9415c090 2023-06-10T18:53:51.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.872+0000 7f4b9c5cd640 1 -- 172.21.15.53:0/2649847592 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b94157ec0 con 0x7f4b9415c090 2023-06-10T18:53:51.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.872+0000 7f4b9c5cd640 1 -- 172.21.15.53:0/2649847592 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b9404d790 con 0x7f4b9415c090 2023-06-10T18:53:51.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.872+0000 7f4b8affd640 1 -- 172.21.15.53:0/2649847592 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4b8c0b8070 con 0x7f4b9415c090 2023-06-10T18:53:51.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.872+0000 7f4b8affd640 1 --2- 172.21.15.53:0/2649847592 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4b78066280 0x7f4b78068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:51.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.872+0000 7f4b8affd640 1 -- 172.21.15.53:0/2649847592 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f4b8c0aa070 con 0x7f4b9415c090 2023-06-10T18:53:51.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.872+0000 7f4b9a369640 1 --2- 172.21.15.53:0/2649847592 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4b78066280 0x7f4b78068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:51.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.872+0000 7f4b9a369640 1 --2- 172.21.15.53:0/2649847592 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4b78066280 0x7f4b78068730 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4b941f7610 tx=0x7f4b90008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:51.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:51.876+0000 7f4b8affd640 1 -- 172.21.15.53:0/2649847592 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4b8c0ead90 con 0x7f4b9415c090 2023-06-10T18:53:52.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.024+0000 7f4b9c5cd640 1 -- 172.21.15.53:0/2649847592 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4b940b72f0 con 0x7f4b9415c090 2023-06-10T18:53:52.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.024+0000 7f4b8affd640 1 -- 172.21.15.53:0/2649847592 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v33) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4b8c0bf0a0 con 0x7f4b9415c090 2023-06-10T18:53:52.033 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-06-10T18:53:52.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.024+0000 7f4b9c5cd640 1 -- 172.21.15.53:0/2649847592 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4b78066280 msgr2=0x7f4b78068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:52.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.024+0000 7f4b9c5cd640 1 --2- 172.21.15.53:0/2649847592 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4b78066280 0x7f4b78068730 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4b941f7610 tx=0x7f4b90008040 comp rx=0 tx=0).stop 2023-06-10T18:53:52.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.024+0000 7f4b9c5cd640 1 -- 172.21.15.53:0/2649847592 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4b9415c090 msgr2=0x7f4b940c91a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:52.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.024+0000 7f4b9c5cd640 1 --2- 172.21.15.53:0/2649847592 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4b9415c090 0x7f4b940c91a0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c01cef0 tx=0x7f4b8c0193f0 comp rx=0 tx=0).stop 2023-06-10T18:53:52.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.024+0000 7f4b9c5cd640 1 -- 172.21.15.53:0/2649847592 shutdown_connections 2023-06-10T18:53:52.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.024+0000 7f4b9c5cd640 1 --2- 172.21.15.53:0/2649847592 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4b78066280 0x7f4b78068730 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:52.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.024+0000 7f4b9c5cd640 1 --2- 172.21.15.53:0/2649847592 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4b9415c090 0x7f4b940c91a0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:52.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.024+0000 7f4b9c5cd640 1 --2- 172.21.15.53:0/2649847592 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b940b7c60 0x7f4b941568f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:52.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.024+0000 7f4b9c5cd640 1 --2- 172.21.15.53:0/2649847592 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b940b0b90 0x7f4b9414f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:52.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.024+0000 7f4b9c5cd640 1 -- 172.21.15.53:0/2649847592 >> 172.21.15.53:0/2649847592 conn(0x7f4b94069e20 msgr2=0x7f4b940b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:52.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.028+0000 7f4b9c5cd640 1 -- 172.21.15.53:0/2649847592 shutdown_connections 2023-06-10T18:53:52.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.028+0000 7f4b9c5cd640 1 -- 172.21.15.53:0/2649847592 wait complete. 2023-06-10T18:53:52.050 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-06-10T18:53:52.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.156+0000 7f5286134640 1 Processor -- start 2023-06-10T18:53:52.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.156+0000 7f5286134640 1 -- start start 2023-06-10T18:53:52.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.156+0000 7f5286134640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f528006c400 0x7f5280157fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:52.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.156+0000 7f5286134640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f528015c260 con 0x7f528006c7d0 2023-06-10T18:53:52.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.156+0000 7f5286134640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f528015c540 con 0x7f52800ccc90 2023-06-10T18:53:52.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.156+0000 7f5286134640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f528015cee0 con 0x7f528006c400 2023-06-10T18:53:52.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.156+0000 7f527f7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f528006c400 0x7f5280157fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:52.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.156+0000 7f5277fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f528006c7d0 0x7f5280158520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60972/0 (socket says 172.21.15.53:60972) 2023-06-10T18:53:52.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.156+0000 7f5277fff640 1 -- 172.21.15.53:0/1906559969 learned_addr learned my addr 172.21.15.53:0/1906559969 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:53:52.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.160+0000 7f527f7fe640 1 -- 172.21.15.53:0/1906559969 >> v1:172.21.15.117:6789/0 conn(0x7f52800ccc90 legacy=0x7f52800cd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:52.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.160+0000 7f527effd640 1 -- 172.21.15.53:0/1906559969 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3631463045 0 0) 0x7f528015c260 con 0x7f528006c7d0 2023-06-10T18:53:52.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.160+0000 7f527f7fe640 1 -- 172.21.15.53:0/1906559969 >> v1:172.21.15.53:6789/0 conn(0x7f528006c7d0 legacy=0x7f5280158520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:52.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.160+0000 7f527f7fe640 1 -- 172.21.15.53:0/1906559969 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f528015c820 con 0x7f528006c400 2023-06-10T18:53:52.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.160+0000 7f527f7fe640 1 --2- 172.21.15.53:0/1906559969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f528006c400 0x7f5280157fe0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f52700097c0 tx=0x7f527001c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca0307baf1d84cc2 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:52.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.160+0000 7f527effd640 1 -- 172.21.15.53:0/1906559969 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52700ab600 con 0x7f528006c400 2023-06-10T18:53:52.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.160+0000 7f527effd640 1 -- 172.21.15.53:0/1906559969 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52700a7050 con 0x7f528006c400 2023-06-10T18:53:52.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.160+0000 7f527effd640 1 -- 172.21.15.53:0/1906559969 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52700ab980 con 0x7f528006c400 2023-06-10T18:53:52.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.160+0000 7f5286134640 1 -- 172.21.15.53:0/1906559969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f528006c400 msgr2=0x7f5280157fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:52.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.160+0000 7f5286134640 1 --2- 172.21.15.53:0/1906559969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f528006c400 0x7f5280157fe0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f52700097c0 tx=0x7f527001c3b0 comp rx=0 tx=0).stop 2023-06-10T18:53:52.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.160+0000 7f5286134640 1 -- 172.21.15.53:0/1906559969 shutdown_connections 2023-06-10T18:53:52.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.160+0000 7f5286134640 1 --2- 172.21.15.53:0/1906559969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f528006c400 0x7f5280157fe0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:52.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.160+0000 7f5286134640 1 -- 172.21.15.53:0/1906559969 >> 172.21.15.53:0/1906559969 conn(0x7f528006a560 msgr2=0x7f528006a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:52.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.160+0000 7f5286134640 1 -- 172.21.15.53:0/1906559969 shutdown_connections 2023-06-10T18:53:52.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.160+0000 7f5286134640 1 -- 172.21.15.53:0/1906559969 wait complete. 2023-06-10T18:53:52.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.164+0000 7f5286134640 1 Processor -- start 2023-06-10T18:53:52.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.164+0000 7f5286134640 1 -- start start 2023-06-10T18:53:52.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.164+0000 7f5286134640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f528006c400 0x7f528014fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:52.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.164+0000 7f5286134640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f528006c7d0 0x7f52801531e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:52.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.164+0000 7f5286134640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f52800ccc90 0x7f528013bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:52.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.164+0000 7f5286134640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52801502c0 con 0x7f528006c7d0 2023-06-10T18:53:52.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.164+0000 7f5286134640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5280162160 con 0x7f528006c400 2023-06-10T18:53:52.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.164+0000 7f5286134640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5280161830 con 0x7f52800ccc90 2023-06-10T18:53:52.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.164+0000 7f5277fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f528006c7d0 0x7f52801531e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:52.175 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.164+0000 7f5277fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f528006c7d0 0x7f52801531e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33596/0 (socket says 172.21.15.53:33596) 2023-06-10T18:53:52.175 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.164+0000 7f5277fff640 1 -- 172.21.15.53:0/2323412070 learned_addr learned my addr 172.21.15.53:0/2323412070 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:52.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.164+0000 7f527ffff640 1 --2- 172.21.15.53:0/2323412070 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f52800ccc90 0x7f528013bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:52.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.164+0000 7f527f7fe640 1 --2- 172.21.15.53:0/2323412070 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f528006c400 0x7f528014fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:52.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.164+0000 7f5277fff640 1 -- 172.21.15.53:0/2323412070 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f52800ccc90 msgr2=0x7f528013bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:52.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.164+0000 7f5277fff640 1 --2- 172.21.15.53:0/2323412070 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f52800ccc90 0x7f528013bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:52.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.164+0000 7f5277fff640 1 -- 172.21.15.53:0/2323412070 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f528006c400 msgr2=0x7f528014fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:52.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.164+0000 7f5277fff640 1 --2- 172.21.15.53:0/2323412070 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f528006c400 0x7f528014fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:52.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.164+0000 7f5277fff640 1 -- 172.21.15.53:0/2323412070 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5270009420 con 0x7f528006c7d0 2023-06-10T18:53:52.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.164+0000 7f5277fff640 1 --2- 172.21.15.53:0/2323412070 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f528006c7d0 0x7f52801531e0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f52680011f0 tx=0x7f526800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:52.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.164+0000 7f527cff9640 1 -- 172.21.15.53:0/2323412070 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52680074e0 con 0x7f528006c7d0 2023-06-10T18:53:52.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.164+0000 7f527cff9640 1 -- 172.21.15.53:0/2323412070 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5268007640 con 0x7f528006c7d0 2023-06-10T18:53:52.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.164+0000 7f527cff9640 1 -- 172.21.15.53:0/2323412070 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5268004a10 con 0x7f528006c7d0 2023-06-10T18:53:52.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.164+0000 7f5286134640 1 -- 172.21.15.53:0/2323412070 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5280161b10 con 0x7f528006c7d0 2023-06-10T18:53:52.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.164+0000 7f5286134640 1 -- 172.21.15.53:0/2323412070 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52801625f0 con 0x7f528006c7d0 2023-06-10T18:53:52.180 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.164+0000 7f5286134640 1 -- 172.21.15.53:0/2323412070 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f528004d790 con 0x7f528006c7d0 2023-06-10T18:53:52.180 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.164+0000 7f527cff9640 1 -- 172.21.15.53:0/2323412070 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5268004b70 con 0x7f528006c7d0 2023-06-10T18:53:52.180 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.168+0000 7f527cff9640 1 --2- 172.21.15.53:0/2323412070 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5260066280 0x7f5260068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:52.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.168+0000 7f527cff9640 1 -- 172.21.15.53:0/2323412070 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f5268082c90 con 0x7f528006c7d0 2023-06-10T18:53:52.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.168+0000 7f527f7fe640 1 --2- 172.21.15.53:0/2323412070 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5260066280 0x7f5260068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:52.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.168+0000 7f527f7fe640 1 --2- 172.21.15.53:0/2323412070 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5260066280 0x7f5260068730 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f52700ad000 tx=0x7f52700a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:52.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.172+0000 7f527cff9640 1 -- 172.21.15.53:0/2323412070 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5268050460 con 0x7f528006c7d0 2023-06-10T18:53:52.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.324+0000 7f5286134640 1 -- 172.21.15.53:0/2323412070 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f52800b4d30 con 0x7f528006c7d0 2023-06-10T18:53:52.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.328+0000 7f527cff9640 1 -- 172.21.15.53:0/2323412070 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v33) v1 ==== 84+0+126 (secure 0 0 0) 0x7f5268018070 con 0x7f528006c7d0 2023-06-10T18:53:52.335 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:53:52.336 INFO:teuthology.orchestra.run.smithi053.stdout:[ 2023-06-10T18:53:52.336 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T18:53:52.336 INFO:teuthology.orchestra.run.smithi053.stdout: "poolnum": 1, 2023-06-10T18:53:52.336 INFO:teuthology.orchestra.run.smithi053.stdout: "poolname": ".mgr" 2023-06-10T18:53:52.336 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:53:52.336 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T18:53:52.336 INFO:teuthology.orchestra.run.smithi053.stdout: "poolnum": 2, 2023-06-10T18:53:52.337 INFO:teuthology.orchestra.run.smithi053.stdout: "poolname": "rbd" 2023-06-10T18:53:52.337 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:53:52.337 INFO:teuthology.orchestra.run.smithi053.stdout:] 2023-06-10T18:53:52.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.328+0000 7f5286134640 1 -- 172.21.15.53:0/2323412070 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5260066280 msgr2=0x7f5260068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:52.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.328+0000 7f5286134640 1 --2- 172.21.15.53:0/2323412070 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5260066280 0x7f5260068730 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f52700ad000 tx=0x7f52700a6000 comp rx=0 tx=0).stop 2023-06-10T18:53:52.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.328+0000 7f5286134640 1 -- 172.21.15.53:0/2323412070 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f528006c7d0 msgr2=0x7f52801531e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:52.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.328+0000 7f5286134640 1 --2- 172.21.15.53:0/2323412070 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f528006c7d0 0x7f52801531e0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f52680011f0 tx=0x7f526800c9b0 comp rx=0 tx=0).stop 2023-06-10T18:53:52.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.328+0000 7f5286134640 1 -- 172.21.15.53:0/2323412070 shutdown_connections 2023-06-10T18:53:52.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.328+0000 7f5286134640 1 --2- 172.21.15.53:0/2323412070 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5260066280 0x7f5260068730 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:52.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.328+0000 7f5286134640 1 --2- 172.21.15.53:0/2323412070 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f52800ccc90 0x7f528013bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:52.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.328+0000 7f5286134640 1 --2- 172.21.15.53:0/2323412070 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f528006c7d0 0x7f52801531e0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:52.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.328+0000 7f5286134640 1 --2- 172.21.15.53:0/2323412070 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f528006c400 0x7f528014fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:52.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.328+0000 7f5286134640 1 -- 172.21.15.53:0/2323412070 >> 172.21.15.53:0/2323412070 conn(0x7f528006a560 msgr2=0x7f528015a070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:52.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.328+0000 7f5286134640 1 -- 172.21.15.53:0/2323412070 shutdown_connections 2023-06-10T18:53:52.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.328+0000 7f5286134640 1 -- 172.21.15.53:0/2323412070 wait complete. 2023-06-10T18:53:52.353 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-06-10T18:53:52.354 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-06-10T18:53:52.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.476+0000 7f2922d35640 1 Processor -- start 2023-06-10T18:53:52.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.476+0000 7f2922d35640 1 -- start start 2023-06-10T18:53:52.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.476+0000 7f2922d35640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f291c0b1490 0x7f291c15fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:52.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.476+0000 7f2922d35640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f291c0cfc30 0x7f291c0d00b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:52.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.476+0000 7f2922d35640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f291c15bd00 con 0x7f291c15b930 2023-06-10T18:53:52.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.476+0000 7f2922d35640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f291c0cf5e0 con 0x7f291c0cfc30 2023-06-10T18:53:52.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.476+0000 7f2922d35640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f291c0cf020 con 0x7f291c0b1490 2023-06-10T18:53:52.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.476+0000 7f29212d2640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f291c0cfc30 0x7f291c0d00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:52.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.476+0000 7f2920ad1640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f291c15b930 0x7f291c15f400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60980/0 (socket says 172.21.15.53:60980) 2023-06-10T18:53:52.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.476+0000 7f2920ad1640 1 -- 172.21.15.53:0/3899752722 learned_addr learned my addr 172.21.15.53:0/3899752722 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:53:52.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.476+0000 7f291bfff640 1 --2- 172.21.15.53:0/3899752722 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f291c0b1490 0x7f291c15fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:52.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.476+0000 7f291b7fe640 1 -- 172.21.15.53:0/3899752722 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1246310578 0 0) 0x7f291c15bd00 con 0x7f291c15b930 2023-06-10T18:53:52.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.476+0000 7f291b7fe640 1 -- 172.21.15.53:0/3899752722 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2904003530 con 0x7f291c15b930 2023-06-10T18:53:52.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.476+0000 7f29212d2640 1 -- 172.21.15.53:0/3899752722 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f291c0b1490 msgr2=0x7f291c15fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:52.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.476+0000 7f29212d2640 1 --2- 172.21.15.53:0/3899752722 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f291c0b1490 0x7f291c15fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:52.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.476+0000 7f29212d2640 1 -- 172.21.15.53:0/3899752722 >> v1:172.21.15.53:6789/0 conn(0x7f291c15b930 legacy=0x7f291c15f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:52.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.476+0000 7f29212d2640 1 -- 172.21.15.53:0/3899752722 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f291c0cf300 con 0x7f291c0cfc30 2023-06-10T18:53:52.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.480+0000 7f29212d2640 1 --2- 172.21.15.53:0/3899752722 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f291c0cfc30 0x7f291c0d00b0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f2914009d90 tx=0x7f291401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d931a916b1e514ed server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:52.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.480+0000 7f291b7fe640 1 -- 172.21.15.53:0/3899752722 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29140a5900 con 0x7f291c0cfc30 2023-06-10T18:53:52.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.480+0000 7f291b7fe640 1 -- 172.21.15.53:0/3899752722 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29140a5a60 con 0x7f291c0cfc30 2023-06-10T18:53:52.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.480+0000 7f291b7fe640 1 -- 172.21.15.53:0/3899752722 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29140a5df0 con 0x7f291c0cfc30 2023-06-10T18:53:52.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.480+0000 7f2922d35640 1 -- 172.21.15.53:0/3899752722 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f291c0cfc30 msgr2=0x7f291c0d00b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:52.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.480+0000 7f2922d35640 1 --2- 172.21.15.53:0/3899752722 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f291c0cfc30 0x7f291c0d00b0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f2914009d90 tx=0x7f291401c930 comp rx=0 tx=0).stop 2023-06-10T18:53:52.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.480+0000 7f2922d35640 1 -- 172.21.15.53:0/3899752722 shutdown_connections 2023-06-10T18:53:52.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.480+0000 7f2922d35640 1 --2- 172.21.15.53:0/3899752722 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f291c0cfc30 0x7f291c0d00b0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:52.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.480+0000 7f2922d35640 1 --2- 172.21.15.53:0/3899752722 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f291c0b1490 0x7f291c15fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:52.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.480+0000 7f2922d35640 1 -- 172.21.15.53:0/3899752722 >> 172.21.15.53:0/3899752722 conn(0x7f291c069d70 msgr2=0x7f291c06a170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:52.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.480+0000 7f2922d35640 1 -- 172.21.15.53:0/3899752722 shutdown_connections 2023-06-10T18:53:52.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.480+0000 7f2922d35640 1 -- 172.21.15.53:0/3899752722 wait complete. 2023-06-10T18:53:52.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.480+0000 7f2922d35640 1 Processor -- start 2023-06-10T18:53:52.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.480+0000 7f2922d35640 1 -- start start 2023-06-10T18:53:52.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.480+0000 7f2922d35640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f291c0b1490 0x7f291c15bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:52.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.480+0000 7f2922d35640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f291c0cfc30 0x7f291c151b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:52.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.480+0000 7f2922d35640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f291c15b930 0x7f291c156cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:52.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.480+0000 7f2922d35640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f291c15c2e0 con 0x7f291c15b930 2023-06-10T18:53:52.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.480+0000 7f2922d35640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f291c15c5c0 con 0x7f291c0cfc30 2023-06-10T18:53:52.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.480+0000 7f2922d35640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f291c15c8a0 con 0x7f291c0b1490 2023-06-10T18:53:52.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.480+0000 7f29212d2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f291c15b930 0x7f291c156cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:52.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.480+0000 7f29212d2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f291c15b930 0x7f291c156cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33616/0 (socket says 172.21.15.53:33616) 2023-06-10T18:53:52.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.480+0000 7f29212d2640 1 -- 172.21.15.53:0/2024916602 learned_addr learned my addr 172.21.15.53:0/2024916602 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:52.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.480+0000 7f2920ad1640 1 --2- 172.21.15.53:0/2024916602 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f291c0b1490 0x7f291c15bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:52.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.480+0000 7f291bfff640 1 --2- 172.21.15.53:0/2024916602 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f291c0cfc30 0x7f291c151b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:52.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.480+0000 7f29212d2640 1 -- 172.21.15.53:0/2024916602 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f291c0b1490 msgr2=0x7f291c15bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:52.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.484+0000 7f29212d2640 1 --2- 172.21.15.53:0/2024916602 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f291c0b1490 0x7f291c15bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:52.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.484+0000 7f29212d2640 1 -- 172.21.15.53:0/2024916602 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f291c0cfc30 msgr2=0x7f291c151b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:52.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.484+0000 7f29212d2640 1 --2- 172.21.15.53:0/2024916602 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f291c0cfc30 0x7f291c151b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:52.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.484+0000 7f29212d2640 1 -- 172.21.15.53:0/2024916602 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2914009a70 con 0x7f291c15b930 2023-06-10T18:53:52.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.484+0000 7f2920ad1640 1 --2- 172.21.15.53:0/2024916602 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f291c0b1490 0x7f291c15bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:52.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.484+0000 7f291bfff640 1 --2- 172.21.15.53:0/2024916602 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f291c0cfc30 0x7f291c151b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:52.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.484+0000 7f29212d2640 1 --2- 172.21.15.53:0/2024916602 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f291c15b930 0x7f291c156cb0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f29140b0040 tx=0x7f29140196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:52.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.484+0000 7f29197fa640 1 -- 172.21.15.53:0/2024916602 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29140b9860 con 0x7f291c15b930 2023-06-10T18:53:52.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.484+0000 7f29197fa640 1 -- 172.21.15.53:0/2024916602 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29140a58f0 con 0x7f291c15b930 2023-06-10T18:53:52.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.484+0000 7f2922d35640 1 -- 172.21.15.53:0/2024916602 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f291c15cb80 con 0x7f291c15b930 2023-06-10T18:53:52.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.484+0000 7f29197fa640 1 -- 172.21.15.53:0/2024916602 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29140b9c00 con 0x7f291c15b930 2023-06-10T18:53:52.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.484+0000 7f2922d35640 1 -- 172.21.15.53:0/2024916602 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f291c0b54c0 con 0x7f291c15b930 2023-06-10T18:53:52.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.484+0000 7f2922d35640 1 -- 172.21.15.53:0/2024916602 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f291c04d790 con 0x7f291c15b930 2023-06-10T18:53:52.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.484+0000 7f29197fa640 1 -- 172.21.15.53:0/2024916602 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f29140ad440 con 0x7f291c15b930 2023-06-10T18:53:52.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.484+0000 7f29197fa640 1 --2- 172.21.15.53:0/2024916602 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f29080662b0 0x7f2908068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:52.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.484+0000 7f29197fa640 1 -- 172.21.15.53:0/2024916602 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f291411e7d0 con 0x7f291c15b930 2023-06-10T18:53:52.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.484+0000 7f2920ad1640 1 --2- 172.21.15.53:0/2024916602 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f29080662b0 0x7f2908068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:52.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.484+0000 7f2920ad1640 1 --2- 172.21.15.53:0/2024916602 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f29080662b0 0x7f2908068760 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f290c0011f0 tx=0x7f290c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:52.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.488+0000 7f29197fa640 1 -- 172.21.15.53:0/2024916602 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f29140ec150 con 0x7f291c15b930 2023-06-10T18:53:52.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:52.644+0000 7f2922d35640 1 -- 172.21.15.53:0/2024916602 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f291c159690 con 0x7f291c15b930 2023-06-10T18:53:53.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:53.340+0000 7f29197fa640 1 -- 172.21.15.53:0/2024916602 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v34) v1 ==== 138+0+0 (secure 0 0 0) 0x7f29140ef770 con 0x7f291c15b930 2023-06-10T18:53:53.348 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_metadata' created 2023-06-10T18:53:53.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:53.344+0000 7f2922d35640 1 -- 172.21.15.53:0/2024916602 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f29080662b0 msgr2=0x7f2908068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:53.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:53.344+0000 7f2922d35640 1 --2- 172.21.15.53:0/2024916602 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f29080662b0 0x7f2908068760 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f290c0011f0 tx=0x7f290c009040 comp rx=0 tx=0).stop 2023-06-10T18:53:53.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:53.344+0000 7f2922d35640 1 -- 172.21.15.53:0/2024916602 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f291c15b930 msgr2=0x7f291c156cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:53.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:53.344+0000 7f2922d35640 1 --2- 172.21.15.53:0/2024916602 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f291c15b930 0x7f291c156cb0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f29140b0040 tx=0x7f29140196d0 comp rx=0 tx=0).stop 2023-06-10T18:53:53.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:53.344+0000 7f2922d35640 1 -- 172.21.15.53:0/2024916602 shutdown_connections 2023-06-10T18:53:53.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:53.344+0000 7f2922d35640 1 --2- 172.21.15.53:0/2024916602 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f29080662b0 0x7f2908068760 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:53.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:53.344+0000 7f2922d35640 1 --2- 172.21.15.53:0/2024916602 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f291c15b930 0x7f291c156cb0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:53.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:53.344+0000 7f2922d35640 1 --2- 172.21.15.53:0/2024916602 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f291c0cfc30 0x7f291c151b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:53.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:53.344+0000 7f2922d35640 1 --2- 172.21.15.53:0/2024916602 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f291c0b1490 0x7f291c15bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:53.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:53.344+0000 7f2922d35640 1 -- 172.21.15.53:0/2024916602 >> 172.21.15.53:0/2024916602 conn(0x7f291c069d70 msgr2=0x7f291c165ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:53.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:53.344+0000 7f2922d35640 1 -- 172.21.15.53:0/2024916602 shutdown_connections 2023-06-10T18:53:53.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:53.344+0000 7f2922d35640 1 -- 172.21.15.53:0/2024916602 wait complete. 2023-06-10T18:53:53.380 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-06-10T18:53:53.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:53.508+0000 7ffb5e6da640 1 Processor -- start 2023-06-10T18:53:53.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:53.508+0000 7ffb5e6da640 1 -- start start 2023-06-10T18:53:53.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:53.508+0000 7ffb5e6da640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ffb580af810 0x7ffb580cd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:53.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:53.508+0000 7ffb5e6da640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb581599b0 0x7ffb580afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:53.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:53.508+0000 7ffb5e6da640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb580ccee0 con 0x7ffb58070460 2023-06-10T18:53:53.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:53.508+0000 7ffb5e6da640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb580cc070 con 0x7ffb580af810 2023-06-10T18:53:53.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:53.508+0000 7ffb5e6da640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb580b0120 con 0x7ffb581599b0 2023-06-10T18:53:53.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:53.508+0000 7ffb57fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ffb580af810 0x7ffb580cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:53.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:53.508+0000 7ffb5cc77640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ffb58070460 0x7ffb580cb960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60988/0 (socket says 172.21.15.53:60988) 2023-06-10T18:53:53.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:53.508+0000 7ffb5cc77640 1 -- 172.21.15.53:0/1626050453 learned_addr learned my addr 172.21.15.53:0/1626050453 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:53:53.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:53.508+0000 7ffb57fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ffb580af810 0x7ffb580cd370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33626/0 (socket says 172.21.15.53:33626) 2023-06-10T18:53:53.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:53.508+0000 7ffb577fe640 1 --2- 172.21.15.53:0/1626050453 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb581599b0 0x7ffb580afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:53.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:53.508+0000 7ffb57fff640 1 -- 172.21.15.53:0/1626050453 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb581599b0 msgr2=0x7ffb580afbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:53.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:53.508+0000 7ffb57fff640 1 --2- 172.21.15.53:0/1626050453 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb581599b0 0x7ffb580afbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:53.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:53.508+0000 7ffb57fff640 1 -- 172.21.15.53:0/1626050453 >> v1:172.21.15.53:6789/0 conn(0x7ffb58070460 legacy=0x7ffb580cb960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:53.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:53.508+0000 7ffb57fff640 1 -- 172.21.15.53:0/1626050453 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb580cc2d0 con 0x7ffb580af810 2023-06-10T18:53:53.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:53.508+0000 7ffb577fe640 1 --2- 172.21.15.53:0/1626050453 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb581599b0 0x7ffb580afbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:53:53.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:53.512+0000 7ffb57fff640 1 --2- 172.21.15.53:0/1626050453 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb580af810 0x7ffb580cd370 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7ffb48009d90 tx=0x7ffb4801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b83dba52d83eeb0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:53.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:53.512+0000 7ffb56ffd640 1 -- 172.21.15.53:0/1626050453 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb480a59e0 con 0x7ffb580af810 2023-06-10T18:53:53.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:53.512+0000 7ffb56ffd640 1 -- 172.21.15.53:0/1626050453 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb480a5b40 con 0x7ffb580af810 2023-06-10T18:53:53.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:53.512+0000 7ffb56ffd640 1 -- 172.21.15.53:0/1626050453 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb480ad440 con 0x7ffb580af810 2023-06-10T18:53:53.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:53.512+0000 7ffb5e6da640 1 -- 172.21.15.53:0/1626050453 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb580af810 msgr2=0x7ffb580cd370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:53.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:53.512+0000 7ffb5e6da640 1 --2- 172.21.15.53:0/1626050453 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb580af810 0x7ffb580cd370 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7ffb48009d90 tx=0x7ffb4801c920 comp rx=0 tx=0).stop 2023-06-10T18:53:53.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:53.512+0000 7ffb5e6da640 1 -- 172.21.15.53:0/1626050453 shutdown_connections 2023-06-10T18:53:53.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:53.512+0000 7ffb5e6da640 1 --2- 172.21.15.53:0/1626050453 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb581599b0 0x7ffb580afbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:53.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:53.512+0000 7ffb5e6da640 1 --2- 172.21.15.53:0/1626050453 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb580af810 0x7ffb580cd370 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:53.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:53.512+0000 7ffb5e6da640 1 -- 172.21.15.53:0/1626050453 >> 172.21.15.53:0/1626050453 conn(0x7ffb5806a0e0 msgr2=0x7ffb580ca810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:53.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:53.512+0000 7ffb5e6da640 1 -- 172.21.15.53:0/1626050453 shutdown_connections 2023-06-10T18:53:53.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:53.512+0000 7ffb5e6da640 1 -- 172.21.15.53:0/1626050453 wait complete. 2023-06-10T18:53:53.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:53.512+0000 7ffb5e6da640 1 Processor -- start 2023-06-10T18:53:53.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:53.512+0000 7ffb5e6da640 1 -- start start 2023-06-10T18:53:53.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:53.516+0000 7ffb5e6da640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb58070460 0x7ffb581511e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:53.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:53.516+0000 7ffb5e6da640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb580af810 0x7ffb580c5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:53.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:53.516+0000 7ffb5e6da640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb581599b0 0x7ffb580b1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:53.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:53.516+0000 7ffb5e6da640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb581f3860 con 0x7ffb580af810 2023-06-10T18:53:53.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:53.516+0000 7ffb5e6da640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb58151720 con 0x7ffb581599b0 2023-06-10T18:53:53.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:53.516+0000 7ffb5e6da640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb580c5d90 con 0x7ffb58070460 2023-06-10T18:53:53.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:53.516+0000 7ffb577fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb580af810 0x7ffb580c5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:53.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:53.516+0000 7ffb577fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb580af810 0x7ffb580c5140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33634/0 (socket says 172.21.15.53:33634) 2023-06-10T18:53:53.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:53.516+0000 7ffb577fe640 1 -- 172.21.15.53:0/237006829 learned_addr learned my addr 172.21.15.53:0/237006829 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:53.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:53.516+0000 7ffb57fff640 1 --2- 172.21.15.53:0/237006829 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb58070460 0x7ffb581511e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:53.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:53.516+0000 7ffb5cc77640 1 --2- 172.21.15.53:0/237006829 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb581599b0 0x7ffb580b1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:53.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:53.516+0000 7ffb577fe640 1 -- 172.21.15.53:0/237006829 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb58070460 msgr2=0x7ffb581511e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:53.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:53.516+0000 7ffb577fe640 1 --2- 172.21.15.53:0/237006829 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb58070460 0x7ffb581511e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:53.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:53.516+0000 7ffb577fe640 1 -- 172.21.15.53:0/237006829 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb581599b0 msgr2=0x7ffb580b1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:53.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:53.516+0000 7ffb577fe640 1 --2- 172.21.15.53:0/237006829 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb581599b0 0x7ffb580b1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:53.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:53.516+0000 7ffb577fe640 1 -- 172.21.15.53:0/237006829 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb48009a70 con 0x7ffb580af810 2023-06-10T18:53:53.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:53.516+0000 7ffb57fff640 1 --2- 172.21.15.53:0/237006829 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb58070460 0x7ffb581511e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:53:53.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:53.516+0000 7ffb577fe640 1 --2- 172.21.15.53:0/237006829 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb580af810 0x7ffb580c5140 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c00d800 tx=0x7ffb4c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:53.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:53.516+0000 7ffb54ff9640 1 -- 172.21.15.53:0/237006829 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb4c0096a0 con 0x7ffb580af810 2023-06-10T18:53:53.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:53.516+0000 7ffb54ff9640 1 -- 172.21.15.53:0/237006829 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb4c009800 con 0x7ffb580af810 2023-06-10T18:53:53.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:53.516+0000 7ffb5e6da640 1 -- 172.21.15.53:0/237006829 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb580c5ab0 con 0x7ffb580af810 2023-06-10T18:53:53.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:53.516+0000 7ffb54ff9640 1 -- 172.21.15.53:0/237006829 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb4c009bb0 con 0x7ffb580af810 2023-06-10T18:53:53.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:53.516+0000 7ffb5e6da640 1 -- 172.21.15.53:0/237006829 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb581f3d90 con 0x7ffb580af810 2023-06-10T18:53:53.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:53.516+0000 7ffb5e6da640 1 -- 172.21.15.53:0/237006829 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb5804d790 con 0x7ffb580af810 2023-06-10T18:53:53.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:53.516+0000 7ffb54ff9640 1 -- 172.21.15.53:0/237006829 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ffb4c009d10 con 0x7ffb580af810 2023-06-10T18:53:53.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:53.516+0000 7ffb54ff9640 1 --2- 172.21.15.53:0/237006829 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ffb44066280 0x7ffb44068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:53.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:53.520+0000 7ffb54ff9640 1 -- 172.21.15.53:0/237006829 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5580+0+0 (secure 0 0 0) 0x7ffb4c083ff0 con 0x7ffb580af810 2023-06-10T18:53:53.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:53.520+0000 7ffb57fff640 1 --2- 172.21.15.53:0/237006829 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ffb44066280 0x7ffb44068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:53.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:53.520+0000 7ffb57fff640 1 --2- 172.21.15.53:0/237006829 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ffb44066280 0x7ffb44068730 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ffb480af000 tx=0x7ffb480a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:53.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:53.524+0000 7ffb54ff9640 1 -- 172.21.15.53:0/237006829 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ffb4c055170 con 0x7ffb580af810 2023-06-10T18:53:53.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:53.680+0000 7ffb5e6da640 1 -- 172.21.15.53:0/237006829 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7ffb580af5f0 con 0x7ffb580af810 2023-06-10T18:53:54.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.356+0000 7ffb54ff9640 1 -- 172.21.15.53:0/237006829 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v35) v1 ==== 170+0+0 (secure 0 0 0) 0x7ffb4c054d00 con 0x7ffb580af810 2023-06-10T18:53:54.365 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_data' created 2023-06-10T18:53:54.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.360+0000 7ffb5e6da640 1 -- 172.21.15.53:0/237006829 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ffb44066280 msgr2=0x7ffb44068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:54.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.360+0000 7ffb5e6da640 1 --2- 172.21.15.53:0/237006829 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ffb44066280 0x7ffb44068730 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ffb480af000 tx=0x7ffb480a7070 comp rx=0 tx=0).stop 2023-06-10T18:53:54.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.360+0000 7ffb5e6da640 1 -- 172.21.15.53:0/237006829 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb580af810 msgr2=0x7ffb580c5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:54.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.360+0000 7ffb5e6da640 1 --2- 172.21.15.53:0/237006829 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb580af810 0x7ffb580c5140 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c00d800 tx=0x7ffb4c00dcc0 comp rx=0 tx=0).stop 2023-06-10T18:53:54.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.360+0000 7ffb5e6da640 1 -- 172.21.15.53:0/237006829 shutdown_connections 2023-06-10T18:53:54.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.360+0000 7ffb5e6da640 1 --2- 172.21.15.53:0/237006829 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ffb44066280 0x7ffb44068730 secure :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ffb480af000 tx=0x7ffb480a7070 comp rx=0 tx=0).stop 2023-06-10T18:53:54.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.360+0000 7ffb5e6da640 1 --2- 172.21.15.53:0/237006829 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb581599b0 0x7ffb580b1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:54.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.360+0000 7ffb5e6da640 1 --2- 172.21.15.53:0/237006829 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb580af810 0x7ffb580c5140 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:54.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.360+0000 7ffb5e6da640 1 --2- 172.21.15.53:0/237006829 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb58070460 0x7ffb581511e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:54.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.360+0000 7ffb5e6da640 1 -- 172.21.15.53:0/237006829 >> 172.21.15.53:0/237006829 conn(0x7ffb5806a0e0 msgr2=0x7ffb581627a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:54.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.364+0000 7ffb5e6da640 1 -- 172.21.15.53:0/237006829 shutdown_connections 2023-06-10T18:53:54.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.364+0000 7ffb5e6da640 1 -- 172.21.15.53:0/237006829 wait complete. 2023-06-10T18:53:54.411 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-06-10T18:53:54.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.528+0000 7f997a768640 1 Processor -- start 2023-06-10T18:53:54.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.528+0000 7f997a768640 1 -- start start 2023-06-10T18:53:54.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.528+0000 7f997a768640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f997415c070 0x7f997415c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:54.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.528+0000 7f997a768640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f997406b800 0x7f997406bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:54.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.528+0000 7f997a768640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f997406b090 con 0x7f9974156180 2023-06-10T18:53:54.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.528+0000 7f997a768640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f997415ca30 con 0x7f997415c070 2023-06-10T18:53:54.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.528+0000 7f997a768640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f997406efa0 con 0x7f997406b800 2023-06-10T18:53:54.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.528+0000 7f9973fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f9974156180 0x7f99740cd4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:32768/0 (socket says 172.21.15.53:32768) 2023-06-10T18:53:54.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.528+0000 7f9973fff640 1 -- 172.21.15.53:0/1911737282 learned_addr learned my addr 172.21.15.53:0/1911737282 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:53:54.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.528+0000 7f9978d05640 1 --2- 172.21.15.53:0/1911737282 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f997406b800 0x7f997406bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:54.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.528+0000 7f99737fe640 1 --2- 172.21.15.53:0/1911737282 >> v2:172.21.15.117:3300/0 conn(0x7f997415c070 0x7f997415c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:54.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.528+0000 7f9972ffd640 1 -- 172.21.15.53:0/1911737282 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3992639884 0 0) 0x7f997406b090 con 0x7f9974156180 2023-06-10T18:53:54.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.528+0000 7f9972ffd640 1 -- 172.21.15.53:0/1911737282 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f995c003530 con 0x7f9974156180 2023-06-10T18:53:54.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.528+0000 7f9972ffd640 1 -- 172.21.15.53:0/1911737282 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3524413391 0 0) 0x7f995c003530 con 0x7f9974156180 2023-06-10T18:53:54.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.528+0000 7f9972ffd640 1 -- 172.21.15.53:0/1911737282 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f997406b800 msgr2=0x7f997406bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:54.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.528+0000 7f9972ffd640 1 --2- 172.21.15.53:0/1911737282 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f997406b800 0x7f997406bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:54.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.528+0000 7f9972ffd640 1 -- 172.21.15.53:0/1911737282 >> v2:172.21.15.117:3300/0 conn(0x7f997415c070 msgr2=0x7f997415c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:54.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.528+0000 7f9972ffd640 1 --2- 172.21.15.53:0/1911737282 >> v2:172.21.15.117:3300/0 conn(0x7f997415c070 0x7f997415c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:54.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.528+0000 7f9972ffd640 1 -- 172.21.15.53:0/1911737282 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99740cc720 con 0x7f9974156180 2023-06-10T18:53:54.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.528+0000 7f9972ffd640 1 -- 172.21.15.53:0/1911737282 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f9964001680 con 0x7f9974156180 2023-06-10T18:53:54.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.528+0000 7f9972ffd640 1 -- 172.21.15.53:0/1911737282 >> v1:172.21.15.53:6789/0 conn(0x7f9974156180 legacy=0x7f99740cd4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:54.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.528+0000 7f9972ffd640 1 --2- 172.21.15.53:0/1911737282 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f995c003980 0x7f995c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:54.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.528+0000 7f9972ffd640 1 --2- 172.21.15.53:0/1911737282 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f997406b800 0x7f995c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:54.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.528+0000 7f9972ffd640 1 --2- 172.21.15.53:0/1911737282 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f995c004d10 0x7f995c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:54.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.528+0000 7f9972ffd640 1 -- 172.21.15.53:0/1911737282 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f997415ca30 con 0x7f995c004d10 2023-06-10T18:53:54.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.528+0000 7f9972ffd640 1 -- 172.21.15.53:0/1911737282 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f997406efa0 con 0x7f995c003980 2023-06-10T18:53:54.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.528+0000 7f9972ffd640 1 -- 172.21.15.53:0/1911737282 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f995c00b990 con 0x7f997406b800 2023-06-10T18:53:54.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.528+0000 7f9978d05640 1 --2- 172.21.15.53:0/1911737282 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f995c004d10 0x7f995c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:54.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.528+0000 7f9973fff640 1 --2- 172.21.15.53:0/1911737282 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f995c003980 0x7f995c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:54.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.528+0000 7f99737fe640 1 --2- 172.21.15.53:0/1911737282 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f997406b800 0x7f995c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:54.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.528+0000 7f9978d05640 1 -- 172.21.15.53:0/1911737282 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f997406b800 msgr2=0x7f995c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:54.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.528+0000 7f9978d05640 1 --2- 172.21.15.53:0/1911737282 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f997406b800 0x7f995c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:54.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.528+0000 7f9978d05640 1 -- 172.21.15.53:0/1911737282 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f995c003980 msgr2=0x7f995c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:54.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.528+0000 7f9978d05640 1 --2- 172.21.15.53:0/1911737282 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f995c003980 0x7f995c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:54.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.528+0000 7f9978d05640 1 -- 172.21.15.53:0/1911737282 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f995c003530 con 0x7f995c004d10 2023-06-10T18:53:54.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.528+0000 7f9973fff640 1 --2- 172.21.15.53:0/1911737282 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f995c003980 0x7f995c003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:53:54.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.532+0000 7f9978d05640 1 --2- 172.21.15.53:0/1911737282 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f995c004d10 0x7f995c005180 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f996c009fc0 tx=0x7f996c01cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7041da9e26291f server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:54.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.532+0000 7f9972ffd640 1 -- 172.21.15.53:0/1911737282 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f996c0a5c90 con 0x7f995c004d10 2023-06-10T18:53:54.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.532+0000 7f9972ffd640 1 -- 172.21.15.53:0/1911737282 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f996c00f040 con 0x7f995c004d10 2023-06-10T18:53:54.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.532+0000 7f9972ffd640 1 -- 172.21.15.53:0/1911737282 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f996c0ad680 con 0x7f995c004d10 2023-06-10T18:53:54.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.532+0000 7f997a768640 1 -- 172.21.15.53:0/1911737282 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f995c004d10 msgr2=0x7f995c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:54.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.532+0000 7f997a768640 1 --2- 172.21.15.53:0/1911737282 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f995c004d10 0x7f995c005180 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f996c009fc0 tx=0x7f996c01cc20 comp rx=0 tx=0).stop 2023-06-10T18:53:54.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.532+0000 7f9978d05640 1 -- 172.21.15.53:0/1911737282 reap_dead start 2023-06-10T18:53:54.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.532+0000 7f997a768640 1 -- 172.21.15.53:0/1911737282 shutdown_connections 2023-06-10T18:53:54.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.532+0000 7f997a768640 1 -- 172.21.15.53:0/1911737282 >> 172.21.15.53:0/1911737282 conn(0x7f997406a0e0 msgr2=0x7f99740cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:54.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.532+0000 7f997a768640 1 -- 172.21.15.53:0/1911737282 shutdown_connections 2023-06-10T18:53:54.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.532+0000 7f997a768640 1 -- 172.21.15.53:0/1911737282 wait complete. 2023-06-10T18:53:54.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.532+0000 7f997a768640 1 Processor -- start 2023-06-10T18:53:54.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.532+0000 7f997a768640 1 -- start start 2023-06-10T18:53:54.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.536+0000 7f997a768640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f995c004d10 0x7f997414a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:54.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.536+0000 7f997a768640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9974146e60 0x7f9974157630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:54.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.536+0000 7f997a768640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99741472d0 0x7f9974157b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:54.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.536+0000 7f997a768640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f997414a730 con 0x7f995c004d10 2023-06-10T18:53:54.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.536+0000 7f997a768640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99740b0e40 con 0x7f99741472d0 2023-06-10T18:53:54.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.536+0000 7f997a768640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99740b1120 con 0x7f9974146e60 2023-06-10T18:53:54.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.536+0000 7f9973fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f995c004d10 0x7f997414a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:54.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.536+0000 7f9973fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f995c004d10 0x7f997414a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33662/0 (socket says 172.21.15.53:33662) 2023-06-10T18:53:54.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.536+0000 7f9973fff640 1 -- 172.21.15.53:0/4145175541 learned_addr learned my addr 172.21.15.53:0/4145175541 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:54.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.536+0000 7f99737fe640 1 --2- 172.21.15.53:0/4145175541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9974146e60 0x7f9974157630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:54.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.536+0000 7f9978d05640 1 --2- 172.21.15.53:0/4145175541 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99741472d0 0x7f9974157b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:54.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.536+0000 7f9973fff640 1 -- 172.21.15.53:0/4145175541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9974146e60 msgr2=0x7f9974157630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:54.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.536+0000 7f9973fff640 1 --2- 172.21.15.53:0/4145175541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9974146e60 0x7f9974157630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:54.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.536+0000 7f9973fff640 1 -- 172.21.15.53:0/4145175541 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99741472d0 msgr2=0x7f9974157b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:54.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.536+0000 7f9973fff640 1 --2- 172.21.15.53:0/4145175541 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99741472d0 0x7f9974157b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:54.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.536+0000 7f9973fff640 1 -- 172.21.15.53:0/4145175541 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99740b1400 con 0x7f995c004d10 2023-06-10T18:53:54.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.536+0000 7f9973fff640 1 --2- 172.21.15.53:0/4145175541 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f995c004d10 0x7f997414a1f0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f9964001ec0 tx=0x7f996400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:54.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.536+0000 7f9970ff9640 1 -- 172.21.15.53:0/4145175541 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f996400c8a0 con 0x7f995c004d10 2023-06-10T18:53:54.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.536+0000 7f9970ff9640 1 -- 172.21.15.53:0/4145175541 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f996400ca00 con 0x7f995c004d10 2023-06-10T18:53:54.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.536+0000 7f997a768640 1 -- 172.21.15.53:0/4145175541 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99740b16e0 con 0x7f995c004d10 2023-06-10T18:53:54.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.536+0000 7f9970ff9640 1 -- 172.21.15.53:0/4145175541 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f996400cd70 con 0x7f995c004d10 2023-06-10T18:53:54.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.536+0000 7f997a768640 1 -- 172.21.15.53:0/4145175541 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99740b0b10 con 0x7f995c004d10 2023-06-10T18:53:54.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.536+0000 7f997a768640 1 -- 172.21.15.53:0/4145175541 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f997404d790 con 0x7f995c004d10 2023-06-10T18:53:54.550 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.536+0000 7f9970ff9640 1 -- 172.21.15.53:0/4145175541 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9964027430 con 0x7f995c004d10 2023-06-10T18:53:54.550 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.536+0000 7f9970ff9640 1 --2- 172.21.15.53:0/4145175541 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f99600662b0 0x7f9960068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:54.550 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.536+0000 7f9970ff9640 1 -- 172.21.15.53:0/4145175541 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f9964084720 con 0x7f995c004d10 2023-06-10T18:53:54.551 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.536+0000 7f99737fe640 1 --2- 172.21.15.53:0/4145175541 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f99600662b0 0x7f9960068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:54.551 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.540+0000 7f99737fe640 1 --2- 172.21.15.53:0/4145175541 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f99600662b0 0x7f9960068760 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f99741582c0 tx=0x7f9968008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:54.551 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.540+0000 7f9970ff9640 1 -- 172.21.15.53:0/4145175541 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9964051ce0 con 0x7f995c004d10 2023-06-10T18:53:54.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.728+0000 7f997a768640 1 -- 172.21.15.53:0/4145175541 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f99740b1b90 con 0x7f995c004d10 2023-06-10T18:53:54.747 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.736+0000 7f9970ff9640 1 -- 172.21.15.53:0/4145175541 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v11) v1 ==== 172+0+0 (secure 0 0 0) 0x7f9964055300 con 0x7f995c004d10 2023-06-10T18:53:54.749 INFO:teuthology.orchestra.run.smithi053.stderr:new fs with metadata pool 5 and data pool 6 2023-06-10T18:53:54.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.744+0000 7f997a768640 1 -- 172.21.15.53:0/4145175541 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f99600662b0 msgr2=0x7f9960068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:54.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.744+0000 7f997a768640 1 --2- 172.21.15.53:0/4145175541 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f99600662b0 0x7f9960068760 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f99741582c0 tx=0x7f9968008040 comp rx=0 tx=0).stop 2023-06-10T18:53:54.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.744+0000 7f997a768640 1 -- 172.21.15.53:0/4145175541 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f995c004d10 msgr2=0x7f997414a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:54.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.744+0000 7f997a768640 1 --2- 172.21.15.53:0/4145175541 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f995c004d10 0x7f997414a1f0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f9964001ec0 tx=0x7f996400eca0 comp rx=0 tx=0).stop 2023-06-10T18:53:54.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.744+0000 7f997a768640 1 -- 172.21.15.53:0/4145175541 shutdown_connections 2023-06-10T18:53:54.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.744+0000 7f997a768640 1 --2- 172.21.15.53:0/4145175541 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f99600662b0 0x7f9960068760 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:54.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.744+0000 7f997a768640 1 --2- 172.21.15.53:0/4145175541 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99741472d0 0x7f9974157b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:54.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.744+0000 7f997a768640 1 --2- 172.21.15.53:0/4145175541 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9974146e60 0x7f9974157630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:54.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.744+0000 7f997a768640 1 --2- 172.21.15.53:0/4145175541 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f995c004d10 0x7f997414a1f0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:54.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.744+0000 7f997a768640 1 -- 172.21.15.53:0/4145175541 >> 172.21.15.53:0/4145175541 conn(0x7f997406a0e0 msgr2=0x7f99740ab860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:54.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.744+0000 7f997a768640 1 -- 172.21.15.53:0/4145175541 shutdown_connections 2023-06-10T18:53:54.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.744+0000 7f997a768640 1 -- 172.21.15.53:0/4145175541 wait complete. 2023-06-10T18:53:54.782 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T18:53:54.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.896+0000 7feb3657d640 1 Processor -- start 2023-06-10T18:53:54.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.896+0000 7feb3657d640 1 -- start start 2023-06-10T18:53:54.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.900+0000 7feb3657d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7feb3015b260 0x7feb3006a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:54.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.900+0000 7feb3657d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb300c9e60 0x7feb300cbb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:54.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.900+0000 7feb3657d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb3015b630 con 0x7feb30141690 2023-06-10T18:53:54.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.900+0000 7feb3657d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb300c89c0 con 0x7feb3015b260 2023-06-10T18:53:54.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.900+0000 7feb3657d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb300ca340 con 0x7feb300c9e60 2023-06-10T18:53:54.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.900+0000 7feb27fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7feb30141690 0x7feb3006ad80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:32778/0 (socket says 172.21.15.53:32778) 2023-06-10T18:53:54.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.900+0000 7feb27fff640 1 -- 172.21.15.53:0/863546522 learned_addr learned my addr 172.21.15.53:0/863546522 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:53:54.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.900+0000 7feb34b1a640 1 --2- 172.21.15.53:0/863546522 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb300c9e60 0x7feb300cbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:54.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.900+0000 7feb2ffff640 1 --2- 172.21.15.53:0/863546522 >> v2:172.21.15.117:3300/0 conn(0x7feb3015b260 0x7feb3006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:54.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.900+0000 7feb2f7fe640 1 -- 172.21.15.53:0/863546522 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3439114528 0 0) 0x7feb3015b630 con 0x7feb30141690 2023-06-10T18:53:54.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.900+0000 7feb2f7fe640 1 -- 172.21.15.53:0/863546522 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb1c003530 con 0x7feb30141690 2023-06-10T18:53:54.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.900+0000 7feb2f7fe640 1 -- 172.21.15.53:0/863546522 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1642567198 0 0) 0x7feb1c003530 con 0x7feb30141690 2023-06-10T18:53:54.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.900+0000 7feb2f7fe640 1 -- 172.21.15.53:0/863546522 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb300c9e60 msgr2=0x7feb300cbb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:54.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.900+0000 7feb2f7fe640 1 --2- 172.21.15.53:0/863546522 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb300c9e60 0x7feb300cbb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:54.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.900+0000 7feb2f7fe640 1 -- 172.21.15.53:0/863546522 >> v2:172.21.15.117:3300/0 conn(0x7feb3015b260 msgr2=0x7feb3006a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:54.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.900+0000 7feb2f7fe640 1 --2- 172.21.15.53:0/863546522 >> v2:172.21.15.117:3300/0 conn(0x7feb3015b260 0x7feb3006a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:54.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.900+0000 7feb2f7fe640 1 -- 172.21.15.53:0/863546522 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb300c8400 con 0x7feb30141690 2023-06-10T18:53:54.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.900+0000 7feb2f7fe640 1 -- 172.21.15.53:0/863546522 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7feb20001680 con 0x7feb30141690 2023-06-10T18:53:54.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.900+0000 7feb2f7fe640 1 -- 172.21.15.53:0/863546522 >> v1:172.21.15.53:6789/0 conn(0x7feb30141690 legacy=0x7feb3006ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:54.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.900+0000 7feb2f7fe640 1 --2- 172.21.15.53:0/863546522 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb300c9e60 0x7feb1c003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:54.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.900+0000 7feb2f7fe640 1 --2- 172.21.15.53:0/863546522 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feb1c003f00 0x7feb1c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:54.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.900+0000 7feb2f7fe640 1 --2- 172.21.15.53:0/863546522 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb1c004d10 0x7feb1c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:54.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.900+0000 7feb2f7fe640 1 -- 172.21.15.53:0/863546522 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb300c89c0 con 0x7feb1c003f00 2023-06-10T18:53:54.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.900+0000 7feb2f7fe640 1 -- 172.21.15.53:0/863546522 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb300ca340 con 0x7feb1c004d10 2023-06-10T18:53:54.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.900+0000 7feb2f7fe640 1 -- 172.21.15.53:0/863546522 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb1c00b990 con 0x7feb300c9e60 2023-06-10T18:53:54.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.900+0000 7feb27fff640 1 --2- 172.21.15.53:0/863546522 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feb1c003f00 0x7feb1c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:54.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.900+0000 7feb2ffff640 1 --2- 172.21.15.53:0/863546522 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb300c9e60 0x7feb1c003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:54.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.900+0000 7feb34b1a640 1 --2- 172.21.15.53:0/863546522 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb1c004d10 0x7feb1c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:54.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.900+0000 7feb27fff640 1 -- 172.21.15.53:0/863546522 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb300c9e60 msgr2=0x7feb1c003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:54.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.900+0000 7feb27fff640 1 --2- 172.21.15.53:0/863546522 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb300c9e60 0x7feb1c003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:54.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.900+0000 7feb27fff640 1 -- 172.21.15.53:0/863546522 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb1c004d10 msgr2=0x7feb1c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:54.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.900+0000 7feb27fff640 1 --2- 172.21.15.53:0/863546522 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb1c004d10 0x7feb1c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:54.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.900+0000 7feb27fff640 1 -- 172.21.15.53:0/863546522 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb1c003530 con 0x7feb1c003f00 2023-06-10T18:53:54.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.900+0000 7feb2ffff640 1 --2- 172.21.15.53:0/863546522 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb300c9e60 0x7feb1c003980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:54.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.904+0000 7feb27fff640 1 --2- 172.21.15.53:0/863546522 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feb1c003f00 0x7feb1c0047d0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7feb2000c210 tx=0x7feb2001f390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1039a041adaa29ba server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:54.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.904+0000 7feb2f7fe640 1 -- 172.21.15.53:0/863546522 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb20005ae0 con 0x7feb1c003f00 2023-06-10T18:53:54.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.904+0000 7feb2f7fe640 1 -- 172.21.15.53:0/863546522 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb200ab070 con 0x7feb1c003f00 2023-06-10T18:53:54.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.904+0000 7feb2f7fe640 1 -- 172.21.15.53:0/863546522 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb20005e80 con 0x7feb1c003f00 2023-06-10T18:53:54.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.904+0000 7feb3657d640 1 -- 172.21.15.53:0/863546522 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feb1c003f00 msgr2=0x7feb1c0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:54.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.904+0000 7feb3657d640 1 --2- 172.21.15.53:0/863546522 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feb1c003f00 0x7feb1c0047d0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7feb2000c210 tx=0x7feb2001f390 comp rx=0 tx=0).stop 2023-06-10T18:53:54.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.904+0000 7feb34b1a640 1 -- 172.21.15.53:0/863546522 reap_dead start 2023-06-10T18:53:54.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.904+0000 7feb3657d640 1 -- 172.21.15.53:0/863546522 shutdown_connections 2023-06-10T18:53:54.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.904+0000 7feb3657d640 1 -- 172.21.15.53:0/863546522 >> 172.21.15.53:0/863546522 conn(0x7feb300cdca0 msgr2=0x7feb300ce0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:54.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.904+0000 7feb3657d640 1 -- 172.21.15.53:0/863546522 shutdown_connections 2023-06-10T18:53:54.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.904+0000 7feb3657d640 1 -- 172.21.15.53:0/863546522 wait complete. 2023-06-10T18:53:54.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.904+0000 7feb3657d640 1 Processor -- start 2023-06-10T18:53:54.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.904+0000 7feb3657d640 1 -- start start 2023-06-10T18:53:54.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.904+0000 7feb3657d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb1c003f00 0x7feb300c2770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:54.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.904+0000 7feb3657d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feb3015a0d0 0x7feb301408c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:54.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.904+0000 7feb3657d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb300ca620 0x7feb300caa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:54.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.904+0000 7feb3657d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb300cafd0 con 0x7feb3015a0d0 2023-06-10T18:53:54.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.904+0000 7feb3657d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb30140e00 con 0x7feb300ca620 2023-06-10T18:53:54.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.904+0000 7feb3657d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb300c2d50 con 0x7feb1c003f00 2023-06-10T18:53:54.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.904+0000 7feb27fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feb3015a0d0 0x7feb301408c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:54.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.904+0000 7feb27fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feb3015a0d0 0x7feb301408c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33672/0 (socket says 172.21.15.53:33672) 2023-06-10T18:53:54.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.904+0000 7feb27fff640 1 -- 172.21.15.53:0/3071239051 learned_addr learned my addr 172.21.15.53:0/3071239051 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:54.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.904+0000 7feb34b1a640 1 --2- 172.21.15.53:0/3071239051 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb300ca620 0x7feb300caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:54.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.904+0000 7feb27fff640 1 -- 172.21.15.53:0/3071239051 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb1c003f00 msgr2=0x7feb300c2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:54.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.904+0000 7feb2ffff640 1 --2- 172.21.15.53:0/3071239051 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb1c003f00 0x7feb300c2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:54.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.904+0000 7feb27fff640 1 --2- 172.21.15.53:0/3071239051 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb1c003f00 0x7feb300c2770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:54.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.904+0000 7feb27fff640 1 -- 172.21.15.53:0/3071239051 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb300ca620 msgr2=0x7feb300caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:54.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.904+0000 7feb27fff640 1 --2- 172.21.15.53:0/3071239051 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb300ca620 0x7feb300caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:54.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.904+0000 7feb27fff640 1 -- 172.21.15.53:0/3071239051 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb300c3030 con 0x7feb3015a0d0 2023-06-10T18:53:54.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.904+0000 7feb34b1a640 1 --2- 172.21.15.53:0/3071239051 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb300ca620 0x7feb300caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:54.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.904+0000 7feb27fff640 1 --2- 172.21.15.53:0/3071239051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feb3015a0d0 0x7feb301408c0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7feb2001f1c0 tx=0x7feb1c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:54.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.904+0000 7feb2d7fa640 1 -- 172.21.15.53:0/3071239051 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb200049f0 con 0x7feb3015a0d0 2023-06-10T18:53:54.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.904+0000 7feb2d7fa640 1 -- 172.21.15.53:0/3071239051 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb20004b70 con 0x7feb3015a0d0 2023-06-10T18:53:54.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.904+0000 7feb3657d640 1 -- 172.21.15.53:0/3071239051 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb300c3310 con 0x7feb3015a0d0 2023-06-10T18:53:54.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.904+0000 7feb2d7fa640 1 -- 172.21.15.53:0/3071239051 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb20007070 con 0x7feb3015a0d0 2023-06-10T18:53:54.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.908+0000 7feb3657d640 1 -- 172.21.15.53:0/3071239051 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb3015a540 con 0x7feb3015a0d0 2023-06-10T18:53:54.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.908+0000 7feb3657d640 1 -- 172.21.15.53:0/3071239051 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb3013dee0 con 0x7feb3015a0d0 2023-06-10T18:53:54.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.908+0000 7feb2d7fa640 1 -- 172.21.15.53:0/3071239051 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7feb200071d0 con 0x7feb3015a0d0 2023-06-10T18:53:54.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.908+0000 7feb2d7fa640 1 --2- 172.21.15.53:0/3071239051 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7feb100662b0 0x7feb10068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:54.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.908+0000 7feb2d7fa640 1 -- 172.21.15.53:0/3071239051 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7feb200b7040 con 0x7feb3015a0d0 2023-06-10T18:53:54.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.908+0000 7feb2ffff640 1 --2- 172.21.15.53:0/3071239051 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7feb100662b0 0x7feb10068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:54.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.908+0000 7feb2ffff640 1 --2- 172.21.15.53:0/3071239051 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7feb100662b0 0x7feb10068760 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7feb18009a60 tx=0x7feb18008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:54.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:54.912+0000 7feb2d7fa640 1 -- 172.21.15.53:0/3071239051 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7feb3013dee0 con 0x7feb3015a0d0 2023-06-10T18:53:55.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.064+0000 7feb3657d640 1 -- 172.21.15.53:0/3071239051 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feb3013dee0 con 0x7feb3015a0d0 2023-06-10T18:53:55.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.064+0000 7feb2d7fa640 1 -- 172.21.15.53:0/3071239051 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+18352 (secure 0 0 0) 0x7feb3013dee0 con 0x7feb3015a0d0 2023-06-10T18:53:55.074 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:53:55.075 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":36,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T18:53:54.734709+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-06-10T18:53:52.688764+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-06-10T18:53:53.727157+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T18:53:55.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.068+0000 7feb3657d640 1 -- 172.21.15.53:0/3071239051 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7feb100662b0 msgr2=0x7feb10068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:55.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.068+0000 7feb3657d640 1 --2- 172.21.15.53:0/3071239051 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7feb100662b0 0x7feb10068760 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7feb18009a60 tx=0x7feb18008040 comp rx=0 tx=0).stop 2023-06-10T18:53:55.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.068+0000 7feb3657d640 1 -- 172.21.15.53:0/3071239051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feb3015a0d0 msgr2=0x7feb301408c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:55.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.068+0000 7feb3657d640 1 --2- 172.21.15.53:0/3071239051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feb3015a0d0 0x7feb301408c0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7feb2001f1c0 tx=0x7feb1c005800 comp rx=0 tx=0).stop 2023-06-10T18:53:55.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.068+0000 7feb3657d640 1 -- 172.21.15.53:0/3071239051 shutdown_connections 2023-06-10T18:53:55.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.068+0000 7feb3657d640 1 --2- 172.21.15.53:0/3071239051 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7feb100662b0 0x7feb10068760 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:55.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.068+0000 7feb3657d640 1 --2- 172.21.15.53:0/3071239051 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb300ca620 0x7feb300caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:55.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.068+0000 7feb3657d640 1 --2- 172.21.15.53:0/3071239051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feb3015a0d0 0x7feb301408c0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:55.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.068+0000 7feb3657d640 1 --2- 172.21.15.53:0/3071239051 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb1c003f00 0x7feb300c2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:55.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.068+0000 7feb3657d640 1 -- 172.21.15.53:0/3071239051 >> 172.21.15.53:0/3071239051 conn(0x7feb300cdca0 msgr2=0x7feb300c6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:55.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.068+0000 7feb3657d640 1 -- 172.21.15.53:0/3071239051 shutdown_connections 2023-06-10T18:53:55.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.068+0000 7feb3657d640 1 -- 172.21.15.53:0/3071239051 wait complete. 2023-06-10T18:53:55.092 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T18:53:55.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.192+0000 7f7a38c65640 1 Processor -- start 2023-06-10T18:53:55.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.192+0000 7f7a38c65640 1 -- start start 2023-06-10T18:53:55.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.196+0000 7f7a38c65640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a340b3ac0 0x7f7a340b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:55.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.196+0000 7f7a38c65640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7a340d14c0 0x7f7a3415fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:55.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.196+0000 7f7a38c65640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a340d0020 con 0x7f7a340cc690 2023-06-10T18:53:55.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.196+0000 7f7a38c65640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a340b43d0 con 0x7f7a340d14c0 2023-06-10T18:53:55.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.196+0000 7f7a38c65640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a340cef40 con 0x7f7a340b3ac0 2023-06-10T18:53:55.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.196+0000 7f7a31d9b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f7a340cc690 0x7f7a3415f370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:32782/0 (socket says 172.21.15.53:32782) 2023-06-10T18:53:55.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.196+0000 7f7a31d9b640 1 -- 172.21.15.53:0/961486130 learned_addr learned my addr 172.21.15.53:0/961486130 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:53:55.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.196+0000 7f7a3259c640 1 --2- 172.21.15.53:0/961486130 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a340b3ac0 0x7f7a340b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:55.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.196+0000 7f7a3159a640 1 -- 172.21.15.53:0/961486130 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3549028379 0 0) 0x7f7a340d0020 con 0x7f7a340cc690 2023-06-10T18:53:55.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.196+0000 7f7a3159a640 1 -- 172.21.15.53:0/961486130 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a1c003530 con 0x7f7a340cc690 2023-06-10T18:53:55.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.196+0000 7f7a32d9d640 1 --2- 172.21.15.53:0/961486130 >> v2:172.21.15.117:3300/0 conn(0x7f7a340d14c0 0x7f7a3415fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:55.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.196+0000 7f7a3159a640 1 -- 172.21.15.53:0/961486130 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 557610609 0 0) 0x7f7a1c003530 con 0x7f7a340cc690 2023-06-10T18:53:55.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.196+0000 7f7a3159a640 1 -- 172.21.15.53:0/961486130 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a340b3ac0 msgr2=0x7f7a340b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:55.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.196+0000 7f7a3159a640 1 --2- 172.21.15.53:0/961486130 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a340b3ac0 0x7f7a340b3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:55.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.196+0000 7f7a3159a640 1 -- 172.21.15.53:0/961486130 >> v2:172.21.15.117:3300/0 conn(0x7f7a340d14c0 msgr2=0x7f7a3415fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:55.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.196+0000 7f7a3159a640 1 --2- 172.21.15.53:0/961486130 >> v2:172.21.15.117:3300/0 conn(0x7f7a340d14c0 0x7f7a3415fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:55.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.196+0000 7f7a3159a640 1 -- 172.21.15.53:0/961486130 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a340cf220 con 0x7f7a340cc690 2023-06-10T18:53:55.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.196+0000 7f7a3159a640 1 -- 172.21.15.53:0/961486130 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f7a28001680 con 0x7f7a340cc690 2023-06-10T18:53:55.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.196+0000 7f7a32d9d640 1 --2- 172.21.15.53:0/961486130 >> v2:172.21.15.117:3300/0 conn(0x7f7a340d14c0 0x7f7a3415fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:53:55.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.196+0000 7f7a3159a640 1 -- 172.21.15.53:0/961486130 >> v1:172.21.15.53:6789/0 conn(0x7f7a340cc690 legacy=0x7f7a3415f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:55.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.196+0000 7f7a3159a640 1 --2- 172.21.15.53:0/961486130 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a1c0039f0 0x7f7a1c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:55.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.196+0000 7f7a3159a640 1 --2- 172.21.15.53:0/961486130 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a1c0047d0 0x7f7a1c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:55.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.196+0000 7f7a3159a640 1 --2- 172.21.15.53:0/961486130 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a340b3ac0 0x7f7a1c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:55.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.196+0000 7f7a3159a640 1 -- 172.21.15.53:0/961486130 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a340b43d0 con 0x7f7a1c0039f0 2023-06-10T18:53:55.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.196+0000 7f7a3159a640 1 -- 172.21.15.53:0/961486130 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a340cef40 con 0x7f7a1c0047d0 2023-06-10T18:53:55.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.196+0000 7f7a3159a640 1 -- 172.21.15.53:0/961486130 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1c00b9e0 con 0x7f7a340b3ac0 2023-06-10T18:53:55.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.196+0000 7f7a3259c640 1 --2- 172.21.15.53:0/961486130 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a1c0039f0 0x7f7a1c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:55.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.196+0000 7f7a31d9b640 1 --2- 172.21.15.53:0/961486130 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a1c0047d0 0x7f7a1c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:55.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.196+0000 7f7a32d9d640 1 --2- 172.21.15.53:0/961486130 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a340b3ac0 0x7f7a1c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:55.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.196+0000 7f7a3259c640 1 -- 172.21.15.53:0/961486130 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a340b3ac0 msgr2=0x7f7a1c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:55.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.196+0000 7f7a3259c640 1 --2- 172.21.15.53:0/961486130 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a340b3ac0 0x7f7a1c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:55.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.196+0000 7f7a3259c640 1 -- 172.21.15.53:0/961486130 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a1c0047d0 msgr2=0x7f7a1c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:55.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.196+0000 7f7a3259c640 1 --2- 172.21.15.53:0/961486130 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a1c0047d0 0x7f7a1c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:55.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.196+0000 7f7a3259c640 1 -- 172.21.15.53:0/961486130 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a1c003530 con 0x7f7a1c0039f0 2023-06-10T18:53:55.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.196+0000 7f7a32d9d640 1 --2- 172.21.15.53:0/961486130 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a340b3ac0 0x7f7a1c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:55.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.200+0000 7f7a3259c640 1 --2- 172.21.15.53:0/961486130 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a1c0039f0 0x7f7a1c003e00 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f7a24009b10 tx=0x7f7a2401ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23ddcb39dd1bd335 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:55.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.200+0000 7f7a3159a640 1 -- 172.21.15.53:0/961486130 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a240a6510 con 0x7f7a1c0039f0 2023-06-10T18:53:55.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.200+0000 7f7a3159a640 1 -- 172.21.15.53:0/961486130 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a240a6670 con 0x7f7a1c0039f0 2023-06-10T18:53:55.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.200+0000 7f7a3159a640 1 -- 172.21.15.53:0/961486130 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a240a6a20 con 0x7f7a1c0039f0 2023-06-10T18:53:55.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.200+0000 7f7a38c65640 1 -- 172.21.15.53:0/961486130 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a1c0039f0 msgr2=0x7f7a1c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:55.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.200+0000 7f7a38c65640 1 --2- 172.21.15.53:0/961486130 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a1c0039f0 0x7f7a1c003e00 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f7a24009b10 tx=0x7f7a2401ca20 comp rx=0 tx=0).stop 2023-06-10T18:53:55.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.200+0000 7f7a32d9d640 1 -- 172.21.15.53:0/961486130 reap_dead start 2023-06-10T18:53:55.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.200+0000 7f7a38c65640 1 -- 172.21.15.53:0/961486130 shutdown_connections 2023-06-10T18:53:55.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.200+0000 7f7a38c65640 1 -- 172.21.15.53:0/961486130 >> 172.21.15.53:0/961486130 conn(0x7f7a34071790 msgr2=0x7f7a34069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:55.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.200+0000 7f7a38c65640 1 -- 172.21.15.53:0/961486130 shutdown_connections 2023-06-10T18:53:55.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.200+0000 7f7a38c65640 1 -- 172.21.15.53:0/961486130 wait complete. 2023-06-10T18:53:55.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.200+0000 7f7a38c65640 1 Processor -- start 2023-06-10T18:53:55.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.200+0000 7f7a38c65640 1 -- start start 2023-06-10T18:53:55.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.200+0000 7f7a38c65640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a1c0039f0 0x7f7a34164a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:55.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.200+0000 7f7a38c65640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a3414a030 0x7f7a3414a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:55.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.200+0000 7f7a38c65640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a34162920 0x7f7a34162d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:55.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.200+0000 7f7a38c65640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a340c9af0 con 0x7f7a1c0039f0 2023-06-10T18:53:55.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.200+0000 7f7a38c65640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a3414a9e0 con 0x7f7a3414a030 2023-06-10T18:53:55.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.200+0000 7f7a38c65640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a34164210 con 0x7f7a34162920 2023-06-10T18:53:55.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.200+0000 7f7a3259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a1c0039f0 0x7f7a34164a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:55.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.200+0000 7f7a3259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a1c0039f0 0x7f7a34164a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33698/0 (socket says 172.21.15.53:33698) 2023-06-10T18:53:55.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.200+0000 7f7a3259c640 1 -- 172.21.15.53:0/1049373007 learned_addr learned my addr 172.21.15.53:0/1049373007 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:55.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.200+0000 7f7a32d9d640 1 --2- 172.21.15.53:0/1049373007 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a34162920 0x7f7a34162d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:55.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.204+0000 7f7a31d9b640 1 --2- 172.21.15.53:0/1049373007 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a3414a030 0x7f7a3414a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:55.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.204+0000 7f7a3259c640 1 -- 172.21.15.53:0/1049373007 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a34162920 msgr2=0x7f7a34162d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:55.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.204+0000 7f7a3259c640 1 --2- 172.21.15.53:0/1049373007 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a34162920 0x7f7a34162d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:55.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.204+0000 7f7a3259c640 1 -- 172.21.15.53:0/1049373007 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a3414a030 msgr2=0x7f7a3414a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:55.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.204+0000 7f7a3259c640 1 --2- 172.21.15.53:0/1049373007 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a3414a030 0x7f7a3414a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:55.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.204+0000 7f7a3259c640 1 -- 172.21.15.53:0/1049373007 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a34163690 con 0x7f7a1c0039f0 2023-06-10T18:53:55.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.204+0000 7f7a3259c640 1 --2- 172.21.15.53:0/1049373007 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a1c0039f0 0x7f7a34164a90 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f7a240b0040 tx=0x7f7a1c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:55.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.204+0000 7f7a22ffd640 1 -- 172.21.15.53:0/1049373007 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a240be070 con 0x7f7a1c0039f0 2023-06-10T18:53:55.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.204+0000 7f7a22ffd640 1 -- 172.21.15.53:0/1049373007 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a2400f000 con 0x7f7a1c0039f0 2023-06-10T18:53:55.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.204+0000 7f7a38c65640 1 -- 172.21.15.53:0/1049373007 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a34163970 con 0x7f7a1c0039f0 2023-06-10T18:53:55.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.204+0000 7f7a22ffd640 1 -- 172.21.15.53:0/1049373007 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a24004020 con 0x7f7a1c0039f0 2023-06-10T18:53:55.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.204+0000 7f7a38c65640 1 -- 172.21.15.53:0/1049373007 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a34163f30 con 0x7f7a1c0039f0 2023-06-10T18:53:55.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.204+0000 7f7a38c65640 1 -- 172.21.15.53:0/1049373007 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a3404d790 con 0x7f7a1c0039f0 2023-06-10T18:53:55.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.204+0000 7f7a22ffd640 1 -- 172.21.15.53:0/1049373007 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7a24004180 con 0x7f7a1c0039f0 2023-06-10T18:53:55.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.204+0000 7f7a22ffd640 1 --2- 172.21.15.53:0/1049373007 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7a140662b0 0x7f7a14068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:55.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.204+0000 7f7a22ffd640 1 -- 172.21.15.53:0/1049373007 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7a240aa070 con 0x7f7a1c0039f0 2023-06-10T18:53:55.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.204+0000 7f7a31d9b640 1 --2- 172.21.15.53:0/1049373007 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7a140662b0 0x7f7a14068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:55.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.204+0000 7f7a31d9b640 1 --2- 172.21.15.53:0/1049373007 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7a140662b0 0x7f7a14068760 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7a28000fc0 tx=0x7f7a28009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:55.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.208+0000 7f7a22ffd640 1 -- 172.21.15.53:0/1049373007 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7a240eb7c0 con 0x7f7a1c0039f0 2023-06-10T18:53:55.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.356+0000 7f7a38c65640 1 -- 172.21.15.53:0/1049373007 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7a340ce8f0 con 0x7f7a1c0039f0 2023-06-10T18:53:55.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.360+0000 7f7a22ffd640 1 -- 172.21.15.53:0/1049373007 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+18352 (secure 0 0 0) 0x7f7a240eede0 con 0x7f7a1c0039f0 2023-06-10T18:53:55.368 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:53:55.369 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":36,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T18:53:54.734709+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-06-10T18:53:52.688764+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-06-10T18:53:53.727157+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T18:53:55.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.360+0000 7f7a38c65640 1 -- 172.21.15.53:0/1049373007 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7a140662b0 msgr2=0x7f7a14068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:55.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.360+0000 7f7a38c65640 1 --2- 172.21.15.53:0/1049373007 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7a140662b0 0x7f7a14068760 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7a28000fc0 tx=0x7f7a28009040 comp rx=0 tx=0).stop 2023-06-10T18:53:55.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.360+0000 7f7a38c65640 1 -- 172.21.15.53:0/1049373007 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a1c0039f0 msgr2=0x7f7a34164a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:55.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.360+0000 7f7a38c65640 1 --2- 172.21.15.53:0/1049373007 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a1c0039f0 0x7f7a34164a90 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f7a240b0040 tx=0x7f7a1c005800 comp rx=0 tx=0).stop 2023-06-10T18:53:55.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.360+0000 7f7a38c65640 1 -- 172.21.15.53:0/1049373007 shutdown_connections 2023-06-10T18:53:55.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.360+0000 7f7a38c65640 1 --2- 172.21.15.53:0/1049373007 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7a140662b0 0x7f7a14068760 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:55.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.360+0000 7f7a38c65640 1 --2- 172.21.15.53:0/1049373007 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a34162920 0x7f7a34162d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:55.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.360+0000 7f7a38c65640 1 --2- 172.21.15.53:0/1049373007 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a3414a030 0x7f7a3414a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:55.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.360+0000 7f7a38c65640 1 --2- 172.21.15.53:0/1049373007 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a1c0039f0 0x7f7a34164a90 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:55.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.360+0000 7f7a38c65640 1 -- 172.21.15.53:0/1049373007 >> 172.21.15.53:0/1049373007 conn(0x7f7a34071790 msgr2=0x7f7a340b3340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:55.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.360+0000 7f7a38c65640 1 -- 172.21.15.53:0/1049373007 shutdown_connections 2023-06-10T18:53:55.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.360+0000 7f7a38c65640 1 -- 172.21.15.53:0/1049373007 wait complete. 2023-06-10T18:53:55.386 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-06-10T18:53:55.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.492+0000 7fc547d70640 1 Processor -- start 2023-06-10T18:53:55.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.492+0000 7fc547d70640 1 -- start start 2023-06-10T18:53:55.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.492+0000 7fc547d70640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc54015bab0 0x7fc5400cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:55.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.492+0000 7fc547d70640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc5400cc120 0x7fc5400cc570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:55.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.492+0000 7fc547d70640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5400ccab0 con 0x7fc54015f6b0 2023-06-10T18:53:55.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.492+0000 7fc547d70640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5400ca160 con 0x7fc5400cc120 2023-06-10T18:53:55.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.492+0000 7fc547d70640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc54006a390 con 0x7fc54015bab0 2023-06-10T18:53:55.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.492+0000 7fc54630d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fc54015f6b0 0x7fc54015fb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:32790/0 (socket says 172.21.15.53:32790) 2023-06-10T18:53:55.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.492+0000 7fc54630d640 1 -- 172.21.15.53:0/3052757381 learned_addr learned my addr 172.21.15.53:0/3052757381 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:53:55.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.492+0000 7fc545b0c640 1 --2- 172.21.15.53:0/3052757381 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc54015bab0 0x7fc5400cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:55.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.492+0000 7fc54530b640 1 --2- 172.21.15.53:0/3052757381 >> v2:172.21.15.117:3300/0 conn(0x7fc5400cc120 0x7fc5400cc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:55.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.492+0000 7fc544b0a640 1 -- 172.21.15.53:0/3052757381 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2816921507 0 0) 0x7fc5380014a0 con 0x7fc54015f6b0 2023-06-10T18:53:55.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.492+0000 7fc544b0a640 1 -- 172.21.15.53:0/3052757381 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc52c003530 con 0x7fc54015f6b0 2023-06-10T18:53:55.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.492+0000 7fc544b0a640 1 -- 172.21.15.53:0/3052757381 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 171300159 0 0) 0x7fc52c003530 con 0x7fc54015f6b0 2023-06-10T18:53:55.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.492+0000 7fc544b0a640 1 -- 172.21.15.53:0/3052757381 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc54015bab0 msgr2=0x7fc5400cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:55.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.492+0000 7fc544b0a640 1 --2- 172.21.15.53:0/3052757381 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc54015bab0 0x7fc5400cdde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:55.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.492+0000 7fc544b0a640 1 -- 172.21.15.53:0/3052757381 >> v2:172.21.15.117:3300/0 conn(0x7fc5400cc120 msgr2=0x7fc5400cc570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:55.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.492+0000 7fc544b0a640 1 --2- 172.21.15.53:0/3052757381 >> v2:172.21.15.117:3300/0 conn(0x7fc5400cc120 0x7fc5400cc570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:55.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.492+0000 7fc544b0a640 1 -- 172.21.15.53:0/3052757381 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5400ce320 con 0x7fc54015f6b0 2023-06-10T18:53:55.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.492+0000 7fc544b0a640 1 -- 172.21.15.53:0/3052757381 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fc538001b90 con 0x7fc54015f6b0 2023-06-10T18:53:55.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.492+0000 7fc544b0a640 1 -- 172.21.15.53:0/3052757381 >> v1:172.21.15.53:6789/0 conn(0x7fc54015f6b0 legacy=0x7fc54015fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:55.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.492+0000 7fc544b0a640 1 --2- 172.21.15.53:0/3052757381 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc54015bab0 0x7fc52c003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:55.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.492+0000 7fc544b0a640 1 --2- 172.21.15.53:0/3052757381 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc52c003f00 0x7fc52c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:55.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.492+0000 7fc544b0a640 1 --2- 172.21.15.53:0/3052757381 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc52c004d10 0x7fc52c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:55.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.492+0000 7fc544b0a640 1 -- 172.21.15.53:0/3052757381 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5400ca160 con 0x7fc52c004d10 2023-06-10T18:53:55.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.492+0000 7fc544b0a640 1 -- 172.21.15.53:0/3052757381 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc54006a390 con 0x7fc52c003f00 2023-06-10T18:53:55.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.492+0000 7fc544b0a640 1 -- 172.21.15.53:0/3052757381 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc52c00b990 con 0x7fc54015bab0 2023-06-10T18:53:55.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.492+0000 7fc54630d640 1 --2- 172.21.15.53:0/3052757381 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc52c004d10 0x7fc52c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:55.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.492+0000 7fc545b0c640 1 --2- 172.21.15.53:0/3052757381 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc54015bab0 0x7fc52c003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:55.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.492+0000 7fc54630d640 1 -- 172.21.15.53:0/3052757381 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc54015bab0 msgr2=0x7fc52c003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:55.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.492+0000 7fc54530b640 1 --2- 172.21.15.53:0/3052757381 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc52c003f00 0x7fc52c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:55.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.492+0000 7fc54630d640 1 --2- 172.21.15.53:0/3052757381 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc54015bab0 0x7fc52c003980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:55.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.492+0000 7fc54630d640 1 -- 172.21.15.53:0/3052757381 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc52c003f00 msgr2=0x7fc52c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:55.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.492+0000 7fc54630d640 1 --2- 172.21.15.53:0/3052757381 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc52c003f00 0x7fc52c0047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:55.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.492+0000 7fc54630d640 1 -- 172.21.15.53:0/3052757381 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc52c003530 con 0x7fc52c004d10 2023-06-10T18:53:55.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.496+0000 7fc54630d640 1 --2- 172.21.15.53:0/3052757381 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc52c004d10 0x7fc52c005180 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fc53800a830 tx=0x7fc53801d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2c7bea8c4500a5e server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:55.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.496+0000 7fc544b0a640 1 -- 172.21.15.53:0/3052757381 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5380ad630 con 0x7fc52c004d10 2023-06-10T18:53:55.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.496+0000 7fc544b0a640 1 -- 172.21.15.53:0/3052757381 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5380a8070 con 0x7fc52c004d10 2023-06-10T18:53:55.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.496+0000 7fc544b0a640 1 -- 172.21.15.53:0/3052757381 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5380ad9d0 con 0x7fc52c004d10 2023-06-10T18:53:55.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.496+0000 7fc547d70640 1 -- 172.21.15.53:0/3052757381 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc52c004d10 msgr2=0x7fc52c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:55.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.496+0000 7fc547d70640 1 --2- 172.21.15.53:0/3052757381 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc52c004d10 0x7fc52c005180 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fc53800a830 tx=0x7fc53801d340 comp rx=0 tx=0).stop 2023-06-10T18:53:55.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.496+0000 7fc54630d640 1 -- 172.21.15.53:0/3052757381 reap_dead start 2023-06-10T18:53:55.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.496+0000 7fc547d70640 1 -- 172.21.15.53:0/3052757381 shutdown_connections 2023-06-10T18:53:55.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.496+0000 7fc547d70640 1 -- 172.21.15.53:0/3052757381 >> 172.21.15.53:0/3052757381 conn(0x7fc5400b00a0 msgr2=0x7fc5400b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:55.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.496+0000 7fc547d70640 1 -- 172.21.15.53:0/3052757381 shutdown_connections 2023-06-10T18:53:55.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.496+0000 7fc547d70640 1 -- 172.21.15.53:0/3052757381 wait complete. 2023-06-10T18:53:55.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.496+0000 7fc547d70640 1 Processor -- start 2023-06-10T18:53:55.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.496+0000 7fc547d70640 1 -- start start 2023-06-10T18:53:55.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.496+0000 7fc547d70640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc5400c4a00 0x7fc5401f19e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:55.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.496+0000 7fc547d70640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc5400c4dd0 0x7fc5401f57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:55.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.496+0000 7fc547d70640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5401591b0 0x7fc54006f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:55.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.496+0000 7fc547d70640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc540157190 con 0x7fc5400c4dd0 2023-06-10T18:53:55.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.496+0000 7fc547d70640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5401f5320 con 0x7fc5401591b0 2023-06-10T18:53:55.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.496+0000 7fc547d70640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5401f4fd0 con 0x7fc5400c4a00 2023-06-10T18:53:55.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.500+0000 7fc54530b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc5400c4dd0 0x7fc5401f57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:55.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.500+0000 7fc54530b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc5400c4dd0 0x7fc5401f57b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33708/0 (socket says 172.21.15.53:33708) 2023-06-10T18:53:55.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.500+0000 7fc54530b640 1 -- 172.21.15.53:0/305183767 learned_addr learned my addr 172.21.15.53:0/305183767 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:55.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.500+0000 7fc54630d640 1 --2- 172.21.15.53:0/305183767 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5401591b0 0x7fc54006f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:55.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.500+0000 7fc545b0c640 1 --2- 172.21.15.53:0/305183767 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc5400c4a00 0x7fc5401f19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:55.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.500+0000 7fc54530b640 1 -- 172.21.15.53:0/305183767 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc5400c4a00 msgr2=0x7fc5401f19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:55.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.500+0000 7fc54530b640 1 --2- 172.21.15.53:0/305183767 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc5400c4a00 0x7fc5401f19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:55.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.500+0000 7fc54530b640 1 -- 172.21.15.53:0/305183767 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5401591b0 msgr2=0x7fc54006f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:55.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.500+0000 7fc54530b640 1 --2- 172.21.15.53:0/305183767 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5401591b0 0x7fc54006f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:55.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.500+0000 7fc54530b640 1 -- 172.21.15.53:0/305183767 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5401f2230 con 0x7fc5400c4dd0 2023-06-10T18:53:55.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.500+0000 7fc545b0c640 1 --2- 172.21.15.53:0/305183767 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc5400c4a00 0x7fc5401f19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:55.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.500+0000 7fc54530b640 1 --2- 172.21.15.53:0/305183767 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc5400c4dd0 0x7fc5401f57b0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fc530010890 tx=0x7fc530010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:55.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.500+0000 7fc5367fc640 1 -- 172.21.15.53:0/305183767 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc530009530 con 0x7fc5400c4dd0 2023-06-10T18:53:55.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.500+0000 7fc5367fc640 1 -- 172.21.15.53:0/305183767 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc53000eb60 con 0x7fc5400c4dd0 2023-06-10T18:53:55.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.500+0000 7fc5367fc640 1 -- 172.21.15.53:0/305183767 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc53001c400 con 0x7fc5400c4dd0 2023-06-10T18:53:55.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.500+0000 7fc547d70640 1 -- 172.21.15.53:0/305183767 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5401f2510 con 0x7fc5400c4dd0 2023-06-10T18:53:55.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.500+0000 7fc547d70640 1 -- 172.21.15.53:0/305183767 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5401f1f20 con 0x7fc5400c4dd0 2023-06-10T18:53:55.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.500+0000 7fc547d70640 1 -- 172.21.15.53:0/305183767 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5401f5490 con 0x7fc5400c4dd0 2023-06-10T18:53:55.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.500+0000 7fc5367fc640 1 -- 172.21.15.53:0/305183767 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc53001c560 con 0x7fc5400c4dd0 2023-06-10T18:53:55.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.500+0000 7fc5367fc640 1 --2- 172.21.15.53:0/305183767 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc5240662b0 0x7fc524068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:55.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.500+0000 7fc5367fc640 1 -- 172.21.15.53:0/305183767 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc530084230 con 0x7fc5400c4dd0 2023-06-10T18:53:55.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.500+0000 7fc545b0c640 1 --2- 172.21.15.53:0/305183767 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc5240662b0 0x7fc524068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:55.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.500+0000 7fc545b0c640 1 --2- 172.21.15.53:0/305183767 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc5240662b0 0x7fc524068760 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc5400b3a80 tx=0x7fc53c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:55.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.504+0000 7fc5367fc640 1 -- 172.21.15.53:0/305183767 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc530051760 con 0x7fc5400c4dd0 2023-06-10T18:53:55.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.692+0000 7fc547d70640 1 -- 172.21.15.53:0/305183767 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fc54004d790 con 0x7fc5400c4dd0 2023-06-10T18:53:55.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.740+0000 7fc5367fc640 1 -- 172.21.15.53:0/305183767 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v12) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc530054d80 con 0x7fc5400c4dd0 2023-06-10T18:53:55.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.744+0000 7fc547d70640 1 -- 172.21.15.53:0/305183767 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc5240662b0 msgr2=0x7fc524068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:55.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.744+0000 7fc547d70640 1 --2- 172.21.15.53:0/305183767 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc5240662b0 0x7fc524068760 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc5400b3a80 tx=0x7fc53c008040 comp rx=0 tx=0).stop 2023-06-10T18:53:55.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.744+0000 7fc547d70640 1 -- 172.21.15.53:0/305183767 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc5400c4dd0 msgr2=0x7fc5401f57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:55.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.744+0000 7fc547d70640 1 --2- 172.21.15.53:0/305183767 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc5400c4dd0 0x7fc5401f57b0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fc530010890 tx=0x7fc530010d50 comp rx=0 tx=0).stop 2023-06-10T18:53:55.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.744+0000 7fc547d70640 1 -- 172.21.15.53:0/305183767 shutdown_connections 2023-06-10T18:53:55.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.744+0000 7fc547d70640 1 --2- 172.21.15.53:0/305183767 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc5240662b0 0x7fc524068760 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:55.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.744+0000 7fc547d70640 1 --2- 172.21.15.53:0/305183767 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5401591b0 0x7fc54006f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:55.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.744+0000 7fc547d70640 1 --2- 172.21.15.53:0/305183767 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc5400c4dd0 0x7fc5401f57b0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:55.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.744+0000 7fc547d70640 1 --2- 172.21.15.53:0/305183767 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc5400c4a00 0x7fc5401f19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:55.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.744+0000 7fc547d70640 1 -- 172.21.15.53:0/305183767 >> 172.21.15.53:0/305183767 conn(0x7fc5400b00a0 msgr2=0x7fc5400b13a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:55.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.744+0000 7fc547d70640 1 -- 172.21.15.53:0/305183767 shutdown_connections 2023-06-10T18:53:55.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.744+0000 7fc547d70640 1 -- 172.21.15.53:0/305183767 wait complete. 2023-06-10T18:53:55.771 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-06-10T18:53:55.772 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-06-10T18:53:55.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.892+0000 7fc0adbc4640 1 Processor -- start 2023-06-10T18:53:55.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.892+0000 7fc0adbc4640 1 -- start start 2023-06-10T18:53:55.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.892+0000 7fc0adbc4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0a8156180 0x7fc0a80cd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:55.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.892+0000 7fc0adbc4640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc0a815c4c0 0x7fc0a8159190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:55.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.892+0000 7fc0adbc4640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0a806b090 con 0x7fc0a815c070 2023-06-10T18:53:55.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.892+0000 7fc0adbc4640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0a806efa0 con 0x7fc0a815c4c0 2023-06-10T18:53:55.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.892+0000 7fc0adbc4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a80cc720 con 0x7fc0a8156180 2023-06-10T18:53:55.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.892+0000 7fc09ffff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fc0a815c070 0x7fc0a8158a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:32794/0 (socket says 172.21.15.53:32794) 2023-06-10T18:53:55.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.892+0000 7fc09ffff640 1 -- 172.21.15.53:0/3470011527 learned_addr learned my addr 172.21.15.53:0/3470011527 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:53:55.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.892+0000 7fc0a77fe640 1 --2- 172.21.15.53:0/3470011527 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0a8156180 0x7fc0a80cd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:55.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.892+0000 7fc0a7fff640 1 --2- 172.21.15.53:0/3470011527 >> v2:172.21.15.117:3300/0 conn(0x7fc0a815c4c0 0x7fc0a8159190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:55.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.892+0000 7fc0a6ffd640 1 -- 172.21.15.53:0/3470011527 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4057736202 0 0) 0x7fc0a806b090 con 0x7fc0a815c070 2023-06-10T18:53:55.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.892+0000 7fc0a6ffd640 1 -- 172.21.15.53:0/3470011527 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc094003530 con 0x7fc0a815c070 2023-06-10T18:53:55.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.892+0000 7fc0a6ffd640 1 -- 172.21.15.53:0/3470011527 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3864487298 0 0) 0x7fc094003530 con 0x7fc0a815c070 2023-06-10T18:53:55.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.892+0000 7fc0a6ffd640 1 -- 172.21.15.53:0/3470011527 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0a8156180 msgr2=0x7fc0a80cd4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:55.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.892+0000 7fc0a6ffd640 1 --2- 172.21.15.53:0/3470011527 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0a8156180 0x7fc0a80cd4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:55.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.892+0000 7fc0a6ffd640 1 -- 172.21.15.53:0/3470011527 >> v2:172.21.15.117:3300/0 conn(0x7fc0a815c4c0 msgr2=0x7fc0a8159190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:55.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.892+0000 7fc0a6ffd640 1 --2- 172.21.15.53:0/3470011527 >> v2:172.21.15.117:3300/0 conn(0x7fc0a815c4c0 0x7fc0a8159190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:55.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.892+0000 7fc0a6ffd640 1 -- 172.21.15.53:0/3470011527 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a80cc9a0 con 0x7fc0a815c070 2023-06-10T18:53:55.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.892+0000 7fc0a6ffd640 1 -- 172.21.15.53:0/3470011527 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fc090001680 con 0x7fc0a815c070 2023-06-10T18:53:55.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.892+0000 7fc0a6ffd640 1 -- 172.21.15.53:0/3470011527 >> v1:172.21.15.53:6789/0 conn(0x7fc0a815c070 legacy=0x7fc0a8158a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:55.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.892+0000 7fc0a6ffd640 1 --2- 172.21.15.53:0/3470011527 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc094003980 0x7fc094003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:55.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.892+0000 7fc0a6ffd640 1 --2- 172.21.15.53:0/3470011527 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0a8156180 0x7fc0940047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:55.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.892+0000 7fc0a6ffd640 1 --2- 172.21.15.53:0/3470011527 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc094004d10 0x7fc094005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:55.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.892+0000 7fc0a6ffd640 1 -- 172.21.15.53:0/3470011527 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a806efa0 con 0x7fc094004d10 2023-06-10T18:53:55.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.892+0000 7fc0a6ffd640 1 -- 172.21.15.53:0/3470011527 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a80cc720 con 0x7fc094003980 2023-06-10T18:53:55.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.892+0000 7fc0a6ffd640 1 -- 172.21.15.53:0/3470011527 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc09400b990 con 0x7fc0a8156180 2023-06-10T18:53:55.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.892+0000 7fc0a7fff640 1 --2- 172.21.15.53:0/3470011527 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc094004d10 0x7fc094005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:55.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.892+0000 7fc09ffff640 1 --2- 172.21.15.53:0/3470011527 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0a8156180 0x7fc0940047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:55.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.892+0000 7fc0a77fe640 1 --2- 172.21.15.53:0/3470011527 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc094003980 0x7fc094003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:55.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.892+0000 7fc0a7fff640 1 -- 172.21.15.53:0/3470011527 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0a8156180 msgr2=0x7fc0940047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:55.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.892+0000 7fc0a7fff640 1 --2- 172.21.15.53:0/3470011527 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0a8156180 0x7fc0940047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:55.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.892+0000 7fc0a7fff640 1 -- 172.21.15.53:0/3470011527 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc094003980 msgr2=0x7fc094003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:55.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.892+0000 7fc0a7fff640 1 --2- 172.21.15.53:0/3470011527 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc094003980 0x7fc094003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:55.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.892+0000 7fc0a7fff640 1 -- 172.21.15.53:0/3470011527 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc094003530 con 0x7fc094004d10 2023-06-10T18:53:55.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.892+0000 7fc09ffff640 1 --2- 172.21.15.53:0/3470011527 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0a8156180 0x7fc0940047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:53:55.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.896+0000 7fc0a7fff640 1 --2- 172.21.15.53:0/3470011527 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc094004d10 0x7fc094005180 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fc0a0009fc0 tx=0x7fc0a001ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=522c029fc611fd23 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:55.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.896+0000 7fc0a6ffd640 1 -- 172.21.15.53:0/3470011527 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a00af440 con 0x7fc094004d10 2023-06-10T18:53:55.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.896+0000 7fc0a6ffd640 1 -- 172.21.15.53:0/3470011527 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0a000f040 con 0x7fc094004d10 2023-06-10T18:53:55.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.896+0000 7fc0a6ffd640 1 -- 172.21.15.53:0/3470011527 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a00af7e0 con 0x7fc094004d10 2023-06-10T18:53:55.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.896+0000 7fc0adbc4640 1 -- 172.21.15.53:0/3470011527 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc094004d10 msgr2=0x7fc094005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:55.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.896+0000 7fc0adbc4640 1 --2- 172.21.15.53:0/3470011527 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc094004d10 0x7fc094005180 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fc0a0009fc0 tx=0x7fc0a001ee50 comp rx=0 tx=0).stop 2023-06-10T18:53:55.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.896+0000 7fc0a7fff640 1 -- 172.21.15.53:0/3470011527 reap_dead start 2023-06-10T18:53:55.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.896+0000 7fc0adbc4640 1 -- 172.21.15.53:0/3470011527 shutdown_connections 2023-06-10T18:53:55.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.896+0000 7fc0adbc4640 1 -- 172.21.15.53:0/3470011527 >> 172.21.15.53:0/3470011527 conn(0x7fc0a806a0e0 msgr2=0x7fc0a80cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:55.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.896+0000 7fc0adbc4640 1 -- 172.21.15.53:0/3470011527 shutdown_connections 2023-06-10T18:53:55.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.896+0000 7fc0adbc4640 1 -- 172.21.15.53:0/3470011527 wait complete. 2023-06-10T18:53:55.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.896+0000 7fc0adbc4640 1 Processor -- start 2023-06-10T18:53:55.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.896+0000 7fc0adbc4640 1 -- start start 2023-06-10T18:53:55.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.900+0000 7fc0adbc4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0a8154520 0x7fc0a80b0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:55.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.900+0000 7fc0adbc4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0a80b1050 0x7fc0a806f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:55.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.900+0000 7fc0adbc4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0a806f680 0x7fc0a80b28b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:55.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.900+0000 7fc0adbc4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a806faf0 con 0x7fc0a80b1050 2023-06-10T18:53:55.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.900+0000 7fc0adbc4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a80b1590 con 0x7fc0a806f680 2023-06-10T18:53:55.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.900+0000 7fc0adbc4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a80b1870 con 0x7fc0a8154520 2023-06-10T18:53:55.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.900+0000 7fc09ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0a80b1050 0x7fc0a806f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:55.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.900+0000 7fc09ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0a80b1050 0x7fc0a806f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33730/0 (socket says 172.21.15.53:33730) 2023-06-10T18:53:55.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.900+0000 7fc09ffff640 1 -- 172.21.15.53:0/1170881984 learned_addr learned my addr 172.21.15.53:0/1170881984 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:55.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.900+0000 7fc0a77fe640 1 --2- 172.21.15.53:0/1170881984 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0a8154520 0x7fc0a80b0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:55.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.900+0000 7fc0a7fff640 1 --2- 172.21.15.53:0/1170881984 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0a806f680 0x7fc0a80b28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:55.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.900+0000 7fc09ffff640 1 -- 172.21.15.53:0/1170881984 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0a8154520 msgr2=0x7fc0a80b0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:55.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.900+0000 7fc09ffff640 1 --2- 172.21.15.53:0/1170881984 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0a8154520 0x7fc0a80b0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:55.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.900+0000 7fc09ffff640 1 -- 172.21.15.53:0/1170881984 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0a806f680 msgr2=0x7fc0a80b28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:55.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.900+0000 7fc09ffff640 1 --2- 172.21.15.53:0/1170881984 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0a806f680 0x7fc0a80b28b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:55.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.900+0000 7fc09ffff640 1 -- 172.21.15.53:0/1170881984 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a80b1b50 con 0x7fc0a80b1050 2023-06-10T18:53:55.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.900+0000 7fc09ffff640 1 --2- 172.21.15.53:0/1170881984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0a80b1050 0x7fc0a806f140 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fc09000e8a0 tx=0x7fc09000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:55.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.900+0000 7fc0a4ff9640 1 -- 172.21.15.53:0/1170881984 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09000c8d0 con 0x7fc0a80b1050 2023-06-10T18:53:55.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.900+0000 7fc0a4ff9640 1 -- 172.21.15.53:0/1170881984 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc09000ca30 con 0x7fc0a80b1050 2023-06-10T18:53:55.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.900+0000 7fc0adbc4640 1 -- 172.21.15.53:0/1170881984 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0a80b1e30 con 0x7fc0a80b1050 2023-06-10T18:53:55.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.900+0000 7fc0a4ff9640 1 -- 172.21.15.53:0/1170881984 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09000cda0 con 0x7fc0a80b1050 2023-06-10T18:53:55.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.900+0000 7fc0adbc4640 1 -- 172.21.15.53:0/1170881984 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0a80c7850 con 0x7fc0a80b1050 2023-06-10T18:53:55.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.900+0000 7fc0adbc4640 1 -- 172.21.15.53:0/1170881984 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0a80a87b0 con 0x7fc0a80b1050 2023-06-10T18:53:55.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.900+0000 7fc0a4ff9640 1 -- 172.21.15.53:0/1170881984 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc090027430 con 0x7fc0a80b1050 2023-06-10T18:53:55.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.900+0000 7fc0a4ff9640 1 --2- 172.21.15.53:0/1170881984 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc088066280 0x7fc088068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:55.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.900+0000 7fc0a4ff9640 1 -- 172.21.15.53:0/1170881984 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc090084620 con 0x7fc0a80b1050 2023-06-10T18:53:55.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.900+0000 7fc0a77fe640 1 --2- 172.21.15.53:0/1170881984 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc088066280 0x7fc088068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:55.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.904+0000 7fc0a77fe640 1 --2- 172.21.15.53:0/1170881984 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc088066280 0x7fc088068730 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc0a80c8690 tx=0x7fc098008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:55.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:55.904+0000 7fc0a4ff9640 1 -- 172.21.15.53:0/1170881984 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc090051c10 con 0x7fc0a80b1050 2023-06-10T18:53:56.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:56.092+0000 7fc0adbc4640 1 -- 172.21.15.53:0/1170881984 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fc0a80a87b0 con 0x7fc0a80b1050 2023-06-10T18:53:56.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:56.776+0000 7fc0a4ff9640 1 -- 172.21.15.53:0/1170881984 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v13) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc090055230 con 0x7fc0a80b1050 2023-06-10T18:53:56.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:56.780+0000 7fc0adbc4640 1 -- 172.21.15.53:0/1170881984 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc088066280 msgr2=0x7fc088068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:56.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:56.780+0000 7fc0adbc4640 1 --2- 172.21.15.53:0/1170881984 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc088066280 0x7fc088068730 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc0a80c8690 tx=0x7fc098008040 comp rx=0 tx=0).stop 2023-06-10T18:53:56.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:56.780+0000 7fc0adbc4640 1 -- 172.21.15.53:0/1170881984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0a80b1050 msgr2=0x7fc0a806f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:56.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:56.780+0000 7fc0adbc4640 1 --2- 172.21.15.53:0/1170881984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0a80b1050 0x7fc0a806f140 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fc09000e8a0 tx=0x7fc09000ed60 comp rx=0 tx=0).stop 2023-06-10T18:53:56.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:56.780+0000 7fc0adbc4640 1 -- 172.21.15.53:0/1170881984 shutdown_connections 2023-06-10T18:53:56.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:56.780+0000 7fc0adbc4640 1 --2- 172.21.15.53:0/1170881984 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc088066280 0x7fc088068730 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:56.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:56.780+0000 7fc0adbc4640 1 --2- 172.21.15.53:0/1170881984 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0a806f680 0x7fc0a80b28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:56.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:56.780+0000 7fc0adbc4640 1 --2- 172.21.15.53:0/1170881984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0a80b1050 0x7fc0a806f140 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:56.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:56.780+0000 7fc0adbc4640 1 --2- 172.21.15.53:0/1170881984 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0a8154520 0x7fc0a80b0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:56.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:56.780+0000 7fc0adbc4640 1 -- 172.21.15.53:0/1170881984 >> 172.21.15.53:0/1170881984 conn(0x7fc0a806a0e0 msgr2=0x7fc0a80706a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:56.791 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:56.780+0000 7fc0adbc4640 1 -- 172.21.15.53:0/1170881984 shutdown_connections 2023-06-10T18:53:56.791 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:56.780+0000 7fc0adbc4640 1 -- 172.21.15.53:0/1170881984 wait complete. 2023-06-10T18:53:56.811 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-06-10T18:53:56.812 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T18:53:56.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:56.932+0000 7f6891733640 1 Processor -- start 2023-06-10T18:53:56.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:56.932+0000 7f6891733640 1 -- start start 2023-06-10T18:53:56.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:56.932+0000 7f6891733640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f688c06b2f0 0x7f688c06f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:56.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:56.932+0000 7f6891733640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f688c0c8d00 0x7f688c06b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:56.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:56.932+0000 7f6891733640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f688c06bc00 0x7f688c0cbe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:56.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:56.932+0000 7f6891733640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f688c158a90 con 0x7f688c0c8d00 2023-06-10T18:53:56.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:56.936+0000 7f6891733640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f688c0705d0 con 0x7f688c06b2f0 2023-06-10T18:53:56.944 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:56.936+0000 7f6891733640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f688c06f9c0 con 0x7f688c06bc00 2023-06-10T18:53:56.944 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:56.936+0000 7f688a7fc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f688c0c8d00 0x7f688c06b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:56.944 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:56.936+0000 7f688a7fc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f688c0c8d00 0x7f688c06b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33740/0 (socket says 172.21.15.53:33740) 2023-06-10T18:53:56.944 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:56.936+0000 7f688a7fc640 1 -- 172.21.15.53:0/294021667 learned_addr learned my addr 172.21.15.53:0/294021667 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:56.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:56.936+0000 7f688affd640 1 --2- 172.21.15.53:0/294021667 >> v2:172.21.15.117:3300/0 conn(0x7f688c06b2f0 0x7f688c06f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:56.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:56.936+0000 7f688b7fe640 1 --2- 172.21.15.53:0/294021667 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f688c06bc00 0x7f688c0cbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:56.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:56.936+0000 7f688a7fc640 1 -- 172.21.15.53:0/294021667 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f688c06bc00 msgr2=0x7f688c0cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:56.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:56.936+0000 7f688a7fc640 1 --2- 172.21.15.53:0/294021667 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f688c06bc00 0x7f688c0cbe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:56.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:56.936+0000 7f688a7fc640 1 -- 172.21.15.53:0/294021667 >> v2:172.21.15.117:3300/0 conn(0x7f688c06b2f0 msgr2=0x7f688c06f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:56.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:56.936+0000 7f688a7fc640 1 --2- 172.21.15.53:0/294021667 >> v2:172.21.15.117:3300/0 conn(0x7f688c06b2f0 0x7f688c06f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:56.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:56.936+0000 7f688a7fc640 1 -- 172.21.15.53:0/294021667 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f688c06fca0 con 0x7f688c0c8d00 2023-06-10T18:53:56.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:56.936+0000 7f688a7fc640 1 --2- 172.21.15.53:0/294021667 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f688c0c8d00 0x7f688c06b6c0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f688c071d80 tx=0x7f68800213c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b267569e7337bbb server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:56.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:56.936+0000 7f6889ffb640 1 -- 172.21.15.53:0/294021667 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f688000b2d0 con 0x7f688c0c8d00 2023-06-10T18:53:56.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:56.936+0000 7f6889ffb640 1 -- 172.21.15.53:0/294021667 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68800ad050 con 0x7f688c0c8d00 2023-06-10T18:53:56.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:56.936+0000 7f6889ffb640 1 -- 172.21.15.53:0/294021667 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6880009820 con 0x7f688c0c8d00 2023-06-10T18:53:56.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:56.936+0000 7f6891733640 1 -- 172.21.15.53:0/294021667 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f688c0c8d00 msgr2=0x7f688c06b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:56.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:56.936+0000 7f6891733640 1 --2- 172.21.15.53:0/294021667 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f688c0c8d00 0x7f688c06b6c0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f688c071d80 tx=0x7f68800213c0 comp rx=0 tx=0).stop 2023-06-10T18:53:56.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:56.936+0000 7f6891733640 1 -- 172.21.15.53:0/294021667 shutdown_connections 2023-06-10T18:53:56.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:56.936+0000 7f6891733640 1 --2- 172.21.15.53:0/294021667 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f688c06bc00 0x7f688c0cbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:56.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:56.936+0000 7f6891733640 1 --2- 172.21.15.53:0/294021667 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f688c0c8d00 0x7f688c06b6c0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:56.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:56.936+0000 7f6891733640 1 --2- 172.21.15.53:0/294021667 >> v2:172.21.15.117:3300/0 conn(0x7f688c06b2f0 0x7f688c06f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:56.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:56.936+0000 7f6891733640 1 -- 172.21.15.53:0/294021667 >> 172.21.15.53:0/294021667 conn(0x7f688c06a0d0 msgr2=0x7f688c0ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:56.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:56.936+0000 7f6891733640 1 -- 172.21.15.53:0/294021667 shutdown_connections 2023-06-10T18:53:56.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:56.936+0000 7f6891733640 1 -- 172.21.15.53:0/294021667 wait complete. 2023-06-10T18:53:56.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:56.940+0000 7f6891733640 1 Processor -- start 2023-06-10T18:53:56.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:56.940+0000 7f6891733640 1 -- start start 2023-06-10T18:53:56.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:56.940+0000 7f6891733640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f688c06b2f0 0x7f688c156e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:56.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:56.940+0000 7f6891733640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f688c06bc00 0x7f688c0b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:56.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:56.940+0000 7f6891733640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f688c0c8d00 0x7f688c0c57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:56.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:56.940+0000 7f6891733640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f688c0b31c0 con 0x7f688c06b2f0 2023-06-10T18:53:56.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:56.940+0000 7f6891733640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f688c1573d0 con 0x7f688c0c8d00 2023-06-10T18:53:56.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:56.940+0000 7f6891733640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f688c15ad70 con 0x7f688c06bc00 2023-06-10T18:53:56.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:56.940+0000 7f688affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f688c06b2f0 0x7f688c156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:56.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:56.940+0000 7f688affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f688c06b2f0 0x7f688c156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33752/0 (socket says 172.21.15.53:33752) 2023-06-10T18:53:56.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:56.940+0000 7f688affd640 1 -- 172.21.15.53:0/1391202533 learned_addr learned my addr 172.21.15.53:0/1391202533 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:56.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:56.940+0000 7f688b7fe640 1 --2- 172.21.15.53:0/1391202533 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f688c0c8d00 0x7f688c0c57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:56.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:56.940+0000 7f688affd640 1 -- 172.21.15.53:0/1391202533 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f688c06bc00 msgr2=0x7f688c0b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:56.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:56.940+0000 7f688a7fc640 1 --2- 172.21.15.53:0/1391202533 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f688c06bc00 0x7f688c0b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:56.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:56.940+0000 7f688affd640 1 --2- 172.21.15.53:0/1391202533 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f688c06bc00 0x7f688c0b1cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:56.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:56.940+0000 7f688affd640 1 -- 172.21.15.53:0/1391202533 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f688c0c8d00 msgr2=0x7f688c0c57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:56.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:56.940+0000 7f688affd640 1 --2- 172.21.15.53:0/1391202533 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f688c0c8d00 0x7f688c0c57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:56.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:56.940+0000 7f688affd640 1 -- 172.21.15.53:0/1391202533 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f688000bd40 con 0x7f688c06b2f0 2023-06-10T18:53:56.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:56.940+0000 7f688affd640 1 --2- 172.21.15.53:0/1391202533 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f688c06b2f0 0x7f688c156e90 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f687c00d800 tx=0x7f687c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:56.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:56.940+0000 7f68737fe640 1 -- 172.21.15.53:0/1391202533 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f687c0096a0 con 0x7f688c06b2f0 2023-06-10T18:53:56.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:56.940+0000 7f68737fe640 1 -- 172.21.15.53:0/1391202533 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f687c009800 con 0x7f688c06b2f0 2023-06-10T18:53:56.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:56.940+0000 7f6891733640 1 -- 172.21.15.53:0/1391202533 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f688c15b050 con 0x7f688c06b2f0 2023-06-10T18:53:56.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:56.940+0000 7f68737fe640 1 -- 172.21.15.53:0/1391202533 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f687c009990 con 0x7f688c06b2f0 2023-06-10T18:53:56.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:56.940+0000 7f6891733640 1 -- 172.21.15.53:0/1391202533 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f688c15b610 con 0x7f688c06b2f0 2023-06-10T18:53:56.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:56.940+0000 7f6891733640 1 -- 172.21.15.53:0/1391202533 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f688c04d790 con 0x7f688c06b2f0 2023-06-10T18:53:56.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:56.944+0000 7f68737fe640 1 -- 172.21.15.53:0/1391202533 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f687c009af0 con 0x7f688c06b2f0 2023-06-10T18:53:56.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:56.944+0000 7f68737fe640 1 --2- 172.21.15.53:0/1391202533 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6878066280 0x7f6878068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:56.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:56.944+0000 7f68737fe640 1 -- 172.21.15.53:0/1391202533 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f687c084480 con 0x7f688c06b2f0 2023-06-10T18:53:56.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:56.944+0000 7f688a7fc640 1 --2- 172.21.15.53:0/1391202533 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6878066280 0x7f6878068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:56.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:56.944+0000 7f688a7fc640 1 --2- 172.21.15.53:0/1391202533 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6878066280 0x7f6878068730 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f68800b3000 tx=0x7f68800ac000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:56.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:56.948+0000 7f68737fe640 1 -- 172.21.15.53:0/1391202533 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f687c051a70 con 0x7f688c06b2f0 2023-06-10T18:53:57.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.124+0000 7f6891733640 1 -- 172.21.15.53:0/1391202533 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f688c0c37e0 con 0x7f688c06b2f0 2023-06-10T18:53:57.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.124+0000 7f68737fe640 1 -- 172.21.15.53:0/1391202533 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4677 (secure 0 0 0) 0x7f687c009da0 con 0x7f688c06b2f0 2023-06-10T18:53:57.135 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:53:57.135 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4853,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/4087456763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":4087456763},{"type":"v1","addr":"172.21.15.117:6835","nonce":4087456763}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5071,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1065941624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1065941624},{"type":"v1","addr":"172.21.15.117:6837","nonce":1065941624}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5322,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/4137796077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":4137796077},{"type":"v1","addr":"172.21.15.53:6833","nonce":4137796077}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T18:53:54.735461+0000","modified":"2023-06-10T18:53:56.773799+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5331},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5331":{"gid":5331,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/2596772129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2596772129},{"type":"v1","addr":"172.21.15.53:6835","nonce":2596772129}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-06-10T18:53:57.135 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 13 2023-06-10T18:53:57.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.128+0000 7f6891733640 1 -- 172.21.15.53:0/1391202533 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6878066280 msgr2=0x7f6878068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:57.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.128+0000 7f6891733640 1 --2- 172.21.15.53:0/1391202533 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6878066280 0x7f6878068730 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f68800b3000 tx=0x7f68800ac000 comp rx=0 tx=0).stop 2023-06-10T18:53:57.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.128+0000 7f6891733640 1 -- 172.21.15.53:0/1391202533 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f688c06b2f0 msgr2=0x7f688c156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:57.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.128+0000 7f6891733640 1 --2- 172.21.15.53:0/1391202533 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f688c06b2f0 0x7f688c156e90 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f687c00d800 tx=0x7f687c00dcc0 comp rx=0 tx=0).stop 2023-06-10T18:53:57.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.128+0000 7f6891733640 1 -- 172.21.15.53:0/1391202533 shutdown_connections 2023-06-10T18:53:57.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.128+0000 7f6891733640 1 --2- 172.21.15.53:0/1391202533 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6878066280 0x7f6878068730 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:57.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.128+0000 7f6891733640 1 --2- 172.21.15.53:0/1391202533 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f688c0c8d00 0x7f688c0c57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:57.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.128+0000 7f6891733640 1 --2- 172.21.15.53:0/1391202533 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f688c06bc00 0x7f688c0b1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:57.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.128+0000 7f6891733640 1 --2- 172.21.15.53:0/1391202533 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f688c06b2f0 0x7f688c156e90 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:57.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.128+0000 7f6891733640 1 -- 172.21.15.53:0/1391202533 >> 172.21.15.53:0/1391202533 conn(0x7f688c06a0d0 msgr2=0x7f688c0cbe00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:57.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.128+0000 7f6891733640 1 -- 172.21.15.53:0/1391202533 shutdown_connections 2023-06-10T18:53:57.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.128+0000 7f6891733640 1 -- 172.21.15.53:0/1391202533 wait complete. 2023-06-10T18:53:57.153 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T18:53:57.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.252+0000 7f835e9fd640 1 Processor -- start 2023-06-10T18:53:57.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.252+0000 7f835e9fd640 1 -- start start 2023-06-10T18:53:57.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.256+0000 7f835e9fd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8358071060 0x7f83580af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:57.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.256+0000 7f835e9fd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83580afc60 0x7f835806b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:57.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.256+0000 7f835e9fd640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8358159b50 con 0x7f83580c9840 2023-06-10T18:53:57.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.256+0000 7f835e9fd640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83580702a0 con 0x7f8358071060 2023-06-10T18:53:57.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.256+0000 7f835e9fd640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8358070580 con 0x7f83580afc60 2023-06-10T18:53:57.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.256+0000 7f83577fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8358071060 0x7f83580af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:57.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.256+0000 7f83577fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8358071060 0x7f83580af720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33758/0 (socket says 172.21.15.53:33758) 2023-06-10T18:53:57.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.256+0000 7f83577fe640 1 -- 172.21.15.53:0/2395017499 learned_addr learned my addr 172.21.15.53:0/2395017499 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:57.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.256+0000 7f835cf9a640 1 --2- 172.21.15.53:0/2395017499 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83580afc60 0x7f835806b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:57.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.256+0000 7f83577fe640 1 -- 172.21.15.53:0/2395017499 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83580afc60 msgr2=0x7f835806b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:57.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.256+0000 7f83577fe640 1 --2- 172.21.15.53:0/2395017499 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83580afc60 0x7f835806b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:57.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.256+0000 7f83577fe640 1 -- 172.21.15.53:0/2395017499 >> v1:172.21.15.117:6789/0 conn(0x7f83580c9840 legacy=0x7f83580c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:57.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.256+0000 7f83577fe640 1 -- 172.21.15.53:0/2395017499 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8358070860 con 0x7f8358071060 2023-06-10T18:53:57.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.256+0000 7f835cf9a640 1 --2- 172.21.15.53:0/2395017499 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83580afc60 0x7f835806b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:57.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.256+0000 7f83577fe640 1 --2- 172.21.15.53:0/2395017499 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8358071060 0x7f83580af720 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f8348009870 tx=0x7f834801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=373b31474154911f server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:57.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.256+0000 7f8356ffd640 1 -- 172.21.15.53:0/2395017499 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83480aa610 con 0x7f8358071060 2023-06-10T18:53:57.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.256+0000 7f8356ffd640 1 -- 172.21.15.53:0/2395017499 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83480a6040 con 0x7f8358071060 2023-06-10T18:53:57.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.256+0000 7f8356ffd640 1 -- 172.21.15.53:0/2395017499 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83480aa990 con 0x7f8358071060 2023-06-10T18:53:57.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.260+0000 7f835e9fd640 1 -- 172.21.15.53:0/2395017499 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8358071060 msgr2=0x7f83580af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:57.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.260+0000 7f835e9fd640 1 --2- 172.21.15.53:0/2395017499 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8358071060 0x7f83580af720 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f8348009870 tx=0x7f834801c4d0 comp rx=0 tx=0).stop 2023-06-10T18:53:57.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.260+0000 7f835e9fd640 1 -- 172.21.15.53:0/2395017499 shutdown_connections 2023-06-10T18:53:57.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.260+0000 7f835e9fd640 1 --2- 172.21.15.53:0/2395017499 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83580afc60 0x7f835806b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:57.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.260+0000 7f835e9fd640 1 --2- 172.21.15.53:0/2395017499 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8358071060 0x7f83580af720 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:57.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.260+0000 7f835e9fd640 1 -- 172.21.15.53:0/2395017499 >> 172.21.15.53:0/2395017499 conn(0x7f835806a0d0 msgr2=0x7f83580ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:57.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.260+0000 7f835e9fd640 1 -- 172.21.15.53:0/2395017499 shutdown_connections 2023-06-10T18:53:57.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.260+0000 7f835e9fd640 1 -- 172.21.15.53:0/2395017499 wait complete. 2023-06-10T18:53:57.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.260+0000 7f835e9fd640 1 Processor -- start 2023-06-10T18:53:57.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.260+0000 7f835e9fd640 1 -- start start 2023-06-10T18:53:57.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.260+0000 7f835e9fd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8358071060 0x7f835814d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:57.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.260+0000 7f835e9fd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83580afc60 0x7f83580cc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:57.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.260+0000 7f835e9fd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83580c9840 0x7f83580cce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:57.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.260+0000 7f835e9fd640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f835814e120 con 0x7f8358071060 2023-06-10T18:53:57.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.260+0000 7f835e9fd640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f835814e400 con 0x7f83580afc60 2023-06-10T18:53:57.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.260+0000 7f835e9fd640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f835814e6e0 con 0x7f83580c9840 2023-06-10T18:53:57.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.260+0000 7f8357fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8358071060 0x7f835814d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:57.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.260+0000 7f8357fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8358071060 0x7f835814d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33768/0 (socket says 172.21.15.53:33768) 2023-06-10T18:53:57.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.260+0000 7f8357fff640 1 -- 172.21.15.53:0/2790503253 learned_addr learned my addr 172.21.15.53:0/2790503253 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:57.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.260+0000 7f835cf9a640 1 --2- 172.21.15.53:0/2790503253 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83580c9840 0x7f83580cce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:57.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.260+0000 7f8357fff640 1 -- 172.21.15.53:0/2790503253 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83580c9840 msgr2=0x7f83580cce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:57.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.260+0000 7f8357fff640 1 --2- 172.21.15.53:0/2790503253 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83580c9840 0x7f83580cce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:57.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.260+0000 7f8357fff640 1 -- 172.21.15.53:0/2790503253 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83580afc60 msgr2=0x7f83580cc8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:57.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.260+0000 7f83577fe640 1 --2- 172.21.15.53:0/2790503253 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83580afc60 0x7f83580cc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:57.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.260+0000 7f8357fff640 1 --2- 172.21.15.53:0/2790503253 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83580afc60 0x7f83580cc8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:57.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.260+0000 7f8357fff640 1 -- 172.21.15.53:0/2790503253 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83480094d0 con 0x7f8358071060 2023-06-10T18:53:57.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.260+0000 7f835cf9a640 1 --2- 172.21.15.53:0/2790503253 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83580c9840 0x7f83580cce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:57.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.260+0000 7f8357fff640 1 --2- 172.21.15.53:0/2790503253 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8358071060 0x7f835814d900 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f834000b410 tx=0x7f834000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:57.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.260+0000 7f8354ff9640 1 -- 172.21.15.53:0/2790503253 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8340004020 con 0x7f8358071060 2023-06-10T18:53:57.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.260+0000 7f8354ff9640 1 -- 172.21.15.53:0/2790503253 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8340004180 con 0x7f8358071060 2023-06-10T18:53:57.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.260+0000 7f8354ff9640 1 -- 172.21.15.53:0/2790503253 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8340011630 con 0x7f8358071060 2023-06-10T18:53:57.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.260+0000 7f835e9fd640 1 -- 172.21.15.53:0/2790503253 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f835814e9c0 con 0x7f8358071060 2023-06-10T18:53:57.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.260+0000 7f835e9fd640 1 -- 172.21.15.53:0/2790503253 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83580b0ad0 con 0x7f8358071060 2023-06-10T18:53:57.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.264+0000 7f835e9fd640 1 -- 172.21.15.53:0/2790503253 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f835814eee0 con 0x7f8358071060 2023-06-10T18:53:57.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.264+0000 7f8354ff9640 1 -- 172.21.15.53:0/2790503253 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8340011790 con 0x7f8358071060 2023-06-10T18:53:57.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.264+0000 7f8354ff9640 1 --2- 172.21.15.53:0/2790503253 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8338066280 0x7f8338068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:57.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.264+0000 7f8354ff9640 1 -- 172.21.15.53:0/2790503253 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8340083a50 con 0x7f8358071060 2023-06-10T18:53:57.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.264+0000 7f83577fe640 1 --2- 172.21.15.53:0/2790503253 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8338066280 0x7f8338068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:57.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.264+0000 7f83577fe640 1 --2- 172.21.15.53:0/2790503253 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8338066280 0x7f8338068730 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f83480ae000 tx=0x7f8348008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:57.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.268+0000 7f8354ff9640 1 -- 172.21.15.53:0/2790503253 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f835814eee0 con 0x7f8358071060 2023-06-10T18:53:57.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.420+0000 7f835e9fd640 1 -- 172.21.15.53:0/2790503253 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f835814eee0 con 0x7f8358071060 2023-06-10T18:53:57.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.424+0000 7f8354ff9640 1 -- 172.21.15.53:0/2790503253 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18339 (secure 0 0 0) 0x7f8340050f60 con 0x7f8358071060 2023-06-10T18:53:57.433 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:53:57.433 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":37,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T18:53:55.739534+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-06-10T18:53:52.688764+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-06-10T18:53:53.727157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T18:53:57.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.424+0000 7f835e9fd640 1 -- 172.21.15.53:0/2790503253 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8338066280 msgr2=0x7f8338068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:57.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.424+0000 7f835e9fd640 1 --2- 172.21.15.53:0/2790503253 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8338066280 0x7f8338068730 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f83480ae000 tx=0x7f8348008040 comp rx=0 tx=0).stop 2023-06-10T18:53:57.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.424+0000 7f835e9fd640 1 -- 172.21.15.53:0/2790503253 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8358071060 msgr2=0x7f835814d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:57.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.424+0000 7f835e9fd640 1 --2- 172.21.15.53:0/2790503253 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8358071060 0x7f835814d900 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f834000b410 tx=0x7f834000b8d0 comp rx=0 tx=0).stop 2023-06-10T18:53:57.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.424+0000 7f835e9fd640 1 -- 172.21.15.53:0/2790503253 shutdown_connections 2023-06-10T18:53:57.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.424+0000 7f835e9fd640 1 --2- 172.21.15.53:0/2790503253 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8338066280 0x7f8338068730 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:57.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.424+0000 7f835e9fd640 1 --2- 172.21.15.53:0/2790503253 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83580c9840 0x7f83580cce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:57.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.424+0000 7f835e9fd640 1 --2- 172.21.15.53:0/2790503253 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83580afc60 0x7f83580cc8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:57.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.424+0000 7f835e9fd640 1 --2- 172.21.15.53:0/2790503253 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8358071060 0x7f835814d900 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:57.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.424+0000 7f835e9fd640 1 -- 172.21.15.53:0/2790503253 >> 172.21.15.53:0/2790503253 conn(0x7f835806a0d0 msgr2=0x7f83580ce4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:57.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.424+0000 7f835e9fd640 1 -- 172.21.15.53:0/2790503253 shutdown_connections 2023-06-10T18:53:57.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.424+0000 7f835e9fd640 1 -- 172.21.15.53:0/2790503253 wait complete. 2023-06-10T18:53:57.452 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-06-10T18:53:57.453 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-10T18:53:57.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.560+0000 7f03d15f8640 1 Processor -- start 2023-06-10T18:53:57.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.560+0000 7f03d15f8640 1 -- start start 2023-06-10T18:53:57.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.564+0000 7f03d15f8640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f03cc15c7f0 0x7f03cc15f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:57.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.564+0000 7f03d15f8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f03cc15f860 0x7f03cc0ceb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:57.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.564+0000 7f03d15f8640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03cc15cc40 con 0x7f03cc06b780 2023-06-10T18:53:57.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.564+0000 7f03d15f8640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03cc15c3d0 con 0x7f03cc15f860 2023-06-10T18:53:57.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.564+0000 7f03d15f8640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03cc0af530 con 0x7f03cc15c7f0 2023-06-10T18:53:57.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.564+0000 7f03cb7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f03cc15f860 0x7f03cc0ceb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:57.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.564+0000 7f03cb7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f03cc15f860 0x7f03cc0ceb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33780/0 (socket says 172.21.15.53:33780) 2023-06-10T18:53:57.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.564+0000 7f03cb7fe640 1 -- 172.21.15.53:0/260711340 learned_addr learned my addr 172.21.15.53:0/260711340 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:57.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.564+0000 7f03caffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f03cc06b780 0x7f03cc06bb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:32808/0 (socket says 172.21.15.53:32808) 2023-06-10T18:53:57.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.564+0000 7f03cb7fe640 1 -- 172.21.15.53:0/260711340 >> v2:172.21.15.117:3300/0 conn(0x7f03cc15c7f0 msgr2=0x7f03cc15f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:57.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.564+0000 7f03ca7fc640 1 --2- 172.21.15.53:0/260711340 >> v2:172.21.15.117:3300/0 conn(0x7f03cc15c7f0 0x7f03cc15f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:57.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.564+0000 7f03c9ffb640 1 -- 172.21.15.53:0/260711340 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2173047042 0 0) 0x7f03cc15cc40 con 0x7f03cc06b780 2023-06-10T18:53:57.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.564+0000 7f03cb7fe640 1 --2- 172.21.15.53:0/260711340 >> v2:172.21.15.117:3300/0 conn(0x7f03cc15c7f0 0x7f03cc15f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:57.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.564+0000 7f03cb7fe640 1 -- 172.21.15.53:0/260711340 >> v1:172.21.15.53:6789/0 conn(0x7f03cc06b780 legacy=0x7f03cc06bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:57.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.564+0000 7f03cb7fe640 1 -- 172.21.15.53:0/260711340 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03cc15fd70 con 0x7f03cc15f860 2023-06-10T18:53:57.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.564+0000 7f03ca7fc640 1 --2- 172.21.15.53:0/260711340 >> v2:172.21.15.117:3300/0 conn(0x7f03cc15c7f0 0x7f03cc15f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:57.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.564+0000 7f03cb7fe640 1 --2- 172.21.15.53:0/260711340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03cc15f860 0x7f03cc0ceb20 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f03cc0cdad0 tx=0x7f03c401c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f80fd04bcc324d3 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:57.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.564+0000 7f03c9ffb640 1 -- 172.21.15.53:0/260711340 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c40a5800 con 0x7f03cc15f860 2023-06-10T18:53:57.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.568+0000 7f03c9ffb640 1 -- 172.21.15.53:0/260711340 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03c40a5960 con 0x7f03cc15f860 2023-06-10T18:53:57.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.568+0000 7f03c9ffb640 1 -- 172.21.15.53:0/260711340 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c40a5cf0 con 0x7f03cc15f860 2023-06-10T18:53:57.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.568+0000 7f03d15f8640 1 -- 172.21.15.53:0/260711340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03cc15f860 msgr2=0x7f03cc0ceb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:57.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.568+0000 7f03d15f8640 1 --2- 172.21.15.53:0/260711340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03cc15f860 0x7f03cc0ceb20 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f03cc0cdad0 tx=0x7f03c401c940 comp rx=0 tx=0).stop 2023-06-10T18:53:57.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.568+0000 7f03d15f8640 1 -- 172.21.15.53:0/260711340 shutdown_connections 2023-06-10T18:53:57.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.568+0000 7f03d15f8640 1 --2- 172.21.15.53:0/260711340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03cc15f860 0x7f03cc0ceb20 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:57.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.568+0000 7f03d15f8640 1 --2- 172.21.15.53:0/260711340 >> v2:172.21.15.117:3300/0 conn(0x7f03cc15c7f0 0x7f03cc15f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:57.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.568+0000 7f03d15f8640 1 -- 172.21.15.53:0/260711340 >> 172.21.15.53:0/260711340 conn(0x7f03cc06a090 msgr2=0x7f03cc06d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:57.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.568+0000 7f03d15f8640 1 -- 172.21.15.53:0/260711340 shutdown_connections 2023-06-10T18:53:57.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.568+0000 7f03d15f8640 1 -- 172.21.15.53:0/260711340 wait complete. 2023-06-10T18:53:57.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.568+0000 7f03d15f8640 1 Processor -- start 2023-06-10T18:53:57.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.568+0000 7f03d15f8640 1 -- start start 2023-06-10T18:53:57.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.568+0000 7f03d15f8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03cc06b780 0x7f03cc0b4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:57.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.568+0000 7f03d15f8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03cc15c7f0 0x7f03cc15d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:57.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.568+0000 7f03d15f8640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03cc15f860 0x7f03cc0ca480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:57.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.568+0000 7f03d15f8640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03cc0b3640 con 0x7f03cc06b780 2023-06-10T18:53:57.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.568+0000 7f03d15f8640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03cc0b4850 con 0x7f03cc15c7f0 2023-06-10T18:53:57.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.568+0000 7f03d15f8640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03cc15e740 con 0x7f03cc15f860 2023-06-10T18:53:57.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.568+0000 7f03caffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03cc06b780 0x7f03cc0b4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:57.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.568+0000 7f03caffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03cc06b780 0x7f03cc0b4310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33784/0 (socket says 172.21.15.53:33784) 2023-06-10T18:53:57.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.568+0000 7f03caffd640 1 -- 172.21.15.53:0/1131652854 learned_addr learned my addr 172.21.15.53:0/1131652854 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:57.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.568+0000 7f03ca7fc640 1 --2- 172.21.15.53:0/1131652854 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03cc15c7f0 0x7f03cc15d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:57.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.568+0000 7f03cb7fe640 1 --2- 172.21.15.53:0/1131652854 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03cc15f860 0x7f03cc0ca480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:57.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.568+0000 7f03caffd640 1 -- 172.21.15.53:0/1131652854 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03cc15f860 msgr2=0x7f03cc0ca480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:57.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.568+0000 7f03caffd640 1 --2- 172.21.15.53:0/1131652854 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03cc15f860 0x7f03cc0ca480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:57.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.568+0000 7f03caffd640 1 -- 172.21.15.53:0/1131652854 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03cc15c7f0 msgr2=0x7f03cc15d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:57.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.568+0000 7f03caffd640 1 --2- 172.21.15.53:0/1131652854 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03cc15c7f0 0x7f03cc15d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:57.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.568+0000 7f03caffd640 1 -- 172.21.15.53:0/1131652854 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03c4009b30 con 0x7f03cc06b780 2023-06-10T18:53:57.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.568+0000 7f03cb7fe640 1 --2- 172.21.15.53:0/1131652854 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03cc15f860 0x7f03cc0ca480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:57.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.568+0000 7f03caffd640 1 --2- 172.21.15.53:0/1131652854 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03cc06b780 0x7f03cc0b4310 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f03bc00c480 tx=0x7f03bc00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:57.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.568+0000 7f03b37fe640 1 -- 172.21.15.53:0/1131652854 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03bc0074e0 con 0x7f03cc06b780 2023-06-10T18:53:57.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.568+0000 7f03b37fe640 1 -- 172.21.15.53:0/1131652854 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03bc007660 con 0x7f03cc06b780 2023-06-10T18:53:57.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.568+0000 7f03d15f8640 1 -- 172.21.15.53:0/1131652854 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03cc15ea20 con 0x7f03cc06b780 2023-06-10T18:53:57.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.568+0000 7f03b37fe640 1 -- 172.21.15.53:0/1131652854 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03bc004a30 con 0x7f03cc06b780 2023-06-10T18:53:57.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.568+0000 7f03d15f8640 1 -- 172.21.15.53:0/1131652854 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03cc0b3b10 con 0x7f03cc06b780 2023-06-10T18:53:57.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.572+0000 7f03d15f8640 1 -- 172.21.15.53:0/1131652854 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03cc04d790 con 0x7f03cc06b780 2023-06-10T18:53:57.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.572+0000 7f03b37fe640 1 -- 172.21.15.53:0/1131652854 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f03bc004b90 con 0x7f03cc06b780 2023-06-10T18:53:57.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.572+0000 7f03b37fe640 1 --2- 172.21.15.53:0/1131652854 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f03b80662b0 0x7f03b8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:57.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.572+0000 7f03b37fe640 1 -- 172.21.15.53:0/1131652854 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f03bc083220 con 0x7f03cc06b780 2023-06-10T18:53:57.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.572+0000 7f03ca7fc640 1 --2- 172.21.15.53:0/1131652854 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f03b80662b0 0x7f03b8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:57.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.572+0000 7f03ca7fc640 1 --2- 172.21.15.53:0/1131652854 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f03b80662b0 0x7f03b8068760 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f03c0006fd0 tx=0x7f03c0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:57.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.576+0000 7f03b37fe640 1 -- 172.21.15.53:0/1131652854 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f03bc054120 con 0x7f03cc06b780 2023-06-10T18:53:57.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.728+0000 7f03d15f8640 1 -- 172.21.15.53:0/1131652854 --> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f03cc0b1a90 con 0x7f03b80662b0 2023-06-10T18:53:57.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.752+0000 7f03b37fe640 1 -- 172.21.15.53:0/1131652854 <== mgr.4105 v2:172.21.15.117:6832/3061986771 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+294734 (secure 0 0 0) 0x7f03c000c040 con 0x7f03b80662b0 2023-06-10T18:53:57.762 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:53:57.764 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-06-10T18:53:57.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.756+0000 7f03d15f8640 1 -- 172.21.15.53:0/1131652854 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f03b80662b0 msgr2=0x7f03b8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:57.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.756+0000 7f03d15f8640 1 --2- 172.21.15.53:0/1131652854 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f03b80662b0 0x7f03b8068760 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f03c0006fd0 tx=0x7f03c0008040 comp rx=0 tx=0).stop 2023-06-10T18:53:57.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.756+0000 7f03d15f8640 1 -- 172.21.15.53:0/1131652854 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03cc06b780 msgr2=0x7f03cc0b4310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:57.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.756+0000 7f03d15f8640 1 --2- 172.21.15.53:0/1131652854 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03cc06b780 0x7f03cc0b4310 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f03bc00c480 tx=0x7f03bc00c940 comp rx=0 tx=0).stop 2023-06-10T18:53:57.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.756+0000 7f03d15f8640 1 -- 172.21.15.53:0/1131652854 shutdown_connections 2023-06-10T18:53:57.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.756+0000 7f03d15f8640 1 --2- 172.21.15.53:0/1131652854 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f03b80662b0 0x7f03b8068760 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:57.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.756+0000 7f03d15f8640 1 --2- 172.21.15.53:0/1131652854 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03cc15f860 0x7f03cc0ca480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:57.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.756+0000 7f03d15f8640 1 --2- 172.21.15.53:0/1131652854 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03cc15c7f0 0x7f03cc15d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:57.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.756+0000 7f03d15f8640 1 --2- 172.21.15.53:0/1131652854 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03cc06b780 0x7f03cc0b4310 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:57.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.756+0000 7f03d15f8640 1 -- 172.21.15.53:0/1131652854 >> 172.21.15.53:0/1131652854 conn(0x7f03cc06a090 msgr2=0x7f03cc0af7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:57.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.756+0000 7f03d15f8640 1 -- 172.21.15.53:0/1131652854 shutdown_connections 2023-06-10T18:53:57.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.756+0000 7f03d15f8640 1 -- 172.21.15.53:0/1131652854 wait complete. 2023-06-10T18:53:57.782 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":73,"stamp":"2023-06-10T18:53:57.583830+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":31,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":236060,"kb_used_data":4060,"kb_used_omap":0,"kb_used_meta":231936,"kb_avail":754738660,"statfs":{"total":773094113280,"available":772852387840,"internally_reserved":0,"allocated":4157440,"data_stored":2368151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":237502464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.240979"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":191,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-06-10T18:53:48.498706+0000","last_change":"2023-06-10T18:52:34.951528+0000","last_active":"2023-06-10T18:53:48.498706+0000","last_peered":"2023-06-10T18:53:48.498706+0000","last_clean":"2023-06-10T18:53:48.498706+0000","last_became_active":"2023-06-10T18:52:34.949099+0000","last_became_peered":"2023-06-10T18:52:34.949099+0000","last_unstale":"2023-06-10T18:53:48.498706+0000","last_undegraded":"2023-06-10T18:53:48.498706+0000","last_fullsized":"2023-06-10T18:53:48.498706+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_clean_scrub_stamp":"2023-06-10T18:52:33.633295+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:34:53.541410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-06-10T18:53:49.872067+0000","last_change":"2023-06-10T18:52:40.506384+0000","last_active":"2023-06-10T18:53:49.872067+0000","last_peered":"2023-06-10T18:53:49.872067+0000","last_clean":"2023-06-10T18:53:49.872067+0000","last_became_active":"2023-06-10T18:52:40.505701+0000","last_became_peered":"2023-06-10T18:52:40.505701+0000","last_unstale":"2023-06-10T18:53:49.872067+0000","last_undegraded":"2023-06-10T18:53:49.872067+0000","last_fullsized":"2023-06-10T18:53:49.872067+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:34:59.382957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-06-10T18:53:48.498373+0000","last_change":"2023-06-10T18:52:40.512015+0000","last_active":"2023-06-10T18:53:48.498373+0000","last_peered":"2023-06-10T18:53:48.498373+0000","last_clean":"2023-06-10T18:53:48.498373+0000","last_became_active":"2023-06-10T18:52:40.511382+0000","last_became_peered":"2023-06-10T18:52:40.511382+0000","last_unstale":"2023-06-10T18:53:48.498373+0000","last_undegraded":"2023-06-10T18:53:48.498373+0000","last_fullsized":"2023-06-10T18:53:48.498373+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:10:48.195305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-06-10T18:53:49.887548+0000","last_change":"2023-06-10T18:52:40.671725+0000","last_active":"2023-06-10T18:53:49.887548+0000","last_peered":"2023-06-10T18:53:49.887548+0000","last_clean":"2023-06-10T18:53:49.887548+0000","last_became_active":"2023-06-10T18:52:40.671442+0000","last_became_peered":"2023-06-10T18:52:40.671442+0000","last_unstale":"2023-06-10T18:53:49.887548+0000","last_undegraded":"2023-06-10T18:53:49.887548+0000","last_fullsized":"2023-06-10T18:53:49.887548+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:08:32.109800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-06-10T18:53:49.872027+0000","last_change":"2023-06-10T18:52:40.510258+0000","last_active":"2023-06-10T18:53:49.872027+0000","last_peered":"2023-06-10T18:53:49.872027+0000","last_clean":"2023-06-10T18:53:49.872027+0000","last_became_active":"2023-06-10T18:52:40.509560+0000","last_became_peered":"2023-06-10T18:52:40.509560+0000","last_unstale":"2023-06-10T18:53:49.872027+0000","last_undegraded":"2023-06-10T18:53:49.872027+0000","last_fullsized":"2023-06-10T18:53:49.872027+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:10:48.195305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-06-10T18:53:50.386582+0000","last_change":"2023-06-10T18:52:40.672266+0000","last_active":"2023-06-10T18:53:50.386582+0000","last_peered":"2023-06-10T18:53:50.386582+0000","last_clean":"2023-06-10T18:53:50.386582+0000","last_became_active":"2023-06-10T18:52:40.671966+0000","last_became_peered":"2023-06-10T18:52:40.671966+0000","last_unstale":"2023-06-10T18:53:50.386582+0000","last_undegraded":"2023-06-10T18:53:50.386582+0000","last_fullsized":"2023-06-10T18:53:50.386582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:48:13.760693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-06-10T18:53:48.498349+0000","last_change":"2023-06-10T18:52:40.671084+0000","last_active":"2023-06-10T18:53:48.498349+0000","last_peered":"2023-06-10T18:53:48.498349+0000","last_clean":"2023-06-10T18:53:48.498349+0000","last_became_active":"2023-06-10T18:52:40.670697+0000","last_became_peered":"2023-06-10T18:52:40.670697+0000","last_unstale":"2023-06-10T18:53:48.498349+0000","last_undegraded":"2023-06-10T18:53:48.498349+0000","last_fullsized":"2023-06-10T18:53:48.498349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:49:02.712682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-06-10T18:53:50.386618+0000","last_change":"2023-06-10T18:52:40.514114+0000","last_active":"2023-06-10T18:53:50.386618+0000","last_peered":"2023-06-10T18:53:50.386618+0000","last_clean":"2023-06-10T18:53:50.386618+0000","last_became_active":"2023-06-10T18:52:40.513638+0000","last_became_peered":"2023-06-10T18:52:40.513638+0000","last_unstale":"2023-06-10T18:53:50.386618+0000","last_undegraded":"2023-06-10T18:53:50.386618+0000","last_fullsized":"2023-06-10T18:53:50.386618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:40:18.586434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-06-10T18:53:50.386316+0000","last_change":"2023-06-10T18:52:40.515396+0000","last_active":"2023-06-10T18:53:50.386316+0000","last_peered":"2023-06-10T18:53:50.386316+0000","last_clean":"2023-06-10T18:53:50.386316+0000","last_became_active":"2023-06-10T18:52:40.514663+0000","last_became_peered":"2023-06-10T18:52:40.514663+0000","last_unstale":"2023-06-10T18:53:50.386316+0000","last_undegraded":"2023-06-10T18:53:50.386316+0000","last_fullsized":"2023-06-10T18:53:50.386316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:48:33.008902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27896,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343944,"statfs":{"total":96636764160,"available":96608198656,"internally_reserved":0,"allocated":966656,"data_stored":739177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.4430000000000001},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":1.206}]},{"osd":1,"last update":"Sat Jun 10 18:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":1.377},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.151}]},{"osd":2,"last update":"Sat Jun 10 18:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.70999999999999996}]},{"osd":3,"last update":"Sat Jun 10 18:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":1.242},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":1.2769999999999999}]},{"osd":4,"last update":"Sat Jun 10 18:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":1.3480000000000001},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":1.411}]},{"osd":5,"last update":"Sat Jun 10 18:53:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.806,"5min":1.806,"15min":1.806},"last":1.5569999999999999},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":1.522}]},{"osd":6,"last update":"Sat Jun 10 18:53:35 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.93400000000000005},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":1.3160000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":372736,"data_stored":148809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.84999999999999998}]},{"osd":1,"last update":"Sat Jun 10 18:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.90400000000000003}]},{"osd":2,"last update":"Sat Jun 10 18:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":1.0149999999999999},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.57999999999999996}]},{"osd":3,"last update":"Sat Jun 10 18:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":1.1579999999999999}]},{"osd":4,"last update":"Sat Jun 10 18:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":1.044},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":1.2}]},{"osd":5,"last update":"Sat Jun 10 18:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.97699999999999998},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":1.1279999999999999}]},{"osd":7,"last update":"Sat Jun 10 18:53:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":1.069}]}]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":372736,"data_stored":148809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":0.753}]},{"osd":1,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":1.0489999999999999},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.78,"5min":1.78,"15min":1.78},"last":0.72199999999999998}]},{"osd":2,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.67200000000000004}]},{"osd":3,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":0.79300000000000004},{"interface":"front","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":1.097}]},{"osd":4,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.5249999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.88400000000000001},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":0.93000000000000005}]},{"osd":6,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":0.98499999999999999},{"interface":"front","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.1439999999999999}]},{"osd":7,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.873,"5min":1.873,"15min":1.873},"last":1.129},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.1759999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27316,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":372736,"data_stored":148809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:53:37 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.498},{"interface":"front","average":{"1min":0.879,"5min":0.879,"15min":0.879},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.73,"5min":1.73,"15min":1.73},"last":0.88900000000000001}]},{"osd":1,"last update":"Sat Jun 10 18:53:37 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.0289999999999999}]},{"osd":2,"last update":"Sat Jun 10 18:53:37 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.71999999999999997},{"interface":"front","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.548,"5min":1.548,"15min":1.548},"last":0.77200000000000002}]},{"osd":3,"last update":"Sat Jun 10 18:53:37 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.82699999999999996}]},{"osd":5,"last update":"Sat Jun 10 18:53:37 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":1.2110000000000001}]},{"osd":6,"last update":"Sat Jun 10 18:53:37 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":2.2639999999999998,"5min":2.2639999999999998,"15min":2.2639999999999998},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":1.0760000000000001}]},{"osd":7,"last update":"Sat Jun 10 18:53:37 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.081,"5min":1.081,"15min":1.081},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":1.1060000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":360,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":368640,"data_stored":147790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.56299999999999994}]},{"osd":1,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.434},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.52800000000000002}]},{"osd":2,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.9530000000000001,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.60099999999999998}]},{"osd":4,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.488,"5min":1.488,"15min":1.488},"last":1.218},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.97599999999999998}]},{"osd":5,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":2.024,"5min":2.024,"15min":2.024},"last":1.075},{"interface":"front","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.724,"5min":1.724,"15min":1.724},"last":0.92500000000000004}]},{"osd":6,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.8500000000000001,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.78,"5min":1.78,"15min":1.78},"last":1.0369999999999999}]},{"osd":7,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.93200000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":372736,"data_stored":148809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.495}]},{"osd":1,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.60699999999999998}]},{"osd":3,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.56299999999999994}]},{"osd":4,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.625},{"interface":"front","average":{"1min":1.04,"5min":1.04,"15min":1.04},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.67400000000000004}]},{"osd":5,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.556,"5min":1.556,"15min":1.556},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.95399999999999996}]},{"osd":6,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.98699999999999999},{"interface":"front","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.81999999999999995}]},{"osd":7,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.88800000000000001},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":1.01}]}]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":360,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":368640,"data_stored":147790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:53:34 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":0.53500000000000003}]},{"osd":2,"last update":"Sat Jun 10 18:53:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.85899999999999999}]},{"osd":3,"last update":"Sat Jun 10 18:53:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":2.1749999999999998,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":0.73199999999999998}]},{"osd":4,"last update":"Sat Jun 10 18:53:34 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":1.097},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":2.218,"5min":2.218,"15min":2.218},"last":1.349}]},{"osd":5,"last update":"Sat Jun 10 18:53:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.8620000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":2.0190000000000001,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":0.92300000000000004}]},{"osd":6,"last update":"Sat Jun 10 18:53:34 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":2.0720000000000001,"5min":2.0720000000000001,"15min":2.0720000000000001},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.774,"5min":1.774,"15min":1.774},"last":1.0389999999999999}]},{"osd":7,"last update":"Sat Jun 10 18:53:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":2.105,"5min":2.105,"15min":2.105},"last":1.4330000000000001},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":2.2570000000000001,"5min":2.2570000000000001,"15min":2.2570000000000001},"last":1.0620000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31988,"kb_used_data":940,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339852,"statfs":{"total":96636764160,"available":96604008448,"internally_reserved":0,"allocated":962560,"data_stored":738158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jun 10 18:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.65000000000000002}]},{"osd":2,"last update":"Sat Jun 10 18:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.48899999999999999}]},{"osd":3,"last update":"Sat Jun 10 18:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.829,"5min":1.829,"15min":1.829},"last":0.61499999999999999}]},{"osd":4,"last update":"Sat Jun 10 18:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.9510000000000001,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":0.67600000000000005}]},{"osd":5,"last update":"Sat Jun 10 18:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.75,"5min":1.75,"15min":1.75},"last":1.103}]},{"osd":6,"last update":"Sat Jun 10 18:53:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":2.04,"5min":2.04,"15min":2.04},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":0.90200000000000002}]},{"osd":7,"last update":"Sat Jun 10 18:53:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.98799999999999999},{"interface":"front","average":{"1min":1.048,"5min":1.048,"15min":1.048},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.9830000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.153}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-10T18:53:57.789 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-10T18:53:57.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.944+0000 7ffa2790a640 1 Processor -- start 2023-06-10T18:53:57.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.944+0000 7ffa2790a640 1 -- start start 2023-06-10T18:53:57.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.948+0000 7ffa2790a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa20071060 0x7ffa200af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:57.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.948+0000 7ffa2790a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ffa200afc60 0x7ffa2006b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:57.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.948+0000 7ffa2790a640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa20159b50 con 0x7ffa200c9840 2023-06-10T18:53:57.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.948+0000 7ffa2790a640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa200702a0 con 0x7ffa200afc60 2023-06-10T18:53:57.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.948+0000 7ffa2790a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa20070580 con 0x7ffa20071060 2023-06-10T18:53:57.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.948+0000 7ffa25ea7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ffa200afc60 0x7ffa2006b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:57.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.948+0000 7ffa256a6640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ffa200c9840 0x7ffa200c9c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:32814/0 (socket says 172.21.15.53:32814) 2023-06-10T18:53:57.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.948+0000 7ffa256a6640 1 -- 172.21.15.53:0/1215700968 learned_addr learned my addr 172.21.15.53:0/1215700968 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:53:57.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.948+0000 7ffa24ea5640 1 --2- 172.21.15.53:0/1215700968 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa20071060 0x7ffa200af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:57.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.948+0000 7ffa25ea7640 1 -- 172.21.15.53:0/1215700968 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa20071060 msgr2=0x7ffa200af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:57.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.948+0000 7ffa25ea7640 1 --2- 172.21.15.53:0/1215700968 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa20071060 0x7ffa200af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:57.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.948+0000 7ffa25ea7640 1 -- 172.21.15.53:0/1215700968 >> v1:172.21.15.53:6789/0 conn(0x7ffa200c9840 legacy=0x7ffa200c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:57.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.948+0000 7ffa17fff640 1 -- 172.21.15.53:0/1215700968 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2473937171 0 0) 0x7ffa20159b50 con 0x7ffa200c9840 2023-06-10T18:53:57.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.948+0000 7ffa25ea7640 1 -- 172.21.15.53:0/1215700968 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa20070860 con 0x7ffa200afc60 2023-06-10T18:53:57.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.948+0000 7ffa24ea5640 1 --2- 172.21.15.53:0/1215700968 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa20071060 0x7ffa200af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:53:57.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.948+0000 7ffa25ea7640 1 --2- 172.21.15.53:0/1215700968 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa200afc60 0x7ffa2006b090 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7ffa18009d90 tx=0x7ffa1801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0a6efd1fcfd91b0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:57.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.948+0000 7ffa17fff640 1 -- 172.21.15.53:0/1215700968 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa180a5a00 con 0x7ffa200afc60 2023-06-10T18:53:57.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.948+0000 7ffa17fff640 1 -- 172.21.15.53:0/1215700968 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa180a5b60 con 0x7ffa200afc60 2023-06-10T18:53:57.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.948+0000 7ffa17fff640 1 -- 172.21.15.53:0/1215700968 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa180ad440 con 0x7ffa200afc60 2023-06-10T18:53:57.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.952+0000 7ffa2790a640 1 -- 172.21.15.53:0/1215700968 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa200afc60 msgr2=0x7ffa2006b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:57.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.952+0000 7ffa2790a640 1 --2- 172.21.15.53:0/1215700968 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa200afc60 0x7ffa2006b090 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7ffa18009d90 tx=0x7ffa1801c920 comp rx=0 tx=0).stop 2023-06-10T18:53:57.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.952+0000 7ffa2790a640 1 -- 172.21.15.53:0/1215700968 shutdown_connections 2023-06-10T18:53:57.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.952+0000 7ffa2790a640 1 --2- 172.21.15.53:0/1215700968 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa200afc60 0x7ffa2006b090 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:57.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.952+0000 7ffa2790a640 1 --2- 172.21.15.53:0/1215700968 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa20071060 0x7ffa200af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:57.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.952+0000 7ffa2790a640 1 -- 172.21.15.53:0/1215700968 >> 172.21.15.53:0/1215700968 conn(0x7ffa2006a0d0 msgr2=0x7ffa200ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:57.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.952+0000 7ffa2790a640 1 -- 172.21.15.53:0/1215700968 shutdown_connections 2023-06-10T18:53:57.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.952+0000 7ffa2790a640 1 -- 172.21.15.53:0/1215700968 wait complete. 2023-06-10T18:53:57.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.952+0000 7ffa2790a640 1 Processor -- start 2023-06-10T18:53:57.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.952+0000 7ffa2790a640 1 -- start start 2023-06-10T18:53:57.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.952+0000 7ffa2790a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa20071060 0x7ffa2014b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:57.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.952+0000 7ffa2790a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa200afc60 0x7ffa2014c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:57.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.952+0000 7ffa2790a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa200c9840 0x7ffa2014dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:57.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.952+0000 7ffa2790a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa200b3030 con 0x7ffa200afc60 2023-06-10T18:53:57.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.952+0000 7ffa2790a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2014b860 con 0x7ffa20071060 2023-06-10T18:53:57.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.952+0000 7ffa2790a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2014ca10 con 0x7ffa200c9840 2023-06-10T18:53:57.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.952+0000 7ffa24ea5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa200afc60 0x7ffa2014c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:57.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.952+0000 7ffa24ea5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa200afc60 0x7ffa2014c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33804/0 (socket says 172.21.15.53:33804) 2023-06-10T18:53:57.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.952+0000 7ffa24ea5640 1 -- 172.21.15.53:0/2233338487 learned_addr learned my addr 172.21.15.53:0/2233338487 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:57.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.952+0000 7ffa25ea7640 1 --2- 172.21.15.53:0/2233338487 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa200c9840 0x7ffa2014dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:57.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.952+0000 7ffa256a6640 1 --2- 172.21.15.53:0/2233338487 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa20071060 0x7ffa2014b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:57.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.952+0000 7ffa24ea5640 1 -- 172.21.15.53:0/2233338487 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa200c9840 msgr2=0x7ffa2014dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:57.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.952+0000 7ffa24ea5640 1 --2- 172.21.15.53:0/2233338487 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa200c9840 0x7ffa2014dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:57.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.952+0000 7ffa24ea5640 1 -- 172.21.15.53:0/2233338487 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa20071060 msgr2=0x7ffa2014b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:57.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.952+0000 7ffa24ea5640 1 --2- 172.21.15.53:0/2233338487 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa20071060 0x7ffa2014b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:57.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.952+0000 7ffa24ea5640 1 -- 172.21.15.53:0/2233338487 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa18009a70 con 0x7ffa200afc60 2023-06-10T18:53:57.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.952+0000 7ffa24ea5640 1 --2- 172.21.15.53:0/2233338487 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa200afc60 0x7ffa2014c4d0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7ffa1000c7f0 tx=0x7ffa1000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:57.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.956+0000 7ffa15ffb640 1 -- 172.21.15.53:0/2233338487 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1000cea0 con 0x7ffa200afc60 2023-06-10T18:53:57.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.956+0000 7ffa15ffb640 1 -- 172.21.15.53:0/2233338487 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa10007a30 con 0x7ffa200afc60 2023-06-10T18:53:57.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.956+0000 7ffa15ffb640 1 -- 172.21.15.53:0/2233338487 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa10007dc0 con 0x7ffa200afc60 2023-06-10T18:53:57.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.956+0000 7ffa2790a640 1 -- 172.21.15.53:0/2233338487 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa2014ccb0 con 0x7ffa200afc60 2023-06-10T18:53:57.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.956+0000 7ffa2790a640 1 -- 172.21.15.53:0/2233338487 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa2014d550 con 0x7ffa200afc60 2023-06-10T18:53:57.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.956+0000 7ffa2790a640 1 -- 172.21.15.53:0/2233338487 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa2014d0b0 con 0x7ffa200afc60 2023-06-10T18:53:57.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.956+0000 7ffa15ffb640 1 -- 172.21.15.53:0/2233338487 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ffa100113f0 con 0x7ffa200afc60 2023-06-10T18:53:57.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.956+0000 7ffa15ffb640 1 --2- 172.21.15.53:0/2233338487 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ffa04066280 0x7ffa04068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:57.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.956+0000 7ffa15ffb640 1 -- 172.21.15.53:0/2233338487 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ffa10084060 con 0x7ffa200afc60 2023-06-10T18:53:57.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.956+0000 7ffa256a6640 1 --2- 172.21.15.53:0/2233338487 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ffa04066280 0x7ffa04068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:57.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.956+0000 7ffa256a6640 1 --2- 172.21.15.53:0/2233338487 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ffa04066280 0x7ffa04068730 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c000f70 tx=0x7ffa1c007c10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:57.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:57.960+0000 7ffa15ffb640 1 -- 172.21.15.53:0/2233338487 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ffa100b4700 con 0x7ffa200afc60 2023-06-10T18:53:58.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.112+0000 7ffa2790a640 1 -- 172.21.15.53:0/2233338487 --> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ffa200667c0 con 0x7ffa04066280 2023-06-10T18:53:58.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.132+0000 7ffa15ffb640 1 -- 172.21.15.53:0/2233338487 <== mgr.4105 v2:172.21.15.117:6832/3061986771 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+294734 (secure 0 0 0) 0x7ffa1c007da0 con 0x7ffa04066280 2023-06-10T18:53:58.144 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:53:58.146 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-06-10T18:53:58.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.140+0000 7ffa2790a640 1 -- 172.21.15.53:0/2233338487 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ffa04066280 msgr2=0x7ffa04068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:58.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.140+0000 7ffa2790a640 1 --2- 172.21.15.53:0/2233338487 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ffa04066280 0x7ffa04068730 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c000f70 tx=0x7ffa1c007c10 comp rx=0 tx=0).stop 2023-06-10T18:53:58.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.140+0000 7ffa2790a640 1 -- 172.21.15.53:0/2233338487 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa200afc60 msgr2=0x7ffa2014c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:58.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.140+0000 7ffa2790a640 1 --2- 172.21.15.53:0/2233338487 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa200afc60 0x7ffa2014c4d0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7ffa1000c7f0 tx=0x7ffa1000ccb0 comp rx=0 tx=0).stop 2023-06-10T18:53:58.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.140+0000 7ffa2790a640 1 -- 172.21.15.53:0/2233338487 shutdown_connections 2023-06-10T18:53:58.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.140+0000 7ffa2790a640 1 --2- 172.21.15.53:0/2233338487 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ffa04066280 0x7ffa04068730 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:58.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.140+0000 7ffa2790a640 1 --2- 172.21.15.53:0/2233338487 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa200c9840 0x7ffa2014dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:58.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.140+0000 7ffa2790a640 1 --2- 172.21.15.53:0/2233338487 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa200afc60 0x7ffa2014c4d0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:58.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.140+0000 7ffa2790a640 1 --2- 172.21.15.53:0/2233338487 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa20071060 0x7ffa2014b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:58.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.140+0000 7ffa2790a640 1 -- 172.21.15.53:0/2233338487 >> 172.21.15.53:0/2233338487 conn(0x7ffa2006a0d0 msgr2=0x7ffa200c9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:58.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.140+0000 7ffa2790a640 1 -- 172.21.15.53:0/2233338487 shutdown_connections 2023-06-10T18:53:58.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.140+0000 7ffa2790a640 1 -- 172.21.15.53:0/2233338487 wait complete. 2023-06-10T18:53:58.166 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":73,"stamp":"2023-06-10T18:53:57.583830+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":31,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":236060,"kb_used_data":4060,"kb_used_omap":0,"kb_used_meta":231936,"kb_avail":754738660,"statfs":{"total":773094113280,"available":772852387840,"internally_reserved":0,"allocated":4157440,"data_stored":2368151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":237502464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.240979"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":191,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-06-10T18:53:48.498706+0000","last_change":"2023-06-10T18:52:34.951528+0000","last_active":"2023-06-10T18:53:48.498706+0000","last_peered":"2023-06-10T18:53:48.498706+0000","last_clean":"2023-06-10T18:53:48.498706+0000","last_became_active":"2023-06-10T18:52:34.949099+0000","last_became_peered":"2023-06-10T18:52:34.949099+0000","last_unstale":"2023-06-10T18:53:48.498706+0000","last_undegraded":"2023-06-10T18:53:48.498706+0000","last_fullsized":"2023-06-10T18:53:48.498706+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_clean_scrub_stamp":"2023-06-10T18:52:33.633295+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:34:53.541410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-06-10T18:53:49.872067+0000","last_change":"2023-06-10T18:52:40.506384+0000","last_active":"2023-06-10T18:53:49.872067+0000","last_peered":"2023-06-10T18:53:49.872067+0000","last_clean":"2023-06-10T18:53:49.872067+0000","last_became_active":"2023-06-10T18:52:40.505701+0000","last_became_peered":"2023-06-10T18:52:40.505701+0000","last_unstale":"2023-06-10T18:53:49.872067+0000","last_undegraded":"2023-06-10T18:53:49.872067+0000","last_fullsized":"2023-06-10T18:53:49.872067+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:34:59.382957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-06-10T18:53:48.498373+0000","last_change":"2023-06-10T18:52:40.512015+0000","last_active":"2023-06-10T18:53:48.498373+0000","last_peered":"2023-06-10T18:53:48.498373+0000","last_clean":"2023-06-10T18:53:48.498373+0000","last_became_active":"2023-06-10T18:52:40.511382+0000","last_became_peered":"2023-06-10T18:52:40.511382+0000","last_unstale":"2023-06-10T18:53:48.498373+0000","last_undegraded":"2023-06-10T18:53:48.498373+0000","last_fullsized":"2023-06-10T18:53:48.498373+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:10:48.195305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-06-10T18:53:49.887548+0000","last_change":"2023-06-10T18:52:40.671725+0000","last_active":"2023-06-10T18:53:49.887548+0000","last_peered":"2023-06-10T18:53:49.887548+0000","last_clean":"2023-06-10T18:53:49.887548+0000","last_became_active":"2023-06-10T18:52:40.671442+0000","last_became_peered":"2023-06-10T18:52:40.671442+0000","last_unstale":"2023-06-10T18:53:49.887548+0000","last_undegraded":"2023-06-10T18:53:49.887548+0000","last_fullsized":"2023-06-10T18:53:49.887548+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:08:32.109800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-06-10T18:53:49.872027+0000","last_change":"2023-06-10T18:52:40.510258+0000","last_active":"2023-06-10T18:53:49.872027+0000","last_peered":"2023-06-10T18:53:49.872027+0000","last_clean":"2023-06-10T18:53:49.872027+0000","last_became_active":"2023-06-10T18:52:40.509560+0000","last_became_peered":"2023-06-10T18:52:40.509560+0000","last_unstale":"2023-06-10T18:53:49.872027+0000","last_undegraded":"2023-06-10T18:53:49.872027+0000","last_fullsized":"2023-06-10T18:53:49.872027+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:10:48.195305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-06-10T18:53:50.386582+0000","last_change":"2023-06-10T18:52:40.672266+0000","last_active":"2023-06-10T18:53:50.386582+0000","last_peered":"2023-06-10T18:53:50.386582+0000","last_clean":"2023-06-10T18:53:50.386582+0000","last_became_active":"2023-06-10T18:52:40.671966+0000","last_became_peered":"2023-06-10T18:52:40.671966+0000","last_unstale":"2023-06-10T18:53:50.386582+0000","last_undegraded":"2023-06-10T18:53:50.386582+0000","last_fullsized":"2023-06-10T18:53:50.386582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:48:13.760693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-06-10T18:53:48.498349+0000","last_change":"2023-06-10T18:52:40.671084+0000","last_active":"2023-06-10T18:53:48.498349+0000","last_peered":"2023-06-10T18:53:48.498349+0000","last_clean":"2023-06-10T18:53:48.498349+0000","last_became_active":"2023-06-10T18:52:40.670697+0000","last_became_peered":"2023-06-10T18:52:40.670697+0000","last_unstale":"2023-06-10T18:53:48.498349+0000","last_undegraded":"2023-06-10T18:53:48.498349+0000","last_fullsized":"2023-06-10T18:53:48.498349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:49:02.712682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-06-10T18:53:50.386618+0000","last_change":"2023-06-10T18:52:40.514114+0000","last_active":"2023-06-10T18:53:50.386618+0000","last_peered":"2023-06-10T18:53:50.386618+0000","last_clean":"2023-06-10T18:53:50.386618+0000","last_became_active":"2023-06-10T18:52:40.513638+0000","last_became_peered":"2023-06-10T18:52:40.513638+0000","last_unstale":"2023-06-10T18:53:50.386618+0000","last_undegraded":"2023-06-10T18:53:50.386618+0000","last_fullsized":"2023-06-10T18:53:50.386618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:40:18.586434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-06-10T18:53:50.386316+0000","last_change":"2023-06-10T18:52:40.515396+0000","last_active":"2023-06-10T18:53:50.386316+0000","last_peered":"2023-06-10T18:53:50.386316+0000","last_clean":"2023-06-10T18:53:50.386316+0000","last_became_active":"2023-06-10T18:52:40.514663+0000","last_became_peered":"2023-06-10T18:52:40.514663+0000","last_unstale":"2023-06-10T18:53:50.386316+0000","last_undegraded":"2023-06-10T18:53:50.386316+0000","last_fullsized":"2023-06-10T18:53:50.386316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:48:33.008902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27896,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343944,"statfs":{"total":96636764160,"available":96608198656,"internally_reserved":0,"allocated":966656,"data_stored":739177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.4430000000000001},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":1.206}]},{"osd":1,"last update":"Sat Jun 10 18:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":1.377},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.151}]},{"osd":2,"last update":"Sat Jun 10 18:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.70999999999999996}]},{"osd":3,"last update":"Sat Jun 10 18:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":1.242},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":1.2769999999999999}]},{"osd":4,"last update":"Sat Jun 10 18:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":1.3480000000000001},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":1.411}]},{"osd":5,"last update":"Sat Jun 10 18:53:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.806,"5min":1.806,"15min":1.806},"last":1.5569999999999999},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":1.522}]},{"osd":6,"last update":"Sat Jun 10 18:53:35 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.93400000000000005},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":1.3160000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":372736,"data_stored":148809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.84999999999999998}]},{"osd":1,"last update":"Sat Jun 10 18:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.90400000000000003}]},{"osd":2,"last update":"Sat Jun 10 18:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":1.0149999999999999},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.57999999999999996}]},{"osd":3,"last update":"Sat Jun 10 18:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":1.1579999999999999}]},{"osd":4,"last update":"Sat Jun 10 18:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":1.044},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":1.2}]},{"osd":5,"last update":"Sat Jun 10 18:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.97699999999999998},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":1.1279999999999999}]},{"osd":7,"last update":"Sat Jun 10 18:53:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":1.069}]}]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":372736,"data_stored":148809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":0.753}]},{"osd":1,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":1.0489999999999999},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.78,"5min":1.78,"15min":1.78},"last":0.72199999999999998}]},{"osd":2,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.67200000000000004}]},{"osd":3,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":0.79300000000000004},{"interface":"front","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":1.097}]},{"osd":4,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.5249999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.88400000000000001},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":0.93000000000000005}]},{"osd":6,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":0.98499999999999999},{"interface":"front","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.1439999999999999}]},{"osd":7,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.873,"5min":1.873,"15min":1.873},"last":1.129},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.1759999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27316,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":372736,"data_stored":148809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:53:37 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.498},{"interface":"front","average":{"1min":0.879,"5min":0.879,"15min":0.879},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.73,"5min":1.73,"15min":1.73},"last":0.88900000000000001}]},{"osd":1,"last update":"Sat Jun 10 18:53:37 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.0289999999999999}]},{"osd":2,"last update":"Sat Jun 10 18:53:37 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.71999999999999997},{"interface":"front","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.548,"5min":1.548,"15min":1.548},"last":0.77200000000000002}]},{"osd":3,"last update":"Sat Jun 10 18:53:37 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.82699999999999996}]},{"osd":5,"last update":"Sat Jun 10 18:53:37 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":1.2110000000000001}]},{"osd":6,"last update":"Sat Jun 10 18:53:37 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":2.2639999999999998,"5min":2.2639999999999998,"15min":2.2639999999999998},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":1.0760000000000001}]},{"osd":7,"last update":"Sat Jun 10 18:53:37 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.081,"5min":1.081,"15min":1.081},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":1.1060000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":360,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":368640,"data_stored":147790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.56299999999999994}]},{"osd":1,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.434},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.52800000000000002}]},{"osd":2,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.9530000000000001,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.60099999999999998}]},{"osd":4,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.488,"5min":1.488,"15min":1.488},"last":1.218},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.97599999999999998}]},{"osd":5,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":2.024,"5min":2.024,"15min":2.024},"last":1.075},{"interface":"front","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.724,"5min":1.724,"15min":1.724},"last":0.92500000000000004}]},{"osd":6,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.8500000000000001,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.78,"5min":1.78,"15min":1.78},"last":1.0369999999999999}]},{"osd":7,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.93200000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":372736,"data_stored":148809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.495}]},{"osd":1,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.60699999999999998}]},{"osd":3,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.56299999999999994}]},{"osd":4,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.625},{"interface":"front","average":{"1min":1.04,"5min":1.04,"15min":1.04},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.67400000000000004}]},{"osd":5,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.556,"5min":1.556,"15min":1.556},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.95399999999999996}]},{"osd":6,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.98699999999999999},{"interface":"front","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.81999999999999995}]},{"osd":7,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.88800000000000001},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":1.01}]}]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":360,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":368640,"data_stored":147790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:53:34 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":0.53500000000000003}]},{"osd":2,"last update":"Sat Jun 10 18:53:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.85899999999999999}]},{"osd":3,"last update":"Sat Jun 10 18:53:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":2.1749999999999998,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":0.73199999999999998}]},{"osd":4,"last update":"Sat Jun 10 18:53:34 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":1.097},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":2.218,"5min":2.218,"15min":2.218},"last":1.349}]},{"osd":5,"last update":"Sat Jun 10 18:53:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.8620000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":2.0190000000000001,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":0.92300000000000004}]},{"osd":6,"last update":"Sat Jun 10 18:53:34 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":2.0720000000000001,"5min":2.0720000000000001,"15min":2.0720000000000001},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.774,"5min":1.774,"15min":1.774},"last":1.0389999999999999}]},{"osd":7,"last update":"Sat Jun 10 18:53:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":2.105,"5min":2.105,"15min":2.105},"last":1.4330000000000001},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":2.2570000000000001,"5min":2.2570000000000001,"15min":2.2570000000000001},"last":1.0620000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31988,"kb_used_data":940,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339852,"statfs":{"total":96636764160,"available":96604008448,"internally_reserved":0,"allocated":962560,"data_stored":738158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jun 10 18:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.65000000000000002}]},{"osd":2,"last update":"Sat Jun 10 18:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.48899999999999999}]},{"osd":3,"last update":"Sat Jun 10 18:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.829,"5min":1.829,"15min":1.829},"last":0.61499999999999999}]},{"osd":4,"last update":"Sat Jun 10 18:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.9510000000000001,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":0.67600000000000005}]},{"osd":5,"last update":"Sat Jun 10 18:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.75,"5min":1.75,"15min":1.75},"last":1.103}]},{"osd":6,"last update":"Sat Jun 10 18:53:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":2.04,"5min":2.04,"15min":2.04},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":0.90200000000000002}]},{"osd":7,"last update":"Sat Jun 10 18:53:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.98799999999999999},{"interface":"front","average":{"1min":1.048,"5min":1.048,"15min":1.048},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.9830000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.153}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-10T18:53:58.173 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-10T18:53:58.313 INFO:tasks.ceph.mds.a.smithi053.stderr:2023-06-10T18:53:58.304+0000 7ff51e60d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-06-10T18:53:58.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.324+0000 7f36fffe7640 1 Processor -- start 2023-06-10T18:53:58.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.324+0000 7f36fffe7640 1 -- start start 2023-06-10T18:53:58.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.324+0000 7f36fffe7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36f81585d0 0x7f36f80c8b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:58.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.324+0000 7f36fffe7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f36f80af720 0x7f36f80afb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:58.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.324+0000 7f36fffe7640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f36f806b950 0x7f36f806bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:58.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.324+0000 7f36fffe7640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36f80b00b0 con 0x7f36f80af720 2023-06-10T18:53:58.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.324+0000 7f36fffe7640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36f80cd2b0 con 0x7f36f806b950 2023-06-10T18:53:58.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.324+0000 7f36fffe7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36f80cbf70 con 0x7f36f81585d0 2023-06-10T18:53:58.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.324+0000 7f36fd582640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f36f80af720 0x7f36f80afb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:58.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.324+0000 7f36fd582640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f36f80af720 0x7f36f80afb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33814/0 (socket says 172.21.15.53:33814) 2023-06-10T18:53:58.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.324+0000 7f36fd582640 1 -- 172.21.15.53:0/915155356 learned_addr learned my addr 172.21.15.53:0/915155356 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:58.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.324+0000 7f36fdd83640 1 --2- 172.21.15.53:0/915155356 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36f81585d0 0x7f36f80c8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:58.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.324+0000 7f36fe584640 1 --2- 172.21.15.53:0/915155356 >> v2:172.21.15.117:3300/0 conn(0x7f36f806b950 0x7f36f806bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:58.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.324+0000 7f36fd582640 1 -- 172.21.15.53:0/915155356 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36f81585d0 msgr2=0x7f36f80c8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:58.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.324+0000 7f36fd582640 1 --2- 172.21.15.53:0/915155356 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36f81585d0 0x7f36f80c8b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:58.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.324+0000 7f36fd582640 1 -- 172.21.15.53:0/915155356 >> v2:172.21.15.117:3300/0 conn(0x7f36f806b950 msgr2=0x7f36f806bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:58.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.324+0000 7f36fd582640 1 --2- 172.21.15.53:0/915155356 >> v2:172.21.15.117:3300/0 conn(0x7f36f806b950 0x7f36f806bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:58.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.324+0000 7f36fd582640 1 -- 172.21.15.53:0/915155356 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36f81589a0 con 0x7f36f80af720 2023-06-10T18:53:58.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.328+0000 7f36fd582640 1 --2- 172.21.15.53:0/915155356 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36f80af720 0x7f36f80afb70 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f36f80c8210 tx=0x7f36ec01eb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5ca606e9bdb331a server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:58.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.328+0000 7f36fcd81640 1 -- 172.21.15.53:0/915155356 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ec0a7aa0 con 0x7f36f80af720 2023-06-10T18:53:58.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.328+0000 7f36fcd81640 1 -- 172.21.15.53:0/915155356 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36ec0a7c00 con 0x7f36f80af720 2023-06-10T18:53:58.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.328+0000 7f36fcd81640 1 -- 172.21.15.53:0/915155356 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ec0af440 con 0x7f36f80af720 2023-06-10T18:53:58.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.328+0000 7f36fffe7640 1 -- 172.21.15.53:0/915155356 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36f80af720 msgr2=0x7f36f80afb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:58.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.328+0000 7f36fffe7640 1 --2- 172.21.15.53:0/915155356 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36f80af720 0x7f36f80afb70 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f36f80c8210 tx=0x7f36ec01eb10 comp rx=0 tx=0).stop 2023-06-10T18:53:58.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.328+0000 7f36fffe7640 1 -- 172.21.15.53:0/915155356 shutdown_connections 2023-06-10T18:53:58.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.328+0000 7f36fffe7640 1 --2- 172.21.15.53:0/915155356 >> v2:172.21.15.117:3300/0 conn(0x7f36f806b950 0x7f36f806bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:58.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.328+0000 7f36fffe7640 1 --2- 172.21.15.53:0/915155356 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36f80af720 0x7f36f80afb70 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:58.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.328+0000 7f36fffe7640 1 --2- 172.21.15.53:0/915155356 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36f81585d0 0x7f36f80c8b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:58.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.328+0000 7f36fffe7640 1 -- 172.21.15.53:0/915155356 >> 172.21.15.53:0/915155356 conn(0x7f36f80cdca0 msgr2=0x7f36f80ce0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:58.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.328+0000 7f36fffe7640 1 -- 172.21.15.53:0/915155356 shutdown_connections 2023-06-10T18:53:58.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.328+0000 7f36fffe7640 1 -- 172.21.15.53:0/915155356 wait complete. 2023-06-10T18:53:58.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.328+0000 7f36fffe7640 1 Processor -- start 2023-06-10T18:53:58.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.328+0000 7f36fffe7640 1 -- start start 2023-06-10T18:53:58.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.328+0000 7f36fffe7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36f806b950 0x7f36f8157730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:58.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.328+0000 7f36fffe7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36f80af720 0x7f36f80c3500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:58.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.328+0000 7f36fffe7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36f81585d0 0x7f36f8155bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:58.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.328+0000 7f36fffe7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f81572a0 con 0x7f36f80af720 2023-06-10T18:53:58.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.328+0000 7f36fffe7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f8156690 con 0x7f36f806b950 2023-06-10T18:53:58.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.328+0000 7f36fffe7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36f8156970 con 0x7f36f81585d0 2023-06-10T18:53:58.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.328+0000 7f36fd582640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36f80af720 0x7f36f80c3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:58.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.328+0000 7f36fd582640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36f80af720 0x7f36f80c3500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33822/0 (socket says 172.21.15.53:33822) 2023-06-10T18:53:58.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.328+0000 7f36fd582640 1 -- 172.21.15.53:0/3202752547 learned_addr learned my addr 172.21.15.53:0/3202752547 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:58.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.328+0000 7f36fdd83640 1 --2- 172.21.15.53:0/3202752547 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36f806b950 0x7f36f8157730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:58.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.328+0000 7f36fe584640 1 --2- 172.21.15.53:0/3202752547 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36f81585d0 0x7f36f8155bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:58.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.328+0000 7f36fd582640 1 -- 172.21.15.53:0/3202752547 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36f81585d0 msgr2=0x7f36f8155bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:58.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.328+0000 7f36fd582640 1 --2- 172.21.15.53:0/3202752547 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36f81585d0 0x7f36f8155bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:58.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.328+0000 7f36fd582640 1 -- 172.21.15.53:0/3202752547 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36f806b950 msgr2=0x7f36f8157730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:58.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.328+0000 7f36fd582640 1 --2- 172.21.15.53:0/3202752547 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36f806b950 0x7f36f8157730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:58.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.328+0000 7f36fd582640 1 -- 172.21.15.53:0/3202752547 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36ec00b770 con 0x7f36f80af720 2023-06-10T18:53:58.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.328+0000 7f36fdd83640 1 --2- 172.21.15.53:0/3202752547 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36f806b950 0x7f36f8157730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:53:58.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.328+0000 7f36fd582640 1 --2- 172.21.15.53:0/3202752547 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36f80af720 0x7f36f80c3500 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f36ec01d1c0 tx=0x7f36ec01b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:58.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.328+0000 7f36f67fc640 1 -- 172.21.15.53:0/3202752547 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ec0ba640 con 0x7f36f80af720 2023-06-10T18:53:58.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.332+0000 7f36f67fc640 1 -- 172.21.15.53:0/3202752547 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36ec0ba7c0 con 0x7f36f80af720 2023-06-10T18:53:58.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.332+0000 7f36fffe7640 1 -- 172.21.15.53:0/3202752547 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36f8156c50 con 0x7f36f80af720 2023-06-10T18:53:58.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.332+0000 7f36f67fc640 1 -- 172.21.15.53:0/3202752547 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ec0bab70 con 0x7f36f80af720 2023-06-10T18:53:58.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.332+0000 7f36fffe7640 1 -- 172.21.15.53:0/3202752547 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36f814e7b0 con 0x7f36f80af720 2023-06-10T18:53:58.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.332+0000 7f36fffe7640 1 -- 172.21.15.53:0/3202752547 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36f804d790 con 0x7f36f80af720 2023-06-10T18:53:58.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.332+0000 7f36f67fc640 1 -- 172.21.15.53:0/3202752547 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f36ec0b6040 con 0x7f36f80af720 2023-06-10T18:53:58.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.332+0000 7f36f67fc640 1 --2- 172.21.15.53:0/3202752547 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f36e4066280 0x7f36e4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:58.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.332+0000 7f36f67fc640 1 -- 172.21.15.53:0/3202752547 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f36ec1212f0 con 0x7f36f80af720 2023-06-10T18:53:58.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.332+0000 7f36fdd83640 1 --2- 172.21.15.53:0/3202752547 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f36e4066280 0x7f36e4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:58.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.332+0000 7f36fdd83640 1 --2- 172.21.15.53:0/3202752547 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f36e4066280 0x7f36e4068730 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f36f000b9f0 tx=0x7f36f0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:58.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.336+0000 7f36f67fc640 1 -- 172.21.15.53:0/3202752547 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f36ec0ee770 con 0x7f36f80af720 2023-06-10T18:53:58.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.488+0000 7f36fffe7640 1 -- 172.21.15.53:0/3202752547 --> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f36f80cc7d0 con 0x7f36e4066280 2023-06-10T18:53:58.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.508+0000 7f36f67fc640 1 -- 172.21.15.53:0/3202752547 <== mgr.4105 v2:172.21.15.117:6832/3061986771 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+294734 (secure 0 0 0) 0x7f36f000f860 con 0x7f36e4066280 2023-06-10T18:53:58.522 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:53:58.524 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-06-10T18:53:58.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.516+0000 7f36fffe7640 1 -- 172.21.15.53:0/3202752547 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f36e4066280 msgr2=0x7f36e4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:58.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.516+0000 7f36fffe7640 1 --2- 172.21.15.53:0/3202752547 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f36e4066280 0x7f36e4068730 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f36f000b9f0 tx=0x7f36f0008040 comp rx=0 tx=0).stop 2023-06-10T18:53:58.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.516+0000 7f36fffe7640 1 -- 172.21.15.53:0/3202752547 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36f80af720 msgr2=0x7f36f80c3500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:58.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.516+0000 7f36fffe7640 1 --2- 172.21.15.53:0/3202752547 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36f80af720 0x7f36f80c3500 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f36ec01d1c0 tx=0x7f36ec01b8b0 comp rx=0 tx=0).stop 2023-06-10T18:53:58.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.516+0000 7f36fffe7640 1 -- 172.21.15.53:0/3202752547 shutdown_connections 2023-06-10T18:53:58.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.516+0000 7f36fffe7640 1 --2- 172.21.15.53:0/3202752547 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f36e4066280 0x7f36e4068730 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:58.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.516+0000 7f36fffe7640 1 --2- 172.21.15.53:0/3202752547 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36f81585d0 0x7f36f8155bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:58.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.516+0000 7f36fffe7640 1 --2- 172.21.15.53:0/3202752547 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36f80af720 0x7f36f80c3500 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:58.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.516+0000 7f36fffe7640 1 --2- 172.21.15.53:0/3202752547 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36f806b950 0x7f36f8157730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:58.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.516+0000 7f36fffe7640 1 -- 172.21.15.53:0/3202752547 >> 172.21.15.53:0/3202752547 conn(0x7f36f80cdca0 msgr2=0x7f36f80c8940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:58.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.516+0000 7f36fffe7640 1 -- 172.21.15.53:0/3202752547 shutdown_connections 2023-06-10T18:53:58.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.516+0000 7f36fffe7640 1 -- 172.21.15.53:0/3202752547 wait complete. 2023-06-10T18:53:58.541 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":73,"stamp":"2023-06-10T18:53:57.583830+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":31,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":236060,"kb_used_data":4060,"kb_used_omap":0,"kb_used_meta":231936,"kb_avail":754738660,"statfs":{"total":773094113280,"available":772852387840,"internally_reserved":0,"allocated":4157440,"data_stored":2368151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":237502464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.240979"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":191,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-06-10T18:53:48.498706+0000","last_change":"2023-06-10T18:52:34.951528+0000","last_active":"2023-06-10T18:53:48.498706+0000","last_peered":"2023-06-10T18:53:48.498706+0000","last_clean":"2023-06-10T18:53:48.498706+0000","last_became_active":"2023-06-10T18:52:34.949099+0000","last_became_peered":"2023-06-10T18:52:34.949099+0000","last_unstale":"2023-06-10T18:53:48.498706+0000","last_undegraded":"2023-06-10T18:53:48.498706+0000","last_fullsized":"2023-06-10T18:53:48.498706+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_clean_scrub_stamp":"2023-06-10T18:52:33.633295+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:34:53.541410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-06-10T18:53:49.872067+0000","last_change":"2023-06-10T18:52:40.506384+0000","last_active":"2023-06-10T18:53:49.872067+0000","last_peered":"2023-06-10T18:53:49.872067+0000","last_clean":"2023-06-10T18:53:49.872067+0000","last_became_active":"2023-06-10T18:52:40.505701+0000","last_became_peered":"2023-06-10T18:52:40.505701+0000","last_unstale":"2023-06-10T18:53:49.872067+0000","last_undegraded":"2023-06-10T18:53:49.872067+0000","last_fullsized":"2023-06-10T18:53:49.872067+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:34:59.382957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-06-10T18:53:48.498373+0000","last_change":"2023-06-10T18:52:40.512015+0000","last_active":"2023-06-10T18:53:48.498373+0000","last_peered":"2023-06-10T18:53:48.498373+0000","last_clean":"2023-06-10T18:53:48.498373+0000","last_became_active":"2023-06-10T18:52:40.511382+0000","last_became_peered":"2023-06-10T18:52:40.511382+0000","last_unstale":"2023-06-10T18:53:48.498373+0000","last_undegraded":"2023-06-10T18:53:48.498373+0000","last_fullsized":"2023-06-10T18:53:48.498373+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:10:48.195305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-06-10T18:53:49.887548+0000","last_change":"2023-06-10T18:52:40.671725+0000","last_active":"2023-06-10T18:53:49.887548+0000","last_peered":"2023-06-10T18:53:49.887548+0000","last_clean":"2023-06-10T18:53:49.887548+0000","last_became_active":"2023-06-10T18:52:40.671442+0000","last_became_peered":"2023-06-10T18:52:40.671442+0000","last_unstale":"2023-06-10T18:53:49.887548+0000","last_undegraded":"2023-06-10T18:53:49.887548+0000","last_fullsized":"2023-06-10T18:53:49.887548+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:08:32.109800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-06-10T18:53:49.872027+0000","last_change":"2023-06-10T18:52:40.510258+0000","last_active":"2023-06-10T18:53:49.872027+0000","last_peered":"2023-06-10T18:53:49.872027+0000","last_clean":"2023-06-10T18:53:49.872027+0000","last_became_active":"2023-06-10T18:52:40.509560+0000","last_became_peered":"2023-06-10T18:52:40.509560+0000","last_unstale":"2023-06-10T18:53:49.872027+0000","last_undegraded":"2023-06-10T18:53:49.872027+0000","last_fullsized":"2023-06-10T18:53:49.872027+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:10:48.195305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-06-10T18:53:50.386582+0000","last_change":"2023-06-10T18:52:40.672266+0000","last_active":"2023-06-10T18:53:50.386582+0000","last_peered":"2023-06-10T18:53:50.386582+0000","last_clean":"2023-06-10T18:53:50.386582+0000","last_became_active":"2023-06-10T18:52:40.671966+0000","last_became_peered":"2023-06-10T18:52:40.671966+0000","last_unstale":"2023-06-10T18:53:50.386582+0000","last_undegraded":"2023-06-10T18:53:50.386582+0000","last_fullsized":"2023-06-10T18:53:50.386582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:48:13.760693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-06-10T18:53:48.498349+0000","last_change":"2023-06-10T18:52:40.671084+0000","last_active":"2023-06-10T18:53:48.498349+0000","last_peered":"2023-06-10T18:53:48.498349+0000","last_clean":"2023-06-10T18:53:48.498349+0000","last_became_active":"2023-06-10T18:52:40.670697+0000","last_became_peered":"2023-06-10T18:52:40.670697+0000","last_unstale":"2023-06-10T18:53:48.498349+0000","last_undegraded":"2023-06-10T18:53:48.498349+0000","last_fullsized":"2023-06-10T18:53:48.498349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:49:02.712682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-06-10T18:53:50.386618+0000","last_change":"2023-06-10T18:52:40.514114+0000","last_active":"2023-06-10T18:53:50.386618+0000","last_peered":"2023-06-10T18:53:50.386618+0000","last_clean":"2023-06-10T18:53:50.386618+0000","last_became_active":"2023-06-10T18:52:40.513638+0000","last_became_peered":"2023-06-10T18:52:40.513638+0000","last_unstale":"2023-06-10T18:53:50.386618+0000","last_undegraded":"2023-06-10T18:53:50.386618+0000","last_fullsized":"2023-06-10T18:53:50.386618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:40:18.586434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-06-10T18:53:50.386316+0000","last_change":"2023-06-10T18:52:40.515396+0000","last_active":"2023-06-10T18:53:50.386316+0000","last_peered":"2023-06-10T18:53:50.386316+0000","last_clean":"2023-06-10T18:53:50.386316+0000","last_became_active":"2023-06-10T18:52:40.514663+0000","last_became_peered":"2023-06-10T18:52:40.514663+0000","last_unstale":"2023-06-10T18:53:50.386316+0000","last_undegraded":"2023-06-10T18:53:50.386316+0000","last_fullsized":"2023-06-10T18:53:50.386316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:48:33.008902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27896,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343944,"statfs":{"total":96636764160,"available":96608198656,"internally_reserved":0,"allocated":966656,"data_stored":739177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.4430000000000001},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":1.206}]},{"osd":1,"last update":"Sat Jun 10 18:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":1.377},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.151}]},{"osd":2,"last update":"Sat Jun 10 18:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.70999999999999996}]},{"osd":3,"last update":"Sat Jun 10 18:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":1.242},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":1.2769999999999999}]},{"osd":4,"last update":"Sat Jun 10 18:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":1.3480000000000001},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":1.411}]},{"osd":5,"last update":"Sat Jun 10 18:53:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.806,"5min":1.806,"15min":1.806},"last":1.5569999999999999},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":1.522}]},{"osd":6,"last update":"Sat Jun 10 18:53:35 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.93400000000000005},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":1.3160000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":372736,"data_stored":148809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.84999999999999998}]},{"osd":1,"last update":"Sat Jun 10 18:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.90400000000000003}]},{"osd":2,"last update":"Sat Jun 10 18:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":1.0149999999999999},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.57999999999999996}]},{"osd":3,"last update":"Sat Jun 10 18:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":1.1579999999999999}]},{"osd":4,"last update":"Sat Jun 10 18:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":1.044},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":1.2}]},{"osd":5,"last update":"Sat Jun 10 18:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.97699999999999998},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":1.1279999999999999}]},{"osd":7,"last update":"Sat Jun 10 18:53:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":1.069}]}]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":372736,"data_stored":148809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":0.753}]},{"osd":1,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":1.0489999999999999},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.78,"5min":1.78,"15min":1.78},"last":0.72199999999999998}]},{"osd":2,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.67200000000000004}]},{"osd":3,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":0.79300000000000004},{"interface":"front","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":1.097}]},{"osd":4,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.5249999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.88400000000000001},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":0.93000000000000005}]},{"osd":6,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":0.98499999999999999},{"interface":"front","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.1439999999999999}]},{"osd":7,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.873,"5min":1.873,"15min":1.873},"last":1.129},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.1759999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27316,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":372736,"data_stored":148809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:53:37 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.498},{"interface":"front","average":{"1min":0.879,"5min":0.879,"15min":0.879},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.73,"5min":1.73,"15min":1.73},"last":0.88900000000000001}]},{"osd":1,"last update":"Sat Jun 10 18:53:37 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.0289999999999999}]},{"osd":2,"last update":"Sat Jun 10 18:53:37 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.71999999999999997},{"interface":"front","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.548,"5min":1.548,"15min":1.548},"last":0.77200000000000002}]},{"osd":3,"last update":"Sat Jun 10 18:53:37 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.82699999999999996}]},{"osd":5,"last update":"Sat Jun 10 18:53:37 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":1.2110000000000001}]},{"osd":6,"last update":"Sat Jun 10 18:53:37 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":2.2639999999999998,"5min":2.2639999999999998,"15min":2.2639999999999998},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":1.0760000000000001}]},{"osd":7,"last update":"Sat Jun 10 18:53:37 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.081,"5min":1.081,"15min":1.081},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":1.1060000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":360,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":368640,"data_stored":147790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.56299999999999994}]},{"osd":1,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.434},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.52800000000000002}]},{"osd":2,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.9530000000000001,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.60099999999999998}]},{"osd":4,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.488,"5min":1.488,"15min":1.488},"last":1.218},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.97599999999999998}]},{"osd":5,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":2.024,"5min":2.024,"15min":2.024},"last":1.075},{"interface":"front","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.724,"5min":1.724,"15min":1.724},"last":0.92500000000000004}]},{"osd":6,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.8500000000000001,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.78,"5min":1.78,"15min":1.78},"last":1.0369999999999999}]},{"osd":7,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.93200000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":372736,"data_stored":148809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.495}]},{"osd":1,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.60699999999999998}]},{"osd":3,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.56299999999999994}]},{"osd":4,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.625},{"interface":"front","average":{"1min":1.04,"5min":1.04,"15min":1.04},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.67400000000000004}]},{"osd":5,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.556,"5min":1.556,"15min":1.556},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.95399999999999996}]},{"osd":6,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.98699999999999999},{"interface":"front","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.81999999999999995}]},{"osd":7,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.88800000000000001},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":1.01}]}]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":360,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":368640,"data_stored":147790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:53:34 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":0.53500000000000003}]},{"osd":2,"last update":"Sat Jun 10 18:53:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.85899999999999999}]},{"osd":3,"last update":"Sat Jun 10 18:53:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":2.1749999999999998,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":0.73199999999999998}]},{"osd":4,"last update":"Sat Jun 10 18:53:34 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":1.097},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":2.218,"5min":2.218,"15min":2.218},"last":1.349}]},{"osd":5,"last update":"Sat Jun 10 18:53:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.8620000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":2.0190000000000001,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":0.92300000000000004}]},{"osd":6,"last update":"Sat Jun 10 18:53:34 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":2.0720000000000001,"5min":2.0720000000000001,"15min":2.0720000000000001},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.774,"5min":1.774,"15min":1.774},"last":1.0389999999999999}]},{"osd":7,"last update":"Sat Jun 10 18:53:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":2.105,"5min":2.105,"15min":2.105},"last":1.4330000000000001},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":2.2570000000000001,"5min":2.2570000000000001,"15min":2.2570000000000001},"last":1.0620000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31988,"kb_used_data":940,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339852,"statfs":{"total":96636764160,"available":96604008448,"internally_reserved":0,"allocated":962560,"data_stored":738158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jun 10 18:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.65000000000000002}]},{"osd":2,"last update":"Sat Jun 10 18:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.48899999999999999}]},{"osd":3,"last update":"Sat Jun 10 18:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.829,"5min":1.829,"15min":1.829},"last":0.61499999999999999}]},{"osd":4,"last update":"Sat Jun 10 18:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.9510000000000001,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":0.67600000000000005}]},{"osd":5,"last update":"Sat Jun 10 18:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.75,"5min":1.75,"15min":1.75},"last":1.103}]},{"osd":6,"last update":"Sat Jun 10 18:53:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":2.04,"5min":2.04,"15min":2.04},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":0.90200000000000002}]},{"osd":7,"last update":"Sat Jun 10 18:53:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.98799999999999999},{"interface":"front","average":{"1min":1.048,"5min":1.048,"15min":1.048},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.9830000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.153}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-10T18:53:58.548 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3f is not active+clean 2023-06-10T18:53:58.549 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:54.339981+0000', 'last_change': '2023-06-10T18:53:54.339981+0000', 'last_active': '2023-06-10T18:53:54.339981+0000', 'last_peered': '2023-06-10T18:53:54.339981+0000', 'last_clean': '2023-06-10T18:53:54.339981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:54.339981+0000', 'last_undegraded': '2023-06-10T18:53:54.339981+0000', 'last_fullsized': '2023-06-10T18:53:54.339981+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.549 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3e is not active+clean 2023-06-10T18:53:58.549 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:54.339981+0000', 'last_change': '2023-06-10T18:53:54.339981+0000', 'last_active': '2023-06-10T18:53:54.339981+0000', 'last_peered': '2023-06-10T18:53:54.339981+0000', 'last_clean': '2023-06-10T18:53:54.339981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:54.339981+0000', 'last_undegraded': '2023-06-10T18:53:54.339981+0000', 'last_fullsized': '2023-06-10T18:53:54.339981+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.550 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3d is not active+clean 2023-06-10T18:53:58.550 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:54.339981+0000', 'last_change': '2023-06-10T18:53:54.339981+0000', 'last_active': '2023-06-10T18:53:54.339981+0000', 'last_peered': '2023-06-10T18:53:54.339981+0000', 'last_clean': '2023-06-10T18:53:54.339981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:54.339981+0000', 'last_undegraded': '2023-06-10T18:53:54.339981+0000', 'last_fullsized': '2023-06-10T18:53:54.339981+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.550 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3c is not active+clean 2023-06-10T18:53:58.551 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:54.339981+0000', 'last_change': '2023-06-10T18:53:54.339981+0000', 'last_active': '2023-06-10T18:53:54.339981+0000', 'last_peered': '2023-06-10T18:53:54.339981+0000', 'last_clean': '2023-06-10T18:53:54.339981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:54.339981+0000', 'last_undegraded': '2023-06-10T18:53:54.339981+0000', 'last_fullsized': '2023-06-10T18:53:54.339981+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.551 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3b is not active+clean 2023-06-10T18:53:58.552 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:54.339981+0000', 'last_change': '2023-06-10T18:53:54.339981+0000', 'last_active': '2023-06-10T18:53:54.339981+0000', 'last_peered': '2023-06-10T18:53:54.339981+0000', 'last_clean': '2023-06-10T18:53:54.339981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:54.339981+0000', 'last_undegraded': '2023-06-10T18:53:54.339981+0000', 'last_fullsized': '2023-06-10T18:53:54.339981+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.552 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3a is not active+clean 2023-06-10T18:53:58.553 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:54.339981+0000', 'last_change': '2023-06-10T18:53:54.339981+0000', 'last_active': '2023-06-10T18:53:54.339981+0000', 'last_peered': '2023-06-10T18:53:54.339981+0000', 'last_clean': '2023-06-10T18:53:54.339981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:54.339981+0000', 'last_undegraded': '2023-06-10T18:53:54.339981+0000', 'last_fullsized': '2023-06-10T18:53:54.339981+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.553 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.39 is not active+clean 2023-06-10T18:53:58.553 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:54.339981+0000', 'last_change': '2023-06-10T18:53:54.339981+0000', 'last_active': '2023-06-10T18:53:54.339981+0000', 'last_peered': '2023-06-10T18:53:54.339981+0000', 'last_clean': '2023-06-10T18:53:54.339981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:54.339981+0000', 'last_undegraded': '2023-06-10T18:53:54.339981+0000', 'last_fullsized': '2023-06-10T18:53:54.339981+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.554 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.38 is not active+clean 2023-06-10T18:53:58.554 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:54.339981+0000', 'last_change': '2023-06-10T18:53:54.339981+0000', 'last_active': '2023-06-10T18:53:54.339981+0000', 'last_peered': '2023-06-10T18:53:54.339981+0000', 'last_clean': '2023-06-10T18:53:54.339981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:54.339981+0000', 'last_undegraded': '2023-06-10T18:53:54.339981+0000', 'last_fullsized': '2023-06-10T18:53:54.339981+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.554 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.37 is not active+clean 2023-06-10T18:53:58.555 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:54.339981+0000', 'last_change': '2023-06-10T18:53:54.339981+0000', 'last_active': '2023-06-10T18:53:54.339981+0000', 'last_peered': '2023-06-10T18:53:54.339981+0000', 'last_clean': '2023-06-10T18:53:54.339981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:54.339981+0000', 'last_undegraded': '2023-06-10T18:53:54.339981+0000', 'last_fullsized': '2023-06-10T18:53:54.339981+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.555 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.36 is not active+clean 2023-06-10T18:53:58.555 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:54.339981+0000', 'last_change': '2023-06-10T18:53:54.339981+0000', 'last_active': '2023-06-10T18:53:54.339981+0000', 'last_peered': '2023-06-10T18:53:54.339981+0000', 'last_clean': '2023-06-10T18:53:54.339981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:54.339981+0000', 'last_undegraded': '2023-06-10T18:53:54.339981+0000', 'last_fullsized': '2023-06-10T18:53:54.339981+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.556 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.35 is not active+clean 2023-06-10T18:53:58.556 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:54.339981+0000', 'last_change': '2023-06-10T18:53:54.339981+0000', 'last_active': '2023-06-10T18:53:54.339981+0000', 'last_peered': '2023-06-10T18:53:54.339981+0000', 'last_clean': '2023-06-10T18:53:54.339981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:54.339981+0000', 'last_undegraded': '2023-06-10T18:53:54.339981+0000', 'last_fullsized': '2023-06-10T18:53:54.339981+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.556 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.34 is not active+clean 2023-06-10T18:53:58.557 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:54.339981+0000', 'last_change': '2023-06-10T18:53:54.339981+0000', 'last_active': '2023-06-10T18:53:54.339981+0000', 'last_peered': '2023-06-10T18:53:54.339981+0000', 'last_clean': '2023-06-10T18:53:54.339981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:54.339981+0000', 'last_undegraded': '2023-06-10T18:53:54.339981+0000', 'last_fullsized': '2023-06-10T18:53:54.339981+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.557 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.33 is not active+clean 2023-06-10T18:53:58.557 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:54.339981+0000', 'last_change': '2023-06-10T18:53:54.339981+0000', 'last_active': '2023-06-10T18:53:54.339981+0000', 'last_peered': '2023-06-10T18:53:54.339981+0000', 'last_clean': '2023-06-10T18:53:54.339981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:54.339981+0000', 'last_undegraded': '2023-06-10T18:53:54.339981+0000', 'last_fullsized': '2023-06-10T18:53:54.339981+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.558 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.32 is not active+clean 2023-06-10T18:53:58.558 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:54.339981+0000', 'last_change': '2023-06-10T18:53:54.339981+0000', 'last_active': '2023-06-10T18:53:54.339981+0000', 'last_peered': '2023-06-10T18:53:54.339981+0000', 'last_clean': '2023-06-10T18:53:54.339981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:54.339981+0000', 'last_undegraded': '2023-06-10T18:53:54.339981+0000', 'last_fullsized': '2023-06-10T18:53:54.339981+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.558 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.31 is not active+clean 2023-06-10T18:53:58.559 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:54.339981+0000', 'last_change': '2023-06-10T18:53:54.339981+0000', 'last_active': '2023-06-10T18:53:54.339981+0000', 'last_peered': '2023-06-10T18:53:54.339981+0000', 'last_clean': '2023-06-10T18:53:54.339981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:54.339981+0000', 'last_undegraded': '2023-06-10T18:53:54.339981+0000', 'last_fullsized': '2023-06-10T18:53:54.339981+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.561 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.30 is not active+clean 2023-06-10T18:53:58.562 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:54.339981+0000', 'last_change': '2023-06-10T18:53:54.339981+0000', 'last_active': '2023-06-10T18:53:54.339981+0000', 'last_peered': '2023-06-10T18:53:54.339981+0000', 'last_clean': '2023-06-10T18:53:54.339981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:54.339981+0000', 'last_undegraded': '2023-06-10T18:53:54.339981+0000', 'last_fullsized': '2023-06-10T18:53:54.339981+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.562 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2f is not active+clean 2023-06-10T18:53:58.562 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:54.339981+0000', 'last_change': '2023-06-10T18:53:54.339981+0000', 'last_active': '2023-06-10T18:53:54.339981+0000', 'last_peered': '2023-06-10T18:53:54.339981+0000', 'last_clean': '2023-06-10T18:53:54.339981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:54.339981+0000', 'last_undegraded': '2023-06-10T18:53:54.339981+0000', 'last_fullsized': '2023-06-10T18:53:54.339981+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.563 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2e is not active+clean 2023-06-10T18:53:58.563 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:54.339981+0000', 'last_change': '2023-06-10T18:53:54.339981+0000', 'last_active': '2023-06-10T18:53:54.339981+0000', 'last_peered': '2023-06-10T18:53:54.339981+0000', 'last_clean': '2023-06-10T18:53:54.339981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:54.339981+0000', 'last_undegraded': '2023-06-10T18:53:54.339981+0000', 'last_fullsized': '2023-06-10T18:53:54.339981+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.563 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2d is not active+clean 2023-06-10T18:53:58.564 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:54.339981+0000', 'last_change': '2023-06-10T18:53:54.339981+0000', 'last_active': '2023-06-10T18:53:54.339981+0000', 'last_peered': '2023-06-10T18:53:54.339981+0000', 'last_clean': '2023-06-10T18:53:54.339981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:54.339981+0000', 'last_undegraded': '2023-06-10T18:53:54.339981+0000', 'last_fullsized': '2023-06-10T18:53:54.339981+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.564 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2c is not active+clean 2023-06-10T18:53:58.565 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:54.339981+0000', 'last_change': '2023-06-10T18:53:54.339981+0000', 'last_active': '2023-06-10T18:53:54.339981+0000', 'last_peered': '2023-06-10T18:53:54.339981+0000', 'last_clean': '2023-06-10T18:53:54.339981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:54.339981+0000', 'last_undegraded': '2023-06-10T18:53:54.339981+0000', 'last_fullsized': '2023-06-10T18:53:54.339981+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.565 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2b is not active+clean 2023-06-10T18:53:58.566 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:54.339981+0000', 'last_change': '2023-06-10T18:53:54.339981+0000', 'last_active': '2023-06-10T18:53:54.339981+0000', 'last_peered': '2023-06-10T18:53:54.339981+0000', 'last_clean': '2023-06-10T18:53:54.339981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:54.339981+0000', 'last_undegraded': '2023-06-10T18:53:54.339981+0000', 'last_fullsized': '2023-06-10T18:53:54.339981+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.566 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2a is not active+clean 2023-06-10T18:53:58.566 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:54.339981+0000', 'last_change': '2023-06-10T18:53:54.339981+0000', 'last_active': '2023-06-10T18:53:54.339981+0000', 'last_peered': '2023-06-10T18:53:54.339981+0000', 'last_clean': '2023-06-10T18:53:54.339981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:54.339981+0000', 'last_undegraded': '2023-06-10T18:53:54.339981+0000', 'last_fullsized': '2023-06-10T18:53:54.339981+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.567 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.29 is not active+clean 2023-06-10T18:53:58.567 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:54.339981+0000', 'last_change': '2023-06-10T18:53:54.339981+0000', 'last_active': '2023-06-10T18:53:54.339981+0000', 'last_peered': '2023-06-10T18:53:54.339981+0000', 'last_clean': '2023-06-10T18:53:54.339981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:54.339981+0000', 'last_undegraded': '2023-06-10T18:53:54.339981+0000', 'last_fullsized': '2023-06-10T18:53:54.339981+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.568 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.28 is not active+clean 2023-06-10T18:53:58.569 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:54.339981+0000', 'last_change': '2023-06-10T18:53:54.339981+0000', 'last_active': '2023-06-10T18:53:54.339981+0000', 'last_peered': '2023-06-10T18:53:54.339981+0000', 'last_clean': '2023-06-10T18:53:54.339981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:54.339981+0000', 'last_undegraded': '2023-06-10T18:53:54.339981+0000', 'last_fullsized': '2023-06-10T18:53:54.339981+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.569 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.27 is not active+clean 2023-06-10T18:53:58.570 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:54.339981+0000', 'last_change': '2023-06-10T18:53:54.339981+0000', 'last_active': '2023-06-10T18:53:54.339981+0000', 'last_peered': '2023-06-10T18:53:54.339981+0000', 'last_clean': '2023-06-10T18:53:54.339981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:54.339981+0000', 'last_undegraded': '2023-06-10T18:53:54.339981+0000', 'last_fullsized': '2023-06-10T18:53:54.339981+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.570 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.26 is not active+clean 2023-06-10T18:53:58.571 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:54.339981+0000', 'last_change': '2023-06-10T18:53:54.339981+0000', 'last_active': '2023-06-10T18:53:54.339981+0000', 'last_peered': '2023-06-10T18:53:54.339981+0000', 'last_clean': '2023-06-10T18:53:54.339981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:54.339981+0000', 'last_undegraded': '2023-06-10T18:53:54.339981+0000', 'last_fullsized': '2023-06-10T18:53:54.339981+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.572 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.25 is not active+clean 2023-06-10T18:53:58.572 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:54.339981+0000', 'last_change': '2023-06-10T18:53:54.339981+0000', 'last_active': '2023-06-10T18:53:54.339981+0000', 'last_peered': '2023-06-10T18:53:54.339981+0000', 'last_clean': '2023-06-10T18:53:54.339981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:54.339981+0000', 'last_undegraded': '2023-06-10T18:53:54.339981+0000', 'last_fullsized': '2023-06-10T18:53:54.339981+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.572 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.24 is not active+clean 2023-06-10T18:53:58.573 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:54.339981+0000', 'last_change': '2023-06-10T18:53:54.339981+0000', 'last_active': '2023-06-10T18:53:54.339981+0000', 'last_peered': '2023-06-10T18:53:54.339981+0000', 'last_clean': '2023-06-10T18:53:54.339981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:54.339981+0000', 'last_undegraded': '2023-06-10T18:53:54.339981+0000', 'last_fullsized': '2023-06-10T18:53:54.339981+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.573 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.23 is not active+clean 2023-06-10T18:53:58.573 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:54.339981+0000', 'last_change': '2023-06-10T18:53:54.339981+0000', 'last_active': '2023-06-10T18:53:54.339981+0000', 'last_peered': '2023-06-10T18:53:54.339981+0000', 'last_clean': '2023-06-10T18:53:54.339981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:54.339981+0000', 'last_undegraded': '2023-06-10T18:53:54.339981+0000', 'last_fullsized': '2023-06-10T18:53:54.339981+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.574 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.22 is not active+clean 2023-06-10T18:53:58.574 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:54.339981+0000', 'last_change': '2023-06-10T18:53:54.339981+0000', 'last_active': '2023-06-10T18:53:54.339981+0000', 'last_peered': '2023-06-10T18:53:54.339981+0000', 'last_clean': '2023-06-10T18:53:54.339981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:54.339981+0000', 'last_undegraded': '2023-06-10T18:53:54.339981+0000', 'last_fullsized': '2023-06-10T18:53:54.339981+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.575 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.21 is not active+clean 2023-06-10T18:53:58.575 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:54.339981+0000', 'last_change': '2023-06-10T18:53:54.339981+0000', 'last_active': '2023-06-10T18:53:54.339981+0000', 'last_peered': '2023-06-10T18:53:54.339981+0000', 'last_clean': '2023-06-10T18:53:54.339981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:54.339981+0000', 'last_undegraded': '2023-06-10T18:53:54.339981+0000', 'last_fullsized': '2023-06-10T18:53:54.339981+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.575 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.20 is not active+clean 2023-06-10T18:53:58.576 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:54.339981+0000', 'last_change': '2023-06-10T18:53:54.339981+0000', 'last_active': '2023-06-10T18:53:54.339981+0000', 'last_peered': '2023-06-10T18:53:54.339981+0000', 'last_clean': '2023-06-10T18:53:54.339981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:54.339981+0000', 'last_undegraded': '2023-06-10T18:53:54.339981+0000', 'last_fullsized': '2023-06-10T18:53:54.339981+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.576 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1c is not active+clean 2023-06-10T18:53:58.576 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:54.339981+0000', 'last_change': '2023-06-10T18:53:54.339981+0000', 'last_active': '2023-06-10T18:53:54.339981+0000', 'last_peered': '2023-06-10T18:53:54.339981+0000', 'last_clean': '2023-06-10T18:53:54.339981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:54.339981+0000', 'last_undegraded': '2023-06-10T18:53:54.339981+0000', 'last_fullsized': '2023-06-10T18:53:54.339981+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.577 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1f is not active+clean 2023-06-10T18:53:58.577 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:53.327231+0000', 'last_change': '2023-06-10T18:53:53.327231+0000', 'last_active': '2023-06-10T18:53:53.327231+0000', 'last_peered': '2023-06-10T18:53:53.327231+0000', 'last_clean': '2023-06-10T18:53:53.327231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:53.327231+0000', 'last_undegraded': '2023-06-10T18:53:53.327231+0000', 'last_fullsized': '2023-06-10T18:53:53.327231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.577 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1d is not active+clean 2023-06-10T18:53:58.578 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:54.339981+0000', 'last_change': '2023-06-10T18:53:54.339981+0000', 'last_active': '2023-06-10T18:53:54.339981+0000', 'last_peered': '2023-06-10T18:53:54.339981+0000', 'last_clean': '2023-06-10T18:53:54.339981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:54.339981+0000', 'last_undegraded': '2023-06-10T18:53:54.339981+0000', 'last_fullsized': '2023-06-10T18:53:54.339981+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.578 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1e is not active+clean 2023-06-10T18:53:58.578 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:53.327231+0000', 'last_change': '2023-06-10T18:53:53.327231+0000', 'last_active': '2023-06-10T18:53:53.327231+0000', 'last_peered': '2023-06-10T18:53:53.327231+0000', 'last_clean': '2023-06-10T18:53:53.327231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:53.327231+0000', 'last_undegraded': '2023-06-10T18:53:53.327231+0000', 'last_fullsized': '2023-06-10T18:53:53.327231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.579 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1e is not active+clean 2023-06-10T18:53:58.579 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:54.339981+0000', 'last_change': '2023-06-10T18:53:54.339981+0000', 'last_active': '2023-06-10T18:53:54.339981+0000', 'last_peered': '2023-06-10T18:53:54.339981+0000', 'last_clean': '2023-06-10T18:53:54.339981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:54.339981+0000', 'last_undegraded': '2023-06-10T18:53:54.339981+0000', 'last_fullsized': '2023-06-10T18:53:54.339981+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.579 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1d is not active+clean 2023-06-10T18:53:58.580 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:53.327231+0000', 'last_change': '2023-06-10T18:53:53.327231+0000', 'last_active': '2023-06-10T18:53:53.327231+0000', 'last_peered': '2023-06-10T18:53:53.327231+0000', 'last_clean': '2023-06-10T18:53:53.327231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:53.327231+0000', 'last_undegraded': '2023-06-10T18:53:53.327231+0000', 'last_fullsized': '2023-06-10T18:53:53.327231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.580 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1f is not active+clean 2023-06-10T18:53:58.580 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:54.339981+0000', 'last_change': '2023-06-10T18:53:54.339981+0000', 'last_active': '2023-06-10T18:53:54.339981+0000', 'last_peered': '2023-06-10T18:53:54.339981+0000', 'last_clean': '2023-06-10T18:53:54.339981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:54.339981+0000', 'last_undegraded': '2023-06-10T18:53:54.339981+0000', 'last_fullsized': '2023-06-10T18:53:54.339981+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.581 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1c is not active+clean 2023-06-10T18:53:58.581 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:53.327231+0000', 'last_change': '2023-06-10T18:53:53.327231+0000', 'last_active': '2023-06-10T18:53:53.327231+0000', 'last_peered': '2023-06-10T18:53:53.327231+0000', 'last_clean': '2023-06-10T18:53:53.327231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:53.327231+0000', 'last_undegraded': '2023-06-10T18:53:53.327231+0000', 'last_fullsized': '2023-06-10T18:53:53.327231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.582 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.18 is not active+clean 2023-06-10T18:53:58.582 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:54.339981+0000', 'last_change': '2023-06-10T18:53:54.339981+0000', 'last_active': '2023-06-10T18:53:54.339981+0000', 'last_peered': '2023-06-10T18:53:54.339981+0000', 'last_clean': '2023-06-10T18:53:54.339981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:54.339981+0000', 'last_undegraded': '2023-06-10T18:53:54.339981+0000', 'last_fullsized': '2023-06-10T18:53:54.339981+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.582 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1b is not active+clean 2023-06-10T18:53:58.583 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:53.327231+0000', 'last_change': '2023-06-10T18:53:53.327231+0000', 'last_active': '2023-06-10T18:53:53.327231+0000', 'last_peered': '2023-06-10T18:53:53.327231+0000', 'last_clean': '2023-06-10T18:53:53.327231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:53.327231+0000', 'last_undegraded': '2023-06-10T18:53:53.327231+0000', 'last_fullsized': '2023-06-10T18:53:53.327231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.583 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.19 is not active+clean 2023-06-10T18:53:58.583 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:54.339981+0000', 'last_change': '2023-06-10T18:53:54.339981+0000', 'last_active': '2023-06-10T18:53:54.339981+0000', 'last_peered': '2023-06-10T18:53:54.339981+0000', 'last_clean': '2023-06-10T18:53:54.339981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:54.339981+0000', 'last_undegraded': '2023-06-10T18:53:54.339981+0000', 'last_fullsized': '2023-06-10T18:53:54.339981+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.584 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1a is not active+clean 2023-06-10T18:53:58.584 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:53.327231+0000', 'last_change': '2023-06-10T18:53:53.327231+0000', 'last_active': '2023-06-10T18:53:53.327231+0000', 'last_peered': '2023-06-10T18:53:53.327231+0000', 'last_clean': '2023-06-10T18:53:53.327231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:53.327231+0000', 'last_undegraded': '2023-06-10T18:53:53.327231+0000', 'last_fullsized': '2023-06-10T18:53:53.327231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.585 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1a is not active+clean 2023-06-10T18:53:58.585 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:54.339981+0000', 'last_change': '2023-06-10T18:53:54.339981+0000', 'last_active': '2023-06-10T18:53:54.339981+0000', 'last_peered': '2023-06-10T18:53:54.339981+0000', 'last_clean': '2023-06-10T18:53:54.339981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:54.339981+0000', 'last_undegraded': '2023-06-10T18:53:54.339981+0000', 'last_fullsized': '2023-06-10T18:53:54.339981+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.586 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.19 is not active+clean 2023-06-10T18:53:58.586 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:53.327231+0000', 'last_change': '2023-06-10T18:53:53.327231+0000', 'last_active': '2023-06-10T18:53:53.327231+0000', 'last_peered': '2023-06-10T18:53:53.327231+0000', 'last_clean': '2023-06-10T18:53:53.327231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:53.327231+0000', 'last_undegraded': '2023-06-10T18:53:53.327231+0000', 'last_fullsized': '2023-06-10T18:53:53.327231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.587 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1b is not active+clean 2023-06-10T18:53:58.587 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:54.339981+0000', 'last_change': '2023-06-10T18:53:54.339981+0000', 'last_active': '2023-06-10T18:53:54.339981+0000', 'last_peered': '2023-06-10T18:53:54.339981+0000', 'last_clean': '2023-06-10T18:53:54.339981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:54.339981+0000', 'last_undegraded': '2023-06-10T18:53:54.339981+0000', 'last_fullsized': '2023-06-10T18:53:54.339981+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.588 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.18 is not active+clean 2023-06-10T18:53:58.588 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:53.327231+0000', 'last_change': '2023-06-10T18:53:53.327231+0000', 'last_active': '2023-06-10T18:53:53.327231+0000', 'last_peered': '2023-06-10T18:53:53.327231+0000', 'last_clean': '2023-06-10T18:53:53.327231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:53.327231+0000', 'last_undegraded': '2023-06-10T18:53:53.327231+0000', 'last_fullsized': '2023-06-10T18:53:53.327231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.588 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.14 is not active+clean 2023-06-10T18:53:58.589 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:54.339981+0000', 'last_change': '2023-06-10T18:53:54.339981+0000', 'last_active': '2023-06-10T18:53:54.339981+0000', 'last_peered': '2023-06-10T18:53:54.339981+0000', 'last_clean': '2023-06-10T18:53:54.339981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:54.339981+0000', 'last_undegraded': '2023-06-10T18:53:54.339981+0000', 'last_fullsized': '2023-06-10T18:53:54.339981+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.589 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.17 is not active+clean 2023-06-10T18:53:58.589 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:53.327231+0000', 'last_change': '2023-06-10T18:53:53.327231+0000', 'last_active': '2023-06-10T18:53:53.327231+0000', 'last_peered': '2023-06-10T18:53:53.327231+0000', 'last_clean': '2023-06-10T18:53:53.327231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:53.327231+0000', 'last_undegraded': '2023-06-10T18:53:53.327231+0000', 'last_fullsized': '2023-06-10T18:53:53.327231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.590 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.15 is not active+clean 2023-06-10T18:53:58.590 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:54.339981+0000', 'last_change': '2023-06-10T18:53:54.339981+0000', 'last_active': '2023-06-10T18:53:54.339981+0000', 'last_peered': '2023-06-10T18:53:54.339981+0000', 'last_clean': '2023-06-10T18:53:54.339981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:54.339981+0000', 'last_undegraded': '2023-06-10T18:53:54.339981+0000', 'last_fullsized': '2023-06-10T18:53:54.339981+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.590 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.16 is not active+clean 2023-06-10T18:53:58.591 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:53.327231+0000', 'last_change': '2023-06-10T18:53:53.327231+0000', 'last_active': '2023-06-10T18:53:53.327231+0000', 'last_peered': '2023-06-10T18:53:53.327231+0000', 'last_clean': '2023-06-10T18:53:53.327231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:53.327231+0000', 'last_undegraded': '2023-06-10T18:53:53.327231+0000', 'last_fullsized': '2023-06-10T18:53:53.327231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.591 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.16 is not active+clean 2023-06-10T18:53:58.591 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:54.339981+0000', 'last_change': '2023-06-10T18:53:54.339981+0000', 'last_active': '2023-06-10T18:53:54.339981+0000', 'last_peered': '2023-06-10T18:53:54.339981+0000', 'last_clean': '2023-06-10T18:53:54.339981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:54.339981+0000', 'last_undegraded': '2023-06-10T18:53:54.339981+0000', 'last_fullsized': '2023-06-10T18:53:54.339981+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.592 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.15 is not active+clean 2023-06-10T18:53:58.592 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:53.327231+0000', 'last_change': '2023-06-10T18:53:53.327231+0000', 'last_active': '2023-06-10T18:53:53.327231+0000', 'last_peered': '2023-06-10T18:53:53.327231+0000', 'last_clean': '2023-06-10T18:53:53.327231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:53.327231+0000', 'last_undegraded': '2023-06-10T18:53:53.327231+0000', 'last_fullsized': '2023-06-10T18:53:53.327231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.592 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.17 is not active+clean 2023-06-10T18:53:58.593 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:54.339981+0000', 'last_change': '2023-06-10T18:53:54.339981+0000', 'last_active': '2023-06-10T18:53:54.339981+0000', 'last_peered': '2023-06-10T18:53:54.339981+0000', 'last_clean': '2023-06-10T18:53:54.339981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:54.339981+0000', 'last_undegraded': '2023-06-10T18:53:54.339981+0000', 'last_fullsized': '2023-06-10T18:53:54.339981+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.593 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.14 is not active+clean 2023-06-10T18:53:58.594 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:53.327231+0000', 'last_change': '2023-06-10T18:53:53.327231+0000', 'last_active': '2023-06-10T18:53:53.327231+0000', 'last_peered': '2023-06-10T18:53:53.327231+0000', 'last_clean': '2023-06-10T18:53:53.327231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:53.327231+0000', 'last_undegraded': '2023-06-10T18:53:53.327231+0000', 'last_fullsized': '2023-06-10T18:53:53.327231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.594 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.10 is not active+clean 2023-06-10T18:53:58.594 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:54.339981+0000', 'last_change': '2023-06-10T18:53:54.339981+0000', 'last_active': '2023-06-10T18:53:54.339981+0000', 'last_peered': '2023-06-10T18:53:54.339981+0000', 'last_clean': '2023-06-10T18:53:54.339981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:54.339981+0000', 'last_undegraded': '2023-06-10T18:53:54.339981+0000', 'last_fullsized': '2023-06-10T18:53:54.339981+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.595 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.13 is not active+clean 2023-06-10T18:53:58.595 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:53.327231+0000', 'last_change': '2023-06-10T18:53:53.327231+0000', 'last_active': '2023-06-10T18:53:53.327231+0000', 'last_peered': '2023-06-10T18:53:53.327231+0000', 'last_clean': '2023-06-10T18:53:53.327231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:53.327231+0000', 'last_undegraded': '2023-06-10T18:53:53.327231+0000', 'last_fullsized': '2023-06-10T18:53:53.327231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.595 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.11 is not active+clean 2023-06-10T18:53:58.596 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:54.339981+0000', 'last_change': '2023-06-10T18:53:54.339981+0000', 'last_active': '2023-06-10T18:53:54.339981+0000', 'last_peered': '2023-06-10T18:53:54.339981+0000', 'last_clean': '2023-06-10T18:53:54.339981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:54.339981+0000', 'last_undegraded': '2023-06-10T18:53:54.339981+0000', 'last_fullsized': '2023-06-10T18:53:54.339981+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.596 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.12 is not active+clean 2023-06-10T18:53:58.596 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:53.327231+0000', 'last_change': '2023-06-10T18:53:53.327231+0000', 'last_active': '2023-06-10T18:53:53.327231+0000', 'last_peered': '2023-06-10T18:53:53.327231+0000', 'last_clean': '2023-06-10T18:53:53.327231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:53.327231+0000', 'last_undegraded': '2023-06-10T18:53:53.327231+0000', 'last_fullsized': '2023-06-10T18:53:53.327231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.597 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.12 is not active+clean 2023-06-10T18:53:58.597 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:54.339981+0000', 'last_change': '2023-06-10T18:53:54.339981+0000', 'last_active': '2023-06-10T18:53:54.339981+0000', 'last_peered': '2023-06-10T18:53:54.339981+0000', 'last_clean': '2023-06-10T18:53:54.339981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:54.339981+0000', 'last_undegraded': '2023-06-10T18:53:54.339981+0000', 'last_fullsized': '2023-06-10T18:53:54.339981+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.598 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.11 is not active+clean 2023-06-10T18:53:58.598 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:53.327231+0000', 'last_change': '2023-06-10T18:53:53.327231+0000', 'last_active': '2023-06-10T18:53:53.327231+0000', 'last_peered': '2023-06-10T18:53:53.327231+0000', 'last_clean': '2023-06-10T18:53:53.327231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:53.327231+0000', 'last_undegraded': '2023-06-10T18:53:53.327231+0000', 'last_fullsized': '2023-06-10T18:53:53.327231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.598 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.13 is not active+clean 2023-06-10T18:53:58.599 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:54.339981+0000', 'last_change': '2023-06-10T18:53:54.339981+0000', 'last_active': '2023-06-10T18:53:54.339981+0000', 'last_peered': '2023-06-10T18:53:54.339981+0000', 'last_clean': '2023-06-10T18:53:54.339981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:54.339981+0000', 'last_undegraded': '2023-06-10T18:53:54.339981+0000', 'last_fullsized': '2023-06-10T18:53:54.339981+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.599 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.10 is not active+clean 2023-06-10T18:53:58.599 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:53.327231+0000', 'last_change': '2023-06-10T18:53:53.327231+0000', 'last_active': '2023-06-10T18:53:53.327231+0000', 'last_peered': '2023-06-10T18:53:53.327231+0000', 'last_clean': '2023-06-10T18:53:53.327231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:53.327231+0000', 'last_undegraded': '2023-06-10T18:53:53.327231+0000', 'last_fullsized': '2023-06-10T18:53:53.327231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.600 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.c is not active+clean 2023-06-10T18:53:58.601 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:54.339981+0000', 'last_change': '2023-06-10T18:53:54.339981+0000', 'last_active': '2023-06-10T18:53:54.339981+0000', 'last_peered': '2023-06-10T18:53:54.339981+0000', 'last_clean': '2023-06-10T18:53:54.339981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:54.339981+0000', 'last_undegraded': '2023-06-10T18:53:54.339981+0000', 'last_fullsized': '2023-06-10T18:53:54.339981+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.601 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.f is not active+clean 2023-06-10T18:53:58.601 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:53.327231+0000', 'last_change': '2023-06-10T18:53:53.327231+0000', 'last_active': '2023-06-10T18:53:53.327231+0000', 'last_peered': '2023-06-10T18:53:53.327231+0000', 'last_clean': '2023-06-10T18:53:53.327231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:53.327231+0000', 'last_undegraded': '2023-06-10T18:53:53.327231+0000', 'last_fullsized': '2023-06-10T18:53:53.327231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.602 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.d is not active+clean 2023-06-10T18:53:58.602 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:54.339981+0000', 'last_change': '2023-06-10T18:53:54.339981+0000', 'last_active': '2023-06-10T18:53:54.339981+0000', 'last_peered': '2023-06-10T18:53:54.339981+0000', 'last_clean': '2023-06-10T18:53:54.339981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:54.339981+0000', 'last_undegraded': '2023-06-10T18:53:54.339981+0000', 'last_fullsized': '2023-06-10T18:53:54.339981+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.603 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.e is not active+clean 2023-06-10T18:53:58.603 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:53.327231+0000', 'last_change': '2023-06-10T18:53:53.327231+0000', 'last_active': '2023-06-10T18:53:53.327231+0000', 'last_peered': '2023-06-10T18:53:53.327231+0000', 'last_clean': '2023-06-10T18:53:53.327231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:53.327231+0000', 'last_undegraded': '2023-06-10T18:53:53.327231+0000', 'last_fullsized': '2023-06-10T18:53:53.327231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.604 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.e is not active+clean 2023-06-10T18:53:58.604 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:54.339981+0000', 'last_change': '2023-06-10T18:53:54.339981+0000', 'last_active': '2023-06-10T18:53:54.339981+0000', 'last_peered': '2023-06-10T18:53:54.339981+0000', 'last_clean': '2023-06-10T18:53:54.339981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:54.339981+0000', 'last_undegraded': '2023-06-10T18:53:54.339981+0000', 'last_fullsized': '2023-06-10T18:53:54.339981+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.605 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.d is not active+clean 2023-06-10T18:53:58.605 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:53.327231+0000', 'last_change': '2023-06-10T18:53:53.327231+0000', 'last_active': '2023-06-10T18:53:53.327231+0000', 'last_peered': '2023-06-10T18:53:53.327231+0000', 'last_clean': '2023-06-10T18:53:53.327231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:53.327231+0000', 'last_undegraded': '2023-06-10T18:53:53.327231+0000', 'last_fullsized': '2023-06-10T18:53:53.327231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.606 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.f is not active+clean 2023-06-10T18:53:58.606 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:54.339981+0000', 'last_change': '2023-06-10T18:53:54.339981+0000', 'last_active': '2023-06-10T18:53:54.339981+0000', 'last_peered': '2023-06-10T18:53:54.339981+0000', 'last_clean': '2023-06-10T18:53:54.339981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:54.339981+0000', 'last_undegraded': '2023-06-10T18:53:54.339981+0000', 'last_fullsized': '2023-06-10T18:53:54.339981+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.606 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.c is not active+clean 2023-06-10T18:53:58.607 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:53.327231+0000', 'last_change': '2023-06-10T18:53:53.327231+0000', 'last_active': '2023-06-10T18:53:53.327231+0000', 'last_peered': '2023-06-10T18:53:53.327231+0000', 'last_clean': '2023-06-10T18:53:53.327231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:53.327231+0000', 'last_undegraded': '2023-06-10T18:53:53.327231+0000', 'last_fullsized': '2023-06-10T18:53:53.327231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.607 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.8 is not active+clean 2023-06-10T18:53:58.608 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:54.339981+0000', 'last_change': '2023-06-10T18:53:54.339981+0000', 'last_active': '2023-06-10T18:53:54.339981+0000', 'last_peered': '2023-06-10T18:53:54.339981+0000', 'last_clean': '2023-06-10T18:53:54.339981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:54.339981+0000', 'last_undegraded': '2023-06-10T18:53:54.339981+0000', 'last_fullsized': '2023-06-10T18:53:54.339981+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.608 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.b is not active+clean 2023-06-10T18:53:58.609 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:53.327231+0000', 'last_change': '2023-06-10T18:53:53.327231+0000', 'last_active': '2023-06-10T18:53:53.327231+0000', 'last_peered': '2023-06-10T18:53:53.327231+0000', 'last_clean': '2023-06-10T18:53:53.327231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:53.327231+0000', 'last_undegraded': '2023-06-10T18:53:53.327231+0000', 'last_fullsized': '2023-06-10T18:53:53.327231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.609 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.9 is not active+clean 2023-06-10T18:53:58.610 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:54.339981+0000', 'last_change': '2023-06-10T18:53:54.339981+0000', 'last_active': '2023-06-10T18:53:54.339981+0000', 'last_peered': '2023-06-10T18:53:54.339981+0000', 'last_clean': '2023-06-10T18:53:54.339981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:54.339981+0000', 'last_undegraded': '2023-06-10T18:53:54.339981+0000', 'last_fullsized': '2023-06-10T18:53:54.339981+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.611 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.a is not active+clean 2023-06-10T18:53:58.611 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:53.327231+0000', 'last_change': '2023-06-10T18:53:53.327231+0000', 'last_active': '2023-06-10T18:53:53.327231+0000', 'last_peered': '2023-06-10T18:53:53.327231+0000', 'last_clean': '2023-06-10T18:53:53.327231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:53.327231+0000', 'last_undegraded': '2023-06-10T18:53:53.327231+0000', 'last_fullsized': '2023-06-10T18:53:53.327231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.611 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.a is not active+clean 2023-06-10T18:53:58.612 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:54.339981+0000', 'last_change': '2023-06-10T18:53:54.339981+0000', 'last_active': '2023-06-10T18:53:54.339981+0000', 'last_peered': '2023-06-10T18:53:54.339981+0000', 'last_clean': '2023-06-10T18:53:54.339981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:54.339981+0000', 'last_undegraded': '2023-06-10T18:53:54.339981+0000', 'last_fullsized': '2023-06-10T18:53:54.339981+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.612 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.9 is not active+clean 2023-06-10T18:53:58.612 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:53.327231+0000', 'last_change': '2023-06-10T18:53:53.327231+0000', 'last_active': '2023-06-10T18:53:53.327231+0000', 'last_peered': '2023-06-10T18:53:53.327231+0000', 'last_clean': '2023-06-10T18:53:53.327231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:53.327231+0000', 'last_undegraded': '2023-06-10T18:53:53.327231+0000', 'last_fullsized': '2023-06-10T18:53:53.327231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.613 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.b is not active+clean 2023-06-10T18:53:58.613 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:54.339981+0000', 'last_change': '2023-06-10T18:53:54.339981+0000', 'last_active': '2023-06-10T18:53:54.339981+0000', 'last_peered': '2023-06-10T18:53:54.339981+0000', 'last_clean': '2023-06-10T18:53:54.339981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:54.339981+0000', 'last_undegraded': '2023-06-10T18:53:54.339981+0000', 'last_fullsized': '2023-06-10T18:53:54.339981+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.614 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.8 is not active+clean 2023-06-10T18:53:58.614 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:53.327231+0000', 'last_change': '2023-06-10T18:53:53.327231+0000', 'last_active': '2023-06-10T18:53:53.327231+0000', 'last_peered': '2023-06-10T18:53:53.327231+0000', 'last_clean': '2023-06-10T18:53:53.327231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:53.327231+0000', 'last_undegraded': '2023-06-10T18:53:53.327231+0000', 'last_fullsized': '2023-06-10T18:53:53.327231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.615 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.7 is not active+clean 2023-06-10T18:53:58.616 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:54.339981+0000', 'last_change': '2023-06-10T18:53:54.339981+0000', 'last_active': '2023-06-10T18:53:54.339981+0000', 'last_peered': '2023-06-10T18:53:54.339981+0000', 'last_clean': '2023-06-10T18:53:54.339981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:54.339981+0000', 'last_undegraded': '2023-06-10T18:53:54.339981+0000', 'last_fullsized': '2023-06-10T18:53:54.339981+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.616 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.4 is not active+clean 2023-06-10T18:53:58.617 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:53.327231+0000', 'last_change': '2023-06-10T18:53:53.327231+0000', 'last_active': '2023-06-10T18:53:53.327231+0000', 'last_peered': '2023-06-10T18:53:53.327231+0000', 'last_clean': '2023-06-10T18:53:53.327231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:53.327231+0000', 'last_undegraded': '2023-06-10T18:53:53.327231+0000', 'last_fullsized': '2023-06-10T18:53:53.327231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.618 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.4 is not active+clean 2023-06-10T18:53:58.618 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:54.339981+0000', 'last_change': '2023-06-10T18:53:54.339981+0000', 'last_active': '2023-06-10T18:53:54.339981+0000', 'last_peered': '2023-06-10T18:53:54.339981+0000', 'last_clean': '2023-06-10T18:53:54.339981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:54.339981+0000', 'last_undegraded': '2023-06-10T18:53:54.339981+0000', 'last_fullsized': '2023-06-10T18:53:54.339981+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.619 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.7 is not active+clean 2023-06-10T18:53:58.619 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:53.327231+0000', 'last_change': '2023-06-10T18:53:53.327231+0000', 'last_active': '2023-06-10T18:53:53.327231+0000', 'last_peered': '2023-06-10T18:53:53.327231+0000', 'last_clean': '2023-06-10T18:53:53.327231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:53.327231+0000', 'last_undegraded': '2023-06-10T18:53:53.327231+0000', 'last_fullsized': '2023-06-10T18:53:53.327231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.620 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.5 is not active+clean 2023-06-10T18:53:58.621 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:54.339981+0000', 'last_change': '2023-06-10T18:53:54.339981+0000', 'last_active': '2023-06-10T18:53:54.339981+0000', 'last_peered': '2023-06-10T18:53:54.339981+0000', 'last_clean': '2023-06-10T18:53:54.339981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:54.339981+0000', 'last_undegraded': '2023-06-10T18:53:54.339981+0000', 'last_fullsized': '2023-06-10T18:53:54.339981+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.621 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.6 is not active+clean 2023-06-10T18:53:58.622 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:53.327231+0000', 'last_change': '2023-06-10T18:53:53.327231+0000', 'last_active': '2023-06-10T18:53:53.327231+0000', 'last_peered': '2023-06-10T18:53:53.327231+0000', 'last_clean': '2023-06-10T18:53:53.327231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:53.327231+0000', 'last_undegraded': '2023-06-10T18:53:53.327231+0000', 'last_fullsized': '2023-06-10T18:53:53.327231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.623 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.6 is not active+clean 2023-06-10T18:53:58.623 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:54.339981+0000', 'last_change': '2023-06-10T18:53:54.339981+0000', 'last_active': '2023-06-10T18:53:54.339981+0000', 'last_peered': '2023-06-10T18:53:54.339981+0000', 'last_clean': '2023-06-10T18:53:54.339981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:54.339981+0000', 'last_undegraded': '2023-06-10T18:53:54.339981+0000', 'last_fullsized': '2023-06-10T18:53:54.339981+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.624 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.5 is not active+clean 2023-06-10T18:53:58.624 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:53.327231+0000', 'last_change': '2023-06-10T18:53:53.327231+0000', 'last_active': '2023-06-10T18:53:53.327231+0000', 'last_peered': '2023-06-10T18:53:53.327231+0000', 'last_clean': '2023-06-10T18:53:53.327231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:53.327231+0000', 'last_undegraded': '2023-06-10T18:53:53.327231+0000', 'last_fullsized': '2023-06-10T18:53:53.327231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.625 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.0 is not active+clean 2023-06-10T18:53:58.625 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:54.339981+0000', 'last_change': '2023-06-10T18:53:54.339981+0000', 'last_active': '2023-06-10T18:53:54.339981+0000', 'last_peered': '2023-06-10T18:53:54.339981+0000', 'last_clean': '2023-06-10T18:53:54.339981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:54.339981+0000', 'last_undegraded': '2023-06-10T18:53:54.339981+0000', 'last_fullsized': '2023-06-10T18:53:54.339981+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.625 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3 is not active+clean 2023-06-10T18:53:58.626 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:53.327231+0000', 'last_change': '2023-06-10T18:53:53.327231+0000', 'last_active': '2023-06-10T18:53:53.327231+0000', 'last_peered': '2023-06-10T18:53:53.327231+0000', 'last_clean': '2023-06-10T18:53:53.327231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:53.327231+0000', 'last_undegraded': '2023-06-10T18:53:53.327231+0000', 'last_fullsized': '2023-06-10T18:53:53.327231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.626 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1 is not active+clean 2023-06-10T18:53:58.627 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:54.339981+0000', 'last_change': '2023-06-10T18:53:54.339981+0000', 'last_active': '2023-06-10T18:53:54.339981+0000', 'last_peered': '2023-06-10T18:53:54.339981+0000', 'last_clean': '2023-06-10T18:53:54.339981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:54.339981+0000', 'last_undegraded': '2023-06-10T18:53:54.339981+0000', 'last_fullsized': '2023-06-10T18:53:54.339981+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.627 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2 is not active+clean 2023-06-10T18:53:58.627 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:53.327231+0000', 'last_change': '2023-06-10T18:53:53.327231+0000', 'last_active': '2023-06-10T18:53:53.327231+0000', 'last_peered': '2023-06-10T18:53:53.327231+0000', 'last_clean': '2023-06-10T18:53:53.327231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:53.327231+0000', 'last_undegraded': '2023-06-10T18:53:53.327231+0000', 'last_fullsized': '2023-06-10T18:53:53.327231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.628 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2 is not active+clean 2023-06-10T18:53:58.628 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:54.339981+0000', 'last_change': '2023-06-10T18:53:54.339981+0000', 'last_active': '2023-06-10T18:53:54.339981+0000', 'last_peered': '2023-06-10T18:53:54.339981+0000', 'last_clean': '2023-06-10T18:53:54.339981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:54.339981+0000', 'last_undegraded': '2023-06-10T18:53:54.339981+0000', 'last_fullsized': '2023-06-10T18:53:54.339981+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.628 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1 is not active+clean 2023-06-10T18:53:58.629 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:53.327231+0000', 'last_change': '2023-06-10T18:53:53.327231+0000', 'last_active': '2023-06-10T18:53:53.327231+0000', 'last_peered': '2023-06-10T18:53:53.327231+0000', 'last_clean': '2023-06-10T18:53:53.327231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:53.327231+0000', 'last_undegraded': '2023-06-10T18:53:53.327231+0000', 'last_fullsized': '2023-06-10T18:53:53.327231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.629 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3 is not active+clean 2023-06-10T18:53:58.629 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:54.339981+0000', 'last_change': '2023-06-10T18:53:54.339981+0000', 'last_active': '2023-06-10T18:53:54.339981+0000', 'last_peered': '2023-06-10T18:53:54.339981+0000', 'last_clean': '2023-06-10T18:53:54.339981+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:54.339981+0000', 'last_undegraded': '2023-06-10T18:53:54.339981+0000', 'last_fullsized': '2023-06-10T18:53:54.339981+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:54.339981+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.630 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.0 is not active+clean 2023-06-10T18:53:58.630 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:53:53.327231+0000', 'last_change': '2023-06-10T18:53:53.327231+0000', 'last_active': '2023-06-10T18:53:53.327231+0000', 'last_peered': '2023-06-10T18:53:53.327231+0000', 'last_clean': '2023-06-10T18:53:53.327231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:53:53.327231+0000', 'last_undegraded': '2023-06-10T18:53:53.327231+0000', 'last_fullsized': '2023-06-10T18:53:53.327231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'last_clean_scrub_stamp': '2023-06-10T18:53:53.327231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:53:58.631 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-06-10T18:53:58.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.752+0000 7fa45a26e640 1 Processor -- start 2023-06-10T18:53:58.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.752+0000 7fa45a26e640 1 -- start start 2023-06-10T18:53:58.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.752+0000 7fa45a26e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4540afe30 0x7fa45415fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:58.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.752+0000 7fa45a26e640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4540cda50 con 0x7fa4540cb7e0 2023-06-10T18:53:58.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.752+0000 7fa45a26e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa454159740 con 0x7fa454159370 2023-06-10T18:53:58.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.752+0000 7fa45a26e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4540cd1b0 con 0x7fa4540afe30 2023-06-10T18:53:58.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.752+0000 7fa4537fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fa4540cb7e0 0x7fa4540af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:32818/0 (socket says 172.21.15.53:32818) 2023-06-10T18:53:58.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.752+0000 7fa4537fe640 1 -- 172.21.15.53:0/2324712160 learned_addr learned my addr 172.21.15.53:0/2324712160 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:53:58.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.752+0000 7fa45880b640 1 --2- 172.21.15.53:0/2324712160 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4540afe30 0x7fa45415fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:58.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.756+0000 7fa452ffd640 1 -- 172.21.15.53:0/2324712160 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1062088345 0 0) 0x7fa4540cda50 con 0x7fa4540cb7e0 2023-06-10T18:53:58.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.756+0000 7fa452ffd640 1 -- 172.21.15.53:0/2324712160 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa43c003530 con 0x7fa4540cb7e0 2023-06-10T18:53:58.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.756+0000 7fa452ffd640 1 -- 172.21.15.53:0/2324712160 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 779808780 0 0) 0x7fa454159740 con 0x7fa454159370 2023-06-10T18:53:58.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.756+0000 7fa452ffd640 1 -- 172.21.15.53:0/2324712160 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4540cda50 con 0x7fa454159370 2023-06-10T18:53:58.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.756+0000 7fa452ffd640 1 -- 172.21.15.53:0/2324712160 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 765213147 0 0) 0x7fa43c003530 con 0x7fa4540cb7e0 2023-06-10T18:53:58.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.756+0000 7fa452ffd640 1 -- 172.21.15.53:0/2324712160 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4540afe30 msgr2=0x7fa45415fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:58.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.756+0000 7fa452ffd640 1 --2- 172.21.15.53:0/2324712160 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4540afe30 0x7fa45415fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:58.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.756+0000 7fa452ffd640 1 -- 172.21.15.53:0/2324712160 >> v1:172.21.15.117:6789/0 conn(0x7fa454159370 legacy=0x7fa4540c8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:58.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.756+0000 7fa452ffd640 1 -- 172.21.15.53:0/2324712160 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4540cd490 con 0x7fa4540cb7e0 2023-06-10T18:53:58.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.756+0000 7fa452ffd640 1 -- 172.21.15.53:0/2324712160 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fa448001a00 con 0x7fa4540cb7e0 2023-06-10T18:53:58.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.756+0000 7fa452ffd640 1 -- 172.21.15.53:0/2324712160 >> v1:172.21.15.53:6789/0 conn(0x7fa4540cb7e0 legacy=0x7fa4540af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:58.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.756+0000 7fa452ffd640 1 --2- 172.21.15.53:0/2324712160 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa43c003b40 0x7fa43c003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:58.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.756+0000 7fa452ffd640 1 --2- 172.21.15.53:0/2324712160 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa43c0047d0 0x7fa43c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:58.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.756+0000 7fa452ffd640 1 --2- 172.21.15.53:0/2324712160 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4540afe30 0x7fa43c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:58.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.756+0000 7fa452ffd640 1 -- 172.21.15.53:0/2324712160 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4540cd1b0 con 0x7fa43c0047d0 2023-06-10T18:53:58.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.756+0000 7fa452ffd640 1 -- 172.21.15.53:0/2324712160 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa43c00ba70 con 0x7fa43c003b40 2023-06-10T18:53:58.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.756+0000 7fa452ffd640 1 -- 172.21.15.53:0/2324712160 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa43c00bc30 con 0x7fa4540afe30 2023-06-10T18:53:58.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.756+0000 7fa4537fe640 1 --2- 172.21.15.53:0/2324712160 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa43c0047d0 0x7fa43c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:58.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.756+0000 7fa45880b640 1 --2- 172.21.15.53:0/2324712160 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4540afe30 0x7fa43c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:58.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.756+0000 7fa453fff640 1 --2- 172.21.15.53:0/2324712160 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa43c003b40 0x7fa43c003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:58.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.756+0000 7fa4537fe640 1 -- 172.21.15.53:0/2324712160 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4540afe30 msgr2=0x7fa43c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:58.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.756+0000 7fa4537fe640 1 --2- 172.21.15.53:0/2324712160 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa4540afe30 0x7fa43c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:58.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.756+0000 7fa4537fe640 1 -- 172.21.15.53:0/2324712160 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa43c003b40 msgr2=0x7fa43c003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:58.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.756+0000 7fa4537fe640 1 --2- 172.21.15.53:0/2324712160 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa43c003b40 0x7fa43c003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:58.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.756+0000 7fa4537fe640 1 -- 172.21.15.53:0/2324712160 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa43c003530 con 0x7fa43c0047d0 2023-06-10T18:53:58.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.756+0000 7fa4537fe640 1 --2- 172.21.15.53:0/2324712160 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa43c0047d0 0x7fa43c004c40 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fa448002240 tx=0x7fa44801d1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92ea00b7b604bf6e server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:58.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.756+0000 7fa452ffd640 1 -- 172.21.15.53:0/2324712160 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4480ad630 con 0x7fa43c0047d0 2023-06-10T18:53:58.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.756+0000 7fa452ffd640 1 -- 172.21.15.53:0/2324712160 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4480a8070 con 0x7fa43c0047d0 2023-06-10T18:53:58.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.756+0000 7fa452ffd640 1 -- 172.21.15.53:0/2324712160 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4480ad9f0 con 0x7fa43c0047d0 2023-06-10T18:53:58.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.756+0000 7fa45a26e640 1 -- 172.21.15.53:0/2324712160 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa43c0047d0 msgr2=0x7fa43c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:58.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.756+0000 7fa45a26e640 1 --2- 172.21.15.53:0/2324712160 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa43c0047d0 0x7fa43c004c40 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fa448002240 tx=0x7fa44801d1c0 comp rx=0 tx=0).stop 2023-06-10T18:53:58.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.756+0000 7fa45880b640 1 -- 172.21.15.53:0/2324712160 reap_dead start 2023-06-10T18:53:58.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.756+0000 7fa45a26e640 1 -- 172.21.15.53:0/2324712160 shutdown_connections 2023-06-10T18:53:58.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.756+0000 7fa45a26e640 1 -- 172.21.15.53:0/2324712160 >> 172.21.15.53:0/2324712160 conn(0x7fa4540cdca0 msgr2=0x7fa4540ce0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:58.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.760+0000 7fa45a26e640 1 -- 172.21.15.53:0/2324712160 shutdown_connections 2023-06-10T18:53:58.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.760+0000 7fa45a26e640 1 -- 172.21.15.53:0/2324712160 wait complete. 2023-06-10T18:53:58.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.760+0000 7fa45a26e640 1 Processor -- start 2023-06-10T18:53:58.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.760+0000 7fa45a26e640 1 -- start start 2023-06-10T18:53:58.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.760+0000 7fa45a26e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa43c0047d0 0x7fa4540b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:58.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.760+0000 7fa45a26e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa45414ccf0 0x7fa4540af0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:58.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.760+0000 7fa45a26e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4540b1350 0x7fa4540b17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:58.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.760+0000 7fa45a26e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4540c2240 con 0x7fa4540b1350 2023-06-10T18:53:58.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.760+0000 7fa45a26e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4540b1d00 con 0x7fa43c0047d0 2023-06-10T18:53:58.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.760+0000 7fa45a26e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4540b3950 con 0x7fa45414ccf0 2023-06-10T18:53:58.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.760+0000 7fa45880b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4540b1350 0x7fa4540b17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:58.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.760+0000 7fa45880b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4540b1350 0x7fa4540b17c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33832/0 (socket says 172.21.15.53:33832) 2023-06-10T18:53:58.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.760+0000 7fa45880b640 1 -- 172.21.15.53:0/1424586989 learned_addr learned my addr 172.21.15.53:0/1424586989 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:58.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.760+0000 7fa453fff640 1 --2- 172.21.15.53:0/1424586989 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa43c0047d0 0x7fa4540b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:58.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.760+0000 7fa4537fe640 1 --2- 172.21.15.53:0/1424586989 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa45414ccf0 0x7fa4540af0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:58.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.760+0000 7fa45880b640 1 -- 172.21.15.53:0/1424586989 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa45414ccf0 msgr2=0x7fa4540af0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:58.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.760+0000 7fa45880b640 1 --2- 172.21.15.53:0/1424586989 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa45414ccf0 0x7fa4540af0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:58.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.760+0000 7fa45880b640 1 -- 172.21.15.53:0/1424586989 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa43c0047d0 msgr2=0x7fa4540b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:58.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.760+0000 7fa45880b640 1 --2- 172.21.15.53:0/1424586989 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa43c0047d0 0x7fa4540b31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:58.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.760+0000 7fa45880b640 1 -- 172.21.15.53:0/1424586989 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4540b3700 con 0x7fa4540b1350 2023-06-10T18:53:58.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.760+0000 7fa4537fe640 1 --2- 172.21.15.53:0/1424586989 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa45414ccf0 0x7fa4540af0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:53:58.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.760+0000 7fa453fff640 1 --2- 172.21.15.53:0/1424586989 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa43c0047d0 0x7fa4540b31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:53:58.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.760+0000 7fa45880b640 1 --2- 172.21.15.53:0/1424586989 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4540b1350 0x7fa4540b17c0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fa45406cb90 tx=0x7fa44c011550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:58.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.760+0000 7fa450ff9640 1 -- 172.21.15.53:0/1424586989 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa44c004500 con 0x7fa4540b1350 2023-06-10T18:53:58.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.760+0000 7fa450ff9640 1 -- 172.21.15.53:0/1424586989 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa44c0118d0 con 0x7fa4540b1350 2023-06-10T18:53:58.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.760+0000 7fa450ff9640 1 -- 172.21.15.53:0/1424586989 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa44c011c80 con 0x7fa4540b1350 2023-06-10T18:53:58.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.760+0000 7fa45a26e640 1 -- 172.21.15.53:0/1424586989 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4540c18e0 con 0x7fa4540b1350 2023-06-10T18:53:58.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.760+0000 7fa45a26e640 1 -- 172.21.15.53:0/1424586989 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4540c1e60 con 0x7fa4540b1350 2023-06-10T18:53:58.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.764+0000 7fa45a26e640 1 -- 172.21.15.53:0/1424586989 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4540c2380 con 0x7fa4540b1350 2023-06-10T18:53:58.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.764+0000 7fa450ff9640 1 -- 172.21.15.53:0/1424586989 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa44c003620 con 0x7fa4540b1350 2023-06-10T18:53:58.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.764+0000 7fa450ff9640 1 --2- 172.21.15.53:0/1424586989 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa440066280 0x7fa440068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:58.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.764+0000 7fa450ff9640 1 -- 172.21.15.53:0/1424586989 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa44c083770 con 0x7fa4540b1350 2023-06-10T18:53:58.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.764+0000 7fa453fff640 1 --2- 172.21.15.53:0/1424586989 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa440066280 0x7fa440068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:58.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.764+0000 7fa453fff640 1 --2- 172.21.15.53:0/1424586989 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa440066280 0x7fa440068730 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fa444005630 tx=0x7fa444009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:58.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.768+0000 7fa450ff9640 1 -- 172.21.15.53:0/1424586989 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa4540c2380 con 0x7fa4540b1350 2023-06-10T18:53:58.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.972+0000 7fa45a26e640 1 -- 172.21.15.53:0/1424586989 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fa4540c2380 con 0x7fa4540b1350 2023-06-10T18:53:58.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.976+0000 7fa450ff9640 1 -- 172.21.15.53:0/1424586989 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1183 (secure 0 0 0) 0x7fa4540c2380 con 0x7fa4540b1350 2023-06-10T18:53:58.984 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:53:58.984 INFO:teuthology.orchestra.run.smithi053.stdout:{"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":97,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":37,"num_osds":8,"num_up_osds":8,"osd_up_since":1686423152,"num_in_osds":8,"osd_in_since":1686423143,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":96},{"state_name":"active+clean","count":9}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":241725440,"bytes_avail":772852387840,"bytes_total":773094113280,"unknown_pgs_ratio":0.91428571939468384},"fsmap":{"epoch":13,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":5331}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2023-06-10T18:53:43.580104+0000","services":{"mds":{"daemons":{"summary":"","d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-06-10T18:53:58.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.976+0000 7fa45a26e640 1 -- 172.21.15.53:0/1424586989 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa440066280 msgr2=0x7fa440068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:58.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.976+0000 7fa45a26e640 1 --2- 172.21.15.53:0/1424586989 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa440066280 0x7fa440068730 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fa444005630 tx=0x7fa444009040 comp rx=0 tx=0).stop 2023-06-10T18:53:58.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.976+0000 7fa45a26e640 1 -- 172.21.15.53:0/1424586989 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4540b1350 msgr2=0x7fa4540b17c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:58.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.976+0000 7fa45a26e640 1 --2- 172.21.15.53:0/1424586989 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4540b1350 0x7fa4540b17c0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fa45406cb90 tx=0x7fa44c011550 comp rx=0 tx=0).stop 2023-06-10T18:53:58.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.976+0000 7fa45a26e640 1 -- 172.21.15.53:0/1424586989 shutdown_connections 2023-06-10T18:53:58.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.976+0000 7fa45a26e640 1 --2- 172.21.15.53:0/1424586989 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa440066280 0x7fa440068730 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:58.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.976+0000 7fa45a26e640 1 --2- 172.21.15.53:0/1424586989 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4540b1350 0x7fa4540b17c0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:58.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.976+0000 7fa45a26e640 1 --2- 172.21.15.53:0/1424586989 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa45414ccf0 0x7fa4540af0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:58.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.976+0000 7fa45a26e640 1 --2- 172.21.15.53:0/1424586989 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa43c0047d0 0x7fa4540b31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:58.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.976+0000 7fa45a26e640 1 -- 172.21.15.53:0/1424586989 >> 172.21.15.53:0/1424586989 conn(0x7fa4540cdca0 msgr2=0x7fa4540ca2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:58.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.976+0000 7fa45a26e640 1 -- 172.21.15.53:0/1424586989 shutdown_connections 2023-06-10T18:53:58.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:58.976+0000 7fa45a26e640 1 -- 172.21.15.53:0/1424586989 wait complete. 2023-06-10T18:53:59.001 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-06-10T18:53:59.002 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-10T18:53:59.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:59.104+0000 7f940fe39640 1 Processor -- start 2023-06-10T18:53:59.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:59.104+0000 7f940fe39640 1 -- start start 2023-06-10T18:53:59.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:59.104+0000 7f940fe39640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94080c9840 0x7f94080c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:59.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:59.104+0000 7f940fe39640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9408071060 0x7f94080af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:59.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:59.104+0000 7f940fe39640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9408159b50 con 0x7f94080afc60 2023-06-10T18:53:59.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:59.104+0000 7f940fe39640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94080ca150 con 0x7f9408071060 2023-06-10T18:53:59.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:59.104+0000 7f940fe39640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94080702a0 con 0x7f94080c9840 2023-06-10T18:53:59.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:59.104+0000 7f940e3d6640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f94080afc60 0x7f940815d2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:32828/0 (socket says 172.21.15.53:32828) 2023-06-10T18:53:59.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:59.104+0000 7f940e3d6640 1 -- 172.21.15.53:0/2574564055 learned_addr learned my addr 172.21.15.53:0/2574564055 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:53:59.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:59.108+0000 7f940dbd5640 1 --2- 172.21.15.53:0/2574564055 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94080c9840 0x7f94080c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:59.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:59.108+0000 7f940d3d4640 1 --2- 172.21.15.53:0/2574564055 >> v2:172.21.15.117:3300/0 conn(0x7f9408071060 0x7f94080af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:59.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:59.108+0000 7f940cbd3640 1 -- 172.21.15.53:0/2574564055 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2490445306 0 0) 0x7f9408159b50 con 0x7f94080afc60 2023-06-10T18:53:59.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:59.108+0000 7f940cbd3640 1 -- 172.21.15.53:0/2574564055 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93f4003530 con 0x7f94080afc60 2023-06-10T18:53:59.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:59.108+0000 7f940d3d4640 1 -- 172.21.15.53:0/2574564055 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94080c9840 msgr2=0x7f94080c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:53:59.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:59.108+0000 7f940d3d4640 1 --2- 172.21.15.53:0/2574564055 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94080c9840 0x7f94080c9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:59.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:59.108+0000 7f940d3d4640 1 -- 172.21.15.53:0/2574564055 >> v1:172.21.15.53:6789/0 conn(0x7f94080afc60 legacy=0x7f940815d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:59.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:59.108+0000 7f940d3d4640 1 -- 172.21.15.53:0/2574564055 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9408070580 con 0x7f9408071060 2023-06-10T18:53:59.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:59.108+0000 7f940dbd5640 1 --2- 172.21.15.53:0/2574564055 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94080c9840 0x7f94080c9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-10T18:53:59.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:59.108+0000 7f940d3d4640 1 --2- 172.21.15.53:0/2574564055 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9408071060 0x7f94080af720 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9404009d90 tx=0x7f940401c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eeb9b5ca89b8f30b server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:59.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:59.108+0000 7f940cbd3640 1 -- 172.21.15.53:0/2574564055 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94040a5900 con 0x7f9408071060 2023-06-10T18:53:59.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:59.108+0000 7f940cbd3640 1 -- 172.21.15.53:0/2574564055 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94040a5a60 con 0x7f9408071060 2023-06-10T18:53:59.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:59.108+0000 7f940cbd3640 1 -- 172.21.15.53:0/2574564055 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94040a5dd0 con 0x7f9408071060 2023-06-10T18:53:59.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:59.108+0000 7f940fe39640 1 -- 172.21.15.53:0/2574564055 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9408071060 msgr2=0x7f94080af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:59.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:59.108+0000 7f940fe39640 1 --2- 172.21.15.53:0/2574564055 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9408071060 0x7f94080af720 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9404009d90 tx=0x7f940401c920 comp rx=0 tx=0).stop 2023-06-10T18:53:59.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:59.108+0000 7f940fe39640 1 -- 172.21.15.53:0/2574564055 shutdown_connections 2023-06-10T18:53:59.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:59.108+0000 7f940fe39640 1 --2- 172.21.15.53:0/2574564055 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9408071060 0x7f94080af720 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:59.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:59.108+0000 7f940fe39640 1 --2- 172.21.15.53:0/2574564055 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94080c9840 0x7f94080c9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:59.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:59.108+0000 7f940fe39640 1 -- 172.21.15.53:0/2574564055 >> 172.21.15.53:0/2574564055 conn(0x7f940806a0d0 msgr2=0x7f94080ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:59.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:59.108+0000 7f940fe39640 1 -- 172.21.15.53:0/2574564055 shutdown_connections 2023-06-10T18:53:59.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:59.108+0000 7f940fe39640 1 -- 172.21.15.53:0/2574564055 wait complete. 2023-06-10T18:53:59.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:59.112+0000 7f940fe39640 1 Processor -- start 2023-06-10T18:53:59.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:59.112+0000 7f940fe39640 1 -- start start 2023-06-10T18:53:59.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:59.112+0000 7f940fe39640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9408071060 0x7f94081479c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:59.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:59.112+0000 7f940fe39640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94080afc60 0x7f94080aeef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:59.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:59.112+0000 7f940fe39640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94080c9840 0x7f94080af430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:59.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:59.112+0000 7f940fe39640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94080cc380 con 0x7f9408071060 2023-06-10T18:53:59.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:59.112+0000 7f940fe39640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9408162bf0 con 0x7f94080c9840 2023-06-10T18:53:59.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:59.112+0000 7f940fe39640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f940814b930 con 0x7f94080afc60 2023-06-10T18:53:59.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:59.112+0000 7f940dbd5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9408071060 0x7f94081479c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:59.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:59.112+0000 7f940dbd5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9408071060 0x7f94081479c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33846/0 (socket says 172.21.15.53:33846) 2023-06-10T18:53:59.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:59.112+0000 7f940dbd5640 1 -- 172.21.15.53:0/3996218381 learned_addr learned my addr 172.21.15.53:0/3996218381 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:53:59.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:59.112+0000 7f940d3d4640 1 --2- 172.21.15.53:0/3996218381 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94080afc60 0x7f94080aeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:59.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:59.112+0000 7f940e3d6640 1 --2- 172.21.15.53:0/3996218381 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94080c9840 0x7f94080af430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:59.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:59.112+0000 7f940dbd5640 1 -- 172.21.15.53:0/3996218381 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94080afc60 msgr2=0x7f94080aeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:59.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:59.112+0000 7f940dbd5640 1 --2- 172.21.15.53:0/3996218381 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94080afc60 0x7f94080aeef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:59.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:59.112+0000 7f940dbd5640 1 -- 172.21.15.53:0/3996218381 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94080c9840 msgr2=0x7f94080af430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:59.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:59.112+0000 7f940dbd5640 1 --2- 172.21.15.53:0/3996218381 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94080c9840 0x7f94080af430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:59.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:59.112+0000 7f940dbd5640 1 -- 172.21.15.53:0/3996218381 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93fc009420 con 0x7f9408071060 2023-06-10T18:53:59.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:59.112+0000 7f940dbd5640 1 --2- 172.21.15.53:0/3996218381 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9408071060 0x7f94081479c0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f93fc00e980 tx=0x7f93fc00ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:59.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:59.112+0000 7f93fa7fc640 1 -- 172.21.15.53:0/3996218381 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93fc00ca00 con 0x7f9408071060 2023-06-10T18:53:59.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:59.112+0000 7f93fa7fc640 1 -- 172.21.15.53:0/3996218381 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93fc00cb60 con 0x7f9408071060 2023-06-10T18:53:59.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:59.112+0000 7f940fe39640 1 -- 172.21.15.53:0/3996218381 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9404009a70 con 0x7f9408071060 2023-06-10T18:53:59.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:59.112+0000 7f93fa7fc640 1 -- 172.21.15.53:0/3996218381 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93fc013470 con 0x7f9408071060 2023-06-10T18:53:59.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:59.112+0000 7f940fe39640 1 -- 172.21.15.53:0/3996218381 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9408150c90 con 0x7f9408071060 2023-06-10T18:53:59.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:59.112+0000 7f940fe39640 1 -- 172.21.15.53:0/3996218381 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f940806fc90 con 0x7f9408071060 2023-06-10T18:53:59.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:59.116+0000 7f93fa7fc640 1 -- 172.21.15.53:0/3996218381 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f93fc0135d0 con 0x7f9408071060 2023-06-10T18:53:59.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:59.116+0000 7f93fa7fc640 1 --2- 172.21.15.53:0/3996218381 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f93ec066280 0x7f93ec068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:53:59.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:59.116+0000 7f93fa7fc640 1 -- 172.21.15.53:0/3996218381 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f93fc083f90 con 0x7f9408071060 2023-06-10T18:53:59.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:59.116+0000 7f940d3d4640 1 --2- 172.21.15.53:0/3996218381 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f93ec066280 0x7f93ec068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:53:59.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:59.116+0000 7f940d3d4640 1 --2- 172.21.15.53:0/3996218381 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f93ec066280 0x7f93ec068730 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f94040af000 tx=0x7f94040a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:53:59.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:59.120+0000 7f93fa7fc640 1 -- 172.21.15.53:0/3996218381 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f93fc0b4700 con 0x7f9408071060 2023-06-10T18:53:59.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:59.264+0000 7f940fe39640 1 -- 172.21.15.53:0/3996218381 --> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9408166660 con 0x7f93ec066280 2023-06-10T18:53:59.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:59.284+0000 7f93fa7fc640 1 -- 172.21.15.53:0/3996218381 <== mgr.4105 v2:172.21.15.117:6832/3061986771 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+294734 (secure 0 0 0) 0x7f94040a5c50 con 0x7f93ec066280 2023-06-10T18:53:59.295 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:53:59.296 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-06-10T18:53:59.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:59.288+0000 7f940fe39640 1 -- 172.21.15.53:0/3996218381 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f93ec066280 msgr2=0x7f93ec068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:59.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:59.288+0000 7f940fe39640 1 --2- 172.21.15.53:0/3996218381 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f93ec066280 0x7f93ec068730 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f94040af000 tx=0x7f94040a7070 comp rx=0 tx=0).stop 2023-06-10T18:53:59.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:59.288+0000 7f940fe39640 1 -- 172.21.15.53:0/3996218381 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9408071060 msgr2=0x7f94081479c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:53:59.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:59.288+0000 7f940fe39640 1 --2- 172.21.15.53:0/3996218381 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9408071060 0x7f94081479c0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f93fc00e980 tx=0x7f93fc00ee40 comp rx=0 tx=0).stop 2023-06-10T18:53:59.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:59.288+0000 7f940fe39640 1 -- 172.21.15.53:0/3996218381 shutdown_connections 2023-06-10T18:53:59.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:59.288+0000 7f940fe39640 1 --2- 172.21.15.53:0/3996218381 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f93ec066280 0x7f93ec068730 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:59.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:59.288+0000 7f940fe39640 1 --2- 172.21.15.53:0/3996218381 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94080c9840 0x7f94080af430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:59.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:59.288+0000 7f940fe39640 1 --2- 172.21.15.53:0/3996218381 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94080afc60 0x7f94080aeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:59.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:59.288+0000 7f940fe39640 1 --2- 172.21.15.53:0/3996218381 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9408071060 0x7f94081479c0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:53:59.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:59.288+0000 7f940fe39640 1 -- 172.21.15.53:0/3996218381 >> 172.21.15.53:0/3996218381 conn(0x7f940806a0d0 msgr2=0x7f94080adf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:53:59.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:59.288+0000 7f940fe39640 1 -- 172.21.15.53:0/3996218381 shutdown_connections 2023-06-10T18:53:59.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:53:59.288+0000 7f940fe39640 1 -- 172.21.15.53:0/3996218381 wait complete. 2023-06-10T18:53:59.312 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":73,"stamp":"2023-06-10T18:53:57.583830+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":31,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":236060,"kb_used_data":4060,"kb_used_omap":0,"kb_used_meta":231936,"kb_avail":754738660,"statfs":{"total":773094113280,"available":772852387840,"internally_reserved":0,"allocated":4157440,"data_stored":2368151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":237502464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.240979"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":191,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-06-10T18:53:48.498706+0000","last_change":"2023-06-10T18:52:34.951528+0000","last_active":"2023-06-10T18:53:48.498706+0000","last_peered":"2023-06-10T18:53:48.498706+0000","last_clean":"2023-06-10T18:53:48.498706+0000","last_became_active":"2023-06-10T18:52:34.949099+0000","last_became_peered":"2023-06-10T18:52:34.949099+0000","last_unstale":"2023-06-10T18:53:48.498706+0000","last_undegraded":"2023-06-10T18:53:48.498706+0000","last_fullsized":"2023-06-10T18:53:48.498706+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_clean_scrub_stamp":"2023-06-10T18:52:33.633295+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:34:53.541410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-06-10T18:53:49.872067+0000","last_change":"2023-06-10T18:52:40.506384+0000","last_active":"2023-06-10T18:53:49.872067+0000","last_peered":"2023-06-10T18:53:49.872067+0000","last_clean":"2023-06-10T18:53:49.872067+0000","last_became_active":"2023-06-10T18:52:40.505701+0000","last_became_peered":"2023-06-10T18:52:40.505701+0000","last_unstale":"2023-06-10T18:53:49.872067+0000","last_undegraded":"2023-06-10T18:53:49.872067+0000","last_fullsized":"2023-06-10T18:53:49.872067+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:34:59.382957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-06-10T18:53:48.498373+0000","last_change":"2023-06-10T18:52:40.512015+0000","last_active":"2023-06-10T18:53:48.498373+0000","last_peered":"2023-06-10T18:53:48.498373+0000","last_clean":"2023-06-10T18:53:48.498373+0000","last_became_active":"2023-06-10T18:52:40.511382+0000","last_became_peered":"2023-06-10T18:52:40.511382+0000","last_unstale":"2023-06-10T18:53:48.498373+0000","last_undegraded":"2023-06-10T18:53:48.498373+0000","last_fullsized":"2023-06-10T18:53:48.498373+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:10:48.195305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-06-10T18:53:49.887548+0000","last_change":"2023-06-10T18:52:40.671725+0000","last_active":"2023-06-10T18:53:49.887548+0000","last_peered":"2023-06-10T18:53:49.887548+0000","last_clean":"2023-06-10T18:53:49.887548+0000","last_became_active":"2023-06-10T18:52:40.671442+0000","last_became_peered":"2023-06-10T18:52:40.671442+0000","last_unstale":"2023-06-10T18:53:49.887548+0000","last_undegraded":"2023-06-10T18:53:49.887548+0000","last_fullsized":"2023-06-10T18:53:49.887548+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:08:32.109800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-06-10T18:53:49.872027+0000","last_change":"2023-06-10T18:52:40.510258+0000","last_active":"2023-06-10T18:53:49.872027+0000","last_peered":"2023-06-10T18:53:49.872027+0000","last_clean":"2023-06-10T18:53:49.872027+0000","last_became_active":"2023-06-10T18:52:40.509560+0000","last_became_peered":"2023-06-10T18:52:40.509560+0000","last_unstale":"2023-06-10T18:53:49.872027+0000","last_undegraded":"2023-06-10T18:53:49.872027+0000","last_fullsized":"2023-06-10T18:53:49.872027+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:10:48.195305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-06-10T18:53:50.386582+0000","last_change":"2023-06-10T18:52:40.672266+0000","last_active":"2023-06-10T18:53:50.386582+0000","last_peered":"2023-06-10T18:53:50.386582+0000","last_clean":"2023-06-10T18:53:50.386582+0000","last_became_active":"2023-06-10T18:52:40.671966+0000","last_became_peered":"2023-06-10T18:52:40.671966+0000","last_unstale":"2023-06-10T18:53:50.386582+0000","last_undegraded":"2023-06-10T18:53:50.386582+0000","last_fullsized":"2023-06-10T18:53:50.386582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:48:13.760693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-06-10T18:53:48.498349+0000","last_change":"2023-06-10T18:52:40.671084+0000","last_active":"2023-06-10T18:53:48.498349+0000","last_peered":"2023-06-10T18:53:48.498349+0000","last_clean":"2023-06-10T18:53:48.498349+0000","last_became_active":"2023-06-10T18:52:40.670697+0000","last_became_peered":"2023-06-10T18:52:40.670697+0000","last_unstale":"2023-06-10T18:53:48.498349+0000","last_undegraded":"2023-06-10T18:53:48.498349+0000","last_fullsized":"2023-06-10T18:53:48.498349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:49:02.712682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-06-10T18:53:50.386618+0000","last_change":"2023-06-10T18:52:40.514114+0000","last_active":"2023-06-10T18:53:50.386618+0000","last_peered":"2023-06-10T18:53:50.386618+0000","last_clean":"2023-06-10T18:53:50.386618+0000","last_became_active":"2023-06-10T18:52:40.513638+0000","last_became_peered":"2023-06-10T18:52:40.513638+0000","last_unstale":"2023-06-10T18:53:50.386618+0000","last_undegraded":"2023-06-10T18:53:50.386618+0000","last_fullsized":"2023-06-10T18:53:50.386618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:40:18.586434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:54.339981+0000","last_change":"2023-06-10T18:53:54.339981+0000","last_active":"2023-06-10T18:53:54.339981+0000","last_peered":"2023-06-10T18:53:54.339981+0000","last_clean":"2023-06-10T18:53:54.339981+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:54.339981+0000","last_undegraded":"2023-06-10T18:53:54.339981+0000","last_fullsized":"2023-06-10T18:53:54.339981+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:53:53.327231+0000","last_change":"2023-06-10T18:53:53.327231+0000","last_active":"2023-06-10T18:53:53.327231+0000","last_peered":"2023-06-10T18:53:53.327231+0000","last_clean":"2023-06-10T18:53:53.327231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:53:53.327231+0000","last_undegraded":"2023-06-10T18:53:53.327231+0000","last_fullsized":"2023-06-10T18:53:53.327231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-06-10T18:53:50.386316+0000","last_change":"2023-06-10T18:52:40.515396+0000","last_active":"2023-06-10T18:53:50.386316+0000","last_peered":"2023-06-10T18:53:50.386316+0000","last_clean":"2023-06-10T18:53:50.386316+0000","last_became_active":"2023-06-10T18:52:40.514663+0000","last_became_peered":"2023-06-10T18:52:40.514663+0000","last_unstale":"2023-06-10T18:53:50.386316+0000","last_undegraded":"2023-06-10T18:53:50.386316+0000","last_fullsized":"2023-06-10T18:53:50.386316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:48:33.008902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27896,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343944,"statfs":{"total":96636764160,"available":96608198656,"internally_reserved":0,"allocated":966656,"data_stored":739177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.4430000000000001},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":1.206}]},{"osd":1,"last update":"Sat Jun 10 18:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":1.377},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.151}]},{"osd":2,"last update":"Sat Jun 10 18:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.70999999999999996}]},{"osd":3,"last update":"Sat Jun 10 18:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":1.242},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":1.2769999999999999}]},{"osd":4,"last update":"Sat Jun 10 18:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":1.3480000000000001},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":1.411}]},{"osd":5,"last update":"Sat Jun 10 18:53:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.806,"5min":1.806,"15min":1.806},"last":1.5569999999999999},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":1.522}]},{"osd":6,"last update":"Sat Jun 10 18:53:35 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.93400000000000005},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":1.3160000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":372736,"data_stored":148809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.84999999999999998}]},{"osd":1,"last update":"Sat Jun 10 18:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.90400000000000003}]},{"osd":2,"last update":"Sat Jun 10 18:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":1.0149999999999999},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.57999999999999996}]},{"osd":3,"last update":"Sat Jun 10 18:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":1.1579999999999999}]},{"osd":4,"last update":"Sat Jun 10 18:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":1.044},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":1.2}]},{"osd":5,"last update":"Sat Jun 10 18:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.97699999999999998},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":1.1279999999999999}]},{"osd":7,"last update":"Sat Jun 10 18:53:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":1.069}]}]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":372736,"data_stored":148809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":0.753}]},{"osd":1,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":1.0489999999999999},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.78,"5min":1.78,"15min":1.78},"last":0.72199999999999998}]},{"osd":2,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.67200000000000004}]},{"osd":3,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":0.79300000000000004},{"interface":"front","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":1.097}]},{"osd":4,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.5249999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.88400000000000001},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":0.93000000000000005}]},{"osd":6,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":0.98499999999999999},{"interface":"front","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.1439999999999999}]},{"osd":7,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.873,"5min":1.873,"15min":1.873},"last":1.129},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.1759999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27316,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":372736,"data_stored":148809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:53:37 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.498},{"interface":"front","average":{"1min":0.879,"5min":0.879,"15min":0.879},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.73,"5min":1.73,"15min":1.73},"last":0.88900000000000001}]},{"osd":1,"last update":"Sat Jun 10 18:53:37 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.0289999999999999}]},{"osd":2,"last update":"Sat Jun 10 18:53:37 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.71999999999999997},{"interface":"front","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.548,"5min":1.548,"15min":1.548},"last":0.77200000000000002}]},{"osd":3,"last update":"Sat Jun 10 18:53:37 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.82699999999999996}]},{"osd":5,"last update":"Sat Jun 10 18:53:37 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":1.2110000000000001}]},{"osd":6,"last update":"Sat Jun 10 18:53:37 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":2.2639999999999998,"5min":2.2639999999999998,"15min":2.2639999999999998},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":1.0760000000000001}]},{"osd":7,"last update":"Sat Jun 10 18:53:37 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.081,"5min":1.081,"15min":1.081},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":1.1060000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":360,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":368640,"data_stored":147790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.56299999999999994}]},{"osd":1,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.434},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.52800000000000002}]},{"osd":2,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.9530000000000001,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.60099999999999998}]},{"osd":4,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.488,"5min":1.488,"15min":1.488},"last":1.218},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.97599999999999998}]},{"osd":5,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":2.024,"5min":2.024,"15min":2.024},"last":1.075},{"interface":"front","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.724,"5min":1.724,"15min":1.724},"last":0.92500000000000004}]},{"osd":6,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.8500000000000001,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.78,"5min":1.78,"15min":1.78},"last":1.0369999999999999}]},{"osd":7,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.93200000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":372736,"data_stored":148809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.495}]},{"osd":1,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.60699999999999998}]},{"osd":3,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.56299999999999994}]},{"osd":4,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.625},{"interface":"front","average":{"1min":1.04,"5min":1.04,"15min":1.04},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.67400000000000004}]},{"osd":5,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.556,"5min":1.556,"15min":1.556},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.95399999999999996}]},{"osd":6,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.98699999999999999},{"interface":"front","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.81999999999999995}]},{"osd":7,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.88800000000000001},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":1.01}]}]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":360,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":368640,"data_stored":147790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:53:34 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":0.53500000000000003}]},{"osd":2,"last update":"Sat Jun 10 18:53:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.85899999999999999}]},{"osd":3,"last update":"Sat Jun 10 18:53:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":2.1749999999999998,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":0.73199999999999998}]},{"osd":4,"last update":"Sat Jun 10 18:53:34 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":1.097},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":2.218,"5min":2.218,"15min":2.218},"last":1.349}]},{"osd":5,"last update":"Sat Jun 10 18:53:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.8620000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":2.0190000000000001,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":0.92300000000000004}]},{"osd":6,"last update":"Sat Jun 10 18:53:34 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":2.0720000000000001,"5min":2.0720000000000001,"15min":2.0720000000000001},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.774,"5min":1.774,"15min":1.774},"last":1.0389999999999999}]},{"osd":7,"last update":"Sat Jun 10 18:53:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":2.105,"5min":2.105,"15min":2.105},"last":1.4330000000000001},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":2.2570000000000001,"5min":2.2570000000000001,"15min":2.2570000000000001},"last":1.0620000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31988,"kb_used_data":940,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339852,"statfs":{"total":96636764160,"available":96604008448,"internally_reserved":0,"allocated":962560,"data_stored":738158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jun 10 18:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.65000000000000002}]},{"osd":2,"last update":"Sat Jun 10 18:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.48899999999999999}]},{"osd":3,"last update":"Sat Jun 10 18:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.829,"5min":1.829,"15min":1.829},"last":0.61499999999999999}]},{"osd":4,"last update":"Sat Jun 10 18:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.9510000000000001,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":0.67600000000000005}]},{"osd":5,"last update":"Sat Jun 10 18:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.75,"5min":1.75,"15min":1.75},"last":1.103}]},{"osd":6,"last update":"Sat Jun 10 18:53:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":2.04,"5min":2.04,"15min":2.04},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":0.90200000000000002}]},{"osd":7,"last update":"Sat Jun 10 18:53:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.98799999999999999},{"interface":"front","average":{"1min":1.048,"5min":1.048,"15min":1.048},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.9830000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.153}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-10T18:54:02.319 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-10T18:54:02.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.444+0000 7fae08828640 1 Processor -- start 2023-06-10T18:54:02.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.444+0000 7fae08828640 1 -- start start 2023-06-10T18:54:02.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.448+0000 7fae08828640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fae040cb870 0x7fae040af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:02.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.448+0000 7fae08828640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae040afc60 0x7fae040aba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:02.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.448+0000 7fae08828640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae041600d0 con 0x7fae040c9750 2023-06-10T18:54:02.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.448+0000 7fae08828640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae040cd990 con 0x7fae040cb870 2023-06-10T18:54:02.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.448+0000 7fae08828640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae040b00e0 con 0x7fae040afc60 2023-06-10T18:54:02.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.448+0000 7fae01d9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fae040cb870 0x7fae040af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:02.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.448+0000 7fae0259c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fae040c9750 0x7fae040aced0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41004/0 (socket says 172.21.15.53:41004) 2023-06-10T18:54:02.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.448+0000 7fae0259c640 1 -- 172.21.15.53:0/102128943 learned_addr learned my addr 172.21.15.53:0/102128943 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:54:02.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.448+0000 7fae02d9d640 1 --2- 172.21.15.53:0/102128943 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae040afc60 0x7fae040aba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:02.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.448+0000 7fae01d9b640 1 -- 172.21.15.53:0/102128943 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae040afc60 msgr2=0x7fae040aba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:54:02.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.448+0000 7fae01d9b640 1 --2- 172.21.15.53:0/102128943 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae040afc60 0x7fae040aba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:02.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.448+0000 7fae01d9b640 1 -- 172.21.15.53:0/102128943 >> v1:172.21.15.53:6789/0 conn(0x7fae040c9750 legacy=0x7fae040aced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:02.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.448+0000 7fae01d9b640 1 -- 172.21.15.53:0/102128943 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae04160370 con 0x7fae040cb870 2023-06-10T18:54:02.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.448+0000 7fae01d9b640 1 --2- 172.21.15.53:0/102128943 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae040cb870 0x7fae040af720 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fadf40097c0 tx=0x7fadf401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81f0bd56c07c4f55 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:02.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.448+0000 7fae0159a640 1 -- 172.21.15.53:0/102128943 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf40a6040 con 0x7fae040cb870 2023-06-10T18:54:02.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.448+0000 7fae0159a640 1 -- 172.21.15.53:0/102128943 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadf40aa600 con 0x7fae040cb870 2023-06-10T18:54:02.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.448+0000 7fae0159a640 1 -- 172.21.15.53:0/102128943 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf40aa990 con 0x7fae040cb870 2023-06-10T18:54:02.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.448+0000 7fae08828640 1 -- 172.21.15.53:0/102128943 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae040cb870 msgr2=0x7fae040af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:02.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.448+0000 7fae08828640 1 --2- 172.21.15.53:0/102128943 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae040cb870 0x7fae040af720 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fadf40097c0 tx=0x7fadf401c480 comp rx=0 tx=0).stop 2023-06-10T18:54:02.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.448+0000 7fae08828640 1 -- 172.21.15.53:0/102128943 shutdown_connections 2023-06-10T18:54:02.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.448+0000 7fae08828640 1 --2- 172.21.15.53:0/102128943 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae040cb870 0x7fae040af720 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:02.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.448+0000 7fae08828640 1 --2- 172.21.15.53:0/102128943 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae040afc60 0x7fae040aba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:02.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.448+0000 7fae08828640 1 -- 172.21.15.53:0/102128943 >> 172.21.15.53:0/102128943 conn(0x7fae0406a0d0 msgr2=0x7fae040ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:54:02.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.448+0000 7fae08828640 1 -- 172.21.15.53:0/102128943 shutdown_connections 2023-06-10T18:54:02.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.448+0000 7fae08828640 1 -- 172.21.15.53:0/102128943 wait complete. 2023-06-10T18:54:02.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.452+0000 7fae08828640 1 Processor -- start 2023-06-10T18:54:02.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.452+0000 7fae08828640 1 -- start start 2023-06-10T18:54:02.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.452+0000 7fae08828640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae040afc60 0x7fae040af5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:02.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.452+0000 7fae08828640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae040c9750 0x7fae0414f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:02.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.452+0000 7fae08828640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae040cb870 0x7fae041597d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:02.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.452+0000 7fae08828640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae040af1d0 con 0x7fae040c9750 2023-06-10T18:54:02.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.452+0000 7fae08828640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae0414f610 con 0x7fae040afc60 2023-06-10T18:54:02.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.452+0000 7fae08828640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae040ae550 con 0x7fae040cb870 2023-06-10T18:54:02.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.452+0000 7fae01d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae040c9750 0x7fae0414f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:02.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.452+0000 7fae01d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae040c9750 0x7fae0414f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55670/0 (socket says 172.21.15.53:55670) 2023-06-10T18:54:02.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.452+0000 7fae01d9b640 1 -- 172.21.15.53:0/221033136 learned_addr learned my addr 172.21.15.53:0/221033136 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:54:02.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.452+0000 7fae02d9d640 1 --2- 172.21.15.53:0/221033136 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae040cb870 0x7fae041597d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:02.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.452+0000 7fae01d9b640 1 -- 172.21.15.53:0/221033136 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae040cb870 msgr2=0x7fae041597d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:02.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.452+0000 7fae01d9b640 1 --2- 172.21.15.53:0/221033136 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae040cb870 0x7fae041597d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:02.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.452+0000 7fae01d9b640 1 -- 172.21.15.53:0/221033136 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae040afc60 msgr2=0x7fae040af5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:02.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.452+0000 7fae01d9b640 1 --2- 172.21.15.53:0/221033136 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae040afc60 0x7fae040af5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:02.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.452+0000 7fae01d9b640 1 -- 172.21.15.53:0/221033136 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadf4009420 con 0x7fae040c9750 2023-06-10T18:54:02.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.452+0000 7fae01d9b640 1 --2- 172.21.15.53:0/221033136 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae040c9750 0x7fae0414f0d0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fadf401ab30 tx=0x7fadf4019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:02.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.452+0000 7fadf2ffd640 1 -- 172.21.15.53:0/221033136 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf40aae40 con 0x7fae040c9750 2023-06-10T18:54:02.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.452+0000 7fadf2ffd640 1 -- 172.21.15.53:0/221033136 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadf40be450 con 0x7fae040c9750 2023-06-10T18:54:02.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.452+0000 7fae08828640 1 -- 172.21.15.53:0/221033136 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae040ae830 con 0x7fae040c9750 2023-06-10T18:54:02.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.452+0000 7fadf2ffd640 1 -- 172.21.15.53:0/221033136 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf40be7e0 con 0x7fae040c9750 2023-06-10T18:54:02.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.452+0000 7fae08828640 1 -- 172.21.15.53:0/221033136 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae040aedf0 con 0x7fae040c9750 2023-06-10T18:54:02.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.452+0000 7fae08828640 1 -- 172.21.15.53:0/221033136 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae040af440 con 0x7fae040c9750 2023-06-10T18:54:02.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.456+0000 7fadf2ffd640 1 -- 172.21.15.53:0/221033136 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fadf40b33f0 con 0x7fae040c9750 2023-06-10T18:54:02.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.456+0000 7fadf2ffd640 1 --2- 172.21.15.53:0/221033136 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fade40662b0 0x7fade4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:02.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.456+0000 7fadf2ffd640 1 -- 172.21.15.53:0/221033136 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fadf411dfe0 con 0x7fae040c9750 2023-06-10T18:54:02.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.456+0000 7fae0259c640 1 --2- 172.21.15.53:0/221033136 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fade40662b0 0x7fade4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:02.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.456+0000 7fae0259c640 1 --2- 172.21.15.53:0/221033136 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fade40662b0 0x7fade4068760 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fadf8001600 tx=0x7fadf8007a50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:02.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.460+0000 7fadf2ffd640 1 -- 172.21.15.53:0/221033136 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fadf40eb460 con 0x7fae040c9750 2023-06-10T18:54:02.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.608+0000 7fae08828640 1 -- 172.21.15.53:0/221033136 --> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fae040ac760 con 0x7fade40662b0 2023-06-10T18:54:02.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.632+0000 7fadf2ffd640 1 -- 172.21.15.53:0/221033136 <== mgr.4105 v2:172.21.15.117:6832/3061986771 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+309401 (secure 0 0 0) 0x7fadf80058c0 con 0x7fade40662b0 2023-06-10T18:54:02.642 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:54:02.645 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-06-10T18:54:02.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.636+0000 7fae08828640 1 -- 172.21.15.53:0/221033136 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fade40662b0 msgr2=0x7fade4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:02.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.636+0000 7fae08828640 1 --2- 172.21.15.53:0/221033136 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fade40662b0 0x7fade4068760 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fadf8001600 tx=0x7fadf8007a50 comp rx=0 tx=0).stop 2023-06-10T18:54:02.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.636+0000 7fae08828640 1 -- 172.21.15.53:0/221033136 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae040c9750 msgr2=0x7fae0414f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:02.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.636+0000 7fae08828640 1 --2- 172.21.15.53:0/221033136 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae040c9750 0x7fae0414f0d0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fadf401ab30 tx=0x7fadf4019220 comp rx=0 tx=0).stop 2023-06-10T18:54:02.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.636+0000 7fae08828640 1 -- 172.21.15.53:0/221033136 shutdown_connections 2023-06-10T18:54:02.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.636+0000 7fae08828640 1 --2- 172.21.15.53:0/221033136 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fade40662b0 0x7fade4068760 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:02.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.636+0000 7fae08828640 1 --2- 172.21.15.53:0/221033136 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae040cb870 0x7fae041597d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:02.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.636+0000 7fae08828640 1 --2- 172.21.15.53:0/221033136 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae040c9750 0x7fae0414f0d0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:02.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.636+0000 7fae08828640 1 --2- 172.21.15.53:0/221033136 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae040afc60 0x7fae040af5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:02.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.636+0000 7fae08828640 1 -- 172.21.15.53:0/221033136 >> 172.21.15.53:0/221033136 conn(0x7fae0406a0d0 msgr2=0x7fae04157c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:54:02.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.636+0000 7fae08828640 1 -- 172.21.15.53:0/221033136 shutdown_connections 2023-06-10T18:54:02.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.636+0000 7fae08828640 1 -- 172.21.15.53:0/221033136 wait complete. 2023-06-10T18:54:02.665 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":75,"stamp":"2023-06-10T18:54:01.585230+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236484,"kb_used_data":4484,"kb_used_omap":0,"kb_used_meta":231936,"kb_avail":754738236,"statfs":{"total":773094113280,"available":772851953664,"internally_reserved":0,"allocated":4591616,"data_stored":2572201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":237502464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,2],"upper_bound":64},"perf_stat":{"commit_latency_ms":63,"apply_latency_ms":63,"commit_latency_ns":63000000,"apply_latency_ns":63000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.232828"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:56.039306+0000","last_change":"2023-06-10T18:53:54.756546+0000","last_active":"2023-06-10T18:53:56.039306+0000","last_peered":"2023-06-10T18:53:56.039306+0000","last_clean":"2023-06-10T18:53:56.039306+0000","last_became_active":"2023-06-10T18:53:54.756271+0000","last_became_peered":"2023-06-10T18:53:54.756271+0000","last_unstale":"2023-06-10T18:53:56.039306+0000","last_undegraded":"2023-06-10T18:53:56.039306+0000","last_fullsized":"2023-06-10T18:53:56.039306+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:20:28.896506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:56.038934+0000","last_change":"2023-06-10T18:53:54.759024+0000","last_active":"2023-06-10T18:53:56.038934+0000","last_peered":"2023-06-10T18:53:56.038934+0000","last_clean":"2023-06-10T18:53:56.038934+0000","last_became_active":"2023-06-10T18:53:54.757911+0000","last_became_peered":"2023-06-10T18:53:54.757911+0000","last_unstale":"2023-06-10T18:53:56.038934+0000","last_undegraded":"2023-06-10T18:53:56.038934+0000","last_fullsized":"2023-06-10T18:53:56.038934+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:40:19.427079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:56.384602+0000","last_change":"2023-06-10T18:53:54.810765+0000","last_active":"2023-06-10T18:53:56.384602+0000","last_peered":"2023-06-10T18:53:56.384602+0000","last_clean":"2023-06-10T18:53:56.384602+0000","last_became_active":"2023-06-10T18:53:54.810474+0000","last_became_peered":"2023-06-10T18:53:54.810474+0000","last_unstale":"2023-06-10T18:53:56.384602+0000","last_undegraded":"2023-06-10T18:53:56.384602+0000","last_fullsized":"2023-06-10T18:53:56.384602+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:03:43.207774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:55.752621+0000","last_change":"2023-06-10T18:53:54.782089+0000","last_active":"2023-06-10T18:53:55.752621+0000","last_peered":"2023-06-10T18:53:55.752621+0000","last_clean":"2023-06-10T18:53:55.752621+0000","last_became_active":"2023-06-10T18:53:54.781799+0000","last_became_peered":"2023-06-10T18:53:54.781799+0000","last_unstale":"2023-06-10T18:53:55.752621+0000","last_undegraded":"2023-06-10T18:53:55.752621+0000","last_fullsized":"2023-06-10T18:53:55.752621+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:20:21.870288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:55.752225+0000","last_change":"2023-06-10T18:53:54.782222+0000","last_active":"2023-06-10T18:53:55.752225+0000","last_peered":"2023-06-10T18:53:55.752225+0000","last_clean":"2023-06-10T18:53:55.752225+0000","last_became_active":"2023-06-10T18:53:54.781885+0000","last_became_peered":"2023-06-10T18:53:54.781885+0000","last_unstale":"2023-06-10T18:53:55.752225+0000","last_undegraded":"2023-06-10T18:53:55.752225+0000","last_fullsized":"2023-06-10T18:53:55.752225+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:11:06.369895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-06-10T18:53:54.761278+0000","last_change":"2023-06-10T18:53:54.760209+0000","last_active":"2023-06-10T18:53:54.761278+0000","last_peered":"2023-06-10T18:53:54.761278+0000","last_clean":"2023-06-10T18:53:54.761278+0000","last_became_active":"2023-06-10T18:53:54.759709+0000","last_became_peered":"2023-06-10T18:53:54.759709+0000","last_unstale":"2023-06-10T18:53:54.761278+0000","last_undegraded":"2023-06-10T18:53:54.761278+0000","last_fullsized":"2023-06-10T18:53:54.761278+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:39:33.210591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:57.374590+0000","last_change":"2023-06-10T18:53:54.791954+0000","last_active":"2023-06-10T18:53:57.374590+0000","last_peered":"2023-06-10T18:53:57.374590+0000","last_clean":"2023-06-10T18:53:57.374590+0000","last_became_active":"2023-06-10T18:53:54.791311+0000","last_became_peered":"2023-06-10T18:53:54.791311+0000","last_unstale":"2023-06-10T18:53:57.374590+0000","last_undegraded":"2023-06-10T18:53:57.374590+0000","last_fullsized":"2023-06-10T18:53:57.374590+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:59:22.432420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:56.038281+0000","last_change":"2023-06-10T18:53:54.795822+0000","last_active":"2023-06-10T18:53:56.038281+0000","last_peered":"2023-06-10T18:53:56.038281+0000","last_clean":"2023-06-10T18:53:56.038281+0000","last_became_active":"2023-06-10T18:53:54.795445+0000","last_became_peered":"2023-06-10T18:53:54.795445+0000","last_unstale":"2023-06-10T18:53:56.038281+0000","last_undegraded":"2023-06-10T18:53:56.038281+0000","last_fullsized":"2023-06-10T18:53:56.038281+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:18:40.380473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:56.384348+0000","last_change":"2023-06-10T18:53:54.783988+0000","last_active":"2023-06-10T18:53:56.384348+0000","last_peered":"2023-06-10T18:53:56.384348+0000","last_clean":"2023-06-10T18:53:56.384348+0000","last_became_active":"2023-06-10T18:53:54.783620+0000","last_became_peered":"2023-06-10T18:53:54.783620+0000","last_unstale":"2023-06-10T18:53:56.384348+0000","last_undegraded":"2023-06-10T18:53:56.384348+0000","last_fullsized":"2023-06-10T18:53:56.384348+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:19:16.353732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:57.374954+0000","last_change":"2023-06-10T18:53:54.800665+0000","last_active":"2023-06-10T18:53:57.374954+0000","last_peered":"2023-06-10T18:53:57.374954+0000","last_clean":"2023-06-10T18:53:57.374954+0000","last_became_active":"2023-06-10T18:53:54.794464+0000","last_became_peered":"2023-06-10T18:53:54.794464+0000","last_unstale":"2023-06-10T18:53:57.374954+0000","last_undegraded":"2023-06-10T18:53:57.374954+0000","last_fullsized":"2023-06-10T18:53:57.374954+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:20:16.655338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:57.375453+0000","last_change":"2023-06-10T18:53:54.792507+0000","last_active":"2023-06-10T18:53:57.375453+0000","last_peered":"2023-06-10T18:53:57.375453+0000","last_clean":"2023-06-10T18:53:57.375453+0000","last_became_active":"2023-06-10T18:53:54.791749+0000","last_became_peered":"2023-06-10T18:53:54.791749+0000","last_unstale":"2023-06-10T18:53:57.375453+0000","last_undegraded":"2023-06-10T18:53:57.375453+0000","last_fullsized":"2023-06-10T18:53:57.375453+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:02:11.676949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:56.384505+0000","last_change":"2023-06-10T18:53:54.755049+0000","last_active":"2023-06-10T18:53:56.384505+0000","last_peered":"2023-06-10T18:53:56.384505+0000","last_clean":"2023-06-10T18:53:56.384505+0000","last_became_active":"2023-06-10T18:53:54.754746+0000","last_became_peered":"2023-06-10T18:53:54.754746+0000","last_unstale":"2023-06-10T18:53:56.384505+0000","last_undegraded":"2023-06-10T18:53:56.384505+0000","last_fullsized":"2023-06-10T18:53:56.384505+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:13:00.826489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:57.375631+0000","last_change":"2023-06-10T18:53:54.805625+0000","last_active":"2023-06-10T18:53:57.375631+0000","last_peered":"2023-06-10T18:53:57.375631+0000","last_clean":"2023-06-10T18:53:57.375631+0000","last_became_active":"2023-06-10T18:53:54.804936+0000","last_became_peered":"2023-06-10T18:53:54.804936+0000","last_unstale":"2023-06-10T18:53:57.375631+0000","last_undegraded":"2023-06-10T18:53:57.375631+0000","last_fullsized":"2023-06-10T18:53:57.375631+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:20:59.138491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:55.757202+0000","last_change":"2023-06-10T18:53:54.787283+0000","last_active":"2023-06-10T18:53:55.757202+0000","last_peered":"2023-06-10T18:53:55.757202+0000","last_clean":"2023-06-10T18:53:55.757202+0000","last_became_active":"2023-06-10T18:53:54.786330+0000","last_became_peered":"2023-06-10T18:53:54.786330+0000","last_unstale":"2023-06-10T18:53:55.757202+0000","last_undegraded":"2023-06-10T18:53:55.757202+0000","last_fullsized":"2023-06-10T18:53:55.757202+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:20:59.138491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:57.374585+0000","last_change":"2023-06-10T18:53:54.790175+0000","last_active":"2023-06-10T18:53:57.374585+0000","last_peered":"2023-06-10T18:53:57.374585+0000","last_clean":"2023-06-10T18:53:57.374585+0000","last_became_active":"2023-06-10T18:53:54.779524+0000","last_became_peered":"2023-06-10T18:53:54.779524+0000","last_unstale":"2023-06-10T18:53:57.374585+0000","last_undegraded":"2023-06-10T18:53:57.374585+0000","last_fullsized":"2023-06-10T18:53:57.374585+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:07:33.220204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:56.366384+0000","last_change":"2023-06-10T18:53:54.808712+0000","last_active":"2023-06-10T18:53:56.366384+0000","last_peered":"2023-06-10T18:53:56.366384+0000","last_clean":"2023-06-10T18:53:56.366384+0000","last_became_active":"2023-06-10T18:53:54.807686+0000","last_became_peered":"2023-06-10T18:53:54.807686+0000","last_unstale":"2023-06-10T18:53:56.366384+0000","last_undegraded":"2023-06-10T18:53:56.366384+0000","last_fullsized":"2023-06-10T18:53:56.366384+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:02:17.614774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:56.368136+0000","last_change":"2023-06-10T18:53:54.807590+0000","last_active":"2023-06-10T18:53:56.368136+0000","last_peered":"2023-06-10T18:53:56.368136+0000","last_clean":"2023-06-10T18:53:56.368136+0000","last_became_active":"2023-06-10T18:53:54.807148+0000","last_became_peered":"2023-06-10T18:53:54.807148+0000","last_unstale":"2023-06-10T18:53:56.368136+0000","last_undegraded":"2023-06-10T18:53:56.368136+0000","last_fullsized":"2023-06-10T18:53:56.368136+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:27:32.119869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:55.757148+0000","last_change":"2023-06-10T18:53:54.787062+0000","last_active":"2023-06-10T18:53:55.757148+0000","last_peered":"2023-06-10T18:53:55.757148+0000","last_clean":"2023-06-10T18:53:55.757148+0000","last_became_active":"2023-06-10T18:53:54.785989+0000","last_became_peered":"2023-06-10T18:53:54.785989+0000","last_unstale":"2023-06-10T18:53:55.757148+0000","last_undegraded":"2023-06-10T18:53:55.757148+0000","last_fullsized":"2023-06-10T18:53:55.757148+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:41:53.418177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:55.752664+0000","last_change":"2023-06-10T18:53:54.755960+0000","last_active":"2023-06-10T18:53:55.752664+0000","last_peered":"2023-06-10T18:53:55.752664+0000","last_clean":"2023-06-10T18:53:55.752664+0000","last_became_active":"2023-06-10T18:53:54.755633+0000","last_became_peered":"2023-06-10T18:53:54.755633+0000","last_unstale":"2023-06-10T18:53:55.752664+0000","last_undegraded":"2023-06-10T18:53:55.752664+0000","last_fullsized":"2023-06-10T18:53:55.752664+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:24:30.624498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:55.756103+0000","last_change":"2023-06-10T18:53:54.786556+0000","last_active":"2023-06-10T18:53:55.756103+0000","last_peered":"2023-06-10T18:53:55.756103+0000","last_clean":"2023-06-10T18:53:55.756103+0000","last_became_active":"2023-06-10T18:53:54.785759+0000","last_became_peered":"2023-06-10T18:53:54.785759+0000","last_unstale":"2023-06-10T18:53:55.756103+0000","last_undegraded":"2023-06-10T18:53:55.756103+0000","last_fullsized":"2023-06-10T18:53:55.756103+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:24:30.624498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:57.375126+0000","last_change":"2023-06-10T18:53:54.780882+0000","last_active":"2023-06-10T18:53:57.375126+0000","last_peered":"2023-06-10T18:53:57.375126+0000","last_clean":"2023-06-10T18:53:57.375126+0000","last_became_active":"2023-06-10T18:53:54.779238+0000","last_became_peered":"2023-06-10T18:53:54.779238+0000","last_unstale":"2023-06-10T18:53:57.375126+0000","last_undegraded":"2023-06-10T18:53:57.375126+0000","last_fullsized":"2023-06-10T18:53:57.375126+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:57:17.939068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:55.757088+0000","last_change":"2023-06-10T18:53:54.768505+0000","last_active":"2023-06-10T18:53:55.757088+0000","last_peered":"2023-06-10T18:53:55.757088+0000","last_clean":"2023-06-10T18:53:55.757088+0000","last_became_active":"2023-06-10T18:53:54.766746+0000","last_became_peered":"2023-06-10T18:53:54.766746+0000","last_unstale":"2023-06-10T18:53:55.757088+0000","last_undegraded":"2023-06-10T18:53:55.757088+0000","last_fullsized":"2023-06-10T18:53:55.757088+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:48:42.741824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:56.366380+0000","last_change":"2023-06-10T18:53:54.798607+0000","last_active":"2023-06-10T18:53:56.366380+0000","last_peered":"2023-06-10T18:53:56.366380+0000","last_clean":"2023-06-10T18:53:56.366380+0000","last_became_active":"2023-06-10T18:53:54.797977+0000","last_became_peered":"2023-06-10T18:53:54.797977+0000","last_unstale":"2023-06-10T18:53:56.366380+0000","last_undegraded":"2023-06-10T18:53:56.366380+0000","last_fullsized":"2023-06-10T18:53:56.366380+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:20:16.655338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:55.752302+0000","last_change":"2023-06-10T18:53:54.799432+0000","last_active":"2023-06-10T18:53:55.752302+0000","last_peered":"2023-06-10T18:53:55.752302+0000","last_clean":"2023-06-10T18:53:55.752302+0000","last_became_active":"2023-06-10T18:53:54.799103+0000","last_became_peered":"2023-06-10T18:53:54.799103+0000","last_unstale":"2023-06-10T18:53:55.752302+0000","last_undegraded":"2023-06-10T18:53:55.752302+0000","last_fullsized":"2023-06-10T18:53:55.752302+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:46:37.383152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:55.757411+0000","last_change":"2023-06-10T18:53:54.789481+0000","last_active":"2023-06-10T18:53:55.757411+0000","last_peered":"2023-06-10T18:53:55.757411+0000","last_clean":"2023-06-10T18:53:55.757411+0000","last_became_active":"2023-06-10T18:53:54.788855+0000","last_became_peered":"2023-06-10T18:53:54.788855+0000","last_unstale":"2023-06-10T18:53:55.757411+0000","last_undegraded":"2023-06-10T18:53:55.757411+0000","last_fullsized":"2023-06-10T18:53:55.757411+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:08:43.057913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-06-10T18:53:54.806286+0000","last_change":"2023-06-10T18:53:54.804713+0000","last_active":"2023-06-10T18:53:54.806286+0000","last_peered":"2023-06-10T18:53:54.806286+0000","last_clean":"2023-06-10T18:53:54.806286+0000","last_became_active":"2023-06-10T18:53:54.804394+0000","last_became_peered":"2023-06-10T18:53:54.804394+0000","last_unstale":"2023-06-10T18:53:54.806286+0000","last_undegraded":"2023-06-10T18:53:54.806286+0000","last_fullsized":"2023-06-10T18:53:54.806286+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:42:25.962765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:55.756736+0000","last_change":"2023-06-10T18:53:54.776681+0000","last_active":"2023-06-10T18:53:55.756736+0000","last_peered":"2023-06-10T18:53:55.756736+0000","last_clean":"2023-06-10T18:53:55.756736+0000","last_became_active":"2023-06-10T18:53:54.775924+0000","last_became_peered":"2023-06-10T18:53:54.775924+0000","last_unstale":"2023-06-10T18:53:55.756736+0000","last_undegraded":"2023-06-10T18:53:55.756736+0000","last_fullsized":"2023-06-10T18:53:55.756736+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:35:20.660802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:57.375298+0000","last_change":"2023-06-10T18:53:54.790639+0000","last_active":"2023-06-10T18:53:57.375298+0000","last_peered":"2023-06-10T18:53:57.375298+0000","last_clean":"2023-06-10T18:53:57.375298+0000","last_became_active":"2023-06-10T18:53:54.773841+0000","last_became_peered":"2023-06-10T18:53:54.773841+0000","last_unstale":"2023-06-10T18:53:57.375298+0000","last_undegraded":"2023-06-10T18:53:57.375298+0000","last_fullsized":"2023-06-10T18:53:57.375298+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:14:39.327728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:55.755915+0000","last_change":"2023-06-10T18:53:54.776867+0000","last_active":"2023-06-10T18:53:55.755915+0000","last_peered":"2023-06-10T18:53:55.755915+0000","last_clean":"2023-06-10T18:53:55.755915+0000","last_became_active":"2023-06-10T18:53:54.776134+0000","last_became_peered":"2023-06-10T18:53:54.776134+0000","last_unstale":"2023-06-10T18:53:55.755915+0000","last_undegraded":"2023-06-10T18:53:55.755915+0000","last_fullsized":"2023-06-10T18:53:55.755915+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:20:21.870288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:55.756128+0000","last_change":"2023-06-10T18:53:54.788684+0000","last_active":"2023-06-10T18:53:55.756128+0000","last_peered":"2023-06-10T18:53:55.756128+0000","last_clean":"2023-06-10T18:53:55.756128+0000","last_became_active":"2023-06-10T18:53:54.777723+0000","last_became_peered":"2023-06-10T18:53:54.777723+0000","last_unstale":"2023-06-10T18:53:55.756128+0000","last_undegraded":"2023-06-10T18:53:55.756128+0000","last_fullsized":"2023-06-10T18:53:55.756128+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:48:31.988992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:56.366770+0000","last_change":"2023-06-10T18:53:54.798389+0000","last_active":"2023-06-10T18:53:56.366770+0000","last_peered":"2023-06-10T18:53:56.366770+0000","last_clean":"2023-06-10T18:53:56.366770+0000","last_became_active":"2023-06-10T18:53:54.797730+0000","last_became_peered":"2023-06-10T18:53:54.797730+0000","last_unstale":"2023-06-10T18:53:56.366770+0000","last_undegraded":"2023-06-10T18:53:56.366770+0000","last_fullsized":"2023-06-10T18:53:56.366770+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:31:03.326978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-06-10T18:53:54.759750+0000","last_change":"2023-06-10T18:53:54.754415+0000","last_active":"2023-06-10T18:53:54.759750+0000","last_peered":"2023-06-10T18:53:54.759750+0000","last_clean":"2023-06-10T18:53:54.759750+0000","last_became_active":"2023-06-10T18:53:54.753962+0000","last_became_peered":"2023-06-10T18:53:54.753962+0000","last_unstale":"2023-06-10T18:53:54.759750+0000","last_undegraded":"2023-06-10T18:53:54.759750+0000","last_fullsized":"2023-06-10T18:53:54.759750+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:15:42.702407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:56.367611+0000","last_change":"2023-06-10T18:53:54.808482+0000","last_active":"2023-06-10T18:53:56.367611+0000","last_peered":"2023-06-10T18:53:56.367611+0000","last_clean":"2023-06-10T18:53:56.367611+0000","last_became_active":"2023-06-10T18:53:54.807993+0000","last_became_peered":"2023-06-10T18:53:54.807993+0000","last_unstale":"2023-06-10T18:53:56.367611+0000","last_undegraded":"2023-06-10T18:53:56.367611+0000","last_fullsized":"2023-06-10T18:53:56.367611+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:48:42.741824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"36'4","reported_seq":17,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:55.757602+0000","last_change":"2023-06-10T18:53:54.397242+0000","last_active":"2023-06-10T18:53:55.757602+0000","last_peered":"2023-06-10T18:53:55.757602+0000","last_clean":"2023-06-10T18:53:55.757602+0000","last_became_active":"2023-06-10T18:53:54.396552+0000","last_became_peered":"2023-06-10T18:53:54.396552+0000","last_unstale":"2023-06-10T18:53:55.757602+0000","last_undegraded":"2023-06-10T18:53:55.757602+0000","last_fullsized":"2023-06-10T18:53:55.757602+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:49:27.613081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-06-10T18:53:54.797429+0000","last_change":"2023-06-10T18:53:54.795935+0000","last_active":"2023-06-10T18:53:54.797429+0000","last_peered":"2023-06-10T18:53:54.797429+0000","last_clean":"2023-06-10T18:53:54.797429+0000","last_became_active":"2023-06-10T18:53:54.795663+0000","last_became_peered":"2023-06-10T18:53:54.795663+0000","last_unstale":"2023-06-10T18:53:54.797429+0000","last_undegraded":"2023-06-10T18:53:54.797429+0000","last_fullsized":"2023-06-10T18:53:54.797429+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:08:42.457819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"36'1","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:56.384448+0000","last_change":"2023-06-10T18:53:54.395338+0000","last_active":"2023-06-10T18:53:56.384448+0000","last_peered":"2023-06-10T18:53:56.384448+0000","last_clean":"2023-06-10T18:53:56.384448+0000","last_became_active":"2023-06-10T18:53:54.394988+0000","last_became_peered":"2023-06-10T18:53:54.394988+0000","last_unstale":"2023-06-10T18:53:56.384448+0000","last_undegraded":"2023-06-10T18:53:56.384448+0000","last_fullsized":"2023-06-10T18:53:56.384448+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:46:30.165110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:55.755647+0000","last_change":"2023-06-10T18:53:54.777739+0000","last_active":"2023-06-10T18:53:55.755647+0000","last_peered":"2023-06-10T18:53:55.755647+0000","last_clean":"2023-06-10T18:53:55.755647+0000","last_became_active":"2023-06-10T18:53:54.776988+0000","last_became_peered":"2023-06-10T18:53:54.776988+0000","last_unstale":"2023-06-10T18:53:55.755647+0000","last_undegraded":"2023-06-10T18:53:55.755647+0000","last_fullsized":"2023-06-10T18:53:55.755647+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:14:39.327728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"36'2","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-06-10T18:53:54.783996+0000","last_change":"2023-06-10T18:53:54.398660+0000","last_active":"2023-06-10T18:53:54.783996+0000","last_peered":"2023-06-10T18:53:54.783996+0000","last_clean":"2023-06-10T18:53:54.783996+0000","last_became_active":"2023-06-10T18:53:54.398161+0000","last_became_peered":"2023-06-10T18:53:54.398161+0000","last_unstale":"2023-06-10T18:53:54.783996+0000","last_undegraded":"2023-06-10T18:53:54.783996+0000","last_fullsized":"2023-06-10T18:53:54.783996+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:37:13.046902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:56.039128+0000","last_change":"2023-06-10T18:53:54.791524+0000","last_active":"2023-06-10T18:53:56.039128+0000","last_peered":"2023-06-10T18:53:56.039128+0000","last_clean":"2023-06-10T18:53:56.039128+0000","last_became_active":"2023-06-10T18:53:54.791226+0000","last_became_peered":"2023-06-10T18:53:54.791226+0000","last_unstale":"2023-06-10T18:53:56.039128+0000","last_undegraded":"2023-06-10T18:53:56.039128+0000","last_fullsized":"2023-06-10T18:53:56.039128+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:23:59.888466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"36'2","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:55.755436+0000","last_change":"2023-06-10T18:53:54.378694+0000","last_active":"2023-06-10T18:53:55.755436+0000","last_peered":"2023-06-10T18:53:55.755436+0000","last_clean":"2023-06-10T18:53:55.755436+0000","last_became_active":"2023-06-10T18:53:54.376420+0000","last_became_peered":"2023-06-10T18:53:54.376420+0000","last_unstale":"2023-06-10T18:53:55.755436+0000","last_undegraded":"2023-06-10T18:53:55.755436+0000","last_fullsized":"2023-06-10T18:53:55.755436+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:03:35.362279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:56.383610+0000","last_change":"2023-06-10T18:53:54.755127+0000","last_active":"2023-06-10T18:53:56.383610+0000","last_peered":"2023-06-10T18:53:56.383610+0000","last_clean":"2023-06-10T18:53:56.383610+0000","last_became_active":"2023-06-10T18:53:54.754846+0000","last_became_peered":"2023-06-10T18:53:54.754846+0000","last_unstale":"2023-06-10T18:53:56.383610+0000","last_undegraded":"2023-06-10T18:53:56.383610+0000","last_fullsized":"2023-06-10T18:53:56.383610+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:29:42.290036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"36'1","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:57.374993+0000","last_change":"2023-06-10T18:53:54.388196+0000","last_active":"2023-06-10T18:53:57.374993+0000","last_peered":"2023-06-10T18:53:57.374993+0000","last_clean":"2023-06-10T18:53:57.374993+0000","last_became_active":"2023-06-10T18:53:54.387130+0000","last_became_peered":"2023-06-10T18:53:54.387130+0000","last_unstale":"2023-06-10T18:53:57.374993+0000","last_undegraded":"2023-06-10T18:53:57.374993+0000","last_fullsized":"2023-06-10T18:53:57.374993+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:47:53.042433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:57.375171+0000","last_change":"2023-06-10T18:53:54.780556+0000","last_active":"2023-06-10T18:53:57.375171+0000","last_peered":"2023-06-10T18:53:57.375171+0000","last_clean":"2023-06-10T18:53:57.375171+0000","last_became_active":"2023-06-10T18:53:54.779367+0000","last_became_peered":"2023-06-10T18:53:54.779367+0000","last_unstale":"2023-06-10T18:53:57.375171+0000","last_undegraded":"2023-06-10T18:53:57.375171+0000","last_fullsized":"2023-06-10T18:53:57.375171+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:03:36.375029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"36'1","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:56.366852+0000","last_change":"2023-06-10T18:53:54.402008+0000","last_active":"2023-06-10T18:53:56.366852+0000","last_peered":"2023-06-10T18:53:56.366852+0000","last_clean":"2023-06-10T18:53:56.366852+0000","last_became_active":"2023-06-10T18:53:54.401300+0000","last_became_peered":"2023-06-10T18:53:54.401300+0000","last_unstale":"2023-06-10T18:53:56.366852+0000","last_undegraded":"2023-06-10T18:53:56.366852+0000","last_fullsized":"2023-06-10T18:53:56.366852+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:14:38.314978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:55.756549+0000","last_change":"2023-06-10T18:53:54.806317+0000","last_active":"2023-06-10T18:53:55.756549+0000","last_peered":"2023-06-10T18:53:55.756549+0000","last_clean":"2023-06-10T18:53:55.756549+0000","last_became_active":"2023-06-10T18:53:54.805844+0000","last_became_peered":"2023-06-10T18:53:54.805844+0000","last_unstale":"2023-06-10T18:53:55.756549+0000","last_undegraded":"2023-06-10T18:53:55.756549+0000","last_fullsized":"2023-06-10T18:53:55.756549+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:46:49.434321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-06-10T18:53:54.751873+0000","last_change":"2023-06-10T18:53:54.387206+0000","last_active":"2023-06-10T18:53:54.751873+0000","last_peered":"2023-06-10T18:53:54.751873+0000","last_clean":"2023-06-10T18:53:54.751873+0000","last_became_active":"2023-06-10T18:53:54.386820+0000","last_became_peered":"2023-06-10T18:53:54.386820+0000","last_unstale":"2023-06-10T18:53:54.751873+0000","last_undegraded":"2023-06-10T18:53:54.751873+0000","last_fullsized":"2023-06-10T18:53:54.751873+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:22:26.121217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:56.038312+0000","last_change":"2023-06-10T18:53:54.806369+0000","last_active":"2023-06-10T18:53:56.038312+0000","last_peered":"2023-06-10T18:53:56.038312+0000","last_clean":"2023-06-10T18:53:56.038312+0000","last_became_active":"2023-06-10T18:53:54.806033+0000","last_became_peered":"2023-06-10T18:53:54.806033+0000","last_unstale":"2023-06-10T18:53:56.038312+0000","last_undegraded":"2023-06-10T18:53:56.038312+0000","last_fullsized":"2023-06-10T18:53:56.038312+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:26:04.446573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:55.754266+0000","last_change":"2023-06-10T18:53:54.387880+0000","last_active":"2023-06-10T18:53:55.754266+0000","last_peered":"2023-06-10T18:53:55.754266+0000","last_clean":"2023-06-10T18:53:55.754266+0000","last_became_active":"2023-06-10T18:53:54.383537+0000","last_became_peered":"2023-06-10T18:53:54.383537+0000","last_unstale":"2023-06-10T18:53:55.754266+0000","last_undegraded":"2023-06-10T18:53:55.754266+0000","last_fullsized":"2023-06-10T18:53:55.754266+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:20:15.642588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:55.752562+0000","last_change":"2023-06-10T18:53:54.769765+0000","last_active":"2023-06-10T18:53:55.752562+0000","last_peered":"2023-06-10T18:53:55.752562+0000","last_clean":"2023-06-10T18:53:55.752562+0000","last_became_active":"2023-06-10T18:53:54.769399+0000","last_became_peered":"2023-06-10T18:53:54.769399+0000","last_unstale":"2023-06-10T18:53:55.752562+0000","last_undegraded":"2023-06-10T18:53:55.752562+0000","last_fullsized":"2023-06-10T18:53:55.752562+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:27:37.844927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:56.039307+0000","last_change":"2023-06-10T18:53:54.388050+0000","last_active":"2023-06-10T18:53:56.039307+0000","last_peered":"2023-06-10T18:53:56.039307+0000","last_clean":"2023-06-10T18:53:56.039307+0000","last_became_active":"2023-06-10T18:53:54.387661+0000","last_became_peered":"2023-06-10T18:53:54.387661+0000","last_unstale":"2023-06-10T18:53:56.039307+0000","last_undegraded":"2023-06-10T18:53:56.039307+0000","last_fullsized":"2023-06-10T18:53:56.039307+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:34:42.960668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:56.367754+0000","last_change":"2023-06-10T18:53:54.794062+0000","last_active":"2023-06-10T18:53:56.367754+0000","last_peered":"2023-06-10T18:53:56.367754+0000","last_clean":"2023-06-10T18:53:56.367754+0000","last_became_active":"2023-06-10T18:53:54.793392+0000","last_became_peered":"2023-06-10T18:53:54.793392+0000","last_unstale":"2023-06-10T18:53:56.367754+0000","last_undegraded":"2023-06-10T18:53:56.367754+0000","last_fullsized":"2023-06-10T18:53:56.367754+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:28:51.472490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:57.375747+0000","last_change":"2023-06-10T18:53:54.393689+0000","last_active":"2023-06-10T18:53:57.375747+0000","last_peered":"2023-06-10T18:53:57.375747+0000","last_clean":"2023-06-10T18:53:57.375747+0000","last_became_active":"2023-06-10T18:53:54.392045+0000","last_became_peered":"2023-06-10T18:53:54.392045+0000","last_unstale":"2023-06-10T18:53:57.375747+0000","last_undegraded":"2023-06-10T18:53:57.375747+0000","last_fullsized":"2023-06-10T18:53:57.375747+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:46:56.851205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:56.384214+0000","last_change":"2023-06-10T18:53:54.794620+0000","last_active":"2023-06-10T18:53:56.384214+0000","last_peered":"2023-06-10T18:53:56.384214+0000","last_clean":"2023-06-10T18:53:56.384214+0000","last_became_active":"2023-06-10T18:53:54.794365+0000","last_became_peered":"2023-06-10T18:53:54.794365+0000","last_unstale":"2023-06-10T18:53:56.384214+0000","last_undegraded":"2023-06-10T18:53:56.384214+0000","last_fullsized":"2023-06-10T18:53:56.384214+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:12:03.060444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"36'3","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:57.375748+0000","last_change":"2023-06-10T18:53:54.391483+0000","last_active":"2023-06-10T18:53:57.375748+0000","last_peered":"2023-06-10T18:53:57.375748+0000","last_clean":"2023-06-10T18:53:57.375748+0000","last_became_active":"2023-06-10T18:53:54.390637+0000","last_became_peered":"2023-06-10T18:53:54.390637+0000","last_unstale":"2023-06-10T18:53:57.375748+0000","last_undegraded":"2023-06-10T18:53:57.375748+0000","last_fullsized":"2023-06-10T18:53:57.375748+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:33:13.508668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:55.755291+0000","last_change":"2023-06-10T18:53:54.766963+0000","last_active":"2023-06-10T18:53:55.755291+0000","last_peered":"2023-06-10T18:53:55.755291+0000","last_clean":"2023-06-10T18:53:55.755291+0000","last_became_active":"2023-06-10T18:53:54.766181+0000","last_became_peered":"2023-06-10T18:53:54.766181+0000","last_unstale":"2023-06-10T18:53:55.755291+0000","last_undegraded":"2023-06-10T18:53:55.755291+0000","last_fullsized":"2023-06-10T18:53:55.755291+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:57:17.939068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"36'6","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:56.038900+0000","last_change":"2023-06-10T18:53:54.402173+0000","last_active":"2023-06-10T18:53:56.038900+0000","last_peered":"2023-06-10T18:53:56.038900+0000","last_clean":"2023-06-10T18:53:56.038900+0000","last_became_active":"2023-06-10T18:53:54.401551+0000","last_became_peered":"2023-06-10T18:53:54.401551+0000","last_unstale":"2023-06-10T18:53:56.038900+0000","last_undegraded":"2023-06-10T18:53:56.038900+0000","last_fullsized":"2023-06-10T18:53:56.038900+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:11:28.430073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:56.383614+0000","last_change":"2023-06-10T18:53:54.807307+0000","last_active":"2023-06-10T18:53:56.383614+0000","last_peered":"2023-06-10T18:53:56.383614+0000","last_clean":"2023-06-10T18:53:56.383614+0000","last_became_active":"2023-06-10T18:53:54.806961+0000","last_became_peered":"2023-06-10T18:53:54.806961+0000","last_unstale":"2023-06-10T18:53:56.383614+0000","last_undegraded":"2023-06-10T18:53:56.383614+0000","last_fullsized":"2023-06-10T18:53:56.383614+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:12:22.010133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"36'2","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:56.038903+0000","last_change":"2023-06-10T18:53:54.379682+0000","last_active":"2023-06-10T18:53:56.038903+0000","last_peered":"2023-06-10T18:53:56.038903+0000","last_clean":"2023-06-10T18:53:56.038903+0000","last_became_active":"2023-06-10T18:53:54.377170+0000","last_became_peered":"2023-06-10T18:53:54.377170+0000","last_unstale":"2023-06-10T18:53:56.038903+0000","last_undegraded":"2023-06-10T18:53:56.038903+0000","last_fullsized":"2023-06-10T18:53:56.038903+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:48:10.925681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:56.038293+0000","last_change":"2023-06-10T18:53:54.755882+0000","last_active":"2023-06-10T18:53:56.038293+0000","last_peered":"2023-06-10T18:53:56.038293+0000","last_clean":"2023-06-10T18:53:56.038293+0000","last_became_active":"2023-06-10T18:53:54.755549+0000","last_became_peered":"2023-06-10T18:53:54.755549+0000","last_unstale":"2023-06-10T18:53:56.038293+0000","last_undegraded":"2023-06-10T18:53:56.038293+0000","last_fullsized":"2023-06-10T18:53:56.038293+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:25:02.689972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-06-10T18:53:54.752600+0000","last_change":"2023-06-10T18:53:54.392238+0000","last_active":"2023-06-10T18:53:54.752600+0000","last_peered":"2023-06-10T18:53:54.752600+0000","last_clean":"2023-06-10T18:53:54.752600+0000","last_became_active":"2023-06-10T18:53:54.391708+0000","last_became_peered":"2023-06-10T18:53:54.391708+0000","last_unstale":"2023-06-10T18:53:54.752600+0000","last_undegraded":"2023-06-10T18:53:54.752600+0000","last_fullsized":"2023-06-10T18:53:54.752600+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:37:02.599005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:56.366498+0000","last_change":"2023-06-10T18:53:54.796560+0000","last_active":"2023-06-10T18:53:56.366498+0000","last_peered":"2023-06-10T18:53:56.366498+0000","last_clean":"2023-06-10T18:53:56.366498+0000","last_became_active":"2023-06-10T18:53:54.795338+0000","last_became_peered":"2023-06-10T18:53:54.795338+0000","last_unstale":"2023-06-10T18:53:56.366498+0000","last_undegraded":"2023-06-10T18:53:56.366498+0000","last_fullsized":"2023-06-10T18:53:56.366498+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:47:54.055184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:55.754524+0000","last_change":"2023-06-10T18:53:54.397247+0000","last_active":"2023-06-10T18:53:55.754524+0000","last_peered":"2023-06-10T18:53:55.754524+0000","last_clean":"2023-06-10T18:53:55.754524+0000","last_became_active":"2023-06-10T18:53:54.396390+0000","last_became_peered":"2023-06-10T18:53:54.396390+0000","last_unstale":"2023-06-10T18:53:55.754524+0000","last_undegraded":"2023-06-10T18:53:55.754524+0000","last_fullsized":"2023-06-10T18:53:55.754524+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:27:36.832177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:56.038552+0000","last_change":"2023-06-10T18:53:54.758590+0000","last_active":"2023-06-10T18:53:56.038552+0000","last_peered":"2023-06-10T18:53:56.038552+0000","last_clean":"2023-06-10T18:53:56.038552+0000","last_became_active":"2023-06-10T18:53:54.758162+0000","last_became_peered":"2023-06-10T18:53:54.758162+0000","last_unstale":"2023-06-10T18:53:56.038552+0000","last_undegraded":"2023-06-10T18:53:56.038552+0000","last_fullsized":"2023-06-10T18:53:56.038552+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:12:41.801544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"36'8","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:56.366166+0000","last_change":"2023-06-10T18:53:54.405826+0000","last_active":"2023-06-10T18:53:56.366166+0000","last_peered":"2023-06-10T18:53:56.366166+0000","last_clean":"2023-06-10T18:53:56.366166+0000","last_became_active":"2023-06-10T18:53:54.405205+0000","last_became_peered":"2023-06-10T18:53:54.405205+0000","last_unstale":"2023-06-10T18:53:56.366166+0000","last_undegraded":"2023-06-10T18:53:56.366166+0000","last_fullsized":"2023-06-10T18:53:56.366166+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:59:21.419669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:56.038908+0000","last_change":"2023-06-10T18:53:54.778200+0000","last_active":"2023-06-10T18:53:56.038908+0000","last_peered":"2023-06-10T18:53:56.038908+0000","last_clean":"2023-06-10T18:53:56.038908+0000","last_became_active":"2023-06-10T18:53:54.777870+0000","last_became_peered":"2023-06-10T18:53:54.777870+0000","last_unstale":"2023-06-10T18:53:56.038908+0000","last_undegraded":"2023-06-10T18:53:56.038908+0000","last_fullsized":"2023-06-10T18:53:56.038908+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:19:53.065425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"36'1","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:57.375736+0000","last_change":"2023-06-10T18:53:54.401210+0000","last_active":"2023-06-10T18:53:57.375736+0000","last_peered":"2023-06-10T18:53:57.375736+0000","last_clean":"2023-06-10T18:53:57.375736+0000","last_became_active":"2023-06-10T18:53:54.400478+0000","last_became_peered":"2023-06-10T18:53:54.400478+0000","last_unstale":"2023-06-10T18:53:57.375736+0000","last_undegraded":"2023-06-10T18:53:57.375736+0000","last_fullsized":"2023-06-10T18:53:57.375736+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:28:50.459740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:57.375351+0000","last_change":"2023-06-10T18:53:54.791072+0000","last_active":"2023-06-10T18:53:57.375351+0000","last_peered":"2023-06-10T18:53:57.375351+0000","last_clean":"2023-06-10T18:53:57.375351+0000","last_became_active":"2023-06-10T18:53:54.782010+0000","last_became_peered":"2023-06-10T18:53:54.782010+0000","last_unstale":"2023-06-10T18:53:57.375351+0000","last_undegraded":"2023-06-10T18:53:57.375351+0000","last_fullsized":"2023-06-10T18:53:57.375351+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:28:22.415501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"36'2","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:55.755892+0000","last_change":"2023-06-10T18:53:54.390210+0000","last_active":"2023-06-10T18:53:55.755892+0000","last_peered":"2023-06-10T18:53:55.755892+0000","last_clean":"2023-06-10T18:53:55.755892+0000","last_became_active":"2023-06-10T18:53:54.389573+0000","last_became_peered":"2023-06-10T18:53:54.389573+0000","last_unstale":"2023-06-10T18:53:55.755892+0000","last_undegraded":"2023-06-10T18:53:55.755892+0000","last_fullsized":"2023-06-10T18:53:55.755892+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:28:21.402751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:55.755560+0000","last_change":"2023-06-10T18:53:54.775491+0000","last_active":"2023-06-10T18:53:55.755560+0000","last_peered":"2023-06-10T18:53:55.755560+0000","last_clean":"2023-06-10T18:53:55.755560+0000","last_became_active":"2023-06-10T18:53:54.774143+0000","last_became_peered":"2023-06-10T18:53:54.774143+0000","last_unstale":"2023-06-10T18:53:55.755560+0000","last_undegraded":"2023-06-10T18:53:55.755560+0000","last_fullsized":"2023-06-10T18:53:55.755560+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:31:03.326978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"36'1","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:55.752797+0000","last_change":"2023-06-10T18:53:54.396158+0000","last_active":"2023-06-10T18:53:55.752797+0000","last_peered":"2023-06-10T18:53:55.752797+0000","last_clean":"2023-06-10T18:53:55.752797+0000","last_became_active":"2023-06-10T18:53:54.395839+0000","last_became_peered":"2023-06-10T18:53:54.395839+0000","last_unstale":"2023-06-10T18:53:55.752797+0000","last_undegraded":"2023-06-10T18:53:55.752797+0000","last_fullsized":"2023-06-10T18:53:55.752797+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:35:19.648052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:55.752795+0000","last_change":"2023-06-10T18:53:54.760455+0000","last_active":"2023-06-10T18:53:55.752795+0000","last_peered":"2023-06-10T18:53:55.752795+0000","last_clean":"2023-06-10T18:53:55.752795+0000","last_became_active":"2023-06-10T18:53:54.760143+0000","last_became_peered":"2023-06-10T18:53:54.760143+0000","last_unstale":"2023-06-10T18:53:55.752795+0000","last_undegraded":"2023-06-10T18:53:55.752795+0000","last_fullsized":"2023-06-10T18:53:55.752795+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:16:15.404348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-06-10T18:53:54.752066+0000","last_change":"2023-06-10T18:53:54.397843+0000","last_active":"2023-06-10T18:53:54.752066+0000","last_peered":"2023-06-10T18:53:54.752066+0000","last_clean":"2023-06-10T18:53:54.752066+0000","last_became_active":"2023-06-10T18:53:54.397368+0000","last_became_peered":"2023-06-10T18:53:54.397368+0000","last_unstale":"2023-06-10T18:53:54.752066+0000","last_undegraded":"2023-06-10T18:53:54.752066+0000","last_fullsized":"2023-06-10T18:53:54.752066+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:06:36.762385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:56.366712+0000","last_change":"2023-06-10T18:53:54.809109+0000","last_active":"2023-06-10T18:53:56.366712+0000","last_peered":"2023-06-10T18:53:56.366712+0000","last_clean":"2023-06-10T18:53:56.366712+0000","last_became_active":"2023-06-10T18:53:54.808218+0000","last_became_peered":"2023-06-10T18:53:54.808218+0000","last_unstale":"2023-06-10T18:53:56.366712+0000","last_undegraded":"2023-06-10T18:53:56.366712+0000","last_fullsized":"2023-06-10T18:53:56.366712+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:03:36.375029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"36'2","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:55.752380+0000","last_change":"2023-06-10T18:53:54.372754+0000","last_active":"2023-06-10T18:53:55.752380+0000","last_peered":"2023-06-10T18:53:55.752380+0000","last_clean":"2023-06-10T18:53:55.752380+0000","last_became_active":"2023-06-10T18:53:54.372341+0000","last_became_peered":"2023-06-10T18:53:54.372341+0000","last_unstale":"2023-06-10T18:53:55.752380+0000","last_undegraded":"2023-06-10T18:53:55.752380+0000","last_fullsized":"2023-06-10T18:53:55.752380+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:58:52.577256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:56.383889+0000","last_change":"2023-06-10T18:53:54.799430+0000","last_active":"2023-06-10T18:53:56.383889+0000","last_peered":"2023-06-10T18:53:56.383889+0000","last_clean":"2023-06-10T18:53:56.383889+0000","last_became_active":"2023-06-10T18:53:54.799085+0000","last_became_peered":"2023-06-10T18:53:54.799085+0000","last_unstale":"2023-06-10T18:53:56.383889+0000","last_undegraded":"2023-06-10T18:53:56.383889+0000","last_fullsized":"2023-06-10T18:53:56.383889+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:02:53.793664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:55.752299+0000","last_change":"2023-06-10T18:53:54.384882+0000","last_active":"2023-06-10T18:53:55.752299+0000","last_peered":"2023-06-10T18:53:55.752299+0000","last_clean":"2023-06-10T18:53:55.752299+0000","last_became_active":"2023-06-10T18:53:54.384412+0000","last_became_peered":"2023-06-10T18:53:54.384412+0000","last_unstale":"2023-06-10T18:53:55.752299+0000","last_undegraded":"2023-06-10T18:53:55.752299+0000","last_fullsized":"2023-06-10T18:53:55.752299+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:30:02.819047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:57.374920+0000","last_change":"2023-06-10T18:53:54.800500+0000","last_active":"2023-06-10T18:53:57.374920+0000","last_peered":"2023-06-10T18:53:57.374920+0000","last_clean":"2023-06-10T18:53:57.374920+0000","last_became_active":"2023-06-10T18:53:54.794900+0000","last_became_peered":"2023-06-10T18:53:54.794900+0000","last_unstale":"2023-06-10T18:53:57.374920+0000","last_undegraded":"2023-06-10T18:53:57.374920+0000","last_fullsized":"2023-06-10T18:53:57.374920+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:02:17.614774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:56.367019+0000","last_change":"2023-06-10T18:53:54.402534+0000","last_active":"2023-06-10T18:53:56.367019+0000","last_peered":"2023-06-10T18:53:56.367019+0000","last_clean":"2023-06-10T18:53:56.367019+0000","last_became_active":"2023-06-10T18:53:54.401789+0000","last_became_peered":"2023-06-10T18:53:54.401789+0000","last_unstale":"2023-06-10T18:53:56.367019+0000","last_undegraded":"2023-06-10T18:53:56.367019+0000","last_fullsized":"2023-06-10T18:53:56.367019+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:02:10.664198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:56.038754+0000","last_change":"2023-06-10T18:53:54.808138+0000","last_active":"2023-06-10T18:53:56.038754+0000","last_peered":"2023-06-10T18:53:56.038754+0000","last_clean":"2023-06-10T18:53:56.038754+0000","last_became_active":"2023-06-10T18:53:54.807810+0000","last_became_peered":"2023-06-10T18:53:54.807810+0000","last_unstale":"2023-06-10T18:53:56.038754+0000","last_undegraded":"2023-06-10T18:53:56.038754+0000","last_fullsized":"2023-06-10T18:53:56.038754+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:34:03.070667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:55.752480+0000","last_change":"2023-06-10T18:53:54.373910+0000","last_active":"2023-06-10T18:53:55.752480+0000","last_peered":"2023-06-10T18:53:55.752480+0000","last_clean":"2023-06-10T18:53:55.752480+0000","last_became_active":"2023-06-10T18:53:54.373522+0000","last_became_peered":"2023-06-10T18:53:54.373522+0000","last_unstale":"2023-06-10T18:53:55.752480+0000","last_undegraded":"2023-06-10T18:53:55.752480+0000","last_fullsized":"2023-06-10T18:53:55.752480+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:44:48.399959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:57.375588+0000","last_change":"2023-06-10T18:53:54.794803+0000","last_active":"2023-06-10T18:53:57.375588+0000","last_peered":"2023-06-10T18:53:57.375588+0000","last_clean":"2023-06-10T18:53:57.375588+0000","last_became_active":"2023-06-10T18:53:54.790220+0000","last_became_peered":"2023-06-10T18:53:54.790220+0000","last_unstale":"2023-06-10T18:53:57.375588+0000","last_undegraded":"2023-06-10T18:53:57.375588+0000","last_fullsized":"2023-06-10T18:53:57.375588+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:48:42.741824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:56.367716+0000","last_change":"2023-06-10T18:53:54.400547+0000","last_active":"2023-06-10T18:53:56.367716+0000","last_peered":"2023-06-10T18:53:56.367716+0000","last_clean":"2023-06-10T18:53:56.367716+0000","last_became_active":"2023-06-10T18:53:54.399937+0000","last_became_peered":"2023-06-10T18:53:54.399937+0000","last_unstale":"2023-06-10T18:53:56.367716+0000","last_undegraded":"2023-06-10T18:53:56.367716+0000","last_fullsized":"2023-06-10T18:53:56.367716+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:20:58.125741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":199,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:56.366862+0000","last_change":"2023-06-10T18:52:34.951528+0000","last_active":"2023-06-10T18:53:56.366862+0000","last_peered":"2023-06-10T18:53:56.366862+0000","last_clean":"2023-06-10T18:53:56.366862+0000","last_became_active":"2023-06-10T18:52:34.949099+0000","last_became_peered":"2023-06-10T18:52:34.949099+0000","last_unstale":"2023-06-10T18:53:56.366862+0000","last_undegraded":"2023-06-10T18:53:56.366862+0000","last_fullsized":"2023-06-10T18:53:56.366862+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_clean_scrub_stamp":"2023-06-10T18:52:33.633295+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:27:01.708815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:57.375422+0000","last_change":"2023-06-10T18:52:40.506384+0000","last_active":"2023-06-10T18:53:57.375422+0000","last_peered":"2023-06-10T18:53:57.375422+0000","last_clean":"2023-06-10T18:53:57.375422+0000","last_became_active":"2023-06-10T18:52:40.505701+0000","last_became_peered":"2023-06-10T18:52:40.505701+0000","last_unstale":"2023-06-10T18:53:57.375422+0000","last_undegraded":"2023-06-10T18:53:57.375422+0000","last_fullsized":"2023-06-10T18:53:57.375422+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:45:34.569182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-06-10T18:53:54.797175+0000","last_change":"2023-06-10T18:53:54.795802+0000","last_active":"2023-06-10T18:53:54.797175+0000","last_peered":"2023-06-10T18:53:54.797175+0000","last_clean":"2023-06-10T18:53:54.797175+0000","last_became_active":"2023-06-10T18:53:54.795535+0000","last_became_peered":"2023-06-10T18:53:54.795535+0000","last_unstale":"2023-06-10T18:53:54.797175+0000","last_undegraded":"2023-06-10T18:53:54.797175+0000","last_fullsized":"2023-06-10T18:53:54.797175+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:05:43.869661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"36'2","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:57.375924+0000","last_change":"2023-06-10T18:53:54.388998+0000","last_active":"2023-06-10T18:53:57.375924+0000","last_peered":"2023-06-10T18:53:57.375924+0000","last_clean":"2023-06-10T18:53:57.375924+0000","last_became_active":"2023-06-10T18:53:54.388252+0000","last_became_peered":"2023-06-10T18:53:54.388252+0000","last_unstale":"2023-06-10T18:53:57.375924+0000","last_undegraded":"2023-06-10T18:53:57.375924+0000","last_fullsized":"2023-06-10T18:53:57.375924+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:27:31.107119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:56.366551+0000","last_change":"2023-06-10T18:52:40.512015+0000","last_active":"2023-06-10T18:53:56.366551+0000","last_peered":"2023-06-10T18:53:56.366551+0000","last_clean":"2023-06-10T18:53:56.366551+0000","last_became_active":"2023-06-10T18:52:40.511382+0000","last_became_peered":"2023-06-10T18:52:40.511382+0000","last_unstale":"2023-06-10T18:53:56.366551+0000","last_undegraded":"2023-06-10T18:53:56.366551+0000","last_fullsized":"2023-06-10T18:53:56.366551+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:56:03.073929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:56.367738+0000","last_change":"2023-06-10T18:53:54.797147+0000","last_active":"2023-06-10T18:53:56.367738+0000","last_peered":"2023-06-10T18:53:56.367738+0000","last_clean":"2023-06-10T18:53:56.367738+0000","last_became_active":"2023-06-10T18:53:54.796391+0000","last_became_peered":"2023-06-10T18:53:54.796391+0000","last_unstale":"2023-06-10T18:53:56.367738+0000","last_undegraded":"2023-06-10T18:53:56.367738+0000","last_fullsized":"2023-06-10T18:53:56.367738+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:33:14.521419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"37'1","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:57.450956+0000","last_change":"2023-06-10T18:53:54.389639+0000","last_active":"2023-06-10T18:53:57.450956+0000","last_peered":"2023-06-10T18:53:57.450956+0000","last_clean":"2023-06-10T18:53:57.450956+0000","last_became_active":"2023-06-10T18:53:54.389210+0000","last_became_peered":"2023-06-10T18:53:54.389210+0000","last_unstale":"2023-06-10T18:53:57.450956+0000","last_undegraded":"2023-06-10T18:53:57.450956+0000","last_fullsized":"2023-06-10T18:53:57.450956+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:48:30.976241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:55.752379+0000","last_change":"2023-06-10T18:52:40.671725+0000","last_active":"2023-06-10T18:53:55.752379+0000","last_peered":"2023-06-10T18:53:55.752379+0000","last_clean":"2023-06-10T18:53:55.752379+0000","last_became_active":"2023-06-10T18:52:40.671442+0000","last_became_peered":"2023-06-10T18:52:40.671442+0000","last_unstale":"2023-06-10T18:53:55.752379+0000","last_undegraded":"2023-06-10T18:53:55.752379+0000","last_fullsized":"2023-06-10T18:53:55.752379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:09:22.739169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:56.039029+0000","last_change":"2023-06-10T18:53:54.775817+0000","last_active":"2023-06-10T18:53:56.039029+0000","last_peered":"2023-06-10T18:53:56.039029+0000","last_clean":"2023-06-10T18:53:56.039029+0000","last_became_active":"2023-06-10T18:53:54.775534+0000","last_became_peered":"2023-06-10T18:53:54.775534+0000","last_unstale":"2023-06-10T18:53:56.039029+0000","last_undegraded":"2023-06-10T18:53:56.039029+0000","last_fullsized":"2023-06-10T18:53:56.039029+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:38:20.735578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:56.384218+0000","last_change":"2023-06-10T18:53:54.384226+0000","last_active":"2023-06-10T18:53:56.384218+0000","last_peered":"2023-06-10T18:53:56.384218+0000","last_clean":"2023-06-10T18:53:56.384218+0000","last_became_active":"2023-06-10T18:53:54.383856+0000","last_became_peered":"2023-06-10T18:53:54.383856+0000","last_unstale":"2023-06-10T18:53:56.384218+0000","last_undegraded":"2023-06-10T18:53:56.384218+0000","last_fullsized":"2023-06-10T18:53:56.384218+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:36:13.235346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:57.375019+0000","last_change":"2023-06-10T18:52:40.510258+0000","last_active":"2023-06-10T18:53:57.375019+0000","last_peered":"2023-06-10T18:53:57.375019+0000","last_clean":"2023-06-10T18:53:57.375019+0000","last_became_active":"2023-06-10T18:52:40.509560+0000","last_became_peered":"2023-06-10T18:52:40.509560+0000","last_unstale":"2023-06-10T18:53:57.375019+0000","last_undegraded":"2023-06-10T18:53:57.375019+0000","last_fullsized":"2023-06-10T18:53:57.375019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:29:48.461839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:56.384012+0000","last_change":"2023-06-10T18:53:54.760285+0000","last_active":"2023-06-10T18:53:56.384012+0000","last_peered":"2023-06-10T18:53:56.384012+0000","last_clean":"2023-06-10T18:53:56.384012+0000","last_became_active":"2023-06-10T18:53:54.759988+0000","last_became_peered":"2023-06-10T18:53:54.759988+0000","last_unstale":"2023-06-10T18:53:56.384012+0000","last_undegraded":"2023-06-10T18:53:56.384012+0000","last_fullsized":"2023-06-10T18:53:56.384012+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:50:17.577821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:56.384530+0000","last_change":"2023-06-10T18:53:54.382906+0000","last_active":"2023-06-10T18:53:56.384530+0000","last_peered":"2023-06-10T18:53:56.384530+0000","last_clean":"2023-06-10T18:53:56.384530+0000","last_became_active":"2023-06-10T18:53:54.382571+0000","last_became_peered":"2023-06-10T18:53:54.382571+0000","last_unstale":"2023-06-10T18:53:56.384530+0000","last_undegraded":"2023-06-10T18:53:56.384530+0000","last_fullsized":"2023-06-10T18:53:56.384530+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:39:32.197840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-06-10T18:53:54.752148+0000","last_change":"2023-06-10T18:52:40.672266+0000","last_active":"2023-06-10T18:53:54.752148+0000","last_peered":"2023-06-10T18:53:54.752148+0000","last_clean":"2023-06-10T18:53:54.752148+0000","last_became_active":"2023-06-10T18:52:40.671966+0000","last_became_peered":"2023-06-10T18:52:40.671966+0000","last_unstale":"2023-06-10T18:53:54.752148+0000","last_undegraded":"2023-06-10T18:53:54.752148+0000","last_fullsized":"2023-06-10T18:53:54.752148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:47:39.799135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-06-10T18:53:54.778323+0000","last_change":"2023-06-10T18:53:54.777459+0000","last_active":"2023-06-10T18:53:54.778323+0000","last_peered":"2023-06-10T18:53:54.778323+0000","last_clean":"2023-06-10T18:53:54.778323+0000","last_became_active":"2023-06-10T18:53:54.777169+0000","last_became_peered":"2023-06-10T18:53:54.777169+0000","last_unstale":"2023-06-10T18:53:54.778323+0000","last_undegraded":"2023-06-10T18:53:54.778323+0000","last_fullsized":"2023-06-10T18:53:54.778323+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:03:43.207774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:55.756257+0000","last_change":"2023-06-10T18:53:54.381838+0000","last_active":"2023-06-10T18:53:55.756257+0000","last_peered":"2023-06-10T18:53:55.756257+0000","last_clean":"2023-06-10T18:53:55.756257+0000","last_became_active":"2023-06-10T18:53:54.381114+0000","last_became_peered":"2023-06-10T18:53:54.381114+0000","last_unstale":"2023-06-10T18:53:55.756257+0000","last_undegraded":"2023-06-10T18:53:55.756257+0000","last_fullsized":"2023-06-10T18:53:55.756257+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:16:14.391598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:56.367970+0000","last_change":"2023-06-10T18:52:40.671084+0000","last_active":"2023-06-10T18:53:56.367970+0000","last_peered":"2023-06-10T18:53:56.367970+0000","last_clean":"2023-06-10T18:53:56.367970+0000","last_became_active":"2023-06-10T18:52:40.670697+0000","last_became_peered":"2023-06-10T18:52:40.670697+0000","last_unstale":"2023-06-10T18:53:56.367970+0000","last_undegraded":"2023-06-10T18:53:56.367970+0000","last_fullsized":"2023-06-10T18:53:56.367970+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:45:42.998817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:55.756208+0000","last_change":"2023-06-10T18:53:54.769110+0000","last_active":"2023-06-10T18:53:55.756208+0000","last_peered":"2023-06-10T18:53:55.756208+0000","last_clean":"2023-06-10T18:53:55.756208+0000","last_became_active":"2023-06-10T18:53:54.767762+0000","last_became_peered":"2023-06-10T18:53:54.767762+0000","last_unstale":"2023-06-10T18:53:55.756208+0000","last_undegraded":"2023-06-10T18:53:55.756208+0000","last_fullsized":"2023-06-10T18:53:55.756208+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:02:11.676949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:55.754687+0000","last_change":"2023-06-10T18:53:54.383752+0000","last_active":"2023-06-10T18:53:55.754687+0000","last_peered":"2023-06-10T18:53:55.754687+0000","last_clean":"2023-06-10T18:53:55.754687+0000","last_became_active":"2023-06-10T18:53:54.382794+0000","last_became_peered":"2023-06-10T18:53:54.382794+0000","last_unstale":"2023-06-10T18:53:55.754687+0000","last_undegraded":"2023-06-10T18:53:55.754687+0000","last_fullsized":"2023-06-10T18:53:55.754687+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:47:53.042433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-06-10T18:53:54.753714+0000","last_change":"2023-06-10T18:52:40.514114+0000","last_active":"2023-06-10T18:53:54.753714+0000","last_peered":"2023-06-10T18:53:54.753714+0000","last_clean":"2023-06-10T18:53:54.753714+0000","last_became_active":"2023-06-10T18:52:40.513638+0000","last_became_peered":"2023-06-10T18:52:40.513638+0000","last_unstale":"2023-06-10T18:53:54.753714+0000","last_undegraded":"2023-06-10T18:53:54.753714+0000","last_fullsized":"2023-06-10T18:53:54.753714+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:10:00.863502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:56.367421+0000","last_change":"2023-06-10T18:53:54.805142+0000","last_active":"2023-06-10T18:53:56.367421+0000","last_peered":"2023-06-10T18:53:56.367421+0000","last_clean":"2023-06-10T18:53:56.367421+0000","last_became_active":"2023-06-10T18:53:54.804631+0000","last_became_peered":"2023-06-10T18:53:54.804631+0000","last_unstale":"2023-06-10T18:53:56.367421+0000","last_undegraded":"2023-06-10T18:53:56.367421+0000","last_fullsized":"2023-06-10T18:53:56.367421+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:54.339981+0000","last_clean_scrub_stamp":"2023-06-10T18:53:54.339981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:46:49.434321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:56.038467+0000","last_change":"2023-06-10T18:53:54.381323+0000","last_active":"2023-06-10T18:53:56.038467+0000","last_peered":"2023-06-10T18:53:56.038467+0000","last_clean":"2023-06-10T18:53:56.038467+0000","last_became_active":"2023-06-10T18:53:54.381007+0000","last_became_peered":"2023-06-10T18:53:54.381007+0000","last_unstale":"2023-06-10T18:53:56.038467+0000","last_undegraded":"2023-06-10T18:53:56.038467+0000","last_fullsized":"2023-06-10T18:53:56.038467+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:53:53.327231+0000","last_clean_scrub_stamp":"2023-06-10T18:53:53.327231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:14:13.653553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-10T18:53:55.757712+0000","last_change":"2023-06-10T18:52:40.515396+0000","last_active":"2023-06-10T18:53:55.757712+0000","last_peered":"2023-06-10T18:53:55.757712+0000","last_clean":"2023-06-10T18:53:55.757712+0000","last_became_active":"2023-06-10T18:52:40.514663+0000","last_became_peered":"2023-06-10T18:52:40.514663+0000","last_unstale":"2023-06-10T18:53:55.757712+0000","last_undegraded":"2023-06-10T18:53:55.757712+0000","last_fullsized":"2023-06-10T18:53:55.757712+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:40:18.586434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":1008,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":1032192,"data_stored":767390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.159},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":1.1839999999999999}]},{"osd":1,"last update":"Sat Jun 10 18:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":1.3680000000000001},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.0860000000000001}]},{"osd":2,"last update":"Sat Jun 10 18:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":1.044},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.90500000000000003}]},{"osd":3,"last update":"Sat Jun 10 18:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":1.4139999999999999},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":1.2350000000000001}]},{"osd":4,"last update":"Sat Jun 10 18:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":1.125}]},{"osd":5,"last update":"Sat Jun 10 18:53:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.806,"5min":1.806,"15min":1.806},"last":0.997},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.95599999999999996}]},{"osd":6,"last update":"Sat Jun 10 18:53:35 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":1.26},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":1.284}]}]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":425984,"data_stored":175970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.57699999999999996}]},{"osd":1,"last update":"Sat Jun 10 18:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.876}]},{"osd":2,"last update":"Sat Jun 10 18:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.93700000000000006}]},{"osd":3,"last update":"Sat Jun 10 18:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.754}]},{"osd":4,"last update":"Sat Jun 10 18:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.96799999999999997}]},{"osd":5,"last update":"Sat Jun 10 18:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":1.0740000000000001}]},{"osd":7,"last update":"Sat Jun 10 18:53:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.84799999999999998},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":1.0509999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":408,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":417792,"data_stored":168847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":1.208}]},{"osd":1,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":1.0720000000000001},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.78,"5min":1.78,"15min":1.78},"last":0.75800000000000001}]},{"osd":2,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":1.1120000000000001},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.61899999999999999}]},{"osd":3,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":0.85699999999999998},{"interface":"front","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":1.252}]},{"osd":4,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.5249999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.99299999999999999},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":1.153}]},{"osd":6,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":1.4330000000000001},{"interface":"front","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.89700000000000002}]},{"osd":7,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.873,"5min":1.873,"15min":1.873},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.2909999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":420,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":430080,"data_stored":175992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:53:37 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.879,"5min":0.879,"15min":0.879},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.73,"5min":1.73,"15min":1.73},"last":0.80000000000000004}]},{"osd":1,"last update":"Sat Jun 10 18:53:37 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.68300000000000005}]},{"osd":2,"last update":"Sat Jun 10 18:53:37 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.83799999999999997},{"interface":"front","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.548,"5min":1.548,"15min":1.548},"last":1}]},{"osd":3,"last update":"Sat Jun 10 18:53:37 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.75600000000000001}]},{"osd":5,"last update":"Sat Jun 10 18:53:37 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":1.0349999999999999}]},{"osd":6,"last update":"Sat Jun 10 18:53:37 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":2.2639999999999998,"5min":2.2639999999999998,"15min":2.2639999999999998},"last":0.89900000000000002},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":1.0640000000000001}]},{"osd":7,"last update":"Sat Jun 10 18:53:37 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.081,"5min":1.081,"15min":1.081},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.97199999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31472,"kb_used_data":424,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340368,"statfs":{"total":96636764160,"available":96604536832,"internally_reserved":0,"allocated":434176,"data_stored":175967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.434},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.46500000000000002}]},{"osd":1,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.623}]},{"osd":2,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.9530000000000001,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":1.008},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.72299999999999998}]},{"osd":4,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.488,"5min":1.488,"15min":1.488},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":1.161}]},{"osd":5,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":2.024,"5min":2.024,"15min":2.024},"last":0.77400000000000002},{"interface":"front","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.724,"5min":1.724,"15min":1.724},"last":0.93600000000000005}]},{"osd":6,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.8500000000000001,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.78,"5min":1.78,"15min":1.78},"last":1.0509999999999999}]},{"osd":7,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.1990000000000001},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":1.24}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31464,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340376,"statfs":{"total":96636764160,"available":96604545024,"internally_reserved":0,"allocated":425984,"data_stored":175458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.76500000000000001}]},{"osd":1,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.90200000000000002}]},{"osd":3,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.67800000000000005}]},{"osd":4,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":1.02},{"interface":"front","average":{"1min":1.04,"5min":1.04,"15min":1.04},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":1.0620000000000001}]},{"osd":5,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.556,"5min":1.556,"15min":1.556},"last":1.2},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":1.0369999999999999}]},{"osd":6,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":1.1779999999999999},{"interface":"front","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.97199999999999998}]},{"osd":7,"last update":"Sat Jun 10 18:53:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":1.095}]}]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":400,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":409600,"data_stored":167806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,2],"upper_bound":64},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:53:34 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":0.35099999999999998}]},{"osd":2,"last update":"Sat Jun 10 18:53:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.249},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.55000000000000004}]},{"osd":3,"last update":"Sat Jun 10 18:53:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":2.1749999999999998,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":0.56299999999999994}]},{"osd":4,"last update":"Sat Jun 10 18:53:34 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":2.218,"5min":2.218,"15min":2.218},"last":5.8209999999999997}]},{"osd":5,"last update":"Sat Jun 10 18:53:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.8620000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":1.145},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":2.0190000000000001,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":3.089}]},{"osd":6,"last update":"Sat Jun 10 18:53:34 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":2.0720000000000001,"5min":2.0720000000000001,"15min":2.0720000000000001},"last":7.2599999999999998},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.774,"5min":1.774,"15min":1.774},"last":9.0069999999999997}]},{"osd":7,"last update":"Sat Jun 10 18:53:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":2.105,"5min":2.105,"15min":2.105},"last":0.66900000000000004},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":2.2570000000000001,"5min":2.2570000000000001,"15min":2.2570000000000001},"last":0.745}]}]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32040,"kb_used_data":992,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339800,"statfs":{"total":96636764160,"available":96603955200,"internally_reserved":0,"allocated":1015808,"data_stored":764771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jun 10 18:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.82299999999999995}]},{"osd":2,"last update":"Sat Jun 10 18:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":1.2490000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.78000000000000003}]},{"osd":3,"last update":"Sat Jun 10 18:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.829,"5min":1.829,"15min":1.829},"last":1.089}]},{"osd":4,"last update":"Sat Jun 10 18:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":1.155},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.9510000000000001,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":1.403}]},{"osd":5,"last update":"Sat Jun 10 18:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":1.363},{"interface":"front","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.75,"5min":1.75,"15min":1.75},"last":0.996}]},{"osd":6,"last update":"Sat Jun 10 18:53:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":2.04,"5min":2.04,"15min":2.04},"last":1.5229999999999999},{"interface":"front","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":1.202}]},{"osd":7,"last update":"Sat Jun 10 18:53:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":1.49},{"interface":"front","average":{"1min":1.048,"5min":1.048,"15min":1.048},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.9830000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.3280000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-10T18:54:02.672 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-06-10T18:54:02.673 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-06-10T18:54:02.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.836+0000 7fda4dd7c640 1 Processor -- start 2023-06-10T18:54:02.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.836+0000 7fda4dd7c640 1 -- start start 2023-06-10T18:54:02.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.840+0000 7fda4dd7c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fda4815c220 0x7fda480cce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:02.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.840+0000 7fda4dd7c640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda480b45c0 con 0x7fda480b7660 2023-06-10T18:54:02.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.840+0000 7fda4dd7c640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda480b4af0 con 0x7fda4815be50 2023-06-10T18:54:02.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.840+0000 7fda4dd7c640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda480cfec0 con 0x7fda4815c220 2023-06-10T18:54:02.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.840+0000 7fda46ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fda4815c220 0x7fda480cce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:02.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.840+0000 7fda47fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fda480b7660 0x7fda480d0350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41018/0 (socket says 172.21.15.53:41018) 2023-06-10T18:54:02.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.840+0000 7fda47fff640 1 -- 172.21.15.53:0/3655219775 learned_addr learned my addr 172.21.15.53:0/3655219775 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:54:02.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.840+0000 7fda467fc640 1 -- 172.21.15.53:0/3655219775 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3780450773 0 0) 0x7fda480b45c0 con 0x7fda480b7660 2023-06-10T18:54:02.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.840+0000 7fda467fc640 1 -- 172.21.15.53:0/3655219775 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda30003530 con 0x7fda480b7660 2023-06-10T18:54:02.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.840+0000 7fda46ffd640 1 -- 172.21.15.53:0/3655219775 >> v1:172.21.15.117:6789/0 conn(0x7fda4815be50 legacy=0x7fda480cc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:02.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.840+0000 7fda46ffd640 1 -- 172.21.15.53:0/3655219775 >> v1:172.21.15.53:6789/0 conn(0x7fda480b7660 legacy=0x7fda480d0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:02.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.840+0000 7fda46ffd640 1 -- 172.21.15.53:0/3655219775 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda480b7f00 con 0x7fda4815c220 2023-06-10T18:54:02.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.840+0000 7fda46ffd640 1 --2- 172.21.15.53:0/3655219775 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda4815c220 0x7fda480cce90 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fda3c0097c0 tx=0x7fda3c01c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b320ad868040c14f server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:02.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.840+0000 7fda467fc640 1 -- 172.21.15.53:0/3655219775 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda3c0ac600 con 0x7fda4815c220 2023-06-10T18:54:02.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.840+0000 7fda467fc640 1 -- 172.21.15.53:0/3655219775 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda3c0a8050 con 0x7fda4815c220 2023-06-10T18:54:02.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.840+0000 7fda467fc640 1 -- 172.21.15.53:0/3655219775 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda3c0ac980 con 0x7fda4815c220 2023-06-10T18:54:02.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.844+0000 7fda4dd7c640 1 -- 172.21.15.53:0/3655219775 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda4815c220 msgr2=0x7fda480cce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:02.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.844+0000 7fda4dd7c640 1 --2- 172.21.15.53:0/3655219775 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda4815c220 0x7fda480cce90 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fda3c0097c0 tx=0x7fda3c01c380 comp rx=0 tx=0).stop 2023-06-10T18:54:02.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.844+0000 7fda4dd7c640 1 -- 172.21.15.53:0/3655219775 shutdown_connections 2023-06-10T18:54:02.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.844+0000 7fda4dd7c640 1 --2- 172.21.15.53:0/3655219775 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda4815c220 0x7fda480cce90 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:02.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.844+0000 7fda4dd7c640 1 -- 172.21.15.53:0/3655219775 >> 172.21.15.53:0/3655219775 conn(0x7fda4806aa30 msgr2=0x7fda480cebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:54:02.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.844+0000 7fda4dd7c640 1 -- 172.21.15.53:0/3655219775 shutdown_connections 2023-06-10T18:54:02.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.844+0000 7fda4dd7c640 1 -- 172.21.15.53:0/3655219775 wait complete. 2023-06-10T18:54:02.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.844+0000 7fda4dd7c640 1 Processor -- start 2023-06-10T18:54:02.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.844+0000 7fda4dd7c640 1 -- start start 2023-06-10T18:54:02.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.844+0000 7fda4dd7c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda480b7660 0x7fda4814b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:02.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.844+0000 7fda4dd7c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda4815be50 0x7fda480ca380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:02.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.844+0000 7fda4dd7c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda4815c220 0x7fda480b63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:02.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.844+0000 7fda4dd7c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda480cac80 con 0x7fda4815be50 2023-06-10T18:54:02.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.844+0000 7fda4dd7c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda480caf60 con 0x7fda480b7660 2023-06-10T18:54:02.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.844+0000 7fda4dd7c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda480cb240 con 0x7fda4815c220 2023-06-10T18:54:02.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.844+0000 7fda46ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda4815be50 0x7fda480ca380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:02.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.844+0000 7fda46ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda4815be50 0x7fda480ca380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55688/0 (socket says 172.21.15.53:55688) 2023-06-10T18:54:02.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.844+0000 7fda46ffd640 1 -- 172.21.15.53:0/1536026330 learned_addr learned my addr 172.21.15.53:0/1536026330 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:54:02.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.844+0000 7fda477fe640 1 --2- 172.21.15.53:0/1536026330 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda480b7660 0x7fda4814b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:02.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.844+0000 7fda47fff640 1 --2- 172.21.15.53:0/1536026330 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda4815c220 0x7fda480b63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:02.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.844+0000 7fda46ffd640 1 -- 172.21.15.53:0/1536026330 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda4815c220 msgr2=0x7fda480b63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:02.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.844+0000 7fda46ffd640 1 --2- 172.21.15.53:0/1536026330 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda4815c220 0x7fda480b63e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:02.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.844+0000 7fda46ffd640 1 -- 172.21.15.53:0/1536026330 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda480b7660 msgr2=0x7fda4814b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:02.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.844+0000 7fda46ffd640 1 --2- 172.21.15.53:0/1536026330 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda480b7660 0x7fda4814b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:02.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.844+0000 7fda46ffd640 1 -- 172.21.15.53:0/1536026330 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda3c009420 con 0x7fda4815be50 2023-06-10T18:54:02.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.844+0000 7fda46ffd640 1 --2- 172.21.15.53:0/1536026330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda4815be50 0x7fda480ca380 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fda3c018f90 tx=0x7fda3c01abc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:02.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.844+0000 7fda2ffff640 1 -- 172.21.15.53:0/1536026330 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda3c006e20 con 0x7fda4815be50 2023-06-10T18:54:02.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.844+0000 7fda2ffff640 1 -- 172.21.15.53:0/1536026330 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda3c004020 con 0x7fda4815be50 2023-06-10T18:54:02.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.844+0000 7fda2ffff640 1 -- 172.21.15.53:0/1536026330 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda3c004390 con 0x7fda4815be50 2023-06-10T18:54:02.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.844+0000 7fda4dd7c640 1 -- 172.21.15.53:0/1536026330 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda480cb520 con 0x7fda4815be50 2023-06-10T18:54:02.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.844+0000 7fda4dd7c640 1 -- 172.21.15.53:0/1536026330 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda480c6e70 con 0x7fda4815be50 2023-06-10T18:54:02.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.848+0000 7fda4dd7c640 1 -- 172.21.15.53:0/1536026330 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda4804d790 con 0x7fda4815be50 2023-06-10T18:54:02.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.848+0000 7fda2ffff640 1 -- 172.21.15.53:0/1536026330 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fda3c0b3050 con 0x7fda4815be50 2023-06-10T18:54:02.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.848+0000 7fda2ffff640 1 --2- 172.21.15.53:0/1536026330 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fda340662b0 0x7fda34068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:02.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.848+0000 7fda2ffff640 1 -- 172.21.15.53:0/1536026330 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fda3c11dfa0 con 0x7fda4815be50 2023-06-10T18:54:02.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.848+0000 7fda477fe640 1 --2- 172.21.15.53:0/1536026330 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fda340662b0 0x7fda34068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:02.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.848+0000 7fda477fe640 1 --2- 172.21.15.53:0/1536026330 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fda340662b0 0x7fda34068760 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fda38001720 tx=0x7fda38009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:02.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:02.852+0000 7fda2ffff640 1 -- 172.21.15.53:0/1536026330 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fda3c0eb410 con 0x7fda4815be50 2023-06-10T18:54:03.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.060+0000 7fda4dd7c640 1 -- 172.21.15.53:0/1536026330 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fda480b22a0 con 0x7fda4815be50 2023-06-10T18:54:03.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.068+0000 7fda2ffff640 1 -- 172.21.15.53:0/1536026330 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+0 (secure 0 0 0) 0x7fda3c0044f0 con 0x7fda4815be50 2023-06-10T18:54:03.077 INFO:teuthology.orchestra.run.smithi053.stderr:updated caps for client.0 2023-06-10T18:54:03.079 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.072+0000 7fda4dd7c640 1 -- 172.21.15.53:0/1536026330 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fda340662b0 msgr2=0x7fda34068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:03.079 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.072+0000 7fda4dd7c640 1 --2- 172.21.15.53:0/1536026330 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fda340662b0 0x7fda34068760 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fda38001720 tx=0x7fda38009040 comp rx=0 tx=0).stop 2023-06-10T18:54:03.079 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.072+0000 7fda4dd7c640 1 -- 172.21.15.53:0/1536026330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda4815be50 msgr2=0x7fda480ca380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:03.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.072+0000 7fda4dd7c640 1 --2- 172.21.15.53:0/1536026330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda4815be50 0x7fda480ca380 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fda3c018f90 tx=0x7fda3c01abc0 comp rx=0 tx=0).stop 2023-06-10T18:54:03.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.072+0000 7fda4dd7c640 1 -- 172.21.15.53:0/1536026330 shutdown_connections 2023-06-10T18:54:03.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.072+0000 7fda4dd7c640 1 --2- 172.21.15.53:0/1536026330 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fda340662b0 0x7fda34068760 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:03.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.072+0000 7fda4dd7c640 1 --2- 172.21.15.53:0/1536026330 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda4815c220 0x7fda480b63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:03.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.072+0000 7fda4dd7c640 1 --2- 172.21.15.53:0/1536026330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda4815be50 0x7fda480ca380 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:03.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.072+0000 7fda4dd7c640 1 --2- 172.21.15.53:0/1536026330 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda480b7660 0x7fda4814b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:03.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.072+0000 7fda4dd7c640 1 -- 172.21.15.53:0/1536026330 >> 172.21.15.53:0/1536026330 conn(0x7fda4806aa30 msgr2=0x7fda480b24c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:54:03.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.072+0000 7fda4dd7c640 1 -- 172.21.15.53:0/1536026330 shutdown_connections 2023-06-10T18:54:03.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.072+0000 7fda4dd7c640 1 -- 172.21.15.53:0/1536026330 wait complete. 2023-06-10T18:54:03.097 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T18:54:03.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.212+0000 7f0d02589640 1 Processor -- start 2023-06-10T18:54:03.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.212+0000 7f0d02589640 1 -- start start 2023-06-10T18:54:03.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.212+0000 7f0d02589640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0cfc0b3ac0 0x7f0cfc0b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:03.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.212+0000 7f0d02589640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0cfc0d14c0 0x7f0cfc15fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:03.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.212+0000 7f0d02589640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cfc0d0020 con 0x7f0cfc0cc690 2023-06-10T18:54:03.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.212+0000 7f0d02589640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cfc0b43d0 con 0x7f0cfc0b3ac0 2023-06-10T18:54:03.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.212+0000 7f0d02589640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cfc0cef40 con 0x7f0cfc0d14c0 2023-06-10T18:54:03.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.212+0000 7f0cfbfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0cfc0b3ac0 0x7f0cfc0b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:03.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.212+0000 7f0cfbfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0cfc0b3ac0 0x7f0cfc0b3e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55698/0 (socket says 172.21.15.53:55698) 2023-06-10T18:54:03.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.212+0000 7f0cfbfff640 1 -- 172.21.15.53:0/162704392 learned_addr learned my addr 172.21.15.53:0/162704392 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:54:03.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.212+0000 7f0d00b26640 1 --2- 172.21.15.53:0/162704392 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0cfc0d14c0 0x7f0cfc15fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:03.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.212+0000 7f0cfbfff640 1 -- 172.21.15.53:0/162704392 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0cfc0d14c0 msgr2=0x7f0cfc15fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:54:03.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.212+0000 7f0cfbfff640 1 --2- 172.21.15.53:0/162704392 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0cfc0d14c0 0x7f0cfc15fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:03.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.212+0000 7f0cfbfff640 1 -- 172.21.15.53:0/162704392 >> v1:172.21.15.117:6789/0 conn(0x7f0cfc0cc690 legacy=0x7f0cfc15f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:03.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.212+0000 7f0cfbfff640 1 -- 172.21.15.53:0/162704392 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cfc0cf220 con 0x7f0cfc0b3ac0 2023-06-10T18:54:03.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.216+0000 7f0cfbfff640 1 --2- 172.21.15.53:0/162704392 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0cfc0b3ac0 0x7f0cfc0b3e90 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f0cec009870 tx=0x7f0cec01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38f29bc49bd75203 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:03.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.216+0000 7f0cfaffd640 1 -- 172.21.15.53:0/162704392 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cec0ab620 con 0x7f0cfc0b3ac0 2023-06-10T18:54:03.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.216+0000 7f0cfaffd640 1 -- 172.21.15.53:0/162704392 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cec0ab780 con 0x7f0cfc0b3ac0 2023-06-10T18:54:03.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.216+0000 7f0cfaffd640 1 -- 172.21.15.53:0/162704392 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cec0abb10 con 0x7f0cfc0b3ac0 2023-06-10T18:54:03.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.216+0000 7f0d02589640 1 -- 172.21.15.53:0/162704392 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0cfc0b3ac0 msgr2=0x7f0cfc0b3e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:03.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.216+0000 7f0d02589640 1 --2- 172.21.15.53:0/162704392 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0cfc0b3ac0 0x7f0cfc0b3e90 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f0cec009870 tx=0x7f0cec01c510 comp rx=0 tx=0).stop 2023-06-10T18:54:03.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.216+0000 7f0d02589640 1 -- 172.21.15.53:0/162704392 shutdown_connections 2023-06-10T18:54:03.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.216+0000 7f0d02589640 1 --2- 172.21.15.53:0/162704392 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0cfc0d14c0 0x7f0cfc15fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:03.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.216+0000 7f0d02589640 1 --2- 172.21.15.53:0/162704392 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0cfc0b3ac0 0x7f0cfc0b3e90 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:03.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.216+0000 7f0d02589640 1 -- 172.21.15.53:0/162704392 >> 172.21.15.53:0/162704392 conn(0x7f0cfc071790 msgr2=0x7f0cfc069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:54:03.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.216+0000 7f0d02589640 1 -- 172.21.15.53:0/162704392 shutdown_connections 2023-06-10T18:54:03.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.216+0000 7f0d02589640 1 -- 172.21.15.53:0/162704392 wait complete. 2023-06-10T18:54:03.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.216+0000 7f0d02589640 1 Processor -- start 2023-06-10T18:54:03.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.216+0000 7f0d02589640 1 -- start start 2023-06-10T18:54:03.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.220+0000 7f0d02589640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cfc0b3ac0 0x7f0cfc1419b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:03.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.220+0000 7f0d02589640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0cfc0cc690 0x7f0cfc0cac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:03.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.220+0000 7f0d02589640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0cfc0d14c0 0x7f0cfc0cb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:03.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.220+0000 7f0d02589640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cfc0c91b0 con 0x7f0cfc0cc690 2023-06-10T18:54:03.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.220+0000 7f0d02589640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cfc141ef0 con 0x7f0cfc0b3ac0 2023-06-10T18:54:03.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.220+0000 7f0d02589640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cfc0c9700 con 0x7f0cfc0d14c0 2023-06-10T18:54:03.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.220+0000 7f0cfb7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0cfc0cc690 0x7f0cfc0cac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:03.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.220+0000 7f0cfb7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0cfc0cc690 0x7f0cfc0cac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55710/0 (socket says 172.21.15.53:55710) 2023-06-10T18:54:03.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.220+0000 7f0cfb7fe640 1 -- 172.21.15.53:0/3735030462 learned_addr learned my addr 172.21.15.53:0/3735030462 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:54:03.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.220+0000 7f0cfbfff640 1 --2- 172.21.15.53:0/3735030462 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cfc0b3ac0 0x7f0cfc1419b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:03.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.220+0000 7f0d00b26640 1 --2- 172.21.15.53:0/3735030462 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0cfc0d14c0 0x7f0cfc0cb9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:03.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.220+0000 7f0cfb7fe640 1 -- 172.21.15.53:0/3735030462 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0cfc0d14c0 msgr2=0x7f0cfc0cb9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:03.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.220+0000 7f0cfb7fe640 1 --2- 172.21.15.53:0/3735030462 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0cfc0d14c0 0x7f0cfc0cb9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:03.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.220+0000 7f0cfb7fe640 1 -- 172.21.15.53:0/3735030462 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cfc0b3ac0 msgr2=0x7f0cfc1419b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:03.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.220+0000 7f0cfb7fe640 1 --2- 172.21.15.53:0/3735030462 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cfc0b3ac0 0x7f0cfc1419b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:03.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.220+0000 7f0cfb7fe640 1 -- 172.21.15.53:0/3735030462 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cec0094d0 con 0x7f0cfc0cc690 2023-06-10T18:54:03.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.220+0000 7f0cfbfff640 1 --2- 172.21.15.53:0/3735030462 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cfc0b3ac0 0x7f0cfc1419b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:54:03.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.220+0000 7f0cfb7fe640 1 --2- 172.21.15.53:0/3735030462 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0cfc0cc690 0x7f0cfc0cac70 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f0cf000c500 tx=0x7f0cf000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:03.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.220+0000 7f0cf8ff9640 1 -- 172.21.15.53:0/3735030462 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf0005220 con 0x7f0cfc0cc690 2023-06-10T18:54:03.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.220+0000 7f0cf8ff9640 1 -- 172.21.15.53:0/3735030462 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cf0005380 con 0x7f0cfc0cc690 2023-06-10T18:54:03.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.220+0000 7f0d02589640 1 -- 172.21.15.53:0/3735030462 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cfc0c9420 con 0x7f0cfc0cc690 2023-06-10T18:54:03.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.220+0000 7f0cf8ff9640 1 -- 172.21.15.53:0/3735030462 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf0007270 con 0x7f0cfc0cc690 2023-06-10T18:54:03.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.220+0000 7f0d02589640 1 -- 172.21.15.53:0/3735030462 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cfc1533a0 con 0x7f0cfc0cc690 2023-06-10T18:54:03.232 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.220+0000 7f0d02589640 1 -- 172.21.15.53:0/3735030462 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cfc1535c0 con 0x7f0cfc0cc690 2023-06-10T18:54:03.232 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.220+0000 7f0cf8ff9640 1 -- 172.21.15.53:0/3735030462 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0cf0007410 con 0x7f0cfc0cc690 2023-06-10T18:54:03.232 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.220+0000 7f0cf8ff9640 1 --2- 172.21.15.53:0/3735030462 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0ce8066280 0x7f0ce8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:03.232 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.220+0000 7f0cf8ff9640 1 -- 172.21.15.53:0/3735030462 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0cf0083600 con 0x7f0cfc0cc690 2023-06-10T18:54:03.232 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.220+0000 7f0cfbfff640 1 --2- 172.21.15.53:0/3735030462 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0ce8066280 0x7f0ce8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:03.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.224+0000 7f0cfbfff640 1 --2- 172.21.15.53:0/3735030462 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0ce8066280 0x7f0ce8068730 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0cec0af000 tx=0x7f0cec0a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:03.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.224+0000 7f0cf8ff9640 1 -- 172.21.15.53:0/3735030462 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0cf0050a90 con 0x7f0cfc0cc690 2023-06-10T18:54:03.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.412+0000 7f0d02589640 1 -- 172.21.15.53:0/3735030462 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0cfc04d790 con 0x7f0cfc0cc690 2023-06-10T18:54:03.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.416+0000 7f0cf8ff9640 1 -- 172.21.15.53:0/3735030462 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4677 (secure 0 0 0) 0x7f0cf00540b0 con 0x7f0cfc0cc690 2023-06-10T18:54:03.424 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:54:03.424 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4853,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/4087456763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":4087456763},{"type":"v1","addr":"172.21.15.117:6835","nonce":4087456763}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5071,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1065941624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1065941624},{"type":"v1","addr":"172.21.15.117:6837","nonce":1065941624}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5322,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/4137796077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":4137796077},{"type":"v1","addr":"172.21.15.53:6833","nonce":4137796077}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T18:53:54.735461+0000","modified":"2023-06-10T18:53:56.773799+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5331},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5331":{"gid":5331,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/2596772129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2596772129},{"type":"v1","addr":"172.21.15.53:6835","nonce":2596772129}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-06-10T18:54:03.424 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 13 2023-06-10T18:54:03.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.416+0000 7f0d02589640 1 -- 172.21.15.53:0/3735030462 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0ce8066280 msgr2=0x7f0ce8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:03.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.416+0000 7f0d02589640 1 --2- 172.21.15.53:0/3735030462 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0ce8066280 0x7f0ce8068730 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0cec0af000 tx=0x7f0cec0a7000 comp rx=0 tx=0).stop 2023-06-10T18:54:03.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.416+0000 7f0d02589640 1 -- 172.21.15.53:0/3735030462 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0cfc0cc690 msgr2=0x7f0cfc0cac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:03.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.416+0000 7f0d02589640 1 --2- 172.21.15.53:0/3735030462 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0cfc0cc690 0x7f0cfc0cac70 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f0cf000c500 tx=0x7f0cf000c9c0 comp rx=0 tx=0).stop 2023-06-10T18:54:03.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.416+0000 7f0d02589640 1 -- 172.21.15.53:0/3735030462 shutdown_connections 2023-06-10T18:54:03.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.416+0000 7f0d02589640 1 --2- 172.21.15.53:0/3735030462 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0ce8066280 0x7f0ce8068730 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:03.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.416+0000 7f0d02589640 1 --2- 172.21.15.53:0/3735030462 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0cfc0d14c0 0x7f0cfc0cb9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:03.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.416+0000 7f0d02589640 1 --2- 172.21.15.53:0/3735030462 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0cfc0cc690 0x7f0cfc0cac70 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:03.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.416+0000 7f0d02589640 1 --2- 172.21.15.53:0/3735030462 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cfc0b3ac0 0x7f0cfc1419b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:03.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.416+0000 7f0d02589640 1 -- 172.21.15.53:0/3735030462 >> 172.21.15.53:0/3735030462 conn(0x7f0cfc071790 msgr2=0x7f0cfc0ce250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:54:03.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.416+0000 7f0d02589640 1 -- 172.21.15.53:0/3735030462 shutdown_connections 2023-06-10T18:54:03.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.416+0000 7f0d02589640 1 -- 172.21.15.53:0/3735030462 wait complete. 2023-06-10T18:54:03.843 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-06-10T18:53:54.735461+0000', 'modified': '2023-06-10T18:53:56.773799+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5331}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5331': {'gid': 5331, 'name': 'a', 'rank': 0, 'incarnation': 11, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.53:6835/2596772129', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.53:6834', 'nonce': 2596772129}, {'type': 'v1', 'addr': '172.21.15.53:6835', 'nonce': 2596772129}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-06-10T18:54:03.843 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-06-10T18:54:03.844 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-06-10T18:54:03.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.968+0000 7f2ceda98640 1 Processor -- start 2023-06-10T18:54:03.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.968+0000 7f2ceda98640 1 -- start start 2023-06-10T18:54:03.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.968+0000 7f2ceda98640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2ce81571a0 0x7f2ce80c9f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:03.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.968+0000 7f2ceda98640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2ce8070100 0x7f2ce80af7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:03.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.968+0000 7f2ceda98640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ce8071190 con 0x7f2ce80afd10 2023-06-10T18:54:03.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.968+0000 7f2ceda98640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ce80b0190 con 0x7f2ce81571a0 2023-06-10T18:54:03.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.968+0000 7f2ceda98640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ce80ca440 con 0x7f2ce8070100 2023-06-10T18:54:03.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.968+0000 7f2ce77fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2ce81571a0 0x7f2ce80c9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:03.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.968+0000 7f2ce77fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2ce81571a0 0x7f2ce80c9f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55716/0 (socket says 172.21.15.53:55716) 2023-06-10T18:54:03.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.968+0000 7f2ce77fe640 1 -- 172.21.15.53:0/3343906236 learned_addr learned my addr 172.21.15.53:0/3343906236 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:54:03.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.968+0000 7f2ce6ffd640 1 --2- 172.21.15.53:0/3343906236 >> v2:172.21.15.117:3300/0 conn(0x7f2ce8070100 0x7f2ce80af7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:03.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.968+0000 7f2ce77fe640 1 -- 172.21.15.53:0/3343906236 >> v2:172.21.15.117:3300/0 conn(0x7f2ce8070100 msgr2=0x7f2ce80af7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:54:03.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.968+0000 7f2ce77fe640 1 --2- 172.21.15.53:0/3343906236 >> v2:172.21.15.117:3300/0 conn(0x7f2ce8070100 0x7f2ce80af7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:03.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.968+0000 7f2ce77fe640 1 -- 172.21.15.53:0/3343906236 >> v1:172.21.15.117:6789/0 conn(0x7f2ce80afd10 legacy=0x7f2ce815d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:54:03.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.968+0000 7f2ce77fe640 1 -- 172.21.15.53:0/3343906236 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ce8070580 con 0x7f2ce81571a0 2023-06-10T18:54:03.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.972+0000 7f2ce77fe640 1 --2- 172.21.15.53:0/3343906236 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2ce81571a0 0x7f2ce80c9f00 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f2ce80b3ec0 tx=0x7f2cd801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee34b1c4d236f86c server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:03.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.972+0000 7f2ce67fc640 1 -- 172.21.15.53:0/3343906236 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd80aa5f0 con 0x7f2ce81571a0 2023-06-10T18:54:03.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.972+0000 7f2ce67fc640 1 -- 172.21.15.53:0/3343906236 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cd80aa750 con 0x7f2ce81571a0 2023-06-10T18:54:03.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.972+0000 7f2ce67fc640 1 -- 172.21.15.53:0/3343906236 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd80aaae0 con 0x7f2ce81571a0 2023-06-10T18:54:03.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.972+0000 7f2ceda98640 1 -- 172.21.15.53:0/3343906236 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2ce81571a0 msgr2=0x7f2ce80c9f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:03.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.972+0000 7f2ceda98640 1 --2- 172.21.15.53:0/3343906236 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2ce81571a0 0x7f2ce80c9f00 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f2ce80b3ec0 tx=0x7f2cd801c490 comp rx=0 tx=0).stop 2023-06-10T18:54:03.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.972+0000 7f2ceda98640 1 -- 172.21.15.53:0/3343906236 shutdown_connections 2023-06-10T18:54:03.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.972+0000 7f2ceda98640 1 --2- 172.21.15.53:0/3343906236 >> v2:172.21.15.117:3300/0 conn(0x7f2ce8070100 0x7f2ce80af7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:03.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.972+0000 7f2ceda98640 1 --2- 172.21.15.53:0/3343906236 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2ce81571a0 0x7f2ce80c9f00 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:03.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.972+0000 7f2ceda98640 1 -- 172.21.15.53:0/3343906236 >> 172.21.15.53:0/3343906236 conn(0x7f2ce80ce9e0 msgr2=0x7f2ce80ca7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:54:03.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.972+0000 7f2ceda98640 1 -- 172.21.15.53:0/3343906236 shutdown_connections 2023-06-10T18:54:03.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.972+0000 7f2ceda98640 1 -- 172.21.15.53:0/3343906236 wait complete. 2023-06-10T18:54:03.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.976+0000 7f2ceda98640 1 Processor -- start 2023-06-10T18:54:03.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.976+0000 7f2ceda98640 1 -- start start 2023-06-10T18:54:03.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.976+0000 7f2ceda98640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ce80afd10 0x7f2ce80c7840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:03.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.976+0000 7f2ceda98640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2ce81571a0 0x7f2ce814d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:03.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.976+0000 7f2ceda98640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ce80c68a0 0x7f2ce8158500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:03.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.976+0000 7f2ceda98640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce80b0d40 con 0x7f2ce81571a0 2023-06-10T18:54:03.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.976+0000 7f2ceda98640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce814edc0 con 0x7f2ce80afd10 2023-06-10T18:54:03.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.976+0000 7f2ceda98640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce814e520 con 0x7f2ce80c68a0 2023-06-10T18:54:03.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.976+0000 7f2ce6ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2ce81571a0 0x7f2ce814d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:03.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.976+0000 7f2ce6ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2ce81571a0 0x7f2ce814d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55726/0 (socket says 172.21.15.53:55726) 2023-06-10T18:54:03.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.976+0000 7f2ce6ffd640 1 -- 172.21.15.53:0/3239867748 learned_addr learned my addr 172.21.15.53:0/3239867748 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:54:03.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.976+0000 7f2ce77fe640 1 --2- 172.21.15.53:0/3239867748 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ce80afd10 0x7f2ce80c7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:03.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.976+0000 7f2ce7fff640 1 --2- 172.21.15.53:0/3239867748 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ce80c68a0 0x7f2ce8158500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:03.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.976+0000 7f2ce6ffd640 1 -- 172.21.15.53:0/3239867748 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ce80c68a0 msgr2=0x7f2ce8158500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:03.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.976+0000 7f2ce6ffd640 1 --2- 172.21.15.53:0/3239867748 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ce80c68a0 0x7f2ce8158500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:03.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.976+0000 7f2ce6ffd640 1 -- 172.21.15.53:0/3239867748 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ce80afd10 msgr2=0x7f2ce80c7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:03.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.976+0000 7f2ce6ffd640 1 --2- 172.21.15.53:0/3239867748 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ce80afd10 0x7f2ce80c7840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:03.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.976+0000 7f2ce6ffd640 1 -- 172.21.15.53:0/3239867748 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cd8009480 con 0x7f2ce81571a0 2023-06-10T18:54:03.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.976+0000 7f2ce6ffd640 1 --2- 172.21.15.53:0/3239867748 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2ce81571a0 0x7f2ce814d4f0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc00c7f0 tx=0x7f2cdc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:03.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.976+0000 7f2ccffff640 1 -- 172.21.15.53:0/3239867748 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc004220 con 0x7f2ce81571a0 2023-06-10T18:54:03.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.976+0000 7f2ccffff640 1 -- 172.21.15.53:0/3239867748 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cdc004380 con 0x7f2ce81571a0 2023-06-10T18:54:03.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.976+0000 7f2ceda98640 1 -- 172.21.15.53:0/3239867748 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ce814e800 con 0x7f2ce81571a0 2023-06-10T18:54:03.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.976+0000 7f2ccffff640 1 -- 172.21.15.53:0/3239867748 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc003840 con 0x7f2ce81571a0 2023-06-10T18:54:03.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.976+0000 7f2ceda98640 1 -- 172.21.15.53:0/3239867748 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ce80c6d40 con 0x7f2ce81571a0 2023-06-10T18:54:03.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.976+0000 7f2ccffff640 1 -- 172.21.15.53:0/3239867748 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2cdc0039a0 con 0x7f2ce81571a0 2023-06-10T18:54:03.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.976+0000 7f2ccffff640 1 --2- 172.21.15.53:0/3239867748 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2cd40662d0 0x7f2cd4068780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:03.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.976+0000 7f2ccffff640 1 -- 172.21.15.53:0/3239867748 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2cdc083900 con 0x7f2ce81571a0 2023-06-10T18:54:03.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.980+0000 7f2ce77fe640 1 --2- 172.21.15.53:0/3239867748 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2cd40662d0 0x7f2cd4068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:03.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.980+0000 7f2cf0bb4000 1 Processor -- start 2023-06-10T18:54:03.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.980+0000 7f2cf0bb4000 1 -- start start 2023-06-10T18:54:03.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.980+0000 7f2ce77fe640 1 --2- 172.21.15.53:0/3239867748 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2cd40662d0 0x7f2cd4068780 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2cd80ae000 tx=0x7f2cd80a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:03.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.980+0000 7f2cf0bb4000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ec8c403740 0x55ec8c403b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:03.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.980+0000 7f2cf0bb4000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec8c404050 0x55ec8c3b9840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:03.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.980+0000 7f2cf0bb4000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ec8c3b9d80 0x55ec8c3ba150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:03.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.980+0000 7f2cf0bb4000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec8c281ac0 con 0x55ec8c404050 2023-06-10T18:54:03.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.980+0000 7f2cf0bb4000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec8c1bb840 con 0x55ec8c403740 2023-06-10T18:54:03.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.980+0000 7f2cf0bb4000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ec8c20f2e0 con 0x55ec8c3b9d80 2023-06-10T18:54:03.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.980+0000 7f2ce6ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec8c404050 0x55ec8c3b9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:03.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.980+0000 7f2ce6ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec8c404050 0x55ec8c3b9840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55738/0 (socket says 172.21.15.53:55738) 2023-06-10T18:54:03.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.980+0000 7f2ce6ffd640 1 -- 172.21.15.53:0/3009218512 learned_addr learned my addr 172.21.15.53:0/3009218512 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:54:03.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.980+0000 7f2ce77fe640 1 --2- 172.21.15.53:0/3009218512 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ec8c403740 0x55ec8c403b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:03.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.980+0000 7f2ce6ffd640 1 -- 172.21.15.53:0/3009218512 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ec8c3b9d80 msgr2=0x55ec8c3ba150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:54:03.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.980+0000 7f2ce7fff640 1 --2- 172.21.15.53:0/3009218512 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ec8c3b9d80 0x55ec8c3ba150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:03.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.980+0000 7f2ce6ffd640 1 --2- 172.21.15.53:0/3009218512 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ec8c3b9d80 0x55ec8c3ba150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:03.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.980+0000 7f2ce6ffd640 1 -- 172.21.15.53:0/3009218512 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ec8c403740 msgr2=0x55ec8c403b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:54:03.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.980+0000 7f2ce6ffd640 1 --2- 172.21.15.53:0/3009218512 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ec8c403740 0x55ec8c403b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:03.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.980+0000 7f2ce6ffd640 1 -- 172.21.15.53:0/3009218512 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ec8bf04890 con 0x55ec8c404050 2023-06-10T18:54:03.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.980+0000 7f2ce77fe640 1 --2- 172.21.15.53:0/3009218512 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ec8c403740 0x55ec8c403b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:54:03.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.980+0000 7f2ce6ffd640 1 --2- 172.21.15.53:0/3009218512 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec8c404050 0x55ec8c3b9840 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc05c9d0 tx=0x7f2cdc058b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bd833a58eeef954 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:03.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.980+0000 7f2ccd7fa640 1 -- 172.21.15.53:0/3009218512 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc003e50 con 0x55ec8c404050 2023-06-10T18:54:03.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.980+0000 7f2ccd7fa640 1 -- 172.21.15.53:0/3009218512 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cdc053010 con 0x55ec8c404050 2023-06-10T18:54:03.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.980+0000 7f2ccd7fa640 1 -- 172.21.15.53:0/3009218512 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc050ba0 con 0x55ec8c404050 2023-06-10T18:54:03.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.980+0000 7f2cf0bb4000 1 -- 172.21.15.53:0/3009218512 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec8c404050 msgr2=0x55ec8c3b9840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:03.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.980+0000 7f2cf0bb4000 1 --2- 172.21.15.53:0/3009218512 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec8c404050 0x55ec8c3b9840 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc05c9d0 tx=0x7f2cdc058b70 comp rx=0 tx=0).stop 2023-06-10T18:54:03.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.980+0000 7f2cf0bb4000 1 -- 172.21.15.53:0/3009218512 shutdown_connections 2023-06-10T18:54:03.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.980+0000 7f2cf0bb4000 1 --2- 172.21.15.53:0/3009218512 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ec8c3b9d80 0x55ec8c3ba150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:03.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.980+0000 7f2cf0bb4000 1 --2- 172.21.15.53:0/3009218512 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec8c404050 0x55ec8c3b9840 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:03.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.980+0000 7f2cf0bb4000 1 --2- 172.21.15.53:0/3009218512 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ec8c403740 0x55ec8c403b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:03.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.980+0000 7f2cf0bb4000 1 -- 172.21.15.53:0/3009218512 >> 172.21.15.53:0/3009218512 conn(0x55ec8c3b1800 msgr2=0x55ec8c3c0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:54:03.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.980+0000 7f2cf0bb4000 1 -- 172.21.15.53:0/3009218512 shutdown_connections 2023-06-10T18:54:03.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.980+0000 7f2cf0bb4000 1 -- 172.21.15.53:0/3009218512 wait complete. 2023-06-10T18:54:03.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.980+0000 7f2cf0bb4000 1 -- start start 2023-06-10T18:54:03.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.980+0000 7f2cf0bb4000 1 Processor -- start 2023-06-10T18:54:03.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.984+0000 7f2cf0bb4000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec8c3b9d80 0x55ec8c3bf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:03.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.984+0000 7f2cf0bb4000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ec8c403740 0x55ec8c3bf6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:03.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.984+0000 7f2cf0bb4000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ec8c404050 0x55ec8c3c50e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:03.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.984+0000 7f2cf0bb4000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec8c208380 con 0x55ec8c3b9d80 2023-06-10T18:54:03.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.984+0000 7f2cf0bb4000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec8c1c4ae0 con 0x55ec8c404050 2023-06-10T18:54:03.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.984+0000 7f2cf0bb4000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ec8c1c4780 con 0x55ec8c403740 2023-06-10T18:54:03.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.984+0000 7f2cf0bb4000 10 client.0 _ll_register_callbacks cb 0x55ec8c3a5e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-10T18:54:04.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.984+0000 7f2ce77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec8c3b9d80 0x55ec8c3bf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:04.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.984+0000 7f2ce77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec8c3b9d80 0x55ec8c3bf190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55744/0 (socket says 172.21.15.53:55744) 2023-06-10T18:54:04.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.984+0000 7f2ce77fe640 1 -- 172.21.15.53:0/2154699026 learned_addr learned my addr 172.21.15.53:0/2154699026 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:54:04.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.984+0000 7f2ce6ffd640 1 --2- 172.21.15.53:0/2154699026 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ec8c403740 0x55ec8c3bf6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:04.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.984+0000 7f2ce77fe640 1 -- 172.21.15.53:0/2154699026 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ec8c403740 msgr2=0x55ec8c3bf6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:54:04.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.984+0000 7f2ce77fe640 1 --2- 172.21.15.53:0/2154699026 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ec8c403740 0x55ec8c3bf6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:04.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.984+0000 7f2ce77fe640 1 -- 172.21.15.53:0/2154699026 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ec8c404050 msgr2=0x55ec8c3c50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:54:04.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.984+0000 7f2ce77fe640 1 --2- 172.21.15.53:0/2154699026 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ec8c404050 0x55ec8c3c50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:04.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.984+0000 7f2ce77fe640 1 -- 172.21.15.53:0/2154699026 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ce80c6d40 con 0x55ec8c3b9d80 2023-06-10T18:54:04.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.984+0000 7f2ce6ffd640 1 --2- 172.21.15.53:0/2154699026 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ec8c403740 0x55ec8c3bf6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:54:04.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.984+0000 7f2ce77fe640 1 --2- 172.21.15.53:0/2154699026 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec8c3b9d80 0x55ec8c3bf190 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f2cd801c970 tx=0x7f2cd801acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd789faf7e98cd5d server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:04.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.984+0000 7f2cc67fc640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-06-10T18:54:04.002 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.984+0000 7f2cc67fc640 1 -- 172.21.15.53:0/2154699026 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd8003d70 con 0x55ec8c3b9d80 2023-06-10T18:54:04.002 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.984+0000 7f2cc67fc640 1 -- 172.21.15.53:0/2154699026 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2cd80ba030 con 0x55ec8c3b9d80 2023-06-10T18:54:04.002 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.984+0000 7f2cf0bb4000 1 -- 172.21.15.53:0/2154699026 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ec8c1cfa20 con 0x55ec8c3b9d80 2023-06-10T18:54:04.002 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.984+0000 7f2cc67fc640 1 -- 172.21.15.53:0/2154699026 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2cd8003ed0 con 0x55ec8c3b9d80 2023-06-10T18:54:04.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.984+0000 7f2cf0bb4000 10 client.5553 fetch_fsmap learned FSMap version 13 2023-06-10T18:54:04.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.984+0000 7f2cf0bb4000 1 -- 172.21.15.53:0/2154699026 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) v3 -- 0x55ec8c1ccd10 con 0x55ec8c3b9d80 2023-06-10T18:54:04.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.984+0000 7f2cc67fc640 1 -- 172.21.15.53:0/2154699026 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ec8c1cfa20 con 0x55ec8c3b9d80 2023-06-10T18:54:04.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.984+0000 7f2cc67fc640 1 -- 172.21.15.53:0/2154699026 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 13) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f2cd80a9070 con 0x55ec8c3b9d80 2023-06-10T18:54:04.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.984+0000 7f2cf0bb4000 10 client.5553 fetch_fsmap finished waiting for FSMap version 13 2023-06-10T18:54:04.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.984+0000 7f2cf0bb4000 10 client.5553 resolve_mds: resolved name 'a' to daemon mds.a 2023-06-10T18:54:04.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.984+0000 7f2cf0bb4000 20 client.5553 populate_metadata read hostname 'smithi053' 2023-06-10T18:54:04.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.984+0000 7f2cf0bb4000 1 --2- 172.21.15.53:0/2154699026 >> [v2:172.21.15.53:6834/2596772129,v1:172.21.15.53:6835/2596772129] conn(0x55ec8c4127b0 0x55ec8c414b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:04.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.984+0000 7f2cf0bb4000 4 client.5553 mds_command: new command op to 5331 tid=0[{"prefix": "get_command_descriptions"}] 2023-06-10T18:54:04.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.984+0000 7f2cf0bb4000 1 -- 172.21.15.53:0/2154699026 --> [v2:172.21.15.53:6834/2596772129,v1:172.21.15.53:6835/2596772129] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ec8c237710 con 0x55ec8c4127b0 2023-06-10T18:54:04.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.984+0000 7f2ce6ffd640 1 --2- 172.21.15.53:0/2154699026 >> [v2:172.21.15.53:6834/2596772129,v1:172.21.15.53:6835/2596772129] conn(0x55ec8c4127b0 0x55ec8c414b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:04.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.984+0000 7f2ce6ffd640 1 --2- 172.21.15.53:0/2154699026 >> [v2:172.21.15.53:6834/2596772129,v1:172.21.15.53:6835/2596772129] conn(0x55ec8c4127b0 0x55ec8c414b90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a292378050ad3ef2 server_cookie=833e7586e6341e8b in_seq=0 out_seq=0 2023-06-10T18:54:04.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.984+0000 7f2cc67fc640 10 client.5553 ms_handle_connect on v2:172.21.15.53:6834/2596772129 2023-06-10T18:54:04.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.984+0000 7f2cc67fc640 1 -- 172.21.15.53:0/2154699026 <== mds.0 v2:172.21.15.53:6834/2596772129 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55ec8c237710 con 0x55ec8c4127b0 2023-06-10T18:54:04.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.984+0000 7f2cc67fc640 10 client.5553 handle_command_reply: tid=0 2023-06-10T18:54:04.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.984+0000 7f2cf0bb4000 1 client.5553 shutdown 2023-06-10T18:54:04.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.984+0000 7f2cf0bb4000 1 -- 172.21.15.53:0/2154699026 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec8c3b9d80 msgr2=0x55ec8c3bf190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:04.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.984+0000 7f2cf0bb4000 1 --2- 172.21.15.53:0/2154699026 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec8c3b9d80 0x55ec8c3bf190 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f2cd801c970 tx=0x7f2cd801acd0 comp rx=0 tx=0).stop 2023-06-10T18:54:04.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.984+0000 7f2cf0bb4000 1 -- 172.21.15.53:0/2154699026 shutdown_connections 2023-06-10T18:54:04.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.984+0000 7f2cf0bb4000 1 --2- 172.21.15.53:0/2154699026 >> [v2:172.21.15.53:6834/2596772129,v1:172.21.15.53:6835/2596772129] conn(0x55ec8c4127b0 0x55ec8c414b90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:04.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.984+0000 7f2cf0bb4000 1 --2- 172.21.15.53:0/2154699026 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ec8c404050 0x55ec8c3c50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:04.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.984+0000 7f2cc67fc640 0 client.5553 ms_handle_reset on v2:172.21.15.53:6834/2596772129 2023-06-10T18:54:04.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.984+0000 7f2cf0bb4000 1 --2- 172.21.15.53:0/2154699026 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ec8c403740 0x55ec8c3bf6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:04.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.984+0000 7f2cf0bb4000 1 --2- 172.21.15.53:0/2154699026 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec8c3b9d80 0x55ec8c3bf190 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:04.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.984+0000 7f2cf0bb4000 1 -- 172.21.15.53:0/2154699026 >> 172.21.15.53:0/2154699026 conn(0x55ec8c3b1800 msgr2=0x55ec8c3b8830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:54:04.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.984+0000 7f2cf0bb4000 1 -- 172.21.15.53:0/2154699026 shutdown_connections 2023-06-10T18:54:04.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.984+0000 7f2cf0bb4000 1 -- 172.21.15.53:0/2154699026 wait complete. 2023-06-10T18:54:04.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:03.984+0000 7f2cf0bb4000 20 client.5553 trim_cache size 0 max 16384 2023-06-10T18:54:04.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.000+0000 7f2cf0bb4000 1 Processor -- start 2023-06-10T18:54:04.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.000+0000 7f2cf0bb4000 1 -- start start 2023-06-10T18:54:04.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.000+0000 7f2cf0bb4000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec8c3b9d80 0x55ec8c3bed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:04.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.000+0000 7f2cf0bb4000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ec8c403740 0x55ec8c3bf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:04.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.000+0000 7f2cf0bb4000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ec8c404050 0x55ec8c41dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:04.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.000+0000 7f2cf0bb4000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec8bec5940 con 0x55ec8c3b9d80 2023-06-10T18:54:04.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.000+0000 7f2cf0bb4000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec8c2042f0 con 0x55ec8c403740 2023-06-10T18:54:04.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.000+0000 7f2cf0bb4000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ec8c210570 con 0x55ec8c404050 2023-06-10T18:54:04.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.000+0000 7f2ce77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec8c3b9d80 0x55ec8c3bed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:04.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.000+0000 7f2ce77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec8c3b9d80 0x55ec8c3bed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55760/0 (socket says 172.21.15.53:55760) 2023-06-10T18:54:04.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.000+0000 7f2ce77fe640 1 -- 172.21.15.53:0/992987281 learned_addr learned my addr 172.21.15.53:0/992987281 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:54:04.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.000+0000 7f2ce77fe640 1 -- 172.21.15.53:0/992987281 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ec8c404050 msgr2=0x55ec8c41dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:54:04.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.000+0000 7f2ce77fe640 1 --2- 172.21.15.53:0/992987281 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ec8c404050 0x55ec8c41dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:04.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.000+0000 7f2ce77fe640 1 -- 172.21.15.53:0/992987281 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ec8c403740 msgr2=0x55ec8c3bf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:54:04.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.000+0000 7f2ce77fe640 1 --2- 172.21.15.53:0/992987281 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ec8c403740 0x55ec8c3bf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:04.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.000+0000 7f2ce77fe640 1 -- 172.21.15.53:0/992987281 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ec8c3bc450 con 0x55ec8c3b9d80 2023-06-10T18:54:04.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.000+0000 7f2ce77fe640 1 --2- 172.21.15.53:0/992987281 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec8c3b9d80 0x55ec8c3bed60 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f2cd801ca00 tx=0x7f2cd80c0000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bffadd375dba2aa8 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:04.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.000+0000 7f2ccdffb640 1 -- 172.21.15.53:0/992987281 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd8005ba0 con 0x55ec8c3b9d80 2023-06-10T18:54:04.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.000+0000 7f2ccdffb640 1 -- 172.21.15.53:0/992987281 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cd8005d00 con 0x55ec8c3b9d80 2023-06-10T18:54:04.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.000+0000 7f2ccdffb640 1 -- 172.21.15.53:0/992987281 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd8003bf0 con 0x55ec8c3b9d80 2023-06-10T18:54:04.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.004+0000 7f2cf0bb4000 1 -- 172.21.15.53:0/992987281 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec8c3b9d80 msgr2=0x55ec8c3bed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:04.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.004+0000 7f2cf0bb4000 1 --2- 172.21.15.53:0/992987281 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec8c3b9d80 0x55ec8c3bed60 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f2cd801ca00 tx=0x7f2cd80c0000 comp rx=0 tx=0).stop 2023-06-10T18:54:04.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.004+0000 7f2cf0bb4000 1 -- 172.21.15.53:0/992987281 shutdown_connections 2023-06-10T18:54:04.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.004+0000 7f2cf0bb4000 1 --2- 172.21.15.53:0/992987281 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ec8c404050 0x55ec8c41dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:04.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.004+0000 7f2cf0bb4000 1 --2- 172.21.15.53:0/992987281 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ec8c403740 0x55ec8c3bf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:04.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.004+0000 7f2cf0bb4000 1 --2- 172.21.15.53:0/992987281 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec8c3b9d80 0x55ec8c3bed60 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:04.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.004+0000 7f2cf0bb4000 1 -- 172.21.15.53:0/992987281 >> 172.21.15.53:0/992987281 conn(0x55ec8c3b1800 msgr2=0x55ec8c3b8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:54:04.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.004+0000 7f2cf0bb4000 1 -- 172.21.15.53:0/992987281 shutdown_connections 2023-06-10T18:54:04.020 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.004+0000 7f2cf0bb4000 1 -- 172.21.15.53:0/992987281 wait complete. 2023-06-10T18:54:04.020 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.004+0000 7f2cf0bb4000 1 -- start start 2023-06-10T18:54:04.020 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.004+0000 7f2cf0bb4000 1 Processor -- start 2023-06-10T18:54:04.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.004+0000 7f2cf0bb4000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ec8c3b9d80 0x55ec8c4627b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:04.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.004+0000 7f2cf0bb4000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ec8c403740 0x55ec8c462cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:04.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.004+0000 7f2cf0bb4000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec8c404050 0x55ec8c463230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:04.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.004+0000 7f2cf0bb4000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec8c1a5a80 con 0x55ec8c404050 2023-06-10T18:54:04.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.004+0000 7f2cf0bb4000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec8c3c0a30 con 0x55ec8c403740 2023-06-10T18:54:04.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.004+0000 7f2cf0bb4000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ec8c1b0450 con 0x55ec8c3b9d80 2023-06-10T18:54:04.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.004+0000 7f2cf0bb4000 10 client.0 _ll_register_callbacks cb 0x55ec8c1cc7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-10T18:54:04.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.004+0000 7f2ce7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec8c404050 0x55ec8c463230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:04.022 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.004+0000 7f2ce7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec8c404050 0x55ec8c463230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55762/0 (socket says 172.21.15.53:55762) 2023-06-10T18:54:04.022 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.004+0000 7f2ce7fff640 1 -- 172.21.15.53:0/2375842212 learned_addr learned my addr 172.21.15.53:0/2375842212 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:54:04.022 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.004+0000 7f2ce77fe640 1 --2- 172.21.15.53:0/2375842212 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ec8c3b9d80 0x55ec8c4627b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:04.022 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.004+0000 7f2ce7fff640 1 -- 172.21.15.53:0/2375842212 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ec8c3b9d80 msgr2=0x55ec8c4627b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:54:04.022 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.004+0000 7f2ce7fff640 1 --2- 172.21.15.53:0/2375842212 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ec8c3b9d80 0x55ec8c4627b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:04.022 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.004+0000 7f2ce7fff640 1 -- 172.21.15.53:0/2375842212 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ec8c403740 msgr2=0x55ec8c462cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:54:04.022 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.004+0000 7f2ce7fff640 1 --2- 172.21.15.53:0/2375842212 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ec8c403740 0x55ec8c462cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:04.023 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.004+0000 7f2ce7fff640 1 -- 172.21.15.53:0/2375842212 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ec8c1ccd10 con 0x55ec8c404050 2023-06-10T18:54:04.023 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.004+0000 7f2ce7fff640 1 --2- 172.21.15.53:0/2375842212 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec8c404050 0x55ec8c463230 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f2ce000f1c0 tx=0x7f2ce000f680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=364f552fcb86eae2 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:04.023 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.004+0000 7f2cc67fc640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-06-10T18:54:04.023 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.004+0000 7f2cc67fc640 1 -- 172.21.15.53:0/2375842212 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce000d070 con 0x55ec8c404050 2023-06-10T18:54:04.023 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.004+0000 7f2cc67fc640 1 -- 172.21.15.53:0/2375842212 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2ce0014410 con 0x55ec8c404050 2023-06-10T18:54:04.023 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.004+0000 7f2cf0bb4000 1 -- 172.21.15.53:0/2375842212 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ec8c206cd0 con 0x55ec8c404050 2023-06-10T18:54:04.023 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.004+0000 7f2cc67fc640 1 -- 172.21.15.53:0/2375842212 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2ce00145d0 con 0x55ec8c404050 2023-06-10T18:54:04.024 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.004+0000 7f2cf0bb4000 10 client.5559 fetch_fsmap learned FSMap version 13 2023-06-10T18:54:04.024 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.004+0000 7f2cf0bb4000 1 -- 172.21.15.53:0/2375842212 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) v3 -- 0x55ec8c1b2fa0 con 0x55ec8c404050 2023-06-10T18:54:04.024 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.004+0000 7f2cc67fc640 1 -- 172.21.15.53:0/2375842212 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ec8c206cd0 con 0x55ec8c404050 2023-06-10T18:54:04.024 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.004+0000 7f2cc67fc640 1 -- 172.21.15.53:0/2375842212 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 13) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f2ce0014730 con 0x55ec8c404050 2023-06-10T18:54:04.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.004+0000 7f2cf0bb4000 10 client.5559 fetch_fsmap finished waiting for FSMap version 13 2023-06-10T18:54:04.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.004+0000 7f2cf0bb4000 10 client.5559 resolve_mds: resolved name 'a' to daemon mds.a 2023-06-10T18:54:04.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.004+0000 7f2cf0bb4000 20 client.5559 populate_metadata read hostname 'smithi053' 2023-06-10T18:54:04.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.004+0000 7f2cf0bb4000 1 --2- 172.21.15.53:0/2375842212 >> [v2:172.21.15.53:6834/2596772129,v1:172.21.15.53:6835/2596772129] conn(0x55ec8c46c070 0x55ec8c46e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:04.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.004+0000 7f2cf0bb4000 4 client.5559 mds_command: new command op to 5331 tid=0[{"prefix": "status"}] 2023-06-10T18:54:04.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.004+0000 7f2cf0bb4000 1 -- 172.21.15.53:0/2375842212 --> [v2:172.21.15.53:6834/2596772129,v1:172.21.15.53:6835/2596772129] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55ec8c201360 con 0x55ec8c46c070 2023-06-10T18:54:04.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.004+0000 7f2ce77fe640 1 --2- 172.21.15.53:0/2375842212 >> [v2:172.21.15.53:6834/2596772129,v1:172.21.15.53:6835/2596772129] conn(0x55ec8c46c070 0x55ec8c46e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:04.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.004+0000 7f2cc67fc640 10 client.5559 ms_handle_connect on v2:172.21.15.53:6834/2596772129 2023-06-10T18:54:04.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.004+0000 7f2ce77fe640 1 --2- 172.21.15.53:0/2375842212 >> [v2:172.21.15.53:6834/2596772129,v1:172.21.15.53:6835/2596772129] conn(0x55ec8c46c070 0x55ec8c46e450 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ee1a341c3c50cf1 server_cookie=dfbb86a1a21d46d0 in_seq=0 out_seq=0 2023-06-10T18:54:04.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.004+0000 7f2cc67fc640 1 -- 172.21.15.53:0/2375842212 <== mds.0 v2:172.21.15.53:6834/2596772129 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55ec8c201360 con 0x55ec8c46c070 2023-06-10T18:54:04.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.004+0000 7f2cc67fc640 10 client.5559 handle_command_reply: tid=0 2023-06-10T18:54:04.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.004+0000 7f2cf0bb4000 1 client.5559 shutdown 2023-06-10T18:54:04.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.008+0000 7f2cf0bb4000 1 -- 172.21.15.53:0/2375842212 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec8c404050 msgr2=0x55ec8c463230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:04.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.008+0000 7f2cf0bb4000 1 --2- 172.21.15.53:0/2375842212 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec8c404050 0x55ec8c463230 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f2ce000f1c0 tx=0x7f2ce000f680 comp rx=0 tx=0).stop 2023-06-10T18:54:04.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.008+0000 7f2cf0bb4000 1 -- 172.21.15.53:0/2375842212 shutdown_connections 2023-06-10T18:54:04.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.008+0000 7f2cf0bb4000 1 --2- 172.21.15.53:0/2375842212 >> [v2:172.21.15.53:6834/2596772129,v1:172.21.15.53:6835/2596772129] conn(0x55ec8c46c070 0x55ec8c46e450 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:04.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.008+0000 7f2cf0bb4000 1 --2- 172.21.15.53:0/2375842212 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec8c404050 0x55ec8c463230 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:04.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.008+0000 7f2cf0bb4000 1 --2- 172.21.15.53:0/2375842212 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ec8c403740 0x55ec8c462cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:04.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.008+0000 7f2cf0bb4000 1 --2- 172.21.15.53:0/2375842212 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ec8c3b9d80 0x55ec8c4627b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:04.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.008+0000 7f2cc67fc640 0 client.5559 ms_handle_reset on v2:172.21.15.53:6834/2596772129 2023-06-10T18:54:04.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.008+0000 7f2cf0bb4000 1 -- 172.21.15.53:0/2375842212 >> 172.21.15.53:0/2375842212 conn(0x55ec8c3b1800 msgr2=0x55ec8c3be5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:54:04.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.008+0000 7f2cf0bb4000 1 -- 172.21.15.53:0/2375842212 shutdown_connections 2023-06-10T18:54:04.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.008+0000 7f2cf0bb4000 1 -- 172.21.15.53:0/2375842212 wait complete. 2023-06-10T18:54:04.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.008+0000 7f2cf0bb4000 20 client.5559 trim_cache size 0 max 16384 2023-06-10T18:54:04.029 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-06-10T18:54:04.030 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_fsid": "c8c64bed-c406-4936-93f9-d16335f1067d", 2023-06-10T18:54:04.030 INFO:teuthology.orchestra.run.smithi053.stdout: "whoami": 0, 2023-06-10T18:54:04.030 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 5331, 2023-06-10T18:54:04.030 INFO:teuthology.orchestra.run.smithi053.stdout: "want_state": "up:active", 2023-06-10T18:54:04.030 INFO:teuthology.orchestra.run.smithi053.stdout: "state": "up:active", 2023-06-10T18:54:04.030 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs", 2023-06-10T18:54:04.030 INFO:teuthology.orchestra.run.smithi053.stdout: "rank_uptime": 9.2717669009999995, 2023-06-10T18:54:04.031 INFO:teuthology.orchestra.run.smithi053.stdout: "mdsmap_epoch": 13, 2023-06-10T18:54:04.031 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch": 37, 2023-06-10T18:54:04.031 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch_barrier": 37, 2023-06-10T18:54:04.031 INFO:teuthology.orchestra.run.smithi053.stdout: "uptime": 16.569569680000001 2023-06-10T18:54:04.031 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-06-10T18:54:04.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.008+0000 7f2ceda98640 1 -- 172.21.15.53:0/3239867748 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2cd40662d0 msgr2=0x7f2cd4068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:04.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.008+0000 7f2ceda98640 1 --2- 172.21.15.53:0/3239867748 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2cd40662d0 0x7f2cd4068780 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2cd80ae000 tx=0x7f2cd80a7000 comp rx=0 tx=0).stop 2023-06-10T18:54:04.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.008+0000 7f2ceda98640 1 -- 172.21.15.53:0/3239867748 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2ce81571a0 msgr2=0x7f2ce814d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:04.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.008+0000 7f2ceda98640 1 --2- 172.21.15.53:0/3239867748 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2ce81571a0 0x7f2ce814d4f0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc00c7f0 tx=0x7f2cdc00ccb0 comp rx=0 tx=0).stop 2023-06-10T18:54:04.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.008+0000 7f2ceda98640 1 -- 172.21.15.53:0/3239867748 shutdown_connections 2023-06-10T18:54:04.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.008+0000 7f2ceda98640 1 --2- 172.21.15.53:0/3239867748 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2cd40662d0 0x7f2cd4068780 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:04.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.008+0000 7f2ceda98640 1 --2- 172.21.15.53:0/3239867748 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ce80c68a0 0x7f2ce8158500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:04.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.008+0000 7f2ceda98640 1 --2- 172.21.15.53:0/3239867748 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2ce81571a0 0x7f2ce814d4f0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:04.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.008+0000 7f2ceda98640 1 --2- 172.21.15.53:0/3239867748 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ce80afd10 0x7f2ce80c7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:04.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.008+0000 7f2ceda98640 1 -- 172.21.15.53:0/3239867748 >> 172.21.15.53:0/3239867748 conn(0x7f2ce80ce9e0 msgr2=0x7f2ce815cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:54:04.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.008+0000 7f2ceda98640 1 -- 172.21.15.53:0/3239867748 shutdown_connections 2023-06-10T18:54:04.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.008+0000 7f2ceda98640 1 -- 172.21.15.53:0/3239867748 wait complete. 2023-06-10T18:54:04.034 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-10T18:54:04.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.140+0000 7fdb7f538640 1 Processor -- start 2023-06-10T18:54:04.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.140+0000 7fdb7f538640 1 -- start start 2023-06-10T18:54:04.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.140+0000 7fdb7f538640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fdb780b3ac0 0x7fdb780b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:04.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.140+0000 7fdb7f538640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb780d0020 con 0x7fdb780d14c0 2023-06-10T18:54:04.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.140+0000 7fdb7f538640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb78160190 con 0x7fdb780cc690 2023-06-10T18:54:04.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.140+0000 7fdb7f538640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb780b43d0 con 0x7fdb780b3ac0 2023-06-10T18:54:04.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.140+0000 7fdb7d2d4640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fdb780b3ac0 0x7fdb780b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:04.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.140+0000 7fdb7dad5640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fdb780d14c0 0x7fdb7815fa80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41020/0 (socket says 172.21.15.53:41020) 2023-06-10T18:54:04.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.140+0000 7fdb7dad5640 1 -- 172.21.15.53:0/3229216580 learned_addr learned my addr 172.21.15.53:0/3229216580 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:54:04.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.140+0000 7fdb6ffff640 1 -- 172.21.15.53:0/3229216580 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1962861519 0 0) 0x7fdb780d0020 con 0x7fdb780d14c0 2023-06-10T18:54:04.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.140+0000 7fdb6ffff640 1 -- 172.21.15.53:0/3229216580 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb60003530 con 0x7fdb780d14c0 2023-06-10T18:54:04.150 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.140+0000 7fdb7d2d4640 1 -- 172.21.15.53:0/3229216580 >> v1:172.21.15.117:6789/0 conn(0x7fdb780cc690 legacy=0x7fdb7815f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:54:04.150 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.140+0000 7fdb7d2d4640 1 -- 172.21.15.53:0/3229216580 >> v1:172.21.15.53:6789/0 conn(0x7fdb780d14c0 legacy=0x7fdb7815fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:04.150 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.140+0000 7fdb7d2d4640 1 -- 172.21.15.53:0/3229216580 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb780cef40 con 0x7fdb780b3ac0 2023-06-10T18:54:04.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.140+0000 7fdb7d2d4640 1 --2- 172.21.15.53:0/3229216580 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb780b3ac0 0x7fdb780b3e90 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fdb700097c0 tx=0x7fdb7001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef5bab7999428547 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:04.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.140+0000 7fdb6ffff640 1 -- 172.21.15.53:0/3229216580 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb700a7070 con 0x7fdb780b3ac0 2023-06-10T18:54:04.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.144+0000 7fdb6ffff640 1 -- 172.21.15.53:0/3229216580 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb700ab430 con 0x7fdb780b3ac0 2023-06-10T18:54:04.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.144+0000 7fdb6ffff640 1 -- 172.21.15.53:0/3229216580 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb700ab7c0 con 0x7fdb780b3ac0 2023-06-10T18:54:04.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.144+0000 7fdb7f538640 1 -- 172.21.15.53:0/3229216580 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb780b3ac0 msgr2=0x7fdb780b3e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:04.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.144+0000 7fdb7f538640 1 --2- 172.21.15.53:0/3229216580 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb780b3ac0 0x7fdb780b3e90 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fdb700097c0 tx=0x7fdb7001c410 comp rx=0 tx=0).stop 2023-06-10T18:54:04.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.144+0000 7fdb7f538640 1 -- 172.21.15.53:0/3229216580 shutdown_connections 2023-06-10T18:54:04.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.144+0000 7fdb7f538640 1 --2- 172.21.15.53:0/3229216580 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb780b3ac0 0x7fdb780b3e90 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:04.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.144+0000 7fdb7f538640 1 -- 172.21.15.53:0/3229216580 >> 172.21.15.53:0/3229216580 conn(0x7fdb78071790 msgr2=0x7fdb78069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:54:04.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.144+0000 7fdb7f538640 1 -- 172.21.15.53:0/3229216580 shutdown_connections 2023-06-10T18:54:04.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.144+0000 7fdb7f538640 1 -- 172.21.15.53:0/3229216580 wait complete. 2023-06-10T18:54:04.154 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.144+0000 7fdb7f538640 1 Processor -- start 2023-06-10T18:54:04.154 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.144+0000 7fdb7f538640 1 -- start start 2023-06-10T18:54:04.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.144+0000 7fdb7f538640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb780b3ac0 0x7fdb7815be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:04.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.144+0000 7fdb7f538640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb780cc690 0x7fdb7815b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:04.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.144+0000 7fdb7f538640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb780d14c0 0x7fdb78156c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:04.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.144+0000 7fdb7f538640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7815c700 con 0x7fdb780b3ac0 2023-06-10T18:54:04.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.144+0000 7fdb7f538640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7815c9e0 con 0x7fdb780cc690 2023-06-10T18:54:04.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.144+0000 7fdb7f538640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7815ccc0 con 0x7fdb780d14c0 2023-06-10T18:54:04.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.144+0000 7fdb7d2d4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb780b3ac0 0x7fdb7815be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:04.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.144+0000 7fdb7d2d4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb780b3ac0 0x7fdb7815be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55782/0 (socket says 172.21.15.53:55782) 2023-06-10T18:54:04.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.144+0000 7fdb7d2d4640 1 -- 172.21.15.53:0/1744594398 learned_addr learned my addr 172.21.15.53:0/1744594398 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:54:04.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.144+0000 7fdb7dad5640 1 --2- 172.21.15.53:0/1744594398 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb780d14c0 0x7fdb78156c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:04.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.144+0000 7fdb7cad3640 1 --2- 172.21.15.53:0/1744594398 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb780cc690 0x7fdb7815b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:04.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.144+0000 7fdb7d2d4640 1 -- 172.21.15.53:0/1744594398 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb780d14c0 msgr2=0x7fdb78156c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:04.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.144+0000 7fdb7d2d4640 1 --2- 172.21.15.53:0/1744594398 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb780d14c0 0x7fdb78156c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:04.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.144+0000 7fdb7d2d4640 1 -- 172.21.15.53:0/1744594398 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb780cc690 msgr2=0x7fdb7815b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:04.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.144+0000 7fdb7d2d4640 1 --2- 172.21.15.53:0/1744594398 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb780cc690 0x7fdb7815b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:04.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.144+0000 7fdb7d2d4640 1 -- 172.21.15.53:0/1744594398 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb70009420 con 0x7fdb780b3ac0 2023-06-10T18:54:04.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.144+0000 7fdb7dad5640 1 --2- 172.21.15.53:0/1744594398 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb780d14c0 0x7fdb78156c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:54:04.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.144+0000 7fdb7d2d4640 1 --2- 172.21.15.53:0/1744594398 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb780b3ac0 0x7fdb7815be00 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fdb700ad040 tx=0x7fdb7001ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:04.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.144+0000 7fdb6dffb640 1 -- 172.21.15.53:0/1744594398 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb700b5810 con 0x7fdb780b3ac0 2023-06-10T18:54:04.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.144+0000 7fdb6dffb640 1 -- 172.21.15.53:0/1744594398 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb700b5970 con 0x7fdb780b3ac0 2023-06-10T18:54:04.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.144+0000 7fdb7f538640 1 -- 172.21.15.53:0/1744594398 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb7815cfa0 con 0x7fdb780b3ac0 2023-06-10T18:54:04.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.144+0000 7fdb6dffb640 1 -- 172.21.15.53:0/1744594398 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb700b5d00 con 0x7fdb780b3ac0 2023-06-10T18:54:04.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.144+0000 7fdb7f538640 1 -- 172.21.15.53:0/1744594398 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb7815d530 con 0x7fdb780b3ac0 2023-06-10T18:54:04.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.148+0000 7fdb7f538640 1 -- 172.21.15.53:0/1744594398 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb7804d790 con 0x7fdb780b3ac0 2023-06-10T18:54:04.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.148+0000 7fdb6dffb640 1 -- 172.21.15.53:0/1744594398 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdb700bf410 con 0x7fdb780b3ac0 2023-06-10T18:54:04.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.148+0000 7fdb6dffb640 1 --2- 172.21.15.53:0/1744594398 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdb64066280 0x7fdb64068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:04.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.148+0000 7fdb6dffb640 1 -- 172.21.15.53:0/1744594398 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdb7011e6f0 con 0x7fdb780b3ac0 2023-06-10T18:54:04.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.148+0000 7fdb7cad3640 1 --2- 172.21.15.53:0/1744594398 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdb64066280 0x7fdb64068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:04.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.148+0000 7fdb7cad3640 1 --2- 172.21.15.53:0/1744594398 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdb64066280 0x7fdb64068730 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fdb780b5bd0 tx=0x7fdb74009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:04.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.152+0000 7fdb6dffb640 1 -- 172.21.15.53:0/1744594398 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdb700ebb80 con 0x7fdb780b3ac0 2023-06-10T18:54:04.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.340+0000 7fdb7f538640 1 -- 172.21.15.53:0/1744594398 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fdb7808a200 con 0x7fdb780b3ac0 2023-06-10T18:54:04.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.340+0000 7fdb6dffb640 1 -- 172.21.15.53:0/1744594398 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v13) v1 ==== 53+0+73 (secure 0 0 0) 0x7fdb700b5e60 con 0x7fdb780b3ac0 2023-06-10T18:54:04.351 INFO:teuthology.orchestra.run.smithi053.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-06-10T18:54:04.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.344+0000 7fdb7f538640 1 -- 172.21.15.53:0/1744594398 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdb64066280 msgr2=0x7fdb64068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:04.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.344+0000 7fdb7f538640 1 --2- 172.21.15.53:0/1744594398 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdb64066280 0x7fdb64068730 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fdb780b5bd0 tx=0x7fdb74009040 comp rx=0 tx=0).stop 2023-06-10T18:54:04.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.344+0000 7fdb7f538640 1 -- 172.21.15.53:0/1744594398 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb780b3ac0 msgr2=0x7fdb7815be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:04.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.344+0000 7fdb7f538640 1 --2- 172.21.15.53:0/1744594398 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb780b3ac0 0x7fdb7815be00 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fdb700ad040 tx=0x7fdb7001ac50 comp rx=0 tx=0).stop 2023-06-10T18:54:04.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.344+0000 7fdb7f538640 1 -- 172.21.15.53:0/1744594398 shutdown_connections 2023-06-10T18:54:04.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.344+0000 7fdb7f538640 1 --2- 172.21.15.53:0/1744594398 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdb64066280 0x7fdb64068730 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:04.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.344+0000 7fdb7f538640 1 --2- 172.21.15.53:0/1744594398 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb780d14c0 0x7fdb78156c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:04.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.344+0000 7fdb7f538640 1 --2- 172.21.15.53:0/1744594398 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb780cc690 0x7fdb7815b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:04.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.344+0000 7fdb7f538640 1 --2- 172.21.15.53:0/1744594398 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb780b3ac0 0x7fdb7815be00 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:04.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.344+0000 7fdb7f538640 1 -- 172.21.15.53:0/1744594398 >> 172.21.15.53:0/1744594398 conn(0x7fdb78071790 msgr2=0x7fdb780b2d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:54:04.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.344+0000 7fdb7f538640 1 -- 172.21.15.53:0/1744594398 shutdown_connections 2023-06-10T18:54:04.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:04.344+0000 7fdb7f538640 1 -- 172.21.15.53:0/1744594398 wait complete. 2023-06-10T18:54:04.370 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-10T18:54:04.370 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-10T18:54:04.371 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi053.front.sepia.ceph.com 2023-06-10T18:54:04.371 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-06-10T18:54:04.371 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-06-10T18:54:04.372 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-10T18:54:04.372 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-10T18:54:04.372 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-10T18:54:04.373 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-06-10T18:54:04.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:54:04.373 DEBUG:teuthology.orchestra.run.smithi053:> ip addr 2023-06-10T18:54:04.378 INFO:teuthology.orchestra.run.smithi053.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-10T18:54:04.379 INFO:teuthology.orchestra.run.smithi053.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-10T18:54:04.379 INFO:teuthology.orchestra.run.smithi053.stdout: inet 127.0.0.1/8 scope host lo 2023-06-10T18:54:04.379 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:54:04.379 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 ::1/128 scope host 2023-06-10T18:54:04.380 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:54:04.380 INFO:teuthology.orchestra.run.smithi053.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T18:54:04.380 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:da brd ff:ff:ff:ff:ff:ff 2023-06-10T18:54:04.380 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f0 2023-06-10T18:54:04.380 INFO:teuthology.orchestra.run.smithi053.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T18:54:04.381 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:db brd ff:ff:ff:ff:ff:ff 2023-06-10T18:54:04.381 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f1 2023-06-10T18:54:04.381 INFO:teuthology.orchestra.run.smithi053.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-10T18:54:04.381 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:18 brd ff:ff:ff:ff:ff:ff 2023-06-10T18:54:04.381 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f0 2023-06-10T18:54:04.381 INFO:teuthology.orchestra.run.smithi053.stdout: inet 172.21.15.53/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-06-10T18:54:04.381 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft 42405sec preferred_lft 42405sec 2023-06-10T18:54:04.381 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::ae1f:6bff:fef8:3718/64 scope link 2023-06-10T18:54:04.382 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:54:04.382 INFO:teuthology.orchestra.run.smithi053.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T18:54:04.382 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:19 brd ff:ff:ff:ff:ff:ff 2023-06-10T18:54:04.382 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f1 2023-06-10T18:54:04.382 INFO:teuthology.orchestra.run.smithi053.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-06-10T18:54:04.382 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 02:42:49:3d:ee:1e brd ff:ff:ff:ff:ff:ff 2023-06-10T18:54:04.382 INFO:teuthology.orchestra.run.smithi053.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-06-10T18:54:04.383 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:54:04.383 INFO:teuthology.orchestra.run.smithi053.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-10T18:54:04.383 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-06-10T18:54:04.383 INFO:teuthology.orchestra.run.smithi053.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-06-10T18:54:04.383 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:54:04.384 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-06-10T18:54:04.384 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:54:04.384 INFO:teuthology.orchestra.run.smithi053.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-10T18:54:04.384 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-06-10T18:54:04.384 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-06-10T18:54:04.384 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:54:04.384 INFO:teuthology.orchestra.run.smithi053.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-10T18:54:04.385 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-06-10T18:54:04.385 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-06-10T18:54:04.385 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:54:04.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:54:04.385 DEBUG:teuthology.orchestra.run.smithi053:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-10T18:54:04.433 INFO:teuthology.orchestra.run.smithi053.stdout:1 2023-06-10T18:54:04.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:54:04.434 DEBUG:teuthology.orchestra.run.smithi053:> route 2023-06-10T18:54:04.480 INFO:teuthology.orchestra.run.smithi053.stdout:Kernel IP routing table 2023-06-10T18:54:04.481 INFO:teuthology.orchestra.run.smithi053.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-10T18:54:04.481 INFO:teuthology.orchestra.run.smithi053.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-06-10T18:54:04.481 INFO:teuthology.orchestra.run.smithi053.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-06-10T18:54:04.481 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-06-10T18:54:04.481 INFO:teuthology.orchestra.run.smithi053.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-10T18:54:04.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:54:04.482 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec bash -c ' 2023-06-10T18:54:04.482 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2023-06-10T18:54:04.483 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-06-10T18:54:04.483 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-06-10T18:54:04.483 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-06-10T18:54:04.483 DEBUG:teuthology.orchestra.run.smithi053:> ') 2023-06-10T18:54:04.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:54:04.559 DEBUG:teuthology.orchestra.run.smithi053:> ip netns list 2023-06-10T18:54:04.608 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-06-10T18:54:04.608 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-06-10T18:54:04.608 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-06-10T18:54:04.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:54:04.609 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link set brx.0 up 2023-06-10T18:54:04.668 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-06-10T18:54:04.669 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-10T18:54:04.669 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-06-10T18:54:04.716 INFO:teuthology.orchestra.run.smithi053.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-06-10T18:54:04.717 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-10T18:54:04.717 DEBUG:teuthology.orchestra.run.smithi053:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-06-10T18:54:04.767 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2023-06-10T18:54:04.825 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T18:54:04.825 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T18:54:04.883 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T18:54:04.884 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T18:54:04.885 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:54:04.886 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2023-06-10T18:54:04.931 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-06-10T18:54:04.932 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-06-10T18:54:04.976 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2023-06-10T18:54:04.991 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T18:54:04.991 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T18:54:05.045 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T18:54:05.046 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T18:54:05.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:54:05.047 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2023-06-10T18:54:05.060 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:2023-06-10T18:54:05.052+0000 7f3c3488e580 -1 init, newargv = 0x56221dbc6f80 newargc=15 2023-06-10T18:54:05.060 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[47887]: starting ceph client 2023-06-10T18:54:05.067 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[47887]: starting fuse 2023-06-10T18:54:06.017 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-10T18:54:06.020 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-10T18:54:06.166 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2023-06-10T18:54:06.182 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T18:54:06.183 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T18:54:06.235 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T18:54:06.237 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T18:54:06.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:54:06.238 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2023-06-10T18:54:06.288 INFO:teuthology.orchestra.run.smithi053.stdout:45 2023-06-10T18:54:06.288 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-06-10T18:54:06.288 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-06-10T18:54:06.289 DEBUG:teuthology.orchestra.run.smithi053:> import glob 2023-06-10T18:54:06.289 DEBUG:teuthology.orchestra.run.smithi053:> import re 2023-06-10T18:54:06.289 DEBUG:teuthology.orchestra.run.smithi053:> import os 2023-06-10T18:54:06.290 DEBUG:teuthology.orchestra.run.smithi053:> import subprocess 2023-06-10T18:54:06.290 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T18:54:06.290 DEBUG:teuthology.orchestra.run.smithi053:> def _find_admin_socket(client_name): 2023-06-10T18:54:06.291 DEBUG:teuthology.orchestra.run.smithi053:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-06-10T18:54:06.291 DEBUG:teuthology.orchestra.run.smithi053:> files = glob.glob(asok_path) 2023-06-10T18:54:06.291 DEBUG:teuthology.orchestra.run.smithi053:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-06-10T18:54:06.291 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T18:54:06.292 DEBUG:teuthology.orchestra.run.smithi053:> # Given a non-glob path, it better be there 2023-06-10T18:54:06.292 DEBUG:teuthology.orchestra.run.smithi053:> if "*" not in asok_path: 2023-06-10T18:54:06.292 DEBUG:teuthology.orchestra.run.smithi053:> assert(len(files) == 1) 2023-06-10T18:54:06.293 DEBUG:teuthology.orchestra.run.smithi053:> return files[0] 2023-06-10T18:54:06.293 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T18:54:06.293 DEBUG:teuthology.orchestra.run.smithi053:> for f in files: 2023-06-10T18:54:06.294 DEBUG:teuthology.orchestra.run.smithi053:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-06-10T18:54:06.294 DEBUG:teuthology.orchestra.run.smithi053:> if os.path.exists("/proc/{0}".format(pid)): 2023-06-10T18:54:06.294 DEBUG:teuthology.orchestra.run.smithi053:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-06-10T18:54:06.294 DEBUG:teuthology.orchestra.run.smithi053:> contents = proc_f.read() 2023-06-10T18:54:06.295 DEBUG:teuthology.orchestra.run.smithi053:> if mountpoint in contents: 2023-06-10T18:54:06.295 DEBUG:teuthology.orchestra.run.smithi053:> return f 2023-06-10T18:54:06.295 DEBUG:teuthology.orchestra.run.smithi053:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-06-10T18:54:06.296 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T18:54:06.296 DEBUG:teuthology.orchestra.run.smithi053:> print(_find_admin_socket("client.0")) 2023-06-10T18:54:06.296 DEBUG:teuthology.orchestra.run.smithi053:> ' 2023-06-10T18:54:06.412 INFO:teuthology.orchestra.run.smithi053.stdout:/var/run/ceph/ceph-client.0.47887.asok 2023-06-10T18:54:06.593 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.47887.asok 2023-06-10T18:54:06.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:54:06.594 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.47887.asok status 2023-06-10T18:54:06.753 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-06-10T18:54:06.753 INFO:teuthology.orchestra.run.smithi053.stdout: "metadata": { 2023-06-10T18:54:06.753 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_sha1": "219d315c3a0b2075e570fb1964be2ad33fe7a9c8", 2023-06-10T18:54:06.753 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_version": "ceph version 18.0.0-4359-g219d315c (219d315c3a0b2075e570fb1964be2ad33fe7a9c8) reef (dev)", 2023-06-10T18:54:06.754 INFO:teuthology.orchestra.run.smithi053.stdout: "entity_id": "0", 2023-06-10T18:54:06.754 INFO:teuthology.orchestra.run.smithi053.stdout: "hostname": "smithi053", 2023-06-10T18:54:06.754 INFO:teuthology.orchestra.run.smithi053.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-06-10T18:54:06.754 INFO:teuthology.orchestra.run.smithi053.stdout: "pid": "47887", 2023-06-10T18:54:06.754 INFO:teuthology.orchestra.run.smithi053.stdout: "root": "/" 2023-06-10T18:54:06.754 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:54:06.754 INFO:teuthology.orchestra.run.smithi053.stdout: "dentry_count": 0, 2023-06-10T18:54:06.755 INFO:teuthology.orchestra.run.smithi053.stdout: "dentry_pinned_count": 0, 2023-06-10T18:54:06.755 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 5574, 2023-06-10T18:54:06.755 INFO:teuthology.orchestra.run.smithi053.stdout: "inst": { 2023-06-10T18:54:06.755 INFO:teuthology.orchestra.run.smithi053.stdout: "name": { 2023-06-10T18:54:06.755 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "client", 2023-06-10T18:54:06.755 INFO:teuthology.orchestra.run.smithi053.stdout: "num": 5574 2023-06-10T18:54:06.755 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:54:06.755 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": { 2023-06-10T18:54:06.756 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2023-06-10T18:54:06.756 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "192.168.0.1:0", 2023-06-10T18:54:06.756 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 1863321557 2023-06-10T18:54:06.756 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:54:06.756 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:54:06.756 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": { 2023-06-10T18:54:06.756 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2023-06-10T18:54:06.756 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "192.168.0.1:0", 2023-06-10T18:54:06.757 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 1863321557 2023-06-10T18:54:06.757 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:54:06.757 INFO:teuthology.orchestra.run.smithi053.stdout: "inst_str": "client.5574 192.168.0.1:0/1863321557", 2023-06-10T18:54:06.757 INFO:teuthology.orchestra.run.smithi053.stdout: "addr_str": "192.168.0.1:0/1863321557", 2023-06-10T18:54:06.757 INFO:teuthology.orchestra.run.smithi053.stdout: "inode_count": 1, 2023-06-10T18:54:06.757 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_epoch": 13, 2023-06-10T18:54:06.757 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_epoch": 37, 2023-06-10T18:54:06.757 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_epoch_barrier": 0, 2023-06-10T18:54:06.758 INFO:teuthology.orchestra.run.smithi053.stdout: "blocklisted": false, 2023-06-10T18:54:06.758 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs" 2023-06-10T18:54:06.758 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-06-10T18:54:06.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:54:06.767 DEBUG:teuthology.orchestra.run.smithi053:> stat --file-system '--printf=%T 2023-06-10T18:54:06.767 DEBUG:teuthology.orchestra.run.smithi053:> ' -- /home/ubuntu/cephtest/mnt.0 2023-06-10T18:54:06.773 INFO:teuthology.orchestra.run.smithi053.stdout:fuseblk 2023-06-10T18:54:06.773 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-06-10T18:54:06.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:54:06.774 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-06-10T18:54:06.828 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-10T18:54:06.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:06.988+0000 7f5e7262d640 1 Processor -- start 2023-06-10T18:54:06.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:06.988+0000 7f5e7262d640 1 -- start start 2023-06-10T18:54:07.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:06.992+0000 7f5e7262d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5e6c0ccae0 0x7f5e6c0d0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:07.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:06.992+0000 7f5e7262d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e6c0d0020 con 0x7f5e6c0b3ac0 2023-06-10T18:54:07.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:06.992+0000 7f5e7262d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e6c0cef40 con 0x7f5e6c0cc690 2023-06-10T18:54:07.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:06.992+0000 7f5e7262d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e6c0cf220 con 0x7f5e6c0ccae0 2023-06-10T18:54:07.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:06.992+0000 7f5e6bfff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f5e6c0b3ac0 0x7f5e6c0b3e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41024/0 (socket says 172.21.15.53:41024) 2023-06-10T18:54:07.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:06.992+0000 7f5e6bfff640 1 -- 172.21.15.53:0/663448370 learned_addr learned my addr 172.21.15.53:0/663448370 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:54:07.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:06.992+0000 7f5e70bca640 1 --2- 172.21.15.53:0/663448370 >> v2:172.21.15.53:3300/0 conn(0x7f5e6c0ccae0 0x7f5e6c0d0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:07.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:06.992+0000 7f5e6affd640 1 -- 172.21.15.53:0/663448370 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3341618265 0 0) 0x7f5e6c0d0020 con 0x7f5e6c0b3ac0 2023-06-10T18:54:07.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:06.992+0000 7f5e6affd640 1 -- 172.21.15.53:0/663448370 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e58003530 con 0x7f5e6c0b3ac0 2023-06-10T18:54:07.002 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:06.992+0000 7f5e70bca640 1 -- 172.21.15.53:0/663448370 >> v1:172.21.15.117:6789/0 conn(0x7f5e6c0cc690 legacy=0x7f5e6c0d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:54:07.002 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:06.992+0000 7f5e70bca640 1 -- 172.21.15.53:0/663448370 >> v1:172.21.15.53:6789/0 conn(0x7f5e6c0b3ac0 legacy=0x7f5e6c0b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:07.002 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:06.992+0000 7f5e70bca640 1 -- 172.21.15.53:0/663448370 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e6c0cf500 con 0x7f5e6c0ccae0 2023-06-10T18:54:07.002 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:06.992+0000 7f5e70bca640 1 --2- 172.21.15.53:0/663448370 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e6c0ccae0 0x7f5e6c0d0bc0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f5e64009d90 tx=0x7f5e6401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=695f9d4ae3228d03 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:07.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:06.992+0000 7f5e6affd640 1 -- 172.21.15.53:0/663448370 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e640a59c0 con 0x7f5e6c0ccae0 2023-06-10T18:54:07.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:06.992+0000 7f5e6affd640 1 -- 172.21.15.53:0/663448370 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e640a5b20 con 0x7f5e6c0ccae0 2023-06-10T18:54:07.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:06.992+0000 7f5e6affd640 1 -- 172.21.15.53:0/663448370 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e640ad440 con 0x7f5e6c0ccae0 2023-06-10T18:54:07.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:06.996+0000 7f5e7262d640 1 -- 172.21.15.53:0/663448370 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e6c0ccae0 msgr2=0x7f5e6c0d0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:07.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:06.996+0000 7f5e7262d640 1 --2- 172.21.15.53:0/663448370 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e6c0ccae0 0x7f5e6c0d0bc0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f5e64009d90 tx=0x7f5e6401c8e0 comp rx=0 tx=0).stop 2023-06-10T18:54:07.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:06.996+0000 7f5e7262d640 1 -- 172.21.15.53:0/663448370 shutdown_connections 2023-06-10T18:54:07.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:06.996+0000 7f5e7262d640 1 --2- 172.21.15.53:0/663448370 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e6c0ccae0 0x7f5e6c0d0bc0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:07.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:06.996+0000 7f5e7262d640 1 -- 172.21.15.53:0/663448370 >> 172.21.15.53:0/663448370 conn(0x7f5e6c071790 msgr2=0x7f5e6c069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:54:07.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:06.996+0000 7f5e7262d640 1 -- 172.21.15.53:0/663448370 shutdown_connections 2023-06-10T18:54:07.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:06.996+0000 7f5e7262d640 1 -- 172.21.15.53:0/663448370 wait complete. 2023-06-10T18:54:07.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:06.996+0000 7f5e7262d640 1 Processor -- start 2023-06-10T18:54:07.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:06.996+0000 7f5e7262d640 1 -- start start 2023-06-10T18:54:07.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:06.996+0000 7f5e7262d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e6c0b3ac0 0x7f5e6c14d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:07.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:06.996+0000 7f5e7262d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e6c0cc690 0x7f5e6c151970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:07.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:06.996+0000 7f5e7262d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e6c0ccae0 0x7f5e6c151eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:07.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:06.996+0000 7f5e7262d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6c1543a0 con 0x7f5e6c0b3ac0 2023-06-10T18:54:07.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:06.996+0000 7f5e7262d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6c153720 con 0x7f5e6c0ccae0 2023-06-10T18:54:07.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:06.996+0000 7f5e7262d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6c153a00 con 0x7f5e6c0cc690 2023-06-10T18:54:07.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:06.996+0000 7f5e6bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e6c0b3ac0 0x7f5e6c14d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:07.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:06.996+0000 7f5e6bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e6c0b3ac0 0x7f5e6c14d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55800/0 (socket says 172.21.15.53:55800) 2023-06-10T18:54:07.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:06.996+0000 7f5e6bfff640 1 -- 172.21.15.53:0/3855044762 learned_addr learned my addr 172.21.15.53:0/3855044762 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:54:07.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:06.996+0000 7f5e6b7fe640 1 --2- 172.21.15.53:0/3855044762 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e6c0cc690 0x7f5e6c151970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:07.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:06.996+0000 7f5e70bca640 1 --2- 172.21.15.53:0/3855044762 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e6c0ccae0 0x7f5e6c151eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:07.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:06.996+0000 7f5e6bfff640 1 -- 172.21.15.53:0/3855044762 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e6c0cc690 msgr2=0x7f5e6c151970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:07.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:06.996+0000 7f5e6bfff640 1 --2- 172.21.15.53:0/3855044762 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e6c0cc690 0x7f5e6c151970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:07.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:06.996+0000 7f5e6bfff640 1 -- 172.21.15.53:0/3855044762 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e6c0ccae0 msgr2=0x7f5e6c151eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:07.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:06.996+0000 7f5e6bfff640 1 --2- 172.21.15.53:0/3855044762 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e6c0ccae0 0x7f5e6c151eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:07.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:06.996+0000 7f5e6bfff640 1 -- 172.21.15.53:0/3855044762 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e64009a70 con 0x7f5e6c0b3ac0 2023-06-10T18:54:07.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:06.996+0000 7f5e6b7fe640 1 --2- 172.21.15.53:0/3855044762 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e6c0cc690 0x7f5e6c151970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:54:07.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:06.996+0000 7f5e70bca640 1 --2- 172.21.15.53:0/3855044762 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e6c0ccae0 0x7f5e6c151eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:54:07.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:06.996+0000 7f5e6bfff640 1 --2- 172.21.15.53:0/3855044762 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e6c0b3ac0 0x7f5e6c14d460 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c00c4d0 tx=0x7f5e5c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:07.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:06.996+0000 7f5e68ff9640 1 -- 172.21.15.53:0/3855044762 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e5c005cf0 con 0x7f5e6c0b3ac0 2023-06-10T18:54:07.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:06.996+0000 7f5e68ff9640 1 -- 172.21.15.53:0/3855044762 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e5c005e50 con 0x7f5e6c0b3ac0 2023-06-10T18:54:07.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:06.996+0000 7f5e7262d640 1 -- 172.21.15.53:0/3855044762 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e6c153ce0 con 0x7f5e6c0b3ac0 2023-06-10T18:54:07.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:06.996+0000 7f5e68ff9640 1 -- 172.21.15.53:0/3855044762 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e5c007270 con 0x7f5e6c0b3ac0 2023-06-10T18:54:07.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:06.996+0000 7f5e7262d640 1 -- 172.21.15.53:0/3855044762 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e6c14d9a0 con 0x7f5e6c0b3ac0 2023-06-10T18:54:07.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:07.000+0000 7f5e7262d640 1 -- 172.21.15.53:0/3855044762 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e6c04d790 con 0x7f5e6c0b3ac0 2023-06-10T18:54:07.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:07.000+0000 7f5e68ff9640 1 -- 172.21.15.53:0/3855044762 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5e5c0073d0 con 0x7f5e6c0b3ac0 2023-06-10T18:54:07.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:07.000+0000 7f5e68ff9640 1 --2- 172.21.15.53:0/3855044762 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5e4c066280 0x7f5e4c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:07.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:07.000+0000 7f5e68ff9640 1 -- 172.21.15.53:0/3855044762 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5e5c083210 con 0x7f5e6c0b3ac0 2023-06-10T18:54:07.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:07.000+0000 7f5e6b7fe640 1 --2- 172.21.15.53:0/3855044762 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5e4c066280 0x7f5e4c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:07.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:07.000+0000 7f5e6b7fe640 1 --2- 172.21.15.53:0/3855044762 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5e4c066280 0x7f5e4c068730 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c0c55e0 tx=0x7f5e54009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:07.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:07.004+0000 7f5e68ff9640 1 -- 172.21.15.53:0/3855044762 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5e5c050730 con 0x7f5e6c0b3ac0 2023-06-10T18:54:07.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:07.200+0000 7f5e7262d640 1 -- 172.21.15.53:0/3855044762 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5e6c08a200 con 0x7f5e6c0b3ac0 2023-06-10T18:54:07.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:07.200+0000 7f5e68ff9640 1 -- 172.21.15.53:0/3855044762 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v13) v1 ==== 53+0+73 (secure 0 0 0) 0x7f5e5c053d50 con 0x7f5e6c0b3ac0 2023-06-10T18:54:07.208 INFO:teuthology.orchestra.run.smithi053.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-06-10T18:54:07.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:07.200+0000 7f5e7262d640 1 -- 172.21.15.53:0/3855044762 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5e4c066280 msgr2=0x7f5e4c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:07.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:07.200+0000 7f5e7262d640 1 --2- 172.21.15.53:0/3855044762 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5e4c066280 0x7f5e4c068730 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c0c55e0 tx=0x7f5e54009040 comp rx=0 tx=0).stop 2023-06-10T18:54:07.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:07.200+0000 7f5e7262d640 1 -- 172.21.15.53:0/3855044762 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e6c0b3ac0 msgr2=0x7f5e6c14d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:07.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:07.200+0000 7f5e7262d640 1 --2- 172.21.15.53:0/3855044762 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e6c0b3ac0 0x7f5e6c14d460 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c00c4d0 tx=0x7f5e5c00c990 comp rx=0 tx=0).stop 2023-06-10T18:54:07.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:07.200+0000 7f5e7262d640 1 -- 172.21.15.53:0/3855044762 shutdown_connections 2023-06-10T18:54:07.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:07.200+0000 7f5e7262d640 1 --2- 172.21.15.53:0/3855044762 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5e4c066280 0x7f5e4c068730 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:07.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:07.200+0000 7f5e7262d640 1 --2- 172.21.15.53:0/3855044762 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e6c0ccae0 0x7f5e6c151eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:07.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:07.200+0000 7f5e7262d640 1 --2- 172.21.15.53:0/3855044762 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e6c0cc690 0x7f5e6c151970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:07.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:07.200+0000 7f5e7262d640 1 --2- 172.21.15.53:0/3855044762 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e6c0b3ac0 0x7f5e6c14d460 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:07.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:07.200+0000 7f5e7262d640 1 -- 172.21.15.53:0/3855044762 >> 172.21.15.53:0/3855044762 conn(0x7f5e6c071790 msgr2=0x7f5e6c0b6890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:54:07.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:07.200+0000 7f5e7262d640 1 -- 172.21.15.53:0/3855044762 shutdown_connections 2023-06-10T18:54:07.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:07.200+0000 7f5e7262d640 1 -- 172.21.15.53:0/3855044762 wait complete. 2023-06-10T18:54:07.227 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-10T18:54:07.227 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-10T18:54:07.227 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi117.front.sepia.ceph.com 2023-06-10T18:54:07.228 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-06-10T18:54:07.228 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-06-10T18:54:07.228 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-10T18:54:07.228 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-10T18:54:07.229 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-10T18:54:07.229 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-06-10T18:54:07.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:54:07.230 DEBUG:teuthology.orchestra.run.smithi117:> ip addr 2023-06-10T18:54:07.236 INFO:teuthology.orchestra.run.smithi117.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-10T18:54:07.236 INFO:teuthology.orchestra.run.smithi117.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-10T18:54:07.236 INFO:teuthology.orchestra.run.smithi117.stdout: inet 127.0.0.1/8 scope host lo 2023-06-10T18:54:07.237 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:54:07.237 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 ::1/128 scope host 2023-06-10T18:54:07.237 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:54:07.237 INFO:teuthology.orchestra.run.smithi117.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T18:54:07.237 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8a brd ff:ff:ff:ff:ff:ff 2023-06-10T18:54:07.237 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f0 2023-06-10T18:54:07.237 INFO:teuthology.orchestra.run.smithi117.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T18:54:07.238 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8b brd ff:ff:ff:ff:ff:ff 2023-06-10T18:54:07.238 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f1 2023-06-10T18:54:07.238 INFO:teuthology.orchestra.run.smithi117.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T18:54:07.238 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:62 brd ff:ff:ff:ff:ff:ff 2023-06-10T18:54:07.238 INFO:teuthology.orchestra.run.smithi117.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-10T18:54:07.238 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:63 brd ff:ff:ff:ff:ff:ff 2023-06-10T18:54:07.238 INFO:teuthology.orchestra.run.smithi117.stdout: inet 172.21.15.117/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-06-10T18:54:07.238 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft 42402sec preferred_lft 42402sec 2023-06-10T18:54:07.239 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::ec4:7aff:fe8f:4463/64 scope link 2023-06-10T18:54:07.239 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:54:07.239 INFO:teuthology.orchestra.run.smithi117.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-06-10T18:54:07.239 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 02:42:f8:40:b2:dc brd ff:ff:ff:ff:ff:ff 2023-06-10T18:54:07.239 INFO:teuthology.orchestra.run.smithi117.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-06-10T18:54:07.239 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:54:07.239 INFO:teuthology.orchestra.run.smithi117.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-10T18:54:07.239 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-06-10T18:54:07.240 INFO:teuthology.orchestra.run.smithi117.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-06-10T18:54:07.240 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:54:07.240 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-06-10T18:54:07.240 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:54:07.240 INFO:teuthology.orchestra.run.smithi117.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-10T18:54:07.240 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-06-10T18:54:07.240 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-06-10T18:54:07.241 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:54:07.241 INFO:teuthology.orchestra.run.smithi117.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-10T18:54:07.241 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-06-10T18:54:07.241 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-06-10T18:54:07.241 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:54:07.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:54:07.242 DEBUG:teuthology.orchestra.run.smithi117:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-10T18:54:07.294 INFO:teuthology.orchestra.run.smithi117.stdout:1 2023-06-10T18:54:07.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:54:07.296 DEBUG:teuthology.orchestra.run.smithi117:> route 2023-06-10T18:54:07.351 INFO:teuthology.orchestra.run.smithi117.stdout:Kernel IP routing table 2023-06-10T18:54:07.351 INFO:teuthology.orchestra.run.smithi117.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-10T18:54:07.351 INFO:teuthology.orchestra.run.smithi117.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-06-10T18:54:07.351 INFO:teuthology.orchestra.run.smithi117.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-06-10T18:54:07.351 INFO:teuthology.orchestra.run.smithi117.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-06-10T18:54:07.351 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-06-10T18:54:07.352 INFO:teuthology.orchestra.run.smithi117.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-10T18:54:07.352 INFO:teuthology.orchestra.run.smithi117.stdout:ns2.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-10T18:54:07.352 INFO:teuthology.orchestra.run.smithi117.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-10T18:54:07.352 INFO:teuthology.orchestra.run.smithi117.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-10T18:54:07.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:54:07.353 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec bash -c ' 2023-06-10T18:54:07.353 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2023-06-10T18:54:07.353 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-06-10T18:54:07.354 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-06-10T18:54:07.354 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-06-10T18:54:07.354 DEBUG:teuthology.orchestra.run.smithi117:> ') 2023-06-10T18:54:07.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:54:07.425 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list 2023-06-10T18:54:07.473 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-06-10T18:54:07.474 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-06-10T18:54:07.474 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-06-10T18:54:07.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:54:07.475 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link set brx.0 up 2023-06-10T18:54:07.530 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-06-10T18:54:07.530 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-10T18:54:07.531 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-06-10T18:54:07.577 INFO:teuthology.orchestra.run.smithi117.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-06-10T18:54:07.577 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-10T18:54:07.578 DEBUG:teuthology.orchestra.run.smithi117:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-06-10T18:54:07.629 DEBUG:teuthology.orchestra.run.smithi117:> sudo modprobe fuse 2023-06-10T18:54:07.686 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T18:54:07.686 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T18:54:07.740 INFO:teuthology.orchestra.run.smithi117.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T18:54:07.741 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T18:54:07.742 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:54:07.742 DEBUG:teuthology.orchestra.run.smithi117:> ls /sys/fs/fuse/connections 2023-06-10T18:54:07.788 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-06-10T18:54:07.789 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-06-10T18:54:07.834 DEBUG:teuthology.orchestra.run.smithi117:> sudo modprobe fuse 2023-06-10T18:54:07.849 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T18:54:07.850 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T18:54:07.906 INFO:teuthology.orchestra.run.smithi117.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T18:54:07.907 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T18:54:07.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:54:07.908 DEBUG:teuthology.orchestra.run.smithi117:> ls /sys/fs/fuse/connections 2023-06-10T18:54:07.910 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi117.stderr:2023-06-10T18:54:07.902+0000 7fa72dc2b580 -1 init, newargv = 0x55f11c138390 newargc=15 2023-06-10T18:54:07.910 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi117.stderr:ceph-fuse[44120]: starting ceph client 2023-06-10T18:54:07.917 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi117.stderr:ceph-fuse[44120]: starting fuse 2023-06-10T18:54:09.016 DEBUG:teuthology.orchestra.run.smithi117:> sudo modprobe fuse 2023-06-10T18:54:09.034 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T18:54:09.035 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T18:54:09.092 INFO:teuthology.orchestra.run.smithi117.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T18:54:09.093 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T18:54:09.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:54:09.094 DEBUG:teuthology.orchestra.run.smithi117:> ls /sys/fs/fuse/connections 2023-06-10T18:54:09.141 INFO:teuthology.orchestra.run.smithi117.stdout:45 2023-06-10T18:54:09.142 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-06-10T18:54:09.142 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-06-10T18:54:09.142 DEBUG:teuthology.orchestra.run.smithi117:> import glob 2023-06-10T18:54:09.143 DEBUG:teuthology.orchestra.run.smithi117:> import re 2023-06-10T18:54:09.143 DEBUG:teuthology.orchestra.run.smithi117:> import os 2023-06-10T18:54:09.143 DEBUG:teuthology.orchestra.run.smithi117:> import subprocess 2023-06-10T18:54:09.144 DEBUG:teuthology.orchestra.run.smithi117:> 2023-06-10T18:54:09.144 DEBUG:teuthology.orchestra.run.smithi117:> def _find_admin_socket(client_name): 2023-06-10T18:54:09.144 DEBUG:teuthology.orchestra.run.smithi117:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-06-10T18:54:09.145 DEBUG:teuthology.orchestra.run.smithi117:> files = glob.glob(asok_path) 2023-06-10T18:54:09.145 DEBUG:teuthology.orchestra.run.smithi117:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-06-10T18:54:09.145 DEBUG:teuthology.orchestra.run.smithi117:> 2023-06-10T18:54:09.145 DEBUG:teuthology.orchestra.run.smithi117:> # Given a non-glob path, it better be there 2023-06-10T18:54:09.146 DEBUG:teuthology.orchestra.run.smithi117:> if "*" not in asok_path: 2023-06-10T18:54:09.146 DEBUG:teuthology.orchestra.run.smithi117:> assert(len(files) == 1) 2023-06-10T18:54:09.146 DEBUG:teuthology.orchestra.run.smithi117:> return files[0] 2023-06-10T18:54:09.147 DEBUG:teuthology.orchestra.run.smithi117:> 2023-06-10T18:54:09.147 DEBUG:teuthology.orchestra.run.smithi117:> for f in files: 2023-06-10T18:54:09.147 DEBUG:teuthology.orchestra.run.smithi117:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-06-10T18:54:09.147 DEBUG:teuthology.orchestra.run.smithi117:> if os.path.exists("/proc/{0}".format(pid)): 2023-06-10T18:54:09.148 DEBUG:teuthology.orchestra.run.smithi117:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-06-10T18:54:09.148 DEBUG:teuthology.orchestra.run.smithi117:> contents = proc_f.read() 2023-06-10T18:54:09.148 DEBUG:teuthology.orchestra.run.smithi117:> if mountpoint in contents: 2023-06-10T18:54:09.149 DEBUG:teuthology.orchestra.run.smithi117:> return f 2023-06-10T18:54:09.149 DEBUG:teuthology.orchestra.run.smithi117:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-06-10T18:54:09.149 DEBUG:teuthology.orchestra.run.smithi117:> 2023-06-10T18:54:09.149 DEBUG:teuthology.orchestra.run.smithi117:> print(_find_admin_socket("client.1")) 2023-06-10T18:54:09.150 DEBUG:teuthology.orchestra.run.smithi117:> ' 2023-06-10T18:54:09.266 INFO:teuthology.orchestra.run.smithi117.stdout:/var/run/ceph/ceph-client.1.44120.asok 2023-06-10T18:54:09.448 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.44120.asok 2023-06-10T18:54:09.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:54:09.449 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.44120.asok status 2023-06-10T18:54:09.609 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2023-06-10T18:54:09.609 INFO:teuthology.orchestra.run.smithi117.stdout: "metadata": { 2023-06-10T18:54:09.610 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_sha1": "219d315c3a0b2075e570fb1964be2ad33fe7a9c8", 2023-06-10T18:54:09.610 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_version": "ceph version 18.0.0-4359-g219d315c (219d315c3a0b2075e570fb1964be2ad33fe7a9c8) reef (dev)", 2023-06-10T18:54:09.611 INFO:teuthology.orchestra.run.smithi117.stdout: "entity_id": "1", 2023-06-10T18:54:09.611 INFO:teuthology.orchestra.run.smithi117.stdout: "hostname": "smithi117", 2023-06-10T18:54:09.611 INFO:teuthology.orchestra.run.smithi117.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-06-10T18:54:09.612 INFO:teuthology.orchestra.run.smithi117.stdout: "pid": "44120", 2023-06-10T18:54:09.612 INFO:teuthology.orchestra.run.smithi117.stdout: "root": "/" 2023-06-10T18:54:09.612 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-06-10T18:54:09.613 INFO:teuthology.orchestra.run.smithi117.stdout: "dentry_count": 0, 2023-06-10T18:54:09.613 INFO:teuthology.orchestra.run.smithi117.stdout: "dentry_pinned_count": 0, 2023-06-10T18:54:09.613 INFO:teuthology.orchestra.run.smithi117.stdout: "id": 5203, 2023-06-10T18:54:09.613 INFO:teuthology.orchestra.run.smithi117.stdout: "inst": { 2023-06-10T18:54:09.614 INFO:teuthology.orchestra.run.smithi117.stdout: "name": { 2023-06-10T18:54:09.614 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "client", 2023-06-10T18:54:09.614 INFO:teuthology.orchestra.run.smithi117.stdout: "num": 5203 2023-06-10T18:54:09.614 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-06-10T18:54:09.614 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": { 2023-06-10T18:54:09.614 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "v1", 2023-06-10T18:54:09.614 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": "192.168.0.1:0", 2023-06-10T18:54:09.614 INFO:teuthology.orchestra.run.smithi117.stdout: "nonce": 2763046504 2023-06-10T18:54:09.615 INFO:teuthology.orchestra.run.smithi117.stdout: } 2023-06-10T18:54:09.615 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-06-10T18:54:09.615 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": { 2023-06-10T18:54:09.615 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "v1", 2023-06-10T18:54:09.615 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": "192.168.0.1:0", 2023-06-10T18:54:09.615 INFO:teuthology.orchestra.run.smithi117.stdout: "nonce": 2763046504 2023-06-10T18:54:09.615 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-06-10T18:54:09.616 INFO:teuthology.orchestra.run.smithi117.stdout: "inst_str": "client.5203 192.168.0.1:0/2763046504", 2023-06-10T18:54:09.616 INFO:teuthology.orchestra.run.smithi117.stdout: "addr_str": "192.168.0.1:0/2763046504", 2023-06-10T18:54:09.616 INFO:teuthology.orchestra.run.smithi117.stdout: "inode_count": 1, 2023-06-10T18:54:09.616 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_epoch": 13, 2023-06-10T18:54:09.616 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_epoch": 37, 2023-06-10T18:54:09.616 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_epoch_barrier": 0, 2023-06-10T18:54:09.617 INFO:teuthology.orchestra.run.smithi117.stdout: "blocklisted": false, 2023-06-10T18:54:09.617 INFO:teuthology.orchestra.run.smithi117.stdout: "fs_name": "cephfs" 2023-06-10T18:54:09.617 INFO:teuthology.orchestra.run.smithi117.stdout:} 2023-06-10T18:54:09.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:54:09.623 DEBUG:teuthology.orchestra.run.smithi117:> stat --file-system '--printf=%T 2023-06-10T18:54:09.623 DEBUG:teuthology.orchestra.run.smithi117:> ' -- /home/ubuntu/cephtest/mnt.1 2023-06-10T18:54:09.629 INFO:teuthology.orchestra.run.smithi117.stdout:fuseblk 2023-06-10T18:54:09.630 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-06-10T18:54:09.630 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:54:09.631 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-06-10T18:54:09.684 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config get mds_reconnect_timeout 2023-06-10T18:54:09.830 INFO:teuthology.orchestra.run.smithi053.stdout:{"mds_reconnect_timeout":"45.000000"} 2023-06-10T18:54:09.830 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_reconnect_timeout": "45.000000" } 2023-06-10T18:54:09.831 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config get ms_max_backoff 2023-06-10T18:54:09.969 INFO:teuthology.orchestra.run.smithi053.stdout:{"ms_max_backoff":"15.000000"} 2023-06-10T18:54:09.970 DEBUG:tasks.cephfs.filesystem:_json_asok output { "ms_max_backoff": "15.000000" } 2023-06-10T18:54:09.971 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T18:54:10.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.084+0000 7fed40e37640 1 Processor -- start 2023-06-10T18:54:10.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.084+0000 7fed40e37640 1 -- start start 2023-06-10T18:54:10.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.084+0000 7fed40e37640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fed3c0afe30 0x7fed3c163980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:10.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.084+0000 7fed40e37640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed3c1648e0 con 0x7fed3c0cb870 2023-06-10T18:54:10.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.084+0000 7fed40e37640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed3c06b2c0 con 0x7fed3c15fe00 2023-06-10T18:54:10.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.084+0000 7fed40e37640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed3c0cbcd0 con 0x7fed3c0afe30 2023-06-10T18:54:10.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.084+0000 7fed39d9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fed3c0afe30 0x7fed3c163980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:10.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.084+0000 7fed39d9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fed3c0afe30 0x7fed3c163980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55802/0 (socket says 172.21.15.53:55802) 2023-06-10T18:54:10.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.084+0000 7fed39d9b640 1 -- 172.21.15.53:0/1235519583 learned_addr learned my addr 172.21.15.53:0/1235519583 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:54:10.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.084+0000 7fed39d9b640 1 -- 172.21.15.53:0/1235519583 >> v1:172.21.15.117:6789/0 conn(0x7fed3c15fe00 legacy=0x7fed3c0af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:54:10.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.084+0000 7fed39d9b640 1 -- 172.21.15.53:0/1235519583 >> v1:172.21.15.53:6789/0 conn(0x7fed3c0cb870 legacy=0x7fed3c06b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:10.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.084+0000 7fed39d9b640 1 -- 172.21.15.53:0/1235519583 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed3c164040 con 0x7fed3c0afe30 2023-06-10T18:54:10.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.088+0000 7fed39d9b640 1 --2- 172.21.15.53:0/1235519583 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed3c0afe30 0x7fed3c163980 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fed30009e50 tx=0x7fed3001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=504b3e6336ae0a93 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:10.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.088+0000 7fed3959a640 1 -- 172.21.15.53:0/1235519583 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed300a5860 con 0x7fed3c0afe30 2023-06-10T18:54:10.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.088+0000 7fed3959a640 1 -- 172.21.15.53:0/1235519583 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed300a59c0 con 0x7fed3c0afe30 2023-06-10T18:54:10.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.088+0000 7fed3959a640 1 -- 172.21.15.53:0/1235519583 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed300a5d50 con 0x7fed3c0afe30 2023-06-10T18:54:10.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.088+0000 7fed40e37640 1 -- 172.21.15.53:0/1235519583 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed3c0afe30 msgr2=0x7fed3c163980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:10.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.088+0000 7fed40e37640 1 --2- 172.21.15.53:0/1235519583 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed3c0afe30 0x7fed3c163980 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fed30009e50 tx=0x7fed3001c9a0 comp rx=0 tx=0).stop 2023-06-10T18:54:10.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.088+0000 7fed40e37640 1 -- 172.21.15.53:0/1235519583 shutdown_connections 2023-06-10T18:54:10.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.088+0000 7fed40e37640 1 --2- 172.21.15.53:0/1235519583 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed3c0afe30 0x7fed3c163980 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:10.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.088+0000 7fed40e37640 1 -- 172.21.15.53:0/1235519583 >> 172.21.15.53:0/1235519583 conn(0x7fed3c06a0d0 msgr2=0x7fed3c0ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:54:10.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.088+0000 7fed40e37640 1 -- 172.21.15.53:0/1235519583 shutdown_connections 2023-06-10T18:54:10.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.088+0000 7fed40e37640 1 -- 172.21.15.53:0/1235519583 wait complete. 2023-06-10T18:54:10.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.088+0000 7fed40e37640 1 Processor -- start 2023-06-10T18:54:10.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.088+0000 7fed40e37640 1 -- start start 2023-06-10T18:54:10.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.088+0000 7fed40e37640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed3c0afe30 0x7fed3c15a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:10.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.088+0000 7fed40e37640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed3c0cb870 0x7fed3c0b1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:10.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.088+0000 7fed40e37640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed3c15fe00 0x7fed3c0b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:10.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.088+0000 7fed40e37640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed3c159f30 con 0x7fed3c0afe30 2023-06-10T18:54:10.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.088+0000 7fed40e37640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed3c159320 con 0x7fed3c0cb870 2023-06-10T18:54:10.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.088+0000 7fed40e37640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed3c159600 con 0x7fed3c15fe00 2023-06-10T18:54:10.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.088+0000 7fed3a59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed3c0afe30 0x7fed3c15a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:10.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.088+0000 7fed3a59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed3c0afe30 0x7fed3c15a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55818/0 (socket says 172.21.15.53:55818) 2023-06-10T18:54:10.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.088+0000 7fed3a59c640 1 -- 172.21.15.53:0/3880378167 learned_addr learned my addr 172.21.15.53:0/3880378167 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:54:10.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.088+0000 7fed39d9b640 1 --2- 172.21.15.53:0/3880378167 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed3c0cb870 0x7fed3c0b1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:10.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.088+0000 7fed3ad9d640 1 --2- 172.21.15.53:0/3880378167 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed3c15fe00 0x7fed3c0b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:10.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.088+0000 7fed3a59c640 1 -- 172.21.15.53:0/3880378167 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed3c15fe00 msgr2=0x7fed3c0b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:10.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.088+0000 7fed3a59c640 1 --2- 172.21.15.53:0/3880378167 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed3c15fe00 0x7fed3c0b1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:10.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.088+0000 7fed3a59c640 1 -- 172.21.15.53:0/3880378167 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed3c0cb870 msgr2=0x7fed3c0b1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:10.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.088+0000 7fed3a59c640 1 --2- 172.21.15.53:0/3880378167 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed3c0cb870 0x7fed3c0b1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:10.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.088+0000 7fed3a59c640 1 -- 172.21.15.53:0/3880378167 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed30009b30 con 0x7fed3c0afe30 2023-06-10T18:54:10.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.088+0000 7fed3a59c640 1 --2- 172.21.15.53:0/3880378167 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed3c0afe30 0x7fed3c15a3c0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fed2c00b410 tx=0x7fed2c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:10.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.088+0000 7fed2affd640 1 -- 172.21.15.53:0/3880378167 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed2c004020 con 0x7fed3c0afe30 2023-06-10T18:54:10.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.088+0000 7fed2affd640 1 -- 172.21.15.53:0/3880378167 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed2c004180 con 0x7fed3c0afe30 2023-06-10T18:54:10.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.088+0000 7fed40e37640 1 -- 172.21.15.53:0/3880378167 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed3c1598e0 con 0x7fed3c0afe30 2023-06-10T18:54:10.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.088+0000 7fed2affd640 1 -- 172.21.15.53:0/3880378167 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed2c011630 con 0x7fed3c0afe30 2023-06-10T18:54:10.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.092+0000 7fed40e37640 1 -- 172.21.15.53:0/3880378167 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed3c15a900 con 0x7fed3c0afe30 2023-06-10T18:54:10.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.092+0000 7fed40e37640 1 -- 172.21.15.53:0/3880378167 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed3c04d790 con 0x7fed3c0afe30 2023-06-10T18:54:10.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.092+0000 7fed2affd640 1 -- 172.21.15.53:0/3880378167 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fed2c011790 con 0x7fed3c0afe30 2023-06-10T18:54:10.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.092+0000 7fed2affd640 1 --2- 172.21.15.53:0/3880378167 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fed1c066280 0x7fed1c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:10.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.092+0000 7fed2affd640 1 -- 172.21.15.53:0/3880378167 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fed2c083af0 con 0x7fed3c0afe30 2023-06-10T18:54:10.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.092+0000 7fed39d9b640 1 --2- 172.21.15.53:0/3880378167 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fed1c066280 0x7fed1c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:10.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.092+0000 7fed39d9b640 1 --2- 172.21.15.53:0/3880378167 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fed1c066280 0x7fed1c068730 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fed300ae000 tx=0x7fed300a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:10.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.096+0000 7fed2affd640 1 -- 172.21.15.53:0/3880378167 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fed2c050f60 con 0x7fed3c0afe30 2023-06-10T18:54:10.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.284+0000 7fed40e37640 1 -- 172.21.15.53:0/3880378167 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fed3c0b0680 con 0x7fed3c0afe30 2023-06-10T18:54:10.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.284+0000 7fed2affd640 1 -- 172.21.15.53:0/3880378167 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4677 (secure 0 0 0) 0x7fed2c054580 con 0x7fed3c0afe30 2023-06-10T18:54:10.293 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:54:10.293 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4853,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/4087456763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":4087456763},{"type":"v1","addr":"172.21.15.117:6835","nonce":4087456763}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5071,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1065941624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1065941624},{"type":"v1","addr":"172.21.15.117:6837","nonce":1065941624}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5322,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/4137796077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":4137796077},{"type":"v1","addr":"172.21.15.53:6833","nonce":4137796077}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T18:53:54.735461+0000","modified":"2023-06-10T18:53:56.773799+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5331},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5331":{"gid":5331,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/2596772129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2596772129},{"type":"v1","addr":"172.21.15.53:6835","nonce":2596772129}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-06-10T18:54:10.293 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 13 2023-06-10T18:54:10.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.284+0000 7fed40e37640 1 -- 172.21.15.53:0/3880378167 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fed1c066280 msgr2=0x7fed1c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:10.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.284+0000 7fed40e37640 1 --2- 172.21.15.53:0/3880378167 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fed1c066280 0x7fed1c068730 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fed300ae000 tx=0x7fed300a7070 comp rx=0 tx=0).stop 2023-06-10T18:54:10.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.284+0000 7fed40e37640 1 -- 172.21.15.53:0/3880378167 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed3c0afe30 msgr2=0x7fed3c15a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:10.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.284+0000 7fed40e37640 1 --2- 172.21.15.53:0/3880378167 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed3c0afe30 0x7fed3c15a3c0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fed2c00b410 tx=0x7fed2c00b8d0 comp rx=0 tx=0).stop 2023-06-10T18:54:10.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.284+0000 7fed40e37640 1 -- 172.21.15.53:0/3880378167 shutdown_connections 2023-06-10T18:54:10.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.284+0000 7fed40e37640 1 --2- 172.21.15.53:0/3880378167 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fed1c066280 0x7fed1c068730 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:10.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.284+0000 7fed40e37640 1 --2- 172.21.15.53:0/3880378167 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed3c15fe00 0x7fed3c0b1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:10.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.284+0000 7fed40e37640 1 --2- 172.21.15.53:0/3880378167 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed3c0cb870 0x7fed3c0b1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:10.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.284+0000 7fed40e37640 1 --2- 172.21.15.53:0/3880378167 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed3c0afe30 0x7fed3c15a3c0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:10.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.284+0000 7fed40e37640 1 -- 172.21.15.53:0/3880378167 >> 172.21.15.53:0/3880378167 conn(0x7fed3c06a0d0 msgr2=0x7fed3c1571d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:54:10.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.284+0000 7fed40e37640 1 -- 172.21.15.53:0/3880378167 shutdown_connections 2023-06-10T18:54:10.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.284+0000 7fed40e37640 1 -- 172.21.15.53:0/3880378167 wait complete. 2023-06-10T18:54:10.311 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_defer_session_stale false 2023-06-10T18:54:10.443 INFO:teuthology.orchestra.run.smithi053.stdout:{"success":"mds_defer_session_stale = 'false' (not observed, change may require restart) "} 2023-06-10T18:54:10.443 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_defer_session_stale = 'false' (not observed, change may require restart) " } 2023-06-10T18:54:10.443 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T18:54:10.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.548+0000 7efec941b640 1 Processor -- start 2023-06-10T18:54:10.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.548+0000 7efec941b640 1 -- start start 2023-06-10T18:54:10.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.552+0000 7efec941b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7efec40b3ac0 0x7efec40b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:10.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.552+0000 7efec941b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efec40cc690 0x7efec415f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:10.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.552+0000 7efec941b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7efec40ccae0 0x7efec415f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:10.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.552+0000 7efec941b640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efec40d0020 con 0x7efec40ccae0 2023-06-10T18:54:10.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.552+0000 7efec941b640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efec40b43d0 con 0x7efec40b3ac0 2023-06-10T18:54:10.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.552+0000 7efec941b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efec40cef40 con 0x7efec40cc690 2023-06-10T18:54:10.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.552+0000 7efec37fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7efec40ccae0 0x7efec415f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:10.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.552+0000 7efec37fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7efec40ccae0 0x7efec415f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55830/0 (socket says 172.21.15.53:55830) 2023-06-10T18:54:10.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.552+0000 7efec37fe640 1 -- 172.21.15.53:0/2998213578 learned_addr learned my addr 172.21.15.53:0/2998213578 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:54:10.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.552+0000 7efec27fc640 1 --2- 172.21.15.53:0/2998213578 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efec40cc690 0x7efec415f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:10.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.552+0000 7efec2ffd640 1 --2- 172.21.15.53:0/2998213578 >> v2:172.21.15.117:3300/0 conn(0x7efec40b3ac0 0x7efec40b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:10.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.552+0000 7efec37fe640 1 -- 172.21.15.53:0/2998213578 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efec40cc690 msgr2=0x7efec415f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:54:10.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.552+0000 7efec37fe640 1 --2- 172.21.15.53:0/2998213578 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efec40cc690 0x7efec415f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:10.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.552+0000 7efec37fe640 1 -- 172.21.15.53:0/2998213578 >> v2:172.21.15.117:3300/0 conn(0x7efec40b3ac0 msgr2=0x7efec40b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:54:10.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.552+0000 7efec37fe640 1 --2- 172.21.15.53:0/2998213578 >> v2:172.21.15.117:3300/0 conn(0x7efec40b3ac0 0x7efec40b3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:10.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.552+0000 7efec37fe640 1 -- 172.21.15.53:0/2998213578 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efec40cf220 con 0x7efec40ccae0 2023-06-10T18:54:10.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.552+0000 7efec27fc640 1 --2- 172.21.15.53:0/2998213578 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efec40cc690 0x7efec415f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:54:10.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.556+0000 7efec37fe640 1 --2- 172.21.15.53:0/2998213578 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efec40ccae0 0x7efec415f8b0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7efec40b4ba0 tx=0x7efebc01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e9ee0a646e2d6c0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:10.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.556+0000 7efec1ffb640 1 -- 172.21.15.53:0/2998213578 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efebc0a5730 con 0x7efec40ccae0 2023-06-10T18:54:10.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.556+0000 7efec1ffb640 1 -- 172.21.15.53:0/2998213578 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efebc0a5890 con 0x7efec40ccae0 2023-06-10T18:54:10.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.556+0000 7efec1ffb640 1 -- 172.21.15.53:0/2998213578 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efebc0a5c20 con 0x7efec40ccae0 2023-06-10T18:54:10.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.556+0000 7efec941b640 1 -- 172.21.15.53:0/2998213578 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efec40ccae0 msgr2=0x7efec415f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:10.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.556+0000 7efec941b640 1 --2- 172.21.15.53:0/2998213578 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efec40ccae0 0x7efec415f8b0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7efec40b4ba0 tx=0x7efebc01c9a0 comp rx=0 tx=0).stop 2023-06-10T18:54:10.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.556+0000 7efec941b640 1 -- 172.21.15.53:0/2998213578 shutdown_connections 2023-06-10T18:54:10.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.556+0000 7efec941b640 1 --2- 172.21.15.53:0/2998213578 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efec40ccae0 0x7efec415f8b0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:10.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.556+0000 7efec941b640 1 --2- 172.21.15.53:0/2998213578 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efec40cc690 0x7efec415f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:10.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.556+0000 7efec941b640 1 --2- 172.21.15.53:0/2998213578 >> v2:172.21.15.117:3300/0 conn(0x7efec40b3ac0 0x7efec40b3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:10.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.556+0000 7efec941b640 1 -- 172.21.15.53:0/2998213578 >> 172.21.15.53:0/2998213578 conn(0x7efec4071790 msgr2=0x7efec4069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:54:10.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.556+0000 7efec941b640 1 -- 172.21.15.53:0/2998213578 shutdown_connections 2023-06-10T18:54:10.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.556+0000 7efec941b640 1 -- 172.21.15.53:0/2998213578 wait complete. 2023-06-10T18:54:10.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.556+0000 7efec941b640 1 Processor -- start 2023-06-10T18:54:10.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.556+0000 7efec941b640 1 -- start start 2023-06-10T18:54:10.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.556+0000 7efec941b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efec40b3ac0 0x7efec4153460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:10.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.556+0000 7efec941b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efec40cc690 0x7efec415a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:10.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.556+0000 7efec941b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efec40ccae0 0x7efec4151850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:10.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.556+0000 7efec941b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efec415adf0 con 0x7efec40b3ac0 2023-06-10T18:54:10.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.556+0000 7efec941b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efec4151d90 con 0x7efec40ccae0 2023-06-10T18:54:10.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.556+0000 7efec941b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efec40c92b0 con 0x7efec40cc690 2023-06-10T18:54:10.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.556+0000 7efec2ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efec40b3ac0 0x7efec4153460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:10.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.556+0000 7efec2ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efec40b3ac0 0x7efec4153460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55838/0 (socket says 172.21.15.53:55838) 2023-06-10T18:54:10.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.556+0000 7efec2ffd640 1 -- 172.21.15.53:0/2224232308 learned_addr learned my addr 172.21.15.53:0/2224232308 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:54:10.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.560+0000 7efec27fc640 1 --2- 172.21.15.53:0/2224232308 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efec40cc690 0x7efec415a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:10.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.560+0000 7efec37fe640 1 --2- 172.21.15.53:0/2224232308 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efec40ccae0 0x7efec4151850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:10.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.560+0000 7efec2ffd640 1 -- 172.21.15.53:0/2224232308 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efec40cc690 msgr2=0x7efec415a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:10.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.560+0000 7efec2ffd640 1 --2- 172.21.15.53:0/2224232308 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efec40cc690 0x7efec415a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:10.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.560+0000 7efec2ffd640 1 -- 172.21.15.53:0/2224232308 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efec40ccae0 msgr2=0x7efec4151850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:10.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.560+0000 7efec2ffd640 1 --2- 172.21.15.53:0/2224232308 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efec40ccae0 0x7efec4151850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:10.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.560+0000 7efec2ffd640 1 -- 172.21.15.53:0/2224232308 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efebc009b30 con 0x7efec40b3ac0 2023-06-10T18:54:10.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.560+0000 7efec27fc640 1 --2- 172.21.15.53:0/2224232308 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efec40cc690 0x7efec415a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:54:10.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.560+0000 7efec2ffd640 1 --2- 172.21.15.53:0/2224232308 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efec40b3ac0 0x7efec4153460 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7efeb400d830 tx=0x7efeb400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:10.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.560+0000 7efeab7fe640 1 -- 172.21.15.53:0/2224232308 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb40096a0 con 0x7efec40b3ac0 2023-06-10T18:54:10.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.560+0000 7efeab7fe640 1 -- 172.21.15.53:0/2224232308 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeb4009800 con 0x7efec40b3ac0 2023-06-10T18:54:10.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.560+0000 7efec941b640 1 -- 172.21.15.53:0/2224232308 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efec40c9590 con 0x7efec40b3ac0 2023-06-10T18:54:10.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.560+0000 7efeab7fe640 1 -- 172.21.15.53:0/2224232308 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb4009b70 con 0x7efec40b3ac0 2023-06-10T18:54:10.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.560+0000 7efec941b640 1 -- 172.21.15.53:0/2224232308 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efec40c9b50 con 0x7efec40b3ac0 2023-06-10T18:54:10.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.560+0000 7efec941b640 1 -- 172.21.15.53:0/2224232308 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efec404d790 con 0x7efec40b3ac0 2023-06-10T18:54:10.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.560+0000 7efeab7fe640 1 -- 172.21.15.53:0/2224232308 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7efeb4009cd0 con 0x7efec40b3ac0 2023-06-10T18:54:10.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.560+0000 7efeab7fe640 1 --2- 172.21.15.53:0/2224232308 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efeb0066280 0x7efeb0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:10.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.560+0000 7efeab7fe640 1 -- 172.21.15.53:0/2224232308 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efeb4084420 con 0x7efec40b3ac0 2023-06-10T18:54:10.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.560+0000 7efec27fc640 1 --2- 172.21.15.53:0/2224232308 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efeb0066280 0x7efeb0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:10.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.560+0000 7efec27fc640 1 --2- 172.21.15.53:0/2224232308 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efeb0066280 0x7efeb0068730 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7efec40b5ec0 tx=0x7efeb8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:10.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.564+0000 7efeab7fe640 1 -- 172.21.15.53:0/2224232308 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7efeb4051930 con 0x7efec40b3ac0 2023-06-10T18:54:10.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.744+0000 7efec941b640 1 -- 172.21.15.53:0/2224232308 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efec40b38a0 con 0x7efec40b3ac0 2023-06-10T18:54:10.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.744+0000 7efeab7fe640 1 -- 172.21.15.53:0/2224232308 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4677 (secure 0 0 0) 0x7efeb4054f50 con 0x7efec40b3ac0 2023-06-10T18:54:10.753 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:54:10.754 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4853,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/4087456763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":4087456763},{"type":"v1","addr":"172.21.15.117:6835","nonce":4087456763}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5071,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1065941624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1065941624},{"type":"v1","addr":"172.21.15.117:6837","nonce":1065941624}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5322,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/4137796077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":4137796077},{"type":"v1","addr":"172.21.15.53:6833","nonce":4137796077}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T18:53:54.735461+0000","modified":"2023-06-10T18:53:56.773799+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5331},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5331":{"gid":5331,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/2596772129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2596772129},{"type":"v1","addr":"172.21.15.53:6835","nonce":2596772129}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-06-10T18:54:10.754 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 13 2023-06-10T18:54:10.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.744+0000 7efec941b640 1 -- 172.21.15.53:0/2224232308 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efeb0066280 msgr2=0x7efeb0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:10.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.744+0000 7efec941b640 1 --2- 172.21.15.53:0/2224232308 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efeb0066280 0x7efeb0068730 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7efec40b5ec0 tx=0x7efeb8008040 comp rx=0 tx=0).stop 2023-06-10T18:54:10.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.744+0000 7efec941b640 1 -- 172.21.15.53:0/2224232308 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efec40b3ac0 msgr2=0x7efec4153460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:10.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.744+0000 7efec941b640 1 --2- 172.21.15.53:0/2224232308 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efec40b3ac0 0x7efec4153460 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7efeb400d830 tx=0x7efeb400dcf0 comp rx=0 tx=0).stop 2023-06-10T18:54:10.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.748+0000 7efec941b640 1 -- 172.21.15.53:0/2224232308 shutdown_connections 2023-06-10T18:54:10.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.748+0000 7efec941b640 1 --2- 172.21.15.53:0/2224232308 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efeb0066280 0x7efeb0068730 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:10.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.748+0000 7efec941b640 1 --2- 172.21.15.53:0/2224232308 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efec40ccae0 0x7efec4151850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:10.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.748+0000 7efec941b640 1 --2- 172.21.15.53:0/2224232308 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efec40cc690 0x7efec415a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:10.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.748+0000 7efec941b640 1 --2- 172.21.15.53:0/2224232308 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efec40b3ac0 0x7efec4153460 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:10.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.748+0000 7efec941b640 1 -- 172.21.15.53:0/2224232308 >> 172.21.15.53:0/2224232308 conn(0x7efec4071790 msgr2=0x7efec40b16e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:54:10.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.748+0000 7efec941b640 1 -- 172.21.15.53:0/2224232308 shutdown_connections 2023-06-10T18:54:10.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.748+0000 7efec941b640 1 -- 172.21.15.53:0/2224232308 wait complete. 2023-06-10T18:54:10.771 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T18:54:10.771 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T18:54:10.777 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T18:54:10.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.928+0000 7f78d7623640 1 Processor -- start 2023-06-10T18:54:10.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.928+0000 7f78d7623640 1 -- start start 2023-06-10T18:54:10.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.928+0000 7f78d7623640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78d015c7f0 0x7f78d015f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:10.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.928+0000 7f78d7623640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f78d015f860 0x7f78d00ceb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:10.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.928+0000 7f78d7623640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78d015cc40 con 0x7f78d006b780 2023-06-10T18:54:10.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.928+0000 7f78d7623640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78d015c3d0 con 0x7f78d015f860 2023-06-10T18:54:10.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.928+0000 7f78d7623640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78d00af530 con 0x7f78d015c7f0 2023-06-10T18:54:10.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.928+0000 7f78d5bc0640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f78d015f860 0x7f78d00ceb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:10.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.928+0000 7f78d5bc0640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f78d015f860 0x7f78d00ceb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55844/0 (socket says 172.21.15.53:55844) 2023-06-10T18:54:10.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.928+0000 7f78d5bc0640 1 -- 172.21.15.53:0/3873322727 learned_addr learned my addr 172.21.15.53:0/3873322727 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:54:10.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.928+0000 7f78d4bbe640 1 --2- 172.21.15.53:0/3873322727 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78d015c7f0 0x7f78d015f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:10.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.928+0000 7f78d5bc0640 1 -- 172.21.15.53:0/3873322727 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78d015c7f0 msgr2=0x7f78d015f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:54:10.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.928+0000 7f78d5bc0640 1 --2- 172.21.15.53:0/3873322727 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78d015c7f0 0x7f78d015f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:10.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.928+0000 7f78d5bc0640 1 -- 172.21.15.53:0/3873322727 >> v1:172.21.15.117:6789/0 conn(0x7f78d006b780 legacy=0x7f78d006bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:54:10.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.928+0000 7f78d5bc0640 1 -- 172.21.15.53:0/3873322727 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78d015fd70 con 0x7f78d015f860 2023-06-10T18:54:10.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.932+0000 7f78d5bc0640 1 --2- 172.21.15.53:0/3873322727 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f78d015f860 0x7f78d00ceb20 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f78c8009870 tx=0x7f78c801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa7f0910ea6024ff server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:10.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.932+0000 7f78c7fff640 1 -- 172.21.15.53:0/3873322727 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c80a7070 con 0x7f78d015f860 2023-06-10T18:54:10.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.932+0000 7f78c7fff640 1 -- 172.21.15.53:0/3873322727 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78c80ab430 con 0x7f78d015f860 2023-06-10T18:54:10.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.932+0000 7f78c7fff640 1 -- 172.21.15.53:0/3873322727 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c80ab7c0 con 0x7f78d015f860 2023-06-10T18:54:10.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.932+0000 7f78d7623640 1 -- 172.21.15.53:0/3873322727 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f78d015f860 msgr2=0x7f78d00ceb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:10.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.932+0000 7f78d7623640 1 --2- 172.21.15.53:0/3873322727 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f78d015f860 0x7f78d00ceb20 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f78c8009870 tx=0x7f78c801c470 comp rx=0 tx=0).stop 2023-06-10T18:54:10.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.932+0000 7f78d7623640 1 -- 172.21.15.53:0/3873322727 shutdown_connections 2023-06-10T18:54:10.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.932+0000 7f78d7623640 1 --2- 172.21.15.53:0/3873322727 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f78d015f860 0x7f78d00ceb20 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:10.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.932+0000 7f78d7623640 1 --2- 172.21.15.53:0/3873322727 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78d015c7f0 0x7f78d015f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:10.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.932+0000 7f78d7623640 1 -- 172.21.15.53:0/3873322727 >> 172.21.15.53:0/3873322727 conn(0x7f78d006a090 msgr2=0x7f78d006d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:54:10.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.932+0000 7f78d7623640 1 -- 172.21.15.53:0/3873322727 shutdown_connections 2023-06-10T18:54:10.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.932+0000 7f78d7623640 1 -- 172.21.15.53:0/3873322727 wait complete. 2023-06-10T18:54:10.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.932+0000 7f78d7623640 1 Processor -- start 2023-06-10T18:54:10.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.932+0000 7f78d7623640 1 -- start start 2023-06-10T18:54:10.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.936+0000 7f78d7623640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78d006b780 0x7f78d0152aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:10.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.936+0000 7f78d7623640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f78d015c7f0 0x7f78d0152fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:10.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.936+0000 7f78d7623640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78d015f860 0x7f78d0153520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:10.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.936+0000 7f78d7623640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d00ca7c0 con 0x7f78d015c7f0 2023-06-10T18:54:10.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.936+0000 7f78d7623640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d00c6fc0 con 0x7f78d006b780 2023-06-10T18:54:10.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.936+0000 7f78d7623640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78d00c72a0 con 0x7f78d015f860 2023-06-10T18:54:10.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.936+0000 7f78d4bbe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f78d015c7f0 0x7f78d0152fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:10.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.936+0000 7f78d4bbe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f78d015c7f0 0x7f78d0152fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55858/0 (socket says 172.21.15.53:55858) 2023-06-10T18:54:10.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.936+0000 7f78d4bbe640 1 -- 172.21.15.53:0/3792670649 learned_addr learned my addr 172.21.15.53:0/3792670649 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:54:10.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.936+0000 7f78d5bc0640 1 --2- 172.21.15.53:0/3792670649 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78d015f860 0x7f78d0153520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:10.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.936+0000 7f78d53bf640 1 --2- 172.21.15.53:0/3792670649 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78d006b780 0x7f78d0152aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:10.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.936+0000 7f78d4bbe640 1 -- 172.21.15.53:0/3792670649 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78d015f860 msgr2=0x7f78d0153520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:10.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.936+0000 7f78d4bbe640 1 --2- 172.21.15.53:0/3792670649 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78d015f860 0x7f78d0153520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:10.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.936+0000 7f78d4bbe640 1 -- 172.21.15.53:0/3792670649 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78d006b780 msgr2=0x7f78d0152aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:10.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.936+0000 7f78d4bbe640 1 --2- 172.21.15.53:0/3792670649 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78d006b780 0x7f78d0152aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:10.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.936+0000 7f78d4bbe640 1 -- 172.21.15.53:0/3792670649 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78c80094d0 con 0x7f78d015c7f0 2023-06-10T18:54:10.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.936+0000 7f78d53bf640 1 --2- 172.21.15.53:0/3792670649 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78d006b780 0x7f78d0152aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:54:10.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.936+0000 7f78d4bbe640 1 --2- 172.21.15.53:0/3792670649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f78d015c7f0 0x7f78d0152fe0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f78c000d800 tx=0x7f78c000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:10.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.936+0000 7f78c5ffb640 1 -- 172.21.15.53:0/3792670649 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c000b6c0 con 0x7f78d015c7f0 2023-06-10T18:54:10.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.936+0000 7f78c5ffb640 1 -- 172.21.15.53:0/3792670649 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78c000b820 con 0x7f78d015c7f0 2023-06-10T18:54:10.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.936+0000 7f78d7623640 1 -- 172.21.15.53:0/3792670649 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78d00caa60 con 0x7f78d015c7f0 2023-06-10T18:54:10.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.936+0000 7f78c5ffb640 1 -- 172.21.15.53:0/3792670649 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c000bb90 con 0x7f78d015c7f0 2023-06-10T18:54:10.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.936+0000 7f78d7623640 1 -- 172.21.15.53:0/3792670649 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78d00ac8b0 con 0x7f78d015c7f0 2023-06-10T18:54:10.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.936+0000 7f78d7623640 1 -- 172.21.15.53:0/3792670649 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78d00acaa0 con 0x7f78d015c7f0 2023-06-10T18:54:10.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.936+0000 7f78c5ffb640 1 -- 172.21.15.53:0/3792670649 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f78c000bcf0 con 0x7f78d015c7f0 2023-06-10T18:54:10.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.936+0000 7f78c5ffb640 1 --2- 172.21.15.53:0/3792670649 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f78b4066280 0x7f78b4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:10.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.936+0000 7f78c5ffb640 1 -- 172.21.15.53:0/3792670649 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f78c00842a0 con 0x7f78d015c7f0 2023-06-10T18:54:10.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.936+0000 7f78d53bf640 1 --2- 172.21.15.53:0/3792670649 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f78b4066280 0x7f78b4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:10.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.940+0000 7f78d53bf640 1 --2- 172.21.15.53:0/3792670649 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f78b4066280 0x7f78b4068730 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f78cc007fd0 tx=0x7f78cc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:10.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:10.940+0000 7f78c5ffb640 1 -- 172.21.15.53:0/3792670649 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f78c00551b0 con 0x7f78d015c7f0 2023-06-10T18:54:11.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.096+0000 7f78d7623640 1 -- 172.21.15.53:0/3792670649 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f78d004d790 con 0x7f78d015c7f0 2023-06-10T18:54:11.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.100+0000 7f78c5ffb640 1 -- 172.21.15.53:0/3792670649 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18339 (secure 0 0 0) 0x7f78c0054d40 con 0x7f78d015c7f0 2023-06-10T18:54:11.108 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:54:11.108 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":37,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T18:53:55.739534+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-06-10T18:53:52.688764+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-06-10T18:53:53.727157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T18:54:11.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.100+0000 7f78d7623640 1 -- 172.21.15.53:0/3792670649 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f78b4066280 msgr2=0x7f78b4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:11.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.100+0000 7f78d7623640 1 --2- 172.21.15.53:0/3792670649 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f78b4066280 0x7f78b4068730 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f78cc007fd0 tx=0x7f78cc009040 comp rx=0 tx=0).stop 2023-06-10T18:54:11.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.100+0000 7f78d7623640 1 -- 172.21.15.53:0/3792670649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f78d015c7f0 msgr2=0x7f78d0152fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:11.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.100+0000 7f78d7623640 1 --2- 172.21.15.53:0/3792670649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f78d015c7f0 0x7f78d0152fe0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f78c000d800 tx=0x7f78c000dcc0 comp rx=0 tx=0).stop 2023-06-10T18:54:11.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.100+0000 7f78d7623640 1 -- 172.21.15.53:0/3792670649 shutdown_connections 2023-06-10T18:54:11.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.100+0000 7f78d7623640 1 --2- 172.21.15.53:0/3792670649 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f78b4066280 0x7f78b4068730 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:11.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.100+0000 7f78d7623640 1 --2- 172.21.15.53:0/3792670649 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78d015f860 0x7f78d0153520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:11.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.100+0000 7f78d7623640 1 --2- 172.21.15.53:0/3792670649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f78d015c7f0 0x7f78d0152fe0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:11.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.100+0000 7f78d7623640 1 --2- 172.21.15.53:0/3792670649 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78d006b780 0x7f78d0152aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:11.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.100+0000 7f78d7623640 1 -- 172.21.15.53:0/3792670649 >> 172.21.15.53:0/3792670649 conn(0x7f78d006a090 msgr2=0x7f78d01586d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:54:11.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.100+0000 7f78d7623640 1 -- 172.21.15.53:0/3792670649 shutdown_connections 2023-06-10T18:54:11.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.100+0000 7f78d7623640 1 -- 172.21.15.53:0/3792670649 wait complete. 2023-06-10T18:54:11.128 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-10T18:52:33.633114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-10T18:52:39.171487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-10T18:53:52.688764+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-06-10T18:53:53.727157+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-10T18:54:11.129 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-10T18:54:11.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.244+0000 7f2621995640 1 Processor -- start 2023-06-10T18:54:11.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.244+0000 7f2621995640 1 -- start start 2023-06-10T18:54:11.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.244+0000 7f2621995640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f261c156180 0x7f261c0cd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:11.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.244+0000 7f2621995640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f261c15c070 0x7f261c15c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:11.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.244+0000 7f2621995640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f261c158a80 0x7f261c158e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:11.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.244+0000 7f2621995640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f261c15ca30 con 0x7f261c156180 2023-06-10T18:54:11.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.244+0000 7f2621995640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f261c06b090 con 0x7f261c15c070 2023-06-10T18:54:11.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.244+0000 7f2621995640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f261c06efa0 con 0x7f261c158a80 2023-06-10T18:54:11.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.248+0000 7f261affd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f261c156180 0x7f261c0cd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:11.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.248+0000 7f261affd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f261c156180 0x7f261c0cd4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47998/0 (socket says 172.21.15.53:47998) 2023-06-10T18:54:11.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.248+0000 7f261affd640 1 -- 172.21.15.53:0/2323984186 learned_addr learned my addr 172.21.15.53:0/2323984186 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:54:11.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.248+0000 7f261b7fe640 1 --2- 172.21.15.53:0/2323984186 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f261c158a80 0x7f261c158e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:11.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.248+0000 7f2613fff640 1 --2- 172.21.15.53:0/2323984186 >> v2:172.21.15.117:3300/0 conn(0x7f261c15c070 0x7f261c15c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:11.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.248+0000 7f261affd640 1 -- 172.21.15.53:0/2323984186 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f261c158a80 msgr2=0x7f261c158e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:54:11.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.248+0000 7f261affd640 1 --2- 172.21.15.53:0/2323984186 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f261c158a80 0x7f261c158e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:11.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.248+0000 7f261affd640 1 -- 172.21.15.53:0/2323984186 >> v2:172.21.15.117:3300/0 conn(0x7f261c15c070 msgr2=0x7f261c15c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:54:11.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.248+0000 7f261affd640 1 --2- 172.21.15.53:0/2323984186 >> v2:172.21.15.117:3300/0 conn(0x7f261c15c070 0x7f261c15c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:11.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.248+0000 7f261affd640 1 -- 172.21.15.53:0/2323984186 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f261c0cc720 con 0x7f261c156180 2023-06-10T18:54:11.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.248+0000 7f261b7fe640 1 --2- 172.21.15.53:0/2323984186 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f261c158a80 0x7f261c158e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:54:11.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.248+0000 7f261affd640 1 --2- 172.21.15.53:0/2323984186 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f261c156180 0x7f261c0cd4a0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f261c0cbae0 tx=0x7f260c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef5dc9f22f773f5 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:11.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.248+0000 7f261a7fc640 1 -- 172.21.15.53:0/2323984186 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260c0ac410 con 0x7f261c156180 2023-06-10T18:54:11.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.248+0000 7f261a7fc640 1 -- 172.21.15.53:0/2323984186 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f260c0ac570 con 0x7f261c156180 2023-06-10T18:54:11.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.248+0000 7f261a7fc640 1 -- 172.21.15.53:0/2323984186 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260c0ac900 con 0x7f261c156180 2023-06-10T18:54:11.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.248+0000 7f2621995640 1 -- 172.21.15.53:0/2323984186 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f261c156180 msgr2=0x7f261c0cd4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:11.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.248+0000 7f2621995640 1 --2- 172.21.15.53:0/2323984186 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f261c156180 0x7f261c0cd4a0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f261c0cbae0 tx=0x7f260c01c500 comp rx=0 tx=0).stop 2023-06-10T18:54:11.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.248+0000 7f2621995640 1 -- 172.21.15.53:0/2323984186 shutdown_connections 2023-06-10T18:54:11.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.248+0000 7f2621995640 1 --2- 172.21.15.53:0/2323984186 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f261c158a80 0x7f261c158e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:11.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.248+0000 7f2621995640 1 --2- 172.21.15.53:0/2323984186 >> v2:172.21.15.117:3300/0 conn(0x7f261c15c070 0x7f261c15c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:11.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.248+0000 7f2621995640 1 --2- 172.21.15.53:0/2323984186 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f261c156180 0x7f261c0cd4a0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:11.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.248+0000 7f2621995640 1 -- 172.21.15.53:0/2323984186 >> 172.21.15.53:0/2323984186 conn(0x7f261c06a0e0 msgr2=0x7f261c0cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:54:11.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.248+0000 7f2621995640 1 -- 172.21.15.53:0/2323984186 shutdown_connections 2023-06-10T18:54:11.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.248+0000 7f2621995640 1 -- 172.21.15.53:0/2323984186 wait complete. 2023-06-10T18:54:11.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.252+0000 7f2621995640 1 Processor -- start 2023-06-10T18:54:11.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.252+0000 7f2621995640 1 -- start start 2023-06-10T18:54:11.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.252+0000 7f2621995640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f261c156180 0x7f261c14acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:11.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.252+0000 7f2621995640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f261c158a80 0x7f261c14b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:11.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.252+0000 7f2621995640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f261c15c070 0x7f261c0c1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:11.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.252+0000 7f2621995640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f261c0b3540 con 0x7f261c158a80 2023-06-10T18:54:11.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.252+0000 7f2621995640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f261c14f2d0 con 0x7f261c156180 2023-06-10T18:54:11.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.252+0000 7f2621995640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f261c153a00 con 0x7f261c15c070 2023-06-10T18:54:11.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.252+0000 7f2613fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f261c158a80 0x7f261c14b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:11.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.252+0000 7f2613fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f261c158a80 0x7f261c14b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48000/0 (socket says 172.21.15.53:48000) 2023-06-10T18:54:11.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.252+0000 7f2613fff640 1 -- 172.21.15.53:0/129316146 learned_addr learned my addr 172.21.15.53:0/129316146 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:54:11.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.252+0000 7f261b7fe640 1 --2- 172.21.15.53:0/129316146 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f261c15c070 0x7f261c0c1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:11.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.252+0000 7f2613fff640 1 -- 172.21.15.53:0/129316146 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f261c15c070 msgr2=0x7f261c0c1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:11.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.252+0000 7f261affd640 1 --2- 172.21.15.53:0/129316146 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f261c156180 0x7f261c14acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:11.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.252+0000 7f2613fff640 1 --2- 172.21.15.53:0/129316146 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f261c15c070 0x7f261c0c1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:11.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.252+0000 7f2613fff640 1 -- 172.21.15.53:0/129316146 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f261c156180 msgr2=0x7f261c14acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:11.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.252+0000 7f2613fff640 1 --2- 172.21.15.53:0/129316146 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f261c156180 0x7f261c14acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:11.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.252+0000 7f2613fff640 1 -- 172.21.15.53:0/129316146 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f260c0094d0 con 0x7f261c158a80 2023-06-10T18:54:11.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.252+0000 7f261b7fe640 1 --2- 172.21.15.53:0/129316146 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f261c15c070 0x7f261c0c1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:54:11.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.252+0000 7f2613fff640 1 --2- 172.21.15.53:0/129316146 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f261c158a80 0x7f261c14b4b0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f260400d620 tx=0x7f260400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:11.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.252+0000 7f2618ff9640 1 -- 172.21.15.53:0/129316146 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260400b620 con 0x7f261c158a80 2023-06-10T18:54:11.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.252+0000 7f2618ff9640 1 -- 172.21.15.53:0/129316146 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f260400b780 con 0x7f261c158a80 2023-06-10T18:54:11.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.252+0000 7f2618ff9640 1 -- 172.21.15.53:0/129316146 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260400bb10 con 0x7f261c158a80 2023-06-10T18:54:11.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.252+0000 7f2621995640 1 -- 172.21.15.53:0/129316146 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f261c153ce0 con 0x7f261c158a80 2023-06-10T18:54:11.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.252+0000 7f2621995640 1 -- 172.21.15.53:0/129316146 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f261c14f520 con 0x7f261c158a80 2023-06-10T18:54:11.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.252+0000 7f2621995640 1 -- 172.21.15.53:0/129316146 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f261c154200 con 0x7f261c158a80 2023-06-10T18:54:11.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.256+0000 7f2618ff9640 1 -- 172.21.15.53:0/129316146 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f260400bc70 con 0x7f261c158a80 2023-06-10T18:54:11.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.256+0000 7f2618ff9640 1 --2- 172.21.15.53:0/129316146 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f25fc066280 0x7f25fc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:11.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.256+0000 7f2618ff9640 1 -- 172.21.15.53:0/129316146 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f26040842b0 con 0x7f261c158a80 2023-06-10T18:54:11.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.256+0000 7f261affd640 1 --2- 172.21.15.53:0/129316146 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f25fc066280 0x7f25fc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:11.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.256+0000 7f261affd640 1 --2- 172.21.15.53:0/129316146 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f25fc066280 0x7f25fc068730 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f260c0ae000 tx=0x7f260c0a6040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:11.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.260+0000 7f2618ff9640 1 -- 172.21.15.53:0/129316146 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f26040516a0 con 0x7f261c158a80 2023-06-10T18:54:11.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.412+0000 7f2621995640 1 -- 172.21.15.53:0/129316146 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f261c14f6b0 con 0x7f261c158a80 2023-06-10T18:54:11.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.412+0000 7f2618ff9640 1 -- 172.21.15.53:0/129316146 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2604007380 con 0x7f261c158a80 2023-06-10T18:54:11.422 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-06-10T18:54:11.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.416+0000 7f2621995640 1 -- 172.21.15.53:0/129316146 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f25fc066280 msgr2=0x7f25fc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:11.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.416+0000 7f2621995640 1 --2- 172.21.15.53:0/129316146 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f25fc066280 0x7f25fc068730 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f260c0ae000 tx=0x7f260c0a6040 comp rx=0 tx=0).stop 2023-06-10T18:54:11.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.416+0000 7f2621995640 1 -- 172.21.15.53:0/129316146 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f261c158a80 msgr2=0x7f261c14b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:11.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.416+0000 7f2621995640 1 --2- 172.21.15.53:0/129316146 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f261c158a80 0x7f261c14b4b0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f260400d620 tx=0x7f260400dae0 comp rx=0 tx=0).stop 2023-06-10T18:54:11.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.416+0000 7f2621995640 1 -- 172.21.15.53:0/129316146 shutdown_connections 2023-06-10T18:54:11.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.416+0000 7f2621995640 1 --2- 172.21.15.53:0/129316146 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f25fc066280 0x7f25fc068730 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:11.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.416+0000 7f2621995640 1 --2- 172.21.15.53:0/129316146 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f261c15c070 0x7f261c0c1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:11.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.416+0000 7f2621995640 1 --2- 172.21.15.53:0/129316146 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f261c158a80 0x7f261c14b4b0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:11.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.416+0000 7f2621995640 1 --2- 172.21.15.53:0/129316146 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f261c156180 0x7f261c14acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:11.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.416+0000 7f2621995640 1 -- 172.21.15.53:0/129316146 >> 172.21.15.53:0/129316146 conn(0x7f261c06a0e0 msgr2=0x7f261c0cdbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:54:11.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.416+0000 7f2621995640 1 -- 172.21.15.53:0/129316146 shutdown_connections 2023-06-10T18:54:11.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.416+0000 7f2621995640 1 -- 172.21.15.53:0/129316146 wait complete. 2023-06-10T18:54:11.441 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-10T18:54:11.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.548+0000 7f59d4926640 1 Processor -- start 2023-06-10T18:54:11.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.548+0000 7f59d4926640 1 -- start start 2023-06-10T18:54:11.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.552+0000 7f59d4926640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f59d00b0b90 0x7f59d00b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:11.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.552+0000 7f59d4926640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59d00cc7c0 con 0x7f59d015c090 2023-06-10T18:54:11.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.552+0000 7f59d4926640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59d00ccaa0 con 0x7f59d00b7e30 2023-06-10T18:54:11.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.552+0000 7f59d4926640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59d00ccd80 con 0x7f59d00b0b90 2023-06-10T18:54:11.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.552+0000 7f59ce59c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f59d015c090 0x7f59d00b7720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:58088/0 (socket says 172.21.15.53:58088) 2023-06-10T18:54:11.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.552+0000 7f59ce59c640 1 -- 172.21.15.53:0/2059106655 learned_addr learned my addr 172.21.15.53:0/2059106655 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:54:11.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.552+0000 7f59ced9d640 1 --2- 172.21.15.53:0/2059106655 >> v2:172.21.15.53:3300/0 conn(0x7f59d00b0b90 0x7f59d00b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:11.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.552+0000 7f59cd59a640 1 -- 172.21.15.53:0/2059106655 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 432312245 0 0) 0x7f59d00cc7c0 con 0x7f59d015c090 2023-06-10T18:54:11.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.552+0000 7f59cd59a640 1 -- 172.21.15.53:0/2059106655 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59b8003530 con 0x7f59d015c090 2023-06-10T18:54:11.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.552+0000 7f59ced9d640 1 -- 172.21.15.53:0/2059106655 >> v1:172.21.15.117:6789/0 conn(0x7f59d00b7e30 legacy=0x7f59d00d04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:11.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.552+0000 7f59ced9d640 1 -- 172.21.15.53:0/2059106655 >> v1:172.21.15.53:6789/0 conn(0x7f59d015c090 legacy=0x7f59d00b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:11.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.552+0000 7f59ced9d640 1 -- 172.21.15.53:0/2059106655 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59d00cd060 con 0x7f59d00b0b90 2023-06-10T18:54:11.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.552+0000 7f59ced9d640 1 --2- 172.21.15.53:0/2059106655 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59d00b0b90 0x7f59d00b10c0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f59c80097c0 tx=0x7f59c801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bb8cb1c735ca69a server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:11.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.552+0000 7f59cd59a640 1 -- 172.21.15.53:0/2059106655 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c80ab600 con 0x7f59d00b0b90 2023-06-10T18:54:11.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.552+0000 7f59cd59a640 1 -- 172.21.15.53:0/2059106655 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59c80a7050 con 0x7f59d00b0b90 2023-06-10T18:54:11.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.552+0000 7f59cd59a640 1 -- 172.21.15.53:0/2059106655 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c80ab980 con 0x7f59d00b0b90 2023-06-10T18:54:11.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.556+0000 7f59d4926640 1 -- 172.21.15.53:0/2059106655 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59d00b0b90 msgr2=0x7f59d00b10c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:11.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.556+0000 7f59d4926640 1 --2- 172.21.15.53:0/2059106655 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59d00b0b90 0x7f59d00b10c0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f59c80097c0 tx=0x7f59c801c3c0 comp rx=0 tx=0).stop 2023-06-10T18:54:11.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.556+0000 7f59d4926640 1 -- 172.21.15.53:0/2059106655 shutdown_connections 2023-06-10T18:54:11.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.556+0000 7f59d4926640 1 --2- 172.21.15.53:0/2059106655 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59d00b0b90 0x7f59d00b10c0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:11.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.556+0000 7f59d4926640 1 -- 172.21.15.53:0/2059106655 >> 172.21.15.53:0/2059106655 conn(0x7f59d0069e20 msgr2=0x7f59d006a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:54:11.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.556+0000 7f59d4926640 1 -- 172.21.15.53:0/2059106655 shutdown_connections 2023-06-10T18:54:11.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.556+0000 7f59d4926640 1 -- 172.21.15.53:0/2059106655 wait complete. 2023-06-10T18:54:11.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.556+0000 7f59d4926640 1 Processor -- start 2023-06-10T18:54:11.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.556+0000 7f59d4926640 1 -- start start 2023-06-10T18:54:11.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.556+0000 7f59d4926640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59d00b0b90 0x7f59d014e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:11.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.556+0000 7f59d4926640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59d00b7e30 0x7f59d00c4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:11.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.556+0000 7f59d4926640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59d015c090 0x7f59d00c91a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:11.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.556+0000 7f59d4926640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59d00caaa0 con 0x7f59d015c090 2023-06-10T18:54:11.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.556+0000 7f59d4926640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59d014ebd0 con 0x7f59d00b0b90 2023-06-10T18:54:11.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.556+0000 7f59d4926640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59d014e990 con 0x7f59d00b7e30 2023-06-10T18:54:11.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.556+0000 7f59ced9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59d015c090 0x7f59d00c91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:11.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.556+0000 7f59ced9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59d015c090 0x7f59d00c91a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48010/0 (socket says 172.21.15.53:48010) 2023-06-10T18:54:11.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.556+0000 7f59ced9d640 1 -- 172.21.15.53:0/4239135913 learned_addr learned my addr 172.21.15.53:0/4239135913 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:54:11.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.556+0000 7f59ced9d640 1 -- 172.21.15.53:0/4239135913 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59d00b7e30 msgr2=0x7f59d00c4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:11.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.556+0000 7f59ced9d640 1 --2- 172.21.15.53:0/4239135913 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59d00b7e30 0x7f59d00c4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:11.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.556+0000 7f59ced9d640 1 -- 172.21.15.53:0/4239135913 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59d00b0b90 msgr2=0x7f59d014e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:11.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.556+0000 7f59ced9d640 1 --2- 172.21.15.53:0/4239135913 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59d00b0b90 0x7f59d014e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:11.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.556+0000 7f59ced9d640 1 -- 172.21.15.53:0/4239135913 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c8009420 con 0x7f59d015c090 2023-06-10T18:54:11.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.556+0000 7f59ced9d640 1 --2- 172.21.15.53:0/4239135913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59d015c090 0x7f59d00c91a0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f59c8019ff0 tx=0x7f59c8019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:11.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.556+0000 7f59beffd640 1 -- 172.21.15.53:0/4239135913 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c80b4430 con 0x7f59d015c090 2023-06-10T18:54:11.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.556+0000 7f59beffd640 1 -- 172.21.15.53:0/4239135913 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59c80b4590 con 0x7f59d015c090 2023-06-10T18:54:11.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.556+0000 7f59beffd640 1 -- 172.21.15.53:0/4239135913 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c80b4920 con 0x7f59d015c090 2023-06-10T18:54:11.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.556+0000 7f59d4926640 1 -- 172.21.15.53:0/4239135913 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59d00ca100 con 0x7f59d015c090 2023-06-10T18:54:11.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.556+0000 7f59d4926640 1 -- 172.21.15.53:0/4239135913 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59d00ca6c0 con 0x7f59d015c090 2023-06-10T18:54:11.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.560+0000 7f59d4926640 1 -- 172.21.15.53:0/4239135913 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59d00c5ba0 con 0x7f59d015c090 2023-06-10T18:54:11.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.560+0000 7f59beffd640 1 -- 172.21.15.53:0/4239135913 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f59c80b2040 con 0x7f59d015c090 2023-06-10T18:54:11.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.560+0000 7f59beffd640 1 --2- 172.21.15.53:0/4239135913 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f59b0066280 0x7f59b0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:11.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.560+0000 7f59beffd640 1 -- 172.21.15.53:0/4239135913 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f59c811dba0 con 0x7f59d015c090 2023-06-10T18:54:11.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.560+0000 7f59ce59c640 1 --2- 172.21.15.53:0/4239135913 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f59b0066280 0x7f59b0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:11.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.560+0000 7f59ce59c640 1 --2- 172.21.15.53:0/4239135913 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f59b0066280 0x7f59b0068730 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f59c0002010 tx=0x7f59c0001600 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:11.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.564+0000 7f59beffd640 1 -- 172.21.15.53:0/4239135913 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f59c80eb0b0 con 0x7f59d015c090 2023-06-10T18:54:11.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.716+0000 7f59d4926640 1 -- 172.21.15.53:0/4239135913 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f59d004d790 con 0x7f59d015c090 2023-06-10T18:54:11.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.720+0000 7f59beffd640 1 -- 172.21.15.53:0/4239135913 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v37) v1 ==== 92+0+10 (secure 0 0 0) 0x7f59c80ee6d0 con 0x7f59d015c090 2023-06-10T18:54:11.728 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-06-10T18:54:11.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.720+0000 7f59d4926640 1 -- 172.21.15.53:0/4239135913 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f59b0066280 msgr2=0x7f59b0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:11.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.720+0000 7f59d4926640 1 --2- 172.21.15.53:0/4239135913 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f59b0066280 0x7f59b0068730 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f59c0002010 tx=0x7f59c0001600 comp rx=0 tx=0).stop 2023-06-10T18:54:11.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.720+0000 7f59d4926640 1 -- 172.21.15.53:0/4239135913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59d015c090 msgr2=0x7f59d00c91a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:11.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.720+0000 7f59d4926640 1 --2- 172.21.15.53:0/4239135913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59d015c090 0x7f59d00c91a0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f59c8019ff0 tx=0x7f59c8019160 comp rx=0 tx=0).stop 2023-06-10T18:54:11.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.720+0000 7f59d4926640 1 -- 172.21.15.53:0/4239135913 shutdown_connections 2023-06-10T18:54:11.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.720+0000 7f59d4926640 1 --2- 172.21.15.53:0/4239135913 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f59b0066280 0x7f59b0068730 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:11.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.720+0000 7f59d4926640 1 --2- 172.21.15.53:0/4239135913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59d015c090 0x7f59d00c91a0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:11.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.720+0000 7f59d4926640 1 --2- 172.21.15.53:0/4239135913 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59d00b7e30 0x7f59d00c4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:11.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.720+0000 7f59d4926640 1 --2- 172.21.15.53:0/4239135913 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59d00b0b90 0x7f59d014e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:11.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.720+0000 7f59d4926640 1 -- 172.21.15.53:0/4239135913 >> 172.21.15.53:0/4239135913 conn(0x7f59d0069e20 msgr2=0x7f59d00b52b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:54:11.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.720+0000 7f59d4926640 1 -- 172.21.15.53:0/4239135913 shutdown_connections 2023-06-10T18:54:11.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.720+0000 7f59d4926640 1 -- 172.21.15.53:0/4239135913 wait complete. 2023-06-10T18:54:11.746 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-10T18:54:11.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.860+0000 7ff1c7a2b640 1 Processor -- start 2023-06-10T18:54:11.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.860+0000 7ff1c7a2b640 1 -- start start 2023-06-10T18:54:11.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.864+0000 7ff1c7a2b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff1c00ceb20 0x7ff1c00cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:11.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.864+0000 7ff1c7a2b640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1c015cc40 con 0x7ff1c006b780 2023-06-10T18:54:11.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.864+0000 7ff1c7a2b640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1c00af530 con 0x7ff1c015c7f0 2023-06-10T18:54:11.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.864+0000 7ff1c7a2b640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1c015c3d0 con 0x7ff1c00ceb20 2023-06-10T18:54:11.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.864+0000 7ff1c57c7640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ff1c006b780 0x7ff1c006bb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:58100/0 (socket says 172.21.15.53:58100) 2023-06-10T18:54:11.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.864+0000 7ff1c57c7640 1 -- 172.21.15.53:0/870458380 learned_addr learned my addr 172.21.15.53:0/870458380 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:54:11.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.864+0000 7ff1c5fc8640 1 --2- 172.21.15.53:0/870458380 >> v2:172.21.15.117:3300/0 conn(0x7ff1c00ceb20 0x7ff1c00cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:11.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.864+0000 7ff1b7fff640 1 -- 172.21.15.53:0/870458380 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 897141321 0 0) 0x7ff1c015cc40 con 0x7ff1c006b780 2023-06-10T18:54:11.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.864+0000 7ff1b7fff640 1 -- 172.21.15.53:0/870458380 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1ac003530 con 0x7ff1c006b780 2023-06-10T18:54:11.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.864+0000 7ff1b7fff640 1 -- 172.21.15.53:0/870458380 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3085396462 0 0) 0x7ff1ac003530 con 0x7ff1c006b780 2023-06-10T18:54:11.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.864+0000 7ff1b7fff640 1 -- 172.21.15.53:0/870458380 >> v2:172.21.15.117:3300/0 conn(0x7ff1c00ceb20 msgr2=0x7ff1c00cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:54:11.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.864+0000 7ff1b7fff640 1 --2- 172.21.15.53:0/870458380 >> v2:172.21.15.117:3300/0 conn(0x7ff1c00ceb20 0x7ff1c00cefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:11.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.864+0000 7ff1b7fff640 1 -- 172.21.15.53:0/870458380 >> v1:172.21.15.117:6789/0 conn(0x7ff1c015c7f0 legacy=0x7ff1c015f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:11.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.864+0000 7ff1b7fff640 1 -- 172.21.15.53:0/870458380 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1c015fd70 con 0x7ff1c006b780 2023-06-10T18:54:11.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.864+0000 7ff1b7fff640 1 -- 172.21.15.53:0/870458380 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7ff1bc001680 con 0x7ff1c006b780 2023-06-10T18:54:11.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.864+0000 7ff1b7fff640 1 -- 172.21.15.53:0/870458380 >> v1:172.21.15.53:6789/0 conn(0x7ff1c006b780 legacy=0x7ff1c006bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:11.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.864+0000 7ff1b7fff640 1 --2- 172.21.15.53:0/870458380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1ac003980 0x7ff1ac003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:11.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.864+0000 7ff1b7fff640 1 --2- 172.21.15.53:0/870458380 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1ac0047d0 0x7ff1ac004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:11.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.864+0000 7ff1b7fff640 1 --2- 172.21.15.53:0/870458380 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1ac005180 0x7ff1ac00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:11.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.864+0000 7ff1b7fff640 1 -- 172.21.15.53:0/870458380 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c015c3d0 con 0x7ff1ac003980 2023-06-10T18:54:11.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.864+0000 7ff1b7fff640 1 -- 172.21.15.53:0/870458380 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1ac00c090 con 0x7ff1ac0047d0 2023-06-10T18:54:11.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.864+0000 7ff1b7fff640 1 -- 172.21.15.53:0/870458380 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1ac00c250 con 0x7ff1ac005180 2023-06-10T18:54:11.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.864+0000 7ff1c57c7640 1 --2- 172.21.15.53:0/870458380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1ac003980 0x7ff1ac003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:11.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.864+0000 7ff1c5fc8640 1 --2- 172.21.15.53:0/870458380 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1ac005180 0x7ff1ac00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:11.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.864+0000 7ff1c4fc6640 1 --2- 172.21.15.53:0/870458380 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1ac0047d0 0x7ff1ac004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:11.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.864+0000 7ff1c57c7640 1 -- 172.21.15.53:0/870458380 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1ac005180 msgr2=0x7ff1ac00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:54:11.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.864+0000 7ff1c57c7640 1 --2- 172.21.15.53:0/870458380 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1ac005180 0x7ff1ac00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:11.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.864+0000 7ff1c57c7640 1 -- 172.21.15.53:0/870458380 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1ac0047d0 msgr2=0x7ff1ac004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:54:11.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.864+0000 7ff1c57c7640 1 --2- 172.21.15.53:0/870458380 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1ac0047d0 0x7ff1ac004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:11.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.864+0000 7ff1c57c7640 1 -- 172.21.15.53:0/870458380 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1ac003530 con 0x7ff1ac003980 2023-06-10T18:54:11.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.864+0000 7ff1c5fc8640 1 -- 172.21.15.53:0/870458380 reap_dead start 2023-06-10T18:54:11.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.868+0000 7ff1c57c7640 1 --2- 172.21.15.53:0/870458380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1ac003980 0x7ff1ac003d90 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc00c240 tx=0x7ff1bc01cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f3d0c07c4cefa9a server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:11.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.868+0000 7ff1b7fff640 1 -- 172.21.15.53:0/870458380 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc005ae0 con 0x7ff1ac003980 2023-06-10T18:54:11.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.868+0000 7ff1b7fff640 1 -- 172.21.15.53:0/870458380 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1bc005c60 con 0x7ff1ac003980 2023-06-10T18:54:11.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.868+0000 7ff1b7fff640 1 -- 172.21.15.53:0/870458380 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc0a58a0 con 0x7ff1ac003980 2023-06-10T18:54:11.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.868+0000 7ff1c7a2b640 1 -- 172.21.15.53:0/870458380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1ac003980 msgr2=0x7ff1ac003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:11.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.868+0000 7ff1c7a2b640 1 --2- 172.21.15.53:0/870458380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1ac003980 0x7ff1ac003d90 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc00c240 tx=0x7ff1bc01cbc0 comp rx=0 tx=0).stop 2023-06-10T18:54:11.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.868+0000 7ff1c7a2b640 1 -- 172.21.15.53:0/870458380 shutdown_connections 2023-06-10T18:54:11.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.868+0000 7ff1c7a2b640 1 --2- 172.21.15.53:0/870458380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1ac003980 0x7ff1ac003d90 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:11.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.868+0000 7ff1c7a2b640 1 -- 172.21.15.53:0/870458380 >> 172.21.15.53:0/870458380 conn(0x7ff1c006a090 msgr2=0x7ff1c006d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:54:11.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.868+0000 7ff1c7a2b640 1 -- 172.21.15.53:0/870458380 shutdown_connections 2023-06-10T18:54:11.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.868+0000 7ff1c7a2b640 1 -- 172.21.15.53:0/870458380 wait complete. 2023-06-10T18:54:11.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.868+0000 7ff1c7a2b640 1 Processor -- start 2023-06-10T18:54:11.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.868+0000 7ff1c7a2b640 1 -- start start 2023-06-10T18:54:11.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.872+0000 7ff1c7a2b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1ac003980 0x7ff1c00acb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:11.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.872+0000 7ff1c7a2b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1c00c9190 0x7ff1c01536c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:11.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.872+0000 7ff1c7a2b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1c00c9600 0x7ff1c00cc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:11.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.872+0000 7ff1c7a2b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c00cc530 con 0x7ff1ac003980 2023-06-10T18:54:11.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.872+0000 7ff1c7a2b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c00ad400 con 0x7ff1c00c9190 2023-06-10T18:54:11.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.872+0000 7ff1c7a2b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c00cbee0 con 0x7ff1c00c9600 2023-06-10T18:54:11.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.872+0000 7ff1c57c7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1ac003980 0x7ff1c00acb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:11.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.872+0000 7ff1c57c7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1ac003980 0x7ff1c00acb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48036/0 (socket says 172.21.15.53:48036) 2023-06-10T18:54:11.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.872+0000 7ff1c57c7640 1 -- 172.21.15.53:0/356602603 learned_addr learned my addr 172.21.15.53:0/356602603 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:54:11.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.872+0000 7ff1c4fc6640 1 --2- 172.21.15.53:0/356602603 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1c00c9190 0x7ff1c01536c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:11.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.872+0000 7ff1c5fc8640 1 --2- 172.21.15.53:0/356602603 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1c00c9600 0x7ff1c00cc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:11.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.872+0000 7ff1c57c7640 1 -- 172.21.15.53:0/356602603 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1c00c9600 msgr2=0x7ff1c00cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:11.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.872+0000 7ff1c57c7640 1 --2- 172.21.15.53:0/356602603 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1c00c9600 0x7ff1c00cc9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:11.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.872+0000 7ff1c57c7640 1 -- 172.21.15.53:0/356602603 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1c00c9190 msgr2=0x7ff1c01536c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:11.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.872+0000 7ff1c57c7640 1 --2- 172.21.15.53:0/356602603 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1c00c9190 0x7ff1c01536c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:11.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.872+0000 7ff1c57c7640 1 -- 172.21.15.53:0/356602603 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1c00cc1c0 con 0x7ff1ac003980 2023-06-10T18:54:11.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.872+0000 7ff1c4fc6640 1 --2- 172.21.15.53:0/356602603 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1c00c9190 0x7ff1c01536c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:54:11.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.872+0000 7ff1c57c7640 1 --2- 172.21.15.53:0/356602603 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1ac003980 0x7ff1c00acb40 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc01c9f0 tx=0x7ff1ac005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:11.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.872+0000 7ff1b5ffb640 1 -- 172.21.15.53:0/356602603 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc0b4070 con 0x7ff1ac003980 2023-06-10T18:54:11.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.872+0000 7ff1b5ffb640 1 -- 172.21.15.53:0/356602603 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1bc001480 con 0x7ff1ac003980 2023-06-10T18:54:11.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.872+0000 7ff1b5ffb640 1 -- 172.21.15.53:0/356602603 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc0a5aa0 con 0x7ff1ac003980 2023-06-10T18:54:11.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.872+0000 7ff1c7a2b640 1 -- 172.21.15.53:0/356602603 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1c00ad6e0 con 0x7ff1ac003980 2023-06-10T18:54:11.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.872+0000 7ff1c7a2b640 1 -- 172.21.15.53:0/356602603 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1c0153c00 con 0x7ff1ac003980 2023-06-10T18:54:11.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.872+0000 7ff1c7a2b640 1 -- 172.21.15.53:0/356602603 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1c00b1a10 con 0x7ff1ac003980 2023-06-10T18:54:11.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.872+0000 7ff1b5ffb640 1 -- 172.21.15.53:0/356602603 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff1bc0a5c00 con 0x7ff1ac003980 2023-06-10T18:54:11.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.872+0000 7ff1b5ffb640 1 --2- 172.21.15.53:0/356602603 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff1a40662b0 0x7ff1a4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:11.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.872+0000 7ff1b5ffb640 1 -- 172.21.15.53:0/356602603 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff1bc11d810 con 0x7ff1ac003980 2023-06-10T18:54:11.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.872+0000 7ff1c4fc6640 1 --2- 172.21.15.53:0/356602603 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff1a40662b0 0x7ff1a4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:11.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.872+0000 7ff1c4fc6640 1 --2- 172.21.15.53:0/356602603 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff1a40662b0 0x7ff1a4068760 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff1c0153670 tx=0x7ff1b0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:11.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:11.876+0000 7ff1b5ffb640 1 -- 172.21.15.53:0/356602603 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff1bc0eac80 con 0x7ff1ac003980 2023-06-10T18:54:12.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.028+0000 7ff1c7a2b640 1 -- 172.21.15.53:0/356602603 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff1c015fb30 con 0x7ff1ac003980 2023-06-10T18:54:12.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.028+0000 7ff1b5ffb640 1 -- 172.21.15.53:0/356602603 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v37) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff1c015fb30 con 0x7ff1ac003980 2023-06-10T18:54:12.039 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-06-10T18:54:12.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.032+0000 7ff1c7a2b640 1 -- 172.21.15.53:0/356602603 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff1a40662b0 msgr2=0x7ff1a4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:12.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.032+0000 7ff1c7a2b640 1 --2- 172.21.15.53:0/356602603 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff1a40662b0 0x7ff1a4068760 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff1c0153670 tx=0x7ff1b0009040 comp rx=0 tx=0).stop 2023-06-10T18:54:12.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.032+0000 7ff1c7a2b640 1 -- 172.21.15.53:0/356602603 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1ac003980 msgr2=0x7ff1c00acb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:12.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.032+0000 7ff1c7a2b640 1 --2- 172.21.15.53:0/356602603 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1ac003980 0x7ff1c00acb40 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc01c9f0 tx=0x7ff1ac005800 comp rx=0 tx=0).stop 2023-06-10T18:54:12.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.032+0000 7ff1c7a2b640 1 -- 172.21.15.53:0/356602603 shutdown_connections 2023-06-10T18:54:12.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.032+0000 7ff1c7a2b640 1 --2- 172.21.15.53:0/356602603 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff1a40662b0 0x7ff1a4068760 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:12.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.032+0000 7ff1c7a2b640 1 --2- 172.21.15.53:0/356602603 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1c00c9600 0x7ff1c00cc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:12.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.032+0000 7ff1c7a2b640 1 --2- 172.21.15.53:0/356602603 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1c00c9190 0x7ff1c01536c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:12.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.032+0000 7ff1c7a2b640 1 --2- 172.21.15.53:0/356602603 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1ac003980 0x7ff1c00acb40 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:12.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.032+0000 7ff1c7a2b640 1 -- 172.21.15.53:0/356602603 >> 172.21.15.53:0/356602603 conn(0x7ff1c006a090 msgr2=0x7ff1c00b0890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:54:12.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.032+0000 7ff1c7a2b640 1 -- 172.21.15.53:0/356602603 shutdown_connections 2023-06-10T18:54:12.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.032+0000 7ff1c7a2b640 1 -- 172.21.15.53:0/356602603 wait complete. 2023-06-10T18:54:12.057 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-10T18:54:12.180 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.172+0000 7f87caf9c640 1 Processor -- start 2023-06-10T18:54:12.180 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.172+0000 7f87caf9c640 1 -- start start 2023-06-10T18:54:12.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.172+0000 7f87caf9c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f87c40c9fa0 0x7f87c406bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:12.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.172+0000 7f87caf9c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87c406c020 0x7f87c40c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:12.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.172+0000 7f87caf9c640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87c406b090 con 0x7f87c40c87e0 2023-06-10T18:54:12.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.172+0000 7f87caf9c640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87c40ca370 con 0x7f87c40c9fa0 2023-06-10T18:54:12.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.172+0000 7f87caf9c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87c4070d50 con 0x7f87c406c020 2023-06-10T18:54:12.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.172+0000 7f87c9539640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f87c40c87e0 0x7f87c40af760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:58104/0 (socket says 172.21.15.53:58104) 2023-06-10T18:54:12.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.172+0000 7f87c9539640 1 -- 172.21.15.53:0/1359916982 learned_addr learned my addr 172.21.15.53:0/1359916982 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:54:12.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.172+0000 7f87c3fff640 1 --2- 172.21.15.53:0/1359916982 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87c406c020 0x7f87c40c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:12.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.172+0000 7f87c8d38640 1 --2- 172.21.15.53:0/1359916982 >> v2:172.21.15.117:3300/0 conn(0x7f87c40c9fa0 0x7f87c406bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:12.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.172+0000 7f87c37fe640 1 -- 172.21.15.53:0/1359916982 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1323245617 0 0) 0x7f87c406b090 con 0x7f87c40c87e0 2023-06-10T18:54:12.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.172+0000 7f87c37fe640 1 -- 172.21.15.53:0/1359916982 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87ac003530 con 0x7f87c40c87e0 2023-06-10T18:54:12.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.172+0000 7f87c37fe640 1 -- 172.21.15.53:0/1359916982 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3035396300 0 0) 0x7f87ac003530 con 0x7f87c40c87e0 2023-06-10T18:54:12.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.172+0000 7f87c37fe640 1 -- 172.21.15.53:0/1359916982 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87c406c020 msgr2=0x7f87c40c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:54:12.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.172+0000 7f87c37fe640 1 --2- 172.21.15.53:0/1359916982 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87c406c020 0x7f87c40c82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:12.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.172+0000 7f87c37fe640 1 -- 172.21.15.53:0/1359916982 >> v2:172.21.15.117:3300/0 conn(0x7f87c40c9fa0 msgr2=0x7f87c406bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:54:12.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.172+0000 7f87c37fe640 1 --2- 172.21.15.53:0/1359916982 >> v2:172.21.15.117:3300/0 conn(0x7f87c40c9fa0 0x7f87c406bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:12.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.172+0000 7f87c37fe640 1 -- 172.21.15.53:0/1359916982 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87c4071030 con 0x7f87c40c87e0 2023-06-10T18:54:12.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.172+0000 7f87c37fe640 1 -- 172.21.15.53:0/1359916982 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f87bc001a00 con 0x7f87c40c87e0 2023-06-10T18:54:12.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.172+0000 7f87c37fe640 1 -- 172.21.15.53:0/1359916982 >> v1:172.21.15.53:6789/0 conn(0x7f87c40c87e0 legacy=0x7f87c40af760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:12.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.172+0000 7f87c37fe640 1 --2- 172.21.15.53:0/1359916982 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87c406c020 0x7f87ac003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:12.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.172+0000 7f87c37fe640 1 --2- 172.21.15.53:0/1359916982 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87ac003f50 0x7f87ac0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:12.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.172+0000 7f87c37fe640 1 --2- 172.21.15.53:0/1359916982 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87ac004d10 0x7f87ac005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:12.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.172+0000 7f87c37fe640 1 -- 172.21.15.53:0/1359916982 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c40ca370 con 0x7f87ac003f50 2023-06-10T18:54:12.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.172+0000 7f87c37fe640 1 -- 172.21.15.53:0/1359916982 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c4070d50 con 0x7f87ac004d10 2023-06-10T18:54:12.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.172+0000 7f87c37fe640 1 -- 172.21.15.53:0/1359916982 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87ac00fe20 con 0x7f87c406c020 2023-06-10T18:54:12.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.172+0000 7f87c3fff640 1 --2- 172.21.15.53:0/1359916982 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87ac003f50 0x7f87ac0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:12.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.172+0000 7f87c9539640 1 --2- 172.21.15.53:0/1359916982 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87ac004d10 0x7f87ac005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:12.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.172+0000 7f87c8d38640 1 --2- 172.21.15.53:0/1359916982 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87c406c020 0x7f87ac003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:12.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.172+0000 7f87c3fff640 1 -- 172.21.15.53:0/1359916982 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87c406c020 msgr2=0x7f87ac003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:54:12.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.172+0000 7f87c3fff640 1 --2- 172.21.15.53:0/1359916982 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87c406c020 0x7f87ac003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:12.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.172+0000 7f87c3fff640 1 -- 172.21.15.53:0/1359916982 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87ac004d10 msgr2=0x7f87ac005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:54:12.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.172+0000 7f87c3fff640 1 --2- 172.21.15.53:0/1359916982 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87ac004d10 0x7f87ac005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:12.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.172+0000 7f87c3fff640 1 -- 172.21.15.53:0/1359916982 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87ac003530 con 0x7f87ac003f50 2023-06-10T18:54:12.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.172+0000 7f87c8d38640 1 --2- 172.21.15.53:0/1359916982 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87c406c020 0x7f87ac003980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:54:12.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.176+0000 7f87c3fff640 1 --2- 172.21.15.53:0/1359916982 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87ac003f50 0x7f87ac0047d0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f87b8009ae0 tx=0x7f87b801ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=403fed83c9063b03 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:12.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.176+0000 7f87c37fe640 1 -- 172.21.15.53:0/1359916982 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b80a6510 con 0x7f87ac003f50 2023-06-10T18:54:12.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.176+0000 7f87c37fe640 1 -- 172.21.15.53:0/1359916982 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87b80a6670 con 0x7f87ac003f50 2023-06-10T18:54:12.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.176+0000 7f87c37fe640 1 -- 172.21.15.53:0/1359916982 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b80a6a20 con 0x7f87ac003f50 2023-06-10T18:54:12.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.176+0000 7f87caf9c640 1 -- 172.21.15.53:0/1359916982 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87ac003f50 msgr2=0x7f87ac0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:12.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.176+0000 7f87caf9c640 1 --2- 172.21.15.53:0/1359916982 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87ac003f50 0x7f87ac0047d0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f87b8009ae0 tx=0x7f87b801ca20 comp rx=0 tx=0).stop 2023-06-10T18:54:12.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.176+0000 7f87c9539640 1 -- 172.21.15.53:0/1359916982 reap_dead start 2023-06-10T18:54:12.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.176+0000 7f87caf9c640 1 -- 172.21.15.53:0/1359916982 shutdown_connections 2023-06-10T18:54:12.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.176+0000 7f87caf9c640 1 -- 172.21.15.53:0/1359916982 >> 172.21.15.53:0/1359916982 conn(0x7f87c406a0e0 msgr2=0x7f87c40cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:54:12.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.176+0000 7f87caf9c640 1 -- 172.21.15.53:0/1359916982 shutdown_connections 2023-06-10T18:54:12.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.176+0000 7f87caf9c640 1 -- 172.21.15.53:0/1359916982 wait complete. 2023-06-10T18:54:12.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.176+0000 7f87caf9c640 1 Processor -- start 2023-06-10T18:54:12.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.176+0000 7f87caf9c640 1 -- start start 2023-06-10T18:54:12.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.180+0000 7f87caf9c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87ac003f50 0x7f87c4148fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:12.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.180+0000 7f87caf9c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87c40c6310 0x7f87c40c6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:12.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.180+0000 7f87caf9c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87c40aab10 0x7f87c40aaf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:12.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.180+0000 7f87caf9c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c41574b0 con 0x7f87c40c6310 2023-06-10T18:54:12.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.180+0000 7f87caf9c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c40c6cc0 con 0x7f87ac003f50 2023-06-10T18:54:12.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.180+0000 7f87caf9c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87c4149510 con 0x7f87c40aab10 2023-06-10T18:54:12.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.180+0000 7f87c3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87c40c6310 0x7f87c40c6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:12.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.180+0000 7f87c3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87c40c6310 0x7f87c40c6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48056/0 (socket says 172.21.15.53:48056) 2023-06-10T18:54:12.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.180+0000 7f87c3fff640 1 -- 172.21.15.53:0/3475758333 learned_addr learned my addr 172.21.15.53:0/3475758333 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:54:12.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.180+0000 7f87c8d38640 1 --2- 172.21.15.53:0/3475758333 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87ac003f50 0x7f87c4148fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:12.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.180+0000 7f87c9539640 1 --2- 172.21.15.53:0/3475758333 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87c40aab10 0x7f87c40aaf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:12.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.180+0000 7f87c3fff640 1 -- 172.21.15.53:0/3475758333 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87c40aab10 msgr2=0x7f87c40aaf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:12.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.180+0000 7f87c3fff640 1 --2- 172.21.15.53:0/3475758333 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87c40aab10 0x7f87c40aaf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:12.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.180+0000 7f87c3fff640 1 -- 172.21.15.53:0/3475758333 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87ac003f50 msgr2=0x7f87c4148fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:12.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.180+0000 7f87c3fff640 1 --2- 172.21.15.53:0/3475758333 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87ac003f50 0x7f87c4148fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:12.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.180+0000 7f87c3fff640 1 -- 172.21.15.53:0/3475758333 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87c40ab4c0 con 0x7f87c40c6310 2023-06-10T18:54:12.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.180+0000 7f87c3fff640 1 --2- 172.21.15.53:0/3475758333 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87c40c6310 0x7f87c40c6780 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f87b801c850 tx=0x7f87ac005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:12.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.180+0000 7f87c17fa640 1 -- 172.21.15.53:0/3475758333 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b80a67e0 con 0x7f87c40c6310 2023-06-10T18:54:12.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.180+0000 7f87c17fa640 1 -- 172.21.15.53:0/3475758333 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87b80a6940 con 0x7f87c40c6310 2023-06-10T18:54:12.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.180+0000 7f87caf9c640 1 -- 172.21.15.53:0/3475758333 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87c41f0b60 con 0x7f87c40c6310 2023-06-10T18:54:12.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.180+0000 7f87c17fa640 1 -- 172.21.15.53:0/3475758333 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b80a6cd0 con 0x7f87c40c6310 2023-06-10T18:54:12.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.180+0000 7f87caf9c640 1 -- 172.21.15.53:0/3475758333 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87c41f1120 con 0x7f87c40c6310 2023-06-10T18:54:12.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.180+0000 7f87caf9c640 1 -- 172.21.15.53:0/3475758333 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87c404d790 con 0x7f87c40c6310 2023-06-10T18:54:12.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.180+0000 7f87c17fa640 1 -- 172.21.15.53:0/3475758333 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f87b8006000 con 0x7f87c40c6310 2023-06-10T18:54:12.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.180+0000 7f87c17fa640 1 --2- 172.21.15.53:0/3475758333 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f87b0066280 0x7f87b0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:12.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.180+0000 7f87c17fa640 1 -- 172.21.15.53:0/3475758333 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f87b80aa070 con 0x7f87c40c6310 2023-06-10T18:54:12.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.180+0000 7f87c8d38640 1 --2- 172.21.15.53:0/3475758333 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f87b0066280 0x7f87b0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:12.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.184+0000 7f87c8d38640 1 --2- 172.21.15.53:0/3475758333 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f87b0066280 0x7f87b0068730 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f87b4009b40 tx=0x7f87b4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:12.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.184+0000 7f87c17fa640 1 -- 172.21.15.53:0/3475758333 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f87b80ec0b0 con 0x7f87c40c6310 2023-06-10T18:54:12.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.336+0000 7f87caf9c640 1 -- 172.21.15.53:0/3475758333 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f87c40ce670 con 0x7f87c40c6310 2023-06-10T18:54:12.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.340+0000 7f87c17fa640 1 -- 172.21.15.53:0/3475758333 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v37) v1 ==== 100+0+11 (secure 0 0 0) 0x7f87b80ef6d0 con 0x7f87c40c6310 2023-06-10T18:54:12.348 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-06-10T18:54:12.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.340+0000 7f87caf9c640 1 -- 172.21.15.53:0/3475758333 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f87b0066280 msgr2=0x7f87b0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:12.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.340+0000 7f87caf9c640 1 --2- 172.21.15.53:0/3475758333 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f87b0066280 0x7f87b0068730 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f87b4009b40 tx=0x7f87b4008040 comp rx=0 tx=0).stop 2023-06-10T18:54:12.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.340+0000 7f87caf9c640 1 -- 172.21.15.53:0/3475758333 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87c40c6310 msgr2=0x7f87c40c6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:12.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.340+0000 7f87caf9c640 1 --2- 172.21.15.53:0/3475758333 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87c40c6310 0x7f87c40c6780 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f87b801c850 tx=0x7f87ac005800 comp rx=0 tx=0).stop 2023-06-10T18:54:12.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.340+0000 7f87caf9c640 1 -- 172.21.15.53:0/3475758333 shutdown_connections 2023-06-10T18:54:12.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.340+0000 7f87caf9c640 1 --2- 172.21.15.53:0/3475758333 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f87b0066280 0x7f87b0068730 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:12.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.340+0000 7f87caf9c640 1 --2- 172.21.15.53:0/3475758333 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87c40aab10 0x7f87c40aaf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:12.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.340+0000 7f87caf9c640 1 --2- 172.21.15.53:0/3475758333 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87c40c6310 0x7f87c40c6780 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:12.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.340+0000 7f87caf9c640 1 --2- 172.21.15.53:0/3475758333 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87ac003f50 0x7f87c4148fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:12.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.340+0000 7f87caf9c640 1 -- 172.21.15.53:0/3475758333 >> 172.21.15.53:0/3475758333 conn(0x7f87c406a0e0 msgr2=0x7f87c40b3530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:54:12.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.340+0000 7f87caf9c640 1 -- 172.21.15.53:0/3475758333 shutdown_connections 2023-06-10T18:54:12.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.340+0000 7f87caf9c640 1 -- 172.21.15.53:0/3475758333 wait complete. 2023-06-10T18:54:12.367 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-10T18:54:12.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.484+0000 7fa1ea671640 1 Processor -- start 2023-06-10T18:54:12.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.484+0000 7fa1ea671640 1 -- start start 2023-06-10T18:54:12.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.488+0000 7fa1ea671640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1e4070100 0x7fa1e40af7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:12.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.488+0000 7fa1ea671640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa1e40afd10 0x7fa1e40c83f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:12.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.488+0000 7fa1ea671640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1e4071190 con 0x7fa1e41571a0 2023-06-10T18:54:12.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.488+0000 7fa1ea671640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1e40b0190 con 0x7fa1e40afd10 2023-06-10T18:54:12.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.488+0000 7fa1ea671640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1e4070580 con 0x7fa1e4070100 2023-06-10T18:54:12.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.488+0000 7fa1e8c0e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa1e40afd10 0x7fa1e40c83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:12.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.488+0000 7fa1e37fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1e4070100 0x7fa1e40af7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:12.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.488+0000 7fa1e8c0e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa1e40afd10 0x7fa1e40c83f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.53:43036/0 (socket says 172.21.15.53:43036) 2023-06-10T18:54:12.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.488+0000 7fa1e8c0e640 1 -- 172.21.15.53:0/4086065235 learned_addr learned my addr 172.21.15.53:0/4086065235 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:54:12.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.488+0000 7fa1e3fff640 1 --1- 172.21.15.53:0/4086065235 >> v1:172.21.15.117:6789/0 conn(0x7fa1e41571a0 0x7fa1e40c9f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.53:46048/0 (socket says 172.21.15.53:46048) 2023-06-10T18:54:12.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.488+0000 7fa1e37fe640 1 -- 172.21.15.53:0/4086065235 >> v2:172.21.15.117:3300/0 conn(0x7fa1e40afd10 msgr2=0x7fa1e40c83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:54:12.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.488+0000 7fa1e37fe640 1 --2- 172.21.15.53:0/4086065235 >> v2:172.21.15.117:3300/0 conn(0x7fa1e40afd10 0x7fa1e40c83f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:12.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.488+0000 7fa1e37fe640 1 -- 172.21.15.53:0/4086065235 >> v1:172.21.15.117:6789/0 conn(0x7fa1e41571a0 legacy=0x7fa1e40c9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:12.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.488+0000 7fa1e37fe640 1 -- 172.21.15.53:0/4086065235 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1e4070860 con 0x7fa1e4070100 2023-06-10T18:54:12.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.492+0000 7fa1e37fe640 1 --2- 172.21.15.53:0/4086065235 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1e4070100 0x7fa1e40af7d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc0097c0 tx=0x7fa1cc01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99a6dbdcccc00e09 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:12.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.492+0000 7fa1e2ffd640 1 -- 172.21.15.53:0/4086065235 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1cc0ab650 con 0x7fa1e4070100 2023-06-10T18:54:12.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.492+0000 7fa1e2ffd640 1 -- 172.21.15.53:0/4086065235 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1cc0ab7b0 con 0x7fa1e4070100 2023-06-10T18:54:12.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.492+0000 7fa1e2ffd640 1 -- 172.21.15.53:0/4086065235 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1cc0abb40 con 0x7fa1e4070100 2023-06-10T18:54:12.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.492+0000 7fa1ea671640 1 -- 172.21.15.53:0/4086065235 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1e4070100 msgr2=0x7fa1e40af7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:12.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.492+0000 7fa1ea671640 1 --2- 172.21.15.53:0/4086065235 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1e4070100 0x7fa1e40af7d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc0097c0 tx=0x7fa1cc01c450 comp rx=0 tx=0).stop 2023-06-10T18:54:12.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.492+0000 7fa1ea671640 1 -- 172.21.15.53:0/4086065235 shutdown_connections 2023-06-10T18:54:12.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.492+0000 7fa1ea671640 1 --2- 172.21.15.53:0/4086065235 >> v2:172.21.15.117:3300/0 conn(0x7fa1e40afd10 0x7fa1e40c83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:12.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.492+0000 7fa1ea671640 1 --2- 172.21.15.53:0/4086065235 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1e4070100 0x7fa1e40af7d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:12.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.492+0000 7fa1ea671640 1 -- 172.21.15.53:0/4086065235 >> 172.21.15.53:0/4086065235 conn(0x7fa1e40ce9e0 msgr2=0x7fa1e40ca7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:54:12.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.492+0000 7fa1ea671640 1 -- 172.21.15.53:0/4086065235 shutdown_connections 2023-06-10T18:54:12.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.492+0000 7fa1ea671640 1 -- 172.21.15.53:0/4086065235 wait complete. 2023-06-10T18:54:12.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.492+0000 7fa1ea671640 1 Processor -- start 2023-06-10T18:54:12.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.492+0000 7fa1ea671640 1 -- start start 2023-06-10T18:54:12.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.492+0000 7fa1ea671640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1e40afd10 0x7fa1e41552a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:12.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.492+0000 7fa1ea671640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1e41571a0 0x7fa1e40c17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:12.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.492+0000 7fa1ea671640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1e41557e0 0x7fa1e40b2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:12.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.492+0000 7fa1ea671640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1e4155c80 con 0x7fa1e41571a0 2023-06-10T18:54:12.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.492+0000 7fa1ea671640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1e40b1e70 con 0x7fa1e40afd10 2023-06-10T18:54:12.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.492+0000 7fa1ea671640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1e40b2150 con 0x7fa1e41557e0 2023-06-10T18:54:12.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.492+0000 7fa1e37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1e41571a0 0x7fa1e40c17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:12.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.492+0000 7fa1e37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1e41571a0 0x7fa1e40c17f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48058/0 (socket says 172.21.15.53:48058) 2023-06-10T18:54:12.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.492+0000 7fa1e37fe640 1 -- 172.21.15.53:0/3885192297 learned_addr learned my addr 172.21.15.53:0/3885192297 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:54:12.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.492+0000 7fa1e8c0e640 1 --2- 172.21.15.53:0/3885192297 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1e41557e0 0x7fa1e40b2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:12.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.492+0000 7fa1e3fff640 1 --2- 172.21.15.53:0/3885192297 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1e40afd10 0x7fa1e41552a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:12.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.492+0000 7fa1e37fe640 1 -- 172.21.15.53:0/3885192297 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1e41557e0 msgr2=0x7fa1e40b2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:12.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.492+0000 7fa1e37fe640 1 --2- 172.21.15.53:0/3885192297 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1e41557e0 0x7fa1e40b2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:12.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.492+0000 7fa1e37fe640 1 -- 172.21.15.53:0/3885192297 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1e40afd10 msgr2=0x7fa1e41552a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:12.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.492+0000 7fa1e37fe640 1 --2- 172.21.15.53:0/3885192297 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1e40afd10 0x7fa1e41552a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:12.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.496+0000 7fa1e37fe640 1 -- 172.21.15.53:0/3885192297 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1cc009420 con 0x7fa1e41571a0 2023-06-10T18:54:12.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.496+0000 7fa1e37fe640 1 --2- 172.21.15.53:0/3885192297 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1e41571a0 0x7fa1e40c17f0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc0ad040 tx=0x7fa1cc01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:12.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.496+0000 7fa1e0ff9640 1 -- 172.21.15.53:0/3885192297 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1cc0b5810 con 0x7fa1e41571a0 2023-06-10T18:54:12.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.496+0000 7fa1e0ff9640 1 -- 172.21.15.53:0/3885192297 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1cc0b5990 con 0x7fa1e41571a0 2023-06-10T18:54:12.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.496+0000 7fa1ea671640 1 -- 172.21.15.53:0/3885192297 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1e40b2430 con 0x7fa1e41571a0 2023-06-10T18:54:12.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.496+0000 7fa1e0ff9640 1 -- 172.21.15.53:0/3885192297 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1cc0b5d40 con 0x7fa1e41571a0 2023-06-10T18:54:12.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.496+0000 7fa1ea671640 1 -- 172.21.15.53:0/3885192297 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1e4154e20 con 0x7fa1e41571a0 2023-06-10T18:54:12.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.496+0000 7fa1ea671640 1 -- 172.21.15.53:0/3885192297 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1e404d790 con 0x7fa1e41571a0 2023-06-10T18:54:12.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.496+0000 7fa1e0ff9640 1 -- 172.21.15.53:0/3885192297 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa1cc0bf410 con 0x7fa1e41571a0 2023-06-10T18:54:12.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.496+0000 7fa1e0ff9640 1 --2- 172.21.15.53:0/3885192297 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa1c4066280 0x7fa1c4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:12.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.496+0000 7fa1e0ff9640 1 -- 172.21.15.53:0/3885192297 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa1cc11e7c0 con 0x7fa1e41571a0 2023-06-10T18:54:12.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.496+0000 7fa1e3fff640 1 --2- 172.21.15.53:0/3885192297 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa1c4066280 0x7fa1c4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:12.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.496+0000 7fa1e3fff640 1 --2- 172.21.15.53:0/3885192297 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa1c4066280 0x7fa1c4068730 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc001340 tx=0x7fa1dc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:12.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.500+0000 7fa1e0ff9640 1 -- 172.21.15.53:0/3885192297 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa1cc0ebc40 con 0x7fa1e41571a0 2023-06-10T18:54:12.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.668+0000 7fa1ea671640 1 -- 172.21.15.53:0/3885192297 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa1e40ccff0 con 0x7fa1e41571a0 2023-06-10T18:54:12.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.668+0000 7fa1e0ff9640 1 -- 172.21.15.53:0/3885192297 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v37) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa1cc0ef260 con 0x7fa1e41571a0 2023-06-10T18:54:12.678 INFO:teuthology.orchestra.run.smithi053.stderr:listed 0 entries 2023-06-10T18:54:12.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.672+0000 7fa1ea671640 1 -- 172.21.15.53:0/3885192297 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa1c4066280 msgr2=0x7fa1c4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:12.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.672+0000 7fa1ea671640 1 --2- 172.21.15.53:0/3885192297 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa1c4066280 0x7fa1c4068730 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc001340 tx=0x7fa1dc009040 comp rx=0 tx=0).stop 2023-06-10T18:54:12.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.672+0000 7fa1ea671640 1 -- 172.21.15.53:0/3885192297 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1e41571a0 msgr2=0x7fa1e40c17f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:12.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.672+0000 7fa1ea671640 1 --2- 172.21.15.53:0/3885192297 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1e41571a0 0x7fa1e40c17f0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc0ad040 tx=0x7fa1cc01ac90 comp rx=0 tx=0).stop 2023-06-10T18:54:12.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.672+0000 7fa1ea671640 1 -- 172.21.15.53:0/3885192297 shutdown_connections 2023-06-10T18:54:12.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.672+0000 7fa1ea671640 1 --2- 172.21.15.53:0/3885192297 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa1c4066280 0x7fa1c4068730 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:12.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.672+0000 7fa1ea671640 1 --2- 172.21.15.53:0/3885192297 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1e41557e0 0x7fa1e40b2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:12.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.672+0000 7fa1ea671640 1 --2- 172.21.15.53:0/3885192297 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1e41571a0 0x7fa1e40c17f0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:12.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.672+0000 7fa1ea671640 1 --2- 172.21.15.53:0/3885192297 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1e40afd10 0x7fa1e41552a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:12.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.672+0000 7fa1ea671640 1 -- 172.21.15.53:0/3885192297 >> 172.21.15.53:0/3885192297 conn(0x7fa1e40ce9e0 msgr2=0x7fa1e40aecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:54:12.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.672+0000 7fa1ea671640 1 -- 172.21.15.53:0/3885192297 shutdown_connections 2023-06-10T18:54:12.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.672+0000 7fa1ea671640 1 -- 172.21.15.53:0/3885192297 wait complete. 2023-06-10T18:54:12.698 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T18:54:12.700 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T18:54:12.714 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T18:54:12.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.872+0000 7f64df06f640 1 Processor -- start 2023-06-10T18:54:12.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.872+0000 7f64df06f640 1 -- start start 2023-06-10T18:54:12.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.872+0000 7f64df06f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f64d806b780 0x7f64d815c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:12.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.872+0000 7f64df06f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64d806bb50 0x7f64d815f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:12.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.872+0000 7f64df06f640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f64d815f860 0x7f64d80ceb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:12.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.872+0000 7f64df06f640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64d815c3d0 con 0x7f64d806b780 2023-06-10T18:54:12.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.872+0000 7f64df06f640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64d80af530 con 0x7f64d815f860 2023-06-10T18:54:12.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.872+0000 7f64df06f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64d815fd70 con 0x7f64d806bb50 2023-06-10T18:54:12.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.872+0000 7f64dce0b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f64d806b780 0x7f64d815c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:12.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.872+0000 7f64dce0b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f64d806b780 0x7f64d815c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48060/0 (socket says 172.21.15.53:48060) 2023-06-10T18:54:12.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.872+0000 7f64dce0b640 1 -- 172.21.15.53:0/1675274474 learned_addr learned my addr 172.21.15.53:0/1675274474 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:54:12.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.872+0000 7f64d7fff640 1 --2- 172.21.15.53:0/1675274474 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64d806bb50 0x7f64d815f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:12.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.872+0000 7f64dd60c640 1 --2- 172.21.15.53:0/1675274474 >> v2:172.21.15.117:3300/0 conn(0x7f64d815f860 0x7f64d80ceb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:12.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.872+0000 7f64dce0b640 1 -- 172.21.15.53:0/1675274474 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64d806bb50 msgr2=0x7f64d815f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:54:12.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.872+0000 7f64dce0b640 1 --2- 172.21.15.53:0/1675274474 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64d806bb50 0x7f64d815f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:12.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.872+0000 7f64dce0b640 1 -- 172.21.15.53:0/1675274474 >> v2:172.21.15.117:3300/0 conn(0x7f64d815f860 msgr2=0x7f64d80ceb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:54:12.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.872+0000 7f64dce0b640 1 --2- 172.21.15.53:0/1675274474 >> v2:172.21.15.117:3300/0 conn(0x7f64d815f860 0x7f64d80ceb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:12.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.872+0000 7f64dce0b640 1 -- 172.21.15.53:0/1675274474 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64d8160050 con 0x7f64d806b780 2023-06-10T18:54:12.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.872+0000 7f64d7fff640 1 --2- 172.21.15.53:0/1675274474 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64d806bb50 0x7f64d815f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:54:12.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.876+0000 7f64dce0b640 1 --2- 172.21.15.53:0/1675274474 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64d806b780 0x7f64d815c7f0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f64d80c38d0 tx=0x7f64c801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80f6e59e1ee08980 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:12.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.876+0000 7f64d77fe640 1 -- 172.21.15.53:0/1675274474 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c80ad660 con 0x7f64d806b780 2023-06-10T18:54:12.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.876+0000 7f64d77fe640 1 -- 172.21.15.53:0/1675274474 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64c80ad7c0 con 0x7f64d806b780 2023-06-10T18:54:12.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.876+0000 7f64d77fe640 1 -- 172.21.15.53:0/1675274474 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c80adb50 con 0x7f64d806b780 2023-06-10T18:54:12.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.876+0000 7f64df06f640 1 -- 172.21.15.53:0/1675274474 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64d806b780 msgr2=0x7f64d815c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:12.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.876+0000 7f64df06f640 1 --2- 172.21.15.53:0/1675274474 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64d806b780 0x7f64d815c7f0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f64d80c38d0 tx=0x7f64c801c470 comp rx=0 tx=0).stop 2023-06-10T18:54:12.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.876+0000 7f64df06f640 1 -- 172.21.15.53:0/1675274474 shutdown_connections 2023-06-10T18:54:12.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.876+0000 7f64df06f640 1 --2- 172.21.15.53:0/1675274474 >> v2:172.21.15.117:3300/0 conn(0x7f64d815f860 0x7f64d80ceb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:12.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.876+0000 7f64df06f640 1 --2- 172.21.15.53:0/1675274474 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64d806bb50 0x7f64d815f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:12.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.876+0000 7f64df06f640 1 --2- 172.21.15.53:0/1675274474 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64d806b780 0x7f64d815c7f0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:12.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.876+0000 7f64df06f640 1 -- 172.21.15.53:0/1675274474 >> 172.21.15.53:0/1675274474 conn(0x7f64d806a090 msgr2=0x7f64d806d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:54:12.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.876+0000 7f64df06f640 1 -- 172.21.15.53:0/1675274474 shutdown_connections 2023-06-10T18:54:12.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.876+0000 7f64df06f640 1 -- 172.21.15.53:0/1675274474 wait complete. 2023-06-10T18:54:12.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.876+0000 7f64df06f640 1 Processor -- start 2023-06-10T18:54:12.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.880+0000 7f64df06f640 1 -- start start 2023-06-10T18:54:12.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.880+0000 7f64df06f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64d806b780 0x7f64d8141760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:12.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.880+0000 7f64df06f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64d806bb50 0x7f64d80b2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:12.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.880+0000 7f64df06f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64d815f860 0x7f64d8153b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:12.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.880+0000 7f64df06f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d80b4990 con 0x7f64d815f860 2023-06-10T18:54:12.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.880+0000 7f64df06f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d8141cd0 con 0x7f64d806bb50 2023-06-10T18:54:12.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.880+0000 7f64df06f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64d80b31f0 con 0x7f64d806b780 2023-06-10T18:54:12.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.880+0000 7f64dd60c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64d815f860 0x7f64d8153b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:12.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.880+0000 7f64dd60c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64d815f860 0x7f64d8153b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48076/0 (socket says 172.21.15.53:48076) 2023-06-10T18:54:12.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.880+0000 7f64dd60c640 1 -- 172.21.15.53:0/768380354 learned_addr learned my addr 172.21.15.53:0/768380354 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:54:12.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.880+0000 7f64dce0b640 1 --2- 172.21.15.53:0/768380354 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64d806b780 0x7f64d8141760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:12.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.880+0000 7f64d7fff640 1 --2- 172.21.15.53:0/768380354 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64d806bb50 0x7f64d80b2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:12.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.880+0000 7f64dd60c640 1 -- 172.21.15.53:0/768380354 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64d806b780 msgr2=0x7f64d8141760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:12.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.880+0000 7f64dd60c640 1 --2- 172.21.15.53:0/768380354 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64d806b780 0x7f64d8141760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:12.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.880+0000 7f64dd60c640 1 -- 172.21.15.53:0/768380354 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64d806bb50 msgr2=0x7f64d80b2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:12.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.880+0000 7f64dd60c640 1 --2- 172.21.15.53:0/768380354 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64d806bb50 0x7f64d80b2c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:12.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.880+0000 7f64dd60c640 1 -- 172.21.15.53:0/768380354 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64c80094d0 con 0x7f64d815f860 2023-06-10T18:54:12.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.880+0000 7f64d7fff640 1 --2- 172.21.15.53:0/768380354 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64d806bb50 0x7f64d80b2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:54:12.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.880+0000 7f64dd60c640 1 --2- 172.21.15.53:0/768380354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64d815f860 0x7f64d8153b70 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f64d0009fd0 tx=0x7f64d000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:12.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.880+0000 7f64d57fa640 1 -- 172.21.15.53:0/768380354 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d0014420 con 0x7f64d815f860 2023-06-10T18:54:12.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.880+0000 7f64d57fa640 1 -- 172.21.15.53:0/768380354 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64d0014580 con 0x7f64d815f860 2023-06-10T18:54:12.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.880+0000 7f64df06f640 1 -- 172.21.15.53:0/768380354 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64d80b4bf0 con 0x7f64d815f860 2023-06-10T18:54:12.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.880+0000 7f64d57fa640 1 -- 172.21.15.53:0/768380354 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d0014930 con 0x7f64d815f860 2023-06-10T18:54:12.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.880+0000 7f64df06f640 1 -- 172.21.15.53:0/768380354 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64d80b5430 con 0x7f64d815f860 2023-06-10T18:54:12.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.880+0000 7f64df06f640 1 -- 172.21.15.53:0/768380354 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64d804d790 con 0x7f64d815f860 2023-06-10T18:54:12.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.880+0000 7f64d57fa640 1 -- 172.21.15.53:0/768380354 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f64d0014a90 con 0x7f64d815f860 2023-06-10T18:54:12.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.880+0000 7f64d57fa640 1 --2- 172.21.15.53:0/768380354 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f64c4066280 0x7f64c4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:12.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.880+0000 7f64d57fa640 1 -- 172.21.15.53:0/768380354 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f64d00845d0 con 0x7f64d815f860 2023-06-10T18:54:12.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.884+0000 7f64dce0b640 1 --2- 172.21.15.53:0/768380354 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f64c4066280 0x7f64c4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:12.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.884+0000 7f64dce0b640 1 --2- 172.21.15.53:0/768380354 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f64c4066280 0x7f64c4068730 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f64c80af000 tx=0x7f64c8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:12.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:12.888+0000 7f64d57fa640 1 -- 172.21.15.53:0/768380354 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f64d00554e0 con 0x7f64d815f860 2023-06-10T18:54:13.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.040+0000 7f64df06f640 1 -- 172.21.15.53:0/768380354 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f64d806df70 con 0x7f64d815f860 2023-06-10T18:54:13.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.044+0000 7f64d57fa640 1 -- 172.21.15.53:0/768380354 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18339 (secure 0 0 0) 0x7f64d0055070 con 0x7f64d815f860 2023-06-10T18:54:13.052 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:54:13.052 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":37,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T18:53:55.739534+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-06-10T18:53:52.688764+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-06-10T18:53:53.727157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T18:54:13.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.044+0000 7f64df06f640 1 -- 172.21.15.53:0/768380354 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f64c4066280 msgr2=0x7f64c4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:13.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.044+0000 7f64df06f640 1 --2- 172.21.15.53:0/768380354 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f64c4066280 0x7f64c4068730 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f64c80af000 tx=0x7f64c8008040 comp rx=0 tx=0).stop 2023-06-10T18:54:13.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.044+0000 7f64df06f640 1 -- 172.21.15.53:0/768380354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64d815f860 msgr2=0x7f64d8153b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:13.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.044+0000 7f64df06f640 1 --2- 172.21.15.53:0/768380354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64d815f860 0x7f64d8153b70 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f64d0009fd0 tx=0x7f64d000e4b0 comp rx=0 tx=0).stop 2023-06-10T18:54:13.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.044+0000 7f64df06f640 1 -- 172.21.15.53:0/768380354 shutdown_connections 2023-06-10T18:54:13.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.044+0000 7f64df06f640 1 --2- 172.21.15.53:0/768380354 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f64c4066280 0x7f64c4068730 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:13.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.044+0000 7f64df06f640 1 --2- 172.21.15.53:0/768380354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64d815f860 0x7f64d8153b70 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:13.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.044+0000 7f64df06f640 1 --2- 172.21.15.53:0/768380354 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64d806bb50 0x7f64d80b2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:13.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.044+0000 7f64df06f640 1 --2- 172.21.15.53:0/768380354 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64d806b780 0x7f64d8141760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:13.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.044+0000 7f64df06f640 1 -- 172.21.15.53:0/768380354 >> 172.21.15.53:0/768380354 conn(0x7f64d806a090 msgr2=0x7f64d806f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:54:13.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.044+0000 7f64df06f640 1 -- 172.21.15.53:0/768380354 shutdown_connections 2023-06-10T18:54:13.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.044+0000 7f64df06f640 1 -- 172.21.15.53:0/768380354 wait complete. 2023-06-10T18:54:13.072 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-10T18:52:33.633114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-10T18:52:39.171487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-10T18:53:52.688764+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-06-10T18:53:53.727157+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-10T18:54:13.073 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-10T18:54:13.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.200+0000 7f8382f1c640 1 Processor -- start 2023-06-10T18:54:13.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.200+0000 7f8382f1c640 1 -- start start 2023-06-10T18:54:13.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.200+0000 7f8382f1c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f837c0b0f30 0x7f837c070950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:13.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.200+0000 7f8382f1c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f837c159a60 0x7f837c0c2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:13.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.200+0000 7f8382f1c640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f837c0cb080 con 0x7f837c159690 2023-06-10T18:54:13.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.200+0000 7f8382f1c640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f837c070e90 con 0x7f837c0b0f30 2023-06-10T18:54:13.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.200+0000 7f8382f1c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f837c06d450 con 0x7f837c159a60 2023-06-10T18:54:13.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.200+0000 7f8380cb8640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f837c159690 0x7f837c0cbe00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:58118/0 (socket says 172.21.15.53:58118) 2023-06-10T18:54:13.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.200+0000 7f8380cb8640 1 -- 172.21.15.53:0/4174432710 learned_addr learned my addr 172.21.15.53:0/4174432710 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:54:13.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.200+0000 7f83814b9640 1 --2- 172.21.15.53:0/4174432710 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f837c159a60 0x7f837c0c2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:13.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.200+0000 7f837bfff640 1 --2- 172.21.15.53:0/4174432710 >> v2:172.21.15.117:3300/0 conn(0x7f837c0b0f30 0x7f837c070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:13.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.200+0000 7f837b7fe640 1 -- 172.21.15.53:0/4174432710 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4262288298 0 0) 0x7f837c0cb080 con 0x7f837c159690 2023-06-10T18:54:13.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.200+0000 7f837b7fe640 1 -- 172.21.15.53:0/4174432710 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8368003530 con 0x7f837c159690 2023-06-10T18:54:13.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.200+0000 7f837b7fe640 1 -- 172.21.15.53:0/4174432710 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2299545240 0 0) 0x7f8368003530 con 0x7f837c159690 2023-06-10T18:54:13.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.200+0000 7f837b7fe640 1 -- 172.21.15.53:0/4174432710 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f837c159a60 msgr2=0x7f837c0c2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:54:13.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.200+0000 7f837b7fe640 1 --2- 172.21.15.53:0/4174432710 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f837c159a60 0x7f837c0c2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:13.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.200+0000 7f837b7fe640 1 -- 172.21.15.53:0/4174432710 >> v2:172.21.15.117:3300/0 conn(0x7f837c0b0f30 msgr2=0x7f837c070950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:54:13.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.200+0000 7f837b7fe640 1 --2- 172.21.15.53:0/4174432710 >> v2:172.21.15.117:3300/0 conn(0x7f837c0b0f30 0x7f837c070950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:13.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.200+0000 7f837b7fe640 1 -- 172.21.15.53:0/4174432710 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f837c0cb320 con 0x7f837c159690 2023-06-10T18:54:13.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.200+0000 7f837b7fe640 1 -- 172.21.15.53:0/4174432710 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f8374001a00 con 0x7f837c159690 2023-06-10T18:54:13.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.200+0000 7f837b7fe640 1 -- 172.21.15.53:0/4174432710 >> v1:172.21.15.53:6789/0 conn(0x7f837c159690 legacy=0x7f837c0cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:13.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.200+0000 7f837b7fe640 1 --2- 172.21.15.53:0/4174432710 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8368003980 0x7f8368003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:13.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.200+0000 7f837b7fe640 1 --2- 172.21.15.53:0/4174432710 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83680047d0 0x7f8368004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:13.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.200+0000 7f837b7fe640 1 --2- 172.21.15.53:0/4174432710 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f837c159a60 0x7f8368005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:13.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.200+0000 7f837b7fe640 1 -- 172.21.15.53:0/4174432710 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f837c070e90 con 0x7f83680047d0 2023-06-10T18:54:13.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.200+0000 7f837b7fe640 1 -- 172.21.15.53:0/4174432710 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f837c06d450 con 0x7f8368003980 2023-06-10T18:54:13.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.200+0000 7f837b7fe640 1 -- 172.21.15.53:0/4174432710 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f836800b990 con 0x7f837c159a60 2023-06-10T18:54:13.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.200+0000 7f837bfff640 1 --2- 172.21.15.53:0/4174432710 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83680047d0 0x7f8368004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:13.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.200+0000 7f83814b9640 1 --2- 172.21.15.53:0/4174432710 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f837c159a60 0x7f8368005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:13.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.200+0000 7f837bfff640 1 -- 172.21.15.53:0/4174432710 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f837c159a60 msgr2=0x7f8368005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:54:13.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.200+0000 7f837bfff640 1 --2- 172.21.15.53:0/4174432710 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f837c159a60 0x7f8368005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:13.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.200+0000 7f837bfff640 1 -- 172.21.15.53:0/4174432710 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8368003980 msgr2=0x7f8368003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:54:13.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.200+0000 7f837bfff640 1 --2- 172.21.15.53:0/4174432710 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8368003980 0x7f8368003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:13.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.200+0000 7f837bfff640 1 -- 172.21.15.53:0/4174432710 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8368003530 con 0x7f83680047d0 2023-06-10T18:54:13.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.204+0000 7f837bfff640 1 --2- 172.21.15.53:0/4174432710 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83680047d0 0x7f8368004c40 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f8364009670 tx=0x7f8364020ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fa84a6ba4bce479 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:13.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.204+0000 7f837b7fe640 1 -- 172.21.15.53:0/4174432710 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83640a9aa0 con 0x7f83680047d0 2023-06-10T18:54:13.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.204+0000 7f837b7fe640 1 -- 172.21.15.53:0/4174432710 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83640a9c00 con 0x7f83680047d0 2023-06-10T18:54:13.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.204+0000 7f837b7fe640 1 -- 172.21.15.53:0/4174432710 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83640b1440 con 0x7f83680047d0 2023-06-10T18:54:13.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.204+0000 7f8382f1c640 1 -- 172.21.15.53:0/4174432710 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83680047d0 msgr2=0x7f8368004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:13.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.204+0000 7f8382f1c640 1 --2- 172.21.15.53:0/4174432710 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83680047d0 0x7f8368004c40 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f8364009670 tx=0x7f8364020ea0 comp rx=0 tx=0).stop 2023-06-10T18:54:13.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.204+0000 7f83814b9640 1 -- 172.21.15.53:0/4174432710 reap_dead start 2023-06-10T18:54:13.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.204+0000 7f8382f1c640 1 -- 172.21.15.53:0/4174432710 shutdown_connections 2023-06-10T18:54:13.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.204+0000 7f8382f1c640 1 -- 172.21.15.53:0/4174432710 >> 172.21.15.53:0/4174432710 conn(0x7f837c06a560 msgr2=0x7f837c06a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:54:13.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.204+0000 7f8382f1c640 1 -- 172.21.15.53:0/4174432710 shutdown_connections 2023-06-10T18:54:13.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.204+0000 7f8382f1c640 1 -- 172.21.15.53:0/4174432710 wait complete. 2023-06-10T18:54:13.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.204+0000 7f8382f1c640 1 Processor -- start 2023-06-10T18:54:13.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.204+0000 7f8382f1c640 1 -- start start 2023-06-10T18:54:13.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.204+0000 7f8382f1c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83680047d0 0x7f837c14af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:13.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.204+0000 7f8382f1c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f837c154f00 0x7f837c155350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:13.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.204+0000 7f8382f1c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f837c0695a0 0x7f837c069a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:13.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.204+0000 7f8382f1c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f837c06a2d0 con 0x7f837c154f00 2023-06-10T18:54:13.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.204+0000 7f8382f1c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f837c155890 con 0x7f837c0695a0 2023-06-10T18:54:13.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.204+0000 7f8382f1c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f837c152f10 con 0x7f83680047d0 2023-06-10T18:54:13.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.208+0000 7f837bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f837c154f00 0x7f837c155350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:13.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.208+0000 7f837bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f837c154f00 0x7f837c155350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48092/0 (socket says 172.21.15.53:48092) 2023-06-10T18:54:13.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.208+0000 7f837bfff640 1 -- 172.21.15.53:0/3718047005 learned_addr learned my addr 172.21.15.53:0/3718047005 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:54:13.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.208+0000 7f8380cb8640 1 --2- 172.21.15.53:0/3718047005 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83680047d0 0x7f837c14af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:13.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.208+0000 7f83814b9640 1 --2- 172.21.15.53:0/3718047005 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f837c0695a0 0x7f837c069a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:13.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.208+0000 7f837bfff640 1 -- 172.21.15.53:0/3718047005 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83680047d0 msgr2=0x7f837c14af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:13.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.208+0000 7f837bfff640 1 --2- 172.21.15.53:0/3718047005 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83680047d0 0x7f837c14af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:13.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.208+0000 7f837bfff640 1 -- 172.21.15.53:0/3718047005 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f837c0695a0 msgr2=0x7f837c069a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:13.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.208+0000 7f837bfff640 1 --2- 172.21.15.53:0/3718047005 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f837c0695a0 0x7f837c069a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:13.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.208+0000 7f837bfff640 1 -- 172.21.15.53:0/3718047005 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f837c1533a0 con 0x7f837c154f00 2023-06-10T18:54:13.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.208+0000 7f837bfff640 1 --2- 172.21.15.53:0/3718047005 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f837c154f00 0x7f837c155350 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f83640273d0 tx=0x7f8368005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:13.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.208+0000 7f83797fa640 1 -- 172.21.15.53:0/3718047005 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83640c2070 con 0x7f837c154f00 2023-06-10T18:54:13.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.208+0000 7f83797fa640 1 -- 172.21.15.53:0/3718047005 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83640b19c0 con 0x7f837c154f00 2023-06-10T18:54:13.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.208+0000 7f83797fa640 1 -- 172.21.15.53:0/3718047005 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83640b1d70 con 0x7f837c154f00 2023-06-10T18:54:13.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.208+0000 7f8382f1c640 1 -- 172.21.15.53:0/3718047005 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f837c1525e0 con 0x7f837c154f00 2023-06-10T18:54:13.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.208+0000 7f8382f1c640 1 -- 172.21.15.53:0/3718047005 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f837c152ba0 con 0x7f837c154f00 2023-06-10T18:54:13.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.208+0000 7f8382f1c640 1 -- 172.21.15.53:0/3718047005 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f837c152d60 con 0x7f837c154f00 2023-06-10T18:54:13.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.208+0000 7f83797fa640 1 -- 172.21.15.53:0/3718047005 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f83640b8040 con 0x7f837c154f00 2023-06-10T18:54:13.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.208+0000 7f83797fa640 1 --2- 172.21.15.53:0/3718047005 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f835c066280 0x7f835c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:13.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.208+0000 7f83797fa640 1 -- 172.21.15.53:0/3718047005 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8364122410 con 0x7f837c154f00 2023-06-10T18:54:13.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.208+0000 7f8380cb8640 1 --2- 172.21.15.53:0/3718047005 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f835c066280 0x7f835c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:13.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.212+0000 7f8380cb8640 1 --2- 172.21.15.53:0/3718047005 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f835c066280 0x7f835c068730 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f8374004c00 tx=0x7f83740019f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:13.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.212+0000 7f83797fa640 1 -- 172.21.15.53:0/3718047005 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f83640ef920 con 0x7f837c154f00 2023-06-10T18:54:13.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.364+0000 7f8382f1c640 1 -- 172.21.15.53:0/3718047005 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f837c04d790 con 0x7f837c154f00 2023-06-10T18:54:13.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.364+0000 7f83797fa640 1 -- 172.21.15.53:0/3718047005 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) v1 ==== 93+0+10 (secure 0 0 0) 0x7f83640f2f40 con 0x7f837c154f00 2023-06-10T18:54:13.375 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-06-10T18:54:13.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.368+0000 7f8382f1c640 1 -- 172.21.15.53:0/3718047005 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f835c066280 msgr2=0x7f835c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:13.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.368+0000 7f8382f1c640 1 --2- 172.21.15.53:0/3718047005 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f835c066280 0x7f835c068730 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f8374004c00 tx=0x7f83740019f0 comp rx=0 tx=0).stop 2023-06-10T18:54:13.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.368+0000 7f8382f1c640 1 -- 172.21.15.53:0/3718047005 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f837c154f00 msgr2=0x7f837c155350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:13.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.368+0000 7f8382f1c640 1 --2- 172.21.15.53:0/3718047005 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f837c154f00 0x7f837c155350 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f83640273d0 tx=0x7f8368005800 comp rx=0 tx=0).stop 2023-06-10T18:54:13.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.368+0000 7f8382f1c640 1 -- 172.21.15.53:0/3718047005 shutdown_connections 2023-06-10T18:54:13.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.368+0000 7f8382f1c640 1 --2- 172.21.15.53:0/3718047005 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f835c066280 0x7f835c068730 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:13.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.368+0000 7f8382f1c640 1 --2- 172.21.15.53:0/3718047005 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f837c0695a0 0x7f837c069a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:13.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.368+0000 7f8382f1c640 1 --2- 172.21.15.53:0/3718047005 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f837c154f00 0x7f837c155350 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:13.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.368+0000 7f8382f1c640 1 --2- 172.21.15.53:0/3718047005 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83680047d0 0x7f837c14af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:13.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.368+0000 7f8382f1c640 1 -- 172.21.15.53:0/3718047005 >> 172.21.15.53:0/3718047005 conn(0x7f837c06a560 msgr2=0x7f837c153670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:54:13.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.368+0000 7f8382f1c640 1 -- 172.21.15.53:0/3718047005 shutdown_connections 2023-06-10T18:54:13.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.368+0000 7f8382f1c640 1 -- 172.21.15.53:0/3718047005 wait complete. 2023-06-10T18:54:13.394 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-10T18:54:13.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.520+0000 7fdb11910640 1 Processor -- start 2023-06-10T18:54:13.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.520+0000 7fdb11910640 1 -- start start 2023-06-10T18:54:13.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.520+0000 7fdb11910640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fdb0c0c9fa0 0x7fdb0c06bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:13.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.520+0000 7fdb11910640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fdb0c06c020 0x7fdb0c0c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:13.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.520+0000 7fdb11910640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb0c0c87e0 0x7fdb0c0af760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:13.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.520+0000 7fdb11910640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb0c06b090 con 0x7fdb0c0c9fa0 2023-06-10T18:54:13.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.520+0000 7fdb11910640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb0c0ca370 con 0x7fdb0c06c020 2023-06-10T18:54:13.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.520+0000 7fdb11910640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0c070d50 con 0x7fdb0c0c87e0 2023-06-10T18:54:13.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.520+0000 7fdb0affd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fdb0c0c9fa0 0x7fdb0c06bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:13.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.520+0000 7fdb0affd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fdb0c0c9fa0 0x7fdb0c06bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48108/0 (socket says 172.21.15.53:48108) 2023-06-10T18:54:13.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.520+0000 7fdb0affd640 1 -- 172.21.15.53:0/2855405821 learned_addr learned my addr 172.21.15.53:0/2855405821 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:54:13.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.520+0000 7fdb0a7fc640 1 --2- 172.21.15.53:0/2855405821 >> v2:172.21.15.117:3300/0 conn(0x7fdb0c06c020 0x7fdb0c0c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:13.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.520+0000 7fdb0b7fe640 1 --2- 172.21.15.53:0/2855405821 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb0c0c87e0 0x7fdb0c0af760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:13.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.520+0000 7fdb0affd640 1 -- 172.21.15.53:0/2855405821 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb0c0c87e0 msgr2=0x7fdb0c0af760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:54:13.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.520+0000 7fdb0affd640 1 --2- 172.21.15.53:0/2855405821 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb0c0c87e0 0x7fdb0c0af760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:13.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.520+0000 7fdb0affd640 1 -- 172.21.15.53:0/2855405821 >> v2:172.21.15.117:3300/0 conn(0x7fdb0c06c020 msgr2=0x7fdb0c0c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:54:13.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.520+0000 7fdb0affd640 1 --2- 172.21.15.53:0/2855405821 >> v2:172.21.15.117:3300/0 conn(0x7fdb0c06c020 0x7fdb0c0c82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:13.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.520+0000 7fdb0affd640 1 -- 172.21.15.53:0/2855405821 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb0c071030 con 0x7fdb0c0c9fa0 2023-06-10T18:54:13.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.520+0000 7fdb0b7fe640 1 --2- 172.21.15.53:0/2855405821 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb0c0c87e0 0x7fdb0c0af760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:54:13.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.524+0000 7fdb0affd640 1 --2- 172.21.15.53:0/2855405821 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb0c0c9fa0 0x7fdb0c06bae0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c06ecb0 tx=0x7fdafc01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=744bf398fb9d74c3 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:13.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.524+0000 7fdb09ffb640 1 -- 172.21.15.53:0/2855405821 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdafc0ac640 con 0x7fdb0c0c9fa0 2023-06-10T18:54:13.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.524+0000 7fdb09ffb640 1 -- 172.21.15.53:0/2855405821 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdafc0ac7a0 con 0x7fdb0c0c9fa0 2023-06-10T18:54:13.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.524+0000 7fdb09ffb640 1 -- 172.21.15.53:0/2855405821 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdafc0acb30 con 0x7fdb0c0c9fa0 2023-06-10T18:54:13.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.524+0000 7fdb11910640 1 -- 172.21.15.53:0/2855405821 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb0c0c9fa0 msgr2=0x7fdb0c06bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:13.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.524+0000 7fdb11910640 1 --2- 172.21.15.53:0/2855405821 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb0c0c9fa0 0x7fdb0c06bae0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c06ecb0 tx=0x7fdafc01c440 comp rx=0 tx=0).stop 2023-06-10T18:54:13.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.524+0000 7fdb11910640 1 -- 172.21.15.53:0/2855405821 shutdown_connections 2023-06-10T18:54:13.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.524+0000 7fdb11910640 1 --2- 172.21.15.53:0/2855405821 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb0c0c87e0 0x7fdb0c0af760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:13.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.524+0000 7fdb11910640 1 --2- 172.21.15.53:0/2855405821 >> v2:172.21.15.117:3300/0 conn(0x7fdb0c06c020 0x7fdb0c0c82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:13.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.524+0000 7fdb11910640 1 --2- 172.21.15.53:0/2855405821 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb0c0c9fa0 0x7fdb0c06bae0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:13.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.524+0000 7fdb11910640 1 -- 172.21.15.53:0/2855405821 >> 172.21.15.53:0/2855405821 conn(0x7fdb0c06a0e0 msgr2=0x7fdb0c0cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:54:13.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.524+0000 7fdb11910640 1 -- 172.21.15.53:0/2855405821 shutdown_connections 2023-06-10T18:54:13.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.524+0000 7fdb11910640 1 -- 172.21.15.53:0/2855405821 wait complete. 2023-06-10T18:54:13.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.524+0000 7fdb11910640 1 Processor -- start 2023-06-10T18:54:13.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.524+0000 7fdb11910640 1 -- start start 2023-06-10T18:54:13.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.524+0000 7fdb11910640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb0c06c020 0x7fdb0c0c6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:13.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.524+0000 7fdb11910640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb0c0c87e0 0x7fdb0c15c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:13.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.524+0000 7fdb11910640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb0c0c9fa0 0x7fdb0c163990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:13.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.524+0000 7fdb11910640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0c15b150 con 0x7fdb0c0c9fa0 2023-06-10T18:54:13.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.524+0000 7fdb11910640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0c0c6cc0 con 0x7fdb0c06c020 2023-06-10T18:54:13.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.524+0000 7fdb11910640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0c15b3a0 con 0x7fdb0c0c87e0 2023-06-10T18:54:13.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.524+0000 7fdb0b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb0c0c9fa0 0x7fdb0c163990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:13.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.524+0000 7fdb0b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb0c0c9fa0 0x7fdb0c163990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48110/0 (socket says 172.21.15.53:48110) 2023-06-10T18:54:13.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.524+0000 7fdb0b7fe640 1 -- 172.21.15.53:0/2281958723 learned_addr learned my addr 172.21.15.53:0/2281958723 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:54:13.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.524+0000 7fdb0a7fc640 1 --2- 172.21.15.53:0/2281958723 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb0c0c87e0 0x7fdb0c15c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:13.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.524+0000 7fdb0affd640 1 --2- 172.21.15.53:0/2281958723 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb0c06c020 0x7fdb0c0c6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:13.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.524+0000 7fdb0b7fe640 1 -- 172.21.15.53:0/2281958723 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb0c0c87e0 msgr2=0x7fdb0c15c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:13.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.524+0000 7fdb0b7fe640 1 --2- 172.21.15.53:0/2281958723 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb0c0c87e0 0x7fdb0c15c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:13.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.524+0000 7fdb0b7fe640 1 -- 172.21.15.53:0/2281958723 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb0c06c020 msgr2=0x7fdb0c0c6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:13.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.524+0000 7fdb0b7fe640 1 --2- 172.21.15.53:0/2281958723 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb0c06c020 0x7fdb0c0c6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:13.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.524+0000 7fdb0b7fe640 1 -- 172.21.15.53:0/2281958723 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdafc0094d0 con 0x7fdb0c0c9fa0 2023-06-10T18:54:13.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.524+0000 7fdb0a7fc640 1 --2- 172.21.15.53:0/2281958723 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb0c0c87e0 0x7fdb0c15c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:54:13.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.528+0000 7fdb0b7fe640 1 --2- 172.21.15.53:0/2281958723 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb0c0c9fa0 0x7fdb0c163990 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fdb04007f20 tx=0x7fdb0400d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:13.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.528+0000 7fdaf3fff640 1 -- 172.21.15.53:0/2281958723 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0400dee0 con 0x7fdb0c0c9fa0 2023-06-10T18:54:13.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.528+0000 7fdaf3fff640 1 -- 172.21.15.53:0/2281958723 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb0400f040 con 0x7fdb0c0c9fa0 2023-06-10T18:54:13.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.528+0000 7fdb11910640 1 -- 172.21.15.53:0/2281958723 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb0c15b680 con 0x7fdb0c0c9fa0 2023-06-10T18:54:13.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.528+0000 7fdaf3fff640 1 -- 172.21.15.53:0/2281958723 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb04003de0 con 0x7fdb0c0c9fa0 2023-06-10T18:54:13.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.528+0000 7fdb11910640 1 -- 172.21.15.53:0/2281958723 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb0c15bc40 con 0x7fdb0c0c9fa0 2023-06-10T18:54:13.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.528+0000 7fdb11910640 1 -- 172.21.15.53:0/2281958723 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb0c04d790 con 0x7fdb0c0c9fa0 2023-06-10T18:54:13.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.528+0000 7fdaf3fff640 1 -- 172.21.15.53:0/2281958723 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdb04004030 con 0x7fdb0c0c9fa0 2023-06-10T18:54:13.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.528+0000 7fdaf3fff640 1 --2- 172.21.15.53:0/2281958723 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdaf8066280 0x7fdaf8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:13.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.528+0000 7fdaf3fff640 1 -- 172.21.15.53:0/2281958723 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdb04084070 con 0x7fdb0c0c9fa0 2023-06-10T18:54:13.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.528+0000 7fdb0affd640 1 --2- 172.21.15.53:0/2281958723 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdaf8066280 0x7fdaf8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:13.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.528+0000 7fdb0affd640 1 --2- 172.21.15.53:0/2281958723 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdaf8066280 0x7fdaf8068730 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fdafc0ae000 tx=0x7fdafc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:13.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.532+0000 7fdaf3fff640 1 -- 172.21.15.53:0/2281958723 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdb04051580 con 0x7fdb0c0c9fa0 2023-06-10T18:54:13.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.680+0000 7fdb11910640 1 -- 172.21.15.53:0/2281958723 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fdb0c0ce670 con 0x7fdb0c0c9fa0 2023-06-10T18:54:13.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.684+0000 7fdaf3fff640 1 -- 172.21.15.53:0/2281958723 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v37) v1 ==== 92+0+10 (secure 0 0 0) 0x7fdb04054ba0 con 0x7fdb0c0c9fa0 2023-06-10T18:54:13.691 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-06-10T18:54:13.693 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.684+0000 7fdb11910640 1 -- 172.21.15.53:0/2281958723 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdaf8066280 msgr2=0x7fdaf8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:13.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.684+0000 7fdb11910640 1 --2- 172.21.15.53:0/2281958723 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdaf8066280 0x7fdaf8068730 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fdafc0ae000 tx=0x7fdafc008040 comp rx=0 tx=0).stop 2023-06-10T18:54:13.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.684+0000 7fdb11910640 1 -- 172.21.15.53:0/2281958723 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb0c0c9fa0 msgr2=0x7fdb0c163990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:13.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.684+0000 7fdb11910640 1 --2- 172.21.15.53:0/2281958723 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb0c0c9fa0 0x7fdb0c163990 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fdb04007f20 tx=0x7fdb0400d560 comp rx=0 tx=0).stop 2023-06-10T18:54:13.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.684+0000 7fdb11910640 1 -- 172.21.15.53:0/2281958723 shutdown_connections 2023-06-10T18:54:13.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.684+0000 7fdb11910640 1 --2- 172.21.15.53:0/2281958723 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdaf8066280 0x7fdaf8068730 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:13.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.684+0000 7fdb11910640 1 --2- 172.21.15.53:0/2281958723 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb0c0c9fa0 0x7fdb0c163990 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:13.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.684+0000 7fdb11910640 1 --2- 172.21.15.53:0/2281958723 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb0c0c87e0 0x7fdb0c15c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:13.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.684+0000 7fdb11910640 1 --2- 172.21.15.53:0/2281958723 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb0c06c020 0x7fdb0c0c6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:13.695 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.684+0000 7fdb11910640 1 -- 172.21.15.53:0/2281958723 >> 172.21.15.53:0/2281958723 conn(0x7fdb0c06a0e0 msgr2=0x7fdb0c0b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:54:13.695 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.684+0000 7fdb11910640 1 -- 172.21.15.53:0/2281958723 shutdown_connections 2023-06-10T18:54:13.695 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.684+0000 7fdb11910640 1 -- 172.21.15.53:0/2281958723 wait complete. 2023-06-10T18:54:13.709 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-10T18:54:13.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.828+0000 7ff558597640 1 Processor -- start 2023-06-10T18:54:13.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.828+0000 7ff558597640 1 -- start start 2023-06-10T18:54:13.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.828+0000 7ff558597640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff5500c9fa0 0x7ff55006bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:13.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.828+0000 7ff558597640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff5500af760 0x7ff5500afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:13.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.828+0000 7ff558597640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff55006b090 con 0x7ff55006c020 2023-06-10T18:54:13.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.828+0000 7ff558597640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5500b0120 con 0x7ff5500af760 2023-06-10T18:54:13.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.828+0000 7ff558597640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5500ca370 con 0x7ff5500c9fa0 2023-06-10T18:54:13.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.828+0000 7ff556333640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff5500c9fa0 0x7ff55006bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:13.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.828+0000 7ff556333640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff5500c9fa0 0x7ff55006bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.53:58814/0 (socket says 172.21.15.53:58814) 2023-06-10T18:54:13.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.828+0000 7ff556b34640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff5500af760 0x7ff5500afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:13.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.828+0000 7ff556333640 1 -- 172.21.15.53:0/3276691123 learned_addr learned my addr 172.21.15.53:0/3276691123 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:54:13.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.828+0000 7ff556b34640 1 -- 172.21.15.53:0/3276691123 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff5500c9fa0 msgr2=0x7ff55006bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:54:13.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.828+0000 7ff556b34640 1 --2- 172.21.15.53:0/3276691123 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff5500c9fa0 0x7ff55006bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:13.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.828+0000 7ff556b34640 1 -- 172.21.15.53:0/3276691123 >> v1:172.21.15.117:6789/0 conn(0x7ff55006c020 legacy=0x7ff5500c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:13.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.828+0000 7ff556b34640 1 -- 172.21.15.53:0/3276691123 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff550070d50 con 0x7ff5500af760 2023-06-10T18:54:13.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.828+0000 7ff556333640 1 --2- 172.21.15.53:0/3276691123 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff5500c9fa0 0x7ff55006bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-10T18:54:13.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.832+0000 7ff556b34640 1 --2- 172.21.15.53:0/3276691123 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff5500af760 0x7ff5500afbe0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff5440097c0 tx=0x7ff54401c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6d4eadf0dbf6e50 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:13.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.832+0000 7ff555331640 1 -- 172.21.15.53:0/3276691123 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5440ab600 con 0x7ff5500af760 2023-06-10T18:54:13.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.832+0000 7ff555331640 1 -- 172.21.15.53:0/3276691123 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5440a7050 con 0x7ff5500af760 2023-06-10T18:54:13.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.832+0000 7ff555331640 1 -- 172.21.15.53:0/3276691123 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5440ab980 con 0x7ff5500af760 2023-06-10T18:54:13.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.832+0000 7ff558597640 1 -- 172.21.15.53:0/3276691123 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff5500af760 msgr2=0x7ff5500afbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:13.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.832+0000 7ff558597640 1 --2- 172.21.15.53:0/3276691123 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff5500af760 0x7ff5500afbe0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff5440097c0 tx=0x7ff54401c3c0 comp rx=0 tx=0).stop 2023-06-10T18:54:13.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.832+0000 7ff558597640 1 -- 172.21.15.53:0/3276691123 shutdown_connections 2023-06-10T18:54:13.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.832+0000 7ff558597640 1 --2- 172.21.15.53:0/3276691123 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff5500af760 0x7ff5500afbe0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:13.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.832+0000 7ff558597640 1 --2- 172.21.15.53:0/3276691123 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff5500c9fa0 0x7ff55006bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:13.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.832+0000 7ff558597640 1 -- 172.21.15.53:0/3276691123 >> 172.21.15.53:0/3276691123 conn(0x7ff55006a0e0 msgr2=0x7ff5500cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:54:13.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.832+0000 7ff558597640 1 -- 172.21.15.53:0/3276691123 shutdown_connections 2023-06-10T18:54:13.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.832+0000 7ff558597640 1 -- 172.21.15.53:0/3276691123 wait complete. 2023-06-10T18:54:13.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.832+0000 7ff558597640 1 Processor -- start 2023-06-10T18:54:13.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.832+0000 7ff558597640 1 -- start start 2023-06-10T18:54:13.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.836+0000 7ff558597640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff55006c020 0x7ff55015dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:13.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.836+0000 7ff558597640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff5500af760 0x7ff5501f3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:13.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.836+0000 7ff558597640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff5500c9fa0 0x7ff5501f4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:13.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.836+0000 7ff558597640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff55015e410 con 0x7ff55006c020 2023-06-10T18:54:13.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.836+0000 7ff558597640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff55015e6f0 con 0x7ff5500af760 2023-06-10T18:54:13.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.836+0000 7ff558597640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff55015e9d0 con 0x7ff5500c9fa0 2023-06-10T18:54:13.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.836+0000 7ff556333640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff55006c020 0x7ff55015dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:13.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.836+0000 7ff556333640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff55006c020 0x7ff55015dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48116/0 (socket says 172.21.15.53:48116) 2023-06-10T18:54:13.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.836+0000 7ff556333640 1 -- 172.21.15.53:0/3984412529 learned_addr learned my addr 172.21.15.53:0/3984412529 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:54:13.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.836+0000 7ff556b34640 1 --2- 172.21.15.53:0/3984412529 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff5500c9fa0 0x7ff5501f4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:13.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.836+0000 7ff555b32640 1 --2- 172.21.15.53:0/3984412529 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff5500af760 0x7ff5501f3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:13.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.836+0000 7ff556333640 1 -- 172.21.15.53:0/3984412529 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff5500c9fa0 msgr2=0x7ff5501f4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:13.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.836+0000 7ff556333640 1 --2- 172.21.15.53:0/3984412529 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff5500c9fa0 0x7ff5501f4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:13.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.836+0000 7ff556333640 1 -- 172.21.15.53:0/3984412529 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff5500af760 msgr2=0x7ff5501f3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:13.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.836+0000 7ff556333640 1 --2- 172.21.15.53:0/3984412529 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff5500af760 0x7ff5501f3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:13.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.836+0000 7ff556333640 1 -- 172.21.15.53:0/3984412529 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5480094d0 con 0x7ff55006c020 2023-06-10T18:54:13.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.836+0000 7ff555b32640 1 --2- 172.21.15.53:0/3984412529 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff5500af760 0x7ff5501f3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:54:13.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.836+0000 7ff556333640 1 --2- 172.21.15.53:0/3984412529 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff55006c020 0x7ff55015dbe0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7ff54800e930 tx=0x7ff54800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:13.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.836+0000 7ff542ffd640 1 -- 172.21.15.53:0/3984412529 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff54800ca00 con 0x7ff55006c020 2023-06-10T18:54:13.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.836+0000 7ff542ffd640 1 -- 172.21.15.53:0/3984412529 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff54800cb60 con 0x7ff55006c020 2023-06-10T18:54:13.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.836+0000 7ff558597640 1 -- 172.21.15.53:0/3984412529 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff544009420 con 0x7ff55006c020 2023-06-10T18:54:13.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.836+0000 7ff542ffd640 1 -- 172.21.15.53:0/3984412529 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff548013470 con 0x7ff55006c020 2023-06-10T18:54:13.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.836+0000 7ff558597640 1 -- 172.21.15.53:0/3984412529 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff55015e120 con 0x7ff55006c020 2023-06-10T18:54:13.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.836+0000 7ff558597640 1 -- 172.21.15.53:0/3984412529 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5501f3870 con 0x7ff55006c020 2023-06-10T18:54:13.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.836+0000 7ff542ffd640 1 -- 172.21.15.53:0/3984412529 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff5480135d0 con 0x7ff55006c020 2023-06-10T18:54:13.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.836+0000 7ff542ffd640 1 --2- 172.21.15.53:0/3984412529 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff534066280 0x7ff534068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:13.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.836+0000 7ff542ffd640 1 -- 172.21.15.53:0/3984412529 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff548084290 con 0x7ff55006c020 2023-06-10T18:54:13.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.836+0000 7ff555b32640 1 --2- 172.21.15.53:0/3984412529 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff534066280 0x7ff534068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:13.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.840+0000 7ff555b32640 1 --2- 172.21.15.53:0/3984412529 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff534066280 0x7ff534068730 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff5501f3740 tx=0x7ff54c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:13.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.840+0000 7ff542ffd640 1 -- 172.21.15.53:0/3984412529 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff5480517a0 con 0x7ff55006c020 2023-06-10T18:54:14.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.996+0000 7ff558597640 1 -- 172.21.15.53:0/3984412529 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff55004d790 con 0x7ff55006c020 2023-06-10T18:54:14.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.996+0000 7ff542ffd640 1 -- 172.21.15.53:0/3984412529 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v37) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff548054dc0 con 0x7ff55006c020 2023-06-10T18:54:14.005 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-06-10T18:54:14.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.996+0000 7ff558597640 1 -- 172.21.15.53:0/3984412529 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff534066280 msgr2=0x7ff534068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:14.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.996+0000 7ff558597640 1 --2- 172.21.15.53:0/3984412529 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff534066280 0x7ff534068730 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff5501f3740 tx=0x7ff54c009040 comp rx=0 tx=0).stop 2023-06-10T18:54:14.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.996+0000 7ff558597640 1 -- 172.21.15.53:0/3984412529 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff55006c020 msgr2=0x7ff55015dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:14.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:13.996+0000 7ff558597640 1 --2- 172.21.15.53:0/3984412529 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff55006c020 0x7ff55015dbe0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7ff54800e930 tx=0x7ff54800edf0 comp rx=0 tx=0).stop 2023-06-10T18:54:14.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.000+0000 7ff558597640 1 -- 172.21.15.53:0/3984412529 shutdown_connections 2023-06-10T18:54:14.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.000+0000 7ff558597640 1 --2- 172.21.15.53:0/3984412529 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff534066280 0x7ff534068730 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:14.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.000+0000 7ff558597640 1 --2- 172.21.15.53:0/3984412529 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff5500c9fa0 0x7ff5501f4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:14.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.000+0000 7ff558597640 1 --2- 172.21.15.53:0/3984412529 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff5500af760 0x7ff5501f3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:14.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.000+0000 7ff558597640 1 --2- 172.21.15.53:0/3984412529 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff55006c020 0x7ff55015dbe0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:14.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.000+0000 7ff558597640 1 -- 172.21.15.53:0/3984412529 >> 172.21.15.53:0/3984412529 conn(0x7ff55006a0e0 msgr2=0x7ff5500b1380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:54:14.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.000+0000 7ff558597640 1 -- 172.21.15.53:0/3984412529 shutdown_connections 2023-06-10T18:54:14.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.000+0000 7ff558597640 1 -- 172.21.15.53:0/3984412529 wait complete. 2023-06-10T18:54:14.025 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-10T18:54:14.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.152+0000 7fcda47e6640 1 Processor -- start 2023-06-10T18:54:14.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.152+0000 7fcda47e6640 1 -- start start 2023-06-10T18:54:14.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.152+0000 7fcda47e6640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fcd9c0c9fa0 0x7fcd9c06bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:14.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.152+0000 7fcda47e6640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fcd9c06c020 0x7fcd9c0c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:14.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.152+0000 7fcda47e6640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd9c06b090 con 0x7fcd9c0c87e0 2023-06-10T18:54:14.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.152+0000 7fcda47e6640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd9c0ca370 con 0x7fcd9c06c020 2023-06-10T18:54:14.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.152+0000 7fcda47e6640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd9c070d50 con 0x7fcd9c0c9fa0 2023-06-10T18:54:14.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.152+0000 7fcda2d83640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fcd9c0c87e0 0x7fcd9c0af760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:58132/0 (socket says 172.21.15.53:58132) 2023-06-10T18:54:14.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.152+0000 7fcda2d83640 1 -- 172.21.15.53:0/541210111 learned_addr learned my addr 172.21.15.53:0/541210111 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:54:14.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.152+0000 7fcda1d81640 1 --2- 172.21.15.53:0/541210111 >> v2:172.21.15.53:3300/0 conn(0x7fcd9c06c020 0x7fcd9c0c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:14.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.152+0000 7fcda2582640 1 --2- 172.21.15.53:0/541210111 >> v2:172.21.15.117:3300/0 conn(0x7fcd9c0c9fa0 0x7fcd9c06bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:14.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.152+0000 7fcda1d81640 1 -- 172.21.15.53:0/541210111 >> v2:172.21.15.117:3300/0 conn(0x7fcd9c0c9fa0 msgr2=0x7fcd9c06bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:54:14.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.152+0000 7fcda1d81640 1 --2- 172.21.15.53:0/541210111 >> v2:172.21.15.117:3300/0 conn(0x7fcd9c0c9fa0 0x7fcd9c06bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:14.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.152+0000 7fcda1d81640 1 -- 172.21.15.53:0/541210111 >> v1:172.21.15.53:6789/0 conn(0x7fcd9c0c87e0 legacy=0x7fcd9c0af760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:14.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.152+0000 7fcda1580640 1 -- 172.21.15.53:0/541210111 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1411906847 0 0) 0x7fcd9c06b090 con 0x7fcd9c0c87e0 2023-06-10T18:54:14.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.152+0000 7fcda1d81640 1 -- 172.21.15.53:0/541210111 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd9c071030 con 0x7fcd9c06c020 2023-06-10T18:54:14.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.156+0000 7fcda1d81640 1 --2- 172.21.15.53:0/541210111 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd9c06c020 0x7fcd9c0c82a0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c06e9d0 tx=0x7fcd8c01c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e90fa9dde277755f server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:14.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.156+0000 7fcda1580640 1 -- 172.21.15.53:0/541210111 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8c0ab600 con 0x7fcd9c06c020 2023-06-10T18:54:14.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.156+0000 7fcda1580640 1 -- 172.21.15.53:0/541210111 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd8c0a7050 con 0x7fcd9c06c020 2023-06-10T18:54:14.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.156+0000 7fcda1580640 1 -- 172.21.15.53:0/541210111 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8c0ab980 con 0x7fcd9c06c020 2023-06-10T18:54:14.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.156+0000 7fcda47e6640 1 -- 172.21.15.53:0/541210111 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd9c06c020 msgr2=0x7fcd9c0c82a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:14.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.156+0000 7fcda47e6640 1 --2- 172.21.15.53:0/541210111 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd9c06c020 0x7fcd9c0c82a0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c06e9d0 tx=0x7fcd8c01c3a0 comp rx=0 tx=0).stop 2023-06-10T18:54:14.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.156+0000 7fcda47e6640 1 -- 172.21.15.53:0/541210111 shutdown_connections 2023-06-10T18:54:14.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.156+0000 7fcda47e6640 1 --2- 172.21.15.53:0/541210111 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd9c06c020 0x7fcd9c0c82a0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:14.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.156+0000 7fcda47e6640 1 --2- 172.21.15.53:0/541210111 >> v2:172.21.15.117:3300/0 conn(0x7fcd9c0c9fa0 0x7fcd9c06bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:14.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.156+0000 7fcda47e6640 1 -- 172.21.15.53:0/541210111 >> 172.21.15.53:0/541210111 conn(0x7fcd9c06a0e0 msgr2=0x7fcd9c0cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:54:14.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.156+0000 7fcda47e6640 1 -- 172.21.15.53:0/541210111 shutdown_connections 2023-06-10T18:54:14.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.156+0000 7fcda47e6640 1 -- 172.21.15.53:0/541210111 wait complete. 2023-06-10T18:54:14.175 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.156+0000 7fcda47e6640 1 Processor -- start 2023-06-10T18:54:14.175 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.156+0000 7fcda47e6640 1 -- start start 2023-06-10T18:54:14.175 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.156+0000 7fcda47e6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd9c06c020 0x7fcd9c0c1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:14.175 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.156+0000 7fcda47e6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd9c0c87e0 0x7fcd9c0c06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:14.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.156+0000 7fcda47e6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd9c0c9fa0 0x7fcd9c142240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:14.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.156+0000 7fcda47e6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9c155450 con 0x7fcd9c0c87e0 2023-06-10T18:54:14.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.156+0000 7fcda47e6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9c154bd0 con 0x7fcd9c0c9fa0 2023-06-10T18:54:14.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.156+0000 7fcda47e6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9c0c1d40 con 0x7fcd9c06c020 2023-06-10T18:54:14.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.156+0000 7fcda1d81640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd9c0c87e0 0x7fcd9c0c06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:14.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.156+0000 7fcda1d81640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd9c0c87e0 0x7fcd9c0c06f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48130/0 (socket says 172.21.15.53:48130) 2023-06-10T18:54:14.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.156+0000 7fcda1d81640 1 -- 172.21.15.53:0/4264271505 learned_addr learned my addr 172.21.15.53:0/4264271505 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:54:14.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.156+0000 7fcda1d81640 1 -- 172.21.15.53:0/4264271505 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd9c06c020 msgr2=0x7fcd9c0c1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:14.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.156+0000 7fcda1d81640 1 --2- 172.21.15.53:0/4264271505 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd9c06c020 0x7fcd9c0c1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:14.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.156+0000 7fcda1d81640 1 -- 172.21.15.53:0/4264271505 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd9c0c9fa0 msgr2=0x7fcd9c142240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:14.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.156+0000 7fcda1d81640 1 --2- 172.21.15.53:0/4264271505 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd9c0c9fa0 0x7fcd9c142240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:14.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.156+0000 7fcda1d81640 1 -- 172.21.15.53:0/4264271505 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd8c009420 con 0x7fcd9c0c87e0 2023-06-10T18:54:14.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.156+0000 7fcda1d81640 1 --2- 172.21.15.53:0/4264271505 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd9c0c87e0 0x7fcd9c0c06f0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c0ae040 tx=0x7fcd8c019140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:14.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.160+0000 7fcd92ffd640 1 -- 172.21.15.53:0/4264271505 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8c0b4610 con 0x7fcd9c0c87e0 2023-06-10T18:54:14.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.160+0000 7fcd92ffd640 1 -- 172.21.15.53:0/4264271505 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd8c0b4770 con 0x7fcd9c0c87e0 2023-06-10T18:54:14.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.160+0000 7fcda47e6640 1 -- 172.21.15.53:0/4264271505 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd9c154e90 con 0x7fcd9c0c87e0 2023-06-10T18:54:14.180 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.160+0000 7fcd92ffd640 1 -- 172.21.15.53:0/4264271505 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8c0b4b20 con 0x7fcd9c0c87e0 2023-06-10T18:54:14.180 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.160+0000 7fcda47e6640 1 -- 172.21.15.53:0/4264271505 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd9c0c7b70 con 0x7fcd9c0c87e0 2023-06-10T18:54:14.180 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.160+0000 7fcda47e6640 1 -- 172.21.15.53:0/4264271505 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd9c04d790 con 0x7fcd9c0c87e0 2023-06-10T18:54:14.180 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.160+0000 7fcd92ffd640 1 -- 172.21.15.53:0/4264271505 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcd8c0b2040 con 0x7fcd9c0c87e0 2023-06-10T18:54:14.180 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.160+0000 7fcd92ffd640 1 --2- 172.21.15.53:0/4264271505 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcd800662b0 0x7fcd80068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:14.180 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.160+0000 7fcd92ffd640 1 -- 172.21.15.53:0/4264271505 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcd8c11ddb0 con 0x7fcd9c0c87e0 2023-06-10T18:54:14.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.160+0000 7fcda2582640 1 --2- 172.21.15.53:0/4264271505 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcd800662b0 0x7fcd80068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:14.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.160+0000 7fcda2582640 1 --2- 172.21.15.53:0/4264271505 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcd800662b0 0x7fcd80068760 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c156b70 tx=0x7fcd98008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:14.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.164+0000 7fcd92ffd640 1 -- 172.21.15.53:0/4264271505 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcd8c0eb230 con 0x7fcd9c0c87e0 2023-06-10T18:54:14.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.316+0000 7fcda47e6640 1 -- 172.21.15.53:0/4264271505 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcd9c0c11b0 con 0x7fcd9c0c87e0 2023-06-10T18:54:14.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.316+0000 7fcd92ffd640 1 -- 172.21.15.53:0/4264271505 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v37) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcd8c0b0020 con 0x7fcd9c0c87e0 2023-06-10T18:54:14.326 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-06-10T18:54:14.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.320+0000 7fcda47e6640 1 -- 172.21.15.53:0/4264271505 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcd800662b0 msgr2=0x7fcd80068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:14.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.320+0000 7fcda47e6640 1 --2- 172.21.15.53:0/4264271505 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcd800662b0 0x7fcd80068760 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c156b70 tx=0x7fcd98008040 comp rx=0 tx=0).stop 2023-06-10T18:54:14.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.320+0000 7fcda47e6640 1 -- 172.21.15.53:0/4264271505 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd9c0c87e0 msgr2=0x7fcd9c0c06f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:14.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.320+0000 7fcda47e6640 1 --2- 172.21.15.53:0/4264271505 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd9c0c87e0 0x7fcd9c0c06f0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c0ae040 tx=0x7fcd8c019140 comp rx=0 tx=0).stop 2023-06-10T18:54:14.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.320+0000 7fcda47e6640 1 -- 172.21.15.53:0/4264271505 shutdown_connections 2023-06-10T18:54:14.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.320+0000 7fcda47e6640 1 --2- 172.21.15.53:0/4264271505 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcd800662b0 0x7fcd80068760 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:14.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.320+0000 7fcda47e6640 1 --2- 172.21.15.53:0/4264271505 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd9c0c9fa0 0x7fcd9c142240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:14.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.320+0000 7fcda47e6640 1 --2- 172.21.15.53:0/4264271505 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd9c0c87e0 0x7fcd9c0c06f0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:14.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.320+0000 7fcda47e6640 1 --2- 172.21.15.53:0/4264271505 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd9c06c020 0x7fcd9c0c1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:14.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.320+0000 7fcda47e6640 1 -- 172.21.15.53:0/4264271505 >> 172.21.15.53:0/4264271505 conn(0x7fcd9c06a0e0 msgr2=0x7fcd9c158e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:54:14.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.320+0000 7fcda47e6640 1 -- 172.21.15.53:0/4264271505 shutdown_connections 2023-06-10T18:54:14.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.320+0000 7fcda47e6640 1 -- 172.21.15.53:0/4264271505 wait complete. 2023-06-10T18:54:14.344 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-10T18:54:14.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.452+0000 7f2667506640 1 Processor -- start 2023-06-10T18:54:14.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.452+0000 7f2667506640 1 -- start start 2023-06-10T18:54:14.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.452+0000 7f2667506640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26601571a0 0x7f26600c9f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:14.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.452+0000 7f2667506640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f26600afee0 0x7f26600c83f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:14.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.452+0000 7f2667506640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2660071190 con 0x7f2660070100 2023-06-10T18:54:14.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.452+0000 7f2667506640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26600ca440 con 0x7f26600afee0 2023-06-10T18:54:14.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.452+0000 7f2667506640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2660070580 con 0x7f26601571a0 2023-06-10T18:54:14.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.452+0000 7f2664aa1640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f2660070100 0x7f26600af7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:58134/0 (socket says 172.21.15.53:58134) 2023-06-10T18:54:14.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.452+0000 7f2664aa1640 1 -- 172.21.15.53:0/710804441 learned_addr learned my addr 172.21.15.53:0/710804441 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:54:14.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.452+0000 7f2657fff640 1 -- 172.21.15.53:0/710804441 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 862656993 0 0) 0x7f2660071190 con 0x7f2660070100 2023-06-10T18:54:14.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.452+0000 7f2657fff640 1 -- 172.21.15.53:0/710804441 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f264c003530 con 0x7f2660070100 2023-06-10T18:54:14.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.452+0000 7f26652a2640 1 --2- 172.21.15.53:0/710804441 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26601571a0 0x7f26600c9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:14.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.452+0000 7f2665aa3640 1 --2- 172.21.15.53:0/710804441 >> v2:172.21.15.117:3300/0 conn(0x7f26600afee0 0x7f26600c83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:14.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.452+0000 7f2657fff640 1 -- 172.21.15.53:0/710804441 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 253402576 0 0) 0x7f264c003530 con 0x7f2660070100 2023-06-10T18:54:14.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.452+0000 7f2657fff640 1 -- 172.21.15.53:0/710804441 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26601571a0 msgr2=0x7f26600c9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:54:14.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.452+0000 7f2657fff640 1 --2- 172.21.15.53:0/710804441 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26601571a0 0x7f26600c9f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:14.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.452+0000 7f2657fff640 1 -- 172.21.15.53:0/710804441 >> v2:172.21.15.117:3300/0 conn(0x7f26600afee0 msgr2=0x7f26600c83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:54:14.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.452+0000 7f2657fff640 1 --2- 172.21.15.53:0/710804441 >> v2:172.21.15.117:3300/0 conn(0x7f26600afee0 0x7f26600c83f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:14.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.452+0000 7f2657fff640 1 -- 172.21.15.53:0/710804441 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2660070860 con 0x7f2660070100 2023-06-10T18:54:14.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.452+0000 7f2657fff640 1 -- 172.21.15.53:0/710804441 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f2650001680 con 0x7f2660070100 2023-06-10T18:54:14.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.452+0000 7f2665aa3640 1 --2- 172.21.15.53:0/710804441 >> v2:172.21.15.117:3300/0 conn(0x7f26600afee0 0x7f26600c83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:54:14.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.452+0000 7f2657fff640 1 -- 172.21.15.53:0/710804441 >> v1:172.21.15.53:6789/0 conn(0x7f2660070100 legacy=0x7f26600af7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:14.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.452+0000 7f2657fff640 1 --2- 172.21.15.53:0/710804441 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26601571a0 0x7f264c003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:14.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.452+0000 7f2657fff640 1 --2- 172.21.15.53:0/710804441 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f264c003fb0 0x7f264c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:14.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.452+0000 7f2657fff640 1 --2- 172.21.15.53:0/710804441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f264c004d10 0x7f264c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:14.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.452+0000 7f2657fff640 1 -- 172.21.15.53:0/710804441 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26600ca440 con 0x7f264c003fb0 2023-06-10T18:54:14.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.452+0000 7f2657fff640 1 -- 172.21.15.53:0/710804441 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2660070580 con 0x7f264c004d10 2023-06-10T18:54:14.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.452+0000 7f2657fff640 1 -- 172.21.15.53:0/710804441 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f264c00ba90 con 0x7f26601571a0 2023-06-10T18:54:14.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.452+0000 7f2664aa1640 1 --2- 172.21.15.53:0/710804441 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f264c003fb0 0x7f264c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:14.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.452+0000 7f2665aa3640 1 --2- 172.21.15.53:0/710804441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f264c004d10 0x7f264c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:14.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.452+0000 7f26652a2640 1 --2- 172.21.15.53:0/710804441 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26601571a0 0x7f264c003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:14.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.452+0000 7f2664aa1640 1 -- 172.21.15.53:0/710804441 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26601571a0 msgr2=0x7f264c003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:54:14.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.452+0000 7f2664aa1640 1 --2- 172.21.15.53:0/710804441 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26601571a0 0x7f264c003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:14.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.452+0000 7f2664aa1640 1 -- 172.21.15.53:0/710804441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f264c004d10 msgr2=0x7f264c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:54:14.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.452+0000 7f2664aa1640 1 --2- 172.21.15.53:0/710804441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f264c004d10 0x7f264c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:14.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.452+0000 7f2664aa1640 1 -- 172.21.15.53:0/710804441 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f264c003530 con 0x7f264c003fb0 2023-06-10T18:54:14.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.452+0000 7f26652a2640 1 --2- 172.21.15.53:0/710804441 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26601571a0 0x7f264c003980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:54:14.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.456+0000 7f2664aa1640 1 --2- 172.21.15.53:0/710804441 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f264c003fb0 0x7f264c0047d0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f265000c240 tx=0x7f265001f390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b63f20f8fc21bb1b server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:14.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.456+0000 7f2657fff640 1 -- 172.21.15.53:0/710804441 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2650005ae0 con 0x7f264c003fb0 2023-06-10T18:54:14.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.456+0000 7f2657fff640 1 -- 172.21.15.53:0/710804441 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26500ab070 con 0x7f264c003fb0 2023-06-10T18:54:14.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.456+0000 7f2657fff640 1 -- 172.21.15.53:0/710804441 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2650007070 con 0x7f264c003fb0 2023-06-10T18:54:14.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.456+0000 7f2667506640 1 -- 172.21.15.53:0/710804441 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f264c003fb0 msgr2=0x7f264c0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:14.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.456+0000 7f2667506640 1 --2- 172.21.15.53:0/710804441 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f264c003fb0 0x7f264c0047d0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f265000c240 tx=0x7f265001f390 comp rx=0 tx=0).stop 2023-06-10T18:54:14.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.456+0000 7f2665aa3640 1 -- 172.21.15.53:0/710804441 reap_dead start 2023-06-10T18:54:14.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.456+0000 7f2667506640 1 -- 172.21.15.53:0/710804441 shutdown_connections 2023-06-10T18:54:14.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.456+0000 7f2667506640 1 -- 172.21.15.53:0/710804441 >> 172.21.15.53:0/710804441 conn(0x7f26600ce9e0 msgr2=0x7f26600ca7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:54:14.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.456+0000 7f2667506640 1 -- 172.21.15.53:0/710804441 shutdown_connections 2023-06-10T18:54:14.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.456+0000 7f2667506640 1 -- 172.21.15.53:0/710804441 wait complete. 2023-06-10T18:54:14.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.460+0000 7f2667506640 1 Processor -- start 2023-06-10T18:54:14.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.460+0000 7f2667506640 1 -- start start 2023-06-10T18:54:14.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.460+0000 7f2667506640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f264c003fb0 0x7f266015ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:14.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.460+0000 7f2667506640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26600c2490 0x7f26600c17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:14.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.460+0000 7f2667506640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26600c1d30 0x7f26600c3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:14.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.460+0000 7f2667506640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26600c21a0 con 0x7f264c003fb0 2023-06-10T18:54:14.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.460+0000 7f2667506640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f266015c740 con 0x7f26600c2490 2023-06-10T18:54:14.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.460+0000 7f2667506640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f266015b6a0 con 0x7f26600c1d30 2023-06-10T18:54:14.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.460+0000 7f26652a2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f264c003fb0 0x7f266015ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:14.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.460+0000 7f26652a2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f264c003fb0 0x7f266015ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48136/0 (socket says 172.21.15.53:48136) 2023-06-10T18:54:14.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.460+0000 7f26652a2640 1 -- 172.21.15.53:0/178998639 learned_addr learned my addr 172.21.15.53:0/178998639 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:54:14.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.460+0000 7f2665aa3640 1 --2- 172.21.15.53:0/178998639 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26600c1d30 0x7f26600c3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:14.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.460+0000 7f2664aa1640 1 --2- 172.21.15.53:0/178998639 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26600c2490 0x7f26600c17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:14.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.460+0000 7f26652a2640 1 -- 172.21.15.53:0/178998639 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26600c1d30 msgr2=0x7f26600c3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:14.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.460+0000 7f26652a2640 1 --2- 172.21.15.53:0/178998639 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26600c1d30 0x7f26600c3080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:14.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.460+0000 7f26652a2640 1 -- 172.21.15.53:0/178998639 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26600c2490 msgr2=0x7f26600c17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:14.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.460+0000 7f26652a2640 1 --2- 172.21.15.53:0/178998639 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26600c2490 0x7f26600c17f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:14.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.460+0000 7f26652a2640 1 -- 172.21.15.53:0/178998639 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f266015b980 con 0x7f264c003fb0 2023-06-10T18:54:14.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.460+0000 7f26652a2640 1 --2- 172.21.15.53:0/178998639 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f264c003fb0 0x7f266015ada0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f265c00e840 tx=0x7f265c00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:14.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.460+0000 7f2655ffb640 1 -- 172.21.15.53:0/178998639 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f265c00c670 con 0x7f264c003fb0 2023-06-10T18:54:14.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.460+0000 7f2655ffb640 1 -- 172.21.15.53:0/178998639 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f265c00c7d0 con 0x7f264c003fb0 2023-06-10T18:54:14.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.460+0000 7f2655ffb640 1 -- 172.21.15.53:0/178998639 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f265c00cb40 con 0x7f264c003fb0 2023-06-10T18:54:14.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.460+0000 7f2667506640 1 -- 172.21.15.53:0/178998639 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f266015bc60 con 0x7f264c003fb0 2023-06-10T18:54:14.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.460+0000 7f2667506640 1 -- 172.21.15.53:0/178998639 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f266015c220 con 0x7f264c003fb0 2023-06-10T18:54:14.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.460+0000 7f2667506640 1 -- 172.21.15.53:0/178998639 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f266004d790 con 0x7f264c003fb0 2023-06-10T18:54:14.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.464+0000 7f2655ffb640 1 -- 172.21.15.53:0/178998639 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f265c00cca0 con 0x7f264c003fb0 2023-06-10T18:54:14.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.464+0000 7f2655ffb640 1 --2- 172.21.15.53:0/178998639 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f26440662b0 0x7f2644068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:14.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.464+0000 7f2655ffb640 1 -- 172.21.15.53:0/178998639 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f265c0839f0 con 0x7f264c003fb0 2023-06-10T18:54:14.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.464+0000 7f2664aa1640 1 --2- 172.21.15.53:0/178998639 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f26440662b0 0x7f2644068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:14.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.464+0000 7f2664aa1640 1 --2- 172.21.15.53:0/178998639 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f26440662b0 0x7f2644068760 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f26500ae000 tx=0x7f2650001a80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:14.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.468+0000 7f2655ffb640 1 -- 172.21.15.53:0/178998639 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f265c050e70 con 0x7f264c003fb0 2023-06-10T18:54:14.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.632+0000 7f2667506640 1 -- 172.21.15.53:0/178998639 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f26600ccff0 con 0x7f264c003fb0 2023-06-10T18:54:14.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.632+0000 7f2655ffb640 1 -- 172.21.15.53:0/178998639 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v37) v1 ==== 80+0+0 (secure 0 0 0) 0x7f265c021080 con 0x7f264c003fb0 2023-06-10T18:54:14.641 INFO:teuthology.orchestra.run.smithi053.stderr:listed 0 entries 2023-06-10T18:54:14.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.632+0000 7f2667506640 1 -- 172.21.15.53:0/178998639 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f26440662b0 msgr2=0x7f2644068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:14.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.632+0000 7f2667506640 1 --2- 172.21.15.53:0/178998639 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f26440662b0 0x7f2644068760 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f26500ae000 tx=0x7f2650001a80 comp rx=0 tx=0).stop 2023-06-10T18:54:14.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.632+0000 7f2667506640 1 -- 172.21.15.53:0/178998639 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f264c003fb0 msgr2=0x7f266015ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:14.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.632+0000 7f2667506640 1 --2- 172.21.15.53:0/178998639 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f264c003fb0 0x7f266015ada0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f265c00e840 tx=0x7f265c00ed00 comp rx=0 tx=0).stop 2023-06-10T18:54:14.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.632+0000 7f2667506640 1 -- 172.21.15.53:0/178998639 shutdown_connections 2023-06-10T18:54:14.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.632+0000 7f2667506640 1 --2- 172.21.15.53:0/178998639 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f26440662b0 0x7f2644068760 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:14.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.632+0000 7f2667506640 1 --2- 172.21.15.53:0/178998639 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26600c1d30 0x7f26600c3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:14.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.632+0000 7f2667506640 1 --2- 172.21.15.53:0/178998639 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26600c2490 0x7f26600c17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:14.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.632+0000 7f2667506640 1 --2- 172.21.15.53:0/178998639 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f264c003fb0 0x7f266015ada0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:14.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.632+0000 7f2667506640 1 -- 172.21.15.53:0/178998639 >> 172.21.15.53:0/178998639 conn(0x7f26600ce9e0 msgr2=0x7f2660155d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:54:14.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.636+0000 7f2667506640 1 -- 172.21.15.53:0/178998639 shutdown_connections 2023-06-10T18:54:14.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:14.636+0000 7f2667506640 1 -- 172.21.15.53:0/178998639 wait complete. 2023-06-10T18:54:14.659 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi053.front.sepia.ceph.com... 2023-06-10T18:54:14.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:54:14.660 DEBUG:teuthology.orchestra.run.smithi053:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-06-10T18:54:14.671 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[47887]: fuse finished with error 0 and tester_r 0 2023-06-10T18:54:14.672 INFO:teuthology.orchestra.run:waiting for 300 2023-06-10T18:54:20.774 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi053.front.sepia.ceph.com 2023-06-10T18:54:20.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:54:20.775 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-06-10T18:54:20.782 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T18:54:20.783 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T18:54:20.789 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T18:54:20.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:20.956+0000 7f88fcf40640 1 Processor -- start 2023-06-10T18:54:20.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:20.956+0000 7f88fcf40640 1 -- start start 2023-06-10T18:54:20.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:20.956+0000 7f88fcf40640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f88f80ccae0 0x7f88f80d0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:20.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:20.956+0000 7f88fcf40640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88f80d0020 con 0x7f88f80b3ac0 2023-06-10T18:54:20.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:20.956+0000 7f88fcf40640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88f80cef40 con 0x7f88f80cc690 2023-06-10T18:54:20.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:20.956+0000 7f88fcf40640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88f80cf220 con 0x7f88f80ccae0 2023-06-10T18:54:20.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:20.956+0000 7f88f659c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f88f80b3ac0 0x7f88f80b3e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:58138/0 (socket says 172.21.15.53:58138) 2023-06-10T18:54:20.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:20.956+0000 7f88f659c640 1 -- 172.21.15.53:0/759331403 learned_addr learned my addr 172.21.15.53:0/759331403 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:54:20.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:20.956+0000 7f88f6d9d640 1 --2- 172.21.15.53:0/759331403 >> v2:172.21.15.117:3300/0 conn(0x7f88f80ccae0 0x7f88f80d0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:20.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:20.956+0000 7f88f559a640 1 -- 172.21.15.53:0/759331403 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1954863582 0 0) 0x7f88f80d0020 con 0x7f88f80b3ac0 2023-06-10T18:54:20.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:20.956+0000 7f88f559a640 1 -- 172.21.15.53:0/759331403 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88e0003530 con 0x7f88f80b3ac0 2023-06-10T18:54:20.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:20.956+0000 7f88f559a640 1 -- 172.21.15.53:0/759331403 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3316277996 0 0) 0x7f88e0003530 con 0x7f88f80b3ac0 2023-06-10T18:54:20.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:20.956+0000 7f88f559a640 1 -- 172.21.15.53:0/759331403 >> v2:172.21.15.117:3300/0 conn(0x7f88f80ccae0 msgr2=0x7f88f80d0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:54:20.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:20.956+0000 7f88f559a640 1 --2- 172.21.15.53:0/759331403 >> v2:172.21.15.117:3300/0 conn(0x7f88f80ccae0 0x7f88f80d0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:20.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:20.956+0000 7f88f559a640 1 -- 172.21.15.53:0/759331403 >> v1:172.21.15.117:6789/0 conn(0x7f88f80cc690 legacy=0x7f88f80d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:20.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:20.956+0000 7f88f559a640 1 -- 172.21.15.53:0/759331403 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88f80cf500 con 0x7f88f80b3ac0 2023-06-10T18:54:20.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:20.956+0000 7f88f559a640 1 -- 172.21.15.53:0/759331403 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f88e8001680 con 0x7f88f80b3ac0 2023-06-10T18:54:20.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:20.956+0000 7f88f559a640 1 -- 172.21.15.53:0/759331403 >> v1:172.21.15.53:6789/0 conn(0x7f88f80b3ac0 legacy=0x7f88f80b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:20.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:20.956+0000 7f88f559a640 1 --2- 172.21.15.53:0/759331403 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88e00039f0 0x7f88e0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:20.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:20.956+0000 7f88f559a640 1 --2- 172.21.15.53:0/759331403 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88e00047d0 0x7f88e0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:20.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:20.956+0000 7f88f559a640 1 --2- 172.21.15.53:0/759331403 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88e0005180 0x7f88e000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:20.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:20.956+0000 7f88f559a640 1 -- 172.21.15.53:0/759331403 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f80cf220 con 0x7f88e00047d0 2023-06-10T18:54:20.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:20.956+0000 7f88f559a640 1 -- 172.21.15.53:0/759331403 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88e000c060 con 0x7f88e0005180 2023-06-10T18:54:20.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:20.956+0000 7f88f559a640 1 -- 172.21.15.53:0/759331403 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88e000c220 con 0x7f88e00039f0 2023-06-10T18:54:20.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:20.956+0000 7f88f5d9b640 1 --2- 172.21.15.53:0/759331403 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88e00047d0 0x7f88e0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:20.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:20.956+0000 7f88f659c640 1 --2- 172.21.15.53:0/759331403 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88e00039f0 0x7f88e0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:20.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:20.956+0000 7f88f6d9d640 1 --2- 172.21.15.53:0/759331403 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88e0005180 0x7f88e000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:20.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:20.956+0000 7f88f5d9b640 1 -- 172.21.15.53:0/759331403 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88e00039f0 msgr2=0x7f88e0003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:54:20.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:20.956+0000 7f88f5d9b640 1 --2- 172.21.15.53:0/759331403 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88e00039f0 0x7f88e0003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:20.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:20.956+0000 7f88f5d9b640 1 -- 172.21.15.53:0/759331403 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88e0005180 msgr2=0x7f88e000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:54:20.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:20.956+0000 7f88f5d9b640 1 --2- 172.21.15.53:0/759331403 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88e0005180 0x7f88e000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:20.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:20.956+0000 7f88f5d9b640 1 -- 172.21.15.53:0/759331403 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88e0003530 con 0x7f88e00047d0 2023-06-10T18:54:20.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:20.956+0000 7f88f6d9d640 1 --2- 172.21.15.53:0/759331403 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88e0005180 0x7f88e000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:54:20.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:20.956+0000 7f88f6d9d640 1 -- 172.21.15.53:0/759331403 reap_dead start 2023-06-10T18:54:20.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:20.960+0000 7f88f5d9b640 1 --2- 172.21.15.53:0/759331403 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88e00047d0 0x7f88e0004c40 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f88ec001780 tx=0x7f88ec01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bba29ca47331221 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:20.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:20.960+0000 7f88f559a640 1 -- 172.21.15.53:0/759331403 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88ec0a4ea0 con 0x7f88e00047d0 2023-06-10T18:54:20.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:20.960+0000 7f88f559a640 1 -- 172.21.15.53:0/759331403 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88ec0a7050 con 0x7f88e00047d0 2023-06-10T18:54:20.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:20.960+0000 7f88f559a640 1 -- 172.21.15.53:0/759331403 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88ec003600 con 0x7f88e00047d0 2023-06-10T18:54:20.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:20.960+0000 7f88fcf40640 1 -- 172.21.15.53:0/759331403 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88e00047d0 msgr2=0x7f88e0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:20.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:20.960+0000 7f88fcf40640 1 --2- 172.21.15.53:0/759331403 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88e00047d0 0x7f88e0004c40 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f88ec001780 tx=0x7f88ec01c3e0 comp rx=0 tx=0).stop 2023-06-10T18:54:20.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:20.960+0000 7f88fcf40640 1 -- 172.21.15.53:0/759331403 shutdown_connections 2023-06-10T18:54:20.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:20.960+0000 7f88fcf40640 1 --2- 172.21.15.53:0/759331403 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88e00047d0 0x7f88e0004c40 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:20.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:20.960+0000 7f88fcf40640 1 -- 172.21.15.53:0/759331403 >> 172.21.15.53:0/759331403 conn(0x7f88f8071790 msgr2=0x7f88f8069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:54:20.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:20.960+0000 7f88fcf40640 1 -- 172.21.15.53:0/759331403 shutdown_connections 2023-06-10T18:54:20.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:20.960+0000 7f88fcf40640 1 -- 172.21.15.53:0/759331403 wait complete. 2023-06-10T18:54:20.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:20.960+0000 7f88fcf40640 1 Processor -- start 2023-06-10T18:54:20.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:20.960+0000 7f88fcf40640 1 -- start start 2023-06-10T18:54:20.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:20.964+0000 7f88fcf40640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88e00047d0 0x7f88f80b0e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:20.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:20.964+0000 7f88fcf40640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88f8159310 0x7f88f80c5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:20.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:20.964+0000 7f88fcf40640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88f80b1aa0 0x7f88f80b1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:20.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:20.964+0000 7f88fcf40640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f80c6330 con 0x7f88f8159310 2023-06-10T18:54:20.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:20.964+0000 7f88fcf40640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f80b2450 con 0x7f88f80b1aa0 2023-06-10T18:54:20.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:20.964+0000 7f88fcf40640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88f80c60b0 con 0x7f88e00047d0 2023-06-10T18:54:20.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:20.964+0000 7f88f5d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88f8159310 0x7f88f80c5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:20.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:20.964+0000 7f88f5d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88f8159310 0x7f88f80c5b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48152/0 (socket says 172.21.15.53:48152) 2023-06-10T18:54:20.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:20.964+0000 7f88f5d9b640 1 -- 172.21.15.53:0/1799907213 learned_addr learned my addr 172.21.15.53:0/1799907213 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:54:20.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:20.964+0000 7f88f659c640 1 --2- 172.21.15.53:0/1799907213 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88e00047d0 0x7f88f80b0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:20.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:20.964+0000 7f88f6d9d640 1 --2- 172.21.15.53:0/1799907213 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88f80b1aa0 0x7f88f80b1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:20.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:20.964+0000 7f88f5d9b640 1 -- 172.21.15.53:0/1799907213 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88e00047d0 msgr2=0x7f88f80b0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:20.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:20.964+0000 7f88f5d9b640 1 --2- 172.21.15.53:0/1799907213 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88e00047d0 0x7f88f80b0e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:20.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:20.964+0000 7f88f5d9b640 1 -- 172.21.15.53:0/1799907213 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88f80b1aa0 msgr2=0x7f88f80b1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:20.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:20.964+0000 7f88f5d9b640 1 --2- 172.21.15.53:0/1799907213 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88f80b1aa0 0x7f88f80b1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:20.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:20.964+0000 7f88f5d9b640 1 -- 172.21.15.53:0/1799907213 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88f81f4af0 con 0x7f88f8159310 2023-06-10T18:54:20.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:20.964+0000 7f88f5d9b640 1 --2- 172.21.15.53:0/1799907213 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88f8159310 0x7f88f80c5b70 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f88ec01c210 tx=0x7f88e0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:20.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:20.964+0000 7f88e6ffd640 1 -- 172.21.15.53:0/1799907213 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88ec003e40 con 0x7f88f8159310 2023-06-10T18:54:20.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:20.964+0000 7f88e6ffd640 1 -- 172.21.15.53:0/1799907213 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88ec007a40 con 0x7f88f8159310 2023-06-10T18:54:20.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:20.964+0000 7f88fcf40640 1 -- 172.21.15.53:0/1799907213 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88f81f4dd0 con 0x7f88f8159310 2023-06-10T18:54:20.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:20.964+0000 7f88e6ffd640 1 -- 172.21.15.53:0/1799907213 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88ec007270 con 0x7f88f8159310 2023-06-10T18:54:20.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:20.964+0000 7f88fcf40640 1 -- 172.21.15.53:0/1799907213 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88f81f5390 con 0x7f88f8159310 2023-06-10T18:54:20.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:20.964+0000 7f88fcf40640 1 -- 172.21.15.53:0/1799907213 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88f804d790 con 0x7f88f8159310 2023-06-10T18:54:20.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:20.964+0000 7f88e6ffd640 1 -- 172.21.15.53:0/1799907213 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f88ec0073d0 con 0x7f88f8159310 2023-06-10T18:54:20.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:20.964+0000 7f88e6ffd640 1 --2- 172.21.15.53:0/1799907213 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f88d8066280 0x7f88d8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:20.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:20.964+0000 7f88e6ffd640 1 -- 172.21.15.53:0/1799907213 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f88ec11df10 con 0x7f88f8159310 2023-06-10T18:54:20.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:20.964+0000 7f88f659c640 1 --2- 172.21.15.53:0/1799907213 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f88d8066280 0x7f88d8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:20.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:20.968+0000 7f88f659c640 1 --2- 172.21.15.53:0/1799907213 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f88d8066280 0x7f88d8068730 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f88e8001ec0 tx=0x7f88e8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:20.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:20.968+0000 7f88e6ffd640 1 -- 172.21.15.53:0/1799907213 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f88ec0eb390 con 0x7f88f8159310 2023-06-10T18:54:21.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.124+0000 7f88fcf40640 1 -- 172.21.15.53:0/1799907213 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f88f808a200 con 0x7f88f8159310 2023-06-10T18:54:21.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.124+0000 7f88e6ffd640 1 -- 172.21.15.53:0/1799907213 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18339 (secure 0 0 0) 0x7f88ec0ee9b0 con 0x7f88f8159310 2023-06-10T18:54:21.136 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:54:21.136 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":37,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T18:53:55.739534+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-06-10T18:53:52.688764+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-06-10T18:53:53.727157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T18:54:21.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.128+0000 7f88fcf40640 1 -- 172.21.15.53:0/1799907213 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f88d8066280 msgr2=0x7f88d8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:21.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.128+0000 7f88fcf40640 1 --2- 172.21.15.53:0/1799907213 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f88d8066280 0x7f88d8068730 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f88e8001ec0 tx=0x7f88e8009040 comp rx=0 tx=0).stop 2023-06-10T18:54:21.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.128+0000 7f88fcf40640 1 -- 172.21.15.53:0/1799907213 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88f8159310 msgr2=0x7f88f80c5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:21.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.128+0000 7f88fcf40640 1 --2- 172.21.15.53:0/1799907213 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88f8159310 0x7f88f80c5b70 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f88ec01c210 tx=0x7f88e0005800 comp rx=0 tx=0).stop 2023-06-10T18:54:21.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.128+0000 7f88fcf40640 1 -- 172.21.15.53:0/1799907213 shutdown_connections 2023-06-10T18:54:21.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.128+0000 7f88fcf40640 1 --2- 172.21.15.53:0/1799907213 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f88d8066280 0x7f88d8068730 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:21.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.128+0000 7f88fcf40640 1 --2- 172.21.15.53:0/1799907213 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88f80b1aa0 0x7f88f80b1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:21.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.128+0000 7f88fcf40640 1 --2- 172.21.15.53:0/1799907213 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88f8159310 0x7f88f80c5b70 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:21.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.128+0000 7f88fcf40640 1 --2- 172.21.15.53:0/1799907213 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88e00047d0 0x7f88f80b0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:21.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.128+0000 7f88fcf40640 1 -- 172.21.15.53:0/1799907213 >> 172.21.15.53:0/1799907213 conn(0x7f88f8071790 msgr2=0x7f88f80b3e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:54:21.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.128+0000 7f88fcf40640 1 -- 172.21.15.53:0/1799907213 shutdown_connections 2023-06-10T18:54:21.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.128+0000 7f88fcf40640 1 -- 172.21.15.53:0/1799907213 wait complete. 2023-06-10T18:54:21.156 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-10T18:52:33.633114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-10T18:52:39.171487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-10T18:53:52.688764+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-06-10T18:53:53.727157+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-10T18:54:21.157 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-10T18:54:21.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.280+0000 7fd02869f640 1 Processor -- start 2023-06-10T18:54:21.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.280+0000 7fd02869f640 1 -- start start 2023-06-10T18:54:21.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.280+0000 7fd02869f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd020156180 0x7fd0200cd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:21.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.280+0000 7fd02869f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd02015c4f0 0x7fd020159190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:21.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.280+0000 7fd02869f640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd02006b090 con 0x7fd02015c070 2023-06-10T18:54:21.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.280+0000 7fd02869f640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd02006efa0 con 0x7fd020156180 2023-06-10T18:54:21.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.280+0000 7fd02869f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0200cc720 con 0x7fd02015c4f0 2023-06-10T18:54:21.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.280+0000 7fd02643b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd020156180 0x7fd0200cd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:21.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.280+0000 7fd025c3a640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fd02015c070 0x7fd020158a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60192/0 (socket says 172.21.15.53:60192) 2023-06-10T18:54:21.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.280+0000 7fd025c3a640 1 -- 172.21.15.53:0/993481138 learned_addr learned my addr 172.21.15.53:0/993481138 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:54:21.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.280+0000 7fd026c3c640 1 --2- 172.21.15.53:0/993481138 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd02015c4f0 0x7fd020159190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:21.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.280+0000 7fd02643b640 1 -- 172.21.15.53:0/993481138 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd02015c4f0 msgr2=0x7fd020159190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:54:21.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.280+0000 7fd02643b640 1 --2- 172.21.15.53:0/993481138 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd02015c4f0 0x7fd020159190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:21.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.280+0000 7fd02643b640 1 -- 172.21.15.53:0/993481138 >> v1:172.21.15.53:6789/0 conn(0x7fd02015c070 legacy=0x7fd020158a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:21.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.280+0000 7fd025439640 1 -- 172.21.15.53:0/993481138 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1004648730 0 0) 0x7fd02006b090 con 0x7fd02015c070 2023-06-10T18:54:21.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.280+0000 7fd02643b640 1 -- 172.21.15.53:0/993481138 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0200cc9a0 con 0x7fd020156180 2023-06-10T18:54:21.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.280+0000 7fd026c3c640 1 --2- 172.21.15.53:0/993481138 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd02015c4f0 0x7fd020159190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:54:21.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.288+0000 7fd02643b640 1 --2- 172.21.15.53:0/993481138 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd020156180 0x7fd0200cd4a0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fd0100097c0 tx=0x7fd01001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d243fd21123276b5 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:21.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.288+0000 7fd025439640 1 -- 172.21.15.53:0/993481138 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0100ab600 con 0x7fd020156180 2023-06-10T18:54:21.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.288+0000 7fd025439640 1 -- 172.21.15.53:0/993481138 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0100a7050 con 0x7fd020156180 2023-06-10T18:54:21.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.288+0000 7fd025439640 1 -- 172.21.15.53:0/993481138 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0100ab980 con 0x7fd020156180 2023-06-10T18:54:21.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.288+0000 7fd02869f640 1 -- 172.21.15.53:0/993481138 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd020156180 msgr2=0x7fd0200cd4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:21.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.288+0000 7fd02869f640 1 --2- 172.21.15.53:0/993481138 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd020156180 0x7fd0200cd4a0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fd0100097c0 tx=0x7fd01001c480 comp rx=0 tx=0).stop 2023-06-10T18:54:21.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.288+0000 7fd02869f640 1 -- 172.21.15.53:0/993481138 shutdown_connections 2023-06-10T18:54:21.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.288+0000 7fd02869f640 1 --2- 172.21.15.53:0/993481138 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd02015c4f0 0x7fd020159190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:21.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.288+0000 7fd02869f640 1 --2- 172.21.15.53:0/993481138 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd020156180 0x7fd0200cd4a0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:21.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.288+0000 7fd02869f640 1 -- 172.21.15.53:0/993481138 >> 172.21.15.53:0/993481138 conn(0x7fd02006a0e0 msgr2=0x7fd0200cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:54:21.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.288+0000 7fd02869f640 1 -- 172.21.15.53:0/993481138 shutdown_connections 2023-06-10T18:54:21.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.288+0000 7fd02869f640 1 -- 172.21.15.53:0/993481138 wait complete. 2023-06-10T18:54:21.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.288+0000 7fd02869f640 1 Processor -- start 2023-06-10T18:54:21.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.288+0000 7fd02869f640 1 -- start start 2023-06-10T18:54:21.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.292+0000 7fd02869f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd020156180 0x7fd0200b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:21.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.292+0000 7fd02869f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd02015c070 0x7fd0200b0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:21.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.292+0000 7fd02869f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd02015c4f0 0x7fd0200b1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:21.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.292+0000 7fd02869f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0200c5ff0 con 0x7fd02015c4f0 2023-06-10T18:54:21.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.292+0000 7fd02869f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0200c62d0 con 0x7fd020156180 2023-06-10T18:54:21.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.292+0000 7fd02869f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0200c65b0 con 0x7fd02015c070 2023-06-10T18:54:21.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.292+0000 7fd026c3c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd02015c4f0 0x7fd0200b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:21.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.292+0000 7fd026c3c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd02015c4f0 0x7fd0200b1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53976/0 (socket says 172.21.15.53:53976) 2023-06-10T18:54:21.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.292+0000 7fd026c3c640 1 -- 172.21.15.53:0/3425562114 learned_addr learned my addr 172.21.15.53:0/3425562114 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:54:21.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.292+0000 7fd02643b640 1 --2- 172.21.15.53:0/3425562114 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd020156180 0x7fd0200b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:21.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.292+0000 7fd025c3a640 1 --2- 172.21.15.53:0/3425562114 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd02015c070 0x7fd0200b0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:21.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.292+0000 7fd026c3c640 1 -- 172.21.15.53:0/3425562114 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd02015c070 msgr2=0x7fd0200b0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:21.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.292+0000 7fd026c3c640 1 --2- 172.21.15.53:0/3425562114 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd02015c070 0x7fd0200b0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:21.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.292+0000 7fd026c3c640 1 -- 172.21.15.53:0/3425562114 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd020156180 msgr2=0x7fd0200b32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:21.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.292+0000 7fd026c3c640 1 --2- 172.21.15.53:0/3425562114 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd020156180 0x7fd0200b32e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:21.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.292+0000 7fd026c3c640 1 -- 172.21.15.53:0/3425562114 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd010009420 con 0x7fd02015c4f0 2023-06-10T18:54:21.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.292+0000 7fd026c3c640 1 --2- 172.21.15.53:0/3425562114 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd02015c4f0 0x7fd0200b1050 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fd01800cd50 tx=0x7fd01800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:21.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.292+0000 7fd016ffd640 1 -- 172.21.15.53:0/3425562114 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd01800f680 con 0x7fd02015c4f0 2023-06-10T18:54:21.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.292+0000 7fd016ffd640 1 -- 172.21.15.53:0/3425562114 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd01800f800 con 0x7fd02015c4f0 2023-06-10T18:54:21.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.292+0000 7fd02869f640 1 -- 172.21.15.53:0/3425562114 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0200c6890 con 0x7fd02015c4f0 2023-06-10T18:54:21.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.292+0000 7fd016ffd640 1 -- 172.21.15.53:0/3425562114 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd01800fbb0 con 0x7fd02015c4f0 2023-06-10T18:54:21.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.292+0000 7fd02869f640 1 -- 172.21.15.53:0/3425562114 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0200b3820 con 0x7fd02015c4f0 2023-06-10T18:54:21.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.292+0000 7fd02869f640 1 -- 172.21.15.53:0/3425562114 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd02004d790 con 0x7fd02015c4f0 2023-06-10T18:54:21.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.292+0000 7fd016ffd640 1 -- 172.21.15.53:0/3425562114 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd01800b040 con 0x7fd02015c4f0 2023-06-10T18:54:21.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.292+0000 7fd016ffd640 1 --2- 172.21.15.53:0/3425562114 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd004066280 0x7fd004068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:21.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.292+0000 7fd016ffd640 1 -- 172.21.15.53:0/3425562114 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd018084790 con 0x7fd02015c4f0 2023-06-10T18:54:21.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.292+0000 7fd02643b640 1 --2- 172.21.15.53:0/3425562114 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd004066280 0x7fd004068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:21.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.296+0000 7fd02643b640 1 --2- 172.21.15.53:0/3425562114 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd004066280 0x7fd004068730 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd0100ad000 tx=0x7fd0100a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:21.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.296+0000 7fd016ffd640 1 -- 172.21.15.53:0/3425562114 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd018051b80 con 0x7fd02015c4f0 2023-06-10T18:54:21.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.456+0000 7fd02869f640 1 -- 172.21.15.53:0/3425562114 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd0200cc1b0 con 0x7fd02015c4f0 2023-06-10T18:54:21.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.456+0000 7fd016ffd640 1 -- 172.21.15.53:0/3425562114 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd0180551a0 con 0x7fd02015c4f0 2023-06-10T18:54:21.464 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-06-10T18:54:21.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.456+0000 7fd02869f640 1 -- 172.21.15.53:0/3425562114 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd004066280 msgr2=0x7fd004068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:21.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.456+0000 7fd02869f640 1 --2- 172.21.15.53:0/3425562114 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd004066280 0x7fd004068730 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd0100ad000 tx=0x7fd0100a6000 comp rx=0 tx=0).stop 2023-06-10T18:54:21.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.456+0000 7fd02869f640 1 -- 172.21.15.53:0/3425562114 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd02015c4f0 msgr2=0x7fd0200b1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:21.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.456+0000 7fd02869f640 1 --2- 172.21.15.53:0/3425562114 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd02015c4f0 0x7fd0200b1050 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fd01800cd50 tx=0x7fd01800a650 comp rx=0 tx=0).stop 2023-06-10T18:54:21.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.456+0000 7fd02869f640 1 -- 172.21.15.53:0/3425562114 shutdown_connections 2023-06-10T18:54:21.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.456+0000 7fd02869f640 1 --2- 172.21.15.53:0/3425562114 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd004066280 0x7fd004068730 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:21.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.456+0000 7fd02869f640 1 --2- 172.21.15.53:0/3425562114 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd02015c4f0 0x7fd0200b1050 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:21.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.456+0000 7fd02869f640 1 --2- 172.21.15.53:0/3425562114 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd02015c070 0x7fd0200b0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:21.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.456+0000 7fd02869f640 1 --2- 172.21.15.53:0/3425562114 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd020156180 0x7fd0200b32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:21.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.456+0000 7fd02869f640 1 -- 172.21.15.53:0/3425562114 >> 172.21.15.53:0/3425562114 conn(0x7fd02006a0e0 msgr2=0x7fd02006b700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:54:21.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.456+0000 7fd02869f640 1 -- 172.21.15.53:0/3425562114 shutdown_connections 2023-06-10T18:54:21.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.456+0000 7fd02869f640 1 -- 172.21.15.53:0/3425562114 wait complete. 2023-06-10T18:54:21.484 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-10T18:54:21.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.596+0000 7f34ab4a4640 1 Processor -- start 2023-06-10T18:54:21.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.596+0000 7f34ab4a4640 1 -- start start 2023-06-10T18:54:21.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.596+0000 7f34ab4a4640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f34a415b870 0x7f34a406a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:21.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.596+0000 7f34ab4a4640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f34a40affc0 0x7f34a40b03f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:21.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.596+0000 7f34ab4a4640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34a406ae70 con 0x7f34a4069450 2023-06-10T18:54:21.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.596+0000 7f34ab4a4640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34a40b0930 con 0x7f34a415b870 2023-06-10T18:54:21.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.596+0000 7f34ab4a4640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34a40655c0 con 0x7f34a40affc0 2023-06-10T18:54:21.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.596+0000 7f34a9240640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f34a415b870 0x7f34a406a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:21.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.596+0000 7f34a9240640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f34a415b870 0x7f34a406a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53988/0 (socket says 172.21.15.53:53988) 2023-06-10T18:54:21.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.596+0000 7f34a9240640 1 -- 172.21.15.53:0/2102674247 learned_addr learned my addr 172.21.15.53:0/2102674247 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:54:21.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.596+0000 7f34a8a3f640 1 --2- 172.21.15.53:0/2102674247 >> v2:172.21.15.117:3300/0 conn(0x7f34a40affc0 0x7f34a40b03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:21.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.596+0000 7f34a9240640 1 -- 172.21.15.53:0/2102674247 >> v2:172.21.15.117:3300/0 conn(0x7f34a40affc0 msgr2=0x7f34a40b03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:54:21.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.596+0000 7f34a9240640 1 --2- 172.21.15.53:0/2102674247 >> v2:172.21.15.117:3300/0 conn(0x7f34a40affc0 0x7f34a40b03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:21.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.596+0000 7f34a9240640 1 -- 172.21.15.53:0/2102674247 >> v1:172.21.15.117:6789/0 conn(0x7f34a4069450 legacy=0x7f34a40698b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:54:21.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.596+0000 7f34a9240640 1 -- 172.21.15.53:0/2102674247 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a40cc110 con 0x7f34a415b870 2023-06-10T18:54:21.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.600+0000 7f34a9240640 1 --2- 172.21.15.53:0/2102674247 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34a415b870 0x7f34a406a930 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f34a40c9660 tx=0x7f349401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e32740293f3141fd server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:21.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.600+0000 7f349bfff640 1 -- 172.21.15.53:0/2102674247 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34940ab600 con 0x7f34a415b870 2023-06-10T18:54:21.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.600+0000 7f349bfff640 1 -- 172.21.15.53:0/2102674247 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34940a7050 con 0x7f34a415b870 2023-06-10T18:54:21.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.600+0000 7f349bfff640 1 -- 172.21.15.53:0/2102674247 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34940ab980 con 0x7f34a415b870 2023-06-10T18:54:21.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.600+0000 7f34ab4a4640 1 -- 172.21.15.53:0/2102674247 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34a415b870 msgr2=0x7f34a406a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:21.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.600+0000 7f34ab4a4640 1 --2- 172.21.15.53:0/2102674247 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34a415b870 0x7f34a406a930 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f34a40c9660 tx=0x7f349401c400 comp rx=0 tx=0).stop 2023-06-10T18:54:21.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.600+0000 7f34ab4a4640 1 -- 172.21.15.53:0/2102674247 shutdown_connections 2023-06-10T18:54:21.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.600+0000 7f34ab4a4640 1 --2- 172.21.15.53:0/2102674247 >> v2:172.21.15.117:3300/0 conn(0x7f34a40affc0 0x7f34a40b03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:21.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.600+0000 7f34ab4a4640 1 --2- 172.21.15.53:0/2102674247 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34a415b870 0x7f34a406a930 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:21.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.600+0000 7f34ab4a4640 1 -- 172.21.15.53:0/2102674247 >> 172.21.15.53:0/2102674247 conn(0x7f34a40cafc0 msgr2=0x7f34a40cb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:54:21.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.600+0000 7f34ab4a4640 1 -- 172.21.15.53:0/2102674247 shutdown_connections 2023-06-10T18:54:21.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.600+0000 7f34ab4a4640 1 -- 172.21.15.53:0/2102674247 wait complete. 2023-06-10T18:54:21.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.600+0000 7f34ab4a4640 1 Processor -- start 2023-06-10T18:54:21.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.600+0000 7f34ab4a4640 1 -- start start 2023-06-10T18:54:21.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.604+0000 7f34ab4a4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34a4069450 0x7f34a40c3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:21.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.604+0000 7f34ab4a4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f34a40affc0 0x7f34a406fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:21.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.604+0000 7f34ab4a4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34a415b870 0x7f34a40c2070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:21.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.604+0000 7f34ab4a4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a40c2ac0 con 0x7f34a415b870 2023-06-10T18:54:21.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.604+0000 7f34ab4a4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a40c2da0 con 0x7f34a4069450 2023-06-10T18:54:21.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.604+0000 7f34ab4a4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34a40c3080 con 0x7f34a40affc0 2023-06-10T18:54:21.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.604+0000 7f34a9a41640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34a415b870 0x7f34a40c2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:21.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.604+0000 7f34a9a41640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34a415b870 0x7f34a40c2070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53990/0 (socket says 172.21.15.53:53990) 2023-06-10T18:54:21.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.604+0000 7f34a9a41640 1 -- 172.21.15.53:0/3358611469 learned_addr learned my addr 172.21.15.53:0/3358611469 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:54:21.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.604+0000 7f34a9240640 1 --2- 172.21.15.53:0/3358611469 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34a4069450 0x7f34a40c3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:21.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.604+0000 7f34a8a3f640 1 --2- 172.21.15.53:0/3358611469 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f34a40affc0 0x7f34a406fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:21.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.604+0000 7f34a9a41640 1 -- 172.21.15.53:0/3358611469 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f34a40affc0 msgr2=0x7f34a406fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:21.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.604+0000 7f34a9a41640 1 --2- 172.21.15.53:0/3358611469 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f34a40affc0 0x7f34a406fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:21.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.604+0000 7f34a9a41640 1 -- 172.21.15.53:0/3358611469 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34a4069450 msgr2=0x7f34a40c3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:21.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.604+0000 7f34a9a41640 1 --2- 172.21.15.53:0/3358611469 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34a4069450 0x7f34a40c3b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:21.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.604+0000 7f34a9a41640 1 -- 172.21.15.53:0/3358611469 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34940094d0 con 0x7f34a415b870 2023-06-10T18:54:21.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.604+0000 7f34a8a3f640 1 --2- 172.21.15.53:0/3358611469 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f34a40affc0 0x7f34a406fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:54:21.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.604+0000 7f34a9a41640 1 --2- 172.21.15.53:0/3358611469 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34a415b870 0x7f34a40c2070 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f349c00b970 tx=0x7f349c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:21.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.604+0000 7f3499ffb640 1 -- 172.21.15.53:0/3358611469 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349c00cb40 con 0x7f34a415b870 2023-06-10T18:54:21.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.604+0000 7f3499ffb640 1 -- 172.21.15.53:0/3358611469 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f349c00cca0 con 0x7f34a415b870 2023-06-10T18:54:21.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.604+0000 7f34ab4a4640 1 -- 172.21.15.53:0/3358611469 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34a40c3360 con 0x7f34a415b870 2023-06-10T18:54:21.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.604+0000 7f3499ffb640 1 -- 172.21.15.53:0/3358611469 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349c014680 con 0x7f34a415b870 2023-06-10T18:54:21.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.604+0000 7f34ab4a4640 1 -- 172.21.15.53:0/3358611469 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34a41530f0 con 0x7f34a415b870 2023-06-10T18:54:21.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.604+0000 7f34ab4a4640 1 -- 172.21.15.53:0/3358611469 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34a404d790 con 0x7f34a415b870 2023-06-10T18:54:21.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.604+0000 7f3499ffb640 1 -- 172.21.15.53:0/3358611469 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f349c01d3b0 con 0x7f34a415b870 2023-06-10T18:54:21.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.604+0000 7f3499ffb640 1 --2- 172.21.15.53:0/3358611469 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3488066280 0x7f3488068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:21.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.604+0000 7f3499ffb640 1 -- 172.21.15.53:0/3358611469 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f349c083c10 con 0x7f34a415b870 2023-06-10T18:54:21.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.604+0000 7f34a9240640 1 --2- 172.21.15.53:0/3358611469 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3488066280 0x7f3488068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:21.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.608+0000 7f34a9240640 1 --2- 172.21.15.53:0/3358611469 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3488066280 0x7f3488068730 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f34940ad000 tx=0x7f3494008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:21.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.612+0000 7f3499ffb640 1 -- 172.21.15.53:0/3358611469 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f349c051000 con 0x7f34a415b870 2023-06-10T18:54:21.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.764+0000 7f34ab4a4640 1 -- 172.21.15.53:0/3358611469 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f34a40b44c0 con 0x7f34a415b870 2023-06-10T18:54:21.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.764+0000 7f3499ffb640 1 -- 172.21.15.53:0/3358611469 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v37) v1 ==== 92+0+10 (secure 0 0 0) 0x7f349c0190a0 con 0x7f34a415b870 2023-06-10T18:54:21.773 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-06-10T18:54:21.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.768+0000 7f34ab4a4640 1 -- 172.21.15.53:0/3358611469 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3488066280 msgr2=0x7f3488068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:21.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.768+0000 7f34ab4a4640 1 --2- 172.21.15.53:0/3358611469 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3488066280 0x7f3488068730 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f34940ad000 tx=0x7f3494008040 comp rx=0 tx=0).stop 2023-06-10T18:54:21.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.768+0000 7f34ab4a4640 1 -- 172.21.15.53:0/3358611469 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34a415b870 msgr2=0x7f34a40c2070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:21.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.768+0000 7f34ab4a4640 1 --2- 172.21.15.53:0/3358611469 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34a415b870 0x7f34a40c2070 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f349c00b970 tx=0x7f349c00be30 comp rx=0 tx=0).stop 2023-06-10T18:54:21.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.768+0000 7f34ab4a4640 1 -- 172.21.15.53:0/3358611469 shutdown_connections 2023-06-10T18:54:21.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.768+0000 7f34ab4a4640 1 --2- 172.21.15.53:0/3358611469 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3488066280 0x7f3488068730 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:21.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.768+0000 7f34ab4a4640 1 --2- 172.21.15.53:0/3358611469 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34a415b870 0x7f34a40c2070 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:21.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.768+0000 7f34ab4a4640 1 --2- 172.21.15.53:0/3358611469 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f34a40affc0 0x7f34a406fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:21.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.768+0000 7f34ab4a4640 1 --2- 172.21.15.53:0/3358611469 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34a4069450 0x7f34a40c3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:21.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.768+0000 7f34ab4a4640 1 -- 172.21.15.53:0/3358611469 >> 172.21.15.53:0/3358611469 conn(0x7f34a40cafc0 msgr2=0x7f34a40b3460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:54:21.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.768+0000 7f34ab4a4640 1 -- 172.21.15.53:0/3358611469 shutdown_connections 2023-06-10T18:54:21.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.768+0000 7f34ab4a4640 1 -- 172.21.15.53:0/3358611469 wait complete. 2023-06-10T18:54:21.793 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-10T18:54:21.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.908+0000 7f2cea412640 1 Processor -- start 2023-06-10T18:54:21.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.908+0000 7f2cea412640 1 -- start start 2023-06-10T18:54:21.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.908+0000 7f2cea412640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2ce40c9fa0 0x7f2ce406bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:21.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.908+0000 7f2cea412640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2ce406c020 0x7f2ce40c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:21.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.908+0000 7f2cea412640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ce406b090 con 0x7f2ce40c87e0 2023-06-10T18:54:21.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.908+0000 7f2cea412640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ce40ca370 con 0x7f2ce40c9fa0 2023-06-10T18:54:21.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.908+0000 7f2cea412640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ce4070d50 con 0x7f2ce406c020 2023-06-10T18:54:21.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.908+0000 7f2ce3fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2ce40c9fa0 0x7f2ce406bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:21.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.908+0000 7f2ce3fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2ce40c9fa0 0x7f2ce406bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54006/0 (socket says 172.21.15.53:54006) 2023-06-10T18:54:21.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.908+0000 7f2ce3fff640 1 -- 172.21.15.53:0/898175257 learned_addr learned my addr 172.21.15.53:0/898175257 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:54:21.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.908+0000 7f2ce37fe640 1 --2- 172.21.15.53:0/898175257 >> v2:172.21.15.117:3300/0 conn(0x7f2ce406c020 0x7f2ce40c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:21.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.908+0000 7f2ce3fff640 1 -- 172.21.15.53:0/898175257 >> v2:172.21.15.117:3300/0 conn(0x7f2ce406c020 msgr2=0x7f2ce40c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:54:21.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.908+0000 7f2ce3fff640 1 --2- 172.21.15.53:0/898175257 >> v2:172.21.15.117:3300/0 conn(0x7f2ce406c020 0x7f2ce40c82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:21.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.908+0000 7f2ce3fff640 1 -- 172.21.15.53:0/898175257 >> v1:172.21.15.117:6789/0 conn(0x7f2ce40c87e0 legacy=0x7f2ce40af760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:54:21.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.908+0000 7f2ce3fff640 1 -- 172.21.15.53:0/898175257 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ce4071030 con 0x7f2ce40c9fa0 2023-06-10T18:54:21.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.908+0000 7f2ce37fe640 1 --2- 172.21.15.53:0/898175257 >> v2:172.21.15.117:3300/0 conn(0x7f2ce406c020 0x7f2ce40c82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:54:21.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.912+0000 7f2ce3fff640 1 --2- 172.21.15.53:0/898175257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2ce40c9fa0 0x7f2ce406bae0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f2ce406ecb0 tx=0x7f2ccc01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cb4eff00316e320 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:21.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.912+0000 7f2ce2ffd640 1 -- 172.21.15.53:0/898175257 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ccc0ac640 con 0x7f2ce40c9fa0 2023-06-10T18:54:21.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.912+0000 7f2ce2ffd640 1 -- 172.21.15.53:0/898175257 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ccc0ac7a0 con 0x7f2ce40c9fa0 2023-06-10T18:54:21.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.912+0000 7f2ce2ffd640 1 -- 172.21.15.53:0/898175257 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ccc0acb30 con 0x7f2ce40c9fa0 2023-06-10T18:54:21.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.912+0000 7f2cea412640 1 -- 172.21.15.53:0/898175257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2ce40c9fa0 msgr2=0x7f2ce406bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:21.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.912+0000 7f2cea412640 1 --2- 172.21.15.53:0/898175257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2ce40c9fa0 0x7f2ce406bae0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f2ce406ecb0 tx=0x7f2ccc01c400 comp rx=0 tx=0).stop 2023-06-10T18:54:21.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.912+0000 7f2cea412640 1 -- 172.21.15.53:0/898175257 shutdown_connections 2023-06-10T18:54:21.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.912+0000 7f2cea412640 1 --2- 172.21.15.53:0/898175257 >> v2:172.21.15.117:3300/0 conn(0x7f2ce406c020 0x7f2ce40c82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:21.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.912+0000 7f2cea412640 1 --2- 172.21.15.53:0/898175257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2ce40c9fa0 0x7f2ce406bae0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:21.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.912+0000 7f2cea412640 1 -- 172.21.15.53:0/898175257 >> 172.21.15.53:0/898175257 conn(0x7f2ce406a0e0 msgr2=0x7f2ce40cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:54:21.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.912+0000 7f2cea412640 1 -- 172.21.15.53:0/898175257 shutdown_connections 2023-06-10T18:54:21.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.912+0000 7f2cea412640 1 -- 172.21.15.53:0/898175257 wait complete. 2023-06-10T18:54:21.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.912+0000 7f2cea412640 1 Processor -- start 2023-06-10T18:54:21.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.912+0000 7f2cea412640 1 -- start start 2023-06-10T18:54:21.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.912+0000 7f2cea412640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ce406c020 0x7f2ce41f1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:21.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.912+0000 7f2cea412640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ce40c87e0 0x7f2ce41f48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:21.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.912+0000 7f2cea412640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2ce40c9fa0 0x7f2ce40afd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:21.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.912+0000 7f2cea412640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce40a8710 con 0x7f2ce40c9fa0 2023-06-10T18:54:21.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.912+0000 7f2cea412640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce41f4de0 con 0x7f2ce406c020 2023-06-10T18:54:21.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.912+0000 7f2cea412640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce40a7a90 con 0x7f2ce40c87e0 2023-06-10T18:54:21.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.912+0000 7f2ce89af640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2ce40c9fa0 0x7f2ce40afd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:21.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.912+0000 7f2ce89af640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2ce40c9fa0 0x7f2ce40afd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54020/0 (socket says 172.21.15.53:54020) 2023-06-10T18:54:21.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.912+0000 7f2ce89af640 1 -- 172.21.15.53:0/1497840752 learned_addr learned my addr 172.21.15.53:0/1497840752 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:54:21.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.912+0000 7f2ce37fe640 1 --2- 172.21.15.53:0/1497840752 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ce40c87e0 0x7f2ce41f48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:21.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.912+0000 7f2ce3fff640 1 --2- 172.21.15.53:0/1497840752 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ce406c020 0x7f2ce41f1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:21.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.912+0000 7f2ce89af640 1 -- 172.21.15.53:0/1497840752 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ce40c87e0 msgr2=0x7f2ce41f48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:21.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.912+0000 7f2ce89af640 1 --2- 172.21.15.53:0/1497840752 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ce40c87e0 0x7f2ce41f48a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:21.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.912+0000 7f2ce89af640 1 -- 172.21.15.53:0/1497840752 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ce406c020 msgr2=0x7f2ce41f1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:21.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.912+0000 7f2ce89af640 1 --2- 172.21.15.53:0/1497840752 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ce406c020 0x7f2ce41f1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:21.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.912+0000 7f2ce89af640 1 -- 172.21.15.53:0/1497840752 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ccc0094d0 con 0x7f2ce40c9fa0 2023-06-10T18:54:21.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.916+0000 7f2ce89af640 1 --2- 172.21.15.53:0/1497840752 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2ce40c9fa0 0x7f2ce40afd30 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc00c3c0 tx=0x7f2cdc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:21.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.916+0000 7f2ce0ff9640 1 -- 172.21.15.53:0/1497840752 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc011790 con 0x7f2ce40c9fa0 2023-06-10T18:54:21.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.916+0000 7f2ce0ff9640 1 -- 172.21.15.53:0/1497840752 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cdc0118f0 con 0x7f2ce40c9fa0 2023-06-10T18:54:21.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.916+0000 7f2cea412640 1 -- 172.21.15.53:0/1497840752 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ce40a7d70 con 0x7f2ce40c9fa0 2023-06-10T18:54:21.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.916+0000 7f2ce0ff9640 1 -- 172.21.15.53:0/1497840752 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc011ca0 con 0x7f2ce40c9fa0 2023-06-10T18:54:21.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.916+0000 7f2cea412640 1 -- 172.21.15.53:0/1497840752 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ce40a8330 con 0x7f2ce40c9fa0 2023-06-10T18:54:21.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.916+0000 7f2cea412640 1 -- 172.21.15.53:0/1497840752 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ce40a8850 con 0x7f2ce40c9fa0 2023-06-10T18:54:21.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.916+0000 7f2ce0ff9640 1 -- 172.21.15.53:0/1497840752 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2cdc01c460 con 0x7f2ce40c9fa0 2023-06-10T18:54:21.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.916+0000 7f2ce0ff9640 1 --2- 172.21.15.53:0/1497840752 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2cc4066280 0x7f2cc4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:21.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.916+0000 7f2ce0ff9640 1 -- 172.21.15.53:0/1497840752 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2cdc083b90 con 0x7f2ce40c9fa0 2023-06-10T18:54:21.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.916+0000 7f2ce3fff640 1 --2- 172.21.15.53:0/1497840752 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2cc4066280 0x7f2cc4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:21.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.916+0000 7f2ce3fff640 1 --2- 172.21.15.53:0/1497840752 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2cc4066280 0x7f2cc4068730 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc0ae000 tx=0x7f2ccc0a6070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:21.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:21.920+0000 7f2ce0ff9640 1 -- 172.21.15.53:0/1497840752 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2ce40a8850 con 0x7f2ce40c9fa0 2023-06-10T18:54:22.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.072+0000 7f2cea412640 1 -- 172.21.15.53:0/1497840752 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2ce40a8850 con 0x7f2ce40c9fa0 2023-06-10T18:54:22.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.072+0000 7f2ce0ff9640 1 -- 172.21.15.53:0/1497840752 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v37) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2ce40a8850 con 0x7f2ce40c9fa0 2023-06-10T18:54:22.081 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-06-10T18:54:22.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.072+0000 7f2cea412640 1 -- 172.21.15.53:0/1497840752 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2cc4066280 msgr2=0x7f2cc4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:22.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.072+0000 7f2cea412640 1 --2- 172.21.15.53:0/1497840752 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2cc4066280 0x7f2cc4068730 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc0ae000 tx=0x7f2ccc0a6070 comp rx=0 tx=0).stop 2023-06-10T18:54:22.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.072+0000 7f2cea412640 1 -- 172.21.15.53:0/1497840752 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2ce40c9fa0 msgr2=0x7f2ce40afd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:22.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.072+0000 7f2cea412640 1 --2- 172.21.15.53:0/1497840752 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2ce40c9fa0 0x7f2ce40afd30 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc00c3c0 tx=0x7f2cdc00c880 comp rx=0 tx=0).stop 2023-06-10T18:54:22.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.072+0000 7f2cea412640 1 -- 172.21.15.53:0/1497840752 shutdown_connections 2023-06-10T18:54:22.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.072+0000 7f2cea412640 1 --2- 172.21.15.53:0/1497840752 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2cc4066280 0x7f2cc4068730 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:22.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.072+0000 7f2cea412640 1 --2- 172.21.15.53:0/1497840752 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2ce40c9fa0 0x7f2ce40afd30 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:22.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.072+0000 7f2cea412640 1 --2- 172.21.15.53:0/1497840752 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2ce40c87e0 0x7f2ce41f48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:22.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.072+0000 7f2cea412640 1 --2- 172.21.15.53:0/1497840752 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ce406c020 0x7f2ce41f1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:22.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.072+0000 7f2cea412640 1 -- 172.21.15.53:0/1497840752 >> 172.21.15.53:0/1497840752 conn(0x7f2ce406a0e0 msgr2=0x7f2ce40c4d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:54:22.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.072+0000 7f2cea412640 1 -- 172.21.15.53:0/1497840752 shutdown_connections 2023-06-10T18:54:22.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.072+0000 7f2cea412640 1 -- 172.21.15.53:0/1497840752 wait complete. 2023-06-10T18:54:22.099 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-10T18:54:22.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.220+0000 7fc311f23640 1 Processor -- start 2023-06-10T18:54:22.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.220+0000 7fc311f23640 1 -- start start 2023-06-10T18:54:22.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.220+0000 7fc311f23640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc30c0afe70 0x7fc30c0c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:22.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.220+0000 7fc311f23640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc30c06b090 con 0x7fc30c0c82a0 2023-06-10T18:54:22.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.220+0000 7fc311f23640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc30c0ca370 con 0x7fc30c0c9fa0 2023-06-10T18:54:22.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.220+0000 7fc311f23640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc30c070d50 con 0x7fc30c0afe70 2023-06-10T18:54:22.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.220+0000 7fc303fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fc30c0c82a0 0x7fc30c0af760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60208/0 (socket says 172.21.15.53:60208) 2023-06-10T18:54:22.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.220+0000 7fc303fff640 1 -- 172.21.15.53:0/1573424593 learned_addr learned my addr 172.21.15.53:0/1573424593 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:54:22.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.220+0000 7fc30bfff640 1 --2- 172.21.15.53:0/1573424593 >> v2:172.21.15.53:3300/0 conn(0x7fc30c0afe70 0x7fc30c0c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:22.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.220+0000 7fc30affd640 1 -- 172.21.15.53:0/1573424593 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4011603473 0 0) 0x7fc30c06b090 con 0x7fc30c0c82a0 2023-06-10T18:54:22.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.220+0000 7fc30affd640 1 -- 172.21.15.53:0/1573424593 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2ec003530 con 0x7fc30c0c82a0 2023-06-10T18:54:22.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.220+0000 7fc30bfff640 1 -- 172.21.15.53:0/1573424593 >> v1:172.21.15.117:6789/0 conn(0x7fc30c0c9fa0 legacy=0x7fc30c06bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:54:22.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.220+0000 7fc30bfff640 1 -- 172.21.15.53:0/1573424593 >> v1:172.21.15.53:6789/0 conn(0x7fc30c0c82a0 legacy=0x7fc30c0af760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:22.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.220+0000 7fc30bfff640 1 -- 172.21.15.53:0/1573424593 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc30c071030 con 0x7fc30c0afe70 2023-06-10T18:54:22.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.224+0000 7fc30bfff640 1 --2- 172.21.15.53:0/1573424593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc30c0afe70 0x7fc30c0c86f0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fc304009d90 tx=0x7fc30401c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb97db4fef232955 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:22.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.224+0000 7fc30affd640 1 -- 172.21.15.53:0/1573424593 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3040a5910 con 0x7fc30c0afe70 2023-06-10T18:54:22.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.224+0000 7fc30affd640 1 -- 172.21.15.53:0/1573424593 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3040a5a70 con 0x7fc30c0afe70 2023-06-10T18:54:22.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.224+0000 7fc30affd640 1 -- 172.21.15.53:0/1573424593 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3040a5e00 con 0x7fc30c0afe70 2023-06-10T18:54:22.232 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.224+0000 7fc311f23640 1 -- 172.21.15.53:0/1573424593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc30c0afe70 msgr2=0x7fc30c0c86f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:22.232 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.224+0000 7fc311f23640 1 --2- 172.21.15.53:0/1573424593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc30c0afe70 0x7fc30c0c86f0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fc304009d90 tx=0x7fc30401c850 comp rx=0 tx=0).stop 2023-06-10T18:54:22.232 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.224+0000 7fc311f23640 1 -- 172.21.15.53:0/1573424593 shutdown_connections 2023-06-10T18:54:22.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.224+0000 7fc311f23640 1 --2- 172.21.15.53:0/1573424593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc30c0afe70 0x7fc30c0c86f0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:22.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.224+0000 7fc311f23640 1 -- 172.21.15.53:0/1573424593 >> 172.21.15.53:0/1573424593 conn(0x7fc30c06a0e0 msgr2=0x7fc30c0cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:54:22.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.224+0000 7fc311f23640 1 -- 172.21.15.53:0/1573424593 shutdown_connections 2023-06-10T18:54:22.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.224+0000 7fc311f23640 1 -- 172.21.15.53:0/1573424593 wait complete. 2023-06-10T18:54:22.235 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.224+0000 7fc311f23640 1 Processor -- start 2023-06-10T18:54:22.235 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.224+0000 7fc311f23640 1 -- start start 2023-06-10T18:54:22.235 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.224+0000 7fc311f23640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc30c0afe70 0x7fc30c1f2420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:22.235 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.224+0000 7fc311f23640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc30c0c82a0 0x7fc30c0af1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:22.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.224+0000 7fc311f23640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc30c0c9fa0 0x7fc30c0af720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:22.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.224+0000 7fc311f23640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc30c153b70 con 0x7fc30c0c82a0 2023-06-10T18:54:22.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.224+0000 7fc311f23640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc30c152f60 con 0x7fc30c0afe70 2023-06-10T18:54:22.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.224+0000 7fc311f23640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc30c153240 con 0x7fc30c0c9fa0 2023-06-10T18:54:22.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.224+0000 7fc303fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc30c0c82a0 0x7fc30c0af1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:22.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.224+0000 7fc303fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc30c0c82a0 0x7fc30c0af1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54026/0 (socket says 172.21.15.53:54026) 2023-06-10T18:54:22.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.224+0000 7fc303fff640 1 -- 172.21.15.53:0/69027385 learned_addr learned my addr 172.21.15.53:0/69027385 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:54:22.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.224+0000 7fc30bfff640 1 --2- 172.21.15.53:0/69027385 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc30c0c9fa0 0x7fc30c0af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:22.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.224+0000 7fc30b7fe640 1 --2- 172.21.15.53:0/69027385 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc30c0afe70 0x7fc30c1f2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:22.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.224+0000 7fc303fff640 1 -- 172.21.15.53:0/69027385 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc30c0c9fa0 msgr2=0x7fc30c0af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:22.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.224+0000 7fc303fff640 1 --2- 172.21.15.53:0/69027385 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc30c0c9fa0 0x7fc30c0af720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:22.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.224+0000 7fc303fff640 1 -- 172.21.15.53:0/69027385 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc30c0afe70 msgr2=0x7fc30c1f2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:22.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.224+0000 7fc303fff640 1 --2- 172.21.15.53:0/69027385 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc30c0afe70 0x7fc30c1f2420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:22.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.224+0000 7fc303fff640 1 -- 172.21.15.53:0/69027385 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc304009a70 con 0x7fc30c0c82a0 2023-06-10T18:54:22.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.224+0000 7fc303fff640 1 --2- 172.21.15.53:0/69027385 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc30c0c82a0 0x7fc30c0af1e0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fc2f400c450 tx=0x7fc2f400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:22.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.224+0000 7fc308ff9640 1 -- 172.21.15.53:0/69027385 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f4005cf0 con 0x7fc30c0c82a0 2023-06-10T18:54:22.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.224+0000 7fc308ff9640 1 -- 172.21.15.53:0/69027385 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2f4005e50 con 0x7fc30c0c82a0 2023-06-10T18:54:22.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.224+0000 7fc308ff9640 1 -- 172.21.15.53:0/69027385 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f4007290 con 0x7fc30c0c82a0 2023-06-10T18:54:22.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.228+0000 7fc311f23640 1 -- 172.21.15.53:0/69027385 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc30c153520 con 0x7fc30c0c82a0 2023-06-10T18:54:22.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.228+0000 7fc311f23640 1 -- 172.21.15.53:0/69027385 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc30c0c4860 con 0x7fc30c0c82a0 2023-06-10T18:54:22.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.228+0000 7fc311f23640 1 -- 172.21.15.53:0/69027385 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc30c153ce0 con 0x7fc30c0c82a0 2023-06-10T18:54:22.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.228+0000 7fc308ff9640 1 -- 172.21.15.53:0/69027385 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc2f40073f0 con 0x7fc30c0c82a0 2023-06-10T18:54:22.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.228+0000 7fc308ff9640 1 --2- 172.21.15.53:0/69027385 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc2f0066280 0x7fc2f0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:22.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.228+0000 7fc308ff9640 1 -- 172.21.15.53:0/69027385 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc2f4083390 con 0x7fc30c0c82a0 2023-06-10T18:54:22.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.228+0000 7fc30b7fe640 1 --2- 172.21.15.53:0/69027385 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc2f0066280 0x7fc2f0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:22.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.228+0000 7fc30b7fe640 1 --2- 172.21.15.53:0/69027385 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc2f0066280 0x7fc2f0068730 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc00a750 tx=0x7fc2fc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:22.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.232+0000 7fc308ff9640 1 -- 172.21.15.53:0/69027385 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc2f4050780 con 0x7fc30c0c82a0 2023-06-10T18:54:22.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.384+0000 7fc311f23640 1 -- 172.21.15.53:0/69027385 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc30c04d790 con 0x7fc30c0c82a0 2023-06-10T18:54:22.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.384+0000 7fc308ff9640 1 -- 172.21.15.53:0/69027385 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v37) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc2f4017020 con 0x7fc30c0c82a0 2023-06-10T18:54:22.392 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-06-10T18:54:22.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.384+0000 7fc311f23640 1 -- 172.21.15.53:0/69027385 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc2f0066280 msgr2=0x7fc2f0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:22.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.384+0000 7fc311f23640 1 --2- 172.21.15.53:0/69027385 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc2f0066280 0x7fc2f0068730 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc00a750 tx=0x7fc2fc008040 comp rx=0 tx=0).stop 2023-06-10T18:54:22.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.384+0000 7fc311f23640 1 -- 172.21.15.53:0/69027385 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc30c0c82a0 msgr2=0x7fc30c0af1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:22.395 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.384+0000 7fc311f23640 1 --2- 172.21.15.53:0/69027385 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc30c0c82a0 0x7fc30c0af1e0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fc2f400c450 tx=0x7fc2f400c910 comp rx=0 tx=0).stop 2023-06-10T18:54:22.395 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.384+0000 7fc311f23640 1 -- 172.21.15.53:0/69027385 shutdown_connections 2023-06-10T18:54:22.395 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.384+0000 7fc311f23640 1 --2- 172.21.15.53:0/69027385 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc2f0066280 0x7fc2f0068730 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:22.395 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.384+0000 7fc311f23640 1 --2- 172.21.15.53:0/69027385 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc30c0c9fa0 0x7fc30c0af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:22.395 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.384+0000 7fc311f23640 1 --2- 172.21.15.53:0/69027385 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc30c0c82a0 0x7fc30c0af1e0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:22.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.384+0000 7fc311f23640 1 --2- 172.21.15.53:0/69027385 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc30c0afe70 0x7fc30c1f2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:22.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.384+0000 7fc311f23640 1 -- 172.21.15.53:0/69027385 >> 172.21.15.53:0/69027385 conn(0x7fc30c06a0e0 msgr2=0x7fc30c0b2a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:54:22.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.384+0000 7fc311f23640 1 -- 172.21.15.53:0/69027385 shutdown_connections 2023-06-10T18:54:22.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.384+0000 7fc311f23640 1 -- 172.21.15.53:0/69027385 wait complete. 2023-06-10T18:54:22.411 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-10T18:54:22.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.528+0000 7f1176079640 1 Processor -- start 2023-06-10T18:54:22.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.528+0000 7f1176079640 1 -- start start 2023-06-10T18:54:22.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.528+0000 7f1176079640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f11700c1c30 0x7f117006cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:22.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.528+0000 7f1176079640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1170070930 0x7f1170070d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:22.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.528+0000 7f1176079640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f117006c340 con 0x7f117015fcd0 2023-06-10T18:54:22.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.528+0000 7f1176079640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11700b1890 con 0x7f1170070930 2023-06-10T18:54:22.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.528+0000 7f1176079640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f117006a1b0 con 0x7f11700c1c30 2023-06-10T18:54:22.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.528+0000 7f116ffff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1170070930 0x7f1170070d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:22.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.528+0000 7f116f7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f117015fcd0 0x7f11700b1180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60214/0 (socket says 172.21.15.53:60214) 2023-06-10T18:54:22.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.528+0000 7f116f7fe640 1 -- 172.21.15.53:0/735256199 learned_addr learned my addr 172.21.15.53:0/735256199 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:54:22.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.528+0000 7f116effd640 1 --2- 172.21.15.53:0/735256199 >> v2:172.21.15.117:3300/0 conn(0x7f11700c1c30 0x7f117006cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:22.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.528+0000 7f116ffff640 1 -- 172.21.15.53:0/735256199 >> v2:172.21.15.117:3300/0 conn(0x7f11700c1c30 msgr2=0x7f117006cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:54:22.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.528+0000 7f116ffff640 1 --2- 172.21.15.53:0/735256199 >> v2:172.21.15.117:3300/0 conn(0x7f11700c1c30 0x7f117006cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:22.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.528+0000 7f116ffff640 1 -- 172.21.15.53:0/735256199 >> v1:172.21.15.53:6789/0 conn(0x7f117015fcd0 legacy=0x7f11700b1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:22.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.528+0000 7f116ffff640 1 -- 172.21.15.53:0/735256199 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11700c21a0 con 0x7f1170070930 2023-06-10T18:54:22.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.532+0000 7f116ffff640 1 --2- 172.21.15.53:0/735256199 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1170070930 0x7f1170070d50 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f1170070060 tx=0x7f116001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a50ec7a54671db31 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:22.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.532+0000 7f116e7fc640 1 -- 172.21.15.53:0/735256199 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11600ab600 con 0x7f1170070930 2023-06-10T18:54:22.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.532+0000 7f116e7fc640 1 -- 172.21.15.53:0/735256199 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11600a7050 con 0x7f1170070930 2023-06-10T18:54:22.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.532+0000 7f116e7fc640 1 -- 172.21.15.53:0/735256199 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11600ab980 con 0x7f1170070930 2023-06-10T18:54:22.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.532+0000 7f1176079640 1 -- 172.21.15.53:0/735256199 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1170070930 msgr2=0x7f1170070d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:22.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.532+0000 7f1176079640 1 --2- 172.21.15.53:0/735256199 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1170070930 0x7f1170070d50 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f1170070060 tx=0x7f116001c460 comp rx=0 tx=0).stop 2023-06-10T18:54:22.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.532+0000 7f1176079640 1 -- 172.21.15.53:0/735256199 shutdown_connections 2023-06-10T18:54:22.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.532+0000 7f1176079640 1 --2- 172.21.15.53:0/735256199 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1170070930 0x7f1170070d50 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:22.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.532+0000 7f1176079640 1 --2- 172.21.15.53:0/735256199 >> v2:172.21.15.117:3300/0 conn(0x7f11700c1c30 0x7f117006cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:22.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.532+0000 7f1176079640 1 -- 172.21.15.53:0/735256199 >> 172.21.15.53:0/735256199 conn(0x7f117006a560 msgr2=0x7f117006a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:54:22.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.532+0000 7f1176079640 1 -- 172.21.15.53:0/735256199 shutdown_connections 2023-06-10T18:54:22.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.532+0000 7f1176079640 1 -- 172.21.15.53:0/735256199 wait complete. 2023-06-10T18:54:22.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.532+0000 7f1176079640 1 Processor -- start 2023-06-10T18:54:22.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.532+0000 7f1176079640 1 -- start start 2023-06-10T18:54:22.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.532+0000 7f1176079640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1170070930 0x7f1170158cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:22.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.532+0000 7f1176079640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11700c1c30 0x7f11701fb600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:22.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.532+0000 7f1176079640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f117015fcd0 0x7f1170160220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:22.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.532+0000 7f1176079640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1170156360 con 0x7f117015fcd0 2023-06-10T18:54:22.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.532+0000 7f1176079640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11701fc080 con 0x7f11700c1c30 2023-06-10T18:54:22.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.532+0000 7f1176079640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11701fc360 con 0x7f1170070930 2023-06-10T18:54:22.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.532+0000 7f116ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f117015fcd0 0x7f1170160220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:22.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.536+0000 7f116ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f117015fcd0 0x7f1170160220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54054/0 (socket says 172.21.15.53:54054) 2023-06-10T18:54:22.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.536+0000 7f116ffff640 1 -- 172.21.15.53:0/1353086130 learned_addr learned my addr 172.21.15.53:0/1353086130 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:54:22.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.536+0000 7f116effd640 1 --2- 172.21.15.53:0/1353086130 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11700c1c30 0x7f11701fb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:22.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.536+0000 7f116f7fe640 1 --2- 172.21.15.53:0/1353086130 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1170070930 0x7f1170158cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:22.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.536+0000 7f116ffff640 1 -- 172.21.15.53:0/1353086130 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1170070930 msgr2=0x7f1170158cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:22.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.536+0000 7f116ffff640 1 --2- 172.21.15.53:0/1353086130 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1170070930 0x7f1170158cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:22.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.536+0000 7f116ffff640 1 -- 172.21.15.53:0/1353086130 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11700c1c30 msgr2=0x7f11701fb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:22.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.536+0000 7f116ffff640 1 --2- 172.21.15.53:0/1353086130 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11700c1c30 0x7f11701fb600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:22.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.536+0000 7f116ffff640 1 -- 172.21.15.53:0/1353086130 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1160009420 con 0x7f117015fcd0 2023-06-10T18:54:22.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.536+0000 7f116ffff640 1 --2- 172.21.15.53:0/1353086130 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f117015fcd0 0x7f1170160220 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f11600ae040 tx=0x7f1160019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:22.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.536+0000 7f1167fff640 1 -- 172.21.15.53:0/1353086130 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11600b4410 con 0x7f117015fcd0 2023-06-10T18:54:22.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.536+0000 7f1167fff640 1 -- 172.21.15.53:0/1353086130 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11600b4590 con 0x7f117015fcd0 2023-06-10T18:54:22.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.536+0000 7f1176079640 1 -- 172.21.15.53:0/1353086130 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1170156570 con 0x7f117015fcd0 2023-06-10T18:54:22.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.536+0000 7f1167fff640 1 -- 172.21.15.53:0/1353086130 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11600b4940 con 0x7f117015fcd0 2023-06-10T18:54:22.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.536+0000 7f1176079640 1 -- 172.21.15.53:0/1353086130 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f117015f510 con 0x7f117015fcd0 2023-06-10T18:54:22.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.536+0000 7f1176079640 1 -- 172.21.15.53:0/1353086130 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f117004d790 con 0x7f117015fcd0 2023-06-10T18:54:22.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.536+0000 7f1167fff640 1 -- 172.21.15.53:0/1353086130 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f11600b2040 con 0x7f117015fcd0 2023-06-10T18:54:22.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.536+0000 7f1167fff640 1 --2- 172.21.15.53:0/1353086130 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f11540662b0 0x7f1154068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:22.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.536+0000 7f1167fff640 1 -- 172.21.15.53:0/1353086130 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f116011de80 con 0x7f117015fcd0 2023-06-10T18:54:22.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.536+0000 7f116f7fe640 1 --2- 172.21.15.53:0/1353086130 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f11540662b0 0x7f1154068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:22.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.536+0000 7f116f7fe640 1 --2- 172.21.15.53:0/1353086130 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f11540662b0 0x7f1154068760 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1168005c10 tx=0x7f1168009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:22.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.540+0000 7f1167fff640 1 -- 172.21.15.53:0/1353086130 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f11600eb310 con 0x7f117015fcd0 2023-06-10T18:54:22.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.700+0000 7f1176079640 1 -- 172.21.15.53:0/1353086130 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f11700b0cb0 con 0x7f117015fcd0 2023-06-10T18:54:22.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.700+0000 7f1167fff640 1 -- 172.21.15.53:0/1353086130 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v37) v1 ==== 80+0+0 (secure 0 0 0) 0x7f11600ee930 con 0x7f117015fcd0 2023-06-10T18:54:22.710 INFO:teuthology.orchestra.run.smithi053.stderr:listed 0 entries 2023-06-10T18:54:22.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.704+0000 7f1176079640 1 -- 172.21.15.53:0/1353086130 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f11540662b0 msgr2=0x7f1154068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:22.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.704+0000 7f1176079640 1 --2- 172.21.15.53:0/1353086130 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f11540662b0 0x7f1154068760 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1168005c10 tx=0x7f1168009040 comp rx=0 tx=0).stop 2023-06-10T18:54:22.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.704+0000 7f1176079640 1 -- 172.21.15.53:0/1353086130 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f117015fcd0 msgr2=0x7f1170160220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:22.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.704+0000 7f1176079640 1 --2- 172.21.15.53:0/1353086130 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f117015fcd0 0x7f1170160220 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f11600ae040 tx=0x7f1160019200 comp rx=0 tx=0).stop 2023-06-10T18:54:22.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.704+0000 7f1176079640 1 -- 172.21.15.53:0/1353086130 shutdown_connections 2023-06-10T18:54:22.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.704+0000 7f1176079640 1 --2- 172.21.15.53:0/1353086130 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f11540662b0 0x7f1154068760 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:22.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.704+0000 7f1176079640 1 --2- 172.21.15.53:0/1353086130 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f117015fcd0 0x7f1170160220 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:22.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.704+0000 7f1176079640 1 --2- 172.21.15.53:0/1353086130 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11700c1c30 0x7f11701fb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:22.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.704+0000 7f1176079640 1 --2- 172.21.15.53:0/1353086130 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1170070930 0x7f1170158cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:22.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.704+0000 7f1176079640 1 -- 172.21.15.53:0/1353086130 >> 172.21.15.53:0/1353086130 conn(0x7f117006a560 msgr2=0x7f11700cf680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:54:22.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.704+0000 7f1176079640 1 -- 172.21.15.53:0/1353086130 shutdown_connections 2023-06-10T18:54:22.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.704+0000 7f1176079640 1 -- 172.21.15.53:0/1353086130 wait complete. 2023-06-10T18:54:22.728 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T18:54:22.728 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T18:54:22.734 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T18:54:22.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.844+0000 7f7f48b1b640 1 Processor -- start 2023-06-10T18:54:22.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.844+0000 7f7f48b1b640 1 -- start start 2023-06-10T18:54:22.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.848+0000 7f7f48b1b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f440ccae0 0x7f7f440d0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:22.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.848+0000 7f7f48b1b640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f440d0020 con 0x7f7f440b3ac0 2023-06-10T18:54:22.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.848+0000 7f7f48b1b640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f440cef40 con 0x7f7f440cc690 2023-06-10T18:54:22.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.848+0000 7f7f48b1b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f440cf220 con 0x7f7f440ccae0 2023-06-10T18:54:22.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.848+0000 7f7f4259c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f7f440b3ac0 0x7f7f440b3e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60230/0 (socket says 172.21.15.53:60230) 2023-06-10T18:54:22.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.848+0000 7f7f4259c640 1 -- 172.21.15.53:0/4056484320 learned_addr learned my addr 172.21.15.53:0/4056484320 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:54:22.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.848+0000 7f7f42d9d640 1 --2- 172.21.15.53:0/4056484320 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f440ccae0 0x7f7f440d0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:22.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.848+0000 7f7f41d9b640 1 -- 172.21.15.53:0/4056484320 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 836394927 0 0) 0x7f7f440d0020 con 0x7f7f440b3ac0 2023-06-10T18:54:22.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.848+0000 7f7f41d9b640 1 -- 172.21.15.53:0/4056484320 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f30003530 con 0x7f7f440b3ac0 2023-06-10T18:54:22.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.848+0000 7f7f41d9b640 1 -- 172.21.15.53:0/4056484320 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2360390237 0 0) 0x7f7f30003530 con 0x7f7f440b3ac0 2023-06-10T18:54:22.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.848+0000 7f7f41d9b640 1 -- 172.21.15.53:0/4056484320 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f440ccae0 msgr2=0x7f7f440d0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:54:22.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.848+0000 7f7f41d9b640 1 --2- 172.21.15.53:0/4056484320 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f440ccae0 0x7f7f440d0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:22.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.848+0000 7f7f41d9b640 1 -- 172.21.15.53:0/4056484320 >> v1:172.21.15.117:6789/0 conn(0x7f7f440cc690 legacy=0x7f7f440d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:22.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.848+0000 7f7f41d9b640 1 -- 172.21.15.53:0/4056484320 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f440cf500 con 0x7f7f440b3ac0 2023-06-10T18:54:22.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.848+0000 7f7f41d9b640 1 -- 172.21.15.53:0/4056484320 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f7f34001680 con 0x7f7f440b3ac0 2023-06-10T18:54:22.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.848+0000 7f7f41d9b640 1 -- 172.21.15.53:0/4056484320 >> v1:172.21.15.53:6789/0 conn(0x7f7f440b3ac0 legacy=0x7f7f440b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:22.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.848+0000 7f7f41d9b640 1 --2- 172.21.15.53:0/4056484320 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f440ccae0 0x7f7f30003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:22.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.848+0000 7f7f41d9b640 1 --2- 172.21.15.53:0/4056484320 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f30003fa0 0x7f7f300047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:22.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.848+0000 7f7f41d9b640 1 --2- 172.21.15.53:0/4056484320 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f30004d10 0x7f7f30005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:22.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.848+0000 7f7f41d9b640 1 -- 172.21.15.53:0/4056484320 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f440cf220 con 0x7f7f30003fa0 2023-06-10T18:54:22.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.848+0000 7f7f41d9b640 1 -- 172.21.15.53:0/4056484320 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3000bad0 con 0x7f7f30004d10 2023-06-10T18:54:22.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.848+0000 7f7f41d9b640 1 -- 172.21.15.53:0/4056484320 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3000bc90 con 0x7f7f440ccae0 2023-06-10T18:54:22.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.848+0000 7f7f39d9b640 1 --2- 172.21.15.53:0/4056484320 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f30003fa0 0x7f7f300047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:22.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.848+0000 7f7f42d9d640 1 --2- 172.21.15.53:0/4056484320 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f30004d10 0x7f7f30005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:22.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.848+0000 7f7f39d9b640 1 -- 172.21.15.53:0/4056484320 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f440ccae0 msgr2=0x7f7f30003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:54:22.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.848+0000 7f7f39d9b640 1 --2- 172.21.15.53:0/4056484320 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f440ccae0 0x7f7f30003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:22.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.848+0000 7f7f39d9b640 1 -- 172.21.15.53:0/4056484320 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f30004d10 msgr2=0x7f7f30005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:54:22.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.848+0000 7f7f39d9b640 1 --2- 172.21.15.53:0/4056484320 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f30004d10 0x7f7f30005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:22.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.848+0000 7f7f39d9b640 1 -- 172.21.15.53:0/4056484320 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f30003530 con 0x7f7f30003fa0 2023-06-10T18:54:22.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.848+0000 7f7f39d9b640 1 --2- 172.21.15.53:0/4056484320 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f30003fa0 0x7f7f300047d0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c001780 tx=0x7f7f2c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfe676830746b09c server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:22.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.848+0000 7f7f41d9b640 1 -- 172.21.15.53:0/4056484320 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f2c0052d0 con 0x7f7f30003fa0 2023-06-10T18:54:22.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.848+0000 7f7f41d9b640 1 -- 172.21.15.53:0/4056484320 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f2c0a7050 con 0x7f7f30003fa0 2023-06-10T18:54:22.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.848+0000 7f7f41d9b640 1 -- 172.21.15.53:0/4056484320 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f2c003600 con 0x7f7f30003fa0 2023-06-10T18:54:22.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.852+0000 7f7f48b1b640 1 -- 172.21.15.53:0/4056484320 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f30003fa0 msgr2=0x7f7f300047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:22.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.852+0000 7f7f48b1b640 1 --2- 172.21.15.53:0/4056484320 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f30003fa0 0x7f7f300047d0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c001780 tx=0x7f7f2c01c400 comp rx=0 tx=0).stop 2023-06-10T18:54:22.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.852+0000 7f7f42d9d640 1 -- 172.21.15.53:0/4056484320 reap_dead start 2023-06-10T18:54:22.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.852+0000 7f7f48b1b640 1 -- 172.21.15.53:0/4056484320 shutdown_connections 2023-06-10T18:54:22.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.852+0000 7f7f48b1b640 1 -- 172.21.15.53:0/4056484320 >> 172.21.15.53:0/4056484320 conn(0x7f7f44071790 msgr2=0x7f7f44069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:54:22.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.852+0000 7f7f48b1b640 1 -- 172.21.15.53:0/4056484320 shutdown_connections 2023-06-10T18:54:22.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.852+0000 7f7f48b1b640 1 -- 172.21.15.53:0/4056484320 wait complete. 2023-06-10T18:54:22.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.852+0000 7f7f48b1b640 1 Processor -- start 2023-06-10T18:54:22.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.852+0000 7f7f48b1b640 1 -- start start 2023-06-10T18:54:22.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.852+0000 7f7f48b1b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f30003fa0 0x7f7f441e4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:22.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.852+0000 7f7f48b1b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f4414a380 0x7f7f4414a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:22.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.852+0000 7f7f48b1b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f441e5f60 0x7f7f441e63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:22.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.852+0000 7f7f48b1b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f441e7960 con 0x7f7f441e5f60 2023-06-10T18:54:22.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.852+0000 7f7f48b1b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f4414ad10 con 0x7f7f30003fa0 2023-06-10T18:54:22.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.852+0000 7f7f48b1b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f441e6ce0 con 0x7f7f4414a380 2023-06-10T18:54:22.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.852+0000 7f7f42d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f441e5f60 0x7f7f441e63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:22.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.852+0000 7f7f42d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f441e5f60 0x7f7f441e63e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54066/0 (socket says 172.21.15.53:54066) 2023-06-10T18:54:22.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.852+0000 7f7f42d9d640 1 -- 172.21.15.53:0/651681871 learned_addr learned my addr 172.21.15.53:0/651681871 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:54:22.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.852+0000 7f7f39d9b640 1 --2- 172.21.15.53:0/651681871 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f4414a380 0x7f7f4414a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:22.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.852+0000 7f7f4259c640 1 --2- 172.21.15.53:0/651681871 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f30003fa0 0x7f7f441e4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:22.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.852+0000 7f7f42d9d640 1 -- 172.21.15.53:0/651681871 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f4414a380 msgr2=0x7f7f4414a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:22.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.852+0000 7f7f42d9d640 1 --2- 172.21.15.53:0/651681871 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f4414a380 0x7f7f4414a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:22.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.852+0000 7f7f42d9d640 1 -- 172.21.15.53:0/651681871 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f30003fa0 msgr2=0x7f7f441e4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:22.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.852+0000 7f7f42d9d640 1 --2- 172.21.15.53:0/651681871 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f30003fa0 0x7f7f441e4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:22.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.852+0000 7f7f42d9d640 1 -- 172.21.15.53:0/651681871 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f441e6fc0 con 0x7f7f441e5f60 2023-06-10T18:54:22.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.852+0000 7f7f4259c640 1 --2- 172.21.15.53:0/651681871 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f30003fa0 0x7f7f441e4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:54:22.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.852+0000 7f7f42d9d640 1 --2- 172.21.15.53:0/651681871 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f441e5f60 0x7f7f441e63e0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f7f440b4c30 tx=0x7f7f3c007e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:22.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.852+0000 7f7f3b7fe640 1 -- 172.21.15.53:0/651681871 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f3c00e070 con 0x7f7f441e5f60 2023-06-10T18:54:22.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.852+0000 7f7f3b7fe640 1 -- 172.21.15.53:0/651681871 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f3c003c70 con 0x7f7f441e5f60 2023-06-10T18:54:22.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.852+0000 7f7f48b1b640 1 -- 172.21.15.53:0/651681871 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f441e72a0 con 0x7f7f441e5f60 2023-06-10T18:54:22.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.852+0000 7f7f3b7fe640 1 -- 172.21.15.53:0/651681871 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f3c003e00 con 0x7f7f441e5f60 2023-06-10T18:54:22.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.852+0000 7f7f48b1b640 1 -- 172.21.15.53:0/651681871 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f441e6920 con 0x7f7f441e5f60 2023-06-10T18:54:22.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.856+0000 7f7f48b1b640 1 -- 172.21.15.53:0/651681871 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f441e7aa0 con 0x7f7f441e5f60 2023-06-10T18:54:22.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.856+0000 7f7f3b7fe640 1 -- 172.21.15.53:0/651681871 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7f3c004030 con 0x7f7f441e5f60 2023-06-10T18:54:22.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.856+0000 7f7f3b7fe640 1 --2- 172.21.15.53:0/651681871 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7f24066280 0x7f7f24068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:22.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.856+0000 7f7f3b7fe640 1 -- 172.21.15.53:0/651681871 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7f3c083df0 con 0x7f7f441e5f60 2023-06-10T18:54:22.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.856+0000 7f7f4259c640 1 --2- 172.21.15.53:0/651681871 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7f24066280 0x7f7f24068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:22.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.856+0000 7f7f4259c640 1 --2- 172.21.15.53:0/651681871 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7f24066280 0x7f7f24068730 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7f340011f0 tx=0x7f7f3400c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:22.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:22.860+0000 7f7f3b7fe640 1 -- 172.21.15.53:0/651681871 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7f441e7aa0 con 0x7f7f441e5f60 2023-06-10T18:54:23.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.012+0000 7f7f48b1b640 1 -- 172.21.15.53:0/651681871 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7f441e7aa0 con 0x7f7f441e5f60 2023-06-10T18:54:23.024 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.016+0000 7f7f3b7fe640 1 -- 172.21.15.53:0/651681871 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18339 (secure 0 0 0) 0x7f7f441e7aa0 con 0x7f7f441e5f60 2023-06-10T18:54:23.025 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:54:23.025 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":37,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T18:53:55.739534+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-06-10T18:53:52.688764+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-06-10T18:53:53.727157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T18:54:23.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.016+0000 7f7f48b1b640 1 -- 172.21.15.53:0/651681871 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7f24066280 msgr2=0x7f7f24068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:23.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.016+0000 7f7f48b1b640 1 --2- 172.21.15.53:0/651681871 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7f24066280 0x7f7f24068730 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7f340011f0 tx=0x7f7f3400c040 comp rx=0 tx=0).stop 2023-06-10T18:54:23.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.016+0000 7f7f48b1b640 1 -- 172.21.15.53:0/651681871 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f441e5f60 msgr2=0x7f7f441e63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:23.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.016+0000 7f7f48b1b640 1 --2- 172.21.15.53:0/651681871 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f441e5f60 0x7f7f441e63e0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f7f440b4c30 tx=0x7f7f3c007e40 comp rx=0 tx=0).stop 2023-06-10T18:54:23.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.016+0000 7f7f48b1b640 1 -- 172.21.15.53:0/651681871 shutdown_connections 2023-06-10T18:54:23.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.016+0000 7f7f48b1b640 1 --2- 172.21.15.53:0/651681871 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7f24066280 0x7f7f24068730 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:23.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.016+0000 7f7f48b1b640 1 --2- 172.21.15.53:0/651681871 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f441e5f60 0x7f7f441e63e0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:23.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.016+0000 7f7f48b1b640 1 --2- 172.21.15.53:0/651681871 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f4414a380 0x7f7f4414a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:23.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.016+0000 7f7f48b1b640 1 --2- 172.21.15.53:0/651681871 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f30003fa0 0x7f7f441e4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:23.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.016+0000 7f7f48b1b640 1 -- 172.21.15.53:0/651681871 >> 172.21.15.53:0/651681871 conn(0x7f7f44071790 msgr2=0x7f7f4415de10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:54:23.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.020+0000 7f7f48b1b640 1 -- 172.21.15.53:0/651681871 shutdown_connections 2023-06-10T18:54:23.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.020+0000 7f7f48b1b640 1 -- 172.21.15.53:0/651681871 wait complete. 2023-06-10T18:54:23.043 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-10T18:52:33.633114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-10T18:52:39.171487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-10T18:53:52.688764+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-06-10T18:53:53.727157+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-10T18:54:23.044 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-10T18:54:23.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.148+0000 7ff71afa2640 1 Processor -- start 2023-06-10T18:54:23.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.148+0000 7ff71afa2640 1 -- start start 2023-06-10T18:54:23.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.152+0000 7ff71afa2640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff714159450 0x7ff71415d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:23.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.152+0000 7ff71afa2640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7140cbac0 con 0x7ff7140cf350 2023-06-10T18:54:23.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.152+0000 7ff71afa2640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff71415dc00 con 0x7ff71415d680 2023-06-10T18:54:23.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.152+0000 7ff71afa2640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff71415dee0 con 0x7ff714159450 2023-06-10T18:54:23.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.152+0000 7ff718d3e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff714159450 0x7ff71415d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:23.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.152+0000 7ff71953f640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ff7140cf350 0x7ff7140cbf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60246/0 (socket says 172.21.15.53:60246) 2023-06-10T18:54:23.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.152+0000 7ff71953f640 1 -- 172.21.15.53:0/3120807301 learned_addr learned my addr 172.21.15.53:0/3120807301 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:54:23.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.152+0000 7ff718d3e640 1 -- 172.21.15.53:0/3120807301 >> v1:172.21.15.117:6789/0 conn(0x7ff71415d680 legacy=0x7ff7140cec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:54:23.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.152+0000 7ff718d3e640 1 -- 172.21.15.53:0/3120807301 >> v1:172.21.15.53:6789/0 conn(0x7ff7140cf350 legacy=0x7ff7140cbf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:23.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.152+0000 7ff718d3e640 1 -- 172.21.15.53:0/3120807301 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7140cb750 con 0x7ff714159450 2023-06-10T18:54:23.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.152+0000 7ff718d3e640 1 --2- 172.21.15.53:0/3120807301 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff714159450 0x7ff71415d140 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7ff7080097c0 tx=0x7ff70801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71b3d196623c55e1 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:23.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.152+0000 7ff7137fe640 1 -- 172.21.15.53:0/3120807301 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7080ab600 con 0x7ff714159450 2023-06-10T18:54:23.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.152+0000 7ff7137fe640 1 -- 172.21.15.53:0/3120807301 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7080ab760 con 0x7ff714159450 2023-06-10T18:54:23.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.152+0000 7ff7137fe640 1 -- 172.21.15.53:0/3120807301 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7080abaf0 con 0x7ff714159450 2023-06-10T18:54:23.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.152+0000 7ff71afa2640 1 -- 172.21.15.53:0/3120807301 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff714159450 msgr2=0x7ff71415d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:23.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.152+0000 7ff71afa2640 1 --2- 172.21.15.53:0/3120807301 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff714159450 0x7ff71415d140 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7ff7080097c0 tx=0x7ff70801c3e0 comp rx=0 tx=0).stop 2023-06-10T18:54:23.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.152+0000 7ff71afa2640 1 -- 172.21.15.53:0/3120807301 shutdown_connections 2023-06-10T18:54:23.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.152+0000 7ff71afa2640 1 --2- 172.21.15.53:0/3120807301 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff714159450 0x7ff71415d140 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:23.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.152+0000 7ff71afa2640 1 -- 172.21.15.53:0/3120807301 >> 172.21.15.53:0/3120807301 conn(0x7ff71406a090 msgr2=0x7ff71406d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:54:23.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.152+0000 7ff71afa2640 1 -- 172.21.15.53:0/3120807301 shutdown_connections 2023-06-10T18:54:23.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.156+0000 7ff71afa2640 1 -- 172.21.15.53:0/3120807301 wait complete. 2023-06-10T18:54:23.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.156+0000 7ff71afa2640 1 Processor -- start 2023-06-10T18:54:23.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.156+0000 7ff71afa2640 1 -- start start 2023-06-10T18:54:23.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.156+0000 7ff71afa2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7140cf350 0x7ff71414e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:23.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.156+0000 7ff71afa2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff714159450 0x7ff714152ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:23.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.156+0000 7ff71afa2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff71415d680 0x7ff714153530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:23.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.156+0000 7ff71afa2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7140c8db0 con 0x7ff71415d680 2023-06-10T18:54:23.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.156+0000 7ff71afa2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff714153c40 con 0x7ff714159450 2023-06-10T18:54:23.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.156+0000 7ff71afa2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff714153f20 con 0x7ff7140cf350 2023-06-10T18:54:23.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.156+0000 7ff71953f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff71415d680 0x7ff714153530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:23.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.156+0000 7ff71953f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff71415d680 0x7ff714153530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54082/0 (socket says 172.21.15.53:54082) 2023-06-10T18:54:23.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.156+0000 7ff71953f640 1 -- 172.21.15.53:0/4110071263 learned_addr learned my addr 172.21.15.53:0/4110071263 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:54:23.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.156+0000 7ff718d3e640 1 --2- 172.21.15.53:0/4110071263 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7140cf350 0x7ff71414e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:23.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.156+0000 7ff713fff640 1 --2- 172.21.15.53:0/4110071263 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff714159450 0x7ff714152ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:23.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.156+0000 7ff71953f640 1 -- 172.21.15.53:0/4110071263 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7140cf350 msgr2=0x7ff71414e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:23.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.156+0000 7ff71953f640 1 --2- 172.21.15.53:0/4110071263 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7140cf350 0x7ff71414e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:23.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.156+0000 7ff71953f640 1 -- 172.21.15.53:0/4110071263 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff714159450 msgr2=0x7ff714152ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:23.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.156+0000 7ff71953f640 1 --2- 172.21.15.53:0/4110071263 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff714159450 0x7ff714152ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:23.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.156+0000 7ff71953f640 1 -- 172.21.15.53:0/4110071263 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff708009420 con 0x7ff71415d680 2023-06-10T18:54:23.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.156+0000 7ff71953f640 1 --2- 172.21.15.53:0/4110071263 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff71415d680 0x7ff714153530 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7ff70c00caf0 tx=0x7ff70c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:23.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.156+0000 7ff7117fa640 1 -- 172.21.15.53:0/4110071263 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff70c00aca0 con 0x7ff71415d680 2023-06-10T18:54:23.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.156+0000 7ff7117fa640 1 -- 172.21.15.53:0/4110071263 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff70c00ae00 con 0x7ff71415d680 2023-06-10T18:54:23.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.156+0000 7ff7117fa640 1 -- 172.21.15.53:0/4110071263 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff70c012600 con 0x7ff71415d680 2023-06-10T18:54:23.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.156+0000 7ff71afa2640 1 -- 172.21.15.53:0/4110071263 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff714154200 con 0x7ff71415d680 2023-06-10T18:54:23.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.156+0000 7ff71afa2640 1 -- 172.21.15.53:0/4110071263 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7141547c0 con 0x7ff71415d680 2023-06-10T18:54:23.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.156+0000 7ff71afa2640 1 -- 172.21.15.53:0/4110071263 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff71404d790 con 0x7ff71415d680 2023-06-10T18:54:23.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.160+0000 7ff7117fa640 1 -- 172.21.15.53:0/4110071263 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff70c007070 con 0x7ff71415d680 2023-06-10T18:54:23.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.160+0000 7ff7117fa640 1 --2- 172.21.15.53:0/4110071263 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff700066280 0x7ff700068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:23.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.160+0000 7ff7117fa640 1 -- 172.21.15.53:0/4110071263 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff70c083c60 con 0x7ff71415d680 2023-06-10T18:54:23.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.160+0000 7ff718d3e640 1 --2- 172.21.15.53:0/4110071263 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff700066280 0x7ff700068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:23.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.160+0000 7ff718d3e640 1 --2- 172.21.15.53:0/4110071263 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff700066280 0x7ff700068730 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff7080af000 tx=0x7ff7080a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:23.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.164+0000 7ff7117fa640 1 -- 172.21.15.53:0/4110071263 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff70c051060 con 0x7ff71415d680 2023-06-10T18:54:23.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.308+0000 7ff71afa2640 1 -- 172.21.15.53:0/4110071263 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff71406df70 con 0x7ff71415d680 2023-06-10T18:54:23.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.312+0000 7ff7117fa640 1 -- 172.21.15.53:0/4110071263 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff70c017070 con 0x7ff71415d680 2023-06-10T18:54:23.319 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-06-10T18:54:23.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.312+0000 7ff71afa2640 1 -- 172.21.15.53:0/4110071263 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff700066280 msgr2=0x7ff700068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:23.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.312+0000 7ff71afa2640 1 --2- 172.21.15.53:0/4110071263 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff700066280 0x7ff700068730 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff7080af000 tx=0x7ff7080a7000 comp rx=0 tx=0).stop 2023-06-10T18:54:23.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.312+0000 7ff71afa2640 1 -- 172.21.15.53:0/4110071263 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff71415d680 msgr2=0x7ff714153530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:23.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.312+0000 7ff71afa2640 1 --2- 172.21.15.53:0/4110071263 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff71415d680 0x7ff714153530 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7ff70c00caf0 tx=0x7ff70c00a060 comp rx=0 tx=0).stop 2023-06-10T18:54:23.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.312+0000 7ff71afa2640 1 -- 172.21.15.53:0/4110071263 shutdown_connections 2023-06-10T18:54:23.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.312+0000 7ff71afa2640 1 --2- 172.21.15.53:0/4110071263 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff700066280 0x7ff700068730 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:23.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.312+0000 7ff71afa2640 1 --2- 172.21.15.53:0/4110071263 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff71415d680 0x7ff714153530 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:23.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.312+0000 7ff71afa2640 1 --2- 172.21.15.53:0/4110071263 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff714159450 0x7ff714152ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:23.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.312+0000 7ff71afa2640 1 --2- 172.21.15.53:0/4110071263 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7140cf350 0x7ff71414e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:23.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.312+0000 7ff71afa2640 1 -- 172.21.15.53:0/4110071263 >> 172.21.15.53:0/4110071263 conn(0x7ff71406a090 msgr2=0x7ff7140b1e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:54:23.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.312+0000 7ff71afa2640 1 -- 172.21.15.53:0/4110071263 shutdown_connections 2023-06-10T18:54:23.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.312+0000 7ff71afa2640 1 -- 172.21.15.53:0/4110071263 wait complete. 2023-06-10T18:54:23.336 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-10T18:54:23.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.444+0000 7f46809c3640 1 Processor -- start 2023-06-10T18:54:23.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.444+0000 7f46809c3640 1 -- start start 2023-06-10T18:54:23.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.444+0000 7f46809c3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f467c157cf0 0x7f467c0ca6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:23.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.444+0000 7f46809c3640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f467c0affc0 0x7f467c0b0410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:23.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.444+0000 7f46809c3640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f467c0b0950 con 0x7f467c15b8e0 2023-06-10T18:54:23.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.444+0000 7f46809c3640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f467c06fa60 con 0x7f467c0affc0 2023-06-10T18:54:23.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.444+0000 7f46809c3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f467c06a340 con 0x7f467c157cf0 2023-06-10T18:54:23.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.444+0000 7f4679d9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f467c0affc0 0x7f467c0b0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:23.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.444+0000 7f467ad9d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f467c15b8e0 0x7f467c15bd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60250/0 (socket says 172.21.15.53:60250) 2023-06-10T18:54:23.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.444+0000 7f467ad9d640 1 -- 172.21.15.53:0/3223277511 learned_addr learned my addr 172.21.15.53:0/3223277511 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:54:23.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.444+0000 7f467a59c640 1 --2- 172.21.15.53:0/3223277511 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f467c157cf0 0x7f467c0ca6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:23.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.444+0000 7f4679d9b640 1 -- 172.21.15.53:0/3223277511 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f467c157cf0 msgr2=0x7f467c0ca6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:54:23.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.444+0000 7f4679d9b640 1 --2- 172.21.15.53:0/3223277511 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f467c157cf0 0x7f467c0ca6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:23.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.444+0000 7f4679d9b640 1 -- 172.21.15.53:0/3223277511 >> v1:172.21.15.53:6789/0 conn(0x7f467c15b8e0 legacy=0x7f467c15bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:23.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.444+0000 7f467959a640 1 -- 172.21.15.53:0/3223277511 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2942553086 0 0) 0x7f466c001120 con 0x7f467c15b8e0 2023-06-10T18:54:23.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.444+0000 7f4679d9b640 1 -- 172.21.15.53:0/3223277511 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f467c0c9250 con 0x7f467c0affc0 2023-06-10T18:54:23.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.448+0000 7f4679d9b640 1 --2- 172.21.15.53:0/3223277511 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f467c0affc0 0x7f467c0b0410 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f4664009d90 tx=0x7f466401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa3e7d43b02c7bd4 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:23.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.448+0000 7f467959a640 1 -- 172.21.15.53:0/3223277511 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46640a59e0 con 0x7f467c0affc0 2023-06-10T18:54:23.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.448+0000 7f467959a640 1 -- 172.21.15.53:0/3223277511 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46640a5b40 con 0x7f467c0affc0 2023-06-10T18:54:23.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.448+0000 7f467959a640 1 -- 172.21.15.53:0/3223277511 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46640ad440 con 0x7f467c0affc0 2023-06-10T18:54:23.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.448+0000 7f46809c3640 1 -- 172.21.15.53:0/3223277511 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f467c0affc0 msgr2=0x7f467c0b0410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:23.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.448+0000 7f46809c3640 1 --2- 172.21.15.53:0/3223277511 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f467c0affc0 0x7f467c0b0410 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f4664009d90 tx=0x7f466401c920 comp rx=0 tx=0).stop 2023-06-10T18:54:23.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.448+0000 7f46809c3640 1 -- 172.21.15.53:0/3223277511 shutdown_connections 2023-06-10T18:54:23.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.448+0000 7f46809c3640 1 --2- 172.21.15.53:0/3223277511 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f467c0affc0 0x7f467c0b0410 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:23.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.448+0000 7f46809c3640 1 --2- 172.21.15.53:0/3223277511 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f467c157cf0 0x7f467c0ca6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:23.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.448+0000 7f46809c3640 1 -- 172.21.15.53:0/3223277511 >> 172.21.15.53:0/3223277511 conn(0x7f467c0cafc0 msgr2=0x7f467c0cb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:54:23.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.448+0000 7f46809c3640 1 -- 172.21.15.53:0/3223277511 shutdown_connections 2023-06-10T18:54:23.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.448+0000 7f46809c3640 1 -- 172.21.15.53:0/3223277511 wait complete. 2023-06-10T18:54:23.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.448+0000 7f46809c3640 1 Processor -- start 2023-06-10T18:54:23.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.448+0000 7f46809c3640 1 -- start start 2023-06-10T18:54:23.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.448+0000 7f46809c3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f467c0affc0 0x7f467c0c6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:23.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.448+0000 7f46809c3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f467c157cf0 0x7f467c152920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:23.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.448+0000 7f46809c3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f467c15b8e0 0x7f467c0b25d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:23.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.448+0000 7f46809c3640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f467c0b1530 con 0x7f467c157cf0 2023-06-10T18:54:23.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.448+0000 7f46809c3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f467c0b1810 con 0x7f467c15b8e0 2023-06-10T18:54:23.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.448+0000 7f46809c3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f467c0b1af0 con 0x7f467c0affc0 2023-06-10T18:54:23.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.448+0000 7f4679d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f467c157cf0 0x7f467c152920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:23.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.448+0000 7f4679d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f467c157cf0 0x7f467c152920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54098/0 (socket says 172.21.15.53:54098) 2023-06-10T18:54:23.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.448+0000 7f4679d9b640 1 -- 172.21.15.53:0/286634526 learned_addr learned my addr 172.21.15.53:0/286634526 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:54:23.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.448+0000 7f467a59c640 1 --2- 172.21.15.53:0/286634526 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f467c0affc0 0x7f467c0c6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:23.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.448+0000 7f467ad9d640 1 --2- 172.21.15.53:0/286634526 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f467c15b8e0 0x7f467c0b25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:23.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.448+0000 7f4679d9b640 1 -- 172.21.15.53:0/286634526 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f467c0affc0 msgr2=0x7f467c0c6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:23.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.448+0000 7f4679d9b640 1 --2- 172.21.15.53:0/286634526 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f467c0affc0 0x7f467c0c6020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:23.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.448+0000 7f4679d9b640 1 -- 172.21.15.53:0/286634526 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f467c15b8e0 msgr2=0x7f467c0b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:23.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.448+0000 7f4679d9b640 1 --2- 172.21.15.53:0/286634526 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f467c15b8e0 0x7f467c0b25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:23.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.448+0000 7f4679d9b640 1 -- 172.21.15.53:0/286634526 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4664009a70 con 0x7f467c157cf0 2023-06-10T18:54:23.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.448+0000 7f467ad9d640 1 --2- 172.21.15.53:0/286634526 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f467c15b8e0 0x7f467c0b25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:54:23.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.448+0000 7f4679d9b640 1 --2- 172.21.15.53:0/286634526 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f467c157cf0 0x7f467c152920 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f4664009d90 tx=0x7f46640196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:23.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.448+0000 7f4672ffd640 1 -- 172.21.15.53:0/286634526 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46640aede0 con 0x7f467c157cf0 2023-06-10T18:54:23.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.452+0000 7f4672ffd640 1 -- 172.21.15.53:0/286634526 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4664009450 con 0x7f467c157cf0 2023-06-10T18:54:23.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.452+0000 7f46809c3640 1 -- 172.21.15.53:0/286634526 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f467c0cadb0 con 0x7f467c157cf0 2023-06-10T18:54:23.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.452+0000 7f4672ffd640 1 -- 172.21.15.53:0/286634526 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46640b7630 con 0x7f467c157cf0 2023-06-10T18:54:23.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.452+0000 7f46809c3640 1 -- 172.21.15.53:0/286634526 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f467c0b20b0 con 0x7f467c157cf0 2023-06-10T18:54:23.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.452+0000 7f46809c3640 1 -- 172.21.15.53:0/286634526 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f467c04d790 con 0x7f467c157cf0 2023-06-10T18:54:23.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.452+0000 7f4672ffd640 1 -- 172.21.15.53:0/286634526 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f46640b4050 con 0x7f467c157cf0 2023-06-10T18:54:23.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.452+0000 7f4672ffd640 1 --2- 172.21.15.53:0/286634526 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f465c066280 0x7f465c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:23.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.452+0000 7f4672ffd640 1 -- 172.21.15.53:0/286634526 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f466411ee10 con 0x7f467c157cf0 2023-06-10T18:54:23.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.452+0000 7f467a59c640 1 --2- 172.21.15.53:0/286634526 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f465c066280 0x7f465c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:23.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.452+0000 7f467a59c640 1 --2- 172.21.15.53:0/286634526 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f465c066280 0x7f465c068730 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f467c153c20 tx=0x7f4674008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:23.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.456+0000 7f4672ffd640 1 -- 172.21.15.53:0/286634526 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f46640ec440 con 0x7f467c157cf0 2023-06-10T18:54:23.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.600+0000 7f46809c3640 1 -- 172.21.15.53:0/286634526 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f467c0ad970 con 0x7f467c157cf0 2023-06-10T18:54:23.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.604+0000 7f4672ffd640 1 -- 172.21.15.53:0/286634526 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v37) v1 ==== 92+0+10 (secure 0 0 0) 0x7f46640efa60 con 0x7f467c157cf0 2023-06-10T18:54:23.611 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-06-10T18:54:23.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.604+0000 7f46809c3640 1 -- 172.21.15.53:0/286634526 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f465c066280 msgr2=0x7f465c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:23.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.604+0000 7f46809c3640 1 --2- 172.21.15.53:0/286634526 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f465c066280 0x7f465c068730 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f467c153c20 tx=0x7f4674008040 comp rx=0 tx=0).stop 2023-06-10T18:54:23.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.604+0000 7f46809c3640 1 -- 172.21.15.53:0/286634526 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f467c157cf0 msgr2=0x7f467c152920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:23.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.604+0000 7f46809c3640 1 --2- 172.21.15.53:0/286634526 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f467c157cf0 0x7f467c152920 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f4664009d90 tx=0x7f46640196c0 comp rx=0 tx=0).stop 2023-06-10T18:54:23.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.604+0000 7f46809c3640 1 -- 172.21.15.53:0/286634526 shutdown_connections 2023-06-10T18:54:23.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.604+0000 7f46809c3640 1 --2- 172.21.15.53:0/286634526 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f465c066280 0x7f465c068730 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:23.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.604+0000 7f46809c3640 1 --2- 172.21.15.53:0/286634526 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f467c15b8e0 0x7f467c0b25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:23.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.604+0000 7f46809c3640 1 --2- 172.21.15.53:0/286634526 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f467c157cf0 0x7f467c152920 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:23.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.604+0000 7f46809c3640 1 --2- 172.21.15.53:0/286634526 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f467c0affc0 0x7f467c0c6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:23.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.604+0000 7f46809c3640 1 -- 172.21.15.53:0/286634526 >> 172.21.15.53:0/286634526 conn(0x7f467c0cafc0 msgr2=0x7f467c070bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:54:23.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.604+0000 7f46809c3640 1 -- 172.21.15.53:0/286634526 shutdown_connections 2023-06-10T18:54:23.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.604+0000 7f46809c3640 1 -- 172.21.15.53:0/286634526 wait complete. 2023-06-10T18:54:23.628 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-10T18:54:23.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.744+0000 7fe6d9ea4640 1 Processor -- start 2023-06-10T18:54:23.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.744+0000 7fe6d9ea4640 1 -- start start 2023-06-10T18:54:23.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.744+0000 7fe6d9ea4640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe6d40b7e30 0x7fe6d40b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:23.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.744+0000 7fe6d9ea4640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe6d40b0b90 0x7fe6d40d04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:23.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.744+0000 7fe6d9ea4640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6d40cc7c0 con 0x7fe6d415c090 2023-06-10T18:54:23.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.744+0000 7fe6d9ea4640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6d40ccaa0 con 0x7fe6d40b0b90 2023-06-10T18:54:23.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.744+0000 7fe6d9ea4640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6d40ccd80 con 0x7fe6d40b7e30 2023-06-10T18:54:23.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.744+0000 7fe6d3fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe6d40b0b90 0x7fe6d40d04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:23.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.744+0000 7fe6d3fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe6d40b0b90 0x7fe6d40d04d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54114/0 (socket says 172.21.15.53:54114) 2023-06-10T18:54:23.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.744+0000 7fe6d3fff640 1 -- 172.21.15.53:0/2437428125 learned_addr learned my addr 172.21.15.53:0/2437428125 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:54:23.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.744+0000 7fe6d2ffd640 1 --2- 172.21.15.53:0/2437428125 >> v2:172.21.15.117:3300/0 conn(0x7fe6d40b7e30 0x7fe6d40b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:23.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.744+0000 7fe6d3fff640 1 -- 172.21.15.53:0/2437428125 >> v2:172.21.15.117:3300/0 conn(0x7fe6d40b7e30 msgr2=0x7fe6d40b10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:54:23.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.744+0000 7fe6d3fff640 1 --2- 172.21.15.53:0/2437428125 >> v2:172.21.15.117:3300/0 conn(0x7fe6d40b7e30 0x7fe6d40b10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:23.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.744+0000 7fe6d3fff640 1 -- 172.21.15.53:0/2437428125 >> v1:172.21.15.117:6789/0 conn(0x7fe6d415c090 legacy=0x7fe6d40b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:54:23.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.744+0000 7fe6d3fff640 1 -- 172.21.15.53:0/2437428125 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6d40cd060 con 0x7fe6d40b0b90 2023-06-10T18:54:23.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.744+0000 7fe6d2ffd640 1 --2- 172.21.15.53:0/2437428125 >> v2:172.21.15.117:3300/0 conn(0x7fe6d40b7e30 0x7fe6d40b10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:54:23.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.748+0000 7fe6d3fff640 1 --2- 172.21.15.53:0/2437428125 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6d40b0b90 0x7fe6d40d04d0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fe6d40b4c30 tx=0x7fe6cc01c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5d86751cd6f9b6c server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:23.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.748+0000 7fe6d27fc640 1 -- 172.21.15.53:0/2437428125 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6cc0a56f0 con 0x7fe6d40b0b90 2023-06-10T18:54:23.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.748+0000 7fe6d27fc640 1 -- 172.21.15.53:0/2437428125 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6cc0a5850 con 0x7fe6d40b0b90 2023-06-10T18:54:23.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.748+0000 7fe6d27fc640 1 -- 172.21.15.53:0/2437428125 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6cc0a5be0 con 0x7fe6d40b0b90 2023-06-10T18:54:23.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.748+0000 7fe6d9ea4640 1 -- 172.21.15.53:0/2437428125 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6d40b0b90 msgr2=0x7fe6d40d04d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:23.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.748+0000 7fe6d9ea4640 1 --2- 172.21.15.53:0/2437428125 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6d40b0b90 0x7fe6d40d04d0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fe6d40b4c30 tx=0x7fe6cc01c8d0 comp rx=0 tx=0).stop 2023-06-10T18:54:23.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.748+0000 7fe6d9ea4640 1 -- 172.21.15.53:0/2437428125 shutdown_connections 2023-06-10T18:54:23.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.748+0000 7fe6d9ea4640 1 --2- 172.21.15.53:0/2437428125 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6d40b0b90 0x7fe6d40d04d0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:23.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.748+0000 7fe6d9ea4640 1 --2- 172.21.15.53:0/2437428125 >> v2:172.21.15.117:3300/0 conn(0x7fe6d40b7e30 0x7fe6d40b10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:23.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.748+0000 7fe6d9ea4640 1 -- 172.21.15.53:0/2437428125 >> 172.21.15.53:0/2437428125 conn(0x7fe6d4069e20 msgr2=0x7fe6d406a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:54:23.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.748+0000 7fe6d9ea4640 1 -- 172.21.15.53:0/2437428125 shutdown_connections 2023-06-10T18:54:23.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.748+0000 7fe6d9ea4640 1 -- 172.21.15.53:0/2437428125 wait complete. 2023-06-10T18:54:23.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.748+0000 7fe6d9ea4640 1 Processor -- start 2023-06-10T18:54:23.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.748+0000 7fe6d9ea4640 1 -- start start 2023-06-10T18:54:23.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.748+0000 7fe6d9ea4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6d40b0b90 0x7fe6d41518f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:23.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.748+0000 7fe6d9ea4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6d40b7e30 0x7fe6d41467c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:23.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.748+0000 7fe6d9ea4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6d415c090 0x7fe6d414eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:23.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.748+0000 7fe6d9ea4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d4152c00 con 0x7fe6d40b7e30 2023-06-10T18:54:23.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.748+0000 7fe6d9ea4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d4146d00 con 0x7fe6d415c090 2023-06-10T18:54:23.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.748+0000 7fe6d9ea4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d41575c0 con 0x7fe6d40b0b90 2023-06-10T18:54:23.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.748+0000 7fe6d2ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6d40b7e30 0x7fe6d41467c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:23.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.748+0000 7fe6d2ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6d40b7e30 0x7fe6d41467c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54124/0 (socket says 172.21.15.53:54124) 2023-06-10T18:54:23.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.748+0000 7fe6d2ffd640 1 -- 172.21.15.53:0/347478969 learned_addr learned my addr 172.21.15.53:0/347478969 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:54:23.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.748+0000 7fe6d3fff640 1 --2- 172.21.15.53:0/347478969 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6d415c090 0x7fe6d414eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:23.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.748+0000 7fe6d37fe640 1 --2- 172.21.15.53:0/347478969 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6d40b0b90 0x7fe6d41518f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:23.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.748+0000 7fe6d2ffd640 1 -- 172.21.15.53:0/347478969 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6d40b0b90 msgr2=0x7fe6d41518f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:23.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.748+0000 7fe6d2ffd640 1 --2- 172.21.15.53:0/347478969 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6d40b0b90 0x7fe6d41518f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:23.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.748+0000 7fe6d2ffd640 1 -- 172.21.15.53:0/347478969 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6d415c090 msgr2=0x7fe6d414eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:23.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.748+0000 7fe6d2ffd640 1 --2- 172.21.15.53:0/347478969 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6d415c090 0x7fe6d414eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:23.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.752+0000 7fe6d2ffd640 1 -- 172.21.15.53:0/347478969 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6cc009b30 con 0x7fe6d40b7e30 2023-06-10T18:54:23.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.752+0000 7fe6d2ffd640 1 --2- 172.21.15.53:0/347478969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6d40b7e30 0x7fe6d41467c0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fe6c800c7c0 tx=0x7fe6c800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:23.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.752+0000 7fe6bbfff640 1 -- 172.21.15.53:0/347478969 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c80079d0 con 0x7fe6d40b7e30 2023-06-10T18:54:23.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.752+0000 7fe6bbfff640 1 -- 172.21.15.53:0/347478969 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6c8007b30 con 0x7fe6d40b7e30 2023-06-10T18:54:23.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.752+0000 7fe6d9ea4640 1 -- 172.21.15.53:0/347478969 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6d4153020 con 0x7fe6d40b7e30 2023-06-10T18:54:23.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.752+0000 7fe6bbfff640 1 -- 172.21.15.53:0/347478969 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c800ce70 con 0x7fe6d40b7e30 2023-06-10T18:54:23.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.752+0000 7fe6d9ea4640 1 -- 172.21.15.53:0/347478969 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6d4152260 con 0x7fe6d40b7e30 2023-06-10T18:54:23.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.752+0000 7fe6d9ea4640 1 -- 172.21.15.53:0/347478969 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6d4152d40 con 0x7fe6d40b7e30 2023-06-10T18:54:23.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.752+0000 7fe6bbfff640 1 -- 172.21.15.53:0/347478969 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe6c80113f0 con 0x7fe6d40b7e30 2023-06-10T18:54:23.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.752+0000 7fe6bbfff640 1 --2- 172.21.15.53:0/347478969 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe6c0066280 0x7fe6c0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:23.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.752+0000 7fe6bbfff640 1 -- 172.21.15.53:0/347478969 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe6c80841f0 con 0x7fe6d40b7e30 2023-06-10T18:54:23.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.752+0000 7fe6d37fe640 1 --2- 172.21.15.53:0/347478969 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe6c0066280 0x7fe6c0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:23.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.752+0000 7fe6d37fe640 1 --2- 172.21.15.53:0/347478969 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe6c0066280 0x7fe6c0068730 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe6c400b810 tx=0x7fe6c4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:23.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.756+0000 7fe6bbfff640 1 -- 172.21.15.53:0/347478969 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe6d4152d40 con 0x7fe6d40b7e30 2023-06-10T18:54:23.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.904+0000 7fe6d9ea4640 1 -- 172.21.15.53:0/347478969 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe6d4152d40 con 0x7fe6d40b7e30 2023-06-10T18:54:23.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.904+0000 7fe6bbfff640 1 -- 172.21.15.53:0/347478969 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v37) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe6d4152d40 con 0x7fe6d40b7e30 2023-06-10T18:54:23.913 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-06-10T18:54:23.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.908+0000 7fe6d9ea4640 1 -- 172.21.15.53:0/347478969 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe6c0066280 msgr2=0x7fe6c0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:23.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.908+0000 7fe6d9ea4640 1 --2- 172.21.15.53:0/347478969 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe6c0066280 0x7fe6c0068730 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe6c400b810 tx=0x7fe6c4008040 comp rx=0 tx=0).stop 2023-06-10T18:54:23.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.908+0000 7fe6d9ea4640 1 -- 172.21.15.53:0/347478969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6d40b7e30 msgr2=0x7fe6d41467c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:23.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.908+0000 7fe6d9ea4640 1 --2- 172.21.15.53:0/347478969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6d40b7e30 0x7fe6d41467c0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fe6c800c7c0 tx=0x7fe6c800cc80 comp rx=0 tx=0).stop 2023-06-10T18:54:23.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.908+0000 7fe6d9ea4640 1 -- 172.21.15.53:0/347478969 shutdown_connections 2023-06-10T18:54:23.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.908+0000 7fe6d9ea4640 1 --2- 172.21.15.53:0/347478969 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe6c0066280 0x7fe6c0068730 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:23.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.908+0000 7fe6d9ea4640 1 --2- 172.21.15.53:0/347478969 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6d415c090 0x7fe6d414eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:23.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.908+0000 7fe6d9ea4640 1 --2- 172.21.15.53:0/347478969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6d40b7e30 0x7fe6d41467c0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:23.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.908+0000 7fe6d9ea4640 1 --2- 172.21.15.53:0/347478969 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6d40b0b90 0x7fe6d41518f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:23.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.908+0000 7fe6d9ea4640 1 -- 172.21.15.53:0/347478969 >> 172.21.15.53:0/347478969 conn(0x7fe6d4069e20 msgr2=0x7fe6d406a260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:54:23.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.908+0000 7fe6d9ea4640 1 -- 172.21.15.53:0/347478969 shutdown_connections 2023-06-10T18:54:23.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:23.908+0000 7fe6d9ea4640 1 -- 172.21.15.53:0/347478969 wait complete. 2023-06-10T18:54:23.931 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-10T18:54:24.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.040+0000 7f3630227640 1 Processor -- start 2023-06-10T18:54:24.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.040+0000 7f3630227640 1 -- start start 2023-06-10T18:54:24.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.040+0000 7f3630227640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f362815c090 0x7f36280b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:24.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.040+0000 7f3630227640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f36280b7e30 0x7f36280d04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:24.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.040+0000 7f3630227640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36280cc7c0 con 0x7f36280b0b90 2023-06-10T18:54:24.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.040+0000 7f3630227640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36280ccaa0 con 0x7f36280b7e30 2023-06-10T18:54:24.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.040+0000 7f3630227640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36280ccd80 con 0x7f362815c090 2023-06-10T18:54:24.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.040+0000 7f362e7c4640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f36280b7e30 0x7f36280d04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:24.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.040+0000 7f362e7c4640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f36280b7e30 0x7f36280d04d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54126/0 (socket says 172.21.15.53:54126) 2023-06-10T18:54:24.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.040+0000 7f362e7c4640 1 -- 172.21.15.53:0/351558974 learned_addr learned my addr 172.21.15.53:0/351558974 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:54:24.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.040+0000 7f362dfc3640 1 --2- 172.21.15.53:0/351558974 >> v2:172.21.15.117:3300/0 conn(0x7f362815c090 0x7f36280b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:24.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.040+0000 7f362e7c4640 1 -- 172.21.15.53:0/351558974 >> v2:172.21.15.117:3300/0 conn(0x7f362815c090 msgr2=0x7f36280b10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:54:24.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.040+0000 7f362e7c4640 1 --2- 172.21.15.53:0/351558974 >> v2:172.21.15.117:3300/0 conn(0x7f362815c090 0x7f36280b10c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:24.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.040+0000 7f362e7c4640 1 -- 172.21.15.53:0/351558974 >> v1:172.21.15.117:6789/0 conn(0x7f36280b0b90 legacy=0x7f36280b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:54:24.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.040+0000 7f362e7c4640 1 -- 172.21.15.53:0/351558974 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36280cd060 con 0x7f36280b7e30 2023-06-10T18:54:24.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.044+0000 7f362e7c4640 1 --2- 172.21.15.53:0/351558974 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36280b7e30 0x7f36280d04d0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f362806b200 tx=0x7f362001c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a3f56eb1fcb1628 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:24.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.044+0000 7f362cfc1640 1 -- 172.21.15.53:0/351558974 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36200a56f0 con 0x7f36280b7e30 2023-06-10T18:54:24.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.044+0000 7f362cfc1640 1 -- 172.21.15.53:0/351558974 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36200a5850 con 0x7f36280b7e30 2023-06-10T18:54:24.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.044+0000 7f362cfc1640 1 -- 172.21.15.53:0/351558974 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36200a5be0 con 0x7f36280b7e30 2023-06-10T18:54:24.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.044+0000 7f3630227640 1 -- 172.21.15.53:0/351558974 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36280b7e30 msgr2=0x7f36280d04d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:24.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.044+0000 7f3630227640 1 --2- 172.21.15.53:0/351558974 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36280b7e30 0x7f36280d04d0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f362806b200 tx=0x7f362001c8d0 comp rx=0 tx=0).stop 2023-06-10T18:54:24.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.044+0000 7f3630227640 1 -- 172.21.15.53:0/351558974 shutdown_connections 2023-06-10T18:54:24.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.044+0000 7f3630227640 1 --2- 172.21.15.53:0/351558974 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36280b7e30 0x7f36280d04d0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:24.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.044+0000 7f3630227640 1 --2- 172.21.15.53:0/351558974 >> v2:172.21.15.117:3300/0 conn(0x7f362815c090 0x7f36280b10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:24.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.044+0000 7f3630227640 1 -- 172.21.15.53:0/351558974 >> 172.21.15.53:0/351558974 conn(0x7f3628069e20 msgr2=0x7f362806a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:54:24.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.044+0000 7f3630227640 1 -- 172.21.15.53:0/351558974 shutdown_connections 2023-06-10T18:54:24.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.044+0000 7f3630227640 1 -- 172.21.15.53:0/351558974 wait complete. 2023-06-10T18:54:24.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.044+0000 7f3630227640 1 Processor -- start 2023-06-10T18:54:24.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.044+0000 7f3630227640 1 -- start start 2023-06-10T18:54:24.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.044+0000 7f3630227640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36280b0b90 0x7f3628146380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:24.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.044+0000 7f3630227640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36280b7e30 0x7f3628156af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:24.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.044+0000 7f3630227640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f362815c090 0x7f36280c4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:24.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.044+0000 7f3630227640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36281455a0 con 0x7f362815c090 2023-06-10T18:54:24.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.044+0000 7f3630227640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3628155580 con 0x7f36280b7e30 2023-06-10T18:54:24.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.044+0000 7f3630227640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36281552a0 con 0x7f36280b0b90 2023-06-10T18:54:24.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.048+0000 7f362e7c4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f362815c090 0x7f36280c4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:24.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.048+0000 7f362e7c4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f362815c090 0x7f36280c4030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54138/0 (socket says 172.21.15.53:54138) 2023-06-10T18:54:24.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.048+0000 7f362e7c4640 1 -- 172.21.15.53:0/1139429178 learned_addr learned my addr 172.21.15.53:0/1139429178 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:54:24.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.048+0000 7f362dfc3640 1 --2- 172.21.15.53:0/1139429178 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36280b0b90 0x7f3628146380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:24.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.048+0000 7f362d7c2640 1 --2- 172.21.15.53:0/1139429178 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36280b7e30 0x7f3628156af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:24.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.048+0000 7f362e7c4640 1 -- 172.21.15.53:0/1139429178 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36280b0b90 msgr2=0x7f3628146380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:24.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.048+0000 7f362e7c4640 1 --2- 172.21.15.53:0/1139429178 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36280b0b90 0x7f3628146380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:24.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.048+0000 7f362e7c4640 1 -- 172.21.15.53:0/1139429178 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36280b7e30 msgr2=0x7f3628156af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:24.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.048+0000 7f362e7c4640 1 --2- 172.21.15.53:0/1139429178 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36280b7e30 0x7f3628156af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:24.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.048+0000 7f362e7c4640 1 -- 172.21.15.53:0/1139429178 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3620009b30 con 0x7f362815c090 2023-06-10T18:54:24.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.048+0000 7f362e7c4640 1 --2- 172.21.15.53:0/1139429178 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f362815c090 0x7f36280c4030 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f362001a500 tx=0x7f3620019670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:24.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.048+0000 7f361e7fc640 1 -- 172.21.15.53:0/1139429178 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36200b8670 con 0x7f362815c090 2023-06-10T18:54:24.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.048+0000 7f361e7fc640 1 -- 172.21.15.53:0/1139429178 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36200b87d0 con 0x7f362815c090 2023-06-10T18:54:24.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.048+0000 7f361e7fc640 1 -- 172.21.15.53:0/1139429178 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36200b8b60 con 0x7f362815c090 2023-06-10T18:54:24.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.048+0000 7f3630227640 1 -- 172.21.15.53:0/1139429178 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3628144ee0 con 0x7f362815c090 2023-06-10T18:54:24.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.048+0000 7f3630227640 1 -- 172.21.15.53:0/1139429178 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3628072730 con 0x7f362815c090 2023-06-10T18:54:24.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.048+0000 7f3630227640 1 -- 172.21.15.53:0/1139429178 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36281456e0 con 0x7f362815c090 2023-06-10T18:54:24.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.048+0000 7f361e7fc640 1 -- 172.21.15.53:0/1139429178 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f36200b8cc0 con 0x7f362815c090 2023-06-10T18:54:24.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.048+0000 7f361e7fc640 1 --2- 172.21.15.53:0/1139429178 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f360c066280 0x7f360c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:24.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.048+0000 7f361e7fc640 1 -- 172.21.15.53:0/1139429178 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f362011f340 con 0x7f362815c090 2023-06-10T18:54:24.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.048+0000 7f362dfc3640 1 --2- 172.21.15.53:0/1139429178 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f360c066280 0x7f360c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:24.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.048+0000 7f362dfc3640 1 --2- 172.21.15.53:0/1139429178 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f360c066280 0x7f360c068730 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3628072630 tx=0x7f3624008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:24.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.052+0000 7f361e7fc640 1 -- 172.21.15.53:0/1139429178 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f36281456e0 con 0x7f362815c090 2023-06-10T18:54:24.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.208+0000 7f3630227640 1 -- 172.21.15.53:0/1139429178 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f36281456e0 con 0x7f362815c090 2023-06-10T18:54:24.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.208+0000 7f361e7fc640 1 -- 172.21.15.53:0/1139429178 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v37) v1 ==== 100+0+11 (secure 0 0 0) 0x7f36281456e0 con 0x7f362815c090 2023-06-10T18:54:24.219 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-06-10T18:54:24.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.212+0000 7f3630227640 1 -- 172.21.15.53:0/1139429178 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f360c066280 msgr2=0x7f360c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:24.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.212+0000 7f3630227640 1 --2- 172.21.15.53:0/1139429178 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f360c066280 0x7f360c068730 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3628072630 tx=0x7f3624008040 comp rx=0 tx=0).stop 2023-06-10T18:54:24.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.212+0000 7f3630227640 1 -- 172.21.15.53:0/1139429178 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f362815c090 msgr2=0x7f36280c4030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:24.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.212+0000 7f3630227640 1 --2- 172.21.15.53:0/1139429178 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f362815c090 0x7f36280c4030 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f362001a500 tx=0x7f3620019670 comp rx=0 tx=0).stop 2023-06-10T18:54:24.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.212+0000 7f3630227640 1 -- 172.21.15.53:0/1139429178 shutdown_connections 2023-06-10T18:54:24.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.212+0000 7f3630227640 1 --2- 172.21.15.53:0/1139429178 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f360c066280 0x7f360c068730 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:24.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.212+0000 7f3630227640 1 --2- 172.21.15.53:0/1139429178 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f362815c090 0x7f36280c4030 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:24.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.212+0000 7f3630227640 1 --2- 172.21.15.53:0/1139429178 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36280b7e30 0x7f3628156af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:24.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.212+0000 7f3630227640 1 --2- 172.21.15.53:0/1139429178 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36280b0b90 0x7f3628146380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:24.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.212+0000 7f3630227640 1 -- 172.21.15.53:0/1139429178 >> 172.21.15.53:0/1139429178 conn(0x7f3628069e20 msgr2=0x7f36280b5330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:54:24.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.212+0000 7f3630227640 1 -- 172.21.15.53:0/1139429178 shutdown_connections 2023-06-10T18:54:24.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.212+0000 7f3630227640 1 -- 172.21.15.53:0/1139429178 wait complete. 2023-06-10T18:54:24.238 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-10T18:54:24.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.356+0000 7f911a02a640 1 Processor -- start 2023-06-10T18:54:24.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.356+0000 7f911a02a640 1 -- start start 2023-06-10T18:54:24.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.356+0000 7f911a02a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9114159610 0x7f91140c8b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:24.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.356+0000 7f911a02a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f91140affc0 0x7f91140b0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:24.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.356+0000 7f911a02a640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9114070ba0 con 0x7f9114069450 2023-06-10T18:54:24.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.356+0000 7f911a02a640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91140b0980 con 0x7f9114159610 2023-06-10T18:54:24.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.356+0000 7f911a02a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91140c9170 con 0x7f91140affc0 2023-06-10T18:54:24.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.356+0000 7f91137fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9114159610 0x7f91140c8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:24.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.356+0000 7f91137fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9114159610 0x7f91140c8b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54150/0 (socket says 172.21.15.53:54150) 2023-06-10T18:54:24.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.356+0000 7f91137fe640 1 -- 172.21.15.53:0/1328845978 learned_addr learned my addr 172.21.15.53:0/1328845978 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:54:24.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.356+0000 7f9113fff640 1 --2- 172.21.15.53:0/1328845978 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f91140affc0 0x7f91140b0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:24.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.356+0000 7f91137fe640 1 -- 172.21.15.53:0/1328845978 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f91140affc0 msgr2=0x7f91140b0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:54:24.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.356+0000 7f91137fe640 1 --2- 172.21.15.53:0/1328845978 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f91140affc0 0x7f91140b0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:24.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.356+0000 7f91137fe640 1 -- 172.21.15.53:0/1328845978 >> v1:172.21.15.117:6789/0 conn(0x7f9114069450 legacy=0x7f91140ad7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:54:24.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.356+0000 7f91137fe640 1 -- 172.21.15.53:0/1328845978 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91140c9450 con 0x7f9114159610 2023-06-10T18:54:24.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.360+0000 7f91137fe640 1 --2- 172.21.15.53:0/1328845978 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9114159610 0x7f91140c8b90 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f91040098a0 tx=0x7f910401c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94681f25ae0b951c server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:24.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.360+0000 7f91127fc640 1 -- 172.21.15.53:0/1328845978 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91040aa5f0 con 0x7f9114159610 2023-06-10T18:54:24.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.360+0000 7f91127fc640 1 -- 172.21.15.53:0/1328845978 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91040aa750 con 0x7f9114159610 2023-06-10T18:54:24.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.360+0000 7f91127fc640 1 -- 172.21.15.53:0/1328845978 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91040aaae0 con 0x7f9114159610 2023-06-10T18:54:24.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.360+0000 7f911a02a640 1 -- 172.21.15.53:0/1328845978 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9114159610 msgr2=0x7f91140c8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:24.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.360+0000 7f911a02a640 1 --2- 172.21.15.53:0/1328845978 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9114159610 0x7f91140c8b90 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f91040098a0 tx=0x7f910401c4b0 comp rx=0 tx=0).stop 2023-06-10T18:54:24.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.360+0000 7f911a02a640 1 -- 172.21.15.53:0/1328845978 shutdown_connections 2023-06-10T18:54:24.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.360+0000 7f911a02a640 1 --2- 172.21.15.53:0/1328845978 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f91140affc0 0x7f91140b0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:24.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.360+0000 7f911a02a640 1 --2- 172.21.15.53:0/1328845978 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9114159610 0x7f91140c8b90 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:24.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.360+0000 7f911a02a640 1 -- 172.21.15.53:0/1328845978 >> 172.21.15.53:0/1328845978 conn(0x7f91140cafc0 msgr2=0x7f91140cb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:54:24.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.360+0000 7f911a02a640 1 -- 172.21.15.53:0/1328845978 shutdown_connections 2023-06-10T18:54:24.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.360+0000 7f911a02a640 1 -- 172.21.15.53:0/1328845978 wait complete. 2023-06-10T18:54:24.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.360+0000 7f911a02a640 1 Processor -- start 2023-06-10T18:54:24.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.360+0000 7f911a02a640 1 -- start start 2023-06-10T18:54:24.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.360+0000 7f911a02a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9114069450 0x7f9114152a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:24.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.360+0000 7f911a02a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f91140affc0 0x7f9114152f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:24.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.364+0000 7f911a02a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9114159610 0x7f91141505a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:24.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.364+0000 7f911a02a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9114158b90 con 0x7f9114069450 2023-06-10T18:54:24.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.364+0000 7f911a02a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9114159cb0 con 0x7f91140affc0 2023-06-10T18:54:24.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.364+0000 7f911a02a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9114153480 con 0x7f9114159610 2023-06-10T18:54:24.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.364+0000 7f91137fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9114069450 0x7f9114152a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:24.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.364+0000 7f91137fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9114069450 0x7f9114152a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54154/0 (socket says 172.21.15.53:54154) 2023-06-10T18:54:24.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.364+0000 7f91137fe640 1 -- 172.21.15.53:0/139643949 learned_addr learned my addr 172.21.15.53:0/139643949 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:54:24.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.364+0000 7f9113fff640 1 --2- 172.21.15.53:0/139643949 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9114159610 0x7f91141505a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:24.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.364+0000 7f91137fe640 1 -- 172.21.15.53:0/139643949 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9114159610 msgr2=0x7f91141505a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:24.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.364+0000 7f91137fe640 1 --2- 172.21.15.53:0/139643949 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9114159610 0x7f91141505a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:24.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.364+0000 7f91137fe640 1 -- 172.21.15.53:0/139643949 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f91140affc0 msgr2=0x7f9114152f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:24.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.364+0000 7f91137fe640 1 --2- 172.21.15.53:0/139643949 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f91140affc0 0x7f9114152f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:24.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.364+0000 7f91137fe640 1 -- 172.21.15.53:0/139643949 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91040094d0 con 0x7f9114069450 2023-06-10T18:54:24.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.364+0000 7f9113fff640 1 --2- 172.21.15.53:0/139643949 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9114159610 0x7f91141505a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:54:24.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.364+0000 7f91137fe640 1 --2- 172.21.15.53:0/139643949 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9114069450 0x7f9114152a00 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f91040ac040 tx=0x7f910401acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:24.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.364+0000 7f90fbfff640 1 -- 172.21.15.53:0/139643949 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91040aa5f0 con 0x7f9114069450 2023-06-10T18:54:24.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.364+0000 7f90fbfff640 1 -- 172.21.15.53:0/139643949 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91040b3820 con 0x7f9114069450 2023-06-10T18:54:24.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.364+0000 7f911a02a640 1 -- 172.21.15.53:0/139643949 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9114163ec0 con 0x7f9114069450 2023-06-10T18:54:24.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.364+0000 7f90fbfff640 1 -- 172.21.15.53:0/139643949 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91040b3bd0 con 0x7f9114069450 2023-06-10T18:54:24.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.364+0000 7f911a02a640 1 -- 172.21.15.53:0/139643949 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91140cc520 con 0x7f9114069450 2023-06-10T18:54:24.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.364+0000 7f911a02a640 1 -- 172.21.15.53:0/139643949 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f911404d790 con 0x7f9114069450 2023-06-10T18:54:24.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.364+0000 7f90fbfff640 1 -- 172.21.15.53:0/139643949 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f91040b3d30 con 0x7f9114069450 2023-06-10T18:54:24.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.364+0000 7f90fbfff640 1 --2- 172.21.15.53:0/139643949 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9100066280 0x7f9100068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:24.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.364+0000 7f90fbfff640 1 -- 172.21.15.53:0/139643949 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f91040a7070 con 0x7f9114069450 2023-06-10T18:54:24.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.364+0000 7f9112ffd640 1 --2- 172.21.15.53:0/139643949 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9100066280 0x7f9100068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:24.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.364+0000 7f9112ffd640 1 --2- 172.21.15.53:0/139643949 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9100066280 0x7f9100068730 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9114164360 tx=0x7f9108006bd0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:24.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.368+0000 7f90fbfff640 1 -- 172.21.15.53:0/139643949 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f91040eb450 con 0x7f9114069450 2023-06-10T18:54:24.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.532+0000 7f911a02a640 1 -- 172.21.15.53:0/139643949 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9114164390 con 0x7f9114069450 2023-06-10T18:54:24.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.536+0000 7f90fbfff640 1 -- 172.21.15.53:0/139643949 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v37) v1 ==== 80+0+0 (secure 0 0 0) 0x7f91040c3020 con 0x7f9114069450 2023-06-10T18:54:24.543 INFO:teuthology.orchestra.run.smithi053.stderr:listed 0 entries 2023-06-10T18:54:24.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.536+0000 7f911a02a640 1 -- 172.21.15.53:0/139643949 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9100066280 msgr2=0x7f9100068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:24.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.536+0000 7f911a02a640 1 --2- 172.21.15.53:0/139643949 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9100066280 0x7f9100068730 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9114164360 tx=0x7f9108006bd0 comp rx=0 tx=0).stop 2023-06-10T18:54:24.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.536+0000 7f911a02a640 1 -- 172.21.15.53:0/139643949 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9114069450 msgr2=0x7f9114152a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:24.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.536+0000 7f911a02a640 1 --2- 172.21.15.53:0/139643949 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9114069450 0x7f9114152a00 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f91040ac040 tx=0x7f910401acf0 comp rx=0 tx=0).stop 2023-06-10T18:54:24.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.536+0000 7f911a02a640 1 -- 172.21.15.53:0/139643949 shutdown_connections 2023-06-10T18:54:24.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.536+0000 7f911a02a640 1 --2- 172.21.15.53:0/139643949 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9100066280 0x7f9100068730 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:24.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.536+0000 7f911a02a640 1 --2- 172.21.15.53:0/139643949 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9114159610 0x7f91141505a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:24.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.536+0000 7f911a02a640 1 --2- 172.21.15.53:0/139643949 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f91140affc0 0x7f9114152f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:24.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.536+0000 7f911a02a640 1 --2- 172.21.15.53:0/139643949 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9114069450 0x7f9114152a00 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:24.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.536+0000 7f911a02a640 1 -- 172.21.15.53:0/139643949 >> 172.21.15.53:0/139643949 conn(0x7f91140cafc0 msgr2=0x7f91140ca070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:54:24.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.536+0000 7f911a02a640 1 -- 172.21.15.53:0/139643949 shutdown_connections 2023-06-10T18:54:24.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:24.536+0000 7f911a02a640 1 -- 172.21.15.53:0/139643949 wait complete. 2023-06-10T18:54:24.564 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi117.front.sepia.ceph.com... 2023-06-10T18:54:24.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:54:24.564 DEBUG:teuthology.orchestra.run.smithi117:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-06-10T18:54:24.578 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi117.stderr:ceph-fuse[44120]: fuse finished with error 0 and tester_r 0 2023-06-10T18:54:24.579 INFO:teuthology.orchestra.run:waiting for 300 2023-06-10T18:54:30.681 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi117.front.sepia.ceph.com 2023-06-10T18:54:30.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:54:30.682 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-06-10T18:54:30.689 DEBUG:teuthology.orchestra.run.smithi053:> adjust-ulimits daemon-helper kill python3 -c ' 2023-06-10T18:54:30.690 DEBUG:teuthology.orchestra.run.smithi053:> import cephfs as libcephfs 2023-06-10T18:54:30.690 DEBUG:teuthology.orchestra.run.smithi053:> cephfs = libcephfs.LibCephFS(conffile='"'"''"'"') 2023-06-10T18:54:30.690 DEBUG:teuthology.orchestra.run.smithi053:> cephfs.mount() 2023-06-10T18:54:30.691 DEBUG:teuthology.orchestra.run.smithi053:> client_id = cephfs.get_instance_id() 2023-06-10T18:54:30.691 DEBUG:teuthology.orchestra.run.smithi053:> cephfs.abort_conn() 2023-06-10T18:54:30.691 DEBUG:teuthology.orchestra.run.smithi053:> print(client_id) 2023-06-10T18:54:30.691 DEBUG:teuthology.orchestra.run.smithi053:> ' 2023-06-10T18:54:30.800 INFO:teuthology.orchestra.run.smithi053.stdout:5763 2023-06-10T18:54:30.947 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T18:54:31.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:31.116+0000 7ffb3f7bd640 1 Processor -- start 2023-06-10T18:54:31.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:31.116+0000 7ffb3f7bd640 1 -- start start 2023-06-10T18:54:31.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:31.120+0000 7ffb3f7bd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ffb380c9840 0x7ffb380c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:31.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:31.120+0000 7ffb3f7bd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb38071060 0x7ffb380af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:31.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:31.120+0000 7ffb3f7bd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ffb380afc60 0x7ffb3815d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:31.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:31.120+0000 7ffb3f7bd640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb38159b50 con 0x7ffb380c9840 2023-06-10T18:54:31.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:31.120+0000 7ffb3f7bd640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb380ca150 con 0x7ffb380afc60 2023-06-10T18:54:31.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:31.120+0000 7ffb3f7bd640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb380702a0 con 0x7ffb38071060 2023-06-10T18:54:31.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:31.120+0000 7ffb3d559640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ffb380c9840 0x7ffb380c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:31.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:31.120+0000 7ffb3d559640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ffb380c9840 0x7ffb380c9c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54170/0 (socket says 172.21.15.53:54170) 2023-06-10T18:54:31.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:31.120+0000 7ffb3d559640 1 -- 172.21.15.53:0/3087060802 learned_addr learned my addr 172.21.15.53:0/3087060802 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:54:31.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:31.120+0000 7ffb3cd58640 1 --2- 172.21.15.53:0/3087060802 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb38071060 0x7ffb380af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:31.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:31.120+0000 7ffb3dd5a640 1 --2- 172.21.15.53:0/3087060802 >> v2:172.21.15.117:3300/0 conn(0x7ffb380afc60 0x7ffb3815d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:31.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:31.120+0000 7ffb3d559640 1 -- 172.21.15.53:0/3087060802 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb38071060 msgr2=0x7ffb380af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:54:31.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:31.120+0000 7ffb3d559640 1 --2- 172.21.15.53:0/3087060802 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb38071060 0x7ffb380af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:31.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:31.120+0000 7ffb3d559640 1 -- 172.21.15.53:0/3087060802 >> v2:172.21.15.117:3300/0 conn(0x7ffb380afc60 msgr2=0x7ffb3815d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:54:31.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:31.120+0000 7ffb3d559640 1 --2- 172.21.15.53:0/3087060802 >> v2:172.21.15.117:3300/0 conn(0x7ffb380afc60 0x7ffb3815d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:31.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:31.120+0000 7ffb3d559640 1 -- 172.21.15.53:0/3087060802 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb38070580 con 0x7ffb380c9840 2023-06-10T18:54:31.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:31.120+0000 7ffb3d559640 1 --2- 172.21.15.53:0/3087060802 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb380c9840 0x7ffb380c9c10 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7ffb3806ef50 tx=0x7ffb3401c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8540233a569330fd server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:31.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:31.120+0000 7ffb2bfff640 1 -- 172.21.15.53:0/3087060802 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb340ab600 con 0x7ffb380c9840 2023-06-10T18:54:31.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:31.120+0000 7ffb2bfff640 1 -- 172.21.15.53:0/3087060802 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb340a7050 con 0x7ffb380c9840 2023-06-10T18:54:31.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:31.120+0000 7ffb2bfff640 1 -- 172.21.15.53:0/3087060802 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb340ab980 con 0x7ffb380c9840 2023-06-10T18:54:31.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:31.120+0000 7ffb3f7bd640 1 -- 172.21.15.53:0/3087060802 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb380c9840 msgr2=0x7ffb380c9c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:31.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:31.120+0000 7ffb3f7bd640 1 --2- 172.21.15.53:0/3087060802 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb380c9840 0x7ffb380c9c10 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7ffb3806ef50 tx=0x7ffb3401c210 comp rx=0 tx=0).stop 2023-06-10T18:54:31.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:31.120+0000 7ffb3f7bd640 1 -- 172.21.15.53:0/3087060802 shutdown_connections 2023-06-10T18:54:31.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:31.120+0000 7ffb3f7bd640 1 --2- 172.21.15.53:0/3087060802 >> v2:172.21.15.117:3300/0 conn(0x7ffb380afc60 0x7ffb3815d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:31.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:31.120+0000 7ffb3f7bd640 1 --2- 172.21.15.53:0/3087060802 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb38071060 0x7ffb380af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:31.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:31.120+0000 7ffb3f7bd640 1 --2- 172.21.15.53:0/3087060802 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb380c9840 0x7ffb380c9c10 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:31.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:31.120+0000 7ffb3f7bd640 1 -- 172.21.15.53:0/3087060802 >> 172.21.15.53:0/3087060802 conn(0x7ffb3806a0d0 msgr2=0x7ffb380ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:54:31.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:31.120+0000 7ffb3f7bd640 1 -- 172.21.15.53:0/3087060802 shutdown_connections 2023-06-10T18:54:31.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:31.120+0000 7ffb3f7bd640 1 -- 172.21.15.53:0/3087060802 wait complete. 2023-06-10T18:54:31.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:31.124+0000 7ffb3f7bd640 1 Processor -- start 2023-06-10T18:54:31.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:31.124+0000 7ffb3f7bd640 1 -- start start 2023-06-10T18:54:31.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:31.124+0000 7ffb3f7bd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb38071060 0x7ffb38163480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:31.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:31.124+0000 7ffb3f7bd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb380afc60 0x7ffb380b3310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:31.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:31.124+0000 7ffb3f7bd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb380b0ad0 0x7ffb380aee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:31.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:31.124+0000 7ffb3f7bd640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb3814aa40 con 0x7ffb380b0ad0 2023-06-10T18:54:31.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:31.124+0000 7ffb3f7bd640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb380b1800 con 0x7ffb38071060 2023-06-10T18:54:31.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:31.124+0000 7ffb3f7bd640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb380b1520 con 0x7ffb380afc60 2023-06-10T18:54:31.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:31.124+0000 7ffb3dd5a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb380b0ad0 0x7ffb380aee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:31.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:31.124+0000 7ffb3dd5a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb380b0ad0 0x7ffb380aee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54186/0 (socket says 172.21.15.53:54186) 2023-06-10T18:54:31.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:31.124+0000 7ffb3dd5a640 1 -- 172.21.15.53:0/2904242206 learned_addr learned my addr 172.21.15.53:0/2904242206 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:54:31.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:31.124+0000 7ffb3cd58640 1 --2- 172.21.15.53:0/2904242206 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb380afc60 0x7ffb380b3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:31.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:31.124+0000 7ffb3d559640 1 --2- 172.21.15.53:0/2904242206 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb38071060 0x7ffb38163480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:31.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:31.124+0000 7ffb3dd5a640 1 -- 172.21.15.53:0/2904242206 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb380afc60 msgr2=0x7ffb380b3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:31.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:31.124+0000 7ffb3dd5a640 1 --2- 172.21.15.53:0/2904242206 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb380afc60 0x7ffb380b3310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:31.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:31.124+0000 7ffb3dd5a640 1 -- 172.21.15.53:0/2904242206 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb38071060 msgr2=0x7ffb38163480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:31.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:31.124+0000 7ffb3dd5a640 1 --2- 172.21.15.53:0/2904242206 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb38071060 0x7ffb38163480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:31.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:31.124+0000 7ffb3dd5a640 1 -- 172.21.15.53:0/2904242206 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb340094d0 con 0x7ffb380b0ad0 2023-06-10T18:54:31.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:31.124+0000 7ffb3dd5a640 1 --2- 172.21.15.53:0/2904242206 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb380b0ad0 0x7ffb380aee50 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7ffb3000d560 tx=0x7ffb3000da20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:31.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:31.124+0000 7ffb29ffb640 1 -- 172.21.15.53:0/2904242206 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb300125f0 con 0x7ffb380b0ad0 2023-06-10T18:54:31.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:31.124+0000 7ffb29ffb640 1 -- 172.21.15.53:0/2904242206 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb30012770 con 0x7ffb380b0ad0 2023-06-10T18:54:31.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:31.124+0000 7ffb3f7bd640 1 -- 172.21.15.53:0/2904242206 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb381629a0 con 0x7ffb380b0ad0 2023-06-10T18:54:31.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:31.124+0000 7ffb29ffb640 1 -- 172.21.15.53:0/2904242206 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb30012b20 con 0x7ffb380b0ad0 2023-06-10T18:54:31.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:31.124+0000 7ffb3f7bd640 1 -- 172.21.15.53:0/2904242206 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb38162f60 con 0x7ffb380b0ad0 2023-06-10T18:54:31.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:31.124+0000 7ffb3f7bd640 1 -- 172.21.15.53:0/2904242206 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb38162800 con 0x7ffb380b0ad0 2023-06-10T18:54:31.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:31.128+0000 7ffb29ffb640 1 -- 172.21.15.53:0/2904242206 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ffb30012c80 con 0x7ffb380b0ad0 2023-06-10T18:54:31.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:31.128+0000 7ffb29ffb640 1 --2- 172.21.15.53:0/2904242206 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ffb1c0662b0 0x7ffb1c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:54:31.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:31.128+0000 7ffb29ffb640 1 -- 172.21.15.53:0/2904242206 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6091+0+0 (secure 0 0 0) 0x7ffb30084170 con 0x7ffb380b0ad0 2023-06-10T18:54:31.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:31.128+0000 7ffb3d559640 1 --2- 172.21.15.53:0/2904242206 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ffb1c0662b0 0x7ffb1c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:54:31.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:31.128+0000 7ffb3d559640 1 --2- 172.21.15.53:0/2904242206 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ffb1c0662b0 0x7ffb1c068760 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ffb340ad000 tx=0x7ffb34008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:54:31.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:31.132+0000 7ffb29ffb640 1 -- 172.21.15.53:0/2904242206 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ffb38162800 con 0x7ffb380b0ad0 2023-06-10T18:54:31.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:31.320+0000 7ffb3f7bd640 1 -- 172.21.15.53:0/2904242206 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffb38162800 con 0x7ffb380b0ad0 2023-06-10T18:54:31.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:31.320+0000 7ffb29ffb640 1 -- 172.21.15.53:0/2904242206 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4677 (secure 0 0 0) 0x7ffb38162800 con 0x7ffb380b0ad0 2023-06-10T18:54:31.329 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:54:31.329 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4853,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/4087456763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":4087456763},{"type":"v1","addr":"172.21.15.117:6835","nonce":4087456763}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5071,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1065941624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1065941624},{"type":"v1","addr":"172.21.15.117:6837","nonce":1065941624}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5322,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/4137796077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":4137796077},{"type":"v1","addr":"172.21.15.53:6833","nonce":4137796077}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T18:53:54.735461+0000","modified":"2023-06-10T18:53:56.773799+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5331},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5331":{"gid":5331,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/2596772129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2596772129},{"type":"v1","addr":"172.21.15.53:6835","nonce":2596772129}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-06-10T18:54:31.330 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 13 2023-06-10T18:54:31.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:31.324+0000 7ffb3f7bd640 1 -- 172.21.15.53:0/2904242206 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ffb1c0662b0 msgr2=0x7ffb1c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:31.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:31.324+0000 7ffb3f7bd640 1 --2- 172.21.15.53:0/2904242206 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ffb1c0662b0 0x7ffb1c068760 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ffb340ad000 tx=0x7ffb34008040 comp rx=0 tx=0).stop 2023-06-10T18:54:31.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:31.324+0000 7ffb3f7bd640 1 -- 172.21.15.53:0/2904242206 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb380b0ad0 msgr2=0x7ffb380aee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:54:31.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:31.324+0000 7ffb3f7bd640 1 --2- 172.21.15.53:0/2904242206 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb380b0ad0 0x7ffb380aee50 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7ffb3000d560 tx=0x7ffb3000da20 comp rx=0 tx=0).stop 2023-06-10T18:54:31.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:31.324+0000 7ffb3f7bd640 1 -- 172.21.15.53:0/2904242206 shutdown_connections 2023-06-10T18:54:31.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:31.324+0000 7ffb3f7bd640 1 --2- 172.21.15.53:0/2904242206 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ffb1c0662b0 0x7ffb1c068760 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:31.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:31.324+0000 7ffb3f7bd640 1 --2- 172.21.15.53:0/2904242206 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb380b0ad0 0x7ffb380aee50 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:31.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:31.324+0000 7ffb3f7bd640 1 --2- 172.21.15.53:0/2904242206 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb380afc60 0x7ffb380b3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:31.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:31.324+0000 7ffb3f7bd640 1 --2- 172.21.15.53:0/2904242206 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb38071060 0x7ffb38163480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:54:31.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:31.324+0000 7ffb3f7bd640 1 -- 172.21.15.53:0/2904242206 >> 172.21.15.53:0/2904242206 conn(0x7ffb3806a0d0 msgr2=0x7ffb380c9030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:54:31.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:31.324+0000 7ffb3f7bd640 1 -- 172.21.15.53:0/2904242206 shutdown_connections 2023-06-10T18:54:31.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:54:31.324+0000 7ffb3f7bd640 1 -- 172.21.15.53:0/2904242206 wait complete. 2023-06-10T18:54:31.349 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2023-06-10T18:54:31.489 INFO:teuthology.orchestra.run.smithi053.stdout:[{"id":5763,"entity":{"name":{"type":"client","num":5763},"addr":{"type":"any","addr":"172.21.15.53:0","nonce":1219381254}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":0,"uptime":0.67599357999999998,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":0.99844856977514918,"halflife":300},"cap_acquisition":{"value":0,"halflife":10},"last_trim_completed_requests_tid":1,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.5763 172.21.15.53:0/1219381254","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x00000000000fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"219d315c3a0b2075e570fb1964be2ad33fe7a9c8","ceph_version":"ceph version 18.0.0-4359-g219d315c (219d315c3a0b2075e570fb1964be2ad33fe7a9c8) reef (dev)","entity_id":"admin","hostname":"smithi053","pid":"48663","root":"/"}}] 2023-06-10T18:54:31.490 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 10, "value": 0 }, "client_metadata": { "ceph_sha1": "219d315c3a0b2075e570fb1964be2ad33fe7a9c8", "ceph_version": "ceph version 18.0.0-4359-g219d315c (219d315c3a0b2075e570fb1964be2ad33fe7a9c8) reef (dev)", "client_features": { "feature_bits": "0x00000000000fffff" }, "entity_id": "admin", "hostname": "smithi053", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "48663", "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "172.21.15.53:0", "nonce": 1219381254, "type": "any" }, "name": { "num": 5763, "type": "client" } }, "id": 5763, "inst": "client.5763 172.21.15.53:0/1219381254", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 1, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 0, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 0.9984485697751492 }, "state": "open", "uptime": 0.67599358 } ] 2023-06-10T18:54:36.095 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-10T18:54:36.099 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-10T18:55:06.217 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-10T18:55:06.220 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-10T18:55:36.353 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-10T18:55:36.355 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-10T18:56:01.491 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T18:56:01.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:01.619+0000 7fe6f2fd1640 1 Processor -- start 2023-06-10T18:56:01.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:01.619+0000 7fe6f2fd1640 1 -- start start 2023-06-10T18:56:01.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:01.619+0000 7fe6f2fd1640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe6ec0c9840 0x7fe6ec0c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:01.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:01.619+0000 7fe6f2fd1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6ec071060 0x7fe6ec0af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:01.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:01.619+0000 7fe6f2fd1640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe6ec0afc60 0x7fe6ec15d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:01.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:01.619+0000 7fe6f2fd1640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6ec159b50 con 0x7fe6ec0afc60 2023-06-10T18:56:01.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:01.619+0000 7fe6f2fd1640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6ec0ca150 con 0x7fe6ec0c9840 2023-06-10T18:56:01.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:01.619+0000 7fe6f2fd1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6ec0702a0 con 0x7fe6ec071060 2023-06-10T18:56:01.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:01.619+0000 7fe6f156e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe6ec0afc60 0x7fe6ec15d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:01.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:01.619+0000 7fe6f156e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe6ec0afc60 0x7fe6ec15d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51078/0 (socket says 172.21.15.53:51078) 2023-06-10T18:56:01.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:01.619+0000 7fe6f156e640 1 -- 172.21.15.53:0/3486531142 learned_addr learned my addr 172.21.15.53:0/3486531142 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:01.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:01.619+0000 7fe6ebfff640 1 --2- 172.21.15.53:0/3486531142 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6ec071060 0x7fe6ec0af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:01.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:01.619+0000 7fe6f0d6d640 1 --2- 172.21.15.53:0/3486531142 >> v2:172.21.15.117:3300/0 conn(0x7fe6ec0c9840 0x7fe6ec0c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:01.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:01.619+0000 7fe6f156e640 1 -- 172.21.15.53:0/3486531142 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6ec071060 msgr2=0x7fe6ec0af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:01.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:01.619+0000 7fe6f156e640 1 --2- 172.21.15.53:0/3486531142 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6ec071060 0x7fe6ec0af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:01.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:01.619+0000 7fe6f156e640 1 -- 172.21.15.53:0/3486531142 >> v2:172.21.15.117:3300/0 conn(0x7fe6ec0c9840 msgr2=0x7fe6ec0c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:01.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:01.619+0000 7fe6f156e640 1 --2- 172.21.15.53:0/3486531142 >> v2:172.21.15.117:3300/0 conn(0x7fe6ec0c9840 0x7fe6ec0c9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:01.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:01.619+0000 7fe6f156e640 1 -- 172.21.15.53:0/3486531142 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6ec070580 con 0x7fe6ec0afc60 2023-06-10T18:56:01.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:01.623+0000 7fe6f156e640 1 --2- 172.21.15.53:0/3486531142 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6ec0afc60 0x7fe6ec15d2c0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec071d80 tx=0x7fe6e401c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e4679c050ae1a72 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:01.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:01.623+0000 7fe6eb7fe640 1 -- 172.21.15.53:0/3486531142 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e40ab600 con 0x7fe6ec0afc60 2023-06-10T18:56:01.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:01.623+0000 7fe6eb7fe640 1 -- 172.21.15.53:0/3486531142 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6e40a7050 con 0x7fe6ec0afc60 2023-06-10T18:56:01.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:01.623+0000 7fe6eb7fe640 1 -- 172.21.15.53:0/3486531142 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e40ab980 con 0x7fe6ec0afc60 2023-06-10T18:56:01.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:01.623+0000 7fe6f2fd1640 1 -- 172.21.15.53:0/3486531142 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6ec0afc60 msgr2=0x7fe6ec15d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:01.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:01.623+0000 7fe6f2fd1640 1 --2- 172.21.15.53:0/3486531142 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6ec0afc60 0x7fe6ec15d2c0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec071d80 tx=0x7fe6e401c210 comp rx=0 tx=0).stop 2023-06-10T18:56:01.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:01.623+0000 7fe6f2fd1640 1 -- 172.21.15.53:0/3486531142 shutdown_connections 2023-06-10T18:56:01.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:01.623+0000 7fe6f2fd1640 1 --2- 172.21.15.53:0/3486531142 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6ec0afc60 0x7fe6ec15d2c0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:01.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:01.623+0000 7fe6f2fd1640 1 --2- 172.21.15.53:0/3486531142 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6ec071060 0x7fe6ec0af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:01.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:01.623+0000 7fe6f2fd1640 1 --2- 172.21.15.53:0/3486531142 >> v2:172.21.15.117:3300/0 conn(0x7fe6ec0c9840 0x7fe6ec0c9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:01.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:01.623+0000 7fe6f2fd1640 1 -- 172.21.15.53:0/3486531142 >> 172.21.15.53:0/3486531142 conn(0x7fe6ec06a0d0 msgr2=0x7fe6ec0ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:01.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:01.623+0000 7fe6f2fd1640 1 -- 172.21.15.53:0/3486531142 shutdown_connections 2023-06-10T18:56:01.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:01.623+0000 7fe6f2fd1640 1 -- 172.21.15.53:0/3486531142 wait complete. 2023-06-10T18:56:01.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:01.623+0000 7fe6f2fd1640 1 Processor -- start 2023-06-10T18:56:01.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:01.623+0000 7fe6f2fd1640 1 -- start start 2023-06-10T18:56:01.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:01.627+0000 7fe6f2fd1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6ec071060 0x7fe6ec150f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:01.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:01.627+0000 7fe6f2fd1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6ec0afc60 0x7fe6ec1554d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:01.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:01.627+0000 7fe6f2fd1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6ec0c9840 0x7fe6ec0c6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:01.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:01.627+0000 7fe6f2fd1640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6ec155040 con 0x7fe6ec071060 2023-06-10T18:56:01.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:01.627+0000 7fe6f2fd1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6ec0c5020 con 0x7fe6ec0afc60 2023-06-10T18:56:01.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:01.627+0000 7fe6f2fd1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6ec151480 con 0x7fe6ec0c9840 2023-06-10T18:56:01.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:01.627+0000 7fe6f0d6d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6ec071060 0x7fe6ec150f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:01.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:01.627+0000 7fe6f0d6d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6ec071060 0x7fe6ec150f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51082/0 (socket says 172.21.15.53:51082) 2023-06-10T18:56:01.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:01.627+0000 7fe6f0d6d640 1 -- 172.21.15.53:0/773728080 learned_addr learned my addr 172.21.15.53:0/773728080 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:01.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:01.627+0000 7fe6ebfff640 1 --2- 172.21.15.53:0/773728080 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6ec0afc60 0x7fe6ec1554d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:01.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:01.627+0000 7fe6f156e640 1 --2- 172.21.15.53:0/773728080 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6ec0c9840 0x7fe6ec0c6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:01.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:01.627+0000 7fe6f0d6d640 1 -- 172.21.15.53:0/773728080 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6ec0c9840 msgr2=0x7fe6ec0c6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:01.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:01.627+0000 7fe6f0d6d640 1 --2- 172.21.15.53:0/773728080 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6ec0c9840 0x7fe6ec0c6470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:01.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:01.627+0000 7fe6f0d6d640 1 -- 172.21.15.53:0/773728080 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6ec0afc60 msgr2=0x7fe6ec1554d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:01.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:01.627+0000 7fe6f0d6d640 1 --2- 172.21.15.53:0/773728080 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6ec0afc60 0x7fe6ec1554d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:01.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:01.627+0000 7fe6f0d6d640 1 -- 172.21.15.53:0/773728080 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e40094d0 con 0x7fe6ec071060 2023-06-10T18:56:01.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:01.627+0000 7fe6f156e640 1 --2- 172.21.15.53:0/773728080 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6ec0c9840 0x7fe6ec0c6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:56:01.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:01.627+0000 7fe6f0d6d640 1 --2- 172.21.15.53:0/773728080 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6ec071060 0x7fe6ec150f40 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc007e70 tx=0x7fe6dc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:01.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:01.627+0000 7fe6e97fa640 1 -- 172.21.15.53:0/773728080 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc014620 con 0x7fe6ec071060 2023-06-10T18:56:01.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:01.627+0000 7fe6e97fa640 1 -- 172.21.15.53:0/773728080 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6dc014780 con 0x7fe6ec071060 2023-06-10T18:56:01.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:01.627+0000 7fe6f2fd1640 1 -- 172.21.15.53:0/773728080 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6ec0cd200 con 0x7fe6ec071060 2023-06-10T18:56:01.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:01.627+0000 7fe6e97fa640 1 -- 172.21.15.53:0/773728080 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc014b30 con 0x7fe6ec071060 2023-06-10T18:56:01.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:01.627+0000 7fe6f2fd1640 1 -- 172.21.15.53:0/773728080 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6ec155a10 con 0x7fe6ec071060 2023-06-10T18:56:01.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:01.627+0000 7fe6f2fd1640 1 -- 172.21.15.53:0/773728080 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6ec06b010 con 0x7fe6ec071060 2023-06-10T18:56:01.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:01.627+0000 7fe6e97fa640 1 -- 172.21.15.53:0/773728080 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe6dc014c90 con 0x7fe6ec071060 2023-06-10T18:56:01.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:01.627+0000 7fe6e97fa640 1 --2- 172.21.15.53:0/773728080 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe6d8066280 0x7fe6d8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:01.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:01.627+0000 7fe6e97fa640 1 -- 172.21.15.53:0/773728080 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6091+0+0 (secure 0 0 0) 0x7fe6dc0846a0 con 0x7fe6ec071060 2023-06-10T18:56:01.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:01.631+0000 7fe6ebfff640 1 --2- 172.21.15.53:0/773728080 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe6d8066280 0x7fe6d8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:01.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:01.631+0000 7fe6ebfff640 1 --2- 172.21.15.53:0/773728080 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe6d8066280 0x7fe6d8068730 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec154290 tx=0x7fe6e0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:01.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:01.635+0000 7fe6e97fa640 1 -- 172.21.15.53:0/773728080 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe6dc055590 con 0x7fe6ec071060 2023-06-10T18:56:01.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:01.819+0000 7fe6f2fd1640 1 -- 172.21.15.53:0/773728080 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe6ec04d790 con 0x7fe6ec071060 2023-06-10T18:56:01.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:01.819+0000 7fe6e97fa640 1 -- 172.21.15.53:0/773728080 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4677 (secure 0 0 0) 0x7fe6dc055120 con 0x7fe6ec071060 2023-06-10T18:56:01.829 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:56:01.829 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4853,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/4087456763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":4087456763},{"type":"v1","addr":"172.21.15.117:6835","nonce":4087456763}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5071,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1065941624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1065941624},{"type":"v1","addr":"172.21.15.117:6837","nonce":1065941624}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5322,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/4137796077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":4137796077},{"type":"v1","addr":"172.21.15.53:6833","nonce":4137796077}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T18:53:54.735461+0000","modified":"2023-06-10T18:53:56.773799+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5331},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5331":{"gid":5331,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/2596772129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2596772129},{"type":"v1","addr":"172.21.15.53:6835","nonce":2596772129}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-06-10T18:56:01.831 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 13 2023-06-10T18:56:01.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:01.823+0000 7fe6f2fd1640 1 -- 172.21.15.53:0/773728080 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe6d8066280 msgr2=0x7fe6d8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:01.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:01.823+0000 7fe6f2fd1640 1 --2- 172.21.15.53:0/773728080 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe6d8066280 0x7fe6d8068730 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec154290 tx=0x7fe6e0008040 comp rx=0 tx=0).stop 2023-06-10T18:56:01.832 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:01.823+0000 7fe6f2fd1640 1 -- 172.21.15.53:0/773728080 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6ec071060 msgr2=0x7fe6ec150f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:01.832 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:01.823+0000 7fe6f2fd1640 1 --2- 172.21.15.53:0/773728080 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6ec071060 0x7fe6ec150f40 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc007e70 tx=0x7fe6dc00e4b0 comp rx=0 tx=0).stop 2023-06-10T18:56:01.832 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:01.823+0000 7fe6f2fd1640 1 -- 172.21.15.53:0/773728080 shutdown_connections 2023-06-10T18:56:01.832 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:01.823+0000 7fe6f2fd1640 1 --2- 172.21.15.53:0/773728080 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe6d8066280 0x7fe6d8068730 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:01.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:01.823+0000 7fe6f2fd1640 1 --2- 172.21.15.53:0/773728080 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6ec0c9840 0x7fe6ec0c6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:01.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:01.823+0000 7fe6f2fd1640 1 --2- 172.21.15.53:0/773728080 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6ec0afc60 0x7fe6ec1554d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:01.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:01.823+0000 7fe6f2fd1640 1 --2- 172.21.15.53:0/773728080 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6ec071060 0x7fe6ec150f40 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:01.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:01.823+0000 7fe6f2fd1640 1 -- 172.21.15.53:0/773728080 >> 172.21.15.53:0/773728080 conn(0x7fe6ec06a0d0 msgr2=0x7fe6ec158b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:01.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:01.823+0000 7fe6f2fd1640 1 -- 172.21.15.53:0/773728080 shutdown_connections 2023-06-10T18:56:01.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:01.823+0000 7fe6f2fd1640 1 -- 172.21.15.53:0/773728080 wait complete. 2023-06-10T18:56:01.846 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2023-06-10T18:56:01.980 INFO:teuthology.orchestra.run.smithi053.stdout:[{"id":5763,"entity":{"name":{"type":"client","num":5763},"addr":{"type":"any","addr":"172.21.15.53:0","nonce":1219381254}},"state":"stale","num_leases":0,"num_caps":1,"request_load_avg":0,"uptime":91.167141436999998,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":0.81007245749844559,"halflife":300},"cap_acquisition":{"value":0,"halflife":10},"last_trim_completed_requests_tid":1,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.5763 172.21.15.53:0/1219381254","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x00000000000fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"219d315c3a0b2075e570fb1964be2ad33fe7a9c8","ceph_version":"ceph version 18.0.0-4359-g219d315c (219d315c3a0b2075e570fb1964be2ad33fe7a9c8) reef (dev)","entity_id":"admin","hostname":"smithi053","pid":"48663","root":"/"}}] 2023-06-10T18:56:01.981 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 10, "value": 0 }, "client_metadata": { "ceph_sha1": "219d315c3a0b2075e570fb1964be2ad33fe7a9c8", "ceph_version": "ceph version 18.0.0-4359-g219d315c (219d315c3a0b2075e570fb1964be2ad33fe7a9c8) reef (dev)", "client_features": { "feature_bits": "0x00000000000fffff" }, "entity_id": "admin", "hostname": "smithi053", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "48663", "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "172.21.15.53:0", "nonce": 1219381254, "type": "any" }, "name": { "num": 5763, "type": "client" } }, "id": 5763, "inst": "client.5763 172.21.15.53:0/1219381254", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 1, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 0, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 0.8100724574984456 }, "state": "stale", "uptime": 91.167141437 } ] 2023-06-10T18:56:01.982 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-06-10T18:56:01.982 DEBUG:teuthology.orchestra.run.smithi053:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-06-10T18:56:02.024 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-06-10T18:56:02.088 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-06-10T18:56:02.088 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T18:56:02.089 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T18:56:02.094 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16345192k,nr_inodes=4086298,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276544k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=407 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276540k,nr_inodes=819135,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276544k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-06-10T18:56:02.095 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi053.front.sepia.ceph.com 2023-06-10T18:56:02.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:56:02.095 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-06-10T18:56:02.142 INFO:teuthology.orchestra.run.smithi053.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-06-10T18:56:02.143 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-10T18:56:02.144 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T18:56:02.144 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T18:56:02.150 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16342088k,nr_inodes=4085522,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275924k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18845 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275920k,nr_inodes=818980,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275924k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-06-10T18:56:02.150 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi117.front.sepia.ceph.com 2023-06-10T18:56:02.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:56:02.151 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-06-10T18:56:02.198 INFO:teuthology.orchestra.run.smithi117.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-06-10T18:56:02.199 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-10T18:56:02.200 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T18:56:02.200 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T18:56:02.206 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16345192k,nr_inodes=4086298,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276544k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=407 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276540k,nr_inodes=819135,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276544k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-06-10T18:56:02.207 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi053.front.sepia.ceph.com 2023-06-10T18:56:02.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:56:02.208 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-06-10T18:56:02.255 INFO:teuthology.orchestra.run.smithi053.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-06-10T18:56:02.256 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-10T18:56:02.257 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T18:56:02.258 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T18:56:02.264 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16342088k,nr_inodes=4085522,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275924k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18845 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275920k,nr_inodes=818980,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275924k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-06-10T18:56:02.264 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi117.front.sepia.ceph.com 2023-06-10T18:56:02.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:56:02.265 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-06-10T18:56:02.310 INFO:teuthology.orchestra.run.smithi117.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-06-10T18:56:02.312 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-10T18:56:02.313 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T18:56:02.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.439+0000 7f570470a640 1 Processor -- start 2023-06-10T18:56:02.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.439+0000 7f570470a640 1 -- start start 2023-06-10T18:56:02.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.439+0000 7f570470a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56fc0b3ac0 0x7f56fc0b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:02.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.439+0000 7f570470a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f56fc0cc690 0x7f56fc15f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:02.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.439+0000 7f570470a640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56fc0d0020 con 0x7f56fc0ccae0 2023-06-10T18:56:02.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.439+0000 7f570470a640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56fc0b43d0 con 0x7f56fc0cc690 2023-06-10T18:56:02.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.439+0000 7f570470a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56fc0cef40 con 0x7f56fc0b3ac0 2023-06-10T18:56:02.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.439+0000 7f5701ca5640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f56fc0cc690 0x7f56fc15f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:02.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.439+0000 7f57024a6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56fc0b3ac0 0x7f56fc0b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:02.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.439+0000 7f5701ca5640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f56fc0cc690 0x7f56fc15f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.53:57748/0 (socket says 172.21.15.53:57748) 2023-06-10T18:56:02.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.439+0000 7f57024a6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56fc0b3ac0 0x7f56fc0b3e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.53:38762/0 (socket says 172.21.15.53:38762) 2023-06-10T18:56:02.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.439+0000 7f5701ca5640 1 -- 172.21.15.53:0/4113086262 learned_addr learned my addr 172.21.15.53:0/4113086262 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:02.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.439+0000 7f57024a6640 1 -- 172.21.15.53:0/4113086262 >> v2:172.21.15.117:3300/0 conn(0x7f56fc0cc690 msgr2=0x7f56fc15f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:02.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.439+0000 7f57024a6640 1 --2- 172.21.15.53:0/4113086262 >> v2:172.21.15.117:3300/0 conn(0x7f56fc0cc690 0x7f56fc15f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:02.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.439+0000 7f57024a6640 1 -- 172.21.15.53:0/4113086262 >> v1:172.21.15.117:6789/0 conn(0x7f56fc0ccae0 legacy=0x7f56fc15f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:02.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.439+0000 7f57024a6640 1 -- 172.21.15.53:0/4113086262 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56fc0cf220 con 0x7f56fc0b3ac0 2023-06-10T18:56:02.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.443+0000 7f57024a6640 1 --2- 172.21.15.53:0/4113086262 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56fc0b3ac0 0x7f56fc0b3e90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f56f80097c0 tx=0x7f56f801c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=198aee4e7a1b6a0b server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:02.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.443+0000 7f57014a4640 1 -- 172.21.15.53:0/4113086262 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f80ad660 con 0x7f56fc0b3ac0 2023-06-10T18:56:02.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.443+0000 7f57014a4640 1 -- 172.21.15.53:0/4113086262 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56f80ad7c0 con 0x7f56fc0b3ac0 2023-06-10T18:56:02.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.443+0000 7f57014a4640 1 -- 172.21.15.53:0/4113086262 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f80adb50 con 0x7f56fc0b3ac0 2023-06-10T18:56:02.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.443+0000 7f570470a640 1 -- 172.21.15.53:0/4113086262 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56fc0b3ac0 msgr2=0x7f56fc0b3e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:02.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.443+0000 7f570470a640 1 --2- 172.21.15.53:0/4113086262 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56fc0b3ac0 0x7f56fc0b3e90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f56f80097c0 tx=0x7f56f801c450 comp rx=0 tx=0).stop 2023-06-10T18:56:02.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.443+0000 7f570470a640 1 -- 172.21.15.53:0/4113086262 shutdown_connections 2023-06-10T18:56:02.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.443+0000 7f570470a640 1 --2- 172.21.15.53:0/4113086262 >> v2:172.21.15.117:3300/0 conn(0x7f56fc0cc690 0x7f56fc15f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:02.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.443+0000 7f570470a640 1 --2- 172.21.15.53:0/4113086262 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56fc0b3ac0 0x7f56fc0b3e90 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:02.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.443+0000 7f570470a640 1 -- 172.21.15.53:0/4113086262 >> 172.21.15.53:0/4113086262 conn(0x7f56fc071790 msgr2=0x7f56fc069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:02.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.443+0000 7f570470a640 1 -- 172.21.15.53:0/4113086262 shutdown_connections 2023-06-10T18:56:02.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.443+0000 7f570470a640 1 -- 172.21.15.53:0/4113086262 wait complete. 2023-06-10T18:56:02.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.443+0000 7f570470a640 1 Processor -- start 2023-06-10T18:56:02.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.443+0000 7f570470a640 1 -- start start 2023-06-10T18:56:02.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.443+0000 7f570470a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f56fc0b3ac0 0x7f56fc0c58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:02.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.443+0000 7f570470a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56fc0cc690 0x7f56fc1553b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:02.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.443+0000 7f570470a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56fc0ccae0 0x7f56fc0cb450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:02.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.447+0000 7f570470a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56fc0c9cb0 con 0x7f56fc0ccae0 2023-06-10T18:56:02.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.447+0000 7f570470a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56fc0c5de0 con 0x7f56fc0b3ac0 2023-06-10T18:56:02.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.447+0000 7f570470a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56fc1558f0 con 0x7f56fc0cc690 2023-06-10T18:56:02.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.447+0000 7f5702ca7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56fc0ccae0 0x7f56fc0cb450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:02.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.447+0000 7f5702ca7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56fc0ccae0 0x7f56fc0cb450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51090/0 (socket says 172.21.15.53:51090) 2023-06-10T18:56:02.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.447+0000 7f5702ca7640 1 -- 172.21.15.53:0/2559915539 learned_addr learned my addr 172.21.15.53:0/2559915539 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:02.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.447+0000 7f5701ca5640 1 --2- 172.21.15.53:0/2559915539 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56fc0cc690 0x7f56fc1553b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:02.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.447+0000 7f57024a6640 1 --2- 172.21.15.53:0/2559915539 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f56fc0b3ac0 0x7f56fc0c58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:02.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.447+0000 7f5702ca7640 1 -- 172.21.15.53:0/2559915539 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56fc0cc690 msgr2=0x7f56fc1553b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:02.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.447+0000 7f5702ca7640 1 --2- 172.21.15.53:0/2559915539 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56fc0cc690 0x7f56fc1553b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:02.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.447+0000 7f5702ca7640 1 -- 172.21.15.53:0/2559915539 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f56fc0b3ac0 msgr2=0x7f56fc0c58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:02.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.447+0000 7f5702ca7640 1 --2- 172.21.15.53:0/2559915539 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f56fc0b3ac0 0x7f56fc0c58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:02.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.447+0000 7f5702ca7640 1 -- 172.21.15.53:0/2559915539 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56f8009420 con 0x7f56fc0ccae0 2023-06-10T18:56:02.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.447+0000 7f5702ca7640 1 --2- 172.21.15.53:0/2559915539 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56fc0ccae0 0x7f56fc0cb450 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f56f400c730 tx=0x7f56f400cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:02.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.447+0000 7f56f2ffd640 1 -- 172.21.15.53:0/2559915539 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f4006d60 con 0x7f56fc0ccae0 2023-06-10T18:56:02.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.447+0000 7f56f2ffd640 1 -- 172.21.15.53:0/2559915539 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56f4003980 con 0x7f56fc0ccae0 2023-06-10T18:56:02.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.447+0000 7f570470a640 1 -- 172.21.15.53:0/2559915539 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56fc0c9ec0 con 0x7f56fc0ccae0 2023-06-10T18:56:02.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.447+0000 7f56f2ffd640 1 -- 172.21.15.53:0/2559915539 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f4003d30 con 0x7f56fc0ccae0 2023-06-10T18:56:02.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.447+0000 7f570470a640 1 -- 172.21.15.53:0/2559915539 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56fc0ca480 con 0x7f56fc0ccae0 2023-06-10T18:56:02.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.447+0000 7f570470a640 1 -- 172.21.15.53:0/2559915539 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56fc04d790 con 0x7f56fc0ccae0 2023-06-10T18:56:02.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.447+0000 7f56f2ffd640 1 -- 172.21.15.53:0/2559915539 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f56f40050d0 con 0x7f56fc0ccae0 2023-06-10T18:56:02.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.447+0000 7f56f2ffd640 1 --2- 172.21.15.53:0/2559915539 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f56e0066280 0x7f56e0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:02.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.447+0000 7f56f2ffd640 1 -- 172.21.15.53:0/2559915539 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f56f4083660 con 0x7f56fc0ccae0 2023-06-10T18:56:02.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.447+0000 7f57024a6640 1 --2- 172.21.15.53:0/2559915539 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f56e0066280 0x7f56e0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:02.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.451+0000 7f57024a6640 1 --2- 172.21.15.53:0/2559915539 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f56e0066280 0x7f56e0068730 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f56f80af000 tx=0x7f56f80a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:02.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.451+0000 7f56f2ffd640 1 -- 172.21.15.53:0/2559915539 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f56f4054690 con 0x7f56fc0ccae0 2023-06-10T18:56:02.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.639+0000 7f570470a640 1 -- 172.21.15.53:0/2559915539 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f56fc0c7200 con 0x7f56fc0ccae0 2023-06-10T18:56:02.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.643+0000 7f56f2ffd640 1 -- 172.21.15.53:0/2559915539 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4677 (secure 0 0 0) 0x7f56f4054220 con 0x7f56fc0ccae0 2023-06-10T18:56:02.650 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:56:02.650 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4853,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/4087456763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":4087456763},{"type":"v1","addr":"172.21.15.117:6835","nonce":4087456763}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5071,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1065941624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1065941624},{"type":"v1","addr":"172.21.15.117:6837","nonce":1065941624}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5322,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/4137796077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":4137796077},{"type":"v1","addr":"172.21.15.53:6833","nonce":4137796077}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T18:53:54.735461+0000","modified":"2023-06-10T18:53:56.773799+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5331},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5331":{"gid":5331,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/2596772129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2596772129},{"type":"v1","addr":"172.21.15.53:6835","nonce":2596772129}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-06-10T18:56:02.651 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 13 2023-06-10T18:56:02.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.643+0000 7f570470a640 1 -- 172.21.15.53:0/2559915539 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f56e0066280 msgr2=0x7f56e0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:02.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.643+0000 7f570470a640 1 --2- 172.21.15.53:0/2559915539 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f56e0066280 0x7f56e0068730 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f56f80af000 tx=0x7f56f80a7000 comp rx=0 tx=0).stop 2023-06-10T18:56:02.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.643+0000 7f570470a640 1 -- 172.21.15.53:0/2559915539 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56fc0ccae0 msgr2=0x7f56fc0cb450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:02.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.643+0000 7f570470a640 1 --2- 172.21.15.53:0/2559915539 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56fc0ccae0 0x7f56fc0cb450 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f56f400c730 tx=0x7f56f400cb30 comp rx=0 tx=0).stop 2023-06-10T18:56:02.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.643+0000 7f570470a640 1 -- 172.21.15.53:0/2559915539 shutdown_connections 2023-06-10T18:56:02.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.643+0000 7f570470a640 1 --2- 172.21.15.53:0/2559915539 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f56e0066280 0x7f56e0068730 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:02.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.643+0000 7f570470a640 1 --2- 172.21.15.53:0/2559915539 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56fc0ccae0 0x7f56fc0cb450 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:02.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.643+0000 7f570470a640 1 --2- 172.21.15.53:0/2559915539 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56fc0cc690 0x7f56fc1553b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:02.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.643+0000 7f570470a640 1 --2- 172.21.15.53:0/2559915539 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f56fc0b3ac0 0x7f56fc0c58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:02.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.643+0000 7f570470a640 1 -- 172.21.15.53:0/2559915539 >> 172.21.15.53:0/2559915539 conn(0x7f56fc071790 msgr2=0x7f56fc15b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:02.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.643+0000 7f570470a640 1 -- 172.21.15.53:0/2559915539 shutdown_connections 2023-06-10T18:56:02.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.643+0000 7f570470a640 1 -- 172.21.15.53:0/2559915539 wait complete. 2023-06-10T18:56:02.670 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T18:56:02.797 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.787+0000 7f346f430640 1 Processor -- start 2023-06-10T18:56:02.798 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.787+0000 7f346f430640 1 -- start start 2023-06-10T18:56:02.799 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.791+0000 7f346f430640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f346806c7d0 0x7f34681586f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:02.799 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.791+0000 7f346f430640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f346815c260 con 0x7f346806c400 2023-06-10T18:56:02.799 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.791+0000 7f346f430640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f346815c540 con 0x7f34680ccc90 2023-06-10T18:56:02.799 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.791+0000 7f346f430640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f346815cee0 con 0x7f346806c7d0 2023-06-10T18:56:02.799 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.791+0000 7f346c9cb640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f346806c7d0 0x7f34681586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:02.799 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.791+0000 7f346d1cc640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f346806c400 0x7f3468157fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41228/0 (socket says 172.21.15.53:41228) 2023-06-10T18:56:02.800 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.791+0000 7f346d1cc640 1 -- 172.21.15.53:0/3213208465 learned_addr learned my addr 172.21.15.53:0/3213208465 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:56:02.800 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.791+0000 7f346c9cb640 1 -- 172.21.15.53:0/3213208465 >> v1:172.21.15.117:6789/0 conn(0x7f34680ccc90 legacy=0x7f34680cd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:02.800 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.791+0000 7f346c9cb640 1 -- 172.21.15.53:0/3213208465 >> v1:172.21.15.53:6789/0 conn(0x7f346806c400 legacy=0x7f3468157fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:02.800 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.791+0000 7f346c9cb640 1 -- 172.21.15.53:0/3213208465 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f346815c820 con 0x7f346806c7d0 2023-06-10T18:56:02.801 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.791+0000 7f346c9cb640 1 --2- 172.21.15.53:0/3213208465 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f346806c7d0 0x7f34681586f0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f3460009d90 tx=0x7f346001c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52c72d5059c4a647 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:02.802 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.791+0000 7f345ffff640 1 -- 172.21.15.53:0/3213208465 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34600a5890 con 0x7f346806c7d0 2023-06-10T18:56:02.802 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.791+0000 7f345ffff640 1 -- 172.21.15.53:0/3213208465 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34600a59f0 con 0x7f346806c7d0 2023-06-10T18:56:02.802 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.791+0000 7f345ffff640 1 -- 172.21.15.53:0/3213208465 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34600a5d80 con 0x7f346806c7d0 2023-06-10T18:56:02.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.795+0000 7f346f430640 1 -- 172.21.15.53:0/3213208465 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f346806c7d0 msgr2=0x7f34681586f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:02.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.795+0000 7f346f430640 1 --2- 172.21.15.53:0/3213208465 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f346806c7d0 0x7f34681586f0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f3460009d90 tx=0x7f346001c8c0 comp rx=0 tx=0).stop 2023-06-10T18:56:02.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.795+0000 7f346f430640 1 -- 172.21.15.53:0/3213208465 shutdown_connections 2023-06-10T18:56:02.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.795+0000 7f346f430640 1 --2- 172.21.15.53:0/3213208465 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f346806c7d0 0x7f34681586f0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:02.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.795+0000 7f346f430640 1 -- 172.21.15.53:0/3213208465 >> 172.21.15.53:0/3213208465 conn(0x7f346806a560 msgr2=0x7f346806a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:02.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.795+0000 7f346f430640 1 -- 172.21.15.53:0/3213208465 shutdown_connections 2023-06-10T18:56:02.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.795+0000 7f346f430640 1 -- 172.21.15.53:0/3213208465 wait complete. 2023-06-10T18:56:02.804 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.795+0000 7f346f430640 1 Processor -- start 2023-06-10T18:56:02.804 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.795+0000 7f346f430640 1 -- start start 2023-06-10T18:56:02.805 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.795+0000 7f346f430640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f346806c400 0x7f34680c7f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:02.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.795+0000 7f346f430640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f346806c7d0 0x7f3468145b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:02.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.795+0000 7f346f430640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34680ccc90 0x7f3468146040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:02.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.795+0000 7f346f430640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f346806a3d0 con 0x7f34680ccc90 2023-06-10T18:56:02.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.795+0000 7f346f430640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34680c87a0 con 0x7f346806c400 2023-06-10T18:56:02.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.795+0000 7f346f430640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34680c8a80 con 0x7f346806c7d0 2023-06-10T18:56:02.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.795+0000 7f346d9cd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34680ccc90 0x7f3468146040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:02.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.795+0000 7f346d9cd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34680ccc90 0x7f3468146040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51104/0 (socket says 172.21.15.53:51104) 2023-06-10T18:56:02.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.795+0000 7f346d9cd640 1 -- 172.21.15.53:0/353206524 learned_addr learned my addr 172.21.15.53:0/353206524 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:02.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.795+0000 7f346d1cc640 1 --2- 172.21.15.53:0/353206524 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f346806c400 0x7f34680c7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:02.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.795+0000 7f346c9cb640 1 --2- 172.21.15.53:0/353206524 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f346806c7d0 0x7f3468145b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:02.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.795+0000 7f346d9cd640 1 -- 172.21.15.53:0/353206524 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f346806c7d0 msgr2=0x7f3468145b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:02.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.795+0000 7f346d9cd640 1 --2- 172.21.15.53:0/353206524 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f346806c7d0 0x7f3468145b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:02.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.795+0000 7f346d9cd640 1 -- 172.21.15.53:0/353206524 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f346806c400 msgr2=0x7f34680c7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:02.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.795+0000 7f346d9cd640 1 --2- 172.21.15.53:0/353206524 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f346806c400 0x7f34680c7f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:02.808 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.795+0000 7f346d9cd640 1 -- 172.21.15.53:0/353206524 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3460009a70 con 0x7f34680ccc90 2023-06-10T18:56:02.809 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.799+0000 7f346d9cd640 1 --2- 172.21.15.53:0/353206524 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34680ccc90 0x7f3468146040 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f346400c340 tx=0x7f346400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:02.809 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.799+0000 7f345dffb640 1 -- 172.21.15.53:0/353206524 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3464005220 con 0x7f34680ccc90 2023-06-10T18:56:02.809 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.799+0000 7f345dffb640 1 -- 172.21.15.53:0/353206524 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3464005380 con 0x7f34680ccc90 2023-06-10T18:56:02.809 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.799+0000 7f345dffb640 1 -- 172.21.15.53:0/353206524 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3464007270 con 0x7f34680ccc90 2023-06-10T18:56:02.809 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.799+0000 7f346f430640 1 -- 172.21.15.53:0/353206524 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f346814da90 con 0x7f34680ccc90 2023-06-10T18:56:02.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.799+0000 7f346f430640 1 -- 172.21.15.53:0/353206524 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34680c8490 con 0x7f34680ccc90 2023-06-10T18:56:02.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.799+0000 7f346f430640 1 -- 172.21.15.53:0/353206524 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f346814d8f0 con 0x7f34680ccc90 2023-06-10T18:56:02.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.799+0000 7f345dffb640 1 -- 172.21.15.53:0/353206524 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f34640073d0 con 0x7f34680ccc90 2023-06-10T18:56:02.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.799+0000 7f345dffb640 1 --2- 172.21.15.53:0/353206524 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3454066280 0x7f3454068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:02.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.799+0000 7f345dffb640 1 -- 172.21.15.53:0/353206524 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f3464083270 con 0x7f34680ccc90 2023-06-10T18:56:02.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.799+0000 7f346d1cc640 1 --2- 172.21.15.53:0/353206524 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3454066280 0x7f3454068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:02.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.799+0000 7f346d1cc640 1 --2- 172.21.15.53:0/353206524 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3454066280 0x7f3454068730 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f3458005890 tx=0x7f3458009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:02.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.803+0000 7f345dffb640 1 -- 172.21.15.53:0/353206524 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f346814d8f0 con 0x7f34680ccc90 2023-06-10T18:56:02.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.959+0000 7f346f430640 1 -- 172.21.15.53:0/353206524 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f346814d8f0 con 0x7f34680ccc90 2023-06-10T18:56:02.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.959+0000 7f345dffb640 1 -- 172.21.15.53:0/353206524 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+18332 (secure 0 0 0) 0x7f346814d8f0 con 0x7f34680ccc90 2023-06-10T18:56:02.970 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:56:02.970 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":39,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T18:54:27.787457+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-06-10T18:53:52.688764+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-06-10T18:53:53.727157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.31","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T18:56:02.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.963+0000 7f346f430640 1 -- 172.21.15.53:0/353206524 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3454066280 msgr2=0x7f3454068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:02.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.963+0000 7f346f430640 1 --2- 172.21.15.53:0/353206524 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3454066280 0x7f3454068730 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f3458005890 tx=0x7f3458009040 comp rx=0 tx=0).stop 2023-06-10T18:56:02.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.963+0000 7f346f430640 1 -- 172.21.15.53:0/353206524 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34680ccc90 msgr2=0x7f3468146040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:02.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.963+0000 7f346f430640 1 --2- 172.21.15.53:0/353206524 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34680ccc90 0x7f3468146040 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f346400c340 tx=0x7f346400c800 comp rx=0 tx=0).stop 2023-06-10T18:56:02.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.963+0000 7f346f430640 1 -- 172.21.15.53:0/353206524 shutdown_connections 2023-06-10T18:56:02.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.963+0000 7f346f430640 1 --2- 172.21.15.53:0/353206524 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3454066280 0x7f3454068730 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:02.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.963+0000 7f346f430640 1 --2- 172.21.15.53:0/353206524 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34680ccc90 0x7f3468146040 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:02.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.963+0000 7f346f430640 1 --2- 172.21.15.53:0/353206524 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f346806c7d0 0x7f3468145b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:02.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.963+0000 7f346f430640 1 --2- 172.21.15.53:0/353206524 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f346806c400 0x7f34680c7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:02.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.963+0000 7f346f430640 1 -- 172.21.15.53:0/353206524 >> 172.21.15.53:0/353206524 conn(0x7f346806a560 msgr2=0x7f3468158c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:02.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.963+0000 7f346f430640 1 -- 172.21.15.53:0/353206524 shutdown_connections 2023-06-10T18:56:02.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:02.963+0000 7f346f430640 1 -- 172.21.15.53:0/353206524 wait complete. 2023-06-10T18:56:02.989 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-10T18:52:33.633114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-10T18:52:39.171487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-10T18:53:52.688764+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-06-10T18:53:53.727157+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-10T18:56:02.989 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-10T18:56:03.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.107+0000 7f449437c640 1 Processor -- start 2023-06-10T18:56:03.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.107+0000 7f449437c640 1 -- start start 2023-06-10T18:56:03.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.111+0000 7f449437c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f448c0b0f30 0x7f448c070950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:03.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.111+0000 7f449437c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f448c159a60 0x7f448c0c2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:03.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.111+0000 7f449437c640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f448c0cb080 con 0x7f448c159690 2023-06-10T18:56:03.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.111+0000 7f449437c640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f448c070e90 con 0x7f448c0b0f30 2023-06-10T18:56:03.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.111+0000 7f449437c640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f448c06d450 con 0x7f448c159a60 2023-06-10T18:56:03.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.111+0000 7f4491917640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f448c0b0f30 0x7f448c070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:03.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.111+0000 7f4491917640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f448c0b0f30 0x7f448c070950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51118/0 (socket says 172.21.15.53:51118) 2023-06-10T18:56:03.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.111+0000 7f4491917640 1 -- 172.21.15.53:0/3466129077 learned_addr learned my addr 172.21.15.53:0/3466129077 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:03.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.111+0000 7f4492919640 1 --2- 172.21.15.53:0/3466129077 >> v2:172.21.15.117:3300/0 conn(0x7f448c159a60 0x7f448c0c2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:03.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.111+0000 7f4491917640 1 -- 172.21.15.53:0/3466129077 >> v2:172.21.15.117:3300/0 conn(0x7f448c159a60 msgr2=0x7f448c0c2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:03.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.111+0000 7f4491917640 1 --2- 172.21.15.53:0/3466129077 >> v2:172.21.15.117:3300/0 conn(0x7f448c159a60 0x7f448c0c2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:03.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.111+0000 7f4491917640 1 -- 172.21.15.53:0/3466129077 >> v1:172.21.15.117:6789/0 conn(0x7f448c159690 legacy=0x7f448c0cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:03.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.111+0000 7f4491917640 1 -- 172.21.15.53:0/3466129077 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f448c0cb320 con 0x7f448c0b0f30 2023-06-10T18:56:03.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.111+0000 7f4492919640 1 --2- 172.21.15.53:0/3466129077 >> v2:172.21.15.117:3300/0 conn(0x7f448c159a60 0x7f448c0c2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:56:03.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.111+0000 7f4491917640 1 --2- 172.21.15.53:0/3466129077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f448c0b0f30 0x7f448c070950 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f448c070160 tx=0x7f447c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e82657ecba31db9 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:03.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.111+0000 7f4491116640 1 -- 172.21.15.53:0/3466129077 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447c0ac600 con 0x7f448c0b0f30 2023-06-10T18:56:03.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.115+0000 7f4491116640 1 -- 172.21.15.53:0/3466129077 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f447c0a8050 con 0x7f448c0b0f30 2023-06-10T18:56:03.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.115+0000 7f4491116640 1 -- 172.21.15.53:0/3466129077 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447c0ac980 con 0x7f448c0b0f30 2023-06-10T18:56:03.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.115+0000 7f449437c640 1 -- 172.21.15.53:0/3466129077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f448c0b0f30 msgr2=0x7f448c070950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:03.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.115+0000 7f449437c640 1 --2- 172.21.15.53:0/3466129077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f448c0b0f30 0x7f448c070950 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f448c070160 tx=0x7f447c01c490 comp rx=0 tx=0).stop 2023-06-10T18:56:03.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.115+0000 7f449437c640 1 -- 172.21.15.53:0/3466129077 shutdown_connections 2023-06-10T18:56:03.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.115+0000 7f449437c640 1 --2- 172.21.15.53:0/3466129077 >> v2:172.21.15.117:3300/0 conn(0x7f448c159a60 0x7f448c0c2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:03.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.115+0000 7f449437c640 1 --2- 172.21.15.53:0/3466129077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f448c0b0f30 0x7f448c070950 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:03.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.115+0000 7f449437c640 1 -- 172.21.15.53:0/3466129077 >> 172.21.15.53:0/3466129077 conn(0x7f448c06a560 msgr2=0x7f448c06a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:03.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.115+0000 7f449437c640 1 -- 172.21.15.53:0/3466129077 shutdown_connections 2023-06-10T18:56:03.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.115+0000 7f449437c640 1 -- 172.21.15.53:0/3466129077 wait complete. 2023-06-10T18:56:03.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.115+0000 7f449437c640 1 Processor -- start 2023-06-10T18:56:03.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.115+0000 7f449437c640 1 -- start start 2023-06-10T18:56:03.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.115+0000 7f449437c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f448c0b0f30 0x7f448c1467a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:03.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.115+0000 7f449437c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f448c159690 0x7f448c0adda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:03.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.115+0000 7f449437c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f448c159a60 0x7f448c14f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:03.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.115+0000 7f449437c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f448c14edc0 con 0x7f448c159690 2023-06-10T18:56:03.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.115+0000 7f449437c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f448c14e500 con 0x7f448c159a60 2023-06-10T18:56:03.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.115+0000 7f449437c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f448c14e770 con 0x7f448c0b0f30 2023-06-10T18:56:03.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.115+0000 7f4491917640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f448c159690 0x7f448c0adda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:03.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.115+0000 7f4491917640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f448c159690 0x7f448c0adda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51126/0 (socket says 172.21.15.53:51126) 2023-06-10T18:56:03.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.115+0000 7f4491917640 1 -- 172.21.15.53:0/3665584683 learned_addr learned my addr 172.21.15.53:0/3665584683 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:03.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.115+0000 7f4492118640 1 --2- 172.21.15.53:0/3665584683 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f448c0b0f30 0x7f448c1467a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:03.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.115+0000 7f4492919640 1 --2- 172.21.15.53:0/3665584683 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f448c159a60 0x7f448c14f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:03.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.115+0000 7f4491917640 1 -- 172.21.15.53:0/3665584683 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f448c0b0f30 msgr2=0x7f448c1467a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:03.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.115+0000 7f4491917640 1 --2- 172.21.15.53:0/3665584683 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f448c0b0f30 0x7f448c1467a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:03.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.115+0000 7f4491917640 1 -- 172.21.15.53:0/3665584683 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f448c159a60 msgr2=0x7f448c14f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:03.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.115+0000 7f4491917640 1 --2- 172.21.15.53:0/3665584683 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f448c159a60 0x7f448c14f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:03.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.115+0000 7f4491917640 1 -- 172.21.15.53:0/3665584683 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f447c0094d0 con 0x7f448c159690 2023-06-10T18:56:03.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.115+0000 7f4491917640 1 --2- 172.21.15.53:0/3665584683 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f448c159690 0x7f448c0adda0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f447c01a0c0 tx=0x7f447c01acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:03.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.115+0000 7f4482ffd640 1 -- 172.21.15.53:0/3665584683 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447c0bd070 con 0x7f448c159690 2023-06-10T18:56:03.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.115+0000 7f4482ffd640 1 -- 172.21.15.53:0/3665584683 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f447c0b7420 con 0x7f448c159690 2023-06-10T18:56:03.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.115+0000 7f4482ffd640 1 -- 172.21.15.53:0/3665584683 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447c0b7790 con 0x7f448c159690 2023-06-10T18:56:03.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.119+0000 7f449437c640 1 -- 172.21.15.53:0/3665584683 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f448c14ea50 con 0x7f448c159690 2023-06-10T18:56:03.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.119+0000 7f449437c640 1 -- 172.21.15.53:0/3665584683 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f448c0ae2e0 con 0x7f448c159690 2023-06-10T18:56:03.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.119+0000 7f449437c640 1 -- 172.21.15.53:0/3665584683 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f448c04d790 con 0x7f448c159690 2023-06-10T18:56:03.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.119+0000 7f4482ffd640 1 -- 172.21.15.53:0/3665584683 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f447c0b3040 con 0x7f448c159690 2023-06-10T18:56:03.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.119+0000 7f4482ffd640 1 --2- 172.21.15.53:0/3665584683 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4470066280 0x7f4470068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:03.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.119+0000 7f4482ffd640 1 -- 172.21.15.53:0/3665584683 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f447c11d8e0 con 0x7f448c159690 2023-06-10T18:56:03.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.119+0000 7f4492118640 1 --2- 172.21.15.53:0/3665584683 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4470066280 0x7f4470068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:03.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.119+0000 7f4492118640 1 --2- 172.21.15.53:0/3665584683 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4470066280 0x7f4470068730 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4488003d60 tx=0x7f4488009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:03.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.123+0000 7f4482ffd640 1 -- 172.21.15.53:0/3665584683 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f447c0eadd0 con 0x7f448c159690 2023-06-10T18:56:03.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.275+0000 7f449437c640 1 -- 172.21.15.53:0/3665584683 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f448c0ca500 con 0x7f448c159690 2023-06-10T18:56:03.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.275+0000 7f4482ffd640 1 -- 172.21.15.53:0/3665584683 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) v1 ==== 93+0+10 (secure 0 0 0) 0x7f447c0ee3f0 con 0x7f448c159690 2023-06-10T18:56:03.285 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-06-10T18:56:03.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.279+0000 7f449437c640 1 -- 172.21.15.53:0/3665584683 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4470066280 msgr2=0x7f4470068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:03.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.279+0000 7f449437c640 1 --2- 172.21.15.53:0/3665584683 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4470066280 0x7f4470068730 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4488003d60 tx=0x7f4488009040 comp rx=0 tx=0).stop 2023-06-10T18:56:03.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.279+0000 7f449437c640 1 -- 172.21.15.53:0/3665584683 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f448c159690 msgr2=0x7f448c0adda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:03.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.279+0000 7f449437c640 1 --2- 172.21.15.53:0/3665584683 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f448c159690 0x7f448c0adda0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f447c01a0c0 tx=0x7f447c01acd0 comp rx=0 tx=0).stop 2023-06-10T18:56:03.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.279+0000 7f449437c640 1 -- 172.21.15.53:0/3665584683 shutdown_connections 2023-06-10T18:56:03.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.279+0000 7f449437c640 1 --2- 172.21.15.53:0/3665584683 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4470066280 0x7f4470068730 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:03.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.279+0000 7f449437c640 1 --2- 172.21.15.53:0/3665584683 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f448c159a60 0x7f448c14f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:03.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.279+0000 7f449437c640 1 --2- 172.21.15.53:0/3665584683 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f448c159690 0x7f448c0adda0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:03.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.279+0000 7f449437c640 1 --2- 172.21.15.53:0/3665584683 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f448c0b0f30 0x7f448c1467a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:03.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.279+0000 7f449437c640 1 -- 172.21.15.53:0/3665584683 >> 172.21.15.53:0/3665584683 conn(0x7f448c06a560 msgr2=0x7f448c0ced90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:03.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.279+0000 7f449437c640 1 -- 172.21.15.53:0/3665584683 shutdown_connections 2023-06-10T18:56:03.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.279+0000 7f449437c640 1 -- 172.21.15.53:0/3665584683 wait complete. 2023-06-10T18:56:03.306 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-10T18:56:03.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.415+0000 7f0f66d69640 1 Processor -- start 2023-06-10T18:56:03.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.415+0000 7f0f66d69640 1 -- start start 2023-06-10T18:56:03.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.419+0000 7f0f66d69640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0f6015c090 0x7f0f600b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:03.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.419+0000 7f0f66d69640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f600cc7c0 con 0x7f0f600b7e30 2023-06-10T18:56:03.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.419+0000 7f0f66d69640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f600ccaa0 con 0x7f0f600b0b90 2023-06-10T18:56:03.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.419+0000 7f0f66d69640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f600ccd80 con 0x7f0f6015c090 2023-06-10T18:56:03.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.419+0000 7f0f65306640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f0f600b7e30 0x7f0f600d04d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41234/0 (socket says 172.21.15.53:41234) 2023-06-10T18:56:03.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.419+0000 7f0f65306640 1 -- 172.21.15.53:0/275356594 learned_addr learned my addr 172.21.15.53:0/275356594 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:56:03.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.419+0000 7f0f64b05640 1 --2- 172.21.15.53:0/275356594 >> v2:172.21.15.117:3300/0 conn(0x7f0f6015c090 0x7f0f600b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:03.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.419+0000 7f0f5f7fe640 1 -- 172.21.15.53:0/275356594 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 381979446 0 0) 0x7f0f600cc7c0 con 0x7f0f600b7e30 2023-06-10T18:56:03.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.419+0000 7f0f5f7fe640 1 -- 172.21.15.53:0/275356594 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f50003530 con 0x7f0f600b7e30 2023-06-10T18:56:03.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.419+0000 7f0f5f7fe640 1 -- 172.21.15.53:0/275356594 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2374572530 0 0) 0x7f0f50003530 con 0x7f0f600b7e30 2023-06-10T18:56:03.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.419+0000 7f0f5f7fe640 1 -- 172.21.15.53:0/275356594 >> v2:172.21.15.117:3300/0 conn(0x7f0f6015c090 msgr2=0x7f0f600b10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:03.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.419+0000 7f0f5f7fe640 1 --2- 172.21.15.53:0/275356594 >> v2:172.21.15.117:3300/0 conn(0x7f0f6015c090 0x7f0f600b10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:03.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.419+0000 7f0f5f7fe640 1 -- 172.21.15.53:0/275356594 >> v1:172.21.15.117:6789/0 conn(0x7f0f600b0b90 legacy=0x7f0f600b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:03.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.419+0000 7f0f5f7fe640 1 -- 172.21.15.53:0/275356594 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f600cd060 con 0x7f0f600b7e30 2023-06-10T18:56:03.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.419+0000 7f0f5f7fe640 1 -- 172.21.15.53:0/275356594 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f0f58001a20 con 0x7f0f600b7e30 2023-06-10T18:56:03.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.419+0000 7f0f5f7fe640 1 -- 172.21.15.53:0/275356594 >> v1:172.21.15.53:6789/0 conn(0x7f0f600b7e30 legacy=0x7f0f600d04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:03.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.419+0000 7f0f5f7fe640 1 --2- 172.21.15.53:0/275356594 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f50003980 0x7f0f50003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:03.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.419+0000 7f0f5f7fe640 1 --2- 172.21.15.53:0/275356594 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f50004370 0x7f0f50004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:03.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.419+0000 7f0f5f7fe640 1 --2- 172.21.15.53:0/275356594 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f500050d0 0x7f0f5000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:03.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.419+0000 7f0f5f7fe640 1 -- 172.21.15.53:0/275356594 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f600ccd80 con 0x7f0f50004370 2023-06-10T18:56:03.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.419+0000 7f0f5f7fe640 1 -- 172.21.15.53:0/275356594 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5000c000 con 0x7f0f500050d0 2023-06-10T18:56:03.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.419+0000 7f0f5f7fe640 1 -- 172.21.15.53:0/275356594 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5000c1c0 con 0x7f0f50003980 2023-06-10T18:56:03.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.419+0000 7f0f5ffff640 1 --2- 172.21.15.53:0/275356594 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f50004370 0x7f0f50004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:03.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.419+0000 7f0f65306640 1 --2- 172.21.15.53:0/275356594 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f500050d0 0x7f0f5000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:03.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.419+0000 7f0f64b05640 1 --2- 172.21.15.53:0/275356594 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f50003980 0x7f0f50003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:03.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.419+0000 7f0f5ffff640 1 -- 172.21.15.53:0/275356594 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f50003980 msgr2=0x7f0f50003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:03.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.419+0000 7f0f5ffff640 1 --2- 172.21.15.53:0/275356594 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f50003980 0x7f0f50003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:03.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.419+0000 7f0f5ffff640 1 -- 172.21.15.53:0/275356594 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f500050d0 msgr2=0x7f0f5000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:03.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.419+0000 7f0f5ffff640 1 --2- 172.21.15.53:0/275356594 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f500050d0 0x7f0f5000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:03.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.419+0000 7f0f5ffff640 1 -- 172.21.15.53:0/275356594 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f50003530 con 0x7f0f50004370 2023-06-10T18:56:03.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.419+0000 7f0f65306640 1 -- 172.21.15.53:0/275356594 reap_dead start 2023-06-10T18:56:03.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.419+0000 7f0f64b05640 1 --2- 172.21.15.53:0/275356594 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f50003980 0x7f0f50003d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:56:03.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.423+0000 7f0f5ffff640 1 --2- 172.21.15.53:0/275356594 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f50004370 0x7f0f50004830 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f0f600b1010 tx=0x7f0f4c01ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5883a57c73bdece1 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:03.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.423+0000 7f0f5f7fe640 1 -- 172.21.15.53:0/275356594 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c0a8810 con 0x7f0f50004370 2023-06-10T18:56:03.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.423+0000 7f0f5f7fe640 1 -- 172.21.15.53:0/275356594 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f4c0a8970 con 0x7f0f50004370 2023-06-10T18:56:03.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.423+0000 7f0f5f7fe640 1 -- 172.21.15.53:0/275356594 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c0a8d60 con 0x7f0f50004370 2023-06-10T18:56:03.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.423+0000 7f0f66d69640 1 -- 172.21.15.53:0/275356594 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f50004370 msgr2=0x7f0f50004830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:03.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.423+0000 7f0f66d69640 1 --2- 172.21.15.53:0/275356594 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f50004370 0x7f0f50004830 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f0f600b1010 tx=0x7f0f4c01ebf0 comp rx=0 tx=0).stop 2023-06-10T18:56:03.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.423+0000 7f0f66d69640 1 -- 172.21.15.53:0/275356594 shutdown_connections 2023-06-10T18:56:03.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.423+0000 7f0f66d69640 1 --2- 172.21.15.53:0/275356594 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f50004370 0x7f0f50004830 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:03.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.423+0000 7f0f66d69640 1 -- 172.21.15.53:0/275356594 >> 172.21.15.53:0/275356594 conn(0x7f0f60069e20 msgr2=0x7f0f6006a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:03.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.423+0000 7f0f66d69640 1 -- 172.21.15.53:0/275356594 shutdown_connections 2023-06-10T18:56:03.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.423+0000 7f0f66d69640 1 -- 172.21.15.53:0/275356594 wait complete. 2023-06-10T18:56:03.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.423+0000 7f0f66d69640 1 Processor -- start 2023-06-10T18:56:03.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.423+0000 7f0f66d69640 1 -- start start 2023-06-10T18:56:03.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.423+0000 7f0f66d69640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f50004370 0x7f0f600ca640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:03.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.423+0000 7f0f66d69640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f600cba40 0x7f0f600b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:03.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.423+0000 7f0f66d69640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f600b3220 0x7f0f600b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:03.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.423+0000 7f0f66d69640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f600c6fb0 con 0x7f0f600b3220 2023-06-10T18:56:03.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.423+0000 7f0f66d69640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f60152060 con 0x7f0f50004370 2023-06-10T18:56:03.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.423+0000 7f0f66d69640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f600cab80 con 0x7f0f600cba40 2023-06-10T18:56:03.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.423+0000 7f0f65306640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f600b3220 0x7f0f600b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:03.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.423+0000 7f0f65306640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f600b3220 0x7f0f600b36a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51142/0 (socket says 172.21.15.53:51142) 2023-06-10T18:56:03.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.423+0000 7f0f65306640 1 -- 172.21.15.53:0/2421178412 learned_addr learned my addr 172.21.15.53:0/2421178412 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:03.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.423+0000 7f0f5ffff640 1 --2- 172.21.15.53:0/2421178412 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f600cba40 0x7f0f600b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:03.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.423+0000 7f0f64b05640 1 --2- 172.21.15.53:0/2421178412 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f50004370 0x7f0f600ca640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:03.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.423+0000 7f0f65306640 1 -- 172.21.15.53:0/2421178412 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f600cba40 msgr2=0x7f0f600b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:03.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.423+0000 7f0f65306640 1 --2- 172.21.15.53:0/2421178412 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f600cba40 0x7f0f600b2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:03.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.423+0000 7f0f65306640 1 -- 172.21.15.53:0/2421178412 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f50004370 msgr2=0x7f0f600ca640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:03.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.423+0000 7f0f65306640 1 --2- 172.21.15.53:0/2421178412 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f50004370 0x7f0f600ca640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:03.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.423+0000 7f0f65306640 1 -- 172.21.15.53:0/2421178412 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f600b3be0 con 0x7f0f600b3220 2023-06-10T18:56:03.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.423+0000 7f0f64b05640 1 --2- 172.21.15.53:0/2421178412 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f50004370 0x7f0f600ca640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:56:03.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.423+0000 7f0f65306640 1 --2- 172.21.15.53:0/2421178412 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f600b3220 0x7f0f600b36a0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f0f600c5ba0 tx=0x7f0f58007a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:03.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.427+0000 7f0f5d7fa640 1 -- 172.21.15.53:0/2421178412 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f580105d0 con 0x7f0f600b3220 2023-06-10T18:56:03.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.427+0000 7f0f5d7fa640 1 -- 172.21.15.53:0/2421178412 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f58010750 con 0x7f0f600b3220 2023-06-10T18:56:03.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.427+0000 7f0f66d69640 1 -- 172.21.15.53:0/2421178412 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f600cbee0 con 0x7f0f600b3220 2023-06-10T18:56:03.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.427+0000 7f0f5d7fa640 1 -- 172.21.15.53:0/2421178412 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f58010b00 con 0x7f0f600b3220 2023-06-10T18:56:03.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.427+0000 7f0f66d69640 1 -- 172.21.15.53:0/2421178412 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f600c6bd0 con 0x7f0f600b3220 2023-06-10T18:56:03.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.427+0000 7f0f66d69640 1 -- 172.21.15.53:0/2421178412 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f601521d0 con 0x7f0f600b3220 2023-06-10T18:56:03.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.427+0000 7f0f5d7fa640 1 -- 172.21.15.53:0/2421178412 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0f58010c60 con 0x7f0f600b3220 2023-06-10T18:56:03.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.427+0000 7f0f5d7fa640 1 --2- 172.21.15.53:0/2421178412 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0f44066280 0x7f0f44068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:03.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.427+0000 7f0f5d7fa640 1 -- 172.21.15.53:0/2421178412 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f0f58083660 con 0x7f0f600b3220 2023-06-10T18:56:03.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.427+0000 7f0f64b05640 1 --2- 172.21.15.53:0/2421178412 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0f44066280 0x7f0f44068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:03.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.427+0000 7f0f64b05640 1 --2- 172.21.15.53:0/2421178412 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0f44066280 0x7f0f44068730 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0f60063080 tx=0x7f0f54008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:03.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.431+0000 7f0f5d7fa640 1 -- 172.21.15.53:0/2421178412 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0f601521d0 con 0x7f0f600b3220 2023-06-10T18:56:03.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.587+0000 7f0f66d69640 1 -- 172.21.15.53:0/2421178412 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0f601521d0 con 0x7f0f600b3220 2023-06-10T18:56:03.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.587+0000 7f0f5d7fa640 1 -- 172.21.15.53:0/2421178412 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v39) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0f601521d0 con 0x7f0f600b3220 2023-06-10T18:56:03.595 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-06-10T18:56:03.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.587+0000 7f0f66d69640 1 -- 172.21.15.53:0/2421178412 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0f44066280 msgr2=0x7f0f44068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:03.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.587+0000 7f0f66d69640 1 --2- 172.21.15.53:0/2421178412 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0f44066280 0x7f0f44068730 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0f60063080 tx=0x7f0f54008040 comp rx=0 tx=0).stop 2023-06-10T18:56:03.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.587+0000 7f0f66d69640 1 -- 172.21.15.53:0/2421178412 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f600b3220 msgr2=0x7f0f600b36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:03.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.587+0000 7f0f66d69640 1 --2- 172.21.15.53:0/2421178412 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f600b3220 0x7f0f600b36a0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f0f600c5ba0 tx=0x7f0f58007a20 comp rx=0 tx=0).stop 2023-06-10T18:56:03.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.587+0000 7f0f66d69640 1 -- 172.21.15.53:0/2421178412 shutdown_connections 2023-06-10T18:56:03.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.587+0000 7f0f66d69640 1 --2- 172.21.15.53:0/2421178412 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0f44066280 0x7f0f44068730 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:03.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.587+0000 7f0f66d69640 1 --2- 172.21.15.53:0/2421178412 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f600b3220 0x7f0f600b36a0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:03.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.587+0000 7f0f66d69640 1 --2- 172.21.15.53:0/2421178412 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f600cba40 0x7f0f600b2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:03.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.587+0000 7f0f66d69640 1 --2- 172.21.15.53:0/2421178412 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f50004370 0x7f0f600ca640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:03.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.587+0000 7f0f66d69640 1 -- 172.21.15.53:0/2421178412 >> 172.21.15.53:0/2421178412 conn(0x7f0f60069e20 msgr2=0x7f0f600d28f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:03.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.587+0000 7f0f66d69640 1 -- 172.21.15.53:0/2421178412 shutdown_connections 2023-06-10T18:56:03.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.587+0000 7f0f66d69640 1 -- 172.21.15.53:0/2421178412 wait complete. 2023-06-10T18:56:03.615 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-10T18:56:03.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.735+0000 7f2815592640 1 Processor -- start 2023-06-10T18:56:03.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.735+0000 7f2815592640 1 -- start start 2023-06-10T18:56:03.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.735+0000 7f2815592640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28100c97d0 0x7f28100cb820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:03.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.735+0000 7f2815592640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f28100af760 0x7f28100afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:03.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.735+0000 7f2815592640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28100ac910 con 0x7f281006c350 2023-06-10T18:56:03.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.735+0000 7f2815592640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28100ca5c0 con 0x7f28100af760 2023-06-10T18:56:03.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.735+0000 7f2815592640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28100b0120 con 0x7f28100c97d0 2023-06-10T18:56:03.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.735+0000 7f280f7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f28100af760 0x7f28100afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:03.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.735+0000 7f280e7fc640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f281006c350 0x7f28100ac200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41250/0 (socket says 172.21.15.53:41250) 2023-06-10T18:56:03.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.735+0000 7f280e7fc640 1 -- 172.21.15.53:0/1403549739 learned_addr learned my addr 172.21.15.53:0/1403549739 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:56:03.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.735+0000 7f280effd640 1 --2- 172.21.15.53:0/1403549739 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28100c97d0 0x7f28100cb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:03.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.735+0000 7f280f7fe640 1 -- 172.21.15.53:0/1403549739 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28100c97d0 msgr2=0x7f28100cb820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:03.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.735+0000 7f280f7fe640 1 --2- 172.21.15.53:0/1403549739 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28100c97d0 0x7f28100cb820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:03.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.735+0000 7f280f7fe640 1 -- 172.21.15.53:0/1403549739 >> v1:172.21.15.53:6789/0 conn(0x7f281006c350 legacy=0x7f28100ac200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:03.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.735+0000 7f280f7fe640 1 -- 172.21.15.53:0/1403549739 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28100cbd60 con 0x7f28100af760 2023-06-10T18:56:03.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.735+0000 7f280effd640 1 --2- 172.21.15.53:0/1403549739 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28100c97d0 0x7f28100cb820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:56:03.747 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.739+0000 7f280f7fe640 1 --2- 172.21.15.53:0/1403549739 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28100af760 0x7f28100afbe0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f2808009d90 tx=0x7f280801c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddabdcec05be1416 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:03.747 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.739+0000 7f280dffb640 1 -- 172.21.15.53:0/1403549739 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28080a6700 con 0x7f28100af760 2023-06-10T18:56:03.747 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.739+0000 7f280dffb640 1 -- 172.21.15.53:0/1403549739 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28080a6860 con 0x7f28100af760 2023-06-10T18:56:03.747 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.739+0000 7f280dffb640 1 -- 172.21.15.53:0/1403549739 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28080a6bf0 con 0x7f28100af760 2023-06-10T18:56:03.747 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.739+0000 7f2815592640 1 -- 172.21.15.53:0/1403549739 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28100af760 msgr2=0x7f28100afbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:03.747 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.739+0000 7f2815592640 1 --2- 172.21.15.53:0/1403549739 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28100af760 0x7f28100afbe0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f2808009d90 tx=0x7f280801c830 comp rx=0 tx=0).stop 2023-06-10T18:56:03.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.739+0000 7f2815592640 1 -- 172.21.15.53:0/1403549739 shutdown_connections 2023-06-10T18:56:03.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.739+0000 7f2815592640 1 --2- 172.21.15.53:0/1403549739 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28100af760 0x7f28100afbe0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:03.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.739+0000 7f2815592640 1 --2- 172.21.15.53:0/1403549739 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28100c97d0 0x7f28100cb820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:03.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.739+0000 7f2815592640 1 -- 172.21.15.53:0/1403549739 >> 172.21.15.53:0/1403549739 conn(0x7f281006a0e0 msgr2=0x7f28100cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:03.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.739+0000 7f2815592640 1 -- 172.21.15.53:0/1403549739 shutdown_connections 2023-06-10T18:56:03.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.739+0000 7f2815592640 1 -- 172.21.15.53:0/1403549739 wait complete. 2023-06-10T18:56:03.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.739+0000 7f2815592640 1 Processor -- start 2023-06-10T18:56:03.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.739+0000 7f2815592640 1 -- start start 2023-06-10T18:56:03.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.739+0000 7f2815592640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f281006c350 0x7f281014f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:03.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.739+0000 7f2815592640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28100af760 0x7f2810153ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:03.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.739+0000 7f2815592640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28100c97d0 0x7f2810154010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:03.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.739+0000 7f2815592640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f281014fdf0 con 0x7f28100af760 2023-06-10T18:56:03.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.739+0000 7f2815592640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f281015a4d0 con 0x7f28100c97d0 2023-06-10T18:56:03.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.739+0000 7f2815592640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f281015a7b0 con 0x7f281006c350 2023-06-10T18:56:03.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.739+0000 7f280e7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28100af760 0x7f2810153ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:03.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.739+0000 7f280e7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28100af760 0x7f2810153ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51166/0 (socket says 172.21.15.53:51166) 2023-06-10T18:56:03.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.739+0000 7f280e7fc640 1 -- 172.21.15.53:0/2203517046 learned_addr learned my addr 172.21.15.53:0/2203517046 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:03.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.739+0000 7f280effd640 1 --2- 172.21.15.53:0/2203517046 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f281006c350 0x7f281014f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:03.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.739+0000 7f280e7fc640 1 -- 172.21.15.53:0/2203517046 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f281006c350 msgr2=0x7f281014f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:03.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.739+0000 7f280f7fe640 1 --2- 172.21.15.53:0/2203517046 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28100c97d0 0x7f2810154010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:03.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.739+0000 7f280e7fc640 1 --2- 172.21.15.53:0/2203517046 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f281006c350 0x7f281014f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:03.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.739+0000 7f280e7fc640 1 -- 172.21.15.53:0/2203517046 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28100c97d0 msgr2=0x7f2810154010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:03.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.739+0000 7f280e7fc640 1 --2- 172.21.15.53:0/2203517046 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28100c97d0 0x7f2810154010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:03.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.739+0000 7f280e7fc640 1 -- 172.21.15.53:0/2203517046 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2808009a70 con 0x7f28100af760 2023-06-10T18:56:03.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.739+0000 7f280e7fc640 1 --2- 172.21.15.53:0/2203517046 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28100af760 0x7f2810153ad0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f280400c400 tx=0x7f280400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:03.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.739+0000 7f27f77fe640 1 -- 172.21.15.53:0/2203517046 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2804005cf0 con 0x7f28100af760 2023-06-10T18:56:03.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.739+0000 7f27f77fe640 1 -- 172.21.15.53:0/2203517046 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2804005e50 con 0x7f28100af760 2023-06-10T18:56:03.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.743+0000 7f2815592640 1 -- 172.21.15.53:0/2203517046 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f281015aa90 con 0x7f28100af760 2023-06-10T18:56:03.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.743+0000 7f27f77fe640 1 -- 172.21.15.53:0/2203517046 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28040072d0 con 0x7f28100af760 2023-06-10T18:56:03.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.743+0000 7f2815592640 1 -- 172.21.15.53:0/2203517046 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f281015b050 con 0x7f28100af760 2023-06-10T18:56:03.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.743+0000 7f2815592640 1 -- 172.21.15.53:0/2203517046 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f281004d790 con 0x7f28100af760 2023-06-10T18:56:03.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.743+0000 7f27f77fe640 1 -- 172.21.15.53:0/2203517046 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2804007430 con 0x7f28100af760 2023-06-10T18:56:03.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.743+0000 7f27f77fe640 1 --2- 172.21.15.53:0/2203517046 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f27fc066280 0x7f27fc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:03.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.743+0000 7f27f77fe640 1 -- 172.21.15.53:0/2203517046 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f2804083130 con 0x7f28100af760 2023-06-10T18:56:03.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.743+0000 7f280effd640 1 --2- 172.21.15.53:0/2203517046 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f27fc066280 0x7f27fc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:03.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.743+0000 7f280effd640 1 --2- 172.21.15.53:0/2203517046 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f27fc066280 0x7f27fc068730 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2800006fd0 tx=0x7f2800008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:03.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.747+0000 7f27f77fe640 1 -- 172.21.15.53:0/2203517046 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f28040506d0 con 0x7f28100af760 2023-06-10T18:56:03.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.895+0000 7f2815592640 1 -- 172.21.15.53:0/2203517046 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f28100cbb40 con 0x7f28100af760 2023-06-10T18:56:03.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.895+0000 7f27f77fe640 1 -- 172.21.15.53:0/2203517046 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v39) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2804053cf0 con 0x7f28100af760 2023-06-10T18:56:03.904 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-06-10T18:56:03.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.895+0000 7f2815592640 1 -- 172.21.15.53:0/2203517046 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f27fc066280 msgr2=0x7f27fc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:03.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.895+0000 7f2815592640 1 --2- 172.21.15.53:0/2203517046 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f27fc066280 0x7f27fc068730 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2800006fd0 tx=0x7f2800008040 comp rx=0 tx=0).stop 2023-06-10T18:56:03.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.895+0000 7f2815592640 1 -- 172.21.15.53:0/2203517046 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28100af760 msgr2=0x7f2810153ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:03.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.895+0000 7f2815592640 1 --2- 172.21.15.53:0/2203517046 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28100af760 0x7f2810153ad0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f280400c400 tx=0x7f280400c8c0 comp rx=0 tx=0).stop 2023-06-10T18:56:03.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.895+0000 7f2815592640 1 -- 172.21.15.53:0/2203517046 shutdown_connections 2023-06-10T18:56:03.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.895+0000 7f2815592640 1 --2- 172.21.15.53:0/2203517046 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f27fc066280 0x7f27fc068730 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:03.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.895+0000 7f2815592640 1 --2- 172.21.15.53:0/2203517046 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28100c97d0 0x7f2810154010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:03.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.895+0000 7f2815592640 1 --2- 172.21.15.53:0/2203517046 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28100af760 0x7f2810153ad0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:03.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.895+0000 7f2815592640 1 --2- 172.21.15.53:0/2203517046 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f281006c350 0x7f281014f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:03.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.895+0000 7f2815592640 1 -- 172.21.15.53:0/2203517046 >> 172.21.15.53:0/2203517046 conn(0x7f281006a0e0 msgr2=0x7f2810157d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:03.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.895+0000 7f2815592640 1 -- 172.21.15.53:0/2203517046 shutdown_connections 2023-06-10T18:56:03.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:03.895+0000 7f2815592640 1 -- 172.21.15.53:0/2203517046 wait complete. 2023-06-10T18:56:03.921 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-10T18:56:04.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.035+0000 7efddafc0640 1 Processor -- start 2023-06-10T18:56:04.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.035+0000 7efddafc0640 1 -- start start 2023-06-10T18:56:04.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.035+0000 7efddafc0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efdd4157cf0 0x7efdd40ca6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:04.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.035+0000 7efddafc0640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7efdd40affc0 0x7efdd40b0410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:04.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.035+0000 7efddafc0640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdd40b0950 con 0x7efdd415b8e0 2023-06-10T18:56:04.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.035+0000 7efddafc0640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdd406fa60 con 0x7efdd40affc0 2023-06-10T18:56:04.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.035+0000 7efddafc0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdd406a340 con 0x7efdd4157cf0 2023-06-10T18:56:04.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.035+0000 7efdd3fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7efdd40affc0 0x7efdd40b0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:04.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.035+0000 7efdd955d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7efdd415b8e0 0x7efdd415bd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41262/0 (socket says 172.21.15.53:41262) 2023-06-10T18:56:04.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.035+0000 7efdd955d640 1 -- 172.21.15.53:0/301634310 learned_addr learned my addr 172.21.15.53:0/301634310 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:56:04.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.035+0000 7efdd8d5c640 1 --2- 172.21.15.53:0/301634310 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efdd4157cf0 0x7efdd40ca6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:04.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.035+0000 7efdd3fff640 1 -- 172.21.15.53:0/301634310 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efdd4157cf0 msgr2=0x7efdd40ca6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:04.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.035+0000 7efdd3fff640 1 --2- 172.21.15.53:0/301634310 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efdd4157cf0 0x7efdd40ca6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:04.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.035+0000 7efdd3fff640 1 -- 172.21.15.53:0/301634310 >> v1:172.21.15.53:6789/0 conn(0x7efdd415b8e0 legacy=0x7efdd415bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:04.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.035+0000 7efdd3fff640 1 -- 172.21.15.53:0/301634310 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdd40c9250 con 0x7efdd40affc0 2023-06-10T18:56:04.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.035+0000 7efdd37fe640 1 -- 172.21.15.53:0/301634310 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 317101566 0 0) 0x7efdcc0014a0 con 0x7efdd415b8e0 2023-06-10T18:56:04.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.035+0000 7efdd8d5c640 1 --2- 172.21.15.53:0/301634310 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efdd4157cf0 0x7efdd40ca6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:56:04.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.039+0000 7efdd3fff640 1 --2- 172.21.15.53:0/301634310 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efdd40affc0 0x7efdd40b0410 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7efdc40097c0 tx=0x7efdc401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a209291d06b26cc8 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:04.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.039+0000 7efdd37fe640 1 -- 172.21.15.53:0/301634310 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc40ab650 con 0x7efdd40affc0 2023-06-10T18:56:04.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.039+0000 7efdd37fe640 1 -- 172.21.15.53:0/301634310 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdc40ab7b0 con 0x7efdd40affc0 2023-06-10T18:56:04.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.039+0000 7efdd37fe640 1 -- 172.21.15.53:0/301634310 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc40abb40 con 0x7efdd40affc0 2023-06-10T18:56:04.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.039+0000 7efddafc0640 1 -- 172.21.15.53:0/301634310 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efdd40affc0 msgr2=0x7efdd40b0410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:04.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.039+0000 7efddafc0640 1 --2- 172.21.15.53:0/301634310 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efdd40affc0 0x7efdd40b0410 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7efdc40097c0 tx=0x7efdc401c450 comp rx=0 tx=0).stop 2023-06-10T18:56:04.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.039+0000 7efddafc0640 1 -- 172.21.15.53:0/301634310 shutdown_connections 2023-06-10T18:56:04.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.039+0000 7efddafc0640 1 --2- 172.21.15.53:0/301634310 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efdd40affc0 0x7efdd40b0410 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:04.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.039+0000 7efddafc0640 1 --2- 172.21.15.53:0/301634310 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efdd4157cf0 0x7efdd40ca6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:04.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.039+0000 7efddafc0640 1 -- 172.21.15.53:0/301634310 >> 172.21.15.53:0/301634310 conn(0x7efdd40cafc0 msgr2=0x7efdd40cb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:04.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.039+0000 7efddafc0640 1 -- 172.21.15.53:0/301634310 shutdown_connections 2023-06-10T18:56:04.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.039+0000 7efddafc0640 1 -- 172.21.15.53:0/301634310 wait complete. 2023-06-10T18:56:04.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.039+0000 7efddafc0640 1 Processor -- start 2023-06-10T18:56:04.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.039+0000 7efddafc0640 1 -- start start 2023-06-10T18:56:04.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.039+0000 7efddafc0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efdd40affc0 0x7efdd40c32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:04.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.039+0000 7efddafc0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efdd4157cf0 0x7efdd414e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:04.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.039+0000 7efddafc0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efdd415b8e0 0x7efdd40c4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:04.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.039+0000 7efddafc0640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd40c6cc0 con 0x7efdd4157cf0 2023-06-10T18:56:04.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.039+0000 7efddafc0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd40c38e0 con 0x7efdd415b8e0 2023-06-10T18:56:04.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.039+0000 7efddafc0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdd40c3bc0 con 0x7efdd40affc0 2023-06-10T18:56:04.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.039+0000 7efdd3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efdd4157cf0 0x7efdd414e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:04.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.039+0000 7efdd3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efdd4157cf0 0x7efdd414e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51176/0 (socket says 172.21.15.53:51176) 2023-06-10T18:56:04.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.039+0000 7efdd3fff640 1 -- 172.21.15.53:0/3036868354 learned_addr learned my addr 172.21.15.53:0/3036868354 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:04.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.039+0000 7efdd8d5c640 1 --2- 172.21.15.53:0/3036868354 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efdd40affc0 0x7efdd40c32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:04.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.039+0000 7efdd955d640 1 --2- 172.21.15.53:0/3036868354 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efdd415b8e0 0x7efdd40c4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:04.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.039+0000 7efdd3fff640 1 -- 172.21.15.53:0/3036868354 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efdd40affc0 msgr2=0x7efdd40c32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:04.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.039+0000 7efdd3fff640 1 --2- 172.21.15.53:0/3036868354 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efdd40affc0 0x7efdd40c32e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:04.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.039+0000 7efdd3fff640 1 -- 172.21.15.53:0/3036868354 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efdd415b8e0 msgr2=0x7efdd40c4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:04.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.039+0000 7efdd3fff640 1 --2- 172.21.15.53:0/3036868354 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efdd415b8e0 0x7efdd40c4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:04.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.039+0000 7efdd3fff640 1 -- 172.21.15.53:0/3036868354 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdc4009420 con 0x7efdd4157cf0 2023-06-10T18:56:04.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.039+0000 7efdd3fff640 1 --2- 172.21.15.53:0/3036868354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efdd4157cf0 0x7efdd414e0f0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7efdc40ad040 tx=0x7efdc401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:04.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.043+0000 7efdd17fa640 1 -- 172.21.15.53:0/3036868354 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc40b5810 con 0x7efdd4157cf0 2023-06-10T18:56:04.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.043+0000 7efdd17fa640 1 -- 172.21.15.53:0/3036868354 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdc40b59b0 con 0x7efdd4157cf0 2023-06-10T18:56:04.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.043+0000 7efddafc0640 1 -- 172.21.15.53:0/3036868354 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdd40cadb0 con 0x7efdd4157cf0 2023-06-10T18:56:04.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.043+0000 7efdd17fa640 1 -- 172.21.15.53:0/3036868354 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc40b5d60 con 0x7efdd4157cf0 2023-06-10T18:56:04.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.043+0000 7efddafc0640 1 -- 172.21.15.53:0/3036868354 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdd40c4180 con 0x7efdd4157cf0 2023-06-10T18:56:04.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.043+0000 7efddafc0640 1 -- 172.21.15.53:0/3036868354 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdd404d790 con 0x7efdd4157cf0 2023-06-10T18:56:04.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.043+0000 7efdd17fa640 1 -- 172.21.15.53:0/3036868354 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7efdc40c83f0 con 0x7efdd4157cf0 2023-06-10T18:56:04.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.043+0000 7efdd17fa640 1 --2- 172.21.15.53:0/3036868354 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efdc0066280 0x7efdc0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:04.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.043+0000 7efdd17fa640 1 -- 172.21.15.53:0/3036868354 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6091+0+0 (secure 0 0 0) 0x7efdc411ee00 con 0x7efdd4157cf0 2023-06-10T18:56:04.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.043+0000 7efdd8d5c640 1 --2- 172.21.15.53:0/3036868354 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efdc0066280 0x7efdc0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:04.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.043+0000 7efdd8d5c640 1 --2- 172.21.15.53:0/3036868354 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efdc0066280 0x7efdc0068730 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7efdc800a9a0 tx=0x7efdc8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:04.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.047+0000 7efdd17fa640 1 -- 172.21.15.53:0/3036868354 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7efdc40ec370 con 0x7efdd4157cf0 2023-06-10T18:56:04.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.195+0000 7efddafc0640 1 -- 172.21.15.53:0/3036868354 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efdd40b44c0 con 0x7efdd4157cf0 2023-06-10T18:56:04.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.195+0000 7efdd17fa640 1 -- 172.21.15.53:0/3036868354 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v39) v1 ==== 100+0+11 (secure 0 0 0) 0x7efdc40ef990 con 0x7efdd4157cf0 2023-06-10T18:56:04.203 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-06-10T18:56:04.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.195+0000 7efddafc0640 1 -- 172.21.15.53:0/3036868354 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efdc0066280 msgr2=0x7efdc0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:04.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.195+0000 7efddafc0640 1 --2- 172.21.15.53:0/3036868354 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efdc0066280 0x7efdc0068730 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7efdc800a9a0 tx=0x7efdc8008040 comp rx=0 tx=0).stop 2023-06-10T18:56:04.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.195+0000 7efddafc0640 1 -- 172.21.15.53:0/3036868354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efdd4157cf0 msgr2=0x7efdd414e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:04.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.195+0000 7efddafc0640 1 --2- 172.21.15.53:0/3036868354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efdd4157cf0 0x7efdd414e0f0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7efdc40ad040 tx=0x7efdc401ac90 comp rx=0 tx=0).stop 2023-06-10T18:56:04.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.195+0000 7efddafc0640 1 -- 172.21.15.53:0/3036868354 shutdown_connections 2023-06-10T18:56:04.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.195+0000 7efddafc0640 1 --2- 172.21.15.53:0/3036868354 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efdc0066280 0x7efdc0068730 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:04.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.195+0000 7efddafc0640 1 --2- 172.21.15.53:0/3036868354 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efdd415b8e0 0x7efdd40c4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:04.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.195+0000 7efddafc0640 1 --2- 172.21.15.53:0/3036868354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efdd4157cf0 0x7efdd414e0f0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:04.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.195+0000 7efddafc0640 1 --2- 172.21.15.53:0/3036868354 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efdd40affc0 0x7efdd40c32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:04.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.195+0000 7efddafc0640 1 -- 172.21.15.53:0/3036868354 >> 172.21.15.53:0/3036868354 conn(0x7efdd40cafc0 msgr2=0x7efdd40cb390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:04.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.195+0000 7efddafc0640 1 -- 172.21.15.53:0/3036868354 shutdown_connections 2023-06-10T18:56:04.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.195+0000 7efddafc0640 1 -- 172.21.15.53:0/3036868354 wait complete. 2023-06-10T18:56:04.220 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T18:56:04.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.327+0000 7fb4d8d6b640 1 Processor -- start 2023-06-10T18:56:04.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.327+0000 7fb4d8d6b640 1 -- start start 2023-06-10T18:56:04.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.327+0000 7fb4d8d6b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb4d40b3ac0 0x7fb4d40b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:04.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.327+0000 7fb4d8d6b640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4d40d0020 con 0x7fb4d40d14c0 2023-06-10T18:56:04.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.327+0000 7fb4d8d6b640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4d4160190 con 0x7fb4d40cc690 2023-06-10T18:56:04.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.327+0000 7fb4d8d6b640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4d40b43d0 con 0x7fb4d40b3ac0 2023-06-10T18:56:04.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.327+0000 7fb4d2d9d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fb4d40d14c0 0x7fb4d415fa80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41264/0 (socket says 172.21.15.53:41264) 2023-06-10T18:56:04.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.327+0000 7fb4d2d9d640 1 -- 172.21.15.53:0/3706325418 learned_addr learned my addr 172.21.15.53:0/3706325418 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:56:04.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.327+0000 7fb4d259c640 1 --2- 172.21.15.53:0/3706325418 >> v2:172.21.15.117:3300/0 conn(0x7fb4d40b3ac0 0x7fb4d40b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:04.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.327+0000 7fb4d1d9b640 1 -- 172.21.15.53:0/3706325418 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4088389085 0 0) 0x7fb4d40d0020 con 0x7fb4d40d14c0 2023-06-10T18:56:04.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.327+0000 7fb4d1d9b640 1 -- 172.21.15.53:0/3706325418 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4c0003530 con 0x7fb4d40d14c0 2023-06-10T18:56:04.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.327+0000 7fb4d1d9b640 1 -- 172.21.15.53:0/3706325418 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3967727500 0 0) 0x7fb4c0003530 con 0x7fb4d40d14c0 2023-06-10T18:56:04.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.327+0000 7fb4d1d9b640 1 -- 172.21.15.53:0/3706325418 >> v2:172.21.15.117:3300/0 conn(0x7fb4d40b3ac0 msgr2=0x7fb4d40b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:04.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.327+0000 7fb4d1d9b640 1 --2- 172.21.15.53:0/3706325418 >> v2:172.21.15.117:3300/0 conn(0x7fb4d40b3ac0 0x7fb4d40b3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:04.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.327+0000 7fb4d1d9b640 1 -- 172.21.15.53:0/3706325418 >> v1:172.21.15.117:6789/0 conn(0x7fb4d40cc690 legacy=0x7fb4d415f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:04.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.327+0000 7fb4d1d9b640 1 -- 172.21.15.53:0/3706325418 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4d40cef40 con 0x7fb4d40d14c0 2023-06-10T18:56:04.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.327+0000 7fb4d1d9b640 1 -- 172.21.15.53:0/3706325418 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fb4cc001a00 con 0x7fb4d40d14c0 2023-06-10T18:56:04.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.327+0000 7fb4d1d9b640 1 -- 172.21.15.53:0/3706325418 >> v1:172.21.15.53:6789/0 conn(0x7fb4d40d14c0 legacy=0x7fb4d415fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:04.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.327+0000 7fb4d1d9b640 1 --2- 172.21.15.53:0/3706325418 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb4c00039f0 0x7fb4c0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:04.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.327+0000 7fb4d1d9b640 1 --2- 172.21.15.53:0/3706325418 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb4c00047d0 0x7fb4c0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:04.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.327+0000 7fb4d1d9b640 1 --2- 172.21.15.53:0/3706325418 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb4c0005180 0x7fb4c000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:04.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.327+0000 7fb4d1d9b640 1 -- 172.21.15.53:0/3706325418 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d40b43d0 con 0x7fb4c00047d0 2023-06-10T18:56:04.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.327+0000 7fb4d1d9b640 1 -- 172.21.15.53:0/3706325418 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c000c060 con 0x7fb4c00039f0 2023-06-10T18:56:04.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.327+0000 7fb4d1d9b640 1 -- 172.21.15.53:0/3706325418 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c000c220 con 0x7fb4c0005180 2023-06-10T18:56:04.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.327+0000 7fb4cbfff640 1 --2- 172.21.15.53:0/3706325418 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb4c00047d0 0x7fb4c0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:04.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.327+0000 7fb4d259c640 1 --2- 172.21.15.53:0/3706325418 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb4c00039f0 0x7fb4c0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:04.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.327+0000 7fb4cbfff640 1 -- 172.21.15.53:0/3706325418 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb4c0005180 msgr2=0x7fb4c000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:04.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.327+0000 7fb4cbfff640 1 --2- 172.21.15.53:0/3706325418 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb4c0005180 0x7fb4c000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:04.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.327+0000 7fb4cbfff640 1 -- 172.21.15.53:0/3706325418 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb4c00039f0 msgr2=0x7fb4c0003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:04.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.327+0000 7fb4cbfff640 1 --2- 172.21.15.53:0/3706325418 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb4c00039f0 0x7fb4c0003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:04.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.327+0000 7fb4cbfff640 1 -- 172.21.15.53:0/3706325418 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4c0003530 con 0x7fb4c00047d0 2023-06-10T18:56:04.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.327+0000 7fb4d2d9d640 1 -- 172.21.15.53:0/3706325418 reap_dead start 2023-06-10T18:56:04.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.331+0000 7fb4cbfff640 1 --2- 172.21.15.53:0/3706325418 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb4c00047d0 0x7fb4c0004c40 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc001780 tx=0x7fb4bc01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6b595ec1c38d901 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:04.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.331+0000 7fb4d1d9b640 1 -- 172.21.15.53:0/3706325418 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4bc0052d0 con 0x7fb4c00047d0 2023-06-10T18:56:04.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.331+0000 7fb4d1d9b640 1 -- 172.21.15.53:0/3706325418 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4bc0a7050 con 0x7fb4c00047d0 2023-06-10T18:56:04.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.331+0000 7fb4d1d9b640 1 -- 172.21.15.53:0/3706325418 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4bc003600 con 0x7fb4c00047d0 2023-06-10T18:56:04.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.331+0000 7fb4d8d6b640 1 -- 172.21.15.53:0/3706325418 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb4c00047d0 msgr2=0x7fb4c0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:04.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.331+0000 7fb4d8d6b640 1 --2- 172.21.15.53:0/3706325418 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb4c00047d0 0x7fb4c0004c40 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc001780 tx=0x7fb4bc01c3e0 comp rx=0 tx=0).stop 2023-06-10T18:56:04.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.331+0000 7fb4d8d6b640 1 -- 172.21.15.53:0/3706325418 shutdown_connections 2023-06-10T18:56:04.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.331+0000 7fb4d8d6b640 1 --2- 172.21.15.53:0/3706325418 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb4c00047d0 0x7fb4c0004c40 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:04.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.331+0000 7fb4d8d6b640 1 -- 172.21.15.53:0/3706325418 >> 172.21.15.53:0/3706325418 conn(0x7fb4d4071790 msgr2=0x7fb4d4069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:04.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.331+0000 7fb4d8d6b640 1 -- 172.21.15.53:0/3706325418 shutdown_connections 2023-06-10T18:56:04.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.331+0000 7fb4d8d6b640 1 -- 172.21.15.53:0/3706325418 wait complete. 2023-06-10T18:56:04.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.331+0000 7fb4d8d6b640 1 Processor -- start 2023-06-10T18:56:04.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.331+0000 7fb4d8d6b640 1 -- start start 2023-06-10T18:56:04.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.331+0000 7fb4d8d6b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb4c00047d0 0x7fb4d41493b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:04.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.331+0000 7fb4d8d6b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb4d40b2240 0x7fb4d40b26b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:04.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.331+0000 7fb4d8d6b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb4d41f1300 0x7fb4d41f1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:04.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.335+0000 7fb4d8d6b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d40b2bf0 con 0x7fb4c00047d0 2023-06-10T18:56:04.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.335+0000 7fb4d8d6b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d41f20a0 con 0x7fb4d41f1300 2023-06-10T18:56:04.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.335+0000 7fb4d8d6b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d40c9290 con 0x7fb4d40b2240 2023-06-10T18:56:04.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.335+0000 7fb4d259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb4c00047d0 0x7fb4d41493b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:04.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.335+0000 7fb4d259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb4c00047d0 0x7fb4d41493b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51182/0 (socket says 172.21.15.53:51182) 2023-06-10T18:56:04.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.335+0000 7fb4d259c640 1 -- 172.21.15.53:0/3350648593 learned_addr learned my addr 172.21.15.53:0/3350648593 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:04.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.335+0000 7fb4cbfff640 1 --2- 172.21.15.53:0/3350648593 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb4d40b2240 0x7fb4d40b26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:04.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.335+0000 7fb4d2d9d640 1 --2- 172.21.15.53:0/3350648593 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb4d41f1300 0x7fb4d41f1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:04.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.335+0000 7fb4d259c640 1 -- 172.21.15.53:0/3350648593 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb4d40b2240 msgr2=0x7fb4d40b26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:04.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.335+0000 7fb4d259c640 1 --2- 172.21.15.53:0/3350648593 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb4d40b2240 0x7fb4d40b26b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:04.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.335+0000 7fb4d259c640 1 -- 172.21.15.53:0/3350648593 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb4d41f1300 msgr2=0x7fb4d41f1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:04.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.335+0000 7fb4d259c640 1 --2- 172.21.15.53:0/3350648593 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb4d41f1300 0x7fb4d41f1770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:04.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.335+0000 7fb4d259c640 1 -- 172.21.15.53:0/3350648593 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4d40c9570 con 0x7fb4c00047d0 2023-06-10T18:56:04.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.335+0000 7fb4d2d9d640 1 --2- 172.21.15.53:0/3350648593 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb4d41f1300 0x7fb4d41f1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:56:04.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.335+0000 7fb4d259c640 1 --2- 172.21.15.53:0/3350648593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb4c00047d0 0x7fb4d41493b0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fb4c4011660 tx=0x7fb4c4011b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:04.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.335+0000 7fb4caffd640 1 -- 172.21.15.53:0/3350648593 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c400f9c0 con 0x7fb4c00047d0 2023-06-10T18:56:04.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.335+0000 7fb4caffd640 1 -- 172.21.15.53:0/3350648593 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4c400fb20 con 0x7fb4c00047d0 2023-06-10T18:56:04.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.335+0000 7fb4d8d6b640 1 -- 172.21.15.53:0/3350648593 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4d40c9850 con 0x7fb4c00047d0 2023-06-10T18:56:04.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.335+0000 7fb4caffd640 1 -- 172.21.15.53:0/3350648593 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c400fe90 con 0x7fb4c00047d0 2023-06-10T18:56:04.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.335+0000 7fb4d8d6b640 1 -- 172.21.15.53:0/3350648593 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4d41f1cb0 con 0x7fb4c00047d0 2023-06-10T18:56:04.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.335+0000 7fb4d8d6b640 1 -- 172.21.15.53:0/3350648593 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4d40c90f0 con 0x7fb4c00047d0 2023-06-10T18:56:04.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.335+0000 7fb4caffd640 1 -- 172.21.15.53:0/3350648593 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb4c4015460 con 0x7fb4c00047d0 2023-06-10T18:56:04.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.335+0000 7fb4caffd640 1 --2- 172.21.15.53:0/3350648593 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb4b4066280 0x7fb4b4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:04.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.335+0000 7fb4caffd640 1 -- 172.21.15.53:0/3350648593 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6091+0+0 (secure 0 0 0) 0x7fb4c4084240 con 0x7fb4c00047d0 2023-06-10T18:56:04.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.335+0000 7fb4cbfff640 1 --2- 172.21.15.53:0/3350648593 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb4b4066280 0x7fb4b4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:04.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.335+0000 7fb4cbfff640 1 --2- 172.21.15.53:0/3350648593 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb4b4066280 0x7fb4b4068730 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc001750 tx=0x7fb4bc0011a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:04.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.339+0000 7fb4caffd640 1 -- 172.21.15.53:0/3350648593 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb4d40c90f0 con 0x7fb4c00047d0 2023-06-10T18:56:04.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.527+0000 7fb4d8d6b640 1 -- 172.21.15.53:0/3350648593 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb4d40c90f0 con 0x7fb4c00047d0 2023-06-10T18:56:04.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.527+0000 7fb4caffd640 1 -- 172.21.15.53:0/3350648593 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4677 (secure 0 0 0) 0x7fb4d40c90f0 con 0x7fb4c00047d0 2023-06-10T18:56:04.537 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:56:04.537 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4853,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/4087456763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":4087456763},{"type":"v1","addr":"172.21.15.117:6835","nonce":4087456763}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5071,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1065941624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1065941624},{"type":"v1","addr":"172.21.15.117:6837","nonce":1065941624}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5322,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/4137796077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":4137796077},{"type":"v1","addr":"172.21.15.53:6833","nonce":4137796077}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T18:53:54.735461+0000","modified":"2023-06-10T18:53:56.773799+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5331},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5331":{"gid":5331,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/2596772129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2596772129},{"type":"v1","addr":"172.21.15.53:6835","nonce":2596772129}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-06-10T18:56:04.537 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 13 2023-06-10T18:56:04.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.531+0000 7fb4d8d6b640 1 -- 172.21.15.53:0/3350648593 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb4b4066280 msgr2=0x7fb4b4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:04.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.531+0000 7fb4d8d6b640 1 --2- 172.21.15.53:0/3350648593 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb4b4066280 0x7fb4b4068730 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc001750 tx=0x7fb4bc0011a0 comp rx=0 tx=0).stop 2023-06-10T18:56:04.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.531+0000 7fb4d8d6b640 1 -- 172.21.15.53:0/3350648593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb4c00047d0 msgr2=0x7fb4d41493b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:04.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.531+0000 7fb4d8d6b640 1 --2- 172.21.15.53:0/3350648593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb4c00047d0 0x7fb4d41493b0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fb4c4011660 tx=0x7fb4c4011b20 comp rx=0 tx=0).stop 2023-06-10T18:56:04.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.531+0000 7fb4d8d6b640 1 -- 172.21.15.53:0/3350648593 shutdown_connections 2023-06-10T18:56:04.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.531+0000 7fb4d8d6b640 1 --2- 172.21.15.53:0/3350648593 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb4b4066280 0x7fb4b4068730 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:04.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.531+0000 7fb4d8d6b640 1 --2- 172.21.15.53:0/3350648593 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb4d41f1300 0x7fb4d41f1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:04.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.531+0000 7fb4d8d6b640 1 --2- 172.21.15.53:0/3350648593 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb4d40b2240 0x7fb4d40b26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:04.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.531+0000 7fb4d8d6b640 1 --2- 172.21.15.53:0/3350648593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb4c00047d0 0x7fb4d41493b0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:04.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.531+0000 7fb4d8d6b640 1 -- 172.21.15.53:0/3350648593 >> 172.21.15.53:0/3350648593 conn(0x7fb4d4071790 msgr2=0x7fb4d415a2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:04.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.531+0000 7fb4d8d6b640 1 -- 172.21.15.53:0/3350648593 shutdown_connections 2023-06-10T18:56:04.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.531+0000 7fb4d8d6b640 1 -- 172.21.15.53:0/3350648593 wait complete. 2023-06-10T18:56:04.556 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T18:56:04.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.659+0000 7f8d90ef2640 1 Processor -- start 2023-06-10T18:56:04.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.659+0000 7f8d90ef2640 1 -- start start 2023-06-10T18:56:04.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.659+0000 7f8d90ef2640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8d8c0cc690 0x7f8d8c0d04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:04.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.659+0000 7f8d90ef2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d8c0ccae0 0x7f8d8c0d09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:04.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.659+0000 7f8d90ef2640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d8c0d0020 con 0x7f8d8c0b3ac0 2023-06-10T18:56:04.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.659+0000 7f8d90ef2640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d8c0cef40 con 0x7f8d8c0cc690 2023-06-10T18:56:04.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.659+0000 7f8d90ef2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8c0cf220 con 0x7f8d8c0ccae0 2023-06-10T18:56:04.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.659+0000 7f8d89d9b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8d8c0cc690 0x7f8d8c0d04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:04.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.659+0000 7f8d8ad9d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d8c0ccae0 0x7f8d8c0d09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:04.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.659+0000 7f8d8a59c640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f8d8c0b3ac0 0x7f8d8c0b3e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.53:59572/0 (socket says 172.21.15.53:59572) 2023-06-10T18:56:04.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.659+0000 7f8d8a59c640 1 -- 172.21.15.53:0/416781969 learned_addr learned my addr 172.21.15.53:0/416781969 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:56:04.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.659+0000 7f8d8ad9d640 1 -- 172.21.15.53:0/416781969 >> v2:172.21.15.117:3300/0 conn(0x7f8d8c0cc690 msgr2=0x7f8d8c0d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:04.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.659+0000 7f8d8ad9d640 1 --2- 172.21.15.53:0/416781969 >> v2:172.21.15.117:3300/0 conn(0x7f8d8c0cc690 0x7f8d8c0d04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:04.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.659+0000 7f8d8ad9d640 1 -- 172.21.15.53:0/416781969 >> v1:172.21.15.117:6789/0 conn(0x7f8d8c0b3ac0 legacy=0x7f8d8c0b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:04.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.659+0000 7f8d8ad9d640 1 -- 172.21.15.53:0/416781969 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d8c0cf500 con 0x7f8d8c0ccae0 2023-06-10T18:56:04.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.659+0000 7f8d89d9b640 1 --2- 172.21.15.53:0/416781969 >> v2:172.21.15.117:3300/0 conn(0x7f8d8c0cc690 0x7f8d8c0d04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-10T18:56:04.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.663+0000 7f8d8ad9d640 1 --2- 172.21.15.53:0/416781969 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d8c0ccae0 0x7f8d8c0d09f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8d84009d90 tx=0x7f8d8401c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e341428415ea8166 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:04.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.663+0000 7f8d8959a640 1 -- 172.21.15.53:0/416781969 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d840a5a00 con 0x7f8d8c0ccae0 2023-06-10T18:56:04.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.663+0000 7f8d8959a640 1 -- 172.21.15.53:0/416781969 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d840a5b60 con 0x7f8d8c0ccae0 2023-06-10T18:56:04.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.663+0000 7f8d8959a640 1 -- 172.21.15.53:0/416781969 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d840ad440 con 0x7f8d8c0ccae0 2023-06-10T18:56:04.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.663+0000 7f8d90ef2640 1 -- 172.21.15.53:0/416781969 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d8c0ccae0 msgr2=0x7f8d8c0d09f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:04.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.663+0000 7f8d90ef2640 1 --2- 172.21.15.53:0/416781969 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d8c0ccae0 0x7f8d8c0d09f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8d84009d90 tx=0x7f8d8401c920 comp rx=0 tx=0).stop 2023-06-10T18:56:04.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.663+0000 7f8d90ef2640 1 -- 172.21.15.53:0/416781969 shutdown_connections 2023-06-10T18:56:04.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.663+0000 7f8d90ef2640 1 --2- 172.21.15.53:0/416781969 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d8c0ccae0 0x7f8d8c0d09f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:04.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.663+0000 7f8d90ef2640 1 --2- 172.21.15.53:0/416781969 >> v2:172.21.15.117:3300/0 conn(0x7f8d8c0cc690 0x7f8d8c0d04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:04.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.663+0000 7f8d90ef2640 1 -- 172.21.15.53:0/416781969 >> 172.21.15.53:0/416781969 conn(0x7f8d8c071790 msgr2=0x7f8d8c069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:04.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.663+0000 7f8d90ef2640 1 -- 172.21.15.53:0/416781969 shutdown_connections 2023-06-10T18:56:04.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.663+0000 7f8d90ef2640 1 -- 172.21.15.53:0/416781969 wait complete. 2023-06-10T18:56:04.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.663+0000 7f8d90ef2640 1 Processor -- start 2023-06-10T18:56:04.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.663+0000 7f8d90ef2640 1 -- start start 2023-06-10T18:56:04.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.663+0000 7f8d90ef2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d8c0b3ac0 0x7f8d8c152080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:04.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.663+0000 7f8d90ef2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d8c0cc690 0x7f8d8c15cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:04.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.663+0000 7f8d90ef2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d8c0ccae0 0x7f8d8c0b5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:04.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.663+0000 7f8d90ef2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8c15de10 con 0x7f8d8c0cc690 2023-06-10T18:56:04.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.663+0000 7f8d90ef2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8c15e0f0 con 0x7f8d8c0b3ac0 2023-06-10T18:56:04.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.663+0000 7f8d90ef2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8c15e3d0 con 0x7f8d8c0ccae0 2023-06-10T18:56:04.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.667+0000 7f8d89d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d8c0cc690 0x7f8d8c15cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:04.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.667+0000 7f8d89d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d8c0cc690 0x7f8d8c15cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51190/0 (socket says 172.21.15.53:51190) 2023-06-10T18:56:04.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.667+0000 7f8d89d9b640 1 -- 172.21.15.53:0/1210103096 learned_addr learned my addr 172.21.15.53:0/1210103096 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:04.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.667+0000 7f8d8ad9d640 1 --2- 172.21.15.53:0/1210103096 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d8c0ccae0 0x7f8d8c0b5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:04.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.667+0000 7f8d8a59c640 1 --2- 172.21.15.53:0/1210103096 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d8c0b3ac0 0x7f8d8c152080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:04.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.667+0000 7f8d89d9b640 1 -- 172.21.15.53:0/1210103096 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d8c0ccae0 msgr2=0x7f8d8c0b5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:04.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.667+0000 7f8d89d9b640 1 --2- 172.21.15.53:0/1210103096 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d8c0ccae0 0x7f8d8c0b5ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:04.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.667+0000 7f8d89d9b640 1 -- 172.21.15.53:0/1210103096 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d8c0b3ac0 msgr2=0x7f8d8c152080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:04.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.667+0000 7f8d89d9b640 1 --2- 172.21.15.53:0/1210103096 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d8c0b3ac0 0x7f8d8c152080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:04.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.667+0000 7f8d89d9b640 1 -- 172.21.15.53:0/1210103096 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d7c009420 con 0x7f8d8c0cc690 2023-06-10T18:56:04.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.667+0000 7f8d89d9b640 1 --2- 172.21.15.53:0/1210103096 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d8c0cc690 0x7f8d8c15cac0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c00ebe0 tx=0x7f8d7c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:04.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.667+0000 7f8d7affd640 1 -- 172.21.15.53:0/1210103096 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d7c00eee0 con 0x7f8d8c0cc690 2023-06-10T18:56:04.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.667+0000 7f8d7affd640 1 -- 172.21.15.53:0/1210103096 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d7c00cc30 con 0x7f8d8c0cc690 2023-06-10T18:56:04.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.667+0000 7f8d90ef2640 1 -- 172.21.15.53:0/1210103096 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d84009a70 con 0x7f8d8c0cc690 2023-06-10T18:56:04.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.667+0000 7f8d7affd640 1 -- 172.21.15.53:0/1210103096 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d7c013470 con 0x7f8d8c0cc690 2023-06-10T18:56:04.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.667+0000 7f8d90ef2640 1 -- 172.21.15.53:0/1210103096 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d8c1525c0 con 0x7f8d8c0cc690 2023-06-10T18:56:04.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.667+0000 7f8d90ef2640 1 -- 172.21.15.53:0/1210103096 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d8c04d790 con 0x7f8d8c0cc690 2023-06-10T18:56:04.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.667+0000 7f8d7affd640 1 -- 172.21.15.53:0/1210103096 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8d7c0135d0 con 0x7f8d8c0cc690 2023-06-10T18:56:04.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.667+0000 7f8d7affd640 1 --2- 172.21.15.53:0/1210103096 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8d6c066280 0x7f8d6c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:04.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.667+0000 7f8d7affd640 1 -- 172.21.15.53:0/1210103096 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f8d7c084080 con 0x7f8d8c0cc690 2023-06-10T18:56:04.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.667+0000 7f8d8a59c640 1 --2- 172.21.15.53:0/1210103096 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8d6c066280 0x7f8d6c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:04.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.667+0000 7f8d8a59c640 1 --2- 172.21.15.53:0/1210103096 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8d6c066280 0x7f8d6c068730 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8d80005890 tx=0x7f8d80009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:04.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.671+0000 7f8d7affd640 1 -- 172.21.15.53:0/1210103096 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8d7c0b4700 con 0x7f8d8c0cc690 2023-06-10T18:56:04.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.823+0000 7f8d90ef2640 1 -- 172.21.15.53:0/1210103096 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8d8c08a200 con 0x7f8d8c0cc690 2023-06-10T18:56:04.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.827+0000 7f8d7affd640 1 -- 172.21.15.53:0/1210103096 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+18332 (secure 0 0 0) 0x7f8d7c054ed0 con 0x7f8d8c0cc690 2023-06-10T18:56:04.837 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:56:04.837 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":39,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T18:54:27.787457+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-06-10T18:53:52.688764+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-06-10T18:53:53.727157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.31","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T18:56:04.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.831+0000 7f8d90ef2640 1 -- 172.21.15.53:0/1210103096 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8d6c066280 msgr2=0x7f8d6c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:04.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.831+0000 7f8d90ef2640 1 --2- 172.21.15.53:0/1210103096 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8d6c066280 0x7f8d6c068730 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8d80005890 tx=0x7f8d80009040 comp rx=0 tx=0).stop 2023-06-10T18:56:04.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.831+0000 7f8d90ef2640 1 -- 172.21.15.53:0/1210103096 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d8c0cc690 msgr2=0x7f8d8c15cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:04.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.831+0000 7f8d90ef2640 1 --2- 172.21.15.53:0/1210103096 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d8c0cc690 0x7f8d8c15cac0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c00ebe0 tx=0x7f8d7c00c520 comp rx=0 tx=0).stop 2023-06-10T18:56:04.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.831+0000 7f8d90ef2640 1 -- 172.21.15.53:0/1210103096 shutdown_connections 2023-06-10T18:56:04.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.831+0000 7f8d90ef2640 1 --2- 172.21.15.53:0/1210103096 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8d6c066280 0x7f8d6c068730 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:04.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.831+0000 7f8d90ef2640 1 --2- 172.21.15.53:0/1210103096 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d8c0ccae0 0x7f8d8c0b5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:04.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.831+0000 7f8d90ef2640 1 --2- 172.21.15.53:0/1210103096 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d8c0cc690 0x7f8d8c15cac0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:04.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.831+0000 7f8d90ef2640 1 --2- 172.21.15.53:0/1210103096 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d8c0b3ac0 0x7f8d8c152080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:04.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.831+0000 7f8d90ef2640 1 -- 172.21.15.53:0/1210103096 >> 172.21.15.53:0/1210103096 conn(0x7f8d8c071790 msgr2=0x7f8d8c15f0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:04.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.831+0000 7f8d90ef2640 1 -- 172.21.15.53:0/1210103096 shutdown_connections 2023-06-10T18:56:04.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.831+0000 7f8d90ef2640 1 -- 172.21.15.53:0/1210103096 wait complete. 2023-06-10T18:56:04.857 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-06-10T18:56:04.858 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T18:56:04.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.975+0000 7fee8ba2b640 1 Processor -- start 2023-06-10T18:56:04.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.975+0000 7fee8ba2b640 1 -- start start 2023-06-10T18:56:04.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.975+0000 7fee8ba2b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fee8406c690 0x7fee8415c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:04.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.975+0000 7fee8ba2b640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee84070080 con 0x7fee8415c0b0 2023-06-10T18:56:04.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.975+0000 7fee8ba2b640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee840705c0 con 0x7fee84070f40 2023-06-10T18:56:04.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.975+0000 7fee8ba2b640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee840cc460 con 0x7fee8406c690 2023-06-10T18:56:04.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.975+0000 7fee897c7640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fee8415c0b0 0x7fee840cbd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41274/0 (socket says 172.21.15.53:41274) 2023-06-10T18:56:04.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.975+0000 7fee897c7640 1 -- 172.21.15.53:0/1353634639 learned_addr learned my addr 172.21.15.53:0/1353634639 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:56:04.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.975+0000 7fee89fc8640 1 --2- 172.21.15.53:0/1353634639 >> v2:172.21.15.53:3300/0 conn(0x7fee8406c690 0x7fee8415c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:04.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.975+0000 7fee7bfff640 1 -- 172.21.15.53:0/1353634639 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1443742592 0 0) 0x7fee84070080 con 0x7fee8415c0b0 2023-06-10T18:56:04.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.975+0000 7fee7bfff640 1 -- 172.21.15.53:0/1353634639 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee70003530 con 0x7fee8415c0b0 2023-06-10T18:56:04.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.975+0000 7fee89fc8640 1 -- 172.21.15.53:0/1353634639 >> v1:172.21.15.117:6789/0 conn(0x7fee84070f40 legacy=0x7fee8406bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:04.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.975+0000 7fee89fc8640 1 -- 172.21.15.53:0/1353634639 >> v1:172.21.15.53:6789/0 conn(0x7fee8415c0b0 legacy=0x7fee840cbd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:04.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.975+0000 7fee89fc8640 1 -- 172.21.15.53:0/1353634639 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee840c8e30 con 0x7fee8406c690 2023-06-10T18:56:04.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.979+0000 7fee89fc8640 1 --2- 172.21.15.53:0/1353634639 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee8406c690 0x7fee8415c480 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fee7c009d90 tx=0x7fee7c01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6876c7237a3e6e29 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:04.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.979+0000 7fee7bfff640 1 -- 172.21.15.53:0/1353634639 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee7c0a57e0 con 0x7fee8406c690 2023-06-10T18:56:04.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.979+0000 7fee7bfff640 1 -- 172.21.15.53:0/1353634639 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee7c0a5940 con 0x7fee8406c690 2023-06-10T18:56:04.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.979+0000 7fee7bfff640 1 -- 172.21.15.53:0/1353634639 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee7c0a5cd0 con 0x7fee8406c690 2023-06-10T18:56:04.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.979+0000 7fee8ba2b640 1 -- 172.21.15.53:0/1353634639 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee8406c690 msgr2=0x7fee8415c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:04.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.979+0000 7fee8ba2b640 1 --2- 172.21.15.53:0/1353634639 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee8406c690 0x7fee8415c480 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fee7c009d90 tx=0x7fee7c01c920 comp rx=0 tx=0).stop 2023-06-10T18:56:04.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.979+0000 7fee8ba2b640 1 -- 172.21.15.53:0/1353634639 shutdown_connections 2023-06-10T18:56:04.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.979+0000 7fee8ba2b640 1 --2- 172.21.15.53:0/1353634639 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee8406c690 0x7fee8415c480 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:04.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.979+0000 7fee8ba2b640 1 -- 172.21.15.53:0/1353634639 >> 172.21.15.53:0/1353634639 conn(0x7fee8406a0d0 msgr2=0x7fee840ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:04.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.979+0000 7fee8ba2b640 1 -- 172.21.15.53:0/1353634639 shutdown_connections 2023-06-10T18:56:04.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.979+0000 7fee8ba2b640 1 -- 172.21.15.53:0/1353634639 wait complete. 2023-06-10T18:56:04.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.979+0000 7fee8ba2b640 1 Processor -- start 2023-06-10T18:56:04.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.979+0000 7fee8ba2b640 1 -- start start 2023-06-10T18:56:04.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.979+0000 7fee8ba2b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee8406c690 0x7fee840b24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:04.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.979+0000 7fee8ba2b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee84070f40 0x7fee8414c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:04.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.979+0000 7fee8ba2b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee8415c0b0 0x7fee8415a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:04.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.979+0000 7fee8ba2b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee840b2a20 con 0x7fee8406c690 2023-06-10T18:56:04.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.979+0000 7fee8ba2b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee8414c820 con 0x7fee8415c0b0 2023-06-10T18:56:04.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.979+0000 7fee8ba2b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee841595c0 con 0x7fee84070f40 2023-06-10T18:56:04.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.979+0000 7fee897c7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee8406c690 0x7fee840b24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:04.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.979+0000 7fee897c7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee8406c690 0x7fee840b24e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51212/0 (socket says 172.21.15.53:51212) 2023-06-10T18:56:04.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.979+0000 7fee897c7640 1 -- 172.21.15.53:0/1322728203 learned_addr learned my addr 172.21.15.53:0/1322728203 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:04.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.983+0000 7fee88fc6640 1 --2- 172.21.15.53:0/1322728203 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee84070f40 0x7fee8414c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:04.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.983+0000 7fee89fc8640 1 --2- 172.21.15.53:0/1322728203 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee8415c0b0 0x7fee8415a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:04.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.983+0000 7fee897c7640 1 -- 172.21.15.53:0/1322728203 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee84070f40 msgr2=0x7fee8414c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:04.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.983+0000 7fee897c7640 1 --2- 172.21.15.53:0/1322728203 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee84070f40 0x7fee8414c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:04.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.983+0000 7fee897c7640 1 -- 172.21.15.53:0/1322728203 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee8415c0b0 msgr2=0x7fee8415a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:04.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.983+0000 7fee897c7640 1 --2- 172.21.15.53:0/1322728203 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee8415c0b0 0x7fee8415a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:04.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.983+0000 7fee897c7640 1 -- 172.21.15.53:0/1322728203 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee7c009a70 con 0x7fee8406c690 2023-06-10T18:56:04.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.983+0000 7fee897c7640 1 --2- 172.21.15.53:0/1322728203 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee8406c690 0x7fee840b24e0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fee8000c420 tx=0x7fee8000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:04.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.983+0000 7fee79ffb640 1 -- 172.21.15.53:0/1322728203 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee80005cf0 con 0x7fee8406c690 2023-06-10T18:56:04.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.983+0000 7fee79ffb640 1 -- 172.21.15.53:0/1322728203 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee80005e50 con 0x7fee8406c690 2023-06-10T18:56:04.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.983+0000 7fee8ba2b640 1 -- 172.21.15.53:0/1322728203 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee84159860 con 0x7fee8406c690 2023-06-10T18:56:04.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.983+0000 7fee79ffb640 1 -- 172.21.15.53:0/1322728203 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee800072d0 con 0x7fee8406c690 2023-06-10T18:56:04.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.983+0000 7fee8ba2b640 1 -- 172.21.15.53:0/1322728203 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee84159e20 con 0x7fee8406c690 2023-06-10T18:56:04.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.983+0000 7fee8ba2b640 1 -- 172.21.15.53:0/1322728203 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee8415a010 con 0x7fee8406c690 2023-06-10T18:56:04.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.983+0000 7fee79ffb640 1 -- 172.21.15.53:0/1322728203 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fee80007430 con 0x7fee8406c690 2023-06-10T18:56:04.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.983+0000 7fee79ffb640 1 --2- 172.21.15.53:0/1322728203 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fee680662b0 0x7fee68068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:05.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.983+0000 7fee79ffb640 1 -- 172.21.15.53:0/1322728203 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6091+0+0 (secure 0 0 0) 0x7fee80083190 con 0x7fee8406c690 2023-06-10T18:56:05.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.983+0000 7fee88fc6640 1 --2- 172.21.15.53:0/1322728203 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fee680662b0 0x7fee68068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:05.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.983+0000 7fee88fc6640 1 --2- 172.21.15.53:0/1322728203 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fee680662b0 0x7fee68068760 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fee840b2470 tx=0x7fee74009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:05.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:04.987+0000 7fee79ffb640 1 -- 172.21.15.53:0/1322728203 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fee80050730 con 0x7fee8406c690 2023-06-10T18:56:05.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.175+0000 7fee8ba2b640 1 -- 172.21.15.53:0/1322728203 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fee8404d790 con 0x7fee8406c690 2023-06-10T18:56:05.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.179+0000 7fee79ffb640 1 -- 172.21.15.53:0/1322728203 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4677 (secure 0 0 0) 0x7fee80053d50 con 0x7fee8406c690 2023-06-10T18:56:05.187 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:56:05.187 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4853,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/4087456763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":4087456763},{"type":"v1","addr":"172.21.15.117:6835","nonce":4087456763}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5071,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1065941624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1065941624},{"type":"v1","addr":"172.21.15.117:6837","nonce":1065941624}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5322,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/4137796077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":4137796077},{"type":"v1","addr":"172.21.15.53:6833","nonce":4137796077}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T18:53:54.735461+0000","modified":"2023-06-10T18:53:56.773799+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5331},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5331":{"gid":5331,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/2596772129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2596772129},{"type":"v1","addr":"172.21.15.53:6835","nonce":2596772129}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-06-10T18:56:05.187 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 13 2023-06-10T18:56:05.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.179+0000 7fee8ba2b640 1 -- 172.21.15.53:0/1322728203 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fee680662b0 msgr2=0x7fee68068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:05.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.179+0000 7fee8ba2b640 1 --2- 172.21.15.53:0/1322728203 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fee680662b0 0x7fee68068760 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fee840b2470 tx=0x7fee74009040 comp rx=0 tx=0).stop 2023-06-10T18:56:05.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.179+0000 7fee8ba2b640 1 -- 172.21.15.53:0/1322728203 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee8406c690 msgr2=0x7fee840b24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:05.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.179+0000 7fee8ba2b640 1 --2- 172.21.15.53:0/1322728203 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee8406c690 0x7fee840b24e0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fee8000c420 tx=0x7fee8000c8e0 comp rx=0 tx=0).stop 2023-06-10T18:56:05.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.179+0000 7fee8ba2b640 1 -- 172.21.15.53:0/1322728203 shutdown_connections 2023-06-10T18:56:05.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.179+0000 7fee8ba2b640 1 --2- 172.21.15.53:0/1322728203 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fee680662b0 0x7fee68068760 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:05.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.179+0000 7fee8ba2b640 1 --2- 172.21.15.53:0/1322728203 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee8415c0b0 0x7fee8415a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:05.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.179+0000 7fee8ba2b640 1 --2- 172.21.15.53:0/1322728203 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee84070f40 0x7fee8414c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:05.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.179+0000 7fee8ba2b640 1 --2- 172.21.15.53:0/1322728203 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee8406c690 0x7fee840b24e0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:05.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.179+0000 7fee8ba2b640 1 -- 172.21.15.53:0/1322728203 >> 172.21.15.53:0/1322728203 conn(0x7fee8406a0d0 msgr2=0x7fee840ccfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:05.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.179+0000 7fee8ba2b640 1 -- 172.21.15.53:0/1322728203 shutdown_connections 2023-06-10T18:56:05.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.179+0000 7fee8ba2b640 1 -- 172.21.15.53:0/1322728203 wait complete. 2023-06-10T18:56:05.206 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T18:56:05.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.319+0000 7f275073c640 1 Processor -- start 2023-06-10T18:56:05.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.319+0000 7f275073c640 1 -- start start 2023-06-10T18:56:05.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.323+0000 7f275073c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27480c9840 0x7f27480c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:05.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.323+0000 7f275073c640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2748159b50 con 0x7f274806b090 2023-06-10T18:56:05.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.323+0000 7f275073c640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27480ca150 con 0x7f2748071060 2023-06-10T18:56:05.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.323+0000 7f275073c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27480702a0 con 0x7f27480c9840 2023-06-10T18:56:05.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.323+0000 7f274ecd9640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f274806b090 0x7f274806b530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41288/0 (socket says 172.21.15.53:41288) 2023-06-10T18:56:05.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.323+0000 7f274ecd9640 1 -- 172.21.15.53:0/3249108159 learned_addr learned my addr 172.21.15.53:0/3249108159 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:56:05.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.323+0000 7f274e4d8640 1 --2- 172.21.15.53:0/3249108159 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27480c9840 0x7f27480c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:05.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.323+0000 7f274d4d6640 1 -- 172.21.15.53:0/3249108159 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2362817073 0 0) 0x7f2748159b50 con 0x7f274806b090 2023-06-10T18:56:05.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.323+0000 7f274d4d6640 1 -- 172.21.15.53:0/3249108159 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2730003530 con 0x7f274806b090 2023-06-10T18:56:05.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.323+0000 7f274d4d6640 1 -- 172.21.15.53:0/3249108159 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1175082264 0 0) 0x7f2730003530 con 0x7f274806b090 2023-06-10T18:56:05.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.323+0000 7f274d4d6640 1 -- 172.21.15.53:0/3249108159 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27480c9840 msgr2=0x7f27480c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:05.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.323+0000 7f274d4d6640 1 --2- 172.21.15.53:0/3249108159 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27480c9840 0x7f27480c9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:05.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.323+0000 7f274d4d6640 1 -- 172.21.15.53:0/3249108159 >> v1:172.21.15.117:6789/0 conn(0x7f2748071060 legacy=0x7f27480af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:05.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.323+0000 7f274d4d6640 1 -- 172.21.15.53:0/3249108159 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2748070580 con 0x7f274806b090 2023-06-10T18:56:05.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.323+0000 7f274d4d6640 1 -- 172.21.15.53:0/3249108159 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f2738001680 con 0x7f274806b090 2023-06-10T18:56:05.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.323+0000 7f274d4d6640 1 -- 172.21.15.53:0/3249108159 >> v1:172.21.15.53:6789/0 conn(0x7f274806b090 legacy=0x7f274806b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:05.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.323+0000 7f274d4d6640 1 --2- 172.21.15.53:0/3249108159 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2730003a20 0x7f2730003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:05.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.323+0000 7f274d4d6640 1 --2- 172.21.15.53:0/3249108159 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27480c9840 0x7f27300047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:05.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.323+0000 7f274d4d6640 1 --2- 172.21.15.53:0/3249108159 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2730004d10 0x7f2730005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:05.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.323+0000 7f274d4d6640 1 -- 172.21.15.53:0/3249108159 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27480702a0 con 0x7f2730003a20 2023-06-10T18:56:05.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.323+0000 7f274d4d6640 1 -- 172.21.15.53:0/3249108159 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f273000ba70 con 0x7f2730004d10 2023-06-10T18:56:05.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.323+0000 7f274d4d6640 1 -- 172.21.15.53:0/3249108159 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f273000bc30 con 0x7f27480c9840 2023-06-10T18:56:05.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.323+0000 7f274e4d8640 1 --2- 172.21.15.53:0/3249108159 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2730003a20 0x7f2730003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:05.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.323+0000 7f274ecd9640 1 --2- 172.21.15.53:0/3249108159 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2730004d10 0x7f2730005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:05.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.323+0000 7f274dcd7640 1 --2- 172.21.15.53:0/3249108159 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27480c9840 0x7f27300047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:05.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.323+0000 7f274e4d8640 1 -- 172.21.15.53:0/3249108159 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27480c9840 msgr2=0x7f27300047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:05.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.323+0000 7f274e4d8640 1 --2- 172.21.15.53:0/3249108159 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27480c9840 0x7f27300047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:05.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.323+0000 7f274e4d8640 1 -- 172.21.15.53:0/3249108159 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2730004d10 msgr2=0x7f2730005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:05.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.323+0000 7f274e4d8640 1 --2- 172.21.15.53:0/3249108159 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2730004d10 0x7f2730005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:05.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.323+0000 7f274e4d8640 1 -- 172.21.15.53:0/3249108159 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2730003530 con 0x7f2730003a20 2023-06-10T18:56:05.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.323+0000 7f274ecd9640 1 --2- 172.21.15.53:0/3249108159 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2730004d10 0x7f2730005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:56:05.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.323+0000 7f274dcd7640 1 --2- 172.21.15.53:0/3249108159 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27480c9840 0x7f27300047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:56:05.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.327+0000 7f274e4d8640 1 --2- 172.21.15.53:0/3249108159 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2730003a20 0x7f2730003e30 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f2740009fc0 tx=0x7f274001cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98f7ad3bf5402fcb server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:05.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.327+0000 7f274d4d6640 1 -- 172.21.15.53:0/3249108159 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27400a5c20 con 0x7f2730003a20 2023-06-10T18:56:05.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.327+0000 7f274d4d6640 1 -- 172.21.15.53:0/3249108159 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f274000f040 con 0x7f2730003a20 2023-06-10T18:56:05.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.327+0000 7f274d4d6640 1 -- 172.21.15.53:0/3249108159 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27400ad440 con 0x7f2730003a20 2023-06-10T18:56:05.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.327+0000 7f275073c640 1 -- 172.21.15.53:0/3249108159 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2730003a20 msgr2=0x7f2730003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:05.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.327+0000 7f275073c640 1 --2- 172.21.15.53:0/3249108159 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2730003a20 0x7f2730003e30 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f2740009fc0 tx=0x7f274001cc30 comp rx=0 tx=0).stop 2023-06-10T18:56:05.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.327+0000 7f274ecd9640 1 -- 172.21.15.53:0/3249108159 reap_dead start 2023-06-10T18:56:05.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.327+0000 7f275073c640 1 -- 172.21.15.53:0/3249108159 shutdown_connections 2023-06-10T18:56:05.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.327+0000 7f275073c640 1 -- 172.21.15.53:0/3249108159 >> 172.21.15.53:0/3249108159 conn(0x7f274806a0d0 msgr2=0x7f27480ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:05.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.327+0000 7f275073c640 1 -- 172.21.15.53:0/3249108159 shutdown_connections 2023-06-10T18:56:05.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.327+0000 7f275073c640 1 -- 172.21.15.53:0/3249108159 wait complete. 2023-06-10T18:56:05.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.327+0000 7f275073c640 1 Processor -- start 2023-06-10T18:56:05.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.327+0000 7f275073c640 1 -- start start 2023-06-10T18:56:05.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.327+0000 7f275073c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2730003a20 0x7f27481520c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:05.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.327+0000 7f275073c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2748151b90 0x7f2748151360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:05.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.327+0000 7f275073c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27480b1e10 0x7f27480b2280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:05.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.327+0000 7f275073c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27480b2c80 con 0x7f27480b1e10 2023-06-10T18:56:05.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.327+0000 7f275073c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27480b3490 con 0x7f2730003a20 2023-06-10T18:56:05.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.327+0000 7f275073c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27480b1980 con 0x7f2748151b90 2023-06-10T18:56:05.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.327+0000 7f274ecd9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27480b1e10 0x7f27480b2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:05.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.327+0000 7f274ecd9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27480b1e10 0x7f27480b2280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51232/0 (socket says 172.21.15.53:51232) 2023-06-10T18:56:05.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.327+0000 7f274ecd9640 1 -- 172.21.15.53:0/82611545 learned_addr learned my addr 172.21.15.53:0/82611545 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:05.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.331+0000 7f274e4d8640 1 --2- 172.21.15.53:0/82611545 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2730003a20 0x7f27481520c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:05.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.331+0000 7f274dcd7640 1 --2- 172.21.15.53:0/82611545 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2748151b90 0x7f2748151360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:05.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.331+0000 7f274ecd9640 1 -- 172.21.15.53:0/82611545 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2748151b90 msgr2=0x7f2748151360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:05.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.331+0000 7f274ecd9640 1 --2- 172.21.15.53:0/82611545 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2748151b90 0x7f2748151360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:05.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.331+0000 7f274ecd9640 1 -- 172.21.15.53:0/82611545 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2730003a20 msgr2=0x7f27481520c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:05.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.331+0000 7f274ecd9640 1 --2- 172.21.15.53:0/82611545 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2730003a20 0x7f27481520c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:05.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.331+0000 7f274ecd9640 1 -- 172.21.15.53:0/82611545 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27480b2ed0 con 0x7f27480b1e10 2023-06-10T18:56:05.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.331+0000 7f274ecd9640 1 --2- 172.21.15.53:0/82611545 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27480b1e10 0x7f27480b2280 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f273800d540 tx=0x7f273800d630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:05.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.331+0000 7f2746ffd640 1 -- 172.21.15.53:0/82611545 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f273800de40 con 0x7f27480b1e10 2023-06-10T18:56:05.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.331+0000 7f2746ffd640 1 -- 172.21.15.53:0/82611545 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27380070d0 con 0x7f27480b1e10 2023-06-10T18:56:05.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.331+0000 7f275073c640 1 -- 172.21.15.53:0/82611545 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27480b31b0 con 0x7f27480b1e10 2023-06-10T18:56:05.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.331+0000 7f2746ffd640 1 -- 172.21.15.53:0/82611545 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2738007460 con 0x7f27480b1e10 2023-06-10T18:56:05.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.331+0000 7f275073c640 1 -- 172.21.15.53:0/82611545 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27481518a0 con 0x7f27480b1e10 2023-06-10T18:56:05.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.331+0000 7f275073c640 1 -- 172.21.15.53:0/82611545 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f274804d790 con 0x7f27480b1e10 2023-06-10T18:56:05.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.331+0000 7f2746ffd640 1 -- 172.21.15.53:0/82611545 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f27380047f0 con 0x7f27480b1e10 2023-06-10T18:56:05.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.331+0000 7f2746ffd640 1 --2- 172.21.15.53:0/82611545 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2734066280 0x7f2734068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:05.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.331+0000 7f2746ffd640 1 -- 172.21.15.53:0/82611545 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f27380831d0 con 0x7f27480b1e10 2023-06-10T18:56:05.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.331+0000 7f274e4d8640 1 --2- 172.21.15.53:0/82611545 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2734066280 0x7f2734068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:05.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.331+0000 7f274e4d8640 1 --2- 172.21.15.53:0/82611545 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2734066280 0x7f2734068730 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f27400b0040 tx=0x7f27400a7040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:05.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.335+0000 7f2746ffd640 1 -- 172.21.15.53:0/82611545 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f27380506c0 con 0x7f27480b1e10 2023-06-10T18:56:05.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.523+0000 7f275073c640 1 -- 172.21.15.53:0/82611545 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f27480c95a0 con 0x7f27480b1e10 2023-06-10T18:56:05.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.527+0000 7f2746ffd640 1 -- 172.21.15.53:0/82611545 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4677 (secure 0 0 0) 0x7f2738053ce0 con 0x7f27480b1e10 2023-06-10T18:56:05.535 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:56:05.535 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4853,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/4087456763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":4087456763},{"type":"v1","addr":"172.21.15.117:6835","nonce":4087456763}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5071,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1065941624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1065941624},{"type":"v1","addr":"172.21.15.117:6837","nonce":1065941624}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5322,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/4137796077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":4137796077},{"type":"v1","addr":"172.21.15.53:6833","nonce":4137796077}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T18:53:54.735461+0000","modified":"2023-06-10T18:53:56.773799+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5331},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5331":{"gid":5331,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/2596772129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2596772129},{"type":"v1","addr":"172.21.15.53:6835","nonce":2596772129}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-06-10T18:56:05.535 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 13 2023-06-10T18:56:05.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.527+0000 7f275073c640 1 -- 172.21.15.53:0/82611545 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2734066280 msgr2=0x7f2734068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:05.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.527+0000 7f275073c640 1 --2- 172.21.15.53:0/82611545 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2734066280 0x7f2734068730 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f27400b0040 tx=0x7f27400a7040 comp rx=0 tx=0).stop 2023-06-10T18:56:05.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.527+0000 7f275073c640 1 -- 172.21.15.53:0/82611545 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27480b1e10 msgr2=0x7f27480b2280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:05.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.527+0000 7f275073c640 1 --2- 172.21.15.53:0/82611545 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27480b1e10 0x7f27480b2280 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f273800d540 tx=0x7f273800d630 comp rx=0 tx=0).stop 2023-06-10T18:56:05.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.527+0000 7f275073c640 1 -- 172.21.15.53:0/82611545 shutdown_connections 2023-06-10T18:56:05.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.527+0000 7f275073c640 1 --2- 172.21.15.53:0/82611545 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2734066280 0x7f2734068730 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:05.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.527+0000 7f275073c640 1 --2- 172.21.15.53:0/82611545 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27480b1e10 0x7f27480b2280 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:05.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.527+0000 7f275073c640 1 --2- 172.21.15.53:0/82611545 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2748151b90 0x7f2748151360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:05.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.527+0000 7f275073c640 1 --2- 172.21.15.53:0/82611545 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2730003a20 0x7f27481520c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:05.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.527+0000 7f275073c640 1 -- 172.21.15.53:0/82611545 >> 172.21.15.53:0/82611545 conn(0x7f274806a0d0 msgr2=0x7f27480ca370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:05.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.527+0000 7f275073c640 1 -- 172.21.15.53:0/82611545 shutdown_connections 2023-06-10T18:56:05.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.527+0000 7f275073c640 1 -- 172.21.15.53:0/82611545 wait complete. 2023-06-10T18:56:05.554 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T18:56:05.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.667+0000 7f529b674640 1 Processor -- start 2023-06-10T18:56:05.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.667+0000 7f529b674640 1 -- start start 2023-06-10T18:56:05.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.667+0000 7f529b674640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f52940b3ac0 0x7f52940b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:05.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.667+0000 7f529b674640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f52940d14c0 0x7f529415fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:05.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.667+0000 7f529b674640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52940d0020 con 0x7f52940cc690 2023-06-10T18:56:05.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.667+0000 7f529b674640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52940b43d0 con 0x7f52940d14c0 2023-06-10T18:56:05.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.667+0000 7f529b674640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52940cef40 con 0x7f52940b3ac0 2023-06-10T18:56:05.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.667+0000 7f5299410640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f52940b3ac0 0x7f52940b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:05.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.667+0000 7f5299410640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f52940b3ac0 0x7f52940b3e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.53:38922/0 (socket says 172.21.15.53:38922) 2023-06-10T18:56:05.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.667+0000 7f5299410640 1 -- 172.21.15.53:0/2766687903 learned_addr learned my addr 172.21.15.53:0/2766687903 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:05.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.667+0000 7f5298c0f640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f52940cc690 0x7f529415f370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41294/0 (socket says 172.21.15.53:41294) 2023-06-10T18:56:05.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.667+0000 7f5299c11640 1 --2- 172.21.15.53:0/2766687903 >> v2:172.21.15.117:3300/0 conn(0x7f52940d14c0 0x7f529415fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:05.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.667+0000 7f5287fff640 1 -- 172.21.15.53:0/2766687903 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 247658205 0 0) 0x7f52940d0020 con 0x7f52940cc690 2023-06-10T18:56:05.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.667+0000 7f5287fff640 1 -- 172.21.15.53:0/2766687903 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5280003530 con 0x7f52940cc690 2023-06-10T18:56:05.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.667+0000 7f5299410640 1 -- 172.21.15.53:0/2766687903 >> v2:172.21.15.117:3300/0 conn(0x7f52940d14c0 msgr2=0x7f529415fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:05.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.667+0000 7f5299410640 1 --2- 172.21.15.53:0/2766687903 >> v2:172.21.15.117:3300/0 conn(0x7f52940d14c0 0x7f529415fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:05.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.667+0000 7f5299410640 1 -- 172.21.15.53:0/2766687903 >> v1:172.21.15.53:6789/0 conn(0x7f52940cc690 legacy=0x7f529415f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:05.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.667+0000 7f5299410640 1 -- 172.21.15.53:0/2766687903 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52940cf220 con 0x7f52940b3ac0 2023-06-10T18:56:05.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.667+0000 7f5299410640 1 --2- 172.21.15.53:0/2766687903 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f52940b3ac0 0x7f52940b3e90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5288009870 tx=0x7f528801c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8384b1b56b4d4fc4 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:05.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.671+0000 7f5287fff640 1 -- 172.21.15.53:0/2766687903 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52880ab620 con 0x7f52940b3ac0 2023-06-10T18:56:05.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.671+0000 7f5287fff640 1 -- 172.21.15.53:0/2766687903 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52880ab780 con 0x7f52940b3ac0 2023-06-10T18:56:05.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.671+0000 7f5287fff640 1 -- 172.21.15.53:0/2766687903 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52880abb10 con 0x7f52940b3ac0 2023-06-10T18:56:05.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.671+0000 7f529b674640 1 -- 172.21.15.53:0/2766687903 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f52940b3ac0 msgr2=0x7f52940b3e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:05.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.671+0000 7f529b674640 1 --2- 172.21.15.53:0/2766687903 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f52940b3ac0 0x7f52940b3e90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5288009870 tx=0x7f528801c510 comp rx=0 tx=0).stop 2023-06-10T18:56:05.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.671+0000 7f529b674640 1 -- 172.21.15.53:0/2766687903 shutdown_connections 2023-06-10T18:56:05.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.671+0000 7f529b674640 1 --2- 172.21.15.53:0/2766687903 >> v2:172.21.15.117:3300/0 conn(0x7f52940d14c0 0x7f529415fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:05.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.671+0000 7f529b674640 1 --2- 172.21.15.53:0/2766687903 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f52940b3ac0 0x7f52940b3e90 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:05.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.671+0000 7f529b674640 1 -- 172.21.15.53:0/2766687903 >> 172.21.15.53:0/2766687903 conn(0x7f5294071790 msgr2=0x7f5294069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:05.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.671+0000 7f529b674640 1 -- 172.21.15.53:0/2766687903 shutdown_connections 2023-06-10T18:56:05.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.671+0000 7f529b674640 1 -- 172.21.15.53:0/2766687903 wait complete. 2023-06-10T18:56:05.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.671+0000 7f529b674640 1 Processor -- start 2023-06-10T18:56:05.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.671+0000 7f529b674640 1 -- start start 2023-06-10T18:56:05.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.671+0000 7f529b674640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f52940b3ac0 0x7f52940c9110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:05.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.671+0000 7f529b674640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f52940cc690 0x7f529415e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:05.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.671+0000 7f529b674640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52940d14c0 0x7f52941595d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:05.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.671+0000 7f529b674640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5294158e60 con 0x7f52940d14c0 2023-06-10T18:56:05.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.671+0000 7f529b674640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5294159140 con 0x7f52940b3ac0 2023-06-10T18:56:05.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.671+0000 7f529b674640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52940cb890 con 0x7f52940cc690 2023-06-10T18:56:05.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.671+0000 7f5299c11640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52940d14c0 0x7f52941595d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:05.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.671+0000 7f5299c11640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52940d14c0 0x7f52941595d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51236/0 (socket says 172.21.15.53:51236) 2023-06-10T18:56:05.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.671+0000 7f5299c11640 1 -- 172.21.15.53:0/1773357434 learned_addr learned my addr 172.21.15.53:0/1773357434 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:05.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.671+0000 7f5298c0f640 1 --2- 172.21.15.53:0/1773357434 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f52940cc690 0x7f529415e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:05.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.671+0000 7f5299410640 1 --2- 172.21.15.53:0/1773357434 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f52940b3ac0 0x7f52940c9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:05.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.671+0000 7f5299c11640 1 -- 172.21.15.53:0/1773357434 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f52940cc690 msgr2=0x7f529415e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:05.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.671+0000 7f5299c11640 1 --2- 172.21.15.53:0/1773357434 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f52940cc690 0x7f529415e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:05.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.671+0000 7f5299c11640 1 -- 172.21.15.53:0/1773357434 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f52940b3ac0 msgr2=0x7f52940c9110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:05.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.671+0000 7f5299c11640 1 --2- 172.21.15.53:0/1773357434 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f52940b3ac0 0x7f52940c9110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:05.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.671+0000 7f5299c11640 1 -- 172.21.15.53:0/1773357434 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52880094d0 con 0x7f52940d14c0 2023-06-10T18:56:05.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.671+0000 7f5298c0f640 1 --2- 172.21.15.53:0/1773357434 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f52940cc690 0x7f529415e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:56:05.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.671+0000 7f5299c11640 1 --2- 172.21.15.53:0/1773357434 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52940d14c0 0x7f52941595d0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f528c00e960 tx=0x7f528c00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:05.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.671+0000 7f5285ffb640 1 -- 172.21.15.53:0/1773357434 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f528c0096b0 con 0x7f52940d14c0 2023-06-10T18:56:05.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.671+0000 7f5285ffb640 1 -- 172.21.15.53:0/1773357434 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f528c00c9a0 con 0x7f52940d14c0 2023-06-10T18:56:05.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.671+0000 7f529b674640 1 -- 172.21.15.53:0/1773357434 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52940cbb70 con 0x7f52940d14c0 2023-06-10T18:56:05.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.671+0000 7f5285ffb640 1 -- 172.21.15.53:0/1773357434 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f528c00cd30 con 0x7f52940d14c0 2023-06-10T18:56:05.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.671+0000 7f529b674640 1 -- 172.21.15.53:0/1773357434 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52940cb510 con 0x7f52940d14c0 2023-06-10T18:56:05.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.675+0000 7f529b674640 1 -- 172.21.15.53:0/1773357434 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52940cc020 con 0x7f52940d14c0 2023-06-10T18:56:05.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.675+0000 7f5285ffb640 1 -- 172.21.15.53:0/1773357434 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f528c013470 con 0x7f52940d14c0 2023-06-10T18:56:05.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.675+0000 7f5285ffb640 1 --2- 172.21.15.53:0/1773357434 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f52780662b0 0x7f5278068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:05.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.675+0000 7f5285ffb640 1 -- 172.21.15.53:0/1773357434 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f528c083f80 con 0x7f52940d14c0 2023-06-10T18:56:05.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.675+0000 7f5299410640 1 --2- 172.21.15.53:0/1773357434 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f52780662b0 0x7f5278068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:05.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.675+0000 7f5299410640 1 --2- 172.21.15.53:0/1773357434 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f52780662b0 0x7f5278068760 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f52880af000 tx=0x7f52880a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:05.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.679+0000 7f5285ffb640 1 -- 172.21.15.53:0/1773357434 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f528c0513d0 con 0x7f52940d14c0 2023-06-10T18:56:05.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.835+0000 7f529b674640 1 -- 172.21.15.53:0/1773357434 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f529404d790 con 0x7f52940d14c0 2023-06-10T18:56:05.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.835+0000 7f5285ffb640 1 -- 172.21.15.53:0/1773357434 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+18332 (secure 0 0 0) 0x7f528c017090 con 0x7f52940d14c0 2023-06-10T18:56:05.845 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:56:05.845 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":39,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T18:54:27.787457+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-06-10T18:53:52.688764+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-06-10T18:53:53.727157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.31","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T18:56:05.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.839+0000 7f529b674640 1 -- 172.21.15.53:0/1773357434 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f52780662b0 msgr2=0x7f5278068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:05.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.839+0000 7f529b674640 1 --2- 172.21.15.53:0/1773357434 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f52780662b0 0x7f5278068760 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f52880af000 tx=0x7f52880a7000 comp rx=0 tx=0).stop 2023-06-10T18:56:05.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.839+0000 7f529b674640 1 -- 172.21.15.53:0/1773357434 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52940d14c0 msgr2=0x7f52941595d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:05.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.839+0000 7f529b674640 1 --2- 172.21.15.53:0/1773357434 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52940d14c0 0x7f52941595d0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f528c00e960 tx=0x7f528c00ee20 comp rx=0 tx=0).stop 2023-06-10T18:56:05.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.839+0000 7f529b674640 1 -- 172.21.15.53:0/1773357434 shutdown_connections 2023-06-10T18:56:05.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.839+0000 7f529b674640 1 --2- 172.21.15.53:0/1773357434 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f52780662b0 0x7f5278068760 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:05.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.839+0000 7f529b674640 1 --2- 172.21.15.53:0/1773357434 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52940d14c0 0x7f52941595d0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:05.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.839+0000 7f529b674640 1 --2- 172.21.15.53:0/1773357434 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f52940cc690 0x7f529415e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:05.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.839+0000 7f529b674640 1 --2- 172.21.15.53:0/1773357434 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f52940b3ac0 0x7f52940c9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:05.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.839+0000 7f529b674640 1 -- 172.21.15.53:0/1773357434 >> 172.21.15.53:0/1773357434 conn(0x7f5294071790 msgr2=0x7f52940b2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:05.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.839+0000 7f529b674640 1 -- 172.21.15.53:0/1773357434 shutdown_connections 2023-06-10T18:56:05.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.839+0000 7f529b674640 1 -- 172.21.15.53:0/1773357434 wait complete. 2023-06-10T18:56:05.866 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-06-10T18:56:05.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.983+0000 7f873af22640 1 Processor -- start 2023-06-10T18:56:05.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.983+0000 7f873af22640 1 -- start start 2023-06-10T18:56:05.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.983+0000 7f873af22640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8734152bb0 0x7f87340c8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:05.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.983+0000 7f873af22640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f873415c210 0x7f873415c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:05.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.983+0000 7f873af22640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87340c8850 con 0x7f8734158c20 2023-06-10T18:56:05.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.983+0000 7f873af22640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87340cc8f0 con 0x7f8734152bb0 2023-06-10T18:56:05.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.983+0000 7f873af22640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f873415cb80 con 0x7f873415c210 2023-06-10T18:56:05.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.983+0000 7f8738cbe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8734152bb0 0x7f87340c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:05.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.983+0000 7f8738cbe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8734152bb0 0x7f87340c8310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51246/0 (socket says 172.21.15.53:51246) 2023-06-10T18:56:05.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.983+0000 7f8738cbe640 1 -- 172.21.15.53:0/3177272427 learned_addr learned my addr 172.21.15.53:0/3177272427 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:05.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.983+0000 7f8733fff640 1 --2- 172.21.15.53:0/3177272427 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f873415c210 0x7f873415c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:05.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.983+0000 7f8738cbe640 1 -- 172.21.15.53:0/3177272427 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f873415c210 msgr2=0x7f873415c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:05.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.983+0000 7f8738cbe640 1 --2- 172.21.15.53:0/3177272427 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f873415c210 0x7f873415c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:05.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.983+0000 7f8738cbe640 1 -- 172.21.15.53:0/3177272427 >> v1:172.21.15.117:6789/0 conn(0x7f8734158c20 legacy=0x7f8734159040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:05.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.983+0000 7f8738cbe640 1 -- 172.21.15.53:0/3177272427 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87340c8b90 con 0x7f8734152bb0 2023-06-10T18:56:05.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.987+0000 7f8738cbe640 1 --2- 172.21.15.53:0/3177272427 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8734152bb0 0x7f87340c8310 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f8728006fd0 tx=0x7f87280213e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3854305edd17558a server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:05.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.987+0000 7f87337fe640 1 -- 172.21.15.53:0/3177272427 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87280b1600 con 0x7f8734152bb0 2023-06-10T18:56:05.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.987+0000 7f87337fe640 1 -- 172.21.15.53:0/3177272427 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87280ad050 con 0x7f8734152bb0 2023-06-10T18:56:05.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.987+0000 7f87337fe640 1 -- 172.21.15.53:0/3177272427 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87280b1980 con 0x7f8734152bb0 2023-06-10T18:56:05.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.987+0000 7f873af22640 1 -- 172.21.15.53:0/3177272427 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8734152bb0 msgr2=0x7f87340c8310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:06.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.987+0000 7f873af22640 1 --2- 172.21.15.53:0/3177272427 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8734152bb0 0x7f87340c8310 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f8728006fd0 tx=0x7f87280213e0 comp rx=0 tx=0).stop 2023-06-10T18:56:06.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.987+0000 7f873af22640 1 -- 172.21.15.53:0/3177272427 shutdown_connections 2023-06-10T18:56:06.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.987+0000 7f873af22640 1 --2- 172.21.15.53:0/3177272427 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f873415c210 0x7f873415c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:06.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.987+0000 7f873af22640 1 --2- 172.21.15.53:0/3177272427 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8734152bb0 0x7f87340c8310 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:06.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.987+0000 7f873af22640 1 -- 172.21.15.53:0/3177272427 >> 172.21.15.53:0/3177272427 conn(0x7f87340ce9e0 msgr2=0x7f87340ca7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:06.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.987+0000 7f873af22640 1 -- 172.21.15.53:0/3177272427 shutdown_connections 2023-06-10T18:56:06.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.987+0000 7f873af22640 1 -- 172.21.15.53:0/3177272427 wait complete. 2023-06-10T18:56:06.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.991+0000 7f873af22640 1 Processor -- start 2023-06-10T18:56:06.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.991+0000 7f873af22640 1 -- start start 2023-06-10T18:56:06.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.991+0000 7f873af22640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8734152bb0 0x7f8734140930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:06.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.991+0000 7f873af22640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8734158c20 0x7f87340c4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:06.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.991+0000 7f873af22640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f873415c210 0x7f87340c7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:06.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.991+0000 7f873af22640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87340c8430 con 0x7f8734152bb0 2023-06-10T18:56:06.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.991+0000 7f873af22640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8734146d00 con 0x7f873415c210 2023-06-10T18:56:06.002 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.991+0000 7f873af22640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87340c2970 con 0x7f8734158c20 2023-06-10T18:56:06.002 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.991+0000 7f8738cbe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8734152bb0 0x7f8734140930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:06.002 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.991+0000 7f8738cbe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8734152bb0 0x7f8734140930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51258/0 (socket says 172.21.15.53:51258) 2023-06-10T18:56:06.002 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.991+0000 7f8738cbe640 1 -- 172.21.15.53:0/597986714 learned_addr learned my addr 172.21.15.53:0/597986714 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:06.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.991+0000 7f8733fff640 1 --2- 172.21.15.53:0/597986714 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8734158c20 0x7f87340c4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:06.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.991+0000 7f8738cbe640 1 -- 172.21.15.53:0/597986714 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8734158c20 msgr2=0x7f87340c4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:06.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.991+0000 7f8738cbe640 1 --2- 172.21.15.53:0/597986714 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8734158c20 0x7f87340c4ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:06.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.991+0000 7f87394bf640 1 --2- 172.21.15.53:0/597986714 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f873415c210 0x7f87340c7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:06.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.991+0000 7f8738cbe640 1 -- 172.21.15.53:0/597986714 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f873415c210 msgr2=0x7f87340c7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:06.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.991+0000 7f8738cbe640 1 --2- 172.21.15.53:0/597986714 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f873415c210 0x7f87340c7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:06.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.991+0000 7f8738cbe640 1 -- 172.21.15.53:0/597986714 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f872800b720 con 0x7f8734152bb0 2023-06-10T18:56:06.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.991+0000 7f8733fff640 1 --2- 172.21.15.53:0/597986714 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8734158c20 0x7f87340c4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:56:06.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.991+0000 7f87394bf640 1 --2- 172.21.15.53:0/597986714 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f873415c210 0x7f87340c7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:56:06.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.991+0000 7f8738cbe640 1 --2- 172.21.15.53:0/597986714 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8734152bb0 0x7f8734140930 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f872801f010 tx=0x7f872801e180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:06.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.991+0000 7f87317fa640 1 -- 172.21.15.53:0/597986714 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8728003bf0 con 0x7f8734152bb0 2023-06-10T18:56:06.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.991+0000 7f87317fa640 1 -- 172.21.15.53:0/597986714 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8728003d50 con 0x7f8734152bb0 2023-06-10T18:56:06.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.991+0000 7f873af22640 1 -- 172.21.15.53:0/597986714 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87340c2c50 con 0x7f8734152bb0 2023-06-10T18:56:06.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.991+0000 7f87317fa640 1 -- 172.21.15.53:0/597986714 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87280bb660 con 0x7f8734152bb0 2023-06-10T18:56:06.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.991+0000 7f873af22640 1 -- 172.21.15.53:0/597986714 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87340c3210 con 0x7f8734152bb0 2023-06-10T18:56:06.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.991+0000 7f873af22640 1 -- 172.21.15.53:0/597986714 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87340c3400 con 0x7f8734152bb0 2023-06-10T18:56:06.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.991+0000 7f87317fa640 1 -- 172.21.15.53:0/597986714 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f87280bb7c0 con 0x7f8734152bb0 2023-06-10T18:56:06.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.995+0000 7f87317fa640 1 --2- 172.21.15.53:0/597986714 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8718066280 0x7f8718068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:06.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.995+0000 7f87317fa640 1 -- 172.21.15.53:0/597986714 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f87281241c0 con 0x7f8734152bb0 2023-06-10T18:56:06.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.995+0000 7f8733fff640 1 --2- 172.21.15.53:0/597986714 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8718066280 0x7f8718068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:06.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.995+0000 7f8733fff640 1 --2- 172.21.15.53:0/597986714 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8718066280 0x7f8718068730 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f8734147040 tx=0x7f8720008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:06.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:05.999+0000 7f87317fa640 1 -- 172.21.15.53:0/597986714 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f87280f16b0 con 0x7f8734152bb0 2023-06-10T18:56:06.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:06.183+0000 7f873af22640 1 -- 172.21.15.53:0/597986714 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f873404d790 con 0x7f8734152bb0 2023-06-10T18:56:06.407 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-10T18:56:06.409 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-10T18:56:07.106 INFO:tasks.ceph.mon.a.smithi053.stderr:2023-06-10T18:56:07.099+0000 7f74752c1640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-06-10T18:56:07.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.115+0000 7f87317fa640 1 -- 172.21.15.53:0/597986714 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v14) v1 ==== 161+0+0 (secure 0 0 0) 0x7f87280f4cd0 con 0x7f8734152bb0 2023-06-10T18:56:07.125 INFO:teuthology.orchestra.run.smithi053.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-06-10T18:56:07.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.119+0000 7f873af22640 1 -- 172.21.15.53:0/597986714 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8718066280 msgr2=0x7f8718068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:07.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.119+0000 7f873af22640 1 --2- 172.21.15.53:0/597986714 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8718066280 0x7f8718068730 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f8734147040 tx=0x7f8720008040 comp rx=0 tx=0).stop 2023-06-10T18:56:07.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.119+0000 7f873af22640 1 -- 172.21.15.53:0/597986714 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8734152bb0 msgr2=0x7f8734140930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:07.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.119+0000 7f873af22640 1 --2- 172.21.15.53:0/597986714 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8734152bb0 0x7f8734140930 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f872801f010 tx=0x7f872801e180 comp rx=0 tx=0).stop 2023-06-10T18:56:07.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.119+0000 7f873af22640 1 -- 172.21.15.53:0/597986714 shutdown_connections 2023-06-10T18:56:07.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.119+0000 7f873af22640 1 --2- 172.21.15.53:0/597986714 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8718066280 0x7f8718068730 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:07.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.119+0000 7f873af22640 1 --2- 172.21.15.53:0/597986714 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f873415c210 0x7f87340c7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:07.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.119+0000 7f873af22640 1 --2- 172.21.15.53:0/597986714 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8734158c20 0x7f87340c4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:07.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.119+0000 7f873af22640 1 --2- 172.21.15.53:0/597986714 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8734152bb0 0x7f8734140930 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:07.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.119+0000 7f873af22640 1 -- 172.21.15.53:0/597986714 >> 172.21.15.53:0/597986714 conn(0x7f87340ce9e0 msgr2=0x7f87340af820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:07.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.119+0000 7f873af22640 1 -- 172.21.15.53:0/597986714 shutdown_connections 2023-06-10T18:56:07.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.119+0000 7f873af22640 1 -- 172.21.15.53:0/597986714 wait complete. 2023-06-10T18:56:07.130 INFO:tasks.ceph.mds.a.smithi053.stderr: -3944> 2023-06-10T18:53:58.304+0000 7ff51e60d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-06-10T18:56:07.151 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-06-10T18:56:07.172 INFO:tasks.ceph.mds.a.smithi053.stdout:starting mds.a at 2023-06-10T18:56:07.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.279+0000 7f55b3724640 1 Processor -- start 2023-06-10T18:56:07.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.279+0000 7f55b3724640 1 -- start start 2023-06-10T18:56:07.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.279+0000 7f55b3724640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55ac0c82a0 0x7f55ac0c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:07.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.279+0000 7f55b3724640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55ac06b090 con 0x7f55ac0c9fa0 2023-06-10T18:56:07.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.279+0000 7f55b3724640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55ac0ca370 con 0x7f55ac0af760 2023-06-10T18:56:07.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.279+0000 7f55b3724640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55ac070d50 con 0x7f55ac0c82a0 2023-06-10T18:56:07.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.283+0000 7f55b14c0640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f55ac0c9fa0 0x7f55ac06bae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41310/0 (socket says 172.21.15.53:41310) 2023-06-10T18:56:07.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.283+0000 7f55b14c0640 1 -- 172.21.15.53:0/1943237305 learned_addr learned my addr 172.21.15.53:0/1943237305 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:56:07.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.283+0000 7f55b0cbf640 1 --2- 172.21.15.53:0/1943237305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55ac0c82a0 0x7f55ac0c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:07.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.283+0000 7f55a3fff640 1 -- 172.21.15.53:0/1943237305 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1524273667 0 0) 0x7f55ac06b090 con 0x7f55ac0c9fa0 2023-06-10T18:56:07.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.283+0000 7f55a3fff640 1 -- 172.21.15.53:0/1943237305 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5598003530 con 0x7f55ac0c9fa0 2023-06-10T18:56:07.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.283+0000 7f55a3fff640 1 -- 172.21.15.53:0/1943237305 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 205062776 0 0) 0x7f5598003530 con 0x7f55ac0c9fa0 2023-06-10T18:56:07.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.283+0000 7f55a3fff640 1 -- 172.21.15.53:0/1943237305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55ac0c82a0 msgr2=0x7f55ac0c86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:07.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.283+0000 7f55a3fff640 1 --2- 172.21.15.53:0/1943237305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55ac0c82a0 0x7f55ac0c86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:07.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.283+0000 7f55a3fff640 1 -- 172.21.15.53:0/1943237305 >> v1:172.21.15.117:6789/0 conn(0x7f55ac0af760 legacy=0x7f55ac0700e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:07.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.283+0000 7f55a3fff640 1 -- 172.21.15.53:0/1943237305 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55ac071030 con 0x7f55ac0c9fa0 2023-06-10T18:56:07.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.283+0000 7f55a3fff640 1 -- 172.21.15.53:0/1943237305 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f55a4001a00 con 0x7f55ac0c9fa0 2023-06-10T18:56:07.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.283+0000 7f55a3fff640 1 -- 172.21.15.53:0/1943237305 >> v1:172.21.15.53:6789/0 conn(0x7f55ac0c9fa0 legacy=0x7f55ac06bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:07.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.283+0000 7f55a3fff640 1 --2- 172.21.15.53:0/1943237305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55ac0c82a0 0x7f55980039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:07.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.283+0000 7f55a3fff640 1 --2- 172.21.15.53:0/1943237305 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5598003ef0 0x7f55980047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:07.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.283+0000 7f55a3fff640 1 --2- 172.21.15.53:0/1943237305 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5598004d10 0x7f5598005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:07.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.283+0000 7f55a3fff640 1 -- 172.21.15.53:0/1943237305 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55ac070d50 con 0x7f5598004d10 2023-06-10T18:56:07.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.283+0000 7f55a3fff640 1 -- 172.21.15.53:0/1943237305 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f559800ba70 con 0x7f5598003ef0 2023-06-10T18:56:07.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.283+0000 7f55a3fff640 1 -- 172.21.15.53:0/1943237305 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f559800bc30 con 0x7f55ac0c82a0 2023-06-10T18:56:07.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.283+0000 7f55b1cc1640 1 --2- 172.21.15.53:0/1943237305 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5598004d10 0x7f5598005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:07.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.283+0000 7f55b14c0640 1 --2- 172.21.15.53:0/1943237305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55ac0c82a0 0x7f55980039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:07.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.283+0000 7f55b0cbf640 1 --2- 172.21.15.53:0/1943237305 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5598003ef0 0x7f55980047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:07.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.283+0000 7f55b1cc1640 1 -- 172.21.15.53:0/1943237305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55ac0c82a0 msgr2=0x7f55980039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:07.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.283+0000 7f55b1cc1640 1 --2- 172.21.15.53:0/1943237305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55ac0c82a0 0x7f55980039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:07.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.283+0000 7f55b1cc1640 1 -- 172.21.15.53:0/1943237305 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5598003ef0 msgr2=0x7f55980047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:07.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.283+0000 7f55b1cc1640 1 --2- 172.21.15.53:0/1943237305 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5598003ef0 0x7f55980047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:07.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.283+0000 7f55b1cc1640 1 -- 172.21.15.53:0/1943237305 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5598003530 con 0x7f5598004d10 2023-06-10T18:56:07.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.283+0000 7f55b1cc1640 1 --2- 172.21.15.53:0/1943237305 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5598004d10 0x7f5598005180 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f55a8007fd0 tx=0x7f55a801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f0bce5083fe7e82 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:07.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.283+0000 7f55a3fff640 1 -- 172.21.15.53:0/1943237305 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a80ad640 con 0x7f5598004d10 2023-06-10T18:56:07.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.283+0000 7f55a3fff640 1 -- 172.21.15.53:0/1943237305 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55a80ad7a0 con 0x7f5598004d10 2023-06-10T18:56:07.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.283+0000 7f55a3fff640 1 -- 172.21.15.53:0/1943237305 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a80adb90 con 0x7f5598004d10 2023-06-10T18:56:07.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.287+0000 7f55b3724640 1 -- 172.21.15.53:0/1943237305 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5598004d10 msgr2=0x7f5598005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:07.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.287+0000 7f55b3724640 1 --2- 172.21.15.53:0/1943237305 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5598004d10 0x7f5598005180 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f55a8007fd0 tx=0x7f55a801c470 comp rx=0 tx=0).stop 2023-06-10T18:56:07.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.287+0000 7f55b1cc1640 1 -- 172.21.15.53:0/1943237305 reap_dead start 2023-06-10T18:56:07.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.287+0000 7f55b3724640 1 -- 172.21.15.53:0/1943237305 shutdown_connections 2023-06-10T18:56:07.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.287+0000 7f55b3724640 1 -- 172.21.15.53:0/1943237305 >> 172.21.15.53:0/1943237305 conn(0x7f55ac06a0e0 msgr2=0x7f55ac0cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:07.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.287+0000 7f55b3724640 1 -- 172.21.15.53:0/1943237305 shutdown_connections 2023-06-10T18:56:07.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.287+0000 7f55b3724640 1 -- 172.21.15.53:0/1943237305 wait complete. 2023-06-10T18:56:07.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.287+0000 7f55b3724640 1 Processor -- start 2023-06-10T18:56:07.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.287+0000 7f55b3724640 1 -- start start 2023-06-10T18:56:07.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.287+0000 7f55b3724640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f55ac15abe0 0x7f55ac0b0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:07.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.287+0000 7f55b3724640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55ac15b320 0x7f55ac0c6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:07.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.287+0000 7f55b3724640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55ac0c7430 0x7f55ac0c1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:07.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.287+0000 7f55b3724640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55ac0c78a0 con 0x7f55ac15b320 2023-06-10T18:56:07.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.287+0000 7f55b3724640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55ac15c680 con 0x7f55ac15abe0 2023-06-10T18:56:07.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.287+0000 7f55b3724640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55ac15bb00 con 0x7f55ac0c7430 2023-06-10T18:56:07.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.287+0000 7f55b0cbf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55ac15b320 0x7f55ac0c6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:07.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.287+0000 7f55b0cbf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55ac15b320 0x7f55ac0c6ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51278/0 (socket says 172.21.15.53:51278) 2023-06-10T18:56:07.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.287+0000 7f55b0cbf640 1 -- 172.21.15.53:0/3340592097 learned_addr learned my addr 172.21.15.53:0/3340592097 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:07.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.287+0000 7f55b14c0640 1 --2- 172.21.15.53:0/3340592097 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f55ac15abe0 0x7f55ac0b0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:07.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.287+0000 7f55b1cc1640 1 --2- 172.21.15.53:0/3340592097 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55ac0c7430 0x7f55ac0c1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:07.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.287+0000 7f55b0cbf640 1 -- 172.21.15.53:0/3340592097 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55ac0c7430 msgr2=0x7f55ac0c1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:07.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.287+0000 7f55b0cbf640 1 --2- 172.21.15.53:0/3340592097 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55ac0c7430 0x7f55ac0c1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:07.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.287+0000 7f55b0cbf640 1 -- 172.21.15.53:0/3340592097 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f55ac15abe0 msgr2=0x7f55ac0b0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:07.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.287+0000 7f55b0cbf640 1 --2- 172.21.15.53:0/3340592097 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f55ac15abe0 0x7f55ac0b0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:07.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.287+0000 7f55b0cbf640 1 -- 172.21.15.53:0/3340592097 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55ac15bde0 con 0x7f55ac15b320 2023-06-10T18:56:07.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.287+0000 7f55b0cbf640 1 --2- 172.21.15.53:0/3340592097 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55ac15b320 0x7f55ac0c6ef0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f559c011610 tx=0x7f559c011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:07.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.287+0000 7f55a1ffb640 1 -- 172.21.15.53:0/3340592097 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f559c00f8f0 con 0x7f55ac15b320 2023-06-10T18:56:07.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.287+0000 7f55a1ffb640 1 -- 172.21.15.53:0/3340592097 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f559c00fa50 con 0x7f55ac15b320 2023-06-10T18:56:07.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.287+0000 7f55b3724640 1 -- 172.21.15.53:0/3340592097 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55ac15c0c0 con 0x7f55ac15b320 2023-06-10T18:56:07.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.287+0000 7f55a1ffb640 1 -- 172.21.15.53:0/3340592097 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f559c00fdc0 con 0x7f55ac15b320 2023-06-10T18:56:07.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.287+0000 7f55b3724640 1 -- 172.21.15.53:0/3340592097 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55ac15b790 con 0x7f55ac15b320 2023-06-10T18:56:07.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.291+0000 7f55b3724640 1 -- 172.21.15.53:0/3340592097 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55ac04d790 con 0x7f55ac15b320 2023-06-10T18:56:07.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.291+0000 7f55a1ffb640 1 -- 172.21.15.53:0/3340592097 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f559c015460 con 0x7f55ac15b320 2023-06-10T18:56:07.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.291+0000 7f55a1ffb640 1 --2- 172.21.15.53:0/3340592097 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5590066280 0x7f5590068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:07.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.291+0000 7f55a1ffb640 1 -- 172.21.15.53:0/3340592097 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f559c084610 con 0x7f55ac15b320 2023-06-10T18:56:07.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.291+0000 7f55b14c0640 1 --2- 172.21.15.53:0/3340592097 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5590066280 0x7f5590068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:07.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.291+0000 7f55b14c0640 1 --2- 172.21.15.53:0/3340592097 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5590066280 0x7f5590068730 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f55a4004bd0 tx=0x7f55a4006040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:07.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.295+0000 7f55a1ffb640 1 -- 172.21.15.53:0/3340592097 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f559c051aa0 con 0x7f55ac15b320 2023-06-10T18:56:07.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:07.483+0000 7f55b3724640 1 -- 172.21.15.53:0/3340592097 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f55ac0cdb00 con 0x7f55ac15b320 2023-06-10T18:56:08.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:08.123+0000 7f55a1ffb640 1 -- 172.21.15.53:0/3340592097 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7f559c0550c0 con 0x7f55ac15b320 2023-06-10T18:56:08.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:08.127+0000 7f55b3724640 1 -- 172.21.15.53:0/3340592097 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5590066280 msgr2=0x7f5590068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:08.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:08.127+0000 7f55b3724640 1 --2- 172.21.15.53:0/3340592097 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5590066280 0x7f5590068730 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f55a4004bd0 tx=0x7f55a4006040 comp rx=0 tx=0).stop 2023-06-10T18:56:08.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:08.127+0000 7f55b3724640 1 -- 172.21.15.53:0/3340592097 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55ac15b320 msgr2=0x7f55ac0c6ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:08.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:08.127+0000 7f55b3724640 1 --2- 172.21.15.53:0/3340592097 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55ac15b320 0x7f55ac0c6ef0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f559c011610 tx=0x7f559c011ad0 comp rx=0 tx=0).stop 2023-06-10T18:56:08.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:08.127+0000 7f55b3724640 1 -- 172.21.15.53:0/3340592097 shutdown_connections 2023-06-10T18:56:08.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:08.127+0000 7f55b3724640 1 --2- 172.21.15.53:0/3340592097 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5590066280 0x7f5590068730 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:08.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:08.127+0000 7f55b3724640 1 --2- 172.21.15.53:0/3340592097 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55ac0c7430 0x7f55ac0c1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:08.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:08.127+0000 7f55b3724640 1 --2- 172.21.15.53:0/3340592097 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55ac15b320 0x7f55ac0c6ef0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:08.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:08.127+0000 7f55b3724640 1 --2- 172.21.15.53:0/3340592097 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f55ac15abe0 0x7f55ac0b0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:08.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:08.127+0000 7f55b3724640 1 -- 172.21.15.53:0/3340592097 >> 172.21.15.53:0/3340592097 conn(0x7f55ac06a0e0 msgr2=0x7f55ac0700e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:08.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:08.127+0000 7f55b3724640 1 -- 172.21.15.53:0/3340592097 shutdown_connections 2023-06-10T18:56:08.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:08.127+0000 7f55b3724640 1 -- 172.21.15.53:0/3340592097 wait complete. 2023-06-10T18:56:08.156 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-06-10T18:56:08.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:08.327+0000 7fd3fd02d640 1 Processor -- start 2023-06-10T18:56:08.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:08.327+0000 7fd3fd02d640 1 -- start start 2023-06-10T18:56:08.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:08.327+0000 7fd3fd02d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd3f8159760 0x7fd3f80cec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:08.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:08.327+0000 7fd3fd02d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd3f80cf1a0 0x7fd3f80cbf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:08.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:08.327+0000 7fd3fd02d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3f80cf5f0 con 0x7fd3f8159390 2023-06-10T18:56:08.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:08.327+0000 7fd3fd02d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3f815e1b0 con 0x7fd3f80cf1a0 2023-06-10T18:56:08.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:08.327+0000 7fd3fd02d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3f80cb460 con 0x7fd3f8159760 2023-06-10T18:56:08.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:08.327+0000 7fd3f759e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd3f80cf1a0 0x7fd3f80cbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:08.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:08.327+0000 7fd3f759e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd3f80cf1a0 0x7fd3f80cbf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51280/0 (socket says 172.21.15.53:51280) 2023-06-10T18:56:08.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:08.327+0000 7fd3f759e640 1 -- 172.21.15.53:0/2266857222 learned_addr learned my addr 172.21.15.53:0/2266857222 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:08.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:08.327+0000 7fd3f659c640 1 --2- 172.21.15.53:0/2266857222 >> v2:172.21.15.117:3300/0 conn(0x7fd3f8159760 0x7fd3f80cec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:08.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:08.327+0000 7fd3f759e640 1 -- 172.21.15.53:0/2266857222 >> v2:172.21.15.117:3300/0 conn(0x7fd3f8159760 msgr2=0x7fd3f80cec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:08.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:08.327+0000 7fd3f759e640 1 --2- 172.21.15.53:0/2266857222 >> v2:172.21.15.117:3300/0 conn(0x7fd3f8159760 0x7fd3f80cec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:08.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:08.327+0000 7fd3f759e640 1 -- 172.21.15.53:0/2266857222 >> v1:172.21.15.117:6789/0 conn(0x7fd3f8159390 legacy=0x7fd3f815d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:08.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:08.327+0000 7fd3f759e640 1 -- 172.21.15.53:0/2266857222 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3f815dbf0 con 0x7fd3f80cf1a0 2023-06-10T18:56:08.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:08.327+0000 7fd3f659c640 1 --2- 172.21.15.53:0/2266857222 >> v2:172.21.15.117:3300/0 conn(0x7fd3f8159760 0x7fd3f80cec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:56:08.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:08.331+0000 7fd3f759e640 1 --2- 172.21.15.53:0/2266857222 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3f80cf1a0 0x7fd3f80cbf00 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fd3f8067010 tx=0x7fd3e801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e96ff8a5c69e51ec server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:08.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:08.331+0000 7fd3f5d9b640 1 -- 172.21.15.53:0/2266857222 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e80aa5f0 con 0x7fd3f80cf1a0 2023-06-10T18:56:08.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:08.331+0000 7fd3f5d9b640 1 -- 172.21.15.53:0/2266857222 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3e80aa750 con 0x7fd3f80cf1a0 2023-06-10T18:56:08.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:08.331+0000 7fd3f5d9b640 1 -- 172.21.15.53:0/2266857222 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e80aaae0 con 0x7fd3f80cf1a0 2023-06-10T18:56:08.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:08.331+0000 7fd3fd02d640 1 -- 172.21.15.53:0/2266857222 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3f80cf1a0 msgr2=0x7fd3f80cbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:08.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:08.331+0000 7fd3fd02d640 1 --2- 172.21.15.53:0/2266857222 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3f80cf1a0 0x7fd3f80cbf00 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fd3f8067010 tx=0x7fd3e801c490 comp rx=0 tx=0).stop 2023-06-10T18:56:08.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:08.331+0000 7fd3fd02d640 1 -- 172.21.15.53:0/2266857222 shutdown_connections 2023-06-10T18:56:08.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:08.331+0000 7fd3fd02d640 1 --2- 172.21.15.53:0/2266857222 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3f80cf1a0 0x7fd3f80cbf00 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:08.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:08.331+0000 7fd3fd02d640 1 --2- 172.21.15.53:0/2266857222 >> v2:172.21.15.117:3300/0 conn(0x7fd3f8159760 0x7fd3f80cec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:08.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:08.331+0000 7fd3fd02d640 1 -- 172.21.15.53:0/2266857222 >> 172.21.15.53:0/2266857222 conn(0x7fd3f806a0b0 msgr2=0x7fd3f806d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:08.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:08.331+0000 7fd3fd02d640 1 -- 172.21.15.53:0/2266857222 shutdown_connections 2023-06-10T18:56:08.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:08.331+0000 7fd3fd02d640 1 -- 172.21.15.53:0/2266857222 wait complete. 2023-06-10T18:56:08.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:08.331+0000 7fd3fd02d640 1 Processor -- start 2023-06-10T18:56:08.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:08.331+0000 7fd3fd02d640 1 -- start start 2023-06-10T18:56:08.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:08.335+0000 7fd3fd02d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3f80cf1a0 0x7fd3f8150520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:08.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:08.335+0000 7fd3fd02d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3f8159390 0x7fd3f806b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:08.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:08.335+0000 7fd3fd02d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3f8159760 0x7fd3f80cdf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:08.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:08.335+0000 7fd3fd02d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f8153a20 con 0x7fd3f8159760 2023-06-10T18:56:08.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:08.335+0000 7fd3fd02d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f8152da0 con 0x7fd3f80cf1a0 2023-06-10T18:56:08.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:08.335+0000 7fd3fd02d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f8153080 con 0x7fd3f8159390 2023-06-10T18:56:08.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:08.335+0000 7fd3f759e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3f8159760 0x7fd3f80cdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:08.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:08.335+0000 7fd3f759e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3f8159760 0x7fd3f80cdf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51282/0 (socket says 172.21.15.53:51282) 2023-06-10T18:56:08.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:08.335+0000 7fd3f759e640 1 -- 172.21.15.53:0/2927882532 learned_addr learned my addr 172.21.15.53:0/2927882532 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:08.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:08.335+0000 7fd3f6d9d640 1 --2- 172.21.15.53:0/2927882532 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3f80cf1a0 0x7fd3f8150520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:08.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:08.335+0000 7fd3f659c640 1 --2- 172.21.15.53:0/2927882532 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3f8159390 0x7fd3f806b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:08.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:08.335+0000 7fd3f759e640 1 -- 172.21.15.53:0/2927882532 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3f8159390 msgr2=0x7fd3f806b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:08.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:08.335+0000 7fd3f759e640 1 --2- 172.21.15.53:0/2927882532 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3f8159390 0x7fd3f806b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:08.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:08.335+0000 7fd3f759e640 1 -- 172.21.15.53:0/2927882532 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3f80cf1a0 msgr2=0x7fd3f8150520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:08.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:08.335+0000 7fd3f759e640 1 --2- 172.21.15.53:0/2927882532 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3f80cf1a0 0x7fd3f8150520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:08.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:08.335+0000 7fd3f759e640 1 -- 172.21.15.53:0/2927882532 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3e80094d0 con 0x7fd3f8159760 2023-06-10T18:56:08.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:08.335+0000 7fd3f659c640 1 --2- 172.21.15.53:0/2927882532 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3f8159390 0x7fd3f806b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:56:08.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:08.335+0000 7fd3f759e640 1 --2- 172.21.15.53:0/2927882532 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3f8159760 0x7fd3f80cdf90 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fd3e80ac040 tx=0x7fd3e801acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:08.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:08.335+0000 7fd3ef7fe640 1 -- 172.21.15.53:0/2927882532 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e80b3800 con 0x7fd3f8159760 2023-06-10T18:56:08.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:08.335+0000 7fd3ef7fe640 1 -- 172.21.15.53:0/2927882532 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3e80b3980 con 0x7fd3f8159760 2023-06-10T18:56:08.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:08.335+0000 7fd3fd02d640 1 -- 172.21.15.53:0/2927882532 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3f8153360 con 0x7fd3f8159760 2023-06-10T18:56:08.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:08.335+0000 7fd3ef7fe640 1 -- 172.21.15.53:0/2927882532 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e80b3d30 con 0x7fd3f8159760 2023-06-10T18:56:08.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:08.335+0000 7fd3fd02d640 1 -- 172.21.15.53:0/2927882532 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3f8150a60 con 0x7fd3f8159760 2023-06-10T18:56:08.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:08.335+0000 7fd3fd02d640 1 -- 172.21.15.53:0/2927882532 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3f8150bf0 con 0x7fd3f8159760 2023-06-10T18:56:08.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:08.335+0000 7fd3ef7fe640 1 -- 172.21.15.53:0/2927882532 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd3e80b2380 con 0x7fd3f8159760 2023-06-10T18:56:08.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:08.335+0000 7fd3ef7fe640 1 --2- 172.21.15.53:0/2927882532 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd3d80662b0 0x7fd3d8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:08.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:08.335+0000 7fd3ef7fe640 1 -- 172.21.15.53:0/2927882532 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6177+0+0 (secure 0 0 0) 0x7fd3e80a7070 con 0x7fd3f8159760 2023-06-10T18:56:08.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:08.335+0000 7fd3f6d9d640 1 --2- 172.21.15.53:0/2927882532 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd3d80662b0 0x7fd3d8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:08.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:08.339+0000 7fd3f6d9d640 1 --2- 172.21.15.53:0/2927882532 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd3d80662b0 0x7fd3d8068760 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd3f0004e30 tx=0x7fd3f0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:08.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:08.339+0000 7fd3ef7fe640 1 -- 172.21.15.53:0/2927882532 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd3e80eaf20 con 0x7fd3f8159760 2023-06-10T18:56:08.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:08.491+0000 7fd3fd02d640 1 -- 172.21.15.53:0/2927882532 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd3f80cf5f0 con 0x7fd3f8159760 2023-06-10T18:56:09.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.203+0000 7fd3ef7fe640 1 -- 172.21.15.53:0/2927882532 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v41) v1 ==== 181+0+0 (secure 0 0 0) 0x7fd3f80cf5f0 con 0x7fd3f8159760 2023-06-10T18:56:09.210 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_metadata' removed 2023-06-10T18:56:09.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.211+0000 7fd3fd02d640 1 -- 172.21.15.53:0/2927882532 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd3d80662b0 msgr2=0x7fd3d8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:09.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.211+0000 7fd3fd02d640 1 --2- 172.21.15.53:0/2927882532 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd3d80662b0 0x7fd3d8068760 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd3f0004e30 tx=0x7fd3f0009040 comp rx=0 tx=0).stop 2023-06-10T18:56:09.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.211+0000 7fd3fd02d640 1 -- 172.21.15.53:0/2927882532 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3f8159760 msgr2=0x7fd3f80cdf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:09.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.211+0000 7fd3fd02d640 1 --2- 172.21.15.53:0/2927882532 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3f8159760 0x7fd3f80cdf90 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fd3e80ac040 tx=0x7fd3e801acd0 comp rx=0 tx=0).stop 2023-06-10T18:56:09.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.211+0000 7fd3fd02d640 1 -- 172.21.15.53:0/2927882532 shutdown_connections 2023-06-10T18:56:09.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.211+0000 7fd3fd02d640 1 --2- 172.21.15.53:0/2927882532 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd3d80662b0 0x7fd3d8068760 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:09.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.211+0000 7fd3fd02d640 1 --2- 172.21.15.53:0/2927882532 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3f8159760 0x7fd3f80cdf90 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:09.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.211+0000 7fd3fd02d640 1 --2- 172.21.15.53:0/2927882532 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3f8159390 0x7fd3f806b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:09.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.211+0000 7fd3fd02d640 1 --2- 172.21.15.53:0/2927882532 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3f80cf1a0 0x7fd3f8150520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:09.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.211+0000 7fd3fd02d640 1 -- 172.21.15.53:0/2927882532 >> 172.21.15.53:0/2927882532 conn(0x7fd3f806a0b0 msgr2=0x7fd3f8154470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:09.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.215+0000 7fd3fd02d640 1 -- 172.21.15.53:0/2927882532 shutdown_connections 2023-06-10T18:56:09.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.215+0000 7fd3fd02d640 1 -- 172.21.15.53:0/2927882532 wait complete. 2023-06-10T18:56:09.243 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-06-10T18:56:09.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.367+0000 7f6ef70ec640 1 Processor -- start 2023-06-10T18:56:09.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.367+0000 7f6ef70ec640 1 -- start start 2023-06-10T18:56:09.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.371+0000 7f6ef70ec640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6ef0164570 0x7f6ef0166950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:09.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.371+0000 7f6ef70ec640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ef00d0c40 con 0x7f6ef015b930 2023-06-10T18:56:09.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.371+0000 7f6ef70ec640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ef0160220 con 0x7f6ef00b1490 2023-06-10T18:56:09.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.371+0000 7f6ef70ec640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ef00cf5e0 con 0x7f6ef0164570 2023-06-10T18:56:09.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.371+0000 7f6ef4e88640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f6ef015b930 0x7f6ef015f400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41314/0 (socket says 172.21.15.53:41314) 2023-06-10T18:56:09.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.371+0000 7f6ef4e88640 1 -- 172.21.15.53:0/351966665 learned_addr learned my addr 172.21.15.53:0/351966665 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:56:09.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.371+0000 7f6ef5689640 1 --2- 172.21.15.53:0/351966665 >> v2:172.21.15.117:3300/0 conn(0x7f6ef0164570 0x7f6ef0166950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:09.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.371+0000 7f6ee77fe640 1 -- 172.21.15.53:0/351966665 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 732242880 0 0) 0x7f6ef00d0c40 con 0x7f6ef015b930 2023-06-10T18:56:09.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.371+0000 7f6ee77fe640 1 -- 172.21.15.53:0/351966665 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ed8003530 con 0x7f6ef015b930 2023-06-10T18:56:09.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.371+0000 7f6ee77fe640 1 -- 172.21.15.53:0/351966665 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4089798685 0 0) 0x7f6ed8003530 con 0x7f6ef015b930 2023-06-10T18:56:09.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.371+0000 7f6ee77fe640 1 -- 172.21.15.53:0/351966665 >> v2:172.21.15.117:3300/0 conn(0x7f6ef0164570 msgr2=0x7f6ef0166950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:09.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.371+0000 7f6ee77fe640 1 --2- 172.21.15.53:0/351966665 >> v2:172.21.15.117:3300/0 conn(0x7f6ef0164570 0x7f6ef0166950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:09.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.371+0000 7f6ee77fe640 1 -- 172.21.15.53:0/351966665 >> v1:172.21.15.117:6789/0 conn(0x7f6ef00b1490 legacy=0x7f6ef015fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:09.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.371+0000 7f6ee77fe640 1 -- 172.21.15.53:0/351966665 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ef015bd00 con 0x7f6ef015b930 2023-06-10T18:56:09.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.371+0000 7f6ee77fe640 1 -- 172.21.15.53:0/351966665 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f6eec001680 con 0x7f6ef015b930 2023-06-10T18:56:09.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.371+0000 7f6ee77fe640 1 -- 172.21.15.53:0/351966665 >> v1:172.21.15.53:6789/0 conn(0x7f6ef015b930 legacy=0x7f6ef015f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:09.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.371+0000 7f6ee77fe640 1 --2- 172.21.15.53:0/351966665 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ed8003980 0x7f6ed8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:09.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.371+0000 7f6ee77fe640 1 --2- 172.21.15.53:0/351966665 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ed80047d0 0x7f6ed8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:09.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.371+0000 7f6ee77fe640 1 --2- 172.21.15.53:0/351966665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ed8005180 0x7f6ed800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:09.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.371+0000 7f6ee77fe640 1 -- 172.21.15.53:0/351966665 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef00cf5e0 con 0x7f6ed8005180 2023-06-10T18:56:09.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.371+0000 7f6ee77fe640 1 -- 172.21.15.53:0/351966665 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed800c000 con 0x7f6ed80047d0 2023-06-10T18:56:09.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.371+0000 7f6ee77fe640 1 -- 172.21.15.53:0/351966665 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed800c1c0 con 0x7f6ed8003980 2023-06-10T18:56:09.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.371+0000 7f6ef5689640 1 --2- 172.21.15.53:0/351966665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ed8005180 0x7f6ed800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:09.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.371+0000 7f6ee7fff640 1 --2- 172.21.15.53:0/351966665 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ed80047d0 0x7f6ed8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:09.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.371+0000 7f6ef4e88640 1 --2- 172.21.15.53:0/351966665 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ed8003980 0x7f6ed8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:09.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.371+0000 7f6ef5689640 1 -- 172.21.15.53:0/351966665 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ed8003980 msgr2=0x7f6ed8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:09.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.371+0000 7f6ef5689640 1 --2- 172.21.15.53:0/351966665 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ed8003980 0x7f6ed8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:09.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.371+0000 7f6ef5689640 1 -- 172.21.15.53:0/351966665 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ed80047d0 msgr2=0x7f6ed8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:09.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.371+0000 7f6ef5689640 1 --2- 172.21.15.53:0/351966665 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ed80047d0 0x7f6ed8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:09.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.371+0000 7f6ef5689640 1 -- 172.21.15.53:0/351966665 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ed8003530 con 0x7f6ed8005180 2023-06-10T18:56:09.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.371+0000 7f6ef5689640 1 -- 172.21.15.53:0/351966665 reap_dead start 2023-06-10T18:56:09.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.371+0000 7f6ef5689640 1 --2- 172.21.15.53:0/351966665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ed8005180 0x7f6ed800b990 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f6ee8009f90 tx=0x7f6ee801cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=779a48e785e94c58 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:09.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.371+0000 7f6ee77fe640 1 -- 172.21.15.53:0/351966665 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee80a5c70 con 0x7f6ed8005180 2023-06-10T18:56:09.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.371+0000 7f6ee77fe640 1 -- 172.21.15.53:0/351966665 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ee800f040 con 0x7f6ed8005180 2023-06-10T18:56:09.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.375+0000 7f6ee77fe640 1 -- 172.21.15.53:0/351966665 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee80039a0 con 0x7f6ed8005180 2023-06-10T18:56:09.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.375+0000 7f6ef70ec640 1 -- 172.21.15.53:0/351966665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ed8005180 msgr2=0x7f6ed800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:09.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.375+0000 7f6ef70ec640 1 --2- 172.21.15.53:0/351966665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ed8005180 0x7f6ed800b990 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f6ee8009f90 tx=0x7f6ee801cc60 comp rx=0 tx=0).stop 2023-06-10T18:56:09.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.375+0000 7f6ef70ec640 1 -- 172.21.15.53:0/351966665 shutdown_connections 2023-06-10T18:56:09.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.375+0000 7f6ef70ec640 1 --2- 172.21.15.53:0/351966665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ed8005180 0x7f6ed800b990 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:09.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.375+0000 7f6ef70ec640 1 -- 172.21.15.53:0/351966665 >> 172.21.15.53:0/351966665 conn(0x7f6ef0069d70 msgr2=0x7f6ef006a170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:09.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.375+0000 7f6ef70ec640 1 -- 172.21.15.53:0/351966665 shutdown_connections 2023-06-10T18:56:09.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.375+0000 7f6ef70ec640 1 -- 172.21.15.53:0/351966665 wait complete. 2023-06-10T18:56:09.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.375+0000 7f6ef70ec640 1 Processor -- start 2023-06-10T18:56:09.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.375+0000 7f6ef70ec640 1 -- start start 2023-06-10T18:56:09.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.375+0000 7f6ef70ec640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ed8005180 0x7f6ef0155b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:09.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.375+0000 7f6ef70ec640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ef0157260 0x7f6ef014e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:09.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.375+0000 7f6ef70ec640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ef014ce20 0x7f6ef014d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:09.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.375+0000 7f6ef70ec640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef01547c0 con 0x7f6ed8005180 2023-06-10T18:56:09.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.375+0000 7f6ef70ec640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef014e5b0 con 0x7f6ef0157260 2023-06-10T18:56:09.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.375+0000 7f6ef70ec640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef01561c0 con 0x7f6ef014ce20 2023-06-10T18:56:09.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.375+0000 7f6ef4e88640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ed8005180 0x7f6ef0155b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:09.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.375+0000 7f6ef4e88640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ed8005180 0x7f6ef0155b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51298/0 (socket says 172.21.15.53:51298) 2023-06-10T18:56:09.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.375+0000 7f6ef4e88640 1 -- 172.21.15.53:0/1188913526 learned_addr learned my addr 172.21.15.53:0/1188913526 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:09.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.375+0000 7f6ee7fff640 1 --2- 172.21.15.53:0/1188913526 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ef0157260 0x7f6ef014e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:09.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.375+0000 7f6ef5689640 1 --2- 172.21.15.53:0/1188913526 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ef014ce20 0x7f6ef014d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:09.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.375+0000 7f6ef4e88640 1 -- 172.21.15.53:0/1188913526 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ef014ce20 msgr2=0x7f6ef014d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:09.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.375+0000 7f6ef4e88640 1 --2- 172.21.15.53:0/1188913526 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ef014ce20 0x7f6ef014d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:09.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.375+0000 7f6ef4e88640 1 -- 172.21.15.53:0/1188913526 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ef0157260 msgr2=0x7f6ef014e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:09.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.375+0000 7f6ef4e88640 1 --2- 172.21.15.53:0/1188913526 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ef0157260 0x7f6ef014e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:09.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.375+0000 7f6ef4e88640 1 -- 172.21.15.53:0/1188913526 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ef01564a0 con 0x7f6ed8005180 2023-06-10T18:56:09.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.375+0000 7f6ee7fff640 1 --2- 172.21.15.53:0/1188913526 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ef0157260 0x7f6ef014e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:56:09.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.375+0000 7f6ef4e88640 1 --2- 172.21.15.53:0/1188913526 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ed8005180 0x7f6ef0155b30 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f6eec00e7b0 tx=0x7f6eec00ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:09.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.375+0000 7f6ee57fa640 1 -- 172.21.15.53:0/1188913526 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eec00c6c0 con 0x7f6ed8005180 2023-06-10T18:56:09.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.375+0000 7f6ee57fa640 1 -- 172.21.15.53:0/1188913526 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eec00c860 con 0x7f6ed8005180 2023-06-10T18:56:09.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.375+0000 7f6ef70ec640 1 -- 172.21.15.53:0/1188913526 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ef0156780 con 0x7f6ed8005180 2023-06-10T18:56:09.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.375+0000 7f6ee57fa640 1 -- 172.21.15.53:0/1188913526 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eec00cc10 con 0x7f6ed8005180 2023-06-10T18:56:09.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.375+0000 7f6ef70ec640 1 -- 172.21.15.53:0/1188913526 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ef0156d40 con 0x7f6ed8005180 2023-06-10T18:56:09.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.379+0000 7f6ef70ec640 1 -- 172.21.15.53:0/1188913526 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ef004d790 con 0x7f6ed8005180 2023-06-10T18:56:09.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.379+0000 7f6ee57fa640 1 -- 172.21.15.53:0/1188913526 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6eec00cd70 con 0x7f6ed8005180 2023-06-10T18:56:09.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.379+0000 7f6ee57fa640 1 --2- 172.21.15.53:0/1188913526 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6edc0662b0 0x7f6edc068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:09.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.379+0000 7f6ee57fa640 1 -- 172.21.15.53:0/1188913526 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5739+0+0 (secure 0 0 0) 0x7f6eec083af0 con 0x7f6ed8005180 2023-06-10T18:56:09.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.379+0000 7f6ee7fff640 1 --2- 172.21.15.53:0/1188913526 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6edc0662b0 0x7f6edc068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:09.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.379+0000 7f6ee7fff640 1 --2- 172.21.15.53:0/1188913526 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6edc0662b0 0x7f6edc068760 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f6ef00c8280 tx=0x7f6ee0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:09.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.383+0000 7f6ee57fa640 1 -- 172.21.15.53:0/1188913526 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6eec0510b0 con 0x7f6ed8005180 2023-06-10T18:56:09.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:09.527+0000 7f6ef70ec640 1 -- 172.21.15.53:0/1188913526 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6ef00cfc10 con 0x7f6ed8005180 2023-06-10T18:56:10.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.207+0000 7f6ee57fa640 1 -- 172.21.15.53:0/1188913526 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v42) v1 ==== 169+0+0 (secure 0 0 0) 0x7f6eec0546d0 con 0x7f6ed8005180 2023-06-10T18:56:10.215 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_data' removed 2023-06-10T18:56:10.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.215+0000 7f6ef70ec640 1 -- 172.21.15.53:0/1188913526 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6edc0662b0 msgr2=0x7f6edc068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:10.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.215+0000 7f6ef70ec640 1 --2- 172.21.15.53:0/1188913526 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6edc0662b0 0x7f6edc068760 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f6ef00c8280 tx=0x7f6ee0009040 comp rx=0 tx=0).stop 2023-06-10T18:56:10.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.215+0000 7f6ef70ec640 1 -- 172.21.15.53:0/1188913526 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ed8005180 msgr2=0x7f6ef0155b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:10.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.215+0000 7f6ef70ec640 1 --2- 172.21.15.53:0/1188913526 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ed8005180 0x7f6ef0155b30 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f6eec00e7b0 tx=0x7f6eec00ebb0 comp rx=0 tx=0).stop 2023-06-10T18:56:10.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.215+0000 7f6ef70ec640 1 -- 172.21.15.53:0/1188913526 shutdown_connections 2023-06-10T18:56:10.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.215+0000 7f6ef70ec640 1 --2- 172.21.15.53:0/1188913526 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6edc0662b0 0x7f6edc068760 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:10.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.215+0000 7f6ef70ec640 1 --2- 172.21.15.53:0/1188913526 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ef014ce20 0x7f6ef014d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:10.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.215+0000 7f6ef70ec640 1 --2- 172.21.15.53:0/1188913526 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ef0157260 0x7f6ef014e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:10.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.215+0000 7f6ef70ec640 1 --2- 172.21.15.53:0/1188913526 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ed8005180 0x7f6ef0155b30 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:10.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.215+0000 7f6ef70ec640 1 -- 172.21.15.53:0/1188913526 >> 172.21.15.53:0/1188913526 conn(0x7f6ef0069d70 msgr2=0x7f6ef01582a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:10.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.215+0000 7f6ef70ec640 1 -- 172.21.15.53:0/1188913526 shutdown_connections 2023-06-10T18:56:10.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.215+0000 7f6ef70ec640 1 -- 172.21.15.53:0/1188913526 wait complete. 2023-06-10T18:56:10.245 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-06-10T18:56:10.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.363+0000 7fbb352a2640 1 Processor -- start 2023-06-10T18:56:10.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.363+0000 7fbb352a2640 1 -- start start 2023-06-10T18:56:10.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.363+0000 7fbb352a2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbb3015c070 0x7fbb3015c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:10.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.363+0000 7fbb352a2640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbb3006b800 0x7fbb3006bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:10.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.363+0000 7fbb352a2640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb3015ca00 con 0x7fbb30156180 2023-06-10T18:56:10.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.363+0000 7fbb352a2640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb3006b090 con 0x7fbb3006b800 2023-06-10T18:56:10.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.363+0000 7fbb352a2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb3006efa0 con 0x7fbb3015c070 2023-06-10T18:56:10.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.363+0000 7fbb2effd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fbb30156180 0x7fbb300cd4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41316/0 (socket says 172.21.15.53:41316) 2023-06-10T18:56:10.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.367+0000 7fbb2effd640 1 -- 172.21.15.53:0/1816266427 learned_addr learned my addr 172.21.15.53:0/1816266427 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:56:10.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.367+0000 7fbb2f7fe640 1 --2- 172.21.15.53:0/1816266427 >> v2:172.21.15.117:3300/0 conn(0x7fbb3006b800 0x7fbb3006bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:10.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.367+0000 7fbb2e7fc640 1 --2- 172.21.15.53:0/1816266427 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbb3015c070 0x7fbb3015c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:10.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.367+0000 7fbb2dffb640 1 -- 172.21.15.53:0/1816266427 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1385885121 0 0) 0x7fbb24001120 con 0x7fbb30156180 2023-06-10T18:56:10.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.367+0000 7fbb2dffb640 1 -- 172.21.15.53:0/1816266427 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb18003530 con 0x7fbb30156180 2023-06-10T18:56:10.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.367+0000 7fbb2dffb640 1 -- 172.21.15.53:0/1816266427 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4258648026 0 0) 0x7fbb18003530 con 0x7fbb30156180 2023-06-10T18:56:10.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.367+0000 7fbb2dffb640 1 -- 172.21.15.53:0/1816266427 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbb3015c070 msgr2=0x7fbb3015c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:10.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.367+0000 7fbb2dffb640 1 --2- 172.21.15.53:0/1816266427 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbb3015c070 0x7fbb3015c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:10.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.367+0000 7fbb2dffb640 1 -- 172.21.15.53:0/1816266427 >> v2:172.21.15.117:3300/0 conn(0x7fbb3006b800 msgr2=0x7fbb3006bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:10.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.367+0000 7fbb2dffb640 1 --2- 172.21.15.53:0/1816266427 >> v2:172.21.15.117:3300/0 conn(0x7fbb3006b800 0x7fbb3006bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:10.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.367+0000 7fbb2dffb640 1 -- 172.21.15.53:0/1816266427 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb300cc720 con 0x7fbb30156180 2023-06-10T18:56:10.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.367+0000 7fbb2dffb640 1 -- 172.21.15.53:0/1816266427 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fbb24001810 con 0x7fbb30156180 2023-06-10T18:56:10.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.367+0000 7fbb2dffb640 1 -- 172.21.15.53:0/1816266427 >> v1:172.21.15.53:6789/0 conn(0x7fbb30156180 legacy=0x7fbb300cd4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:10.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.367+0000 7fbb2dffb640 1 --2- 172.21.15.53:0/1816266427 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbb3015c070 0x7fbb18003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:10.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.367+0000 7fbb2dffb640 1 --2- 172.21.15.53:0/1816266427 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb18003f00 0x7fbb180047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:10.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.367+0000 7fbb2dffb640 1 --2- 172.21.15.53:0/1816266427 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb18004d10 0x7fbb18005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:10.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.367+0000 7fbb2dffb640 1 -- 172.21.15.53:0/1816266427 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb3006b090 con 0x7fbb18003f00 2023-06-10T18:56:10.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.367+0000 7fbb2dffb640 1 -- 172.21.15.53:0/1816266427 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb3006efa0 con 0x7fbb18004d10 2023-06-10T18:56:10.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.367+0000 7fbb2dffb640 1 -- 172.21.15.53:0/1816266427 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1800dba0 con 0x7fbb3015c070 2023-06-10T18:56:10.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.367+0000 7fbb2e7fc640 1 --2- 172.21.15.53:0/1816266427 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb18003f00 0x7fbb180047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:10.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.367+0000 7fbb2f7fe640 1 --2- 172.21.15.53:0/1816266427 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb18004d10 0x7fbb18005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:10.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.367+0000 7fbb2e7fc640 1 -- 172.21.15.53:0/1816266427 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbb3015c070 msgr2=0x7fbb18003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:10.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.367+0000 7fbb2e7fc640 1 --2- 172.21.15.53:0/1816266427 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbb3015c070 0x7fbb18003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:10.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.367+0000 7fbb2e7fc640 1 -- 172.21.15.53:0/1816266427 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb18004d10 msgr2=0x7fbb18005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:10.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.367+0000 7fbb2e7fc640 1 --2- 172.21.15.53:0/1816266427 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb18004d10 0x7fbb18005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:10.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.367+0000 7fbb2e7fc640 1 -- 172.21.15.53:0/1816266427 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb18003530 con 0x7fbb18003f00 2023-06-10T18:56:10.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.367+0000 7fbb2e7fc640 1 --2- 172.21.15.53:0/1816266427 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb18003f00 0x7fbb180047d0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fbb20009ae0 tx=0x7fbb2001ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d65889aa440d7724 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:10.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.367+0000 7fbb2dffb640 1 -- 172.21.15.53:0/1816266427 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb200a5680 con 0x7fbb18003f00 2023-06-10T18:56:10.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.367+0000 7fbb2dffb640 1 -- 172.21.15.53:0/1816266427 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb200a57e0 con 0x7fbb18003f00 2023-06-10T18:56:10.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.367+0000 7fbb2dffb640 1 -- 172.21.15.53:0/1816266427 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb200a5b90 con 0x7fbb18003f00 2023-06-10T18:56:10.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.367+0000 7fbb352a2640 1 -- 172.21.15.53:0/1816266427 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb18003f00 msgr2=0x7fbb180047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:10.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.367+0000 7fbb352a2640 1 --2- 172.21.15.53:0/1816266427 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb18003f00 0x7fbb180047d0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fbb20009ae0 tx=0x7fbb2001ca90 comp rx=0 tx=0).stop 2023-06-10T18:56:10.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.367+0000 7fbb2f7fe640 1 -- 172.21.15.53:0/1816266427 reap_dead start 2023-06-10T18:56:10.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.371+0000 7fbb352a2640 1 -- 172.21.15.53:0/1816266427 shutdown_connections 2023-06-10T18:56:10.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.371+0000 7fbb352a2640 1 -- 172.21.15.53:0/1816266427 >> 172.21.15.53:0/1816266427 conn(0x7fbb3006a0e0 msgr2=0x7fbb300cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:10.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.371+0000 7fbb352a2640 1 -- 172.21.15.53:0/1816266427 shutdown_connections 2023-06-10T18:56:10.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.371+0000 7fbb352a2640 1 -- 172.21.15.53:0/1816266427 wait complete. 2023-06-10T18:56:10.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.371+0000 7fbb352a2640 1 Processor -- start 2023-06-10T18:56:10.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.371+0000 7fbb352a2640 1 -- start start 2023-06-10T18:56:10.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.371+0000 7fbb352a2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb18003f00 0x7fbb30155250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:10.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.371+0000 7fbb352a2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb300b1150 0x7fbb300c1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:10.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.371+0000 7fbb352a2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbb30157630 0x7fbb30157aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:10.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.371+0000 7fbb352a2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb300b3250 con 0x7fbb300b1150 2023-06-10T18:56:10.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.371+0000 7fbb352a2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb30157fe0 con 0x7fbb18003f00 2023-06-10T18:56:10.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.371+0000 7fbb352a2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb30155790 con 0x7fbb30157630 2023-06-10T18:56:10.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.371+0000 7fbb2e7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb300b1150 0x7fbb300c1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:10.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.371+0000 7fbb2e7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb300b1150 0x7fbb300c1780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51320/0 (socket says 172.21.15.53:51320) 2023-06-10T18:56:10.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.371+0000 7fbb2e7fc640 1 -- 172.21.15.53:0/449476010 learned_addr learned my addr 172.21.15.53:0/449476010 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:10.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.371+0000 7fbb2f7fe640 1 --2- 172.21.15.53:0/449476010 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbb30157630 0x7fbb30157aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:10.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.371+0000 7fbb2effd640 1 --2- 172.21.15.53:0/449476010 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb18003f00 0x7fbb30155250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:10.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.371+0000 7fbb2e7fc640 1 -- 172.21.15.53:0/449476010 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbb30157630 msgr2=0x7fbb30157aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:10.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.371+0000 7fbb2e7fc640 1 --2- 172.21.15.53:0/449476010 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbb30157630 0x7fbb30157aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:10.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.371+0000 7fbb2e7fc640 1 -- 172.21.15.53:0/449476010 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb18003f00 msgr2=0x7fbb30155250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:10.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.371+0000 7fbb2e7fc640 1 --2- 172.21.15.53:0/449476010 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb18003f00 0x7fbb30155250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:10.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.371+0000 7fbb2e7fc640 1 -- 172.21.15.53:0/449476010 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb300c2080 con 0x7fbb300b1150 2023-06-10T18:56:10.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.371+0000 7fbb2f7fe640 1 --2- 172.21.15.53:0/449476010 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbb30157630 0x7fbb30157aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:56:10.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.371+0000 7fbb2effd640 1 --2- 172.21.15.53:0/449476010 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb18003f00 0x7fbb30155250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:56:10.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.371+0000 7fbb2e7fc640 1 --2- 172.21.15.53:0/449476010 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb300b1150 0x7fbb300c1780 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fbb20009ae0 tx=0x7fbb18005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:10.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.371+0000 7fbb177fe640 1 -- 172.21.15.53:0/449476010 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb20004230 con 0x7fbb300b1150 2023-06-10T18:56:10.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.371+0000 7fbb177fe640 1 -- 172.21.15.53:0/449476010 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb20004390 con 0x7fbb300b1150 2023-06-10T18:56:10.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.371+0000 7fbb177fe640 1 -- 172.21.15.53:0/449476010 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb20003820 con 0x7fbb300b1150 2023-06-10T18:56:10.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.371+0000 7fbb352a2640 1 -- 172.21.15.53:0/449476010 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb300c2360 con 0x7fbb300b1150 2023-06-10T18:56:10.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.371+0000 7fbb352a2640 1 -- 172.21.15.53:0/449476010 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb300c2e20 con 0x7fbb300b1150 2023-06-10T18:56:10.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.371+0000 7fbb352a2640 1 -- 172.21.15.53:0/449476010 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb3004d790 con 0x7fbb300b1150 2023-06-10T18:56:10.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.375+0000 7fbb177fe640 1 -- 172.21.15.53:0/449476010 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbb200b4040 con 0x7fbb300b1150 2023-06-10T18:56:10.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.375+0000 7fbb177fe640 1 --2- 172.21.15.53:0/449476010 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbb1c066280 0x7fbb1c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:10.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.375+0000 7fbb177fe640 1 -- 172.21.15.53:0/449476010 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fbb2011db40 con 0x7fbb300b1150 2023-06-10T18:56:10.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.375+0000 7fbb2effd640 1 --2- 172.21.15.53:0/449476010 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbb1c066280 0x7fbb1c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:10.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.375+0000 7fbb2effd640 1 --2- 172.21.15.53:0/449476010 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbb1c066280 0x7fbb1c068730 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fbb24001060 tx=0x7fbb2400c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:10.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.379+0000 7fbb177fe640 1 -- 172.21.15.53:0/449476010 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbb200eb350 con 0x7fbb300b1150 2023-06-10T18:56:10.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.543+0000 7fbb352a2640 1 -- 172.21.15.53:0/449476010 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fbb300cb4d0 con 0x7fbb300b1150 2023-06-10T18:56:10.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.551+0000 7fbb177fe640 1 -- 172.21.15.53:0/449476010 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fbb200ee970 con 0x7fbb300b1150 2023-06-10T18:56:10.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.555+0000 7fbb352a2640 1 -- 172.21.15.53:0/449476010 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbb1c066280 msgr2=0x7fbb1c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:10.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.555+0000 7fbb352a2640 1 --2- 172.21.15.53:0/449476010 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbb1c066280 0x7fbb1c068730 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fbb24001060 tx=0x7fbb2400c040 comp rx=0 tx=0).stop 2023-06-10T18:56:10.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.555+0000 7fbb352a2640 1 -- 172.21.15.53:0/449476010 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb300b1150 msgr2=0x7fbb300c1780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:10.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.555+0000 7fbb352a2640 1 --2- 172.21.15.53:0/449476010 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb300b1150 0x7fbb300c1780 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fbb20009ae0 tx=0x7fbb18005800 comp rx=0 tx=0).stop 2023-06-10T18:56:10.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.555+0000 7fbb352a2640 1 -- 172.21.15.53:0/449476010 shutdown_connections 2023-06-10T18:56:10.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.555+0000 7fbb352a2640 1 --2- 172.21.15.53:0/449476010 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbb1c066280 0x7fbb1c068730 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:10.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.555+0000 7fbb352a2640 1 --2- 172.21.15.53:0/449476010 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbb30157630 0x7fbb30157aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:10.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.555+0000 7fbb352a2640 1 --2- 172.21.15.53:0/449476010 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb300b1150 0x7fbb300c1780 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:10.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.555+0000 7fbb352a2640 1 --2- 172.21.15.53:0/449476010 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb18003f00 0x7fbb30155250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:10.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.555+0000 7fbb352a2640 1 -- 172.21.15.53:0/449476010 >> 172.21.15.53:0/449476010 conn(0x7fbb3006a0e0 msgr2=0x7fbb30159020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:10.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.555+0000 7fbb352a2640 1 -- 172.21.15.53:0/449476010 shutdown_connections 2023-06-10T18:56:10.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.555+0000 7fbb352a2640 1 -- 172.21.15.53:0/449476010 wait complete. 2023-06-10T18:56:10.577 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_abort_conn' 2023-06-10T18:56:10.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.699+0000 7f9fe4b87640 1 Processor -- start 2023-06-10T18:56:10.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.699+0000 7f9fe4b87640 1 -- start start 2023-06-10T18:56:10.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.699+0000 7f9fe4b87640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9fe00b3ac0 0x7f9fe00b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:10.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.699+0000 7f9fe4b87640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9fe00d14c0 0x7f9fe015fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:10.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.699+0000 7f9fe4b87640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fe00d0020 con 0x7f9fe00cc690 2023-06-10T18:56:10.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.699+0000 7f9fe4b87640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fe00b43d0 con 0x7f9fe00d14c0 2023-06-10T18:56:10.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.699+0000 7f9fe4b87640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe00cef40 con 0x7f9fe00b3ac0 2023-06-10T18:56:10.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.699+0000 7f9fddd9b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f9fe00cc690 0x7f9fe015f370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41328/0 (socket says 172.21.15.53:41328) 2023-06-10T18:56:10.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.699+0000 7f9fddd9b640 1 -- 172.21.15.53:0/909387753 learned_addr learned my addr 172.21.15.53:0/909387753 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:56:10.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.699+0000 7f9fde59c640 1 --2- 172.21.15.53:0/909387753 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9fe00b3ac0 0x7f9fe00b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:10.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.699+0000 7f9fded9d640 1 --2- 172.21.15.53:0/909387753 >> v2:172.21.15.117:3300/0 conn(0x7f9fe00d14c0 0x7f9fe015fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:10.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.699+0000 7f9fdd59a640 1 -- 172.21.15.53:0/909387753 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 341491028 0 0) 0x7f9fe00d0020 con 0x7f9fe00cc690 2023-06-10T18:56:10.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.699+0000 7f9fdd59a640 1 -- 172.21.15.53:0/909387753 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fc8003530 con 0x7f9fe00cc690 2023-06-10T18:56:10.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.699+0000 7f9fdd59a640 1 -- 172.21.15.53:0/909387753 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1715409423 0 0) 0x7f9fc8003530 con 0x7f9fe00cc690 2023-06-10T18:56:10.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.699+0000 7f9fdd59a640 1 -- 172.21.15.53:0/909387753 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9fe00b3ac0 msgr2=0x7f9fe00b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:10.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.699+0000 7f9fdd59a640 1 --2- 172.21.15.53:0/909387753 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9fe00b3ac0 0x7f9fe00b3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:10.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.699+0000 7f9fdd59a640 1 -- 172.21.15.53:0/909387753 >> v2:172.21.15.117:3300/0 conn(0x7f9fe00d14c0 msgr2=0x7f9fe015fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:10.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.699+0000 7f9fdd59a640 1 --2- 172.21.15.53:0/909387753 >> v2:172.21.15.117:3300/0 conn(0x7f9fe00d14c0 0x7f9fe015fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:10.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.699+0000 7f9fdd59a640 1 -- 172.21.15.53:0/909387753 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe00cf220 con 0x7f9fe00cc690 2023-06-10T18:56:10.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.699+0000 7f9fdd59a640 1 -- 172.21.15.53:0/909387753 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f9fd4001680 con 0x7f9fe00cc690 2023-06-10T18:56:10.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.699+0000 7f9fdd59a640 1 -- 172.21.15.53:0/909387753 >> v1:172.21.15.53:6789/0 conn(0x7f9fe00cc690 legacy=0x7f9fe015f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:10.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.699+0000 7f9fdd59a640 1 --2- 172.21.15.53:0/909387753 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9fc80039f0 0x7f9fc8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:10.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.699+0000 7f9fdd59a640 1 --2- 172.21.15.53:0/909387753 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9fc80047d0 0x7f9fc8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:10.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.699+0000 7f9fdd59a640 1 --2- 172.21.15.53:0/909387753 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9fe00b3ac0 0x7f9fc8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:10.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.699+0000 7f9fdd59a640 1 -- 172.21.15.53:0/909387753 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe00b43d0 con 0x7f9fc80047d0 2023-06-10T18:56:10.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.699+0000 7f9fdd59a640 1 -- 172.21.15.53:0/909387753 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe00cef40 con 0x7f9fc80039f0 2023-06-10T18:56:10.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.699+0000 7f9fdd59a640 1 -- 172.21.15.53:0/909387753 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc800b990 con 0x7f9fe00b3ac0 2023-06-10T18:56:10.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.699+0000 7f9fddd9b640 1 --2- 172.21.15.53:0/909387753 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9fc80047d0 0x7f9fc8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:10.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.699+0000 7f9fde59c640 1 --2- 172.21.15.53:0/909387753 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9fc80039f0 0x7f9fc8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:10.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.699+0000 7f9fded9d640 1 --2- 172.21.15.53:0/909387753 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9fe00b3ac0 0x7f9fc8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:10.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.699+0000 7f9fddd9b640 1 -- 172.21.15.53:0/909387753 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9fe00b3ac0 msgr2=0x7f9fc8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:10.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.699+0000 7f9fddd9b640 1 --2- 172.21.15.53:0/909387753 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9fe00b3ac0 0x7f9fc8005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:10.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.699+0000 7f9fddd9b640 1 -- 172.21.15.53:0/909387753 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9fc80039f0 msgr2=0x7f9fc8003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:10.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.699+0000 7f9fddd9b640 1 --2- 172.21.15.53:0/909387753 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9fc80039f0 0x7f9fc8003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:10.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.699+0000 7f9fddd9b640 1 -- 172.21.15.53:0/909387753 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fc8003530 con 0x7f9fc80047d0 2023-06-10T18:56:10.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.703+0000 7f9fddd9b640 1 --2- 172.21.15.53:0/909387753 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9fc80047d0 0x7f9fc8004c40 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f9fd400c240 tx=0x7f9fd401f3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29ffaabdf847434d server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:10.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.703+0000 7f9fdd59a640 1 -- 172.21.15.53:0/909387753 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd4005ae0 con 0x7f9fc80047d0 2023-06-10T18:56:10.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.703+0000 7f9fdd59a640 1 -- 172.21.15.53:0/909387753 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fd40ab070 con 0x7f9fc80047d0 2023-06-10T18:56:10.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.703+0000 7f9fdd59a640 1 -- 172.21.15.53:0/909387753 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd4005ea0 con 0x7f9fc80047d0 2023-06-10T18:56:10.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.703+0000 7f9fe4b87640 1 -- 172.21.15.53:0/909387753 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9fc80047d0 msgr2=0x7f9fc8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:10.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.703+0000 7f9fe4b87640 1 --2- 172.21.15.53:0/909387753 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9fc80047d0 0x7f9fc8004c40 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f9fd400c240 tx=0x7f9fd401f3d0 comp rx=0 tx=0).stop 2023-06-10T18:56:10.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.703+0000 7f9fded9d640 1 -- 172.21.15.53:0/909387753 reap_dead start 2023-06-10T18:56:10.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.703+0000 7f9fe4b87640 1 -- 172.21.15.53:0/909387753 shutdown_connections 2023-06-10T18:56:10.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.703+0000 7f9fe4b87640 1 -- 172.21.15.53:0/909387753 >> 172.21.15.53:0/909387753 conn(0x7f9fe0071790 msgr2=0x7f9fe0069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:10.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.703+0000 7f9fe4b87640 1 -- 172.21.15.53:0/909387753 shutdown_connections 2023-06-10T18:56:10.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.703+0000 7f9fe4b87640 1 -- 172.21.15.53:0/909387753 wait complete. 2023-06-10T18:56:10.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.707+0000 7f9fe4b87640 1 Processor -- start 2023-06-10T18:56:10.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.707+0000 7f9fe4b87640 1 -- start start 2023-06-10T18:56:10.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.707+0000 7f9fe4b87640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9fc80047d0 0x7f9fe015e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:10.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.707+0000 7f9fe4b87640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9fe014d6a0 0x7f9fe00caed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:10.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.707+0000 7f9fe4b87640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9fe00cb410 0x7f9fe00c6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:10.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.707+0000 7f9fe4b87640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe015e9a0 con 0x7f9fc80047d0 2023-06-10T18:56:10.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.707+0000 7f9fe4b87640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe00cb880 con 0x7f9fe00cb410 2023-06-10T18:56:10.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.707+0000 7f9fe4b87640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe015c9b0 con 0x7f9fe014d6a0 2023-06-10T18:56:10.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.707+0000 7f9fde59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9fc80047d0 0x7f9fe015e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:10.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.707+0000 7f9fde59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9fc80047d0 0x7f9fe015e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51332/0 (socket says 172.21.15.53:51332) 2023-06-10T18:56:10.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.707+0000 7f9fde59c640 1 -- 172.21.15.53:0/1132384847 learned_addr learned my addr 172.21.15.53:0/1132384847 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:10.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.707+0000 7f9fde59c640 1 -- 172.21.15.53:0/1132384847 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9fe014d6a0 msgr2=0x7f9fe00caed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:10.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.707+0000 7f9fded9d640 1 --2- 172.21.15.53:0/1132384847 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9fe00cb410 0x7f9fe00c6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:10.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.707+0000 7f9fde59c640 1 --2- 172.21.15.53:0/1132384847 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9fe014d6a0 0x7f9fe00caed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:10.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.707+0000 7f9fde59c640 1 -- 172.21.15.53:0/1132384847 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9fe00cb410 msgr2=0x7f9fe00c6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:10.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.707+0000 7f9fde59c640 1 --2- 172.21.15.53:0/1132384847 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9fe00cb410 0x7f9fe00c6530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:10.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.707+0000 7f9fde59c640 1 -- 172.21.15.53:0/1132384847 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe015cc50 con 0x7f9fc80047d0 2023-06-10T18:56:10.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.707+0000 7f9fde59c640 1 --2- 172.21.15.53:0/1132384847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9fc80047d0 0x7f9fe015e2a0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f9fd0009fb0 tx=0x7f9fd00115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:10.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.707+0000 7f9fceffd640 1 -- 172.21.15.53:0/1132384847 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd000e030 con 0x7f9fc80047d0 2023-06-10T18:56:10.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.707+0000 7f9fceffd640 1 -- 172.21.15.53:0/1132384847 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fd0016470 con 0x7f9fc80047d0 2023-06-10T18:56:10.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.707+0000 7f9fceffd640 1 -- 172.21.15.53:0/1132384847 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd0016820 con 0x7f9fc80047d0 2023-06-10T18:56:10.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.707+0000 7f9fe4b87640 1 -- 172.21.15.53:0/1132384847 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fe015cf30 con 0x7f9fc80047d0 2023-06-10T18:56:10.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.707+0000 7f9fe4b87640 1 -- 172.21.15.53:0/1132384847 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fe015d730 con 0x7f9fc80047d0 2023-06-10T18:56:10.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.707+0000 7f9fe4b87640 1 -- 172.21.15.53:0/1132384847 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fe004d790 con 0x7f9fc80047d0 2023-06-10T18:56:10.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.707+0000 7f9fceffd640 1 -- 172.21.15.53:0/1132384847 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9fd0016980 con 0x7f9fc80047d0 2023-06-10T18:56:10.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.711+0000 7f9fceffd640 1 --2- 172.21.15.53:0/1132384847 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9fc00662b0 0x7f9fc0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:10.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.711+0000 7f9fceffd640 1 -- 172.21.15.53:0/1132384847 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f9fd000f070 con 0x7f9fc80047d0 2023-06-10T18:56:10.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.711+0000 7f9fddd9b640 1 --2- 172.21.15.53:0/1132384847 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9fc00662b0 0x7f9fc0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:10.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.711+0000 7f9fddd9b640 1 --2- 172.21.15.53:0/1132384847 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9fc00662b0 0x7f9fc0068760 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9fd40ae000 tx=0x7f9fd4001a10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:10.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.715+0000 7f9fceffd640 1 -- 172.21.15.53:0/1132384847 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9fd0051fc0 con 0x7f9fc80047d0 2023-06-10T18:56:10.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:10.927+0000 7f9fe4b87640 1 -- 172.21.15.53:0/1132384847 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_abort_conn"]} v 0) v1 -- 0x7f9fe008a200 con 0x7f9fc80047d0 2023-06-10T18:56:11.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:11.235+0000 7f9fceffd640 1 -- 172.21.15.53:0/1132384847 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_abort_conn"]}]=0 v171) v1 ==== 147+0+0 (secure 0 0 0) 0x7f9fd00555e0 con 0x7f9fc80047d0 2023-06-10T18:56:11.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:11.235+0000 7f9fe4b87640 1 -- 172.21.15.53:0/1132384847 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9fc00662b0 msgr2=0x7f9fc0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:11.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:11.235+0000 7f9fe4b87640 1 --2- 172.21.15.53:0/1132384847 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9fc00662b0 0x7f9fc0068760 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9fd40ae000 tx=0x7f9fd4001a10 comp rx=0 tx=0).stop 2023-06-10T18:56:11.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:11.235+0000 7f9fe4b87640 1 -- 172.21.15.53:0/1132384847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9fc80047d0 msgr2=0x7f9fe015e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:11.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:11.235+0000 7f9fe4b87640 1 --2- 172.21.15.53:0/1132384847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9fc80047d0 0x7f9fe015e2a0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f9fd0009fb0 tx=0x7f9fd00115a0 comp rx=0 tx=0).stop 2023-06-10T18:56:11.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:11.235+0000 7f9fe4b87640 1 -- 172.21.15.53:0/1132384847 shutdown_connections 2023-06-10T18:56:11.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:11.235+0000 7f9fe4b87640 1 --2- 172.21.15.53:0/1132384847 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9fc00662b0 0x7f9fc0068760 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:11.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:11.235+0000 7f9fe4b87640 1 --2- 172.21.15.53:0/1132384847 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9fe00cb410 0x7f9fe00c6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:11.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:11.235+0000 7f9fe4b87640 1 --2- 172.21.15.53:0/1132384847 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9fe014d6a0 0x7f9fe00caed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:11.243 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:11.235+0000 7f9fe4b87640 1 --2- 172.21.15.53:0/1132384847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9fc80047d0 0x7f9fe015e2a0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:11.243 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:11.235+0000 7f9fe4b87640 1 -- 172.21.15.53:0/1132384847 >> 172.21.15.53:0/1132384847 conn(0x7f9fe0071790 msgr2=0x7f9fe00b25c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:11.243 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:11.235+0000 7f9fe4b87640 1 -- 172.21.15.53:0/1132384847 shutdown_connections 2023-06-10T18:56:11.243 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:11.235+0000 7f9fe4b87640 1 -- 172.21.15.53:0/1132384847 wait complete. 2023-06-10T18:56:11.264 INFO:tasks.cephfs_test_runner:test_abort_conn (tasks.cephfs.test_client_recovery.TestClientRecovery) ... ok 2023-06-10T18:56:11.264 INFO:tasks.cephfs_test_runner:Starting test: test_basic (tasks.cephfs.test_client_recovery.TestClientRecovery) 2023-06-10T18:56:11.265 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_basic' 2023-06-10T18:56:11.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:11.387+0000 7f89b0bb0640 1 Processor -- start 2023-06-10T18:56:11.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:11.387+0000 7f89b0bb0640 1 -- start start 2023-06-10T18:56:11.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:11.387+0000 7f89b0bb0640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f89ac0cec40 0x7f89ac0cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:11.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:11.387+0000 7f89b0bb0640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f89ac0cbf50 0x7f89ac0cc390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:11.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:11.387+0000 7f89b0bb0640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89ac0cbac0 con 0x7f89ac159450 2023-06-10T18:56:11.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:11.387+0000 7f89b0bb0640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89ac0cf600 con 0x7f89ac0cec40 2023-06-10T18:56:11.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:11.387+0000 7f89b0bb0640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89ac15dc00 con 0x7f89ac0cbf50 2023-06-10T18:56:11.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:11.387+0000 7f89aa59c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f89ac159450 0x7f89ac15d140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41340/0 (socket says 172.21.15.53:41340) 2023-06-10T18:56:11.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:11.387+0000 7f89a9d9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f89ac0cec40 0x7f89ac0cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:11.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:11.387+0000 7f89aa59c640 1 -- 172.21.15.53:0/1176746375 learned_addr learned my addr 172.21.15.53:0/1176746375 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:56:11.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:11.387+0000 7f89a9d9b640 1 -- 172.21.15.53:0/1176746375 >> v2:172.21.15.117:3300/0 conn(0x7f89ac0cbf50 msgr2=0x7f89ac0cc390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:11.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:11.387+0000 7f89aad9d640 1 --2- 172.21.15.53:0/1176746375 >> v2:172.21.15.117:3300/0 conn(0x7f89ac0cbf50 0x7f89ac0cc390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:11.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:11.387+0000 7f89a9d9b640 1 --2- 172.21.15.53:0/1176746375 >> v2:172.21.15.117:3300/0 conn(0x7f89ac0cbf50 0x7f89ac0cc390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:11.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:11.387+0000 7f89a9d9b640 1 -- 172.21.15.53:0/1176746375 >> v1:172.21.15.53:6789/0 conn(0x7f89ac159450 legacy=0x7f89ac15d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:11.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:11.387+0000 7f89a9d9b640 1 -- 172.21.15.53:0/1176746375 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89ac15dee0 con 0x7f89ac0cec40 2023-06-10T18:56:11.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:11.387+0000 7f89a959a640 1 -- 172.21.15.53:0/1176746375 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3281533983 0 0) 0x7f89ac0cbac0 con 0x7f89ac159450 2023-06-10T18:56:11.395 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:11.391+0000 7f89a9d9b640 1 --2- 172.21.15.53:0/1176746375 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89ac0cec40 0x7f89ac0cf0c0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f89ac0675f0 tx=0x7f89a001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e89e4be23eb649c server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:11.395 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:11.391+0000 7f89a959a640 1 -- 172.21.15.53:0/1176746375 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a00ab600 con 0x7f89ac0cec40 2023-06-10T18:56:11.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:11.391+0000 7f89a959a640 1 -- 172.21.15.53:0/1176746375 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89a00a7050 con 0x7f89ac0cec40 2023-06-10T18:56:11.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:11.391+0000 7f89a959a640 1 -- 172.21.15.53:0/1176746375 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a00ab980 con 0x7f89ac0cec40 2023-06-10T18:56:11.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:11.391+0000 7f89b0bb0640 1 -- 172.21.15.53:0/1176746375 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89ac0cec40 msgr2=0x7f89ac0cf0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:11.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:11.391+0000 7f89b0bb0640 1 --2- 172.21.15.53:0/1176746375 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89ac0cec40 0x7f89ac0cf0c0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f89ac0675f0 tx=0x7f89a001c430 comp rx=0 tx=0).stop 2023-06-10T18:56:11.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:11.391+0000 7f89b0bb0640 1 -- 172.21.15.53:0/1176746375 shutdown_connections 2023-06-10T18:56:11.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:11.391+0000 7f89b0bb0640 1 --2- 172.21.15.53:0/1176746375 >> v2:172.21.15.117:3300/0 conn(0x7f89ac0cbf50 0x7f89ac0cc390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:11.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:11.391+0000 7f89b0bb0640 1 --2- 172.21.15.53:0/1176746375 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89ac0cec40 0x7f89ac0cf0c0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:11.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:11.391+0000 7f89b0bb0640 1 -- 172.21.15.53:0/1176746375 >> 172.21.15.53:0/1176746375 conn(0x7f89ac06a090 msgr2=0x7f89ac06d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:11.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:11.391+0000 7f89b0bb0640 1 -- 172.21.15.53:0/1176746375 shutdown_connections 2023-06-10T18:56:11.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:11.391+0000 7f89b0bb0640 1 -- 172.21.15.53:0/1176746375 wait complete. 2023-06-10T18:56:11.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:11.391+0000 7f89b0bb0640 1 Processor -- start 2023-06-10T18:56:11.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:11.391+0000 7f89b0bb0640 1 -- start start 2023-06-10T18:56:11.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:11.395+0000 7f89b0bb0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89ac0cbf50 0x7f89ac15bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:11.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:11.395+0000 7f89b0bb0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89ac0cec40 0x7f89ac157a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:11.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:11.395+0000 7f89b0bb0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89ac159450 0x7f89ac157f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:11.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:11.395+0000 7f89b0bb0640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89ac0c7e10 con 0x7f89ac0cbf50 2023-06-10T18:56:11.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:11.395+0000 7f89b0bb0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89ac0c80f0 con 0x7f89ac159450 2023-06-10T18:56:11.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:11.395+0000 7f89b0bb0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89ac0c83d0 con 0x7f89ac0cec40 2023-06-10T18:56:11.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:11.395+0000 7f89aa59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89ac0cbf50 0x7f89ac15bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:11.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:11.395+0000 7f89aa59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89ac0cbf50 0x7f89ac15bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33472/0 (socket says 172.21.15.53:33472) 2023-06-10T18:56:11.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:11.395+0000 7f89aa59c640 1 -- 172.21.15.53:0/2674128003 learned_addr learned my addr 172.21.15.53:0/2674128003 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:11.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:11.395+0000 7f89a9d9b640 1 --2- 172.21.15.53:0/2674128003 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89ac0cec40 0x7f89ac157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:11.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:11.395+0000 7f89aad9d640 1 --2- 172.21.15.53:0/2674128003 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89ac159450 0x7f89ac157f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:11.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:11.395+0000 7f89aa59c640 1 -- 172.21.15.53:0/2674128003 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89ac0cec40 msgr2=0x7f89ac157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:11.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:11.395+0000 7f89aa59c640 1 --2- 172.21.15.53:0/2674128003 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89ac0cec40 0x7f89ac157a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:11.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:11.395+0000 7f89aa59c640 1 -- 172.21.15.53:0/2674128003 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89ac159450 msgr2=0x7f89ac157f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:11.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:11.395+0000 7f89aa59c640 1 --2- 172.21.15.53:0/2674128003 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89ac159450 0x7f89ac157f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:11.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:11.395+0000 7f89aa59c640 1 -- 172.21.15.53:0/2674128003 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a0009420 con 0x7f89ac0cbf50 2023-06-10T18:56:11.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:11.395+0000 7f89a9d9b640 1 --2- 172.21.15.53:0/2674128003 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89ac0cec40 0x7f89ac157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:56:11.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:11.395+0000 7f89aa59c640 1 --2- 172.21.15.53:0/2674128003 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89ac0cbf50 0x7f89ac15bc50 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f899c0011f0 tx=0x7f899c00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:11.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:11.395+0000 7f899affd640 1 -- 172.21.15.53:0/2674128003 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f899c0074e0 con 0x7f89ac0cbf50 2023-06-10T18:56:11.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:11.395+0000 7f899affd640 1 -- 172.21.15.53:0/2674128003 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f899c007640 con 0x7f89ac0cbf50 2023-06-10T18:56:11.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:11.395+0000 7f89b0bb0640 1 -- 172.21.15.53:0/2674128003 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89ac15d9d0 con 0x7f89ac0cbf50 2023-06-10T18:56:11.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:11.395+0000 7f899affd640 1 -- 172.21.15.53:0/2674128003 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f899c004a10 con 0x7f89ac0cbf50 2023-06-10T18:56:11.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:11.395+0000 7f89b0bb0640 1 -- 172.21.15.53:0/2674128003 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89ac0c8990 con 0x7f89ac0cbf50 2023-06-10T18:56:11.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:11.395+0000 7f89b0bb0640 1 -- 172.21.15.53:0/2674128003 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89ac0c8b80 con 0x7f89ac0cbf50 2023-06-10T18:56:11.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:11.395+0000 7f899affd640 1 -- 172.21.15.53:0/2674128003 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f899c004b70 con 0x7f89ac0cbf50 2023-06-10T18:56:11.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:11.395+0000 7f899affd640 1 --2- 172.21.15.53:0/2674128003 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f898c066280 0x7f898c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:11.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:11.395+0000 7f899affd640 1 -- 172.21.15.53:0/2674128003 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f899c082f90 con 0x7f89ac0cbf50 2023-06-10T18:56:11.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:11.395+0000 7f89a9d9b640 1 --2- 172.21.15.53:0/2674128003 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f898c066280 0x7f898c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:11.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:11.399+0000 7f89a9d9b640 1 --2- 172.21.15.53:0/2674128003 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f898c066280 0x7f898c068730 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f89ac0b29a0 tx=0x7f89a0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:11.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:11.399+0000 7f899affd640 1 -- 172.21.15.53:0/2674128003 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f899c0b3700 con 0x7f89ac0cbf50 2023-06-10T18:56:11.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:11.619+0000 7f89b0bb0640 1 -- 172.21.15.53:0/2674128003 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_basic"]} v 0) v1 -- 0x7f89ac04d790 con 0x7f89ac0cbf50 2023-06-10T18:56:12.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.243+0000 7f899affd640 1 -- 172.21.15.53:0/2674128003 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_basic"]}]=0 v172) v1 ==== 145+0+0 (secure 0 0 0) 0x7f899c0180d0 con 0x7f89ac0cbf50 2023-06-10T18:56:12.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.247+0000 7f89b0bb0640 1 -- 172.21.15.53:0/2674128003 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f898c066280 msgr2=0x7f898c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:12.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.247+0000 7f89b0bb0640 1 --2- 172.21.15.53:0/2674128003 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f898c066280 0x7f898c068730 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f89ac0b29a0 tx=0x7f89a0008040 comp rx=0 tx=0).stop 2023-06-10T18:56:12.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.247+0000 7f89b0bb0640 1 -- 172.21.15.53:0/2674128003 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89ac0cbf50 msgr2=0x7f89ac15bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:12.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.247+0000 7f89b0bb0640 1 --2- 172.21.15.53:0/2674128003 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89ac0cbf50 0x7f89ac15bc50 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f899c0011f0 tx=0x7f899c00c9b0 comp rx=0 tx=0).stop 2023-06-10T18:56:12.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.247+0000 7f89b0bb0640 1 -- 172.21.15.53:0/2674128003 shutdown_connections 2023-06-10T18:56:12.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.247+0000 7f89b0bb0640 1 --2- 172.21.15.53:0/2674128003 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f898c066280 0x7f898c068730 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:12.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.247+0000 7f89b0bb0640 1 --2- 172.21.15.53:0/2674128003 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89ac159450 0x7f89ac157f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:12.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.247+0000 7f89b0bb0640 1 --2- 172.21.15.53:0/2674128003 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89ac0cec40 0x7f89ac157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:12.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.247+0000 7f89b0bb0640 1 --2- 172.21.15.53:0/2674128003 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89ac0cbf50 0x7f89ac15bc50 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:12.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.247+0000 7f89b0bb0640 1 -- 172.21.15.53:0/2674128003 >> 172.21.15.53:0/2674128003 conn(0x7f89ac06a090 msgr2=0x7f89ac0b2c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:12.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.247+0000 7f89b0bb0640 1 -- 172.21.15.53:0/2674128003 shutdown_connections 2023-06-10T18:56:12.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.247+0000 7f89b0bb0640 1 -- 172.21.15.53:0/2674128003 wait complete. 2023-06-10T18:56:12.275 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-06-10T18:56:12.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.403+0000 7f649c0d4640 1 Processor -- start 2023-06-10T18:56:12.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.403+0000 7f649c0d4640 1 -- start start 2023-06-10T18:56:12.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.403+0000 7f649c0d4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f649415c090 0x7f64940b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:12.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.403+0000 7f649c0d4640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f64940b7e30 0x7f64940d04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:12.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.403+0000 7f649c0d4640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64940cc7c0 con 0x7f64940b0b90 2023-06-10T18:56:12.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.403+0000 7f649c0d4640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64940ccaa0 con 0x7f64940b7e30 2023-06-10T18:56:12.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.403+0000 7f649c0d4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64940ccd80 con 0x7f649415c090 2023-06-10T18:56:12.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.403+0000 7f649a671640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f64940b7e30 0x7f64940d04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:12.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.403+0000 7f649966f640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f64940b0b90 0x7f64940b7720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41350/0 (socket says 172.21.15.53:41350) 2023-06-10T18:56:12.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.403+0000 7f649966f640 1 -- 172.21.15.53:0/3747270854 learned_addr learned my addr 172.21.15.53:0/3747270854 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:56:12.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.403+0000 7f6499e70640 1 --2- 172.21.15.53:0/3747270854 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f649415c090 0x7f64940b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:12.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.403+0000 7f649a671640 1 -- 172.21.15.53:0/3747270854 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f649415c090 msgr2=0x7f64940b10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:12.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.403+0000 7f649a671640 1 --2- 172.21.15.53:0/3747270854 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f649415c090 0x7f64940b10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:12.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.403+0000 7f649a671640 1 -- 172.21.15.53:0/3747270854 >> v1:172.21.15.53:6789/0 conn(0x7f64940b0b90 legacy=0x7f64940b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:12.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.403+0000 7f6498e6e640 1 -- 172.21.15.53:0/3747270854 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3106519463 0 0) 0x7f64940cc7c0 con 0x7f64940b0b90 2023-06-10T18:56:12.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.403+0000 7f649a671640 1 -- 172.21.15.53:0/3747270854 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64940cd060 con 0x7f64940b7e30 2023-06-10T18:56:12.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.407+0000 7f649a671640 1 --2- 172.21.15.53:0/3747270854 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64940b7e30 0x7f64940d04d0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f64900097c0 tx=0x7f649001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51710fa465b1d23 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:12.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.407+0000 7f6498e6e640 1 -- 172.21.15.53:0/3747270854 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64900ab600 con 0x7f64940b7e30 2023-06-10T18:56:12.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.407+0000 7f6498e6e640 1 -- 172.21.15.53:0/3747270854 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64900a7050 con 0x7f64940b7e30 2023-06-10T18:56:12.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.407+0000 7f6498e6e640 1 -- 172.21.15.53:0/3747270854 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64900ab980 con 0x7f64940b7e30 2023-06-10T18:56:12.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.407+0000 7f649c0d4640 1 -- 172.21.15.53:0/3747270854 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64940b7e30 msgr2=0x7f64940d04d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:12.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.407+0000 7f649c0d4640 1 --2- 172.21.15.53:0/3747270854 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64940b7e30 0x7f64940d04d0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f64900097c0 tx=0x7f649001c3c0 comp rx=0 tx=0).stop 2023-06-10T18:56:12.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.407+0000 7f649c0d4640 1 -- 172.21.15.53:0/3747270854 shutdown_connections 2023-06-10T18:56:12.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.407+0000 7f649c0d4640 1 --2- 172.21.15.53:0/3747270854 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64940b7e30 0x7f64940d04d0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:12.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.407+0000 7f649c0d4640 1 --2- 172.21.15.53:0/3747270854 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f649415c090 0x7f64940b10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:12.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.407+0000 7f649c0d4640 1 -- 172.21.15.53:0/3747270854 >> 172.21.15.53:0/3747270854 conn(0x7f6494069e20 msgr2=0x7f649406a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:12.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.407+0000 7f649c0d4640 1 -- 172.21.15.53:0/3747270854 shutdown_connections 2023-06-10T18:56:12.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.407+0000 7f649c0d4640 1 -- 172.21.15.53:0/3747270854 wait complete. 2023-06-10T18:56:12.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.407+0000 7f649c0d4640 1 Processor -- start 2023-06-10T18:56:12.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.407+0000 7f649c0d4640 1 -- start start 2023-06-10T18:56:12.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.407+0000 7f649c0d4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64940b0b90 0x7f649415efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:12.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.407+0000 7f649c0d4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64940b7e30 0x7f64940c3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:12.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.407+0000 7f649c0d4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f649415c090 0x7f64940c4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:12.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.407+0000 7f649c0d4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64940c5480 con 0x7f64940b0b90 2023-06-10T18:56:12.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.407+0000 7f649c0d4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64940c3940 con 0x7f649415c090 2023-06-10T18:56:12.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.407+0000 7f649c0d4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64940c3c20 con 0x7f64940b7e30 2023-06-10T18:56:12.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.411+0000 7f6499e70640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64940b0b90 0x7f649415efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:12.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.411+0000 7f6499e70640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64940b0b90 0x7f649415efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33494/0 (socket says 172.21.15.53:33494) 2023-06-10T18:56:12.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.411+0000 7f6499e70640 1 -- 172.21.15.53:0/262891510 learned_addr learned my addr 172.21.15.53:0/262891510 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:12.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.411+0000 7f649966f640 1 --2- 172.21.15.53:0/262891510 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64940b7e30 0x7f64940c3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:12.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.411+0000 7f649a671640 1 --2- 172.21.15.53:0/262891510 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f649415c090 0x7f64940c4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:12.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.411+0000 7f6499e70640 1 -- 172.21.15.53:0/262891510 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64940b7e30 msgr2=0x7f64940c3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:12.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.411+0000 7f6499e70640 1 --2- 172.21.15.53:0/262891510 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64940b7e30 0x7f64940c3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:12.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.411+0000 7f6499e70640 1 -- 172.21.15.53:0/262891510 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f649415c090 msgr2=0x7f64940c4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:12.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.411+0000 7f6499e70640 1 --2- 172.21.15.53:0/262891510 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f649415c090 0x7f64940c4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:12.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.411+0000 7f6499e70640 1 -- 172.21.15.53:0/262891510 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6490009420 con 0x7f64940b0b90 2023-06-10T18:56:12.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.411+0000 7f649966f640 1 --2- 172.21.15.53:0/262891510 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64940b7e30 0x7f64940c3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:56:12.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.411+0000 7f6499e70640 1 --2- 172.21.15.53:0/262891510 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64940b0b90 0x7f649415efa0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f648c007e40 tx=0x7f648c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:12.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.411+0000 7f648a7fc640 1 -- 172.21.15.53:0/262891510 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648c014620 con 0x7f64940b0b90 2023-06-10T18:56:12.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.411+0000 7f648a7fc640 1 -- 172.21.15.53:0/262891510 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f648c00ee90 con 0x7f64940b0b90 2023-06-10T18:56:12.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.411+0000 7f649c0d4640 1 -- 172.21.15.53:0/262891510 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64940c3f00 con 0x7f64940b0b90 2023-06-10T18:56:12.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.411+0000 7f648a7fc640 1 -- 172.21.15.53:0/262891510 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648c0149c0 con 0x7f64940b0b90 2023-06-10T18:56:12.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.411+0000 7f649c0d4640 1 -- 172.21.15.53:0/262891510 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64940c44c0 con 0x7f64940b0b90 2023-06-10T18:56:12.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.411+0000 7f649c0d4640 1 -- 172.21.15.53:0/262891510 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f649404d790 con 0x7f64940b0b90 2023-06-10T18:56:12.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.411+0000 7f648a7fc640 1 -- 172.21.15.53:0/262891510 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f648c014b20 con 0x7f64940b0b90 2023-06-10T18:56:12.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.411+0000 7f648a7fc640 1 --2- 172.21.15.53:0/262891510 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6478066280 0x7f6478068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:12.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.411+0000 7f648a7fc640 1 -- 172.21.15.53:0/262891510 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f648c0843f0 con 0x7f64940b0b90 2023-06-10T18:56:12.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.411+0000 7f649966f640 1 --2- 172.21.15.53:0/262891510 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6478066280 0x7f6478068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:12.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.411+0000 7f649966f640 1 --2- 172.21.15.53:0/262891510 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6478066280 0x7f6478068730 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f64941561d0 tx=0x7f6484009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:12.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.415+0000 7f648a7fc640 1 -- 172.21.15.53:0/262891510 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f648c051af0 con 0x7f64940b0b90 2023-06-10T18:56:12.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.571+0000 7f649c0d4640 1 -- 172.21.15.53:0/262891510 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f64940b72f0 con 0x7f64940b0b90 2023-06-10T18:56:12.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.579+0000 7f648a7fc640 1 -- 172.21.15.53:0/262891510 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f648c082e60 con 0x7f64940b0b90 2023-06-10T18:56:12.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.579+0000 7f649c0d4640 1 -- 172.21.15.53:0/262891510 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6478066280 msgr2=0x7f6478068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:12.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.579+0000 7f649c0d4640 1 --2- 172.21.15.53:0/262891510 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6478066280 0x7f6478068730 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f64941561d0 tx=0x7f6484009040 comp rx=0 tx=0).stop 2023-06-10T18:56:12.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.579+0000 7f649c0d4640 1 -- 172.21.15.53:0/262891510 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64940b0b90 msgr2=0x7f649415efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:12.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.579+0000 7f649c0d4640 1 --2- 172.21.15.53:0/262891510 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64940b0b90 0x7f649415efa0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f648c007e40 tx=0x7f648c00e4b0 comp rx=0 tx=0).stop 2023-06-10T18:56:12.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.579+0000 7f649c0d4640 1 -- 172.21.15.53:0/262891510 shutdown_connections 2023-06-10T18:56:12.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.579+0000 7f649c0d4640 1 --2- 172.21.15.53:0/262891510 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6478066280 0x7f6478068730 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:12.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.579+0000 7f649c0d4640 1 --2- 172.21.15.53:0/262891510 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f649415c090 0x7f64940c4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:12.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.579+0000 7f649c0d4640 1 --2- 172.21.15.53:0/262891510 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64940b7e30 0x7f64940c3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:12.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.579+0000 7f649c0d4640 1 --2- 172.21.15.53:0/262891510 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64940b0b90 0x7f649415efa0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:12.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.579+0000 7f649c0d4640 1 -- 172.21.15.53:0/262891510 >> 172.21.15.53:0/262891510 conn(0x7f6494069e20 msgr2=0x7f64940ce8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:12.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.583+0000 7f649c0d4640 1 -- 172.21.15.53:0/262891510 shutdown_connections 2023-06-10T18:56:12.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.583+0000 7f649c0d4640 1 -- 172.21.15.53:0/262891510 wait complete. 2023-06-10T18:56:12.603 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-06-10T18:56:12.603 DEBUG:teuthology.orchestra.run.smithi053:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-06-10T18:56:12.667 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-06-10T18:56:12.715 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-06-10T18:56:12.716 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T18:56:12.716 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T18:56:12.722 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16345192k,nr_inodes=4086298,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276544k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=407 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276540k,nr_inodes=819135,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276544k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-06-10T18:56:12.722 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T18:56:12.723 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T18:56:12.763 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16342088k,nr_inodes=4085522,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275924k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18845 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275920k,nr_inodes=818980,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275924k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-06-10T18:56:12.764 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T18:56:12.765 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T18:56:12.771 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16345192k,nr_inodes=4086298,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276544k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=407 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276540k,nr_inodes=819135,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276544k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-06-10T18:56:12.771 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T18:56:12.771 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T18:56:12.810 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16342088k,nr_inodes=4085522,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275924k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18845 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275920k,nr_inodes=818980,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275924k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-06-10T18:56:12.810 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-06-10T18:56:12.811 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T18:56:12.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.943+0000 7fd175b19640 1 Processor -- start 2023-06-10T18:56:12.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.943+0000 7fd175b19640 1 -- start start 2023-06-10T18:56:12.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.943+0000 7fd175b19640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd1700ccae0 0x7fd1700d0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:12.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.943+0000 7fd175b19640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1700d0020 con 0x7fd1700b3ac0 2023-06-10T18:56:12.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.943+0000 7fd175b19640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1700cef40 con 0x7fd1700cc690 2023-06-10T18:56:12.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.943+0000 7fd175b19640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1700cf220 con 0x7fd1700ccae0 2023-06-10T18:56:12.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.943+0000 7fd16f7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fd1700b3ac0 0x7fd1700b3e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41362/0 (socket says 172.21.15.53:41362) 2023-06-10T18:56:12.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.943+0000 7fd16f7fe640 1 -- 172.21.15.53:0/1974075598 learned_addr learned my addr 172.21.15.53:0/1974075598 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:56:12.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.943+0000 7fd16ffff640 1 --2- 172.21.15.53:0/1974075598 >> v2:172.21.15.53:3300/0 conn(0x7fd1700ccae0 0x7fd1700d0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:12.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.943+0000 7fd16ffff640 1 -- 172.21.15.53:0/1974075598 >> v1:172.21.15.117:6789/0 conn(0x7fd1700cc690 legacy=0x7fd1700d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:12.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.943+0000 7fd16ffff640 1 -- 172.21.15.53:0/1974075598 >> v1:172.21.15.53:6789/0 conn(0x7fd1700b3ac0 legacy=0x7fd1700b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:12.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.943+0000 7fd16effd640 1 -- 172.21.15.53:0/1974075598 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3300282654 0 0) 0x7fd1700d0020 con 0x7fd1700b3ac0 2023-06-10T18:56:12.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.943+0000 7fd16ffff640 1 -- 172.21.15.53:0/1974075598 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1700cf500 con 0x7fd1700ccae0 2023-06-10T18:56:12.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.947+0000 7fd16ffff640 1 --2- 172.21.15.53:0/1974075598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1700ccae0 0x7fd1700d0bc0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fd168009d90 tx=0x7fd16801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a91ac9dc970ce9e3 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:12.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.947+0000 7fd16effd640 1 -- 172.21.15.53:0/1974075598 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1680a59c0 con 0x7fd1700ccae0 2023-06-10T18:56:12.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.947+0000 7fd16effd640 1 -- 172.21.15.53:0/1974075598 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1680a5b20 con 0x7fd1700ccae0 2023-06-10T18:56:12.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.947+0000 7fd16effd640 1 -- 172.21.15.53:0/1974075598 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1680ad440 con 0x7fd1700ccae0 2023-06-10T18:56:12.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.947+0000 7fd175b19640 1 -- 172.21.15.53:0/1974075598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1700ccae0 msgr2=0x7fd1700d0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:12.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.947+0000 7fd175b19640 1 --2- 172.21.15.53:0/1974075598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1700ccae0 0x7fd1700d0bc0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fd168009d90 tx=0x7fd16801c8e0 comp rx=0 tx=0).stop 2023-06-10T18:56:12.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.947+0000 7fd175b19640 1 -- 172.21.15.53:0/1974075598 shutdown_connections 2023-06-10T18:56:12.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.947+0000 7fd175b19640 1 --2- 172.21.15.53:0/1974075598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1700ccae0 0x7fd1700d0bc0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:12.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.947+0000 7fd175b19640 1 -- 172.21.15.53:0/1974075598 >> 172.21.15.53:0/1974075598 conn(0x7fd170071790 msgr2=0x7fd170069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:12.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.947+0000 7fd175b19640 1 -- 172.21.15.53:0/1974075598 shutdown_connections 2023-06-10T18:56:12.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.947+0000 7fd175b19640 1 -- 172.21.15.53:0/1974075598 wait complete. 2023-06-10T18:56:12.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.947+0000 7fd175b19640 1 Processor -- start 2023-06-10T18:56:12.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.947+0000 7fd175b19640 1 -- start start 2023-06-10T18:56:12.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.947+0000 7fd175b19640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1700b3ac0 0x7fd170157210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:12.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.947+0000 7fd175b19640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd1700cc690 0x7fd1700c6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:12.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.947+0000 7fd175b19640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd1700ccae0 0x7fd17015d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:12.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.947+0000 7fd175b19640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1701417d0 con 0x7fd1700b3ac0 2023-06-10T18:56:12.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.947+0000 7fd175b19640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd17015ed00 con 0x7fd1700cc690 2023-06-10T18:56:12.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.947+0000 7fd175b19640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd17015dda0 con 0x7fd1700ccae0 2023-06-10T18:56:12.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.947+0000 7fd16f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1700b3ac0 0x7fd170157210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:12.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.947+0000 7fd16f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1700b3ac0 0x7fd170157210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33518/0 (socket says 172.21.15.53:33518) 2023-06-10T18:56:12.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.947+0000 7fd16f7fe640 1 -- 172.21.15.53:0/3701620684 learned_addr learned my addr 172.21.15.53:0/3701620684 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:12.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.947+0000 7fd167fff640 1 --2- 172.21.15.53:0/3701620684 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd1700cc690 0x7fd1700c6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:12.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.947+0000 7fd16ffff640 1 --2- 172.21.15.53:0/3701620684 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd1700ccae0 0x7fd17015d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:12.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.947+0000 7fd16f7fe640 1 -- 172.21.15.53:0/3701620684 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd1700ccae0 msgr2=0x7fd17015d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:12.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.947+0000 7fd16f7fe640 1 --2- 172.21.15.53:0/3701620684 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd1700ccae0 0x7fd17015d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:12.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.947+0000 7fd16f7fe640 1 -- 172.21.15.53:0/3701620684 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd1700cc690 msgr2=0x7fd1700c6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:12.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.947+0000 7fd16f7fe640 1 --2- 172.21.15.53:0/3701620684 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd1700cc690 0x7fd1700c6f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:12.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.947+0000 7fd16f7fe640 1 -- 172.21.15.53:0/3701620684 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd168009a70 con 0x7fd1700b3ac0 2023-06-10T18:56:12.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.947+0000 7fd16f7fe640 1 --2- 172.21.15.53:0/3701620684 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1700b3ac0 0x7fd170157210 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fd1600011f0 tx=0x7fd16000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:12.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.947+0000 7fd16cff9640 1 -- 172.21.15.53:0/3701620684 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1600074e0 con 0x7fd1700b3ac0 2023-06-10T18:56:12.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.951+0000 7fd16cff9640 1 -- 172.21.15.53:0/3701620684 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd160007640 con 0x7fd1700b3ac0 2023-06-10T18:56:12.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.951+0000 7fd175b19640 1 -- 172.21.15.53:0/3701620684 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd170140be0 con 0x7fd1700b3ac0 2023-06-10T18:56:12.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.951+0000 7fd16cff9640 1 -- 172.21.15.53:0/3701620684 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd160004a10 con 0x7fd1700b3ac0 2023-06-10T18:56:12.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.951+0000 7fd175b19640 1 -- 172.21.15.53:0/3701620684 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd170141110 con 0x7fd1700b3ac0 2023-06-10T18:56:12.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.951+0000 7fd175b19640 1 -- 172.21.15.53:0/3701620684 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd17004d790 con 0x7fd1700b3ac0 2023-06-10T18:56:12.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.951+0000 7fd16cff9640 1 -- 172.21.15.53:0/3701620684 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd160004b70 con 0x7fd1700b3ac0 2023-06-10T18:56:12.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.951+0000 7fd16cff9640 1 --2- 172.21.15.53:0/3701620684 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd150066280 0x7fd150068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:12.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.951+0000 7fd16cff9640 1 -- 172.21.15.53:0/3701620684 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fd160082ed0 con 0x7fd1700b3ac0 2023-06-10T18:56:12.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.951+0000 7fd167fff640 1 --2- 172.21.15.53:0/3701620684 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd150066280 0x7fd150068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:12.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.951+0000 7fd167fff640 1 --2- 172.21.15.53:0/3701620684 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd150066280 0x7fd150068730 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fd1700b3850 tx=0x7fd158009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:12.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:12.955+0000 7fd16cff9640 1 -- 172.21.15.53:0/3701620684 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd1600506e0 con 0x7fd1700b3ac0 2023-06-10T18:56:13.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:13.143+0000 7fd175b19640 1 -- 172.21.15.53:0/3701620684 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd170072a60 con 0x7fd1700b3ac0 2023-06-10T18:56:13.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:13.143+0000 7fd16cff9640 1 -- 172.21.15.53:0/3701620684 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+3535 (secure 0 0 0) 0x7fd160018090 con 0x7fd1700b3ac0 2023-06-10T18:56:13.148 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:56:13.149 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":15,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4853,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/4087456763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":4087456763},{"type":"v1","addr":"172.21.15.117:6835","nonce":4087456763}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5071,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1065941624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1065941624},{"type":"v1","addr":"172.21.15.117:6837","nonce":1065941624}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5322,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/4137796077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":4137796077},{"type":"v1","addr":"172.21.15.53:6833","nonce":4137796077}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5859,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/1635061618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":1635061618},{"type":"v1","addr":"172.21.15.53:6835","nonce":1635061618}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[]} 2023-06-10T18:56:13.149 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 15 2023-06-10T18:56:13.150 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:13.147+0000 7fd175b19640 1 -- 172.21.15.53:0/3701620684 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd150066280 msgr2=0x7fd150068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:13.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:13.147+0000 7fd175b19640 1 --2- 172.21.15.53:0/3701620684 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd150066280 0x7fd150068730 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fd1700b3850 tx=0x7fd158009040 comp rx=0 tx=0).stop 2023-06-10T18:56:13.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:13.147+0000 7fd175b19640 1 -- 172.21.15.53:0/3701620684 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1700b3ac0 msgr2=0x7fd170157210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:13.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:13.147+0000 7fd175b19640 1 --2- 172.21.15.53:0/3701620684 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1700b3ac0 0x7fd170157210 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fd1600011f0 tx=0x7fd16000c9b0 comp rx=0 tx=0).stop 2023-06-10T18:56:13.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:13.147+0000 7fd175b19640 1 -- 172.21.15.53:0/3701620684 shutdown_connections 2023-06-10T18:56:13.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:13.147+0000 7fd175b19640 1 --2- 172.21.15.53:0/3701620684 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd150066280 0x7fd150068730 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:13.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:13.147+0000 7fd175b19640 1 --2- 172.21.15.53:0/3701620684 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd1700ccae0 0x7fd17015d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:13.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:13.147+0000 7fd175b19640 1 --2- 172.21.15.53:0/3701620684 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd1700cc690 0x7fd1700c6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:13.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:13.147+0000 7fd175b19640 1 --2- 172.21.15.53:0/3701620684 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1700b3ac0 0x7fd170157210 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:13.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:13.147+0000 7fd175b19640 1 -- 172.21.15.53:0/3701620684 >> 172.21.15.53:0/3701620684 conn(0x7fd170071790 msgr2=0x7fd1700cbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:13.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:13.147+0000 7fd175b19640 1 -- 172.21.15.53:0/3701620684 shutdown_connections 2023-06-10T18:56:13.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:13.147+0000 7fd175b19640 1 -- 172.21.15.53:0/3701620684 wait complete. 2023-06-10T18:56:13.168 INFO:tasks.ceph.mds.a:Restarting daemon 2023-06-10T18:56:13.168 INFO:tasks.ceph.mds.a:Stopping old one... 2023-06-10T18:56:13.168 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-06-10T18:56:13.168 INFO:teuthology.orchestra.run:waiting for 300 2023-06-10T18:56:13.169 INFO:tasks.ceph.mds.c:Restarting daemon 2023-06-10T18:56:13.169 INFO:tasks.ceph.mds.c:Stopping old one... 2023-06-10T18:56:13.169 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-06-10T18:56:13.169 INFO:teuthology.orchestra.run:waiting for 300 2023-06-10T18:56:13.170 INFO:tasks.ceph.mds.b:Restarting daemon 2023-06-10T18:56:13.170 INFO:tasks.ceph.mds.b:Stopping old one... 2023-06-10T18:56:13.170 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-06-10T18:56:13.170 INFO:teuthology.orchestra.run:waiting for 300 2023-06-10T18:56:13.170 INFO:tasks.ceph.mds.d:Restarting daemon 2023-06-10T18:56:13.171 INFO:tasks.ceph.mds.d:Stopping old one... 2023-06-10T18:56:13.171 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-06-10T18:56:13.171 INFO:teuthology.orchestra.run:waiting for 300 2023-06-10T18:56:13.179 INFO:tasks.ceph.mds.a:Stopped 2023-06-10T18:56:13.180 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-06-10T18:56:13.181 INFO:tasks.ceph.mds.c:Stopped 2023-06-10T18:56:13.182 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-06-10T18:56:13.186 INFO:tasks.ceph.mds.d:Stopped 2023-06-10T18:56:13.187 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-06-10T18:56:13.190 INFO:tasks.ceph.mds.b:Stopped 2023-06-10T18:56:13.191 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-06-10T18:56:13.231 INFO:tasks.ceph.mds.a:Started 2023-06-10T18:56:13.232 DEBUG:teuthology.parallel:result is None 2023-06-10T18:56:13.234 INFO:tasks.ceph.mds.c:Started 2023-06-10T18:56:13.234 DEBUG:teuthology.parallel:result is None 2023-06-10T18:56:13.236 INFO:tasks.ceph.mds.d:Started 2023-06-10T18:56:13.236 DEBUG:teuthology.parallel:result is None 2023-06-10T18:56:13.237 INFO:tasks.ceph.mds.b:Started 2023-06-10T18:56:13.238 DEBUG:teuthology.parallel:result is None 2023-06-10T18:56:13.238 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-06-10T18:56:13.295 INFO:tasks.ceph.mds.a.smithi053.stdout:starting mds.a at 2023-06-10T18:56:13.297 INFO:tasks.ceph.mds.c.smithi053.stdout:starting mds.c at 2023-06-10T18:56:13.312 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2023-06-10T18:56:13.313 INFO:tasks.ceph.mds.d.smithi117.stdout:starting mds.d at 2023-06-10T18:56:13.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:13.363+0000 7f6a57137640 1 Processor -- start 2023-06-10T18:56:13.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:13.363+0000 7f6a57137640 1 -- start start 2023-06-10T18:56:13.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:13.367+0000 7f6a57137640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6a501571a0 0x7f6a500c9f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:13.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:13.367+0000 7f6a57137640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6a50070100 0x7f6a500af7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:13.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:13.367+0000 7f6a57137640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a50071190 con 0x7f6a500afd10 2023-06-10T18:56:13.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:13.367+0000 7f6a57137640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a500b0190 con 0x7f6a501571a0 2023-06-10T18:56:13.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:13.367+0000 7f6a57137640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a500ca440 con 0x7f6a50070100 2023-06-10T18:56:13.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:13.367+0000 7f6a54ed3640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6a501571a0 0x7f6a500c9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:13.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:13.367+0000 7f6a556d4640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f6a500afd10 0x7f6a5015d260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41388/0 (socket says 172.21.15.53:41388) 2023-06-10T18:56:13.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:13.367+0000 7f6a556d4640 1 -- 172.21.15.53:0/2029454400 learned_addr learned my addr 172.21.15.53:0/2029454400 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:56:13.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:13.367+0000 7f6a4ffff640 1 --2- 172.21.15.53:0/2029454400 >> v2:172.21.15.117:3300/0 conn(0x7f6a50070100 0x7f6a500af7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:13.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:13.367+0000 7f6a54ed3640 1 -- 172.21.15.53:0/2029454400 >> v2:172.21.15.117:3300/0 conn(0x7f6a50070100 msgr2=0x7f6a500af7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:13.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:13.367+0000 7f6a54ed3640 1 --2- 172.21.15.53:0/2029454400 >> v2:172.21.15.117:3300/0 conn(0x7f6a50070100 0x7f6a500af7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:13.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:13.367+0000 7f6a54ed3640 1 -- 172.21.15.53:0/2029454400 >> v1:172.21.15.53:6789/0 conn(0x7f6a500afd10 legacy=0x7f6a5015d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:13.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:13.367+0000 7f6a54ed3640 1 -- 172.21.15.53:0/2029454400 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a50070580 con 0x7f6a501571a0 2023-06-10T18:56:13.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:13.367+0000 7f6a4f7fe640 1 -- 172.21.15.53:0/2029454400 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 52587640 0 0) 0x7f6a50071190 con 0x7f6a500afd10 2023-06-10T18:56:13.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:13.367+0000 7f6a54ed3640 1 --2- 172.21.15.53:0/2029454400 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a501571a0 0x7f6a500c9f00 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f6a500b3ec0 tx=0x7f6a4001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abdc820a044b725e server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:13.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:13.367+0000 7f6a4f7fe640 1 -- 172.21.15.53:0/2029454400 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a400ab610 con 0x7f6a501571a0 2023-06-10T18:56:13.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:13.367+0000 7f6a4f7fe640 1 -- 172.21.15.53:0/2029454400 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a400ab770 con 0x7f6a501571a0 2023-06-10T18:56:13.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:13.367+0000 7f6a4f7fe640 1 -- 172.21.15.53:0/2029454400 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a400abb00 con 0x7f6a501571a0 2023-06-10T18:56:13.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:13.371+0000 7f6a57137640 1 -- 172.21.15.53:0/2029454400 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a501571a0 msgr2=0x7f6a500c9f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:13.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:13.371+0000 7f6a57137640 1 --2- 172.21.15.53:0/2029454400 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a501571a0 0x7f6a500c9f00 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f6a500b3ec0 tx=0x7f6a4001c410 comp rx=0 tx=0).stop 2023-06-10T18:56:13.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:13.371+0000 7f6a57137640 1 -- 172.21.15.53:0/2029454400 shutdown_connections 2023-06-10T18:56:13.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:13.371+0000 7f6a57137640 1 --2- 172.21.15.53:0/2029454400 >> v2:172.21.15.117:3300/0 conn(0x7f6a50070100 0x7f6a500af7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:13.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:13.371+0000 7f6a57137640 1 --2- 172.21.15.53:0/2029454400 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a501571a0 0x7f6a500c9f00 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:13.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:13.371+0000 7f6a57137640 1 -- 172.21.15.53:0/2029454400 >> 172.21.15.53:0/2029454400 conn(0x7f6a500ce9e0 msgr2=0x7f6a500ca7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:13.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:13.371+0000 7f6a57137640 1 -- 172.21.15.53:0/2029454400 shutdown_connections 2023-06-10T18:56:13.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:13.371+0000 7f6a57137640 1 -- 172.21.15.53:0/2029454400 wait complete. 2023-06-10T18:56:13.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:13.371+0000 7f6a57137640 1 Processor -- start 2023-06-10T18:56:13.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:13.371+0000 7f6a57137640 1 -- start start 2023-06-10T18:56:13.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:13.371+0000 7f6a57137640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a500afd10 0x7f6a500c2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:13.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:13.371+0000 7f6a57137640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a501571a0 0x7f6a501496e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:13.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:13.371+0000 7f6a57137640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6a500c4450 0x7f6a500c6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:13.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:13.371+0000 7f6a57137640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a50149c20 con 0x7f6a500afd10 2023-06-10T18:56:13.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:13.371+0000 7f6a57137640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a500c67c0 con 0x7f6a501571a0 2023-06-10T18:56:13.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:13.371+0000 7f6a57137640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a500c33b0 con 0x7f6a500c4450 2023-06-10T18:56:13.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:13.371+0000 7f6a54ed3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a500afd10 0x7f6a500c2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:13.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:13.371+0000 7f6a54ed3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a500afd10 0x7f6a500c2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33570/0 (socket says 172.21.15.53:33570) 2023-06-10T18:56:13.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:13.371+0000 7f6a54ed3640 1 -- 172.21.15.53:0/3315005500 learned_addr learned my addr 172.21.15.53:0/3315005500 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:13.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:13.371+0000 7f6a4ffff640 1 --2- 172.21.15.53:0/3315005500 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a501571a0 0x7f6a501496e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:13.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:13.371+0000 7f6a556d4640 1 --2- 172.21.15.53:0/3315005500 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6a500c4450 0x7f6a500c6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:13.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:13.371+0000 7f6a54ed3640 1 -- 172.21.15.53:0/3315005500 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6a500c4450 msgr2=0x7f6a500c6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:13.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:13.371+0000 7f6a54ed3640 1 --2- 172.21.15.53:0/3315005500 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6a500c4450 0x7f6a500c6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:13.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:13.371+0000 7f6a54ed3640 1 -- 172.21.15.53:0/3315005500 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a501571a0 msgr2=0x7f6a501496e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:13.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:13.371+0000 7f6a54ed3640 1 --2- 172.21.15.53:0/3315005500 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a501571a0 0x7f6a501496e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:13.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:13.371+0000 7f6a54ed3640 1 -- 172.21.15.53:0/3315005500 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a400093b0 con 0x7f6a500afd10 2023-06-10T18:56:13.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:13.371+0000 7f6a4ffff640 1 --2- 172.21.15.53:0/3315005500 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a501571a0 0x7f6a501496e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:56:13.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:13.371+0000 7f6a556d4640 1 --2- 172.21.15.53:0/3315005500 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6a500c4450 0x7f6a500c6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:56:13.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:13.371+0000 7f6a54ed3640 1 --2- 172.21.15.53:0/3315005500 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a500afd10 0x7f6a500c2cf0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f6a400ad040 tx=0x7f6a4001ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:13.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:13.371+0000 7f6a4d7fa640 1 -- 172.21.15.53:0/3315005500 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a40005ba0 con 0x7f6a500afd10 2023-06-10T18:56:13.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:13.371+0000 7f6a4d7fa640 1 -- 172.21.15.53:0/3315005500 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a40005d20 con 0x7f6a500afd10 2023-06-10T18:56:13.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:13.371+0000 7f6a57137640 1 -- 172.21.15.53:0/3315005500 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a500c3690 con 0x7f6a500afd10 2023-06-10T18:56:13.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:13.371+0000 7f6a4d7fa640 1 -- 172.21.15.53:0/3315005500 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a40006260 con 0x7f6a500afd10 2023-06-10T18:56:13.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:13.371+0000 7f6a57137640 1 -- 172.21.15.53:0/3315005500 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a500c3c50 con 0x7f6a500afd10 2023-06-10T18:56:13.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:13.375+0000 7f6a57137640 1 -- 172.21.15.53:0/3315005500 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a5004d790 con 0x7f6a500afd10 2023-06-10T18:56:13.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:13.375+0000 7f6a4d7fa640 1 -- 172.21.15.53:0/3315005500 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6a400063c0 con 0x7f6a500afd10 2023-06-10T18:56:13.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:13.375+0000 7f6a4d7fa640 1 --2- 172.21.15.53:0/3315005500 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6a3c066280 0x7f6a3c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:13.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:13.375+0000 7f6a4d7fa640 1 -- 172.21.15.53:0/3315005500 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f6a4011e600 con 0x7f6a500afd10 2023-06-10T18:56:13.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:13.375+0000 7f6a4ffff640 1 --2- 172.21.15.53:0/3315005500 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6a3c066280 0x7f6a3c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:13.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:13.375+0000 7f6a4ffff640 1 --2- 172.21.15.53:0/3315005500 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6a3c066280 0x7f6a3c068730 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6a5006f560 tx=0x7f6a44008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:13.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:13.379+0000 7f6a4d7fa640 1 -- 172.21.15.53:0/3315005500 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6a400ebd20 con 0x7f6a500afd10 2023-06-10T18:56:13.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:13.543+0000 7f6a57137640 1 -- 172.21.15.53:0/3315005500 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f6a5014f890 con 0x7f6a500afd10 2023-06-10T18:56:14.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.355+0000 7f6a4d7fa640 1 -- 172.21.15.53:0/3315005500 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v47) v1 ==== 97+0+0 (secure 0 0 0) 0x7f6a400c4020 con 0x7f6a500afd10 2023-06-10T18:56:14.361 INFO:teuthology.orchestra.run.smithi053.stderr: removed all blocklist entries 2023-06-10T18:56:14.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.359+0000 7f6a57137640 1 -- 172.21.15.53:0/3315005500 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6a3c066280 msgr2=0x7f6a3c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:14.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.359+0000 7f6a57137640 1 --2- 172.21.15.53:0/3315005500 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6a3c066280 0x7f6a3c068730 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6a5006f560 tx=0x7f6a44008040 comp rx=0 tx=0).stop 2023-06-10T18:56:14.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.359+0000 7f6a57137640 1 -- 172.21.15.53:0/3315005500 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a500afd10 msgr2=0x7f6a500c2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:14.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.359+0000 7f6a57137640 1 --2- 172.21.15.53:0/3315005500 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a500afd10 0x7f6a500c2cf0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f6a400ad040 tx=0x7f6a4001ac50 comp rx=0 tx=0).stop 2023-06-10T18:56:14.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.359+0000 7f6a57137640 1 -- 172.21.15.53:0/3315005500 shutdown_connections 2023-06-10T18:56:14.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.359+0000 7f6a57137640 1 --2- 172.21.15.53:0/3315005500 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6a3c066280 0x7f6a3c068730 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:14.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.359+0000 7f6a57137640 1 --2- 172.21.15.53:0/3315005500 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6a500c4450 0x7f6a500c6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:14.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.359+0000 7f6a57137640 1 --2- 172.21.15.53:0/3315005500 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a501571a0 0x7f6a501496e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:14.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.359+0000 7f6a57137640 1 --2- 172.21.15.53:0/3315005500 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a500afd10 0x7f6a500c2cf0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:14.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.359+0000 7f6a57137640 1 -- 172.21.15.53:0/3315005500 >> 172.21.15.53:0/3315005500 conn(0x7f6a500ce9e0 msgr2=0x7f6a500ae120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:14.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.359+0000 7f6a57137640 1 -- 172.21.15.53:0/3315005500 shutdown_connections 2023-06-10T18:56:14.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.359+0000 7f6a57137640 1 -- 172.21.15.53:0/3315005500 wait complete. 2023-06-10T18:56:14.386 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-06-10T18:56:14.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.511+0000 7f55375b7640 1 Processor -- start 2023-06-10T18:56:14.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.511+0000 7f55375b7640 1 -- start start 2023-06-10T18:56:14.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.515+0000 7f55375b7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f55300cb870 0x7f55300af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:14.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.515+0000 7f55375b7640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55300b00a0 con 0x7f55300afc60 2023-06-10T18:56:14.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.515+0000 7f55375b7640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55301600d0 con 0x7f55300c9750 2023-06-10T18:56:14.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.515+0000 7f55375b7640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55300cd990 con 0x7f55300cb870 2023-06-10T18:56:14.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.515+0000 7f5534b52640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f55300cb870 0x7f55300af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:14.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.515+0000 7f5535b54640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f55300afc60 0x7f55300aba10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41400/0 (socket says 172.21.15.53:41400) 2023-06-10T18:56:14.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.515+0000 7f5534b52640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f55300cb870 0x7f55300af720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33574/0 (socket says 172.21.15.53:33574) 2023-06-10T18:56:14.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.515+0000 7f5535b54640 1 -- 172.21.15.53:0/1088591834 learned_addr learned my addr 172.21.15.53:0/1088591834 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:56:14.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.515+0000 7f5534b52640 1 -- 172.21.15.53:0/1088591834 >> v1:172.21.15.117:6789/0 conn(0x7f55300c9750 legacy=0x7f55300aced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:14.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.515+0000 7f5534b52640 1 -- 172.21.15.53:0/1088591834 >> v1:172.21.15.53:6789/0 conn(0x7f55300afc60 legacy=0x7f55300aba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:14.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.515+0000 7f5527fff640 1 -- 172.21.15.53:0/1088591834 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1532676930 0 0) 0x7f55300b00a0 con 0x7f55300afc60 2023-06-10T18:56:14.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.515+0000 7f5534b52640 1 -- 172.21.15.53:0/1088591834 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5530160370 con 0x7f55300cb870 2023-06-10T18:56:14.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.515+0000 7f5534b52640 1 --2- 172.21.15.53:0/1088591834 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55300cb870 0x7f55300af720 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f55200097c0 tx=0x7f552001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5fd59c94030d89d server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:14.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.515+0000 7f5527fff640 1 -- 172.21.15.53:0/1088591834 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55200ab660 con 0x7f55300cb870 2023-06-10T18:56:14.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.515+0000 7f5527fff640 1 -- 172.21.15.53:0/1088591834 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55200ab7c0 con 0x7f55300cb870 2023-06-10T18:56:14.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.515+0000 7f5527fff640 1 -- 172.21.15.53:0/1088591834 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55200abb50 con 0x7f55300cb870 2023-06-10T18:56:14.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.515+0000 7f55375b7640 1 -- 172.21.15.53:0/1088591834 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55300cb870 msgr2=0x7f55300af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:14.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.515+0000 7f55375b7640 1 --2- 172.21.15.53:0/1088591834 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55300cb870 0x7f55300af720 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f55200097c0 tx=0x7f552001c440 comp rx=0 tx=0).stop 2023-06-10T18:56:14.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.515+0000 7f55375b7640 1 -- 172.21.15.53:0/1088591834 shutdown_connections 2023-06-10T18:56:14.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.515+0000 7f55375b7640 1 --2- 172.21.15.53:0/1088591834 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55300cb870 0x7f55300af720 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:14.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.515+0000 7f55375b7640 1 -- 172.21.15.53:0/1088591834 >> 172.21.15.53:0/1088591834 conn(0x7f553006a0d0 msgr2=0x7f55300ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:14.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.515+0000 7f55375b7640 1 -- 172.21.15.53:0/1088591834 shutdown_connections 2023-06-10T18:56:14.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.515+0000 7f55375b7640 1 -- 172.21.15.53:0/1088591834 wait complete. 2023-06-10T18:56:14.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.519+0000 7f55375b7640 1 Processor -- start 2023-06-10T18:56:14.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.519+0000 7f55375b7640 1 -- start start 2023-06-10T18:56:14.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.519+0000 7f55375b7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55300afc60 0x7f5530147ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:14.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.519+0000 7f55375b7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55300c9750 0x7f553015e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:14.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.519+0000 7f55375b7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f55300cb870 0x7f55300ae390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:14.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.519+0000 7f55375b7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f553015e3e0 con 0x7f55300afc60 2023-06-10T18:56:14.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.519+0000 7f55375b7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f553015d340 con 0x7f55300cb870 2023-06-10T18:56:14.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.519+0000 7f55375b7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f553015d620 con 0x7f55300c9750 2023-06-10T18:56:14.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.519+0000 7f5535353640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55300afc60 0x7f5530147ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:14.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.519+0000 7f5535353640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55300afc60 0x7f5530147ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33582/0 (socket says 172.21.15.53:33582) 2023-06-10T18:56:14.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.519+0000 7f5535353640 1 -- 172.21.15.53:0/1911212385 learned_addr learned my addr 172.21.15.53:0/1911212385 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:14.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.519+0000 7f5534b52640 1 --2- 172.21.15.53:0/1911212385 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55300c9750 0x7f553015e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:14.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.519+0000 7f5535b54640 1 --2- 172.21.15.53:0/1911212385 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f55300cb870 0x7f55300ae390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:14.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.519+0000 7f5535353640 1 -- 172.21.15.53:0/1911212385 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55300c9750 msgr2=0x7f553015e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:14.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.519+0000 7f5535353640 1 --2- 172.21.15.53:0/1911212385 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55300c9750 0x7f553015e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:14.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.519+0000 7f5535353640 1 -- 172.21.15.53:0/1911212385 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f55300cb870 msgr2=0x7f55300ae390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:14.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.519+0000 7f5535353640 1 --2- 172.21.15.53:0/1911212385 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f55300cb870 0x7f55300ae390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:14.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.519+0000 7f5535353640 1 -- 172.21.15.53:0/1911212385 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5520009420 con 0x7f55300afc60 2023-06-10T18:56:14.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.519+0000 7f5535353640 1 --2- 172.21.15.53:0/1911212385 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55300afc60 0x7f5530147ef0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f552c00c450 tx=0x7f552c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:14.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.519+0000 7f5525ffb640 1 -- 172.21.15.53:0/1911212385 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f552c012830 con 0x7f55300afc60 2023-06-10T18:56:14.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.519+0000 7f5525ffb640 1 -- 172.21.15.53:0/1911212385 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f552c0129b0 con 0x7f55300afc60 2023-06-10T18:56:14.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.519+0000 7f55375b7640 1 -- 172.21.15.53:0/1911212385 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f553015d900 con 0x7f55300afc60 2023-06-10T18:56:14.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.519+0000 7f5525ffb640 1 -- 172.21.15.53:0/1911212385 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f552c012d60 con 0x7f55300afc60 2023-06-10T18:56:14.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.519+0000 7f55375b7640 1 -- 172.21.15.53:0/1911212385 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f553015dec0 con 0x7f55300afc60 2023-06-10T18:56:14.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.519+0000 7f55375b7640 1 -- 172.21.15.53:0/1911212385 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f553015e0b0 con 0x7f55300afc60 2023-06-10T18:56:14.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.519+0000 7f5525ffb640 1 -- 172.21.15.53:0/1911212385 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f552c01c460 con 0x7f55300afc60 2023-06-10T18:56:14.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.523+0000 7f5525ffb640 1 --2- 172.21.15.53:0/1911212385 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5514066280 0x7f5514068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:14.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.523+0000 7f5525ffb640 1 -- 172.21.15.53:0/1911212385 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f552c0838b0 con 0x7f55300afc60 2023-06-10T18:56:14.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.523+0000 7f5534b52640 1 --2- 172.21.15.53:0/1911212385 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5514066280 0x7f5514068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:14.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.523+0000 7f5534b52640 1 --2- 172.21.15.53:0/1911212385 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5514066280 0x7f5514068730 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f55200af000 tx=0x7f5520008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:14.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.527+0000 7f5525ffb640 1 -- 172.21.15.53:0/1911212385 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f552c054b10 con 0x7f55300afc60 2023-06-10T18:56:14.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.735+0000 7f55375b7640 1 -- 172.21.15.53:0/1911212385 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f553004d790 con 0x7f55300afc60 2023-06-10T18:56:14.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.735+0000 7f5525ffb640 1 -- 172.21.15.53:0/1911212385 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v11) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f552c0546a0 con 0x7f55300afc60 2023-06-10T18:56:14.746 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:56:14.746 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-06-10T18:56:14.747 INFO:teuthology.orchestra.run.smithi053.stdout: "auth_dump": [ 2023-06-10T18:56:14.747 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T18:56:14.747 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.a", 2023-06-10T18:56:14.747 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkWqEQBhAAW+iEw0Gxfw744rsYc/tfTQ==", 2023-06-10T18:56:14.748 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T18:56:14.748 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T18:56:14.748 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2023-06-10T18:56:14.749 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2023-06-10T18:56:14.749 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T18:56:14.749 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:56:14.749 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:56:14.749 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T18:56:14.750 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.b", 2023-06-10T18:56:14.750 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkSu02FRAAFpo6NpcwDLZUt2Rgk/wm8w==", 2023-06-10T18:56:14.750 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T18:56:14.750 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T18:56:14.750 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2023-06-10T18:56:14.750 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2023-06-10T18:56:14.751 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T18:56:14.751 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:56:14.751 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:56:14.751 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T18:56:14.751 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.c", 2023-06-10T18:56:14.751 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRk19/ODhAAodfGGNLP7UbNhHySgaukrg==", 2023-06-10T18:56:14.751 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T18:56:14.752 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T18:56:14.752 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2023-06-10T18:56:14.752 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2023-06-10T18:56:14.752 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T18:56:14.752 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:56:14.752 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:56:14.752 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T18:56:14.753 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.d", 2023-06-10T18:56:14.753 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkogwkGxAAIavVKa8GtML1XQDEMwwokQ==", 2023-06-10T18:56:14.753 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T18:56:14.753 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T18:56:14.753 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2023-06-10T18:56:14.753 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2023-06-10T18:56:14.754 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T18:56:14.754 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:56:14.754 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:56:14.754 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T18:56:14.754 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.0", 2023-06-10T18:56:14.754 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA7xoRkoj1OMhAAYFc4W5kAlMBqY2yzeJZXQw==", 2023-06-10T18:56:14.754 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T18:56:14.754 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T18:56:14.755 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T18:56:14.755 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T18:56:14.755 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:56:14.755 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:56:14.755 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T18:56:14.755 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.1", 2023-06-10T18:56:14.755 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA+xoRk6FpDOBAALjxW3eaIh3Gu9b1rmMmqfw==", 2023-06-10T18:56:14.755 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T18:56:14.756 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T18:56:14.756 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T18:56:14.756 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T18:56:14.756 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:56:14.756 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:56:14.756 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T18:56:14.756 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.2", 2023-06-10T18:56:14.756 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBCxoRkaO2GBRAA0Xr5en+n5DxhZDg8kVswpQ==", 2023-06-10T18:56:14.757 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T18:56:14.757 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T18:56:14.757 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T18:56:14.757 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T18:56:14.757 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:56:14.757 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:56:14.757 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T18:56:14.758 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.3", 2023-06-10T18:56:14.758 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBFxoRkjfsBDhAAArYYrPnmXu5VcUMGVjQXZg==", 2023-06-10T18:56:14.758 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T18:56:14.758 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T18:56:14.758 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T18:56:14.758 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T18:56:14.758 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:56:14.758 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:56:14.759 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T18:56:14.759 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.4", 2023-06-10T18:56:14.759 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBLxoRkybumChAAdym/nl9bzyI71flvuy9Vtw==", 2023-06-10T18:56:14.759 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T18:56:14.759 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T18:56:14.759 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T18:56:14.759 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T18:56:14.759 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:56:14.760 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:56:14.760 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T18:56:14.760 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.5", 2023-06-10T18:56:14.760 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBOxoRkinSGIRAAwLbgYKI4NsbHKqGo9O4WuQ==", 2023-06-10T18:56:14.760 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T18:56:14.760 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T18:56:14.760 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T18:56:14.761 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T18:56:14.761 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:56:14.761 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:56:14.761 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T18:56:14.761 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.6", 2023-06-10T18:56:14.761 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBRxoRkj7VlKRAAs2ReBZ5iqtr17Nli9kUtGQ==", 2023-06-10T18:56:14.761 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T18:56:14.761 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T18:56:14.762 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T18:56:14.762 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T18:56:14.762 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:56:14.763 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:56:14.763 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T18:56:14.763 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.7", 2023-06-10T18:56:14.763 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBUxoRk48CnMhAASfbeuCo9jDuHQrYDQ8Vt3A==", 2023-06-10T18:56:14.763 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T18:56:14.764 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T18:56:14.764 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T18:56:14.764 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T18:56:14.764 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:56:14.764 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:56:14.765 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T18:56:14.765 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.0", 2023-06-10T18:56:14.765 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkgey1IBAAkNYrXMgUOnavBY/5uGyFrw==", 2023-06-10T18:56:14.765 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T18:56:14.765 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T18:56:14.765 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow r", 2023-06-10T18:56:14.766 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-06-10T18:56:14.766 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:56:14.766 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:56:14.766 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T18:56:14.766 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.1", 2023-06-10T18:56:14.766 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkBw+UKBAAuvT+vXmJLG5CvQVg5xItDQ==", 2023-06-10T18:56:14.766 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T18:56:14.767 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T18:56:14.767 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow r", 2023-06-10T18:56:14.767 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow rw", 2023-06-10T18:56:14.767 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rwx" 2023-06-10T18:56:14.767 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:56:14.767 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:56:14.767 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T18:56:14.768 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.2", 2023-06-10T18:56:14.768 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkewjeJRAA4pmIEVJ3Z7GKQFmA54CZ5Q==", 2023-06-10T18:56:14.768 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T18:56:14.768 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T18:56:14.768 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow r", 2023-06-10T18:56:14.768 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow rw", 2023-06-10T18:56:14.768 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rwx" 2023-06-10T18:56:14.769 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:56:14.769 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:56:14.769 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T18:56:14.769 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.3", 2023-06-10T18:56:14.769 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkHwCiLRAAWGt8UoWxGlG1Y1zSPbKUCg==", 2023-06-10T18:56:14.769 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T18:56:14.769 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T18:56:14.769 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow r", 2023-06-10T18:56:14.770 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow rw", 2023-06-10T18:56:14.770 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rwx" 2023-06-10T18:56:14.770 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:56:14.770 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:56:14.770 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T18:56:14.770 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.admin", 2023-06-10T18:56:14.770 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA5xoRkIVgrKBAABIxiaOPe9h5ne2y2l50aMg==", 2023-06-10T18:56:14.771 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T18:56:14.771 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow *", 2023-06-10T18:56:14.771 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2023-06-10T18:56:14.771 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2023-06-10T18:56:14.771 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T18:56:14.771 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:56:14.771 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:56:14.772 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T18:56:14.772 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mgr.x", 2023-06-10T18:56:14.772 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkzWG3AhAAh3NFYHAbp4fgn4FZeRRNuw==", 2023-06-10T18:56:14.772 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T18:56:14.772 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow *", 2023-06-10T18:56:14.772 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile mgr", 2023-06-10T18:56:14.772 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T18:56:14.773 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:56:14.773 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:56:14.773 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T18:56:14.773 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mgr.y", 2023-06-10T18:56:14.773 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA5xoRkBriKOxAA6G+T7Yp2rH7XV7z37lvMYQ==", 2023-06-10T18:56:14.773 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T18:56:14.773 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow *", 2023-06-10T18:56:14.774 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile mgr", 2023-06-10T18:56:14.774 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T18:56:14.774 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:56:14.774 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:56:14.774 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2023-06-10T18:56:14.774 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-06-10T18:56:14.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.739+0000 7f55375b7640 1 -- 172.21.15.53:0/1911212385 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5514066280 msgr2=0x7f5514068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:14.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.739+0000 7f55375b7640 1 --2- 172.21.15.53:0/1911212385 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5514066280 0x7f5514068730 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f55200af000 tx=0x7f5520008040 comp rx=0 tx=0).stop 2023-06-10T18:56:14.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.739+0000 7f55375b7640 1 -- 172.21.15.53:0/1911212385 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55300afc60 msgr2=0x7f5530147ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:14.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.739+0000 7f55375b7640 1 --2- 172.21.15.53:0/1911212385 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55300afc60 0x7f5530147ef0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f552c00c450 tx=0x7f552c00c910 comp rx=0 tx=0).stop 2023-06-10T18:56:14.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.739+0000 7f55375b7640 1 -- 172.21.15.53:0/1911212385 shutdown_connections 2023-06-10T18:56:14.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.739+0000 7f55375b7640 1 --2- 172.21.15.53:0/1911212385 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5514066280 0x7f5514068730 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:14.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.739+0000 7f55375b7640 1 --2- 172.21.15.53:0/1911212385 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f55300cb870 0x7f55300ae390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:14.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.739+0000 7f55375b7640 1 --2- 172.21.15.53:0/1911212385 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55300c9750 0x7f553015e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:14.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.739+0000 7f55375b7640 1 --2- 172.21.15.53:0/1911212385 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55300afc60 0x7f5530147ef0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:14.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.739+0000 7f55375b7640 1 -- 172.21.15.53:0/1911212385 >> 172.21.15.53:0/1911212385 conn(0x7f553006a0d0 msgr2=0x7f55300c82a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:14.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.739+0000 7f55375b7640 1 -- 172.21.15.53:0/1911212385 shutdown_connections 2023-06-10T18:56:14.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.739+0000 7f55375b7640 1 -- 172.21.15.53:0/1911212385 wait complete. 2023-06-10T18:56:14.778 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T18:56:14.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.899+0000 7f9bc8b26640 1 Processor -- start 2023-06-10T18:56:14.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.899+0000 7f9bc8b26640 1 -- start start 2023-06-10T18:56:14.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.899+0000 7f9bc8b26640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9bc40c9840 0x7f9bc40c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:14.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.899+0000 7f9bc8b26640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9bc4071060 0x7f9bc40af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:14.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.899+0000 7f9bc8b26640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9bc40afc60 0x7f9bc415d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:14.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.899+0000 7f9bc8b26640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bc4159b50 con 0x7f9bc40c9840 2023-06-10T18:56:14.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.899+0000 7f9bc8b26640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bc40ca150 con 0x7f9bc4071060 2023-06-10T18:56:14.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.899+0000 7f9bc8b26640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc40702a0 con 0x7f9bc40afc60 2023-06-10T18:56:14.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.899+0000 7f9bc259c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9bc40c9840 0x7f9bc40c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:14.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.899+0000 7f9bc259c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9bc40c9840 0x7f9bc40c9c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33592/0 (socket says 172.21.15.53:33592) 2023-06-10T18:56:14.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.899+0000 7f9bc259c640 1 -- 172.21.15.53:0/715239589 learned_addr learned my addr 172.21.15.53:0/715239589 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:14.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.899+0000 7f9bc1d9b640 1 --2- 172.21.15.53:0/715239589 >> v2:172.21.15.117:3300/0 conn(0x7f9bc4071060 0x7f9bc40af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:14.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.899+0000 7f9bc2d9d640 1 --2- 172.21.15.53:0/715239589 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9bc40afc60 0x7f9bc415d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:14.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.899+0000 7f9bc259c640 1 -- 172.21.15.53:0/715239589 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9bc40afc60 msgr2=0x7f9bc415d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:14.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.899+0000 7f9bc259c640 1 --2- 172.21.15.53:0/715239589 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9bc40afc60 0x7f9bc415d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:14.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.899+0000 7f9bc259c640 1 -- 172.21.15.53:0/715239589 >> v2:172.21.15.117:3300/0 conn(0x7f9bc4071060 msgr2=0x7f9bc40af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:14.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.899+0000 7f9bc259c640 1 --2- 172.21.15.53:0/715239589 >> v2:172.21.15.117:3300/0 conn(0x7f9bc4071060 0x7f9bc40af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:14.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.899+0000 7f9bc259c640 1 -- 172.21.15.53:0/715239589 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bc4070580 con 0x7f9bc40c9840 2023-06-10T18:56:14.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.903+0000 7f9bc259c640 1 --2- 172.21.15.53:0/715239589 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9bc40c9840 0x7f9bc40c9c10 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f9bc406e650 tx=0x7f9bb401c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b28567dadeb7da9d server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:14.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.903+0000 7f9bc159a640 1 -- 172.21.15.53:0/715239589 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb40ab600 con 0x7f9bc40c9840 2023-06-10T18:56:14.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.903+0000 7f9bc159a640 1 -- 172.21.15.53:0/715239589 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bb40a7050 con 0x7f9bc40c9840 2023-06-10T18:56:14.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.903+0000 7f9bc159a640 1 -- 172.21.15.53:0/715239589 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb40ab980 con 0x7f9bc40c9840 2023-06-10T18:56:14.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.903+0000 7f9bc8b26640 1 -- 172.21.15.53:0/715239589 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9bc40c9840 msgr2=0x7f9bc40c9c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:14.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.903+0000 7f9bc8b26640 1 --2- 172.21.15.53:0/715239589 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9bc40c9840 0x7f9bc40c9c10 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f9bc406e650 tx=0x7f9bb401c210 comp rx=0 tx=0).stop 2023-06-10T18:56:14.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.903+0000 7f9bc8b26640 1 -- 172.21.15.53:0/715239589 shutdown_connections 2023-06-10T18:56:14.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.903+0000 7f9bc8b26640 1 --2- 172.21.15.53:0/715239589 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9bc40afc60 0x7f9bc415d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:14.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.903+0000 7f9bc8b26640 1 --2- 172.21.15.53:0/715239589 >> v2:172.21.15.117:3300/0 conn(0x7f9bc4071060 0x7f9bc40af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:14.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.903+0000 7f9bc8b26640 1 --2- 172.21.15.53:0/715239589 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9bc40c9840 0x7f9bc40c9c10 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:14.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.903+0000 7f9bc8b26640 1 -- 172.21.15.53:0/715239589 >> 172.21.15.53:0/715239589 conn(0x7f9bc406a0d0 msgr2=0x7f9bc40ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:14.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.903+0000 7f9bc8b26640 1 -- 172.21.15.53:0/715239589 shutdown_connections 2023-06-10T18:56:14.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.903+0000 7f9bc8b26640 1 -- 172.21.15.53:0/715239589 wait complete. 2023-06-10T18:56:14.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.903+0000 7f9bc8b26640 1 Processor -- start 2023-06-10T18:56:14.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.903+0000 7f9bc8b26640 1 -- start start 2023-06-10T18:56:14.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.903+0000 7f9bc8b26640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9bc4071060 0x7f9bc40b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:14.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.903+0000 7f9bc8b26640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9bc40afc60 0x7f9bc40adfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:14.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.903+0000 7f9bc8b26640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9bc40c9840 0x7f9bc40ae520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:14.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.903+0000 7f9bc8b26640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc40c5ad0 con 0x7f9bc4071060 2023-06-10T18:56:14.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.903+0000 7f9bc8b26640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc40aebc0 con 0x7f9bc40afc60 2023-06-10T18:56:14.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.903+0000 7f9bc8b26640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc40aeea0 con 0x7f9bc40c9840 2023-06-10T18:56:14.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.903+0000 7f9bc259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9bc4071060 0x7f9bc40b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:14.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.903+0000 7f9bc259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9bc4071060 0x7f9bc40b2d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33602/0 (socket says 172.21.15.53:33602) 2023-06-10T18:56:14.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.903+0000 7f9bc259c640 1 -- 172.21.15.53:0/2696185371 learned_addr learned my addr 172.21.15.53:0/2696185371 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:14.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.903+0000 7f9bc1d9b640 1 --2- 172.21.15.53:0/2696185371 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9bc40afc60 0x7f9bc40adfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:14.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.903+0000 7f9bc2d9d640 1 --2- 172.21.15.53:0/2696185371 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9bc40c9840 0x7f9bc40ae520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:14.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.907+0000 7f9bc259c640 1 -- 172.21.15.53:0/2696185371 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9bc40c9840 msgr2=0x7f9bc40ae520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:14.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.907+0000 7f9bc259c640 1 --2- 172.21.15.53:0/2696185371 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9bc40c9840 0x7f9bc40ae520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:14.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.907+0000 7f9bc259c640 1 -- 172.21.15.53:0/2696185371 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9bc40afc60 msgr2=0x7f9bc40adfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:14.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.907+0000 7f9bc259c640 1 --2- 172.21.15.53:0/2696185371 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9bc40afc60 0x7f9bc40adfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:14.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.907+0000 7f9bc259c640 1 -- 172.21.15.53:0/2696185371 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb40094d0 con 0x7f9bc4071060 2023-06-10T18:56:14.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.907+0000 7f9bc2d9d640 1 --2- 172.21.15.53:0/2696185371 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9bc40c9840 0x7f9bc40ae520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:56:14.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.907+0000 7f9bc259c640 1 --2- 172.21.15.53:0/2696185371 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9bc4071060 0x7f9bc40b2d20 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f9bb40ae040 tx=0x7f9bb4018fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:14.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.907+0000 7f9bb2ffd640 1 -- 172.21.15.53:0/2696185371 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb40b4640 con 0x7f9bc4071060 2023-06-10T18:56:14.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.907+0000 7f9bb2ffd640 1 -- 172.21.15.53:0/2696185371 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bb40b47c0 con 0x7f9bc4071060 2023-06-10T18:56:14.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.907+0000 7f9bc8b26640 1 -- 172.21.15.53:0/2696185371 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bc415b020 con 0x7f9bc4071060 2023-06-10T18:56:14.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.907+0000 7f9bb2ffd640 1 -- 172.21.15.53:0/2696185371 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb40b4b70 con 0x7f9bc4071060 2023-06-10T18:56:14.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.907+0000 7f9bc8b26640 1 -- 172.21.15.53:0/2696185371 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bc415b5e0 con 0x7f9bc4071060 2023-06-10T18:56:14.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.907+0000 7f9bc8b26640 1 -- 172.21.15.53:0/2696185371 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bc415b7d0 con 0x7f9bc4071060 2023-06-10T18:56:14.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.907+0000 7f9bb2ffd640 1 -- 172.21.15.53:0/2696185371 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9bb40b2070 con 0x7f9bc4071060 2023-06-10T18:56:14.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.907+0000 7f9bb2ffd640 1 --2- 172.21.15.53:0/2696185371 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9ba4066280 0x7f9ba4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:14.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.907+0000 7f9bb2ffd640 1 -- 172.21.15.53:0/2696185371 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f9bb411e160 con 0x7f9bc4071060 2023-06-10T18:56:14.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.907+0000 7f9bc1d9b640 1 --2- 172.21.15.53:0/2696185371 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9ba4066280 0x7f9ba4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:14.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.907+0000 7f9bc1d9b640 1 --2- 172.21.15.53:0/2696185371 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9ba4066280 0x7f9ba4068730 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f9bc40c1750 tx=0x7f9bb8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:14.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:14.911+0000 7f9bb2ffd640 1 -- 172.21.15.53:0/2696185371 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9bb40eba10 con 0x7f9bc4071060 2023-06-10T18:56:15.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.067+0000 7f9bc8b26640 1 -- 172.21.15.53:0/2696185371 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9bc406b010 con 0x7f9bc4071060 2023-06-10T18:56:15.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.067+0000 7f9bb2ffd640 1 -- 172.21.15.53:0/2696185371 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+14627 (secure 0 0 0) 0x7f9bb40ef030 con 0x7f9bc4071060 2023-06-10T18:56:15.073 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:56:15.074 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":47,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T18:56:14.343128+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T18:56:15.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.071+0000 7f9bc8b26640 1 -- 172.21.15.53:0/2696185371 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9ba4066280 msgr2=0x7f9ba4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:15.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.071+0000 7f9bc8b26640 1 --2- 172.21.15.53:0/2696185371 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9ba4066280 0x7f9ba4068730 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f9bc40c1750 tx=0x7f9bb8008040 comp rx=0 tx=0).stop 2023-06-10T18:56:15.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.071+0000 7f9bc8b26640 1 -- 172.21.15.53:0/2696185371 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9bc4071060 msgr2=0x7f9bc40b2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:15.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.071+0000 7f9bc8b26640 1 --2- 172.21.15.53:0/2696185371 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9bc4071060 0x7f9bc40b2d20 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f9bb40ae040 tx=0x7f9bb4018fb0 comp rx=0 tx=0).stop 2023-06-10T18:56:15.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.071+0000 7f9bc8b26640 1 -- 172.21.15.53:0/2696185371 shutdown_connections 2023-06-10T18:56:15.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.071+0000 7f9bc8b26640 1 --2- 172.21.15.53:0/2696185371 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9ba4066280 0x7f9ba4068730 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:15.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.071+0000 7f9bc8b26640 1 --2- 172.21.15.53:0/2696185371 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9bc40c9840 0x7f9bc40ae520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:15.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.071+0000 7f9bc8b26640 1 --2- 172.21.15.53:0/2696185371 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9bc40afc60 0x7f9bc40adfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:15.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.071+0000 7f9bc8b26640 1 --2- 172.21.15.53:0/2696185371 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9bc4071060 0x7f9bc40b2d20 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:15.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.071+0000 7f9bc8b26640 1 -- 172.21.15.53:0/2696185371 >> 172.21.15.53:0/2696185371 conn(0x7f9bc406a0d0 msgr2=0x7f9bc41559f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:15.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.071+0000 7f9bc8b26640 1 -- 172.21.15.53:0/2696185371 shutdown_connections 2023-06-10T18:56:15.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.071+0000 7f9bc8b26640 1 -- 172.21.15.53:0/2696185371 wait complete. 2023-06-10T18:56:15.093 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-10T18:52:33.633114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-10T18:52:39.171487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-10T18:56:15.093 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-10T18:56:15.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.207+0000 7f353de53640 1 Processor -- start 2023-06-10T18:56:15.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.207+0000 7f353de53640 1 -- start start 2023-06-10T18:56:15.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.207+0000 7f353de53640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35380c97d0 0x7f35380cb820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:15.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.207+0000 7f353de53640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35380ac910 con 0x7f35380af760 2023-06-10T18:56:15.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.207+0000 7f353de53640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35380cbd60 con 0x7f353806c350 2023-06-10T18:56:15.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.207+0000 7f353de53640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35380ca5c0 con 0x7f35380c97d0 2023-06-10T18:56:15.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.207+0000 7f3537fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f35380af760 0x7f353806b090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41402/0 (socket says 172.21.15.53:41402) 2023-06-10T18:56:15.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.207+0000 7f3537fff640 1 -- 172.21.15.53:0/1061659182 learned_addr learned my addr 172.21.15.53:0/1061659182 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:56:15.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.207+0000 7f35377fe640 1 --2- 172.21.15.53:0/1061659182 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35380c97d0 0x7f35380cb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:15.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.207+0000 7f35367fc640 1 -- 172.21.15.53:0/1061659182 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3553737300 0 0) 0x7f35380ac910 con 0x7f35380af760 2023-06-10T18:56:15.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.207+0000 7f35367fc640 1 -- 172.21.15.53:0/1061659182 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3524003530 con 0x7f35380af760 2023-06-10T18:56:15.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.207+0000 7f35367fc640 1 -- 172.21.15.53:0/1061659182 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2660706225 0 0) 0x7f3524003530 con 0x7f35380af760 2023-06-10T18:56:15.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.207+0000 7f35367fc640 1 -- 172.21.15.53:0/1061659182 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35380c97d0 msgr2=0x7f35380cb820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:15.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.207+0000 7f35367fc640 1 --2- 172.21.15.53:0/1061659182 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35380c97d0 0x7f35380cb820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:15.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.207+0000 7f35367fc640 1 -- 172.21.15.53:0/1061659182 >> v1:172.21.15.117:6789/0 conn(0x7f353806c350 legacy=0x7f35380ac200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:15.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.207+0000 7f35367fc640 1 -- 172.21.15.53:0/1061659182 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35380abd70 con 0x7f35380af760 2023-06-10T18:56:15.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.207+0000 7f35367fc640 1 -- 172.21.15.53:0/1061659182 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f3530001a00 con 0x7f35380af760 2023-06-10T18:56:15.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.207+0000 7f35367fc640 1 -- 172.21.15.53:0/1061659182 >> v1:172.21.15.53:6789/0 conn(0x7f35380af760 legacy=0x7f353806b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:15.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.207+0000 7f35367fc640 1 --2- 172.21.15.53:0/1061659182 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35380c97d0 0x7f35240039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:15.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.207+0000 7f35367fc640 1 --2- 172.21.15.53:0/1061659182 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3524003f30 0x7f35240047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:15.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.207+0000 7f35367fc640 1 --2- 172.21.15.53:0/1061659182 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3524004d10 0x7f3524005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:15.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.207+0000 7f35367fc640 1 -- 172.21.15.53:0/1061659182 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35380ca5c0 con 0x7f3524003f30 2023-06-10T18:56:15.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.207+0000 7f35367fc640 1 -- 172.21.15.53:0/1061659182 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f352400bba0 con 0x7f3524004d10 2023-06-10T18:56:15.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.207+0000 7f35367fc640 1 -- 172.21.15.53:0/1061659182 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f352400bd60 con 0x7f35380c97d0 2023-06-10T18:56:15.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.207+0000 7f3536ffd640 1 --2- 172.21.15.53:0/1061659182 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3524003f30 0x7f35240047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:15.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.207+0000 7f3537fff640 1 --2- 172.21.15.53:0/1061659182 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3524004d10 0x7f3524005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:15.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.207+0000 7f35377fe640 1 --2- 172.21.15.53:0/1061659182 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35380c97d0 0x7f35240039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:15.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.207+0000 7f3536ffd640 1 -- 172.21.15.53:0/1061659182 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35380c97d0 msgr2=0x7f35240039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:15.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.207+0000 7f3536ffd640 1 --2- 172.21.15.53:0/1061659182 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35380c97d0 0x7f35240039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:15.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.207+0000 7f3536ffd640 1 -- 172.21.15.53:0/1061659182 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3524004d10 msgr2=0x7f3524005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:15.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.207+0000 7f3536ffd640 1 --2- 172.21.15.53:0/1061659182 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3524004d10 0x7f3524005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:15.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.207+0000 7f3536ffd640 1 -- 172.21.15.53:0/1061659182 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3524003530 con 0x7f3524003f30 2023-06-10T18:56:15.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.211+0000 7f3536ffd640 1 --2- 172.21.15.53:0/1061659182 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3524003f30 0x7f35240047d0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f35200015b0 tx=0x7f352001c220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=586b44d6f33d4c71 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:15.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.211+0000 7f35367fc640 1 -- 172.21.15.53:0/1061659182 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35200050d0 con 0x7f3524003f30 2023-06-10T18:56:15.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.211+0000 7f35367fc640 1 -- 172.21.15.53:0/1061659182 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3520005250 con 0x7f3524003f30 2023-06-10T18:56:15.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.211+0000 7f35367fc640 1 -- 172.21.15.53:0/1061659182 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3520003600 con 0x7f3524003f30 2023-06-10T18:56:15.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.211+0000 7f353de53640 1 -- 172.21.15.53:0/1061659182 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3524003f30 msgr2=0x7f35240047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:15.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.211+0000 7f353de53640 1 --2- 172.21.15.53:0/1061659182 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3524003f30 0x7f35240047d0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f35200015b0 tx=0x7f352001c220 comp rx=0 tx=0).stop 2023-06-10T18:56:15.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.211+0000 7f3537fff640 1 -- 172.21.15.53:0/1061659182 reap_dead start 2023-06-10T18:56:15.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.211+0000 7f353de53640 1 -- 172.21.15.53:0/1061659182 shutdown_connections 2023-06-10T18:56:15.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.211+0000 7f353de53640 1 -- 172.21.15.53:0/1061659182 >> 172.21.15.53:0/1061659182 conn(0x7f353806a0e0 msgr2=0x7f35380cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:15.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.211+0000 7f353de53640 1 -- 172.21.15.53:0/1061659182 shutdown_connections 2023-06-10T18:56:15.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.211+0000 7f353de53640 1 -- 172.21.15.53:0/1061659182 wait complete. 2023-06-10T18:56:15.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.211+0000 7f353de53640 1 Processor -- start 2023-06-10T18:56:15.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.211+0000 7f353de53640 1 -- start start 2023-06-10T18:56:15.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.215+0000 7f353de53640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3524003f30 0x7f35380b1970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:15.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.215+0000 7f353de53640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35380b0b10 0x7f3538157150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:15.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.215+0000 7f353de53640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f35380b0f80 0x7f3538157690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:15.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.215+0000 7f353de53640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35380b38b0 con 0x7f35380b0f80 2023-06-10T18:56:15.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.215+0000 7f353de53640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f353814c660 con 0x7f3524003f30 2023-06-10T18:56:15.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.215+0000 7f353de53640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f353814c940 con 0x7f35380b0b10 2023-06-10T18:56:15.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.215+0000 7f3537fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f35380b0f80 0x7f3538157690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:15.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.215+0000 7f3537fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f35380b0f80 0x7f3538157690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33608/0 (socket says 172.21.15.53:33608) 2023-06-10T18:56:15.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.215+0000 7f3537fff640 1 -- 172.21.15.53:0/4219304752 learned_addr learned my addr 172.21.15.53:0/4219304752 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:15.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.215+0000 7f35377fe640 1 --2- 172.21.15.53:0/4219304752 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3524003f30 0x7f35380b1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:15.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.215+0000 7f3536ffd640 1 --2- 172.21.15.53:0/4219304752 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35380b0b10 0x7f3538157150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:15.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.215+0000 7f3537fff640 1 -- 172.21.15.53:0/4219304752 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35380b0b10 msgr2=0x7f3538157150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:15.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.215+0000 7f3537fff640 1 --2- 172.21.15.53:0/4219304752 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35380b0b10 0x7f3538157150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:15.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.215+0000 7f3537fff640 1 -- 172.21.15.53:0/4219304752 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3524003f30 msgr2=0x7f35380b1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:15.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.215+0000 7f3537fff640 1 --2- 172.21.15.53:0/4219304752 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3524003f30 0x7f35380b1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:15.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.215+0000 7f3537fff640 1 -- 172.21.15.53:0/4219304752 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f353814cc20 con 0x7f35380b0f80 2023-06-10T18:56:15.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.215+0000 7f3536ffd640 1 --2- 172.21.15.53:0/4219304752 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35380b0b10 0x7f3538157150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:56:15.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.215+0000 7f3537fff640 1 --2- 172.21.15.53:0/4219304752 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f35380b0f80 0x7f3538157690 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f353806ebe0 tx=0x7f35300077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:15.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.215+0000 7f352ffff640 1 -- 172.21.15.53:0/4219304752 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35300114f0 con 0x7f35380b0f80 2023-06-10T18:56:15.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.215+0000 7f352ffff640 1 -- 172.21.15.53:0/4219304752 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3530011650 con 0x7f35380b0f80 2023-06-10T18:56:15.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.215+0000 7f353de53640 1 -- 172.21.15.53:0/4219304752 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f353814cf00 con 0x7f35380b0f80 2023-06-10T18:56:15.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.215+0000 7f352ffff640 1 -- 172.21.15.53:0/4219304752 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3530011a00 con 0x7f35380b0f80 2023-06-10T18:56:15.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.215+0000 7f353de53640 1 -- 172.21.15.53:0/4219304752 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f353814d700 con 0x7f35380b0f80 2023-06-10T18:56:15.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.215+0000 7f353de53640 1 -- 172.21.15.53:0/4219304752 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f353804d790 con 0x7f35380b0f80 2023-06-10T18:56:15.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.215+0000 7f352ffff640 1 -- 172.21.15.53:0/4219304752 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3530011b60 con 0x7f35380b0f80 2023-06-10T18:56:15.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.215+0000 7f352ffff640 1 --2- 172.21.15.53:0/4219304752 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3518066280 0x7f3518068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:15.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.215+0000 7f352ffff640 1 -- 172.21.15.53:0/4219304752 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f35300832f0 con 0x7f35380b0f80 2023-06-10T18:56:15.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.215+0000 7f35377fe640 1 --2- 172.21.15.53:0/4219304752 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3518066280 0x7f3518068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:15.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.215+0000 7f35377fe640 1 --2- 172.21.15.53:0/4219304752 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3518066280 0x7f3518068730 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f3528009a30 tx=0x7f3528008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:15.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.219+0000 7f352ffff640 1 -- 172.21.15.53:0/4219304752 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3530050aa0 con 0x7f35380b0f80 2023-06-10T18:56:15.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.371+0000 7f353de53640 1 -- 172.21.15.53:0/4219304752 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f35380ce8f0 con 0x7f35380b0f80 2023-06-10T18:56:15.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.371+0000 7f352ffff640 1 -- 172.21.15.53:0/4219304752 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v47) v1 ==== 93+0+10 (secure 0 0 0) 0x7f35300540c0 con 0x7f35380b0f80 2023-06-10T18:56:15.376 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-06-10T18:56:15.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.375+0000 7f353de53640 1 -- 172.21.15.53:0/4219304752 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3518066280 msgr2=0x7f3518068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:15.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.375+0000 7f353de53640 1 --2- 172.21.15.53:0/4219304752 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3518066280 0x7f3518068730 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f3528009a30 tx=0x7f3528008040 comp rx=0 tx=0).stop 2023-06-10T18:56:15.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.375+0000 7f353de53640 1 -- 172.21.15.53:0/4219304752 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f35380b0f80 msgr2=0x7f3538157690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:15.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.375+0000 7f353de53640 1 --2- 172.21.15.53:0/4219304752 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f35380b0f80 0x7f3538157690 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f353806ebe0 tx=0x7f35300077d0 comp rx=0 tx=0).stop 2023-06-10T18:56:15.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.375+0000 7f353de53640 1 -- 172.21.15.53:0/4219304752 shutdown_connections 2023-06-10T18:56:15.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.375+0000 7f353de53640 1 --2- 172.21.15.53:0/4219304752 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3518066280 0x7f3518068730 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:15.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.375+0000 7f353de53640 1 --2- 172.21.15.53:0/4219304752 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f35380b0f80 0x7f3538157690 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:15.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.375+0000 7f353de53640 1 --2- 172.21.15.53:0/4219304752 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35380b0b10 0x7f3538157150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:15.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.375+0000 7f353de53640 1 --2- 172.21.15.53:0/4219304752 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3524003f30 0x7f35380b1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:15.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.375+0000 7f353de53640 1 -- 172.21.15.53:0/4219304752 >> 172.21.15.53:0/4219304752 conn(0x7f353806a0e0 msgr2=0x7f35380cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:15.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.375+0000 7f353de53640 1 -- 172.21.15.53:0/4219304752 shutdown_connections 2023-06-10T18:56:15.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.375+0000 7f353de53640 1 -- 172.21.15.53:0/4219304752 wait complete. 2023-06-10T18:56:15.394 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-10T18:56:15.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.515+0000 7f20adc0c640 1 Processor -- start 2023-06-10T18:56:15.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.515+0000 7f20adc0c640 1 -- start start 2023-06-10T18:56:15.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.515+0000 7f20adc0c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f20a80c1c30 0x7f20a806cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:15.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.515+0000 7f20adc0c640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20a806c340 con 0x7f20a8070930 2023-06-10T18:56:15.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.515+0000 7f20adc0c640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20a80c21a0 con 0x7f20a815fcd0 2023-06-10T18:56:15.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.515+0000 7f20adc0c640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20a80b1890 con 0x7f20a80c1c30 2023-06-10T18:56:15.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.515+0000 7f20a7fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f20a8070930 0x7f20a8070d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41404/0 (socket says 172.21.15.53:41404) 2023-06-10T18:56:15.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.515+0000 7f20a7fff640 1 -- 172.21.15.53:0/1208533064 learned_addr learned my addr 172.21.15.53:0/1208533064 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:56:15.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.515+0000 7f20a6ffd640 1 --2- 172.21.15.53:0/1208533064 >> v2:172.21.15.117:3300/0 conn(0x7f20a80c1c30 0x7f20a806cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:15.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.515+0000 7f20a67fc640 1 -- 172.21.15.53:0/1208533064 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2041965543 0 0) 0x7f20a806c340 con 0x7f20a8070930 2023-06-10T18:56:15.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.515+0000 7f20a67fc640 1 -- 172.21.15.53:0/1208533064 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2088003530 con 0x7f20a8070930 2023-06-10T18:56:15.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.515+0000 7f20a67fc640 1 -- 172.21.15.53:0/1208533064 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3869295982 0 0) 0x7f2088003530 con 0x7f20a8070930 2023-06-10T18:56:15.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.515+0000 7f20a67fc640 1 -- 172.21.15.53:0/1208533064 >> v2:172.21.15.117:3300/0 conn(0x7f20a80c1c30 msgr2=0x7f20a806cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:15.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.515+0000 7f20a67fc640 1 --2- 172.21.15.53:0/1208533064 >> v2:172.21.15.117:3300/0 conn(0x7f20a80c1c30 0x7f20a806cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:15.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.515+0000 7f20a67fc640 1 -- 172.21.15.53:0/1208533064 >> v1:172.21.15.117:6789/0 conn(0x7f20a815fcd0 legacy=0x7f20a80b1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:15.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.515+0000 7f20a67fc640 1 -- 172.21.15.53:0/1208533064 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20a80c2480 con 0x7f20a8070930 2023-06-10T18:56:15.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.515+0000 7f20a67fc640 1 -- 172.21.15.53:0/1208533064 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f20a0001680 con 0x7f20a8070930 2023-06-10T18:56:15.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.515+0000 7f20a67fc640 1 -- 172.21.15.53:0/1208533064 >> v1:172.21.15.53:6789/0 conn(0x7f20a8070930 legacy=0x7f20a8070d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:15.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.515+0000 7f20a67fc640 1 --2- 172.21.15.53:0/1208533064 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2088003980 0x7f2088003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:15.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.515+0000 7f20a67fc640 1 --2- 172.21.15.53:0/1208533064 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20880047d0 0x7f2088004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:15.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.515+0000 7f20a67fc640 1 --2- 172.21.15.53:0/1208533064 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2088005180 0x7f208800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:15.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.515+0000 7f20a67fc640 1 -- 172.21.15.53:0/1208533064 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20a80b1890 con 0x7f20880047d0 2023-06-10T18:56:15.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.515+0000 7f20a67fc640 1 -- 172.21.15.53:0/1208533064 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f208800c000 con 0x7f2088003980 2023-06-10T18:56:15.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.515+0000 7f20a67fc640 1 -- 172.21.15.53:0/1208533064 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f208800c1c0 con 0x7f2088005180 2023-06-10T18:56:15.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.515+0000 7f20a6ffd640 1 --2- 172.21.15.53:0/1208533064 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20880047d0 0x7f2088004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:15.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.515+0000 7f20a77fe640 1 --2- 172.21.15.53:0/1208533064 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2088003980 0x7f2088003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:15.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.515+0000 7f20a7fff640 1 --2- 172.21.15.53:0/1208533064 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2088005180 0x7f208800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:15.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.515+0000 7f20a6ffd640 1 -- 172.21.15.53:0/1208533064 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2088005180 msgr2=0x7f208800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:15.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.515+0000 7f20a6ffd640 1 --2- 172.21.15.53:0/1208533064 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2088005180 0x7f208800b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:15.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.515+0000 7f20a6ffd640 1 -- 172.21.15.53:0/1208533064 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2088003980 msgr2=0x7f2088003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:15.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.515+0000 7f20a6ffd640 1 --2- 172.21.15.53:0/1208533064 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2088003980 0x7f2088003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:15.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.515+0000 7f20a6ffd640 1 -- 172.21.15.53:0/1208533064 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2088003530 con 0x7f20880047d0 2023-06-10T18:56:15.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.515+0000 7f20a7fff640 1 -- 172.21.15.53:0/1208533064 reap_dead start 2023-06-10T18:56:15.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.519+0000 7f20a6ffd640 1 --2- 172.21.15.53:0/1208533064 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20880047d0 0x7f2088004c40 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f2090009f90 tx=0x7f209001cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85795614ac21b3e1 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:15.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.519+0000 7f20a67fc640 1 -- 172.21.15.53:0/1208533064 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20900a5b50 con 0x7f20880047d0 2023-06-10T18:56:15.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.519+0000 7f20a67fc640 1 -- 172.21.15.53:0/1208533064 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f209000f040 con 0x7f20880047d0 2023-06-10T18:56:15.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.519+0000 7f20a67fc640 1 -- 172.21.15.53:0/1208533064 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20900ad440 con 0x7f20880047d0 2023-06-10T18:56:15.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.519+0000 7f20adc0c640 1 -- 172.21.15.53:0/1208533064 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20880047d0 msgr2=0x7f2088004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:15.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.519+0000 7f20adc0c640 1 --2- 172.21.15.53:0/1208533064 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20880047d0 0x7f2088004c40 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f2090009f90 tx=0x7f209001cc20 comp rx=0 tx=0).stop 2023-06-10T18:56:15.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.519+0000 7f20adc0c640 1 -- 172.21.15.53:0/1208533064 shutdown_connections 2023-06-10T18:56:15.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.519+0000 7f20adc0c640 1 --2- 172.21.15.53:0/1208533064 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20880047d0 0x7f2088004c40 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:15.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.519+0000 7f20adc0c640 1 -- 172.21.15.53:0/1208533064 >> 172.21.15.53:0/1208533064 conn(0x7f20a806a560 msgr2=0x7f20a806a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:15.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.519+0000 7f20adc0c640 1 -- 172.21.15.53:0/1208533064 shutdown_connections 2023-06-10T18:56:15.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.519+0000 7f20adc0c640 1 -- 172.21.15.53:0/1208533064 wait complete. 2023-06-10T18:56:15.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.519+0000 7f20adc0c640 1 Processor -- start 2023-06-10T18:56:15.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.519+0000 7f20adc0c640 1 -- start start 2023-06-10T18:56:15.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.523+0000 7f20adc0c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20880047d0 0x7f20a8162ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:15.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.523+0000 7f20adc0c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20a80cef30 0x7f20a81599f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:15.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.523+0000 7f20adc0c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20a80cf3a0 0x7f20a8159f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:15.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.523+0000 7f20adc0c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20a815a470 con 0x7f20880047d0 2023-06-10T18:56:15.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.523+0000 7f20adc0c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20a815d140 con 0x7f20a80cf3a0 2023-06-10T18:56:15.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.523+0000 7f20adc0c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20a815d420 con 0x7f20a80cef30 2023-06-10T18:56:15.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.523+0000 7f20a77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20880047d0 0x7f20a8162ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:15.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.523+0000 7f20a77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20880047d0 0x7f20a8162ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33630/0 (socket says 172.21.15.53:33630) 2023-06-10T18:56:15.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.523+0000 7f20a77fe640 1 -- 172.21.15.53:0/3545533067 learned_addr learned my addr 172.21.15.53:0/3545533067 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:15.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.523+0000 7f20a6ffd640 1 --2- 172.21.15.53:0/3545533067 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20a80cef30 0x7f20a81599f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:15.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.523+0000 7f20a7fff640 1 --2- 172.21.15.53:0/3545533067 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20a80cf3a0 0x7f20a8159f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:15.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.523+0000 7f20a77fe640 1 -- 172.21.15.53:0/3545533067 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20a80cef30 msgr2=0x7f20a81599f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:15.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.523+0000 7f20a77fe640 1 --2- 172.21.15.53:0/3545533067 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20a80cef30 0x7f20a81599f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:15.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.523+0000 7f20a77fe640 1 -- 172.21.15.53:0/3545533067 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20a80cf3a0 msgr2=0x7f20a8159f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:15.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.523+0000 7f20a77fe640 1 --2- 172.21.15.53:0/3545533067 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20a80cf3a0 0x7f20a8159f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:15.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.523+0000 7f20a77fe640 1 -- 172.21.15.53:0/3545533067 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20a815d700 con 0x7f20880047d0 2023-06-10T18:56:15.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.523+0000 7f20a77fe640 1 --2- 172.21.15.53:0/3545533067 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20880047d0 0x7f20a8162ba0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f209800e4d0 tx=0x7f209800e990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:15.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.523+0000 7f209ffff640 1 -- 172.21.15.53:0/3545533067 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20980053a0 con 0x7f20880047d0 2023-06-10T18:56:15.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.523+0000 7f209ffff640 1 -- 172.21.15.53:0/3545533067 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2098003600 con 0x7f20880047d0 2023-06-10T18:56:15.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.523+0000 7f20adc0c640 1 -- 172.21.15.53:0/3545533067 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20a815d9e0 con 0x7f20880047d0 2023-06-10T18:56:15.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.523+0000 7f209ffff640 1 -- 172.21.15.53:0/3545533067 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2098003990 con 0x7f20880047d0 2023-06-10T18:56:15.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.523+0000 7f20adc0c640 1 -- 172.21.15.53:0/3545533067 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20a815dfa0 con 0x7f20880047d0 2023-06-10T18:56:15.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.523+0000 7f20adc0c640 1 -- 172.21.15.53:0/3545533067 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20a804d790 con 0x7f20880047d0 2023-06-10T18:56:15.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.523+0000 7f209ffff640 1 -- 172.21.15.53:0/3545533067 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2098003af0 con 0x7f20880047d0 2023-06-10T18:56:15.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.523+0000 7f209ffff640 1 --2- 172.21.15.53:0/3545533067 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f208c0662b0 0x7f208c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:15.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.523+0000 7f209ffff640 1 -- 172.21.15.53:0/3545533067 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f2098083750 con 0x7f20880047d0 2023-06-10T18:56:15.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.523+0000 7f20a6ffd640 1 --2- 172.21.15.53:0/3545533067 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f208c0662b0 0x7f208c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:15.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.527+0000 7f20a6ffd640 1 --2- 172.21.15.53:0/3545533067 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f208c0662b0 0x7f208c068760 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f20900af000 tx=0x7f20900a7040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:15.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.527+0000 7f209ffff640 1 -- 172.21.15.53:0/3545533067 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2098050fb0 con 0x7f20880047d0 2023-06-10T18:56:15.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.683+0000 7f20adc0c640 1 -- 172.21.15.53:0/3545533067 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f20a80b0cb0 con 0x7f20880047d0 2023-06-10T18:56:15.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.683+0000 7f209ffff640 1 -- 172.21.15.53:0/3545533067 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v47) v1 ==== 92+0+10 (secure 0 0 0) 0x7f20980545d0 con 0x7f20880047d0 2023-06-10T18:56:15.689 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-06-10T18:56:15.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.687+0000 7f20adc0c640 1 -- 172.21.15.53:0/3545533067 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f208c0662b0 msgr2=0x7f208c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:15.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.687+0000 7f20adc0c640 1 --2- 172.21.15.53:0/3545533067 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f208c0662b0 0x7f208c068760 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f20900af000 tx=0x7f20900a7040 comp rx=0 tx=0).stop 2023-06-10T18:56:15.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.687+0000 7f20adc0c640 1 -- 172.21.15.53:0/3545533067 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20880047d0 msgr2=0x7f20a8162ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:15.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.687+0000 7f20adc0c640 1 --2- 172.21.15.53:0/3545533067 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20880047d0 0x7f20a8162ba0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f209800e4d0 tx=0x7f209800e990 comp rx=0 tx=0).stop 2023-06-10T18:56:15.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.687+0000 7f20adc0c640 1 -- 172.21.15.53:0/3545533067 shutdown_connections 2023-06-10T18:56:15.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.687+0000 7f20adc0c640 1 --2- 172.21.15.53:0/3545533067 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f208c0662b0 0x7f208c068760 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:15.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.687+0000 7f20adc0c640 1 --2- 172.21.15.53:0/3545533067 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20a80cf3a0 0x7f20a8159f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:15.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.687+0000 7f20adc0c640 1 --2- 172.21.15.53:0/3545533067 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20a80cef30 0x7f20a81599f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:15.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.687+0000 7f20adc0c640 1 --2- 172.21.15.53:0/3545533067 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20880047d0 0x7f20a8162ba0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:15.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.687+0000 7f20adc0c640 1 -- 172.21.15.53:0/3545533067 >> 172.21.15.53:0/3545533067 conn(0x7f20a806a560 msgr2=0x7f20a806ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:15.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.687+0000 7f20adc0c640 1 -- 172.21.15.53:0/3545533067 shutdown_connections 2023-06-10T18:56:15.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.687+0000 7f20adc0c640 1 -- 172.21.15.53:0/3545533067 wait complete. 2023-06-10T18:56:15.708 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-06-10T18:56:15.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.831+0000 7f0a6add1640 1 Processor -- start 2023-06-10T18:56:15.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.831+0000 7f0a6add1640 1 -- start start 2023-06-10T18:56:15.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.831+0000 7f0a6add1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a64071060 0x7f0a640af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:15.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.831+0000 7f0a6add1640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a64159b50 con 0x7f0a640afc60 2023-06-10T18:56:15.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.831+0000 7f0a6add1640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a640702a0 con 0x7f0a640c9840 2023-06-10T18:56:15.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.831+0000 7f0a6add1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a64070580 con 0x7f0a64071060 2023-06-10T18:56:15.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.831+0000 7f0a6936e640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f0a640afc60 0x7f0a6406b090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41416/0 (socket says 172.21.15.53:41416) 2023-06-10T18:56:15.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.831+0000 7f0a6936e640 1 -- 172.21.15.53:0/3672876202 learned_addr learned my addr 172.21.15.53:0/3672876202 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:56:15.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.831+0000 7f0a63fff640 1 --2- 172.21.15.53:0/3672876202 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a64071060 0x7f0a640af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:15.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.831+0000 7f0a637fe640 1 -- 172.21.15.53:0/3672876202 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3047397358 0 0) 0x7f0a64159b50 con 0x7f0a640afc60 2023-06-10T18:56:15.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.831+0000 7f0a637fe640 1 -- 172.21.15.53:0/3672876202 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a4c003530 con 0x7f0a640afc60 2023-06-10T18:56:15.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.831+0000 7f0a637fe640 1 -- 172.21.15.53:0/3672876202 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1197877800 0 0) 0x7f0a4c003530 con 0x7f0a640afc60 2023-06-10T18:56:15.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.831+0000 7f0a637fe640 1 -- 172.21.15.53:0/3672876202 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a64071060 msgr2=0x7f0a640af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:15.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.831+0000 7f0a637fe640 1 --2- 172.21.15.53:0/3672876202 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a64071060 0x7f0a640af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:15.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.831+0000 7f0a637fe640 1 -- 172.21.15.53:0/3672876202 >> v1:172.21.15.117:6789/0 conn(0x7f0a640c9840 legacy=0x7f0a640c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:15.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.831+0000 7f0a637fe640 1 -- 172.21.15.53:0/3672876202 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a64070860 con 0x7f0a640afc60 2023-06-10T18:56:15.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.831+0000 7f0a637fe640 1 -- 172.21.15.53:0/3672876202 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f0a5c001680 con 0x7f0a640afc60 2023-06-10T18:56:15.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.831+0000 7f0a637fe640 1 -- 172.21.15.53:0/3672876202 >> v1:172.21.15.53:6789/0 conn(0x7f0a640afc60 legacy=0x7f0a6406b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:15.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.831+0000 7f0a637fe640 1 --2- 172.21.15.53:0/3672876202 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a4c003a20 0x7f0a4c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:15.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.831+0000 7f0a637fe640 1 --2- 172.21.15.53:0/3672876202 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0a4c0047d0 0x7f0a4c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:15.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.831+0000 7f0a637fe640 1 --2- 172.21.15.53:0/3672876202 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a64071060 0x7f0a4c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:15.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.831+0000 7f0a637fe640 1 -- 172.21.15.53:0/3672876202 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a64070580 con 0x7f0a4c0047d0 2023-06-10T18:56:15.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.831+0000 7f0a637fe640 1 -- 172.21.15.53:0/3672876202 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4c00ba70 con 0x7f0a4c003a20 2023-06-10T18:56:15.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.831+0000 7f0a637fe640 1 -- 172.21.15.53:0/3672876202 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4c00bc30 con 0x7f0a64071060 2023-06-10T18:56:15.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.831+0000 7f0a63fff640 1 --2- 172.21.15.53:0/3672876202 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0a4c0047d0 0x7f0a4c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:15.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.831+0000 7f0a6936e640 1 --2- 172.21.15.53:0/3672876202 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a64071060 0x7f0a4c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:15.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.831+0000 7f0a68b6d640 1 --2- 172.21.15.53:0/3672876202 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a4c003a20 0x7f0a4c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:15.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.831+0000 7f0a63fff640 1 -- 172.21.15.53:0/3672876202 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a64071060 msgr2=0x7f0a4c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:15.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.831+0000 7f0a63fff640 1 --2- 172.21.15.53:0/3672876202 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a64071060 0x7f0a4c005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:15.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.831+0000 7f0a63fff640 1 -- 172.21.15.53:0/3672876202 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a4c003a20 msgr2=0x7f0a4c003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:15.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.831+0000 7f0a63fff640 1 --2- 172.21.15.53:0/3672876202 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a4c003a20 0x7f0a4c003e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:15.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.831+0000 7f0a63fff640 1 -- 172.21.15.53:0/3672876202 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a4c003530 con 0x7f0a4c0047d0 2023-06-10T18:56:15.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.835+0000 7f0a63fff640 1 --2- 172.21.15.53:0/3672876202 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0a4c0047d0 0x7f0a4c004c40 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f0a58009f90 tx=0x7f0a5801cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58410756498ec3a1 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:15.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.835+0000 7f0a637fe640 1 -- 172.21.15.53:0/3672876202 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a580a5c30 con 0x7f0a4c0047d0 2023-06-10T18:56:15.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.835+0000 7f0a637fe640 1 -- 172.21.15.53:0/3672876202 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a5800f040 con 0x7f0a4c0047d0 2023-06-10T18:56:15.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.835+0000 7f0a637fe640 1 -- 172.21.15.53:0/3672876202 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a580ad440 con 0x7f0a4c0047d0 2023-06-10T18:56:15.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.835+0000 7f0a6add1640 1 -- 172.21.15.53:0/3672876202 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0a4c0047d0 msgr2=0x7f0a4c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:15.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.835+0000 7f0a6add1640 1 --2- 172.21.15.53:0/3672876202 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0a4c0047d0 0x7f0a4c004c40 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f0a58009f90 tx=0x7f0a5801cc20 comp rx=0 tx=0).stop 2023-06-10T18:56:15.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.835+0000 7f0a6936e640 1 -- 172.21.15.53:0/3672876202 reap_dead start 2023-06-10T18:56:15.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.835+0000 7f0a6add1640 1 -- 172.21.15.53:0/3672876202 shutdown_connections 2023-06-10T18:56:15.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.835+0000 7f0a6add1640 1 -- 172.21.15.53:0/3672876202 >> 172.21.15.53:0/3672876202 conn(0x7f0a6406a0d0 msgr2=0x7f0a640ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:15.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.835+0000 7f0a6add1640 1 -- 172.21.15.53:0/3672876202 shutdown_connections 2023-06-10T18:56:15.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.835+0000 7f0a6add1640 1 -- 172.21.15.53:0/3672876202 wait complete. 2023-06-10T18:56:15.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.835+0000 7f0a6add1640 1 Processor -- start 2023-06-10T18:56:15.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.835+0000 7f0a6add1640 1 -- start start 2023-06-10T18:56:15.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.839+0000 7f0a6add1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a6414dab0 0x7f0a640b0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:15.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.839+0000 7f0a6add1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0a6414de80 0x7f0a640ac390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:15.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.839+0000 7f0a6add1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a640ac8d0 0x7f0a640acd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:15.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.839+0000 7f0a6add1640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a640b1cf0 con 0x7f0a6414de80 2023-06-10T18:56:15.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.839+0000 7f0a6add1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a640b1220 con 0x7f0a640ac8d0 2023-06-10T18:56:15.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.839+0000 7f0a6add1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6415d930 con 0x7f0a6414dab0 2023-06-10T18:56:15.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.839+0000 7f0a63fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0a6414de80 0x7f0a640ac390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:15.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.839+0000 7f0a63fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0a6414de80 0x7f0a640ac390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33652/0 (socket says 172.21.15.53:33652) 2023-06-10T18:56:15.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.839+0000 7f0a63fff640 1 -- 172.21.15.53:0/1514926648 learned_addr learned my addr 172.21.15.53:0/1514926648 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:15.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.839+0000 7f0a68b6d640 1 --2- 172.21.15.53:0/1514926648 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a6414dab0 0x7f0a640b0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:15.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.839+0000 7f0a6936e640 1 --2- 172.21.15.53:0/1514926648 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a640ac8d0 0x7f0a640acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:15.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.839+0000 7f0a63fff640 1 -- 172.21.15.53:0/1514926648 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a6414dab0 msgr2=0x7f0a640b0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:15.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.839+0000 7f0a63fff640 1 --2- 172.21.15.53:0/1514926648 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a6414dab0 0x7f0a640b0ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:15.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.839+0000 7f0a63fff640 1 -- 172.21.15.53:0/1514926648 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a640ac8d0 msgr2=0x7f0a640acd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:15.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.839+0000 7f0a63fff640 1 --2- 172.21.15.53:0/1514926648 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a640ac8d0 0x7f0a640acd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:15.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.839+0000 7f0a63fff640 1 -- 172.21.15.53:0/1514926648 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a640b14e0 con 0x7f0a6414de80 2023-06-10T18:56:15.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.839+0000 7f0a6936e640 1 --2- 172.21.15.53:0/1514926648 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a640ac8d0 0x7f0a640acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:56:15.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.839+0000 7f0a63fff640 1 --2- 172.21.15.53:0/1514926648 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0a6414de80 0x7f0a640ac390 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f0a5801ca50 tx=0x7f0a58009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:15.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.839+0000 7f0a617fa640 1 -- 172.21.15.53:0/1514926648 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a580ad990 con 0x7f0a6414de80 2023-06-10T18:56:15.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.839+0000 7f0a617fa640 1 -- 172.21.15.53:0/1514926648 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a580adaf0 con 0x7f0a6414de80 2023-06-10T18:56:15.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.839+0000 7f0a617fa640 1 -- 172.21.15.53:0/1514926648 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a580adea0 con 0x7f0a6414de80 2023-06-10T18:56:15.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.839+0000 7f0a6add1640 1 -- 172.21.15.53:0/1514926648 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a640b3480 con 0x7f0a6414de80 2023-06-10T18:56:15.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.839+0000 7f0a6add1640 1 -- 172.21.15.53:0/1514926648 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a640b1730 con 0x7f0a6414de80 2023-06-10T18:56:15.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.839+0000 7f0a6add1640 1 -- 172.21.15.53:0/1514926648 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a640b3610 con 0x7f0a6414de80 2023-06-10T18:56:15.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.839+0000 7f0a617fa640 1 -- 172.21.15.53:0/1514926648 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0a580b4040 con 0x7f0a6414de80 2023-06-10T18:56:15.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.839+0000 7f0a617fa640 1 --2- 172.21.15.53:0/1514926648 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0a500662b0 0x7f0a50068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:15.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.839+0000 7f0a617fa640 1 -- 172.21.15.53:0/1514926648 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0a5811e360 con 0x7f0a6414de80 2023-06-10T18:56:15.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.839+0000 7f0a68b6d640 1 --2- 172.21.15.53:0/1514926648 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0a500662b0 0x7f0a50068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:15.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.843+0000 7f0a68b6d640 1 --2- 172.21.15.53:0/1514926648 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0a500662b0 0x7f0a50068760 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f0a540016e0 tx=0x7f0a54009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:15.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.843+0000 7f0a617fa640 1 -- 172.21.15.53:0/1514926648 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0a580ebc70 con 0x7f0a6414de80 2023-06-10T18:56:16.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:15.999+0000 7f0a6add1640 1 -- 172.21.15.53:0/1514926648 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f0a6404d790 con 0x7f0a6414de80 2023-06-10T18:56:16.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:16.003+0000 7f0a617fa640 1 -- 172.21.15.53:0/1514926648 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v47) v1 ==== 84+0+126 (secure 0 0 0) 0x7f0a580ef290 con 0x7f0a6414de80 2023-06-10T18:56:16.006 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:56:16.006 INFO:teuthology.orchestra.run.smithi053.stdout:[ 2023-06-10T18:56:16.006 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T18:56:16.007 INFO:teuthology.orchestra.run.smithi053.stdout: "poolnum": 1, 2023-06-10T18:56:16.007 INFO:teuthology.orchestra.run.smithi053.stdout: "poolname": ".mgr" 2023-06-10T18:56:16.007 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:56:16.007 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T18:56:16.007 INFO:teuthology.orchestra.run.smithi053.stdout: "poolnum": 2, 2023-06-10T18:56:16.007 INFO:teuthology.orchestra.run.smithi053.stdout: "poolname": "rbd" 2023-06-10T18:56:16.007 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:56:16.008 INFO:teuthology.orchestra.run.smithi053.stdout:] 2023-06-10T18:56:16.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:16.003+0000 7f0a6add1640 1 -- 172.21.15.53:0/1514926648 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0a500662b0 msgr2=0x7f0a50068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:16.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:16.003+0000 7f0a6add1640 1 --2- 172.21.15.53:0/1514926648 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0a500662b0 0x7f0a50068760 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f0a540016e0 tx=0x7f0a54009040 comp rx=0 tx=0).stop 2023-06-10T18:56:16.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:16.003+0000 7f0a6add1640 1 -- 172.21.15.53:0/1514926648 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0a6414de80 msgr2=0x7f0a640ac390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:16.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:16.003+0000 7f0a6add1640 1 --2- 172.21.15.53:0/1514926648 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0a6414de80 0x7f0a640ac390 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f0a5801ca50 tx=0x7f0a58009750 comp rx=0 tx=0).stop 2023-06-10T18:56:16.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:16.003+0000 7f0a6add1640 1 -- 172.21.15.53:0/1514926648 shutdown_connections 2023-06-10T18:56:16.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:16.003+0000 7f0a6add1640 1 --2- 172.21.15.53:0/1514926648 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0a500662b0 0x7f0a50068760 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:16.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:16.003+0000 7f0a6add1640 1 --2- 172.21.15.53:0/1514926648 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a640ac8d0 0x7f0a640acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:16.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:16.003+0000 7f0a6add1640 1 --2- 172.21.15.53:0/1514926648 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0a6414de80 0x7f0a640ac390 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:16.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:16.003+0000 7f0a6add1640 1 --2- 172.21.15.53:0/1514926648 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a6414dab0 0x7f0a640b0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:16.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:16.003+0000 7f0a6add1640 1 -- 172.21.15.53:0/1514926648 >> 172.21.15.53:0/1514926648 conn(0x7f0a6406a0d0 msgr2=0x7f0a64154e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:16.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:16.003+0000 7f0a6add1640 1 -- 172.21.15.53:0/1514926648 shutdown_connections 2023-06-10T18:56:16.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:16.003+0000 7f0a6add1640 1 -- 172.21.15.53:0/1514926648 wait complete. 2023-06-10T18:56:16.025 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-06-10T18:56:16.026 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-06-10T18:56:16.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:16.151+0000 7f37687ea640 1 Processor -- start 2023-06-10T18:56:16.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:16.151+0000 7f37687ea640 1 -- start start 2023-06-10T18:56:16.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:16.151+0000 7f37687ea640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3760159940 0x7f37600c9b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:16.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:16.151+0000 7f37687ea640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f37600ca050 0x7f37600af830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:16.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:16.151+0000 7f37687ea640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f37600afd70 0x7f376015d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:16.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:16.151+0000 7f37687ea640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37600ca4a0 con 0x7f37600ca050 2023-06-10T18:56:16.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:16.151+0000 7f37687ea640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3760159d10 con 0x7f37600afd70 2023-06-10T18:56:16.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:16.151+0000 7f37687ea640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f376006b100 con 0x7f3760159940 2023-06-10T18:56:16.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:16.151+0000 7f3765d85640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f37600ca050 0x7f37600af830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:16.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:16.151+0000 7f3765d85640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f37600ca050 0x7f37600af830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33662/0 (socket says 172.21.15.53:33662) 2023-06-10T18:56:16.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:16.151+0000 7f3765d85640 1 -- 172.21.15.53:0/2955405098 learned_addr learned my addr 172.21.15.53:0/2955405098 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:16.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:16.151+0000 7f3766586640 1 --2- 172.21.15.53:0/2955405098 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3760159940 0x7f37600c9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:16.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:16.151+0000 7f3766d87640 1 --2- 172.21.15.53:0/2955405098 >> v2:172.21.15.117:3300/0 conn(0x7f37600afd70 0x7f376015d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:16.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:16.151+0000 7f3765d85640 1 -- 172.21.15.53:0/2955405098 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3760159940 msgr2=0x7f37600c9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:16.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:16.151+0000 7f3765d85640 1 --2- 172.21.15.53:0/2955405098 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3760159940 0x7f37600c9b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:16.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:16.151+0000 7f3765d85640 1 -- 172.21.15.53:0/2955405098 >> v2:172.21.15.117:3300/0 conn(0x7f37600afd70 msgr2=0x7f376015d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:16.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:16.151+0000 7f3765d85640 1 --2- 172.21.15.53:0/2955405098 >> v2:172.21.15.117:3300/0 conn(0x7f37600afd70 0x7f376015d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:16.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:16.151+0000 7f3765d85640 1 -- 172.21.15.53:0/2955405098 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f376006bc80 con 0x7f37600ca050 2023-06-10T18:56:16.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:16.155+0000 7f3765d85640 1 --2- 172.21.15.53:0/2955405098 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37600ca050 0x7f37600af830 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f376006eef0 tx=0x7f375001c1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7877fcc6b90aaa57 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:16.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:16.155+0000 7f3765584640 1 -- 172.21.15.53:0/2955405098 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37500ab600 con 0x7f37600ca050 2023-06-10T18:56:16.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:16.155+0000 7f3765584640 1 -- 172.21.15.53:0/2955405098 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37500a7050 con 0x7f37600ca050 2023-06-10T18:56:16.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:16.155+0000 7f3765584640 1 -- 172.21.15.53:0/2955405098 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37500ab980 con 0x7f37600ca050 2023-06-10T18:56:16.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:16.155+0000 7f37687ea640 1 -- 172.21.15.53:0/2955405098 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37600ca050 msgr2=0x7f37600af830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:16.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:16.155+0000 7f37687ea640 1 --2- 172.21.15.53:0/2955405098 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37600ca050 0x7f37600af830 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f376006eef0 tx=0x7f375001c1b0 comp rx=0 tx=0).stop 2023-06-10T18:56:16.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:16.155+0000 7f37687ea640 1 -- 172.21.15.53:0/2955405098 shutdown_connections 2023-06-10T18:56:16.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:16.155+0000 7f37687ea640 1 --2- 172.21.15.53:0/2955405098 >> v2:172.21.15.117:3300/0 conn(0x7f37600afd70 0x7f376015d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:16.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:16.155+0000 7f37687ea640 1 --2- 172.21.15.53:0/2955405098 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37600ca050 0x7f37600af830 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:16.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:16.155+0000 7f37687ea640 1 --2- 172.21.15.53:0/2955405098 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3760159940 0x7f37600c9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:16.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:16.155+0000 7f37687ea640 1 -- 172.21.15.53:0/2955405098 >> 172.21.15.53:0/2955405098 conn(0x7f37600ca830 msgr2=0x7f37600cac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:16.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:16.155+0000 7f37687ea640 1 -- 172.21.15.53:0/2955405098 shutdown_connections 2023-06-10T18:56:16.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:16.155+0000 7f37687ea640 1 -- 172.21.15.53:0/2955405098 wait complete. 2023-06-10T18:56:16.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:16.159+0000 7f37687ea640 1 Processor -- start 2023-06-10T18:56:16.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:16.159+0000 7f37687ea640 1 -- start start 2023-06-10T18:56:16.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:16.159+0000 7f37687ea640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37600afd70 0x7f376015aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:16.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:16.159+0000 7f37687ea640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f37600ca050 0x7f37601446d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:16.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:16.159+0000 7f37687ea640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3760159940 0x7f376015baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:16.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:16.159+0000 7f37687ea640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f376015af40 con 0x7f37600afd70 2023-06-10T18:56:16.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:16.159+0000 7f37687ea640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3760159f60 con 0x7f37600ca050 2023-06-10T18:56:16.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:16.159+0000 7f37687ea640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f376015c460 con 0x7f3760159940 2023-06-10T18:56:16.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:16.159+0000 7f3766586640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37600afd70 0x7f376015aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:16.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:16.159+0000 7f3766586640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37600afd70 0x7f376015aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33678/0 (socket says 172.21.15.53:33678) 2023-06-10T18:56:16.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:16.159+0000 7f3766586640 1 -- 172.21.15.53:0/2225995476 learned_addr learned my addr 172.21.15.53:0/2225995476 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:16.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:16.159+0000 7f3766d87640 1 --2- 172.21.15.53:0/2225995476 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3760159940 0x7f376015baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:16.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:16.159+0000 7f3765d85640 1 --2- 172.21.15.53:0/2225995476 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f37600ca050 0x7f37601446d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:16.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:16.159+0000 7f3766586640 1 -- 172.21.15.53:0/2225995476 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3760159940 msgr2=0x7f376015baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:16.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:16.159+0000 7f3766586640 1 --2- 172.21.15.53:0/2225995476 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3760159940 0x7f376015baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:16.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:16.159+0000 7f3766586640 1 -- 172.21.15.53:0/2225995476 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f37600ca050 msgr2=0x7f37601446d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:16.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:16.159+0000 7f3766586640 1 --2- 172.21.15.53:0/2225995476 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f37600ca050 0x7f37601446d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:16.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:16.159+0000 7f3766586640 1 -- 172.21.15.53:0/2225995476 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37500094d0 con 0x7f37600afd70 2023-06-10T18:56:16.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:16.159+0000 7f3766d87640 1 --2- 172.21.15.53:0/2225995476 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3760159940 0x7f376015baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:56:16.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:16.159+0000 7f3766586640 1 --2- 172.21.15.53:0/2225995476 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37600afd70 0x7f376015aa00 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f375c00d5f0 tx=0x7f375c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:16.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:16.159+0000 7f3756ffd640 1 -- 172.21.15.53:0/2225995476 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f375c0125f0 con 0x7f37600afd70 2023-06-10T18:56:16.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:16.159+0000 7f3756ffd640 1 -- 172.21.15.53:0/2225995476 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f375c012750 con 0x7f37600afd70 2023-06-10T18:56:16.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:16.159+0000 7f3756ffd640 1 -- 172.21.15.53:0/2225995476 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f375c012ae0 con 0x7f37600afd70 2023-06-10T18:56:16.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:16.159+0000 7f37687ea640 1 -- 172.21.15.53:0/2225995476 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f376015a200 con 0x7f37600afd70 2023-06-10T18:56:16.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:16.159+0000 7f37687ea640 1 -- 172.21.15.53:0/2225995476 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f376015c740 con 0x7f37600afd70 2023-06-10T18:56:16.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:16.159+0000 7f37687ea640 1 -- 172.21.15.53:0/2225995476 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f376004d790 con 0x7f37600afd70 2023-06-10T18:56:16.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:16.163+0000 7f3756ffd640 1 -- 172.21.15.53:0/2225995476 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f375c012c40 con 0x7f37600afd70 2023-06-10T18:56:16.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:16.163+0000 7f3756ffd640 1 --2- 172.21.15.53:0/2225995476 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3744066280 0x7f3744068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:16.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:16.163+0000 7f3756ffd640 1 -- 172.21.15.53:0/2225995476 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f375c083eb0 con 0x7f37600afd70 2023-06-10T18:56:16.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:16.163+0000 7f3765d85640 1 --2- 172.21.15.53:0/2225995476 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3744066280 0x7f3744068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:16.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:16.163+0000 7f3765d85640 1 --2- 172.21.15.53:0/2225995476 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3744066280 0x7f3744068730 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f37500ad000 tx=0x7f37500a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:16.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:16.167+0000 7f3756ffd640 1 -- 172.21.15.53:0/2225995476 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f375c051680 con 0x7f37600afd70 2023-06-10T18:56:16.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:16.323+0000 7f37687ea640 1 -- 172.21.15.53:0/2225995476 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f37600b3190 con 0x7f37600afd70 2023-06-10T18:56:17.291 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_metadata' created 2023-06-10T18:56:17.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:17.287+0000 7f3756ffd640 1 -- 172.21.15.53:0/2225995476 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v48) v1 ==== 138+0+0 (secure 0 0 0) 0x7f375c054ca0 con 0x7f37600afd70 2023-06-10T18:56:17.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:17.291+0000 7f37687ea640 1 -- 172.21.15.53:0/2225995476 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3744066280 msgr2=0x7f3744068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:17.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:17.291+0000 7f37687ea640 1 --2- 172.21.15.53:0/2225995476 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3744066280 0x7f3744068730 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f37500ad000 tx=0x7f37500a6000 comp rx=0 tx=0).stop 2023-06-10T18:56:17.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:17.291+0000 7f37687ea640 1 -- 172.21.15.53:0/2225995476 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37600afd70 msgr2=0x7f376015aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:17.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:17.291+0000 7f37687ea640 1 --2- 172.21.15.53:0/2225995476 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37600afd70 0x7f376015aa00 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f375c00d5f0 tx=0x7f375c00dab0 comp rx=0 tx=0).stop 2023-06-10T18:56:17.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:17.291+0000 7f37687ea640 1 -- 172.21.15.53:0/2225995476 shutdown_connections 2023-06-10T18:56:17.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:17.291+0000 7f37687ea640 1 --2- 172.21.15.53:0/2225995476 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3744066280 0x7f3744068730 secure :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f37500ad000 tx=0x7f37500a6000 comp rx=0 tx=0).stop 2023-06-10T18:56:17.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:17.291+0000 7f37687ea640 1 --2- 172.21.15.53:0/2225995476 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3760159940 0x7f376015baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:17.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:17.291+0000 7f37687ea640 1 --2- 172.21.15.53:0/2225995476 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f37600ca050 0x7f37601446d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:17.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:17.291+0000 7f37687ea640 1 --2- 172.21.15.53:0/2225995476 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37600afd70 0x7f376015aa00 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:17.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:17.291+0000 7f37687ea640 1 -- 172.21.15.53:0/2225995476 >> 172.21.15.53:0/2225995476 conn(0x7f37600ca830 msgr2=0x7f376014f240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:17.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:17.291+0000 7f37687ea640 1 -- 172.21.15.53:0/2225995476 shutdown_connections 2023-06-10T18:56:17.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:17.291+0000 7f37687ea640 1 -- 172.21.15.53:0/2225995476 wait complete. 2023-06-10T18:56:17.320 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-06-10T18:56:17.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:17.443+0000 7fb3617c6640 1 Processor -- start 2023-06-10T18:56:17.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:17.447+0000 7fb3617c6640 1 -- start start 2023-06-10T18:56:17.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:17.447+0000 7fb3617c6640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb35c0af810 0x7fb35c0cd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:17.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:17.447+0000 7fb3617c6640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb35c1599b0 0x7fb35c0afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:17.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:17.447+0000 7fb3617c6640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb35c0ccee0 con 0x7fb35c070460 2023-06-10T18:56:17.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:17.447+0000 7fb3617c6640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb35c0cc070 con 0x7fb35c1599b0 2023-06-10T18:56:17.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:17.447+0000 7fb3617c6640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb35c0b0120 con 0x7fb35c0af810 2023-06-10T18:56:17.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:17.447+0000 7fb35a7fc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb35c1599b0 0x7fb35c0afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:17.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:17.447+0000 7fb35b7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fb35c070460 0x7fb35c0cb960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41424/0 (socket says 172.21.15.53:41424) 2023-06-10T18:56:17.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:17.447+0000 7fb35b7fe640 1 -- 172.21.15.53:0/814839357 learned_addr learned my addr 172.21.15.53:0/814839357 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:56:17.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:17.447+0000 7fb35affd640 1 --2- 172.21.15.53:0/814839357 >> v2:172.21.15.117:3300/0 conn(0x7fb35c0af810 0x7fb35c0cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:17.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:17.447+0000 7fb35a7fc640 1 -- 172.21.15.53:0/814839357 >> v2:172.21.15.117:3300/0 conn(0x7fb35c0af810 msgr2=0x7fb35c0cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:17.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:17.447+0000 7fb35a7fc640 1 --2- 172.21.15.53:0/814839357 >> v2:172.21.15.117:3300/0 conn(0x7fb35c0af810 0x7fb35c0cd370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:17.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:17.447+0000 7fb35a7fc640 1 -- 172.21.15.53:0/814839357 >> v1:172.21.15.53:6789/0 conn(0x7fb35c070460 legacy=0x7fb35c0cb960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:17.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:17.447+0000 7fb35a7fc640 1 -- 172.21.15.53:0/814839357 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb35c0cc2d0 con 0x7fb35c1599b0 2023-06-10T18:56:17.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:17.451+0000 7fb35a7fc640 1 --2- 172.21.15.53:0/814839357 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb35c1599b0 0x7fb35c0afbe0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fb35c0c4e10 tx=0x7fb34c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8238995a1ad7b322 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:17.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:17.451+0000 7fb359ffb640 1 -- 172.21.15.53:0/814839357 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb34c0a7070 con 0x7fb35c1599b0 2023-06-10T18:56:17.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:17.451+0000 7fb359ffb640 1 -- 172.21.15.53:0/814839357 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb34c0ab430 con 0x7fb35c1599b0 2023-06-10T18:56:17.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:17.451+0000 7fb359ffb640 1 -- 172.21.15.53:0/814839357 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb34c0ab7c0 con 0x7fb35c1599b0 2023-06-10T18:56:17.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:17.451+0000 7fb3617c6640 1 -- 172.21.15.53:0/814839357 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb35c1599b0 msgr2=0x7fb35c0afbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:17.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:17.451+0000 7fb3617c6640 1 --2- 172.21.15.53:0/814839357 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb35c1599b0 0x7fb35c0afbe0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fb35c0c4e10 tx=0x7fb34c01c430 comp rx=0 tx=0).stop 2023-06-10T18:56:17.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:17.451+0000 7fb3617c6640 1 -- 172.21.15.53:0/814839357 shutdown_connections 2023-06-10T18:56:17.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:17.451+0000 7fb3617c6640 1 --2- 172.21.15.53:0/814839357 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb35c1599b0 0x7fb35c0afbe0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:17.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:17.451+0000 7fb3617c6640 1 --2- 172.21.15.53:0/814839357 >> v2:172.21.15.117:3300/0 conn(0x7fb35c0af810 0x7fb35c0cd370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:17.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:17.451+0000 7fb3617c6640 1 -- 172.21.15.53:0/814839357 >> 172.21.15.53:0/814839357 conn(0x7fb35c06a0e0 msgr2=0x7fb35c0ca810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:17.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:17.451+0000 7fb3617c6640 1 -- 172.21.15.53:0/814839357 shutdown_connections 2023-06-10T18:56:17.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:17.451+0000 7fb3617c6640 1 -- 172.21.15.53:0/814839357 wait complete. 2023-06-10T18:56:17.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:17.451+0000 7fb3617c6640 1 Processor -- start 2023-06-10T18:56:17.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:17.451+0000 7fb3617c6640 1 -- start start 2023-06-10T18:56:17.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:17.451+0000 7fb3617c6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb35c070460 0x7fb35c14e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:17.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:17.451+0000 7fb3617c6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb35c0af810 0x7fb35c150300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:17.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:17.451+0000 7fb3617c6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb35c1599b0 0x7fb35c0ae780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:17.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:17.451+0000 7fb3617c6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb35c153e20 con 0x7fb35c070460 2023-06-10T18:56:17.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:17.451+0000 7fb3617c6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb35c150840 con 0x7fb35c1599b0 2023-06-10T18:56:17.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:17.451+0000 7fb3617c6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb35c153b40 con 0x7fb35c0af810 2023-06-10T18:56:17.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:17.451+0000 7fb35affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb35c070460 0x7fb35c14e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:17.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:17.451+0000 7fb35affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb35c070460 0x7fb35c14e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33696/0 (socket says 172.21.15.53:33696) 2023-06-10T18:56:17.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:17.451+0000 7fb35affd640 1 -- 172.21.15.53:0/4224089369 learned_addr learned my addr 172.21.15.53:0/4224089369 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:17.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:17.451+0000 7fb35a7fc640 1 --2- 172.21.15.53:0/4224089369 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb35c0af810 0x7fb35c150300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:17.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:17.451+0000 7fb35b7fe640 1 --2- 172.21.15.53:0/4224089369 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb35c1599b0 0x7fb35c0ae780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:17.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:17.451+0000 7fb35affd640 1 -- 172.21.15.53:0/4224089369 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb35c0af810 msgr2=0x7fb35c150300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:17.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:17.451+0000 7fb35affd640 1 --2- 172.21.15.53:0/4224089369 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb35c0af810 0x7fb35c150300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:17.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:17.451+0000 7fb35affd640 1 -- 172.21.15.53:0/4224089369 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb35c1599b0 msgr2=0x7fb35c0ae780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:17.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:17.451+0000 7fb35affd640 1 --2- 172.21.15.53:0/4224089369 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb35c1599b0 0x7fb35c0ae780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:17.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:17.451+0000 7fb35affd640 1 -- 172.21.15.53:0/4224089369 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb34c009420 con 0x7fb35c070460 2023-06-10T18:56:17.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:17.451+0000 7fb35b7fe640 1 --2- 172.21.15.53:0/4224089369 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb35c1599b0 0x7fb35c0ae780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:56:17.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:17.451+0000 7fb35a7fc640 1 --2- 172.21.15.53:0/4224089369 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb35c0af810 0x7fb35c150300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:56:17.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:17.451+0000 7fb35affd640 1 --2- 172.21.15.53:0/4224089369 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb35c070460 0x7fb35c14e4f0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fb35000d800 tx=0x7fb35000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:17.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:17.455+0000 7fb3437fe640 1 -- 172.21.15.53:0/4224089369 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb35000b6c0 con 0x7fb35c070460 2023-06-10T18:56:17.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:17.455+0000 7fb3437fe640 1 -- 172.21.15.53:0/4224089369 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb35000b820 con 0x7fb35c070460 2023-06-10T18:56:17.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:17.455+0000 7fb3617c6640 1 -- 172.21.15.53:0/4224089369 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb35c154bd0 con 0x7fb35c070460 2023-06-10T18:56:17.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:17.455+0000 7fb3437fe640 1 -- 172.21.15.53:0/4224089369 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb35000bb90 con 0x7fb35c070460 2023-06-10T18:56:17.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:17.455+0000 7fb3617c6640 1 -- 172.21.15.53:0/4224089369 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb35c155190 con 0x7fb35c070460 2023-06-10T18:56:17.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:17.455+0000 7fb3617c6640 1 -- 172.21.15.53:0/4224089369 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb35c04d790 con 0x7fb35c070460 2023-06-10T18:56:17.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:17.455+0000 7fb3437fe640 1 -- 172.21.15.53:0/4224089369 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb35000bcf0 con 0x7fb35c070460 2023-06-10T18:56:17.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:17.455+0000 7fb3437fe640 1 --2- 172.21.15.53:0/4224089369 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb348066280 0x7fb348068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:17.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:17.455+0000 7fb3437fe640 1 -- 172.21.15.53:0/4224089369 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5580+0+0 (secure 0 0 0) 0x7fb350084b80 con 0x7fb35c070460 2023-06-10T18:56:17.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:17.455+0000 7fb35a7fc640 1 --2- 172.21.15.53:0/4224089369 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb348066280 0x7fb348068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:17.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:17.455+0000 7fb35a7fc640 1 --2- 172.21.15.53:0/4224089369 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb348066280 0x7fb348068730 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb34c0af000 tx=0x7fb34c0b6040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:17.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:17.459+0000 7fb3437fe640 1 -- 172.21.15.53:0/4224089369 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb350055d50 con 0x7fb35c070460 2023-06-10T18:56:17.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:17.615+0000 7fb3617c6640 1 -- 172.21.15.53:0/4224089369 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fb35c0c9c10 con 0x7fb35c070460 2023-06-10T18:56:18.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.303+0000 7fb3437fe640 1 -- 172.21.15.53:0/4224089369 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v49) v1 ==== 170+0+0 (secure 0 0 0) 0x7fb3500558e0 con 0x7fb35c070460 2023-06-10T18:56:18.310 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_data' created 2023-06-10T18:56:18.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.311+0000 7fb3617c6640 1 -- 172.21.15.53:0/4224089369 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb348066280 msgr2=0x7fb348068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:18.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.311+0000 7fb3617c6640 1 --2- 172.21.15.53:0/4224089369 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb348066280 0x7fb348068730 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb34c0af000 tx=0x7fb34c0b6040 comp rx=0 tx=0).stop 2023-06-10T18:56:18.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.311+0000 7fb3617c6640 1 -- 172.21.15.53:0/4224089369 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb35c070460 msgr2=0x7fb35c14e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:18.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.311+0000 7fb3617c6640 1 --2- 172.21.15.53:0/4224089369 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb35c070460 0x7fb35c14e4f0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fb35000d800 tx=0x7fb35000dcc0 comp rx=0 tx=0).stop 2023-06-10T18:56:18.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.315+0000 7fb3617c6640 1 -- 172.21.15.53:0/4224089369 shutdown_connections 2023-06-10T18:56:18.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.315+0000 7fb3617c6640 1 --2- 172.21.15.53:0/4224089369 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb348066280 0x7fb348068730 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:18.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.315+0000 7fb3617c6640 1 --2- 172.21.15.53:0/4224089369 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb35c1599b0 0x7fb35c0ae780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:18.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.315+0000 7fb3617c6640 1 --2- 172.21.15.53:0/4224089369 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb35c0af810 0x7fb35c150300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:18.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.315+0000 7fb3617c6640 1 --2- 172.21.15.53:0/4224089369 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb35c070460 0x7fb35c14e4f0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:18.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.315+0000 7fb3617c6640 1 -- 172.21.15.53:0/4224089369 >> 172.21.15.53:0/4224089369 conn(0x7fb35c06a0e0 msgr2=0x7fb35c0c9160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:18.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.315+0000 7fb3617c6640 1 -- 172.21.15.53:0/4224089369 shutdown_connections 2023-06-10T18:56:18.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.319+0000 7fb3617c6640 1 -- 172.21.15.53:0/4224089369 wait complete. 2023-06-10T18:56:18.355 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-06-10T18:56:18.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.475+0000 7fcfd48d3640 1 Processor -- start 2023-06-10T18:56:18.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.475+0000 7fcfd48d3640 1 -- start start 2023-06-10T18:56:18.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.475+0000 7fcfd48d3640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fcfd00c9fa0 0x7fcfd006bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:18.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.475+0000 7fcfd48d3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfd00af760 0x7fcfd00afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:18.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.475+0000 7fcfd48d3640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfd006b090 con 0x7fcfd006c020 2023-06-10T18:56:18.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.475+0000 7fcfd48d3640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfd00b0120 con 0x7fcfd00c9fa0 2023-06-10T18:56:18.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.475+0000 7fcfd48d3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd00ca370 con 0x7fcfd00af760 2023-06-10T18:56:18.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.475+0000 7fcfce59c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fcfd00c9fa0 0x7fcfd006bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:18.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.475+0000 7fcfced9d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfd00af760 0x7fcfd00afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:18.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.475+0000 7fcfce59c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fcfd00c9fa0 0x7fcfd006bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.53:35250/0 (socket says 172.21.15.53:35250) 2023-06-10T18:56:18.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.475+0000 7fcfcdd9b640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fcfd006c020 0x7fcfd00c82a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.53:39670/0 (socket says 172.21.15.53:39670) 2023-06-10T18:56:18.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.475+0000 7fcfce59c640 1 -- 172.21.15.53:0/1422876900 learned_addr learned my addr 172.21.15.53:0/1422876900 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:18.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.475+0000 7fcfced9d640 1 -- 172.21.15.53:0/1422876900 >> v2:172.21.15.117:3300/0 conn(0x7fcfd00c9fa0 msgr2=0x7fcfd006bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:18.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.475+0000 7fcfced9d640 1 --2- 172.21.15.53:0/1422876900 >> v2:172.21.15.117:3300/0 conn(0x7fcfd00c9fa0 0x7fcfd006bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:18.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.475+0000 7fcfced9d640 1 -- 172.21.15.53:0/1422876900 >> v1:172.21.15.117:6789/0 conn(0x7fcfd006c020 legacy=0x7fcfd00c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:18.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.475+0000 7fcfced9d640 1 -- 172.21.15.53:0/1422876900 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd0070d50 con 0x7fcfd00af760 2023-06-10T18:56:18.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.479+0000 7fcfced9d640 1 --2- 172.21.15.53:0/1422876900 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfd00af760 0x7fcfd00afbe0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fcfc8009d90 tx=0x7fcfc801c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7ee17ade0f4a256 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:18.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.479+0000 7fcfcd59a640 1 -- 172.21.15.53:0/1422876900 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc80a5860 con 0x7fcfd00af760 2023-06-10T18:56:18.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.479+0000 7fcfcd59a640 1 -- 172.21.15.53:0/1422876900 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfc80a59c0 con 0x7fcfd00af760 2023-06-10T18:56:18.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.479+0000 7fcfcd59a640 1 -- 172.21.15.53:0/1422876900 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc80a5d50 con 0x7fcfd00af760 2023-06-10T18:56:18.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.479+0000 7fcfd48d3640 1 -- 172.21.15.53:0/1422876900 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfd00af760 msgr2=0x7fcfd00afbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:18.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.479+0000 7fcfd48d3640 1 --2- 172.21.15.53:0/1422876900 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfd00af760 0x7fcfd00afbe0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fcfc8009d90 tx=0x7fcfc801c890 comp rx=0 tx=0).stop 2023-06-10T18:56:18.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.479+0000 7fcfd48d3640 1 -- 172.21.15.53:0/1422876900 shutdown_connections 2023-06-10T18:56:18.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.479+0000 7fcfd48d3640 1 --2- 172.21.15.53:0/1422876900 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfd00af760 0x7fcfd00afbe0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:18.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.479+0000 7fcfd48d3640 1 --2- 172.21.15.53:0/1422876900 >> v2:172.21.15.117:3300/0 conn(0x7fcfd00c9fa0 0x7fcfd006bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:18.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.479+0000 7fcfd48d3640 1 -- 172.21.15.53:0/1422876900 >> 172.21.15.53:0/1422876900 conn(0x7fcfd006a0e0 msgr2=0x7fcfd00cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:18.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.479+0000 7fcfd48d3640 1 -- 172.21.15.53:0/1422876900 shutdown_connections 2023-06-10T18:56:18.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.479+0000 7fcfd48d3640 1 -- 172.21.15.53:0/1422876900 wait complete. 2023-06-10T18:56:18.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.479+0000 7fcfd48d3640 1 Processor -- start 2023-06-10T18:56:18.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.479+0000 7fcfd48d3640 1 -- start start 2023-06-10T18:56:18.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.483+0000 7fcfd48d3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcfd006c020 0x7fcfd01f4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:18.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.483+0000 7fcfd48d3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcfd00af760 0x7fcfd0148410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:18.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.483+0000 7fcfd48d3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfd00c9fa0 0x7fcfd01633f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:18.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.483+0000 7fcfd48d3640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd0148950 con 0x7fcfd006c020 2023-06-10T18:56:18.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.483+0000 7fcfd48d3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd0163930 con 0x7fcfd00af760 2023-06-10T18:56:18.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.483+0000 7fcfd48d3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd01f4a10 con 0x7fcfd00c9fa0 2023-06-10T18:56:18.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.483+0000 7fcfce59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcfd006c020 0x7fcfd01f4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:18.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.483+0000 7fcfce59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcfd006c020 0x7fcfd01f4320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33706/0 (socket says 172.21.15.53:33706) 2023-06-10T18:56:18.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.483+0000 7fcfce59c640 1 -- 172.21.15.53:0/432834150 learned_addr learned my addr 172.21.15.53:0/432834150 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:18.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.483+0000 7fcfced9d640 1 --2- 172.21.15.53:0/432834150 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfd00c9fa0 0x7fcfd01633f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:18.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.483+0000 7fcfcdd9b640 1 --2- 172.21.15.53:0/432834150 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcfd00af760 0x7fcfd0148410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:18.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.483+0000 7fcfce59c640 1 -- 172.21.15.53:0/432834150 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfd00c9fa0 msgr2=0x7fcfd01633f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:18.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.483+0000 7fcfce59c640 1 --2- 172.21.15.53:0/432834150 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfd00c9fa0 0x7fcfd01633f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:18.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.483+0000 7fcfce59c640 1 -- 172.21.15.53:0/432834150 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcfd00af760 msgr2=0x7fcfd0148410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:18.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.483+0000 7fcfce59c640 1 --2- 172.21.15.53:0/432834150 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcfd00af760 0x7fcfd0148410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:18.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.483+0000 7fcfce59c640 1 -- 172.21.15.53:0/432834150 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfc8009a70 con 0x7fcfd006c020 2023-06-10T18:56:18.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.483+0000 7fcfce59c640 1 --2- 172.21.15.53:0/432834150 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcfd006c020 0x7fcfd01f4320 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fcfc000e890 tx=0x7fcfc000ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:18.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.483+0000 7fcfc6ffd640 1 -- 172.21.15.53:0/432834150 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc0009620 con 0x7fcfd006c020 2023-06-10T18:56:18.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.483+0000 7fcfc6ffd640 1 -- 172.21.15.53:0/432834150 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfc000c940 con 0x7fcfd006c020 2023-06-10T18:56:18.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.483+0000 7fcfd48d3640 1 -- 172.21.15.53:0/432834150 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfd01f4cf0 con 0x7fcfd006c020 2023-06-10T18:56:18.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.483+0000 7fcfc6ffd640 1 -- 172.21.15.53:0/432834150 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc000ccf0 con 0x7fcfd006c020 2023-06-10T18:56:18.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.483+0000 7fcfd48d3640 1 -- 172.21.15.53:0/432834150 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfd01f52b0 con 0x7fcfd006c020 2023-06-10T18:56:18.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.483+0000 7fcfd48d3640 1 -- 172.21.15.53:0/432834150 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfd00ad3a0 con 0x7fcfd006c020 2023-06-10T18:56:18.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.483+0000 7fcfc6ffd640 1 -- 172.21.15.53:0/432834150 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcfc0013470 con 0x7fcfd006c020 2023-06-10T18:56:18.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.483+0000 7fcfc6ffd640 1 --2- 172.21.15.53:0/432834150 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcfb4066280 0x7fcfb4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:18.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.483+0000 7fcfc6ffd640 1 -- 172.21.15.53:0/432834150 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5962+0+0 (secure 0 0 0) 0x7fcfc0083e30 con 0x7fcfd006c020 2023-06-10T18:56:18.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.487+0000 7fcfcdd9b640 1 --2- 172.21.15.53:0/432834150 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcfb4066280 0x7fcfb4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:18.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.487+0000 7fcfcdd9b640 1 --2- 172.21.15.53:0/432834150 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcfb4066280 0x7fcfb4068730 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fcfd00ad2d0 tx=0x7fcfb8007c90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:18.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.491+0000 7fcfc6ffd640 1 -- 172.21.15.53:0/432834150 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcfc00513a0 con 0x7fcfd006c020 2023-06-10T18:56:18.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.679+0000 7fcfd48d3640 1 -- 172.21.15.53:0/432834150 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fcfd004d790 con 0x7fcfd006c020 2023-06-10T18:56:18.698 INFO:teuthology.orchestra.run.smithi053.stderr:new fs with metadata pool 7 and data pool 8 2023-06-10T18:56:18.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.691+0000 7fcfc6ffd640 1 -- 172.21.15.53:0/432834150 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 7 and data pool 8 v17) v1 ==== 172+0+0 (secure 0 0 0) 0x7fcfc00170c0 con 0x7fcfd006c020 2023-06-10T18:56:18.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.699+0000 7fcfd48d3640 1 -- 172.21.15.53:0/432834150 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcfb4066280 msgr2=0x7fcfb4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:18.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.699+0000 7fcfd48d3640 1 --2- 172.21.15.53:0/432834150 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcfb4066280 0x7fcfb4068730 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fcfd00ad2d0 tx=0x7fcfb8007c90 comp rx=0 tx=0).stop 2023-06-10T18:56:18.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.699+0000 7fcfd48d3640 1 -- 172.21.15.53:0/432834150 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcfd006c020 msgr2=0x7fcfd01f4320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:18.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.699+0000 7fcfd48d3640 1 --2- 172.21.15.53:0/432834150 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcfd006c020 0x7fcfd01f4320 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fcfc000e890 tx=0x7fcfc000ed50 comp rx=0 tx=0).stop 2023-06-10T18:56:18.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.699+0000 7fcfd48d3640 1 -- 172.21.15.53:0/432834150 shutdown_connections 2023-06-10T18:56:18.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.699+0000 7fcfd48d3640 1 --2- 172.21.15.53:0/432834150 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcfb4066280 0x7fcfb4068730 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:18.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.699+0000 7fcfd48d3640 1 --2- 172.21.15.53:0/432834150 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfd00c9fa0 0x7fcfd01633f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:18.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.699+0000 7fcfd48d3640 1 --2- 172.21.15.53:0/432834150 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcfd00af760 0x7fcfd0148410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:18.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.699+0000 7fcfd48d3640 1 --2- 172.21.15.53:0/432834150 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcfd006c020 0x7fcfd01f4320 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:18.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.699+0000 7fcfd48d3640 1 -- 172.21.15.53:0/432834150 >> 172.21.15.53:0/432834150 conn(0x7fcfd006a0e0 msgr2=0x7fcfd00c8280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:18.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.707+0000 7fcfd48d3640 1 -- 172.21.15.53:0/432834150 shutdown_connections 2023-06-10T18:56:18.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.707+0000 7fcfd48d3640 1 -- 172.21.15.53:0/432834150 wait complete. 2023-06-10T18:56:18.742 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T18:56:18.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.855+0000 7f7e59963640 1 Processor -- start 2023-06-10T18:56:18.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.855+0000 7f7e59963640 1 -- start start 2023-06-10T18:56:18.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.855+0000 7f7e59963640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7e54071060 0x7f7e540af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:18.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.855+0000 7f7e59963640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e540afc60 0x7f7e5406b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:18.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.855+0000 7f7e59963640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e54159b50 con 0x7f7e540c9840 2023-06-10T18:56:18.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.855+0000 7f7e59963640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e540702a0 con 0x7f7e54071060 2023-06-10T18:56:18.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.855+0000 7f7e59963640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e54070580 con 0x7f7e540afc60 2023-06-10T18:56:18.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.855+0000 7f7e52ffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f7e540c9840 0x7f7e540c9c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41436/0 (socket says 172.21.15.53:41436) 2023-06-10T18:56:18.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.855+0000 7f7e52ffd640 1 -- 172.21.15.53:0/33189442 learned_addr learned my addr 172.21.15.53:0/33189442 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:56:18.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.855+0000 7f7e527fc640 1 -- 172.21.15.53:0/33189442 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2484205509 0 0) 0x7f7e54159b50 con 0x7f7e540c9840 2023-06-10T18:56:18.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.855+0000 7f7e527fc640 1 -- 172.21.15.53:0/33189442 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e40003530 con 0x7f7e540c9840 2023-06-10T18:56:18.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.855+0000 7f7e4bfff640 1 --2- 172.21.15.53:0/33189442 >> v2:172.21.15.117:3300/0 conn(0x7f7e54071060 0x7f7e540af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:18.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.855+0000 7f7e537fe640 1 --2- 172.21.15.53:0/33189442 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e540afc60 0x7f7e5406b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:18.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.855+0000 7f7e527fc640 1 -- 172.21.15.53:0/33189442 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3784643027 0 0) 0x7f7e40003530 con 0x7f7e540c9840 2023-06-10T18:56:18.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.855+0000 7f7e527fc640 1 -- 172.21.15.53:0/33189442 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e540afc60 msgr2=0x7f7e5406b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:18.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.855+0000 7f7e527fc640 1 --2- 172.21.15.53:0/33189442 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e540afc60 0x7f7e5406b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:18.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.855+0000 7f7e527fc640 1 -- 172.21.15.53:0/33189442 >> v2:172.21.15.117:3300/0 conn(0x7f7e54071060 msgr2=0x7f7e540af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:18.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.855+0000 7f7e527fc640 1 --2- 172.21.15.53:0/33189442 >> v2:172.21.15.117:3300/0 conn(0x7f7e54071060 0x7f7e540af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:18.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.855+0000 7f7e527fc640 1 -- 172.21.15.53:0/33189442 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e54070860 con 0x7f7e540c9840 2023-06-10T18:56:18.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.855+0000 7f7e527fc640 1 -- 172.21.15.53:0/33189442 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f7e44001680 con 0x7f7e540c9840 2023-06-10T18:56:18.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.855+0000 7f7e537fe640 1 --2- 172.21.15.53:0/33189442 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e540afc60 0x7f7e5406b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:56:18.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.855+0000 7f7e527fc640 1 -- 172.21.15.53:0/33189442 >> v1:172.21.15.53:6789/0 conn(0x7f7e540c9840 legacy=0x7f7e540c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:18.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.855+0000 7f7e527fc640 1 --2- 172.21.15.53:0/33189442 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e540afc60 0x7f7e400039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:18.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.855+0000 7f7e527fc640 1 --2- 172.21.15.53:0/33189442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e40003f30 0x7f7e400047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:18.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.855+0000 7f7e527fc640 1 --2- 172.21.15.53:0/33189442 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e40004d10 0x7f7e40005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:18.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.855+0000 7f7e527fc640 1 -- 172.21.15.53:0/33189442 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e540702a0 con 0x7f7e40003f30 2023-06-10T18:56:18.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.855+0000 7f7e527fc640 1 -- 172.21.15.53:0/33189442 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e54070580 con 0x7f7e40004d10 2023-06-10T18:56:18.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.855+0000 7f7e527fc640 1 -- 172.21.15.53:0/33189442 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e4000ba10 con 0x7f7e540afc60 2023-06-10T18:56:18.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.855+0000 7f7e4bfff640 1 --2- 172.21.15.53:0/33189442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e40003f30 0x7f7e400047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:18.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.855+0000 7f7e52ffd640 1 --2- 172.21.15.53:0/33189442 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e540afc60 0x7f7e400039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:18.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.855+0000 7f7e537fe640 1 --2- 172.21.15.53:0/33189442 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e40004d10 0x7f7e40005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:18.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.855+0000 7f7e4bfff640 1 -- 172.21.15.53:0/33189442 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e540afc60 msgr2=0x7f7e400039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:18.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.855+0000 7f7e4bfff640 1 --2- 172.21.15.53:0/33189442 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e540afc60 0x7f7e400039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:18.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.855+0000 7f7e4bfff640 1 -- 172.21.15.53:0/33189442 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e40004d10 msgr2=0x7f7e40005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:18.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.855+0000 7f7e4bfff640 1 --2- 172.21.15.53:0/33189442 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e40004d10 0x7f7e40005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:18.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.855+0000 7f7e4bfff640 1 -- 172.21.15.53:0/33189442 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e40003530 con 0x7f7e40003f30 2023-06-10T18:56:18.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.855+0000 7f7e537fe640 1 --2- 172.21.15.53:0/33189442 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e40004d10 0x7f7e40005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:56:18.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.859+0000 7f7e4bfff640 1 --2- 172.21.15.53:0/33189442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e40003f30 0x7f7e400047d0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c009ab0 tx=0x7f7e3c01ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1915cfc569a07af9 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:18.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.859+0000 7f7e527fc640 1 -- 172.21.15.53:0/33189442 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c0a5660 con 0x7f7e40003f30 2023-06-10T18:56:18.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.859+0000 7f7e527fc640 1 -- 172.21.15.53:0/33189442 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e3c0a57c0 con 0x7f7e40003f30 2023-06-10T18:56:18.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.859+0000 7f7e527fc640 1 -- 172.21.15.53:0/33189442 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c0a5b70 con 0x7f7e40003f30 2023-06-10T18:56:18.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.859+0000 7f7e59963640 1 -- 172.21.15.53:0/33189442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e40003f30 msgr2=0x7f7e400047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:18.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.859+0000 7f7e59963640 1 --2- 172.21.15.53:0/33189442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e40003f30 0x7f7e400047d0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c009ab0 tx=0x7f7e3c01ca70 comp rx=0 tx=0).stop 2023-06-10T18:56:18.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.859+0000 7f7e537fe640 1 -- 172.21.15.53:0/33189442 reap_dead start 2023-06-10T18:56:18.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.859+0000 7f7e59963640 1 -- 172.21.15.53:0/33189442 shutdown_connections 2023-06-10T18:56:18.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.859+0000 7f7e59963640 1 -- 172.21.15.53:0/33189442 >> 172.21.15.53:0/33189442 conn(0x7f7e5406a0d0 msgr2=0x7f7e540ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:18.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.859+0000 7f7e59963640 1 -- 172.21.15.53:0/33189442 shutdown_connections 2023-06-10T18:56:18.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.859+0000 7f7e59963640 1 -- 172.21.15.53:0/33189442 wait complete. 2023-06-10T18:56:18.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.859+0000 7f7e59963640 1 Processor -- start 2023-06-10T18:56:18.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.859+0000 7f7e59963640 1 -- start start 2023-06-10T18:56:18.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.859+0000 7f7e59963640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e5414e080 0x7f7e540b24c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:18.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.859+0000 7f7e59963640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e5415dbc0 0x7f7e540b0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:18.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.859+0000 7f7e59963640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e54156330 0x7f7e541567b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:18.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.859+0000 7f7e59963640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e54156cf0 con 0x7f7e5415dbc0 2023-06-10T18:56:18.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.859+0000 7f7e59963640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e540b1420 con 0x7f7e54156330 2023-06-10T18:56:18.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.859+0000 7f7e59963640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e540b1700 con 0x7f7e5414e080 2023-06-10T18:56:18.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.863+0000 7f7e4bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e5415dbc0 0x7f7e540b0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:18.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.863+0000 7f7e4bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e5415dbc0 0x7f7e540b0ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33726/0 (socket says 172.21.15.53:33726) 2023-06-10T18:56:18.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.863+0000 7f7e4bfff640 1 -- 172.21.15.53:0/1421108552 learned_addr learned my addr 172.21.15.53:0/1421108552 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:18.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.863+0000 7f7e52ffd640 1 --2- 172.21.15.53:0/1421108552 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e5414e080 0x7f7e540b24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:18.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.863+0000 7f7e537fe640 1 --2- 172.21.15.53:0/1421108552 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e54156330 0x7f7e541567b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:18.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.863+0000 7f7e4bfff640 1 -- 172.21.15.53:0/1421108552 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e5414e080 msgr2=0x7f7e540b24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:18.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.863+0000 7f7e4bfff640 1 --2- 172.21.15.53:0/1421108552 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e5414e080 0x7f7e540b24c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:18.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.863+0000 7f7e4bfff640 1 -- 172.21.15.53:0/1421108552 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e54156330 msgr2=0x7f7e541567b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:18.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.863+0000 7f7e4bfff640 1 --2- 172.21.15.53:0/1421108552 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e54156330 0x7f7e541567b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:18.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.863+0000 7f7e4bfff640 1 -- 172.21.15.53:0/1421108552 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e540b19e0 con 0x7f7e5415dbc0 2023-06-10T18:56:18.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.863+0000 7f7e537fe640 1 --2- 172.21.15.53:0/1421108552 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e54156330 0x7f7e541567b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:56:18.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.863+0000 7f7e4bfff640 1 --2- 172.21.15.53:0/1421108552 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e5415dbc0 0x7f7e540b0ad0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c01c8a0 tx=0x7f7e3c019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:18.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.863+0000 7f7e50ff9640 1 -- 172.21.15.53:0/1421108552 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c004020 con 0x7f7e5415dbc0 2023-06-10T18:56:18.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.863+0000 7f7e50ff9640 1 -- 172.21.15.53:0/1421108552 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e3c0041c0 con 0x7f7e5415dbc0 2023-06-10T18:56:18.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.863+0000 7f7e59963640 1 -- 172.21.15.53:0/1421108552 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e540b1cc0 con 0x7f7e5415dbc0 2023-06-10T18:56:18.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.863+0000 7f7e50ff9640 1 -- 172.21.15.53:0/1421108552 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c003620 con 0x7f7e5415dbc0 2023-06-10T18:56:18.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.863+0000 7f7e59963640 1 -- 172.21.15.53:0/1421108552 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e540b2a00 con 0x7f7e5415dbc0 2023-06-10T18:56:18.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.863+0000 7f7e59963640 1 -- 172.21.15.53:0/1421108552 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e5404d790 con 0x7f7e5415dbc0 2023-06-10T18:56:18.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.863+0000 7f7e50ff9640 1 -- 172.21.15.53:0/1421108552 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7e3c0b4070 con 0x7f7e5415dbc0 2023-06-10T18:56:18.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.863+0000 7f7e50ff9640 1 --2- 172.21.15.53:0/1421108552 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7e34066280 0x7f7e34068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:18.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.863+0000 7f7e50ff9640 1 -- 172.21.15.53:0/1421108552 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7e3c11e170 con 0x7f7e5415dbc0 2023-06-10T18:56:18.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.863+0000 7f7e52ffd640 1 --2- 172.21.15.53:0/1421108552 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7e34066280 0x7f7e34068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:18.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.863+0000 7f7e52ffd640 1 --2- 172.21.15.53:0/1421108552 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7e34066280 0x7f7e34068730 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f7e44001060 tx=0x7f7e44009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:18.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:18.867+0000 7f7e50ff9640 1 -- 172.21.15.53:0/1421108552 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7e3c0eb590 con 0x7f7e5415dbc0 2023-06-10T18:56:19.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.027+0000 7f7e59963640 1 -- 172.21.15.53:0/1421108552 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7e54159310 con 0x7f7e5415dbc0 2023-06-10T18:56:19.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.027+0000 7f7e50ff9640 1 -- 172.21.15.53:0/1421108552 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+18352 (secure 0 0 0) 0x7f7e3c0eebb0 con 0x7f7e5415dbc0 2023-06-10T18:56:19.033 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:56:19.033 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":50,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T18:56:18.681407+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-06-10T18:56:16.364582+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-06-10T18:56:17.656793+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T18:56:19.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.031+0000 7f7e59963640 1 -- 172.21.15.53:0/1421108552 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7e34066280 msgr2=0x7f7e34068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:19.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.031+0000 7f7e59963640 1 --2- 172.21.15.53:0/1421108552 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7e34066280 0x7f7e34068730 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f7e44001060 tx=0x7f7e44009040 comp rx=0 tx=0).stop 2023-06-10T18:56:19.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.031+0000 7f7e59963640 1 -- 172.21.15.53:0/1421108552 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e5415dbc0 msgr2=0x7f7e540b0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:19.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.031+0000 7f7e59963640 1 --2- 172.21.15.53:0/1421108552 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e5415dbc0 0x7f7e540b0ad0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c01c8a0 tx=0x7f7e3c019810 comp rx=0 tx=0).stop 2023-06-10T18:56:19.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.031+0000 7f7e59963640 1 -- 172.21.15.53:0/1421108552 shutdown_connections 2023-06-10T18:56:19.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.031+0000 7f7e59963640 1 --2- 172.21.15.53:0/1421108552 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7e34066280 0x7f7e34068730 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:19.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.031+0000 7f7e59963640 1 --2- 172.21.15.53:0/1421108552 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e54156330 0x7f7e541567b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:19.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.031+0000 7f7e59963640 1 --2- 172.21.15.53:0/1421108552 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e5415dbc0 0x7f7e540b0ad0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:19.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.031+0000 7f7e59963640 1 --2- 172.21.15.53:0/1421108552 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e5414e080 0x7f7e540b24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:19.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.031+0000 7f7e59963640 1 -- 172.21.15.53:0/1421108552 >> 172.21.15.53:0/1421108552 conn(0x7f7e5406a0d0 msgr2=0x7f7e540ad6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:19.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.031+0000 7f7e59963640 1 -- 172.21.15.53:0/1421108552 shutdown_connections 2023-06-10T18:56:19.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.031+0000 7f7e59963640 1 -- 172.21.15.53:0/1421108552 wait complete. 2023-06-10T18:56:19.052 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T18:56:19.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.167+0000 7fb07726b640 1 Processor -- start 2023-06-10T18:56:19.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.167+0000 7fb07726b640 1 -- start start 2023-06-10T18:56:19.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.171+0000 7fb07726b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb0700b3390 0x7fb0700af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:19.175 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.171+0000 7fb07726b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb070070e30 0x7fb0700c8d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:19.175 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.171+0000 7fb07726b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb0700c9240 0x7fb07006b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:19.175 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.171+0000 7fb07726b640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0700c82f0 con 0x7fb0700c9240 2023-06-10T18:56:19.175 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.171+0000 7fb07726b640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0700b3760 con 0x7fb0700b3390 2023-06-10T18:56:19.175 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.171+0000 7fb07726b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb070071280 con 0x7fb070070e30 2023-06-10T18:56:19.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.171+0000 7fb075808640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb0700c9240 0x7fb07006b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:19.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.171+0000 7fb075808640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb0700c9240 0x7fb07006b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33728/0 (socket says 172.21.15.53:33728) 2023-06-10T18:56:19.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.171+0000 7fb075808640 1 -- 172.21.15.53:0/2173808137 learned_addr learned my addr 172.21.15.53:0/2173808137 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:19.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.171+0000 7fb074806640 1 --2- 172.21.15.53:0/2173808137 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb070070e30 0x7fb0700c8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:19.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.171+0000 7fb075007640 1 --2- 172.21.15.53:0/2173808137 >> v2:172.21.15.117:3300/0 conn(0x7fb0700b3390 0x7fb0700af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:19.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.171+0000 7fb075808640 1 -- 172.21.15.53:0/2173808137 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb070070e30 msgr2=0x7fb0700c8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:19.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.171+0000 7fb075808640 1 --2- 172.21.15.53:0/2173808137 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb070070e30 0x7fb0700c8d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:19.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.171+0000 7fb075808640 1 -- 172.21.15.53:0/2173808137 >> v2:172.21.15.117:3300/0 conn(0x7fb0700b3390 msgr2=0x7fb0700af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:19.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.171+0000 7fb075808640 1 --2- 172.21.15.53:0/2173808137 >> v2:172.21.15.117:3300/0 conn(0x7fb0700b3390 0x7fb0700af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:19.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.171+0000 7fb075808640 1 -- 172.21.15.53:0/2173808137 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0700afe20 con 0x7fb0700c9240 2023-06-10T18:56:19.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.175+0000 7fb075808640 1 --2- 172.21.15.53:0/2173808137 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0700c9240 0x7fb07006b090 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fb07006ea70 tx=0x7fb06801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1970b61187bff14e server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:19.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.175+0000 7fb067fff640 1 -- 172.21.15.53:0/2173808137 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0680ac630 con 0x7fb0700c9240 2023-06-10T18:56:19.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.175+0000 7fb067fff640 1 -- 172.21.15.53:0/2173808137 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0680ac790 con 0x7fb0700c9240 2023-06-10T18:56:19.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.175+0000 7fb067fff640 1 -- 172.21.15.53:0/2173808137 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0680acb20 con 0x7fb0700c9240 2023-06-10T18:56:19.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.175+0000 7fb07726b640 1 -- 172.21.15.53:0/2173808137 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0700c9240 msgr2=0x7fb07006b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:19.180 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.175+0000 7fb07726b640 1 --2- 172.21.15.53:0/2173808137 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0700c9240 0x7fb07006b090 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fb07006ea70 tx=0x7fb06801c500 comp rx=0 tx=0).stop 2023-06-10T18:56:19.180 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.175+0000 7fb07726b640 1 -- 172.21.15.53:0/2173808137 shutdown_connections 2023-06-10T18:56:19.180 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.175+0000 7fb07726b640 1 --2- 172.21.15.53:0/2173808137 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0700c9240 0x7fb07006b090 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:19.180 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.175+0000 7fb07726b640 1 --2- 172.21.15.53:0/2173808137 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb070070e30 0x7fb0700c8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:19.180 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.175+0000 7fb07726b640 1 --2- 172.21.15.53:0/2173808137 >> v2:172.21.15.117:3300/0 conn(0x7fb0700b3390 0x7fb0700af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:19.180 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.175+0000 7fb07726b640 1 -- 172.21.15.53:0/2173808137 >> 172.21.15.53:0/2173808137 conn(0x7fb07006a0d0 msgr2=0x7fb0700ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:19.180 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.175+0000 7fb07726b640 1 -- 172.21.15.53:0/2173808137 shutdown_connections 2023-06-10T18:56:19.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.175+0000 7fb07726b640 1 -- 172.21.15.53:0/2173808137 wait complete. 2023-06-10T18:56:19.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.175+0000 7fb07726b640 1 Processor -- start 2023-06-10T18:56:19.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.175+0000 7fb07726b640 1 -- start start 2023-06-10T18:56:19.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.175+0000 7fb07726b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb070070e30 0x7fb0701519d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:19.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.175+0000 7fb07726b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0700b3390 0x7fb0700b0c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:19.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.175+0000 7fb07726b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0700c9240 0x7fb0700b11a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:19.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.175+0000 7fb07726b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb070151f10 con 0x7fb0700b3390 2023-06-10T18:56:19.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.175+0000 7fb07726b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0700ac230 con 0x7fb0700c9240 2023-06-10T18:56:19.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.175+0000 7fb07726b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0700ac510 con 0x7fb070070e30 2023-06-10T18:56:19.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.175+0000 7fb074806640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0700b3390 0x7fb0700b0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:19.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.179+0000 7fb074806640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0700b3390 0x7fb0700b0c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33738/0 (socket says 172.21.15.53:33738) 2023-06-10T18:56:19.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.179+0000 7fb074806640 1 -- 172.21.15.53:0/2656135097 learned_addr learned my addr 172.21.15.53:0/2656135097 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:19.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.179+0000 7fb075808640 1 --2- 172.21.15.53:0/2656135097 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0700c9240 0x7fb0700b11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:19.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.179+0000 7fb075007640 1 --2- 172.21.15.53:0/2656135097 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb070070e30 0x7fb0701519d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:19.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.179+0000 7fb074806640 1 -- 172.21.15.53:0/2656135097 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb070070e30 msgr2=0x7fb0701519d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:19.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.179+0000 7fb074806640 1 --2- 172.21.15.53:0/2656135097 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb070070e30 0x7fb0701519d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:19.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.179+0000 7fb074806640 1 -- 172.21.15.53:0/2656135097 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0700c9240 msgr2=0x7fb0700b11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:19.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.179+0000 7fb074806640 1 --2- 172.21.15.53:0/2656135097 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0700c9240 0x7fb0700b11a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:19.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.179+0000 7fb074806640 1 -- 172.21.15.53:0/2656135097 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0680094d0 con 0x7fb0700b3390 2023-06-10T18:56:19.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.179+0000 7fb075007640 1 --2- 172.21.15.53:0/2656135097 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb070070e30 0x7fb0701519d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:56:19.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.179+0000 7fb075808640 1 --2- 172.21.15.53:0/2656135097 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0700c9240 0x7fb0700b11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:56:19.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.179+0000 7fb074806640 1 --2- 172.21.15.53:0/2656135097 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0700b3390 0x7fb0700b0c60 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fb06000d800 tx=0x7fb06000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:19.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.179+0000 7fb065ffb640 1 -- 172.21.15.53:0/2656135097 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0600096a0 con 0x7fb0700b3390 2023-06-10T18:56:19.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.179+0000 7fb065ffb640 1 -- 172.21.15.53:0/2656135097 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb060009800 con 0x7fb0700b3390 2023-06-10T18:56:19.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.179+0000 7fb07726b640 1 -- 172.21.15.53:0/2656135097 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0700ac7f0 con 0x7fb0700b3390 2023-06-10T18:56:19.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.179+0000 7fb065ffb640 1 -- 172.21.15.53:0/2656135097 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb060009990 con 0x7fb0700b3390 2023-06-10T18:56:19.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.179+0000 7fb07726b640 1 -- 172.21.15.53:0/2656135097 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0700acdb0 con 0x7fb0700b3390 2023-06-10T18:56:19.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.179+0000 7fb07726b640 1 -- 172.21.15.53:0/2656135097 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb07004d790 con 0x7fb0700b3390 2023-06-10T18:56:19.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.179+0000 7fb065ffb640 1 -- 172.21.15.53:0/2656135097 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb060009af0 con 0x7fb0700b3390 2023-06-10T18:56:19.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.179+0000 7fb065ffb640 1 --2- 172.21.15.53:0/2656135097 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb0540662b0 0x7fb054068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:19.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.179+0000 7fb065ffb640 1 -- 172.21.15.53:0/2656135097 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb0600841f0 con 0x7fb0700b3390 2023-06-10T18:56:19.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.179+0000 7fb075007640 1 --2- 172.21.15.53:0/2656135097 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb0540662b0 0x7fb054068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:19.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.183+0000 7fb075007640 1 --2- 172.21.15.53:0/2656135097 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb0540662b0 0x7fb054068760 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb06c007330 tx=0x7fb06c00b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:19.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.183+0000 7fb065ffb640 1 -- 172.21.15.53:0/2656135097 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb060051720 con 0x7fb0700b3390 2023-06-10T18:56:19.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.339+0000 7fb07726b640 1 -- 172.21.15.53:0/2656135097 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb0700cb3f0 con 0x7fb0700b3390 2023-06-10T18:56:19.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.343+0000 7fb065ffb640 1 -- 172.21.15.53:0/2656135097 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+18352 (secure 0 0 0) 0x7fb060009da0 con 0x7fb0700b3390 2023-06-10T18:56:19.349 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:56:19.349 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":50,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T18:56:18.681407+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-06-10T18:56:16.364582+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-06-10T18:56:17.656793+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T18:56:19.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.347+0000 7fb07726b640 1 -- 172.21.15.53:0/2656135097 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb0540662b0 msgr2=0x7fb054068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:19.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.347+0000 7fb07726b640 1 --2- 172.21.15.53:0/2656135097 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb0540662b0 0x7fb054068760 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb06c007330 tx=0x7fb06c00b040 comp rx=0 tx=0).stop 2023-06-10T18:56:19.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.347+0000 7fb07726b640 1 -- 172.21.15.53:0/2656135097 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0700b3390 msgr2=0x7fb0700b0c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:19.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.347+0000 7fb07726b640 1 --2- 172.21.15.53:0/2656135097 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0700b3390 0x7fb0700b0c60 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fb06000d800 tx=0x7fb06000dcc0 comp rx=0 tx=0).stop 2023-06-10T18:56:19.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.347+0000 7fb07726b640 1 -- 172.21.15.53:0/2656135097 shutdown_connections 2023-06-10T18:56:19.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.347+0000 7fb07726b640 1 --2- 172.21.15.53:0/2656135097 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb0540662b0 0x7fb054068760 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:19.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.347+0000 7fb07726b640 1 --2- 172.21.15.53:0/2656135097 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0700c9240 0x7fb0700b11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:19.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.347+0000 7fb07726b640 1 --2- 172.21.15.53:0/2656135097 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0700b3390 0x7fb0700b0c60 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:19.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.347+0000 7fb07726b640 1 --2- 172.21.15.53:0/2656135097 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb070070e30 0x7fb0701519d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:19.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.347+0000 7fb07726b640 1 -- 172.21.15.53:0/2656135097 >> 172.21.15.53:0/2656135097 conn(0x7fb07006a0d0 msgr2=0x7fb070163c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:19.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.347+0000 7fb07726b640 1 -- 172.21.15.53:0/2656135097 shutdown_connections 2023-06-10T18:56:19.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.347+0000 7fb07726b640 1 -- 172.21.15.53:0/2656135097 wait complete. 2023-06-10T18:56:19.367 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-06-10T18:56:19.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.495+0000 7f5ef4a9d640 1 Processor -- start 2023-06-10T18:56:19.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.495+0000 7f5ef4a9d640 1 -- start start 2023-06-10T18:56:19.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.495+0000 7f5ef4a9d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5ef015c090 0x7f5ef00b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:19.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.495+0000 7f5ef4a9d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ef00b0b90 0x7f5ef00b7720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:19.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.495+0000 7f5ef4a9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5ef00b7c60 0x7f5ef00b3b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:19.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.495+0000 7f5ef4a9d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ef00b80e0 con 0x7f5ef00b7c60 2023-06-10T18:56:19.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.495+0000 7f5ef4a9d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ef00cc7c0 con 0x7f5ef015c090 2023-06-10T18:56:19.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.495+0000 7f5ef4a9d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef00ccaa0 con 0x7f5ef00b0b90 2023-06-10T18:56:19.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.495+0000 7f5eeed9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5ef00b7c60 0x7f5ef00b3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:19.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.495+0000 7f5eeed9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5ef00b7c60 0x7f5ef00b3b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33752/0 (socket says 172.21.15.53:33752) 2023-06-10T18:56:19.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.495+0000 7f5eeed9d640 1 -- 172.21.15.53:0/1097082065 learned_addr learned my addr 172.21.15.53:0/1097082065 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:19.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.495+0000 7f5eedd9b640 1 --2- 172.21.15.53:0/1097082065 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ef00b0b90 0x7f5ef00b7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:19.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.495+0000 7f5eee59c640 1 --2- 172.21.15.53:0/1097082065 >> v2:172.21.15.117:3300/0 conn(0x7f5ef015c090 0x7f5ef00b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:19.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.495+0000 7f5eeed9d640 1 -- 172.21.15.53:0/1097082065 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ef00b0b90 msgr2=0x7f5ef00b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:19.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.495+0000 7f5eeed9d640 1 --2- 172.21.15.53:0/1097082065 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ef00b0b90 0x7f5ef00b7720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:19.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.495+0000 7f5eeed9d640 1 -- 172.21.15.53:0/1097082065 >> v2:172.21.15.117:3300/0 conn(0x7f5ef015c090 msgr2=0x7f5ef00b10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:19.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.495+0000 7f5eeed9d640 1 --2- 172.21.15.53:0/1097082065 >> v2:172.21.15.117:3300/0 conn(0x7f5ef015c090 0x7f5ef00b10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:19.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.495+0000 7f5eeed9d640 1 -- 172.21.15.53:0/1097082065 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ef00ccd80 con 0x7f5ef00b7c60 2023-06-10T18:56:19.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.495+0000 7f5eee59c640 1 --2- 172.21.15.53:0/1097082065 >> v2:172.21.15.117:3300/0 conn(0x7f5ef015c090 0x7f5ef00b10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:56:19.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.499+0000 7f5eeed9d640 1 --2- 172.21.15.53:0/1097082065 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ef00b7c60 0x7f5ef00b3b50 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f5ef008a080 tx=0x7f5ee801c650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd1efad44552b23b server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:19.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.499+0000 7f5eed59a640 1 -- 172.21.15.53:0/1097082065 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee80a64e0 con 0x7f5ef00b7c60 2023-06-10T18:56:19.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.499+0000 7f5eed59a640 1 -- 172.21.15.53:0/1097082065 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ee80a6640 con 0x7f5ef00b7c60 2023-06-10T18:56:19.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.499+0000 7f5eed59a640 1 -- 172.21.15.53:0/1097082065 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee80a69d0 con 0x7f5ef00b7c60 2023-06-10T18:56:19.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.499+0000 7f5ef4a9d640 1 -- 172.21.15.53:0/1097082065 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ef00b7c60 msgr2=0x7f5ef00b3b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:19.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.499+0000 7f5ef4a9d640 1 --2- 172.21.15.53:0/1097082065 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ef00b7c60 0x7f5ef00b3b50 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f5ef008a080 tx=0x7f5ee801c650 comp rx=0 tx=0).stop 2023-06-10T18:56:19.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.499+0000 7f5ef4a9d640 1 -- 172.21.15.53:0/1097082065 shutdown_connections 2023-06-10T18:56:19.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.499+0000 7f5ef4a9d640 1 --2- 172.21.15.53:0/1097082065 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ef00b7c60 0x7f5ef00b3b50 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:19.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.499+0000 7f5ef4a9d640 1 --2- 172.21.15.53:0/1097082065 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ef00b0b90 0x7f5ef00b7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:19.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.499+0000 7f5ef4a9d640 1 --2- 172.21.15.53:0/1097082065 >> v2:172.21.15.117:3300/0 conn(0x7f5ef015c090 0x7f5ef00b10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:19.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.499+0000 7f5ef4a9d640 1 -- 172.21.15.53:0/1097082065 >> 172.21.15.53:0/1097082065 conn(0x7f5ef0069e20 msgr2=0x7f5ef006a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:19.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.499+0000 7f5ef4a9d640 1 -- 172.21.15.53:0/1097082065 shutdown_connections 2023-06-10T18:56:19.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.499+0000 7f5ef4a9d640 1 -- 172.21.15.53:0/1097082065 wait complete. 2023-06-10T18:56:19.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.499+0000 7f5ef4a9d640 1 Processor -- start 2023-06-10T18:56:19.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.499+0000 7f5ef4a9d640 1 -- start start 2023-06-10T18:56:19.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.499+0000 7f5ef4a9d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ef00b0b90 0x7f5ef0158470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:19.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.499+0000 7f5ef4a9d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ef00b7c60 0x7f5ef01515e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:19.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.499+0000 7f5ef4a9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ef015c090 0x7f5ef00b28f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:19.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.499+0000 7f5ef4a9d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef0150040 con 0x7f5ef015c090 2023-06-10T18:56:19.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.499+0000 7f5ef4a9d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef0151b20 con 0x7f5ef00b7c60 2023-06-10T18:56:19.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.499+0000 7f5ef4a9d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef0151d50 con 0x7f5ef00b0b90 2023-06-10T18:56:19.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.499+0000 7f5eeed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ef015c090 0x7f5ef00b28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:19.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.499+0000 7f5eeed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ef015c090 0x7f5ef00b28f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33758/0 (socket says 172.21.15.53:33758) 2023-06-10T18:56:19.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.499+0000 7f5eeed9d640 1 -- 172.21.15.53:0/4004278660 learned_addr learned my addr 172.21.15.53:0/4004278660 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:19.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.503+0000 7f5eee59c640 1 --2- 172.21.15.53:0/4004278660 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ef00b0b90 0x7f5ef0158470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:19.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.503+0000 7f5eedd9b640 1 --2- 172.21.15.53:0/4004278660 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ef00b7c60 0x7f5ef01515e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:19.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.503+0000 7f5eeed9d640 1 -- 172.21.15.53:0/4004278660 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ef00b0b90 msgr2=0x7f5ef0158470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:19.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.503+0000 7f5eeed9d640 1 --2- 172.21.15.53:0/4004278660 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ef00b0b90 0x7f5ef0158470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:19.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.503+0000 7f5eeed9d640 1 -- 172.21.15.53:0/4004278660 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ef00b7c60 msgr2=0x7f5ef01515e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:19.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.503+0000 7f5eeed9d640 1 --2- 172.21.15.53:0/4004278660 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ef00b7c60 0x7f5ef01515e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:19.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.503+0000 7f5eeed9d640 1 -- 172.21.15.53:0/4004278660 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ee8009b30 con 0x7f5ef015c090 2023-06-10T18:56:19.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.503+0000 7f5eee59c640 1 --2- 172.21.15.53:0/4004278660 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ef00b0b90 0x7f5ef0158470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:56:19.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.503+0000 7f5eedd9b640 1 --2- 172.21.15.53:0/4004278660 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ef00b7c60 0x7f5ef01515e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:56:19.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.503+0000 7f5eeed9d640 1 --2- 172.21.15.53:0/4004278660 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ef015c090 0x7f5ef00b28f0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f5ee801ad00 tx=0x7f5ee80193f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:19.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.503+0000 7f5edeffd640 1 -- 172.21.15.53:0/4004278660 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee80b4070 con 0x7f5ef015c090 2023-06-10T18:56:19.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.503+0000 7f5edeffd640 1 -- 172.21.15.53:0/4004278660 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ee8009240 con 0x7f5ef015c090 2023-06-10T18:56:19.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.503+0000 7f5ef4a9d640 1 -- 172.21.15.53:0/4004278660 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ef00b1b30 con 0x7f5ef015c090 2023-06-10T18:56:19.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.503+0000 7f5edeffd640 1 -- 172.21.15.53:0/4004278660 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee80a69f0 con 0x7f5ef015c090 2023-06-10T18:56:19.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.503+0000 7f5ef4a9d640 1 -- 172.21.15.53:0/4004278660 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ef00b20f0 con 0x7f5ef015c090 2023-06-10T18:56:19.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.503+0000 7f5ef4a9d640 1 -- 172.21.15.53:0/4004278660 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ef004d790 con 0x7f5ef015c090 2023-06-10T18:56:19.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.503+0000 7f5edeffd640 1 -- 172.21.15.53:0/4004278660 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5ee80b8070 con 0x7f5ef015c090 2023-06-10T18:56:19.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.503+0000 7f5edeffd640 1 --2- 172.21.15.53:0/4004278660 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5ed00662b0 0x7f5ed0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:19.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.503+0000 7f5edeffd640 1 -- 172.21.15.53:0/4004278660 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5ee80aa070 con 0x7f5ef015c090 2023-06-10T18:56:19.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.503+0000 7f5eee59c640 1 --2- 172.21.15.53:0/4004278660 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5ed00662b0 0x7f5ed0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:19.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.503+0000 7f5eee59c640 1 --2- 172.21.15.53:0/4004278660 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5ed00662b0 0x7f5ed0068760 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5ee0008890 tx=0x7f5ee0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:19.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.507+0000 7f5edeffd640 1 -- 172.21.15.53:0/4004278660 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5ee80eeea0 con 0x7f5ef015c090 2023-06-10T18:56:19.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:19.699+0000 7f5ef4a9d640 1 -- 172.21.15.53:0/4004278660 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f5ef00b72f0 con 0x7f5ef015c090 2023-06-10T18:56:20.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:20.711+0000 7f5edeffd640 1 -- 172.21.15.53:0/4004278660 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v19) v1 ==== 118+0+0 (secure 0 0 0) 0x7f5ee80eea30 con 0x7f5ef015c090 2023-06-10T18:56:20.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:20.715+0000 7f5ef4a9d640 1 -- 172.21.15.53:0/4004278660 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5ed00662b0 msgr2=0x7f5ed0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:20.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:20.715+0000 7f5ef4a9d640 1 --2- 172.21.15.53:0/4004278660 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5ed00662b0 0x7f5ed0068760 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5ee0008890 tx=0x7f5ee0008040 comp rx=0 tx=0).stop 2023-06-10T18:56:20.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:20.715+0000 7f5ef4a9d640 1 -- 172.21.15.53:0/4004278660 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ef015c090 msgr2=0x7f5ef00b28f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:20.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:20.715+0000 7f5ef4a9d640 1 --2- 172.21.15.53:0/4004278660 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ef015c090 0x7f5ef00b28f0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f5ee801ad00 tx=0x7f5ee80193f0 comp rx=0 tx=0).stop 2023-06-10T18:56:20.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:20.715+0000 7f5ef4a9d640 1 -- 172.21.15.53:0/4004278660 shutdown_connections 2023-06-10T18:56:20.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:20.715+0000 7f5ef4a9d640 1 --2- 172.21.15.53:0/4004278660 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5ed00662b0 0x7f5ed0068760 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:20.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:20.715+0000 7f5ef4a9d640 1 --2- 172.21.15.53:0/4004278660 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ef015c090 0x7f5ef00b28f0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:20.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:20.715+0000 7f5ef4a9d640 1 --2- 172.21.15.53:0/4004278660 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ef00b7c60 0x7f5ef01515e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:20.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:20.715+0000 7f5ef4a9d640 1 --2- 172.21.15.53:0/4004278660 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ef00b0b90 0x7f5ef0158470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:20.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:20.715+0000 7f5ef4a9d640 1 -- 172.21.15.53:0/4004278660 >> 172.21.15.53:0/4004278660 conn(0x7f5ef0069e20 msgr2=0x7f5ef00b6620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:20.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:20.715+0000 7f5ef4a9d640 1 -- 172.21.15.53:0/4004278660 shutdown_connections 2023-06-10T18:56:20.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:20.715+0000 7f5ef4a9d640 1 -- 172.21.15.53:0/4004278660 wait complete. 2023-06-10T18:56:20.743 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-06-10T18:56:20.743 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-06-10T18:56:20.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:20.883+0000 7fed6d031640 1 Processor -- start 2023-06-10T18:56:20.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:20.883+0000 7fed6d031640 1 -- start start 2023-06-10T18:56:20.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:20.883+0000 7fed6d031640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fed6815c090 0x7fed680b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:20.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:20.883+0000 7fed6d031640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fed680b0b90 0x7fed680b7720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:20.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:20.883+0000 7fed6d031640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed680b7c60 0x7fed680b3b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:20.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:20.883+0000 7fed6d031640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed680b80e0 con 0x7fed680b0b90 2023-06-10T18:56:20.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:20.883+0000 7fed6d031640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed680cc7c0 con 0x7fed6815c090 2023-06-10T18:56:20.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:20.883+0000 7fed6d031640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed680ccaa0 con 0x7fed680b7c60 2023-06-10T18:56:20.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:20.883+0000 7fed6659c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fed680b0b90 0x7fed680b7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:20.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:20.883+0000 7fed6659c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fed680b0b90 0x7fed680b7720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33762/0 (socket says 172.21.15.53:33762) 2023-06-10T18:56:20.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:20.883+0000 7fed6659c640 1 -- 172.21.15.53:0/3937653775 learned_addr learned my addr 172.21.15.53:0/3937653775 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:20.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:20.883+0000 7fed66d9d640 1 --2- 172.21.15.53:0/3937653775 >> v2:172.21.15.117:3300/0 conn(0x7fed6815c090 0x7fed680b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:20.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:20.883+0000 7fed6759e640 1 --2- 172.21.15.53:0/3937653775 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed680b7c60 0x7fed680b3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:20.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:20.883+0000 7fed6659c640 1 -- 172.21.15.53:0/3937653775 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed680b7c60 msgr2=0x7fed680b3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:20.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:20.883+0000 7fed6659c640 1 --2- 172.21.15.53:0/3937653775 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed680b7c60 0x7fed680b3b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:20.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:20.883+0000 7fed6659c640 1 -- 172.21.15.53:0/3937653775 >> v2:172.21.15.117:3300/0 conn(0x7fed6815c090 msgr2=0x7fed680b10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:20.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:20.883+0000 7fed6659c640 1 --2- 172.21.15.53:0/3937653775 >> v2:172.21.15.117:3300/0 conn(0x7fed6815c090 0x7fed680b10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:20.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:20.883+0000 7fed6659c640 1 -- 172.21.15.53:0/3937653775 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed680ccd80 con 0x7fed680b0b90 2023-06-10T18:56:20.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:20.887+0000 7fed6659c640 1 --2- 172.21.15.53:0/3937653775 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed680b0b90 0x7fed680b7720 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fed6808a080 tx=0x7fed5c01c180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=340716c02ab18c2a server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:20.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:20.887+0000 7fed65d9b640 1 -- 172.21.15.53:0/3937653775 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5c0ab600 con 0x7fed680b0b90 2023-06-10T18:56:20.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:20.887+0000 7fed65d9b640 1 -- 172.21.15.53:0/3937653775 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed5c0a7050 con 0x7fed680b0b90 2023-06-10T18:56:20.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:20.887+0000 7fed65d9b640 1 -- 172.21.15.53:0/3937653775 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5c0ab980 con 0x7fed680b0b90 2023-06-10T18:56:20.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:20.887+0000 7fed6d031640 1 -- 172.21.15.53:0/3937653775 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed680b0b90 msgr2=0x7fed680b7720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:20.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:20.887+0000 7fed6d031640 1 --2- 172.21.15.53:0/3937653775 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed680b0b90 0x7fed680b7720 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fed6808a080 tx=0x7fed5c01c180 comp rx=0 tx=0).stop 2023-06-10T18:56:20.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:20.887+0000 7fed6d031640 1 -- 172.21.15.53:0/3937653775 shutdown_connections 2023-06-10T18:56:20.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:20.887+0000 7fed6d031640 1 --2- 172.21.15.53:0/3937653775 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed680b7c60 0x7fed680b3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:20.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:20.887+0000 7fed6d031640 1 --2- 172.21.15.53:0/3937653775 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed680b0b90 0x7fed680b7720 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:20.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:20.887+0000 7fed6d031640 1 --2- 172.21.15.53:0/3937653775 >> v2:172.21.15.117:3300/0 conn(0x7fed6815c090 0x7fed680b10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:20.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:20.887+0000 7fed6d031640 1 -- 172.21.15.53:0/3937653775 >> 172.21.15.53:0/3937653775 conn(0x7fed68069e20 msgr2=0x7fed6806a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:20.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:20.887+0000 7fed6d031640 1 -- 172.21.15.53:0/3937653775 shutdown_connections 2023-06-10T18:56:20.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:20.887+0000 7fed6d031640 1 -- 172.21.15.53:0/3937653775 wait complete. 2023-06-10T18:56:20.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:20.891+0000 7fed6d031640 1 Processor -- start 2023-06-10T18:56:20.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:20.891+0000 7fed6d031640 1 -- start start 2023-06-10T18:56:20.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:20.891+0000 7fed6d031640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed680b0b90 0x7fed680b2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:20.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:20.891+0000 7fed6d031640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed680b7c60 0x7fed680b68c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:20.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:20.891+0000 7fed6d031640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed6815c090 0x7fed6814b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:20.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:20.891+0000 7fed6d031640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed68150b10 con 0x7fed6815c090 2023-06-10T18:56:20.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:20.891+0000 7fed6d031640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed680b2ae0 con 0x7fed680b0b90 2023-06-10T18:56:20.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:20.891+0000 7fed6d031640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed680b5de0 con 0x7fed680b7c60 2023-06-10T18:56:20.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:20.891+0000 7fed6759e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed6815c090 0x7fed6814b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:20.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:20.891+0000 7fed6759e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed6815c090 0x7fed6814b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33778/0 (socket says 172.21.15.53:33778) 2023-06-10T18:56:20.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:20.891+0000 7fed6759e640 1 -- 172.21.15.53:0/610100129 learned_addr learned my addr 172.21.15.53:0/610100129 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:20.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:20.891+0000 7fed6659c640 1 --2- 172.21.15.53:0/610100129 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed680b7c60 0x7fed680b68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:20.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:20.891+0000 7fed66d9d640 1 --2- 172.21.15.53:0/610100129 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed680b0b90 0x7fed680b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:20.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:20.891+0000 7fed6759e640 1 -- 172.21.15.53:0/610100129 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed680b7c60 msgr2=0x7fed680b68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:20.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:20.891+0000 7fed6759e640 1 --2- 172.21.15.53:0/610100129 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed680b7c60 0x7fed680b68c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:20.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:20.891+0000 7fed6759e640 1 -- 172.21.15.53:0/610100129 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed680b0b90 msgr2=0x7fed680b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:20.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:20.891+0000 7fed6759e640 1 --2- 172.21.15.53:0/610100129 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed680b0b90 0x7fed680b2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:20.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:20.891+0000 7fed6759e640 1 -- 172.21.15.53:0/610100129 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed5c0094d0 con 0x7fed6815c090 2023-06-10T18:56:20.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:20.891+0000 7fed6659c640 1 --2- 172.21.15.53:0/610100129 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed680b7c60 0x7fed680b68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:56:20.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:20.891+0000 7fed6759e640 1 --2- 172.21.15.53:0/610100129 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed6815c090 0x7fed6814b520 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fed60007e60 tx=0x7fed6000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:20.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:20.891+0000 7fed4f7fe640 1 -- 172.21.15.53:0/610100129 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed60014620 con 0x7fed6815c090 2023-06-10T18:56:20.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:20.891+0000 7fed4f7fe640 1 -- 172.21.15.53:0/610100129 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed6000ee90 con 0x7fed6815c090 2023-06-10T18:56:20.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:20.891+0000 7fed4f7fe640 1 -- 172.21.15.53:0/610100129 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed600149e0 con 0x7fed6815c090 2023-06-10T18:56:20.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:20.891+0000 7fed6d031640 1 -- 172.21.15.53:0/610100129 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed680b60c0 con 0x7fed6815c090 2023-06-10T18:56:20.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:20.891+0000 7fed6d031640 1 -- 172.21.15.53:0/610100129 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed680b2dc0 con 0x7fed6815c090 2023-06-10T18:56:20.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:20.891+0000 7fed6d031640 1 -- 172.21.15.53:0/610100129 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed6804d790 con 0x7fed6815c090 2023-06-10T18:56:20.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:20.891+0000 7fed4f7fe640 1 -- 172.21.15.53:0/610100129 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fed60014b40 con 0x7fed6815c090 2023-06-10T18:56:20.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:20.895+0000 7fed4f7fe640 1 --2- 172.21.15.53:0/610100129 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fed54066280 0x7fed54068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:20.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:20.895+0000 7fed4f7fe640 1 -- 172.21.15.53:0/610100129 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fed60084670 con 0x7fed6815c090 2023-06-10T18:56:20.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:20.895+0000 7fed66d9d640 1 --2- 172.21.15.53:0/610100129 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fed54066280 0x7fed54068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:20.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:20.895+0000 7fed66d9d640 1 --2- 172.21.15.53:0/610100129 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fed54066280 0x7fed54068730 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fed680b3530 tx=0x7fed58008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:20.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:20.899+0000 7fed4f7fe640 1 -- 172.21.15.53:0/610100129 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fed60051af0 con 0x7fed6815c090 2023-06-10T18:56:21.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.087+0000 7fed6d031640 1 -- 172.21.15.53:0/610100129 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fed68153d70 con 0x7fed6815c090 2023-06-10T18:56:21.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.839+0000 7fed4f7fe640 1 -- 172.21.15.53:0/610100129 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v20) v1 ==== 122+0+0 (secure 0 0 0) 0x7fed60082e60 con 0x7fed6815c090 2023-06-10T18:56:21.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.839+0000 7fed6d031640 1 -- 172.21.15.53:0/610100129 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fed54066280 msgr2=0x7fed54068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:21.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.839+0000 7fed6d031640 1 --2- 172.21.15.53:0/610100129 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fed54066280 0x7fed54068730 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fed680b3530 tx=0x7fed58008040 comp rx=0 tx=0).stop 2023-06-10T18:56:21.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.839+0000 7fed6d031640 1 -- 172.21.15.53:0/610100129 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed6815c090 msgr2=0x7fed6814b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:21.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.839+0000 7fed6d031640 1 --2- 172.21.15.53:0/610100129 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed6815c090 0x7fed6814b520 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fed60007e60 tx=0x7fed6000e4b0 comp rx=0 tx=0).stop 2023-06-10T18:56:21.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.839+0000 7fed6d031640 1 -- 172.21.15.53:0/610100129 shutdown_connections 2023-06-10T18:56:21.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.839+0000 7fed6d031640 1 --2- 172.21.15.53:0/610100129 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fed54066280 0x7fed54068730 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:21.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.839+0000 7fed6d031640 1 --2- 172.21.15.53:0/610100129 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed6815c090 0x7fed6814b520 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:21.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.839+0000 7fed6d031640 1 --2- 172.21.15.53:0/610100129 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed680b7c60 0x7fed680b68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:21.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.839+0000 7fed6d031640 1 --2- 172.21.15.53:0/610100129 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed680b0b90 0x7fed680b2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:21.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.839+0000 7fed6d031640 1 -- 172.21.15.53:0/610100129 >> 172.21.15.53:0/610100129 conn(0x7fed68069e20 msgr2=0x7fed68153580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:21.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.839+0000 7fed6d031640 1 -- 172.21.15.53:0/610100129 shutdown_connections 2023-06-10T18:56:21.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.839+0000 7fed6d031640 1 -- 172.21.15.53:0/610100129 wait complete. 2023-06-10T18:56:21.865 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-06-10T18:56:21.866 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T18:56:21.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.991+0000 7fd720239640 1 Processor -- start 2023-06-10T18:56:21.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.991+0000 7fd720239640 1 -- start start 2023-06-10T18:56:21.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.991+0000 7fd720239640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd71806b2f0 0x7fd71806f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:21.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.991+0000 7fd720239640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd718158a90 con 0x7fd7180c8d00 2023-06-10T18:56:21.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.991+0000 7fd720239640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7180705d0 con 0x7fd718160170 2023-06-10T18:56:21.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.991+0000 7fd720239640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7180cce10 con 0x7fd71806b2f0 2023-06-10T18:56:21.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.991+0000 7fd71d7d4640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fd7180c8d00 0x7fd71806b6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:54014/0 (socket says 172.21.15.53:54014) 2023-06-10T18:56:21.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.991+0000 7fd71d7d4640 1 -- 172.21.15.53:0/941968609 learned_addr learned my addr 172.21.15.53:0/941968609 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:56:21.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.991+0000 7fd71cfd3640 1 -- 172.21.15.53:0/941968609 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 937070432 0 0) 0x7fd708001120 con 0x7fd7180c8d00 2023-06-10T18:56:21.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.991+0000 7fd71dfd5640 1 --2- 172.21.15.53:0/941968609 >> v2:172.21.15.117:3300/0 conn(0x7fd71806b2f0 0x7fd71806f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:21.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.991+0000 7fd71cfd3640 1 -- 172.21.15.53:0/941968609 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd704003530 con 0x7fd7180c8d00 2023-06-10T18:56:21.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.991+0000 7fd71cfd3640 1 -- 172.21.15.53:0/941968609 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1769139193 0 0) 0x7fd704003530 con 0x7fd7180c8d00 2023-06-10T18:56:21.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.991+0000 7fd71cfd3640 1 -- 172.21.15.53:0/941968609 >> v2:172.21.15.117:3300/0 conn(0x7fd71806b2f0 msgr2=0x7fd71806f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:21.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.991+0000 7fd71cfd3640 1 --2- 172.21.15.53:0/941968609 >> v2:172.21.15.117:3300/0 conn(0x7fd71806b2f0 0x7fd71806f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:21.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.991+0000 7fd71cfd3640 1 -- 172.21.15.53:0/941968609 >> v1:172.21.15.117:6789/0 conn(0x7fd718160170 legacy=0x7fd718162550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:21.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.991+0000 7fd71cfd3640 1 -- 172.21.15.53:0/941968609 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd71806f9c0 con 0x7fd7180c8d00 2023-06-10T18:56:22.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.991+0000 7fd71cfd3640 1 -- 172.21.15.53:0/941968609 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fd708001810 con 0x7fd7180c8d00 2023-06-10T18:56:22.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.991+0000 7fd71dfd5640 1 --2- 172.21.15.53:0/941968609 >> v2:172.21.15.117:3300/0 conn(0x7fd71806b2f0 0x7fd71806f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:56:22.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.991+0000 7fd71cfd3640 1 -- 172.21.15.53:0/941968609 >> v1:172.21.15.53:6789/0 conn(0x7fd7180c8d00 legacy=0x7fd71806b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:22.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.991+0000 7fd71cfd3640 1 --2- 172.21.15.53:0/941968609 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7040039f0 0x7fd704003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:22.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.991+0000 7fd71cfd3640 1 --2- 172.21.15.53:0/941968609 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7040047d0 0x7fd704004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:22.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.991+0000 7fd71cfd3640 1 --2- 172.21.15.53:0/941968609 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7040051f0 0x7fd70400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:22.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.991+0000 7fd71cfd3640 1 -- 172.21.15.53:0/941968609 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7180cce10 con 0x7fd7040047d0 2023-06-10T18:56:22.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.991+0000 7fd71cfd3640 1 -- 172.21.15.53:0/941968609 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd70400c120 con 0x7fd7040039f0 2023-06-10T18:56:22.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.991+0000 7fd71cfd3640 1 -- 172.21.15.53:0/941968609 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd70400c2e0 con 0x7fd7040051f0 2023-06-10T18:56:22.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.991+0000 7fd71d7d4640 1 --2- 172.21.15.53:0/941968609 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7040047d0 0x7fd704004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:22.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.991+0000 7fd71dfd5640 1 --2- 172.21.15.53:0/941968609 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7040039f0 0x7fd704003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:22.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.991+0000 7fd71e7d6640 1 --2- 172.21.15.53:0/941968609 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7040051f0 0x7fd70400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:22.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.991+0000 7fd71d7d4640 1 -- 172.21.15.53:0/941968609 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7040051f0 msgr2=0x7fd70400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:22.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.991+0000 7fd71d7d4640 1 --2- 172.21.15.53:0/941968609 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7040051f0 0x7fd70400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:22.002 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.991+0000 7fd71d7d4640 1 -- 172.21.15.53:0/941968609 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7040039f0 msgr2=0x7fd704003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:22.002 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.991+0000 7fd71d7d4640 1 --2- 172.21.15.53:0/941968609 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7040039f0 0x7fd704003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:22.002 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.991+0000 7fd71d7d4640 1 -- 172.21.15.53:0/941968609 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd704003530 con 0x7fd7040047d0 2023-06-10T18:56:22.002 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.991+0000 7fd71e7d6640 1 -- 172.21.15.53:0/941968609 reap_dead start 2023-06-10T18:56:22.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.995+0000 7fd71d7d4640 1 --2- 172.21.15.53:0/941968609 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7040047d0 0x7fd704004c40 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fd70800c240 tx=0x7fd70801cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dabf2186896af53f server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:22.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.995+0000 7fd71cfd3640 1 -- 172.21.15.53:0/941968609 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7080a5b40 con 0x7fd7040047d0 2023-06-10T18:56:22.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.995+0000 7fd71cfd3640 1 -- 172.21.15.53:0/941968609 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7080a5cc0 con 0x7fd7040047d0 2023-06-10T18:56:22.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.995+0000 7fd71cfd3640 1 -- 172.21.15.53:0/941968609 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd708005b20 con 0x7fd7040047d0 2023-06-10T18:56:22.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.995+0000 7fd720239640 1 -- 172.21.15.53:0/941968609 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7040047d0 msgr2=0x7fd704004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:22.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.995+0000 7fd720239640 1 --2- 172.21.15.53:0/941968609 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7040047d0 0x7fd704004c40 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fd70800c240 tx=0x7fd70801cc40 comp rx=0 tx=0).stop 2023-06-10T18:56:22.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.995+0000 7fd720239640 1 -- 172.21.15.53:0/941968609 shutdown_connections 2023-06-10T18:56:22.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.995+0000 7fd720239640 1 --2- 172.21.15.53:0/941968609 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7040047d0 0x7fd704004c40 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:22.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.995+0000 7fd720239640 1 -- 172.21.15.53:0/941968609 >> 172.21.15.53:0/941968609 conn(0x7fd71806a0d0 msgr2=0x7fd7180ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:22.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.995+0000 7fd720239640 1 -- 172.21.15.53:0/941968609 shutdown_connections 2023-06-10T18:56:22.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.995+0000 7fd720239640 1 -- 172.21.15.53:0/941968609 wait complete. 2023-06-10T18:56:22.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.995+0000 7fd720239640 1 Processor -- start 2023-06-10T18:56:22.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.995+0000 7fd720239640 1 -- start start 2023-06-10T18:56:22.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.999+0000 7fd720239640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7040047d0 0x7fd7180c2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:22.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.999+0000 7fd720239640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd718155000 0x7fd7180acaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:22.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.999+0000 7fd720239640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7180ad030 0x7fd7180aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:22.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.999+0000 7fd720239640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7180c44e0 con 0x7fd718155000 2023-06-10T18:56:22.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.999+0000 7fd720239640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7181f44a0 con 0x7fd7040047d0 2023-06-10T18:56:22.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.999+0000 7fd720239640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7180c2cd0 con 0x7fd7180ad030 2023-06-10T18:56:22.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.999+0000 7fd71d7d4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd718155000 0x7fd7180acaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:22.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.999+0000 7fd71d7d4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd718155000 0x7fd7180acaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59162/0 (socket says 172.21.15.53:59162) 2023-06-10T18:56:22.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.999+0000 7fd71d7d4640 1 -- 172.21.15.53:0/1696171993 learned_addr learned my addr 172.21.15.53:0/1696171993 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:22.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.999+0000 7fd71dfd5640 1 --2- 172.21.15.53:0/1696171993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7040047d0 0x7fd7180c2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:22.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.999+0000 7fd71e7d6640 1 --2- 172.21.15.53:0/1696171993 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7180ad030 0x7fd7180aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:22.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.999+0000 7fd71d7d4640 1 -- 172.21.15.53:0/1696171993 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7180ad030 msgr2=0x7fd7180aebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:22.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.999+0000 7fd71d7d4640 1 --2- 172.21.15.53:0/1696171993 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7180ad030 0x7fd7180aebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:22.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.999+0000 7fd71d7d4640 1 -- 172.21.15.53:0/1696171993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7040047d0 msgr2=0x7fd7180c2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:22.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.999+0000 7fd71d7d4640 1 --2- 172.21.15.53:0/1696171993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7040047d0 0x7fd7180c2790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:22.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.999+0000 7fd71d7d4640 1 -- 172.21.15.53:0/1696171993 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7181f46f0 con 0x7fd718155000 2023-06-10T18:56:22.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.999+0000 7fd71e7d6640 1 --2- 172.21.15.53:0/1696171993 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7180ad030 0x7fd7180aebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:56:22.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.999+0000 7fd71d7d4640 1 --2- 172.21.15.53:0/1696171993 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd718155000 0x7fd7180acaf0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fd70801ca70 tx=0x7fd704005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:22.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.999+0000 7fd70e7fc640 1 -- 172.21.15.53:0/1696171993 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7080b3070 con 0x7fd718155000 2023-06-10T18:56:22.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.999+0000 7fd70e7fc640 1 -- 172.21.15.53:0/1696171993 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd708000ee0 con 0x7fd718155000 2023-06-10T18:56:22.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.999+0000 7fd720239640 1 -- 172.21.15.53:0/1696171993 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7181f49d0 con 0x7fd718155000 2023-06-10T18:56:22.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.999+0000 7fd70e7fc640 1 -- 172.21.15.53:0/1696171993 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd708001810 con 0x7fd718155000 2023-06-10T18:56:22.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.999+0000 7fd720239640 1 -- 172.21.15.53:0/1696171993 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7181f4f90 con 0x7fd718155000 2023-06-10T18:56:22.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.999+0000 7fd720239640 1 -- 172.21.15.53:0/1696171993 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd718070240 con 0x7fd718155000 2023-06-10T18:56:22.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.999+0000 7fd70e7fc640 1 -- 172.21.15.53:0/1696171993 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd7080a5940 con 0x7fd718155000 2023-06-10T18:56:22.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.999+0000 7fd70e7fc640 1 --2- 172.21.15.53:0/1696171993 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd6fc066280 0x7fd6fc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:22.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.999+0000 7fd70e7fc640 1 -- 172.21.15.53:0/1696171993 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd70811db00 con 0x7fd718155000 2023-06-10T18:56:22.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:21.999+0000 7fd71dfd5640 1 --2- 172.21.15.53:0/1696171993 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd6fc066280 0x7fd6fc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:22.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.003+0000 7fd71dfd5640 1 --2- 172.21.15.53:0/1696171993 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd6fc066280 0x7fd6fc068730 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd71806cbb0 tx=0x7fd71400d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:22.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.003+0000 7fd70e7fc640 1 -- 172.21.15.53:0/1696171993 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd718070240 con 0x7fd718155000 2023-06-10T18:56:22.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.203+0000 7fd720239640 1 -- 172.21.15.53:0/1696171993 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd718158a90 con 0x7fd718155000 2023-06-10T18:56:22.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.203+0000 7fd70e7fc640 1 -- 172.21.15.53:0/1696171993 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+4674 (secure 0 0 0) 0x7fd718158a90 con 0x7fd718155000 2023-06-10T18:56:22.210 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:56:22.210 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":20,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5168,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/275593879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":275593879},{"type":"v1","addr":"172.21.15.117:6837","nonce":275593879}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5422,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/2837986258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2837986258},{"type":"v1","addr":"172.21.15.117:6836","nonce":2837986258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5928,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/2789082937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2789082937},{"type":"v1","addr":"172.21.15.53:6833","nonce":2789082937}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T18:56:18.681744+0000","modified":"2023-06-10T18:56:21.825431+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5931},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5931":{"gid":5931,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/3463677034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":3463677034},{"type":"v1","addr":"172.21.15.53:6835","nonce":3463677034}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-06-10T18:56:22.211 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 20 2023-06-10T18:56:22.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.203+0000 7fd720239640 1 -- 172.21.15.53:0/1696171993 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd6fc066280 msgr2=0x7fd6fc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:22.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.203+0000 7fd720239640 1 --2- 172.21.15.53:0/1696171993 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd6fc066280 0x7fd6fc068730 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd71806cbb0 tx=0x7fd71400d040 comp rx=0 tx=0).stop 2023-06-10T18:56:22.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.203+0000 7fd720239640 1 -- 172.21.15.53:0/1696171993 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd718155000 msgr2=0x7fd7180acaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:22.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.203+0000 7fd720239640 1 --2- 172.21.15.53:0/1696171993 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd718155000 0x7fd7180acaf0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fd70801ca70 tx=0x7fd704005800 comp rx=0 tx=0).stop 2023-06-10T18:56:22.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.203+0000 7fd720239640 1 -- 172.21.15.53:0/1696171993 shutdown_connections 2023-06-10T18:56:22.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.203+0000 7fd720239640 1 --2- 172.21.15.53:0/1696171993 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd6fc066280 0x7fd6fc068730 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:22.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.203+0000 7fd720239640 1 --2- 172.21.15.53:0/1696171993 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7180ad030 0x7fd7180aebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:22.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.203+0000 7fd720239640 1 --2- 172.21.15.53:0/1696171993 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd718155000 0x7fd7180acaf0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:22.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.203+0000 7fd720239640 1 --2- 172.21.15.53:0/1696171993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7040047d0 0x7fd7180c2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:22.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.203+0000 7fd720239640 1 -- 172.21.15.53:0/1696171993 >> 172.21.15.53:0/1696171993 conn(0x7fd71806a0d0 msgr2=0x7fd7180afdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:22.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.203+0000 7fd720239640 1 -- 172.21.15.53:0/1696171993 shutdown_connections 2023-06-10T18:56:22.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.203+0000 7fd720239640 1 -- 172.21.15.53:0/1696171993 wait complete. 2023-06-10T18:56:22.224 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T18:56:22.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.343+0000 7f76e8bbc640 1 Processor -- start 2023-06-10T18:56:22.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.343+0000 7f76e8bbc640 1 -- start start 2023-06-10T18:56:22.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.343+0000 7f76e8bbc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f76e4070f80 0x7f76e40ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:22.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.343+0000 7f76e8bbc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f76e40ce990 0x7f76e4069450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:22.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.343+0000 7f76e8bbc640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76e415f2c0 con 0x7f76e415eef0 2023-06-10T18:56:22.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.343+0000 7f76e8bbc640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76e415fdc0 con 0x7f76e4070f80 2023-06-10T18:56:22.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.343+0000 7f76e8bbc640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76e41600a0 con 0x7f76e40ce990 2023-06-10T18:56:22.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.343+0000 7f76dbfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f76e4070f80 0x7f76e40ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:22.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.343+0000 7f76dbfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f76e4070f80 0x7f76e40ce450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59170/0 (socket says 172.21.15.53:59170) 2023-06-10T18:56:22.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.343+0000 7f76dbfff640 1 -- 172.21.15.53:0/1420730307 learned_addr learned my addr 172.21.15.53:0/1420730307 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:22.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.343+0000 7f76e2d9d640 1 --2- 172.21.15.53:0/1420730307 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f76e40ce990 0x7f76e4069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:22.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.343+0000 7f76dbfff640 1 -- 172.21.15.53:0/1420730307 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f76e40ce990 msgr2=0x7f76e4069450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:22.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.343+0000 7f76dbfff640 1 --2- 172.21.15.53:0/1420730307 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f76e40ce990 0x7f76e4069450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:22.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.343+0000 7f76dbfff640 1 -- 172.21.15.53:0/1420730307 >> v1:172.21.15.117:6789/0 conn(0x7f76e415eef0 legacy=0x7f76e415f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:22.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.343+0000 7f76dbfff640 1 -- 172.21.15.53:0/1420730307 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76e4160380 con 0x7f76e4070f80 2023-06-10T18:56:22.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.347+0000 7f76dbfff640 1 --2- 172.21.15.53:0/1420730307 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76e4070f80 0x7f76e40ce450 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f76cc009870 tx=0x7f76cc01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e0ed7e948c953ab server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:22.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.347+0000 7f76e1d9b640 1 -- 172.21.15.53:0/1420730307 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76cc0ab600 con 0x7f76e4070f80 2023-06-10T18:56:22.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.347+0000 7f76e1d9b640 1 -- 172.21.15.53:0/1420730307 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76cc0a7050 con 0x7f76e4070f80 2023-06-10T18:56:22.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.347+0000 7f76e1d9b640 1 -- 172.21.15.53:0/1420730307 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76cc0ab980 con 0x7f76e4070f80 2023-06-10T18:56:22.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.347+0000 7f76e8bbc640 1 -- 172.21.15.53:0/1420730307 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76e4070f80 msgr2=0x7f76e40ce450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:22.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.347+0000 7f76e8bbc640 1 --2- 172.21.15.53:0/1420730307 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76e4070f80 0x7f76e40ce450 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f76cc009870 tx=0x7f76cc01c500 comp rx=0 tx=0).stop 2023-06-10T18:56:22.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.347+0000 7f76e8bbc640 1 -- 172.21.15.53:0/1420730307 shutdown_connections 2023-06-10T18:56:22.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.347+0000 7f76e8bbc640 1 --2- 172.21.15.53:0/1420730307 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f76e40ce990 0x7f76e4069450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:22.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.347+0000 7f76e8bbc640 1 --2- 172.21.15.53:0/1420730307 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76e4070f80 0x7f76e40ce450 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:22.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.347+0000 7f76e8bbc640 1 -- 172.21.15.53:0/1420730307 >> 172.21.15.53:0/1420730307 conn(0x7f76e406a560 msgr2=0x7f76e406a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:22.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.347+0000 7f76e8bbc640 1 -- 172.21.15.53:0/1420730307 shutdown_connections 2023-06-10T18:56:22.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.347+0000 7f76e8bbc640 1 -- 172.21.15.53:0/1420730307 wait complete. 2023-06-10T18:56:22.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.347+0000 7f76e8bbc640 1 Processor -- start 2023-06-10T18:56:22.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.347+0000 7f76e8bbc640 1 -- start start 2023-06-10T18:56:22.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.347+0000 7f76e8bbc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f76e4070f80 0x7f76e40c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:22.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.347+0000 7f76e8bbc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76e40ce990 0x7f76e41f5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:22.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.347+0000 7f76e8bbc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f76e415eef0 0x7f76e41522d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:22.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.347+0000 7f76e8bbc640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e40c6520 con 0x7f76e40ce990 2023-06-10T18:56:22.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.347+0000 7f76e8bbc640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e40c6800 con 0x7f76e4070f80 2023-06-10T18:56:22.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.347+0000 7f76e8bbc640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76e40c6ae0 con 0x7f76e415eef0 2023-06-10T18:56:22.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.347+0000 7f76dbfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76e40ce990 0x7f76e41f5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:22.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.347+0000 7f76dbfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76e40ce990 0x7f76e41f5230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59184/0 (socket says 172.21.15.53:59184) 2023-06-10T18:56:22.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.347+0000 7f76dbfff640 1 -- 172.21.15.53:0/3853678649 learned_addr learned my addr 172.21.15.53:0/3853678649 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:22.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.347+0000 7f76e259c640 1 --2- 172.21.15.53:0/3853678649 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f76e4070f80 0x7f76e40c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:22.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.347+0000 7f76e2d9d640 1 --2- 172.21.15.53:0/3853678649 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f76e415eef0 0x7f76e41522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:22.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.347+0000 7f76dbfff640 1 -- 172.21.15.53:0/3853678649 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f76e415eef0 msgr2=0x7f76e41522d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:22.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.347+0000 7f76dbfff640 1 --2- 172.21.15.53:0/3853678649 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f76e415eef0 0x7f76e41522d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:22.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.347+0000 7f76dbfff640 1 -- 172.21.15.53:0/3853678649 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f76e4070f80 msgr2=0x7f76e40c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:22.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.347+0000 7f76dbfff640 1 --2- 172.21.15.53:0/3853678649 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f76e4070f80 0x7f76e40c75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:22.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.347+0000 7f76dbfff640 1 -- 172.21.15.53:0/3853678649 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76cc0094d0 con 0x7f76e40ce990 2023-06-10T18:56:22.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.347+0000 7f76e259c640 1 --2- 172.21.15.53:0/3853678649 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f76e4070f80 0x7f76e40c75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:56:22.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.347+0000 7f76e2d9d640 1 --2- 172.21.15.53:0/3853678649 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f76e415eef0 0x7f76e41522d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:56:22.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.347+0000 7f76dbfff640 1 --2- 172.21.15.53:0/3853678649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76e40ce990 0x7f76e41f5230 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f76cc0ae040 tx=0x7f76cc0192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:22.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.347+0000 7f76daffd640 1 -- 172.21.15.53:0/3853678649 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76cc0b4420 con 0x7f76e40ce990 2023-06-10T18:56:22.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.347+0000 7f76daffd640 1 -- 172.21.15.53:0/3853678649 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76cc0b4580 con 0x7f76e40ce990 2023-06-10T18:56:22.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.347+0000 7f76e8bbc640 1 -- 172.21.15.53:0/3853678649 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76e40c6dc0 con 0x7f76e40ce990 2023-06-10T18:56:22.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.347+0000 7f76daffd640 1 -- 172.21.15.53:0/3853678649 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76cc0b4930 con 0x7f76e40ce990 2023-06-10T18:56:22.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.347+0000 7f76e8bbc640 1 -- 172.21.15.53:0/3853678649 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76e40c6090 con 0x7f76e40ce990 2023-06-10T18:56:22.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.351+0000 7f76e8bbc640 1 -- 172.21.15.53:0/3853678649 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76e40c6280 con 0x7f76e40ce990 2023-06-10T18:56:22.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.351+0000 7f76daffd640 1 -- 172.21.15.53:0/3853678649 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f76cc0b2070 con 0x7f76e40ce990 2023-06-10T18:56:22.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.351+0000 7f76daffd640 1 --2- 172.21.15.53:0/3853678649 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f76c4066280 0x7f76c4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:22.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.351+0000 7f76daffd640 1 -- 172.21.15.53:0/3853678649 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f76cc11d080 con 0x7f76e40ce990 2023-06-10T18:56:22.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.351+0000 7f76e259c640 1 --2- 172.21.15.53:0/3853678649 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f76c4066280 0x7f76c4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:22.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.351+0000 7f76e259c640 1 --2- 172.21.15.53:0/3853678649 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f76c4066280 0x7f76c4068730 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f76d400a850 tx=0x7f76d4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:22.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.355+0000 7f76daffd640 1 -- 172.21.15.53:0/3853678649 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f76cc0ea500 con 0x7f76e40ce990 2023-06-10T18:56:22.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.507+0000 7f76e8bbc640 1 -- 172.21.15.53:0/3853678649 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f76e404d790 con 0x7f76e40ce990 2023-06-10T18:56:22.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.511+0000 7f76daffd640 1 -- 172.21.15.53:0/3853678649 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+18339 (secure 0 0 0) 0x7f76cc0edb20 con 0x7f76e40ce990 2023-06-10T18:56:22.516 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:56:22.516 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":51,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T18:56:19.684508+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-06-10T18:56:16.364582+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-06-10T18:56:17.656793+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T18:56:22.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.515+0000 7f76e8bbc640 1 -- 172.21.15.53:0/3853678649 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f76c4066280 msgr2=0x7f76c4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:22.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.515+0000 7f76e8bbc640 1 --2- 172.21.15.53:0/3853678649 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f76c4066280 0x7f76c4068730 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f76d400a850 tx=0x7f76d4008040 comp rx=0 tx=0).stop 2023-06-10T18:56:22.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.515+0000 7f76e8bbc640 1 -- 172.21.15.53:0/3853678649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76e40ce990 msgr2=0x7f76e41f5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:22.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.515+0000 7f76e8bbc640 1 --2- 172.21.15.53:0/3853678649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76e40ce990 0x7f76e41f5230 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f76cc0ae040 tx=0x7f76cc0192a0 comp rx=0 tx=0).stop 2023-06-10T18:56:22.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.515+0000 7f76e8bbc640 1 -- 172.21.15.53:0/3853678649 shutdown_connections 2023-06-10T18:56:22.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.515+0000 7f76e8bbc640 1 --2- 172.21.15.53:0/3853678649 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f76c4066280 0x7f76c4068730 secure :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f76d400a850 tx=0x7f76d4008040 comp rx=0 tx=0).stop 2023-06-10T18:56:22.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.515+0000 7f76e8bbc640 1 --2- 172.21.15.53:0/3853678649 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f76e415eef0 0x7f76e41522d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:22.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.515+0000 7f76e8bbc640 1 --2- 172.21.15.53:0/3853678649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76e40ce990 0x7f76e41f5230 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:22.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.515+0000 7f76e8bbc640 1 --2- 172.21.15.53:0/3853678649 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f76e4070f80 0x7f76e40c75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:22.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.515+0000 7f76e8bbc640 1 -- 172.21.15.53:0/3853678649 >> 172.21.15.53:0/3853678649 conn(0x7f76e406a560 msgr2=0x7f76e40c90c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:22.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.515+0000 7f76e8bbc640 1 -- 172.21.15.53:0/3853678649 shutdown_connections 2023-06-10T18:56:22.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.515+0000 7f76e8bbc640 1 -- 172.21.15.53:0/3853678649 wait complete. 2023-06-10T18:56:22.535 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-06-10T18:56:22.535 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-10T18:56:22.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.643+0000 7ff81ccda640 1 Processor -- start 2023-06-10T18:56:22.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.643+0000 7ff81ccda640 1 -- start start 2023-06-10T18:56:22.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.643+0000 7ff81ccda640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff818157e10 0x7ff81806efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:22.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.643+0000 7ff81ccda640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8180afe30 0x7ff8180ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:22.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.643+0000 7ff81ccda640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8180c9e50 con 0x7ff81806bb30 2023-06-10T18:56:22.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.643+0000 7ff81ccda640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8180cd520 con 0x7ff818157e10 2023-06-10T18:56:22.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.643+0000 7ff81ccda640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8180c82f0 con 0x7ff8180afe30 2023-06-10T18:56:22.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.643+0000 7ff815d9b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ff81806bb30 0x7ff8180af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:54020/0 (socket says 172.21.15.53:54020) 2023-06-10T18:56:22.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.643+0000 7ff815d9b640 1 -- 172.21.15.53:0/1461507451 learned_addr learned my addr 172.21.15.53:0/1461507451 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:56:22.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.643+0000 7ff81659c640 1 --2- 172.21.15.53:0/1461507451 >> v2:172.21.15.117:3300/0 conn(0x7ff818157e10 0x7ff81806efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:22.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.643+0000 7ff816d9d640 1 --2- 172.21.15.53:0/1461507451 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8180afe30 0x7ff8180ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:22.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.643+0000 7ff81559a640 1 -- 172.21.15.53:0/1461507451 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1612912712 0 0) 0x7ff8180c9e50 con 0x7ff81806bb30 2023-06-10T18:56:22.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.643+0000 7ff81559a640 1 -- 172.21.15.53:0/1461507451 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff800003530 con 0x7ff81806bb30 2023-06-10T18:56:22.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.643+0000 7ff81559a640 1 -- 172.21.15.53:0/1461507451 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1912261256 0 0) 0x7ff800003530 con 0x7ff81806bb30 2023-06-10T18:56:22.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.643+0000 7ff81559a640 1 -- 172.21.15.53:0/1461507451 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8180afe30 msgr2=0x7ff8180ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:22.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.643+0000 7ff81559a640 1 --2- 172.21.15.53:0/1461507451 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8180afe30 0x7ff8180ccfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:22.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.643+0000 7ff81559a640 1 -- 172.21.15.53:0/1461507451 >> v2:172.21.15.117:3300/0 conn(0x7ff818157e10 msgr2=0x7ff81806efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:22.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.643+0000 7ff81559a640 1 --2- 172.21.15.53:0/1461507451 >> v2:172.21.15.117:3300/0 conn(0x7ff818157e10 0x7ff81806efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:22.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.643+0000 7ff81559a640 1 -- 172.21.15.53:0/1461507451 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff81806bf80 con 0x7ff81806bb30 2023-06-10T18:56:22.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.643+0000 7ff81559a640 1 -- 172.21.15.53:0/1461507451 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7ff80c001680 con 0x7ff81806bb30 2023-06-10T18:56:22.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.643+0000 7ff81559a640 1 -- 172.21.15.53:0/1461507451 >> v1:172.21.15.53:6789/0 conn(0x7ff81806bb30 legacy=0x7ff8180af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:22.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.643+0000 7ff81559a640 1 --2- 172.21.15.53:0/1461507451 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8180afe30 0x7ff8000039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:22.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.643+0000 7ff81559a640 1 --2- 172.21.15.53:0/1461507451 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff800003f70 0x7ff8000047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:22.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.643+0000 7ff81559a640 1 --2- 172.21.15.53:0/1461507451 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff800004d10 0x7ff800005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:22.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.643+0000 7ff81559a640 1 -- 172.21.15.53:0/1461507451 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8180cd520 con 0x7ff800004d10 2023-06-10T18:56:22.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.643+0000 7ff81559a640 1 -- 172.21.15.53:0/1461507451 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8180c82f0 con 0x7ff800003f70 2023-06-10T18:56:22.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.643+0000 7ff81559a640 1 -- 172.21.15.53:0/1461507451 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff80000ba40 con 0x7ff8180afe30 2023-06-10T18:56:22.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.643+0000 7ff816d9d640 1 --2- 172.21.15.53:0/1461507451 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff800004d10 0x7ff800005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:22.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.643+0000 7ff815d9b640 1 --2- 172.21.15.53:0/1461507451 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff800003f70 0x7ff8000047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:22.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.643+0000 7ff81659c640 1 --2- 172.21.15.53:0/1461507451 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8180afe30 0x7ff8000039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:22.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.643+0000 7ff816d9d640 1 -- 172.21.15.53:0/1461507451 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8180afe30 msgr2=0x7ff8000039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:22.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.643+0000 7ff816d9d640 1 --2- 172.21.15.53:0/1461507451 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8180afe30 0x7ff8000039f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:22.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.643+0000 7ff816d9d640 1 -- 172.21.15.53:0/1461507451 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff800003f70 msgr2=0x7ff8000047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:22.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.643+0000 7ff816d9d640 1 --2- 172.21.15.53:0/1461507451 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff800003f70 0x7ff8000047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:22.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.643+0000 7ff816d9d640 1 -- 172.21.15.53:0/1461507451 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff800003530 con 0x7ff800004d10 2023-06-10T18:56:22.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.643+0000 7ff815d9b640 1 --2- 172.21.15.53:0/1461507451 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff800003f70 0x7ff8000047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:56:22.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.647+0000 7ff816d9d640 1 --2- 172.21.15.53:0/1461507451 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff800004d10 0x7ff800005180 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7ff81806cb60 tx=0x7ff81001cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c11cd9a515b9af45 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:22.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.647+0000 7ff81559a640 1 -- 172.21.15.53:0/1461507451 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8100a5c10 con 0x7ff800004d10 2023-06-10T18:56:22.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.647+0000 7ff81559a640 1 -- 172.21.15.53:0/1461507451 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff81000f040 con 0x7ff800004d10 2023-06-10T18:56:22.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.647+0000 7ff81559a640 1 -- 172.21.15.53:0/1461507451 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8100ad440 con 0x7ff800004d10 2023-06-10T18:56:22.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.647+0000 7ff81ccda640 1 -- 172.21.15.53:0/1461507451 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff800004d10 msgr2=0x7ff800005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:22.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.647+0000 7ff81ccda640 1 --2- 172.21.15.53:0/1461507451 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff800004d10 0x7ff800005180 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7ff81806cb60 tx=0x7ff81001cc00 comp rx=0 tx=0).stop 2023-06-10T18:56:22.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.647+0000 7ff816d9d640 1 -- 172.21.15.53:0/1461507451 reap_dead start 2023-06-10T18:56:22.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.647+0000 7ff81ccda640 1 -- 172.21.15.53:0/1461507451 shutdown_connections 2023-06-10T18:56:22.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.647+0000 7ff81ccda640 1 -- 172.21.15.53:0/1461507451 >> 172.21.15.53:0/1461507451 conn(0x7ff81806a0d0 msgr2=0x7ff8180ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:22.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.647+0000 7ff81ccda640 1 -- 172.21.15.53:0/1461507451 shutdown_connections 2023-06-10T18:56:22.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.647+0000 7ff81ccda640 1 -- 172.21.15.53:0/1461507451 wait complete. 2023-06-10T18:56:22.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.647+0000 7ff81ccda640 1 Processor -- start 2023-06-10T18:56:22.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.647+0000 7ff81ccda640 1 -- start start 2023-06-10T18:56:22.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.647+0000 7ff81ccda640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff81814cff0 0x7ff8180c3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:22.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.647+0000 7ff81ccda640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff81814d3c0 0x7ff81814e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:22.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.647+0000 7ff81ccda640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8180c3dd0 0x7ff81814ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:22.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.647+0000 7ff81ccda640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8180c2d10 con 0x7ff81814cff0 2023-06-10T18:56:22.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.647+0000 7ff81ccda640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8180c5fd0 con 0x7ff81814d3c0 2023-06-10T18:56:22.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.647+0000 7ff81ccda640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8180c62b0 con 0x7ff8180c3dd0 2023-06-10T18:56:22.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.647+0000 7ff81659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff81814cff0 0x7ff8180c3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:22.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.647+0000 7ff81659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff81814cff0 0x7ff8180c3890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59214/0 (socket says 172.21.15.53:59214) 2023-06-10T18:56:22.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.647+0000 7ff81659c640 1 -- 172.21.15.53:0/1867590950 learned_addr learned my addr 172.21.15.53:0/1867590950 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:22.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.647+0000 7ff815d9b640 1 --2- 172.21.15.53:0/1867590950 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff81814d3c0 0x7ff81814e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:22.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.647+0000 7ff81659c640 1 -- 172.21.15.53:0/1867590950 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8180c3dd0 msgr2=0x7ff81814ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:22.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.647+0000 7ff81659c640 1 --2- 172.21.15.53:0/1867590950 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8180c3dd0 0x7ff81814ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:22.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.647+0000 7ff81659c640 1 -- 172.21.15.53:0/1867590950 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff81814d3c0 msgr2=0x7ff81814e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:22.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.647+0000 7ff81659c640 1 --2- 172.21.15.53:0/1867590950 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff81814d3c0 0x7ff81814e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:22.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.647+0000 7ff81659c640 1 -- 172.21.15.53:0/1867590950 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8180c6590 con 0x7ff81814cff0 2023-06-10T18:56:22.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.647+0000 7ff815d9b640 1 --2- 172.21.15.53:0/1867590950 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff81814d3c0 0x7ff81814e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:56:22.660 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.647+0000 7ff81659c640 1 --2- 172.21.15.53:0/1867590950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff81814cff0 0x7ff8180c3890 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7ff808010900 tx=0x7ff808010dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:22.660 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.651+0000 7ff806ffd640 1 -- 172.21.15.53:0/1867590950 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8080096b0 con 0x7ff81814cff0 2023-06-10T18:56:22.660 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.651+0000 7ff806ffd640 1 -- 172.21.15.53:0/1867590950 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff80800eba0 con 0x7ff81814cff0 2023-06-10T18:56:22.660 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.651+0000 7ff806ffd640 1 -- 172.21.15.53:0/1867590950 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff80801c400 con 0x7ff81814cff0 2023-06-10T18:56:22.660 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.651+0000 7ff81ccda640 1 -- 172.21.15.53:0/1867590950 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8180c6870 con 0x7ff81814cff0 2023-06-10T18:56:22.660 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.651+0000 7ff81ccda640 1 -- 172.21.15.53:0/1867590950 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8180c7070 con 0x7ff81814cff0 2023-06-10T18:56:22.660 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.651+0000 7ff81ccda640 1 -- 172.21.15.53:0/1867590950 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff81804d790 con 0x7ff81814cff0 2023-06-10T18:56:22.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.651+0000 7ff806ffd640 1 -- 172.21.15.53:0/1867590950 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff80801c560 con 0x7ff81814cff0 2023-06-10T18:56:22.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.651+0000 7ff806ffd640 1 --2- 172.21.15.53:0/1867590950 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff7f80662b0 0x7ff7f8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:22.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.651+0000 7ff806ffd640 1 -- 172.21.15.53:0/1867590950 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff808084290 con 0x7ff81814cff0 2023-06-10T18:56:22.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.651+0000 7ff815d9b640 1 --2- 172.21.15.53:0/1867590950 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff7f80662b0 0x7ff7f8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:22.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.651+0000 7ff815d9b640 1 --2- 172.21.15.53:0/1867590950 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff7f80662b0 0x7ff7f8068760 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ff80c000f70 tx=0x7ff80c0014c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:22.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.655+0000 7ff806ffd640 1 -- 172.21.15.53:0/1867590950 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff8080517b0 con 0x7ff81814cff0 2023-06-10T18:56:22.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.799+0000 7ff81ccda640 1 -- 172.21.15.53:0/1867590950 --> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff8180ca360 con 0x7ff7f80662b0 2023-06-10T18:56:22.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.823+0000 7ff806ffd640 1 -- 172.21.15.53:0/1867590950 <== mgr.4105 v2:172.21.15.117:6832/3061986771 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+297258 (secure 0 0 0) 0x7ff80c011d80 con 0x7ff7f80662b0 2023-06-10T18:56:22.830 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:56:22.832 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-06-10T18:56:22.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.827+0000 7ff81ccda640 1 -- 172.21.15.53:0/1867590950 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff7f80662b0 msgr2=0x7ff7f8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:22.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.827+0000 7ff81ccda640 1 --2- 172.21.15.53:0/1867590950 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff7f80662b0 0x7ff7f8068760 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ff80c000f70 tx=0x7ff80c0014c0 comp rx=0 tx=0).stop 2023-06-10T18:56:22.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.827+0000 7ff81ccda640 1 -- 172.21.15.53:0/1867590950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff81814cff0 msgr2=0x7ff8180c3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:22.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.827+0000 7ff81ccda640 1 --2- 172.21.15.53:0/1867590950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff81814cff0 0x7ff8180c3890 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7ff808010900 tx=0x7ff808010dc0 comp rx=0 tx=0).stop 2023-06-10T18:56:22.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.827+0000 7ff81ccda640 1 -- 172.21.15.53:0/1867590950 shutdown_connections 2023-06-10T18:56:22.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.827+0000 7ff81ccda640 1 --2- 172.21.15.53:0/1867590950 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff7f80662b0 0x7ff7f8068760 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:22.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.827+0000 7ff81ccda640 1 --2- 172.21.15.53:0/1867590950 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8180c3dd0 0x7ff81814ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:22.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.827+0000 7ff81ccda640 1 --2- 172.21.15.53:0/1867590950 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff81814d3c0 0x7ff81814e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:22.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.827+0000 7ff81ccda640 1 --2- 172.21.15.53:0/1867590950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff81814cff0 0x7ff8180c3890 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:22.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.827+0000 7ff81ccda640 1 -- 172.21.15.53:0/1867590950 >> 172.21.15.53:0/1867590950 conn(0x7ff81806a0d0 msgr2=0x7ff8180cbba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:22.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.827+0000 7ff81ccda640 1 -- 172.21.15.53:0/1867590950 shutdown_connections 2023-06-10T18:56:22.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:22.827+0000 7ff81ccda640 1 -- 172.21.15.53:0/1867590950 wait complete. 2023-06-10T18:56:22.846 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":159,"stamp":"2023-06-10T18:56:21.638167+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237504,"kb_used_data":5504,"kb_used_omap":0,"kb_used_meta":231936,"kb_avail":754737216,"statfs":{"total":773094113280,"available":772850909184,"internally_reserved":0,"allocated":5636096,"data_stored":3070917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":237502464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.352346"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.298104+0000","last_change":"2023-06-10T18:56:17.298104+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.298104+0000","last_undegraded":"2023-06-10T18:56:17.298104+0000","last_fullsized":"2023-06-10T18:56:17.298104+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.289656+0000","last_change":"2023-06-10T18:56:17.289656+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.289656+0000","last_undegraded":"2023-06-10T18:56:17.289656+0000","last_fullsized":"2023-06-10T18:56:17.289656+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.291448+0000","last_change":"2023-06-10T18:56:17.291448+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.291448+0000","last_undegraded":"2023-06-10T18:56:17.291448+0000","last_fullsized":"2023-06-10T18:56:17.291448+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.296823+0000","last_change":"2023-06-10T18:56:17.296823+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.296823+0000","last_undegraded":"2023-06-10T18:56:17.296823+0000","last_fullsized":"2023-06-10T18:56:17.296823+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.296135+0000","last_change":"2023-06-10T18:56:17.296135+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.296135+0000","last_undegraded":"2023-06-10T18:56:17.296135+0000","last_fullsized":"2023-06-10T18:56:17.296135+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.289245+0000","last_change":"2023-06-10T18:56:17.289245+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.289245+0000","last_undegraded":"2023-06-10T18:56:17.289245+0000","last_fullsized":"2023-06-10T18:56:17.289245+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.294945+0000","last_change":"2023-06-10T18:56:17.294945+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.294945+0000","last_undegraded":"2023-06-10T18:56:17.294945+0000","last_fullsized":"2023-06-10T18:56:17.294945+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.295322+0000","last_change":"2023-06-10T18:56:17.295322+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.295322+0000","last_undegraded":"2023-06-10T18:56:17.295322+0000","last_fullsized":"2023-06-10T18:56:17.295322+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.298508+0000","last_change":"2023-06-10T18:56:17.298508+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.298508+0000","last_undegraded":"2023-06-10T18:56:17.298508+0000","last_fullsized":"2023-06-10T18:56:17.298508+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.289523+0000","last_change":"2023-06-10T18:56:17.289523+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.289523+0000","last_undegraded":"2023-06-10T18:56:17.289523+0000","last_fullsized":"2023-06-10T18:56:17.289523+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.300882+0000","last_change":"2023-06-10T18:56:17.300882+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.300882+0000","last_undegraded":"2023-06-10T18:56:17.300882+0000","last_fullsized":"2023-06-10T18:56:17.300882+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.293909+0000","last_change":"2023-06-10T18:56:17.293909+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.293909+0000","last_undegraded":"2023-06-10T18:56:17.293909+0000","last_fullsized":"2023-06-10T18:56:17.293909+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.295642+0000","last_change":"2023-06-10T18:56:17.295642+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.295642+0000","last_undegraded":"2023-06-10T18:56:17.295642+0000","last_fullsized":"2023-06-10T18:56:17.295642+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.294849+0000","last_change":"2023-06-10T18:56:17.294849+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.294849+0000","last_undegraded":"2023-06-10T18:56:17.294849+0000","last_fullsized":"2023-06-10T18:56:17.294849+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.294831+0000","last_change":"2023-06-10T18:56:17.294831+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.294831+0000","last_undegraded":"2023-06-10T18:56:17.294831+0000","last_fullsized":"2023-06-10T18:56:17.294831+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.293216+0000","last_change":"2023-06-10T18:56:17.293216+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.293216+0000","last_undegraded":"2023-06-10T18:56:17.293216+0000","last_fullsized":"2023-06-10T18:56:17.293216+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.295221+0000","last_change":"2023-06-10T18:56:17.295221+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.295221+0000","last_undegraded":"2023-06-10T18:56:17.295221+0000","last_fullsized":"2023-06-10T18:56:17.295221+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.289785+0000","last_change":"2023-06-10T18:56:17.289785+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.289785+0000","last_undegraded":"2023-06-10T18:56:17.289785+0000","last_fullsized":"2023-06-10T18:56:17.289785+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.294974+0000","last_change":"2023-06-10T18:56:17.294974+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.294974+0000","last_undegraded":"2023-06-10T18:56:17.294974+0000","last_fullsized":"2023-06-10T18:56:17.294974+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.296124+0000","last_change":"2023-06-10T18:56:17.296124+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.296124+0000","last_undegraded":"2023-06-10T18:56:17.296124+0000","last_fullsized":"2023-06-10T18:56:17.296124+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.289645+0000","last_change":"2023-06-10T18:56:17.289645+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.289645+0000","last_undegraded":"2023-06-10T18:56:17.289645+0000","last_fullsized":"2023-06-10T18:56:17.289645+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.294752+0000","last_change":"2023-06-10T18:56:17.294752+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.294752+0000","last_undegraded":"2023-06-10T18:56:17.294752+0000","last_fullsized":"2023-06-10T18:56:17.294752+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.294908+0000","last_change":"2023-06-10T18:56:17.294908+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.294908+0000","last_undegraded":"2023-06-10T18:56:17.294908+0000","last_fullsized":"2023-06-10T18:56:17.294908+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.289886+0000","last_change":"2023-06-10T18:56:17.289886+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.289886+0000","last_undegraded":"2023-06-10T18:56:17.289886+0000","last_fullsized":"2023-06-10T18:56:17.289886+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.294982+0000","last_change":"2023-06-10T18:56:17.294982+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.294982+0000","last_undegraded":"2023-06-10T18:56:17.294982+0000","last_fullsized":"2023-06-10T18:56:17.294982+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":216,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-06-10T18:56:17.296459+0000","last_change":"2023-06-10T18:52:34.951528+0000","last_active":"2023-06-10T18:56:17.296459+0000","last_peered":"2023-06-10T18:56:17.296459+0000","last_clean":"2023-06-10T18:56:17.296459+0000","last_became_active":"2023-06-10T18:52:34.949099+0000","last_became_peered":"2023-06-10T18:52:34.949099+0000","last_unstale":"2023-06-10T18:56:17.296459+0000","last_undegraded":"2023-06-10T18:56:17.296459+0000","last_fullsized":"2023-06-10T18:56:17.296459+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_clean_scrub_stamp":"2023-06-10T18:52:33.633295+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:53:32.439531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":62,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-06-10T18:56:17.296089+0000","last_change":"2023-06-10T18:52:40.506384+0000","last_active":"2023-06-10T18:56:17.296089+0000","last_peered":"2023-06-10T18:56:17.296089+0000","last_clean":"2023-06-10T18:56:17.296089+0000","last_became_active":"2023-06-10T18:52:40.505701+0000","last_became_peered":"2023-06-10T18:52:40.505701+0000","last_unstale":"2023-06-10T18:56:17.296089+0000","last_undegraded":"2023-06-10T18:56:17.296089+0000","last_fullsized":"2023-06-10T18:56:17.296089+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:42:06.079219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.300199+0000","last_change":"2023-06-10T18:56:17.300199+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.300199+0000","last_undegraded":"2023-06-10T18:56:17.300199+0000","last_fullsized":"2023-06-10T18:56:17.300199+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":60,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-06-10T18:56:17.296117+0000","last_change":"2023-06-10T18:52:40.512015+0000","last_active":"2023-06-10T18:56:17.296117+0000","last_peered":"2023-06-10T18:56:17.296117+0000","last_clean":"2023-06-10T18:56:17.296117+0000","last_became_active":"2023-06-10T18:52:40.511382+0000","last_became_peered":"2023-06-10T18:52:40.511382+0000","last_unstale":"2023-06-10T18:56:17.296117+0000","last_undegraded":"2023-06-10T18:56:17.296117+0000","last_fullsized":"2023-06-10T18:56:17.296117+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:14:11.722106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.295569+0000","last_change":"2023-06-10T18:56:17.295569+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.295569+0000","last_undegraded":"2023-06-10T18:56:17.295569+0000","last_fullsized":"2023-06-10T18:56:17.295569+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":62,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-06-10T18:56:17.287206+0000","last_change":"2023-06-10T18:52:40.671725+0000","last_active":"2023-06-10T18:56:17.287206+0000","last_peered":"2023-06-10T18:56:17.287206+0000","last_clean":"2023-06-10T18:56:17.287206+0000","last_became_active":"2023-06-10T18:52:40.671442+0000","last_became_peered":"2023-06-10T18:52:40.671442+0000","last_unstale":"2023-06-10T18:56:17.287206+0000","last_undegraded":"2023-06-10T18:56:17.287206+0000","last_fullsized":"2023-06-10T18:56:17.287206+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:51:06.334711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.296581+0000","last_change":"2023-06-10T18:56:17.296581+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.296581+0000","last_undegraded":"2023-06-10T18:56:17.296581+0000","last_fullsized":"2023-06-10T18:56:17.296581+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":62,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-06-10T18:56:17.297511+0000","last_change":"2023-06-10T18:52:40.510258+0000","last_active":"2023-06-10T18:56:17.297511+0000","last_peered":"2023-06-10T18:56:17.297511+0000","last_clean":"2023-06-10T18:56:17.297511+0000","last_became_active":"2023-06-10T18:52:40.509560+0000","last_became_peered":"2023-06-10T18:52:40.509560+0000","last_unstale":"2023-06-10T18:56:17.297511+0000","last_undegraded":"2023-06-10T18:56:17.297511+0000","last_fullsized":"2023-06-10T18:56:17.297511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:12:41.321044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.289523+0000","last_change":"2023-06-10T18:56:17.289523+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.289523+0000","last_undegraded":"2023-06-10T18:56:17.289523+0000","last_fullsized":"2023-06-10T18:56:17.289523+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":58,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-06-10T18:56:17.292501+0000","last_change":"2023-06-10T18:52:40.672266+0000","last_active":"2023-06-10T18:56:17.292501+0000","last_peered":"2023-06-10T18:56:17.292501+0000","last_clean":"2023-06-10T18:56:17.292501+0000","last_became_active":"2023-06-10T18:52:40.671966+0000","last_became_peered":"2023-06-10T18:52:40.671966+0000","last_unstale":"2023-06-10T18:56:17.292501+0000","last_undegraded":"2023-06-10T18:56:17.292501+0000","last_fullsized":"2023-06-10T18:56:17.292501+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:57:03.883411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.295123+0000","last_change":"2023-06-10T18:56:17.295123+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.295123+0000","last_undegraded":"2023-06-10T18:56:17.295123+0000","last_fullsized":"2023-06-10T18:56:17.295123+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":60,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-06-10T18:56:17.301379+0000","last_change":"2023-06-10T18:52:40.671084+0000","last_active":"2023-06-10T18:56:17.301379+0000","last_peered":"2023-06-10T18:56:17.301379+0000","last_clean":"2023-06-10T18:56:17.301379+0000","last_became_active":"2023-06-10T18:52:40.670697+0000","last_became_peered":"2023-06-10T18:52:40.670697+0000","last_unstale":"2023-06-10T18:56:17.301379+0000","last_undegraded":"2023-06-10T18:56:17.301379+0000","last_fullsized":"2023-06-10T18:56:17.301379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:00:32.947088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.293534+0000","last_change":"2023-06-10T18:56:17.293534+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.293534+0000","last_undegraded":"2023-06-10T18:56:17.293534+0000","last_fullsized":"2023-06-10T18:56:17.293534+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":58,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-06-10T18:56:17.292862+0000","last_change":"2023-06-10T18:52:40.514114+0000","last_active":"2023-06-10T18:56:17.292862+0000","last_peered":"2023-06-10T18:56:17.292862+0000","last_clean":"2023-06-10T18:56:17.292862+0000","last_became_active":"2023-06-10T18:52:40.513638+0000","last_became_peered":"2023-06-10T18:52:40.513638+0000","last_unstale":"2023-06-10T18:56:17.292862+0000","last_undegraded":"2023-06-10T18:56:17.292862+0000","last_fullsized":"2023-06-10T18:56:17.292862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:03:15.366661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.293226+0000","last_change":"2023-06-10T18:56:17.293226+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.293226+0000","last_undegraded":"2023-06-10T18:56:17.293226+0000","last_fullsized":"2023-06-10T18:56:17.293226+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":62,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-06-10T18:56:17.299937+0000","last_change":"2023-06-10T18:52:40.515396+0000","last_active":"2023-06-10T18:56:17.299937+0000","last_peered":"2023-06-10T18:56:17.299937+0000","last_clean":"2023-06-10T18:56:17.299937+0000","last_became_active":"2023-06-10T18:52:40.514663+0000","last_became_peered":"2023-06-10T18:52:40.514663+0000","last_unstale":"2023-06-10T18:56:17.299937+0000","last_undegraded":"2023-06-10T18:56:17.299937+0000","last_fullsized":"2023-06-10T18:56:17.299937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:17:56.639920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574896,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28072,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343768,"statfs":{"total":96636764160,"available":96608018432,"internally_reserved":0,"allocated":1146880,"data_stored":824709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":0.90400000000000003,"15min":0.88200000000000001},"min":{"1min":0.73599999999999999,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.3759999999999999,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.91100000000000003},{"interface":"front","average":{"1min":1.006,"5min":0.94299999999999995,"15min":0.93000000000000005},"min":{"1min":0.81899999999999995,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.234,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":1.022}]},{"osd":1,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92400000000000004,"15min":0.91500000000000004},"min":{"1min":0.58599999999999997,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.3089999999999999,"5min":1.377,"15min":1.377},"last":0.99299999999999999},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.92500000000000004,"15min":0.91100000000000003},"min":{"1min":0.78400000000000003,"5min":0.504,"15min":0.504},"max":{"1min":1.111,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.82399999999999995}]},{"osd":2,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.83999999999999997,"15min":0.82799999999999996},"min":{"1min":0.64100000000000001,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.214,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.89900000000000002,"15min":0.90700000000000003},"min":{"1min":0.67500000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.325,"5min":1.367,"15min":1.367},"last":0.62}]},{"osd":3,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.92100000000000004,"15min":0.89900000000000002},"min":{"1min":0.68100000000000005,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1499999999999999,"5min":1.502,"15min":1.502},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.93799999999999994,"15min":0.92800000000000005},"min":{"1min":0.70399999999999996,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.2130000000000001,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.84799999999999998}]},{"osd":4,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.876,"15min":0.872},"min":{"1min":0.60199999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.141,"5min":1.639,"15min":1.639},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.96899999999999997,"15min":0.98099999999999998},"min":{"1min":0.748,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.238,"5min":1.411,"15min":1.411},"last":0.88400000000000001}]},{"osd":5,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.042,"15min":1.038},"min":{"1min":0.79800000000000004,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.2669999999999999,"5min":1.806,"15min":1.806},"last":0.79000000000000004},{"interface":"front","average":{"1min":1.081,"5min":1.05,"15min":1.052},"min":{"1min":0.93200000000000005,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.256,"5min":1.522,"15min":1.522},"last":1.111}]},{"osd":6,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.0129999999999999,"15min":1.008},"min":{"1min":0.78500000000000003,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.3,"5min":1.718,"15min":1.718},"last":0.72199999999999998},{"interface":"front","average":{"1min":1.147,"5min":1.095,"15min":1.0900000000000001},"min":{"1min":0.96599999999999997,"5min":0.441,"15min":0.441},"max":{"1min":1.409,"5min":1.464,"15min":1.464},"last":1.052}]}]},{"osd":6,"up_from":13,"seq":55834574897,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":565248,"data_stored":240511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.81999999999999995,"15min":0.80100000000000005},"min":{"1min":0.65800000000000003,"5min":0.502,"15min":0.502},"max":{"1min":1.0589999999999999,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.755},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.85199999999999998,"15min":0.83999999999999997},"min":{"1min":0.71799999999999997,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.0680000000000001,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":1.161}]},{"osd":1,"last update":"Sat Jun 10 18:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.873,"15min":0.85199999999999998},"min":{"1min":0.68999999999999995,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.879,"15min":0.85899999999999999},"min":{"1min":0.68999999999999995,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":0.91100000000000003}]},{"osd":2,"last update":"Sat Jun 10 18:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.871,"15min":0.85899999999999999},"min":{"1min":0.66000000000000003,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.1950000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.88500000000000001,"15min":0.88900000000000001},"min":{"1min":0.68000000000000005,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.109,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.995}]},{"osd":3,"last update":"Sat Jun 10 18:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.874,"15min":0.84799999999999998},"min":{"1min":0.64900000000000002,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.169,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":1.0209999999999999,"5min":0.997,"15min":0.995},"min":{"1min":0.72799999999999998,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":1.1160000000000001}]},{"osd":4,"last update":"Sat Jun 10 18:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.93799999999999994,"15min":0.95399999999999996},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.1259999999999999,"5min":1.198,"15min":1.198},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.95699999999999996,"5min":1.0049999999999999,"15min":1.0189999999999999},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.1879999999999999,"5min":1.222,"15min":1.222},"last":1.0549999999999999}]},{"osd":5,"last update":"Sat Jun 10 18:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.94999999999999996,"15min":0.96199999999999997},"min":{"1min":0.68700000000000006,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.0720000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.879},{"interface":"front","average":{"1min":1.02,"5min":1.0249999999999999,"15min":1.026},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.97199999999999998}]},{"osd":7,"last update":"Sat Jun 10 18:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":1.0389999999999999,"15min":1.0489999999999999},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.1739999999999999,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":1.2030000000000001},{"interface":"front","average":{"1min":1.022,"5min":1.0569999999999999,"15min":1.0649999999999999},"min":{"1min":0.82199999999999995,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.2010000000000001,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":1.085}]}]},{"osd":5,"up_from":13,"seq":55834574897,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":540,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":552960,"data_stored":234341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.84199999999999997,"15min":0.82999999999999996},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.139,"5min":1.175,"15min":1.175},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.91800000000000004,"15min":0.94199999999999995},"min":{"1min":0.63800000000000001,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.246,"5min":1.637,"15min":1.637},"last":1.129}]},{"osd":1,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.91000000000000003,"15min":0.91800000000000004},"min":{"1min":0.67800000000000005,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.1559999999999999,"5min":1.335,"15min":1.335},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.91700000000000004,"15min":0.92100000000000004},"min":{"1min":0.72699999999999998,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.208,"5min":1.78,"15min":1.78},"last":0.63600000000000001}]},{"osd":2,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.65000000000000002,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.1000000000000001,"5min":1.446,"15min":1.446},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.91600000000000004,"15min":0.91200000000000003},"min":{"1min":0.71399999999999997,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.1379999999999999,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.93600000000000005}]},{"osd":3,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93899999999999995,"15min":0.94499999999999995},"min":{"1min":0.68600000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.206,"5min":1.484,"15min":1.484},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.97199999999999998,"5min":1.0249999999999999,"15min":1.0429999999999999},"min":{"1min":0.77100000000000002,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.2969999999999999,"5min":1.337,"15min":1.337},"last":1.1910000000000001}]},{"osd":4,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.96999999999999997,"15min":0.98899999999999999},"min":{"1min":0.70299999999999996,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.2669999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.94599999999999995,"5min":1.034,"15min":1.0640000000000001},"min":{"1min":0.66500000000000004,"5min":0.629,"15min":0.629},"max":{"1min":1.26,"5min":1.575,"15min":1.575},"last":0.90400000000000003}]},{"osd":6,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":1.038,"15min":1.0780000000000001},"min":{"1min":0.66000000000000003,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.2010000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.0589999999999999},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.0609999999999999,"15min":1.079},"min":{"1min":0.69799999999999995,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.2270000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.0389999999999999}]},{"osd":7,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.139,"15min":1.1739999999999999},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.226,"5min":1.873,"15min":1.873},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.155,"15min":1.181},"min":{"1min":0.80000000000000004,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.3680000000000001,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.46}]}]},{"osd":4,"up_from":13,"seq":55834574896,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":565248,"data_stored":240511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.76700000000000002,"15min":0.745},"min":{"1min":0.53400000000000003,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.1599999999999999,"5min":1.2,"15min":1.2},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.88200000000000001,"15min":0.88},"min":{"1min":0.63800000000000001,"5min":0.504,"15min":0.504},"max":{"1min":1.4970000000000001,"5min":1.73,"15min":1.73},"last":0.71499999999999997}]},{"osd":1,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.95199999999999996,"15min":0.95499999999999996},"min":{"1min":0.68200000000000005,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.84599999999999997,"15min":0.83699999999999997},"min":{"1min":0.66600000000000004,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.024,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.64500000000000002}]},{"osd":2,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.879,"15min":0.875},"min":{"1min":0.70799999999999996,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":0.877},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1,"15min":1.004},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.91700000000000004}]},{"osd":3,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.89900000000000002,"15min":0.88},"min":{"1min":0.80900000000000005,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.1679999999999999,"5min":1.22,"15min":1.22},"last":0.55700000000000005},{"interface":"front","average":{"1min":1.006,"5min":0.95799999999999996,"15min":0.95099999999999996},"min":{"1min":0.80100000000000005,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.4490000000000001,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.115}]},{"osd":5,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.96799999999999997,"15min":0.99399999999999999},"min":{"1min":0.67800000000000005,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.069,"5min":1.663,"15min":1.663},"last":1.0780000000000001},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.95399999999999996,"15min":0.98199999999999998},"min":{"1min":0.58099999999999996,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.111,"5min":1.353,"15min":1.353},"last":0.76200000000000001}]},{"osd":6,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":1.002,"15min":1.028},"min":{"1min":0.63100000000000001,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.5720000000000001,"5min":2.2639999999999998,"15min":2.2639999999999998},"last":1.04},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0720000000000001,"15min":1.0760000000000001},"min":{"1min":0.81200000000000006,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":1.004}]},{"osd":7,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.98399999999999999,"15min":0.99399999999999999},"min":{"1min":0.68899999999999995,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.1950000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.85299999999999998},{"interface":"front","average":{"1min":1.012,"5min":1.0529999999999999,"15min":1.071},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.2390000000000001,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":1.3879999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574895,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31584,"kb_used_data":536,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340256,"statfs":{"total":96636764160,"available":96604422144,"internally_reserved":0,"allocated":548864,"data_stored":233322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.57799999999999996,"15min":0.57199999999999995},"min":{"1min":0.51400000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.63500000000000001,"15min":0.63100000000000001},"min":{"1min":0.56000000000000005,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.59699999999999998}]},{"osd":1,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.64400000000000002,"15min":0.622},"min":{"1min":0.51000000000000001,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.747},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.72099999999999997,"15min":0.71599999999999997},"min":{"1min":0.56100000000000005,"5min":0.318,"15min":0.318},"max":{"1min":0.98899999999999999,"5min":1.411,"15min":1.411},"last":1.0620000000000001}]},{"osd":2,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.76100000000000001,"15min":0.75},"min":{"1min":0.63500000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.167,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.75900000000000001,"15min":0.74199999999999999},"min":{"1min":0.65200000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.1970000000000001,"5min":1.264,"15min":1.264},"last":0.80600000000000005}]},{"osd":4,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96099999999999997,"15min":0.96899999999999997},"min":{"1min":0.79800000000000004,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.3089999999999999,"5min":1.488,"15min":1.488},"last":0.88200000000000001},{"interface":"front","average":{"1min":1.052,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.82099999999999995,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.345,"5min":1.458,"15min":1.458},"last":0.84699999999999998}]},{"osd":5,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.0369999999999999,"15min":1.0589999999999999},"min":{"1min":0.80400000000000005,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.268,"5min":2.024,"15min":2.024},"last":0.94599999999999995},{"interface":"front","average":{"1min":1.101,"5min":1.026,"15min":1.014},"min":{"1min":0.83899999999999997,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.29,"5min":1.724,"15min":1.724},"last":1.2390000000000001}]},{"osd":6,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.0489999999999999,"15min":1.0469999999999999},"min":{"1min":0.92400000000000004,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.3300000000000001,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":1.401},{"interface":"front","average":{"1min":1.071,"5min":1.0589999999999999,"15min":1.0720000000000001},"min":{"1min":0.90700000000000003,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.302,"5min":1.78,"15min":1.78},"last":0.98699999999999999}]},{"osd":7,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.101,"15min":1.1279999999999999},"min":{"1min":0.82799999999999996,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.3959999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.212,"5min":1.089,"15min":1.0740000000000001},"min":{"1min":1.0049999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.468,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":1.103}]}]},{"osd":2,"up_from":13,"seq":55834574896,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31600,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340240,"statfs":{"total":96636764160,"available":96604405760,"internally_reserved":0,"allocated":565248,"data_stored":240511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.60099999999999998,"15min":0.58799999999999997},"min":{"1min":0.498,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.97799999999999998,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.50800000000000001,"5min":0.378,"15min":0.378},"max":{"1min":1.024,"5min":1.224,"15min":1.224},"last":0.60499999999999998}]},{"osd":1,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.65000000000000002,"15min":0.64600000000000002},"min":{"1min":0.53400000000000003,"5min":0.307,"15min":0.307},"max":{"1min":0.89500000000000002,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.72299999999999998,"15min":0.68999999999999995},"min":{"1min":0.64700000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.89200000000000002}]},{"osd":3,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.73599999999999999,"15min":0.70599999999999996},"min":{"1min":0.64900000000000002,"5min":0.377,"15min":0.377},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.749,"15min":0.746},"min":{"1min":0.64700000000000002,"5min":0.252,"15min":0.252},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.745}]},{"osd":4,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.91900000000000004,"15min":0.91500000000000004},"min":{"1min":0.81000000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.93600000000000005},{"interface":"front","average":{"1min":1.097,"5min":1.0349999999999999,"15min":1.038},"min":{"1min":0.88600000000000001,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.476,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":1.202}]},{"osd":5,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.016,"15min":1.016},"min":{"1min":0.82699999999999996,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.379,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":1.2789999999999999},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.002,"15min":0.97799999999999998},"min":{"1min":0.77100000000000002,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.377,"5min":1.667,"15min":1.667},"last":0.97099999999999997}]},{"osd":6,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.0429999999999999,"15min":1.0229999999999999},"min":{"1min":0.84299999999999997,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.3049999999999999,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":1.0509999999999999},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.034,"15min":1.032},"min":{"1min":0.89400000000000002,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.4299999999999999,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":1.073}]},{"osd":7,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.099,"15min":1.099},"min":{"1min":0.82399999999999995,"5min":0.62,"15min":0.62},"max":{"1min":1.4339999999999999,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.1319999999999999},{"interface":"front","average":{"1min":1.153,"5min":1.0980000000000001,"15min":1.0760000000000001},"min":{"1min":0.95499999999999996,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.4239999999999999,"5min":1.752,"15min":1.752},"last":1.2310000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574898,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31584,"kb_used_data":536,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340256,"statfs":{"total":96636764160,"available":96604422144,"internally_reserved":0,"allocated":548864,"data_stored":233322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.67100000000000004,"15min":0.66100000000000003},"min":{"1min":0.47999999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.96699999999999997},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.71999999999999997,"15min":0.68600000000000005},"min":{"1min":0.63400000000000001,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.0369999999999999,"5min":1.694,"15min":1.694},"last":0.64500000000000002}]},{"osd":2,"last update":"Sat Jun 10 18:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.64400000000000002,"15min":0.623},"min":{"1min":0.53500000000000003,"5min":0.249,"15min":0.249},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.877,"5min":0.70199999999999996,"15min":0.65800000000000003},"min":{"1min":0.65600000000000003,"5min":0.315,"15min":0.315},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":0.79500000000000004}]},{"osd":3,"last update":"Sat Jun 10 18:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.77800000000000002,"15min":0.745},"min":{"1min":0.65900000000000003,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":1.2170000000000001},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.76100000000000001,"15min":0.749},"min":{"1min":0.58499999999999996,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.1100000000000001,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":0.73899999999999999}]},{"osd":4,"last update":"Sat Jun 10 18:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.87,"15min":0.83599999999999997},"min":{"1min":0.73399999999999999,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.90700000000000003},{"interface":"front","average":{"1min":1.087,"5min":1.1160000000000001,"15min":1.079},"min":{"1min":0.78500000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.5449999999999999,"5min":5.8209999999999997,"15min":5.8209999999999997},"last":1.141}]},{"osd":5,"last update":"Sat Jun 10 18:55:44 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.032,"15min":1.028},"min":{"1min":0.75800000000000001,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.4550000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":0.877},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0129999999999999,"15min":0.97099999999999997},"min":{"1min":0.754,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.3819999999999999,"5min":3.089,"15min":3.089},"last":0.754}]},{"osd":6,"last update":"Sat Jun 10 18:55:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.105,"15min":1.0309999999999999},"min":{"1min":0.75900000000000001,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.5249999999999999,"5min":7.2599999999999998,"15min":7.2599999999999998},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.081,"5min":1.107,"15min":1.0309999999999999},"min":{"1min":0.80800000000000005,"5min":0.622,"15min":0.622},"max":{"1min":1.591,"5min":9.0069999999999997,"15min":9.0069999999999997},"last":0.84799999999999998}]},{"osd":7,"last update":"Sat Jun 10 18:55:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.0980000000000001,"15min":1.083},"min":{"1min":0.89300000000000002,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.6879999999999999,"5min":2.105,"15min":2.105},"last":1.0640000000000001},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.085,"15min":1.0669999999999999},"min":{"1min":0.90200000000000002,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.573,"5min":2.2570000000000001,"15min":2.2570000000000001},"last":0.93100000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574897,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32164,"kb_used_data":1116,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339676,"statfs":{"total":96636764160,"available":96603828224,"internally_reserved":0,"allocated":1142784,"data_stored":823690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.61299999999999999,"15min":0.59899999999999998},"min":{"1min":0.51000000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.77200000000000002,"15min":0.746},"min":{"1min":0.70899999999999996,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.0469999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.73699999999999999}]},{"osd":2,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.71099999999999997,"15min":0.69799999999999995},"min":{"1min":0.51900000000000002,"5min":0.313,"15min":0.313},"max":{"1min":1.0269999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.64600000000000002,"15min":0.63},"min":{"1min":0.55700000000000005,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.96799999999999997,"5min":1.371,"15min":1.371},"last":0.82399999999999995}]},{"osd":3,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.68200000000000005,"15min":0.67000000000000004},"min":{"1min":0.55800000000000005,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.1930000000000001,"5min":1.226,"15min":1.226},"last":1.087},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.82899999999999996,"15min":0.81000000000000005},"min":{"1min":0.65800000000000003,"5min":0.375,"15min":0.375},"max":{"1min":1.262,"5min":1.829,"15min":1.829},"last":1.296}]},{"osd":4,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.90000000000000002,"15min":0.88900000000000001},"min":{"1min":0.75600000000000001,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.1579999999999999,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.94099999999999995},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.0369999999999999,"15min":1.034},"min":{"1min":0.86099999999999999,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.228,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":1.04}]},{"osd":5,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.96099999999999997,"15min":0.95799999999999996},"min":{"1min":0.67300000000000004,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.351,"5min":1.694,"15min":1.694},"last":1.002},{"interface":"front","average":{"1min":0.99099999999999999,"5min":1,"15min":0.998},"min":{"1min":0.72999999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.1870000000000001,"5min":1.75,"15min":1.75},"last":1.3400000000000001}]},{"osd":6,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.0700000000000001,"15min":1.056},"min":{"1min":0.93899999999999995,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.331,"5min":2.04,"15min":2.04},"last":1.1220000000000001},{"interface":"front","average":{"1min":1.0409999999999999,"5min":0.996,"15min":0.997},"min":{"1min":0.76100000000000001,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.444,"5min":1.883,"15min":1.883},"last":1.159}]},{"osd":7,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.0369999999999999,"15min":1.0329999999999999},"min":{"1min":0.77200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.397,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.077,"5min":1.056,"15min":1.05},"min":{"1min":0.93200000000000005,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.298,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.4610000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-10T18:56:22.855 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-10T18:56:23.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.007+0000 7fb51b707640 1 Processor -- start 2023-06-10T18:56:23.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.007+0000 7fb51b707640 1 -- start start 2023-06-10T18:56:23.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.007+0000 7fb51b707640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5140ccae0 0x7fb5140d0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:23.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.007+0000 7fb51b707640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5140d0020 con 0x7fb5140cc690 2023-06-10T18:56:23.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.007+0000 7fb51b707640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5140cef40 con 0x7fb5140b3ac0 2023-06-10T18:56:23.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.007+0000 7fb51b707640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5140cf220 con 0x7fb5140ccae0 2023-06-10T18:56:23.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.007+0000 7fb518ca2640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fb5140cc690 0x7fb5140d04b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:54024/0 (socket says 172.21.15.53:54024) 2023-06-10T18:56:23.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.007+0000 7fb518ca2640 1 -- 172.21.15.53:0/1128929321 learned_addr learned my addr 172.21.15.53:0/1128929321 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:56:23.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.007+0000 7fb519ca4640 1 --2- 172.21.15.53:0/1128929321 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5140ccae0 0x7fb5140d0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:23.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.007+0000 7fb50bfff640 1 -- 172.21.15.53:0/1128929321 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4154931051 0 0) 0x7fb5140d0020 con 0x7fb5140cc690 2023-06-10T18:56:23.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.007+0000 7fb50bfff640 1 -- 172.21.15.53:0/1128929321 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb500003530 con 0x7fb5140cc690 2023-06-10T18:56:23.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.007+0000 7fb50bfff640 1 -- 172.21.15.53:0/1128929321 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2007513560 0 0) 0x7fb500003530 con 0x7fb5140cc690 2023-06-10T18:56:23.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.007+0000 7fb50bfff640 1 -- 172.21.15.53:0/1128929321 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5140ccae0 msgr2=0x7fb5140d0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:23.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.007+0000 7fb50bfff640 1 --2- 172.21.15.53:0/1128929321 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5140ccae0 0x7fb5140d0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:23.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.007+0000 7fb50bfff640 1 -- 172.21.15.53:0/1128929321 >> v1:172.21.15.117:6789/0 conn(0x7fb5140b3ac0 legacy=0x7fb5140b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:23.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.007+0000 7fb50bfff640 1 -- 172.21.15.53:0/1128929321 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5140cf500 con 0x7fb5140cc690 2023-06-10T18:56:23.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.007+0000 7fb50bfff640 1 -- 172.21.15.53:0/1128929321 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fb504001680 con 0x7fb5140cc690 2023-06-10T18:56:23.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.007+0000 7fb50bfff640 1 -- 172.21.15.53:0/1128929321 >> v1:172.21.15.53:6789/0 conn(0x7fb5140cc690 legacy=0x7fb5140d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:23.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.007+0000 7fb50bfff640 1 --2- 172.21.15.53:0/1128929321 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5140ccae0 0x7fb500003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:23.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.007+0000 7fb50bfff640 1 --2- 172.21.15.53:0/1128929321 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb500003fa0 0x7fb5000047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:23.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.007+0000 7fb50bfff640 1 --2- 172.21.15.53:0/1128929321 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb500004d10 0x7fb500005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:23.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.007+0000 7fb50bfff640 1 -- 172.21.15.53:0/1128929321 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5140cf220 con 0x7fb500003fa0 2023-06-10T18:56:23.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.007+0000 7fb50bfff640 1 -- 172.21.15.53:0/1128929321 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb50000bad0 con 0x7fb500004d10 2023-06-10T18:56:23.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.007+0000 7fb50bfff640 1 -- 172.21.15.53:0/1128929321 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb50000bc90 con 0x7fb5140ccae0 2023-06-10T18:56:23.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.007+0000 7fb518ca2640 1 --2- 172.21.15.53:0/1128929321 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb500003fa0 0x7fb5000047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:23.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.007+0000 7fb5194a3640 1 --2- 172.21.15.53:0/1128929321 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5140ccae0 0x7fb500003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:23.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.007+0000 7fb519ca4640 1 --2- 172.21.15.53:0/1128929321 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb500004d10 0x7fb500005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:23.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.007+0000 7fb518ca2640 1 -- 172.21.15.53:0/1128929321 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5140ccae0 msgr2=0x7fb500003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:23.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.007+0000 7fb518ca2640 1 --2- 172.21.15.53:0/1128929321 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5140ccae0 0x7fb500003a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:23.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.007+0000 7fb518ca2640 1 -- 172.21.15.53:0/1128929321 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb500004d10 msgr2=0x7fb500005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:23.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.007+0000 7fb518ca2640 1 --2- 172.21.15.53:0/1128929321 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb500004d10 0x7fb500005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:23.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.007+0000 7fb518ca2640 1 -- 172.21.15.53:0/1128929321 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb500003530 con 0x7fb500003fa0 2023-06-10T18:56:23.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.007+0000 7fb5194a3640 1 --2- 172.21.15.53:0/1128929321 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5140ccae0 0x7fb500003a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:56:23.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.011+0000 7fb518ca2640 1 --2- 172.21.15.53:0/1128929321 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb500003fa0 0x7fb5000047d0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fb50400c240 tx=0x7fb50401f3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef3164cf6ae119f8 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:23.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.011+0000 7fb50bfff640 1 -- 172.21.15.53:0/1128929321 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb504005ae0 con 0x7fb500003fa0 2023-06-10T18:56:23.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.011+0000 7fb50bfff640 1 -- 172.21.15.53:0/1128929321 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5040ab070 con 0x7fb500003fa0 2023-06-10T18:56:23.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.011+0000 7fb50bfff640 1 -- 172.21.15.53:0/1128929321 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb504007070 con 0x7fb500003fa0 2023-06-10T18:56:23.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.011+0000 7fb51b707640 1 -- 172.21.15.53:0/1128929321 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb500003fa0 msgr2=0x7fb5000047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:23.022 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.011+0000 7fb51b707640 1 --2- 172.21.15.53:0/1128929321 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb500003fa0 0x7fb5000047d0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fb50400c240 tx=0x7fb50401f3b0 comp rx=0 tx=0).stop 2023-06-10T18:56:23.022 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.011+0000 7fb519ca4640 1 -- 172.21.15.53:0/1128929321 reap_dead start 2023-06-10T18:56:23.022 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.011+0000 7fb51b707640 1 -- 172.21.15.53:0/1128929321 shutdown_connections 2023-06-10T18:56:23.022 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.011+0000 7fb51b707640 1 -- 172.21.15.53:0/1128929321 >> 172.21.15.53:0/1128929321 conn(0x7fb514071790 msgr2=0x7fb514069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:23.022 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.011+0000 7fb51b707640 1 -- 172.21.15.53:0/1128929321 shutdown_connections 2023-06-10T18:56:23.022 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.011+0000 7fb51b707640 1 -- 172.21.15.53:0/1128929321 wait complete. 2023-06-10T18:56:23.022 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.011+0000 7fb51b707640 1 Processor -- start 2023-06-10T18:56:23.023 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.011+0000 7fb51b707640 1 -- start start 2023-06-10T18:56:23.023 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.015+0000 7fb51b707640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb500003fa0 0x7fb5141e76b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:23.023 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.015+0000 7fb51b707640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5140c8a30 0x7fb514146de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:23.023 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.015+0000 7fb51b707640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5141f2680 0x7fb5141f2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:23.023 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.015+0000 7fb51b707640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5141e7bf0 con 0x7fb500003fa0 2023-06-10T18:56:23.023 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.015+0000 7fb51b707640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb514147610 con 0x7fb5140c8a30 2023-06-10T18:56:23.023 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.015+0000 7fb51b707640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5141478f0 con 0x7fb5141f2680 2023-06-10T18:56:23.024 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.015+0000 7fb5194a3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb500003fa0 0x7fb5141e76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:23.024 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.015+0000 7fb5194a3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb500003fa0 0x7fb5141e76b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59232/0 (socket says 172.21.15.53:59232) 2023-06-10T18:56:23.024 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.015+0000 7fb5194a3640 1 -- 172.21.15.53:0/3417199328 learned_addr learned my addr 172.21.15.53:0/3417199328 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:23.024 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.015+0000 7fb518ca2640 1 --2- 172.21.15.53:0/3417199328 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5140c8a30 0x7fb514146de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:23.024 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.015+0000 7fb519ca4640 1 --2- 172.21.15.53:0/3417199328 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5141f2680 0x7fb5141f2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:23.024 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.015+0000 7fb5194a3640 1 -- 172.21.15.53:0/3417199328 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5141f2680 msgr2=0x7fb5141f2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:23.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.015+0000 7fb5194a3640 1 --2- 172.21.15.53:0/3417199328 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5141f2680 0x7fb5141f2af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:23.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.015+0000 7fb5194a3640 1 -- 172.21.15.53:0/3417199328 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5140c8a30 msgr2=0x7fb514146de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:23.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.015+0000 7fb5194a3640 1 --2- 172.21.15.53:0/3417199328 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5140c8a30 0x7fb514146de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:23.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.015+0000 7fb5194a3640 1 -- 172.21.15.53:0/3417199328 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb514147bd0 con 0x7fb500003fa0 2023-06-10T18:56:23.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.015+0000 7fb518ca2640 1 --2- 172.21.15.53:0/3417199328 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5140c8a30 0x7fb514146de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:56:23.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.015+0000 7fb5194a3640 1 --2- 172.21.15.53:0/3417199328 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb500003fa0 0x7fb5141e76b0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fb51000e550 tx=0x7fb51000ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:23.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.015+0000 7fb509ffb640 1 -- 172.21.15.53:0/3417199328 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5100052e0 con 0x7fb500003fa0 2023-06-10T18:56:23.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.015+0000 7fb509ffb640 1 -- 172.21.15.53:0/3417199328 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb510005440 con 0x7fb500003fa0 2023-06-10T18:56:23.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.015+0000 7fb51b707640 1 -- 172.21.15.53:0/3417199328 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5141f1560 con 0x7fb500003fa0 2023-06-10T18:56:23.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.015+0000 7fb509ffb640 1 -- 172.21.15.53:0/3417199328 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb510003840 con 0x7fb500003fa0 2023-06-10T18:56:23.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.015+0000 7fb51b707640 1 -- 172.21.15.53:0/3417199328 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5141f11b0 con 0x7fb500003fa0 2023-06-10T18:56:23.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.015+0000 7fb51b707640 1 -- 172.21.15.53:0/3417199328 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5141f13d0 con 0x7fb500003fa0 2023-06-10T18:56:23.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.015+0000 7fb509ffb640 1 -- 172.21.15.53:0/3417199328 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb5100039a0 con 0x7fb500003fa0 2023-06-10T18:56:23.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.015+0000 7fb509ffb640 1 --2- 172.21.15.53:0/3417199328 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb4f8066280 0x7fb4f8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:23.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.015+0000 7fb509ffb640 1 -- 172.21.15.53:0/3417199328 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb510083ad0 con 0x7fb500003fa0 2023-06-10T18:56:23.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.015+0000 7fb518ca2640 1 --2- 172.21.15.53:0/3417199328 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb4f8066280 0x7fb4f8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:23.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.015+0000 7fb518ca2640 1 --2- 172.21.15.53:0/3417199328 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb4f8066280 0x7fb4f8068730 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb5040af000 tx=0x7fb5040aa000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:23.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.019+0000 7fb509ffb640 1 -- 172.21.15.53:0/3417199328 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb510050fe0 con 0x7fb500003fa0 2023-06-10T18:56:23.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.163+0000 7fb51b707640 1 -- 172.21.15.53:0/3417199328 --> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb5140cfcb0 con 0x7fb4f8066280 2023-06-10T18:56:23.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.187+0000 7fb509ffb640 1 -- 172.21.15.53:0/3417199328 <== mgr.4105 v2:172.21.15.117:6832/3061986771 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+297258 (secure 0 0 0) 0x7fb504001680 con 0x7fb4f8066280 2023-06-10T18:56:23.194 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:56:23.195 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-06-10T18:56:23.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.191+0000 7fb51b707640 1 -- 172.21.15.53:0/3417199328 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb4f8066280 msgr2=0x7fb4f8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:23.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.191+0000 7fb51b707640 1 --2- 172.21.15.53:0/3417199328 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb4f8066280 0x7fb4f8068730 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb5040af000 tx=0x7fb5040aa000 comp rx=0 tx=0).stop 2023-06-10T18:56:23.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.191+0000 7fb51b707640 1 -- 172.21.15.53:0/3417199328 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb500003fa0 msgr2=0x7fb5141e76b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:23.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.191+0000 7fb51b707640 1 --2- 172.21.15.53:0/3417199328 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb500003fa0 0x7fb5141e76b0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fb51000e550 tx=0x7fb51000ea10 comp rx=0 tx=0).stop 2023-06-10T18:56:23.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.191+0000 7fb51b707640 1 -- 172.21.15.53:0/3417199328 shutdown_connections 2023-06-10T18:56:23.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.191+0000 7fb51b707640 1 --2- 172.21.15.53:0/3417199328 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb4f8066280 0x7fb4f8068730 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:23.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.191+0000 7fb51b707640 1 --2- 172.21.15.53:0/3417199328 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5141f2680 0x7fb5141f2af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:23.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.191+0000 7fb51b707640 1 --2- 172.21.15.53:0/3417199328 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5140c8a30 0x7fb514146de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:23.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.191+0000 7fb51b707640 1 --2- 172.21.15.53:0/3417199328 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb500003fa0 0x7fb5141e76b0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:23.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.191+0000 7fb51b707640 1 -- 172.21.15.53:0/3417199328 >> 172.21.15.53:0/3417199328 conn(0x7fb514071790 msgr2=0x7fb5140b23d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:23.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.191+0000 7fb51b707640 1 -- 172.21.15.53:0/3417199328 shutdown_connections 2023-06-10T18:56:23.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.191+0000 7fb51b707640 1 -- 172.21.15.53:0/3417199328 wait complete. 2023-06-10T18:56:23.209 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":159,"stamp":"2023-06-10T18:56:21.638167+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237504,"kb_used_data":5504,"kb_used_omap":0,"kb_used_meta":231936,"kb_avail":754737216,"statfs":{"total":773094113280,"available":772850909184,"internally_reserved":0,"allocated":5636096,"data_stored":3070917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":237502464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.352346"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.298104+0000","last_change":"2023-06-10T18:56:17.298104+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.298104+0000","last_undegraded":"2023-06-10T18:56:17.298104+0000","last_fullsized":"2023-06-10T18:56:17.298104+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.289656+0000","last_change":"2023-06-10T18:56:17.289656+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.289656+0000","last_undegraded":"2023-06-10T18:56:17.289656+0000","last_fullsized":"2023-06-10T18:56:17.289656+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.291448+0000","last_change":"2023-06-10T18:56:17.291448+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.291448+0000","last_undegraded":"2023-06-10T18:56:17.291448+0000","last_fullsized":"2023-06-10T18:56:17.291448+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.296823+0000","last_change":"2023-06-10T18:56:17.296823+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.296823+0000","last_undegraded":"2023-06-10T18:56:17.296823+0000","last_fullsized":"2023-06-10T18:56:17.296823+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.296135+0000","last_change":"2023-06-10T18:56:17.296135+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.296135+0000","last_undegraded":"2023-06-10T18:56:17.296135+0000","last_fullsized":"2023-06-10T18:56:17.296135+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.289245+0000","last_change":"2023-06-10T18:56:17.289245+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.289245+0000","last_undegraded":"2023-06-10T18:56:17.289245+0000","last_fullsized":"2023-06-10T18:56:17.289245+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.294945+0000","last_change":"2023-06-10T18:56:17.294945+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.294945+0000","last_undegraded":"2023-06-10T18:56:17.294945+0000","last_fullsized":"2023-06-10T18:56:17.294945+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.295322+0000","last_change":"2023-06-10T18:56:17.295322+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.295322+0000","last_undegraded":"2023-06-10T18:56:17.295322+0000","last_fullsized":"2023-06-10T18:56:17.295322+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.298508+0000","last_change":"2023-06-10T18:56:17.298508+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.298508+0000","last_undegraded":"2023-06-10T18:56:17.298508+0000","last_fullsized":"2023-06-10T18:56:17.298508+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.289523+0000","last_change":"2023-06-10T18:56:17.289523+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.289523+0000","last_undegraded":"2023-06-10T18:56:17.289523+0000","last_fullsized":"2023-06-10T18:56:17.289523+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.300882+0000","last_change":"2023-06-10T18:56:17.300882+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.300882+0000","last_undegraded":"2023-06-10T18:56:17.300882+0000","last_fullsized":"2023-06-10T18:56:17.300882+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.293909+0000","last_change":"2023-06-10T18:56:17.293909+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.293909+0000","last_undegraded":"2023-06-10T18:56:17.293909+0000","last_fullsized":"2023-06-10T18:56:17.293909+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.295642+0000","last_change":"2023-06-10T18:56:17.295642+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.295642+0000","last_undegraded":"2023-06-10T18:56:17.295642+0000","last_fullsized":"2023-06-10T18:56:17.295642+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.294849+0000","last_change":"2023-06-10T18:56:17.294849+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.294849+0000","last_undegraded":"2023-06-10T18:56:17.294849+0000","last_fullsized":"2023-06-10T18:56:17.294849+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.294831+0000","last_change":"2023-06-10T18:56:17.294831+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.294831+0000","last_undegraded":"2023-06-10T18:56:17.294831+0000","last_fullsized":"2023-06-10T18:56:17.294831+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.293216+0000","last_change":"2023-06-10T18:56:17.293216+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.293216+0000","last_undegraded":"2023-06-10T18:56:17.293216+0000","last_fullsized":"2023-06-10T18:56:17.293216+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.295221+0000","last_change":"2023-06-10T18:56:17.295221+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.295221+0000","last_undegraded":"2023-06-10T18:56:17.295221+0000","last_fullsized":"2023-06-10T18:56:17.295221+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.289785+0000","last_change":"2023-06-10T18:56:17.289785+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.289785+0000","last_undegraded":"2023-06-10T18:56:17.289785+0000","last_fullsized":"2023-06-10T18:56:17.289785+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.294974+0000","last_change":"2023-06-10T18:56:17.294974+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.294974+0000","last_undegraded":"2023-06-10T18:56:17.294974+0000","last_fullsized":"2023-06-10T18:56:17.294974+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.296124+0000","last_change":"2023-06-10T18:56:17.296124+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.296124+0000","last_undegraded":"2023-06-10T18:56:17.296124+0000","last_fullsized":"2023-06-10T18:56:17.296124+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.289645+0000","last_change":"2023-06-10T18:56:17.289645+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.289645+0000","last_undegraded":"2023-06-10T18:56:17.289645+0000","last_fullsized":"2023-06-10T18:56:17.289645+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.294752+0000","last_change":"2023-06-10T18:56:17.294752+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.294752+0000","last_undegraded":"2023-06-10T18:56:17.294752+0000","last_fullsized":"2023-06-10T18:56:17.294752+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.294908+0000","last_change":"2023-06-10T18:56:17.294908+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.294908+0000","last_undegraded":"2023-06-10T18:56:17.294908+0000","last_fullsized":"2023-06-10T18:56:17.294908+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.289886+0000","last_change":"2023-06-10T18:56:17.289886+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.289886+0000","last_undegraded":"2023-06-10T18:56:17.289886+0000","last_fullsized":"2023-06-10T18:56:17.289886+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.294982+0000","last_change":"2023-06-10T18:56:17.294982+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.294982+0000","last_undegraded":"2023-06-10T18:56:17.294982+0000","last_fullsized":"2023-06-10T18:56:17.294982+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":216,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-06-10T18:56:17.296459+0000","last_change":"2023-06-10T18:52:34.951528+0000","last_active":"2023-06-10T18:56:17.296459+0000","last_peered":"2023-06-10T18:56:17.296459+0000","last_clean":"2023-06-10T18:56:17.296459+0000","last_became_active":"2023-06-10T18:52:34.949099+0000","last_became_peered":"2023-06-10T18:52:34.949099+0000","last_unstale":"2023-06-10T18:56:17.296459+0000","last_undegraded":"2023-06-10T18:56:17.296459+0000","last_fullsized":"2023-06-10T18:56:17.296459+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_clean_scrub_stamp":"2023-06-10T18:52:33.633295+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:53:32.439531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":62,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-06-10T18:56:17.296089+0000","last_change":"2023-06-10T18:52:40.506384+0000","last_active":"2023-06-10T18:56:17.296089+0000","last_peered":"2023-06-10T18:56:17.296089+0000","last_clean":"2023-06-10T18:56:17.296089+0000","last_became_active":"2023-06-10T18:52:40.505701+0000","last_became_peered":"2023-06-10T18:52:40.505701+0000","last_unstale":"2023-06-10T18:56:17.296089+0000","last_undegraded":"2023-06-10T18:56:17.296089+0000","last_fullsized":"2023-06-10T18:56:17.296089+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:42:06.079219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.300199+0000","last_change":"2023-06-10T18:56:17.300199+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.300199+0000","last_undegraded":"2023-06-10T18:56:17.300199+0000","last_fullsized":"2023-06-10T18:56:17.300199+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":60,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-06-10T18:56:17.296117+0000","last_change":"2023-06-10T18:52:40.512015+0000","last_active":"2023-06-10T18:56:17.296117+0000","last_peered":"2023-06-10T18:56:17.296117+0000","last_clean":"2023-06-10T18:56:17.296117+0000","last_became_active":"2023-06-10T18:52:40.511382+0000","last_became_peered":"2023-06-10T18:52:40.511382+0000","last_unstale":"2023-06-10T18:56:17.296117+0000","last_undegraded":"2023-06-10T18:56:17.296117+0000","last_fullsized":"2023-06-10T18:56:17.296117+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:14:11.722106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.295569+0000","last_change":"2023-06-10T18:56:17.295569+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.295569+0000","last_undegraded":"2023-06-10T18:56:17.295569+0000","last_fullsized":"2023-06-10T18:56:17.295569+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":62,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-06-10T18:56:17.287206+0000","last_change":"2023-06-10T18:52:40.671725+0000","last_active":"2023-06-10T18:56:17.287206+0000","last_peered":"2023-06-10T18:56:17.287206+0000","last_clean":"2023-06-10T18:56:17.287206+0000","last_became_active":"2023-06-10T18:52:40.671442+0000","last_became_peered":"2023-06-10T18:52:40.671442+0000","last_unstale":"2023-06-10T18:56:17.287206+0000","last_undegraded":"2023-06-10T18:56:17.287206+0000","last_fullsized":"2023-06-10T18:56:17.287206+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:51:06.334711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.296581+0000","last_change":"2023-06-10T18:56:17.296581+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.296581+0000","last_undegraded":"2023-06-10T18:56:17.296581+0000","last_fullsized":"2023-06-10T18:56:17.296581+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":62,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-06-10T18:56:17.297511+0000","last_change":"2023-06-10T18:52:40.510258+0000","last_active":"2023-06-10T18:56:17.297511+0000","last_peered":"2023-06-10T18:56:17.297511+0000","last_clean":"2023-06-10T18:56:17.297511+0000","last_became_active":"2023-06-10T18:52:40.509560+0000","last_became_peered":"2023-06-10T18:52:40.509560+0000","last_unstale":"2023-06-10T18:56:17.297511+0000","last_undegraded":"2023-06-10T18:56:17.297511+0000","last_fullsized":"2023-06-10T18:56:17.297511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:12:41.321044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.289523+0000","last_change":"2023-06-10T18:56:17.289523+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.289523+0000","last_undegraded":"2023-06-10T18:56:17.289523+0000","last_fullsized":"2023-06-10T18:56:17.289523+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":58,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-06-10T18:56:17.292501+0000","last_change":"2023-06-10T18:52:40.672266+0000","last_active":"2023-06-10T18:56:17.292501+0000","last_peered":"2023-06-10T18:56:17.292501+0000","last_clean":"2023-06-10T18:56:17.292501+0000","last_became_active":"2023-06-10T18:52:40.671966+0000","last_became_peered":"2023-06-10T18:52:40.671966+0000","last_unstale":"2023-06-10T18:56:17.292501+0000","last_undegraded":"2023-06-10T18:56:17.292501+0000","last_fullsized":"2023-06-10T18:56:17.292501+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:57:03.883411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.295123+0000","last_change":"2023-06-10T18:56:17.295123+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.295123+0000","last_undegraded":"2023-06-10T18:56:17.295123+0000","last_fullsized":"2023-06-10T18:56:17.295123+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":60,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-06-10T18:56:17.301379+0000","last_change":"2023-06-10T18:52:40.671084+0000","last_active":"2023-06-10T18:56:17.301379+0000","last_peered":"2023-06-10T18:56:17.301379+0000","last_clean":"2023-06-10T18:56:17.301379+0000","last_became_active":"2023-06-10T18:52:40.670697+0000","last_became_peered":"2023-06-10T18:52:40.670697+0000","last_unstale":"2023-06-10T18:56:17.301379+0000","last_undegraded":"2023-06-10T18:56:17.301379+0000","last_fullsized":"2023-06-10T18:56:17.301379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:00:32.947088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.293534+0000","last_change":"2023-06-10T18:56:17.293534+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.293534+0000","last_undegraded":"2023-06-10T18:56:17.293534+0000","last_fullsized":"2023-06-10T18:56:17.293534+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":58,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-06-10T18:56:17.292862+0000","last_change":"2023-06-10T18:52:40.514114+0000","last_active":"2023-06-10T18:56:17.292862+0000","last_peered":"2023-06-10T18:56:17.292862+0000","last_clean":"2023-06-10T18:56:17.292862+0000","last_became_active":"2023-06-10T18:52:40.513638+0000","last_became_peered":"2023-06-10T18:52:40.513638+0000","last_unstale":"2023-06-10T18:56:17.292862+0000","last_undegraded":"2023-06-10T18:56:17.292862+0000","last_fullsized":"2023-06-10T18:56:17.292862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:03:15.366661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.293226+0000","last_change":"2023-06-10T18:56:17.293226+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.293226+0000","last_undegraded":"2023-06-10T18:56:17.293226+0000","last_fullsized":"2023-06-10T18:56:17.293226+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":62,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-06-10T18:56:17.299937+0000","last_change":"2023-06-10T18:52:40.515396+0000","last_active":"2023-06-10T18:56:17.299937+0000","last_peered":"2023-06-10T18:56:17.299937+0000","last_clean":"2023-06-10T18:56:17.299937+0000","last_became_active":"2023-06-10T18:52:40.514663+0000","last_became_peered":"2023-06-10T18:52:40.514663+0000","last_unstale":"2023-06-10T18:56:17.299937+0000","last_undegraded":"2023-06-10T18:56:17.299937+0000","last_fullsized":"2023-06-10T18:56:17.299937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:17:56.639920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574896,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28072,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343768,"statfs":{"total":96636764160,"available":96608018432,"internally_reserved":0,"allocated":1146880,"data_stored":824709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":0.90400000000000003,"15min":0.88200000000000001},"min":{"1min":0.73599999999999999,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.3759999999999999,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.91100000000000003},{"interface":"front","average":{"1min":1.006,"5min":0.94299999999999995,"15min":0.93000000000000005},"min":{"1min":0.81899999999999995,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.234,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":1.022}]},{"osd":1,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92400000000000004,"15min":0.91500000000000004},"min":{"1min":0.58599999999999997,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.3089999999999999,"5min":1.377,"15min":1.377},"last":0.99299999999999999},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.92500000000000004,"15min":0.91100000000000003},"min":{"1min":0.78400000000000003,"5min":0.504,"15min":0.504},"max":{"1min":1.111,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.82399999999999995}]},{"osd":2,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.83999999999999997,"15min":0.82799999999999996},"min":{"1min":0.64100000000000001,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.214,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.89900000000000002,"15min":0.90700000000000003},"min":{"1min":0.67500000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.325,"5min":1.367,"15min":1.367},"last":0.62}]},{"osd":3,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.92100000000000004,"15min":0.89900000000000002},"min":{"1min":0.68100000000000005,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1499999999999999,"5min":1.502,"15min":1.502},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.93799999999999994,"15min":0.92800000000000005},"min":{"1min":0.70399999999999996,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.2130000000000001,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.84799999999999998}]},{"osd":4,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.876,"15min":0.872},"min":{"1min":0.60199999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.141,"5min":1.639,"15min":1.639},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.96899999999999997,"15min":0.98099999999999998},"min":{"1min":0.748,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.238,"5min":1.411,"15min":1.411},"last":0.88400000000000001}]},{"osd":5,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.042,"15min":1.038},"min":{"1min":0.79800000000000004,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.2669999999999999,"5min":1.806,"15min":1.806},"last":0.79000000000000004},{"interface":"front","average":{"1min":1.081,"5min":1.05,"15min":1.052},"min":{"1min":0.93200000000000005,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.256,"5min":1.522,"15min":1.522},"last":1.111}]},{"osd":6,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.0129999999999999,"15min":1.008},"min":{"1min":0.78500000000000003,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.3,"5min":1.718,"15min":1.718},"last":0.72199999999999998},{"interface":"front","average":{"1min":1.147,"5min":1.095,"15min":1.0900000000000001},"min":{"1min":0.96599999999999997,"5min":0.441,"15min":0.441},"max":{"1min":1.409,"5min":1.464,"15min":1.464},"last":1.052}]}]},{"osd":6,"up_from":13,"seq":55834574897,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":565248,"data_stored":240511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.81999999999999995,"15min":0.80100000000000005},"min":{"1min":0.65800000000000003,"5min":0.502,"15min":0.502},"max":{"1min":1.0589999999999999,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.755},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.85199999999999998,"15min":0.83999999999999997},"min":{"1min":0.71799999999999997,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.0680000000000001,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":1.161}]},{"osd":1,"last update":"Sat Jun 10 18:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.873,"15min":0.85199999999999998},"min":{"1min":0.68999999999999995,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.879,"15min":0.85899999999999999},"min":{"1min":0.68999999999999995,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":0.91100000000000003}]},{"osd":2,"last update":"Sat Jun 10 18:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.871,"15min":0.85899999999999999},"min":{"1min":0.66000000000000003,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.1950000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.88500000000000001,"15min":0.88900000000000001},"min":{"1min":0.68000000000000005,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.109,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.995}]},{"osd":3,"last update":"Sat Jun 10 18:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.874,"15min":0.84799999999999998},"min":{"1min":0.64900000000000002,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.169,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":1.0209999999999999,"5min":0.997,"15min":0.995},"min":{"1min":0.72799999999999998,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":1.1160000000000001}]},{"osd":4,"last update":"Sat Jun 10 18:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.93799999999999994,"15min":0.95399999999999996},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.1259999999999999,"5min":1.198,"15min":1.198},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.95699999999999996,"5min":1.0049999999999999,"15min":1.0189999999999999},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.1879999999999999,"5min":1.222,"15min":1.222},"last":1.0549999999999999}]},{"osd":5,"last update":"Sat Jun 10 18:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.94999999999999996,"15min":0.96199999999999997},"min":{"1min":0.68700000000000006,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.0720000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.879},{"interface":"front","average":{"1min":1.02,"5min":1.0249999999999999,"15min":1.026},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.97199999999999998}]},{"osd":7,"last update":"Sat Jun 10 18:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":1.0389999999999999,"15min":1.0489999999999999},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.1739999999999999,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":1.2030000000000001},{"interface":"front","average":{"1min":1.022,"5min":1.0569999999999999,"15min":1.0649999999999999},"min":{"1min":0.82199999999999995,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.2010000000000001,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":1.085}]}]},{"osd":5,"up_from":13,"seq":55834574897,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":540,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":552960,"data_stored":234341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.84199999999999997,"15min":0.82999999999999996},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.139,"5min":1.175,"15min":1.175},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.91800000000000004,"15min":0.94199999999999995},"min":{"1min":0.63800000000000001,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.246,"5min":1.637,"15min":1.637},"last":1.129}]},{"osd":1,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.91000000000000003,"15min":0.91800000000000004},"min":{"1min":0.67800000000000005,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.1559999999999999,"5min":1.335,"15min":1.335},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.91700000000000004,"15min":0.92100000000000004},"min":{"1min":0.72699999999999998,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.208,"5min":1.78,"15min":1.78},"last":0.63600000000000001}]},{"osd":2,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.65000000000000002,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.1000000000000001,"5min":1.446,"15min":1.446},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.91600000000000004,"15min":0.91200000000000003},"min":{"1min":0.71399999999999997,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.1379999999999999,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.93600000000000005}]},{"osd":3,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93899999999999995,"15min":0.94499999999999995},"min":{"1min":0.68600000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.206,"5min":1.484,"15min":1.484},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.97199999999999998,"5min":1.0249999999999999,"15min":1.0429999999999999},"min":{"1min":0.77100000000000002,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.2969999999999999,"5min":1.337,"15min":1.337},"last":1.1910000000000001}]},{"osd":4,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.96999999999999997,"15min":0.98899999999999999},"min":{"1min":0.70299999999999996,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.2669999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.94599999999999995,"5min":1.034,"15min":1.0640000000000001},"min":{"1min":0.66500000000000004,"5min":0.629,"15min":0.629},"max":{"1min":1.26,"5min":1.575,"15min":1.575},"last":0.90400000000000003}]},{"osd":6,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":1.038,"15min":1.0780000000000001},"min":{"1min":0.66000000000000003,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.2010000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.0589999999999999},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.0609999999999999,"15min":1.079},"min":{"1min":0.69799999999999995,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.2270000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.0389999999999999}]},{"osd":7,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.139,"15min":1.1739999999999999},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.226,"5min":1.873,"15min":1.873},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.155,"15min":1.181},"min":{"1min":0.80000000000000004,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.3680000000000001,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.46}]}]},{"osd":4,"up_from":13,"seq":55834574896,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":565248,"data_stored":240511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.76700000000000002,"15min":0.745},"min":{"1min":0.53400000000000003,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.1599999999999999,"5min":1.2,"15min":1.2},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.88200000000000001,"15min":0.88},"min":{"1min":0.63800000000000001,"5min":0.504,"15min":0.504},"max":{"1min":1.4970000000000001,"5min":1.73,"15min":1.73},"last":0.71499999999999997}]},{"osd":1,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.95199999999999996,"15min":0.95499999999999996},"min":{"1min":0.68200000000000005,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.84599999999999997,"15min":0.83699999999999997},"min":{"1min":0.66600000000000004,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.024,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.64500000000000002}]},{"osd":2,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.879,"15min":0.875},"min":{"1min":0.70799999999999996,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":0.877},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1,"15min":1.004},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.91700000000000004}]},{"osd":3,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.89900000000000002,"15min":0.88},"min":{"1min":0.80900000000000005,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.1679999999999999,"5min":1.22,"15min":1.22},"last":0.55700000000000005},{"interface":"front","average":{"1min":1.006,"5min":0.95799999999999996,"15min":0.95099999999999996},"min":{"1min":0.80100000000000005,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.4490000000000001,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.115}]},{"osd":5,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.96799999999999997,"15min":0.99399999999999999},"min":{"1min":0.67800000000000005,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.069,"5min":1.663,"15min":1.663},"last":1.0780000000000001},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.95399999999999996,"15min":0.98199999999999998},"min":{"1min":0.58099999999999996,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.111,"5min":1.353,"15min":1.353},"last":0.76200000000000001}]},{"osd":6,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":1.002,"15min":1.028},"min":{"1min":0.63100000000000001,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.5720000000000001,"5min":2.2639999999999998,"15min":2.2639999999999998},"last":1.04},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0720000000000001,"15min":1.0760000000000001},"min":{"1min":0.81200000000000006,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":1.004}]},{"osd":7,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.98399999999999999,"15min":0.99399999999999999},"min":{"1min":0.68899999999999995,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.1950000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.85299999999999998},{"interface":"front","average":{"1min":1.012,"5min":1.0529999999999999,"15min":1.071},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.2390000000000001,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":1.3879999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574895,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31584,"kb_used_data":536,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340256,"statfs":{"total":96636764160,"available":96604422144,"internally_reserved":0,"allocated":548864,"data_stored":233322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.57799999999999996,"15min":0.57199999999999995},"min":{"1min":0.51400000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.63500000000000001,"15min":0.63100000000000001},"min":{"1min":0.56000000000000005,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.59699999999999998}]},{"osd":1,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.64400000000000002,"15min":0.622},"min":{"1min":0.51000000000000001,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.747},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.72099999999999997,"15min":0.71599999999999997},"min":{"1min":0.56100000000000005,"5min":0.318,"15min":0.318},"max":{"1min":0.98899999999999999,"5min":1.411,"15min":1.411},"last":1.0620000000000001}]},{"osd":2,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.76100000000000001,"15min":0.75},"min":{"1min":0.63500000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.167,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.75900000000000001,"15min":0.74199999999999999},"min":{"1min":0.65200000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.1970000000000001,"5min":1.264,"15min":1.264},"last":0.80600000000000005}]},{"osd":4,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96099999999999997,"15min":0.96899999999999997},"min":{"1min":0.79800000000000004,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.3089999999999999,"5min":1.488,"15min":1.488},"last":0.88200000000000001},{"interface":"front","average":{"1min":1.052,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.82099999999999995,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.345,"5min":1.458,"15min":1.458},"last":0.84699999999999998}]},{"osd":5,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.0369999999999999,"15min":1.0589999999999999},"min":{"1min":0.80400000000000005,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.268,"5min":2.024,"15min":2.024},"last":0.94599999999999995},{"interface":"front","average":{"1min":1.101,"5min":1.026,"15min":1.014},"min":{"1min":0.83899999999999997,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.29,"5min":1.724,"15min":1.724},"last":1.2390000000000001}]},{"osd":6,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.0489999999999999,"15min":1.0469999999999999},"min":{"1min":0.92400000000000004,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.3300000000000001,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":1.401},{"interface":"front","average":{"1min":1.071,"5min":1.0589999999999999,"15min":1.0720000000000001},"min":{"1min":0.90700000000000003,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.302,"5min":1.78,"15min":1.78},"last":0.98699999999999999}]},{"osd":7,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.101,"15min":1.1279999999999999},"min":{"1min":0.82799999999999996,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.3959999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.212,"5min":1.089,"15min":1.0740000000000001},"min":{"1min":1.0049999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.468,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":1.103}]}]},{"osd":2,"up_from":13,"seq":55834574896,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31600,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340240,"statfs":{"total":96636764160,"available":96604405760,"internally_reserved":0,"allocated":565248,"data_stored":240511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.60099999999999998,"15min":0.58799999999999997},"min":{"1min":0.498,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.97799999999999998,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.50800000000000001,"5min":0.378,"15min":0.378},"max":{"1min":1.024,"5min":1.224,"15min":1.224},"last":0.60499999999999998}]},{"osd":1,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.65000000000000002,"15min":0.64600000000000002},"min":{"1min":0.53400000000000003,"5min":0.307,"15min":0.307},"max":{"1min":0.89500000000000002,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.72299999999999998,"15min":0.68999999999999995},"min":{"1min":0.64700000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.89200000000000002}]},{"osd":3,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.73599999999999999,"15min":0.70599999999999996},"min":{"1min":0.64900000000000002,"5min":0.377,"15min":0.377},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.749,"15min":0.746},"min":{"1min":0.64700000000000002,"5min":0.252,"15min":0.252},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.745}]},{"osd":4,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.91900000000000004,"15min":0.91500000000000004},"min":{"1min":0.81000000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.93600000000000005},{"interface":"front","average":{"1min":1.097,"5min":1.0349999999999999,"15min":1.038},"min":{"1min":0.88600000000000001,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.476,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":1.202}]},{"osd":5,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.016,"15min":1.016},"min":{"1min":0.82699999999999996,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.379,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":1.2789999999999999},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.002,"15min":0.97799999999999998},"min":{"1min":0.77100000000000002,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.377,"5min":1.667,"15min":1.667},"last":0.97099999999999997}]},{"osd":6,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.0429999999999999,"15min":1.0229999999999999},"min":{"1min":0.84299999999999997,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.3049999999999999,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":1.0509999999999999},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.034,"15min":1.032},"min":{"1min":0.89400000000000002,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.4299999999999999,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":1.073}]},{"osd":7,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.099,"15min":1.099},"min":{"1min":0.82399999999999995,"5min":0.62,"15min":0.62},"max":{"1min":1.4339999999999999,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.1319999999999999},{"interface":"front","average":{"1min":1.153,"5min":1.0980000000000001,"15min":1.0760000000000001},"min":{"1min":0.95499999999999996,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.4239999999999999,"5min":1.752,"15min":1.752},"last":1.2310000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574898,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31584,"kb_used_data":536,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340256,"statfs":{"total":96636764160,"available":96604422144,"internally_reserved":0,"allocated":548864,"data_stored":233322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.67100000000000004,"15min":0.66100000000000003},"min":{"1min":0.47999999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.96699999999999997},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.71999999999999997,"15min":0.68600000000000005},"min":{"1min":0.63400000000000001,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.0369999999999999,"5min":1.694,"15min":1.694},"last":0.64500000000000002}]},{"osd":2,"last update":"Sat Jun 10 18:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.64400000000000002,"15min":0.623},"min":{"1min":0.53500000000000003,"5min":0.249,"15min":0.249},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.877,"5min":0.70199999999999996,"15min":0.65800000000000003},"min":{"1min":0.65600000000000003,"5min":0.315,"15min":0.315},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":0.79500000000000004}]},{"osd":3,"last update":"Sat Jun 10 18:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.77800000000000002,"15min":0.745},"min":{"1min":0.65900000000000003,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":1.2170000000000001},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.76100000000000001,"15min":0.749},"min":{"1min":0.58499999999999996,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.1100000000000001,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":0.73899999999999999}]},{"osd":4,"last update":"Sat Jun 10 18:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.87,"15min":0.83599999999999997},"min":{"1min":0.73399999999999999,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.90700000000000003},{"interface":"front","average":{"1min":1.087,"5min":1.1160000000000001,"15min":1.079},"min":{"1min":0.78500000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.5449999999999999,"5min":5.8209999999999997,"15min":5.8209999999999997},"last":1.141}]},{"osd":5,"last update":"Sat Jun 10 18:55:44 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.032,"15min":1.028},"min":{"1min":0.75800000000000001,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.4550000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":0.877},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0129999999999999,"15min":0.97099999999999997},"min":{"1min":0.754,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.3819999999999999,"5min":3.089,"15min":3.089},"last":0.754}]},{"osd":6,"last update":"Sat Jun 10 18:55:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.105,"15min":1.0309999999999999},"min":{"1min":0.75900000000000001,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.5249999999999999,"5min":7.2599999999999998,"15min":7.2599999999999998},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.081,"5min":1.107,"15min":1.0309999999999999},"min":{"1min":0.80800000000000005,"5min":0.622,"15min":0.622},"max":{"1min":1.591,"5min":9.0069999999999997,"15min":9.0069999999999997},"last":0.84799999999999998}]},{"osd":7,"last update":"Sat Jun 10 18:55:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.0980000000000001,"15min":1.083},"min":{"1min":0.89300000000000002,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.6879999999999999,"5min":2.105,"15min":2.105},"last":1.0640000000000001},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.085,"15min":1.0669999999999999},"min":{"1min":0.90200000000000002,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.573,"5min":2.2570000000000001,"15min":2.2570000000000001},"last":0.93100000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574897,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32164,"kb_used_data":1116,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339676,"statfs":{"total":96636764160,"available":96603828224,"internally_reserved":0,"allocated":1142784,"data_stored":823690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.61299999999999999,"15min":0.59899999999999998},"min":{"1min":0.51000000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.77200000000000002,"15min":0.746},"min":{"1min":0.70899999999999996,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.0469999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.73699999999999999}]},{"osd":2,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.71099999999999997,"15min":0.69799999999999995},"min":{"1min":0.51900000000000002,"5min":0.313,"15min":0.313},"max":{"1min":1.0269999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.64600000000000002,"15min":0.63},"min":{"1min":0.55700000000000005,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.96799999999999997,"5min":1.371,"15min":1.371},"last":0.82399999999999995}]},{"osd":3,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.68200000000000005,"15min":0.67000000000000004},"min":{"1min":0.55800000000000005,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.1930000000000001,"5min":1.226,"15min":1.226},"last":1.087},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.82899999999999996,"15min":0.81000000000000005},"min":{"1min":0.65800000000000003,"5min":0.375,"15min":0.375},"max":{"1min":1.262,"5min":1.829,"15min":1.829},"last":1.296}]},{"osd":4,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.90000000000000002,"15min":0.88900000000000001},"min":{"1min":0.75600000000000001,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.1579999999999999,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.94099999999999995},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.0369999999999999,"15min":1.034},"min":{"1min":0.86099999999999999,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.228,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":1.04}]},{"osd":5,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.96099999999999997,"15min":0.95799999999999996},"min":{"1min":0.67300000000000004,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.351,"5min":1.694,"15min":1.694},"last":1.002},{"interface":"front","average":{"1min":0.99099999999999999,"5min":1,"15min":0.998},"min":{"1min":0.72999999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.1870000000000001,"5min":1.75,"15min":1.75},"last":1.3400000000000001}]},{"osd":6,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.0700000000000001,"15min":1.056},"min":{"1min":0.93899999999999995,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.331,"5min":2.04,"15min":2.04},"last":1.1220000000000001},{"interface":"front","average":{"1min":1.0409999999999999,"5min":0.996,"15min":0.997},"min":{"1min":0.76100000000000001,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.444,"5min":1.883,"15min":1.883},"last":1.159}]},{"osd":7,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.0369999999999999,"15min":1.0329999999999999},"min":{"1min":0.77200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.397,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.077,"5min":1.056,"15min":1.05},"min":{"1min":0.93200000000000005,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.298,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.4610000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-10T18:56:23.217 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-10T18:56:23.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.363+0000 7f27a37e0640 1 Processor -- start 2023-06-10T18:56:23.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.363+0000 7f27a37e0640 1 -- start start 2023-06-10T18:56:23.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.367+0000 7f27a37e0640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f279c0ccae0 0x7f279c0d0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:23.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.367+0000 7f27a37e0640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f279c0d0020 con 0x7f279c0b3ac0 2023-06-10T18:56:23.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.367+0000 7f27a37e0640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f279c0cef40 con 0x7f279c0cc690 2023-06-10T18:56:23.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.367+0000 7f27a37e0640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f279c0cf220 con 0x7f279c0ccae0 2023-06-10T18:56:23.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.367+0000 7f27a157c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f279c0b3ac0 0x7f279c0b3e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:54028/0 (socket says 172.21.15.53:54028) 2023-06-10T18:56:23.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.367+0000 7f27a157c640 1 -- 172.21.15.53:0/989564099 learned_addr learned my addr 172.21.15.53:0/989564099 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:56:23.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.367+0000 7f2793fff640 1 -- 172.21.15.53:0/989564099 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2724818298 0 0) 0x7f279c0d0020 con 0x7f279c0b3ac0 2023-06-10T18:56:23.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.367+0000 7f27a1d7d640 1 --2- 172.21.15.53:0/989564099 >> v2:172.21.15.117:3300/0 conn(0x7f279c0ccae0 0x7f279c0d0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:23.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.367+0000 7f2793fff640 1 -- 172.21.15.53:0/989564099 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2788003530 con 0x7f279c0b3ac0 2023-06-10T18:56:23.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.367+0000 7f2793fff640 1 -- 172.21.15.53:0/989564099 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3110772837 0 0) 0x7f2788003530 con 0x7f279c0b3ac0 2023-06-10T18:56:23.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.367+0000 7f2793fff640 1 -- 172.21.15.53:0/989564099 >> v2:172.21.15.117:3300/0 conn(0x7f279c0ccae0 msgr2=0x7f279c0d0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:23.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.367+0000 7f2793fff640 1 --2- 172.21.15.53:0/989564099 >> v2:172.21.15.117:3300/0 conn(0x7f279c0ccae0 0x7f279c0d0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:23.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.367+0000 7f2793fff640 1 -- 172.21.15.53:0/989564099 >> v1:172.21.15.117:6789/0 conn(0x7f279c0cc690 legacy=0x7f279c0d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:23.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.367+0000 7f2793fff640 1 -- 172.21.15.53:0/989564099 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f279c0cf500 con 0x7f279c0b3ac0 2023-06-10T18:56:23.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.367+0000 7f2793fff640 1 -- 172.21.15.53:0/989564099 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f2798001680 con 0x7f279c0b3ac0 2023-06-10T18:56:23.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.367+0000 7f2793fff640 1 -- 172.21.15.53:0/989564099 >> v1:172.21.15.53:6789/0 conn(0x7f279c0b3ac0 legacy=0x7f279c0b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:23.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.367+0000 7f2793fff640 1 --2- 172.21.15.53:0/989564099 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27880039f0 0x7f2788003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:23.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.367+0000 7f2793fff640 1 --2- 172.21.15.53:0/989564099 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27880047d0 0x7f2788004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:23.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.367+0000 7f2793fff640 1 --2- 172.21.15.53:0/989564099 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2788005180 0x7f278800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:23.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.367+0000 7f2793fff640 1 -- 172.21.15.53:0/989564099 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f279c0cf220 con 0x7f27880047d0 2023-06-10T18:56:23.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.367+0000 7f2793fff640 1 -- 172.21.15.53:0/989564099 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f278800c060 con 0x7f27880039f0 2023-06-10T18:56:23.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.367+0000 7f2793fff640 1 -- 172.21.15.53:0/989564099 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f278800c220 con 0x7f2788005180 2023-06-10T18:56:23.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.367+0000 7f27a0d7b640 1 --2- 172.21.15.53:0/989564099 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27880047d0 0x7f2788004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:23.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.367+0000 7f27a157c640 1 --2- 172.21.15.53:0/989564099 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27880039f0 0x7f2788003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:23.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.367+0000 7f27a1d7d640 1 --2- 172.21.15.53:0/989564099 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2788005180 0x7f278800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:23.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.367+0000 7f27a0d7b640 1 -- 172.21.15.53:0/989564099 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2788005180 msgr2=0x7f278800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:23.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.367+0000 7f27a0d7b640 1 --2- 172.21.15.53:0/989564099 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2788005180 0x7f278800b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:23.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.367+0000 7f27a0d7b640 1 -- 172.21.15.53:0/989564099 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27880039f0 msgr2=0x7f2788003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:23.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.367+0000 7f27a0d7b640 1 --2- 172.21.15.53:0/989564099 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27880039f0 0x7f2788003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:23.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.367+0000 7f27a1d7d640 1 -- 172.21.15.53:0/989564099 reap_dead start 2023-06-10T18:56:23.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.367+0000 7f27a0d7b640 1 -- 172.21.15.53:0/989564099 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2788003530 con 0x7f27880047d0 2023-06-10T18:56:23.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.367+0000 7f27a157c640 1 --2- 172.21.15.53:0/989564099 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27880039f0 0x7f2788003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:56:23.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.371+0000 7f27a0d7b640 1 --2- 172.21.15.53:0/989564099 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27880047d0 0x7f2788004c40 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f278c001780 tx=0x7f278c01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bf7a9e9118b6167 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:23.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.371+0000 7f2793fff640 1 -- 172.21.15.53:0/989564099 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f278c0052d0 con 0x7f27880047d0 2023-06-10T18:56:23.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.371+0000 7f2793fff640 1 -- 172.21.15.53:0/989564099 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f278c0a7050 con 0x7f27880047d0 2023-06-10T18:56:23.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.371+0000 7f2793fff640 1 -- 172.21.15.53:0/989564099 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f278c003600 con 0x7f27880047d0 2023-06-10T18:56:23.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.371+0000 7f27a37e0640 1 -- 172.21.15.53:0/989564099 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27880047d0 msgr2=0x7f2788004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:23.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.371+0000 7f27a37e0640 1 --2- 172.21.15.53:0/989564099 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27880047d0 0x7f2788004c40 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f278c001780 tx=0x7f278c01c3e0 comp rx=0 tx=0).stop 2023-06-10T18:56:23.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.371+0000 7f27a37e0640 1 -- 172.21.15.53:0/989564099 shutdown_connections 2023-06-10T18:56:23.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.371+0000 7f27a37e0640 1 --2- 172.21.15.53:0/989564099 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27880047d0 0x7f2788004c40 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:23.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.371+0000 7f27a37e0640 1 -- 172.21.15.53:0/989564099 >> 172.21.15.53:0/989564099 conn(0x7f279c071790 msgr2=0x7f279c069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:23.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.371+0000 7f27a37e0640 1 -- 172.21.15.53:0/989564099 shutdown_connections 2023-06-10T18:56:23.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.371+0000 7f27a37e0640 1 -- 172.21.15.53:0/989564099 wait complete. 2023-06-10T18:56:23.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.371+0000 7f27a37e0640 1 Processor -- start 2023-06-10T18:56:23.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.371+0000 7f27a37e0640 1 -- start start 2023-06-10T18:56:23.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.371+0000 7f27a37e0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27880047d0 0x7f279c1e5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:23.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.371+0000 7f27a37e0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f279c0cbb20 0x7f279c155710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:23.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.371+0000 7f27a37e0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f279c0b2680 0x7f279c0b2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:23.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.371+0000 7f27a37e0640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f279c1e6440 con 0x7f279c0cbb20 2023-06-10T18:56:23.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.371+0000 7f27a37e0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f279c0b3030 con 0x7f279c0b2680 2023-06-10T18:56:23.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.371+0000 7f27a37e0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f279c1e57c0 con 0x7f27880047d0 2023-06-10T18:56:23.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.371+0000 7f27a0d7b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f279c0cbb20 0x7f279c155710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:23.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.371+0000 7f27a0d7b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f279c0cbb20 0x7f279c155710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59256/0 (socket says 172.21.15.53:59256) 2023-06-10T18:56:23.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.371+0000 7f27a0d7b640 1 -- 172.21.15.53:0/2843055378 learned_addr learned my addr 172.21.15.53:0/2843055378 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:23.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.371+0000 7f27a1d7d640 1 --2- 172.21.15.53:0/2843055378 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f279c0b2680 0x7f279c0b2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:23.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.371+0000 7f27a157c640 1 --2- 172.21.15.53:0/2843055378 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27880047d0 0x7f279c1e5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:23.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.371+0000 7f27a0d7b640 1 -- 172.21.15.53:0/2843055378 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27880047d0 msgr2=0x7f279c1e5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:23.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.371+0000 7f27a0d7b640 1 --2- 172.21.15.53:0/2843055378 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27880047d0 0x7f279c1e5150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:23.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.371+0000 7f27a0d7b640 1 -- 172.21.15.53:0/2843055378 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f279c0b2680 msgr2=0x7f279c0b2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:23.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.371+0000 7f27a0d7b640 1 --2- 172.21.15.53:0/2843055378 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f279c0b2680 0x7f279c0b2af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:23.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.371+0000 7f27a0d7b640 1 -- 172.21.15.53:0/2843055378 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f279c1e5aa0 con 0x7f279c0cbb20 2023-06-10T18:56:23.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.371+0000 7f27a0d7b640 1 --2- 172.21.15.53:0/2843055378 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f279c0cbb20 0x7f279c155710 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f278c005040 tx=0x7f2788005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:23.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.371+0000 7f2791ffb640 1 -- 172.21.15.53:0/2843055378 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f278c007440 con 0x7f279c0cbb20 2023-06-10T18:56:23.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.371+0000 7f2791ffb640 1 -- 172.21.15.53:0/2843055378 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2798001d80 con 0x7f279c0cbb20 2023-06-10T18:56:23.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.371+0000 7f27a37e0640 1 -- 172.21.15.53:0/2843055378 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f279c1e5d80 con 0x7f279c0cbb20 2023-06-10T18:56:23.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.371+0000 7f2791ffb640 1 -- 172.21.15.53:0/2843055378 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f278c0067e0 con 0x7f279c0cbb20 2023-06-10T18:56:23.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.371+0000 7f27a37e0640 1 -- 172.21.15.53:0/2843055378 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f279c155c50 con 0x7f279c0cbb20 2023-06-10T18:56:23.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.375+0000 7f27a37e0640 1 -- 172.21.15.53:0/2843055378 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f279c1e6580 con 0x7f279c0cbb20 2023-06-10T18:56:23.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.375+0000 7f2791ffb640 1 -- 172.21.15.53:0/2843055378 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f278c006940 con 0x7f279c0cbb20 2023-06-10T18:56:23.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.375+0000 7f2791ffb640 1 --2- 172.21.15.53:0/2843055378 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f27800662b0 0x7f2780068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:23.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.375+0000 7f2791ffb640 1 -- 172.21.15.53:0/2843055378 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f278c11dd80 con 0x7f279c0cbb20 2023-06-10T18:56:23.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.375+0000 7f27a157c640 1 --2- 172.21.15.53:0/2843055378 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f27800662b0 0x7f2780068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:23.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.375+0000 7f27a157c640 1 --2- 172.21.15.53:0/2843055378 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f27800662b0 0x7f2780068760 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f2798001210 tx=0x7f2798001120 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:23.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.379+0000 7f2791ffb640 1 -- 172.21.15.53:0/2843055378 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f279c1e6580 con 0x7f279c0cbb20 2023-06-10T18:56:23.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.523+0000 7f27a37e0640 1 -- 172.21.15.53:0/2843055378 --> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f279c0cfcb0 con 0x7f27800662b0 2023-06-10T18:56:23.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.547+0000 7f2791ffb640 1 -- 172.21.15.53:0/2843055378 <== mgr.4105 v2:172.21.15.117:6832/3061986771 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+297258 (secure 0 0 0) 0x7f27980056a0 con 0x7f27800662b0 2023-06-10T18:56:23.553 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:56:23.556 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-06-10T18:56:23.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.551+0000 7f27a37e0640 1 -- 172.21.15.53:0/2843055378 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f27800662b0 msgr2=0x7f2780068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:23.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.551+0000 7f27a37e0640 1 --2- 172.21.15.53:0/2843055378 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f27800662b0 0x7f2780068760 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f2798001210 tx=0x7f2798001120 comp rx=0 tx=0).stop 2023-06-10T18:56:23.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.551+0000 7f27a37e0640 1 -- 172.21.15.53:0/2843055378 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f279c0cbb20 msgr2=0x7f279c155710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:23.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.551+0000 7f27a37e0640 1 --2- 172.21.15.53:0/2843055378 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f279c0cbb20 0x7f279c155710 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f278c005040 tx=0x7f2788005800 comp rx=0 tx=0).stop 2023-06-10T18:56:23.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.551+0000 7f27a37e0640 1 -- 172.21.15.53:0/2843055378 shutdown_connections 2023-06-10T18:56:23.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.551+0000 7f27a37e0640 1 --2- 172.21.15.53:0/2843055378 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f27800662b0 0x7f2780068760 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:23.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.551+0000 7f27a37e0640 1 --2- 172.21.15.53:0/2843055378 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f279c0b2680 0x7f279c0b2af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:23.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.551+0000 7f27a37e0640 1 --2- 172.21.15.53:0/2843055378 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f279c0cbb20 0x7f279c155710 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:23.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.551+0000 7f27a37e0640 1 --2- 172.21.15.53:0/2843055378 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27880047d0 0x7f279c1e5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:23.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.551+0000 7f27a37e0640 1 -- 172.21.15.53:0/2843055378 >> 172.21.15.53:0/2843055378 conn(0x7f279c071790 msgr2=0x7f279c0b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:23.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.551+0000 7f27a37e0640 1 -- 172.21.15.53:0/2843055378 shutdown_connections 2023-06-10T18:56:23.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.551+0000 7f27a37e0640 1 -- 172.21.15.53:0/2843055378 wait complete. 2023-06-10T18:56:23.574 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":159,"stamp":"2023-06-10T18:56:21.638167+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237504,"kb_used_data":5504,"kb_used_omap":0,"kb_used_meta":231936,"kb_avail":754737216,"statfs":{"total":773094113280,"available":772850909184,"internally_reserved":0,"allocated":5636096,"data_stored":3070917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":237502464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.352346"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.298104+0000","last_change":"2023-06-10T18:56:17.298104+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.298104+0000","last_undegraded":"2023-06-10T18:56:17.298104+0000","last_fullsized":"2023-06-10T18:56:17.298104+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.289656+0000","last_change":"2023-06-10T18:56:17.289656+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.289656+0000","last_undegraded":"2023-06-10T18:56:17.289656+0000","last_fullsized":"2023-06-10T18:56:17.289656+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.291448+0000","last_change":"2023-06-10T18:56:17.291448+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.291448+0000","last_undegraded":"2023-06-10T18:56:17.291448+0000","last_fullsized":"2023-06-10T18:56:17.291448+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.296823+0000","last_change":"2023-06-10T18:56:17.296823+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.296823+0000","last_undegraded":"2023-06-10T18:56:17.296823+0000","last_fullsized":"2023-06-10T18:56:17.296823+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.296135+0000","last_change":"2023-06-10T18:56:17.296135+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.296135+0000","last_undegraded":"2023-06-10T18:56:17.296135+0000","last_fullsized":"2023-06-10T18:56:17.296135+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.289245+0000","last_change":"2023-06-10T18:56:17.289245+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.289245+0000","last_undegraded":"2023-06-10T18:56:17.289245+0000","last_fullsized":"2023-06-10T18:56:17.289245+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.294945+0000","last_change":"2023-06-10T18:56:17.294945+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.294945+0000","last_undegraded":"2023-06-10T18:56:17.294945+0000","last_fullsized":"2023-06-10T18:56:17.294945+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.295322+0000","last_change":"2023-06-10T18:56:17.295322+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.295322+0000","last_undegraded":"2023-06-10T18:56:17.295322+0000","last_fullsized":"2023-06-10T18:56:17.295322+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.298508+0000","last_change":"2023-06-10T18:56:17.298508+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.298508+0000","last_undegraded":"2023-06-10T18:56:17.298508+0000","last_fullsized":"2023-06-10T18:56:17.298508+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.289523+0000","last_change":"2023-06-10T18:56:17.289523+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.289523+0000","last_undegraded":"2023-06-10T18:56:17.289523+0000","last_fullsized":"2023-06-10T18:56:17.289523+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.300882+0000","last_change":"2023-06-10T18:56:17.300882+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.300882+0000","last_undegraded":"2023-06-10T18:56:17.300882+0000","last_fullsized":"2023-06-10T18:56:17.300882+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.293909+0000","last_change":"2023-06-10T18:56:17.293909+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.293909+0000","last_undegraded":"2023-06-10T18:56:17.293909+0000","last_fullsized":"2023-06-10T18:56:17.293909+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.295642+0000","last_change":"2023-06-10T18:56:17.295642+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.295642+0000","last_undegraded":"2023-06-10T18:56:17.295642+0000","last_fullsized":"2023-06-10T18:56:17.295642+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.294849+0000","last_change":"2023-06-10T18:56:17.294849+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.294849+0000","last_undegraded":"2023-06-10T18:56:17.294849+0000","last_fullsized":"2023-06-10T18:56:17.294849+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.294831+0000","last_change":"2023-06-10T18:56:17.294831+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.294831+0000","last_undegraded":"2023-06-10T18:56:17.294831+0000","last_fullsized":"2023-06-10T18:56:17.294831+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.293216+0000","last_change":"2023-06-10T18:56:17.293216+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.293216+0000","last_undegraded":"2023-06-10T18:56:17.293216+0000","last_fullsized":"2023-06-10T18:56:17.293216+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.295221+0000","last_change":"2023-06-10T18:56:17.295221+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.295221+0000","last_undegraded":"2023-06-10T18:56:17.295221+0000","last_fullsized":"2023-06-10T18:56:17.295221+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.289785+0000","last_change":"2023-06-10T18:56:17.289785+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.289785+0000","last_undegraded":"2023-06-10T18:56:17.289785+0000","last_fullsized":"2023-06-10T18:56:17.289785+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.294974+0000","last_change":"2023-06-10T18:56:17.294974+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.294974+0000","last_undegraded":"2023-06-10T18:56:17.294974+0000","last_fullsized":"2023-06-10T18:56:17.294974+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.296124+0000","last_change":"2023-06-10T18:56:17.296124+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.296124+0000","last_undegraded":"2023-06-10T18:56:17.296124+0000","last_fullsized":"2023-06-10T18:56:17.296124+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.289645+0000","last_change":"2023-06-10T18:56:17.289645+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.289645+0000","last_undegraded":"2023-06-10T18:56:17.289645+0000","last_fullsized":"2023-06-10T18:56:17.289645+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.294752+0000","last_change":"2023-06-10T18:56:17.294752+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.294752+0000","last_undegraded":"2023-06-10T18:56:17.294752+0000","last_fullsized":"2023-06-10T18:56:17.294752+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.294908+0000","last_change":"2023-06-10T18:56:17.294908+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.294908+0000","last_undegraded":"2023-06-10T18:56:17.294908+0000","last_fullsized":"2023-06-10T18:56:17.294908+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.289886+0000","last_change":"2023-06-10T18:56:17.289886+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.289886+0000","last_undegraded":"2023-06-10T18:56:17.289886+0000","last_fullsized":"2023-06-10T18:56:17.289886+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.294982+0000","last_change":"2023-06-10T18:56:17.294982+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.294982+0000","last_undegraded":"2023-06-10T18:56:17.294982+0000","last_fullsized":"2023-06-10T18:56:17.294982+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":216,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-06-10T18:56:17.296459+0000","last_change":"2023-06-10T18:52:34.951528+0000","last_active":"2023-06-10T18:56:17.296459+0000","last_peered":"2023-06-10T18:56:17.296459+0000","last_clean":"2023-06-10T18:56:17.296459+0000","last_became_active":"2023-06-10T18:52:34.949099+0000","last_became_peered":"2023-06-10T18:52:34.949099+0000","last_unstale":"2023-06-10T18:56:17.296459+0000","last_undegraded":"2023-06-10T18:56:17.296459+0000","last_fullsized":"2023-06-10T18:56:17.296459+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_clean_scrub_stamp":"2023-06-10T18:52:33.633295+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:53:32.439531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":62,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-06-10T18:56:17.296089+0000","last_change":"2023-06-10T18:52:40.506384+0000","last_active":"2023-06-10T18:56:17.296089+0000","last_peered":"2023-06-10T18:56:17.296089+0000","last_clean":"2023-06-10T18:56:17.296089+0000","last_became_active":"2023-06-10T18:52:40.505701+0000","last_became_peered":"2023-06-10T18:52:40.505701+0000","last_unstale":"2023-06-10T18:56:17.296089+0000","last_undegraded":"2023-06-10T18:56:17.296089+0000","last_fullsized":"2023-06-10T18:56:17.296089+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:42:06.079219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.300199+0000","last_change":"2023-06-10T18:56:17.300199+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.300199+0000","last_undegraded":"2023-06-10T18:56:17.300199+0000","last_fullsized":"2023-06-10T18:56:17.300199+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":60,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-06-10T18:56:17.296117+0000","last_change":"2023-06-10T18:52:40.512015+0000","last_active":"2023-06-10T18:56:17.296117+0000","last_peered":"2023-06-10T18:56:17.296117+0000","last_clean":"2023-06-10T18:56:17.296117+0000","last_became_active":"2023-06-10T18:52:40.511382+0000","last_became_peered":"2023-06-10T18:52:40.511382+0000","last_unstale":"2023-06-10T18:56:17.296117+0000","last_undegraded":"2023-06-10T18:56:17.296117+0000","last_fullsized":"2023-06-10T18:56:17.296117+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:14:11.722106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.295569+0000","last_change":"2023-06-10T18:56:17.295569+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.295569+0000","last_undegraded":"2023-06-10T18:56:17.295569+0000","last_fullsized":"2023-06-10T18:56:17.295569+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":62,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-06-10T18:56:17.287206+0000","last_change":"2023-06-10T18:52:40.671725+0000","last_active":"2023-06-10T18:56:17.287206+0000","last_peered":"2023-06-10T18:56:17.287206+0000","last_clean":"2023-06-10T18:56:17.287206+0000","last_became_active":"2023-06-10T18:52:40.671442+0000","last_became_peered":"2023-06-10T18:52:40.671442+0000","last_unstale":"2023-06-10T18:56:17.287206+0000","last_undegraded":"2023-06-10T18:56:17.287206+0000","last_fullsized":"2023-06-10T18:56:17.287206+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:51:06.334711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.296581+0000","last_change":"2023-06-10T18:56:17.296581+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.296581+0000","last_undegraded":"2023-06-10T18:56:17.296581+0000","last_fullsized":"2023-06-10T18:56:17.296581+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":62,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-06-10T18:56:17.297511+0000","last_change":"2023-06-10T18:52:40.510258+0000","last_active":"2023-06-10T18:56:17.297511+0000","last_peered":"2023-06-10T18:56:17.297511+0000","last_clean":"2023-06-10T18:56:17.297511+0000","last_became_active":"2023-06-10T18:52:40.509560+0000","last_became_peered":"2023-06-10T18:52:40.509560+0000","last_unstale":"2023-06-10T18:56:17.297511+0000","last_undegraded":"2023-06-10T18:56:17.297511+0000","last_fullsized":"2023-06-10T18:56:17.297511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:12:41.321044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.289523+0000","last_change":"2023-06-10T18:56:17.289523+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.289523+0000","last_undegraded":"2023-06-10T18:56:17.289523+0000","last_fullsized":"2023-06-10T18:56:17.289523+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":58,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-06-10T18:56:17.292501+0000","last_change":"2023-06-10T18:52:40.672266+0000","last_active":"2023-06-10T18:56:17.292501+0000","last_peered":"2023-06-10T18:56:17.292501+0000","last_clean":"2023-06-10T18:56:17.292501+0000","last_became_active":"2023-06-10T18:52:40.671966+0000","last_became_peered":"2023-06-10T18:52:40.671966+0000","last_unstale":"2023-06-10T18:56:17.292501+0000","last_undegraded":"2023-06-10T18:56:17.292501+0000","last_fullsized":"2023-06-10T18:56:17.292501+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:57:03.883411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.295123+0000","last_change":"2023-06-10T18:56:17.295123+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.295123+0000","last_undegraded":"2023-06-10T18:56:17.295123+0000","last_fullsized":"2023-06-10T18:56:17.295123+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":60,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-06-10T18:56:17.301379+0000","last_change":"2023-06-10T18:52:40.671084+0000","last_active":"2023-06-10T18:56:17.301379+0000","last_peered":"2023-06-10T18:56:17.301379+0000","last_clean":"2023-06-10T18:56:17.301379+0000","last_became_active":"2023-06-10T18:52:40.670697+0000","last_became_peered":"2023-06-10T18:52:40.670697+0000","last_unstale":"2023-06-10T18:56:17.301379+0000","last_undegraded":"2023-06-10T18:56:17.301379+0000","last_fullsized":"2023-06-10T18:56:17.301379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:00:32.947088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.293534+0000","last_change":"2023-06-10T18:56:17.293534+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.293534+0000","last_undegraded":"2023-06-10T18:56:17.293534+0000","last_fullsized":"2023-06-10T18:56:17.293534+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":58,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-06-10T18:56:17.292862+0000","last_change":"2023-06-10T18:52:40.514114+0000","last_active":"2023-06-10T18:56:17.292862+0000","last_peered":"2023-06-10T18:56:17.292862+0000","last_clean":"2023-06-10T18:56:17.292862+0000","last_became_active":"2023-06-10T18:52:40.513638+0000","last_became_peered":"2023-06-10T18:52:40.513638+0000","last_unstale":"2023-06-10T18:56:17.292862+0000","last_undegraded":"2023-06-10T18:56:17.292862+0000","last_fullsized":"2023-06-10T18:56:17.292862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:03:15.366661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:56:18.283809+0000","last_change":"2023-06-10T18:56:18.283809+0000","last_active":"2023-06-10T18:56:18.283809+0000","last_peered":"2023-06-10T18:56:18.283809+0000","last_clean":"2023-06-10T18:56:18.283809+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:18.283809+0000","last_undegraded":"2023-06-10T18:56:18.283809+0000","last_fullsized":"2023-06-10T18:56:18.283809+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2023-06-10T18:56:17.293226+0000","last_change":"2023-06-10T18:56:17.293226+0000","last_active":"2023-06-10T18:56:17.270307+0000","last_peered":"2023-06-10T18:56:17.270307+0000","last_clean":"2023-06-10T18:56:17.270307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:56:17.293226+0000","last_undegraded":"2023-06-10T18:56:17.293226+0000","last_fullsized":"2023-06-10T18:56:17.293226+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":62,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-06-10T18:56:17.299937+0000","last_change":"2023-06-10T18:52:40.515396+0000","last_active":"2023-06-10T18:56:17.299937+0000","last_peered":"2023-06-10T18:56:17.299937+0000","last_clean":"2023-06-10T18:56:17.299937+0000","last_became_active":"2023-06-10T18:52:40.514663+0000","last_became_peered":"2023-06-10T18:52:40.514663+0000","last_unstale":"2023-06-10T18:56:17.299937+0000","last_undegraded":"2023-06-10T18:56:17.299937+0000","last_fullsized":"2023-06-10T18:56:17.299937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:17:56.639920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574896,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28072,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343768,"statfs":{"total":96636764160,"available":96608018432,"internally_reserved":0,"allocated":1146880,"data_stored":824709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":0.90400000000000003,"15min":0.88200000000000001},"min":{"1min":0.73599999999999999,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.3759999999999999,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.91100000000000003},{"interface":"front","average":{"1min":1.006,"5min":0.94299999999999995,"15min":0.93000000000000005},"min":{"1min":0.81899999999999995,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.234,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":1.022}]},{"osd":1,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92400000000000004,"15min":0.91500000000000004},"min":{"1min":0.58599999999999997,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.3089999999999999,"5min":1.377,"15min":1.377},"last":0.99299999999999999},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.92500000000000004,"15min":0.91100000000000003},"min":{"1min":0.78400000000000003,"5min":0.504,"15min":0.504},"max":{"1min":1.111,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.82399999999999995}]},{"osd":2,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.83999999999999997,"15min":0.82799999999999996},"min":{"1min":0.64100000000000001,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.214,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.89900000000000002,"15min":0.90700000000000003},"min":{"1min":0.67500000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.325,"5min":1.367,"15min":1.367},"last":0.62}]},{"osd":3,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.92100000000000004,"15min":0.89900000000000002},"min":{"1min":0.68100000000000005,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1499999999999999,"5min":1.502,"15min":1.502},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.93799999999999994,"15min":0.92800000000000005},"min":{"1min":0.70399999999999996,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.2130000000000001,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.84799999999999998}]},{"osd":4,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.876,"15min":0.872},"min":{"1min":0.60199999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.141,"5min":1.639,"15min":1.639},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.96899999999999997,"15min":0.98099999999999998},"min":{"1min":0.748,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.238,"5min":1.411,"15min":1.411},"last":0.88400000000000001}]},{"osd":5,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.042,"15min":1.038},"min":{"1min":0.79800000000000004,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.2669999999999999,"5min":1.806,"15min":1.806},"last":0.79000000000000004},{"interface":"front","average":{"1min":1.081,"5min":1.05,"15min":1.052},"min":{"1min":0.93200000000000005,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.256,"5min":1.522,"15min":1.522},"last":1.111}]},{"osd":6,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.0129999999999999,"15min":1.008},"min":{"1min":0.78500000000000003,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.3,"5min":1.718,"15min":1.718},"last":0.72199999999999998},{"interface":"front","average":{"1min":1.147,"5min":1.095,"15min":1.0900000000000001},"min":{"1min":0.96599999999999997,"5min":0.441,"15min":0.441},"max":{"1min":1.409,"5min":1.464,"15min":1.464},"last":1.052}]}]},{"osd":6,"up_from":13,"seq":55834574897,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":565248,"data_stored":240511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.81999999999999995,"15min":0.80100000000000005},"min":{"1min":0.65800000000000003,"5min":0.502,"15min":0.502},"max":{"1min":1.0589999999999999,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.755},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.85199999999999998,"15min":0.83999999999999997},"min":{"1min":0.71799999999999997,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.0680000000000001,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":1.161}]},{"osd":1,"last update":"Sat Jun 10 18:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.873,"15min":0.85199999999999998},"min":{"1min":0.68999999999999995,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.879,"15min":0.85899999999999999},"min":{"1min":0.68999999999999995,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":0.91100000000000003}]},{"osd":2,"last update":"Sat Jun 10 18:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.871,"15min":0.85899999999999999},"min":{"1min":0.66000000000000003,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.1950000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.88500000000000001,"15min":0.88900000000000001},"min":{"1min":0.68000000000000005,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.109,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.995}]},{"osd":3,"last update":"Sat Jun 10 18:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.874,"15min":0.84799999999999998},"min":{"1min":0.64900000000000002,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.169,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":1.0209999999999999,"5min":0.997,"15min":0.995},"min":{"1min":0.72799999999999998,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":1.1160000000000001}]},{"osd":4,"last update":"Sat Jun 10 18:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.93799999999999994,"15min":0.95399999999999996},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.1259999999999999,"5min":1.198,"15min":1.198},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.95699999999999996,"5min":1.0049999999999999,"15min":1.0189999999999999},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.1879999999999999,"5min":1.222,"15min":1.222},"last":1.0549999999999999}]},{"osd":5,"last update":"Sat Jun 10 18:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.94999999999999996,"15min":0.96199999999999997},"min":{"1min":0.68700000000000006,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.0720000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.879},{"interface":"front","average":{"1min":1.02,"5min":1.0249999999999999,"15min":1.026},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.97199999999999998}]},{"osd":7,"last update":"Sat Jun 10 18:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":1.0389999999999999,"15min":1.0489999999999999},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.1739999999999999,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":1.2030000000000001},{"interface":"front","average":{"1min":1.022,"5min":1.0569999999999999,"15min":1.0649999999999999},"min":{"1min":0.82199999999999995,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.2010000000000001,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":1.085}]}]},{"osd":5,"up_from":13,"seq":55834574897,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":540,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":552960,"data_stored":234341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.84199999999999997,"15min":0.82999999999999996},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.139,"5min":1.175,"15min":1.175},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.91800000000000004,"15min":0.94199999999999995},"min":{"1min":0.63800000000000001,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.246,"5min":1.637,"15min":1.637},"last":1.129}]},{"osd":1,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.91000000000000003,"15min":0.91800000000000004},"min":{"1min":0.67800000000000005,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.1559999999999999,"5min":1.335,"15min":1.335},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.91700000000000004,"15min":0.92100000000000004},"min":{"1min":0.72699999999999998,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.208,"5min":1.78,"15min":1.78},"last":0.63600000000000001}]},{"osd":2,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.65000000000000002,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.1000000000000001,"5min":1.446,"15min":1.446},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.91600000000000004,"15min":0.91200000000000003},"min":{"1min":0.71399999999999997,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.1379999999999999,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.93600000000000005}]},{"osd":3,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93899999999999995,"15min":0.94499999999999995},"min":{"1min":0.68600000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.206,"5min":1.484,"15min":1.484},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.97199999999999998,"5min":1.0249999999999999,"15min":1.0429999999999999},"min":{"1min":0.77100000000000002,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.2969999999999999,"5min":1.337,"15min":1.337},"last":1.1910000000000001}]},{"osd":4,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.96999999999999997,"15min":0.98899999999999999},"min":{"1min":0.70299999999999996,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.2669999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.94599999999999995,"5min":1.034,"15min":1.0640000000000001},"min":{"1min":0.66500000000000004,"5min":0.629,"15min":0.629},"max":{"1min":1.26,"5min":1.575,"15min":1.575},"last":0.90400000000000003}]},{"osd":6,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":1.038,"15min":1.0780000000000001},"min":{"1min":0.66000000000000003,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.2010000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.0589999999999999},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.0609999999999999,"15min":1.079},"min":{"1min":0.69799999999999995,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.2270000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.0389999999999999}]},{"osd":7,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.139,"15min":1.1739999999999999},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.226,"5min":1.873,"15min":1.873},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.155,"15min":1.181},"min":{"1min":0.80000000000000004,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.3680000000000001,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.46}]}]},{"osd":4,"up_from":13,"seq":55834574896,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":565248,"data_stored":240511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.76700000000000002,"15min":0.745},"min":{"1min":0.53400000000000003,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.1599999999999999,"5min":1.2,"15min":1.2},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.88200000000000001,"15min":0.88},"min":{"1min":0.63800000000000001,"5min":0.504,"15min":0.504},"max":{"1min":1.4970000000000001,"5min":1.73,"15min":1.73},"last":0.71499999999999997}]},{"osd":1,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.95199999999999996,"15min":0.95499999999999996},"min":{"1min":0.68200000000000005,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.84599999999999997,"15min":0.83699999999999997},"min":{"1min":0.66600000000000004,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.024,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.64500000000000002}]},{"osd":2,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.879,"15min":0.875},"min":{"1min":0.70799999999999996,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":0.877},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1,"15min":1.004},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.91700000000000004}]},{"osd":3,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.89900000000000002,"15min":0.88},"min":{"1min":0.80900000000000005,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.1679999999999999,"5min":1.22,"15min":1.22},"last":0.55700000000000005},{"interface":"front","average":{"1min":1.006,"5min":0.95799999999999996,"15min":0.95099999999999996},"min":{"1min":0.80100000000000005,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.4490000000000001,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.115}]},{"osd":5,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.96799999999999997,"15min":0.99399999999999999},"min":{"1min":0.67800000000000005,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.069,"5min":1.663,"15min":1.663},"last":1.0780000000000001},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.95399999999999996,"15min":0.98199999999999998},"min":{"1min":0.58099999999999996,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.111,"5min":1.353,"15min":1.353},"last":0.76200000000000001}]},{"osd":6,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":1.002,"15min":1.028},"min":{"1min":0.63100000000000001,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.5720000000000001,"5min":2.2639999999999998,"15min":2.2639999999999998},"last":1.04},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0720000000000001,"15min":1.0760000000000001},"min":{"1min":0.81200000000000006,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":1.004}]},{"osd":7,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.98399999999999999,"15min":0.99399999999999999},"min":{"1min":0.68899999999999995,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.1950000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.85299999999999998},{"interface":"front","average":{"1min":1.012,"5min":1.0529999999999999,"15min":1.071},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.2390000000000001,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":1.3879999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574895,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31584,"kb_used_data":536,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340256,"statfs":{"total":96636764160,"available":96604422144,"internally_reserved":0,"allocated":548864,"data_stored":233322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.57799999999999996,"15min":0.57199999999999995},"min":{"1min":0.51400000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.63500000000000001,"15min":0.63100000000000001},"min":{"1min":0.56000000000000005,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.59699999999999998}]},{"osd":1,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.64400000000000002,"15min":0.622},"min":{"1min":0.51000000000000001,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.747},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.72099999999999997,"15min":0.71599999999999997},"min":{"1min":0.56100000000000005,"5min":0.318,"15min":0.318},"max":{"1min":0.98899999999999999,"5min":1.411,"15min":1.411},"last":1.0620000000000001}]},{"osd":2,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.76100000000000001,"15min":0.75},"min":{"1min":0.63500000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.167,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.75900000000000001,"15min":0.74199999999999999},"min":{"1min":0.65200000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.1970000000000001,"5min":1.264,"15min":1.264},"last":0.80600000000000005}]},{"osd":4,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96099999999999997,"15min":0.96899999999999997},"min":{"1min":0.79800000000000004,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.3089999999999999,"5min":1.488,"15min":1.488},"last":0.88200000000000001},{"interface":"front","average":{"1min":1.052,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.82099999999999995,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.345,"5min":1.458,"15min":1.458},"last":0.84699999999999998}]},{"osd":5,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.0369999999999999,"15min":1.0589999999999999},"min":{"1min":0.80400000000000005,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.268,"5min":2.024,"15min":2.024},"last":0.94599999999999995},{"interface":"front","average":{"1min":1.101,"5min":1.026,"15min":1.014},"min":{"1min":0.83899999999999997,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.29,"5min":1.724,"15min":1.724},"last":1.2390000000000001}]},{"osd":6,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.0489999999999999,"15min":1.0469999999999999},"min":{"1min":0.92400000000000004,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.3300000000000001,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":1.401},{"interface":"front","average":{"1min":1.071,"5min":1.0589999999999999,"15min":1.0720000000000001},"min":{"1min":0.90700000000000003,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.302,"5min":1.78,"15min":1.78},"last":0.98699999999999999}]},{"osd":7,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.101,"15min":1.1279999999999999},"min":{"1min":0.82799999999999996,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.3959999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.212,"5min":1.089,"15min":1.0740000000000001},"min":{"1min":1.0049999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.468,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":1.103}]}]},{"osd":2,"up_from":13,"seq":55834574896,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31600,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340240,"statfs":{"total":96636764160,"available":96604405760,"internally_reserved":0,"allocated":565248,"data_stored":240511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.60099999999999998,"15min":0.58799999999999997},"min":{"1min":0.498,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.97799999999999998,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.50800000000000001,"5min":0.378,"15min":0.378},"max":{"1min":1.024,"5min":1.224,"15min":1.224},"last":0.60499999999999998}]},{"osd":1,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.65000000000000002,"15min":0.64600000000000002},"min":{"1min":0.53400000000000003,"5min":0.307,"15min":0.307},"max":{"1min":0.89500000000000002,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.72299999999999998,"15min":0.68999999999999995},"min":{"1min":0.64700000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.89200000000000002}]},{"osd":3,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.73599999999999999,"15min":0.70599999999999996},"min":{"1min":0.64900000000000002,"5min":0.377,"15min":0.377},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.749,"15min":0.746},"min":{"1min":0.64700000000000002,"5min":0.252,"15min":0.252},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.745}]},{"osd":4,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.91900000000000004,"15min":0.91500000000000004},"min":{"1min":0.81000000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.93600000000000005},{"interface":"front","average":{"1min":1.097,"5min":1.0349999999999999,"15min":1.038},"min":{"1min":0.88600000000000001,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.476,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":1.202}]},{"osd":5,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.016,"15min":1.016},"min":{"1min":0.82699999999999996,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.379,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":1.2789999999999999},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.002,"15min":0.97799999999999998},"min":{"1min":0.77100000000000002,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.377,"5min":1.667,"15min":1.667},"last":0.97099999999999997}]},{"osd":6,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.0429999999999999,"15min":1.0229999999999999},"min":{"1min":0.84299999999999997,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.3049999999999999,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":1.0509999999999999},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.034,"15min":1.032},"min":{"1min":0.89400000000000002,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.4299999999999999,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":1.073}]},{"osd":7,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.099,"15min":1.099},"min":{"1min":0.82399999999999995,"5min":0.62,"15min":0.62},"max":{"1min":1.4339999999999999,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.1319999999999999},{"interface":"front","average":{"1min":1.153,"5min":1.0980000000000001,"15min":1.0760000000000001},"min":{"1min":0.95499999999999996,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.4239999999999999,"5min":1.752,"15min":1.752},"last":1.2310000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574898,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31584,"kb_used_data":536,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340256,"statfs":{"total":96636764160,"available":96604422144,"internally_reserved":0,"allocated":548864,"data_stored":233322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.67100000000000004,"15min":0.66100000000000003},"min":{"1min":0.47999999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.96699999999999997},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.71999999999999997,"15min":0.68600000000000005},"min":{"1min":0.63400000000000001,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.0369999999999999,"5min":1.694,"15min":1.694},"last":0.64500000000000002}]},{"osd":2,"last update":"Sat Jun 10 18:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.64400000000000002,"15min":0.623},"min":{"1min":0.53500000000000003,"5min":0.249,"15min":0.249},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.877,"5min":0.70199999999999996,"15min":0.65800000000000003},"min":{"1min":0.65600000000000003,"5min":0.315,"15min":0.315},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":0.79500000000000004}]},{"osd":3,"last update":"Sat Jun 10 18:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.77800000000000002,"15min":0.745},"min":{"1min":0.65900000000000003,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":1.2170000000000001},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.76100000000000001,"15min":0.749},"min":{"1min":0.58499999999999996,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.1100000000000001,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":0.73899999999999999}]},{"osd":4,"last update":"Sat Jun 10 18:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.87,"15min":0.83599999999999997},"min":{"1min":0.73399999999999999,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.90700000000000003},{"interface":"front","average":{"1min":1.087,"5min":1.1160000000000001,"15min":1.079},"min":{"1min":0.78500000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.5449999999999999,"5min":5.8209999999999997,"15min":5.8209999999999997},"last":1.141}]},{"osd":5,"last update":"Sat Jun 10 18:55:44 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.032,"15min":1.028},"min":{"1min":0.75800000000000001,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.4550000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":0.877},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0129999999999999,"15min":0.97099999999999997},"min":{"1min":0.754,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.3819999999999999,"5min":3.089,"15min":3.089},"last":0.754}]},{"osd":6,"last update":"Sat Jun 10 18:55:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.105,"15min":1.0309999999999999},"min":{"1min":0.75900000000000001,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.5249999999999999,"5min":7.2599999999999998,"15min":7.2599999999999998},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.081,"5min":1.107,"15min":1.0309999999999999},"min":{"1min":0.80800000000000005,"5min":0.622,"15min":0.622},"max":{"1min":1.591,"5min":9.0069999999999997,"15min":9.0069999999999997},"last":0.84799999999999998}]},{"osd":7,"last update":"Sat Jun 10 18:55:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.0980000000000001,"15min":1.083},"min":{"1min":0.89300000000000002,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.6879999999999999,"5min":2.105,"15min":2.105},"last":1.0640000000000001},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.085,"15min":1.0669999999999999},"min":{"1min":0.90200000000000002,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.573,"5min":2.2570000000000001,"15min":2.2570000000000001},"last":0.93100000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574897,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32164,"kb_used_data":1116,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339676,"statfs":{"total":96636764160,"available":96603828224,"internally_reserved":0,"allocated":1142784,"data_stored":823690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.61299999999999999,"15min":0.59899999999999998},"min":{"1min":0.51000000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.77200000000000002,"15min":0.746},"min":{"1min":0.70899999999999996,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.0469999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.73699999999999999}]},{"osd":2,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.71099999999999997,"15min":0.69799999999999995},"min":{"1min":0.51900000000000002,"5min":0.313,"15min":0.313},"max":{"1min":1.0269999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.64600000000000002,"15min":0.63},"min":{"1min":0.55700000000000005,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.96799999999999997,"5min":1.371,"15min":1.371},"last":0.82399999999999995}]},{"osd":3,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.68200000000000005,"15min":0.67000000000000004},"min":{"1min":0.55800000000000005,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.1930000000000001,"5min":1.226,"15min":1.226},"last":1.087},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.82899999999999996,"15min":0.81000000000000005},"min":{"1min":0.65800000000000003,"5min":0.375,"15min":0.375},"max":{"1min":1.262,"5min":1.829,"15min":1.829},"last":1.296}]},{"osd":4,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.90000000000000002,"15min":0.88900000000000001},"min":{"1min":0.75600000000000001,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.1579999999999999,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.94099999999999995},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.0369999999999999,"15min":1.034},"min":{"1min":0.86099999999999999,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.228,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":1.04}]},{"osd":5,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.96099999999999997,"15min":0.95799999999999996},"min":{"1min":0.67300000000000004,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.351,"5min":1.694,"15min":1.694},"last":1.002},{"interface":"front","average":{"1min":0.99099999999999999,"5min":1,"15min":0.998},"min":{"1min":0.72999999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.1870000000000001,"5min":1.75,"15min":1.75},"last":1.3400000000000001}]},{"osd":6,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.0700000000000001,"15min":1.056},"min":{"1min":0.93899999999999995,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.331,"5min":2.04,"15min":2.04},"last":1.1220000000000001},{"interface":"front","average":{"1min":1.0409999999999999,"5min":0.996,"15min":0.997},"min":{"1min":0.76100000000000001,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.444,"5min":1.883,"15min":1.883},"last":1.159}]},{"osd":7,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.0369999999999999,"15min":1.0329999999999999},"min":{"1min":0.77200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.397,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.077,"5min":1.056,"15min":1.05},"min":{"1min":0.93200000000000005,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.298,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.4610000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-10T18:56:23.581 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3f is not active+clean 2023-06-10T18:56:23.581 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:56:18.283809+0000', 'last_change': '2023-06-10T18:56:18.283809+0000', 'last_active': '2023-06-10T18:56:18.283809+0000', 'last_peered': '2023-06-10T18:56:18.283809+0000', 'last_clean': '2023-06-10T18:56:18.283809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:18.283809+0000', 'last_undegraded': '2023-06-10T18:56:18.283809+0000', 'last_fullsized': '2023-06-10T18:56:18.283809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:56:23.581 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3e is not active+clean 2023-06-10T18:56:23.582 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:56:18.283809+0000', 'last_change': '2023-06-10T18:56:18.283809+0000', 'last_active': '2023-06-10T18:56:18.283809+0000', 'last_peered': '2023-06-10T18:56:18.283809+0000', 'last_clean': '2023-06-10T18:56:18.283809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:18.283809+0000', 'last_undegraded': '2023-06-10T18:56:18.283809+0000', 'last_fullsized': '2023-06-10T18:56:18.283809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:56:23.582 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3d is not active+clean 2023-06-10T18:56:23.582 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:56:18.283809+0000', 'last_change': '2023-06-10T18:56:18.283809+0000', 'last_active': '2023-06-10T18:56:18.283809+0000', 'last_peered': '2023-06-10T18:56:18.283809+0000', 'last_clean': '2023-06-10T18:56:18.283809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:18.283809+0000', 'last_undegraded': '2023-06-10T18:56:18.283809+0000', 'last_fullsized': '2023-06-10T18:56:18.283809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:56:23.583 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3c is not active+clean 2023-06-10T18:56:23.583 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:56:18.283809+0000', 'last_change': '2023-06-10T18:56:18.283809+0000', 'last_active': '2023-06-10T18:56:18.283809+0000', 'last_peered': '2023-06-10T18:56:18.283809+0000', 'last_clean': '2023-06-10T18:56:18.283809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:18.283809+0000', 'last_undegraded': '2023-06-10T18:56:18.283809+0000', 'last_fullsized': '2023-06-10T18:56:18.283809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:56:23.583 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3b is not active+clean 2023-06-10T18:56:23.584 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:56:18.283809+0000', 'last_change': '2023-06-10T18:56:18.283809+0000', 'last_active': '2023-06-10T18:56:18.283809+0000', 'last_peered': '2023-06-10T18:56:18.283809+0000', 'last_clean': '2023-06-10T18:56:18.283809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:18.283809+0000', 'last_undegraded': '2023-06-10T18:56:18.283809+0000', 'last_fullsized': '2023-06-10T18:56:18.283809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:56:23.584 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3a is not active+clean 2023-06-10T18:56:23.584 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:56:18.283809+0000', 'last_change': '2023-06-10T18:56:18.283809+0000', 'last_active': '2023-06-10T18:56:18.283809+0000', 'last_peered': '2023-06-10T18:56:18.283809+0000', 'last_clean': '2023-06-10T18:56:18.283809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:18.283809+0000', 'last_undegraded': '2023-06-10T18:56:18.283809+0000', 'last_fullsized': '2023-06-10T18:56:18.283809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:56:23.585 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.39 is not active+clean 2023-06-10T18:56:23.585 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:56:18.283809+0000', 'last_change': '2023-06-10T18:56:18.283809+0000', 'last_active': '2023-06-10T18:56:18.283809+0000', 'last_peered': '2023-06-10T18:56:18.283809+0000', 'last_clean': '2023-06-10T18:56:18.283809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:18.283809+0000', 'last_undegraded': '2023-06-10T18:56:18.283809+0000', 'last_fullsized': '2023-06-10T18:56:18.283809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:56:23.585 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.38 is not active+clean 2023-06-10T18:56:23.586 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:56:18.283809+0000', 'last_change': '2023-06-10T18:56:18.283809+0000', 'last_active': '2023-06-10T18:56:18.283809+0000', 'last_peered': '2023-06-10T18:56:18.283809+0000', 'last_clean': '2023-06-10T18:56:18.283809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:18.283809+0000', 'last_undegraded': '2023-06-10T18:56:18.283809+0000', 'last_fullsized': '2023-06-10T18:56:18.283809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:56:23.587 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.37 is not active+clean 2023-06-10T18:56:23.587 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:56:18.283809+0000', 'last_change': '2023-06-10T18:56:18.283809+0000', 'last_active': '2023-06-10T18:56:18.283809+0000', 'last_peered': '2023-06-10T18:56:18.283809+0000', 'last_clean': '2023-06-10T18:56:18.283809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:18.283809+0000', 'last_undegraded': '2023-06-10T18:56:18.283809+0000', 'last_fullsized': '2023-06-10T18:56:18.283809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:56:23.587 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.36 is not active+clean 2023-06-10T18:56:23.588 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:56:18.283809+0000', 'last_change': '2023-06-10T18:56:18.283809+0000', 'last_active': '2023-06-10T18:56:18.283809+0000', 'last_peered': '2023-06-10T18:56:18.283809+0000', 'last_clean': '2023-06-10T18:56:18.283809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:18.283809+0000', 'last_undegraded': '2023-06-10T18:56:18.283809+0000', 'last_fullsized': '2023-06-10T18:56:18.283809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:56:23.588 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.35 is not active+clean 2023-06-10T18:56:23.588 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:56:18.283809+0000', 'last_change': '2023-06-10T18:56:18.283809+0000', 'last_active': '2023-06-10T18:56:18.283809+0000', 'last_peered': '2023-06-10T18:56:18.283809+0000', 'last_clean': '2023-06-10T18:56:18.283809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:18.283809+0000', 'last_undegraded': '2023-06-10T18:56:18.283809+0000', 'last_fullsized': '2023-06-10T18:56:18.283809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:56:23.589 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.34 is not active+clean 2023-06-10T18:56:23.589 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:56:18.283809+0000', 'last_change': '2023-06-10T18:56:18.283809+0000', 'last_active': '2023-06-10T18:56:18.283809+0000', 'last_peered': '2023-06-10T18:56:18.283809+0000', 'last_clean': '2023-06-10T18:56:18.283809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:18.283809+0000', 'last_undegraded': '2023-06-10T18:56:18.283809+0000', 'last_fullsized': '2023-06-10T18:56:18.283809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:56:23.589 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.33 is not active+clean 2023-06-10T18:56:23.590 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:56:18.283809+0000', 'last_change': '2023-06-10T18:56:18.283809+0000', 'last_active': '2023-06-10T18:56:18.283809+0000', 'last_peered': '2023-06-10T18:56:18.283809+0000', 'last_clean': '2023-06-10T18:56:18.283809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:18.283809+0000', 'last_undegraded': '2023-06-10T18:56:18.283809+0000', 'last_fullsized': '2023-06-10T18:56:18.283809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:56:23.590 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.32 is not active+clean 2023-06-10T18:56:23.591 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:56:18.283809+0000', 'last_change': '2023-06-10T18:56:18.283809+0000', 'last_active': '2023-06-10T18:56:18.283809+0000', 'last_peered': '2023-06-10T18:56:18.283809+0000', 'last_clean': '2023-06-10T18:56:18.283809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:18.283809+0000', 'last_undegraded': '2023-06-10T18:56:18.283809+0000', 'last_fullsized': '2023-06-10T18:56:18.283809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:56:23.591 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.31 is not active+clean 2023-06-10T18:56:23.591 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:56:18.283809+0000', 'last_change': '2023-06-10T18:56:18.283809+0000', 'last_active': '2023-06-10T18:56:18.283809+0000', 'last_peered': '2023-06-10T18:56:18.283809+0000', 'last_clean': '2023-06-10T18:56:18.283809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:18.283809+0000', 'last_undegraded': '2023-06-10T18:56:18.283809+0000', 'last_fullsized': '2023-06-10T18:56:18.283809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:56:23.592 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.30 is not active+clean 2023-06-10T18:56:23.592 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:56:18.283809+0000', 'last_change': '2023-06-10T18:56:18.283809+0000', 'last_active': '2023-06-10T18:56:18.283809+0000', 'last_peered': '2023-06-10T18:56:18.283809+0000', 'last_clean': '2023-06-10T18:56:18.283809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:18.283809+0000', 'last_undegraded': '2023-06-10T18:56:18.283809+0000', 'last_fullsized': '2023-06-10T18:56:18.283809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:56:23.592 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2f is not active+clean 2023-06-10T18:56:23.593 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:56:18.283809+0000', 'last_change': '2023-06-10T18:56:18.283809+0000', 'last_active': '2023-06-10T18:56:18.283809+0000', 'last_peered': '2023-06-10T18:56:18.283809+0000', 'last_clean': '2023-06-10T18:56:18.283809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:18.283809+0000', 'last_undegraded': '2023-06-10T18:56:18.283809+0000', 'last_fullsized': '2023-06-10T18:56:18.283809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:56:23.593 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2e is not active+clean 2023-06-10T18:56:23.593 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:56:18.283809+0000', 'last_change': '2023-06-10T18:56:18.283809+0000', 'last_active': '2023-06-10T18:56:18.283809+0000', 'last_peered': '2023-06-10T18:56:18.283809+0000', 'last_clean': '2023-06-10T18:56:18.283809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:18.283809+0000', 'last_undegraded': '2023-06-10T18:56:18.283809+0000', 'last_fullsized': '2023-06-10T18:56:18.283809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:56:23.594 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2d is not active+clean 2023-06-10T18:56:23.594 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:56:18.283809+0000', 'last_change': '2023-06-10T18:56:18.283809+0000', 'last_active': '2023-06-10T18:56:18.283809+0000', 'last_peered': '2023-06-10T18:56:18.283809+0000', 'last_clean': '2023-06-10T18:56:18.283809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:18.283809+0000', 'last_undegraded': '2023-06-10T18:56:18.283809+0000', 'last_fullsized': '2023-06-10T18:56:18.283809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:56:23.594 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2c is not active+clean 2023-06-10T18:56:23.595 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:56:18.283809+0000', 'last_change': '2023-06-10T18:56:18.283809+0000', 'last_active': '2023-06-10T18:56:18.283809+0000', 'last_peered': '2023-06-10T18:56:18.283809+0000', 'last_clean': '2023-06-10T18:56:18.283809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:18.283809+0000', 'last_undegraded': '2023-06-10T18:56:18.283809+0000', 'last_fullsized': '2023-06-10T18:56:18.283809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:56:23.595 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2b is not active+clean 2023-06-10T18:56:23.595 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:56:18.283809+0000', 'last_change': '2023-06-10T18:56:18.283809+0000', 'last_active': '2023-06-10T18:56:18.283809+0000', 'last_peered': '2023-06-10T18:56:18.283809+0000', 'last_clean': '2023-06-10T18:56:18.283809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:18.283809+0000', 'last_undegraded': '2023-06-10T18:56:18.283809+0000', 'last_fullsized': '2023-06-10T18:56:18.283809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:56:23.596 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2a is not active+clean 2023-06-10T18:56:23.596 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:56:18.283809+0000', 'last_change': '2023-06-10T18:56:18.283809+0000', 'last_active': '2023-06-10T18:56:18.283809+0000', 'last_peered': '2023-06-10T18:56:18.283809+0000', 'last_clean': '2023-06-10T18:56:18.283809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:18.283809+0000', 'last_undegraded': '2023-06-10T18:56:18.283809+0000', 'last_fullsized': '2023-06-10T18:56:18.283809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:56:23.596 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.29 is not active+clean 2023-06-10T18:56:23.596 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:56:18.283809+0000', 'last_change': '2023-06-10T18:56:18.283809+0000', 'last_active': '2023-06-10T18:56:18.283809+0000', 'last_peered': '2023-06-10T18:56:18.283809+0000', 'last_clean': '2023-06-10T18:56:18.283809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:18.283809+0000', 'last_undegraded': '2023-06-10T18:56:18.283809+0000', 'last_fullsized': '2023-06-10T18:56:18.283809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:56:23.597 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.28 is not active+clean 2023-06-10T18:56:23.597 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:56:18.283809+0000', 'last_change': '2023-06-10T18:56:18.283809+0000', 'last_active': '2023-06-10T18:56:18.283809+0000', 'last_peered': '2023-06-10T18:56:18.283809+0000', 'last_clean': '2023-06-10T18:56:18.283809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:18.283809+0000', 'last_undegraded': '2023-06-10T18:56:18.283809+0000', 'last_fullsized': '2023-06-10T18:56:18.283809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:56:23.597 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.27 is not active+clean 2023-06-10T18:56:23.598 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:56:18.283809+0000', 'last_change': '2023-06-10T18:56:18.283809+0000', 'last_active': '2023-06-10T18:56:18.283809+0000', 'last_peered': '2023-06-10T18:56:18.283809+0000', 'last_clean': '2023-06-10T18:56:18.283809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:18.283809+0000', 'last_undegraded': '2023-06-10T18:56:18.283809+0000', 'last_fullsized': '2023-06-10T18:56:18.283809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:56:23.598 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.26 is not active+clean 2023-06-10T18:56:23.598 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:56:18.283809+0000', 'last_change': '2023-06-10T18:56:18.283809+0000', 'last_active': '2023-06-10T18:56:18.283809+0000', 'last_peered': '2023-06-10T18:56:18.283809+0000', 'last_clean': '2023-06-10T18:56:18.283809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:18.283809+0000', 'last_undegraded': '2023-06-10T18:56:18.283809+0000', 'last_fullsized': '2023-06-10T18:56:18.283809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:56:23.599 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.25 is not active+clean 2023-06-10T18:56:23.599 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:56:18.283809+0000', 'last_change': '2023-06-10T18:56:18.283809+0000', 'last_active': '2023-06-10T18:56:18.283809+0000', 'last_peered': '2023-06-10T18:56:18.283809+0000', 'last_clean': '2023-06-10T18:56:18.283809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:18.283809+0000', 'last_undegraded': '2023-06-10T18:56:18.283809+0000', 'last_fullsized': '2023-06-10T18:56:18.283809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:56:23.599 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.24 is not active+clean 2023-06-10T18:56:23.600 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:56:18.283809+0000', 'last_change': '2023-06-10T18:56:18.283809+0000', 'last_active': '2023-06-10T18:56:18.283809+0000', 'last_peered': '2023-06-10T18:56:18.283809+0000', 'last_clean': '2023-06-10T18:56:18.283809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:18.283809+0000', 'last_undegraded': '2023-06-10T18:56:18.283809+0000', 'last_fullsized': '2023-06-10T18:56:18.283809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:56:23.600 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.23 is not active+clean 2023-06-10T18:56:23.600 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:56:18.283809+0000', 'last_change': '2023-06-10T18:56:18.283809+0000', 'last_active': '2023-06-10T18:56:18.283809+0000', 'last_peered': '2023-06-10T18:56:18.283809+0000', 'last_clean': '2023-06-10T18:56:18.283809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:18.283809+0000', 'last_undegraded': '2023-06-10T18:56:18.283809+0000', 'last_fullsized': '2023-06-10T18:56:18.283809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:56:23.601 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.22 is not active+clean 2023-06-10T18:56:23.601 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:56:18.283809+0000', 'last_change': '2023-06-10T18:56:18.283809+0000', 'last_active': '2023-06-10T18:56:18.283809+0000', 'last_peered': '2023-06-10T18:56:18.283809+0000', 'last_clean': '2023-06-10T18:56:18.283809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:18.283809+0000', 'last_undegraded': '2023-06-10T18:56:18.283809+0000', 'last_fullsized': '2023-06-10T18:56:18.283809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:56:23.601 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.21 is not active+clean 2023-06-10T18:56:23.602 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:56:18.283809+0000', 'last_change': '2023-06-10T18:56:18.283809+0000', 'last_active': '2023-06-10T18:56:18.283809+0000', 'last_peered': '2023-06-10T18:56:18.283809+0000', 'last_clean': '2023-06-10T18:56:18.283809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:18.283809+0000', 'last_undegraded': '2023-06-10T18:56:18.283809+0000', 'last_fullsized': '2023-06-10T18:56:18.283809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:56:23.602 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.20 is not active+clean 2023-06-10T18:56:23.602 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:56:18.283809+0000', 'last_change': '2023-06-10T18:56:18.283809+0000', 'last_active': '2023-06-10T18:56:18.283809+0000', 'last_peered': '2023-06-10T18:56:18.283809+0000', 'last_clean': '2023-06-10T18:56:18.283809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:18.283809+0000', 'last_undegraded': '2023-06-10T18:56:18.283809+0000', 'last_fullsized': '2023-06-10T18:56:18.283809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:56:23.603 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.10 is not active+clean 2023-06-10T18:56:23.603 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:56:18.283809+0000', 'last_change': '2023-06-10T18:56:18.283809+0000', 'last_active': '2023-06-10T18:56:18.283809+0000', 'last_peered': '2023-06-10T18:56:18.283809+0000', 'last_clean': '2023-06-10T18:56:18.283809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:18.283809+0000', 'last_undegraded': '2023-06-10T18:56:18.283809+0000', 'last_fullsized': '2023-06-10T18:56:18.283809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:56:23.603 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1f is not active+clean 2023-06-10T18:56:23.603 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-06-10T18:56:17.298104+0000', 'last_change': '2023-06-10T18:56:17.298104+0000', 'last_active': '2023-06-10T18:56:17.270307+0000', 'last_peered': '2023-06-10T18:56:17.270307+0000', 'last_clean': '2023-06-10T18:56:17.270307+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:17.298104+0000', 'last_undegraded': '2023-06-10T18:56:17.298104+0000', 'last_fullsized': '2023-06-10T18:56:17.298104+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-06-10T18:56:23.604 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.11 is not active+clean 2023-06-10T18:56:23.604 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:56:18.283809+0000', 'last_change': '2023-06-10T18:56:18.283809+0000', 'last_active': '2023-06-10T18:56:18.283809+0000', 'last_peered': '2023-06-10T18:56:18.283809+0000', 'last_clean': '2023-06-10T18:56:18.283809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:18.283809+0000', 'last_undegraded': '2023-06-10T18:56:18.283809+0000', 'last_fullsized': '2023-06-10T18:56:18.283809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:56:23.604 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1e is not active+clean 2023-06-10T18:56:23.605 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-06-10T18:56:17.289656+0000', 'last_change': '2023-06-10T18:56:17.289656+0000', 'last_active': '2023-06-10T18:56:17.270307+0000', 'last_peered': '2023-06-10T18:56:17.270307+0000', 'last_clean': '2023-06-10T18:56:17.270307+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:17.289656+0000', 'last_undegraded': '2023-06-10T18:56:17.289656+0000', 'last_fullsized': '2023-06-10T18:56:17.289656+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-06-10T18:56:23.605 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.12 is not active+clean 2023-06-10T18:56:23.605 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:56:18.283809+0000', 'last_change': '2023-06-10T18:56:18.283809+0000', 'last_active': '2023-06-10T18:56:18.283809+0000', 'last_peered': '2023-06-10T18:56:18.283809+0000', 'last_clean': '2023-06-10T18:56:18.283809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:18.283809+0000', 'last_undegraded': '2023-06-10T18:56:18.283809+0000', 'last_fullsized': '2023-06-10T18:56:18.283809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:56:23.606 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1d is not active+clean 2023-06-10T18:56:23.606 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-06-10T18:56:17.291448+0000', 'last_change': '2023-06-10T18:56:17.291448+0000', 'last_active': '2023-06-10T18:56:17.270307+0000', 'last_peered': '2023-06-10T18:56:17.270307+0000', 'last_clean': '2023-06-10T18:56:17.270307+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:17.291448+0000', 'last_undegraded': '2023-06-10T18:56:17.291448+0000', 'last_fullsized': '2023-06-10T18:56:17.291448+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-06-10T18:56:23.606 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.13 is not active+clean 2023-06-10T18:56:23.607 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:56:18.283809+0000', 'last_change': '2023-06-10T18:56:18.283809+0000', 'last_active': '2023-06-10T18:56:18.283809+0000', 'last_peered': '2023-06-10T18:56:18.283809+0000', 'last_clean': '2023-06-10T18:56:18.283809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:18.283809+0000', 'last_undegraded': '2023-06-10T18:56:18.283809+0000', 'last_fullsized': '2023-06-10T18:56:18.283809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:56:23.607 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1c is not active+clean 2023-06-10T18:56:23.607 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-06-10T18:56:17.296823+0000', 'last_change': '2023-06-10T18:56:17.296823+0000', 'last_active': '2023-06-10T18:56:17.270307+0000', 'last_peered': '2023-06-10T18:56:17.270307+0000', 'last_clean': '2023-06-10T18:56:17.270307+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:17.296823+0000', 'last_undegraded': '2023-06-10T18:56:17.296823+0000', 'last_fullsized': '2023-06-10T18:56:17.296823+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-06-10T18:56:23.608 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.14 is not active+clean 2023-06-10T18:56:23.608 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:56:18.283809+0000', 'last_change': '2023-06-10T18:56:18.283809+0000', 'last_active': '2023-06-10T18:56:18.283809+0000', 'last_peered': '2023-06-10T18:56:18.283809+0000', 'last_clean': '2023-06-10T18:56:18.283809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:18.283809+0000', 'last_undegraded': '2023-06-10T18:56:18.283809+0000', 'last_fullsized': '2023-06-10T18:56:18.283809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:56:23.608 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1b is not active+clean 2023-06-10T18:56:23.608 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-06-10T18:56:17.296135+0000', 'last_change': '2023-06-10T18:56:17.296135+0000', 'last_active': '2023-06-10T18:56:17.270307+0000', 'last_peered': '2023-06-10T18:56:17.270307+0000', 'last_clean': '2023-06-10T18:56:17.270307+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:17.296135+0000', 'last_undegraded': '2023-06-10T18:56:17.296135+0000', 'last_fullsized': '2023-06-10T18:56:17.296135+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-06-10T18:56:23.609 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.15 is not active+clean 2023-06-10T18:56:23.609 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:56:18.283809+0000', 'last_change': '2023-06-10T18:56:18.283809+0000', 'last_active': '2023-06-10T18:56:18.283809+0000', 'last_peered': '2023-06-10T18:56:18.283809+0000', 'last_clean': '2023-06-10T18:56:18.283809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:18.283809+0000', 'last_undegraded': '2023-06-10T18:56:18.283809+0000', 'last_fullsized': '2023-06-10T18:56:18.283809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:56:23.609 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1a is not active+clean 2023-06-10T18:56:23.610 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-06-10T18:56:17.289245+0000', 'last_change': '2023-06-10T18:56:17.289245+0000', 'last_active': '2023-06-10T18:56:17.270307+0000', 'last_peered': '2023-06-10T18:56:17.270307+0000', 'last_clean': '2023-06-10T18:56:17.270307+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:17.289245+0000', 'last_undegraded': '2023-06-10T18:56:17.289245+0000', 'last_fullsized': '2023-06-10T18:56:17.289245+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-06-10T18:56:23.610 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.16 is not active+clean 2023-06-10T18:56:23.610 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:56:18.283809+0000', 'last_change': '2023-06-10T18:56:18.283809+0000', 'last_active': '2023-06-10T18:56:18.283809+0000', 'last_peered': '2023-06-10T18:56:18.283809+0000', 'last_clean': '2023-06-10T18:56:18.283809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:18.283809+0000', 'last_undegraded': '2023-06-10T18:56:18.283809+0000', 'last_fullsized': '2023-06-10T18:56:18.283809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:56:23.611 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.19 is not active+clean 2023-06-10T18:56:23.611 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-06-10T18:56:17.294945+0000', 'last_change': '2023-06-10T18:56:17.294945+0000', 'last_active': '2023-06-10T18:56:17.270307+0000', 'last_peered': '2023-06-10T18:56:17.270307+0000', 'last_clean': '2023-06-10T18:56:17.270307+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:17.294945+0000', 'last_undegraded': '2023-06-10T18:56:17.294945+0000', 'last_fullsized': '2023-06-10T18:56:17.294945+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-06-10T18:56:23.611 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.17 is not active+clean 2023-06-10T18:56:23.611 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:56:18.283809+0000', 'last_change': '2023-06-10T18:56:18.283809+0000', 'last_active': '2023-06-10T18:56:18.283809+0000', 'last_peered': '2023-06-10T18:56:18.283809+0000', 'last_clean': '2023-06-10T18:56:18.283809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:18.283809+0000', 'last_undegraded': '2023-06-10T18:56:18.283809+0000', 'last_fullsized': '2023-06-10T18:56:18.283809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:56:23.612 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.18 is not active+clean 2023-06-10T18:56:23.612 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-06-10T18:56:17.295322+0000', 'last_change': '2023-06-10T18:56:17.295322+0000', 'last_active': '2023-06-10T18:56:17.270307+0000', 'last_peered': '2023-06-10T18:56:17.270307+0000', 'last_clean': '2023-06-10T18:56:17.270307+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:17.295322+0000', 'last_undegraded': '2023-06-10T18:56:17.295322+0000', 'last_fullsized': '2023-06-10T18:56:17.295322+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-06-10T18:56:23.612 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.18 is not active+clean 2023-06-10T18:56:23.613 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:56:18.283809+0000', 'last_change': '2023-06-10T18:56:18.283809+0000', 'last_active': '2023-06-10T18:56:18.283809+0000', 'last_peered': '2023-06-10T18:56:18.283809+0000', 'last_clean': '2023-06-10T18:56:18.283809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:18.283809+0000', 'last_undegraded': '2023-06-10T18:56:18.283809+0000', 'last_fullsized': '2023-06-10T18:56:18.283809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:56:23.613 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.17 is not active+clean 2023-06-10T18:56:23.613 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-06-10T18:56:17.298508+0000', 'last_change': '2023-06-10T18:56:17.298508+0000', 'last_active': '2023-06-10T18:56:17.270307+0000', 'last_peered': '2023-06-10T18:56:17.270307+0000', 'last_clean': '2023-06-10T18:56:17.270307+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:17.298508+0000', 'last_undegraded': '2023-06-10T18:56:17.298508+0000', 'last_fullsized': '2023-06-10T18:56:17.298508+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-06-10T18:56:23.614 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.19 is not active+clean 2023-06-10T18:56:23.614 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:56:18.283809+0000', 'last_change': '2023-06-10T18:56:18.283809+0000', 'last_active': '2023-06-10T18:56:18.283809+0000', 'last_peered': '2023-06-10T18:56:18.283809+0000', 'last_clean': '2023-06-10T18:56:18.283809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:18.283809+0000', 'last_undegraded': '2023-06-10T18:56:18.283809+0000', 'last_fullsized': '2023-06-10T18:56:18.283809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:56:23.614 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.16 is not active+clean 2023-06-10T18:56:23.614 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-06-10T18:56:17.289523+0000', 'last_change': '2023-06-10T18:56:17.289523+0000', 'last_active': '2023-06-10T18:56:17.270307+0000', 'last_peered': '2023-06-10T18:56:17.270307+0000', 'last_clean': '2023-06-10T18:56:17.270307+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:17.289523+0000', 'last_undegraded': '2023-06-10T18:56:17.289523+0000', 'last_fullsized': '2023-06-10T18:56:17.289523+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-06-10T18:56:23.615 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1a is not active+clean 2023-06-10T18:56:23.615 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:56:18.283809+0000', 'last_change': '2023-06-10T18:56:18.283809+0000', 'last_active': '2023-06-10T18:56:18.283809+0000', 'last_peered': '2023-06-10T18:56:18.283809+0000', 'last_clean': '2023-06-10T18:56:18.283809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:18.283809+0000', 'last_undegraded': '2023-06-10T18:56:18.283809+0000', 'last_fullsized': '2023-06-10T18:56:18.283809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:56:23.615 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.15 is not active+clean 2023-06-10T18:56:23.616 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-06-10T18:56:17.300882+0000', 'last_change': '2023-06-10T18:56:17.300882+0000', 'last_active': '2023-06-10T18:56:17.270307+0000', 'last_peered': '2023-06-10T18:56:17.270307+0000', 'last_clean': '2023-06-10T18:56:17.270307+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:17.300882+0000', 'last_undegraded': '2023-06-10T18:56:17.300882+0000', 'last_fullsized': '2023-06-10T18:56:17.300882+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-06-10T18:56:23.616 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1b is not active+clean 2023-06-10T18:56:23.616 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:56:18.283809+0000', 'last_change': '2023-06-10T18:56:18.283809+0000', 'last_active': '2023-06-10T18:56:18.283809+0000', 'last_peered': '2023-06-10T18:56:18.283809+0000', 'last_clean': '2023-06-10T18:56:18.283809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:18.283809+0000', 'last_undegraded': '2023-06-10T18:56:18.283809+0000', 'last_fullsized': '2023-06-10T18:56:18.283809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:56:23.617 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.14 is not active+clean 2023-06-10T18:56:23.617 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-06-10T18:56:17.293909+0000', 'last_change': '2023-06-10T18:56:17.293909+0000', 'last_active': '2023-06-10T18:56:17.270307+0000', 'last_peered': '2023-06-10T18:56:17.270307+0000', 'last_clean': '2023-06-10T18:56:17.270307+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:17.293909+0000', 'last_undegraded': '2023-06-10T18:56:17.293909+0000', 'last_fullsized': '2023-06-10T18:56:17.293909+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-06-10T18:56:23.617 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1c is not active+clean 2023-06-10T18:56:23.618 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:56:18.283809+0000', 'last_change': '2023-06-10T18:56:18.283809+0000', 'last_active': '2023-06-10T18:56:18.283809+0000', 'last_peered': '2023-06-10T18:56:18.283809+0000', 'last_clean': '2023-06-10T18:56:18.283809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:18.283809+0000', 'last_undegraded': '2023-06-10T18:56:18.283809+0000', 'last_fullsized': '2023-06-10T18:56:18.283809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:56:23.618 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.13 is not active+clean 2023-06-10T18:56:23.618 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-06-10T18:56:17.295642+0000', 'last_change': '2023-06-10T18:56:17.295642+0000', 'last_active': '2023-06-10T18:56:17.270307+0000', 'last_peered': '2023-06-10T18:56:17.270307+0000', 'last_clean': '2023-06-10T18:56:17.270307+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:17.295642+0000', 'last_undegraded': '2023-06-10T18:56:17.295642+0000', 'last_fullsized': '2023-06-10T18:56:17.295642+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-06-10T18:56:23.618 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1d is not active+clean 2023-06-10T18:56:23.619 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:56:18.283809+0000', 'last_change': '2023-06-10T18:56:18.283809+0000', 'last_active': '2023-06-10T18:56:18.283809+0000', 'last_peered': '2023-06-10T18:56:18.283809+0000', 'last_clean': '2023-06-10T18:56:18.283809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:18.283809+0000', 'last_undegraded': '2023-06-10T18:56:18.283809+0000', 'last_fullsized': '2023-06-10T18:56:18.283809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:56:23.619 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.12 is not active+clean 2023-06-10T18:56:23.619 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-06-10T18:56:17.294849+0000', 'last_change': '2023-06-10T18:56:17.294849+0000', 'last_active': '2023-06-10T18:56:17.270307+0000', 'last_peered': '2023-06-10T18:56:17.270307+0000', 'last_clean': '2023-06-10T18:56:17.270307+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:17.294849+0000', 'last_undegraded': '2023-06-10T18:56:17.294849+0000', 'last_fullsized': '2023-06-10T18:56:17.294849+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-06-10T18:56:23.620 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1e is not active+clean 2023-06-10T18:56:23.620 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:56:18.283809+0000', 'last_change': '2023-06-10T18:56:18.283809+0000', 'last_active': '2023-06-10T18:56:18.283809+0000', 'last_peered': '2023-06-10T18:56:18.283809+0000', 'last_clean': '2023-06-10T18:56:18.283809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:18.283809+0000', 'last_undegraded': '2023-06-10T18:56:18.283809+0000', 'last_fullsized': '2023-06-10T18:56:18.283809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:56:23.620 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.11 is not active+clean 2023-06-10T18:56:23.621 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-06-10T18:56:17.294831+0000', 'last_change': '2023-06-10T18:56:17.294831+0000', 'last_active': '2023-06-10T18:56:17.270307+0000', 'last_peered': '2023-06-10T18:56:17.270307+0000', 'last_clean': '2023-06-10T18:56:17.270307+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:17.294831+0000', 'last_undegraded': '2023-06-10T18:56:17.294831+0000', 'last_fullsized': '2023-06-10T18:56:17.294831+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-06-10T18:56:23.621 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1f is not active+clean 2023-06-10T18:56:23.621 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:56:18.283809+0000', 'last_change': '2023-06-10T18:56:18.283809+0000', 'last_active': '2023-06-10T18:56:18.283809+0000', 'last_peered': '2023-06-10T18:56:18.283809+0000', 'last_clean': '2023-06-10T18:56:18.283809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:18.283809+0000', 'last_undegraded': '2023-06-10T18:56:18.283809+0000', 'last_fullsized': '2023-06-10T18:56:18.283809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:56:23.622 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.10 is not active+clean 2023-06-10T18:56:23.622 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-06-10T18:56:17.293216+0000', 'last_change': '2023-06-10T18:56:17.293216+0000', 'last_active': '2023-06-10T18:56:17.270307+0000', 'last_peered': '2023-06-10T18:56:17.270307+0000', 'last_clean': '2023-06-10T18:56:17.270307+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:17.293216+0000', 'last_undegraded': '2023-06-10T18:56:17.293216+0000', 'last_fullsized': '2023-06-10T18:56:17.293216+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-06-10T18:56:23.622 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.0 is not active+clean 2023-06-10T18:56:23.622 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:56:18.283809+0000', 'last_change': '2023-06-10T18:56:18.283809+0000', 'last_active': '2023-06-10T18:56:18.283809+0000', 'last_peered': '2023-06-10T18:56:18.283809+0000', 'last_clean': '2023-06-10T18:56:18.283809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:18.283809+0000', 'last_undegraded': '2023-06-10T18:56:18.283809+0000', 'last_fullsized': '2023-06-10T18:56:18.283809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:56:23.623 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.f is not active+clean 2023-06-10T18:56:23.623 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-06-10T18:56:17.295221+0000', 'last_change': '2023-06-10T18:56:17.295221+0000', 'last_active': '2023-06-10T18:56:17.270307+0000', 'last_peered': '2023-06-10T18:56:17.270307+0000', 'last_clean': '2023-06-10T18:56:17.270307+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:17.295221+0000', 'last_undegraded': '2023-06-10T18:56:17.295221+0000', 'last_fullsized': '2023-06-10T18:56:17.295221+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-06-10T18:56:23.623 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1 is not active+clean 2023-06-10T18:56:23.624 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:56:18.283809+0000', 'last_change': '2023-06-10T18:56:18.283809+0000', 'last_active': '2023-06-10T18:56:18.283809+0000', 'last_peered': '2023-06-10T18:56:18.283809+0000', 'last_clean': '2023-06-10T18:56:18.283809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:18.283809+0000', 'last_undegraded': '2023-06-10T18:56:18.283809+0000', 'last_fullsized': '2023-06-10T18:56:18.283809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:56:23.624 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.e is not active+clean 2023-06-10T18:56:23.624 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-06-10T18:56:17.289785+0000', 'last_change': '2023-06-10T18:56:17.289785+0000', 'last_active': '2023-06-10T18:56:17.270307+0000', 'last_peered': '2023-06-10T18:56:17.270307+0000', 'last_clean': '2023-06-10T18:56:17.270307+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:17.289785+0000', 'last_undegraded': '2023-06-10T18:56:17.289785+0000', 'last_fullsized': '2023-06-10T18:56:17.289785+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-06-10T18:56:23.625 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2 is not active+clean 2023-06-10T18:56:23.625 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:56:18.283809+0000', 'last_change': '2023-06-10T18:56:18.283809+0000', 'last_active': '2023-06-10T18:56:18.283809+0000', 'last_peered': '2023-06-10T18:56:18.283809+0000', 'last_clean': '2023-06-10T18:56:18.283809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:18.283809+0000', 'last_undegraded': '2023-06-10T18:56:18.283809+0000', 'last_fullsized': '2023-06-10T18:56:18.283809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:56:23.625 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.d is not active+clean 2023-06-10T18:56:23.625 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-06-10T18:56:17.294974+0000', 'last_change': '2023-06-10T18:56:17.294974+0000', 'last_active': '2023-06-10T18:56:17.270307+0000', 'last_peered': '2023-06-10T18:56:17.270307+0000', 'last_clean': '2023-06-10T18:56:17.270307+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:17.294974+0000', 'last_undegraded': '2023-06-10T18:56:17.294974+0000', 'last_fullsized': '2023-06-10T18:56:17.294974+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-06-10T18:56:23.626 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3 is not active+clean 2023-06-10T18:56:23.626 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:56:18.283809+0000', 'last_change': '2023-06-10T18:56:18.283809+0000', 'last_active': '2023-06-10T18:56:18.283809+0000', 'last_peered': '2023-06-10T18:56:18.283809+0000', 'last_clean': '2023-06-10T18:56:18.283809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:18.283809+0000', 'last_undegraded': '2023-06-10T18:56:18.283809+0000', 'last_fullsized': '2023-06-10T18:56:18.283809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:56:23.626 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.c is not active+clean 2023-06-10T18:56:23.627 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-06-10T18:56:17.296124+0000', 'last_change': '2023-06-10T18:56:17.296124+0000', 'last_active': '2023-06-10T18:56:17.270307+0000', 'last_peered': '2023-06-10T18:56:17.270307+0000', 'last_clean': '2023-06-10T18:56:17.270307+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:17.296124+0000', 'last_undegraded': '2023-06-10T18:56:17.296124+0000', 'last_fullsized': '2023-06-10T18:56:17.296124+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-06-10T18:56:23.627 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.4 is not active+clean 2023-06-10T18:56:23.627 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:56:18.283809+0000', 'last_change': '2023-06-10T18:56:18.283809+0000', 'last_active': '2023-06-10T18:56:18.283809+0000', 'last_peered': '2023-06-10T18:56:18.283809+0000', 'last_clean': '2023-06-10T18:56:18.283809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:18.283809+0000', 'last_undegraded': '2023-06-10T18:56:18.283809+0000', 'last_fullsized': '2023-06-10T18:56:18.283809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:56:23.628 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.b is not active+clean 2023-06-10T18:56:23.628 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-06-10T18:56:17.289645+0000', 'last_change': '2023-06-10T18:56:17.289645+0000', 'last_active': '2023-06-10T18:56:17.270307+0000', 'last_peered': '2023-06-10T18:56:17.270307+0000', 'last_clean': '2023-06-10T18:56:17.270307+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:17.289645+0000', 'last_undegraded': '2023-06-10T18:56:17.289645+0000', 'last_fullsized': '2023-06-10T18:56:17.289645+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-06-10T18:56:23.628 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.5 is not active+clean 2023-06-10T18:56:23.628 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:56:18.283809+0000', 'last_change': '2023-06-10T18:56:18.283809+0000', 'last_active': '2023-06-10T18:56:18.283809+0000', 'last_peered': '2023-06-10T18:56:18.283809+0000', 'last_clean': '2023-06-10T18:56:18.283809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:18.283809+0000', 'last_undegraded': '2023-06-10T18:56:18.283809+0000', 'last_fullsized': '2023-06-10T18:56:18.283809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:56:23.629 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.a is not active+clean 2023-06-10T18:56:23.629 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-06-10T18:56:17.294752+0000', 'last_change': '2023-06-10T18:56:17.294752+0000', 'last_active': '2023-06-10T18:56:17.270307+0000', 'last_peered': '2023-06-10T18:56:17.270307+0000', 'last_clean': '2023-06-10T18:56:17.270307+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:17.294752+0000', 'last_undegraded': '2023-06-10T18:56:17.294752+0000', 'last_fullsized': '2023-06-10T18:56:17.294752+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-06-10T18:56:23.629 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.6 is not active+clean 2023-06-10T18:56:23.630 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:56:18.283809+0000', 'last_change': '2023-06-10T18:56:18.283809+0000', 'last_active': '2023-06-10T18:56:18.283809+0000', 'last_peered': '2023-06-10T18:56:18.283809+0000', 'last_clean': '2023-06-10T18:56:18.283809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:18.283809+0000', 'last_undegraded': '2023-06-10T18:56:18.283809+0000', 'last_fullsized': '2023-06-10T18:56:18.283809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:56:23.630 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.9 is not active+clean 2023-06-10T18:56:23.630 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-06-10T18:56:17.294908+0000', 'last_change': '2023-06-10T18:56:17.294908+0000', 'last_active': '2023-06-10T18:56:17.270307+0000', 'last_peered': '2023-06-10T18:56:17.270307+0000', 'last_clean': '2023-06-10T18:56:17.270307+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:17.294908+0000', 'last_undegraded': '2023-06-10T18:56:17.294908+0000', 'last_fullsized': '2023-06-10T18:56:17.294908+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-06-10T18:56:23.631 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.7 is not active+clean 2023-06-10T18:56:23.631 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:56:18.283809+0000', 'last_change': '2023-06-10T18:56:18.283809+0000', 'last_active': '2023-06-10T18:56:18.283809+0000', 'last_peered': '2023-06-10T18:56:18.283809+0000', 'last_clean': '2023-06-10T18:56:18.283809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:18.283809+0000', 'last_undegraded': '2023-06-10T18:56:18.283809+0000', 'last_fullsized': '2023-06-10T18:56:18.283809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:56:23.631 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.8 is not active+clean 2023-06-10T18:56:23.631 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-06-10T18:56:17.289886+0000', 'last_change': '2023-06-10T18:56:17.289886+0000', 'last_active': '2023-06-10T18:56:17.270307+0000', 'last_peered': '2023-06-10T18:56:17.270307+0000', 'last_clean': '2023-06-10T18:56:17.270307+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:17.289886+0000', 'last_undegraded': '2023-06-10T18:56:17.289886+0000', 'last_fullsized': '2023-06-10T18:56:17.289886+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-06-10T18:56:23.632 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.9 is not active+clean 2023-06-10T18:56:23.632 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:56:18.283809+0000', 'last_change': '2023-06-10T18:56:18.283809+0000', 'last_active': '2023-06-10T18:56:18.283809+0000', 'last_peered': '2023-06-10T18:56:18.283809+0000', 'last_clean': '2023-06-10T18:56:18.283809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:18.283809+0000', 'last_undegraded': '2023-06-10T18:56:18.283809+0000', 'last_fullsized': '2023-06-10T18:56:18.283809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:56:23.632 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.6 is not active+clean 2023-06-10T18:56:23.633 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-06-10T18:56:17.294982+0000', 'last_change': '2023-06-10T18:56:17.294982+0000', 'last_active': '2023-06-10T18:56:17.270307+0000', 'last_peered': '2023-06-10T18:56:17.270307+0000', 'last_clean': '2023-06-10T18:56:17.270307+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:17.294982+0000', 'last_undegraded': '2023-06-10T18:56:17.294982+0000', 'last_fullsized': '2023-06-10T18:56:17.294982+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-06-10T18:56:23.633 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.a is not active+clean 2023-06-10T18:56:23.633 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:56:18.283809+0000', 'last_change': '2023-06-10T18:56:18.283809+0000', 'last_active': '2023-06-10T18:56:18.283809+0000', 'last_peered': '2023-06-10T18:56:18.283809+0000', 'last_clean': '2023-06-10T18:56:18.283809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:18.283809+0000', 'last_undegraded': '2023-06-10T18:56:18.283809+0000', 'last_fullsized': '2023-06-10T18:56:18.283809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:56:23.634 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.5 is not active+clean 2023-06-10T18:56:23.634 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-06-10T18:56:17.300199+0000', 'last_change': '2023-06-10T18:56:17.300199+0000', 'last_active': '2023-06-10T18:56:17.270307+0000', 'last_peered': '2023-06-10T18:56:17.270307+0000', 'last_clean': '2023-06-10T18:56:17.270307+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:17.300199+0000', 'last_undegraded': '2023-06-10T18:56:17.300199+0000', 'last_fullsized': '2023-06-10T18:56:17.300199+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-06-10T18:56:23.634 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.b is not active+clean 2023-06-10T18:56:23.635 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:56:18.283809+0000', 'last_change': '2023-06-10T18:56:18.283809+0000', 'last_active': '2023-06-10T18:56:18.283809+0000', 'last_peered': '2023-06-10T18:56:18.283809+0000', 'last_clean': '2023-06-10T18:56:18.283809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:18.283809+0000', 'last_undegraded': '2023-06-10T18:56:18.283809+0000', 'last_fullsized': '2023-06-10T18:56:18.283809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:56:23.635 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.4 is not active+clean 2023-06-10T18:56:23.635 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-06-10T18:56:17.295569+0000', 'last_change': '2023-06-10T18:56:17.295569+0000', 'last_active': '2023-06-10T18:56:17.270307+0000', 'last_peered': '2023-06-10T18:56:17.270307+0000', 'last_clean': '2023-06-10T18:56:17.270307+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:17.295569+0000', 'last_undegraded': '2023-06-10T18:56:17.295569+0000', 'last_fullsized': '2023-06-10T18:56:17.295569+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-06-10T18:56:23.635 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.8 is not active+clean 2023-06-10T18:56:23.636 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:56:18.283809+0000', 'last_change': '2023-06-10T18:56:18.283809+0000', 'last_active': '2023-06-10T18:56:18.283809+0000', 'last_peered': '2023-06-10T18:56:18.283809+0000', 'last_clean': '2023-06-10T18:56:18.283809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:18.283809+0000', 'last_undegraded': '2023-06-10T18:56:18.283809+0000', 'last_fullsized': '2023-06-10T18:56:18.283809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:56:23.636 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.7 is not active+clean 2023-06-10T18:56:23.636 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-06-10T18:56:17.296581+0000', 'last_change': '2023-06-10T18:56:17.296581+0000', 'last_active': '2023-06-10T18:56:17.270307+0000', 'last_peered': '2023-06-10T18:56:17.270307+0000', 'last_clean': '2023-06-10T18:56:17.270307+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:17.296581+0000', 'last_undegraded': '2023-06-10T18:56:17.296581+0000', 'last_fullsized': '2023-06-10T18:56:17.296581+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-06-10T18:56:23.637 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.e is not active+clean 2023-06-10T18:56:23.637 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:56:18.283809+0000', 'last_change': '2023-06-10T18:56:18.283809+0000', 'last_active': '2023-06-10T18:56:18.283809+0000', 'last_peered': '2023-06-10T18:56:18.283809+0000', 'last_clean': '2023-06-10T18:56:18.283809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:18.283809+0000', 'last_undegraded': '2023-06-10T18:56:18.283809+0000', 'last_fullsized': '2023-06-10T18:56:18.283809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:56:23.637 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1 is not active+clean 2023-06-10T18:56:23.638 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-06-10T18:56:17.289523+0000', 'last_change': '2023-06-10T18:56:17.289523+0000', 'last_active': '2023-06-10T18:56:17.270307+0000', 'last_peered': '2023-06-10T18:56:17.270307+0000', 'last_clean': '2023-06-10T18:56:17.270307+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:17.289523+0000', 'last_undegraded': '2023-06-10T18:56:17.289523+0000', 'last_fullsized': '2023-06-10T18:56:17.289523+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-06-10T18:56:23.638 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.f is not active+clean 2023-06-10T18:56:23.638 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:56:18.283809+0000', 'last_change': '2023-06-10T18:56:18.283809+0000', 'last_active': '2023-06-10T18:56:18.283809+0000', 'last_peered': '2023-06-10T18:56:18.283809+0000', 'last_clean': '2023-06-10T18:56:18.283809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:18.283809+0000', 'last_undegraded': '2023-06-10T18:56:18.283809+0000', 'last_fullsized': '2023-06-10T18:56:18.283809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:56:23.639 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.0 is not active+clean 2023-06-10T18:56:23.639 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-06-10T18:56:17.295123+0000', 'last_change': '2023-06-10T18:56:17.295123+0000', 'last_active': '2023-06-10T18:56:17.270307+0000', 'last_peered': '2023-06-10T18:56:17.270307+0000', 'last_clean': '2023-06-10T18:56:17.270307+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:17.295123+0000', 'last_undegraded': '2023-06-10T18:56:17.295123+0000', 'last_fullsized': '2023-06-10T18:56:17.295123+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-06-10T18:56:23.639 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.c is not active+clean 2023-06-10T18:56:23.639 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:56:18.283809+0000', 'last_change': '2023-06-10T18:56:18.283809+0000', 'last_active': '2023-06-10T18:56:18.283809+0000', 'last_peered': '2023-06-10T18:56:18.283809+0000', 'last_clean': '2023-06-10T18:56:18.283809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:18.283809+0000', 'last_undegraded': '2023-06-10T18:56:18.283809+0000', 'last_fullsized': '2023-06-10T18:56:18.283809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:56:23.640 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3 is not active+clean 2023-06-10T18:56:23.640 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-06-10T18:56:17.293534+0000', 'last_change': '2023-06-10T18:56:17.293534+0000', 'last_active': '2023-06-10T18:56:17.270307+0000', 'last_peered': '2023-06-10T18:56:17.270307+0000', 'last_clean': '2023-06-10T18:56:17.270307+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:17.293534+0000', 'last_undegraded': '2023-06-10T18:56:17.293534+0000', 'last_fullsized': '2023-06-10T18:56:17.293534+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-06-10T18:56:23.640 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.d is not active+clean 2023-06-10T18:56:23.641 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:56:18.283809+0000', 'last_change': '2023-06-10T18:56:18.283809+0000', 'last_active': '2023-06-10T18:56:18.283809+0000', 'last_peered': '2023-06-10T18:56:18.283809+0000', 'last_clean': '2023-06-10T18:56:18.283809+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:18.283809+0000', 'last_undegraded': '2023-06-10T18:56:18.283809+0000', 'last_fullsized': '2023-06-10T18:56:18.283809+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:56:23.641 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2 is not active+clean 2023-06-10T18:56:23.641 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2023-06-10T18:56:17.293226+0000', 'last_change': '2023-06-10T18:56:17.293226+0000', 'last_active': '2023-06-10T18:56:17.270307+0000', 'last_peered': '2023-06-10T18:56:17.270307+0000', 'last_clean': '2023-06-10T18:56:17.270307+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:56:17.293226+0000', 'last_undegraded': '2023-06-10T18:56:17.293226+0000', 'last_fullsized': '2023-06-10T18:56:17.293226+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:17.270307+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-06-10T18:56:23.642 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-06-10T18:56:23.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.763+0000 7f36aa5c5640 1 Processor -- start 2023-06-10T18:56:23.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.763+0000 7f36aa5c5640 1 -- start start 2023-06-10T18:56:23.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.763+0000 7f36aa5c5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36a415cdb0 0x7f36a40b30e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:23.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.763+0000 7f36aa5c5640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f36a4071060 0x7f36a40b3620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:23.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.763+0000 7f36aa5c5640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36a406c620 con 0x7f36a40c9840 2023-06-10T18:56:23.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.763+0000 7f36aa5c5640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36a40702a0 con 0x7f36a4071060 2023-06-10T18:56:23.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.763+0000 7f36aa5c5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36a4070580 con 0x7f36a415cdb0 2023-06-10T18:56:23.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.763+0000 7f36a8b62640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f36a40c9840 0x7f36a406b090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:54042/0 (socket says 172.21.15.53:54042) 2023-06-10T18:56:23.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.763+0000 7f36a8b62640 1 -- 172.21.15.53:0/3715410400 learned_addr learned my addr 172.21.15.53:0/3715410400 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:56:23.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.763+0000 7f36a3fff640 1 --2- 172.21.15.53:0/3715410400 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36a415cdb0 0x7f36a40b30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:23.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.763+0000 7f369bfff640 1 --2- 172.21.15.53:0/3715410400 >> v2:172.21.15.117:3300/0 conn(0x7f36a4071060 0x7f36a40b3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:23.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.767+0000 7f36a37fe640 1 -- 172.21.15.53:0/3715410400 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1575229109 0 0) 0x7f36a406c620 con 0x7f36a40c9840 2023-06-10T18:56:23.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.767+0000 7f36a37fe640 1 -- 172.21.15.53:0/3715410400 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3690003530 con 0x7f36a40c9840 2023-06-10T18:56:23.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.767+0000 7f36a37fe640 1 -- 172.21.15.53:0/3715410400 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 586664968 0 0) 0x7f3690003530 con 0x7f36a40c9840 2023-06-10T18:56:23.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.767+0000 7f36a37fe640 1 -- 172.21.15.53:0/3715410400 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36a415cdb0 msgr2=0x7f36a40b30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:23.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.767+0000 7f36a37fe640 1 --2- 172.21.15.53:0/3715410400 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36a415cdb0 0x7f36a40b30e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:23.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.767+0000 7f36a37fe640 1 -- 172.21.15.53:0/3715410400 >> v2:172.21.15.117:3300/0 conn(0x7f36a4071060 msgr2=0x7f36a40b3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:23.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.767+0000 7f36a37fe640 1 --2- 172.21.15.53:0/3715410400 >> v2:172.21.15.117:3300/0 conn(0x7f36a4071060 0x7f36a40b3620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:23.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.767+0000 7f36a37fe640 1 -- 172.21.15.53:0/3715410400 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a4070860 con 0x7f36a40c9840 2023-06-10T18:56:23.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.767+0000 7f36a37fe640 1 -- 172.21.15.53:0/3715410400 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f369c001a00 con 0x7f36a40c9840 2023-06-10T18:56:23.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.767+0000 7f36a37fe640 1 -- 172.21.15.53:0/3715410400 >> v1:172.21.15.53:6789/0 conn(0x7f36a40c9840 legacy=0x7f36a406b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:23.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.767+0000 7f36a37fe640 1 --2- 172.21.15.53:0/3715410400 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36900039f0 0x7f3690003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:23.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.767+0000 7f36a37fe640 1 --2- 172.21.15.53:0/3715410400 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36900047d0 0x7f3690004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:23.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.767+0000 7f36a37fe640 1 --2- 172.21.15.53:0/3715410400 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36a415cdb0 0x7f3690005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:23.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.767+0000 7f36a37fe640 1 -- 172.21.15.53:0/3715410400 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a40702a0 con 0x7f36900047d0 2023-06-10T18:56:23.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.767+0000 7f36a37fe640 1 -- 172.21.15.53:0/3715410400 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a4070580 con 0x7f36900039f0 2023-06-10T18:56:23.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.767+0000 7f36a37fe640 1 -- 172.21.15.53:0/3715410400 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f369000b990 con 0x7f36a415cdb0 2023-06-10T18:56:23.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.767+0000 7f369bfff640 1 --2- 172.21.15.53:0/3715410400 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36900047d0 0x7f3690004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:23.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.767+0000 7f36a3fff640 1 --2- 172.21.15.53:0/3715410400 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36900039f0 0x7f3690003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:23.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.767+0000 7f36a8b62640 1 --2- 172.21.15.53:0/3715410400 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36a415cdb0 0x7f3690005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:23.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.767+0000 7f369bfff640 1 -- 172.21.15.53:0/3715410400 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36a415cdb0 msgr2=0x7f3690005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:23.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.767+0000 7f369bfff640 1 --2- 172.21.15.53:0/3715410400 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36a415cdb0 0x7f3690005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:23.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.767+0000 7f369bfff640 1 -- 172.21.15.53:0/3715410400 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36900039f0 msgr2=0x7f3690003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:23.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.767+0000 7f369bfff640 1 --2- 172.21.15.53:0/3715410400 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36900039f0 0x7f3690003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:23.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.767+0000 7f369bfff640 1 -- 172.21.15.53:0/3715410400 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3690003530 con 0x7f36900047d0 2023-06-10T18:56:23.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.767+0000 7f369bfff640 1 --2- 172.21.15.53:0/3715410400 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36900047d0 0x7f3690004c40 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f368c009ab0 tx=0x7f368c01ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=200e04e4708eba15 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:23.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.767+0000 7f36a37fe640 1 -- 172.21.15.53:0/3715410400 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f368c0a5550 con 0x7f36900047d0 2023-06-10T18:56:23.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.767+0000 7f36a37fe640 1 -- 172.21.15.53:0/3715410400 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f368c0a56b0 con 0x7f36900047d0 2023-06-10T18:56:23.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.767+0000 7f36a37fe640 1 -- 172.21.15.53:0/3715410400 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f368c0a5a60 con 0x7f36900047d0 2023-06-10T18:56:23.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.767+0000 7f36aa5c5640 1 -- 172.21.15.53:0/3715410400 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36900047d0 msgr2=0x7f3690004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:23.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.767+0000 7f36aa5c5640 1 --2- 172.21.15.53:0/3715410400 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36900047d0 0x7f3690004c40 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f368c009ab0 tx=0x7f368c01ca70 comp rx=0 tx=0).stop 2023-06-10T18:56:23.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.767+0000 7f36a8b62640 1 -- 172.21.15.53:0/3715410400 reap_dead start 2023-06-10T18:56:23.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.767+0000 7f36aa5c5640 1 -- 172.21.15.53:0/3715410400 shutdown_connections 2023-06-10T18:56:23.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.767+0000 7f36aa5c5640 1 -- 172.21.15.53:0/3715410400 >> 172.21.15.53:0/3715410400 conn(0x7f36a406a0d0 msgr2=0x7f36a40ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:23.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.767+0000 7f36aa5c5640 1 -- 172.21.15.53:0/3715410400 shutdown_connections 2023-06-10T18:56:23.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.767+0000 7f36aa5c5640 1 -- 172.21.15.53:0/3715410400 wait complete. 2023-06-10T18:56:23.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.771+0000 7f36aa5c5640 1 Processor -- start 2023-06-10T18:56:23.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.771+0000 7f36aa5c5640 1 -- start start 2023-06-10T18:56:23.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.771+0000 7f36aa5c5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36900047d0 0x7f36a4153e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:23.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.771+0000 7f36aa5c5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36a40cd440 0x7f36a40c3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:23.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.771+0000 7f36aa5c5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36a41558a0 0x7f36a414fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:23.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.771+0000 7f36aa5c5640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a4154800 con 0x7f36a40cd440 2023-06-10T18:56:23.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.771+0000 7f36aa5c5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a4154ae0 con 0x7f36900047d0 2023-06-10T18:56:23.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.771+0000 7f36aa5c5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36a4154dc0 con 0x7f36a41558a0 2023-06-10T18:56:23.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.771+0000 7f369bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36a40cd440 0x7f36a40c3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:23.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.771+0000 7f369bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36a40cd440 0x7f36a40c3a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59260/0 (socket says 172.21.15.53:59260) 2023-06-10T18:56:23.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.771+0000 7f369bfff640 1 -- 172.21.15.53:0/2387918752 learned_addr learned my addr 172.21.15.53:0/2387918752 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:23.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.771+0000 7f36a8b62640 1 --2- 172.21.15.53:0/2387918752 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36a41558a0 0x7f36a414fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:23.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.771+0000 7f36a3fff640 1 --2- 172.21.15.53:0/2387918752 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36900047d0 0x7f36a4153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:23.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.771+0000 7f369bfff640 1 -- 172.21.15.53:0/2387918752 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36a41558a0 msgr2=0x7f36a414fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:23.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.771+0000 7f369bfff640 1 --2- 172.21.15.53:0/2387918752 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36a41558a0 0x7f36a414fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:23.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.771+0000 7f369bfff640 1 -- 172.21.15.53:0/2387918752 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36900047d0 msgr2=0x7f36a4153e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:23.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.771+0000 7f369bfff640 1 --2- 172.21.15.53:0/2387918752 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36900047d0 0x7f36a4153e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:23.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.771+0000 7f369bfff640 1 -- 172.21.15.53:0/2387918752 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a41550a0 con 0x7f36a40cd440 2023-06-10T18:56:23.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.771+0000 7f369bfff640 1 --2- 172.21.15.53:0/2387918752 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36a40cd440 0x7f36a40c3a70 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f368c009ab0 tx=0x7f3690005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:23.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.771+0000 7f36a17fa640 1 -- 172.21.15.53:0/2387918752 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f368c0be070 con 0x7f36a40cd440 2023-06-10T18:56:23.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.771+0000 7f36a17fa640 1 -- 172.21.15.53:0/2387918752 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f368c00f0c0 con 0x7f36a40cd440 2023-06-10T18:56:23.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.771+0000 7f36aa5c5640 1 -- 172.21.15.53:0/2387918752 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36a4155380 con 0x7f36a40cd440 2023-06-10T18:56:23.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.771+0000 7f36a17fa640 1 -- 172.21.15.53:0/2387918752 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f368c004220 con 0x7f36a40cd440 2023-06-10T18:56:23.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.771+0000 7f36aa5c5640 1 -- 172.21.15.53:0/2387918752 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36a41545a0 con 0x7f36a40cd440 2023-06-10T18:56:23.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.771+0000 7f36aa5c5640 1 -- 172.21.15.53:0/2387918752 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36a4155510 con 0x7f36a40cd440 2023-06-10T18:56:23.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.775+0000 7f36a17fa640 1 -- 172.21.15.53:0/2387918752 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f368c0b4040 con 0x7f36a40cd440 2023-06-10T18:56:23.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.775+0000 7f36a17fa640 1 --2- 172.21.15.53:0/2387918752 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3684066280 0x7f3684068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:23.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.775+0000 7f36a17fa640 1 -- 172.21.15.53:0/2387918752 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f368c11daf0 con 0x7f36a40cd440 2023-06-10T18:56:23.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.775+0000 7f36a3fff640 1 --2- 172.21.15.53:0/2387918752 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3684066280 0x7f3684068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:23.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.775+0000 7f36a3fff640 1 --2- 172.21.15.53:0/2387918752 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3684066280 0x7f3684068730 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3694009a40 tx=0x7f3694008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:23.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.779+0000 7f36a17fa640 1 -- 172.21.15.53:0/2387918752 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f368c0eaf60 con 0x7f36a40cd440 2023-06-10T18:56:23.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.987+0000 7f36aa5c5640 1 -- 172.21.15.53:0/2387918752 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f36a404d790 con 0x7f36a40cd440 2023-06-10T18:56:23.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.987+0000 7f36a17fa640 1 -- 172.21.15.53:0/2387918752 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1014 (secure 0 0 0) 0x7f368c0ee580 con 0x7f36a40cd440 2023-06-10T18:56:23.994 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:56:23.994 INFO:teuthology.orchestra.run.smithi053.stdout:{"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":242,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":51,"num_osds":8,"num_up_osds":8,"osd_up_since":1686423152,"num_in_osds":8,"osd_in_since":1686423143,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":23,"data_bytes":592730,"bytes_used":243625984,"bytes_avail":772850487296,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":20,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"c","status":"up:active","gid":5931}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2023-06-10T18:54:59.607497+0000","services":{}},"progress_events":{}} 2023-06-10T18:56:23.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.991+0000 7f36aa5c5640 1 -- 172.21.15.53:0/2387918752 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3684066280 msgr2=0x7f3684068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:23.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.991+0000 7f36aa5c5640 1 --2- 172.21.15.53:0/2387918752 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3684066280 0x7f3684068730 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3694009a40 tx=0x7f3694008040 comp rx=0 tx=0).stop 2023-06-10T18:56:23.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.991+0000 7f36aa5c5640 1 -- 172.21.15.53:0/2387918752 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36a40cd440 msgr2=0x7f36a40c3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:23.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.991+0000 7f36aa5c5640 1 --2- 172.21.15.53:0/2387918752 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36a40cd440 0x7f36a40c3a70 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f368c009ab0 tx=0x7f3690005800 comp rx=0 tx=0).stop 2023-06-10T18:56:23.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.991+0000 7f36aa5c5640 1 -- 172.21.15.53:0/2387918752 shutdown_connections 2023-06-10T18:56:23.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.991+0000 7f36aa5c5640 1 --2- 172.21.15.53:0/2387918752 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3684066280 0x7f3684068730 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:23.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.991+0000 7f36aa5c5640 1 --2- 172.21.15.53:0/2387918752 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36a41558a0 0x7f36a414fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:23.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.991+0000 7f36aa5c5640 1 --2- 172.21.15.53:0/2387918752 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36a40cd440 0x7f36a40c3a70 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:23.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.991+0000 7f36aa5c5640 1 --2- 172.21.15.53:0/2387918752 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36900047d0 0x7f36a4153e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:23.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.991+0000 7f36aa5c5640 1 -- 172.21.15.53:0/2387918752 >> 172.21.15.53:0/2387918752 conn(0x7f36a406a0d0 msgr2=0x7f36a40b0ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:23.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.991+0000 7f36aa5c5640 1 -- 172.21.15.53:0/2387918752 shutdown_connections 2023-06-10T18:56:23.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:23.991+0000 7f36aa5c5640 1 -- 172.21.15.53:0/2387918752 wait complete. 2023-06-10T18:56:24.013 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-06-10T18:56:24.014 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-10T18:56:24.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:24.127+0000 7f4b2151d640 1 Processor -- start 2023-06-10T18:56:24.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:24.127+0000 7f4b2151d640 1 -- start start 2023-06-10T18:56:24.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:24.131+0000 7f4b2151d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b1c0b3390 0x7f4b1c0af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:24.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:24.131+0000 7f4b2151d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4b1c070e30 0x7f4b1c0c8d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:24.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:24.131+0000 7f4b2151d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b1c0b3760 con 0x7f4b1c0c9240 2023-06-10T18:56:24.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:24.131+0000 7f4b2151d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b1c0c82f0 con 0x7f4b1c070e30 2023-06-10T18:56:24.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:24.131+0000 7f4b2151d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1c071280 con 0x7f4b1c0b3390 2023-06-10T18:56:24.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:24.131+0000 7f4b1affd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b1c0b3390 0x7f4b1c0af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:24.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:24.131+0000 7f4b1a7fc640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4b1c070e30 0x7f4b1c0c8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:24.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:24.131+0000 7f4b1b7fe640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f4b1c0c9240 0x7f4b1c06b090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.53:46560/0 (socket says 172.21.15.53:46560) 2023-06-10T18:56:24.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:24.131+0000 7f4b1b7fe640 1 -- 172.21.15.53:0/3527164007 learned_addr learned my addr 172.21.15.53:0/3527164007 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:56:24.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:24.131+0000 7f4b1affd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b1c0b3390 0x7f4b1c0af720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.53:46654/0 (socket says 172.21.15.53:46654) 2023-06-10T18:56:24.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:24.131+0000 7f4b1affd640 1 -- 172.21.15.53:0/3527164007 >> v2:172.21.15.117:3300/0 conn(0x7f4b1c070e30 msgr2=0x7f4b1c0c8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:24.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:24.131+0000 7f4b1affd640 1 --2- 172.21.15.53:0/3527164007 >> v2:172.21.15.117:3300/0 conn(0x7f4b1c070e30 0x7f4b1c0c8d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:24.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:24.131+0000 7f4b1affd640 1 -- 172.21.15.53:0/3527164007 >> v1:172.21.15.117:6789/0 conn(0x7f4b1c0c9240 legacy=0x7f4b1c06b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:24.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:24.131+0000 7f4b1affd640 1 -- 172.21.15.53:0/3527164007 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b1c0afe20 con 0x7f4b1c0b3390 2023-06-10T18:56:24.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:24.131+0000 7f4b19ffb640 1 -- 172.21.15.53:0/3527164007 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 557320755 0 0) 0x7f4b1c0b3760 con 0x7f4b1c0c9240 2023-06-10T18:56:24.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:24.131+0000 7f4b1a7fc640 1 --2- 172.21.15.53:0/3527164007 >> v2:172.21.15.117:3300/0 conn(0x7f4b1c070e30 0x7f4b1c0c8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-10T18:56:24.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:24.131+0000 7f4b1affd640 1 --2- 172.21.15.53:0/3527164007 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b1c0b3390 0x7f4b1c0af720 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c0097c0 tx=0x7f4b0c01c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7bddab393cb3b26c server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:24.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:24.135+0000 7f4b19ffb640 1 -- 172.21.15.53:0/3527164007 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c0ab680 con 0x7f4b1c0b3390 2023-06-10T18:56:24.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:24.135+0000 7f4b19ffb640 1 -- 172.21.15.53:0/3527164007 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b0c0ab7e0 con 0x7f4b1c0b3390 2023-06-10T18:56:24.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:24.135+0000 7f4b19ffb640 1 -- 172.21.15.53:0/3527164007 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c0abb70 con 0x7f4b1c0b3390 2023-06-10T18:56:24.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:24.135+0000 7f4b2151d640 1 -- 172.21.15.53:0/3527164007 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b1c0b3390 msgr2=0x7f4b1c0af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:24.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:24.135+0000 7f4b2151d640 1 --2- 172.21.15.53:0/3527164007 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b1c0b3390 0x7f4b1c0af720 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c0097c0 tx=0x7f4b0c01c480 comp rx=0 tx=0).stop 2023-06-10T18:56:24.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:24.135+0000 7f4b2151d640 1 -- 172.21.15.53:0/3527164007 shutdown_connections 2023-06-10T18:56:24.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:24.135+0000 7f4b2151d640 1 --2- 172.21.15.53:0/3527164007 >> v2:172.21.15.117:3300/0 conn(0x7f4b1c070e30 0x7f4b1c0c8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:24.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:24.135+0000 7f4b2151d640 1 --2- 172.21.15.53:0/3527164007 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b1c0b3390 0x7f4b1c0af720 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:24.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:24.135+0000 7f4b2151d640 1 -- 172.21.15.53:0/3527164007 >> 172.21.15.53:0/3527164007 conn(0x7f4b1c06a0d0 msgr2=0x7f4b1c0ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:24.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:24.135+0000 7f4b2151d640 1 -- 172.21.15.53:0/3527164007 shutdown_connections 2023-06-10T18:56:24.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:24.135+0000 7f4b2151d640 1 -- 172.21.15.53:0/3527164007 wait complete. 2023-06-10T18:56:24.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:24.135+0000 7f4b2151d640 1 Processor -- start 2023-06-10T18:56:24.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:24.135+0000 7f4b2151d640 1 -- start start 2023-06-10T18:56:24.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:24.135+0000 7f4b2151d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4b1c070e30 0x7f4b1c0c17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:24.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:24.135+0000 7f4b2151d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b1c0b3390 0x7f4b1c149050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:24.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:24.135+0000 7f4b2151d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b1c0c9240 0x7f4b1c0c5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:24.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:24.135+0000 7f4b2151d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1c0c46d0 con 0x7f4b1c070e30 2023-06-10T18:56:24.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:24.135+0000 7f4b2151d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1c0c3e40 con 0x7f4b1c0b3390 2023-06-10T18:56:24.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:24.135+0000 7f4b2151d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1c0c4110 con 0x7f4b1c0c9240 2023-06-10T18:56:24.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:24.135+0000 7f4b1affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4b1c070e30 0x7f4b1c0c17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:24.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:24.139+0000 7f4b1affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4b1c070e30 0x7f4b1c0c17d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59264/0 (socket says 172.21.15.53:59264) 2023-06-10T18:56:24.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:24.139+0000 7f4b1affd640 1 -- 172.21.15.53:0/3505339480 learned_addr learned my addr 172.21.15.53:0/3505339480 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:24.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:24.139+0000 7f4b1a7fc640 1 --2- 172.21.15.53:0/3505339480 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b1c0b3390 0x7f4b1c149050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:24.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:24.139+0000 7f4b1b7fe640 1 --2- 172.21.15.53:0/3505339480 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b1c0c9240 0x7f4b1c0c5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:24.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:24.139+0000 7f4b1affd640 1 -- 172.21.15.53:0/3505339480 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b1c0c9240 msgr2=0x7f4b1c0c5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:24.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:24.139+0000 7f4b1affd640 1 --2- 172.21.15.53:0/3505339480 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b1c0c9240 0x7f4b1c0c5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:24.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:24.139+0000 7f4b1affd640 1 -- 172.21.15.53:0/3505339480 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b1c0b3390 msgr2=0x7f4b1c149050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:24.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:24.139+0000 7f4b1affd640 1 --2- 172.21.15.53:0/3505339480 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b1c0b3390 0x7f4b1c149050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:24.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:24.139+0000 7f4b1affd640 1 -- 172.21.15.53:0/3505339480 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b10009420 con 0x7f4b1c070e30 2023-06-10T18:56:24.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:24.139+0000 7f4b1affd640 1 --2- 172.21.15.53:0/3505339480 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4b1c070e30 0x7f4b1c0c17d0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c0097c0 tx=0x7f4b0c01acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:24.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:24.139+0000 7f4b037fe640 1 -- 172.21.15.53:0/3505339480 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c004220 con 0x7f4b1c070e30 2023-06-10T18:56:24.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:24.139+0000 7f4b037fe640 1 -- 172.21.15.53:0/3505339480 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b0c0b9070 con 0x7f4b1c070e30 2023-06-10T18:56:24.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:24.139+0000 7f4b037fe640 1 -- 172.21.15.53:0/3505339480 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c003620 con 0x7f4b1c070e30 2023-06-10T18:56:24.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:24.139+0000 7f4b2151d640 1 -- 172.21.15.53:0/3505339480 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b0c009420 con 0x7f4b1c070e30 2023-06-10T18:56:24.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:24.139+0000 7f4b2151d640 1 -- 172.21.15.53:0/3505339480 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b1c0b0b70 con 0x7f4b1c070e30 2023-06-10T18:56:24.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:24.139+0000 7f4b2151d640 1 -- 172.21.15.53:0/3505339480 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b1c0b0d60 con 0x7f4b1c070e30 2023-06-10T18:56:24.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:24.139+0000 7f4b037fe640 1 -- 172.21.15.53:0/3505339480 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4b0c003780 con 0x7f4b1c070e30 2023-06-10T18:56:24.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:24.139+0000 7f4b037fe640 1 --2- 172.21.15.53:0/3505339480 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4b08066280 0x7f4b08068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:24.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:24.139+0000 7f4b037fe640 1 -- 172.21.15.53:0/3505339480 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4b0c0bb070 con 0x7f4b1c070e30 2023-06-10T18:56:24.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:24.139+0000 7f4b1a7fc640 1 --2- 172.21.15.53:0/3505339480 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4b08066280 0x7f4b08068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:24.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:24.143+0000 7f4b1a7fc640 1 --2- 172.21.15.53:0/3505339480 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4b08066280 0x7f4b08068730 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c070e00 tx=0x7f4b10009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:24.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:24.147+0000 7f4b037fe640 1 -- 172.21.15.53:0/3505339480 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4b0c0ebdd0 con 0x7f4b1c070e30 2023-06-10T18:56:24.273 INFO:tasks.ceph.mds.c.smithi053.stderr:2023-06-10T18:56:24.267+0000 7faad20a8640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-06-10T18:56:24.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:24.299+0000 7f4b2151d640 1 -- 172.21.15.53:0/3505339480 --> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4b1c0c87e0 con 0x7f4b08066280 2023-06-10T18:56:24.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:24.323+0000 7f4b037fe640 1 -- 172.21.15.53:0/3505339480 <== mgr.4105 v2:172.21.15.117:6832/3061986771 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+309271 (secure 0 0 0) 0x7f4b100098a0 con 0x7f4b08066280 2023-06-10T18:56:24.329 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:56:24.330 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-06-10T18:56:24.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:24.327+0000 7f4b2151d640 1 -- 172.21.15.53:0/3505339480 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4b08066280 msgr2=0x7f4b08068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:24.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:24.327+0000 7f4b2151d640 1 --2- 172.21.15.53:0/3505339480 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4b08066280 0x7f4b08068730 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c070e00 tx=0x7f4b10009190 comp rx=0 tx=0).stop 2023-06-10T18:56:24.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:24.327+0000 7f4b2151d640 1 -- 172.21.15.53:0/3505339480 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4b1c070e30 msgr2=0x7f4b1c0c17d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:24.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:24.327+0000 7f4b2151d640 1 --2- 172.21.15.53:0/3505339480 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4b1c070e30 0x7f4b1c0c17d0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c0097c0 tx=0x7f4b0c01acc0 comp rx=0 tx=0).stop 2023-06-10T18:56:24.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:24.327+0000 7f4b2151d640 1 -- 172.21.15.53:0/3505339480 shutdown_connections 2023-06-10T18:56:24.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:24.327+0000 7f4b2151d640 1 --2- 172.21.15.53:0/3505339480 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4b08066280 0x7f4b08068730 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:24.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:24.327+0000 7f4b2151d640 1 --2- 172.21.15.53:0/3505339480 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b1c0c9240 0x7f4b1c0c5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:24.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:24.327+0000 7f4b2151d640 1 --2- 172.21.15.53:0/3505339480 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b1c0b3390 0x7f4b1c149050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:24.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:24.327+0000 7f4b2151d640 1 --2- 172.21.15.53:0/3505339480 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4b1c070e30 0x7f4b1c0c17d0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:24.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:24.327+0000 7f4b2151d640 1 -- 172.21.15.53:0/3505339480 >> 172.21.15.53:0/3505339480 conn(0x7f4b1c06a0d0 msgr2=0x7f4b1c06b090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:24.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:24.327+0000 7f4b2151d640 1 -- 172.21.15.53:0/3505339480 shutdown_connections 2023-06-10T18:56:24.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:24.327+0000 7f4b2151d640 1 -- 172.21.15.53:0/3505339480 wait complete. 2023-06-10T18:56:24.348 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":160,"stamp":"2023-06-10T18:56:23.638756+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":202,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237916,"kb_used_data":5916,"kb_used_omap":0,"kb_used_meta":231936,"kb_avail":754736804,"statfs":{"total":773094113280,"available":772850487296,"internally_reserved":0,"allocated":6057984,"data_stored":3269763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":237502464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":68,"apply_latency_ms":68,"commit_latency_ns":68000000,"apply_latency_ns":68000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001867"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:20.025031+0000","last_change":"2023-06-10T18:56:18.723557+0000","last_active":"2023-06-10T18:56:20.025031+0000","last_peered":"2023-06-10T18:56:20.025031+0000","last_clean":"2023-06-10T18:56:20.025031+0000","last_became_active":"2023-06-10T18:56:18.723169+0000","last_became_peered":"2023-06-10T18:56:18.723169+0000","last_unstale":"2023-06-10T18:56:20.025031+0000","last_undegraded":"2023-06-10T18:56:20.025031+0000","last_fullsized":"2023-06-10T18:56:20.025031+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:22:08.409137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:20.024783+0000","last_change":"2023-06-10T18:56:18.739659+0000","last_active":"2023-06-10T18:56:20.024783+0000","last_peered":"2023-06-10T18:56:20.024783+0000","last_clean":"2023-06-10T18:56:20.024783+0000","last_became_active":"2023-06-10T18:56:18.738930+0000","last_became_peered":"2023-06-10T18:56:18.738930+0000","last_unstale":"2023-06-10T18:56:20.024783+0000","last_undegraded":"2023-06-10T18:56:20.024783+0000","last_fullsized":"2023-06-10T18:56:20.024783+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:28:59.500115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:20.026767+0000","last_change":"2023-06-10T18:56:18.715713+0000","last_active":"2023-06-10T18:56:20.026767+0000","last_peered":"2023-06-10T18:56:20.026767+0000","last_clean":"2023-06-10T18:56:20.026767+0000","last_became_active":"2023-06-10T18:56:18.715403+0000","last_became_peered":"2023-06-10T18:56:18.715403+0000","last_unstale":"2023-06-10T18:56:20.026767+0000","last_undegraded":"2023-06-10T18:56:20.026767+0000","last_fullsized":"2023-06-10T18:56:20.026767+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:06:24.379721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:20.024500+0000","last_change":"2023-06-10T18:56:18.742396+0000","last_active":"2023-06-10T18:56:20.024500+0000","last_peered":"2023-06-10T18:56:20.024500+0000","last_clean":"2023-06-10T18:56:20.024500+0000","last_became_active":"2023-06-10T18:56:18.741689+0000","last_became_peered":"2023-06-10T18:56:18.741689+0000","last_unstale":"2023-06-10T18:56:20.024500+0000","last_undegraded":"2023-06-10T18:56:20.024500+0000","last_fullsized":"2023-06-10T18:56:20.024500+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:16:35.200792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:19.700296+0000","last_change":"2023-06-10T18:56:18.733830+0000","last_active":"2023-06-10T18:56:19.700296+0000","last_peered":"2023-06-10T18:56:19.700296+0000","last_clean":"2023-06-10T18:56:19.700296+0000","last_became_active":"2023-06-10T18:56:18.732968+0000","last_became_peered":"2023-06-10T18:56:18.732968+0000","last_unstale":"2023-06-10T18:56:19.700296+0000","last_undegraded":"2023-06-10T18:56:19.700296+0000","last_fullsized":"2023-06-10T18:56:19.700296+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:36:59.628013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:20.022918+0000","last_change":"2023-06-10T18:56:18.733304+0000","last_active":"2023-06-10T18:56:20.022918+0000","last_peered":"2023-06-10T18:56:20.022918+0000","last_clean":"2023-06-10T18:56:20.022918+0000","last_became_active":"2023-06-10T18:56:18.733010+0000","last_became_peered":"2023-06-10T18:56:18.733010+0000","last_unstale":"2023-06-10T18:56:20.022918+0000","last_undegraded":"2023-06-10T18:56:20.022918+0000","last_fullsized":"2023-06-10T18:56:20.022918+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:35:08.996388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:20.024129+0000","last_change":"2023-06-10T18:56:18.715925+0000","last_active":"2023-06-10T18:56:20.024129+0000","last_peered":"2023-06-10T18:56:20.024129+0000","last_clean":"2023-06-10T18:56:20.024129+0000","last_became_active":"2023-06-10T18:56:18.715163+0000","last_became_peered":"2023-06-10T18:56:18.715163+0000","last_unstale":"2023-06-10T18:56:20.024129+0000","last_undegraded":"2023-06-10T18:56:20.024129+0000","last_fullsized":"2023-06-10T18:56:20.024129+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:11:51.560341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:20.024886+0000","last_change":"2023-06-10T18:56:18.710693+0000","last_active":"2023-06-10T18:56:20.024886+0000","last_peered":"2023-06-10T18:56:20.024886+0000","last_clean":"2023-06-10T18:56:20.024886+0000","last_became_active":"2023-06-10T18:56:18.710420+0000","last_became_peered":"2023-06-10T18:56:18.710420+0000","last_unstale":"2023-06-10T18:56:20.024886+0000","last_undegraded":"2023-06-10T18:56:20.024886+0000","last_fullsized":"2023-06-10T18:56:20.024886+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:40:33.066988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:20.023722+0000","last_change":"2023-06-10T18:56:18.711205+0000","last_active":"2023-06-10T18:56:20.023722+0000","last_peered":"2023-06-10T18:56:20.023722+0000","last_clean":"2023-06-10T18:56:20.023722+0000","last_became_active":"2023-06-10T18:56:18.711011+0000","last_became_peered":"2023-06-10T18:56:18.711011+0000","last_unstale":"2023-06-10T18:56:20.023722+0000","last_undegraded":"2023-06-10T18:56:20.023722+0000","last_fullsized":"2023-06-10T18:56:20.023722+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:43:25.661186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:20.024345+0000","last_change":"2023-06-10T18:56:18.731703+0000","last_active":"2023-06-10T18:56:20.024345+0000","last_peered":"2023-06-10T18:56:20.024345+0000","last_clean":"2023-06-10T18:56:20.024345+0000","last_became_active":"2023-06-10T18:56:18.731407+0000","last_became_peered":"2023-06-10T18:56:18.731407+0000","last_unstale":"2023-06-10T18:56:20.024345+0000","last_undegraded":"2023-06-10T18:56:20.024345+0000","last_fullsized":"2023-06-10T18:56:20.024345+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:36:59.628013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:19.692871+0000","last_change":"2023-06-10T18:56:18.739026+0000","last_active":"2023-06-10T18:56:19.692871+0000","last_peered":"2023-06-10T18:56:19.692871+0000","last_clean":"2023-06-10T18:56:19.692871+0000","last_became_active":"2023-06-10T18:56:18.738748+0000","last_became_peered":"2023-06-10T18:56:18.738748+0000","last_unstale":"2023-06-10T18:56:19.692871+0000","last_undegraded":"2023-06-10T18:56:19.692871+0000","last_fullsized":"2023-06-10T18:56:19.692871+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:15:15.859766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:20.024212+0000","last_change":"2023-06-10T18:56:18.711319+0000","last_active":"2023-06-10T18:56:20.024212+0000","last_peered":"2023-06-10T18:56:20.024212+0000","last_clean":"2023-06-10T18:56:20.024212+0000","last_became_active":"2023-06-10T18:56:18.711043+0000","last_became_peered":"2023-06-10T18:56:18.711043+0000","last_unstale":"2023-06-10T18:56:20.024212+0000","last_undegraded":"2023-06-10T18:56:20.024212+0000","last_fullsized":"2023-06-10T18:56:20.024212+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:51:11.268018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:20.023116+0000","last_change":"2023-06-10T18:56:18.735130+0000","last_active":"2023-06-10T18:56:20.023116+0000","last_peered":"2023-06-10T18:56:20.023116+0000","last_clean":"2023-06-10T18:56:20.023116+0000","last_became_active":"2023-06-10T18:56:18.734873+0000","last_became_peered":"2023-06-10T18:56:18.734873+0000","last_unstale":"2023-06-10T18:56:20.023116+0000","last_undegraded":"2023-06-10T18:56:20.023116+0000","last_fullsized":"2023-06-10T18:56:20.023116+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:47:50.069755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:20.024662+0000","last_change":"2023-06-10T18:56:18.718525+0000","last_active":"2023-06-10T18:56:20.024662+0000","last_peered":"2023-06-10T18:56:20.024662+0000","last_clean":"2023-06-10T18:56:20.024662+0000","last_became_active":"2023-06-10T18:56:18.718169+0000","last_became_peered":"2023-06-10T18:56:18.718169+0000","last_unstale":"2023-06-10T18:56:20.024662+0000","last_undegraded":"2023-06-10T18:56:20.024662+0000","last_fullsized":"2023-06-10T18:56:20.024662+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:01:17.253867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:20.023913+0000","last_change":"2023-06-10T18:56:18.747220+0000","last_active":"2023-06-10T18:56:20.023913+0000","last_peered":"2023-06-10T18:56:20.023913+0000","last_clean":"2023-06-10T18:56:20.023913+0000","last_became_active":"2023-06-10T18:56:18.746415+0000","last_became_peered":"2023-06-10T18:56:18.746415+0000","last_unstale":"2023-06-10T18:56:20.023913+0000","last_undegraded":"2023-06-10T18:56:20.023913+0000","last_fullsized":"2023-06-10T18:56:20.023913+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:43:45.838944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:20.022425+0000","last_change":"2023-06-10T18:56:18.732379+0000","last_active":"2023-06-10T18:56:20.022425+0000","last_peered":"2023-06-10T18:56:20.022425+0000","last_clean":"2023-06-10T18:56:20.022425+0000","last_became_active":"2023-06-10T18:56:18.732081+0000","last_became_peered":"2023-06-10T18:56:18.732081+0000","last_unstale":"2023-06-10T18:56:20.022425+0000","last_undegraded":"2023-06-10T18:56:20.022425+0000","last_fullsized":"2023-06-10T18:56:20.022425+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:36:19.615907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:20.027879+0000","last_change":"2023-06-10T18:56:18.727402+0000","last_active":"2023-06-10T18:56:20.027879+0000","last_peered":"2023-06-10T18:56:20.027879+0000","last_clean":"2023-06-10T18:56:20.027879+0000","last_became_active":"2023-06-10T18:56:18.726939+0000","last_became_peered":"2023-06-10T18:56:18.726939+0000","last_unstale":"2023-06-10T18:56:20.027879+0000","last_undegraded":"2023-06-10T18:56:20.027879+0000","last_fullsized":"2023-06-10T18:56:20.027879+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:36:19.615907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:20.025135+0000","last_change":"2023-06-10T18:56:18.741248+0000","last_active":"2023-06-10T18:56:20.025135+0000","last_peered":"2023-06-10T18:56:20.025135+0000","last_clean":"2023-06-10T18:56:20.025135+0000","last_became_active":"2023-06-10T18:56:18.740548+0000","last_became_peered":"2023-06-10T18:56:18.740548+0000","last_unstale":"2023-06-10T18:56:20.025135+0000","last_undegraded":"2023-06-10T18:56:20.025135+0000","last_fullsized":"2023-06-10T18:56:20.025135+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:39:55.727680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:20.026977+0000","last_change":"2023-06-10T18:56:18.718426+0000","last_active":"2023-06-10T18:56:20.026977+0000","last_peered":"2023-06-10T18:56:20.026977+0000","last_clean":"2023-06-10T18:56:20.026977+0000","last_became_active":"2023-06-10T18:56:18.718017+0000","last_became_peered":"2023-06-10T18:56:18.718017+0000","last_unstale":"2023-06-10T18:56:20.026977+0000","last_undegraded":"2023-06-10T18:56:20.026977+0000","last_fullsized":"2023-06-10T18:56:20.026977+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:15:45.739480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:20.023683+0000","last_change":"2023-06-10T18:56:18.734189+0000","last_active":"2023-06-10T18:56:20.023683+0000","last_peered":"2023-06-10T18:56:20.023683+0000","last_clean":"2023-06-10T18:56:20.023683+0000","last_became_active":"2023-06-10T18:56:18.733412+0000","last_became_peered":"2023-06-10T18:56:18.733412+0000","last_unstale":"2023-06-10T18:56:20.023683+0000","last_undegraded":"2023-06-10T18:56:20.023683+0000","last_fullsized":"2023-06-10T18:56:20.023683+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:48:22.699885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:20.025871+0000","last_change":"2023-06-10T18:56:18.737307+0000","last_active":"2023-06-10T18:56:20.025871+0000","last_peered":"2023-06-10T18:56:20.025871+0000","last_clean":"2023-06-10T18:56:20.025871+0000","last_became_active":"2023-06-10T18:56:18.736534+0000","last_became_peered":"2023-06-10T18:56:18.736534+0000","last_unstale":"2023-06-10T18:56:20.025871+0000","last_undegraded":"2023-06-10T18:56:20.025871+0000","last_fullsized":"2023-06-10T18:56:20.025871+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:22:42.813908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:20.022866+0000","last_change":"2023-06-10T18:56:18.710819+0000","last_active":"2023-06-10T18:56:20.022866+0000","last_peered":"2023-06-10T18:56:20.022866+0000","last_clean":"2023-06-10T18:56:20.022866+0000","last_became_active":"2023-06-10T18:56:18.710524+0000","last_became_peered":"2023-06-10T18:56:18.710524+0000","last_unstale":"2023-06-10T18:56:20.022866+0000","last_undegraded":"2023-06-10T18:56:20.022866+0000","last_fullsized":"2023-06-10T18:56:20.022866+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:36:19.615907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:19.692559+0000","last_change":"2023-06-10T18:56:18.739719+0000","last_active":"2023-06-10T18:56:19.692559+0000","last_peered":"2023-06-10T18:56:19.692559+0000","last_clean":"2023-06-10T18:56:19.692559+0000","last_became_active":"2023-06-10T18:56:18.739394+0000","last_became_peered":"2023-06-10T18:56:18.739394+0000","last_unstale":"2023-06-10T18:56:19.692559+0000","last_undegraded":"2023-06-10T18:56:19.692559+0000","last_fullsized":"2023-06-10T18:56:19.692559+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:44:33.048871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:20.022374+0000","last_change":"2023-06-10T18:56:18.716014+0000","last_active":"2023-06-10T18:56:20.022374+0000","last_peered":"2023-06-10T18:56:20.022374+0000","last_clean":"2023-06-10T18:56:20.022374+0000","last_became_active":"2023-06-10T18:56:18.715463+0000","last_became_peered":"2023-06-10T18:56:18.715463+0000","last_unstale":"2023-06-10T18:56:20.022374+0000","last_undegraded":"2023-06-10T18:56:20.022374+0000","last_fullsized":"2023-06-10T18:56:20.022374+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:16:15.404759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:20.028153+0000","last_change":"2023-06-10T18:56:18.722488+0000","last_active":"2023-06-10T18:56:20.028153+0000","last_peered":"2023-06-10T18:56:20.028153+0000","last_clean":"2023-06-10T18:56:20.028153+0000","last_became_active":"2023-06-10T18:56:18.722221+0000","last_became_peered":"2023-06-10T18:56:18.722221+0000","last_unstale":"2023-06-10T18:56:20.028153+0000","last_undegraded":"2023-06-10T18:56:20.028153+0000","last_fullsized":"2023-06-10T18:56:20.028153+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:17:47.581822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:20.024515+0000","last_change":"2023-06-10T18:56:18.721449+0000","last_active":"2023-06-10T18:56:20.024515+0000","last_peered":"2023-06-10T18:56:20.024515+0000","last_clean":"2023-06-10T18:56:20.024515+0000","last_became_active":"2023-06-10T18:56:18.721191+0000","last_became_peered":"2023-06-10T18:56:18.721191+0000","last_unstale":"2023-06-10T18:56:20.024515+0000","last_undegraded":"2023-06-10T18:56:20.024515+0000","last_fullsized":"2023-06-10T18:56:20.024515+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:19:46.602504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:20.025044+0000","last_change":"2023-06-10T18:56:18.719671+0000","last_active":"2023-06-10T18:56:20.025044+0000","last_peered":"2023-06-10T18:56:20.025044+0000","last_clean":"2023-06-10T18:56:20.025044+0000","last_became_active":"2023-06-10T18:56:18.718588+0000","last_became_peered":"2023-06-10T18:56:18.718588+0000","last_unstale":"2023-06-10T18:56:20.025044+0000","last_undegraded":"2023-06-10T18:56:20.025044+0000","last_fullsized":"2023-06-10T18:56:20.025044+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:40:33.066988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:20.024016+0000","last_change":"2023-06-10T18:56:18.720108+0000","last_active":"2023-06-10T18:56:20.024016+0000","last_peered":"2023-06-10T18:56:20.024016+0000","last_clean":"2023-06-10T18:56:20.024016+0000","last_became_active":"2023-06-10T18:56:18.719242+0000","last_became_peered":"2023-06-10T18:56:18.719242+0000","last_unstale":"2023-06-10T18:56:20.024016+0000","last_undegraded":"2023-06-10T18:56:20.024016+0000","last_fullsized":"2023-06-10T18:56:20.024016+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:29:48.176898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:20.026384+0000","last_change":"2023-06-10T18:56:18.747959+0000","last_active":"2023-06-10T18:56:20.026384+0000","last_peered":"2023-06-10T18:56:20.026384+0000","last_clean":"2023-06-10T18:56:20.026384+0000","last_became_active":"2023-06-10T18:56:18.747680+0000","last_became_peered":"2023-06-10T18:56:18.747680+0000","last_unstale":"2023-06-10T18:56:20.026384+0000","last_undegraded":"2023-06-10T18:56:20.026384+0000","last_fullsized":"2023-06-10T18:56:20.026384+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:33:14.006785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:20.024029+0000","last_change":"2023-06-10T18:56:18.740103+0000","last_active":"2023-06-10T18:56:20.024029+0000","last_peered":"2023-06-10T18:56:20.024029+0000","last_clean":"2023-06-10T18:56:20.024029+0000","last_became_active":"2023-06-10T18:56:18.739227+0000","last_became_peered":"2023-06-10T18:56:18.739227+0000","last_unstale":"2023-06-10T18:56:20.024029+0000","last_undegraded":"2023-06-10T18:56:20.024029+0000","last_fullsized":"2023-06-10T18:56:20.024029+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:56:08.938886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:20.024488+0000","last_change":"2023-06-10T18:56:18.715535+0000","last_active":"2023-06-10T18:56:20.024488+0000","last_peered":"2023-06-10T18:56:20.024488+0000","last_clean":"2023-06-10T18:56:20.024488+0000","last_became_active":"2023-06-10T18:56:18.714677+0000","last_became_peered":"2023-06-10T18:56:18.714677+0000","last_unstale":"2023-06-10T18:56:20.024488+0000","last_undegraded":"2023-06-10T18:56:20.024488+0000","last_fullsized":"2023-06-10T18:56:20.024488+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:08:19.820815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:19.697838+0000","last_change":"2023-06-10T18:56:18.705775+0000","last_active":"2023-06-10T18:56:19.697838+0000","last_peered":"2023-06-10T18:56:19.697838+0000","last_clean":"2023-06-10T18:56:19.697838+0000","last_became_active":"2023-06-10T18:56:18.703437+0000","last_became_peered":"2023-06-10T18:56:18.703437+0000","last_unstale":"2023-06-10T18:56:19.697838+0000","last_undegraded":"2023-06-10T18:56:19.697838+0000","last_fullsized":"2023-06-10T18:56:19.697838+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:27:56.626985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:20.023155+0000","last_change":"2023-06-10T18:56:18.740486+0000","last_active":"2023-06-10T18:56:20.023155+0000","last_peered":"2023-06-10T18:56:20.023155+0000","last_clean":"2023-06-10T18:56:20.023155+0000","last_became_active":"2023-06-10T18:56:18.739644+0000","last_became_peered":"2023-06-10T18:56:18.739644+0000","last_unstale":"2023-06-10T18:56:20.023155+0000","last_undegraded":"2023-06-10T18:56:20.023155+0000","last_fullsized":"2023-06-10T18:56:20.023155+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:14:23.654180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"50'4","reported_seq":17,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:20.025549+0000","last_change":"2023-06-10T18:56:18.340764+0000","last_active":"2023-06-10T18:56:20.025549+0000","last_peered":"2023-06-10T18:56:20.025549+0000","last_clean":"2023-06-10T18:56:20.025549+0000","last_became_active":"2023-06-10T18:56:18.340011+0000","last_became_peered":"2023-06-10T18:56:18.340011+0000","last_unstale":"2023-06-10T18:56:20.025549+0000","last_undegraded":"2023-06-10T18:56:20.025549+0000","last_fullsized":"2023-06-10T18:56:20.025549+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:09:00.887920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:19.698173+0000","last_change":"2023-06-10T18:56:18.735833+0000","last_active":"2023-06-10T18:56:19.698173+0000","last_peered":"2023-06-10T18:56:19.698173+0000","last_clean":"2023-06-10T18:56:19.698173+0000","last_became_active":"2023-06-10T18:56:18.734668+0000","last_became_peered":"2023-06-10T18:56:18.734668+0000","last_unstale":"2023-06-10T18:56:19.698173+0000","last_undegraded":"2023-06-10T18:56:19.698173+0000","last_fullsized":"2023-06-10T18:56:19.698173+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:33:38.472734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"50'1","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:20.024509+0000","last_change":"2023-06-10T18:56:18.335972+0000","last_active":"2023-06-10T18:56:20.024509+0000","last_peered":"2023-06-10T18:56:20.024509+0000","last_clean":"2023-06-10T18:56:20.024509+0000","last_became_active":"2023-06-10T18:56:18.335565+0000","last_became_peered":"2023-06-10T18:56:18.335565+0000","last_unstale":"2023-06-10T18:56:20.024509+0000","last_undegraded":"2023-06-10T18:56:20.024509+0000","last_fullsized":"2023-06-10T18:56:20.024509+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:19:45.589002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:20.022934+0000","last_change":"2023-06-10T18:56:18.741042+0000","last_active":"2023-06-10T18:56:20.022934+0000","last_peered":"2023-06-10T18:56:20.022934+0000","last_clean":"2023-06-10T18:56:20.022934+0000","last_became_active":"2023-06-10T18:56:18.740325+0000","last_became_peered":"2023-06-10T18:56:18.740325+0000","last_unstale":"2023-06-10T18:56:20.022934+0000","last_undegraded":"2023-06-10T18:56:20.022934+0000","last_fullsized":"2023-06-10T18:56:20.022934+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:40:20.778295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"50'2","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:20.025138+0000","last_change":"2023-06-10T18:56:18.336603+0000","last_active":"2023-06-10T18:56:20.025138+0000","last_peered":"2023-06-10T18:56:20.025138+0000","last_clean":"2023-06-10T18:56:20.025138+0000","last_became_active":"2023-06-10T18:56:18.336117+0000","last_became_peered":"2023-06-10T18:56:18.336117+0000","last_unstale":"2023-06-10T18:56:20.025138+0000","last_undegraded":"2023-06-10T18:56:20.025138+0000","last_fullsized":"2023-06-10T18:56:20.025138+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:07:14.556000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:20.023460+0000","last_change":"2023-06-10T18:56:18.719404+0000","last_active":"2023-06-10T18:56:20.023460+0000","last_peered":"2023-06-10T18:56:20.023460+0000","last_clean":"2023-06-10T18:56:20.023460+0000","last_became_active":"2023-06-10T18:56:18.719096+0000","last_became_peered":"2023-06-10T18:56:18.719096+0000","last_unstale":"2023-06-10T18:56:20.023460+0000","last_undegraded":"2023-06-10T18:56:20.023460+0000","last_fullsized":"2023-06-10T18:56:20.023460+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:18:14.399249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"50'2","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:19.698483+0000","last_change":"2023-06-10T18:56:18.323382+0000","last_active":"2023-06-10T18:56:19.698483+0000","last_peered":"2023-06-10T18:56:19.698483+0000","last_clean":"2023-06-10T18:56:19.698483+0000","last_became_active":"2023-06-10T18:56:18.322748+0000","last_became_peered":"2023-06-10T18:56:18.322748+0000","last_unstale":"2023-06-10T18:56:19.698483+0000","last_undegraded":"2023-06-10T18:56:19.698483+0000","last_fullsized":"2023-06-10T18:56:19.698483+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:23:26.069557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:19.700769+0000","last_change":"2023-06-10T18:56:18.716497+0000","last_active":"2023-06-10T18:56:19.700769+0000","last_peered":"2023-06-10T18:56:19.700769+0000","last_clean":"2023-06-10T18:56:19.700769+0000","last_became_active":"2023-06-10T18:56:18.715689+0000","last_became_peered":"2023-06-10T18:56:18.715689+0000","last_unstale":"2023-06-10T18:56:19.700769+0000","last_undegraded":"2023-06-10T18:56:19.700769+0000","last_fullsized":"2023-06-10T18:56:19.700769+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:19:46.602504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"50'1","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:20.026329+0000","last_change":"2023-06-10T18:56:18.321017+0000","last_active":"2023-06-10T18:56:20.026329+0000","last_peered":"2023-06-10T18:56:20.026329+0000","last_clean":"2023-06-10T18:56:20.026329+0000","last_became_active":"2023-06-10T18:56:18.320552+0000","last_became_peered":"2023-06-10T18:56:18.320552+0000","last_unstale":"2023-06-10T18:56:20.026329+0000","last_undegraded":"2023-06-10T18:56:20.026329+0000","last_fullsized":"2023-06-10T18:56:20.026329+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:39:43.122259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:20.024820+0000","last_change":"2023-06-10T18:56:18.742047+0000","last_active":"2023-06-10T18:56:20.024820+0000","last_peered":"2023-06-10T18:56:20.024820+0000","last_clean":"2023-06-10T18:56:20.024820+0000","last_became_active":"2023-06-10T18:56:18.741342+0000","last_became_peered":"2023-06-10T18:56:18.741342+0000","last_unstale":"2023-06-10T18:56:20.024820+0000","last_undegraded":"2023-06-10T18:56:20.024820+0000","last_fullsized":"2023-06-10T18:56:20.024820+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:38:42.007423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"50'1","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:19.699715+0000","last_change":"2023-06-10T18:56:18.339655+0000","last_active":"2023-06-10T18:56:19.699715+0000","last_peered":"2023-06-10T18:56:19.699715+0000","last_clean":"2023-06-10T18:56:19.699715+0000","last_became_active":"2023-06-10T18:56:18.338930+0000","last_became_peered":"2023-06-10T18:56:18.338930+0000","last_unstale":"2023-06-10T18:56:19.699715+0000","last_undegraded":"2023-06-10T18:56:19.699715+0000","last_fullsized":"2023-06-10T18:56:19.699715+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:47:49.056253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:20.024744+0000","last_change":"2023-06-10T18:56:18.721372+0000","last_active":"2023-06-10T18:56:20.024744+0000","last_peered":"2023-06-10T18:56:20.024744+0000","last_clean":"2023-06-10T18:56:20.024744+0000","last_became_active":"2023-06-10T18:56:18.721086+0000","last_became_peered":"2023-06-10T18:56:18.721086+0000","last_unstale":"2023-06-10T18:56:20.024744+0000","last_undegraded":"2023-06-10T18:56:20.024744+0000","last_fullsized":"2023-06-10T18:56:20.024744+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:22:08.409137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:20.023017+0000","last_change":"2023-06-10T18:56:18.337501+0000","last_active":"2023-06-10T18:56:20.023017+0000","last_peered":"2023-06-10T18:56:20.023017+0000","last_clean":"2023-06-10T18:56:20.023017+0000","last_became_active":"2023-06-10T18:56:18.336875+0000","last_became_peered":"2023-06-10T18:56:18.336875+0000","last_unstale":"2023-06-10T18:56:20.023017+0000","last_undegraded":"2023-06-10T18:56:20.023017+0000","last_fullsized":"2023-06-10T18:56:20.023017+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:38:24.548346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:20.024772+0000","last_change":"2023-06-10T18:56:18.740844+0000","last_active":"2023-06-10T18:56:20.024772+0000","last_peered":"2023-06-10T18:56:20.024772+0000","last_clean":"2023-06-10T18:56:20.024772+0000","last_became_active":"2023-06-10T18:56:18.740202+0000","last_became_peered":"2023-06-10T18:56:18.740202+0000","last_unstale":"2023-06-10T18:56:20.024772+0000","last_undegraded":"2023-06-10T18:56:20.024772+0000","last_fullsized":"2023-06-10T18:56:20.024772+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:12:46.928430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:20.023571+0000","last_change":"2023-06-10T18:56:18.328357+0000","last_active":"2023-06-10T18:56:20.023571+0000","last_peered":"2023-06-10T18:56:20.023571+0000","last_clean":"2023-06-10T18:56:20.023571+0000","last_became_active":"2023-06-10T18:56:18.328062+0000","last_became_peered":"2023-06-10T18:56:18.328062+0000","last_unstale":"2023-06-10T18:56:20.023571+0000","last_undegraded":"2023-06-10T18:56:20.023571+0000","last_fullsized":"2023-06-10T18:56:20.023571+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:27:46.347276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:19.700178+0000","last_change":"2023-06-10T18:56:18.715041+0000","last_active":"2023-06-10T18:56:19.700178+0000","last_peered":"2023-06-10T18:56:19.700178+0000","last_clean":"2023-06-10T18:56:19.700178+0000","last_became_active":"2023-06-10T18:56:18.714315+0000","last_became_peered":"2023-06-10T18:56:18.714315+0000","last_unstale":"2023-06-10T18:56:19.700178+0000","last_undegraded":"2023-06-10T18:56:19.700178+0000","last_fullsized":"2023-06-10T18:56:19.700178+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:16:20.130012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:20.024365+0000","last_change":"2023-06-10T18:56:18.343930+0000","last_active":"2023-06-10T18:56:20.024365+0000","last_peered":"2023-06-10T18:56:20.024365+0000","last_clean":"2023-06-10T18:56:20.024365+0000","last_became_active":"2023-06-10T18:56:18.343289+0000","last_became_peered":"2023-06-10T18:56:18.343289+0000","last_unstale":"2023-06-10T18:56:20.024365+0000","last_undegraded":"2023-06-10T18:56:20.024365+0000","last_fullsized":"2023-06-10T18:56:20.024365+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:07:33.231119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:19.698701+0000","last_change":"2023-06-10T18:56:18.720481+0000","last_active":"2023-06-10T18:56:19.698701+0000","last_peered":"2023-06-10T18:56:19.698701+0000","last_clean":"2023-06-10T18:56:19.698701+0000","last_became_active":"2023-06-10T18:56:18.717729+0000","last_became_peered":"2023-06-10T18:56:18.717729+0000","last_unstale":"2023-06-10T18:56:19.698701+0000","last_undegraded":"2023-06-10T18:56:19.698701+0000","last_fullsized":"2023-06-10T18:56:19.698701+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:05:32.467816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:19.700851+0000","last_change":"2023-06-10T18:56:18.331216+0000","last_active":"2023-06-10T18:56:19.700851+0000","last_peered":"2023-06-10T18:56:19.700851+0000","last_clean":"2023-06-10T18:56:19.700851+0000","last_became_active":"2023-06-10T18:56:18.330640+0000","last_became_peered":"2023-06-10T18:56:18.330640+0000","last_unstale":"2023-06-10T18:56:19.700851+0000","last_undegraded":"2023-06-10T18:56:19.700851+0000","last_fullsized":"2023-06-10T18:56:19.700851+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:22:07.395636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:20.026238+0000","last_change":"2023-06-10T18:56:18.745850+0000","last_active":"2023-06-10T18:56:20.026238+0000","last_peered":"2023-06-10T18:56:20.026238+0000","last_clean":"2023-06-10T18:56:20.026238+0000","last_became_active":"2023-06-10T18:56:18.745516+0000","last_became_peered":"2023-06-10T18:56:18.745516+0000","last_unstale":"2023-06-10T18:56:20.026238+0000","last_undegraded":"2023-06-10T18:56:20.026238+0000","last_fullsized":"2023-06-10T18:56:20.026238+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:25:41.401949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"50'3","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:20.025043+0000","last_change":"2023-06-10T18:56:18.341819+0000","last_active":"2023-06-10T18:56:20.025043+0000","last_peered":"2023-06-10T18:56:20.025043+0000","last_clean":"2023-06-10T18:56:20.025043+0000","last_became_active":"2023-06-10T18:56:18.341153+0000","last_became_peered":"2023-06-10T18:56:18.341153+0000","last_unstale":"2023-06-10T18:56:20.025043+0000","last_undegraded":"2023-06-10T18:56:20.025043+0000","last_fullsized":"2023-06-10T18:56:20.025043+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:46:20.007636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:19.700445+0000","last_change":"2023-06-10T18:56:18.718945+0000","last_active":"2023-06-10T18:56:19.700445+0000","last_peered":"2023-06-10T18:56:19.700445+0000","last_clean":"2023-06-10T18:56:19.700445+0000","last_became_active":"2023-06-10T18:56:18.717962+0000","last_became_peered":"2023-06-10T18:56:18.717962+0000","last_unstale":"2023-06-10T18:56:19.700445+0000","last_undegraded":"2023-06-10T18:56:19.700445+0000","last_fullsized":"2023-06-10T18:56:19.700445+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:51:11.268018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"50'6","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:20.025614+0000","last_change":"2023-06-10T18:56:18.333312+0000","last_active":"2023-06-10T18:56:20.025614+0000","last_peered":"2023-06-10T18:56:20.025614+0000","last_clean":"2023-06-10T18:56:20.025614+0000","last_became_active":"2023-06-10T18:56:18.332390+0000","last_became_peered":"2023-06-10T18:56:18.332390+0000","last_unstale":"2023-06-10T18:56:20.025614+0000","last_undegraded":"2023-06-10T18:56:20.025614+0000","last_fullsized":"2023-06-10T18:56:20.025614+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:12:01.130435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:19.698243+0000","last_change":"2023-06-10T18:56:18.739711+0000","last_active":"2023-06-10T18:56:19.698243+0000","last_peered":"2023-06-10T18:56:19.698243+0000","last_clean":"2023-06-10T18:56:19.698243+0000","last_became_active":"2023-06-10T18:56:18.738999+0000","last_became_peered":"2023-06-10T18:56:18.738999+0000","last_unstale":"2023-06-10T18:56:19.698243+0000","last_undegraded":"2023-06-10T18:56:19.698243+0000","last_fullsized":"2023-06-10T18:56:19.698243+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:18:25.090460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"50'2","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:20.026591+0000","last_change":"2023-06-10T18:56:18.342157+0000","last_active":"2023-06-10T18:56:20.026591+0000","last_peered":"2023-06-10T18:56:20.026591+0000","last_clean":"2023-06-10T18:56:20.026591+0000","last_became_active":"2023-06-10T18:56:18.341576+0000","last_became_peered":"2023-06-10T18:56:18.341576+0000","last_unstale":"2023-06-10T18:56:20.026591+0000","last_undegraded":"2023-06-10T18:56:20.026591+0000","last_fullsized":"2023-06-10T18:56:20.026591+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:59:37.523382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:20.027149+0000","last_change":"2023-06-10T18:56:18.712056+0000","last_active":"2023-06-10T18:56:20.027149+0000","last_peered":"2023-06-10T18:56:20.027149+0000","last_clean":"2023-06-10T18:56:20.027149+0000","last_became_active":"2023-06-10T18:56:18.711779+0000","last_became_peered":"2023-06-10T18:56:18.711779+0000","last_unstale":"2023-06-10T18:56:20.027149+0000","last_undegraded":"2023-06-10T18:56:20.027149+0000","last_fullsized":"2023-06-10T18:56:20.027149+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:25:45.000488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:20.023234+0000","last_change":"2023-06-10T18:56:18.335774+0000","last_active":"2023-06-10T18:56:20.023234+0000","last_peered":"2023-06-10T18:56:20.023234+0000","last_clean":"2023-06-10T18:56:20.023234+0000","last_became_active":"2023-06-10T18:56:18.334295+0000","last_became_peered":"2023-06-10T18:56:18.334295+0000","last_unstale":"2023-06-10T18:56:20.023234+0000","last_undegraded":"2023-06-10T18:56:20.023234+0000","last_fullsized":"2023-06-10T18:56:20.023234+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:24:21.579841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:20.024180+0000","last_change":"2023-06-10T18:56:18.732193+0000","last_active":"2023-06-10T18:56:20.024180+0000","last_peered":"2023-06-10T18:56:20.024180+0000","last_clean":"2023-06-10T18:56:20.024180+0000","last_became_active":"2023-06-10T18:56:18.731876+0000","last_became_peered":"2023-06-10T18:56:18.731876+0000","last_unstale":"2023-06-10T18:56:20.024180+0000","last_undegraded":"2023-06-10T18:56:20.024180+0000","last_fullsized":"2023-06-10T18:56:20.024180+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:16:20.130012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:20.024339+0000","last_change":"2023-06-10T18:56:18.348170+0000","last_active":"2023-06-10T18:56:20.024339+0000","last_peered":"2023-06-10T18:56:20.024339+0000","last_clean":"2023-06-10T18:56:20.024339+0000","last_became_active":"2023-06-10T18:56:18.347458+0000","last_became_peered":"2023-06-10T18:56:18.347458+0000","last_unstale":"2023-06-10T18:56:20.024339+0000","last_undegraded":"2023-06-10T18:56:20.024339+0000","last_fullsized":"2023-06-10T18:56:20.024339+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:51:38.297689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:20.027912+0000","last_change":"2023-06-10T18:56:18.727211+0000","last_active":"2023-06-10T18:56:20.027912+0000","last_peered":"2023-06-10T18:56:20.027912+0000","last_clean":"2023-06-10T18:56:20.027912+0000","last_became_active":"2023-06-10T18:56:18.726575+0000","last_became_peered":"2023-06-10T18:56:18.726575+0000","last_unstale":"2023-06-10T18:56:20.027912+0000","last_undegraded":"2023-06-10T18:56:20.027912+0000","last_fullsized":"2023-06-10T18:56:20.027912+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:18:14.399249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"50'8","reported_seq":21,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:20.025121+0000","last_change":"2023-06-10T18:56:18.332240+0000","last_active":"2023-06-10T18:56:20.025121+0000","last_peered":"2023-06-10T18:56:20.025121+0000","last_clean":"2023-06-10T18:56:20.025121+0000","last_became_active":"2023-06-10T18:56:18.331781+0000","last_became_peered":"2023-06-10T18:56:18.331781+0000","last_unstale":"2023-06-10T18:56:20.025121+0000","last_undegraded":"2023-06-10T18:56:20.025121+0000","last_fullsized":"2023-06-10T18:56:20.025121+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:42:04.516586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:20.025133+0000","last_change":"2023-06-10T18:56:18.702816+0000","last_active":"2023-06-10T18:56:20.025133+0000","last_peered":"2023-06-10T18:56:20.025133+0000","last_clean":"2023-06-10T18:56:20.025133+0000","last_became_active":"2023-06-10T18:56:18.702527+0000","last_became_peered":"2023-06-10T18:56:18.702527+0000","last_unstale":"2023-06-10T18:56:20.025133+0000","last_undegraded":"2023-06-10T18:56:20.025133+0000","last_fullsized":"2023-06-10T18:56:20.025133+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:07:15.569502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"50'1","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:20.028056+0000","last_change":"2023-06-10T18:56:18.324631+0000","last_active":"2023-06-10T18:56:20.028056+0000","last_peered":"2023-06-10T18:56:20.028056+0000","last_clean":"2023-06-10T18:56:20.028056+0000","last_became_active":"2023-06-10T18:56:18.324243+0000","last_became_peered":"2023-06-10T18:56:18.324243+0000","last_unstale":"2023-06-10T18:56:20.028056+0000","last_undegraded":"2023-06-10T18:56:20.028056+0000","last_fullsized":"2023-06-10T18:56:20.028056+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:35:07.982886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:20.022516+0000","last_change":"2023-06-10T18:56:18.710557+0000","last_active":"2023-06-10T18:56:20.022516+0000","last_peered":"2023-06-10T18:56:20.022516+0000","last_clean":"2023-06-10T18:56:20.022516+0000","last_became_active":"2023-06-10T18:56:18.710238+0000","last_became_peered":"2023-06-10T18:56:18.710238+0000","last_unstale":"2023-06-10T18:56:20.022516+0000","last_undegraded":"2023-06-10T18:56:20.022516+0000","last_fullsized":"2023-06-10T18:56:20.022516+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:18:14.399249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"50'2","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:19.692977+0000","last_change":"2023-06-10T18:56:18.324362+0000","last_active":"2023-06-10T18:56:19.692977+0000","last_peered":"2023-06-10T18:56:19.692977+0000","last_clean":"2023-06-10T18:56:19.692977+0000","last_became_active":"2023-06-10T18:56:18.323943+0000","last_became_peered":"2023-06-10T18:56:18.323943+0000","last_unstale":"2023-06-10T18:56:19.692977+0000","last_undegraded":"2023-06-10T18:56:19.692977+0000","last_fullsized":"2023-06-10T18:56:19.692977+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:08:03.781625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:19.699804+0000","last_change":"2023-06-10T18:56:18.715476+0000","last_active":"2023-06-10T18:56:19.699804+0000","last_peered":"2023-06-10T18:56:19.699804+0000","last_clean":"2023-06-10T18:56:19.699804+0000","last_became_active":"2023-06-10T18:56:18.714697+0000","last_became_peered":"2023-06-10T18:56:18.714697+0000","last_unstale":"2023-06-10T18:56:19.699804+0000","last_undegraded":"2023-06-10T18:56:19.699804+0000","last_fullsized":"2023-06-10T18:56:19.699804+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:17:47.581822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"50'1","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:20.025125+0000","last_change":"2023-06-10T18:56:18.341065+0000","last_active":"2023-06-10T18:56:20.025125+0000","last_peered":"2023-06-10T18:56:20.025125+0000","last_clean":"2023-06-10T18:56:20.025125+0000","last_became_active":"2023-06-10T18:56:18.340242+0000","last_became_peered":"2023-06-10T18:56:18.340242+0000","last_unstale":"2023-06-10T18:56:20.025125+0000","last_undegraded":"2023-06-10T18:56:20.025125+0000","last_fullsized":"2023-06-10T18:56:20.025125+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:28:14.023246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:20.024276+0000","last_change":"2023-06-10T18:56:18.722679+0000","last_active":"2023-06-10T18:56:20.024276+0000","last_peered":"2023-06-10T18:56:20.024276+0000","last_clean":"2023-06-10T18:56:20.024276+0000","last_became_active":"2023-06-10T18:56:18.722389+0000","last_became_peered":"2023-06-10T18:56:18.722389+0000","last_unstale":"2023-06-10T18:56:20.024276+0000","last_undegraded":"2023-06-10T18:56:20.024276+0000","last_fullsized":"2023-06-10T18:56:20.024276+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:16:20.130012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:20.024215+0000","last_change":"2023-06-10T18:56:18.335157+0000","last_active":"2023-06-10T18:56:20.024215+0000","last_peered":"2023-06-10T18:56:20.024215+0000","last_clean":"2023-06-10T18:56:20.024215+0000","last_became_active":"2023-06-10T18:56:18.334417+0000","last_became_peered":"2023-06-10T18:56:18.334417+0000","last_unstale":"2023-06-10T18:56:20.024215+0000","last_undegraded":"2023-06-10T18:56:20.024215+0000","last_fullsized":"2023-06-10T18:56:20.024215+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:11:26.228115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:19.698384+0000","last_change":"2023-06-10T18:56:18.720351+0000","last_active":"2023-06-10T18:56:19.698384+0000","last_peered":"2023-06-10T18:56:19.698384+0000","last_clean":"2023-06-10T18:56:19.698384+0000","last_became_active":"2023-06-10T18:56:18.717962+0000","last_became_peered":"2023-06-10T18:56:18.717962+0000","last_unstale":"2023-06-10T18:56:19.698384+0000","last_undegraded":"2023-06-10T18:56:19.698384+0000","last_fullsized":"2023-06-10T18:56:19.698384+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:13:39.804832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"50'2","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:20.023414+0000","last_change":"2023-06-10T18:56:18.337149+0000","last_active":"2023-06-10T18:56:20.023414+0000","last_peered":"2023-06-10T18:56:20.023414+0000","last_clean":"2023-06-10T18:56:20.023414+0000","last_became_active":"2023-06-10T18:56:18.335525+0000","last_became_peered":"2023-06-10T18:56:18.335525+0000","last_unstale":"2023-06-10T18:56:20.023414+0000","last_undegraded":"2023-06-10T18:56:20.023414+0000","last_fullsized":"2023-06-10T18:56:20.023414+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:45:43.874685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:20.024868+0000","last_change":"2023-06-10T18:56:18.734899+0000","last_active":"2023-06-10T18:56:20.024868+0000","last_peered":"2023-06-10T18:56:20.024868+0000","last_clean":"2023-06-10T18:56:20.024868+0000","last_became_active":"2023-06-10T18:56:18.734152+0000","last_became_peered":"2023-06-10T18:56:18.734152+0000","last_unstale":"2023-06-10T18:56:20.024868+0000","last_undegraded":"2023-06-10T18:56:20.024868+0000","last_fullsized":"2023-06-10T18:56:20.024868+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:13:39.864943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:20.023834+0000","last_change":"2023-06-10T18:56:18.332341+0000","last_active":"2023-06-10T18:56:20.023834+0000","last_peered":"2023-06-10T18:56:20.023834+0000","last_clean":"2023-06-10T18:56:20.023834+0000","last_became_active":"2023-06-10T18:56:18.331836+0000","last_became_peered":"2023-06-10T18:56:18.331836+0000","last_unstale":"2023-06-10T18:56:20.023834+0000","last_undegraded":"2023-06-10T18:56:20.023834+0000","last_fullsized":"2023-06-10T18:56:20.023834+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:17:46.568320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:20.027835+0000","last_change":"2023-06-10T18:56:18.745846+0000","last_active":"2023-06-10T18:56:20.027835+0000","last_peered":"2023-06-10T18:56:20.027835+0000","last_clean":"2023-06-10T18:56:20.027835+0000","last_became_active":"2023-06-10T18:56:18.745527+0000","last_became_peered":"2023-06-10T18:56:18.745527+0000","last_unstale":"2023-06-10T18:56:20.027835+0000","last_undegraded":"2023-06-10T18:56:20.027835+0000","last_fullsized":"2023-06-10T18:56:20.027835+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:57:58.828553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:20.024647+0000","last_change":"2023-06-10T18:56:18.337764+0000","last_active":"2023-06-10T18:56:20.024647+0000","last_peered":"2023-06-10T18:56:20.024647+0000","last_clean":"2023-06-10T18:56:20.024647+0000","last_became_active":"2023-06-10T18:56:18.337390+0000","last_became_peered":"2023-06-10T18:56:18.337390+0000","last_unstale":"2023-06-10T18:56:20.024647+0000","last_undegraded":"2023-06-10T18:56:20.024647+0000","last_fullsized":"2023-06-10T18:56:20.024647+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:26:59.504646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:20.025376+0000","last_change":"2023-06-10T18:56:18.705770+0000","last_active":"2023-06-10T18:56:20.025376+0000","last_peered":"2023-06-10T18:56:20.025376+0000","last_clean":"2023-06-10T18:56:20.025376+0000","last_became_active":"2023-06-10T18:56:18.705487+0000","last_became_peered":"2023-06-10T18:56:18.705487+0000","last_unstale":"2023-06-10T18:56:20.025376+0000","last_undegraded":"2023-06-10T18:56:20.025376+0000","last_fullsized":"2023-06-10T18:56:20.025376+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:42:05.530087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:19.692172+0000","last_change":"2023-06-10T18:56:18.339683+0000","last_active":"2023-06-10T18:56:19.692172+0000","last_peered":"2023-06-10T18:56:19.692172+0000","last_clean":"2023-06-10T18:56:19.692172+0000","last_became_active":"2023-06-10T18:56:18.339076+0000","last_became_peered":"2023-06-10T18:56:18.339076+0000","last_unstale":"2023-06-10T18:56:19.692172+0000","last_undegraded":"2023-06-10T18:56:19.692172+0000","last_fullsized":"2023-06-10T18:56:19.692172+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:59:31.013867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:20.023087+0000","last_change":"2023-06-10T18:56:18.724347+0000","last_active":"2023-06-10T18:56:20.023087+0000","last_peered":"2023-06-10T18:56:20.023087+0000","last_clean":"2023-06-10T18:56:20.023087+0000","last_became_active":"2023-06-10T18:56:18.723327+0000","last_became_peered":"2023-06-10T18:56:18.723327+0000","last_unstale":"2023-06-10T18:56:20.023087+0000","last_undegraded":"2023-06-10T18:56:20.023087+0000","last_fullsized":"2023-06-10T18:56:20.023087+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:31:06.623614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:20.028013+0000","last_change":"2023-06-10T18:56:18.337157+0000","last_active":"2023-06-10T18:56:20.028013+0000","last_peered":"2023-06-10T18:56:20.028013+0000","last_clean":"2023-06-10T18:56:20.028013+0000","last_became_active":"2023-06-10T18:56:18.336768+0000","last_became_peered":"2023-06-10T18:56:18.336768+0000","last_unstale":"2023-06-10T18:56:20.028013+0000","last_undegraded":"2023-06-10T18:56:20.028013+0000","last_fullsized":"2023-06-10T18:56:20.028013+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:43:24.647684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":222,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:20.023866+0000","last_change":"2023-06-10T18:52:34.951528+0000","last_active":"2023-06-10T18:56:20.023866+0000","last_peered":"2023-06-10T18:56:20.023866+0000","last_clean":"2023-06-10T18:56:20.023866+0000","last_became_active":"2023-06-10T18:52:34.949099+0000","last_became_peered":"2023-06-10T18:52:34.949099+0000","last_unstale":"2023-06-10T18:56:20.023866+0000","last_undegraded":"2023-06-10T18:56:20.023866+0000","last_fullsized":"2023-06-10T18:56:20.023866+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_clean_scrub_stamp":"2023-06-10T18:52:33.633295+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:32:11.250930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":68,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:19.698672+0000","last_change":"2023-06-10T18:52:40.506384+0000","last_active":"2023-06-10T18:56:19.698672+0000","last_peered":"2023-06-10T18:56:19.698672+0000","last_clean":"2023-06-10T18:56:19.698672+0000","last_became_active":"2023-06-10T18:52:40.505701+0000","last_became_peered":"2023-06-10T18:52:40.505701+0000","last_unstale":"2023-06-10T18:56:19.698672+0000","last_undegraded":"2023-06-10T18:56:19.698672+0000","last_fullsized":"2023-06-10T18:56:19.698672+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:48:51.708443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:20.023070+0000","last_change":"2023-06-10T18:56:18.714433+0000","last_active":"2023-06-10T18:56:20.023070+0000","last_peered":"2023-06-10T18:56:20.023070+0000","last_clean":"2023-06-10T18:56:20.023070+0000","last_became_active":"2023-06-10T18:56:18.714070+0000","last_became_peered":"2023-06-10T18:56:18.714070+0000","last_unstale":"2023-06-10T18:56:20.023070+0000","last_undegraded":"2023-06-10T18:56:20.023070+0000","last_fullsized":"2023-06-10T18:56:20.023070+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:17:47.581822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:20.025206+0000","last_change":"2023-06-10T18:56:18.341822+0000","last_active":"2023-06-10T18:56:20.025206+0000","last_peered":"2023-06-10T18:56:20.025206+0000","last_clean":"2023-06-10T18:56:20.025206+0000","last_became_active":"2023-06-10T18:56:18.341138+0000","last_became_peered":"2023-06-10T18:56:18.341138+0000","last_unstale":"2023-06-10T18:56:20.025206+0000","last_undegraded":"2023-06-10T18:56:20.025206+0000","last_fullsized":"2023-06-10T18:56:20.025206+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:47:55.177929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":66,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:20.023546+0000","last_change":"2023-06-10T18:52:40.512015+0000","last_active":"2023-06-10T18:56:20.023546+0000","last_peered":"2023-06-10T18:56:20.023546+0000","last_clean":"2023-06-10T18:56:20.023546+0000","last_became_active":"2023-06-10T18:52:40.511382+0000","last_became_peered":"2023-06-10T18:52:40.511382+0000","last_unstale":"2023-06-10T18:56:20.023546+0000","last_undegraded":"2023-06-10T18:56:20.023546+0000","last_fullsized":"2023-06-10T18:56:20.023546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:51:31.323683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:20.023833+0000","last_change":"2023-06-10T18:56:18.720642+0000","last_active":"2023-06-10T18:56:20.023833+0000","last_peered":"2023-06-10T18:56:20.023833+0000","last_clean":"2023-06-10T18:56:20.023833+0000","last_became_active":"2023-06-10T18:56:18.720385+0000","last_became_peered":"2023-06-10T18:56:18.720385+0000","last_unstale":"2023-06-10T18:56:20.023833+0000","last_undegraded":"2023-06-10T18:56:20.023833+0000","last_fullsized":"2023-06-10T18:56:20.023833+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:35:08.996388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:20.026639+0000","last_change":"2023-06-10T18:56:18.320760+0000","last_active":"2023-06-10T18:56:20.026639+0000","last_peered":"2023-06-10T18:56:20.026639+0000","last_clean":"2023-06-10T18:56:20.026639+0000","last_became_active":"2023-06-10T18:56:18.320373+0000","last_became_peered":"2023-06-10T18:56:18.320373+0000","last_unstale":"2023-06-10T18:56:20.026639+0000","last_undegraded":"2023-06-10T18:56:20.026639+0000","last_fullsized":"2023-06-10T18:56:20.026639+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:23:32.094038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":68,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:19.692494+0000","last_change":"2023-06-10T18:52:40.671725+0000","last_active":"2023-06-10T18:56:19.692494+0000","last_peered":"2023-06-10T18:56:19.692494+0000","last_clean":"2023-06-10T18:56:19.692494+0000","last_became_active":"2023-06-10T18:52:40.671442+0000","last_became_peered":"2023-06-10T18:52:40.671442+0000","last_unstale":"2023-06-10T18:56:19.692494+0000","last_undegraded":"2023-06-10T18:56:19.692494+0000","last_fullsized":"2023-06-10T18:56:19.692494+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:03:50.882670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:19.697835+0000","last_change":"2023-06-10T18:56:18.704278+0000","last_active":"2023-06-10T18:56:19.697835+0000","last_peered":"2023-06-10T18:56:19.697835+0000","last_clean":"2023-06-10T18:56:19.697835+0000","last_became_active":"2023-06-10T18:56:18.703336+0000","last_became_peered":"2023-06-10T18:56:18.703336+0000","last_unstale":"2023-06-10T18:56:19.697835+0000","last_undegraded":"2023-06-10T18:56:19.697835+0000","last_fullsized":"2023-06-10T18:56:19.697835+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:16:44.545696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"50'2","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:20.025653+0000","last_change":"2023-06-10T18:56:18.335741+0000","last_active":"2023-06-10T18:56:20.025653+0000","last_peered":"2023-06-10T18:56:20.025653+0000","last_clean":"2023-06-10T18:56:20.025653+0000","last_became_active":"2023-06-10T18:56:18.334904+0000","last_became_peered":"2023-06-10T18:56:18.334904+0000","last_unstale":"2023-06-10T18:56:20.025653+0000","last_undegraded":"2023-06-10T18:56:20.025653+0000","last_fullsized":"2023-06-10T18:56:20.025653+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:21:14.498048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":68,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:19.698049+0000","last_change":"2023-06-10T18:52:40.510258+0000","last_active":"2023-06-10T18:56:19.698049+0000","last_peered":"2023-06-10T18:56:19.698049+0000","last_clean":"2023-06-10T18:56:19.698049+0000","last_became_active":"2023-06-10T18:52:40.509560+0000","last_became_peered":"2023-06-10T18:52:40.509560+0000","last_unstale":"2023-06-10T18:56:19.698049+0000","last_undegraded":"2023-06-10T18:56:19.698049+0000","last_fullsized":"2023-06-10T18:56:19.698049+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:41:17.572105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:20.027556+0000","last_change":"2023-06-10T18:56:18.715957+0000","last_active":"2023-06-10T18:56:20.027556+0000","last_peered":"2023-06-10T18:56:20.027556+0000","last_clean":"2023-06-10T18:56:20.027556+0000","last_became_active":"2023-06-10T18:56:18.715542+0000","last_became_peered":"2023-06-10T18:56:18.715542+0000","last_unstale":"2023-06-10T18:56:20.027556+0000","last_undegraded":"2023-06-10T18:56:20.027556+0000","last_fullsized":"2023-06-10T18:56:20.027556+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:29:52.624463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:19.699723+0000","last_change":"2023-06-10T18:56:18.325010+0000","last_active":"2023-06-10T18:56:19.699723+0000","last_peered":"2023-06-10T18:56:19.699723+0000","last_clean":"2023-06-10T18:56:19.699723+0000","last_became_active":"2023-06-10T18:56:18.324414+0000","last_became_peered":"2023-06-10T18:56:18.324414+0000","last_unstale":"2023-06-10T18:56:19.699723+0000","last_undegraded":"2023-06-10T18:56:19.699723+0000","last_fullsized":"2023-06-10T18:56:19.699723+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:45:43.874685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":64,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:20.022641+0000","last_change":"2023-06-10T18:52:40.672266+0000","last_active":"2023-06-10T18:56:20.022641+0000","last_peered":"2023-06-10T18:56:20.022641+0000","last_clean":"2023-06-10T18:56:20.022641+0000","last_became_active":"2023-06-10T18:52:40.671966+0000","last_became_peered":"2023-06-10T18:52:40.671966+0000","last_unstale":"2023-06-10T18:56:20.022641+0000","last_undegraded":"2023-06-10T18:56:20.022641+0000","last_fullsized":"2023-06-10T18:56:20.022641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:39:46.852218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:20.024023+0000","last_change":"2023-06-10T18:56:18.703583+0000","last_active":"2023-06-10T18:56:20.024023+0000","last_peered":"2023-06-10T18:56:20.024023+0000","last_clean":"2023-06-10T18:56:20.024023+0000","last_became_active":"2023-06-10T18:56:18.703292+0000","last_became_peered":"2023-06-10T18:56:18.703292+0000","last_unstale":"2023-06-10T18:56:20.024023+0000","last_undegraded":"2023-06-10T18:56:20.024023+0000","last_fullsized":"2023-06-10T18:56:20.024023+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:47:50.069755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:19.698086+0000","last_change":"2023-06-10T18:56:18.331871+0000","last_active":"2023-06-10T18:56:19.698086+0000","last_peered":"2023-06-10T18:56:19.698086+0000","last_clean":"2023-06-10T18:56:19.698086+0000","last_became_active":"2023-06-10T18:56:18.331127+0000","last_became_peered":"2023-06-10T18:56:18.331127+0000","last_unstale":"2023-06-10T18:56:19.698086+0000","last_undegraded":"2023-06-10T18:56:19.698086+0000","last_fullsized":"2023-06-10T18:56:19.698086+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:01:29.954138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":66,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:20.025347+0000","last_change":"2023-06-10T18:52:40.671084+0000","last_active":"2023-06-10T18:56:20.025347+0000","last_peered":"2023-06-10T18:56:20.025347+0000","last_clean":"2023-06-10T18:56:20.025347+0000","last_became_active":"2023-06-10T18:52:40.670697+0000","last_became_peered":"2023-06-10T18:52:40.670697+0000","last_unstale":"2023-06-10T18:56:20.025347+0000","last_undegraded":"2023-06-10T18:56:20.025347+0000","last_fullsized":"2023-06-10T18:56:20.025347+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:38:54.445772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:20.026519+0000","last_change":"2023-06-10T18:56:18.724544+0000","last_active":"2023-06-10T18:56:20.026519+0000","last_peered":"2023-06-10T18:56:20.026519+0000","last_clean":"2023-06-10T18:56:20.026519+0000","last_became_active":"2023-06-10T18:56:18.724244+0000","last_became_peered":"2023-06-10T18:56:18.724244+0000","last_unstale":"2023-06-10T18:56:20.026519+0000","last_undegraded":"2023-06-10T18:56:20.026519+0000","last_fullsized":"2023-06-10T18:56:20.026519+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:50:38.629690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:20.024054+0000","last_change":"2023-06-10T18:56:18.332507+0000","last_active":"2023-06-10T18:56:20.024054+0000","last_peered":"2023-06-10T18:56:20.024054+0000","last_clean":"2023-06-10T18:56:20.024054+0000","last_became_active":"2023-06-10T18:56:18.331887+0000","last_became_peered":"2023-06-10T18:56:18.331887+0000","last_unstale":"2023-06-10T18:56:20.024054+0000","last_undegraded":"2023-06-10T18:56:20.024054+0000","last_fullsized":"2023-06-10T18:56:20.024054+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:45:43.874685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":64,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:20.024487+0000","last_change":"2023-06-10T18:52:40.514114+0000","last_active":"2023-06-10T18:56:20.024487+0000","last_peered":"2023-06-10T18:56:20.024487+0000","last_clean":"2023-06-10T18:56:20.024487+0000","last_became_active":"2023-06-10T18:52:40.513638+0000","last_became_peered":"2023-06-10T18:52:40.513638+0000","last_unstale":"2023-06-10T18:56:20.024487+0000","last_undegraded":"2023-06-10T18:56:20.024487+0000","last_fullsized":"2023-06-10T18:56:20.024487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:47:32.459051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:19.699156+0000","last_change":"2023-06-10T18:56:18.733094+0000","last_active":"2023-06-10T18:56:19.699156+0000","last_peered":"2023-06-10T18:56:19.699156+0000","last_clean":"2023-06-10T18:56:19.699156+0000","last_became_active":"2023-06-10T18:56:18.732442+0000","last_became_peered":"2023-06-10T18:56:18.732442+0000","last_unstale":"2023-06-10T18:56:19.699156+0000","last_undegraded":"2023-06-10T18:56:19.699156+0000","last_fullsized":"2023-06-10T18:56:19.699156+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:57:04.253762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:20.024084+0000","last_change":"2023-06-10T18:56:18.337697+0000","last_active":"2023-06-10T18:56:20.024084+0000","last_peered":"2023-06-10T18:56:20.024084+0000","last_clean":"2023-06-10T18:56:20.024084+0000","last_became_active":"2023-06-10T18:56:18.337174+0000","last_became_peered":"2023-06-10T18:56:18.337174+0000","last_unstale":"2023-06-10T18:56:20.024084+0000","last_undegraded":"2023-06-10T18:56:20.024084+0000","last_fullsized":"2023-06-10T18:56:20.024084+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:36:58.614511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":68,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-06-10T18:56:20.025859+0000","last_change":"2023-06-10T18:52:40.515396+0000","last_active":"2023-06-10T18:56:20.025859+0000","last_peered":"2023-06-10T18:56:20.025859+0000","last_clean":"2023-06-10T18:56:20.025859+0000","last_became_active":"2023-06-10T18:52:40.514663+0000","last_became_peered":"2023-06-10T18:52:40.514663+0000","last_unstale":"2023-06-10T18:56:20.025859+0000","last_undegraded":"2023-06-10T18:56:20.025859+0000","last_fullsized":"2023-06-10T18:56:20.025859+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:36:28.446641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574897,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28128,"kb_used_data":1176,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343712,"statfs":{"total":96636764160,"available":96607961088,"internally_reserved":0,"allocated":1204224,"data_stored":851412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":0.90400000000000003,"15min":0.88200000000000001},"min":{"1min":0.73599999999999999,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.3759999999999999,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.84999999999999998},{"interface":"front","average":{"1min":1.006,"5min":0.94299999999999995,"15min":0.93000000000000005},"min":{"1min":0.81899999999999995,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.234,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":1.0620000000000001}]},{"osd":1,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92400000000000004,"15min":0.91500000000000004},"min":{"1min":0.58599999999999997,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.3089999999999999,"5min":1.377,"15min":1.377},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.92500000000000004,"15min":0.91100000000000003},"min":{"1min":0.78400000000000003,"5min":0.504,"15min":0.504},"max":{"1min":1.111,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.93000000000000005}]},{"osd":2,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.83999999999999997,"15min":0.82799999999999996},"min":{"1min":0.64100000000000001,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.214,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.89900000000000002,"15min":0.90700000000000003},"min":{"1min":0.67500000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.325,"5min":1.367,"15min":1.367},"last":1.1930000000000001}]},{"osd":3,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.92100000000000004,"15min":0.89900000000000002},"min":{"1min":0.68100000000000005,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1499999999999999,"5min":1.502,"15min":1.502},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.93799999999999994,"15min":0.92800000000000005},"min":{"1min":0.70399999999999996,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.2130000000000001,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.98199999999999998}]},{"osd":4,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.876,"15min":0.872},"min":{"1min":0.60199999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.141,"5min":1.639,"15min":1.639},"last":1.1639999999999999},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.96899999999999997,"15min":0.98099999999999998},"min":{"1min":0.748,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.238,"5min":1.411,"15min":1.411},"last":1.0229999999999999}]},{"osd":5,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.042,"15min":1.038},"min":{"1min":0.79800000000000004,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.2669999999999999,"5min":1.806,"15min":1.806},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.081,"5min":1.05,"15min":1.052},"min":{"1min":0.93200000000000005,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.256,"5min":1.522,"15min":1.522},"last":0.89800000000000002}]},{"osd":6,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.0129999999999999,"15min":1.008},"min":{"1min":0.78500000000000003,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.3,"5min":1.718,"15min":1.718},"last":1.2170000000000001},{"interface":"front","average":{"1min":1.147,"5min":1.095,"15min":1.0900000000000001},"min":{"1min":0.96599999999999997,"5min":0.441,"15min":0.441},"max":{"1min":1.409,"5min":1.464,"15min":1.464},"last":1.123}]}]},{"osd":6,"up_from":13,"seq":55834574898,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27548,"kb_used_data":596,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344292,"statfs":{"total":96636764160,"available":96608555008,"internally_reserved":0,"allocated":610304,"data_stored":261572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.81999999999999995,"15min":0.80100000000000005},"min":{"1min":0.65800000000000003,"5min":0.502,"15min":0.502},"max":{"1min":1.0589999999999999,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.85199999999999998,"15min":0.83999999999999997},"min":{"1min":0.71799999999999997,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.0680000000000001,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.46100000000000002}]},{"osd":1,"last update":"Sat Jun 10 18:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.873,"15min":0.85199999999999998},"min":{"1min":0.68999999999999995,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.879,"15min":0.85899999999999999},"min":{"1min":0.68999999999999995,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":0.88300000000000001}]},{"osd":2,"last update":"Sat Jun 10 18:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.871,"15min":0.85899999999999999},"min":{"1min":0.66000000000000003,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.1950000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.88500000000000001,"15min":0.88900000000000001},"min":{"1min":0.68000000000000005,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.109,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.63}]},{"osd":3,"last update":"Sat Jun 10 18:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.874,"15min":0.84799999999999998},"min":{"1min":0.64900000000000002,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.169,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.93200000000000005},{"interface":"front","average":{"1min":1.0209999999999999,"5min":0.997,"15min":0.995},"min":{"1min":0.72799999999999998,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.58599999999999997}]},{"osd":4,"last update":"Sat Jun 10 18:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.93799999999999994,"15min":0.95399999999999996},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.1259999999999999,"5min":1.198,"15min":1.198},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.95699999999999996,"5min":1.0049999999999999,"15min":1.0189999999999999},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.1879999999999999,"5min":1.222,"15min":1.222},"last":0.90700000000000003}]},{"osd":5,"last update":"Sat Jun 10 18:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.94999999999999996,"15min":0.96199999999999997},"min":{"1min":0.68700000000000006,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.0720000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":1.02,"5min":1.0249999999999999,"15min":1.026},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":1.028}]},{"osd":7,"last update":"Sat Jun 10 18:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":1.0389999999999999,"15min":1.0489999999999999},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.1739999999999999,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.751},{"interface":"front","average":{"1min":1.022,"5min":1.0569999999999999,"15min":1.0649999999999999},"min":{"1min":0.82199999999999995,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.2010000000000001,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.84699999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574898,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27540,"kb_used_data":588,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":602112,"data_stored":260920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.84199999999999997,"15min":0.82999999999999996},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.139,"5min":1.175,"15min":1.175},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.91800000000000004,"15min":0.94199999999999995},"min":{"1min":0.63800000000000001,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.246,"5min":1.637,"15min":1.637},"last":0.752}]},{"osd":1,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.91000000000000003,"15min":0.91800000000000004},"min":{"1min":0.67800000000000005,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.1559999999999999,"5min":1.335,"15min":1.335},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.91700000000000004,"15min":0.92100000000000004},"min":{"1min":0.72699999999999998,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.208,"5min":1.78,"15min":1.78},"last":0.83999999999999997}]},{"osd":2,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.65000000000000002,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.1000000000000001,"5min":1.446,"15min":1.446},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.91600000000000004,"15min":0.91200000000000003},"min":{"1min":0.71399999999999997,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.1379999999999999,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.60099999999999998}]},{"osd":3,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93899999999999995,"15min":0.94499999999999995},"min":{"1min":0.68600000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.206,"5min":1.484,"15min":1.484},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.97199999999999998,"5min":1.0249999999999999,"15min":1.0429999999999999},"min":{"1min":0.77100000000000002,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.2969999999999999,"5min":1.337,"15min":1.337},"last":1.0449999999999999}]},{"osd":4,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.96999999999999997,"15min":0.98899999999999999},"min":{"1min":0.70299999999999996,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.2669999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":1.012},{"interface":"front","average":{"1min":0.94599999999999995,"5min":1.034,"15min":1.0640000000000001},"min":{"1min":0.66500000000000004,"5min":0.629,"15min":0.629},"max":{"1min":1.26,"5min":1.575,"15min":1.575},"last":0.91100000000000003}]},{"osd":6,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":1.038,"15min":1.0780000000000001},"min":{"1min":0.66000000000000003,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.2010000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.88500000000000001},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.0609999999999999,"15min":1.079},"min":{"1min":0.69799999999999995,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.2270000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.93200000000000005}]},{"osd":7,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.139,"15min":1.1739999999999999},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.226,"5min":1.873,"15min":1.873},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.155,"15min":1.181},"min":{"1min":0.80000000000000004,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.3680000000000001,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.96899999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574897,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27544,"kb_used_data":592,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344296,"statfs":{"total":96636764160,"available":96608559104,"internally_reserved":0,"allocated":606208,"data_stored":261502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.76700000000000002,"15min":0.745},"min":{"1min":0.53400000000000003,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.1599999999999999,"5min":1.2,"15min":1.2},"last":0.629},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.88200000000000001,"15min":0.88},"min":{"1min":0.63800000000000001,"5min":0.504,"15min":0.504},"max":{"1min":1.4970000000000001,"5min":1.73,"15min":1.73},"last":1.034}]},{"osd":1,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.95199999999999996,"15min":0.95499999999999996},"min":{"1min":0.68200000000000005,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.84599999999999997,"15min":0.83699999999999997},"min":{"1min":0.66600000000000004,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.024,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.097}]},{"osd":2,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.879,"15min":0.875},"min":{"1min":0.70799999999999996,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":0.85499999999999998},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1,"15min":1.004},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":1.121}]},{"osd":3,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.89900000000000002,"15min":0.88},"min":{"1min":0.80900000000000005,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.1679999999999999,"5min":1.22,"15min":1.22},"last":0.73999999999999999},{"interface":"front","average":{"1min":1.006,"5min":0.95799999999999996,"15min":0.95099999999999996},"min":{"1min":0.80100000000000005,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.4490000000000001,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.069}]},{"osd":5,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.96799999999999997,"15min":0.99399999999999999},"min":{"1min":0.67800000000000005,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.069,"5min":1.663,"15min":1.663},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.95399999999999996,"15min":0.98199999999999998},"min":{"1min":0.58099999999999996,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.111,"5min":1.353,"15min":1.353},"last":1.179}]},{"osd":6,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":1.002,"15min":1.028},"min":{"1min":0.63100000000000001,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.5720000000000001,"5min":2.2639999999999998,"15min":2.2639999999999998},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0720000000000001,"15min":1.0760000000000001},"min":{"1min":0.81200000000000006,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":1.1970000000000001}]},{"osd":7,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.98399999999999999,"15min":0.99399999999999999},"min":{"1min":0.68899999999999995,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.1950000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.012,"5min":1.0529999999999999,"15min":1.071},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.2390000000000001,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":1.1539999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574896,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31648,"kb_used_data":600,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340192,"statfs":{"total":96636764160,"available":96604356608,"internally_reserved":0,"allocated":614400,"data_stored":261487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.57799999999999996,"15min":0.57199999999999995},"min":{"1min":0.51400000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.63500000000000001,"15min":0.63100000000000001},"min":{"1min":0.56000000000000005,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.65100000000000002}]},{"osd":1,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.64400000000000002,"15min":0.622},"min":{"1min":0.51000000000000001,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.72099999999999997,"15min":0.71599999999999997},"min":{"1min":0.56100000000000005,"5min":0.318,"15min":0.318},"max":{"1min":0.98899999999999999,"5min":1.411,"15min":1.411},"last":0.94299999999999995}]},{"osd":2,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.76100000000000001,"15min":0.75},"min":{"1min":0.63500000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.167,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.75900000000000001,"15min":0.74199999999999999},"min":{"1min":0.65200000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.1970000000000001,"5min":1.264,"15min":1.264},"last":0.69699999999999995}]},{"osd":4,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96099999999999997,"15min":0.96899999999999997},"min":{"1min":0.79800000000000004,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.3089999999999999,"5min":1.488,"15min":1.488},"last":0.76500000000000001},{"interface":"front","average":{"1min":1.052,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.82099999999999995,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.345,"5min":1.458,"15min":1.458},"last":0.91500000000000004}]},{"osd":5,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.0369999999999999,"15min":1.0589999999999999},"min":{"1min":0.80400000000000005,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.268,"5min":2.024,"15min":2.024},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.101,"5min":1.026,"15min":1.014},"min":{"1min":0.83899999999999997,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.29,"5min":1.724,"15min":1.724},"last":0.996}]},{"osd":6,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.0489999999999999,"15min":1.0469999999999999},"min":{"1min":0.92400000000000004,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.3300000000000001,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":1.071,"5min":1.0589999999999999,"15min":1.0720000000000001},"min":{"1min":0.90700000000000003,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.302,"5min":1.78,"15min":1.78},"last":0.88100000000000001}]},{"osd":7,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.101,"15min":1.1279999999999999},"min":{"1min":0.82799999999999996,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.3959999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.97299999999999998},{"interface":"front","average":{"1min":1.212,"5min":1.089,"15min":1.0740000000000001},"min":{"1min":1.0049999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.468,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":0.96399999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574897,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31648,"kb_used_data":600,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340192,"statfs":{"total":96636764160,"available":96604356608,"internally_reserved":0,"allocated":614400,"data_stored":262484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.60099999999999998,"15min":0.58799999999999997},"min":{"1min":0.498,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.97799999999999998,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.50800000000000001,"5min":0.378,"15min":0.378},"max":{"1min":1.024,"5min":1.224,"15min":1.224},"last":1.0580000000000001}]},{"osd":1,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.65000000000000002,"15min":0.64600000000000002},"min":{"1min":0.53400000000000003,"5min":0.307,"15min":0.307},"max":{"1min":0.89500000000000002,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.72299999999999998,"15min":0.68999999999999995},"min":{"1min":0.64700000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.86899999999999999}]},{"osd":3,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.73599999999999999,"15min":0.70599999999999996},"min":{"1min":0.64900000000000002,"5min":0.377,"15min":0.377},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.746},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.749,"15min":0.746},"min":{"1min":0.64700000000000002,"5min":0.252,"15min":0.252},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":1.3340000000000001}]},{"osd":4,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.91900000000000004,"15min":0.91500000000000004},"min":{"1min":0.81000000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.097,"5min":1.0349999999999999,"15min":1.038},"min":{"1min":0.88600000000000001,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.476,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":1.272}]},{"osd":5,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.016,"15min":1.016},"min":{"1min":0.82699999999999996,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.379,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.002,"15min":0.97799999999999998},"min":{"1min":0.77100000000000002,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.377,"5min":1.667,"15min":1.667},"last":1.4119999999999999}]},{"osd":6,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.0429999999999999,"15min":1.0229999999999999},"min":{"1min":0.84299999999999997,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.3049999999999999,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":1.1140000000000001},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.034,"15min":1.032},"min":{"1min":0.89400000000000002,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.4299999999999999,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":1.546}]},{"osd":7,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.099,"15min":1.099},"min":{"1min":0.82399999999999995,"5min":0.62,"15min":0.62},"max":{"1min":1.4339999999999999,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.458},{"interface":"front","average":{"1min":1.153,"5min":1.0980000000000001,"15min":1.0760000000000001},"min":{"1min":0.95499999999999996,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.4239999999999999,"5min":1.752,"15min":1.752},"last":1.5920000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574899,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31640,"kb_used_data":592,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340200,"statfs":{"total":96636764160,"available":96604364800,"internally_reserved":0,"allocated":606208,"data_stored":260061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.67100000000000004,"15min":0.66100000000000003},"min":{"1min":0.47999999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.71999999999999997,"15min":0.68600000000000005},"min":{"1min":0.63400000000000001,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.0369999999999999,"5min":1.694,"15min":1.694},"last":0.38800000000000001}]},{"osd":2,"last update":"Sat Jun 10 18:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.64400000000000002,"15min":0.623},"min":{"1min":0.53500000000000003,"5min":0.249,"15min":0.249},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.877,"5min":0.70199999999999996,"15min":0.65800000000000003},"min":{"1min":0.65600000000000003,"5min":0.315,"15min":0.315},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":0.40000000000000002}]},{"osd":3,"last update":"Sat Jun 10 18:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.77800000000000002,"15min":0.745},"min":{"1min":0.65900000000000003,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.376},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.76100000000000001,"15min":0.749},"min":{"1min":0.58499999999999996,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.1100000000000001,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":0.36299999999999999}]},{"osd":4,"last update":"Sat Jun 10 18:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.87,"15min":0.83599999999999997},"min":{"1min":0.73399999999999999,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.80600000000000005},{"interface":"front","average":{"1min":1.087,"5min":1.1160000000000001,"15min":1.079},"min":{"1min":0.78500000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.5449999999999999,"5min":5.8209999999999997,"15min":5.8209999999999997},"last":0.58899999999999997}]},{"osd":5,"last update":"Sat Jun 10 18:55:44 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.032,"15min":1.028},"min":{"1min":0.75800000000000001,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.4550000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0129999999999999,"15min":0.97099999999999997},"min":{"1min":0.754,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.3819999999999999,"5min":3.089,"15min":3.089},"last":0.60699999999999998}]},{"osd":6,"last update":"Sat Jun 10 18:55:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.105,"15min":1.0309999999999999},"min":{"1min":0.75900000000000001,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.5249999999999999,"5min":7.2599999999999998,"15min":7.2599999999999998},"last":0.56200000000000006},{"interface":"front","average":{"1min":1.081,"5min":1.107,"15min":1.0309999999999999},"min":{"1min":0.80800000000000005,"5min":0.622,"15min":0.622},"max":{"1min":1.591,"5min":9.0069999999999997,"15min":9.0069999999999997},"last":0.72699999999999998}]},{"osd":7,"last update":"Sat Jun 10 18:55:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.0980000000000001,"15min":1.083},"min":{"1min":0.89300000000000002,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.6879999999999999,"5min":2.105,"15min":2.105},"last":0.67800000000000005},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.085,"15min":1.0669999999999999},"min":{"1min":0.90200000000000002,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.573,"5min":2.2570000000000001,"15min":2.2570000000000001},"last":0.77400000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574898,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32220,"kb_used_data":1172,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339620,"statfs":{"total":96636764160,"available":96603770880,"internally_reserved":0,"allocated":1200128,"data_stored":850325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.61299999999999999,"15min":0.59899999999999998},"min":{"1min":0.51000000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.77200000000000002,"15min":0.746},"min":{"1min":0.70899999999999996,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.0469999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.68200000000000005}]},{"osd":2,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.71099999999999997,"15min":0.69799999999999995},"min":{"1min":0.51900000000000002,"5min":0.313,"15min":0.313},"max":{"1min":1.0269999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.64600000000000002,"15min":0.63},"min":{"1min":0.55700000000000005,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.96799999999999997,"5min":1.371,"15min":1.371},"last":0.317}]},{"osd":3,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.68200000000000005,"15min":0.67000000000000004},"min":{"1min":0.55800000000000005,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.1930000000000001,"5min":1.226,"15min":1.226},"last":0.377},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.82899999999999996,"15min":0.81000000000000005},"min":{"1min":0.65800000000000003,"5min":0.375,"15min":0.375},"max":{"1min":1.262,"5min":1.829,"15min":1.829},"last":0.435}]},{"osd":4,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.90000000000000002,"15min":0.88900000000000001},"min":{"1min":0.75600000000000001,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.1579999999999999,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.0369999999999999,"15min":1.034},"min":{"1min":0.86099999999999999,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.228,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":0.70299999999999996}]},{"osd":5,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.96099999999999997,"15min":0.95799999999999996},"min":{"1min":0.67300000000000004,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.351,"5min":1.694,"15min":1.694},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.99099999999999999,"5min":1,"15min":0.998},"min":{"1min":0.72999999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.1870000000000001,"5min":1.75,"15min":1.75},"last":0.57399999999999995}]},{"osd":6,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.0700000000000001,"15min":1.056},"min":{"1min":0.93899999999999995,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.331,"5min":2.04,"15min":2.04},"last":0.65900000000000003},{"interface":"front","average":{"1min":1.0409999999999999,"5min":0.996,"15min":0.997},"min":{"1min":0.76100000000000001,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.444,"5min":1.883,"15min":1.883},"last":0.81599999999999995}]},{"osd":7,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.0369999999999999,"15min":1.0329999999999999},"min":{"1min":0.77200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.397,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.79100000000000004},{"interface":"front","average":{"1min":1.077,"5min":1.056,"15min":1.05},"min":{"1min":0.93200000000000005,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.298,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":0.69299999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-10T18:56:27.356 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-10T18:56:27.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.487+0000 7f7b269b9640 1 Processor -- start 2023-06-10T18:56:27.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.487+0000 7f7b269b9640 1 -- start start 2023-06-10T18:56:27.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.491+0000 7f7b269b9640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7b20159450 0x7f7b2015d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:27.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.491+0000 7f7b269b9640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7b2015d680 0x7f7b200cec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:27.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.491+0000 7f7b269b9640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b200cbac0 con 0x7f7b200cf180 2023-06-10T18:56:27.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.491+0000 7f7b269b9640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b200cf5c0 con 0x7f7b20159450 2023-06-10T18:56:27.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.491+0000 7f7b269b9640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b2015dc00 con 0x7f7b2015d680 2023-06-10T18:56:27.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.491+0000 7f7b1ffff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7b20159450 0x7f7b2015d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:27.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.491+0000 7f7b1ffff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7b20159450 0x7f7b2015d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59278/0 (socket says 172.21.15.53:59278) 2023-06-10T18:56:27.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.491+0000 7f7b1ffff640 1 -- 172.21.15.53:0/2419875448 learned_addr learned my addr 172.21.15.53:0/2419875448 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:27.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.491+0000 7f7b1f7fe640 1 --2- 172.21.15.53:0/2419875448 >> v2:172.21.15.117:3300/0 conn(0x7f7b2015d680 0x7f7b200cec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:27.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.491+0000 7f7b1ffff640 1 -- 172.21.15.53:0/2419875448 >> v2:172.21.15.117:3300/0 conn(0x7f7b2015d680 msgr2=0x7f7b200cec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:27.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.491+0000 7f7b1ffff640 1 --2- 172.21.15.53:0/2419875448 >> v2:172.21.15.117:3300/0 conn(0x7f7b2015d680 0x7f7b200cec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:27.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.491+0000 7f7b1ffff640 1 -- 172.21.15.53:0/2419875448 >> v1:172.21.15.117:6789/0 conn(0x7f7b200cf180 legacy=0x7f7b200cda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:27.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.491+0000 7f7b1ffff640 1 -- 172.21.15.53:0/2419875448 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b2015dee0 con 0x7f7b20159450 2023-06-10T18:56:27.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.491+0000 7f7b1ffff640 1 --2- 172.21.15.53:0/2419875448 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b20159450 0x7f7b2015d140 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f7b2006df40 tx=0x7f7b1001c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eda720d33838a0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:27.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.491+0000 7f7b1effd640 1 -- 172.21.15.53:0/2419875448 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b100a57e0 con 0x7f7b20159450 2023-06-10T18:56:27.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.491+0000 7f7b1effd640 1 -- 172.21.15.53:0/2419875448 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b100a5940 con 0x7f7b20159450 2023-06-10T18:56:27.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.491+0000 7f7b1effd640 1 -- 172.21.15.53:0/2419875448 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b100a5cd0 con 0x7f7b20159450 2023-06-10T18:56:27.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.495+0000 7f7b269b9640 1 -- 172.21.15.53:0/2419875448 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b20159450 msgr2=0x7f7b2015d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:27.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.495+0000 7f7b269b9640 1 --2- 172.21.15.53:0/2419875448 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b20159450 0x7f7b2015d140 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f7b2006df40 tx=0x7f7b1001c960 comp rx=0 tx=0).stop 2023-06-10T18:56:27.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.495+0000 7f7b269b9640 1 -- 172.21.15.53:0/2419875448 shutdown_connections 2023-06-10T18:56:27.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.495+0000 7f7b269b9640 1 --2- 172.21.15.53:0/2419875448 >> v2:172.21.15.117:3300/0 conn(0x7f7b2015d680 0x7f7b200cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:27.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.495+0000 7f7b269b9640 1 --2- 172.21.15.53:0/2419875448 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b20159450 0x7f7b2015d140 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:27.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.495+0000 7f7b269b9640 1 -- 172.21.15.53:0/2419875448 >> 172.21.15.53:0/2419875448 conn(0x7f7b2006a090 msgr2=0x7f7b2006d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:27.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.495+0000 7f7b269b9640 1 -- 172.21.15.53:0/2419875448 shutdown_connections 2023-06-10T18:56:27.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.495+0000 7f7b269b9640 1 -- 172.21.15.53:0/2419875448 wait complete. 2023-06-10T18:56:27.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.495+0000 7f7b269b9640 1 Processor -- start 2023-06-10T18:56:27.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.495+0000 7f7b269b9640 1 -- start start 2023-06-10T18:56:27.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.495+0000 7f7b269b9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7b200cf180 0x7f7b20158020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:27.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.495+0000 7f7b269b9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b20159450 0x7f7b20157910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:27.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.495+0000 7f7b269b9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7b2015d680 0x7f7b200c83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:27.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.495+0000 7f7b269b9640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b200a7450 con 0x7f7b20159450 2023-06-10T18:56:27.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.495+0000 7f7b269b9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b20157e50 con 0x7f7b200cf180 2023-06-10T18:56:27.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.495+0000 7f7b269b9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b2015be20 con 0x7f7b2015d680 2023-06-10T18:56:27.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.495+0000 7f7b1f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b20159450 0x7f7b20157910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:27.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.495+0000 7f7b1f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b20159450 0x7f7b20157910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59294/0 (socket says 172.21.15.53:59294) 2023-06-10T18:56:27.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.495+0000 7f7b1f7fe640 1 -- 172.21.15.53:0/480629478 learned_addr learned my addr 172.21.15.53:0/480629478 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:27.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.495+0000 7f7b1ffff640 1 --2- 172.21.15.53:0/480629478 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7b200cf180 0x7f7b20158020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:27.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.495+0000 7f7b1f7fe640 1 -- 172.21.15.53:0/480629478 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7b2015d680 msgr2=0x7f7b200c83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:27.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.495+0000 7f7b24f56640 1 --2- 172.21.15.53:0/480629478 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7b2015d680 0x7f7b200c83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:27.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.495+0000 7f7b1f7fe640 1 --2- 172.21.15.53:0/480629478 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7b2015d680 0x7f7b200c83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:27.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.495+0000 7f7b1f7fe640 1 -- 172.21.15.53:0/480629478 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7b200cf180 msgr2=0x7f7b20158020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:27.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.495+0000 7f7b1f7fe640 1 --2- 172.21.15.53:0/480629478 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7b200cf180 0x7f7b20158020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:27.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.495+0000 7f7b1f7fe640 1 -- 172.21.15.53:0/480629478 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b10009b30 con 0x7f7b20159450 2023-06-10T18:56:27.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.495+0000 7f7b24f56640 1 --2- 172.21.15.53:0/480629478 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7b2015d680 0x7f7b200c83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:56:27.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.495+0000 7f7b1f7fe640 1 --2- 172.21.15.53:0/480629478 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b20159450 0x7f7b20157910 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f7b1400d5f0 tx=0x7f7b1400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:27.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.495+0000 7f7b1cff9640 1 -- 172.21.15.53:0/480629478 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b140125f0 con 0x7f7b20159450 2023-06-10T18:56:27.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.495+0000 7f7b1cff9640 1 -- 172.21.15.53:0/480629478 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b14012750 con 0x7f7b20159450 2023-06-10T18:56:27.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.495+0000 7f7b269b9640 1 -- 172.21.15.53:0/480629478 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b2015a630 con 0x7f7b20159450 2023-06-10T18:56:27.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.495+0000 7f7b1cff9640 1 -- 172.21.15.53:0/480629478 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b14012ae0 con 0x7f7b20159450 2023-06-10T18:56:27.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.495+0000 7f7b269b9640 1 -- 172.21.15.53:0/480629478 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b2015abf0 con 0x7f7b20159450 2023-06-10T18:56:27.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.499+0000 7f7b269b9640 1 -- 172.21.15.53:0/480629478 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b2004d790 con 0x7f7b20159450 2023-06-10T18:56:27.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.499+0000 7f7b1cff9640 1 -- 172.21.15.53:0/480629478 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7b14012c40 con 0x7f7b20159450 2023-06-10T18:56:27.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.499+0000 7f7b1cff9640 1 --2- 172.21.15.53:0/480629478 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7b0c066280 0x7f7b0c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:27.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.499+0000 7f7b1cff9640 1 -- 172.21.15.53:0/480629478 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f7b140842a0 con 0x7f7b20159450 2023-06-10T18:56:27.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.499+0000 7f7b1ffff640 1 --2- 172.21.15.53:0/480629478 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7b0c066280 0x7f7b0c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:27.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.499+0000 7f7b1ffff640 1 --2- 172.21.15.53:0/480629478 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7b0c066280 0x7f7b0c068730 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f7b100ae000 tx=0x7f7b100a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:27.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.503+0000 7f7b1cff9640 1 -- 172.21.15.53:0/480629478 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7b140516e0 con 0x7f7b20159450 2023-06-10T18:56:27.660 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.655+0000 7f7b269b9640 1 -- 172.21.15.53:0/480629478 --> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7b200b1af0 con 0x7f7b0c066280 2023-06-10T18:56:27.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.679+0000 7f7b1cff9640 1 -- 172.21.15.53:0/480629478 <== mgr.4105 v2:172.21.15.117:6832/3061986771 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+309197 (secure 0 0 0) 0x7f7b100091d0 con 0x7f7b0c066280 2023-06-10T18:56:27.687 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:56:27.688 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-06-10T18:56:27.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.683+0000 7f7b269b9640 1 -- 172.21.15.53:0/480629478 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7b0c066280 msgr2=0x7f7b0c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:27.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.683+0000 7f7b269b9640 1 --2- 172.21.15.53:0/480629478 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7b0c066280 0x7f7b0c068730 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f7b100ae000 tx=0x7f7b100a7070 comp rx=0 tx=0).stop 2023-06-10T18:56:27.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.683+0000 7f7b269b9640 1 -- 172.21.15.53:0/480629478 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b20159450 msgr2=0x7f7b20157910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:27.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.683+0000 7f7b269b9640 1 --2- 172.21.15.53:0/480629478 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b20159450 0x7f7b20157910 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f7b1400d5f0 tx=0x7f7b1400dab0 comp rx=0 tx=0).stop 2023-06-10T18:56:27.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.683+0000 7f7b269b9640 1 -- 172.21.15.53:0/480629478 shutdown_connections 2023-06-10T18:56:27.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.683+0000 7f7b269b9640 1 --2- 172.21.15.53:0/480629478 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7b0c066280 0x7f7b0c068730 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:27.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.683+0000 7f7b269b9640 1 --2- 172.21.15.53:0/480629478 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7b2015d680 0x7f7b200c83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:27.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.683+0000 7f7b269b9640 1 --2- 172.21.15.53:0/480629478 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b20159450 0x7f7b20157910 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:27.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.683+0000 7f7b269b9640 1 --2- 172.21.15.53:0/480629478 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7b200cf180 0x7f7b20158020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:27.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.683+0000 7f7b269b9640 1 -- 172.21.15.53:0/480629478 >> 172.21.15.53:0/480629478 conn(0x7f7b2006a090 msgr2=0x7f7b200cd980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:27.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.683+0000 7f7b269b9640 1 -- 172.21.15.53:0/480629478 shutdown_connections 2023-06-10T18:56:27.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.683+0000 7f7b269b9640 1 -- 172.21.15.53:0/480629478 wait complete. 2023-06-10T18:56:27.707 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":163,"stamp":"2023-06-10T18:56:27.640414+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237976,"kb_used_data":5976,"kb_used_omap":0,"kb_used_meta":231936,"kb_avail":754736744,"statfs":{"total":773094113280,"available":772850425856,"internally_reserved":0,"allocated":6119424,"data_stored":3301653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":237502464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002819"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.887321+0000","last_change":"2023-06-10T18:56:18.723557+0000","last_active":"2023-06-10T18:56:26.887321+0000","last_peered":"2023-06-10T18:56:26.887321+0000","last_clean":"2023-06-10T18:56:26.887321+0000","last_became_active":"2023-06-10T18:56:18.723169+0000","last_became_peered":"2023-06-10T18:56:18.723169+0000","last_unstale":"2023-06-10T18:56:26.887321+0000","last_undegraded":"2023-06-10T18:56:26.887321+0000","last_fullsized":"2023-06-10T18:56:26.887321+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:05:32.467816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.144646+0000","last_change":"2023-06-10T18:56:18.739659+0000","last_active":"2023-06-10T18:56:27.144646+0000","last_peered":"2023-06-10T18:56:27.144646+0000","last_clean":"2023-06-10T18:56:27.144646+0000","last_became_active":"2023-06-10T18:56:18.738930+0000","last_became_peered":"2023-06-10T18:56:18.738930+0000","last_unstale":"2023-06-10T18:56:27.144646+0000","last_undegraded":"2023-06-10T18:56:27.144646+0000","last_fullsized":"2023-06-10T18:56:27.144646+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:56:20.150212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.882137+0000","last_change":"2023-06-10T18:56:18.715713+0000","last_active":"2023-06-10T18:56:26.882137+0000","last_peered":"2023-06-10T18:56:26.882137+0000","last_clean":"2023-06-10T18:56:26.882137+0000","last_became_active":"2023-06-10T18:56:18.715403+0000","last_became_peered":"2023-06-10T18:56:18.715403+0000","last_unstale":"2023-06-10T18:56:26.882137+0000","last_undegraded":"2023-06-10T18:56:26.882137+0000","last_fullsized":"2023-06-10T18:56:26.882137+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:13:39.804832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.144321+0000","last_change":"2023-06-10T18:56:18.742396+0000","last_active":"2023-06-10T18:56:27.144321+0000","last_peered":"2023-06-10T18:56:27.144321+0000","last_clean":"2023-06-10T18:56:27.144321+0000","last_became_active":"2023-06-10T18:56:18.741689+0000","last_became_peered":"2023-06-10T18:56:18.741689+0000","last_unstale":"2023-06-10T18:56:27.144321+0000","last_undegraded":"2023-06-10T18:56:27.144321+0000","last_fullsized":"2023-06-10T18:56:27.144321+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:15:14.281447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.871175+0000","last_change":"2023-06-10T18:56:18.733830+0000","last_active":"2023-06-10T18:56:26.871175+0000","last_peered":"2023-06-10T18:56:26.871175+0000","last_clean":"2023-06-10T18:56:26.871175+0000","last_became_active":"2023-06-10T18:56:18.732968+0000","last_became_peered":"2023-06-10T18:56:18.732968+0000","last_unstale":"2023-06-10T18:56:26.871175+0000","last_undegraded":"2023-06-10T18:56:26.871175+0000","last_fullsized":"2023-06-10T18:56:26.871175+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:17:50.531074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.886873+0000","last_change":"2023-06-10T18:56:18.733304+0000","last_active":"2023-06-10T18:56:26.886873+0000","last_peered":"2023-06-10T18:56:26.886873+0000","last_clean":"2023-06-10T18:56:26.886873+0000","last_became_active":"2023-06-10T18:56:18.733010+0000","last_became_peered":"2023-06-10T18:56:18.733010+0000","last_unstale":"2023-06-10T18:56:26.886873+0000","last_undegraded":"2023-06-10T18:56:26.886873+0000","last_fullsized":"2023-06-10T18:56:26.886873+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:04:11.756055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.879556+0000","last_change":"2023-06-10T18:56:18.715925+0000","last_active":"2023-06-10T18:56:26.879556+0000","last_peered":"2023-06-10T18:56:26.879556+0000","last_clean":"2023-06-10T18:56:26.879556+0000","last_became_active":"2023-06-10T18:56:18.715163+0000","last_became_peered":"2023-06-10T18:56:18.715163+0000","last_unstale":"2023-06-10T18:56:26.879556+0000","last_undegraded":"2023-06-10T18:56:26.879556+0000","last_fullsized":"2023-06-10T18:56:26.879556+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:07:15.569502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.194669+0000","last_change":"2023-06-10T18:56:18.710693+0000","last_active":"2023-06-10T18:56:27.194669+0000","last_peered":"2023-06-10T18:56:27.194669+0000","last_clean":"2023-06-10T18:56:27.194669+0000","last_became_active":"2023-06-10T18:56:18.710420+0000","last_became_peered":"2023-06-10T18:56:18.710420+0000","last_unstale":"2023-06-10T18:56:27.194669+0000","last_undegraded":"2023-06-10T18:56:27.194669+0000","last_fullsized":"2023-06-10T18:56:27.194669+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:04:11.756055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.195404+0000","last_change":"2023-06-10T18:56:18.711205+0000","last_active":"2023-06-10T18:56:27.195404+0000","last_peered":"2023-06-10T18:56:27.195404+0000","last_clean":"2023-06-10T18:56:27.195404+0000","last_became_active":"2023-06-10T18:56:18.711011+0000","last_became_peered":"2023-06-10T18:56:18.711011+0000","last_unstale":"2023-06-10T18:56:27.195404+0000","last_undegraded":"2023-06-10T18:56:27.195404+0000","last_fullsized":"2023-06-10T18:56:27.195404+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:52:30.517410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.887403+0000","last_change":"2023-06-10T18:56:18.731703+0000","last_active":"2023-06-10T18:56:26.887403+0000","last_peered":"2023-06-10T18:56:26.887403+0000","last_clean":"2023-06-10T18:56:26.887403+0000","last_became_active":"2023-06-10T18:56:18.731407+0000","last_became_peered":"2023-06-10T18:56:18.731407+0000","last_unstale":"2023-06-10T18:56:26.887403+0000","last_undegraded":"2023-06-10T18:56:26.887403+0000","last_fullsized":"2023-06-10T18:56:26.887403+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:13:39.804832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.868234+0000","last_change":"2023-06-10T18:56:18.739026+0000","last_active":"2023-06-10T18:56:26.868234+0000","last_peered":"2023-06-10T18:56:26.868234+0000","last_clean":"2023-06-10T18:56:26.868234+0000","last_became_active":"2023-06-10T18:56:18.738748+0000","last_became_peered":"2023-06-10T18:56:18.738748+0000","last_unstale":"2023-06-10T18:56:26.868234+0000","last_undegraded":"2023-06-10T18:56:26.868234+0000","last_fullsized":"2023-06-10T18:56:26.868234+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:11:27.241616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.195269+0000","last_change":"2023-06-10T18:56:18.711319+0000","last_active":"2023-06-10T18:56:27.195269+0000","last_peered":"2023-06-10T18:56:27.195269+0000","last_clean":"2023-06-10T18:56:27.195269+0000","last_became_active":"2023-06-10T18:56:18.711043+0000","last_became_peered":"2023-06-10T18:56:18.711043+0000","last_unstale":"2023-06-10T18:56:27.195269+0000","last_undegraded":"2023-06-10T18:56:27.195269+0000","last_fullsized":"2023-06-10T18:56:27.195269+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:05:32.467816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.886977+0000","last_change":"2023-06-10T18:56:18.735130+0000","last_active":"2023-06-10T18:56:26.886977+0000","last_peered":"2023-06-10T18:56:26.886977+0000","last_clean":"2023-06-10T18:56:26.886977+0000","last_became_active":"2023-06-10T18:56:18.734873+0000","last_became_peered":"2023-06-10T18:56:18.734873+0000","last_unstale":"2023-06-10T18:56:26.886977+0000","last_undegraded":"2023-06-10T18:56:26.886977+0000","last_fullsized":"2023-06-10T18:56:26.886977+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:27:56.626985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.879977+0000","last_change":"2023-06-10T18:56:18.718525+0000","last_active":"2023-06-10T18:56:26.879977+0000","last_peered":"2023-06-10T18:56:26.879977+0000","last_clean":"2023-06-10T18:56:26.879977+0000","last_became_active":"2023-06-10T18:56:18.718169+0000","last_became_peered":"2023-06-10T18:56:18.718169+0000","last_unstale":"2023-06-10T18:56:26.879977+0000","last_undegraded":"2023-06-10T18:56:26.879977+0000","last_fullsized":"2023-06-10T18:56:26.879977+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:17:01.114014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.144057+0000","last_change":"2023-06-10T18:56:18.747220+0000","last_active":"2023-06-10T18:56:27.144057+0000","last_peered":"2023-06-10T18:56:27.144057+0000","last_clean":"2023-06-10T18:56:27.144057+0000","last_became_active":"2023-06-10T18:56:18.746415+0000","last_became_peered":"2023-06-10T18:56:18.746415+0000","last_unstale":"2023-06-10T18:56:27.144057+0000","last_undegraded":"2023-06-10T18:56:27.144057+0000","last_fullsized":"2023-06-10T18:56:27.144057+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:02:03.688477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.886572+0000","last_change":"2023-06-10T18:56:18.732379+0000","last_active":"2023-06-10T18:56:26.886572+0000","last_peered":"2023-06-10T18:56:26.886572+0000","last_clean":"2023-06-10T18:56:26.886572+0000","last_became_active":"2023-06-10T18:56:18.732081+0000","last_became_peered":"2023-06-10T18:56:18.732081+0000","last_unstale":"2023-06-10T18:56:26.886572+0000","last_undegraded":"2023-06-10T18:56:26.886572+0000","last_fullsized":"2023-06-10T18:56:26.886572+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:17:50.531074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.880795+0000","last_change":"2023-06-10T18:56:18.727402+0000","last_active":"2023-06-10T18:56:26.880795+0000","last_peered":"2023-06-10T18:56:26.880795+0000","last_clean":"2023-06-10T18:56:26.880795+0000","last_became_active":"2023-06-10T18:56:18.726939+0000","last_became_peered":"2023-06-10T18:56:18.726939+0000","last_unstale":"2023-06-10T18:56:26.880795+0000","last_undegraded":"2023-06-10T18:56:26.880795+0000","last_fullsized":"2023-06-10T18:56:26.880795+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:57:17.090045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.144764+0000","last_change":"2023-06-10T18:56:18.741248+0000","last_active":"2023-06-10T18:56:27.144764+0000","last_peered":"2023-06-10T18:56:27.144764+0000","last_clean":"2023-06-10T18:56:27.144764+0000","last_became_active":"2023-06-10T18:56:18.740548+0000","last_became_peered":"2023-06-10T18:56:18.740548+0000","last_unstale":"2023-06-10T18:56:27.144764+0000","last_undegraded":"2023-06-10T18:56:27.144764+0000","last_fullsized":"2023-06-10T18:56:27.144764+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:51:41.177614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.880542+0000","last_change":"2023-06-10T18:56:18.718426+0000","last_active":"2023-06-10T18:56:26.880542+0000","last_peered":"2023-06-10T18:56:26.880542+0000","last_clean":"2023-06-10T18:56:26.880542+0000","last_became_active":"2023-06-10T18:56:18.718017+0000","last_became_peered":"2023-06-10T18:56:18.718017+0000","last_unstale":"2023-06-10T18:56:26.880542+0000","last_undegraded":"2023-06-10T18:56:26.880542+0000","last_fullsized":"2023-06-10T18:56:26.880542+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:36:56.932324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.875458+0000","last_change":"2023-06-10T18:56:18.734189+0000","last_active":"2023-06-10T18:56:26.875458+0000","last_peered":"2023-06-10T18:56:26.875458+0000","last_clean":"2023-06-10T18:56:26.875458+0000","last_became_active":"2023-06-10T18:56:18.733412+0000","last_became_peered":"2023-06-10T18:56:18.733412+0000","last_unstale":"2023-06-10T18:56:26.875458+0000","last_undegraded":"2023-06-10T18:56:26.875458+0000","last_fullsized":"2023-06-10T18:56:26.875458+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:59:44.756321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.875364+0000","last_change":"2023-06-10T18:56:18.737307+0000","last_active":"2023-06-10T18:56:26.875364+0000","last_peered":"2023-06-10T18:56:26.875364+0000","last_clean":"2023-06-10T18:56:26.875364+0000","last_became_active":"2023-06-10T18:56:18.736534+0000","last_became_peered":"2023-06-10T18:56:18.736534+0000","last_unstale":"2023-06-10T18:56:26.875364+0000","last_undegraded":"2023-06-10T18:56:26.875364+0000","last_fullsized":"2023-06-10T18:56:26.875364+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:01:44.663641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.194660+0000","last_change":"2023-06-10T18:56:18.710819+0000","last_active":"2023-06-10T18:56:27.194660+0000","last_peered":"2023-06-10T18:56:27.194660+0000","last_clean":"2023-06-10T18:56:27.194660+0000","last_became_active":"2023-06-10T18:56:18.710524+0000","last_became_peered":"2023-06-10T18:56:18.710524+0000","last_unstale":"2023-06-10T18:56:27.194660+0000","last_undegraded":"2023-06-10T18:56:27.194660+0000","last_fullsized":"2023-06-10T18:56:27.194660+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:16:44.545696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.867692+0000","last_change":"2023-06-10T18:56:18.739719+0000","last_active":"2023-06-10T18:56:26.867692+0000","last_peered":"2023-06-10T18:56:26.867692+0000","last_clean":"2023-06-10T18:56:26.867692+0000","last_became_active":"2023-06-10T18:56:18.739394+0000","last_became_peered":"2023-06-10T18:56:18.739394+0000","last_unstale":"2023-06-10T18:56:26.867692+0000","last_undegraded":"2023-06-10T18:56:26.867692+0000","last_fullsized":"2023-06-10T18:56:26.867692+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:48:22.699885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.879440+0000","last_change":"2023-06-10T18:56:18.716014+0000","last_active":"2023-06-10T18:56:26.879440+0000","last_peered":"2023-06-10T18:56:26.879440+0000","last_clean":"2023-06-10T18:56:26.879440+0000","last_became_active":"2023-06-10T18:56:18.715463+0000","last_became_peered":"2023-06-10T18:56:18.715463+0000","last_unstale":"2023-06-10T18:56:26.879440+0000","last_undegraded":"2023-06-10T18:56:26.879440+0000","last_fullsized":"2023-06-10T18:56:26.879440+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:40:33.066988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.881131+0000","last_change":"2023-06-10T18:56:18.722488+0000","last_active":"2023-06-10T18:56:26.881131+0000","last_peered":"2023-06-10T18:56:26.881131+0000","last_clean":"2023-06-10T18:56:26.881131+0000","last_became_active":"2023-06-10T18:56:18.722221+0000","last_became_peered":"2023-06-10T18:56:18.722221+0000","last_unstale":"2023-06-10T18:56:26.881131+0000","last_undegraded":"2023-06-10T18:56:26.881131+0000","last_fullsized":"2023-06-10T18:56:26.881131+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:16:44.545696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.195014+0000","last_change":"2023-06-10T18:56:18.721449+0000","last_active":"2023-06-10T18:56:27.195014+0000","last_peered":"2023-06-10T18:56:27.195014+0000","last_clean":"2023-06-10T18:56:27.195014+0000","last_became_active":"2023-06-10T18:56:18.721191+0000","last_became_peered":"2023-06-10T18:56:18.721191+0000","last_unstale":"2023-06-10T18:56:27.195014+0000","last_undegraded":"2023-06-10T18:56:27.195014+0000","last_fullsized":"2023-06-10T18:56:27.195014+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:18:25.090460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.888495+0000","last_change":"2023-06-10T18:56:18.719671+0000","last_active":"2023-06-10T18:56:26.888495+0000","last_peered":"2023-06-10T18:56:26.888495+0000","last_clean":"2023-06-10T18:56:26.888495+0000","last_became_active":"2023-06-10T18:56:18.718588+0000","last_became_peered":"2023-06-10T18:56:18.718588+0000","last_unstale":"2023-06-10T18:56:26.888495+0000","last_undegraded":"2023-06-10T18:56:26.888495+0000","last_fullsized":"2023-06-10T18:56:26.888495+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:57:04.253762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.875781+0000","last_change":"2023-06-10T18:56:18.720108+0000","last_active":"2023-06-10T18:56:26.875781+0000","last_peered":"2023-06-10T18:56:26.875781+0000","last_clean":"2023-06-10T18:56:26.875781+0000","last_became_active":"2023-06-10T18:56:18.719242+0000","last_became_peered":"2023-06-10T18:56:18.719242+0000","last_unstale":"2023-06-10T18:56:26.875781+0000","last_undegraded":"2023-06-10T18:56:26.875781+0000","last_fullsized":"2023-06-10T18:56:26.875781+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:41:27.064954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.879750+0000","last_change":"2023-06-10T18:56:18.747959+0000","last_active":"2023-06-10T18:56:26.879750+0000","last_peered":"2023-06-10T18:56:26.879750+0000","last_clean":"2023-06-10T18:56:26.879750+0000","last_became_active":"2023-06-10T18:56:18.747680+0000","last_became_peered":"2023-06-10T18:56:18.747680+0000","last_unstale":"2023-06-10T18:56:26.879750+0000","last_undegraded":"2023-06-10T18:56:26.879750+0000","last_fullsized":"2023-06-10T18:56:26.879750+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:22:48.846033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.144212+0000","last_change":"2023-06-10T18:56:18.740103+0000","last_active":"2023-06-10T18:56:27.144212+0000","last_peered":"2023-06-10T18:56:27.144212+0000","last_clean":"2023-06-10T18:56:27.144212+0000","last_became_active":"2023-06-10T18:56:18.739227+0000","last_became_peered":"2023-06-10T18:56:18.739227+0000","last_unstale":"2023-06-10T18:56:27.144212+0000","last_undegraded":"2023-06-10T18:56:27.144212+0000","last_fullsized":"2023-06-10T18:56:27.144212+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:21:25.069656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.879705+0000","last_change":"2023-06-10T18:56:18.715535+0000","last_active":"2023-06-10T18:56:26.879705+0000","last_peered":"2023-06-10T18:56:26.879705+0000","last_clean":"2023-06-10T18:56:26.879705+0000","last_became_active":"2023-06-10T18:56:18.714677+0000","last_became_peered":"2023-06-10T18:56:18.714677+0000","last_unstale":"2023-06-10T18:56:26.879705+0000","last_undegraded":"2023-06-10T18:56:26.879705+0000","last_fullsized":"2023-06-10T18:56:26.879705+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:12:02.143937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.871827+0000","last_change":"2023-06-10T18:56:18.705775+0000","last_active":"2023-06-10T18:56:26.871827+0000","last_peered":"2023-06-10T18:56:26.871827+0000","last_clean":"2023-06-10T18:56:26.871827+0000","last_became_active":"2023-06-10T18:56:18.703437+0000","last_became_peered":"2023-06-10T18:56:18.703437+0000","last_unstale":"2023-06-10T18:56:26.871827+0000","last_undegraded":"2023-06-10T18:56:26.871827+0000","last_fullsized":"2023-06-10T18:56:26.871827+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:03:07.190449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.143717+0000","last_change":"2023-06-10T18:56:18.740486+0000","last_active":"2023-06-10T18:56:27.143717+0000","last_peered":"2023-06-10T18:56:27.143717+0000","last_clean":"2023-06-10T18:56:27.143717+0000","last_became_active":"2023-06-10T18:56:18.739644+0000","last_became_peered":"2023-06-10T18:56:18.739644+0000","last_unstale":"2023-06-10T18:56:27.143717+0000","last_undegraded":"2023-06-10T18:56:27.143717+0000","last_fullsized":"2023-06-10T18:56:27.143717+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:30:31.600689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"50'4","reported_seq":19,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.876540+0000","last_change":"2023-06-10T18:56:18.340764+0000","last_active":"2023-06-10T18:56:26.876540+0000","last_peered":"2023-06-10T18:56:26.876540+0000","last_clean":"2023-06-10T18:56:26.876540+0000","last_became_active":"2023-06-10T18:56:18.340011+0000","last_became_peered":"2023-06-10T18:56:18.340011+0000","last_unstale":"2023-06-10T18:56:26.876540+0000","last_undegraded":"2023-06-10T18:56:26.876540+0000","last_fullsized":"2023-06-10T18:56:26.876540+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:11:50.546839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.873041+0000","last_change":"2023-06-10T18:56:18.735833+0000","last_active":"2023-06-10T18:56:26.873041+0000","last_peered":"2023-06-10T18:56:26.873041+0000","last_clean":"2023-06-10T18:56:26.873041+0000","last_became_active":"2023-06-10T18:56:18.734668+0000","last_became_peered":"2023-06-10T18:56:18.734668+0000","last_unstale":"2023-06-10T18:56:26.873041+0000","last_undegraded":"2023-06-10T18:56:26.873041+0000","last_fullsized":"2023-06-10T18:56:26.873041+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:16:35.200792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"50'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.887551+0000","last_change":"2023-06-10T18:56:18.335972+0000","last_active":"2023-06-10T18:56:26.887551+0000","last_peered":"2023-06-10T18:56:26.887551+0000","last_clean":"2023-06-10T18:56:26.887551+0000","last_became_active":"2023-06-10T18:56:18.335565+0000","last_became_peered":"2023-06-10T18:56:18.335565+0000","last_unstale":"2023-06-10T18:56:26.887551+0000","last_undegraded":"2023-06-10T18:56:26.887551+0000","last_fullsized":"2023-06-10T18:56:26.887551+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:52:29.503909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.875187+0000","last_change":"2023-06-10T18:56:18.741042+0000","last_active":"2023-06-10T18:56:26.875187+0000","last_peered":"2023-06-10T18:56:26.875187+0000","last_clean":"2023-06-10T18:56:26.875187+0000","last_became_active":"2023-06-10T18:56:18.740325+0000","last_became_peered":"2023-06-10T18:56:18.740325+0000","last_unstale":"2023-06-10T18:56:26.875187+0000","last_undegraded":"2023-06-10T18:56:26.875187+0000","last_fullsized":"2023-06-10T18:56:26.875187+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:45:27.842047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"50'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.888555+0000","last_change":"2023-06-10T18:56:18.336603+0000","last_active":"2023-06-10T18:56:26.888555+0000","last_peered":"2023-06-10T18:56:26.888555+0000","last_clean":"2023-06-10T18:56:26.888555+0000","last_became_active":"2023-06-10T18:56:18.336117+0000","last_became_peered":"2023-06-10T18:56:18.336117+0000","last_unstale":"2023-06-10T18:56:26.888555+0000","last_undegraded":"2023-06-10T18:56:26.888555+0000","last_fullsized":"2023-06-10T18:56:26.888555+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:41:56.108306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.194691+0000","last_change":"2023-06-10T18:56:18.719404+0000","last_active":"2023-06-10T18:56:27.194691+0000","last_peered":"2023-06-10T18:56:27.194691+0000","last_clean":"2023-06-10T18:56:27.194691+0000","last_became_active":"2023-06-10T18:56:18.719096+0000","last_became_peered":"2023-06-10T18:56:18.719096+0000","last_unstale":"2023-06-10T18:56:27.194691+0000","last_undegraded":"2023-06-10T18:56:27.194691+0000","last_fullsized":"2023-06-10T18:56:27.194691+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:33:38.472734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"50'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.872249+0000","last_change":"2023-06-10T18:56:18.323382+0000","last_active":"2023-06-10T18:56:26.872249+0000","last_peered":"2023-06-10T18:56:26.872249+0000","last_clean":"2023-06-10T18:56:26.872249+0000","last_became_active":"2023-06-10T18:56:18.322748+0000","last_became_peered":"2023-06-10T18:56:18.322748+0000","last_unstale":"2023-06-10T18:56:26.872249+0000","last_undegraded":"2023-06-10T18:56:26.872249+0000","last_fullsized":"2023-06-10T18:56:26.872249+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:35:54.887943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.872083+0000","last_change":"2023-06-10T18:56:18.716497+0000","last_active":"2023-06-10T18:56:26.872083+0000","last_peered":"2023-06-10T18:56:26.872083+0000","last_clean":"2023-06-10T18:56:26.872083+0000","last_became_active":"2023-06-10T18:56:18.715689+0000","last_became_peered":"2023-06-10T18:56:18.715689+0000","last_unstale":"2023-06-10T18:56:26.872083+0000","last_undegraded":"2023-06-10T18:56:26.872083+0000","last_fullsized":"2023-06-10T18:56:26.872083+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:27:56.626985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"50'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.880042+0000","last_change":"2023-06-10T18:56:18.321017+0000","last_active":"2023-06-10T18:56:26.880042+0000","last_peered":"2023-06-10T18:56:26.880042+0000","last_clean":"2023-06-10T18:56:26.880042+0000","last_became_active":"2023-06-10T18:56:18.320552+0000","last_became_peered":"2023-06-10T18:56:18.320552+0000","last_unstale":"2023-06-10T18:56:26.880042+0000","last_undegraded":"2023-06-10T18:56:26.880042+0000","last_fullsized":"2023-06-10T18:56:26.880042+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:53:30.066871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.144497+0000","last_change":"2023-06-10T18:56:18.742047+0000","last_active":"2023-06-10T18:56:27.144497+0000","last_peered":"2023-06-10T18:56:27.144497+0000","last_clean":"2023-06-10T18:56:27.144497+0000","last_became_active":"2023-06-10T18:56:18.741342+0000","last_became_peered":"2023-06-10T18:56:18.741342+0000","last_unstale":"2023-06-10T18:56:27.144497+0000","last_undegraded":"2023-06-10T18:56:27.144497+0000","last_fullsized":"2023-06-10T18:56:27.144497+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:39:30.440026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"50'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.871399+0000","last_change":"2023-06-10T18:56:18.339655+0000","last_active":"2023-06-10T18:56:26.871399+0000","last_peered":"2023-06-10T18:56:26.871399+0000","last_clean":"2023-06-10T18:56:26.871399+0000","last_became_active":"2023-06-10T18:56:18.338930+0000","last_became_peered":"2023-06-10T18:56:18.338930+0000","last_unstale":"2023-06-10T18:56:26.871399+0000","last_undegraded":"2023-06-10T18:56:26.871399+0000","last_fullsized":"2023-06-10T18:56:26.871399+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:57:16.076543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.195762+0000","last_change":"2023-06-10T18:56:18.721372+0000","last_active":"2023-06-10T18:56:27.195762+0000","last_peered":"2023-06-10T18:56:27.195762+0000","last_clean":"2023-06-10T18:56:27.195762+0000","last_became_active":"2023-06-10T18:56:18.721086+0000","last_became_peered":"2023-06-10T18:56:18.721086+0000","last_unstale":"2023-06-10T18:56:27.195762+0000","last_undegraded":"2023-06-10T18:56:27.195762+0000","last_fullsized":"2023-06-10T18:56:27.195762+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:36:50.106017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.875086+0000","last_change":"2023-06-10T18:56:18.337501+0000","last_active":"2023-06-10T18:56:26.875086+0000","last_peered":"2023-06-10T18:56:26.875086+0000","last_clean":"2023-06-10T18:56:26.875086+0000","last_became_active":"2023-06-10T18:56:18.336875+0000","last_became_peered":"2023-06-10T18:56:18.336875+0000","last_unstale":"2023-06-10T18:56:26.875086+0000","last_undegraded":"2023-06-10T18:56:26.875086+0000","last_fullsized":"2023-06-10T18:56:26.875086+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:54:49.818477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.144972+0000","last_change":"2023-06-10T18:56:18.740844+0000","last_active":"2023-06-10T18:56:27.144972+0000","last_peered":"2023-06-10T18:56:27.144972+0000","last_clean":"2023-06-10T18:56:27.144972+0000","last_became_active":"2023-06-10T18:56:18.740202+0000","last_became_peered":"2023-06-10T18:56:18.740202+0000","last_unstale":"2023-06-10T18:56:27.144972+0000","last_undegraded":"2023-06-10T18:56:27.144972+0000","last_fullsized":"2023-06-10T18:56:27.144972+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:34:13.702327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.879577+0000","last_change":"2023-06-10T18:56:18.328357+0000","last_active":"2023-06-10T18:56:26.879577+0000","last_peered":"2023-06-10T18:56:26.879577+0000","last_clean":"2023-06-10T18:56:26.879577+0000","last_became_active":"2023-06-10T18:56:18.328062+0000","last_became_peered":"2023-06-10T18:56:18.328062+0000","last_unstale":"2023-06-10T18:56:26.879577+0000","last_undegraded":"2023-06-10T18:56:26.879577+0000","last_fullsized":"2023-06-10T18:56:26.879577+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:42:04.516586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.870557+0000","last_change":"2023-06-10T18:56:18.715041+0000","last_active":"2023-06-10T18:56:26.870557+0000","last_peered":"2023-06-10T18:56:26.870557+0000","last_clean":"2023-06-10T18:56:26.870557+0000","last_became_active":"2023-06-10T18:56:18.714315+0000","last_became_peered":"2023-06-10T18:56:18.714315+0000","last_unstale":"2023-06-10T18:56:26.870557+0000","last_undegraded":"2023-06-10T18:56:26.870557+0000","last_fullsized":"2023-06-10T18:56:26.870557+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:23:30.185213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.144647+0000","last_change":"2023-06-10T18:56:18.343930+0000","last_active":"2023-06-10T18:56:27.144647+0000","last_peered":"2023-06-10T18:56:27.144647+0000","last_clean":"2023-06-10T18:56:27.144647+0000","last_became_active":"2023-06-10T18:56:18.343289+0000","last_became_peered":"2023-06-10T18:56:18.343289+0000","last_unstale":"2023-06-10T18:56:27.144647+0000","last_undegraded":"2023-06-10T18:56:27.144647+0000","last_fullsized":"2023-06-10T18:56:27.144647+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:14:05.116786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.872895+0000","last_change":"2023-06-10T18:56:18.720481+0000","last_active":"2023-06-10T18:56:26.872895+0000","last_peered":"2023-06-10T18:56:26.872895+0000","last_clean":"2023-06-10T18:56:26.872895+0000","last_became_active":"2023-06-10T18:56:18.717729+0000","last_became_peered":"2023-06-10T18:56:18.717729+0000","last_unstale":"2023-06-10T18:56:26.872895+0000","last_undegraded":"2023-06-10T18:56:26.872895+0000","last_fullsized":"2023-06-10T18:56:26.872895+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:07:34.244620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.872218+0000","last_change":"2023-06-10T18:56:18.331216+0000","last_active":"2023-06-10T18:56:26.872218+0000","last_peered":"2023-06-10T18:56:26.872218+0000","last_clean":"2023-06-10T18:56:26.872218+0000","last_became_active":"2023-06-10T18:56:18.330640+0000","last_became_peered":"2023-06-10T18:56:18.330640+0000","last_unstale":"2023-06-10T18:56:26.872218+0000","last_undegraded":"2023-06-10T18:56:26.872218+0000","last_fullsized":"2023-06-10T18:56:26.872218+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:16:43.532194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.880373+0000","last_change":"2023-06-10T18:56:18.745850+0000","last_active":"2023-06-10T18:56:26.880373+0000","last_peered":"2023-06-10T18:56:26.880373+0000","last_clean":"2023-06-10T18:56:26.880373+0000","last_became_active":"2023-06-10T18:56:18.745516+0000","last_became_peered":"2023-06-10T18:56:18.745516+0000","last_unstale":"2023-06-10T18:56:26.880373+0000","last_undegraded":"2023-06-10T18:56:26.880373+0000","last_fullsized":"2023-06-10T18:56:26.880373+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:53:56.836970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"50'3","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.144726+0000","last_change":"2023-06-10T18:56:18.341819+0000","last_active":"2023-06-10T18:56:27.144726+0000","last_peered":"2023-06-10T18:56:27.144726+0000","last_clean":"2023-06-10T18:56:27.144726+0000","last_became_active":"2023-06-10T18:56:18.341153+0000","last_became_peered":"2023-06-10T18:56:18.341153+0000","last_unstale":"2023-06-10T18:56:27.144726+0000","last_undegraded":"2023-06-10T18:56:27.144726+0000","last_fullsized":"2023-06-10T18:56:27.144726+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:13:55.771862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.871435+0000","last_change":"2023-06-10T18:56:18.718945+0000","last_active":"2023-06-10T18:56:26.871435+0000","last_peered":"2023-06-10T18:56:26.871435+0000","last_clean":"2023-06-10T18:56:26.871435+0000","last_became_active":"2023-06-10T18:56:18.717962+0000","last_became_peered":"2023-06-10T18:56:18.717962+0000","last_unstale":"2023-06-10T18:56:26.871435+0000","last_undegraded":"2023-06-10T18:56:26.871435+0000","last_fullsized":"2023-06-10T18:56:26.871435+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:04:11.756055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"50'6","reported_seq":21,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.195682+0000","last_change":"2023-06-10T18:56:18.333312+0000","last_active":"2023-06-10T18:56:27.195682+0000","last_peered":"2023-06-10T18:56:27.195682+0000","last_clean":"2023-06-10T18:56:27.195682+0000","last_became_active":"2023-06-10T18:56:18.332390+0000","last_became_peered":"2023-06-10T18:56:18.332390+0000","last_unstale":"2023-06-10T18:56:27.195682+0000","last_undegraded":"2023-06-10T18:56:27.195682+0000","last_fullsized":"2023-06-10T18:56:27.195682+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:04:57.213752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.871933+0000","last_change":"2023-06-10T18:56:18.739711+0000","last_active":"2023-06-10T18:56:26.871933+0000","last_peered":"2023-06-10T18:56:26.871933+0000","last_clean":"2023-06-10T18:56:26.871933+0000","last_became_active":"2023-06-10T18:56:18.738999+0000","last_became_peered":"2023-06-10T18:56:18.738999+0000","last_unstale":"2023-06-10T18:56:26.871933+0000","last_undegraded":"2023-06-10T18:56:26.871933+0000","last_fullsized":"2023-06-10T18:56:26.871933+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:14:23.654180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"50'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.880149+0000","last_change":"2023-06-10T18:56:18.342157+0000","last_active":"2023-06-10T18:56:26.880149+0000","last_peered":"2023-06-10T18:56:26.880149+0000","last_clean":"2023-06-10T18:56:26.880149+0000","last_became_active":"2023-06-10T18:56:18.341576+0000","last_became_peered":"2023-06-10T18:56:18.341576+0000","last_unstale":"2023-06-10T18:56:26.880149+0000","last_undegraded":"2023-06-10T18:56:26.880149+0000","last_fullsized":"2023-06-10T18:56:26.880149+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:23:29.171711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":2,"reported_epoch":52,"state":"peering","last_fresh":"2023-06-10T18:56:22.631216+0000","last_change":"2023-06-10T18:56:27.634240+0000","last_active":"2023-06-10T18:56:27.634240+0000","last_peered":"2023-06-10T18:56:22.631216+0000","last_clean":"2023-06-10T18:56:22.631216+0000","last_became_active":"2023-06-10T18:56:18.711779+0000","last_became_peered":"2023-06-10T18:56:18.711779+0000","last_unstale":"2023-06-10T18:56:22.631216+0000","last_undegraded":"2023-06-10T18:56:22.631216+0000","last_fullsized":"2023-06-10T18:56:22.631216+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.875792+0000","last_change":"2023-06-10T18:56:18.335774+0000","last_active":"2023-06-10T18:56:26.875792+0000","last_peered":"2023-06-10T18:56:26.875792+0000","last_clean":"2023-06-10T18:56:26.875792+0000","last_became_active":"2023-06-10T18:56:18.334295+0000","last_became_peered":"2023-06-10T18:56:18.334295+0000","last_unstale":"2023-06-10T18:56:26.875792+0000","last_undegraded":"2023-06-10T18:56:26.875792+0000","last_fullsized":"2023-06-10T18:56:26.875792+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:45:39.069258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.195203+0000","last_change":"2023-06-10T18:56:18.732193+0000","last_active":"2023-06-10T18:56:27.195203+0000","last_peered":"2023-06-10T18:56:27.195203+0000","last_clean":"2023-06-10T18:56:27.195203+0000","last_became_active":"2023-06-10T18:56:18.731876+0000","last_became_peered":"2023-06-10T18:56:18.731876+0000","last_unstale":"2023-06-10T18:56:27.195203+0000","last_undegraded":"2023-06-10T18:56:27.195203+0000","last_fullsized":"2023-06-10T18:56:27.195203+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:41:57.121808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.144429+0000","last_change":"2023-06-10T18:56:18.348170+0000","last_active":"2023-06-10T18:56:27.144429+0000","last_peered":"2023-06-10T18:56:27.144429+0000","last_clean":"2023-06-10T18:56:27.144429+0000","last_became_active":"2023-06-10T18:56:18.347458+0000","last_became_peered":"2023-06-10T18:56:18.347458+0000","last_unstale":"2023-06-10T18:56:27.144429+0000","last_undegraded":"2023-06-10T18:56:27.144429+0000","last_fullsized":"2023-06-10T18:56:27.144429+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:08:51.581596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.880965+0000","last_change":"2023-06-10T18:56:18.727211+0000","last_active":"2023-06-10T18:56:26.880965+0000","last_peered":"2023-06-10T18:56:26.880965+0000","last_clean":"2023-06-10T18:56:26.880965+0000","last_became_active":"2023-06-10T18:56:18.726575+0000","last_became_peered":"2023-06-10T18:56:18.726575+0000","last_unstale":"2023-06-10T18:56:26.880965+0000","last_undegraded":"2023-06-10T18:56:26.880965+0000","last_fullsized":"2023-06-10T18:56:26.880965+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:04:11.756055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"50'8","reported_seq":23,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.195340+0000","last_change":"2023-06-10T18:56:18.332240+0000","last_active":"2023-06-10T18:56:27.195340+0000","last_peered":"2023-06-10T18:56:27.195340+0000","last_clean":"2023-06-10T18:56:27.195340+0000","last_became_active":"2023-06-10T18:56:18.331781+0000","last_became_peered":"2023-06-10T18:56:18.331781+0000","last_unstale":"2023-06-10T18:56:27.195340+0000","last_undegraded":"2023-06-10T18:56:27.195340+0000","last_fullsized":"2023-06-10T18:56:27.195340+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:23:26.069557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.195018+0000","last_change":"2023-06-10T18:56:18.702816+0000","last_active":"2023-06-10T18:56:27.195018+0000","last_peered":"2023-06-10T18:56:27.195018+0000","last_clean":"2023-06-10T18:56:27.195018+0000","last_became_active":"2023-06-10T18:56:18.702527+0000","last_became_peered":"2023-06-10T18:56:18.702527+0000","last_unstale":"2023-06-10T18:56:27.195018+0000","last_undegraded":"2023-06-10T18:56:27.195018+0000","last_fullsized":"2023-06-10T18:56:27.195018+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:01:30.967639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"50'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.881337+0000","last_change":"2023-06-10T18:56:18.324631+0000","last_active":"2023-06-10T18:56:26.881337+0000","last_peered":"2023-06-10T18:56:26.881337+0000","last_clean":"2023-06-10T18:56:26.881337+0000","last_became_active":"2023-06-10T18:56:18.324243+0000","last_became_peered":"2023-06-10T18:56:18.324243+0000","last_unstale":"2023-06-10T18:56:26.881337+0000","last_undegraded":"2023-06-10T18:56:26.881337+0000","last_fullsized":"2023-06-10T18:56:26.881337+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:01:29.954138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.886746+0000","last_change":"2023-06-10T18:56:18.710557+0000","last_active":"2023-06-10T18:56:26.886746+0000","last_peered":"2023-06-10T18:56:26.886746+0000","last_clean":"2023-06-10T18:56:26.886746+0000","last_became_active":"2023-06-10T18:56:18.710238+0000","last_became_peered":"2023-06-10T18:56:18.710238+0000","last_unstale":"2023-06-10T18:56:26.886746+0000","last_undegraded":"2023-06-10T18:56:26.886746+0000","last_fullsized":"2023-06-10T18:56:26.886746+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:57:17.090045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"50'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.869232+0000","last_change":"2023-06-10T18:56:18.324362+0000","last_active":"2023-06-10T18:56:26.869232+0000","last_peered":"2023-06-10T18:56:26.869232+0000","last_clean":"2023-06-10T18:56:26.869232+0000","last_became_active":"2023-06-10T18:56:18.323943+0000","last_became_peered":"2023-06-10T18:56:18.323943+0000","last_unstale":"2023-06-10T18:56:26.869232+0000","last_undegraded":"2023-06-10T18:56:26.869232+0000","last_fullsized":"2023-06-10T18:56:26.869232+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:13:38.851442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.871058+0000","last_change":"2023-06-10T18:56:18.715476+0000","last_active":"2023-06-10T18:56:26.871058+0000","last_peered":"2023-06-10T18:56:26.871058+0000","last_clean":"2023-06-10T18:56:26.871058+0000","last_became_active":"2023-06-10T18:56:18.714697+0000","last_became_peered":"2023-06-10T18:56:18.714697+0000","last_unstale":"2023-06-10T18:56:26.871058+0000","last_undegraded":"2023-06-10T18:56:26.871058+0000","last_fullsized":"2023-06-10T18:56:26.871058+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:36:56.932324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"50'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.876240+0000","last_change":"2023-06-10T18:56:18.341065+0000","last_active":"2023-06-10T18:56:26.876240+0000","last_peered":"2023-06-10T18:56:26.876240+0000","last_clean":"2023-06-10T18:56:26.876240+0000","last_became_active":"2023-06-10T18:56:18.340242+0000","last_became_peered":"2023-06-10T18:56:18.340242+0000","last_unstale":"2023-06-10T18:56:26.876240+0000","last_undegraded":"2023-06-10T18:56:26.876240+0000","last_fullsized":"2023-06-10T18:56:26.876240+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:27:46.347276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.887392+0000","last_change":"2023-06-10T18:56:18.722679+0000","last_active":"2023-06-10T18:56:26.887392+0000","last_peered":"2023-06-10T18:56:26.887392+0000","last_clean":"2023-06-10T18:56:26.887392+0000","last_became_active":"2023-06-10T18:56:18.722389+0000","last_became_peered":"2023-06-10T18:56:18.722389+0000","last_unstale":"2023-06-10T18:56:26.887392+0000","last_undegraded":"2023-06-10T18:56:26.887392+0000","last_fullsized":"2023-06-10T18:56:26.887392+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:01:30.967639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.875808+0000","last_change":"2023-06-10T18:56:18.335157+0000","last_active":"2023-06-10T18:56:26.875808+0000","last_peered":"2023-06-10T18:56:26.875808+0000","last_clean":"2023-06-10T18:56:26.875808+0000","last_became_active":"2023-06-10T18:56:18.334417+0000","last_became_peered":"2023-06-10T18:56:18.334417+0000","last_unstale":"2023-06-10T18:56:26.875808+0000","last_undegraded":"2023-06-10T18:56:26.875808+0000","last_fullsized":"2023-06-10T18:56:26.875808+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:43:46.237306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.872091+0000","last_change":"2023-06-10T18:56:18.720351+0000","last_active":"2023-06-10T18:56:26.872091+0000","last_peered":"2023-06-10T18:56:26.872091+0000","last_clean":"2023-06-10T18:56:26.872091+0000","last_became_active":"2023-06-10T18:56:18.717962+0000","last_became_peered":"2023-06-10T18:56:18.717962+0000","last_unstale":"2023-06-10T18:56:26.872091+0000","last_undegraded":"2023-06-10T18:56:26.872091+0000","last_fullsized":"2023-06-10T18:56:26.872091+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:55:10.132650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"50'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.887432+0000","last_change":"2023-06-10T18:56:18.337149+0000","last_active":"2023-06-10T18:56:26.887432+0000","last_peered":"2023-06-10T18:56:26.887432+0000","last_clean":"2023-06-10T18:56:26.887432+0000","last_became_active":"2023-06-10T18:56:18.335525+0000","last_became_peered":"2023-06-10T18:56:18.335525+0000","last_unstale":"2023-06-10T18:56:26.887432+0000","last_undegraded":"2023-06-10T18:56:26.887432+0000","last_fullsized":"2023-06-10T18:56:26.887432+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:23:26.069557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.876152+0000","last_change":"2023-06-10T18:56:18.734899+0000","last_active":"2023-06-10T18:56:26.876152+0000","last_peered":"2023-06-10T18:56:26.876152+0000","last_clean":"2023-06-10T18:56:26.876152+0000","last_became_active":"2023-06-10T18:56:18.734152+0000","last_became_peered":"2023-06-10T18:56:18.734152+0000","last_unstale":"2023-06-10T18:56:26.876152+0000","last_undegraded":"2023-06-10T18:56:26.876152+0000","last_fullsized":"2023-06-10T18:56:26.876152+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:16:15.404759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.194661+0000","last_change":"2023-06-10T18:56:18.332341+0000","last_active":"2023-06-10T18:56:27.194661+0000","last_peered":"2023-06-10T18:56:27.194661+0000","last_clean":"2023-06-10T18:56:27.194661+0000","last_became_active":"2023-06-10T18:56:18.331836+0000","last_became_peered":"2023-06-10T18:56:18.331836+0000","last_unstale":"2023-06-10T18:56:27.194661+0000","last_undegraded":"2023-06-10T18:56:27.194661+0000","last_fullsized":"2023-06-10T18:56:27.194661+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:27:55.613483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.881243+0000","last_change":"2023-06-10T18:56:18.745846+0000","last_active":"2023-06-10T18:56:26.881243+0000","last_peered":"2023-06-10T18:56:26.881243+0000","last_clean":"2023-06-10T18:56:26.881243+0000","last_became_active":"2023-06-10T18:56:18.745527+0000","last_became_peered":"2023-06-10T18:56:18.745527+0000","last_unstale":"2023-06-10T18:56:26.881243+0000","last_undegraded":"2023-06-10T18:56:26.881243+0000","last_fullsized":"2023-06-10T18:56:26.881243+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:33:38.472734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.879935+0000","last_change":"2023-06-10T18:56:18.337764+0000","last_active":"2023-06-10T18:56:26.879935+0000","last_peered":"2023-06-10T18:56:26.879935+0000","last_clean":"2023-06-10T18:56:26.879935+0000","last_became_active":"2023-06-10T18:56:18.337390+0000","last_became_peered":"2023-06-10T18:56:18.337390+0000","last_unstale":"2023-06-10T18:56:26.879935+0000","last_undegraded":"2023-06-10T18:56:26.879935+0000","last_fullsized":"2023-06-10T18:56:26.879935+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:54:06.053571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.887362+0000","last_change":"2023-06-10T18:56:18.705770+0000","last_active":"2023-06-10T18:56:26.887362+0000","last_peered":"2023-06-10T18:56:26.887362+0000","last_clean":"2023-06-10T18:56:26.887362+0000","last_became_active":"2023-06-10T18:56:18.705487+0000","last_became_peered":"2023-06-10T18:56:18.705487+0000","last_unstale":"2023-06-10T18:56:26.887362+0000","last_undegraded":"2023-06-10T18:56:26.887362+0000","last_fullsized":"2023-06-10T18:56:26.887362+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:18:25.090460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.867631+0000","last_change":"2023-06-10T18:56:18.339683+0000","last_active":"2023-06-10T18:56:26.867631+0000","last_peered":"2023-06-10T18:56:26.867631+0000","last_clean":"2023-06-10T18:56:26.867631+0000","last_became_active":"2023-06-10T18:56:18.339076+0000","last_became_peered":"2023-06-10T18:56:18.339076+0000","last_unstale":"2023-06-10T18:56:26.867631+0000","last_undegraded":"2023-06-10T18:56:26.867631+0000","last_fullsized":"2023-06-10T18:56:26.867631+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:24:21.579841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.874936+0000","last_change":"2023-06-10T18:56:18.724347+0000","last_active":"2023-06-10T18:56:26.874936+0000","last_peered":"2023-06-10T18:56:26.874936+0000","last_clean":"2023-06-10T18:56:26.874936+0000","last_became_active":"2023-06-10T18:56:18.723327+0000","last_became_peered":"2023-06-10T18:56:18.723327+0000","last_unstale":"2023-06-10T18:56:26.874936+0000","last_undegraded":"2023-06-10T18:56:26.874936+0000","last_fullsized":"2023-06-10T18:56:26.874936+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:06:54.175628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"51'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.881525+0000","last_change":"2023-06-10T18:56:18.337157+0000","last_active":"2023-06-10T18:56:26.881525+0000","last_peered":"2023-06-10T18:56:26.881525+0000","last_clean":"2023-06-10T18:56:26.881525+0000","last_became_active":"2023-06-10T18:56:18.336768+0000","last_became_peered":"2023-06-10T18:56:18.336768+0000","last_unstale":"2023-06-10T18:56:26.881525+0000","last_undegraded":"2023-06-10T18:56:26.881525+0000","last_fullsized":"2023-06-10T18:56:26.881525+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:18:24.076958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":224,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.143607+0000","last_change":"2023-06-10T18:52:34.951528+0000","last_active":"2023-06-10T18:56:27.143607+0000","last_peered":"2023-06-10T18:56:27.143607+0000","last_clean":"2023-06-10T18:56:27.143607+0000","last_became_active":"2023-06-10T18:52:34.949099+0000","last_became_peered":"2023-06-10T18:52:34.949099+0000","last_unstale":"2023-06-10T18:56:27.143607+0000","last_undegraded":"2023-06-10T18:56:27.143607+0000","last_fullsized":"2023-06-10T18:56:27.143607+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_clean_scrub_stamp":"2023-06-10T18:52:33.633295+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:48:42.927886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":70,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.872604+0000","last_change":"2023-06-10T18:52:40.506384+0000","last_active":"2023-06-10T18:56:26.872604+0000","last_peered":"2023-06-10T18:56:26.872604+0000","last_clean":"2023-06-10T18:56:26.872604+0000","last_became_active":"2023-06-10T18:52:40.505701+0000","last_became_peered":"2023-06-10T18:52:40.505701+0000","last_unstale":"2023-06-10T18:56:26.872604+0000","last_undegraded":"2023-06-10T18:56:26.872604+0000","last_fullsized":"2023-06-10T18:56:26.872604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:48:00.502223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.887017+0000","last_change":"2023-06-10T18:56:18.714433+0000","last_active":"2023-06-10T18:56:26.887017+0000","last_peered":"2023-06-10T18:56:26.887017+0000","last_clean":"2023-06-10T18:56:26.887017+0000","last_became_active":"2023-06-10T18:56:18.714070+0000","last_became_peered":"2023-06-10T18:56:18.714070+0000","last_unstale":"2023-06-10T18:56:26.887017+0000","last_undegraded":"2023-06-10T18:56:26.887017+0000","last_fullsized":"2023-06-10T18:56:26.887017+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:16:44.545696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.144734+0000","last_change":"2023-06-10T18:56:18.341822+0000","last_active":"2023-06-10T18:56:27.144734+0000","last_peered":"2023-06-10T18:56:27.144734+0000","last_clean":"2023-06-10T18:56:27.144734+0000","last_became_active":"2023-06-10T18:56:18.341138+0000","last_became_peered":"2023-06-10T18:56:18.341138+0000","last_unstale":"2023-06-10T18:56:27.144734+0000","last_undegraded":"2023-06-10T18:56:27.144734+0000","last_fullsized":"2023-06-10T18:56:27.144734+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:19:07.044160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":68,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.144020+0000","last_change":"2023-06-10T18:52:40.512015+0000","last_active":"2023-06-10T18:56:27.144020+0000","last_peered":"2023-06-10T18:56:27.144020+0000","last_clean":"2023-06-10T18:56:27.144020+0000","last_became_active":"2023-06-10T18:52:40.511382+0000","last_became_peered":"2023-06-10T18:52:40.511382+0000","last_unstale":"2023-06-10T18:56:27.144020+0000","last_undegraded":"2023-06-10T18:56:27.144020+0000","last_fullsized":"2023-06-10T18:56:27.144020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:10:22.176800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.195451+0000","last_change":"2023-06-10T18:56:18.720642+0000","last_active":"2023-06-10T18:56:27.195451+0000","last_peered":"2023-06-10T18:56:27.195451+0000","last_clean":"2023-06-10T18:56:27.195451+0000","last_became_active":"2023-06-10T18:56:18.720385+0000","last_became_peered":"2023-06-10T18:56:18.720385+0000","last_unstale":"2023-06-10T18:56:27.195451+0000","last_undegraded":"2023-06-10T18:56:27.195451+0000","last_fullsized":"2023-06-10T18:56:27.195451+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:44:56.381072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.881015+0000","last_change":"2023-06-10T18:56:18.320760+0000","last_active":"2023-06-10T18:56:26.881015+0000","last_peered":"2023-06-10T18:56:26.881015+0000","last_clean":"2023-06-10T18:56:26.881015+0000","last_became_active":"2023-06-10T18:56:18.320373+0000","last_became_peered":"2023-06-10T18:56:18.320373+0000","last_unstale":"2023-06-10T18:56:26.881015+0000","last_undegraded":"2023-06-10T18:56:26.881015+0000","last_fullsized":"2023-06-10T18:56:26.881015+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:27:55.613483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":70,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.867695+0000","last_change":"2023-06-10T18:52:40.671725+0000","last_active":"2023-06-10T18:56:26.867695+0000","last_peered":"2023-06-10T18:56:26.867695+0000","last_clean":"2023-06-10T18:56:26.867695+0000","last_became_active":"2023-06-10T18:52:40.671442+0000","last_became_peered":"2023-06-10T18:52:40.671442+0000","last_unstale":"2023-06-10T18:56:26.867695+0000","last_undegraded":"2023-06-10T18:56:26.867695+0000","last_fullsized":"2023-06-10T18:56:26.867695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:26:09.367931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.872142+0000","last_change":"2023-06-10T18:56:18.704278+0000","last_active":"2023-06-10T18:56:26.872142+0000","last_peered":"2023-06-10T18:56:26.872142+0000","last_clean":"2023-06-10T18:56:26.872142+0000","last_became_active":"2023-06-10T18:56:18.703336+0000","last_became_peered":"2023-06-10T18:56:18.703336+0000","last_unstale":"2023-06-10T18:56:26.872142+0000","last_undegraded":"2023-06-10T18:56:26.872142+0000","last_fullsized":"2023-06-10T18:56:26.872142+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:43:45.838944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"50'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.876735+0000","last_change":"2023-06-10T18:56:18.335741+0000","last_active":"2023-06-10T18:56:26.876735+0000","last_peered":"2023-06-10T18:56:26.876735+0000","last_clean":"2023-06-10T18:56:26.876735+0000","last_became_active":"2023-06-10T18:56:18.334904+0000","last_became_peered":"2023-06-10T18:56:18.334904+0000","last_unstale":"2023-06-10T18:56:26.876735+0000","last_undegraded":"2023-06-10T18:56:26.876735+0000","last_fullsized":"2023-06-10T18:56:26.876735+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:08:18.807313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":70,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.871228+0000","last_change":"2023-06-10T18:52:40.510258+0000","last_active":"2023-06-10T18:56:26.871228+0000","last_peered":"2023-06-10T18:56:26.871228+0000","last_clean":"2023-06-10T18:56:26.871228+0000","last_became_active":"2023-06-10T18:52:40.509560+0000","last_became_peered":"2023-06-10T18:52:40.509560+0000","last_unstale":"2023-06-10T18:56:26.871228+0000","last_undegraded":"2023-06-10T18:56:26.871228+0000","last_fullsized":"2023-06-10T18:56:26.871228+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:43:32.943829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":2,"reported_epoch":52,"state":"peering","last_fresh":"2023-06-10T18:56:22.631242+0000","last_change":"2023-06-10T18:56:27.634300+0000","last_active":"2023-06-10T18:56:27.634300+0000","last_peered":"2023-06-10T18:56:22.631242+0000","last_clean":"2023-06-10T18:56:22.631242+0000","last_became_active":"2023-06-10T18:56:18.715542+0000","last_became_peered":"2023-06-10T18:56:18.715542+0000","last_unstale":"2023-06-10T18:56:22.631242+0000","last_undegraded":"2023-06-10T18:56:22.631242+0000","last_fullsized":"2023-06-10T18:56:22.631242+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.870792+0000","last_change":"2023-06-10T18:56:18.325010+0000","last_active":"2023-06-10T18:56:26.870792+0000","last_peered":"2023-06-10T18:56:26.870792+0000","last_clean":"2023-06-10T18:56:26.870792+0000","last_became_active":"2023-06-10T18:56:18.324414+0000","last_became_peered":"2023-06-10T18:56:18.324414+0000","last_unstale":"2023-06-10T18:56:26.870792+0000","last_undegraded":"2023-06-10T18:56:26.870792+0000","last_fullsized":"2023-06-10T18:56:26.870792+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:53:55.823468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":66,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.887066+0000","last_change":"2023-06-10T18:52:40.672266+0000","last_active":"2023-06-10T18:56:26.887066+0000","last_peered":"2023-06-10T18:56:26.887066+0000","last_clean":"2023-06-10T18:56:26.887066+0000","last_became_active":"2023-06-10T18:52:40.671966+0000","last_became_peered":"2023-06-10T18:52:40.671966+0000","last_unstale":"2023-06-10T18:56:26.887066+0000","last_undegraded":"2023-06-10T18:56:26.887066+0000","last_fullsized":"2023-06-10T18:56:26.887066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:29:59.663767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.195764+0000","last_change":"2023-06-10T18:56:18.703583+0000","last_active":"2023-06-10T18:56:27.195764+0000","last_peered":"2023-06-10T18:56:27.195764+0000","last_clean":"2023-06-10T18:56:27.195764+0000","last_became_active":"2023-06-10T18:56:18.703292+0000","last_became_peered":"2023-06-10T18:56:18.703292+0000","last_unstale":"2023-06-10T18:56:27.195764+0000","last_undegraded":"2023-06-10T18:56:27.195764+0000","last_fullsized":"2023-06-10T18:56:27.195764+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:37:45.597946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.872441+0000","last_change":"2023-06-10T18:56:18.331871+0000","last_active":"2023-06-10T18:56:26.872441+0000","last_peered":"2023-06-10T18:56:26.872441+0000","last_clean":"2023-06-10T18:56:26.872441+0000","last_became_active":"2023-06-10T18:56:18.331127+0000","last_became_peered":"2023-06-10T18:56:18.331127+0000","last_unstale":"2023-06-10T18:56:26.872441+0000","last_undegraded":"2023-06-10T18:56:26.872441+0000","last_fullsized":"2023-06-10T18:56:26.872441+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:56:07.925384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":68,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.144910+0000","last_change":"2023-06-10T18:52:40.671084+0000","last_active":"2023-06-10T18:56:27.144910+0000","last_peered":"2023-06-10T18:56:27.144910+0000","last_clean":"2023-06-10T18:56:27.144910+0000","last_became_active":"2023-06-10T18:52:40.670697+0000","last_became_peered":"2023-06-10T18:52:40.670697+0000","last_unstale":"2023-06-10T18:56:27.144910+0000","last_undegraded":"2023-06-10T18:56:27.144910+0000","last_fullsized":"2023-06-10T18:56:27.144910+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:26:45.209485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.880674+0000","last_change":"2023-06-10T18:56:18.724544+0000","last_active":"2023-06-10T18:56:26.880674+0000","last_peered":"2023-06-10T18:56:26.880674+0000","last_clean":"2023-06-10T18:56:26.880674+0000","last_became_active":"2023-06-10T18:56:18.724244+0000","last_became_peered":"2023-06-10T18:56:18.724244+0000","last_unstale":"2023-06-10T18:56:26.880674+0000","last_undegraded":"2023-06-10T18:56:26.880674+0000","last_fullsized":"2023-06-10T18:56:26.880674+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:17:50.531074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.195134+0000","last_change":"2023-06-10T18:56:18.332507+0000","last_active":"2023-06-10T18:56:27.195134+0000","last_peered":"2023-06-10T18:56:27.195134+0000","last_clean":"2023-06-10T18:56:27.195134+0000","last_became_active":"2023-06-10T18:56:18.331887+0000","last_became_peered":"2023-06-10T18:56:18.331887+0000","last_unstale":"2023-06-10T18:56:27.195134+0000","last_undegraded":"2023-06-10T18:56:27.195134+0000","last_fullsized":"2023-06-10T18:56:27.195134+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:13:38.791330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":66,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.887650+0000","last_change":"2023-06-10T18:52:40.514114+0000","last_active":"2023-06-10T18:56:26.887650+0000","last_peered":"2023-06-10T18:56:26.887650+0000","last_clean":"2023-06-10T18:56:26.887650+0000","last_became_active":"2023-06-10T18:52:40.513638+0000","last_became_peered":"2023-06-10T18:52:40.513638+0000","last_unstale":"2023-06-10T18:56:26.887650+0000","last_undegraded":"2023-06-10T18:56:26.887650+0000","last_fullsized":"2023-06-10T18:56:26.887650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:41:17.572105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.871355+0000","last_change":"2023-06-10T18:56:18.733094+0000","last_active":"2023-06-10T18:56:26.871355+0000","last_peered":"2023-06-10T18:56:26.871355+0000","last_clean":"2023-06-10T18:56:26.871355+0000","last_became_active":"2023-06-10T18:56:18.732442+0000","last_became_peered":"2023-06-10T18:56:18.732442+0000","last_unstale":"2023-06-10T18:56:26.871355+0000","last_undegraded":"2023-06-10T18:56:26.871355+0000","last_fullsized":"2023-06-10T18:56:26.871355+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T18:57:31.579489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.195498+0000","last_change":"2023-06-10T18:56:18.337697+0000","last_active":"2023-06-10T18:56:27.195498+0000","last_peered":"2023-06-10T18:56:27.195498+0000","last_clean":"2023-06-10T18:56:27.195498+0000","last_became_active":"2023-06-10T18:56:18.337174+0000","last_became_peered":"2023-06-10T18:56:18.337174+0000","last_unstale":"2023-06-10T18:56:27.195498+0000","last_undegraded":"2023-06-10T18:56:27.195498+0000","last_fullsized":"2023-06-10T18:56:27.195498+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:57:03.240260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":70,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.876863+0000","last_change":"2023-06-10T18:52:40.515396+0000","last_active":"2023-06-10T18:56:26.876863+0000","last_peered":"2023-06-10T18:56:26.876863+0000","last_clean":"2023-06-10T18:56:26.876863+0000","last_became_active":"2023-06-10T18:52:40.514663+0000","last_became_peered":"2023-06-10T18:52:40.514663+0000","last_unstale":"2023-06-10T18:56:26.876863+0000","last_undegraded":"2023-06-10T18:56:26.876863+0000","last_fullsized":"2023-06-10T18:56:26.876863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:57:38.444899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574898,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28128,"kb_used_data":1176,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343712,"statfs":{"total":96636764160,"available":96607961088,"internally_reserved":0,"allocated":1204224,"data_stored":851412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":0.90400000000000003,"15min":0.88200000000000001},"min":{"1min":0.73599999999999999,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.3759999999999999,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.97999999999999998},{"interface":"front","average":{"1min":1.006,"5min":0.94299999999999995,"15min":0.93000000000000005},"min":{"1min":0.81899999999999995,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.234,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":1.0349999999999999}]},{"osd":1,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92400000000000004,"15min":0.91500000000000004},"min":{"1min":0.58599999999999997,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.3089999999999999,"5min":1.377,"15min":1.377},"last":1.1419999999999999},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.92500000000000004,"15min":0.91100000000000003},"min":{"1min":0.78400000000000003,"5min":0.504,"15min":0.504},"max":{"1min":1.111,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.1080000000000001}]},{"osd":2,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.83999999999999997,"15min":0.82799999999999996},"min":{"1min":0.64100000000000001,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.214,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.89900000000000002,"15min":0.90700000000000003},"min":{"1min":0.67500000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.325,"5min":1.367,"15min":1.367},"last":1.069}]},{"osd":3,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.92100000000000004,"15min":0.89900000000000002},"min":{"1min":0.68100000000000005,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1499999999999999,"5min":1.502,"15min":1.502},"last":1.167},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.93799999999999994,"15min":0.92800000000000005},"min":{"1min":0.70399999999999996,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.2130000000000001,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.77200000000000002}]},{"osd":4,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.876,"15min":0.872},"min":{"1min":0.60199999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.141,"5min":1.639,"15min":1.639},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.96899999999999997,"15min":0.98099999999999998},"min":{"1min":0.748,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.238,"5min":1.411,"15min":1.411},"last":0.65200000000000002}]},{"osd":5,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.042,"15min":1.038},"min":{"1min":0.79800000000000004,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.2669999999999999,"5min":1.806,"15min":1.806},"last":0.93200000000000005},{"interface":"front","average":{"1min":1.081,"5min":1.05,"15min":1.052},"min":{"1min":0.93200000000000005,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.256,"5min":1.522,"15min":1.522},"last":1.0009999999999999}]},{"osd":6,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.0129999999999999,"15min":1.008},"min":{"1min":0.78500000000000003,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.3,"5min":1.718,"15min":1.718},"last":0.95599999999999996},{"interface":"front","average":{"1min":1.147,"5min":1.095,"15min":1.0900000000000001},"min":{"1min":0.96599999999999997,"5min":0.441,"15min":0.441},"max":{"1min":1.409,"5min":1.464,"15min":1.464},"last":1.224}]}]},{"osd":6,"up_from":13,"seq":55834574899,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27548,"kb_used_data":596,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344292,"statfs":{"total":96636764160,"available":96608555008,"internally_reserved":0,"allocated":610304,"data_stored":261572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.81999999999999995,"15min":0.80100000000000005},"min":{"1min":0.65800000000000003,"5min":0.502,"15min":0.502},"max":{"1min":1.0589999999999999,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.85199999999999998,"15min":0.83999999999999997},"min":{"1min":0.71799999999999997,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.0680000000000001,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":1.0920000000000001}]},{"osd":1,"last update":"Sat Jun 10 18:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.873,"15min":0.85199999999999998},"min":{"1min":0.68999999999999995,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.0549999999999999},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.879,"15min":0.85899999999999999},"min":{"1min":0.68999999999999995,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":0.90000000000000002}]},{"osd":2,"last update":"Sat Jun 10 18:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.871,"15min":0.85899999999999999},"min":{"1min":0.66000000000000003,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.1950000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.88500000000000001,"15min":0.88900000000000001},"min":{"1min":0.68000000000000005,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.109,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":1.177}]},{"osd":3,"last update":"Sat Jun 10 18:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.874,"15min":0.84799999999999998},"min":{"1min":0.64900000000000002,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.169,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.95999999999999996},{"interface":"front","average":{"1min":1.0209999999999999,"5min":0.997,"15min":0.995},"min":{"1min":0.72799999999999998,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":1.2889999999999999}]},{"osd":4,"last update":"Sat Jun 10 18:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.93799999999999994,"15min":0.95399999999999996},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.1259999999999999,"5min":1.198,"15min":1.198},"last":1.002},{"interface":"front","average":{"1min":0.95699999999999996,"5min":1.0049999999999999,"15min":1.0189999999999999},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.1879999999999999,"5min":1.222,"15min":1.222},"last":1.212}]},{"osd":5,"last update":"Sat Jun 10 18:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.94999999999999996,"15min":0.96199999999999997},"min":{"1min":0.68700000000000006,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.0720000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.86099999999999999},{"interface":"front","average":{"1min":1.02,"5min":1.0249999999999999,"15min":1.026},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":1.1399999999999999}]},{"osd":7,"last update":"Sat Jun 10 18:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":1.0389999999999999,"15min":1.0489999999999999},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.1739999999999999,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.022,"5min":1.0569999999999999,"15min":1.0649999999999999},"min":{"1min":0.82199999999999995,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.2010000000000001,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":1.2569999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574899,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27552,"kb_used_data":600,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":614400,"data_stored":267298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.84199999999999997,"15min":0.82999999999999996},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.139,"5min":1.175,"15min":1.175},"last":1.083},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.91800000000000004,"15min":0.94199999999999995},"min":{"1min":0.63800000000000001,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.246,"5min":1.637,"15min":1.637},"last":0.67700000000000005}]},{"osd":1,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.91000000000000003,"15min":0.91800000000000004},"min":{"1min":0.67800000000000005,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.1559999999999999,"5min":1.335,"15min":1.335},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.91700000000000004,"15min":0.92100000000000004},"min":{"1min":0.72699999999999998,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.208,"5min":1.78,"15min":1.78},"last":0.80700000000000005}]},{"osd":2,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.65000000000000002,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.1000000000000001,"5min":1.446,"15min":1.446},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.91600000000000004,"15min":0.91200000000000003},"min":{"1min":0.71399999999999997,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.1379999999999999,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.92300000000000004}]},{"osd":3,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93899999999999995,"15min":0.94499999999999995},"min":{"1min":0.68600000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.206,"5min":1.484,"15min":1.484},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.97199999999999998,"5min":1.0249999999999999,"15min":1.0429999999999999},"min":{"1min":0.77100000000000002,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.2969999999999999,"5min":1.337,"15min":1.337},"last":0.84599999999999997}]},{"osd":4,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.96999999999999997,"15min":0.98899999999999999},"min":{"1min":0.70299999999999996,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.2669999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.94599999999999995,"5min":1.034,"15min":1.0640000000000001},"min":{"1min":0.66500000000000004,"5min":0.629,"15min":0.629},"max":{"1min":1.26,"5min":1.575,"15min":1.575},"last":1.2010000000000001}]},{"osd":6,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":1.038,"15min":1.0780000000000001},"min":{"1min":0.66000000000000003,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.2010000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.0609999999999999,"15min":1.079},"min":{"1min":0.69799999999999995,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.2270000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.73699999999999999}]},{"osd":7,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.139,"15min":1.1739999999999999},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.226,"5min":1.873,"15min":1.873},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.155,"15min":1.181},"min":{"1min":0.80000000000000004,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.3680000000000001,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.121}]}]},{"osd":4,"up_from":13,"seq":55834574898,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27556,"kb_used_data":604,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344284,"statfs":{"total":96636764160,"available":96608546816,"internally_reserved":0,"allocated":618496,"data_stored":267880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.76700000000000002,"15min":0.745},"min":{"1min":0.53400000000000003,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.1599999999999999,"5min":1.2,"15min":1.2},"last":0.629},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.88200000000000001,"15min":0.88},"min":{"1min":0.63800000000000001,"5min":0.504,"15min":0.504},"max":{"1min":1.4970000000000001,"5min":1.73,"15min":1.73},"last":1.034}]},{"osd":1,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.95199999999999996,"15min":0.95499999999999996},"min":{"1min":0.68200000000000005,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.84599999999999997,"15min":0.83699999999999997},"min":{"1min":0.66600000000000004,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.024,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.097}]},{"osd":2,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.879,"15min":0.875},"min":{"1min":0.70799999999999996,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":0.85499999999999998},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1,"15min":1.004},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":1.121}]},{"osd":3,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.89900000000000002,"15min":0.88},"min":{"1min":0.80900000000000005,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.1679999999999999,"5min":1.22,"15min":1.22},"last":0.73999999999999999},{"interface":"front","average":{"1min":1.006,"5min":0.95799999999999996,"15min":0.95099999999999996},"min":{"1min":0.80100000000000005,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.4490000000000001,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.069}]},{"osd":5,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.96799999999999997,"15min":0.99399999999999999},"min":{"1min":0.67800000000000005,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.069,"5min":1.663,"15min":1.663},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.95399999999999996,"15min":0.98199999999999998},"min":{"1min":0.58099999999999996,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.111,"5min":1.353,"15min":1.353},"last":1.179}]},{"osd":6,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":1.002,"15min":1.028},"min":{"1min":0.63100000000000001,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.5720000000000001,"5min":2.2639999999999998,"15min":2.2639999999999998},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0720000000000001,"15min":1.0760000000000001},"min":{"1min":0.81200000000000006,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":1.1970000000000001}]},{"osd":7,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.98399999999999999,"15min":0.99399999999999999},"min":{"1min":0.68899999999999995,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.1950000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.012,"5min":1.0529999999999999,"15min":1.071},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.2390000000000001,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":1.1539999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574897,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31660,"kb_used_data":612,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340180,"statfs":{"total":96636764160,"available":96604344320,"internally_reserved":0,"allocated":626688,"data_stored":267865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.57799999999999996,"15min":0.57199999999999995},"min":{"1min":0.51400000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.63500000000000001,"15min":0.63100000000000001},"min":{"1min":0.56000000000000005,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.57599999999999996}]},{"osd":1,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.64400000000000002,"15min":0.622},"min":{"1min":0.51000000000000001,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":1.0860000000000001},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.72099999999999997,"15min":0.71599999999999997},"min":{"1min":0.56100000000000005,"5min":0.318,"15min":0.318},"max":{"1min":0.98899999999999999,"5min":1.411,"15min":1.411},"last":1.0409999999999999}]},{"osd":2,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.76100000000000001,"15min":0.75},"min":{"1min":0.63500000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.167,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":1.3759999999999999},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.75900000000000001,"15min":0.74199999999999999},"min":{"1min":0.65200000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.1970000000000001,"5min":1.264,"15min":1.264},"last":0.624}]},{"osd":4,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96099999999999997,"15min":0.96899999999999997},"min":{"1min":0.79800000000000004,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.3089999999999999,"5min":1.488,"15min":1.488},"last":1.3360000000000001},{"interface":"front","average":{"1min":1.052,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.82099999999999995,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.345,"5min":1.458,"15min":1.458},"last":0.93100000000000005}]},{"osd":5,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.0369999999999999,"15min":1.0589999999999999},"min":{"1min":0.80400000000000005,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.268,"5min":2.024,"15min":2.024},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.101,"5min":1.026,"15min":1.014},"min":{"1min":0.83899999999999997,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.29,"5min":1.724,"15min":1.724},"last":1.2170000000000001}]},{"osd":6,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.0489999999999999,"15min":1.0469999999999999},"min":{"1min":0.92400000000000004,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.3300000000000001,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.071,"5min":1.0589999999999999,"15min":1.0720000000000001},"min":{"1min":0.90700000000000003,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.302,"5min":1.78,"15min":1.78},"last":1.1399999999999999}]},{"osd":7,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.101,"15min":1.1279999999999999},"min":{"1min":0.82799999999999996,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.3959999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.212,"5min":1.089,"15min":1.0740000000000001},"min":{"1min":1.0049999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.468,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":1.5429999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574898,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31660,"kb_used_data":612,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340180,"statfs":{"total":96636764160,"available":96604344320,"internally_reserved":0,"allocated":626688,"data_stored":268862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.60099999999999998,"15min":0.58799999999999997},"min":{"1min":0.498,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.97799999999999998,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.50800000000000001,"5min":0.378,"15min":0.378},"max":{"1min":1.024,"5min":1.224,"15min":1.224},"last":0.68600000000000005}]},{"osd":1,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.65000000000000002,"15min":0.64600000000000002},"min":{"1min":0.53400000000000003,"5min":0.307,"15min":0.307},"max":{"1min":0.89500000000000002,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.72299999999999998,"15min":0.68999999999999995},"min":{"1min":0.64700000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.89100000000000001}]},{"osd":3,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.73599999999999999,"15min":0.70599999999999996},"min":{"1min":0.64900000000000002,"5min":0.377,"15min":0.377},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.749,"15min":0.746},"min":{"1min":0.64700000000000002,"5min":0.252,"15min":0.252},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.86199999999999999}]},{"osd":4,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.91900000000000004,"15min":0.91500000000000004},"min":{"1min":0.81000000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.097,"5min":1.0349999999999999,"15min":1.038},"min":{"1min":0.88600000000000001,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.476,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":1.0129999999999999}]},{"osd":5,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.016,"15min":1.016},"min":{"1min":0.82699999999999996,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.379,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":1.2330000000000001},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.002,"15min":0.97799999999999998},"min":{"1min":0.77100000000000002,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.377,"5min":1.667,"15min":1.667},"last":0.78200000000000003}]},{"osd":6,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.0429999999999999,"15min":1.0229999999999999},"min":{"1min":0.84299999999999997,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.3049999999999999,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.92900000000000005},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.034,"15min":1.032},"min":{"1min":0.89400000000000002,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.4299999999999999,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":1.1120000000000001}]},{"osd":7,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.099,"15min":1.099},"min":{"1min":0.82399999999999995,"5min":0.62,"15min":0.62},"max":{"1min":1.4339999999999999,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.153,"5min":1.0980000000000001,"15min":1.0760000000000001},"min":{"1min":0.95499999999999996,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.4239999999999999,"5min":1.752,"15min":1.752},"last":0.98899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574900,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31640,"kb_used_data":592,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340200,"statfs":{"total":96636764160,"available":96604364800,"internally_reserved":0,"allocated":606208,"data_stored":260061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.67100000000000004,"15min":0.66100000000000003},"min":{"1min":0.47999999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.71999999999999997,"15min":0.68600000000000005},"min":{"1min":0.63400000000000001,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.0369999999999999,"5min":1.694,"15min":1.694},"last":0.56799999999999995}]},{"osd":2,"last update":"Sat Jun 10 18:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.64400000000000002,"15min":0.623},"min":{"1min":0.53500000000000003,"5min":0.249,"15min":0.249},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.877,"5min":0.70199999999999996,"15min":0.65800000000000003},"min":{"1min":0.65600000000000003,"5min":0.315,"15min":0.315},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":0.65500000000000003}]},{"osd":3,"last update":"Sat Jun 10 18:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.77800000000000002,"15min":0.745},"min":{"1min":0.65900000000000003,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.76100000000000001,"15min":0.749},"min":{"1min":0.58499999999999996,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.1100000000000001,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":0.622}]},{"osd":4,"last update":"Sat Jun 10 18:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.87,"15min":0.83599999999999997},"min":{"1min":0.73399999999999999,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":1.087,"5min":1.1160000000000001,"15min":1.079},"min":{"1min":0.78500000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.5449999999999999,"5min":5.8209999999999997,"15min":5.8209999999999997},"last":0.91000000000000003}]},{"osd":5,"last update":"Sat Jun 10 18:55:44 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.032,"15min":1.028},"min":{"1min":0.75800000000000001,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.4550000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":0.879},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0129999999999999,"15min":0.97099999999999997},"min":{"1min":0.754,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.3819999999999999,"5min":3.089,"15min":3.089},"last":0.72299999999999998}]},{"osd":6,"last update":"Sat Jun 10 18:55:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.105,"15min":1.0309999999999999},"min":{"1min":0.75900000000000001,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.5249999999999999,"5min":7.2599999999999998,"15min":7.2599999999999998},"last":0.77500000000000002},{"interface":"front","average":{"1min":1.081,"5min":1.107,"15min":1.0309999999999999},"min":{"1min":0.80800000000000005,"5min":0.622,"15min":0.622},"max":{"1min":1.591,"5min":9.0069999999999997,"15min":9.0069999999999997},"last":0.85899999999999999}]},{"osd":7,"last update":"Sat Jun 10 18:55:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.0980000000000001,"15min":1.083},"min":{"1min":0.89300000000000002,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.6879999999999999,"5min":2.105,"15min":2.105},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.085,"15min":1.0669999999999999},"min":{"1min":0.90200000000000002,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.573,"5min":2.2570000000000001,"15min":2.2570000000000001},"last":0.73999999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574899,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32232,"kb_used_data":1184,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339608,"statfs":{"total":96636764160,"available":96603758592,"internally_reserved":0,"allocated":1212416,"data_stored":856703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.61299999999999999,"15min":0.59899999999999998},"min":{"1min":0.51000000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.77200000000000002,"15min":0.746},"min":{"1min":0.70899999999999996,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.0469999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.83899999999999997}]},{"osd":2,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.71099999999999997,"15min":0.69799999999999995},"min":{"1min":0.51900000000000002,"5min":0.313,"15min":0.313},"max":{"1min":1.0269999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.64600000000000002,"15min":0.63},"min":{"1min":0.55700000000000005,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.96799999999999997,"5min":1.371,"15min":1.371},"last":0.622}]},{"osd":3,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.68200000000000005,"15min":0.67000000000000004},"min":{"1min":0.55800000000000005,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.1930000000000001,"5min":1.226,"15min":1.226},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.82899999999999996,"15min":0.81000000000000005},"min":{"1min":0.65800000000000003,"5min":0.375,"15min":0.375},"max":{"1min":1.262,"5min":1.829,"15min":1.829},"last":0.76200000000000001}]},{"osd":4,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.90000000000000002,"15min":0.88900000000000001},"min":{"1min":0.75600000000000001,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.1579999999999999,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.0369999999999999,"15min":1.034},"min":{"1min":0.86099999999999999,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.228,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":0.97199999999999998}]},{"osd":5,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.96099999999999997,"15min":0.95799999999999996},"min":{"1min":0.67300000000000004,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.351,"5min":1.694,"15min":1.694},"last":1.1399999999999999},{"interface":"front","average":{"1min":0.99099999999999999,"5min":1,"15min":0.998},"min":{"1min":0.72999999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.1870000000000001,"5min":1.75,"15min":1.75},"last":1.2789999999999999}]},{"osd":6,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.0700000000000001,"15min":1.056},"min":{"1min":0.93899999999999995,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.331,"5min":2.04,"15min":2.04},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.0409999999999999,"5min":0.996,"15min":0.997},"min":{"1min":0.76100000000000001,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.444,"5min":1.883,"15min":1.883},"last":1.3280000000000001}]},{"osd":7,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.0369999999999999,"15min":1.0329999999999999},"min":{"1min":0.77200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.397,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.077,"5min":1.056,"15min":1.05},"min":{"1min":0.93200000000000005,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.298,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.2170000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-10T18:56:27.714 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-10T18:56:27.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.871+0000 7f94ee6e0640 1 Processor -- start 2023-06-10T18:56:27.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.871+0000 7f94ee6e0640 1 -- start start 2023-06-10T18:56:27.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.875+0000 7f94ee6e0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94e80cc690 0x7f94e80d04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:27.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.875+0000 7f94ee6e0640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94e80d0020 con 0x7f94e80b3ac0 2023-06-10T18:56:27.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.875+0000 7f94ee6e0640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94e80cef40 con 0x7f94e80ccae0 2023-06-10T18:56:27.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.875+0000 7f94ee6e0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94e80cf220 con 0x7f94e80cc690 2023-06-10T18:56:27.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.875+0000 7f94e7fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f94e80b3ac0 0x7f94e80b3e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:54050/0 (socket says 172.21.15.53:54050) 2023-06-10T18:56:27.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.875+0000 7f94e7fff640 1 -- 172.21.15.53:0/555303262 learned_addr learned my addr 172.21.15.53:0/555303262 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:56:27.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.875+0000 7f94e77fe640 1 --2- 172.21.15.53:0/555303262 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94e80cc690 0x7f94e80d04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:27.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.875+0000 7f94e6ffd640 1 -- 172.21.15.53:0/555303262 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1781094384 0 0) 0x7f94e80d0020 con 0x7f94e80b3ac0 2023-06-10T18:56:27.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.875+0000 7f94e6ffd640 1 -- 172.21.15.53:0/555303262 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94d4003530 con 0x7f94e80b3ac0 2023-06-10T18:56:27.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.875+0000 7f94e6ffd640 1 -- 172.21.15.53:0/555303262 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 259922280 0 0) 0x7f94d4003530 con 0x7f94e80b3ac0 2023-06-10T18:56:27.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.875+0000 7f94e6ffd640 1 -- 172.21.15.53:0/555303262 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94e80cc690 msgr2=0x7f94e80d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:27.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.875+0000 7f94e6ffd640 1 --2- 172.21.15.53:0/555303262 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94e80cc690 0x7f94e80d04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:27.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.875+0000 7f94e6ffd640 1 -- 172.21.15.53:0/555303262 >> v1:172.21.15.117:6789/0 conn(0x7f94e80ccae0 legacy=0x7f94e80d09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:27.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.875+0000 7f94e6ffd640 1 -- 172.21.15.53:0/555303262 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94e80cf500 con 0x7f94e80b3ac0 2023-06-10T18:56:27.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.875+0000 7f94e6ffd640 1 -- 172.21.15.53:0/555303262 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f94d8001680 con 0x7f94e80b3ac0 2023-06-10T18:56:27.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.875+0000 7f94e77fe640 1 --2- 172.21.15.53:0/555303262 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94e80cc690 0x7f94e80d04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:56:27.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.875+0000 7f94e6ffd640 1 -- 172.21.15.53:0/555303262 >> v1:172.21.15.53:6789/0 conn(0x7f94e80b3ac0 legacy=0x7f94e80b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:27.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.875+0000 7f94e6ffd640 1 --2- 172.21.15.53:0/555303262 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94e80cc690 0x7f94d4003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:27.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.875+0000 7f94e6ffd640 1 --2- 172.21.15.53:0/555303262 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f94d4004010 0x7f94d40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:27.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.875+0000 7f94e6ffd640 1 --2- 172.21.15.53:0/555303262 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94d4004d10 0x7f94d4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:27.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.875+0000 7f94e6ffd640 1 -- 172.21.15.53:0/555303262 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e80cf220 con 0x7f94d4004010 2023-06-10T18:56:27.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.875+0000 7f94e6ffd640 1 -- 172.21.15.53:0/555303262 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d400bb50 con 0x7f94d4004d10 2023-06-10T18:56:27.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.875+0000 7f94e6ffd640 1 -- 172.21.15.53:0/555303262 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94d400bd10 con 0x7f94e80cc690 2023-06-10T18:56:27.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.875+0000 7f94e77fe640 1 --2- 172.21.15.53:0/555303262 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f94d4004010 0x7f94d40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:27.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.875+0000 7f94e7fff640 1 --2- 172.21.15.53:0/555303262 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94e80cc690 0x7f94d4003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:27.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.875+0000 7f94ecc7d640 1 --2- 172.21.15.53:0/555303262 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94d4004d10 0x7f94d4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:27.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.875+0000 7f94e77fe640 1 -- 172.21.15.53:0/555303262 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94e80cc690 msgr2=0x7f94d4003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:27.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.875+0000 7f94e77fe640 1 --2- 172.21.15.53:0/555303262 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94e80cc690 0x7f94d4003a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:27.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.875+0000 7f94e77fe640 1 -- 172.21.15.53:0/555303262 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94d4004d10 msgr2=0x7f94d4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:27.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.875+0000 7f94e77fe640 1 --2- 172.21.15.53:0/555303262 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94d4004d10 0x7f94d4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:27.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.875+0000 7f94e77fe640 1 -- 172.21.15.53:0/555303262 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94d4003530 con 0x7f94d4004010 2023-06-10T18:56:27.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.875+0000 7f94e7fff640 1 --2- 172.21.15.53:0/555303262 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94e80cc690 0x7f94d4003a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:56:27.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.875+0000 7f94ecc7d640 1 --2- 172.21.15.53:0/555303262 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94d4004d10 0x7f94d4005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:56:27.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.879+0000 7f94e77fe640 1 --2- 172.21.15.53:0/555303262 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f94d4004010 0x7f94d40047d0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f94d00098d0 tx=0x7f94d001c5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28d5215bddae65c7 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:27.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.879+0000 7f94e6ffd640 1 -- 172.21.15.53:0/555303262 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d00a8620 con 0x7f94d4004010 2023-06-10T18:56:27.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.879+0000 7f94e6ffd640 1 -- 172.21.15.53:0/555303262 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94d00a8780 con 0x7f94d4004010 2023-06-10T18:56:27.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.879+0000 7f94e6ffd640 1 -- 172.21.15.53:0/555303262 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d00a8af0 con 0x7f94d4004010 2023-06-10T18:56:27.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.879+0000 7f94ee6e0640 1 -- 172.21.15.53:0/555303262 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f94d4004010 msgr2=0x7f94d40047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:27.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.879+0000 7f94ee6e0640 1 --2- 172.21.15.53:0/555303262 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f94d4004010 0x7f94d40047d0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f94d00098d0 tx=0x7f94d001c5b0 comp rx=0 tx=0).stop 2023-06-10T18:56:27.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.879+0000 7f94ecc7d640 1 -- 172.21.15.53:0/555303262 reap_dead start 2023-06-10T18:56:27.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.879+0000 7f94ee6e0640 1 -- 172.21.15.53:0/555303262 shutdown_connections 2023-06-10T18:56:27.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.879+0000 7f94ee6e0640 1 -- 172.21.15.53:0/555303262 >> 172.21.15.53:0/555303262 conn(0x7f94e8071790 msgr2=0x7f94e8069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:27.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.879+0000 7f94ee6e0640 1 -- 172.21.15.53:0/555303262 shutdown_connections 2023-06-10T18:56:27.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.879+0000 7f94ee6e0640 1 -- 172.21.15.53:0/555303262 wait complete. 2023-06-10T18:56:27.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.883+0000 7f94ee6e0640 1 Processor -- start 2023-06-10T18:56:27.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.883+0000 7f94ee6e0640 1 -- start start 2023-06-10T18:56:27.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.883+0000 7f94ee6e0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f94d4004010 0x7f94e8151a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:27.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.883+0000 7f94ee6e0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94e81e7b00 0x7f94e81f5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:27.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.883+0000 7f94ee6e0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94e80c8380 0x7f94e8156a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:27.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.883+0000 7f94ee6e0640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e81f5fb0 con 0x7f94d4004010 2023-06-10T18:56:27.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.883+0000 7f94ee6e0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e80c70b0 con 0x7f94e80c8380 2023-06-10T18:56:27.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.883+0000 7f94ee6e0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94e80c56e0 con 0x7f94e81e7b00 2023-06-10T18:56:27.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.883+0000 7f94e7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f94d4004010 0x7f94e8151a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:27.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.883+0000 7f94e7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f94d4004010 0x7f94e8151a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59306/0 (socket says 172.21.15.53:59306) 2023-06-10T18:56:27.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.883+0000 7f94e7fff640 1 -- 172.21.15.53:0/1333562535 learned_addr learned my addr 172.21.15.53:0/1333562535 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:27.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.883+0000 7f94ecc7d640 1 --2- 172.21.15.53:0/1333562535 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94e80c8380 0x7f94e8156a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:27.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.883+0000 7f94e77fe640 1 --2- 172.21.15.53:0/1333562535 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94e81e7b00 0x7f94e81f5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:27.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.883+0000 7f94e7fff640 1 -- 172.21.15.53:0/1333562535 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94e81e7b00 msgr2=0x7f94e81f5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:27.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.883+0000 7f94e7fff640 1 --2- 172.21.15.53:0/1333562535 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94e81e7b00 0x7f94e81f5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:27.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.883+0000 7f94e7fff640 1 -- 172.21.15.53:0/1333562535 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94e80c8380 msgr2=0x7f94e8156a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:27.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.883+0000 7f94e7fff640 1 --2- 172.21.15.53:0/1333562535 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94e80c8380 0x7f94e8156a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:27.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.883+0000 7f94e7fff640 1 -- 172.21.15.53:0/1333562535 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94e81e7f50 con 0x7f94d4004010 2023-06-10T18:56:27.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.883+0000 7f94ecc7d640 1 --2- 172.21.15.53:0/1333562535 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94e80c8380 0x7f94e8156a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:56:27.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.883+0000 7f94e7fff640 1 --2- 172.21.15.53:0/1333562535 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f94d4004010 0x7f94e8151a30 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f94d8011870 tx=0x7f94d8011d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:27.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.883+0000 7f94e4ff9640 1 -- 172.21.15.53:0/1333562535 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d801a030 con 0x7f94d4004010 2023-06-10T18:56:27.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.883+0000 7f94e4ff9640 1 -- 172.21.15.53:0/1333562535 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94d800fb00 con 0x7f94d4004010 2023-06-10T18:56:27.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.883+0000 7f94ee6e0640 1 -- 172.21.15.53:0/1333562535 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94e80c72e0 con 0x7f94d4004010 2023-06-10T18:56:27.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.883+0000 7f94e4ff9640 1 -- 172.21.15.53:0/1333562535 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d800fe70 con 0x7f94d4004010 2023-06-10T18:56:27.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.883+0000 7f94ee6e0640 1 -- 172.21.15.53:0/1333562535 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94e80c78a0 con 0x7f94d4004010 2023-06-10T18:56:27.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.883+0000 7f94ee6e0640 1 -- 172.21.15.53:0/1333562535 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94e80d1e40 con 0x7f94d4004010 2023-06-10T18:56:27.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.883+0000 7f94e4ff9640 1 -- 172.21.15.53:0/1333562535 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f94d801d070 con 0x7f94d4004010 2023-06-10T18:56:27.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.887+0000 7f94e4ff9640 1 --2- 172.21.15.53:0/1333562535 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f94c8066280 0x7f94c8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:27.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.887+0000 7f94e4ff9640 1 -- 172.21.15.53:0/1333562535 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f94d801b070 con 0x7f94d4004010 2023-06-10T18:56:27.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.887+0000 7f94e77fe640 1 --2- 172.21.15.53:0/1333562535 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f94c8066280 0x7f94c8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:27.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.887+0000 7f94e77fe640 1 --2- 172.21.15.53:0/1333562535 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f94c8066280 0x7f94c8068730 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f94d00af000 tx=0x7f94d00aa040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:27.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:27.891+0000 7f94e4ff9640 1 -- 172.21.15.53:0/1333562535 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f94d8053ff0 con 0x7f94d4004010 2023-06-10T18:56:28.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.047+0000 7f94ee6e0640 1 -- 172.21.15.53:0/1333562535 --> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f94e80cfcb0 con 0x7f94c8066280 2023-06-10T18:56:28.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.071+0000 7f94e4ff9640 1 -- 172.21.15.53:0/1333562535 <== mgr.4105 v2:172.21.15.117:6832/3061986771 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+309197 (secure 0 0 0) 0x7f94d00a85c0 con 0x7f94c8066280 2023-06-10T18:56:28.078 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:56:28.079 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-06-10T18:56:28.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.075+0000 7f94ee6e0640 1 -- 172.21.15.53:0/1333562535 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f94c8066280 msgr2=0x7f94c8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:28.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.075+0000 7f94ee6e0640 1 --2- 172.21.15.53:0/1333562535 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f94c8066280 0x7f94c8068730 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f94d00af000 tx=0x7f94d00aa040 comp rx=0 tx=0).stop 2023-06-10T18:56:28.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.075+0000 7f94ee6e0640 1 -- 172.21.15.53:0/1333562535 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f94d4004010 msgr2=0x7f94e8151a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:28.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.075+0000 7f94ee6e0640 1 --2- 172.21.15.53:0/1333562535 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f94d4004010 0x7f94e8151a30 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f94d8011870 tx=0x7f94d8011d30 comp rx=0 tx=0).stop 2023-06-10T18:56:28.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.075+0000 7f94ee6e0640 1 -- 172.21.15.53:0/1333562535 shutdown_connections 2023-06-10T18:56:28.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.075+0000 7f94ee6e0640 1 --2- 172.21.15.53:0/1333562535 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f94c8066280 0x7f94c8068730 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:28.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.075+0000 7f94ee6e0640 1 --2- 172.21.15.53:0/1333562535 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94e80c8380 0x7f94e8156a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:28.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.075+0000 7f94ee6e0640 1 --2- 172.21.15.53:0/1333562535 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94e81e7b00 0x7f94e81f5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:28.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.075+0000 7f94ee6e0640 1 --2- 172.21.15.53:0/1333562535 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f94d4004010 0x7f94e8151a30 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:28.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.075+0000 7f94ee6e0640 1 -- 172.21.15.53:0/1333562535 >> 172.21.15.53:0/1333562535 conn(0x7f94e8071790 msgr2=0x7f94e80d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:28.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.075+0000 7f94ee6e0640 1 -- 172.21.15.53:0/1333562535 shutdown_connections 2023-06-10T18:56:28.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.075+0000 7f94ee6e0640 1 -- 172.21.15.53:0/1333562535 wait complete. 2023-06-10T18:56:28.096 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":164,"stamp":"2023-06-10T18:56:27.888666+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237976,"kb_used_data":5976,"kb_used_omap":0,"kb_used_meta":231936,"kb_avail":754736744,"statfs":{"total":773094113280,"available":772850425856,"internally_reserved":0,"allocated":6119424,"data_stored":3301653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":237502464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.195857"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.887321+0000","last_change":"2023-06-10T18:56:18.723557+0000","last_active":"2023-06-10T18:56:26.887321+0000","last_peered":"2023-06-10T18:56:26.887321+0000","last_clean":"2023-06-10T18:56:26.887321+0000","last_became_active":"2023-06-10T18:56:18.723169+0000","last_became_peered":"2023-06-10T18:56:18.723169+0000","last_unstale":"2023-06-10T18:56:26.887321+0000","last_undegraded":"2023-06-10T18:56:26.887321+0000","last_fullsized":"2023-06-10T18:56:26.887321+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:05:32.467816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.144646+0000","last_change":"2023-06-10T18:56:18.739659+0000","last_active":"2023-06-10T18:56:27.144646+0000","last_peered":"2023-06-10T18:56:27.144646+0000","last_clean":"2023-06-10T18:56:27.144646+0000","last_became_active":"2023-06-10T18:56:18.738930+0000","last_became_peered":"2023-06-10T18:56:18.738930+0000","last_unstale":"2023-06-10T18:56:27.144646+0000","last_undegraded":"2023-06-10T18:56:27.144646+0000","last_fullsized":"2023-06-10T18:56:27.144646+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:56:20.150212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.882137+0000","last_change":"2023-06-10T18:56:18.715713+0000","last_active":"2023-06-10T18:56:26.882137+0000","last_peered":"2023-06-10T18:56:26.882137+0000","last_clean":"2023-06-10T18:56:26.882137+0000","last_became_active":"2023-06-10T18:56:18.715403+0000","last_became_peered":"2023-06-10T18:56:18.715403+0000","last_unstale":"2023-06-10T18:56:26.882137+0000","last_undegraded":"2023-06-10T18:56:26.882137+0000","last_fullsized":"2023-06-10T18:56:26.882137+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:13:39.804832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.144321+0000","last_change":"2023-06-10T18:56:18.742396+0000","last_active":"2023-06-10T18:56:27.144321+0000","last_peered":"2023-06-10T18:56:27.144321+0000","last_clean":"2023-06-10T18:56:27.144321+0000","last_became_active":"2023-06-10T18:56:18.741689+0000","last_became_peered":"2023-06-10T18:56:18.741689+0000","last_unstale":"2023-06-10T18:56:27.144321+0000","last_undegraded":"2023-06-10T18:56:27.144321+0000","last_fullsized":"2023-06-10T18:56:27.144321+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:15:14.281447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.871175+0000","last_change":"2023-06-10T18:56:18.733830+0000","last_active":"2023-06-10T18:56:26.871175+0000","last_peered":"2023-06-10T18:56:26.871175+0000","last_clean":"2023-06-10T18:56:26.871175+0000","last_became_active":"2023-06-10T18:56:18.732968+0000","last_became_peered":"2023-06-10T18:56:18.732968+0000","last_unstale":"2023-06-10T18:56:26.871175+0000","last_undegraded":"2023-06-10T18:56:26.871175+0000","last_fullsized":"2023-06-10T18:56:26.871175+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:17:50.531074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.886873+0000","last_change":"2023-06-10T18:56:18.733304+0000","last_active":"2023-06-10T18:56:26.886873+0000","last_peered":"2023-06-10T18:56:26.886873+0000","last_clean":"2023-06-10T18:56:26.886873+0000","last_became_active":"2023-06-10T18:56:18.733010+0000","last_became_peered":"2023-06-10T18:56:18.733010+0000","last_unstale":"2023-06-10T18:56:26.886873+0000","last_undegraded":"2023-06-10T18:56:26.886873+0000","last_fullsized":"2023-06-10T18:56:26.886873+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:04:11.756055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.879556+0000","last_change":"2023-06-10T18:56:18.715925+0000","last_active":"2023-06-10T18:56:26.879556+0000","last_peered":"2023-06-10T18:56:26.879556+0000","last_clean":"2023-06-10T18:56:26.879556+0000","last_became_active":"2023-06-10T18:56:18.715163+0000","last_became_peered":"2023-06-10T18:56:18.715163+0000","last_unstale":"2023-06-10T18:56:26.879556+0000","last_undegraded":"2023-06-10T18:56:26.879556+0000","last_fullsized":"2023-06-10T18:56:26.879556+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:07:15.569502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.194669+0000","last_change":"2023-06-10T18:56:18.710693+0000","last_active":"2023-06-10T18:56:27.194669+0000","last_peered":"2023-06-10T18:56:27.194669+0000","last_clean":"2023-06-10T18:56:27.194669+0000","last_became_active":"2023-06-10T18:56:18.710420+0000","last_became_peered":"2023-06-10T18:56:18.710420+0000","last_unstale":"2023-06-10T18:56:27.194669+0000","last_undegraded":"2023-06-10T18:56:27.194669+0000","last_fullsized":"2023-06-10T18:56:27.194669+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:04:11.756055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.195404+0000","last_change":"2023-06-10T18:56:18.711205+0000","last_active":"2023-06-10T18:56:27.195404+0000","last_peered":"2023-06-10T18:56:27.195404+0000","last_clean":"2023-06-10T18:56:27.195404+0000","last_became_active":"2023-06-10T18:56:18.711011+0000","last_became_peered":"2023-06-10T18:56:18.711011+0000","last_unstale":"2023-06-10T18:56:27.195404+0000","last_undegraded":"2023-06-10T18:56:27.195404+0000","last_fullsized":"2023-06-10T18:56:27.195404+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:52:30.517410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.887403+0000","last_change":"2023-06-10T18:56:18.731703+0000","last_active":"2023-06-10T18:56:26.887403+0000","last_peered":"2023-06-10T18:56:26.887403+0000","last_clean":"2023-06-10T18:56:26.887403+0000","last_became_active":"2023-06-10T18:56:18.731407+0000","last_became_peered":"2023-06-10T18:56:18.731407+0000","last_unstale":"2023-06-10T18:56:26.887403+0000","last_undegraded":"2023-06-10T18:56:26.887403+0000","last_fullsized":"2023-06-10T18:56:26.887403+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:13:39.804832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.868234+0000","last_change":"2023-06-10T18:56:18.739026+0000","last_active":"2023-06-10T18:56:26.868234+0000","last_peered":"2023-06-10T18:56:26.868234+0000","last_clean":"2023-06-10T18:56:26.868234+0000","last_became_active":"2023-06-10T18:56:18.738748+0000","last_became_peered":"2023-06-10T18:56:18.738748+0000","last_unstale":"2023-06-10T18:56:26.868234+0000","last_undegraded":"2023-06-10T18:56:26.868234+0000","last_fullsized":"2023-06-10T18:56:26.868234+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:11:27.241616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.195269+0000","last_change":"2023-06-10T18:56:18.711319+0000","last_active":"2023-06-10T18:56:27.195269+0000","last_peered":"2023-06-10T18:56:27.195269+0000","last_clean":"2023-06-10T18:56:27.195269+0000","last_became_active":"2023-06-10T18:56:18.711043+0000","last_became_peered":"2023-06-10T18:56:18.711043+0000","last_unstale":"2023-06-10T18:56:27.195269+0000","last_undegraded":"2023-06-10T18:56:27.195269+0000","last_fullsized":"2023-06-10T18:56:27.195269+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:05:32.467816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.886977+0000","last_change":"2023-06-10T18:56:18.735130+0000","last_active":"2023-06-10T18:56:26.886977+0000","last_peered":"2023-06-10T18:56:26.886977+0000","last_clean":"2023-06-10T18:56:26.886977+0000","last_became_active":"2023-06-10T18:56:18.734873+0000","last_became_peered":"2023-06-10T18:56:18.734873+0000","last_unstale":"2023-06-10T18:56:26.886977+0000","last_undegraded":"2023-06-10T18:56:26.886977+0000","last_fullsized":"2023-06-10T18:56:26.886977+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:27:56.626985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.879977+0000","last_change":"2023-06-10T18:56:18.718525+0000","last_active":"2023-06-10T18:56:26.879977+0000","last_peered":"2023-06-10T18:56:26.879977+0000","last_clean":"2023-06-10T18:56:26.879977+0000","last_became_active":"2023-06-10T18:56:18.718169+0000","last_became_peered":"2023-06-10T18:56:18.718169+0000","last_unstale":"2023-06-10T18:56:26.879977+0000","last_undegraded":"2023-06-10T18:56:26.879977+0000","last_fullsized":"2023-06-10T18:56:26.879977+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:17:01.114014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.144057+0000","last_change":"2023-06-10T18:56:18.747220+0000","last_active":"2023-06-10T18:56:27.144057+0000","last_peered":"2023-06-10T18:56:27.144057+0000","last_clean":"2023-06-10T18:56:27.144057+0000","last_became_active":"2023-06-10T18:56:18.746415+0000","last_became_peered":"2023-06-10T18:56:18.746415+0000","last_unstale":"2023-06-10T18:56:27.144057+0000","last_undegraded":"2023-06-10T18:56:27.144057+0000","last_fullsized":"2023-06-10T18:56:27.144057+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:02:03.688477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.886572+0000","last_change":"2023-06-10T18:56:18.732379+0000","last_active":"2023-06-10T18:56:26.886572+0000","last_peered":"2023-06-10T18:56:26.886572+0000","last_clean":"2023-06-10T18:56:26.886572+0000","last_became_active":"2023-06-10T18:56:18.732081+0000","last_became_peered":"2023-06-10T18:56:18.732081+0000","last_unstale":"2023-06-10T18:56:26.886572+0000","last_undegraded":"2023-06-10T18:56:26.886572+0000","last_fullsized":"2023-06-10T18:56:26.886572+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:17:50.531074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.880795+0000","last_change":"2023-06-10T18:56:18.727402+0000","last_active":"2023-06-10T18:56:26.880795+0000","last_peered":"2023-06-10T18:56:26.880795+0000","last_clean":"2023-06-10T18:56:26.880795+0000","last_became_active":"2023-06-10T18:56:18.726939+0000","last_became_peered":"2023-06-10T18:56:18.726939+0000","last_unstale":"2023-06-10T18:56:26.880795+0000","last_undegraded":"2023-06-10T18:56:26.880795+0000","last_fullsized":"2023-06-10T18:56:26.880795+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:57:17.090045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.144764+0000","last_change":"2023-06-10T18:56:18.741248+0000","last_active":"2023-06-10T18:56:27.144764+0000","last_peered":"2023-06-10T18:56:27.144764+0000","last_clean":"2023-06-10T18:56:27.144764+0000","last_became_active":"2023-06-10T18:56:18.740548+0000","last_became_peered":"2023-06-10T18:56:18.740548+0000","last_unstale":"2023-06-10T18:56:27.144764+0000","last_undegraded":"2023-06-10T18:56:27.144764+0000","last_fullsized":"2023-06-10T18:56:27.144764+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:51:41.177614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.880542+0000","last_change":"2023-06-10T18:56:18.718426+0000","last_active":"2023-06-10T18:56:26.880542+0000","last_peered":"2023-06-10T18:56:26.880542+0000","last_clean":"2023-06-10T18:56:26.880542+0000","last_became_active":"2023-06-10T18:56:18.718017+0000","last_became_peered":"2023-06-10T18:56:18.718017+0000","last_unstale":"2023-06-10T18:56:26.880542+0000","last_undegraded":"2023-06-10T18:56:26.880542+0000","last_fullsized":"2023-06-10T18:56:26.880542+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:36:56.932324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.875458+0000","last_change":"2023-06-10T18:56:18.734189+0000","last_active":"2023-06-10T18:56:26.875458+0000","last_peered":"2023-06-10T18:56:26.875458+0000","last_clean":"2023-06-10T18:56:26.875458+0000","last_became_active":"2023-06-10T18:56:18.733412+0000","last_became_peered":"2023-06-10T18:56:18.733412+0000","last_unstale":"2023-06-10T18:56:26.875458+0000","last_undegraded":"2023-06-10T18:56:26.875458+0000","last_fullsized":"2023-06-10T18:56:26.875458+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:59:44.756321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.875364+0000","last_change":"2023-06-10T18:56:18.737307+0000","last_active":"2023-06-10T18:56:26.875364+0000","last_peered":"2023-06-10T18:56:26.875364+0000","last_clean":"2023-06-10T18:56:26.875364+0000","last_became_active":"2023-06-10T18:56:18.736534+0000","last_became_peered":"2023-06-10T18:56:18.736534+0000","last_unstale":"2023-06-10T18:56:26.875364+0000","last_undegraded":"2023-06-10T18:56:26.875364+0000","last_fullsized":"2023-06-10T18:56:26.875364+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:01:44.663641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.194660+0000","last_change":"2023-06-10T18:56:18.710819+0000","last_active":"2023-06-10T18:56:27.194660+0000","last_peered":"2023-06-10T18:56:27.194660+0000","last_clean":"2023-06-10T18:56:27.194660+0000","last_became_active":"2023-06-10T18:56:18.710524+0000","last_became_peered":"2023-06-10T18:56:18.710524+0000","last_unstale":"2023-06-10T18:56:27.194660+0000","last_undegraded":"2023-06-10T18:56:27.194660+0000","last_fullsized":"2023-06-10T18:56:27.194660+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:16:44.545696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.867692+0000","last_change":"2023-06-10T18:56:18.739719+0000","last_active":"2023-06-10T18:56:26.867692+0000","last_peered":"2023-06-10T18:56:26.867692+0000","last_clean":"2023-06-10T18:56:26.867692+0000","last_became_active":"2023-06-10T18:56:18.739394+0000","last_became_peered":"2023-06-10T18:56:18.739394+0000","last_unstale":"2023-06-10T18:56:26.867692+0000","last_undegraded":"2023-06-10T18:56:26.867692+0000","last_fullsized":"2023-06-10T18:56:26.867692+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:48:22.699885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.879440+0000","last_change":"2023-06-10T18:56:18.716014+0000","last_active":"2023-06-10T18:56:26.879440+0000","last_peered":"2023-06-10T18:56:26.879440+0000","last_clean":"2023-06-10T18:56:26.879440+0000","last_became_active":"2023-06-10T18:56:18.715463+0000","last_became_peered":"2023-06-10T18:56:18.715463+0000","last_unstale":"2023-06-10T18:56:26.879440+0000","last_undegraded":"2023-06-10T18:56:26.879440+0000","last_fullsized":"2023-06-10T18:56:26.879440+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:40:33.066988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.881131+0000","last_change":"2023-06-10T18:56:18.722488+0000","last_active":"2023-06-10T18:56:26.881131+0000","last_peered":"2023-06-10T18:56:26.881131+0000","last_clean":"2023-06-10T18:56:26.881131+0000","last_became_active":"2023-06-10T18:56:18.722221+0000","last_became_peered":"2023-06-10T18:56:18.722221+0000","last_unstale":"2023-06-10T18:56:26.881131+0000","last_undegraded":"2023-06-10T18:56:26.881131+0000","last_fullsized":"2023-06-10T18:56:26.881131+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:16:44.545696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.195014+0000","last_change":"2023-06-10T18:56:18.721449+0000","last_active":"2023-06-10T18:56:27.195014+0000","last_peered":"2023-06-10T18:56:27.195014+0000","last_clean":"2023-06-10T18:56:27.195014+0000","last_became_active":"2023-06-10T18:56:18.721191+0000","last_became_peered":"2023-06-10T18:56:18.721191+0000","last_unstale":"2023-06-10T18:56:27.195014+0000","last_undegraded":"2023-06-10T18:56:27.195014+0000","last_fullsized":"2023-06-10T18:56:27.195014+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:18:25.090460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.888495+0000","last_change":"2023-06-10T18:56:18.719671+0000","last_active":"2023-06-10T18:56:26.888495+0000","last_peered":"2023-06-10T18:56:26.888495+0000","last_clean":"2023-06-10T18:56:26.888495+0000","last_became_active":"2023-06-10T18:56:18.718588+0000","last_became_peered":"2023-06-10T18:56:18.718588+0000","last_unstale":"2023-06-10T18:56:26.888495+0000","last_undegraded":"2023-06-10T18:56:26.888495+0000","last_fullsized":"2023-06-10T18:56:26.888495+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:57:04.253762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.875781+0000","last_change":"2023-06-10T18:56:18.720108+0000","last_active":"2023-06-10T18:56:26.875781+0000","last_peered":"2023-06-10T18:56:26.875781+0000","last_clean":"2023-06-10T18:56:26.875781+0000","last_became_active":"2023-06-10T18:56:18.719242+0000","last_became_peered":"2023-06-10T18:56:18.719242+0000","last_unstale":"2023-06-10T18:56:26.875781+0000","last_undegraded":"2023-06-10T18:56:26.875781+0000","last_fullsized":"2023-06-10T18:56:26.875781+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:41:27.064954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.879750+0000","last_change":"2023-06-10T18:56:18.747959+0000","last_active":"2023-06-10T18:56:26.879750+0000","last_peered":"2023-06-10T18:56:26.879750+0000","last_clean":"2023-06-10T18:56:26.879750+0000","last_became_active":"2023-06-10T18:56:18.747680+0000","last_became_peered":"2023-06-10T18:56:18.747680+0000","last_unstale":"2023-06-10T18:56:26.879750+0000","last_undegraded":"2023-06-10T18:56:26.879750+0000","last_fullsized":"2023-06-10T18:56:26.879750+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:22:48.846033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.144212+0000","last_change":"2023-06-10T18:56:18.740103+0000","last_active":"2023-06-10T18:56:27.144212+0000","last_peered":"2023-06-10T18:56:27.144212+0000","last_clean":"2023-06-10T18:56:27.144212+0000","last_became_active":"2023-06-10T18:56:18.739227+0000","last_became_peered":"2023-06-10T18:56:18.739227+0000","last_unstale":"2023-06-10T18:56:27.144212+0000","last_undegraded":"2023-06-10T18:56:27.144212+0000","last_fullsized":"2023-06-10T18:56:27.144212+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:21:25.069656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.879705+0000","last_change":"2023-06-10T18:56:18.715535+0000","last_active":"2023-06-10T18:56:26.879705+0000","last_peered":"2023-06-10T18:56:26.879705+0000","last_clean":"2023-06-10T18:56:26.879705+0000","last_became_active":"2023-06-10T18:56:18.714677+0000","last_became_peered":"2023-06-10T18:56:18.714677+0000","last_unstale":"2023-06-10T18:56:26.879705+0000","last_undegraded":"2023-06-10T18:56:26.879705+0000","last_fullsized":"2023-06-10T18:56:26.879705+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:12:02.143937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.871827+0000","last_change":"2023-06-10T18:56:18.705775+0000","last_active":"2023-06-10T18:56:26.871827+0000","last_peered":"2023-06-10T18:56:26.871827+0000","last_clean":"2023-06-10T18:56:26.871827+0000","last_became_active":"2023-06-10T18:56:18.703437+0000","last_became_peered":"2023-06-10T18:56:18.703437+0000","last_unstale":"2023-06-10T18:56:26.871827+0000","last_undegraded":"2023-06-10T18:56:26.871827+0000","last_fullsized":"2023-06-10T18:56:26.871827+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:03:07.190449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.143717+0000","last_change":"2023-06-10T18:56:18.740486+0000","last_active":"2023-06-10T18:56:27.143717+0000","last_peered":"2023-06-10T18:56:27.143717+0000","last_clean":"2023-06-10T18:56:27.143717+0000","last_became_active":"2023-06-10T18:56:18.739644+0000","last_became_peered":"2023-06-10T18:56:18.739644+0000","last_unstale":"2023-06-10T18:56:27.143717+0000","last_undegraded":"2023-06-10T18:56:27.143717+0000","last_fullsized":"2023-06-10T18:56:27.143717+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:30:31.600689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"50'4","reported_seq":19,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.876540+0000","last_change":"2023-06-10T18:56:18.340764+0000","last_active":"2023-06-10T18:56:26.876540+0000","last_peered":"2023-06-10T18:56:26.876540+0000","last_clean":"2023-06-10T18:56:26.876540+0000","last_became_active":"2023-06-10T18:56:18.340011+0000","last_became_peered":"2023-06-10T18:56:18.340011+0000","last_unstale":"2023-06-10T18:56:26.876540+0000","last_undegraded":"2023-06-10T18:56:26.876540+0000","last_fullsized":"2023-06-10T18:56:26.876540+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:11:50.546839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.873041+0000","last_change":"2023-06-10T18:56:18.735833+0000","last_active":"2023-06-10T18:56:26.873041+0000","last_peered":"2023-06-10T18:56:26.873041+0000","last_clean":"2023-06-10T18:56:26.873041+0000","last_became_active":"2023-06-10T18:56:18.734668+0000","last_became_peered":"2023-06-10T18:56:18.734668+0000","last_unstale":"2023-06-10T18:56:26.873041+0000","last_undegraded":"2023-06-10T18:56:26.873041+0000","last_fullsized":"2023-06-10T18:56:26.873041+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:16:35.200792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"50'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.887551+0000","last_change":"2023-06-10T18:56:18.335972+0000","last_active":"2023-06-10T18:56:26.887551+0000","last_peered":"2023-06-10T18:56:26.887551+0000","last_clean":"2023-06-10T18:56:26.887551+0000","last_became_active":"2023-06-10T18:56:18.335565+0000","last_became_peered":"2023-06-10T18:56:18.335565+0000","last_unstale":"2023-06-10T18:56:26.887551+0000","last_undegraded":"2023-06-10T18:56:26.887551+0000","last_fullsized":"2023-06-10T18:56:26.887551+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:52:29.503909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.875187+0000","last_change":"2023-06-10T18:56:18.741042+0000","last_active":"2023-06-10T18:56:26.875187+0000","last_peered":"2023-06-10T18:56:26.875187+0000","last_clean":"2023-06-10T18:56:26.875187+0000","last_became_active":"2023-06-10T18:56:18.740325+0000","last_became_peered":"2023-06-10T18:56:18.740325+0000","last_unstale":"2023-06-10T18:56:26.875187+0000","last_undegraded":"2023-06-10T18:56:26.875187+0000","last_fullsized":"2023-06-10T18:56:26.875187+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:45:27.842047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"50'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.888555+0000","last_change":"2023-06-10T18:56:18.336603+0000","last_active":"2023-06-10T18:56:26.888555+0000","last_peered":"2023-06-10T18:56:26.888555+0000","last_clean":"2023-06-10T18:56:26.888555+0000","last_became_active":"2023-06-10T18:56:18.336117+0000","last_became_peered":"2023-06-10T18:56:18.336117+0000","last_unstale":"2023-06-10T18:56:26.888555+0000","last_undegraded":"2023-06-10T18:56:26.888555+0000","last_fullsized":"2023-06-10T18:56:26.888555+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:41:56.108306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.194691+0000","last_change":"2023-06-10T18:56:18.719404+0000","last_active":"2023-06-10T18:56:27.194691+0000","last_peered":"2023-06-10T18:56:27.194691+0000","last_clean":"2023-06-10T18:56:27.194691+0000","last_became_active":"2023-06-10T18:56:18.719096+0000","last_became_peered":"2023-06-10T18:56:18.719096+0000","last_unstale":"2023-06-10T18:56:27.194691+0000","last_undegraded":"2023-06-10T18:56:27.194691+0000","last_fullsized":"2023-06-10T18:56:27.194691+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:33:38.472734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"50'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.872249+0000","last_change":"2023-06-10T18:56:18.323382+0000","last_active":"2023-06-10T18:56:26.872249+0000","last_peered":"2023-06-10T18:56:26.872249+0000","last_clean":"2023-06-10T18:56:26.872249+0000","last_became_active":"2023-06-10T18:56:18.322748+0000","last_became_peered":"2023-06-10T18:56:18.322748+0000","last_unstale":"2023-06-10T18:56:26.872249+0000","last_undegraded":"2023-06-10T18:56:26.872249+0000","last_fullsized":"2023-06-10T18:56:26.872249+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:35:54.887943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.872083+0000","last_change":"2023-06-10T18:56:18.716497+0000","last_active":"2023-06-10T18:56:26.872083+0000","last_peered":"2023-06-10T18:56:26.872083+0000","last_clean":"2023-06-10T18:56:26.872083+0000","last_became_active":"2023-06-10T18:56:18.715689+0000","last_became_peered":"2023-06-10T18:56:18.715689+0000","last_unstale":"2023-06-10T18:56:26.872083+0000","last_undegraded":"2023-06-10T18:56:26.872083+0000","last_fullsized":"2023-06-10T18:56:26.872083+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:27:56.626985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"50'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.880042+0000","last_change":"2023-06-10T18:56:18.321017+0000","last_active":"2023-06-10T18:56:26.880042+0000","last_peered":"2023-06-10T18:56:26.880042+0000","last_clean":"2023-06-10T18:56:26.880042+0000","last_became_active":"2023-06-10T18:56:18.320552+0000","last_became_peered":"2023-06-10T18:56:18.320552+0000","last_unstale":"2023-06-10T18:56:26.880042+0000","last_undegraded":"2023-06-10T18:56:26.880042+0000","last_fullsized":"2023-06-10T18:56:26.880042+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:53:30.066871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.144497+0000","last_change":"2023-06-10T18:56:18.742047+0000","last_active":"2023-06-10T18:56:27.144497+0000","last_peered":"2023-06-10T18:56:27.144497+0000","last_clean":"2023-06-10T18:56:27.144497+0000","last_became_active":"2023-06-10T18:56:18.741342+0000","last_became_peered":"2023-06-10T18:56:18.741342+0000","last_unstale":"2023-06-10T18:56:27.144497+0000","last_undegraded":"2023-06-10T18:56:27.144497+0000","last_fullsized":"2023-06-10T18:56:27.144497+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:39:30.440026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"50'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.871399+0000","last_change":"2023-06-10T18:56:18.339655+0000","last_active":"2023-06-10T18:56:26.871399+0000","last_peered":"2023-06-10T18:56:26.871399+0000","last_clean":"2023-06-10T18:56:26.871399+0000","last_became_active":"2023-06-10T18:56:18.338930+0000","last_became_peered":"2023-06-10T18:56:18.338930+0000","last_unstale":"2023-06-10T18:56:26.871399+0000","last_undegraded":"2023-06-10T18:56:26.871399+0000","last_fullsized":"2023-06-10T18:56:26.871399+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:57:16.076543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.195762+0000","last_change":"2023-06-10T18:56:18.721372+0000","last_active":"2023-06-10T18:56:27.195762+0000","last_peered":"2023-06-10T18:56:27.195762+0000","last_clean":"2023-06-10T18:56:27.195762+0000","last_became_active":"2023-06-10T18:56:18.721086+0000","last_became_peered":"2023-06-10T18:56:18.721086+0000","last_unstale":"2023-06-10T18:56:27.195762+0000","last_undegraded":"2023-06-10T18:56:27.195762+0000","last_fullsized":"2023-06-10T18:56:27.195762+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:36:50.106017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.875086+0000","last_change":"2023-06-10T18:56:18.337501+0000","last_active":"2023-06-10T18:56:26.875086+0000","last_peered":"2023-06-10T18:56:26.875086+0000","last_clean":"2023-06-10T18:56:26.875086+0000","last_became_active":"2023-06-10T18:56:18.336875+0000","last_became_peered":"2023-06-10T18:56:18.336875+0000","last_unstale":"2023-06-10T18:56:26.875086+0000","last_undegraded":"2023-06-10T18:56:26.875086+0000","last_fullsized":"2023-06-10T18:56:26.875086+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:54:49.818477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.144972+0000","last_change":"2023-06-10T18:56:18.740844+0000","last_active":"2023-06-10T18:56:27.144972+0000","last_peered":"2023-06-10T18:56:27.144972+0000","last_clean":"2023-06-10T18:56:27.144972+0000","last_became_active":"2023-06-10T18:56:18.740202+0000","last_became_peered":"2023-06-10T18:56:18.740202+0000","last_unstale":"2023-06-10T18:56:27.144972+0000","last_undegraded":"2023-06-10T18:56:27.144972+0000","last_fullsized":"2023-06-10T18:56:27.144972+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:34:13.702327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.879577+0000","last_change":"2023-06-10T18:56:18.328357+0000","last_active":"2023-06-10T18:56:26.879577+0000","last_peered":"2023-06-10T18:56:26.879577+0000","last_clean":"2023-06-10T18:56:26.879577+0000","last_became_active":"2023-06-10T18:56:18.328062+0000","last_became_peered":"2023-06-10T18:56:18.328062+0000","last_unstale":"2023-06-10T18:56:26.879577+0000","last_undegraded":"2023-06-10T18:56:26.879577+0000","last_fullsized":"2023-06-10T18:56:26.879577+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:42:04.516586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.870557+0000","last_change":"2023-06-10T18:56:18.715041+0000","last_active":"2023-06-10T18:56:26.870557+0000","last_peered":"2023-06-10T18:56:26.870557+0000","last_clean":"2023-06-10T18:56:26.870557+0000","last_became_active":"2023-06-10T18:56:18.714315+0000","last_became_peered":"2023-06-10T18:56:18.714315+0000","last_unstale":"2023-06-10T18:56:26.870557+0000","last_undegraded":"2023-06-10T18:56:26.870557+0000","last_fullsized":"2023-06-10T18:56:26.870557+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:23:30.185213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.144647+0000","last_change":"2023-06-10T18:56:18.343930+0000","last_active":"2023-06-10T18:56:27.144647+0000","last_peered":"2023-06-10T18:56:27.144647+0000","last_clean":"2023-06-10T18:56:27.144647+0000","last_became_active":"2023-06-10T18:56:18.343289+0000","last_became_peered":"2023-06-10T18:56:18.343289+0000","last_unstale":"2023-06-10T18:56:27.144647+0000","last_undegraded":"2023-06-10T18:56:27.144647+0000","last_fullsized":"2023-06-10T18:56:27.144647+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:14:05.116786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.872895+0000","last_change":"2023-06-10T18:56:18.720481+0000","last_active":"2023-06-10T18:56:26.872895+0000","last_peered":"2023-06-10T18:56:26.872895+0000","last_clean":"2023-06-10T18:56:26.872895+0000","last_became_active":"2023-06-10T18:56:18.717729+0000","last_became_peered":"2023-06-10T18:56:18.717729+0000","last_unstale":"2023-06-10T18:56:26.872895+0000","last_undegraded":"2023-06-10T18:56:26.872895+0000","last_fullsized":"2023-06-10T18:56:26.872895+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:07:34.244620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.872218+0000","last_change":"2023-06-10T18:56:18.331216+0000","last_active":"2023-06-10T18:56:26.872218+0000","last_peered":"2023-06-10T18:56:26.872218+0000","last_clean":"2023-06-10T18:56:26.872218+0000","last_became_active":"2023-06-10T18:56:18.330640+0000","last_became_peered":"2023-06-10T18:56:18.330640+0000","last_unstale":"2023-06-10T18:56:26.872218+0000","last_undegraded":"2023-06-10T18:56:26.872218+0000","last_fullsized":"2023-06-10T18:56:26.872218+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:16:43.532194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.880373+0000","last_change":"2023-06-10T18:56:18.745850+0000","last_active":"2023-06-10T18:56:26.880373+0000","last_peered":"2023-06-10T18:56:26.880373+0000","last_clean":"2023-06-10T18:56:26.880373+0000","last_became_active":"2023-06-10T18:56:18.745516+0000","last_became_peered":"2023-06-10T18:56:18.745516+0000","last_unstale":"2023-06-10T18:56:26.880373+0000","last_undegraded":"2023-06-10T18:56:26.880373+0000","last_fullsized":"2023-06-10T18:56:26.880373+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:53:56.836970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"50'3","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.144726+0000","last_change":"2023-06-10T18:56:18.341819+0000","last_active":"2023-06-10T18:56:27.144726+0000","last_peered":"2023-06-10T18:56:27.144726+0000","last_clean":"2023-06-10T18:56:27.144726+0000","last_became_active":"2023-06-10T18:56:18.341153+0000","last_became_peered":"2023-06-10T18:56:18.341153+0000","last_unstale":"2023-06-10T18:56:27.144726+0000","last_undegraded":"2023-06-10T18:56:27.144726+0000","last_fullsized":"2023-06-10T18:56:27.144726+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:13:55.771862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.871435+0000","last_change":"2023-06-10T18:56:18.718945+0000","last_active":"2023-06-10T18:56:26.871435+0000","last_peered":"2023-06-10T18:56:26.871435+0000","last_clean":"2023-06-10T18:56:26.871435+0000","last_became_active":"2023-06-10T18:56:18.717962+0000","last_became_peered":"2023-06-10T18:56:18.717962+0000","last_unstale":"2023-06-10T18:56:26.871435+0000","last_undegraded":"2023-06-10T18:56:26.871435+0000","last_fullsized":"2023-06-10T18:56:26.871435+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:04:11.756055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"50'6","reported_seq":21,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.195682+0000","last_change":"2023-06-10T18:56:18.333312+0000","last_active":"2023-06-10T18:56:27.195682+0000","last_peered":"2023-06-10T18:56:27.195682+0000","last_clean":"2023-06-10T18:56:27.195682+0000","last_became_active":"2023-06-10T18:56:18.332390+0000","last_became_peered":"2023-06-10T18:56:18.332390+0000","last_unstale":"2023-06-10T18:56:27.195682+0000","last_undegraded":"2023-06-10T18:56:27.195682+0000","last_fullsized":"2023-06-10T18:56:27.195682+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:04:57.213752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.871933+0000","last_change":"2023-06-10T18:56:18.739711+0000","last_active":"2023-06-10T18:56:26.871933+0000","last_peered":"2023-06-10T18:56:26.871933+0000","last_clean":"2023-06-10T18:56:26.871933+0000","last_became_active":"2023-06-10T18:56:18.738999+0000","last_became_peered":"2023-06-10T18:56:18.738999+0000","last_unstale":"2023-06-10T18:56:26.871933+0000","last_undegraded":"2023-06-10T18:56:26.871933+0000","last_fullsized":"2023-06-10T18:56:26.871933+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:14:23.654180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"50'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.880149+0000","last_change":"2023-06-10T18:56:18.342157+0000","last_active":"2023-06-10T18:56:26.880149+0000","last_peered":"2023-06-10T18:56:26.880149+0000","last_clean":"2023-06-10T18:56:26.880149+0000","last_became_active":"2023-06-10T18:56:18.341576+0000","last_became_peered":"2023-06-10T18:56:18.341576+0000","last_unstale":"2023-06-10T18:56:26.880149+0000","last_undegraded":"2023-06-10T18:56:26.880149+0000","last_fullsized":"2023-06-10T18:56:26.880149+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:23:29.171711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":2,"reported_epoch":52,"state":"peering","last_fresh":"2023-06-10T18:56:22.631216+0000","last_change":"2023-06-10T18:56:27.634240+0000","last_active":"2023-06-10T18:56:27.634240+0000","last_peered":"2023-06-10T18:56:22.631216+0000","last_clean":"2023-06-10T18:56:22.631216+0000","last_became_active":"2023-06-10T18:56:18.711779+0000","last_became_peered":"2023-06-10T18:56:18.711779+0000","last_unstale":"2023-06-10T18:56:22.631216+0000","last_undegraded":"2023-06-10T18:56:22.631216+0000","last_fullsized":"2023-06-10T18:56:22.631216+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.875792+0000","last_change":"2023-06-10T18:56:18.335774+0000","last_active":"2023-06-10T18:56:26.875792+0000","last_peered":"2023-06-10T18:56:26.875792+0000","last_clean":"2023-06-10T18:56:26.875792+0000","last_became_active":"2023-06-10T18:56:18.334295+0000","last_became_peered":"2023-06-10T18:56:18.334295+0000","last_unstale":"2023-06-10T18:56:26.875792+0000","last_undegraded":"2023-06-10T18:56:26.875792+0000","last_fullsized":"2023-06-10T18:56:26.875792+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:45:39.069258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.195203+0000","last_change":"2023-06-10T18:56:18.732193+0000","last_active":"2023-06-10T18:56:27.195203+0000","last_peered":"2023-06-10T18:56:27.195203+0000","last_clean":"2023-06-10T18:56:27.195203+0000","last_became_active":"2023-06-10T18:56:18.731876+0000","last_became_peered":"2023-06-10T18:56:18.731876+0000","last_unstale":"2023-06-10T18:56:27.195203+0000","last_undegraded":"2023-06-10T18:56:27.195203+0000","last_fullsized":"2023-06-10T18:56:27.195203+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:41:57.121808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.144429+0000","last_change":"2023-06-10T18:56:18.348170+0000","last_active":"2023-06-10T18:56:27.144429+0000","last_peered":"2023-06-10T18:56:27.144429+0000","last_clean":"2023-06-10T18:56:27.144429+0000","last_became_active":"2023-06-10T18:56:18.347458+0000","last_became_peered":"2023-06-10T18:56:18.347458+0000","last_unstale":"2023-06-10T18:56:27.144429+0000","last_undegraded":"2023-06-10T18:56:27.144429+0000","last_fullsized":"2023-06-10T18:56:27.144429+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:08:51.581596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.880965+0000","last_change":"2023-06-10T18:56:18.727211+0000","last_active":"2023-06-10T18:56:26.880965+0000","last_peered":"2023-06-10T18:56:26.880965+0000","last_clean":"2023-06-10T18:56:26.880965+0000","last_became_active":"2023-06-10T18:56:18.726575+0000","last_became_peered":"2023-06-10T18:56:18.726575+0000","last_unstale":"2023-06-10T18:56:26.880965+0000","last_undegraded":"2023-06-10T18:56:26.880965+0000","last_fullsized":"2023-06-10T18:56:26.880965+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:04:11.756055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"50'8","reported_seq":23,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.195340+0000","last_change":"2023-06-10T18:56:18.332240+0000","last_active":"2023-06-10T18:56:27.195340+0000","last_peered":"2023-06-10T18:56:27.195340+0000","last_clean":"2023-06-10T18:56:27.195340+0000","last_became_active":"2023-06-10T18:56:18.331781+0000","last_became_peered":"2023-06-10T18:56:18.331781+0000","last_unstale":"2023-06-10T18:56:27.195340+0000","last_undegraded":"2023-06-10T18:56:27.195340+0000","last_fullsized":"2023-06-10T18:56:27.195340+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:23:26.069557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.195018+0000","last_change":"2023-06-10T18:56:18.702816+0000","last_active":"2023-06-10T18:56:27.195018+0000","last_peered":"2023-06-10T18:56:27.195018+0000","last_clean":"2023-06-10T18:56:27.195018+0000","last_became_active":"2023-06-10T18:56:18.702527+0000","last_became_peered":"2023-06-10T18:56:18.702527+0000","last_unstale":"2023-06-10T18:56:27.195018+0000","last_undegraded":"2023-06-10T18:56:27.195018+0000","last_fullsized":"2023-06-10T18:56:27.195018+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:01:30.967639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"50'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.881337+0000","last_change":"2023-06-10T18:56:18.324631+0000","last_active":"2023-06-10T18:56:26.881337+0000","last_peered":"2023-06-10T18:56:26.881337+0000","last_clean":"2023-06-10T18:56:26.881337+0000","last_became_active":"2023-06-10T18:56:18.324243+0000","last_became_peered":"2023-06-10T18:56:18.324243+0000","last_unstale":"2023-06-10T18:56:26.881337+0000","last_undegraded":"2023-06-10T18:56:26.881337+0000","last_fullsized":"2023-06-10T18:56:26.881337+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:01:29.954138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.886746+0000","last_change":"2023-06-10T18:56:18.710557+0000","last_active":"2023-06-10T18:56:26.886746+0000","last_peered":"2023-06-10T18:56:26.886746+0000","last_clean":"2023-06-10T18:56:26.886746+0000","last_became_active":"2023-06-10T18:56:18.710238+0000","last_became_peered":"2023-06-10T18:56:18.710238+0000","last_unstale":"2023-06-10T18:56:26.886746+0000","last_undegraded":"2023-06-10T18:56:26.886746+0000","last_fullsized":"2023-06-10T18:56:26.886746+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:57:17.090045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"50'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.869232+0000","last_change":"2023-06-10T18:56:18.324362+0000","last_active":"2023-06-10T18:56:26.869232+0000","last_peered":"2023-06-10T18:56:26.869232+0000","last_clean":"2023-06-10T18:56:26.869232+0000","last_became_active":"2023-06-10T18:56:18.323943+0000","last_became_peered":"2023-06-10T18:56:18.323943+0000","last_unstale":"2023-06-10T18:56:26.869232+0000","last_undegraded":"2023-06-10T18:56:26.869232+0000","last_fullsized":"2023-06-10T18:56:26.869232+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:13:38.851442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.871058+0000","last_change":"2023-06-10T18:56:18.715476+0000","last_active":"2023-06-10T18:56:26.871058+0000","last_peered":"2023-06-10T18:56:26.871058+0000","last_clean":"2023-06-10T18:56:26.871058+0000","last_became_active":"2023-06-10T18:56:18.714697+0000","last_became_peered":"2023-06-10T18:56:18.714697+0000","last_unstale":"2023-06-10T18:56:26.871058+0000","last_undegraded":"2023-06-10T18:56:26.871058+0000","last_fullsized":"2023-06-10T18:56:26.871058+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:36:56.932324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"50'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.876240+0000","last_change":"2023-06-10T18:56:18.341065+0000","last_active":"2023-06-10T18:56:26.876240+0000","last_peered":"2023-06-10T18:56:26.876240+0000","last_clean":"2023-06-10T18:56:26.876240+0000","last_became_active":"2023-06-10T18:56:18.340242+0000","last_became_peered":"2023-06-10T18:56:18.340242+0000","last_unstale":"2023-06-10T18:56:26.876240+0000","last_undegraded":"2023-06-10T18:56:26.876240+0000","last_fullsized":"2023-06-10T18:56:26.876240+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:27:46.347276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.887392+0000","last_change":"2023-06-10T18:56:18.722679+0000","last_active":"2023-06-10T18:56:26.887392+0000","last_peered":"2023-06-10T18:56:26.887392+0000","last_clean":"2023-06-10T18:56:26.887392+0000","last_became_active":"2023-06-10T18:56:18.722389+0000","last_became_peered":"2023-06-10T18:56:18.722389+0000","last_unstale":"2023-06-10T18:56:26.887392+0000","last_undegraded":"2023-06-10T18:56:26.887392+0000","last_fullsized":"2023-06-10T18:56:26.887392+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:01:30.967639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.875808+0000","last_change":"2023-06-10T18:56:18.335157+0000","last_active":"2023-06-10T18:56:26.875808+0000","last_peered":"2023-06-10T18:56:26.875808+0000","last_clean":"2023-06-10T18:56:26.875808+0000","last_became_active":"2023-06-10T18:56:18.334417+0000","last_became_peered":"2023-06-10T18:56:18.334417+0000","last_unstale":"2023-06-10T18:56:26.875808+0000","last_undegraded":"2023-06-10T18:56:26.875808+0000","last_fullsized":"2023-06-10T18:56:26.875808+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:43:46.237306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.872091+0000","last_change":"2023-06-10T18:56:18.720351+0000","last_active":"2023-06-10T18:56:26.872091+0000","last_peered":"2023-06-10T18:56:26.872091+0000","last_clean":"2023-06-10T18:56:26.872091+0000","last_became_active":"2023-06-10T18:56:18.717962+0000","last_became_peered":"2023-06-10T18:56:18.717962+0000","last_unstale":"2023-06-10T18:56:26.872091+0000","last_undegraded":"2023-06-10T18:56:26.872091+0000","last_fullsized":"2023-06-10T18:56:26.872091+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:55:10.132650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"50'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.887432+0000","last_change":"2023-06-10T18:56:18.337149+0000","last_active":"2023-06-10T18:56:26.887432+0000","last_peered":"2023-06-10T18:56:26.887432+0000","last_clean":"2023-06-10T18:56:26.887432+0000","last_became_active":"2023-06-10T18:56:18.335525+0000","last_became_peered":"2023-06-10T18:56:18.335525+0000","last_unstale":"2023-06-10T18:56:26.887432+0000","last_undegraded":"2023-06-10T18:56:26.887432+0000","last_fullsized":"2023-06-10T18:56:26.887432+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:23:26.069557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.876152+0000","last_change":"2023-06-10T18:56:18.734899+0000","last_active":"2023-06-10T18:56:26.876152+0000","last_peered":"2023-06-10T18:56:26.876152+0000","last_clean":"2023-06-10T18:56:26.876152+0000","last_became_active":"2023-06-10T18:56:18.734152+0000","last_became_peered":"2023-06-10T18:56:18.734152+0000","last_unstale":"2023-06-10T18:56:26.876152+0000","last_undegraded":"2023-06-10T18:56:26.876152+0000","last_fullsized":"2023-06-10T18:56:26.876152+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:16:15.404759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.194661+0000","last_change":"2023-06-10T18:56:18.332341+0000","last_active":"2023-06-10T18:56:27.194661+0000","last_peered":"2023-06-10T18:56:27.194661+0000","last_clean":"2023-06-10T18:56:27.194661+0000","last_became_active":"2023-06-10T18:56:18.331836+0000","last_became_peered":"2023-06-10T18:56:18.331836+0000","last_unstale":"2023-06-10T18:56:27.194661+0000","last_undegraded":"2023-06-10T18:56:27.194661+0000","last_fullsized":"2023-06-10T18:56:27.194661+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:27:55.613483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.881243+0000","last_change":"2023-06-10T18:56:18.745846+0000","last_active":"2023-06-10T18:56:26.881243+0000","last_peered":"2023-06-10T18:56:26.881243+0000","last_clean":"2023-06-10T18:56:26.881243+0000","last_became_active":"2023-06-10T18:56:18.745527+0000","last_became_peered":"2023-06-10T18:56:18.745527+0000","last_unstale":"2023-06-10T18:56:26.881243+0000","last_undegraded":"2023-06-10T18:56:26.881243+0000","last_fullsized":"2023-06-10T18:56:26.881243+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:33:38.472734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.879935+0000","last_change":"2023-06-10T18:56:18.337764+0000","last_active":"2023-06-10T18:56:26.879935+0000","last_peered":"2023-06-10T18:56:26.879935+0000","last_clean":"2023-06-10T18:56:26.879935+0000","last_became_active":"2023-06-10T18:56:18.337390+0000","last_became_peered":"2023-06-10T18:56:18.337390+0000","last_unstale":"2023-06-10T18:56:26.879935+0000","last_undegraded":"2023-06-10T18:56:26.879935+0000","last_fullsized":"2023-06-10T18:56:26.879935+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:54:06.053571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.887362+0000","last_change":"2023-06-10T18:56:18.705770+0000","last_active":"2023-06-10T18:56:26.887362+0000","last_peered":"2023-06-10T18:56:26.887362+0000","last_clean":"2023-06-10T18:56:26.887362+0000","last_became_active":"2023-06-10T18:56:18.705487+0000","last_became_peered":"2023-06-10T18:56:18.705487+0000","last_unstale":"2023-06-10T18:56:26.887362+0000","last_undegraded":"2023-06-10T18:56:26.887362+0000","last_fullsized":"2023-06-10T18:56:26.887362+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:18:25.090460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.867631+0000","last_change":"2023-06-10T18:56:18.339683+0000","last_active":"2023-06-10T18:56:26.867631+0000","last_peered":"2023-06-10T18:56:26.867631+0000","last_clean":"2023-06-10T18:56:26.867631+0000","last_became_active":"2023-06-10T18:56:18.339076+0000","last_became_peered":"2023-06-10T18:56:18.339076+0000","last_unstale":"2023-06-10T18:56:26.867631+0000","last_undegraded":"2023-06-10T18:56:26.867631+0000","last_fullsized":"2023-06-10T18:56:26.867631+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:24:21.579841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.874936+0000","last_change":"2023-06-10T18:56:18.724347+0000","last_active":"2023-06-10T18:56:26.874936+0000","last_peered":"2023-06-10T18:56:26.874936+0000","last_clean":"2023-06-10T18:56:26.874936+0000","last_became_active":"2023-06-10T18:56:18.723327+0000","last_became_peered":"2023-06-10T18:56:18.723327+0000","last_unstale":"2023-06-10T18:56:26.874936+0000","last_undegraded":"2023-06-10T18:56:26.874936+0000","last_fullsized":"2023-06-10T18:56:26.874936+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:06:54.175628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"51'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.881525+0000","last_change":"2023-06-10T18:56:18.337157+0000","last_active":"2023-06-10T18:56:26.881525+0000","last_peered":"2023-06-10T18:56:26.881525+0000","last_clean":"2023-06-10T18:56:26.881525+0000","last_became_active":"2023-06-10T18:56:18.336768+0000","last_became_peered":"2023-06-10T18:56:18.336768+0000","last_unstale":"2023-06-10T18:56:26.881525+0000","last_undegraded":"2023-06-10T18:56:26.881525+0000","last_fullsized":"2023-06-10T18:56:26.881525+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:18:24.076958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":224,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.143607+0000","last_change":"2023-06-10T18:52:34.951528+0000","last_active":"2023-06-10T18:56:27.143607+0000","last_peered":"2023-06-10T18:56:27.143607+0000","last_clean":"2023-06-10T18:56:27.143607+0000","last_became_active":"2023-06-10T18:52:34.949099+0000","last_became_peered":"2023-06-10T18:52:34.949099+0000","last_unstale":"2023-06-10T18:56:27.143607+0000","last_undegraded":"2023-06-10T18:56:27.143607+0000","last_fullsized":"2023-06-10T18:56:27.143607+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_clean_scrub_stamp":"2023-06-10T18:52:33.633295+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:48:42.927886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":70,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.872604+0000","last_change":"2023-06-10T18:52:40.506384+0000","last_active":"2023-06-10T18:56:26.872604+0000","last_peered":"2023-06-10T18:56:26.872604+0000","last_clean":"2023-06-10T18:56:26.872604+0000","last_became_active":"2023-06-10T18:52:40.505701+0000","last_became_peered":"2023-06-10T18:52:40.505701+0000","last_unstale":"2023-06-10T18:56:26.872604+0000","last_undegraded":"2023-06-10T18:56:26.872604+0000","last_fullsized":"2023-06-10T18:56:26.872604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:48:00.502223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.887017+0000","last_change":"2023-06-10T18:56:18.714433+0000","last_active":"2023-06-10T18:56:26.887017+0000","last_peered":"2023-06-10T18:56:26.887017+0000","last_clean":"2023-06-10T18:56:26.887017+0000","last_became_active":"2023-06-10T18:56:18.714070+0000","last_became_peered":"2023-06-10T18:56:18.714070+0000","last_unstale":"2023-06-10T18:56:26.887017+0000","last_undegraded":"2023-06-10T18:56:26.887017+0000","last_fullsized":"2023-06-10T18:56:26.887017+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:16:44.545696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.144734+0000","last_change":"2023-06-10T18:56:18.341822+0000","last_active":"2023-06-10T18:56:27.144734+0000","last_peered":"2023-06-10T18:56:27.144734+0000","last_clean":"2023-06-10T18:56:27.144734+0000","last_became_active":"2023-06-10T18:56:18.341138+0000","last_became_peered":"2023-06-10T18:56:18.341138+0000","last_unstale":"2023-06-10T18:56:27.144734+0000","last_undegraded":"2023-06-10T18:56:27.144734+0000","last_fullsized":"2023-06-10T18:56:27.144734+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:19:07.044160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":68,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.144020+0000","last_change":"2023-06-10T18:52:40.512015+0000","last_active":"2023-06-10T18:56:27.144020+0000","last_peered":"2023-06-10T18:56:27.144020+0000","last_clean":"2023-06-10T18:56:27.144020+0000","last_became_active":"2023-06-10T18:52:40.511382+0000","last_became_peered":"2023-06-10T18:52:40.511382+0000","last_unstale":"2023-06-10T18:56:27.144020+0000","last_undegraded":"2023-06-10T18:56:27.144020+0000","last_fullsized":"2023-06-10T18:56:27.144020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:10:22.176800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.195451+0000","last_change":"2023-06-10T18:56:18.720642+0000","last_active":"2023-06-10T18:56:27.195451+0000","last_peered":"2023-06-10T18:56:27.195451+0000","last_clean":"2023-06-10T18:56:27.195451+0000","last_became_active":"2023-06-10T18:56:18.720385+0000","last_became_peered":"2023-06-10T18:56:18.720385+0000","last_unstale":"2023-06-10T18:56:27.195451+0000","last_undegraded":"2023-06-10T18:56:27.195451+0000","last_fullsized":"2023-06-10T18:56:27.195451+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:44:56.381072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.881015+0000","last_change":"2023-06-10T18:56:18.320760+0000","last_active":"2023-06-10T18:56:26.881015+0000","last_peered":"2023-06-10T18:56:26.881015+0000","last_clean":"2023-06-10T18:56:26.881015+0000","last_became_active":"2023-06-10T18:56:18.320373+0000","last_became_peered":"2023-06-10T18:56:18.320373+0000","last_unstale":"2023-06-10T18:56:26.881015+0000","last_undegraded":"2023-06-10T18:56:26.881015+0000","last_fullsized":"2023-06-10T18:56:26.881015+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:27:55.613483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":70,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.867695+0000","last_change":"2023-06-10T18:52:40.671725+0000","last_active":"2023-06-10T18:56:26.867695+0000","last_peered":"2023-06-10T18:56:26.867695+0000","last_clean":"2023-06-10T18:56:26.867695+0000","last_became_active":"2023-06-10T18:52:40.671442+0000","last_became_peered":"2023-06-10T18:52:40.671442+0000","last_unstale":"2023-06-10T18:56:26.867695+0000","last_undegraded":"2023-06-10T18:56:26.867695+0000","last_fullsized":"2023-06-10T18:56:26.867695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:26:09.367931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.872142+0000","last_change":"2023-06-10T18:56:18.704278+0000","last_active":"2023-06-10T18:56:26.872142+0000","last_peered":"2023-06-10T18:56:26.872142+0000","last_clean":"2023-06-10T18:56:26.872142+0000","last_became_active":"2023-06-10T18:56:18.703336+0000","last_became_peered":"2023-06-10T18:56:18.703336+0000","last_unstale":"2023-06-10T18:56:26.872142+0000","last_undegraded":"2023-06-10T18:56:26.872142+0000","last_fullsized":"2023-06-10T18:56:26.872142+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:43:45.838944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"50'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.876735+0000","last_change":"2023-06-10T18:56:18.335741+0000","last_active":"2023-06-10T18:56:26.876735+0000","last_peered":"2023-06-10T18:56:26.876735+0000","last_clean":"2023-06-10T18:56:26.876735+0000","last_became_active":"2023-06-10T18:56:18.334904+0000","last_became_peered":"2023-06-10T18:56:18.334904+0000","last_unstale":"2023-06-10T18:56:26.876735+0000","last_undegraded":"2023-06-10T18:56:26.876735+0000","last_fullsized":"2023-06-10T18:56:26.876735+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:08:18.807313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":70,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.871228+0000","last_change":"2023-06-10T18:52:40.510258+0000","last_active":"2023-06-10T18:56:26.871228+0000","last_peered":"2023-06-10T18:56:26.871228+0000","last_clean":"2023-06-10T18:56:26.871228+0000","last_became_active":"2023-06-10T18:52:40.509560+0000","last_became_peered":"2023-06-10T18:52:40.509560+0000","last_unstale":"2023-06-10T18:56:26.871228+0000","last_undegraded":"2023-06-10T18:56:26.871228+0000","last_fullsized":"2023-06-10T18:56:26.871228+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:43:32.943829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":2,"reported_epoch":52,"state":"peering","last_fresh":"2023-06-10T18:56:22.631242+0000","last_change":"2023-06-10T18:56:27.634300+0000","last_active":"2023-06-10T18:56:27.634300+0000","last_peered":"2023-06-10T18:56:22.631242+0000","last_clean":"2023-06-10T18:56:22.631242+0000","last_became_active":"2023-06-10T18:56:18.715542+0000","last_became_peered":"2023-06-10T18:56:18.715542+0000","last_unstale":"2023-06-10T18:56:22.631242+0000","last_undegraded":"2023-06-10T18:56:22.631242+0000","last_fullsized":"2023-06-10T18:56:22.631242+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.870792+0000","last_change":"2023-06-10T18:56:18.325010+0000","last_active":"2023-06-10T18:56:26.870792+0000","last_peered":"2023-06-10T18:56:26.870792+0000","last_clean":"2023-06-10T18:56:26.870792+0000","last_became_active":"2023-06-10T18:56:18.324414+0000","last_became_peered":"2023-06-10T18:56:18.324414+0000","last_unstale":"2023-06-10T18:56:26.870792+0000","last_undegraded":"2023-06-10T18:56:26.870792+0000","last_fullsized":"2023-06-10T18:56:26.870792+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:53:55.823468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":66,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.887066+0000","last_change":"2023-06-10T18:52:40.672266+0000","last_active":"2023-06-10T18:56:26.887066+0000","last_peered":"2023-06-10T18:56:26.887066+0000","last_clean":"2023-06-10T18:56:26.887066+0000","last_became_active":"2023-06-10T18:52:40.671966+0000","last_became_peered":"2023-06-10T18:52:40.671966+0000","last_unstale":"2023-06-10T18:56:26.887066+0000","last_undegraded":"2023-06-10T18:56:26.887066+0000","last_fullsized":"2023-06-10T18:56:26.887066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:29:59.663767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.195764+0000","last_change":"2023-06-10T18:56:18.703583+0000","last_active":"2023-06-10T18:56:27.195764+0000","last_peered":"2023-06-10T18:56:27.195764+0000","last_clean":"2023-06-10T18:56:27.195764+0000","last_became_active":"2023-06-10T18:56:18.703292+0000","last_became_peered":"2023-06-10T18:56:18.703292+0000","last_unstale":"2023-06-10T18:56:27.195764+0000","last_undegraded":"2023-06-10T18:56:27.195764+0000","last_fullsized":"2023-06-10T18:56:27.195764+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:37:45.597946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.872441+0000","last_change":"2023-06-10T18:56:18.331871+0000","last_active":"2023-06-10T18:56:26.872441+0000","last_peered":"2023-06-10T18:56:26.872441+0000","last_clean":"2023-06-10T18:56:26.872441+0000","last_became_active":"2023-06-10T18:56:18.331127+0000","last_became_peered":"2023-06-10T18:56:18.331127+0000","last_unstale":"2023-06-10T18:56:26.872441+0000","last_undegraded":"2023-06-10T18:56:26.872441+0000","last_fullsized":"2023-06-10T18:56:26.872441+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:56:07.925384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":68,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.144910+0000","last_change":"2023-06-10T18:52:40.671084+0000","last_active":"2023-06-10T18:56:27.144910+0000","last_peered":"2023-06-10T18:56:27.144910+0000","last_clean":"2023-06-10T18:56:27.144910+0000","last_became_active":"2023-06-10T18:52:40.670697+0000","last_became_peered":"2023-06-10T18:52:40.670697+0000","last_unstale":"2023-06-10T18:56:27.144910+0000","last_undegraded":"2023-06-10T18:56:27.144910+0000","last_fullsized":"2023-06-10T18:56:27.144910+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:26:45.209485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.880674+0000","last_change":"2023-06-10T18:56:18.724544+0000","last_active":"2023-06-10T18:56:26.880674+0000","last_peered":"2023-06-10T18:56:26.880674+0000","last_clean":"2023-06-10T18:56:26.880674+0000","last_became_active":"2023-06-10T18:56:18.724244+0000","last_became_peered":"2023-06-10T18:56:18.724244+0000","last_unstale":"2023-06-10T18:56:26.880674+0000","last_undegraded":"2023-06-10T18:56:26.880674+0000","last_fullsized":"2023-06-10T18:56:26.880674+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:17:50.531074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.195134+0000","last_change":"2023-06-10T18:56:18.332507+0000","last_active":"2023-06-10T18:56:27.195134+0000","last_peered":"2023-06-10T18:56:27.195134+0000","last_clean":"2023-06-10T18:56:27.195134+0000","last_became_active":"2023-06-10T18:56:18.331887+0000","last_became_peered":"2023-06-10T18:56:18.331887+0000","last_unstale":"2023-06-10T18:56:27.195134+0000","last_undegraded":"2023-06-10T18:56:27.195134+0000","last_fullsized":"2023-06-10T18:56:27.195134+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:13:38.791330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":66,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.887650+0000","last_change":"2023-06-10T18:52:40.514114+0000","last_active":"2023-06-10T18:56:26.887650+0000","last_peered":"2023-06-10T18:56:26.887650+0000","last_clean":"2023-06-10T18:56:26.887650+0000","last_became_active":"2023-06-10T18:52:40.513638+0000","last_became_peered":"2023-06-10T18:52:40.513638+0000","last_unstale":"2023-06-10T18:56:26.887650+0000","last_undegraded":"2023-06-10T18:56:26.887650+0000","last_fullsized":"2023-06-10T18:56:26.887650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:41:17.572105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.871355+0000","last_change":"2023-06-10T18:56:18.733094+0000","last_active":"2023-06-10T18:56:26.871355+0000","last_peered":"2023-06-10T18:56:26.871355+0000","last_clean":"2023-06-10T18:56:26.871355+0000","last_became_active":"2023-06-10T18:56:18.732442+0000","last_became_peered":"2023-06-10T18:56:18.732442+0000","last_unstale":"2023-06-10T18:56:26.871355+0000","last_undegraded":"2023-06-10T18:56:26.871355+0000","last_fullsized":"2023-06-10T18:56:26.871355+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T18:57:31.579489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.195498+0000","last_change":"2023-06-10T18:56:18.337697+0000","last_active":"2023-06-10T18:56:27.195498+0000","last_peered":"2023-06-10T18:56:27.195498+0000","last_clean":"2023-06-10T18:56:27.195498+0000","last_became_active":"2023-06-10T18:56:18.337174+0000","last_became_peered":"2023-06-10T18:56:18.337174+0000","last_unstale":"2023-06-10T18:56:27.195498+0000","last_undegraded":"2023-06-10T18:56:27.195498+0000","last_fullsized":"2023-06-10T18:56:27.195498+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:57:03.240260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":70,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.876863+0000","last_change":"2023-06-10T18:52:40.515396+0000","last_active":"2023-06-10T18:56:26.876863+0000","last_peered":"2023-06-10T18:56:26.876863+0000","last_clean":"2023-06-10T18:56:26.876863+0000","last_became_active":"2023-06-10T18:52:40.514663+0000","last_became_peered":"2023-06-10T18:52:40.514663+0000","last_unstale":"2023-06-10T18:56:26.876863+0000","last_undegraded":"2023-06-10T18:56:26.876863+0000","last_fullsized":"2023-06-10T18:56:26.876863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:57:38.444899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574898,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28128,"kb_used_data":1176,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343712,"statfs":{"total":96636764160,"available":96607961088,"internally_reserved":0,"allocated":1204224,"data_stored":851412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":0.90400000000000003,"15min":0.88200000000000001},"min":{"1min":0.73599999999999999,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.3759999999999999,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.97999999999999998},{"interface":"front","average":{"1min":1.006,"5min":0.94299999999999995,"15min":0.93000000000000005},"min":{"1min":0.81899999999999995,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.234,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":1.0349999999999999}]},{"osd":1,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92400000000000004,"15min":0.91500000000000004},"min":{"1min":0.58599999999999997,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.3089999999999999,"5min":1.377,"15min":1.377},"last":1.1419999999999999},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.92500000000000004,"15min":0.91100000000000003},"min":{"1min":0.78400000000000003,"5min":0.504,"15min":0.504},"max":{"1min":1.111,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.1080000000000001}]},{"osd":2,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.83999999999999997,"15min":0.82799999999999996},"min":{"1min":0.64100000000000001,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.214,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.89900000000000002,"15min":0.90700000000000003},"min":{"1min":0.67500000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.325,"5min":1.367,"15min":1.367},"last":1.069}]},{"osd":3,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.92100000000000004,"15min":0.89900000000000002},"min":{"1min":0.68100000000000005,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1499999999999999,"5min":1.502,"15min":1.502},"last":1.167},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.93799999999999994,"15min":0.92800000000000005},"min":{"1min":0.70399999999999996,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.2130000000000001,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.77200000000000002}]},{"osd":4,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.876,"15min":0.872},"min":{"1min":0.60199999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.141,"5min":1.639,"15min":1.639},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.96899999999999997,"15min":0.98099999999999998},"min":{"1min":0.748,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.238,"5min":1.411,"15min":1.411},"last":0.65200000000000002}]},{"osd":5,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.042,"15min":1.038},"min":{"1min":0.79800000000000004,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.2669999999999999,"5min":1.806,"15min":1.806},"last":0.93200000000000005},{"interface":"front","average":{"1min":1.081,"5min":1.05,"15min":1.052},"min":{"1min":0.93200000000000005,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.256,"5min":1.522,"15min":1.522},"last":1.0009999999999999}]},{"osd":6,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.0129999999999999,"15min":1.008},"min":{"1min":0.78500000000000003,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.3,"5min":1.718,"15min":1.718},"last":0.95599999999999996},{"interface":"front","average":{"1min":1.147,"5min":1.095,"15min":1.0900000000000001},"min":{"1min":0.96599999999999997,"5min":0.441,"15min":0.441},"max":{"1min":1.409,"5min":1.464,"15min":1.464},"last":1.224}]}]},{"osd":6,"up_from":13,"seq":55834574899,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27548,"kb_used_data":596,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344292,"statfs":{"total":96636764160,"available":96608555008,"internally_reserved":0,"allocated":610304,"data_stored":261572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.81999999999999995,"15min":0.80100000000000005},"min":{"1min":0.65800000000000003,"5min":0.502,"15min":0.502},"max":{"1min":1.0589999999999999,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.85199999999999998,"15min":0.83999999999999997},"min":{"1min":0.71799999999999997,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.0680000000000001,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":1.0920000000000001}]},{"osd":1,"last update":"Sat Jun 10 18:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.873,"15min":0.85199999999999998},"min":{"1min":0.68999999999999995,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.0549999999999999},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.879,"15min":0.85899999999999999},"min":{"1min":0.68999999999999995,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":0.90000000000000002}]},{"osd":2,"last update":"Sat Jun 10 18:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.871,"15min":0.85899999999999999},"min":{"1min":0.66000000000000003,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.1950000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.88500000000000001,"15min":0.88900000000000001},"min":{"1min":0.68000000000000005,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.109,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":1.177}]},{"osd":3,"last update":"Sat Jun 10 18:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.874,"15min":0.84799999999999998},"min":{"1min":0.64900000000000002,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.169,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.95999999999999996},{"interface":"front","average":{"1min":1.0209999999999999,"5min":0.997,"15min":0.995},"min":{"1min":0.72799999999999998,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":1.2889999999999999}]},{"osd":4,"last update":"Sat Jun 10 18:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.93799999999999994,"15min":0.95399999999999996},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.1259999999999999,"5min":1.198,"15min":1.198},"last":1.002},{"interface":"front","average":{"1min":0.95699999999999996,"5min":1.0049999999999999,"15min":1.0189999999999999},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.1879999999999999,"5min":1.222,"15min":1.222},"last":1.212}]},{"osd":5,"last update":"Sat Jun 10 18:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.94999999999999996,"15min":0.96199999999999997},"min":{"1min":0.68700000000000006,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.0720000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.86099999999999999},{"interface":"front","average":{"1min":1.02,"5min":1.0249999999999999,"15min":1.026},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":1.1399999999999999}]},{"osd":7,"last update":"Sat Jun 10 18:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":1.0389999999999999,"15min":1.0489999999999999},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.1739999999999999,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.022,"5min":1.0569999999999999,"15min":1.0649999999999999},"min":{"1min":0.82199999999999995,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.2010000000000001,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":1.2569999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574899,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27552,"kb_used_data":600,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":614400,"data_stored":267298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.84199999999999997,"15min":0.82999999999999996},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.139,"5min":1.175,"15min":1.175},"last":1.083},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.91800000000000004,"15min":0.94199999999999995},"min":{"1min":0.63800000000000001,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.246,"5min":1.637,"15min":1.637},"last":0.67700000000000005}]},{"osd":1,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.91000000000000003,"15min":0.91800000000000004},"min":{"1min":0.67800000000000005,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.1559999999999999,"5min":1.335,"15min":1.335},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.91700000000000004,"15min":0.92100000000000004},"min":{"1min":0.72699999999999998,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.208,"5min":1.78,"15min":1.78},"last":0.80700000000000005}]},{"osd":2,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.65000000000000002,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.1000000000000001,"5min":1.446,"15min":1.446},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.91600000000000004,"15min":0.91200000000000003},"min":{"1min":0.71399999999999997,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.1379999999999999,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.92300000000000004}]},{"osd":3,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93899999999999995,"15min":0.94499999999999995},"min":{"1min":0.68600000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.206,"5min":1.484,"15min":1.484},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.97199999999999998,"5min":1.0249999999999999,"15min":1.0429999999999999},"min":{"1min":0.77100000000000002,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.2969999999999999,"5min":1.337,"15min":1.337},"last":0.84599999999999997}]},{"osd":4,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.96999999999999997,"15min":0.98899999999999999},"min":{"1min":0.70299999999999996,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.2669999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.94599999999999995,"5min":1.034,"15min":1.0640000000000001},"min":{"1min":0.66500000000000004,"5min":0.629,"15min":0.629},"max":{"1min":1.26,"5min":1.575,"15min":1.575},"last":1.2010000000000001}]},{"osd":6,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":1.038,"15min":1.0780000000000001},"min":{"1min":0.66000000000000003,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.2010000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.0609999999999999,"15min":1.079},"min":{"1min":0.69799999999999995,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.2270000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.73699999999999999}]},{"osd":7,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.139,"15min":1.1739999999999999},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.226,"5min":1.873,"15min":1.873},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.155,"15min":1.181},"min":{"1min":0.80000000000000004,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.3680000000000001,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.121}]}]},{"osd":4,"up_from":13,"seq":55834574898,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27556,"kb_used_data":604,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344284,"statfs":{"total":96636764160,"available":96608546816,"internally_reserved":0,"allocated":618496,"data_stored":267880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.76700000000000002,"15min":0.745},"min":{"1min":0.53400000000000003,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.1599999999999999,"5min":1.2,"15min":1.2},"last":0.629},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.88200000000000001,"15min":0.88},"min":{"1min":0.63800000000000001,"5min":0.504,"15min":0.504},"max":{"1min":1.4970000000000001,"5min":1.73,"15min":1.73},"last":1.034}]},{"osd":1,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.95199999999999996,"15min":0.95499999999999996},"min":{"1min":0.68200000000000005,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.84599999999999997,"15min":0.83699999999999997},"min":{"1min":0.66600000000000004,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.024,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.097}]},{"osd":2,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.879,"15min":0.875},"min":{"1min":0.70799999999999996,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":0.85499999999999998},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1,"15min":1.004},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":1.121}]},{"osd":3,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.89900000000000002,"15min":0.88},"min":{"1min":0.80900000000000005,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.1679999999999999,"5min":1.22,"15min":1.22},"last":0.73999999999999999},{"interface":"front","average":{"1min":1.006,"5min":0.95799999999999996,"15min":0.95099999999999996},"min":{"1min":0.80100000000000005,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.4490000000000001,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.069}]},{"osd":5,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.96799999999999997,"15min":0.99399999999999999},"min":{"1min":0.67800000000000005,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.069,"5min":1.663,"15min":1.663},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.95399999999999996,"15min":0.98199999999999998},"min":{"1min":0.58099999999999996,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.111,"5min":1.353,"15min":1.353},"last":1.179}]},{"osd":6,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":1.002,"15min":1.028},"min":{"1min":0.63100000000000001,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.5720000000000001,"5min":2.2639999999999998,"15min":2.2639999999999998},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0720000000000001,"15min":1.0760000000000001},"min":{"1min":0.81200000000000006,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":1.1970000000000001}]},{"osd":7,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.98399999999999999,"15min":0.99399999999999999},"min":{"1min":0.68899999999999995,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.1950000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.012,"5min":1.0529999999999999,"15min":1.071},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.2390000000000001,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":1.1539999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574897,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31660,"kb_used_data":612,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340180,"statfs":{"total":96636764160,"available":96604344320,"internally_reserved":0,"allocated":626688,"data_stored":267865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.57799999999999996,"15min":0.57199999999999995},"min":{"1min":0.51400000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.63500000000000001,"15min":0.63100000000000001},"min":{"1min":0.56000000000000005,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.57599999999999996}]},{"osd":1,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.64400000000000002,"15min":0.622},"min":{"1min":0.51000000000000001,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":1.0860000000000001},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.72099999999999997,"15min":0.71599999999999997},"min":{"1min":0.56100000000000005,"5min":0.318,"15min":0.318},"max":{"1min":0.98899999999999999,"5min":1.411,"15min":1.411},"last":1.0409999999999999}]},{"osd":2,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.76100000000000001,"15min":0.75},"min":{"1min":0.63500000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.167,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":1.3759999999999999},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.75900000000000001,"15min":0.74199999999999999},"min":{"1min":0.65200000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.1970000000000001,"5min":1.264,"15min":1.264},"last":0.624}]},{"osd":4,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96099999999999997,"15min":0.96899999999999997},"min":{"1min":0.79800000000000004,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.3089999999999999,"5min":1.488,"15min":1.488},"last":1.3360000000000001},{"interface":"front","average":{"1min":1.052,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.82099999999999995,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.345,"5min":1.458,"15min":1.458},"last":0.93100000000000005}]},{"osd":5,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.0369999999999999,"15min":1.0589999999999999},"min":{"1min":0.80400000000000005,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.268,"5min":2.024,"15min":2.024},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.101,"5min":1.026,"15min":1.014},"min":{"1min":0.83899999999999997,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.29,"5min":1.724,"15min":1.724},"last":1.2170000000000001}]},{"osd":6,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.0489999999999999,"15min":1.0469999999999999},"min":{"1min":0.92400000000000004,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.3300000000000001,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.071,"5min":1.0589999999999999,"15min":1.0720000000000001},"min":{"1min":0.90700000000000003,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.302,"5min":1.78,"15min":1.78},"last":1.1399999999999999}]},{"osd":7,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.101,"15min":1.1279999999999999},"min":{"1min":0.82799999999999996,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.3959999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.212,"5min":1.089,"15min":1.0740000000000001},"min":{"1min":1.0049999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.468,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":1.5429999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574898,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31660,"kb_used_data":612,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340180,"statfs":{"total":96636764160,"available":96604344320,"internally_reserved":0,"allocated":626688,"data_stored":268862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.60099999999999998,"15min":0.58799999999999997},"min":{"1min":0.498,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.97799999999999998,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.50800000000000001,"5min":0.378,"15min":0.378},"max":{"1min":1.024,"5min":1.224,"15min":1.224},"last":0.68600000000000005}]},{"osd":1,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.65000000000000002,"15min":0.64600000000000002},"min":{"1min":0.53400000000000003,"5min":0.307,"15min":0.307},"max":{"1min":0.89500000000000002,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.72299999999999998,"15min":0.68999999999999995},"min":{"1min":0.64700000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.89100000000000001}]},{"osd":3,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.73599999999999999,"15min":0.70599999999999996},"min":{"1min":0.64900000000000002,"5min":0.377,"15min":0.377},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.749,"15min":0.746},"min":{"1min":0.64700000000000002,"5min":0.252,"15min":0.252},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.86199999999999999}]},{"osd":4,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.91900000000000004,"15min":0.91500000000000004},"min":{"1min":0.81000000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.097,"5min":1.0349999999999999,"15min":1.038},"min":{"1min":0.88600000000000001,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.476,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":1.0129999999999999}]},{"osd":5,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.016,"15min":1.016},"min":{"1min":0.82699999999999996,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.379,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":1.2330000000000001},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.002,"15min":0.97799999999999998},"min":{"1min":0.77100000000000002,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.377,"5min":1.667,"15min":1.667},"last":0.78200000000000003}]},{"osd":6,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.0429999999999999,"15min":1.0229999999999999},"min":{"1min":0.84299999999999997,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.3049999999999999,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.92900000000000005},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.034,"15min":1.032},"min":{"1min":0.89400000000000002,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.4299999999999999,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":1.1120000000000001}]},{"osd":7,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.099,"15min":1.099},"min":{"1min":0.82399999999999995,"5min":0.62,"15min":0.62},"max":{"1min":1.4339999999999999,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.153,"5min":1.0980000000000001,"15min":1.0760000000000001},"min":{"1min":0.95499999999999996,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.4239999999999999,"5min":1.752,"15min":1.752},"last":0.98899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574900,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31640,"kb_used_data":592,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340200,"statfs":{"total":96636764160,"available":96604364800,"internally_reserved":0,"allocated":606208,"data_stored":260061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.67100000000000004,"15min":0.66100000000000003},"min":{"1min":0.47999999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.71999999999999997,"15min":0.68600000000000005},"min":{"1min":0.63400000000000001,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.0369999999999999,"5min":1.694,"15min":1.694},"last":0.56799999999999995}]},{"osd":2,"last update":"Sat Jun 10 18:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.64400000000000002,"15min":0.623},"min":{"1min":0.53500000000000003,"5min":0.249,"15min":0.249},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.877,"5min":0.70199999999999996,"15min":0.65800000000000003},"min":{"1min":0.65600000000000003,"5min":0.315,"15min":0.315},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":0.65500000000000003}]},{"osd":3,"last update":"Sat Jun 10 18:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.77800000000000002,"15min":0.745},"min":{"1min":0.65900000000000003,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.76100000000000001,"15min":0.749},"min":{"1min":0.58499999999999996,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.1100000000000001,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":0.622}]},{"osd":4,"last update":"Sat Jun 10 18:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.87,"15min":0.83599999999999997},"min":{"1min":0.73399999999999999,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":1.087,"5min":1.1160000000000001,"15min":1.079},"min":{"1min":0.78500000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.5449999999999999,"5min":5.8209999999999997,"15min":5.8209999999999997},"last":0.91000000000000003}]},{"osd":5,"last update":"Sat Jun 10 18:55:44 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.032,"15min":1.028},"min":{"1min":0.75800000000000001,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.4550000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":0.879},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0129999999999999,"15min":0.97099999999999997},"min":{"1min":0.754,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.3819999999999999,"5min":3.089,"15min":3.089},"last":0.72299999999999998}]},{"osd":6,"last update":"Sat Jun 10 18:55:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.105,"15min":1.0309999999999999},"min":{"1min":0.75900000000000001,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.5249999999999999,"5min":7.2599999999999998,"15min":7.2599999999999998},"last":0.77500000000000002},{"interface":"front","average":{"1min":1.081,"5min":1.107,"15min":1.0309999999999999},"min":{"1min":0.80800000000000005,"5min":0.622,"15min":0.622},"max":{"1min":1.591,"5min":9.0069999999999997,"15min":9.0069999999999997},"last":0.85899999999999999}]},{"osd":7,"last update":"Sat Jun 10 18:55:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.0980000000000001,"15min":1.083},"min":{"1min":0.89300000000000002,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.6879999999999999,"5min":2.105,"15min":2.105},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.085,"15min":1.0669999999999999},"min":{"1min":0.90200000000000002,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.573,"5min":2.2570000000000001,"15min":2.2570000000000001},"last":0.73999999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574899,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32232,"kb_used_data":1184,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339608,"statfs":{"total":96636764160,"available":96603758592,"internally_reserved":0,"allocated":1212416,"data_stored":856703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.61299999999999999,"15min":0.59899999999999998},"min":{"1min":0.51000000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.77200000000000002,"15min":0.746},"min":{"1min":0.70899999999999996,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.0469999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.83899999999999997}]},{"osd":2,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.71099999999999997,"15min":0.69799999999999995},"min":{"1min":0.51900000000000002,"5min":0.313,"15min":0.313},"max":{"1min":1.0269999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.64600000000000002,"15min":0.63},"min":{"1min":0.55700000000000005,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.96799999999999997,"5min":1.371,"15min":1.371},"last":0.622}]},{"osd":3,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.68200000000000005,"15min":0.67000000000000004},"min":{"1min":0.55800000000000005,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.1930000000000001,"5min":1.226,"15min":1.226},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.82899999999999996,"15min":0.81000000000000005},"min":{"1min":0.65800000000000003,"5min":0.375,"15min":0.375},"max":{"1min":1.262,"5min":1.829,"15min":1.829},"last":0.76200000000000001}]},{"osd":4,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.90000000000000002,"15min":0.88900000000000001},"min":{"1min":0.75600000000000001,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.1579999999999999,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.0369999999999999,"15min":1.034},"min":{"1min":0.86099999999999999,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.228,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":0.97199999999999998}]},{"osd":5,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.96099999999999997,"15min":0.95799999999999996},"min":{"1min":0.67300000000000004,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.351,"5min":1.694,"15min":1.694},"last":1.1399999999999999},{"interface":"front","average":{"1min":0.99099999999999999,"5min":1,"15min":0.998},"min":{"1min":0.72999999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.1870000000000001,"5min":1.75,"15min":1.75},"last":1.2789999999999999}]},{"osd":6,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.0700000000000001,"15min":1.056},"min":{"1min":0.93899999999999995,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.331,"5min":2.04,"15min":2.04},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.0409999999999999,"5min":0.996,"15min":0.997},"min":{"1min":0.76100000000000001,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.444,"5min":1.883,"15min":1.883},"last":1.3280000000000001}]},{"osd":7,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.0369999999999999,"15min":1.0329999999999999},"min":{"1min":0.77200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.397,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.077,"5min":1.056,"15min":1.05},"min":{"1min":0.93200000000000005,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.298,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.2170000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-10T18:56:28.103 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1d is not active+clean 2023-06-10T18:56:28.104 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1d', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 52, 'state': 'peering', 'last_fresh': '2023-06-10T18:56:22.631216+0000', 'last_change': '2023-06-10T18:56:27.634240+0000', 'last_active': '2023-06-10T18:56:27.634240+0000', 'last_peered': '2023-06-10T18:56:22.631216+0000', 'last_clean': '2023-06-10T18:56:22.631216+0000', 'last_became_active': '2023-06-10T18:56:18.711779+0000', 'last_became_peered': '2023-06-10T18:56:18.711779+0000', 'last_unstale': '2023-06-10T18:56:22.631216+0000', 'last_undegraded': '2023-06-10T18:56:22.631216+0000', 'last_fullsized': '2023-06-10T18:56:22.631216+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 50, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-06-10T18:56:28.104 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.e is not active+clean 2023-06-10T18:56:28.104 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.e', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 52, 'state': 'peering', 'last_fresh': '2023-06-10T18:56:22.631242+0000', 'last_change': '2023-06-10T18:56:27.634300+0000', 'last_active': '2023-06-10T18:56:27.634300+0000', 'last_peered': '2023-06-10T18:56:22.631242+0000', 'last_clean': '2023-06-10T18:56:22.631242+0000', 'last_became_active': '2023-06-10T18:56:18.715542+0000', 'last_became_peered': '2023-06-10T18:56:18.715542+0000', 'last_unstale': '2023-06-10T18:56:22.631242+0000', 'last_undegraded': '2023-06-10T18:56:22.631242+0000', 'last_fullsized': '2023-06-10T18:56:22.631242+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 50, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-06-10T18:56:28.105 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-06-10T18:56:28.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.251+0000 7f7fb21df640 1 Processor -- start 2023-06-10T18:56:28.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.251+0000 7f7fb21df640 1 -- start start 2023-06-10T18:56:28.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.251+0000 7f7fb21df640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7fac06c690 0x7f7fac15c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:28.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.251+0000 7f7fb21df640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fac070080 con 0x7f7fac070f40 2023-06-10T18:56:28.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.251+0000 7f7fb21df640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fac0705c0 con 0x7f7fac15c0b0 2023-06-10T18:56:28.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.251+0000 7f7fb21df640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fac0cc460 con 0x7f7fac06c690 2023-06-10T18:56:28.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.251+0000 7f7faaffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f7fac070f40 0x7f7fac06bf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:54058/0 (socket says 172.21.15.53:54058) 2023-06-10T18:56:28.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.251+0000 7f7faaffd640 1 -- 172.21.15.53:0/2160398760 learned_addr learned my addr 172.21.15.53:0/2160398760 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:56:28.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.251+0000 7f7fabfff640 1 --2- 172.21.15.53:0/2160398760 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7fac06c690 0x7f7fac15c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:28.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.251+0000 7f7faa7fc640 1 -- 172.21.15.53:0/2160398760 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2684657354 0 0) 0x7f7fac070080 con 0x7f7fac070f40 2023-06-10T18:56:28.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.251+0000 7f7faa7fc640 1 -- 172.21.15.53:0/2160398760 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f94003430 con 0x7f7fac070f40 2023-06-10T18:56:28.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.251+0000 7f7faa7fc640 1 -- 172.21.15.53:0/2160398760 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 693506841 0 0) 0x7f7fac0705c0 con 0x7f7fac15c0b0 2023-06-10T18:56:28.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.251+0000 7f7faa7fc640 1 -- 172.21.15.53:0/2160398760 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fac070080 con 0x7f7fac15c0b0 2023-06-10T18:56:28.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.251+0000 7f7faa7fc640 1 -- 172.21.15.53:0/2160398760 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2556656063 0 0) 0x7f7f94003430 con 0x7f7fac070f40 2023-06-10T18:56:28.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.251+0000 7f7faa7fc640 1 -- 172.21.15.53:0/2160398760 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7fac06c690 msgr2=0x7f7fac15c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:28.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.251+0000 7f7faa7fc640 1 --2- 172.21.15.53:0/2160398760 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7fac06c690 0x7f7fac15c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:28.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.251+0000 7f7faa7fc640 1 -- 172.21.15.53:0/2160398760 >> v1:172.21.15.117:6789/0 conn(0x7f7fac15c0b0 legacy=0x7f7fac0cbd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:28.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.251+0000 7f7faa7fc640 1 -- 172.21.15.53:0/2160398760 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fac0c8e30 con 0x7f7fac070f40 2023-06-10T18:56:28.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.251+0000 7f7faa7fc640 1 -- 172.21.15.53:0/2160398760 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f7fa0001680 con 0x7f7fac070f40 2023-06-10T18:56:28.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.251+0000 7f7faa7fc640 1 -- 172.21.15.53:0/2160398760 >> v1:172.21.15.53:6789/0 conn(0x7f7fac070f40 legacy=0x7f7fac06bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:28.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.251+0000 7f7faa7fc640 1 --2- 172.21.15.53:0/2160398760 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7fac06c690 0x7f7f94004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:28.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.251+0000 7f7faa7fc640 1 --2- 172.21.15.53:0/2160398760 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f94005240 0x7f7f940036f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:28.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.251+0000 7f7faa7fc640 1 --2- 172.21.15.53:0/2160398760 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f94003d60 0x7f7f9400fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:28.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.251+0000 7f7faa7fc640 1 -- 172.21.15.53:0/2160398760 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fac0cc460 con 0x7f7f94005240 2023-06-10T18:56:28.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.251+0000 7f7faa7fc640 1 -- 172.21.15.53:0/2160398760 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f940044d0 con 0x7f7f94003d60 2023-06-10T18:56:28.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.251+0000 7f7faa7fc640 1 -- 172.21.15.53:0/2160398760 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f940100f0 con 0x7f7fac06c690 2023-06-10T18:56:28.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.251+0000 7f7faaffd640 1 --2- 172.21.15.53:0/2160398760 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f94005240 0x7f7f940036f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:28.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.251+0000 7f7fab7fe640 1 --2- 172.21.15.53:0/2160398760 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7fac06c690 0x7f7f94004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:28.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.251+0000 7f7fabfff640 1 --2- 172.21.15.53:0/2160398760 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f94003d60 0x7f7f9400fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:28.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.251+0000 7f7faaffd640 1 -- 172.21.15.53:0/2160398760 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7fac06c690 msgr2=0x7f7f94004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:28.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.251+0000 7f7faaffd640 1 --2- 172.21.15.53:0/2160398760 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7fac06c690 0x7f7f94004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:28.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.251+0000 7f7faaffd640 1 -- 172.21.15.53:0/2160398760 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f94003d60 msgr2=0x7f7f9400fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:28.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.251+0000 7f7faaffd640 1 --2- 172.21.15.53:0/2160398760 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f94003d60 0x7f7f9400fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:28.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.251+0000 7f7faaffd640 1 -- 172.21.15.53:0/2160398760 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f94003430 con 0x7f7f94005240 2023-06-10T18:56:28.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.255+0000 7f7fabfff640 1 --2- 172.21.15.53:0/2160398760 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f94003d60 0x7f7f9400fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:56:28.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.255+0000 7f7faaffd640 1 --2- 172.21.15.53:0/2160398760 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f94005240 0x7f7f940036f0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f7fa0007fa0 tx=0x7f7fa001cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=300ac4106571d2d9 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:28.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.255+0000 7f7faa7fc640 1 -- 172.21.15.53:0/2160398760 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa0005ae0 con 0x7f7f94005240 2023-06-10T18:56:28.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.255+0000 7f7faa7fc640 1 -- 172.21.15.53:0/2160398760 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa0005c40 con 0x7f7f94005240 2023-06-10T18:56:28.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.255+0000 7f7faa7fc640 1 -- 172.21.15.53:0/2160398760 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa00a5a00 con 0x7f7f94005240 2023-06-10T18:56:28.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.255+0000 7f7fb21df640 1 -- 172.21.15.53:0/2160398760 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f94005240 msgr2=0x7f7f940036f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:28.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.255+0000 7f7fb21df640 1 --2- 172.21.15.53:0/2160398760 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f94005240 0x7f7f940036f0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f7fa0007fa0 tx=0x7f7fa001cae0 comp rx=0 tx=0).stop 2023-06-10T18:56:28.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.255+0000 7f7fabfff640 1 -- 172.21.15.53:0/2160398760 reap_dead start 2023-06-10T18:56:28.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.255+0000 7f7fb21df640 1 -- 172.21.15.53:0/2160398760 shutdown_connections 2023-06-10T18:56:28.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.255+0000 7f7fb21df640 1 -- 172.21.15.53:0/2160398760 >> 172.21.15.53:0/2160398760 conn(0x7f7fac06a0d0 msgr2=0x7f7fac0ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:28.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.255+0000 7f7fb21df640 1 -- 172.21.15.53:0/2160398760 shutdown_connections 2023-06-10T18:56:28.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.255+0000 7f7fb21df640 1 -- 172.21.15.53:0/2160398760 wait complete. 2023-06-10T18:56:28.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.255+0000 7f7fb21df640 1 Processor -- start 2023-06-10T18:56:28.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.255+0000 7f7fb21df640 1 -- start start 2023-06-10T18:56:28.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.259+0000 7f7fb21df640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f94005240 0x7f7fac1577a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:28.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.259+0000 7f7fb21df640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7fac1f0db0 0x7f7fac14f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:28.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.259+0000 7f7fb21df640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7fac0c39a0 0x7f7fac0c3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:28.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.259+0000 7f7fb21df640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fac0c4350 con 0x7f7fac0c39a0 2023-06-10T18:56:28.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.259+0000 7f7fb21df640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fac156590 con 0x7f7fac1f0db0 2023-06-10T18:56:28.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.259+0000 7f7fb21df640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fac155980 con 0x7f7f94005240 2023-06-10T18:56:28.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.259+0000 7f7fabfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7fac0c39a0 0x7f7fac0c3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:28.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.259+0000 7f7fabfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7fac0c39a0 0x7f7fac0c3e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59318/0 (socket says 172.21.15.53:59318) 2023-06-10T18:56:28.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.259+0000 7f7fabfff640 1 -- 172.21.15.53:0/1258250036 learned_addr learned my addr 172.21.15.53:0/1258250036 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:28.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.259+0000 7f7faaffd640 1 --2- 172.21.15.53:0/1258250036 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7fac1f0db0 0x7f7fac14f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:28.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.259+0000 7f7fab7fe640 1 --2- 172.21.15.53:0/1258250036 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f94005240 0x7f7fac1577a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:28.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.259+0000 7f7fabfff640 1 -- 172.21.15.53:0/1258250036 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f94005240 msgr2=0x7f7fac1577a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:28.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.259+0000 7f7fabfff640 1 --2- 172.21.15.53:0/1258250036 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f94005240 0x7f7fac1577a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:28.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.259+0000 7f7fabfff640 1 -- 172.21.15.53:0/1258250036 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7fac1f0db0 msgr2=0x7f7fac14f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:28.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.259+0000 7f7fabfff640 1 --2- 172.21.15.53:0/1258250036 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7fac1f0db0 0x7f7fac14f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:28.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.259+0000 7f7fabfff640 1 -- 172.21.15.53:0/1258250036 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fac155c60 con 0x7f7fac0c39a0 2023-06-10T18:56:28.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.259+0000 7f7faaffd640 1 --2- 172.21.15.53:0/1258250036 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7fac1f0db0 0x7f7fac14f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:56:28.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.259+0000 7f7fabfff640 1 --2- 172.21.15.53:0/1258250036 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7fac0c39a0 0x7f7fac0c3e10 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f7fac0c17a0 tx=0x7f7fa4007e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:28.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.259+0000 7f7f93fff640 1 -- 172.21.15.53:0/1258250036 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa401b070 con 0x7f7fac0c39a0 2023-06-10T18:56:28.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.259+0000 7f7f93fff640 1 -- 172.21.15.53:0/1258250036 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa400f040 con 0x7f7fac0c39a0 2023-06-10T18:56:28.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.259+0000 7f7f93fff640 1 -- 172.21.15.53:0/1258250036 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa400e050 con 0x7f7fac0c39a0 2023-06-10T18:56:28.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.259+0000 7f7fb21df640 1 -- 172.21.15.53:0/1258250036 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fac155f40 con 0x7f7fac0c39a0 2023-06-10T18:56:28.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.259+0000 7f7fb21df640 1 -- 172.21.15.53:0/1258250036 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fac1f1220 con 0x7f7fac0c39a0 2023-06-10T18:56:28.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.259+0000 7f7fb21df640 1 -- 172.21.15.53:0/1258250036 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fac04d790 con 0x7f7fac0c39a0 2023-06-10T18:56:28.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.259+0000 7f7f93fff640 1 -- 172.21.15.53:0/1258250036 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7fa4015710 con 0x7f7fac0c39a0 2023-06-10T18:56:28.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.259+0000 7f7f93fff640 1 --2- 172.21.15.53:0/1258250036 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7f98066280 0x7f7f98068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:28.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.259+0000 7f7f93fff640 1 -- 172.21.15.53:0/1258250036 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f7fa4083ac0 con 0x7f7fac0c39a0 2023-06-10T18:56:28.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.259+0000 7f7fab7fe640 1 --2- 172.21.15.53:0/1258250036 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7f98066280 0x7f7f98068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:28.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.263+0000 7f7fab7fe640 1 --2- 172.21.15.53:0/1258250036 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7f98066280 0x7f7f98068730 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c007af0 tx=0x7f7f9c007010 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:28.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.263+0000 7f7f93fff640 1 -- 172.21.15.53:0/1258250036 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7fa4050f10 con 0x7f7fac0c39a0 2023-06-10T18:56:28.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.471+0000 7f7fb21df640 1 -- 172.21.15.53:0/1258250036 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f7fac0b3c20 con 0x7f7fac0c39a0 2023-06-10T18:56:28.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.471+0000 7f7f93fff640 1 -- 172.21.15.53:0/1258250036 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1090 (secure 0 0 0) 0x7f7fa4054530 con 0x7f7fac0c39a0 2023-06-10T18:56:28.477 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:56:28.477 INFO:teuthology.orchestra.run.smithi053.stdout:{"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":247,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":53,"num_osds":8,"num_up_osds":8,"osd_up_since":1686423152,"num_in_osds":8,"osd_in_since":1686423143,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":103},{"state_name":"peering","count":2}],"num_pgs":105,"num_pools":4,"num_objects":24,"data_bytes":592730,"bytes_used":243687424,"bytes_avail":772850425856,"bytes_total":773094113280,"inactive_pgs_ratio":0.01904761977493763,"write_bytes_sec":1791,"read_op_per_sec":0,"write_op_per_sec":5},"fsmap":{"epoch":20,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"c","status":"up:active","gid":5931}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2023-06-10T18:54:59.607497+0000","services":{}},"progress_events":{}} 2023-06-10T18:56:28.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.475+0000 7f7fb21df640 1 -- 172.21.15.53:0/1258250036 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7f98066280 msgr2=0x7f7f98068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:28.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.475+0000 7f7fb21df640 1 --2- 172.21.15.53:0/1258250036 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7f98066280 0x7f7f98068730 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c007af0 tx=0x7f7f9c007010 comp rx=0 tx=0).stop 2023-06-10T18:56:28.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.475+0000 7f7fb21df640 1 -- 172.21.15.53:0/1258250036 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7fac0c39a0 msgr2=0x7f7fac0c3e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:28.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.475+0000 7f7fb21df640 1 --2- 172.21.15.53:0/1258250036 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7fac0c39a0 0x7f7fac0c3e10 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f7fac0c17a0 tx=0x7f7fa4007e40 comp rx=0 tx=0).stop 2023-06-10T18:56:28.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.475+0000 7f7fb21df640 1 -- 172.21.15.53:0/1258250036 shutdown_connections 2023-06-10T18:56:28.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.475+0000 7f7fb21df640 1 --2- 172.21.15.53:0/1258250036 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7f98066280 0x7f7f98068730 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:28.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.475+0000 7f7fb21df640 1 --2- 172.21.15.53:0/1258250036 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7fac0c39a0 0x7f7fac0c3e10 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:28.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.475+0000 7f7fb21df640 1 --2- 172.21.15.53:0/1258250036 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7fac1f0db0 0x7f7fac14f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:28.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.475+0000 7f7fb21df640 1 --2- 172.21.15.53:0/1258250036 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f94005240 0x7f7fac1577a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:28.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.475+0000 7f7fb21df640 1 -- 172.21.15.53:0/1258250036 >> 172.21.15.53:0/1258250036 conn(0x7f7fac06a0d0 msgr2=0x7f7fac0b3150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:28.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.475+0000 7f7fb21df640 1 -- 172.21.15.53:0/1258250036 shutdown_connections 2023-06-10T18:56:28.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.475+0000 7f7fb21df640 1 -- 172.21.15.53:0/1258250036 wait complete. 2023-06-10T18:56:28.495 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-06-10T18:56:28.495 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-10T18:56:28.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.599+0000 7fd56ea16640 1 Processor -- start 2023-06-10T18:56:28.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.599+0000 7fd56ea16640 1 -- start start 2023-06-10T18:56:28.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.603+0000 7fd56ea16640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd56806b2f0 0x7fd56806f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:28.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.603+0000 7fd56ea16640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd5680c8d00 0x7fd56806b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:28.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.603+0000 7fd56ea16640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd568158a90 con 0x7fd56806bc00 2023-06-10T18:56:28.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.603+0000 7fd56ea16640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5680705d0 con 0x7fd5680c8d00 2023-06-10T18:56:28.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.603+0000 7fd56ea16640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd56806f9c0 con 0x7fd56806b2f0 2023-06-10T18:56:28.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.603+0000 7fd5677fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd5680c8d00 0x7fd56806b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:28.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.603+0000 7fd56cfb3640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fd56806bc00 0x7fd5680cbe00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:54066/0 (socket says 172.21.15.53:54066) 2023-06-10T18:56:28.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.603+0000 7fd56cfb3640 1 -- 172.21.15.53:0/2923363801 learned_addr learned my addr 172.21.15.53:0/2923363801 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:56:28.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.603+0000 7fd567fff640 1 --2- 172.21.15.53:0/2923363801 >> v2:172.21.15.117:3300/0 conn(0x7fd56806b2f0 0x7fd56806f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:28.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.603+0000 7fd5677fe640 1 -- 172.21.15.53:0/2923363801 >> v2:172.21.15.117:3300/0 conn(0x7fd56806b2f0 msgr2=0x7fd56806f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:28.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.603+0000 7fd5677fe640 1 --2- 172.21.15.53:0/2923363801 >> v2:172.21.15.117:3300/0 conn(0x7fd56806b2f0 0x7fd56806f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:28.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.603+0000 7fd5677fe640 1 -- 172.21.15.53:0/2923363801 >> v1:172.21.15.53:6789/0 conn(0x7fd56806bc00 legacy=0x7fd5680cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:28.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.603+0000 7fd566ffd640 1 -- 172.21.15.53:0/2923363801 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 942718514 0 0) 0x7fd560001120 con 0x7fd56806bc00 2023-06-10T18:56:28.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.603+0000 7fd5677fe640 1 -- 172.21.15.53:0/2923363801 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd56806fca0 con 0x7fd5680c8d00 2023-06-10T18:56:28.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.603+0000 7fd5677fe640 1 --2- 172.21.15.53:0/2923363801 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5680c8d00 0x7fd56806b6c0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fd568071d80 tx=0x7fd55001ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18df816d8fd6cd51 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:28.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.607+0000 7fd566ffd640 1 -- 172.21.15.53:0/2923363801 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5500a8950 con 0x7fd5680c8d00 2023-06-10T18:56:28.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.607+0000 7fd566ffd640 1 -- 172.21.15.53:0/2923363801 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5500a8ab0 con 0x7fd5680c8d00 2023-06-10T18:56:28.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.607+0000 7fd566ffd640 1 -- 172.21.15.53:0/2923363801 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5500a8e40 con 0x7fd5680c8d00 2023-06-10T18:56:28.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.607+0000 7fd56ea16640 1 -- 172.21.15.53:0/2923363801 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5680c8d00 msgr2=0x7fd56806b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:28.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.607+0000 7fd56ea16640 1 --2- 172.21.15.53:0/2923363801 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5680c8d00 0x7fd56806b6c0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fd568071d80 tx=0x7fd55001ec50 comp rx=0 tx=0).stop 2023-06-10T18:56:28.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.607+0000 7fd56ea16640 1 -- 172.21.15.53:0/2923363801 shutdown_connections 2023-06-10T18:56:28.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.607+0000 7fd56ea16640 1 --2- 172.21.15.53:0/2923363801 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5680c8d00 0x7fd56806b6c0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:28.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.607+0000 7fd56ea16640 1 --2- 172.21.15.53:0/2923363801 >> v2:172.21.15.117:3300/0 conn(0x7fd56806b2f0 0x7fd56806f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:28.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.607+0000 7fd56ea16640 1 -- 172.21.15.53:0/2923363801 >> 172.21.15.53:0/2923363801 conn(0x7fd56806a0d0 msgr2=0x7fd5680ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:28.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.607+0000 7fd56ea16640 1 -- 172.21.15.53:0/2923363801 shutdown_connections 2023-06-10T18:56:28.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.607+0000 7fd56ea16640 1 -- 172.21.15.53:0/2923363801 wait complete. 2023-06-10T18:56:28.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.607+0000 7fd56ea16640 1 Processor -- start 2023-06-10T18:56:28.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.607+0000 7fd56ea16640 1 -- start start 2023-06-10T18:56:28.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.607+0000 7fd56ea16640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd56806b2f0 0x7fd5681f05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:28.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.607+0000 7fd56ea16640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd56806bc00 0x7fd5680b14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:28.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.607+0000 7fd56ea16640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5680c8d00 0x7fd5680ae430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:28.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.607+0000 7fd56ea16640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5680b2b90 con 0x7fd5680c8d00 2023-06-10T18:56:28.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.607+0000 7fd56ea16640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5680b1f80 con 0x7fd56806bc00 2023-06-10T18:56:28.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.607+0000 7fd56ea16640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5680b2260 con 0x7fd56806b2f0 2023-06-10T18:56:28.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.607+0000 7fd56cfb3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5680c8d00 0x7fd5680ae430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:28.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.607+0000 7fd56cfb3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5680c8d00 0x7fd5680ae430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59338/0 (socket says 172.21.15.53:59338) 2023-06-10T18:56:28.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.607+0000 7fd56cfb3640 1 -- 172.21.15.53:0/3036159991 learned_addr learned my addr 172.21.15.53:0/3036159991 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:28.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.607+0000 7fd56cfb3640 1 -- 172.21.15.53:0/3036159991 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd56806b2f0 msgr2=0x7fd5681f05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:28.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.607+0000 7fd56cfb3640 1 --2- 172.21.15.53:0/3036159991 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd56806b2f0 0x7fd5681f05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:28.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.607+0000 7fd5677fe640 1 --2- 172.21.15.53:0/3036159991 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd56806bc00 0x7fd5680b14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:28.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.607+0000 7fd56cfb3640 1 -- 172.21.15.53:0/3036159991 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd56806bc00 msgr2=0x7fd5680b14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:28.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.607+0000 7fd56cfb3640 1 --2- 172.21.15.53:0/3036159991 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd56806bc00 0x7fd5680b14e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:28.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.607+0000 7fd56cfb3640 1 -- 172.21.15.53:0/3036159991 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd550009420 con 0x7fd5680c8d00 2023-06-10T18:56:28.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.607+0000 7fd56cfb3640 1 --2- 172.21.15.53:0/3036159991 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5680c8d00 0x7fd5680ae430 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fd56000c780 tx=0x7fd56000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:28.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.607+0000 7fd564ff9640 1 -- 172.21.15.53:0/3036159991 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5600072d0 con 0x7fd5680c8d00 2023-06-10T18:56:28.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.607+0000 7fd564ff9640 1 -- 172.21.15.53:0/3036159991 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd560007450 con 0x7fd5680c8d00 2023-06-10T18:56:28.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.607+0000 7fd56ea16640 1 -- 172.21.15.53:0/3036159991 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5680b2540 con 0x7fd5680c8d00 2023-06-10T18:56:28.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.607+0000 7fd564ff9640 1 -- 172.21.15.53:0/3036159991 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd560001d20 con 0x7fd5680c8d00 2023-06-10T18:56:28.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.607+0000 7fd56ea16640 1 -- 172.21.15.53:0/3036159991 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd56815a870 con 0x7fd5680c8d00 2023-06-10T18:56:28.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.611+0000 7fd56ea16640 1 -- 172.21.15.53:0/3036159991 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd56804d790 con 0x7fd5680c8d00 2023-06-10T18:56:28.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.611+0000 7fd564ff9640 1 -- 172.21.15.53:0/3036159991 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd5600047f0 con 0x7fd5680c8d00 2023-06-10T18:56:28.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.611+0000 7fd564ff9640 1 --2- 172.21.15.53:0/3036159991 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd548066280 0x7fd548068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:28.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.611+0000 7fd564ff9640 1 -- 172.21.15.53:0/3036159991 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fd560083080 con 0x7fd5680c8d00 2023-06-10T18:56:28.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.611+0000 7fd567fff640 1 --2- 172.21.15.53:0/3036159991 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd548066280 0x7fd548068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:28.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.611+0000 7fd567fff640 1 --2- 172.21.15.53:0/3036159991 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd548066280 0x7fd548068730 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fd558007e60 tx=0x7fd558007390 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:28.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.615+0000 7fd564ff9640 1 -- 172.21.15.53:0/3036159991 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd560050550 con 0x7fd5680c8d00 2023-06-10T18:56:28.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.759+0000 7fd56ea16640 1 -- 172.21.15.53:0/3036159991 --> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd568070260 con 0x7fd548066280 2023-06-10T18:56:28.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.779+0000 7fd564ff9640 1 -- 172.21.15.53:0/3036159991 <== mgr.4105 v2:172.21.15.117:6832/3061986771 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+309197 (secure 0 0 0) 0x7fd558007a50 con 0x7fd548066280 2023-06-10T18:56:28.788 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:56:28.789 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-06-10T18:56:28.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.783+0000 7fd56ea16640 1 -- 172.21.15.53:0/3036159991 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd548066280 msgr2=0x7fd548068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:28.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.783+0000 7fd56ea16640 1 --2- 172.21.15.53:0/3036159991 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd548066280 0x7fd548068730 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fd558007e60 tx=0x7fd558007390 comp rx=0 tx=0).stop 2023-06-10T18:56:28.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.783+0000 7fd56ea16640 1 -- 172.21.15.53:0/3036159991 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5680c8d00 msgr2=0x7fd5680ae430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:28.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.783+0000 7fd56ea16640 1 --2- 172.21.15.53:0/3036159991 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5680c8d00 0x7fd5680ae430 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fd56000c780 tx=0x7fd56000cc40 comp rx=0 tx=0).stop 2023-06-10T18:56:28.791 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.783+0000 7fd56ea16640 1 -- 172.21.15.53:0/3036159991 shutdown_connections 2023-06-10T18:56:28.791 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.783+0000 7fd56ea16640 1 --2- 172.21.15.53:0/3036159991 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd548066280 0x7fd548068730 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:28.791 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.783+0000 7fd56ea16640 1 --2- 172.21.15.53:0/3036159991 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5680c8d00 0x7fd5680ae430 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:28.791 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.783+0000 7fd56ea16640 1 --2- 172.21.15.53:0/3036159991 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd56806bc00 0x7fd5680b14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:28.791 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.783+0000 7fd56ea16640 1 --2- 172.21.15.53:0/3036159991 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd56806b2f0 0x7fd5681f05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:28.791 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.783+0000 7fd56ea16640 1 -- 172.21.15.53:0/3036159991 >> 172.21.15.53:0/3036159991 conn(0x7fd56806a0d0 msgr2=0x7fd56806eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:28.791 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.783+0000 7fd56ea16640 1 -- 172.21.15.53:0/3036159991 shutdown_connections 2023-06-10T18:56:28.791 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:28.783+0000 7fd56ea16640 1 -- 172.21.15.53:0/3036159991 wait complete. 2023-06-10T18:56:28.805 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":164,"stamp":"2023-06-10T18:56:27.888666+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237976,"kb_used_data":5976,"kb_used_omap":0,"kb_used_meta":231936,"kb_avail":754736744,"statfs":{"total":773094113280,"available":772850425856,"internally_reserved":0,"allocated":6119424,"data_stored":3301653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":237502464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.195857"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.887321+0000","last_change":"2023-06-10T18:56:18.723557+0000","last_active":"2023-06-10T18:56:26.887321+0000","last_peered":"2023-06-10T18:56:26.887321+0000","last_clean":"2023-06-10T18:56:26.887321+0000","last_became_active":"2023-06-10T18:56:18.723169+0000","last_became_peered":"2023-06-10T18:56:18.723169+0000","last_unstale":"2023-06-10T18:56:26.887321+0000","last_undegraded":"2023-06-10T18:56:26.887321+0000","last_fullsized":"2023-06-10T18:56:26.887321+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:05:32.467816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.144646+0000","last_change":"2023-06-10T18:56:18.739659+0000","last_active":"2023-06-10T18:56:27.144646+0000","last_peered":"2023-06-10T18:56:27.144646+0000","last_clean":"2023-06-10T18:56:27.144646+0000","last_became_active":"2023-06-10T18:56:18.738930+0000","last_became_peered":"2023-06-10T18:56:18.738930+0000","last_unstale":"2023-06-10T18:56:27.144646+0000","last_undegraded":"2023-06-10T18:56:27.144646+0000","last_fullsized":"2023-06-10T18:56:27.144646+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:56:20.150212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.882137+0000","last_change":"2023-06-10T18:56:18.715713+0000","last_active":"2023-06-10T18:56:26.882137+0000","last_peered":"2023-06-10T18:56:26.882137+0000","last_clean":"2023-06-10T18:56:26.882137+0000","last_became_active":"2023-06-10T18:56:18.715403+0000","last_became_peered":"2023-06-10T18:56:18.715403+0000","last_unstale":"2023-06-10T18:56:26.882137+0000","last_undegraded":"2023-06-10T18:56:26.882137+0000","last_fullsized":"2023-06-10T18:56:26.882137+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:13:39.804832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.144321+0000","last_change":"2023-06-10T18:56:18.742396+0000","last_active":"2023-06-10T18:56:27.144321+0000","last_peered":"2023-06-10T18:56:27.144321+0000","last_clean":"2023-06-10T18:56:27.144321+0000","last_became_active":"2023-06-10T18:56:18.741689+0000","last_became_peered":"2023-06-10T18:56:18.741689+0000","last_unstale":"2023-06-10T18:56:27.144321+0000","last_undegraded":"2023-06-10T18:56:27.144321+0000","last_fullsized":"2023-06-10T18:56:27.144321+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:15:14.281447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.871175+0000","last_change":"2023-06-10T18:56:18.733830+0000","last_active":"2023-06-10T18:56:26.871175+0000","last_peered":"2023-06-10T18:56:26.871175+0000","last_clean":"2023-06-10T18:56:26.871175+0000","last_became_active":"2023-06-10T18:56:18.732968+0000","last_became_peered":"2023-06-10T18:56:18.732968+0000","last_unstale":"2023-06-10T18:56:26.871175+0000","last_undegraded":"2023-06-10T18:56:26.871175+0000","last_fullsized":"2023-06-10T18:56:26.871175+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:17:50.531074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.886873+0000","last_change":"2023-06-10T18:56:18.733304+0000","last_active":"2023-06-10T18:56:26.886873+0000","last_peered":"2023-06-10T18:56:26.886873+0000","last_clean":"2023-06-10T18:56:26.886873+0000","last_became_active":"2023-06-10T18:56:18.733010+0000","last_became_peered":"2023-06-10T18:56:18.733010+0000","last_unstale":"2023-06-10T18:56:26.886873+0000","last_undegraded":"2023-06-10T18:56:26.886873+0000","last_fullsized":"2023-06-10T18:56:26.886873+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:04:11.756055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.879556+0000","last_change":"2023-06-10T18:56:18.715925+0000","last_active":"2023-06-10T18:56:26.879556+0000","last_peered":"2023-06-10T18:56:26.879556+0000","last_clean":"2023-06-10T18:56:26.879556+0000","last_became_active":"2023-06-10T18:56:18.715163+0000","last_became_peered":"2023-06-10T18:56:18.715163+0000","last_unstale":"2023-06-10T18:56:26.879556+0000","last_undegraded":"2023-06-10T18:56:26.879556+0000","last_fullsized":"2023-06-10T18:56:26.879556+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:07:15.569502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.194669+0000","last_change":"2023-06-10T18:56:18.710693+0000","last_active":"2023-06-10T18:56:27.194669+0000","last_peered":"2023-06-10T18:56:27.194669+0000","last_clean":"2023-06-10T18:56:27.194669+0000","last_became_active":"2023-06-10T18:56:18.710420+0000","last_became_peered":"2023-06-10T18:56:18.710420+0000","last_unstale":"2023-06-10T18:56:27.194669+0000","last_undegraded":"2023-06-10T18:56:27.194669+0000","last_fullsized":"2023-06-10T18:56:27.194669+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:04:11.756055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.195404+0000","last_change":"2023-06-10T18:56:18.711205+0000","last_active":"2023-06-10T18:56:27.195404+0000","last_peered":"2023-06-10T18:56:27.195404+0000","last_clean":"2023-06-10T18:56:27.195404+0000","last_became_active":"2023-06-10T18:56:18.711011+0000","last_became_peered":"2023-06-10T18:56:18.711011+0000","last_unstale":"2023-06-10T18:56:27.195404+0000","last_undegraded":"2023-06-10T18:56:27.195404+0000","last_fullsized":"2023-06-10T18:56:27.195404+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:52:30.517410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.887403+0000","last_change":"2023-06-10T18:56:18.731703+0000","last_active":"2023-06-10T18:56:26.887403+0000","last_peered":"2023-06-10T18:56:26.887403+0000","last_clean":"2023-06-10T18:56:26.887403+0000","last_became_active":"2023-06-10T18:56:18.731407+0000","last_became_peered":"2023-06-10T18:56:18.731407+0000","last_unstale":"2023-06-10T18:56:26.887403+0000","last_undegraded":"2023-06-10T18:56:26.887403+0000","last_fullsized":"2023-06-10T18:56:26.887403+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:13:39.804832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.868234+0000","last_change":"2023-06-10T18:56:18.739026+0000","last_active":"2023-06-10T18:56:26.868234+0000","last_peered":"2023-06-10T18:56:26.868234+0000","last_clean":"2023-06-10T18:56:26.868234+0000","last_became_active":"2023-06-10T18:56:18.738748+0000","last_became_peered":"2023-06-10T18:56:18.738748+0000","last_unstale":"2023-06-10T18:56:26.868234+0000","last_undegraded":"2023-06-10T18:56:26.868234+0000","last_fullsized":"2023-06-10T18:56:26.868234+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:11:27.241616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.195269+0000","last_change":"2023-06-10T18:56:18.711319+0000","last_active":"2023-06-10T18:56:27.195269+0000","last_peered":"2023-06-10T18:56:27.195269+0000","last_clean":"2023-06-10T18:56:27.195269+0000","last_became_active":"2023-06-10T18:56:18.711043+0000","last_became_peered":"2023-06-10T18:56:18.711043+0000","last_unstale":"2023-06-10T18:56:27.195269+0000","last_undegraded":"2023-06-10T18:56:27.195269+0000","last_fullsized":"2023-06-10T18:56:27.195269+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:05:32.467816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.886977+0000","last_change":"2023-06-10T18:56:18.735130+0000","last_active":"2023-06-10T18:56:26.886977+0000","last_peered":"2023-06-10T18:56:26.886977+0000","last_clean":"2023-06-10T18:56:26.886977+0000","last_became_active":"2023-06-10T18:56:18.734873+0000","last_became_peered":"2023-06-10T18:56:18.734873+0000","last_unstale":"2023-06-10T18:56:26.886977+0000","last_undegraded":"2023-06-10T18:56:26.886977+0000","last_fullsized":"2023-06-10T18:56:26.886977+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:27:56.626985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.879977+0000","last_change":"2023-06-10T18:56:18.718525+0000","last_active":"2023-06-10T18:56:26.879977+0000","last_peered":"2023-06-10T18:56:26.879977+0000","last_clean":"2023-06-10T18:56:26.879977+0000","last_became_active":"2023-06-10T18:56:18.718169+0000","last_became_peered":"2023-06-10T18:56:18.718169+0000","last_unstale":"2023-06-10T18:56:26.879977+0000","last_undegraded":"2023-06-10T18:56:26.879977+0000","last_fullsized":"2023-06-10T18:56:26.879977+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:17:01.114014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.144057+0000","last_change":"2023-06-10T18:56:18.747220+0000","last_active":"2023-06-10T18:56:27.144057+0000","last_peered":"2023-06-10T18:56:27.144057+0000","last_clean":"2023-06-10T18:56:27.144057+0000","last_became_active":"2023-06-10T18:56:18.746415+0000","last_became_peered":"2023-06-10T18:56:18.746415+0000","last_unstale":"2023-06-10T18:56:27.144057+0000","last_undegraded":"2023-06-10T18:56:27.144057+0000","last_fullsized":"2023-06-10T18:56:27.144057+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:02:03.688477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.886572+0000","last_change":"2023-06-10T18:56:18.732379+0000","last_active":"2023-06-10T18:56:26.886572+0000","last_peered":"2023-06-10T18:56:26.886572+0000","last_clean":"2023-06-10T18:56:26.886572+0000","last_became_active":"2023-06-10T18:56:18.732081+0000","last_became_peered":"2023-06-10T18:56:18.732081+0000","last_unstale":"2023-06-10T18:56:26.886572+0000","last_undegraded":"2023-06-10T18:56:26.886572+0000","last_fullsized":"2023-06-10T18:56:26.886572+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:17:50.531074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.880795+0000","last_change":"2023-06-10T18:56:18.727402+0000","last_active":"2023-06-10T18:56:26.880795+0000","last_peered":"2023-06-10T18:56:26.880795+0000","last_clean":"2023-06-10T18:56:26.880795+0000","last_became_active":"2023-06-10T18:56:18.726939+0000","last_became_peered":"2023-06-10T18:56:18.726939+0000","last_unstale":"2023-06-10T18:56:26.880795+0000","last_undegraded":"2023-06-10T18:56:26.880795+0000","last_fullsized":"2023-06-10T18:56:26.880795+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:57:17.090045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.144764+0000","last_change":"2023-06-10T18:56:18.741248+0000","last_active":"2023-06-10T18:56:27.144764+0000","last_peered":"2023-06-10T18:56:27.144764+0000","last_clean":"2023-06-10T18:56:27.144764+0000","last_became_active":"2023-06-10T18:56:18.740548+0000","last_became_peered":"2023-06-10T18:56:18.740548+0000","last_unstale":"2023-06-10T18:56:27.144764+0000","last_undegraded":"2023-06-10T18:56:27.144764+0000","last_fullsized":"2023-06-10T18:56:27.144764+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:51:41.177614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.880542+0000","last_change":"2023-06-10T18:56:18.718426+0000","last_active":"2023-06-10T18:56:26.880542+0000","last_peered":"2023-06-10T18:56:26.880542+0000","last_clean":"2023-06-10T18:56:26.880542+0000","last_became_active":"2023-06-10T18:56:18.718017+0000","last_became_peered":"2023-06-10T18:56:18.718017+0000","last_unstale":"2023-06-10T18:56:26.880542+0000","last_undegraded":"2023-06-10T18:56:26.880542+0000","last_fullsized":"2023-06-10T18:56:26.880542+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:36:56.932324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.875458+0000","last_change":"2023-06-10T18:56:18.734189+0000","last_active":"2023-06-10T18:56:26.875458+0000","last_peered":"2023-06-10T18:56:26.875458+0000","last_clean":"2023-06-10T18:56:26.875458+0000","last_became_active":"2023-06-10T18:56:18.733412+0000","last_became_peered":"2023-06-10T18:56:18.733412+0000","last_unstale":"2023-06-10T18:56:26.875458+0000","last_undegraded":"2023-06-10T18:56:26.875458+0000","last_fullsized":"2023-06-10T18:56:26.875458+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:59:44.756321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.875364+0000","last_change":"2023-06-10T18:56:18.737307+0000","last_active":"2023-06-10T18:56:26.875364+0000","last_peered":"2023-06-10T18:56:26.875364+0000","last_clean":"2023-06-10T18:56:26.875364+0000","last_became_active":"2023-06-10T18:56:18.736534+0000","last_became_peered":"2023-06-10T18:56:18.736534+0000","last_unstale":"2023-06-10T18:56:26.875364+0000","last_undegraded":"2023-06-10T18:56:26.875364+0000","last_fullsized":"2023-06-10T18:56:26.875364+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:01:44.663641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.194660+0000","last_change":"2023-06-10T18:56:18.710819+0000","last_active":"2023-06-10T18:56:27.194660+0000","last_peered":"2023-06-10T18:56:27.194660+0000","last_clean":"2023-06-10T18:56:27.194660+0000","last_became_active":"2023-06-10T18:56:18.710524+0000","last_became_peered":"2023-06-10T18:56:18.710524+0000","last_unstale":"2023-06-10T18:56:27.194660+0000","last_undegraded":"2023-06-10T18:56:27.194660+0000","last_fullsized":"2023-06-10T18:56:27.194660+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:16:44.545696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.867692+0000","last_change":"2023-06-10T18:56:18.739719+0000","last_active":"2023-06-10T18:56:26.867692+0000","last_peered":"2023-06-10T18:56:26.867692+0000","last_clean":"2023-06-10T18:56:26.867692+0000","last_became_active":"2023-06-10T18:56:18.739394+0000","last_became_peered":"2023-06-10T18:56:18.739394+0000","last_unstale":"2023-06-10T18:56:26.867692+0000","last_undegraded":"2023-06-10T18:56:26.867692+0000","last_fullsized":"2023-06-10T18:56:26.867692+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:48:22.699885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.879440+0000","last_change":"2023-06-10T18:56:18.716014+0000","last_active":"2023-06-10T18:56:26.879440+0000","last_peered":"2023-06-10T18:56:26.879440+0000","last_clean":"2023-06-10T18:56:26.879440+0000","last_became_active":"2023-06-10T18:56:18.715463+0000","last_became_peered":"2023-06-10T18:56:18.715463+0000","last_unstale":"2023-06-10T18:56:26.879440+0000","last_undegraded":"2023-06-10T18:56:26.879440+0000","last_fullsized":"2023-06-10T18:56:26.879440+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:40:33.066988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.881131+0000","last_change":"2023-06-10T18:56:18.722488+0000","last_active":"2023-06-10T18:56:26.881131+0000","last_peered":"2023-06-10T18:56:26.881131+0000","last_clean":"2023-06-10T18:56:26.881131+0000","last_became_active":"2023-06-10T18:56:18.722221+0000","last_became_peered":"2023-06-10T18:56:18.722221+0000","last_unstale":"2023-06-10T18:56:26.881131+0000","last_undegraded":"2023-06-10T18:56:26.881131+0000","last_fullsized":"2023-06-10T18:56:26.881131+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:16:44.545696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.195014+0000","last_change":"2023-06-10T18:56:18.721449+0000","last_active":"2023-06-10T18:56:27.195014+0000","last_peered":"2023-06-10T18:56:27.195014+0000","last_clean":"2023-06-10T18:56:27.195014+0000","last_became_active":"2023-06-10T18:56:18.721191+0000","last_became_peered":"2023-06-10T18:56:18.721191+0000","last_unstale":"2023-06-10T18:56:27.195014+0000","last_undegraded":"2023-06-10T18:56:27.195014+0000","last_fullsized":"2023-06-10T18:56:27.195014+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:18:25.090460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.888495+0000","last_change":"2023-06-10T18:56:18.719671+0000","last_active":"2023-06-10T18:56:26.888495+0000","last_peered":"2023-06-10T18:56:26.888495+0000","last_clean":"2023-06-10T18:56:26.888495+0000","last_became_active":"2023-06-10T18:56:18.718588+0000","last_became_peered":"2023-06-10T18:56:18.718588+0000","last_unstale":"2023-06-10T18:56:26.888495+0000","last_undegraded":"2023-06-10T18:56:26.888495+0000","last_fullsized":"2023-06-10T18:56:26.888495+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:57:04.253762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.875781+0000","last_change":"2023-06-10T18:56:18.720108+0000","last_active":"2023-06-10T18:56:26.875781+0000","last_peered":"2023-06-10T18:56:26.875781+0000","last_clean":"2023-06-10T18:56:26.875781+0000","last_became_active":"2023-06-10T18:56:18.719242+0000","last_became_peered":"2023-06-10T18:56:18.719242+0000","last_unstale":"2023-06-10T18:56:26.875781+0000","last_undegraded":"2023-06-10T18:56:26.875781+0000","last_fullsized":"2023-06-10T18:56:26.875781+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:41:27.064954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.879750+0000","last_change":"2023-06-10T18:56:18.747959+0000","last_active":"2023-06-10T18:56:26.879750+0000","last_peered":"2023-06-10T18:56:26.879750+0000","last_clean":"2023-06-10T18:56:26.879750+0000","last_became_active":"2023-06-10T18:56:18.747680+0000","last_became_peered":"2023-06-10T18:56:18.747680+0000","last_unstale":"2023-06-10T18:56:26.879750+0000","last_undegraded":"2023-06-10T18:56:26.879750+0000","last_fullsized":"2023-06-10T18:56:26.879750+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:22:48.846033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.144212+0000","last_change":"2023-06-10T18:56:18.740103+0000","last_active":"2023-06-10T18:56:27.144212+0000","last_peered":"2023-06-10T18:56:27.144212+0000","last_clean":"2023-06-10T18:56:27.144212+0000","last_became_active":"2023-06-10T18:56:18.739227+0000","last_became_peered":"2023-06-10T18:56:18.739227+0000","last_unstale":"2023-06-10T18:56:27.144212+0000","last_undegraded":"2023-06-10T18:56:27.144212+0000","last_fullsized":"2023-06-10T18:56:27.144212+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:21:25.069656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.879705+0000","last_change":"2023-06-10T18:56:18.715535+0000","last_active":"2023-06-10T18:56:26.879705+0000","last_peered":"2023-06-10T18:56:26.879705+0000","last_clean":"2023-06-10T18:56:26.879705+0000","last_became_active":"2023-06-10T18:56:18.714677+0000","last_became_peered":"2023-06-10T18:56:18.714677+0000","last_unstale":"2023-06-10T18:56:26.879705+0000","last_undegraded":"2023-06-10T18:56:26.879705+0000","last_fullsized":"2023-06-10T18:56:26.879705+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:12:02.143937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.871827+0000","last_change":"2023-06-10T18:56:18.705775+0000","last_active":"2023-06-10T18:56:26.871827+0000","last_peered":"2023-06-10T18:56:26.871827+0000","last_clean":"2023-06-10T18:56:26.871827+0000","last_became_active":"2023-06-10T18:56:18.703437+0000","last_became_peered":"2023-06-10T18:56:18.703437+0000","last_unstale":"2023-06-10T18:56:26.871827+0000","last_undegraded":"2023-06-10T18:56:26.871827+0000","last_fullsized":"2023-06-10T18:56:26.871827+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:03:07.190449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.143717+0000","last_change":"2023-06-10T18:56:18.740486+0000","last_active":"2023-06-10T18:56:27.143717+0000","last_peered":"2023-06-10T18:56:27.143717+0000","last_clean":"2023-06-10T18:56:27.143717+0000","last_became_active":"2023-06-10T18:56:18.739644+0000","last_became_peered":"2023-06-10T18:56:18.739644+0000","last_unstale":"2023-06-10T18:56:27.143717+0000","last_undegraded":"2023-06-10T18:56:27.143717+0000","last_fullsized":"2023-06-10T18:56:27.143717+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:30:31.600689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"50'4","reported_seq":19,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.876540+0000","last_change":"2023-06-10T18:56:18.340764+0000","last_active":"2023-06-10T18:56:26.876540+0000","last_peered":"2023-06-10T18:56:26.876540+0000","last_clean":"2023-06-10T18:56:26.876540+0000","last_became_active":"2023-06-10T18:56:18.340011+0000","last_became_peered":"2023-06-10T18:56:18.340011+0000","last_unstale":"2023-06-10T18:56:26.876540+0000","last_undegraded":"2023-06-10T18:56:26.876540+0000","last_fullsized":"2023-06-10T18:56:26.876540+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:11:50.546839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.873041+0000","last_change":"2023-06-10T18:56:18.735833+0000","last_active":"2023-06-10T18:56:26.873041+0000","last_peered":"2023-06-10T18:56:26.873041+0000","last_clean":"2023-06-10T18:56:26.873041+0000","last_became_active":"2023-06-10T18:56:18.734668+0000","last_became_peered":"2023-06-10T18:56:18.734668+0000","last_unstale":"2023-06-10T18:56:26.873041+0000","last_undegraded":"2023-06-10T18:56:26.873041+0000","last_fullsized":"2023-06-10T18:56:26.873041+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:16:35.200792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"50'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.887551+0000","last_change":"2023-06-10T18:56:18.335972+0000","last_active":"2023-06-10T18:56:26.887551+0000","last_peered":"2023-06-10T18:56:26.887551+0000","last_clean":"2023-06-10T18:56:26.887551+0000","last_became_active":"2023-06-10T18:56:18.335565+0000","last_became_peered":"2023-06-10T18:56:18.335565+0000","last_unstale":"2023-06-10T18:56:26.887551+0000","last_undegraded":"2023-06-10T18:56:26.887551+0000","last_fullsized":"2023-06-10T18:56:26.887551+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:52:29.503909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.875187+0000","last_change":"2023-06-10T18:56:18.741042+0000","last_active":"2023-06-10T18:56:26.875187+0000","last_peered":"2023-06-10T18:56:26.875187+0000","last_clean":"2023-06-10T18:56:26.875187+0000","last_became_active":"2023-06-10T18:56:18.740325+0000","last_became_peered":"2023-06-10T18:56:18.740325+0000","last_unstale":"2023-06-10T18:56:26.875187+0000","last_undegraded":"2023-06-10T18:56:26.875187+0000","last_fullsized":"2023-06-10T18:56:26.875187+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:45:27.842047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"50'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.888555+0000","last_change":"2023-06-10T18:56:18.336603+0000","last_active":"2023-06-10T18:56:26.888555+0000","last_peered":"2023-06-10T18:56:26.888555+0000","last_clean":"2023-06-10T18:56:26.888555+0000","last_became_active":"2023-06-10T18:56:18.336117+0000","last_became_peered":"2023-06-10T18:56:18.336117+0000","last_unstale":"2023-06-10T18:56:26.888555+0000","last_undegraded":"2023-06-10T18:56:26.888555+0000","last_fullsized":"2023-06-10T18:56:26.888555+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:41:56.108306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.194691+0000","last_change":"2023-06-10T18:56:18.719404+0000","last_active":"2023-06-10T18:56:27.194691+0000","last_peered":"2023-06-10T18:56:27.194691+0000","last_clean":"2023-06-10T18:56:27.194691+0000","last_became_active":"2023-06-10T18:56:18.719096+0000","last_became_peered":"2023-06-10T18:56:18.719096+0000","last_unstale":"2023-06-10T18:56:27.194691+0000","last_undegraded":"2023-06-10T18:56:27.194691+0000","last_fullsized":"2023-06-10T18:56:27.194691+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:33:38.472734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"50'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.872249+0000","last_change":"2023-06-10T18:56:18.323382+0000","last_active":"2023-06-10T18:56:26.872249+0000","last_peered":"2023-06-10T18:56:26.872249+0000","last_clean":"2023-06-10T18:56:26.872249+0000","last_became_active":"2023-06-10T18:56:18.322748+0000","last_became_peered":"2023-06-10T18:56:18.322748+0000","last_unstale":"2023-06-10T18:56:26.872249+0000","last_undegraded":"2023-06-10T18:56:26.872249+0000","last_fullsized":"2023-06-10T18:56:26.872249+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:35:54.887943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.872083+0000","last_change":"2023-06-10T18:56:18.716497+0000","last_active":"2023-06-10T18:56:26.872083+0000","last_peered":"2023-06-10T18:56:26.872083+0000","last_clean":"2023-06-10T18:56:26.872083+0000","last_became_active":"2023-06-10T18:56:18.715689+0000","last_became_peered":"2023-06-10T18:56:18.715689+0000","last_unstale":"2023-06-10T18:56:26.872083+0000","last_undegraded":"2023-06-10T18:56:26.872083+0000","last_fullsized":"2023-06-10T18:56:26.872083+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:27:56.626985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"50'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.880042+0000","last_change":"2023-06-10T18:56:18.321017+0000","last_active":"2023-06-10T18:56:26.880042+0000","last_peered":"2023-06-10T18:56:26.880042+0000","last_clean":"2023-06-10T18:56:26.880042+0000","last_became_active":"2023-06-10T18:56:18.320552+0000","last_became_peered":"2023-06-10T18:56:18.320552+0000","last_unstale":"2023-06-10T18:56:26.880042+0000","last_undegraded":"2023-06-10T18:56:26.880042+0000","last_fullsized":"2023-06-10T18:56:26.880042+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:53:30.066871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.144497+0000","last_change":"2023-06-10T18:56:18.742047+0000","last_active":"2023-06-10T18:56:27.144497+0000","last_peered":"2023-06-10T18:56:27.144497+0000","last_clean":"2023-06-10T18:56:27.144497+0000","last_became_active":"2023-06-10T18:56:18.741342+0000","last_became_peered":"2023-06-10T18:56:18.741342+0000","last_unstale":"2023-06-10T18:56:27.144497+0000","last_undegraded":"2023-06-10T18:56:27.144497+0000","last_fullsized":"2023-06-10T18:56:27.144497+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:39:30.440026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"50'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.871399+0000","last_change":"2023-06-10T18:56:18.339655+0000","last_active":"2023-06-10T18:56:26.871399+0000","last_peered":"2023-06-10T18:56:26.871399+0000","last_clean":"2023-06-10T18:56:26.871399+0000","last_became_active":"2023-06-10T18:56:18.338930+0000","last_became_peered":"2023-06-10T18:56:18.338930+0000","last_unstale":"2023-06-10T18:56:26.871399+0000","last_undegraded":"2023-06-10T18:56:26.871399+0000","last_fullsized":"2023-06-10T18:56:26.871399+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:57:16.076543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.195762+0000","last_change":"2023-06-10T18:56:18.721372+0000","last_active":"2023-06-10T18:56:27.195762+0000","last_peered":"2023-06-10T18:56:27.195762+0000","last_clean":"2023-06-10T18:56:27.195762+0000","last_became_active":"2023-06-10T18:56:18.721086+0000","last_became_peered":"2023-06-10T18:56:18.721086+0000","last_unstale":"2023-06-10T18:56:27.195762+0000","last_undegraded":"2023-06-10T18:56:27.195762+0000","last_fullsized":"2023-06-10T18:56:27.195762+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:36:50.106017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.875086+0000","last_change":"2023-06-10T18:56:18.337501+0000","last_active":"2023-06-10T18:56:26.875086+0000","last_peered":"2023-06-10T18:56:26.875086+0000","last_clean":"2023-06-10T18:56:26.875086+0000","last_became_active":"2023-06-10T18:56:18.336875+0000","last_became_peered":"2023-06-10T18:56:18.336875+0000","last_unstale":"2023-06-10T18:56:26.875086+0000","last_undegraded":"2023-06-10T18:56:26.875086+0000","last_fullsized":"2023-06-10T18:56:26.875086+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:54:49.818477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.144972+0000","last_change":"2023-06-10T18:56:18.740844+0000","last_active":"2023-06-10T18:56:27.144972+0000","last_peered":"2023-06-10T18:56:27.144972+0000","last_clean":"2023-06-10T18:56:27.144972+0000","last_became_active":"2023-06-10T18:56:18.740202+0000","last_became_peered":"2023-06-10T18:56:18.740202+0000","last_unstale":"2023-06-10T18:56:27.144972+0000","last_undegraded":"2023-06-10T18:56:27.144972+0000","last_fullsized":"2023-06-10T18:56:27.144972+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:34:13.702327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.879577+0000","last_change":"2023-06-10T18:56:18.328357+0000","last_active":"2023-06-10T18:56:26.879577+0000","last_peered":"2023-06-10T18:56:26.879577+0000","last_clean":"2023-06-10T18:56:26.879577+0000","last_became_active":"2023-06-10T18:56:18.328062+0000","last_became_peered":"2023-06-10T18:56:18.328062+0000","last_unstale":"2023-06-10T18:56:26.879577+0000","last_undegraded":"2023-06-10T18:56:26.879577+0000","last_fullsized":"2023-06-10T18:56:26.879577+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:42:04.516586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.870557+0000","last_change":"2023-06-10T18:56:18.715041+0000","last_active":"2023-06-10T18:56:26.870557+0000","last_peered":"2023-06-10T18:56:26.870557+0000","last_clean":"2023-06-10T18:56:26.870557+0000","last_became_active":"2023-06-10T18:56:18.714315+0000","last_became_peered":"2023-06-10T18:56:18.714315+0000","last_unstale":"2023-06-10T18:56:26.870557+0000","last_undegraded":"2023-06-10T18:56:26.870557+0000","last_fullsized":"2023-06-10T18:56:26.870557+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:23:30.185213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.144647+0000","last_change":"2023-06-10T18:56:18.343930+0000","last_active":"2023-06-10T18:56:27.144647+0000","last_peered":"2023-06-10T18:56:27.144647+0000","last_clean":"2023-06-10T18:56:27.144647+0000","last_became_active":"2023-06-10T18:56:18.343289+0000","last_became_peered":"2023-06-10T18:56:18.343289+0000","last_unstale":"2023-06-10T18:56:27.144647+0000","last_undegraded":"2023-06-10T18:56:27.144647+0000","last_fullsized":"2023-06-10T18:56:27.144647+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:14:05.116786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.872895+0000","last_change":"2023-06-10T18:56:18.720481+0000","last_active":"2023-06-10T18:56:26.872895+0000","last_peered":"2023-06-10T18:56:26.872895+0000","last_clean":"2023-06-10T18:56:26.872895+0000","last_became_active":"2023-06-10T18:56:18.717729+0000","last_became_peered":"2023-06-10T18:56:18.717729+0000","last_unstale":"2023-06-10T18:56:26.872895+0000","last_undegraded":"2023-06-10T18:56:26.872895+0000","last_fullsized":"2023-06-10T18:56:26.872895+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:07:34.244620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.872218+0000","last_change":"2023-06-10T18:56:18.331216+0000","last_active":"2023-06-10T18:56:26.872218+0000","last_peered":"2023-06-10T18:56:26.872218+0000","last_clean":"2023-06-10T18:56:26.872218+0000","last_became_active":"2023-06-10T18:56:18.330640+0000","last_became_peered":"2023-06-10T18:56:18.330640+0000","last_unstale":"2023-06-10T18:56:26.872218+0000","last_undegraded":"2023-06-10T18:56:26.872218+0000","last_fullsized":"2023-06-10T18:56:26.872218+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:16:43.532194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.880373+0000","last_change":"2023-06-10T18:56:18.745850+0000","last_active":"2023-06-10T18:56:26.880373+0000","last_peered":"2023-06-10T18:56:26.880373+0000","last_clean":"2023-06-10T18:56:26.880373+0000","last_became_active":"2023-06-10T18:56:18.745516+0000","last_became_peered":"2023-06-10T18:56:18.745516+0000","last_unstale":"2023-06-10T18:56:26.880373+0000","last_undegraded":"2023-06-10T18:56:26.880373+0000","last_fullsized":"2023-06-10T18:56:26.880373+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:53:56.836970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"50'3","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.144726+0000","last_change":"2023-06-10T18:56:18.341819+0000","last_active":"2023-06-10T18:56:27.144726+0000","last_peered":"2023-06-10T18:56:27.144726+0000","last_clean":"2023-06-10T18:56:27.144726+0000","last_became_active":"2023-06-10T18:56:18.341153+0000","last_became_peered":"2023-06-10T18:56:18.341153+0000","last_unstale":"2023-06-10T18:56:27.144726+0000","last_undegraded":"2023-06-10T18:56:27.144726+0000","last_fullsized":"2023-06-10T18:56:27.144726+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:13:55.771862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.871435+0000","last_change":"2023-06-10T18:56:18.718945+0000","last_active":"2023-06-10T18:56:26.871435+0000","last_peered":"2023-06-10T18:56:26.871435+0000","last_clean":"2023-06-10T18:56:26.871435+0000","last_became_active":"2023-06-10T18:56:18.717962+0000","last_became_peered":"2023-06-10T18:56:18.717962+0000","last_unstale":"2023-06-10T18:56:26.871435+0000","last_undegraded":"2023-06-10T18:56:26.871435+0000","last_fullsized":"2023-06-10T18:56:26.871435+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:04:11.756055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"50'6","reported_seq":21,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.195682+0000","last_change":"2023-06-10T18:56:18.333312+0000","last_active":"2023-06-10T18:56:27.195682+0000","last_peered":"2023-06-10T18:56:27.195682+0000","last_clean":"2023-06-10T18:56:27.195682+0000","last_became_active":"2023-06-10T18:56:18.332390+0000","last_became_peered":"2023-06-10T18:56:18.332390+0000","last_unstale":"2023-06-10T18:56:27.195682+0000","last_undegraded":"2023-06-10T18:56:27.195682+0000","last_fullsized":"2023-06-10T18:56:27.195682+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:04:57.213752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.871933+0000","last_change":"2023-06-10T18:56:18.739711+0000","last_active":"2023-06-10T18:56:26.871933+0000","last_peered":"2023-06-10T18:56:26.871933+0000","last_clean":"2023-06-10T18:56:26.871933+0000","last_became_active":"2023-06-10T18:56:18.738999+0000","last_became_peered":"2023-06-10T18:56:18.738999+0000","last_unstale":"2023-06-10T18:56:26.871933+0000","last_undegraded":"2023-06-10T18:56:26.871933+0000","last_fullsized":"2023-06-10T18:56:26.871933+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:14:23.654180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"50'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.880149+0000","last_change":"2023-06-10T18:56:18.342157+0000","last_active":"2023-06-10T18:56:26.880149+0000","last_peered":"2023-06-10T18:56:26.880149+0000","last_clean":"2023-06-10T18:56:26.880149+0000","last_became_active":"2023-06-10T18:56:18.341576+0000","last_became_peered":"2023-06-10T18:56:18.341576+0000","last_unstale":"2023-06-10T18:56:26.880149+0000","last_undegraded":"2023-06-10T18:56:26.880149+0000","last_fullsized":"2023-06-10T18:56:26.880149+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:23:29.171711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":2,"reported_epoch":52,"state":"peering","last_fresh":"2023-06-10T18:56:22.631216+0000","last_change":"2023-06-10T18:56:27.634240+0000","last_active":"2023-06-10T18:56:27.634240+0000","last_peered":"2023-06-10T18:56:22.631216+0000","last_clean":"2023-06-10T18:56:22.631216+0000","last_became_active":"2023-06-10T18:56:18.711779+0000","last_became_peered":"2023-06-10T18:56:18.711779+0000","last_unstale":"2023-06-10T18:56:22.631216+0000","last_undegraded":"2023-06-10T18:56:22.631216+0000","last_fullsized":"2023-06-10T18:56:22.631216+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.875792+0000","last_change":"2023-06-10T18:56:18.335774+0000","last_active":"2023-06-10T18:56:26.875792+0000","last_peered":"2023-06-10T18:56:26.875792+0000","last_clean":"2023-06-10T18:56:26.875792+0000","last_became_active":"2023-06-10T18:56:18.334295+0000","last_became_peered":"2023-06-10T18:56:18.334295+0000","last_unstale":"2023-06-10T18:56:26.875792+0000","last_undegraded":"2023-06-10T18:56:26.875792+0000","last_fullsized":"2023-06-10T18:56:26.875792+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:45:39.069258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.195203+0000","last_change":"2023-06-10T18:56:18.732193+0000","last_active":"2023-06-10T18:56:27.195203+0000","last_peered":"2023-06-10T18:56:27.195203+0000","last_clean":"2023-06-10T18:56:27.195203+0000","last_became_active":"2023-06-10T18:56:18.731876+0000","last_became_peered":"2023-06-10T18:56:18.731876+0000","last_unstale":"2023-06-10T18:56:27.195203+0000","last_undegraded":"2023-06-10T18:56:27.195203+0000","last_fullsized":"2023-06-10T18:56:27.195203+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:41:57.121808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.144429+0000","last_change":"2023-06-10T18:56:18.348170+0000","last_active":"2023-06-10T18:56:27.144429+0000","last_peered":"2023-06-10T18:56:27.144429+0000","last_clean":"2023-06-10T18:56:27.144429+0000","last_became_active":"2023-06-10T18:56:18.347458+0000","last_became_peered":"2023-06-10T18:56:18.347458+0000","last_unstale":"2023-06-10T18:56:27.144429+0000","last_undegraded":"2023-06-10T18:56:27.144429+0000","last_fullsized":"2023-06-10T18:56:27.144429+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:08:51.581596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.880965+0000","last_change":"2023-06-10T18:56:18.727211+0000","last_active":"2023-06-10T18:56:26.880965+0000","last_peered":"2023-06-10T18:56:26.880965+0000","last_clean":"2023-06-10T18:56:26.880965+0000","last_became_active":"2023-06-10T18:56:18.726575+0000","last_became_peered":"2023-06-10T18:56:18.726575+0000","last_unstale":"2023-06-10T18:56:26.880965+0000","last_undegraded":"2023-06-10T18:56:26.880965+0000","last_fullsized":"2023-06-10T18:56:26.880965+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:04:11.756055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"50'8","reported_seq":23,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.195340+0000","last_change":"2023-06-10T18:56:18.332240+0000","last_active":"2023-06-10T18:56:27.195340+0000","last_peered":"2023-06-10T18:56:27.195340+0000","last_clean":"2023-06-10T18:56:27.195340+0000","last_became_active":"2023-06-10T18:56:18.331781+0000","last_became_peered":"2023-06-10T18:56:18.331781+0000","last_unstale":"2023-06-10T18:56:27.195340+0000","last_undegraded":"2023-06-10T18:56:27.195340+0000","last_fullsized":"2023-06-10T18:56:27.195340+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:23:26.069557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.195018+0000","last_change":"2023-06-10T18:56:18.702816+0000","last_active":"2023-06-10T18:56:27.195018+0000","last_peered":"2023-06-10T18:56:27.195018+0000","last_clean":"2023-06-10T18:56:27.195018+0000","last_became_active":"2023-06-10T18:56:18.702527+0000","last_became_peered":"2023-06-10T18:56:18.702527+0000","last_unstale":"2023-06-10T18:56:27.195018+0000","last_undegraded":"2023-06-10T18:56:27.195018+0000","last_fullsized":"2023-06-10T18:56:27.195018+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:01:30.967639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"50'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.881337+0000","last_change":"2023-06-10T18:56:18.324631+0000","last_active":"2023-06-10T18:56:26.881337+0000","last_peered":"2023-06-10T18:56:26.881337+0000","last_clean":"2023-06-10T18:56:26.881337+0000","last_became_active":"2023-06-10T18:56:18.324243+0000","last_became_peered":"2023-06-10T18:56:18.324243+0000","last_unstale":"2023-06-10T18:56:26.881337+0000","last_undegraded":"2023-06-10T18:56:26.881337+0000","last_fullsized":"2023-06-10T18:56:26.881337+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:01:29.954138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.886746+0000","last_change":"2023-06-10T18:56:18.710557+0000","last_active":"2023-06-10T18:56:26.886746+0000","last_peered":"2023-06-10T18:56:26.886746+0000","last_clean":"2023-06-10T18:56:26.886746+0000","last_became_active":"2023-06-10T18:56:18.710238+0000","last_became_peered":"2023-06-10T18:56:18.710238+0000","last_unstale":"2023-06-10T18:56:26.886746+0000","last_undegraded":"2023-06-10T18:56:26.886746+0000","last_fullsized":"2023-06-10T18:56:26.886746+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:57:17.090045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"50'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.869232+0000","last_change":"2023-06-10T18:56:18.324362+0000","last_active":"2023-06-10T18:56:26.869232+0000","last_peered":"2023-06-10T18:56:26.869232+0000","last_clean":"2023-06-10T18:56:26.869232+0000","last_became_active":"2023-06-10T18:56:18.323943+0000","last_became_peered":"2023-06-10T18:56:18.323943+0000","last_unstale":"2023-06-10T18:56:26.869232+0000","last_undegraded":"2023-06-10T18:56:26.869232+0000","last_fullsized":"2023-06-10T18:56:26.869232+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:13:38.851442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.871058+0000","last_change":"2023-06-10T18:56:18.715476+0000","last_active":"2023-06-10T18:56:26.871058+0000","last_peered":"2023-06-10T18:56:26.871058+0000","last_clean":"2023-06-10T18:56:26.871058+0000","last_became_active":"2023-06-10T18:56:18.714697+0000","last_became_peered":"2023-06-10T18:56:18.714697+0000","last_unstale":"2023-06-10T18:56:26.871058+0000","last_undegraded":"2023-06-10T18:56:26.871058+0000","last_fullsized":"2023-06-10T18:56:26.871058+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:36:56.932324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"50'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.876240+0000","last_change":"2023-06-10T18:56:18.341065+0000","last_active":"2023-06-10T18:56:26.876240+0000","last_peered":"2023-06-10T18:56:26.876240+0000","last_clean":"2023-06-10T18:56:26.876240+0000","last_became_active":"2023-06-10T18:56:18.340242+0000","last_became_peered":"2023-06-10T18:56:18.340242+0000","last_unstale":"2023-06-10T18:56:26.876240+0000","last_undegraded":"2023-06-10T18:56:26.876240+0000","last_fullsized":"2023-06-10T18:56:26.876240+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:27:46.347276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.887392+0000","last_change":"2023-06-10T18:56:18.722679+0000","last_active":"2023-06-10T18:56:26.887392+0000","last_peered":"2023-06-10T18:56:26.887392+0000","last_clean":"2023-06-10T18:56:26.887392+0000","last_became_active":"2023-06-10T18:56:18.722389+0000","last_became_peered":"2023-06-10T18:56:18.722389+0000","last_unstale":"2023-06-10T18:56:26.887392+0000","last_undegraded":"2023-06-10T18:56:26.887392+0000","last_fullsized":"2023-06-10T18:56:26.887392+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:01:30.967639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.875808+0000","last_change":"2023-06-10T18:56:18.335157+0000","last_active":"2023-06-10T18:56:26.875808+0000","last_peered":"2023-06-10T18:56:26.875808+0000","last_clean":"2023-06-10T18:56:26.875808+0000","last_became_active":"2023-06-10T18:56:18.334417+0000","last_became_peered":"2023-06-10T18:56:18.334417+0000","last_unstale":"2023-06-10T18:56:26.875808+0000","last_undegraded":"2023-06-10T18:56:26.875808+0000","last_fullsized":"2023-06-10T18:56:26.875808+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:43:46.237306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.872091+0000","last_change":"2023-06-10T18:56:18.720351+0000","last_active":"2023-06-10T18:56:26.872091+0000","last_peered":"2023-06-10T18:56:26.872091+0000","last_clean":"2023-06-10T18:56:26.872091+0000","last_became_active":"2023-06-10T18:56:18.717962+0000","last_became_peered":"2023-06-10T18:56:18.717962+0000","last_unstale":"2023-06-10T18:56:26.872091+0000","last_undegraded":"2023-06-10T18:56:26.872091+0000","last_fullsized":"2023-06-10T18:56:26.872091+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:55:10.132650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"50'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.887432+0000","last_change":"2023-06-10T18:56:18.337149+0000","last_active":"2023-06-10T18:56:26.887432+0000","last_peered":"2023-06-10T18:56:26.887432+0000","last_clean":"2023-06-10T18:56:26.887432+0000","last_became_active":"2023-06-10T18:56:18.335525+0000","last_became_peered":"2023-06-10T18:56:18.335525+0000","last_unstale":"2023-06-10T18:56:26.887432+0000","last_undegraded":"2023-06-10T18:56:26.887432+0000","last_fullsized":"2023-06-10T18:56:26.887432+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:23:26.069557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.876152+0000","last_change":"2023-06-10T18:56:18.734899+0000","last_active":"2023-06-10T18:56:26.876152+0000","last_peered":"2023-06-10T18:56:26.876152+0000","last_clean":"2023-06-10T18:56:26.876152+0000","last_became_active":"2023-06-10T18:56:18.734152+0000","last_became_peered":"2023-06-10T18:56:18.734152+0000","last_unstale":"2023-06-10T18:56:26.876152+0000","last_undegraded":"2023-06-10T18:56:26.876152+0000","last_fullsized":"2023-06-10T18:56:26.876152+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:16:15.404759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.194661+0000","last_change":"2023-06-10T18:56:18.332341+0000","last_active":"2023-06-10T18:56:27.194661+0000","last_peered":"2023-06-10T18:56:27.194661+0000","last_clean":"2023-06-10T18:56:27.194661+0000","last_became_active":"2023-06-10T18:56:18.331836+0000","last_became_peered":"2023-06-10T18:56:18.331836+0000","last_unstale":"2023-06-10T18:56:27.194661+0000","last_undegraded":"2023-06-10T18:56:27.194661+0000","last_fullsized":"2023-06-10T18:56:27.194661+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:27:55.613483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.881243+0000","last_change":"2023-06-10T18:56:18.745846+0000","last_active":"2023-06-10T18:56:26.881243+0000","last_peered":"2023-06-10T18:56:26.881243+0000","last_clean":"2023-06-10T18:56:26.881243+0000","last_became_active":"2023-06-10T18:56:18.745527+0000","last_became_peered":"2023-06-10T18:56:18.745527+0000","last_unstale":"2023-06-10T18:56:26.881243+0000","last_undegraded":"2023-06-10T18:56:26.881243+0000","last_fullsized":"2023-06-10T18:56:26.881243+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:33:38.472734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.879935+0000","last_change":"2023-06-10T18:56:18.337764+0000","last_active":"2023-06-10T18:56:26.879935+0000","last_peered":"2023-06-10T18:56:26.879935+0000","last_clean":"2023-06-10T18:56:26.879935+0000","last_became_active":"2023-06-10T18:56:18.337390+0000","last_became_peered":"2023-06-10T18:56:18.337390+0000","last_unstale":"2023-06-10T18:56:26.879935+0000","last_undegraded":"2023-06-10T18:56:26.879935+0000","last_fullsized":"2023-06-10T18:56:26.879935+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:54:06.053571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.887362+0000","last_change":"2023-06-10T18:56:18.705770+0000","last_active":"2023-06-10T18:56:26.887362+0000","last_peered":"2023-06-10T18:56:26.887362+0000","last_clean":"2023-06-10T18:56:26.887362+0000","last_became_active":"2023-06-10T18:56:18.705487+0000","last_became_peered":"2023-06-10T18:56:18.705487+0000","last_unstale":"2023-06-10T18:56:26.887362+0000","last_undegraded":"2023-06-10T18:56:26.887362+0000","last_fullsized":"2023-06-10T18:56:26.887362+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:18:25.090460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.867631+0000","last_change":"2023-06-10T18:56:18.339683+0000","last_active":"2023-06-10T18:56:26.867631+0000","last_peered":"2023-06-10T18:56:26.867631+0000","last_clean":"2023-06-10T18:56:26.867631+0000","last_became_active":"2023-06-10T18:56:18.339076+0000","last_became_peered":"2023-06-10T18:56:18.339076+0000","last_unstale":"2023-06-10T18:56:26.867631+0000","last_undegraded":"2023-06-10T18:56:26.867631+0000","last_fullsized":"2023-06-10T18:56:26.867631+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:24:21.579841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.874936+0000","last_change":"2023-06-10T18:56:18.724347+0000","last_active":"2023-06-10T18:56:26.874936+0000","last_peered":"2023-06-10T18:56:26.874936+0000","last_clean":"2023-06-10T18:56:26.874936+0000","last_became_active":"2023-06-10T18:56:18.723327+0000","last_became_peered":"2023-06-10T18:56:18.723327+0000","last_unstale":"2023-06-10T18:56:26.874936+0000","last_undegraded":"2023-06-10T18:56:26.874936+0000","last_fullsized":"2023-06-10T18:56:26.874936+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:06:54.175628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"51'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.881525+0000","last_change":"2023-06-10T18:56:18.337157+0000","last_active":"2023-06-10T18:56:26.881525+0000","last_peered":"2023-06-10T18:56:26.881525+0000","last_clean":"2023-06-10T18:56:26.881525+0000","last_became_active":"2023-06-10T18:56:18.336768+0000","last_became_peered":"2023-06-10T18:56:18.336768+0000","last_unstale":"2023-06-10T18:56:26.881525+0000","last_undegraded":"2023-06-10T18:56:26.881525+0000","last_fullsized":"2023-06-10T18:56:26.881525+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:18:24.076958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":224,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.143607+0000","last_change":"2023-06-10T18:52:34.951528+0000","last_active":"2023-06-10T18:56:27.143607+0000","last_peered":"2023-06-10T18:56:27.143607+0000","last_clean":"2023-06-10T18:56:27.143607+0000","last_became_active":"2023-06-10T18:52:34.949099+0000","last_became_peered":"2023-06-10T18:52:34.949099+0000","last_unstale":"2023-06-10T18:56:27.143607+0000","last_undegraded":"2023-06-10T18:56:27.143607+0000","last_fullsized":"2023-06-10T18:56:27.143607+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_clean_scrub_stamp":"2023-06-10T18:52:33.633295+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:48:42.927886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":70,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.872604+0000","last_change":"2023-06-10T18:52:40.506384+0000","last_active":"2023-06-10T18:56:26.872604+0000","last_peered":"2023-06-10T18:56:26.872604+0000","last_clean":"2023-06-10T18:56:26.872604+0000","last_became_active":"2023-06-10T18:52:40.505701+0000","last_became_peered":"2023-06-10T18:52:40.505701+0000","last_unstale":"2023-06-10T18:56:26.872604+0000","last_undegraded":"2023-06-10T18:56:26.872604+0000","last_fullsized":"2023-06-10T18:56:26.872604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:48:00.502223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.887017+0000","last_change":"2023-06-10T18:56:18.714433+0000","last_active":"2023-06-10T18:56:26.887017+0000","last_peered":"2023-06-10T18:56:26.887017+0000","last_clean":"2023-06-10T18:56:26.887017+0000","last_became_active":"2023-06-10T18:56:18.714070+0000","last_became_peered":"2023-06-10T18:56:18.714070+0000","last_unstale":"2023-06-10T18:56:26.887017+0000","last_undegraded":"2023-06-10T18:56:26.887017+0000","last_fullsized":"2023-06-10T18:56:26.887017+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:16:44.545696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.144734+0000","last_change":"2023-06-10T18:56:18.341822+0000","last_active":"2023-06-10T18:56:27.144734+0000","last_peered":"2023-06-10T18:56:27.144734+0000","last_clean":"2023-06-10T18:56:27.144734+0000","last_became_active":"2023-06-10T18:56:18.341138+0000","last_became_peered":"2023-06-10T18:56:18.341138+0000","last_unstale":"2023-06-10T18:56:27.144734+0000","last_undegraded":"2023-06-10T18:56:27.144734+0000","last_fullsized":"2023-06-10T18:56:27.144734+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:19:07.044160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":68,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.144020+0000","last_change":"2023-06-10T18:52:40.512015+0000","last_active":"2023-06-10T18:56:27.144020+0000","last_peered":"2023-06-10T18:56:27.144020+0000","last_clean":"2023-06-10T18:56:27.144020+0000","last_became_active":"2023-06-10T18:52:40.511382+0000","last_became_peered":"2023-06-10T18:52:40.511382+0000","last_unstale":"2023-06-10T18:56:27.144020+0000","last_undegraded":"2023-06-10T18:56:27.144020+0000","last_fullsized":"2023-06-10T18:56:27.144020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:10:22.176800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.195451+0000","last_change":"2023-06-10T18:56:18.720642+0000","last_active":"2023-06-10T18:56:27.195451+0000","last_peered":"2023-06-10T18:56:27.195451+0000","last_clean":"2023-06-10T18:56:27.195451+0000","last_became_active":"2023-06-10T18:56:18.720385+0000","last_became_peered":"2023-06-10T18:56:18.720385+0000","last_unstale":"2023-06-10T18:56:27.195451+0000","last_undegraded":"2023-06-10T18:56:27.195451+0000","last_fullsized":"2023-06-10T18:56:27.195451+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:44:56.381072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.881015+0000","last_change":"2023-06-10T18:56:18.320760+0000","last_active":"2023-06-10T18:56:26.881015+0000","last_peered":"2023-06-10T18:56:26.881015+0000","last_clean":"2023-06-10T18:56:26.881015+0000","last_became_active":"2023-06-10T18:56:18.320373+0000","last_became_peered":"2023-06-10T18:56:18.320373+0000","last_unstale":"2023-06-10T18:56:26.881015+0000","last_undegraded":"2023-06-10T18:56:26.881015+0000","last_fullsized":"2023-06-10T18:56:26.881015+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:27:55.613483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":70,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.867695+0000","last_change":"2023-06-10T18:52:40.671725+0000","last_active":"2023-06-10T18:56:26.867695+0000","last_peered":"2023-06-10T18:56:26.867695+0000","last_clean":"2023-06-10T18:56:26.867695+0000","last_became_active":"2023-06-10T18:52:40.671442+0000","last_became_peered":"2023-06-10T18:52:40.671442+0000","last_unstale":"2023-06-10T18:56:26.867695+0000","last_undegraded":"2023-06-10T18:56:26.867695+0000","last_fullsized":"2023-06-10T18:56:26.867695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:26:09.367931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.872142+0000","last_change":"2023-06-10T18:56:18.704278+0000","last_active":"2023-06-10T18:56:26.872142+0000","last_peered":"2023-06-10T18:56:26.872142+0000","last_clean":"2023-06-10T18:56:26.872142+0000","last_became_active":"2023-06-10T18:56:18.703336+0000","last_became_peered":"2023-06-10T18:56:18.703336+0000","last_unstale":"2023-06-10T18:56:26.872142+0000","last_undegraded":"2023-06-10T18:56:26.872142+0000","last_fullsized":"2023-06-10T18:56:26.872142+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:43:45.838944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"50'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.876735+0000","last_change":"2023-06-10T18:56:18.335741+0000","last_active":"2023-06-10T18:56:26.876735+0000","last_peered":"2023-06-10T18:56:26.876735+0000","last_clean":"2023-06-10T18:56:26.876735+0000","last_became_active":"2023-06-10T18:56:18.334904+0000","last_became_peered":"2023-06-10T18:56:18.334904+0000","last_unstale":"2023-06-10T18:56:26.876735+0000","last_undegraded":"2023-06-10T18:56:26.876735+0000","last_fullsized":"2023-06-10T18:56:26.876735+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:08:18.807313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":70,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.871228+0000","last_change":"2023-06-10T18:52:40.510258+0000","last_active":"2023-06-10T18:56:26.871228+0000","last_peered":"2023-06-10T18:56:26.871228+0000","last_clean":"2023-06-10T18:56:26.871228+0000","last_became_active":"2023-06-10T18:52:40.509560+0000","last_became_peered":"2023-06-10T18:52:40.509560+0000","last_unstale":"2023-06-10T18:56:26.871228+0000","last_undegraded":"2023-06-10T18:56:26.871228+0000","last_fullsized":"2023-06-10T18:56:26.871228+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:43:32.943829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":2,"reported_epoch":52,"state":"peering","last_fresh":"2023-06-10T18:56:22.631242+0000","last_change":"2023-06-10T18:56:27.634300+0000","last_active":"2023-06-10T18:56:27.634300+0000","last_peered":"2023-06-10T18:56:22.631242+0000","last_clean":"2023-06-10T18:56:22.631242+0000","last_became_active":"2023-06-10T18:56:18.715542+0000","last_became_peered":"2023-06-10T18:56:18.715542+0000","last_unstale":"2023-06-10T18:56:22.631242+0000","last_undegraded":"2023-06-10T18:56:22.631242+0000","last_fullsized":"2023-06-10T18:56:22.631242+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.870792+0000","last_change":"2023-06-10T18:56:18.325010+0000","last_active":"2023-06-10T18:56:26.870792+0000","last_peered":"2023-06-10T18:56:26.870792+0000","last_clean":"2023-06-10T18:56:26.870792+0000","last_became_active":"2023-06-10T18:56:18.324414+0000","last_became_peered":"2023-06-10T18:56:18.324414+0000","last_unstale":"2023-06-10T18:56:26.870792+0000","last_undegraded":"2023-06-10T18:56:26.870792+0000","last_fullsized":"2023-06-10T18:56:26.870792+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:53:55.823468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":66,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.887066+0000","last_change":"2023-06-10T18:52:40.672266+0000","last_active":"2023-06-10T18:56:26.887066+0000","last_peered":"2023-06-10T18:56:26.887066+0000","last_clean":"2023-06-10T18:56:26.887066+0000","last_became_active":"2023-06-10T18:52:40.671966+0000","last_became_peered":"2023-06-10T18:52:40.671966+0000","last_unstale":"2023-06-10T18:56:26.887066+0000","last_undegraded":"2023-06-10T18:56:26.887066+0000","last_fullsized":"2023-06-10T18:56:26.887066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:29:59.663767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.195764+0000","last_change":"2023-06-10T18:56:18.703583+0000","last_active":"2023-06-10T18:56:27.195764+0000","last_peered":"2023-06-10T18:56:27.195764+0000","last_clean":"2023-06-10T18:56:27.195764+0000","last_became_active":"2023-06-10T18:56:18.703292+0000","last_became_peered":"2023-06-10T18:56:18.703292+0000","last_unstale":"2023-06-10T18:56:27.195764+0000","last_undegraded":"2023-06-10T18:56:27.195764+0000","last_fullsized":"2023-06-10T18:56:27.195764+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:37:45.597946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.872441+0000","last_change":"2023-06-10T18:56:18.331871+0000","last_active":"2023-06-10T18:56:26.872441+0000","last_peered":"2023-06-10T18:56:26.872441+0000","last_clean":"2023-06-10T18:56:26.872441+0000","last_became_active":"2023-06-10T18:56:18.331127+0000","last_became_peered":"2023-06-10T18:56:18.331127+0000","last_unstale":"2023-06-10T18:56:26.872441+0000","last_undegraded":"2023-06-10T18:56:26.872441+0000","last_fullsized":"2023-06-10T18:56:26.872441+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:56:07.925384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":68,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.144910+0000","last_change":"2023-06-10T18:52:40.671084+0000","last_active":"2023-06-10T18:56:27.144910+0000","last_peered":"2023-06-10T18:56:27.144910+0000","last_clean":"2023-06-10T18:56:27.144910+0000","last_became_active":"2023-06-10T18:52:40.670697+0000","last_became_peered":"2023-06-10T18:52:40.670697+0000","last_unstale":"2023-06-10T18:56:27.144910+0000","last_undegraded":"2023-06-10T18:56:27.144910+0000","last_fullsized":"2023-06-10T18:56:27.144910+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:26:45.209485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.880674+0000","last_change":"2023-06-10T18:56:18.724544+0000","last_active":"2023-06-10T18:56:26.880674+0000","last_peered":"2023-06-10T18:56:26.880674+0000","last_clean":"2023-06-10T18:56:26.880674+0000","last_became_active":"2023-06-10T18:56:18.724244+0000","last_became_peered":"2023-06-10T18:56:18.724244+0000","last_unstale":"2023-06-10T18:56:26.880674+0000","last_undegraded":"2023-06-10T18:56:26.880674+0000","last_fullsized":"2023-06-10T18:56:26.880674+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:17:50.531074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.195134+0000","last_change":"2023-06-10T18:56:18.332507+0000","last_active":"2023-06-10T18:56:27.195134+0000","last_peered":"2023-06-10T18:56:27.195134+0000","last_clean":"2023-06-10T18:56:27.195134+0000","last_became_active":"2023-06-10T18:56:18.331887+0000","last_became_peered":"2023-06-10T18:56:18.331887+0000","last_unstale":"2023-06-10T18:56:27.195134+0000","last_undegraded":"2023-06-10T18:56:27.195134+0000","last_fullsized":"2023-06-10T18:56:27.195134+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:13:38.791330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":66,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.887650+0000","last_change":"2023-06-10T18:52:40.514114+0000","last_active":"2023-06-10T18:56:26.887650+0000","last_peered":"2023-06-10T18:56:26.887650+0000","last_clean":"2023-06-10T18:56:26.887650+0000","last_became_active":"2023-06-10T18:52:40.513638+0000","last_became_peered":"2023-06-10T18:52:40.513638+0000","last_unstale":"2023-06-10T18:56:26.887650+0000","last_undegraded":"2023-06-10T18:56:26.887650+0000","last_fullsized":"2023-06-10T18:56:26.887650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:41:17.572105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.871355+0000","last_change":"2023-06-10T18:56:18.733094+0000","last_active":"2023-06-10T18:56:26.871355+0000","last_peered":"2023-06-10T18:56:26.871355+0000","last_clean":"2023-06-10T18:56:26.871355+0000","last_became_active":"2023-06-10T18:56:18.732442+0000","last_became_peered":"2023-06-10T18:56:18.732442+0000","last_unstale":"2023-06-10T18:56:26.871355+0000","last_undegraded":"2023-06-10T18:56:26.871355+0000","last_fullsized":"2023-06-10T18:56:26.871355+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T18:57:31.579489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.195498+0000","last_change":"2023-06-10T18:56:18.337697+0000","last_active":"2023-06-10T18:56:27.195498+0000","last_peered":"2023-06-10T18:56:27.195498+0000","last_clean":"2023-06-10T18:56:27.195498+0000","last_became_active":"2023-06-10T18:56:18.337174+0000","last_became_peered":"2023-06-10T18:56:18.337174+0000","last_unstale":"2023-06-10T18:56:27.195498+0000","last_undegraded":"2023-06-10T18:56:27.195498+0000","last_fullsized":"2023-06-10T18:56:27.195498+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:57:03.240260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":70,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.876863+0000","last_change":"2023-06-10T18:52:40.515396+0000","last_active":"2023-06-10T18:56:26.876863+0000","last_peered":"2023-06-10T18:56:26.876863+0000","last_clean":"2023-06-10T18:56:26.876863+0000","last_became_active":"2023-06-10T18:52:40.514663+0000","last_became_peered":"2023-06-10T18:52:40.514663+0000","last_unstale":"2023-06-10T18:56:26.876863+0000","last_undegraded":"2023-06-10T18:56:26.876863+0000","last_fullsized":"2023-06-10T18:56:26.876863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:57:38.444899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574898,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28128,"kb_used_data":1176,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343712,"statfs":{"total":96636764160,"available":96607961088,"internally_reserved":0,"allocated":1204224,"data_stored":851412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":0.90400000000000003,"15min":0.88200000000000001},"min":{"1min":0.73599999999999999,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.3759999999999999,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.97999999999999998},{"interface":"front","average":{"1min":1.006,"5min":0.94299999999999995,"15min":0.93000000000000005},"min":{"1min":0.81899999999999995,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.234,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":1.0349999999999999}]},{"osd":1,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92400000000000004,"15min":0.91500000000000004},"min":{"1min":0.58599999999999997,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.3089999999999999,"5min":1.377,"15min":1.377},"last":1.1419999999999999},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.92500000000000004,"15min":0.91100000000000003},"min":{"1min":0.78400000000000003,"5min":0.504,"15min":0.504},"max":{"1min":1.111,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.1080000000000001}]},{"osd":2,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.83999999999999997,"15min":0.82799999999999996},"min":{"1min":0.64100000000000001,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.214,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.89900000000000002,"15min":0.90700000000000003},"min":{"1min":0.67500000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.325,"5min":1.367,"15min":1.367},"last":1.069}]},{"osd":3,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.92100000000000004,"15min":0.89900000000000002},"min":{"1min":0.68100000000000005,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1499999999999999,"5min":1.502,"15min":1.502},"last":1.167},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.93799999999999994,"15min":0.92800000000000005},"min":{"1min":0.70399999999999996,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.2130000000000001,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.77200000000000002}]},{"osd":4,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.876,"15min":0.872},"min":{"1min":0.60199999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.141,"5min":1.639,"15min":1.639},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.96899999999999997,"15min":0.98099999999999998},"min":{"1min":0.748,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.238,"5min":1.411,"15min":1.411},"last":0.65200000000000002}]},{"osd":5,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.042,"15min":1.038},"min":{"1min":0.79800000000000004,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.2669999999999999,"5min":1.806,"15min":1.806},"last":0.93200000000000005},{"interface":"front","average":{"1min":1.081,"5min":1.05,"15min":1.052},"min":{"1min":0.93200000000000005,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.256,"5min":1.522,"15min":1.522},"last":1.0009999999999999}]},{"osd":6,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.0129999999999999,"15min":1.008},"min":{"1min":0.78500000000000003,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.3,"5min":1.718,"15min":1.718},"last":0.95599999999999996},{"interface":"front","average":{"1min":1.147,"5min":1.095,"15min":1.0900000000000001},"min":{"1min":0.96599999999999997,"5min":0.441,"15min":0.441},"max":{"1min":1.409,"5min":1.464,"15min":1.464},"last":1.224}]}]},{"osd":6,"up_from":13,"seq":55834574899,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27548,"kb_used_data":596,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344292,"statfs":{"total":96636764160,"available":96608555008,"internally_reserved":0,"allocated":610304,"data_stored":261572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.81999999999999995,"15min":0.80100000000000005},"min":{"1min":0.65800000000000003,"5min":0.502,"15min":0.502},"max":{"1min":1.0589999999999999,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.85199999999999998,"15min":0.83999999999999997},"min":{"1min":0.71799999999999997,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.0680000000000001,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":1.0920000000000001}]},{"osd":1,"last update":"Sat Jun 10 18:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.873,"15min":0.85199999999999998},"min":{"1min":0.68999999999999995,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.0549999999999999},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.879,"15min":0.85899999999999999},"min":{"1min":0.68999999999999995,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":0.90000000000000002}]},{"osd":2,"last update":"Sat Jun 10 18:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.871,"15min":0.85899999999999999},"min":{"1min":0.66000000000000003,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.1950000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.88500000000000001,"15min":0.88900000000000001},"min":{"1min":0.68000000000000005,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.109,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":1.177}]},{"osd":3,"last update":"Sat Jun 10 18:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.874,"15min":0.84799999999999998},"min":{"1min":0.64900000000000002,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.169,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.95999999999999996},{"interface":"front","average":{"1min":1.0209999999999999,"5min":0.997,"15min":0.995},"min":{"1min":0.72799999999999998,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":1.2889999999999999}]},{"osd":4,"last update":"Sat Jun 10 18:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.93799999999999994,"15min":0.95399999999999996},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.1259999999999999,"5min":1.198,"15min":1.198},"last":1.002},{"interface":"front","average":{"1min":0.95699999999999996,"5min":1.0049999999999999,"15min":1.0189999999999999},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.1879999999999999,"5min":1.222,"15min":1.222},"last":1.212}]},{"osd":5,"last update":"Sat Jun 10 18:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.94999999999999996,"15min":0.96199999999999997},"min":{"1min":0.68700000000000006,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.0720000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.86099999999999999},{"interface":"front","average":{"1min":1.02,"5min":1.0249999999999999,"15min":1.026},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":1.1399999999999999}]},{"osd":7,"last update":"Sat Jun 10 18:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":1.0389999999999999,"15min":1.0489999999999999},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.1739999999999999,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.022,"5min":1.0569999999999999,"15min":1.0649999999999999},"min":{"1min":0.82199999999999995,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.2010000000000001,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":1.2569999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574899,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27552,"kb_used_data":600,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":614400,"data_stored":267298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.84199999999999997,"15min":0.82999999999999996},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.139,"5min":1.175,"15min":1.175},"last":1.083},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.91800000000000004,"15min":0.94199999999999995},"min":{"1min":0.63800000000000001,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.246,"5min":1.637,"15min":1.637},"last":0.67700000000000005}]},{"osd":1,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.91000000000000003,"15min":0.91800000000000004},"min":{"1min":0.67800000000000005,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.1559999999999999,"5min":1.335,"15min":1.335},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.91700000000000004,"15min":0.92100000000000004},"min":{"1min":0.72699999999999998,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.208,"5min":1.78,"15min":1.78},"last":0.80700000000000005}]},{"osd":2,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.65000000000000002,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.1000000000000001,"5min":1.446,"15min":1.446},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.91600000000000004,"15min":0.91200000000000003},"min":{"1min":0.71399999999999997,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.1379999999999999,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.92300000000000004}]},{"osd":3,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93899999999999995,"15min":0.94499999999999995},"min":{"1min":0.68600000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.206,"5min":1.484,"15min":1.484},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.97199999999999998,"5min":1.0249999999999999,"15min":1.0429999999999999},"min":{"1min":0.77100000000000002,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.2969999999999999,"5min":1.337,"15min":1.337},"last":0.84599999999999997}]},{"osd":4,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.96999999999999997,"15min":0.98899999999999999},"min":{"1min":0.70299999999999996,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.2669999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.94599999999999995,"5min":1.034,"15min":1.0640000000000001},"min":{"1min":0.66500000000000004,"5min":0.629,"15min":0.629},"max":{"1min":1.26,"5min":1.575,"15min":1.575},"last":1.2010000000000001}]},{"osd":6,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":1.038,"15min":1.0780000000000001},"min":{"1min":0.66000000000000003,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.2010000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.0609999999999999,"15min":1.079},"min":{"1min":0.69799999999999995,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.2270000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.73699999999999999}]},{"osd":7,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.139,"15min":1.1739999999999999},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.226,"5min":1.873,"15min":1.873},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.155,"15min":1.181},"min":{"1min":0.80000000000000004,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.3680000000000001,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.121}]}]},{"osd":4,"up_from":13,"seq":55834574898,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27556,"kb_used_data":604,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344284,"statfs":{"total":96636764160,"available":96608546816,"internally_reserved":0,"allocated":618496,"data_stored":267880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.76700000000000002,"15min":0.745},"min":{"1min":0.53400000000000003,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.1599999999999999,"5min":1.2,"15min":1.2},"last":0.629},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.88200000000000001,"15min":0.88},"min":{"1min":0.63800000000000001,"5min":0.504,"15min":0.504},"max":{"1min":1.4970000000000001,"5min":1.73,"15min":1.73},"last":1.034}]},{"osd":1,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.95199999999999996,"15min":0.95499999999999996},"min":{"1min":0.68200000000000005,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.84599999999999997,"15min":0.83699999999999997},"min":{"1min":0.66600000000000004,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.024,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.097}]},{"osd":2,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.879,"15min":0.875},"min":{"1min":0.70799999999999996,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":0.85499999999999998},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1,"15min":1.004},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":1.121}]},{"osd":3,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.89900000000000002,"15min":0.88},"min":{"1min":0.80900000000000005,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.1679999999999999,"5min":1.22,"15min":1.22},"last":0.73999999999999999},{"interface":"front","average":{"1min":1.006,"5min":0.95799999999999996,"15min":0.95099999999999996},"min":{"1min":0.80100000000000005,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.4490000000000001,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.069}]},{"osd":5,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.96799999999999997,"15min":0.99399999999999999},"min":{"1min":0.67800000000000005,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.069,"5min":1.663,"15min":1.663},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.95399999999999996,"15min":0.98199999999999998},"min":{"1min":0.58099999999999996,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.111,"5min":1.353,"15min":1.353},"last":1.179}]},{"osd":6,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":1.002,"15min":1.028},"min":{"1min":0.63100000000000001,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.5720000000000001,"5min":2.2639999999999998,"15min":2.2639999999999998},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0720000000000001,"15min":1.0760000000000001},"min":{"1min":0.81200000000000006,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":1.1970000000000001}]},{"osd":7,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.98399999999999999,"15min":0.99399999999999999},"min":{"1min":0.68899999999999995,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.1950000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.012,"5min":1.0529999999999999,"15min":1.071},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.2390000000000001,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":1.1539999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574897,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31660,"kb_used_data":612,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340180,"statfs":{"total":96636764160,"available":96604344320,"internally_reserved":0,"allocated":626688,"data_stored":267865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.57799999999999996,"15min":0.57199999999999995},"min":{"1min":0.51400000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.63500000000000001,"15min":0.63100000000000001},"min":{"1min":0.56000000000000005,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.57599999999999996}]},{"osd":1,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.64400000000000002,"15min":0.622},"min":{"1min":0.51000000000000001,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":1.0860000000000001},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.72099999999999997,"15min":0.71599999999999997},"min":{"1min":0.56100000000000005,"5min":0.318,"15min":0.318},"max":{"1min":0.98899999999999999,"5min":1.411,"15min":1.411},"last":1.0409999999999999}]},{"osd":2,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.76100000000000001,"15min":0.75},"min":{"1min":0.63500000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.167,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":1.3759999999999999},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.75900000000000001,"15min":0.74199999999999999},"min":{"1min":0.65200000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.1970000000000001,"5min":1.264,"15min":1.264},"last":0.624}]},{"osd":4,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96099999999999997,"15min":0.96899999999999997},"min":{"1min":0.79800000000000004,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.3089999999999999,"5min":1.488,"15min":1.488},"last":1.3360000000000001},{"interface":"front","average":{"1min":1.052,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.82099999999999995,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.345,"5min":1.458,"15min":1.458},"last":0.93100000000000005}]},{"osd":5,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.0369999999999999,"15min":1.0589999999999999},"min":{"1min":0.80400000000000005,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.268,"5min":2.024,"15min":2.024},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.101,"5min":1.026,"15min":1.014},"min":{"1min":0.83899999999999997,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.29,"5min":1.724,"15min":1.724},"last":1.2170000000000001}]},{"osd":6,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.0489999999999999,"15min":1.0469999999999999},"min":{"1min":0.92400000000000004,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.3300000000000001,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.071,"5min":1.0589999999999999,"15min":1.0720000000000001},"min":{"1min":0.90700000000000003,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.302,"5min":1.78,"15min":1.78},"last":1.1399999999999999}]},{"osd":7,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.101,"15min":1.1279999999999999},"min":{"1min":0.82799999999999996,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.3959999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.212,"5min":1.089,"15min":1.0740000000000001},"min":{"1min":1.0049999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.468,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":1.5429999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574898,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31660,"kb_used_data":612,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340180,"statfs":{"total":96636764160,"available":96604344320,"internally_reserved":0,"allocated":626688,"data_stored":268862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.60099999999999998,"15min":0.58799999999999997},"min":{"1min":0.498,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.97799999999999998,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.50800000000000001,"5min":0.378,"15min":0.378},"max":{"1min":1.024,"5min":1.224,"15min":1.224},"last":0.68600000000000005}]},{"osd":1,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.65000000000000002,"15min":0.64600000000000002},"min":{"1min":0.53400000000000003,"5min":0.307,"15min":0.307},"max":{"1min":0.89500000000000002,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.72299999999999998,"15min":0.68999999999999995},"min":{"1min":0.64700000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.89100000000000001}]},{"osd":3,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.73599999999999999,"15min":0.70599999999999996},"min":{"1min":0.64900000000000002,"5min":0.377,"15min":0.377},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.749,"15min":0.746},"min":{"1min":0.64700000000000002,"5min":0.252,"15min":0.252},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.86199999999999999}]},{"osd":4,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.91900000000000004,"15min":0.91500000000000004},"min":{"1min":0.81000000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.097,"5min":1.0349999999999999,"15min":1.038},"min":{"1min":0.88600000000000001,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.476,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":1.0129999999999999}]},{"osd":5,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.016,"15min":1.016},"min":{"1min":0.82699999999999996,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.379,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":1.2330000000000001},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.002,"15min":0.97799999999999998},"min":{"1min":0.77100000000000002,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.377,"5min":1.667,"15min":1.667},"last":0.78200000000000003}]},{"osd":6,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.0429999999999999,"15min":1.0229999999999999},"min":{"1min":0.84299999999999997,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.3049999999999999,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.92900000000000005},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.034,"15min":1.032},"min":{"1min":0.89400000000000002,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.4299999999999999,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":1.1120000000000001}]},{"osd":7,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.099,"15min":1.099},"min":{"1min":0.82399999999999995,"5min":0.62,"15min":0.62},"max":{"1min":1.4339999999999999,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.153,"5min":1.0980000000000001,"15min":1.0760000000000001},"min":{"1min":0.95499999999999996,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.4239999999999999,"5min":1.752,"15min":1.752},"last":0.98899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574900,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31640,"kb_used_data":592,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340200,"statfs":{"total":96636764160,"available":96604364800,"internally_reserved":0,"allocated":606208,"data_stored":260061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.67100000000000004,"15min":0.66100000000000003},"min":{"1min":0.47999999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.71999999999999997,"15min":0.68600000000000005},"min":{"1min":0.63400000000000001,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.0369999999999999,"5min":1.694,"15min":1.694},"last":0.56799999999999995}]},{"osd":2,"last update":"Sat Jun 10 18:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.64400000000000002,"15min":0.623},"min":{"1min":0.53500000000000003,"5min":0.249,"15min":0.249},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.877,"5min":0.70199999999999996,"15min":0.65800000000000003},"min":{"1min":0.65600000000000003,"5min":0.315,"15min":0.315},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":0.65500000000000003}]},{"osd":3,"last update":"Sat Jun 10 18:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.77800000000000002,"15min":0.745},"min":{"1min":0.65900000000000003,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.76100000000000001,"15min":0.749},"min":{"1min":0.58499999999999996,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.1100000000000001,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":0.622}]},{"osd":4,"last update":"Sat Jun 10 18:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.87,"15min":0.83599999999999997},"min":{"1min":0.73399999999999999,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":1.087,"5min":1.1160000000000001,"15min":1.079},"min":{"1min":0.78500000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.5449999999999999,"5min":5.8209999999999997,"15min":5.8209999999999997},"last":0.91000000000000003}]},{"osd":5,"last update":"Sat Jun 10 18:55:44 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.032,"15min":1.028},"min":{"1min":0.75800000000000001,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.4550000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":0.879},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0129999999999999,"15min":0.97099999999999997},"min":{"1min":0.754,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.3819999999999999,"5min":3.089,"15min":3.089},"last":0.72299999999999998}]},{"osd":6,"last update":"Sat Jun 10 18:55:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.105,"15min":1.0309999999999999},"min":{"1min":0.75900000000000001,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.5249999999999999,"5min":7.2599999999999998,"15min":7.2599999999999998},"last":0.77500000000000002},{"interface":"front","average":{"1min":1.081,"5min":1.107,"15min":1.0309999999999999},"min":{"1min":0.80800000000000005,"5min":0.622,"15min":0.622},"max":{"1min":1.591,"5min":9.0069999999999997,"15min":9.0069999999999997},"last":0.85899999999999999}]},{"osd":7,"last update":"Sat Jun 10 18:55:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.0980000000000001,"15min":1.083},"min":{"1min":0.89300000000000002,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.6879999999999999,"5min":2.105,"15min":2.105},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.085,"15min":1.0669999999999999},"min":{"1min":0.90200000000000002,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.573,"5min":2.2570000000000001,"15min":2.2570000000000001},"last":0.73999999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574899,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32232,"kb_used_data":1184,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339608,"statfs":{"total":96636764160,"available":96603758592,"internally_reserved":0,"allocated":1212416,"data_stored":856703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.61299999999999999,"15min":0.59899999999999998},"min":{"1min":0.51000000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.77200000000000002,"15min":0.746},"min":{"1min":0.70899999999999996,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.0469999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.83899999999999997}]},{"osd":2,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.71099999999999997,"15min":0.69799999999999995},"min":{"1min":0.51900000000000002,"5min":0.313,"15min":0.313},"max":{"1min":1.0269999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.64600000000000002,"15min":0.63},"min":{"1min":0.55700000000000005,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.96799999999999997,"5min":1.371,"15min":1.371},"last":0.622}]},{"osd":3,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.68200000000000005,"15min":0.67000000000000004},"min":{"1min":0.55800000000000005,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.1930000000000001,"5min":1.226,"15min":1.226},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.82899999999999996,"15min":0.81000000000000005},"min":{"1min":0.65800000000000003,"5min":0.375,"15min":0.375},"max":{"1min":1.262,"5min":1.829,"15min":1.829},"last":0.76200000000000001}]},{"osd":4,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.90000000000000002,"15min":0.88900000000000001},"min":{"1min":0.75600000000000001,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.1579999999999999,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.0369999999999999,"15min":1.034},"min":{"1min":0.86099999999999999,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.228,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":0.97199999999999998}]},{"osd":5,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.96099999999999997,"15min":0.95799999999999996},"min":{"1min":0.67300000000000004,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.351,"5min":1.694,"15min":1.694},"last":1.1399999999999999},{"interface":"front","average":{"1min":0.99099999999999999,"5min":1,"15min":0.998},"min":{"1min":0.72999999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.1870000000000001,"5min":1.75,"15min":1.75},"last":1.2789999999999999}]},{"osd":6,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.0700000000000001,"15min":1.056},"min":{"1min":0.93899999999999995,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.331,"5min":2.04,"15min":2.04},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.0409999999999999,"5min":0.996,"15min":0.997},"min":{"1min":0.76100000000000001,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.444,"5min":1.883,"15min":1.883},"last":1.3280000000000001}]},{"osd":7,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.0369999999999999,"15min":1.0329999999999999},"min":{"1min":0.77200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.397,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.077,"5min":1.056,"15min":1.05},"min":{"1min":0.93200000000000005,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.298,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.2170000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-10T18:56:31.815 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-10T18:56:31.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:31.947+0000 7f4e0d1ba640 1 Processor -- start 2023-06-10T18:56:31.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:31.947+0000 7f4e0d1ba640 1 -- start start 2023-06-10T18:56:31.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:31.947+0000 7f4e0d1ba640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4e080b24c0 0x7f4e080c2c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:31.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:31.947+0000 7f4e0d1ba640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e081642c0 0x7f4e080c31a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:31.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:31.947+0000 7f4e0d1ba640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e0806c060 con 0x7f4e0815d5d0 2023-06-10T18:56:31.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:31.947+0000 7f4e0d1ba640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e081637e0 con 0x7f4e080b24c0 2023-06-10T18:56:31.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:31.947+0000 7f4e0d1ba640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e08163ac0 con 0x7f4e081642c0 2023-06-10T18:56:31.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:31.947+0000 7f4e0659c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4e080b24c0 0x7f4e080c2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:31.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:31.947+0000 7f4e0659c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4e080b24c0 0x7f4e080c2c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53030/0 (socket says 172.21.15.53:53030) 2023-06-10T18:56:31.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:31.947+0000 7f4e0659c640 1 -- 172.21.15.53:0/3410817043 learned_addr learned my addr 172.21.15.53:0/3410817043 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:31.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:31.947+0000 7f4e0759e640 1 --2- 172.21.15.53:0/3410817043 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e081642c0 0x7f4e080c31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:31.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:31.947+0000 7f4e0659c640 1 -- 172.21.15.53:0/3410817043 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e081642c0 msgr2=0x7f4e080c31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:31.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:31.947+0000 7f4e0659c640 1 --2- 172.21.15.53:0/3410817043 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e081642c0 0x7f4e080c31a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:31.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:31.947+0000 7f4e0659c640 1 -- 172.21.15.53:0/3410817043 >> v1:172.21.15.117:6789/0 conn(0x7f4e0815d5d0 legacy=0x7f4e0806b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:31.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:31.947+0000 7f4e0659c640 1 -- 172.21.15.53:0/3410817043 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e08163da0 con 0x7f4e080b24c0 2023-06-10T18:56:31.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:31.951+0000 7f4e0659c640 1 --2- 172.21.15.53:0/3410817043 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e080b24c0 0x7f4e080c2c60 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f4df0009870 tx=0x7f4df001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c8193300bc887f4 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:31.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:31.951+0000 7f4e05d9b640 1 -- 172.21.15.53:0/3410817043 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df00ab600 con 0x7f4e080b24c0 2023-06-10T18:56:31.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:31.951+0000 7f4e05d9b640 1 -- 172.21.15.53:0/3410817043 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4df00a7050 con 0x7f4e080b24c0 2023-06-10T18:56:31.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:31.951+0000 7f4e05d9b640 1 -- 172.21.15.53:0/3410817043 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df00ab980 con 0x7f4e080b24c0 2023-06-10T18:56:31.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:31.951+0000 7f4e0d1ba640 1 -- 172.21.15.53:0/3410817043 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e080b24c0 msgr2=0x7f4e080c2c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:31.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:31.951+0000 7f4e0d1ba640 1 --2- 172.21.15.53:0/3410817043 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e080b24c0 0x7f4e080c2c60 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f4df0009870 tx=0x7f4df001c420 comp rx=0 tx=0).stop 2023-06-10T18:56:31.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:31.951+0000 7f4e0d1ba640 1 -- 172.21.15.53:0/3410817043 shutdown_connections 2023-06-10T18:56:31.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:31.951+0000 7f4e0d1ba640 1 --2- 172.21.15.53:0/3410817043 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e081642c0 0x7f4e080c31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:31.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:31.951+0000 7f4e0d1ba640 1 --2- 172.21.15.53:0/3410817043 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e080b24c0 0x7f4e080c2c60 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:31.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:31.951+0000 7f4e0d1ba640 1 -- 172.21.15.53:0/3410817043 >> 172.21.15.53:0/3410817043 conn(0x7f4e0806a090 msgr2=0x7f4e0806d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:31.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:31.951+0000 7f4e0d1ba640 1 -- 172.21.15.53:0/3410817043 shutdown_connections 2023-06-10T18:56:31.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:31.951+0000 7f4e0d1ba640 1 -- 172.21.15.53:0/3410817043 wait complete. 2023-06-10T18:56:31.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:31.955+0000 7f4e0d1ba640 1 Processor -- start 2023-06-10T18:56:31.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:31.955+0000 7f4e0d1ba640 1 -- start start 2023-06-10T18:56:31.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:31.955+0000 7f4e0d1ba640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e080b24c0 0x7f4e081534a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:31.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:31.955+0000 7f4e0d1ba640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e0815d5d0 0x7f4e0815bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:31.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:31.955+0000 7f4e0d1ba640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e081642c0 0x7f4e0815f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:31.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:31.955+0000 7f4e0d1ba640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e0815eb10 con 0x7f4e081642c0 2023-06-10T18:56:31.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:31.955+0000 7f4e0d1ba640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e0815e680 con 0x7f4e080b24c0 2023-06-10T18:56:31.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:31.955+0000 7f4e0d1ba640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e0815dd50 con 0x7f4e0815d5d0 2023-06-10T18:56:31.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:31.955+0000 7f4e0759e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e081642c0 0x7f4e0815f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:31.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:31.955+0000 7f4e0759e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e081642c0 0x7f4e0815f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53032/0 (socket says 172.21.15.53:53032) 2023-06-10T18:56:31.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:31.955+0000 7f4e0759e640 1 -- 172.21.15.53:0/838046201 learned_addr learned my addr 172.21.15.53:0/838046201 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:31.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:31.955+0000 7f4e06d9d640 1 --2- 172.21.15.53:0/838046201 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e080b24c0 0x7f4e081534a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:31.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:31.955+0000 7f4e0759e640 1 -- 172.21.15.53:0/838046201 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e0815d5d0 msgr2=0x7f4e0815bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:31.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:31.955+0000 7f4e0759e640 1 --2- 172.21.15.53:0/838046201 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e0815d5d0 0x7f4e0815bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:31.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:31.955+0000 7f4e0759e640 1 -- 172.21.15.53:0/838046201 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e080b24c0 msgr2=0x7f4e081534a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:31.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:31.955+0000 7f4e0759e640 1 --2- 172.21.15.53:0/838046201 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e080b24c0 0x7f4e081534a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:31.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:31.955+0000 7f4e0759e640 1 -- 172.21.15.53:0/838046201 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4df00094d0 con 0x7f4e081642c0 2023-06-10T18:56:31.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:31.955+0000 7f4e0759e640 1 --2- 172.21.15.53:0/838046201 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e081642c0 0x7f4e0815f060 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f4e0000e820 tx=0x7f4e0000ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:31.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:31.955+0000 7f4dff7fe640 1 -- 172.21.15.53:0/838046201 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e00009530 con 0x7f4e081642c0 2023-06-10T18:56:31.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:31.955+0000 7f4dff7fe640 1 -- 172.21.15.53:0/838046201 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e0000eed0 con 0x7f4e081642c0 2023-06-10T18:56:31.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:31.955+0000 7f4e0d1ba640 1 -- 172.21.15.53:0/838046201 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e0815e030 con 0x7f4e081642c0 2023-06-10T18:56:31.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:31.955+0000 7f4dff7fe640 1 -- 172.21.15.53:0/838046201 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0000cb00 con 0x7f4e081642c0 2023-06-10T18:56:31.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:31.955+0000 7f4e0d1ba640 1 -- 172.21.15.53:0/838046201 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e08155470 con 0x7f4e081642c0 2023-06-10T18:56:31.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:31.955+0000 7f4e0d1ba640 1 -- 172.21.15.53:0/838046201 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e0804d790 con 0x7f4e081642c0 2023-06-10T18:56:31.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:31.955+0000 7f4dff7fe640 1 -- 172.21.15.53:0/838046201 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4e0000cc80 con 0x7f4e081642c0 2023-06-10T18:56:31.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:31.959+0000 7f4dff7fe640 1 --2- 172.21.15.53:0/838046201 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4de8066280 0x7f4de8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:31.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:31.959+0000 7f4dff7fe640 1 -- 172.21.15.53:0/838046201 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f4e00083da0 con 0x7f4e081642c0 2023-06-10T18:56:31.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:31.959+0000 7f4e06d9d640 1 --2- 172.21.15.53:0/838046201 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4de8066280 0x7f4de8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:31.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:31.959+0000 7f4e06d9d640 1 --2- 172.21.15.53:0/838046201 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4de8066280 0x7f4de8068730 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f4df80012f0 tx=0x7f4df8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:31.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:31.963+0000 7f4dff7fe640 1 -- 172.21.15.53:0/838046201 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4e00051270 con 0x7f4e081642c0 2023-06-10T18:56:32.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.111+0000 7f4e0d1ba640 1 -- 172.21.15.53:0/838046201 --> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4e0815e4e0 con 0x7f4de8066280 2023-06-10T18:56:32.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.135+0000 7f4dff7fe640 1 -- 172.21.15.53:0/838046201 <== mgr.4105 v2:172.21.15.117:6832/3061986771 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+309188 (secure 0 0 0) 0x7f4df80015b0 con 0x7f4de8066280 2023-06-10T18:56:32.142 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:56:32.145 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-06-10T18:56:32.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.139+0000 7f4e0d1ba640 1 -- 172.21.15.53:0/838046201 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4de8066280 msgr2=0x7f4de8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:32.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.139+0000 7f4e0d1ba640 1 --2- 172.21.15.53:0/838046201 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4de8066280 0x7f4de8068730 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f4df80012f0 tx=0x7f4df8009040 comp rx=0 tx=0).stop 2023-06-10T18:56:32.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.139+0000 7f4e0d1ba640 1 -- 172.21.15.53:0/838046201 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e081642c0 msgr2=0x7f4e0815f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:32.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.139+0000 7f4e0d1ba640 1 --2- 172.21.15.53:0/838046201 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e081642c0 0x7f4e0815f060 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f4e0000e820 tx=0x7f4e0000ece0 comp rx=0 tx=0).stop 2023-06-10T18:56:32.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.139+0000 7f4e0d1ba640 1 -- 172.21.15.53:0/838046201 shutdown_connections 2023-06-10T18:56:32.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.139+0000 7f4e0d1ba640 1 --2- 172.21.15.53:0/838046201 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4de8066280 0x7f4de8068730 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:32.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.139+0000 7f4e0d1ba640 1 --2- 172.21.15.53:0/838046201 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e081642c0 0x7f4e0815f060 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:32.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.139+0000 7f4e0d1ba640 1 --2- 172.21.15.53:0/838046201 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e0815d5d0 0x7f4e0815bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:32.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.139+0000 7f4e0d1ba640 1 --2- 172.21.15.53:0/838046201 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e080b24c0 0x7f4e081534a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:32.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.139+0000 7f4e0d1ba640 1 -- 172.21.15.53:0/838046201 >> 172.21.15.53:0/838046201 conn(0x7f4e0806a090 msgr2=0x7f4e080af750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:32.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.139+0000 7f4e0d1ba640 1 -- 172.21.15.53:0/838046201 shutdown_connections 2023-06-10T18:56:32.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.139+0000 7f4e0d1ba640 1 -- 172.21.15.53:0/838046201 wait complete. 2023-06-10T18:56:32.163 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":166,"stamp":"2023-06-10T18:56:31.642205+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237976,"kb_used_data":5976,"kb_used_omap":0,"kb_used_meta":231936,"kb_avail":754736744,"statfs":{"total":773094113280,"available":772850425856,"internally_reserved":0,"allocated":6119424,"data_stored":3301653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":237502464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.003448"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.887321+0000","last_change":"2023-06-10T18:56:18.723557+0000","last_active":"2023-06-10T18:56:26.887321+0000","last_peered":"2023-06-10T18:56:26.887321+0000","last_clean":"2023-06-10T18:56:26.887321+0000","last_became_active":"2023-06-10T18:56:18.723169+0000","last_became_peered":"2023-06-10T18:56:18.723169+0000","last_unstale":"2023-06-10T18:56:26.887321+0000","last_undegraded":"2023-06-10T18:56:26.887321+0000","last_fullsized":"2023-06-10T18:56:26.887321+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:05:32.467816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.144646+0000","last_change":"2023-06-10T18:56:18.739659+0000","last_active":"2023-06-10T18:56:27.144646+0000","last_peered":"2023-06-10T18:56:27.144646+0000","last_clean":"2023-06-10T18:56:27.144646+0000","last_became_active":"2023-06-10T18:56:18.738930+0000","last_became_peered":"2023-06-10T18:56:18.738930+0000","last_unstale":"2023-06-10T18:56:27.144646+0000","last_undegraded":"2023-06-10T18:56:27.144646+0000","last_fullsized":"2023-06-10T18:56:27.144646+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:56:20.150212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.882137+0000","last_change":"2023-06-10T18:56:18.715713+0000","last_active":"2023-06-10T18:56:26.882137+0000","last_peered":"2023-06-10T18:56:26.882137+0000","last_clean":"2023-06-10T18:56:26.882137+0000","last_became_active":"2023-06-10T18:56:18.715403+0000","last_became_peered":"2023-06-10T18:56:18.715403+0000","last_unstale":"2023-06-10T18:56:26.882137+0000","last_undegraded":"2023-06-10T18:56:26.882137+0000","last_fullsized":"2023-06-10T18:56:26.882137+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:13:39.804832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.144321+0000","last_change":"2023-06-10T18:56:18.742396+0000","last_active":"2023-06-10T18:56:27.144321+0000","last_peered":"2023-06-10T18:56:27.144321+0000","last_clean":"2023-06-10T18:56:27.144321+0000","last_became_active":"2023-06-10T18:56:18.741689+0000","last_became_peered":"2023-06-10T18:56:18.741689+0000","last_unstale":"2023-06-10T18:56:27.144321+0000","last_undegraded":"2023-06-10T18:56:27.144321+0000","last_fullsized":"2023-06-10T18:56:27.144321+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:15:14.281447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.871175+0000","last_change":"2023-06-10T18:56:18.733830+0000","last_active":"2023-06-10T18:56:26.871175+0000","last_peered":"2023-06-10T18:56:26.871175+0000","last_clean":"2023-06-10T18:56:26.871175+0000","last_became_active":"2023-06-10T18:56:18.732968+0000","last_became_peered":"2023-06-10T18:56:18.732968+0000","last_unstale":"2023-06-10T18:56:26.871175+0000","last_undegraded":"2023-06-10T18:56:26.871175+0000","last_fullsized":"2023-06-10T18:56:26.871175+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:17:50.531074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.886873+0000","last_change":"2023-06-10T18:56:18.733304+0000","last_active":"2023-06-10T18:56:26.886873+0000","last_peered":"2023-06-10T18:56:26.886873+0000","last_clean":"2023-06-10T18:56:26.886873+0000","last_became_active":"2023-06-10T18:56:18.733010+0000","last_became_peered":"2023-06-10T18:56:18.733010+0000","last_unstale":"2023-06-10T18:56:26.886873+0000","last_undegraded":"2023-06-10T18:56:26.886873+0000","last_fullsized":"2023-06-10T18:56:26.886873+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:04:11.756055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.879556+0000","last_change":"2023-06-10T18:56:18.715925+0000","last_active":"2023-06-10T18:56:26.879556+0000","last_peered":"2023-06-10T18:56:26.879556+0000","last_clean":"2023-06-10T18:56:26.879556+0000","last_became_active":"2023-06-10T18:56:18.715163+0000","last_became_peered":"2023-06-10T18:56:18.715163+0000","last_unstale":"2023-06-10T18:56:26.879556+0000","last_undegraded":"2023-06-10T18:56:26.879556+0000","last_fullsized":"2023-06-10T18:56:26.879556+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:07:15.569502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.194669+0000","last_change":"2023-06-10T18:56:18.710693+0000","last_active":"2023-06-10T18:56:27.194669+0000","last_peered":"2023-06-10T18:56:27.194669+0000","last_clean":"2023-06-10T18:56:27.194669+0000","last_became_active":"2023-06-10T18:56:18.710420+0000","last_became_peered":"2023-06-10T18:56:18.710420+0000","last_unstale":"2023-06-10T18:56:27.194669+0000","last_undegraded":"2023-06-10T18:56:27.194669+0000","last_fullsized":"2023-06-10T18:56:27.194669+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:04:11.756055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.195404+0000","last_change":"2023-06-10T18:56:18.711205+0000","last_active":"2023-06-10T18:56:27.195404+0000","last_peered":"2023-06-10T18:56:27.195404+0000","last_clean":"2023-06-10T18:56:27.195404+0000","last_became_active":"2023-06-10T18:56:18.711011+0000","last_became_peered":"2023-06-10T18:56:18.711011+0000","last_unstale":"2023-06-10T18:56:27.195404+0000","last_undegraded":"2023-06-10T18:56:27.195404+0000","last_fullsized":"2023-06-10T18:56:27.195404+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:52:30.517410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.887403+0000","last_change":"2023-06-10T18:56:18.731703+0000","last_active":"2023-06-10T18:56:26.887403+0000","last_peered":"2023-06-10T18:56:26.887403+0000","last_clean":"2023-06-10T18:56:26.887403+0000","last_became_active":"2023-06-10T18:56:18.731407+0000","last_became_peered":"2023-06-10T18:56:18.731407+0000","last_unstale":"2023-06-10T18:56:26.887403+0000","last_undegraded":"2023-06-10T18:56:26.887403+0000","last_fullsized":"2023-06-10T18:56:26.887403+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:13:39.804832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.868234+0000","last_change":"2023-06-10T18:56:18.739026+0000","last_active":"2023-06-10T18:56:26.868234+0000","last_peered":"2023-06-10T18:56:26.868234+0000","last_clean":"2023-06-10T18:56:26.868234+0000","last_became_active":"2023-06-10T18:56:18.738748+0000","last_became_peered":"2023-06-10T18:56:18.738748+0000","last_unstale":"2023-06-10T18:56:26.868234+0000","last_undegraded":"2023-06-10T18:56:26.868234+0000","last_fullsized":"2023-06-10T18:56:26.868234+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:11:27.241616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.195269+0000","last_change":"2023-06-10T18:56:18.711319+0000","last_active":"2023-06-10T18:56:27.195269+0000","last_peered":"2023-06-10T18:56:27.195269+0000","last_clean":"2023-06-10T18:56:27.195269+0000","last_became_active":"2023-06-10T18:56:18.711043+0000","last_became_peered":"2023-06-10T18:56:18.711043+0000","last_unstale":"2023-06-10T18:56:27.195269+0000","last_undegraded":"2023-06-10T18:56:27.195269+0000","last_fullsized":"2023-06-10T18:56:27.195269+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:05:32.467816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.886977+0000","last_change":"2023-06-10T18:56:18.735130+0000","last_active":"2023-06-10T18:56:26.886977+0000","last_peered":"2023-06-10T18:56:26.886977+0000","last_clean":"2023-06-10T18:56:26.886977+0000","last_became_active":"2023-06-10T18:56:18.734873+0000","last_became_peered":"2023-06-10T18:56:18.734873+0000","last_unstale":"2023-06-10T18:56:26.886977+0000","last_undegraded":"2023-06-10T18:56:26.886977+0000","last_fullsized":"2023-06-10T18:56:26.886977+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:27:56.626985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.879977+0000","last_change":"2023-06-10T18:56:18.718525+0000","last_active":"2023-06-10T18:56:26.879977+0000","last_peered":"2023-06-10T18:56:26.879977+0000","last_clean":"2023-06-10T18:56:26.879977+0000","last_became_active":"2023-06-10T18:56:18.718169+0000","last_became_peered":"2023-06-10T18:56:18.718169+0000","last_unstale":"2023-06-10T18:56:26.879977+0000","last_undegraded":"2023-06-10T18:56:26.879977+0000","last_fullsized":"2023-06-10T18:56:26.879977+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:17:01.114014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.144057+0000","last_change":"2023-06-10T18:56:18.747220+0000","last_active":"2023-06-10T18:56:27.144057+0000","last_peered":"2023-06-10T18:56:27.144057+0000","last_clean":"2023-06-10T18:56:27.144057+0000","last_became_active":"2023-06-10T18:56:18.746415+0000","last_became_peered":"2023-06-10T18:56:18.746415+0000","last_unstale":"2023-06-10T18:56:27.144057+0000","last_undegraded":"2023-06-10T18:56:27.144057+0000","last_fullsized":"2023-06-10T18:56:27.144057+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:02:03.688477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.886572+0000","last_change":"2023-06-10T18:56:18.732379+0000","last_active":"2023-06-10T18:56:26.886572+0000","last_peered":"2023-06-10T18:56:26.886572+0000","last_clean":"2023-06-10T18:56:26.886572+0000","last_became_active":"2023-06-10T18:56:18.732081+0000","last_became_peered":"2023-06-10T18:56:18.732081+0000","last_unstale":"2023-06-10T18:56:26.886572+0000","last_undegraded":"2023-06-10T18:56:26.886572+0000","last_fullsized":"2023-06-10T18:56:26.886572+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:17:50.531074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.880795+0000","last_change":"2023-06-10T18:56:18.727402+0000","last_active":"2023-06-10T18:56:26.880795+0000","last_peered":"2023-06-10T18:56:26.880795+0000","last_clean":"2023-06-10T18:56:26.880795+0000","last_became_active":"2023-06-10T18:56:18.726939+0000","last_became_peered":"2023-06-10T18:56:18.726939+0000","last_unstale":"2023-06-10T18:56:26.880795+0000","last_undegraded":"2023-06-10T18:56:26.880795+0000","last_fullsized":"2023-06-10T18:56:26.880795+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:57:17.090045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.144764+0000","last_change":"2023-06-10T18:56:18.741248+0000","last_active":"2023-06-10T18:56:27.144764+0000","last_peered":"2023-06-10T18:56:27.144764+0000","last_clean":"2023-06-10T18:56:27.144764+0000","last_became_active":"2023-06-10T18:56:18.740548+0000","last_became_peered":"2023-06-10T18:56:18.740548+0000","last_unstale":"2023-06-10T18:56:27.144764+0000","last_undegraded":"2023-06-10T18:56:27.144764+0000","last_fullsized":"2023-06-10T18:56:27.144764+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:51:41.177614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.880542+0000","last_change":"2023-06-10T18:56:18.718426+0000","last_active":"2023-06-10T18:56:26.880542+0000","last_peered":"2023-06-10T18:56:26.880542+0000","last_clean":"2023-06-10T18:56:26.880542+0000","last_became_active":"2023-06-10T18:56:18.718017+0000","last_became_peered":"2023-06-10T18:56:18.718017+0000","last_unstale":"2023-06-10T18:56:26.880542+0000","last_undegraded":"2023-06-10T18:56:26.880542+0000","last_fullsized":"2023-06-10T18:56:26.880542+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:36:56.932324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.875458+0000","last_change":"2023-06-10T18:56:18.734189+0000","last_active":"2023-06-10T18:56:26.875458+0000","last_peered":"2023-06-10T18:56:26.875458+0000","last_clean":"2023-06-10T18:56:26.875458+0000","last_became_active":"2023-06-10T18:56:18.733412+0000","last_became_peered":"2023-06-10T18:56:18.733412+0000","last_unstale":"2023-06-10T18:56:26.875458+0000","last_undegraded":"2023-06-10T18:56:26.875458+0000","last_fullsized":"2023-06-10T18:56:26.875458+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:59:44.756321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.875364+0000","last_change":"2023-06-10T18:56:18.737307+0000","last_active":"2023-06-10T18:56:26.875364+0000","last_peered":"2023-06-10T18:56:26.875364+0000","last_clean":"2023-06-10T18:56:26.875364+0000","last_became_active":"2023-06-10T18:56:18.736534+0000","last_became_peered":"2023-06-10T18:56:18.736534+0000","last_unstale":"2023-06-10T18:56:26.875364+0000","last_undegraded":"2023-06-10T18:56:26.875364+0000","last_fullsized":"2023-06-10T18:56:26.875364+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:01:44.663641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.194660+0000","last_change":"2023-06-10T18:56:18.710819+0000","last_active":"2023-06-10T18:56:27.194660+0000","last_peered":"2023-06-10T18:56:27.194660+0000","last_clean":"2023-06-10T18:56:27.194660+0000","last_became_active":"2023-06-10T18:56:18.710524+0000","last_became_peered":"2023-06-10T18:56:18.710524+0000","last_unstale":"2023-06-10T18:56:27.194660+0000","last_undegraded":"2023-06-10T18:56:27.194660+0000","last_fullsized":"2023-06-10T18:56:27.194660+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:16:44.545696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.867692+0000","last_change":"2023-06-10T18:56:18.739719+0000","last_active":"2023-06-10T18:56:26.867692+0000","last_peered":"2023-06-10T18:56:26.867692+0000","last_clean":"2023-06-10T18:56:26.867692+0000","last_became_active":"2023-06-10T18:56:18.739394+0000","last_became_peered":"2023-06-10T18:56:18.739394+0000","last_unstale":"2023-06-10T18:56:26.867692+0000","last_undegraded":"2023-06-10T18:56:26.867692+0000","last_fullsized":"2023-06-10T18:56:26.867692+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:48:22.699885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.879440+0000","last_change":"2023-06-10T18:56:18.716014+0000","last_active":"2023-06-10T18:56:26.879440+0000","last_peered":"2023-06-10T18:56:26.879440+0000","last_clean":"2023-06-10T18:56:26.879440+0000","last_became_active":"2023-06-10T18:56:18.715463+0000","last_became_peered":"2023-06-10T18:56:18.715463+0000","last_unstale":"2023-06-10T18:56:26.879440+0000","last_undegraded":"2023-06-10T18:56:26.879440+0000","last_fullsized":"2023-06-10T18:56:26.879440+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:40:33.066988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.881131+0000","last_change":"2023-06-10T18:56:18.722488+0000","last_active":"2023-06-10T18:56:26.881131+0000","last_peered":"2023-06-10T18:56:26.881131+0000","last_clean":"2023-06-10T18:56:26.881131+0000","last_became_active":"2023-06-10T18:56:18.722221+0000","last_became_peered":"2023-06-10T18:56:18.722221+0000","last_unstale":"2023-06-10T18:56:26.881131+0000","last_undegraded":"2023-06-10T18:56:26.881131+0000","last_fullsized":"2023-06-10T18:56:26.881131+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:16:44.545696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.195014+0000","last_change":"2023-06-10T18:56:18.721449+0000","last_active":"2023-06-10T18:56:27.195014+0000","last_peered":"2023-06-10T18:56:27.195014+0000","last_clean":"2023-06-10T18:56:27.195014+0000","last_became_active":"2023-06-10T18:56:18.721191+0000","last_became_peered":"2023-06-10T18:56:18.721191+0000","last_unstale":"2023-06-10T18:56:27.195014+0000","last_undegraded":"2023-06-10T18:56:27.195014+0000","last_fullsized":"2023-06-10T18:56:27.195014+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:18:25.090460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.888495+0000","last_change":"2023-06-10T18:56:18.719671+0000","last_active":"2023-06-10T18:56:26.888495+0000","last_peered":"2023-06-10T18:56:26.888495+0000","last_clean":"2023-06-10T18:56:26.888495+0000","last_became_active":"2023-06-10T18:56:18.718588+0000","last_became_peered":"2023-06-10T18:56:18.718588+0000","last_unstale":"2023-06-10T18:56:26.888495+0000","last_undegraded":"2023-06-10T18:56:26.888495+0000","last_fullsized":"2023-06-10T18:56:26.888495+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:57:04.253762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.875781+0000","last_change":"2023-06-10T18:56:18.720108+0000","last_active":"2023-06-10T18:56:26.875781+0000","last_peered":"2023-06-10T18:56:26.875781+0000","last_clean":"2023-06-10T18:56:26.875781+0000","last_became_active":"2023-06-10T18:56:18.719242+0000","last_became_peered":"2023-06-10T18:56:18.719242+0000","last_unstale":"2023-06-10T18:56:26.875781+0000","last_undegraded":"2023-06-10T18:56:26.875781+0000","last_fullsized":"2023-06-10T18:56:26.875781+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:41:27.064954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.879750+0000","last_change":"2023-06-10T18:56:18.747959+0000","last_active":"2023-06-10T18:56:26.879750+0000","last_peered":"2023-06-10T18:56:26.879750+0000","last_clean":"2023-06-10T18:56:26.879750+0000","last_became_active":"2023-06-10T18:56:18.747680+0000","last_became_peered":"2023-06-10T18:56:18.747680+0000","last_unstale":"2023-06-10T18:56:26.879750+0000","last_undegraded":"2023-06-10T18:56:26.879750+0000","last_fullsized":"2023-06-10T18:56:26.879750+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:22:48.846033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.144212+0000","last_change":"2023-06-10T18:56:18.740103+0000","last_active":"2023-06-10T18:56:27.144212+0000","last_peered":"2023-06-10T18:56:27.144212+0000","last_clean":"2023-06-10T18:56:27.144212+0000","last_became_active":"2023-06-10T18:56:18.739227+0000","last_became_peered":"2023-06-10T18:56:18.739227+0000","last_unstale":"2023-06-10T18:56:27.144212+0000","last_undegraded":"2023-06-10T18:56:27.144212+0000","last_fullsized":"2023-06-10T18:56:27.144212+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:21:25.069656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.879705+0000","last_change":"2023-06-10T18:56:18.715535+0000","last_active":"2023-06-10T18:56:26.879705+0000","last_peered":"2023-06-10T18:56:26.879705+0000","last_clean":"2023-06-10T18:56:26.879705+0000","last_became_active":"2023-06-10T18:56:18.714677+0000","last_became_peered":"2023-06-10T18:56:18.714677+0000","last_unstale":"2023-06-10T18:56:26.879705+0000","last_undegraded":"2023-06-10T18:56:26.879705+0000","last_fullsized":"2023-06-10T18:56:26.879705+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:12:02.143937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.871827+0000","last_change":"2023-06-10T18:56:18.705775+0000","last_active":"2023-06-10T18:56:26.871827+0000","last_peered":"2023-06-10T18:56:26.871827+0000","last_clean":"2023-06-10T18:56:26.871827+0000","last_became_active":"2023-06-10T18:56:18.703437+0000","last_became_peered":"2023-06-10T18:56:18.703437+0000","last_unstale":"2023-06-10T18:56:26.871827+0000","last_undegraded":"2023-06-10T18:56:26.871827+0000","last_fullsized":"2023-06-10T18:56:26.871827+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:03:07.190449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.143717+0000","last_change":"2023-06-10T18:56:18.740486+0000","last_active":"2023-06-10T18:56:27.143717+0000","last_peered":"2023-06-10T18:56:27.143717+0000","last_clean":"2023-06-10T18:56:27.143717+0000","last_became_active":"2023-06-10T18:56:18.739644+0000","last_became_peered":"2023-06-10T18:56:18.739644+0000","last_unstale":"2023-06-10T18:56:27.143717+0000","last_undegraded":"2023-06-10T18:56:27.143717+0000","last_fullsized":"2023-06-10T18:56:27.143717+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:30:31.600689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"50'4","reported_seq":19,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.876540+0000","last_change":"2023-06-10T18:56:18.340764+0000","last_active":"2023-06-10T18:56:26.876540+0000","last_peered":"2023-06-10T18:56:26.876540+0000","last_clean":"2023-06-10T18:56:26.876540+0000","last_became_active":"2023-06-10T18:56:18.340011+0000","last_became_peered":"2023-06-10T18:56:18.340011+0000","last_unstale":"2023-06-10T18:56:26.876540+0000","last_undegraded":"2023-06-10T18:56:26.876540+0000","last_fullsized":"2023-06-10T18:56:26.876540+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:11:50.546839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.873041+0000","last_change":"2023-06-10T18:56:18.735833+0000","last_active":"2023-06-10T18:56:26.873041+0000","last_peered":"2023-06-10T18:56:26.873041+0000","last_clean":"2023-06-10T18:56:26.873041+0000","last_became_active":"2023-06-10T18:56:18.734668+0000","last_became_peered":"2023-06-10T18:56:18.734668+0000","last_unstale":"2023-06-10T18:56:26.873041+0000","last_undegraded":"2023-06-10T18:56:26.873041+0000","last_fullsized":"2023-06-10T18:56:26.873041+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:16:35.200792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"50'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.887551+0000","last_change":"2023-06-10T18:56:18.335972+0000","last_active":"2023-06-10T18:56:26.887551+0000","last_peered":"2023-06-10T18:56:26.887551+0000","last_clean":"2023-06-10T18:56:26.887551+0000","last_became_active":"2023-06-10T18:56:18.335565+0000","last_became_peered":"2023-06-10T18:56:18.335565+0000","last_unstale":"2023-06-10T18:56:26.887551+0000","last_undegraded":"2023-06-10T18:56:26.887551+0000","last_fullsized":"2023-06-10T18:56:26.887551+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:52:29.503909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.875187+0000","last_change":"2023-06-10T18:56:18.741042+0000","last_active":"2023-06-10T18:56:26.875187+0000","last_peered":"2023-06-10T18:56:26.875187+0000","last_clean":"2023-06-10T18:56:26.875187+0000","last_became_active":"2023-06-10T18:56:18.740325+0000","last_became_peered":"2023-06-10T18:56:18.740325+0000","last_unstale":"2023-06-10T18:56:26.875187+0000","last_undegraded":"2023-06-10T18:56:26.875187+0000","last_fullsized":"2023-06-10T18:56:26.875187+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:45:27.842047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"50'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.888555+0000","last_change":"2023-06-10T18:56:18.336603+0000","last_active":"2023-06-10T18:56:26.888555+0000","last_peered":"2023-06-10T18:56:26.888555+0000","last_clean":"2023-06-10T18:56:26.888555+0000","last_became_active":"2023-06-10T18:56:18.336117+0000","last_became_peered":"2023-06-10T18:56:18.336117+0000","last_unstale":"2023-06-10T18:56:26.888555+0000","last_undegraded":"2023-06-10T18:56:26.888555+0000","last_fullsized":"2023-06-10T18:56:26.888555+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:41:56.108306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.194691+0000","last_change":"2023-06-10T18:56:18.719404+0000","last_active":"2023-06-10T18:56:27.194691+0000","last_peered":"2023-06-10T18:56:27.194691+0000","last_clean":"2023-06-10T18:56:27.194691+0000","last_became_active":"2023-06-10T18:56:18.719096+0000","last_became_peered":"2023-06-10T18:56:18.719096+0000","last_unstale":"2023-06-10T18:56:27.194691+0000","last_undegraded":"2023-06-10T18:56:27.194691+0000","last_fullsized":"2023-06-10T18:56:27.194691+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:33:38.472734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"50'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.872249+0000","last_change":"2023-06-10T18:56:18.323382+0000","last_active":"2023-06-10T18:56:26.872249+0000","last_peered":"2023-06-10T18:56:26.872249+0000","last_clean":"2023-06-10T18:56:26.872249+0000","last_became_active":"2023-06-10T18:56:18.322748+0000","last_became_peered":"2023-06-10T18:56:18.322748+0000","last_unstale":"2023-06-10T18:56:26.872249+0000","last_undegraded":"2023-06-10T18:56:26.872249+0000","last_fullsized":"2023-06-10T18:56:26.872249+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:35:54.887943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.872083+0000","last_change":"2023-06-10T18:56:18.716497+0000","last_active":"2023-06-10T18:56:26.872083+0000","last_peered":"2023-06-10T18:56:26.872083+0000","last_clean":"2023-06-10T18:56:26.872083+0000","last_became_active":"2023-06-10T18:56:18.715689+0000","last_became_peered":"2023-06-10T18:56:18.715689+0000","last_unstale":"2023-06-10T18:56:26.872083+0000","last_undegraded":"2023-06-10T18:56:26.872083+0000","last_fullsized":"2023-06-10T18:56:26.872083+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:27:56.626985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"50'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.880042+0000","last_change":"2023-06-10T18:56:18.321017+0000","last_active":"2023-06-10T18:56:26.880042+0000","last_peered":"2023-06-10T18:56:26.880042+0000","last_clean":"2023-06-10T18:56:26.880042+0000","last_became_active":"2023-06-10T18:56:18.320552+0000","last_became_peered":"2023-06-10T18:56:18.320552+0000","last_unstale":"2023-06-10T18:56:26.880042+0000","last_undegraded":"2023-06-10T18:56:26.880042+0000","last_fullsized":"2023-06-10T18:56:26.880042+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:53:30.066871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.144497+0000","last_change":"2023-06-10T18:56:18.742047+0000","last_active":"2023-06-10T18:56:27.144497+0000","last_peered":"2023-06-10T18:56:27.144497+0000","last_clean":"2023-06-10T18:56:27.144497+0000","last_became_active":"2023-06-10T18:56:18.741342+0000","last_became_peered":"2023-06-10T18:56:18.741342+0000","last_unstale":"2023-06-10T18:56:27.144497+0000","last_undegraded":"2023-06-10T18:56:27.144497+0000","last_fullsized":"2023-06-10T18:56:27.144497+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:39:30.440026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"50'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.871399+0000","last_change":"2023-06-10T18:56:18.339655+0000","last_active":"2023-06-10T18:56:26.871399+0000","last_peered":"2023-06-10T18:56:26.871399+0000","last_clean":"2023-06-10T18:56:26.871399+0000","last_became_active":"2023-06-10T18:56:18.338930+0000","last_became_peered":"2023-06-10T18:56:18.338930+0000","last_unstale":"2023-06-10T18:56:26.871399+0000","last_undegraded":"2023-06-10T18:56:26.871399+0000","last_fullsized":"2023-06-10T18:56:26.871399+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:57:16.076543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.195762+0000","last_change":"2023-06-10T18:56:18.721372+0000","last_active":"2023-06-10T18:56:27.195762+0000","last_peered":"2023-06-10T18:56:27.195762+0000","last_clean":"2023-06-10T18:56:27.195762+0000","last_became_active":"2023-06-10T18:56:18.721086+0000","last_became_peered":"2023-06-10T18:56:18.721086+0000","last_unstale":"2023-06-10T18:56:27.195762+0000","last_undegraded":"2023-06-10T18:56:27.195762+0000","last_fullsized":"2023-06-10T18:56:27.195762+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:36:50.106017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.875086+0000","last_change":"2023-06-10T18:56:18.337501+0000","last_active":"2023-06-10T18:56:26.875086+0000","last_peered":"2023-06-10T18:56:26.875086+0000","last_clean":"2023-06-10T18:56:26.875086+0000","last_became_active":"2023-06-10T18:56:18.336875+0000","last_became_peered":"2023-06-10T18:56:18.336875+0000","last_unstale":"2023-06-10T18:56:26.875086+0000","last_undegraded":"2023-06-10T18:56:26.875086+0000","last_fullsized":"2023-06-10T18:56:26.875086+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:54:49.818477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.144972+0000","last_change":"2023-06-10T18:56:18.740844+0000","last_active":"2023-06-10T18:56:27.144972+0000","last_peered":"2023-06-10T18:56:27.144972+0000","last_clean":"2023-06-10T18:56:27.144972+0000","last_became_active":"2023-06-10T18:56:18.740202+0000","last_became_peered":"2023-06-10T18:56:18.740202+0000","last_unstale":"2023-06-10T18:56:27.144972+0000","last_undegraded":"2023-06-10T18:56:27.144972+0000","last_fullsized":"2023-06-10T18:56:27.144972+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:34:13.702327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.879577+0000","last_change":"2023-06-10T18:56:18.328357+0000","last_active":"2023-06-10T18:56:26.879577+0000","last_peered":"2023-06-10T18:56:26.879577+0000","last_clean":"2023-06-10T18:56:26.879577+0000","last_became_active":"2023-06-10T18:56:18.328062+0000","last_became_peered":"2023-06-10T18:56:18.328062+0000","last_unstale":"2023-06-10T18:56:26.879577+0000","last_undegraded":"2023-06-10T18:56:26.879577+0000","last_fullsized":"2023-06-10T18:56:26.879577+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:42:04.516586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.870557+0000","last_change":"2023-06-10T18:56:18.715041+0000","last_active":"2023-06-10T18:56:26.870557+0000","last_peered":"2023-06-10T18:56:26.870557+0000","last_clean":"2023-06-10T18:56:26.870557+0000","last_became_active":"2023-06-10T18:56:18.714315+0000","last_became_peered":"2023-06-10T18:56:18.714315+0000","last_unstale":"2023-06-10T18:56:26.870557+0000","last_undegraded":"2023-06-10T18:56:26.870557+0000","last_fullsized":"2023-06-10T18:56:26.870557+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:23:30.185213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.144647+0000","last_change":"2023-06-10T18:56:18.343930+0000","last_active":"2023-06-10T18:56:27.144647+0000","last_peered":"2023-06-10T18:56:27.144647+0000","last_clean":"2023-06-10T18:56:27.144647+0000","last_became_active":"2023-06-10T18:56:18.343289+0000","last_became_peered":"2023-06-10T18:56:18.343289+0000","last_unstale":"2023-06-10T18:56:27.144647+0000","last_undegraded":"2023-06-10T18:56:27.144647+0000","last_fullsized":"2023-06-10T18:56:27.144647+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:14:05.116786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.872895+0000","last_change":"2023-06-10T18:56:18.720481+0000","last_active":"2023-06-10T18:56:26.872895+0000","last_peered":"2023-06-10T18:56:26.872895+0000","last_clean":"2023-06-10T18:56:26.872895+0000","last_became_active":"2023-06-10T18:56:18.717729+0000","last_became_peered":"2023-06-10T18:56:18.717729+0000","last_unstale":"2023-06-10T18:56:26.872895+0000","last_undegraded":"2023-06-10T18:56:26.872895+0000","last_fullsized":"2023-06-10T18:56:26.872895+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:07:34.244620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.872218+0000","last_change":"2023-06-10T18:56:18.331216+0000","last_active":"2023-06-10T18:56:26.872218+0000","last_peered":"2023-06-10T18:56:26.872218+0000","last_clean":"2023-06-10T18:56:26.872218+0000","last_became_active":"2023-06-10T18:56:18.330640+0000","last_became_peered":"2023-06-10T18:56:18.330640+0000","last_unstale":"2023-06-10T18:56:26.872218+0000","last_undegraded":"2023-06-10T18:56:26.872218+0000","last_fullsized":"2023-06-10T18:56:26.872218+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:16:43.532194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.880373+0000","last_change":"2023-06-10T18:56:18.745850+0000","last_active":"2023-06-10T18:56:26.880373+0000","last_peered":"2023-06-10T18:56:26.880373+0000","last_clean":"2023-06-10T18:56:26.880373+0000","last_became_active":"2023-06-10T18:56:18.745516+0000","last_became_peered":"2023-06-10T18:56:18.745516+0000","last_unstale":"2023-06-10T18:56:26.880373+0000","last_undegraded":"2023-06-10T18:56:26.880373+0000","last_fullsized":"2023-06-10T18:56:26.880373+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:53:56.836970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"50'3","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.144726+0000","last_change":"2023-06-10T18:56:18.341819+0000","last_active":"2023-06-10T18:56:27.144726+0000","last_peered":"2023-06-10T18:56:27.144726+0000","last_clean":"2023-06-10T18:56:27.144726+0000","last_became_active":"2023-06-10T18:56:18.341153+0000","last_became_peered":"2023-06-10T18:56:18.341153+0000","last_unstale":"2023-06-10T18:56:27.144726+0000","last_undegraded":"2023-06-10T18:56:27.144726+0000","last_fullsized":"2023-06-10T18:56:27.144726+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:13:55.771862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.871435+0000","last_change":"2023-06-10T18:56:18.718945+0000","last_active":"2023-06-10T18:56:26.871435+0000","last_peered":"2023-06-10T18:56:26.871435+0000","last_clean":"2023-06-10T18:56:26.871435+0000","last_became_active":"2023-06-10T18:56:18.717962+0000","last_became_peered":"2023-06-10T18:56:18.717962+0000","last_unstale":"2023-06-10T18:56:26.871435+0000","last_undegraded":"2023-06-10T18:56:26.871435+0000","last_fullsized":"2023-06-10T18:56:26.871435+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:04:11.756055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"50'6","reported_seq":21,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.195682+0000","last_change":"2023-06-10T18:56:18.333312+0000","last_active":"2023-06-10T18:56:27.195682+0000","last_peered":"2023-06-10T18:56:27.195682+0000","last_clean":"2023-06-10T18:56:27.195682+0000","last_became_active":"2023-06-10T18:56:18.332390+0000","last_became_peered":"2023-06-10T18:56:18.332390+0000","last_unstale":"2023-06-10T18:56:27.195682+0000","last_undegraded":"2023-06-10T18:56:27.195682+0000","last_fullsized":"2023-06-10T18:56:27.195682+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:04:57.213752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.871933+0000","last_change":"2023-06-10T18:56:18.739711+0000","last_active":"2023-06-10T18:56:26.871933+0000","last_peered":"2023-06-10T18:56:26.871933+0000","last_clean":"2023-06-10T18:56:26.871933+0000","last_became_active":"2023-06-10T18:56:18.738999+0000","last_became_peered":"2023-06-10T18:56:18.738999+0000","last_unstale":"2023-06-10T18:56:26.871933+0000","last_undegraded":"2023-06-10T18:56:26.871933+0000","last_fullsized":"2023-06-10T18:56:26.871933+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:14:23.654180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"50'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.880149+0000","last_change":"2023-06-10T18:56:18.342157+0000","last_active":"2023-06-10T18:56:26.880149+0000","last_peered":"2023-06-10T18:56:26.880149+0000","last_clean":"2023-06-10T18:56:26.880149+0000","last_became_active":"2023-06-10T18:56:18.341576+0000","last_became_peered":"2023-06-10T18:56:18.341576+0000","last_unstale":"2023-06-10T18:56:26.880149+0000","last_undegraded":"2023-06-10T18:56:26.880149+0000","last_fullsized":"2023-06-10T18:56:26.880149+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:23:29.171711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":2,"reported_epoch":52,"state":"peering","last_fresh":"2023-06-10T18:56:22.631216+0000","last_change":"2023-06-10T18:56:27.634240+0000","last_active":"2023-06-10T18:56:27.634240+0000","last_peered":"2023-06-10T18:56:22.631216+0000","last_clean":"2023-06-10T18:56:22.631216+0000","last_became_active":"2023-06-10T18:56:18.711779+0000","last_became_peered":"2023-06-10T18:56:18.711779+0000","last_unstale":"2023-06-10T18:56:22.631216+0000","last_undegraded":"2023-06-10T18:56:22.631216+0000","last_fullsized":"2023-06-10T18:56:22.631216+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.875792+0000","last_change":"2023-06-10T18:56:18.335774+0000","last_active":"2023-06-10T18:56:26.875792+0000","last_peered":"2023-06-10T18:56:26.875792+0000","last_clean":"2023-06-10T18:56:26.875792+0000","last_became_active":"2023-06-10T18:56:18.334295+0000","last_became_peered":"2023-06-10T18:56:18.334295+0000","last_unstale":"2023-06-10T18:56:26.875792+0000","last_undegraded":"2023-06-10T18:56:26.875792+0000","last_fullsized":"2023-06-10T18:56:26.875792+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:45:39.069258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.195203+0000","last_change":"2023-06-10T18:56:18.732193+0000","last_active":"2023-06-10T18:56:27.195203+0000","last_peered":"2023-06-10T18:56:27.195203+0000","last_clean":"2023-06-10T18:56:27.195203+0000","last_became_active":"2023-06-10T18:56:18.731876+0000","last_became_peered":"2023-06-10T18:56:18.731876+0000","last_unstale":"2023-06-10T18:56:27.195203+0000","last_undegraded":"2023-06-10T18:56:27.195203+0000","last_fullsized":"2023-06-10T18:56:27.195203+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:41:57.121808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.144429+0000","last_change":"2023-06-10T18:56:18.348170+0000","last_active":"2023-06-10T18:56:27.144429+0000","last_peered":"2023-06-10T18:56:27.144429+0000","last_clean":"2023-06-10T18:56:27.144429+0000","last_became_active":"2023-06-10T18:56:18.347458+0000","last_became_peered":"2023-06-10T18:56:18.347458+0000","last_unstale":"2023-06-10T18:56:27.144429+0000","last_undegraded":"2023-06-10T18:56:27.144429+0000","last_fullsized":"2023-06-10T18:56:27.144429+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:08:51.581596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.880965+0000","last_change":"2023-06-10T18:56:18.727211+0000","last_active":"2023-06-10T18:56:26.880965+0000","last_peered":"2023-06-10T18:56:26.880965+0000","last_clean":"2023-06-10T18:56:26.880965+0000","last_became_active":"2023-06-10T18:56:18.726575+0000","last_became_peered":"2023-06-10T18:56:18.726575+0000","last_unstale":"2023-06-10T18:56:26.880965+0000","last_undegraded":"2023-06-10T18:56:26.880965+0000","last_fullsized":"2023-06-10T18:56:26.880965+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:04:11.756055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"50'8","reported_seq":23,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.195340+0000","last_change":"2023-06-10T18:56:18.332240+0000","last_active":"2023-06-10T18:56:27.195340+0000","last_peered":"2023-06-10T18:56:27.195340+0000","last_clean":"2023-06-10T18:56:27.195340+0000","last_became_active":"2023-06-10T18:56:18.331781+0000","last_became_peered":"2023-06-10T18:56:18.331781+0000","last_unstale":"2023-06-10T18:56:27.195340+0000","last_undegraded":"2023-06-10T18:56:27.195340+0000","last_fullsized":"2023-06-10T18:56:27.195340+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:23:26.069557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.195018+0000","last_change":"2023-06-10T18:56:18.702816+0000","last_active":"2023-06-10T18:56:27.195018+0000","last_peered":"2023-06-10T18:56:27.195018+0000","last_clean":"2023-06-10T18:56:27.195018+0000","last_became_active":"2023-06-10T18:56:18.702527+0000","last_became_peered":"2023-06-10T18:56:18.702527+0000","last_unstale":"2023-06-10T18:56:27.195018+0000","last_undegraded":"2023-06-10T18:56:27.195018+0000","last_fullsized":"2023-06-10T18:56:27.195018+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:01:30.967639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"50'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.881337+0000","last_change":"2023-06-10T18:56:18.324631+0000","last_active":"2023-06-10T18:56:26.881337+0000","last_peered":"2023-06-10T18:56:26.881337+0000","last_clean":"2023-06-10T18:56:26.881337+0000","last_became_active":"2023-06-10T18:56:18.324243+0000","last_became_peered":"2023-06-10T18:56:18.324243+0000","last_unstale":"2023-06-10T18:56:26.881337+0000","last_undegraded":"2023-06-10T18:56:26.881337+0000","last_fullsized":"2023-06-10T18:56:26.881337+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:01:29.954138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.886746+0000","last_change":"2023-06-10T18:56:18.710557+0000","last_active":"2023-06-10T18:56:26.886746+0000","last_peered":"2023-06-10T18:56:26.886746+0000","last_clean":"2023-06-10T18:56:26.886746+0000","last_became_active":"2023-06-10T18:56:18.710238+0000","last_became_peered":"2023-06-10T18:56:18.710238+0000","last_unstale":"2023-06-10T18:56:26.886746+0000","last_undegraded":"2023-06-10T18:56:26.886746+0000","last_fullsized":"2023-06-10T18:56:26.886746+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:57:17.090045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"50'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.869232+0000","last_change":"2023-06-10T18:56:18.324362+0000","last_active":"2023-06-10T18:56:26.869232+0000","last_peered":"2023-06-10T18:56:26.869232+0000","last_clean":"2023-06-10T18:56:26.869232+0000","last_became_active":"2023-06-10T18:56:18.323943+0000","last_became_peered":"2023-06-10T18:56:18.323943+0000","last_unstale":"2023-06-10T18:56:26.869232+0000","last_undegraded":"2023-06-10T18:56:26.869232+0000","last_fullsized":"2023-06-10T18:56:26.869232+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:13:38.851442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.871058+0000","last_change":"2023-06-10T18:56:18.715476+0000","last_active":"2023-06-10T18:56:26.871058+0000","last_peered":"2023-06-10T18:56:26.871058+0000","last_clean":"2023-06-10T18:56:26.871058+0000","last_became_active":"2023-06-10T18:56:18.714697+0000","last_became_peered":"2023-06-10T18:56:18.714697+0000","last_unstale":"2023-06-10T18:56:26.871058+0000","last_undegraded":"2023-06-10T18:56:26.871058+0000","last_fullsized":"2023-06-10T18:56:26.871058+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:36:56.932324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"50'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.876240+0000","last_change":"2023-06-10T18:56:18.341065+0000","last_active":"2023-06-10T18:56:26.876240+0000","last_peered":"2023-06-10T18:56:26.876240+0000","last_clean":"2023-06-10T18:56:26.876240+0000","last_became_active":"2023-06-10T18:56:18.340242+0000","last_became_peered":"2023-06-10T18:56:18.340242+0000","last_unstale":"2023-06-10T18:56:26.876240+0000","last_undegraded":"2023-06-10T18:56:26.876240+0000","last_fullsized":"2023-06-10T18:56:26.876240+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:27:46.347276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.887392+0000","last_change":"2023-06-10T18:56:18.722679+0000","last_active":"2023-06-10T18:56:26.887392+0000","last_peered":"2023-06-10T18:56:26.887392+0000","last_clean":"2023-06-10T18:56:26.887392+0000","last_became_active":"2023-06-10T18:56:18.722389+0000","last_became_peered":"2023-06-10T18:56:18.722389+0000","last_unstale":"2023-06-10T18:56:26.887392+0000","last_undegraded":"2023-06-10T18:56:26.887392+0000","last_fullsized":"2023-06-10T18:56:26.887392+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:01:30.967639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.875808+0000","last_change":"2023-06-10T18:56:18.335157+0000","last_active":"2023-06-10T18:56:26.875808+0000","last_peered":"2023-06-10T18:56:26.875808+0000","last_clean":"2023-06-10T18:56:26.875808+0000","last_became_active":"2023-06-10T18:56:18.334417+0000","last_became_peered":"2023-06-10T18:56:18.334417+0000","last_unstale":"2023-06-10T18:56:26.875808+0000","last_undegraded":"2023-06-10T18:56:26.875808+0000","last_fullsized":"2023-06-10T18:56:26.875808+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:43:46.237306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.872091+0000","last_change":"2023-06-10T18:56:18.720351+0000","last_active":"2023-06-10T18:56:26.872091+0000","last_peered":"2023-06-10T18:56:26.872091+0000","last_clean":"2023-06-10T18:56:26.872091+0000","last_became_active":"2023-06-10T18:56:18.717962+0000","last_became_peered":"2023-06-10T18:56:18.717962+0000","last_unstale":"2023-06-10T18:56:26.872091+0000","last_undegraded":"2023-06-10T18:56:26.872091+0000","last_fullsized":"2023-06-10T18:56:26.872091+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:55:10.132650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"50'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.887432+0000","last_change":"2023-06-10T18:56:18.337149+0000","last_active":"2023-06-10T18:56:26.887432+0000","last_peered":"2023-06-10T18:56:26.887432+0000","last_clean":"2023-06-10T18:56:26.887432+0000","last_became_active":"2023-06-10T18:56:18.335525+0000","last_became_peered":"2023-06-10T18:56:18.335525+0000","last_unstale":"2023-06-10T18:56:26.887432+0000","last_undegraded":"2023-06-10T18:56:26.887432+0000","last_fullsized":"2023-06-10T18:56:26.887432+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:23:26.069557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.876152+0000","last_change":"2023-06-10T18:56:18.734899+0000","last_active":"2023-06-10T18:56:26.876152+0000","last_peered":"2023-06-10T18:56:26.876152+0000","last_clean":"2023-06-10T18:56:26.876152+0000","last_became_active":"2023-06-10T18:56:18.734152+0000","last_became_peered":"2023-06-10T18:56:18.734152+0000","last_unstale":"2023-06-10T18:56:26.876152+0000","last_undegraded":"2023-06-10T18:56:26.876152+0000","last_fullsized":"2023-06-10T18:56:26.876152+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:16:15.404759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.194661+0000","last_change":"2023-06-10T18:56:18.332341+0000","last_active":"2023-06-10T18:56:27.194661+0000","last_peered":"2023-06-10T18:56:27.194661+0000","last_clean":"2023-06-10T18:56:27.194661+0000","last_became_active":"2023-06-10T18:56:18.331836+0000","last_became_peered":"2023-06-10T18:56:18.331836+0000","last_unstale":"2023-06-10T18:56:27.194661+0000","last_undegraded":"2023-06-10T18:56:27.194661+0000","last_fullsized":"2023-06-10T18:56:27.194661+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:27:55.613483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.881243+0000","last_change":"2023-06-10T18:56:18.745846+0000","last_active":"2023-06-10T18:56:26.881243+0000","last_peered":"2023-06-10T18:56:26.881243+0000","last_clean":"2023-06-10T18:56:26.881243+0000","last_became_active":"2023-06-10T18:56:18.745527+0000","last_became_peered":"2023-06-10T18:56:18.745527+0000","last_unstale":"2023-06-10T18:56:26.881243+0000","last_undegraded":"2023-06-10T18:56:26.881243+0000","last_fullsized":"2023-06-10T18:56:26.881243+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:33:38.472734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.879935+0000","last_change":"2023-06-10T18:56:18.337764+0000","last_active":"2023-06-10T18:56:26.879935+0000","last_peered":"2023-06-10T18:56:26.879935+0000","last_clean":"2023-06-10T18:56:26.879935+0000","last_became_active":"2023-06-10T18:56:18.337390+0000","last_became_peered":"2023-06-10T18:56:18.337390+0000","last_unstale":"2023-06-10T18:56:26.879935+0000","last_undegraded":"2023-06-10T18:56:26.879935+0000","last_fullsized":"2023-06-10T18:56:26.879935+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:54:06.053571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.887362+0000","last_change":"2023-06-10T18:56:18.705770+0000","last_active":"2023-06-10T18:56:26.887362+0000","last_peered":"2023-06-10T18:56:26.887362+0000","last_clean":"2023-06-10T18:56:26.887362+0000","last_became_active":"2023-06-10T18:56:18.705487+0000","last_became_peered":"2023-06-10T18:56:18.705487+0000","last_unstale":"2023-06-10T18:56:26.887362+0000","last_undegraded":"2023-06-10T18:56:26.887362+0000","last_fullsized":"2023-06-10T18:56:26.887362+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:18:25.090460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.867631+0000","last_change":"2023-06-10T18:56:18.339683+0000","last_active":"2023-06-10T18:56:26.867631+0000","last_peered":"2023-06-10T18:56:26.867631+0000","last_clean":"2023-06-10T18:56:26.867631+0000","last_became_active":"2023-06-10T18:56:18.339076+0000","last_became_peered":"2023-06-10T18:56:18.339076+0000","last_unstale":"2023-06-10T18:56:26.867631+0000","last_undegraded":"2023-06-10T18:56:26.867631+0000","last_fullsized":"2023-06-10T18:56:26.867631+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:24:21.579841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.874936+0000","last_change":"2023-06-10T18:56:18.724347+0000","last_active":"2023-06-10T18:56:26.874936+0000","last_peered":"2023-06-10T18:56:26.874936+0000","last_clean":"2023-06-10T18:56:26.874936+0000","last_became_active":"2023-06-10T18:56:18.723327+0000","last_became_peered":"2023-06-10T18:56:18.723327+0000","last_unstale":"2023-06-10T18:56:26.874936+0000","last_undegraded":"2023-06-10T18:56:26.874936+0000","last_fullsized":"2023-06-10T18:56:26.874936+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:06:54.175628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"51'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.881525+0000","last_change":"2023-06-10T18:56:18.337157+0000","last_active":"2023-06-10T18:56:26.881525+0000","last_peered":"2023-06-10T18:56:26.881525+0000","last_clean":"2023-06-10T18:56:26.881525+0000","last_became_active":"2023-06-10T18:56:18.336768+0000","last_became_peered":"2023-06-10T18:56:18.336768+0000","last_unstale":"2023-06-10T18:56:26.881525+0000","last_undegraded":"2023-06-10T18:56:26.881525+0000","last_fullsized":"2023-06-10T18:56:26.881525+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:18:24.076958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":224,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.143607+0000","last_change":"2023-06-10T18:52:34.951528+0000","last_active":"2023-06-10T18:56:27.143607+0000","last_peered":"2023-06-10T18:56:27.143607+0000","last_clean":"2023-06-10T18:56:27.143607+0000","last_became_active":"2023-06-10T18:52:34.949099+0000","last_became_peered":"2023-06-10T18:52:34.949099+0000","last_unstale":"2023-06-10T18:56:27.143607+0000","last_undegraded":"2023-06-10T18:56:27.143607+0000","last_fullsized":"2023-06-10T18:56:27.143607+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_clean_scrub_stamp":"2023-06-10T18:52:33.633295+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:48:42.927886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":70,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.872604+0000","last_change":"2023-06-10T18:52:40.506384+0000","last_active":"2023-06-10T18:56:26.872604+0000","last_peered":"2023-06-10T18:56:26.872604+0000","last_clean":"2023-06-10T18:56:26.872604+0000","last_became_active":"2023-06-10T18:52:40.505701+0000","last_became_peered":"2023-06-10T18:52:40.505701+0000","last_unstale":"2023-06-10T18:56:26.872604+0000","last_undegraded":"2023-06-10T18:56:26.872604+0000","last_fullsized":"2023-06-10T18:56:26.872604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:48:00.502223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.887017+0000","last_change":"2023-06-10T18:56:18.714433+0000","last_active":"2023-06-10T18:56:26.887017+0000","last_peered":"2023-06-10T18:56:26.887017+0000","last_clean":"2023-06-10T18:56:26.887017+0000","last_became_active":"2023-06-10T18:56:18.714070+0000","last_became_peered":"2023-06-10T18:56:18.714070+0000","last_unstale":"2023-06-10T18:56:26.887017+0000","last_undegraded":"2023-06-10T18:56:26.887017+0000","last_fullsized":"2023-06-10T18:56:26.887017+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:16:44.545696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.144734+0000","last_change":"2023-06-10T18:56:18.341822+0000","last_active":"2023-06-10T18:56:27.144734+0000","last_peered":"2023-06-10T18:56:27.144734+0000","last_clean":"2023-06-10T18:56:27.144734+0000","last_became_active":"2023-06-10T18:56:18.341138+0000","last_became_peered":"2023-06-10T18:56:18.341138+0000","last_unstale":"2023-06-10T18:56:27.144734+0000","last_undegraded":"2023-06-10T18:56:27.144734+0000","last_fullsized":"2023-06-10T18:56:27.144734+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:19:07.044160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":68,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.144020+0000","last_change":"2023-06-10T18:52:40.512015+0000","last_active":"2023-06-10T18:56:27.144020+0000","last_peered":"2023-06-10T18:56:27.144020+0000","last_clean":"2023-06-10T18:56:27.144020+0000","last_became_active":"2023-06-10T18:52:40.511382+0000","last_became_peered":"2023-06-10T18:52:40.511382+0000","last_unstale":"2023-06-10T18:56:27.144020+0000","last_undegraded":"2023-06-10T18:56:27.144020+0000","last_fullsized":"2023-06-10T18:56:27.144020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:10:22.176800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.195451+0000","last_change":"2023-06-10T18:56:18.720642+0000","last_active":"2023-06-10T18:56:27.195451+0000","last_peered":"2023-06-10T18:56:27.195451+0000","last_clean":"2023-06-10T18:56:27.195451+0000","last_became_active":"2023-06-10T18:56:18.720385+0000","last_became_peered":"2023-06-10T18:56:18.720385+0000","last_unstale":"2023-06-10T18:56:27.195451+0000","last_undegraded":"2023-06-10T18:56:27.195451+0000","last_fullsized":"2023-06-10T18:56:27.195451+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:44:56.381072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.881015+0000","last_change":"2023-06-10T18:56:18.320760+0000","last_active":"2023-06-10T18:56:26.881015+0000","last_peered":"2023-06-10T18:56:26.881015+0000","last_clean":"2023-06-10T18:56:26.881015+0000","last_became_active":"2023-06-10T18:56:18.320373+0000","last_became_peered":"2023-06-10T18:56:18.320373+0000","last_unstale":"2023-06-10T18:56:26.881015+0000","last_undegraded":"2023-06-10T18:56:26.881015+0000","last_fullsized":"2023-06-10T18:56:26.881015+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:27:55.613483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":70,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.867695+0000","last_change":"2023-06-10T18:52:40.671725+0000","last_active":"2023-06-10T18:56:26.867695+0000","last_peered":"2023-06-10T18:56:26.867695+0000","last_clean":"2023-06-10T18:56:26.867695+0000","last_became_active":"2023-06-10T18:52:40.671442+0000","last_became_peered":"2023-06-10T18:52:40.671442+0000","last_unstale":"2023-06-10T18:56:26.867695+0000","last_undegraded":"2023-06-10T18:56:26.867695+0000","last_fullsized":"2023-06-10T18:56:26.867695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:26:09.367931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.872142+0000","last_change":"2023-06-10T18:56:18.704278+0000","last_active":"2023-06-10T18:56:26.872142+0000","last_peered":"2023-06-10T18:56:26.872142+0000","last_clean":"2023-06-10T18:56:26.872142+0000","last_became_active":"2023-06-10T18:56:18.703336+0000","last_became_peered":"2023-06-10T18:56:18.703336+0000","last_unstale":"2023-06-10T18:56:26.872142+0000","last_undegraded":"2023-06-10T18:56:26.872142+0000","last_fullsized":"2023-06-10T18:56:26.872142+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:43:45.838944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"50'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.876735+0000","last_change":"2023-06-10T18:56:18.335741+0000","last_active":"2023-06-10T18:56:26.876735+0000","last_peered":"2023-06-10T18:56:26.876735+0000","last_clean":"2023-06-10T18:56:26.876735+0000","last_became_active":"2023-06-10T18:56:18.334904+0000","last_became_peered":"2023-06-10T18:56:18.334904+0000","last_unstale":"2023-06-10T18:56:26.876735+0000","last_undegraded":"2023-06-10T18:56:26.876735+0000","last_fullsized":"2023-06-10T18:56:26.876735+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:08:18.807313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":70,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.871228+0000","last_change":"2023-06-10T18:52:40.510258+0000","last_active":"2023-06-10T18:56:26.871228+0000","last_peered":"2023-06-10T18:56:26.871228+0000","last_clean":"2023-06-10T18:56:26.871228+0000","last_became_active":"2023-06-10T18:52:40.509560+0000","last_became_peered":"2023-06-10T18:52:40.509560+0000","last_unstale":"2023-06-10T18:56:26.871228+0000","last_undegraded":"2023-06-10T18:56:26.871228+0000","last_fullsized":"2023-06-10T18:56:26.871228+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:43:32.943829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":2,"reported_epoch":52,"state":"peering","last_fresh":"2023-06-10T18:56:22.631242+0000","last_change":"2023-06-10T18:56:27.634300+0000","last_active":"2023-06-10T18:56:27.634300+0000","last_peered":"2023-06-10T18:56:22.631242+0000","last_clean":"2023-06-10T18:56:22.631242+0000","last_became_active":"2023-06-10T18:56:18.715542+0000","last_became_peered":"2023-06-10T18:56:18.715542+0000","last_unstale":"2023-06-10T18:56:22.631242+0000","last_undegraded":"2023-06-10T18:56:22.631242+0000","last_fullsized":"2023-06-10T18:56:22.631242+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.870792+0000","last_change":"2023-06-10T18:56:18.325010+0000","last_active":"2023-06-10T18:56:26.870792+0000","last_peered":"2023-06-10T18:56:26.870792+0000","last_clean":"2023-06-10T18:56:26.870792+0000","last_became_active":"2023-06-10T18:56:18.324414+0000","last_became_peered":"2023-06-10T18:56:18.324414+0000","last_unstale":"2023-06-10T18:56:26.870792+0000","last_undegraded":"2023-06-10T18:56:26.870792+0000","last_fullsized":"2023-06-10T18:56:26.870792+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:53:55.823468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":66,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.887066+0000","last_change":"2023-06-10T18:52:40.672266+0000","last_active":"2023-06-10T18:56:26.887066+0000","last_peered":"2023-06-10T18:56:26.887066+0000","last_clean":"2023-06-10T18:56:26.887066+0000","last_became_active":"2023-06-10T18:52:40.671966+0000","last_became_peered":"2023-06-10T18:52:40.671966+0000","last_unstale":"2023-06-10T18:56:26.887066+0000","last_undegraded":"2023-06-10T18:56:26.887066+0000","last_fullsized":"2023-06-10T18:56:26.887066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:29:59.663767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.195764+0000","last_change":"2023-06-10T18:56:18.703583+0000","last_active":"2023-06-10T18:56:27.195764+0000","last_peered":"2023-06-10T18:56:27.195764+0000","last_clean":"2023-06-10T18:56:27.195764+0000","last_became_active":"2023-06-10T18:56:18.703292+0000","last_became_peered":"2023-06-10T18:56:18.703292+0000","last_unstale":"2023-06-10T18:56:27.195764+0000","last_undegraded":"2023-06-10T18:56:27.195764+0000","last_fullsized":"2023-06-10T18:56:27.195764+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:37:45.597946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.872441+0000","last_change":"2023-06-10T18:56:18.331871+0000","last_active":"2023-06-10T18:56:26.872441+0000","last_peered":"2023-06-10T18:56:26.872441+0000","last_clean":"2023-06-10T18:56:26.872441+0000","last_became_active":"2023-06-10T18:56:18.331127+0000","last_became_peered":"2023-06-10T18:56:18.331127+0000","last_unstale":"2023-06-10T18:56:26.872441+0000","last_undegraded":"2023-06-10T18:56:26.872441+0000","last_fullsized":"2023-06-10T18:56:26.872441+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:56:07.925384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":68,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.144910+0000","last_change":"2023-06-10T18:52:40.671084+0000","last_active":"2023-06-10T18:56:27.144910+0000","last_peered":"2023-06-10T18:56:27.144910+0000","last_clean":"2023-06-10T18:56:27.144910+0000","last_became_active":"2023-06-10T18:52:40.670697+0000","last_became_peered":"2023-06-10T18:52:40.670697+0000","last_unstale":"2023-06-10T18:56:27.144910+0000","last_undegraded":"2023-06-10T18:56:27.144910+0000","last_fullsized":"2023-06-10T18:56:27.144910+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:26:45.209485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.880674+0000","last_change":"2023-06-10T18:56:18.724544+0000","last_active":"2023-06-10T18:56:26.880674+0000","last_peered":"2023-06-10T18:56:26.880674+0000","last_clean":"2023-06-10T18:56:26.880674+0000","last_became_active":"2023-06-10T18:56:18.724244+0000","last_became_peered":"2023-06-10T18:56:18.724244+0000","last_unstale":"2023-06-10T18:56:26.880674+0000","last_undegraded":"2023-06-10T18:56:26.880674+0000","last_fullsized":"2023-06-10T18:56:26.880674+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:17:50.531074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.195134+0000","last_change":"2023-06-10T18:56:18.332507+0000","last_active":"2023-06-10T18:56:27.195134+0000","last_peered":"2023-06-10T18:56:27.195134+0000","last_clean":"2023-06-10T18:56:27.195134+0000","last_became_active":"2023-06-10T18:56:18.331887+0000","last_became_peered":"2023-06-10T18:56:18.331887+0000","last_unstale":"2023-06-10T18:56:27.195134+0000","last_undegraded":"2023-06-10T18:56:27.195134+0000","last_fullsized":"2023-06-10T18:56:27.195134+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:13:38.791330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":66,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.887650+0000","last_change":"2023-06-10T18:52:40.514114+0000","last_active":"2023-06-10T18:56:26.887650+0000","last_peered":"2023-06-10T18:56:26.887650+0000","last_clean":"2023-06-10T18:56:26.887650+0000","last_became_active":"2023-06-10T18:52:40.513638+0000","last_became_peered":"2023-06-10T18:52:40.513638+0000","last_unstale":"2023-06-10T18:56:26.887650+0000","last_undegraded":"2023-06-10T18:56:26.887650+0000","last_fullsized":"2023-06-10T18:56:26.887650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:41:17.572105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.871355+0000","last_change":"2023-06-10T18:56:18.733094+0000","last_active":"2023-06-10T18:56:26.871355+0000","last_peered":"2023-06-10T18:56:26.871355+0000","last_clean":"2023-06-10T18:56:26.871355+0000","last_became_active":"2023-06-10T18:56:18.732442+0000","last_became_peered":"2023-06-10T18:56:18.732442+0000","last_unstale":"2023-06-10T18:56:26.871355+0000","last_undegraded":"2023-06-10T18:56:26.871355+0000","last_fullsized":"2023-06-10T18:56:26.871355+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T18:57:31.579489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.195498+0000","last_change":"2023-06-10T18:56:18.337697+0000","last_active":"2023-06-10T18:56:27.195498+0000","last_peered":"2023-06-10T18:56:27.195498+0000","last_clean":"2023-06-10T18:56:27.195498+0000","last_became_active":"2023-06-10T18:56:18.337174+0000","last_became_peered":"2023-06-10T18:56:18.337174+0000","last_unstale":"2023-06-10T18:56:27.195498+0000","last_undegraded":"2023-06-10T18:56:27.195498+0000","last_fullsized":"2023-06-10T18:56:27.195498+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:57:03.240260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":70,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.876863+0000","last_change":"2023-06-10T18:52:40.515396+0000","last_active":"2023-06-10T18:56:26.876863+0000","last_peered":"2023-06-10T18:56:26.876863+0000","last_clean":"2023-06-10T18:56:26.876863+0000","last_became_active":"2023-06-10T18:52:40.514663+0000","last_became_peered":"2023-06-10T18:52:40.514663+0000","last_unstale":"2023-06-10T18:56:26.876863+0000","last_undegraded":"2023-06-10T18:56:26.876863+0000","last_fullsized":"2023-06-10T18:56:26.876863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:57:38.444899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574898,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28128,"kb_used_data":1176,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343712,"statfs":{"total":96636764160,"available":96607961088,"internally_reserved":0,"allocated":1204224,"data_stored":851412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":0.90400000000000003,"15min":0.88200000000000001},"min":{"1min":0.73599999999999999,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.3759999999999999,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.97999999999999998},{"interface":"front","average":{"1min":1.006,"5min":0.94299999999999995,"15min":0.93000000000000005},"min":{"1min":0.81899999999999995,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.234,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":1.0349999999999999}]},{"osd":1,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92400000000000004,"15min":0.91500000000000004},"min":{"1min":0.58599999999999997,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.3089999999999999,"5min":1.377,"15min":1.377},"last":1.1419999999999999},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.92500000000000004,"15min":0.91100000000000003},"min":{"1min":0.78400000000000003,"5min":0.504,"15min":0.504},"max":{"1min":1.111,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.1080000000000001}]},{"osd":2,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.83999999999999997,"15min":0.82799999999999996},"min":{"1min":0.64100000000000001,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.214,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.89900000000000002,"15min":0.90700000000000003},"min":{"1min":0.67500000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.325,"5min":1.367,"15min":1.367},"last":1.069}]},{"osd":3,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.92100000000000004,"15min":0.89900000000000002},"min":{"1min":0.68100000000000005,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1499999999999999,"5min":1.502,"15min":1.502},"last":1.167},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.93799999999999994,"15min":0.92800000000000005},"min":{"1min":0.70399999999999996,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.2130000000000001,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.77200000000000002}]},{"osd":4,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.876,"15min":0.872},"min":{"1min":0.60199999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.141,"5min":1.639,"15min":1.639},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.96899999999999997,"15min":0.98099999999999998},"min":{"1min":0.748,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.238,"5min":1.411,"15min":1.411},"last":0.65200000000000002}]},{"osd":5,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.042,"15min":1.038},"min":{"1min":0.79800000000000004,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.2669999999999999,"5min":1.806,"15min":1.806},"last":0.93200000000000005},{"interface":"front","average":{"1min":1.081,"5min":1.05,"15min":1.052},"min":{"1min":0.93200000000000005,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.256,"5min":1.522,"15min":1.522},"last":1.0009999999999999}]},{"osd":6,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.0129999999999999,"15min":1.008},"min":{"1min":0.78500000000000003,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.3,"5min":1.718,"15min":1.718},"last":0.95599999999999996},{"interface":"front","average":{"1min":1.147,"5min":1.095,"15min":1.0900000000000001},"min":{"1min":0.96599999999999997,"5min":0.441,"15min":0.441},"max":{"1min":1.409,"5min":1.464,"15min":1.464},"last":1.224}]}]},{"osd":6,"up_from":13,"seq":55834574899,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27548,"kb_used_data":596,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344292,"statfs":{"total":96636764160,"available":96608555008,"internally_reserved":0,"allocated":610304,"data_stored":261572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.81999999999999995,"15min":0.80100000000000005},"min":{"1min":0.65800000000000003,"5min":0.502,"15min":0.502},"max":{"1min":1.0589999999999999,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.85199999999999998,"15min":0.83999999999999997},"min":{"1min":0.71799999999999997,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.0680000000000001,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":1.0920000000000001}]},{"osd":1,"last update":"Sat Jun 10 18:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.873,"15min":0.85199999999999998},"min":{"1min":0.68999999999999995,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.0549999999999999},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.879,"15min":0.85899999999999999},"min":{"1min":0.68999999999999995,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":0.90000000000000002}]},{"osd":2,"last update":"Sat Jun 10 18:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.871,"15min":0.85899999999999999},"min":{"1min":0.66000000000000003,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.1950000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.88500000000000001,"15min":0.88900000000000001},"min":{"1min":0.68000000000000005,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.109,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":1.177}]},{"osd":3,"last update":"Sat Jun 10 18:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.874,"15min":0.84799999999999998},"min":{"1min":0.64900000000000002,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.169,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.95999999999999996},{"interface":"front","average":{"1min":1.0209999999999999,"5min":0.997,"15min":0.995},"min":{"1min":0.72799999999999998,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":1.2889999999999999}]},{"osd":4,"last update":"Sat Jun 10 18:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.93799999999999994,"15min":0.95399999999999996},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.1259999999999999,"5min":1.198,"15min":1.198},"last":1.002},{"interface":"front","average":{"1min":0.95699999999999996,"5min":1.0049999999999999,"15min":1.0189999999999999},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.1879999999999999,"5min":1.222,"15min":1.222},"last":1.212}]},{"osd":5,"last update":"Sat Jun 10 18:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.94999999999999996,"15min":0.96199999999999997},"min":{"1min":0.68700000000000006,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.0720000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.86099999999999999},{"interface":"front","average":{"1min":1.02,"5min":1.0249999999999999,"15min":1.026},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":1.1399999999999999}]},{"osd":7,"last update":"Sat Jun 10 18:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":1.0389999999999999,"15min":1.0489999999999999},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.1739999999999999,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.022,"5min":1.0569999999999999,"15min":1.0649999999999999},"min":{"1min":0.82199999999999995,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.2010000000000001,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":1.2569999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574899,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27552,"kb_used_data":600,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":614400,"data_stored":267298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.84199999999999997,"15min":0.82999999999999996},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.139,"5min":1.175,"15min":1.175},"last":1.083},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.91800000000000004,"15min":0.94199999999999995},"min":{"1min":0.63800000000000001,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.246,"5min":1.637,"15min":1.637},"last":0.67700000000000005}]},{"osd":1,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.91000000000000003,"15min":0.91800000000000004},"min":{"1min":0.67800000000000005,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.1559999999999999,"5min":1.335,"15min":1.335},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.91700000000000004,"15min":0.92100000000000004},"min":{"1min":0.72699999999999998,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.208,"5min":1.78,"15min":1.78},"last":0.80700000000000005}]},{"osd":2,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.65000000000000002,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.1000000000000001,"5min":1.446,"15min":1.446},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.91600000000000004,"15min":0.91200000000000003},"min":{"1min":0.71399999999999997,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.1379999999999999,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.92300000000000004}]},{"osd":3,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93899999999999995,"15min":0.94499999999999995},"min":{"1min":0.68600000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.206,"5min":1.484,"15min":1.484},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.97199999999999998,"5min":1.0249999999999999,"15min":1.0429999999999999},"min":{"1min":0.77100000000000002,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.2969999999999999,"5min":1.337,"15min":1.337},"last":0.84599999999999997}]},{"osd":4,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.96999999999999997,"15min":0.98899999999999999},"min":{"1min":0.70299999999999996,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.2669999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.94599999999999995,"5min":1.034,"15min":1.0640000000000001},"min":{"1min":0.66500000000000004,"5min":0.629,"15min":0.629},"max":{"1min":1.26,"5min":1.575,"15min":1.575},"last":1.2010000000000001}]},{"osd":6,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":1.038,"15min":1.0780000000000001},"min":{"1min":0.66000000000000003,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.2010000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.0609999999999999,"15min":1.079},"min":{"1min":0.69799999999999995,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.2270000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.73699999999999999}]},{"osd":7,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.139,"15min":1.1739999999999999},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.226,"5min":1.873,"15min":1.873},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.155,"15min":1.181},"min":{"1min":0.80000000000000004,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.3680000000000001,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.121}]}]},{"osd":4,"up_from":13,"seq":55834574898,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27556,"kb_used_data":604,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344284,"statfs":{"total":96636764160,"available":96608546816,"internally_reserved":0,"allocated":618496,"data_stored":267880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.76700000000000002,"15min":0.745},"min":{"1min":0.53400000000000003,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.1599999999999999,"5min":1.2,"15min":1.2},"last":0.629},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.88200000000000001,"15min":0.88},"min":{"1min":0.63800000000000001,"5min":0.504,"15min":0.504},"max":{"1min":1.4970000000000001,"5min":1.73,"15min":1.73},"last":1.034}]},{"osd":1,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.95199999999999996,"15min":0.95499999999999996},"min":{"1min":0.68200000000000005,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.84599999999999997,"15min":0.83699999999999997},"min":{"1min":0.66600000000000004,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.024,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.097}]},{"osd":2,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.879,"15min":0.875},"min":{"1min":0.70799999999999996,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":0.85499999999999998},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1,"15min":1.004},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":1.121}]},{"osd":3,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.89900000000000002,"15min":0.88},"min":{"1min":0.80900000000000005,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.1679999999999999,"5min":1.22,"15min":1.22},"last":0.73999999999999999},{"interface":"front","average":{"1min":1.006,"5min":0.95799999999999996,"15min":0.95099999999999996},"min":{"1min":0.80100000000000005,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.4490000000000001,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.069}]},{"osd":5,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.96799999999999997,"15min":0.99399999999999999},"min":{"1min":0.67800000000000005,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.069,"5min":1.663,"15min":1.663},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.95399999999999996,"15min":0.98199999999999998},"min":{"1min":0.58099999999999996,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.111,"5min":1.353,"15min":1.353},"last":1.179}]},{"osd":6,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":1.002,"15min":1.028},"min":{"1min":0.63100000000000001,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.5720000000000001,"5min":2.2639999999999998,"15min":2.2639999999999998},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0720000000000001,"15min":1.0760000000000001},"min":{"1min":0.81200000000000006,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":1.1970000000000001}]},{"osd":7,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.98399999999999999,"15min":0.99399999999999999},"min":{"1min":0.68899999999999995,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.1950000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.012,"5min":1.0529999999999999,"15min":1.071},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.2390000000000001,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":1.1539999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574897,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31660,"kb_used_data":612,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340180,"statfs":{"total":96636764160,"available":96604344320,"internally_reserved":0,"allocated":626688,"data_stored":267865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.57799999999999996,"15min":0.57199999999999995},"min":{"1min":0.51400000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.63500000000000001,"15min":0.63100000000000001},"min":{"1min":0.56000000000000005,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.57599999999999996}]},{"osd":1,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.64400000000000002,"15min":0.622},"min":{"1min":0.51000000000000001,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":1.0860000000000001},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.72099999999999997,"15min":0.71599999999999997},"min":{"1min":0.56100000000000005,"5min":0.318,"15min":0.318},"max":{"1min":0.98899999999999999,"5min":1.411,"15min":1.411},"last":1.0409999999999999}]},{"osd":2,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.76100000000000001,"15min":0.75},"min":{"1min":0.63500000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.167,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":1.3759999999999999},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.75900000000000001,"15min":0.74199999999999999},"min":{"1min":0.65200000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.1970000000000001,"5min":1.264,"15min":1.264},"last":0.624}]},{"osd":4,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96099999999999997,"15min":0.96899999999999997},"min":{"1min":0.79800000000000004,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.3089999999999999,"5min":1.488,"15min":1.488},"last":1.3360000000000001},{"interface":"front","average":{"1min":1.052,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.82099999999999995,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.345,"5min":1.458,"15min":1.458},"last":0.93100000000000005}]},{"osd":5,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.0369999999999999,"15min":1.0589999999999999},"min":{"1min":0.80400000000000005,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.268,"5min":2.024,"15min":2.024},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.101,"5min":1.026,"15min":1.014},"min":{"1min":0.83899999999999997,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.29,"5min":1.724,"15min":1.724},"last":1.2170000000000001}]},{"osd":6,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.0489999999999999,"15min":1.0469999999999999},"min":{"1min":0.92400000000000004,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.3300000000000001,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.071,"5min":1.0589999999999999,"15min":1.0720000000000001},"min":{"1min":0.90700000000000003,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.302,"5min":1.78,"15min":1.78},"last":1.1399999999999999}]},{"osd":7,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.101,"15min":1.1279999999999999},"min":{"1min":0.82799999999999996,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.3959999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.212,"5min":1.089,"15min":1.0740000000000001},"min":{"1min":1.0049999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.468,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":1.5429999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574898,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31660,"kb_used_data":612,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340180,"statfs":{"total":96636764160,"available":96604344320,"internally_reserved":0,"allocated":626688,"data_stored":268862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.60099999999999998,"15min":0.58799999999999997},"min":{"1min":0.498,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.97799999999999998,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.50800000000000001,"5min":0.378,"15min":0.378},"max":{"1min":1.024,"5min":1.224,"15min":1.224},"last":0.68600000000000005}]},{"osd":1,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.65000000000000002,"15min":0.64600000000000002},"min":{"1min":0.53400000000000003,"5min":0.307,"15min":0.307},"max":{"1min":0.89500000000000002,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.72299999999999998,"15min":0.68999999999999995},"min":{"1min":0.64700000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.89100000000000001}]},{"osd":3,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.73599999999999999,"15min":0.70599999999999996},"min":{"1min":0.64900000000000002,"5min":0.377,"15min":0.377},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.749,"15min":0.746},"min":{"1min":0.64700000000000002,"5min":0.252,"15min":0.252},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.86199999999999999}]},{"osd":4,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.91900000000000004,"15min":0.91500000000000004},"min":{"1min":0.81000000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.097,"5min":1.0349999999999999,"15min":1.038},"min":{"1min":0.88600000000000001,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.476,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":1.0129999999999999}]},{"osd":5,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.016,"15min":1.016},"min":{"1min":0.82699999999999996,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.379,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":1.2330000000000001},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.002,"15min":0.97799999999999998},"min":{"1min":0.77100000000000002,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.377,"5min":1.667,"15min":1.667},"last":0.78200000000000003}]},{"osd":6,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.0429999999999999,"15min":1.0229999999999999},"min":{"1min":0.84299999999999997,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.3049999999999999,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.92900000000000005},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.034,"15min":1.032},"min":{"1min":0.89400000000000002,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.4299999999999999,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":1.1120000000000001}]},{"osd":7,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.099,"15min":1.099},"min":{"1min":0.82399999999999995,"5min":0.62,"15min":0.62},"max":{"1min":1.4339999999999999,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.153,"5min":1.0980000000000001,"15min":1.0760000000000001},"min":{"1min":0.95499999999999996,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.4239999999999999,"5min":1.752,"15min":1.752},"last":0.98899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574900,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31640,"kb_used_data":592,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340200,"statfs":{"total":96636764160,"available":96604364800,"internally_reserved":0,"allocated":606208,"data_stored":260061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.67100000000000004,"15min":0.66100000000000003},"min":{"1min":0.47999999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.71999999999999997,"15min":0.68600000000000005},"min":{"1min":0.63400000000000001,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.0369999999999999,"5min":1.694,"15min":1.694},"last":0.56799999999999995}]},{"osd":2,"last update":"Sat Jun 10 18:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.64400000000000002,"15min":0.623},"min":{"1min":0.53500000000000003,"5min":0.249,"15min":0.249},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.877,"5min":0.70199999999999996,"15min":0.65800000000000003},"min":{"1min":0.65600000000000003,"5min":0.315,"15min":0.315},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":0.65500000000000003}]},{"osd":3,"last update":"Sat Jun 10 18:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.77800000000000002,"15min":0.745},"min":{"1min":0.65900000000000003,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.76100000000000001,"15min":0.749},"min":{"1min":0.58499999999999996,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.1100000000000001,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":0.622}]},{"osd":4,"last update":"Sat Jun 10 18:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.87,"15min":0.83599999999999997},"min":{"1min":0.73399999999999999,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":1.087,"5min":1.1160000000000001,"15min":1.079},"min":{"1min":0.78500000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.5449999999999999,"5min":5.8209999999999997,"15min":5.8209999999999997},"last":0.91000000000000003}]},{"osd":5,"last update":"Sat Jun 10 18:55:44 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.032,"15min":1.028},"min":{"1min":0.75800000000000001,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.4550000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":0.879},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0129999999999999,"15min":0.97099999999999997},"min":{"1min":0.754,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.3819999999999999,"5min":3.089,"15min":3.089},"last":0.72299999999999998}]},{"osd":6,"last update":"Sat Jun 10 18:55:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.105,"15min":1.0309999999999999},"min":{"1min":0.75900000000000001,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.5249999999999999,"5min":7.2599999999999998,"15min":7.2599999999999998},"last":0.77500000000000002},{"interface":"front","average":{"1min":1.081,"5min":1.107,"15min":1.0309999999999999},"min":{"1min":0.80800000000000005,"5min":0.622,"15min":0.622},"max":{"1min":1.591,"5min":9.0069999999999997,"15min":9.0069999999999997},"last":0.85899999999999999}]},{"osd":7,"last update":"Sat Jun 10 18:55:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.0980000000000001,"15min":1.083},"min":{"1min":0.89300000000000002,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.6879999999999999,"5min":2.105,"15min":2.105},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.085,"15min":1.0669999999999999},"min":{"1min":0.90200000000000002,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.573,"5min":2.2570000000000001,"15min":2.2570000000000001},"last":0.73999999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574899,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32232,"kb_used_data":1184,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339608,"statfs":{"total":96636764160,"available":96603758592,"internally_reserved":0,"allocated":1212416,"data_stored":856703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.61299999999999999,"15min":0.59899999999999998},"min":{"1min":0.51000000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.77200000000000002,"15min":0.746},"min":{"1min":0.70899999999999996,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.0469999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.83899999999999997}]},{"osd":2,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.71099999999999997,"15min":0.69799999999999995},"min":{"1min":0.51900000000000002,"5min":0.313,"15min":0.313},"max":{"1min":1.0269999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.64600000000000002,"15min":0.63},"min":{"1min":0.55700000000000005,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.96799999999999997,"5min":1.371,"15min":1.371},"last":0.622}]},{"osd":3,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.68200000000000005,"15min":0.67000000000000004},"min":{"1min":0.55800000000000005,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.1930000000000001,"5min":1.226,"15min":1.226},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.82899999999999996,"15min":0.81000000000000005},"min":{"1min":0.65800000000000003,"5min":0.375,"15min":0.375},"max":{"1min":1.262,"5min":1.829,"15min":1.829},"last":0.76200000000000001}]},{"osd":4,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.90000000000000002,"15min":0.88900000000000001},"min":{"1min":0.75600000000000001,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.1579999999999999,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.0369999999999999,"15min":1.034},"min":{"1min":0.86099999999999999,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.228,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":0.97199999999999998}]},{"osd":5,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.96099999999999997,"15min":0.95799999999999996},"min":{"1min":0.67300000000000004,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.351,"5min":1.694,"15min":1.694},"last":1.1399999999999999},{"interface":"front","average":{"1min":0.99099999999999999,"5min":1,"15min":0.998},"min":{"1min":0.72999999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.1870000000000001,"5min":1.75,"15min":1.75},"last":1.2789999999999999}]},{"osd":6,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.0700000000000001,"15min":1.056},"min":{"1min":0.93899999999999995,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.331,"5min":2.04,"15min":2.04},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.0409999999999999,"5min":0.996,"15min":0.997},"min":{"1min":0.76100000000000001,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.444,"5min":1.883,"15min":1.883},"last":1.3280000000000001}]},{"osd":7,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.0369999999999999,"15min":1.0329999999999999},"min":{"1min":0.77200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.397,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.077,"5min":1.056,"15min":1.05},"min":{"1min":0.93200000000000005,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.298,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.2170000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-10T18:56:32.171 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-10T18:56:32.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.319+0000 7fdfcc46a640 1 Processor -- start 2023-06-10T18:56:32.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.319+0000 7fdfcc46a640 1 -- start start 2023-06-10T18:56:32.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.323+0000 7fdfcc46a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdfc406c7d0 0x7fdfc41586f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:32.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.323+0000 7fdfcc46a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fdfc40ccc90 0x7fdfc40cd130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:32.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.323+0000 7fdfcc46a640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfc415c260 con 0x7fdfc406c400 2023-06-10T18:56:32.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.323+0000 7fdfcc46a640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfc415cee0 con 0x7fdfc40ccc90 2023-06-10T18:56:32.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.323+0000 7fdfcc46a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc415c540 con 0x7fdfc406c7d0 2023-06-10T18:56:32.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.323+0000 7fdfca206640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fdfc406c400 0x7fdfc4157fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:59614/0 (socket says 172.21.15.53:59614) 2023-06-10T18:56:32.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.323+0000 7fdfca206640 1 -- 172.21.15.53:0/4201811714 learned_addr learned my addr 172.21.15.53:0/4201811714 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:56:32.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.323+0000 7fdfcaa07640 1 --2- 172.21.15.53:0/4201811714 >> v2:172.21.15.117:3300/0 conn(0x7fdfc40ccc90 0x7fdfc40cd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:32.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.323+0000 7fdfc9a05640 1 --2- 172.21.15.53:0/4201811714 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdfc406c7d0 0x7fdfc41586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:32.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.323+0000 7fdfc9204640 1 -- 172.21.15.53:0/4201811714 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2566632902 0 0) 0x7fdfc415c260 con 0x7fdfc406c400 2023-06-10T18:56:32.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.323+0000 7fdfc9204640 1 -- 172.21.15.53:0/4201811714 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfb0003530 con 0x7fdfc406c400 2023-06-10T18:56:32.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.323+0000 7fdfc9204640 1 -- 172.21.15.53:0/4201811714 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1116399310 0 0) 0x7fdfb0003530 con 0x7fdfc406c400 2023-06-10T18:56:32.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.323+0000 7fdfc9204640 1 -- 172.21.15.53:0/4201811714 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdfc406c7d0 msgr2=0x7fdfc41586f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:32.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.323+0000 7fdfc9204640 1 --2- 172.21.15.53:0/4201811714 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdfc406c7d0 0x7fdfc41586f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:32.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.323+0000 7fdfc9204640 1 -- 172.21.15.53:0/4201811714 >> v2:172.21.15.117:3300/0 conn(0x7fdfc40ccc90 msgr2=0x7fdfc40cd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:32.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.323+0000 7fdfc9204640 1 --2- 172.21.15.53:0/4201811714 >> v2:172.21.15.117:3300/0 conn(0x7fdfc40ccc90 0x7fdfc40cd130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:32.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.323+0000 7fdfc9204640 1 -- 172.21.15.53:0/4201811714 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc415c820 con 0x7fdfc406c400 2023-06-10T18:56:32.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.323+0000 7fdfc9204640 1 -- 172.21.15.53:0/4201811714 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fdfc0001a00 con 0x7fdfc406c400 2023-06-10T18:56:32.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.323+0000 7fdfcaa07640 1 --2- 172.21.15.53:0/4201811714 >> v2:172.21.15.117:3300/0 conn(0x7fdfc40ccc90 0x7fdfc40cd130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:56:32.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.323+0000 7fdfc9204640 1 -- 172.21.15.53:0/4201811714 >> v1:172.21.15.53:6789/0 conn(0x7fdfc406c400 legacy=0x7fdfc4157fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:32.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.323+0000 7fdfc9204640 1 --2- 172.21.15.53:0/4201811714 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdfb00039f0 0x7fdfb0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:32.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.323+0000 7fdfc9204640 1 --2- 172.21.15.53:0/4201811714 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdfb00047d0 0x7fdfb0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:32.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.323+0000 7fdfc9204640 1 --2- 172.21.15.53:0/4201811714 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdfc406c7d0 0x7fdfb0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:32.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.323+0000 7fdfc9204640 1 -- 172.21.15.53:0/4201811714 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc415cee0 con 0x7fdfb00047d0 2023-06-10T18:56:32.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.323+0000 7fdfc9204640 1 -- 172.21.15.53:0/4201811714 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc415c540 con 0x7fdfb00039f0 2023-06-10T18:56:32.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.323+0000 7fdfc9204640 1 -- 172.21.15.53:0/4201811714 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb000bac0 con 0x7fdfc406c7d0 2023-06-10T18:56:32.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.323+0000 7fdfc9a05640 1 --2- 172.21.15.53:0/4201811714 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdfb00047d0 0x7fdfb0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:32.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.323+0000 7fdfca206640 1 --2- 172.21.15.53:0/4201811714 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdfb00039f0 0x7fdfb0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:32.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.323+0000 7fdfcaa07640 1 --2- 172.21.15.53:0/4201811714 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdfc406c7d0 0x7fdfb0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:32.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.323+0000 7fdfc9a05640 1 -- 172.21.15.53:0/4201811714 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdfc406c7d0 msgr2=0x7fdfb0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:32.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.323+0000 7fdfc9a05640 1 --2- 172.21.15.53:0/4201811714 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdfc406c7d0 0x7fdfb0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:32.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.323+0000 7fdfc9a05640 1 -- 172.21.15.53:0/4201811714 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdfb00039f0 msgr2=0x7fdfb0003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:32.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.323+0000 7fdfc9a05640 1 --2- 172.21.15.53:0/4201811714 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdfb00039f0 0x7fdfb0003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:32.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.323+0000 7fdfc9a05640 1 -- 172.21.15.53:0/4201811714 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb0003530 con 0x7fdfb00047d0 2023-06-10T18:56:32.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.323+0000 7fdfca206640 1 --2- 172.21.15.53:0/4201811714 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdfb00039f0 0x7fdfb0003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:56:32.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.327+0000 7fdfc9a05640 1 --2- 172.21.15.53:0/4201811714 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdfb00047d0 0x7fdfb0004c40 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fdfb4009ab0 tx=0x7fdfb401c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf986388fcff4608 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:32.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.327+0000 7fdfc9204640 1 -- 172.21.15.53:0/4201811714 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb40a8430 con 0x7fdfb00047d0 2023-06-10T18:56:32.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.327+0000 7fdfc9204640 1 -- 172.21.15.53:0/4201811714 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfb40a8590 con 0x7fdfb00047d0 2023-06-10T18:56:32.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.327+0000 7fdfc9204640 1 -- 172.21.15.53:0/4201811714 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb40a8940 con 0x7fdfb00047d0 2023-06-10T18:56:32.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.327+0000 7fdfcc46a640 1 -- 172.21.15.53:0/4201811714 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdfb00047d0 msgr2=0x7fdfb0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:32.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.327+0000 7fdfcc46a640 1 --2- 172.21.15.53:0/4201811714 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdfb00047d0 0x7fdfb0004c40 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fdfb4009ab0 tx=0x7fdfb401c9e0 comp rx=0 tx=0).stop 2023-06-10T18:56:32.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.327+0000 7fdfcaa07640 1 -- 172.21.15.53:0/4201811714 reap_dead start 2023-06-10T18:56:32.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.327+0000 7fdfcc46a640 1 -- 172.21.15.53:0/4201811714 shutdown_connections 2023-06-10T18:56:32.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.327+0000 7fdfcc46a640 1 -- 172.21.15.53:0/4201811714 >> 172.21.15.53:0/4201811714 conn(0x7fdfc406a560 msgr2=0x7fdfc406a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:32.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.327+0000 7fdfcc46a640 1 -- 172.21.15.53:0/4201811714 shutdown_connections 2023-06-10T18:56:32.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.327+0000 7fdfcc46a640 1 -- 172.21.15.53:0/4201811714 wait complete. 2023-06-10T18:56:32.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.327+0000 7fdfcc46a640 1 Processor -- start 2023-06-10T18:56:32.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.327+0000 7fdfcc46a640 1 -- start start 2023-06-10T18:56:32.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.331+0000 7fdfcc46a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdfb00047d0 0x7fdfc40c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:32.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.331+0000 7fdfcc46a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdfc41479d0 0x7fdfc41471c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:32.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.331+0000 7fdfcc46a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdfc415dd70 0x7fdfc415e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:32.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.331+0000 7fdfcc46a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc40c57e0 con 0x7fdfc41479d0 2023-06-10T18:56:32.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.331+0000 7fdfcc46a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc415e720 con 0x7fdfb00047d0 2023-06-10T18:56:32.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.331+0000 7fdfcc46a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc40c3720 con 0x7fdfc415dd70 2023-06-10T18:56:32.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.331+0000 7fdfc9a05640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdfc41479d0 0x7fdfc41471c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:32.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.331+0000 7fdfc9a05640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdfc41479d0 0x7fdfc41471c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53052/0 (socket says 172.21.15.53:53052) 2023-06-10T18:56:32.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.331+0000 7fdfc9a05640 1 -- 172.21.15.53:0/3539431582 learned_addr learned my addr 172.21.15.53:0/3539431582 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:32.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.331+0000 7fdfcaa07640 1 --2- 172.21.15.53:0/3539431582 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdfc415dd70 0x7fdfc415e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:32.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.331+0000 7fdfca206640 1 --2- 172.21.15.53:0/3539431582 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdfb00047d0 0x7fdfc40c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:32.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.331+0000 7fdfc9a05640 1 -- 172.21.15.53:0/3539431582 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdfc415dd70 msgr2=0x7fdfc415e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:32.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.331+0000 7fdfc9a05640 1 --2- 172.21.15.53:0/3539431582 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdfc415dd70 0x7fdfc415e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:32.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.331+0000 7fdfc9a05640 1 -- 172.21.15.53:0/3539431582 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdfb00047d0 msgr2=0x7fdfc40c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:32.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.331+0000 7fdfc9a05640 1 --2- 172.21.15.53:0/3539431582 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdfb00047d0 0x7fdfc40c52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:32.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.331+0000 7fdfc9a05640 1 -- 172.21.15.53:0/3539431582 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc40c39c0 con 0x7fdfc41479d0 2023-06-10T18:56:32.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.331+0000 7fdfcaa07640 1 --2- 172.21.15.53:0/3539431582 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdfc415dd70 0x7fdfc415e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:56:32.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.331+0000 7fdfc9a05640 1 --2- 172.21.15.53:0/3539431582 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdfc41479d0 0x7fdfc41471c0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fdfb401cec0 tx=0x7fdfb4019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:32.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.331+0000 7fdfbaffd640 1 -- 172.21.15.53:0/3539431582 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb400f000 con 0x7fdfc41479d0 2023-06-10T18:56:32.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.331+0000 7fdfbaffd640 1 -- 172.21.15.53:0/3539431582 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfb40a8d80 con 0x7fdfc41479d0 2023-06-10T18:56:32.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.331+0000 7fdfcc46a640 1 -- 172.21.15.53:0/3539431582 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfc40c3ca0 con 0x7fdfc41479d0 2023-06-10T18:56:32.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.331+0000 7fdfbaffd640 1 -- 172.21.15.53:0/3539431582 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb40b9650 con 0x7fdfc41479d0 2023-06-10T18:56:32.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.331+0000 7fdfcc46a640 1 -- 172.21.15.53:0/3539431582 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfc414fd40 con 0x7fdfc41479d0 2023-06-10T18:56:32.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.331+0000 7fdfcc46a640 1 -- 172.21.15.53:0/3539431582 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfc404d790 con 0x7fdfc41479d0 2023-06-10T18:56:32.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.331+0000 7fdfbaffd640 1 -- 172.21.15.53:0/3539431582 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdfb40b0400 con 0x7fdfc41479d0 2023-06-10T18:56:32.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.331+0000 7fdfbaffd640 1 --2- 172.21.15.53:0/3539431582 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdfa80662b0 0x7fdfa8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:32.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.331+0000 7fdfbaffd640 1 -- 172.21.15.53:0/3539431582 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fdfb411dbd0 con 0x7fdfc41479d0 2023-06-10T18:56:32.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.331+0000 7fdfca206640 1 --2- 172.21.15.53:0/3539431582 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdfa80662b0 0x7fdfa8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:32.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.335+0000 7fdfca206640 1 --2- 172.21.15.53:0/3539431582 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdfa80662b0 0x7fdfa8068760 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fdfc0002020 tx=0x7fdfc0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:32.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.335+0000 7fdfbaffd640 1 -- 172.21.15.53:0/3539431582 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdfb40eb010 con 0x7fdfc41479d0 2023-06-10T18:56:32.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.483+0000 7fdfcc46a640 1 -- 172.21.15.53:0/3539431582 --> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdfc40b4d30 con 0x7fdfa80662b0 2023-06-10T18:56:32.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.507+0000 7fdfbaffd640 1 -- 172.21.15.53:0/3539431582 <== mgr.4105 v2:172.21.15.117:6832/3061986771 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+309188 (secure 0 0 0) 0x7fdfc40b4d30 con 0x7fdfa80662b0 2023-06-10T18:56:32.513 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:56:32.516 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-06-10T18:56:32.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.511+0000 7fdfcc46a640 1 -- 172.21.15.53:0/3539431582 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdfa80662b0 msgr2=0x7fdfa8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:32.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.511+0000 7fdfcc46a640 1 --2- 172.21.15.53:0/3539431582 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdfa80662b0 0x7fdfa8068760 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fdfc0002020 tx=0x7fdfc0009040 comp rx=0 tx=0).stop 2023-06-10T18:56:32.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.511+0000 7fdfcc46a640 1 -- 172.21.15.53:0/3539431582 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdfc41479d0 msgr2=0x7fdfc41471c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:32.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.511+0000 7fdfcc46a640 1 --2- 172.21.15.53:0/3539431582 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdfc41479d0 0x7fdfc41471c0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fdfb401cec0 tx=0x7fdfb4019780 comp rx=0 tx=0).stop 2023-06-10T18:56:32.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.511+0000 7fdfcc46a640 1 -- 172.21.15.53:0/3539431582 shutdown_connections 2023-06-10T18:56:32.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.511+0000 7fdfcc46a640 1 --2- 172.21.15.53:0/3539431582 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdfa80662b0 0x7fdfa8068760 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:32.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.511+0000 7fdfcc46a640 1 --2- 172.21.15.53:0/3539431582 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdfc415dd70 0x7fdfc415e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:32.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.511+0000 7fdfcc46a640 1 --2- 172.21.15.53:0/3539431582 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdfc41479d0 0x7fdfc41471c0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:32.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.511+0000 7fdfcc46a640 1 --2- 172.21.15.53:0/3539431582 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdfb00047d0 0x7fdfc40c52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:32.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.511+0000 7fdfcc46a640 1 -- 172.21.15.53:0/3539431582 >> 172.21.15.53:0/3539431582 conn(0x7fdfc406a560 msgr2=0x7fdfc4151b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:32.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.511+0000 7fdfcc46a640 1 -- 172.21.15.53:0/3539431582 shutdown_connections 2023-06-10T18:56:32.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.511+0000 7fdfcc46a640 1 -- 172.21.15.53:0/3539431582 wait complete. 2023-06-10T18:56:32.533 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":166,"stamp":"2023-06-10T18:56:31.642205+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237976,"kb_used_data":5976,"kb_used_omap":0,"kb_used_meta":231936,"kb_avail":754736744,"statfs":{"total":773094113280,"available":772850425856,"internally_reserved":0,"allocated":6119424,"data_stored":3301653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":237502464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.003448"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.887321+0000","last_change":"2023-06-10T18:56:18.723557+0000","last_active":"2023-06-10T18:56:26.887321+0000","last_peered":"2023-06-10T18:56:26.887321+0000","last_clean":"2023-06-10T18:56:26.887321+0000","last_became_active":"2023-06-10T18:56:18.723169+0000","last_became_peered":"2023-06-10T18:56:18.723169+0000","last_unstale":"2023-06-10T18:56:26.887321+0000","last_undegraded":"2023-06-10T18:56:26.887321+0000","last_fullsized":"2023-06-10T18:56:26.887321+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:05:32.467816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.144646+0000","last_change":"2023-06-10T18:56:18.739659+0000","last_active":"2023-06-10T18:56:27.144646+0000","last_peered":"2023-06-10T18:56:27.144646+0000","last_clean":"2023-06-10T18:56:27.144646+0000","last_became_active":"2023-06-10T18:56:18.738930+0000","last_became_peered":"2023-06-10T18:56:18.738930+0000","last_unstale":"2023-06-10T18:56:27.144646+0000","last_undegraded":"2023-06-10T18:56:27.144646+0000","last_fullsized":"2023-06-10T18:56:27.144646+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:56:20.150212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.882137+0000","last_change":"2023-06-10T18:56:18.715713+0000","last_active":"2023-06-10T18:56:26.882137+0000","last_peered":"2023-06-10T18:56:26.882137+0000","last_clean":"2023-06-10T18:56:26.882137+0000","last_became_active":"2023-06-10T18:56:18.715403+0000","last_became_peered":"2023-06-10T18:56:18.715403+0000","last_unstale":"2023-06-10T18:56:26.882137+0000","last_undegraded":"2023-06-10T18:56:26.882137+0000","last_fullsized":"2023-06-10T18:56:26.882137+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:13:39.804832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.144321+0000","last_change":"2023-06-10T18:56:18.742396+0000","last_active":"2023-06-10T18:56:27.144321+0000","last_peered":"2023-06-10T18:56:27.144321+0000","last_clean":"2023-06-10T18:56:27.144321+0000","last_became_active":"2023-06-10T18:56:18.741689+0000","last_became_peered":"2023-06-10T18:56:18.741689+0000","last_unstale":"2023-06-10T18:56:27.144321+0000","last_undegraded":"2023-06-10T18:56:27.144321+0000","last_fullsized":"2023-06-10T18:56:27.144321+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:15:14.281447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.871175+0000","last_change":"2023-06-10T18:56:18.733830+0000","last_active":"2023-06-10T18:56:26.871175+0000","last_peered":"2023-06-10T18:56:26.871175+0000","last_clean":"2023-06-10T18:56:26.871175+0000","last_became_active":"2023-06-10T18:56:18.732968+0000","last_became_peered":"2023-06-10T18:56:18.732968+0000","last_unstale":"2023-06-10T18:56:26.871175+0000","last_undegraded":"2023-06-10T18:56:26.871175+0000","last_fullsized":"2023-06-10T18:56:26.871175+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:17:50.531074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.886873+0000","last_change":"2023-06-10T18:56:18.733304+0000","last_active":"2023-06-10T18:56:26.886873+0000","last_peered":"2023-06-10T18:56:26.886873+0000","last_clean":"2023-06-10T18:56:26.886873+0000","last_became_active":"2023-06-10T18:56:18.733010+0000","last_became_peered":"2023-06-10T18:56:18.733010+0000","last_unstale":"2023-06-10T18:56:26.886873+0000","last_undegraded":"2023-06-10T18:56:26.886873+0000","last_fullsized":"2023-06-10T18:56:26.886873+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:04:11.756055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.879556+0000","last_change":"2023-06-10T18:56:18.715925+0000","last_active":"2023-06-10T18:56:26.879556+0000","last_peered":"2023-06-10T18:56:26.879556+0000","last_clean":"2023-06-10T18:56:26.879556+0000","last_became_active":"2023-06-10T18:56:18.715163+0000","last_became_peered":"2023-06-10T18:56:18.715163+0000","last_unstale":"2023-06-10T18:56:26.879556+0000","last_undegraded":"2023-06-10T18:56:26.879556+0000","last_fullsized":"2023-06-10T18:56:26.879556+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:07:15.569502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.194669+0000","last_change":"2023-06-10T18:56:18.710693+0000","last_active":"2023-06-10T18:56:27.194669+0000","last_peered":"2023-06-10T18:56:27.194669+0000","last_clean":"2023-06-10T18:56:27.194669+0000","last_became_active":"2023-06-10T18:56:18.710420+0000","last_became_peered":"2023-06-10T18:56:18.710420+0000","last_unstale":"2023-06-10T18:56:27.194669+0000","last_undegraded":"2023-06-10T18:56:27.194669+0000","last_fullsized":"2023-06-10T18:56:27.194669+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:04:11.756055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.195404+0000","last_change":"2023-06-10T18:56:18.711205+0000","last_active":"2023-06-10T18:56:27.195404+0000","last_peered":"2023-06-10T18:56:27.195404+0000","last_clean":"2023-06-10T18:56:27.195404+0000","last_became_active":"2023-06-10T18:56:18.711011+0000","last_became_peered":"2023-06-10T18:56:18.711011+0000","last_unstale":"2023-06-10T18:56:27.195404+0000","last_undegraded":"2023-06-10T18:56:27.195404+0000","last_fullsized":"2023-06-10T18:56:27.195404+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:52:30.517410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.887403+0000","last_change":"2023-06-10T18:56:18.731703+0000","last_active":"2023-06-10T18:56:26.887403+0000","last_peered":"2023-06-10T18:56:26.887403+0000","last_clean":"2023-06-10T18:56:26.887403+0000","last_became_active":"2023-06-10T18:56:18.731407+0000","last_became_peered":"2023-06-10T18:56:18.731407+0000","last_unstale":"2023-06-10T18:56:26.887403+0000","last_undegraded":"2023-06-10T18:56:26.887403+0000","last_fullsized":"2023-06-10T18:56:26.887403+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:13:39.804832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.868234+0000","last_change":"2023-06-10T18:56:18.739026+0000","last_active":"2023-06-10T18:56:26.868234+0000","last_peered":"2023-06-10T18:56:26.868234+0000","last_clean":"2023-06-10T18:56:26.868234+0000","last_became_active":"2023-06-10T18:56:18.738748+0000","last_became_peered":"2023-06-10T18:56:18.738748+0000","last_unstale":"2023-06-10T18:56:26.868234+0000","last_undegraded":"2023-06-10T18:56:26.868234+0000","last_fullsized":"2023-06-10T18:56:26.868234+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:11:27.241616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.195269+0000","last_change":"2023-06-10T18:56:18.711319+0000","last_active":"2023-06-10T18:56:27.195269+0000","last_peered":"2023-06-10T18:56:27.195269+0000","last_clean":"2023-06-10T18:56:27.195269+0000","last_became_active":"2023-06-10T18:56:18.711043+0000","last_became_peered":"2023-06-10T18:56:18.711043+0000","last_unstale":"2023-06-10T18:56:27.195269+0000","last_undegraded":"2023-06-10T18:56:27.195269+0000","last_fullsized":"2023-06-10T18:56:27.195269+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:05:32.467816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.886977+0000","last_change":"2023-06-10T18:56:18.735130+0000","last_active":"2023-06-10T18:56:26.886977+0000","last_peered":"2023-06-10T18:56:26.886977+0000","last_clean":"2023-06-10T18:56:26.886977+0000","last_became_active":"2023-06-10T18:56:18.734873+0000","last_became_peered":"2023-06-10T18:56:18.734873+0000","last_unstale":"2023-06-10T18:56:26.886977+0000","last_undegraded":"2023-06-10T18:56:26.886977+0000","last_fullsized":"2023-06-10T18:56:26.886977+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:27:56.626985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.879977+0000","last_change":"2023-06-10T18:56:18.718525+0000","last_active":"2023-06-10T18:56:26.879977+0000","last_peered":"2023-06-10T18:56:26.879977+0000","last_clean":"2023-06-10T18:56:26.879977+0000","last_became_active":"2023-06-10T18:56:18.718169+0000","last_became_peered":"2023-06-10T18:56:18.718169+0000","last_unstale":"2023-06-10T18:56:26.879977+0000","last_undegraded":"2023-06-10T18:56:26.879977+0000","last_fullsized":"2023-06-10T18:56:26.879977+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:17:01.114014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.144057+0000","last_change":"2023-06-10T18:56:18.747220+0000","last_active":"2023-06-10T18:56:27.144057+0000","last_peered":"2023-06-10T18:56:27.144057+0000","last_clean":"2023-06-10T18:56:27.144057+0000","last_became_active":"2023-06-10T18:56:18.746415+0000","last_became_peered":"2023-06-10T18:56:18.746415+0000","last_unstale":"2023-06-10T18:56:27.144057+0000","last_undegraded":"2023-06-10T18:56:27.144057+0000","last_fullsized":"2023-06-10T18:56:27.144057+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:02:03.688477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.886572+0000","last_change":"2023-06-10T18:56:18.732379+0000","last_active":"2023-06-10T18:56:26.886572+0000","last_peered":"2023-06-10T18:56:26.886572+0000","last_clean":"2023-06-10T18:56:26.886572+0000","last_became_active":"2023-06-10T18:56:18.732081+0000","last_became_peered":"2023-06-10T18:56:18.732081+0000","last_unstale":"2023-06-10T18:56:26.886572+0000","last_undegraded":"2023-06-10T18:56:26.886572+0000","last_fullsized":"2023-06-10T18:56:26.886572+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:17:50.531074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.880795+0000","last_change":"2023-06-10T18:56:18.727402+0000","last_active":"2023-06-10T18:56:26.880795+0000","last_peered":"2023-06-10T18:56:26.880795+0000","last_clean":"2023-06-10T18:56:26.880795+0000","last_became_active":"2023-06-10T18:56:18.726939+0000","last_became_peered":"2023-06-10T18:56:18.726939+0000","last_unstale":"2023-06-10T18:56:26.880795+0000","last_undegraded":"2023-06-10T18:56:26.880795+0000","last_fullsized":"2023-06-10T18:56:26.880795+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:57:17.090045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.144764+0000","last_change":"2023-06-10T18:56:18.741248+0000","last_active":"2023-06-10T18:56:27.144764+0000","last_peered":"2023-06-10T18:56:27.144764+0000","last_clean":"2023-06-10T18:56:27.144764+0000","last_became_active":"2023-06-10T18:56:18.740548+0000","last_became_peered":"2023-06-10T18:56:18.740548+0000","last_unstale":"2023-06-10T18:56:27.144764+0000","last_undegraded":"2023-06-10T18:56:27.144764+0000","last_fullsized":"2023-06-10T18:56:27.144764+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:51:41.177614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.880542+0000","last_change":"2023-06-10T18:56:18.718426+0000","last_active":"2023-06-10T18:56:26.880542+0000","last_peered":"2023-06-10T18:56:26.880542+0000","last_clean":"2023-06-10T18:56:26.880542+0000","last_became_active":"2023-06-10T18:56:18.718017+0000","last_became_peered":"2023-06-10T18:56:18.718017+0000","last_unstale":"2023-06-10T18:56:26.880542+0000","last_undegraded":"2023-06-10T18:56:26.880542+0000","last_fullsized":"2023-06-10T18:56:26.880542+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:36:56.932324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.875458+0000","last_change":"2023-06-10T18:56:18.734189+0000","last_active":"2023-06-10T18:56:26.875458+0000","last_peered":"2023-06-10T18:56:26.875458+0000","last_clean":"2023-06-10T18:56:26.875458+0000","last_became_active":"2023-06-10T18:56:18.733412+0000","last_became_peered":"2023-06-10T18:56:18.733412+0000","last_unstale":"2023-06-10T18:56:26.875458+0000","last_undegraded":"2023-06-10T18:56:26.875458+0000","last_fullsized":"2023-06-10T18:56:26.875458+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:59:44.756321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.875364+0000","last_change":"2023-06-10T18:56:18.737307+0000","last_active":"2023-06-10T18:56:26.875364+0000","last_peered":"2023-06-10T18:56:26.875364+0000","last_clean":"2023-06-10T18:56:26.875364+0000","last_became_active":"2023-06-10T18:56:18.736534+0000","last_became_peered":"2023-06-10T18:56:18.736534+0000","last_unstale":"2023-06-10T18:56:26.875364+0000","last_undegraded":"2023-06-10T18:56:26.875364+0000","last_fullsized":"2023-06-10T18:56:26.875364+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:01:44.663641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.194660+0000","last_change":"2023-06-10T18:56:18.710819+0000","last_active":"2023-06-10T18:56:27.194660+0000","last_peered":"2023-06-10T18:56:27.194660+0000","last_clean":"2023-06-10T18:56:27.194660+0000","last_became_active":"2023-06-10T18:56:18.710524+0000","last_became_peered":"2023-06-10T18:56:18.710524+0000","last_unstale":"2023-06-10T18:56:27.194660+0000","last_undegraded":"2023-06-10T18:56:27.194660+0000","last_fullsized":"2023-06-10T18:56:27.194660+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:16:44.545696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.867692+0000","last_change":"2023-06-10T18:56:18.739719+0000","last_active":"2023-06-10T18:56:26.867692+0000","last_peered":"2023-06-10T18:56:26.867692+0000","last_clean":"2023-06-10T18:56:26.867692+0000","last_became_active":"2023-06-10T18:56:18.739394+0000","last_became_peered":"2023-06-10T18:56:18.739394+0000","last_unstale":"2023-06-10T18:56:26.867692+0000","last_undegraded":"2023-06-10T18:56:26.867692+0000","last_fullsized":"2023-06-10T18:56:26.867692+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:48:22.699885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.879440+0000","last_change":"2023-06-10T18:56:18.716014+0000","last_active":"2023-06-10T18:56:26.879440+0000","last_peered":"2023-06-10T18:56:26.879440+0000","last_clean":"2023-06-10T18:56:26.879440+0000","last_became_active":"2023-06-10T18:56:18.715463+0000","last_became_peered":"2023-06-10T18:56:18.715463+0000","last_unstale":"2023-06-10T18:56:26.879440+0000","last_undegraded":"2023-06-10T18:56:26.879440+0000","last_fullsized":"2023-06-10T18:56:26.879440+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:40:33.066988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.881131+0000","last_change":"2023-06-10T18:56:18.722488+0000","last_active":"2023-06-10T18:56:26.881131+0000","last_peered":"2023-06-10T18:56:26.881131+0000","last_clean":"2023-06-10T18:56:26.881131+0000","last_became_active":"2023-06-10T18:56:18.722221+0000","last_became_peered":"2023-06-10T18:56:18.722221+0000","last_unstale":"2023-06-10T18:56:26.881131+0000","last_undegraded":"2023-06-10T18:56:26.881131+0000","last_fullsized":"2023-06-10T18:56:26.881131+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:16:44.545696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.195014+0000","last_change":"2023-06-10T18:56:18.721449+0000","last_active":"2023-06-10T18:56:27.195014+0000","last_peered":"2023-06-10T18:56:27.195014+0000","last_clean":"2023-06-10T18:56:27.195014+0000","last_became_active":"2023-06-10T18:56:18.721191+0000","last_became_peered":"2023-06-10T18:56:18.721191+0000","last_unstale":"2023-06-10T18:56:27.195014+0000","last_undegraded":"2023-06-10T18:56:27.195014+0000","last_fullsized":"2023-06-10T18:56:27.195014+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:18:25.090460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.888495+0000","last_change":"2023-06-10T18:56:18.719671+0000","last_active":"2023-06-10T18:56:26.888495+0000","last_peered":"2023-06-10T18:56:26.888495+0000","last_clean":"2023-06-10T18:56:26.888495+0000","last_became_active":"2023-06-10T18:56:18.718588+0000","last_became_peered":"2023-06-10T18:56:18.718588+0000","last_unstale":"2023-06-10T18:56:26.888495+0000","last_undegraded":"2023-06-10T18:56:26.888495+0000","last_fullsized":"2023-06-10T18:56:26.888495+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:57:04.253762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.875781+0000","last_change":"2023-06-10T18:56:18.720108+0000","last_active":"2023-06-10T18:56:26.875781+0000","last_peered":"2023-06-10T18:56:26.875781+0000","last_clean":"2023-06-10T18:56:26.875781+0000","last_became_active":"2023-06-10T18:56:18.719242+0000","last_became_peered":"2023-06-10T18:56:18.719242+0000","last_unstale":"2023-06-10T18:56:26.875781+0000","last_undegraded":"2023-06-10T18:56:26.875781+0000","last_fullsized":"2023-06-10T18:56:26.875781+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:41:27.064954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.879750+0000","last_change":"2023-06-10T18:56:18.747959+0000","last_active":"2023-06-10T18:56:26.879750+0000","last_peered":"2023-06-10T18:56:26.879750+0000","last_clean":"2023-06-10T18:56:26.879750+0000","last_became_active":"2023-06-10T18:56:18.747680+0000","last_became_peered":"2023-06-10T18:56:18.747680+0000","last_unstale":"2023-06-10T18:56:26.879750+0000","last_undegraded":"2023-06-10T18:56:26.879750+0000","last_fullsized":"2023-06-10T18:56:26.879750+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:22:48.846033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.144212+0000","last_change":"2023-06-10T18:56:18.740103+0000","last_active":"2023-06-10T18:56:27.144212+0000","last_peered":"2023-06-10T18:56:27.144212+0000","last_clean":"2023-06-10T18:56:27.144212+0000","last_became_active":"2023-06-10T18:56:18.739227+0000","last_became_peered":"2023-06-10T18:56:18.739227+0000","last_unstale":"2023-06-10T18:56:27.144212+0000","last_undegraded":"2023-06-10T18:56:27.144212+0000","last_fullsized":"2023-06-10T18:56:27.144212+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:21:25.069656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.879705+0000","last_change":"2023-06-10T18:56:18.715535+0000","last_active":"2023-06-10T18:56:26.879705+0000","last_peered":"2023-06-10T18:56:26.879705+0000","last_clean":"2023-06-10T18:56:26.879705+0000","last_became_active":"2023-06-10T18:56:18.714677+0000","last_became_peered":"2023-06-10T18:56:18.714677+0000","last_unstale":"2023-06-10T18:56:26.879705+0000","last_undegraded":"2023-06-10T18:56:26.879705+0000","last_fullsized":"2023-06-10T18:56:26.879705+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:12:02.143937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.871827+0000","last_change":"2023-06-10T18:56:18.705775+0000","last_active":"2023-06-10T18:56:26.871827+0000","last_peered":"2023-06-10T18:56:26.871827+0000","last_clean":"2023-06-10T18:56:26.871827+0000","last_became_active":"2023-06-10T18:56:18.703437+0000","last_became_peered":"2023-06-10T18:56:18.703437+0000","last_unstale":"2023-06-10T18:56:26.871827+0000","last_undegraded":"2023-06-10T18:56:26.871827+0000","last_fullsized":"2023-06-10T18:56:26.871827+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:03:07.190449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.143717+0000","last_change":"2023-06-10T18:56:18.740486+0000","last_active":"2023-06-10T18:56:27.143717+0000","last_peered":"2023-06-10T18:56:27.143717+0000","last_clean":"2023-06-10T18:56:27.143717+0000","last_became_active":"2023-06-10T18:56:18.739644+0000","last_became_peered":"2023-06-10T18:56:18.739644+0000","last_unstale":"2023-06-10T18:56:27.143717+0000","last_undegraded":"2023-06-10T18:56:27.143717+0000","last_fullsized":"2023-06-10T18:56:27.143717+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:30:31.600689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"50'4","reported_seq":19,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.876540+0000","last_change":"2023-06-10T18:56:18.340764+0000","last_active":"2023-06-10T18:56:26.876540+0000","last_peered":"2023-06-10T18:56:26.876540+0000","last_clean":"2023-06-10T18:56:26.876540+0000","last_became_active":"2023-06-10T18:56:18.340011+0000","last_became_peered":"2023-06-10T18:56:18.340011+0000","last_unstale":"2023-06-10T18:56:26.876540+0000","last_undegraded":"2023-06-10T18:56:26.876540+0000","last_fullsized":"2023-06-10T18:56:26.876540+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:11:50.546839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.873041+0000","last_change":"2023-06-10T18:56:18.735833+0000","last_active":"2023-06-10T18:56:26.873041+0000","last_peered":"2023-06-10T18:56:26.873041+0000","last_clean":"2023-06-10T18:56:26.873041+0000","last_became_active":"2023-06-10T18:56:18.734668+0000","last_became_peered":"2023-06-10T18:56:18.734668+0000","last_unstale":"2023-06-10T18:56:26.873041+0000","last_undegraded":"2023-06-10T18:56:26.873041+0000","last_fullsized":"2023-06-10T18:56:26.873041+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:16:35.200792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"50'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.887551+0000","last_change":"2023-06-10T18:56:18.335972+0000","last_active":"2023-06-10T18:56:26.887551+0000","last_peered":"2023-06-10T18:56:26.887551+0000","last_clean":"2023-06-10T18:56:26.887551+0000","last_became_active":"2023-06-10T18:56:18.335565+0000","last_became_peered":"2023-06-10T18:56:18.335565+0000","last_unstale":"2023-06-10T18:56:26.887551+0000","last_undegraded":"2023-06-10T18:56:26.887551+0000","last_fullsized":"2023-06-10T18:56:26.887551+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:52:29.503909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.875187+0000","last_change":"2023-06-10T18:56:18.741042+0000","last_active":"2023-06-10T18:56:26.875187+0000","last_peered":"2023-06-10T18:56:26.875187+0000","last_clean":"2023-06-10T18:56:26.875187+0000","last_became_active":"2023-06-10T18:56:18.740325+0000","last_became_peered":"2023-06-10T18:56:18.740325+0000","last_unstale":"2023-06-10T18:56:26.875187+0000","last_undegraded":"2023-06-10T18:56:26.875187+0000","last_fullsized":"2023-06-10T18:56:26.875187+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:45:27.842047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"50'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.888555+0000","last_change":"2023-06-10T18:56:18.336603+0000","last_active":"2023-06-10T18:56:26.888555+0000","last_peered":"2023-06-10T18:56:26.888555+0000","last_clean":"2023-06-10T18:56:26.888555+0000","last_became_active":"2023-06-10T18:56:18.336117+0000","last_became_peered":"2023-06-10T18:56:18.336117+0000","last_unstale":"2023-06-10T18:56:26.888555+0000","last_undegraded":"2023-06-10T18:56:26.888555+0000","last_fullsized":"2023-06-10T18:56:26.888555+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:41:56.108306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.194691+0000","last_change":"2023-06-10T18:56:18.719404+0000","last_active":"2023-06-10T18:56:27.194691+0000","last_peered":"2023-06-10T18:56:27.194691+0000","last_clean":"2023-06-10T18:56:27.194691+0000","last_became_active":"2023-06-10T18:56:18.719096+0000","last_became_peered":"2023-06-10T18:56:18.719096+0000","last_unstale":"2023-06-10T18:56:27.194691+0000","last_undegraded":"2023-06-10T18:56:27.194691+0000","last_fullsized":"2023-06-10T18:56:27.194691+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:33:38.472734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"50'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.872249+0000","last_change":"2023-06-10T18:56:18.323382+0000","last_active":"2023-06-10T18:56:26.872249+0000","last_peered":"2023-06-10T18:56:26.872249+0000","last_clean":"2023-06-10T18:56:26.872249+0000","last_became_active":"2023-06-10T18:56:18.322748+0000","last_became_peered":"2023-06-10T18:56:18.322748+0000","last_unstale":"2023-06-10T18:56:26.872249+0000","last_undegraded":"2023-06-10T18:56:26.872249+0000","last_fullsized":"2023-06-10T18:56:26.872249+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:35:54.887943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.872083+0000","last_change":"2023-06-10T18:56:18.716497+0000","last_active":"2023-06-10T18:56:26.872083+0000","last_peered":"2023-06-10T18:56:26.872083+0000","last_clean":"2023-06-10T18:56:26.872083+0000","last_became_active":"2023-06-10T18:56:18.715689+0000","last_became_peered":"2023-06-10T18:56:18.715689+0000","last_unstale":"2023-06-10T18:56:26.872083+0000","last_undegraded":"2023-06-10T18:56:26.872083+0000","last_fullsized":"2023-06-10T18:56:26.872083+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:27:56.626985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"50'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.880042+0000","last_change":"2023-06-10T18:56:18.321017+0000","last_active":"2023-06-10T18:56:26.880042+0000","last_peered":"2023-06-10T18:56:26.880042+0000","last_clean":"2023-06-10T18:56:26.880042+0000","last_became_active":"2023-06-10T18:56:18.320552+0000","last_became_peered":"2023-06-10T18:56:18.320552+0000","last_unstale":"2023-06-10T18:56:26.880042+0000","last_undegraded":"2023-06-10T18:56:26.880042+0000","last_fullsized":"2023-06-10T18:56:26.880042+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:53:30.066871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.144497+0000","last_change":"2023-06-10T18:56:18.742047+0000","last_active":"2023-06-10T18:56:27.144497+0000","last_peered":"2023-06-10T18:56:27.144497+0000","last_clean":"2023-06-10T18:56:27.144497+0000","last_became_active":"2023-06-10T18:56:18.741342+0000","last_became_peered":"2023-06-10T18:56:18.741342+0000","last_unstale":"2023-06-10T18:56:27.144497+0000","last_undegraded":"2023-06-10T18:56:27.144497+0000","last_fullsized":"2023-06-10T18:56:27.144497+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:39:30.440026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"50'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.871399+0000","last_change":"2023-06-10T18:56:18.339655+0000","last_active":"2023-06-10T18:56:26.871399+0000","last_peered":"2023-06-10T18:56:26.871399+0000","last_clean":"2023-06-10T18:56:26.871399+0000","last_became_active":"2023-06-10T18:56:18.338930+0000","last_became_peered":"2023-06-10T18:56:18.338930+0000","last_unstale":"2023-06-10T18:56:26.871399+0000","last_undegraded":"2023-06-10T18:56:26.871399+0000","last_fullsized":"2023-06-10T18:56:26.871399+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:57:16.076543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.195762+0000","last_change":"2023-06-10T18:56:18.721372+0000","last_active":"2023-06-10T18:56:27.195762+0000","last_peered":"2023-06-10T18:56:27.195762+0000","last_clean":"2023-06-10T18:56:27.195762+0000","last_became_active":"2023-06-10T18:56:18.721086+0000","last_became_peered":"2023-06-10T18:56:18.721086+0000","last_unstale":"2023-06-10T18:56:27.195762+0000","last_undegraded":"2023-06-10T18:56:27.195762+0000","last_fullsized":"2023-06-10T18:56:27.195762+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:36:50.106017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.875086+0000","last_change":"2023-06-10T18:56:18.337501+0000","last_active":"2023-06-10T18:56:26.875086+0000","last_peered":"2023-06-10T18:56:26.875086+0000","last_clean":"2023-06-10T18:56:26.875086+0000","last_became_active":"2023-06-10T18:56:18.336875+0000","last_became_peered":"2023-06-10T18:56:18.336875+0000","last_unstale":"2023-06-10T18:56:26.875086+0000","last_undegraded":"2023-06-10T18:56:26.875086+0000","last_fullsized":"2023-06-10T18:56:26.875086+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:54:49.818477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.144972+0000","last_change":"2023-06-10T18:56:18.740844+0000","last_active":"2023-06-10T18:56:27.144972+0000","last_peered":"2023-06-10T18:56:27.144972+0000","last_clean":"2023-06-10T18:56:27.144972+0000","last_became_active":"2023-06-10T18:56:18.740202+0000","last_became_peered":"2023-06-10T18:56:18.740202+0000","last_unstale":"2023-06-10T18:56:27.144972+0000","last_undegraded":"2023-06-10T18:56:27.144972+0000","last_fullsized":"2023-06-10T18:56:27.144972+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:34:13.702327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.879577+0000","last_change":"2023-06-10T18:56:18.328357+0000","last_active":"2023-06-10T18:56:26.879577+0000","last_peered":"2023-06-10T18:56:26.879577+0000","last_clean":"2023-06-10T18:56:26.879577+0000","last_became_active":"2023-06-10T18:56:18.328062+0000","last_became_peered":"2023-06-10T18:56:18.328062+0000","last_unstale":"2023-06-10T18:56:26.879577+0000","last_undegraded":"2023-06-10T18:56:26.879577+0000","last_fullsized":"2023-06-10T18:56:26.879577+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:42:04.516586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.870557+0000","last_change":"2023-06-10T18:56:18.715041+0000","last_active":"2023-06-10T18:56:26.870557+0000","last_peered":"2023-06-10T18:56:26.870557+0000","last_clean":"2023-06-10T18:56:26.870557+0000","last_became_active":"2023-06-10T18:56:18.714315+0000","last_became_peered":"2023-06-10T18:56:18.714315+0000","last_unstale":"2023-06-10T18:56:26.870557+0000","last_undegraded":"2023-06-10T18:56:26.870557+0000","last_fullsized":"2023-06-10T18:56:26.870557+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:23:30.185213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.144647+0000","last_change":"2023-06-10T18:56:18.343930+0000","last_active":"2023-06-10T18:56:27.144647+0000","last_peered":"2023-06-10T18:56:27.144647+0000","last_clean":"2023-06-10T18:56:27.144647+0000","last_became_active":"2023-06-10T18:56:18.343289+0000","last_became_peered":"2023-06-10T18:56:18.343289+0000","last_unstale":"2023-06-10T18:56:27.144647+0000","last_undegraded":"2023-06-10T18:56:27.144647+0000","last_fullsized":"2023-06-10T18:56:27.144647+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:14:05.116786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.872895+0000","last_change":"2023-06-10T18:56:18.720481+0000","last_active":"2023-06-10T18:56:26.872895+0000","last_peered":"2023-06-10T18:56:26.872895+0000","last_clean":"2023-06-10T18:56:26.872895+0000","last_became_active":"2023-06-10T18:56:18.717729+0000","last_became_peered":"2023-06-10T18:56:18.717729+0000","last_unstale":"2023-06-10T18:56:26.872895+0000","last_undegraded":"2023-06-10T18:56:26.872895+0000","last_fullsized":"2023-06-10T18:56:26.872895+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:07:34.244620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.872218+0000","last_change":"2023-06-10T18:56:18.331216+0000","last_active":"2023-06-10T18:56:26.872218+0000","last_peered":"2023-06-10T18:56:26.872218+0000","last_clean":"2023-06-10T18:56:26.872218+0000","last_became_active":"2023-06-10T18:56:18.330640+0000","last_became_peered":"2023-06-10T18:56:18.330640+0000","last_unstale":"2023-06-10T18:56:26.872218+0000","last_undegraded":"2023-06-10T18:56:26.872218+0000","last_fullsized":"2023-06-10T18:56:26.872218+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:16:43.532194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.880373+0000","last_change":"2023-06-10T18:56:18.745850+0000","last_active":"2023-06-10T18:56:26.880373+0000","last_peered":"2023-06-10T18:56:26.880373+0000","last_clean":"2023-06-10T18:56:26.880373+0000","last_became_active":"2023-06-10T18:56:18.745516+0000","last_became_peered":"2023-06-10T18:56:18.745516+0000","last_unstale":"2023-06-10T18:56:26.880373+0000","last_undegraded":"2023-06-10T18:56:26.880373+0000","last_fullsized":"2023-06-10T18:56:26.880373+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:53:56.836970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"50'3","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.144726+0000","last_change":"2023-06-10T18:56:18.341819+0000","last_active":"2023-06-10T18:56:27.144726+0000","last_peered":"2023-06-10T18:56:27.144726+0000","last_clean":"2023-06-10T18:56:27.144726+0000","last_became_active":"2023-06-10T18:56:18.341153+0000","last_became_peered":"2023-06-10T18:56:18.341153+0000","last_unstale":"2023-06-10T18:56:27.144726+0000","last_undegraded":"2023-06-10T18:56:27.144726+0000","last_fullsized":"2023-06-10T18:56:27.144726+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:13:55.771862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.871435+0000","last_change":"2023-06-10T18:56:18.718945+0000","last_active":"2023-06-10T18:56:26.871435+0000","last_peered":"2023-06-10T18:56:26.871435+0000","last_clean":"2023-06-10T18:56:26.871435+0000","last_became_active":"2023-06-10T18:56:18.717962+0000","last_became_peered":"2023-06-10T18:56:18.717962+0000","last_unstale":"2023-06-10T18:56:26.871435+0000","last_undegraded":"2023-06-10T18:56:26.871435+0000","last_fullsized":"2023-06-10T18:56:26.871435+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:04:11.756055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"50'6","reported_seq":21,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.195682+0000","last_change":"2023-06-10T18:56:18.333312+0000","last_active":"2023-06-10T18:56:27.195682+0000","last_peered":"2023-06-10T18:56:27.195682+0000","last_clean":"2023-06-10T18:56:27.195682+0000","last_became_active":"2023-06-10T18:56:18.332390+0000","last_became_peered":"2023-06-10T18:56:18.332390+0000","last_unstale":"2023-06-10T18:56:27.195682+0000","last_undegraded":"2023-06-10T18:56:27.195682+0000","last_fullsized":"2023-06-10T18:56:27.195682+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:04:57.213752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.871933+0000","last_change":"2023-06-10T18:56:18.739711+0000","last_active":"2023-06-10T18:56:26.871933+0000","last_peered":"2023-06-10T18:56:26.871933+0000","last_clean":"2023-06-10T18:56:26.871933+0000","last_became_active":"2023-06-10T18:56:18.738999+0000","last_became_peered":"2023-06-10T18:56:18.738999+0000","last_unstale":"2023-06-10T18:56:26.871933+0000","last_undegraded":"2023-06-10T18:56:26.871933+0000","last_fullsized":"2023-06-10T18:56:26.871933+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:14:23.654180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"50'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.880149+0000","last_change":"2023-06-10T18:56:18.342157+0000","last_active":"2023-06-10T18:56:26.880149+0000","last_peered":"2023-06-10T18:56:26.880149+0000","last_clean":"2023-06-10T18:56:26.880149+0000","last_became_active":"2023-06-10T18:56:18.341576+0000","last_became_peered":"2023-06-10T18:56:18.341576+0000","last_unstale":"2023-06-10T18:56:26.880149+0000","last_undegraded":"2023-06-10T18:56:26.880149+0000","last_fullsized":"2023-06-10T18:56:26.880149+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:23:29.171711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":2,"reported_epoch":52,"state":"peering","last_fresh":"2023-06-10T18:56:22.631216+0000","last_change":"2023-06-10T18:56:27.634240+0000","last_active":"2023-06-10T18:56:27.634240+0000","last_peered":"2023-06-10T18:56:22.631216+0000","last_clean":"2023-06-10T18:56:22.631216+0000","last_became_active":"2023-06-10T18:56:18.711779+0000","last_became_peered":"2023-06-10T18:56:18.711779+0000","last_unstale":"2023-06-10T18:56:22.631216+0000","last_undegraded":"2023-06-10T18:56:22.631216+0000","last_fullsized":"2023-06-10T18:56:22.631216+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.875792+0000","last_change":"2023-06-10T18:56:18.335774+0000","last_active":"2023-06-10T18:56:26.875792+0000","last_peered":"2023-06-10T18:56:26.875792+0000","last_clean":"2023-06-10T18:56:26.875792+0000","last_became_active":"2023-06-10T18:56:18.334295+0000","last_became_peered":"2023-06-10T18:56:18.334295+0000","last_unstale":"2023-06-10T18:56:26.875792+0000","last_undegraded":"2023-06-10T18:56:26.875792+0000","last_fullsized":"2023-06-10T18:56:26.875792+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:45:39.069258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.195203+0000","last_change":"2023-06-10T18:56:18.732193+0000","last_active":"2023-06-10T18:56:27.195203+0000","last_peered":"2023-06-10T18:56:27.195203+0000","last_clean":"2023-06-10T18:56:27.195203+0000","last_became_active":"2023-06-10T18:56:18.731876+0000","last_became_peered":"2023-06-10T18:56:18.731876+0000","last_unstale":"2023-06-10T18:56:27.195203+0000","last_undegraded":"2023-06-10T18:56:27.195203+0000","last_fullsized":"2023-06-10T18:56:27.195203+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:41:57.121808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.144429+0000","last_change":"2023-06-10T18:56:18.348170+0000","last_active":"2023-06-10T18:56:27.144429+0000","last_peered":"2023-06-10T18:56:27.144429+0000","last_clean":"2023-06-10T18:56:27.144429+0000","last_became_active":"2023-06-10T18:56:18.347458+0000","last_became_peered":"2023-06-10T18:56:18.347458+0000","last_unstale":"2023-06-10T18:56:27.144429+0000","last_undegraded":"2023-06-10T18:56:27.144429+0000","last_fullsized":"2023-06-10T18:56:27.144429+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:08:51.581596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.880965+0000","last_change":"2023-06-10T18:56:18.727211+0000","last_active":"2023-06-10T18:56:26.880965+0000","last_peered":"2023-06-10T18:56:26.880965+0000","last_clean":"2023-06-10T18:56:26.880965+0000","last_became_active":"2023-06-10T18:56:18.726575+0000","last_became_peered":"2023-06-10T18:56:18.726575+0000","last_unstale":"2023-06-10T18:56:26.880965+0000","last_undegraded":"2023-06-10T18:56:26.880965+0000","last_fullsized":"2023-06-10T18:56:26.880965+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:04:11.756055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"50'8","reported_seq":23,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.195340+0000","last_change":"2023-06-10T18:56:18.332240+0000","last_active":"2023-06-10T18:56:27.195340+0000","last_peered":"2023-06-10T18:56:27.195340+0000","last_clean":"2023-06-10T18:56:27.195340+0000","last_became_active":"2023-06-10T18:56:18.331781+0000","last_became_peered":"2023-06-10T18:56:18.331781+0000","last_unstale":"2023-06-10T18:56:27.195340+0000","last_undegraded":"2023-06-10T18:56:27.195340+0000","last_fullsized":"2023-06-10T18:56:27.195340+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:23:26.069557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.195018+0000","last_change":"2023-06-10T18:56:18.702816+0000","last_active":"2023-06-10T18:56:27.195018+0000","last_peered":"2023-06-10T18:56:27.195018+0000","last_clean":"2023-06-10T18:56:27.195018+0000","last_became_active":"2023-06-10T18:56:18.702527+0000","last_became_peered":"2023-06-10T18:56:18.702527+0000","last_unstale":"2023-06-10T18:56:27.195018+0000","last_undegraded":"2023-06-10T18:56:27.195018+0000","last_fullsized":"2023-06-10T18:56:27.195018+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:01:30.967639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"50'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.881337+0000","last_change":"2023-06-10T18:56:18.324631+0000","last_active":"2023-06-10T18:56:26.881337+0000","last_peered":"2023-06-10T18:56:26.881337+0000","last_clean":"2023-06-10T18:56:26.881337+0000","last_became_active":"2023-06-10T18:56:18.324243+0000","last_became_peered":"2023-06-10T18:56:18.324243+0000","last_unstale":"2023-06-10T18:56:26.881337+0000","last_undegraded":"2023-06-10T18:56:26.881337+0000","last_fullsized":"2023-06-10T18:56:26.881337+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:01:29.954138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.886746+0000","last_change":"2023-06-10T18:56:18.710557+0000","last_active":"2023-06-10T18:56:26.886746+0000","last_peered":"2023-06-10T18:56:26.886746+0000","last_clean":"2023-06-10T18:56:26.886746+0000","last_became_active":"2023-06-10T18:56:18.710238+0000","last_became_peered":"2023-06-10T18:56:18.710238+0000","last_unstale":"2023-06-10T18:56:26.886746+0000","last_undegraded":"2023-06-10T18:56:26.886746+0000","last_fullsized":"2023-06-10T18:56:26.886746+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:57:17.090045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"50'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.869232+0000","last_change":"2023-06-10T18:56:18.324362+0000","last_active":"2023-06-10T18:56:26.869232+0000","last_peered":"2023-06-10T18:56:26.869232+0000","last_clean":"2023-06-10T18:56:26.869232+0000","last_became_active":"2023-06-10T18:56:18.323943+0000","last_became_peered":"2023-06-10T18:56:18.323943+0000","last_unstale":"2023-06-10T18:56:26.869232+0000","last_undegraded":"2023-06-10T18:56:26.869232+0000","last_fullsized":"2023-06-10T18:56:26.869232+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:13:38.851442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.871058+0000","last_change":"2023-06-10T18:56:18.715476+0000","last_active":"2023-06-10T18:56:26.871058+0000","last_peered":"2023-06-10T18:56:26.871058+0000","last_clean":"2023-06-10T18:56:26.871058+0000","last_became_active":"2023-06-10T18:56:18.714697+0000","last_became_peered":"2023-06-10T18:56:18.714697+0000","last_unstale":"2023-06-10T18:56:26.871058+0000","last_undegraded":"2023-06-10T18:56:26.871058+0000","last_fullsized":"2023-06-10T18:56:26.871058+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:36:56.932324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"50'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.876240+0000","last_change":"2023-06-10T18:56:18.341065+0000","last_active":"2023-06-10T18:56:26.876240+0000","last_peered":"2023-06-10T18:56:26.876240+0000","last_clean":"2023-06-10T18:56:26.876240+0000","last_became_active":"2023-06-10T18:56:18.340242+0000","last_became_peered":"2023-06-10T18:56:18.340242+0000","last_unstale":"2023-06-10T18:56:26.876240+0000","last_undegraded":"2023-06-10T18:56:26.876240+0000","last_fullsized":"2023-06-10T18:56:26.876240+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:27:46.347276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.887392+0000","last_change":"2023-06-10T18:56:18.722679+0000","last_active":"2023-06-10T18:56:26.887392+0000","last_peered":"2023-06-10T18:56:26.887392+0000","last_clean":"2023-06-10T18:56:26.887392+0000","last_became_active":"2023-06-10T18:56:18.722389+0000","last_became_peered":"2023-06-10T18:56:18.722389+0000","last_unstale":"2023-06-10T18:56:26.887392+0000","last_undegraded":"2023-06-10T18:56:26.887392+0000","last_fullsized":"2023-06-10T18:56:26.887392+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:01:30.967639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.875808+0000","last_change":"2023-06-10T18:56:18.335157+0000","last_active":"2023-06-10T18:56:26.875808+0000","last_peered":"2023-06-10T18:56:26.875808+0000","last_clean":"2023-06-10T18:56:26.875808+0000","last_became_active":"2023-06-10T18:56:18.334417+0000","last_became_peered":"2023-06-10T18:56:18.334417+0000","last_unstale":"2023-06-10T18:56:26.875808+0000","last_undegraded":"2023-06-10T18:56:26.875808+0000","last_fullsized":"2023-06-10T18:56:26.875808+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:43:46.237306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.872091+0000","last_change":"2023-06-10T18:56:18.720351+0000","last_active":"2023-06-10T18:56:26.872091+0000","last_peered":"2023-06-10T18:56:26.872091+0000","last_clean":"2023-06-10T18:56:26.872091+0000","last_became_active":"2023-06-10T18:56:18.717962+0000","last_became_peered":"2023-06-10T18:56:18.717962+0000","last_unstale":"2023-06-10T18:56:26.872091+0000","last_undegraded":"2023-06-10T18:56:26.872091+0000","last_fullsized":"2023-06-10T18:56:26.872091+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:55:10.132650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"50'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.887432+0000","last_change":"2023-06-10T18:56:18.337149+0000","last_active":"2023-06-10T18:56:26.887432+0000","last_peered":"2023-06-10T18:56:26.887432+0000","last_clean":"2023-06-10T18:56:26.887432+0000","last_became_active":"2023-06-10T18:56:18.335525+0000","last_became_peered":"2023-06-10T18:56:18.335525+0000","last_unstale":"2023-06-10T18:56:26.887432+0000","last_undegraded":"2023-06-10T18:56:26.887432+0000","last_fullsized":"2023-06-10T18:56:26.887432+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:23:26.069557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.876152+0000","last_change":"2023-06-10T18:56:18.734899+0000","last_active":"2023-06-10T18:56:26.876152+0000","last_peered":"2023-06-10T18:56:26.876152+0000","last_clean":"2023-06-10T18:56:26.876152+0000","last_became_active":"2023-06-10T18:56:18.734152+0000","last_became_peered":"2023-06-10T18:56:18.734152+0000","last_unstale":"2023-06-10T18:56:26.876152+0000","last_undegraded":"2023-06-10T18:56:26.876152+0000","last_fullsized":"2023-06-10T18:56:26.876152+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:16:15.404759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.194661+0000","last_change":"2023-06-10T18:56:18.332341+0000","last_active":"2023-06-10T18:56:27.194661+0000","last_peered":"2023-06-10T18:56:27.194661+0000","last_clean":"2023-06-10T18:56:27.194661+0000","last_became_active":"2023-06-10T18:56:18.331836+0000","last_became_peered":"2023-06-10T18:56:18.331836+0000","last_unstale":"2023-06-10T18:56:27.194661+0000","last_undegraded":"2023-06-10T18:56:27.194661+0000","last_fullsized":"2023-06-10T18:56:27.194661+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:27:55.613483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.881243+0000","last_change":"2023-06-10T18:56:18.745846+0000","last_active":"2023-06-10T18:56:26.881243+0000","last_peered":"2023-06-10T18:56:26.881243+0000","last_clean":"2023-06-10T18:56:26.881243+0000","last_became_active":"2023-06-10T18:56:18.745527+0000","last_became_peered":"2023-06-10T18:56:18.745527+0000","last_unstale":"2023-06-10T18:56:26.881243+0000","last_undegraded":"2023-06-10T18:56:26.881243+0000","last_fullsized":"2023-06-10T18:56:26.881243+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:33:38.472734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.879935+0000","last_change":"2023-06-10T18:56:18.337764+0000","last_active":"2023-06-10T18:56:26.879935+0000","last_peered":"2023-06-10T18:56:26.879935+0000","last_clean":"2023-06-10T18:56:26.879935+0000","last_became_active":"2023-06-10T18:56:18.337390+0000","last_became_peered":"2023-06-10T18:56:18.337390+0000","last_unstale":"2023-06-10T18:56:26.879935+0000","last_undegraded":"2023-06-10T18:56:26.879935+0000","last_fullsized":"2023-06-10T18:56:26.879935+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:54:06.053571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.887362+0000","last_change":"2023-06-10T18:56:18.705770+0000","last_active":"2023-06-10T18:56:26.887362+0000","last_peered":"2023-06-10T18:56:26.887362+0000","last_clean":"2023-06-10T18:56:26.887362+0000","last_became_active":"2023-06-10T18:56:18.705487+0000","last_became_peered":"2023-06-10T18:56:18.705487+0000","last_unstale":"2023-06-10T18:56:26.887362+0000","last_undegraded":"2023-06-10T18:56:26.887362+0000","last_fullsized":"2023-06-10T18:56:26.887362+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:18:25.090460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.867631+0000","last_change":"2023-06-10T18:56:18.339683+0000","last_active":"2023-06-10T18:56:26.867631+0000","last_peered":"2023-06-10T18:56:26.867631+0000","last_clean":"2023-06-10T18:56:26.867631+0000","last_became_active":"2023-06-10T18:56:18.339076+0000","last_became_peered":"2023-06-10T18:56:18.339076+0000","last_unstale":"2023-06-10T18:56:26.867631+0000","last_undegraded":"2023-06-10T18:56:26.867631+0000","last_fullsized":"2023-06-10T18:56:26.867631+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:24:21.579841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.874936+0000","last_change":"2023-06-10T18:56:18.724347+0000","last_active":"2023-06-10T18:56:26.874936+0000","last_peered":"2023-06-10T18:56:26.874936+0000","last_clean":"2023-06-10T18:56:26.874936+0000","last_became_active":"2023-06-10T18:56:18.723327+0000","last_became_peered":"2023-06-10T18:56:18.723327+0000","last_unstale":"2023-06-10T18:56:26.874936+0000","last_undegraded":"2023-06-10T18:56:26.874936+0000","last_fullsized":"2023-06-10T18:56:26.874936+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:06:54.175628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"51'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.881525+0000","last_change":"2023-06-10T18:56:18.337157+0000","last_active":"2023-06-10T18:56:26.881525+0000","last_peered":"2023-06-10T18:56:26.881525+0000","last_clean":"2023-06-10T18:56:26.881525+0000","last_became_active":"2023-06-10T18:56:18.336768+0000","last_became_peered":"2023-06-10T18:56:18.336768+0000","last_unstale":"2023-06-10T18:56:26.881525+0000","last_undegraded":"2023-06-10T18:56:26.881525+0000","last_fullsized":"2023-06-10T18:56:26.881525+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:18:24.076958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":224,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.143607+0000","last_change":"2023-06-10T18:52:34.951528+0000","last_active":"2023-06-10T18:56:27.143607+0000","last_peered":"2023-06-10T18:56:27.143607+0000","last_clean":"2023-06-10T18:56:27.143607+0000","last_became_active":"2023-06-10T18:52:34.949099+0000","last_became_peered":"2023-06-10T18:52:34.949099+0000","last_unstale":"2023-06-10T18:56:27.143607+0000","last_undegraded":"2023-06-10T18:56:27.143607+0000","last_fullsized":"2023-06-10T18:56:27.143607+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_clean_scrub_stamp":"2023-06-10T18:52:33.633295+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:48:42.927886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":70,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.872604+0000","last_change":"2023-06-10T18:52:40.506384+0000","last_active":"2023-06-10T18:56:26.872604+0000","last_peered":"2023-06-10T18:56:26.872604+0000","last_clean":"2023-06-10T18:56:26.872604+0000","last_became_active":"2023-06-10T18:52:40.505701+0000","last_became_peered":"2023-06-10T18:52:40.505701+0000","last_unstale":"2023-06-10T18:56:26.872604+0000","last_undegraded":"2023-06-10T18:56:26.872604+0000","last_fullsized":"2023-06-10T18:56:26.872604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:48:00.502223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.887017+0000","last_change":"2023-06-10T18:56:18.714433+0000","last_active":"2023-06-10T18:56:26.887017+0000","last_peered":"2023-06-10T18:56:26.887017+0000","last_clean":"2023-06-10T18:56:26.887017+0000","last_became_active":"2023-06-10T18:56:18.714070+0000","last_became_peered":"2023-06-10T18:56:18.714070+0000","last_unstale":"2023-06-10T18:56:26.887017+0000","last_undegraded":"2023-06-10T18:56:26.887017+0000","last_fullsized":"2023-06-10T18:56:26.887017+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:16:44.545696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.144734+0000","last_change":"2023-06-10T18:56:18.341822+0000","last_active":"2023-06-10T18:56:27.144734+0000","last_peered":"2023-06-10T18:56:27.144734+0000","last_clean":"2023-06-10T18:56:27.144734+0000","last_became_active":"2023-06-10T18:56:18.341138+0000","last_became_peered":"2023-06-10T18:56:18.341138+0000","last_unstale":"2023-06-10T18:56:27.144734+0000","last_undegraded":"2023-06-10T18:56:27.144734+0000","last_fullsized":"2023-06-10T18:56:27.144734+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:19:07.044160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":68,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.144020+0000","last_change":"2023-06-10T18:52:40.512015+0000","last_active":"2023-06-10T18:56:27.144020+0000","last_peered":"2023-06-10T18:56:27.144020+0000","last_clean":"2023-06-10T18:56:27.144020+0000","last_became_active":"2023-06-10T18:52:40.511382+0000","last_became_peered":"2023-06-10T18:52:40.511382+0000","last_unstale":"2023-06-10T18:56:27.144020+0000","last_undegraded":"2023-06-10T18:56:27.144020+0000","last_fullsized":"2023-06-10T18:56:27.144020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:10:22.176800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.195451+0000","last_change":"2023-06-10T18:56:18.720642+0000","last_active":"2023-06-10T18:56:27.195451+0000","last_peered":"2023-06-10T18:56:27.195451+0000","last_clean":"2023-06-10T18:56:27.195451+0000","last_became_active":"2023-06-10T18:56:18.720385+0000","last_became_peered":"2023-06-10T18:56:18.720385+0000","last_unstale":"2023-06-10T18:56:27.195451+0000","last_undegraded":"2023-06-10T18:56:27.195451+0000","last_fullsized":"2023-06-10T18:56:27.195451+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:44:56.381072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.881015+0000","last_change":"2023-06-10T18:56:18.320760+0000","last_active":"2023-06-10T18:56:26.881015+0000","last_peered":"2023-06-10T18:56:26.881015+0000","last_clean":"2023-06-10T18:56:26.881015+0000","last_became_active":"2023-06-10T18:56:18.320373+0000","last_became_peered":"2023-06-10T18:56:18.320373+0000","last_unstale":"2023-06-10T18:56:26.881015+0000","last_undegraded":"2023-06-10T18:56:26.881015+0000","last_fullsized":"2023-06-10T18:56:26.881015+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:27:55.613483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":70,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.867695+0000","last_change":"2023-06-10T18:52:40.671725+0000","last_active":"2023-06-10T18:56:26.867695+0000","last_peered":"2023-06-10T18:56:26.867695+0000","last_clean":"2023-06-10T18:56:26.867695+0000","last_became_active":"2023-06-10T18:52:40.671442+0000","last_became_peered":"2023-06-10T18:52:40.671442+0000","last_unstale":"2023-06-10T18:56:26.867695+0000","last_undegraded":"2023-06-10T18:56:26.867695+0000","last_fullsized":"2023-06-10T18:56:26.867695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:26:09.367931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.872142+0000","last_change":"2023-06-10T18:56:18.704278+0000","last_active":"2023-06-10T18:56:26.872142+0000","last_peered":"2023-06-10T18:56:26.872142+0000","last_clean":"2023-06-10T18:56:26.872142+0000","last_became_active":"2023-06-10T18:56:18.703336+0000","last_became_peered":"2023-06-10T18:56:18.703336+0000","last_unstale":"2023-06-10T18:56:26.872142+0000","last_undegraded":"2023-06-10T18:56:26.872142+0000","last_fullsized":"2023-06-10T18:56:26.872142+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:43:45.838944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"50'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.876735+0000","last_change":"2023-06-10T18:56:18.335741+0000","last_active":"2023-06-10T18:56:26.876735+0000","last_peered":"2023-06-10T18:56:26.876735+0000","last_clean":"2023-06-10T18:56:26.876735+0000","last_became_active":"2023-06-10T18:56:18.334904+0000","last_became_peered":"2023-06-10T18:56:18.334904+0000","last_unstale":"2023-06-10T18:56:26.876735+0000","last_undegraded":"2023-06-10T18:56:26.876735+0000","last_fullsized":"2023-06-10T18:56:26.876735+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:08:18.807313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":70,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.871228+0000","last_change":"2023-06-10T18:52:40.510258+0000","last_active":"2023-06-10T18:56:26.871228+0000","last_peered":"2023-06-10T18:56:26.871228+0000","last_clean":"2023-06-10T18:56:26.871228+0000","last_became_active":"2023-06-10T18:52:40.509560+0000","last_became_peered":"2023-06-10T18:52:40.509560+0000","last_unstale":"2023-06-10T18:56:26.871228+0000","last_undegraded":"2023-06-10T18:56:26.871228+0000","last_fullsized":"2023-06-10T18:56:26.871228+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:43:32.943829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":2,"reported_epoch":52,"state":"peering","last_fresh":"2023-06-10T18:56:22.631242+0000","last_change":"2023-06-10T18:56:27.634300+0000","last_active":"2023-06-10T18:56:27.634300+0000","last_peered":"2023-06-10T18:56:22.631242+0000","last_clean":"2023-06-10T18:56:22.631242+0000","last_became_active":"2023-06-10T18:56:18.715542+0000","last_became_peered":"2023-06-10T18:56:18.715542+0000","last_unstale":"2023-06-10T18:56:22.631242+0000","last_undegraded":"2023-06-10T18:56:22.631242+0000","last_fullsized":"2023-06-10T18:56:22.631242+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.870792+0000","last_change":"2023-06-10T18:56:18.325010+0000","last_active":"2023-06-10T18:56:26.870792+0000","last_peered":"2023-06-10T18:56:26.870792+0000","last_clean":"2023-06-10T18:56:26.870792+0000","last_became_active":"2023-06-10T18:56:18.324414+0000","last_became_peered":"2023-06-10T18:56:18.324414+0000","last_unstale":"2023-06-10T18:56:26.870792+0000","last_undegraded":"2023-06-10T18:56:26.870792+0000","last_fullsized":"2023-06-10T18:56:26.870792+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:53:55.823468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":66,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.887066+0000","last_change":"2023-06-10T18:52:40.672266+0000","last_active":"2023-06-10T18:56:26.887066+0000","last_peered":"2023-06-10T18:56:26.887066+0000","last_clean":"2023-06-10T18:56:26.887066+0000","last_became_active":"2023-06-10T18:52:40.671966+0000","last_became_peered":"2023-06-10T18:52:40.671966+0000","last_unstale":"2023-06-10T18:56:26.887066+0000","last_undegraded":"2023-06-10T18:56:26.887066+0000","last_fullsized":"2023-06-10T18:56:26.887066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:29:59.663767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.195764+0000","last_change":"2023-06-10T18:56:18.703583+0000","last_active":"2023-06-10T18:56:27.195764+0000","last_peered":"2023-06-10T18:56:27.195764+0000","last_clean":"2023-06-10T18:56:27.195764+0000","last_became_active":"2023-06-10T18:56:18.703292+0000","last_became_peered":"2023-06-10T18:56:18.703292+0000","last_unstale":"2023-06-10T18:56:27.195764+0000","last_undegraded":"2023-06-10T18:56:27.195764+0000","last_fullsized":"2023-06-10T18:56:27.195764+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:37:45.597946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.872441+0000","last_change":"2023-06-10T18:56:18.331871+0000","last_active":"2023-06-10T18:56:26.872441+0000","last_peered":"2023-06-10T18:56:26.872441+0000","last_clean":"2023-06-10T18:56:26.872441+0000","last_became_active":"2023-06-10T18:56:18.331127+0000","last_became_peered":"2023-06-10T18:56:18.331127+0000","last_unstale":"2023-06-10T18:56:26.872441+0000","last_undegraded":"2023-06-10T18:56:26.872441+0000","last_fullsized":"2023-06-10T18:56:26.872441+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:56:07.925384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":68,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.144910+0000","last_change":"2023-06-10T18:52:40.671084+0000","last_active":"2023-06-10T18:56:27.144910+0000","last_peered":"2023-06-10T18:56:27.144910+0000","last_clean":"2023-06-10T18:56:27.144910+0000","last_became_active":"2023-06-10T18:52:40.670697+0000","last_became_peered":"2023-06-10T18:52:40.670697+0000","last_unstale":"2023-06-10T18:56:27.144910+0000","last_undegraded":"2023-06-10T18:56:27.144910+0000","last_fullsized":"2023-06-10T18:56:27.144910+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:26:45.209485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.880674+0000","last_change":"2023-06-10T18:56:18.724544+0000","last_active":"2023-06-10T18:56:26.880674+0000","last_peered":"2023-06-10T18:56:26.880674+0000","last_clean":"2023-06-10T18:56:26.880674+0000","last_became_active":"2023-06-10T18:56:18.724244+0000","last_became_peered":"2023-06-10T18:56:18.724244+0000","last_unstale":"2023-06-10T18:56:26.880674+0000","last_undegraded":"2023-06-10T18:56:26.880674+0000","last_fullsized":"2023-06-10T18:56:26.880674+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:17:50.531074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.195134+0000","last_change":"2023-06-10T18:56:18.332507+0000","last_active":"2023-06-10T18:56:27.195134+0000","last_peered":"2023-06-10T18:56:27.195134+0000","last_clean":"2023-06-10T18:56:27.195134+0000","last_became_active":"2023-06-10T18:56:18.331887+0000","last_became_peered":"2023-06-10T18:56:18.331887+0000","last_unstale":"2023-06-10T18:56:27.195134+0000","last_undegraded":"2023-06-10T18:56:27.195134+0000","last_fullsized":"2023-06-10T18:56:27.195134+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:13:38.791330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":66,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.887650+0000","last_change":"2023-06-10T18:52:40.514114+0000","last_active":"2023-06-10T18:56:26.887650+0000","last_peered":"2023-06-10T18:56:26.887650+0000","last_clean":"2023-06-10T18:56:26.887650+0000","last_became_active":"2023-06-10T18:52:40.513638+0000","last_became_peered":"2023-06-10T18:52:40.513638+0000","last_unstale":"2023-06-10T18:56:26.887650+0000","last_undegraded":"2023-06-10T18:56:26.887650+0000","last_fullsized":"2023-06-10T18:56:26.887650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:41:17.572105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.871355+0000","last_change":"2023-06-10T18:56:18.733094+0000","last_active":"2023-06-10T18:56:26.871355+0000","last_peered":"2023-06-10T18:56:26.871355+0000","last_clean":"2023-06-10T18:56:26.871355+0000","last_became_active":"2023-06-10T18:56:18.732442+0000","last_became_peered":"2023-06-10T18:56:18.732442+0000","last_unstale":"2023-06-10T18:56:26.871355+0000","last_undegraded":"2023-06-10T18:56:26.871355+0000","last_fullsized":"2023-06-10T18:56:26.871355+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T18:57:31.579489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.195498+0000","last_change":"2023-06-10T18:56:18.337697+0000","last_active":"2023-06-10T18:56:27.195498+0000","last_peered":"2023-06-10T18:56:27.195498+0000","last_clean":"2023-06-10T18:56:27.195498+0000","last_became_active":"2023-06-10T18:56:18.337174+0000","last_became_peered":"2023-06-10T18:56:18.337174+0000","last_unstale":"2023-06-10T18:56:27.195498+0000","last_undegraded":"2023-06-10T18:56:27.195498+0000","last_fullsized":"2023-06-10T18:56:27.195498+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:57:03.240260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":70,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.876863+0000","last_change":"2023-06-10T18:52:40.515396+0000","last_active":"2023-06-10T18:56:26.876863+0000","last_peered":"2023-06-10T18:56:26.876863+0000","last_clean":"2023-06-10T18:56:26.876863+0000","last_became_active":"2023-06-10T18:52:40.514663+0000","last_became_peered":"2023-06-10T18:52:40.514663+0000","last_unstale":"2023-06-10T18:56:26.876863+0000","last_undegraded":"2023-06-10T18:56:26.876863+0000","last_fullsized":"2023-06-10T18:56:26.876863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:57:38.444899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574898,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28128,"kb_used_data":1176,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343712,"statfs":{"total":96636764160,"available":96607961088,"internally_reserved":0,"allocated":1204224,"data_stored":851412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":0.90400000000000003,"15min":0.88200000000000001},"min":{"1min":0.73599999999999999,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.3759999999999999,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.97999999999999998},{"interface":"front","average":{"1min":1.006,"5min":0.94299999999999995,"15min":0.93000000000000005},"min":{"1min":0.81899999999999995,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.234,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":1.0349999999999999}]},{"osd":1,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92400000000000004,"15min":0.91500000000000004},"min":{"1min":0.58599999999999997,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.3089999999999999,"5min":1.377,"15min":1.377},"last":1.1419999999999999},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.92500000000000004,"15min":0.91100000000000003},"min":{"1min":0.78400000000000003,"5min":0.504,"15min":0.504},"max":{"1min":1.111,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.1080000000000001}]},{"osd":2,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.83999999999999997,"15min":0.82799999999999996},"min":{"1min":0.64100000000000001,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.214,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.89900000000000002,"15min":0.90700000000000003},"min":{"1min":0.67500000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.325,"5min":1.367,"15min":1.367},"last":1.069}]},{"osd":3,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.92100000000000004,"15min":0.89900000000000002},"min":{"1min":0.68100000000000005,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1499999999999999,"5min":1.502,"15min":1.502},"last":1.167},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.93799999999999994,"15min":0.92800000000000005},"min":{"1min":0.70399999999999996,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.2130000000000001,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.77200000000000002}]},{"osd":4,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.876,"15min":0.872},"min":{"1min":0.60199999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.141,"5min":1.639,"15min":1.639},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.96899999999999997,"15min":0.98099999999999998},"min":{"1min":0.748,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.238,"5min":1.411,"15min":1.411},"last":0.65200000000000002}]},{"osd":5,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.042,"15min":1.038},"min":{"1min":0.79800000000000004,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.2669999999999999,"5min":1.806,"15min":1.806},"last":0.93200000000000005},{"interface":"front","average":{"1min":1.081,"5min":1.05,"15min":1.052},"min":{"1min":0.93200000000000005,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.256,"5min":1.522,"15min":1.522},"last":1.0009999999999999}]},{"osd":6,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.0129999999999999,"15min":1.008},"min":{"1min":0.78500000000000003,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.3,"5min":1.718,"15min":1.718},"last":0.95599999999999996},{"interface":"front","average":{"1min":1.147,"5min":1.095,"15min":1.0900000000000001},"min":{"1min":0.96599999999999997,"5min":0.441,"15min":0.441},"max":{"1min":1.409,"5min":1.464,"15min":1.464},"last":1.224}]}]},{"osd":6,"up_from":13,"seq":55834574899,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27548,"kb_used_data":596,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344292,"statfs":{"total":96636764160,"available":96608555008,"internally_reserved":0,"allocated":610304,"data_stored":261572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.81999999999999995,"15min":0.80100000000000005},"min":{"1min":0.65800000000000003,"5min":0.502,"15min":0.502},"max":{"1min":1.0589999999999999,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.85199999999999998,"15min":0.83999999999999997},"min":{"1min":0.71799999999999997,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.0680000000000001,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":1.0920000000000001}]},{"osd":1,"last update":"Sat Jun 10 18:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.873,"15min":0.85199999999999998},"min":{"1min":0.68999999999999995,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.0549999999999999},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.879,"15min":0.85899999999999999},"min":{"1min":0.68999999999999995,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":0.90000000000000002}]},{"osd":2,"last update":"Sat Jun 10 18:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.871,"15min":0.85899999999999999},"min":{"1min":0.66000000000000003,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.1950000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.88500000000000001,"15min":0.88900000000000001},"min":{"1min":0.68000000000000005,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.109,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":1.177}]},{"osd":3,"last update":"Sat Jun 10 18:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.874,"15min":0.84799999999999998},"min":{"1min":0.64900000000000002,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.169,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.95999999999999996},{"interface":"front","average":{"1min":1.0209999999999999,"5min":0.997,"15min":0.995},"min":{"1min":0.72799999999999998,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":1.2889999999999999}]},{"osd":4,"last update":"Sat Jun 10 18:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.93799999999999994,"15min":0.95399999999999996},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.1259999999999999,"5min":1.198,"15min":1.198},"last":1.002},{"interface":"front","average":{"1min":0.95699999999999996,"5min":1.0049999999999999,"15min":1.0189999999999999},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.1879999999999999,"5min":1.222,"15min":1.222},"last":1.212}]},{"osd":5,"last update":"Sat Jun 10 18:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.94999999999999996,"15min":0.96199999999999997},"min":{"1min":0.68700000000000006,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.0720000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.86099999999999999},{"interface":"front","average":{"1min":1.02,"5min":1.0249999999999999,"15min":1.026},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":1.1399999999999999}]},{"osd":7,"last update":"Sat Jun 10 18:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":1.0389999999999999,"15min":1.0489999999999999},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.1739999999999999,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.022,"5min":1.0569999999999999,"15min":1.0649999999999999},"min":{"1min":0.82199999999999995,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.2010000000000001,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":1.2569999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574899,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27552,"kb_used_data":600,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":614400,"data_stored":267298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.84199999999999997,"15min":0.82999999999999996},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.139,"5min":1.175,"15min":1.175},"last":1.083},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.91800000000000004,"15min":0.94199999999999995},"min":{"1min":0.63800000000000001,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.246,"5min":1.637,"15min":1.637},"last":0.67700000000000005}]},{"osd":1,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.91000000000000003,"15min":0.91800000000000004},"min":{"1min":0.67800000000000005,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.1559999999999999,"5min":1.335,"15min":1.335},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.91700000000000004,"15min":0.92100000000000004},"min":{"1min":0.72699999999999998,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.208,"5min":1.78,"15min":1.78},"last":0.80700000000000005}]},{"osd":2,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.65000000000000002,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.1000000000000001,"5min":1.446,"15min":1.446},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.91600000000000004,"15min":0.91200000000000003},"min":{"1min":0.71399999999999997,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.1379999999999999,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.92300000000000004}]},{"osd":3,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93899999999999995,"15min":0.94499999999999995},"min":{"1min":0.68600000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.206,"5min":1.484,"15min":1.484},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.97199999999999998,"5min":1.0249999999999999,"15min":1.0429999999999999},"min":{"1min":0.77100000000000002,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.2969999999999999,"5min":1.337,"15min":1.337},"last":0.84599999999999997}]},{"osd":4,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.96999999999999997,"15min":0.98899999999999999},"min":{"1min":0.70299999999999996,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.2669999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.94599999999999995,"5min":1.034,"15min":1.0640000000000001},"min":{"1min":0.66500000000000004,"5min":0.629,"15min":0.629},"max":{"1min":1.26,"5min":1.575,"15min":1.575},"last":1.2010000000000001}]},{"osd":6,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":1.038,"15min":1.0780000000000001},"min":{"1min":0.66000000000000003,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.2010000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.0609999999999999,"15min":1.079},"min":{"1min":0.69799999999999995,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.2270000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.73699999999999999}]},{"osd":7,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.139,"15min":1.1739999999999999},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.226,"5min":1.873,"15min":1.873},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.155,"15min":1.181},"min":{"1min":0.80000000000000004,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.3680000000000001,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.121}]}]},{"osd":4,"up_from":13,"seq":55834574898,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27556,"kb_used_data":604,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344284,"statfs":{"total":96636764160,"available":96608546816,"internally_reserved":0,"allocated":618496,"data_stored":267880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.76700000000000002,"15min":0.745},"min":{"1min":0.53400000000000003,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.1599999999999999,"5min":1.2,"15min":1.2},"last":0.629},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.88200000000000001,"15min":0.88},"min":{"1min":0.63800000000000001,"5min":0.504,"15min":0.504},"max":{"1min":1.4970000000000001,"5min":1.73,"15min":1.73},"last":1.034}]},{"osd":1,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.95199999999999996,"15min":0.95499999999999996},"min":{"1min":0.68200000000000005,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.84599999999999997,"15min":0.83699999999999997},"min":{"1min":0.66600000000000004,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.024,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.097}]},{"osd":2,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.879,"15min":0.875},"min":{"1min":0.70799999999999996,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":0.85499999999999998},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1,"15min":1.004},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":1.121}]},{"osd":3,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.89900000000000002,"15min":0.88},"min":{"1min":0.80900000000000005,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.1679999999999999,"5min":1.22,"15min":1.22},"last":0.73999999999999999},{"interface":"front","average":{"1min":1.006,"5min":0.95799999999999996,"15min":0.95099999999999996},"min":{"1min":0.80100000000000005,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.4490000000000001,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.069}]},{"osd":5,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.96799999999999997,"15min":0.99399999999999999},"min":{"1min":0.67800000000000005,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.069,"5min":1.663,"15min":1.663},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.95399999999999996,"15min":0.98199999999999998},"min":{"1min":0.58099999999999996,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.111,"5min":1.353,"15min":1.353},"last":1.179}]},{"osd":6,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":1.002,"15min":1.028},"min":{"1min":0.63100000000000001,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.5720000000000001,"5min":2.2639999999999998,"15min":2.2639999999999998},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0720000000000001,"15min":1.0760000000000001},"min":{"1min":0.81200000000000006,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":1.1970000000000001}]},{"osd":7,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.98399999999999999,"15min":0.99399999999999999},"min":{"1min":0.68899999999999995,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.1950000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.012,"5min":1.0529999999999999,"15min":1.071},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.2390000000000001,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":1.1539999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574897,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31660,"kb_used_data":612,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340180,"statfs":{"total":96636764160,"available":96604344320,"internally_reserved":0,"allocated":626688,"data_stored":267865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.57799999999999996,"15min":0.57199999999999995},"min":{"1min":0.51400000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.63500000000000001,"15min":0.63100000000000001},"min":{"1min":0.56000000000000005,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.57599999999999996}]},{"osd":1,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.64400000000000002,"15min":0.622},"min":{"1min":0.51000000000000001,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":1.0860000000000001},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.72099999999999997,"15min":0.71599999999999997},"min":{"1min":0.56100000000000005,"5min":0.318,"15min":0.318},"max":{"1min":0.98899999999999999,"5min":1.411,"15min":1.411},"last":1.0409999999999999}]},{"osd":2,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.76100000000000001,"15min":0.75},"min":{"1min":0.63500000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.167,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":1.3759999999999999},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.75900000000000001,"15min":0.74199999999999999},"min":{"1min":0.65200000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.1970000000000001,"5min":1.264,"15min":1.264},"last":0.624}]},{"osd":4,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96099999999999997,"15min":0.96899999999999997},"min":{"1min":0.79800000000000004,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.3089999999999999,"5min":1.488,"15min":1.488},"last":1.3360000000000001},{"interface":"front","average":{"1min":1.052,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.82099999999999995,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.345,"5min":1.458,"15min":1.458},"last":0.93100000000000005}]},{"osd":5,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.0369999999999999,"15min":1.0589999999999999},"min":{"1min":0.80400000000000005,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.268,"5min":2.024,"15min":2.024},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.101,"5min":1.026,"15min":1.014},"min":{"1min":0.83899999999999997,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.29,"5min":1.724,"15min":1.724},"last":1.2170000000000001}]},{"osd":6,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.0489999999999999,"15min":1.0469999999999999},"min":{"1min":0.92400000000000004,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.3300000000000001,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.071,"5min":1.0589999999999999,"15min":1.0720000000000001},"min":{"1min":0.90700000000000003,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.302,"5min":1.78,"15min":1.78},"last":1.1399999999999999}]},{"osd":7,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.101,"15min":1.1279999999999999},"min":{"1min":0.82799999999999996,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.3959999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.212,"5min":1.089,"15min":1.0740000000000001},"min":{"1min":1.0049999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.468,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":1.5429999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574898,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31660,"kb_used_data":612,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340180,"statfs":{"total":96636764160,"available":96604344320,"internally_reserved":0,"allocated":626688,"data_stored":268862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.60099999999999998,"15min":0.58799999999999997},"min":{"1min":0.498,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.97799999999999998,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.50800000000000001,"5min":0.378,"15min":0.378},"max":{"1min":1.024,"5min":1.224,"15min":1.224},"last":0.68600000000000005}]},{"osd":1,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.65000000000000002,"15min":0.64600000000000002},"min":{"1min":0.53400000000000003,"5min":0.307,"15min":0.307},"max":{"1min":0.89500000000000002,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.72299999999999998,"15min":0.68999999999999995},"min":{"1min":0.64700000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.89100000000000001}]},{"osd":3,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.73599999999999999,"15min":0.70599999999999996},"min":{"1min":0.64900000000000002,"5min":0.377,"15min":0.377},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.749,"15min":0.746},"min":{"1min":0.64700000000000002,"5min":0.252,"15min":0.252},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.86199999999999999}]},{"osd":4,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.91900000000000004,"15min":0.91500000000000004},"min":{"1min":0.81000000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.097,"5min":1.0349999999999999,"15min":1.038},"min":{"1min":0.88600000000000001,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.476,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":1.0129999999999999}]},{"osd":5,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.016,"15min":1.016},"min":{"1min":0.82699999999999996,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.379,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":1.2330000000000001},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.002,"15min":0.97799999999999998},"min":{"1min":0.77100000000000002,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.377,"5min":1.667,"15min":1.667},"last":0.78200000000000003}]},{"osd":6,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.0429999999999999,"15min":1.0229999999999999},"min":{"1min":0.84299999999999997,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.3049999999999999,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.92900000000000005},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.034,"15min":1.032},"min":{"1min":0.89400000000000002,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.4299999999999999,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":1.1120000000000001}]},{"osd":7,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.099,"15min":1.099},"min":{"1min":0.82399999999999995,"5min":0.62,"15min":0.62},"max":{"1min":1.4339999999999999,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.153,"5min":1.0980000000000001,"15min":1.0760000000000001},"min":{"1min":0.95499999999999996,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.4239999999999999,"5min":1.752,"15min":1.752},"last":0.98899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574900,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31640,"kb_used_data":592,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340200,"statfs":{"total":96636764160,"available":96604364800,"internally_reserved":0,"allocated":606208,"data_stored":260061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.67100000000000004,"15min":0.66100000000000003},"min":{"1min":0.47999999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.71999999999999997,"15min":0.68600000000000005},"min":{"1min":0.63400000000000001,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.0369999999999999,"5min":1.694,"15min":1.694},"last":0.56799999999999995}]},{"osd":2,"last update":"Sat Jun 10 18:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.64400000000000002,"15min":0.623},"min":{"1min":0.53500000000000003,"5min":0.249,"15min":0.249},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.877,"5min":0.70199999999999996,"15min":0.65800000000000003},"min":{"1min":0.65600000000000003,"5min":0.315,"15min":0.315},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":0.65500000000000003}]},{"osd":3,"last update":"Sat Jun 10 18:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.77800000000000002,"15min":0.745},"min":{"1min":0.65900000000000003,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.76100000000000001,"15min":0.749},"min":{"1min":0.58499999999999996,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.1100000000000001,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":0.622}]},{"osd":4,"last update":"Sat Jun 10 18:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.87,"15min":0.83599999999999997},"min":{"1min":0.73399999999999999,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":1.087,"5min":1.1160000000000001,"15min":1.079},"min":{"1min":0.78500000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.5449999999999999,"5min":5.8209999999999997,"15min":5.8209999999999997},"last":0.91000000000000003}]},{"osd":5,"last update":"Sat Jun 10 18:55:44 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.032,"15min":1.028},"min":{"1min":0.75800000000000001,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.4550000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":0.879},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0129999999999999,"15min":0.97099999999999997},"min":{"1min":0.754,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.3819999999999999,"5min":3.089,"15min":3.089},"last":0.72299999999999998}]},{"osd":6,"last update":"Sat Jun 10 18:55:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.105,"15min":1.0309999999999999},"min":{"1min":0.75900000000000001,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.5249999999999999,"5min":7.2599999999999998,"15min":7.2599999999999998},"last":0.77500000000000002},{"interface":"front","average":{"1min":1.081,"5min":1.107,"15min":1.0309999999999999},"min":{"1min":0.80800000000000005,"5min":0.622,"15min":0.622},"max":{"1min":1.591,"5min":9.0069999999999997,"15min":9.0069999999999997},"last":0.85899999999999999}]},{"osd":7,"last update":"Sat Jun 10 18:55:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.0980000000000001,"15min":1.083},"min":{"1min":0.89300000000000002,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.6879999999999999,"5min":2.105,"15min":2.105},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.085,"15min":1.0669999999999999},"min":{"1min":0.90200000000000002,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.573,"5min":2.2570000000000001,"15min":2.2570000000000001},"last":0.73999999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574899,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32232,"kb_used_data":1184,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339608,"statfs":{"total":96636764160,"available":96603758592,"internally_reserved":0,"allocated":1212416,"data_stored":856703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.61299999999999999,"15min":0.59899999999999998},"min":{"1min":0.51000000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.77200000000000002,"15min":0.746},"min":{"1min":0.70899999999999996,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.0469999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.83899999999999997}]},{"osd":2,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.71099999999999997,"15min":0.69799999999999995},"min":{"1min":0.51900000000000002,"5min":0.313,"15min":0.313},"max":{"1min":1.0269999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.64600000000000002,"15min":0.63},"min":{"1min":0.55700000000000005,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.96799999999999997,"5min":1.371,"15min":1.371},"last":0.622}]},{"osd":3,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.68200000000000005,"15min":0.67000000000000004},"min":{"1min":0.55800000000000005,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.1930000000000001,"5min":1.226,"15min":1.226},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.82899999999999996,"15min":0.81000000000000005},"min":{"1min":0.65800000000000003,"5min":0.375,"15min":0.375},"max":{"1min":1.262,"5min":1.829,"15min":1.829},"last":0.76200000000000001}]},{"osd":4,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.90000000000000002,"15min":0.88900000000000001},"min":{"1min":0.75600000000000001,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.1579999999999999,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.0369999999999999,"15min":1.034},"min":{"1min":0.86099999999999999,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.228,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":0.97199999999999998}]},{"osd":5,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.96099999999999997,"15min":0.95799999999999996},"min":{"1min":0.67300000000000004,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.351,"5min":1.694,"15min":1.694},"last":1.1399999999999999},{"interface":"front","average":{"1min":0.99099999999999999,"5min":1,"15min":0.998},"min":{"1min":0.72999999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.1870000000000001,"5min":1.75,"15min":1.75},"last":1.2789999999999999}]},{"osd":6,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.0700000000000001,"15min":1.056},"min":{"1min":0.93899999999999995,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.331,"5min":2.04,"15min":2.04},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.0409999999999999,"5min":0.996,"15min":0.997},"min":{"1min":0.76100000000000001,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.444,"5min":1.883,"15min":1.883},"last":1.3280000000000001}]},{"osd":7,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.0369999999999999,"15min":1.0329999999999999},"min":{"1min":0.77200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.397,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.077,"5min":1.056,"15min":1.05},"min":{"1min":0.93200000000000005,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.298,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.2170000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-10T18:56:32.540 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1d is not active+clean 2023-06-10T18:56:32.541 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1d', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 52, 'state': 'peering', 'last_fresh': '2023-06-10T18:56:22.631216+0000', 'last_change': '2023-06-10T18:56:27.634240+0000', 'last_active': '2023-06-10T18:56:27.634240+0000', 'last_peered': '2023-06-10T18:56:22.631216+0000', 'last_clean': '2023-06-10T18:56:22.631216+0000', 'last_became_active': '2023-06-10T18:56:18.711779+0000', 'last_became_peered': '2023-06-10T18:56:18.711779+0000', 'last_unstale': '2023-06-10T18:56:22.631216+0000', 'last_undegraded': '2023-06-10T18:56:22.631216+0000', 'last_fullsized': '2023-06-10T18:56:22.631216+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 50, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-06-10T18:56:32.541 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.e is not active+clean 2023-06-10T18:56:32.541 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.e', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 52, 'state': 'peering', 'last_fresh': '2023-06-10T18:56:22.631242+0000', 'last_change': '2023-06-10T18:56:27.634300+0000', 'last_active': '2023-06-10T18:56:27.634300+0000', 'last_peered': '2023-06-10T18:56:22.631242+0000', 'last_clean': '2023-06-10T18:56:22.631242+0000', 'last_became_active': '2023-06-10T18:56:18.715542+0000', 'last_became_peered': '2023-06-10T18:56:18.715542+0000', 'last_unstale': '2023-06-10T18:56:22.631242+0000', 'last_undegraded': '2023-06-10T18:56:22.631242+0000', 'last_fullsized': '2023-06-10T18:56:22.631242+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 50, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'last_clean_scrub_stamp': '2023-06-10T18:56:18.283809+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-06-10T18:56:32.542 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-06-10T18:56:32.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.695+0000 7fe0625d8640 1 Processor -- start 2023-06-10T18:56:32.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.695+0000 7fe0625d8640 1 -- start start 2023-06-10T18:56:32.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.695+0000 7fe0625d8640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe05c0c9840 0x7fe05c0c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:32.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.695+0000 7fe0625d8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe05c071060 0x7fe05c0af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:32.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.695+0000 7fe0625d8640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe05c159b50 con 0x7fe05c0afc60 2023-06-10T18:56:32.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.695+0000 7fe0625d8640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe05c0ca150 con 0x7fe05c071060 2023-06-10T18:56:32.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.695+0000 7fe0625d8640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe05c0702a0 con 0x7fe05c0c9840 2023-06-10T18:56:32.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.695+0000 7fe05b7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe05c071060 0x7fe05c0af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:32.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.695+0000 7fe05b7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe05c071060 0x7fe05c0af720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53068/0 (socket says 172.21.15.53:53068) 2023-06-10T18:56:32.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.695+0000 7fe05b7fe640 1 -- 172.21.15.53:0/1222340591 learned_addr learned my addr 172.21.15.53:0/1222340591 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:32.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.695+0000 7fe05bfff640 1 --2- 172.21.15.53:0/1222340591 >> v2:172.21.15.117:3300/0 conn(0x7fe05c0c9840 0x7fe05c0c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:32.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.699+0000 7fe05b7fe640 1 -- 172.21.15.53:0/1222340591 >> v2:172.21.15.117:3300/0 conn(0x7fe05c0c9840 msgr2=0x7fe05c0c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:32.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.699+0000 7fe05b7fe640 1 --2- 172.21.15.53:0/1222340591 >> v2:172.21.15.117:3300/0 conn(0x7fe05c0c9840 0x7fe05c0c9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:32.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.699+0000 7fe05b7fe640 1 -- 172.21.15.53:0/1222340591 >> v1:172.21.15.117:6789/0 conn(0x7fe05c0afc60 legacy=0x7fe05c15d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:32.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.699+0000 7fe05b7fe640 1 -- 172.21.15.53:0/1222340591 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe05c070580 con 0x7fe05c071060 2023-06-10T18:56:32.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.699+0000 7fe05b7fe640 1 --2- 172.21.15.53:0/1222340591 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe05c071060 0x7fe05c0af720 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fe05c071d80 tx=0x7fe04c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2bfab9aa03b64e2 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:32.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.699+0000 7fe05affd640 1 -- 172.21.15.53:0/1222340591 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04c0ac410 con 0x7fe05c071060 2023-06-10T18:56:32.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.699+0000 7fe05affd640 1 -- 172.21.15.53:0/1222340591 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe04c0ac570 con 0x7fe05c071060 2023-06-10T18:56:32.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.699+0000 7fe05affd640 1 -- 172.21.15.53:0/1222340591 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04c0ac900 con 0x7fe05c071060 2023-06-10T18:56:32.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.699+0000 7fe0625d8640 1 -- 172.21.15.53:0/1222340591 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe05c071060 msgr2=0x7fe05c0af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:32.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.699+0000 7fe0625d8640 1 --2- 172.21.15.53:0/1222340591 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe05c071060 0x7fe05c0af720 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fe05c071d80 tx=0x7fe04c01c490 comp rx=0 tx=0).stop 2023-06-10T18:56:32.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.699+0000 7fe0625d8640 1 -- 172.21.15.53:0/1222340591 shutdown_connections 2023-06-10T18:56:32.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.699+0000 7fe0625d8640 1 --2- 172.21.15.53:0/1222340591 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe05c071060 0x7fe05c0af720 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:32.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.699+0000 7fe0625d8640 1 --2- 172.21.15.53:0/1222340591 >> v2:172.21.15.117:3300/0 conn(0x7fe05c0c9840 0x7fe05c0c9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:32.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.699+0000 7fe0625d8640 1 -- 172.21.15.53:0/1222340591 >> 172.21.15.53:0/1222340591 conn(0x7fe05c06a0d0 msgr2=0x7fe05c0ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:32.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.699+0000 7fe0625d8640 1 -- 172.21.15.53:0/1222340591 shutdown_connections 2023-06-10T18:56:32.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.699+0000 7fe0625d8640 1 -- 172.21.15.53:0/1222340591 wait complete. 2023-06-10T18:56:32.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.703+0000 7fe0625d8640 1 Processor -- start 2023-06-10T18:56:32.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.703+0000 7fe0625d8640 1 -- start start 2023-06-10T18:56:32.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.703+0000 7fe0625d8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe05c071060 0x7fe05c0b3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:32.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.703+0000 7fe0625d8640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe05c0afc60 0x7fe05c14c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:32.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.703+0000 7fe0625d8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe05c0c9840 0x7fe05c14bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:32.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.703+0000 7fe0625d8640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe05c14c820 con 0x7fe05c071060 2023-06-10T18:56:32.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.703+0000 7fe0625d8640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe05c14c130 con 0x7fe05c0c9840 2023-06-10T18:56:32.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.703+0000 7fe0625d8640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe05c14d620 con 0x7fe05c0afc60 2023-06-10T18:56:32.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.703+0000 7fe05bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe05c071060 0x7fe05c0b3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:32.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.703+0000 7fe05bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe05c071060 0x7fe05c0b3520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53082/0 (socket says 172.21.15.53:53082) 2023-06-10T18:56:32.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.703+0000 7fe05bfff640 1 -- 172.21.15.53:0/679884148 learned_addr learned my addr 172.21.15.53:0/679884148 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:32.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.703+0000 7fe05b7fe640 1 --2- 172.21.15.53:0/679884148 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe05c0afc60 0x7fe05c14c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:32.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.703+0000 7fe060b75640 1 --2- 172.21.15.53:0/679884148 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe05c0c9840 0x7fe05c14bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:32.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.703+0000 7fe05bfff640 1 -- 172.21.15.53:0/679884148 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe05c0afc60 msgr2=0x7fe05c14c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:32.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.703+0000 7fe05bfff640 1 --2- 172.21.15.53:0/679884148 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe05c0afc60 0x7fe05c14c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:32.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.703+0000 7fe05bfff640 1 -- 172.21.15.53:0/679884148 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe05c0c9840 msgr2=0x7fe05c14bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:32.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.703+0000 7fe05bfff640 1 --2- 172.21.15.53:0/679884148 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe05c0c9840 0x7fe05c14bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:32.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.703+0000 7fe05bfff640 1 -- 172.21.15.53:0/679884148 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe04c0094d0 con 0x7fe05c071060 2023-06-10T18:56:32.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.703+0000 7fe05b7fe640 1 --2- 172.21.15.53:0/679884148 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe05c0afc60 0x7fe05c14c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:56:32.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.703+0000 7fe060b75640 1 --2- 172.21.15.53:0/679884148 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe05c0c9840 0x7fe05c14bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:56:32.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.703+0000 7fe05bfff640 1 --2- 172.21.15.53:0/679884148 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe05c071060 0x7fe05c0b3520 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fe05000d5f0 tx=0x7fe05000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:32.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.703+0000 7fe058ff9640 1 -- 172.21.15.53:0/679884148 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0500125f0 con 0x7fe05c071060 2023-06-10T18:56:32.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.703+0000 7fe058ff9640 1 -- 172.21.15.53:0/679884148 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe050012750 con 0x7fe05c071060 2023-06-10T18:56:32.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.703+0000 7fe0625d8640 1 -- 172.21.15.53:0/679884148 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe05c14ca10 con 0x7fe05c071060 2023-06-10T18:56:32.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.703+0000 7fe058ff9640 1 -- 172.21.15.53:0/679884148 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe050012ae0 con 0x7fe05c071060 2023-06-10T18:56:32.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.703+0000 7fe0625d8640 1 -- 172.21.15.53:0/679884148 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe05c14cfd0 con 0x7fe05c071060 2023-06-10T18:56:32.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.703+0000 7fe0625d8640 1 -- 172.21.15.53:0/679884148 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe05c04d790 con 0x7fe05c071060 2023-06-10T18:56:32.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.703+0000 7fe058ff9640 1 -- 172.21.15.53:0/679884148 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe050012c40 con 0x7fe05c071060 2023-06-10T18:56:32.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.703+0000 7fe058ff9640 1 --2- 172.21.15.53:0/679884148 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe048066280 0x7fe048068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:32.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.707+0000 7fe058ff9640 1 -- 172.21.15.53:0/679884148 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fe0500842b0 con 0x7fe05c071060 2023-06-10T18:56:32.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.707+0000 7fe05b7fe640 1 --2- 172.21.15.53:0/679884148 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe048066280 0x7fe048068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:32.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.707+0000 7fe05b7fe640 1 --2- 172.21.15.53:0/679884148 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe048066280 0x7fe048068730 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe04c0ae000 tx=0x7fe04c0a6040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:32.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.711+0000 7fe058ff9640 1 -- 172.21.15.53:0/679884148 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe050051660 con 0x7fe05c071060 2023-06-10T18:56:32.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.911+0000 7fe0625d8640 1 -- 172.21.15.53:0/679884148 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fe05c0cb140 con 0x7fe05c071060 2023-06-10T18:56:32.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.915+0000 7fe058ff9640 1 -- 172.21.15.53:0/679884148 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1087 (secure 0 0 0) 0x7fe050007380 con 0x7fe05c071060 2023-06-10T18:56:32.918 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:56:32.919 INFO:teuthology.orchestra.run.smithi053.stdout:{"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":251,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":53,"num_osds":8,"num_up_osds":8,"osd_up_since":1686423152,"num_in_osds":8,"osd_in_since":1686423143,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":103},{"state_name":"peering","count":2}],"num_pgs":105,"num_pools":4,"num_objects":24,"data_bytes":592730,"bytes_used":243687424,"bytes_avail":772850425856,"bytes_total":773094113280,"inactive_pgs_ratio":0.01904761977493763,"write_bytes_sec":0,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":20,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"c","status":"up:active","gid":5931}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2023-06-10T18:54:59.607497+0000","services":{}},"progress_events":{}} 2023-06-10T18:56:32.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.915+0000 7fe0625d8640 1 -- 172.21.15.53:0/679884148 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe048066280 msgr2=0x7fe048068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:32.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.915+0000 7fe0625d8640 1 --2- 172.21.15.53:0/679884148 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe048066280 0x7fe048068730 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe04c0ae000 tx=0x7fe04c0a6040 comp rx=0 tx=0).stop 2023-06-10T18:56:32.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.915+0000 7fe0625d8640 1 -- 172.21.15.53:0/679884148 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe05c071060 msgr2=0x7fe05c0b3520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:32.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.915+0000 7fe0625d8640 1 --2- 172.21.15.53:0/679884148 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe05c071060 0x7fe05c0b3520 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fe05000d5f0 tx=0x7fe05000dab0 comp rx=0 tx=0).stop 2023-06-10T18:56:32.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.915+0000 7fe0625d8640 1 -- 172.21.15.53:0/679884148 shutdown_connections 2023-06-10T18:56:32.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.915+0000 7fe0625d8640 1 --2- 172.21.15.53:0/679884148 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe048066280 0x7fe048068730 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:32.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.915+0000 7fe0625d8640 1 --2- 172.21.15.53:0/679884148 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe05c0c9840 0x7fe05c14bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:32.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.915+0000 7fe0625d8640 1 --2- 172.21.15.53:0/679884148 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe05c0afc60 0x7fe05c14c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:32.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.915+0000 7fe0625d8640 1 --2- 172.21.15.53:0/679884148 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe05c071060 0x7fe05c0b3520 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:32.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.915+0000 7fe0625d8640 1 -- 172.21.15.53:0/679884148 >> 172.21.15.53:0/679884148 conn(0x7fe05c06a0d0 msgr2=0x7fe05c0c82d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:32.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.915+0000 7fe0625d8640 1 -- 172.21.15.53:0/679884148 shutdown_connections 2023-06-10T18:56:32.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:32.915+0000 7fe0625d8640 1 -- 172.21.15.53:0/679884148 wait complete. 2023-06-10T18:56:32.936 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-06-10T18:56:32.937 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-10T18:56:33.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:33.055+0000 7f735a32b640 1 Processor -- start 2023-06-10T18:56:33.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:33.055+0000 7f735a32b640 1 -- start start 2023-06-10T18:56:33.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:33.055+0000 7f735a32b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7354157e10 0x7f735406efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:33.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:33.055+0000 7f735a32b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f735406bb30 0x7f73540ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:33.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:33.055+0000 7f735a32b640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73540c9e50 con 0x7f73540af720 2023-06-10T18:56:33.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:33.055+0000 7f735a32b640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73540cd520 con 0x7f7354157e10 2023-06-10T18:56:33.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:33.055+0000 7f735a32b640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73540c82f0 con 0x7f735406bb30 2023-06-10T18:56:33.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:33.055+0000 7f7353fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7354157e10 0x7f735406efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:33.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:33.055+0000 7f7353fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7354157e10 0x7f735406efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53098/0 (socket says 172.21.15.53:53098) 2023-06-10T18:56:33.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:33.055+0000 7f7353fff640 1 -- 172.21.15.53:0/1849403260 learned_addr learned my addr 172.21.15.53:0/1849403260 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:33.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:33.055+0000 7f7353fff640 1 -- 172.21.15.53:0/1849403260 >> v2:172.21.15.117:3300/0 conn(0x7f735406bb30 msgr2=0x7f73540ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:33.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:33.055+0000 7f73537fe640 1 --2- 172.21.15.53:0/1849403260 >> v2:172.21.15.117:3300/0 conn(0x7f735406bb30 0x7f73540ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:33.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:33.055+0000 7f7353fff640 1 --2- 172.21.15.53:0/1849403260 >> v2:172.21.15.117:3300/0 conn(0x7f735406bb30 0x7f73540ccfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:33.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:33.055+0000 7f7353fff640 1 -- 172.21.15.53:0/1849403260 >> v1:172.21.15.117:6789/0 conn(0x7f73540af720 legacy=0x7f73540afb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:33.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:33.055+0000 7f7353fff640 1 -- 172.21.15.53:0/1849403260 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f735406bf80 con 0x7f7354157e10 2023-06-10T18:56:33.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:33.055+0000 7f7353fff640 1 --2- 172.21.15.53:0/1849403260 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7354157e10 0x7f735406efc0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f735406e9d0 tx=0x7f734401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0c0928ca2ac0b33 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:33.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:33.055+0000 7f7352ffd640 1 -- 172.21.15.53:0/1849403260 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73440ac640 con 0x7f7354157e10 2023-06-10T18:56:33.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:33.055+0000 7f7352ffd640 1 -- 172.21.15.53:0/1849403260 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73440ac7a0 con 0x7f7354157e10 2023-06-10T18:56:33.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:33.055+0000 7f7352ffd640 1 -- 172.21.15.53:0/1849403260 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73440acb30 con 0x7f7354157e10 2023-06-10T18:56:33.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:33.059+0000 7f735a32b640 1 -- 172.21.15.53:0/1849403260 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7354157e10 msgr2=0x7f735406efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:33.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:33.059+0000 7f735a32b640 1 --2- 172.21.15.53:0/1849403260 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7354157e10 0x7f735406efc0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f735406e9d0 tx=0x7f734401c3e0 comp rx=0 tx=0).stop 2023-06-10T18:56:33.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:33.059+0000 7f735a32b640 1 -- 172.21.15.53:0/1849403260 shutdown_connections 2023-06-10T18:56:33.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:33.059+0000 7f735a32b640 1 --2- 172.21.15.53:0/1849403260 >> v2:172.21.15.117:3300/0 conn(0x7f735406bb30 0x7f73540ccfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:33.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:33.059+0000 7f735a32b640 1 --2- 172.21.15.53:0/1849403260 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7354157e10 0x7f735406efc0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:33.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:33.059+0000 7f735a32b640 1 -- 172.21.15.53:0/1849403260 >> 172.21.15.53:0/1849403260 conn(0x7f735406a0d0 msgr2=0x7f73540ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:33.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:33.059+0000 7f735a32b640 1 -- 172.21.15.53:0/1849403260 shutdown_connections 2023-06-10T18:56:33.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:33.059+0000 7f735a32b640 1 -- 172.21.15.53:0/1849403260 wait complete. 2023-06-10T18:56:33.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:33.059+0000 7f735a32b640 1 Processor -- start 2023-06-10T18:56:33.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:33.059+0000 7f735a32b640 1 -- start start 2023-06-10T18:56:33.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:33.059+0000 7f735a32b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f735406bb30 0x7f7354154600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:33.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:33.059+0000 7f735a32b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73540af720 0x7f73540c66a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:33.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:33.059+0000 7f735a32b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7354157e10 0x7f7354153db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:33.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:33.059+0000 7f735a32b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73540c23e0 con 0x7f735406bb30 2023-06-10T18:56:33.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:33.059+0000 7f735a32b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73540c6be0 con 0x7f7354157e10 2023-06-10T18:56:33.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:33.059+0000 7f735a32b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73540c73e0 con 0x7f73540af720 2023-06-10T18:56:33.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:33.059+0000 7f7353fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f735406bb30 0x7f7354154600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:33.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:33.059+0000 7f7353fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f735406bb30 0x7f7354154600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53110/0 (socket says 172.21.15.53:53110) 2023-06-10T18:56:33.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:33.059+0000 7f7353fff640 1 -- 172.21.15.53:0/3928147600 learned_addr learned my addr 172.21.15.53:0/3928147600 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:33.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:33.059+0000 7f7353fff640 1 -- 172.21.15.53:0/3928147600 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73540af720 msgr2=0x7f73540c66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:33.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:33.059+0000 7f7353fff640 1 --2- 172.21.15.53:0/3928147600 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73540af720 0x7f73540c66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:33.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:33.059+0000 7f7353fff640 1 -- 172.21.15.53:0/3928147600 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7354157e10 msgr2=0x7f7354153db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:33.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:33.059+0000 7f7353fff640 1 --2- 172.21.15.53:0/3928147600 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7354157e10 0x7f7354153db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:33.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:33.059+0000 7f7353fff640 1 -- 172.21.15.53:0/3928147600 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73440094d0 con 0x7f735406bb30 2023-06-10T18:56:33.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:33.059+0000 7f7353fff640 1 --2- 172.21.15.53:0/3928147600 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f735406bb30 0x7f7354154600 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f734401aa90 tx=0x7f734401ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:33.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:33.059+0000 7f7350ff9640 1 -- 172.21.15.53:0/3928147600 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73440b7830 con 0x7f735406bb30 2023-06-10T18:56:33.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:33.059+0000 7f7350ff9640 1 -- 172.21.15.53:0/3928147600 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73440b79b0 con 0x7f735406bb30 2023-06-10T18:56:33.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:33.059+0000 7f735a32b640 1 -- 172.21.15.53:0/3928147600 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73540c76c0 con 0x7f735406bb30 2023-06-10T18:56:33.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:33.059+0000 7f7350ff9640 1 -- 172.21.15.53:0/3928147600 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73440b7d60 con 0x7f735406bb30 2023-06-10T18:56:33.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:33.059+0000 7f735a32b640 1 -- 172.21.15.53:0/3928147600 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73541542f0 con 0x7f735406bb30 2023-06-10T18:56:33.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:33.063+0000 7f735a32b640 1 -- 172.21.15.53:0/3928147600 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73540c7b70 con 0x7f735406bb30 2023-06-10T18:56:33.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:33.063+0000 7f7350ff9640 1 -- 172.21.15.53:0/3928147600 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f73440b3040 con 0x7f735406bb30 2023-06-10T18:56:33.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:33.063+0000 7f7350ff9640 1 --2- 172.21.15.53:0/3928147600 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f73400662b0 0x7f7340068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:33.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:33.063+0000 7f7350ff9640 1 -- 172.21.15.53:0/3928147600 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f734411f050 con 0x7f735406bb30 2023-06-10T18:56:33.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:33.063+0000 7f73537fe640 1 --2- 172.21.15.53:0/3928147600 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f73400662b0 0x7f7340068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:33.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:33.063+0000 7f73537fe640 1 --2- 172.21.15.53:0/3928147600 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f73400662b0 0x7f7340068760 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f73540aef10 tx=0x7f7348008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:33.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:33.067+0000 7f7350ff9640 1 -- 172.21.15.53:0/3928147600 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f73440ec520 con 0x7f735406bb30 2023-06-10T18:56:33.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:33.215+0000 7f735a32b640 1 -- 172.21.15.53:0/3928147600 --> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f73541581e0 con 0x7f73400662b0 2023-06-10T18:56:33.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:33.239+0000 7f7350ff9640 1 -- 172.21.15.53:0/3928147600 <== mgr.4105 v2:172.21.15.117:6832/3061986771 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+309188 (secure 0 0 0) 0x7f734800a420 con 0x7f73400662b0 2023-06-10T18:56:33.245 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:56:33.246 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-06-10T18:56:33.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:33.243+0000 7f735a32b640 1 -- 172.21.15.53:0/3928147600 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f73400662b0 msgr2=0x7f7340068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:33.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:33.243+0000 7f735a32b640 1 --2- 172.21.15.53:0/3928147600 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f73400662b0 0x7f7340068760 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f73540aef10 tx=0x7f7348008040 comp rx=0 tx=0).stop 2023-06-10T18:56:33.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:33.243+0000 7f735a32b640 1 -- 172.21.15.53:0/3928147600 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f735406bb30 msgr2=0x7f7354154600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:33.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:33.243+0000 7f735a32b640 1 --2- 172.21.15.53:0/3928147600 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f735406bb30 0x7f7354154600 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f734401aa90 tx=0x7f734401ac20 comp rx=0 tx=0).stop 2023-06-10T18:56:33.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:33.243+0000 7f735a32b640 1 -- 172.21.15.53:0/3928147600 shutdown_connections 2023-06-10T18:56:33.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:33.243+0000 7f735a32b640 1 --2- 172.21.15.53:0/3928147600 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f73400662b0 0x7f7340068760 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:33.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:33.243+0000 7f735a32b640 1 --2- 172.21.15.53:0/3928147600 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7354157e10 0x7f7354153db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:33.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:33.243+0000 7f735a32b640 1 --2- 172.21.15.53:0/3928147600 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73540af720 0x7f73540c66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:33.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:33.243+0000 7f735a32b640 1 --2- 172.21.15.53:0/3928147600 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f735406bb30 0x7f7354154600 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:33.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:33.243+0000 7f735a32b640 1 -- 172.21.15.53:0/3928147600 >> 172.21.15.53:0/3928147600 conn(0x7f735406a0d0 msgr2=0x7f735406fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:33.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:33.243+0000 7f735a32b640 1 -- 172.21.15.53:0/3928147600 shutdown_connections 2023-06-10T18:56:33.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:33.243+0000 7f735a32b640 1 -- 172.21.15.53:0/3928147600 wait complete. 2023-06-10T18:56:33.263 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":166,"stamp":"2023-06-10T18:56:31.642205+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237976,"kb_used_data":5976,"kb_used_omap":0,"kb_used_meta":231936,"kb_avail":754736744,"statfs":{"total":773094113280,"available":772850425856,"internally_reserved":0,"allocated":6119424,"data_stored":3301653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":237502464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.003448"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.887321+0000","last_change":"2023-06-10T18:56:18.723557+0000","last_active":"2023-06-10T18:56:26.887321+0000","last_peered":"2023-06-10T18:56:26.887321+0000","last_clean":"2023-06-10T18:56:26.887321+0000","last_became_active":"2023-06-10T18:56:18.723169+0000","last_became_peered":"2023-06-10T18:56:18.723169+0000","last_unstale":"2023-06-10T18:56:26.887321+0000","last_undegraded":"2023-06-10T18:56:26.887321+0000","last_fullsized":"2023-06-10T18:56:26.887321+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:05:32.467816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.144646+0000","last_change":"2023-06-10T18:56:18.739659+0000","last_active":"2023-06-10T18:56:27.144646+0000","last_peered":"2023-06-10T18:56:27.144646+0000","last_clean":"2023-06-10T18:56:27.144646+0000","last_became_active":"2023-06-10T18:56:18.738930+0000","last_became_peered":"2023-06-10T18:56:18.738930+0000","last_unstale":"2023-06-10T18:56:27.144646+0000","last_undegraded":"2023-06-10T18:56:27.144646+0000","last_fullsized":"2023-06-10T18:56:27.144646+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:56:20.150212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.882137+0000","last_change":"2023-06-10T18:56:18.715713+0000","last_active":"2023-06-10T18:56:26.882137+0000","last_peered":"2023-06-10T18:56:26.882137+0000","last_clean":"2023-06-10T18:56:26.882137+0000","last_became_active":"2023-06-10T18:56:18.715403+0000","last_became_peered":"2023-06-10T18:56:18.715403+0000","last_unstale":"2023-06-10T18:56:26.882137+0000","last_undegraded":"2023-06-10T18:56:26.882137+0000","last_fullsized":"2023-06-10T18:56:26.882137+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:13:39.804832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.144321+0000","last_change":"2023-06-10T18:56:18.742396+0000","last_active":"2023-06-10T18:56:27.144321+0000","last_peered":"2023-06-10T18:56:27.144321+0000","last_clean":"2023-06-10T18:56:27.144321+0000","last_became_active":"2023-06-10T18:56:18.741689+0000","last_became_peered":"2023-06-10T18:56:18.741689+0000","last_unstale":"2023-06-10T18:56:27.144321+0000","last_undegraded":"2023-06-10T18:56:27.144321+0000","last_fullsized":"2023-06-10T18:56:27.144321+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:15:14.281447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.871175+0000","last_change":"2023-06-10T18:56:18.733830+0000","last_active":"2023-06-10T18:56:26.871175+0000","last_peered":"2023-06-10T18:56:26.871175+0000","last_clean":"2023-06-10T18:56:26.871175+0000","last_became_active":"2023-06-10T18:56:18.732968+0000","last_became_peered":"2023-06-10T18:56:18.732968+0000","last_unstale":"2023-06-10T18:56:26.871175+0000","last_undegraded":"2023-06-10T18:56:26.871175+0000","last_fullsized":"2023-06-10T18:56:26.871175+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:17:50.531074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.886873+0000","last_change":"2023-06-10T18:56:18.733304+0000","last_active":"2023-06-10T18:56:26.886873+0000","last_peered":"2023-06-10T18:56:26.886873+0000","last_clean":"2023-06-10T18:56:26.886873+0000","last_became_active":"2023-06-10T18:56:18.733010+0000","last_became_peered":"2023-06-10T18:56:18.733010+0000","last_unstale":"2023-06-10T18:56:26.886873+0000","last_undegraded":"2023-06-10T18:56:26.886873+0000","last_fullsized":"2023-06-10T18:56:26.886873+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:04:11.756055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.879556+0000","last_change":"2023-06-10T18:56:18.715925+0000","last_active":"2023-06-10T18:56:26.879556+0000","last_peered":"2023-06-10T18:56:26.879556+0000","last_clean":"2023-06-10T18:56:26.879556+0000","last_became_active":"2023-06-10T18:56:18.715163+0000","last_became_peered":"2023-06-10T18:56:18.715163+0000","last_unstale":"2023-06-10T18:56:26.879556+0000","last_undegraded":"2023-06-10T18:56:26.879556+0000","last_fullsized":"2023-06-10T18:56:26.879556+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:07:15.569502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.194669+0000","last_change":"2023-06-10T18:56:18.710693+0000","last_active":"2023-06-10T18:56:27.194669+0000","last_peered":"2023-06-10T18:56:27.194669+0000","last_clean":"2023-06-10T18:56:27.194669+0000","last_became_active":"2023-06-10T18:56:18.710420+0000","last_became_peered":"2023-06-10T18:56:18.710420+0000","last_unstale":"2023-06-10T18:56:27.194669+0000","last_undegraded":"2023-06-10T18:56:27.194669+0000","last_fullsized":"2023-06-10T18:56:27.194669+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:04:11.756055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.195404+0000","last_change":"2023-06-10T18:56:18.711205+0000","last_active":"2023-06-10T18:56:27.195404+0000","last_peered":"2023-06-10T18:56:27.195404+0000","last_clean":"2023-06-10T18:56:27.195404+0000","last_became_active":"2023-06-10T18:56:18.711011+0000","last_became_peered":"2023-06-10T18:56:18.711011+0000","last_unstale":"2023-06-10T18:56:27.195404+0000","last_undegraded":"2023-06-10T18:56:27.195404+0000","last_fullsized":"2023-06-10T18:56:27.195404+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:52:30.517410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.887403+0000","last_change":"2023-06-10T18:56:18.731703+0000","last_active":"2023-06-10T18:56:26.887403+0000","last_peered":"2023-06-10T18:56:26.887403+0000","last_clean":"2023-06-10T18:56:26.887403+0000","last_became_active":"2023-06-10T18:56:18.731407+0000","last_became_peered":"2023-06-10T18:56:18.731407+0000","last_unstale":"2023-06-10T18:56:26.887403+0000","last_undegraded":"2023-06-10T18:56:26.887403+0000","last_fullsized":"2023-06-10T18:56:26.887403+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:13:39.804832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.868234+0000","last_change":"2023-06-10T18:56:18.739026+0000","last_active":"2023-06-10T18:56:26.868234+0000","last_peered":"2023-06-10T18:56:26.868234+0000","last_clean":"2023-06-10T18:56:26.868234+0000","last_became_active":"2023-06-10T18:56:18.738748+0000","last_became_peered":"2023-06-10T18:56:18.738748+0000","last_unstale":"2023-06-10T18:56:26.868234+0000","last_undegraded":"2023-06-10T18:56:26.868234+0000","last_fullsized":"2023-06-10T18:56:26.868234+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:11:27.241616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.195269+0000","last_change":"2023-06-10T18:56:18.711319+0000","last_active":"2023-06-10T18:56:27.195269+0000","last_peered":"2023-06-10T18:56:27.195269+0000","last_clean":"2023-06-10T18:56:27.195269+0000","last_became_active":"2023-06-10T18:56:18.711043+0000","last_became_peered":"2023-06-10T18:56:18.711043+0000","last_unstale":"2023-06-10T18:56:27.195269+0000","last_undegraded":"2023-06-10T18:56:27.195269+0000","last_fullsized":"2023-06-10T18:56:27.195269+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:05:32.467816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.886977+0000","last_change":"2023-06-10T18:56:18.735130+0000","last_active":"2023-06-10T18:56:26.886977+0000","last_peered":"2023-06-10T18:56:26.886977+0000","last_clean":"2023-06-10T18:56:26.886977+0000","last_became_active":"2023-06-10T18:56:18.734873+0000","last_became_peered":"2023-06-10T18:56:18.734873+0000","last_unstale":"2023-06-10T18:56:26.886977+0000","last_undegraded":"2023-06-10T18:56:26.886977+0000","last_fullsized":"2023-06-10T18:56:26.886977+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:27:56.626985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.879977+0000","last_change":"2023-06-10T18:56:18.718525+0000","last_active":"2023-06-10T18:56:26.879977+0000","last_peered":"2023-06-10T18:56:26.879977+0000","last_clean":"2023-06-10T18:56:26.879977+0000","last_became_active":"2023-06-10T18:56:18.718169+0000","last_became_peered":"2023-06-10T18:56:18.718169+0000","last_unstale":"2023-06-10T18:56:26.879977+0000","last_undegraded":"2023-06-10T18:56:26.879977+0000","last_fullsized":"2023-06-10T18:56:26.879977+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:17:01.114014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.144057+0000","last_change":"2023-06-10T18:56:18.747220+0000","last_active":"2023-06-10T18:56:27.144057+0000","last_peered":"2023-06-10T18:56:27.144057+0000","last_clean":"2023-06-10T18:56:27.144057+0000","last_became_active":"2023-06-10T18:56:18.746415+0000","last_became_peered":"2023-06-10T18:56:18.746415+0000","last_unstale":"2023-06-10T18:56:27.144057+0000","last_undegraded":"2023-06-10T18:56:27.144057+0000","last_fullsized":"2023-06-10T18:56:27.144057+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:02:03.688477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.886572+0000","last_change":"2023-06-10T18:56:18.732379+0000","last_active":"2023-06-10T18:56:26.886572+0000","last_peered":"2023-06-10T18:56:26.886572+0000","last_clean":"2023-06-10T18:56:26.886572+0000","last_became_active":"2023-06-10T18:56:18.732081+0000","last_became_peered":"2023-06-10T18:56:18.732081+0000","last_unstale":"2023-06-10T18:56:26.886572+0000","last_undegraded":"2023-06-10T18:56:26.886572+0000","last_fullsized":"2023-06-10T18:56:26.886572+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:17:50.531074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.880795+0000","last_change":"2023-06-10T18:56:18.727402+0000","last_active":"2023-06-10T18:56:26.880795+0000","last_peered":"2023-06-10T18:56:26.880795+0000","last_clean":"2023-06-10T18:56:26.880795+0000","last_became_active":"2023-06-10T18:56:18.726939+0000","last_became_peered":"2023-06-10T18:56:18.726939+0000","last_unstale":"2023-06-10T18:56:26.880795+0000","last_undegraded":"2023-06-10T18:56:26.880795+0000","last_fullsized":"2023-06-10T18:56:26.880795+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:57:17.090045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.144764+0000","last_change":"2023-06-10T18:56:18.741248+0000","last_active":"2023-06-10T18:56:27.144764+0000","last_peered":"2023-06-10T18:56:27.144764+0000","last_clean":"2023-06-10T18:56:27.144764+0000","last_became_active":"2023-06-10T18:56:18.740548+0000","last_became_peered":"2023-06-10T18:56:18.740548+0000","last_unstale":"2023-06-10T18:56:27.144764+0000","last_undegraded":"2023-06-10T18:56:27.144764+0000","last_fullsized":"2023-06-10T18:56:27.144764+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:51:41.177614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.880542+0000","last_change":"2023-06-10T18:56:18.718426+0000","last_active":"2023-06-10T18:56:26.880542+0000","last_peered":"2023-06-10T18:56:26.880542+0000","last_clean":"2023-06-10T18:56:26.880542+0000","last_became_active":"2023-06-10T18:56:18.718017+0000","last_became_peered":"2023-06-10T18:56:18.718017+0000","last_unstale":"2023-06-10T18:56:26.880542+0000","last_undegraded":"2023-06-10T18:56:26.880542+0000","last_fullsized":"2023-06-10T18:56:26.880542+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:36:56.932324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.875458+0000","last_change":"2023-06-10T18:56:18.734189+0000","last_active":"2023-06-10T18:56:26.875458+0000","last_peered":"2023-06-10T18:56:26.875458+0000","last_clean":"2023-06-10T18:56:26.875458+0000","last_became_active":"2023-06-10T18:56:18.733412+0000","last_became_peered":"2023-06-10T18:56:18.733412+0000","last_unstale":"2023-06-10T18:56:26.875458+0000","last_undegraded":"2023-06-10T18:56:26.875458+0000","last_fullsized":"2023-06-10T18:56:26.875458+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:59:44.756321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.875364+0000","last_change":"2023-06-10T18:56:18.737307+0000","last_active":"2023-06-10T18:56:26.875364+0000","last_peered":"2023-06-10T18:56:26.875364+0000","last_clean":"2023-06-10T18:56:26.875364+0000","last_became_active":"2023-06-10T18:56:18.736534+0000","last_became_peered":"2023-06-10T18:56:18.736534+0000","last_unstale":"2023-06-10T18:56:26.875364+0000","last_undegraded":"2023-06-10T18:56:26.875364+0000","last_fullsized":"2023-06-10T18:56:26.875364+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:01:44.663641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.194660+0000","last_change":"2023-06-10T18:56:18.710819+0000","last_active":"2023-06-10T18:56:27.194660+0000","last_peered":"2023-06-10T18:56:27.194660+0000","last_clean":"2023-06-10T18:56:27.194660+0000","last_became_active":"2023-06-10T18:56:18.710524+0000","last_became_peered":"2023-06-10T18:56:18.710524+0000","last_unstale":"2023-06-10T18:56:27.194660+0000","last_undegraded":"2023-06-10T18:56:27.194660+0000","last_fullsized":"2023-06-10T18:56:27.194660+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:16:44.545696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.867692+0000","last_change":"2023-06-10T18:56:18.739719+0000","last_active":"2023-06-10T18:56:26.867692+0000","last_peered":"2023-06-10T18:56:26.867692+0000","last_clean":"2023-06-10T18:56:26.867692+0000","last_became_active":"2023-06-10T18:56:18.739394+0000","last_became_peered":"2023-06-10T18:56:18.739394+0000","last_unstale":"2023-06-10T18:56:26.867692+0000","last_undegraded":"2023-06-10T18:56:26.867692+0000","last_fullsized":"2023-06-10T18:56:26.867692+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:48:22.699885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.879440+0000","last_change":"2023-06-10T18:56:18.716014+0000","last_active":"2023-06-10T18:56:26.879440+0000","last_peered":"2023-06-10T18:56:26.879440+0000","last_clean":"2023-06-10T18:56:26.879440+0000","last_became_active":"2023-06-10T18:56:18.715463+0000","last_became_peered":"2023-06-10T18:56:18.715463+0000","last_unstale":"2023-06-10T18:56:26.879440+0000","last_undegraded":"2023-06-10T18:56:26.879440+0000","last_fullsized":"2023-06-10T18:56:26.879440+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:40:33.066988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.881131+0000","last_change":"2023-06-10T18:56:18.722488+0000","last_active":"2023-06-10T18:56:26.881131+0000","last_peered":"2023-06-10T18:56:26.881131+0000","last_clean":"2023-06-10T18:56:26.881131+0000","last_became_active":"2023-06-10T18:56:18.722221+0000","last_became_peered":"2023-06-10T18:56:18.722221+0000","last_unstale":"2023-06-10T18:56:26.881131+0000","last_undegraded":"2023-06-10T18:56:26.881131+0000","last_fullsized":"2023-06-10T18:56:26.881131+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:16:44.545696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.195014+0000","last_change":"2023-06-10T18:56:18.721449+0000","last_active":"2023-06-10T18:56:27.195014+0000","last_peered":"2023-06-10T18:56:27.195014+0000","last_clean":"2023-06-10T18:56:27.195014+0000","last_became_active":"2023-06-10T18:56:18.721191+0000","last_became_peered":"2023-06-10T18:56:18.721191+0000","last_unstale":"2023-06-10T18:56:27.195014+0000","last_undegraded":"2023-06-10T18:56:27.195014+0000","last_fullsized":"2023-06-10T18:56:27.195014+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:18:25.090460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.888495+0000","last_change":"2023-06-10T18:56:18.719671+0000","last_active":"2023-06-10T18:56:26.888495+0000","last_peered":"2023-06-10T18:56:26.888495+0000","last_clean":"2023-06-10T18:56:26.888495+0000","last_became_active":"2023-06-10T18:56:18.718588+0000","last_became_peered":"2023-06-10T18:56:18.718588+0000","last_unstale":"2023-06-10T18:56:26.888495+0000","last_undegraded":"2023-06-10T18:56:26.888495+0000","last_fullsized":"2023-06-10T18:56:26.888495+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:57:04.253762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.875781+0000","last_change":"2023-06-10T18:56:18.720108+0000","last_active":"2023-06-10T18:56:26.875781+0000","last_peered":"2023-06-10T18:56:26.875781+0000","last_clean":"2023-06-10T18:56:26.875781+0000","last_became_active":"2023-06-10T18:56:18.719242+0000","last_became_peered":"2023-06-10T18:56:18.719242+0000","last_unstale":"2023-06-10T18:56:26.875781+0000","last_undegraded":"2023-06-10T18:56:26.875781+0000","last_fullsized":"2023-06-10T18:56:26.875781+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:41:27.064954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.879750+0000","last_change":"2023-06-10T18:56:18.747959+0000","last_active":"2023-06-10T18:56:26.879750+0000","last_peered":"2023-06-10T18:56:26.879750+0000","last_clean":"2023-06-10T18:56:26.879750+0000","last_became_active":"2023-06-10T18:56:18.747680+0000","last_became_peered":"2023-06-10T18:56:18.747680+0000","last_unstale":"2023-06-10T18:56:26.879750+0000","last_undegraded":"2023-06-10T18:56:26.879750+0000","last_fullsized":"2023-06-10T18:56:26.879750+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:22:48.846033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.144212+0000","last_change":"2023-06-10T18:56:18.740103+0000","last_active":"2023-06-10T18:56:27.144212+0000","last_peered":"2023-06-10T18:56:27.144212+0000","last_clean":"2023-06-10T18:56:27.144212+0000","last_became_active":"2023-06-10T18:56:18.739227+0000","last_became_peered":"2023-06-10T18:56:18.739227+0000","last_unstale":"2023-06-10T18:56:27.144212+0000","last_undegraded":"2023-06-10T18:56:27.144212+0000","last_fullsized":"2023-06-10T18:56:27.144212+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:21:25.069656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.879705+0000","last_change":"2023-06-10T18:56:18.715535+0000","last_active":"2023-06-10T18:56:26.879705+0000","last_peered":"2023-06-10T18:56:26.879705+0000","last_clean":"2023-06-10T18:56:26.879705+0000","last_became_active":"2023-06-10T18:56:18.714677+0000","last_became_peered":"2023-06-10T18:56:18.714677+0000","last_unstale":"2023-06-10T18:56:26.879705+0000","last_undegraded":"2023-06-10T18:56:26.879705+0000","last_fullsized":"2023-06-10T18:56:26.879705+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:12:02.143937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.871827+0000","last_change":"2023-06-10T18:56:18.705775+0000","last_active":"2023-06-10T18:56:26.871827+0000","last_peered":"2023-06-10T18:56:26.871827+0000","last_clean":"2023-06-10T18:56:26.871827+0000","last_became_active":"2023-06-10T18:56:18.703437+0000","last_became_peered":"2023-06-10T18:56:18.703437+0000","last_unstale":"2023-06-10T18:56:26.871827+0000","last_undegraded":"2023-06-10T18:56:26.871827+0000","last_fullsized":"2023-06-10T18:56:26.871827+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:03:07.190449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.143717+0000","last_change":"2023-06-10T18:56:18.740486+0000","last_active":"2023-06-10T18:56:27.143717+0000","last_peered":"2023-06-10T18:56:27.143717+0000","last_clean":"2023-06-10T18:56:27.143717+0000","last_became_active":"2023-06-10T18:56:18.739644+0000","last_became_peered":"2023-06-10T18:56:18.739644+0000","last_unstale":"2023-06-10T18:56:27.143717+0000","last_undegraded":"2023-06-10T18:56:27.143717+0000","last_fullsized":"2023-06-10T18:56:27.143717+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:30:31.600689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"50'4","reported_seq":19,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.876540+0000","last_change":"2023-06-10T18:56:18.340764+0000","last_active":"2023-06-10T18:56:26.876540+0000","last_peered":"2023-06-10T18:56:26.876540+0000","last_clean":"2023-06-10T18:56:26.876540+0000","last_became_active":"2023-06-10T18:56:18.340011+0000","last_became_peered":"2023-06-10T18:56:18.340011+0000","last_unstale":"2023-06-10T18:56:26.876540+0000","last_undegraded":"2023-06-10T18:56:26.876540+0000","last_fullsized":"2023-06-10T18:56:26.876540+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:11:50.546839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.873041+0000","last_change":"2023-06-10T18:56:18.735833+0000","last_active":"2023-06-10T18:56:26.873041+0000","last_peered":"2023-06-10T18:56:26.873041+0000","last_clean":"2023-06-10T18:56:26.873041+0000","last_became_active":"2023-06-10T18:56:18.734668+0000","last_became_peered":"2023-06-10T18:56:18.734668+0000","last_unstale":"2023-06-10T18:56:26.873041+0000","last_undegraded":"2023-06-10T18:56:26.873041+0000","last_fullsized":"2023-06-10T18:56:26.873041+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:16:35.200792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"50'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.887551+0000","last_change":"2023-06-10T18:56:18.335972+0000","last_active":"2023-06-10T18:56:26.887551+0000","last_peered":"2023-06-10T18:56:26.887551+0000","last_clean":"2023-06-10T18:56:26.887551+0000","last_became_active":"2023-06-10T18:56:18.335565+0000","last_became_peered":"2023-06-10T18:56:18.335565+0000","last_unstale":"2023-06-10T18:56:26.887551+0000","last_undegraded":"2023-06-10T18:56:26.887551+0000","last_fullsized":"2023-06-10T18:56:26.887551+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:52:29.503909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.875187+0000","last_change":"2023-06-10T18:56:18.741042+0000","last_active":"2023-06-10T18:56:26.875187+0000","last_peered":"2023-06-10T18:56:26.875187+0000","last_clean":"2023-06-10T18:56:26.875187+0000","last_became_active":"2023-06-10T18:56:18.740325+0000","last_became_peered":"2023-06-10T18:56:18.740325+0000","last_unstale":"2023-06-10T18:56:26.875187+0000","last_undegraded":"2023-06-10T18:56:26.875187+0000","last_fullsized":"2023-06-10T18:56:26.875187+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:45:27.842047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"50'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.888555+0000","last_change":"2023-06-10T18:56:18.336603+0000","last_active":"2023-06-10T18:56:26.888555+0000","last_peered":"2023-06-10T18:56:26.888555+0000","last_clean":"2023-06-10T18:56:26.888555+0000","last_became_active":"2023-06-10T18:56:18.336117+0000","last_became_peered":"2023-06-10T18:56:18.336117+0000","last_unstale":"2023-06-10T18:56:26.888555+0000","last_undegraded":"2023-06-10T18:56:26.888555+0000","last_fullsized":"2023-06-10T18:56:26.888555+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:41:56.108306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.194691+0000","last_change":"2023-06-10T18:56:18.719404+0000","last_active":"2023-06-10T18:56:27.194691+0000","last_peered":"2023-06-10T18:56:27.194691+0000","last_clean":"2023-06-10T18:56:27.194691+0000","last_became_active":"2023-06-10T18:56:18.719096+0000","last_became_peered":"2023-06-10T18:56:18.719096+0000","last_unstale":"2023-06-10T18:56:27.194691+0000","last_undegraded":"2023-06-10T18:56:27.194691+0000","last_fullsized":"2023-06-10T18:56:27.194691+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:33:38.472734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"50'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.872249+0000","last_change":"2023-06-10T18:56:18.323382+0000","last_active":"2023-06-10T18:56:26.872249+0000","last_peered":"2023-06-10T18:56:26.872249+0000","last_clean":"2023-06-10T18:56:26.872249+0000","last_became_active":"2023-06-10T18:56:18.322748+0000","last_became_peered":"2023-06-10T18:56:18.322748+0000","last_unstale":"2023-06-10T18:56:26.872249+0000","last_undegraded":"2023-06-10T18:56:26.872249+0000","last_fullsized":"2023-06-10T18:56:26.872249+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:35:54.887943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.872083+0000","last_change":"2023-06-10T18:56:18.716497+0000","last_active":"2023-06-10T18:56:26.872083+0000","last_peered":"2023-06-10T18:56:26.872083+0000","last_clean":"2023-06-10T18:56:26.872083+0000","last_became_active":"2023-06-10T18:56:18.715689+0000","last_became_peered":"2023-06-10T18:56:18.715689+0000","last_unstale":"2023-06-10T18:56:26.872083+0000","last_undegraded":"2023-06-10T18:56:26.872083+0000","last_fullsized":"2023-06-10T18:56:26.872083+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:27:56.626985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"50'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.880042+0000","last_change":"2023-06-10T18:56:18.321017+0000","last_active":"2023-06-10T18:56:26.880042+0000","last_peered":"2023-06-10T18:56:26.880042+0000","last_clean":"2023-06-10T18:56:26.880042+0000","last_became_active":"2023-06-10T18:56:18.320552+0000","last_became_peered":"2023-06-10T18:56:18.320552+0000","last_unstale":"2023-06-10T18:56:26.880042+0000","last_undegraded":"2023-06-10T18:56:26.880042+0000","last_fullsized":"2023-06-10T18:56:26.880042+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:53:30.066871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.144497+0000","last_change":"2023-06-10T18:56:18.742047+0000","last_active":"2023-06-10T18:56:27.144497+0000","last_peered":"2023-06-10T18:56:27.144497+0000","last_clean":"2023-06-10T18:56:27.144497+0000","last_became_active":"2023-06-10T18:56:18.741342+0000","last_became_peered":"2023-06-10T18:56:18.741342+0000","last_unstale":"2023-06-10T18:56:27.144497+0000","last_undegraded":"2023-06-10T18:56:27.144497+0000","last_fullsized":"2023-06-10T18:56:27.144497+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:39:30.440026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"50'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.871399+0000","last_change":"2023-06-10T18:56:18.339655+0000","last_active":"2023-06-10T18:56:26.871399+0000","last_peered":"2023-06-10T18:56:26.871399+0000","last_clean":"2023-06-10T18:56:26.871399+0000","last_became_active":"2023-06-10T18:56:18.338930+0000","last_became_peered":"2023-06-10T18:56:18.338930+0000","last_unstale":"2023-06-10T18:56:26.871399+0000","last_undegraded":"2023-06-10T18:56:26.871399+0000","last_fullsized":"2023-06-10T18:56:26.871399+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:57:16.076543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.195762+0000","last_change":"2023-06-10T18:56:18.721372+0000","last_active":"2023-06-10T18:56:27.195762+0000","last_peered":"2023-06-10T18:56:27.195762+0000","last_clean":"2023-06-10T18:56:27.195762+0000","last_became_active":"2023-06-10T18:56:18.721086+0000","last_became_peered":"2023-06-10T18:56:18.721086+0000","last_unstale":"2023-06-10T18:56:27.195762+0000","last_undegraded":"2023-06-10T18:56:27.195762+0000","last_fullsized":"2023-06-10T18:56:27.195762+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:36:50.106017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.875086+0000","last_change":"2023-06-10T18:56:18.337501+0000","last_active":"2023-06-10T18:56:26.875086+0000","last_peered":"2023-06-10T18:56:26.875086+0000","last_clean":"2023-06-10T18:56:26.875086+0000","last_became_active":"2023-06-10T18:56:18.336875+0000","last_became_peered":"2023-06-10T18:56:18.336875+0000","last_unstale":"2023-06-10T18:56:26.875086+0000","last_undegraded":"2023-06-10T18:56:26.875086+0000","last_fullsized":"2023-06-10T18:56:26.875086+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:54:49.818477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.144972+0000","last_change":"2023-06-10T18:56:18.740844+0000","last_active":"2023-06-10T18:56:27.144972+0000","last_peered":"2023-06-10T18:56:27.144972+0000","last_clean":"2023-06-10T18:56:27.144972+0000","last_became_active":"2023-06-10T18:56:18.740202+0000","last_became_peered":"2023-06-10T18:56:18.740202+0000","last_unstale":"2023-06-10T18:56:27.144972+0000","last_undegraded":"2023-06-10T18:56:27.144972+0000","last_fullsized":"2023-06-10T18:56:27.144972+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:34:13.702327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.879577+0000","last_change":"2023-06-10T18:56:18.328357+0000","last_active":"2023-06-10T18:56:26.879577+0000","last_peered":"2023-06-10T18:56:26.879577+0000","last_clean":"2023-06-10T18:56:26.879577+0000","last_became_active":"2023-06-10T18:56:18.328062+0000","last_became_peered":"2023-06-10T18:56:18.328062+0000","last_unstale":"2023-06-10T18:56:26.879577+0000","last_undegraded":"2023-06-10T18:56:26.879577+0000","last_fullsized":"2023-06-10T18:56:26.879577+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:42:04.516586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.870557+0000","last_change":"2023-06-10T18:56:18.715041+0000","last_active":"2023-06-10T18:56:26.870557+0000","last_peered":"2023-06-10T18:56:26.870557+0000","last_clean":"2023-06-10T18:56:26.870557+0000","last_became_active":"2023-06-10T18:56:18.714315+0000","last_became_peered":"2023-06-10T18:56:18.714315+0000","last_unstale":"2023-06-10T18:56:26.870557+0000","last_undegraded":"2023-06-10T18:56:26.870557+0000","last_fullsized":"2023-06-10T18:56:26.870557+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:23:30.185213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.144647+0000","last_change":"2023-06-10T18:56:18.343930+0000","last_active":"2023-06-10T18:56:27.144647+0000","last_peered":"2023-06-10T18:56:27.144647+0000","last_clean":"2023-06-10T18:56:27.144647+0000","last_became_active":"2023-06-10T18:56:18.343289+0000","last_became_peered":"2023-06-10T18:56:18.343289+0000","last_unstale":"2023-06-10T18:56:27.144647+0000","last_undegraded":"2023-06-10T18:56:27.144647+0000","last_fullsized":"2023-06-10T18:56:27.144647+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:14:05.116786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.872895+0000","last_change":"2023-06-10T18:56:18.720481+0000","last_active":"2023-06-10T18:56:26.872895+0000","last_peered":"2023-06-10T18:56:26.872895+0000","last_clean":"2023-06-10T18:56:26.872895+0000","last_became_active":"2023-06-10T18:56:18.717729+0000","last_became_peered":"2023-06-10T18:56:18.717729+0000","last_unstale":"2023-06-10T18:56:26.872895+0000","last_undegraded":"2023-06-10T18:56:26.872895+0000","last_fullsized":"2023-06-10T18:56:26.872895+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:07:34.244620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.872218+0000","last_change":"2023-06-10T18:56:18.331216+0000","last_active":"2023-06-10T18:56:26.872218+0000","last_peered":"2023-06-10T18:56:26.872218+0000","last_clean":"2023-06-10T18:56:26.872218+0000","last_became_active":"2023-06-10T18:56:18.330640+0000","last_became_peered":"2023-06-10T18:56:18.330640+0000","last_unstale":"2023-06-10T18:56:26.872218+0000","last_undegraded":"2023-06-10T18:56:26.872218+0000","last_fullsized":"2023-06-10T18:56:26.872218+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:16:43.532194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.880373+0000","last_change":"2023-06-10T18:56:18.745850+0000","last_active":"2023-06-10T18:56:26.880373+0000","last_peered":"2023-06-10T18:56:26.880373+0000","last_clean":"2023-06-10T18:56:26.880373+0000","last_became_active":"2023-06-10T18:56:18.745516+0000","last_became_peered":"2023-06-10T18:56:18.745516+0000","last_unstale":"2023-06-10T18:56:26.880373+0000","last_undegraded":"2023-06-10T18:56:26.880373+0000","last_fullsized":"2023-06-10T18:56:26.880373+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:53:56.836970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"50'3","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.144726+0000","last_change":"2023-06-10T18:56:18.341819+0000","last_active":"2023-06-10T18:56:27.144726+0000","last_peered":"2023-06-10T18:56:27.144726+0000","last_clean":"2023-06-10T18:56:27.144726+0000","last_became_active":"2023-06-10T18:56:18.341153+0000","last_became_peered":"2023-06-10T18:56:18.341153+0000","last_unstale":"2023-06-10T18:56:27.144726+0000","last_undegraded":"2023-06-10T18:56:27.144726+0000","last_fullsized":"2023-06-10T18:56:27.144726+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:13:55.771862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.871435+0000","last_change":"2023-06-10T18:56:18.718945+0000","last_active":"2023-06-10T18:56:26.871435+0000","last_peered":"2023-06-10T18:56:26.871435+0000","last_clean":"2023-06-10T18:56:26.871435+0000","last_became_active":"2023-06-10T18:56:18.717962+0000","last_became_peered":"2023-06-10T18:56:18.717962+0000","last_unstale":"2023-06-10T18:56:26.871435+0000","last_undegraded":"2023-06-10T18:56:26.871435+0000","last_fullsized":"2023-06-10T18:56:26.871435+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:04:11.756055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"50'6","reported_seq":21,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.195682+0000","last_change":"2023-06-10T18:56:18.333312+0000","last_active":"2023-06-10T18:56:27.195682+0000","last_peered":"2023-06-10T18:56:27.195682+0000","last_clean":"2023-06-10T18:56:27.195682+0000","last_became_active":"2023-06-10T18:56:18.332390+0000","last_became_peered":"2023-06-10T18:56:18.332390+0000","last_unstale":"2023-06-10T18:56:27.195682+0000","last_undegraded":"2023-06-10T18:56:27.195682+0000","last_fullsized":"2023-06-10T18:56:27.195682+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:04:57.213752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.871933+0000","last_change":"2023-06-10T18:56:18.739711+0000","last_active":"2023-06-10T18:56:26.871933+0000","last_peered":"2023-06-10T18:56:26.871933+0000","last_clean":"2023-06-10T18:56:26.871933+0000","last_became_active":"2023-06-10T18:56:18.738999+0000","last_became_peered":"2023-06-10T18:56:18.738999+0000","last_unstale":"2023-06-10T18:56:26.871933+0000","last_undegraded":"2023-06-10T18:56:26.871933+0000","last_fullsized":"2023-06-10T18:56:26.871933+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:14:23.654180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"50'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.880149+0000","last_change":"2023-06-10T18:56:18.342157+0000","last_active":"2023-06-10T18:56:26.880149+0000","last_peered":"2023-06-10T18:56:26.880149+0000","last_clean":"2023-06-10T18:56:26.880149+0000","last_became_active":"2023-06-10T18:56:18.341576+0000","last_became_peered":"2023-06-10T18:56:18.341576+0000","last_unstale":"2023-06-10T18:56:26.880149+0000","last_undegraded":"2023-06-10T18:56:26.880149+0000","last_fullsized":"2023-06-10T18:56:26.880149+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:23:29.171711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":2,"reported_epoch":52,"state":"peering","last_fresh":"2023-06-10T18:56:22.631216+0000","last_change":"2023-06-10T18:56:27.634240+0000","last_active":"2023-06-10T18:56:27.634240+0000","last_peered":"2023-06-10T18:56:22.631216+0000","last_clean":"2023-06-10T18:56:22.631216+0000","last_became_active":"2023-06-10T18:56:18.711779+0000","last_became_peered":"2023-06-10T18:56:18.711779+0000","last_unstale":"2023-06-10T18:56:22.631216+0000","last_undegraded":"2023-06-10T18:56:22.631216+0000","last_fullsized":"2023-06-10T18:56:22.631216+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.875792+0000","last_change":"2023-06-10T18:56:18.335774+0000","last_active":"2023-06-10T18:56:26.875792+0000","last_peered":"2023-06-10T18:56:26.875792+0000","last_clean":"2023-06-10T18:56:26.875792+0000","last_became_active":"2023-06-10T18:56:18.334295+0000","last_became_peered":"2023-06-10T18:56:18.334295+0000","last_unstale":"2023-06-10T18:56:26.875792+0000","last_undegraded":"2023-06-10T18:56:26.875792+0000","last_fullsized":"2023-06-10T18:56:26.875792+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:45:39.069258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.195203+0000","last_change":"2023-06-10T18:56:18.732193+0000","last_active":"2023-06-10T18:56:27.195203+0000","last_peered":"2023-06-10T18:56:27.195203+0000","last_clean":"2023-06-10T18:56:27.195203+0000","last_became_active":"2023-06-10T18:56:18.731876+0000","last_became_peered":"2023-06-10T18:56:18.731876+0000","last_unstale":"2023-06-10T18:56:27.195203+0000","last_undegraded":"2023-06-10T18:56:27.195203+0000","last_fullsized":"2023-06-10T18:56:27.195203+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:41:57.121808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.144429+0000","last_change":"2023-06-10T18:56:18.348170+0000","last_active":"2023-06-10T18:56:27.144429+0000","last_peered":"2023-06-10T18:56:27.144429+0000","last_clean":"2023-06-10T18:56:27.144429+0000","last_became_active":"2023-06-10T18:56:18.347458+0000","last_became_peered":"2023-06-10T18:56:18.347458+0000","last_unstale":"2023-06-10T18:56:27.144429+0000","last_undegraded":"2023-06-10T18:56:27.144429+0000","last_fullsized":"2023-06-10T18:56:27.144429+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:08:51.581596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.880965+0000","last_change":"2023-06-10T18:56:18.727211+0000","last_active":"2023-06-10T18:56:26.880965+0000","last_peered":"2023-06-10T18:56:26.880965+0000","last_clean":"2023-06-10T18:56:26.880965+0000","last_became_active":"2023-06-10T18:56:18.726575+0000","last_became_peered":"2023-06-10T18:56:18.726575+0000","last_unstale":"2023-06-10T18:56:26.880965+0000","last_undegraded":"2023-06-10T18:56:26.880965+0000","last_fullsized":"2023-06-10T18:56:26.880965+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:04:11.756055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"50'8","reported_seq":23,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.195340+0000","last_change":"2023-06-10T18:56:18.332240+0000","last_active":"2023-06-10T18:56:27.195340+0000","last_peered":"2023-06-10T18:56:27.195340+0000","last_clean":"2023-06-10T18:56:27.195340+0000","last_became_active":"2023-06-10T18:56:18.331781+0000","last_became_peered":"2023-06-10T18:56:18.331781+0000","last_unstale":"2023-06-10T18:56:27.195340+0000","last_undegraded":"2023-06-10T18:56:27.195340+0000","last_fullsized":"2023-06-10T18:56:27.195340+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:23:26.069557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.195018+0000","last_change":"2023-06-10T18:56:18.702816+0000","last_active":"2023-06-10T18:56:27.195018+0000","last_peered":"2023-06-10T18:56:27.195018+0000","last_clean":"2023-06-10T18:56:27.195018+0000","last_became_active":"2023-06-10T18:56:18.702527+0000","last_became_peered":"2023-06-10T18:56:18.702527+0000","last_unstale":"2023-06-10T18:56:27.195018+0000","last_undegraded":"2023-06-10T18:56:27.195018+0000","last_fullsized":"2023-06-10T18:56:27.195018+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:01:30.967639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"50'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.881337+0000","last_change":"2023-06-10T18:56:18.324631+0000","last_active":"2023-06-10T18:56:26.881337+0000","last_peered":"2023-06-10T18:56:26.881337+0000","last_clean":"2023-06-10T18:56:26.881337+0000","last_became_active":"2023-06-10T18:56:18.324243+0000","last_became_peered":"2023-06-10T18:56:18.324243+0000","last_unstale":"2023-06-10T18:56:26.881337+0000","last_undegraded":"2023-06-10T18:56:26.881337+0000","last_fullsized":"2023-06-10T18:56:26.881337+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:01:29.954138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.886746+0000","last_change":"2023-06-10T18:56:18.710557+0000","last_active":"2023-06-10T18:56:26.886746+0000","last_peered":"2023-06-10T18:56:26.886746+0000","last_clean":"2023-06-10T18:56:26.886746+0000","last_became_active":"2023-06-10T18:56:18.710238+0000","last_became_peered":"2023-06-10T18:56:18.710238+0000","last_unstale":"2023-06-10T18:56:26.886746+0000","last_undegraded":"2023-06-10T18:56:26.886746+0000","last_fullsized":"2023-06-10T18:56:26.886746+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:57:17.090045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"50'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.869232+0000","last_change":"2023-06-10T18:56:18.324362+0000","last_active":"2023-06-10T18:56:26.869232+0000","last_peered":"2023-06-10T18:56:26.869232+0000","last_clean":"2023-06-10T18:56:26.869232+0000","last_became_active":"2023-06-10T18:56:18.323943+0000","last_became_peered":"2023-06-10T18:56:18.323943+0000","last_unstale":"2023-06-10T18:56:26.869232+0000","last_undegraded":"2023-06-10T18:56:26.869232+0000","last_fullsized":"2023-06-10T18:56:26.869232+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:13:38.851442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.871058+0000","last_change":"2023-06-10T18:56:18.715476+0000","last_active":"2023-06-10T18:56:26.871058+0000","last_peered":"2023-06-10T18:56:26.871058+0000","last_clean":"2023-06-10T18:56:26.871058+0000","last_became_active":"2023-06-10T18:56:18.714697+0000","last_became_peered":"2023-06-10T18:56:18.714697+0000","last_unstale":"2023-06-10T18:56:26.871058+0000","last_undegraded":"2023-06-10T18:56:26.871058+0000","last_fullsized":"2023-06-10T18:56:26.871058+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:36:56.932324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"50'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.876240+0000","last_change":"2023-06-10T18:56:18.341065+0000","last_active":"2023-06-10T18:56:26.876240+0000","last_peered":"2023-06-10T18:56:26.876240+0000","last_clean":"2023-06-10T18:56:26.876240+0000","last_became_active":"2023-06-10T18:56:18.340242+0000","last_became_peered":"2023-06-10T18:56:18.340242+0000","last_unstale":"2023-06-10T18:56:26.876240+0000","last_undegraded":"2023-06-10T18:56:26.876240+0000","last_fullsized":"2023-06-10T18:56:26.876240+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:27:46.347276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.887392+0000","last_change":"2023-06-10T18:56:18.722679+0000","last_active":"2023-06-10T18:56:26.887392+0000","last_peered":"2023-06-10T18:56:26.887392+0000","last_clean":"2023-06-10T18:56:26.887392+0000","last_became_active":"2023-06-10T18:56:18.722389+0000","last_became_peered":"2023-06-10T18:56:18.722389+0000","last_unstale":"2023-06-10T18:56:26.887392+0000","last_undegraded":"2023-06-10T18:56:26.887392+0000","last_fullsized":"2023-06-10T18:56:26.887392+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:01:30.967639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.875808+0000","last_change":"2023-06-10T18:56:18.335157+0000","last_active":"2023-06-10T18:56:26.875808+0000","last_peered":"2023-06-10T18:56:26.875808+0000","last_clean":"2023-06-10T18:56:26.875808+0000","last_became_active":"2023-06-10T18:56:18.334417+0000","last_became_peered":"2023-06-10T18:56:18.334417+0000","last_unstale":"2023-06-10T18:56:26.875808+0000","last_undegraded":"2023-06-10T18:56:26.875808+0000","last_fullsized":"2023-06-10T18:56:26.875808+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:43:46.237306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.872091+0000","last_change":"2023-06-10T18:56:18.720351+0000","last_active":"2023-06-10T18:56:26.872091+0000","last_peered":"2023-06-10T18:56:26.872091+0000","last_clean":"2023-06-10T18:56:26.872091+0000","last_became_active":"2023-06-10T18:56:18.717962+0000","last_became_peered":"2023-06-10T18:56:18.717962+0000","last_unstale":"2023-06-10T18:56:26.872091+0000","last_undegraded":"2023-06-10T18:56:26.872091+0000","last_fullsized":"2023-06-10T18:56:26.872091+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:55:10.132650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"50'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.887432+0000","last_change":"2023-06-10T18:56:18.337149+0000","last_active":"2023-06-10T18:56:26.887432+0000","last_peered":"2023-06-10T18:56:26.887432+0000","last_clean":"2023-06-10T18:56:26.887432+0000","last_became_active":"2023-06-10T18:56:18.335525+0000","last_became_peered":"2023-06-10T18:56:18.335525+0000","last_unstale":"2023-06-10T18:56:26.887432+0000","last_undegraded":"2023-06-10T18:56:26.887432+0000","last_fullsized":"2023-06-10T18:56:26.887432+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:23:26.069557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.876152+0000","last_change":"2023-06-10T18:56:18.734899+0000","last_active":"2023-06-10T18:56:26.876152+0000","last_peered":"2023-06-10T18:56:26.876152+0000","last_clean":"2023-06-10T18:56:26.876152+0000","last_became_active":"2023-06-10T18:56:18.734152+0000","last_became_peered":"2023-06-10T18:56:18.734152+0000","last_unstale":"2023-06-10T18:56:26.876152+0000","last_undegraded":"2023-06-10T18:56:26.876152+0000","last_fullsized":"2023-06-10T18:56:26.876152+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:16:15.404759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.194661+0000","last_change":"2023-06-10T18:56:18.332341+0000","last_active":"2023-06-10T18:56:27.194661+0000","last_peered":"2023-06-10T18:56:27.194661+0000","last_clean":"2023-06-10T18:56:27.194661+0000","last_became_active":"2023-06-10T18:56:18.331836+0000","last_became_peered":"2023-06-10T18:56:18.331836+0000","last_unstale":"2023-06-10T18:56:27.194661+0000","last_undegraded":"2023-06-10T18:56:27.194661+0000","last_fullsized":"2023-06-10T18:56:27.194661+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:27:55.613483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.881243+0000","last_change":"2023-06-10T18:56:18.745846+0000","last_active":"2023-06-10T18:56:26.881243+0000","last_peered":"2023-06-10T18:56:26.881243+0000","last_clean":"2023-06-10T18:56:26.881243+0000","last_became_active":"2023-06-10T18:56:18.745527+0000","last_became_peered":"2023-06-10T18:56:18.745527+0000","last_unstale":"2023-06-10T18:56:26.881243+0000","last_undegraded":"2023-06-10T18:56:26.881243+0000","last_fullsized":"2023-06-10T18:56:26.881243+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:33:38.472734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.879935+0000","last_change":"2023-06-10T18:56:18.337764+0000","last_active":"2023-06-10T18:56:26.879935+0000","last_peered":"2023-06-10T18:56:26.879935+0000","last_clean":"2023-06-10T18:56:26.879935+0000","last_became_active":"2023-06-10T18:56:18.337390+0000","last_became_peered":"2023-06-10T18:56:18.337390+0000","last_unstale":"2023-06-10T18:56:26.879935+0000","last_undegraded":"2023-06-10T18:56:26.879935+0000","last_fullsized":"2023-06-10T18:56:26.879935+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:54:06.053571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.887362+0000","last_change":"2023-06-10T18:56:18.705770+0000","last_active":"2023-06-10T18:56:26.887362+0000","last_peered":"2023-06-10T18:56:26.887362+0000","last_clean":"2023-06-10T18:56:26.887362+0000","last_became_active":"2023-06-10T18:56:18.705487+0000","last_became_peered":"2023-06-10T18:56:18.705487+0000","last_unstale":"2023-06-10T18:56:26.887362+0000","last_undegraded":"2023-06-10T18:56:26.887362+0000","last_fullsized":"2023-06-10T18:56:26.887362+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:18:25.090460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.867631+0000","last_change":"2023-06-10T18:56:18.339683+0000","last_active":"2023-06-10T18:56:26.867631+0000","last_peered":"2023-06-10T18:56:26.867631+0000","last_clean":"2023-06-10T18:56:26.867631+0000","last_became_active":"2023-06-10T18:56:18.339076+0000","last_became_peered":"2023-06-10T18:56:18.339076+0000","last_unstale":"2023-06-10T18:56:26.867631+0000","last_undegraded":"2023-06-10T18:56:26.867631+0000","last_fullsized":"2023-06-10T18:56:26.867631+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:24:21.579841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.874936+0000","last_change":"2023-06-10T18:56:18.724347+0000","last_active":"2023-06-10T18:56:26.874936+0000","last_peered":"2023-06-10T18:56:26.874936+0000","last_clean":"2023-06-10T18:56:26.874936+0000","last_became_active":"2023-06-10T18:56:18.723327+0000","last_became_peered":"2023-06-10T18:56:18.723327+0000","last_unstale":"2023-06-10T18:56:26.874936+0000","last_undegraded":"2023-06-10T18:56:26.874936+0000","last_fullsized":"2023-06-10T18:56:26.874936+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:06:54.175628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"51'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.881525+0000","last_change":"2023-06-10T18:56:18.337157+0000","last_active":"2023-06-10T18:56:26.881525+0000","last_peered":"2023-06-10T18:56:26.881525+0000","last_clean":"2023-06-10T18:56:26.881525+0000","last_became_active":"2023-06-10T18:56:18.336768+0000","last_became_peered":"2023-06-10T18:56:18.336768+0000","last_unstale":"2023-06-10T18:56:26.881525+0000","last_undegraded":"2023-06-10T18:56:26.881525+0000","last_fullsized":"2023-06-10T18:56:26.881525+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:18:24.076958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":224,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.143607+0000","last_change":"2023-06-10T18:52:34.951528+0000","last_active":"2023-06-10T18:56:27.143607+0000","last_peered":"2023-06-10T18:56:27.143607+0000","last_clean":"2023-06-10T18:56:27.143607+0000","last_became_active":"2023-06-10T18:52:34.949099+0000","last_became_peered":"2023-06-10T18:52:34.949099+0000","last_unstale":"2023-06-10T18:56:27.143607+0000","last_undegraded":"2023-06-10T18:56:27.143607+0000","last_fullsized":"2023-06-10T18:56:27.143607+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_clean_scrub_stamp":"2023-06-10T18:52:33.633295+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:48:42.927886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":70,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.872604+0000","last_change":"2023-06-10T18:52:40.506384+0000","last_active":"2023-06-10T18:56:26.872604+0000","last_peered":"2023-06-10T18:56:26.872604+0000","last_clean":"2023-06-10T18:56:26.872604+0000","last_became_active":"2023-06-10T18:52:40.505701+0000","last_became_peered":"2023-06-10T18:52:40.505701+0000","last_unstale":"2023-06-10T18:56:26.872604+0000","last_undegraded":"2023-06-10T18:56:26.872604+0000","last_fullsized":"2023-06-10T18:56:26.872604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:48:00.502223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.887017+0000","last_change":"2023-06-10T18:56:18.714433+0000","last_active":"2023-06-10T18:56:26.887017+0000","last_peered":"2023-06-10T18:56:26.887017+0000","last_clean":"2023-06-10T18:56:26.887017+0000","last_became_active":"2023-06-10T18:56:18.714070+0000","last_became_peered":"2023-06-10T18:56:18.714070+0000","last_unstale":"2023-06-10T18:56:26.887017+0000","last_undegraded":"2023-06-10T18:56:26.887017+0000","last_fullsized":"2023-06-10T18:56:26.887017+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:16:44.545696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.144734+0000","last_change":"2023-06-10T18:56:18.341822+0000","last_active":"2023-06-10T18:56:27.144734+0000","last_peered":"2023-06-10T18:56:27.144734+0000","last_clean":"2023-06-10T18:56:27.144734+0000","last_became_active":"2023-06-10T18:56:18.341138+0000","last_became_peered":"2023-06-10T18:56:18.341138+0000","last_unstale":"2023-06-10T18:56:27.144734+0000","last_undegraded":"2023-06-10T18:56:27.144734+0000","last_fullsized":"2023-06-10T18:56:27.144734+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:19:07.044160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":68,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.144020+0000","last_change":"2023-06-10T18:52:40.512015+0000","last_active":"2023-06-10T18:56:27.144020+0000","last_peered":"2023-06-10T18:56:27.144020+0000","last_clean":"2023-06-10T18:56:27.144020+0000","last_became_active":"2023-06-10T18:52:40.511382+0000","last_became_peered":"2023-06-10T18:52:40.511382+0000","last_unstale":"2023-06-10T18:56:27.144020+0000","last_undegraded":"2023-06-10T18:56:27.144020+0000","last_fullsized":"2023-06-10T18:56:27.144020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:10:22.176800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.195451+0000","last_change":"2023-06-10T18:56:18.720642+0000","last_active":"2023-06-10T18:56:27.195451+0000","last_peered":"2023-06-10T18:56:27.195451+0000","last_clean":"2023-06-10T18:56:27.195451+0000","last_became_active":"2023-06-10T18:56:18.720385+0000","last_became_peered":"2023-06-10T18:56:18.720385+0000","last_unstale":"2023-06-10T18:56:27.195451+0000","last_undegraded":"2023-06-10T18:56:27.195451+0000","last_fullsized":"2023-06-10T18:56:27.195451+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:44:56.381072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.881015+0000","last_change":"2023-06-10T18:56:18.320760+0000","last_active":"2023-06-10T18:56:26.881015+0000","last_peered":"2023-06-10T18:56:26.881015+0000","last_clean":"2023-06-10T18:56:26.881015+0000","last_became_active":"2023-06-10T18:56:18.320373+0000","last_became_peered":"2023-06-10T18:56:18.320373+0000","last_unstale":"2023-06-10T18:56:26.881015+0000","last_undegraded":"2023-06-10T18:56:26.881015+0000","last_fullsized":"2023-06-10T18:56:26.881015+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:27:55.613483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":70,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.867695+0000","last_change":"2023-06-10T18:52:40.671725+0000","last_active":"2023-06-10T18:56:26.867695+0000","last_peered":"2023-06-10T18:56:26.867695+0000","last_clean":"2023-06-10T18:56:26.867695+0000","last_became_active":"2023-06-10T18:52:40.671442+0000","last_became_peered":"2023-06-10T18:52:40.671442+0000","last_unstale":"2023-06-10T18:56:26.867695+0000","last_undegraded":"2023-06-10T18:56:26.867695+0000","last_fullsized":"2023-06-10T18:56:26.867695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:26:09.367931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.872142+0000","last_change":"2023-06-10T18:56:18.704278+0000","last_active":"2023-06-10T18:56:26.872142+0000","last_peered":"2023-06-10T18:56:26.872142+0000","last_clean":"2023-06-10T18:56:26.872142+0000","last_became_active":"2023-06-10T18:56:18.703336+0000","last_became_peered":"2023-06-10T18:56:18.703336+0000","last_unstale":"2023-06-10T18:56:26.872142+0000","last_undegraded":"2023-06-10T18:56:26.872142+0000","last_fullsized":"2023-06-10T18:56:26.872142+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:43:45.838944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"50'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.876735+0000","last_change":"2023-06-10T18:56:18.335741+0000","last_active":"2023-06-10T18:56:26.876735+0000","last_peered":"2023-06-10T18:56:26.876735+0000","last_clean":"2023-06-10T18:56:26.876735+0000","last_became_active":"2023-06-10T18:56:18.334904+0000","last_became_peered":"2023-06-10T18:56:18.334904+0000","last_unstale":"2023-06-10T18:56:26.876735+0000","last_undegraded":"2023-06-10T18:56:26.876735+0000","last_fullsized":"2023-06-10T18:56:26.876735+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:08:18.807313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":70,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.871228+0000","last_change":"2023-06-10T18:52:40.510258+0000","last_active":"2023-06-10T18:56:26.871228+0000","last_peered":"2023-06-10T18:56:26.871228+0000","last_clean":"2023-06-10T18:56:26.871228+0000","last_became_active":"2023-06-10T18:52:40.509560+0000","last_became_peered":"2023-06-10T18:52:40.509560+0000","last_unstale":"2023-06-10T18:56:26.871228+0000","last_undegraded":"2023-06-10T18:56:26.871228+0000","last_fullsized":"2023-06-10T18:56:26.871228+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:43:32.943829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":2,"reported_epoch":52,"state":"peering","last_fresh":"2023-06-10T18:56:22.631242+0000","last_change":"2023-06-10T18:56:27.634300+0000","last_active":"2023-06-10T18:56:27.634300+0000","last_peered":"2023-06-10T18:56:22.631242+0000","last_clean":"2023-06-10T18:56:22.631242+0000","last_became_active":"2023-06-10T18:56:18.715542+0000","last_became_peered":"2023-06-10T18:56:18.715542+0000","last_unstale":"2023-06-10T18:56:22.631242+0000","last_undegraded":"2023-06-10T18:56:22.631242+0000","last_fullsized":"2023-06-10T18:56:22.631242+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.870792+0000","last_change":"2023-06-10T18:56:18.325010+0000","last_active":"2023-06-10T18:56:26.870792+0000","last_peered":"2023-06-10T18:56:26.870792+0000","last_clean":"2023-06-10T18:56:26.870792+0000","last_became_active":"2023-06-10T18:56:18.324414+0000","last_became_peered":"2023-06-10T18:56:18.324414+0000","last_unstale":"2023-06-10T18:56:26.870792+0000","last_undegraded":"2023-06-10T18:56:26.870792+0000","last_fullsized":"2023-06-10T18:56:26.870792+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:53:55.823468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":66,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.887066+0000","last_change":"2023-06-10T18:52:40.672266+0000","last_active":"2023-06-10T18:56:26.887066+0000","last_peered":"2023-06-10T18:56:26.887066+0000","last_clean":"2023-06-10T18:56:26.887066+0000","last_became_active":"2023-06-10T18:52:40.671966+0000","last_became_peered":"2023-06-10T18:52:40.671966+0000","last_unstale":"2023-06-10T18:56:26.887066+0000","last_undegraded":"2023-06-10T18:56:26.887066+0000","last_fullsized":"2023-06-10T18:56:26.887066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:29:59.663767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.195764+0000","last_change":"2023-06-10T18:56:18.703583+0000","last_active":"2023-06-10T18:56:27.195764+0000","last_peered":"2023-06-10T18:56:27.195764+0000","last_clean":"2023-06-10T18:56:27.195764+0000","last_became_active":"2023-06-10T18:56:18.703292+0000","last_became_peered":"2023-06-10T18:56:18.703292+0000","last_unstale":"2023-06-10T18:56:27.195764+0000","last_undegraded":"2023-06-10T18:56:27.195764+0000","last_fullsized":"2023-06-10T18:56:27.195764+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:37:45.597946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.872441+0000","last_change":"2023-06-10T18:56:18.331871+0000","last_active":"2023-06-10T18:56:26.872441+0000","last_peered":"2023-06-10T18:56:26.872441+0000","last_clean":"2023-06-10T18:56:26.872441+0000","last_became_active":"2023-06-10T18:56:18.331127+0000","last_became_peered":"2023-06-10T18:56:18.331127+0000","last_unstale":"2023-06-10T18:56:26.872441+0000","last_undegraded":"2023-06-10T18:56:26.872441+0000","last_fullsized":"2023-06-10T18:56:26.872441+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:56:07.925384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":68,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.144910+0000","last_change":"2023-06-10T18:52:40.671084+0000","last_active":"2023-06-10T18:56:27.144910+0000","last_peered":"2023-06-10T18:56:27.144910+0000","last_clean":"2023-06-10T18:56:27.144910+0000","last_became_active":"2023-06-10T18:52:40.670697+0000","last_became_peered":"2023-06-10T18:52:40.670697+0000","last_unstale":"2023-06-10T18:56:27.144910+0000","last_undegraded":"2023-06-10T18:56:27.144910+0000","last_fullsized":"2023-06-10T18:56:27.144910+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:26:45.209485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.880674+0000","last_change":"2023-06-10T18:56:18.724544+0000","last_active":"2023-06-10T18:56:26.880674+0000","last_peered":"2023-06-10T18:56:26.880674+0000","last_clean":"2023-06-10T18:56:26.880674+0000","last_became_active":"2023-06-10T18:56:18.724244+0000","last_became_peered":"2023-06-10T18:56:18.724244+0000","last_unstale":"2023-06-10T18:56:26.880674+0000","last_undegraded":"2023-06-10T18:56:26.880674+0000","last_fullsized":"2023-06-10T18:56:26.880674+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:17:50.531074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.195134+0000","last_change":"2023-06-10T18:56:18.332507+0000","last_active":"2023-06-10T18:56:27.195134+0000","last_peered":"2023-06-10T18:56:27.195134+0000","last_clean":"2023-06-10T18:56:27.195134+0000","last_became_active":"2023-06-10T18:56:18.331887+0000","last_became_peered":"2023-06-10T18:56:18.331887+0000","last_unstale":"2023-06-10T18:56:27.195134+0000","last_undegraded":"2023-06-10T18:56:27.195134+0000","last_fullsized":"2023-06-10T18:56:27.195134+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:13:38.791330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":66,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.887650+0000","last_change":"2023-06-10T18:52:40.514114+0000","last_active":"2023-06-10T18:56:26.887650+0000","last_peered":"2023-06-10T18:56:26.887650+0000","last_clean":"2023-06-10T18:56:26.887650+0000","last_became_active":"2023-06-10T18:52:40.513638+0000","last_became_peered":"2023-06-10T18:52:40.513638+0000","last_unstale":"2023-06-10T18:56:26.887650+0000","last_undegraded":"2023-06-10T18:56:26.887650+0000","last_fullsized":"2023-06-10T18:56:26.887650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:41:17.572105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.871355+0000","last_change":"2023-06-10T18:56:18.733094+0000","last_active":"2023-06-10T18:56:26.871355+0000","last_peered":"2023-06-10T18:56:26.871355+0000","last_clean":"2023-06-10T18:56:26.871355+0000","last_became_active":"2023-06-10T18:56:18.732442+0000","last_became_peered":"2023-06-10T18:56:18.732442+0000","last_unstale":"2023-06-10T18:56:26.871355+0000","last_undegraded":"2023-06-10T18:56:26.871355+0000","last_fullsized":"2023-06-10T18:56:26.871355+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T18:57:31.579489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.195498+0000","last_change":"2023-06-10T18:56:18.337697+0000","last_active":"2023-06-10T18:56:27.195498+0000","last_peered":"2023-06-10T18:56:27.195498+0000","last_clean":"2023-06-10T18:56:27.195498+0000","last_became_active":"2023-06-10T18:56:18.337174+0000","last_became_peered":"2023-06-10T18:56:18.337174+0000","last_unstale":"2023-06-10T18:56:27.195498+0000","last_undegraded":"2023-06-10T18:56:27.195498+0000","last_fullsized":"2023-06-10T18:56:27.195498+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:57:03.240260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":70,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-06-10T18:56:26.876863+0000","last_change":"2023-06-10T18:52:40.515396+0000","last_active":"2023-06-10T18:56:26.876863+0000","last_peered":"2023-06-10T18:56:26.876863+0000","last_clean":"2023-06-10T18:56:26.876863+0000","last_became_active":"2023-06-10T18:52:40.514663+0000","last_became_peered":"2023-06-10T18:52:40.514663+0000","last_unstale":"2023-06-10T18:56:26.876863+0000","last_undegraded":"2023-06-10T18:56:26.876863+0000","last_fullsized":"2023-06-10T18:56:26.876863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:57:38.444899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574898,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28128,"kb_used_data":1176,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343712,"statfs":{"total":96636764160,"available":96607961088,"internally_reserved":0,"allocated":1204224,"data_stored":851412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":0.90400000000000003,"15min":0.88200000000000001},"min":{"1min":0.73599999999999999,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.3759999999999999,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.97999999999999998},{"interface":"front","average":{"1min":1.006,"5min":0.94299999999999995,"15min":0.93000000000000005},"min":{"1min":0.81899999999999995,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.234,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":1.0349999999999999}]},{"osd":1,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92400000000000004,"15min":0.91500000000000004},"min":{"1min":0.58599999999999997,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.3089999999999999,"5min":1.377,"15min":1.377},"last":1.1419999999999999},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.92500000000000004,"15min":0.91100000000000003},"min":{"1min":0.78400000000000003,"5min":0.504,"15min":0.504},"max":{"1min":1.111,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.1080000000000001}]},{"osd":2,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.83999999999999997,"15min":0.82799999999999996},"min":{"1min":0.64100000000000001,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.214,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.89900000000000002,"15min":0.90700000000000003},"min":{"1min":0.67500000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.325,"5min":1.367,"15min":1.367},"last":1.069}]},{"osd":3,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.92100000000000004,"15min":0.89900000000000002},"min":{"1min":0.68100000000000005,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1499999999999999,"5min":1.502,"15min":1.502},"last":1.167},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.93799999999999994,"15min":0.92800000000000005},"min":{"1min":0.70399999999999996,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.2130000000000001,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.77200000000000002}]},{"osd":4,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.876,"15min":0.872},"min":{"1min":0.60199999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.141,"5min":1.639,"15min":1.639},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.96899999999999997,"15min":0.98099999999999998},"min":{"1min":0.748,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.238,"5min":1.411,"15min":1.411},"last":0.65200000000000002}]},{"osd":5,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.042,"15min":1.038},"min":{"1min":0.79800000000000004,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.2669999999999999,"5min":1.806,"15min":1.806},"last":0.93200000000000005},{"interface":"front","average":{"1min":1.081,"5min":1.05,"15min":1.052},"min":{"1min":0.93200000000000005,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.256,"5min":1.522,"15min":1.522},"last":1.0009999999999999}]},{"osd":6,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.0129999999999999,"15min":1.008},"min":{"1min":0.78500000000000003,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.3,"5min":1.718,"15min":1.718},"last":0.95599999999999996},{"interface":"front","average":{"1min":1.147,"5min":1.095,"15min":1.0900000000000001},"min":{"1min":0.96599999999999997,"5min":0.441,"15min":0.441},"max":{"1min":1.409,"5min":1.464,"15min":1.464},"last":1.224}]}]},{"osd":6,"up_from":13,"seq":55834574899,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27548,"kb_used_data":596,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344292,"statfs":{"total":96636764160,"available":96608555008,"internally_reserved":0,"allocated":610304,"data_stored":261572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.81999999999999995,"15min":0.80100000000000005},"min":{"1min":0.65800000000000003,"5min":0.502,"15min":0.502},"max":{"1min":1.0589999999999999,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.85199999999999998,"15min":0.83999999999999997},"min":{"1min":0.71799999999999997,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.0680000000000001,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":1.0920000000000001}]},{"osd":1,"last update":"Sat Jun 10 18:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.873,"15min":0.85199999999999998},"min":{"1min":0.68999999999999995,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.0549999999999999},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.879,"15min":0.85899999999999999},"min":{"1min":0.68999999999999995,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":0.90000000000000002}]},{"osd":2,"last update":"Sat Jun 10 18:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.871,"15min":0.85899999999999999},"min":{"1min":0.66000000000000003,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.1950000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.88500000000000001,"15min":0.88900000000000001},"min":{"1min":0.68000000000000005,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.109,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":1.177}]},{"osd":3,"last update":"Sat Jun 10 18:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.874,"15min":0.84799999999999998},"min":{"1min":0.64900000000000002,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.169,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.95999999999999996},{"interface":"front","average":{"1min":1.0209999999999999,"5min":0.997,"15min":0.995},"min":{"1min":0.72799999999999998,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":1.2889999999999999}]},{"osd":4,"last update":"Sat Jun 10 18:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.93799999999999994,"15min":0.95399999999999996},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.1259999999999999,"5min":1.198,"15min":1.198},"last":1.002},{"interface":"front","average":{"1min":0.95699999999999996,"5min":1.0049999999999999,"15min":1.0189999999999999},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.1879999999999999,"5min":1.222,"15min":1.222},"last":1.212}]},{"osd":5,"last update":"Sat Jun 10 18:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.94999999999999996,"15min":0.96199999999999997},"min":{"1min":0.68700000000000006,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.0720000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.86099999999999999},{"interface":"front","average":{"1min":1.02,"5min":1.0249999999999999,"15min":1.026},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":1.1399999999999999}]},{"osd":7,"last update":"Sat Jun 10 18:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":1.0389999999999999,"15min":1.0489999999999999},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.1739999999999999,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.022,"5min":1.0569999999999999,"15min":1.0649999999999999},"min":{"1min":0.82199999999999995,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.2010000000000001,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":1.2569999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574899,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27552,"kb_used_data":600,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":614400,"data_stored":267298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.84199999999999997,"15min":0.82999999999999996},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.139,"5min":1.175,"15min":1.175},"last":1.083},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.91800000000000004,"15min":0.94199999999999995},"min":{"1min":0.63800000000000001,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.246,"5min":1.637,"15min":1.637},"last":0.67700000000000005}]},{"osd":1,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.91000000000000003,"15min":0.91800000000000004},"min":{"1min":0.67800000000000005,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.1559999999999999,"5min":1.335,"15min":1.335},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.91700000000000004,"15min":0.92100000000000004},"min":{"1min":0.72699999999999998,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.208,"5min":1.78,"15min":1.78},"last":0.80700000000000005}]},{"osd":2,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.65000000000000002,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.1000000000000001,"5min":1.446,"15min":1.446},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.91600000000000004,"15min":0.91200000000000003},"min":{"1min":0.71399999999999997,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.1379999999999999,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.92300000000000004}]},{"osd":3,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93899999999999995,"15min":0.94499999999999995},"min":{"1min":0.68600000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.206,"5min":1.484,"15min":1.484},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.97199999999999998,"5min":1.0249999999999999,"15min":1.0429999999999999},"min":{"1min":0.77100000000000002,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.2969999999999999,"5min":1.337,"15min":1.337},"last":0.84599999999999997}]},{"osd":4,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.96999999999999997,"15min":0.98899999999999999},"min":{"1min":0.70299999999999996,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.2669999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.94599999999999995,"5min":1.034,"15min":1.0640000000000001},"min":{"1min":0.66500000000000004,"5min":0.629,"15min":0.629},"max":{"1min":1.26,"5min":1.575,"15min":1.575},"last":1.2010000000000001}]},{"osd":6,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":1.038,"15min":1.0780000000000001},"min":{"1min":0.66000000000000003,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.2010000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.0609999999999999,"15min":1.079},"min":{"1min":0.69799999999999995,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.2270000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.73699999999999999}]},{"osd":7,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.139,"15min":1.1739999999999999},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.226,"5min":1.873,"15min":1.873},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.155,"15min":1.181},"min":{"1min":0.80000000000000004,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.3680000000000001,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.121}]}]},{"osd":4,"up_from":13,"seq":55834574898,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27556,"kb_used_data":604,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344284,"statfs":{"total":96636764160,"available":96608546816,"internally_reserved":0,"allocated":618496,"data_stored":267880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.76700000000000002,"15min":0.745},"min":{"1min":0.53400000000000003,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.1599999999999999,"5min":1.2,"15min":1.2},"last":0.629},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.88200000000000001,"15min":0.88},"min":{"1min":0.63800000000000001,"5min":0.504,"15min":0.504},"max":{"1min":1.4970000000000001,"5min":1.73,"15min":1.73},"last":1.034}]},{"osd":1,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.95199999999999996,"15min":0.95499999999999996},"min":{"1min":0.68200000000000005,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.84599999999999997,"15min":0.83699999999999997},"min":{"1min":0.66600000000000004,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.024,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.097}]},{"osd":2,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.879,"15min":0.875},"min":{"1min":0.70799999999999996,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":0.85499999999999998},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1,"15min":1.004},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":1.121}]},{"osd":3,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.89900000000000002,"15min":0.88},"min":{"1min":0.80900000000000005,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.1679999999999999,"5min":1.22,"15min":1.22},"last":0.73999999999999999},{"interface":"front","average":{"1min":1.006,"5min":0.95799999999999996,"15min":0.95099999999999996},"min":{"1min":0.80100000000000005,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.4490000000000001,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.069}]},{"osd":5,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.96799999999999997,"15min":0.99399999999999999},"min":{"1min":0.67800000000000005,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.069,"5min":1.663,"15min":1.663},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.95399999999999996,"15min":0.98199999999999998},"min":{"1min":0.58099999999999996,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.111,"5min":1.353,"15min":1.353},"last":1.179}]},{"osd":6,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":1.002,"15min":1.028},"min":{"1min":0.63100000000000001,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.5720000000000001,"5min":2.2639999999999998,"15min":2.2639999999999998},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0720000000000001,"15min":1.0760000000000001},"min":{"1min":0.81200000000000006,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":1.1970000000000001}]},{"osd":7,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.98399999999999999,"15min":0.99399999999999999},"min":{"1min":0.68899999999999995,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.1950000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.012,"5min":1.0529999999999999,"15min":1.071},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.2390000000000001,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":1.1539999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574897,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31660,"kb_used_data":612,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340180,"statfs":{"total":96636764160,"available":96604344320,"internally_reserved":0,"allocated":626688,"data_stored":267865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.57799999999999996,"15min":0.57199999999999995},"min":{"1min":0.51400000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.63500000000000001,"15min":0.63100000000000001},"min":{"1min":0.56000000000000005,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.57599999999999996}]},{"osd":1,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.64400000000000002,"15min":0.622},"min":{"1min":0.51000000000000001,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":1.0860000000000001},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.72099999999999997,"15min":0.71599999999999997},"min":{"1min":0.56100000000000005,"5min":0.318,"15min":0.318},"max":{"1min":0.98899999999999999,"5min":1.411,"15min":1.411},"last":1.0409999999999999}]},{"osd":2,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.76100000000000001,"15min":0.75},"min":{"1min":0.63500000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.167,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":1.3759999999999999},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.75900000000000001,"15min":0.74199999999999999},"min":{"1min":0.65200000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.1970000000000001,"5min":1.264,"15min":1.264},"last":0.624}]},{"osd":4,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96099999999999997,"15min":0.96899999999999997},"min":{"1min":0.79800000000000004,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.3089999999999999,"5min":1.488,"15min":1.488},"last":1.3360000000000001},{"interface":"front","average":{"1min":1.052,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.82099999999999995,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.345,"5min":1.458,"15min":1.458},"last":0.93100000000000005}]},{"osd":5,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.0369999999999999,"15min":1.0589999999999999},"min":{"1min":0.80400000000000005,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.268,"5min":2.024,"15min":2.024},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.101,"5min":1.026,"15min":1.014},"min":{"1min":0.83899999999999997,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.29,"5min":1.724,"15min":1.724},"last":1.2170000000000001}]},{"osd":6,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.0489999999999999,"15min":1.0469999999999999},"min":{"1min":0.92400000000000004,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.3300000000000001,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.071,"5min":1.0589999999999999,"15min":1.0720000000000001},"min":{"1min":0.90700000000000003,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.302,"5min":1.78,"15min":1.78},"last":1.1399999999999999}]},{"osd":7,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.101,"15min":1.1279999999999999},"min":{"1min":0.82799999999999996,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.3959999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.212,"5min":1.089,"15min":1.0740000000000001},"min":{"1min":1.0049999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.468,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":1.5429999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574898,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31660,"kb_used_data":612,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340180,"statfs":{"total":96636764160,"available":96604344320,"internally_reserved":0,"allocated":626688,"data_stored":268862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.60099999999999998,"15min":0.58799999999999997},"min":{"1min":0.498,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.97799999999999998,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.50800000000000001,"5min":0.378,"15min":0.378},"max":{"1min":1.024,"5min":1.224,"15min":1.224},"last":0.68600000000000005}]},{"osd":1,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.65000000000000002,"15min":0.64600000000000002},"min":{"1min":0.53400000000000003,"5min":0.307,"15min":0.307},"max":{"1min":0.89500000000000002,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.72299999999999998,"15min":0.68999999999999995},"min":{"1min":0.64700000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.89100000000000001}]},{"osd":3,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.73599999999999999,"15min":0.70599999999999996},"min":{"1min":0.64900000000000002,"5min":0.377,"15min":0.377},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.749,"15min":0.746},"min":{"1min":0.64700000000000002,"5min":0.252,"15min":0.252},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.86199999999999999}]},{"osd":4,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.91900000000000004,"15min":0.91500000000000004},"min":{"1min":0.81000000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.097,"5min":1.0349999999999999,"15min":1.038},"min":{"1min":0.88600000000000001,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.476,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":1.0129999999999999}]},{"osd":5,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.016,"15min":1.016},"min":{"1min":0.82699999999999996,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.379,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":1.2330000000000001},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.002,"15min":0.97799999999999998},"min":{"1min":0.77100000000000002,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.377,"5min":1.667,"15min":1.667},"last":0.78200000000000003}]},{"osd":6,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.0429999999999999,"15min":1.0229999999999999},"min":{"1min":0.84299999999999997,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.3049999999999999,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.92900000000000005},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.034,"15min":1.032},"min":{"1min":0.89400000000000002,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.4299999999999999,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":1.1120000000000001}]},{"osd":7,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.099,"15min":1.099},"min":{"1min":0.82399999999999995,"5min":0.62,"15min":0.62},"max":{"1min":1.4339999999999999,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.153,"5min":1.0980000000000001,"15min":1.0760000000000001},"min":{"1min":0.95499999999999996,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.4239999999999999,"5min":1.752,"15min":1.752},"last":0.98899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574900,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31640,"kb_used_data":592,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340200,"statfs":{"total":96636764160,"available":96604364800,"internally_reserved":0,"allocated":606208,"data_stored":260061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.67100000000000004,"15min":0.66100000000000003},"min":{"1min":0.47999999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.71999999999999997,"15min":0.68600000000000005},"min":{"1min":0.63400000000000001,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.0369999999999999,"5min":1.694,"15min":1.694},"last":0.56799999999999995}]},{"osd":2,"last update":"Sat Jun 10 18:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.64400000000000002,"15min":0.623},"min":{"1min":0.53500000000000003,"5min":0.249,"15min":0.249},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.877,"5min":0.70199999999999996,"15min":0.65800000000000003},"min":{"1min":0.65600000000000003,"5min":0.315,"15min":0.315},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":0.65500000000000003}]},{"osd":3,"last update":"Sat Jun 10 18:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.77800000000000002,"15min":0.745},"min":{"1min":0.65900000000000003,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.76100000000000001,"15min":0.749},"min":{"1min":0.58499999999999996,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.1100000000000001,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":0.622}]},{"osd":4,"last update":"Sat Jun 10 18:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.87,"15min":0.83599999999999997},"min":{"1min":0.73399999999999999,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":1.087,"5min":1.1160000000000001,"15min":1.079},"min":{"1min":0.78500000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.5449999999999999,"5min":5.8209999999999997,"15min":5.8209999999999997},"last":0.91000000000000003}]},{"osd":5,"last update":"Sat Jun 10 18:55:44 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.032,"15min":1.028},"min":{"1min":0.75800000000000001,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.4550000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":0.879},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0129999999999999,"15min":0.97099999999999997},"min":{"1min":0.754,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.3819999999999999,"5min":3.089,"15min":3.089},"last":0.72299999999999998}]},{"osd":6,"last update":"Sat Jun 10 18:55:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.105,"15min":1.0309999999999999},"min":{"1min":0.75900000000000001,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.5249999999999999,"5min":7.2599999999999998,"15min":7.2599999999999998},"last":0.77500000000000002},{"interface":"front","average":{"1min":1.081,"5min":1.107,"15min":1.0309999999999999},"min":{"1min":0.80800000000000005,"5min":0.622,"15min":0.622},"max":{"1min":1.591,"5min":9.0069999999999997,"15min":9.0069999999999997},"last":0.85899999999999999}]},{"osd":7,"last update":"Sat Jun 10 18:55:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.0980000000000001,"15min":1.083},"min":{"1min":0.89300000000000002,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.6879999999999999,"5min":2.105,"15min":2.105},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.085,"15min":1.0669999999999999},"min":{"1min":0.90200000000000002,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.573,"5min":2.2570000000000001,"15min":2.2570000000000001},"last":0.73999999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574899,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32232,"kb_used_data":1184,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339608,"statfs":{"total":96636764160,"available":96603758592,"internally_reserved":0,"allocated":1212416,"data_stored":856703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.61299999999999999,"15min":0.59899999999999998},"min":{"1min":0.51000000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.77200000000000002,"15min":0.746},"min":{"1min":0.70899999999999996,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.0469999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.83899999999999997}]},{"osd":2,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.71099999999999997,"15min":0.69799999999999995},"min":{"1min":0.51900000000000002,"5min":0.313,"15min":0.313},"max":{"1min":1.0269999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.64600000000000002,"15min":0.63},"min":{"1min":0.55700000000000005,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.96799999999999997,"5min":1.371,"15min":1.371},"last":0.622}]},{"osd":3,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.68200000000000005,"15min":0.67000000000000004},"min":{"1min":0.55800000000000005,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.1930000000000001,"5min":1.226,"15min":1.226},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.82899999999999996,"15min":0.81000000000000005},"min":{"1min":0.65800000000000003,"5min":0.375,"15min":0.375},"max":{"1min":1.262,"5min":1.829,"15min":1.829},"last":0.76200000000000001}]},{"osd":4,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.90000000000000002,"15min":0.88900000000000001},"min":{"1min":0.75600000000000001,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.1579999999999999,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.0369999999999999,"15min":1.034},"min":{"1min":0.86099999999999999,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.228,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":0.97199999999999998}]},{"osd":5,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.96099999999999997,"15min":0.95799999999999996},"min":{"1min":0.67300000000000004,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.351,"5min":1.694,"15min":1.694},"last":1.1399999999999999},{"interface":"front","average":{"1min":0.99099999999999999,"5min":1,"15min":0.998},"min":{"1min":0.72999999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.1870000000000001,"5min":1.75,"15min":1.75},"last":1.2789999999999999}]},{"osd":6,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.0700000000000001,"15min":1.056},"min":{"1min":0.93899999999999995,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.331,"5min":2.04,"15min":2.04},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.0409999999999999,"5min":0.996,"15min":0.997},"min":{"1min":0.76100000000000001,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.444,"5min":1.883,"15min":1.883},"last":1.3280000000000001}]},{"osd":7,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.0369999999999999,"15min":1.0329999999999999},"min":{"1min":0.77200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.397,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.077,"5min":1.056,"15min":1.05},"min":{"1min":0.93200000000000005,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.298,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.2170000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-10T18:56:36.271 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-10T18:56:36.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.399+0000 7f9e89ad1640 1 Processor -- start 2023-06-10T18:56:36.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.403+0000 7f9e89ad1640 1 -- start start 2023-06-10T18:56:36.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.403+0000 7f9e89ad1640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9e8415c810 0x7f9e840cd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:36.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.403+0000 7f9e89ad1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e840cbfc0 0x7f9e840c8d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:36.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.403+0000 7f9e89ad1640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e840c9270 con 0x7f9e8415ba70 2023-06-10T18:56:36.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.403+0000 7f9e89ad1640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e840cc6c0 con 0x7f9e8415c810 2023-06-10T18:56:36.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.403+0000 7f9e89ad1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e840cc9a0 con 0x7f9e840cbfc0 2023-06-10T18:56:36.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.403+0000 7f9e83fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e840cbfc0 0x7f9e840c8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:36.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.403+0000 7f9e82ffd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9e8415c810 0x7f9e840cd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:36.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.403+0000 7f9e82ffd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9e8415c810 0x7f9e840cd760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.53:59760/0 (socket says 172.21.15.53:59760) 2023-06-10T18:56:36.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.403+0000 7f9e83fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e840cbfc0 0x7f9e840c8d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.53:50178/0 (socket says 172.21.15.53:50178) 2023-06-10T18:56:36.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.403+0000 7f9e82ffd640 1 -- 172.21.15.53:0/2367668476 learned_addr learned my addr 172.21.15.53:0/2367668476 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:36.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.403+0000 7f9e837fe640 1 --1- 172.21.15.53:0/2367668476 >> v1:172.21.15.117:6789/0 conn(0x7f9e8415ba70 0x7f9e8415c100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.53:39178/0 (socket says 172.21.15.53:39178) 2023-06-10T18:56:36.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.403+0000 7f9e82ffd640 1 -- 172.21.15.53:0/2367668476 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e840cbfc0 msgr2=0x7f9e840c8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:36.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.403+0000 7f9e82ffd640 1 --2- 172.21.15.53:0/2367668476 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e840cbfc0 0x7f9e840c8d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:36.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.403+0000 7f9e82ffd640 1 -- 172.21.15.53:0/2367668476 >> v1:172.21.15.117:6789/0 conn(0x7f9e8415ba70 legacy=0x7f9e8415c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:36.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.403+0000 7f9e82ffd640 1 -- 172.21.15.53:0/2367668476 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e840ccc80 con 0x7f9e8415c810 2023-06-10T18:56:36.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.407+0000 7f9e82ffd640 1 --2- 172.21.15.53:0/2367668476 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e8415c810 0x7f9e840cd760 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9e78009870 tx=0x7f9e7801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=889fd98bca899c82 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:36.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.407+0000 7f9e827fc640 1 -- 172.21.15.53:0/2367668476 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e780ab680 con 0x7f9e8415c810 2023-06-10T18:56:36.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.407+0000 7f9e827fc640 1 -- 172.21.15.53:0/2367668476 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e780ab7e0 con 0x7f9e8415c810 2023-06-10T18:56:36.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.407+0000 7f9e827fc640 1 -- 172.21.15.53:0/2367668476 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e780abb70 con 0x7f9e8415c810 2023-06-10T18:56:36.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.407+0000 7f9e89ad1640 1 -- 172.21.15.53:0/2367668476 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e8415c810 msgr2=0x7f9e840cd760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:36.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.407+0000 7f9e89ad1640 1 --2- 172.21.15.53:0/2367668476 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e8415c810 0x7f9e840cd760 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9e78009870 tx=0x7f9e7801c480 comp rx=0 tx=0).stop 2023-06-10T18:56:36.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.407+0000 7f9e89ad1640 1 -- 172.21.15.53:0/2367668476 shutdown_connections 2023-06-10T18:56:36.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.407+0000 7f9e89ad1640 1 --2- 172.21.15.53:0/2367668476 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e840cbfc0 0x7f9e840c8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:36.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.407+0000 7f9e89ad1640 1 --2- 172.21.15.53:0/2367668476 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e8415c810 0x7f9e840cd760 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:36.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.407+0000 7f9e89ad1640 1 -- 172.21.15.53:0/2367668476 >> 172.21.15.53:0/2367668476 conn(0x7f9e8406a0d0 msgr2=0x7f9e840ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:36.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.407+0000 7f9e89ad1640 1 -- 172.21.15.53:0/2367668476 shutdown_connections 2023-06-10T18:56:36.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.407+0000 7f9e89ad1640 1 -- 172.21.15.53:0/2367668476 wait complete. 2023-06-10T18:56:36.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.407+0000 7f9e89ad1640 1 Processor -- start 2023-06-10T18:56:36.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.407+0000 7f9e89ad1640 1 -- start start 2023-06-10T18:56:36.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.407+0000 7f9e89ad1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e840cbfc0 0x7f9e84153060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:36.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.407+0000 7f9e89ad1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e8415ba70 0x7f9e840b30c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:36.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.407+0000 7f9e89ad1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9e8415c810 0x7f9e840c3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:36.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.407+0000 7f9e89ad1640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e84153640 con 0x7f9e8415c810 2023-06-10T18:56:36.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.407+0000 7f9e89ad1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e84153920 con 0x7f9e8415ba70 2023-06-10T18:56:36.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.407+0000 7f9e89ad1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e84153c00 con 0x7f9e840cbfc0 2023-06-10T18:56:36.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.407+0000 7f9e83fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9e8415c810 0x7f9e840c3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:36.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.407+0000 7f9e83fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9e8415c810 0x7f9e840c3a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53126/0 (socket says 172.21.15.53:53126) 2023-06-10T18:56:36.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.407+0000 7f9e83fff640 1 -- 172.21.15.53:0/2320417911 learned_addr learned my addr 172.21.15.53:0/2320417911 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:36.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.407+0000 7f9e82ffd640 1 --2- 172.21.15.53:0/2320417911 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e8415ba70 0x7f9e840b30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:36.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.407+0000 7f9e837fe640 1 --2- 172.21.15.53:0/2320417911 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e840cbfc0 0x7f9e84153060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:36.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.407+0000 7f9e83fff640 1 -- 172.21.15.53:0/2320417911 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e840cbfc0 msgr2=0x7f9e84153060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:36.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.407+0000 7f9e83fff640 1 --2- 172.21.15.53:0/2320417911 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e840cbfc0 0x7f9e84153060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:36.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.407+0000 7f9e83fff640 1 -- 172.21.15.53:0/2320417911 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e8415ba70 msgr2=0x7f9e840b30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:36.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.407+0000 7f9e83fff640 1 --2- 172.21.15.53:0/2320417911 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e8415ba70 0x7f9e840b30c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:36.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.407+0000 7f9e83fff640 1 -- 172.21.15.53:0/2320417911 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e780094d0 con 0x7f9e8415c810 2023-06-10T18:56:36.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.407+0000 7f9e837fe640 1 --2- 172.21.15.53:0/2320417911 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e840cbfc0 0x7f9e84153060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:56:36.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.411+0000 7f9e83fff640 1 --2- 172.21.15.53:0/2320417911 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9e8415c810 0x7f9e840c3a40 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c00efc0 tx=0x7f9e7c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:36.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.411+0000 7f9e6bfff640 1 -- 172.21.15.53:0/2320417911 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e7c014480 con 0x7f9e8415c810 2023-06-10T18:56:36.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.411+0000 7f9e6bfff640 1 -- 172.21.15.53:0/2320417911 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e7c00f040 con 0x7f9e8415c810 2023-06-10T18:56:36.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.411+0000 7f9e89ad1640 1 -- 172.21.15.53:0/2320417911 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e84153ee0 con 0x7f9e8415c810 2023-06-10T18:56:36.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.411+0000 7f9e6bfff640 1 -- 172.21.15.53:0/2320417911 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e7c014820 con 0x7f9e8415c810 2023-06-10T18:56:36.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.411+0000 7f9e89ad1640 1 -- 172.21.15.53:0/2320417911 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e840b3600 con 0x7f9e8415c810 2023-06-10T18:56:36.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.411+0000 7f9e89ad1640 1 -- 172.21.15.53:0/2320417911 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e840ca040 con 0x7f9e8415c810 2023-06-10T18:56:36.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.411+0000 7f9e6bfff640 1 -- 172.21.15.53:0/2320417911 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9e7c014980 con 0x7f9e8415c810 2023-06-10T18:56:36.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.411+0000 7f9e6bfff640 1 --2- 172.21.15.53:0/2320417911 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9e70066280 0x7f9e70068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:36.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.411+0000 7f9e6bfff640 1 -- 172.21.15.53:0/2320417911 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f9e7c084920 con 0x7f9e8415c810 2023-06-10T18:56:36.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.411+0000 7f9e837fe640 1 --2- 172.21.15.53:0/2320417911 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9e70066280 0x7f9e70068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:36.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.411+0000 7f9e837fe640 1 --2- 172.21.15.53:0/2320417911 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9e70066280 0x7f9e70068730 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f9e74000f70 tx=0x7f9e74009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:36.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.415+0000 7f9e6bfff640 1 -- 172.21.15.53:0/2320417911 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9e7c051d60 con 0x7f9e8415c810 2023-06-10T18:56:36.460 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-10T18:56:36.463 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-10T18:56:36.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.567+0000 7f9e89ad1640 1 -- 172.21.15.53:0/2320417911 --> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9e84153a90 con 0x7f9e70066280 2023-06-10T18:56:36.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.579+0000 7f9e6bfff640 1 -- 172.21.15.53:0/2320417911 <== mgr.4105 v2:172.21.15.117:6832/3061986771 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+309044 (secure 0 0 0) 0x7f9e84153a90 con 0x7f9e70066280 2023-06-10T18:56:36.587 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:56:36.589 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-06-10T18:56:36.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.583+0000 7f9e89ad1640 1 -- 172.21.15.53:0/2320417911 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9e70066280 msgr2=0x7f9e70068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:36.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.583+0000 7f9e89ad1640 1 --2- 172.21.15.53:0/2320417911 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9e70066280 0x7f9e70068730 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f9e74000f70 tx=0x7f9e74009040 comp rx=0 tx=0).stop 2023-06-10T18:56:36.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.583+0000 7f9e89ad1640 1 -- 172.21.15.53:0/2320417911 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9e8415c810 msgr2=0x7f9e840c3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:36.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.583+0000 7f9e89ad1640 1 --2- 172.21.15.53:0/2320417911 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9e8415c810 0x7f9e840c3a40 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c00efc0 tx=0x7f9e7c00c490 comp rx=0 tx=0).stop 2023-06-10T18:56:36.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.583+0000 7f9e89ad1640 1 -- 172.21.15.53:0/2320417911 shutdown_connections 2023-06-10T18:56:36.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.583+0000 7f9e89ad1640 1 --2- 172.21.15.53:0/2320417911 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9e70066280 0x7f9e70068730 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:36.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.583+0000 7f9e89ad1640 1 --2- 172.21.15.53:0/2320417911 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9e8415c810 0x7f9e840c3a40 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:36.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.583+0000 7f9e89ad1640 1 --2- 172.21.15.53:0/2320417911 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e8415ba70 0x7f9e840b30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:36.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.583+0000 7f9e89ad1640 1 --2- 172.21.15.53:0/2320417911 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9e840cbfc0 0x7f9e84153060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:36.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.583+0000 7f9e89ad1640 1 -- 172.21.15.53:0/2320417911 >> 172.21.15.53:0/2320417911 conn(0x7f9e8406a0d0 msgr2=0x7f9e84150c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:36.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.583+0000 7f9e89ad1640 1 -- 172.21.15.53:0/2320417911 shutdown_connections 2023-06-10T18:56:36.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.583+0000 7f9e89ad1640 1 -- 172.21.15.53:0/2320417911 wait complete. 2023-06-10T18:56:36.606 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":168,"stamp":"2023-06-10T18:56:35.644063+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238108,"kb_used_data":6108,"kb_used_omap":0,"kb_used_meta":231936,"kb_avail":754736612,"statfs":{"total":773094113280,"available":772850290688,"internally_reserved":0,"allocated":6254592,"data_stored":3371875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":237502464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.776955"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.911248+0000","last_change":"2023-06-10T18:56:18.723557+0000","last_active":"2023-06-10T18:56:27.911248+0000","last_peered":"2023-06-10T18:56:27.911248+0000","last_clean":"2023-06-10T18:56:27.911248+0000","last_became_active":"2023-06-10T18:56:18.723169+0000","last_became_peered":"2023-06-10T18:56:18.723169+0000","last_unstale":"2023-06-10T18:56:27.911248+0000","last_undegraded":"2023-06-10T18:56:27.911248+0000","last_fullsized":"2023-06-10T18:56:27.911248+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:55:10.132650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:28.216271+0000","last_change":"2023-06-10T18:56:18.739659+0000","last_active":"2023-06-10T18:56:28.216271+0000","last_peered":"2023-06-10T18:56:28.216271+0000","last_clean":"2023-06-10T18:56:28.216271+0000","last_became_active":"2023-06-10T18:56:18.738930+0000","last_became_peered":"2023-06-10T18:56:18.738930+0000","last_unstale":"2023-06-10T18:56:28.216271+0000","last_undegraded":"2023-06-10T18:56:28.216271+0000","last_fullsized":"2023-06-10T18:56:28.216271+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:34:30.402788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.928567+0000","last_change":"2023-06-10T18:56:18.715713+0000","last_active":"2023-06-10T18:56:27.928567+0000","last_peered":"2023-06-10T18:56:27.928567+0000","last_clean":"2023-06-10T18:56:27.928567+0000","last_became_active":"2023-06-10T18:56:18.715403+0000","last_became_peered":"2023-06-10T18:56:18.715403+0000","last_unstale":"2023-06-10T18:56:27.928567+0000","last_undegraded":"2023-06-10T18:56:27.928567+0000","last_fullsized":"2023-06-10T18:56:27.928567+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:03:07.190449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:28.216135+0000","last_change":"2023-06-10T18:56:18.742396+0000","last_active":"2023-06-10T18:56:28.216135+0000","last_peered":"2023-06-10T18:56:28.216135+0000","last_clean":"2023-06-10T18:56:28.216135+0000","last_became_active":"2023-06-10T18:56:18.741689+0000","last_became_peered":"2023-06-10T18:56:18.741689+0000","last_unstale":"2023-06-10T18:56:28.216135+0000","last_undegraded":"2023-06-10T18:56:28.216135+0000","last_fullsized":"2023-06-10T18:56:28.216135+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:00:39.211097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.893736+0000","last_change":"2023-06-10T18:56:18.733830+0000","last_active":"2023-06-10T18:56:27.893736+0000","last_peered":"2023-06-10T18:56:27.893736+0000","last_clean":"2023-06-10T18:56:27.893736+0000","last_became_active":"2023-06-10T18:56:18.732968+0000","last_became_peered":"2023-06-10T18:56:18.732968+0000","last_unstale":"2023-06-10T18:56:27.893736+0000","last_undegraded":"2023-06-10T18:56:27.893736+0000","last_fullsized":"2023-06-10T18:56:27.893736+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:44:56.381072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.910730+0000","last_change":"2023-06-10T18:56:18.733304+0000","last_active":"2023-06-10T18:56:27.910730+0000","last_peered":"2023-06-10T18:56:27.910730+0000","last_clean":"2023-06-10T18:56:27.910730+0000","last_became_active":"2023-06-10T18:56:18.733010+0000","last_became_peered":"2023-06-10T18:56:18.733010+0000","last_unstale":"2023-06-10T18:56:27.910730+0000","last_undegraded":"2023-06-10T18:56:27.910730+0000","last_fullsized":"2023-06-10T18:56:27.910730+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:03:35.723274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.927789+0000","last_change":"2023-06-10T18:56:18.715925+0000","last_active":"2023-06-10T18:56:27.927789+0000","last_peered":"2023-06-10T18:56:27.927789+0000","last_clean":"2023-06-10T18:56:27.927789+0000","last_became_active":"2023-06-10T18:56:18.715163+0000","last_became_peered":"2023-06-10T18:56:18.715163+0000","last_unstale":"2023-06-10T18:56:27.927789+0000","last_undegraded":"2023-06-10T18:56:27.927789+0000","last_fullsized":"2023-06-10T18:56:27.927789+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:57:04.253762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:28.215258+0000","last_change":"2023-06-10T18:56:18.710693+0000","last_active":"2023-06-10T18:56:28.215258+0000","last_peered":"2023-06-10T18:56:28.215258+0000","last_clean":"2023-06-10T18:56:28.215258+0000","last_became_active":"2023-06-10T18:56:18.710420+0000","last_became_peered":"2023-06-10T18:56:18.710420+0000","last_unstale":"2023-06-10T18:56:28.215258+0000","last_undegraded":"2023-06-10T18:56:28.215258+0000","last_fullsized":"2023-06-10T18:56:28.215258+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:03:35.723274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:28.216407+0000","last_change":"2023-06-10T18:56:18.711205+0000","last_active":"2023-06-10T18:56:28.216407+0000","last_peered":"2023-06-10T18:56:28.216407+0000","last_clean":"2023-06-10T18:56:28.216407+0000","last_became_active":"2023-06-10T18:56:18.711011+0000","last_became_peered":"2023-06-10T18:56:18.711011+0000","last_unstale":"2023-06-10T18:56:28.216407+0000","last_undegraded":"2023-06-10T18:56:28.216407+0000","last_fullsized":"2023-06-10T18:56:28.216407+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:51:39.311190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.911263+0000","last_change":"2023-06-10T18:56:18.731703+0000","last_active":"2023-06-10T18:56:27.911263+0000","last_peered":"2023-06-10T18:56:27.911263+0000","last_clean":"2023-06-10T18:56:27.911263+0000","last_became_active":"2023-06-10T18:56:18.731407+0000","last_became_peered":"2023-06-10T18:56:18.731407+0000","last_unstale":"2023-06-10T18:56:27.911263+0000","last_undegraded":"2023-06-10T18:56:27.911263+0000","last_fullsized":"2023-06-10T18:56:27.911263+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:43:45.838944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.888979+0000","last_change":"2023-06-10T18:56:18.739026+0000","last_active":"2023-06-10T18:56:27.888979+0000","last_peered":"2023-06-10T18:56:27.888979+0000","last_clean":"2023-06-10T18:56:27.888979+0000","last_became_active":"2023-06-10T18:56:18.738748+0000","last_became_peered":"2023-06-10T18:56:18.738748+0000","last_unstale":"2023-06-10T18:56:27.888979+0000","last_undegraded":"2023-06-10T18:56:27.888979+0000","last_fullsized":"2023-06-10T18:56:27.888979+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:40:07.255608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:28.215919+0000","last_change":"2023-06-10T18:56:18.711319+0000","last_active":"2023-06-10T18:56:28.215919+0000","last_peered":"2023-06-10T18:56:28.215919+0000","last_clean":"2023-06-10T18:56:28.215919+0000","last_became_active":"2023-06-10T18:56:18.711043+0000","last_became_peered":"2023-06-10T18:56:18.711043+0000","last_unstale":"2023-06-10T18:56:28.215919+0000","last_undegraded":"2023-06-10T18:56:28.215919+0000","last_fullsized":"2023-06-10T18:56:28.215919+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T18:57:31.579489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.910848+0000","last_change":"2023-06-10T18:56:18.735130+0000","last_active":"2023-06-10T18:56:27.910848+0000","last_peered":"2023-06-10T18:56:27.910848+0000","last_clean":"2023-06-10T18:56:27.910848+0000","last_became_active":"2023-06-10T18:56:18.734873+0000","last_became_peered":"2023-06-10T18:56:18.734873+0000","last_unstale":"2023-06-10T18:56:27.910848+0000","last_undegraded":"2023-06-10T18:56:27.910848+0000","last_fullsized":"2023-06-10T18:56:27.910848+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:49:22.969532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.928109+0000","last_change":"2023-06-10T18:56:18.718525+0000","last_active":"2023-06-10T18:56:27.928109+0000","last_peered":"2023-06-10T18:56:27.928109+0000","last_clean":"2023-06-10T18:56:27.928109+0000","last_became_active":"2023-06-10T18:56:18.718169+0000","last_became_peered":"2023-06-10T18:56:18.718169+0000","last_unstale":"2023-06-10T18:56:27.928109+0000","last_undegraded":"2023-06-10T18:56:27.928109+0000","last_fullsized":"2023-06-10T18:56:27.928109+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:37:45.597946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:28.215621+0000","last_change":"2023-06-10T18:56:18.747220+0000","last_active":"2023-06-10T18:56:28.215621+0000","last_peered":"2023-06-10T18:56:28.215621+0000","last_clean":"2023-06-10T18:56:28.215621+0000","last_became_active":"2023-06-10T18:56:18.746415+0000","last_became_peered":"2023-06-10T18:56:18.746415+0000","last_unstale":"2023-06-10T18:56:28.215621+0000","last_undegraded":"2023-06-10T18:56:28.215621+0000","last_fullsized":"2023-06-10T18:56:28.215621+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:30:30.106924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.910638+0000","last_change":"2023-06-10T18:56:18.732379+0000","last_active":"2023-06-10T18:56:27.910638+0000","last_peered":"2023-06-10T18:56:27.910638+0000","last_clean":"2023-06-10T18:56:27.910638+0000","last_became_active":"2023-06-10T18:56:18.732081+0000","last_became_peered":"2023-06-10T18:56:18.732081+0000","last_unstale":"2023-06-10T18:56:27.910638+0000","last_undegraded":"2023-06-10T18:56:27.910638+0000","last_fullsized":"2023-06-10T18:56:27.910638+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:28:26.545969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.928239+0000","last_change":"2023-06-10T18:56:18.727402+0000","last_active":"2023-06-10T18:56:27.928239+0000","last_peered":"2023-06-10T18:56:27.928239+0000","last_clean":"2023-06-10T18:56:27.928239+0000","last_became_active":"2023-06-10T18:56:18.726939+0000","last_became_peered":"2023-06-10T18:56:18.726939+0000","last_unstale":"2023-06-10T18:56:27.928239+0000","last_undegraded":"2023-06-10T18:56:27.928239+0000","last_fullsized":"2023-06-10T18:56:27.928239+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:03:35.723274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:28.216457+0000","last_change":"2023-06-10T18:56:18.741248+0000","last_active":"2023-06-10T18:56:28.216457+0000","last_peered":"2023-06-10T18:56:28.216457+0000","last_clean":"2023-06-10T18:56:28.216457+0000","last_became_active":"2023-06-10T18:56:18.740548+0000","last_became_peered":"2023-06-10T18:56:18.740548+0000","last_unstale":"2023-06-10T18:56:28.216457+0000","last_undegraded":"2023-06-10T18:56:28.216457+0000","last_fullsized":"2023-06-10T18:56:28.216457+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:15:39.033964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.928699+0000","last_change":"2023-06-10T18:56:18.718426+0000","last_active":"2023-06-10T18:56:27.928699+0000","last_peered":"2023-06-10T18:56:27.928699+0000","last_clean":"2023-06-10T18:56:27.928699+0000","last_became_active":"2023-06-10T18:56:18.718017+0000","last_became_peered":"2023-06-10T18:56:18.718017+0000","last_unstale":"2023-06-10T18:56:27.928699+0000","last_undegraded":"2023-06-10T18:56:27.928699+0000","last_fullsized":"2023-06-10T18:56:27.928699+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:55:10.132650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.893015+0000","last_change":"2023-06-10T18:56:18.734189+0000","last_active":"2023-06-10T18:56:27.893015+0000","last_peered":"2023-06-10T18:56:27.893015+0000","last_clean":"2023-06-10T18:56:27.893015+0000","last_became_active":"2023-06-10T18:56:18.733412+0000","last_became_peered":"2023-06-10T18:56:18.733412+0000","last_unstale":"2023-06-10T18:56:27.893015+0000","last_undegraded":"2023-06-10T18:56:27.893015+0000","last_fullsized":"2023-06-10T18:56:27.893015+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:33:14.006785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.894179+0000","last_change":"2023-06-10T18:56:18.737307+0000","last_active":"2023-06-10T18:56:27.894179+0000","last_peered":"2023-06-10T18:56:27.894179+0000","last_clean":"2023-06-10T18:56:27.894179+0000","last_became_active":"2023-06-10T18:56:18.736534+0000","last_became_peered":"2023-06-10T18:56:18.736534+0000","last_unstale":"2023-06-10T18:56:27.894179+0000","last_undegraded":"2023-06-10T18:56:27.894179+0000","last_fullsized":"2023-06-10T18:56:27.894179+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:23:33.107540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:28.215288+0000","last_change":"2023-06-10T18:56:18.710819+0000","last_active":"2023-06-10T18:56:28.215288+0000","last_peered":"2023-06-10T18:56:28.215288+0000","last_clean":"2023-06-10T18:56:28.215288+0000","last_became_active":"2023-06-10T18:56:18.710524+0000","last_became_peered":"2023-06-10T18:56:18.710524+0000","last_unstale":"2023-06-10T18:56:28.215288+0000","last_undegraded":"2023-06-10T18:56:28.215288+0000","last_fullsized":"2023-06-10T18:56:28.215288+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:21:04.889176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.888702+0000","last_change":"2023-06-10T18:56:18.739719+0000","last_active":"2023-06-10T18:56:27.888702+0000","last_peered":"2023-06-10T18:56:27.888702+0000","last_clean":"2023-06-10T18:56:27.888702+0000","last_became_active":"2023-06-10T18:56:18.739394+0000","last_became_peered":"2023-06-10T18:56:18.739394+0000","last_unstale":"2023-06-10T18:56:27.888702+0000","last_undegraded":"2023-06-10T18:56:27.888702+0000","last_fullsized":"2023-06-10T18:56:27.888702+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:22:42.813908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.927755+0000","last_change":"2023-06-10T18:56:18.716014+0000","last_active":"2023-06-10T18:56:27.927755+0000","last_peered":"2023-06-10T18:56:27.927755+0000","last_clean":"2023-06-10T18:56:27.927755+0000","last_became_active":"2023-06-10T18:56:18.715463+0000","last_became_peered":"2023-06-10T18:56:18.715463+0000","last_unstale":"2023-06-10T18:56:27.927755+0000","last_undegraded":"2023-06-10T18:56:27.927755+0000","last_fullsized":"2023-06-10T18:56:27.927755+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:44:56.381072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.928362+0000","last_change":"2023-06-10T18:56:18.722488+0000","last_active":"2023-06-10T18:56:27.928362+0000","last_peered":"2023-06-10T18:56:27.928362+0000","last_clean":"2023-06-10T18:56:27.928362+0000","last_became_active":"2023-06-10T18:56:18.722221+0000","last_became_peered":"2023-06-10T18:56:18.722221+0000","last_unstale":"2023-06-10T18:56:27.928362+0000","last_undegraded":"2023-06-10T18:56:27.928362+0000","last_fullsized":"2023-06-10T18:56:27.928362+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:49:22.969532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:28.216098+0000","last_change":"2023-06-10T18:56:18.721449+0000","last_active":"2023-06-10T18:56:28.216098+0000","last_peered":"2023-06-10T18:56:28.216098+0000","last_clean":"2023-06-10T18:56:28.216098+0000","last_became_active":"2023-06-10T18:56:18.721191+0000","last_became_peered":"2023-06-10T18:56:18.721191+0000","last_unstale":"2023-06-10T18:56:28.216098+0000","last_undegraded":"2023-06-10T18:56:28.216098+0000","last_fullsized":"2023-06-10T18:56:28.216098+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:55:10.132650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.911112+0000","last_change":"2023-06-10T18:56:18.719671+0000","last_active":"2023-06-10T18:56:27.911112+0000","last_peered":"2023-06-10T18:56:27.911112+0000","last_clean":"2023-06-10T18:56:27.911112+0000","last_became_active":"2023-06-10T18:56:18.718588+0000","last_became_peered":"2023-06-10T18:56:18.718588+0000","last_unstale":"2023-06-10T18:56:27.911112+0000","last_undegraded":"2023-06-10T18:56:27.911112+0000","last_fullsized":"2023-06-10T18:56:27.911112+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T18:57:31.579489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.895887+0000","last_change":"2023-06-10T18:56:18.720108+0000","last_active":"2023-06-10T18:56:27.895887+0000","last_peered":"2023-06-10T18:56:27.895887+0000","last_clean":"2023-06-10T18:56:27.895887+0000","last_became_active":"2023-06-10T18:56:18.719242+0000","last_became_peered":"2023-06-10T18:56:18.719242+0000","last_unstale":"2023-06-10T18:56:27.895887+0000","last_undegraded":"2023-06-10T18:56:27.895887+0000","last_fullsized":"2023-06-10T18:56:27.895887+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:25:45.000488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.927987+0000","last_change":"2023-06-10T18:56:18.747959+0000","last_active":"2023-06-10T18:56:27.927987+0000","last_peered":"2023-06-10T18:56:27.927987+0000","last_clean":"2023-06-10T18:56:27.927987+0000","last_became_active":"2023-06-10T18:56:18.747680+0000","last_became_peered":"2023-06-10T18:56:18.747680+0000","last_unstale":"2023-06-10T18:56:27.927987+0000","last_undegraded":"2023-06-10T18:56:27.927987+0000","last_fullsized":"2023-06-10T18:56:27.927987+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:04:58.227254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:28.215727+0000","last_change":"2023-06-10T18:56:18.740103+0000","last_active":"2023-06-10T18:56:28.215727+0000","last_peered":"2023-06-10T18:56:28.215727+0000","last_clean":"2023-06-10T18:56:28.215727+0000","last_became_active":"2023-06-10T18:56:18.739227+0000","last_became_peered":"2023-06-10T18:56:18.739227+0000","last_unstale":"2023-06-10T18:56:28.215727+0000","last_undegraded":"2023-06-10T18:56:28.215727+0000","last_fullsized":"2023-06-10T18:56:28.215727+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:00:40.102159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.927936+0000","last_change":"2023-06-10T18:56:18.715535+0000","last_active":"2023-06-10T18:56:27.927936+0000","last_peered":"2023-06-10T18:56:27.927936+0000","last_clean":"2023-06-10T18:56:27.927936+0000","last_became_active":"2023-06-10T18:56:18.714677+0000","last_became_peered":"2023-06-10T18:56:18.714677+0000","last_unstale":"2023-06-10T18:56:27.927936+0000","last_undegraded":"2023-06-10T18:56:27.927936+0000","last_fullsized":"2023-06-10T18:56:27.927936+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:41:57.121808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.895884+0000","last_change":"2023-06-10T18:56:18.705775+0000","last_active":"2023-06-10T18:56:27.895884+0000","last_peered":"2023-06-10T18:56:27.895884+0000","last_clean":"2023-06-10T18:56:27.895884+0000","last_became_active":"2023-06-10T18:56:18.703437+0000","last_became_peered":"2023-06-10T18:56:18.703437+0000","last_unstale":"2023-06-10T18:56:27.895884+0000","last_undegraded":"2023-06-10T18:56:27.895884+0000","last_fullsized":"2023-06-10T18:56:27.895884+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:12:46.928430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:28.215224+0000","last_change":"2023-06-10T18:56:18.740486+0000","last_active":"2023-06-10T18:56:28.215224+0000","last_peered":"2023-06-10T18:56:28.215224+0000","last_clean":"2023-06-10T18:56:28.215224+0000","last_became_active":"2023-06-10T18:56:18.739644+0000","last_became_peered":"2023-06-10T18:56:18.739644+0000","last_unstale":"2023-06-10T18:56:28.215224+0000","last_undegraded":"2023-06-10T18:56:28.215224+0000","last_fullsized":"2023-06-10T18:56:28.215224+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:16:37.425941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"50'4","reported_seq":21,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.896682+0000","last_change":"2023-06-10T18:56:18.340764+0000","last_active":"2023-06-10T18:56:27.896682+0000","last_peered":"2023-06-10T18:56:27.896682+0000","last_clean":"2023-06-10T18:56:27.896682+0000","last_became_active":"2023-06-10T18:56:18.340011+0000","last_became_peered":"2023-06-10T18:56:18.340011+0000","last_unstale":"2023-06-10T18:56:27.896682+0000","last_undegraded":"2023-06-10T18:56:27.896682+0000","last_fullsized":"2023-06-10T18:56:27.896682+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:18:13.385747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.898717+0000","last_change":"2023-06-10T18:56:18.735833+0000","last_active":"2023-06-10T18:56:27.898717+0000","last_peered":"2023-06-10T18:56:27.898717+0000","last_clean":"2023-06-10T18:56:27.898717+0000","last_became_active":"2023-06-10T18:56:18.734668+0000","last_became_peered":"2023-06-10T18:56:18.734668+0000","last_unstale":"2023-06-10T18:56:27.898717+0000","last_undegraded":"2023-06-10T18:56:27.898717+0000","last_fullsized":"2023-06-10T18:56:27.898717+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:30:09.475520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"50'1","reported_seq":18,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.911230+0000","last_change":"2023-06-10T18:56:18.335972+0000","last_active":"2023-06-10T18:56:27.911230+0000","last_peered":"2023-06-10T18:56:27.911230+0000","last_clean":"2023-06-10T18:56:27.911230+0000","last_became_active":"2023-06-10T18:56:18.335565+0000","last_became_peered":"2023-06-10T18:56:18.335565+0000","last_unstale":"2023-06-10T18:56:27.911230+0000","last_undegraded":"2023-06-10T18:56:27.911230+0000","last_fullsized":"2023-06-10T18:56:27.911230+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:14:22.640678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.894028+0000","last_change":"2023-06-10T18:56:18.741042+0000","last_active":"2023-06-10T18:56:27.894028+0000","last_peered":"2023-06-10T18:56:27.894028+0000","last_clean":"2023-06-10T18:56:27.894028+0000","last_became_active":"2023-06-10T18:56:18.740325+0000","last_became_peered":"2023-06-10T18:56:18.740325+0000","last_unstale":"2023-06-10T18:56:27.894028+0000","last_undegraded":"2023-06-10T18:56:27.894028+0000","last_fullsized":"2023-06-10T18:56:27.894028+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:59:38.536884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"50'2","reported_seq":19,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.911159+0000","last_change":"2023-06-10T18:56:18.336603+0000","last_active":"2023-06-10T18:56:27.911159+0000","last_peered":"2023-06-10T18:56:27.911159+0000","last_clean":"2023-06-10T18:56:27.911159+0000","last_became_active":"2023-06-10T18:56:18.336117+0000","last_became_peered":"2023-06-10T18:56:18.336117+0000","last_unstale":"2023-06-10T18:56:27.911159+0000","last_undegraded":"2023-06-10T18:56:27.911159+0000","last_fullsized":"2023-06-10T18:56:27.911159+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:03:06.176948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:28.215949+0000","last_change":"2023-06-10T18:56:18.719404+0000","last_active":"2023-06-10T18:56:28.215949+0000","last_peered":"2023-06-10T18:56:28.215949+0000","last_clean":"2023-06-10T18:56:28.215949+0000","last_became_active":"2023-06-10T18:56:18.719096+0000","last_became_peered":"2023-06-10T18:56:18.719096+0000","last_unstale":"2023-06-10T18:56:28.215949+0000","last_undegraded":"2023-06-10T18:56:28.215949+0000","last_fullsized":"2023-06-10T18:56:28.215949+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:03:07.190449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"50'2","reported_seq":19,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.898475+0000","last_change":"2023-06-10T18:56:18.323382+0000","last_active":"2023-06-10T18:56:27.898475+0000","last_peered":"2023-06-10T18:56:27.898475+0000","last_clean":"2023-06-10T18:56:27.898475+0000","last_became_active":"2023-06-10T18:56:18.322748+0000","last_became_peered":"2023-06-10T18:56:18.322748+0000","last_unstale":"2023-06-10T18:56:27.898475+0000","last_undegraded":"2023-06-10T18:56:27.898475+0000","last_fullsized":"2023-06-10T18:56:27.898475+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:37:12.754886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.895361+0000","last_change":"2023-06-10T18:56:18.716497+0000","last_active":"2023-06-10T18:56:27.895361+0000","last_peered":"2023-06-10T18:56:27.895361+0000","last_clean":"2023-06-10T18:56:27.895361+0000","last_became_active":"2023-06-10T18:56:18.715689+0000","last_became_peered":"2023-06-10T18:56:18.715689+0000","last_unstale":"2023-06-10T18:56:27.895361+0000","last_undegraded":"2023-06-10T18:56:27.895361+0000","last_fullsized":"2023-06-10T18:56:27.895361+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:41:57.121808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"50'1","reported_seq":18,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.928138+0000","last_change":"2023-06-10T18:56:18.321017+0000","last_active":"2023-06-10T18:56:27.928138+0000","last_peered":"2023-06-10T18:56:27.928138+0000","last_clean":"2023-06-10T18:56:27.928138+0000","last_became_active":"2023-06-10T18:56:18.320552+0000","last_became_peered":"2023-06-10T18:56:18.320552+0000","last_unstale":"2023-06-10T18:56:27.928138+0000","last_undegraded":"2023-06-10T18:56:27.928138+0000","last_fullsized":"2023-06-10T18:56:27.928138+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:28:25.532467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:28.216248+0000","last_change":"2023-06-10T18:56:18.742047+0000","last_active":"2023-06-10T18:56:28.216248+0000","last_peered":"2023-06-10T18:56:28.216248+0000","last_clean":"2023-06-10T18:56:28.216248+0000","last_became_active":"2023-06-10T18:56:18.741342+0000","last_became_peered":"2023-06-10T18:56:18.741342+0000","last_unstale":"2023-06-10T18:56:28.216248+0000","last_undegraded":"2023-06-10T18:56:28.216248+0000","last_fullsized":"2023-06-10T18:56:28.216248+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:43:41.132616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"50'1","reported_seq":18,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.893121+0000","last_change":"2023-06-10T18:56:18.339655+0000","last_active":"2023-06-10T18:56:27.893121+0000","last_peered":"2023-06-10T18:56:27.893121+0000","last_clean":"2023-06-10T18:56:27.893121+0000","last_became_active":"2023-06-10T18:56:18.338930+0000","last_became_peered":"2023-06-10T18:56:18.338930+0000","last_unstale":"2023-06-10T18:56:27.893121+0000","last_undegraded":"2023-06-10T18:56:27.893121+0000","last_fullsized":"2023-06-10T18:56:27.893121+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:23:26.069557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:28.216269+0000","last_change":"2023-06-10T18:56:18.721372+0000","last_active":"2023-06-10T18:56:28.216269+0000","last_peered":"2023-06-10T18:56:28.216269+0000","last_clean":"2023-06-10T18:56:28.216269+0000","last_became_active":"2023-06-10T18:56:18.721086+0000","last_became_peered":"2023-06-10T18:56:18.721086+0000","last_unstale":"2023-06-10T18:56:28.216269+0000","last_undegraded":"2023-06-10T18:56:28.216269+0000","last_fullsized":"2023-06-10T18:56:28.216269+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:56:08.938886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":17,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.893639+0000","last_change":"2023-06-10T18:56:18.337501+0000","last_active":"2023-06-10T18:56:27.893639+0000","last_peered":"2023-06-10T18:56:27.893639+0000","last_clean":"2023-06-10T18:56:27.893639+0000","last_became_active":"2023-06-10T18:56:18.336875+0000","last_became_peered":"2023-06-10T18:56:18.336875+0000","last_unstale":"2023-06-10T18:56:27.893639+0000","last_undegraded":"2023-06-10T18:56:27.893639+0000","last_fullsized":"2023-06-10T18:56:27.893639+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:50:37.616188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:28.216431+0000","last_change":"2023-06-10T18:56:18.740844+0000","last_active":"2023-06-10T18:56:28.216431+0000","last_peered":"2023-06-10T18:56:28.216431+0000","last_clean":"2023-06-10T18:56:28.216431+0000","last_became_active":"2023-06-10T18:56:18.740202+0000","last_became_peered":"2023-06-10T18:56:18.740202+0000","last_unstale":"2023-06-10T18:56:28.216431+0000","last_undegraded":"2023-06-10T18:56:28.216431+0000","last_fullsized":"2023-06-10T18:56:28.216431+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:56:44.879355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":17,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.927935+0000","last_change":"2023-06-10T18:56:18.328357+0000","last_active":"2023-06-10T18:56:27.927935+0000","last_peered":"2023-06-10T18:56:27.927935+0000","last_clean":"2023-06-10T18:56:27.927935+0000","last_became_active":"2023-06-10T18:56:18.328062+0000","last_became_peered":"2023-06-10T18:56:18.328062+0000","last_unstale":"2023-06-10T18:56:27.927935+0000","last_undegraded":"2023-06-10T18:56:27.927935+0000","last_fullsized":"2023-06-10T18:56:27.927935+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T18:57:30.565987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.893210+0000","last_change":"2023-06-10T18:56:18.715041+0000","last_active":"2023-06-10T18:56:27.893210+0000","last_peered":"2023-06-10T18:56:27.893210+0000","last_clean":"2023-06-10T18:56:27.893210+0000","last_became_active":"2023-06-10T18:56:18.714315+0000","last_became_peered":"2023-06-10T18:56:18.714315+0000","last_unstale":"2023-06-10T18:56:27.893210+0000","last_undegraded":"2023-06-10T18:56:27.893210+0000","last_fullsized":"2023-06-10T18:56:27.893210+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:05:32.467816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":17,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:28.216430+0000","last_change":"2023-06-10T18:56:18.343930+0000","last_active":"2023-06-10T18:56:28.216430+0000","last_peered":"2023-06-10T18:56:28.216430+0000","last_clean":"2023-06-10T18:56:28.216430+0000","last_became_active":"2023-06-10T18:56:18.343289+0000","last_became_peered":"2023-06-10T18:56:18.343289+0000","last_unstale":"2023-06-10T18:56:28.216430+0000","last_undegraded":"2023-06-10T18:56:28.216430+0000","last_fullsized":"2023-06-10T18:56:28.216430+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:44:58.528642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.896086+0000","last_change":"2023-06-10T18:56:18.720481+0000","last_active":"2023-06-10T18:56:27.896086+0000","last_peered":"2023-06-10T18:56:27.896086+0000","last_clean":"2023-06-10T18:56:27.896086+0000","last_became_active":"2023-06-10T18:56:18.717729+0000","last_became_peered":"2023-06-10T18:56:18.717729+0000","last_unstale":"2023-06-10T18:56:27.896086+0000","last_undegraded":"2023-06-10T18:56:27.896086+0000","last_fullsized":"2023-06-10T18:56:27.896086+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:38:42.007423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":17,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.893103+0000","last_change":"2023-06-10T18:56:18.331216+0000","last_active":"2023-06-10T18:56:27.893103+0000","last_peered":"2023-06-10T18:56:27.893103+0000","last_clean":"2023-06-10T18:56:27.893103+0000","last_became_active":"2023-06-10T18:56:18.330640+0000","last_became_peered":"2023-06-10T18:56:18.330640+0000","last_unstale":"2023-06-10T18:56:27.893103+0000","last_undegraded":"2023-06-10T18:56:27.893103+0000","last_fullsized":"2023-06-10T18:56:27.893103+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:13:38.791330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.928352+0000","last_change":"2023-06-10T18:56:18.745850+0000","last_active":"2023-06-10T18:56:27.928352+0000","last_peered":"2023-06-10T18:56:27.928352+0000","last_clean":"2023-06-10T18:56:27.928352+0000","last_became_active":"2023-06-10T18:56:18.745516+0000","last_became_peered":"2023-06-10T18:56:18.745516+0000","last_unstale":"2023-06-10T18:56:27.928352+0000","last_undegraded":"2023-06-10T18:56:27.928352+0000","last_fullsized":"2023-06-10T18:56:27.928352+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:39:23.831662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"50'3","reported_seq":20,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:28.216247+0000","last_change":"2023-06-10T18:56:18.341819+0000","last_active":"2023-06-10T18:56:28.216247+0000","last_peered":"2023-06-10T18:56:28.216247+0000","last_clean":"2023-06-10T18:56:28.216247+0000","last_became_active":"2023-06-10T18:56:18.341153+0000","last_became_peered":"2023-06-10T18:56:18.341153+0000","last_unstale":"2023-06-10T18:56:28.216247+0000","last_undegraded":"2023-06-10T18:56:28.216247+0000","last_fullsized":"2023-06-10T18:56:28.216247+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:32:32.897566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.893997+0000","last_change":"2023-06-10T18:56:18.718945+0000","last_active":"2023-06-10T18:56:27.893997+0000","last_peered":"2023-06-10T18:56:27.893997+0000","last_clean":"2023-06-10T18:56:27.893997+0000","last_became_active":"2023-06-10T18:56:18.717962+0000","last_became_peered":"2023-06-10T18:56:18.717962+0000","last_unstale":"2023-06-10T18:56:27.893997+0000","last_undegraded":"2023-06-10T18:56:27.893997+0000","last_fullsized":"2023-06-10T18:56:27.893997+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:57:04.253762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"50'6","reported_seq":23,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:28.216174+0000","last_change":"2023-06-10T18:56:18.333312+0000","last_active":"2023-06-10T18:56:28.216174+0000","last_peered":"2023-06-10T18:56:28.216174+0000","last_clean":"2023-06-10T18:56:28.216174+0000","last_became_active":"2023-06-10T18:56:18.332390+0000","last_became_peered":"2023-06-10T18:56:18.332390+0000","last_unstale":"2023-06-10T18:56:28.216174+0000","last_undegraded":"2023-06-10T18:56:28.216174+0000","last_fullsized":"2023-06-10T18:56:28.216174+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:35:54.887943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.898059+0000","last_change":"2023-06-10T18:56:18.739711+0000","last_active":"2023-06-10T18:56:27.898059+0000","last_peered":"2023-06-10T18:56:27.898059+0000","last_clean":"2023-06-10T18:56:27.898059+0000","last_became_active":"2023-06-10T18:56:18.738999+0000","last_became_peered":"2023-06-10T18:56:18.738999+0000","last_unstale":"2023-06-10T18:56:27.898059+0000","last_undegraded":"2023-06-10T18:56:27.898059+0000","last_fullsized":"2023-06-10T18:56:27.898059+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:48:42.161363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"50'2","reported_seq":19,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.928288+0000","last_change":"2023-06-10T18:56:18.342157+0000","last_active":"2023-06-10T18:56:27.928288+0000","last_peered":"2023-06-10T18:56:27.928288+0000","last_clean":"2023-06-10T18:56:27.928288+0000","last_became_active":"2023-06-10T18:56:18.341576+0000","last_became_peered":"2023-06-10T18:56:18.341576+0000","last_unstale":"2023-06-10T18:56:27.928288+0000","last_undegraded":"2023-06-10T18:56:27.928288+0000","last_fullsized":"2023-06-10T18:56:27.928288+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:21:03.875674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.912516+0000","last_change":"2023-06-10T18:56:27.912516+0000","last_active":"2023-06-10T18:56:27.912516+0000","last_peered":"2023-06-10T18:56:27.912516+0000","last_clean":"2023-06-10T18:56:27.912516+0000","last_became_active":"2023-06-10T18:56:27.911930+0000","last_became_peered":"2023-06-10T18:56:27.911930+0000","last_unstale":"2023-06-10T18:56:27.912516+0000","last_undegraded":"2023-06-10T18:56:27.912516+0000","last_fullsized":"2023-06-10T18:56:27.912516+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:15:45.739480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":17,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.894223+0000","last_change":"2023-06-10T18:56:18.335774+0000","last_active":"2023-06-10T18:56:27.894223+0000","last_peered":"2023-06-10T18:56:27.894223+0000","last_clean":"2023-06-10T18:56:27.894223+0000","last_became_active":"2023-06-10T18:56:18.334295+0000","last_became_peered":"2023-06-10T18:56:18.334295+0000","last_unstale":"2023-06-10T18:56:27.894223+0000","last_undegraded":"2023-06-10T18:56:27.894223+0000","last_fullsized":"2023-06-10T18:56:27.894223+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:06:23.366219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:28.216091+0000","last_change":"2023-06-10T18:56:18.732193+0000","last_active":"2023-06-10T18:56:28.216091+0000","last_peered":"2023-06-10T18:56:28.216091+0000","last_clean":"2023-06-10T18:56:28.216091+0000","last_became_active":"2023-06-10T18:56:18.731876+0000","last_became_peered":"2023-06-10T18:56:18.731876+0000","last_unstale":"2023-06-10T18:56:28.216091+0000","last_undegraded":"2023-06-10T18:56:28.216091+0000","last_fullsized":"2023-06-10T18:56:28.216091+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:14:23.654180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":17,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:28.215870+0000","last_change":"2023-06-10T18:56:18.348170+0000","last_active":"2023-06-10T18:56:28.215870+0000","last_peered":"2023-06-10T18:56:28.215870+0000","last_clean":"2023-06-10T18:56:28.215870+0000","last_became_active":"2023-06-10T18:56:18.347458+0000","last_became_peered":"2023-06-10T18:56:18.347458+0000","last_unstale":"2023-06-10T18:56:28.215870+0000","last_undegraded":"2023-06-10T18:56:28.215870+0000","last_fullsized":"2023-06-10T18:56:28.215870+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:02:44.634536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.928367+0000","last_change":"2023-06-10T18:56:18.727211+0000","last_active":"2023-06-10T18:56:27.928367+0000","last_peered":"2023-06-10T18:56:27.928367+0000","last_clean":"2023-06-10T18:56:27.928367+0000","last_became_active":"2023-06-10T18:56:18.726575+0000","last_became_peered":"2023-06-10T18:56:18.726575+0000","last_unstale":"2023-06-10T18:56:27.928367+0000","last_undegraded":"2023-06-10T18:56:27.928367+0000","last_fullsized":"2023-06-10T18:56:27.928367+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:36:48.749304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"50'8","reported_seq":25,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:28.215660+0000","last_change":"2023-06-10T18:56:18.332240+0000","last_active":"2023-06-10T18:56:28.215660+0000","last_peered":"2023-06-10T18:56:28.215660+0000","last_clean":"2023-06-10T18:56:28.215660+0000","last_became_active":"2023-06-10T18:56:18.331781+0000","last_became_peered":"2023-06-10T18:56:18.331781+0000","last_unstale":"2023-06-10T18:56:28.215660+0000","last_undegraded":"2023-06-10T18:56:28.215660+0000","last_fullsized":"2023-06-10T18:56:28.215660+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:36:47.735802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:28.215432+0000","last_change":"2023-06-10T18:56:18.702816+0000","last_active":"2023-06-10T18:56:28.215432+0000","last_peered":"2023-06-10T18:56:28.215432+0000","last_clean":"2023-06-10T18:56:28.215432+0000","last_became_active":"2023-06-10T18:56:18.702527+0000","last_became_peered":"2023-06-10T18:56:18.702527+0000","last_unstale":"2023-06-10T18:56:28.215432+0000","last_undegraded":"2023-06-10T18:56:28.215432+0000","last_fullsized":"2023-06-10T18:56:28.215432+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:39:23.831662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"50'1","reported_seq":18,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.928483+0000","last_change":"2023-06-10T18:56:18.324631+0000","last_active":"2023-06-10T18:56:27.928483+0000","last_peered":"2023-06-10T18:56:27.928483+0000","last_clean":"2023-06-10T18:56:27.928483+0000","last_became_active":"2023-06-10T18:56:18.324243+0000","last_became_peered":"2023-06-10T18:56:18.324243+0000","last_unstale":"2023-06-10T18:56:27.928483+0000","last_undegraded":"2023-06-10T18:56:27.928483+0000","last_fullsized":"2023-06-10T18:56:27.928483+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:05:53.380384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.910806+0000","last_change":"2023-06-10T18:56:18.710557+0000","last_active":"2023-06-10T18:56:27.910806+0000","last_peered":"2023-06-10T18:56:27.910806+0000","last_clean":"2023-06-10T18:56:27.910806+0000","last_became_active":"2023-06-10T18:56:18.710238+0000","last_became_peered":"2023-06-10T18:56:18.710238+0000","last_unstale":"2023-06-10T18:56:27.910806+0000","last_undegraded":"2023-06-10T18:56:27.910806+0000","last_fullsized":"2023-06-10T18:56:27.910806+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:39:23.831662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"50'2","reported_seq":19,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.889045+0000","last_change":"2023-06-10T18:56:18.324362+0000","last_active":"2023-06-10T18:56:27.889045+0000","last_peered":"2023-06-10T18:56:27.889045+0000","last_clean":"2023-06-10T18:56:27.889045+0000","last_became_active":"2023-06-10T18:56:18.323943+0000","last_became_peered":"2023-06-10T18:56:18.323943+0000","last_unstale":"2023-06-10T18:56:27.889045+0000","last_undegraded":"2023-06-10T18:56:27.889045+0000","last_fullsized":"2023-06-10T18:56:27.889045+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:12:03.020338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.892767+0000","last_change":"2023-06-10T18:56:18.715476+0000","last_active":"2023-06-10T18:56:27.892767+0000","last_peered":"2023-06-10T18:56:27.892767+0000","last_clean":"2023-06-10T18:56:27.892767+0000","last_became_active":"2023-06-10T18:56:18.714697+0000","last_became_peered":"2023-06-10T18:56:18.714697+0000","last_unstale":"2023-06-10T18:56:27.892767+0000","last_undegraded":"2023-06-10T18:56:27.892767+0000","last_fullsized":"2023-06-10T18:56:27.892767+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:18:25.090460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"50'1","reported_seq":18,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.896683+0000","last_change":"2023-06-10T18:56:18.341065+0000","last_active":"2023-06-10T18:56:27.896683+0000","last_peered":"2023-06-10T18:56:27.896683+0000","last_clean":"2023-06-10T18:56:27.896683+0000","last_became_active":"2023-06-10T18:56:18.340242+0000","last_became_peered":"2023-06-10T18:56:18.340242+0000","last_unstale":"2023-06-10T18:56:27.896683+0000","last_undegraded":"2023-06-10T18:56:27.896683+0000","last_fullsized":"2023-06-10T18:56:27.896683+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:36:18.602405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.910931+0000","last_change":"2023-06-10T18:56:18.722679+0000","last_active":"2023-06-10T18:56:27.910931+0000","last_peered":"2023-06-10T18:56:27.910931+0000","last_clean":"2023-06-10T18:56:27.910931+0000","last_became_active":"2023-06-10T18:56:18.722389+0000","last_became_peered":"2023-06-10T18:56:18.722389+0000","last_unstale":"2023-06-10T18:56:27.910931+0000","last_undegraded":"2023-06-10T18:56:27.910931+0000","last_fullsized":"2023-06-10T18:56:27.910931+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:05:54.393886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":17,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.896141+0000","last_change":"2023-06-10T18:56:18.335157+0000","last_active":"2023-06-10T18:56:27.896141+0000","last_peered":"2023-06-10T18:56:27.896141+0000","last_clean":"2023-06-10T18:56:27.896141+0000","last_became_active":"2023-06-10T18:56:18.334417+0000","last_became_peered":"2023-06-10T18:56:18.334417+0000","last_unstale":"2023-06-10T18:56:27.896141+0000","last_undegraded":"2023-06-10T18:56:27.896141+0000","last_fullsized":"2023-06-10T18:56:27.896141+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:29:51.610962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.898261+0000","last_change":"2023-06-10T18:56:18.720351+0000","last_active":"2023-06-10T18:56:27.898261+0000","last_peered":"2023-06-10T18:56:27.898261+0000","last_clean":"2023-06-10T18:56:27.898261+0000","last_became_active":"2023-06-10T18:56:18.717962+0000","last_became_peered":"2023-06-10T18:56:18.717962+0000","last_unstale":"2023-06-10T18:56:27.898261+0000","last_undegraded":"2023-06-10T18:56:27.898261+0000","last_fullsized":"2023-06-10T18:56:27.898261+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:28:12.092718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"50'2","reported_seq":19,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.910989+0000","last_change":"2023-06-10T18:56:18.337149+0000","last_active":"2023-06-10T18:56:27.910989+0000","last_peered":"2023-06-10T18:56:27.910989+0000","last_clean":"2023-06-10T18:56:27.910989+0000","last_became_active":"2023-06-10T18:56:18.335525+0000","last_became_peered":"2023-06-10T18:56:18.335525+0000","last_unstale":"2023-06-10T18:56:27.910989+0000","last_undegraded":"2023-06-10T18:56:27.910989+0000","last_fullsized":"2023-06-10T18:56:27.910989+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:47:10.739294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.896643+0000","last_change":"2023-06-10T18:56:18.734899+0000","last_active":"2023-06-10T18:56:27.896643+0000","last_peered":"2023-06-10T18:56:27.896643+0000","last_clean":"2023-06-10T18:56:27.896643+0000","last_became_active":"2023-06-10T18:56:18.734152+0000","last_became_peered":"2023-06-10T18:56:18.734152+0000","last_unstale":"2023-06-10T18:56:27.896643+0000","last_undegraded":"2023-06-10T18:56:27.896643+0000","last_fullsized":"2023-06-10T18:56:27.896643+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:57:58.828553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":17,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:28.215571+0000","last_change":"2023-06-10T18:56:18.332341+0000","last_active":"2023-06-10T18:56:28.215571+0000","last_peered":"2023-06-10T18:56:28.215571+0000","last_clean":"2023-06-10T18:56:28.215571+0000","last_became_active":"2023-06-10T18:56:18.331836+0000","last_became_peered":"2023-06-10T18:56:18.331836+0000","last_unstale":"2023-06-10T18:56:28.215571+0000","last_undegraded":"2023-06-10T18:56:28.215571+0000","last_fullsized":"2023-06-10T18:56:28.215571+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:49:21.956031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.928895+0000","last_change":"2023-06-10T18:56:18.745846+0000","last_active":"2023-06-10T18:56:27.928895+0000","last_peered":"2023-06-10T18:56:27.928895+0000","last_clean":"2023-06-10T18:56:27.928895+0000","last_became_active":"2023-06-10T18:56:18.745527+0000","last_became_peered":"2023-06-10T18:56:18.745527+0000","last_unstale":"2023-06-10T18:56:27.928895+0000","last_undegraded":"2023-06-10T18:56:27.928895+0000","last_fullsized":"2023-06-10T18:56:27.928895+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:35:55.901444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":17,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.928093+0000","last_change":"2023-06-10T18:56:18.337764+0000","last_active":"2023-06-10T18:56:27.928093+0000","last_peered":"2023-06-10T18:56:27.928093+0000","last_clean":"2023-06-10T18:56:27.928093+0000","last_became_active":"2023-06-10T18:56:18.337390+0000","last_became_peered":"2023-06-10T18:56:18.337390+0000","last_unstale":"2023-06-10T18:56:27.928093+0000","last_undegraded":"2023-06-10T18:56:27.928093+0000","last_fullsized":"2023-06-10T18:56:27.928093+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:36:49.092515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.911283+0000","last_change":"2023-06-10T18:56:18.705770+0000","last_active":"2023-06-10T18:56:27.911283+0000","last_peered":"2023-06-10T18:56:27.911283+0000","last_clean":"2023-06-10T18:56:27.911283+0000","last_became_active":"2023-06-10T18:56:18.705487+0000","last_became_peered":"2023-06-10T18:56:18.705487+0000","last_unstale":"2023-06-10T18:56:27.911283+0000","last_undegraded":"2023-06-10T18:56:27.911283+0000","last_fullsized":"2023-06-10T18:56:27.911283+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:35:55.901444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":17,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.888605+0000","last_change":"2023-06-10T18:56:18.339683+0000","last_active":"2023-06-10T18:56:27.888605+0000","last_peered":"2023-06-10T18:56:27.888605+0000","last_clean":"2023-06-10T18:56:27.888605+0000","last_became_active":"2023-06-10T18:56:18.339076+0000","last_became_peered":"2023-06-10T18:56:18.339076+0000","last_unstale":"2023-06-10T18:56:27.888605+0000","last_undegraded":"2023-06-10T18:56:27.888605+0000","last_fullsized":"2023-06-10T18:56:27.888605+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:21:14.498048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.893348+0000","last_change":"2023-06-10T18:56:18.724347+0000","last_active":"2023-06-10T18:56:27.893348+0000","last_peered":"2023-06-10T18:56:27.893348+0000","last_clean":"2023-06-10T18:56:27.893348+0000","last_became_active":"2023-06-10T18:56:18.723327+0000","last_became_peered":"2023-06-10T18:56:18.723327+0000","last_unstale":"2023-06-10T18:56:27.893348+0000","last_undegraded":"2023-06-10T18:56:27.893348+0000","last_fullsized":"2023-06-10T18:56:27.893348+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:39:44.135761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"51'1","reported_seq":18,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.928865+0000","last_change":"2023-06-10T18:56:18.337157+0000","last_active":"2023-06-10T18:56:27.928865+0000","last_peered":"2023-06-10T18:56:27.928865+0000","last_clean":"2023-06-10T18:56:27.928865+0000","last_became_active":"2023-06-10T18:56:18.336768+0000","last_became_peered":"2023-06-10T18:56:18.336768+0000","last_unstale":"2023-06-10T18:56:27.928865+0000","last_undegraded":"2023-06-10T18:56:27.928865+0000","last_fullsized":"2023-06-10T18:56:27.928865+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:43:44.825443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":226,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:28.215639+0000","last_change":"2023-06-10T18:52:34.951528+0000","last_active":"2023-06-10T18:56:28.215639+0000","last_peered":"2023-06-10T18:56:28.215639+0000","last_clean":"2023-06-10T18:56:28.215639+0000","last_became_active":"2023-06-10T18:52:34.949099+0000","last_became_peered":"2023-06-10T18:52:34.949099+0000","last_unstale":"2023-06-10T18:56:28.215639+0000","last_undegraded":"2023-06-10T18:56:28.215639+0000","last_fullsized":"2023-06-10T18:56:28.215639+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_clean_scrub_stamp":"2023-06-10T18:52:33.633295+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:04:30.683049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":72,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.897722+0000","last_change":"2023-06-10T18:52:40.506384+0000","last_active":"2023-06-10T18:56:27.897722+0000","last_peered":"2023-06-10T18:56:27.897722+0000","last_clean":"2023-06-10T18:56:27.897722+0000","last_became_active":"2023-06-10T18:52:40.505701+0000","last_became_peered":"2023-06-10T18:52:40.505701+0000","last_unstale":"2023-06-10T18:56:27.897722+0000","last_undegraded":"2023-06-10T18:56:27.897722+0000","last_fullsized":"2023-06-10T18:56:27.897722+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:38:54.445772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.910804+0000","last_change":"2023-06-10T18:56:18.714433+0000","last_active":"2023-06-10T18:56:27.910804+0000","last_peered":"2023-06-10T18:56:27.910804+0000","last_clean":"2023-06-10T18:56:27.910804+0000","last_became_active":"2023-06-10T18:56:18.714070+0000","last_became_peered":"2023-06-10T18:56:18.714070+0000","last_unstale":"2023-06-10T18:56:27.910804+0000","last_undegraded":"2023-06-10T18:56:27.910804+0000","last_fullsized":"2023-06-10T18:56:27.910804+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:21:04.889176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":17,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:28.216595+0000","last_change":"2023-06-10T18:56:18.341822+0000","last_active":"2023-06-10T18:56:28.216595+0000","last_peered":"2023-06-10T18:56:28.216595+0000","last_clean":"2023-06-10T18:56:28.216595+0000","last_became_active":"2023-06-10T18:56:18.341138+0000","last_became_peered":"2023-06-10T18:56:18.341138+0000","last_unstale":"2023-06-10T18:56:28.216595+0000","last_undegraded":"2023-06-10T18:56:28.216595+0000","last_fullsized":"2023-06-10T18:56:28.216595+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:22:10.765106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":70,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:28.215576+0000","last_change":"2023-06-10T18:52:40.512015+0000","last_active":"2023-06-10T18:56:28.215576+0000","last_peered":"2023-06-10T18:56:28.215576+0000","last_clean":"2023-06-10T18:56:28.215576+0000","last_became_active":"2023-06-10T18:52:40.511382+0000","last_became_peered":"2023-06-10T18:52:40.511382+0000","last_unstale":"2023-06-10T18:56:28.215576+0000","last_undegraded":"2023-06-10T18:56:28.215576+0000","last_fullsized":"2023-06-10T18:56:28.215576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:10:46.322261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:28.215800+0000","last_change":"2023-06-10T18:56:18.720642+0000","last_active":"2023-06-10T18:56:28.215800+0000","last_peered":"2023-06-10T18:56:28.215800+0000","last_clean":"2023-06-10T18:56:28.215800+0000","last_became_active":"2023-06-10T18:56:18.720385+0000","last_became_peered":"2023-06-10T18:56:18.720385+0000","last_unstale":"2023-06-10T18:56:28.215800+0000","last_undegraded":"2023-06-10T18:56:28.215800+0000","last_fullsized":"2023-06-10T18:56:28.215800+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:47:11.752796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":17,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.928615+0000","last_change":"2023-06-10T18:56:18.320760+0000","last_active":"2023-06-10T18:56:27.928615+0000","last_peered":"2023-06-10T18:56:27.928615+0000","last_clean":"2023-06-10T18:56:27.928615+0000","last_became_active":"2023-06-10T18:56:18.320373+0000","last_became_peered":"2023-06-10T18:56:18.320373+0000","last_unstale":"2023-06-10T18:56:27.928615+0000","last_undegraded":"2023-06-10T18:56:27.928615+0000","last_fullsized":"2023-06-10T18:56:27.928615+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:14:22.640678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":72,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.888605+0000","last_change":"2023-06-10T18:52:40.671725+0000","last_active":"2023-06-10T18:56:27.888605+0000","last_peered":"2023-06-10T18:56:27.888605+0000","last_clean":"2023-06-10T18:56:27.888605+0000","last_became_active":"2023-06-10T18:52:40.671442+0000","last_became_peered":"2023-06-10T18:52:40.671442+0000","last_unstale":"2023-06-10T18:56:27.888605+0000","last_undegraded":"2023-06-10T18:56:27.888605+0000","last_fullsized":"2023-06-10T18:56:27.888605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:05:23.092455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.896180+0000","last_change":"2023-06-10T18:56:18.704278+0000","last_active":"2023-06-10T18:56:27.896180+0000","last_peered":"2023-06-10T18:56:27.896180+0000","last_clean":"2023-06-10T18:56:27.896180+0000","last_became_active":"2023-06-10T18:56:18.703336+0000","last_became_peered":"2023-06-10T18:56:18.703336+0000","last_unstale":"2023-06-10T18:56:27.896180+0000","last_undegraded":"2023-06-10T18:56:27.896180+0000","last_fullsized":"2023-06-10T18:56:27.896180+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:46:21.021138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"50'2","reported_seq":19,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.896775+0000","last_change":"2023-06-10T18:56:18.335741+0000","last_active":"2023-06-10T18:56:27.896775+0000","last_peered":"2023-06-10T18:56:27.896775+0000","last_clean":"2023-06-10T18:56:27.896775+0000","last_became_active":"2023-06-10T18:56:18.334904+0000","last_became_peered":"2023-06-10T18:56:18.334904+0000","last_unstale":"2023-06-10T18:56:27.896775+0000","last_undegraded":"2023-06-10T18:56:27.896775+0000","last_fullsized":"2023-06-10T18:56:27.896775+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:43:24.647684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":72,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.897073+0000","last_change":"2023-06-10T18:52:40.510258+0000","last_active":"2023-06-10T18:56:27.897073+0000","last_peered":"2023-06-10T18:56:27.897073+0000","last_clean":"2023-06-10T18:56:27.897073+0000","last_became_active":"2023-06-10T18:52:40.509560+0000","last_became_peered":"2023-06-10T18:52:40.509560+0000","last_unstale":"2023-06-10T18:56:27.897073+0000","last_undegraded":"2023-06-10T18:56:27.897073+0000","last_fullsized":"2023-06-10T18:56:27.897073+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:44:17.382463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.896693+0000","last_change":"2023-06-10T18:56:27.896693+0000","last_active":"2023-06-10T18:56:27.896693+0000","last_peered":"2023-06-10T18:56:27.896693+0000","last_clean":"2023-06-10T18:56:27.896693+0000","last_became_active":"2023-06-10T18:56:27.895116+0000","last_became_peered":"2023-06-10T18:56:27.895116+0000","last_unstale":"2023-06-10T18:56:27.896693+0000","last_undegraded":"2023-06-10T18:56:27.896693+0000","last_fullsized":"2023-06-10T18:56:27.896693+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:25:41.401949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":17,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.893581+0000","last_change":"2023-06-10T18:56:18.325010+0000","last_active":"2023-06-10T18:56:27.893581+0000","last_peered":"2023-06-10T18:56:27.893581+0000","last_clean":"2023-06-10T18:56:27.893581+0000","last_became_active":"2023-06-10T18:56:18.324414+0000","last_became_peered":"2023-06-10T18:56:18.324414+0000","last_unstale":"2023-06-10T18:56:27.893581+0000","last_undegraded":"2023-06-10T18:56:27.893581+0000","last_fullsized":"2023-06-10T18:56:27.893581+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:52:29.503909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":68,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.910855+0000","last_change":"2023-06-10T18:52:40.672266+0000","last_active":"2023-06-10T18:56:27.910855+0000","last_peered":"2023-06-10T18:56:27.910855+0000","last_clean":"2023-06-10T18:56:27.910855+0000","last_became_active":"2023-06-10T18:52:40.671966+0000","last_became_peered":"2023-06-10T18:52:40.671966+0000","last_unstale":"2023-06-10T18:56:27.910855+0000","last_undegraded":"2023-06-10T18:56:27.910855+0000","last_fullsized":"2023-06-10T18:56:27.910855+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:33:09.940336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:28.216439+0000","last_change":"2023-06-10T18:56:18.703583+0000","last_active":"2023-06-10T18:56:28.216439+0000","last_peered":"2023-06-10T18:56:28.216439+0000","last_clean":"2023-06-10T18:56:28.216439+0000","last_became_active":"2023-06-10T18:56:18.703292+0000","last_became_peered":"2023-06-10T18:56:18.703292+0000","last_unstale":"2023-06-10T18:56:28.216439+0000","last_undegraded":"2023-06-10T18:56:28.216439+0000","last_fullsized":"2023-06-10T18:56:28.216439+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:07:34.244620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":17,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.896469+0000","last_change":"2023-06-10T18:56:18.331871+0000","last_active":"2023-06-10T18:56:27.896469+0000","last_peered":"2023-06-10T18:56:27.896469+0000","last_clean":"2023-06-10T18:56:27.896469+0000","last_became_active":"2023-06-10T18:56:18.331127+0000","last_became_peered":"2023-06-10T18:56:18.331127+0000","last_unstale":"2023-06-10T18:56:27.896469+0000","last_undegraded":"2023-06-10T18:56:27.896469+0000","last_fullsized":"2023-06-10T18:56:27.896469+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:39:54.714178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":70,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:28.216658+0000","last_change":"2023-06-10T18:52:40.671084+0000","last_active":"2023-06-10T18:56:28.216658+0000","last_peered":"2023-06-10T18:56:28.216658+0000","last_clean":"2023-06-10T18:56:28.216658+0000","last_became_active":"2023-06-10T18:52:40.670697+0000","last_became_peered":"2023-06-10T18:52:40.670697+0000","last_unstale":"2023-06-10T18:56:28.216658+0000","last_undegraded":"2023-06-10T18:56:28.216658+0000","last_fullsized":"2023-06-10T18:56:28.216658+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:49:15.364958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.928498+0000","last_change":"2023-06-10T18:56:18.724544+0000","last_active":"2023-06-10T18:56:27.928498+0000","last_peered":"2023-06-10T18:56:27.928498+0000","last_clean":"2023-06-10T18:56:27.928498+0000","last_became_active":"2023-06-10T18:56:18.724244+0000","last_became_peered":"2023-06-10T18:56:18.724244+0000","last_unstale":"2023-06-10T18:56:27.928498+0000","last_undegraded":"2023-06-10T18:56:27.928498+0000","last_fullsized":"2023-06-10T18:56:27.928498+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:47:11.752796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":17,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:28.216127+0000","last_change":"2023-06-10T18:56:18.332507+0000","last_active":"2023-06-10T18:56:28.216127+0000","last_peered":"2023-06-10T18:56:28.216127+0000","last_clean":"2023-06-10T18:56:28.216127+0000","last_became_active":"2023-06-10T18:56:18.331887+0000","last_became_peered":"2023-06-10T18:56:18.331887+0000","last_unstale":"2023-06-10T18:56:28.216127+0000","last_undegraded":"2023-06-10T18:56:28.216127+0000","last_fullsized":"2023-06-10T18:56:28.216127+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:43:44.825443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":68,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.911356+0000","last_change":"2023-06-10T18:52:40.514114+0000","last_active":"2023-06-10T18:56:27.911356+0000","last_peered":"2023-06-10T18:56:27.911356+0000","last_clean":"2023-06-10T18:56:27.911356+0000","last_became_active":"2023-06-10T18:52:40.513638+0000","last_became_peered":"2023-06-10T18:52:40.513638+0000","last_unstale":"2023-06-10T18:56:27.911356+0000","last_undegraded":"2023-06-10T18:56:27.911356+0000","last_fullsized":"2023-06-10T18:56:27.911356+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:52:30.129918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.898062+0000","last_change":"2023-06-10T18:56:18.733094+0000","last_active":"2023-06-10T18:56:27.898062+0000","last_peered":"2023-06-10T18:56:27.898062+0000","last_clean":"2023-06-10T18:56:27.898062+0000","last_became_active":"2023-06-10T18:56:18.732442+0000","last_became_peered":"2023-06-10T18:56:18.732442+0000","last_unstale":"2023-06-10T18:56:27.898062+0000","last_undegraded":"2023-06-10T18:56:27.898062+0000","last_fullsized":"2023-06-10T18:56:27.898062+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:18.283809+0000","last_clean_scrub_stamp":"2023-06-10T18:56:18.283809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:28:33.824943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":17,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:28.215671+0000","last_change":"2023-06-10T18:56:18.337697+0000","last_active":"2023-06-10T18:56:28.215671+0000","last_peered":"2023-06-10T18:56:28.215671+0000","last_clean":"2023-06-10T18:56:28.215671+0000","last_became_active":"2023-06-10T18:56:18.337174+0000","last_became_peered":"2023-06-10T18:56:18.337174+0000","last_unstale":"2023-06-10T18:56:28.215671+0000","last_undegraded":"2023-06-10T18:56:28.215671+0000","last_fullsized":"2023-06-10T18:56:28.215671+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:56:17.270307+0000","last_clean_scrub_stamp":"2023-06-10T18:56:17.270307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:05:53.380384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":72,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-06-10T18:56:27.896983+0000","last_change":"2023-06-10T18:52:40.515396+0000","last_active":"2023-06-10T18:56:27.896983+0000","last_peered":"2023-06-10T18:56:27.896983+0000","last_clean":"2023-06-10T18:56:27.896983+0000","last_became_active":"2023-06-10T18:52:40.514663+0000","last_became_peered":"2023-06-10T18:52:40.514663+0000","last_unstale":"2023-06-10T18:56:27.896983+0000","last_undegraded":"2023-06-10T18:56:27.896983+0000","last_fullsized":"2023-06-10T18:56:27.896983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:31:30.187421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574899,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28152,"kb_used_data":1200,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343688,"statfs":{"total":96636764160,"available":96607936512,"internally_reserved":0,"allocated":1228800,"data_stored":864176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":0.90400000000000003,"15min":0.88200000000000001},"min":{"1min":0.73599999999999999,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.3759999999999999,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.97999999999999998},{"interface":"front","average":{"1min":1.006,"5min":0.94299999999999995,"15min":0.93000000000000005},"min":{"1min":0.81899999999999995,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.234,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":1.0349999999999999}]},{"osd":1,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92400000000000004,"15min":0.91500000000000004},"min":{"1min":0.58599999999999997,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.3089999999999999,"5min":1.377,"15min":1.377},"last":1.1419999999999999},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.92500000000000004,"15min":0.91100000000000003},"min":{"1min":0.78400000000000003,"5min":0.504,"15min":0.504},"max":{"1min":1.111,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.1080000000000001}]},{"osd":2,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.83999999999999997,"15min":0.82799999999999996},"min":{"1min":0.64100000000000001,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.214,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.89900000000000002,"15min":0.90700000000000003},"min":{"1min":0.67500000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.325,"5min":1.367,"15min":1.367},"last":1.069}]},{"osd":3,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.92100000000000004,"15min":0.89900000000000002},"min":{"1min":0.68100000000000005,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1499999999999999,"5min":1.502,"15min":1.502},"last":1.167},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.93799999999999994,"15min":0.92800000000000005},"min":{"1min":0.70399999999999996,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.2130000000000001,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.77200000000000002}]},{"osd":4,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.876,"15min":0.872},"min":{"1min":0.60199999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.141,"5min":1.639,"15min":1.639},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.96899999999999997,"15min":0.98099999999999998},"min":{"1min":0.748,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.238,"5min":1.411,"15min":1.411},"last":0.65200000000000002}]},{"osd":5,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.042,"15min":1.038},"min":{"1min":0.79800000000000004,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.2669999999999999,"5min":1.806,"15min":1.806},"last":0.93200000000000005},{"interface":"front","average":{"1min":1.081,"5min":1.05,"15min":1.052},"min":{"1min":0.93200000000000005,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.256,"5min":1.522,"15min":1.522},"last":1.0009999999999999}]},{"osd":6,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.0129999999999999,"15min":1.008},"min":{"1min":0.78500000000000003,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.3,"5min":1.718,"15min":1.718},"last":0.95599999999999996},{"interface":"front","average":{"1min":1.147,"5min":1.095,"15min":1.0900000000000001},"min":{"1min":0.96599999999999997,"5min":0.441,"15min":0.441},"max":{"1min":1.409,"5min":1.464,"15min":1.464},"last":1.224}]}]},{"osd":6,"up_from":13,"seq":55834574900,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27572,"kb_used_data":620,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344268,"statfs":{"total":96636764160,"available":96608530432,"internally_reserved":0,"allocated":634880,"data_stored":274336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.81999999999999995,"15min":0.80100000000000005},"min":{"1min":0.65800000000000003,"5min":0.502,"15min":0.502},"max":{"1min":1.0589999999999999,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":1.155},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.85199999999999998,"15min":0.83999999999999997},"min":{"1min":0.71799999999999997,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.0680000000000001,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":1.024}]},{"osd":1,"last update":"Sat Jun 10 18:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.873,"15min":0.85199999999999998},"min":{"1min":0.68999999999999995,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.0529999999999999},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.879,"15min":0.85899999999999999},"min":{"1min":0.68999999999999995,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":0.83699999999999997}]},{"osd":2,"last update":"Sat Jun 10 18:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.871,"15min":0.85899999999999999},"min":{"1min":0.66000000000000003,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.1950000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.875},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.88500000000000001,"15min":0.88900000000000001},"min":{"1min":0.68000000000000005,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.109,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.91300000000000003}]},{"osd":3,"last update":"Sat Jun 10 18:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.874,"15min":0.84799999999999998},"min":{"1min":0.64900000000000002,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.169,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.97799999999999998},{"interface":"front","average":{"1min":1.0209999999999999,"5min":0.997,"15min":0.995},"min":{"1min":0.72799999999999998,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":1.2569999999999999}]},{"osd":4,"last update":"Sat Jun 10 18:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.93799999999999994,"15min":0.95399999999999996},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.1259999999999999,"5min":1.198,"15min":1.198},"last":1.081},{"interface":"front","average":{"1min":0.95699999999999996,"5min":1.0049999999999999,"15min":1.0189999999999999},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.1879999999999999,"5min":1.222,"15min":1.222},"last":1.117}]},{"osd":5,"last update":"Sat Jun 10 18:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.94999999999999996,"15min":0.96199999999999997},"min":{"1min":0.68700000000000006,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.0720000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.77600000000000002},{"interface":"front","average":{"1min":1.02,"5min":1.0249999999999999,"15min":1.026},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":1.2270000000000001}]},{"osd":7,"last update":"Sat Jun 10 18:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":1.0389999999999999,"15min":1.0489999999999999},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.1739999999999999,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":1.1910000000000001},{"interface":"front","average":{"1min":1.022,"5min":1.0569999999999999,"15min":1.0649999999999999},"min":{"1min":0.82199999999999995,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.2010000000000001,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":1.002}]}]},{"osd":5,"up_from":13,"seq":55834574900,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27564,"kb_used_data":612,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344276,"statfs":{"total":96636764160,"available":96608538624,"internally_reserved":0,"allocated":626688,"data_stored":273684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.84199999999999997,"15min":0.82999999999999996},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.139,"5min":1.175,"15min":1.175},"last":1.0129999999999999},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.91800000000000004,"15min":0.94199999999999995},"min":{"1min":0.63800000000000001,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.246,"5min":1.637,"15min":1.637},"last":0.58799999999999997}]},{"osd":1,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.91000000000000003,"15min":0.91800000000000004},"min":{"1min":0.67800000000000005,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.1559999999999999,"5min":1.335,"15min":1.335},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.91700000000000004,"15min":0.92100000000000004},"min":{"1min":0.72699999999999998,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.208,"5min":1.78,"15min":1.78},"last":0.68300000000000005}]},{"osd":2,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.65000000000000002,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.1000000000000001,"5min":1.446,"15min":1.446},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.91600000000000004,"15min":0.91200000000000003},"min":{"1min":0.71399999999999997,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.1379999999999999,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.78300000000000003}]},{"osd":3,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93899999999999995,"15min":0.94499999999999995},"min":{"1min":0.68600000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.206,"5min":1.484,"15min":1.484},"last":1.123},{"interface":"front","average":{"1min":0.97199999999999998,"5min":1.0249999999999999,"15min":1.0429999999999999},"min":{"1min":0.77100000000000002,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.2969999999999999,"5min":1.337,"15min":1.337},"last":0.82299999999999995}]},{"osd":4,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.96999999999999997,"15min":0.98899999999999999},"min":{"1min":0.70299999999999996,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.2669999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.94599999999999995,"5min":1.034,"15min":1.0640000000000001},"min":{"1min":0.66500000000000004,"5min":0.629,"15min":0.629},"max":{"1min":1.26,"5min":1.575,"15min":1.575},"last":1.181}]},{"osd":6,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":1.038,"15min":1.0780000000000001},"min":{"1min":0.66000000000000003,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.2010000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.92500000000000004},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.0609999999999999,"15min":1.079},"min":{"1min":0.69799999999999995,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.2270000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.96699999999999997}]},{"osd":7,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.139,"15min":1.1739999999999999},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.226,"5min":1.873,"15min":1.873},"last":1.224},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.155,"15min":1.181},"min":{"1min":0.80000000000000004,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.3680000000000001,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.0669999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574899,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27568,"kb_used_data":616,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344272,"statfs":{"total":96636764160,"available":96608534528,"internally_reserved":0,"allocated":630784,"data_stored":274266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.76700000000000002,"15min":0.745},"min":{"1min":0.53400000000000003,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.1599999999999999,"5min":1.2,"15min":1.2},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.88200000000000001,"15min":0.88},"min":{"1min":0.63800000000000001,"5min":0.504,"15min":0.504},"max":{"1min":1.4970000000000001,"5min":1.73,"15min":1.73},"last":0.84099999999999997}]},{"osd":1,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.95199999999999996,"15min":0.95499999999999996},"min":{"1min":0.68200000000000005,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.84599999999999997,"15min":0.83699999999999997},"min":{"1min":0.66600000000000004,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.024,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.90400000000000003}]},{"osd":2,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.879,"15min":0.875},"min":{"1min":0.70799999999999996,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":1.036},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1,"15min":1.004},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":1.0900000000000001}]},{"osd":3,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.89900000000000002,"15min":0.88},"min":{"1min":0.80900000000000005,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.1679999999999999,"5min":1.22,"15min":1.22},"last":0.996},{"interface":"front","average":{"1min":1.006,"5min":0.95799999999999996,"15min":0.95099999999999996},"min":{"1min":0.80100000000000005,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.4490000000000001,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.153}]},{"osd":5,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.96799999999999997,"15min":0.99399999999999999},"min":{"1min":0.67800000000000005,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.069,"5min":1.663,"15min":1.663},"last":1.27},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.95399999999999996,"15min":0.98199999999999998},"min":{"1min":0.58099999999999996,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.111,"5min":1.353,"15min":1.353},"last":1.2150000000000001}]},{"osd":6,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":1.002,"15min":1.028},"min":{"1min":0.63100000000000001,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.5720000000000001,"5min":2.2639999999999998,"15min":2.2639999999999998},"last":1.242},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0720000000000001,"15min":1.0760000000000001},"min":{"1min":0.81200000000000006,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":1.1859999999999999}]},{"osd":7,"last update":"Sat Jun 10 18:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.98399999999999999,"15min":0.99399999999999999},"min":{"1min":0.68899999999999995,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.1950000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":1.1299999999999999},{"interface":"front","average":{"1min":1.012,"5min":1.0529999999999999,"15min":1.071},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.2390000000000001,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":1.3}]}]},{"osd":3,"up_from":13,"seq":55834574898,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31672,"kb_used_data":624,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340168,"statfs":{"total":96636764160,"available":96604332032,"internally_reserved":0,"allocated":638976,"data_stored":274251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.57799999999999996,"15min":0.57199999999999995},"min":{"1min":0.51400000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.63500000000000001,"15min":0.63100000000000001},"min":{"1min":0.56000000000000005,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.69999999999999996}]},{"osd":1,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.64400000000000002,"15min":0.622},"min":{"1min":0.51000000000000001,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.72099999999999997,"15min":0.71599999999999997},"min":{"1min":0.56100000000000005,"5min":0.318,"15min":0.318},"max":{"1min":0.98899999999999999,"5min":1.411,"15min":1.411},"last":1.143}]},{"osd":2,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.76100000000000001,"15min":0.75},"min":{"1min":0.63500000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.167,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":0.753},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.75900000000000001,"15min":0.74199999999999999},"min":{"1min":0.65200000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.1970000000000001,"5min":1.264,"15min":1.264},"last":0.80200000000000005}]},{"osd":4,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96099999999999997,"15min":0.96899999999999997},"min":{"1min":0.79800000000000004,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.3089999999999999,"5min":1.488,"15min":1.488},"last":0.84299999999999997},{"interface":"front","average":{"1min":1.052,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.82099999999999995,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.345,"5min":1.458,"15min":1.458},"last":1.1879999999999999}]},{"osd":5,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.0369999999999999,"15min":1.0589999999999999},"min":{"1min":0.80400000000000005,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.268,"5min":2.024,"15min":2.024},"last":0.874},{"interface":"front","average":{"1min":1.101,"5min":1.026,"15min":1.014},"min":{"1min":0.83899999999999997,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.29,"5min":1.724,"15min":1.724},"last":1.2330000000000001}]},{"osd":6,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.0489999999999999,"15min":1.0469999999999999},"min":{"1min":0.92400000000000004,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.3300000000000001,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.071,"5min":1.0589999999999999,"15min":1.0720000000000001},"min":{"1min":0.90700000000000003,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.302,"5min":1.78,"15min":1.78},"last":1.016}]},{"osd":7,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.101,"15min":1.1279999999999999},"min":{"1min":0.82799999999999996,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.3959999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.212,"5min":1.089,"15min":1.0740000000000001},"min":{"1min":1.0049999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.468,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":1.0489999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574899,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31672,"kb_used_data":624,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340168,"statfs":{"total":96636764160,"available":96604332032,"internally_reserved":0,"allocated":638976,"data_stored":275248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.60099999999999998,"15min":0.58799999999999997},"min":{"1min":0.498,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.97799999999999998,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.50800000000000001,"5min":0.378,"15min":0.378},"max":{"1min":1.024,"5min":1.224,"15min":1.224},"last":0.73299999999999998}]},{"osd":1,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.65000000000000002,"15min":0.64600000000000002},"min":{"1min":0.53400000000000003,"5min":0.307,"15min":0.307},"max":{"1min":0.89500000000000002,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.72299999999999998,"15min":0.68999999999999995},"min":{"1min":0.64700000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.92100000000000004}]},{"osd":3,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.73599999999999999,"15min":0.70599999999999996},"min":{"1min":0.64900000000000002,"5min":0.377,"15min":0.377},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":1.0609999999999999},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.749,"15min":0.746},"min":{"1min":0.64700000000000002,"5min":0.252,"15min":0.252},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.80600000000000005}]},{"osd":4,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.91900000000000004,"15min":0.91500000000000004},"min":{"1min":0.81000000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.097,"5min":1.0349999999999999,"15min":1.038},"min":{"1min":0.88600000000000001,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.476,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":1.0289999999999999}]},{"osd":5,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.016,"15min":1.016},"min":{"1min":0.82699999999999996,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.379,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":1.1319999999999999},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.002,"15min":0.97799999999999998},"min":{"1min":0.77100000000000002,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.377,"5min":1.667,"15min":1.667},"last":1.194}]},{"osd":6,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.0429999999999999,"15min":1.0229999999999999},"min":{"1min":0.84299999999999997,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.3049999999999999,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":1.264},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.034,"15min":1.032},"min":{"1min":0.89400000000000002,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.4299999999999999,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":1.169}]},{"osd":7,"last update":"Sat Jun 10 18:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.099,"15min":1.099},"min":{"1min":0.82399999999999995,"5min":0.62,"15min":0.62},"max":{"1min":1.4339999999999999,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.234},{"interface":"front","average":{"1min":1.153,"5min":1.0980000000000001,"15min":1.0760000000000001},"min":{"1min":0.95499999999999996,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.4239999999999999,"5min":1.752,"15min":1.752},"last":1.425}]}]},{"osd":1,"up_from":13,"seq":55834574901,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31664,"kb_used_data":616,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340176,"statfs":{"total":96636764160,"available":96604340224,"internally_reserved":0,"allocated":630784,"data_stored":272825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.67100000000000004,"15min":0.66100000000000003},"min":{"1min":0.47999999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.71999999999999997,"15min":0.68600000000000005},"min":{"1min":0.63400000000000001,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.0369999999999999,"5min":1.694,"15min":1.694},"last":0.77300000000000002}]},{"osd":2,"last update":"Sat Jun 10 18:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.64400000000000002,"15min":0.623},"min":{"1min":0.53500000000000003,"5min":0.249,"15min":0.249},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.877,"5min":0.70199999999999996,"15min":0.65800000000000003},"min":{"1min":0.65600000000000003,"5min":0.315,"15min":0.315},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":0.89900000000000002}]},{"osd":3,"last update":"Sat Jun 10 18:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.77800000000000002,"15min":0.745},"min":{"1min":0.65900000000000003,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.76100000000000001,"15min":0.749},"min":{"1min":0.58499999999999996,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.1100000000000001,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":0.96899999999999997}]},{"osd":4,"last update":"Sat Jun 10 18:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.87,"15min":0.83599999999999997},"min":{"1min":0.73399999999999999,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.85899999999999999},{"interface":"front","average":{"1min":1.087,"5min":1.1160000000000001,"15min":1.079},"min":{"1min":0.78500000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.5449999999999999,"5min":5.8209999999999997,"15min":5.8209999999999997},"last":1.149}]},{"osd":5,"last update":"Sat Jun 10 18:55:44 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.032,"15min":1.028},"min":{"1min":0.75800000000000001,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.4550000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":1.125},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0129999999999999,"15min":0.97099999999999997},"min":{"1min":0.754,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.3819999999999999,"5min":3.089,"15min":3.089},"last":1.111}]},{"osd":6,"last update":"Sat Jun 10 18:55:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.105,"15min":1.0309999999999999},"min":{"1min":0.75900000000000001,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.5249999999999999,"5min":7.2599999999999998,"15min":7.2599999999999998},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.081,"5min":1.107,"15min":1.0309999999999999},"min":{"1min":0.80800000000000005,"5min":0.622,"15min":0.622},"max":{"1min":1.591,"5min":9.0069999999999997,"15min":9.0069999999999997},"last":1.0409999999999999}]},{"osd":7,"last update":"Sat Jun 10 18:55:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.0980000000000001,"15min":1.083},"min":{"1min":0.89300000000000002,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.6879999999999999,"5min":2.105,"15min":2.105},"last":1.3440000000000001},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.085,"15min":1.0669999999999999},"min":{"1min":0.90200000000000002,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.573,"5min":2.2570000000000001,"15min":2.2570000000000001},"last":1.1739999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574900,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32244,"kb_used_data":1196,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339596,"statfs":{"total":96636764160,"available":96603746304,"internally_reserved":0,"allocated":1224704,"data_stored":863089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.61299999999999999,"15min":0.59899999999999998},"min":{"1min":0.51000000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.63},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.77200000000000002,"15min":0.746},"min":{"1min":0.70899999999999996,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.0469999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.57299999999999995}]},{"osd":2,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.71099999999999997,"15min":0.69799999999999995},"min":{"1min":0.51900000000000002,"5min":0.313,"15min":0.313},"max":{"1min":1.0269999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.433},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.64600000000000002,"15min":0.63},"min":{"1min":0.55700000000000005,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.96799999999999997,"5min":1.371,"15min":1.371},"last":0.54400000000000004}]},{"osd":3,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.68200000000000005,"15min":0.67000000000000004},"min":{"1min":0.55800000000000005,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.1930000000000001,"5min":1.226,"15min":1.226},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.82899999999999996,"15min":0.81000000000000005},"min":{"1min":0.65800000000000003,"5min":0.375,"15min":0.375},"max":{"1min":1.262,"5min":1.829,"15min":1.829},"last":0.52000000000000002}]},{"osd":4,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.90000000000000002,"15min":0.88900000000000001},"min":{"1min":0.75600000000000001,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.1579999999999999,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.0369999999999999,"15min":1.034},"min":{"1min":0.86099999999999999,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.228,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":0.73599999999999999}]},{"osd":5,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.96099999999999997,"15min":0.95799999999999996},"min":{"1min":0.67300000000000004,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.351,"5min":1.694,"15min":1.694},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.99099999999999999,"5min":1,"15min":0.998},"min":{"1min":0.72999999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.1870000000000001,"5min":1.75,"15min":1.75},"last":0.75700000000000001}]},{"osd":6,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.0700000000000001,"15min":1.056},"min":{"1min":0.93899999999999995,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.331,"5min":2.04,"15min":2.04},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.0409999999999999,"5min":0.996,"15min":0.997},"min":{"1min":0.76100000000000001,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.444,"5min":1.883,"15min":1.883},"last":0.81999999999999995}]},{"osd":7,"last update":"Sat Jun 10 18:55:37 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.0369999999999999,"15min":1.0329999999999999},"min":{"1min":0.77200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.397,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.78300000000000003},{"interface":"front","average":{"1min":1.077,"5min":1.056,"15min":1.05},"min":{"1min":0.93200000000000005,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.298,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":0.80300000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-10T18:56:36.613 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-06-10T18:56:36.614 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-06-10T18:56:36.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.783+0000 7fb6e17e3640 1 Processor -- start 2023-06-10T18:56:36.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.783+0000 7fb6e17e3640 1 -- start start 2023-06-10T18:56:36.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.783+0000 7fb6e17e3640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb6dc15c870 0x7fb6dc0c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:36.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.783+0000 7fb6e17e3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb6dc0cd6a0 0x7fb6dc0cbe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:36.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.783+0000 7fb6e17e3640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6dc0cc3c0 con 0x7fb6dc158550 2023-06-10T18:56:36.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.783+0000 7fb6e17e3640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6dc0c9450 con 0x7fb6dc15c870 2023-06-10T18:56:36.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.783+0000 7fb6e17e3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6dc0cdb40 con 0x7fb6dc0cd6a0 2023-06-10T18:56:36.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.783+0000 7fb6da7fc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb6dc15c870 0x7fb6dc0c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:36.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.783+0000 7fb6daffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fb6dc158550 0x7fb6dc15c160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:59622/0 (socket says 172.21.15.53:59622) 2023-06-10T18:56:36.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.783+0000 7fb6daffd640 1 -- 172.21.15.53:0/1387267549 learned_addr learned my addr 172.21.15.53:0/1387267549 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:56:36.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.783+0000 7fb6db7fe640 1 --2- 172.21.15.53:0/1387267549 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb6dc0cd6a0 0x7fb6dc0cbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:36.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.783+0000 7fb6da7fc640 1 -- 172.21.15.53:0/1387267549 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb6dc0cd6a0 msgr2=0x7fb6dc0cbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:36.791 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.783+0000 7fb6da7fc640 1 --2- 172.21.15.53:0/1387267549 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb6dc0cd6a0 0x7fb6dc0cbe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:36.791 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.783+0000 7fb6da7fc640 1 -- 172.21.15.53:0/1387267549 >> v1:172.21.15.53:6789/0 conn(0x7fb6dc158550 legacy=0x7fb6dc15c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:36.791 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.783+0000 7fb6d9ffb640 1 -- 172.21.15.53:0/1387267549 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1486041849 0 0) 0x7fb6cc001120 con 0x7fb6dc158550 2023-06-10T18:56:36.791 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.783+0000 7fb6da7fc640 1 -- 172.21.15.53:0/1387267549 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6dc0cc600 con 0x7fb6dc15c870 2023-06-10T18:56:36.791 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.783+0000 7fb6db7fe640 1 --2- 172.21.15.53:0/1387267549 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb6dc0cd6a0 0x7fb6dc0cbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:56:36.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.787+0000 7fb6da7fc640 1 --2- 172.21.15.53:0/1387267549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6dc15c870 0x7fb6dc0c8f10 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fb6d00097c0 tx=0x7fb6d001ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3d0535d74e3a6c0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:36.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.787+0000 7fb6d9ffb640 1 -- 172.21.15.53:0/1387267549 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d00a8970 con 0x7fb6dc15c870 2023-06-10T18:56:36.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.787+0000 7fb6d9ffb640 1 -- 172.21.15.53:0/1387267549 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6d00a8ad0 con 0x7fb6dc15c870 2023-06-10T18:56:36.793 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.787+0000 7fb6d9ffb640 1 -- 172.21.15.53:0/1387267549 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d00a8e60 con 0x7fb6dc15c870 2023-06-10T18:56:36.793 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.787+0000 7fb6e17e3640 1 -- 172.21.15.53:0/1387267549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6dc15c870 msgr2=0x7fb6dc0c8f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:36.793 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.787+0000 7fb6e17e3640 1 --2- 172.21.15.53:0/1387267549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6dc15c870 0x7fb6dc0c8f10 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fb6d00097c0 tx=0x7fb6d001ec70 comp rx=0 tx=0).stop 2023-06-10T18:56:36.793 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.787+0000 7fb6e17e3640 1 -- 172.21.15.53:0/1387267549 shutdown_connections 2023-06-10T18:56:36.793 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.787+0000 7fb6e17e3640 1 --2- 172.21.15.53:0/1387267549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6dc15c870 0x7fb6dc0c8f10 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:36.793 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.787+0000 7fb6e17e3640 1 --2- 172.21.15.53:0/1387267549 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb6dc0cd6a0 0x7fb6dc0cbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:36.793 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.787+0000 7fb6e17e3640 1 -- 172.21.15.53:0/1387267549 >> 172.21.15.53:0/1387267549 conn(0x7fb6dc06a0e0 msgr2=0x7fb6dc0ca810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:36.794 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.787+0000 7fb6e17e3640 1 -- 172.21.15.53:0/1387267549 shutdown_connections 2023-06-10T18:56:36.794 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.787+0000 7fb6e17e3640 1 -- 172.21.15.53:0/1387267549 wait complete. 2023-06-10T18:56:36.795 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.787+0000 7fb6e17e3640 1 Processor -- start 2023-06-10T18:56:36.795 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.787+0000 7fb6e17e3640 1 -- start start 2023-06-10T18:56:36.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.791+0000 7fb6e17e3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb6dc0cd6a0 0x7fb6dc15b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:36.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.791+0000 7fb6e17e3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb6dc158550 0x7fb6dc153600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:36.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.791+0000 7fb6e17e3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6dc15c870 0x7fb6dc1f0f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:36.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.791+0000 7fb6e17e3640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6dc15ad40 con 0x7fb6dc15c870 2023-06-10T18:56:36.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.791+0000 7fb6e17e3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6dc1541a0 con 0x7fb6dc0cd6a0 2023-06-10T18:56:36.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.791+0000 7fb6e17e3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6dc15b780 con 0x7fb6dc158550 2023-06-10T18:56:36.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.791+0000 7fb6db7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6dc15c870 0x7fb6dc1f0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:36.797 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.791+0000 7fb6db7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6dc15c870 0x7fb6dc1f0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53152/0 (socket says 172.21.15.53:53152) 2023-06-10T18:56:36.797 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.791+0000 7fb6db7fe640 1 -- 172.21.15.53:0/1239642931 learned_addr learned my addr 172.21.15.53:0/1239642931 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:36.797 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.791+0000 7fb6db7fe640 1 -- 172.21.15.53:0/1239642931 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb6dc158550 msgr2=0x7fb6dc153600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:36.797 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.791+0000 7fb6da7fc640 1 --2- 172.21.15.53:0/1239642931 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb6dc158550 0x7fb6dc153600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:36.797 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.791+0000 7fb6daffd640 1 --2- 172.21.15.53:0/1239642931 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb6dc0cd6a0 0x7fb6dc15b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:36.797 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.791+0000 7fb6db7fe640 1 --2- 172.21.15.53:0/1239642931 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb6dc158550 0x7fb6dc153600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:36.797 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.791+0000 7fb6db7fe640 1 -- 172.21.15.53:0/1239642931 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb6dc0cd6a0 msgr2=0x7fb6dc15b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:36.798 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.791+0000 7fb6db7fe640 1 --2- 172.21.15.53:0/1239642931 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb6dc0cd6a0 0x7fb6dc15b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:36.798 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.791+0000 7fb6db7fe640 1 -- 172.21.15.53:0/1239642931 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6d0009420 con 0x7fb6dc15c870 2023-06-10T18:56:36.798 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.791+0000 7fb6daffd640 1 --2- 172.21.15.53:0/1239642931 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb6dc0cd6a0 0x7fb6dc15b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:56:36.798 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.791+0000 7fb6db7fe640 1 --2- 172.21.15.53:0/1239642931 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6dc15c870 0x7fb6dc1f0f20 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fb6d400cef0 tx=0x7fb6d400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:36.798 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.791+0000 7fb6c37fe640 1 -- 172.21.15.53:0/1239642931 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d400d840 con 0x7fb6dc15c870 2023-06-10T18:56:36.798 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.791+0000 7fb6c37fe640 1 -- 172.21.15.53:0/1239642931 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6d400d9c0 con 0x7fb6dc15c870 2023-06-10T18:56:36.799 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.791+0000 7fb6c37fe640 1 -- 172.21.15.53:0/1239642931 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d400dd70 con 0x7fb6dc15c870 2023-06-10T18:56:36.799 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.791+0000 7fb6e17e3640 1 -- 172.21.15.53:0/1239642931 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6dc159de0 con 0x7fb6dc15c870 2023-06-10T18:56:36.799 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.791+0000 7fb6e17e3640 1 -- 172.21.15.53:0/1239642931 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6dc159b00 con 0x7fb6dc15c870 2023-06-10T18:56:36.800 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.791+0000 7fb6e17e3640 1 -- 172.21.15.53:0/1239642931 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6dc04d790 con 0x7fb6dc15c870 2023-06-10T18:56:36.800 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.791+0000 7fb6c37fe640 1 -- 172.21.15.53:0/1239642931 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb6d401e3b0 con 0x7fb6dc15c870 2023-06-10T18:56:36.800 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.791+0000 7fb6c37fe640 1 --2- 172.21.15.53:0/1239642931 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb6c8066280 0x7fb6c8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:36.800 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.795+0000 7fb6c37fe640 1 -- 172.21.15.53:0/1239642931 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fb6d4084780 con 0x7fb6dc15c870 2023-06-10T18:56:36.800 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.795+0000 7fb6daffd640 1 --2- 172.21.15.53:0/1239642931 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb6c8066280 0x7fb6c8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:36.800 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.795+0000 7fb6daffd640 1 --2- 172.21.15.53:0/1239642931 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb6c8066280 0x7fb6c8068730 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc007fd0 tx=0x7fb6cc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:36.801 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:36.798+0000 7fb6c37fe640 1 -- 172.21.15.53:0/1239642931 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb6d4051d10 con 0x7fb6dc15c870 2023-06-10T18:56:37.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.006+0000 7fb6e17e3640 1 -- 172.21.15.53:0/1239642931 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fb6dc0cba30 con 0x7fb6dc15c870 2023-06-10T18:56:37.022 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.014+0000 7fb6c37fe640 1 -- 172.21.15.53:0/1239642931 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v12) v1 ==== 190+0+0 (secure 0 0 0) 0x7fb6d4055330 con 0x7fb6dc15c870 2023-06-10T18:56:37.022 INFO:teuthology.orchestra.run.smithi053.stderr:updated caps for client.0 2023-06-10T18:56:37.024 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.018+0000 7fb6e17e3640 1 -- 172.21.15.53:0/1239642931 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb6c8066280 msgr2=0x7fb6c8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:37.024 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.018+0000 7fb6e17e3640 1 --2- 172.21.15.53:0/1239642931 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb6c8066280 0x7fb6c8068730 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc007fd0 tx=0x7fb6cc009040 comp rx=0 tx=0).stop 2023-06-10T18:56:37.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.018+0000 7fb6e17e3640 1 -- 172.21.15.53:0/1239642931 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6dc15c870 msgr2=0x7fb6dc1f0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:37.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.018+0000 7fb6e17e3640 1 --2- 172.21.15.53:0/1239642931 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6dc15c870 0x7fb6dc1f0f20 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fb6d400cef0 tx=0x7fb6d400a710 comp rx=0 tx=0).stop 2023-06-10T18:56:37.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.018+0000 7fb6e17e3640 1 -- 172.21.15.53:0/1239642931 shutdown_connections 2023-06-10T18:56:37.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.018+0000 7fb6e17e3640 1 --2- 172.21.15.53:0/1239642931 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb6c8066280 0x7fb6c8068730 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:37.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.018+0000 7fb6e17e3640 1 --2- 172.21.15.53:0/1239642931 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6dc15c870 0x7fb6dc1f0f20 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:37.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.018+0000 7fb6e17e3640 1 --2- 172.21.15.53:0/1239642931 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb6dc158550 0x7fb6dc153600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:37.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.018+0000 7fb6e17e3640 1 --2- 172.21.15.53:0/1239642931 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb6dc0cd6a0 0x7fb6dc15b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:37.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.018+0000 7fb6e17e3640 1 -- 172.21.15.53:0/1239642931 >> 172.21.15.53:0/1239642931 conn(0x7fb6dc06a0e0 msgr2=0x7fb6dc15c150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:37.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.018+0000 7fb6e17e3640 1 -- 172.21.15.53:0/1239642931 shutdown_connections 2023-06-10T18:56:37.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.018+0000 7fb6e17e3640 1 -- 172.21.15.53:0/1239642931 wait complete. 2023-06-10T18:56:37.042 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T18:56:37.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.154+0000 7f76e31a6640 1 Processor -- start 2023-06-10T18:56:37.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.158+0000 7f76e31a6640 1 -- start start 2023-06-10T18:56:37.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.158+0000 7f76e31a6640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f76dc0cc690 0x7f76dc0d04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:37.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.158+0000 7f76e31a6640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f76dc0ccae0 0x7f76dc0d09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:37.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.158+0000 7f76e31a6640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76dc0d0020 con 0x7f76dc0b3ac0 2023-06-10T18:56:37.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.158+0000 7f76e31a6640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76dc0cef40 con 0x7f76dc0cc690 2023-06-10T18:56:37.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.158+0000 7f76e31a6640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76dc0cf220 con 0x7f76dc0ccae0 2023-06-10T18:56:37.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.158+0000 7f76dbfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f76dc0cc690 0x7f76dc0d04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:37.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.158+0000 7f76dbfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f76dc0cc690 0x7f76dc0d04b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53160/0 (socket says 172.21.15.53:53160) 2023-06-10T18:56:37.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.158+0000 7f76dbfff640 1 -- 172.21.15.53:0/4159937976 learned_addr learned my addr 172.21.15.53:0/4159937976 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:37.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.158+0000 7f76e1743640 1 --2- 172.21.15.53:0/4159937976 >> v2:172.21.15.117:3300/0 conn(0x7f76dc0ccae0 0x7f76dc0d09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:37.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.158+0000 7f76dbfff640 1 -- 172.21.15.53:0/4159937976 >> v2:172.21.15.117:3300/0 conn(0x7f76dc0ccae0 msgr2=0x7f76dc0d09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:37.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.158+0000 7f76dbfff640 1 --2- 172.21.15.53:0/4159937976 >> v2:172.21.15.117:3300/0 conn(0x7f76dc0ccae0 0x7f76dc0d09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:37.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.158+0000 7f76dbfff640 1 -- 172.21.15.53:0/4159937976 >> v1:172.21.15.117:6789/0 conn(0x7f76dc0b3ac0 legacy=0x7f76dc0b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:37.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.158+0000 7f76dbfff640 1 -- 172.21.15.53:0/4159937976 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76dc0cf500 con 0x7f76dc0cc690 2023-06-10T18:56:37.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.158+0000 7f76dbfff640 1 --2- 172.21.15.53:0/4159937976 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76dc0cc690 0x7f76dc0d04b0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f76dc160410 tx=0x7f76d001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e833e54bad59aaa4 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:37.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.162+0000 7f76db7fe640 1 -- 172.21.15.53:0/4159937976 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d00ac600 con 0x7f76dc0cc690 2023-06-10T18:56:37.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.162+0000 7f76db7fe640 1 -- 172.21.15.53:0/4159937976 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76d00a8050 con 0x7f76dc0cc690 2023-06-10T18:56:37.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.162+0000 7f76db7fe640 1 -- 172.21.15.53:0/4159937976 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d00ac980 con 0x7f76dc0cc690 2023-06-10T18:56:37.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.162+0000 7f76e31a6640 1 -- 172.21.15.53:0/4159937976 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76dc0cc690 msgr2=0x7f76dc0d04b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:37.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.162+0000 7f76e31a6640 1 --2- 172.21.15.53:0/4159937976 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76dc0cc690 0x7f76dc0d04b0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f76dc160410 tx=0x7f76d001c490 comp rx=0 tx=0).stop 2023-06-10T18:56:37.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.162+0000 7f76e31a6640 1 -- 172.21.15.53:0/4159937976 shutdown_connections 2023-06-10T18:56:37.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.162+0000 7f76e31a6640 1 --2- 172.21.15.53:0/4159937976 >> v2:172.21.15.117:3300/0 conn(0x7f76dc0ccae0 0x7f76dc0d09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:37.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.162+0000 7f76e31a6640 1 --2- 172.21.15.53:0/4159937976 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76dc0cc690 0x7f76dc0d04b0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:37.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.162+0000 7f76e31a6640 1 -- 172.21.15.53:0/4159937976 >> 172.21.15.53:0/4159937976 conn(0x7f76dc071790 msgr2=0x7f76dc069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:37.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.162+0000 7f76e31a6640 1 -- 172.21.15.53:0/4159937976 shutdown_connections 2023-06-10T18:56:37.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.162+0000 7f76e31a6640 1 -- 172.21.15.53:0/4159937976 wait complete. 2023-06-10T18:56:37.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.162+0000 7f76e31a6640 1 Processor -- start 2023-06-10T18:56:37.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.162+0000 7f76e31a6640 1 -- start start 2023-06-10T18:56:37.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.162+0000 7f76e31a6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f76dc0b3ac0 0x7f76dc0c8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:37.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.162+0000 7f76e31a6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76dc0cc690 0x7f76dc0c5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:37.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.162+0000 7f76e31a6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f76dc0ccae0 0x7f76dc0c60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:37.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.162+0000 7f76e31a6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76dc15e870 con 0x7f76dc0cc690 2023-06-10T18:56:37.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.162+0000 7f76e31a6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76dc1f71d0 con 0x7f76dc0ccae0 2023-06-10T18:56:37.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.162+0000 7f76e31a6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76dc15d7d0 con 0x7f76dc0b3ac0 2023-06-10T18:56:37.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.162+0000 7f76dbfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76dc0cc690 0x7f76dc0c5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:37.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.162+0000 7f76dbfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76dc0cc690 0x7f76dc0c5b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53168/0 (socket says 172.21.15.53:53168) 2023-06-10T18:56:37.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.162+0000 7f76dbfff640 1 -- 172.21.15.53:0/714585006 learned_addr learned my addr 172.21.15.53:0/714585006 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:37.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.162+0000 7f76e0f42640 1 --2- 172.21.15.53:0/714585006 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f76dc0b3ac0 0x7f76dc0c8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:37.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.162+0000 7f76e1743640 1 --2- 172.21.15.53:0/714585006 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f76dc0ccae0 0x7f76dc0c60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:37.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.162+0000 7f76dbfff640 1 -- 172.21.15.53:0/714585006 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f76dc0b3ac0 msgr2=0x7f76dc0c8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:37.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.162+0000 7f76dbfff640 1 --2- 172.21.15.53:0/714585006 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f76dc0b3ac0 0x7f76dc0c8270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:37.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.162+0000 7f76dbfff640 1 -- 172.21.15.53:0/714585006 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f76dc0ccae0 msgr2=0x7f76dc0c60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:37.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.162+0000 7f76dbfff640 1 --2- 172.21.15.53:0/714585006 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f76dc0ccae0 0x7f76dc0c60b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:37.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.162+0000 7f76dbfff640 1 -- 172.21.15.53:0/714585006 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76d00094d0 con 0x7f76dc0cc690 2023-06-10T18:56:37.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.162+0000 7f76dbfff640 1 --2- 172.21.15.53:0/714585006 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76dc0cc690 0x7f76dc0c5b70 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f76d001a0c0 tx=0x7f76d001acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:37.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.166+0000 7f76d97fa640 1 -- 172.21.15.53:0/714585006 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d00b7620 con 0x7f76dc0cc690 2023-06-10T18:56:37.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.166+0000 7f76d97fa640 1 -- 172.21.15.53:0/714585006 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76d00b7780 con 0x7f76dc0cc690 2023-06-10T18:56:37.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.166+0000 7f76e31a6640 1 -- 172.21.15.53:0/714585006 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76dc15dab0 con 0x7f76dc0cc690 2023-06-10T18:56:37.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.166+0000 7f76d97fa640 1 -- 172.21.15.53:0/714585006 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d00b7af0 con 0x7f76dc0cc690 2023-06-10T18:56:37.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.166+0000 7f76e31a6640 1 -- 172.21.15.53:0/714585006 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76dc15e070 con 0x7f76dc0cc690 2023-06-10T18:56:37.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.166+0000 7f76e31a6640 1 -- 172.21.15.53:0/714585006 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76dc04d790 con 0x7f76dc0cc690 2023-06-10T18:56:37.175 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.166+0000 7f76d97fa640 1 -- 172.21.15.53:0/714585006 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f76d00b3040 con 0x7f76dc0cc690 2023-06-10T18:56:37.175 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.166+0000 7f76d97fa640 1 --2- 172.21.15.53:0/714585006 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f76c80662b0 0x7f76c8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:37.175 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.166+0000 7f76d97fa640 1 -- 172.21.15.53:0/714585006 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f76d011deb0 con 0x7f76dc0cc690 2023-06-10T18:56:37.175 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.166+0000 7f76e0f42640 1 --2- 172.21.15.53:0/714585006 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f76c80662b0 0x7f76c8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:37.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.166+0000 7f76e0f42640 1 --2- 172.21.15.53:0/714585006 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f76c80662b0 0x7f76c8068760 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f76cc007fd0 tx=0x7f76cc007e40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:37.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.170+0000 7f76d97fa640 1 -- 172.21.15.53:0/714585006 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f76d00eb3a0 con 0x7f76dc0cc690 2023-06-10T18:56:37.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.358+0000 7f76e31a6640 1 -- 172.21.15.53:0/714585006 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f76dc08a200 con 0x7f76dc0cc690 2023-06-10T18:56:37.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.358+0000 7f76d97fa640 1 -- 172.21.15.53:0/714585006 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+4674 (secure 0 0 0) 0x7f76d00ee9c0 con 0x7f76dc0cc690 2023-06-10T18:56:37.366 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:56:37.366 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":20,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5168,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/275593879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":275593879},{"type":"v1","addr":"172.21.15.117:6837","nonce":275593879}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5422,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/2837986258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2837986258},{"type":"v1","addr":"172.21.15.117:6836","nonce":2837986258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5928,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/2789082937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2789082937},{"type":"v1","addr":"172.21.15.53:6833","nonce":2789082937}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T18:56:18.681744+0000","modified":"2023-06-10T18:56:21.825431+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5931},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5931":{"gid":5931,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/3463677034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":3463677034},{"type":"v1","addr":"172.21.15.53:6835","nonce":3463677034}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-06-10T18:56:37.367 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 20 2023-06-10T18:56:37.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.362+0000 7f76e31a6640 1 -- 172.21.15.53:0/714585006 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f76c80662b0 msgr2=0x7f76c8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:37.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.362+0000 7f76e31a6640 1 --2- 172.21.15.53:0/714585006 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f76c80662b0 0x7f76c8068760 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f76cc007fd0 tx=0x7f76cc007e40 comp rx=0 tx=0).stop 2023-06-10T18:56:37.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.362+0000 7f76e31a6640 1 -- 172.21.15.53:0/714585006 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76dc0cc690 msgr2=0x7f76dc0c5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:37.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.362+0000 7f76e31a6640 1 --2- 172.21.15.53:0/714585006 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76dc0cc690 0x7f76dc0c5b70 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f76d001a0c0 tx=0x7f76d001acd0 comp rx=0 tx=0).stop 2023-06-10T18:56:37.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.362+0000 7f76e31a6640 1 -- 172.21.15.53:0/714585006 shutdown_connections 2023-06-10T18:56:37.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.362+0000 7f76e31a6640 1 --2- 172.21.15.53:0/714585006 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f76c80662b0 0x7f76c8068760 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:37.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.362+0000 7f76e31a6640 1 --2- 172.21.15.53:0/714585006 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f76dc0ccae0 0x7f76dc0c60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:37.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.362+0000 7f76e31a6640 1 --2- 172.21.15.53:0/714585006 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76dc0cc690 0x7f76dc0c5b70 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:37.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.362+0000 7f76e31a6640 1 --2- 172.21.15.53:0/714585006 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f76dc0b3ac0 0x7f76dc0c8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:37.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.362+0000 7f76e31a6640 1 -- 172.21.15.53:0/714585006 >> 172.21.15.53:0/714585006 conn(0x7f76dc071790 msgr2=0x7f76dc15f940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:37.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.362+0000 7f76e31a6640 1 -- 172.21.15.53:0/714585006 shutdown_connections 2023-06-10T18:56:37.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.362+0000 7f76e31a6640 1 -- 172.21.15.53:0/714585006 wait complete. 2023-06-10T18:56:37.788 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 20, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-06-10T18:56:18.681744+0000', 'modified': '2023-06-10T18:56:21.825431+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5931}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5931': {'gid': 5931, 'name': 'c', 'rank': 0, 'incarnation': 17, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.53:6835/3463677034', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.53:6834', 'nonce': 3463677034}, {'type': 'v1', 'addr': '172.21.15.53:6835', 'nonce': 3463677034}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-06-10T18:56:37.788 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-06-10T18:56:37.789 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-06-10T18:56:37.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.918+0000 7efd1c3f7640 1 Processor -- start 2023-06-10T18:56:37.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.918+0000 7efd1c3f7640 1 -- start start 2023-06-10T18:56:37.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.918+0000 7efd1c3f7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7efd14152bb0 0x7efd140c8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:37.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.918+0000 7efd1c3f7640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7efd1406b9c0 0x7efd1415c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:37.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.918+0000 7efd1c3f7640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd1415cbb0 con 0x7efd1415c210 2023-06-10T18:56:37.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.918+0000 7efd1c3f7640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd140c8850 con 0x7efd14152bb0 2023-06-10T18:56:37.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.918+0000 7efd1c3f7640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd140cc8f0 con 0x7efd1406b9c0 2023-06-10T18:56:37.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.918+0000 7efd1a193640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7efd14152bb0 0x7efd140c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:37.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.918+0000 7efd1a193640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7efd14152bb0 0x7efd140c8310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53170/0 (socket says 172.21.15.53:53170) 2023-06-10T18:56:37.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.918+0000 7efd1a193640 1 -- 172.21.15.53:0/771272398 learned_addr learned my addr 172.21.15.53:0/771272398 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:37.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.918+0000 7efd1a994640 1 --2- 172.21.15.53:0/771272398 >> v2:172.21.15.117:3300/0 conn(0x7efd1406b9c0 0x7efd1415c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:37.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.918+0000 7efd1a193640 1 -- 172.21.15.53:0/771272398 >> v2:172.21.15.117:3300/0 conn(0x7efd1406b9c0 msgr2=0x7efd1415c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:37.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.918+0000 7efd1a193640 1 --2- 172.21.15.53:0/771272398 >> v2:172.21.15.117:3300/0 conn(0x7efd1406b9c0 0x7efd1415c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:37.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.918+0000 7efd1a193640 1 -- 172.21.15.53:0/771272398 >> v1:172.21.15.117:6789/0 conn(0x7efd1415c210 legacy=0x7efd14158c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:37.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.918+0000 7efd1a193640 1 -- 172.21.15.53:0/771272398 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd140c8b90 con 0x7efd14152bb0 2023-06-10T18:56:37.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.922+0000 7efd1a193640 1 --2- 172.21.15.53:0/771272398 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd14152bb0 0x7efd140c8310 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7efd140ccc40 tx=0x7efd1001ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c50f1aa9b3c96 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:37.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.922+0000 7efd19191640 1 -- 172.21.15.53:0/771272398 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd100a89b0 con 0x7efd14152bb0 2023-06-10T18:56:37.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.922+0000 7efd19191640 1 -- 172.21.15.53:0/771272398 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd100a8b10 con 0x7efd14152bb0 2023-06-10T18:56:37.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.922+0000 7efd19191640 1 -- 172.21.15.53:0/771272398 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd100a8ea0 con 0x7efd14152bb0 2023-06-10T18:56:37.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.922+0000 7efd1c3f7640 1 -- 172.21.15.53:0/771272398 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd14152bb0 msgr2=0x7efd140c8310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:37.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.922+0000 7efd1c3f7640 1 --2- 172.21.15.53:0/771272398 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd14152bb0 0x7efd140c8310 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7efd140ccc40 tx=0x7efd1001ecb0 comp rx=0 tx=0).stop 2023-06-10T18:56:37.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.922+0000 7efd1c3f7640 1 -- 172.21.15.53:0/771272398 shutdown_connections 2023-06-10T18:56:37.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.922+0000 7efd1c3f7640 1 --2- 172.21.15.53:0/771272398 >> v2:172.21.15.117:3300/0 conn(0x7efd1406b9c0 0x7efd1415c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:37.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.922+0000 7efd1c3f7640 1 --2- 172.21.15.53:0/771272398 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd14152bb0 0x7efd140c8310 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:37.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.922+0000 7efd1c3f7640 1 -- 172.21.15.53:0/771272398 >> 172.21.15.53:0/771272398 conn(0x7efd140ce9e0 msgr2=0x7efd140ca7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:37.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.922+0000 7efd1c3f7640 1 -- 172.21.15.53:0/771272398 shutdown_connections 2023-06-10T18:56:37.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.922+0000 7efd1c3f7640 1 -- 172.21.15.53:0/771272398 wait complete. 2023-06-10T18:56:37.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.926+0000 7efd1c3f7640 1 Processor -- start 2023-06-10T18:56:37.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.926+0000 7efd1c3f7640 1 -- start start 2023-06-10T18:56:37.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.926+0000 7efd1c3f7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efd1406b9c0 0x7efd140ac270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:37.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.926+0000 7efd1c3f7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efd14152bb0 0x7efd1414e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:37.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.926+0000 7efd1c3f7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd1415c210 0x7efd1414f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:37.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.926+0000 7efd1c3f7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd140c7370 con 0x7efd1415c210 2023-06-10T18:56:37.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.926+0000 7efd1c3f7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd140c64c0 con 0x7efd14152bb0 2023-06-10T18:56:37.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.926+0000 7efd1c3f7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd140c6760 con 0x7efd1406b9c0 2023-06-10T18:56:37.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.926+0000 7efd1a994640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd1415c210 0x7efd1414f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:37.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.926+0000 7efd1a994640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd1415c210 0x7efd1414f8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53178/0 (socket says 172.21.15.53:53178) 2023-06-10T18:56:37.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.926+0000 7efd1a994640 1 -- 172.21.15.53:0/456235899 learned_addr learned my addr 172.21.15.53:0/456235899 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:37.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.926+0000 7efd1a193640 1 --2- 172.21.15.53:0/456235899 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efd1406b9c0 0x7efd140ac270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:37.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.926+0000 7efd19992640 1 --2- 172.21.15.53:0/456235899 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efd14152bb0 0x7efd1414e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:37.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.926+0000 7efd1a994640 1 -- 172.21.15.53:0/456235899 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efd1406b9c0 msgr2=0x7efd140ac270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:37.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.926+0000 7efd1a994640 1 --2- 172.21.15.53:0/456235899 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efd1406b9c0 0x7efd140ac270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:37.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.926+0000 7efd1a994640 1 -- 172.21.15.53:0/456235899 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efd14152bb0 msgr2=0x7efd1414e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:37.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.926+0000 7efd1a994640 1 --2- 172.21.15.53:0/456235899 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efd14152bb0 0x7efd1414e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:37.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.926+0000 7efd1a994640 1 -- 172.21.15.53:0/456235899 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd10009480 con 0x7efd1415c210 2023-06-10T18:56:37.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.926+0000 7efd1a994640 1 --2- 172.21.15.53:0/456235899 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd1415c210 0x7efd1414f8c0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7efd0c007e40 tx=0x7efd0c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:37.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.926+0000 7efd06ffd640 1 -- 172.21.15.53:0/456235899 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd0c014620 con 0x7efd1415c210 2023-06-10T18:56:37.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.926+0000 7efd06ffd640 1 -- 172.21.15.53:0/456235899 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd0c00ee90 con 0x7efd1415c210 2023-06-10T18:56:37.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.926+0000 7efd1c3f7640 1 -- 172.21.15.53:0/456235899 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd140c6a40 con 0x7efd1415c210 2023-06-10T18:56:37.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.926+0000 7efd06ffd640 1 -- 172.21.15.53:0/456235899 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd0c0149e0 con 0x7efd1415c210 2023-06-10T18:56:37.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.926+0000 7efd1c3f7640 1 -- 172.21.15.53:0/456235899 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd140c7000 con 0x7efd1415c210 2023-06-10T18:56:37.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.926+0000 7efd06ffd640 1 -- 172.21.15.53:0/456235899 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7efd0c014b40 con 0x7efd1415c210 2023-06-10T18:56:37.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.926+0000 7efd06ffd640 1 --2- 172.21.15.53:0/456235899 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efcf8066280 0x7efcf8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:37.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.926+0000 7efd06ffd640 1 -- 172.21.15.53:0/456235899 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6120+0+0 (secure 0 0 0) 0x7efd0c084730 con 0x7efd1415c210 2023-06-10T18:56:37.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.930+0000 7efd1a193640 1 --2- 172.21.15.53:0/456235899 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efcf8066280 0x7efcf8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:37.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.930+0000 7efd1a193640 1 --2- 172.21.15.53:0/456235899 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efcf8066280 0x7efcf8068730 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7efd100b2000 tx=0x7efd100aa070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:37.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.930+0000 7efd1f513000 1 Processor -- start 2023-06-10T18:56:37.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.930+0000 7efd1f513000 1 -- start start 2023-06-10T18:56:37.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.930+0000 7efd1f513000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557a54606740 0x557a54606b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:37.944 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.930+0000 7efd1f513000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557a54607050 0x557a545bc840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:37.944 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.930+0000 7efd1f513000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557a545bcd80 0x557a545bd150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:37.944 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.930+0000 7efd1f513000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a54484ac0 con 0x557a545bcd80 2023-06-10T18:56:37.944 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.930+0000 7efd1f513000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a543be840 con 0x557a54607050 2023-06-10T18:56:37.944 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.930+0000 7efd1f513000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x557a544122e0 con 0x557a54606740 2023-06-10T18:56:37.944 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.930+0000 7efd1a994640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557a545bcd80 0x557a545bd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:37.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.930+0000 7efd1a994640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557a545bcd80 0x557a545bd150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53190/0 (socket says 172.21.15.53:53190) 2023-06-10T18:56:37.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.930+0000 7efd1a994640 1 -- 172.21.15.53:0/692693462 learned_addr learned my addr 172.21.15.53:0/692693462 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:37.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.930+0000 7efd1a193640 1 --2- 172.21.15.53:0/692693462 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557a54606740 0x557a54606b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:37.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.930+0000 7efd19992640 1 --2- 172.21.15.53:0/692693462 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557a54607050 0x557a545bc840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:37.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.930+0000 7efd1a994640 1 -- 172.21.15.53:0/692693462 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557a54606740 msgr2=0x557a54606b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:37.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.930+0000 7efd1a994640 1 --2- 172.21.15.53:0/692693462 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557a54606740 0x557a54606b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:37.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.930+0000 7efd1a994640 1 -- 172.21.15.53:0/692693462 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557a54607050 msgr2=0x557a545bc840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:37.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.930+0000 7efd1a994640 1 --2- 172.21.15.53:0/692693462 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557a54607050 0x557a545bc840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:37.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.930+0000 7efd1a994640 1 -- 172.21.15.53:0/692693462 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557a54107890 con 0x557a545bcd80 2023-06-10T18:56:37.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.930+0000 7efd1a994640 1 --2- 172.21.15.53:0/692693462 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557a545bcd80 0x557a545bd150 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7efd0c00c040 tx=0x7efd0c059970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71085957f22669d server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:37.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.930+0000 7efcf7fff640 1 -- 172.21.15.53:0/692693462 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd0c053a30 con 0x557a545bcd80 2023-06-10T18:56:37.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.930+0000 7efcf7fff640 1 -- 172.21.15.53:0/692693462 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd0c051f40 con 0x557a545bcd80 2023-06-10T18:56:37.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.930+0000 7efcf7fff640 1 -- 172.21.15.53:0/692693462 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd0c05d8f0 con 0x557a545bcd80 2023-06-10T18:56:37.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.930+0000 7efd1f513000 1 -- 172.21.15.53:0/692693462 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557a545bcd80 msgr2=0x557a545bd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:37.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.930+0000 7efd1f513000 1 --2- 172.21.15.53:0/692693462 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557a545bcd80 0x557a545bd150 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7efd0c00c040 tx=0x7efd0c059970 comp rx=0 tx=0).stop 2023-06-10T18:56:37.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.930+0000 7efd1f513000 1 -- 172.21.15.53:0/692693462 shutdown_connections 2023-06-10T18:56:37.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.930+0000 7efd1f513000 1 --2- 172.21.15.53:0/692693462 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557a545bcd80 0x557a545bd150 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:37.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.930+0000 7efd1f513000 1 --2- 172.21.15.53:0/692693462 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557a54607050 0x557a545bc840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:37.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.930+0000 7efd1f513000 1 --2- 172.21.15.53:0/692693462 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557a54606740 0x557a54606b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:37.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.930+0000 7efd1f513000 1 -- 172.21.15.53:0/692693462 >> 172.21.15.53:0/692693462 conn(0x557a545b4800 msgr2=0x557a545c3800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:37.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.930+0000 7efd1f513000 1 -- 172.21.15.53:0/692693462 shutdown_connections 2023-06-10T18:56:37.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.930+0000 7efd1f513000 1 -- 172.21.15.53:0/692693462 wait complete. 2023-06-10T18:56:37.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.934+0000 7efd1f513000 1 -- start start 2023-06-10T18:56:37.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.934+0000 7efd1f513000 1 Processor -- start 2023-06-10T18:56:37.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.934+0000 7efd1f513000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557a545bcd80 0x557a545c28e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:37.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.934+0000 7efd1f513000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557a54606740 0x557a545c80e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:37.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.934+0000 7efd1f513000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557a54607050 0x557a545c8620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:37.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.934+0000 7efd1f513000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a5440b380 con 0x557a54606740 2023-06-10T18:56:37.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.934+0000 7efd1f513000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a543c7ae0 con 0x557a545bcd80 2023-06-10T18:56:37.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.934+0000 7efd1f513000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x557a543c7780 con 0x557a54607050 2023-06-10T18:56:37.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.934+0000 7efd1f513000 10 client.0 _ll_register_callbacks cb 0x557a545a8e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-10T18:56:37.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.934+0000 7efd19992640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557a54606740 0x557a545c80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:37.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.934+0000 7efd19992640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557a54606740 0x557a545c80e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53194/0 (socket says 172.21.15.53:53194) 2023-06-10T18:56:37.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.934+0000 7efd19992640 1 -- 172.21.15.53:0/2058209521 learned_addr learned my addr 172.21.15.53:0/2058209521 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:37.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.934+0000 7efd1a994640 1 --2- 172.21.15.53:0/2058209521 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557a54607050 0x557a545c8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:37.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.934+0000 7efd1a193640 1 --2- 172.21.15.53:0/2058209521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557a545bcd80 0x557a545c28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:37.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.934+0000 7efd19992640 1 -- 172.21.15.53:0/2058209521 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557a54607050 msgr2=0x557a545c8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:37.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.934+0000 7efd19992640 1 --2- 172.21.15.53:0/2058209521 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557a54607050 0x557a545c8620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:37.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.934+0000 7efd19992640 1 -- 172.21.15.53:0/2058209521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557a545bcd80 msgr2=0x557a545c28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:37.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.934+0000 7efd19992640 1 --2- 172.21.15.53:0/2058209521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557a545bcd80 0x557a545c28e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:37.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.934+0000 7efd19992640 1 -- 172.21.15.53:0/2058209521 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd140c7000 con 0x557a54606740 2023-06-10T18:56:37.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.934+0000 7efd1a193640 1 --2- 172.21.15.53:0/2058209521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557a545bcd80 0x557a545c28e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:56:37.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.934+0000 7efd19992640 1 --2- 172.21.15.53:0/2058209521 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557a54606740 0x557a545c80e0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7efd0800dee0 tx=0x7efd0800f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=443ea05146251703 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:37.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.934+0000 7efcf57fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-06-10T18:56:37.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.934+0000 7efcf57fa640 1 -- 172.21.15.53:0/2058209521 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd08004020 con 0x557a54606740 2023-06-10T18:56:37.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.934+0000 7efcf57fa640 1 -- 172.21.15.53:0/2058209521 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(53..53 src has 1..53) v4 ==== 6120+0+0 (secure 0 0 0) 0x7efd08004180 con 0x557a54606740 2023-06-10T18:56:37.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.934+0000 7efd1f513000 1 -- 172.21.15.53:0/2058209521 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557a543d2a20 con 0x557a54606740 2023-06-10T18:56:37.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.934+0000 7efcf57fa640 1 -- 172.21.15.53:0/2058209521 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7efd08004340 con 0x557a54606740 2023-06-10T18:56:37.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.934+0000 7efd1f513000 10 client.6144 fetch_fsmap learned FSMap version 20 2023-06-10T18:56:37.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.934+0000 7efd1f513000 1 -- 172.21.15.53:0/2058209521 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) v3 -- 0x557a543cfd10 con 0x557a54606740 2023-06-10T18:56:37.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.934+0000 7efcf57fa640 1 -- 172.21.15.53:0/2058209521 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557a543d2a20 con 0x557a54606740 2023-06-10T18:56:37.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.934+0000 7efcf57fa640 1 -- 172.21.15.53:0/2058209521 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 20) v1 ==== 3114+0+0 (secure 0 0 0) 0x7efd08003600 con 0x557a54606740 2023-06-10T18:56:37.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.934+0000 7efd1f513000 10 client.6144 fetch_fsmap finished waiting for FSMap version 20 2023-06-10T18:56:37.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.934+0000 7efd1f513000 10 client.6144 resolve_mds: resolved name 'c' to daemon mds.c 2023-06-10T18:56:37.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.934+0000 7efd1f513000 20 client.6144 populate_metadata read hostname 'smithi053' 2023-06-10T18:56:37.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.934+0000 7efd1f513000 1 --2- 172.21.15.53:0/2058209521 >> [v2:172.21.15.53:6834/3463677034,v1:172.21.15.53:6835/3463677034] conn(0x557a54615c80 0x557a54618060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:37.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.934+0000 7efd1f513000 4 client.6144 mds_command: new command op to 5931 tid=0[{"prefix": "get_command_descriptions"}] 2023-06-10T18:56:37.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.934+0000 7efd1f513000 1 -- 172.21.15.53:0/2058209521 --> [v2:172.21.15.53:6834/3463677034,v1:172.21.15.53:6835/3463677034] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557a5443a710 con 0x557a54615c80 2023-06-10T18:56:37.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.934+0000 7efd1a193640 1 --2- 172.21.15.53:0/2058209521 >> [v2:172.21.15.53:6834/3463677034,v1:172.21.15.53:6835/3463677034] conn(0x557a54615c80 0x557a54618060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:37.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.934+0000 7efd1a193640 1 --2- 172.21.15.53:0/2058209521 >> [v2:172.21.15.53:6834/3463677034,v1:172.21.15.53:6835/3463677034] conn(0x557a54615c80 0x557a54618060 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2857522558475a5f server_cookie=c9ac219d60f8af62 in_seq=0 out_seq=0 2023-06-10T18:56:37.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.934+0000 7efcf57fa640 10 client.6144 ms_handle_connect on v2:172.21.15.53:6834/3463677034 2023-06-10T18:56:37.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.934+0000 7efcf57fa640 1 -- 172.21.15.53:0/2058209521 <== mds.0 v2:172.21.15.53:6834/3463677034 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x557a5443a710 con 0x557a54615c80 2023-06-10T18:56:37.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.934+0000 7efcf57fa640 10 client.6144 handle_command_reply: tid=0 2023-06-10T18:56:37.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.934+0000 7efd1f513000 1 client.6144 shutdown 2023-06-10T18:56:37.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.934+0000 7efd1f513000 1 -- 172.21.15.53:0/2058209521 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557a54606740 msgr2=0x557a545c80e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:37.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.934+0000 7efd1f513000 1 --2- 172.21.15.53:0/2058209521 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557a54606740 0x557a545c80e0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7efd0800dee0 tx=0x7efd0800f5b0 comp rx=0 tx=0).stop 2023-06-10T18:56:37.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.934+0000 7efd1f513000 1 -- 172.21.15.53:0/2058209521 shutdown_connections 2023-06-10T18:56:37.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.934+0000 7efd1f513000 1 --2- 172.21.15.53:0/2058209521 >> [v2:172.21.15.53:6834/3463677034,v1:172.21.15.53:6835/3463677034] conn(0x557a54615c80 0x557a54618060 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:37.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.934+0000 7efd1f513000 1 --2- 172.21.15.53:0/2058209521 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557a54607050 0x557a545c8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:37.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.934+0000 7efd1f513000 1 --2- 172.21.15.53:0/2058209521 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557a54606740 0x557a545c80e0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:37.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.934+0000 7efcf57fa640 0 client.6144 ms_handle_reset on v2:172.21.15.53:6834/3463677034 2023-06-10T18:56:37.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.934+0000 7efd1f513000 1 --2- 172.21.15.53:0/2058209521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557a545bcd80 0x557a545c28e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:37.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.934+0000 7efd1f513000 1 -- 172.21.15.53:0/2058209521 >> 172.21.15.53:0/2058209521 conn(0x557a545b4800 msgr2=0x557a545bb830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:37.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.938+0000 7efd1f513000 1 -- 172.21.15.53:0/2058209521 shutdown_connections 2023-06-10T18:56:37.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.938+0000 7efd1f513000 1 -- 172.21.15.53:0/2058209521 wait complete. 2023-06-10T18:56:37.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.938+0000 7efd1f513000 20 client.6144 trim_cache size 0 max 16384 2023-06-10T18:56:37.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.950+0000 7efd1f513000 1 Processor -- start 2023-06-10T18:56:37.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.950+0000 7efd1f513000 1 -- start start 2023-06-10T18:56:37.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.954+0000 7efd1f513000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557a545bcd80 0x557a54619fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:37.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.954+0000 7efd1f513000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557a54606740 0x557a54616050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:37.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.954+0000 7efd1f513000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557a54607050 0x557a54616590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:37.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.954+0000 7efd1f513000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a540c8940 con 0x557a54607050 2023-06-10T18:56:37.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.954+0000 7efd1f513000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a543ccad0 con 0x557a54606740 2023-06-10T18:56:37.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.954+0000 7efd1f513000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x557a545c3a30 con 0x557a545bcd80 2023-06-10T18:56:37.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.954+0000 7efd1a994640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557a54607050 0x557a54616590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:37.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.954+0000 7efd1a994640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557a54607050 0x557a54616590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53208/0 (socket says 172.21.15.53:53208) 2023-06-10T18:56:37.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.954+0000 7efd1a994640 1 -- 172.21.15.53:0/972938131 learned_addr learned my addr 172.21.15.53:0/972938131 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:37.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.954+0000 7efd1a193640 1 --2- 172.21.15.53:0/972938131 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557a545bcd80 0x557a54619fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:37.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.954+0000 7efd19992640 1 --2- 172.21.15.53:0/972938131 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557a54606740 0x557a54616050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:37.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.954+0000 7efd1a994640 1 -- 172.21.15.53:0/972938131 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557a545bcd80 msgr2=0x557a54619fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:37.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.954+0000 7efd1a994640 1 --2- 172.21.15.53:0/972938131 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557a545bcd80 0x557a54619fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:37.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.954+0000 7efd1a994640 1 -- 172.21.15.53:0/972938131 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557a54606740 msgr2=0x557a54616050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:37.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.954+0000 7efd1a994640 1 --2- 172.21.15.53:0/972938131 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557a54606740 0x557a54616050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:37.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.954+0000 7efd1a994640 1 -- 172.21.15.53:0/972938131 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557a545bf450 con 0x557a54607050 2023-06-10T18:56:37.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.954+0000 7efd1a994640 1 --2- 172.21.15.53:0/972938131 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557a54607050 0x557a54616590 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7efd0c00e9b0 tx=0x7efd0c05dd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61ba173ef9b1a1b3 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:37.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.954+0000 7efd04ff9640 1 -- 172.21.15.53:0/972938131 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd0c051b70 con 0x557a54607050 2023-06-10T18:56:37.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.954+0000 7efd04ff9640 1 -- 172.21.15.53:0/972938131 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd0c051f40 con 0x557a54607050 2023-06-10T18:56:37.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.954+0000 7efd04ff9640 1 -- 172.21.15.53:0/972938131 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd0c05d950 con 0x557a54607050 2023-06-10T18:56:37.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.954+0000 7efd1f513000 1 -- 172.21.15.53:0/972938131 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557a54607050 msgr2=0x557a54616590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:37.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.954+0000 7efd1f513000 1 --2- 172.21.15.53:0/972938131 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557a54607050 0x557a54616590 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7efd0c00e9b0 tx=0x7efd0c05dd00 comp rx=0 tx=0).stop 2023-06-10T18:56:37.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.954+0000 7efd1f513000 1 -- 172.21.15.53:0/972938131 shutdown_connections 2023-06-10T18:56:37.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.954+0000 7efd1f513000 1 --2- 172.21.15.53:0/972938131 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557a54607050 0x557a54616590 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:37.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.954+0000 7efd1f513000 1 --2- 172.21.15.53:0/972938131 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557a54606740 0x557a54616050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:37.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.954+0000 7efd1f513000 1 --2- 172.21.15.53:0/972938131 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557a545bcd80 0x557a54619fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:37.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.954+0000 7efd1f513000 1 -- 172.21.15.53:0/972938131 >> 172.21.15.53:0/972938131 conn(0x557a545b4800 msgr2=0x557a545bbeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:37.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.954+0000 7efd1f513000 1 -- 172.21.15.53:0/972938131 shutdown_connections 2023-06-10T18:56:37.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.954+0000 7efd1f513000 1 -- 172.21.15.53:0/972938131 wait complete. 2023-06-10T18:56:37.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.954+0000 7efd1f513000 1 -- start start 2023-06-10T18:56:37.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.954+0000 7efd1f513000 1 Processor -- start 2023-06-10T18:56:37.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.954+0000 7efd1f513000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557a545bcd80 0x557a54619710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:37.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.954+0000 7efd1f513000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557a54606740 0x557a546214c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:37.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.954+0000 7efd1f513000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557a54607050 0x557a54621a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:37.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.954+0000 7efd1f513000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a543a8a80 con 0x557a54607050 2023-06-10T18:56:37.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.954+0000 7efd1f513000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a545c12e0 con 0x557a545bcd80 2023-06-10T18:56:37.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.954+0000 7efd1f513000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x557a543b3450 con 0x557a54606740 2023-06-10T18:56:37.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.954+0000 7efd1f513000 10 client.0 _ll_register_callbacks cb 0x557a543cf7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-10T18:56:37.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.954+0000 7efd1a994640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557a54607050 0x557a54621a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:37.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.954+0000 7efd1a994640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557a54607050 0x557a54621a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53218/0 (socket says 172.21.15.53:53218) 2023-06-10T18:56:37.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.954+0000 7efd1a994640 1 -- 172.21.15.53:0/2945518502 learned_addr learned my addr 172.21.15.53:0/2945518502 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:37.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.954+0000 7efd1a193640 1 --2- 172.21.15.53:0/2945518502 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557a545bcd80 0x557a54619710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:37.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.954+0000 7efd19992640 1 --2- 172.21.15.53:0/2945518502 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557a54606740 0x557a546214c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:37.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.954+0000 7efd1a994640 1 -- 172.21.15.53:0/2945518502 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557a54606740 msgr2=0x557a546214c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:37.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.954+0000 7efd1a994640 1 --2- 172.21.15.53:0/2945518502 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557a54606740 0x557a546214c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:37.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.954+0000 7efd1a994640 1 -- 172.21.15.53:0/2945518502 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557a545bcd80 msgr2=0x557a54619710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:37.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.954+0000 7efd1a994640 1 --2- 172.21.15.53:0/2945518502 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557a545bcd80 0x557a54619710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:37.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.954+0000 7efd1a994640 1 -- 172.21.15.53:0/2945518502 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557a54107890 con 0x557a54607050 2023-06-10T18:56:37.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.954+0000 7efd1a994640 1 --2- 172.21.15.53:0/2945518502 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557a54607050 0x557a54621a00 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7efd0c055300 tx=0x7efd0c004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41244007613f6070 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:37.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.954+0000 7efcf57fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-06-10T18:56:37.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.958+0000 7efcf57fa640 1 -- 172.21.15.53:0/2945518502 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd0c051620 con 0x557a54607050 2023-06-10T18:56:37.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.958+0000 7efcf57fa640 1 -- 172.21.15.53:0/2945518502 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(53..53 src has 1..53) v4 ==== 6120+0+0 (secure 0 0 0) 0x7efd0c051780 con 0x557a54607050 2023-06-10T18:56:37.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.958+0000 7efd1f513000 1 -- 172.21.15.53:0/2945518502 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557a545c06e0 con 0x557a54607050 2023-06-10T18:56:37.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.958+0000 7efcf57fa640 1 -- 172.21.15.53:0/2945518502 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7efd0c051940 con 0x557a54607050 2023-06-10T18:56:37.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.958+0000 7efd1f513000 10 client.6150 fetch_fsmap learned FSMap version 20 2023-06-10T18:56:37.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.958+0000 7efd1f513000 1 -- 172.21.15.53:0/2945518502 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) v3 -- 0x557a543b5fa0 con 0x557a54607050 2023-06-10T18:56:37.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.958+0000 7efcf57fa640 1 -- 172.21.15.53:0/2945518502 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557a545c06e0 con 0x557a54607050 2023-06-10T18:56:37.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.958+0000 7efcf57fa640 1 -- 172.21.15.53:0/2945518502 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 20) v1 ==== 3114+0+0 (secure 0 0 0) 0x7efd0c071050 con 0x557a54607050 2023-06-10T18:56:37.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.958+0000 7efd1f513000 10 client.6150 fetch_fsmap finished waiting for FSMap version 20 2023-06-10T18:56:37.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.958+0000 7efd1f513000 10 client.6150 resolve_mds: resolved name 'c' to daemon mds.c 2023-06-10T18:56:37.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.958+0000 7efd1f513000 20 client.6150 populate_metadata read hostname 'smithi053' 2023-06-10T18:56:37.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.958+0000 7efd1f513000 1 --2- 172.21.15.53:0/2945518502 >> [v2:172.21.15.53:6834/3463677034,v1:172.21.15.53:6835/3463677034] conn(0x557a54621f40 0x557a54664d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:37.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.958+0000 7efd1f513000 4 client.6150 mds_command: new command op to 5931 tid=0[{"prefix": "status"}] 2023-06-10T18:56:37.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.958+0000 7efd1f513000 1 -- 172.21.15.53:0/2945518502 --> [v2:172.21.15.53:6834/3463677034,v1:172.21.15.53:6835/3463677034] -- command(tid 0: {"prefix": "status"}) v1 -- 0x557a54409cd0 con 0x557a54621f40 2023-06-10T18:56:37.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.958+0000 7efd1a193640 1 --2- 172.21.15.53:0/2945518502 >> [v2:172.21.15.53:6834/3463677034,v1:172.21.15.53:6835/3463677034] conn(0x557a54621f40 0x557a54664d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:37.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.958+0000 7efcf57fa640 10 client.6150 ms_handle_connect on v2:172.21.15.53:6834/3463677034 2023-06-10T18:56:37.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.958+0000 7efd1a193640 1 --2- 172.21.15.53:0/2945518502 >> [v2:172.21.15.53:6834/3463677034,v1:172.21.15.53:6835/3463677034] conn(0x557a54621f40 0x557a54664d10 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74db8b209fa99901 server_cookie=bb0084e4522a248f in_seq=0 out_seq=0 2023-06-10T18:56:37.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.958+0000 7efcf57fa640 1 -- 172.21.15.53:0/2945518502 <== mds.0 v2:172.21.15.53:6834/3463677034 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+319 (crc 0 0 0) 0x557a54409cd0 con 0x557a54621f40 2023-06-10T18:56:37.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.958+0000 7efcf57fa640 10 client.6150 handle_command_reply: tid=0 2023-06-10T18:56:37.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.958+0000 7efd1f513000 1 client.6150 shutdown 2023-06-10T18:56:37.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.958+0000 7efd1f513000 1 -- 172.21.15.53:0/2945518502 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557a54607050 msgr2=0x557a54621a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:37.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.958+0000 7efd1f513000 1 --2- 172.21.15.53:0/2945518502 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557a54607050 0x557a54621a00 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7efd0c055300 tx=0x7efd0c004a50 comp rx=0 tx=0).stop 2023-06-10T18:56:37.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.958+0000 7efd1f513000 1 -- 172.21.15.53:0/2945518502 shutdown_connections 2023-06-10T18:56:37.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.958+0000 7efd1f513000 1 --2- 172.21.15.53:0/2945518502 >> [v2:172.21.15.53:6834/3463677034,v1:172.21.15.53:6835/3463677034] conn(0x557a54621f40 0x557a54664d10 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:37.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.958+0000 7efd1f513000 1 --2- 172.21.15.53:0/2945518502 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557a54607050 0x557a54621a00 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:37.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.958+0000 7efd1f513000 1 --2- 172.21.15.53:0/2945518502 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557a54606740 0x557a546214c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:37.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.958+0000 7efcf57fa640 0 client.6150 ms_handle_reset on v2:172.21.15.53:6834/3463677034 2023-06-10T18:56:37.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.958+0000 7efd1f513000 1 --2- 172.21.15.53:0/2945518502 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557a545bcd80 0x557a54619710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:37.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.958+0000 7efd1f513000 1 -- 172.21.15.53:0/2945518502 >> 172.21.15.53:0/2945518502 conn(0x557a545b4800 msgr2=0x557a546050d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:37.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.958+0000 7efd1f513000 1 -- 172.21.15.53:0/2945518502 shutdown_connections 2023-06-10T18:56:37.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.958+0000 7efd1f513000 1 -- 172.21.15.53:0/2945518502 wait complete. 2023-06-10T18:56:37.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.958+0000 7efd1f513000 20 client.6150 trim_cache size 0 max 16384 2023-06-10T18:56:37.982 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-06-10T18:56:37.982 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_fsid": "c8c64bed-c406-4936-93f9-d16335f1067d", 2023-06-10T18:56:37.982 INFO:teuthology.orchestra.run.smithi053.stdout: "whoami": 0, 2023-06-10T18:56:37.982 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 5931, 2023-06-10T18:56:37.982 INFO:teuthology.orchestra.run.smithi053.stdout: "want_state": "up:active", 2023-06-10T18:56:37.982 INFO:teuthology.orchestra.run.smithi053.stdout: "state": "up:active", 2023-06-10T18:56:37.983 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs", 2023-06-10T18:56:37.983 INFO:teuthology.orchestra.run.smithi053.stdout: "rank_uptime": 19.275231544, 2023-06-10T18:56:37.983 INFO:teuthology.orchestra.run.smithi053.stdout: "mdsmap_epoch": 20, 2023-06-10T18:56:37.983 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch": 53, 2023-06-10T18:56:37.983 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch_barrier": 51, 2023-06-10T18:56:37.983 INFO:teuthology.orchestra.run.smithi053.stdout: "uptime": 24.664784716 2023-06-10T18:56:37.984 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-06-10T18:56:37.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.958+0000 7efd1c3f7640 1 -- 172.21.15.53:0/456235899 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efcf8066280 msgr2=0x7efcf8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:37.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.958+0000 7efd1c3f7640 1 --2- 172.21.15.53:0/456235899 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efcf8066280 0x7efcf8068730 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7efd100b2000 tx=0x7efd100aa070 comp rx=0 tx=0).stop 2023-06-10T18:56:37.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.958+0000 7efd1c3f7640 1 -- 172.21.15.53:0/456235899 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd1415c210 msgr2=0x7efd1414f8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:37.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.958+0000 7efd1c3f7640 1 --2- 172.21.15.53:0/456235899 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd1415c210 0x7efd1414f8c0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7efd0c007e40 tx=0x7efd0c00e4b0 comp rx=0 tx=0).stop 2023-06-10T18:56:37.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.958+0000 7efd1c3f7640 1 -- 172.21.15.53:0/456235899 shutdown_connections 2023-06-10T18:56:37.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.958+0000 7efd1c3f7640 1 --2- 172.21.15.53:0/456235899 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efcf8066280 0x7efcf8068730 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:37.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.958+0000 7efd1c3f7640 1 --2- 172.21.15.53:0/456235899 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd1415c210 0x7efd1414f8c0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:37.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.958+0000 7efd1c3f7640 1 --2- 172.21.15.53:0/456235899 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efd14152bb0 0x7efd1414e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:37.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.958+0000 7efd1c3f7640 1 --2- 172.21.15.53:0/456235899 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efd1406b9c0 0x7efd140ac270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:37.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.958+0000 7efd1c3f7640 1 -- 172.21.15.53:0/456235899 >> 172.21.15.53:0/456235899 conn(0x7efd140ce9e0 msgr2=0x7efd140ccc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:37.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.958+0000 7efd1c3f7640 1 -- 172.21.15.53:0/456235899 shutdown_connections 2023-06-10T18:56:37.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:37.958+0000 7efd1c3f7640 1 -- 172.21.15.53:0/456235899 wait complete. 2023-06-10T18:56:37.987 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-10T18:56:38.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:38.098+0000 7f9d87ee3640 1 Processor -- start 2023-06-10T18:56:38.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:38.098+0000 7f9d87ee3640 1 -- start start 2023-06-10T18:56:38.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:38.098+0000 7f9d87ee3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d800c9840 0x7f9d800c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:38.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:38.098+0000 7f9d87ee3640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9d80071060 0x7f9d800af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:38.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:38.098+0000 7f9d87ee3640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d80159b50 con 0x7f9d800afc60 2023-06-10T18:56:38.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:38.098+0000 7f9d87ee3640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d800ca150 con 0x7f9d80071060 2023-06-10T18:56:38.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:38.098+0000 7f9d87ee3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d800702a0 con 0x7f9d800c9840 2023-06-10T18:56:38.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:38.098+0000 7f9d86480640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f9d800afc60 0x7f9d8015d2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:59628/0 (socket says 172.21.15.53:59628) 2023-06-10T18:56:38.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:38.098+0000 7f9d86480640 1 -- 172.21.15.53:0/606667238 learned_addr learned my addr 172.21.15.53:0/606667238 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:56:38.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:38.098+0000 7f9d8547e640 1 --2- 172.21.15.53:0/606667238 >> v2:172.21.15.53:3300/0 conn(0x7f9d80071060 0x7f9d800af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:38.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:38.098+0000 7f9d85c7f640 1 --2- 172.21.15.53:0/606667238 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d800c9840 0x7f9d800c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:38.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:38.098+0000 7f9d84c7d640 1 -- 172.21.15.53:0/606667238 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 65184079 0 0) 0x7f9d80159b50 con 0x7f9d800afc60 2023-06-10T18:56:38.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:38.098+0000 7f9d8547e640 1 -- 172.21.15.53:0/606667238 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d800c9840 msgr2=0x7f9d800c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:38.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:38.098+0000 7f9d8547e640 1 --2- 172.21.15.53:0/606667238 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d800c9840 0x7f9d800c9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:38.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:38.098+0000 7f9d8547e640 1 -- 172.21.15.53:0/606667238 >> v1:172.21.15.53:6789/0 conn(0x7f9d800afc60 legacy=0x7f9d8015d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:38.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:38.098+0000 7f9d8547e640 1 -- 172.21.15.53:0/606667238 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d80070580 con 0x7f9d80071060 2023-06-10T18:56:38.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:38.102+0000 7f9d8547e640 1 --2- 172.21.15.53:0/606667238 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d80071060 0x7f9d800af720 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f9d700097c0 tx=0x7f9d7001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb5ab2fb11d20184 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:38.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:38.102+0000 7f9d84c7d640 1 -- 172.21.15.53:0/606667238 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d700ab600 con 0x7f9d80071060 2023-06-10T18:56:38.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:38.102+0000 7f9d84c7d640 1 -- 172.21.15.53:0/606667238 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d700a7050 con 0x7f9d80071060 2023-06-10T18:56:38.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:38.102+0000 7f9d84c7d640 1 -- 172.21.15.53:0/606667238 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d700ab980 con 0x7f9d80071060 2023-06-10T18:56:38.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:38.102+0000 7f9d87ee3640 1 -- 172.21.15.53:0/606667238 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d80071060 msgr2=0x7f9d800af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:38.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:38.102+0000 7f9d87ee3640 1 --2- 172.21.15.53:0/606667238 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d80071060 0x7f9d800af720 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f9d700097c0 tx=0x7f9d7001c450 comp rx=0 tx=0).stop 2023-06-10T18:56:38.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:38.102+0000 7f9d87ee3640 1 -- 172.21.15.53:0/606667238 shutdown_connections 2023-06-10T18:56:38.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:38.102+0000 7f9d87ee3640 1 --2- 172.21.15.53:0/606667238 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d80071060 0x7f9d800af720 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:38.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:38.102+0000 7f9d87ee3640 1 --2- 172.21.15.53:0/606667238 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d800c9840 0x7f9d800c9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:38.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:38.102+0000 7f9d87ee3640 1 -- 172.21.15.53:0/606667238 >> 172.21.15.53:0/606667238 conn(0x7f9d8006a0d0 msgr2=0x7f9d800ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:38.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:38.102+0000 7f9d87ee3640 1 -- 172.21.15.53:0/606667238 shutdown_connections 2023-06-10T18:56:38.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:38.102+0000 7f9d87ee3640 1 -- 172.21.15.53:0/606667238 wait complete. 2023-06-10T18:56:38.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:38.102+0000 7f9d87ee3640 1 Processor -- start 2023-06-10T18:56:38.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:38.102+0000 7f9d87ee3640 1 -- start start 2023-06-10T18:56:38.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:38.102+0000 7f9d87ee3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d80071060 0x7f9d800b2e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:38.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:38.102+0000 7f9d87ee3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d800afc60 0x7f9d800c17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:38.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:38.102+0000 7f9d87ee3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d800c9840 0x7f9d80153180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:38.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:38.102+0000 7f9d87ee3640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d801536c0 con 0x7f9d800c9840 2023-06-10T18:56:38.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:38.102+0000 7f9d87ee3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d800c1ed0 con 0x7f9d800afc60 2023-06-10T18:56:38.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:38.102+0000 7f9d87ee3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d800c21b0 con 0x7f9d80071060 2023-06-10T18:56:38.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:38.102+0000 7f9d86480640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d800c9840 0x7f9d80153180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:38.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:38.102+0000 7f9d86480640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d800c9840 0x7f9d80153180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53242/0 (socket says 172.21.15.53:53242) 2023-06-10T18:56:38.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:38.102+0000 7f9d86480640 1 -- 172.21.15.53:0/2316180487 learned_addr learned my addr 172.21.15.53:0/2316180487 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:38.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:38.102+0000 7f9d85c7f640 1 --2- 172.21.15.53:0/2316180487 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d80071060 0x7f9d800b2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:38.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:38.102+0000 7f9d8547e640 1 --2- 172.21.15.53:0/2316180487 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d800afc60 0x7f9d800c17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:38.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:38.102+0000 7f9d86480640 1 -- 172.21.15.53:0/2316180487 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d80071060 msgr2=0x7f9d800b2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:38.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:38.102+0000 7f9d86480640 1 --2- 172.21.15.53:0/2316180487 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d80071060 0x7f9d800b2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:38.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:38.102+0000 7f9d86480640 1 -- 172.21.15.53:0/2316180487 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d800afc60 msgr2=0x7f9d800c17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:38.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:38.102+0000 7f9d86480640 1 --2- 172.21.15.53:0/2316180487 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d800afc60 0x7f9d800c17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:38.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:38.102+0000 7f9d86480640 1 -- 172.21.15.53:0/2316180487 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d70009420 con 0x7f9d800c9840 2023-06-10T18:56:38.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:38.102+0000 7f9d8547e640 1 --2- 172.21.15.53:0/2316180487 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d800afc60 0x7f9d800c17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:56:38.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:38.102+0000 7f9d85c7f640 1 --2- 172.21.15.53:0/2316180487 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d80071060 0x7f9d800b2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:56:38.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:38.102+0000 7f9d86480640 1 --2- 172.21.15.53:0/2316180487 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d800c9840 0x7f9d80153180 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f9d78001570 tx=0x7f9d7800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:38.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:38.106+0000 7f9d767fc640 1 -- 172.21.15.53:0/2316180487 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7800a640 con 0x7f9d800c9840 2023-06-10T18:56:38.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:38.106+0000 7f9d767fc640 1 -- 172.21.15.53:0/2316180487 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d7800a7c0 con 0x7f9d800c9840 2023-06-10T18:56:38.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:38.106+0000 7f9d87ee3640 1 -- 172.21.15.53:0/2316180487 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d800c2490 con 0x7f9d800c9840 2023-06-10T18:56:38.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:38.106+0000 7f9d767fc640 1 -- 172.21.15.53:0/2316180487 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7800ab70 con 0x7f9d800c9840 2023-06-10T18:56:38.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:38.106+0000 7f9d87ee3640 1 -- 172.21.15.53:0/2316180487 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d800c2a50 con 0x7f9d800c9840 2023-06-10T18:56:38.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:38.106+0000 7f9d87ee3640 1 -- 172.21.15.53:0/2316180487 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d8004d790 con 0x7f9d800c9840 2023-06-10T18:56:38.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:38.106+0000 7f9d767fc640 1 -- 172.21.15.53:0/2316180487 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9d7800acd0 con 0x7f9d800c9840 2023-06-10T18:56:38.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:38.106+0000 7f9d767fc640 1 --2- 172.21.15.53:0/2316180487 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9d640662b0 0x7f9d64068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:38.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:38.106+0000 7f9d767fc640 1 -- 172.21.15.53:0/2316180487 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f9d78083660 con 0x7f9d800c9840 2023-06-10T18:56:38.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:38.106+0000 7f9d85c7f640 1 --2- 172.21.15.53:0/2316180487 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9d640662b0 0x7f9d64068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:38.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:38.106+0000 7f9d85c7f640 1 --2- 172.21.15.53:0/2316180487 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9d640662b0 0x7f9d64068760 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c00b9f0 tx=0x7f9d7c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:38.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:38.110+0000 7f9d767fc640 1 -- 172.21.15.53:0/2316180487 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9d78050a00 con 0x7f9d800c9840 2023-06-10T18:56:38.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:38.294+0000 7f9d87ee3640 1 -- 172.21.15.53:0/2316180487 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9d800ad4b0 con 0x7f9d800c9840 2023-06-10T18:56:38.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:38.294+0000 7f9d767fc640 1 -- 172.21.15.53:0/2316180487 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v20) v1 ==== 53+0+73 (secure 0 0 0) 0x7f9d78054020 con 0x7f9d800c9840 2023-06-10T18:56:38.300 INFO:teuthology.orchestra.run.smithi053.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-06-10T18:56:38.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:38.294+0000 7f9d87ee3640 1 -- 172.21.15.53:0/2316180487 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9d640662b0 msgr2=0x7f9d64068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:38.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:38.294+0000 7f9d87ee3640 1 --2- 172.21.15.53:0/2316180487 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9d640662b0 0x7f9d64068760 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c00b9f0 tx=0x7f9d7c008040 comp rx=0 tx=0).stop 2023-06-10T18:56:38.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:38.294+0000 7f9d87ee3640 1 -- 172.21.15.53:0/2316180487 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d800c9840 msgr2=0x7f9d80153180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:38.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:38.294+0000 7f9d87ee3640 1 --2- 172.21.15.53:0/2316180487 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d800c9840 0x7f9d80153180 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f9d78001570 tx=0x7f9d7800cca0 comp rx=0 tx=0).stop 2023-06-10T18:56:38.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:38.294+0000 7f9d87ee3640 1 -- 172.21.15.53:0/2316180487 shutdown_connections 2023-06-10T18:56:38.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:38.294+0000 7f9d87ee3640 1 --2- 172.21.15.53:0/2316180487 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9d640662b0 0x7f9d64068760 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:38.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:38.294+0000 7f9d87ee3640 1 --2- 172.21.15.53:0/2316180487 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d800c9840 0x7f9d80153180 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:38.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:38.294+0000 7f9d87ee3640 1 --2- 172.21.15.53:0/2316180487 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d800afc60 0x7f9d800c17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:38.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:38.294+0000 7f9d87ee3640 1 --2- 172.21.15.53:0/2316180487 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d80071060 0x7f9d800b2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:38.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:38.294+0000 7f9d87ee3640 1 -- 172.21.15.53:0/2316180487 >> 172.21.15.53:0/2316180487 conn(0x7f9d8006a0d0 msgr2=0x7f9d800ad9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:38.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:38.294+0000 7f9d87ee3640 1 -- 172.21.15.53:0/2316180487 shutdown_connections 2023-06-10T18:56:38.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:38.298+0000 7f9d87ee3640 1 -- 172.21.15.53:0/2316180487 wait complete. 2023-06-10T18:56:38.317 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-10T18:56:38.317 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-10T18:56:38.318 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi053.front.sepia.ceph.com 2023-06-10T18:56:38.318 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-06-10T18:56:38.318 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-06-10T18:56:38.319 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-10T18:56:38.319 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-10T18:56:38.319 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-10T18:56:38.320 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-06-10T18:56:38.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:56:38.321 DEBUG:teuthology.orchestra.run.smithi053:> ip addr 2023-06-10T18:56:38.327 INFO:teuthology.orchestra.run.smithi053.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-10T18:56:38.327 INFO:teuthology.orchestra.run.smithi053.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-10T18:56:38.327 INFO:teuthology.orchestra.run.smithi053.stdout: inet 127.0.0.1/8 scope host lo 2023-06-10T18:56:38.328 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:56:38.328 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 ::1/128 scope host 2023-06-10T18:56:38.328 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:56:38.329 INFO:teuthology.orchestra.run.smithi053.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T18:56:38.329 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:da brd ff:ff:ff:ff:ff:ff 2023-06-10T18:56:38.329 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f0 2023-06-10T18:56:38.329 INFO:teuthology.orchestra.run.smithi053.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T18:56:38.329 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:db brd ff:ff:ff:ff:ff:ff 2023-06-10T18:56:38.330 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f1 2023-06-10T18:56:38.330 INFO:teuthology.orchestra.run.smithi053.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-10T18:56:38.330 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:18 brd ff:ff:ff:ff:ff:ff 2023-06-10T18:56:38.330 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f0 2023-06-10T18:56:38.331 INFO:teuthology.orchestra.run.smithi053.stdout: inet 172.21.15.53/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-06-10T18:56:38.331 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft 42251sec preferred_lft 42251sec 2023-06-10T18:56:38.331 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::ae1f:6bff:fef8:3718/64 scope link 2023-06-10T18:56:38.331 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:56:38.331 INFO:teuthology.orchestra.run.smithi053.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T18:56:38.332 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:19 brd ff:ff:ff:ff:ff:ff 2023-06-10T18:56:38.332 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f1 2023-06-10T18:56:38.332 INFO:teuthology.orchestra.run.smithi053.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-06-10T18:56:38.334 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 02:42:49:3d:ee:1e brd ff:ff:ff:ff:ff:ff 2023-06-10T18:56:38.334 INFO:teuthology.orchestra.run.smithi053.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-06-10T18:56:38.335 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:56:38.335 INFO:teuthology.orchestra.run.smithi053.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-10T18:56:38.335 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-06-10T18:56:38.335 INFO:teuthology.orchestra.run.smithi053.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-06-10T18:56:38.335 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:56:38.335 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-06-10T18:56:38.335 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:56:38.336 INFO:teuthology.orchestra.run.smithi053.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-10T18:56:38.336 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-06-10T18:56:38.336 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-06-10T18:56:38.336 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:56:38.336 INFO:teuthology.orchestra.run.smithi053.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-10T18:56:38.336 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-06-10T18:56:38.336 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-06-10T18:56:38.337 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:56:38.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:56:38.337 DEBUG:teuthology.orchestra.run.smithi053:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-10T18:56:38.380 INFO:teuthology.orchestra.run.smithi053.stdout:1 2023-06-10T18:56:38.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:56:38.382 DEBUG:teuthology.orchestra.run.smithi053:> route 2023-06-10T18:56:38.432 INFO:teuthology.orchestra.run.smithi053.stdout:Kernel IP routing table 2023-06-10T18:56:38.432 INFO:teuthology.orchestra.run.smithi053.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-10T18:56:38.433 INFO:teuthology.orchestra.run.smithi053.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-06-10T18:56:38.433 INFO:teuthology.orchestra.run.smithi053.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-06-10T18:56:38.433 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-06-10T18:56:38.433 INFO:teuthology.orchestra.run.smithi053.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-10T18:56:38.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:56:38.434 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec bash -c ' 2023-06-10T18:56:38.434 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2023-06-10T18:56:38.434 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-06-10T18:56:38.435 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-06-10T18:56:38.435 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-06-10T18:56:38.435 DEBUG:teuthology.orchestra.run.smithi053:> ') 2023-06-10T18:56:38.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:56:38.507 DEBUG:teuthology.orchestra.run.smithi053:> ip netns list 2023-06-10T18:56:38.554 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-06-10T18:56:38.555 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-06-10T18:56:38.555 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-06-10T18:56:38.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:56:38.556 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link set brx.0 up 2023-06-10T18:56:38.611 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-06-10T18:56:38.611 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-10T18:56:38.611 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-06-10T18:56:38.659 INFO:teuthology.orchestra.run.smithi053.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-06-10T18:56:38.659 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-10T18:56:38.660 DEBUG:teuthology.orchestra.run.smithi053:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-06-10T18:56:38.706 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2023-06-10T18:56:38.768 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T18:56:38.769 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T18:56:38.822 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T18:56:38.823 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T18:56:38.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:56:38.824 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2023-06-10T18:56:38.871 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-06-10T18:56:38.871 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-06-10T18:56:38.916 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2023-06-10T18:56:38.930 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T18:56:38.931 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T18:56:38.985 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T18:56:38.986 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T18:56:38.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:56:38.987 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2023-06-10T18:56:39.002 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:2023-06-10T18:56:38.998+0000 7f9c11aef580 -1 init, newargv = 0x5567e03c7bb0 newargc=15 2023-06-10T18:56:39.003 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[50293]: starting ceph client 2023-06-10T18:56:39.007 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[50293]: starting fuse 2023-06-10T18:56:40.108 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2023-06-10T18:56:40.125 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T18:56:40.125 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T18:56:40.181 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T18:56:40.182 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T18:56:40.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:56:40.183 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2023-06-10T18:56:40.230 INFO:teuthology.orchestra.run.smithi053.stdout:45 2023-06-10T18:56:40.231 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-06-10T18:56:40.231 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-06-10T18:56:40.232 DEBUG:teuthology.orchestra.run.smithi053:> import glob 2023-06-10T18:56:40.232 DEBUG:teuthology.orchestra.run.smithi053:> import re 2023-06-10T18:56:40.233 DEBUG:teuthology.orchestra.run.smithi053:> import os 2023-06-10T18:56:40.234 DEBUG:teuthology.orchestra.run.smithi053:> import subprocess 2023-06-10T18:56:40.234 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T18:56:40.235 DEBUG:teuthology.orchestra.run.smithi053:> def _find_admin_socket(client_name): 2023-06-10T18:56:40.235 DEBUG:teuthology.orchestra.run.smithi053:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-06-10T18:56:40.235 DEBUG:teuthology.orchestra.run.smithi053:> files = glob.glob(asok_path) 2023-06-10T18:56:40.236 DEBUG:teuthology.orchestra.run.smithi053:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-06-10T18:56:40.237 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T18:56:40.237 DEBUG:teuthology.orchestra.run.smithi053:> # Given a non-glob path, it better be there 2023-06-10T18:56:40.237 DEBUG:teuthology.orchestra.run.smithi053:> if "*" not in asok_path: 2023-06-10T18:56:40.238 DEBUG:teuthology.orchestra.run.smithi053:> assert(len(files) == 1) 2023-06-10T18:56:40.238 DEBUG:teuthology.orchestra.run.smithi053:> return files[0] 2023-06-10T18:56:40.238 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T18:56:40.239 DEBUG:teuthology.orchestra.run.smithi053:> for f in files: 2023-06-10T18:56:40.239 DEBUG:teuthology.orchestra.run.smithi053:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-06-10T18:56:40.240 DEBUG:teuthology.orchestra.run.smithi053:> if os.path.exists("/proc/{0}".format(pid)): 2023-06-10T18:56:40.240 DEBUG:teuthology.orchestra.run.smithi053:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-06-10T18:56:40.240 DEBUG:teuthology.orchestra.run.smithi053:> contents = proc_f.read() 2023-06-10T18:56:40.240 DEBUG:teuthology.orchestra.run.smithi053:> if mountpoint in contents: 2023-06-10T18:56:40.241 DEBUG:teuthology.orchestra.run.smithi053:> return f 2023-06-10T18:56:40.241 DEBUG:teuthology.orchestra.run.smithi053:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-06-10T18:56:40.241 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T18:56:40.242 DEBUG:teuthology.orchestra.run.smithi053:> print(_find_admin_socket("client.0")) 2023-06-10T18:56:40.242 DEBUG:teuthology.orchestra.run.smithi053:> ' 2023-06-10T18:56:40.354 INFO:teuthology.orchestra.run.smithi053.stdout:/var/run/ceph/ceph-client.0.50293.asok 2023-06-10T18:56:40.538 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.50293.asok 2023-06-10T18:56:40.538 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:56:40.539 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.50293.asok status 2023-06-10T18:56:40.701 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-06-10T18:56:40.702 INFO:teuthology.orchestra.run.smithi053.stdout: "metadata": { 2023-06-10T18:56:40.702 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_sha1": "219d315c3a0b2075e570fb1964be2ad33fe7a9c8", 2023-06-10T18:56:40.702 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_version": "ceph version 18.0.0-4359-g219d315c (219d315c3a0b2075e570fb1964be2ad33fe7a9c8) reef (dev)", 2023-06-10T18:56:40.703 INFO:teuthology.orchestra.run.smithi053.stdout: "entity_id": "0", 2023-06-10T18:56:40.703 INFO:teuthology.orchestra.run.smithi053.stdout: "hostname": "smithi053", 2023-06-10T18:56:40.703 INFO:teuthology.orchestra.run.smithi053.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-06-10T18:56:40.704 INFO:teuthology.orchestra.run.smithi053.stdout: "pid": "50293", 2023-06-10T18:56:40.704 INFO:teuthology.orchestra.run.smithi053.stdout: "root": "/" 2023-06-10T18:56:40.704 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:56:40.704 INFO:teuthology.orchestra.run.smithi053.stdout: "dentry_count": 0, 2023-06-10T18:56:40.705 INFO:teuthology.orchestra.run.smithi053.stdout: "dentry_pinned_count": 0, 2023-06-10T18:56:40.705 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 6168, 2023-06-10T18:56:40.705 INFO:teuthology.orchestra.run.smithi053.stdout: "inst": { 2023-06-10T18:56:40.706 INFO:teuthology.orchestra.run.smithi053.stdout: "name": { 2023-06-10T18:56:40.706 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "client", 2023-06-10T18:56:40.706 INFO:teuthology.orchestra.run.smithi053.stdout: "num": 6168 2023-06-10T18:56:40.706 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:56:40.707 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": { 2023-06-10T18:56:40.707 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2023-06-10T18:56:40.707 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "192.168.0.1:0", 2023-06-10T18:56:40.707 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 3227928255 2023-06-10T18:56:40.708 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:56:40.708 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:56:40.708 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": { 2023-06-10T18:56:40.709 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2023-06-10T18:56:40.709 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "192.168.0.1:0", 2023-06-10T18:56:40.709 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 3227928255 2023-06-10T18:56:40.709 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:56:40.710 INFO:teuthology.orchestra.run.smithi053.stdout: "inst_str": "client.6168 192.168.0.1:0/3227928255", 2023-06-10T18:56:40.710 INFO:teuthology.orchestra.run.smithi053.stdout: "addr_str": "192.168.0.1:0/3227928255", 2023-06-10T18:56:40.710 INFO:teuthology.orchestra.run.smithi053.stdout: "inode_count": 1, 2023-06-10T18:56:40.710 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_epoch": 20, 2023-06-10T18:56:40.711 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_epoch": 53, 2023-06-10T18:56:40.711 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_epoch_barrier": 0, 2023-06-10T18:56:40.711 INFO:teuthology.orchestra.run.smithi053.stdout: "blocklisted": false, 2023-06-10T18:56:40.712 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs" 2023-06-10T18:56:40.712 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-06-10T18:56:40.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:56:40.717 DEBUG:teuthology.orchestra.run.smithi053:> stat --file-system '--printf=%T 2023-06-10T18:56:40.718 DEBUG:teuthology.orchestra.run.smithi053:> ' -- /home/ubuntu/cephtest/mnt.0 2023-06-10T18:56:40.724 INFO:teuthology.orchestra.run.smithi053.stdout:fuseblk 2023-06-10T18:56:40.725 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-06-10T18:56:40.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:56:40.725 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-06-10T18:56:40.777 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-10T18:56:40.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:40.950+0000 7f989dc81640 1 Processor -- start 2023-06-10T18:56:40.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:40.950+0000 7f989dc81640 1 -- start start 2023-06-10T18:56:40.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:40.950+0000 7f989dc81640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98980b3ac0 0x7f98980b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:40.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:40.950+0000 7f989dc81640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f98980cc690 0x7f989815f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:40.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:40.950+0000 7f989dc81640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f98980ccae0 0x7f989815f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:40.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:40.950+0000 7f989dc81640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98980d0020 con 0x7f98980ccae0 2023-06-10T18:56:40.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:40.950+0000 7f989dc81640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98980b43d0 con 0x7f98980cc690 2023-06-10T18:56:40.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:40.950+0000 7f989dc81640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98980cef40 con 0x7f98980b3ac0 2023-06-10T18:56:40.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:40.950+0000 7f9897fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f98980ccae0 0x7f989815f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:40.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:40.950+0000 7f9897fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f98980ccae0 0x7f989815f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53252/0 (socket says 172.21.15.53:53252) 2023-06-10T18:56:40.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:40.950+0000 7f9897fff640 1 -- 172.21.15.53:0/3161999839 learned_addr learned my addr 172.21.15.53:0/3161999839 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:40.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:40.950+0000 7f98977fe640 1 --2- 172.21.15.53:0/3161999839 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98980b3ac0 0x7f98980b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:40.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:40.950+0000 7f9896ffd640 1 --2- 172.21.15.53:0/3161999839 >> v2:172.21.15.117:3300/0 conn(0x7f98980cc690 0x7f989815f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:40.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:40.950+0000 7f9897fff640 1 -- 172.21.15.53:0/3161999839 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98980b3ac0 msgr2=0x7f98980b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:40.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:40.950+0000 7f9897fff640 1 --2- 172.21.15.53:0/3161999839 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98980b3ac0 0x7f98980b3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:40.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:40.950+0000 7f9897fff640 1 -- 172.21.15.53:0/3161999839 >> v2:172.21.15.117:3300/0 conn(0x7f98980cc690 msgr2=0x7f989815f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:40.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:40.950+0000 7f9897fff640 1 --2- 172.21.15.53:0/3161999839 >> v2:172.21.15.117:3300/0 conn(0x7f98980cc690 0x7f989815f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:40.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:40.950+0000 7f9897fff640 1 -- 172.21.15.53:0/3161999839 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98980cf220 con 0x7f98980ccae0 2023-06-10T18:56:40.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:40.950+0000 7f9896ffd640 1 --2- 172.21.15.53:0/3161999839 >> v2:172.21.15.117:3300/0 conn(0x7f98980cc690 0x7f989815f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:56:40.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:40.954+0000 7f9897fff640 1 --2- 172.21.15.53:0/3161999839 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98980ccae0 0x7f989815f8b0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f9898069cb0 tx=0x7f989001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9a8781fe02eeb79 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:40.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:40.954+0000 7f98967fc640 1 -- 172.21.15.53:0/3161999839 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98900ac600 con 0x7f98980ccae0 2023-06-10T18:56:40.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:40.954+0000 7f98967fc640 1 -- 172.21.15.53:0/3161999839 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98900a8050 con 0x7f98980ccae0 2023-06-10T18:56:40.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:40.954+0000 7f98967fc640 1 -- 172.21.15.53:0/3161999839 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98900ac980 con 0x7f98980ccae0 2023-06-10T18:56:40.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:40.954+0000 7f989dc81640 1 -- 172.21.15.53:0/3161999839 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98980ccae0 msgr2=0x7f989815f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:40.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:40.954+0000 7f989dc81640 1 --2- 172.21.15.53:0/3161999839 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98980ccae0 0x7f989815f8b0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f9898069cb0 tx=0x7f989001c4d0 comp rx=0 tx=0).stop 2023-06-10T18:56:40.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:40.954+0000 7f989dc81640 1 -- 172.21.15.53:0/3161999839 shutdown_connections 2023-06-10T18:56:40.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:40.954+0000 7f989dc81640 1 --2- 172.21.15.53:0/3161999839 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98980ccae0 0x7f989815f8b0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:40.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:40.954+0000 7f989dc81640 1 --2- 172.21.15.53:0/3161999839 >> v2:172.21.15.117:3300/0 conn(0x7f98980cc690 0x7f989815f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:40.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:40.954+0000 7f989dc81640 1 --2- 172.21.15.53:0/3161999839 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98980b3ac0 0x7f98980b3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:40.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:40.954+0000 7f989dc81640 1 -- 172.21.15.53:0/3161999839 >> 172.21.15.53:0/3161999839 conn(0x7f9898071790 msgr2=0x7f9898069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:40.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:40.954+0000 7f989dc81640 1 -- 172.21.15.53:0/3161999839 shutdown_connections 2023-06-10T18:56:40.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:40.954+0000 7f989dc81640 1 -- 172.21.15.53:0/3161999839 wait complete. 2023-06-10T18:56:40.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:40.954+0000 7f989dc81640 1 Processor -- start 2023-06-10T18:56:40.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:40.954+0000 7f989dc81640 1 -- start start 2023-06-10T18:56:40.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:40.954+0000 7f989dc81640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98980b3ac0 0x7f989815e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:40.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:40.954+0000 7f989dc81640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98980cc690 0x7f9898150210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:40.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:40.954+0000 7f989dc81640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98980ccae0 0x7f989815d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:40.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:40.954+0000 7f989dc81640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f989815c980 con 0x7f98980cc690 2023-06-10T18:56:40.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:40.954+0000 7f989dc81640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f989815ec80 con 0x7f98980ccae0 2023-06-10T18:56:40.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:40.954+0000 7f989dc81640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f989815b090 con 0x7f98980b3ac0 2023-06-10T18:56:40.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:40.954+0000 7f9896ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98980cc690 0x7f9898150210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:40.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:40.954+0000 7f9896ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98980cc690 0x7f9898150210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53262/0 (socket says 172.21.15.53:53262) 2023-06-10T18:56:40.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:40.954+0000 7f9896ffd640 1 -- 172.21.15.53:0/82792027 learned_addr learned my addr 172.21.15.53:0/82792027 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:40.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:40.958+0000 7f98977fe640 1 --2- 172.21.15.53:0/82792027 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98980b3ac0 0x7f989815e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:40.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:40.958+0000 7f9896ffd640 1 -- 172.21.15.53:0/82792027 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98980b3ac0 msgr2=0x7f989815e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:40.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:40.958+0000 7f9896ffd640 1 --2- 172.21.15.53:0/82792027 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98980b3ac0 0x7f989815e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:40.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:40.958+0000 7f9897fff640 1 --2- 172.21.15.53:0/82792027 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98980ccae0 0x7f989815d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:40.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:40.958+0000 7f9896ffd640 1 -- 172.21.15.53:0/82792027 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98980ccae0 msgr2=0x7f989815d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:40.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:40.958+0000 7f9896ffd640 1 --2- 172.21.15.53:0/82792027 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98980ccae0 0x7f989815d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:40.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:40.958+0000 7f9896ffd640 1 -- 172.21.15.53:0/82792027 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98900094d0 con 0x7f98980cc690 2023-06-10T18:56:40.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:40.958+0000 7f9896ffd640 1 --2- 172.21.15.53:0/82792027 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98980cc690 0x7f9898150210 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f988000e810 tx=0x7f988000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:40.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:40.958+0000 7f988ffff640 1 -- 172.21.15.53:0/82792027 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f988000c870 con 0x7f98980cc690 2023-06-10T18:56:40.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:40.958+0000 7f988ffff640 1 -- 172.21.15.53:0/82792027 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f988000c9d0 con 0x7f98980cc690 2023-06-10T18:56:40.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:40.958+0000 7f989dc81640 1 -- 172.21.15.53:0/82792027 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f989815cbb0 con 0x7f98980cc690 2023-06-10T18:56:40.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:40.958+0000 7f988ffff640 1 -- 172.21.15.53:0/82792027 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f988000cd60 con 0x7f98980cc690 2023-06-10T18:56:40.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:40.958+0000 7f989dc81640 1 -- 172.21.15.53:0/82792027 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f989815cf40 con 0x7f98980cc690 2023-06-10T18:56:40.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:40.958+0000 7f989dc81640 1 -- 172.21.15.53:0/82792027 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f989804d790 con 0x7f98980cc690 2023-06-10T18:56:40.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:40.958+0000 7f988ffff640 1 -- 172.21.15.53:0/82792027 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9880013410 con 0x7f98980cc690 2023-06-10T18:56:40.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:40.958+0000 7f988ffff640 1 --2- 172.21.15.53:0/82792027 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f98780662d0 0x7f9878068780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:40.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:40.958+0000 7f988ffff640 1 -- 172.21.15.53:0/82792027 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f9880083a80 con 0x7f98980cc690 2023-06-10T18:56:40.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:40.958+0000 7f98977fe640 1 --2- 172.21.15.53:0/82792027 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f98780662d0 0x7f9878068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:40.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:40.958+0000 7f98977fe640 1 --2- 172.21.15.53:0/82792027 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f98780662d0 0x7f9878068780 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f98980cd710 tx=0x7f988800d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:40.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:40.962+0000 7f988ffff640 1 -- 172.21.15.53:0/82792027 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9880050fa0 con 0x7f98980cc690 2023-06-10T18:56:41.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:41.154+0000 7f989dc81640 1 -- 172.21.15.53:0/82792027 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f989815cd40 con 0x7f98980cc690 2023-06-10T18:56:41.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:41.154+0000 7f988ffff640 1 -- 172.21.15.53:0/82792027 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v20) v1 ==== 53+0+73 (secure 0 0 0) 0x7f98800545c0 con 0x7f98980cc690 2023-06-10T18:56:41.161 INFO:teuthology.orchestra.run.smithi053.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-06-10T18:56:41.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:41.158+0000 7f989dc81640 1 -- 172.21.15.53:0/82792027 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f98780662d0 msgr2=0x7f9878068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:41.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:41.158+0000 7f989dc81640 1 --2- 172.21.15.53:0/82792027 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f98780662d0 0x7f9878068780 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f98980cd710 tx=0x7f988800d040 comp rx=0 tx=0).stop 2023-06-10T18:56:41.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:41.158+0000 7f989dc81640 1 -- 172.21.15.53:0/82792027 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98980cc690 msgr2=0x7f9898150210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:41.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:41.158+0000 7f989dc81640 1 --2- 172.21.15.53:0/82792027 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98980cc690 0x7f9898150210 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f988000e810 tx=0x7f988000ecd0 comp rx=0 tx=0).stop 2023-06-10T18:56:41.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:41.158+0000 7f989dc81640 1 -- 172.21.15.53:0/82792027 shutdown_connections 2023-06-10T18:56:41.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:41.158+0000 7f989dc81640 1 --2- 172.21.15.53:0/82792027 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f98780662d0 0x7f9878068780 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:41.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:41.158+0000 7f989dc81640 1 --2- 172.21.15.53:0/82792027 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98980ccae0 0x7f989815d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:41.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:41.158+0000 7f989dc81640 1 --2- 172.21.15.53:0/82792027 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98980cc690 0x7f9898150210 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:41.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:41.158+0000 7f989dc81640 1 --2- 172.21.15.53:0/82792027 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98980b3ac0 0x7f989815e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:41.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:41.158+0000 7f989dc81640 1 -- 172.21.15.53:0/82792027 >> 172.21.15.53:0/82792027 conn(0x7f9898071790 msgr2=0x7f98980b4f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:41.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:41.158+0000 7f989dc81640 1 -- 172.21.15.53:0/82792027 shutdown_connections 2023-06-10T18:56:41.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:41.158+0000 7f989dc81640 1 -- 172.21.15.53:0/82792027 wait complete. 2023-06-10T18:56:41.180 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-10T18:56:41.180 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-10T18:56:41.180 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi117.front.sepia.ceph.com 2023-06-10T18:56:41.181 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-06-10T18:56:41.181 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-06-10T18:56:41.181 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-10T18:56:41.181 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-10T18:56:41.182 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-10T18:56:41.182 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-06-10T18:56:41.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:56:41.183 DEBUG:teuthology.orchestra.run.smithi117:> ip addr 2023-06-10T18:56:41.190 INFO:teuthology.orchestra.run.smithi117.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-10T18:56:41.190 INFO:teuthology.orchestra.run.smithi117.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-10T18:56:41.190 INFO:teuthology.orchestra.run.smithi117.stdout: inet 127.0.0.1/8 scope host lo 2023-06-10T18:56:41.191 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:56:41.191 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 ::1/128 scope host 2023-06-10T18:56:41.191 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:56:41.191 INFO:teuthology.orchestra.run.smithi117.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T18:56:41.191 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8a brd ff:ff:ff:ff:ff:ff 2023-06-10T18:56:41.191 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f0 2023-06-10T18:56:41.191 INFO:teuthology.orchestra.run.smithi117.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T18:56:41.191 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8b brd ff:ff:ff:ff:ff:ff 2023-06-10T18:56:41.192 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f1 2023-06-10T18:56:41.192 INFO:teuthology.orchestra.run.smithi117.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T18:56:41.192 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:62 brd ff:ff:ff:ff:ff:ff 2023-06-10T18:56:41.192 INFO:teuthology.orchestra.run.smithi117.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-10T18:56:41.192 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:63 brd ff:ff:ff:ff:ff:ff 2023-06-10T18:56:41.192 INFO:teuthology.orchestra.run.smithi117.stdout: inet 172.21.15.117/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-06-10T18:56:41.192 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft 42248sec preferred_lft 42248sec 2023-06-10T18:56:41.193 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::ec4:7aff:fe8f:4463/64 scope link 2023-06-10T18:56:41.193 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:56:41.193 INFO:teuthology.orchestra.run.smithi117.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-06-10T18:56:41.193 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 02:42:f8:40:b2:dc brd ff:ff:ff:ff:ff:ff 2023-06-10T18:56:41.193 INFO:teuthology.orchestra.run.smithi117.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-06-10T18:56:41.193 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:56:41.193 INFO:teuthology.orchestra.run.smithi117.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-10T18:56:41.193 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-06-10T18:56:41.194 INFO:teuthology.orchestra.run.smithi117.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-06-10T18:56:41.194 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:56:41.194 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-06-10T18:56:41.194 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:56:41.194 INFO:teuthology.orchestra.run.smithi117.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-10T18:56:41.194 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-06-10T18:56:41.194 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-06-10T18:56:41.194 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:56:41.195 INFO:teuthology.orchestra.run.smithi117.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-10T18:56:41.195 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-06-10T18:56:41.195 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-06-10T18:56:41.195 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:56:41.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:56:41.196 DEBUG:teuthology.orchestra.run.smithi117:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-10T18:56:41.246 INFO:teuthology.orchestra.run.smithi117.stdout:1 2023-06-10T18:56:41.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:56:41.248 DEBUG:teuthology.orchestra.run.smithi117:> route 2023-06-10T18:56:41.297 INFO:teuthology.orchestra.run.smithi117.stdout:Kernel IP routing table 2023-06-10T18:56:41.297 INFO:teuthology.orchestra.run.smithi117.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-10T18:56:41.297 INFO:teuthology.orchestra.run.smithi117.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-06-10T18:56:41.297 INFO:teuthology.orchestra.run.smithi117.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-06-10T18:56:41.297 INFO:teuthology.orchestra.run.smithi117.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-06-10T18:56:41.298 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-06-10T18:56:41.298 INFO:teuthology.orchestra.run.smithi117.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-10T18:56:41.298 INFO:teuthology.orchestra.run.smithi117.stdout:ns2.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-10T18:56:41.298 INFO:teuthology.orchestra.run.smithi117.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-10T18:56:41.298 INFO:teuthology.orchestra.run.smithi117.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-10T18:56:41.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:56:41.299 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec bash -c ' 2023-06-10T18:56:41.299 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2023-06-10T18:56:41.300 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-06-10T18:56:41.300 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-06-10T18:56:41.300 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-06-10T18:56:41.300 DEBUG:teuthology.orchestra.run.smithi117:> ') 2023-06-10T18:56:41.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:56:41.370 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list 2023-06-10T18:56:41.419 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-06-10T18:56:41.419 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-06-10T18:56:41.420 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-06-10T18:56:41.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:56:41.421 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link set brx.0 up 2023-06-10T18:56:41.475 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-06-10T18:56:41.476 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-10T18:56:41.476 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-06-10T18:56:41.523 INFO:teuthology.orchestra.run.smithi117.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-06-10T18:56:41.523 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-10T18:56:41.524 DEBUG:teuthology.orchestra.run.smithi117:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-06-10T18:56:41.570 DEBUG:teuthology.orchestra.run.smithi117:> sudo modprobe fuse 2023-06-10T18:56:41.628 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T18:56:41.628 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T18:56:41.683 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T18:56:41.686 INFO:teuthology.orchestra.run.smithi117.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T18:56:41.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:56:41.686 DEBUG:teuthology.orchestra.run.smithi117:> ls /sys/fs/fuse/connections 2023-06-10T18:56:41.734 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-06-10T18:56:41.735 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-06-10T18:56:41.779 DEBUG:teuthology.orchestra.run.smithi117:> sudo modprobe fuse 2023-06-10T18:56:41.795 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T18:56:41.796 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T18:56:41.847 INFO:teuthology.orchestra.run.smithi117.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T18:56:41.848 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T18:56:41.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:56:41.849 DEBUG:teuthology.orchestra.run.smithi117:> ls /sys/fs/fuse/connections 2023-06-10T18:56:41.858 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi117.stderr:2023-06-10T18:56:41.853+0000 7fbfc438e580 -1 init, newargv = 0x5569194c0cd0 newargc=15 2023-06-10T18:56:41.858 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi117.stderr:ceph-fuse[44292]: starting ceph client 2023-06-10T18:56:41.866 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi117.stderr:ceph-fuse[44292]: starting fuse 2023-06-10T18:56:42.964 DEBUG:teuthology.orchestra.run.smithi117:> sudo modprobe fuse 2023-06-10T18:56:42.980 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T18:56:42.980 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T18:56:43.034 INFO:teuthology.orchestra.run.smithi117.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T18:56:43.035 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T18:56:43.035 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:56:43.036 DEBUG:teuthology.orchestra.run.smithi117:> ls /sys/fs/fuse/connections 2023-06-10T18:56:43.083 INFO:teuthology.orchestra.run.smithi117.stdout:45 2023-06-10T18:56:43.083 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-06-10T18:56:43.084 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-06-10T18:56:43.084 DEBUG:teuthology.orchestra.run.smithi117:> import glob 2023-06-10T18:56:43.085 DEBUG:teuthology.orchestra.run.smithi117:> import re 2023-06-10T18:56:43.085 DEBUG:teuthology.orchestra.run.smithi117:> import os 2023-06-10T18:56:43.085 DEBUG:teuthology.orchestra.run.smithi117:> import subprocess 2023-06-10T18:56:43.086 DEBUG:teuthology.orchestra.run.smithi117:> 2023-06-10T18:56:43.086 DEBUG:teuthology.orchestra.run.smithi117:> def _find_admin_socket(client_name): 2023-06-10T18:56:43.086 DEBUG:teuthology.orchestra.run.smithi117:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-06-10T18:56:43.086 DEBUG:teuthology.orchestra.run.smithi117:> files = glob.glob(asok_path) 2023-06-10T18:56:43.087 DEBUG:teuthology.orchestra.run.smithi117:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-06-10T18:56:43.087 DEBUG:teuthology.orchestra.run.smithi117:> 2023-06-10T18:56:43.087 DEBUG:teuthology.orchestra.run.smithi117:> # Given a non-glob path, it better be there 2023-06-10T18:56:43.088 DEBUG:teuthology.orchestra.run.smithi117:> if "*" not in asok_path: 2023-06-10T18:56:43.088 DEBUG:teuthology.orchestra.run.smithi117:> assert(len(files) == 1) 2023-06-10T18:56:43.088 DEBUG:teuthology.orchestra.run.smithi117:> return files[0] 2023-06-10T18:56:43.089 DEBUG:teuthology.orchestra.run.smithi117:> 2023-06-10T18:56:43.089 DEBUG:teuthology.orchestra.run.smithi117:> for f in files: 2023-06-10T18:56:43.089 DEBUG:teuthology.orchestra.run.smithi117:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-06-10T18:56:43.089 DEBUG:teuthology.orchestra.run.smithi117:> if os.path.exists("/proc/{0}".format(pid)): 2023-06-10T18:56:43.090 DEBUG:teuthology.orchestra.run.smithi117:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-06-10T18:56:43.090 DEBUG:teuthology.orchestra.run.smithi117:> contents = proc_f.read() 2023-06-10T18:56:43.090 DEBUG:teuthology.orchestra.run.smithi117:> if mountpoint in contents: 2023-06-10T18:56:43.091 DEBUG:teuthology.orchestra.run.smithi117:> return f 2023-06-10T18:56:43.091 DEBUG:teuthology.orchestra.run.smithi117:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-06-10T18:56:43.091 DEBUG:teuthology.orchestra.run.smithi117:> 2023-06-10T18:56:43.092 DEBUG:teuthology.orchestra.run.smithi117:> print(_find_admin_socket("client.1")) 2023-06-10T18:56:43.092 DEBUG:teuthology.orchestra.run.smithi117:> ' 2023-06-10T18:56:43.202 INFO:teuthology.orchestra.run.smithi117.stdout:/var/run/ceph/ceph-client.1.44292.asok 2023-06-10T18:56:43.385 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.44292.asok 2023-06-10T18:56:43.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:56:43.385 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.44292.asok status 2023-06-10T18:56:43.538 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2023-06-10T18:56:43.538 INFO:teuthology.orchestra.run.smithi117.stdout: "metadata": { 2023-06-10T18:56:43.538 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_sha1": "219d315c3a0b2075e570fb1964be2ad33fe7a9c8", 2023-06-10T18:56:43.538 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_version": "ceph version 18.0.0-4359-g219d315c (219d315c3a0b2075e570fb1964be2ad33fe7a9c8) reef (dev)", 2023-06-10T18:56:43.539 INFO:teuthology.orchestra.run.smithi117.stdout: "entity_id": "1", 2023-06-10T18:56:43.539 INFO:teuthology.orchestra.run.smithi117.stdout: "hostname": "smithi117", 2023-06-10T18:56:43.539 INFO:teuthology.orchestra.run.smithi117.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-06-10T18:56:43.539 INFO:teuthology.orchestra.run.smithi117.stdout: "pid": "44292", 2023-06-10T18:56:43.539 INFO:teuthology.orchestra.run.smithi117.stdout: "root": "/" 2023-06-10T18:56:43.539 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-06-10T18:56:43.539 INFO:teuthology.orchestra.run.smithi117.stdout: "dentry_count": 0, 2023-06-10T18:56:43.540 INFO:teuthology.orchestra.run.smithi117.stdout: "dentry_pinned_count": 0, 2023-06-10T18:56:43.540 INFO:teuthology.orchestra.run.smithi117.stdout: "id": 5291, 2023-06-10T18:56:43.540 INFO:teuthology.orchestra.run.smithi117.stdout: "inst": { 2023-06-10T18:56:43.540 INFO:teuthology.orchestra.run.smithi117.stdout: "name": { 2023-06-10T18:56:43.540 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "client", 2023-06-10T18:56:43.540 INFO:teuthology.orchestra.run.smithi117.stdout: "num": 5291 2023-06-10T18:56:43.540 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-06-10T18:56:43.540 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": { 2023-06-10T18:56:43.541 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "v1", 2023-06-10T18:56:43.541 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": "192.168.0.1:0", 2023-06-10T18:56:43.541 INFO:teuthology.orchestra.run.smithi117.stdout: "nonce": 369413839 2023-06-10T18:56:43.541 INFO:teuthology.orchestra.run.smithi117.stdout: } 2023-06-10T18:56:43.541 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-06-10T18:56:43.541 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": { 2023-06-10T18:56:43.541 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "v1", 2023-06-10T18:56:43.541 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": "192.168.0.1:0", 2023-06-10T18:56:43.542 INFO:teuthology.orchestra.run.smithi117.stdout: "nonce": 369413839 2023-06-10T18:56:43.542 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-06-10T18:56:43.542 INFO:teuthology.orchestra.run.smithi117.stdout: "inst_str": "client.5291 192.168.0.1:0/369413839", 2023-06-10T18:56:43.542 INFO:teuthology.orchestra.run.smithi117.stdout: "addr_str": "192.168.0.1:0/369413839", 2023-06-10T18:56:43.542 INFO:teuthology.orchestra.run.smithi117.stdout: "inode_count": 1, 2023-06-10T18:56:43.542 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_epoch": 20, 2023-06-10T18:56:43.542 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_epoch": 53, 2023-06-10T18:56:43.542 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_epoch_barrier": 0, 2023-06-10T18:56:43.543 INFO:teuthology.orchestra.run.smithi117.stdout: "blocklisted": false, 2023-06-10T18:56:43.543 INFO:teuthology.orchestra.run.smithi117.stdout: "fs_name": "cephfs" 2023-06-10T18:56:43.543 INFO:teuthology.orchestra.run.smithi117.stdout:} 2023-06-10T18:56:43.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:56:43.551 DEBUG:teuthology.orchestra.run.smithi117:> stat --file-system '--printf=%T 2023-06-10T18:56:43.552 DEBUG:teuthology.orchestra.run.smithi117:> ' -- /home/ubuntu/cephtest/mnt.1 2023-06-10T18:56:43.558 INFO:teuthology.orchestra.run.smithi117.stdout:fuseblk 2023-06-10T18:56:43.558 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-06-10T18:56:43.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:56:43.559 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-06-10T18:56:43.614 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config get mds_reconnect_timeout 2023-06-10T18:56:43.760 INFO:teuthology.orchestra.run.smithi053.stdout:{"mds_reconnect_timeout":"45.000000"} 2023-06-10T18:56:43.761 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_reconnect_timeout": "45.000000" } 2023-06-10T18:56:43.761 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config get ms_max_backoff 2023-06-10T18:56:43.898 INFO:teuthology.orchestra.run.smithi053.stdout:{"ms_max_backoff":"15.000000"} 2023-06-10T18:56:43.898 DEBUG:tasks.cephfs.filesystem:_json_asok output { "ms_max_backoff": "15.000000" } 2023-06-10T18:56:43.899 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T18:56:43.899 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T18:56:43.905 INFO:tasks.cephfs.mount:Creating file a 2023-06-10T18:56:43.905 DEBUG:teuthology.orchestra.run.smithi053:> touch /home/ubuntu/cephtest/mnt.0/a 2023-06-10T18:56:43.961 INFO:tasks.cephfs.mount:Creating file b 2023-06-10T18:56:43.962 DEBUG:teuthology.orchestra.run.smithi053:> touch /home/ubuntu/cephtest/mnt.0/b 2023-06-10T18:56:44.015 INFO:tasks.cephfs.mount:Creating file c 2023-06-10T18:56:44.017 DEBUG:teuthology.orchestra.run.smithi053:> touch /home/ubuntu/cephtest/mnt.0/c 2023-06-10T18:56:44.067 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T18:56:44.068 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T18:56:44.114 INFO:tasks.cephfs.mount:Checking file a 2023-06-10T18:56:44.115 DEBUG:teuthology.orchestra.run.smithi053:> ls /home/ubuntu/cephtest/mnt.0/a 2023-06-10T18:56:44.167 INFO:teuthology.orchestra.run.smithi053.stdout:/home/ubuntu/cephtest/mnt.0/a 2023-06-10T18:56:44.168 INFO:tasks.cephfs.mount:Checking file b 2023-06-10T18:56:44.168 DEBUG:teuthology.orchestra.run.smithi053:> ls /home/ubuntu/cephtest/mnt.0/b 2023-06-10T18:56:44.220 INFO:teuthology.orchestra.run.smithi053.stdout:/home/ubuntu/cephtest/mnt.0/b 2023-06-10T18:56:44.220 INFO:tasks.cephfs.mount:Checking file c 2023-06-10T18:56:44.221 DEBUG:teuthology.orchestra.run.smithi053:> ls /home/ubuntu/cephtest/mnt.0/c 2023-06-10T18:56:44.267 INFO:teuthology.orchestra.run.smithi053.stdout:/home/ubuntu/cephtest/mnt.0/c 2023-06-10T18:56:44.268 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T18:56:44.268 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T18:56:44.315 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T18:56:44.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.486+0000 7f7a495ac640 1 Processor -- start 2023-06-10T18:56:44.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.486+0000 7f7a495ac640 1 -- start start 2023-06-10T18:56:44.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.486+0000 7f7a495ac640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7a440cb870 0x7f7a440af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:44.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.486+0000 7f7a495ac640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a440afc60 0x7f7a440aba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:44.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.486+0000 7f7a495ac640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a441600d0 con 0x7f7a440c9750 2023-06-10T18:56:44.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.486+0000 7f7a495ac640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a440cd990 con 0x7f7a440cb870 2023-06-10T18:56:44.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.486+0000 7f7a495ac640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a440b00e0 con 0x7f7a440afc60 2023-06-10T18:56:44.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.486+0000 7f7a42ffd640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f7a440c9750 0x7f7a440aced0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.53:53478/0 (socket says 172.21.15.53:53478) 2023-06-10T18:56:44.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.486+0000 7f7a42ffd640 1 -- 172.21.15.53:0/3556707310 learned_addr learned my addr 172.21.15.53:0/3556707310 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:56:44.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.486+0000 7f7a427fc640 1 --2- 172.21.15.53:0/3556707310 >> v2:172.21.15.117:3300/0 conn(0x7f7a440cb870 0x7f7a440af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:44.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.486+0000 7f7a437fe640 1 --2- 172.21.15.53:0/3556707310 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a440afc60 0x7f7a440aba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:44.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.486+0000 7f7a41ffb640 1 -- 172.21.15.53:0/3556707310 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2177505213 0 0) 0x7f7a441600d0 con 0x7f7a440c9750 2023-06-10T18:56:44.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.486+0000 7f7a41ffb640 1 -- 172.21.15.53:0/3556707310 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a30003530 con 0x7f7a440c9750 2023-06-10T18:56:44.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.486+0000 7f7a437fe640 1 -- 172.21.15.53:0/3556707310 >> v2:172.21.15.117:3300/0 conn(0x7f7a440cb870 msgr2=0x7f7a440af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:44.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.486+0000 7f7a437fe640 1 --2- 172.21.15.53:0/3556707310 >> v2:172.21.15.117:3300/0 conn(0x7f7a440cb870 0x7f7a440af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:44.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.486+0000 7f7a437fe640 1 -- 172.21.15.53:0/3556707310 >> v1:172.21.15.117:6789/0 conn(0x7f7a440c9750 legacy=0x7f7a440aced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:44.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.486+0000 7f7a437fe640 1 -- 172.21.15.53:0/3556707310 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a44160370 con 0x7f7a440afc60 2023-06-10T18:56:44.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.490+0000 7f7a437fe640 1 --2- 172.21.15.53:0/3556707310 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a440afc60 0x7f7a440aba10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c009d90 tx=0x7f7a3c01c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a65ffe40b6dd37fe server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:44.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.490+0000 7f7a41ffb640 1 -- 172.21.15.53:0/3556707310 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a3c0a5920 con 0x7f7a440afc60 2023-06-10T18:56:44.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.490+0000 7f7a41ffb640 1 -- 172.21.15.53:0/3556707310 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a3c0a5a80 con 0x7f7a440afc60 2023-06-10T18:56:44.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.490+0000 7f7a41ffb640 1 -- 172.21.15.53:0/3556707310 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a3c0a5e10 con 0x7f7a440afc60 2023-06-10T18:56:44.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.490+0000 7f7a495ac640 1 -- 172.21.15.53:0/3556707310 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a440afc60 msgr2=0x7f7a440aba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:44.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.490+0000 7f7a495ac640 1 --2- 172.21.15.53:0/3556707310 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a440afc60 0x7f7a440aba10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c009d90 tx=0x7f7a3c01c950 comp rx=0 tx=0).stop 2023-06-10T18:56:44.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.490+0000 7f7a495ac640 1 -- 172.21.15.53:0/3556707310 shutdown_connections 2023-06-10T18:56:44.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.490+0000 7f7a495ac640 1 --2- 172.21.15.53:0/3556707310 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a440afc60 0x7f7a440aba10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:44.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.490+0000 7f7a495ac640 1 --2- 172.21.15.53:0/3556707310 >> v2:172.21.15.117:3300/0 conn(0x7f7a440cb870 0x7f7a440af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:44.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.490+0000 7f7a495ac640 1 -- 172.21.15.53:0/3556707310 >> 172.21.15.53:0/3556707310 conn(0x7f7a4406a0d0 msgr2=0x7f7a440ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:44.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.490+0000 7f7a495ac640 1 -- 172.21.15.53:0/3556707310 shutdown_connections 2023-06-10T18:56:44.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.490+0000 7f7a495ac640 1 -- 172.21.15.53:0/3556707310 wait complete. 2023-06-10T18:56:44.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.494+0000 7f7a495ac640 1 Processor -- start 2023-06-10T18:56:44.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.494+0000 7f7a495ac640 1 -- start start 2023-06-10T18:56:44.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.494+0000 7f7a495ac640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a440afc60 0x7f7a44158c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:44.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.494+0000 7f7a495ac640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a440c9750 0x7f7a4406f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:44.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.494+0000 7f7a495ac640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a440cb870 0x7f7a44151ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:44.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.494+0000 7f7a495ac640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a44159180 con 0x7f7a440c9750 2023-06-10T18:56:44.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.494+0000 7f7a495ac640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4406fe10 con 0x7f7a440cb870 2023-06-10T18:56:44.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.494+0000 7f7a495ac640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4415cff0 con 0x7f7a440afc60 2023-06-10T18:56:44.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.494+0000 7f7a427fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a440c9750 0x7f7a4406f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:44.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.494+0000 7f7a427fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a440c9750 0x7f7a4406f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42846/0 (socket says 172.21.15.53:42846) 2023-06-10T18:56:44.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.494+0000 7f7a427fc640 1 -- 172.21.15.53:0/4087861050 learned_addr learned my addr 172.21.15.53:0/4087861050 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:44.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.494+0000 7f7a437fe640 1 --2- 172.21.15.53:0/4087861050 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a440cb870 0x7f7a44151ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:44.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.494+0000 7f7a42ffd640 1 --2- 172.21.15.53:0/4087861050 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a440afc60 0x7f7a44158c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:44.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.494+0000 7f7a427fc640 1 -- 172.21.15.53:0/4087861050 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a440afc60 msgr2=0x7f7a44158c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:44.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.494+0000 7f7a427fc640 1 --2- 172.21.15.53:0/4087861050 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a440afc60 0x7f7a44158c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:44.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.494+0000 7f7a427fc640 1 -- 172.21.15.53:0/4087861050 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a440cb870 msgr2=0x7f7a44151ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:44.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.494+0000 7f7a427fc640 1 --2- 172.21.15.53:0/4087861050 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a440cb870 0x7f7a44151ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:44.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.494+0000 7f7a427fc640 1 -- 172.21.15.53:0/4087861050 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a3c009a70 con 0x7f7a440c9750 2023-06-10T18:56:44.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.494+0000 7f7a427fc640 1 --2- 172.21.15.53:0/4087861050 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a440c9750 0x7f7a4406f8d0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c00e930 tx=0x7f7a2c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:44.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.494+0000 7f7a3b7fe640 1 -- 172.21.15.53:0/4087861050 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2c009690 con 0x7f7a440c9750 2023-06-10T18:56:44.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.494+0000 7f7a3b7fe640 1 -- 172.21.15.53:0/4087861050 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a2c00ca00 con 0x7f7a440c9750 2023-06-10T18:56:44.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.494+0000 7f7a495ac640 1 -- 172.21.15.53:0/4087861050 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a4415d2d0 con 0x7f7a440c9750 2023-06-10T18:56:44.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.494+0000 7f7a3b7fe640 1 -- 172.21.15.53:0/4087861050 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2c00cd70 con 0x7f7a440c9750 2023-06-10T18:56:44.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.494+0000 7f7a495ac640 1 -- 172.21.15.53:0/4087861050 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a4415d890 con 0x7f7a440c9750 2023-06-10T18:56:44.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.494+0000 7f7a495ac640 1 -- 172.21.15.53:0/4087861050 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a4404d790 con 0x7f7a440c9750 2023-06-10T18:56:44.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.494+0000 7f7a3b7fe640 1 -- 172.21.15.53:0/4087861050 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7a2c013470 con 0x7f7a440c9750 2023-06-10T18:56:44.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.498+0000 7f7a3b7fe640 1 --2- 172.21.15.53:0/4087861050 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7a240662b0 0x7f7a24068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:44.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.498+0000 7f7a3b7fe640 1 -- 172.21.15.53:0/4087861050 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f7a2c083f20 con 0x7f7a440c9750 2023-06-10T18:56:44.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.498+0000 7f7a42ffd640 1 --2- 172.21.15.53:0/4087861050 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7a240662b0 0x7f7a24068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:44.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.498+0000 7f7a42ffd640 1 --2- 172.21.15.53:0/4087861050 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7a240662b0 0x7f7a24068760 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f7a34005890 tx=0x7f7a34009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:44.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.502+0000 7f7a3b7fe640 1 -- 172.21.15.53:0/4087861050 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7a2c051450 con 0x7f7a440c9750 2023-06-10T18:56:44.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.658+0000 7f7a495ac640 1 -- 172.21.15.53:0/4087861050 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7a440abbe0 con 0x7f7a440c9750 2023-06-10T18:56:44.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.662+0000 7f7a3b7fe640 1 -- 172.21.15.53:0/4087861050 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+18434 (secure 0 0 0) 0x7f7a2c054a70 con 0x7f7a440c9750 2023-06-10T18:56:44.666 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:56:44.667 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":53,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T18:56:27.877880+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-06-10T18:56:16.364582+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-06-10T18:56:17.656793+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.e","mappings":[{"from":0,"to":6}]},{"pgid":"8.1d","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T18:56:44.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.662+0000 7f7a495ac640 1 -- 172.21.15.53:0/4087861050 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7a240662b0 msgr2=0x7f7a24068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:44.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.662+0000 7f7a495ac640 1 --2- 172.21.15.53:0/4087861050 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7a240662b0 0x7f7a24068760 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f7a34005890 tx=0x7f7a34009040 comp rx=0 tx=0).stop 2023-06-10T18:56:44.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.662+0000 7f7a495ac640 1 -- 172.21.15.53:0/4087861050 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a440c9750 msgr2=0x7f7a4406f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:44.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.662+0000 7f7a495ac640 1 --2- 172.21.15.53:0/4087861050 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a440c9750 0x7f7a4406f8d0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c00e930 tx=0x7f7a2c00edf0 comp rx=0 tx=0).stop 2023-06-10T18:56:44.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.662+0000 7f7a495ac640 1 -- 172.21.15.53:0/4087861050 shutdown_connections 2023-06-10T18:56:44.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.662+0000 7f7a495ac640 1 --2- 172.21.15.53:0/4087861050 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7a240662b0 0x7f7a24068760 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:44.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.662+0000 7f7a495ac640 1 --2- 172.21.15.53:0/4087861050 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a440cb870 0x7f7a44151ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:44.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.662+0000 7f7a495ac640 1 --2- 172.21.15.53:0/4087861050 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a440c9750 0x7f7a4406f8d0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:44.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.662+0000 7f7a495ac640 1 --2- 172.21.15.53:0/4087861050 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a440afc60 0x7f7a44158c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:44.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.662+0000 7f7a495ac640 1 -- 172.21.15.53:0/4087861050 >> 172.21.15.53:0/4087861050 conn(0x7f7a4406a0d0 msgr2=0x7f7a44158390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:44.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.662+0000 7f7a495ac640 1 -- 172.21.15.53:0/4087861050 shutdown_connections 2023-06-10T18:56:44.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.662+0000 7f7a495ac640 1 -- 172.21.15.53:0/4087861050 wait complete. 2023-06-10T18:56:44.685 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-10T18:52:33.633114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-10T18:52:39.171487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-10T18:56:16.364582+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2023-06-10T18:56:17.656793+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '51', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-10T18:56:44.686 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-10T18:56:44.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.814+0000 7efd3a98f640 1 Processor -- start 2023-06-10T18:56:44.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.814+0000 7efd3a98f640 1 -- start start 2023-06-10T18:56:44.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.814+0000 7efd3a98f640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7efd340b4260 0x7efd3416b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:44.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.814+0000 7efd3a98f640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd340cc720 con 0x7efd340d1790 2023-06-10T18:56:44.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.814+0000 7efd3a98f640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd340d1d70 con 0x7efd341603a0 2023-06-10T18:56:44.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.814+0000 7efd3a98f640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd340ccf30 con 0x7efd340b4260 2023-06-10T18:56:44.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.814+0000 7efd337fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7efd340d1790 0x7efd340b3b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:50436/0 (socket says 172.21.15.53:50436) 2023-06-10T18:56:44.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.814+0000 7efd337fe640 1 -- 172.21.15.53:0/4030669177 learned_addr learned my addr 172.21.15.53:0/4030669177 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:56:44.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.814+0000 7efd38f2c640 1 --2- 172.21.15.53:0/4030669177 >> v2:172.21.15.117:3300/0 conn(0x7efd340b4260 0x7efd3416b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:44.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.814+0000 7efd32ffd640 1 -- 172.21.15.53:0/4030669177 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 331420056 0 0) 0x7efd340cc720 con 0x7efd340d1790 2023-06-10T18:56:44.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.814+0000 7efd32ffd640 1 -- 172.21.15.53:0/4030669177 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd20003530 con 0x7efd340d1790 2023-06-10T18:56:44.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.814+0000 7efd38f2c640 1 -- 172.21.15.53:0/4030669177 >> v1:172.21.15.117:6789/0 conn(0x7efd341603a0 legacy=0x7efd340cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:44.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.814+0000 7efd38f2c640 1 -- 172.21.15.53:0/4030669177 >> v1:172.21.15.53:6789/0 conn(0x7efd340d1790 legacy=0x7efd340b3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:44.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.814+0000 7efd38f2c640 1 -- 172.21.15.53:0/4030669177 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd340cc970 con 0x7efd340b4260 2023-06-10T18:56:44.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.814+0000 7efd32ffd640 1 -- 172.21.15.53:0/4030669177 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 825072739 0 0) 0x7efd20003530 con 0x7efd340d1790 2023-06-10T18:56:44.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.818+0000 7efd38f2c640 1 --2- 172.21.15.53:0/4030669177 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efd340b4260 0x7efd3416b050 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7efd2c0097c0 tx=0x7efd2c01c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80ba639f16dd788c server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:44.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.818+0000 7efd32ffd640 1 -- 172.21.15.53:0/4030669177 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd24001680 con 0x7efd340b4260 2023-06-10T18:56:44.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.818+0000 7efd32ffd640 1 -- 172.21.15.53:0/4030669177 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd2c0a7050 con 0x7efd340b4260 2023-06-10T18:56:44.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.818+0000 7efd32ffd640 1 -- 172.21.15.53:0/4030669177 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd2c0ab600 con 0x7efd340b4260 2023-06-10T18:56:44.824 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.818+0000 7efd3a98f640 1 -- 172.21.15.53:0/4030669177 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efd340b4260 msgr2=0x7efd3416b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:44.824 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.818+0000 7efd3a98f640 1 --2- 172.21.15.53:0/4030669177 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efd340b4260 0x7efd3416b050 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7efd2c0097c0 tx=0x7efd2c01c3a0 comp rx=0 tx=0).stop 2023-06-10T18:56:44.824 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.818+0000 7efd3a98f640 1 -- 172.21.15.53:0/4030669177 shutdown_connections 2023-06-10T18:56:44.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.818+0000 7efd3a98f640 1 --2- 172.21.15.53:0/4030669177 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efd340b4260 0x7efd3416b050 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:44.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.818+0000 7efd3a98f640 1 -- 172.21.15.53:0/4030669177 >> 172.21.15.53:0/4030669177 conn(0x7efd34069e20 msgr2=0x7efd3406a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:44.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.818+0000 7efd3a98f640 1 -- 172.21.15.53:0/4030669177 shutdown_connections 2023-06-10T18:56:44.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.818+0000 7efd3a98f640 1 -- 172.21.15.53:0/4030669177 wait complete. 2023-06-10T18:56:44.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.818+0000 7efd3a98f640 1 Processor -- start 2023-06-10T18:56:44.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.818+0000 7efd3a98f640 1 -- start start 2023-06-10T18:56:44.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.822+0000 7efd3a98f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efd340b4260 0x7efd34160770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:44.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.822+0000 7efd3a98f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd340d1790 0x7efd34152a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:44.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.822+0000 7efd3a98f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efd341603a0 0x7efd340b63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:44.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.822+0000 7efd3a98f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd340ca550 con 0x7efd340d1790 2023-06-10T18:56:44.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.822+0000 7efd3a98f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd34158bf0 con 0x7efd340b4260 2023-06-10T18:56:44.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.822+0000 7efd3a98f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd340cb920 con 0x7efd341603a0 2023-06-10T18:56:44.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.822+0000 7efd337fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd340d1790 0x7efd34152a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:44.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.822+0000 7efd337fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd340d1790 0x7efd34152a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42862/0 (socket says 172.21.15.53:42862) 2023-06-10T18:56:44.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.822+0000 7efd337fe640 1 -- 172.21.15.53:0/3468277322 learned_addr learned my addr 172.21.15.53:0/3468277322 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:44.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.822+0000 7efd38f2c640 1 --2- 172.21.15.53:0/3468277322 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efd341603a0 0x7efd340b63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:44.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.822+0000 7efd33fff640 1 --2- 172.21.15.53:0/3468277322 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efd340b4260 0x7efd34160770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:44.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.822+0000 7efd337fe640 1 -- 172.21.15.53:0/3468277322 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efd341603a0 msgr2=0x7efd340b63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:44.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.822+0000 7efd337fe640 1 --2- 172.21.15.53:0/3468277322 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efd341603a0 0x7efd340b63a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:44.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.822+0000 7efd337fe640 1 -- 172.21.15.53:0/3468277322 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efd340b4260 msgr2=0x7efd34160770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:44.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.822+0000 7efd337fe640 1 --2- 172.21.15.53:0/3468277322 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efd340b4260 0x7efd34160770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:44.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.822+0000 7efd337fe640 1 -- 172.21.15.53:0/3468277322 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd2c009420 con 0x7efd340d1790 2023-06-10T18:56:44.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.822+0000 7efd337fe640 1 --2- 172.21.15.53:0/3468277322 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd340d1790 0x7efd34152a20 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7efd2400c780 tx=0x7efd2400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:44.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.822+0000 7efd30ff9640 1 -- 172.21.15.53:0/3468277322 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd24005ae0 con 0x7efd340d1790 2023-06-10T18:56:44.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.822+0000 7efd30ff9640 1 -- 172.21.15.53:0/3468277322 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd24005c40 con 0x7efd340d1790 2023-06-10T18:56:44.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.822+0000 7efd3a98f640 1 -- 172.21.15.53:0/3468277322 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd34152f60 con 0x7efd340d1790 2023-06-10T18:56:44.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.822+0000 7efd30ff9640 1 -- 172.21.15.53:0/3468277322 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd24007070 con 0x7efd340d1790 2023-06-10T18:56:44.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.822+0000 7efd3a98f640 1 -- 172.21.15.53:0/3468277322 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd340cbb50 con 0x7efd340d1790 2023-06-10T18:56:44.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.822+0000 7efd3a98f640 1 -- 172.21.15.53:0/3468277322 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd3404d790 con 0x7efd340d1790 2023-06-10T18:56:44.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.822+0000 7efd30ff9640 1 -- 172.21.15.53:0/3468277322 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7efd240071d0 con 0x7efd340d1790 2023-06-10T18:56:44.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.822+0000 7efd30ff9640 1 --2- 172.21.15.53:0/3468277322 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efd14066280 0x7efd14068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:44.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.822+0000 7efd30ff9640 1 -- 172.21.15.53:0/3468277322 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6120+0+0 (secure 0 0 0) 0x7efd240845c0 con 0x7efd340d1790 2023-06-10T18:56:44.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.822+0000 7efd33fff640 1 --2- 172.21.15.53:0/3468277322 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efd14066280 0x7efd14068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:44.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.826+0000 7efd33fff640 1 --2- 172.21.15.53:0/3468277322 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efd14066280 0x7efd14068730 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7efd340cf1d0 tx=0x7efd1c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:44.832 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.826+0000 7efd30ff9640 1 -- 172.21.15.53:0/3468277322 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7efd24051aa0 con 0x7efd340d1790 2023-06-10T18:56:44.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.982+0000 7efd3a98f640 1 -- 172.21.15.53:0/3468277322 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efd340cf9c0 con 0x7efd340d1790 2023-06-10T18:56:44.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.982+0000 7efd30ff9640 1 -- 172.21.15.53:0/3468277322 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v53) v1 ==== 93+0+10 (secure 0 0 0) 0x7efd240550c0 con 0x7efd340d1790 2023-06-10T18:56:44.987 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-06-10T18:56:44.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.982+0000 7efd3a98f640 1 -- 172.21.15.53:0/3468277322 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efd14066280 msgr2=0x7efd14068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:44.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.982+0000 7efd3a98f640 1 --2- 172.21.15.53:0/3468277322 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efd14066280 0x7efd14068730 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7efd340cf1d0 tx=0x7efd1c009040 comp rx=0 tx=0).stop 2023-06-10T18:56:44.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.982+0000 7efd3a98f640 1 -- 172.21.15.53:0/3468277322 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd340d1790 msgr2=0x7efd34152a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:44.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.982+0000 7efd3a98f640 1 --2- 172.21.15.53:0/3468277322 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd340d1790 0x7efd34152a20 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7efd2400c780 tx=0x7efd2400cc40 comp rx=0 tx=0).stop 2023-06-10T18:56:44.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.982+0000 7efd3a98f640 1 -- 172.21.15.53:0/3468277322 shutdown_connections 2023-06-10T18:56:44.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.982+0000 7efd3a98f640 1 --2- 172.21.15.53:0/3468277322 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efd14066280 0x7efd14068730 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:44.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.982+0000 7efd3a98f640 1 --2- 172.21.15.53:0/3468277322 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efd341603a0 0x7efd340b63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:44.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.982+0000 7efd3a98f640 1 --2- 172.21.15.53:0/3468277322 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd340d1790 0x7efd34152a20 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:44.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.982+0000 7efd3a98f640 1 --2- 172.21.15.53:0/3468277322 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efd340b4260 0x7efd34160770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:44.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.982+0000 7efd3a98f640 1 -- 172.21.15.53:0/3468277322 >> 172.21.15.53:0/3468277322 conn(0x7efd34069e20 msgr2=0x7efd3415ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:44.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.982+0000 7efd3a98f640 1 -- 172.21.15.53:0/3468277322 shutdown_connections 2023-06-10T18:56:44.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:44.982+0000 7efd3a98f640 1 -- 172.21.15.53:0/3468277322 wait complete. 2023-06-10T18:56:45.006 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-10T18:56:45.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.126+0000 7ffbd0183640 1 Processor -- start 2023-06-10T18:56:45.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.126+0000 7ffbd0183640 1 -- start start 2023-06-10T18:56:45.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.126+0000 7ffbd0183640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffbc815c090 0x7ffbc80b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:45.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.126+0000 7ffbd0183640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ffbc80b0b90 0x7ffbc80b7720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:45.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.126+0000 7ffbd0183640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ffbc80b7c60 0x7ffbc80b3b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:45.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.126+0000 7ffbd0183640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbc80b80e0 con 0x7ffbc80b7c60 2023-06-10T18:56:45.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.126+0000 7ffbd0183640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbc80cc7c0 con 0x7ffbc80b0b90 2023-06-10T18:56:45.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.126+0000 7ffbd0183640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc80ccaa0 con 0x7ffbc815c090 2023-06-10T18:56:45.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.126+0000 7ffbce720640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ffbc80b7c60 0x7ffbc80b3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:45.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.126+0000 7ffbce720640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ffbc80b7c60 0x7ffbc80b3b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42872/0 (socket says 172.21.15.53:42872) 2023-06-10T18:56:45.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.126+0000 7ffbce720640 1 -- 172.21.15.53:0/3357858895 learned_addr learned my addr 172.21.15.53:0/3357858895 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:45.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.126+0000 7ffbcd71e640 1 --2- 172.21.15.53:0/3357858895 >> v2:172.21.15.117:3300/0 conn(0x7ffbc80b0b90 0x7ffbc80b7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:45.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.126+0000 7ffbcdf1f640 1 --2- 172.21.15.53:0/3357858895 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffbc815c090 0x7ffbc80b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:45.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.126+0000 7ffbce720640 1 -- 172.21.15.53:0/3357858895 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffbc815c090 msgr2=0x7ffbc80b10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:45.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.126+0000 7ffbce720640 1 --2- 172.21.15.53:0/3357858895 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffbc815c090 0x7ffbc80b10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:45.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.126+0000 7ffbce720640 1 -- 172.21.15.53:0/3357858895 >> v2:172.21.15.117:3300/0 conn(0x7ffbc80b0b90 msgr2=0x7ffbc80b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:45.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.126+0000 7ffbce720640 1 --2- 172.21.15.53:0/3357858895 >> v2:172.21.15.117:3300/0 conn(0x7ffbc80b0b90 0x7ffbc80b7720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:45.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.126+0000 7ffbce720640 1 -- 172.21.15.53:0/3357858895 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbc80ccd80 con 0x7ffbc80b7c60 2023-06-10T18:56:45.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.130+0000 7ffbce720640 1 --2- 172.21.15.53:0/3357858895 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffbc80b7c60 0x7ffbc80b3b50 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7ffbc806b390 tx=0x7ffbc001c650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a397cc22f759a01d server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:45.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.130+0000 7ffbccf1d640 1 -- 172.21.15.53:0/3357858895 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc00a64e0 con 0x7ffbc80b7c60 2023-06-10T18:56:45.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.130+0000 7ffbccf1d640 1 -- 172.21.15.53:0/3357858895 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc00a6640 con 0x7ffbc80b7c60 2023-06-10T18:56:45.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.130+0000 7ffbccf1d640 1 -- 172.21.15.53:0/3357858895 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc00a69d0 con 0x7ffbc80b7c60 2023-06-10T18:56:45.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.130+0000 7ffbd0183640 1 -- 172.21.15.53:0/3357858895 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffbc80b7c60 msgr2=0x7ffbc80b3b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:45.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.130+0000 7ffbd0183640 1 --2- 172.21.15.53:0/3357858895 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffbc80b7c60 0x7ffbc80b3b50 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7ffbc806b390 tx=0x7ffbc001c650 comp rx=0 tx=0).stop 2023-06-10T18:56:45.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.130+0000 7ffbd0183640 1 -- 172.21.15.53:0/3357858895 shutdown_connections 2023-06-10T18:56:45.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.130+0000 7ffbd0183640 1 --2- 172.21.15.53:0/3357858895 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffbc80b7c60 0x7ffbc80b3b50 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:45.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.130+0000 7ffbd0183640 1 --2- 172.21.15.53:0/3357858895 >> v2:172.21.15.117:3300/0 conn(0x7ffbc80b0b90 0x7ffbc80b7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:45.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.130+0000 7ffbd0183640 1 --2- 172.21.15.53:0/3357858895 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffbc815c090 0x7ffbc80b10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:45.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.130+0000 7ffbd0183640 1 -- 172.21.15.53:0/3357858895 >> 172.21.15.53:0/3357858895 conn(0x7ffbc8069e20 msgr2=0x7ffbc806a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:45.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.130+0000 7ffbd0183640 1 -- 172.21.15.53:0/3357858895 shutdown_connections 2023-06-10T18:56:45.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.130+0000 7ffbd0183640 1 -- 172.21.15.53:0/3357858895 wait complete. 2023-06-10T18:56:45.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.130+0000 7ffbd0183640 1 Processor -- start 2023-06-10T18:56:45.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.130+0000 7ffbd0183640 1 -- start start 2023-06-10T18:56:45.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.130+0000 7ffbd0183640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffbc80b0b90 0x7ffbc80b3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:45.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.130+0000 7ffbd0183640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffbc80b7c60 0x7ffbc81513e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:45.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.130+0000 7ffbd0183640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffbc815c090 0x7ffbc814d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:45.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.130+0000 7ffbd0183640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc81568f0 con 0x7ffbc80b0b90 2023-06-10T18:56:45.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.130+0000 7ffbd0183640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc8156bd0 con 0x7ffbc815c090 2023-06-10T18:56:45.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.130+0000 7ffbd0183640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc8156eb0 con 0x7ffbc80b7c60 2023-06-10T18:56:45.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.130+0000 7ffbcdf1f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffbc80b0b90 0x7ffbc80b3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:45.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.130+0000 7ffbcdf1f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffbc80b0b90 0x7ffbc80b3980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42874/0 (socket says 172.21.15.53:42874) 2023-06-10T18:56:45.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.134+0000 7ffbcdf1f640 1 -- 172.21.15.53:0/2618882002 learned_addr learned my addr 172.21.15.53:0/2618882002 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:45.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.134+0000 7ffbce720640 1 --2- 172.21.15.53:0/2618882002 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffbc815c090 0x7ffbc814d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:45.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.134+0000 7ffbcd71e640 1 --2- 172.21.15.53:0/2618882002 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffbc80b7c60 0x7ffbc81513e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:45.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.134+0000 7ffbcdf1f640 1 -- 172.21.15.53:0/2618882002 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffbc80b7c60 msgr2=0x7ffbc81513e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:45.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.134+0000 7ffbcdf1f640 1 --2- 172.21.15.53:0/2618882002 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffbc80b7c60 0x7ffbc81513e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:45.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.134+0000 7ffbcdf1f640 1 -- 172.21.15.53:0/2618882002 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffbc815c090 msgr2=0x7ffbc814d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:45.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.134+0000 7ffbcdf1f640 1 --2- 172.21.15.53:0/2618882002 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffbc815c090 0x7ffbc814d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:45.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.134+0000 7ffbcdf1f640 1 -- 172.21.15.53:0/2618882002 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbc0009b30 con 0x7ffbc80b0b90 2023-06-10T18:56:45.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.134+0000 7ffbce720640 1 --2- 172.21.15.53:0/2618882002 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffbc815c090 0x7ffbc814d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:56:45.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.134+0000 7ffbcdf1f640 1 --2- 172.21.15.53:0/2618882002 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffbc80b0b90 0x7ffbc80b3980 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7ffbc400d5f0 tx=0x7ffbc400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:45.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.134+0000 7ffbbe7fc640 1 -- 172.21.15.53:0/2618882002 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc40125f0 con 0x7ffbc80b0b90 2023-06-10T18:56:45.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.134+0000 7ffbbe7fc640 1 -- 172.21.15.53:0/2618882002 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc4012750 con 0x7ffbc80b0b90 2023-06-10T18:56:45.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.134+0000 7ffbd0183640 1 -- 172.21.15.53:0/2618882002 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbc8157190 con 0x7ffbc80b0b90 2023-06-10T18:56:45.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.134+0000 7ffbbe7fc640 1 -- 172.21.15.53:0/2618882002 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc4012ae0 con 0x7ffbc80b0b90 2023-06-10T18:56:45.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.134+0000 7ffbd0183640 1 -- 172.21.15.53:0/2618882002 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbc8157750 con 0x7ffbc80b0b90 2023-06-10T18:56:45.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.134+0000 7ffbd0183640 1 -- 172.21.15.53:0/2618882002 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbc81578e0 con 0x7ffbc80b0b90 2023-06-10T18:56:45.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.134+0000 7ffbbe7fc640 1 -- 172.21.15.53:0/2618882002 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ffbc4012c40 con 0x7ffbc80b0b90 2023-06-10T18:56:45.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.134+0000 7ffbbe7fc640 1 --2- 172.21.15.53:0/2618882002 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ffbac066280 0x7ffbac068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:45.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.134+0000 7ffbbe7fc640 1 -- 172.21.15.53:0/2618882002 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6120+0+0 (secure 0 0 0) 0x7ffbc40842a0 con 0x7ffbc80b0b90 2023-06-10T18:56:45.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.134+0000 7ffbcd71e640 1 --2- 172.21.15.53:0/2618882002 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ffbac066280 0x7ffbac068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:45.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.138+0000 7ffbcd71e640 1 --2- 172.21.15.53:0/2618882002 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ffbac066280 0x7ffbac068730 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ffbc80d2620 tx=0x7ffbb8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:45.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.138+0000 7ffbbe7fc640 1 -- 172.21.15.53:0/2618882002 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ffbc40516e0 con 0x7ffbc80b0b90 2023-06-10T18:56:45.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.290+0000 7ffbd0183640 1 -- 172.21.15.53:0/2618882002 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ffbc804d790 con 0x7ffbc80b0b90 2023-06-10T18:56:45.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.294+0000 7ffbbe7fc640 1 -- 172.21.15.53:0/2618882002 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v53) v1 ==== 92+0+10 (secure 0 0 0) 0x7ffbc4007380 con 0x7ffbc80b0b90 2023-06-10T18:56:45.298 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-06-10T18:56:45.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.294+0000 7ffbd0183640 1 -- 172.21.15.53:0/2618882002 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ffbac066280 msgr2=0x7ffbac068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:45.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.294+0000 7ffbd0183640 1 --2- 172.21.15.53:0/2618882002 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ffbac066280 0x7ffbac068730 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ffbc80d2620 tx=0x7ffbb8008040 comp rx=0 tx=0).stop 2023-06-10T18:56:45.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.294+0000 7ffbd0183640 1 -- 172.21.15.53:0/2618882002 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffbc80b0b90 msgr2=0x7ffbc80b3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:45.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.294+0000 7ffbd0183640 1 --2- 172.21.15.53:0/2618882002 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffbc80b0b90 0x7ffbc80b3980 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7ffbc400d5f0 tx=0x7ffbc400dab0 comp rx=0 tx=0).stop 2023-06-10T18:56:45.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.294+0000 7ffbd0183640 1 -- 172.21.15.53:0/2618882002 shutdown_connections 2023-06-10T18:56:45.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.294+0000 7ffbd0183640 1 --2- 172.21.15.53:0/2618882002 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ffbac066280 0x7ffbac068730 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:45.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.294+0000 7ffbd0183640 1 --2- 172.21.15.53:0/2618882002 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffbc815c090 0x7ffbc814d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:45.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.294+0000 7ffbd0183640 1 --2- 172.21.15.53:0/2618882002 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffbc80b7c60 0x7ffbc81513e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:45.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.294+0000 7ffbd0183640 1 --2- 172.21.15.53:0/2618882002 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffbc80b0b90 0x7ffbc80b3980 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:45.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.294+0000 7ffbd0183640 1 -- 172.21.15.53:0/2618882002 >> 172.21.15.53:0/2618882002 conn(0x7ffbc8069e20 msgr2=0x7ffbc80b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:45.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.294+0000 7ffbd0183640 1 -- 172.21.15.53:0/2618882002 shutdown_connections 2023-06-10T18:56:45.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.294+0000 7ffbd0183640 1 -- 172.21.15.53:0/2618882002 wait complete. 2023-06-10T18:56:45.317 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-10T18:56:45.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.434+0000 7f381c271640 1 Processor -- start 2023-06-10T18:56:45.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.434+0000 7f381c271640 1 -- start start 2023-06-10T18:56:45.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.434+0000 7f381c271640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f38140c82a0 0x7f38140c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:45.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.434+0000 7f381c271640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f38140af760 0x7f38140afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:45.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.434+0000 7f381c271640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f381406b090 con 0x7f38140c9fa0 2023-06-10T18:56:45.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.434+0000 7f381c271640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38140b0120 con 0x7f38140c82a0 2023-06-10T18:56:45.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.434+0000 7f381c271640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38140ca370 con 0x7f38140af760 2023-06-10T18:56:45.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.434+0000 7f381980c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f38140c82a0 0x7f38140c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:45.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.434+0000 7f381980c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f38140c82a0 0x7f38140c86f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42884/0 (socket says 172.21.15.53:42884) 2023-06-10T18:56:45.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.434+0000 7f381980c640 1 -- 172.21.15.53:0/2147801278 learned_addr learned my addr 172.21.15.53:0/2147801278 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:45.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.434+0000 7f381a80e640 1 --2- 172.21.15.53:0/2147801278 >> v2:172.21.15.117:3300/0 conn(0x7f38140af760 0x7f38140afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:45.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.434+0000 7f381980c640 1 -- 172.21.15.53:0/2147801278 >> v2:172.21.15.117:3300/0 conn(0x7f38140af760 msgr2=0x7f38140afbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:45.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.434+0000 7f381980c640 1 --2- 172.21.15.53:0/2147801278 >> v2:172.21.15.117:3300/0 conn(0x7f38140af760 0x7f38140afbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:45.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.434+0000 7f381980c640 1 -- 172.21.15.53:0/2147801278 >> v1:172.21.15.117:6789/0 conn(0x7f38140c9fa0 legacy=0x7f381406bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:45.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.434+0000 7f381980c640 1 -- 172.21.15.53:0/2147801278 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3814070d50 con 0x7f38140c82a0 2023-06-10T18:56:45.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.434+0000 7f381a80e640 1 --2- 172.21.15.53:0/2147801278 >> v2:172.21.15.117:3300/0 conn(0x7f38140af760 0x7f38140afbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:56:45.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.438+0000 7f381980c640 1 --2- 172.21.15.53:0/2147801278 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38140c82a0 0x7f38140c86f0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f381406fc20 tx=0x7f380401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ca4a706e91338d5 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:45.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.438+0000 7f381900b640 1 -- 172.21.15.53:0/2147801278 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38040ab600 con 0x7f38140c82a0 2023-06-10T18:56:45.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.438+0000 7f381900b640 1 -- 172.21.15.53:0/2147801278 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38040ab760 con 0x7f38140c82a0 2023-06-10T18:56:45.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.438+0000 7f381900b640 1 -- 172.21.15.53:0/2147801278 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38040abaf0 con 0x7f38140c82a0 2023-06-10T18:56:45.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.438+0000 7f381c271640 1 -- 172.21.15.53:0/2147801278 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38140c82a0 msgr2=0x7f38140c86f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:45.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.438+0000 7f381c271640 1 --2- 172.21.15.53:0/2147801278 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38140c82a0 0x7f38140c86f0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f381406fc20 tx=0x7f380401c400 comp rx=0 tx=0).stop 2023-06-10T18:56:45.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.438+0000 7f381c271640 1 -- 172.21.15.53:0/2147801278 shutdown_connections 2023-06-10T18:56:45.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.438+0000 7f381c271640 1 --2- 172.21.15.53:0/2147801278 >> v2:172.21.15.117:3300/0 conn(0x7f38140af760 0x7f38140afbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:45.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.438+0000 7f381c271640 1 --2- 172.21.15.53:0/2147801278 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38140c82a0 0x7f38140c86f0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:45.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.438+0000 7f381c271640 1 -- 172.21.15.53:0/2147801278 >> 172.21.15.53:0/2147801278 conn(0x7f381406a0e0 msgr2=0x7f38140cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:45.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.438+0000 7f381c271640 1 -- 172.21.15.53:0/2147801278 shutdown_connections 2023-06-10T18:56:45.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.438+0000 7f381c271640 1 -- 172.21.15.53:0/2147801278 wait complete. 2023-06-10T18:56:45.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.438+0000 7f381c271640 1 Processor -- start 2023-06-10T18:56:45.445 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.438+0000 7f381c271640 1 -- start start 2023-06-10T18:56:45.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.442+0000 7f381c271640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38140af760 0x7f38140c2250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:45.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.442+0000 7f381c271640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38140c82a0 0x7f38141511e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:45.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.442+0000 7f381c271640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38140c9fa0 0x7f38140b1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:45.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.442+0000 7f381c271640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38140c2aa0 con 0x7f38140c9fa0 2023-06-10T18:56:45.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.442+0000 7f381c271640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38140c2d80 con 0x7f38140c82a0 2023-06-10T18:56:45.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.442+0000 7f381c271640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38140c3060 con 0x7f38140af760 2023-06-10T18:56:45.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.442+0000 7f381a80e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38140c9fa0 0x7f38140b1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:45.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.442+0000 7f381a80e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38140c9fa0 0x7f38140b1900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42886/0 (socket says 172.21.15.53:42886) 2023-06-10T18:56:45.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.442+0000 7f381a80e640 1 -- 172.21.15.53:0/301640277 learned_addr learned my addr 172.21.15.53:0/301640277 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:45.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.442+0000 7f381980c640 1 --2- 172.21.15.53:0/301640277 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38140c82a0 0x7f38141511e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:45.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.442+0000 7f381a00d640 1 --2- 172.21.15.53:0/301640277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38140af760 0x7f38140c2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:45.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.442+0000 7f381a80e640 1 -- 172.21.15.53:0/301640277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38140af760 msgr2=0x7f38140c2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:45.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.442+0000 7f381a80e640 1 --2- 172.21.15.53:0/301640277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38140af760 0x7f38140c2250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:45.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.442+0000 7f381a80e640 1 -- 172.21.15.53:0/301640277 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38140c82a0 msgr2=0x7f38141511e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:45.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.442+0000 7f381a80e640 1 --2- 172.21.15.53:0/301640277 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38140c82a0 0x7f38141511e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:45.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.442+0000 7f381a80e640 1 -- 172.21.15.53:0/301640277 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38040094d0 con 0x7f38140c9fa0 2023-06-10T18:56:45.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.442+0000 7f381a80e640 1 --2- 172.21.15.53:0/301640277 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38140c9fa0 0x7f38140b1900 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f380c00cef0 tx=0x7f380c00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:45.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.442+0000 7f380affd640 1 -- 172.21.15.53:0/301640277 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f380c00d840 con 0x7f38140c9fa0 2023-06-10T18:56:45.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.442+0000 7f380affd640 1 -- 172.21.15.53:0/301640277 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f380c00d9c0 con 0x7f38140c9fa0 2023-06-10T18:56:45.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.442+0000 7f381c271640 1 -- 172.21.15.53:0/301640277 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38140c3340 con 0x7f38140c9fa0 2023-06-10T18:56:45.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.442+0000 7f380affd640 1 -- 172.21.15.53:0/301640277 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f380c00dd70 con 0x7f38140c9fa0 2023-06-10T18:56:45.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.442+0000 7f381c271640 1 -- 172.21.15.53:0/301640277 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3814151720 con 0x7f38140c9fa0 2023-06-10T18:56:45.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.442+0000 7f381c271640 1 -- 172.21.15.53:0/301640277 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38140b3cc0 con 0x7f38140c9fa0 2023-06-10T18:56:45.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.442+0000 7f380affd640 1 -- 172.21.15.53:0/301640277 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f380c01e3b0 con 0x7f38140c9fa0 2023-06-10T18:56:45.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.442+0000 7f380affd640 1 --2- 172.21.15.53:0/301640277 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f37f80662b0 0x7f37f8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:45.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.442+0000 7f380affd640 1 -- 172.21.15.53:0/301640277 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f380c084830 con 0x7f38140c9fa0 2023-06-10T18:56:45.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.442+0000 7f381a00d640 1 --2- 172.21.15.53:0/301640277 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f37f80662b0 0x7f37f8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:45.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.446+0000 7f381a00d640 1 --2- 172.21.15.53:0/301640277 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f37f80662b0 0x7f37f8068760 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f381000b810 tx=0x7f3810008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:45.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.446+0000 7f380affd640 1 -- 172.21.15.53:0/301640277 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f380c051d20 con 0x7f38140c9fa0 2023-06-10T18:56:45.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.598+0000 7f381c271640 1 -- 172.21.15.53:0/301640277 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f381404d790 con 0x7f38140c9fa0 2023-06-10T18:56:45.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.598+0000 7f380affd640 1 -- 172.21.15.53:0/301640277 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v53) v1 ==== 104+0+11 (secure 0 0 0) 0x7f380c055340 con 0x7f38140c9fa0 2023-06-10T18:56:45.606 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-06-10T18:56:45.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.602+0000 7f381c271640 1 -- 172.21.15.53:0/301640277 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f37f80662b0 msgr2=0x7f37f8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:45.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.602+0000 7f381c271640 1 --2- 172.21.15.53:0/301640277 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f37f80662b0 0x7f37f8068760 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f381000b810 tx=0x7f3810008040 comp rx=0 tx=0).stop 2023-06-10T18:56:45.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.602+0000 7f381c271640 1 -- 172.21.15.53:0/301640277 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38140c9fa0 msgr2=0x7f38140b1900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:45.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.602+0000 7f381c271640 1 --2- 172.21.15.53:0/301640277 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38140c9fa0 0x7f38140b1900 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f380c00cef0 tx=0x7f380c00a710 comp rx=0 tx=0).stop 2023-06-10T18:56:45.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.602+0000 7f381c271640 1 -- 172.21.15.53:0/301640277 shutdown_connections 2023-06-10T18:56:45.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.602+0000 7f381c271640 1 --2- 172.21.15.53:0/301640277 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f37f80662b0 0x7f37f8068760 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:45.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.602+0000 7f381c271640 1 --2- 172.21.15.53:0/301640277 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38140c9fa0 0x7f38140b1900 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:45.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.602+0000 7f381c271640 1 --2- 172.21.15.53:0/301640277 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38140c82a0 0x7f38141511e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:45.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.602+0000 7f381c271640 1 --2- 172.21.15.53:0/301640277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38140af760 0x7f38140c2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:45.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.602+0000 7f381c271640 1 -- 172.21.15.53:0/301640277 >> 172.21.15.53:0/301640277 conn(0x7f381406a0e0 msgr2=0x7f38140723f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:45.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.602+0000 7f381c271640 1 -- 172.21.15.53:0/301640277 shutdown_connections 2023-06-10T18:56:45.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.602+0000 7f381c271640 1 -- 172.21.15.53:0/301640277 wait complete. 2023-06-10T18:56:45.624 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-10T18:56:45.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.738+0000 7fca3681a640 1 Processor -- start 2023-06-10T18:56:45.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.738+0000 7fca3681a640 1 -- start start 2023-06-10T18:56:45.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.738+0000 7fca3681a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fca30159690 0x7fca30070950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:45.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.738+0000 7fca3681a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fca300b0f30 0x7fca300cbe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:45.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.738+0000 7fca3681a640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca300cb080 con 0x7fca30159a60 2023-06-10T18:56:45.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.738+0000 7fca3681a640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca30070e90 con 0x7fca300b0f30 2023-06-10T18:56:45.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.738+0000 7fca3681a640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca3006d450 con 0x7fca30159690 2023-06-10T18:56:45.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.738+0000 7fca2f7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fca300b0f30 0x7fca300cbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:45.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.738+0000 7fca2f7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fca300b0f30 0x7fca300cbe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42900/0 (socket says 172.21.15.53:42900) 2023-06-10T18:56:45.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.738+0000 7fca2f7fe640 1 -- 172.21.15.53:0/3687331287 learned_addr learned my addr 172.21.15.53:0/3687331287 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:45.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.738+0000 7fca2ffff640 1 --2- 172.21.15.53:0/3687331287 >> v2:172.21.15.117:3300/0 conn(0x7fca30159690 0x7fca30070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:45.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.738+0000 7fca2f7fe640 1 -- 172.21.15.53:0/3687331287 >> v2:172.21.15.117:3300/0 conn(0x7fca30159690 msgr2=0x7fca30070950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:45.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.738+0000 7fca2f7fe640 1 --2- 172.21.15.53:0/3687331287 >> v2:172.21.15.117:3300/0 conn(0x7fca30159690 0x7fca30070950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:45.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.738+0000 7fca2f7fe640 1 -- 172.21.15.53:0/3687331287 >> v1:172.21.15.117:6789/0 conn(0x7fca30159a60 legacy=0x7fca300c2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:45.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.738+0000 7fca2f7fe640 1 -- 172.21.15.53:0/3687331287 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca300cb320 con 0x7fca300b0f30 2023-06-10T18:56:45.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.742+0000 7fca2f7fe640 1 --2- 172.21.15.53:0/3687331287 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca300b0f30 0x7fca300cbe00 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fca30071570 tx=0x7fca2401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9d8b9191f6059b2 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:45.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.742+0000 7fca2effd640 1 -- 172.21.15.53:0/3687331287 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca240aa5f0 con 0x7fca300b0f30 2023-06-10T18:56:45.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.742+0000 7fca2effd640 1 -- 172.21.15.53:0/3687331287 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca240aa750 con 0x7fca300b0f30 2023-06-10T18:56:45.747 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.742+0000 7fca2effd640 1 -- 172.21.15.53:0/3687331287 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca240aaae0 con 0x7fca300b0f30 2023-06-10T18:56:45.747 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.742+0000 7fca3681a640 1 -- 172.21.15.53:0/3687331287 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca300b0f30 msgr2=0x7fca300cbe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:45.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.742+0000 7fca3681a640 1 --2- 172.21.15.53:0/3687331287 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca300b0f30 0x7fca300cbe00 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fca30071570 tx=0x7fca2401c490 comp rx=0 tx=0).stop 2023-06-10T18:56:45.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.742+0000 7fca3681a640 1 -- 172.21.15.53:0/3687331287 shutdown_connections 2023-06-10T18:56:45.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.742+0000 7fca3681a640 1 --2- 172.21.15.53:0/3687331287 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca300b0f30 0x7fca300cbe00 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:45.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.742+0000 7fca3681a640 1 --2- 172.21.15.53:0/3687331287 >> v2:172.21.15.117:3300/0 conn(0x7fca30159690 0x7fca30070950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:45.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.742+0000 7fca3681a640 1 -- 172.21.15.53:0/3687331287 >> 172.21.15.53:0/3687331287 conn(0x7fca3006a560 msgr2=0x7fca3006a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:45.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.742+0000 7fca3681a640 1 -- 172.21.15.53:0/3687331287 shutdown_connections 2023-06-10T18:56:45.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.742+0000 7fca3681a640 1 -- 172.21.15.53:0/3687331287 wait complete. 2023-06-10T18:56:45.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.742+0000 7fca3681a640 1 Processor -- start 2023-06-10T18:56:45.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.742+0000 7fca3681a640 1 -- start start 2023-06-10T18:56:45.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.742+0000 7fca3681a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca300b0f30 0x7fca30144820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:45.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.742+0000 7fca3681a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fca30159690 0x7fca301435d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:45.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.742+0000 7fca3681a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca30159a60 0x7fca30143b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:45.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.742+0000 7fca3681a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca301529a0 con 0x7fca300b0f30 2023-06-10T18:56:45.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.742+0000 7fca3681a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca300cc980 con 0x7fca30159a60 2023-06-10T18:56:45.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.742+0000 7fca3681a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca300cd4c0 con 0x7fca30159690 2023-06-10T18:56:45.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.742+0000 7fca2ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca300b0f30 0x7fca30144820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:45.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.742+0000 7fca2ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca300b0f30 0x7fca30144820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42902/0 (socket says 172.21.15.53:42902) 2023-06-10T18:56:45.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.742+0000 7fca2ffff640 1 -- 172.21.15.53:0/136958747 learned_addr learned my addr 172.21.15.53:0/136958747 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:45.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.742+0000 7fca2ffff640 1 -- 172.21.15.53:0/136958747 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fca30159690 msgr2=0x7fca301435d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:45.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.742+0000 7fca2ffff640 1 --2- 172.21.15.53:0/136958747 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fca30159690 0x7fca301435d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:45.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.742+0000 7fca2ffff640 1 -- 172.21.15.53:0/136958747 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca30159a60 msgr2=0x7fca30143b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:45.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.742+0000 7fca2ffff640 1 --2- 172.21.15.53:0/136958747 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca30159a60 0x7fca30143b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:45.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.742+0000 7fca2ffff640 1 -- 172.21.15.53:0/136958747 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca240094d0 con 0x7fca300b0f30 2023-06-10T18:56:45.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.742+0000 7fca2ffff640 1 --2- 172.21.15.53:0/136958747 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca300b0f30 0x7fca30144820 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fca2000d800 tx=0x7fca2000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:45.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.742+0000 7fca2cff9640 1 -- 172.21.15.53:0/136958747 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2000b6c0 con 0x7fca300b0f30 2023-06-10T18:56:45.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.742+0000 7fca2cff9640 1 -- 172.21.15.53:0/136958747 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca2000b820 con 0x7fca300b0f30 2023-06-10T18:56:45.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.742+0000 7fca3681a640 1 -- 172.21.15.53:0/136958747 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca30144050 con 0x7fca300b0f30 2023-06-10T18:56:45.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.742+0000 7fca2cff9640 1 -- 172.21.15.53:0/136958747 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2000bb90 con 0x7fca300b0f30 2023-06-10T18:56:45.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.742+0000 7fca3681a640 1 -- 172.21.15.53:0/136958747 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca300ccc40 con 0x7fca300b0f30 2023-06-10T18:56:45.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.746+0000 7fca3681a640 1 -- 172.21.15.53:0/136958747 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca3004d790 con 0x7fca300b0f30 2023-06-10T18:56:45.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.746+0000 7fca2cff9640 1 -- 172.21.15.53:0/136958747 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fca2000bcf0 con 0x7fca300b0f30 2023-06-10T18:56:45.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.746+0000 7fca2cff9640 1 --2- 172.21.15.53:0/136958747 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fca1c066280 0x7fca1c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:45.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.746+0000 7fca2cff9640 1 -- 172.21.15.53:0/136958747 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fca20084380 con 0x7fca300b0f30 2023-06-10T18:56:45.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.746+0000 7fca2f7fe640 1 --2- 172.21.15.53:0/136958747 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fca1c066280 0x7fca1c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:45.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.746+0000 7fca2f7fe640 1 --2- 172.21.15.53:0/136958747 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fca1c066280 0x7fca1c068730 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fca240ae000 tx=0x7fca24008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:45.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.750+0000 7fca2cff9640 1 -- 172.21.15.53:0/136958747 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fca200551b0 con 0x7fca300b0f30 2023-06-10T18:56:45.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.902+0000 7fca3681a640 1 -- 172.21.15.53:0/136958747 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fca3006b330 con 0x7fca300b0f30 2023-06-10T18:56:45.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.902+0000 7fca2cff9640 1 -- 172.21.15.53:0/136958747 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v53) v1 ==== 100+0+11 (secure 0 0 0) 0x7fca20054d40 con 0x7fca300b0f30 2023-06-10T18:56:45.909 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-06-10T18:56:45.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.906+0000 7fca3681a640 1 -- 172.21.15.53:0/136958747 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fca1c066280 msgr2=0x7fca1c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:45.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.906+0000 7fca3681a640 1 --2- 172.21.15.53:0/136958747 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fca1c066280 0x7fca1c068730 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fca240ae000 tx=0x7fca24008040 comp rx=0 tx=0).stop 2023-06-10T18:56:45.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.906+0000 7fca3681a640 1 -- 172.21.15.53:0/136958747 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca300b0f30 msgr2=0x7fca30144820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:45.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.906+0000 7fca3681a640 1 --2- 172.21.15.53:0/136958747 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca300b0f30 0x7fca30144820 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fca2000d800 tx=0x7fca2000dcc0 comp rx=0 tx=0).stop 2023-06-10T18:56:45.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.906+0000 7fca3681a640 1 -- 172.21.15.53:0/136958747 shutdown_connections 2023-06-10T18:56:45.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.906+0000 7fca3681a640 1 --2- 172.21.15.53:0/136958747 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fca1c066280 0x7fca1c068730 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:45.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.906+0000 7fca3681a640 1 --2- 172.21.15.53:0/136958747 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca30159a60 0x7fca30143b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:45.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.906+0000 7fca3681a640 1 --2- 172.21.15.53:0/136958747 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fca30159690 0x7fca301435d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:45.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.906+0000 7fca3681a640 1 --2- 172.21.15.53:0/136958747 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca300b0f30 0x7fca30144820 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:45.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.906+0000 7fca3681a640 1 -- 172.21.15.53:0/136958747 >> 172.21.15.53:0/136958747 conn(0x7fca3006a560 msgr2=0x7fca30153490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:45.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.906+0000 7fca3681a640 1 -- 172.21.15.53:0/136958747 shutdown_connections 2023-06-10T18:56:45.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:45.906+0000 7fca3681a640 1 -- 172.21.15.53:0/136958747 wait complete. 2023-06-10T18:56:45.928 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-10T18:56:46.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.050+0000 7fe8ce14e640 1 Processor -- start 2023-06-10T18:56:46.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.050+0000 7fe8ce14e640 1 -- start start 2023-06-10T18:56:46.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.050+0000 7fe8ce14e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe8c815b9a0 0x7fe8c815fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:46.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.050+0000 7fe8ce14e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe8c80b0d70 0x7fe8c80ab860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:46.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.050+0000 7fe8ce14e640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8c806cd10 con 0x7fe8c8160360 2023-06-10T18:56:46.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.050+0000 7fe8ce14e640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8c806d5b0 con 0x7fe8c80b0d70 2023-06-10T18:56:46.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.050+0000 7fe8ce14e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c806cff0 con 0x7fe8c815b9a0 2023-06-10T18:56:46.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.050+0000 7fe8c6ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe8c80b0d70 0x7fe8c80ab860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:46.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.050+0000 7fe8c6ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe8c80b0d70 0x7fe8c80ab860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42914/0 (socket says 172.21.15.53:42914) 2023-06-10T18:56:46.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.050+0000 7fe8c6ffd640 1 -- 172.21.15.53:0/2616531696 learned_addr learned my addr 172.21.15.53:0/2616531696 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:46.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.050+0000 7fe8c77fe640 1 --2- 172.21.15.53:0/2616531696 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe8c815b9a0 0x7fe8c815fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:46.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.050+0000 7fe8c6ffd640 1 -- 172.21.15.53:0/2616531696 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe8c815b9a0 msgr2=0x7fe8c815fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:46.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.050+0000 7fe8c6ffd640 1 --2- 172.21.15.53:0/2616531696 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe8c815b9a0 0x7fe8c815fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:46.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.050+0000 7fe8c6ffd640 1 -- 172.21.15.53:0/2616531696 >> v1:172.21.15.53:6789/0 conn(0x7fe8c8160360 legacy=0x7fe8c8069450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:46.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.050+0000 7fe8c6ffd640 1 -- 172.21.15.53:0/2616531696 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8c806d2d0 con 0x7fe8c80b0d70 2023-06-10T18:56:46.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.050+0000 7fe8c77fe640 1 --2- 172.21.15.53:0/2616531696 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe8c815b9a0 0x7fe8c815fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:56:46.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.054+0000 7fe8c6ffd640 1 --2- 172.21.15.53:0/2616531696 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8c80b0d70 0x7fe8c80ab860 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc009870 tx=0x7fe8bc01cfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d326be3bdc8f1a6c server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:46.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.054+0000 7fe8c67fc640 1 -- 172.21.15.53:0/2616531696 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8bc0a9620 con 0x7fe8c80b0d70 2023-06-10T18:56:46.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.054+0000 7fe8c67fc640 1 -- 172.21.15.53:0/2616531696 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8bc0a9780 con 0x7fe8c80b0d70 2023-06-10T18:56:46.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.054+0000 7fe8c67fc640 1 -- 172.21.15.53:0/2616531696 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8bc0a9b10 con 0x7fe8c80b0d70 2023-06-10T18:56:46.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.054+0000 7fe8ce14e640 1 -- 172.21.15.53:0/2616531696 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8c80b0d70 msgr2=0x7fe8c80ab860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:46.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.054+0000 7fe8ce14e640 1 --2- 172.21.15.53:0/2616531696 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8c80b0d70 0x7fe8c80ab860 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc009870 tx=0x7fe8bc01cfa0 comp rx=0 tx=0).stop 2023-06-10T18:56:46.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.054+0000 7fe8ce14e640 1 -- 172.21.15.53:0/2616531696 shutdown_connections 2023-06-10T18:56:46.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.054+0000 7fe8ce14e640 1 --2- 172.21.15.53:0/2616531696 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8c80b0d70 0x7fe8c80ab860 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:46.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.054+0000 7fe8ce14e640 1 --2- 172.21.15.53:0/2616531696 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe8c815b9a0 0x7fe8c815fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:46.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.054+0000 7fe8ce14e640 1 -- 172.21.15.53:0/2616531696 >> 172.21.15.53:0/2616531696 conn(0x7fe8c806a560 msgr2=0x7fe8c806a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:46.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.054+0000 7fe8ce14e640 1 -- 172.21.15.53:0/2616531696 shutdown_connections 2023-06-10T18:56:46.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.054+0000 7fe8ce14e640 1 -- 172.21.15.53:0/2616531696 wait complete. 2023-06-10T18:56:46.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.054+0000 7fe8ce14e640 1 Processor -- start 2023-06-10T18:56:46.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.054+0000 7fe8ce14e640 1 -- start start 2023-06-10T18:56:46.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.054+0000 7fe8ce14e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8c80b0d70 0x7fe8c814dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:46.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.054+0000 7fe8ce14e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8c815b9a0 0x7fe8c8145fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:46.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.054+0000 7fe8ce14e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe8c8160360 0x7fe8c80ad280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:46.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.054+0000 7fe8ce14e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c8143ff0 con 0x7fe8c815b9a0 2023-06-10T18:56:46.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.054+0000 7fe8ce14e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c8146520 con 0x7fe8c80b0d70 2023-06-10T18:56:46.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.054+0000 7fe8ce14e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c814e310 con 0x7fe8c8160360 2023-06-10T18:56:46.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.058+0000 7fe8c6ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8c815b9a0 0x7fe8c8145fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:46.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.058+0000 7fe8c6ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8c815b9a0 0x7fe8c8145fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42918/0 (socket says 172.21.15.53:42918) 2023-06-10T18:56:46.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.058+0000 7fe8c6ffd640 1 -- 172.21.15.53:0/1456823044 learned_addr learned my addr 172.21.15.53:0/1456823044 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:46.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.058+0000 7fe8c6ffd640 1 -- 172.21.15.53:0/1456823044 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe8c8160360 msgr2=0x7fe8c80ad280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:46.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.058+0000 7fe8c77fe640 1 --2- 172.21.15.53:0/1456823044 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8c80b0d70 0x7fe8c814dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:46.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.058+0000 7fe8c7fff640 1 --2- 172.21.15.53:0/1456823044 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe8c8160360 0x7fe8c80ad280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:46.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.058+0000 7fe8c6ffd640 1 --2- 172.21.15.53:0/1456823044 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe8c8160360 0x7fe8c80ad280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:46.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.058+0000 7fe8c6ffd640 1 -- 172.21.15.53:0/1456823044 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8c80b0d70 msgr2=0x7fe8c814dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:46.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.058+0000 7fe8c6ffd640 1 --2- 172.21.15.53:0/1456823044 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8c80b0d70 0x7fe8c814dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:46.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.058+0000 7fe8c6ffd640 1 -- 172.21.15.53:0/1456823044 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8bc0094d0 con 0x7fe8c815b9a0 2023-06-10T18:56:46.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.058+0000 7fe8c6ffd640 1 --2- 172.21.15.53:0/1456823044 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8c815b9a0 0x7fe8c8145fe0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc0ab040 tx=0x7fe8bc01ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:46.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.058+0000 7fe8affff640 1 -- 172.21.15.53:0/1456823044 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8bc0bc450 con 0x7fe8c815b9a0 2023-06-10T18:56:46.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.058+0000 7fe8affff640 1 -- 172.21.15.53:0/1456823044 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8bc0bc5d0 con 0x7fe8c815b9a0 2023-06-10T18:56:46.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.058+0000 7fe8affff640 1 -- 172.21.15.53:0/1456823044 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8bc0bc980 con 0x7fe8c815b9a0 2023-06-10T18:56:46.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.058+0000 7fe8ce14e640 1 -- 172.21.15.53:0/1456823044 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8c814e5f0 con 0x7fe8c815b9a0 2023-06-10T18:56:46.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.058+0000 7fe8ce14e640 1 -- 172.21.15.53:0/1456823044 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8c814ebb0 con 0x7fe8c815b9a0 2023-06-10T18:56:46.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.058+0000 7fe8ce14e640 1 -- 172.21.15.53:0/1456823044 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8c804d790 con 0x7fe8c815b9a0 2023-06-10T18:56:46.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.058+0000 7fe8affff640 1 -- 172.21.15.53:0/1456823044 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe8bc0bcae0 con 0x7fe8c815b9a0 2023-06-10T18:56:46.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.058+0000 7fe8affff640 1 --2- 172.21.15.53:0/1456823044 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe8b4066280 0x7fe8b4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:46.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.058+0000 7fe8affff640 1 -- 172.21.15.53:0/1456823044 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fe8bc11e290 con 0x7fe8c815b9a0 2023-06-10T18:56:46.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.058+0000 7fe8c77fe640 1 --2- 172.21.15.53:0/1456823044 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe8b4066280 0x7fe8b4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:46.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.058+0000 7fe8c77fe640 1 --2- 172.21.15.53:0/1456823044 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe8b4066280 0x7fe8b4068730 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe8c81f7410 tx=0x7fe8b8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:46.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.062+0000 7fe8affff640 1 -- 172.21.15.53:0/1456823044 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe8bc0eb880 con 0x7fe8c815b9a0 2023-06-10T18:56:46.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.222+0000 7fe8ce14e640 1 -- 172.21.15.53:0/1456823044 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe8c80b4e10 con 0x7fe8c815b9a0 2023-06-10T18:56:46.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.222+0000 7fe8affff640 1 -- 172.21.15.53:0/1456823044 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v53) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe8bc0eeea0 con 0x7fe8c815b9a0 2023-06-10T18:56:46.229 INFO:teuthology.orchestra.run.smithi053.stderr:listed 0 entries 2023-06-10T18:56:46.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.226+0000 7fe8ce14e640 1 -- 172.21.15.53:0/1456823044 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe8b4066280 msgr2=0x7fe8b4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:46.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.226+0000 7fe8ce14e640 1 --2- 172.21.15.53:0/1456823044 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe8b4066280 0x7fe8b4068730 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe8c81f7410 tx=0x7fe8b8008040 comp rx=0 tx=0).stop 2023-06-10T18:56:46.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.226+0000 7fe8ce14e640 1 -- 172.21.15.53:0/1456823044 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8c815b9a0 msgr2=0x7fe8c8145fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:46.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.226+0000 7fe8ce14e640 1 --2- 172.21.15.53:0/1456823044 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8c815b9a0 0x7fe8c8145fe0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc0ab040 tx=0x7fe8bc01ad80 comp rx=0 tx=0).stop 2023-06-10T18:56:46.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.226+0000 7fe8ce14e640 1 -- 172.21.15.53:0/1456823044 shutdown_connections 2023-06-10T18:56:46.232 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.226+0000 7fe8ce14e640 1 --2- 172.21.15.53:0/1456823044 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe8b4066280 0x7fe8b4068730 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:46.232 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.226+0000 7fe8ce14e640 1 --2- 172.21.15.53:0/1456823044 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe8c8160360 0x7fe8c80ad280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:46.232 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.226+0000 7fe8ce14e640 1 --2- 172.21.15.53:0/1456823044 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8c815b9a0 0x7fe8c8145fe0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:46.232 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.226+0000 7fe8ce14e640 1 --2- 172.21.15.53:0/1456823044 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8c80b0d70 0x7fe8c814dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:46.232 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.226+0000 7fe8ce14e640 1 -- 172.21.15.53:0/1456823044 >> 172.21.15.53:0/1456823044 conn(0x7fe8c806a560 msgr2=0x7fe8c8069450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:46.232 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.226+0000 7fe8ce14e640 1 -- 172.21.15.53:0/1456823044 shutdown_connections 2023-06-10T18:56:46.232 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.226+0000 7fe8ce14e640 1 -- 172.21.15.53:0/1456823044 wait complete. 2023-06-10T18:56:46.246 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T18:56:46.247 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T18:56:46.253 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T18:56:46.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.414+0000 7f28fb862640 1 Processor -- start 2023-06-10T18:56:46.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.414+0000 7f28fb862640 1 -- start start 2023-06-10T18:56:46.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.418+0000 7f28fb862640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28f4159450 0x7f28f415d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:46.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.418+0000 7f28fb862640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f28f415d680 0x7f28f40cec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:46.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.418+0000 7f28fb862640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28f40cbac0 con 0x7f28f40cf180 2023-06-10T18:56:46.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.418+0000 7f28fb862640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28f40cf600 con 0x7f28f415d680 2023-06-10T18:56:46.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.418+0000 7f28fb862640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28f415dc00 con 0x7f28f4159450 2023-06-10T18:56:46.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.418+0000 7f28f8dfd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f28f415d680 0x7f28f40cec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:46.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.418+0000 7f28f8dfd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f28f415d680 0x7f28f40cec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42924/0 (socket says 172.21.15.53:42924) 2023-06-10T18:56:46.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.418+0000 7f28f8dfd640 1 -- 172.21.15.53:0/4257206378 learned_addr learned my addr 172.21.15.53:0/4257206378 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:46.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.418+0000 7f28f95fe640 1 --2- 172.21.15.53:0/4257206378 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28f4159450 0x7f28f415d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:46.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.418+0000 7f28f8dfd640 1 -- 172.21.15.53:0/4257206378 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28f4159450 msgr2=0x7f28f415d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:46.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.418+0000 7f28f8dfd640 1 --2- 172.21.15.53:0/4257206378 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28f4159450 0x7f28f415d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:46.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.418+0000 7f28f8dfd640 1 -- 172.21.15.53:0/4257206378 >> v1:172.21.15.117:6789/0 conn(0x7f28f40cf180 legacy=0x7f28f40cda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:46.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.418+0000 7f28f8dfd640 1 -- 172.21.15.53:0/4257206378 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28f415dee0 con 0x7f28f415d680 2023-06-10T18:56:46.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.418+0000 7f28f8dfd640 1 --2- 172.21.15.53:0/4257206378 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28f415d680 0x7f28f40cec40 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f28f0009870 tx=0x7f28f001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c6699ca565bc4e1 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:46.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.418+0000 7f28ebfff640 1 -- 172.21.15.53:0/4257206378 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f00ab640 con 0x7f28f415d680 2023-06-10T18:56:46.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.418+0000 7f28ebfff640 1 -- 172.21.15.53:0/4257206378 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28f00a7070 con 0x7f28f415d680 2023-06-10T18:56:46.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.418+0000 7f28ebfff640 1 -- 172.21.15.53:0/4257206378 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f00ab9c0 con 0x7f28f415d680 2023-06-10T18:56:46.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.418+0000 7f28fb862640 1 -- 172.21.15.53:0/4257206378 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28f415d680 msgr2=0x7f28f40cec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:46.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.418+0000 7f28fb862640 1 --2- 172.21.15.53:0/4257206378 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28f415d680 0x7f28f40cec40 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f28f0009870 tx=0x7f28f001c480 comp rx=0 tx=0).stop 2023-06-10T18:56:46.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.418+0000 7f28fb862640 1 -- 172.21.15.53:0/4257206378 shutdown_connections 2023-06-10T18:56:46.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.418+0000 7f28fb862640 1 --2- 172.21.15.53:0/4257206378 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28f415d680 0x7f28f40cec40 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:46.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.418+0000 7f28fb862640 1 --2- 172.21.15.53:0/4257206378 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28f4159450 0x7f28f415d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:46.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.418+0000 7f28fb862640 1 -- 172.21.15.53:0/4257206378 >> 172.21.15.53:0/4257206378 conn(0x7f28f406a090 msgr2=0x7f28f406d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:46.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.418+0000 7f28fb862640 1 -- 172.21.15.53:0/4257206378 shutdown_connections 2023-06-10T18:56:46.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.418+0000 7f28fb862640 1 -- 172.21.15.53:0/4257206378 wait complete. 2023-06-10T18:56:46.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.422+0000 7f28fb862640 1 Processor -- start 2023-06-10T18:56:46.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.422+0000 7f28fb862640 1 -- start start 2023-06-10T18:56:46.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.422+0000 7f28fb862640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28f40cf180 0x7f28f4152a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:46.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.422+0000 7f28fb862640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28f4159450 0x7f28f406b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:46.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.422+0000 7f28fb862640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28f415d680 0x7f28f41636a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:46.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.422+0000 7f28fb862640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28f406c340 con 0x7f28f4159450 2023-06-10T18:56:46.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.422+0000 7f28fb862640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28f406a560 con 0x7f28f40cf180 2023-06-10T18:56:46.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.422+0000 7f28fb862640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28f406c080 con 0x7f28f415d680 2023-06-10T18:56:46.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.422+0000 7f28f8dfd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28f4159450 0x7f28f406b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:46.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.422+0000 7f28f8dfd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28f4159450 0x7f28f406b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42930/0 (socket says 172.21.15.53:42930) 2023-06-10T18:56:46.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.422+0000 7f28f8dfd640 1 -- 172.21.15.53:0/3610739877 learned_addr learned my addr 172.21.15.53:0/3610739877 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:46.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.422+0000 7f28f95fe640 1 --2- 172.21.15.53:0/3610739877 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28f40cf180 0x7f28f4152a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:46.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.422+0000 7f28f9dff640 1 --2- 172.21.15.53:0/3610739877 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28f415d680 0x7f28f41636a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:46.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.422+0000 7f28f8dfd640 1 -- 172.21.15.53:0/3610739877 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28f415d680 msgr2=0x7f28f41636a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:46.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.422+0000 7f28f8dfd640 1 --2- 172.21.15.53:0/3610739877 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28f415d680 0x7f28f41636a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:46.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.422+0000 7f28f8dfd640 1 -- 172.21.15.53:0/3610739877 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28f40cf180 msgr2=0x7f28f4152a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:46.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.422+0000 7f28f8dfd640 1 --2- 172.21.15.53:0/3610739877 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28f40cf180 0x7f28f4152a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:46.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.422+0000 7f28f8dfd640 1 -- 172.21.15.53:0/3610739877 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28f00094d0 con 0x7f28f4159450 2023-06-10T18:56:46.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.422+0000 7f28f95fe640 1 --2- 172.21.15.53:0/3610739877 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28f40cf180 0x7f28f4152a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:56:46.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.422+0000 7f28f9dff640 1 --2- 172.21.15.53:0/3610739877 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28f415d680 0x7f28f41636a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:56:46.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.422+0000 7f28f8dfd640 1 --2- 172.21.15.53:0/3610739877 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28f4159450 0x7f28f406b690 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f28f00ad040 tx=0x7f28f001acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:46.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.422+0000 7f28e9ffb640 1 -- 172.21.15.53:0/3610739877 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f00be3f0 con 0x7f28f4159450 2023-06-10T18:56:46.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.422+0000 7f28e9ffb640 1 -- 172.21.15.53:0/3610739877 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28f00be570 con 0x7f28f4159450 2023-06-10T18:56:46.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.422+0000 7f28e9ffb640 1 -- 172.21.15.53:0/3610739877 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f00be920 con 0x7f28f4159450 2023-06-10T18:56:46.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.422+0000 7f28fb862640 1 -- 172.21.15.53:0/3610739877 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28f406a770 con 0x7f28f4159450 2023-06-10T18:56:46.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.422+0000 7f28fb862640 1 -- 172.21.15.53:0/3610739877 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28f406ad30 con 0x7f28f4159450 2023-06-10T18:56:46.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.426+0000 7f28fb862640 1 -- 172.21.15.53:0/3610739877 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28f406af20 con 0x7f28f4159450 2023-06-10T18:56:46.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.426+0000 7f28e9ffb640 1 -- 172.21.15.53:0/3610739877 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f28f00b43f0 con 0x7f28f4159450 2023-06-10T18:56:46.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.426+0000 7f28e9ffb640 1 --2- 172.21.15.53:0/3610739877 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f28d80662b0 0x7f28d8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:46.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.426+0000 7f28e9ffb640 1 -- 172.21.15.53:0/3610739877 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f28f011e240 con 0x7f28f4159450 2023-06-10T18:56:46.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.426+0000 7f28f95fe640 1 --2- 172.21.15.53:0/3610739877 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f28d80662b0 0x7f28d8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:46.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.426+0000 7f28f95fe640 1 --2- 172.21.15.53:0/3610739877 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f28d80662b0 0x7f28d8068760 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f28e40097a0 tx=0x7f28e4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:46.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.430+0000 7f28e9ffb640 1 -- 172.21.15.53:0/3610739877 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f28f00eb730 con 0x7f28f4159450 2023-06-10T18:56:46.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.578+0000 7f28fb862640 1 -- 172.21.15.53:0/3610739877 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f28f404d790 con 0x7f28f4159450 2023-06-10T18:56:46.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.582+0000 7f28e9ffb640 1 -- 172.21.15.53:0/3610739877 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+18434 (secure 0 0 0) 0x7f28f00eed50 con 0x7f28f4159450 2023-06-10T18:56:46.587 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:56:46.587 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":53,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T18:56:27.877880+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-06-10T18:56:16.364582+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-06-10T18:56:17.656793+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.e","mappings":[{"from":0,"to":6}]},{"pgid":"8.1d","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T18:56:46.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.582+0000 7f28fb862640 1 -- 172.21.15.53:0/3610739877 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f28d80662b0 msgr2=0x7f28d8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:46.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.582+0000 7f28fb862640 1 --2- 172.21.15.53:0/3610739877 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f28d80662b0 0x7f28d8068760 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f28e40097a0 tx=0x7f28e4008040 comp rx=0 tx=0).stop 2023-06-10T18:56:46.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.582+0000 7f28fb862640 1 -- 172.21.15.53:0/3610739877 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28f4159450 msgr2=0x7f28f406b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:46.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.582+0000 7f28fb862640 1 --2- 172.21.15.53:0/3610739877 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28f4159450 0x7f28f406b690 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f28f00ad040 tx=0x7f28f001acc0 comp rx=0 tx=0).stop 2023-06-10T18:56:46.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.582+0000 7f28fb862640 1 -- 172.21.15.53:0/3610739877 shutdown_connections 2023-06-10T18:56:46.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.582+0000 7f28fb862640 1 --2- 172.21.15.53:0/3610739877 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f28d80662b0 0x7f28d8068760 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:46.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.582+0000 7f28fb862640 1 --2- 172.21.15.53:0/3610739877 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28f415d680 0x7f28f41636a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:46.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.582+0000 7f28fb862640 1 --2- 172.21.15.53:0/3610739877 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28f4159450 0x7f28f406b690 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:46.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.582+0000 7f28fb862640 1 --2- 172.21.15.53:0/3610739877 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28f40cf180 0x7f28f4152a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:46.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.582+0000 7f28fb862640 1 -- 172.21.15.53:0/3610739877 >> 172.21.15.53:0/3610739877 conn(0x7f28f406a090 msgr2=0x7f28f40b11e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:46.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.582+0000 7f28fb862640 1 -- 172.21.15.53:0/3610739877 shutdown_connections 2023-06-10T18:56:46.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.582+0000 7f28fb862640 1 -- 172.21.15.53:0/3610739877 wait complete. 2023-06-10T18:56:46.604 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-10T18:52:33.633114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-10T18:52:39.171487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-10T18:56:16.364582+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2023-06-10T18:56:17.656793+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '51', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-10T18:56:46.605 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-10T18:56:46.732 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.726+0000 7f7fece56640 1 Processor -- start 2023-06-10T18:56:46.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.726+0000 7f7fece56640 1 -- start start 2023-06-10T18:56:46.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.730+0000 7f7fece56640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7fe815dae0 0x7f7fe806b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:46.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.730+0000 7f7fece56640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fe8070910 con 0x7f7fe80700e0 2023-06-10T18:56:46.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.730+0000 7f7fece56640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fe8070bf0 con 0x7f7fe80af760 2023-06-10T18:56:46.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.730+0000 7f7fece56640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe8070ed0 con 0x7f7fe815dae0 2023-06-10T18:56:46.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.730+0000 7f7fe5d9b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f7fe80700e0 0x7f7fe80c82a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:50450/0 (socket says 172.21.15.53:50450) 2023-06-10T18:56:46.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.730+0000 7f7fe5d9b640 1 -- 172.21.15.53:0/3487382009 learned_addr learned my addr 172.21.15.53:0/3487382009 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:56:46.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.730+0000 7f7fe6d9d640 1 --2- 172.21.15.53:0/3487382009 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7fe815dae0 0x7f7fe806b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:46.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.730+0000 7f7fe559a640 1 -- 172.21.15.53:0/3487382009 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2365533215 0 0) 0x7f7fe8070910 con 0x7f7fe80700e0 2023-06-10T18:56:46.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.730+0000 7f7fe559a640 1 -- 172.21.15.53:0/3487382009 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fd0003530 con 0x7f7fe80700e0 2023-06-10T18:56:46.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.730+0000 7f7fe559a640 1 -- 172.21.15.53:0/3487382009 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3654647834 0 0) 0x7f7fe8070bf0 con 0x7f7fe80af760 2023-06-10T18:56:46.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.730+0000 7f7fe559a640 1 -- 172.21.15.53:0/3487382009 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fe8070910 con 0x7f7fe80af760 2023-06-10T18:56:46.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.730+0000 7f7fe559a640 1 -- 172.21.15.53:0/3487382009 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1938852727 0 0) 0x7f7fd0003530 con 0x7f7fe80700e0 2023-06-10T18:56:46.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.730+0000 7f7fe6d9d640 1 -- 172.21.15.53:0/3487382009 >> v1:172.21.15.117:6789/0 conn(0x7f7fe80af760 legacy=0x7f7fe80afb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:46.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.730+0000 7f7fe6d9d640 1 -- 172.21.15.53:0/3487382009 >> v1:172.21.15.53:6789/0 conn(0x7f7fe80700e0 legacy=0x7f7fe80c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:46.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.730+0000 7f7fe6d9d640 1 -- 172.21.15.53:0/3487382009 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe80711b0 con 0x7f7fe815dae0 2023-06-10T18:56:46.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.730+0000 7f7fe6d9d640 1 --2- 172.21.15.53:0/3487382009 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7fe815dae0 0x7f7fe806b650 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7fe0009dc0 tx=0x7f7fe001c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7914e0eeaf7d90 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:46.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.730+0000 7f7fe559a640 1 -- 172.21.15.53:0/3487382009 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fdc001680 con 0x7f7fe815dae0 2023-06-10T18:56:46.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.730+0000 7f7fe559a640 1 -- 172.21.15.53:0/3487382009 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fe00a55c0 con 0x7f7fe815dae0 2023-06-10T18:56:46.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.730+0000 7f7fe559a640 1 -- 172.21.15.53:0/3487382009 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe00a5930 con 0x7f7fe815dae0 2023-06-10T18:56:46.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.734+0000 7f7fece56640 1 -- 172.21.15.53:0/3487382009 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7fe815dae0 msgr2=0x7f7fe806b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:46.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.734+0000 7f7fece56640 1 --2- 172.21.15.53:0/3487382009 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7fe815dae0 0x7f7fe806b650 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7fe0009dc0 tx=0x7f7fe001c860 comp rx=0 tx=0).stop 2023-06-10T18:56:46.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.734+0000 7f7fece56640 1 -- 172.21.15.53:0/3487382009 shutdown_connections 2023-06-10T18:56:46.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.734+0000 7f7fece56640 1 --2- 172.21.15.53:0/3487382009 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7fe815dae0 0x7f7fe806b650 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:46.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.734+0000 7f7fece56640 1 -- 172.21.15.53:0/3487382009 >> 172.21.15.53:0/3487382009 conn(0x7f7fe806a0e0 msgr2=0x7f7fe80cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:46.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.734+0000 7f7fece56640 1 -- 172.21.15.53:0/3487382009 shutdown_connections 2023-06-10T18:56:46.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.734+0000 7f7fece56640 1 -- 172.21.15.53:0/3487382009 wait complete. 2023-06-10T18:56:46.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.734+0000 7f7fece56640 1 Processor -- start 2023-06-10T18:56:46.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.734+0000 7f7fece56640 1 -- start start 2023-06-10T18:56:46.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.734+0000 7f7fece56640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7fe80700e0 0x7f7fe80c5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:46.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.734+0000 7f7fece56640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7fe80af760 0x7f7fe80cb820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:46.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.734+0000 7f7fece56640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7fe815dae0 0x7f7fe80ab860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:46.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.734+0000 7f7fece56640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe8153740 con 0x7f7fe80700e0 2023-06-10T18:56:46.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.734+0000 7f7fece56640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe80ac7e0 con 0x7f7fe80af760 2023-06-10T18:56:46.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.734+0000 7f7fece56640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe80ac220 con 0x7f7fe815dae0 2023-06-10T18:56:46.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.734+0000 7f7fe659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7fe80700e0 0x7f7fe80c5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:46.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.734+0000 7f7fe659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7fe80700e0 0x7f7fe80c5440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42940/0 (socket says 172.21.15.53:42940) 2023-06-10T18:56:46.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.734+0000 7f7fe659c640 1 -- 172.21.15.53:0/1439450104 learned_addr learned my addr 172.21.15.53:0/1439450104 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:46.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.734+0000 7f7fe5d9b640 1 --2- 172.21.15.53:0/1439450104 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7fe80af760 0x7f7fe80cb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:46.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.734+0000 7f7fe6d9d640 1 --2- 172.21.15.53:0/1439450104 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7fe815dae0 0x7f7fe80ab860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:46.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.734+0000 7f7fe659c640 1 -- 172.21.15.53:0/1439450104 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7fe815dae0 msgr2=0x7f7fe80ab860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:46.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.734+0000 7f7fe659c640 1 --2- 172.21.15.53:0/1439450104 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7fe815dae0 0x7f7fe80ab860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:46.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.734+0000 7f7fe659c640 1 -- 172.21.15.53:0/1439450104 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7fe80af760 msgr2=0x7f7fe80cb820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:46.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.734+0000 7f7fe659c640 1 --2- 172.21.15.53:0/1439450104 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7fe80af760 0x7f7fe80cb820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:46.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.734+0000 7f7fe659c640 1 -- 172.21.15.53:0/1439450104 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe0009a70 con 0x7f7fe80700e0 2023-06-10T18:56:46.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.734+0000 7f7fe659c640 1 --2- 172.21.15.53:0/1439450104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7fe80700e0 0x7f7fe80c5440 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f7fd800c500 tx=0x7f7fd800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:46.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.734+0000 7f7fd6ffd640 1 -- 172.21.15.53:0/1439450104 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd80052d0 con 0x7f7fe80700e0 2023-06-10T18:56:46.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.734+0000 7f7fd6ffd640 1 -- 172.21.15.53:0/1439450104 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fd8005470 con 0x7f7fe80700e0 2023-06-10T18:56:46.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.734+0000 7f7fd6ffd640 1 -- 172.21.15.53:0/1439450104 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd8003840 con 0x7f7fe80700e0 2023-06-10T18:56:46.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.734+0000 7f7fece56640 1 -- 172.21.15.53:0/1439450104 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fe80ac500 con 0x7f7fe80700e0 2023-06-10T18:56:46.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.734+0000 7f7fece56640 1 -- 172.21.15.53:0/1439450104 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fe80c5980 con 0x7f7fe80700e0 2023-06-10T18:56:46.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.738+0000 7f7fece56640 1 -- 172.21.15.53:0/1439450104 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fe8153880 con 0x7f7fe80700e0 2023-06-10T18:56:46.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.738+0000 7f7fd6ffd640 1 -- 172.21.15.53:0/1439450104 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7fd80039a0 con 0x7f7fe80700e0 2023-06-10T18:56:46.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.738+0000 7f7fd6ffd640 1 --2- 172.21.15.53:0/1439450104 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7fc8066280 0x7f7fc8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:46.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.738+0000 7f7fd6ffd640 1 -- 172.21.15.53:0/1439450104 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f7fd80831f0 con 0x7f7fe80700e0 2023-06-10T18:56:46.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.738+0000 7f7fe5d9b640 1 --2- 172.21.15.53:0/1439450104 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7fc8066280 0x7f7fc8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:46.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.738+0000 7f7fe5d9b640 1 --2- 172.21.15.53:0/1439450104 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7fc8066280 0x7f7fc8068730 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f7fe8155a90 tx=0x7f7fdc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:46.747 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.742+0000 7f7fd6ffd640 1 -- 172.21.15.53:0/1439450104 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7fe8153880 con 0x7f7fe80700e0 2023-06-10T18:56:46.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.894+0000 7f7fece56640 1 -- 172.21.15.53:0/1439450104 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7fe8153880 con 0x7f7fe80700e0 2023-06-10T18:56:46.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.894+0000 7f7fd6ffd640 1 -- 172.21.15.53:0/1439450104 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v53) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7fe8153880 con 0x7f7fe80700e0 2023-06-10T18:56:46.901 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-06-10T18:56:46.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.898+0000 7f7fece56640 1 -- 172.21.15.53:0/1439450104 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7fc8066280 msgr2=0x7f7fc8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:46.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.898+0000 7f7fece56640 1 --2- 172.21.15.53:0/1439450104 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7fc8066280 0x7f7fc8068730 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f7fe8155a90 tx=0x7f7fdc009040 comp rx=0 tx=0).stop 2023-06-10T18:56:46.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.898+0000 7f7fece56640 1 -- 172.21.15.53:0/1439450104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7fe80700e0 msgr2=0x7f7fe80c5440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:46.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.898+0000 7f7fece56640 1 --2- 172.21.15.53:0/1439450104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7fe80700e0 0x7f7fe80c5440 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f7fd800c500 tx=0x7f7fd800c9c0 comp rx=0 tx=0).stop 2023-06-10T18:56:46.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.898+0000 7f7fece56640 1 -- 172.21.15.53:0/1439450104 shutdown_connections 2023-06-10T18:56:46.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.898+0000 7f7fece56640 1 --2- 172.21.15.53:0/1439450104 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7fc8066280 0x7f7fc8068730 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:46.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.898+0000 7f7fece56640 1 --2- 172.21.15.53:0/1439450104 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7fe815dae0 0x7f7fe80ab860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:46.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.898+0000 7f7fece56640 1 --2- 172.21.15.53:0/1439450104 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7fe80af760 0x7f7fe80cb820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:46.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.898+0000 7f7fece56640 1 --2- 172.21.15.53:0/1439450104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7fe80700e0 0x7f7fe80c5440 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:46.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.898+0000 7f7fece56640 1 -- 172.21.15.53:0/1439450104 >> 172.21.15.53:0/1439450104 conn(0x7f7fe806a0e0 msgr2=0x7f7fe80afb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:46.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.898+0000 7f7fece56640 1 -- 172.21.15.53:0/1439450104 shutdown_connections 2023-06-10T18:56:46.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:46.898+0000 7f7fece56640 1 -- 172.21.15.53:0/1439450104 wait complete. 2023-06-10T18:56:46.920 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-10T18:56:47.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.042+0000 7fa29a253640 1 Processor -- start 2023-06-10T18:56:47.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.042+0000 7fa29a253640 1 -- start start 2023-06-10T18:56:47.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.046+0000 7fa29a253640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa29406b6e0 0x7fa29406bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:47.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.046+0000 7fa29a253640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa29406c230 con 0x7fa2941558e0 2023-06-10T18:56:47.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.046+0000 7fa29a253640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa29406ca40 con 0x7fa294158f40 2023-06-10T18:56:47.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.046+0000 7fa29a253640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa29406c020 con 0x7fa29406b6e0 2023-06-10T18:56:47.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.046+0000 7fa2937fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fa2941558e0 0x7fa2940c82a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:50464/0 (socket says 172.21.15.53:50464) 2023-06-10T18:56:47.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.046+0000 7fa2937fe640 1 -- 172.21.15.53:0/3315454131 learned_addr learned my addr 172.21.15.53:0/3315454131 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:56:47.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.046+0000 7fa293fff640 1 --2- 172.21.15.53:0/3315454131 >> v2:172.21.15.117:3300/0 conn(0x7fa29406b6e0 0x7fa29406bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:47.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.046+0000 7fa2927fc640 1 -- 172.21.15.53:0/3315454131 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1745346669 0 0) 0x7fa29406c230 con 0x7fa2941558e0 2023-06-10T18:56:47.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.046+0000 7fa2927fc640 1 -- 172.21.15.53:0/3315454131 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa27c003530 con 0x7fa2941558e0 2023-06-10T18:56:47.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.046+0000 7fa2927fc640 1 -- 172.21.15.53:0/3315454131 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1231396048 0 0) 0x7fa27c003530 con 0x7fa2941558e0 2023-06-10T18:56:47.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.046+0000 7fa2927fc640 1 -- 172.21.15.53:0/3315454131 >> v2:172.21.15.117:3300/0 conn(0x7fa29406b6e0 msgr2=0x7fa29406bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:47.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.046+0000 7fa2927fc640 1 --2- 172.21.15.53:0/3315454131 >> v2:172.21.15.117:3300/0 conn(0x7fa29406b6e0 0x7fa29406bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:47.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.046+0000 7fa2927fc640 1 -- 172.21.15.53:0/3315454131 >> v1:172.21.15.117:6789/0 conn(0x7fa294158f40 legacy=0x7fa2940cb820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:47.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.046+0000 7fa2927fc640 1 -- 172.21.15.53:0/3315454131 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa294155cb0 con 0x7fa2941558e0 2023-06-10T18:56:47.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.046+0000 7fa2927fc640 1 -- 172.21.15.53:0/3315454131 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fa284001680 con 0x7fa2941558e0 2023-06-10T18:56:47.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.046+0000 7fa2927fc640 1 -- 172.21.15.53:0/3315454131 >> v1:172.21.15.53:6789/0 conn(0x7fa2941558e0 legacy=0x7fa2940c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:47.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.046+0000 7fa2927fc640 1 --2- 172.21.15.53:0/3315454131 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa27c003980 0x7fa27c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:47.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.046+0000 7fa2927fc640 1 --2- 172.21.15.53:0/3315454131 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa27c0047d0 0x7fa27c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:47.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.046+0000 7fa2927fc640 1 --2- 172.21.15.53:0/3315454131 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa27c0052a0 0x7fa27c00caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:47.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.046+0000 7fa2927fc640 1 -- 172.21.15.53:0/3315454131 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa29406c020 con 0x7fa27c003980 2023-06-10T18:56:47.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.046+0000 7fa2927fc640 1 -- 172.21.15.53:0/3315454131 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa27c00d2e0 con 0x7fa27c0047d0 2023-06-10T18:56:47.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.046+0000 7fa2927fc640 1 -- 172.21.15.53:0/3315454131 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa27c00d4a0 con 0x7fa27c0052a0 2023-06-10T18:56:47.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.046+0000 7fa2937fe640 1 --2- 172.21.15.53:0/3315454131 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa27c003980 0x7fa27c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:47.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.046+0000 7fa292ffd640 1 --2- 172.21.15.53:0/3315454131 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa27c0047d0 0x7fa27c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:47.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.046+0000 7fa2937fe640 1 -- 172.21.15.53:0/3315454131 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa27c0052a0 msgr2=0x7fa27c00caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:47.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.046+0000 7fa293fff640 1 --2- 172.21.15.53:0/3315454131 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa27c0052a0 0x7fa27c00caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:47.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.046+0000 7fa2937fe640 1 --2- 172.21.15.53:0/3315454131 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa27c0052a0 0x7fa27c00caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:47.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.046+0000 7fa2937fe640 1 -- 172.21.15.53:0/3315454131 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa27c0047d0 msgr2=0x7fa27c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:47.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.046+0000 7fa2937fe640 1 --2- 172.21.15.53:0/3315454131 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa27c0047d0 0x7fa27c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:47.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.046+0000 7fa293fff640 1 -- 172.21.15.53:0/3315454131 reap_dead start 2023-06-10T18:56:47.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.046+0000 7fa2937fe640 1 -- 172.21.15.53:0/3315454131 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa27c003530 con 0x7fa27c003980 2023-06-10T18:56:47.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.046+0000 7fa292ffd640 1 --2- 172.21.15.53:0/3315454131 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa27c0047d0 0x7fa27c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:56:47.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.050+0000 7fa2937fe640 1 --2- 172.21.15.53:0/3315454131 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa27c003980 0x7fa27c003d90 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fa28400c240 tx=0x7fa28401cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b34b54f1e041290e server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:47.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.050+0000 7fa2927fc640 1 -- 172.21.15.53:0/3315454131 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa284005ae0 con 0x7fa27c003980 2023-06-10T18:56:47.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.050+0000 7fa2927fc640 1 -- 172.21.15.53:0/3315454131 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa284005c40 con 0x7fa27c003980 2023-06-10T18:56:47.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.050+0000 7fa2927fc640 1 -- 172.21.15.53:0/3315454131 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2840072b0 con 0x7fa27c003980 2023-06-10T18:56:47.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.050+0000 7fa29a253640 1 -- 172.21.15.53:0/3315454131 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa27c003980 msgr2=0x7fa27c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:47.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.050+0000 7fa29a253640 1 --2- 172.21.15.53:0/3315454131 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa27c003980 0x7fa27c003d90 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fa28400c240 tx=0x7fa28401cb50 comp rx=0 tx=0).stop 2023-06-10T18:56:47.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.050+0000 7fa29a253640 1 -- 172.21.15.53:0/3315454131 shutdown_connections 2023-06-10T18:56:47.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.050+0000 7fa29a253640 1 --2- 172.21.15.53:0/3315454131 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa27c003980 0x7fa27c003d90 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:47.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.050+0000 7fa29a253640 1 -- 172.21.15.53:0/3315454131 >> 172.21.15.53:0/3315454131 conn(0x7fa29406a0e0 msgr2=0x7fa2940cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:47.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.050+0000 7fa29a253640 1 -- 172.21.15.53:0/3315454131 shutdown_connections 2023-06-10T18:56:47.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.050+0000 7fa29a253640 1 -- 172.21.15.53:0/3315454131 wait complete. 2023-06-10T18:56:47.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.054+0000 7fa29a253640 1 Processor -- start 2023-06-10T18:56:47.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.054+0000 7fa29a253640 1 -- start start 2023-06-10T18:56:47.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.054+0000 7fa29a253640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa27c003980 0x7fa29406f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:47.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.054+0000 7fa29a253640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa29415baa0 0x7fa2940b3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:47.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.054+0000 7fa29a253640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa29415bef0 0x7fa294159340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:47.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.054+0000 7fa29a253640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa29406fe10 con 0x7fa29415bef0 2023-06-10T18:56:47.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.054+0000 7fa29a253640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2940b0ed0 con 0x7fa29415baa0 2023-06-10T18:56:47.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.054+0000 7fa29a253640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2940b11b0 con 0x7fa27c003980 2023-06-10T18:56:47.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.054+0000 7fa293fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa29415bef0 0x7fa294159340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:47.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.054+0000 7fa293fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa29415bef0 0x7fa294159340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42950/0 (socket says 172.21.15.53:42950) 2023-06-10T18:56:47.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.054+0000 7fa293fff640 1 -- 172.21.15.53:0/2165877376 learned_addr learned my addr 172.21.15.53:0/2165877376 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:47.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.054+0000 7fa2937fe640 1 --2- 172.21.15.53:0/2165877376 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa27c003980 0x7fa29406f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:47.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.054+0000 7fa292ffd640 1 --2- 172.21.15.53:0/2165877376 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa29415baa0 0x7fa2940b3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:47.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.054+0000 7fa293fff640 1 -- 172.21.15.53:0/2165877376 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa27c003980 msgr2=0x7fa29406f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:47.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.054+0000 7fa293fff640 1 --2- 172.21.15.53:0/2165877376 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa27c003980 0x7fa29406f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:47.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.054+0000 7fa293fff640 1 -- 172.21.15.53:0/2165877376 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa29415baa0 msgr2=0x7fa2940b3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:47.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.054+0000 7fa293fff640 1 --2- 172.21.15.53:0/2165877376 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa29415baa0 0x7fa2940b3360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:47.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.054+0000 7fa293fff640 1 -- 172.21.15.53:0/2165877376 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2940b2b60 con 0x7fa29415bef0 2023-06-10T18:56:47.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.054+0000 7fa293fff640 1 --2- 172.21.15.53:0/2165877376 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa29415bef0 0x7fa294159340 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fa29406e880 tx=0x7fa28c00f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:47.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.054+0000 7fa27bfff640 1 -- 172.21.15.53:0/2165877376 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28c00f910 con 0x7fa29415bef0 2023-06-10T18:56:47.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.054+0000 7fa27bfff640 1 -- 172.21.15.53:0/2165877376 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa28c00fa90 con 0x7fa29415bef0 2023-06-10T18:56:47.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.054+0000 7fa29a253640 1 -- 172.21.15.53:0/2165877376 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2940b2e40 con 0x7fa29415bef0 2023-06-10T18:56:47.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.054+0000 7fa27bfff640 1 -- 172.21.15.53:0/2165877376 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28c00fe40 con 0x7fa29415bef0 2023-06-10T18:56:47.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.054+0000 7fa29a253640 1 -- 172.21.15.53:0/2165877376 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2940b2830 con 0x7fa29415bef0 2023-06-10T18:56:47.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.054+0000 7fa29a253640 1 -- 172.21.15.53:0/2165877376 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2940b3060 con 0x7fa29415bef0 2023-06-10T18:56:47.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.054+0000 7fa27bfff640 1 -- 172.21.15.53:0/2165877376 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa28c016420 con 0x7fa29415bef0 2023-06-10T18:56:47.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.054+0000 7fa27bfff640 1 --2- 172.21.15.53:0/2165877376 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa2800662b0 0x7fa280068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:47.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.054+0000 7fa27bfff640 1 -- 172.21.15.53:0/2165877376 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fa28c0843e0 con 0x7fa29415bef0 2023-06-10T18:56:47.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.058+0000 7fa2937fe640 1 --2- 172.21.15.53:0/2165877376 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa2800662b0 0x7fa280068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:47.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.058+0000 7fa2937fe640 1 --2- 172.21.15.53:0/2165877376 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa2800662b0 0x7fa280068760 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fa2840ab000 tx=0x7fa2840b1040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:47.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.062+0000 7fa27bfff640 1 -- 172.21.15.53:0/2165877376 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa28c051780 con 0x7fa29415bef0 2023-06-10T18:56:47.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.214+0000 7fa29a253640 1 -- 172.21.15.53:0/2165877376 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa29404d790 con 0x7fa29415bef0 2023-06-10T18:56:47.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.214+0000 7fa27bfff640 1 -- 172.21.15.53:0/2165877376 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v53) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa28c054da0 con 0x7fa29415bef0 2023-06-10T18:56:47.220 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-06-10T18:56:47.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.218+0000 7fa29a253640 1 -- 172.21.15.53:0/2165877376 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa2800662b0 msgr2=0x7fa280068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:47.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.218+0000 7fa29a253640 1 --2- 172.21.15.53:0/2165877376 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa2800662b0 0x7fa280068760 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fa2840ab000 tx=0x7fa2840b1040 comp rx=0 tx=0).stop 2023-06-10T18:56:47.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.218+0000 7fa29a253640 1 -- 172.21.15.53:0/2165877376 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa29415bef0 msgr2=0x7fa294159340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:47.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.218+0000 7fa29a253640 1 --2- 172.21.15.53:0/2165877376 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa29415bef0 0x7fa294159340 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fa29406e880 tx=0x7fa28c00f150 comp rx=0 tx=0).stop 2023-06-10T18:56:47.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.218+0000 7fa29a253640 1 -- 172.21.15.53:0/2165877376 shutdown_connections 2023-06-10T18:56:47.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.218+0000 7fa29a253640 1 --2- 172.21.15.53:0/2165877376 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa2800662b0 0x7fa280068760 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:47.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.218+0000 7fa29a253640 1 --2- 172.21.15.53:0/2165877376 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa29415bef0 0x7fa294159340 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:47.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.218+0000 7fa29a253640 1 --2- 172.21.15.53:0/2165877376 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa29415baa0 0x7fa2940b3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:47.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.218+0000 7fa29a253640 1 --2- 172.21.15.53:0/2165877376 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa27c003980 0x7fa29406f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:47.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.218+0000 7fa29a253640 1 -- 172.21.15.53:0/2165877376 >> 172.21.15.53:0/2165877376 conn(0x7fa29406a0e0 msgr2=0x7fa294152600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:47.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.218+0000 7fa29a253640 1 -- 172.21.15.53:0/2165877376 shutdown_connections 2023-06-10T18:56:47.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.218+0000 7fa29a253640 1 -- 172.21.15.53:0/2165877376 wait complete. 2023-06-10T18:56:47.240 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-10T18:56:47.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.358+0000 7f705f322640 1 Processor -- start 2023-06-10T18:56:47.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.358+0000 7f705f322640 1 -- start start 2023-06-10T18:56:47.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.362+0000 7f705f322640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f705815c060 0x7f70580cc020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:47.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.362+0000 7f705f322640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7058070de0 0x7f705815c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:47.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.362+0000 7f705f322640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f705815c970 0x7f705806bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:47.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.362+0000 7f705f322640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70580c8d50 con 0x7f705815c060 2023-06-10T18:56:47.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.362+0000 7f705f322640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70580c9030 con 0x7f7058070de0 2023-06-10T18:56:47.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.362+0000 7f705f322640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7058070300 con 0x7f705815c970 2023-06-10T18:56:47.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.362+0000 7f705d0be640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f705815c060 0x7f70580cc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:47.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.362+0000 7f705d0be640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f705815c060 0x7f70580cc020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42960/0 (socket says 172.21.15.53:42960) 2023-06-10T18:56:47.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.362+0000 7f705d0be640 1 -- 172.21.15.53:0/1360681469 learned_addr learned my addr 172.21.15.53:0/1360681469 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:47.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.362+0000 7f705c8bd640 1 --2- 172.21.15.53:0/1360681469 >> v2:172.21.15.117:3300/0 conn(0x7f7058070de0 0x7f705815c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:47.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.362+0000 7f705d8bf640 1 --2- 172.21.15.53:0/1360681469 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f705815c970 0x7f705806bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:47.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.362+0000 7f705d0be640 1 -- 172.21.15.53:0/1360681469 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f705815c970 msgr2=0x7f705806bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:47.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.362+0000 7f705d0be640 1 --2- 172.21.15.53:0/1360681469 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f705815c970 0x7f705806bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:47.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.362+0000 7f705d0be640 1 -- 172.21.15.53:0/1360681469 >> v2:172.21.15.117:3300/0 conn(0x7f7058070de0 msgr2=0x7f705815c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:47.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.362+0000 7f705d0be640 1 --2- 172.21.15.53:0/1360681469 >> v2:172.21.15.117:3300/0 conn(0x7f7058070de0 0x7f705815c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:47.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.362+0000 7f705d0be640 1 -- 172.21.15.53:0/1360681469 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70580705e0 con 0x7f705815c060 2023-06-10T18:56:47.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.362+0000 7f705c8bd640 1 --2- 172.21.15.53:0/1360681469 >> v2:172.21.15.117:3300/0 conn(0x7f7058070de0 0x7f705815c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:56:47.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.362+0000 7f705d8bf640 1 --2- 172.21.15.53:0/1360681469 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f705815c970 0x7f705806bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:56:47.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.366+0000 7f705d0be640 1 --2- 172.21.15.53:0/1360681469 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f705815c060 0x7f70580cc020 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f7058071450 tx=0x7f705401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8a6cd16fb2d7c5e server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:47.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.366+0000 7f704ffff640 1 -- 172.21.15.53:0/1360681469 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70540ab600 con 0x7f705815c060 2023-06-10T18:56:47.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.366+0000 7f704ffff640 1 -- 172.21.15.53:0/1360681469 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70540a7050 con 0x7f705815c060 2023-06-10T18:56:47.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.366+0000 7f704ffff640 1 -- 172.21.15.53:0/1360681469 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70540ab980 con 0x7f705815c060 2023-06-10T18:56:47.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.366+0000 7f705f322640 1 -- 172.21.15.53:0/1360681469 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f705815c060 msgr2=0x7f70580cc020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:47.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.366+0000 7f705f322640 1 --2- 172.21.15.53:0/1360681469 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f705815c060 0x7f70580cc020 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f7058071450 tx=0x7f705401c470 comp rx=0 tx=0).stop 2023-06-10T18:56:47.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.366+0000 7f705f322640 1 -- 172.21.15.53:0/1360681469 shutdown_connections 2023-06-10T18:56:47.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.366+0000 7f705f322640 1 --2- 172.21.15.53:0/1360681469 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f705815c970 0x7f705806bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:47.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.366+0000 7f705f322640 1 --2- 172.21.15.53:0/1360681469 >> v2:172.21.15.117:3300/0 conn(0x7f7058070de0 0x7f705815c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:47.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.366+0000 7f705f322640 1 --2- 172.21.15.53:0/1360681469 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f705815c060 0x7f70580cc020 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:47.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.366+0000 7f705f322640 1 -- 172.21.15.53:0/1360681469 >> 172.21.15.53:0/1360681469 conn(0x7f705806a0e0 msgr2=0x7f70580cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:47.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.366+0000 7f705f322640 1 -- 172.21.15.53:0/1360681469 shutdown_connections 2023-06-10T18:56:47.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.366+0000 7f705f322640 1 -- 172.21.15.53:0/1360681469 wait complete. 2023-06-10T18:56:47.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.366+0000 7f705f322640 1 Processor -- start 2023-06-10T18:56:47.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.366+0000 7f705f322640 1 -- start start 2023-06-10T18:56:47.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.366+0000 7f705f322640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7058070de0 0x7f705814e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:47.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.366+0000 7f705f322640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f705815c060 0x7f70580c35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:47.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.366+0000 7f705f322640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f705815c970 0x7f70580c8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:47.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.366+0000 7f705f322640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70580c3b00 con 0x7f7058070de0 2023-06-10T18:56:47.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.366+0000 7f705f322640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70580c89b0 con 0x7f705815c970 2023-06-10T18:56:47.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.366+0000 7f705f322640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70580c3cf0 con 0x7f705815c060 2023-06-10T18:56:47.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.366+0000 7f705d0be640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7058070de0 0x7f705814e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:47.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.366+0000 7f705d0be640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7058070de0 0x7f705814e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42968/0 (socket says 172.21.15.53:42968) 2023-06-10T18:56:47.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.366+0000 7f705d0be640 1 -- 172.21.15.53:0/1952899738 learned_addr learned my addr 172.21.15.53:0/1952899738 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:47.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.366+0000 7f705c8bd640 1 --2- 172.21.15.53:0/1952899738 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f705815c060 0x7f70580c35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:47.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.366+0000 7f705d8bf640 1 --2- 172.21.15.53:0/1952899738 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f705815c970 0x7f70580c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:47.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.366+0000 7f705d0be640 1 -- 172.21.15.53:0/1952899738 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f705815c060 msgr2=0x7f70580c35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:47.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.366+0000 7f705d0be640 1 --2- 172.21.15.53:0/1952899738 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f705815c060 0x7f70580c35c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:47.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.366+0000 7f705d0be640 1 -- 172.21.15.53:0/1952899738 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f705815c970 msgr2=0x7f70580c8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:47.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.366+0000 7f705d0be640 1 --2- 172.21.15.53:0/1952899738 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f705815c970 0x7f70580c8470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:47.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.366+0000 7f705d0be640 1 -- 172.21.15.53:0/1952899738 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70540094d0 con 0x7f7058070de0 2023-06-10T18:56:47.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.366+0000 7f705d0be640 1 --2- 172.21.15.53:0/1952899738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7058070de0 0x7f705814e330 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f705401ab20 tx=0x7f7054019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:47.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.366+0000 7f704dffb640 1 -- 172.21.15.53:0/1952899738 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70540b4420 con 0x7f7058070de0 2023-06-10T18:56:47.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.366+0000 7f704dffb640 1 -- 172.21.15.53:0/1952899738 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70540b4580 con 0x7f7058070de0 2023-06-10T18:56:47.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.366+0000 7f704dffb640 1 -- 172.21.15.53:0/1952899738 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70540b48f0 con 0x7f7058070de0 2023-06-10T18:56:47.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.366+0000 7f705f322640 1 -- 172.21.15.53:0/1952899738 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70580b0bb0 con 0x7f7058070de0 2023-06-10T18:56:47.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.366+0000 7f705f322640 1 -- 172.21.15.53:0/1952899738 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70580b1170 con 0x7f7058070de0 2023-06-10T18:56:47.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.370+0000 7f705f322640 1 -- 172.21.15.53:0/1952899738 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f705804d790 con 0x7f7058070de0 2023-06-10T18:56:47.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.370+0000 7f704dffb640 1 -- 172.21.15.53:0/1952899738 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f70540b2070 con 0x7f7058070de0 2023-06-10T18:56:47.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.370+0000 7f704dffb640 1 --2- 172.21.15.53:0/1952899738 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f703c066280 0x7f703c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:47.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.370+0000 7f704dffb640 1 -- 172.21.15.53:0/1952899738 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f705411d240 con 0x7f7058070de0 2023-06-10T18:56:47.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.370+0000 7f705c8bd640 1 --2- 172.21.15.53:0/1952899738 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f703c066280 0x7f703c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:47.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.370+0000 7f705c8bd640 1 --2- 172.21.15.53:0/1952899738 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f703c066280 0x7f703c068730 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f70580c30d0 tx=0x7f7048008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:47.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.374+0000 7f704dffb640 1 -- 172.21.15.53:0/1952899738 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f70540ea830 con 0x7f7058070de0 2023-06-10T18:56:47.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.518+0000 7f705f322640 1 -- 172.21.15.53:0/1952899738 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f70581631d0 con 0x7f7058070de0 2023-06-10T18:56:47.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.518+0000 7f704dffb640 1 -- 172.21.15.53:0/1952899738 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v53) v1 ==== 104+0+11 (secure 0 0 0) 0x7f70540ede50 con 0x7f7058070de0 2023-06-10T18:56:47.526 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-06-10T18:56:47.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.522+0000 7f705f322640 1 -- 172.21.15.53:0/1952899738 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f703c066280 msgr2=0x7f703c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:47.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.522+0000 7f705f322640 1 --2- 172.21.15.53:0/1952899738 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f703c066280 0x7f703c068730 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f70580c30d0 tx=0x7f7048008040 comp rx=0 tx=0).stop 2023-06-10T18:56:47.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.522+0000 7f705f322640 1 -- 172.21.15.53:0/1952899738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7058070de0 msgr2=0x7f705814e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:47.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.522+0000 7f705f322640 1 --2- 172.21.15.53:0/1952899738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7058070de0 0x7f705814e330 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f705401ab20 tx=0x7f7054019210 comp rx=0 tx=0).stop 2023-06-10T18:56:47.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.522+0000 7f705f322640 1 -- 172.21.15.53:0/1952899738 shutdown_connections 2023-06-10T18:56:47.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.522+0000 7f705f322640 1 --2- 172.21.15.53:0/1952899738 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f703c066280 0x7f703c068730 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:47.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.522+0000 7f705f322640 1 --2- 172.21.15.53:0/1952899738 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f705815c970 0x7f70580c8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:47.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.522+0000 7f705f322640 1 --2- 172.21.15.53:0/1952899738 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f705815c060 0x7f70580c35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:47.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.522+0000 7f705f322640 1 --2- 172.21.15.53:0/1952899738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7058070de0 0x7f705814e330 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:47.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.522+0000 7f705f322640 1 -- 172.21.15.53:0/1952899738 >> 172.21.15.53:0/1952899738 conn(0x7f705806a0e0 msgr2=0x7f70580accc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:47.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.522+0000 7f705f322640 1 -- 172.21.15.53:0/1952899738 shutdown_connections 2023-06-10T18:56:47.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.522+0000 7f705f322640 1 -- 172.21.15.53:0/1952899738 wait complete. 2023-06-10T18:56:47.543 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-10T18:56:47.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.654+0000 7f3a9a85d640 1 Processor -- start 2023-06-10T18:56:47.660 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.654+0000 7f3a9a85d640 1 -- start start 2023-06-10T18:56:47.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.654+0000 7f3a9a85d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3a9415c060 0x7f3a940cc020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:47.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.654+0000 7f3a9a85d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3a94070de0 0x7f3a9415c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:47.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.654+0000 7f3a9a85d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a940c8d50 con 0x7f3a9415c970 2023-06-10T18:56:47.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.654+0000 7f3a9a85d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a940c9030 con 0x7f3a9415c060 2023-06-10T18:56:47.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.654+0000 7f3a9a85d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a94070300 con 0x7f3a94070de0 2023-06-10T18:56:47.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.654+0000 7f3a93fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3a9415c060 0x7f3a940cc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:47.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.654+0000 7f3a98dfa640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f3a9415c970 0x7f3a9406bd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:50468/0 (socket says 172.21.15.53:50468) 2023-06-10T18:56:47.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.654+0000 7f3a98dfa640 1 -- 172.21.15.53:0/786982846 learned_addr learned my addr 172.21.15.53:0/786982846 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:56:47.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.654+0000 7f3a937fe640 1 --2- 172.21.15.53:0/786982846 >> v2:172.21.15.117:3300/0 conn(0x7f3a94070de0 0x7f3a9415c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:47.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.654+0000 7f3a92ffd640 1 -- 172.21.15.53:0/786982846 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2264774858 0 0) 0x7f3a940c8d50 con 0x7f3a9415c970 2023-06-10T18:56:47.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.654+0000 7f3a92ffd640 1 -- 172.21.15.53:0/786982846 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a7c003530 con 0x7f3a9415c970 2023-06-10T18:56:47.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.654+0000 7f3a93fff640 1 -- 172.21.15.53:0/786982846 >> v2:172.21.15.117:3300/0 conn(0x7f3a94070de0 msgr2=0x7f3a9415c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:47.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.654+0000 7f3a93fff640 1 --2- 172.21.15.53:0/786982846 >> v2:172.21.15.117:3300/0 conn(0x7f3a94070de0 0x7f3a9415c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:47.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.654+0000 7f3a93fff640 1 -- 172.21.15.53:0/786982846 >> v1:172.21.15.53:6789/0 conn(0x7f3a9415c970 legacy=0x7f3a9406bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:47.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.654+0000 7f3a93fff640 1 -- 172.21.15.53:0/786982846 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a940705e0 con 0x7f3a9415c060 2023-06-10T18:56:47.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.654+0000 7f3a937fe640 1 --2- 172.21.15.53:0/786982846 >> v2:172.21.15.117:3300/0 conn(0x7f3a94070de0 0x7f3a9415c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:56:47.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.658+0000 7f3a93fff640 1 --2- 172.21.15.53:0/786982846 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a9415c060 0x7f3a940cc020 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f3a94071450 tx=0x7f3a8401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1297b6410252d88 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:47.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.658+0000 7f3a92ffd640 1 -- 172.21.15.53:0/786982846 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a840ab600 con 0x7f3a9415c060 2023-06-10T18:56:47.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.658+0000 7f3a92ffd640 1 -- 172.21.15.53:0/786982846 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a840a7050 con 0x7f3a9415c060 2023-06-10T18:56:47.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.658+0000 7f3a92ffd640 1 -- 172.21.15.53:0/786982846 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a840ab960 con 0x7f3a9415c060 2023-06-10T18:56:47.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.658+0000 7f3a9a85d640 1 -- 172.21.15.53:0/786982846 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a9415c060 msgr2=0x7f3a940cc020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:47.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.658+0000 7f3a9a85d640 1 --2- 172.21.15.53:0/786982846 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a9415c060 0x7f3a940cc020 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f3a94071450 tx=0x7f3a8401c3d0 comp rx=0 tx=0).stop 2023-06-10T18:56:47.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.658+0000 7f3a9a85d640 1 -- 172.21.15.53:0/786982846 shutdown_connections 2023-06-10T18:56:47.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.658+0000 7f3a9a85d640 1 --2- 172.21.15.53:0/786982846 >> v2:172.21.15.117:3300/0 conn(0x7f3a94070de0 0x7f3a9415c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:47.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.658+0000 7f3a9a85d640 1 --2- 172.21.15.53:0/786982846 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a9415c060 0x7f3a940cc020 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:47.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.658+0000 7f3a9a85d640 1 -- 172.21.15.53:0/786982846 >> 172.21.15.53:0/786982846 conn(0x7f3a9406a0e0 msgr2=0x7f3a940cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:47.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.658+0000 7f3a9a85d640 1 -- 172.21.15.53:0/786982846 shutdown_connections 2023-06-10T18:56:47.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.658+0000 7f3a9a85d640 1 -- 172.21.15.53:0/786982846 wait complete. 2023-06-10T18:56:47.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.662+0000 7f3a9a85d640 1 Processor -- start 2023-06-10T18:56:47.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.662+0000 7f3a9a85d640 1 -- start start 2023-06-10T18:56:47.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.662+0000 7f3a9a85d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a94070de0 0x7f3a9414bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:47.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.662+0000 7f3a9a85d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a9415c060 0x7f3a940c2850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:47.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.662+0000 7f3a9a85d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3a9415c970 0x7f3a940c2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:47.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.662+0000 7f3a9a85d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a940c23c0 con 0x7f3a9415c060 2023-06-10T18:56:47.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.662+0000 7f3a9a85d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a940c3a40 con 0x7f3a94070de0 2023-06-10T18:56:47.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.662+0000 7f3a9a85d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a940b3020 con 0x7f3a9415c970 2023-06-10T18:56:47.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.662+0000 7f3a937fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a9415c060 0x7f3a940c2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:47.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.662+0000 7f3a937fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a9415c060 0x7f3a940c2850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42984/0 (socket says 172.21.15.53:42984) 2023-06-10T18:56:47.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.662+0000 7f3a937fe640 1 -- 172.21.15.53:0/720093598 learned_addr learned my addr 172.21.15.53:0/720093598 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:47.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.662+0000 7f3a98dfa640 1 --2- 172.21.15.53:0/720093598 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3a9415c970 0x7f3a940c2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:47.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.662+0000 7f3a937fe640 1 -- 172.21.15.53:0/720093598 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3a9415c970 msgr2=0x7f3a940c2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:47.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.662+0000 7f3a93fff640 1 --2- 172.21.15.53:0/720093598 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a94070de0 0x7f3a9414bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:47.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.662+0000 7f3a937fe640 1 --2- 172.21.15.53:0/720093598 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3a9415c970 0x7f3a940c2d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:47.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.662+0000 7f3a937fe640 1 -- 172.21.15.53:0/720093598 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a94070de0 msgr2=0x7f3a9414bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:47.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.662+0000 7f3a937fe640 1 --2- 172.21.15.53:0/720093598 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a94070de0 0x7f3a9414bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:47.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.662+0000 7f3a937fe640 1 -- 172.21.15.53:0/720093598 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a84009420 con 0x7f3a9415c060 2023-06-10T18:56:47.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.662+0000 7f3a937fe640 1 --2- 172.21.15.53:0/720093598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a9415c060 0x7f3a940c2850 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f3a8800c7f0 tx=0x7f3a8800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:47.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.662+0000 7f3a90ff9640 1 -- 172.21.15.53:0/720093598 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a88007820 con 0x7f3a9415c060 2023-06-10T18:56:47.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.662+0000 7f3a90ff9640 1 -- 172.21.15.53:0/720093598 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a88007980 con 0x7f3a9415c060 2023-06-10T18:56:47.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.662+0000 7f3a9a85d640 1 -- 172.21.15.53:0/720093598 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a94158950 con 0x7f3a9415c060 2023-06-10T18:56:47.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.662+0000 7f3a90ff9640 1 -- 172.21.15.53:0/720093598 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a88007d30 con 0x7f3a9415c060 2023-06-10T18:56:47.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.662+0000 7f3a9a85d640 1 -- 172.21.15.53:0/720093598 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a9414c240 con 0x7f3a9415c060 2023-06-10T18:56:47.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.662+0000 7f3a9a85d640 1 -- 172.21.15.53:0/720093598 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a940c3f40 con 0x7f3a9415c060 2023-06-10T18:56:47.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.662+0000 7f3a90ff9640 1 -- 172.21.15.53:0/720093598 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3a88024480 con 0x7f3a9415c060 2023-06-10T18:56:47.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.666+0000 7f3a90ff9640 1 --2- 172.21.15.53:0/720093598 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3a80066280 0x7f3a80068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:47.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.666+0000 7f3a90ff9640 1 -- 172.21.15.53:0/720093598 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f3a88084370 con 0x7f3a9415c060 2023-06-10T18:56:47.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.666+0000 7f3a93fff640 1 --2- 172.21.15.53:0/720093598 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3a80066280 0x7f3a80068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:47.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.666+0000 7f3a93fff640 1 --2- 172.21.15.53:0/720093598 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3a80066280 0x7f3a80068730 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f3a840ad000 tx=0x7f3a840a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:47.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.666+0000 7f3a90ff9640 1 -- 172.21.15.53:0/720093598 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3a88051820 con 0x7f3a9415c060 2023-06-10T18:56:47.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.814+0000 7f3a9a85d640 1 -- 172.21.15.53:0/720093598 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3a940c3f40 con 0x7f3a9415c060 2023-06-10T18:56:47.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.814+0000 7f3a90ff9640 1 -- 172.21.15.53:0/720093598 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v53) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3a940c3f40 con 0x7f3a9415c060 2023-06-10T18:56:47.819 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-06-10T18:56:47.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.814+0000 7f3a9a85d640 1 -- 172.21.15.53:0/720093598 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3a80066280 msgr2=0x7f3a80068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:47.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.814+0000 7f3a9a85d640 1 --2- 172.21.15.53:0/720093598 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3a80066280 0x7f3a80068730 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f3a840ad000 tx=0x7f3a840a6000 comp rx=0 tx=0).stop 2023-06-10T18:56:47.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.814+0000 7f3a9a85d640 1 -- 172.21.15.53:0/720093598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a9415c060 msgr2=0x7f3a940c2850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:47.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.814+0000 7f3a9a85d640 1 --2- 172.21.15.53:0/720093598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a9415c060 0x7f3a940c2850 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f3a8800c7f0 tx=0x7f3a8800ccb0 comp rx=0 tx=0).stop 2023-06-10T18:56:47.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.814+0000 7f3a9a85d640 1 -- 172.21.15.53:0/720093598 shutdown_connections 2023-06-10T18:56:47.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.814+0000 7f3a9a85d640 1 --2- 172.21.15.53:0/720093598 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3a80066280 0x7f3a80068730 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:47.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.814+0000 7f3a9a85d640 1 --2- 172.21.15.53:0/720093598 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3a9415c970 0x7f3a940c2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:47.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.814+0000 7f3a9a85d640 1 --2- 172.21.15.53:0/720093598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a9415c060 0x7f3a940c2850 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:47.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.814+0000 7f3a9a85d640 1 --2- 172.21.15.53:0/720093598 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a94070de0 0x7f3a9414bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:47.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.814+0000 7f3a9a85d640 1 -- 172.21.15.53:0/720093598 >> 172.21.15.53:0/720093598 conn(0x7f3a9406a0e0 msgr2=0x7f3a940cc680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:47.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.814+0000 7f3a9a85d640 1 -- 172.21.15.53:0/720093598 shutdown_connections 2023-06-10T18:56:47.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.814+0000 7f3a9a85d640 1 -- 172.21.15.53:0/720093598 wait complete. 2023-06-10T18:56:47.837 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-10T18:56:47.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.946+0000 7f1420cf8640 1 Processor -- start 2023-06-10T18:56:47.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.946+0000 7f1420cf8640 1 -- start start 2023-06-10T18:56:47.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.946+0000 7f1420cf8640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f141c15c240 0x7f141c15c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:47.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.946+0000 7f1420cf8640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f141c06ac20 0x7f141c06b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:47.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.946+0000 7f1420cf8640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f141c15cbd0 con 0x7f141c152e70 2023-06-10T18:56:47.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.946+0000 7f1420cf8640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f141c0c9430 con 0x7f141c06ac20 2023-06-10T18:56:47.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.946+0000 7f1420cf8640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f141c15d090 con 0x7f141c15c240 2023-06-10T18:56:47.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.946+0000 7f141a59c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f141c152e70 0x7f141c0c8d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:50484/0 (socket says 172.21.15.53:50484) 2023-06-10T18:56:47.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.946+0000 7f141a59c640 1 -- 172.21.15.53:0/3639307751 learned_addr learned my addr 172.21.15.53:0/3639307751 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:56:47.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.946+0000 7f1419d9b640 1 -- 172.21.15.53:0/3639307751 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3730934561 0 0) 0x7f140c0012a0 con 0x7f141c152e70 2023-06-10T18:56:47.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.946+0000 7f1419d9b640 1 -- 172.21.15.53:0/3639307751 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1408003530 con 0x7f141c152e70 2023-06-10T18:56:47.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.946+0000 7f1411d9b640 1 --2- 172.21.15.53:0/3639307751 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f141c15c240 0x7f141c15c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:47.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.946+0000 7f141ad9d640 1 --2- 172.21.15.53:0/3639307751 >> v2:172.21.15.117:3300/0 conn(0x7f141c06ac20 0x7f141c06b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:47.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.946+0000 7f1419d9b640 1 -- 172.21.15.53:0/3639307751 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3363808222 0 0) 0x7f1408003530 con 0x7f141c152e70 2023-06-10T18:56:47.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.946+0000 7f1419d9b640 1 -- 172.21.15.53:0/3639307751 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f141c15c240 msgr2=0x7f141c15c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:47.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.946+0000 7f1419d9b640 1 --2- 172.21.15.53:0/3639307751 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f141c15c240 0x7f141c15c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:47.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.946+0000 7f1419d9b640 1 -- 172.21.15.53:0/3639307751 >> v2:172.21.15.117:3300/0 conn(0x7f141c06ac20 msgr2=0x7f141c06b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:47.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.946+0000 7f1419d9b640 1 --2- 172.21.15.53:0/3639307751 >> v2:172.21.15.117:3300/0 conn(0x7f141c06ac20 0x7f141c06b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:47.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.946+0000 7f1419d9b640 1 -- 172.21.15.53:0/3639307751 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f141c0cdac0 con 0x7f141c152e70 2023-06-10T18:56:47.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.946+0000 7f141ad9d640 1 --2- 172.21.15.53:0/3639307751 >> v2:172.21.15.117:3300/0 conn(0x7f141c06ac20 0x7f141c06b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:56:47.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.946+0000 7f1419d9b640 1 -- 172.21.15.53:0/3639307751 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f140c001990 con 0x7f141c152e70 2023-06-10T18:56:47.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.946+0000 7f1419d9b640 1 -- 172.21.15.53:0/3639307751 >> v1:172.21.15.53:6789/0 conn(0x7f141c152e70 legacy=0x7f141c0c8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:47.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.946+0000 7f1419d9b640 1 --2- 172.21.15.53:0/3639307751 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1408003980 0x7f1408003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:47.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.946+0000 7f1419d9b640 1 --2- 172.21.15.53:0/3639307751 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f141c15c240 0x7f14080047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:47.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.946+0000 7f1419d9b640 1 --2- 172.21.15.53:0/3639307751 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1408004d10 0x7f1408005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:47.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.946+0000 7f1419d9b640 1 -- 172.21.15.53:0/3639307751 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f141c0c9430 con 0x7f1408003980 2023-06-10T18:56:47.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.946+0000 7f1419d9b640 1 -- 172.21.15.53:0/3639307751 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f141c15d090 con 0x7f1408004d10 2023-06-10T18:56:47.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.946+0000 7f1419d9b640 1 -- 172.21.15.53:0/3639307751 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f140800b990 con 0x7f141c15c240 2023-06-10T18:56:47.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.946+0000 7f141a59c640 1 --2- 172.21.15.53:0/3639307751 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1408003980 0x7f1408003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:47.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.946+0000 7f141ad9d640 1 --2- 172.21.15.53:0/3639307751 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1408004d10 0x7f1408005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:47.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.946+0000 7f1411d9b640 1 --2- 172.21.15.53:0/3639307751 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f141c15c240 0x7f14080047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:47.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.946+0000 7f141a59c640 1 -- 172.21.15.53:0/3639307751 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f141c15c240 msgr2=0x7f14080047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:47.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.946+0000 7f141a59c640 1 --2- 172.21.15.53:0/3639307751 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f141c15c240 0x7f14080047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:47.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.946+0000 7f141a59c640 1 -- 172.21.15.53:0/3639307751 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1408004d10 msgr2=0x7f1408005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:47.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.946+0000 7f141a59c640 1 --2- 172.21.15.53:0/3639307751 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1408004d10 0x7f1408005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:47.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.946+0000 7f141a59c640 1 -- 172.21.15.53:0/3639307751 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1408003530 con 0x7f1408003980 2023-06-10T18:56:47.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.950+0000 7f141a59c640 1 --2- 172.21.15.53:0/3639307751 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1408003980 0x7f1408003d90 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f140c00c190 tx=0x7f140c01cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8198ecac3752be32 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:47.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.950+0000 7f1419d9b640 1 -- 172.21.15.53:0/3639307751 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140c0070d0 con 0x7f1408003980 2023-06-10T18:56:47.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.950+0000 7f1419d9b640 1 -- 172.21.15.53:0/3639307751 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f140c007230 con 0x7f1408003980 2023-06-10T18:56:47.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.950+0000 7f1419d9b640 1 -- 172.21.15.53:0/3639307751 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140c0075e0 con 0x7f1408003980 2023-06-10T18:56:47.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.950+0000 7f1420cf8640 1 -- 172.21.15.53:0/3639307751 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1408003980 msgr2=0x7f1408003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:47.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.950+0000 7f1420cf8640 1 --2- 172.21.15.53:0/3639307751 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1408003980 0x7f1408003d90 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f140c00c190 tx=0x7f140c01cbf0 comp rx=0 tx=0).stop 2023-06-10T18:56:47.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.950+0000 7f141ad9d640 1 -- 172.21.15.53:0/3639307751 reap_dead start 2023-06-10T18:56:47.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.950+0000 7f1420cf8640 1 -- 172.21.15.53:0/3639307751 shutdown_connections 2023-06-10T18:56:47.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.950+0000 7f1420cf8640 1 -- 172.21.15.53:0/3639307751 >> 172.21.15.53:0/3639307751 conn(0x7f141c0ce9e0 msgr2=0x7f141c0ca7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:47.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.950+0000 7f1420cf8640 1 -- 172.21.15.53:0/3639307751 shutdown_connections 2023-06-10T18:56:47.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.950+0000 7f1420cf8640 1 -- 172.21.15.53:0/3639307751 wait complete. 2023-06-10T18:56:47.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.950+0000 7f1420cf8640 1 Processor -- start 2023-06-10T18:56:47.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.950+0000 7f1420cf8640 1 -- start start 2023-06-10T18:56:47.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.950+0000 7f1420cf8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1408003980 0x7f141c0b2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:47.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.950+0000 7f1420cf8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f141c14fde0 0x7f141c070710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:47.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.950+0000 7f1420cf8640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f141c070c50 0x7f141c0c5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:47.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.950+0000 7f1420cf8640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f141c150680 con 0x7f1408003980 2023-06-10T18:56:47.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.950+0000 7f1420cf8640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f141c0b3a30 con 0x7f141c14fde0 2023-06-10T18:56:47.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.950+0000 7f1420cf8640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f141c0b3470 con 0x7f141c070c50 2023-06-10T18:56:47.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.950+0000 7f141a59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1408003980 0x7f141c0b2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:47.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.950+0000 7f141a59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1408003980 0x7f141c0b2d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43002/0 (socket says 172.21.15.53:43002) 2023-06-10T18:56:47.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.950+0000 7f141a59c640 1 -- 172.21.15.53:0/625059021 learned_addr learned my addr 172.21.15.53:0/625059021 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:47.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.950+0000 7f141ad9d640 1 --2- 172.21.15.53:0/625059021 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f141c070c50 0x7f141c0c5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:47.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.950+0000 7f1411d9b640 1 --2- 172.21.15.53:0/625059021 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f141c14fde0 0x7f141c070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:47.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.954+0000 7f141a59c640 1 -- 172.21.15.53:0/625059021 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f141c070c50 msgr2=0x7f141c0c5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:47.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.954+0000 7f141a59c640 1 --2- 172.21.15.53:0/625059021 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f141c070c50 0x7f141c0c5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:47.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.954+0000 7f141a59c640 1 -- 172.21.15.53:0/625059021 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f141c14fde0 msgr2=0x7f141c070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:47.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.954+0000 7f141a59c640 1 --2- 172.21.15.53:0/625059021 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f141c14fde0 0x7f141c070710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:47.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.954+0000 7f141a59c640 1 -- 172.21.15.53:0/625059021 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f141c0b3750 con 0x7f1408003980 2023-06-10T18:56:47.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.954+0000 7f141a59c640 1 --2- 172.21.15.53:0/625059021 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1408003980 0x7f141c0b2d70 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f140c000f00 tx=0x7f1408005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:47.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.954+0000 7f14137fe640 1 -- 172.21.15.53:0/625059021 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140c0070d0 con 0x7f1408003980 2023-06-10T18:56:47.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.954+0000 7f14137fe640 1 -- 172.21.15.53:0/625059021 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f140c007810 con 0x7f1408003980 2023-06-10T18:56:47.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.954+0000 7f1420cf8640 1 -- 172.21.15.53:0/625059021 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f141c0c4e30 con 0x7f1408003980 2023-06-10T18:56:47.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.954+0000 7f14137fe640 1 -- 172.21.15.53:0/625059021 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140c0012a0 con 0x7f1408003980 2023-06-10T18:56:47.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.954+0000 7f1420cf8640 1 -- 172.21.15.53:0/625059021 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f141c0c5b50 con 0x7f1408003980 2023-06-10T18:56:47.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.954+0000 7f1420cf8640 1 -- 172.21.15.53:0/625059021 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f141c0c8b90 con 0x7f1408003980 2023-06-10T18:56:47.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.954+0000 7f14137fe640 1 -- 172.21.15.53:0/625059021 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f140c001750 con 0x7f1408003980 2023-06-10T18:56:47.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.954+0000 7f14137fe640 1 --2- 172.21.15.53:0/625059021 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f13fc066280 0x7f13fc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:47.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.954+0000 7f14137fe640 1 -- 172.21.15.53:0/625059021 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f140c11d780 con 0x7f1408003980 2023-06-10T18:56:47.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.954+0000 7f1411d9b640 1 --2- 172.21.15.53:0/625059021 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f13fc066280 0x7f13fc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:47.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.954+0000 7f1411d9b640 1 --2- 172.21.15.53:0/625059021 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f13fc066280 0x7f13fc068730 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f1404009930 tx=0x7f1404008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:47.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:47.958+0000 7f14137fe640 1 -- 172.21.15.53:0/625059021 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f140c0eac50 con 0x7f1408003980 2023-06-10T18:56:48.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.118+0000 7f1420cf8640 1 -- 172.21.15.53:0/625059021 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f141c15cbd0 con 0x7f1408003980 2023-06-10T18:56:48.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.118+0000 7f14137fe640 1 -- 172.21.15.53:0/625059021 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v53) v1 ==== 80+0+0 (secure 0 0 0) 0x7f141c15cbd0 con 0x7f1408003980 2023-06-10T18:56:48.125 INFO:teuthology.orchestra.run.smithi053.stderr:listed 0 entries 2023-06-10T18:56:48.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.122+0000 7f1420cf8640 1 -- 172.21.15.53:0/625059021 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f13fc066280 msgr2=0x7f13fc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:48.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.122+0000 7f1420cf8640 1 --2- 172.21.15.53:0/625059021 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f13fc066280 0x7f13fc068730 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f1404009930 tx=0x7f1404008040 comp rx=0 tx=0).stop 2023-06-10T18:56:48.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.122+0000 7f1420cf8640 1 -- 172.21.15.53:0/625059021 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1408003980 msgr2=0x7f141c0b2d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:48.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.122+0000 7f1420cf8640 1 --2- 172.21.15.53:0/625059021 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1408003980 0x7f141c0b2d70 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f140c000f00 tx=0x7f1408005800 comp rx=0 tx=0).stop 2023-06-10T18:56:48.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.122+0000 7f1420cf8640 1 -- 172.21.15.53:0/625059021 shutdown_connections 2023-06-10T18:56:48.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.122+0000 7f1420cf8640 1 --2- 172.21.15.53:0/625059021 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f13fc066280 0x7f13fc068730 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:48.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.122+0000 7f1420cf8640 1 --2- 172.21.15.53:0/625059021 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f141c070c50 0x7f141c0c5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:48.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.122+0000 7f1420cf8640 1 --2- 172.21.15.53:0/625059021 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f141c14fde0 0x7f141c070710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:48.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.122+0000 7f1420cf8640 1 --2- 172.21.15.53:0/625059021 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1408003980 0x7f141c0b2d70 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:48.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.122+0000 7f1420cf8640 1 -- 172.21.15.53:0/625059021 >> 172.21.15.53:0/625059021 conn(0x7f141c0ce9e0 msgr2=0x7f141c0af060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:48.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.122+0000 7f1420cf8640 1 -- 172.21.15.53:0/625059021 shutdown_connections 2023-06-10T18:56:48.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.122+0000 7f1420cf8640 1 -- 172.21.15.53:0/625059021 wait complete. 2023-06-10T18:56:48.143 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi053.front.sepia.ceph.com... 2023-06-10T18:56:48.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:56:48.144 DEBUG:teuthology.orchestra.run.smithi053:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-06-10T18:56:48.154 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[50293]: fuse finished with error 0 and tester_r 0 2023-06-10T18:56:48.156 INFO:teuthology.orchestra.run:waiting for 300 2023-06-10T18:56:48.204 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi053.front.sepia.ceph.com 2023-06-10T18:56:48.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:56:48.205 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-06-10T18:56:48.212 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T18:56:48.213 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T18:56:48.226 INFO:tasks.cephfs.mount:Checking file a 2023-06-10T18:56:48.226 DEBUG:teuthology.orchestra.run.smithi117:> ls /home/ubuntu/cephtest/mnt.1/a 2023-06-10T18:56:48.277 INFO:teuthology.orchestra.run.smithi117.stdout:/home/ubuntu/cephtest/mnt.1/a 2023-06-10T18:56:48.277 INFO:tasks.cephfs.mount:Checking file b 2023-06-10T18:56:48.277 DEBUG:teuthology.orchestra.run.smithi117:> ls /home/ubuntu/cephtest/mnt.1/b 2023-06-10T18:56:48.324 INFO:teuthology.orchestra.run.smithi117.stdout:/home/ubuntu/cephtest/mnt.1/b 2023-06-10T18:56:48.325 INFO:tasks.cephfs.mount:Checking file c 2023-06-10T18:56:48.325 DEBUG:teuthology.orchestra.run.smithi117:> ls /home/ubuntu/cephtest/mnt.1/c 2023-06-10T18:56:48.373 INFO:teuthology.orchestra.run.smithi117.stdout:/home/ubuntu/cephtest/mnt.1/c 2023-06-10T18:56:48.374 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-10T18:56:48.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.494+0000 7fc94da66640 1 Processor -- start 2023-06-10T18:56:48.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.494+0000 7fc94da66640 1 -- start start 2023-06-10T18:56:48.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.494+0000 7fc94da66640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc9480cec40 0x7fc9480cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:48.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.494+0000 7fc94da66640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9480cbf50 0x7fc9480cc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:48.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.494+0000 7fc94da66640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9480cbac0 con 0x7fc948159450 2023-06-10T18:56:48.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.494+0000 7fc94da66640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9480cf600 con 0x7fc9480cec40 2023-06-10T18:56:48.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.494+0000 7fc94da66640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc94815dc00 con 0x7fc9480cbf50 2023-06-10T18:56:48.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.494+0000 7fc9477fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fc948159450 0x7fc94815d140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:50500/0 (socket says 172.21.15.53:50500) 2023-06-10T18:56:48.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.494+0000 7fc9477fe640 1 -- 172.21.15.53:0/3619036805 learned_addr learned my addr 172.21.15.53:0/3619036805 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:56:48.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.494+0000 7fc946ffd640 1 --2- 172.21.15.53:0/3619036805 >> v2:172.21.15.53:3300/0 conn(0x7fc9480cec40 0x7fc9480cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:48.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.498+0000 7fc9467fc640 1 -- 172.21.15.53:0/3619036805 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2891038385 0 0) 0x7fc9480cbac0 con 0x7fc948159450 2023-06-10T18:56:48.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.498+0000 7fc947fff640 1 --2- 172.21.15.53:0/3619036805 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9480cbf50 0x7fc9480cc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:48.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.498+0000 7fc9467fc640 1 -- 172.21.15.53:0/3619036805 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc930003530 con 0x7fc948159450 2023-06-10T18:56:48.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.498+0000 7fc946ffd640 1 -- 172.21.15.53:0/3619036805 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9480cbf50 msgr2=0x7fc9480cc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:48.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.498+0000 7fc946ffd640 1 --2- 172.21.15.53:0/3619036805 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9480cbf50 0x7fc9480cc3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:48.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.498+0000 7fc946ffd640 1 -- 172.21.15.53:0/3619036805 >> v1:172.21.15.53:6789/0 conn(0x7fc948159450 legacy=0x7fc94815d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:48.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.498+0000 7fc946ffd640 1 -- 172.21.15.53:0/3619036805 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc94815dee0 con 0x7fc9480cec40 2023-06-10T18:56:48.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.498+0000 7fc947fff640 1 --2- 172.21.15.53:0/3619036805 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9480cbf50 0x7fc9480cc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:56:48.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.498+0000 7fc946ffd640 1 --2- 172.21.15.53:0/3619036805 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9480cec40 0x7fc9480cf0c0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fc93c009d90 tx=0x7fc93c01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=666a1bf066f9d651 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:48.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.498+0000 7fc9467fc640 1 -- 172.21.15.53:0/3619036805 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc93c0a59a0 con 0x7fc9480cec40 2023-06-10T18:56:48.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.498+0000 7fc9467fc640 1 -- 172.21.15.53:0/3619036805 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc93c0a5b00 con 0x7fc9480cec40 2023-06-10T18:56:48.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.498+0000 7fc9467fc640 1 -- 172.21.15.53:0/3619036805 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc93c0a5e90 con 0x7fc9480cec40 2023-06-10T18:56:48.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.498+0000 7fc94da66640 1 -- 172.21.15.53:0/3619036805 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9480cec40 msgr2=0x7fc9480cf0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:48.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.498+0000 7fc94da66640 1 --2- 172.21.15.53:0/3619036805 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9480cec40 0x7fc9480cf0c0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fc93c009d90 tx=0x7fc93c01c920 comp rx=0 tx=0).stop 2023-06-10T18:56:48.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.498+0000 7fc94da66640 1 -- 172.21.15.53:0/3619036805 shutdown_connections 2023-06-10T18:56:48.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.498+0000 7fc94da66640 1 --2- 172.21.15.53:0/3619036805 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9480cec40 0x7fc9480cf0c0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:48.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.498+0000 7fc94da66640 1 --2- 172.21.15.53:0/3619036805 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9480cbf50 0x7fc9480cc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:48.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.498+0000 7fc94da66640 1 -- 172.21.15.53:0/3619036805 >> 172.21.15.53:0/3619036805 conn(0x7fc94806a090 msgr2=0x7fc94806d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:48.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.498+0000 7fc94da66640 1 -- 172.21.15.53:0/3619036805 shutdown_connections 2023-06-10T18:56:48.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.498+0000 7fc94da66640 1 -- 172.21.15.53:0/3619036805 wait complete. 2023-06-10T18:56:48.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.502+0000 7fc94da66640 1 Processor -- start 2023-06-10T18:56:48.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.502+0000 7fc94da66640 1 -- start start 2023-06-10T18:56:48.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.502+0000 7fc94da66640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9480cbf50 0x7fc9480c62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:48.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.502+0000 7fc94da66640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9480cec40 0x7fc9480b3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:48.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.502+0000 7fc94da66640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc948159450 0x7fc9480b4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:48.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.502+0000 7fc94da66640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc94814e6c0 con 0x7fc948159450 2023-06-10T18:56:48.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.502+0000 7fc94da66640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc948150f70 con 0x7fc9480cbf50 2023-06-10T18:56:48.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.502+0000 7fc94da66640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc948151250 con 0x7fc9480cec40 2023-06-10T18:56:48.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.502+0000 7fc947fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc948159450 0x7fc9480b4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:48.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.502+0000 7fc947fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc948159450 0x7fc9480b4390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43012/0 (socket says 172.21.15.53:43012) 2023-06-10T18:56:48.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.502+0000 7fc947fff640 1 -- 172.21.15.53:0/3744414355 learned_addr learned my addr 172.21.15.53:0/3744414355 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:48.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.502+0000 7fc946ffd640 1 --2- 172.21.15.53:0/3744414355 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9480cec40 0x7fc9480b3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:48.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.502+0000 7fc947fff640 1 -- 172.21.15.53:0/3744414355 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9480cec40 msgr2=0x7fc9480b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:48.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.502+0000 7fc947fff640 1 --2- 172.21.15.53:0/3744414355 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9480cec40 0x7fc9480b3e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:48.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.502+0000 7fc947fff640 1 -- 172.21.15.53:0/3744414355 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9480cbf50 msgr2=0x7fc9480c62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:48.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.502+0000 7fc947fff640 1 --2- 172.21.15.53:0/3744414355 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9480cbf50 0x7fc9480c62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:48.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.502+0000 7fc947fff640 1 -- 172.21.15.53:0/3744414355 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc93c009a70 con 0x7fc948159450 2023-06-10T18:56:48.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.502+0000 7fc947fff640 1 --2- 172.21.15.53:0/3744414355 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc948159450 0x7fc9480b4390 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fc94000c7f0 tx=0x7fc94000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:48.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.502+0000 7fc92ffff640 1 -- 172.21.15.53:0/3744414355 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc940004230 con 0x7fc948159450 2023-06-10T18:56:48.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.502+0000 7fc92ffff640 1 -- 172.21.15.53:0/3744414355 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9400043b0 con 0x7fc948159450 2023-06-10T18:56:48.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.502+0000 7fc92ffff640 1 -- 172.21.15.53:0/3744414355 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc940003860 con 0x7fc948159450 2023-06-10T18:56:48.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.502+0000 7fc94da66640 1 -- 172.21.15.53:0/3744414355 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc94815d9d0 con 0x7fc948159450 2023-06-10T18:56:48.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.502+0000 7fc94da66640 1 -- 172.21.15.53:0/3744414355 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc948151810 con 0x7fc948159450 2023-06-10T18:56:48.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.502+0000 7fc94da66640 1 -- 172.21.15.53:0/3744414355 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc94804d790 con 0x7fc948159450 2023-06-10T18:56:48.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.502+0000 7fc92ffff640 1 -- 172.21.15.53:0/3744414355 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc940003bd0 con 0x7fc948159450 2023-06-10T18:56:48.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.502+0000 7fc92ffff640 1 --2- 172.21.15.53:0/3744414355 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc9340662b0 0x7fc934068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:48.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.502+0000 7fc92ffff640 1 -- 172.21.15.53:0/3744414355 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fc940084190 con 0x7fc948159450 2023-06-10T18:56:48.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.506+0000 7fc9477fe640 1 --2- 172.21.15.53:0/3744414355 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc9340662b0 0x7fc934068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:48.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.506+0000 7fc9477fe640 1 --2- 172.21.15.53:0/3744414355 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc9340662b0 0x7fc934068760 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fc938007fd0 tx=0x7fc938007940 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:48.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.510+0000 7fc92ffff640 1 -- 172.21.15.53:0/3744414355 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc940051660 con 0x7fc948159450 2023-06-10T18:56:48.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.702+0000 7fc94da66640 1 -- 172.21.15.53:0/3744414355 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc9481642b0 con 0x7fc948159450 2023-06-10T18:56:48.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.702+0000 7fc92ffff640 1 -- 172.21.15.53:0/3744414355 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v20) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc940054c80 con 0x7fc948159450 2023-06-10T18:56:48.709 INFO:teuthology.orchestra.run.smithi053.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-06-10T18:56:48.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.706+0000 7fc94da66640 1 -- 172.21.15.53:0/3744414355 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc9340662b0 msgr2=0x7fc934068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:48.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.706+0000 7fc94da66640 1 --2- 172.21.15.53:0/3744414355 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc9340662b0 0x7fc934068760 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fc938007fd0 tx=0x7fc938007940 comp rx=0 tx=0).stop 2023-06-10T18:56:48.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.706+0000 7fc94da66640 1 -- 172.21.15.53:0/3744414355 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc948159450 msgr2=0x7fc9480b4390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:48.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.706+0000 7fc94da66640 1 --2- 172.21.15.53:0/3744414355 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc948159450 0x7fc9480b4390 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fc94000c7f0 tx=0x7fc94000ccb0 comp rx=0 tx=0).stop 2023-06-10T18:56:48.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.706+0000 7fc94da66640 1 -- 172.21.15.53:0/3744414355 shutdown_connections 2023-06-10T18:56:48.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.706+0000 7fc94da66640 1 --2- 172.21.15.53:0/3744414355 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc9340662b0 0x7fc934068760 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:48.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.706+0000 7fc94da66640 1 --2- 172.21.15.53:0/3744414355 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc948159450 0x7fc9480b4390 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:48.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.706+0000 7fc94da66640 1 --2- 172.21.15.53:0/3744414355 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9480cec40 0x7fc9480b3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:48.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.706+0000 7fc94da66640 1 --2- 172.21.15.53:0/3744414355 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9480cbf50 0x7fc9480c62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:48.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.706+0000 7fc94da66640 1 -- 172.21.15.53:0/3744414355 >> 172.21.15.53:0/3744414355 conn(0x7fc94806a090 msgr2=0x7fc94815d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:48.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.706+0000 7fc94da66640 1 -- 172.21.15.53:0/3744414355 shutdown_connections 2023-06-10T18:56:48.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:48.706+0000 7fc94da66640 1 -- 172.21.15.53:0/3744414355 wait complete. 2023-06-10T18:56:48.728 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-10T18:56:48.728 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-10T18:56:48.729 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi053.front.sepia.ceph.com 2023-06-10T18:56:48.729 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-06-10T18:56:48.730 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-06-10T18:56:48.730 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-10T18:56:48.731 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-10T18:56:48.731 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-10T18:56:48.732 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-06-10T18:56:48.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:56:48.733 DEBUG:teuthology.orchestra.run.smithi053:> ip addr 2023-06-10T18:56:48.739 INFO:teuthology.orchestra.run.smithi053.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-10T18:56:48.740 INFO:teuthology.orchestra.run.smithi053.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-10T18:56:48.740 INFO:teuthology.orchestra.run.smithi053.stdout: inet 127.0.0.1/8 scope host lo 2023-06-10T18:56:48.740 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:56:48.740 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 ::1/128 scope host 2023-06-10T18:56:48.740 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:56:48.740 INFO:teuthology.orchestra.run.smithi053.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T18:56:48.741 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:da brd ff:ff:ff:ff:ff:ff 2023-06-10T18:56:48.741 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f0 2023-06-10T18:56:48.741 INFO:teuthology.orchestra.run.smithi053.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T18:56:48.741 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:db brd ff:ff:ff:ff:ff:ff 2023-06-10T18:56:48.742 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f1 2023-06-10T18:56:48.742 INFO:teuthology.orchestra.run.smithi053.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-10T18:56:48.742 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:18 brd ff:ff:ff:ff:ff:ff 2023-06-10T18:56:48.743 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f0 2023-06-10T18:56:48.743 INFO:teuthology.orchestra.run.smithi053.stdout: inet 172.21.15.53/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-06-10T18:56:48.743 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft 42241sec preferred_lft 42241sec 2023-06-10T18:56:48.743 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::ae1f:6bff:fef8:3718/64 scope link 2023-06-10T18:56:48.744 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:56:48.744 INFO:teuthology.orchestra.run.smithi053.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T18:56:48.744 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:19 brd ff:ff:ff:ff:ff:ff 2023-06-10T18:56:48.744 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f1 2023-06-10T18:56:48.744 INFO:teuthology.orchestra.run.smithi053.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-06-10T18:56:48.745 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 02:42:49:3d:ee:1e brd ff:ff:ff:ff:ff:ff 2023-06-10T18:56:48.745 INFO:teuthology.orchestra.run.smithi053.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-06-10T18:56:48.745 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:56:48.745 INFO:teuthology.orchestra.run.smithi053.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-10T18:56:48.745 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-06-10T18:56:48.745 INFO:teuthology.orchestra.run.smithi053.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-06-10T18:56:48.745 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:56:48.746 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-06-10T18:56:48.746 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:56:48.746 INFO:teuthology.orchestra.run.smithi053.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-10T18:56:48.746 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-06-10T18:56:48.746 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-06-10T18:56:48.746 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:56:48.746 INFO:teuthology.orchestra.run.smithi053.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-10T18:56:48.746 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-06-10T18:56:48.747 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-06-10T18:56:48.747 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:56:48.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:56:48.747 DEBUG:teuthology.orchestra.run.smithi053:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-10T18:56:48.792 INFO:teuthology.orchestra.run.smithi053.stdout:1 2023-06-10T18:56:48.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:56:48.793 DEBUG:teuthology.orchestra.run.smithi053:> route 2023-06-10T18:56:48.845 INFO:teuthology.orchestra.run.smithi053.stdout:Kernel IP routing table 2023-06-10T18:56:48.845 INFO:teuthology.orchestra.run.smithi053.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-10T18:56:48.845 INFO:teuthology.orchestra.run.smithi053.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-06-10T18:56:48.845 INFO:teuthology.orchestra.run.smithi053.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-06-10T18:56:48.845 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-06-10T18:56:48.845 INFO:teuthology.orchestra.run.smithi053.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-10T18:56:48.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:56:48.846 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec bash -c ' 2023-06-10T18:56:48.847 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2023-06-10T18:56:48.847 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-06-10T18:56:48.847 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-06-10T18:56:48.848 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-06-10T18:56:48.848 DEBUG:teuthology.orchestra.run.smithi053:> ') 2023-06-10T18:56:48.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:56:48.917 DEBUG:teuthology.orchestra.run.smithi053:> ip netns list 2023-06-10T18:56:48.965 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-06-10T18:56:48.966 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-06-10T18:56:48.966 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-06-10T18:56:48.966 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:56:48.967 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link set brx.0 up 2023-06-10T18:56:49.021 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-06-10T18:56:49.022 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-10T18:56:49.022 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-06-10T18:56:49.074 INFO:teuthology.orchestra.run.smithi053.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-06-10T18:56:49.075 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-10T18:56:49.075 DEBUG:teuthology.orchestra.run.smithi053:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-06-10T18:56:49.122 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2023-06-10T18:56:49.180 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T18:56:49.181 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T18:56:49.234 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T18:56:49.235 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T18:56:49.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:56:49.236 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2023-06-10T18:56:49.287 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-06-10T18:56:49.287 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-06-10T18:56:49.331 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2023-06-10T18:56:49.348 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T18:56:49.348 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T18:56:49.400 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T18:56:49.401 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T18:56:49.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:56:49.402 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2023-06-10T18:56:49.416 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:2023-06-10T18:56:49.410+0000 7fbc6d2c2580 -1 init, newargv = 0x5594c5a90c90 newargc=15 2023-06-10T18:56:49.416 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[50761]: starting ceph client 2023-06-10T18:56:49.421 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[50761]: starting fuse 2023-06-10T18:56:50.522 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2023-06-10T18:56:50.538 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T18:56:50.539 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T18:56:50.593 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T18:56:50.595 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T18:56:50.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:56:50.596 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2023-06-10T18:56:50.642 INFO:teuthology.orchestra.run.smithi053.stdout:45 2023-06-10T18:56:50.643 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-06-10T18:56:50.643 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-06-10T18:56:50.643 DEBUG:teuthology.orchestra.run.smithi053:> import glob 2023-06-10T18:56:50.644 DEBUG:teuthology.orchestra.run.smithi053:> import re 2023-06-10T18:56:50.644 DEBUG:teuthology.orchestra.run.smithi053:> import os 2023-06-10T18:56:50.644 DEBUG:teuthology.orchestra.run.smithi053:> import subprocess 2023-06-10T18:56:50.645 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T18:56:50.645 DEBUG:teuthology.orchestra.run.smithi053:> def _find_admin_socket(client_name): 2023-06-10T18:56:50.645 DEBUG:teuthology.orchestra.run.smithi053:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-06-10T18:56:50.646 DEBUG:teuthology.orchestra.run.smithi053:> files = glob.glob(asok_path) 2023-06-10T18:56:50.646 DEBUG:teuthology.orchestra.run.smithi053:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-06-10T18:56:50.646 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T18:56:50.647 DEBUG:teuthology.orchestra.run.smithi053:> # Given a non-glob path, it better be there 2023-06-10T18:56:50.647 DEBUG:teuthology.orchestra.run.smithi053:> if "*" not in asok_path: 2023-06-10T18:56:50.647 DEBUG:teuthology.orchestra.run.smithi053:> assert(len(files) == 1) 2023-06-10T18:56:50.647 DEBUG:teuthology.orchestra.run.smithi053:> return files[0] 2023-06-10T18:56:50.648 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T18:56:50.648 DEBUG:teuthology.orchestra.run.smithi053:> for f in files: 2023-06-10T18:56:50.648 DEBUG:teuthology.orchestra.run.smithi053:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-06-10T18:56:50.649 DEBUG:teuthology.orchestra.run.smithi053:> if os.path.exists("/proc/{0}".format(pid)): 2023-06-10T18:56:50.649 DEBUG:teuthology.orchestra.run.smithi053:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-06-10T18:56:50.649 DEBUG:teuthology.orchestra.run.smithi053:> contents = proc_f.read() 2023-06-10T18:56:50.650 DEBUG:teuthology.orchestra.run.smithi053:> if mountpoint in contents: 2023-06-10T18:56:50.650 DEBUG:teuthology.orchestra.run.smithi053:> return f 2023-06-10T18:56:50.650 DEBUG:teuthology.orchestra.run.smithi053:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-06-10T18:56:50.650 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T18:56:50.651 DEBUG:teuthology.orchestra.run.smithi053:> print(_find_admin_socket("client.0")) 2023-06-10T18:56:50.651 DEBUG:teuthology.orchestra.run.smithi053:> ' 2023-06-10T18:56:50.769 INFO:teuthology.orchestra.run.smithi053.stdout:/var/run/ceph/ceph-client.0.50761.asok 2023-06-10T18:56:50.950 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.50761.asok 2023-06-10T18:56:50.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:56:50.951 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.50761.asok status 2023-06-10T18:56:51.113 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-06-10T18:56:51.113 INFO:teuthology.orchestra.run.smithi053.stdout: "metadata": { 2023-06-10T18:56:51.114 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_sha1": "219d315c3a0b2075e570fb1964be2ad33fe7a9c8", 2023-06-10T18:56:51.114 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_version": "ceph version 18.0.0-4359-g219d315c (219d315c3a0b2075e570fb1964be2ad33fe7a9c8) reef (dev)", 2023-06-10T18:56:51.114 INFO:teuthology.orchestra.run.smithi053.stdout: "entity_id": "0", 2023-06-10T18:56:51.114 INFO:teuthology.orchestra.run.smithi053.stdout: "hostname": "smithi053", 2023-06-10T18:56:51.114 INFO:teuthology.orchestra.run.smithi053.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-06-10T18:56:51.114 INFO:teuthology.orchestra.run.smithi053.stdout: "pid": "50761", 2023-06-10T18:56:51.114 INFO:teuthology.orchestra.run.smithi053.stdout: "root": "/" 2023-06-10T18:56:51.115 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:56:51.115 INFO:teuthology.orchestra.run.smithi053.stdout: "dentry_count": 0, 2023-06-10T18:56:51.115 INFO:teuthology.orchestra.run.smithi053.stdout: "dentry_pinned_count": 0, 2023-06-10T18:56:51.115 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 6270, 2023-06-10T18:56:51.115 INFO:teuthology.orchestra.run.smithi053.stdout: "inst": { 2023-06-10T18:56:51.115 INFO:teuthology.orchestra.run.smithi053.stdout: "name": { 2023-06-10T18:56:51.116 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "client", 2023-06-10T18:56:51.116 INFO:teuthology.orchestra.run.smithi053.stdout: "num": 6270 2023-06-10T18:56:51.116 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:56:51.116 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": { 2023-06-10T18:56:51.116 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2023-06-10T18:56:51.116 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "192.168.0.1:0", 2023-06-10T18:56:51.116 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 1194525209 2023-06-10T18:56:51.116 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:56:51.117 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:56:51.117 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": { 2023-06-10T18:56:51.117 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2023-06-10T18:56:51.117 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "192.168.0.1:0", 2023-06-10T18:56:51.117 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 1194525209 2023-06-10T18:56:51.117 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:56:51.117 INFO:teuthology.orchestra.run.smithi053.stdout: "inst_str": "client.6270 192.168.0.1:0/1194525209", 2023-06-10T18:56:51.118 INFO:teuthology.orchestra.run.smithi053.stdout: "addr_str": "192.168.0.1:0/1194525209", 2023-06-10T18:56:51.118 INFO:teuthology.orchestra.run.smithi053.stdout: "inode_count": 1, 2023-06-10T18:56:51.118 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_epoch": 20, 2023-06-10T18:56:51.118 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_epoch": 53, 2023-06-10T18:56:51.118 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_epoch_barrier": 0, 2023-06-10T18:56:51.118 INFO:teuthology.orchestra.run.smithi053.stdout: "blocklisted": false, 2023-06-10T18:56:51.118 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs" 2023-06-10T18:56:51.118 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-06-10T18:56:51.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:56:51.127 DEBUG:teuthology.orchestra.run.smithi053:> stat --file-system '--printf=%T 2023-06-10T18:56:51.127 DEBUG:teuthology.orchestra.run.smithi053:> ' -- /home/ubuntu/cephtest/mnt.0 2023-06-10T18:56:51.134 INFO:teuthology.orchestra.run.smithi053.stdout:fuseblk 2023-06-10T18:56:51.134 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-06-10T18:56:51.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:56:51.135 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-06-10T18:56:51.190 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T18:56:51.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:51.358+0000 7fd590cd8640 1 Processor -- start 2023-06-10T18:56:51.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:51.358+0000 7fd590cd8640 1 -- start start 2023-06-10T18:56:51.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:51.358+0000 7fd590cd8640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd58c0c8d00 0x7fd58c06b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:51.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:51.358+0000 7fd590cd8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd58c06bc00 0x7fd58c162180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:51.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:51.358+0000 7fd590cd8640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd58c158a90 con 0x7fd58c06b2f0 2023-06-10T18:56:51.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:51.358+0000 7fd590cd8640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd58c06f780 con 0x7fd58c06bc00 2023-06-10T18:56:51.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:51.358+0000 7fd590cd8640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd58c0705d0 con 0x7fd58c0c8d00 2023-06-10T18:56:51.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:51.358+0000 7fd58ad9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd58c06bc00 0x7fd58c162180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:51.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:51.358+0000 7fd58ad9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd58c06bc00 0x7fd58c162180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37436/0 (socket says 172.21.15.53:37436) 2023-06-10T18:56:51.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:51.358+0000 7fd58ad9d640 1 -- 172.21.15.53:0/3259356201 learned_addr learned my addr 172.21.15.53:0/3259356201 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:51.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:51.358+0000 7fd589d9b640 1 --2- 172.21.15.53:0/3259356201 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd58c0c8d00 0x7fd58c06b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:51.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:51.358+0000 7fd58ad9d640 1 -- 172.21.15.53:0/3259356201 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd58c0c8d00 msgr2=0x7fd58c06b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:51.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:51.358+0000 7fd58ad9d640 1 --2- 172.21.15.53:0/3259356201 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd58c0c8d00 0x7fd58c06b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:51.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:51.358+0000 7fd58ad9d640 1 -- 172.21.15.53:0/3259356201 >> v1:172.21.15.117:6789/0 conn(0x7fd58c06b2f0 legacy=0x7fd58c06f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:51.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:51.358+0000 7fd58ad9d640 1 -- 172.21.15.53:0/3259356201 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd58c0cce10 con 0x7fd58c06bc00 2023-06-10T18:56:51.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:51.362+0000 7fd58ad9d640 1 --2- 172.21.15.53:0/3259356201 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd58c06bc00 0x7fd58c162180 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fd5840098a0 tx=0x7fd58401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9139a75bfb50d51a server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:51.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:51.362+0000 7fd58959a640 1 -- 172.21.15.53:0/3259356201 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5840a8a10 con 0x7fd58c06bc00 2023-06-10T18:56:51.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:51.362+0000 7fd58959a640 1 -- 172.21.15.53:0/3259356201 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5840a8b70 con 0x7fd58c06bc00 2023-06-10T18:56:51.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:51.362+0000 7fd58959a640 1 -- 172.21.15.53:0/3259356201 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5840b0440 con 0x7fd58c06bc00 2023-06-10T18:56:51.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:51.362+0000 7fd590cd8640 1 -- 172.21.15.53:0/3259356201 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd58c06bc00 msgr2=0x7fd58c162180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:51.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:51.362+0000 7fd590cd8640 1 --2- 172.21.15.53:0/3259356201 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd58c06bc00 0x7fd58c162180 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fd5840098a0 tx=0x7fd58401ed10 comp rx=0 tx=0).stop 2023-06-10T18:56:51.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:51.362+0000 7fd590cd8640 1 -- 172.21.15.53:0/3259356201 shutdown_connections 2023-06-10T18:56:51.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:51.362+0000 7fd590cd8640 1 --2- 172.21.15.53:0/3259356201 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd58c06bc00 0x7fd58c162180 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:51.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:51.362+0000 7fd590cd8640 1 --2- 172.21.15.53:0/3259356201 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd58c0c8d00 0x7fd58c06b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:51.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:51.362+0000 7fd590cd8640 1 -- 172.21.15.53:0/3259356201 >> 172.21.15.53:0/3259356201 conn(0x7fd58c06a0d0 msgr2=0x7fd58c0ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:51.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:51.362+0000 7fd590cd8640 1 -- 172.21.15.53:0/3259356201 shutdown_connections 2023-06-10T18:56:51.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:51.362+0000 7fd590cd8640 1 -- 172.21.15.53:0/3259356201 wait complete. 2023-06-10T18:56:51.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:51.362+0000 7fd590cd8640 1 Processor -- start 2023-06-10T18:56:51.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:51.362+0000 7fd590cd8640 1 -- start start 2023-06-10T18:56:51.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:51.362+0000 7fd590cd8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd58c06b2f0 0x7fd58c15a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:51.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:51.362+0000 7fd590cd8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd58c06bc00 0x7fd58c14c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:51.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:51.362+0000 7fd590cd8640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd58c0c8d00 0x7fd58c158c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:51.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:51.362+0000 7fd590cd8640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd58c159170 con 0x7fd58c06bc00 2023-06-10T18:56:51.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:51.362+0000 7fd590cd8640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd58c159410 con 0x7fd58c06b2f0 2023-06-10T18:56:51.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:51.362+0000 7fd590cd8640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd58c1596f0 con 0x7fd58c0c8d00 2023-06-10T18:56:51.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:51.362+0000 7fd589d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd58c06bc00 0x7fd58c14c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:51.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:51.362+0000 7fd589d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd58c06bc00 0x7fd58c14c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37440/0 (socket says 172.21.15.53:37440) 2023-06-10T18:56:51.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:51.362+0000 7fd589d9b640 1 -- 172.21.15.53:0/152266581 learned_addr learned my addr 172.21.15.53:0/152266581 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:51.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:51.362+0000 7fd58a59c640 1 --2- 172.21.15.53:0/152266581 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd58c06b2f0 0x7fd58c15a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:51.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:51.362+0000 7fd58ad9d640 1 --2- 172.21.15.53:0/152266581 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd58c0c8d00 0x7fd58c158c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:51.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:51.362+0000 7fd589d9b640 1 -- 172.21.15.53:0/152266581 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd58c0c8d00 msgr2=0x7fd58c158c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:51.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:51.362+0000 7fd589d9b640 1 --2- 172.21.15.53:0/152266581 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd58c0c8d00 0x7fd58c158c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:51.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:51.362+0000 7fd589d9b640 1 -- 172.21.15.53:0/152266581 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd58c06b2f0 msgr2=0x7fd58c15a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:51.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:51.362+0000 7fd589d9b640 1 --2- 172.21.15.53:0/152266581 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd58c06b2f0 0x7fd58c15a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:51.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:51.362+0000 7fd589d9b640 1 -- 172.21.15.53:0/152266581 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5840094d0 con 0x7fd58c06bc00 2023-06-10T18:56:51.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:51.362+0000 7fd589d9b640 1 --2- 172.21.15.53:0/152266581 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd58c06bc00 0x7fd58c14c080 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fd58000d5f0 tx=0x7fd58000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:51.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:51.366+0000 7fd57affd640 1 -- 172.21.15.53:0/152266581 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd580011920 con 0x7fd58c06bc00 2023-06-10T18:56:51.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:51.366+0000 7fd57affd640 1 -- 172.21.15.53:0/152266581 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd580011a80 con 0x7fd58c06bc00 2023-06-10T18:56:51.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:51.366+0000 7fd590cd8640 1 -- 172.21.15.53:0/152266581 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd58c1599d0 con 0x7fd58c06bc00 2023-06-10T18:56:51.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:51.366+0000 7fd57affd640 1 -- 172.21.15.53:0/152266581 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd580011e10 con 0x7fd58c06bc00 2023-06-10T18:56:51.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:51.366+0000 7fd590cd8640 1 -- 172.21.15.53:0/152266581 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd58c159f90 con 0x7fd58c06bc00 2023-06-10T18:56:51.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:51.366+0000 7fd590cd8640 1 -- 172.21.15.53:0/152266581 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd58c15a150 con 0x7fd58c06bc00 2023-06-10T18:56:51.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:51.366+0000 7fd57affd640 1 -- 172.21.15.53:0/152266581 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd580010440 con 0x7fd58c06bc00 2023-06-10T18:56:51.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:51.366+0000 7fd57affd640 1 --2- 172.21.15.53:0/152266581 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd56c066280 0x7fd56c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:51.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:51.366+0000 7fd57affd640 1 -- 172.21.15.53:0/152266581 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fd580085c90 con 0x7fd58c06bc00 2023-06-10T18:56:51.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:51.366+0000 7fd58a59c640 1 --2- 172.21.15.53:0/152266581 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd56c066280 0x7fd56c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:51.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:51.366+0000 7fd58a59c640 1 --2- 172.21.15.53:0/152266581 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd56c066280 0x7fd56c068730 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd57c0012f0 tx=0x7fd57c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:51.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:51.370+0000 7fd57affd640 1 -- 172.21.15.53:0/152266581 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd580053160 con 0x7fd58c06bc00 2023-06-10T18:56:51.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:51.554+0000 7fd590cd8640 1 -- 172.21.15.53:0/152266581 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd58c04d790 con 0x7fd58c06bc00 2023-06-10T18:56:51.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:51.558+0000 7fd57affd640 1 -- 172.21.15.53:0/152266581 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+4674 (secure 0 0 0) 0x7fd580020020 con 0x7fd58c06bc00 2023-06-10T18:56:51.562 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:56:51.562 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":20,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5168,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/275593879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":275593879},{"type":"v1","addr":"172.21.15.117:6837","nonce":275593879}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5422,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/2837986258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2837986258},{"type":"v1","addr":"172.21.15.117:6836","nonce":2837986258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5928,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/2789082937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2789082937},{"type":"v1","addr":"172.21.15.53:6833","nonce":2789082937}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T18:56:18.681744+0000","modified":"2023-06-10T18:56:21.825431+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5931},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5931":{"gid":5931,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/3463677034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":3463677034},{"type":"v1","addr":"172.21.15.53:6835","nonce":3463677034}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-06-10T18:56:51.563 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 20 2023-06-10T18:56:51.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:51.558+0000 7fd590cd8640 1 -- 172.21.15.53:0/152266581 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd56c066280 msgr2=0x7fd56c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:51.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:51.558+0000 7fd590cd8640 1 --2- 172.21.15.53:0/152266581 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd56c066280 0x7fd56c068730 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd57c0012f0 tx=0x7fd57c009040 comp rx=0 tx=0).stop 2023-06-10T18:56:51.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:51.558+0000 7fd590cd8640 1 -- 172.21.15.53:0/152266581 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd58c06bc00 msgr2=0x7fd58c14c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:51.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:51.558+0000 7fd590cd8640 1 --2- 172.21.15.53:0/152266581 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd58c06bc00 0x7fd58c14c080 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fd58000d5f0 tx=0x7fd58000dab0 comp rx=0 tx=0).stop 2023-06-10T18:56:51.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:51.558+0000 7fd590cd8640 1 -- 172.21.15.53:0/152266581 shutdown_connections 2023-06-10T18:56:51.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:51.558+0000 7fd590cd8640 1 --2- 172.21.15.53:0/152266581 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd56c066280 0x7fd56c068730 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:51.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:51.558+0000 7fd590cd8640 1 --2- 172.21.15.53:0/152266581 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd58c0c8d00 0x7fd58c158c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:51.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:51.558+0000 7fd590cd8640 1 --2- 172.21.15.53:0/152266581 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd58c06bc00 0x7fd58c14c080 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:51.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:51.558+0000 7fd590cd8640 1 --2- 172.21.15.53:0/152266581 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd58c06b2f0 0x7fd58c15a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:51.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:51.558+0000 7fd590cd8640 1 -- 172.21.15.53:0/152266581 >> 172.21.15.53:0/152266581 conn(0x7fd58c06a0d0 msgr2=0x7fd58c0ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:51.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:51.558+0000 7fd590cd8640 1 -- 172.21.15.53:0/152266581 shutdown_connections 2023-06-10T18:56:51.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:51.558+0000 7fd590cd8640 1 -- 172.21.15.53:0/152266581 wait complete. 2023-06-10T18:56:51.582 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2023-06-10T18:56:51.717 INFO:teuthology.orchestra.run.smithi053.stdout:[{"id":6270,"entity":{"name":{"type":"client","num":6270},"addr":{"type":"any","addr":"192.168.0.1:0","nonce":1194525209}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":0,"uptime":2.2839788059999999,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":0.99473678792664255,"halflife":300},"cap_acquisition":{"value":0,"halflife":10},"last_trim_completed_requests_tid":1,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.6270 192.168.0.1:0/1194525209","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x00000000000fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"219d315c3a0b2075e570fb1964be2ad33fe7a9c8","ceph_version":"ceph version 18.0.0-4359-g219d315c (219d315c3a0b2075e570fb1964be2ad33fe7a9c8) reef (dev)","entity_id":"0","hostname":"smithi053","mount_point":"/home/ubuntu/cephtest/mnt.0","pid":"50761","root":"/"}},{"id":5291,"entity":{"name":{"type":"client","num":5291},"addr":{"type":"any","addr":"192.168.0.1:0","nonce":369413839}},"state":"open","num_leases":3,"num_caps":4,"request_load_avg":3,"uptime":9.8439085990000006,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":8.8953722353260787,"halflife":300},"cap_acquisition":{"value":0,"halflife":10},"last_trim_completed_requests_tid":4,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.5291 192.168.0.1:0/369413839","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x00000000000fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"219d315c3a0b2075e570fb1964be2ad33fe7a9c8","ceph_version":"ceph version 18.0.0-4359-g219d315c (219d315c3a0b2075e570fb1964be2ad33fe7a9c8) reef (dev)","entity_id":"1","hostname":"smithi117","mount_point":"/home/ubuntu/cephtest/mnt.1","pid":"44292","root":"/"}}] 2023-06-10T18:56:51.717 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 10, "value": 0 }, "client_metadata": { "ceph_sha1": "219d315c3a0b2075e570fb1964be2ad33fe7a9c8", "ceph_version": "ceph version 18.0.0-4359-g219d315c (219d315c3a0b2075e570fb1964be2ad33fe7a9c8) reef (dev)", "client_features": { "feature_bits": "0x00000000000fffff" }, "entity_id": "0", "hostname": "smithi053", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "mount_point": "/home/ubuntu/cephtest/mnt.0", "pid": "50761", "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 1194525209, "type": "any" }, "name": { "num": 6270, "type": "client" } }, "id": 6270, "inst": "client.6270 192.168.0.1:0/1194525209", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 1, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 0, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 0.9947367879266426 }, "state": "open", "uptime": 2.283978806 }, { "cap_acquisition": { "halflife": 10, "value": 0 }, "client_metadata": { "ceph_sha1": "219d315c3a0b2075e570fb1964be2ad33fe7a9c8", "ceph_version": "ceph version 18.0.0-4359-g219d315c (219d315c3a0b2075e570fb1964be2ad33fe7a9c8) reef (dev)", "client_features": { "feature_bits": "0x00000000000fffff" }, "entity_id": "1", "hostname": "smithi117", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "mount_point": "/home/ubuntu/cephtest/mnt.1", "pid": "44292", "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 369413839, "type": "any" }, "name": { "num": 5291, "type": "client" } }, "id": 5291, "inst": "client.5291 192.168.0.1:0/369413839", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 4, "num_caps": 4, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 3, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 3, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 8.895372235326079 }, "state": "open", "uptime": 9.843908599 } ] 2023-06-10T18:56:51.718 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-06-10T18:56:51.718 DEBUG:teuthology.orchestra.run.smithi053:> import glob 2023-06-10T18:56:51.719 DEBUG:teuthology.orchestra.run.smithi053:> import re 2023-06-10T18:56:51.719 DEBUG:teuthology.orchestra.run.smithi053:> import os 2023-06-10T18:56:51.719 DEBUG:teuthology.orchestra.run.smithi053:> import subprocess 2023-06-10T18:56:51.719 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T18:56:51.720 DEBUG:teuthology.orchestra.run.smithi053:> def _find_admin_socket(client_name): 2023-06-10T18:56:51.720 DEBUG:teuthology.orchestra.run.smithi053:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-06-10T18:56:51.720 DEBUG:teuthology.orchestra.run.smithi053:> files = glob.glob(asok_path) 2023-06-10T18:56:51.721 DEBUG:teuthology.orchestra.run.smithi053:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-06-10T18:56:51.721 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T18:56:51.721 DEBUG:teuthology.orchestra.run.smithi053:> # Given a non-glob path, it better be there 2023-06-10T18:56:51.723 DEBUG:teuthology.orchestra.run.smithi053:> if "*" not in asok_path: 2023-06-10T18:56:51.723 DEBUG:teuthology.orchestra.run.smithi053:> assert(len(files) == 1) 2023-06-10T18:56:51.723 DEBUG:teuthology.orchestra.run.smithi053:> return files[0] 2023-06-10T18:56:51.724 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T18:56:51.724 DEBUG:teuthology.orchestra.run.smithi053:> for f in files: 2023-06-10T18:56:51.724 DEBUG:teuthology.orchestra.run.smithi053:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-06-10T18:56:51.725 DEBUG:teuthology.orchestra.run.smithi053:> if os.path.exists("/proc/{0}".format(pid)): 2023-06-10T18:56:51.725 DEBUG:teuthology.orchestra.run.smithi053:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-06-10T18:56:51.725 DEBUG:teuthology.orchestra.run.smithi053:> contents = proc_f.read() 2023-06-10T18:56:51.725 DEBUG:teuthology.orchestra.run.smithi053:> if mountpoint in contents: 2023-06-10T18:56:51.726 DEBUG:teuthology.orchestra.run.smithi053:> return f 2023-06-10T18:56:51.726 DEBUG:teuthology.orchestra.run.smithi053:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-06-10T18:56:51.726 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T18:56:51.726 DEBUG:teuthology.orchestra.run.smithi053:> print(_find_admin_socket("client.0")) 2023-06-10T18:56:51.727 DEBUG:teuthology.orchestra.run.smithi053:> ' 2023-06-10T18:56:51.797 INFO:teuthology.orchestra.run.smithi053.stdout:/var/run/ceph/ceph-client.0.50761.asok 2023-06-10T18:56:51.981 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.50761.asok 2023-06-10T18:56:51.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:56:51.981 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.50761.asok mds_sessions 2023-06-10T18:56:52.141 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-06-10T18:56:52.141 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 6270, 2023-06-10T18:56:52.141 INFO:teuthology.orchestra.run.smithi053.stdout: "inst": { 2023-06-10T18:56:52.141 INFO:teuthology.orchestra.run.smithi053.stdout: "name": { 2023-06-10T18:56:52.141 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "client", 2023-06-10T18:56:52.142 INFO:teuthology.orchestra.run.smithi053.stdout: "num": 6270 2023-06-10T18:56:52.142 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:56:52.142 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": { 2023-06-10T18:56:52.142 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2023-06-10T18:56:52.143 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "192.168.0.1:0", 2023-06-10T18:56:52.143 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 1194525209 2023-06-10T18:56:52.143 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:56:52.143 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:56:52.143 INFO:teuthology.orchestra.run.smithi053.stdout: "inst_str": "client.6270 v1:192.168.0.1:0/1194525209", 2023-06-10T18:56:52.144 INFO:teuthology.orchestra.run.smithi053.stdout: "addr_str": "v1:192.168.0.1:0/1194525209", 2023-06-10T18:56:52.144 INFO:teuthology.orchestra.run.smithi053.stdout: "sessions": [ 2023-06-10T18:56:52.144 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T18:56:52.144 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": 0, 2023-06-10T18:56:52.144 INFO:teuthology.orchestra.run.smithi053.stdout: "addrs": { 2023-06-10T18:56:52.145 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2023-06-10T18:56:52.145 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T18:56:52.145 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2023-06-10T18:56:52.145 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.53:6834", 2023-06-10T18:56:52.145 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 3463677034 2023-06-10T18:56:52.145 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:56:52.146 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T18:56:52.146 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2023-06-10T18:56:52.146 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.53:6835", 2023-06-10T18:56:52.146 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 3463677034 2023-06-10T18:56:52.146 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:56:52.146 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2023-06-10T18:56:52.146 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:56:52.147 INFO:teuthology.orchestra.run.smithi053.stdout: "seq": 0, 2023-06-10T18:56:52.147 INFO:teuthology.orchestra.run.smithi053.stdout: "cap_gen": 0, 2023-06-10T18:56:52.147 INFO:teuthology.orchestra.run.smithi053.stdout: "cap_ttl": "2023-06-10T18:57:50.415413+0000", 2023-06-10T18:56:52.147 INFO:teuthology.orchestra.run.smithi053.stdout: "last_cap_renew_request": "2023-06-10T18:56:50.415413+0000", 2023-06-10T18:56:52.148 INFO:teuthology.orchestra.run.smithi053.stdout: "cap_renew_seq": 2, 2023-06-10T18:56:52.148 INFO:teuthology.orchestra.run.smithi053.stdout: "num_caps": 1, 2023-06-10T18:56:52.148 INFO:teuthology.orchestra.run.smithi053.stdout: "state": "open" 2023-06-10T18:56:52.148 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:56:52.149 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2023-06-10T18:56:52.149 INFO:teuthology.orchestra.run.smithi053.stdout: "mdsmap_epoch": 20 2023-06-10T18:56:52.149 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-06-10T18:56:52.155 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-06-10T18:56:52.156 DEBUG:teuthology.orchestra.run.smithi117:> import glob 2023-06-10T18:56:52.156 DEBUG:teuthology.orchestra.run.smithi117:> import re 2023-06-10T18:56:52.157 DEBUG:teuthology.orchestra.run.smithi117:> import os 2023-06-10T18:56:52.157 DEBUG:teuthology.orchestra.run.smithi117:> import subprocess 2023-06-10T18:56:52.158 DEBUG:teuthology.orchestra.run.smithi117:> 2023-06-10T18:56:52.158 DEBUG:teuthology.orchestra.run.smithi117:> def _find_admin_socket(client_name): 2023-06-10T18:56:52.159 DEBUG:teuthology.orchestra.run.smithi117:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-06-10T18:56:52.159 DEBUG:teuthology.orchestra.run.smithi117:> files = glob.glob(asok_path) 2023-06-10T18:56:52.160 DEBUG:teuthology.orchestra.run.smithi117:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-06-10T18:56:52.160 DEBUG:teuthology.orchestra.run.smithi117:> 2023-06-10T18:56:52.161 DEBUG:teuthology.orchestra.run.smithi117:> # Given a non-glob path, it better be there 2023-06-10T18:56:52.162 DEBUG:teuthology.orchestra.run.smithi117:> if "*" not in asok_path: 2023-06-10T18:56:52.162 DEBUG:teuthology.orchestra.run.smithi117:> assert(len(files) == 1) 2023-06-10T18:56:52.163 DEBUG:teuthology.orchestra.run.smithi117:> return files[0] 2023-06-10T18:56:52.163 DEBUG:teuthology.orchestra.run.smithi117:> 2023-06-10T18:56:52.164 DEBUG:teuthology.orchestra.run.smithi117:> for f in files: 2023-06-10T18:56:52.164 DEBUG:teuthology.orchestra.run.smithi117:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-06-10T18:56:52.165 DEBUG:teuthology.orchestra.run.smithi117:> if os.path.exists("/proc/{0}".format(pid)): 2023-06-10T18:56:52.165 DEBUG:teuthology.orchestra.run.smithi117:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-06-10T18:56:52.166 DEBUG:teuthology.orchestra.run.smithi117:> contents = proc_f.read() 2023-06-10T18:56:52.166 DEBUG:teuthology.orchestra.run.smithi117:> if mountpoint in contents: 2023-06-10T18:56:52.167 DEBUG:teuthology.orchestra.run.smithi117:> return f 2023-06-10T18:56:52.167 DEBUG:teuthology.orchestra.run.smithi117:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-06-10T18:56:52.168 DEBUG:teuthology.orchestra.run.smithi117:> 2023-06-10T18:56:52.168 DEBUG:teuthology.orchestra.run.smithi117:> print(_find_admin_socket("client.1")) 2023-06-10T18:56:52.169 DEBUG:teuthology.orchestra.run.smithi117:> ' 2023-06-10T18:56:52.249 INFO:teuthology.orchestra.run.smithi117.stdout:/var/run/ceph/ceph-client.1.44292.asok 2023-06-10T18:56:52.432 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.44292.asok 2023-06-10T18:56:52.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:56:52.433 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.44292.asok mds_sessions 2023-06-10T18:56:52.589 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2023-06-10T18:56:52.590 INFO:teuthology.orchestra.run.smithi117.stdout: "id": 5291, 2023-06-10T18:56:52.590 INFO:teuthology.orchestra.run.smithi117.stdout: "inst": { 2023-06-10T18:56:52.590 INFO:teuthology.orchestra.run.smithi117.stdout: "name": { 2023-06-10T18:56:52.590 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "client", 2023-06-10T18:56:52.590 INFO:teuthology.orchestra.run.smithi117.stdout: "num": 5291 2023-06-10T18:56:52.590 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-06-10T18:56:52.591 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": { 2023-06-10T18:56:52.591 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "v1", 2023-06-10T18:56:52.591 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": "192.168.0.1:0", 2023-06-10T18:56:52.591 INFO:teuthology.orchestra.run.smithi117.stdout: "nonce": 369413839 2023-06-10T18:56:52.591 INFO:teuthology.orchestra.run.smithi117.stdout: } 2023-06-10T18:56:52.591 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-06-10T18:56:52.591 INFO:teuthology.orchestra.run.smithi117.stdout: "inst_str": "client.5291 v1:192.168.0.1:0/369413839", 2023-06-10T18:56:52.592 INFO:teuthology.orchestra.run.smithi117.stdout: "addr_str": "v1:192.168.0.1:0/369413839", 2023-06-10T18:56:52.592 INFO:teuthology.orchestra.run.smithi117.stdout: "sessions": [ 2023-06-10T18:56:52.592 INFO:teuthology.orchestra.run.smithi117.stdout: { 2023-06-10T18:56:52.592 INFO:teuthology.orchestra.run.smithi117.stdout: "mds": 0, 2023-06-10T18:56:52.592 INFO:teuthology.orchestra.run.smithi117.stdout: "addrs": { 2023-06-10T18:56:52.593 INFO:teuthology.orchestra.run.smithi117.stdout: "addrvec": [ 2023-06-10T18:56:52.593 INFO:teuthology.orchestra.run.smithi117.stdout: { 2023-06-10T18:56:52.593 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "v2", 2023-06-10T18:56:52.593 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": "172.21.15.53:6834", 2023-06-10T18:56:52.593 INFO:teuthology.orchestra.run.smithi117.stdout: "nonce": 3463677034 2023-06-10T18:56:52.594 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-06-10T18:56:52.594 INFO:teuthology.orchestra.run.smithi117.stdout: { 2023-06-10T18:56:52.594 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "v1", 2023-06-10T18:56:52.594 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": "172.21.15.53:6835", 2023-06-10T18:56:52.595 INFO:teuthology.orchestra.run.smithi117.stdout: "nonce": 3463677034 2023-06-10T18:56:52.595 INFO:teuthology.orchestra.run.smithi117.stdout: } 2023-06-10T18:56:52.595 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2023-06-10T18:56:52.595 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-06-10T18:56:52.595 INFO:teuthology.orchestra.run.smithi117.stdout: "seq": 1, 2023-06-10T18:56:52.595 INFO:teuthology.orchestra.run.smithi117.stdout: "cap_gen": 0, 2023-06-10T18:56:52.595 INFO:teuthology.orchestra.run.smithi117.stdout: "cap_ttl": "2023-06-10T18:57:42.857439+0000", 2023-06-10T18:56:52.596 INFO:teuthology.orchestra.run.smithi117.stdout: "last_cap_renew_request": "2023-06-10T18:56:42.857439+0000", 2023-06-10T18:56:52.596 INFO:teuthology.orchestra.run.smithi117.stdout: "cap_renew_seq": 2, 2023-06-10T18:56:52.596 INFO:teuthology.orchestra.run.smithi117.stdout: "num_caps": 4, 2023-06-10T18:56:52.596 INFO:teuthology.orchestra.run.smithi117.stdout: "state": "open" 2023-06-10T18:56:52.596 INFO:teuthology.orchestra.run.smithi117.stdout: } 2023-06-10T18:56:52.596 INFO:teuthology.orchestra.run.smithi117.stdout: ], 2023-06-10T18:56:52.596 INFO:teuthology.orchestra.run.smithi117.stdout: "mdsmap_epoch": 20 2023-06-10T18:56:52.596 INFO:teuthology.orchestra.run.smithi117.stdout:} 2023-06-10T18:56:52.603 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-06-10T18:56:52.603 DEBUG:teuthology.orchestra.run.smithi053:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-06-10T18:56:52.664 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-06-10T18:56:52.716 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-06-10T18:56:52.716 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T18:56:52.717 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T18:56:52.724 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T18:56:52.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:52.890+0000 7f6251f47640 1 Processor -- start 2023-06-10T18:56:52.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:52.890+0000 7f6251f47640 1 -- start start 2023-06-10T18:56:52.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:52.894+0000 7f6251f47640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f624c0cc690 0x7f624c0d04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:52.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:52.894+0000 7f6251f47640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f624c0ccae0 0x7f624c0d09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:52.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:52.894+0000 7f6251f47640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f624c0d0020 con 0x7f624c0b3ac0 2023-06-10T18:56:52.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:52.894+0000 7f6251f47640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f624c0cef40 con 0x7f624c0cc690 2023-06-10T18:56:52.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:52.894+0000 7f6251f47640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f624c0cf220 con 0x7f624c0ccae0 2023-06-10T18:56:52.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:52.894+0000 7f624affd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f624c0cc690 0x7f624c0d04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:52.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:52.894+0000 7f624affd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f624c0cc690 0x7f624c0d04b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37448/0 (socket says 172.21.15.53:37448) 2023-06-10T18:56:52.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:52.894+0000 7f624affd640 1 -- 172.21.15.53:0/786883057 learned_addr learned my addr 172.21.15.53:0/786883057 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:52.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:52.894+0000 7f624bfff640 1 --2- 172.21.15.53:0/786883057 >> v2:172.21.15.117:3300/0 conn(0x7f624c0ccae0 0x7f624c0d09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:52.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:52.894+0000 7f624affd640 1 -- 172.21.15.53:0/786883057 >> v2:172.21.15.117:3300/0 conn(0x7f624c0ccae0 msgr2=0x7f624c0d09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:52.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:52.894+0000 7f624affd640 1 --2- 172.21.15.53:0/786883057 >> v2:172.21.15.117:3300/0 conn(0x7f624c0ccae0 0x7f624c0d09f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:52.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:52.894+0000 7f624affd640 1 -- 172.21.15.53:0/786883057 >> v1:172.21.15.117:6789/0 conn(0x7f624c0b3ac0 legacy=0x7f624c0b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:52.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:52.894+0000 7f624affd640 1 -- 172.21.15.53:0/786883057 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f624c0cf500 con 0x7f624c0cc690 2023-06-10T18:56:52.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:52.894+0000 7f624affd640 1 --2- 172.21.15.53:0/786883057 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f624c0cc690 0x7f624c0d04b0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f624c160410 tx=0x7f624001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28e064bea46b47cb server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:52.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:52.894+0000 7f624a7fc640 1 -- 172.21.15.53:0/786883057 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62400ac640 con 0x7f624c0cc690 2023-06-10T18:56:52.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:52.898+0000 7f624a7fc640 1 -- 172.21.15.53:0/786883057 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62400ac7a0 con 0x7f624c0cc690 2023-06-10T18:56:52.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:52.898+0000 7f624a7fc640 1 -- 172.21.15.53:0/786883057 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62400acb30 con 0x7f624c0cc690 2023-06-10T18:56:52.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:52.898+0000 7f6251f47640 1 -- 172.21.15.53:0/786883057 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f624c0cc690 msgr2=0x7f624c0d04b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:52.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:52.898+0000 7f6251f47640 1 --2- 172.21.15.53:0/786883057 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f624c0cc690 0x7f624c0d04b0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f624c160410 tx=0x7f624001c4d0 comp rx=0 tx=0).stop 2023-06-10T18:56:52.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:52.898+0000 7f6251f47640 1 -- 172.21.15.53:0/786883057 shutdown_connections 2023-06-10T18:56:52.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:52.898+0000 7f6251f47640 1 --2- 172.21.15.53:0/786883057 >> v2:172.21.15.117:3300/0 conn(0x7f624c0ccae0 0x7f624c0d09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:52.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:52.898+0000 7f6251f47640 1 --2- 172.21.15.53:0/786883057 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f624c0cc690 0x7f624c0d04b0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:52.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:52.898+0000 7f6251f47640 1 -- 172.21.15.53:0/786883057 >> 172.21.15.53:0/786883057 conn(0x7f624c071790 msgr2=0x7f624c069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:52.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:52.898+0000 7f6251f47640 1 -- 172.21.15.53:0/786883057 shutdown_connections 2023-06-10T18:56:52.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:52.898+0000 7f6251f47640 1 -- 172.21.15.53:0/786883057 wait complete. 2023-06-10T18:56:52.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:52.898+0000 7f6251f47640 1 Processor -- start 2023-06-10T18:56:52.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:52.898+0000 7f6251f47640 1 -- start start 2023-06-10T18:56:52.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:52.898+0000 7f6251f47640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f624c0b3ac0 0x7f624c0b6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:52.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:52.898+0000 7f6251f47640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f624c0cc690 0x7f624c14ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:52.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:52.898+0000 7f6251f47640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f624c0ccae0 0x7f624c14c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:52.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:52.898+0000 7f6251f47640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f624c14ca40 con 0x7f624c0cc690 2023-06-10T18:56:52.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:52.898+0000 7f6251f47640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f624c14cca0 con 0x7f624c0b3ac0 2023-06-10T18:56:52.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:52.898+0000 7f6251f47640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f624c159e80 con 0x7f624c0ccae0 2023-06-10T18:56:52.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:52.898+0000 7f624affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f624c0cc690 0x7f624c14ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:52.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:52.898+0000 7f624affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f624c0cc690 0x7f624c14ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37454/0 (socket says 172.21.15.53:37454) 2023-06-10T18:56:52.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:52.898+0000 7f624affd640 1 -- 172.21.15.53:0/1394634617 learned_addr learned my addr 172.21.15.53:0/1394634617 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:52.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:52.898+0000 7f624b7fe640 1 --2- 172.21.15.53:0/1394634617 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f624c0b3ac0 0x7f624c0b6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:52.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:52.898+0000 7f624bfff640 1 --2- 172.21.15.53:0/1394634617 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f624c0ccae0 0x7f624c14c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:52.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:52.898+0000 7f624affd640 1 -- 172.21.15.53:0/1394634617 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f624c0ccae0 msgr2=0x7f624c14c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:52.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:52.898+0000 7f624affd640 1 --2- 172.21.15.53:0/1394634617 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f624c0ccae0 0x7f624c14c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:52.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:52.898+0000 7f624affd640 1 -- 172.21.15.53:0/1394634617 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f624c0b3ac0 msgr2=0x7f624c0b6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:52.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:52.898+0000 7f624affd640 1 --2- 172.21.15.53:0/1394634617 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f624c0b3ac0 0x7f624c0b6180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:52.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:52.898+0000 7f624affd640 1 -- 172.21.15.53:0/1394634617 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62400094d0 con 0x7f624c0cc690 2023-06-10T18:56:52.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:52.898+0000 7f624bfff640 1 --2- 172.21.15.53:0/1394634617 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f624c0ccae0 0x7f624c14c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:56:52.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:52.898+0000 7f624affd640 1 --2- 172.21.15.53:0/1394634617 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f624c0cc690 0x7f624c14ea90 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f62400af040 tx=0x7f624001ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:52.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:52.898+0000 7f6233fff640 1 -- 172.21.15.53:0/1394634617 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62400b7830 con 0x7f624c0cc690 2023-06-10T18:56:52.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:52.898+0000 7f6233fff640 1 -- 172.21.15.53:0/1394634617 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62400b79b0 con 0x7f624c0cc690 2023-06-10T18:56:52.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:52.898+0000 7f6251f47640 1 -- 172.21.15.53:0/1394634617 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f624c15a160 con 0x7f624c0cc690 2023-06-10T18:56:52.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:52.898+0000 7f6233fff640 1 -- 172.21.15.53:0/1394634617 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62400b7d60 con 0x7f624c0cc690 2023-06-10T18:56:52.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:52.898+0000 7f6251f47640 1 -- 172.21.15.53:0/1394634617 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f624c14d240 con 0x7f624c0cc690 2023-06-10T18:56:52.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:52.902+0000 7f6251f47640 1 -- 172.21.15.53:0/1394634617 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f624c14d430 con 0x7f624c0cc690 2023-06-10T18:56:52.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:52.902+0000 7f6233fff640 1 -- 172.21.15.53:0/1394634617 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f62400b3040 con 0x7f624c0cc690 2023-06-10T18:56:52.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:52.902+0000 7f6233fff640 1 --2- 172.21.15.53:0/1394634617 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6238066280 0x7f6238068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:52.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:52.902+0000 7f6233fff640 1 -- 172.21.15.53:0/1394634617 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f624011e570 con 0x7f624c0cc690 2023-06-10T18:56:52.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:52.902+0000 7f624b7fe640 1 --2- 172.21.15.53:0/1394634617 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6238066280 0x7f6238068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:52.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:52.902+0000 7f624b7fe640 1 --2- 172.21.15.53:0/1394634617 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6238066280 0x7f6238068730 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f623c000f70 tx=0x7f623c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:52.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:52.906+0000 7f6233fff640 1 -- 172.21.15.53:0/1394634617 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f62400ebb20 con 0x7f624c0cc690 2023-06-10T18:56:53.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.062+0000 7f6251f47640 1 -- 172.21.15.53:0/1394634617 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f624c04d790 con 0x7f624c0cc690 2023-06-10T18:56:53.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.062+0000 7f6233fff640 1 -- 172.21.15.53:0/1394634617 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+18434 (secure 0 0 0) 0x7f62400ef140 con 0x7f624c0cc690 2023-06-10T18:56:53.069 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:56:53.069 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":53,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T18:56:27.877880+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-06-10T18:56:16.364582+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-06-10T18:56:17.656793+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.e","mappings":[{"from":0,"to":6}]},{"pgid":"8.1d","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T18:56:53.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.066+0000 7f6251f47640 1 -- 172.21.15.53:0/1394634617 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6238066280 msgr2=0x7f6238068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:53.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.066+0000 7f6251f47640 1 --2- 172.21.15.53:0/1394634617 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6238066280 0x7f6238068730 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f623c000f70 tx=0x7f623c009040 comp rx=0 tx=0).stop 2023-06-10T18:56:53.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.066+0000 7f6251f47640 1 -- 172.21.15.53:0/1394634617 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f624c0cc690 msgr2=0x7f624c14ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:53.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.066+0000 7f6251f47640 1 --2- 172.21.15.53:0/1394634617 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f624c0cc690 0x7f624c14ea90 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f62400af040 tx=0x7f624001ad10 comp rx=0 tx=0).stop 2023-06-10T18:56:53.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.066+0000 7f6251f47640 1 -- 172.21.15.53:0/1394634617 shutdown_connections 2023-06-10T18:56:53.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.066+0000 7f6251f47640 1 --2- 172.21.15.53:0/1394634617 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6238066280 0x7f6238068730 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:53.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.066+0000 7f6251f47640 1 --2- 172.21.15.53:0/1394634617 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f624c0ccae0 0x7f624c14c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:53.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.066+0000 7f6251f47640 1 --2- 172.21.15.53:0/1394634617 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f624c0cc690 0x7f624c14ea90 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:53.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.066+0000 7f6251f47640 1 --2- 172.21.15.53:0/1394634617 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f624c0b3ac0 0x7f624c0b6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:53.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.066+0000 7f6251f47640 1 -- 172.21.15.53:0/1394634617 >> 172.21.15.53:0/1394634617 conn(0x7f624c071790 msgr2=0x7f624c0ce320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:53.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.066+0000 7f6251f47640 1 -- 172.21.15.53:0/1394634617 shutdown_connections 2023-06-10T18:56:53.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.066+0000 7f6251f47640 1 -- 172.21.15.53:0/1394634617 wait complete. 2023-06-10T18:56:53.088 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-10T18:52:33.633114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-10T18:52:39.171487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-10T18:56:16.364582+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2023-06-10T18:56:17.656793+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '51', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-10T18:56:53.089 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-10T18:56:53.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.210+0000 7f4a57a50640 1 Processor -- start 2023-06-10T18:56:53.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.210+0000 7f4a57a50640 1 -- start start 2023-06-10T18:56:53.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.214+0000 7f4a57a50640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4a500c97d0 0x7f4a500cb820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:53.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.214+0000 7f4a57a50640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4a5006c350 0x7f4a500ac200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:53.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.214+0000 7f4a57a50640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a500cbd60 con 0x7f4a500af760 2023-06-10T18:56:53.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.214+0000 7f4a57a50640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a500ca5c0 con 0x7f4a5006c350 2023-06-10T18:56:53.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.214+0000 7f4a57a50640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a500abd70 con 0x7f4a500c97d0 2023-06-10T18:56:53.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.214+0000 7f4a54feb640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4a5006c350 0x7f4a500ac200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:53.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.214+0000 7f4a54feb640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4a5006c350 0x7f4a500ac200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37458/0 (socket says 172.21.15.53:37458) 2023-06-10T18:56:53.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.214+0000 7f4a54feb640 1 -- 172.21.15.53:0/3896696380 learned_addr learned my addr 172.21.15.53:0/3896696380 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:53.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.214+0000 7f4a557ec640 1 --2- 172.21.15.53:0/3896696380 >> v2:172.21.15.117:3300/0 conn(0x7f4a500c97d0 0x7f4a500cb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:53.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.214+0000 7f4a54feb640 1 -- 172.21.15.53:0/3896696380 >> v2:172.21.15.117:3300/0 conn(0x7f4a500c97d0 msgr2=0x7f4a500cb820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:53.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.214+0000 7f4a54feb640 1 --2- 172.21.15.53:0/3896696380 >> v2:172.21.15.117:3300/0 conn(0x7f4a500c97d0 0x7f4a500cb820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:53.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.214+0000 7f4a54feb640 1 -- 172.21.15.53:0/3896696380 >> v1:172.21.15.117:6789/0 conn(0x7f4a500af760 legacy=0x7f4a5006b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:53.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.214+0000 7f4a54feb640 1 -- 172.21.15.53:0/3896696380 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a500c9ba0 con 0x7f4a5006c350 2023-06-10T18:56:53.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.214+0000 7f4a54feb640 1 --2- 172.21.15.53:0/3896696380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a5006c350 0x7f4a500ac200 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f4a5006e9d0 tx=0x7f4a4401c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8711754afa407f4 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:53.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.214+0000 7f4a4ffff640 1 -- 172.21.15.53:0/3896696380 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a440a5530 con 0x7f4a5006c350 2023-06-10T18:56:53.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.214+0000 7f4a4ffff640 1 -- 172.21.15.53:0/3896696380 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a440a5690 con 0x7f4a5006c350 2023-06-10T18:56:53.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.214+0000 7f4a4ffff640 1 -- 172.21.15.53:0/3896696380 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a440a5a20 con 0x7f4a5006c350 2023-06-10T18:56:53.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.214+0000 7f4a57a50640 1 -- 172.21.15.53:0/3896696380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a5006c350 msgr2=0x7f4a500ac200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:53.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.214+0000 7f4a57a50640 1 --2- 172.21.15.53:0/3896696380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a5006c350 0x7f4a500ac200 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f4a5006e9d0 tx=0x7f4a4401c870 comp rx=0 tx=0).stop 2023-06-10T18:56:53.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.218+0000 7f4a57a50640 1 -- 172.21.15.53:0/3896696380 shutdown_connections 2023-06-10T18:56:53.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.218+0000 7f4a57a50640 1 --2- 172.21.15.53:0/3896696380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a5006c350 0x7f4a500ac200 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:53.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.218+0000 7f4a57a50640 1 --2- 172.21.15.53:0/3896696380 >> v2:172.21.15.117:3300/0 conn(0x7f4a500c97d0 0x7f4a500cb820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:53.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.218+0000 7f4a57a50640 1 -- 172.21.15.53:0/3896696380 >> 172.21.15.53:0/3896696380 conn(0x7f4a5006a0e0 msgr2=0x7f4a500cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:53.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.218+0000 7f4a57a50640 1 -- 172.21.15.53:0/3896696380 shutdown_connections 2023-06-10T18:56:53.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.218+0000 7f4a57a50640 1 -- 172.21.15.53:0/3896696380 wait complete. 2023-06-10T18:56:53.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.218+0000 7f4a57a50640 1 Processor -- start 2023-06-10T18:56:53.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.218+0000 7f4a57a50640 1 -- start start 2023-06-10T18:56:53.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.218+0000 7f4a57a50640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a5006c350 0x7f4a5015d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:53.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.218+0000 7f4a57a50640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a500af760 0x7f4a500b0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:53.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.218+0000 7f4a57a50640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a500c97d0 0x7f4a5015cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:53.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.218+0000 7f4a57a50640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a500c5d70 con 0x7f4a500af760 2023-06-10T18:56:53.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.218+0000 7f4a57a50640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a500b1050 con 0x7f4a500c97d0 2023-06-10T18:56:53.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.218+0000 7f4a57a50640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5015eb80 con 0x7f4a5006c350 2023-06-10T18:56:53.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.218+0000 7f4a54feb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a500af760 0x7f4a500b0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:53.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.218+0000 7f4a54feb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a500af760 0x7f4a500b0b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37470/0 (socket says 172.21.15.53:37470) 2023-06-10T18:56:53.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.218+0000 7f4a54feb640 1 -- 172.21.15.53:0/3320354956 learned_addr learned my addr 172.21.15.53:0/3320354956 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:53.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.218+0000 7f4a55fed640 1 --2- 172.21.15.53:0/3320354956 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a500c97d0 0x7f4a5015cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:53.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.218+0000 7f4a54feb640 1 -- 172.21.15.53:0/3320354956 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a5006c350 msgr2=0x7f4a5015d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:53.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.218+0000 7f4a54feb640 1 --2- 172.21.15.53:0/3320354956 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a5006c350 0x7f4a5015d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:53.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.218+0000 7f4a54feb640 1 -- 172.21.15.53:0/3320354956 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a500c97d0 msgr2=0x7f4a5015cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:53.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.218+0000 7f4a54feb640 1 --2- 172.21.15.53:0/3320354956 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a500c97d0 0x7f4a5015cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:53.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.218+0000 7f4a54feb640 1 -- 172.21.15.53:0/3320354956 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a44009b30 con 0x7f4a500af760 2023-06-10T18:56:53.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.218+0000 7f4a54feb640 1 --2- 172.21.15.53:0/3320354956 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a500af760 0x7f4a500b0b10 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f4a4401a4a0 tx=0x7f4a44019610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:53.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.218+0000 7f4a4dffb640 1 -- 172.21.15.53:0/3320354956 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a440b8670 con 0x7f4a500af760 2023-06-10T18:56:53.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.218+0000 7f4a4dffb640 1 -- 172.21.15.53:0/3320354956 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a440b87f0 con 0x7f4a500af760 2023-06-10T18:56:53.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.218+0000 7f4a57a50640 1 -- 172.21.15.53:0/3320354956 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a5015c100 con 0x7f4a500af760 2023-06-10T18:56:53.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.218+0000 7f4a4dffb640 1 -- 172.21.15.53:0/3320354956 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a440b8ba0 con 0x7f4a500af760 2023-06-10T18:56:53.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.218+0000 7f4a57a50640 1 -- 172.21.15.53:0/3320354956 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a501570e0 con 0x7f4a500af760 2023-06-10T18:56:53.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.218+0000 7f4a57a50640 1 -- 172.21.15.53:0/3320354956 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a5015bf60 con 0x7f4a500af760 2023-06-10T18:56:53.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.222+0000 7f4a4dffb640 1 -- 172.21.15.53:0/3320354956 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4a440b8d00 con 0x7f4a500af760 2023-06-10T18:56:53.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.222+0000 7f4a4dffb640 1 --2- 172.21.15.53:0/3320354956 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4a3c066280 0x7f4a3c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:53.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.222+0000 7f4a4dffb640 1 -- 172.21.15.53:0/3320354956 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f4a4411ee90 con 0x7f4a500af760 2023-06-10T18:56:53.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.222+0000 7f4a557ec640 1 --2- 172.21.15.53:0/3320354956 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4a3c066280 0x7f4a3c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:53.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.222+0000 7f4a557ec640 1 --2- 172.21.15.53:0/3320354956 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4a3c066280 0x7f4a3c068730 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f4a480098f0 tx=0x7f4a48008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:53.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.226+0000 7f4a4dffb640 1 -- 172.21.15.53:0/3320354956 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4a5015bf60 con 0x7f4a500af760 2023-06-10T18:56:53.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.378+0000 7f4a57a50640 1 -- 172.21.15.53:0/3320354956 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4a500cbd60 con 0x7f4a500af760 2023-06-10T18:56:53.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.378+0000 7f4a4dffb640 1 -- 172.21.15.53:0/3320354956 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v53) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4a500cbd60 con 0x7f4a500af760 2023-06-10T18:56:53.385 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-06-10T18:56:53.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.382+0000 7f4a57a50640 1 -- 172.21.15.53:0/3320354956 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4a3c066280 msgr2=0x7f4a3c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:53.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.382+0000 7f4a57a50640 1 --2- 172.21.15.53:0/3320354956 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4a3c066280 0x7f4a3c068730 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f4a480098f0 tx=0x7f4a48008040 comp rx=0 tx=0).stop 2023-06-10T18:56:53.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.382+0000 7f4a57a50640 1 -- 172.21.15.53:0/3320354956 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a500af760 msgr2=0x7f4a500b0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:53.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.382+0000 7f4a57a50640 1 --2- 172.21.15.53:0/3320354956 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a500af760 0x7f4a500b0b10 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f4a4401a4a0 tx=0x7f4a44019610 comp rx=0 tx=0).stop 2023-06-10T18:56:53.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.382+0000 7f4a57a50640 1 -- 172.21.15.53:0/3320354956 shutdown_connections 2023-06-10T18:56:53.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.382+0000 7f4a57a50640 1 --2- 172.21.15.53:0/3320354956 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4a3c066280 0x7f4a3c068730 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:53.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.382+0000 7f4a57a50640 1 --2- 172.21.15.53:0/3320354956 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a500c97d0 0x7f4a5015cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:53.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.382+0000 7f4a57a50640 1 --2- 172.21.15.53:0/3320354956 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a500af760 0x7f4a500b0b10 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:53.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.382+0000 7f4a57a50640 1 --2- 172.21.15.53:0/3320354956 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a5006c350 0x7f4a5015d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:53.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.382+0000 7f4a57a50640 1 -- 172.21.15.53:0/3320354956 >> 172.21.15.53:0/3320354956 conn(0x7f4a5006a0e0 msgr2=0x7f4a5015ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:53.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.382+0000 7f4a57a50640 1 -- 172.21.15.53:0/3320354956 shutdown_connections 2023-06-10T18:56:53.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.382+0000 7f4a57a50640 1 -- 172.21.15.53:0/3320354956 wait complete. 2023-06-10T18:56:53.405 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-10T18:56:53.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.522+0000 7f0d387db640 1 Processor -- start 2023-06-10T18:56:53.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.522+0000 7f0d387db640 1 -- start start 2023-06-10T18:56:53.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.522+0000 7f0d387db640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d3015c090 0x7f0d300b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:53.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.522+0000 7f0d387db640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0d300b7e30 0x7f0d300d04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:53.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.522+0000 7f0d387db640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d300cc7c0 con 0x7f0d300b0b90 2023-06-10T18:56:53.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.522+0000 7f0d387db640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d300ccaa0 con 0x7f0d300b7e30 2023-06-10T18:56:53.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.522+0000 7f0d387db640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d300ccd80 con 0x7f0d3015c090 2023-06-10T18:56:53.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.522+0000 7f0d36d78640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0d300b7e30 0x7f0d300d04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:53.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.522+0000 7f0d36d78640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0d300b7e30 0x7f0d300d04d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37472/0 (socket says 172.21.15.53:37472) 2023-06-10T18:56:53.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.522+0000 7f0d36d78640 1 -- 172.21.15.53:0/2400161409 learned_addr learned my addr 172.21.15.53:0/2400161409 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:53.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.522+0000 7f0d36577640 1 --2- 172.21.15.53:0/2400161409 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d3015c090 0x7f0d300b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:53.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.522+0000 7f0d36d78640 1 -- 172.21.15.53:0/2400161409 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d3015c090 msgr2=0x7f0d300b10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:53.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.522+0000 7f0d36d78640 1 --2- 172.21.15.53:0/2400161409 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d3015c090 0x7f0d300b10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:53.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.522+0000 7f0d36d78640 1 -- 172.21.15.53:0/2400161409 >> v1:172.21.15.117:6789/0 conn(0x7f0d300b0b90 legacy=0x7f0d300b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:53.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.522+0000 7f0d36d78640 1 -- 172.21.15.53:0/2400161409 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d300cd060 con 0x7f0d300b7e30 2023-06-10T18:56:53.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.526+0000 7f0d36d78640 1 --2- 172.21.15.53:0/2400161409 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d300b7e30 0x7f0d300d04d0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f0d20009e50 tx=0x7f0d2001c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=631152ed0072ed5f server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:53.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.526+0000 7f0d35575640 1 -- 172.21.15.53:0/2400161409 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d200a5770 con 0x7f0d300b7e30 2023-06-10T18:56:53.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.526+0000 7f0d35575640 1 -- 172.21.15.53:0/2400161409 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d200a58d0 con 0x7f0d300b7e30 2023-06-10T18:56:53.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.526+0000 7f0d35575640 1 -- 172.21.15.53:0/2400161409 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d200a5c60 con 0x7f0d300b7e30 2023-06-10T18:56:53.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.526+0000 7f0d387db640 1 -- 172.21.15.53:0/2400161409 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d300b7e30 msgr2=0x7f0d300d04d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:53.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.526+0000 7f0d387db640 1 --2- 172.21.15.53:0/2400161409 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d300b7e30 0x7f0d300d04d0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f0d20009e50 tx=0x7f0d2001c950 comp rx=0 tx=0).stop 2023-06-10T18:56:53.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.526+0000 7f0d387db640 1 -- 172.21.15.53:0/2400161409 shutdown_connections 2023-06-10T18:56:53.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.526+0000 7f0d387db640 1 --2- 172.21.15.53:0/2400161409 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d300b7e30 0x7f0d300d04d0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:53.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.526+0000 7f0d387db640 1 --2- 172.21.15.53:0/2400161409 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d3015c090 0x7f0d300b10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:53.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.526+0000 7f0d387db640 1 -- 172.21.15.53:0/2400161409 >> 172.21.15.53:0/2400161409 conn(0x7f0d30069e20 msgr2=0x7f0d3006a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:53.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.526+0000 7f0d387db640 1 -- 172.21.15.53:0/2400161409 shutdown_connections 2023-06-10T18:56:53.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.526+0000 7f0d387db640 1 -- 172.21.15.53:0/2400161409 wait complete. 2023-06-10T18:56:53.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.526+0000 7f0d387db640 1 Processor -- start 2023-06-10T18:56:53.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.526+0000 7f0d387db640 1 -- start start 2023-06-10T18:56:53.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.526+0000 7f0d387db640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d300b0b90 0x7f0d300cb660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:53.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.526+0000 7f0d387db640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d300b7e30 0x7f0d30146140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:53.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.526+0000 7f0d387db640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d3015c090 0x7f0d3014ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:53.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.526+0000 7f0d387db640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d300ca650 con 0x7f0d300b7e30 2023-06-10T18:56:53.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.526+0000 7f0d387db640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d300ca8a0 con 0x7f0d3015c090 2023-06-10T18:56:53.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.526+0000 7f0d387db640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d300cab80 con 0x7f0d300b0b90 2023-06-10T18:56:53.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.526+0000 7f0d35d76640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d300b7e30 0x7f0d30146140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:53.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.526+0000 7f0d35d76640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d300b7e30 0x7f0d30146140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37484/0 (socket says 172.21.15.53:37484) 2023-06-10T18:56:53.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.526+0000 7f0d35d76640 1 -- 172.21.15.53:0/2601626416 learned_addr learned my addr 172.21.15.53:0/2601626416 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:53.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.526+0000 7f0d36577640 1 --2- 172.21.15.53:0/2601626416 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d300b0b90 0x7f0d300cb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:53.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.526+0000 7f0d36d78640 1 --2- 172.21.15.53:0/2601626416 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d3015c090 0x7f0d3014ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:53.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.526+0000 7f0d35d76640 1 -- 172.21.15.53:0/2601626416 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d300b0b90 msgr2=0x7f0d300cb660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:53.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.526+0000 7f0d35d76640 1 --2- 172.21.15.53:0/2601626416 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d300b0b90 0x7f0d300cb660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:53.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.530+0000 7f0d35d76640 1 -- 172.21.15.53:0/2601626416 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d3015c090 msgr2=0x7f0d3014ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:53.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.530+0000 7f0d35d76640 1 --2- 172.21.15.53:0/2601626416 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d3015c090 0x7f0d3014ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:53.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.530+0000 7f0d35d76640 1 -- 172.21.15.53:0/2601626416 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d20009b30 con 0x7f0d300b7e30 2023-06-10T18:56:53.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.530+0000 7f0d35d76640 1 --2- 172.21.15.53:0/2601626416 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d300b7e30 0x7f0d30146140 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f0d2400c500 tx=0x7f0d2400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:53.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.530+0000 7f0d2effd640 1 -- 172.21.15.53:0/2601626416 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d24005220 con 0x7f0d300b7e30 2023-06-10T18:56:53.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.530+0000 7f0d2effd640 1 -- 172.21.15.53:0/2601626416 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d24005380 con 0x7f0d300b7e30 2023-06-10T18:56:53.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.530+0000 7f0d387db640 1 -- 172.21.15.53:0/2601626416 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d300cae60 con 0x7f0d300b7e30 2023-06-10T18:56:53.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.530+0000 7f0d2effd640 1 -- 172.21.15.53:0/2601626416 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d24007270 con 0x7f0d300b7e30 2023-06-10T18:56:53.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.530+0000 7f0d387db640 1 -- 172.21.15.53:0/2601626416 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d300cf070 con 0x7f0d300b7e30 2023-06-10T18:56:53.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.530+0000 7f0d387db640 1 -- 172.21.15.53:0/2601626416 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d3004d790 con 0x7f0d300b7e30 2023-06-10T18:56:53.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.530+0000 7f0d2effd640 1 -- 172.21.15.53:0/2601626416 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0d240073d0 con 0x7f0d300b7e30 2023-06-10T18:56:53.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.530+0000 7f0d2effd640 1 --2- 172.21.15.53:0/2601626416 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0d1c0662b0 0x7f0d1c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:53.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.530+0000 7f0d2effd640 1 -- 172.21.15.53:0/2601626416 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f0d240836b0 con 0x7f0d300b7e30 2023-06-10T18:56:53.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.530+0000 7f0d36577640 1 --2- 172.21.15.53:0/2601626416 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0d1c0662b0 0x7f0d1c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:53.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.530+0000 7f0d36577640 1 --2- 172.21.15.53:0/2601626416 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0d1c0662b0 0x7f0d1c068760 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f0d2800b910 tx=0x7f0d28008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:53.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.534+0000 7f0d2effd640 1 -- 172.21.15.53:0/2601626416 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0d24050a60 con 0x7f0d300b7e30 2023-06-10T18:56:53.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.690+0000 7f0d387db640 1 -- 172.21.15.53:0/2601626416 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0d300cb310 con 0x7f0d300b7e30 2023-06-10T18:56:53.695 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.690+0000 7f0d2effd640 1 -- 172.21.15.53:0/2601626416 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v53) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0d24054080 con 0x7f0d300b7e30 2023-06-10T18:56:53.695 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-06-10T18:56:53.697 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.690+0000 7f0d387db640 1 -- 172.21.15.53:0/2601626416 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0d1c0662b0 msgr2=0x7f0d1c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:53.697 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.690+0000 7f0d387db640 1 --2- 172.21.15.53:0/2601626416 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0d1c0662b0 0x7f0d1c068760 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f0d2800b910 tx=0x7f0d28008040 comp rx=0 tx=0).stop 2023-06-10T18:56:53.697 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.690+0000 7f0d387db640 1 -- 172.21.15.53:0/2601626416 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d300b7e30 msgr2=0x7f0d30146140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:53.697 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.690+0000 7f0d387db640 1 --2- 172.21.15.53:0/2601626416 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d300b7e30 0x7f0d30146140 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f0d2400c500 tx=0x7f0d2400c9c0 comp rx=0 tx=0).stop 2023-06-10T18:56:53.697 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.690+0000 7f0d387db640 1 -- 172.21.15.53:0/2601626416 shutdown_connections 2023-06-10T18:56:53.697 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.690+0000 7f0d387db640 1 --2- 172.21.15.53:0/2601626416 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0d1c0662b0 0x7f0d1c068760 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:53.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.690+0000 7f0d387db640 1 --2- 172.21.15.53:0/2601626416 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d3015c090 0x7f0d3014ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:53.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.690+0000 7f0d387db640 1 --2- 172.21.15.53:0/2601626416 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d300b7e30 0x7f0d30146140 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:53.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.690+0000 7f0d387db640 1 --2- 172.21.15.53:0/2601626416 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d300b0b90 0x7f0d300cb660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:53.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.690+0000 7f0d387db640 1 -- 172.21.15.53:0/2601626416 >> 172.21.15.53:0/2601626416 conn(0x7f0d30069e20 msgr2=0x7f0d3014fe00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:53.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.690+0000 7f0d387db640 1 -- 172.21.15.53:0/2601626416 shutdown_connections 2023-06-10T18:56:53.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.690+0000 7f0d387db640 1 -- 172.21.15.53:0/2601626416 wait complete. 2023-06-10T18:56:53.713 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-10T18:56:53.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.838+0000 7f632e9ec640 1 Processor -- start 2023-06-10T18:56:53.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.838+0000 7f632e9ec640 1 -- start start 2023-06-10T18:56:53.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.838+0000 7f632e9ec640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63280c9fa0 0x7f632806bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:53.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.838+0000 7f632e9ec640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f632806c020 0x7f63280c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:53.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.838+0000 7f632e9ec640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f632806b090 con 0x7f63280c87e0 2023-06-10T18:56:53.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.838+0000 7f632e9ec640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63280ca370 con 0x7f632806c020 2023-06-10T18:56:53.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.838+0000 7f632e9ec640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6328070d50 con 0x7f63280c9fa0 2023-06-10T18:56:53.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.838+0000 7f63277fe640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f632806c020 0x7f63280c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:53.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.838+0000 7f6327fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63280c9fa0 0x7f632806bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:53.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.838+0000 7f63277fe640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f632806c020 0x7f63280c82a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.53:45740/0 (socket says 172.21.15.53:45740) 2023-06-10T18:56:53.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.838+0000 7f63277fe640 1 -- 172.21.15.53:0/3116531519 learned_addr learned my addr 172.21.15.53:0/3116531519 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:53.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.838+0000 7f63277fe640 1 -- 172.21.15.53:0/3116531519 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63280c9fa0 msgr2=0x7f632806bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:53.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.838+0000 7f63277fe640 1 --2- 172.21.15.53:0/3116531519 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63280c9fa0 0x7f632806bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:53.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.838+0000 7f63277fe640 1 -- 172.21.15.53:0/3116531519 >> v1:172.21.15.117:6789/0 conn(0x7f63280c87e0 legacy=0x7f63280af760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:53.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.838+0000 7f63277fe640 1 -- 172.21.15.53:0/3116531519 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6328071030 con 0x7f632806c020 2023-06-10T18:56:53.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.842+0000 7f63277fe640 1 --2- 172.21.15.53:0/3116531519 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f632806c020 0x7f63280c82a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f631c009870 tx=0x7f631c01c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c97b5a9e5d0aac7a server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:53.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.842+0000 7f6326ffd640 1 -- 172.21.15.53:0/3116531519 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631c0ad640 con 0x7f632806c020 2023-06-10T18:56:53.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.842+0000 7f6326ffd640 1 -- 172.21.15.53:0/3116531519 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f631c0ad7a0 con 0x7f632806c020 2023-06-10T18:56:53.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.842+0000 7f6326ffd640 1 -- 172.21.15.53:0/3116531519 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631c0adb30 con 0x7f632806c020 2023-06-10T18:56:53.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.842+0000 7f632e9ec640 1 -- 172.21.15.53:0/3116531519 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f632806c020 msgr2=0x7f63280c82a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:53.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.842+0000 7f632e9ec640 1 --2- 172.21.15.53:0/3116531519 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f632806c020 0x7f63280c82a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f631c009870 tx=0x7f631c01c480 comp rx=0 tx=0).stop 2023-06-10T18:56:53.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.842+0000 7f632e9ec640 1 -- 172.21.15.53:0/3116531519 shutdown_connections 2023-06-10T18:56:53.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.842+0000 7f632e9ec640 1 --2- 172.21.15.53:0/3116531519 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f632806c020 0x7f63280c82a0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:53.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.842+0000 7f632e9ec640 1 --2- 172.21.15.53:0/3116531519 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63280c9fa0 0x7f632806bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:53.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.842+0000 7f632e9ec640 1 -- 172.21.15.53:0/3116531519 >> 172.21.15.53:0/3116531519 conn(0x7f632806a0e0 msgr2=0x7f63280cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:53.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.842+0000 7f632e9ec640 1 -- 172.21.15.53:0/3116531519 shutdown_connections 2023-06-10T18:56:53.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.842+0000 7f632e9ec640 1 -- 172.21.15.53:0/3116531519 wait complete. 2023-06-10T18:56:53.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.842+0000 7f632e9ec640 1 Processor -- start 2023-06-10T18:56:53.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.842+0000 7f632e9ec640 1 -- start start 2023-06-10T18:56:53.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.846+0000 7f632e9ec640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f632806c020 0x7f6328142120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:53.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.846+0000 7f632e9ec640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63280c87e0 0x7f63280b2f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:53.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.846+0000 7f632e9ec640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63280c9fa0 0x7f63280c2c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:53.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.846+0000 7f632e9ec640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63280b1ea0 con 0x7f632806c020 2023-06-10T18:56:53.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.846+0000 7f632e9ec640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63280b2180 con 0x7f63280c87e0 2023-06-10T18:56:53.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.846+0000 7f632e9ec640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63280b2460 con 0x7f63280c9fa0 2023-06-10T18:56:53.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.846+0000 7f6327fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f632806c020 0x7f6328142120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:53.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.846+0000 7f6327fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f632806c020 0x7f6328142120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37486/0 (socket says 172.21.15.53:37486) 2023-06-10T18:56:53.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.846+0000 7f6327fff640 1 -- 172.21.15.53:0/3479024218 learned_addr learned my addr 172.21.15.53:0/3479024218 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:53.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.846+0000 7f63277fe640 1 --2- 172.21.15.53:0/3479024218 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63280c87e0 0x7f63280b2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:53.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.846+0000 7f632cf89640 1 --2- 172.21.15.53:0/3479024218 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63280c9fa0 0x7f63280c2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:53.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.846+0000 7f6327fff640 1 -- 172.21.15.53:0/3479024218 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63280c9fa0 msgr2=0x7f63280c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:53.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.846+0000 7f6327fff640 1 --2- 172.21.15.53:0/3479024218 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63280c9fa0 0x7f63280c2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:53.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.846+0000 7f6327fff640 1 -- 172.21.15.53:0/3479024218 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63280c87e0 msgr2=0x7f63280b2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:53.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.846+0000 7f6327fff640 1 --2- 172.21.15.53:0/3479024218 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63280c87e0 0x7f63280b2f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:53.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.846+0000 7f6327fff640 1 -- 172.21.15.53:0/3479024218 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f631c0094d0 con 0x7f632806c020 2023-06-10T18:56:53.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.846+0000 7f632cf89640 1 --2- 172.21.15.53:0/3479024218 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63280c9fa0 0x7f63280c2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:56:53.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.846+0000 7f6327fff640 1 --2- 172.21.15.53:0/3479024218 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f632806c020 0x7f6328142120 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f631800e870 tx=0x7f631800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:53.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.846+0000 7f6324ff9640 1 -- 172.21.15.53:0/3479024218 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6318009510 con 0x7f632806c020 2023-06-10T18:56:53.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.846+0000 7f6324ff9640 1 -- 172.21.15.53:0/3479024218 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f631800eec0 con 0x7f632806c020 2023-06-10T18:56:53.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.846+0000 7f6324ff9640 1 -- 172.21.15.53:0/3479024218 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631800cb40 con 0x7f632806c020 2023-06-10T18:56:53.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.846+0000 7f632e9ec640 1 -- 172.21.15.53:0/3479024218 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63280b2740 con 0x7f632806c020 2023-06-10T18:56:53.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.846+0000 7f632e9ec640 1 -- 172.21.15.53:0/3479024218 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6328142660 con 0x7f632806c020 2023-06-10T18:56:53.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.846+0000 7f632e9ec640 1 -- 172.21.15.53:0/3479024218 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f632804d790 con 0x7f632806c020 2023-06-10T18:56:53.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.846+0000 7f6324ff9640 1 -- 172.21.15.53:0/3479024218 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f631800cca0 con 0x7f632806c020 2023-06-10T18:56:53.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.846+0000 7f6324ff9640 1 --2- 172.21.15.53:0/3479024218 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6314066280 0x7f6314068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:53.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.846+0000 7f6324ff9640 1 -- 172.21.15.53:0/3479024218 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f6318083df0 con 0x7f632806c020 2023-06-10T18:56:53.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.850+0000 7f63277fe640 1 --2- 172.21.15.53:0/3479024218 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6314066280 0x7f6314068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:53.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.850+0000 7f63277fe640 1 --2- 172.21.15.53:0/3479024218 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6314066280 0x7f6314068730 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f631c0af000 tx=0x7f631c0a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:53.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:53.850+0000 7f6324ff9640 1 -- 172.21.15.53:0/3479024218 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f63180512c0 con 0x7f632806c020 2023-06-10T18:56:54.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.006+0000 7f632e9ec640 1 -- 172.21.15.53:0/3479024218 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f63280ce670 con 0x7f632806c020 2023-06-10T18:56:54.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.006+0000 7f6324ff9640 1 -- 172.21.15.53:0/3479024218 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v53) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6318017020 con 0x7f632806c020 2023-06-10T18:56:54.010 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-06-10T18:56:54.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.006+0000 7f632e9ec640 1 -- 172.21.15.53:0/3479024218 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6314066280 msgr2=0x7f6314068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:54.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.006+0000 7f632e9ec640 1 --2- 172.21.15.53:0/3479024218 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6314066280 0x7f6314068730 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f631c0af000 tx=0x7f631c0a7070 comp rx=0 tx=0).stop 2023-06-10T18:56:54.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.006+0000 7f632e9ec640 1 -- 172.21.15.53:0/3479024218 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f632806c020 msgr2=0x7f6328142120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:54.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.006+0000 7f632e9ec640 1 --2- 172.21.15.53:0/3479024218 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f632806c020 0x7f6328142120 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f631800e870 tx=0x7f631800ec70 comp rx=0 tx=0).stop 2023-06-10T18:56:54.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.006+0000 7f632e9ec640 1 -- 172.21.15.53:0/3479024218 shutdown_connections 2023-06-10T18:56:54.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.006+0000 7f632e9ec640 1 --2- 172.21.15.53:0/3479024218 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6314066280 0x7f6314068730 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:54.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.006+0000 7f632e9ec640 1 --2- 172.21.15.53:0/3479024218 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63280c9fa0 0x7f63280c2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:54.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.006+0000 7f632e9ec640 1 --2- 172.21.15.53:0/3479024218 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63280c87e0 0x7f63280b2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:54.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.006+0000 7f632e9ec640 1 --2- 172.21.15.53:0/3479024218 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f632806c020 0x7f6328142120 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:54.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.006+0000 7f632e9ec640 1 -- 172.21.15.53:0/3479024218 >> 172.21.15.53:0/3479024218 conn(0x7f632806a0e0 msgr2=0x7f6328155640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:54.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.010+0000 7f632e9ec640 1 -- 172.21.15.53:0/3479024218 shutdown_connections 2023-06-10T18:56:54.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.010+0000 7f632e9ec640 1 -- 172.21.15.53:0/3479024218 wait complete. 2023-06-10T18:56:54.031 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-10T18:56:54.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.146+0000 7f012c47f640 1 Processor -- start 2023-06-10T18:56:54.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.146+0000 7f012c47f640 1 -- start start 2023-06-10T18:56:54.154 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.146+0000 7f012c47f640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f01240c9fa0 0x7f012406bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:54.154 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.146+0000 7f012c47f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f012406c020 0x7f01240c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:54.154 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.150+0000 7f012c47f640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f012406b090 con 0x7f01240c87e0 2023-06-10T18:56:54.154 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.150+0000 7f012c47f640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01240ca370 con 0x7f012406c020 2023-06-10T18:56:54.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.150+0000 7f012c47f640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0124070d50 con 0x7f01240c9fa0 2023-06-10T18:56:54.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.150+0000 7f012aa1c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f01240c87e0 0x7f01240af760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60460/0 (socket says 172.21.15.53:60460) 2023-06-10T18:56:54.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.150+0000 7f012aa1c640 1 -- 172.21.15.53:0/1343862938 learned_addr learned my addr 172.21.15.53:0/1343862938 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:56:54.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.150+0000 7f0129a1a640 1 --2- 172.21.15.53:0/1343862938 >> v2:172.21.15.53:3300/0 conn(0x7f012406c020 0x7f01240c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:54.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.150+0000 7f012a21b640 1 --2- 172.21.15.53:0/1343862938 >> v2:172.21.15.117:3300/0 conn(0x7f01240c9fa0 0x7f012406bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:54.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.150+0000 7f0129a1a640 1 -- 172.21.15.53:0/1343862938 >> v2:172.21.15.117:3300/0 conn(0x7f01240c9fa0 msgr2=0x7f012406bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:54.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.150+0000 7f0129a1a640 1 --2- 172.21.15.53:0/1343862938 >> v2:172.21.15.117:3300/0 conn(0x7f01240c9fa0 0x7f012406bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:54.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.150+0000 7f0129a1a640 1 -- 172.21.15.53:0/1343862938 >> v1:172.21.15.53:6789/0 conn(0x7f01240c87e0 legacy=0x7f01240af760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:54.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.150+0000 7f0129a1a640 1 -- 172.21.15.53:0/1343862938 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0124071030 con 0x7f012406c020 2023-06-10T18:56:54.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.150+0000 7f0129219640 1 -- 172.21.15.53:0/1343862938 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2811082669 0 0) 0x7f012406b090 con 0x7f01240c87e0 2023-06-10T18:56:54.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.150+0000 7f0129a1a640 1 --2- 172.21.15.53:0/1343862938 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f012406c020 0x7f01240c82a0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f012406e9d0 tx=0x7f011401c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84210c3c1ad2906b server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:54.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.150+0000 7f0129219640 1 -- 172.21.15.53:0/1343862938 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01140ab600 con 0x7f012406c020 2023-06-10T18:56:54.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.150+0000 7f0129219640 1 -- 172.21.15.53:0/1343862938 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01140a7050 con 0x7f012406c020 2023-06-10T18:56:54.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.150+0000 7f0129219640 1 -- 172.21.15.53:0/1343862938 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01140ab980 con 0x7f012406c020 2023-06-10T18:56:54.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.150+0000 7f012c47f640 1 -- 172.21.15.53:0/1343862938 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f012406c020 msgr2=0x7f01240c82a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:54.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.150+0000 7f012c47f640 1 --2- 172.21.15.53:0/1343862938 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f012406c020 0x7f01240c82a0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f012406e9d0 tx=0x7f011401c3a0 comp rx=0 tx=0).stop 2023-06-10T18:56:54.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.150+0000 7f012c47f640 1 -- 172.21.15.53:0/1343862938 shutdown_connections 2023-06-10T18:56:54.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.150+0000 7f012c47f640 1 --2- 172.21.15.53:0/1343862938 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f012406c020 0x7f01240c82a0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:54.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.150+0000 7f012c47f640 1 --2- 172.21.15.53:0/1343862938 >> v2:172.21.15.117:3300/0 conn(0x7f01240c9fa0 0x7f012406bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:54.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.150+0000 7f012c47f640 1 -- 172.21.15.53:0/1343862938 >> 172.21.15.53:0/1343862938 conn(0x7f012406a0e0 msgr2=0x7f01240cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:54.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.150+0000 7f012c47f640 1 -- 172.21.15.53:0/1343862938 shutdown_connections 2023-06-10T18:56:54.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.150+0000 7f012c47f640 1 -- 172.21.15.53:0/1343862938 wait complete. 2023-06-10T18:56:54.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.154+0000 7f012c47f640 1 Processor -- start 2023-06-10T18:56:54.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.154+0000 7f012c47f640 1 -- start start 2023-06-10T18:56:54.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.154+0000 7f012c47f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f012406c020 0x7f0124142280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:54.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.154+0000 7f012c47f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01240c87e0 0x7f012414f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:54.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.154+0000 7f012c47f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f01240c9fa0 0x7f01240b1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:54.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.154+0000 7f012c47f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01241427c0 con 0x7f01240c9fa0 2023-06-10T18:56:54.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.154+0000 7f012c47f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f012414e4c0 con 0x7f01240c87e0 2023-06-10T18:56:54.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.154+0000 7f012c47f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f012414e7a0 con 0x7f012406c020 2023-06-10T18:56:54.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.154+0000 7f012aa1c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f01240c9fa0 0x7f01240b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:54.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.154+0000 7f012aa1c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f01240c9fa0 0x7f01240b1b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37504/0 (socket says 172.21.15.53:37504) 2023-06-10T18:56:54.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.154+0000 7f012aa1c640 1 -- 172.21.15.53:0/3741439044 learned_addr learned my addr 172.21.15.53:0/3741439044 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:54.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.154+0000 7f0129a1a640 1 --2- 172.21.15.53:0/3741439044 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01240c87e0 0x7f012414f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:54.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.154+0000 7f012a21b640 1 --2- 172.21.15.53:0/3741439044 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f012406c020 0x7f0124142280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:54.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.154+0000 7f012aa1c640 1 -- 172.21.15.53:0/3741439044 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f012406c020 msgr2=0x7f0124142280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:54.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.154+0000 7f012aa1c640 1 --2- 172.21.15.53:0/3741439044 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f012406c020 0x7f0124142280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:54.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.154+0000 7f012aa1c640 1 -- 172.21.15.53:0/3741439044 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01240c87e0 msgr2=0x7f012414f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:54.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.154+0000 7f012aa1c640 1 --2- 172.21.15.53:0/3741439044 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01240c87e0 0x7f012414f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:54.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.154+0000 7f012aa1c640 1 -- 172.21.15.53:0/3741439044 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0114009420 con 0x7f01240c9fa0 2023-06-10T18:56:54.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.154+0000 7f012aa1c640 1 --2- 172.21.15.53:0/3741439044 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f01240c9fa0 0x7f01240b1b70 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f011c00c7a0 tx=0x7f011c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:54.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.154+0000 7f011affd640 1 -- 172.21.15.53:0/3741439044 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f011c00a640 con 0x7f01240c9fa0 2023-06-10T18:56:54.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.154+0000 7f011affd640 1 -- 172.21.15.53:0/3741439044 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f011c00a7a0 con 0x7f01240c9fa0 2023-06-10T18:56:54.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.154+0000 7f012c47f640 1 -- 172.21.15.53:0/3741439044 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f012414ea80 con 0x7f01240c9fa0 2023-06-10T18:56:54.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.154+0000 7f011affd640 1 -- 172.21.15.53:0/3741439044 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f011c00abd0 con 0x7f01240c9fa0 2023-06-10T18:56:54.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.154+0000 7f012c47f640 1 -- 172.21.15.53:0/3741439044 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f012414f040 con 0x7f01240c9fa0 2023-06-10T18:56:54.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.154+0000 7f012c47f640 1 -- 172.21.15.53:0/3741439044 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f012414f260 con 0x7f01240c9fa0 2023-06-10T18:56:54.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.158+0000 7f011affd640 1 -- 172.21.15.53:0/3741439044 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f011c00ad30 con 0x7f01240c9fa0 2023-06-10T18:56:54.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.158+0000 7f011affd640 1 --2- 172.21.15.53:0/3741439044 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0108066280 0x7f0108068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:54.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.158+0000 7f011affd640 1 -- 172.21.15.53:0/3741439044 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f011c083270 con 0x7f01240c9fa0 2023-06-10T18:56:54.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.158+0000 7f012a21b640 1 --2- 172.21.15.53:0/3741439044 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0108066280 0x7f0108068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:54.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.158+0000 7f012a21b640 1 --2- 172.21.15.53:0/3741439044 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0108066280 0x7f0108068730 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f01241588c0 tx=0x7f0120008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:54.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.162+0000 7f011affd640 1 -- 172.21.15.53:0/3741439044 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f011c050760 con 0x7f01240c9fa0 2023-06-10T18:56:54.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.314+0000 7f012c47f640 1 -- 172.21.15.53:0/3741439044 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f012404d790 con 0x7f01240c9fa0 2023-06-10T18:56:54.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.314+0000 7f011affd640 1 -- 172.21.15.53:0/3741439044 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v53) v1 ==== 100+0+11 (secure 0 0 0) 0x7f011c053d80 con 0x7f01240c9fa0 2023-06-10T18:56:54.321 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-06-10T18:56:54.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.318+0000 7f012c47f640 1 -- 172.21.15.53:0/3741439044 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0108066280 msgr2=0x7f0108068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:54.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.318+0000 7f012c47f640 1 --2- 172.21.15.53:0/3741439044 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0108066280 0x7f0108068730 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f01241588c0 tx=0x7f0120008040 comp rx=0 tx=0).stop 2023-06-10T18:56:54.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.318+0000 7f012c47f640 1 -- 172.21.15.53:0/3741439044 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f01240c9fa0 msgr2=0x7f01240b1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:54.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.318+0000 7f012c47f640 1 --2- 172.21.15.53:0/3741439044 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f01240c9fa0 0x7f01240b1b70 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f011c00c7a0 tx=0x7f011c00cc60 comp rx=0 tx=0).stop 2023-06-10T18:56:54.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.318+0000 7f012c47f640 1 -- 172.21.15.53:0/3741439044 shutdown_connections 2023-06-10T18:56:54.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.318+0000 7f012c47f640 1 --2- 172.21.15.53:0/3741439044 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0108066280 0x7f0108068730 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:54.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.318+0000 7f012c47f640 1 --2- 172.21.15.53:0/3741439044 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f01240c9fa0 0x7f01240b1b70 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:54.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.318+0000 7f012c47f640 1 --2- 172.21.15.53:0/3741439044 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01240c87e0 0x7f012414f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:54.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.318+0000 7f012c47f640 1 --2- 172.21.15.53:0/3741439044 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f012406c020 0x7f0124142280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:54.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.318+0000 7f012c47f640 1 -- 172.21.15.53:0/3741439044 >> 172.21.15.53:0/3741439044 conn(0x7f012406a0e0 msgr2=0x7f0124152440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:54.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.318+0000 7f012c47f640 1 -- 172.21.15.53:0/3741439044 shutdown_connections 2023-06-10T18:56:54.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.318+0000 7f012c47f640 1 -- 172.21.15.53:0/3741439044 wait complete. 2023-06-10T18:56:54.340 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-10T18:56:54.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.454+0000 7f0df8cbf640 1 Processor -- start 2023-06-10T18:56:54.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.454+0000 7f0df8cbf640 1 -- start start 2023-06-10T18:56:54.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.454+0000 7f0df8cbf640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0df415c240 0x7f0df415c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:54.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.454+0000 7f0df8cbf640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0df415cbd0 con 0x7f0df4152e70 2023-06-10T18:56:54.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.454+0000 7f0df8cbf640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0df415d090 con 0x7f0df406ac20 2023-06-10T18:56:54.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.454+0000 7f0df8cbf640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0df40c9430 con 0x7f0df415c240 2023-06-10T18:56:54.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.454+0000 7f0df259c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f0df4152e70 0x7f0df40c8d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60472/0 (socket says 172.21.15.53:60472) 2023-06-10T18:56:54.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.454+0000 7f0df259c640 1 -- 172.21.15.53:0/3428814586 learned_addr learned my addr 172.21.15.53:0/3428814586 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:56:54.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.454+0000 7f0debfff640 1 --2- 172.21.15.53:0/3428814586 >> v2:172.21.15.117:3300/0 conn(0x7f0df415c240 0x7f0df415c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:54.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.454+0000 7f0df1d9b640 1 -- 172.21.15.53:0/3428814586 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2498539536 0 0) 0x7f0de40012a0 con 0x7f0df4152e70 2023-06-10T18:56:54.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.454+0000 7f0df1d9b640 1 -- 172.21.15.53:0/3428814586 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0de0003530 con 0x7f0df4152e70 2023-06-10T18:56:54.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.454+0000 7f0df1d9b640 1 -- 172.21.15.53:0/3428814586 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3335993142 0 0) 0x7f0de0003530 con 0x7f0df4152e70 2023-06-10T18:56:54.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.454+0000 7f0df1d9b640 1 -- 172.21.15.53:0/3428814586 >> v2:172.21.15.117:3300/0 conn(0x7f0df415c240 msgr2=0x7f0df415c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:54.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.454+0000 7f0df1d9b640 1 --2- 172.21.15.53:0/3428814586 >> v2:172.21.15.117:3300/0 conn(0x7f0df415c240 0x7f0df415c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:54.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.454+0000 7f0df1d9b640 1 -- 172.21.15.53:0/3428814586 >> v1:172.21.15.117:6789/0 conn(0x7f0df406ac20 legacy=0x7f0df406b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:54.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.454+0000 7f0df1d9b640 1 -- 172.21.15.53:0/3428814586 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0df40cdac0 con 0x7f0df4152e70 2023-06-10T18:56:54.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.454+0000 7f0df1d9b640 1 -- 172.21.15.53:0/3428814586 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f0de4001990 con 0x7f0df4152e70 2023-06-10T18:56:54.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.454+0000 7f0df1d9b640 1 -- 172.21.15.53:0/3428814586 >> v1:172.21.15.53:6789/0 conn(0x7f0df4152e70 legacy=0x7f0df40c8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:54.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.454+0000 7f0df1d9b640 1 --2- 172.21.15.53:0/3428814586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0de0003980 0x7f0de0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:54.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.454+0000 7f0df1d9b640 1 --2- 172.21.15.53:0/3428814586 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0de00047d0 0x7f0de0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:54.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.454+0000 7f0df1d9b640 1 --2- 172.21.15.53:0/3428814586 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0de0005180 0x7f0de000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:54.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.454+0000 7f0df1d9b640 1 -- 172.21.15.53:0/3428814586 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df40c9430 con 0x7f0de0003980 2023-06-10T18:56:54.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.454+0000 7f0df1d9b640 1 -- 172.21.15.53:0/3428814586 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de000c000 con 0x7f0de00047d0 2023-06-10T18:56:54.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.454+0000 7f0df1d9b640 1 -- 172.21.15.53:0/3428814586 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0de000c1c0 con 0x7f0de0005180 2023-06-10T18:56:54.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.454+0000 7f0df259c640 1 --2- 172.21.15.53:0/3428814586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0de0003980 0x7f0de0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:54.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.454+0000 7f0debfff640 1 --2- 172.21.15.53:0/3428814586 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0de00047d0 0x7f0de0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:54.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.454+0000 7f0df2d9d640 1 --2- 172.21.15.53:0/3428814586 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0de0005180 0x7f0de000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:54.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.454+0000 7f0df259c640 1 -- 172.21.15.53:0/3428814586 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0de0005180 msgr2=0x7f0de000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:54.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.454+0000 7f0df259c640 1 --2- 172.21.15.53:0/3428814586 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0de0005180 0x7f0de000b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:54.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.454+0000 7f0df259c640 1 -- 172.21.15.53:0/3428814586 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0de00047d0 msgr2=0x7f0de0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:54.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.454+0000 7f0df259c640 1 --2- 172.21.15.53:0/3428814586 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0de00047d0 0x7f0de0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:54.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.454+0000 7f0df259c640 1 -- 172.21.15.53:0/3428814586 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0de0003530 con 0x7f0de0003980 2023-06-10T18:56:54.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.454+0000 7f0df2d9d640 1 -- 172.21.15.53:0/3428814586 reap_dead start 2023-06-10T18:56:54.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.458+0000 7f0df259c640 1 --2- 172.21.15.53:0/3428814586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0de0003980 0x7f0de0003d90 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f0de40011e0 tx=0x7f0de401caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b616eb185cf9404 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:54.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.458+0000 7f0df1d9b640 1 -- 172.21.15.53:0/3428814586 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de40070d0 con 0x7f0de0003980 2023-06-10T18:56:54.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.458+0000 7f0df1d9b640 1 -- 172.21.15.53:0/3428814586 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0de4007250 con 0x7f0de0003980 2023-06-10T18:56:54.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.458+0000 7f0df1d9b640 1 -- 172.21.15.53:0/3428814586 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de4007640 con 0x7f0de0003980 2023-06-10T18:56:54.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.458+0000 7f0df8cbf640 1 -- 172.21.15.53:0/3428814586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0de0003980 msgr2=0x7f0de0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:54.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.458+0000 7f0df8cbf640 1 --2- 172.21.15.53:0/3428814586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0de0003980 0x7f0de0003d90 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f0de40011e0 tx=0x7f0de401caf0 comp rx=0 tx=0).stop 2023-06-10T18:56:54.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.458+0000 7f0df8cbf640 1 -- 172.21.15.53:0/3428814586 shutdown_connections 2023-06-10T18:56:54.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.458+0000 7f0df8cbf640 1 --2- 172.21.15.53:0/3428814586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0de0003980 0x7f0de0003d90 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:54.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.458+0000 7f0df8cbf640 1 -- 172.21.15.53:0/3428814586 >> 172.21.15.53:0/3428814586 conn(0x7f0df40ce9e0 msgr2=0x7f0df40ca7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:54.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.458+0000 7f0df8cbf640 1 -- 172.21.15.53:0/3428814586 shutdown_connections 2023-06-10T18:56:54.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.458+0000 7f0df8cbf640 1 -- 172.21.15.53:0/3428814586 wait complete. 2023-06-10T18:56:54.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.458+0000 7f0df8cbf640 1 Processor -- start 2023-06-10T18:56:54.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.458+0000 7f0df8cbf640 1 -- start start 2023-06-10T18:56:54.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.458+0000 7f0df8cbf640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0de0003980 0x7f0df414b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:54.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.458+0000 7f0df8cbf640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0df40c2a80 0x7f0df40c1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:54.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.458+0000 7f0df8cbf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0df4070270 0x7f0df4070710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:54.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.458+0000 7f0df8cbf640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df40c5490 con 0x7f0df4070270 2023-06-10T18:56:54.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.458+0000 7f0df8cbf640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df4070c50 con 0x7f0de0003980 2023-06-10T18:56:54.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.458+0000 7f0df8cbf640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0df40c5750 con 0x7f0df40c2a80 2023-06-10T18:56:54.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.462+0000 7f0df2d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0df4070270 0x7f0df4070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:54.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.462+0000 7f0df2d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0df4070270 0x7f0df4070710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37526/0 (socket says 172.21.15.53:37526) 2023-06-10T18:56:54.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.462+0000 7f0df2d9d640 1 -- 172.21.15.53:0/3677183950 learned_addr learned my addr 172.21.15.53:0/3677183950 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:54.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.462+0000 7f0df259c640 1 --2- 172.21.15.53:0/3677183950 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0de0003980 0x7f0df414b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:54.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.462+0000 7f0debfff640 1 --2- 172.21.15.53:0/3677183950 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0df40c2a80 0x7f0df40c1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:54.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.462+0000 7f0df2d9d640 1 -- 172.21.15.53:0/3677183950 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0df40c2a80 msgr2=0x7f0df40c1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:54.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.462+0000 7f0df2d9d640 1 --2- 172.21.15.53:0/3677183950 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0df40c2a80 0x7f0df40c1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:54.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.462+0000 7f0df2d9d640 1 -- 172.21.15.53:0/3677183950 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0de0003980 msgr2=0x7f0df414b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:54.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.462+0000 7f0df2d9d640 1 --2- 172.21.15.53:0/3677183950 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0de0003980 0x7f0df414b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:54.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.462+0000 7f0df2d9d640 1 -- 172.21.15.53:0/3677183950 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0df40c2670 con 0x7f0df4070270 2023-06-10T18:56:54.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.462+0000 7f0df259c640 1 --2- 172.21.15.53:0/3677183950 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0de0003980 0x7f0df414b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:56:54.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.462+0000 7f0df2d9d640 1 --2- 172.21.15.53:0/3677183950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0df4070270 0x7f0df4070710 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f0df406a460 tx=0x7f0dec00d830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:54.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.462+0000 7f0deaffd640 1 -- 172.21.15.53:0/3677183950 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dec00b070 con 0x7f0df4070270 2023-06-10T18:56:54.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.462+0000 7f0deaffd640 1 -- 172.21.15.53:0/3677183950 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dec003980 con 0x7f0df4070270 2023-06-10T18:56:54.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.462+0000 7f0df8cbf640 1 -- 172.21.15.53:0/3677183950 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0df40c1dd0 con 0x7f0df4070270 2023-06-10T18:56:54.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.462+0000 7f0deaffd640 1 -- 172.21.15.53:0/3677183950 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dec003d70 con 0x7f0df4070270 2023-06-10T18:56:54.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.462+0000 7f0df8cbf640 1 -- 172.21.15.53:0/3677183950 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0df40c2390 con 0x7f0df4070270 2023-06-10T18:56:54.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.462+0000 7f0df8cbf640 1 -- 172.21.15.53:0/3677183950 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0df40c8b90 con 0x7f0df4070270 2023-06-10T18:56:54.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.462+0000 7f0deaffd640 1 -- 172.21.15.53:0/3677183950 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0dec0050d0 con 0x7f0df4070270 2023-06-10T18:56:54.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.462+0000 7f0deaffd640 1 --2- 172.21.15.53:0/3677183950 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0dd40662b0 0x7f0dd4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:54.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.462+0000 7f0deaffd640 1 -- 172.21.15.53:0/3677183950 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f0dec082f50 con 0x7f0df4070270 2023-06-10T18:56:54.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.462+0000 7f0df259c640 1 --2- 172.21.15.53:0/3677183950 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0dd40662b0 0x7f0dd4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:54.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.466+0000 7f0df259c640 1 --2- 172.21.15.53:0/3677183950 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0dd40662b0 0x7f0dd4068760 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f0de40aa000 tx=0x7f0de40b0040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:54.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.466+0000 7f0deaffd640 1 -- 172.21.15.53:0/3677183950 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0dec050390 con 0x7f0df4070270 2023-06-10T18:56:54.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.630+0000 7f0df8cbf640 1 -- 172.21.15.53:0/3677183950 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f0df404d790 con 0x7f0df4070270 2023-06-10T18:56:54.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.634+0000 7f0deaffd640 1 -- 172.21.15.53:0/3677183950 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v53) v1 ==== 80+0+0 (secure 0 0 0) 0x7f0dec018020 con 0x7f0df4070270 2023-06-10T18:56:54.638 INFO:teuthology.orchestra.run.smithi053.stderr:listed 0 entries 2023-06-10T18:56:54.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.634+0000 7f0df8cbf640 1 -- 172.21.15.53:0/3677183950 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0dd40662b0 msgr2=0x7f0dd4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:54.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.634+0000 7f0df8cbf640 1 --2- 172.21.15.53:0/3677183950 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0dd40662b0 0x7f0dd4068760 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f0de40aa000 tx=0x7f0de40b0040 comp rx=0 tx=0).stop 2023-06-10T18:56:54.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.634+0000 7f0df8cbf640 1 -- 172.21.15.53:0/3677183950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0df4070270 msgr2=0x7f0df4070710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:54.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.634+0000 7f0df8cbf640 1 --2- 172.21.15.53:0/3677183950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0df4070270 0x7f0df4070710 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f0df406a460 tx=0x7f0dec00d830 comp rx=0 tx=0).stop 2023-06-10T18:56:54.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.634+0000 7f0df8cbf640 1 -- 172.21.15.53:0/3677183950 shutdown_connections 2023-06-10T18:56:54.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.634+0000 7f0df8cbf640 1 --2- 172.21.15.53:0/3677183950 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0dd40662b0 0x7f0dd4068760 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:54.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.634+0000 7f0df8cbf640 1 --2- 172.21.15.53:0/3677183950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0df4070270 0x7f0df4070710 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:54.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.634+0000 7f0df8cbf640 1 --2- 172.21.15.53:0/3677183950 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0df40c2a80 0x7f0df40c1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:54.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.634+0000 7f0df8cbf640 1 --2- 172.21.15.53:0/3677183950 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0de0003980 0x7f0df414b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:54.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.634+0000 7f0df8cbf640 1 -- 172.21.15.53:0/3677183950 >> 172.21.15.53:0/3677183950 conn(0x7f0df40ce9e0 msgr2=0x7f0df414bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:54.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.634+0000 7f0df8cbf640 1 -- 172.21.15.53:0/3677183950 shutdown_connections 2023-06-10T18:56:54.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.634+0000 7f0df8cbf640 1 -- 172.21.15.53:0/3677183950 wait complete. 2023-06-10T18:56:54.657 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi053.front.sepia.ceph.com... 2023-06-10T18:56:54.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:56:54.658 DEBUG:teuthology.orchestra.run.smithi053:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-06-10T18:56:54.669 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[50761]: fuse finished with error 0 and tester_r 0 2023-06-10T18:56:54.671 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi053.front.sepia.ceph.com 2023-06-10T18:56:54.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:56:54.672 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-06-10T18:56:54.810 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T18:56:54.810 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T18:56:54.817 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T18:56:54.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.942+0000 7fb160ef2640 1 Processor -- start 2023-06-10T18:56:54.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.942+0000 7fb160ef2640 1 -- start start 2023-06-10T18:56:54.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.946+0000 7fb160ef2640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb15c159450 0x7fb15c15d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:54.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.946+0000 7fb160ef2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb15c15d680 0x7fb15c0cec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:54.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.946+0000 7fb160ef2640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb15c0cbac0 con 0x7fb15c0cf180 2023-06-10T18:56:54.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.946+0000 7fb160ef2640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb15c0cf600 con 0x7fb15c159450 2023-06-10T18:56:54.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.946+0000 7fb160ef2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb15c15dc00 con 0x7fb15c15d680 2023-06-10T18:56:54.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.946+0000 7fb15a59c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb15c159450 0x7fb15c15d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:54.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.946+0000 7fb15ad9d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fb15c0cf180 0x7fb15c0cda20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60476/0 (socket says 172.21.15.53:60476) 2023-06-10T18:56:54.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.946+0000 7fb15ad9d640 1 -- 172.21.15.53:0/3247783639 learned_addr learned my addr 172.21.15.53:0/3247783639 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:56:54.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.946+0000 7fb153fff640 1 --2- 172.21.15.53:0/3247783639 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb15c15d680 0x7fb15c0cec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:54.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.946+0000 7fb15a59c640 1 -- 172.21.15.53:0/3247783639 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb15c15d680 msgr2=0x7fb15c0cec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:54.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.946+0000 7fb15a59c640 1 --2- 172.21.15.53:0/3247783639 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb15c15d680 0x7fb15c0cec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:54.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.946+0000 7fb15a59c640 1 -- 172.21.15.53:0/3247783639 >> v1:172.21.15.53:6789/0 conn(0x7fb15c0cf180 legacy=0x7fb15c0cda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:54.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.946+0000 7fb15a59c640 1 -- 172.21.15.53:0/3247783639 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb15c15dee0 con 0x7fb15c159450 2023-06-10T18:56:54.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.946+0000 7fb159d9b640 1 -- 172.21.15.53:0/3247783639 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4047902148 0 0) 0x7fb15c0cbac0 con 0x7fb15c0cf180 2023-06-10T18:56:54.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.946+0000 7fb15a59c640 1 --2- 172.21.15.53:0/3247783639 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb15c159450 0x7fb15c15d140 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fb14c0097c0 tx=0x7fb14c01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=574a1ba927951ba2 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:54.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.946+0000 7fb159d9b640 1 -- 172.21.15.53:0/3247783639 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb14c0ad680 con 0x7fb15c159450 2023-06-10T18:56:54.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.946+0000 7fb159d9b640 1 -- 172.21.15.53:0/3247783639 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb14c0ad7e0 con 0x7fb15c159450 2023-06-10T18:56:54.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.946+0000 7fb159d9b640 1 -- 172.21.15.53:0/3247783639 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb14c0adb70 con 0x7fb15c159450 2023-06-10T18:56:54.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.946+0000 7fb160ef2640 1 -- 172.21.15.53:0/3247783639 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb15c159450 msgr2=0x7fb15c15d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:54.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.946+0000 7fb160ef2640 1 --2- 172.21.15.53:0/3247783639 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb15c159450 0x7fb15c15d140 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fb14c0097c0 tx=0x7fb14c01c3c0 comp rx=0 tx=0).stop 2023-06-10T18:56:54.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.950+0000 7fb160ef2640 1 -- 172.21.15.53:0/3247783639 shutdown_connections 2023-06-10T18:56:54.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.950+0000 7fb160ef2640 1 --2- 172.21.15.53:0/3247783639 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb15c15d680 0x7fb15c0cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:54.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.950+0000 7fb160ef2640 1 --2- 172.21.15.53:0/3247783639 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb15c159450 0x7fb15c15d140 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:54.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.950+0000 7fb160ef2640 1 -- 172.21.15.53:0/3247783639 >> 172.21.15.53:0/3247783639 conn(0x7fb15c06a090 msgr2=0x7fb15c06d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:54.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.950+0000 7fb160ef2640 1 -- 172.21.15.53:0/3247783639 shutdown_connections 2023-06-10T18:56:54.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.950+0000 7fb160ef2640 1 -- 172.21.15.53:0/3247783639 wait complete. 2023-06-10T18:56:54.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.950+0000 7fb160ef2640 1 Processor -- start 2023-06-10T18:56:54.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.950+0000 7fb160ef2640 1 -- start start 2023-06-10T18:56:54.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.950+0000 7fb160ef2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb15c0cf180 0x7fb15c15c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:54.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.950+0000 7fb160ef2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb15c159450 0x7fb15c14d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:54.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.950+0000 7fb160ef2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb15c15d680 0x7fb15c0b4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:54.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.950+0000 7fb160ef2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb15c14de50 con 0x7fb15c15d680 2023-06-10T18:56:54.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.950+0000 7fb160ef2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb15c14e130 con 0x7fb15c159450 2023-06-10T18:56:54.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.950+0000 7fb160ef2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb15c14e410 con 0x7fb15c0cf180 2023-06-10T18:56:54.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.950+0000 7fb15ad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb15c15d680 0x7fb15c0b4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:54.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.950+0000 7fb15ad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb15c15d680 0x7fb15c0b4ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37542/0 (socket says 172.21.15.53:37542) 2023-06-10T18:56:54.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.950+0000 7fb15ad9d640 1 -- 172.21.15.53:0/1502243234 learned_addr learned my addr 172.21.15.53:0/1502243234 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:54.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.950+0000 7fb15ad9d640 1 -- 172.21.15.53:0/1502243234 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb15c0cf180 msgr2=0x7fb15c15c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:54.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.950+0000 7fb15ad9d640 1 --2- 172.21.15.53:0/1502243234 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb15c0cf180 0x7fb15c15c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:54.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.950+0000 7fb15ad9d640 1 -- 172.21.15.53:0/1502243234 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb15c159450 msgr2=0x7fb15c14d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:54.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.950+0000 7fb15ad9d640 1 --2- 172.21.15.53:0/1502243234 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb15c159450 0x7fb15c14d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:54.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.950+0000 7fb15ad9d640 1 -- 172.21.15.53:0/1502243234 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb14c009420 con 0x7fb15c15d680 2023-06-10T18:56:54.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.950+0000 7fb15ad9d640 1 --2- 172.21.15.53:0/1502243234 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb15c15d680 0x7fb15c0b4ab0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fb15400c780 tx=0x7fb15400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:54.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.950+0000 7fb152ffd640 1 -- 172.21.15.53:0/1502243234 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb15400ce90 con 0x7fb15c15d680 2023-06-10T18:56:54.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.950+0000 7fb152ffd640 1 -- 172.21.15.53:0/1502243234 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb15400a640 con 0x7fb15c15d680 2023-06-10T18:56:54.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.950+0000 7fb160ef2640 1 -- 172.21.15.53:0/1502243234 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb15c14e6f0 con 0x7fb15c15d680 2023-06-10T18:56:54.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.950+0000 7fb152ffd640 1 -- 172.21.15.53:0/1502243234 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb15400a9d0 con 0x7fb15c15d680 2023-06-10T18:56:54.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.950+0000 7fb160ef2640 1 -- 172.21.15.53:0/1502243234 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb15c15c930 con 0x7fb15c15d680 2023-06-10T18:56:54.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.950+0000 7fb160ef2640 1 -- 172.21.15.53:0/1502243234 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb15c14ec10 con 0x7fb15c15d680 2023-06-10T18:56:54.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.954+0000 7fb152ffd640 1 -- 172.21.15.53:0/1502243234 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb15400ab30 con 0x7fb15c15d680 2023-06-10T18:56:54.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.954+0000 7fb152ffd640 1 --2- 172.21.15.53:0/1502243234 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb13c066280 0x7fb13c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:54.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.954+0000 7fb152ffd640 1 -- 172.21.15.53:0/1502243234 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fb154083590 con 0x7fb15c15d680 2023-06-10T18:56:54.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.954+0000 7fb15a59c640 1 --2- 172.21.15.53:0/1502243234 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb13c066280 0x7fb13c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:54.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.954+0000 7fb15a59c640 1 --2- 172.21.15.53:0/1502243234 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb13c066280 0x7fb13c068730 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fb14c0af000 tx=0x7fb14c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:54.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:54.958+0000 7fb152ffd640 1 -- 172.21.15.53:0/1502243234 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb15c14ec10 con 0x7fb15c15d680 2023-06-10T18:56:55.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.114+0000 7fb160ef2640 1 -- 172.21.15.53:0/1502243234 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb15c14ec10 con 0x7fb15c15d680 2023-06-10T18:56:55.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.118+0000 7fb152ffd640 1 -- 172.21.15.53:0/1502243234 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+18434 (secure 0 0 0) 0x7fb15c14ec10 con 0x7fb15c15d680 2023-06-10T18:56:55.122 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:56:55.122 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":53,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T18:56:27.877880+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-06-10T18:56:16.364582+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-06-10T18:56:17.656793+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.e","mappings":[{"from":0,"to":6}]},{"pgid":"8.1d","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T18:56:55.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.118+0000 7fb160ef2640 1 -- 172.21.15.53:0/1502243234 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb13c066280 msgr2=0x7fb13c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:55.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.118+0000 7fb160ef2640 1 --2- 172.21.15.53:0/1502243234 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb13c066280 0x7fb13c068730 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fb14c0af000 tx=0x7fb14c008040 comp rx=0 tx=0).stop 2023-06-10T18:56:55.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.118+0000 7fb160ef2640 1 -- 172.21.15.53:0/1502243234 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb15c15d680 msgr2=0x7fb15c0b4ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:55.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.118+0000 7fb160ef2640 1 --2- 172.21.15.53:0/1502243234 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb15c15d680 0x7fb15c0b4ab0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fb15400c780 tx=0x7fb15400cc40 comp rx=0 tx=0).stop 2023-06-10T18:56:55.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.118+0000 7fb160ef2640 1 -- 172.21.15.53:0/1502243234 shutdown_connections 2023-06-10T18:56:55.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.118+0000 7fb160ef2640 1 --2- 172.21.15.53:0/1502243234 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb13c066280 0x7fb13c068730 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:55.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.118+0000 7fb160ef2640 1 --2- 172.21.15.53:0/1502243234 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb15c15d680 0x7fb15c0b4ab0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:55.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.118+0000 7fb160ef2640 1 --2- 172.21.15.53:0/1502243234 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb15c159450 0x7fb15c14d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:55.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.118+0000 7fb160ef2640 1 --2- 172.21.15.53:0/1502243234 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb15c0cf180 0x7fb15c15c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:55.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.118+0000 7fb160ef2640 1 -- 172.21.15.53:0/1502243234 >> 172.21.15.53:0/1502243234 conn(0x7fb15c06a090 msgr2=0x7fb15c155e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:55.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.118+0000 7fb160ef2640 1 -- 172.21.15.53:0/1502243234 shutdown_connections 2023-06-10T18:56:55.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.118+0000 7fb160ef2640 1 -- 172.21.15.53:0/1502243234 wait complete. 2023-06-10T18:56:55.142 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-10T18:52:33.633114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-10T18:52:39.171487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-10T18:56:16.364582+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2023-06-10T18:56:17.656793+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '51', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-10T18:56:55.144 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-10T18:56:55.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.270+0000 7f98aa6c6640 1 Processor -- start 2023-06-10T18:56:55.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.270+0000 7f98aa6c6640 1 -- start start 2023-06-10T18:56:55.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.270+0000 7f98aa6c6640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f98a40af760 0x7f98a40afb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:55.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.270+0000 7f98aa6c6640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f98a415dae0 0x7f98a406b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:55.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.270+0000 7f98aa6c6640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98a40b0070 con 0x7f98a40700e0 2023-06-10T18:56:55.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.270+0000 7f98aa6c6640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98a4070910 con 0x7f98a415dae0 2023-06-10T18:56:55.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.270+0000 7f98aa6c6640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98a4070bf0 con 0x7f98a40af760 2023-06-10T18:56:55.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.274+0000 7f98a8c63640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f98a415dae0 0x7f98a406b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:55.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.274+0000 7f98a8c63640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f98a415dae0 0x7f98a406b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37544/0 (socket says 172.21.15.53:37544) 2023-06-10T18:56:55.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.274+0000 7f98a8c63640 1 -- 172.21.15.53:0/1986678179 learned_addr learned my addr 172.21.15.53:0/1986678179 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:55.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.274+0000 7f98a3fff640 1 --2- 172.21.15.53:0/1986678179 >> v2:172.21.15.117:3300/0 conn(0x7f98a40af760 0x7f98a40afb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:55.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.274+0000 7f98a8c63640 1 -- 172.21.15.53:0/1986678179 >> v2:172.21.15.117:3300/0 conn(0x7f98a40af760 msgr2=0x7f98a40afb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:55.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.274+0000 7f98a8c63640 1 --2- 172.21.15.53:0/1986678179 >> v2:172.21.15.117:3300/0 conn(0x7f98a40af760 0x7f98a40afb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:55.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.274+0000 7f98a8c63640 1 -- 172.21.15.53:0/1986678179 >> v1:172.21.15.117:6789/0 conn(0x7f98a40700e0 legacy=0x7f98a40c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:55.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.274+0000 7f98a8c63640 1 -- 172.21.15.53:0/1986678179 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98a4070ed0 con 0x7f98a415dae0 2023-06-10T18:56:55.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.274+0000 7f98a8c63640 1 --2- 172.21.15.53:0/1986678179 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98a415dae0 0x7f98a406b650 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f98a406e9d0 tx=0x7f989c01c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb933d5510f60dc2 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:55.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.274+0000 7f98a2ffd640 1 -- 172.21.15.53:0/1986678179 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989c0a5820 con 0x7f98a415dae0 2023-06-10T18:56:55.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.274+0000 7f98a2ffd640 1 -- 172.21.15.53:0/1986678179 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f989c0a5980 con 0x7f98a415dae0 2023-06-10T18:56:55.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.274+0000 7f98a2ffd640 1 -- 172.21.15.53:0/1986678179 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989c0a5d10 con 0x7f98a415dae0 2023-06-10T18:56:55.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.274+0000 7f98aa6c6640 1 -- 172.21.15.53:0/1986678179 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98a415dae0 msgr2=0x7f98a406b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:55.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.274+0000 7f98aa6c6640 1 --2- 172.21.15.53:0/1986678179 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98a415dae0 0x7f98a406b650 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f98a406e9d0 tx=0x7f989c01c960 comp rx=0 tx=0).stop 2023-06-10T18:56:55.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.274+0000 7f98aa6c6640 1 -- 172.21.15.53:0/1986678179 shutdown_connections 2023-06-10T18:56:55.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.274+0000 7f98aa6c6640 1 --2- 172.21.15.53:0/1986678179 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98a415dae0 0x7f98a406b650 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:55.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.274+0000 7f98aa6c6640 1 --2- 172.21.15.53:0/1986678179 >> v2:172.21.15.117:3300/0 conn(0x7f98a40af760 0x7f98a40afb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:55.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.274+0000 7f98aa6c6640 1 -- 172.21.15.53:0/1986678179 >> 172.21.15.53:0/1986678179 conn(0x7f98a406a0e0 msgr2=0x7f98a40cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:55.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.274+0000 7f98aa6c6640 1 -- 172.21.15.53:0/1986678179 shutdown_connections 2023-06-10T18:56:55.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.274+0000 7f98aa6c6640 1 -- 172.21.15.53:0/1986678179 wait complete. 2023-06-10T18:56:55.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.278+0000 7f98aa6c6640 1 Processor -- start 2023-06-10T18:56:55.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.278+0000 7f98aa6c6640 1 -- start start 2023-06-10T18:56:55.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.278+0000 7f98aa6c6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98a40700e0 0x7f98a41591d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:55.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.278+0000 7f98aa6c6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98a40af760 0x7f98a40b2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:55.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.278+0000 7f98aa6c6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98a415dae0 0x7f98a40b2a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:55.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.278+0000 7f98aa6c6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a4158db0 con 0x7f98a415dae0 2023-06-10T18:56:55.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.278+0000 7f98aa6c6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a4159710 con 0x7f98a40af760 2023-06-10T18:56:55.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.278+0000 7f98aa6c6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98a4158130 con 0x7f98a40700e0 2023-06-10T18:56:55.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.278+0000 7f98a8c63640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98a415dae0 0x7f98a40b2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:55.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.278+0000 7f98a8c63640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98a415dae0 0x7f98a40b2a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37556/0 (socket says 172.21.15.53:37556) 2023-06-10T18:56:55.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.278+0000 7f98a8c63640 1 -- 172.21.15.53:0/64266143 learned_addr learned my addr 172.21.15.53:0/64266143 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:55.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.278+0000 7f98a37fe640 1 --2- 172.21.15.53:0/64266143 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98a40af760 0x7f98a40b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:55.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.278+0000 7f98a8c63640 1 -- 172.21.15.53:0/64266143 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98a40700e0 msgr2=0x7f98a41591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:55.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.278+0000 7f98a8c63640 1 --2- 172.21.15.53:0/64266143 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98a40700e0 0x7f98a41591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:55.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.278+0000 7f98a8c63640 1 -- 172.21.15.53:0/64266143 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98a40af760 msgr2=0x7f98a40b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:55.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.278+0000 7f98a8c63640 1 --2- 172.21.15.53:0/64266143 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98a40af760 0x7f98a40b2500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:55.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.278+0000 7f98a8c63640 1 -- 172.21.15.53:0/64266143 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f989c009b30 con 0x7f98a415dae0 2023-06-10T18:56:55.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.278+0000 7f98a8c63640 1 --2- 172.21.15.53:0/64266143 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98a415dae0 0x7f98a40b2a40 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f989c0af040 tx=0x7f989c019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:55.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.278+0000 7f98a0ff9640 1 -- 172.21.15.53:0/64266143 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989c0b8670 con 0x7f98a415dae0 2023-06-10T18:56:55.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.278+0000 7f98a0ff9640 1 -- 172.21.15.53:0/64266143 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f989c0b87f0 con 0x7f98a415dae0 2023-06-10T18:56:55.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.278+0000 7f98aa6c6640 1 -- 172.21.15.53:0/64266143 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98a40706e0 con 0x7f98a415dae0 2023-06-10T18:56:55.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.278+0000 7f98a0ff9640 1 -- 172.21.15.53:0/64266143 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989c0b8ba0 con 0x7f98a415dae0 2023-06-10T18:56:55.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.278+0000 7f98aa6c6640 1 -- 172.21.15.53:0/64266143 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98a41586f0 con 0x7f98a415dae0 2023-06-10T18:56:55.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.278+0000 7f98aa6c6640 1 -- 172.21.15.53:0/64266143 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98a404d790 con 0x7f98a415dae0 2023-06-10T18:56:55.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.282+0000 7f98a0ff9640 1 -- 172.21.15.53:0/64266143 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f989c0b8d00 con 0x7f98a415dae0 2023-06-10T18:56:55.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.282+0000 7f98a0ff9640 1 --2- 172.21.15.53:0/64266143 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9890066280 0x7f9890068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:55.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.282+0000 7f98a0ff9640 1 -- 172.21.15.53:0/64266143 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f989c11f570 con 0x7f98a415dae0 2023-06-10T18:56:55.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.282+0000 7f98a3fff640 1 --2- 172.21.15.53:0/64266143 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9890066280 0x7f9890068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:55.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.282+0000 7f98a3fff640 1 --2- 172.21.15.53:0/64266143 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9890066280 0x7f9890068730 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f98a40c1360 tx=0x7f9894008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:55.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.286+0000 7f98a0ff9640 1 -- 172.21.15.53:0/64266143 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f989c0ecb90 con 0x7f98a415dae0 2023-06-10T18:56:55.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.438+0000 7f98aa6c6640 1 -- 172.21.15.53:0/64266143 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f98a4158ef0 con 0x7f98a415dae0 2023-06-10T18:56:55.445 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.438+0000 7f98a0ff9640 1 -- 172.21.15.53:0/64266143 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v53) v1 ==== 93+0+10 (secure 0 0 0) 0x7f989c0f01b0 con 0x7f98a415dae0 2023-06-10T18:56:55.445 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-06-10T18:56:55.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.442+0000 7f98aa6c6640 1 -- 172.21.15.53:0/64266143 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9890066280 msgr2=0x7f9890068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:55.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.442+0000 7f98aa6c6640 1 --2- 172.21.15.53:0/64266143 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9890066280 0x7f9890068730 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f98a40c1360 tx=0x7f9894008040 comp rx=0 tx=0).stop 2023-06-10T18:56:55.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.442+0000 7f98aa6c6640 1 -- 172.21.15.53:0/64266143 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98a415dae0 msgr2=0x7f98a40b2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:55.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.442+0000 7f98aa6c6640 1 --2- 172.21.15.53:0/64266143 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98a415dae0 0x7f98a40b2a40 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f989c0af040 tx=0x7f989c019700 comp rx=0 tx=0).stop 2023-06-10T18:56:55.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.442+0000 7f98aa6c6640 1 -- 172.21.15.53:0/64266143 shutdown_connections 2023-06-10T18:56:55.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.442+0000 7f98aa6c6640 1 --2- 172.21.15.53:0/64266143 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9890066280 0x7f9890068730 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:55.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.442+0000 7f98aa6c6640 1 --2- 172.21.15.53:0/64266143 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98a415dae0 0x7f98a40b2a40 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:55.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.442+0000 7f98aa6c6640 1 --2- 172.21.15.53:0/64266143 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98a40af760 0x7f98a40b2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:55.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.442+0000 7f98aa6c6640 1 --2- 172.21.15.53:0/64266143 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98a40700e0 0x7f98a41591d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:55.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.442+0000 7f98aa6c6640 1 -- 172.21.15.53:0/64266143 >> 172.21.15.53:0/64266143 conn(0x7f98a406a0e0 msgr2=0x7f98a40aec40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:55.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.442+0000 7f98aa6c6640 1 -- 172.21.15.53:0/64266143 shutdown_connections 2023-06-10T18:56:55.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.442+0000 7f98aa6c6640 1 -- 172.21.15.53:0/64266143 wait complete. 2023-06-10T18:56:55.464 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-10T18:56:55.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.590+0000 7fbc3e650640 1 Processor -- start 2023-06-10T18:56:55.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.590+0000 7fbc3e650640 1 -- start start 2023-06-10T18:56:55.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.590+0000 7fbc3e650640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc3806f3b0 0x7fbc380cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:55.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.590+0000 7fbc3e650640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbc380cda10 0x7fbc380cde90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:55.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.590+0000 7fbc3e650640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc380ce3d0 con 0x7fbc38159b20 2023-06-10T18:56:55.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.590+0000 7fbc3e650640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc380cbb30 con 0x7fbc380cda10 2023-06-10T18:56:55.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.590+0000 7fbc3e650640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc380ce620 con 0x7fbc3806f3b0 2023-06-10T18:56:55.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.590+0000 7fbc3cbed640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbc380cda10 0x7fbc380cde90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:55.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.590+0000 7fbc3cbed640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbc380cda10 0x7fbc380cde90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.53:45858/0 (socket says 172.21.15.53:45858) 2023-06-10T18:56:55.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.590+0000 7fbc3cbed640 1 -- 172.21.15.53:0/1499961644 learned_addr learned my addr 172.21.15.53:0/1499961644 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:55.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.590+0000 7fbc377fe640 1 --2- 172.21.15.53:0/1499961644 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc3806f3b0 0x7fbc380cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:55.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.590+0000 7fbc37fff640 1 --1- 172.21.15.53:0/1499961644 >> v1:172.21.15.117:6789/0 conn(0x7fbc38159b20 0x7fbc3806eca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.53:40946/0 (socket says 172.21.15.53:40946) 2023-06-10T18:56:55.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.590+0000 7fbc3cbed640 1 -- 172.21.15.53:0/1499961644 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc3806f3b0 msgr2=0x7fbc380cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:55.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.590+0000 7fbc3cbed640 1 --2- 172.21.15.53:0/1499961644 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc3806f3b0 0x7fbc380cf6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:55.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.590+0000 7fbc3cbed640 1 -- 172.21.15.53:0/1499961644 >> v1:172.21.15.117:6789/0 conn(0x7fbc38159b20 legacy=0x7fbc3806eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:55.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.590+0000 7fbc3cbed640 1 -- 172.21.15.53:0/1499961644 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc380ce900 con 0x7fbc380cda10 2023-06-10T18:56:55.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.594+0000 7fbc3cbed640 1 --2- 172.21.15.53:0/1499961644 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc380cda10 0x7fbc380cde90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fbc30009870 tx=0x7fbc3001c540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb52218facee378e server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:55.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.594+0000 7fbc36ffd640 1 -- 172.21.15.53:0/1499961644 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc300a7070 con 0x7fbc380cda10 2023-06-10T18:56:55.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.594+0000 7fbc36ffd640 1 -- 172.21.15.53:0/1499961644 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc300ab430 con 0x7fbc380cda10 2023-06-10T18:56:55.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.594+0000 7fbc36ffd640 1 -- 172.21.15.53:0/1499961644 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc300ab7c0 con 0x7fbc380cda10 2023-06-10T18:56:55.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.594+0000 7fbc3e650640 1 -- 172.21.15.53:0/1499961644 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc380cda10 msgr2=0x7fbc380cde90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:55.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.594+0000 7fbc3e650640 1 --2- 172.21.15.53:0/1499961644 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc380cda10 0x7fbc380cde90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fbc30009870 tx=0x7fbc3001c540 comp rx=0 tx=0).stop 2023-06-10T18:56:55.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.594+0000 7fbc3e650640 1 -- 172.21.15.53:0/1499961644 shutdown_connections 2023-06-10T18:56:55.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.594+0000 7fbc3e650640 1 --2- 172.21.15.53:0/1499961644 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc380cda10 0x7fbc380cde90 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:55.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.594+0000 7fbc3e650640 1 --2- 172.21.15.53:0/1499961644 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc3806f3b0 0x7fbc380cf6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:55.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.594+0000 7fbc3e650640 1 -- 172.21.15.53:0/1499961644 >> 172.21.15.53:0/1499961644 conn(0x7fbc3806a0e0 msgr2=0x7fbc3806d270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:55.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.594+0000 7fbc3e650640 1 -- 172.21.15.53:0/1499961644 shutdown_connections 2023-06-10T18:56:55.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.594+0000 7fbc3e650640 1 -- 172.21.15.53:0/1499961644 wait complete. 2023-06-10T18:56:55.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.598+0000 7fbc3e650640 1 Processor -- start 2023-06-10T18:56:55.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.598+0000 7fbc3e650640 1 -- start start 2023-06-10T18:56:55.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.598+0000 7fbc3e650640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc3806f3b0 0x7fbc380b1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:55.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.598+0000 7fbc3e650640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc380cda10 0x7fbc381452b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:55.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.598+0000 7fbc3e650640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc38159b20 0x7fbc3814eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:55.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.598+0000 7fbc3e650640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc380b1d50 con 0x7fbc3806f3b0 2023-06-10T18:56:55.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.598+0000 7fbc3e650640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3814cf30 con 0x7fbc380cda10 2023-06-10T18:56:55.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.598+0000 7fbc3e650640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3814d210 con 0x7fbc38159b20 2023-06-10T18:56:55.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.598+0000 7fbc37fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc3806f3b0 0x7fbc380b1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:55.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.598+0000 7fbc37fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc3806f3b0 0x7fbc380b1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37568/0 (socket says 172.21.15.53:37568) 2023-06-10T18:56:55.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.598+0000 7fbc37fff640 1 -- 172.21.15.53:0/1586471824 learned_addr learned my addr 172.21.15.53:0/1586471824 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:55.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.598+0000 7fbc377fe640 1 --2- 172.21.15.53:0/1586471824 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc380cda10 0x7fbc381452b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:55.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.598+0000 7fbc3cbed640 1 --2- 172.21.15.53:0/1586471824 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc38159b20 0x7fbc3814eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:55.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.598+0000 7fbc37fff640 1 -- 172.21.15.53:0/1586471824 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc38159b20 msgr2=0x7fbc3814eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:55.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.598+0000 7fbc37fff640 1 --2- 172.21.15.53:0/1586471824 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc38159b20 0x7fbc3814eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:55.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.598+0000 7fbc37fff640 1 -- 172.21.15.53:0/1586471824 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc380cda10 msgr2=0x7fbc381452b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:55.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.598+0000 7fbc37fff640 1 --2- 172.21.15.53:0/1586471824 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc380cda10 0x7fbc381452b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:55.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.598+0000 7fbc37fff640 1 -- 172.21.15.53:0/1586471824 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc300094d0 con 0x7fbc3806f3b0 2023-06-10T18:56:55.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.598+0000 7fbc377fe640 1 --2- 172.21.15.53:0/1586471824 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc380cda10 0x7fbc381452b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:56:55.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.598+0000 7fbc37fff640 1 --2- 172.21.15.53:0/1586471824 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc3806f3b0 0x7fbc380b1810 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fbc2800c370 tx=0x7fbc2800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:55.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.598+0000 7fbc34ff9640 1 -- 172.21.15.53:0/1586471824 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc280074e0 con 0x7fbc3806f3b0 2023-06-10T18:56:55.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.598+0000 7fbc34ff9640 1 -- 172.21.15.53:0/1586471824 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc28007640 con 0x7fbc3806f3b0 2023-06-10T18:56:55.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.598+0000 7fbc34ff9640 1 -- 172.21.15.53:0/1586471824 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc28004a30 con 0x7fbc3806f3b0 2023-06-10T18:56:55.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.598+0000 7fbc3e650640 1 -- 172.21.15.53:0/1586471824 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc3814d4f0 con 0x7fbc3806f3b0 2023-06-10T18:56:55.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.598+0000 7fbc3e650640 1 -- 172.21.15.53:0/1586471824 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc380b12f0 con 0x7fbc3806f3b0 2023-06-10T18:56:55.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.598+0000 7fbc3e650640 1 -- 172.21.15.53:0/1586471824 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc380b14e0 con 0x7fbc3806f3b0 2023-06-10T18:56:55.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.598+0000 7fbc34ff9640 1 -- 172.21.15.53:0/1586471824 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbc28004b90 con 0x7fbc3806f3b0 2023-06-10T18:56:55.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.602+0000 7fbc34ff9640 1 --2- 172.21.15.53:0/1586471824 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbc18066280 0x7fbc18068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:55.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.602+0000 7fbc34ff9640 1 -- 172.21.15.53:0/1586471824 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fbc28083690 con 0x7fbc3806f3b0 2023-06-10T18:56:55.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.602+0000 7fbc377fe640 1 --2- 172.21.15.53:0/1586471824 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbc18066280 0x7fbc18068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:55.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.602+0000 7fbc377fe640 1 --2- 172.21.15.53:0/1586471824 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbc18066280 0x7fbc18068730 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fbc3814d7d0 tx=0x7fbc2000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:55.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.606+0000 7fbc34ff9640 1 -- 172.21.15.53:0/1586471824 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbc28050b60 con 0x7fbc3806f3b0 2023-06-10T18:56:55.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.758+0000 7fbc3e650640 1 -- 172.21.15.53:0/1586471824 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fbc3804d790 con 0x7fbc3806f3b0 2023-06-10T18:56:55.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.758+0000 7fbc34ff9640 1 -- 172.21.15.53:0/1586471824 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v53) v1 ==== 92+0+10 (secure 0 0 0) 0x7fbc28054180 con 0x7fbc3806f3b0 2023-06-10T18:56:55.763 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-06-10T18:56:55.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.758+0000 7fbc3e650640 1 -- 172.21.15.53:0/1586471824 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbc18066280 msgr2=0x7fbc18068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:55.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.758+0000 7fbc3e650640 1 --2- 172.21.15.53:0/1586471824 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbc18066280 0x7fbc18068730 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fbc3814d7d0 tx=0x7fbc2000b040 comp rx=0 tx=0).stop 2023-06-10T18:56:55.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.758+0000 7fbc3e650640 1 -- 172.21.15.53:0/1586471824 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc3806f3b0 msgr2=0x7fbc380b1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:55.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.758+0000 7fbc3e650640 1 --2- 172.21.15.53:0/1586471824 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc3806f3b0 0x7fbc380b1810 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fbc2800c370 tx=0x7fbc2800c830 comp rx=0 tx=0).stop 2023-06-10T18:56:55.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.758+0000 7fbc3e650640 1 -- 172.21.15.53:0/1586471824 shutdown_connections 2023-06-10T18:56:55.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.758+0000 7fbc3e650640 1 --2- 172.21.15.53:0/1586471824 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbc18066280 0x7fbc18068730 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:55.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.758+0000 7fbc3e650640 1 --2- 172.21.15.53:0/1586471824 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc38159b20 0x7fbc3814eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:55.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.758+0000 7fbc3e650640 1 --2- 172.21.15.53:0/1586471824 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc380cda10 0x7fbc381452b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:55.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.758+0000 7fbc3e650640 1 --2- 172.21.15.53:0/1586471824 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc3806f3b0 0x7fbc380b1810 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:55.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.758+0000 7fbc3e650640 1 -- 172.21.15.53:0/1586471824 >> 172.21.15.53:0/1586471824 conn(0x7fbc3806a0e0 msgr2=0x7fbc380cfd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:55.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.758+0000 7fbc3e650640 1 -- 172.21.15.53:0/1586471824 shutdown_connections 2023-06-10T18:56:55.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.758+0000 7fbc3e650640 1 -- 172.21.15.53:0/1586471824 wait complete. 2023-06-10T18:56:55.781 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-10T18:56:55.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.894+0000 7f0f87a8b640 1 Processor -- start 2023-06-10T18:56:55.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.894+0000 7f0f87a8b640 1 -- start start 2023-06-10T18:56:55.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.894+0000 7f0f87a8b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f80159450 0x7f0f8015d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:55.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.894+0000 7f0f87a8b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0f800cf350 0x7f0f800cbf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:55.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.894+0000 7f0f87a8b640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f800cbac0 con 0x7f0f8015d680 2023-06-10T18:56:55.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.894+0000 7f0f87a8b640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f8015dc00 con 0x7f0f800cf350 2023-06-10T18:56:55.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.894+0000 7f0f87a8b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f8015dee0 con 0x7f0f80159450 2023-06-10T18:56:55.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.894+0000 7f0f86028640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0f800cf350 0x7f0f800cbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:55.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.894+0000 7f0f86028640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0f800cf350 0x7f0f800cbf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37582/0 (socket says 172.21.15.53:37582) 2023-06-10T18:56:55.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.894+0000 7f0f85026640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f0f8015d680 0x7f0f800cec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60478/0 (socket says 172.21.15.53:60478) 2023-06-10T18:56:55.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.894+0000 7f0f86028640 1 -- 172.21.15.53:0/2236394044 learned_addr learned my addr 172.21.15.53:0/2236394044 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:55.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.894+0000 7f0f85827640 1 --2- 172.21.15.53:0/2236394044 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f80159450 0x7f0f8015d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:55.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.894+0000 7f0f86028640 1 -- 172.21.15.53:0/2236394044 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f80159450 msgr2=0x7f0f8015d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:55.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.894+0000 7f0f86028640 1 --2- 172.21.15.53:0/2236394044 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f80159450 0x7f0f8015d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:55.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.894+0000 7f0f86028640 1 -- 172.21.15.53:0/2236394044 >> v1:172.21.15.53:6789/0 conn(0x7f0f8015d680 legacy=0x7f0f800cec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:55.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.894+0000 7f0f86028640 1 -- 172.21.15.53:0/2236394044 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f800cb750 con 0x7f0f800cf350 2023-06-10T18:56:55.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.894+0000 7f0f84825640 1 -- 172.21.15.53:0/2236394044 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 109565257 0 0) 0x7f0f800cbac0 con 0x7f0f8015d680 2023-06-10T18:56:55.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.898+0000 7f0f86028640 1 --2- 172.21.15.53:0/2236394044 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f800cf350 0x7f0f800cbf50 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f0f78009e50 tx=0x7f0f7801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2be9bf7fce9049b2 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:55.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.898+0000 7f0f84825640 1 -- 172.21.15.53:0/2236394044 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f780a5800 con 0x7f0f800cf350 2023-06-10T18:56:55.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.898+0000 7f0f84825640 1 -- 172.21.15.53:0/2236394044 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f780a5960 con 0x7f0f800cf350 2023-06-10T18:56:55.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.898+0000 7f0f84825640 1 -- 172.21.15.53:0/2236394044 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f780a5cf0 con 0x7f0f800cf350 2023-06-10T18:56:55.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.898+0000 7f0f87a8b640 1 -- 172.21.15.53:0/2236394044 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f800cf350 msgr2=0x7f0f800cbf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:55.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.898+0000 7f0f87a8b640 1 --2- 172.21.15.53:0/2236394044 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f800cf350 0x7f0f800cbf50 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f0f78009e50 tx=0x7f0f7801c920 comp rx=0 tx=0).stop 2023-06-10T18:56:55.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.898+0000 7f0f87a8b640 1 -- 172.21.15.53:0/2236394044 shutdown_connections 2023-06-10T18:56:55.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.898+0000 7f0f87a8b640 1 --2- 172.21.15.53:0/2236394044 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f800cf350 0x7f0f800cbf50 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:55.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.898+0000 7f0f87a8b640 1 --2- 172.21.15.53:0/2236394044 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f80159450 0x7f0f8015d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:55.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.898+0000 7f0f87a8b640 1 -- 172.21.15.53:0/2236394044 >> 172.21.15.53:0/2236394044 conn(0x7f0f8006a090 msgr2=0x7f0f8006d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:55.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.898+0000 7f0f87a8b640 1 -- 172.21.15.53:0/2236394044 shutdown_connections 2023-06-10T18:56:55.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.898+0000 7f0f87a8b640 1 -- 172.21.15.53:0/2236394044 wait complete. 2023-06-10T18:56:55.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.898+0000 7f0f87a8b640 1 Processor -- start 2023-06-10T18:56:55.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.898+0000 7f0f87a8b640 1 -- start start 2023-06-10T18:56:55.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.898+0000 7f0f87a8b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f800cf350 0x7f0f800c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:55.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.898+0000 7f0f87a8b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f80159450 0x7f0f801f7de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:55.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.898+0000 7f0f87a8b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f8015d680 0x7f0f801563a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:55.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.898+0000 7f0f87a8b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f801f8320 con 0x7f0f80159450 2023-06-10T18:56:55.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.898+0000 7f0f87a8b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f800c9270 con 0x7f0f8015d680 2023-06-10T18:56:55.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.898+0000 7f0f87a8b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f800c9550 con 0x7f0f800cf350 2023-06-10T18:56:55.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.898+0000 7f0f85026640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f80159450 0x7f0f801f7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:55.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.898+0000 7f0f85026640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f80159450 0x7f0f801f7de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37598/0 (socket says 172.21.15.53:37598) 2023-06-10T18:56:55.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.898+0000 7f0f85026640 1 -- 172.21.15.53:0/3994351317 learned_addr learned my addr 172.21.15.53:0/3994351317 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:55.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.902+0000 7f0f86028640 1 --2- 172.21.15.53:0/3994351317 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f8015d680 0x7f0f801563a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:55.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.902+0000 7f0f85026640 1 -- 172.21.15.53:0/3994351317 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f800cf350 msgr2=0x7f0f800c8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:55.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.902+0000 7f0f85026640 1 --2- 172.21.15.53:0/3994351317 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f800cf350 0x7f0f800c8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:55.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.902+0000 7f0f85026640 1 -- 172.21.15.53:0/3994351317 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f8015d680 msgr2=0x7f0f801563a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:55.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.902+0000 7f0f85026640 1 --2- 172.21.15.53:0/3994351317 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f8015d680 0x7f0f801563a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:55.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.902+0000 7f0f85026640 1 -- 172.21.15.53:0/3994351317 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f78009b30 con 0x7f0f80159450 2023-06-10T18:56:55.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.902+0000 7f0f85026640 1 --2- 172.21.15.53:0/3994351317 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f80159450 0x7f0f801f7de0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f0f7000c480 tx=0x7f0f7000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:55.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.902+0000 7f0f767fc640 1 -- 172.21.15.53:0/3994351317 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f700074e0 con 0x7f0f80159450 2023-06-10T18:56:55.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.902+0000 7f0f767fc640 1 -- 172.21.15.53:0/3994351317 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f70007660 con 0x7f0f80159450 2023-06-10T18:56:55.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.902+0000 7f0f87a8b640 1 -- 172.21.15.53:0/3994351317 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f800c9830 con 0x7f0f80159450 2023-06-10T18:56:55.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.902+0000 7f0f767fc640 1 -- 172.21.15.53:0/3994351317 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f70004a30 con 0x7f0f80159450 2023-06-10T18:56:55.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.902+0000 7f0f87a8b640 1 -- 172.21.15.53:0/3994351317 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f801568e0 con 0x7f0f80159450 2023-06-10T18:56:55.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.902+0000 7f0f87a8b640 1 -- 172.21.15.53:0/3994351317 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f8004d790 con 0x7f0f80159450 2023-06-10T18:56:55.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.902+0000 7f0f767fc640 1 -- 172.21.15.53:0/3994351317 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0f70004b90 con 0x7f0f80159450 2023-06-10T18:56:55.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.902+0000 7f0f767fc640 1 --2- 172.21.15.53:0/3994351317 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0f64066280 0x7f0f64068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:55.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.902+0000 7f0f767fc640 1 -- 172.21.15.53:0/3994351317 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f0f700832f0 con 0x7f0f80159450 2023-06-10T18:56:55.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.902+0000 7f0f85827640 1 --2- 172.21.15.53:0/3994351317 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0f64066280 0x7f0f64068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:55.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.902+0000 7f0f85827640 1 --2- 172.21.15.53:0/3994351317 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0f64066280 0x7f0f64068730 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c00a8b0 tx=0x7f0f7c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:55.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:55.906+0000 7f0f767fc640 1 -- 172.21.15.53:0/3994351317 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0f700541b0 con 0x7f0f80159450 2023-06-10T18:56:56.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.062+0000 7f0f87a8b640 1 -- 172.21.15.53:0/3994351317 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0f800b18d0 con 0x7f0f80159450 2023-06-10T18:56:56.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.062+0000 7f0f767fc640 1 -- 172.21.15.53:0/3994351317 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v53) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0f70053d40 con 0x7f0f80159450 2023-06-10T18:56:56.067 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-06-10T18:56:56.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.062+0000 7f0f87a8b640 1 -- 172.21.15.53:0/3994351317 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0f64066280 msgr2=0x7f0f64068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:56.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.062+0000 7f0f87a8b640 1 --2- 172.21.15.53:0/3994351317 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0f64066280 0x7f0f64068730 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c00a8b0 tx=0x7f0f7c008040 comp rx=0 tx=0).stop 2023-06-10T18:56:56.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.062+0000 7f0f87a8b640 1 -- 172.21.15.53:0/3994351317 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f80159450 msgr2=0x7f0f801f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:56.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.062+0000 7f0f87a8b640 1 --2- 172.21.15.53:0/3994351317 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f80159450 0x7f0f801f7de0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f0f7000c480 tx=0x7f0f7000c940 comp rx=0 tx=0).stop 2023-06-10T18:56:56.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.062+0000 7f0f87a8b640 1 -- 172.21.15.53:0/3994351317 shutdown_connections 2023-06-10T18:56:56.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.062+0000 7f0f87a8b640 1 --2- 172.21.15.53:0/3994351317 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0f64066280 0x7f0f64068730 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:56.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.062+0000 7f0f87a8b640 1 --2- 172.21.15.53:0/3994351317 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f8015d680 0x7f0f801563a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:56.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.062+0000 7f0f87a8b640 1 --2- 172.21.15.53:0/3994351317 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f80159450 0x7f0f801f7de0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:56.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.062+0000 7f0f87a8b640 1 --2- 172.21.15.53:0/3994351317 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f800cf350 0x7f0f800c8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:56.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.062+0000 7f0f87a8b640 1 -- 172.21.15.53:0/3994351317 >> 172.21.15.53:0/3994351317 conn(0x7f0f8006a090 msgr2=0x7f0f8006a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:56.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.062+0000 7f0f87a8b640 1 -- 172.21.15.53:0/3994351317 shutdown_connections 2023-06-10T18:56:56.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.062+0000 7f0f87a8b640 1 -- 172.21.15.53:0/3994351317 wait complete. 2023-06-10T18:56:56.086 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-10T18:56:56.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.202+0000 7f81a906c640 1 Processor -- start 2023-06-10T18:56:56.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.202+0000 7f81a906c640 1 -- start start 2023-06-10T18:56:56.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.202+0000 7f81a906c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f81a40b0f30 0x7f81a4070950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:56.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.202+0000 7f81a906c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f81a4159a60 0x7f81a40c2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:56.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.202+0000 7f81a906c640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81a40cb080 con 0x7f81a4159690 2023-06-10T18:56:56.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.202+0000 7f81a906c640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81a4070e90 con 0x7f81a40b0f30 2023-06-10T18:56:56.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.202+0000 7f81a906c640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81a406d450 con 0x7f81a4159a60 2023-06-10T18:56:56.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.202+0000 7f81a259c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f81a40b0f30 0x7f81a4070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:56.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.202+0000 7f81a259c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f81a40b0f30 0x7f81a4070950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37612/0 (socket says 172.21.15.53:37612) 2023-06-10T18:56:56.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.202+0000 7f81a259c640 1 -- 172.21.15.53:0/2526873572 learned_addr learned my addr 172.21.15.53:0/2526873572 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:56.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.202+0000 7f81a2d9d640 1 --1- 172.21.15.53:0/2526873572 >> v1:172.21.15.53:6789/0 conn(0x7f81a4159690 0x7f81a40cbe00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60488/0 (socket says 172.21.15.53:60488) 2023-06-10T18:56:56.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.202+0000 7f81a259c640 1 -- 172.21.15.53:0/2526873572 >> v2:172.21.15.117:3300/0 conn(0x7f81a4159a60 msgr2=0x7f81a40c2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:56.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.202+0000 7f81a259c640 1 --2- 172.21.15.53:0/2526873572 >> v2:172.21.15.117:3300/0 conn(0x7f81a4159a60 0x7f81a40c2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:56.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.202+0000 7f81a259c640 1 -- 172.21.15.53:0/2526873572 >> v1:172.21.15.53:6789/0 conn(0x7f81a4159690 legacy=0x7f81a40cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:56.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.202+0000 7f81a259c640 1 -- 172.21.15.53:0/2526873572 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81a40cb320 con 0x7f81a40b0f30 2023-06-10T18:56:56.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.202+0000 7f81a259c640 1 --2- 172.21.15.53:0/2526873572 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f81a40b0f30 0x7f81a4070950 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f81a4070160 tx=0x7f818c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d864cc102192dcba server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:56.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.202+0000 7f81a1d9b640 1 -- 172.21.15.53:0/2526873572 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f818c0ac640 con 0x7f81a40b0f30 2023-06-10T18:56:56.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.202+0000 7f81a1d9b640 1 -- 172.21.15.53:0/2526873572 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f818c0ac7a0 con 0x7f81a40b0f30 2023-06-10T18:56:56.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.202+0000 7f81a1d9b640 1 -- 172.21.15.53:0/2526873572 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f818c0acb30 con 0x7f81a40b0f30 2023-06-10T18:56:56.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.206+0000 7f81a906c640 1 -- 172.21.15.53:0/2526873572 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f81a40b0f30 msgr2=0x7f81a4070950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:56.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.206+0000 7f81a906c640 1 --2- 172.21.15.53:0/2526873572 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f81a40b0f30 0x7f81a4070950 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f81a4070160 tx=0x7f818c01c4d0 comp rx=0 tx=0).stop 2023-06-10T18:56:56.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.206+0000 7f81a906c640 1 -- 172.21.15.53:0/2526873572 shutdown_connections 2023-06-10T18:56:56.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.206+0000 7f81a906c640 1 --2- 172.21.15.53:0/2526873572 >> v2:172.21.15.117:3300/0 conn(0x7f81a4159a60 0x7f81a40c2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:56.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.206+0000 7f81a906c640 1 --2- 172.21.15.53:0/2526873572 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f81a40b0f30 0x7f81a4070950 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:56.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.206+0000 7f81a906c640 1 -- 172.21.15.53:0/2526873572 >> 172.21.15.53:0/2526873572 conn(0x7f81a406a560 msgr2=0x7f81a406a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:56.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.206+0000 7f81a906c640 1 -- 172.21.15.53:0/2526873572 shutdown_connections 2023-06-10T18:56:56.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.206+0000 7f81a906c640 1 -- 172.21.15.53:0/2526873572 wait complete. 2023-06-10T18:56:56.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.206+0000 7f81a906c640 1 Processor -- start 2023-06-10T18:56:56.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.206+0000 7f81a906c640 1 -- start start 2023-06-10T18:56:56.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.206+0000 7f81a906c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f81a4159690 0x7f81a414f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:56.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.206+0000 7f81a906c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81a4159a60 0x7f81a4154ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:56.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.206+0000 7f81a906c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f81a4154ff0 0x7f81a40cf090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:56.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.206+0000 7f81a906c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a414f780 con 0x7f81a4159690 2023-06-10T18:56:56.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.206+0000 7f81a906c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a4155470 con 0x7f81a4159a60 2023-06-10T18:56:56.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.206+0000 7f81a906c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81a4153470 con 0x7f81a4154ff0 2023-06-10T18:56:56.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.206+0000 7f81a2d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f81a4159690 0x7f81a414f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:56.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.206+0000 7f81a2d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f81a4159690 0x7f81a414f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37616/0 (socket says 172.21.15.53:37616) 2023-06-10T18:56:56.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.206+0000 7f81a2d9d640 1 -- 172.21.15.53:0/102341879 learned_addr learned my addr 172.21.15.53:0/102341879 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:56.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.206+0000 7f81a259c640 1 --2- 172.21.15.53:0/102341879 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81a4159a60 0x7f81a4154ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:56.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.206+0000 7f81a2d9d640 1 -- 172.21.15.53:0/102341879 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f81a4154ff0 msgr2=0x7f81a40cf090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:56.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.206+0000 7f81a2d9d640 1 --2- 172.21.15.53:0/102341879 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f81a4154ff0 0x7f81a40cf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:56.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.206+0000 7f81a2d9d640 1 -- 172.21.15.53:0/102341879 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81a4159a60 msgr2=0x7f81a4154ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:56.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.206+0000 7f81a2d9d640 1 --2- 172.21.15.53:0/102341879 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81a4159a60 0x7f81a4154ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:56.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.206+0000 7f81a2d9d640 1 -- 172.21.15.53:0/102341879 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f818c0094d0 con 0x7f81a4159690 2023-06-10T18:56:56.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.206+0000 7f81a2d9d640 1 --2- 172.21.15.53:0/102341879 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f81a4159690 0x7f81a414f240 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f819400c490 tx=0x7f819400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:56.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.206+0000 7f819b7fe640 1 -- 172.21.15.53:0/102341879 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8194007480 con 0x7f81a4159690 2023-06-10T18:56:56.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.206+0000 7f819b7fe640 1 -- 172.21.15.53:0/102341879 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81940075e0 con 0x7f81a4159690 2023-06-10T18:56:56.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.206+0000 7f81a906c640 1 -- 172.21.15.53:0/102341879 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81a4153750 con 0x7f81a4159690 2023-06-10T18:56:56.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.206+0000 7f819b7fe640 1 -- 172.21.15.53:0/102341879 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8194004a10 con 0x7f81a4159690 2023-06-10T18:56:56.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.206+0000 7f81a906c640 1 -- 172.21.15.53:0/102341879 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81a4153d10 con 0x7f81a4159690 2023-06-10T18:56:56.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.210+0000 7f81a906c640 1 -- 172.21.15.53:0/102341879 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81a40b4dc0 con 0x7f81a4159690 2023-06-10T18:56:56.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.210+0000 7f819b7fe640 1 -- 172.21.15.53:0/102341879 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8194004b70 con 0x7f81a4159690 2023-06-10T18:56:56.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.210+0000 7f819b7fe640 1 --2- 172.21.15.53:0/102341879 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8184066280 0x7f8184068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:56.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.210+0000 7f819b7fe640 1 -- 172.21.15.53:0/102341879 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f8194082f50 con 0x7f81a4159690 2023-06-10T18:56:56.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.210+0000 7f81a259c640 1 --2- 172.21.15.53:0/102341879 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8184066280 0x7f8184068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:56.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.210+0000 7f81a259c640 1 --2- 172.21.15.53:0/102341879 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8184066280 0x7f8184068730 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f818c0ae000 tx=0x7f818c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:56.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.214+0000 7f819b7fe640 1 -- 172.21.15.53:0/102341879 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8194050390 con 0x7f81a4159690 2023-06-10T18:56:56.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.358+0000 7f81a906c640 1 -- 172.21.15.53:0/102341879 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f81a404d790 con 0x7f81a4159690 2023-06-10T18:56:56.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.358+0000 7f819b7fe640 1 -- 172.21.15.53:0/102341879 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v53) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8194018020 con 0x7f81a4159690 2023-06-10T18:56:56.365 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-06-10T18:56:56.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.362+0000 7f81a906c640 1 -- 172.21.15.53:0/102341879 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8184066280 msgr2=0x7f8184068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:56.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.362+0000 7f81a906c640 1 --2- 172.21.15.53:0/102341879 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8184066280 0x7f8184068730 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f818c0ae000 tx=0x7f818c008040 comp rx=0 tx=0).stop 2023-06-10T18:56:56.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.362+0000 7f81a906c640 1 -- 172.21.15.53:0/102341879 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f81a4159690 msgr2=0x7f81a414f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:56.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.362+0000 7f81a906c640 1 --2- 172.21.15.53:0/102341879 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f81a4159690 0x7f81a414f240 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f819400c490 tx=0x7f819400c950 comp rx=0 tx=0).stop 2023-06-10T18:56:56.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.362+0000 7f81a906c640 1 -- 172.21.15.53:0/102341879 shutdown_connections 2023-06-10T18:56:56.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.362+0000 7f81a906c640 1 --2- 172.21.15.53:0/102341879 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8184066280 0x7f8184068730 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:56.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.362+0000 7f81a906c640 1 --2- 172.21.15.53:0/102341879 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f81a4154ff0 0x7f81a40cf090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:56.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.362+0000 7f81a906c640 1 --2- 172.21.15.53:0/102341879 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81a4159a60 0x7f81a4154ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:56.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.362+0000 7f81a906c640 1 --2- 172.21.15.53:0/102341879 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f81a4159690 0x7f81a414f240 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:56.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.362+0000 7f81a906c640 1 -- 172.21.15.53:0/102341879 >> 172.21.15.53:0/102341879 conn(0x7f81a406a560 msgr2=0x7f81a41574b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:56.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.362+0000 7f81a906c640 1 -- 172.21.15.53:0/102341879 shutdown_connections 2023-06-10T18:56:56.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.362+0000 7f81a906c640 1 -- 172.21.15.53:0/102341879 wait complete. 2023-06-10T18:56:56.382 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-10T18:56:56.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.502+0000 7f6ac0aa1640 1 Processor -- start 2023-06-10T18:56:56.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.502+0000 7f6ac0aa1640 1 -- start start 2023-06-10T18:56:56.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.502+0000 7f6ac0aa1640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6abc06b780 0x7f6abc15c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:56.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.502+0000 7f6ac0aa1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6abc06bb50 0x7f6abc15f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:56.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.502+0000 7f6ac0aa1640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6abc0af530 con 0x7f6abc15f860 2023-06-10T18:56:56.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.502+0000 7f6ac0aa1640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6abc15c3d0 con 0x7f6abc06b780 2023-06-10T18:56:56.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.502+0000 7f6ac0aa1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6abc15fd70 con 0x7f6abc06bb50 2023-06-10T18:56:56.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.502+0000 7f6abad9d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f6abc15f860 0x7f6abc0ceb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60498/0 (socket says 172.21.15.53:60498) 2023-06-10T18:56:56.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.502+0000 7f6abad9d640 1 -- 172.21.15.53:0/2804707958 learned_addr learned my addr 172.21.15.53:0/2804707958 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:56:56.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.502+0000 7f6aba59c640 1 --2- 172.21.15.53:0/2804707958 >> v2:172.21.15.117:3300/0 conn(0x7f6abc06b780 0x7f6abc15c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:56.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.502+0000 7f6ab9d9b640 1 --2- 172.21.15.53:0/2804707958 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6abc06bb50 0x7f6abc15f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:56.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.502+0000 7f6ab959a640 1 -- 172.21.15.53:0/2804707958 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2108172317 0 0) 0x7f6abc0af530 con 0x7f6abc15f860 2023-06-10T18:56:56.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.502+0000 7f6ab959a640 1 -- 172.21.15.53:0/2804707958 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6aa4003530 con 0x7f6abc15f860 2023-06-10T18:56:56.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.502+0000 7f6ab959a640 1 -- 172.21.15.53:0/2804707958 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 909189924 0 0) 0x7f6aa4003530 con 0x7f6abc15f860 2023-06-10T18:56:56.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.502+0000 7f6aba59c640 1 -- 172.21.15.53:0/2804707958 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6abc06bb50 msgr2=0x7f6abc15f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:56.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.502+0000 7f6aba59c640 1 --2- 172.21.15.53:0/2804707958 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6abc06bb50 0x7f6abc15f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:56.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.502+0000 7f6aba59c640 1 -- 172.21.15.53:0/2804707958 >> v1:172.21.15.53:6789/0 conn(0x7f6abc15f860 legacy=0x7f6abc0ceb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:56.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.502+0000 7f6aba59c640 1 -- 172.21.15.53:0/2804707958 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6abc160050 con 0x7f6abc06b780 2023-06-10T18:56:56.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.506+0000 7f6aba59c640 1 --2- 172.21.15.53:0/2804707958 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6abc06b780 0x7f6abc15c7f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f6ab4009d90 tx=0x7f6ab401c7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bebf21a0f177ec63 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:56.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.506+0000 7f6ab959a640 1 -- 172.21.15.53:0/2804707958 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aac001680 con 0x7f6abc06b780 2023-06-10T18:56:56.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.506+0000 7f6ab959a640 1 -- 172.21.15.53:0/2804707958 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ab40a5510 con 0x7f6abc06b780 2023-06-10T18:56:56.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.506+0000 7f6ab959a640 1 -- 172.21.15.53:0/2804707958 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab40a58a0 con 0x7f6abc06b780 2023-06-10T18:56:56.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.506+0000 7f6ac0aa1640 1 -- 172.21.15.53:0/2804707958 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6abc06b780 msgr2=0x7f6abc15c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:56.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.506+0000 7f6ac0aa1640 1 --2- 172.21.15.53:0/2804707958 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6abc06b780 0x7f6abc15c7f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f6ab4009d90 tx=0x7f6ab401c7e0 comp rx=0 tx=0).stop 2023-06-10T18:56:56.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.506+0000 7f6ac0aa1640 1 -- 172.21.15.53:0/2804707958 shutdown_connections 2023-06-10T18:56:56.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.506+0000 7f6ac0aa1640 1 --2- 172.21.15.53:0/2804707958 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6abc06bb50 0x7f6abc15f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:56.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.506+0000 7f6ac0aa1640 1 --2- 172.21.15.53:0/2804707958 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6abc06b780 0x7f6abc15c7f0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:56.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.506+0000 7f6ac0aa1640 1 -- 172.21.15.53:0/2804707958 >> 172.21.15.53:0/2804707958 conn(0x7f6abc06a0b0 msgr2=0x7f6abc06d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:56.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.506+0000 7f6ac0aa1640 1 -- 172.21.15.53:0/2804707958 shutdown_connections 2023-06-10T18:56:56.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.506+0000 7f6ac0aa1640 1 -- 172.21.15.53:0/2804707958 wait complete. 2023-06-10T18:56:56.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.510+0000 7f6ac0aa1640 1 Processor -- start 2023-06-10T18:56:56.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.510+0000 7f6ac0aa1640 1 -- start start 2023-06-10T18:56:56.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.510+0000 7f6ac0aa1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6abc06b780 0x7f6abc15dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:56.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.510+0000 7f6ac0aa1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6abc06bb50 0x7f6abc0b4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:56.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.510+0000 7f6ac0aa1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6abc15f860 0x7f6abc0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:56.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.510+0000 7f6ac0aa1640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6abc15ce50 con 0x7f6abc06b780 2023-06-10T18:56:56.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.510+0000 7f6ac0aa1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6abc0b4260 con 0x7f6abc15f860 2023-06-10T18:56:56.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.510+0000 7f6ac0aa1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6abc15d340 con 0x7f6abc06bb50 2023-06-10T18:56:56.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.510+0000 7f6aba59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6abc06b780 0x7f6abc15dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:56.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.510+0000 7f6aba59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6abc06b780 0x7f6abc15dc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37624/0 (socket says 172.21.15.53:37624) 2023-06-10T18:56:56.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.510+0000 7f6aba59c640 1 -- 172.21.15.53:0/4248423735 learned_addr learned my addr 172.21.15.53:0/4248423735 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:56.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.510+0000 7f6ab9d9b640 1 --2- 172.21.15.53:0/4248423735 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6abc06bb50 0x7f6abc0b4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:56.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.510+0000 7f6abad9d640 1 --2- 172.21.15.53:0/4248423735 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6abc15f860 0x7f6abc0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:56.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.510+0000 7f6aba59c640 1 -- 172.21.15.53:0/4248423735 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6abc06bb50 msgr2=0x7f6abc0b4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:56.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.510+0000 7f6aba59c640 1 --2- 172.21.15.53:0/4248423735 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6abc06bb50 0x7f6abc0b4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:56.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.510+0000 7f6aba59c640 1 -- 172.21.15.53:0/4248423735 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6abc15f860 msgr2=0x7f6abc0b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:56.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.510+0000 7f6aba59c640 1 --2- 172.21.15.53:0/4248423735 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6abc15f860 0x7f6abc0b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:56.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.510+0000 7f6aba59c640 1 -- 172.21.15.53:0/4248423735 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab4009a70 con 0x7f6abc06b780 2023-06-10T18:56:56.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.510+0000 7f6abad9d640 1 --2- 172.21.15.53:0/4248423735 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6abc15f860 0x7f6abc0b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:56:56.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.510+0000 7f6aba59c640 1 --2- 172.21.15.53:0/4248423735 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6abc06b780 0x7f6abc15dc90 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f6ab401a410 tx=0x7f6abc0cfa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:56.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.510+0000 7f6aaaffd640 1 -- 172.21.15.53:0/4248423735 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab40ad640 con 0x7f6abc06b780 2023-06-10T18:56:56.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.510+0000 7f6aaaffd640 1 -- 172.21.15.53:0/4248423735 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ab40ad7a0 con 0x7f6abc06b780 2023-06-10T18:56:56.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.510+0000 7f6ac0aa1640 1 -- 172.21.15.53:0/4248423735 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6abc0b0400 con 0x7f6abc06b780 2023-06-10T18:56:56.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.510+0000 7f6aaaffd640 1 -- 172.21.15.53:0/4248423735 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab40adb50 con 0x7f6abc06b780 2023-06-10T18:56:56.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.510+0000 7f6ac0aa1640 1 -- 172.21.15.53:0/4248423735 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6abc15d060 con 0x7f6abc06b780 2023-06-10T18:56:56.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.510+0000 7f6ac0aa1640 1 -- 172.21.15.53:0/4248423735 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6abc072920 con 0x7f6abc06b780 2023-06-10T18:56:56.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.510+0000 7f6aaaffd640 1 -- 172.21.15.53:0/4248423735 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6ab40b4050 con 0x7f6abc06b780 2023-06-10T18:56:56.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.510+0000 7f6aaaffd640 1 --2- 172.21.15.53:0/4248423735 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6a9c066280 0x7f6a9c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:56.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.510+0000 7f6aaaffd640 1 -- 172.21.15.53:0/4248423735 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f6ab411ebe0 con 0x7f6abc06b780 2023-06-10T18:56:56.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.514+0000 7f6ab9d9b640 1 --2- 172.21.15.53:0/4248423735 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6a9c066280 0x7f6a9c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:56.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.514+0000 7f6ab9d9b640 1 --2- 172.21.15.53:0/4248423735 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6a9c066280 0x7f6a9c068730 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f6abc0b0720 tx=0x7f6ab0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:56.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.514+0000 7f6aaaffd640 1 -- 172.21.15.53:0/4248423735 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6ab40ebf80 con 0x7f6abc06b780 2023-06-10T18:56:56.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.682+0000 7f6ac0aa1640 1 -- 172.21.15.53:0/4248423735 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6abc04d790 con 0x7f6abc06b780 2023-06-10T18:56:56.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.682+0000 7f6aaaffd640 1 -- 172.21.15.53:0/4248423735 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v53) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6ab40b2080 con 0x7f6abc06b780 2023-06-10T18:56:56.689 INFO:teuthology.orchestra.run.smithi053.stderr:listed 0 entries 2023-06-10T18:56:56.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.686+0000 7f6ac0aa1640 1 -- 172.21.15.53:0/4248423735 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6a9c066280 msgr2=0x7f6a9c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:56.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.686+0000 7f6ac0aa1640 1 --2- 172.21.15.53:0/4248423735 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6a9c066280 0x7f6a9c068730 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f6abc0b0720 tx=0x7f6ab0008040 comp rx=0 tx=0).stop 2023-06-10T18:56:56.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.686+0000 7f6ac0aa1640 1 -- 172.21.15.53:0/4248423735 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6abc06b780 msgr2=0x7f6abc15dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:56.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.686+0000 7f6ac0aa1640 1 --2- 172.21.15.53:0/4248423735 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6abc06b780 0x7f6abc15dc90 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f6ab401a410 tx=0x7f6abc0cfa40 comp rx=0 tx=0).stop 2023-06-10T18:56:56.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.686+0000 7f6ac0aa1640 1 -- 172.21.15.53:0/4248423735 shutdown_connections 2023-06-10T18:56:56.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.686+0000 7f6ac0aa1640 1 --2- 172.21.15.53:0/4248423735 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6a9c066280 0x7f6a9c068730 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:56.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.686+0000 7f6ac0aa1640 1 --2- 172.21.15.53:0/4248423735 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6abc15f860 0x7f6abc0b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:56.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.686+0000 7f6ac0aa1640 1 --2- 172.21.15.53:0/4248423735 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6abc06bb50 0x7f6abc0b4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:56.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.686+0000 7f6ac0aa1640 1 --2- 172.21.15.53:0/4248423735 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6abc06b780 0x7f6abc15dc90 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:56.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.686+0000 7f6ac0aa1640 1 -- 172.21.15.53:0/4248423735 >> 172.21.15.53:0/4248423735 conn(0x7f6abc06a0b0 msgr2=0x7f6abc1588b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:56.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.686+0000 7f6ac0aa1640 1 -- 172.21.15.53:0/4248423735 shutdown_connections 2023-06-10T18:56:56.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:56.686+0000 7f6ac0aa1640 1 -- 172.21.15.53:0/4248423735 wait complete. 2023-06-10T18:56:56.707 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi117.front.sepia.ceph.com... 2023-06-10T18:56:56.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:56:56.708 DEBUG:teuthology.orchestra.run.smithi117:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-06-10T18:56:56.721 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi117.stderr:ceph-fuse[44292]: fuse finished with error 0 and tester_r 0 2023-06-10T18:56:56.723 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi117.front.sepia.ceph.com 2023-06-10T18:56:56.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:56:56.724 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-06-10T18:56:56.867 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T18:56:56.868 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T18:56:56.874 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16345192k,nr_inodes=4086298,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276544k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=407 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276540k,nr_inodes=819135,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276544k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-06-10T18:56:56.874 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi053.front.sepia.ceph.com 2023-06-10T18:56:56.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:56:56.875 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-06-10T18:56:56.922 INFO:teuthology.orchestra.run.smithi053.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-06-10T18:56:56.923 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-10T18:56:56.924 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T18:56:56.924 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T18:56:56.931 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16342088k,nr_inodes=4085522,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275924k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18845 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275920k,nr_inodes=818980,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275924k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-06-10T18:56:56.931 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi117.front.sepia.ceph.com 2023-06-10T18:56:56.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:56:56.932 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-06-10T18:56:56.978 INFO:teuthology.orchestra.run.smithi117.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-06-10T18:56:56.979 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-10T18:56:56.980 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T18:56:57.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.106+0000 7ff356573640 1 Processor -- start 2023-06-10T18:56:57.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.106+0000 7ff356573640 1 -- start start 2023-06-10T18:56:57.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.110+0000 7ff356573640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff350161180 0x7ff350163560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:57.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.110+0000 7ff356573640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff350158a90 con 0x7ff35006b2f0 2023-06-10T18:56:57.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.110+0000 7ff356573640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff35006f780 con 0x7ff3500c8d00 2023-06-10T18:56:57.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.110+0000 7ff356573640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3500705d0 con 0x7ff350161180 2023-06-10T18:56:57.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.110+0000 7ff34ffff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ff35006b2f0 0x7ff35006f070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60514/0 (socket says 172.21.15.53:60514) 2023-06-10T18:56:57.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.110+0000 7ff34ffff640 1 -- 172.21.15.53:0/1678300771 learned_addr learned my addr 172.21.15.53:0/1678300771 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:56:57.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.110+0000 7ff354b10640 1 --2- 172.21.15.53:0/1678300771 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff350161180 0x7ff350163560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:57.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.110+0000 7ff34effd640 1 -- 172.21.15.53:0/1678300771 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 219073694 0 0) 0x7ff340001120 con 0x7ff35006b2f0 2023-06-10T18:56:57.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.110+0000 7ff34effd640 1 -- 172.21.15.53:0/1678300771 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff338003530 con 0x7ff35006b2f0 2023-06-10T18:56:57.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.110+0000 7ff34effd640 1 -- 172.21.15.53:0/1678300771 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1519526578 0 0) 0x7ff344001120 con 0x7ff3500c8d00 2023-06-10T18:56:57.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.110+0000 7ff34effd640 1 -- 172.21.15.53:0/1678300771 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff340001120 con 0x7ff3500c8d00 2023-06-10T18:56:57.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.110+0000 7ff34effd640 1 -- 172.21.15.53:0/1678300771 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1403580910 0 0) 0x7ff338003530 con 0x7ff35006b2f0 2023-06-10T18:56:57.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.110+0000 7ff34effd640 1 -- 172.21.15.53:0/1678300771 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff350161180 msgr2=0x7ff350163560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:57.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.110+0000 7ff34effd640 1 --2- 172.21.15.53:0/1678300771 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff350161180 0x7ff350163560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:57.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.110+0000 7ff34effd640 1 -- 172.21.15.53:0/1678300771 >> v1:172.21.15.117:6789/0 conn(0x7ff3500c8d00 legacy=0x7ff35006b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:57.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.110+0000 7ff34effd640 1 -- 172.21.15.53:0/1678300771 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3500cce10 con 0x7ff35006b2f0 2023-06-10T18:56:57.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.110+0000 7ff34effd640 1 -- 172.21.15.53:0/1678300771 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7ff340001810 con 0x7ff35006b2f0 2023-06-10T18:56:57.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.110+0000 7ff34effd640 1 -- 172.21.15.53:0/1678300771 >> v1:172.21.15.53:6789/0 conn(0x7ff35006b2f0 legacy=0x7ff35006f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:57.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.110+0000 7ff34effd640 1 --2- 172.21.15.53:0/1678300771 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff338003bb0 0x7ff338003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:57.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.110+0000 7ff34effd640 1 --2- 172.21.15.53:0/1678300771 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3380047d0 0x7ff338004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:57.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.110+0000 7ff34effd640 1 --2- 172.21.15.53:0/1678300771 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff338005180 0x7ff33800dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:57.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.110+0000 7ff34effd640 1 -- 172.21.15.53:0/1678300771 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3500705d0 con 0x7ff3380047d0 2023-06-10T18:56:57.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.110+0000 7ff34effd640 1 -- 172.21.15.53:0/1678300771 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff33800e140 con 0x7ff338005180 2023-06-10T18:56:57.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.110+0000 7ff34effd640 1 -- 172.21.15.53:0/1678300771 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff33800e300 con 0x7ff338003bb0 2023-06-10T18:56:57.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.110+0000 7ff354b10640 1 --2- 172.21.15.53:0/1678300771 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff350161180 0x7ff350163560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-10T18:56:57.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.110+0000 7ff34f7fe640 1 --2- 172.21.15.53:0/1678300771 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3380047d0 0x7ff338004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:57.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.110+0000 7ff34ffff640 1 --2- 172.21.15.53:0/1678300771 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff338003bb0 0x7ff338003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:57.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.110+0000 7ff354b10640 1 --2- 172.21.15.53:0/1678300771 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff338005180 0x7ff33800dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:57.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.110+0000 7ff34f7fe640 1 -- 172.21.15.53:0/1678300771 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff338003bb0 msgr2=0x7ff338003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:57.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.110+0000 7ff34f7fe640 1 --2- 172.21.15.53:0/1678300771 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff338003bb0 0x7ff338003fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:57.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.110+0000 7ff34f7fe640 1 -- 172.21.15.53:0/1678300771 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff338005180 msgr2=0x7ff33800dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:57.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.110+0000 7ff34f7fe640 1 --2- 172.21.15.53:0/1678300771 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff338005180 0x7ff33800dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:57.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.110+0000 7ff34f7fe640 1 -- 172.21.15.53:0/1678300771 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff338003530 con 0x7ff3380047d0 2023-06-10T18:56:57.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.110+0000 7ff354b10640 1 --2- 172.21.15.53:0/1678300771 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff338005180 0x7ff33800dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:56:57.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.114+0000 7ff34f7fe640 1 --2- 172.21.15.53:0/1678300771 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3380047d0 0x7ff338004c40 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7ff3440018b0 tx=0x7ff34401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51b6f6e63f3cac8c server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:57.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.114+0000 7ff34effd640 1 -- 172.21.15.53:0/1678300771 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3440052d0 con 0x7ff3380047d0 2023-06-10T18:56:57.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.114+0000 7ff34effd640 1 -- 172.21.15.53:0/1678300771 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff344005430 con 0x7ff3380047d0 2023-06-10T18:56:57.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.114+0000 7ff34effd640 1 -- 172.21.15.53:0/1678300771 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff344003820 con 0x7ff3380047d0 2023-06-10T18:56:57.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.114+0000 7ff356573640 1 -- 172.21.15.53:0/1678300771 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3380047d0 msgr2=0x7ff338004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:57.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.114+0000 7ff356573640 1 --2- 172.21.15.53:0/1678300771 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3380047d0 0x7ff338004c40 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7ff3440018b0 tx=0x7ff34401c480 comp rx=0 tx=0).stop 2023-06-10T18:56:57.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.114+0000 7ff354b10640 1 -- 172.21.15.53:0/1678300771 reap_dead start 2023-06-10T18:56:57.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.114+0000 7ff356573640 1 -- 172.21.15.53:0/1678300771 shutdown_connections 2023-06-10T18:56:57.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.114+0000 7ff356573640 1 -- 172.21.15.53:0/1678300771 >> 172.21.15.53:0/1678300771 conn(0x7ff35006a0d0 msgr2=0x7ff3500ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:57.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.114+0000 7ff356573640 1 -- 172.21.15.53:0/1678300771 shutdown_connections 2023-06-10T18:56:57.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.114+0000 7ff356573640 1 -- 172.21.15.53:0/1678300771 wait complete. 2023-06-10T18:56:57.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.114+0000 7ff356573640 1 Processor -- start 2023-06-10T18:56:57.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.114+0000 7ff356573640 1 -- start start 2023-06-10T18:56:57.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.114+0000 7ff356573640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff35014ab10 0x7ff3500c5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:57.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.114+0000 7ff356573640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff350147ec0 0x7ff3500b1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:57.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.114+0000 7ff356573640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff3500c6170 0x7ff3500b1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:57.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.114+0000 7ff356573640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3500c72f0 con 0x7ff350147ec0 2023-06-10T18:56:57.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.114+0000 7ff356573640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff350158ff0 con 0x7ff35014ab10 2023-06-10T18:56:57.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.114+0000 7ff356573640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff35014aee0 con 0x7ff3500c6170 2023-06-10T18:56:57.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.118+0000 7ff34f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff350147ec0 0x7ff3500b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:57.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.118+0000 7ff34f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff350147ec0 0x7ff3500b1750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37646/0 (socket says 172.21.15.53:37646) 2023-06-10T18:56:57.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.118+0000 7ff34f7fe640 1 -- 172.21.15.53:0/3371725282 learned_addr learned my addr 172.21.15.53:0/3371725282 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:57.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.118+0000 7ff34ffff640 1 --2- 172.21.15.53:0/3371725282 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff35014ab10 0x7ff3500c5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:57.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.118+0000 7ff354b10640 1 --2- 172.21.15.53:0/3371725282 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff3500c6170 0x7ff3500b1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:57.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.118+0000 7ff34f7fe640 1 -- 172.21.15.53:0/3371725282 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff3500c6170 msgr2=0x7ff3500b1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:57.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.118+0000 7ff34f7fe640 1 --2- 172.21.15.53:0/3371725282 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff3500c6170 0x7ff3500b1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:57.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.118+0000 7ff34f7fe640 1 -- 172.21.15.53:0/3371725282 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff35014ab10 msgr2=0x7ff3500c5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:57.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.118+0000 7ff34f7fe640 1 --2- 172.21.15.53:0/3371725282 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff35014ab10 0x7ff3500c5780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:57.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.118+0000 7ff34f7fe640 1 -- 172.21.15.53:0/3371725282 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3500c6670 con 0x7ff350147ec0 2023-06-10T18:56:57.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.118+0000 7ff34f7fe640 1 --2- 172.21.15.53:0/3371725282 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff350147ec0 0x7ff3500b1750 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7ff34401cd20 tx=0x7ff338005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:57.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.118+0000 7ff34cff9640 1 -- 172.21.15.53:0/3371725282 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff344005270 con 0x7ff350147ec0 2023-06-10T18:56:57.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.118+0000 7ff34cff9640 1 -- 172.21.15.53:0/3371725282 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff344001120 con 0x7ff350147ec0 2023-06-10T18:56:57.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.118+0000 7ff356573640 1 -- 172.21.15.53:0/3371725282 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3500c6950 con 0x7ff350147ec0 2023-06-10T18:56:57.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.118+0000 7ff34cff9640 1 -- 172.21.15.53:0/3371725282 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3440b5650 con 0x7ff350147ec0 2023-06-10T18:56:57.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.118+0000 7ff356573640 1 -- 172.21.15.53:0/3371725282 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3500c6f10 con 0x7ff350147ec0 2023-06-10T18:56:57.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.118+0000 7ff356573640 1 -- 172.21.15.53:0/3371725282 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3500c7430 con 0x7ff350147ec0 2023-06-10T18:56:57.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.118+0000 7ff34cff9640 1 -- 172.21.15.53:0/3371725282 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff3440aa070 con 0x7ff350147ec0 2023-06-10T18:56:57.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.118+0000 7ff34cff9640 1 --2- 172.21.15.53:0/3371725282 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff33c0662b0 0x7ff33c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:57.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.118+0000 7ff34cff9640 1 -- 172.21.15.53:0/3371725282 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6120+0+0 (secure 0 0 0) 0x7ff34411de00 con 0x7ff350147ec0 2023-06-10T18:56:57.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.118+0000 7ff34ffff640 1 --2- 172.21.15.53:0/3371725282 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff33c0662b0 0x7ff33c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:57.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.118+0000 7ff34ffff640 1 --2- 172.21.15.53:0/3371725282 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff33c0662b0 0x7ff33c068760 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff3500b2490 tx=0x7ff340009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:57.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.122+0000 7ff34cff9640 1 -- 172.21.15.53:0/3371725282 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff3500c7430 con 0x7ff350147ec0 2023-06-10T18:56:57.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.310+0000 7ff356573640 1 -- 172.21.15.53:0/3371725282 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff35006f780 con 0x7ff350147ec0 2023-06-10T18:56:57.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.314+0000 7ff34cff9640 1 -- 172.21.15.53:0/3371725282 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+4674 (secure 0 0 0) 0x7ff35006f780 con 0x7ff350147ec0 2023-06-10T18:56:57.318 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:56:57.318 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":20,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5168,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/275593879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":275593879},{"type":"v1","addr":"172.21.15.117:6837","nonce":275593879}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5422,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/2837986258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2837986258},{"type":"v1","addr":"172.21.15.117:6836","nonce":2837986258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5928,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/2789082937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2789082937},{"type":"v1","addr":"172.21.15.53:6833","nonce":2789082937}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T18:56:18.681744+0000","modified":"2023-06-10T18:56:21.825431+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5931},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5931":{"gid":5931,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/3463677034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":3463677034},{"type":"v1","addr":"172.21.15.53:6835","nonce":3463677034}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-06-10T18:56:57.319 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 20 2023-06-10T18:56:57.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.314+0000 7ff356573640 1 -- 172.21.15.53:0/3371725282 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff33c0662b0 msgr2=0x7ff33c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:57.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.314+0000 7ff356573640 1 --2- 172.21.15.53:0/3371725282 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff33c0662b0 0x7ff33c068760 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff3500b2490 tx=0x7ff340009040 comp rx=0 tx=0).stop 2023-06-10T18:56:57.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.314+0000 7ff356573640 1 -- 172.21.15.53:0/3371725282 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff350147ec0 msgr2=0x7ff3500b1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:57.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.314+0000 7ff356573640 1 --2- 172.21.15.53:0/3371725282 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff350147ec0 0x7ff3500b1750 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7ff34401cd20 tx=0x7ff338005800 comp rx=0 tx=0).stop 2023-06-10T18:56:57.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.314+0000 7ff356573640 1 -- 172.21.15.53:0/3371725282 shutdown_connections 2023-06-10T18:56:57.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.314+0000 7ff356573640 1 --2- 172.21.15.53:0/3371725282 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff33c0662b0 0x7ff33c068760 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:57.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.314+0000 7ff356573640 1 --2- 172.21.15.53:0/3371725282 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff3500c6170 0x7ff3500b1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:57.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.314+0000 7ff356573640 1 --2- 172.21.15.53:0/3371725282 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff350147ec0 0x7ff3500b1750 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:57.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.314+0000 7ff356573640 1 --2- 172.21.15.53:0/3371725282 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff35014ab10 0x7ff3500c5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:57.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.314+0000 7ff356573640 1 -- 172.21.15.53:0/3371725282 >> 172.21.15.53:0/3371725282 conn(0x7ff35006a0d0 msgr2=0x7ff3500ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:57.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.314+0000 7ff356573640 1 -- 172.21.15.53:0/3371725282 shutdown_connections 2023-06-10T18:56:57.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.314+0000 7ff356573640 1 -- 172.21.15.53:0/3371725282 wait complete. 2023-06-10T18:56:57.337 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T18:56:57.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.454+0000 7f88e7559640 1 Processor -- start 2023-06-10T18:56:57.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.454+0000 7f88e7559640 1 -- start start 2023-06-10T18:56:57.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.454+0000 7f88e7559640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f88e0071060 0x7f88e00af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:57.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.454+0000 7f88e7559640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f88e00afc60 0x7f88e006b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:57.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.454+0000 7f88e7559640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88e0159b50 con 0x7f88e00c9840 2023-06-10T18:56:57.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.454+0000 7f88e7559640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88e00702a0 con 0x7f88e00afc60 2023-06-10T18:56:57.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.454+0000 7f88e7559640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88e0070580 con 0x7f88e0071060 2023-06-10T18:56:57.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.454+0000 7f88e5af6640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f88e00afc60 0x7f88e006b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:57.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.454+0000 7f88e5af6640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f88e00afc60 0x7f88e006b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37662/0 (socket says 172.21.15.53:37662) 2023-06-10T18:56:57.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.454+0000 7f88e5af6640 1 -- 172.21.15.53:0/4080544908 learned_addr learned my addr 172.21.15.53:0/4080544908 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:57.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.454+0000 7f88e4af4640 1 --2- 172.21.15.53:0/4080544908 >> v2:172.21.15.117:3300/0 conn(0x7f88e0071060 0x7f88e00af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:57.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.454+0000 7f88e5af6640 1 -- 172.21.15.53:0/4080544908 >> v2:172.21.15.117:3300/0 conn(0x7f88e0071060 msgr2=0x7f88e00af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:57.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.454+0000 7f88e5af6640 1 --2- 172.21.15.53:0/4080544908 >> v2:172.21.15.117:3300/0 conn(0x7f88e0071060 0x7f88e00af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:57.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.454+0000 7f88e5af6640 1 -- 172.21.15.53:0/4080544908 >> v1:172.21.15.117:6789/0 conn(0x7f88e00c9840 legacy=0x7f88e00c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:57.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.454+0000 7f88e5af6640 1 -- 172.21.15.53:0/4080544908 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88e0070860 con 0x7f88e00afc60 2023-06-10T18:56:57.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.458+0000 7f88e5af6640 1 --2- 172.21.15.53:0/4080544908 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88e00afc60 0x7f88e006b090 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f88e006e650 tx=0x7f88d801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=322a19ca0b6119b server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:57.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.458+0000 7f88d7fff640 1 -- 172.21.15.53:0/4080544908 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d80a5880 con 0x7f88e00afc60 2023-06-10T18:56:57.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.458+0000 7f88d7fff640 1 -- 172.21.15.53:0/4080544908 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88d80a59e0 con 0x7f88e00afc60 2023-06-10T18:56:57.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.458+0000 7f88d7fff640 1 -- 172.21.15.53:0/4080544908 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d80a5d70 con 0x7f88e00afc60 2023-06-10T18:56:57.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.458+0000 7f88e7559640 1 -- 172.21.15.53:0/4080544908 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88e00afc60 msgr2=0x7f88e006b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:57.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.458+0000 7f88e7559640 1 --2- 172.21.15.53:0/4080544908 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88e00afc60 0x7f88e006b090 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f88e006e650 tx=0x7f88d801c9a0 comp rx=0 tx=0).stop 2023-06-10T18:56:57.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.458+0000 7f88e7559640 1 -- 172.21.15.53:0/4080544908 shutdown_connections 2023-06-10T18:56:57.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.458+0000 7f88e7559640 1 --2- 172.21.15.53:0/4080544908 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88e00afc60 0x7f88e006b090 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:57.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.458+0000 7f88e7559640 1 --2- 172.21.15.53:0/4080544908 >> v2:172.21.15.117:3300/0 conn(0x7f88e0071060 0x7f88e00af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:57.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.458+0000 7f88e7559640 1 -- 172.21.15.53:0/4080544908 >> 172.21.15.53:0/4080544908 conn(0x7f88e006a0d0 msgr2=0x7f88e00ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:57.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.458+0000 7f88e7559640 1 -- 172.21.15.53:0/4080544908 shutdown_connections 2023-06-10T18:56:57.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.458+0000 7f88e7559640 1 -- 172.21.15.53:0/4080544908 wait complete. 2023-06-10T18:56:57.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.458+0000 7f88e7559640 1 Processor -- start 2023-06-10T18:56:57.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.458+0000 7f88e7559640 1 -- start start 2023-06-10T18:56:57.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.458+0000 7f88e7559640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88e0071060 0x7f88e0146a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:57.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.458+0000 7f88e7559640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88e00afc60 0x7f88e01584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:57.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.458+0000 7f88e7559640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88e00c9840 0x7f88e0151130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:57.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.458+0000 7f88e7559640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88e0152320 con 0x7f88e00c9840 2023-06-10T18:56:57.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.458+0000 7f88e7559640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88e00b0e40 con 0x7f88e00afc60 2023-06-10T18:56:57.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.458+0000 7f88e7559640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88e00c1870 con 0x7f88e0071060 2023-06-10T18:56:57.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.458+0000 7f88e5af6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88e00c9840 0x7f88e0151130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:57.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.458+0000 7f88e5af6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88e00c9840 0x7f88e0151130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37668/0 (socket says 172.21.15.53:37668) 2023-06-10T18:56:57.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.458+0000 7f88e5af6640 1 -- 172.21.15.53:0/1971864437 learned_addr learned my addr 172.21.15.53:0/1971864437 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:57.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.458+0000 7f88e4af4640 1 --2- 172.21.15.53:0/1971864437 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88e00afc60 0x7f88e01584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:57.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.458+0000 7f88e52f5640 1 --2- 172.21.15.53:0/1971864437 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88e0071060 0x7f88e0146a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:57.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.458+0000 7f88e5af6640 1 -- 172.21.15.53:0/1971864437 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88e0071060 msgr2=0x7f88e0146a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:57.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.458+0000 7f88e5af6640 1 --2- 172.21.15.53:0/1971864437 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88e0071060 0x7f88e0146a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:57.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.458+0000 7f88e5af6640 1 -- 172.21.15.53:0/1971864437 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88e00afc60 msgr2=0x7f88e01584d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:57.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.458+0000 7f88e5af6640 1 --2- 172.21.15.53:0/1971864437 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88e00afc60 0x7f88e01584d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:57.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.458+0000 7f88e5af6640 1 -- 172.21.15.53:0/1971864437 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88d8009b30 con 0x7f88e00c9840 2023-06-10T18:56:57.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.458+0000 7f88e52f5640 1 --2- 172.21.15.53:0/1971864437 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88e0071060 0x7f88e0146a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:56:57.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.462+0000 7f88e5af6640 1 --2- 172.21.15.53:0/1971864437 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88e00c9840 0x7f88e0151130 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f88d80195b0 tx=0x7f88d8019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:57.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.462+0000 7f88d5ffb640 1 -- 172.21.15.53:0/1971864437 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d80b8670 con 0x7f88e00c9840 2023-06-10T18:56:57.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.462+0000 7f88d5ffb640 1 -- 172.21.15.53:0/1971864437 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88d80b87f0 con 0x7f88e00c9840 2023-06-10T18:56:57.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.462+0000 7f88d5ffb640 1 -- 172.21.15.53:0/1971864437 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d80b8ba0 con 0x7f88e00c9840 2023-06-10T18:56:57.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.462+0000 7f88e7559640 1 -- 172.21.15.53:0/1971864437 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88e00c1b50 con 0x7f88e00c9840 2023-06-10T18:56:57.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.462+0000 7f88e7559640 1 -- 172.21.15.53:0/1971864437 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88e00b0ad0 con 0x7f88e00c9840 2023-06-10T18:56:57.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.462+0000 7f88e7559640 1 -- 172.21.15.53:0/1971864437 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88e004d790 con 0x7f88e00c9840 2023-06-10T18:56:57.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.462+0000 7f88d5ffb640 1 -- 172.21.15.53:0/1971864437 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f88d80b8d00 con 0x7f88e00c9840 2023-06-10T18:56:57.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.462+0000 7f88d5ffb640 1 --2- 172.21.15.53:0/1971864437 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f88c4066280 0x7f88c4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:57.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.462+0000 7f88d5ffb640 1 -- 172.21.15.53:0/1971864437 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f88d811f550 con 0x7f88e00c9840 2023-06-10T18:56:57.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.462+0000 7f88e52f5640 1 --2- 172.21.15.53:0/1971864437 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f88c4066280 0x7f88c4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:57.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.462+0000 7f88e52f5640 1 --2- 172.21.15.53:0/1971864437 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f88c4066280 0x7f88c4068730 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f88d0000f70 tx=0x7f88d0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:57.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.466+0000 7f88d5ffb640 1 -- 172.21.15.53:0/1971864437 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f88d80ecab0 con 0x7f88e00c9840 2023-06-10T18:56:57.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.622+0000 7f88e7559640 1 -- 172.21.15.53:0/1971864437 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f88e00c2000 con 0x7f88e00c9840 2023-06-10T18:56:57.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.622+0000 7f88d5ffb640 1 -- 172.21.15.53:0/1971864437 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+18434 (secure 0 0 0) 0x7f88d80f00d0 con 0x7f88e00c9840 2023-06-10T18:56:57.628 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:56:57.628 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":53,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T18:56:27.877880+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-06-10T18:56:16.364582+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-06-10T18:56:17.656793+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.e","mappings":[{"from":0,"to":6}]},{"pgid":"8.1d","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T18:56:57.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.626+0000 7f88e7559640 1 -- 172.21.15.53:0/1971864437 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f88c4066280 msgr2=0x7f88c4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:57.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.626+0000 7f88e7559640 1 --2- 172.21.15.53:0/1971864437 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f88c4066280 0x7f88c4068730 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f88d0000f70 tx=0x7f88d0009040 comp rx=0 tx=0).stop 2023-06-10T18:56:57.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.626+0000 7f88e7559640 1 -- 172.21.15.53:0/1971864437 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88e00c9840 msgr2=0x7f88e0151130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:57.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.626+0000 7f88e7559640 1 --2- 172.21.15.53:0/1971864437 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88e00c9840 0x7f88e0151130 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f88d80195b0 tx=0x7f88d8019740 comp rx=0 tx=0).stop 2023-06-10T18:56:57.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.626+0000 7f88e7559640 1 -- 172.21.15.53:0/1971864437 shutdown_connections 2023-06-10T18:56:57.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.626+0000 7f88e7559640 1 --2- 172.21.15.53:0/1971864437 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f88c4066280 0x7f88c4068730 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:57.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.626+0000 7f88e7559640 1 --2- 172.21.15.53:0/1971864437 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88e00c9840 0x7f88e0151130 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:57.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.626+0000 7f88e7559640 1 --2- 172.21.15.53:0/1971864437 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88e00afc60 0x7f88e01584d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:57.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.626+0000 7f88e7559640 1 --2- 172.21.15.53:0/1971864437 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88e0071060 0x7f88e0146a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:57.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.626+0000 7f88e7559640 1 -- 172.21.15.53:0/1971864437 >> 172.21.15.53:0/1971864437 conn(0x7f88e006a0d0 msgr2=0x7f88e00ae200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:57.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.626+0000 7f88e7559640 1 -- 172.21.15.53:0/1971864437 shutdown_connections 2023-06-10T18:56:57.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.626+0000 7f88e7559640 1 -- 172.21.15.53:0/1971864437 wait complete. 2023-06-10T18:56:57.647 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-10T18:52:33.633114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-10T18:52:39.171487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-10T18:56:16.364582+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2023-06-10T18:56:17.656793+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '51', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-10T18:56:57.648 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-10T18:56:57.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.762+0000 7f0932eac640 1 Processor -- start 2023-06-10T18:56:57.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.766+0000 7f0932eac640 1 -- start start 2023-06-10T18:56:57.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.766+0000 7f0932eac640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f092c0b0b90 0x7f092c0b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:57.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.766+0000 7f0932eac640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f092c0cc7c0 con 0x7f092c0b7e30 2023-06-10T18:56:57.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.766+0000 7f0932eac640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f092c0ccaa0 con 0x7f092c15c090 2023-06-10T18:56:57.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.766+0000 7f0932eac640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f092c0ccd80 con 0x7f092c0b0b90 2023-06-10T18:56:57.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.766+0000 7f092bfff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f092c0b7e30 0x7f092c0d04d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60518/0 (socket says 172.21.15.53:60518) 2023-06-10T18:56:57.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.766+0000 7f092bfff640 1 -- 172.21.15.53:0/2915510173 learned_addr learned my addr 172.21.15.53:0/2915510173 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:56:57.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.766+0000 7f0931449640 1 --2- 172.21.15.53:0/2915510173 >> v2:172.21.15.117:3300/0 conn(0x7f092c0b0b90 0x7f092c0b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:57.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.766+0000 7f092b7fe640 1 -- 172.21.15.53:0/2915510173 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3318010620 0 0) 0x7f092c0cc7c0 con 0x7f092c0b7e30 2023-06-10T18:56:57.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.766+0000 7f092b7fe640 1 -- 172.21.15.53:0/2915510173 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0914003530 con 0x7f092c0b7e30 2023-06-10T18:56:57.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.766+0000 7f092b7fe640 1 -- 172.21.15.53:0/2915510173 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4256676050 0 0) 0x7f0914003530 con 0x7f092c0b7e30 2023-06-10T18:56:57.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.766+0000 7f092b7fe640 1 -- 172.21.15.53:0/2915510173 >> v2:172.21.15.117:3300/0 conn(0x7f092c0b0b90 msgr2=0x7f092c0b10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:57.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.766+0000 7f092b7fe640 1 --2- 172.21.15.53:0/2915510173 >> v2:172.21.15.117:3300/0 conn(0x7f092c0b0b90 0x7f092c0b10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:57.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.766+0000 7f092b7fe640 1 -- 172.21.15.53:0/2915510173 >> v1:172.21.15.117:6789/0 conn(0x7f092c15c090 legacy=0x7f092c0b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:57.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.766+0000 7f092b7fe640 1 -- 172.21.15.53:0/2915510173 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f092c0cd060 con 0x7f092c0b7e30 2023-06-10T18:56:57.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.766+0000 7f092b7fe640 1 -- 172.21.15.53:0/2915510173 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f0920001680 con 0x7f092c0b7e30 2023-06-10T18:56:57.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.766+0000 7f092b7fe640 1 -- 172.21.15.53:0/2915510173 >> v1:172.21.15.53:6789/0 conn(0x7f092c0b7e30 legacy=0x7f092c0d04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:57.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.766+0000 7f092b7fe640 1 --2- 172.21.15.53:0/2915510173 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0914003980 0x7f0914003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:57.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.766+0000 7f092b7fe640 1 --2- 172.21.15.53:0/2915510173 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09140047d0 0x7f0914004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:57.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.766+0000 7f092b7fe640 1 --2- 172.21.15.53:0/2915510173 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0914005180 0x7f091400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:57.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.766+0000 7f092b7fe640 1 -- 172.21.15.53:0/2915510173 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f092c0ccd80 con 0x7f0914003980 2023-06-10T18:56:57.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.766+0000 7f092b7fe640 1 -- 172.21.15.53:0/2915510173 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f091400c090 con 0x7f0914005180 2023-06-10T18:56:57.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.766+0000 7f092b7fe640 1 -- 172.21.15.53:0/2915510173 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f091400c250 con 0x7f09140047d0 2023-06-10T18:56:57.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.766+0000 7f0930c48640 1 --2- 172.21.15.53:0/2915510173 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0914003980 0x7f0914003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:57.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.766+0000 7f0931449640 1 --2- 172.21.15.53:0/2915510173 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0914005180 0x7f091400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:57.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.766+0000 7f0930c48640 1 -- 172.21.15.53:0/2915510173 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09140047d0 msgr2=0x7f0914004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:57.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.766+0000 7f0930c48640 1 --2- 172.21.15.53:0/2915510173 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09140047d0 0x7f0914004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:57.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.766+0000 7f0930c48640 1 -- 172.21.15.53:0/2915510173 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0914005180 msgr2=0x7f091400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:57.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.766+0000 7f0930c48640 1 --2- 172.21.15.53:0/2915510173 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0914005180 0x7f091400b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:57.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.766+0000 7f0930c48640 1 -- 172.21.15.53:0/2915510173 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0914003530 con 0x7f0914003980 2023-06-10T18:56:57.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.766+0000 7f0931449640 1 -- 172.21.15.53:0/2915510173 reap_dead start 2023-06-10T18:56:57.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.770+0000 7f0930c48640 1 --2- 172.21.15.53:0/2915510173 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0914003980 0x7f0914003d90 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f091c001780 tx=0x7f091c01c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a1026bb2c7f3c37 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:57.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.770+0000 7f092b7fe640 1 -- 172.21.15.53:0/2915510173 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091c0052d0 con 0x7f0914003980 2023-06-10T18:56:57.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.770+0000 7f092b7fe640 1 -- 172.21.15.53:0/2915510173 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f091c0a7050 con 0x7f0914003980 2023-06-10T18:56:57.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.770+0000 7f092b7fe640 1 -- 172.21.15.53:0/2915510173 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091c003600 con 0x7f0914003980 2023-06-10T18:56:57.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.770+0000 7f0932eac640 1 -- 172.21.15.53:0/2915510173 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0914003980 msgr2=0x7f0914003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:57.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.770+0000 7f0932eac640 1 --2- 172.21.15.53:0/2915510173 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0914003980 0x7f0914003d90 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f091c001780 tx=0x7f091c01c3b0 comp rx=0 tx=0).stop 2023-06-10T18:56:57.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.770+0000 7f0932eac640 1 -- 172.21.15.53:0/2915510173 shutdown_connections 2023-06-10T18:56:57.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.770+0000 7f0932eac640 1 --2- 172.21.15.53:0/2915510173 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0914003980 0x7f0914003d90 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:57.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.770+0000 7f0932eac640 1 -- 172.21.15.53:0/2915510173 >> 172.21.15.53:0/2915510173 conn(0x7f092c069e20 msgr2=0x7f092c06a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:57.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.770+0000 7f0932eac640 1 -- 172.21.15.53:0/2915510173 shutdown_connections 2023-06-10T18:56:57.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.770+0000 7f0932eac640 1 -- 172.21.15.53:0/2915510173 wait complete. 2023-06-10T18:56:57.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.770+0000 7f0932eac640 1 Processor -- start 2023-06-10T18:56:57.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.770+0000 7f0932eac640 1 -- start start 2023-06-10T18:56:57.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.770+0000 7f0932eac640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0914003980 0x7f092c15cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:57.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.770+0000 7f0932eac640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f092c0c8540 0x7f092c15ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:57.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.770+0000 7f0932eac640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f092c1f5b10 0x7f092c0cb0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:57.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.770+0000 7f0932eac640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f092c15f740 con 0x7f092c1f5b10 2023-06-10T18:56:57.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.770+0000 7f0932eac640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f092c15f4a0 con 0x7f092c0c8540 2023-06-10T18:56:57.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.770+0000 7f0932eac640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f092c0ca320 con 0x7f0914003980 2023-06-10T18:56:57.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.770+0000 7f0931449640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f092c1f5b10 0x7f092c0cb0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:57.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.770+0000 7f0931449640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f092c1f5b10 0x7f092c0cb0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37680/0 (socket says 172.21.15.53:37680) 2023-06-10T18:56:57.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.770+0000 7f0931449640 1 -- 172.21.15.53:0/785433777 learned_addr learned my addr 172.21.15.53:0/785433777 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:57.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.770+0000 7f092bfff640 1 --2- 172.21.15.53:0/785433777 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f092c0c8540 0x7f092c15ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:57.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.770+0000 7f0930c48640 1 --2- 172.21.15.53:0/785433777 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0914003980 0x7f092c15cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:57.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.770+0000 7f0931449640 1 -- 172.21.15.53:0/785433777 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0914003980 msgr2=0x7f092c15cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:57.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.770+0000 7f0931449640 1 --2- 172.21.15.53:0/785433777 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0914003980 0x7f092c15cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:57.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.770+0000 7f0931449640 1 -- 172.21.15.53:0/785433777 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f092c0c8540 msgr2=0x7f092c15ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:57.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.770+0000 7f0931449640 1 --2- 172.21.15.53:0/785433777 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f092c0c8540 0x7f092c15ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:57.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.770+0000 7f0931449640 1 -- 172.21.15.53:0/785433777 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f092c0ca600 con 0x7f092c1f5b10 2023-06-10T18:56:57.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.770+0000 7f092bfff640 1 --2- 172.21.15.53:0/785433777 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f092c0c8540 0x7f092c15ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:56:57.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.770+0000 7f0931449640 1 --2- 172.21.15.53:0/785433777 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f092c1f5b10 0x7f092c0cb0e0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f092c08b310 tx=0x7f0924009f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:57.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.774+0000 7f09297fa640 1 -- 172.21.15.53:0/785433777 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f092400f8a0 con 0x7f092c1f5b10 2023-06-10T18:56:57.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.774+0000 7f09297fa640 1 -- 172.21.15.53:0/785433777 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f092400fa20 con 0x7f092c1f5b10 2023-06-10T18:56:57.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.774+0000 7f0932eac640 1 -- 172.21.15.53:0/785433777 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f092c0ca8e0 con 0x7f092c1f5b10 2023-06-10T18:56:57.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.774+0000 7f09297fa640 1 -- 172.21.15.53:0/785433777 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f092400fdd0 con 0x7f092c1f5b10 2023-06-10T18:56:57.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.774+0000 7f0932eac640 1 -- 172.21.15.53:0/785433777 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f092c0c89b0 con 0x7f092c1f5b10 2023-06-10T18:56:57.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.774+0000 7f0932eac640 1 -- 172.21.15.53:0/785433777 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f092c0b1770 con 0x7f092c1f5b10 2023-06-10T18:56:57.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.774+0000 7f09297fa640 1 -- 172.21.15.53:0/785433777 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0924016420 con 0x7f092c1f5b10 2023-06-10T18:56:57.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.774+0000 7f09297fa640 1 --2- 172.21.15.53:0/785433777 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f09180662b0 0x7f0918068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:57.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.774+0000 7f09297fa640 1 -- 172.21.15.53:0/785433777 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f0924084280 con 0x7f092c1f5b10 2023-06-10T18:56:57.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.774+0000 7f0930c48640 1 --2- 172.21.15.53:0/785433777 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f09180662b0 0x7f0918068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:57.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.774+0000 7f0930c48640 1 --2- 172.21.15.53:0/785433777 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f09180662b0 0x7f0918068760 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f091c001750 tx=0x7f091c0011a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:57.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.778+0000 7f09297fa640 1 -- 172.21.15.53:0/785433777 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0924051750 con 0x7f092c1f5b10 2023-06-10T18:56:57.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.930+0000 7f0932eac640 1 -- 172.21.15.53:0/785433777 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f092c04d790 con 0x7f092c1f5b10 2023-06-10T18:56:57.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.930+0000 7f09297fa640 1 -- 172.21.15.53:0/785433777 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v53) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0924054d70 con 0x7f092c1f5b10 2023-06-10T18:56:57.936 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-06-10T18:56:57.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.934+0000 7f0932eac640 1 -- 172.21.15.53:0/785433777 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f09180662b0 msgr2=0x7f0918068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:57.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.934+0000 7f0932eac640 1 --2- 172.21.15.53:0/785433777 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f09180662b0 0x7f0918068760 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f091c001750 tx=0x7f091c0011a0 comp rx=0 tx=0).stop 2023-06-10T18:56:57.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.934+0000 7f0932eac640 1 -- 172.21.15.53:0/785433777 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f092c1f5b10 msgr2=0x7f092c0cb0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:57.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.934+0000 7f0932eac640 1 --2- 172.21.15.53:0/785433777 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f092c1f5b10 0x7f092c0cb0e0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f092c08b310 tx=0x7f0924009f50 comp rx=0 tx=0).stop 2023-06-10T18:56:57.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.934+0000 7f0932eac640 1 -- 172.21.15.53:0/785433777 shutdown_connections 2023-06-10T18:56:57.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.934+0000 7f0932eac640 1 --2- 172.21.15.53:0/785433777 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f09180662b0 0x7f0918068760 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:57.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.934+0000 7f0932eac640 1 --2- 172.21.15.53:0/785433777 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f092c1f5b10 0x7f092c0cb0e0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:57.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.934+0000 7f0932eac640 1 --2- 172.21.15.53:0/785433777 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f092c0c8540 0x7f092c15ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:57.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.934+0000 7f0932eac640 1 --2- 172.21.15.53:0/785433777 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0914003980 0x7f092c15cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:57.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.934+0000 7f0932eac640 1 -- 172.21.15.53:0/785433777 >> 172.21.15.53:0/785433777 conn(0x7f092c069e20 msgr2=0x7f092c0cd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:57.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.934+0000 7f0932eac640 1 -- 172.21.15.53:0/785433777 shutdown_connections 2023-06-10T18:56:57.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:57.934+0000 7f0932eac640 1 -- 172.21.15.53:0/785433777 wait complete. 2023-06-10T18:56:57.954 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-10T18:56:58.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.066+0000 7fc9c6c67640 1 Processor -- start 2023-06-10T18:56:58.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.066+0000 7fc9c6c67640 1 -- start start 2023-06-10T18:56:58.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.066+0000 7fc9c6c67640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc9c0070de0 0x7fc9c015cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:58.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.066+0000 7fc9c6c67640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9c00c8d50 con 0x7fc9c015c060 2023-06-10T18:56:58.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.066+0000 7fc9c6c67640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9c00c9030 con 0x7fc9c00cc020 2023-06-10T18:56:58.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.066+0000 7fc9c6c67640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9c0070300 con 0x7fc9c0070de0 2023-06-10T18:56:58.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.070+0000 7fc9c4a03640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fc9c015c060 0x7fc9c015c430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60534/0 (socket says 172.21.15.53:60534) 2023-06-10T18:56:58.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.070+0000 7fc9c4a03640 1 -- 172.21.15.53:0/4289896354 learned_addr learned my addr 172.21.15.53:0/4289896354 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:56:58.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.070+0000 7fc9bffff640 1 --2- 172.21.15.53:0/4289896354 >> v2:172.21.15.117:3300/0 conn(0x7fc9c0070de0 0x7fc9c015cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:58.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.070+0000 7fc9bf7fe640 1 -- 172.21.15.53:0/4289896354 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1262867935 0 0) 0x7fc9c00c8d50 con 0x7fc9c015c060 2023-06-10T18:56:58.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.070+0000 7fc9bf7fe640 1 -- 172.21.15.53:0/4289896354 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9ac003530 con 0x7fc9c015c060 2023-06-10T18:56:58.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.070+0000 7fc9bf7fe640 1 -- 172.21.15.53:0/4289896354 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3475406085 0 0) 0x7fc9ac003530 con 0x7fc9c015c060 2023-06-10T18:56:58.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.070+0000 7fc9bf7fe640 1 -- 172.21.15.53:0/4289896354 >> v2:172.21.15.117:3300/0 conn(0x7fc9c0070de0 msgr2=0x7fc9c015cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:58.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.070+0000 7fc9bf7fe640 1 --2- 172.21.15.53:0/4289896354 >> v2:172.21.15.117:3300/0 conn(0x7fc9c0070de0 0x7fc9c015cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:58.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.070+0000 7fc9bf7fe640 1 -- 172.21.15.53:0/4289896354 >> v1:172.21.15.117:6789/0 conn(0x7fc9c00cc020 legacy=0x7fc9c006bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:58.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.070+0000 7fc9bf7fe640 1 -- 172.21.15.53:0/4289896354 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c00705e0 con 0x7fc9c015c060 2023-06-10T18:56:58.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.070+0000 7fc9bf7fe640 1 -- 172.21.15.53:0/4289896354 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fc9b8001680 con 0x7fc9c015c060 2023-06-10T18:56:58.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.070+0000 7fc9bf7fe640 1 -- 172.21.15.53:0/4289896354 >> v1:172.21.15.53:6789/0 conn(0x7fc9c015c060 legacy=0x7fc9c015c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:58.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.070+0000 7fc9bf7fe640 1 --2- 172.21.15.53:0/4289896354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9ac003980 0x7fc9ac003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:58.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.070+0000 7fc9bf7fe640 1 --2- 172.21.15.53:0/4289896354 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9ac0047d0 0x7fc9ac004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:58.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.070+0000 7fc9bf7fe640 1 --2- 172.21.15.53:0/4289896354 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9ac005180 0x7fc9ac00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:58.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.070+0000 7fc9bf7fe640 1 -- 172.21.15.53:0/4289896354 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c0070300 con 0x7fc9ac003980 2023-06-10T18:56:58.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.070+0000 7fc9bf7fe640 1 -- 172.21.15.53:0/4289896354 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ac00c090 con 0x7fc9ac0047d0 2023-06-10T18:56:58.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.070+0000 7fc9bf7fe640 1 -- 172.21.15.53:0/4289896354 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ac00c250 con 0x7fc9ac005180 2023-06-10T18:56:58.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.070+0000 7fc9c4a03640 1 --2- 172.21.15.53:0/4289896354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9ac003980 0x7fc9ac003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:58.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.070+0000 7fc9c4a03640 1 -- 172.21.15.53:0/4289896354 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9ac005180 msgr2=0x7fc9ac00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:58.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.070+0000 7fc9c4a03640 1 --2- 172.21.15.53:0/4289896354 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9ac005180 0x7fc9ac00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:58.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.070+0000 7fc9c4a03640 1 -- 172.21.15.53:0/4289896354 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9ac0047d0 msgr2=0x7fc9ac004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:58.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.070+0000 7fc9c4a03640 1 --2- 172.21.15.53:0/4289896354 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9ac0047d0 0x7fc9ac004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:58.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.070+0000 7fc9c4a03640 1 -- 172.21.15.53:0/4289896354 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9ac003530 con 0x7fc9ac003980 2023-06-10T18:56:58.079 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.070+0000 7fc9c5204640 1 -- 172.21.15.53:0/4289896354 reap_dead start 2023-06-10T18:56:58.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.070+0000 7fc9c4a03640 1 --2- 172.21.15.53:0/4289896354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9ac003980 0x7fc9ac003d90 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fc9b800c240 tx=0x7fc9b801cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4517fdbf3fc963ae server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:58.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.070+0000 7fc9bf7fe640 1 -- 172.21.15.53:0/4289896354 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b8005ae0 con 0x7fc9ac003980 2023-06-10T18:56:58.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.070+0000 7fc9bf7fe640 1 -- 172.21.15.53:0/4289896354 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b8005c40 con 0x7fc9ac003980 2023-06-10T18:56:58.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.070+0000 7fc9bf7fe640 1 -- 172.21.15.53:0/4289896354 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b80a5a80 con 0x7fc9ac003980 2023-06-10T18:56:58.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.070+0000 7fc9c6c67640 1 -- 172.21.15.53:0/4289896354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9ac003980 msgr2=0x7fc9ac003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:58.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.070+0000 7fc9c6c67640 1 --2- 172.21.15.53:0/4289896354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9ac003980 0x7fc9ac003d90 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fc9b800c240 tx=0x7fc9b801cbf0 comp rx=0 tx=0).stop 2023-06-10T18:56:58.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.070+0000 7fc9c6c67640 1 -- 172.21.15.53:0/4289896354 shutdown_connections 2023-06-10T18:56:58.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.070+0000 7fc9c6c67640 1 --2- 172.21.15.53:0/4289896354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9ac003980 0x7fc9ac003d90 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:58.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.070+0000 7fc9c6c67640 1 -- 172.21.15.53:0/4289896354 >> 172.21.15.53:0/4289896354 conn(0x7fc9c006a0e0 msgr2=0x7fc9c00cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:58.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.074+0000 7fc9c6c67640 1 -- 172.21.15.53:0/4289896354 shutdown_connections 2023-06-10T18:56:58.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.074+0000 7fc9c6c67640 1 -- 172.21.15.53:0/4289896354 wait complete. 2023-06-10T18:56:58.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.074+0000 7fc9c6c67640 1 Processor -- start 2023-06-10T18:56:58.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.074+0000 7fc9c6c67640 1 -- start start 2023-06-10T18:56:58.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.074+0000 7fc9c6c67640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9ac003980 0x7fc9c00c65e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:58.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.074+0000 7fc9c6c67640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9c01f4380 0x7fc9c01f6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:58.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.074+0000 7fc9c6c67640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9c01f74f0 0x7fc9c00c3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:58.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.074+0000 7fc9c6c67640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c01f7960 con 0x7fc9ac003980 2023-06-10T18:56:58.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.074+0000 7fc9c6c67640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c00c6150 con 0x7fc9c01f74f0 2023-06-10T18:56:58.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.074+0000 7fc9c6c67640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c00c5540 con 0x7fc9c01f4380 2023-06-10T18:56:58.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.074+0000 7fc9c4a03640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9ac003980 0x7fc9c00c65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:58.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.074+0000 7fc9c4a03640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9ac003980 0x7fc9c00c65e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37696/0 (socket says 172.21.15.53:37696) 2023-06-10T18:56:58.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.074+0000 7fc9c4a03640 1 -- 172.21.15.53:0/3656360942 learned_addr learned my addr 172.21.15.53:0/3656360942 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:58.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.074+0000 7fc9c5204640 1 --2- 172.21.15.53:0/3656360942 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9c01f74f0 0x7fc9c00c3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:58.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.074+0000 7fc9bffff640 1 --2- 172.21.15.53:0/3656360942 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9c01f4380 0x7fc9c01f6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:58.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.074+0000 7fc9c4a03640 1 -- 172.21.15.53:0/3656360942 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9c01f4380 msgr2=0x7fc9c01f6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:58.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.074+0000 7fc9c4a03640 1 --2- 172.21.15.53:0/3656360942 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9c01f4380 0x7fc9c01f6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:58.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.074+0000 7fc9c4a03640 1 -- 172.21.15.53:0/3656360942 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9c01f74f0 msgr2=0x7fc9c00c3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:58.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.074+0000 7fc9c4a03640 1 --2- 172.21.15.53:0/3656360942 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9c01f74f0 0x7fc9c00c3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:58.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.074+0000 7fc9c4a03640 1 -- 172.21.15.53:0/3656360942 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c0158950 con 0x7fc9ac003980 2023-06-10T18:56:58.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.074+0000 7fc9c4a03640 1 --2- 172.21.15.53:0/3656360942 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9ac003980 0x7fc9c00c65e0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fc9b801b2f0 tx=0x7fc9ac005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:58.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.074+0000 7fc9bd7fa640 1 -- 172.21.15.53:0/3656360942 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b80b4070 con 0x7fc9ac003980 2023-06-10T18:56:58.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.074+0000 7fc9bd7fa640 1 -- 172.21.15.53:0/3656360942 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b8001540 con 0x7fc9ac003980 2023-06-10T18:56:58.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.074+0000 7fc9c6c67640 1 -- 172.21.15.53:0/3656360942 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9c00c5820 con 0x7fc9ac003980 2023-06-10T18:56:58.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.074+0000 7fc9bd7fa640 1 -- 172.21.15.53:0/3656360942 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b80a5a60 con 0x7fc9ac003980 2023-06-10T18:56:58.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.074+0000 7fc9c6c67640 1 -- 172.21.15.53:0/3656360942 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9c00c5de0 con 0x7fc9ac003980 2023-06-10T18:56:58.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.074+0000 7fc9c6c67640 1 -- 172.21.15.53:0/3656360942 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9c004d790 con 0x7fc9ac003980 2023-06-10T18:56:58.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.078+0000 7fc9bd7fa640 1 -- 172.21.15.53:0/3656360942 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc9b80a5bc0 con 0x7fc9ac003980 2023-06-10T18:56:58.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.078+0000 7fc9bd7fa640 1 --2- 172.21.15.53:0/3656360942 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc9a0066280 0x7fc9a0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:58.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.078+0000 7fc9bd7fa640 1 -- 172.21.15.53:0/3656360942 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fc9b811dab0 con 0x7fc9ac003980 2023-06-10T18:56:58.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.078+0000 7fc9bffff640 1 --2- 172.21.15.53:0/3656360942 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc9a0066280 0x7fc9a0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:58.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.078+0000 7fc9bffff640 1 --2- 172.21.15.53:0/3656360942 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc9a0066280 0x7fc9a0068730 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc9c00af3e0 tx=0x7fc9a800b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:58.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.082+0000 7fc9bd7fa640 1 -- 172.21.15.53:0/3656360942 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc9b80eaf80 con 0x7fc9ac003980 2023-06-10T18:56:58.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.230+0000 7fc9c6c67640 1 -- 172.21.15.53:0/3656360942 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc9c00b3c60 con 0x7fc9ac003980 2023-06-10T18:56:58.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.230+0000 7fc9bd7fa640 1 -- 172.21.15.53:0/3656360942 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v53) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc9b80f2e60 con 0x7fc9ac003980 2023-06-10T18:56:58.235 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-06-10T18:56:58.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.230+0000 7fc9c6c67640 1 -- 172.21.15.53:0/3656360942 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc9a0066280 msgr2=0x7fc9a0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:58.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.230+0000 7fc9c6c67640 1 --2- 172.21.15.53:0/3656360942 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc9a0066280 0x7fc9a0068730 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc9c00af3e0 tx=0x7fc9a800b040 comp rx=0 tx=0).stop 2023-06-10T18:56:58.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.230+0000 7fc9c6c67640 1 -- 172.21.15.53:0/3656360942 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9ac003980 msgr2=0x7fc9c00c65e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:58.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.230+0000 7fc9c6c67640 1 --2- 172.21.15.53:0/3656360942 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9ac003980 0x7fc9c00c65e0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fc9b801b2f0 tx=0x7fc9ac005800 comp rx=0 tx=0).stop 2023-06-10T18:56:58.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.230+0000 7fc9c6c67640 1 -- 172.21.15.53:0/3656360942 shutdown_connections 2023-06-10T18:56:58.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.230+0000 7fc9c6c67640 1 --2- 172.21.15.53:0/3656360942 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc9a0066280 0x7fc9a0068730 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:58.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.230+0000 7fc9c6c67640 1 --2- 172.21.15.53:0/3656360942 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9c01f74f0 0x7fc9c00c3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:58.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.230+0000 7fc9c6c67640 1 --2- 172.21.15.53:0/3656360942 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9c01f4380 0x7fc9c01f6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:58.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.230+0000 7fc9c6c67640 1 --2- 172.21.15.53:0/3656360942 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9ac003980 0x7fc9c00c65e0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:58.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.230+0000 7fc9c6c67640 1 -- 172.21.15.53:0/3656360942 >> 172.21.15.53:0/3656360942 conn(0x7fc9c006a0e0 msgr2=0x7fc9c00ce310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:58.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.230+0000 7fc9c6c67640 1 -- 172.21.15.53:0/3656360942 shutdown_connections 2023-06-10T18:56:58.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.230+0000 7fc9c6c67640 1 -- 172.21.15.53:0/3656360942 wait complete. 2023-06-10T18:56:58.252 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-10T18:56:58.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.374+0000 7f0500d06640 1 Processor -- start 2023-06-10T18:56:58.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.374+0000 7f0500d06640 1 -- start start 2023-06-10T18:56:58.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.374+0000 7f0500d06640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f04fc15c090 0x7f04fc0b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:58.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.374+0000 7f0500d06640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f04fc0b7e30 0x7f04fc0d04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:58.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.374+0000 7f0500d06640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04fc0cc7c0 con 0x7f04fc0b0b90 2023-06-10T18:56:58.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.374+0000 7f0500d06640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04fc0ccaa0 con 0x7f04fc0b7e30 2023-06-10T18:56:58.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.374+0000 7f0500d06640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04fc0ccd80 con 0x7f04fc15c090 2023-06-10T18:56:58.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.374+0000 7f04fad9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f04fc0b7e30 0x7f04fc0d04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:58.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.374+0000 7f04fad9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f04fc0b7e30 0x7f04fc0d04d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37704/0 (socket says 172.21.15.53:37704) 2023-06-10T18:56:58.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.374+0000 7f04fad9d640 1 -- 172.21.15.53:0/3575413509 learned_addr learned my addr 172.21.15.53:0/3575413509 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:58.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.374+0000 7f04fa59c640 1 --2- 172.21.15.53:0/3575413509 >> v2:172.21.15.117:3300/0 conn(0x7f04fc15c090 0x7f04fc0b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:58.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.374+0000 7f04fad9d640 1 -- 172.21.15.53:0/3575413509 >> v2:172.21.15.117:3300/0 conn(0x7f04fc15c090 msgr2=0x7f04fc0b10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:58.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.374+0000 7f04fad9d640 1 --2- 172.21.15.53:0/3575413509 >> v2:172.21.15.117:3300/0 conn(0x7f04fc15c090 0x7f04fc0b10c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:58.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.374+0000 7f04fad9d640 1 -- 172.21.15.53:0/3575413509 >> v1:172.21.15.117:6789/0 conn(0x7f04fc0b0b90 legacy=0x7f04fc0b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:58.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.374+0000 7f04fad9d640 1 -- 172.21.15.53:0/3575413509 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04fc0cd060 con 0x7f04fc0b7e30 2023-06-10T18:56:58.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.378+0000 7f04fad9d640 1 --2- 172.21.15.53:0/3575413509 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04fc0b7e30 0x7f04fc0d04d0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f04fc06b200 tx=0x7f04f401c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6274f1744d5dd4c4 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:58.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.378+0000 7f04f959a640 1 -- 172.21.15.53:0/3575413509 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f40a56f0 con 0x7f04fc0b7e30 2023-06-10T18:56:58.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.378+0000 7f04f959a640 1 -- 172.21.15.53:0/3575413509 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04f40a5850 con 0x7f04fc0b7e30 2023-06-10T18:56:58.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.378+0000 7f04f959a640 1 -- 172.21.15.53:0/3575413509 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f40a5be0 con 0x7f04fc0b7e30 2023-06-10T18:56:58.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.378+0000 7f0500d06640 1 -- 172.21.15.53:0/3575413509 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04fc0b7e30 msgr2=0x7f04fc0d04d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:58.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.378+0000 7f0500d06640 1 --2- 172.21.15.53:0/3575413509 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04fc0b7e30 0x7f04fc0d04d0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f04fc06b200 tx=0x7f04f401c8d0 comp rx=0 tx=0).stop 2023-06-10T18:56:58.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.378+0000 7f0500d06640 1 -- 172.21.15.53:0/3575413509 shutdown_connections 2023-06-10T18:56:58.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.378+0000 7f0500d06640 1 --2- 172.21.15.53:0/3575413509 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04fc0b7e30 0x7f04fc0d04d0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:58.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.378+0000 7f0500d06640 1 --2- 172.21.15.53:0/3575413509 >> v2:172.21.15.117:3300/0 conn(0x7f04fc15c090 0x7f04fc0b10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:58.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.378+0000 7f0500d06640 1 -- 172.21.15.53:0/3575413509 >> 172.21.15.53:0/3575413509 conn(0x7f04fc069e20 msgr2=0x7f04fc06a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:58.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.378+0000 7f0500d06640 1 -- 172.21.15.53:0/3575413509 shutdown_connections 2023-06-10T18:56:58.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.378+0000 7f0500d06640 1 -- 172.21.15.53:0/3575413509 wait complete. 2023-06-10T18:56:58.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.382+0000 7f0500d06640 1 Processor -- start 2023-06-10T18:56:58.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.382+0000 7f0500d06640 1 -- start start 2023-06-10T18:56:58.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.382+0000 7f0500d06640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04fc0b0b90 0x7f04fc146f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:58.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.382+0000 7f0500d06640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04fc0b7e30 0x7f04fc0c5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:58.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.382+0000 7f0500d06640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04fc15c090 0x7f04fc14a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:58.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.382+0000 7f0500d06640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04fc0c5580 con 0x7f04fc0b7e30 2023-06-10T18:56:58.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.382+0000 7f0500d06640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04fc155110 con 0x7f04fc0b0b90 2023-06-10T18:56:58.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.382+0000 7f0500d06640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04fc146630 con 0x7f04fc15c090 2023-06-10T18:56:58.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.382+0000 7f04f9d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04fc0b7e30 0x7f04fc0c5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:58.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.382+0000 7f04f9d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04fc0b7e30 0x7f04fc0c5040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37716/0 (socket says 172.21.15.53:37716) 2023-06-10T18:56:58.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.382+0000 7f04f9d9b640 1 -- 172.21.15.53:0/293691572 learned_addr learned my addr 172.21.15.53:0/293691572 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:58.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.382+0000 7f04fa59c640 1 --2- 172.21.15.53:0/293691572 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04fc0b0b90 0x7f04fc146f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:58.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.382+0000 7f04fad9d640 1 --2- 172.21.15.53:0/293691572 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04fc15c090 0x7f04fc14a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:58.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.382+0000 7f04f9d9b640 1 -- 172.21.15.53:0/293691572 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04fc15c090 msgr2=0x7f04fc14a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:58.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.382+0000 7f04f9d9b640 1 --2- 172.21.15.53:0/293691572 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04fc15c090 0x7f04fc14a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:58.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.382+0000 7f04f9d9b640 1 -- 172.21.15.53:0/293691572 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04fc0b0b90 msgr2=0x7f04fc146f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:58.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.382+0000 7f04f9d9b640 1 --2- 172.21.15.53:0/293691572 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04fc0b0b90 0x7f04fc146f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:58.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.382+0000 7f04f9d9b640 1 -- 172.21.15.53:0/293691572 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f4009b30 con 0x7f04fc0b7e30 2023-06-10T18:56:58.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.382+0000 7f04f9d9b640 1 --2- 172.21.15.53:0/293691572 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04fc0b7e30 0x7f04fc0c5040 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f04f000c410 tx=0x7f04f000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:58.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.382+0000 7f04eaffd640 1 -- 172.21.15.53:0/293691572 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f0003600 con 0x7f04fc0b7e30 2023-06-10T18:56:58.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.382+0000 7f04eaffd640 1 -- 172.21.15.53:0/293691572 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04f0003780 con 0x7f04fc0b7e30 2023-06-10T18:56:58.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.382+0000 7f0500d06640 1 -- 172.21.15.53:0/293691572 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04fc146910 con 0x7f04fc0b7e30 2023-06-10T18:56:58.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.382+0000 7f04eaffd640 1 -- 172.21.15.53:0/293691572 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f0003b30 con 0x7f04fc0b7e30 2023-06-10T18:56:58.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.382+0000 7f0500d06640 1 -- 172.21.15.53:0/293691572 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04fc154000 con 0x7f04fc0b7e30 2023-06-10T18:56:58.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.386+0000 7f0500d06640 1 -- 172.21.15.53:0/293691572 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04fc1552d0 con 0x7f04fc0b7e30 2023-06-10T18:56:58.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.386+0000 7f04eaffd640 1 -- 172.21.15.53:0/293691572 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f04f0003c90 con 0x7f04fc0b7e30 2023-06-10T18:56:58.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.386+0000 7f04eaffd640 1 --2- 172.21.15.53:0/293691572 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f04dc066280 0x7f04dc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:58.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.386+0000 7f04eaffd640 1 -- 172.21.15.53:0/293691572 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f04f0082f70 con 0x7f04fc0b7e30 2023-06-10T18:56:58.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.386+0000 7f04fa59c640 1 --2- 172.21.15.53:0/293691572 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f04dc066280 0x7f04dc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:58.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.386+0000 7f04fa59c640 1 --2- 172.21.15.53:0/293691572 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f04dc066280 0x7f04dc068730 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f04fc0cf420 tx=0x7f04ec008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:58.395 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.390+0000 7f04eaffd640 1 -- 172.21.15.53:0/293691572 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f04f00b3700 con 0x7f04fc0b7e30 2023-06-10T18:56:58.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.542+0000 7f0500d06640 1 -- 172.21.15.53:0/293691572 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f04fc04d790 con 0x7f04fc0b7e30 2023-06-10T18:56:58.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.542+0000 7f04eaffd640 1 -- 172.21.15.53:0/293691572 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v53) v1 ==== 104+0+11 (secure 0 0 0) 0x7f04f0017020 con 0x7f04fc0b7e30 2023-06-10T18:56:58.548 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-06-10T18:56:58.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.542+0000 7f0500d06640 1 -- 172.21.15.53:0/293691572 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f04dc066280 msgr2=0x7f04dc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:58.550 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.542+0000 7f0500d06640 1 --2- 172.21.15.53:0/293691572 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f04dc066280 0x7f04dc068730 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f04fc0cf420 tx=0x7f04ec008040 comp rx=0 tx=0).stop 2023-06-10T18:56:58.550 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.542+0000 7f0500d06640 1 -- 172.21.15.53:0/293691572 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04fc0b7e30 msgr2=0x7f04fc0c5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:58.550 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.542+0000 7f0500d06640 1 --2- 172.21.15.53:0/293691572 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04fc0b7e30 0x7f04fc0c5040 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f04f000c410 tx=0x7f04f000c8d0 comp rx=0 tx=0).stop 2023-06-10T18:56:58.551 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.542+0000 7f0500d06640 1 -- 172.21.15.53:0/293691572 shutdown_connections 2023-06-10T18:56:58.551 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.542+0000 7f0500d06640 1 --2- 172.21.15.53:0/293691572 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f04dc066280 0x7f04dc068730 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:58.551 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.542+0000 7f0500d06640 1 --2- 172.21.15.53:0/293691572 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04fc15c090 0x7f04fc14a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:58.551 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.542+0000 7f0500d06640 1 --2- 172.21.15.53:0/293691572 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04fc0b7e30 0x7f04fc0c5040 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:58.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.542+0000 7f0500d06640 1 --2- 172.21.15.53:0/293691572 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04fc0b0b90 0x7f04fc146f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:58.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.542+0000 7f0500d06640 1 -- 172.21.15.53:0/293691572 >> 172.21.15.53:0/293691572 conn(0x7f04fc069e20 msgr2=0x7f04fc0b67e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:58.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.542+0000 7f0500d06640 1 -- 172.21.15.53:0/293691572 shutdown_connections 2023-06-10T18:56:58.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.542+0000 7f0500d06640 1 -- 172.21.15.53:0/293691572 wait complete. 2023-06-10T18:56:58.567 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-10T18:56:58.697 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.690+0000 7efdfd90e640 1 Processor -- start 2023-06-10T18:56:58.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.690+0000 7efdfd90e640 1 -- start start 2023-06-10T18:56:58.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.694+0000 7efdfd90e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7efdf8159450 0x7efdf815d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:58.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.694+0000 7efdfd90e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efdf815d680 0x7efdf80cec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:58.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.694+0000 7efdfd90e640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdf80cbac0 con 0x7efdf80cf180 2023-06-10T18:56:58.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.694+0000 7efdfd90e640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdf80cf600 con 0x7efdf8159450 2023-06-10T18:56:58.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.694+0000 7efdfd90e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdf815dc00 con 0x7efdf815d680 2023-06-10T18:56:58.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.694+0000 7efdf77fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7efdf80cf180 0x7efdf80cda20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60550/0 (socket says 172.21.15.53:60550) 2023-06-10T18:56:58.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.694+0000 7efdf77fe640 1 -- 172.21.15.53:0/57549829 learned_addr learned my addr 172.21.15.53:0/57549829 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:56:58.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.694+0000 7efdf6ffd640 1 --2- 172.21.15.53:0/57549829 >> v2:172.21.15.53:3300/0 conn(0x7efdf8159450 0x7efdf815d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:58.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.694+0000 7efdeffff640 1 --2- 172.21.15.53:0/57549829 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efdf815d680 0x7efdf80cec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:58.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.694+0000 7efdf67fc640 1 -- 172.21.15.53:0/57549829 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2640902379 0 0) 0x7efdf80cbac0 con 0x7efdf80cf180 2023-06-10T18:56:58.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.694+0000 7efdf67fc640 1 -- 172.21.15.53:0/57549829 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efde4003530 con 0x7efdf80cf180 2023-06-10T18:56:58.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.694+0000 7efdf6ffd640 1 -- 172.21.15.53:0/57549829 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efdf815d680 msgr2=0x7efdf80cec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:58.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.694+0000 7efdf6ffd640 1 --2- 172.21.15.53:0/57549829 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efdf815d680 0x7efdf80cec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:58.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.694+0000 7efdf6ffd640 1 -- 172.21.15.53:0/57549829 >> v1:172.21.15.53:6789/0 conn(0x7efdf80cf180 legacy=0x7efdf80cda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:58.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.694+0000 7efdf6ffd640 1 -- 172.21.15.53:0/57549829 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdf815dee0 con 0x7efdf8159450 2023-06-10T18:56:58.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.694+0000 7efdf6ffd640 1 --2- 172.21.15.53:0/57549829 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efdf8159450 0x7efdf815d140 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7efde80097c0 tx=0x7efde801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=834ddbcd4bfdc27c server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:58.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.694+0000 7efdf67fc640 1 -- 172.21.15.53:0/57549829 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde80ad680 con 0x7efdf8159450 2023-06-10T18:56:58.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.694+0000 7efdf67fc640 1 -- 172.21.15.53:0/57549829 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efde80ad7e0 con 0x7efdf8159450 2023-06-10T18:56:58.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.694+0000 7efdf67fc640 1 -- 172.21.15.53:0/57549829 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde80adb50 con 0x7efdf8159450 2023-06-10T18:56:58.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.698+0000 7efdfd90e640 1 -- 172.21.15.53:0/57549829 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efdf8159450 msgr2=0x7efdf815d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:58.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.698+0000 7efdfd90e640 1 --2- 172.21.15.53:0/57549829 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efdf8159450 0x7efdf815d140 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7efde80097c0 tx=0x7efde801c3c0 comp rx=0 tx=0).stop 2023-06-10T18:56:58.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.698+0000 7efdfd90e640 1 -- 172.21.15.53:0/57549829 shutdown_connections 2023-06-10T18:56:58.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.698+0000 7efdfd90e640 1 --2- 172.21.15.53:0/57549829 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efdf815d680 0x7efdf80cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:58.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.698+0000 7efdfd90e640 1 --2- 172.21.15.53:0/57549829 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efdf8159450 0x7efdf815d140 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:58.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.698+0000 7efdfd90e640 1 -- 172.21.15.53:0/57549829 >> 172.21.15.53:0/57549829 conn(0x7efdf806a090 msgr2=0x7efdf806d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:58.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.698+0000 7efdfd90e640 1 -- 172.21.15.53:0/57549829 shutdown_connections 2023-06-10T18:56:58.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.698+0000 7efdfd90e640 1 -- 172.21.15.53:0/57549829 wait complete. 2023-06-10T18:56:58.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.698+0000 7efdfd90e640 1 Processor -- start 2023-06-10T18:56:58.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.698+0000 7efdfd90e640 1 -- start start 2023-06-10T18:56:58.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.698+0000 7efdfd90e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efdf80cf180 0x7efdf80c6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:58.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.698+0000 7efdfd90e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efdf8159450 0x7efdf814fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:58.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.698+0000 7efdfd90e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efdf815d680 0x7efdf814f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:58.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.698+0000 7efdfd90e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf8156340 con 0x7efdf815d680 2023-06-10T18:56:58.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.698+0000 7efdfd90e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf8157470 con 0x7efdf80cf180 2023-06-10T18:56:58.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.698+0000 7efdfd90e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdf8157750 con 0x7efdf8159450 2023-06-10T18:56:58.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.698+0000 7efdf77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efdf815d680 0x7efdf814f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:58.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.698+0000 7efdf77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efdf815d680 0x7efdf814f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37744/0 (socket says 172.21.15.53:37744) 2023-06-10T18:56:58.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.698+0000 7efdf77fe640 1 -- 172.21.15.53:0/457992383 learned_addr learned my addr 172.21.15.53:0/457992383 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:58.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.698+0000 7efdf6ffd640 1 --2- 172.21.15.53:0/457992383 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efdf80cf180 0x7efdf80c6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:58.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.698+0000 7efdeffff640 1 --2- 172.21.15.53:0/457992383 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efdf8159450 0x7efdf814fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:58.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.698+0000 7efdf77fe640 1 -- 172.21.15.53:0/457992383 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efdf8159450 msgr2=0x7efdf814fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:58.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.698+0000 7efdf77fe640 1 --2- 172.21.15.53:0/457992383 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efdf8159450 0x7efdf814fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:58.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.698+0000 7efdf77fe640 1 -- 172.21.15.53:0/457992383 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efdf80cf180 msgr2=0x7efdf80c6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:58.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.698+0000 7efdf77fe640 1 --2- 172.21.15.53:0/457992383 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efdf80cf180 0x7efdf80c6830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:58.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.698+0000 7efdf77fe640 1 -- 172.21.15.53:0/457992383 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efde8009420 con 0x7efdf815d680 2023-06-10T18:56:58.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.698+0000 7efdf77fe640 1 --2- 172.21.15.53:0/457992383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efdf815d680 0x7efdf814f1a0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7efdf000caa0 tx=0x7efdf000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:58.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.698+0000 7efdf4ff9640 1 -- 172.21.15.53:0/457992383 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf000ac00 con 0x7efdf815d680 2023-06-10T18:56:58.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.698+0000 7efdf4ff9640 1 -- 172.21.15.53:0/457992383 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf000ad60 con 0x7efdf815d680 2023-06-10T18:56:58.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.698+0000 7efdf4ff9640 1 -- 172.21.15.53:0/457992383 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf0012620 con 0x7efdf815d680 2023-06-10T18:56:58.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.702+0000 7efdfd90e640 1 -- 172.21.15.53:0/457992383 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdf8157a30 con 0x7efdf815d680 2023-06-10T18:56:58.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.702+0000 7efdfd90e640 1 -- 172.21.15.53:0/457992383 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdf8157ff0 con 0x7efdf815d680 2023-06-10T18:56:58.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.702+0000 7efdfd90e640 1 -- 172.21.15.53:0/457992383 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdf8156480 con 0x7efdf815d680 2023-06-10T18:56:58.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.702+0000 7efdf4ff9640 1 -- 172.21.15.53:0/457992383 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7efdf0007070 con 0x7efdf815d680 2023-06-10T18:56:58.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.702+0000 7efdf4ff9640 1 --2- 172.21.15.53:0/457992383 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efdd8066280 0x7efdd8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:58.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.702+0000 7efdf4ff9640 1 -- 172.21.15.53:0/457992383 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6120+0+0 (secure 0 0 0) 0x7efdf0083d10 con 0x7efdf815d680 2023-06-10T18:56:58.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.702+0000 7efdf6ffd640 1 --2- 172.21.15.53:0/457992383 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efdd8066280 0x7efdd8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:58.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.702+0000 7efdf6ffd640 1 --2- 172.21.15.53:0/457992383 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efdd8066280 0x7efdd8068730 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7efde80af000 tx=0x7efde80a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:58.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.706+0000 7efdf4ff9640 1 -- 172.21.15.53:0/457992383 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7efdf8156480 con 0x7efdf815d680 2023-06-10T18:56:58.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.858+0000 7efdfd90e640 1 -- 172.21.15.53:0/457992383 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efdf8156480 con 0x7efdf815d680 2023-06-10T18:56:58.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.858+0000 7efdf4ff9640 1 -- 172.21.15.53:0/457992383 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v53) v1 ==== 100+0+11 (secure 0 0 0) 0x7efdf8156480 con 0x7efdf815d680 2023-06-10T18:56:58.862 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-06-10T18:56:58.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.858+0000 7efdfd90e640 1 -- 172.21.15.53:0/457992383 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efdd8066280 msgr2=0x7efdd8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:58.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.858+0000 7efdfd90e640 1 --2- 172.21.15.53:0/457992383 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efdd8066280 0x7efdd8068730 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7efde80af000 tx=0x7efde80a7000 comp rx=0 tx=0).stop 2023-06-10T18:56:58.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.858+0000 7efdfd90e640 1 -- 172.21.15.53:0/457992383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efdf815d680 msgr2=0x7efdf814f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:58.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.858+0000 7efdfd90e640 1 --2- 172.21.15.53:0/457992383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efdf815d680 0x7efdf814f1a0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7efdf000caa0 tx=0x7efdf000cf60 comp rx=0 tx=0).stop 2023-06-10T18:56:58.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.858+0000 7efdfd90e640 1 -- 172.21.15.53:0/457992383 shutdown_connections 2023-06-10T18:56:58.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.858+0000 7efdfd90e640 1 --2- 172.21.15.53:0/457992383 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efdd8066280 0x7efdd8068730 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:58.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.858+0000 7efdfd90e640 1 --2- 172.21.15.53:0/457992383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efdf815d680 0x7efdf814f1a0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:58.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.858+0000 7efdfd90e640 1 --2- 172.21.15.53:0/457992383 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efdf8159450 0x7efdf814fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:58.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.858+0000 7efdfd90e640 1 --2- 172.21.15.53:0/457992383 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efdf80cf180 0x7efdf80c6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:58.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.858+0000 7efdfd90e640 1 -- 172.21.15.53:0/457992383 >> 172.21.15.53:0/457992383 conn(0x7efdf806a090 msgr2=0x7efdf8155860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:58.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.858+0000 7efdfd90e640 1 -- 172.21.15.53:0/457992383 shutdown_connections 2023-06-10T18:56:58.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.858+0000 7efdfd90e640 1 -- 172.21.15.53:0/457992383 wait complete. 2023-06-10T18:56:58.880 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T18:56:59.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.998+0000 7f317db9c640 1 Processor -- start 2023-06-10T18:56:59.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.998+0000 7f317db9c640 1 -- start start 2023-06-10T18:56:59.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.998+0000 7f317db9c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f31780c9840 0x7f31780c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:59.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.998+0000 7f317db9c640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3178159b50 con 0x7f3178071060 2023-06-10T18:56:59.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.998+0000 7f317db9c640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31780ca150 con 0x7f317806b090 2023-06-10T18:56:59.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.998+0000 7f317db9c640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31780702a0 con 0x7f31780c9840 2023-06-10T18:56:59.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.998+0000 7f3176ffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f3178071060 0x7f31780af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60554/0 (socket says 172.21.15.53:60554) 2023-06-10T18:56:59.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.998+0000 7f3176ffd640 1 -- 172.21.15.53:0/3822354746 learned_addr learned my addr 172.21.15.53:0/3822354746 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:56:59.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.998+0000 7f31777fe640 1 --2- 172.21.15.53:0/3822354746 >> v2:172.21.15.117:3300/0 conn(0x7f31780c9840 0x7f31780c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:59.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.998+0000 7f31767fc640 1 -- 172.21.15.53:0/3822354746 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 229842250 0 0) 0x7f3178159b50 con 0x7f3178071060 2023-06-10T18:56:59.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.998+0000 7f31767fc640 1 -- 172.21.15.53:0/3822354746 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3160003530 con 0x7f3178071060 2023-06-10T18:56:59.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.998+0000 7f31767fc640 1 -- 172.21.15.53:0/3822354746 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2976305310 0 0) 0x7f3160003530 con 0x7f3178071060 2023-06-10T18:56:59.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.998+0000 7f31767fc640 1 -- 172.21.15.53:0/3822354746 >> v2:172.21.15.117:3300/0 conn(0x7f31780c9840 msgr2=0x7f31780c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:59.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.998+0000 7f31767fc640 1 --2- 172.21.15.53:0/3822354746 >> v2:172.21.15.117:3300/0 conn(0x7f31780c9840 0x7f31780c9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:59.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.998+0000 7f31767fc640 1 -- 172.21.15.53:0/3822354746 >> v1:172.21.15.117:6789/0 conn(0x7f317806b090 legacy=0x7f317806b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:59.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.998+0000 7f31767fc640 1 -- 172.21.15.53:0/3822354746 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3178070580 con 0x7f3178071060 2023-06-10T18:56:59.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.998+0000 7f31767fc640 1 -- 172.21.15.53:0/3822354746 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f316c001680 con 0x7f3178071060 2023-06-10T18:56:59.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.998+0000 7f31767fc640 1 -- 172.21.15.53:0/3822354746 >> v1:172.21.15.53:6789/0 conn(0x7f3178071060 legacy=0x7f31780af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:59.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.998+0000 7f31767fc640 1 --2- 172.21.15.53:0/3822354746 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3160003a40 0x7f3160003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:59.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.998+0000 7f31767fc640 1 --2- 172.21.15.53:0/3822354746 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31600047d0 0x7f3160004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:59.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.998+0000 7f31767fc640 1 --2- 172.21.15.53:0/3822354746 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3160005180 0x7f316000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:59.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.998+0000 7f31767fc640 1 -- 172.21.15.53:0/3822354746 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31780702a0 con 0x7f3160005180 2023-06-10T18:56:59.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.998+0000 7f31767fc640 1 -- 172.21.15.53:0/3822354746 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f316000c0c0 con 0x7f31600047d0 2023-06-10T18:56:59.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.998+0000 7f31767fc640 1 -- 172.21.15.53:0/3822354746 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f316000c280 con 0x7f3160003a40 2023-06-10T18:56:59.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:58.998+0000 7f3177fff640 1 --2- 172.21.15.53:0/3822354746 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3160005180 0x7f316000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:59.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.002+0000 7f3176ffd640 1 --2- 172.21.15.53:0/3822354746 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31600047d0 0x7f3160004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:59.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.002+0000 7f31777fe640 1 --2- 172.21.15.53:0/3822354746 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3160003a40 0x7f3160003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:59.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.002+0000 7f3177fff640 1 -- 172.21.15.53:0/3822354746 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3160003a40 msgr2=0x7f3160003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:59.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.002+0000 7f3177fff640 1 --2- 172.21.15.53:0/3822354746 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3160003a40 0x7f3160003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:59.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.002+0000 7f3177fff640 1 -- 172.21.15.53:0/3822354746 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31600047d0 msgr2=0x7f3160004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:59.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.002+0000 7f3177fff640 1 --2- 172.21.15.53:0/3822354746 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31600047d0 0x7f3160004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:59.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.002+0000 7f3177fff640 1 -- 172.21.15.53:0/3822354746 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3160003530 con 0x7f3160005180 2023-06-10T18:56:59.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.002+0000 7f3176ffd640 1 --2- 172.21.15.53:0/3822354746 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31600047d0 0x7f3160004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:56:59.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.002+0000 7f3177fff640 1 -- 172.21.15.53:0/3822354746 reap_dead start 2023-06-10T18:56:59.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.002+0000 7f3177fff640 1 --2- 172.21.15.53:0/3822354746 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3160005180 0x7f316000b990 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f3170001e40 tx=0x7f317001c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efdda63542233425 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:59.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.002+0000 7f31767fc640 1 -- 172.21.15.53:0/3822354746 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3170003b80 con 0x7f3160005180 2023-06-10T18:56:59.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.002+0000 7f31767fc640 1 -- 172.21.15.53:0/3822354746 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3170003ce0 con 0x7f3160005180 2023-06-10T18:56:59.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.002+0000 7f31767fc640 1 -- 172.21.15.53:0/3822354746 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3170005260 con 0x7f3160005180 2023-06-10T18:56:59.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.002+0000 7f317db9c640 1 -- 172.21.15.53:0/3822354746 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3160005180 msgr2=0x7f316000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:59.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.002+0000 7f317db9c640 1 --2- 172.21.15.53:0/3822354746 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3160005180 0x7f316000b990 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f3170001e40 tx=0x7f317001c740 comp rx=0 tx=0).stop 2023-06-10T18:56:59.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.002+0000 7f317db9c640 1 -- 172.21.15.53:0/3822354746 shutdown_connections 2023-06-10T18:56:59.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.002+0000 7f317db9c640 1 --2- 172.21.15.53:0/3822354746 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3160005180 0x7f316000b990 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:59.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.002+0000 7f317db9c640 1 -- 172.21.15.53:0/3822354746 >> 172.21.15.53:0/3822354746 conn(0x7f317806a0d0 msgr2=0x7f31780ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:59.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.002+0000 7f317db9c640 1 -- 172.21.15.53:0/3822354746 shutdown_connections 2023-06-10T18:56:59.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.002+0000 7f317db9c640 1 -- 172.21.15.53:0/3822354746 wait complete. 2023-06-10T18:56:59.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.006+0000 7f317db9c640 1 Processor -- start 2023-06-10T18:56:59.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.006+0000 7f317db9c640 1 -- start start 2023-06-10T18:56:59.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.006+0000 7f317db9c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3160005180 0x7f31780c6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:59.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.006+0000 7f317db9c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31780c59c0 0x7f31780c7c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:59.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.006+0000 7f317db9c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f317814da20 0x7f317815ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:59.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.006+0000 7f317db9c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f317814de90 con 0x7f317814da20 2023-06-10T18:56:59.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.006+0000 7f317db9c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31780c6b50 con 0x7f31780c59c0 2023-06-10T18:56:59.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.006+0000 7f317db9c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31780c5f40 con 0x7f3160005180 2023-06-10T18:56:59.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.006+0000 7f3177fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f317814da20 0x7f317815ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:59.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.006+0000 7f3177fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f317814da20 0x7f317815ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37754/0 (socket says 172.21.15.53:37754) 2023-06-10T18:56:59.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.006+0000 7f3177fff640 1 -- 172.21.15.53:0/800202033 learned_addr learned my addr 172.21.15.53:0/800202033 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:59.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.006+0000 7f31777fe640 1 --2- 172.21.15.53:0/800202033 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3160005180 0x7f31780c6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:59.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.006+0000 7f3176ffd640 1 --2- 172.21.15.53:0/800202033 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31780c59c0 0x7f31780c7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:59.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.006+0000 7f3177fff640 1 -- 172.21.15.53:0/800202033 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3160005180 msgr2=0x7f31780c6fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:59.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.006+0000 7f3177fff640 1 --2- 172.21.15.53:0/800202033 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3160005180 0x7f31780c6fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:59.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.006+0000 7f3177fff640 1 -- 172.21.15.53:0/800202033 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31780c59c0 msgr2=0x7f31780c7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:59.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.006+0000 7f3177fff640 1 --2- 172.21.15.53:0/800202033 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31780c59c0 0x7f31780c7c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:59.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.006+0000 7f3177fff640 1 -- 172.21.15.53:0/800202033 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31780c6220 con 0x7f317814da20 2023-06-10T18:56:59.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.006+0000 7f31777fe640 1 --2- 172.21.15.53:0/800202033 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3160005180 0x7f31780c6fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:56:59.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.006+0000 7f3176ffd640 1 --2- 172.21.15.53:0/800202033 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31780c59c0 0x7f31780c7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:56:59.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.006+0000 7f3177fff640 1 --2- 172.21.15.53:0/800202033 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f317814da20 0x7f317815ae10 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f317001cfe0 tx=0x7f3160005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:59.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.006+0000 7f315ffff640 1 -- 172.21.15.53:0/800202033 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3170006d60 con 0x7f317814da20 2023-06-10T18:56:59.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.006+0000 7f315ffff640 1 -- 172.21.15.53:0/800202033 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3170005230 con 0x7f317814da20 2023-06-10T18:56:59.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.006+0000 7f317db9c640 1 -- 172.21.15.53:0/800202033 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31780c6500 con 0x7f317814da20 2023-06-10T18:56:59.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.006+0000 7f315ffff640 1 -- 172.21.15.53:0/800202033 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31700055e0 con 0x7f317814da20 2023-06-10T18:56:59.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.006+0000 7f317db9c640 1 -- 172.21.15.53:0/800202033 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f317814e310 con 0x7f317814da20 2023-06-10T18:56:59.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.006+0000 7f317db9c640 1 -- 172.21.15.53:0/800202033 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f317804d790 con 0x7f317814da20 2023-06-10T18:56:59.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.010+0000 7f315ffff640 1 -- 172.21.15.53:0/800202033 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f31700a6440 con 0x7f317814da20 2023-06-10T18:56:59.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.010+0000 7f315ffff640 1 --2- 172.21.15.53:0/800202033 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3164066280 0x7f3164068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:59.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.010+0000 7f315ffff640 1 -- 172.21.15.53:0/800202033 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f317011cc70 con 0x7f317814da20 2023-06-10T18:56:59.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.010+0000 7f31777fe640 1 --2- 172.21.15.53:0/800202033 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3164066280 0x7f3164068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:59.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.010+0000 7f31777fe640 1 --2- 172.21.15.53:0/800202033 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3164066280 0x7f3164068730 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f31680099a0 tx=0x7f3168008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:59.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.014+0000 7f315ffff640 1 -- 172.21.15.53:0/800202033 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f31700ea0a0 con 0x7f317814da20 2023-06-10T18:56:59.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.202+0000 7f317db9c640 1 -- 172.21.15.53:0/800202033 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f31780cb140 con 0x7f317814da20 2023-06-10T18:56:59.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.202+0000 7f315ffff640 1 -- 172.21.15.53:0/800202033 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+4674 (secure 0 0 0) 0x7f31700ed6c0 con 0x7f317814da20 2023-06-10T18:56:59.209 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:56:59.209 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":20,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5168,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/275593879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":275593879},{"type":"v1","addr":"172.21.15.117:6837","nonce":275593879}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5422,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/2837986258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2837986258},{"type":"v1","addr":"172.21.15.117:6836","nonce":2837986258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5928,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/2789082937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2789082937},{"type":"v1","addr":"172.21.15.53:6833","nonce":2789082937}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T18:56:18.681744+0000","modified":"2023-06-10T18:56:21.825431+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5931},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5931":{"gid":5931,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/3463677034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":3463677034},{"type":"v1","addr":"172.21.15.53:6835","nonce":3463677034}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-06-10T18:56:59.209 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 20 2023-06-10T18:56:59.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.206+0000 7f317db9c640 1 -- 172.21.15.53:0/800202033 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3164066280 msgr2=0x7f3164068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:59.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.206+0000 7f317db9c640 1 --2- 172.21.15.53:0/800202033 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3164066280 0x7f3164068730 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f31680099a0 tx=0x7f3168008040 comp rx=0 tx=0).stop 2023-06-10T18:56:59.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.206+0000 7f317db9c640 1 -- 172.21.15.53:0/800202033 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f317814da20 msgr2=0x7f317815ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:59.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.206+0000 7f317db9c640 1 --2- 172.21.15.53:0/800202033 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f317814da20 0x7f317815ae10 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f317001cfe0 tx=0x7f3160005800 comp rx=0 tx=0).stop 2023-06-10T18:56:59.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.206+0000 7f317db9c640 1 -- 172.21.15.53:0/800202033 shutdown_connections 2023-06-10T18:56:59.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.206+0000 7f317db9c640 1 --2- 172.21.15.53:0/800202033 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3164066280 0x7f3164068730 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:59.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.206+0000 7f317db9c640 1 --2- 172.21.15.53:0/800202033 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f317814da20 0x7f317815ae10 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:59.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.206+0000 7f317db9c640 1 --2- 172.21.15.53:0/800202033 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31780c59c0 0x7f31780c7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:59.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.206+0000 7f317db9c640 1 --2- 172.21.15.53:0/800202033 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3160005180 0x7f31780c6fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:59.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.206+0000 7f317db9c640 1 -- 172.21.15.53:0/800202033 >> 172.21.15.53:0/800202033 conn(0x7f317806a0d0 msgr2=0x7f31780ca340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:59.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.206+0000 7f317db9c640 1 -- 172.21.15.53:0/800202033 shutdown_connections 2023-06-10T18:56:59.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.206+0000 7f317db9c640 1 -- 172.21.15.53:0/800202033 wait complete. 2023-06-10T18:56:59.228 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T18:56:59.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.346+0000 7f2731503640 1 Processor -- start 2023-06-10T18:56:59.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.346+0000 7f2731503640 1 -- start start 2023-06-10T18:56:59.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.350+0000 7f2731503640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f272c0b3ac0 0x7f272c0b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:59.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.350+0000 7f2731503640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f272c0cc690 0x7f272c15f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:59.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.350+0000 7f2731503640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f272c0ccae0 0x7f272c15f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:59.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.350+0000 7f2731503640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f272c0d0020 con 0x7f272c0ccae0 2023-06-10T18:56:59.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.350+0000 7f2731503640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f272c0b43d0 con 0x7f272c0cc690 2023-06-10T18:56:59.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.350+0000 7f2731503640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f272c0cef40 con 0x7f272c0b3ac0 2023-06-10T18:56:59.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.350+0000 7f272b7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f272c0ccae0 0x7f272c15f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:59.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.350+0000 7f272b7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f272c0ccae0 0x7f272c15f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37760/0 (socket says 172.21.15.53:37760) 2023-06-10T18:56:59.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.350+0000 7f272b7fe640 1 -- 172.21.15.53:0/236610346 learned_addr learned my addr 172.21.15.53:0/236610346 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:59.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.350+0000 7f272affd640 1 --2- 172.21.15.53:0/236610346 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f272c0b3ac0 0x7f272c0b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:59.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.350+0000 7f272b7fe640 1 -- 172.21.15.53:0/236610346 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f272c0b3ac0 msgr2=0x7f272c0b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:59.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.350+0000 7f272a7fc640 1 --2- 172.21.15.53:0/236610346 >> v2:172.21.15.117:3300/0 conn(0x7f272c0cc690 0x7f272c15f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:59.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.350+0000 7f272b7fe640 1 --2- 172.21.15.53:0/236610346 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f272c0b3ac0 0x7f272c0b3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:59.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.350+0000 7f272b7fe640 1 -- 172.21.15.53:0/236610346 >> v2:172.21.15.117:3300/0 conn(0x7f272c0cc690 msgr2=0x7f272c15f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:59.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.350+0000 7f272b7fe640 1 --2- 172.21.15.53:0/236610346 >> v2:172.21.15.117:3300/0 conn(0x7f272c0cc690 0x7f272c15f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:59.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.350+0000 7f272b7fe640 1 -- 172.21.15.53:0/236610346 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f272c0cf220 con 0x7f272c0ccae0 2023-06-10T18:56:59.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.350+0000 7f272affd640 1 --2- 172.21.15.53:0/236610346 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f272c0b3ac0 0x7f272c0b3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:56:59.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.350+0000 7f272a7fc640 1 --2- 172.21.15.53:0/236610346 >> v2:172.21.15.117:3300/0 conn(0x7f272c0cc690 0x7f272c15f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:56:59.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.350+0000 7f272b7fe640 1 --2- 172.21.15.53:0/236610346 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f272c0ccae0 0x7f272c15f8b0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f272c069cb0 tx=0x7f272401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f83b1b6b8021c055 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:59.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.350+0000 7f2729ffb640 1 -- 172.21.15.53:0/236610346 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27240a5730 con 0x7f272c0ccae0 2023-06-10T18:56:59.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.350+0000 7f2729ffb640 1 -- 172.21.15.53:0/236610346 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27240a5890 con 0x7f272c0ccae0 2023-06-10T18:56:59.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.350+0000 7f2729ffb640 1 -- 172.21.15.53:0/236610346 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27240a5c20 con 0x7f272c0ccae0 2023-06-10T18:56:59.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.354+0000 7f2731503640 1 -- 172.21.15.53:0/236610346 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f272c0ccae0 msgr2=0x7f272c15f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:59.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.354+0000 7f2731503640 1 --2- 172.21.15.53:0/236610346 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f272c0ccae0 0x7f272c15f8b0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f272c069cb0 tx=0x7f272401c9a0 comp rx=0 tx=0).stop 2023-06-10T18:56:59.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.354+0000 7f2731503640 1 -- 172.21.15.53:0/236610346 shutdown_connections 2023-06-10T18:56:59.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.354+0000 7f2731503640 1 --2- 172.21.15.53:0/236610346 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f272c0ccae0 0x7f272c15f8b0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:59.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.354+0000 7f2731503640 1 --2- 172.21.15.53:0/236610346 >> v2:172.21.15.117:3300/0 conn(0x7f272c0cc690 0x7f272c15f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:59.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.354+0000 7f2731503640 1 --2- 172.21.15.53:0/236610346 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f272c0b3ac0 0x7f272c0b3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:59.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.354+0000 7f2731503640 1 -- 172.21.15.53:0/236610346 >> 172.21.15.53:0/236610346 conn(0x7f272c071790 msgr2=0x7f272c069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:59.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.354+0000 7f2731503640 1 -- 172.21.15.53:0/236610346 shutdown_connections 2023-06-10T18:56:59.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.354+0000 7f2731503640 1 -- 172.21.15.53:0/236610346 wait complete. 2023-06-10T18:56:59.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.354+0000 7f2731503640 1 Processor -- start 2023-06-10T18:56:59.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.354+0000 7f2731503640 1 -- start start 2023-06-10T18:56:59.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.354+0000 7f2731503640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f272c0b3ac0 0x7f272c15e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:59.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.354+0000 7f2731503640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f272c0cc690 0x7f272c0c80c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:59.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.354+0000 7f2731503640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f272c0ccae0 0x7f272c153de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:59.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.354+0000 7f2731503640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f272c1530b0 con 0x7f272c0b3ac0 2023-06-10T18:56:59.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.354+0000 7f2731503640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f272c153950 con 0x7f272c0cc690 2023-06-10T18:56:59.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.354+0000 7f2731503640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f272c15b540 con 0x7f272c0ccae0 2023-06-10T18:56:59.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.354+0000 7f272affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f272c0b3ac0 0x7f272c15e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:59.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.354+0000 7f272affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f272c0b3ac0 0x7f272c15e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37764/0 (socket says 172.21.15.53:37764) 2023-06-10T18:56:59.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.354+0000 7f272affd640 1 -- 172.21.15.53:0/397185875 learned_addr learned my addr 172.21.15.53:0/397185875 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:59.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.354+0000 7f272b7fe640 1 --2- 172.21.15.53:0/397185875 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f272c0ccae0 0x7f272c153de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:59.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.354+0000 7f272a7fc640 1 --2- 172.21.15.53:0/397185875 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f272c0cc690 0x7f272c0c80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:59.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.354+0000 7f272affd640 1 -- 172.21.15.53:0/397185875 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f272c0ccae0 msgr2=0x7f272c153de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:59.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.354+0000 7f272affd640 1 --2- 172.21.15.53:0/397185875 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f272c0ccae0 0x7f272c153de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:59.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.354+0000 7f272affd640 1 -- 172.21.15.53:0/397185875 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f272c0cc690 msgr2=0x7f272c0c80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:59.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.354+0000 7f272affd640 1 --2- 172.21.15.53:0/397185875 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f272c0cc690 0x7f272c0c80c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:59.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.354+0000 7f272affd640 1 -- 172.21.15.53:0/397185875 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2724009b30 con 0x7f272c0b3ac0 2023-06-10T18:56:59.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.354+0000 7f272affd640 1 --2- 172.21.15.53:0/397185875 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f272c0b3ac0 0x7f272c15e6c0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f271c00c7f0 tx=0x7f271c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:59.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.354+0000 7f27137fe640 1 -- 172.21.15.53:0/397185875 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271c00cea0 con 0x7f272c0b3ac0 2023-06-10T18:56:59.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.354+0000 7f27137fe640 1 -- 172.21.15.53:0/397185875 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f271c007a30 con 0x7f272c0b3ac0 2023-06-10T18:56:59.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.354+0000 7f27137fe640 1 -- 172.21.15.53:0/397185875 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271c007dc0 con 0x7f272c0b3ac0 2023-06-10T18:56:59.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.354+0000 7f2731503640 1 -- 172.21.15.53:0/397185875 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f272c153300 con 0x7f272c0b3ac0 2023-06-10T18:56:59.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.358+0000 7f2731503640 1 -- 172.21.15.53:0/397185875 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f272c15ec00 con 0x7f272c0b3ac0 2023-06-10T18:56:59.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.358+0000 7f2731503640 1 -- 172.21.15.53:0/397185875 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f272c04d790 con 0x7f272c0b3ac0 2023-06-10T18:56:59.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.358+0000 7f27137fe640 1 -- 172.21.15.53:0/397185875 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f271c0113f0 con 0x7f272c0b3ac0 2023-06-10T18:56:59.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.358+0000 7f27137fe640 1 --2- 172.21.15.53:0/397185875 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2718066280 0x7f2718068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:59.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.358+0000 7f27137fe640 1 -- 172.21.15.53:0/397185875 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f271c083e30 con 0x7f272c0b3ac0 2023-06-10T18:56:59.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.358+0000 7f272a7fc640 1 --2- 172.21.15.53:0/397185875 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2718066280 0x7f2718068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:59.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.358+0000 7f272a7fc640 1 --2- 172.21.15.53:0/397185875 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2718066280 0x7f2718068730 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f272c166670 tx=0x7f2720008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:59.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.362+0000 7f27137fe640 1 -- 172.21.15.53:0/397185875 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f271c051300 con 0x7f272c0b3ac0 2023-06-10T18:56:59.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.518+0000 7f2731503640 1 -- 172.21.15.53:0/397185875 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f272c08a200 con 0x7f272c0b3ac0 2023-06-10T18:56:59.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.518+0000 7f27137fe640 1 -- 172.21.15.53:0/397185875 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+18434 (secure 0 0 0) 0x7f271c054920 con 0x7f272c0b3ac0 2023-06-10T18:56:59.524 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:56:59.524 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":53,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T18:56:27.877880+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-06-10T18:56:16.364582+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-06-10T18:56:17.656793+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.e","mappings":[{"from":0,"to":6}]},{"pgid":"8.1d","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T18:56:59.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.522+0000 7f2731503640 1 -- 172.21.15.53:0/397185875 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2718066280 msgr2=0x7f2718068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:59.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.522+0000 7f2731503640 1 --2- 172.21.15.53:0/397185875 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2718066280 0x7f2718068730 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f272c166670 tx=0x7f2720008040 comp rx=0 tx=0).stop 2023-06-10T18:56:59.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.522+0000 7f2731503640 1 -- 172.21.15.53:0/397185875 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f272c0b3ac0 msgr2=0x7f272c15e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:59.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.522+0000 7f2731503640 1 --2- 172.21.15.53:0/397185875 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f272c0b3ac0 0x7f272c15e6c0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f271c00c7f0 tx=0x7f271c00ccb0 comp rx=0 tx=0).stop 2023-06-10T18:56:59.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.522+0000 7f2731503640 1 -- 172.21.15.53:0/397185875 shutdown_connections 2023-06-10T18:56:59.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.522+0000 7f2731503640 1 --2- 172.21.15.53:0/397185875 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2718066280 0x7f2718068730 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:59.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.522+0000 7f2731503640 1 --2- 172.21.15.53:0/397185875 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f272c0ccae0 0x7f272c153de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:59.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.522+0000 7f2731503640 1 --2- 172.21.15.53:0/397185875 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f272c0cc690 0x7f272c0c80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:59.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.522+0000 7f2731503640 1 --2- 172.21.15.53:0/397185875 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f272c0b3ac0 0x7f272c15e6c0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:59.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.522+0000 7f2731503640 1 -- 172.21.15.53:0/397185875 >> 172.21.15.53:0/397185875 conn(0x7f272c071790 msgr2=0x7f272c0b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:59.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.522+0000 7f2731503640 1 -- 172.21.15.53:0/397185875 shutdown_connections 2023-06-10T18:56:59.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.522+0000 7f2731503640 1 -- 172.21.15.53:0/397185875 wait complete. 2023-06-10T18:56:59.544 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-06-10T18:56:59.544 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T18:56:59.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.662+0000 7fb0fb727640 1 Processor -- start 2023-06-10T18:56:59.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.662+0000 7fb0fb727640 1 -- start start 2023-06-10T18:56:59.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.666+0000 7fb0fb727640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0f40c9840 0x7fb0f40c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:59.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.666+0000 7fb0fb727640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb0f4071060 0x7fb0f40af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:59.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.666+0000 7fb0fb727640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb0f40afc60 0x7fb0f415d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:59.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.666+0000 7fb0fb727640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0f4159b50 con 0x7fb0f4071060 2023-06-10T18:56:59.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.666+0000 7fb0fb727640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0f40ca150 con 0x7fb0f40afc60 2023-06-10T18:56:59.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.666+0000 7fb0fb727640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f40702a0 con 0x7fb0f40c9840 2023-06-10T18:56:59.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.666+0000 7fb0f8cc2640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb0f4071060 0x7fb0f40af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:59.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.666+0000 7fb0f8cc2640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb0f4071060 0x7fb0f40af720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37776/0 (socket says 172.21.15.53:37776) 2023-06-10T18:56:59.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.666+0000 7fb0f8cc2640 1 -- 172.21.15.53:0/3306899843 learned_addr learned my addr 172.21.15.53:0/3306899843 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:59.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.666+0000 7fb0f94c3640 1 --2- 172.21.15.53:0/3306899843 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0f40c9840 0x7fb0f40c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:59.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.666+0000 7fb0f9cc4640 1 --2- 172.21.15.53:0/3306899843 >> v2:172.21.15.117:3300/0 conn(0x7fb0f40afc60 0x7fb0f415d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:59.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.666+0000 7fb0f8cc2640 1 -- 172.21.15.53:0/3306899843 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0f40c9840 msgr2=0x7fb0f40c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:59.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.666+0000 7fb0f8cc2640 1 --2- 172.21.15.53:0/3306899843 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0f40c9840 0x7fb0f40c9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:59.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.666+0000 7fb0f8cc2640 1 -- 172.21.15.53:0/3306899843 >> v2:172.21.15.117:3300/0 conn(0x7fb0f40afc60 msgr2=0x7fb0f415d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:56:59.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.666+0000 7fb0f8cc2640 1 --2- 172.21.15.53:0/3306899843 >> v2:172.21.15.117:3300/0 conn(0x7fb0f40afc60 0x7fb0f415d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:59.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.666+0000 7fb0f8cc2640 1 -- 172.21.15.53:0/3306899843 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0f4070580 con 0x7fb0f4071060 2023-06-10T18:56:59.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.670+0000 7fb0f8cc2640 1 --2- 172.21.15.53:0/3306899843 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0f4071060 0x7fb0f40af720 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fb0f406ef50 tx=0x7fb0e401c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=713ee94aed928d16 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:59.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.670+0000 7fb0ebfff640 1 -- 172.21.15.53:0/3306899843 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e40ab600 con 0x7fb0f4071060 2023-06-10T18:56:59.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.670+0000 7fb0ebfff640 1 -- 172.21.15.53:0/3306899843 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0e40a7050 con 0x7fb0f4071060 2023-06-10T18:56:59.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.670+0000 7fb0ebfff640 1 -- 172.21.15.53:0/3306899843 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e40ab980 con 0x7fb0f4071060 2023-06-10T18:56:59.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.670+0000 7fb0fb727640 1 -- 172.21.15.53:0/3306899843 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0f4071060 msgr2=0x7fb0f40af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:59.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.670+0000 7fb0fb727640 1 --2- 172.21.15.53:0/3306899843 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0f4071060 0x7fb0f40af720 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fb0f406ef50 tx=0x7fb0e401c210 comp rx=0 tx=0).stop 2023-06-10T18:56:59.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.670+0000 7fb0fb727640 1 -- 172.21.15.53:0/3306899843 shutdown_connections 2023-06-10T18:56:59.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.670+0000 7fb0fb727640 1 --2- 172.21.15.53:0/3306899843 >> v2:172.21.15.117:3300/0 conn(0x7fb0f40afc60 0x7fb0f415d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:59.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.670+0000 7fb0fb727640 1 --2- 172.21.15.53:0/3306899843 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0f4071060 0x7fb0f40af720 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:59.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.670+0000 7fb0fb727640 1 --2- 172.21.15.53:0/3306899843 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0f40c9840 0x7fb0f40c9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:59.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.670+0000 7fb0fb727640 1 -- 172.21.15.53:0/3306899843 >> 172.21.15.53:0/3306899843 conn(0x7fb0f406a0d0 msgr2=0x7fb0f40ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:59.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.670+0000 7fb0fb727640 1 -- 172.21.15.53:0/3306899843 shutdown_connections 2023-06-10T18:56:59.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.670+0000 7fb0fb727640 1 -- 172.21.15.53:0/3306899843 wait complete. 2023-06-10T18:56:59.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.670+0000 7fb0fb727640 1 Processor -- start 2023-06-10T18:56:59.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.670+0000 7fb0fb727640 1 -- start start 2023-06-10T18:56:59.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.670+0000 7fb0fb727640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0f4071060 0x7fb0f41552f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:59.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.670+0000 7fb0fb727640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0f40afc60 0x7fb0f4153010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:59.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.670+0000 7fb0fb727640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0f40c9840 0x7fb0f41514f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:59.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.670+0000 7fb0fb727640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f4156ef0 con 0x7fb0f40afc60 2023-06-10T18:56:59.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.670+0000 7fb0fb727640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f4151d20 con 0x7fb0f4071060 2023-06-10T18:56:59.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.670+0000 7fb0fb727640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f4153550 con 0x7fb0f40c9840 2023-06-10T18:56:59.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.670+0000 7fb0f8cc2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0f40afc60 0x7fb0f4153010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:59.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.670+0000 7fb0f8cc2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0f40afc60 0x7fb0f4153010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37784/0 (socket says 172.21.15.53:37784) 2023-06-10T18:56:59.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.670+0000 7fb0f8cc2640 1 -- 172.21.15.53:0/2726135857 learned_addr learned my addr 172.21.15.53:0/2726135857 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:56:59.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.670+0000 7fb0f94c3640 1 --2- 172.21.15.53:0/2726135857 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0f4071060 0x7fb0f41552f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:59.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.670+0000 7fb0f9cc4640 1 --2- 172.21.15.53:0/2726135857 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0f40c9840 0x7fb0f41514f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:59.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.670+0000 7fb0f8cc2640 1 -- 172.21.15.53:0/2726135857 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0f40c9840 msgr2=0x7fb0f41514f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:59.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.674+0000 7fb0f8cc2640 1 --2- 172.21.15.53:0/2726135857 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0f40c9840 0x7fb0f41514f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:59.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.674+0000 7fb0f8cc2640 1 -- 172.21.15.53:0/2726135857 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0f4071060 msgr2=0x7fb0f41552f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:59.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.674+0000 7fb0f8cc2640 1 --2- 172.21.15.53:0/2726135857 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0f4071060 0x7fb0f41552f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:59.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.674+0000 7fb0f8cc2640 1 -- 172.21.15.53:0/2726135857 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0e40094d0 con 0x7fb0f40afc60 2023-06-10T18:56:59.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.674+0000 7fb0f9cc4640 1 --2- 172.21.15.53:0/2726135857 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0f40c9840 0x7fb0f41514f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:56:59.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.674+0000 7fb0f8cc2640 1 --2- 172.21.15.53:0/2726135857 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0f40afc60 0x7fb0f4153010 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fb0e401a8c0 tx=0x7fb0e4018fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:59.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.674+0000 7fb0e9ffb640 1 -- 172.21.15.53:0/2726135857 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e40b6850 con 0x7fb0f40afc60 2023-06-10T18:56:59.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.674+0000 7fb0e9ffb640 1 -- 172.21.15.53:0/2726135857 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0e40b69d0 con 0x7fb0f40afc60 2023-06-10T18:56:59.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.674+0000 7fb0fb727640 1 -- 172.21.15.53:0/2726135857 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0f4151f70 con 0x7fb0f40afc60 2023-06-10T18:56:59.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.674+0000 7fb0e9ffb640 1 -- 172.21.15.53:0/2726135857 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e40b6d80 con 0x7fb0f40afc60 2023-06-10T18:56:59.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.674+0000 7fb0fb727640 1 -- 172.21.15.53:0/2726135857 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0f4152530 con 0x7fb0f40afc60 2023-06-10T18:56:59.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.674+0000 7fb0fb727640 1 -- 172.21.15.53:0/2726135857 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0f406b010 con 0x7fb0f40afc60 2023-06-10T18:56:59.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.674+0000 7fb0e9ffb640 1 -- 172.21.15.53:0/2726135857 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb0e40b2040 con 0x7fb0f40afc60 2023-06-10T18:56:59.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.674+0000 7fb0e9ffb640 1 --2- 172.21.15.53:0/2726135857 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb0d8066280 0x7fb0d8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:56:59.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.674+0000 7fb0e9ffb640 1 -- 172.21.15.53:0/2726135857 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fb0e411d7c0 con 0x7fb0f40afc60 2023-06-10T18:56:59.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.674+0000 7fb0f94c3640 1 --2- 172.21.15.53:0/2726135857 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb0d8066280 0x7fb0d8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:56:59.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.674+0000 7fb0f94c3640 1 --2- 172.21.15.53:0/2726135857 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb0d8066280 0x7fb0d8068730 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fb0f415caa0 tx=0x7fb0f0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:56:59.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.678+0000 7fb0e9ffb640 1 -- 172.21.15.53:0/2726135857 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb0e40eac00 con 0x7fb0f40afc60 2023-06-10T18:56:59.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.866+0000 7fb0fb727640 1 -- 172.21.15.53:0/2726135857 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb0f404d790 con 0x7fb0f40afc60 2023-06-10T18:56:59.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.866+0000 7fb0e9ffb640 1 -- 172.21.15.53:0/2726135857 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+4674 (secure 0 0 0) 0x7fb0e40ee220 con 0x7fb0f40afc60 2023-06-10T18:56:59.873 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:56:59.873 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":20,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5168,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/275593879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":275593879},{"type":"v1","addr":"172.21.15.117:6837","nonce":275593879}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5422,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/2837986258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2837986258},{"type":"v1","addr":"172.21.15.117:6836","nonce":2837986258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5928,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/2789082937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2789082937},{"type":"v1","addr":"172.21.15.53:6833","nonce":2789082937}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T18:56:18.681744+0000","modified":"2023-06-10T18:56:21.825431+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5931},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5931":{"gid":5931,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/3463677034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":3463677034},{"type":"v1","addr":"172.21.15.53:6835","nonce":3463677034}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-06-10T18:56:59.874 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 20 2023-06-10T18:56:59.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.870+0000 7fb0fb727640 1 -- 172.21.15.53:0/2726135857 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb0d8066280 msgr2=0x7fb0d8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:59.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.870+0000 7fb0fb727640 1 --2- 172.21.15.53:0/2726135857 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb0d8066280 0x7fb0d8068730 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fb0f415caa0 tx=0x7fb0f0008040 comp rx=0 tx=0).stop 2023-06-10T18:56:59.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.870+0000 7fb0fb727640 1 -- 172.21.15.53:0/2726135857 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0f40afc60 msgr2=0x7fb0f4153010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:56:59.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.870+0000 7fb0fb727640 1 --2- 172.21.15.53:0/2726135857 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0f40afc60 0x7fb0f4153010 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fb0e401a8c0 tx=0x7fb0e4018fb0 comp rx=0 tx=0).stop 2023-06-10T18:56:59.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.870+0000 7fb0fb727640 1 -- 172.21.15.53:0/2726135857 shutdown_connections 2023-06-10T18:56:59.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.870+0000 7fb0fb727640 1 --2- 172.21.15.53:0/2726135857 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb0d8066280 0x7fb0d8068730 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:59.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.870+0000 7fb0fb727640 1 --2- 172.21.15.53:0/2726135857 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0f40c9840 0x7fb0f41514f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:59.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.870+0000 7fb0fb727640 1 --2- 172.21.15.53:0/2726135857 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0f40afc60 0x7fb0f4153010 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:59.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.870+0000 7fb0fb727640 1 --2- 172.21.15.53:0/2726135857 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0f4071060 0x7fb0f41552f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:56:59.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.870+0000 7fb0fb727640 1 -- 172.21.15.53:0/2726135857 >> 172.21.15.53:0/2726135857 conn(0x7fb0f406a0d0 msgr2=0x7fb0f40aefb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:56:59.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.870+0000 7fb0fb727640 1 -- 172.21.15.53:0/2726135857 shutdown_connections 2023-06-10T18:56:59.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:56:59.870+0000 7fb0fb727640 1 -- 172.21.15.53:0/2726135857 wait complete. 2023-06-10T18:56:59.892 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T18:57:00.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.006+0000 7f78b5da7640 1 Processor -- start 2023-06-10T18:57:00.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.006+0000 7f78b5da7640 1 -- start start 2023-06-10T18:57:00.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.006+0000 7f78b5da7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f78b00cc690 0x7f78b00d04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:00.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.006+0000 7f78b5da7640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f78b00ccae0 0x7f78b00d09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:00.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.006+0000 7f78b5da7640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78b00d0020 con 0x7f78b00b3ac0 2023-06-10T18:57:00.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.006+0000 7f78b5da7640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78b00cef40 con 0x7f78b00cc690 2023-06-10T18:57:00.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.006+0000 7f78b5da7640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78b00cf220 con 0x7f78b00ccae0 2023-06-10T18:57:00.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.006+0000 7f78af7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f78b00b3ac0 0x7f78b00b3e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60570/0 (socket says 172.21.15.53:60570) 2023-06-10T18:57:00.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.006+0000 7f78aeffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f78b00cc690 0x7f78b00d04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:00.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.006+0000 7f78af7fe640 1 -- 172.21.15.53:0/2250589101 learned_addr learned my addr 172.21.15.53:0/2250589101 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:57:00.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.006+0000 7f78affff640 1 --2- 172.21.15.53:0/2250589101 >> v2:172.21.15.117:3300/0 conn(0x7f78b00ccae0 0x7f78b00d09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:00.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.006+0000 7f78aeffd640 1 -- 172.21.15.53:0/2250589101 >> v2:172.21.15.117:3300/0 conn(0x7f78b00ccae0 msgr2=0x7f78b00d09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:00.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.006+0000 7f78aeffd640 1 --2- 172.21.15.53:0/2250589101 >> v2:172.21.15.117:3300/0 conn(0x7f78b00ccae0 0x7f78b00d09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:00.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.006+0000 7f78aeffd640 1 -- 172.21.15.53:0/2250589101 >> v1:172.21.15.53:6789/0 conn(0x7f78b00b3ac0 legacy=0x7f78b00b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:00.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.006+0000 7f78aeffd640 1 -- 172.21.15.53:0/2250589101 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78b00cf500 con 0x7f78b00cc690 2023-06-10T18:57:00.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.010+0000 7f78aeffd640 1 --2- 172.21.15.53:0/2250589101 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f78b00cc690 0x7f78b00d04b0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f78b0160410 tx=0x7f78a401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0f27ddcdc838da4 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:00.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.010+0000 7f78ae7fc640 1 -- 172.21.15.53:0/2250589101 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a40ab600 con 0x7f78b00cc690 2023-06-10T18:57:00.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.010+0000 7f78ae7fc640 1 -- 172.21.15.53:0/2250589101 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78a40a7050 con 0x7f78b00cc690 2023-06-10T18:57:00.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.010+0000 7f78ae7fc640 1 -- 172.21.15.53:0/2250589101 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a40ab980 con 0x7f78b00cc690 2023-06-10T18:57:00.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.010+0000 7f78b5da7640 1 -- 172.21.15.53:0/2250589101 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f78b00cc690 msgr2=0x7f78b00d04b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:00.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.010+0000 7f78b5da7640 1 --2- 172.21.15.53:0/2250589101 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f78b00cc690 0x7f78b00d04b0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f78b0160410 tx=0x7f78a401c430 comp rx=0 tx=0).stop 2023-06-10T18:57:00.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.010+0000 7f78b5da7640 1 -- 172.21.15.53:0/2250589101 shutdown_connections 2023-06-10T18:57:00.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.010+0000 7f78b5da7640 1 --2- 172.21.15.53:0/2250589101 >> v2:172.21.15.117:3300/0 conn(0x7f78b00ccae0 0x7f78b00d09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:00.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.010+0000 7f78b5da7640 1 --2- 172.21.15.53:0/2250589101 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f78b00cc690 0x7f78b00d04b0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:00.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.010+0000 7f78b5da7640 1 -- 172.21.15.53:0/2250589101 >> 172.21.15.53:0/2250589101 conn(0x7f78b0071790 msgr2=0x7f78b0069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:00.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.010+0000 7f78b5da7640 1 -- 172.21.15.53:0/2250589101 shutdown_connections 2023-06-10T18:57:00.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.010+0000 7f78b5da7640 1 -- 172.21.15.53:0/2250589101 wait complete. 2023-06-10T18:57:00.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.010+0000 7f78b5da7640 1 Processor -- start 2023-06-10T18:57:00.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.010+0000 7f78b5da7640 1 -- start start 2023-06-10T18:57:00.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.010+0000 7f78b5da7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78b00b3ac0 0x7f78b01541d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:00.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.010+0000 7f78b5da7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f78b00cc690 0x7f78b014c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:00.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.010+0000 7f78b5da7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78b00ccae0 0x7f78b014bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:00.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.010+0000 7f78b5da7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78b014caa0 con 0x7f78b00cc690 2023-06-10T18:57:00.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.010+0000 7f78b5da7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78b0159c60 con 0x7f78b00b3ac0 2023-06-10T18:57:00.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.010+0000 7f78b5da7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78b014c080 con 0x7f78b00ccae0 2023-06-10T18:57:00.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.010+0000 7f78aeffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f78b00cc690 0x7f78b014c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:00.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.010+0000 7f78aeffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f78b00cc690 0x7f78b014c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37802/0 (socket says 172.21.15.53:37802) 2023-06-10T18:57:00.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.010+0000 7f78aeffd640 1 -- 172.21.15.53:0/1026661763 learned_addr learned my addr 172.21.15.53:0/1026661763 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:57:00.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.014+0000 7f78af7fe640 1 --2- 172.21.15.53:0/1026661763 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78b00b3ac0 0x7f78b01541d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:00.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.014+0000 7f78affff640 1 --2- 172.21.15.53:0/1026661763 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78b00ccae0 0x7f78b014bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:00.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.014+0000 7f78aeffd640 1 -- 172.21.15.53:0/1026661763 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78b00ccae0 msgr2=0x7f78b014bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:00.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.014+0000 7f78aeffd640 1 --2- 172.21.15.53:0/1026661763 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78b00ccae0 0x7f78b014bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:00.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.014+0000 7f78aeffd640 1 -- 172.21.15.53:0/1026661763 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78b00b3ac0 msgr2=0x7f78b01541d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:00.020 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.014+0000 7f78aeffd640 1 --2- 172.21.15.53:0/1026661763 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78b00b3ac0 0x7f78b01541d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:00.020 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.014+0000 7f78aeffd640 1 -- 172.21.15.53:0/1026661763 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a4009420 con 0x7f78b00cc690 2023-06-10T18:57:00.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.014+0000 7f78aeffd640 1 --2- 172.21.15.53:0/1026661763 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f78b00cc690 0x7f78b014c560 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f78a401a060 tx=0x7f78a40191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:00.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.014+0000 7f7897fff640 1 -- 172.21.15.53:0/1026661763 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a40b4600 con 0x7f78b00cc690 2023-06-10T18:57:00.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.014+0000 7f7897fff640 1 -- 172.21.15.53:0/1026661763 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78a40b4760 con 0x7f78b00cc690 2023-06-10T18:57:00.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.014+0000 7f78b5da7640 1 -- 172.21.15.53:0/1026661763 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78b01548d0 con 0x7f78b00cc690 2023-06-10T18:57:00.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.014+0000 7f7897fff640 1 -- 172.21.15.53:0/1026661763 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a40b4ad0 con 0x7f78b00cc690 2023-06-10T18:57:00.022 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.014+0000 7f78b5da7640 1 -- 172.21.15.53:0/1026661763 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78b01598f0 con 0x7f78b00cc690 2023-06-10T18:57:00.022 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.014+0000 7f78b5da7640 1 -- 172.21.15.53:0/1026661763 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78b004d790 con 0x7f78b00cc690 2023-06-10T18:57:00.022 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.014+0000 7f7897fff640 1 -- 172.21.15.53:0/1026661763 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f78a40b2040 con 0x7f78b00cc690 2023-06-10T18:57:00.022 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.014+0000 7f7897fff640 1 --2- 172.21.15.53:0/1026661763 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f789c0662b0 0x7f789c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:00.022 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.014+0000 7f7897fff640 1 -- 172.21.15.53:0/1026661763 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f78a411dc10 con 0x7f78b00cc690 2023-06-10T18:57:00.022 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.014+0000 7f78af7fe640 1 --2- 172.21.15.53:0/1026661763 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f789c0662b0 0x7f789c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:00.022 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.014+0000 7f78af7fe640 1 --2- 172.21.15.53:0/1026661763 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f789c0662b0 0x7f789c068760 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f78a8005c10 tx=0x7f78a8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:00.024 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.018+0000 7f7897fff640 1 -- 172.21.15.53:0/1026661763 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f78a40eb0e0 con 0x7f78b00cc690 2023-06-10T18:57:00.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.202+0000 7f78b5da7640 1 -- 172.21.15.53:0/1026661763 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f78b0159da0 con 0x7f78b00cc690 2023-06-10T18:57:00.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.202+0000 7f7897fff640 1 -- 172.21.15.53:0/1026661763 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+4674 (secure 0 0 0) 0x7f78a4006e20 con 0x7f78b00cc690 2023-06-10T18:57:00.209 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:57:00.209 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":20,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5168,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/275593879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":275593879},{"type":"v1","addr":"172.21.15.117:6837","nonce":275593879}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5422,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/2837986258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2837986258},{"type":"v1","addr":"172.21.15.117:6836","nonce":2837986258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5928,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/2789082937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2789082937},{"type":"v1","addr":"172.21.15.53:6833","nonce":2789082937}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T18:56:18.681744+0000","modified":"2023-06-10T18:56:21.825431+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5931},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5931":{"gid":5931,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/3463677034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":3463677034},{"type":"v1","addr":"172.21.15.53:6835","nonce":3463677034}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-06-10T18:57:00.209 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 20 2023-06-10T18:57:00.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.206+0000 7f78b5da7640 1 -- 172.21.15.53:0/1026661763 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f789c0662b0 msgr2=0x7f789c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:00.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.206+0000 7f78b5da7640 1 --2- 172.21.15.53:0/1026661763 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f789c0662b0 0x7f789c068760 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f78a8005c10 tx=0x7f78a8009040 comp rx=0 tx=0).stop 2023-06-10T18:57:00.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.206+0000 7f78b5da7640 1 -- 172.21.15.53:0/1026661763 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f78b00cc690 msgr2=0x7f78b014c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:00.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.206+0000 7f78b5da7640 1 --2- 172.21.15.53:0/1026661763 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f78b00cc690 0x7f78b014c560 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f78a401a060 tx=0x7f78a40191d0 comp rx=0 tx=0).stop 2023-06-10T18:57:00.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.206+0000 7f78b5da7640 1 -- 172.21.15.53:0/1026661763 shutdown_connections 2023-06-10T18:57:00.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.206+0000 7f78b5da7640 1 --2- 172.21.15.53:0/1026661763 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f789c0662b0 0x7f789c068760 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:00.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.206+0000 7f78b5da7640 1 --2- 172.21.15.53:0/1026661763 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78b00ccae0 0x7f78b014bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:00.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.206+0000 7f78b5da7640 1 --2- 172.21.15.53:0/1026661763 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f78b00cc690 0x7f78b014c560 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:00.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.206+0000 7f78b5da7640 1 --2- 172.21.15.53:0/1026661763 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78b00b3ac0 0x7f78b01541d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:00.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.206+0000 7f78b5da7640 1 -- 172.21.15.53:0/1026661763 >> 172.21.15.53:0/1026661763 conn(0x7f78b0071790 msgr2=0x7f78b00ce320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:00.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.206+0000 7f78b5da7640 1 -- 172.21.15.53:0/1026661763 shutdown_connections 2023-06-10T18:57:00.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.206+0000 7f78b5da7640 1 -- 172.21.15.53:0/1026661763 wait complete. 2023-06-10T18:57:00.226 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T18:57:00.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.346+0000 7f5e17ce3640 1 Processor -- start 2023-06-10T18:57:00.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.346+0000 7f5e17ce3640 1 -- start start 2023-06-10T18:57:00.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.346+0000 7f5e17ce3640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5e10071060 0x7f5e100af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:00.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.346+0000 7f5e17ce3640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5e100afc60 0x7f5e1006b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:00.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.346+0000 7f5e17ce3640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e10159b50 con 0x7f5e100c9840 2023-06-10T18:57:00.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.346+0000 7f5e17ce3640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e100702a0 con 0x7f5e100afc60 2023-06-10T18:57:00.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.346+0000 7f5e17ce3640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e10070580 con 0x7f5e10071060 2023-06-10T18:57:00.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.346+0000 7f5e16280640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5e100afc60 0x7f5e1006b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:00.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.346+0000 7f5e15a7f640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f5e100c9840 0x7f5e100c9c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60586/0 (socket says 172.21.15.53:60586) 2023-06-10T18:57:00.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.346+0000 7f5e16280640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5e100afc60 0x7f5e1006b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37808/0 (socket says 172.21.15.53:37808) 2023-06-10T18:57:00.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.346+0000 7f5e15a7f640 1 -- 172.21.15.53:0/971412099 learned_addr learned my addr 172.21.15.53:0/971412099 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:57:00.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.346+0000 7f5e1527e640 1 --2- 172.21.15.53:0/971412099 >> v2:172.21.15.117:3300/0 conn(0x7f5e10071060 0x7f5e100af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:00.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.346+0000 7f5e16280640 1 -- 172.21.15.53:0/971412099 >> v2:172.21.15.117:3300/0 conn(0x7f5e10071060 msgr2=0x7f5e100af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:00.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.346+0000 7f5e16280640 1 --2- 172.21.15.53:0/971412099 >> v2:172.21.15.117:3300/0 conn(0x7f5e10071060 0x7f5e100af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:00.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.346+0000 7f5e16280640 1 -- 172.21.15.53:0/971412099 >> v1:172.21.15.53:6789/0 conn(0x7f5e100c9840 legacy=0x7f5e100c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:00.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.346+0000 7f5e14a7d640 1 -- 172.21.15.53:0/971412099 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2408581251 0 0) 0x7f5e10159b50 con 0x7f5e100c9840 2023-06-10T18:57:00.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.346+0000 7f5e16280640 1 -- 172.21.15.53:0/971412099 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e10070860 con 0x7f5e100afc60 2023-06-10T18:57:00.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.346+0000 7f5e1527e640 1 --2- 172.21.15.53:0/971412099 >> v2:172.21.15.117:3300/0 conn(0x7f5e10071060 0x7f5e100af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:57:00.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.350+0000 7f5e16280640 1 --2- 172.21.15.53:0/971412099 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e100afc60 0x7f5e1006b090 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f5e1006e650 tx=0x7f5e0801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3b1a5f1d9479377 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:00.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.350+0000 7f5e14a7d640 1 -- 172.21.15.53:0/971412099 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e080a59c0 con 0x7f5e100afc60 2023-06-10T18:57:00.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.350+0000 7f5e14a7d640 1 -- 172.21.15.53:0/971412099 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e080a5b20 con 0x7f5e100afc60 2023-06-10T18:57:00.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.350+0000 7f5e14a7d640 1 -- 172.21.15.53:0/971412099 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e080ad440 con 0x7f5e100afc60 2023-06-10T18:57:00.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.350+0000 7f5e17ce3640 1 -- 172.21.15.53:0/971412099 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e100afc60 msgr2=0x7f5e1006b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:00.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.350+0000 7f5e17ce3640 1 --2- 172.21.15.53:0/971412099 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e100afc60 0x7f5e1006b090 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f5e1006e650 tx=0x7f5e0801c8e0 comp rx=0 tx=0).stop 2023-06-10T18:57:00.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.350+0000 7f5e17ce3640 1 -- 172.21.15.53:0/971412099 shutdown_connections 2023-06-10T18:57:00.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.350+0000 7f5e17ce3640 1 --2- 172.21.15.53:0/971412099 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e100afc60 0x7f5e1006b090 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:00.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.350+0000 7f5e17ce3640 1 --2- 172.21.15.53:0/971412099 >> v2:172.21.15.117:3300/0 conn(0x7f5e10071060 0x7f5e100af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:00.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.350+0000 7f5e17ce3640 1 -- 172.21.15.53:0/971412099 >> 172.21.15.53:0/971412099 conn(0x7f5e1006a0d0 msgr2=0x7f5e100ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:00.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.350+0000 7f5e17ce3640 1 -- 172.21.15.53:0/971412099 shutdown_connections 2023-06-10T18:57:00.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.350+0000 7f5e17ce3640 1 -- 172.21.15.53:0/971412099 wait complete. 2023-06-10T18:57:00.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.350+0000 7f5e17ce3640 1 Processor -- start 2023-06-10T18:57:00.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.350+0000 7f5e17ce3640 1 -- start start 2023-06-10T18:57:00.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.354+0000 7f5e17ce3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e10071060 0x7f5e100c23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:00.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.354+0000 7f5e17ce3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e100afc60 0x7f5e10152500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:00.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.354+0000 7f5e17ce3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e100c9840 0x7f5e100b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:00.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.354+0000 7f5e17ce3640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e100c32c0 con 0x7f5e100afc60 2023-06-10T18:57:00.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.354+0000 7f5e17ce3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e100c2920 con 0x7f5e10071060 2023-06-10T18:57:00.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.354+0000 7f5e17ce3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e101f2e70 con 0x7f5e100c9840 2023-06-10T18:57:00.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.354+0000 7f5e1527e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e100afc60 0x7f5e10152500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:00.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.354+0000 7f5e1527e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e100afc60 0x7f5e10152500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37816/0 (socket says 172.21.15.53:37816) 2023-06-10T18:57:00.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.354+0000 7f5e1527e640 1 -- 172.21.15.53:0/3811106856 learned_addr learned my addr 172.21.15.53:0/3811106856 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:57:00.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.354+0000 7f5e16280640 1 --2- 172.21.15.53:0/3811106856 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e100c9840 0x7f5e100b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:00.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.354+0000 7f5e15a7f640 1 --2- 172.21.15.53:0/3811106856 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e10071060 0x7f5e100c23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:00.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.354+0000 7f5e1527e640 1 -- 172.21.15.53:0/3811106856 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e100c9840 msgr2=0x7f5e100b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:00.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.354+0000 7f5e1527e640 1 --2- 172.21.15.53:0/3811106856 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e100c9840 0x7f5e100b1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:00.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.354+0000 7f5e1527e640 1 -- 172.21.15.53:0/3811106856 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e10071060 msgr2=0x7f5e100c23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:00.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.354+0000 7f5e1527e640 1 --2- 172.21.15.53:0/3811106856 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e10071060 0x7f5e100c23e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:00.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.354+0000 7f5e1527e640 1 -- 172.21.15.53:0/3811106856 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e08009a70 con 0x7f5e100afc60 2023-06-10T18:57:00.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.354+0000 7f5e15a7f640 1 --2- 172.21.15.53:0/3811106856 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e10071060 0x7f5e100c23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:57:00.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.354+0000 7f5e16280640 1 --2- 172.21.15.53:0/3811106856 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e100c9840 0x7f5e100b1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:57:00.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.354+0000 7f5e1527e640 1 --2- 172.21.15.53:0/3811106856 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e100afc60 0x7f5e10152500 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f5e0000e870 tx=0x7f5e0000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:00.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.354+0000 7f5e067fc640 1 -- 172.21.15.53:0/3811106856 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e0000c8d0 con 0x7f5e100afc60 2023-06-10T18:57:00.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.354+0000 7f5e067fc640 1 -- 172.21.15.53:0/3811106856 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e0000ca30 con 0x7f5e100afc60 2023-06-10T18:57:00.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.354+0000 7f5e067fc640 1 -- 172.21.15.53:0/3811106856 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e0000cde0 con 0x7f5e100afc60 2023-06-10T18:57:00.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.354+0000 7f5e17ce3640 1 -- 172.21.15.53:0/3811106856 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e101f2b90 con 0x7f5e100afc60 2023-06-10T18:57:00.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.354+0000 7f5e17ce3640 1 -- 172.21.15.53:0/3811106856 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e100c1be0 con 0x7f5e100afc60 2023-06-10T18:57:00.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.354+0000 7f5e17ce3640 1 -- 172.21.15.53:0/3811106856 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e1004d790 con 0x7f5e100afc60 2023-06-10T18:57:00.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.354+0000 7f5e067fc640 1 -- 172.21.15.53:0/3811106856 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5e00013410 con 0x7f5e100afc60 2023-06-10T18:57:00.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.354+0000 7f5e067fc640 1 --2- 172.21.15.53:0/3811106856 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5df40662b0 0x7f5df4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:00.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.354+0000 7f5e067fc640 1 -- 172.21.15.53:0/3811106856 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f5e00083a60 con 0x7f5e100afc60 2023-06-10T18:57:00.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.358+0000 7f5e15a7f640 1 --2- 172.21.15.53:0/3811106856 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5df40662b0 0x7f5df4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:00.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.358+0000 7f5e15a7f640 1 --2- 172.21.15.53:0/3811106856 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5df40662b0 0x7f5df4068760 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c007fd0 tx=0x7f5e0c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:00.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.362+0000 7f5e067fc640 1 -- 172.21.15.53:0/3811106856 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5e00050f30 con 0x7f5e100afc60 2023-06-10T18:57:00.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.514+0000 7f5e17ce3640 1 -- 172.21.15.53:0/3811106856 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5e100cb140 con 0x7f5e100afc60 2023-06-10T18:57:00.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.518+0000 7f5e067fc640 1 -- 172.21.15.53:0/3811106856 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+18434 (secure 0 0 0) 0x7f5e0000ee60 con 0x7f5e100afc60 2023-06-10T18:57:00.523 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:57:00.523 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":53,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T18:56:27.877880+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-06-10T18:56:16.364582+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-06-10T18:56:17.656793+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.e","mappings":[{"from":0,"to":6}]},{"pgid":"8.1d","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T18:57:00.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.518+0000 7f5e17ce3640 1 -- 172.21.15.53:0/3811106856 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5df40662b0 msgr2=0x7f5df4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:00.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.518+0000 7f5e17ce3640 1 --2- 172.21.15.53:0/3811106856 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5df40662b0 0x7f5df4068760 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c007fd0 tx=0x7f5e0c009040 comp rx=0 tx=0).stop 2023-06-10T18:57:00.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.518+0000 7f5e17ce3640 1 -- 172.21.15.53:0/3811106856 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e100afc60 msgr2=0x7f5e10152500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:00.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.518+0000 7f5e17ce3640 1 --2- 172.21.15.53:0/3811106856 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e100afc60 0x7f5e10152500 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f5e0000e870 tx=0x7f5e0000ed30 comp rx=0 tx=0).stop 2023-06-10T18:57:00.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.518+0000 7f5e17ce3640 1 -- 172.21.15.53:0/3811106856 shutdown_connections 2023-06-10T18:57:00.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.518+0000 7f5e17ce3640 1 --2- 172.21.15.53:0/3811106856 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5df40662b0 0x7f5df4068760 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:00.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.518+0000 7f5e17ce3640 1 --2- 172.21.15.53:0/3811106856 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e100c9840 0x7f5e100b1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:00.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.518+0000 7f5e17ce3640 1 --2- 172.21.15.53:0/3811106856 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e100afc60 0x7f5e10152500 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:00.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.518+0000 7f5e17ce3640 1 --2- 172.21.15.53:0/3811106856 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e10071060 0x7f5e100c23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:00.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.518+0000 7f5e17ce3640 1 -- 172.21.15.53:0/3811106856 >> 172.21.15.53:0/3811106856 conn(0x7f5e1006a0d0 msgr2=0x7f5e10151920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:00.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.518+0000 7f5e17ce3640 1 -- 172.21.15.53:0/3811106856 shutdown_connections 2023-06-10T18:57:00.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.518+0000 7f5e17ce3640 1 -- 172.21.15.53:0/3811106856 wait complete. 2023-06-10T18:57:00.543 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-06-10T18:57:00.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.662+0000 7fc7fb7d4640 1 Processor -- start 2023-06-10T18:57:00.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.662+0000 7fc7fb7d4640 1 -- start start 2023-06-10T18:57:00.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.666+0000 7fc7fb7d4640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc7f40cc690 0x7fc7f40d00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:00.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.666+0000 7fc7fb7d4640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc7f40d1b00 0x7fc7f40d05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:00.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.666+0000 7fc7fb7d4640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7f40ccde0 con 0x7fc7f40b3ac0 2023-06-10T18:57:00.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.666+0000 7fc7fb7d4640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7f40ced00 con 0x7fc7f40cc690 2023-06-10T18:57:00.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.666+0000 7fc7fb7d4640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7f40cfc10 con 0x7fc7f40d1b00 2023-06-10T18:57:00.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.666+0000 7fc7f8d6f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc7f40cc690 0x7fc7f40d00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:00.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.666+0000 7fc7f8d6f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc7f40cc690 0x7fc7f40d00a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37818/0 (socket says 172.21.15.53:37818) 2023-06-10T18:57:00.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.666+0000 7fc7f8d6f640 1 -- 172.21.15.53:0/3150411679 learned_addr learned my addr 172.21.15.53:0/3150411679 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:57:00.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.666+0000 7fc7f9d71640 1 --2- 172.21.15.53:0/3150411679 >> v2:172.21.15.117:3300/0 conn(0x7fc7f40d1b00 0x7fc7f40d05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:00.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.666+0000 7fc7f8d6f640 1 -- 172.21.15.53:0/3150411679 >> v2:172.21.15.117:3300/0 conn(0x7fc7f40d1b00 msgr2=0x7fc7f40d05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:00.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.666+0000 7fc7f8d6f640 1 --2- 172.21.15.53:0/3150411679 >> v2:172.21.15.117:3300/0 conn(0x7fc7f40d1b00 0x7fc7f40d05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:00.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.666+0000 7fc7f8d6f640 1 -- 172.21.15.53:0/3150411679 >> v1:172.21.15.117:6789/0 conn(0x7fc7f40b3ac0 legacy=0x7fc7f40b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:00.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.666+0000 7fc7f8d6f640 1 -- 172.21.15.53:0/3150411679 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7f40b7b50 con 0x7fc7f40cc690 2023-06-10T18:57:00.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.666+0000 7fc7f9d71640 1 --2- 172.21.15.53:0/3150411679 >> v2:172.21.15.117:3300/0 conn(0x7fc7f40d1b00 0x7fc7f40d05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:57:00.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.666+0000 7fc7f8d6f640 1 --2- 172.21.15.53:0/3150411679 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7f40cc690 0x7fc7f40d00a0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fc7f40b8110 tx=0x7fc7e401c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38d8579b235ea30f server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:00.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.666+0000 7fc7ebfff640 1 -- 172.21.15.53:0/3150411679 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e40ac630 con 0x7fc7f40cc690 2023-06-10T18:57:00.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.666+0000 7fc7ebfff640 1 -- 172.21.15.53:0/3150411679 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7e40ac790 con 0x7fc7f40cc690 2023-06-10T18:57:00.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.666+0000 7fc7ebfff640 1 -- 172.21.15.53:0/3150411679 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e40acb20 con 0x7fc7f40cc690 2023-06-10T18:57:00.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.670+0000 7fc7fb7d4640 1 -- 172.21.15.53:0/3150411679 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7f40cc690 msgr2=0x7fc7f40d00a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:00.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.670+0000 7fc7fb7d4640 1 --2- 172.21.15.53:0/3150411679 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7f40cc690 0x7fc7f40d00a0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fc7f40b8110 tx=0x7fc7e401c3b0 comp rx=0 tx=0).stop 2023-06-10T18:57:00.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.670+0000 7fc7fb7d4640 1 -- 172.21.15.53:0/3150411679 shutdown_connections 2023-06-10T18:57:00.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.670+0000 7fc7fb7d4640 1 --2- 172.21.15.53:0/3150411679 >> v2:172.21.15.117:3300/0 conn(0x7fc7f40d1b00 0x7fc7f40d05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:00.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.670+0000 7fc7fb7d4640 1 --2- 172.21.15.53:0/3150411679 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7f40cc690 0x7fc7f40d00a0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:00.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.670+0000 7fc7fb7d4640 1 -- 172.21.15.53:0/3150411679 >> 172.21.15.53:0/3150411679 conn(0x7fc7f4069de0 msgr2=0x7fc7f406a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:00.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.670+0000 7fc7fb7d4640 1 -- 172.21.15.53:0/3150411679 shutdown_connections 2023-06-10T18:57:00.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.670+0000 7fc7fb7d4640 1 -- 172.21.15.53:0/3150411679 wait complete. 2023-06-10T18:57:00.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.670+0000 7fc7fb7d4640 1 Processor -- start 2023-06-10T18:57:00.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.670+0000 7fc7fb7d4640 1 -- start start 2023-06-10T18:57:00.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.670+0000 7fc7fb7d4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7f40b3ac0 0x7fc7f415c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:00.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.670+0000 7fc7fb7d4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7f40cc690 0x7fc7f415c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:00.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.670+0000 7fc7fb7d4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7f40d1b00 0x7fc7f40b6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:00.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.670+0000 7fc7fb7d4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f415a880 con 0x7fc7f40cc690 2023-06-10T18:57:00.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.670+0000 7fc7fb7d4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f415c660 con 0x7fc7f40d1b00 2023-06-10T18:57:00.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.670+0000 7fc7fb7d4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f4159f50 con 0x7fc7f40b3ac0 2023-06-10T18:57:00.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.670+0000 7fc7f8d6f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7f40cc690 0x7fc7f415c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:00.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.670+0000 7fc7f8d6f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7f40cc690 0x7fc7f415c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37824/0 (socket says 172.21.15.53:37824) 2023-06-10T18:57:00.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.670+0000 7fc7f8d6f640 1 -- 172.21.15.53:0/2582334033 learned_addr learned my addr 172.21.15.53:0/2582334033 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:57:00.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.670+0000 7fc7f9d71640 1 --2- 172.21.15.53:0/2582334033 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7f40d1b00 0x7fc7f40b6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:00.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.670+0000 7fc7f9570640 1 --2- 172.21.15.53:0/2582334033 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7f40b3ac0 0x7fc7f415c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:00.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.670+0000 7fc7f8d6f640 1 -- 172.21.15.53:0/2582334033 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7f40b3ac0 msgr2=0x7fc7f415c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:00.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.670+0000 7fc7f8d6f640 1 --2- 172.21.15.53:0/2582334033 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7f40b3ac0 0x7fc7f415c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:00.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.670+0000 7fc7f8d6f640 1 -- 172.21.15.53:0/2582334033 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7f40d1b00 msgr2=0x7fc7f40b6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:00.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.670+0000 7fc7f8d6f640 1 --2- 172.21.15.53:0/2582334033 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7f40d1b00 0x7fc7f40b6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:00.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.670+0000 7fc7f8d6f640 1 -- 172.21.15.53:0/2582334033 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7e40094d0 con 0x7fc7f40cc690 2023-06-10T18:57:00.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.670+0000 7fc7f9d71640 1 --2- 172.21.15.53:0/2582334033 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7f40d1b00 0x7fc7f40b6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:57:00.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.670+0000 7fc7f9570640 1 --2- 172.21.15.53:0/2582334033 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7f40b3ac0 0x7fc7f415c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:57:00.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.670+0000 7fc7f8d6f640 1 --2- 172.21.15.53:0/2582334033 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7f40cc690 0x7fc7f415c120 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fc7e4018fc0 tx=0x7fc7e4019150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:00.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.670+0000 7fc7e9ffb640 1 -- 172.21.15.53:0/2582334033 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e40b5640 con 0x7fc7f40cc690 2023-06-10T18:57:00.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.670+0000 7fc7e9ffb640 1 -- 172.21.15.53:0/2582334033 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7e40b57a0 con 0x7fc7f40cc690 2023-06-10T18:57:00.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.670+0000 7fc7fb7d4640 1 -- 172.21.15.53:0/2582334033 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7f415a230 con 0x7fc7f40cc690 2023-06-10T18:57:00.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.670+0000 7fc7e9ffb640 1 -- 172.21.15.53:0/2582334033 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e40b5b10 con 0x7fc7f40cc690 2023-06-10T18:57:00.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.670+0000 7fc7fb7d4640 1 -- 172.21.15.53:0/2582334033 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7f415cf00 con 0x7fc7f40cc690 2023-06-10T18:57:00.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.674+0000 7fc7fb7d4640 1 -- 172.21.15.53:0/2582334033 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7f404d790 con 0x7fc7f40cc690 2023-06-10T18:57:00.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.674+0000 7fc7e9ffb640 1 -- 172.21.15.53:0/2582334033 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc7e40b3070 con 0x7fc7f40cc690 2023-06-10T18:57:00.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.674+0000 7fc7e9ffb640 1 --2- 172.21.15.53:0/2582334033 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc7d8066280 0x7fc7d8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:00.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.674+0000 7fc7e9ffb640 1 -- 172.21.15.53:0/2582334033 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fc7e411dda0 con 0x7fc7f40cc690 2023-06-10T18:57:00.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.674+0000 7fc7f9570640 1 --2- 172.21.15.53:0/2582334033 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc7d8066280 0x7fc7d8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:00.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.674+0000 7fc7f9570640 1 --2- 172.21.15.53:0/2582334033 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc7d8066280 0x7fc7d8068730 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fc7f0007fd0 tx=0x7fc7f0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:00.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.678+0000 7fc7e9ffb640 1 -- 172.21.15.53:0/2582334033 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc7e40eb300 con 0x7fc7f40cc690 2023-06-10T18:57:00.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:00.870+0000 7fc7fb7d4640 1 -- 172.21.15.53:0/2582334033 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fc7f406ac70 con 0x7fc7f40cc690 2023-06-10T18:57:01.842 INFO:tasks.ceph.mon.a.smithi053.stderr:2023-06-10T18:57:01.838+0000 7f74752c1640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-06-10T18:57:01.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:01.846+0000 7fc7e9ffb640 1 -- 172.21.15.53:0/2582334033 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v21) v1 ==== 161+0+0 (secure 0 0 0) 0x7fc7e40b1090 con 0x7fc7f40cc690 2023-06-10T18:57:01.851 INFO:teuthology.orchestra.run.smithi053.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-06-10T18:57:01.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:01.846+0000 7fc7fb7d4640 1 -- 172.21.15.53:0/2582334033 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc7d8066280 msgr2=0x7fc7d8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:01.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:01.846+0000 7fc7fb7d4640 1 --2- 172.21.15.53:0/2582334033 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc7d8066280 0x7fc7d8068730 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fc7f0007fd0 tx=0x7fc7f0009040 comp rx=0 tx=0).stop 2023-06-10T18:57:01.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:01.846+0000 7fc7fb7d4640 1 -- 172.21.15.53:0/2582334033 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7f40cc690 msgr2=0x7fc7f415c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:01.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:01.846+0000 7fc7fb7d4640 1 --2- 172.21.15.53:0/2582334033 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7f40cc690 0x7fc7f415c120 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fc7e4018fc0 tx=0x7fc7e4019150 comp rx=0 tx=0).stop 2023-06-10T18:57:01.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:01.846+0000 7fc7fb7d4640 1 -- 172.21.15.53:0/2582334033 shutdown_connections 2023-06-10T18:57:01.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:01.846+0000 7fc7fb7d4640 1 --2- 172.21.15.53:0/2582334033 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc7d8066280 0x7fc7d8068730 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:01.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:01.846+0000 7fc7fb7d4640 1 --2- 172.21.15.53:0/2582334033 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7f40d1b00 0x7fc7f40b6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:01.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:01.846+0000 7fc7fb7d4640 1 --2- 172.21.15.53:0/2582334033 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7f40cc690 0x7fc7f415c120 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:01.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:01.850+0000 7fc7fb7d4640 1 --2- 172.21.15.53:0/2582334033 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7f40b3ac0 0x7fc7f415c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:01.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:01.850+0000 7fc7fb7d4640 1 -- 172.21.15.53:0/2582334033 >> 172.21.15.53:0/2582334033 conn(0x7fc7f4069de0 msgr2=0x7fc7f4158cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:01.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:01.850+0000 7fc7fb7d4640 1 -- 172.21.15.53:0/2582334033 shutdown_connections 2023-06-10T18:57:01.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:01.850+0000 7fc7fb7d4640 1 -- 172.21.15.53:0/2582334033 wait complete. 2023-06-10T18:57:01.857 INFO:tasks.ceph.mds.c.smithi053.stderr: -4407> 2023-06-10T18:56:24.267+0000 7faad20a8640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-06-10T18:57:01.877 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-06-10T18:57:01.899 INFO:tasks.ceph.mds.c.smithi053.stdout:starting mds.c at 2023-06-10T18:57:02.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:02.002+0000 7effac6fa640 1 Processor -- start 2023-06-10T18:57:02.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:02.002+0000 7effac6fa640 1 -- start start 2023-06-10T18:57:02.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:02.006+0000 7effac6fa640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7effa40c9fa0 0x7effa406bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:02.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:02.006+0000 7effac6fa640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effa40af760 0x7effa40afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:02.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:02.006+0000 7effac6fa640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effa406b090 con 0x7effa406c020 2023-06-10T18:57:02.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:02.006+0000 7effac6fa640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effa40b0120 con 0x7effa40c9fa0 2023-06-10T18:57:02.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:02.006+0000 7effac6fa640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effa40ca370 con 0x7effa40af760 2023-06-10T18:57:02.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:02.006+0000 7effa9c95640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7effa406c020 0x7effa40c82a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:48880/0 (socket says 172.21.15.53:48880) 2023-06-10T18:57:02.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:02.006+0000 7effa9c95640 1 -- 172.21.15.53:0/3284450694 learned_addr learned my addr 172.21.15.53:0/3284450694 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:57:02.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:02.006+0000 7effaa496640 1 --2- 172.21.15.53:0/3284450694 >> v2:172.21.15.53:3300/0 conn(0x7effa40c9fa0 0x7effa406bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:02.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:02.006+0000 7effa9494640 1 -- 172.21.15.53:0/3284450694 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 380549755 0 0) 0x7effa406b090 con 0x7effa406c020 2023-06-10T18:57:02.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:02.006+0000 7effa9494640 1 -- 172.21.15.53:0/3284450694 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff90003530 con 0x7effa406c020 2023-06-10T18:57:02.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:02.006+0000 7effaac97640 1 --2- 172.21.15.53:0/3284450694 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effa40af760 0x7effa40afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:02.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:02.006+0000 7effaa496640 1 -- 172.21.15.53:0/3284450694 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effa40af760 msgr2=0x7effa40afbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:02.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:02.006+0000 7effaa496640 1 --2- 172.21.15.53:0/3284450694 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effa40af760 0x7effa40afbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:02.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:02.006+0000 7effaa496640 1 -- 172.21.15.53:0/3284450694 >> v1:172.21.15.53:6789/0 conn(0x7effa406c020 legacy=0x7effa40c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:02.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:02.006+0000 7effaa496640 1 -- 172.21.15.53:0/3284450694 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa4070d50 con 0x7effa40c9fa0 2023-06-10T18:57:02.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:02.006+0000 7effaac97640 1 --2- 172.21.15.53:0/3284450694 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effa40af760 0x7effa40afbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:57:02.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:02.006+0000 7effaa496640 1 --2- 172.21.15.53:0/3284450694 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7effa40c9fa0 0x7effa406bae0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7effa00097c0 tx=0x7effa001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f3e1a63cf763533 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:02.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:02.006+0000 7effa9494640 1 -- 172.21.15.53:0/3284450694 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa00ab600 con 0x7effa40c9fa0 2023-06-10T18:57:02.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:02.006+0000 7effa9494640 1 -- 172.21.15.53:0/3284450694 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effa00a7050 con 0x7effa40c9fa0 2023-06-10T18:57:02.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:02.006+0000 7effa9494640 1 -- 172.21.15.53:0/3284450694 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa00ab980 con 0x7effa40c9fa0 2023-06-10T18:57:02.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:02.006+0000 7effac6fa640 1 -- 172.21.15.53:0/3284450694 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7effa40c9fa0 msgr2=0x7effa406bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:02.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:02.006+0000 7effac6fa640 1 --2- 172.21.15.53:0/3284450694 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7effa40c9fa0 0x7effa406bae0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7effa00097c0 tx=0x7effa001c3c0 comp rx=0 tx=0).stop 2023-06-10T18:57:02.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:02.010+0000 7effac6fa640 1 -- 172.21.15.53:0/3284450694 shutdown_connections 2023-06-10T18:57:02.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:02.010+0000 7effac6fa640 1 --2- 172.21.15.53:0/3284450694 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effa40af760 0x7effa40afbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:02.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:02.010+0000 7effac6fa640 1 --2- 172.21.15.53:0/3284450694 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7effa40c9fa0 0x7effa406bae0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:02.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:02.010+0000 7effac6fa640 1 -- 172.21.15.53:0/3284450694 >> 172.21.15.53:0/3284450694 conn(0x7effa406a0e0 msgr2=0x7effa40cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:02.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:02.010+0000 7effac6fa640 1 -- 172.21.15.53:0/3284450694 shutdown_connections 2023-06-10T18:57:02.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:02.010+0000 7effac6fa640 1 -- 172.21.15.53:0/3284450694 wait complete. 2023-06-10T18:57:02.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:02.010+0000 7effac6fa640 1 Processor -- start 2023-06-10T18:57:02.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:02.010+0000 7effac6fa640 1 -- start start 2023-06-10T18:57:02.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:02.010+0000 7effac6fa640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effa406c020 0x7effa40c60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:02.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:02.010+0000 7effac6fa640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7effa40af760 0x7effa40c0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:02.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:02.010+0000 7effac6fa640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effa40c9fa0 0x7effa40c4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:02.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:02.010+0000 7effac6fa640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa40c2bb0 con 0x7effa40af760 2023-06-10T18:57:02.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:02.010+0000 7effac6fa640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa40c20f0 con 0x7effa406c020 2023-06-10T18:57:02.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:02.010+0000 7effac6fa640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effa40c5cc0 con 0x7effa40c9fa0 2023-06-10T18:57:02.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:02.010+0000 7effa9c95640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7effa40af760 0x7effa40c0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:02.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:02.010+0000 7effa9c95640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7effa40af760 0x7effa40c0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35224/0 (socket says 172.21.15.53:35224) 2023-06-10T18:57:02.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:02.010+0000 7effa9c95640 1 -- 172.21.15.53:0/3975312637 learned_addr learned my addr 172.21.15.53:0/3975312637 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:57:02.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:02.010+0000 7effaac97640 1 --2- 172.21.15.53:0/3975312637 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effa40c9fa0 0x7effa40c4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:02.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:02.010+0000 7effaa496640 1 --2- 172.21.15.53:0/3975312637 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effa406c020 0x7effa40c60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:02.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:02.010+0000 7effa9c95640 1 -- 172.21.15.53:0/3975312637 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effa40c9fa0 msgr2=0x7effa40c4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:02.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:02.010+0000 7effa9c95640 1 --2- 172.21.15.53:0/3975312637 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effa40c9fa0 0x7effa40c4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:02.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:02.010+0000 7effa9c95640 1 -- 172.21.15.53:0/3975312637 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effa406c020 msgr2=0x7effa40c60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:02.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:02.010+0000 7effa9c95640 1 --2- 172.21.15.53:0/3975312637 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effa406c020 0x7effa40c60e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:02.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:02.010+0000 7effa9c95640 1 -- 172.21.15.53:0/3975312637 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa0009420 con 0x7effa40af760 2023-06-10T18:57:02.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:02.010+0000 7effaac97640 1 --2- 172.21.15.53:0/3975312637 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effa40c9fa0 0x7effa40c4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:57:02.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:02.010+0000 7effaa496640 1 --2- 172.21.15.53:0/3975312637 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effa406c020 0x7effa40c60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:57:02.020 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:02.010+0000 7effa9c95640 1 --2- 172.21.15.53:0/3975312637 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7effa40af760 0x7effa40c0af0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7eff9400c420 tx=0x7eff9400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:02.020 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:02.010+0000 7eff9affd640 1 -- 172.21.15.53:0/3975312637 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff94005cf0 con 0x7effa40af760 2023-06-10T18:57:02.020 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:02.010+0000 7eff9affd640 1 -- 172.21.15.53:0/3975312637 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff94005e50 con 0x7effa40af760 2023-06-10T18:57:02.020 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:02.010+0000 7effac6fa640 1 -- 172.21.15.53:0/3975312637 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effa40c23b0 con 0x7effa40af760 2023-06-10T18:57:02.020 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:02.010+0000 7eff9affd640 1 -- 172.21.15.53:0/3975312637 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff940072d0 con 0x7effa40af760 2023-06-10T18:57:02.020 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:02.010+0000 7effac6fa640 1 -- 172.21.15.53:0/3975312637 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effa40c1030 con 0x7effa40af760 2023-06-10T18:57:02.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:02.014+0000 7effac6fa640 1 -- 172.21.15.53:0/3975312637 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effa40c28d0 con 0x7effa40af760 2023-06-10T18:57:02.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:02.014+0000 7eff9affd640 1 -- 172.21.15.53:0/3975312637 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7eff94007430 con 0x7effa40af760 2023-06-10T18:57:02.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:02.014+0000 7eff9affd640 1 --2- 172.21.15.53:0/3975312637 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7eff88066280 0x7eff88068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:02.022 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:02.014+0000 7eff9affd640 1 -- 172.21.15.53:0/3975312637 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6206+0+0 (secure 0 0 0) 0x7eff94083290 con 0x7effa40af760 2023-06-10T18:57:02.022 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:02.014+0000 7effaa496640 1 --2- 172.21.15.53:0/3975312637 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7eff88066280 0x7eff88068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:02.022 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:02.014+0000 7effaa496640 1 --2- 172.21.15.53:0/3975312637 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7eff88066280 0x7eff88068730 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7effa00ad000 tx=0x7effa0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:02.023 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:02.018+0000 7eff9affd640 1 -- 172.21.15.53:0/3975312637 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7effa40c28d0 con 0x7effa40af760 2023-06-10T18:57:02.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:02.206+0000 7effac6fa640 1 -- 172.21.15.53:0/3975312637 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7effa40c28d0 con 0x7effa40af760 2023-06-10T18:57:02.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:02.846+0000 7eff9affd640 1 -- 172.21.15.53:0/3975312637 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v22) v1 ==== 104+0+0 (secure 0 0 0) 0x7effa40c28d0 con 0x7effa40af760 2023-06-10T18:57:02.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:02.850+0000 7effac6fa640 1 -- 172.21.15.53:0/3975312637 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7eff88066280 msgr2=0x7eff88068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:02.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:02.850+0000 7effac6fa640 1 --2- 172.21.15.53:0/3975312637 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7eff88066280 0x7eff88068730 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7effa00ad000 tx=0x7effa0008040 comp rx=0 tx=0).stop 2023-06-10T18:57:02.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:02.850+0000 7effac6fa640 1 -- 172.21.15.53:0/3975312637 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7effa40af760 msgr2=0x7effa40c0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:02.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:02.850+0000 7effac6fa640 1 --2- 172.21.15.53:0/3975312637 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7effa40af760 0x7effa40c0af0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7eff9400c420 tx=0x7eff9400c8e0 comp rx=0 tx=0).stop 2023-06-10T18:57:02.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:02.850+0000 7effac6fa640 1 -- 172.21.15.53:0/3975312637 shutdown_connections 2023-06-10T18:57:02.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:02.850+0000 7effac6fa640 1 --2- 172.21.15.53:0/3975312637 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7eff88066280 0x7eff88068730 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:02.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:02.850+0000 7effac6fa640 1 --2- 172.21.15.53:0/3975312637 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7effa40c9fa0 0x7effa40c4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:02.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:02.850+0000 7effac6fa640 1 --2- 172.21.15.53:0/3975312637 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7effa40af760 0x7effa40c0af0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:02.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:02.850+0000 7effac6fa640 1 --2- 172.21.15.53:0/3975312637 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effa406c020 0x7effa40c60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:02.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:02.850+0000 7effac6fa640 1 -- 172.21.15.53:0/3975312637 >> 172.21.15.53:0/3975312637 conn(0x7effa406a0e0 msgr2=0x7effa40b0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:02.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:02.850+0000 7effac6fa640 1 -- 172.21.15.53:0/3975312637 shutdown_connections 2023-06-10T18:57:02.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:02.850+0000 7effac6fa640 1 -- 172.21.15.53:0/3975312637 wait complete. 2023-06-10T18:57:02.880 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-06-10T18:57:03.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:03.050+0000 7f349a023640 1 Processor -- start 2023-06-10T18:57:03.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:03.050+0000 7f349a023640 1 -- start start 2023-06-10T18:57:03.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:03.050+0000 7f349a023640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3494159390 0x7f349415d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:03.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:03.050+0000 7f349a023640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f349415d6e0 0x7f34940cec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:03.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:03.050+0000 7f349a023640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34940cb460 con 0x7f3494159760 2023-06-10T18:57:03.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:03.050+0000 7f349a023640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f349415e1b0 con 0x7f3494159390 2023-06-10T18:57:03.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:03.050+0000 7f349a023640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f349415dbf0 con 0x7f349415d6e0 2023-06-10T18:57:03.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:03.050+0000 7f34937fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3494159390 0x7f349415d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:03.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:03.050+0000 7f3493fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f3494159760 0x7f34940cda40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:48890/0 (socket says 172.21.15.53:48890) 2023-06-10T18:57:03.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:03.054+0000 7f3493fff640 1 -- 172.21.15.53:0/2565624855 learned_addr learned my addr 172.21.15.53:0/2565624855 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:57:03.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:03.054+0000 7f3492ffd640 1 --2- 172.21.15.53:0/2565624855 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f349415d6e0 0x7f34940cec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:03.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:03.054+0000 7f34937fe640 1 -- 172.21.15.53:0/2565624855 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f349415d6e0 msgr2=0x7f34940cec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:03.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:03.054+0000 7f34937fe640 1 --2- 172.21.15.53:0/2565624855 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f349415d6e0 0x7f34940cec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:03.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:03.054+0000 7f34937fe640 1 -- 172.21.15.53:0/2565624855 >> v1:172.21.15.53:6789/0 conn(0x7f3494159760 legacy=0x7f34940cda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:03.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:03.054+0000 7f34937fe640 1 -- 172.21.15.53:0/2565624855 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f349415ded0 con 0x7f3494159390 2023-06-10T18:57:03.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:03.054+0000 7f34927fc640 1 -- 172.21.15.53:0/2565624855 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2851403756 0 0) 0x7f34940cb460 con 0x7f3494159760 2023-06-10T18:57:03.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:03.054+0000 7f3492ffd640 1 --2- 172.21.15.53:0/2565624855 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f349415d6e0 0x7f34940cec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:57:03.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:03.054+0000 7f34937fe640 1 --2- 172.21.15.53:0/2565624855 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3494159390 0x7f349415d1a0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f34840097c0 tx=0x7f348401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=755389cba9abbe9 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:03.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:03.054+0000 7f34927fc640 1 -- 172.21.15.53:0/2565624855 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34840ab650 con 0x7f3494159390 2023-06-10T18:57:03.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:03.054+0000 7f34927fc640 1 -- 172.21.15.53:0/2565624855 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34840ab7b0 con 0x7f3494159390 2023-06-10T18:57:03.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:03.054+0000 7f34927fc640 1 -- 172.21.15.53:0/2565624855 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34840abb40 con 0x7f3494159390 2023-06-10T18:57:03.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:03.054+0000 7f349a023640 1 -- 172.21.15.53:0/2565624855 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3494159390 msgr2=0x7f349415d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:03.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:03.054+0000 7f349a023640 1 --2- 172.21.15.53:0/2565624855 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3494159390 0x7f349415d1a0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f34840097c0 tx=0x7f348401c450 comp rx=0 tx=0).stop 2023-06-10T18:57:03.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:03.054+0000 7f349a023640 1 -- 172.21.15.53:0/2565624855 shutdown_connections 2023-06-10T18:57:03.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:03.054+0000 7f349a023640 1 --2- 172.21.15.53:0/2565624855 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f349415d6e0 0x7f34940cec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:03.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:03.054+0000 7f349a023640 1 --2- 172.21.15.53:0/2565624855 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3494159390 0x7f349415d1a0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:03.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:03.054+0000 7f349a023640 1 -- 172.21.15.53:0/2565624855 >> 172.21.15.53:0/2565624855 conn(0x7f349406a0b0 msgr2=0x7f349406d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:03.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:03.054+0000 7f349a023640 1 -- 172.21.15.53:0/2565624855 shutdown_connections 2023-06-10T18:57:03.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:03.054+0000 7f349a023640 1 -- 172.21.15.53:0/2565624855 wait complete. 2023-06-10T18:57:03.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:03.058+0000 7f349a023640 1 Processor -- start 2023-06-10T18:57:03.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:03.058+0000 7f349a023640 1 -- start start 2023-06-10T18:57:03.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:03.058+0000 7f349a023640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3494159390 0x7f3494152620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:03.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:03.058+0000 7f349a023640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3494159760 0x7f349414e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:03.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:03.058+0000 7f349a023640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f349415d6e0 0x7f349414ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:03.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:03.058+0000 7f349a023640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34941566b0 con 0x7f3494159390 2023-06-10T18:57:03.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:03.058+0000 7f349a023640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3494151810 con 0x7f349415d6e0 2023-06-10T18:57:03.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:03.058+0000 7f349a023640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3494156900 con 0x7f3494159760 2023-06-10T18:57:03.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:03.058+0000 7f34937fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3494159390 0x7f3494152620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:03.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:03.058+0000 7f34937fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3494159390 0x7f3494152620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35246/0 (socket says 172.21.15.53:35246) 2023-06-10T18:57:03.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:03.058+0000 7f34937fe640 1 -- 172.21.15.53:0/3993848380 learned_addr learned my addr 172.21.15.53:0/3993848380 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:57:03.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:03.058+0000 7f3493fff640 1 --2- 172.21.15.53:0/3993848380 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f349415d6e0 0x7f349414ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:03.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:03.058+0000 7f3492ffd640 1 --2- 172.21.15.53:0/3993848380 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3494159760 0x7f349414e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:03.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:03.058+0000 7f34937fe640 1 -- 172.21.15.53:0/3993848380 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3494159760 msgr2=0x7f349414e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:03.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:03.058+0000 7f34937fe640 1 --2- 172.21.15.53:0/3993848380 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3494159760 0x7f349414e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:03.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:03.058+0000 7f34937fe640 1 -- 172.21.15.53:0/3993848380 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f349415d6e0 msgr2=0x7f349414ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:03.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:03.058+0000 7f34937fe640 1 --2- 172.21.15.53:0/3993848380 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f349415d6e0 0x7f349414ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:03.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:03.058+0000 7f34937fe640 1 -- 172.21.15.53:0/3993848380 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3484009420 con 0x7f3494159390 2023-06-10T18:57:03.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:03.058+0000 7f34937fe640 1 --2- 172.21.15.53:0/3993848380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3494159390 0x7f3494152620 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f34840ad040 tx=0x7f348401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:03.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:03.058+0000 7f347bfff640 1 -- 172.21.15.53:0/3993848380 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34840b5810 con 0x7f3494159390 2023-06-10T18:57:03.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:03.058+0000 7f347bfff640 1 -- 172.21.15.53:0/3993848380 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34840b5970 con 0x7f3494159390 2023-06-10T18:57:03.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:03.058+0000 7f349a023640 1 -- 172.21.15.53:0/3993848380 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3494156be0 con 0x7f3494159390 2023-06-10T18:57:03.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:03.058+0000 7f347bfff640 1 -- 172.21.15.53:0/3993848380 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34840b5d20 con 0x7f3494159390 2023-06-10T18:57:03.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:03.058+0000 7f349a023640 1 -- 172.21.15.53:0/3993848380 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3494152b60 con 0x7f3494159390 2023-06-10T18:57:03.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:03.058+0000 7f349a023640 1 -- 172.21.15.53:0/3993848380 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f349404d790 con 0x7f3494159390 2023-06-10T18:57:03.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:03.058+0000 7f347bfff640 1 -- 172.21.15.53:0/3993848380 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f34840bf410 con 0x7f3494159390 2023-06-10T18:57:03.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:03.062+0000 7f347bfff640 1 --2- 172.21.15.53:0/3993848380 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3480066280 0x7f3480068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:03.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:03.062+0000 7f347bfff640 1 -- 172.21.15.53:0/3993848380 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6206+0+0 (secure 0 0 0) 0x7f348411ef00 con 0x7f3494159390 2023-06-10T18:57:03.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:03.062+0000 7f3492ffd640 1 --2- 172.21.15.53:0/3993848380 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3480066280 0x7f3480068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:03.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:03.062+0000 7f3492ffd640 1 --2- 172.21.15.53:0/3993848380 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3480066280 0x7f3480068730 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f3488006fd0 tx=0x7f3488008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:03.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:03.066+0000 7f347bfff640 1 -- 172.21.15.53:0/3993848380 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f34840ec4a0 con 0x7f3494159390 2023-06-10T18:57:03.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:03.214+0000 7f349a023640 1 -- 172.21.15.53:0/3993848380 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3494156a40 con 0x7f3494159390 2023-06-10T18:57:04.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:04.166+0000 7f347bfff640 1 -- 172.21.15.53:0/3993848380 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v55) v1 ==== 181+0+0 (secure 0 0 0) 0x7f3494156a40 con 0x7f3494159390 2023-06-10T18:57:04.171 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_metadata' removed 2023-06-10T18:57:04.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:04.170+0000 7f349a023640 1 -- 172.21.15.53:0/3993848380 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3480066280 msgr2=0x7f3480068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:04.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:04.170+0000 7f349a023640 1 --2- 172.21.15.53:0/3993848380 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3480066280 0x7f3480068730 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f3488006fd0 tx=0x7f3488008040 comp rx=0 tx=0).stop 2023-06-10T18:57:04.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:04.170+0000 7f349a023640 1 -- 172.21.15.53:0/3993848380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3494159390 msgr2=0x7f3494152620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:04.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:04.170+0000 7f349a023640 1 --2- 172.21.15.53:0/3993848380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3494159390 0x7f3494152620 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f34840ad040 tx=0x7f348401ac90 comp rx=0 tx=0).stop 2023-06-10T18:57:04.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:04.170+0000 7f349a023640 1 -- 172.21.15.53:0/3993848380 shutdown_connections 2023-06-10T18:57:04.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:04.170+0000 7f349a023640 1 --2- 172.21.15.53:0/3993848380 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3480066280 0x7f3480068730 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:04.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:04.170+0000 7f349a023640 1 --2- 172.21.15.53:0/3993848380 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f349415d6e0 0x7f349414ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:04.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:04.170+0000 7f349a023640 1 --2- 172.21.15.53:0/3993848380 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3494159760 0x7f349414e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:04.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:04.170+0000 7f349a023640 1 --2- 172.21.15.53:0/3993848380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3494159390 0x7f3494152620 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:04.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:04.170+0000 7f349a023640 1 -- 172.21.15.53:0/3993848380 >> 172.21.15.53:0/3993848380 conn(0x7f349406a0b0 msgr2=0x7f34940b1220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:04.180 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:04.174+0000 7f349a023640 1 -- 172.21.15.53:0/3993848380 shutdown_connections 2023-06-10T18:57:04.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:04.174+0000 7f349a023640 1 -- 172.21.15.53:0/3993848380 wait complete. 2023-06-10T18:57:04.208 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-06-10T18:57:04.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:04.338+0000 7f2b9d4c0640 1 Processor -- start 2023-06-10T18:57:04.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:04.338+0000 7f2b9d4c0640 1 -- start start 2023-06-10T18:57:04.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:04.342+0000 7f2b9d4c0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b980afaa0 0x7f2b98069c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:04.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:04.342+0000 7f2b9d4c0640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2b9806cc30 0x7f2b9806a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:04.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:04.342+0000 7f2b9d4c0640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2b980b3d80 0x7f2b9806a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:04.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:04.342+0000 7f2b9d4c0640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b98069860 con 0x7f2b9806cc30 2023-06-10T18:57:04.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:04.342+0000 7f2b9d4c0640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b980b0d70 con 0x7f2b980b3d80 2023-06-10T18:57:04.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:04.342+0000 7f2b9d4c0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b980694f0 con 0x7f2b980afaa0 2023-06-10T18:57:04.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:04.342+0000 7f2b967fc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2b9806cc30 0x7f2b9806a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:04.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:04.342+0000 7f2b967fc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2b9806cc30 0x7f2b9806a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35256/0 (socket says 172.21.15.53:35256) 2023-06-10T18:57:04.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:04.342+0000 7f2b967fc640 1 -- 172.21.15.53:0/4275958230 learned_addr learned my addr 172.21.15.53:0/4275958230 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:57:04.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:04.342+0000 7f2b967fc640 1 -- 172.21.15.53:0/4275958230 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b980afaa0 msgr2=0x7f2b98069c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:04.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:04.342+0000 7f2b967fc640 1 --2- 172.21.15.53:0/4275958230 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b980afaa0 0x7f2b98069c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:04.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:04.342+0000 7f2b967fc640 1 -- 172.21.15.53:0/4275958230 >> v2:172.21.15.117:3300/0 conn(0x7f2b980b3d80 msgr2=0x7f2b9806a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:04.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:04.342+0000 7f2b967fc640 1 --2- 172.21.15.53:0/4275958230 >> v2:172.21.15.117:3300/0 conn(0x7f2b980b3d80 0x7f2b9806a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:04.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:04.342+0000 7f2b967fc640 1 -- 172.21.15.53:0/4275958230 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b98159c70 con 0x7f2b9806cc30 2023-06-10T18:57:04.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:04.342+0000 7f2b967fc640 1 --2- 172.21.15.53:0/4275958230 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b9806cc30 0x7f2b9806a1c0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f2b98159c00 tx=0x7f2b8c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=830bd6e370649894 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:04.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:04.342+0000 7f2b95ffb640 1 -- 172.21.15.53:0/4275958230 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c0aa5f0 con 0x7f2b9806cc30 2023-06-10T18:57:04.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:04.342+0000 7f2b95ffb640 1 -- 172.21.15.53:0/4275958230 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b8c0aa750 con 0x7f2b9806cc30 2023-06-10T18:57:04.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:04.342+0000 7f2b95ffb640 1 -- 172.21.15.53:0/4275958230 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c0aaae0 con 0x7f2b9806cc30 2023-06-10T18:57:04.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:04.346+0000 7f2b9d4c0640 1 -- 172.21.15.53:0/4275958230 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b9806cc30 msgr2=0x7f2b9806a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:04.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:04.346+0000 7f2b9d4c0640 1 --2- 172.21.15.53:0/4275958230 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b9806cc30 0x7f2b9806a1c0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f2b98159c00 tx=0x7f2b8c01c4d0 comp rx=0 tx=0).stop 2023-06-10T18:57:04.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:04.346+0000 7f2b9d4c0640 1 -- 172.21.15.53:0/4275958230 shutdown_connections 2023-06-10T18:57:04.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:04.346+0000 7f2b9d4c0640 1 --2- 172.21.15.53:0/4275958230 >> v2:172.21.15.117:3300/0 conn(0x7f2b980b3d80 0x7f2b9806a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:04.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:04.346+0000 7f2b9d4c0640 1 --2- 172.21.15.53:0/4275958230 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b9806cc30 0x7f2b9806a1c0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:04.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:04.346+0000 7f2b9d4c0640 1 --2- 172.21.15.53:0/4275958230 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b980afaa0 0x7f2b98069c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:04.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:04.346+0000 7f2b9d4c0640 1 -- 172.21.15.53:0/4275958230 >> 172.21.15.53:0/4275958230 conn(0x7f2b980cf170 msgr2=0x7f2b980b3670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:04.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:04.346+0000 7f2b9d4c0640 1 -- 172.21.15.53:0/4275958230 shutdown_connections 2023-06-10T18:57:04.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:04.346+0000 7f2b9d4c0640 1 -- 172.21.15.53:0/4275958230 wait complete. 2023-06-10T18:57:04.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:04.346+0000 7f2b9d4c0640 1 Processor -- start 2023-06-10T18:57:04.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:04.346+0000 7f2b9d4c0640 1 -- start start 2023-06-10T18:57:04.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:04.346+0000 7f2b9d4c0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b9806cc30 0x7f2b98149df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:04.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:04.346+0000 7f2b9d4c0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b980afaa0 0x7f2b980b1f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:04.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:04.346+0000 7f2b9d4c0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b980b3d80 0x7f2b980ac0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:04.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:04.346+0000 7f2b9d4c0640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b9814a330 con 0x7f2b9806cc30 2023-06-10T18:57:04.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:04.346+0000 7f2b9d4c0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b981574a0 con 0x7f2b980b3d80 2023-06-10T18:57:04.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:04.346+0000 7f2b9d4c0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b98157740 con 0x7f2b980afaa0 2023-06-10T18:57:04.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:04.346+0000 7f2b96ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b9806cc30 0x7f2b98149df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:04.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:04.346+0000 7f2b96ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b9806cc30 0x7f2b98149df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35268/0 (socket says 172.21.15.53:35268) 2023-06-10T18:57:04.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:04.346+0000 7f2b96ffd640 1 -- 172.21.15.53:0/1632077805 learned_addr learned my addr 172.21.15.53:0/1632077805 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:57:04.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:04.346+0000 7f2b96ffd640 1 -- 172.21.15.53:0/1632077805 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b980afaa0 msgr2=0x7f2b980b1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:04.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:04.346+0000 7f2b96ffd640 1 --2- 172.21.15.53:0/1632077805 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b980afaa0 0x7f2b980b1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:04.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:04.346+0000 7f2b96ffd640 1 -- 172.21.15.53:0/1632077805 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b980b3d80 msgr2=0x7f2b980ac0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:04.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:04.346+0000 7f2b96ffd640 1 --2- 172.21.15.53:0/1632077805 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b980b3d80 0x7f2b980ac0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:04.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:04.346+0000 7f2b96ffd640 1 -- 172.21.15.53:0/1632077805 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b8c0094d0 con 0x7f2b9806cc30 2023-06-10T18:57:04.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:04.346+0000 7f2b96ffd640 1 --2- 172.21.15.53:0/1632077805 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b9806cc30 0x7f2b98149df0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f2b8800b550 tx=0x7f2b8800ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:04.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:04.346+0000 7f2b7f7fe640 1 -- 172.21.15.53:0/1632077805 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b88010870 con 0x7f2b9806cc30 2023-06-10T18:57:04.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:04.346+0000 7f2b7f7fe640 1 -- 172.21.15.53:0/1632077805 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b880109f0 con 0x7f2b9806cc30 2023-06-10T18:57:04.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:04.346+0000 7f2b9d4c0640 1 -- 172.21.15.53:0/1632077805 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b98157a20 con 0x7f2b9806cc30 2023-06-10T18:57:04.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:04.346+0000 7f2b7f7fe640 1 -- 172.21.15.53:0/1632077805 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b88010da0 con 0x7f2b9806cc30 2023-06-10T18:57:04.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:04.346+0000 7f2b9d4c0640 1 -- 172.21.15.53:0/1632077805 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b980abbd0 con 0x7f2b9806cc30 2023-06-10T18:57:04.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:04.350+0000 7f2b9d4c0640 1 -- 172.21.15.53:0/1632077805 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b9804d790 con 0x7f2b9806cc30 2023-06-10T18:57:04.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:04.350+0000 7f2b7f7fe640 1 -- 172.21.15.53:0/1632077805 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2b8800f3c0 con 0x7f2b9806cc30 2023-06-10T18:57:04.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:04.350+0000 7f2b7f7fe640 1 --2- 172.21.15.53:0/1632077805 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2b84066280 0x7f2b84068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:04.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:04.350+0000 7f2b7f7fe640 1 -- 172.21.15.53:0/1632077805 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5768+0+0 (secure 0 0 0) 0x7f2b88083cb0 con 0x7f2b9806cc30 2023-06-10T18:57:04.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:04.350+0000 7f2b967fc640 1 --2- 172.21.15.53:0/1632077805 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2b84066280 0x7f2b84068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:04.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:04.350+0000 7f2b967fc640 1 --2- 172.21.15.53:0/1632077805 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2b84066280 0x7f2b84068730 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c0ae000 tx=0x7f2b8c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:04.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:04.354+0000 7f2b7f7fe640 1 -- 172.21.15.53:0/1632077805 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2b880511b0 con 0x7f2b9806cc30 2023-06-10T18:57:04.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:04.510+0000 7f2b9d4c0640 1 -- 172.21.15.53:0/1632077805 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2b980abdc0 con 0x7f2b9806cc30 2023-06-10T18:57:05.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.170+0000 7f2b7f7fe640 1 -- 172.21.15.53:0/1632077805 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v56) v1 ==== 169+0+0 (secure 0 0 0) 0x7f2b880140d0 con 0x7f2b9806cc30 2023-06-10T18:57:05.179 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_data' removed 2023-06-10T18:57:05.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.178+0000 7f2b9d4c0640 1 -- 172.21.15.53:0/1632077805 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2b84066280 msgr2=0x7f2b84068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:05.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.178+0000 7f2b9d4c0640 1 --2- 172.21.15.53:0/1632077805 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2b84066280 0x7f2b84068730 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c0ae000 tx=0x7f2b8c008040 comp rx=0 tx=0).stop 2023-06-10T18:57:05.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.178+0000 7f2b9d4c0640 1 -- 172.21.15.53:0/1632077805 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b9806cc30 msgr2=0x7f2b98149df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:05.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.178+0000 7f2b9d4c0640 1 --2- 172.21.15.53:0/1632077805 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b9806cc30 0x7f2b98149df0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f2b8800b550 tx=0x7f2b8800ba10 comp rx=0 tx=0).stop 2023-06-10T18:57:05.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.182+0000 7f2b9d4c0640 1 -- 172.21.15.53:0/1632077805 shutdown_connections 2023-06-10T18:57:05.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.182+0000 7f2b9d4c0640 1 --2- 172.21.15.53:0/1632077805 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2b84066280 0x7f2b84068730 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:05.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.182+0000 7f2b9d4c0640 1 --2- 172.21.15.53:0/1632077805 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b980b3d80 0x7f2b980ac0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:05.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.182+0000 7f2b9d4c0640 1 --2- 172.21.15.53:0/1632077805 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b980afaa0 0x7f2b980b1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:05.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.182+0000 7f2b9d4c0640 1 --2- 172.21.15.53:0/1632077805 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b9806cc30 0x7f2b98149df0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:05.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.182+0000 7f2b9d4c0640 1 -- 172.21.15.53:0/1632077805 >> 172.21.15.53:0/1632077805 conn(0x7f2b980cf170 msgr2=0x7f2b980cd9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:05.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.186+0000 7f2b9d4c0640 1 -- 172.21.15.53:0/1632077805 shutdown_connections 2023-06-10T18:57:05.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.190+0000 7f2b9d4c0640 1 -- 172.21.15.53:0/1632077805 wait complete. 2023-06-10T18:57:05.223 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-06-10T18:57:05.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.346+0000 7f39830c6640 1 Processor -- start 2023-06-10T18:57:05.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.346+0000 7f39830c6640 1 -- start start 2023-06-10T18:57:05.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.346+0000 7f39830c6640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f397c0c9fa0 0x7f397c06bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:05.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.346+0000 7f39830c6640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f397c06c020 0x7f397c0c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:05.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.346+0000 7f39830c6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f397c0c87e0 0x7f397c0af760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:05.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.346+0000 7f39830c6640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f397c06b090 con 0x7f397c06c020 2023-06-10T18:57:05.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.346+0000 7f39830c6640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f397c0ca370 con 0x7f397c0c9fa0 2023-06-10T18:57:05.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.346+0000 7f39830c6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f397c070d50 con 0x7f397c0c87e0 2023-06-10T18:57:05.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.350+0000 7f397bfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f397c06c020 0x7f397c0c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:05.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.350+0000 7f397bfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f397c06c020 0x7f397c0c82a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35270/0 (socket says 172.21.15.53:35270) 2023-06-10T18:57:05.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.350+0000 7f397bfff640 1 -- 172.21.15.53:0/3899891523 learned_addr learned my addr 172.21.15.53:0/3899891523 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:57:05.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.350+0000 7f3981663640 1 --2- 172.21.15.53:0/3899891523 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f397c0c87e0 0x7f397c0af760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:05.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.350+0000 7f3980e62640 1 --2- 172.21.15.53:0/3899891523 >> v2:172.21.15.117:3300/0 conn(0x7f397c0c9fa0 0x7f397c06bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:05.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.350+0000 7f397bfff640 1 -- 172.21.15.53:0/3899891523 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f397c0c87e0 msgr2=0x7f397c0af760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:05.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.350+0000 7f397bfff640 1 --2- 172.21.15.53:0/3899891523 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f397c0c87e0 0x7f397c0af760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:05.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.350+0000 7f397bfff640 1 -- 172.21.15.53:0/3899891523 >> v2:172.21.15.117:3300/0 conn(0x7f397c0c9fa0 msgr2=0x7f397c06bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:05.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.350+0000 7f397bfff640 1 --2- 172.21.15.53:0/3899891523 >> v2:172.21.15.117:3300/0 conn(0x7f397c0c9fa0 0x7f397c06bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:05.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.350+0000 7f397bfff640 1 -- 172.21.15.53:0/3899891523 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f397c071030 con 0x7f397c06c020 2023-06-10T18:57:05.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.350+0000 7f397bfff640 1 --2- 172.21.15.53:0/3899891523 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f397c06c020 0x7f397c0c82a0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f397c06e9d0 tx=0x7f397001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1c7d5c5262b6416 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:05.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.350+0000 7f397b7fe640 1 -- 172.21.15.53:0/3899891523 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39700ac640 con 0x7f397c06c020 2023-06-10T18:57:05.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.350+0000 7f397b7fe640 1 -- 172.21.15.53:0/3899891523 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39700ac7a0 con 0x7f397c06c020 2023-06-10T18:57:05.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.350+0000 7f397b7fe640 1 -- 172.21.15.53:0/3899891523 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39700acb30 con 0x7f397c06c020 2023-06-10T18:57:05.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.350+0000 7f39830c6640 1 -- 172.21.15.53:0/3899891523 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f397c06c020 msgr2=0x7f397c0c82a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:05.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.350+0000 7f39830c6640 1 --2- 172.21.15.53:0/3899891523 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f397c06c020 0x7f397c0c82a0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f397c06e9d0 tx=0x7f397001c440 comp rx=0 tx=0).stop 2023-06-10T18:57:05.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.350+0000 7f39830c6640 1 -- 172.21.15.53:0/3899891523 shutdown_connections 2023-06-10T18:57:05.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.350+0000 7f39830c6640 1 --2- 172.21.15.53:0/3899891523 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f397c0c87e0 0x7f397c0af760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:05.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.350+0000 7f39830c6640 1 --2- 172.21.15.53:0/3899891523 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f397c06c020 0x7f397c0c82a0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:05.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.350+0000 7f39830c6640 1 --2- 172.21.15.53:0/3899891523 >> v2:172.21.15.117:3300/0 conn(0x7f397c0c9fa0 0x7f397c06bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:05.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.350+0000 7f39830c6640 1 -- 172.21.15.53:0/3899891523 >> 172.21.15.53:0/3899891523 conn(0x7f397c06a0e0 msgr2=0x7f397c0cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:05.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.350+0000 7f39830c6640 1 -- 172.21.15.53:0/3899891523 shutdown_connections 2023-06-10T18:57:05.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.350+0000 7f39830c6640 1 -- 172.21.15.53:0/3899891523 wait complete. 2023-06-10T18:57:05.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.354+0000 7f39830c6640 1 Processor -- start 2023-06-10T18:57:05.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.354+0000 7f39830c6640 1 -- start start 2023-06-10T18:57:05.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.354+0000 7f39830c6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f397c06c020 0x7f397c1568a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:05.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.354+0000 7f39830c6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f397c0c87e0 0x7f397c163280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:05.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.354+0000 7f39830c6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f397c0c9fa0 0x7f397c0cb820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:05.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.354+0000 7f39830c6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f397c156de0 con 0x7f397c0c9fa0 2023-06-10T18:57:05.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.354+0000 7f39830c6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f397c15ab60 con 0x7f397c06c020 2023-06-10T18:57:05.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.354+0000 7f39830c6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f397c15ade0 con 0x7f397c0c87e0 2023-06-10T18:57:05.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.354+0000 7f3981663640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f397c0c9fa0 0x7f397c0cb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:05.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.354+0000 7f3981663640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f397c0c9fa0 0x7f397c0cb820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35284/0 (socket says 172.21.15.53:35284) 2023-06-10T18:57:05.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.354+0000 7f3981663640 1 -- 172.21.15.53:0/3066636732 learned_addr learned my addr 172.21.15.53:0/3066636732 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:57:05.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.354+0000 7f397bfff640 1 --2- 172.21.15.53:0/3066636732 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f397c0c87e0 0x7f397c163280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:05.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.354+0000 7f3980e62640 1 --2- 172.21.15.53:0/3066636732 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f397c06c020 0x7f397c1568a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:05.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.354+0000 7f3981663640 1 -- 172.21.15.53:0/3066636732 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f397c0c87e0 msgr2=0x7f397c163280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:05.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.354+0000 7f3981663640 1 --2- 172.21.15.53:0/3066636732 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f397c0c87e0 0x7f397c163280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:05.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.354+0000 7f3981663640 1 -- 172.21.15.53:0/3066636732 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f397c06c020 msgr2=0x7f397c1568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:05.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.354+0000 7f3981663640 1 --2- 172.21.15.53:0/3066636732 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f397c06c020 0x7f397c1568a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:05.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.354+0000 7f3981663640 1 -- 172.21.15.53:0/3066636732 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39700094d0 con 0x7f397c0c9fa0 2023-06-10T18:57:05.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.354+0000 7f397bfff640 1 --2- 172.21.15.53:0/3066636732 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f397c0c87e0 0x7f397c163280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:57:05.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.354+0000 7f3980e62640 1 --2- 172.21.15.53:0/3066636732 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f397c06c020 0x7f397c1568a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:57:05.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.354+0000 7f3981663640 1 --2- 172.21.15.53:0/3066636732 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f397c0c9fa0 0x7f397c0cb820 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f397400d800 tx=0x7f397400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:05.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.354+0000 7f39797fa640 1 -- 172.21.15.53:0/3066636732 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39740096c0 con 0x7f397c0c9fa0 2023-06-10T18:57:05.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.354+0000 7f39797fa640 1 -- 172.21.15.53:0/3066636732 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3974009820 con 0x7f397c0c9fa0 2023-06-10T18:57:05.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.354+0000 7f39830c6640 1 -- 172.21.15.53:0/3066636732 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f397c0b2f80 con 0x7f397c0c9fa0 2023-06-10T18:57:05.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.354+0000 7f39797fa640 1 -- 172.21.15.53:0/3066636732 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3974009bd0 con 0x7f397c0c9fa0 2023-06-10T18:57:05.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.354+0000 7f39830c6640 1 -- 172.21.15.53:0/3066636732 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f397c15b0a0 con 0x7f397c0c9fa0 2023-06-10T18:57:05.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.354+0000 7f39830c6640 1 -- 172.21.15.53:0/3066636732 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f397c0b34a0 con 0x7f397c0c9fa0 2023-06-10T18:57:05.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.358+0000 7f39797fa640 1 -- 172.21.15.53:0/3066636732 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3974009d30 con 0x7f397c0c9fa0 2023-06-10T18:57:05.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.358+0000 7f39797fa640 1 --2- 172.21.15.53:0/3066636732 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3968066280 0x7f3968068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:05.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.358+0000 7f39797fa640 1 -- 172.21.15.53:0/3066636732 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f3974084160 con 0x7f397c0c9fa0 2023-06-10T18:57:05.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.358+0000 7f3980e62640 1 --2- 172.21.15.53:0/3066636732 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3968066280 0x7f3968068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:05.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.358+0000 7f3980e62640 1 --2- 172.21.15.53:0/3066636732 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3968066280 0x7f3968068730 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f396c009f50 tx=0x7f396c00b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:05.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.362+0000 7f39797fa640 1 -- 172.21.15.53:0/3066636732 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3974055370 con 0x7f397c0c9fa0 2023-06-10T18:57:05.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.514+0000 7f39830c6640 1 -- 172.21.15.53:0/3066636732 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f397c15b290 con 0x7f397c0c9fa0 2023-06-10T18:57:05.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.518+0000 7f39797fa640 1 -- 172.21.15.53:0/3066636732 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f397400b3c0 con 0x7f397c0c9fa0 2023-06-10T18:57:05.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.522+0000 7f39830c6640 1 -- 172.21.15.53:0/3066636732 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3968066280 msgr2=0x7f3968068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:05.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.522+0000 7f39830c6640 1 --2- 172.21.15.53:0/3066636732 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3968066280 0x7f3968068730 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f396c009f50 tx=0x7f396c00b040 comp rx=0 tx=0).stop 2023-06-10T18:57:05.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.522+0000 7f39830c6640 1 -- 172.21.15.53:0/3066636732 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f397c0c9fa0 msgr2=0x7f397c0cb820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:05.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.522+0000 7f39830c6640 1 --2- 172.21.15.53:0/3066636732 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f397c0c9fa0 0x7f397c0cb820 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f397400d800 tx=0x7f397400dcc0 comp rx=0 tx=0).stop 2023-06-10T18:57:05.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.522+0000 7f39830c6640 1 -- 172.21.15.53:0/3066636732 shutdown_connections 2023-06-10T18:57:05.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.522+0000 7f39830c6640 1 --2- 172.21.15.53:0/3066636732 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3968066280 0x7f3968068730 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:05.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.522+0000 7f39830c6640 1 --2- 172.21.15.53:0/3066636732 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f397c0c9fa0 0x7f397c0cb820 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:05.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.522+0000 7f39830c6640 1 --2- 172.21.15.53:0/3066636732 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f397c0c87e0 0x7f397c163280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:05.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.522+0000 7f39830c6640 1 --2- 172.21.15.53:0/3066636732 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f397c06c020 0x7f397c1568a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:05.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.522+0000 7f39830c6640 1 -- 172.21.15.53:0/3066636732 >> 172.21.15.53:0/3066636732 conn(0x7f397c06a0e0 msgr2=0x7f397c0b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:05.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.522+0000 7f39830c6640 1 -- 172.21.15.53:0/3066636732 shutdown_connections 2023-06-10T18:57:05.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.522+0000 7f39830c6640 1 -- 172.21.15.53:0/3066636732 wait complete. 2023-06-10T18:57:05.545 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_basic' 2023-06-10T18:57:05.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.658+0000 7f16d19df640 1 Processor -- start 2023-06-10T18:57:05.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.658+0000 7f16d19df640 1 -- start start 2023-06-10T18:57:05.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.658+0000 7f16d19df640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f16cc06b780 0x7f16cc15c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:05.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.658+0000 7f16d19df640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16cc0ceb20 0x7f16cc0cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:05.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.658+0000 7f16d19df640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16cc0af530 con 0x7f16cc06bb50 2023-06-10T18:57:05.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.658+0000 7f16d19df640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16cc15c3d0 con 0x7f16cc06b780 2023-06-10T18:57:05.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.658+0000 7f16d19df640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16cc15fd70 con 0x7f16cc0ceb20 2023-06-10T18:57:05.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.658+0000 7f16caffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f16cc06b780 0x7f16cc15c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:05.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.658+0000 7f16caffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f16cc06b780 0x7f16cc15c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35292/0 (socket says 172.21.15.53:35292) 2023-06-10T18:57:05.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.658+0000 7f16caffd640 1 -- 172.21.15.53:0/854503218 learned_addr learned my addr 172.21.15.53:0/854503218 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:57:05.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.658+0000 7f16cb7fe640 1 --2- 172.21.15.53:0/854503218 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16cc0ceb20 0x7f16cc0cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:05.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.658+0000 7f16caffd640 1 -- 172.21.15.53:0/854503218 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16cc0ceb20 msgr2=0x7f16cc0cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:05.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.658+0000 7f16caffd640 1 --2- 172.21.15.53:0/854503218 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16cc0ceb20 0x7f16cc0cefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:05.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.658+0000 7f16caffd640 1 -- 172.21.15.53:0/854503218 >> v1:172.21.15.117:6789/0 conn(0x7f16cc06bb50 legacy=0x7f16cc15f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:05.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.658+0000 7f16caffd640 1 -- 172.21.15.53:0/854503218 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16cc160050 con 0x7f16cc06b780 2023-06-10T18:57:05.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.658+0000 7f16cb7fe640 1 --2- 172.21.15.53:0/854503218 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16cc0ceb20 0x7f16cc0cefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:57:05.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.658+0000 7f16caffd640 1 --2- 172.21.15.53:0/854503218 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16cc06b780 0x7f16cc15c7f0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f16bc009870 tx=0x7f16bc01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d89f4ec6a3600937 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:05.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.662+0000 7f16ca7fc640 1 -- 172.21.15.53:0/854503218 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16bc0ab600 con 0x7f16cc06b780 2023-06-10T18:57:05.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.662+0000 7f16ca7fc640 1 -- 172.21.15.53:0/854503218 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16bc0a7050 con 0x7f16cc06b780 2023-06-10T18:57:05.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.662+0000 7f16ca7fc640 1 -- 172.21.15.53:0/854503218 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16bc0ab980 con 0x7f16cc06b780 2023-06-10T18:57:05.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.662+0000 7f16d19df640 1 -- 172.21.15.53:0/854503218 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16cc06b780 msgr2=0x7f16cc15c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:05.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.662+0000 7f16d19df640 1 --2- 172.21.15.53:0/854503218 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16cc06b780 0x7f16cc15c7f0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f16bc009870 tx=0x7f16bc01c470 comp rx=0 tx=0).stop 2023-06-10T18:57:05.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.662+0000 7f16d19df640 1 -- 172.21.15.53:0/854503218 shutdown_connections 2023-06-10T18:57:05.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.662+0000 7f16d19df640 1 --2- 172.21.15.53:0/854503218 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16cc0ceb20 0x7f16cc0cefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:05.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.662+0000 7f16d19df640 1 --2- 172.21.15.53:0/854503218 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16cc06b780 0x7f16cc15c7f0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:05.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.662+0000 7f16d19df640 1 -- 172.21.15.53:0/854503218 >> 172.21.15.53:0/854503218 conn(0x7f16cc06a090 msgr2=0x7f16cc06d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:05.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.662+0000 7f16d19df640 1 -- 172.21.15.53:0/854503218 shutdown_connections 2023-06-10T18:57:05.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.662+0000 7f16d19df640 1 -- 172.21.15.53:0/854503218 wait complete. 2023-06-10T18:57:05.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.662+0000 7f16d19df640 1 Processor -- start 2023-06-10T18:57:05.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.662+0000 7f16d19df640 1 -- start start 2023-06-10T18:57:05.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.662+0000 7f16d19df640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16cc06b780 0x7f16cc15a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:05.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.662+0000 7f16d19df640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16cc06bb50 0x7f16cc15a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:05.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.662+0000 7f16d19df640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16cc0ceb20 0x7f16cc0b2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:05.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.662+0000 7f16d19df640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16cc0c8300 con 0x7f16cc06b780 2023-06-10T18:57:05.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.662+0000 7f16d19df640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16cc0c7680 con 0x7f16cc0ceb20 2023-06-10T18:57:05.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.662+0000 7f16d19df640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16cc0c7960 con 0x7f16cc06bb50 2023-06-10T18:57:05.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.662+0000 7f16caffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16cc06b780 0x7f16cc15a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:05.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.662+0000 7f16caffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16cc06b780 0x7f16cc15a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35300/0 (socket says 172.21.15.53:35300) 2023-06-10T18:57:05.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.662+0000 7f16caffd640 1 -- 172.21.15.53:0/2237515132 learned_addr learned my addr 172.21.15.53:0/2237515132 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:57:05.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.662+0000 7f16c3fff640 1 --2- 172.21.15.53:0/2237515132 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16cc06bb50 0x7f16cc15a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:05.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.662+0000 7f16cb7fe640 1 --2- 172.21.15.53:0/2237515132 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16cc0ceb20 0x7f16cc0b2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:05.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.662+0000 7f16caffd640 1 -- 172.21.15.53:0/2237515132 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16cc06bb50 msgr2=0x7f16cc15a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:05.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.662+0000 7f16caffd640 1 --2- 172.21.15.53:0/2237515132 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16cc06bb50 0x7f16cc15a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:05.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.662+0000 7f16caffd640 1 -- 172.21.15.53:0/2237515132 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16cc0ceb20 msgr2=0x7f16cc0b2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:05.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.662+0000 7f16caffd640 1 --2- 172.21.15.53:0/2237515132 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16cc0ceb20 0x7f16cc0b2c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:05.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.662+0000 7f16caffd640 1 -- 172.21.15.53:0/2237515132 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16bc0094d0 con 0x7f16cc06b780 2023-06-10T18:57:05.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.662+0000 7f16cb7fe640 1 --2- 172.21.15.53:0/2237515132 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16cc0ceb20 0x7f16cc0b2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:57:05.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.662+0000 7f16caffd640 1 --2- 172.21.15.53:0/2237515132 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16cc06b780 0x7f16cc15a310 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f16bc01cd10 tx=0x7f16bc019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:05.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.662+0000 7f16c8ff9640 1 -- 172.21.15.53:0/2237515132 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16bc0b3890 con 0x7f16cc06b780 2023-06-10T18:57:05.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.662+0000 7f16c8ff9640 1 -- 172.21.15.53:0/2237515132 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16bc0b39f0 con 0x7f16cc06b780 2023-06-10T18:57:05.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.662+0000 7f16d19df640 1 -- 172.21.15.53:0/2237515132 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16cc0c7c40 con 0x7f16cc06b780 2023-06-10T18:57:05.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.662+0000 7f16c8ff9640 1 -- 172.21.15.53:0/2237515132 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16bc0b3da0 con 0x7f16cc06b780 2023-06-10T18:57:05.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.662+0000 7f16d19df640 1 -- 172.21.15.53:0/2237515132 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16cc0c72e0 con 0x7f16cc06b780 2023-06-10T18:57:05.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.666+0000 7f16d19df640 1 -- 172.21.15.53:0/2237515132 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16cc06bf80 con 0x7f16cc06b780 2023-06-10T18:57:05.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.666+0000 7f16c8ff9640 1 -- 172.21.15.53:0/2237515132 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f16bc0b2070 con 0x7f16cc06b780 2023-06-10T18:57:05.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.666+0000 7f16c8ff9640 1 --2- 172.21.15.53:0/2237515132 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f16ac066280 0x7f16ac068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:05.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.666+0000 7f16c8ff9640 1 -- 172.21.15.53:0/2237515132 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f16bc11db80 con 0x7f16cc06b780 2023-06-10T18:57:05.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.666+0000 7f16c3fff640 1 --2- 172.21.15.53:0/2237515132 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f16ac066280 0x7f16ac068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:05.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.666+0000 7f16c3fff640 1 --2- 172.21.15.53:0/2237515132 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f16ac066280 0x7f16ac068730 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f16cc0c9aa0 tx=0x7f16b4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:05.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.670+0000 7f16c8ff9640 1 -- 172.21.15.53:0/2237515132 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f16cc06bf80 con 0x7f16cc06b780 2023-06-10T18:57:05.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:05.898+0000 7f16d19df640 1 -- 172.21.15.53:0/2237515132 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_basic"]} v 0) v1 -- 0x7f16cc06bf80 con 0x7f16cc06b780 2023-06-10T18:57:06.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.190+0000 7f16c8ff9640 1 -- 172.21.15.53:0/2237515132 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_basic"]}]=0 v220) v1 ==== 142+0+0 (secure 0 0 0) 0x7f16cc06bf80 con 0x7f16cc06b780 2023-06-10T18:57:06.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.194+0000 7f16d19df640 1 -- 172.21.15.53:0/2237515132 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f16ac066280 msgr2=0x7f16ac068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:06.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.194+0000 7f16d19df640 1 --2- 172.21.15.53:0/2237515132 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f16ac066280 0x7f16ac068730 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f16cc0c9aa0 tx=0x7f16b4008040 comp rx=0 tx=0).stop 2023-06-10T18:57:06.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.194+0000 7f16d19df640 1 -- 172.21.15.53:0/2237515132 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16cc06b780 msgr2=0x7f16cc15a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:06.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.194+0000 7f16d19df640 1 --2- 172.21.15.53:0/2237515132 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16cc06b780 0x7f16cc15a310 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f16bc01cd10 tx=0x7f16bc019210 comp rx=0 tx=0).stop 2023-06-10T18:57:06.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.194+0000 7f16d19df640 1 -- 172.21.15.53:0/2237515132 shutdown_connections 2023-06-10T18:57:06.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.194+0000 7f16d19df640 1 --2- 172.21.15.53:0/2237515132 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f16ac066280 0x7f16ac068730 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:06.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.194+0000 7f16d19df640 1 --2- 172.21.15.53:0/2237515132 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16cc0ceb20 0x7f16cc0b2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:06.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.194+0000 7f16d19df640 1 --2- 172.21.15.53:0/2237515132 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16cc06bb50 0x7f16cc15a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:06.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.194+0000 7f16d19df640 1 --2- 172.21.15.53:0/2237515132 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16cc06b780 0x7f16cc15a310 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:06.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.194+0000 7f16d19df640 1 -- 172.21.15.53:0/2237515132 >> 172.21.15.53:0/2237515132 conn(0x7f16cc06a090 msgr2=0x7f16cc15e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:06.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.194+0000 7f16d19df640 1 -- 172.21.15.53:0/2237515132 shutdown_connections 2023-06-10T18:57:06.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.194+0000 7f16d19df640 1 -- 172.21.15.53:0/2237515132 wait complete. 2023-06-10T18:57:06.216 INFO:tasks.cephfs_test_runner:test_basic (tasks.cephfs.test_client_recovery.TestClientRecovery) ... ok 2023-06-10T18:57:06.217 INFO:tasks.cephfs_test_runner:Starting test: test_config_session_timeout (tasks.cephfs.test_client_recovery.TestClientRecovery) 2023-06-10T18:57:06.217 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_config_session_timeout' 2023-06-10T18:57:06.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.334+0000 7fb2b2b2b640 1 Processor -- start 2023-06-10T18:57:06.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.334+0000 7fb2b2b2b640 1 -- start start 2023-06-10T18:57:06.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.334+0000 7fb2b2b2b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2ac0ccae0 0x7fb2ac0d0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:06.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.334+0000 7fb2b2b2b640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2ac0d0020 con 0x7fb2ac0b3ac0 2023-06-10T18:57:06.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.334+0000 7fb2b2b2b640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2ac0cef40 con 0x7fb2ac0cc690 2023-06-10T18:57:06.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.334+0000 7fb2b2b2b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ac0cf220 con 0x7fb2ac0ccae0 2023-06-10T18:57:06.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.334+0000 7fb2b08c7640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fb2ac0b3ac0 0x7fb2ac0b3e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:48892/0 (socket says 172.21.15.53:48892) 2023-06-10T18:57:06.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.334+0000 7fb2b08c7640 1 -- 172.21.15.53:0/82736471 learned_addr learned my addr 172.21.15.53:0/82736471 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:57:06.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.334+0000 7fb2b10c8640 1 --2- 172.21.15.53:0/82736471 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2ac0ccae0 0x7fb2ac0d0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:06.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.334+0000 7fb2ab7fe640 1 -- 172.21.15.53:0/82736471 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2029867982 0 0) 0x7fb2ac0d0020 con 0x7fb2ac0b3ac0 2023-06-10T18:57:06.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.334+0000 7fb2ab7fe640 1 -- 172.21.15.53:0/82736471 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb298003530 con 0x7fb2ac0b3ac0 2023-06-10T18:57:06.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.334+0000 7fb2ab7fe640 1 -- 172.21.15.53:0/82736471 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1138871023 0 0) 0x7fb298003530 con 0x7fb2ac0b3ac0 2023-06-10T18:57:06.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.334+0000 7fb2ab7fe640 1 -- 172.21.15.53:0/82736471 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2ac0ccae0 msgr2=0x7fb2ac0d0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:06.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.334+0000 7fb2ab7fe640 1 --2- 172.21.15.53:0/82736471 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2ac0ccae0 0x7fb2ac0d0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:06.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.334+0000 7fb2ab7fe640 1 -- 172.21.15.53:0/82736471 >> v1:172.21.15.117:6789/0 conn(0x7fb2ac0cc690 legacy=0x7fb2ac0d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:06.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.334+0000 7fb2ab7fe640 1 -- 172.21.15.53:0/82736471 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2ac0cf500 con 0x7fb2ac0b3ac0 2023-06-10T18:57:06.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.334+0000 7fb2ab7fe640 1 -- 172.21.15.53:0/82736471 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fb294001680 con 0x7fb2ac0b3ac0 2023-06-10T18:57:06.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.334+0000 7fb2ab7fe640 1 -- 172.21.15.53:0/82736471 >> v1:172.21.15.53:6789/0 conn(0x7fb2ac0b3ac0 legacy=0x7fb2ac0b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:06.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.334+0000 7fb2ab7fe640 1 --2- 172.21.15.53:0/82736471 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2ac0ccae0 0x7fb298003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:06.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.334+0000 7fb2ab7fe640 1 --2- 172.21.15.53:0/82736471 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb298003fa0 0x7fb2980047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:06.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.334+0000 7fb2ab7fe640 1 --2- 172.21.15.53:0/82736471 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb298004d10 0x7fb298005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:06.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.334+0000 7fb2ab7fe640 1 -- 172.21.15.53:0/82736471 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ac0cf220 con 0x7fb298003fa0 2023-06-10T18:57:06.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.334+0000 7fb2ab7fe640 1 -- 172.21.15.53:0/82736471 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb29800bad0 con 0x7fb298004d10 2023-06-10T18:57:06.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.334+0000 7fb2ab7fe640 1 -- 172.21.15.53:0/82736471 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb29800bc90 con 0x7fb2ac0ccae0 2023-06-10T18:57:06.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.338+0000 7fb2abfff640 1 --2- 172.21.15.53:0/82736471 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb298003fa0 0x7fb2980047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:06.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.338+0000 7fb2b08c7640 1 --2- 172.21.15.53:0/82736471 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2ac0ccae0 0x7fb298003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:06.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.338+0000 7fb2b10c8640 1 --2- 172.21.15.53:0/82736471 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb298004d10 0x7fb298005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:06.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.338+0000 7fb2abfff640 1 -- 172.21.15.53:0/82736471 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2ac0ccae0 msgr2=0x7fb298003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:06.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.338+0000 7fb2abfff640 1 --2- 172.21.15.53:0/82736471 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2ac0ccae0 0x7fb298003a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:06.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.338+0000 7fb2abfff640 1 -- 172.21.15.53:0/82736471 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb298004d10 msgr2=0x7fb298005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:06.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.338+0000 7fb2abfff640 1 --2- 172.21.15.53:0/82736471 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb298004d10 0x7fb298005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:06.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.338+0000 7fb2abfff640 1 -- 172.21.15.53:0/82736471 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb298003530 con 0x7fb298003fa0 2023-06-10T18:57:06.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.338+0000 7fb2b08c7640 1 --2- 172.21.15.53:0/82736471 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2ac0ccae0 0x7fb298003a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:57:06.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.338+0000 7fb2b10c8640 1 --2- 172.21.15.53:0/82736471 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb298004d10 0x7fb298005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:57:06.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.338+0000 7fb2abfff640 1 --2- 172.21.15.53:0/82736471 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb298003fa0 0x7fb2980047d0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fb2a4001e70 tx=0x7fb2a401c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efc36575cb6a7e2f server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:06.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.338+0000 7fb2ab7fe640 1 -- 172.21.15.53:0/82736471 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a4003b80 con 0x7fb298003fa0 2023-06-10T18:57:06.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.338+0000 7fb2ab7fe640 1 -- 172.21.15.53:0/82736471 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb294001d80 con 0x7fb298003fa0 2023-06-10T18:57:06.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.338+0000 7fb2ab7fe640 1 -- 172.21.15.53:0/82736471 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a4005080 con 0x7fb298003fa0 2023-06-10T18:57:06.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.338+0000 7fb2b2b2b640 1 -- 172.21.15.53:0/82736471 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb298003fa0 msgr2=0x7fb2980047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:06.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.338+0000 7fb2b2b2b640 1 --2- 172.21.15.53:0/82736471 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb298003fa0 0x7fb2980047d0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fb2a4001e70 tx=0x7fb2a401c760 comp rx=0 tx=0).stop 2023-06-10T18:57:06.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.338+0000 7fb2b10c8640 1 -- 172.21.15.53:0/82736471 reap_dead start 2023-06-10T18:57:06.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.338+0000 7fb2b2b2b640 1 -- 172.21.15.53:0/82736471 shutdown_connections 2023-06-10T18:57:06.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.338+0000 7fb2b2b2b640 1 -- 172.21.15.53:0/82736471 >> 172.21.15.53:0/82736471 conn(0x7fb2ac071790 msgr2=0x7fb2ac069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:06.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.338+0000 7fb2b2b2b640 1 -- 172.21.15.53:0/82736471 shutdown_connections 2023-06-10T18:57:06.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.338+0000 7fb2b2b2b640 1 -- 172.21.15.53:0/82736471 wait complete. 2023-06-10T18:57:06.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.342+0000 7fb2b2b2b640 1 Processor -- start 2023-06-10T18:57:06.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.342+0000 7fb2b2b2b640 1 -- start start 2023-06-10T18:57:06.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.342+0000 7fb2b2b2b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb298003fa0 0x7fb2ac1e4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:06.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.342+0000 7fb2b2b2b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2ac147350 0x7fb2ac1477c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:06.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.342+0000 7fb2b2b2b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2ac0c7490 0x7fb2ac0c7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:06.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.342+0000 7fb2b2b2b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ac147d00 con 0x7fb2ac147350 2023-06-10T18:57:06.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.342+0000 7fb2b2b2b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ac0c8230 con 0x7fb298003fa0 2023-06-10T18:57:06.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.342+0000 7fb2b2b2b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ac1480d0 con 0x7fb2ac0c7490 2023-06-10T18:57:06.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.342+0000 7fb2abfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2ac147350 0x7fb2ac1477c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:06.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.342+0000 7fb2abfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2ac147350 0x7fb2ac1477c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35322/0 (socket says 172.21.15.53:35322) 2023-06-10T18:57:06.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.342+0000 7fb2abfff640 1 -- 172.21.15.53:0/1026693347 learned_addr learned my addr 172.21.15.53:0/1026693347 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:57:06.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.342+0000 7fb2b08c7640 1 --2- 172.21.15.53:0/1026693347 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb298003fa0 0x7fb2ac1e4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:06.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.342+0000 7fb2b10c8640 1 --2- 172.21.15.53:0/1026693347 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2ac0c7490 0x7fb2ac0c7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:06.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.342+0000 7fb2abfff640 1 -- 172.21.15.53:0/1026693347 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2ac0c7490 msgr2=0x7fb2ac0c7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:06.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.342+0000 7fb2abfff640 1 --2- 172.21.15.53:0/1026693347 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2ac0c7490 0x7fb2ac0c7930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:06.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.342+0000 7fb2abfff640 1 -- 172.21.15.53:0/1026693347 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb298003fa0 msgr2=0x7fb2ac1e4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:06.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.342+0000 7fb2abfff640 1 --2- 172.21.15.53:0/1026693347 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb298003fa0 0x7fb2ac1e4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:06.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.342+0000 7fb2abfff640 1 -- 172.21.15.53:0/1026693347 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2ac1483b0 con 0x7fb2ac147350 2023-06-10T18:57:06.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.342+0000 7fb2abfff640 1 --2- 172.21.15.53:0/1026693347 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2ac147350 0x7fb2ac1477c0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fb2a401cc40 tx=0x7fb298005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:06.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.342+0000 7fb2a97fa640 1 -- 172.21.15.53:0/1026693347 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a4005500 con 0x7fb2ac147350 2023-06-10T18:57:06.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.342+0000 7fb2a97fa640 1 -- 172.21.15.53:0/1026693347 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2a4005660 con 0x7fb2ac147350 2023-06-10T18:57:06.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.342+0000 7fb2b2b2b640 1 -- 172.21.15.53:0/1026693347 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2ac148690 con 0x7fb2ac147350 2023-06-10T18:57:06.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.342+0000 7fb2a97fa640 1 -- 172.21.15.53:0/1026693347 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a40a6460 con 0x7fb2ac147350 2023-06-10T18:57:06.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.342+0000 7fb2b2b2b640 1 -- 172.21.15.53:0/1026693347 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2ac0c7e70 con 0x7fb2ac147350 2023-06-10T18:57:06.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.342+0000 7fb2b2b2b640 1 -- 172.21.15.53:0/1026693347 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2ac04d790 con 0x7fb2ac147350 2023-06-10T18:57:06.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.342+0000 7fb2a97fa640 1 -- 172.21.15.53:0/1026693347 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb2a40a65c0 con 0x7fb2ac147350 2023-06-10T18:57:06.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.346+0000 7fb2a97fa640 1 --2- 172.21.15.53:0/1026693347 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb28c0662b0 0x7fb28c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:06.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.346+0000 7fb2a97fa640 1 -- 172.21.15.53:0/1026693347 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fb2a411dec0 con 0x7fb2ac147350 2023-06-10T18:57:06.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.346+0000 7fb2b08c7640 1 --2- 172.21.15.53:0/1026693347 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb28c0662b0 0x7fb28c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:06.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.346+0000 7fb2b08c7640 1 --2- 172.21.15.53:0/1026693347 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb28c0662b0 0x7fb28c068760 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fb294004880 tx=0x7fb294001440 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:06.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.350+0000 7fb2a97fa640 1 -- 172.21.15.53:0/1026693347 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb2a40ef160 con 0x7fb2ac147350 2023-06-10T18:57:06.515 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-10T18:57:06.517 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-10T18:57:06.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:06.554+0000 7fb2b2b2b640 1 -- 172.21.15.53:0/1026693347 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_config_session_timeout"]} v 0) v1 -- 0x7fb2ac08a200 con 0x7fb2ac147350 2023-06-10T18:57:07.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.194+0000 7fb2a97fa640 1 -- 172.21.15.53:0/1026693347 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_config_session_timeout"]}]=0 v221) v1 ==== 162+0+0 (secure 0 0 0) 0x7fb2a40eecf0 con 0x7fb2ac147350 2023-06-10T18:57:07.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.198+0000 7fb2b2b2b640 1 -- 172.21.15.53:0/1026693347 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb28c0662b0 msgr2=0x7fb28c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:07.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.198+0000 7fb2b2b2b640 1 --2- 172.21.15.53:0/1026693347 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb28c0662b0 0x7fb28c068760 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fb294004880 tx=0x7fb294001440 comp rx=0 tx=0).stop 2023-06-10T18:57:07.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.198+0000 7fb2b2b2b640 1 -- 172.21.15.53:0/1026693347 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2ac147350 msgr2=0x7fb2ac1477c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:07.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.198+0000 7fb2b2b2b640 1 --2- 172.21.15.53:0/1026693347 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2ac147350 0x7fb2ac1477c0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fb2a401cc40 tx=0x7fb298005800 comp rx=0 tx=0).stop 2023-06-10T18:57:07.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.198+0000 7fb2b2b2b640 1 -- 172.21.15.53:0/1026693347 shutdown_connections 2023-06-10T18:57:07.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.198+0000 7fb2b2b2b640 1 --2- 172.21.15.53:0/1026693347 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb28c0662b0 0x7fb28c068760 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:07.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.198+0000 7fb2b2b2b640 1 --2- 172.21.15.53:0/1026693347 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2ac0c7490 0x7fb2ac0c7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:07.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.198+0000 7fb2b2b2b640 1 --2- 172.21.15.53:0/1026693347 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2ac147350 0x7fb2ac1477c0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:07.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.198+0000 7fb2b2b2b640 1 --2- 172.21.15.53:0/1026693347 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb298003fa0 0x7fb2ac1e4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:07.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.198+0000 7fb2b2b2b640 1 -- 172.21.15.53:0/1026693347 >> 172.21.15.53:0/1026693347 conn(0x7fb2ac071790 msgr2=0x7fb2ac15de10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:07.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.198+0000 7fb2b2b2b640 1 -- 172.21.15.53:0/1026693347 shutdown_connections 2023-06-10T18:57:07.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.198+0000 7fb2b2b2b640 1 -- 172.21.15.53:0/1026693347 wait complete. 2023-06-10T18:57:07.224 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-06-10T18:57:07.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.394+0000 7fa540e63640 1 Processor -- start 2023-06-10T18:57:07.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.394+0000 7fa540e63640 1 -- start start 2023-06-10T18:57:07.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.394+0000 7fa540e63640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa53c0afe70 0x7fa53c0c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:07.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.394+0000 7fa540e63640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa53c06b090 con 0x7fa53c0c82a0 2023-06-10T18:57:07.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.394+0000 7fa540e63640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa53c0ca370 con 0x7fa53c0c9fa0 2023-06-10T18:57:07.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.394+0000 7fa540e63640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa53c070d50 con 0x7fa53c0afe70 2023-06-10T18:57:07.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.394+0000 7fa539d9b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fa53c0c82a0 0x7fa53c0af760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:48904/0 (socket says 172.21.15.53:48904) 2023-06-10T18:57:07.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.394+0000 7fa539d9b640 1 -- 172.21.15.53:0/2126621822 learned_addr learned my addr 172.21.15.53:0/2126621822 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:57:07.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.394+0000 7fa53ad9d640 1 --2- 172.21.15.53:0/2126621822 >> v2:172.21.15.117:3300/0 conn(0x7fa53c0afe70 0x7fa53c0c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:07.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.394+0000 7fa53959a640 1 -- 172.21.15.53:0/2126621822 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1037318057 0 0) 0x7fa53c06b090 con 0x7fa53c0c82a0 2023-06-10T18:57:07.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.394+0000 7fa53959a640 1 -- 172.21.15.53:0/2126621822 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa528003530 con 0x7fa53c0c82a0 2023-06-10T18:57:07.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.394+0000 7fa53959a640 1 -- 172.21.15.53:0/2126621822 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2250423859 0 0) 0x7fa528003530 con 0x7fa53c0c82a0 2023-06-10T18:57:07.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.394+0000 7fa53959a640 1 -- 172.21.15.53:0/2126621822 >> v2:172.21.15.117:3300/0 conn(0x7fa53c0afe70 msgr2=0x7fa53c0c86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:07.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.394+0000 7fa53959a640 1 --2- 172.21.15.53:0/2126621822 >> v2:172.21.15.117:3300/0 conn(0x7fa53c0afe70 0x7fa53c0c86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:07.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.394+0000 7fa53959a640 1 -- 172.21.15.53:0/2126621822 >> v1:172.21.15.117:6789/0 conn(0x7fa53c0c9fa0 legacy=0x7fa53c06bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:07.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.394+0000 7fa53959a640 1 -- 172.21.15.53:0/2126621822 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa53c071030 con 0x7fa53c0c82a0 2023-06-10T18:57:07.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.394+0000 7fa53959a640 1 -- 172.21.15.53:0/2126621822 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fa52c001680 con 0x7fa53c0c82a0 2023-06-10T18:57:07.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.394+0000 7fa53959a640 1 -- 172.21.15.53:0/2126621822 >> v1:172.21.15.53:6789/0 conn(0x7fa53c0c82a0 legacy=0x7fa53c0af760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:07.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.394+0000 7fa53959a640 1 --2- 172.21.15.53:0/2126621822 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa528003980 0x7fa528003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:07.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.394+0000 7fa53959a640 1 --2- 172.21.15.53:0/2126621822 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5280047d0 0x7fa528004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:07.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.394+0000 7fa53959a640 1 --2- 172.21.15.53:0/2126621822 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa528005180 0x7fa52800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:07.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.394+0000 7fa53959a640 1 -- 172.21.15.53:0/2126621822 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa53c070d50 con 0x7fa528003980 2023-06-10T18:57:07.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.394+0000 7fa53959a640 1 -- 172.21.15.53:0/2126621822 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa52800c090 con 0x7fa5280047d0 2023-06-10T18:57:07.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.394+0000 7fa53959a640 1 -- 172.21.15.53:0/2126621822 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa52800c250 con 0x7fa528005180 2023-06-10T18:57:07.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.394+0000 7fa53a59c640 1 --2- 172.21.15.53:0/2126621822 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa528003980 0x7fa528003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:07.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.394+0000 7fa539d9b640 1 --2- 172.21.15.53:0/2126621822 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5280047d0 0x7fa528004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:07.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.394+0000 7fa53ad9d640 1 --2- 172.21.15.53:0/2126621822 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa528005180 0x7fa52800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:07.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.394+0000 7fa53a59c640 1 -- 172.21.15.53:0/2126621822 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa528005180 msgr2=0x7fa52800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:07.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.394+0000 7fa53a59c640 1 --2- 172.21.15.53:0/2126621822 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa528005180 0x7fa52800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:07.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.394+0000 7fa53a59c640 1 -- 172.21.15.53:0/2126621822 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5280047d0 msgr2=0x7fa528004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:07.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.394+0000 7fa53a59c640 1 --2- 172.21.15.53:0/2126621822 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5280047d0 0x7fa528004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:07.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.394+0000 7fa53a59c640 1 -- 172.21.15.53:0/2126621822 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa528003530 con 0x7fa528003980 2023-06-10T18:57:07.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.394+0000 7fa53ad9d640 1 -- 172.21.15.53:0/2126621822 reap_dead start 2023-06-10T18:57:07.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.398+0000 7fa53a59c640 1 --2- 172.21.15.53:0/2126621822 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa528003980 0x7fa528003d90 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fa524001780 tx=0x7fa52401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2497d83447894dd server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:07.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.398+0000 7fa53959a640 1 -- 172.21.15.53:0/2126621822 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5240052d0 con 0x7fa528003980 2023-06-10T18:57:07.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.398+0000 7fa53959a640 1 -- 172.21.15.53:0/2126621822 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5240a7050 con 0x7fa528003980 2023-06-10T18:57:07.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.398+0000 7fa53959a640 1 -- 172.21.15.53:0/2126621822 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa524003600 con 0x7fa528003980 2023-06-10T18:57:07.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.398+0000 7fa540e63640 1 -- 172.21.15.53:0/2126621822 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa528003980 msgr2=0x7fa528003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:07.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.398+0000 7fa540e63640 1 --2- 172.21.15.53:0/2126621822 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa528003980 0x7fa528003d90 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fa524001780 tx=0x7fa52401c3d0 comp rx=0 tx=0).stop 2023-06-10T18:57:07.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.398+0000 7fa540e63640 1 -- 172.21.15.53:0/2126621822 shutdown_connections 2023-06-10T18:57:07.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.398+0000 7fa540e63640 1 --2- 172.21.15.53:0/2126621822 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa528003980 0x7fa528003d90 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:07.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.398+0000 7fa540e63640 1 -- 172.21.15.53:0/2126621822 >> 172.21.15.53:0/2126621822 conn(0x7fa53c06a0e0 msgr2=0x7fa53c0cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:07.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.398+0000 7fa540e63640 1 -- 172.21.15.53:0/2126621822 shutdown_connections 2023-06-10T18:57:07.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.398+0000 7fa540e63640 1 -- 172.21.15.53:0/2126621822 wait complete. 2023-06-10T18:57:07.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.398+0000 7fa540e63640 1 Processor -- start 2023-06-10T18:57:07.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.398+0000 7fa540e63640 1 -- start start 2023-06-10T18:57:07.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.398+0000 7fa540e63640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa528003980 0x7fa53c0af120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:07.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.398+0000 7fa540e63640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa53c0c7230 0x7fa53c1535c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:07.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.402+0000 7fa540e63640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa53c15c2a0 0x7fa53c15c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:07.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.402+0000 7fa540e63640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa53c159a20 con 0x7fa53c0c7230 2023-06-10T18:57:07.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.402+0000 7fa540e63640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa53c15cc50 con 0x7fa53c15c2a0 2023-06-10T18:57:07.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.402+0000 7fa540e63640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa53c0c76a0 con 0x7fa528003980 2023-06-10T18:57:07.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.402+0000 7fa539d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa53c0c7230 0x7fa53c1535c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:07.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.402+0000 7fa539d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa53c0c7230 0x7fa53c1535c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35346/0 (socket says 172.21.15.53:35346) 2023-06-10T18:57:07.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.402+0000 7fa539d9b640 1 -- 172.21.15.53:0/2809353964 learned_addr learned my addr 172.21.15.53:0/2809353964 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:57:07.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.402+0000 7fa53a59c640 1 --2- 172.21.15.53:0/2809353964 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa528003980 0x7fa53c0af120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:07.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.402+0000 7fa53ad9d640 1 --2- 172.21.15.53:0/2809353964 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa53c15c2a0 0x7fa53c15c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:07.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.402+0000 7fa539d9b640 1 -- 172.21.15.53:0/2809353964 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa528003980 msgr2=0x7fa53c0af120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:07.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.402+0000 7fa539d9b640 1 --2- 172.21.15.53:0/2809353964 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa528003980 0x7fa53c0af120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:07.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.402+0000 7fa539d9b640 1 -- 172.21.15.53:0/2809353964 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa53c15c2a0 msgr2=0x7fa53c15c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:07.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.402+0000 7fa539d9b640 1 --2- 172.21.15.53:0/2809353964 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa53c15c2a0 0x7fa53c15c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:07.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.402+0000 7fa539d9b640 1 -- 172.21.15.53:0/2809353964 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa53c0c7930 con 0x7fa53c0c7230 2023-06-10T18:57:07.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.402+0000 7fa53a59c640 1 --2- 172.21.15.53:0/2809353964 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa528003980 0x7fa53c0af120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:57:07.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.402+0000 7fa539d9b640 1 --2- 172.21.15.53:0/2809353964 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa53c0c7230 0x7fa53c1535c0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fa52c00e7b0 tx=0x7fa52c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:07.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.402+0000 7fa532ffd640 1 -- 172.21.15.53:0/2809353964 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa52c00ee60 con 0x7fa53c0c7230 2023-06-10T18:57:07.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.402+0000 7fa532ffd640 1 -- 172.21.15.53:0/2809353964 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa52c00c870 con 0x7fa53c0c7230 2023-06-10T18:57:07.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.402+0000 7fa532ffd640 1 -- 172.21.15.53:0/2809353964 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa52c00cc20 con 0x7fa53c0c7230 2023-06-10T18:57:07.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.402+0000 7fa540e63640 1 -- 172.21.15.53:0/2809353964 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa53c159c00 con 0x7fa53c0c7230 2023-06-10T18:57:07.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.402+0000 7fa540e63640 1 -- 172.21.15.53:0/2809353964 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa53c15a1c0 con 0x7fa53c0c7230 2023-06-10T18:57:07.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.402+0000 7fa540e63640 1 -- 172.21.15.53:0/2809353964 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa53c04d790 con 0x7fa53c0c7230 2023-06-10T18:57:07.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.402+0000 7fa532ffd640 1 -- 172.21.15.53:0/2809353964 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa52c00cd80 con 0x7fa53c0c7230 2023-06-10T18:57:07.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.402+0000 7fa532ffd640 1 --2- 172.21.15.53:0/2809353964 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa51c0662b0 0x7fa51c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:07.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.402+0000 7fa532ffd640 1 -- 172.21.15.53:0/2809353964 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fa52c083660 con 0x7fa53c0c7230 2023-06-10T18:57:07.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.402+0000 7fa53a59c640 1 --2- 172.21.15.53:0/2809353964 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa51c0662b0 0x7fa51c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:07.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.406+0000 7fa53a59c640 1 --2- 172.21.15.53:0/2809353964 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa51c0662b0 0x7fa51c068760 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fa524001750 tx=0x7fa5240011a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:07.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.406+0000 7fa532ffd640 1 -- 172.21.15.53:0/2809353964 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa52c050de0 con 0x7fa53c0c7230 2023-06-10T18:57:07.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.562+0000 7fa540e63640 1 -- 172.21.15.53:0/2809353964 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fa53c0c7f80 con 0x7fa53c0c7230 2023-06-10T18:57:07.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.566+0000 7fa532ffd640 1 -- 172.21.15.53:0/2809353964 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa52c054400 con 0x7fa53c0c7230 2023-06-10T18:57:07.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.570+0000 7fa540e63640 1 -- 172.21.15.53:0/2809353964 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa51c0662b0 msgr2=0x7fa51c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:07.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.570+0000 7fa540e63640 1 --2- 172.21.15.53:0/2809353964 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa51c0662b0 0x7fa51c068760 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fa524001750 tx=0x7fa5240011a0 comp rx=0 tx=0).stop 2023-06-10T18:57:07.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.570+0000 7fa540e63640 1 -- 172.21.15.53:0/2809353964 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa53c0c7230 msgr2=0x7fa53c1535c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:07.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.570+0000 7fa540e63640 1 --2- 172.21.15.53:0/2809353964 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa53c0c7230 0x7fa53c1535c0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fa52c00e7b0 tx=0x7fa52c00ec70 comp rx=0 tx=0).stop 2023-06-10T18:57:07.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.570+0000 7fa540e63640 1 -- 172.21.15.53:0/2809353964 shutdown_connections 2023-06-10T18:57:07.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.570+0000 7fa540e63640 1 --2- 172.21.15.53:0/2809353964 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa51c0662b0 0x7fa51c068760 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:07.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.570+0000 7fa540e63640 1 --2- 172.21.15.53:0/2809353964 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa53c15c2a0 0x7fa53c15c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:07.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.570+0000 7fa540e63640 1 --2- 172.21.15.53:0/2809353964 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa53c0c7230 0x7fa53c1535c0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:07.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.570+0000 7fa540e63640 1 --2- 172.21.15.53:0/2809353964 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa528003980 0x7fa53c0af120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:07.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.570+0000 7fa540e63640 1 -- 172.21.15.53:0/2809353964 >> 172.21.15.53:0/2809353964 conn(0x7fa53c06a0e0 msgr2=0x7fa53c0b0ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:07.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.570+0000 7fa540e63640 1 -- 172.21.15.53:0/2809353964 shutdown_connections 2023-06-10T18:57:07.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.570+0000 7fa540e63640 1 -- 172.21.15.53:0/2809353964 wait complete. 2023-06-10T18:57:07.591 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-06-10T18:57:07.592 DEBUG:teuthology.orchestra.run.smithi053:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-06-10T18:57:07.619 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-06-10T18:57:07.669 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-06-10T18:57:07.669 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T18:57:07.670 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T18:57:07.675 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16345192k,nr_inodes=4086298,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276544k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=407 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276540k,nr_inodes=819135,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276544k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-06-10T18:57:07.676 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T18:57:07.676 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T18:57:07.716 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16342088k,nr_inodes=4085522,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275924k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18845 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275920k,nr_inodes=818980,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275924k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-06-10T18:57:07.717 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T18:57:07.718 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T18:57:07.724 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16345192k,nr_inodes=4086298,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276544k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=407 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276540k,nr_inodes=819135,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276544k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-06-10T18:57:07.725 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T18:57:07.725 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T18:57:07.763 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16342088k,nr_inodes=4085522,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275924k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18845 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275920k,nr_inodes=818980,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275924k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-06-10T18:57:07.763 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-06-10T18:57:07.764 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T18:57:07.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.890+0000 7fe6951a3640 1 Processor -- start 2023-06-10T18:57:07.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.890+0000 7fe6951a3640 1 -- start start 2023-06-10T18:57:07.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.890+0000 7fe6951a3640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe6900ceb20 0x7fe6900cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:07.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.890+0000 7fe6951a3640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe69015cc40 con 0x7fe69006b780 2023-06-10T18:57:07.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.890+0000 7fe6951a3640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6900af530 con 0x7fe69015c7f0 2023-06-10T18:57:07.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.890+0000 7fe6951a3640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe69015c3d0 con 0x7fe6900ceb20 2023-06-10T18:57:07.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.890+0000 7fe68ed9d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fe69006b780 0x7fe69006bb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:48912/0 (socket says 172.21.15.53:48912) 2023-06-10T18:57:07.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.890+0000 7fe68ed9d640 1 -- 172.21.15.53:0/2700609580 learned_addr learned my addr 172.21.15.53:0/2700609580 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:57:07.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.890+0000 7fe68f59e640 1 --2- 172.21.15.53:0/2700609580 >> v2:172.21.15.117:3300/0 conn(0x7fe6900ceb20 0x7fe6900cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:07.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.890+0000 7fe68dd9b640 1 -- 172.21.15.53:0/2700609580 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 516858227 0 0) 0x7fe69015cc40 con 0x7fe69006b780 2023-06-10T18:57:07.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.890+0000 7fe68dd9b640 1 -- 172.21.15.53:0/2700609580 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe678003530 con 0x7fe69006b780 2023-06-10T18:57:07.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.890+0000 7fe68dd9b640 1 -- 172.21.15.53:0/2700609580 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3980970157 0 0) 0x7fe678003530 con 0x7fe69006b780 2023-06-10T18:57:07.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.890+0000 7fe68dd9b640 1 -- 172.21.15.53:0/2700609580 >> v2:172.21.15.117:3300/0 conn(0x7fe6900ceb20 msgr2=0x7fe6900cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:07.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.890+0000 7fe68dd9b640 1 --2- 172.21.15.53:0/2700609580 >> v2:172.21.15.117:3300/0 conn(0x7fe6900ceb20 0x7fe6900cefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:07.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.890+0000 7fe68dd9b640 1 -- 172.21.15.53:0/2700609580 >> v1:172.21.15.117:6789/0 conn(0x7fe69015c7f0 legacy=0x7fe69015f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:07.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.890+0000 7fe68dd9b640 1 -- 172.21.15.53:0/2700609580 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe69015fd70 con 0x7fe69006b780 2023-06-10T18:57:07.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.890+0000 7fe68dd9b640 1 -- 172.21.15.53:0/2700609580 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fe680001680 con 0x7fe69006b780 2023-06-10T18:57:07.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.890+0000 7fe68dd9b640 1 -- 172.21.15.53:0/2700609580 >> v1:172.21.15.53:6789/0 conn(0x7fe69006b780 legacy=0x7fe69006bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:07.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.890+0000 7fe68dd9b640 1 --2- 172.21.15.53:0/2700609580 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6780039f0 0x7fe678003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:07.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.890+0000 7fe68dd9b640 1 --2- 172.21.15.53:0/2700609580 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6780047d0 0x7fe678004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:07.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.890+0000 7fe68dd9b640 1 --2- 172.21.15.53:0/2700609580 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6780051d0 0x7fe67800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:07.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.890+0000 7fe68dd9b640 1 -- 172.21.15.53:0/2700609580 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe69015c3d0 con 0x7fe6780051d0 2023-06-10T18:57:07.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.890+0000 7fe68dd9b640 1 -- 172.21.15.53:0/2700609580 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe67800c110 con 0x7fe6780047d0 2023-06-10T18:57:07.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.890+0000 7fe68dd9b640 1 -- 172.21.15.53:0/2700609580 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe67800c2d0 con 0x7fe6780039f0 2023-06-10T18:57:07.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.890+0000 7fe68f59e640 1 --2- 172.21.15.53:0/2700609580 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6780051d0 0x7fe67800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:07.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.890+0000 7fe68e59c640 1 --2- 172.21.15.53:0/2700609580 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6780047d0 0x7fe678004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:07.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.890+0000 7fe68ed9d640 1 --2- 172.21.15.53:0/2700609580 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6780039f0 0x7fe678003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:07.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.890+0000 7fe68f59e640 1 -- 172.21.15.53:0/2700609580 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6780039f0 msgr2=0x7fe678003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:07.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.890+0000 7fe68f59e640 1 --2- 172.21.15.53:0/2700609580 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6780039f0 0x7fe678003e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:07.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.890+0000 7fe68f59e640 1 -- 172.21.15.53:0/2700609580 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6780047d0 msgr2=0x7fe678004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:07.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.890+0000 7fe68f59e640 1 --2- 172.21.15.53:0/2700609580 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6780047d0 0x7fe678004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:07.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.890+0000 7fe68f59e640 1 -- 172.21.15.53:0/2700609580 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe678003530 con 0x7fe6780051d0 2023-06-10T18:57:07.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.894+0000 7fe68f59e640 1 -- 172.21.15.53:0/2700609580 reap_dead start 2023-06-10T18:57:07.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.894+0000 7fe68f59e640 1 --2- 172.21.15.53:0/2700609580 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6780051d0 0x7fe67800b990 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fe688009f90 tx=0x7fe68801cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9faf145bc00965ef server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:07.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.894+0000 7fe68dd9b640 1 -- 172.21.15.53:0/2700609580 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6880a5c70 con 0x7fe6780051d0 2023-06-10T18:57:07.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.894+0000 7fe68dd9b640 1 -- 172.21.15.53:0/2700609580 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe68800f040 con 0x7fe6780051d0 2023-06-10T18:57:07.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.894+0000 7fe68dd9b640 1 -- 172.21.15.53:0/2700609580 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6880039a0 con 0x7fe6780051d0 2023-06-10T18:57:07.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.894+0000 7fe6951a3640 1 -- 172.21.15.53:0/2700609580 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6780051d0 msgr2=0x7fe67800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:07.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.894+0000 7fe6951a3640 1 --2- 172.21.15.53:0/2700609580 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6780051d0 0x7fe67800b990 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fe688009f90 tx=0x7fe68801cc60 comp rx=0 tx=0).stop 2023-06-10T18:57:07.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.894+0000 7fe6951a3640 1 -- 172.21.15.53:0/2700609580 shutdown_connections 2023-06-10T18:57:07.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.894+0000 7fe6951a3640 1 --2- 172.21.15.53:0/2700609580 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6780051d0 0x7fe67800b990 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:07.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.894+0000 7fe6951a3640 1 -- 172.21.15.53:0/2700609580 >> 172.21.15.53:0/2700609580 conn(0x7fe69006a090 msgr2=0x7fe69006d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:07.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.894+0000 7fe6951a3640 1 -- 172.21.15.53:0/2700609580 shutdown_connections 2023-06-10T18:57:07.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.894+0000 7fe6951a3640 1 -- 172.21.15.53:0/2700609580 wait complete. 2023-06-10T18:57:07.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.894+0000 7fe6951a3640 1 Processor -- start 2023-06-10T18:57:07.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.894+0000 7fe6951a3640 1 -- start start 2023-06-10T18:57:07.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.898+0000 7fe6951a3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6780051d0 0x7fe6901f0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:07.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.898+0000 7fe6951a3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6900ccb80 0x7fe6900ad150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:07.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.898+0000 7fe6951a3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6900ccff0 0x7fe6900ad690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:07.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.898+0000 7fe6951a3640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6900adbd0 con 0x7fe6900ccff0 2023-06-10T18:57:07.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.898+0000 7fe6951a3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6901f0ff0 con 0x7fe6900ccb80 2023-06-10T18:57:07.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.898+0000 7fe6951a3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6900b50c0 con 0x7fe6780051d0 2023-06-10T18:57:07.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.898+0000 7fe68f59e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6900ccff0 0x7fe6900ad690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:07.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.898+0000 7fe68f59e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6900ccff0 0x7fe6900ad690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35372/0 (socket says 172.21.15.53:35372) 2023-06-10T18:57:07.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.898+0000 7fe68f59e640 1 -- 172.21.15.53:0/1710410757 learned_addr learned my addr 172.21.15.53:0/1710410757 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:57:07.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.898+0000 7fe68ed9d640 1 --2- 172.21.15.53:0/1710410757 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6780051d0 0x7fe6901f0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:07.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.898+0000 7fe68e59c640 1 --2- 172.21.15.53:0/1710410757 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6900ccb80 0x7fe6900ad150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:07.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.898+0000 7fe68f59e640 1 -- 172.21.15.53:0/1710410757 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6780051d0 msgr2=0x7fe6901f0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:07.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.898+0000 7fe68f59e640 1 --2- 172.21.15.53:0/1710410757 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6780051d0 0x7fe6901f0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:07.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.898+0000 7fe68f59e640 1 -- 172.21.15.53:0/1710410757 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6900ccb80 msgr2=0x7fe6900ad150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:07.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.898+0000 7fe68f59e640 1 --2- 172.21.15.53:0/1710410757 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6900ccb80 0x7fe6900ad150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:07.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.898+0000 7fe68f59e640 1 -- 172.21.15.53:0/1710410757 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6900b53a0 con 0x7fe6900ccff0 2023-06-10T18:57:07.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.898+0000 7fe68f59e640 1 --2- 172.21.15.53:0/1710410757 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6900ccff0 0x7fe6900ad690 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fe68801ca90 tx=0x7fe688009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:07.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.898+0000 7fe6777fe640 1 -- 172.21.15.53:0/1710410757 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe688003ba0 con 0x7fe6900ccff0 2023-06-10T18:57:07.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.898+0000 7fe6777fe640 1 -- 172.21.15.53:0/1710410757 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe688003d20 con 0x7fe6900ccff0 2023-06-10T18:57:07.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.898+0000 7fe6777fe640 1 -- 172.21.15.53:0/1710410757 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe688004260 con 0x7fe6900ccff0 2023-06-10T18:57:07.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.898+0000 7fe6951a3640 1 -- 172.21.15.53:0/1710410757 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6900b5680 con 0x7fe6900ccff0 2023-06-10T18:57:07.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.898+0000 7fe6951a3640 1 -- 172.21.15.53:0/1710410757 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6900ca800 con 0x7fe6900ccff0 2023-06-10T18:57:07.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.898+0000 7fe6951a3640 1 -- 172.21.15.53:0/1710410757 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe69015bc30 con 0x7fe6900ccff0 2023-06-10T18:57:07.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.898+0000 7fe6777fe640 1 -- 172.21.15.53:0/1710410757 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe6880043c0 con 0x7fe6900ccff0 2023-06-10T18:57:07.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.898+0000 7fe6777fe640 1 --2- 172.21.15.53:0/1710410757 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe67c066280 0x7fe67c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:07.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.898+0000 7fe6777fe640 1 -- 172.21.15.53:0/1710410757 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fe68811ed80 con 0x7fe6900ccff0 2023-06-10T18:57:07.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.898+0000 7fe68ed9d640 1 --2- 172.21.15.53:0/1710410757 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe67c066280 0x7fe67c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:07.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.902+0000 7fe68ed9d640 1 --2- 172.21.15.53:0/1710410757 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe67c066280 0x7fe67c068730 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe680000fc0 tx=0x7fe6800013e0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:07.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:07.902+0000 7fe6777fe640 1 -- 172.21.15.53:0/1710410757 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe69015bc30 con 0x7fe6900ccff0 2023-06-10T18:57:08.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:08.090+0000 7fe6951a3640 1 -- 172.21.15.53:0/1710410757 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe69015bc30 con 0x7fe6900ccff0 2023-06-10T18:57:08.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:08.090+0000 7fe6777fe640 1 -- 172.21.15.53:0/1710410757 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+3532 (secure 0 0 0) 0x7fe69015bc30 con 0x7fe6900ccff0 2023-06-10T18:57:08.097 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:57:08.097 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":22,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5168,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/275593879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":275593879},{"type":"v1","addr":"172.21.15.117:6837","nonce":275593879}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5422,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/2837986258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2837986258},{"type":"v1","addr":"172.21.15.117:6836","nonce":2837986258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5928,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/2789082937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2789082937},{"type":"v1","addr":"172.21.15.53:6833","nonce":2789082937}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":6441,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2019887676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2019887676},{"type":"v1","addr":"172.21.15.53:6835","nonce":2019887676}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[]} 2023-06-10T18:57:08.097 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 22 2023-06-10T18:57:08.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:08.094+0000 7fe6951a3640 1 -- 172.21.15.53:0/1710410757 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe67c066280 msgr2=0x7fe67c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:08.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:08.094+0000 7fe6951a3640 1 --2- 172.21.15.53:0/1710410757 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe67c066280 0x7fe67c068730 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe680000fc0 tx=0x7fe6800013e0 comp rx=0 tx=0).stop 2023-06-10T18:57:08.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:08.094+0000 7fe6951a3640 1 -- 172.21.15.53:0/1710410757 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6900ccff0 msgr2=0x7fe6900ad690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:08.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:08.094+0000 7fe6951a3640 1 --2- 172.21.15.53:0/1710410757 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6900ccff0 0x7fe6900ad690 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fe68801ca90 tx=0x7fe688009750 comp rx=0 tx=0).stop 2023-06-10T18:57:08.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:08.094+0000 7fe6951a3640 1 -- 172.21.15.53:0/1710410757 shutdown_connections 2023-06-10T18:57:08.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:08.094+0000 7fe6951a3640 1 --2- 172.21.15.53:0/1710410757 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe67c066280 0x7fe67c068730 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:08.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:08.094+0000 7fe6951a3640 1 --2- 172.21.15.53:0/1710410757 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6900ccff0 0x7fe6900ad690 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:08.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:08.094+0000 7fe6951a3640 1 --2- 172.21.15.53:0/1710410757 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6900ccb80 0x7fe6900ad150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:08.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:08.094+0000 7fe6951a3640 1 --2- 172.21.15.53:0/1710410757 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6780051d0 0x7fe6901f0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:08.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:08.094+0000 7fe6951a3640 1 -- 172.21.15.53:0/1710410757 >> 172.21.15.53:0/1710410757 conn(0x7fe69006a090 msgr2=0x7fe6900b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:08.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:08.094+0000 7fe6951a3640 1 -- 172.21.15.53:0/1710410757 shutdown_connections 2023-06-10T18:57:08.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:08.094+0000 7fe6951a3640 1 -- 172.21.15.53:0/1710410757 wait complete. 2023-06-10T18:57:08.115 INFO:tasks.ceph.mds.a:Restarting daemon 2023-06-10T18:57:08.116 INFO:tasks.ceph.mds.a:Stopping old one... 2023-06-10T18:57:08.116 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-06-10T18:57:08.116 INFO:teuthology.orchestra.run:waiting for 300 2023-06-10T18:57:08.117 INFO:tasks.ceph.mds.c:Restarting daemon 2023-06-10T18:57:08.117 INFO:tasks.ceph.mds.c:Stopping old one... 2023-06-10T18:57:08.117 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-06-10T18:57:08.117 INFO:teuthology.orchestra.run:waiting for 300 2023-06-10T18:57:08.118 INFO:tasks.ceph.mds.b:Restarting daemon 2023-06-10T18:57:08.118 INFO:tasks.ceph.mds.b:Stopping old one... 2023-06-10T18:57:08.118 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-06-10T18:57:08.118 INFO:teuthology.orchestra.run:waiting for 300 2023-06-10T18:57:08.118 INFO:tasks.ceph.mds.d:Restarting daemon 2023-06-10T18:57:08.119 INFO:tasks.ceph.mds.d:Stopping old one... 2023-06-10T18:57:08.119 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-06-10T18:57:08.119 INFO:teuthology.orchestra.run:waiting for 300 2023-06-10T18:57:08.126 INFO:tasks.ceph.mds.a:Stopped 2023-06-10T18:57:08.126 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-06-10T18:57:08.129 INFO:tasks.ceph.mds.c:Stopped 2023-06-10T18:57:08.129 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-06-10T18:57:08.132 INFO:tasks.ceph.mds.b:Stopped 2023-06-10T18:57:08.133 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-06-10T18:57:08.134 INFO:tasks.ceph.mds.d:Stopped 2023-06-10T18:57:08.134 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-06-10T18:57:08.174 INFO:tasks.ceph.mds.a:Started 2023-06-10T18:57:08.175 DEBUG:teuthology.parallel:result is None 2023-06-10T18:57:08.176 INFO:tasks.ceph.mds.c:Started 2023-06-10T18:57:08.176 DEBUG:teuthology.parallel:result is None 2023-06-10T18:57:08.179 INFO:tasks.ceph.mds.b:Started 2023-06-10T18:57:08.179 DEBUG:teuthology.parallel:result is None 2023-06-10T18:57:08.181 INFO:tasks.ceph.mds.d:Started 2023-06-10T18:57:08.181 DEBUG:teuthology.parallel:result is None 2023-06-10T18:57:08.181 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-06-10T18:57:08.237 INFO:tasks.ceph.mds.c.smithi053.stdout:starting mds.c at 2023-06-10T18:57:08.242 INFO:tasks.ceph.mds.a.smithi053.stdout:starting mds.a at 2023-06-10T18:57:08.251 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2023-06-10T18:57:08.251 INFO:tasks.ceph.mds.d.smithi117.stdout:starting mds.d at 2023-06-10T18:57:08.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:08.306+0000 7f702fd26640 1 Processor -- start 2023-06-10T18:57:08.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:08.306+0000 7f702fd26640 1 -- start start 2023-06-10T18:57:08.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:08.306+0000 7f702fd26640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f70280b3ac0 0x7f70280b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:08.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:08.306+0000 7f702fd26640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f70280cc690 0x7f70280b43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:08.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:08.306+0000 7f702fd26640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f70280d1b00 0x7f702815f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:08.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:08.306+0000 7f702fd26640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70280ccde0 con 0x7f70280cc690 2023-06-10T18:57:08.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:08.306+0000 7f702fd26640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70280ced00 con 0x7f70280b3ac0 2023-06-10T18:57:08.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:08.306+0000 7f702fd26640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70280cfc10 con 0x7f70280d1b00 2023-06-10T18:57:08.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:08.306+0000 7f702d2c1640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f70280cc690 0x7f70280b43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:08.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:08.306+0000 7f702d2c1640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f70280cc690 0x7f70280b43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35406/0 (socket says 172.21.15.53:35406) 2023-06-10T18:57:08.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:08.306+0000 7f702d2c1640 1 -- 172.21.15.53:0/942727443 learned_addr learned my addr 172.21.15.53:0/942727443 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:57:08.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:08.306+0000 7f702dac2640 1 --2- 172.21.15.53:0/942727443 >> v2:172.21.15.117:3300/0 conn(0x7f70280b3ac0 0x7f70280b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:08.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:08.306+0000 7f702e2c3640 1 --2- 172.21.15.53:0/942727443 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f70280d1b00 0x7f702815f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:08.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:08.306+0000 7f702d2c1640 1 -- 172.21.15.53:0/942727443 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f70280d1b00 msgr2=0x7f702815f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:08.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:08.306+0000 7f702d2c1640 1 --2- 172.21.15.53:0/942727443 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f70280d1b00 0x7f702815f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:08.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:08.306+0000 7f702d2c1640 1 -- 172.21.15.53:0/942727443 >> v2:172.21.15.117:3300/0 conn(0x7f70280b3ac0 msgr2=0x7f70280b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:08.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:08.306+0000 7f702d2c1640 1 --2- 172.21.15.53:0/942727443 >> v2:172.21.15.117:3300/0 conn(0x7f70280b3ac0 0x7f70280b3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:08.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:08.306+0000 7f702d2c1640 1 -- 172.21.15.53:0/942727443 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70280b4910 con 0x7f70280cc690 2023-06-10T18:57:08.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:08.306+0000 7f702d2c1640 1 --2- 172.21.15.53:0/942727443 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70280cc690 0x7f70280b43d0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f70280b4bd0 tx=0x7f701801c120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86a57c749a87ecd5 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:08.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:08.310+0000 7f702cac0640 1 -- 172.21.15.53:0/942727443 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70180ab600 con 0x7f70280cc690 2023-06-10T18:57:08.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:08.310+0000 7f702cac0640 1 -- 172.21.15.53:0/942727443 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70180a7050 con 0x7f70280cc690 2023-06-10T18:57:08.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:08.310+0000 7f702cac0640 1 -- 172.21.15.53:0/942727443 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70180ab980 con 0x7f70280cc690 2023-06-10T18:57:08.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:08.310+0000 7f702fd26640 1 -- 172.21.15.53:0/942727443 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70280cc690 msgr2=0x7f70280b43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:08.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:08.310+0000 7f702fd26640 1 --2- 172.21.15.53:0/942727443 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70280cc690 0x7f70280b43d0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f70280b4bd0 tx=0x7f701801c120 comp rx=0 tx=0).stop 2023-06-10T18:57:08.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:08.310+0000 7f702fd26640 1 -- 172.21.15.53:0/942727443 shutdown_connections 2023-06-10T18:57:08.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:08.310+0000 7f702fd26640 1 --2- 172.21.15.53:0/942727443 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f70280d1b00 0x7f702815f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:08.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:08.310+0000 7f702fd26640 1 --2- 172.21.15.53:0/942727443 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70280cc690 0x7f70280b43d0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:08.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:08.310+0000 7f702fd26640 1 --2- 172.21.15.53:0/942727443 >> v2:172.21.15.117:3300/0 conn(0x7f70280b3ac0 0x7f70280b3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:08.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:08.310+0000 7f702fd26640 1 -- 172.21.15.53:0/942727443 >> 172.21.15.53:0/942727443 conn(0x7f7028069de0 msgr2=0x7f702806a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:08.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:08.310+0000 7f702fd26640 1 -- 172.21.15.53:0/942727443 shutdown_connections 2023-06-10T18:57:08.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:08.310+0000 7f702fd26640 1 -- 172.21.15.53:0/942727443 wait complete. 2023-06-10T18:57:08.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:08.310+0000 7f702fd26640 1 Processor -- start 2023-06-10T18:57:08.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:08.310+0000 7f702fd26640 1 -- start start 2023-06-10T18:57:08.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:08.310+0000 7f702fd26640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f70280b3ac0 0x7f70280b6a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:08.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:08.310+0000 7f702fd26640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70280cc690 0x7f7028152330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:08.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:08.310+0000 7f702fd26640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70280d1b00 0x7f7028151b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:08.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:08.310+0000 7f702fd26640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70281536e0 con 0x7f70280cc690 2023-06-10T18:57:08.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:08.310+0000 7f702fd26640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7028152870 con 0x7f70280d1b00 2023-06-10T18:57:08.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:08.310+0000 7f702fd26640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7028152a60 con 0x7f70280b3ac0 2023-06-10T18:57:08.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:08.310+0000 7f702d2c1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70280cc690 0x7f7028152330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:08.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:08.310+0000 7f702d2c1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70280cc690 0x7f7028152330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35410/0 (socket says 172.21.15.53:35410) 2023-06-10T18:57:08.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:08.310+0000 7f702d2c1640 1 -- 172.21.15.53:0/3718669262 learned_addr learned my addr 172.21.15.53:0/3718669262 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:57:08.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:08.310+0000 7f702dac2640 1 --2- 172.21.15.53:0/3718669262 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f70280b3ac0 0x7f70280b6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:08.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:08.310+0000 7f702e2c3640 1 --2- 172.21.15.53:0/3718669262 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70280d1b00 0x7f7028151b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:08.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:08.310+0000 7f702d2c1640 1 -- 172.21.15.53:0/3718669262 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f70280b3ac0 msgr2=0x7f70280b6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:08.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:08.310+0000 7f702d2c1640 1 --2- 172.21.15.53:0/3718669262 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f70280b3ac0 0x7f70280b6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:08.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:08.310+0000 7f702d2c1640 1 -- 172.21.15.53:0/3718669262 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70280d1b00 msgr2=0x7f7028151b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:08.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:08.310+0000 7f702d2c1640 1 --2- 172.21.15.53:0/3718669262 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70280d1b00 0x7f7028151b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:08.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:08.310+0000 7f702d2c1640 1 -- 172.21.15.53:0/3718669262 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70180094d0 con 0x7f70280cc690 2023-06-10T18:57:08.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:08.310+0000 7f702d2c1640 1 --2- 172.21.15.53:0/3718669262 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70280cc690 0x7f7028152330 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f701801a7d0 tx=0x7f7018018ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:08.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:08.310+0000 7f701e7fc640 1 -- 172.21.15.53:0/3718669262 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70180b4420 con 0x7f70280cc690 2023-06-10T18:57:08.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:08.310+0000 7f701e7fc640 1 -- 172.21.15.53:0/3718669262 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70180b4580 con 0x7f70280cc690 2023-06-10T18:57:08.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:08.310+0000 7f702fd26640 1 -- 172.21.15.53:0/3718669262 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7028152d40 con 0x7f70280cc690 2023-06-10T18:57:08.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:08.310+0000 7f701e7fc640 1 -- 172.21.15.53:0/3718669262 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70180b48f0 con 0x7f70280cc690 2023-06-10T18:57:08.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:08.314+0000 7f702fd26640 1 -- 172.21.15.53:0/3718669262 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7028153300 con 0x7f70280cc690 2023-06-10T18:57:08.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:08.314+0000 7f702fd26640 1 -- 172.21.15.53:0/3718669262 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7028154750 con 0x7f70280cc690 2023-06-10T18:57:08.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:08.314+0000 7f701e7fc640 1 -- 172.21.15.53:0/3718669262 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f70180b2070 con 0x7f70280cc690 2023-06-10T18:57:08.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:08.314+0000 7f701e7fc640 1 --2- 172.21.15.53:0/3718669262 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f700c066280 0x7f700c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:08.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:08.314+0000 7f701e7fc640 1 -- 172.21.15.53:0/3718669262 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f701811d3c0 con 0x7f70280cc690 2023-06-10T18:57:08.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:08.314+0000 7f702dac2640 1 --2- 172.21.15.53:0/3718669262 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f700c066280 0x7f700c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:08.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:08.314+0000 7f702dac2640 1 --2- 172.21.15.53:0/3718669262 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f700c066280 0x7f700c068730 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f7024009ae0 tx=0x7f7024009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:08.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:08.318+0000 7f701e7fc640 1 -- 172.21.15.53:0/3718669262 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7028154750 con 0x7f70280cc690 2023-06-10T18:57:08.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:08.482+0000 7f702fd26640 1 -- 172.21.15.53:0/3718669262 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f7028154750 con 0x7f70280cc690 2023-06-10T18:57:09.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.290+0000 7f701e7fc640 1 -- 172.21.15.53:0/3718669262 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v61) v1 ==== 97+0+0 (secure 0 0 0) 0x7f7028154750 con 0x7f70280cc690 2023-06-10T18:57:09.294 INFO:teuthology.orchestra.run.smithi053.stderr: removed all blocklist entries 2023-06-10T18:57:09.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.294+0000 7f702fd26640 1 -- 172.21.15.53:0/3718669262 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f700c066280 msgr2=0x7f700c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:09.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.294+0000 7f702fd26640 1 --2- 172.21.15.53:0/3718669262 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f700c066280 0x7f700c068730 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f7024009ae0 tx=0x7f7024009190 comp rx=0 tx=0).stop 2023-06-10T18:57:09.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.294+0000 7f702fd26640 1 -- 172.21.15.53:0/3718669262 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70280cc690 msgr2=0x7f7028152330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:09.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.294+0000 7f702fd26640 1 --2- 172.21.15.53:0/3718669262 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70280cc690 0x7f7028152330 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f701801a7d0 tx=0x7f7018018ec0 comp rx=0 tx=0).stop 2023-06-10T18:57:09.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.294+0000 7f702fd26640 1 -- 172.21.15.53:0/3718669262 shutdown_connections 2023-06-10T18:57:09.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.294+0000 7f702fd26640 1 --2- 172.21.15.53:0/3718669262 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f700c066280 0x7f700c068730 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:09.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.294+0000 7f702fd26640 1 --2- 172.21.15.53:0/3718669262 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70280d1b00 0x7f7028151b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:09.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.294+0000 7f702fd26640 1 --2- 172.21.15.53:0/3718669262 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70280cc690 0x7f7028152330 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:09.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.294+0000 7f702fd26640 1 --2- 172.21.15.53:0/3718669262 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f70280b3ac0 0x7f70280b6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:09.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.294+0000 7f702fd26640 1 -- 172.21.15.53:0/3718669262 >> 172.21.15.53:0/3718669262 conn(0x7f7028069de0 msgr2=0x7f70280d05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:09.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.294+0000 7f702fd26640 1 -- 172.21.15.53:0/3718669262 shutdown_connections 2023-06-10T18:57:09.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.294+0000 7f702fd26640 1 -- 172.21.15.53:0/3718669262 wait complete. 2023-06-10T18:57:09.323 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-06-10T18:57:09.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.446+0000 7f23e721f640 1 Processor -- start 2023-06-10T18:57:09.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.446+0000 7f23e721f640 1 -- start start 2023-06-10T18:57:09.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.450+0000 7f23e721f640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f23e00b3ac0 0x7f23e00b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:09.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.450+0000 7f23e721f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23e00d14c0 0x7f23e015fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:09.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.450+0000 7f23e721f640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23e00d0020 con 0x7f23e00cc690 2023-06-10T18:57:09.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.450+0000 7f23e721f640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23e00b43d0 con 0x7f23e00b3ac0 2023-06-10T18:57:09.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.450+0000 7f23e721f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23e00cef40 con 0x7f23e00d14c0 2023-06-10T18:57:09.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.450+0000 7f23dffff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f23e00cc690 0x7f23e015f370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:48928/0 (socket says 172.21.15.53:48928) 2023-06-10T18:57:09.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.450+0000 7f23dffff640 1 -- 172.21.15.53:0/408876593 learned_addr learned my addr 172.21.15.53:0/408876593 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:57:09.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.450+0000 7f23df7fe640 1 -- 172.21.15.53:0/408876593 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1581138554 0 0) 0x7f23e00d0020 con 0x7f23e00cc690 2023-06-10T18:57:09.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.450+0000 7f23df7fe640 1 -- 172.21.15.53:0/408876593 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23c8003530 con 0x7f23e00cc690 2023-06-10T18:57:09.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.450+0000 7f23e57bc640 1 --2- 172.21.15.53:0/408876593 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23e00d14c0 0x7f23e015fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:09.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.450+0000 7f23e4fbb640 1 --2- 172.21.15.53:0/408876593 >> v2:172.21.15.117:3300/0 conn(0x7f23e00b3ac0 0x7f23e00b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:09.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.450+0000 7f23df7fe640 1 -- 172.21.15.53:0/408876593 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 168146711 0 0) 0x7f23c8003530 con 0x7f23e00cc690 2023-06-10T18:57:09.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.450+0000 7f23df7fe640 1 -- 172.21.15.53:0/408876593 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23e00d14c0 msgr2=0x7f23e015fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:09.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.450+0000 7f23df7fe640 1 --2- 172.21.15.53:0/408876593 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23e00d14c0 0x7f23e015fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:09.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.450+0000 7f23df7fe640 1 -- 172.21.15.53:0/408876593 >> v2:172.21.15.117:3300/0 conn(0x7f23e00b3ac0 msgr2=0x7f23e00b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:09.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.450+0000 7f23df7fe640 1 --2- 172.21.15.53:0/408876593 >> v2:172.21.15.117:3300/0 conn(0x7f23e00b3ac0 0x7f23e00b3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:09.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.450+0000 7f23df7fe640 1 -- 172.21.15.53:0/408876593 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23e00cf220 con 0x7f23e00cc690 2023-06-10T18:57:09.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.450+0000 7f23df7fe640 1 -- 172.21.15.53:0/408876593 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f23d4001680 con 0x7f23e00cc690 2023-06-10T18:57:09.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.450+0000 7f23df7fe640 1 -- 172.21.15.53:0/408876593 >> v1:172.21.15.53:6789/0 conn(0x7f23e00cc690 legacy=0x7f23e015f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:09.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.450+0000 7f23df7fe640 1 --2- 172.21.15.53:0/408876593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f23c80039f0 0x7f23c8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:09.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.450+0000 7f23df7fe640 1 --2- 172.21.15.53:0/408876593 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23e00d14c0 0x7f23c80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:09.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.450+0000 7f23df7fe640 1 --2- 172.21.15.53:0/408876593 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23c8004d10 0x7f23c8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:09.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.450+0000 7f23df7fe640 1 -- 172.21.15.53:0/408876593 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e00b43d0 con 0x7f23c80039f0 2023-06-10T18:57:09.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.450+0000 7f23df7fe640 1 -- 172.21.15.53:0/408876593 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e00cef40 con 0x7f23c8004d10 2023-06-10T18:57:09.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.450+0000 7f23df7fe640 1 -- 172.21.15.53:0/408876593 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23c800b990 con 0x7f23e00d14c0 2023-06-10T18:57:09.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.450+0000 7f23e4fbb640 1 --2- 172.21.15.53:0/408876593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f23c80039f0 0x7f23c8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:09.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.450+0000 7f23dffff640 1 --2- 172.21.15.53:0/408876593 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23e00d14c0 0x7f23c80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:09.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.450+0000 7f23e57bc640 1 --2- 172.21.15.53:0/408876593 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23c8004d10 0x7f23c8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:09.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.450+0000 7f23e4fbb640 1 -- 172.21.15.53:0/408876593 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23e00d14c0 msgr2=0x7f23c80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:09.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.450+0000 7f23e4fbb640 1 --2- 172.21.15.53:0/408876593 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23e00d14c0 0x7f23c80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:09.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.450+0000 7f23e4fbb640 1 -- 172.21.15.53:0/408876593 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23c8004d10 msgr2=0x7f23c8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:09.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.450+0000 7f23e4fbb640 1 --2- 172.21.15.53:0/408876593 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23c8004d10 0x7f23c8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:09.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.450+0000 7f23e4fbb640 1 -- 172.21.15.53:0/408876593 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23c8003530 con 0x7f23c80039f0 2023-06-10T18:57:09.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.450+0000 7f23e57bc640 1 --2- 172.21.15.53:0/408876593 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23c8004d10 0x7f23c8005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:57:09.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.454+0000 7f23e4fbb640 1 --2- 172.21.15.53:0/408876593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f23c80039f0 0x7f23c8003e00 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f23d0009ae0 tx=0x7f23d001ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42cfe933b4700e84 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:09.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.454+0000 7f23df7fe640 1 -- 172.21.15.53:0/408876593 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d00a5540 con 0x7f23c80039f0 2023-06-10T18:57:09.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.454+0000 7f23df7fe640 1 -- 172.21.15.53:0/408876593 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23d00a56a0 con 0x7f23c80039f0 2023-06-10T18:57:09.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.454+0000 7f23df7fe640 1 -- 172.21.15.53:0/408876593 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d00a5a50 con 0x7f23c80039f0 2023-06-10T18:57:09.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.454+0000 7f23e721f640 1 -- 172.21.15.53:0/408876593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f23c80039f0 msgr2=0x7f23c8003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:09.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.454+0000 7f23e721f640 1 --2- 172.21.15.53:0/408876593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f23c80039f0 0x7f23c8003e00 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f23d0009ae0 tx=0x7f23d001ca00 comp rx=0 tx=0).stop 2023-06-10T18:57:09.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.454+0000 7f23e57bc640 1 -- 172.21.15.53:0/408876593 reap_dead start 2023-06-10T18:57:09.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.454+0000 7f23e721f640 1 -- 172.21.15.53:0/408876593 shutdown_connections 2023-06-10T18:57:09.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.454+0000 7f23e721f640 1 -- 172.21.15.53:0/408876593 >> 172.21.15.53:0/408876593 conn(0x7f23e0071790 msgr2=0x7f23e0069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:09.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.454+0000 7f23e721f640 1 -- 172.21.15.53:0/408876593 shutdown_connections 2023-06-10T18:57:09.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.454+0000 7f23e721f640 1 -- 172.21.15.53:0/408876593 wait complete. 2023-06-10T18:57:09.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.454+0000 7f23e721f640 1 Processor -- start 2023-06-10T18:57:09.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.454+0000 7f23e721f640 1 -- start start 2023-06-10T18:57:09.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.454+0000 7f23e721f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23c80039f0 0x7f23e01f5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:09.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.454+0000 7f23e721f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23e00c8a60 0x7f23e015e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:09.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.454+0000 7f23e721f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f23e015e800 0x7f23e0158ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:09.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.454+0000 7f23e721f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e015eca0 con 0x7f23e015e800 2023-06-10T18:57:09.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.454+0000 7f23e721f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e0156dd0 con 0x7f23e00c8a60 2023-06-10T18:57:09.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.454+0000 7f23e721f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23e01f57c0 con 0x7f23c80039f0 2023-06-10T18:57:09.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.454+0000 7f23e57bc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f23e015e800 0x7f23e0158ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:09.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.454+0000 7f23e57bc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f23e015e800 0x7f23e0158ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35418/0 (socket says 172.21.15.53:35418) 2023-06-10T18:57:09.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.454+0000 7f23e57bc640 1 -- 172.21.15.53:0/2080703961 learned_addr learned my addr 172.21.15.53:0/2080703961 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:57:09.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.454+0000 7f23e4fbb640 1 --2- 172.21.15.53:0/2080703961 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23c80039f0 0x7f23e01f5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:09.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.454+0000 7f23dffff640 1 --2- 172.21.15.53:0/2080703961 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23e00c8a60 0x7f23e015e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:09.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.458+0000 7f23e57bc640 1 -- 172.21.15.53:0/2080703961 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23c80039f0 msgr2=0x7f23e01f5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:09.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.458+0000 7f23e57bc640 1 --2- 172.21.15.53:0/2080703961 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23c80039f0 0x7f23e01f5280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:09.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.458+0000 7f23e57bc640 1 -- 172.21.15.53:0/2080703961 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23e00c8a60 msgr2=0x7f23e015e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:09.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.458+0000 7f23e57bc640 1 --2- 172.21.15.53:0/2080703961 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23e00c8a60 0x7f23e015e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:09.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.458+0000 7f23e57bc640 1 -- 172.21.15.53:0/2080703961 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23e015be00 con 0x7f23e015e800 2023-06-10T18:57:09.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.458+0000 7f23e57bc640 1 --2- 172.21.15.53:0/2080703961 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f23e015e800 0x7f23e0158ac0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f23e00d1890 tx=0x7f23d8007f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:09.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.458+0000 7f23dd7fa640 1 -- 172.21.15.53:0/2080703961 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d8014760 con 0x7f23e015e800 2023-06-10T18:57:09.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.458+0000 7f23dd7fa640 1 -- 172.21.15.53:0/2080703961 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23d8011040 con 0x7f23e015e800 2023-06-10T18:57:09.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.458+0000 7f23dd7fa640 1 -- 172.21.15.53:0/2080703961 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d8014ae0 con 0x7f23e015e800 2023-06-10T18:57:09.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.458+0000 7f23e721f640 1 -- 172.21.15.53:0/2080703961 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23e01597f0 con 0x7f23e015e800 2023-06-10T18:57:09.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.458+0000 7f23e721f640 1 -- 172.21.15.53:0/2080703961 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23e015c380 con 0x7f23e015e800 2023-06-10T18:57:09.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.458+0000 7f23e721f640 1 -- 172.21.15.53:0/2080703961 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23e00b6c70 con 0x7f23e015e800 2023-06-10T18:57:09.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.458+0000 7f23dd7fa640 1 -- 172.21.15.53:0/2080703961 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f23d8014c40 con 0x7f23e015e800 2023-06-10T18:57:09.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.458+0000 7f23dd7fa640 1 --2- 172.21.15.53:0/2080703961 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f23cc066280 0x7f23cc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:09.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.458+0000 7f23dd7fa640 1 -- 172.21.15.53:0/2080703961 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f23d8083370 con 0x7f23e015e800 2023-06-10T18:57:09.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.458+0000 7f23e4fbb640 1 --2- 172.21.15.53:0/2080703961 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f23cc066280 0x7f23cc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:09.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.462+0000 7f23e4fbb640 1 --2- 172.21.15.53:0/2080703961 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f23cc066280 0x7f23cc068730 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f23d00af000 tx=0x7f23d00046d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:09.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.462+0000 7f23dd7fa640 1 -- 172.21.15.53:0/2080703961 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f23d8050bf0 con 0x7f23e015e800 2023-06-10T18:57:09.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.670+0000 7f23e721f640 1 -- 172.21.15.53:0/2080703961 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f23e004d790 con 0x7f23e015e800 2023-06-10T18:57:09.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.674+0000 7f23dd7fa640 1 -- 172.21.15.53:0/2080703961 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v12) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f23d8054210 con 0x7f23e015e800 2023-06-10T18:57:09.678 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:57:09.678 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-06-10T18:57:09.679 INFO:teuthology.orchestra.run.smithi053.stdout: "auth_dump": [ 2023-06-10T18:57:09.679 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T18:57:09.679 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.a", 2023-06-10T18:57:09.679 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkWqEQBhAAW+iEw0Gxfw744rsYc/tfTQ==", 2023-06-10T18:57:09.679 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T18:57:09.679 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T18:57:09.680 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2023-06-10T18:57:09.680 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2023-06-10T18:57:09.680 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T18:57:09.680 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:57:09.680 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:57:09.680 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T18:57:09.680 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.b", 2023-06-10T18:57:09.681 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkSu02FRAAFpo6NpcwDLZUt2Rgk/wm8w==", 2023-06-10T18:57:09.681 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T18:57:09.681 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T18:57:09.681 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2023-06-10T18:57:09.681 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2023-06-10T18:57:09.682 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T18:57:09.682 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:57:09.682 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:57:09.682 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T18:57:09.682 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.c", 2023-06-10T18:57:09.682 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRk19/ODhAAodfGGNLP7UbNhHySgaukrg==", 2023-06-10T18:57:09.682 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T18:57:09.683 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T18:57:09.683 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2023-06-10T18:57:09.683 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2023-06-10T18:57:09.683 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T18:57:09.683 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:57:09.683 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:57:09.683 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T18:57:09.683 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.d", 2023-06-10T18:57:09.684 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkogwkGxAAIavVKa8GtML1XQDEMwwokQ==", 2023-06-10T18:57:09.684 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T18:57:09.684 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T18:57:09.684 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2023-06-10T18:57:09.684 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2023-06-10T18:57:09.685 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T18:57:09.685 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:57:09.685 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:57:09.685 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T18:57:09.685 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.0", 2023-06-10T18:57:09.685 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA7xoRkoj1OMhAAYFc4W5kAlMBqY2yzeJZXQw==", 2023-06-10T18:57:09.685 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T18:57:09.686 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T18:57:09.686 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T18:57:09.686 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T18:57:09.686 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:57:09.686 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:57:09.686 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T18:57:09.687 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.1", 2023-06-10T18:57:09.687 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA+xoRk6FpDOBAALjxW3eaIh3Gu9b1rmMmqfw==", 2023-06-10T18:57:09.687 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T18:57:09.687 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T18:57:09.687 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T18:57:09.687 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T18:57:09.687 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:57:09.687 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:57:09.688 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T18:57:09.688 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.2", 2023-06-10T18:57:09.688 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBCxoRkaO2GBRAA0Xr5en+n5DxhZDg8kVswpQ==", 2023-06-10T18:57:09.688 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T18:57:09.688 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T18:57:09.688 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T18:57:09.688 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T18:57:09.689 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:57:09.689 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:57:09.689 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T18:57:09.689 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.3", 2023-06-10T18:57:09.689 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBFxoRkjfsBDhAAArYYrPnmXu5VcUMGVjQXZg==", 2023-06-10T18:57:09.689 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T18:57:09.689 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T18:57:09.689 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T18:57:09.690 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T18:57:09.690 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:57:09.690 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:57:09.690 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T18:57:09.690 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.4", 2023-06-10T18:57:09.690 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBLxoRkybumChAAdym/nl9bzyI71flvuy9Vtw==", 2023-06-10T18:57:09.690 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T18:57:09.690 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T18:57:09.691 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T18:57:09.691 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T18:57:09.691 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:57:09.691 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:57:09.691 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T18:57:09.691 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.5", 2023-06-10T18:57:09.691 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBOxoRkinSGIRAAwLbgYKI4NsbHKqGo9O4WuQ==", 2023-06-10T18:57:09.691 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T18:57:09.692 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T18:57:09.692 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T18:57:09.692 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T18:57:09.692 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:57:09.692 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:57:09.692 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T18:57:09.692 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.6", 2023-06-10T18:57:09.692 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBRxoRkj7VlKRAAs2ReBZ5iqtr17Nli9kUtGQ==", 2023-06-10T18:57:09.693 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T18:57:09.693 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T18:57:09.693 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T18:57:09.693 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T18:57:09.693 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:57:09.693 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:57:09.693 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T18:57:09.693 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.7", 2023-06-10T18:57:09.694 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBUxoRk48CnMhAASfbeuCo9jDuHQrYDQ8Vt3A==", 2023-06-10T18:57:09.694 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T18:57:09.694 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T18:57:09.694 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T18:57:09.694 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T18:57:09.694 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:57:09.694 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:57:09.695 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T18:57:09.695 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.0", 2023-06-10T18:57:09.695 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkgey1IBAAkNYrXMgUOnavBY/5uGyFrw==", 2023-06-10T18:57:09.695 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T18:57:09.695 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T18:57:09.695 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow r", 2023-06-10T18:57:09.695 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-06-10T18:57:09.695 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:57:09.696 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:57:09.696 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T18:57:09.696 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.1", 2023-06-10T18:57:09.696 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkBw+UKBAAuvT+vXmJLG5CvQVg5xItDQ==", 2023-06-10T18:57:09.696 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T18:57:09.697 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T18:57:09.697 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow r", 2023-06-10T18:57:09.697 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow rw", 2023-06-10T18:57:09.697 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rwx" 2023-06-10T18:57:09.697 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:57:09.697 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:57:09.697 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T18:57:09.697 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.2", 2023-06-10T18:57:09.698 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkewjeJRAA4pmIEVJ3Z7GKQFmA54CZ5Q==", 2023-06-10T18:57:09.698 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T18:57:09.698 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T18:57:09.698 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow r", 2023-06-10T18:57:09.698 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow rw", 2023-06-10T18:57:09.698 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rwx" 2023-06-10T18:57:09.699 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:57:09.699 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:57:09.699 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T18:57:09.699 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.3", 2023-06-10T18:57:09.699 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkHwCiLRAAWGt8UoWxGlG1Y1zSPbKUCg==", 2023-06-10T18:57:09.699 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T18:57:09.700 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T18:57:09.700 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow r", 2023-06-10T18:57:09.700 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow rw", 2023-06-10T18:57:09.700 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rwx" 2023-06-10T18:57:09.700 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:57:09.700 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:57:09.700 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T18:57:09.701 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.admin", 2023-06-10T18:57:09.701 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA5xoRkIVgrKBAABIxiaOPe9h5ne2y2l50aMg==", 2023-06-10T18:57:09.701 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T18:57:09.701 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow *", 2023-06-10T18:57:09.701 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2023-06-10T18:57:09.701 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2023-06-10T18:57:09.701 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T18:57:09.701 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:57:09.702 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:57:09.702 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T18:57:09.702 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mgr.x", 2023-06-10T18:57:09.702 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkzWG3AhAAh3NFYHAbp4fgn4FZeRRNuw==", 2023-06-10T18:57:09.702 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T18:57:09.702 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow *", 2023-06-10T18:57:09.702 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile mgr", 2023-06-10T18:57:09.702 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T18:57:09.703 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:57:09.703 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:57:09.703 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T18:57:09.703 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mgr.y", 2023-06-10T18:57:09.703 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA5xoRkBriKOxAA6G+T7Yp2rH7XV7z37lvMYQ==", 2023-06-10T18:57:09.703 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T18:57:09.703 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow *", 2023-06-10T18:57:09.703 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile mgr", 2023-06-10T18:57:09.704 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T18:57:09.704 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:57:09.704 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:57:09.704 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2023-06-10T18:57:09.704 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-06-10T18:57:09.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.674+0000 7f23e721f640 1 -- 172.21.15.53:0/2080703961 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f23cc066280 msgr2=0x7f23cc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:09.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.674+0000 7f23e721f640 1 --2- 172.21.15.53:0/2080703961 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f23cc066280 0x7f23cc068730 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f23d00af000 tx=0x7f23d00046d0 comp rx=0 tx=0).stop 2023-06-10T18:57:09.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.674+0000 7f23e721f640 1 -- 172.21.15.53:0/2080703961 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f23e015e800 msgr2=0x7f23e0158ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:09.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.674+0000 7f23e721f640 1 --2- 172.21.15.53:0/2080703961 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f23e015e800 0x7f23e0158ac0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f23e00d1890 tx=0x7f23d8007f00 comp rx=0 tx=0).stop 2023-06-10T18:57:09.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.674+0000 7f23e721f640 1 -- 172.21.15.53:0/2080703961 shutdown_connections 2023-06-10T18:57:09.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.674+0000 7f23e721f640 1 --2- 172.21.15.53:0/2080703961 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f23cc066280 0x7f23cc068730 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:09.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.674+0000 7f23e721f640 1 --2- 172.21.15.53:0/2080703961 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f23e015e800 0x7f23e0158ac0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:09.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.674+0000 7f23e721f640 1 --2- 172.21.15.53:0/2080703961 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23e00c8a60 0x7f23e015e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:09.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.674+0000 7f23e721f640 1 --2- 172.21.15.53:0/2080703961 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23c80039f0 0x7f23e01f5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:09.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.674+0000 7f23e721f640 1 -- 172.21.15.53:0/2080703961 >> 172.21.15.53:0/2080703961 conn(0x7f23e0071790 msgr2=0x7f23e015ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:09.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.674+0000 7f23e721f640 1 -- 172.21.15.53:0/2080703961 shutdown_connections 2023-06-10T18:57:09.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.674+0000 7f23e721f640 1 -- 172.21.15.53:0/2080703961 wait complete. 2023-06-10T18:57:09.707 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T18:57:09.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.826+0000 7f35cb0a8640 1 Processor -- start 2023-06-10T18:57:09.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.826+0000 7f35cb0a8640 1 -- start start 2023-06-10T18:57:09.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.830+0000 7f35cb0a8640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f35c4161180 0x7f35c4163560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:09.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.830+0000 7f35cb0a8640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35c4158a90 con 0x7f35c40c8d00 2023-06-10T18:57:09.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.830+0000 7f35cb0a8640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35c406f780 con 0x7f35c406b2f0 2023-06-10T18:57:09.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.830+0000 7f35cb0a8640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35c40705d0 con 0x7f35c4161180 2023-06-10T18:57:09.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.830+0000 7f35c3fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f35c40c8d00 0x7f35c406b6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:48944/0 (socket says 172.21.15.53:48944) 2023-06-10T18:57:09.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.830+0000 7f35c3fff640 1 -- 172.21.15.53:0/2002035225 learned_addr learned my addr 172.21.15.53:0/2002035225 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:57:09.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.830+0000 7f35c37fe640 1 -- 172.21.15.53:0/2002035225 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3052429755 0 0) 0x7f35b8001120 con 0x7f35c40c8d00 2023-06-10T18:57:09.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.830+0000 7f35c9645640 1 --2- 172.21.15.53:0/2002035225 >> v2:172.21.15.117:3300/0 conn(0x7f35c4161180 0x7f35c4163560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:09.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.830+0000 7f35c37fe640 1 -- 172.21.15.53:0/2002035225 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35ac005740 con 0x7f35c40c8d00 2023-06-10T18:57:09.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.830+0000 7f35c37fe640 1 -- 172.21.15.53:0/2002035225 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2378427725 0 0) 0x7f35ac005740 con 0x7f35c40c8d00 2023-06-10T18:57:09.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.830+0000 7f35c37fe640 1 -- 172.21.15.53:0/2002035225 >> v2:172.21.15.117:3300/0 conn(0x7f35c4161180 msgr2=0x7f35c4163560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:09.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.830+0000 7f35c37fe640 1 --2- 172.21.15.53:0/2002035225 >> v2:172.21.15.117:3300/0 conn(0x7f35c4161180 0x7f35c4163560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:09.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.830+0000 7f35c37fe640 1 -- 172.21.15.53:0/2002035225 >> v1:172.21.15.117:6789/0 conn(0x7f35c406b2f0 legacy=0x7f35c406f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:09.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.830+0000 7f35c37fe640 1 -- 172.21.15.53:0/2002035225 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c40cce10 con 0x7f35c40c8d00 2023-06-10T18:57:09.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.830+0000 7f35c37fe640 1 -- 172.21.15.53:0/2002035225 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f35b8001810 con 0x7f35c40c8d00 2023-06-10T18:57:09.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.830+0000 7f35c37fe640 1 -- 172.21.15.53:0/2002035225 >> v1:172.21.15.53:6789/0 conn(0x7f35c40c8d00 legacy=0x7f35c406b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:09.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.830+0000 7f35c37fe640 1 --2- 172.21.15.53:0/2002035225 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35ac005c00 0x7f35ac006010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:09.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.830+0000 7f35c37fe640 1 --2- 172.21.15.53:0/2002035225 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f35ac0069e0 0x7f35ac006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:09.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.830+0000 7f35c37fe640 1 --2- 172.21.15.53:0/2002035225 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35ac007390 0x7f35ac00dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:09.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.830+0000 7f35c37fe640 1 -- 172.21.15.53:0/2002035225 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c40705d0 con 0x7f35ac0069e0 2023-06-10T18:57:09.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.830+0000 7f35c37fe640 1 -- 172.21.15.53:0/2002035225 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35ac00e280 con 0x7f35ac005c00 2023-06-10T18:57:09.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.830+0000 7f35c37fe640 1 -- 172.21.15.53:0/2002035225 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35ac00e440 con 0x7f35ac007390 2023-06-10T18:57:09.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.830+0000 7f35c3fff640 1 --2- 172.21.15.53:0/2002035225 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f35ac0069e0 0x7f35ac006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:09.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.830+0000 7f35c8e44640 1 --2- 172.21.15.53:0/2002035225 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35ac005c00 0x7f35ac006010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:09.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.830+0000 7f35c9645640 1 --2- 172.21.15.53:0/2002035225 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35ac007390 0x7f35ac00dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:09.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.830+0000 7f35c3fff640 1 -- 172.21.15.53:0/2002035225 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35ac007390 msgr2=0x7f35ac00dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:09.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.830+0000 7f35c3fff640 1 --2- 172.21.15.53:0/2002035225 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35ac007390 0x7f35ac00dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:09.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.830+0000 7f35c3fff640 1 -- 172.21.15.53:0/2002035225 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35ac005c00 msgr2=0x7f35ac006010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:09.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.830+0000 7f35c3fff640 1 --2- 172.21.15.53:0/2002035225 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35ac005c00 0x7f35ac006010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:09.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.830+0000 7f35c3fff640 1 -- 172.21.15.53:0/2002035225 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35ac005740 con 0x7f35ac0069e0 2023-06-10T18:57:09.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.830+0000 7f35c9645640 1 -- 172.21.15.53:0/2002035225 reap_dead start 2023-06-10T18:57:09.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.834+0000 7f35c3fff640 1 --2- 172.21.15.53:0/2002035225 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f35ac0069e0 0x7f35ac006e50 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f35b800c190 tx=0x7f35b801cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbb030f289fd9f05 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:09.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.834+0000 7f35c37fe640 1 -- 172.21.15.53:0/2002035225 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b8005ae0 con 0x7f35ac0069e0 2023-06-10T18:57:09.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.834+0000 7f35c37fe640 1 -- 172.21.15.53:0/2002035225 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b8005c60 con 0x7f35ac0069e0 2023-06-10T18:57:09.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.834+0000 7f35c37fe640 1 -- 172.21.15.53:0/2002035225 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b80a5ae0 con 0x7f35ac0069e0 2023-06-10T18:57:09.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.834+0000 7f35cb0a8640 1 -- 172.21.15.53:0/2002035225 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f35ac0069e0 msgr2=0x7f35ac006e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:09.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.834+0000 7f35cb0a8640 1 --2- 172.21.15.53:0/2002035225 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f35ac0069e0 0x7f35ac006e50 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f35b800c190 tx=0x7f35b801cba0 comp rx=0 tx=0).stop 2023-06-10T18:57:09.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.834+0000 7f35cb0a8640 1 -- 172.21.15.53:0/2002035225 shutdown_connections 2023-06-10T18:57:09.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.834+0000 7f35cb0a8640 1 --2- 172.21.15.53:0/2002035225 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f35ac0069e0 0x7f35ac006e50 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:09.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.834+0000 7f35cb0a8640 1 -- 172.21.15.53:0/2002035225 >> 172.21.15.53:0/2002035225 conn(0x7f35c406a0d0 msgr2=0x7f35c40ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:09.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.834+0000 7f35cb0a8640 1 -- 172.21.15.53:0/2002035225 shutdown_connections 2023-06-10T18:57:09.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.834+0000 7f35cb0a8640 1 -- 172.21.15.53:0/2002035225 wait complete. 2023-06-10T18:57:09.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.834+0000 7f35cb0a8640 1 Processor -- start 2023-06-10T18:57:09.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.834+0000 7f35cb0a8640 1 -- start start 2023-06-10T18:57:09.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.834+0000 7f35cb0a8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35ac0069e0 0x7f35c41531f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:09.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.834+0000 7f35cb0a8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f35c41f1a70 0x7f35c40c1b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:09.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.834+0000 7f35cb0a8640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35c40b1a30 0x7f35c40abcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:09.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.834+0000 7f35cb0a8640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c4153730 con 0x7f35c41f1a70 2023-06-10T18:57:09.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.834+0000 7f35cb0a8640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c40c24a0 con 0x7f35ac0069e0 2023-06-10T18:57:09.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.834+0000 7f35cb0a8640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35c40c2780 con 0x7f35c40b1a30 2023-06-10T18:57:09.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.838+0000 7f35c3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f35c41f1a70 0x7f35c40c1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:09.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.838+0000 7f35c8e44640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35ac0069e0 0x7f35c41531f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:09.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.838+0000 7f35c3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f35c41f1a70 0x7f35c40c1b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35430/0 (socket says 172.21.15.53:35430) 2023-06-10T18:57:09.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.838+0000 7f35c3fff640 1 -- 172.21.15.53:0/4220052060 learned_addr learned my addr 172.21.15.53:0/4220052060 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:57:09.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.838+0000 7f35c9645640 1 --2- 172.21.15.53:0/4220052060 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35c40b1a30 0x7f35c40abcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:09.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.838+0000 7f35c3fff640 1 -- 172.21.15.53:0/4220052060 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35c40b1a30 msgr2=0x7f35c40abcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:09.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.838+0000 7f35c3fff640 1 --2- 172.21.15.53:0/4220052060 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35c40b1a30 0x7f35c40abcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:09.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.838+0000 7f35c3fff640 1 -- 172.21.15.53:0/4220052060 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35ac0069e0 msgr2=0x7f35c41531f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:09.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.838+0000 7f35c3fff640 1 --2- 172.21.15.53:0/4220052060 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35ac0069e0 0x7f35c41531f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:09.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.838+0000 7f35c3fff640 1 -- 172.21.15.53:0/4220052060 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c40c2a60 con 0x7f35c41f1a70 2023-06-10T18:57:09.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.838+0000 7f35c3fff640 1 --2- 172.21.15.53:0/4220052060 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f35c41f1a70 0x7f35c40c1b30 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f35b801c9d0 tx=0x7f35ac007a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:09.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.838+0000 7f35c17fa640 1 -- 172.21.15.53:0/4220052060 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b80b4070 con 0x7f35c41f1a70 2023-06-10T18:57:09.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.838+0000 7f35c17fa640 1 -- 172.21.15.53:0/4220052060 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b8001260 con 0x7f35c41f1a70 2023-06-10T18:57:09.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.838+0000 7f35cb0a8640 1 -- 172.21.15.53:0/4220052060 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35c41538c0 con 0x7f35c41f1a70 2023-06-10T18:57:09.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.838+0000 7f35c17fa640 1 -- 172.21.15.53:0/4220052060 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b80a5aa0 con 0x7f35c41f1a70 2023-06-10T18:57:09.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.838+0000 7f35cb0a8640 1 -- 172.21.15.53:0/4220052060 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35c40c2070 con 0x7f35c41f1a70 2023-06-10T18:57:09.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.838+0000 7f35cb0a8640 1 -- 172.21.15.53:0/4220052060 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35c404d790 con 0x7f35c41f1a70 2023-06-10T18:57:09.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.838+0000 7f35c17fa640 1 -- 172.21.15.53:0/4220052060 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f35b80a5c00 con 0x7f35c41f1a70 2023-06-10T18:57:09.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.838+0000 7f35c17fa640 1 --2- 172.21.15.53:0/4220052060 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f35b00662b0 0x7f35b0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:09.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.838+0000 7f35c17fa640 1 -- 172.21.15.53:0/4220052060 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f35b811d480 con 0x7f35c41f1a70 2023-06-10T18:57:09.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.838+0000 7f35c8e44640 1 --2- 172.21.15.53:0/4220052060 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f35b00662b0 0x7f35b0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:09.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.842+0000 7f35c8e44640 1 --2- 172.21.15.53:0/4220052060 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f35b00662b0 0x7f35b0068760 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f35b4000c10 tx=0x7f35b4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:09.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.842+0000 7f35c17fa640 1 -- 172.21.15.53:0/4220052060 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f35b80ead00 con 0x7f35c41f1a70 2023-06-10T18:57:10.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.998+0000 7f35cb0a8640 1 -- 172.21.15.53:0/4220052060 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f35c4158a90 con 0x7f35c41f1a70 2023-06-10T18:57:10.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:09.998+0000 7f35c17fa640 1 -- 172.21.15.53:0/4220052060 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+14627 (secure 0 0 0) 0x7f35c4158a90 con 0x7f35c41f1a70 2023-06-10T18:57:10.005 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:57:10.006 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":61,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T18:57:09.283016+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T18:57:10.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.002+0000 7f35cb0a8640 1 -- 172.21.15.53:0/4220052060 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f35b00662b0 msgr2=0x7f35b0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:10.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.002+0000 7f35cb0a8640 1 --2- 172.21.15.53:0/4220052060 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f35b00662b0 0x7f35b0068760 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f35b4000c10 tx=0x7f35b4009040 comp rx=0 tx=0).stop 2023-06-10T18:57:10.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.002+0000 7f35cb0a8640 1 -- 172.21.15.53:0/4220052060 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f35c41f1a70 msgr2=0x7f35c40c1b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:10.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.002+0000 7f35cb0a8640 1 --2- 172.21.15.53:0/4220052060 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f35c41f1a70 0x7f35c40c1b30 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f35b801c9d0 tx=0x7f35ac007a10 comp rx=0 tx=0).stop 2023-06-10T18:57:10.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.002+0000 7f35cb0a8640 1 -- 172.21.15.53:0/4220052060 shutdown_connections 2023-06-10T18:57:10.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.002+0000 7f35cb0a8640 1 --2- 172.21.15.53:0/4220052060 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f35b00662b0 0x7f35b0068760 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:10.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.002+0000 7f35cb0a8640 1 --2- 172.21.15.53:0/4220052060 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35c40b1a30 0x7f35c40abcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:10.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.002+0000 7f35cb0a8640 1 --2- 172.21.15.53:0/4220052060 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f35c41f1a70 0x7f35c40c1b30 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:10.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.002+0000 7f35cb0a8640 1 --2- 172.21.15.53:0/4220052060 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35ac0069e0 0x7f35c41531f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:10.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.002+0000 7f35cb0a8640 1 -- 172.21.15.53:0/4220052060 >> 172.21.15.53:0/4220052060 conn(0x7f35c406a0d0 msgr2=0x7f35c40ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:10.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.002+0000 7f35cb0a8640 1 -- 172.21.15.53:0/4220052060 shutdown_connections 2023-06-10T18:57:10.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.002+0000 7f35cb0a8640 1 -- 172.21.15.53:0/4220052060 wait complete. 2023-06-10T18:57:10.025 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-10T18:52:33.633114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-10T18:52:39.171487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-10T18:57:10.025 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-10T18:57:10.154 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.150+0000 7f618f058640 1 Processor -- start 2023-06-10T18:57:10.154 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.150+0000 7f618f058640 1 -- start start 2023-06-10T18:57:10.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.150+0000 7f618f058640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f61880c97d0 0x7f61880cb820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:10.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.150+0000 7f618f058640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61880ac910 con 0x7f618806c350 2023-06-10T18:57:10.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.150+0000 7f618f058640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61880cbd60 con 0x7f61880af760 2023-06-10T18:57:10.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.150+0000 7f618f058640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61880ca5c0 con 0x7f61880c97d0 2023-06-10T18:57:10.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.150+0000 7f6187fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f618806c350 0x7f61880ac200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:48960/0 (socket says 172.21.15.53:48960) 2023-06-10T18:57:10.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.150+0000 7f6187fff640 1 -- 172.21.15.53:0/2857580260 learned_addr learned my addr 172.21.15.53:0/2857580260 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:57:10.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.150+0000 7f618cdf4640 1 --2- 172.21.15.53:0/2857580260 >> v2:172.21.15.117:3300/0 conn(0x7f61880c97d0 0x7f61880cb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:10.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.150+0000 7f61877fe640 1 -- 172.21.15.53:0/2857580260 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2466818991 0 0) 0x7f61880ac910 con 0x7f618806c350 2023-06-10T18:57:10.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.150+0000 7f61877fe640 1 -- 172.21.15.53:0/2857580260 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6170003530 con 0x7f618806c350 2023-06-10T18:57:10.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.150+0000 7f61877fe640 1 -- 172.21.15.53:0/2857580260 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1776674419 0 0) 0x7f6170003530 con 0x7f618806c350 2023-06-10T18:57:10.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.150+0000 7f61877fe640 1 -- 172.21.15.53:0/2857580260 >> v2:172.21.15.117:3300/0 conn(0x7f61880c97d0 msgr2=0x7f61880cb820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:10.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.150+0000 7f61877fe640 1 --2- 172.21.15.53:0/2857580260 >> v2:172.21.15.117:3300/0 conn(0x7f61880c97d0 0x7f61880cb820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:10.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.150+0000 7f61877fe640 1 -- 172.21.15.53:0/2857580260 >> v1:172.21.15.117:6789/0 conn(0x7f61880af760 legacy=0x7f618806b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:10.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.150+0000 7f61877fe640 1 -- 172.21.15.53:0/2857580260 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61880abd70 con 0x7f618806c350 2023-06-10T18:57:10.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.150+0000 7f61877fe640 1 -- 172.21.15.53:0/2857580260 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f617c001680 con 0x7f618806c350 2023-06-10T18:57:10.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.150+0000 7f61877fe640 1 -- 172.21.15.53:0/2857580260 >> v1:172.21.15.53:6789/0 conn(0x7f618806c350 legacy=0x7f61880ac200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:10.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.150+0000 7f61877fe640 1 --2- 172.21.15.53:0/2857580260 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6170003980 0x7f6170003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:10.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.150+0000 7f61877fe640 1 --2- 172.21.15.53:0/2857580260 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61700047d0 0x7f6170004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:10.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.150+0000 7f61877fe640 1 --2- 172.21.15.53:0/2857580260 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61700052a0 0x7f617000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:10.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.150+0000 7f61877fe640 1 -- 172.21.15.53:0/2857580260 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61880ca5c0 con 0x7f61700052a0 2023-06-10T18:57:10.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.150+0000 7f61877fe640 1 -- 172.21.15.53:0/2857580260 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f617000c1d0 con 0x7f61700047d0 2023-06-10T18:57:10.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.150+0000 7f61877fe640 1 -- 172.21.15.53:0/2857580260 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f617000c390 con 0x7f6170003980 2023-06-10T18:57:10.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.150+0000 7f618d5f5640 1 --2- 172.21.15.53:0/2857580260 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61700052a0 0x7f617000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:10.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.150+0000 7f6187fff640 1 --2- 172.21.15.53:0/2857580260 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61700047d0 0x7f6170004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:10.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.150+0000 7f618cdf4640 1 --2- 172.21.15.53:0/2857580260 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6170003980 0x7f6170003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:10.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.150+0000 7f618d5f5640 1 -- 172.21.15.53:0/2857580260 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6170003980 msgr2=0x7f6170003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:10.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.150+0000 7f618d5f5640 1 --2- 172.21.15.53:0/2857580260 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6170003980 0x7f6170003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:10.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.150+0000 7f618d5f5640 1 -- 172.21.15.53:0/2857580260 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61700047d0 msgr2=0x7f6170004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:10.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.150+0000 7f618d5f5640 1 --2- 172.21.15.53:0/2857580260 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61700047d0 0x7f6170004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:10.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.150+0000 7f618d5f5640 1 -- 172.21.15.53:0/2857580260 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6170003530 con 0x7f61700052a0 2023-06-10T18:57:10.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.154+0000 7f618d5f5640 1 -- 172.21.15.53:0/2857580260 reap_dead start 2023-06-10T18:57:10.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.154+0000 7f618d5f5640 1 --2- 172.21.15.53:0/2857580260 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61700052a0 0x7f617000b990 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f6180001cd0 tx=0x7f618001c5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45ce3de5b74ba30a server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:10.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.154+0000 7f61877fe640 1 -- 172.21.15.53:0/2857580260 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6180003b80 con 0x7f61700052a0 2023-06-10T18:57:10.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.154+0000 7f61877fe640 1 -- 172.21.15.53:0/2857580260 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61800a7050 con 0x7f61700052a0 2023-06-10T18:57:10.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.154+0000 7f61877fe640 1 -- 172.21.15.53:0/2857580260 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61800050d0 con 0x7f61700052a0 2023-06-10T18:57:10.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.154+0000 7f618f058640 1 -- 172.21.15.53:0/2857580260 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61700052a0 msgr2=0x7f617000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:10.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.154+0000 7f618f058640 1 --2- 172.21.15.53:0/2857580260 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61700052a0 0x7f617000b990 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f6180001cd0 tx=0x7f618001c5c0 comp rx=0 tx=0).stop 2023-06-10T18:57:10.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.154+0000 7f618f058640 1 -- 172.21.15.53:0/2857580260 shutdown_connections 2023-06-10T18:57:10.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.154+0000 7f618f058640 1 --2- 172.21.15.53:0/2857580260 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61700052a0 0x7f617000b990 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:10.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.154+0000 7f618f058640 1 -- 172.21.15.53:0/2857580260 >> 172.21.15.53:0/2857580260 conn(0x7f618806a0e0 msgr2=0x7f61880cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:10.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.154+0000 7f618f058640 1 -- 172.21.15.53:0/2857580260 shutdown_connections 2023-06-10T18:57:10.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.154+0000 7f618f058640 1 -- 172.21.15.53:0/2857580260 wait complete. 2023-06-10T18:57:10.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.154+0000 7f618f058640 1 Processor -- start 2023-06-10T18:57:10.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.154+0000 7f618f058640 1 -- start start 2023-06-10T18:57:10.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.158+0000 7f618f058640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61700052a0 0x7f618814cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:10.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.158+0000 7f618f058640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f618815de40 0x7f618815cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:10.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.158+0000 7f618f058640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f618815e2b0 0x7f618815d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:10.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.158+0000 7f618f058640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61880c4580 con 0x7f618815de40 2023-06-10T18:57:10.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.158+0000 7f618f058640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61880b0b10 con 0x7f61700052a0 2023-06-10T18:57:10.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.158+0000 7f618f058640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f618815d970 con 0x7f618815e2b0 2023-06-10T18:57:10.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.158+0000 7f6187fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f618815de40 0x7f618815cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:10.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.158+0000 7f6187fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f618815de40 0x7f618815cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35454/0 (socket says 172.21.15.53:35454) 2023-06-10T18:57:10.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.158+0000 7f6187fff640 1 -- 172.21.15.53:0/2122149693 learned_addr learned my addr 172.21.15.53:0/2122149693 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:57:10.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.158+0000 7f618cdf4640 1 --2- 172.21.15.53:0/2122149693 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61700052a0 0x7f618814cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:10.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.158+0000 7f618d5f5640 1 --2- 172.21.15.53:0/2122149693 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f618815e2b0 0x7f618815d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:10.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.158+0000 7f6187fff640 1 -- 172.21.15.53:0/2122149693 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f618815e2b0 msgr2=0x7f618815d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:10.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.158+0000 7f6187fff640 1 --2- 172.21.15.53:0/2122149693 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f618815e2b0 0x7f618815d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:10.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.158+0000 7f6187fff640 1 -- 172.21.15.53:0/2122149693 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61700052a0 msgr2=0x7f618814cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:10.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.158+0000 7f6187fff640 1 --2- 172.21.15.53:0/2122149693 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61700052a0 0x7f618814cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:10.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.158+0000 7f6187fff640 1 -- 172.21.15.53:0/2122149693 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61880b0d60 con 0x7f618815de40 2023-06-10T18:57:10.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.158+0000 7f6187fff640 1 --2- 172.21.15.53:0/2122149693 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f618815de40 0x7f618815cef0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f617c00e780 tx=0x7f617c00ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:10.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.158+0000 7f61857fa640 1 -- 172.21.15.53:0/2122149693 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f617c00c6c0 con 0x7f618815de40 2023-06-10T18:57:10.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.158+0000 7f61857fa640 1 -- 172.21.15.53:0/2122149693 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f617c00c820 con 0x7f618815de40 2023-06-10T18:57:10.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.158+0000 7f61857fa640 1 -- 172.21.15.53:0/2122149693 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f617c00cbd0 con 0x7f618815de40 2023-06-10T18:57:10.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.158+0000 7f618f058640 1 -- 172.21.15.53:0/2122149693 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61880b1040 con 0x7f618815de40 2023-06-10T18:57:10.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.158+0000 7f618f058640 1 -- 172.21.15.53:0/2122149693 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61880b1600 con 0x7f618815de40 2023-06-10T18:57:10.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.158+0000 7f618f058640 1 -- 172.21.15.53:0/2122149693 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f618804d790 con 0x7f618815de40 2023-06-10T18:57:10.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.158+0000 7f61857fa640 1 -- 172.21.15.53:0/2122149693 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f617c00cd30 con 0x7f618815de40 2023-06-10T18:57:10.175 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.158+0000 7f61857fa640 1 --2- 172.21.15.53:0/2122149693 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6174066280 0x7f6174068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:10.175 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.158+0000 7f61857fa640 1 -- 172.21.15.53:0/2122149693 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f617c083860 con 0x7f618815de40 2023-06-10T18:57:10.175 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.158+0000 7f618cdf4640 1 --2- 172.21.15.53:0/2122149693 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6174066280 0x7f6174068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:10.175 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.162+0000 7f618cdf4640 1 --2- 172.21.15.53:0/2122149693 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6174066280 0x7f6174068730 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f61780099b0 tx=0x7f6178008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:10.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.162+0000 7f61857fa640 1 -- 172.21.15.53:0/2122149693 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f617c051030 con 0x7f618815de40 2023-06-10T18:57:10.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.318+0000 7f618f058640 1 -- 172.21.15.53:0/2122149693 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f61880c4ae0 con 0x7f618815de40 2023-06-10T18:57:10.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.322+0000 7f61857fa640 1 -- 172.21.15.53:0/2122149693 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v61) v1 ==== 93+0+10 (secure 0 0 0) 0x7f617c054650 con 0x7f618815de40 2023-06-10T18:57:10.368 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-06-10T18:57:10.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.322+0000 7f618f058640 1 -- 172.21.15.53:0/2122149693 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6174066280 msgr2=0x7f6174068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:10.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.322+0000 7f618f058640 1 --2- 172.21.15.53:0/2122149693 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6174066280 0x7f6174068730 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f61780099b0 tx=0x7f6178008040 comp rx=0 tx=0).stop 2023-06-10T18:57:10.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.322+0000 7f618f058640 1 -- 172.21.15.53:0/2122149693 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f618815de40 msgr2=0x7f618815cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:10.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.322+0000 7f618f058640 1 --2- 172.21.15.53:0/2122149693 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f618815de40 0x7f618815cef0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f617c00e780 tx=0x7f617c00ec40 comp rx=0 tx=0).stop 2023-06-10T18:57:10.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.322+0000 7f618f058640 1 -- 172.21.15.53:0/2122149693 shutdown_connections 2023-06-10T18:57:10.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.322+0000 7f618f058640 1 --2- 172.21.15.53:0/2122149693 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6174066280 0x7f6174068730 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:10.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.322+0000 7f618f058640 1 --2- 172.21.15.53:0/2122149693 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f618815e2b0 0x7f618815d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:10.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.322+0000 7f618f058640 1 --2- 172.21.15.53:0/2122149693 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f618815de40 0x7f618815cef0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:10.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.322+0000 7f618f058640 1 --2- 172.21.15.53:0/2122149693 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61700052a0 0x7f618814cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:10.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.322+0000 7f618f058640 1 -- 172.21.15.53:0/2122149693 >> 172.21.15.53:0/2122149693 conn(0x7f618806a0e0 msgr2=0x7f618806b090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:10.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.322+0000 7f618f058640 1 -- 172.21.15.53:0/2122149693 shutdown_connections 2023-06-10T18:57:10.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.322+0000 7f618f058640 1 -- 172.21.15.53:0/2122149693 wait complete. 2023-06-10T18:57:10.373 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-10T18:57:10.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.490+0000 7f92d8971640 1 Processor -- start 2023-06-10T18:57:10.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.490+0000 7f92d8971640 1 -- start start 2023-06-10T18:57:10.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.490+0000 7f92d8971640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f92d40af760 0x7f92d40c9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:10.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.490+0000 7f92d8971640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92d4070b80 0x7f92d406b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:10.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.490+0000 7f92d8971640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92d40706f0 con 0x7f92d40afb30 2023-06-10T18:57:10.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.490+0000 7f92d8971640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92d415ab10 con 0x7f92d40af760 2023-06-10T18:57:10.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.490+0000 7f92d8971640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92d40700e0 con 0x7f92d4070b80 2023-06-10T18:57:10.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.494+0000 7f92d1d9b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f92d40afb30 0x7f92d415dbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:48972/0 (socket says 172.21.15.53:48972) 2023-06-10T18:57:10.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.494+0000 7f92d1d9b640 1 -- 172.21.15.53:0/473731356 learned_addr learned my addr 172.21.15.53:0/473731356 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:57:10.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.494+0000 7f92d259c640 1 --2- 172.21.15.53:0/473731356 >> v2:172.21.15.117:3300/0 conn(0x7f92d40af760 0x7f92d40c9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:10.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.494+0000 7f92d2d9d640 1 --2- 172.21.15.53:0/473731356 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92d4070b80 0x7f92d406b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:10.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.494+0000 7f92d159a640 1 -- 172.21.15.53:0/473731356 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1654406237 0 0) 0x7f92d40706f0 con 0x7f92d40afb30 2023-06-10T18:57:10.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.494+0000 7f92d159a640 1 -- 172.21.15.53:0/473731356 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92c0003530 con 0x7f92d40afb30 2023-06-10T18:57:10.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.494+0000 7f92d159a640 1 -- 172.21.15.53:0/473731356 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1403130266 0 0) 0x7f92c0003530 con 0x7f92d40afb30 2023-06-10T18:57:10.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.494+0000 7f92d159a640 1 -- 172.21.15.53:0/473731356 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92d4070b80 msgr2=0x7f92d406b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:10.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.494+0000 7f92d159a640 1 --2- 172.21.15.53:0/473731356 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92d4070b80 0x7f92d406b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:10.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.494+0000 7f92d159a640 1 -- 172.21.15.53:0/473731356 >> v2:172.21.15.117:3300/0 conn(0x7f92d40af760 msgr2=0x7f92d40c9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:10.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.494+0000 7f92d159a640 1 --2- 172.21.15.53:0/473731356 >> v2:172.21.15.117:3300/0 conn(0x7f92d40af760 0x7f92d40c9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:10.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.494+0000 7f92d159a640 1 -- 172.21.15.53:0/473731356 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92d40c9e10 con 0x7f92d40afb30 2023-06-10T18:57:10.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.494+0000 7f92d159a640 1 -- 172.21.15.53:0/473731356 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f92bc001680 con 0x7f92d40afb30 2023-06-10T18:57:10.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.494+0000 7f92d159a640 1 -- 172.21.15.53:0/473731356 >> v1:172.21.15.53:6789/0 conn(0x7f92d40afb30 legacy=0x7f92d415dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:10.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.494+0000 7f92d159a640 1 --2- 172.21.15.53:0/473731356 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92d4070b80 0x7f92c0003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:10.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.494+0000 7f92d159a640 1 --2- 172.21.15.53:0/473731356 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f92c0003f00 0x7f92c00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:10.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.494+0000 7f92d159a640 1 --2- 172.21.15.53:0/473731356 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92c0004d10 0x7f92c0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:10.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.494+0000 7f92d159a640 1 -- 172.21.15.53:0/473731356 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d415ab10 con 0x7f92c0004d10 2023-06-10T18:57:10.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.494+0000 7f92d159a640 1 -- 172.21.15.53:0/473731356 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d40700e0 con 0x7f92c0003f00 2023-06-10T18:57:10.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.494+0000 7f92d159a640 1 -- 172.21.15.53:0/473731356 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92c000b990 con 0x7f92d4070b80 2023-06-10T18:57:10.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.494+0000 7f92d2d9d640 1 --2- 172.21.15.53:0/473731356 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92c0004d10 0x7f92c0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:10.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.494+0000 7f92d259c640 1 --2- 172.21.15.53:0/473731356 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92d4070b80 0x7f92c0003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:10.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.494+0000 7f92d1d9b640 1 --2- 172.21.15.53:0/473731356 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f92c0003f00 0x7f92c00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:10.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.494+0000 7f92d2d9d640 1 -- 172.21.15.53:0/473731356 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92d4070b80 msgr2=0x7f92c0003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:10.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.494+0000 7f92d2d9d640 1 --2- 172.21.15.53:0/473731356 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92d4070b80 0x7f92c0003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:10.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.494+0000 7f92d2d9d640 1 -- 172.21.15.53:0/473731356 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f92c0003f00 msgr2=0x7f92c00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:10.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.494+0000 7f92d2d9d640 1 --2- 172.21.15.53:0/473731356 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f92c0003f00 0x7f92c00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:10.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.494+0000 7f92d2d9d640 1 -- 172.21.15.53:0/473731356 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c0003530 con 0x7f92c0004d10 2023-06-10T18:57:10.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.494+0000 7f92d2d9d640 1 --2- 172.21.15.53:0/473731356 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92c0004d10 0x7f92c0005180 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f92cc009ae0 tx=0x7f92cc01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4618ef7405bee208 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:10.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.494+0000 7f92d159a640 1 -- 172.21.15.53:0/473731356 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92cc0a5640 con 0x7f92c0004d10 2023-06-10T18:57:10.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.494+0000 7f92d159a640 1 -- 172.21.15.53:0/473731356 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92cc0a57a0 con 0x7f92c0004d10 2023-06-10T18:57:10.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.494+0000 7f92d159a640 1 -- 172.21.15.53:0/473731356 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92cc0a5b50 con 0x7f92c0004d10 2023-06-10T18:57:10.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.498+0000 7f92d8971640 1 -- 172.21.15.53:0/473731356 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92c0004d10 msgr2=0x7f92c0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:10.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.498+0000 7f92d8971640 1 --2- 172.21.15.53:0/473731356 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92c0004d10 0x7f92c0005180 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f92cc009ae0 tx=0x7f92cc01ca50 comp rx=0 tx=0).stop 2023-06-10T18:57:10.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.498+0000 7f92d2d9d640 1 -- 172.21.15.53:0/473731356 reap_dead start 2023-06-10T18:57:10.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.498+0000 7f92d8971640 1 -- 172.21.15.53:0/473731356 shutdown_connections 2023-06-10T18:57:10.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.498+0000 7f92d8971640 1 -- 172.21.15.53:0/473731356 >> 172.21.15.53:0/473731356 conn(0x7f92d406a0e0 msgr2=0x7f92d40cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:10.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.498+0000 7f92d8971640 1 -- 172.21.15.53:0/473731356 shutdown_connections 2023-06-10T18:57:10.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.498+0000 7f92d8971640 1 -- 172.21.15.53:0/473731356 wait complete. 2023-06-10T18:57:10.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.498+0000 7f92d8971640 1 Processor -- start 2023-06-10T18:57:10.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.498+0000 7f92d8971640 1 -- start start 2023-06-10T18:57:10.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.498+0000 7f92d8971640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f92c0004d10 0x7f92d4153ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:10.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.498+0000 7f92d8971640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92d41ef2d0 0x7f92d40c8730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:10.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.498+0000 7f92d8971640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92d41ef740 0x7f92d40c8c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:10.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.498+0000 7f92d8971640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d4157eb0 con 0x7f92d41ef740 2023-06-10T18:57:10.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.498+0000 7f92d8971640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d41571d0 con 0x7f92c0004d10 2023-06-10T18:57:10.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.498+0000 7f92d8971640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92d40c2e60 con 0x7f92d41ef2d0 2023-06-10T18:57:10.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.498+0000 7f92d2d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92d41ef740 0x7f92d40c8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:10.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.498+0000 7f92d2d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92d41ef740 0x7f92d40c8c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35474/0 (socket says 172.21.15.53:35474) 2023-06-10T18:57:10.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.498+0000 7f92d2d9d640 1 -- 172.21.15.53:0/3425306722 learned_addr learned my addr 172.21.15.53:0/3425306722 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:57:10.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.498+0000 7f92d259c640 1 --2- 172.21.15.53:0/3425306722 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f92c0004d10 0x7f92d4153ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:10.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.498+0000 7f92d1d9b640 1 --2- 172.21.15.53:0/3425306722 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92d41ef2d0 0x7f92d40c8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:10.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.498+0000 7f92d2d9d640 1 -- 172.21.15.53:0/3425306722 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92d41ef2d0 msgr2=0x7f92d40c8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:10.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.498+0000 7f92d2d9d640 1 --2- 172.21.15.53:0/3425306722 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92d41ef2d0 0x7f92d40c8730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:10.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.498+0000 7f92d2d9d640 1 -- 172.21.15.53:0/3425306722 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f92c0004d10 msgr2=0x7f92d4153ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:10.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.498+0000 7f92d2d9d640 1 --2- 172.21.15.53:0/3425306722 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f92c0004d10 0x7f92d4153ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:10.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.498+0000 7f92d2d9d640 1 -- 172.21.15.53:0/3425306722 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92d40c3140 con 0x7f92d41ef740 2023-06-10T18:57:10.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.498+0000 7f92d2d9d640 1 --2- 172.21.15.53:0/3425306722 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92d41ef740 0x7f92d40c8c70 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f92cc009ae0 tx=0x7f92c0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:10.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.498+0000 7f92caffd640 1 -- 172.21.15.53:0/3425306722 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92cc0a5640 con 0x7f92d41ef740 2023-06-10T18:57:10.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.498+0000 7f92caffd640 1 -- 172.21.15.53:0/3425306722 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92cc004240 con 0x7f92d41ef740 2023-06-10T18:57:10.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.498+0000 7f92caffd640 1 -- 172.21.15.53:0/3425306722 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92cc003620 con 0x7f92d41ef740 2023-06-10T18:57:10.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.498+0000 7f92d8971640 1 -- 172.21.15.53:0/3425306722 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92d40c3420 con 0x7f92d41ef740 2023-06-10T18:57:10.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.498+0000 7f92d8971640 1 -- 172.21.15.53:0/3425306722 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92d4154000 con 0x7f92d41ef740 2023-06-10T18:57:10.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.502+0000 7f92d8971640 1 -- 172.21.15.53:0/3425306722 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92d404d790 con 0x7f92d41ef740 2023-06-10T18:57:10.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.502+0000 7f92caffd640 1 -- 172.21.15.53:0/3425306722 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f92cc0b4070 con 0x7f92d41ef740 2023-06-10T18:57:10.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.502+0000 7f92caffd640 1 --2- 172.21.15.53:0/3425306722 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f92b4066280 0x7f92b4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:10.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.502+0000 7f92caffd640 1 -- 172.21.15.53:0/3425306722 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f92cc11d8c0 con 0x7f92d41ef740 2023-06-10T18:57:10.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.502+0000 7f92d259c640 1 --2- 172.21.15.53:0/3425306722 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f92b4066280 0x7f92b4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:10.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.502+0000 7f92d259c640 1 --2- 172.21.15.53:0/3425306722 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f92b4066280 0x7f92b4068730 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f92c4003c10 tx=0x7f92c400b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:10.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.506+0000 7f92caffd640 1 -- 172.21.15.53:0/3425306722 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f92cc0eb0a0 con 0x7f92d41ef740 2023-06-10T18:57:10.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.654+0000 7f92d8971640 1 -- 172.21.15.53:0/3425306722 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f92d40c38d0 con 0x7f92d41ef740 2023-06-10T18:57:10.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.654+0000 7f92caffd640 1 -- 172.21.15.53:0/3425306722 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v61) v1 ==== 92+0+10 (secure 0 0 0) 0x7f92cc0b20a0 con 0x7f92d41ef740 2023-06-10T18:57:10.659 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-06-10T18:57:10.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.658+0000 7f92d8971640 1 -- 172.21.15.53:0/3425306722 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f92b4066280 msgr2=0x7f92b4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:10.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.658+0000 7f92d8971640 1 --2- 172.21.15.53:0/3425306722 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f92b4066280 0x7f92b4068730 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f92c4003c10 tx=0x7f92c400b040 comp rx=0 tx=0).stop 2023-06-10T18:57:10.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.658+0000 7f92d8971640 1 -- 172.21.15.53:0/3425306722 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92d41ef740 msgr2=0x7f92d40c8c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:10.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.658+0000 7f92d8971640 1 --2- 172.21.15.53:0/3425306722 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92d41ef740 0x7f92d40c8c70 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f92cc009ae0 tx=0x7f92c0005800 comp rx=0 tx=0).stop 2023-06-10T18:57:10.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.658+0000 7f92d8971640 1 -- 172.21.15.53:0/3425306722 shutdown_connections 2023-06-10T18:57:10.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.658+0000 7f92d8971640 1 --2- 172.21.15.53:0/3425306722 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f92b4066280 0x7f92b4068730 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:10.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.658+0000 7f92d8971640 1 --2- 172.21.15.53:0/3425306722 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92d41ef740 0x7f92d40c8c70 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:10.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.658+0000 7f92d8971640 1 --2- 172.21.15.53:0/3425306722 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92d41ef2d0 0x7f92d40c8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:10.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.658+0000 7f92d8971640 1 --2- 172.21.15.53:0/3425306722 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f92c0004d10 0x7f92d4153ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:10.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.658+0000 7f92d8971640 1 -- 172.21.15.53:0/3425306722 >> 172.21.15.53:0/3425306722 conn(0x7f92d406a0e0 msgr2=0x7f92d406b980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:10.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.658+0000 7f92d8971640 1 -- 172.21.15.53:0/3425306722 shutdown_connections 2023-06-10T18:57:10.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.658+0000 7f92d8971640 1 -- 172.21.15.53:0/3425306722 wait complete. 2023-06-10T18:57:10.678 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-06-10T18:57:10.797 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.790+0000 7f7ebf0ea640 1 Processor -- start 2023-06-10T18:57:10.797 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.790+0000 7f7ebf0ea640 1 -- start start 2023-06-10T18:57:10.797 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.794+0000 7f7ebf0ea640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7eb8162640 0x7f7eb8164a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:10.798 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.794+0000 7f7ebf0ea640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7eb8159b50 con 0x7f7eb80c9840 2023-06-10T18:57:10.798 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.794+0000 7f7ebf0ea640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7eb80702a0 con 0x7f7eb8071060 2023-06-10T18:57:10.798 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.794+0000 7f7ebf0ea640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb8070580 con 0x7f7eb8162640 2023-06-10T18:57:10.798 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.794+0000 7f7ebce86640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f7eb80c9840 0x7f7eb80c9c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:48976/0 (socket says 172.21.15.53:48976) 2023-06-10T18:57:10.798 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.794+0000 7f7ebce86640 1 -- 172.21.15.53:0/621454262 learned_addr learned my addr 172.21.15.53:0/621454262 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:57:10.800 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.794+0000 7f7ebd687640 1 --2- 172.21.15.53:0/621454262 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7eb8162640 0x7f7eb8164a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:10.801 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.794+0000 7f7eb77fe640 1 -- 172.21.15.53:0/621454262 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 98532047 0 0) 0x7f7eb8159b50 con 0x7f7eb80c9840 2023-06-10T18:57:10.802 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.794+0000 7f7eb77fe640 1 -- 172.21.15.53:0/621454262 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ea4003530 con 0x7f7eb80c9840 2023-06-10T18:57:10.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.794+0000 7f7eb77fe640 1 -- 172.21.15.53:0/621454262 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2467589342 0 0) 0x7f7eb80702a0 con 0x7f7eb8071060 2023-06-10T18:57:10.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.794+0000 7f7eb77fe640 1 -- 172.21.15.53:0/621454262 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7eb8159b50 con 0x7f7eb8071060 2023-06-10T18:57:10.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.794+0000 7f7eb77fe640 1 -- 172.21.15.53:0/621454262 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1836087209 0 0) 0x7f7ea4003530 con 0x7f7eb80c9840 2023-06-10T18:57:10.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.794+0000 7f7eb77fe640 1 -- 172.21.15.53:0/621454262 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7eb8162640 msgr2=0x7f7eb8164a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:10.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.794+0000 7f7eb77fe640 1 --2- 172.21.15.53:0/621454262 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7eb8162640 0x7f7eb8164a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:10.804 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.794+0000 7f7eb77fe640 1 -- 172.21.15.53:0/621454262 >> v1:172.21.15.117:6789/0 conn(0x7f7eb8071060 legacy=0x7f7eb80af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:10.804 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.794+0000 7f7eb77fe640 1 -- 172.21.15.53:0/621454262 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb8070860 con 0x7f7eb80c9840 2023-06-10T18:57:10.804 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.794+0000 7f7eb77fe640 1 -- 172.21.15.53:0/621454262 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f7ea8001600 con 0x7f7eb80c9840 2023-06-10T18:57:10.804 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.794+0000 7f7eb77fe640 1 -- 172.21.15.53:0/621454262 >> v1:172.21.15.53:6789/0 conn(0x7f7eb80c9840 legacy=0x7f7eb80c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:10.804 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.794+0000 7f7eb77fe640 1 --2- 172.21.15.53:0/621454262 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ea4003bb0 0x7f7ea4003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:10.805 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.794+0000 7f7eb77fe640 1 --2- 172.21.15.53:0/621454262 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ea40047d0 0x7f7ea4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:10.805 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.794+0000 7f7eb77fe640 1 --2- 172.21.15.53:0/621454262 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7eb8162640 0x7f7ea40051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:10.805 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.794+0000 7f7eb77fe640 1 -- 172.21.15.53:0/621454262 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb8070580 con 0x7f7ea4003bb0 2023-06-10T18:57:10.805 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.794+0000 7f7eb77fe640 1 -- 172.21.15.53:0/621454262 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea400bac0 con 0x7f7ea40047d0 2023-06-10T18:57:10.805 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.794+0000 7f7eb77fe640 1 -- 172.21.15.53:0/621454262 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea400bc80 con 0x7f7eb8162640 2023-06-10T18:57:10.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.794+0000 7f7ebce86640 1 --2- 172.21.15.53:0/621454262 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ea4003bb0 0x7f7ea4003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:10.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.794+0000 7f7eb7fff640 1 --2- 172.21.15.53:0/621454262 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ea40047d0 0x7f7ea4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:10.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.794+0000 7f7ebd687640 1 --2- 172.21.15.53:0/621454262 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7eb8162640 0x7f7ea40051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:10.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.794+0000 7f7ebce86640 1 -- 172.21.15.53:0/621454262 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7eb8162640 msgr2=0x7f7ea40051a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:10.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.794+0000 7f7ebce86640 1 --2- 172.21.15.53:0/621454262 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7eb8162640 0x7f7ea40051a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:10.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.794+0000 7f7ebce86640 1 -- 172.21.15.53:0/621454262 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ea40047d0 msgr2=0x7f7ea4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:10.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.794+0000 7f7ebce86640 1 --2- 172.21.15.53:0/621454262 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ea40047d0 0x7f7ea4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:10.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.794+0000 7f7ebce86640 1 -- 172.21.15.53:0/621454262 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ea4003530 con 0x7f7ea4003bb0 2023-06-10T18:57:10.809 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.798+0000 7f7ebce86640 1 --2- 172.21.15.53:0/621454262 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ea4003bb0 0x7f7ea4003fa0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f7ea8007f50 tx=0x7f7ea801ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d78f5036257c80db server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:10.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.798+0000 7f7eb77fe640 1 -- 172.21.15.53:0/621454262 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea8005ba0 con 0x7f7ea4003bb0 2023-06-10T18:57:10.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.798+0000 7f7eb77fe640 1 -- 172.21.15.53:0/621454262 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ea8005d20 con 0x7f7ea4003bb0 2023-06-10T18:57:10.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.798+0000 7f7eb77fe640 1 -- 172.21.15.53:0/621454262 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea80072b0 con 0x7f7ea4003bb0 2023-06-10T18:57:10.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.798+0000 7f7ebf0ea640 1 -- 172.21.15.53:0/621454262 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ea4003bb0 msgr2=0x7f7ea4003fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:10.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.798+0000 7f7ebf0ea640 1 --2- 172.21.15.53:0/621454262 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ea4003bb0 0x7f7ea4003fa0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f7ea8007f50 tx=0x7f7ea801ca70 comp rx=0 tx=0).stop 2023-06-10T18:57:10.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.798+0000 7f7ebd687640 1 -- 172.21.15.53:0/621454262 reap_dead start 2023-06-10T18:57:10.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.798+0000 7f7ebf0ea640 1 -- 172.21.15.53:0/621454262 shutdown_connections 2023-06-10T18:57:10.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.798+0000 7f7ebf0ea640 1 -- 172.21.15.53:0/621454262 >> 172.21.15.53:0/621454262 conn(0x7f7eb806a0d0 msgr2=0x7f7eb80ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:10.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.798+0000 7f7ebf0ea640 1 -- 172.21.15.53:0/621454262 shutdown_connections 2023-06-10T18:57:10.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.798+0000 7f7ebf0ea640 1 -- 172.21.15.53:0/621454262 wait complete. 2023-06-10T18:57:10.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.798+0000 7f7ebf0ea640 1 Processor -- start 2023-06-10T18:57:10.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.798+0000 7f7ebf0ea640 1 -- start start 2023-06-10T18:57:10.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.798+0000 7f7ebf0ea640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ea4003bb0 0x7f7eb80b1270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:10.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.798+0000 7f7ebf0ea640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7eb814b870 0x7f7eb8156220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:10.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.798+0000 7f7ebf0ea640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7eb8156760 0x7f7eb80ad560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:10.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.798+0000 7f7ebf0ea640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb8156bd0 con 0x7f7eb814b870 2023-06-10T18:57:10.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.798+0000 7f7ebf0ea640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb80b17b0 con 0x7f7eb8156760 2023-06-10T18:57:10.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.798+0000 7f7ebf0ea640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb8153cd0 con 0x7f7ea4003bb0 2023-06-10T18:57:10.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.798+0000 7f7eb7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7eb814b870 0x7f7eb8156220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:10.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.798+0000 7f7eb7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7eb814b870 0x7f7eb8156220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35496/0 (socket says 172.21.15.53:35496) 2023-06-10T18:57:10.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.798+0000 7f7eb7fff640 1 -- 172.21.15.53:0/241336957 learned_addr learned my addr 172.21.15.53:0/241336957 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:57:10.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.798+0000 7f7ebd687640 1 --2- 172.21.15.53:0/241336957 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7eb8156760 0x7f7eb80ad560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:10.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.798+0000 7f7ebce86640 1 --2- 172.21.15.53:0/241336957 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ea4003bb0 0x7f7eb80b1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:10.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.798+0000 7f7eb7fff640 1 -- 172.21.15.53:0/241336957 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ea4003bb0 msgr2=0x7f7eb80b1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:10.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.798+0000 7f7eb7fff640 1 --2- 172.21.15.53:0/241336957 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ea4003bb0 0x7f7eb80b1270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:10.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.798+0000 7f7eb7fff640 1 -- 172.21.15.53:0/241336957 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7eb8156760 msgr2=0x7f7eb80ad560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:10.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.798+0000 7f7eb7fff640 1 --2- 172.21.15.53:0/241336957 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7eb8156760 0x7f7eb80ad560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:10.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.798+0000 7f7eb7fff640 1 -- 172.21.15.53:0/241336957 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb8153fb0 con 0x7f7eb814b870 2023-06-10T18:57:10.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.798+0000 7f7eb7fff640 1 --2- 172.21.15.53:0/241336957 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7eb814b870 0x7f7eb8156220 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f7ea000eb20 tx=0x7f7ea0002100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:10.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.798+0000 7f7eb57fa640 1 -- 172.21.15.53:0/241336957 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea0017070 con 0x7f7eb814b870 2023-06-10T18:57:10.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.798+0000 7f7eb57fa640 1 -- 172.21.15.53:0/241336957 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ea0003b90 con 0x7f7eb814b870 2023-06-10T18:57:10.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.798+0000 7f7ebf0ea640 1 -- 172.21.15.53:0/241336957 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7eb8154290 con 0x7f7eb814b870 2023-06-10T18:57:10.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.798+0000 7f7eb57fa640 1 -- 172.21.15.53:0/241336957 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea0003d40 con 0x7f7eb814b870 2023-06-10T18:57:10.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.798+0000 7f7ebf0ea640 1 -- 172.21.15.53:0/241336957 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7eb80ae250 con 0x7f7eb814b870 2023-06-10T18:57:10.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.802+0000 7f7ebf0ea640 1 -- 172.21.15.53:0/241336957 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7eb804d790 con 0x7f7eb814b870 2023-06-10T18:57:10.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.802+0000 7f7eb57fa640 1 -- 172.21.15.53:0/241336957 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7ea000c7e0 con 0x7f7eb814b870 2023-06-10T18:57:10.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.802+0000 7f7eb57fa640 1 --2- 172.21.15.53:0/241336957 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7e98066280 0x7f7e98068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:10.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.802+0000 7f7eb57fa640 1 -- 172.21.15.53:0/241336957 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f7ea0083390 con 0x7f7eb814b870 2023-06-10T18:57:10.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.802+0000 7f7ebce86640 1 --2- 172.21.15.53:0/241336957 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7e98066280 0x7f7e98068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:10.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.802+0000 7f7ebce86640 1 --2- 172.21.15.53:0/241336957 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7e98066280 0x7f7e98068730 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f7ea8007f20 tx=0x7f7ea80a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:10.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.806+0000 7f7eb57fa640 1 -- 172.21.15.53:0/241336957 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7ea0050bf0 con 0x7f7eb814b870 2023-06-10T18:57:10.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.962+0000 7f7ebf0ea640 1 -- 172.21.15.53:0/241336957 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f7eb8154740 con 0x7f7eb814b870 2023-06-10T18:57:10.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.962+0000 7f7eb57fa640 1 -- 172.21.15.53:0/241336957 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v61) v1 ==== 84+0+126 (secure 0 0 0) 0x7f7ea0054210 con 0x7f7eb814b870 2023-06-10T18:57:10.970 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:57:10.970 INFO:teuthology.orchestra.run.smithi053.stdout:[ 2023-06-10T18:57:10.970 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T18:57:10.970 INFO:teuthology.orchestra.run.smithi053.stdout: "poolnum": 1, 2023-06-10T18:57:10.970 INFO:teuthology.orchestra.run.smithi053.stdout: "poolname": ".mgr" 2023-06-10T18:57:10.970 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:57:10.971 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T18:57:10.971 INFO:teuthology.orchestra.run.smithi053.stdout: "poolnum": 2, 2023-06-10T18:57:10.971 INFO:teuthology.orchestra.run.smithi053.stdout: "poolname": "rbd" 2023-06-10T18:57:10.971 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:57:10.971 INFO:teuthology.orchestra.run.smithi053.stdout:] 2023-06-10T18:57:10.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.966+0000 7f7ebf0ea640 1 -- 172.21.15.53:0/241336957 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7e98066280 msgr2=0x7f7e98068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:10.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.966+0000 7f7ebf0ea640 1 --2- 172.21.15.53:0/241336957 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7e98066280 0x7f7e98068730 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f7ea8007f20 tx=0x7f7ea80a7070 comp rx=0 tx=0).stop 2023-06-10T18:57:10.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.966+0000 7f7ebf0ea640 1 -- 172.21.15.53:0/241336957 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7eb814b870 msgr2=0x7f7eb8156220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:10.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.966+0000 7f7ebf0ea640 1 --2- 172.21.15.53:0/241336957 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7eb814b870 0x7f7eb8156220 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f7ea000eb20 tx=0x7f7ea0002100 comp rx=0 tx=0).stop 2023-06-10T18:57:10.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.966+0000 7f7ebf0ea640 1 -- 172.21.15.53:0/241336957 shutdown_connections 2023-06-10T18:57:10.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.966+0000 7f7ebf0ea640 1 --2- 172.21.15.53:0/241336957 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7e98066280 0x7f7e98068730 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:10.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.966+0000 7f7ebf0ea640 1 --2- 172.21.15.53:0/241336957 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7eb8156760 0x7f7eb80ad560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:10.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.966+0000 7f7ebf0ea640 1 --2- 172.21.15.53:0/241336957 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7eb814b870 0x7f7eb8156220 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:10.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.966+0000 7f7ebf0ea640 1 --2- 172.21.15.53:0/241336957 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ea4003bb0 0x7f7eb80b1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:10.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.966+0000 7f7ebf0ea640 1 -- 172.21.15.53:0/241336957 >> 172.21.15.53:0/241336957 conn(0x7f7eb806a0d0 msgr2=0x7f7eb8152c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:10.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.966+0000 7f7ebf0ea640 1 -- 172.21.15.53:0/241336957 shutdown_connections 2023-06-10T18:57:10.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:10.966+0000 7f7ebf0ea640 1 -- 172.21.15.53:0/241336957 wait complete. 2023-06-10T18:57:10.989 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-06-10T18:57:10.990 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-06-10T18:57:11.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.114+0000 7f6ae8ede640 1 Processor -- start 2023-06-10T18:57:11.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.114+0000 7f6ae8ede640 1 -- start start 2023-06-10T18:57:11.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.114+0000 7f6ae8ede640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6ae40ca220 0x7f6ae40af830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:11.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.114+0000 7f6ae8ede640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ae4159d10 con 0x7f6ae4159940 2023-06-10T18:57:11.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.114+0000 7f6ae8ede640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ae406b100 con 0x7f6ae40afd70 2023-06-10T18:57:11.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.114+0000 7f6ae8ede640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ae406bc80 con 0x7f6ae40ca220 2023-06-10T18:57:11.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.114+0000 7f6ae259c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f6ae4159940 0x7f6ae40c9b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:48986/0 (socket says 172.21.15.53:48986) 2023-06-10T18:57:11.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.114+0000 7f6ae259c640 1 -- 172.21.15.53:0/2090337513 learned_addr learned my addr 172.21.15.53:0/2090337513 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:57:11.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.114+0000 7f6ae1d9b640 1 --2- 172.21.15.53:0/2090337513 >> v2:172.21.15.117:3300/0 conn(0x7f6ae40ca220 0x7f6ae40af830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:11.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.114+0000 7f6ae159a640 1 -- 172.21.15.53:0/2090337513 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4123424753 0 0) 0x7f6ae4159d10 con 0x7f6ae4159940 2023-06-10T18:57:11.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.114+0000 7f6ae159a640 1 -- 172.21.15.53:0/2090337513 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ac4003530 con 0x7f6ae4159940 2023-06-10T18:57:11.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.118+0000 7f6ae159a640 1 -- 172.21.15.53:0/2090337513 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2445274835 0 0) 0x7f6ac4003530 con 0x7f6ae4159940 2023-06-10T18:57:11.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.118+0000 7f6ae159a640 1 -- 172.21.15.53:0/2090337513 >> v2:172.21.15.117:3300/0 conn(0x7f6ae40ca220 msgr2=0x7f6ae40af830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:11.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.118+0000 7f6ae159a640 1 --2- 172.21.15.53:0/2090337513 >> v2:172.21.15.117:3300/0 conn(0x7f6ae40ca220 0x7f6ae40af830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:11.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.118+0000 7f6ae159a640 1 -- 172.21.15.53:0/2090337513 >> v1:172.21.15.117:6789/0 conn(0x7f6ae40afd70 legacy=0x7f6ae40c8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:11.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.118+0000 7f6ae159a640 1 -- 172.21.15.53:0/2090337513 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ae406c110 con 0x7f6ae4159940 2023-06-10T18:57:11.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.118+0000 7f6ae159a640 1 -- 172.21.15.53:0/2090337513 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f6ad4001680 con 0x7f6ae4159940 2023-06-10T18:57:11.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.118+0000 7f6ae159a640 1 -- 172.21.15.53:0/2090337513 >> v1:172.21.15.53:6789/0 conn(0x7f6ae4159940 legacy=0x7f6ae40c9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:11.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.118+0000 7f6ae159a640 1 --2- 172.21.15.53:0/2090337513 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ac40039d0 0x7f6ac4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:11.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.118+0000 7f6ae159a640 1 --2- 172.21.15.53:0/2090337513 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ac40047d0 0x7f6ac4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:11.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.118+0000 7f6ae159a640 1 --2- 172.21.15.53:0/2090337513 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ac40051d0 0x7f6ac400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:11.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.118+0000 7f6ae159a640 1 -- 172.21.15.53:0/2090337513 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae406bc80 con 0x7f6ac40039d0 2023-06-10T18:57:11.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.118+0000 7f6ae159a640 1 -- 172.21.15.53:0/2090337513 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac400c0e0 con 0x7f6ac40047d0 2023-06-10T18:57:11.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.118+0000 7f6ae159a640 1 -- 172.21.15.53:0/2090337513 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac400c2a0 con 0x7f6ac40051d0 2023-06-10T18:57:11.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.118+0000 7f6ae259c640 1 --2- 172.21.15.53:0/2090337513 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ac40039d0 0x7f6ac4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:11.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.118+0000 7f6ae1d9b640 1 --2- 172.21.15.53:0/2090337513 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ac40047d0 0x7f6ac4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:11.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.118+0000 7f6ae259c640 1 -- 172.21.15.53:0/2090337513 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ac40051d0 msgr2=0x7f6ac400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:11.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.118+0000 7f6ae259c640 1 --2- 172.21.15.53:0/2090337513 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ac40051d0 0x7f6ac400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:11.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.118+0000 7f6ae259c640 1 -- 172.21.15.53:0/2090337513 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ac40047d0 msgr2=0x7f6ac4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:11.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.118+0000 7f6ae259c640 1 --2- 172.21.15.53:0/2090337513 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ac40047d0 0x7f6ac4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:11.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.118+0000 7f6ae259c640 1 -- 172.21.15.53:0/2090337513 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ac4003530 con 0x7f6ac40039d0 2023-06-10T18:57:11.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.118+0000 7f6ae2d9d640 1 -- 172.21.15.53:0/2090337513 reap_dead start 2023-06-10T18:57:11.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.118+0000 7f6ae259c640 1 --2- 172.21.15.53:0/2090337513 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ac40039d0 0x7f6ac4003de0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f6ad400c110 tx=0x7f6ad401cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d85fbcfb897b111 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:11.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.118+0000 7f6ae159a640 1 -- 172.21.15.53:0/2090337513 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad4005ae0 con 0x7f6ac40039d0 2023-06-10T18:57:11.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.118+0000 7f6ae159a640 1 -- 172.21.15.53:0/2090337513 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ad4005c40 con 0x7f6ac40039d0 2023-06-10T18:57:11.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.118+0000 7f6ae159a640 1 -- 172.21.15.53:0/2090337513 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad4007070 con 0x7f6ac40039d0 2023-06-10T18:57:11.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.118+0000 7f6ae8ede640 1 -- 172.21.15.53:0/2090337513 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ac40039d0 msgr2=0x7f6ac4003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:11.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.118+0000 7f6ae8ede640 1 --2- 172.21.15.53:0/2090337513 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ac40039d0 0x7f6ac4003de0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f6ad400c110 tx=0x7f6ad401cb30 comp rx=0 tx=0).stop 2023-06-10T18:57:11.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.118+0000 7f6ae8ede640 1 -- 172.21.15.53:0/2090337513 shutdown_connections 2023-06-10T18:57:11.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.118+0000 7f6ae8ede640 1 --2- 172.21.15.53:0/2090337513 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ac40039d0 0x7f6ac4003de0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:11.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.118+0000 7f6ae8ede640 1 -- 172.21.15.53:0/2090337513 >> 172.21.15.53:0/2090337513 conn(0x7f6ae40ca830 msgr2=0x7f6ae40cac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:11.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.118+0000 7f6ae8ede640 1 -- 172.21.15.53:0/2090337513 shutdown_connections 2023-06-10T18:57:11.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.118+0000 7f6ae8ede640 1 -- 172.21.15.53:0/2090337513 wait complete. 2023-06-10T18:57:11.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.122+0000 7f6ae8ede640 1 Processor -- start 2023-06-10T18:57:11.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.122+0000 7f6ae8ede640 1 -- start start 2023-06-10T18:57:11.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.122+0000 7f6ae8ede640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ac40039d0 0x7f6ae40cd150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:11.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.122+0000 7f6ae8ede640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ae41f4f00 0x7f6ae40cb980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:11.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.122+0000 7f6ae8ede640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ae41522f0 0x7f6ae40a7d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:11.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.122+0000 7f6ae8ede640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae40cbec0 con 0x7f6ae41f4f00 2023-06-10T18:57:11.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.122+0000 7f6ae8ede640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae41f5370 con 0x7f6ae41522f0 2023-06-10T18:57:11.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.122+0000 7f6ae8ede640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae40cc0b0 con 0x7f6ac40039d0 2023-06-10T18:57:11.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.122+0000 7f6ae1d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ae41f4f00 0x7f6ae40cb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:11.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.122+0000 7f6ae1d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ae41f4f00 0x7f6ae40cb980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35516/0 (socket says 172.21.15.53:35516) 2023-06-10T18:57:11.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.122+0000 7f6ae1d9b640 1 -- 172.21.15.53:0/1444504082 learned_addr learned my addr 172.21.15.53:0/1444504082 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:57:11.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.122+0000 7f6ae2d9d640 1 --2- 172.21.15.53:0/1444504082 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ae41522f0 0x7f6ae40a7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:11.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.122+0000 7f6ae259c640 1 --2- 172.21.15.53:0/1444504082 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ac40039d0 0x7f6ae40cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:11.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.122+0000 7f6ae1d9b640 1 -- 172.21.15.53:0/1444504082 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ac40039d0 msgr2=0x7f6ae40cd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:11.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.122+0000 7f6ae1d9b640 1 --2- 172.21.15.53:0/1444504082 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ac40039d0 0x7f6ae40cd150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:11.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.122+0000 7f6ae1d9b640 1 -- 172.21.15.53:0/1444504082 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ae41522f0 msgr2=0x7f6ae40a7d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:11.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.122+0000 7f6ae1d9b640 1 --2- 172.21.15.53:0/1444504082 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ae41522f0 0x7f6ae40a7d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:11.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.122+0000 7f6ae1d9b640 1 -- 172.21.15.53:0/1444504082 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ae40cc390 con 0x7f6ae41f4f00 2023-06-10T18:57:11.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.122+0000 7f6ae2d9d640 1 --2- 172.21.15.53:0/1444504082 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ae41522f0 0x7f6ae40a7d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:57:11.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.122+0000 7f6ae1d9b640 1 --2- 172.21.15.53:0/1444504082 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ae41f4f00 0x7f6ae40cb980 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f6acc007f30 tx=0x7f6acc011660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:11.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.122+0000 7f6adaffd640 1 -- 172.21.15.53:0/1444504082 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6acc00e030 con 0x7f6ae41f4f00 2023-06-10T18:57:11.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.122+0000 7f6adaffd640 1 -- 172.21.15.53:0/1444504082 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6acc016470 con 0x7f6ae41f4f00 2023-06-10T18:57:11.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.122+0000 7f6ae8ede640 1 -- 172.21.15.53:0/1444504082 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ae40cc670 con 0x7f6ae41f4f00 2023-06-10T18:57:11.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.122+0000 7f6adaffd640 1 -- 172.21.15.53:0/1444504082 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6acc016820 con 0x7f6ae41f4f00 2023-06-10T18:57:11.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.122+0000 7f6ae8ede640 1 -- 172.21.15.53:0/1444504082 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ae40ccc30 con 0x7f6ae41f4f00 2023-06-10T18:57:11.150 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.122+0000 7f6ae8ede640 1 -- 172.21.15.53:0/1444504082 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ae404d790 con 0x7f6ae41f4f00 2023-06-10T18:57:11.150 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.122+0000 7f6adaffd640 1 -- 172.21.15.53:0/1444504082 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6acc016980 con 0x7f6ae41f4f00 2023-06-10T18:57:11.150 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.126+0000 7f6adaffd640 1 --2- 172.21.15.53:0/1444504082 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6ac80662b0 0x7f6ac8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:11.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.126+0000 7f6adaffd640 1 -- 172.21.15.53:0/1444504082 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6acc00f070 con 0x7f6ae41f4f00 2023-06-10T18:57:11.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.126+0000 7f6ae259c640 1 --2- 172.21.15.53:0/1444504082 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6ac80662b0 0x7f6ac8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:11.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.126+0000 7f6ae259c640 1 --2- 172.21.15.53:0/1444504082 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6ac80662b0 0x7f6ac8068760 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f6ad40ab000 tx=0x7f6ad40a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:11.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.130+0000 7f6adaffd640 1 -- 172.21.15.53:0/1444504082 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6acc0520a0 con 0x7f6ae41f4f00 2023-06-10T18:57:11.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.282+0000 7f6ae8ede640 1 -- 172.21.15.53:0/1444504082 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f6ae40c98d0 con 0x7f6ae41f4f00 2023-06-10T18:57:11.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.850+0000 7f6adaffd640 1 -- 172.21.15.53:0/1444504082 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v62) v1 ==== 138+0+0 (secure 0 0 0) 0x7f6acc0556c0 con 0x7f6ae41f4f00 2023-06-10T18:57:11.855 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_metadata' created 2023-06-10T18:57:11.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.854+0000 7f6ae8ede640 1 -- 172.21.15.53:0/1444504082 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6ac80662b0 msgr2=0x7f6ac8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:11.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.854+0000 7f6ae8ede640 1 --2- 172.21.15.53:0/1444504082 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6ac80662b0 0x7f6ac8068760 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f6ad40ab000 tx=0x7f6ad40a7070 comp rx=0 tx=0).stop 2023-06-10T18:57:11.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.854+0000 7f6ae8ede640 1 -- 172.21.15.53:0/1444504082 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ae41f4f00 msgr2=0x7f6ae40cb980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:11.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.854+0000 7f6ae8ede640 1 --2- 172.21.15.53:0/1444504082 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ae41f4f00 0x7f6ae40cb980 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f6acc007f30 tx=0x7f6acc011660 comp rx=0 tx=0).stop 2023-06-10T18:57:11.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.854+0000 7f6ae8ede640 1 -- 172.21.15.53:0/1444504082 shutdown_connections 2023-06-10T18:57:11.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.854+0000 7f6ae8ede640 1 --2- 172.21.15.53:0/1444504082 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6ac80662b0 0x7f6ac8068760 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:11.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.854+0000 7f6ae8ede640 1 --2- 172.21.15.53:0/1444504082 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ae41522f0 0x7f6ae40a7d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:11.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.854+0000 7f6ae8ede640 1 --2- 172.21.15.53:0/1444504082 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ae41f4f00 0x7f6ae40cb980 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:11.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.854+0000 7f6ae8ede640 1 --2- 172.21.15.53:0/1444504082 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ac40039d0 0x7f6ae40cd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:11.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.854+0000 7f6ae8ede640 1 -- 172.21.15.53:0/1444504082 >> 172.21.15.53:0/1444504082 conn(0x7f6ae40ca830 msgr2=0x7f6ae40b10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:11.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.854+0000 7f6ae8ede640 1 -- 172.21.15.53:0/1444504082 shutdown_connections 2023-06-10T18:57:11.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:11.854+0000 7f6ae8ede640 1 -- 172.21.15.53:0/1444504082 wait complete. 2023-06-10T18:57:11.887 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-06-10T18:57:12.022 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:12.018+0000 7fad3263e640 1 Processor -- start 2023-06-10T18:57:12.023 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:12.018+0000 7fad3263e640 1 -- start start 2023-06-10T18:57:12.024 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:12.018+0000 7fad3263e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fad2c158550 0x7fad2c0c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:12.024 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:12.018+0000 7fad3263e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fad2c0cd6a0 0x7fad2c0cbe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:12.024 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:12.018+0000 7fad3263e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad2c0cc3c0 con 0x7fad2c15c160 2023-06-10T18:57:12.024 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:12.018+0000 7fad3263e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad2c0c9450 con 0x7fad2c0cd6a0 2023-06-10T18:57:12.024 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:12.018+0000 7fad3263e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad2c0cc600 con 0x7fad2c158550 2023-06-10T18:57:12.024 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:12.018+0000 7fad2b7fe640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fad2c0cd6a0 0x7fad2c0cbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:12.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:12.018+0000 7fad2bfff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fad2c158550 0x7fad2c0c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:12.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:12.018+0000 7fad2b7fe640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fad2c0cd6a0 0x7fad2c0cbe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.53:51956/0 (socket says 172.21.15.53:51956) 2023-06-10T18:57:12.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:12.018+0000 7fad2bfff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fad2c158550 0x7fad2c0c8f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.53:42126/0 (socket says 172.21.15.53:42126) 2023-06-10T18:57:12.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:12.018+0000 7fad2b7fe640 1 -- 172.21.15.53:0/3438510695 learned_addr learned my addr 172.21.15.53:0/3438510695 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:57:12.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:12.018+0000 7fad30bdb640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fad2c15c160 0x7fad2c06f000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.53:57608/0 (socket says 172.21.15.53:57608) 2023-06-10T18:57:12.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:12.018+0000 7fad2b7fe640 1 -- 172.21.15.53:0/3438510695 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fad2c158550 msgr2=0x7fad2c0c8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:12.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:12.018+0000 7fad2b7fe640 1 --2- 172.21.15.53:0/3438510695 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fad2c158550 0x7fad2c0c8f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:12.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:12.018+0000 7fad2b7fe640 1 -- 172.21.15.53:0/3438510695 >> v1:172.21.15.117:6789/0 conn(0x7fad2c15c160 legacy=0x7fad2c06f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:12.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:12.018+0000 7fad2b7fe640 1 -- 172.21.15.53:0/3438510695 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad2c0cc8e0 con 0x7fad2c0cd6a0 2023-06-10T18:57:12.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:12.022+0000 7fad2b7fe640 1 --2- 172.21.15.53:0/3438510695 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad2c0cd6a0 0x7fad2c0cbe80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fad20009870 tx=0x7fad2001ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60fddb8870b9b90b server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:12.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:12.022+0000 7fad2affd640 1 -- 172.21.15.53:0/3438510695 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad200a8a30 con 0x7fad2c0cd6a0 2023-06-10T18:57:12.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:12.022+0000 7fad2affd640 1 -- 172.21.15.53:0/3438510695 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad200a8b90 con 0x7fad2c0cd6a0 2023-06-10T18:57:12.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:12.022+0000 7fad2affd640 1 -- 172.21.15.53:0/3438510695 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad200b0440 con 0x7fad2c0cd6a0 2023-06-10T18:57:12.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:12.022+0000 7fad3263e640 1 -- 172.21.15.53:0/3438510695 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad2c0cd6a0 msgr2=0x7fad2c0cbe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:12.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:12.022+0000 7fad3263e640 1 --2- 172.21.15.53:0/3438510695 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad2c0cd6a0 0x7fad2c0cbe80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fad20009870 tx=0x7fad2001ed30 comp rx=0 tx=0).stop 2023-06-10T18:57:12.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:12.022+0000 7fad3263e640 1 -- 172.21.15.53:0/3438510695 shutdown_connections 2023-06-10T18:57:12.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:12.022+0000 7fad3263e640 1 --2- 172.21.15.53:0/3438510695 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad2c0cd6a0 0x7fad2c0cbe80 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:12.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:12.022+0000 7fad3263e640 1 --2- 172.21.15.53:0/3438510695 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fad2c158550 0x7fad2c0c8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:12.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:12.022+0000 7fad3263e640 1 -- 172.21.15.53:0/3438510695 >> 172.21.15.53:0/3438510695 conn(0x7fad2c06a0e0 msgr2=0x7fad2c0ca810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:12.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:12.022+0000 7fad3263e640 1 -- 172.21.15.53:0/3438510695 shutdown_connections 2023-06-10T18:57:12.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:12.022+0000 7fad3263e640 1 -- 172.21.15.53:0/3438510695 wait complete. 2023-06-10T18:57:12.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:12.022+0000 7fad3263e640 1 Processor -- start 2023-06-10T18:57:12.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:12.022+0000 7fad3263e640 1 -- start start 2023-06-10T18:57:12.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:12.026+0000 7fad3263e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad2c0cd6a0 0x7fad2c15cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:12.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:12.026+0000 7fad3263e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fad2c158550 0x7fad2c151850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:12.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:12.026+0000 7fad3263e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fad2c15c160 0x7fad2c0b0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:12.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:12.026+0000 7fad3263e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad2c1540f0 con 0x7fad2c158550 2023-06-10T18:57:12.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:12.026+0000 7fad3263e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad2c151f50 con 0x7fad2c0cd6a0 2023-06-10T18:57:12.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:12.026+0000 7fad3263e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad2c152230 con 0x7fad2c15c160 2023-06-10T18:57:12.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:12.026+0000 7fad2b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fad2c158550 0x7fad2c151850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:12.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:12.026+0000 7fad2b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fad2c158550 0x7fad2c151850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52826/0 (socket says 172.21.15.53:52826) 2023-06-10T18:57:12.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:12.026+0000 7fad2b7fe640 1 -- 172.21.15.53:0/2218158835 learned_addr learned my addr 172.21.15.53:0/2218158835 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:57:12.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:12.026+0000 7fad30bdb640 1 --2- 172.21.15.53:0/2218158835 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fad2c15c160 0x7fad2c0b0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:12.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:12.026+0000 7fad2bfff640 1 --2- 172.21.15.53:0/2218158835 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad2c0cd6a0 0x7fad2c15cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:12.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:12.026+0000 7fad2b7fe640 1 -- 172.21.15.53:0/2218158835 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fad2c15c160 msgr2=0x7fad2c0b0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:12.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:12.026+0000 7fad2b7fe640 1 --2- 172.21.15.53:0/2218158835 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fad2c15c160 0x7fad2c0b0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:12.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:12.026+0000 7fad2b7fe640 1 -- 172.21.15.53:0/2218158835 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad2c0cd6a0 msgr2=0x7fad2c15cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:12.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:12.026+0000 7fad2b7fe640 1 --2- 172.21.15.53:0/2218158835 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad2c0cd6a0 0x7fad2c15cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:12.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:12.026+0000 7fad2b7fe640 1 -- 172.21.15.53:0/2218158835 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad200094d0 con 0x7fad2c158550 2023-06-10T18:57:12.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:12.026+0000 7fad2b7fe640 1 --2- 172.21.15.53:0/2218158835 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fad2c158550 0x7fad2c151850 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fad20000c10 tx=0x7fad2001bad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:12.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:12.026+0000 7fad28ff9640 1 -- 172.21.15.53:0/2218158835 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad200b1de0 con 0x7fad2c158550 2023-06-10T18:57:12.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:12.026+0000 7fad28ff9640 1 -- 172.21.15.53:0/2218158835 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad200b9410 con 0x7fad2c158550 2023-06-10T18:57:12.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:12.026+0000 7fad3263e640 1 -- 172.21.15.53:0/2218158835 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad2c152510 con 0x7fad2c158550 2023-06-10T18:57:12.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:12.026+0000 7fad28ff9640 1 -- 172.21.15.53:0/2218158835 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad200b97c0 con 0x7fad2c158550 2023-06-10T18:57:12.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:12.026+0000 7fad3263e640 1 -- 172.21.15.53:0/2218158835 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad2c152ad0 con 0x7fad2c158550 2023-06-10T18:57:12.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:12.026+0000 7fad3263e640 1 -- 172.21.15.53:0/2218158835 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad2c152cc0 con 0x7fad2c158550 2023-06-10T18:57:12.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:12.026+0000 7fad28ff9640 1 -- 172.21.15.53:0/2218158835 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fad200b7040 con 0x7fad2c158550 2023-06-10T18:57:12.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:12.026+0000 7fad28ff9640 1 --2- 172.21.15.53:0/2218158835 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fad180662b0 0x7fad18068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:12.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:12.030+0000 7fad28ff9640 1 -- 172.21.15.53:0/2218158835 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5580+0+0 (secure 0 0 0) 0x7fad20122210 con 0x7fad2c158550 2023-06-10T18:57:12.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:12.030+0000 7fad2bfff640 1 --2- 172.21.15.53:0/2218158835 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fad180662b0 0x7fad18068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:12.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:12.030+0000 7fad2bfff640 1 --2- 172.21.15.53:0/2218158835 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fad180662b0 0x7fad18068760 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fad1c009af0 tx=0x7fad1c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:12.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:12.034+0000 7fad28ff9640 1 -- 172.21.15.53:0/2218158835 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fad200ef7d0 con 0x7fad2c158550 2023-06-10T18:57:12.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:12.186+0000 7fad3263e640 1 -- 172.21.15.53:0/2218158835 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fad2c04d790 con 0x7fad2c158550 2023-06-10T18:57:12.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:12.858+0000 7fad28ff9640 1 -- 172.21.15.53:0/2218158835 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v63) v1 ==== 170+0+0 (secure 0 0 0) 0x7fad200b50d0 con 0x7fad2c158550 2023-06-10T18:57:12.868 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_data' created 2023-06-10T18:57:12.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:12.866+0000 7fad3263e640 1 -- 172.21.15.53:0/2218158835 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fad180662b0 msgr2=0x7fad18068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:12.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:12.866+0000 7fad3263e640 1 --2- 172.21.15.53:0/2218158835 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fad180662b0 0x7fad18068760 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fad1c009af0 tx=0x7fad1c008040 comp rx=0 tx=0).stop 2023-06-10T18:57:12.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:12.866+0000 7fad3263e640 1 -- 172.21.15.53:0/2218158835 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fad2c158550 msgr2=0x7fad2c151850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:12.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:12.866+0000 7fad3263e640 1 --2- 172.21.15.53:0/2218158835 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fad2c158550 0x7fad2c151850 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fad20000c10 tx=0x7fad2001bad0 comp rx=0 tx=0).stop 2023-06-10T18:57:12.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:12.870+0000 7fad3263e640 1 -- 172.21.15.53:0/2218158835 shutdown_connections 2023-06-10T18:57:12.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:12.870+0000 7fad3263e640 1 --2- 172.21.15.53:0/2218158835 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fad180662b0 0x7fad18068760 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:12.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:12.870+0000 7fad3263e640 1 --2- 172.21.15.53:0/2218158835 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fad2c15c160 0x7fad2c0b0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:12.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:12.870+0000 7fad3263e640 1 --2- 172.21.15.53:0/2218158835 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fad2c158550 0x7fad2c151850 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:12.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:12.870+0000 7fad3263e640 1 --2- 172.21.15.53:0/2218158835 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad2c0cd6a0 0x7fad2c15cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:12.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:12.870+0000 7fad3263e640 1 -- 172.21.15.53:0/2218158835 >> 172.21.15.53:0/2218158835 conn(0x7fad2c06a0e0 msgr2=0x7fad2c0aefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:12.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:12.870+0000 7fad3263e640 1 -- 172.21.15.53:0/2218158835 shutdown_connections 2023-06-10T18:57:12.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:12.874+0000 7fad3263e640 1 -- 172.21.15.53:0/2218158835 wait complete. 2023-06-10T18:57:12.909 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-06-10T18:57:13.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.030+0000 7f96bdfa3640 1 Processor -- start 2023-06-10T18:57:13.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.030+0000 7f96bdfa3640 1 -- start start 2023-06-10T18:57:13.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.030+0000 7f96bdfa3640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f96b815c090 0x7f96b80b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:13.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.030+0000 7f96bdfa3640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96b80cc7c0 con 0x7f96b80b7e30 2023-06-10T18:57:13.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.030+0000 7f96bdfa3640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96b80ccaa0 con 0x7f96b80b0b90 2023-06-10T18:57:13.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.030+0000 7f96bdfa3640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96b80ccd80 con 0x7f96b815c090 2023-06-10T18:57:13.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.030+0000 7f96b7fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f96b80b7e30 0x7f96b80d04d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:48192/0 (socket says 172.21.15.53:48192) 2023-06-10T18:57:13.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.030+0000 7f96b7fff640 1 -- 172.21.15.53:0/1380601607 learned_addr learned my addr 172.21.15.53:0/1380601607 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:57:13.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.030+0000 7f96b77fe640 1 --2- 172.21.15.53:0/1380601607 >> v2:172.21.15.117:3300/0 conn(0x7f96b815c090 0x7f96b80b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:13.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.030+0000 7f96b67fc640 1 -- 172.21.15.53:0/1380601607 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3151922949 0 0) 0x7f96b80cc7c0 con 0x7f96b80b7e30 2023-06-10T18:57:13.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.030+0000 7f96b67fc640 1 -- 172.21.15.53:0/1380601607 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96a0003530 con 0x7f96b80b7e30 2023-06-10T18:57:13.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.030+0000 7f96b67fc640 1 -- 172.21.15.53:0/1380601607 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4164993347 0 0) 0x7f96a0003530 con 0x7f96b80b7e30 2023-06-10T18:57:13.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.030+0000 7f96b67fc640 1 -- 172.21.15.53:0/1380601607 >> v2:172.21.15.117:3300/0 conn(0x7f96b815c090 msgr2=0x7f96b80b10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:13.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.030+0000 7f96b67fc640 1 --2- 172.21.15.53:0/1380601607 >> v2:172.21.15.117:3300/0 conn(0x7f96b815c090 0x7f96b80b10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:13.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.030+0000 7f96b67fc640 1 -- 172.21.15.53:0/1380601607 >> v1:172.21.15.117:6789/0 conn(0x7f96b80b0b90 legacy=0x7f96b80b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:13.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.030+0000 7f96b67fc640 1 -- 172.21.15.53:0/1380601607 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96b80cd060 con 0x7f96b80b7e30 2023-06-10T18:57:13.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.030+0000 7f96b67fc640 1 -- 172.21.15.53:0/1380601607 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f96b0001a20 con 0x7f96b80b7e30 2023-06-10T18:57:13.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.030+0000 7f96b67fc640 1 -- 172.21.15.53:0/1380601607 >> v1:172.21.15.53:6789/0 conn(0x7f96b80b7e30 legacy=0x7f96b80d04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:13.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.030+0000 7f96b67fc640 1 --2- 172.21.15.53:0/1380601607 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96a0003980 0x7f96a0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:13.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.030+0000 7f96b67fc640 1 --2- 172.21.15.53:0/1380601607 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f96a00047d0 0x7f96a0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:13.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.030+0000 7f96b67fc640 1 --2- 172.21.15.53:0/1380601607 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96a0005180 0x7f96a000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:13.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.030+0000 7f96b67fc640 1 -- 172.21.15.53:0/1380601607 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b80ccd80 con 0x7f96a0005180 2023-06-10T18:57:13.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.030+0000 7f96b67fc640 1 -- 172.21.15.53:0/1380601607 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a000c090 con 0x7f96a0003980 2023-06-10T18:57:13.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.030+0000 7f96b67fc640 1 -- 172.21.15.53:0/1380601607 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96a000c250 con 0x7f96a00047d0 2023-06-10T18:57:13.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.030+0000 7f96b7fff640 1 --2- 172.21.15.53:0/1380601607 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96a0005180 0x7f96a000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:13.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.030+0000 7f96b77fe640 1 --2- 172.21.15.53:0/1380601607 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96a0003980 0x7f96a0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:13.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.030+0000 7f96b6ffd640 1 --2- 172.21.15.53:0/1380601607 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f96a00047d0 0x7f96a0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:13.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.030+0000 7f96b7fff640 1 -- 172.21.15.53:0/1380601607 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f96a00047d0 msgr2=0x7f96a0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:13.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.030+0000 7f96b7fff640 1 --2- 172.21.15.53:0/1380601607 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f96a00047d0 0x7f96a0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:13.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.030+0000 7f96b7fff640 1 -- 172.21.15.53:0/1380601607 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96a0003980 msgr2=0x7f96a0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:13.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.030+0000 7f96b7fff640 1 --2- 172.21.15.53:0/1380601607 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96a0003980 0x7f96a0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:13.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.030+0000 7f96b7fff640 1 -- 172.21.15.53:0/1380601607 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96a0003530 con 0x7f96a0005180 2023-06-10T18:57:13.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.034+0000 7f96b7fff640 1 -- 172.21.15.53:0/1380601607 reap_dead start 2023-06-10T18:57:13.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.034+0000 7f96b7fff640 1 --2- 172.21.15.53:0/1380601607 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96a0005180 0x7f96a000b990 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f96b80b8220 tx=0x7f96b001fa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e1218a993db96a5 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:13.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.034+0000 7f96b67fc640 1 -- 172.21.15.53:0/1380601607 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b00af070 con 0x7f96a0005180 2023-06-10T18:57:13.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.034+0000 7f96b67fc640 1 -- 172.21.15.53:0/1380601607 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96b00aa470 con 0x7f96a0005180 2023-06-10T18:57:13.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.034+0000 7f96b67fc640 1 -- 172.21.15.53:0/1380601607 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b00aa800 con 0x7f96a0005180 2023-06-10T18:57:13.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.034+0000 7f96bdfa3640 1 -- 172.21.15.53:0/1380601607 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96a0005180 msgr2=0x7f96a000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:13.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.034+0000 7f96bdfa3640 1 --2- 172.21.15.53:0/1380601607 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96a0005180 0x7f96a000b990 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f96b80b8220 tx=0x7f96b001fa40 comp rx=0 tx=0).stop 2023-06-10T18:57:13.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.034+0000 7f96bdfa3640 1 -- 172.21.15.53:0/1380601607 shutdown_connections 2023-06-10T18:57:13.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.034+0000 7f96bdfa3640 1 --2- 172.21.15.53:0/1380601607 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96a0005180 0x7f96a000b990 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:13.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.034+0000 7f96bdfa3640 1 -- 172.21.15.53:0/1380601607 >> 172.21.15.53:0/1380601607 conn(0x7f96b8069e20 msgr2=0x7f96b806a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:13.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.034+0000 7f96bdfa3640 1 -- 172.21.15.53:0/1380601607 shutdown_connections 2023-06-10T18:57:13.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.034+0000 7f96bdfa3640 1 -- 172.21.15.53:0/1380601607 wait complete. 2023-06-10T18:57:13.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.034+0000 7f96bdfa3640 1 Processor -- start 2023-06-10T18:57:13.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.034+0000 7f96bdfa3640 1 -- start start 2023-06-10T18:57:13.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.038+0000 7f96bdfa3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f96a0005180 0x7f96b80d29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:13.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.038+0000 7f96bdfa3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96b80d0410 0x7f96b81f43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:13.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.038+0000 7f96bdfa3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96b8155290 0x7f96b8155700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:13.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.038+0000 7f96bdfa3640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b815f4a0 con 0x7f96b80d0410 2023-06-10T18:57:13.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.038+0000 7f96bdfa3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b8155c40 con 0x7f96b8155290 2023-06-10T18:57:13.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.038+0000 7f96bdfa3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96b81f4910 con 0x7f96a0005180 2023-06-10T18:57:13.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.038+0000 7f96b6ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96b80d0410 0x7f96b81f43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:13.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.038+0000 7f96b6ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96b80d0410 0x7f96b81f43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52850/0 (socket says 172.21.15.53:52850) 2023-06-10T18:57:13.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.038+0000 7f96b6ffd640 1 -- 172.21.15.53:0/3749798109 learned_addr learned my addr 172.21.15.53:0/3749798109 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:57:13.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.038+0000 7f96b77fe640 1 --2- 172.21.15.53:0/3749798109 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f96a0005180 0x7f96b80d29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:13.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.038+0000 7f96b7fff640 1 --2- 172.21.15.53:0/3749798109 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96b8155290 0x7f96b8155700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:13.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.038+0000 7f96b6ffd640 1 -- 172.21.15.53:0/3749798109 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f96a0005180 msgr2=0x7f96b80d29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:13.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.038+0000 7f96b6ffd640 1 --2- 172.21.15.53:0/3749798109 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f96a0005180 0x7f96b80d29e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:13.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.038+0000 7f96b6ffd640 1 -- 172.21.15.53:0/3749798109 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96b8155290 msgr2=0x7f96b8155700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:13.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.038+0000 7f96b6ffd640 1 --2- 172.21.15.53:0/3749798109 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96b8155290 0x7f96b8155700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:13.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.038+0000 7f96b6ffd640 1 -- 172.21.15.53:0/3749798109 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96b815f1c0 con 0x7f96b80d0410 2023-06-10T18:57:13.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.038+0000 7f96b6ffd640 1 --2- 172.21.15.53:0/3749798109 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96b80d0410 0x7f96b81f43d0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f96ac00e410 tx=0x7f96ac00e8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:13.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.038+0000 7f969ffff640 1 -- 172.21.15.53:0/3749798109 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96ac0052e0 con 0x7f96b80d0410 2023-06-10T18:57:13.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.038+0000 7f969ffff640 1 -- 172.21.15.53:0/3749798109 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96ac005440 con 0x7f96b80d0410 2023-06-10T18:57:13.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.038+0000 7f96bdfa3640 1 -- 172.21.15.53:0/3749798109 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96b80c9d50 con 0x7f96b80d0410 2023-06-10T18:57:13.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.038+0000 7f969ffff640 1 -- 172.21.15.53:0/3749798109 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96ac003820 con 0x7f96b80d0410 2023-06-10T18:57:13.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.038+0000 7f96bdfa3640 1 -- 172.21.15.53:0/3749798109 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96b80ca310 con 0x7f96b80d0410 2023-06-10T18:57:13.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.038+0000 7f96bdfa3640 1 -- 172.21.15.53:0/3749798109 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96b80c9bb0 con 0x7f96b80d0410 2023-06-10T18:57:13.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.038+0000 7f969ffff640 1 -- 172.21.15.53:0/3749798109 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f96ac003980 con 0x7f96b80d0410 2023-06-10T18:57:13.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.038+0000 7f969ffff640 1 --2- 172.21.15.53:0/3749798109 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f96a40662b0 0x7f96a4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:13.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.038+0000 7f969ffff640 1 -- 172.21.15.53:0/3749798109 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f96ac083460 con 0x7f96b80d0410 2023-06-10T18:57:13.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.038+0000 7f96b77fe640 1 --2- 172.21.15.53:0/3749798109 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f96a40662b0 0x7f96a4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:13.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.042+0000 7f96b77fe640 1 --2- 172.21.15.53:0/3749798109 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f96a40662b0 0x7f96a4068760 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f96a80099b0 tx=0x7f96a8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:13.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.042+0000 7f969ffff640 1 -- 172.21.15.53:0/3749798109 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f96b80c9bb0 con 0x7f96b80d0410 2023-06-10T18:57:13.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.230+0000 7f96bdfa3640 1 -- 172.21.15.53:0/3749798109 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f96b80c9bb0 con 0x7f96b80d0410 2023-06-10T18:57:13.247 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.242+0000 7f969ffff640 1 -- 172.21.15.53:0/3749798109 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 9 and data pool 10 v24) v1 ==== 173+0+0 (secure 0 0 0) 0x7f96b80c9bb0 con 0x7f96b80d0410 2023-06-10T18:57:13.248 INFO:teuthology.orchestra.run.smithi053.stderr:new fs with metadata pool 9 and data pool 10 2023-06-10T18:57:13.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.246+0000 7f96bdfa3640 1 -- 172.21.15.53:0/3749798109 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f96a40662b0 msgr2=0x7f96a4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:13.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.246+0000 7f96bdfa3640 1 --2- 172.21.15.53:0/3749798109 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f96a40662b0 0x7f96a4068760 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f96a80099b0 tx=0x7f96a8008040 comp rx=0 tx=0).stop 2023-06-10T18:57:13.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.246+0000 7f96bdfa3640 1 -- 172.21.15.53:0/3749798109 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96b80d0410 msgr2=0x7f96b81f43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:13.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.246+0000 7f96bdfa3640 1 --2- 172.21.15.53:0/3749798109 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96b80d0410 0x7f96b81f43d0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f96ac00e410 tx=0x7f96ac00e8d0 comp rx=0 tx=0).stop 2023-06-10T18:57:13.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.246+0000 7f96bdfa3640 1 -- 172.21.15.53:0/3749798109 shutdown_connections 2023-06-10T18:57:13.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.246+0000 7f96bdfa3640 1 --2- 172.21.15.53:0/3749798109 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f96a40662b0 0x7f96a4068760 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:13.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.246+0000 7f96bdfa3640 1 --2- 172.21.15.53:0/3749798109 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96b8155290 0x7f96b8155700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:13.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.246+0000 7f96bdfa3640 1 --2- 172.21.15.53:0/3749798109 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96b80d0410 0x7f96b81f43d0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:13.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.246+0000 7f96bdfa3640 1 --2- 172.21.15.53:0/3749798109 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f96a0005180 0x7f96b80d29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:13.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.246+0000 7f96bdfa3640 1 -- 172.21.15.53:0/3749798109 >> 172.21.15.53:0/3749798109 conn(0x7f96b8069e20 msgr2=0x7f96b806a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:13.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.246+0000 7f96bdfa3640 1 -- 172.21.15.53:0/3749798109 shutdown_connections 2023-06-10T18:57:13.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.246+0000 7f96bdfa3640 1 -- 172.21.15.53:0/3749798109 wait complete. 2023-06-10T18:57:13.280 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T18:57:13.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.390+0000 7efcdf8d2640 1 Processor -- start 2023-06-10T18:57:13.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.390+0000 7efcdf8d2640 1 -- start start 2023-06-10T18:57:13.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.394+0000 7efcdf8d2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efcd80c9750 0x7efcd80aced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:13.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.394+0000 7efcdf8d2640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7efcd80cb870 0x7efcd80af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:13.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.394+0000 7efcdf8d2640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcd80ad410 con 0x7efcd80afc60 2023-06-10T18:57:13.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.394+0000 7efcdf8d2640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcd80cd990 con 0x7efcd80cb870 2023-06-10T18:57:13.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.394+0000 7efcdf8d2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcd80b00e0 con 0x7efcd80c9750 2023-06-10T18:57:13.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.394+0000 7efcdde6f640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7efcd80afc60 0x7efcd815bec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:48198/0 (socket says 172.21.15.53:48198) 2023-06-10T18:57:13.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.394+0000 7efcdde6f640 1 -- 172.21.15.53:0/2150835023 learned_addr learned my addr 172.21.15.53:0/2150835023 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:57:13.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.394+0000 7efcdce6d640 1 --2- 172.21.15.53:0/2150835023 >> v2:172.21.15.53:3300/0 conn(0x7efcd80cb870 0x7efcd80af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:13.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.394+0000 7efcdd66e640 1 --2- 172.21.15.53:0/2150835023 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efcd80c9750 0x7efcd80aced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:13.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.394+0000 7efccffff640 1 -- 172.21.15.53:0/2150835023 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3344515530 0 0) 0x7efcd80ad410 con 0x7efcd80afc60 2023-06-10T18:57:13.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.394+0000 7efccffff640 1 -- 172.21.15.53:0/2150835023 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efcc4003530 con 0x7efcd80afc60 2023-06-10T18:57:13.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.394+0000 7efcdce6d640 1 -- 172.21.15.53:0/2150835023 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efcd80c9750 msgr2=0x7efcd80aced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:13.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.394+0000 7efcdce6d640 1 --2- 172.21.15.53:0/2150835023 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efcd80c9750 0x7efcd80aced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:13.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.394+0000 7efcdce6d640 1 -- 172.21.15.53:0/2150835023 >> v1:172.21.15.53:6789/0 conn(0x7efcd80afc60 legacy=0x7efcd815bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:13.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.394+0000 7efcdce6d640 1 -- 172.21.15.53:0/2150835023 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcd81600d0 con 0x7efcd80cb870 2023-06-10T18:57:13.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.398+0000 7efcdce6d640 1 --2- 172.21.15.53:0/2150835023 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efcd80cb870 0x7efcd80af720 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7efcc80097c0 tx=0x7efcc801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4070d78ddeed0019 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:13.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.398+0000 7efccffff640 1 -- 172.21.15.53:0/2150835023 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc80ab650 con 0x7efcd80cb870 2023-06-10T18:57:13.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.398+0000 7efccffff640 1 -- 172.21.15.53:0/2150835023 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcc80ab7b0 con 0x7efcd80cb870 2023-06-10T18:57:13.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.398+0000 7efccffff640 1 -- 172.21.15.53:0/2150835023 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc80abb40 con 0x7efcd80cb870 2023-06-10T18:57:13.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.398+0000 7efcdf8d2640 1 -- 172.21.15.53:0/2150835023 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efcd80cb870 msgr2=0x7efcd80af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:13.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.398+0000 7efcdf8d2640 1 --2- 172.21.15.53:0/2150835023 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efcd80cb870 0x7efcd80af720 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7efcc80097c0 tx=0x7efcc801c450 comp rx=0 tx=0).stop 2023-06-10T18:57:13.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.398+0000 7efcdf8d2640 1 -- 172.21.15.53:0/2150835023 shutdown_connections 2023-06-10T18:57:13.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.398+0000 7efcdf8d2640 1 --2- 172.21.15.53:0/2150835023 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efcd80cb870 0x7efcd80af720 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:13.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.398+0000 7efcdf8d2640 1 --2- 172.21.15.53:0/2150835023 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efcd80c9750 0x7efcd80aced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:13.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.398+0000 7efcdf8d2640 1 -- 172.21.15.53:0/2150835023 >> 172.21.15.53:0/2150835023 conn(0x7efcd806a0d0 msgr2=0x7efcd80ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:13.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.398+0000 7efcdf8d2640 1 -- 172.21.15.53:0/2150835023 shutdown_connections 2023-06-10T18:57:13.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.398+0000 7efcdf8d2640 1 -- 172.21.15.53:0/2150835023 wait complete. 2023-06-10T18:57:13.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.398+0000 7efcdf8d2640 1 Processor -- start 2023-06-10T18:57:13.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.398+0000 7efcdf8d2640 1 -- start start 2023-06-10T18:57:13.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.398+0000 7efcdf8d2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efcd80afc60 0x7efcd806be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:13.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.398+0000 7efcdf8d2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcd80c9750 0x7efcd814e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:13.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.398+0000 7efcdf8d2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efcd80cb870 0x7efcd8155540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:13.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.398+0000 7efcdf8d2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd8156940 con 0x7efcd80cb870 2023-06-10T18:57:13.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.398+0000 7efcdf8d2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd8156c20 con 0x7efcd80c9750 2023-06-10T18:57:13.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.398+0000 7efcdf8d2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcd8156f00 con 0x7efcd80afc60 2023-06-10T18:57:13.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.398+0000 7efcdde6f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efcd80cb870 0x7efcd8155540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:13.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.398+0000 7efcdde6f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efcd80cb870 0x7efcd8155540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52862/0 (socket says 172.21.15.53:52862) 2023-06-10T18:57:13.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.398+0000 7efcdde6f640 1 -- 172.21.15.53:0/591547438 learned_addr learned my addr 172.21.15.53:0/591547438 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:57:13.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.398+0000 7efcdd66e640 1 --2- 172.21.15.53:0/591547438 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efcd80afc60 0x7efcd806be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:13.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.398+0000 7efcdde6f640 1 -- 172.21.15.53:0/591547438 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efcd80afc60 msgr2=0x7efcd806be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:13.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.398+0000 7efcdce6d640 1 --2- 172.21.15.53:0/591547438 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcd80c9750 0x7efcd814e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:13.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.398+0000 7efcdde6f640 1 --2- 172.21.15.53:0/591547438 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efcd80afc60 0x7efcd806be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:13.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.398+0000 7efcdde6f640 1 -- 172.21.15.53:0/591547438 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcd80c9750 msgr2=0x7efcd814e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:13.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.398+0000 7efcdde6f640 1 --2- 172.21.15.53:0/591547438 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcd80c9750 0x7efcd814e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:13.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.398+0000 7efcdde6f640 1 -- 172.21.15.53:0/591547438 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcc8009420 con 0x7efcd80cb870 2023-06-10T18:57:13.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.398+0000 7efcdde6f640 1 --2- 172.21.15.53:0/591547438 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efcd80cb870 0x7efcd8155540 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7efcd000caa0 tx=0x7efcd000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:13.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.402+0000 7efccdffb640 1 -- 172.21.15.53:0/591547438 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd000ac00 con 0x7efcd80cb870 2023-06-10T18:57:13.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.402+0000 7efccdffb640 1 -- 172.21.15.53:0/591547438 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcd000ad60 con 0x7efcd80cb870 2023-06-10T18:57:13.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.402+0000 7efcdf8d2640 1 -- 172.21.15.53:0/591547438 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcd81571e0 con 0x7efcd80cb870 2023-06-10T18:57:13.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.402+0000 7efccdffb640 1 -- 172.21.15.53:0/591547438 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd0012620 con 0x7efcd80cb870 2023-06-10T18:57:13.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.402+0000 7efcdf8d2640 1 -- 172.21.15.53:0/591547438 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcd81565a0 con 0x7efcd80cb870 2023-06-10T18:57:13.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.402+0000 7efcdf8d2640 1 -- 172.21.15.53:0/591547438 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcd804d790 con 0x7efcd80cb870 2023-06-10T18:57:13.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.402+0000 7efccdffb640 1 -- 172.21.15.53:0/591547438 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7efcd0007070 con 0x7efcd80cb870 2023-06-10T18:57:13.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.402+0000 7efccdffb640 1 --2- 172.21.15.53:0/591547438 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efcbc0662d0 0x7efcbc068780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:13.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.402+0000 7efccdffb640 1 -- 172.21.15.53:0/591547438 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efcd0083c80 con 0x7efcd80cb870 2023-06-10T18:57:13.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.402+0000 7efcdd66e640 1 --2- 172.21.15.53:0/591547438 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efcbc0662d0 0x7efcbc068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:13.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.402+0000 7efcdd66e640 1 --2- 172.21.15.53:0/591547438 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efcbc0662d0 0x7efcbc068780 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7efcd4009990 tx=0x7efcd4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:13.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.406+0000 7efccdffb640 1 -- 172.21.15.53:0/591547438 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7efcd00511e0 con 0x7efcd80cb870 2023-06-10T18:57:13.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.562+0000 7efcdf8d2640 1 -- 172.21.15.53:0/591547438 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efcd8157690 con 0x7efcd80cb870 2023-06-10T18:57:13.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.562+0000 7efccdffb640 1 -- 172.21.15.53:0/591547438 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+18294 (secure 0 0 0) 0x7efcd0017020 con 0x7efcd80cb870 2023-06-10T18:57:13.568 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:57:13.569 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":64,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T18:57:13.234270+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-06-10T18:57:11.323255+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-06-10T18:57:12.231973+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T18:57:13.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.566+0000 7efcdf8d2640 1 -- 172.21.15.53:0/591547438 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efcbc0662d0 msgr2=0x7efcbc068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:13.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.566+0000 7efcdf8d2640 1 --2- 172.21.15.53:0/591547438 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efcbc0662d0 0x7efcbc068780 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7efcd4009990 tx=0x7efcd4008040 comp rx=0 tx=0).stop 2023-06-10T18:57:13.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.566+0000 7efcdf8d2640 1 -- 172.21.15.53:0/591547438 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efcd80cb870 msgr2=0x7efcd8155540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:13.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.566+0000 7efcdf8d2640 1 --2- 172.21.15.53:0/591547438 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efcd80cb870 0x7efcd8155540 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7efcd000caa0 tx=0x7efcd000cf60 comp rx=0 tx=0).stop 2023-06-10T18:57:13.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.566+0000 7efcdf8d2640 1 -- 172.21.15.53:0/591547438 shutdown_connections 2023-06-10T18:57:13.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.566+0000 7efcdf8d2640 1 --2- 172.21.15.53:0/591547438 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efcbc0662d0 0x7efcbc068780 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:13.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.566+0000 7efcdf8d2640 1 --2- 172.21.15.53:0/591547438 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efcd80cb870 0x7efcd8155540 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:13.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.566+0000 7efcdf8d2640 1 --2- 172.21.15.53:0/591547438 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcd80c9750 0x7efcd814e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:13.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.566+0000 7efcdf8d2640 1 --2- 172.21.15.53:0/591547438 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efcd80afc60 0x7efcd806be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:13.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.566+0000 7efcdf8d2640 1 -- 172.21.15.53:0/591547438 >> 172.21.15.53:0/591547438 conn(0x7efcd806a0d0 msgr2=0x7efcd815bec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:13.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.566+0000 7efcdf8d2640 1 -- 172.21.15.53:0/591547438 shutdown_connections 2023-06-10T18:57:13.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.566+0000 7efcdf8d2640 1 -- 172.21.15.53:0/591547438 wait complete. 2023-06-10T18:57:13.588 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T18:57:13.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.710+0000 7f85cb9b8640 1 Processor -- start 2023-06-10T18:57:13.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.710+0000 7f85cb9b8640 1 -- start start 2023-06-10T18:57:13.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.710+0000 7f85cb9b8640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f85c40cec40 0x7f85c40cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:13.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.710+0000 7f85cb9b8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f85c40cbf50 0x7f85c40cc390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:13.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.710+0000 7f85cb9b8640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85c40cbac0 con 0x7f85c4159450 2023-06-10T18:57:13.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.710+0000 7f85cb9b8640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85c40cf600 con 0x7f85c40cbf50 2023-06-10T18:57:13.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.710+0000 7f85cb9b8640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85c415dc00 con 0x7f85c40cec40 2023-06-10T18:57:13.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.710+0000 7f85c9754640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f85c4159450 0x7f85c415d140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:48204/0 (socket says 172.21.15.53:48204) 2023-06-10T18:57:13.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.710+0000 7f85c9754640 1 -- 172.21.15.53:0/1158908728 learned_addr learned my addr 172.21.15.53:0/1158908728 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:57:13.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.710+0000 7f85c9f55640 1 --2- 172.21.15.53:0/1158908728 >> v2:172.21.15.53:3300/0 conn(0x7f85c40cbf50 0x7f85c40cc390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:13.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.710+0000 7f85bbfff640 1 -- 172.21.15.53:0/1158908728 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1920560471 0 0) 0x7f85c40cbac0 con 0x7f85c4159450 2023-06-10T18:57:13.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.710+0000 7f85bbfff640 1 -- 172.21.15.53:0/1158908728 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85b0003530 con 0x7f85c4159450 2023-06-10T18:57:13.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.710+0000 7f85c8f53640 1 --2- 172.21.15.53:0/1158908728 >> v2:172.21.15.117:3300/0 conn(0x7f85c40cec40 0x7f85c40cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:13.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.710+0000 7f85c9f55640 1 -- 172.21.15.53:0/1158908728 >> v2:172.21.15.117:3300/0 conn(0x7f85c40cec40 msgr2=0x7f85c40cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:13.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.710+0000 7f85c9f55640 1 --2- 172.21.15.53:0/1158908728 >> v2:172.21.15.117:3300/0 conn(0x7f85c40cec40 0x7f85c40cf0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:13.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.710+0000 7f85c9f55640 1 -- 172.21.15.53:0/1158908728 >> v1:172.21.15.53:6789/0 conn(0x7f85c4159450 legacy=0x7f85c415d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:13.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.710+0000 7f85bbfff640 1 -- 172.21.15.53:0/1158908728 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2784644574 0 0) 0x7f85b0003530 con 0x7f85c4159450 2023-06-10T18:57:13.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.710+0000 7f85c9f55640 1 -- 172.21.15.53:0/1158908728 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c415dee0 con 0x7f85c40cbf50 2023-06-10T18:57:13.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.714+0000 7f85c9f55640 1 --2- 172.21.15.53:0/1158908728 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85c40cbf50 0x7f85c40cc390 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f85c406df40 tx=0x7f85bc01c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e502dfd62b62f2e7 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:13.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.714+0000 7f85bbfff640 1 -- 172.21.15.53:0/1158908728 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c0001680 con 0x7f85c40cbf50 2023-06-10T18:57:13.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.714+0000 7f85bbfff640 1 -- 172.21.15.53:0/1158908728 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85bc0a5600 con 0x7f85c40cbf50 2023-06-10T18:57:13.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.714+0000 7f85bbfff640 1 -- 172.21.15.53:0/1158908728 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85bc0a5990 con 0x7f85c40cbf50 2023-06-10T18:57:13.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.714+0000 7f85cb9b8640 1 -- 172.21.15.53:0/1158908728 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85c40cbf50 msgr2=0x7f85c40cc390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:13.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.714+0000 7f85cb9b8640 1 --2- 172.21.15.53:0/1158908728 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85c40cbf50 0x7f85c40cc390 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f85c406df40 tx=0x7f85bc01c800 comp rx=0 tx=0).stop 2023-06-10T18:57:13.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.714+0000 7f85cb9b8640 1 -- 172.21.15.53:0/1158908728 shutdown_connections 2023-06-10T18:57:13.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.714+0000 7f85cb9b8640 1 --2- 172.21.15.53:0/1158908728 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85c40cbf50 0x7f85c40cc390 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:13.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.714+0000 7f85cb9b8640 1 --2- 172.21.15.53:0/1158908728 >> v2:172.21.15.117:3300/0 conn(0x7f85c40cec40 0x7f85c40cf0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:13.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.714+0000 7f85cb9b8640 1 -- 172.21.15.53:0/1158908728 >> 172.21.15.53:0/1158908728 conn(0x7f85c406a090 msgr2=0x7f85c406d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:13.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.714+0000 7f85cb9b8640 1 -- 172.21.15.53:0/1158908728 shutdown_connections 2023-06-10T18:57:13.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.714+0000 7f85cb9b8640 1 -- 172.21.15.53:0/1158908728 wait complete. 2023-06-10T18:57:13.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.714+0000 7f85cb9b8640 1 Processor -- start 2023-06-10T18:57:13.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.714+0000 7f85cb9b8640 1 -- start start 2023-06-10T18:57:13.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.714+0000 7f85cb9b8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85c40cbf50 0x7f85c40b0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:13.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.714+0000 7f85cb9b8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85c40cec40 0x7f85c40afaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:13.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.714+0000 7f85cb9b8640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85c4159450 0x7f85c4151900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:13.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.714+0000 7f85cb9b8640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c415a2d0 con 0x7f85c40cbf50 2023-06-10T18:57:13.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.714+0000 7f85cb9b8640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c415a5b0 con 0x7f85c40cec40 2023-06-10T18:57:13.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.714+0000 7f85cb9b8640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85c415a890 con 0x7f85c4159450 2023-06-10T18:57:13.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.714+0000 7f85c9754640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85c40cbf50 0x7f85c40b0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:13.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.714+0000 7f85c9754640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85c40cbf50 0x7f85c40b0bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52872/0 (socket says 172.21.15.53:52872) 2023-06-10T18:57:13.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.714+0000 7f85c9754640 1 -- 172.21.15.53:0/1032931685 learned_addr learned my addr 172.21.15.53:0/1032931685 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:57:13.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.718+0000 7f85c8f53640 1 --2- 172.21.15.53:0/1032931685 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85c40cec40 0x7f85c40afaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:13.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.718+0000 7f85c9754640 1 -- 172.21.15.53:0/1032931685 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85c4159450 msgr2=0x7f85c4151900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:13.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.718+0000 7f85c9754640 1 --2- 172.21.15.53:0/1032931685 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85c4159450 0x7f85c4151900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:13.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.718+0000 7f85c9754640 1 -- 172.21.15.53:0/1032931685 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85c40cec40 msgr2=0x7f85c40afaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:13.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.718+0000 7f85c9754640 1 --2- 172.21.15.53:0/1032931685 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85c40cec40 0x7f85c40afaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:13.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.718+0000 7f85c9754640 1 -- 172.21.15.53:0/1032931685 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85bc009a70 con 0x7f85c40cbf50 2023-06-10T18:57:13.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.718+0000 7f85c8f53640 1 --2- 172.21.15.53:0/1032931685 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85c40cec40 0x7f85c40afaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:57:13.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.718+0000 7f85c9754640 1 --2- 172.21.15.53:0/1032931685 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85c40cbf50 0x7f85c40b0bb0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f85c000c780 tx=0x7f85c000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:13.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.718+0000 7f85b9ffb640 1 -- 172.21.15.53:0/1032931685 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c0005cf0 con 0x7f85c40cbf50 2023-06-10T18:57:13.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.718+0000 7f85b9ffb640 1 -- 172.21.15.53:0/1032931685 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85c0005e50 con 0x7f85c40cbf50 2023-06-10T18:57:13.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.718+0000 7f85cb9b8640 1 -- 172.21.15.53:0/1032931685 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85c415d9d0 con 0x7f85c40cbf50 2023-06-10T18:57:13.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.718+0000 7f85b9ffb640 1 -- 172.21.15.53:0/1032931685 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c00072b0 con 0x7f85c40cbf50 2023-06-10T18:57:13.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.718+0000 7f85cb9b8640 1 -- 172.21.15.53:0/1032931685 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85c415ae50 con 0x7f85c40cbf50 2023-06-10T18:57:13.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.718+0000 7f85cb9b8640 1 -- 172.21.15.53:0/1032931685 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85c415b070 con 0x7f85c40cbf50 2023-06-10T18:57:13.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.718+0000 7f85b9ffb640 1 -- 172.21.15.53:0/1032931685 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f85c0007410 con 0x7f85c40cbf50 2023-06-10T18:57:13.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.718+0000 7f85b9ffb640 1 --2- 172.21.15.53:0/1032931685 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f85a8066280 0x7f85a8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:13.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.718+0000 7f85b9ffb640 1 -- 172.21.15.53:0/1032931685 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f85c0083ba0 con 0x7f85c40cbf50 2023-06-10T18:57:13.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.718+0000 7f85c8f53640 1 --2- 172.21.15.53:0/1032931685 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f85a8066280 0x7f85a8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:13.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.718+0000 7f85c8f53640 1 --2- 172.21.15.53:0/1032931685 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f85a8066280 0x7f85a8068730 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f85c415a200 tx=0x7f85b4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:13.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.722+0000 7f85b9ffb640 1 -- 172.21.15.53:0/1032931685 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f85c0051020 con 0x7f85c40cbf50 2023-06-10T18:57:13.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.878+0000 7f85cb9b8640 1 -- 172.21.15.53:0/1032931685 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f85c404d790 con 0x7f85c40cbf50 2023-06-10T18:57:13.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.878+0000 7f85b9ffb640 1 -- 172.21.15.53:0/1032931685 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+18294 (secure 0 0 0) 0x7f85c0054640 con 0x7f85c40cbf50 2023-06-10T18:57:13.884 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:57:13.885 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":64,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T18:57:13.234270+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-06-10T18:57:11.323255+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-06-10T18:57:12.231973+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T18:57:13.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.882+0000 7f85cb9b8640 1 -- 172.21.15.53:0/1032931685 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f85a8066280 msgr2=0x7f85a8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:13.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.882+0000 7f85cb9b8640 1 --2- 172.21.15.53:0/1032931685 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f85a8066280 0x7f85a8068730 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f85c415a200 tx=0x7f85b4008040 comp rx=0 tx=0).stop 2023-06-10T18:57:13.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.882+0000 7f85cb9b8640 1 -- 172.21.15.53:0/1032931685 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85c40cbf50 msgr2=0x7f85c40b0bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:13.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.882+0000 7f85cb9b8640 1 --2- 172.21.15.53:0/1032931685 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85c40cbf50 0x7f85c40b0bb0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f85c000c780 tx=0x7f85c000cc40 comp rx=0 tx=0).stop 2023-06-10T18:57:13.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.882+0000 7f85cb9b8640 1 -- 172.21.15.53:0/1032931685 shutdown_connections 2023-06-10T18:57:13.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.882+0000 7f85cb9b8640 1 --2- 172.21.15.53:0/1032931685 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f85a8066280 0x7f85a8068730 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:13.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.882+0000 7f85cb9b8640 1 --2- 172.21.15.53:0/1032931685 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85c4159450 0x7f85c4151900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:13.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.882+0000 7f85cb9b8640 1 --2- 172.21.15.53:0/1032931685 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85c40cec40 0x7f85c40afaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:13.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.882+0000 7f85cb9b8640 1 --2- 172.21.15.53:0/1032931685 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85c40cbf50 0x7f85c40b0bb0 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:13.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.882+0000 7f85cb9b8640 1 -- 172.21.15.53:0/1032931685 >> 172.21.15.53:0/1032931685 conn(0x7f85c406a090 msgr2=0x7f85c40b1340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:13.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.882+0000 7f85cb9b8640 1 -- 172.21.15.53:0/1032931685 shutdown_connections 2023-06-10T18:57:13.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:13.882+0000 7f85cb9b8640 1 -- 172.21.15.53:0/1032931685 wait complete. 2023-06-10T18:57:13.904 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-06-10T18:57:14.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.022+0000 7fdd74c2e640 1 Processor -- start 2023-06-10T18:57:14.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.022+0000 7fdd74c2e640 1 -- start start 2023-06-10T18:57:14.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.022+0000 7fdd74c2e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd70156180 0x7fdd700cd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:14.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.022+0000 7fdd74c2e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fdd7015c070 0x7fdd7015c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:14.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.022+0000 7fdd74c2e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd7015ca00 con 0x7fdd70158a80 2023-06-10T18:57:14.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.022+0000 7fdd74c2e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd7006b090 con 0x7fdd7015c070 2023-06-10T18:57:14.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.022+0000 7fdd74c2e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd7006efa0 con 0x7fdd70156180 2023-06-10T18:57:14.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.022+0000 7fdd6e59c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd70156180 0x7fdd700cd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:14.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.022+0000 7fdd67fff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fdd7015c070 0x7fdd7015c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:14.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.022+0000 7fdd6e59c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd70156180 0x7fdd700cd4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.53:42204/0 (socket says 172.21.15.53:42204) 2023-06-10T18:57:14.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.022+0000 7fdd6ed9d640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fdd70158a80 0x7fdd70158ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.53:57628/0 (socket says 172.21.15.53:57628) 2023-06-10T18:57:14.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.022+0000 7fdd6e59c640 1 -- 172.21.15.53:0/311552175 learned_addr learned my addr 172.21.15.53:0/311552175 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:57:14.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.022+0000 7fdd6e59c640 1 -- 172.21.15.53:0/311552175 >> v2:172.21.15.117:3300/0 conn(0x7fdd7015c070 msgr2=0x7fdd7015c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:14.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.022+0000 7fdd6e59c640 1 --2- 172.21.15.53:0/311552175 >> v2:172.21.15.117:3300/0 conn(0x7fdd7015c070 0x7fdd7015c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:14.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.022+0000 7fdd6e59c640 1 -- 172.21.15.53:0/311552175 >> v1:172.21.15.117:6789/0 conn(0x7fdd70158a80 legacy=0x7fdd70158ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:14.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.022+0000 7fdd6e59c640 1 -- 172.21.15.53:0/311552175 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd700cc720 con 0x7fdd70156180 2023-06-10T18:57:14.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.022+0000 7fdd67fff640 1 --2- 172.21.15.53:0/311552175 >> v2:172.21.15.117:3300/0 conn(0x7fdd7015c070 0x7fdd7015c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-10T18:57:14.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.026+0000 7fdd6e59c640 1 --2- 172.21.15.53:0/311552175 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd70156180 0x7fdd700cd4a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdd60009870 tx=0x7fdd6001c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e58837ed0e0c2f6 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:14.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.026+0000 7fdd6dd9b640 1 -- 172.21.15.53:0/311552175 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd600ab600 con 0x7fdd70156180 2023-06-10T18:57:14.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.026+0000 7fdd6dd9b640 1 -- 172.21.15.53:0/311552175 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd600a7050 con 0x7fdd70156180 2023-06-10T18:57:14.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.026+0000 7fdd6dd9b640 1 -- 172.21.15.53:0/311552175 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd600ab980 con 0x7fdd70156180 2023-06-10T18:57:14.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.026+0000 7fdd74c2e640 1 -- 172.21.15.53:0/311552175 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd70156180 msgr2=0x7fdd700cd4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:14.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.026+0000 7fdd74c2e640 1 --2- 172.21.15.53:0/311552175 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd70156180 0x7fdd700cd4a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdd60009870 tx=0x7fdd6001c540 comp rx=0 tx=0).stop 2023-06-10T18:57:14.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.026+0000 7fdd74c2e640 1 -- 172.21.15.53:0/311552175 shutdown_connections 2023-06-10T18:57:14.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.026+0000 7fdd74c2e640 1 --2- 172.21.15.53:0/311552175 >> v2:172.21.15.117:3300/0 conn(0x7fdd7015c070 0x7fdd7015c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:14.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.026+0000 7fdd74c2e640 1 --2- 172.21.15.53:0/311552175 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd70156180 0x7fdd700cd4a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:14.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.026+0000 7fdd74c2e640 1 -- 172.21.15.53:0/311552175 >> 172.21.15.53:0/311552175 conn(0x7fdd7006a0e0 msgr2=0x7fdd700cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:14.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.026+0000 7fdd74c2e640 1 -- 172.21.15.53:0/311552175 shutdown_connections 2023-06-10T18:57:14.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.026+0000 7fdd74c2e640 1 -- 172.21.15.53:0/311552175 wait complete. 2023-06-10T18:57:14.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.026+0000 7fdd74c2e640 1 Processor -- start 2023-06-10T18:57:14.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.026+0000 7fdd74c2e640 1 -- start start 2023-06-10T18:57:14.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.026+0000 7fdd74c2e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd70156180 0x7fdd7006fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:14.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.026+0000 7fdd74c2e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd70158a80 0x7fdd700c25e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:14.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.026+0000 7fdd74c2e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd7015c070 0x7fdd7014e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:14.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.026+0000 7fdd74c2e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd700c2b20 con 0x7fdd7015c070 2023-06-10T18:57:14.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.026+0000 7fdd74c2e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd700c2150 con 0x7fdd70158a80 2023-06-10T18:57:14.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.026+0000 7fdd74c2e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd7014f0f0 con 0x7fdd70156180 2023-06-10T18:57:14.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.030+0000 7fdd6ed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd7015c070 0x7fdd7014e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:14.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.030+0000 7fdd6ed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd7015c070 0x7fdd7014e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52876/0 (socket says 172.21.15.53:52876) 2023-06-10T18:57:14.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.030+0000 7fdd6ed9d640 1 -- 172.21.15.53:0/2753505953 learned_addr learned my addr 172.21.15.53:0/2753505953 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:57:14.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.030+0000 7fdd67fff640 1 --2- 172.21.15.53:0/2753505953 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd70158a80 0x7fdd700c25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:14.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.030+0000 7fdd6e59c640 1 --2- 172.21.15.53:0/2753505953 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd70156180 0x7fdd7006fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:14.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.030+0000 7fdd6ed9d640 1 -- 172.21.15.53:0/2753505953 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd70156180 msgr2=0x7fdd7006fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:14.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.030+0000 7fdd6ed9d640 1 --2- 172.21.15.53:0/2753505953 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd70156180 0x7fdd7006fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:14.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.030+0000 7fdd6ed9d640 1 -- 172.21.15.53:0/2753505953 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd70158a80 msgr2=0x7fdd700c25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:14.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.030+0000 7fdd6ed9d640 1 --2- 172.21.15.53:0/2753505953 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd70158a80 0x7fdd700c25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:14.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.030+0000 7fdd6ed9d640 1 -- 172.21.15.53:0/2753505953 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd58009420 con 0x7fdd7015c070 2023-06-10T18:57:14.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.030+0000 7fdd6ed9d640 1 --2- 172.21.15.53:0/2753505953 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd7015c070 0x7fdd7014e590 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fdd6800c7a0 tx=0x7fdd6800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:14.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.030+0000 7fdd66ffd640 1 -- 172.21.15.53:0/2753505953 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd6800a640 con 0x7fdd7015c070 2023-06-10T18:57:14.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.030+0000 7fdd66ffd640 1 -- 172.21.15.53:0/2753505953 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd6800a7a0 con 0x7fdd7015c070 2023-06-10T18:57:14.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.030+0000 7fdd74c2e640 1 -- 172.21.15.53:0/2753505953 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd600094d0 con 0x7fdd7015c070 2023-06-10T18:57:14.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.030+0000 7fdd66ffd640 1 -- 172.21.15.53:0/2753505953 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd6800ab10 con 0x7fdd7015c070 2023-06-10T18:57:14.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.030+0000 7fdd74c2e640 1 -- 172.21.15.53:0/2753505953 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd700c1b00 con 0x7fdd7015c070 2023-06-10T18:57:14.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.030+0000 7fdd74c2e640 1 -- 172.21.15.53:0/2753505953 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd700c22e0 con 0x7fdd7015c070 2023-06-10T18:57:14.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.030+0000 7fdd66ffd640 1 -- 172.21.15.53:0/2753505953 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdd6800ac70 con 0x7fdd7015c070 2023-06-10T18:57:14.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.030+0000 7fdd66ffd640 1 --2- 172.21.15.53:0/2753505953 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdd500662b0 0x7fdd50068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:14.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.030+0000 7fdd66ffd640 1 -- 172.21.15.53:0/2753505953 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdd68083370 con 0x7fdd7015c070 2023-06-10T18:57:14.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.030+0000 7fdd6e59c640 1 --2- 172.21.15.53:0/2753505953 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdd500662b0 0x7fdd50068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:14.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.030+0000 7fdd6e59c640 1 --2- 172.21.15.53:0/2753505953 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdd500662b0 0x7fdd50068760 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fdd700c8b20 tx=0x7fdd60008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:14.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.034+0000 7fdd66ffd640 1 -- 172.21.15.53:0/2753505953 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdd680508a0 con 0x7fdd7015c070 2023-06-10T18:57:14.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.226+0000 7fdd74c2e640 1 -- 172.21.15.53:0/2753505953 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fdd7015ca00 con 0x7fdd7015c070 2023-06-10T18:57:14.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.254+0000 7fdd66ffd640 1 -- 172.21.15.53:0/2753505953 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v25) v1 ==== 118+0+0 (secure 0 0 0) 0x7fdd7015ca00 con 0x7fdd7015c070 2023-06-10T18:57:14.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.254+0000 7fdd74c2e640 1 -- 172.21.15.53:0/2753505953 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdd500662b0 msgr2=0x7fdd50068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:14.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.254+0000 7fdd74c2e640 1 --2- 172.21.15.53:0/2753505953 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdd500662b0 0x7fdd50068760 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fdd700c8b20 tx=0x7fdd60008040 comp rx=0 tx=0).stop 2023-06-10T18:57:14.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.254+0000 7fdd74c2e640 1 -- 172.21.15.53:0/2753505953 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd7015c070 msgr2=0x7fdd7014e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:14.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.254+0000 7fdd74c2e640 1 --2- 172.21.15.53:0/2753505953 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd7015c070 0x7fdd7014e590 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fdd6800c7a0 tx=0x7fdd6800cc60 comp rx=0 tx=0).stop 2023-06-10T18:57:14.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.254+0000 7fdd74c2e640 1 -- 172.21.15.53:0/2753505953 shutdown_connections 2023-06-10T18:57:14.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.254+0000 7fdd74c2e640 1 --2- 172.21.15.53:0/2753505953 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdd500662b0 0x7fdd50068760 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:14.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.254+0000 7fdd74c2e640 1 --2- 172.21.15.53:0/2753505953 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd7015c070 0x7fdd7014e590 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:14.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.254+0000 7fdd74c2e640 1 --2- 172.21.15.53:0/2753505953 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd70158a80 0x7fdd700c25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:14.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.254+0000 7fdd74c2e640 1 --2- 172.21.15.53:0/2753505953 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd70156180 0x7fdd7006fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:14.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.254+0000 7fdd74c2e640 1 -- 172.21.15.53:0/2753505953 >> 172.21.15.53:0/2753505953 conn(0x7fdd7006a0e0 msgr2=0x7fdd7006c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:14.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.254+0000 7fdd74c2e640 1 -- 172.21.15.53:0/2753505953 shutdown_connections 2023-06-10T18:57:14.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.254+0000 7fdd74c2e640 1 -- 172.21.15.53:0/2753505953 wait complete. 2023-06-10T18:57:14.278 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-06-10T18:57:14.278 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-06-10T18:57:14.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.394+0000 7faf6749c640 1 Processor -- start 2023-06-10T18:57:14.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.394+0000 7faf6749c640 1 -- start start 2023-06-10T18:57:14.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.394+0000 7faf6749c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf600b7e30 0x7faf600b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:14.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.394+0000 7faf6749c640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf600cc7c0 con 0x7faf6015c090 2023-06-10T18:57:14.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.394+0000 7faf6749c640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf600ccaa0 con 0x7faf600b0b90 2023-06-10T18:57:14.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.394+0000 7faf6749c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf600ccd80 con 0x7faf600b7e30 2023-06-10T18:57:14.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.394+0000 7faf65238640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7faf6015c090 0x7faf600b7720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:48214/0 (socket says 172.21.15.53:48214) 2023-06-10T18:57:14.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.394+0000 7faf65238640 1 -- 172.21.15.53:0/2913125786 learned_addr learned my addr 172.21.15.53:0/2913125786 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:57:14.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.394+0000 7faf64a37640 1 --2- 172.21.15.53:0/2913125786 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf600b7e30 0x7faf600b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:14.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.394+0000 7faf57fff640 1 -- 172.21.15.53:0/2913125786 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 777081537 0 0) 0x7faf600cc7c0 con 0x7faf6015c090 2023-06-10T18:57:14.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.394+0000 7faf57fff640 1 -- 172.21.15.53:0/2913125786 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf4c003530 con 0x7faf6015c090 2023-06-10T18:57:14.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.394+0000 7faf57fff640 1 -- 172.21.15.53:0/2913125786 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 203540904 0 0) 0x7faf600ccaa0 con 0x7faf600b0b90 2023-06-10T18:57:14.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.394+0000 7faf57fff640 1 -- 172.21.15.53:0/2913125786 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf600cc7c0 con 0x7faf600b0b90 2023-06-10T18:57:14.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.394+0000 7faf57fff640 1 -- 172.21.15.53:0/2913125786 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 347005158 0 0) 0x7faf4c003530 con 0x7faf6015c090 2023-06-10T18:57:14.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.394+0000 7faf57fff640 1 -- 172.21.15.53:0/2913125786 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf600b7e30 msgr2=0x7faf600b10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:14.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.394+0000 7faf57fff640 1 --2- 172.21.15.53:0/2913125786 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf600b7e30 0x7faf600b10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:14.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.394+0000 7faf57fff640 1 -- 172.21.15.53:0/2913125786 >> v1:172.21.15.117:6789/0 conn(0x7faf600b0b90 legacy=0x7faf600d04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:14.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.394+0000 7faf57fff640 1 -- 172.21.15.53:0/2913125786 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf600cd060 con 0x7faf6015c090 2023-06-10T18:57:14.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.394+0000 7faf57fff640 1 -- 172.21.15.53:0/2913125786 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7faf5c001680 con 0x7faf6015c090 2023-06-10T18:57:14.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.394+0000 7faf57fff640 1 -- 172.21.15.53:0/2913125786 >> v1:172.21.15.53:6789/0 conn(0x7faf6015c090 legacy=0x7faf600b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:14.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.394+0000 7faf57fff640 1 --2- 172.21.15.53:0/2913125786 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf4c003b40 0x7faf4c003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:14.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.394+0000 7faf57fff640 1 --2- 172.21.15.53:0/2913125786 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf600b7e30 0x7faf4c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:14.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.394+0000 7faf57fff640 1 --2- 172.21.15.53:0/2913125786 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf4c004d10 0x7faf4c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:14.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.394+0000 7faf57fff640 1 -- 172.21.15.53:0/2913125786 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf600ccd80 con 0x7faf4c003b40 2023-06-10T18:57:14.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.394+0000 7faf57fff640 1 -- 172.21.15.53:0/2913125786 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf4c00ba90 con 0x7faf4c004d10 2023-06-10T18:57:14.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.394+0000 7faf57fff640 1 -- 172.21.15.53:0/2913125786 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf4c00bc50 con 0x7faf600b7e30 2023-06-10T18:57:14.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.394+0000 7faf65238640 1 --2- 172.21.15.53:0/2913125786 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf4c003b40 0x7faf4c003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:14.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.394+0000 7faf65a39640 1 --2- 172.21.15.53:0/2913125786 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf4c004d10 0x7faf4c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:14.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.394+0000 7faf64a37640 1 --2- 172.21.15.53:0/2913125786 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf600b7e30 0x7faf4c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:14.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.394+0000 7faf65238640 1 -- 172.21.15.53:0/2913125786 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf600b7e30 msgr2=0x7faf4c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:14.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.394+0000 7faf65238640 1 --2- 172.21.15.53:0/2913125786 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf600b7e30 0x7faf4c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:14.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.394+0000 7faf65238640 1 -- 172.21.15.53:0/2913125786 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf4c004d10 msgr2=0x7faf4c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:14.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.394+0000 7faf65238640 1 --2- 172.21.15.53:0/2913125786 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf4c004d10 0x7faf4c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:14.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.394+0000 7faf65238640 1 -- 172.21.15.53:0/2913125786 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf4c003530 con 0x7faf4c003b40 2023-06-10T18:57:14.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.402+0000 7faf65238640 1 --2- 172.21.15.53:0/2913125786 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf4c003b40 0x7faf4c003f30 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7faf5c00c160 tx=0x7faf5c01cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=581cd64139fad46a server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:14.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.402+0000 7faf57fff640 1 -- 172.21.15.53:0/2913125786 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c0058e0 con 0x7faf4c003b40 2023-06-10T18:57:14.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.402+0000 7faf57fff640 1 -- 172.21.15.53:0/2913125786 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf5c005a40 con 0x7faf4c003b40 2023-06-10T18:57:14.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.402+0000 7faf57fff640 1 -- 172.21.15.53:0/2913125786 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c005df0 con 0x7faf4c003b40 2023-06-10T18:57:14.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.402+0000 7faf6749c640 1 -- 172.21.15.53:0/2913125786 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf4c003b40 msgr2=0x7faf4c003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:14.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.402+0000 7faf6749c640 1 --2- 172.21.15.53:0/2913125786 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf4c003b40 0x7faf4c003f30 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7faf5c00c160 tx=0x7faf5c01cb90 comp rx=0 tx=0).stop 2023-06-10T18:57:14.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.402+0000 7faf65a39640 1 -- 172.21.15.53:0/2913125786 reap_dead start 2023-06-10T18:57:14.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.402+0000 7faf6749c640 1 -- 172.21.15.53:0/2913125786 shutdown_connections 2023-06-10T18:57:14.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.402+0000 7faf6749c640 1 -- 172.21.15.53:0/2913125786 >> 172.21.15.53:0/2913125786 conn(0x7faf60069e20 msgr2=0x7faf6006a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:14.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.402+0000 7faf6749c640 1 -- 172.21.15.53:0/2913125786 shutdown_connections 2023-06-10T18:57:14.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.402+0000 7faf6749c640 1 -- 172.21.15.53:0/2913125786 wait complete. 2023-06-10T18:57:14.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.402+0000 7faf6749c640 1 Processor -- start 2023-06-10T18:57:14.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.402+0000 7faf6749c640 1 -- start start 2023-06-10T18:57:14.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.406+0000 7faf6749c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf6014b1c0 0x7faf600b6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:14.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.406+0000 7faf6749c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf6014b590 0x7faf6014ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:14.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.406+0000 7faf6749c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf600b5170 0x7faf600c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:14.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.406+0000 7faf6749c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf600b6360 con 0x7faf6014b1c0 2023-06-10T18:57:14.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.406+0000 7faf6749c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf600b56e0 con 0x7faf6014b590 2023-06-10T18:57:14.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.406+0000 7faf6749c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf600b59c0 con 0x7faf600b5170 2023-06-10T18:57:14.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.406+0000 7faf65238640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf6014b1c0 0x7faf600b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:14.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.406+0000 7faf65238640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf6014b1c0 0x7faf600b6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52890/0 (socket says 172.21.15.53:52890) 2023-06-10T18:57:14.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.406+0000 7faf65238640 1 -- 172.21.15.53:0/1698894894 learned_addr learned my addr 172.21.15.53:0/1698894894 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:57:14.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.406+0000 7faf65a39640 1 --2- 172.21.15.53:0/1698894894 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf600b5170 0x7faf600c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:14.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.406+0000 7faf64a37640 1 --2- 172.21.15.53:0/1698894894 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf6014b590 0x7faf6014ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:14.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.406+0000 7faf65238640 1 -- 172.21.15.53:0/1698894894 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf600b5170 msgr2=0x7faf600c9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:14.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.406+0000 7faf65238640 1 --2- 172.21.15.53:0/1698894894 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf600b5170 0x7faf600c9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:14.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.406+0000 7faf65238640 1 -- 172.21.15.53:0/1698894894 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf6014b590 msgr2=0x7faf6014ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:14.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.406+0000 7faf65238640 1 --2- 172.21.15.53:0/1698894894 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf6014b590 0x7faf6014ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:14.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.406+0000 7faf65238640 1 -- 172.21.15.53:0/1698894894 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf600b5ca0 con 0x7faf6014b1c0 2023-06-10T18:57:14.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.406+0000 7faf65a39640 1 --2- 172.21.15.53:0/1698894894 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf600b5170 0x7faf600c9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:57:14.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.406+0000 7faf64a37640 1 --2- 172.21.15.53:0/1698894894 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf6014b590 0x7faf6014ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:57:14.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.406+0000 7faf65238640 1 --2- 172.21.15.53:0/1698894894 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf6014b1c0 0x7faf600b6780 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7faf5c0ab040 tx=0x7faf4c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:14.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.406+0000 7faf55ffb640 1 -- 172.21.15.53:0/1698894894 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c001680 con 0x7faf6014b1c0 2023-06-10T18:57:14.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.406+0000 7faf55ffb640 1 -- 172.21.15.53:0/1698894894 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf5c0048b0 con 0x7faf6014b1c0 2023-06-10T18:57:14.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.406+0000 7faf55ffb640 1 -- 172.21.15.53:0/1698894894 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c004c80 con 0x7faf6014b1c0 2023-06-10T18:57:14.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.406+0000 7faf6749c640 1 -- 172.21.15.53:0/1698894894 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf600b5f80 con 0x7faf6014b1c0 2023-06-10T18:57:14.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.406+0000 7faf6749c640 1 -- 172.21.15.53:0/1698894894 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf600ca3c0 con 0x7faf6014b1c0 2023-06-10T18:57:14.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.406+0000 7faf6749c640 1 -- 172.21.15.53:0/1698894894 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf6004d790 con 0x7faf6014b1c0 2023-06-10T18:57:14.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.406+0000 7faf55ffb640 1 -- 172.21.15.53:0/1698894894 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7faf5c007070 con 0x7faf6014b1c0 2023-06-10T18:57:14.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.406+0000 7faf55ffb640 1 --2- 172.21.15.53:0/1698894894 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7faf440662b0 0x7faf44068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:14.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.406+0000 7faf55ffb640 1 -- 172.21.15.53:0/1698894894 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6062+0+0 (secure 0 0 0) 0x7faf5c11d5b0 con 0x7faf6014b1c0 2023-06-10T18:57:14.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.406+0000 7faf64a37640 1 --2- 172.21.15.53:0/1698894894 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7faf440662b0 0x7faf44068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:14.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.410+0000 7faf64a37640 1 --2- 172.21.15.53:0/1698894894 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7faf440662b0 0x7faf44068760 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7faf600cb860 tx=0x7faf50008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:14.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.410+0000 7faf55ffb640 1 -- 172.21.15.53:0/1698894894 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7faf5c0eaac0 con 0x7faf6014b1c0 2023-06-10T18:57:14.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:14.602+0000 7faf6749c640 1 -- 172.21.15.53:0/1698894894 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7faf60159610 con 0x7faf6014b1c0 2023-06-10T18:57:15.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.254+0000 7faf55ffb640 1 -- 172.21.15.53:0/1698894894 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v26) v1 ==== 122+0+0 (secure 0 0 0) 0x7faf5c0ee0e0 con 0x7faf6014b1c0 2023-06-10T18:57:15.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.258+0000 7faf6749c640 1 -- 172.21.15.53:0/1698894894 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7faf440662b0 msgr2=0x7faf44068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:15.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.258+0000 7faf6749c640 1 --2- 172.21.15.53:0/1698894894 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7faf440662b0 0x7faf44068760 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7faf600cb860 tx=0x7faf50008040 comp rx=0 tx=0).stop 2023-06-10T18:57:15.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.258+0000 7faf6749c640 1 -- 172.21.15.53:0/1698894894 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf6014b1c0 msgr2=0x7faf600b6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:15.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.258+0000 7faf6749c640 1 --2- 172.21.15.53:0/1698894894 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf6014b1c0 0x7faf600b6780 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7faf5c0ab040 tx=0x7faf4c005800 comp rx=0 tx=0).stop 2023-06-10T18:57:15.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.258+0000 7faf6749c640 1 -- 172.21.15.53:0/1698894894 shutdown_connections 2023-06-10T18:57:15.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.258+0000 7faf6749c640 1 --2- 172.21.15.53:0/1698894894 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7faf440662b0 0x7faf44068760 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:15.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.258+0000 7faf6749c640 1 --2- 172.21.15.53:0/1698894894 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf600b5170 0x7faf600c9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:15.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.258+0000 7faf6749c640 1 --2- 172.21.15.53:0/1698894894 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf6014b590 0x7faf6014ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:15.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.258+0000 7faf6749c640 1 --2- 172.21.15.53:0/1698894894 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf6014b1c0 0x7faf600b6780 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:15.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.258+0000 7faf6749c640 1 -- 172.21.15.53:0/1698894894 >> 172.21.15.53:0/1698894894 conn(0x7faf60069e20 msgr2=0x7faf6006a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:15.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.258+0000 7faf6749c640 1 -- 172.21.15.53:0/1698894894 shutdown_connections 2023-06-10T18:57:15.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.258+0000 7faf6749c640 1 -- 172.21.15.53:0/1698894894 wait complete. 2023-06-10T18:57:15.289 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-06-10T18:57:15.289 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T18:57:15.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.406+0000 7fdf26d7d640 1 Processor -- start 2023-06-10T18:57:15.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.406+0000 7fdf26d7d640 1 -- start start 2023-06-10T18:57:15.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.410+0000 7fdf26d7d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fdf2015c7f0 0x7fdf2015f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:15.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.410+0000 7fdf26d7d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdf2015f860 0x7fdf200ceb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:15.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.410+0000 7fdf26d7d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf2015cc40 con 0x7fdf2006b780 2023-06-10T18:57:15.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.410+0000 7fdf26d7d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf2015c3d0 con 0x7fdf2015c7f0 2023-06-10T18:57:15.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.410+0000 7fdf26d7d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf200af530 con 0x7fdf2015f860 2023-06-10T18:57:15.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.410+0000 7fdf2531a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdf2015f860 0x7fdf200ceb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:15.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.410+0000 7fdf1ffff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fdf2015c7f0 0x7fdf2015f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:15.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.410+0000 7fdf2531a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdf2015f860 0x7fdf200ceb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.53:42262/0 (socket says 172.21.15.53:42262) 2023-06-10T18:57:15.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.410+0000 7fdf2531a640 1 -- 172.21.15.53:0/2014169391 learned_addr learned my addr 172.21.15.53:0/2014169391 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:57:15.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.410+0000 7fdf1ffff640 1 -- 172.21.15.53:0/2014169391 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdf2015f860 msgr2=0x7fdf200ceb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:15.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.410+0000 7fdf1ffff640 1 --2- 172.21.15.53:0/2014169391 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdf2015f860 0x7fdf200ceb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:15.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.410+0000 7fdf1ffff640 1 -- 172.21.15.53:0/2014169391 >> v1:172.21.15.117:6789/0 conn(0x7fdf2006b780 legacy=0x7fdf2006bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:15.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.410+0000 7fdf1ffff640 1 -- 172.21.15.53:0/2014169391 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf2015fd70 con 0x7fdf2015c7f0 2023-06-10T18:57:15.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.410+0000 7fdf2531a640 1 --2- 172.21.15.53:0/2014169391 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdf2015f860 0x7fdf200ceb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-10T18:57:15.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.414+0000 7fdf1ffff640 1 --2- 172.21.15.53:0/2014169391 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf2015c7f0 0x7fdf2015f320 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fdf140097c0 tx=0x7fdf1401c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69b47192e448c22a server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:15.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.414+0000 7fdf1f7fe640 1 -- 172.21.15.53:0/2014169391 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf140ab5f0 con 0x7fdf2015c7f0 2023-06-10T18:57:15.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.414+0000 7fdf1f7fe640 1 -- 172.21.15.53:0/2014169391 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf140ab750 con 0x7fdf2015c7f0 2023-06-10T18:57:15.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.414+0000 7fdf1f7fe640 1 -- 172.21.15.53:0/2014169391 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf140abae0 con 0x7fdf2015c7f0 2023-06-10T18:57:15.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.414+0000 7fdf26d7d640 1 -- 172.21.15.53:0/2014169391 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf2015c7f0 msgr2=0x7fdf2015f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:15.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.414+0000 7fdf26d7d640 1 --2- 172.21.15.53:0/2014169391 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf2015c7f0 0x7fdf2015f320 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fdf140097c0 tx=0x7fdf1401c3f0 comp rx=0 tx=0).stop 2023-06-10T18:57:15.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.414+0000 7fdf26d7d640 1 -- 172.21.15.53:0/2014169391 shutdown_connections 2023-06-10T18:57:15.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.414+0000 7fdf26d7d640 1 --2- 172.21.15.53:0/2014169391 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdf2015f860 0x7fdf200ceb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:15.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.414+0000 7fdf26d7d640 1 --2- 172.21.15.53:0/2014169391 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf2015c7f0 0x7fdf2015f320 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:15.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.414+0000 7fdf26d7d640 1 -- 172.21.15.53:0/2014169391 >> 172.21.15.53:0/2014169391 conn(0x7fdf2006a090 msgr2=0x7fdf2006d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:15.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.414+0000 7fdf26d7d640 1 -- 172.21.15.53:0/2014169391 shutdown_connections 2023-06-10T18:57:15.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.414+0000 7fdf26d7d640 1 -- 172.21.15.53:0/2014169391 wait complete. 2023-06-10T18:57:15.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.414+0000 7fdf26d7d640 1 Processor -- start 2023-06-10T18:57:15.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.414+0000 7fdf26d7d640 1 -- start start 2023-06-10T18:57:15.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.414+0000 7fdf26d7d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf2006b780 0x7fdf20152ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:15.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.414+0000 7fdf26d7d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdf2015c7f0 0x7fdf200ca6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:15.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.414+0000 7fdf26d7d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf2015f860 0x7fdf200b51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:15.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.414+0000 7fdf26d7d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf200cc1d0 con 0x7fdf2015f860 2023-06-10T18:57:15.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.414+0000 7fdf26d7d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf200cac20 con 0x7fdf2006b780 2023-06-10T18:57:15.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.414+0000 7fdf26d7d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf200cb5c0 con 0x7fdf2015c7f0 2023-06-10T18:57:15.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.414+0000 7fdf2531a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf2015f860 0x7fdf200b51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:15.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.414+0000 7fdf1ffff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdf2015c7f0 0x7fdf200ca6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:15.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.414+0000 7fdf2531a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf2015f860 0x7fdf200b51f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52898/0 (socket says 172.21.15.53:52898) 2023-06-10T18:57:15.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.414+0000 7fdf2531a640 1 -- 172.21.15.53:0/2904883103 learned_addr learned my addr 172.21.15.53:0/2904883103 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:57:15.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.414+0000 7fdf24b19640 1 --2- 172.21.15.53:0/2904883103 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf2006b780 0x7fdf20152ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:15.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.418+0000 7fdf2531a640 1 -- 172.21.15.53:0/2904883103 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdf2015c7f0 msgr2=0x7fdf200ca6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:15.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.418+0000 7fdf2531a640 1 --2- 172.21.15.53:0/2904883103 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdf2015c7f0 0x7fdf200ca6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:15.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.418+0000 7fdf2531a640 1 -- 172.21.15.53:0/2904883103 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf2006b780 msgr2=0x7fdf20152ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:15.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.418+0000 7fdf2531a640 1 --2- 172.21.15.53:0/2904883103 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf2006b780 0x7fdf20152ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:15.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.418+0000 7fdf2531a640 1 -- 172.21.15.53:0/2904883103 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf180094d0 con 0x7fdf2015f860 2023-06-10T18:57:15.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.418+0000 7fdf2531a640 1 --2- 172.21.15.53:0/2904883103 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf2015f860 0x7fdf200b51f0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fdf18006e10 tx=0x7fdf18009e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:15.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.418+0000 7fdf1d7fa640 1 -- 172.21.15.53:0/2904883103 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1800ca00 con 0x7fdf2015f860 2023-06-10T18:57:15.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.418+0000 7fdf1d7fa640 1 -- 172.21.15.53:0/2904883103 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf1800cb60 con 0x7fdf2015f860 2023-06-10T18:57:15.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.418+0000 7fdf26d7d640 1 -- 172.21.15.53:0/2904883103 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf14009420 con 0x7fdf2015f860 2023-06-10T18:57:15.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.418+0000 7fdf26d7d640 1 -- 172.21.15.53:0/2904883103 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf200cbb80 con 0x7fdf2015f860 2023-06-10T18:57:15.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.418+0000 7fdf1d7fa640 1 -- 172.21.15.53:0/2904883103 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf18004030 con 0x7fdf2015f860 2023-06-10T18:57:15.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.418+0000 7fdf26d7d640 1 -- 172.21.15.53:0/2904883103 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf00005260 con 0x7fdf2015f860 2023-06-10T18:57:15.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.418+0000 7fdf1d7fa640 1 -- 172.21.15.53:0/2904883103 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdf18004190 con 0x7fdf2015f860 2023-06-10T18:57:15.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.418+0000 7fdf1d7fa640 1 --2- 172.21.15.53:0/2904883103 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdf0c0662b0 0x7fdf0c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:15.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.418+0000 7fdf1d7fa640 1 -- 172.21.15.53:0/2904883103 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdf18083dd0 con 0x7fdf2015f860 2023-06-10T18:57:15.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.418+0000 7fdf24b19640 1 --2- 172.21.15.53:0/2904883103 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdf0c0662b0 0x7fdf0c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:15.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.418+0000 7fdf24b19640 1 --2- 172.21.15.53:0/2904883103 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdf0c0662b0 0x7fdf0c068760 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fdf10001e00 tx=0x7fdf10009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:15.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.422+0000 7fdf1d7fa640 1 -- 172.21.15.53:0/2904883103 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdf18051270 con 0x7fdf2015f860 2023-06-10T18:57:15.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.606+0000 7fdf26d7d640 1 -- 172.21.15.53:0/2904883103 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdf00005510 con 0x7fdf2015f860 2023-06-10T18:57:15.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.606+0000 7fdf1d7fa640 1 -- 172.21.15.53:0/2904883103 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4669 (secure 0 0 0) 0x7fdf18085090 con 0x7fdf2015f860 2023-06-10T18:57:15.613 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:57:15.613 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":26,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5444,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1300171732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":1300171732},{"type":"v1","addr":"172.21.15.117:6837","nonce":1300171732}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5818,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/507478314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":507478314},{"type":"v1","addr":"172.21.15.117:6836","nonce":507478314}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":6504,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/169051241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":169051241},{"type":"v1","addr":"172.21.15.53:6833","nonce":169051241}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T18:57:13.234809+0000","modified":"2023-06-10T18:57:15.250305+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6507},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6507":{"gid":6507,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/486797221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":486797221},{"type":"v1","addr":"172.21.15.53:6835","nonce":486797221}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-06-10T18:57:15.613 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 26 2023-06-10T18:57:15.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.610+0000 7fdf26d7d640 1 -- 172.21.15.53:0/2904883103 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdf0c0662b0 msgr2=0x7fdf0c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:15.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.610+0000 7fdf26d7d640 1 --2- 172.21.15.53:0/2904883103 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdf0c0662b0 0x7fdf0c068760 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fdf10001e00 tx=0x7fdf10009040 comp rx=0 tx=0).stop 2023-06-10T18:57:15.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.610+0000 7fdf26d7d640 1 -- 172.21.15.53:0/2904883103 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf2015f860 msgr2=0x7fdf200b51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:15.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.610+0000 7fdf26d7d640 1 --2- 172.21.15.53:0/2904883103 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf2015f860 0x7fdf200b51f0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fdf18006e10 tx=0x7fdf18009e00 comp rx=0 tx=0).stop 2023-06-10T18:57:15.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.610+0000 7fdf26d7d640 1 -- 172.21.15.53:0/2904883103 shutdown_connections 2023-06-10T18:57:15.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.610+0000 7fdf26d7d640 1 --2- 172.21.15.53:0/2904883103 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdf0c0662b0 0x7fdf0c068760 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:15.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.610+0000 7fdf26d7d640 1 --2- 172.21.15.53:0/2904883103 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf2015f860 0x7fdf200b51f0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:15.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.610+0000 7fdf26d7d640 1 --2- 172.21.15.53:0/2904883103 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdf2015c7f0 0x7fdf200ca6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:15.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.610+0000 7fdf26d7d640 1 --2- 172.21.15.53:0/2904883103 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf2006b780 0x7fdf20152ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:15.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.610+0000 7fdf26d7d640 1 -- 172.21.15.53:0/2904883103 >> 172.21.15.53:0/2904883103 conn(0x7fdf2006a090 msgr2=0x7fdf200b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:15.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.610+0000 7fdf26d7d640 1 -- 172.21.15.53:0/2904883103 shutdown_connections 2023-06-10T18:57:15.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.610+0000 7fdf26d7d640 1 -- 172.21.15.53:0/2904883103 wait complete. 2023-06-10T18:57:15.631 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T18:57:15.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.746+0000 7fa180664640 1 Processor -- start 2023-06-10T18:57:15.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.750+0000 7fa180664640 1 -- start start 2023-06-10T18:57:15.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.750+0000 7fa180664640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa178162640 0x7fa178164a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:15.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.750+0000 7fa180664640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa178159b50 con 0x7fa1780c9840 2023-06-10T18:57:15.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.750+0000 7fa180664640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1780702a0 con 0x7fa178071060 2023-06-10T18:57:15.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.750+0000 7fa180664640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa178070580 con 0x7fa178162640 2023-06-10T18:57:15.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.750+0000 7fa17e400640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fa1780c9840 0x7fa1780c9c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:48228/0 (socket says 172.21.15.53:48228) 2023-06-10T18:57:15.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.750+0000 7fa17e400640 1 -- 172.21.15.53:0/4088420219 learned_addr learned my addr 172.21.15.53:0/4088420219 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:57:15.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.750+0000 7fa17ec01640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa178162640 0x7fa178164a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:15.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.750+0000 7fa17ec01640 1 -- 172.21.15.53:0/4088420219 >> v1:172.21.15.117:6789/0 conn(0x7fa178071060 legacy=0x7fa1780af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:15.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.750+0000 7fa17ec01640 1 -- 172.21.15.53:0/4088420219 >> v1:172.21.15.53:6789/0 conn(0x7fa1780c9840 legacy=0x7fa1780c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:15.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.750+0000 7fa17d3fe640 1 -- 172.21.15.53:0/4088420219 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 594749541 0 0) 0x7fa178159b50 con 0x7fa1780c9840 2023-06-10T18:57:15.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.750+0000 7fa17ec01640 1 -- 172.21.15.53:0/4088420219 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa178070860 con 0x7fa178162640 2023-06-10T18:57:15.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.750+0000 7fa17ec01640 1 --2- 172.21.15.53:0/4088420219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa178162640 0x7fa178164a20 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fa1680097c0 tx=0x7fa16801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca8c0c73b6de1423 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:15.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.750+0000 7fa17d3fe640 1 -- 172.21.15.53:0/4088420219 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1680ab670 con 0x7fa178162640 2023-06-10T18:57:15.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.754+0000 7fa17d3fe640 1 -- 172.21.15.53:0/4088420219 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1680ab7d0 con 0x7fa178162640 2023-06-10T18:57:15.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.754+0000 7fa17d3fe640 1 -- 172.21.15.53:0/4088420219 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1680abb60 con 0x7fa178162640 2023-06-10T18:57:15.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.754+0000 7fa180664640 1 -- 172.21.15.53:0/4088420219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa178162640 msgr2=0x7fa178164a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:15.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.754+0000 7fa180664640 1 --2- 172.21.15.53:0/4088420219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa178162640 0x7fa178164a20 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fa1680097c0 tx=0x7fa16801c450 comp rx=0 tx=0).stop 2023-06-10T18:57:15.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.754+0000 7fa180664640 1 -- 172.21.15.53:0/4088420219 shutdown_connections 2023-06-10T18:57:15.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.754+0000 7fa180664640 1 --2- 172.21.15.53:0/4088420219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa178162640 0x7fa178164a20 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:15.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.754+0000 7fa180664640 1 -- 172.21.15.53:0/4088420219 >> 172.21.15.53:0/4088420219 conn(0x7fa17806a0d0 msgr2=0x7fa1780ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:15.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.754+0000 7fa180664640 1 -- 172.21.15.53:0/4088420219 shutdown_connections 2023-06-10T18:57:15.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.754+0000 7fa180664640 1 -- 172.21.15.53:0/4088420219 wait complete. 2023-06-10T18:57:15.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.754+0000 7fa180664640 1 Processor -- start 2023-06-10T18:57:15.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.754+0000 7fa180664640 1 -- start start 2023-06-10T18:57:15.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.754+0000 7fa180664640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa178071060 0x7fa178153280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:15.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.754+0000 7fa180664640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1780c9840 0x7fa1780c3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:15.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.754+0000 7fa180664640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa178162640 0x7fa1780c4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:15.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.754+0000 7fa180664640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1780c32d0 con 0x7fa178162640 2023-06-10T18:57:15.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.754+0000 7fa180664640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1781537c0 con 0x7fa1780c9840 2023-06-10T18:57:15.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.754+0000 7fa180664640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1780c26c0 con 0x7fa178071060 2023-06-10T18:57:15.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.754+0000 7fa17ec01640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa178162640 0x7fa1780c4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:15.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.754+0000 7fa17ec01640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa178162640 0x7fa1780c4090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52918/0 (socket says 172.21.15.53:52918) 2023-06-10T18:57:15.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.754+0000 7fa17ec01640 1 -- 172.21.15.53:0/1244181892 learned_addr learned my addr 172.21.15.53:0/1244181892 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:57:15.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.754+0000 7fa17e400640 1 --2- 172.21.15.53:0/1244181892 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa178071060 0x7fa178153280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:15.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.754+0000 7fa17dbff640 1 --2- 172.21.15.53:0/1244181892 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1780c9840 0x7fa1780c3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:15.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.754+0000 7fa17ec01640 1 -- 172.21.15.53:0/1244181892 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa178071060 msgr2=0x7fa178153280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:15.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.754+0000 7fa17ec01640 1 --2- 172.21.15.53:0/1244181892 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa178071060 0x7fa178153280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:15.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.754+0000 7fa17ec01640 1 -- 172.21.15.53:0/1244181892 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1780c9840 msgr2=0x7fa1780c3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:15.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.754+0000 7fa17ec01640 1 --2- 172.21.15.53:0/1244181892 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1780c9840 0x7fa1780c3b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:15.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.754+0000 7fa17ec01640 1 -- 172.21.15.53:0/1244181892 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa168009420 con 0x7fa178162640 2023-06-10T18:57:15.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.754+0000 7fa17dbff640 1 --2- 172.21.15.53:0/1244181892 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1780c9840 0x7fa1780c3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:57:15.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.754+0000 7fa17ec01640 1 --2- 172.21.15.53:0/1244181892 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa178162640 0x7fa1780c4090 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fa1680097c0 tx=0x7fa16801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:15.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.754+0000 7fa176ffd640 1 -- 172.21.15.53:0/1244181892 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa168004230 con 0x7fa178162640 2023-06-10T18:57:15.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.754+0000 7fa176ffd640 1 -- 172.21.15.53:0/1244181892 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1680b9070 con 0x7fa178162640 2023-06-10T18:57:15.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.754+0000 7fa176ffd640 1 -- 172.21.15.53:0/1244181892 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa168003620 con 0x7fa178162640 2023-06-10T18:57:15.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.758+0000 7fa180664640 1 -- 172.21.15.53:0/1244181892 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1780c29a0 con 0x7fa178162640 2023-06-10T18:57:15.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.758+0000 7fa180664640 1 -- 172.21.15.53:0/1244181892 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1780c2f60 con 0x7fa178162640 2023-06-10T18:57:15.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.758+0000 7fa180664640 1 -- 172.21.15.53:0/1244181892 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1780c30f0 con 0x7fa178162640 2023-06-10T18:57:15.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.758+0000 7fa176ffd640 1 -- 172.21.15.53:0/1244181892 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa168003990 con 0x7fa178162640 2023-06-10T18:57:15.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.758+0000 7fa176ffd640 1 --2- 172.21.15.53:0/1244181892 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa164066280 0x7fa164068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:15.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.758+0000 7fa176ffd640 1 -- 172.21.15.53:0/1244181892 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa1680bb070 con 0x7fa178162640 2023-06-10T18:57:15.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.758+0000 7fa17e400640 1 --2- 172.21.15.53:0/1244181892 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa164066280 0x7fa164068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:15.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.758+0000 7fa17e400640 1 --2- 172.21.15.53:0/1244181892 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa164066280 0x7fa164068730 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fa170007fd0 tx=0x7fa170007f20 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:15.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.762+0000 7fa176ffd640 1 -- 172.21.15.53:0/1244181892 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa1680ebe40 con 0x7fa178162640 2023-06-10T18:57:15.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.918+0000 7fa180664640 1 -- 172.21.15.53:0/1244181892 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa17804d790 con 0x7fa178162640 2023-06-10T18:57:15.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.922+0000 7fa176ffd640 1 -- 172.21.15.53:0/1244181892 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+18281 (secure 0 0 0) 0x7fa1680ef460 con 0x7fa178162640 2023-06-10T18:57:15.927 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:57:15.928 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":65,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T18:57:14.238576+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-06-10T18:57:11.323255+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-06-10T18:57:12.231973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T18:57:15.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.922+0000 7fa180664640 1 -- 172.21.15.53:0/1244181892 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa164066280 msgr2=0x7fa164068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:15.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.922+0000 7fa180664640 1 --2- 172.21.15.53:0/1244181892 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa164066280 0x7fa164068730 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fa170007fd0 tx=0x7fa170007f20 comp rx=0 tx=0).stop 2023-06-10T18:57:15.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.922+0000 7fa180664640 1 -- 172.21.15.53:0/1244181892 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa178162640 msgr2=0x7fa1780c4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:15.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.922+0000 7fa180664640 1 --2- 172.21.15.53:0/1244181892 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa178162640 0x7fa1780c4090 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fa1680097c0 tx=0x7fa16801ac90 comp rx=0 tx=0).stop 2023-06-10T18:57:15.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.922+0000 7fa180664640 1 -- 172.21.15.53:0/1244181892 shutdown_connections 2023-06-10T18:57:15.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.922+0000 7fa180664640 1 --2- 172.21.15.53:0/1244181892 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa164066280 0x7fa164068730 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:15.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.922+0000 7fa180664640 1 --2- 172.21.15.53:0/1244181892 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa178162640 0x7fa1780c4090 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:15.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.922+0000 7fa180664640 1 --2- 172.21.15.53:0/1244181892 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1780c9840 0x7fa1780c3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:15.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.922+0000 7fa180664640 1 --2- 172.21.15.53:0/1244181892 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa178071060 0x7fa178153280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:15.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.922+0000 7fa180664640 1 -- 172.21.15.53:0/1244181892 >> 172.21.15.53:0/1244181892 conn(0x7fa17806a0d0 msgr2=0x7fa1780c8580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:15.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.922+0000 7fa180664640 1 -- 172.21.15.53:0/1244181892 shutdown_connections 2023-06-10T18:57:15.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:15.922+0000 7fa180664640 1 -- 172.21.15.53:0/1244181892 wait complete. 2023-06-10T18:57:15.947 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-06-10T18:57:15.947 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-10T18:57:16.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.058+0000 7f73abe30640 1 Processor -- start 2023-06-10T18:57:16.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.058+0000 7f73abe30640 1 -- start start 2023-06-10T18:57:16.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.062+0000 7f73abe30640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f73a40cc690 0x7f73a40d04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:16.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.062+0000 7f73abe30640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73a40ccae0 0x7f73a40d09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:16.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.062+0000 7f73abe30640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73a40d0020 con 0x7f73a40b3ac0 2023-06-10T18:57:16.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.062+0000 7f73abe30640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73a40cef40 con 0x7f73a40cc690 2023-06-10T18:57:16.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.062+0000 7f73abe30640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73a40cf220 con 0x7f73a40ccae0 2023-06-10T18:57:16.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.062+0000 7f73a93cb640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f73a40cc690 0x7f73a40d04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:16.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.062+0000 7f73a9bcc640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f73a40b3ac0 0x7f73a40b3e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:48238/0 (socket says 172.21.15.53:48238) 2023-06-10T18:57:16.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.062+0000 7f73a9bcc640 1 -- 172.21.15.53:0/4173075970 learned_addr learned my addr 172.21.15.53:0/4173075970 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:57:16.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.062+0000 7f73aa3cd640 1 --2- 172.21.15.53:0/4173075970 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73a40ccae0 0x7f73a40d09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:16.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.062+0000 7f73a93cb640 1 -- 172.21.15.53:0/4173075970 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73a40ccae0 msgr2=0x7f73a40d09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:16.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.062+0000 7f73a93cb640 1 --2- 172.21.15.53:0/4173075970 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73a40ccae0 0x7f73a40d09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:16.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.062+0000 7f73a93cb640 1 -- 172.21.15.53:0/4173075970 >> v1:172.21.15.53:6789/0 conn(0x7f73a40b3ac0 legacy=0x7f73a40b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:16.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.062+0000 7f73a93cb640 1 -- 172.21.15.53:0/4173075970 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73a40cf500 con 0x7f73a40cc690 2023-06-10T18:57:16.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.062+0000 7f73a8bca640 1 -- 172.21.15.53:0/4173075970 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1161983071 0 0) 0x7f73a40d0020 con 0x7f73a40b3ac0 2023-06-10T18:57:16.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.062+0000 7f73a93cb640 1 --2- 172.21.15.53:0/4173075970 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73a40cc690 0x7f73a40d04b0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f73980097c0 tx=0x7f739801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d52111e587bb07f2 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:16.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.062+0000 7f73a8bca640 1 -- 172.21.15.53:0/4173075970 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73980ad660 con 0x7f73a40cc690 2023-06-10T18:57:16.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.062+0000 7f73a8bca640 1 -- 172.21.15.53:0/4173075970 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73980ad7c0 con 0x7f73a40cc690 2023-06-10T18:57:16.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.062+0000 7f73a8bca640 1 -- 172.21.15.53:0/4173075970 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73980adb50 con 0x7f73a40cc690 2023-06-10T18:57:16.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.066+0000 7f73abe30640 1 -- 172.21.15.53:0/4173075970 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73a40cc690 msgr2=0x7f73a40d04b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:16.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.066+0000 7f73abe30640 1 --2- 172.21.15.53:0/4173075970 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73a40cc690 0x7f73a40d04b0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f73980097c0 tx=0x7f739801c450 comp rx=0 tx=0).stop 2023-06-10T18:57:16.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.066+0000 7f73abe30640 1 -- 172.21.15.53:0/4173075970 shutdown_connections 2023-06-10T18:57:16.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.066+0000 7f73abe30640 1 --2- 172.21.15.53:0/4173075970 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73a40cc690 0x7f73a40d04b0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:16.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.066+0000 7f73abe30640 1 --2- 172.21.15.53:0/4173075970 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73a40ccae0 0x7f73a40d09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:16.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.066+0000 7f73abe30640 1 -- 172.21.15.53:0/4173075970 >> 172.21.15.53:0/4173075970 conn(0x7f73a4071790 msgr2=0x7f73a4069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:16.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.066+0000 7f73abe30640 1 -- 172.21.15.53:0/4173075970 shutdown_connections 2023-06-10T18:57:16.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.066+0000 7f73abe30640 1 -- 172.21.15.53:0/4173075970 wait complete. 2023-06-10T18:57:16.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.066+0000 7f73abe30640 1 Processor -- start 2023-06-10T18:57:16.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.066+0000 7f73abe30640 1 -- start start 2023-06-10T18:57:16.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.066+0000 7f73abe30640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73a40b3ac0 0x7f73a4153f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:16.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.066+0000 7f73abe30640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73a40cc690 0x7f73a40ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:16.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.066+0000 7f73abe30640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73a40ccae0 0x7f73a415c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:16.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.066+0000 7f73abe30640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73a415be00 con 0x7f73a40cc690 2023-06-10T18:57:16.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.066+0000 7f73abe30640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73a4153960 con 0x7f73a40ccae0 2023-06-10T18:57:16.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.066+0000 7f73abe30640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73a4153c40 con 0x7f73a40b3ac0 2023-06-10T18:57:16.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.066+0000 7f73a93cb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73a40cc690 0x7f73a40ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:16.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.066+0000 7f73a93cb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73a40cc690 0x7f73a40ca6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52926/0 (socket says 172.21.15.53:52926) 2023-06-10T18:57:16.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.066+0000 7f73a93cb640 1 -- 172.21.15.53:0/3835127624 learned_addr learned my addr 172.21.15.53:0/3835127624 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:57:16.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.066+0000 7f73a9bcc640 1 --2- 172.21.15.53:0/3835127624 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73a40b3ac0 0x7f73a4153f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:16.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.066+0000 7f73aa3cd640 1 --2- 172.21.15.53:0/3835127624 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73a40ccae0 0x7f73a415c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:16.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.066+0000 7f73a93cb640 1 -- 172.21.15.53:0/3835127624 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73a40b3ac0 msgr2=0x7f73a4153f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:16.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.066+0000 7f73a93cb640 1 --2- 172.21.15.53:0/3835127624 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73a40b3ac0 0x7f73a4153f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:16.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.066+0000 7f73a93cb640 1 -- 172.21.15.53:0/3835127624 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73a40ccae0 msgr2=0x7f73a415c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:16.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.066+0000 7f73a93cb640 1 --2- 172.21.15.53:0/3835127624 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73a40ccae0 0x7f73a415c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:16.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.066+0000 7f73a93cb640 1 -- 172.21.15.53:0/3835127624 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7398009420 con 0x7f73a40cc690 2023-06-10T18:57:16.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.066+0000 7f73a93cb640 1 --2- 172.21.15.53:0/3835127624 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73a40cc690 0x7f73a40ca6b0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f739801a080 tx=0x7f73980191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:16.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.066+0000 7f73967fc640 1 -- 172.21.15.53:0/3835127624 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7398004230 con 0x7f73a40cc690 2023-06-10T18:57:16.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.066+0000 7f73967fc640 1 -- 172.21.15.53:0/3835127624 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7398004390 con 0x7f73a40cc690 2023-06-10T18:57:16.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.066+0000 7f73abe30640 1 -- 172.21.15.53:0/3835127624 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73a415c050 con 0x7f73a40cc690 2023-06-10T18:57:16.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.066+0000 7f73967fc640 1 -- 172.21.15.53:0/3835127624 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7398003820 con 0x7f73a40cc690 2023-06-10T18:57:16.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.066+0000 7f73abe30640 1 -- 172.21.15.53:0/3835127624 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73a41534d0 con 0x7f73a40cc690 2023-06-10T18:57:16.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.070+0000 7f73abe30640 1 -- 172.21.15.53:0/3835127624 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73a4153720 con 0x7f73a40cc690 2023-06-10T18:57:16.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.070+0000 7f73967fc640 1 -- 172.21.15.53:0/3835127624 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f73980b4040 con 0x7f73a40cc690 2023-06-10T18:57:16.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.070+0000 7f73967fc640 1 --2- 172.21.15.53:0/3835127624 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7388066280 0x7f7388068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:16.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.070+0000 7f73967fc640 1 -- 172.21.15.53:0/3835127624 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f739811e240 con 0x7f73a40cc690 2023-06-10T18:57:16.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.070+0000 7f73a9bcc640 1 --2- 172.21.15.53:0/3835127624 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7388066280 0x7f7388068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:16.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.070+0000 7f73a9bcc640 1 --2- 172.21.15.53:0/3835127624 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7388066280 0x7f7388068730 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f73a0000f70 tx=0x7f73a0007b80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:16.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.074+0000 7f73967fc640 1 -- 172.21.15.53:0/3835127624 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f73980eb850 con 0x7f73a40cc690 2023-06-10T18:57:16.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.222+0000 7f73abe30640 1 -- 172.21.15.53:0/3835127624 --> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f73a41686b0 con 0x7f7388066280 2023-06-10T18:57:16.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.246+0000 7f73967fc640 1 -- 172.21.15.53:0/3835127624 <== mgr.4105 v2:172.21.15.117:6832/3061986771 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+297119 (secure 0 0 0) 0x7f73a00071f0 con 0x7f7388066280 2023-06-10T18:57:16.255 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:57:16.257 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-06-10T18:57:16.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.250+0000 7f73abe30640 1 -- 172.21.15.53:0/3835127624 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7388066280 msgr2=0x7f7388068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:16.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.250+0000 7f73abe30640 1 --2- 172.21.15.53:0/3835127624 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7388066280 0x7f7388068730 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f73a0000f70 tx=0x7f73a0007b80 comp rx=0 tx=0).stop 2023-06-10T18:57:16.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.250+0000 7f73abe30640 1 -- 172.21.15.53:0/3835127624 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73a40cc690 msgr2=0x7f73a40ca6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:16.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.250+0000 7f73abe30640 1 --2- 172.21.15.53:0/3835127624 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73a40cc690 0x7f73a40ca6b0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f739801a080 tx=0x7f73980191f0 comp rx=0 tx=0).stop 2023-06-10T18:57:16.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.250+0000 7f73abe30640 1 -- 172.21.15.53:0/3835127624 shutdown_connections 2023-06-10T18:57:16.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.250+0000 7f73abe30640 1 --2- 172.21.15.53:0/3835127624 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7388066280 0x7f7388068730 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:16.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.250+0000 7f73abe30640 1 --2- 172.21.15.53:0/3835127624 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73a40ccae0 0x7f73a415c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:16.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.250+0000 7f73abe30640 1 --2- 172.21.15.53:0/3835127624 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73a40cc690 0x7f73a40ca6b0 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:16.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.250+0000 7f73abe30640 1 --2- 172.21.15.53:0/3835127624 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f73a40b3ac0 0x7f73a4153f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:16.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.250+0000 7f73abe30640 1 -- 172.21.15.53:0/3835127624 >> 172.21.15.53:0/3835127624 conn(0x7f73a4071790 msgr2=0x7f73a415fc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:16.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.250+0000 7f73abe30640 1 -- 172.21.15.53:0/3835127624 shutdown_connections 2023-06-10T18:57:16.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.250+0000 7f73abe30640 1 -- 172.21.15.53:0/3835127624 wait complete. 2023-06-10T18:57:16.274 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":200,"stamp":"2023-06-10T18:57:15.659031+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238960,"kb_used_data":6960,"kb_used_omap":0,"kb_used_meta":231936,"kb_avail":754735760,"statfs":{"total":773094113280,"available":772849418240,"internally_reserved":0,"allocated":7127040,"data_stored":3781845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":237502464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001139"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.858048+0000","last_change":"2023-06-10T18:57:11.858048+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.858048+0000","last_undegraded":"2023-06-10T18:57:11.858048+0000","last_fullsized":"2023-06-10T18:57:11.858048+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.867848+0000","last_change":"2023-06-10T18:57:11.867848+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.867848+0000","last_undegraded":"2023-06-10T18:57:11.867848+0000","last_fullsized":"2023-06-10T18:57:11.867848+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.867289+0000","last_change":"2023-06-10T18:57:11.867289+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.867289+0000","last_undegraded":"2023-06-10T18:57:11.867289+0000","last_fullsized":"2023-06-10T18:57:11.867289+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.868398+0000","last_change":"2023-06-10T18:57:11.868398+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.868398+0000","last_undegraded":"2023-06-10T18:57:11.868398+0000","last_fullsized":"2023-06-10T18:57:11.868398+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.864218+0000","last_change":"2023-06-10T18:57:11.864218+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.864218+0000","last_undegraded":"2023-06-10T18:57:11.864218+0000","last_fullsized":"2023-06-10T18:57:11.864218+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.865117+0000","last_change":"2023-06-10T18:57:11.865117+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.865117+0000","last_undegraded":"2023-06-10T18:57:11.865117+0000","last_fullsized":"2023-06-10T18:57:11.865117+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.864215+0000","last_change":"2023-06-10T18:57:11.864215+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.864215+0000","last_undegraded":"2023-06-10T18:57:11.864215+0000","last_fullsized":"2023-06-10T18:57:11.864215+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.852046+0000","last_change":"2023-06-10T18:57:11.852046+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.852046+0000","last_undegraded":"2023-06-10T18:57:11.852046+0000","last_fullsized":"2023-06-10T18:57:11.852046+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.858422+0000","last_change":"2023-06-10T18:57:11.858422+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.858422+0000","last_undegraded":"2023-06-10T18:57:11.858422+0000","last_fullsized":"2023-06-10T18:57:11.858422+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.853111+0000","last_change":"2023-06-10T18:57:11.853111+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.853111+0000","last_undegraded":"2023-06-10T18:57:11.853111+0000","last_fullsized":"2023-06-10T18:57:11.853111+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.858596+0000","last_change":"2023-06-10T18:57:11.858596+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.858596+0000","last_undegraded":"2023-06-10T18:57:11.858596+0000","last_fullsized":"2023-06-10T18:57:11.858596+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.858699+0000","last_change":"2023-06-10T18:57:11.858699+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.858699+0000","last_undegraded":"2023-06-10T18:57:11.858699+0000","last_fullsized":"2023-06-10T18:57:11.858699+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.858402+0000","last_change":"2023-06-10T18:57:11.858402+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.858402+0000","last_undegraded":"2023-06-10T18:57:11.858402+0000","last_fullsized":"2023-06-10T18:57:11.858402+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.872354+0000","last_change":"2023-06-10T18:57:11.872354+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.872354+0000","last_undegraded":"2023-06-10T18:57:11.872354+0000","last_fullsized":"2023-06-10T18:57:11.872354+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.857189+0000","last_change":"2023-06-10T18:57:11.857189+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.857189+0000","last_undegraded":"2023-06-10T18:57:11.857189+0000","last_fullsized":"2023-06-10T18:57:11.857189+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.853005+0000","last_change":"2023-06-10T18:57:11.853005+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.853005+0000","last_undegraded":"2023-06-10T18:57:11.853005+0000","last_fullsized":"2023-06-10T18:57:11.853005+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.871215+0000","last_change":"2023-06-10T18:57:11.871215+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.871215+0000","last_undegraded":"2023-06-10T18:57:11.871215+0000","last_fullsized":"2023-06-10T18:57:11.871215+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.871166+0000","last_change":"2023-06-10T18:57:11.871166+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.871166+0000","last_undegraded":"2023-06-10T18:57:11.871166+0000","last_fullsized":"2023-06-10T18:57:11.871166+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.868169+0000","last_change":"2023-06-10T18:57:11.868169+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.868169+0000","last_undegraded":"2023-06-10T18:57:11.868169+0000","last_fullsized":"2023-06-10T18:57:11.868169+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.857982+0000","last_change":"2023-06-10T18:57:11.857982+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.857982+0000","last_undegraded":"2023-06-10T18:57:11.857982+0000","last_fullsized":"2023-06-10T18:57:11.857982+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.857076+0000","last_change":"2023-06-10T18:57:11.857076+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.857076+0000","last_undegraded":"2023-06-10T18:57:11.857076+0000","last_fullsized":"2023-06-10T18:57:11.857076+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.864162+0000","last_change":"2023-06-10T18:57:11.864162+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.864162+0000","last_undegraded":"2023-06-10T18:57:11.864162+0000","last_fullsized":"2023-06-10T18:57:11.864162+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.865225+0000","last_change":"2023-06-10T18:57:11.865225+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.865225+0000","last_undegraded":"2023-06-10T18:57:11.865225+0000","last_fullsized":"2023-06-10T18:57:11.865225+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.857958+0000","last_change":"2023-06-10T18:57:11.857958+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.857958+0000","last_undegraded":"2023-06-10T18:57:11.857958+0000","last_fullsized":"2023-06-10T18:57:11.857958+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.864162+0000","last_change":"2023-06-10T18:57:11.864162+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.864162+0000","last_undegraded":"2023-06-10T18:57:11.864162+0000","last_fullsized":"2023-06-10T18:57:11.864162+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":243,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-06-10T18:57:11.860040+0000","last_change":"2023-06-10T18:52:34.951528+0000","last_active":"2023-06-10T18:57:11.860040+0000","last_peered":"2023-06-10T18:57:11.860040+0000","last_clean":"2023-06-10T18:57:11.860040+0000","last_became_active":"2023-06-10T18:52:34.949099+0000","last_became_peered":"2023-06-10T18:52:34.949099+0000","last_unstale":"2023-06-10T18:57:11.860040+0000","last_undegraded":"2023-06-10T18:57:11.860040+0000","last_fullsized":"2023-06-10T18:57:11.860040+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_clean_scrub_stamp":"2023-06-10T18:52:33.633295+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:02:34.447395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":89,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-06-10T18:57:11.873465+0000","last_change":"2023-06-10T18:52:40.506384+0000","last_active":"2023-06-10T18:57:11.873465+0000","last_peered":"2023-06-10T18:57:11.873465+0000","last_clean":"2023-06-10T18:57:11.873465+0000","last_became_active":"2023-06-10T18:52:40.505701+0000","last_became_peered":"2023-06-10T18:52:40.505701+0000","last_unstale":"2023-06-10T18:57:11.873465+0000","last_undegraded":"2023-06-10T18:57:11.873465+0000","last_fullsized":"2023-06-10T18:57:11.873465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:01:38.268612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.867782+0000","last_change":"2023-06-10T18:57:11.867782+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.867782+0000","last_undegraded":"2023-06-10T18:57:11.867782+0000","last_fullsized":"2023-06-10T18:57:11.867782+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":87,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-06-10T18:57:11.859674+0000","last_change":"2023-06-10T18:52:40.512015+0000","last_active":"2023-06-10T18:57:11.859674+0000","last_peered":"2023-06-10T18:57:11.859674+0000","last_clean":"2023-06-10T18:57:11.859674+0000","last_became_active":"2023-06-10T18:52:40.511382+0000","last_became_peered":"2023-06-10T18:52:40.511382+0000","last_unstale":"2023-06-10T18:57:11.859674+0000","last_undegraded":"2023-06-10T18:57:11.859674+0000","last_fullsized":"2023-06-10T18:57:11.859674+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:32:10.225462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.871187+0000","last_change":"2023-06-10T18:57:11.871187+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.871187+0000","last_undegraded":"2023-06-10T18:57:11.871187+0000","last_fullsized":"2023-06-10T18:57:11.871187+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":91,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-06-10T18:57:11.851098+0000","last_change":"2023-06-10T18:52:40.671725+0000","last_active":"2023-06-10T18:57:11.851098+0000","last_peered":"2023-06-10T18:57:11.851098+0000","last_clean":"2023-06-10T18:57:11.851098+0000","last_became_active":"2023-06-10T18:52:40.671442+0000","last_became_peered":"2023-06-10T18:52:40.671442+0000","last_unstale":"2023-06-10T18:57:11.851098+0000","last_undegraded":"2023-06-10T18:57:11.851098+0000","last_fullsized":"2023-06-10T18:57:11.851098+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:41:17.572105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.867223+0000","last_change":"2023-06-10T18:57:11.867223+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.867223+0000","last_undegraded":"2023-06-10T18:57:11.867223+0000","last_fullsized":"2023-06-10T18:57:11.867223+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":89,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-06-10T18:57:11.873707+0000","last_change":"2023-06-10T18:52:40.510258+0000","last_active":"2023-06-10T18:57:11.873707+0000","last_peered":"2023-06-10T18:57:11.873707+0000","last_clean":"2023-06-10T18:57:11.873707+0000","last_became_active":"2023-06-10T18:52:40.509560+0000","last_became_peered":"2023-06-10T18:52:40.509560+0000","last_unstale":"2023-06-10T18:57:11.873707+0000","last_undegraded":"2023-06-10T18:57:11.873707+0000","last_fullsized":"2023-06-10T18:57:11.873707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:02:39.344511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.872455+0000","last_change":"2023-06-10T18:57:11.872455+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.872455+0000","last_undegraded":"2023-06-10T18:57:11.872455+0000","last_fullsized":"2023-06-10T18:57:11.872455+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":83,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-06-10T18:57:11.859334+0000","last_change":"2023-06-10T18:52:40.672266+0000","last_active":"2023-06-10T18:57:11.859334+0000","last_peered":"2023-06-10T18:57:11.859334+0000","last_clean":"2023-06-10T18:57:11.859334+0000","last_became_active":"2023-06-10T18:52:40.671966+0000","last_became_peered":"2023-06-10T18:52:40.671966+0000","last_unstale":"2023-06-10T18:57:11.859334+0000","last_undegraded":"2023-06-10T18:57:11.859334+0000","last_fullsized":"2023-06-10T18:57:11.859334+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:20:22.653473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.857155+0000","last_change":"2023-06-10T18:57:11.857155+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.857155+0000","last_undegraded":"2023-06-10T18:57:11.857155+0000","last_fullsized":"2023-06-10T18:57:11.857155+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":87,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-06-10T18:57:11.860042+0000","last_change":"2023-06-10T18:52:40.671084+0000","last_active":"2023-06-10T18:57:11.860042+0000","last_peered":"2023-06-10T18:57:11.860042+0000","last_clean":"2023-06-10T18:57:11.860042+0000","last_became_active":"2023-06-10T18:52:40.670697+0000","last_became_peered":"2023-06-10T18:52:40.670697+0000","last_unstale":"2023-06-10T18:57:11.860042+0000","last_undegraded":"2023-06-10T18:57:11.860042+0000","last_fullsized":"2023-06-10T18:57:11.860042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:38:30.948317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.857096+0000","last_change":"2023-06-10T18:57:11.857096+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.857096+0000","last_undegraded":"2023-06-10T18:57:11.857096+0000","last_fullsized":"2023-06-10T18:57:11.857096+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":83,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-06-10T18:57:11.859351+0000","last_change":"2023-06-10T18:52:40.514114+0000","last_active":"2023-06-10T18:57:11.859351+0000","last_peered":"2023-06-10T18:57:11.859351+0000","last_clean":"2023-06-10T18:57:11.859351+0000","last_became_active":"2023-06-10T18:52:40.513638+0000","last_became_peered":"2023-06-10T18:52:40.513638+0000","last_unstale":"2023-06-10T18:57:11.859351+0000","last_undegraded":"2023-06-10T18:57:11.859351+0000","last_fullsized":"2023-06-10T18:57:11.859351+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:44:43.932666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.864245+0000","last_change":"2023-06-10T18:57:11.864245+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.864245+0000","last_undegraded":"2023-06-10T18:57:11.864245+0000","last_fullsized":"2023-06-10T18:57:11.864245+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":91,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-06-10T18:57:11.851590+0000","last_change":"2023-06-10T18:52:40.515396+0000","last_active":"2023-06-10T18:57:11.851590+0000","last_peered":"2023-06-10T18:57:11.851590+0000","last_clean":"2023-06-10T18:57:11.851590+0000","last_became_active":"2023-06-10T18:52:40.514663+0000","last_became_peered":"2023-06-10T18:52:40.514663+0000","last_unstale":"2023-06-10T18:57:11.851590+0000","last_undegraded":"2023-06-10T18:57:11.851590+0000","last_fullsized":"2023-06-10T18:57:11.851590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:26:51.297957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574907,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28260,"kb_used_data":1308,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343580,"statfs":{"total":96636764160,"available":96607825920,"internally_reserved":0,"allocated":1339392,"data_stored":916660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.89800000000000002,"15min":0.88},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.1850000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.038},{"interface":"front","average":{"1min":0.874,"5min":0.93300000000000005,"15min":0.92700000000000005},"min":{"1min":0.52900000000000003,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1910000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.66000000000000003}]},{"osd":1,"last update":"Sat Jun 10 18:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.93200000000000005,"15min":0.91800000000000004},"min":{"1min":0.56100000000000005,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.3759999999999999,"5min":1.377,"15min":1.377},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.93300000000000005,"15min":0.91300000000000003},"min":{"1min":0.70099999999999996,"5min":0.504,"15min":0.504},"max":{"1min":1.2529999999999999,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.78000000000000003}]},{"osd":2,"last update":"Sat Jun 10 18:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.83699999999999997,"15min":0.82699999999999996},"min":{"1min":0.49299999999999999,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.04,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.89100000000000001,"15min":0.90400000000000003},"min":{"1min":0.56100000000000005,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1930000000000001,"5min":1.367,"15min":1.367},"last":0.96199999999999997}]},{"osd":3,"last update":"Sat Jun 10 18:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.92900000000000005,"15min":0.90100000000000002},"min":{"1min":0.59699999999999998,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.167,"5min":1.502,"15min":1.502},"last":1.0649999999999999},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.94199999999999995,"15min":0.92900000000000005},"min":{"1min":0.63,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.2230000000000001,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":1.1279999999999999}]},{"osd":4,"last update":"Sat Jun 10 18:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.871,"15min":0.871},"min":{"1min":0.57399999999999995,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.1639999999999999,"5min":1.639,"15min":1.639},"last":1.097},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.95999999999999996,"15min":0.97799999999999998},"min":{"1min":0.65200000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.22,"5min":1.411,"15min":1.411},"last":1.1639999999999999}]},{"osd":5,"last update":"Sat Jun 10 18:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":1.0189999999999999,"15min":1.0309999999999999},"min":{"1min":0.60099999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.2210000000000001,"5min":1.806,"15min":1.806},"last":1.2210000000000001},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.038,"15min":1.048},"min":{"1min":0.71299999999999997,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.26,"5min":1.522,"15min":1.522},"last":1.2450000000000001}]},{"osd":6,"last update":"Sat Jun 10 18:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.995,"15min":1.002},"min":{"1min":0.66400000000000003,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.2170000000000001,"5min":1.718,"15min":1.718},"last":0.93000000000000005},{"interface":"front","average":{"1min":1.048,"5min":1.087,"15min":1.087},"min":{"1min":0.83599999999999997,"5min":0.441,"15min":0.441},"max":{"1min":1.2889999999999999,"5min":1.464,"15min":1.464},"last":1.3169999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574908,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27680,"kb_used_data":728,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344160,"statfs":{"total":96636764160,"available":96608419840,"internally_reserved":0,"allocated":745472,"data_stored":326292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:56:33 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.84999999999999998,"15min":0.81100000000000005},"min":{"1min":0.66700000000000004,"5min":0.502,"15min":0.502},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":0.755},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.878,"15min":0.84799999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.78800000000000003}]},{"osd":1,"last update":"Sat Jun 10 18:56:33 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.88,"15min":0.85399999999999998},"min":{"1min":0.53400000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0900000000000001,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.89500000000000002,"15min":0.86399999999999999},"min":{"1min":0.53800000000000003,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.587,"5min":1.778,"15min":1.778},"last":1.0640000000000001}]},{"osd":2,"last update":"Sat Jun 10 18:56:33 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.88300000000000001,"15min":0.86299999999999999},"min":{"1min":0.57399999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.1819999999999999,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.871,"5min":0.88100000000000001,"15min":0.88800000000000001},"min":{"1min":0.60299999999999998,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.177,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":1.012}]},{"osd":3,"last update":"Sat Jun 10 18:56:33 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":0.90800000000000003,"15min":0.85999999999999999},"min":{"1min":0.64500000000000002,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":0.60799999999999998},{"interface":"front","average":{"1min":1,"5min":0.998,"15min":0.996},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.90600000000000003}]},{"osd":4,"last update":"Sat Jun 10 18:56:33 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.93000000000000005,"15min":0.95199999999999996},"min":{"1min":0.63,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":0.86299999999999999},{"interface":"front","average":{"1min":1.024,"5min":1.0049999999999999,"15min":1.0189999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.54,"5min":1.54,"15min":1.54},"last":0.70299999999999996}]},{"osd":5,"last update":"Sat Jun 10 18:56:33 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.93500000000000005,"15min":0.95699999999999996},"min":{"1min":0.70299999999999996,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":1.097},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.044,"15min":1.032},"min":{"1min":0.83699999999999997,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":2.536,"5min":2.536,"15min":2.536},"last":0.96099999999999997}]},{"osd":7,"last update":"Sat Jun 10 18:56:33 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.036,"15min":1.048},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.917,"5min":1.917,"15min":1.917},"last":1.0389999999999999},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.05,"15min":1.0629999999999999},"min":{"1min":0.79400000000000004,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.395,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.81899999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574908,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27680,"kb_used_data":728,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344160,"statfs":{"total":96636764160,"available":96608419840,"internally_reserved":0,"allocated":745472,"data_stored":326292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84499999999999997,"15min":0.83099999999999996},"min":{"1min":0.60999999999999999,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.879,"5min":0.90300000000000002,"15min":0.93700000000000006},"min":{"1min":0.58799999999999997,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1499999999999999,"5min":1.637,"15min":1.637},"last":0.89800000000000002}]},{"osd":1,"last update":"Sat Jun 10 18:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.89000000000000001,"15min":0.91200000000000003},"min":{"1min":0.54400000000000004,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.107,"5min":1.335,"15min":1.335},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.91700000000000004,"15min":0.92100000000000004},"min":{"1min":0.63600000000000001,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.444,"5min":1.78,"15min":1.78},"last":0.57699999999999996}]},{"osd":2,"last update":"Sat Jun 10 18:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.84299999999999997,"15min":0.85099999999999998},"min":{"1min":0.54400000000000004,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.995,"5min":1.446,"15min":1.446},"last":1.0509999999999999},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.163,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.65700000000000003}]},{"osd":3,"last update":"Sat Jun 10 18:56:37 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":0.95299999999999996,"15min":0.94899999999999995},"min":{"1min":0.75900000000000001,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.3440000000000001,"5min":1.484,"15min":1.484},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.998,"15min":1.034},"min":{"1min":0.66700000000000004,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.1910000000000001,"5min":1.337,"15min":1.337},"last":1.0029999999999999}]},{"osd":4,"last update":"Sat Jun 10 18:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.94499999999999995,"15min":0.98099999999999998},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.0720000000000001,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":1.002,"5min":1.0189999999999999,"15min":1.0589999999999999},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.528,"5min":1.575,"15min":1.575},"last":0.69599999999999995}]},{"osd":6,"last update":"Sat Jun 10 18:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":1.0089999999999999,"15min":1.0680000000000001},"min":{"1min":0.629,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.1799999999999999,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.1499999999999999},{"interface":"front","average":{"1min":0.97899999999999998,"5min":1.0389999999999999,"15min":1.0720000000000001},"min":{"1min":0.67200000000000004,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.1859999999999999,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.81999999999999995}]},{"osd":7,"last update":"Sat Jun 10 18:56:37 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.123,"15min":1.169},"min":{"1min":0.85199999999999998,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.573,"5min":1.873,"15min":1.873},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.1339999999999999,"15min":1.1739999999999999},"min":{"1min":0.877,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.4750000000000001,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.3149999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574907,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27680,"kb_used_data":728,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344160,"statfs":{"total":96636764160,"available":96608419840,"internally_reserved":0,"allocated":745472,"data_stored":326292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.78700000000000003,"15min":0.752},"min":{"1min":0.49299999999999999,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.157,"5min":1.2,"15min":1.2},"last":0.998},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.89700000000000002,"15min":0.88500000000000001},"min":{"1min":0.66500000000000004,"5min":0.504,"15min":0.504},"max":{"1min":1.2350000000000001,"5min":1.73,"15min":1.73},"last":0.71799999999999997}]},{"osd":1,"last update":"Sat Jun 10 18:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.94799999999999995,"15min":0.95399999999999996},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.179,"5min":1.601,"15min":1.601},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.87,"5min":0.85299999999999998,"15min":0.83899999999999997},"min":{"1min":0.63400000000000001,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.3029999999999999,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.67600000000000005}]},{"osd":2,"last update":"Sat Jun 10 18:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.877,"15min":0.875},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.089,"5min":1.522,"15min":1.522},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.98999999999999999,"15min":1},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.2629999999999999,"5min":1.552,"15min":1.552},"last":0.57799999999999996}]},{"osd":3,"last update":"Sat Jun 10 18:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.89900000000000002,"15min":0.88},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.1990000000000001,"5min":1.22,"15min":1.22},"last":0.53900000000000003},{"interface":"front","average":{"1min":1.02,"5min":0.97299999999999998,"15min":0.95599999999999996},"min":{"1min":0.78900000000000003,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.159,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.92300000000000004}]},{"osd":5,"last update":"Sat Jun 10 18:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.95099999999999996,"15min":0.98899999999999999},"min":{"1min":0.68200000000000005,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.27,"5min":1.663,"15min":1.663},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.999,"5min":0.95499999999999996,"15min":0.98199999999999998},"min":{"1min":0.69899999999999995,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.234,"5min":1.353,"15min":1.353},"last":0.89300000000000002}]},{"osd":6,"last update":"Sat Jun 10 18:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.98799999999999999,"15min":1.024},"min":{"1min":0.65500000000000003,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.242,"5min":2.2639999999999998,"15min":2.2639999999999998},"last":1.105},{"interface":"front","average":{"1min":1.054,"5min":1.0669999999999999,"15min":1.0740000000000001},"min":{"1min":0.72599999999999998,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.2849999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.95299999999999996}]},{"osd":7,"last update":"Sat Jun 10 18:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.98399999999999999,"15min":0.99399999999999999},"min":{"1min":0.68999999999999995,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.2350000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.0600000000000001,"15min":1.0740000000000001},"min":{"1min":0.78500000000000003,"5min":0.628,"15min":0.628},"max":{"1min":1.3879999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":1.2669999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574906,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31772,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340068,"statfs":{"total":96636764160,"available":96604229632,"internally_reserved":0,"allocated":741376,"data_stored":325273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:56:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.60099999999999998,"15min":0.57999999999999996},"min":{"1min":0.432,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.65300000000000002,"15min":0.63700000000000001},"min":{"1min":0.35599999999999998,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.0129999999999999,"5min":1.286,"15min":1.286},"last":0.5}]},{"osd":1,"last update":"Sat Jun 10 18:56:36 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.67500000000000004,"15min":0.63200000000000001},"min":{"1min":0.45500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":1.2569999999999999},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.74299999999999999,"15min":0.72299999999999998},"min":{"1min":0.48599999999999999,"5min":0.318,"15min":0.318},"max":{"1min":1.143,"5min":1.411,"15min":1.411},"last":0.95399999999999996}]},{"osd":2,"last update":"Sat Jun 10 18:56:36 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.77400000000000002,"15min":0.754},"min":{"1min":0.48999999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.3759999999999999,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":0.749},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.76800000000000002,"15min":0.745},"min":{"1min":0.52900000000000003,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.125,"5min":1.264,"15min":1.264},"last":1.2170000000000001}]},{"osd":4,"last update":"Sat Jun 10 18:56:36 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.95399999999999996,"15min":0.96599999999999997},"min":{"1min":0.747,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.3360000000000001,"5min":1.488,"15min":1.488},"last":0.879},{"interface":"front","average":{"1min":1.026,"5min":0.997,"15min":0.99299999999999999},"min":{"1min":0.65500000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.3700000000000001,"5min":1.458,"15min":1.458},"last":1.3400000000000001}]},{"osd":5,"last update":"Sat Jun 10 18:56:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":1.026,"15min":1.0549999999999999},"min":{"1min":0.68000000000000005,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.431,"5min":2.024,"15min":2.024},"last":0.91600000000000004},{"interface":"front","average":{"1min":1.117,"5min":1.0469999999999999,"15min":1.0209999999999999},"min":{"1min":0.94299999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.4139999999999999,"5min":1.724,"15min":1.724},"last":1.304}]},{"osd":6,"last update":"Sat Jun 10 18:56:36 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.0669999999999999,"15min":1.0529999999999999},"min":{"1min":0.83199999999999996,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.5449999999999999,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":1.139},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.0640000000000001,"15min":1.0740000000000001},"min":{"1min":0.75900000000000001,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.514,"5min":1.78,"15min":1.78},"last":1.173}]},{"osd":7,"last update":"Sat Jun 10 18:56:36 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.105,"15min":1.129},"min":{"1min":0.82599999999999996,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.5900000000000001,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.099,"15min":1.077},"min":{"1min":0.71799999999999997,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.5429999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":1.091}]}]},{"osd":2,"up_from":13,"seq":55834574907,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31764,"kb_used_data":716,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340076,"statfs":{"total":96636764160,"available":96604237824,"internally_reserved":0,"allocated":733184,"data_stored":320122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.60699999999999998,"15min":0.58999999999999997},"min":{"1min":0.36499999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.91700000000000004,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.432},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.436,"5min":0.378,"15min":0.378},"max":{"1min":1.0580000000000001,"5min":1.224,"15min":1.224},"last":0.58199999999999996}]},{"osd":1,"last update":"Sat Jun 10 18:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.66300000000000003,"15min":0.65100000000000002},"min":{"1min":0.39700000000000002,"5min":0.307,"15min":0.307},"max":{"1min":1.0109999999999999,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":1.099},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.753,"15min":0.69999999999999996},"min":{"1min":0.41699999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.64100000000000001}]},{"osd":3,"last update":"Sat Jun 10 18:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.745,"15min":0.70899999999999996},"min":{"1min":0.44700000000000001,"5min":0.377,"15min":0.377},"max":{"1min":1.0609999999999999,"5min":1.165,"15min":1.165},"last":1.006},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.76400000000000001,"15min":0.751},"min":{"1min":0.32900000000000001,"5min":0.252,"15min":0.252},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.80500000000000005}]},{"osd":4,"last update":"Sat Jun 10 18:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.92300000000000004,"15min":0.91700000000000004},"min":{"1min":0.63,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.2769999999999999,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":1.05},{"interface":"front","average":{"1min":1.046,"5min":1.036,"15min":1.038},"min":{"1min":0.70199999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.3169999999999999,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.85399999999999998}]},{"osd":5,"last update":"Sat Jun 10 18:56:37 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.0289999999999999,"15min":1.0209999999999999},"min":{"1min":0.64600000000000002,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.3759999999999999,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":1.032},{"interface":"front","average":{"1min":1.056,"5min":1.02,"15min":0.98399999999999999},"min":{"1min":0.78200000000000003,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.4119999999999999,"5min":1.667,"15min":1.667},"last":0.88800000000000001}]},{"osd":6,"last update":"Sat Jun 10 18:56:37 2023","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.0609999999999999,"15min":1.0289999999999999},"min":{"1min":0.873,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.4550000000000001,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":1.153},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.0509999999999999,"15min":1.038},"min":{"1min":0.66000000000000003,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.96999999999999997}]},{"osd":7,"last update":"Sat Jun 10 18:56:37 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.1060000000000001,"15min":1.1020000000000001},"min":{"1min":0.83899999999999997,"5min":0.62,"15min":0.62},"max":{"1min":1.458,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.94599999999999995},{"interface":"front","average":{"1min":1.181,"5min":1.121,"15min":1.083},"min":{"1min":0.76400000000000001,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.5920000000000001,"5min":1.752,"15min":1.752},"last":0.71799999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574909,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31772,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340068,"statfs":{"total":96636764160,"available":96604229632,"internally_reserved":0,"allocated":741376,"data_stored":325273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.66600000000000004,"15min":0.65900000000000003},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.0149999999999999,"5min":1.288,"15min":1.288},"last":1.0600000000000001},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.72799999999999998,"15min":0.68799999999999994},"min":{"1min":0.38300000000000001,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.0089999999999999,"5min":1.694,"15min":1.694},"last":0.98099999999999998}]},{"osd":2,"last update":"Sat Jun 10 18:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.63200000000000001,"15min":0.61899999999999999},"min":{"1min":0.27300000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.77300000000000002,"5min":1.21,"15min":1.21},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71899999999999997,"15min":0.66300000000000003},"min":{"1min":0.33800000000000002,"5min":0.315,"15min":0.315},"max":{"1min":1.171,"5min":1.415,"15min":1.415},"last":0.63700000000000001}]},{"osd":3,"last update":"Sat Jun 10 18:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79200000000000004,"15min":0.75},"min":{"1min":0.33400000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.4139999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.755,"15min":0.747},"min":{"1min":0.35399999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.0649999999999999,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":0.79000000000000004}]},{"osd":4,"last update":"Sat Jun 10 18:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.875,"15min":0.83799999999999997},"min":{"1min":0.56799999999999995,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0329999999999999,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.95799999999999996,"5min":1.0960000000000001,"15min":1.0720000000000001},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.5129999999999999,"5min":5.8209999999999997,"15min":5.8209999999999997},"last":0.83499999999999996}]},{"osd":5,"last update":"Sat Jun 10 18:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":1.018,"15min":1.024},"min":{"1min":0.58499999999999996,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.2829999999999999,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":1.589},{"interface":"front","average":{"1min":0.90400000000000003,"5min":1.004,"15min":0.96799999999999997},"min":{"1min":0.60699999999999998,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.1599999999999999,"5min":3.089,"15min":3.089},"last":0.93899999999999995}]},{"osd":6,"last update":"Sat Jun 10 18:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":1.105,"15min":1.0309999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.472,"5min":7.2599999999999998,"15min":7.2599999999999998},"last":1.478},{"interface":"front","average":{"1min":0.92900000000000005,"5min":1.0940000000000001,"15min":1.026},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.2090000000000001,"5min":9.0069999999999997,"15min":9.0069999999999997},"last":1.1040000000000001}]},{"osd":7,"last update":"Sat Jun 10 18:56:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.0920000000000001,"15min":1.081},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.3440000000000001,"5min":2.105,"15min":2.105},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.083,"15min":1.0669999999999999},"min":{"1min":0.65600000000000003,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.673,"5min":2.2570000000000001,"15min":2.2570000000000001},"last":1.6399999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574908,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32352,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339488,"statfs":{"total":96636764160,"available":96603635712,"internally_reserved":0,"allocated":1335296,"data_stored":915641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jun 10 18:56:40 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.626,"15min":0.60299999999999998},"min":{"1min":0.35599999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.93899999999999995,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.78500000000000003,"15min":0.75},"min":{"1min":0.53100000000000003,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.028,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":1.0329999999999999}]},{"osd":2,"last update":"Sat Jun 10 18:56:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.71399999999999997,"15min":0.69899999999999995},"min":{"1min":0.39400000000000002,"5min":0.313,"15min":0.313},"max":{"1min":1.073,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65400000000000003,"15min":0.63300000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.95099999999999996,"5min":1.371,"15min":1.371},"last":0.56499999999999995}]},{"osd":3,"last update":"Sat Jun 10 18:56:40 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.70099999999999996,"15min":0.67700000000000005},"min":{"1min":0.377,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.087,"5min":1.226,"15min":1.226},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.84099999999999997,"15min":0.81399999999999995},"min":{"1min":0.435,"5min":0.375,"15min":0.375},"max":{"1min":1.296,"5min":1.829,"15min":1.829},"last":0.80500000000000005}]},{"osd":4,"last update":"Sat Jun 10 18:56:40 2023","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.91100000000000003,"15min":0.89300000000000002},"min":{"1min":0.59099999999999997,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.173,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.83399999999999996},{"interface":"front","average":{"1min":1.034,"5min":1.0369999999999999,"15min":1.034},"min":{"1min":0.65600000000000003,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.2729999999999999,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":1.1599999999999999}]},{"osd":5,"last update":"Sat Jun 10 18:56:40 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.64300000000000002,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.2450000000000001,"5min":1.694,"15min":1.694},"last":0.86599999999999999},{"interface":"front","average":{"1min":1.044,"5min":1.01,"15min":1.0009999999999999},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.3460000000000001,"5min":1.75,"15min":1.75},"last":0.996}]},{"osd":6,"last update":"Sat Jun 10 18:56:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.0740000000000001,"15min":1.0569999999999999},"min":{"1min":0.61699999999999999,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.2949999999999999,"5min":2.04,"15min":2.04},"last":1.2250000000000001},{"interface":"front","average":{"1min":1.03,"5min":1.0029999999999999,"15min":0.999},"min":{"1min":0.71099999999999997,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.3280000000000001,"5min":1.883,"15min":1.883},"last":1.0740000000000001}]},{"osd":7,"last update":"Sat Jun 10 18:56:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.044,"15min":1.0349999999999999},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.3360000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.96799999999999997},{"interface":"front","average":{"1min":1.099,"5min":1.0660000000000001,"15min":1.054},"min":{"1min":0.69299999999999995,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.4610000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.115}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-10T18:57:16.282 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-10T18:57:16.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.438+0000 7f36eb0b5640 1 Processor -- start 2023-06-10T18:57:16.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.438+0000 7f36eb0b5640 1 -- start start 2023-06-10T18:57:16.445 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.438+0000 7f36eb0b5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36e40c9840 0x7f36e40c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:16.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.438+0000 7f36eb0b5640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36e4159b50 con 0x7f36e406b090 2023-06-10T18:57:16.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.438+0000 7f36eb0b5640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36e40ca150 con 0x7f36e4071060 2023-06-10T18:57:16.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.438+0000 7f36eb0b5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36e40702a0 con 0x7f36e40c9840 2023-06-10T18:57:16.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.438+0000 7f36e9652640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f36e406b090 0x7f36e406b530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:48254/0 (socket says 172.21.15.53:48254) 2023-06-10T18:57:16.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.438+0000 7f36e9652640 1 -- 172.21.15.53:0/3335310297 learned_addr learned my addr 172.21.15.53:0/3335310297 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:57:16.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.438+0000 7f36e8e51640 1 --2- 172.21.15.53:0/3335310297 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36e40c9840 0x7f36e40c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:16.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.438+0000 7f36e37fe640 1 -- 172.21.15.53:0/3335310297 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3932184798 0 0) 0x7f36e4159b50 con 0x7f36e406b090 2023-06-10T18:57:16.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.438+0000 7f36e37fe640 1 -- 172.21.15.53:0/3335310297 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36d0003530 con 0x7f36e406b090 2023-06-10T18:57:16.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.438+0000 7f36e37fe640 1 -- 172.21.15.53:0/3335310297 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2590927447 0 0) 0x7f36d0003530 con 0x7f36e406b090 2023-06-10T18:57:16.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.438+0000 7f36e37fe640 1 -- 172.21.15.53:0/3335310297 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36e40c9840 msgr2=0x7f36e40c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:16.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.438+0000 7f36e37fe640 1 --2- 172.21.15.53:0/3335310297 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36e40c9840 0x7f36e40c9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:16.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.438+0000 7f36e37fe640 1 -- 172.21.15.53:0/3335310297 >> v1:172.21.15.117:6789/0 conn(0x7f36e4071060 legacy=0x7f36e40af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:16.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.438+0000 7f36e37fe640 1 -- 172.21.15.53:0/3335310297 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36e4070580 con 0x7f36e406b090 2023-06-10T18:57:16.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.438+0000 7f36e37fe640 1 -- 172.21.15.53:0/3335310297 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f36dc001680 con 0x7f36e406b090 2023-06-10T18:57:16.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.438+0000 7f36e8e51640 1 --2- 172.21.15.53:0/3335310297 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36e40c9840 0x7f36e40c9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T18:57:16.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.438+0000 7f36e37fe640 1 -- 172.21.15.53:0/3335310297 >> v1:172.21.15.53:6789/0 conn(0x7f36e406b090 legacy=0x7f36e406b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:16.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.438+0000 7f36e37fe640 1 --2- 172.21.15.53:0/3335310297 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36e40c9840 0x7f36d0003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:16.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.438+0000 7f36e37fe640 1 --2- 172.21.15.53:0/3335310297 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36d0004010 0x7f36d00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:16.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.438+0000 7f36e37fe640 1 --2- 172.21.15.53:0/3335310297 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36d0004d10 0x7f36d0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:16.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.438+0000 7f36e37fe640 1 -- 172.21.15.53:0/3335310297 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e40702a0 con 0x7f36d0004010 2023-06-10T18:57:16.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.438+0000 7f36e37fe640 1 -- 172.21.15.53:0/3335310297 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36d000bb50 con 0x7f36d0004d10 2023-06-10T18:57:16.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.438+0000 7f36e37fe640 1 -- 172.21.15.53:0/3335310297 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36d000bd10 con 0x7f36e40c9840 2023-06-10T18:57:16.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.438+0000 7f36e3fff640 1 --2- 172.21.15.53:0/3335310297 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36d0004010 0x7f36d00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:16.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.438+0000 7f36e8e51640 1 --2- 172.21.15.53:0/3335310297 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36e40c9840 0x7f36d0003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:16.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.438+0000 7f36e9652640 1 --2- 172.21.15.53:0/3335310297 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36d0004d10 0x7f36d0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:16.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.438+0000 7f36e3fff640 1 -- 172.21.15.53:0/3335310297 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36e40c9840 msgr2=0x7f36d0003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:16.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.438+0000 7f36e3fff640 1 --2- 172.21.15.53:0/3335310297 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36e40c9840 0x7f36d0003a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:16.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.438+0000 7f36e3fff640 1 -- 172.21.15.53:0/3335310297 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36d0004d10 msgr2=0x7f36d0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:16.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.438+0000 7f36e3fff640 1 --2- 172.21.15.53:0/3335310297 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36d0004d10 0x7f36d0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:16.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.438+0000 7f36e3fff640 1 -- 172.21.15.53:0/3335310297 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36d0003530 con 0x7f36d0004010 2023-06-10T18:57:16.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.442+0000 7f36e3fff640 1 --2- 172.21.15.53:0/3335310297 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36d0004010 0x7f36d00047d0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f36cc001e40 tx=0x7f36cc01c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c43f63912a4954b4 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:16.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.442+0000 7f36e37fe640 1 -- 172.21.15.53:0/3335310297 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36cc003b80 con 0x7f36d0004010 2023-06-10T18:57:16.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.442+0000 7f36e37fe640 1 -- 172.21.15.53:0/3335310297 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36cc003ce0 con 0x7f36d0004010 2023-06-10T18:57:16.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.442+0000 7f36e37fe640 1 -- 172.21.15.53:0/3335310297 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36cc0052c0 con 0x7f36d0004010 2023-06-10T18:57:16.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.442+0000 7f36eb0b5640 1 -- 172.21.15.53:0/3335310297 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36d0004010 msgr2=0x7f36d00047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:16.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.442+0000 7f36eb0b5640 1 --2- 172.21.15.53:0/3335310297 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36d0004010 0x7f36d00047d0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f36cc001e40 tx=0x7f36cc01c740 comp rx=0 tx=0).stop 2023-06-10T18:57:16.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.442+0000 7f36e9652640 1 -- 172.21.15.53:0/3335310297 reap_dead start 2023-06-10T18:57:16.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.442+0000 7f36eb0b5640 1 -- 172.21.15.53:0/3335310297 shutdown_connections 2023-06-10T18:57:16.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.442+0000 7f36eb0b5640 1 -- 172.21.15.53:0/3335310297 >> 172.21.15.53:0/3335310297 conn(0x7f36e406a0d0 msgr2=0x7f36e40ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:16.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.442+0000 7f36eb0b5640 1 -- 172.21.15.53:0/3335310297 shutdown_connections 2023-06-10T18:57:16.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.442+0000 7f36eb0b5640 1 -- 172.21.15.53:0/3335310297 wait complete. 2023-06-10T18:57:16.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.442+0000 7f36eb0b5640 1 Processor -- start 2023-06-10T18:57:16.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.442+0000 7f36eb0b5640 1 -- start start 2023-06-10T18:57:16.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.446+0000 7f36eb0b5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36e414b1e0 0x7f36e40af210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:16.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.446+0000 7f36eb0b5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36e40af750 0x7f36e415b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:16.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.446+0000 7f36eb0b5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36e415bb10 0x7f36e40b0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:16.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.446+0000 7f36eb0b5640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e415a910 con 0x7f36e40af750 2023-06-10T18:57:16.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.446+0000 7f36eb0b5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e40afbc0 con 0x7f36e415bb10 2023-06-10T18:57:16.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.446+0000 7f36eb0b5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36e415c2c0 con 0x7f36e414b1e0 2023-06-10T18:57:16.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.446+0000 7f36e3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36e40af750 0x7f36e415b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:16.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.446+0000 7f36e3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36e40af750 0x7f36e415b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52954/0 (socket says 172.21.15.53:52954) 2023-06-10T18:57:16.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.446+0000 7f36e3fff640 1 -- 172.21.15.53:0/3307671119 learned_addr learned my addr 172.21.15.53:0/3307671119 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:57:16.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.446+0000 7f36e8e51640 1 --2- 172.21.15.53:0/3307671119 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36e414b1e0 0x7f36e40af210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:16.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.446+0000 7f36e9652640 1 --2- 172.21.15.53:0/3307671119 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36e415bb10 0x7f36e40b0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:16.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.446+0000 7f36e3fff640 1 -- 172.21.15.53:0/3307671119 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36e414b1e0 msgr2=0x7f36e40af210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:16.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.446+0000 7f36e3fff640 1 --2- 172.21.15.53:0/3307671119 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36e414b1e0 0x7f36e40af210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:16.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.446+0000 7f36e3fff640 1 -- 172.21.15.53:0/3307671119 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36e415bb10 msgr2=0x7f36e40b0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:16.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.446+0000 7f36e3fff640 1 --2- 172.21.15.53:0/3307671119 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36e415bb10 0x7f36e40b0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:16.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.446+0000 7f36e3fff640 1 -- 172.21.15.53:0/3307671119 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36e4159f70 con 0x7f36e40af750 2023-06-10T18:57:16.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.446+0000 7f36e3fff640 1 --2- 172.21.15.53:0/3307671119 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36e40af750 0x7f36e415b5d0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f36cc098040 tx=0x7f36d0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:16.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.446+0000 7f36e17fa640 1 -- 172.21.15.53:0/3307671119 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36cc0a9630 con 0x7f36e40af750 2023-06-10T18:57:16.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.446+0000 7f36e17fa640 1 -- 172.21.15.53:0/3307671119 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36cc0a9790 con 0x7f36e40af750 2023-06-10T18:57:16.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.446+0000 7f36eb0b5640 1 -- 172.21.15.53:0/3307671119 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36e415a250 con 0x7f36e40af750 2023-06-10T18:57:16.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.446+0000 7f36e17fa640 1 -- 172.21.15.53:0/3307671119 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36cc0a9b20 con 0x7f36e40af750 2023-06-10T18:57:16.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.446+0000 7f36eb0b5640 1 -- 172.21.15.53:0/3307671119 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36e415bf80 con 0x7f36e40af750 2023-06-10T18:57:16.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.446+0000 7f36eb0b5640 1 -- 172.21.15.53:0/3307671119 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36e404d790 con 0x7f36e40af750 2023-06-10T18:57:16.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.446+0000 7f36e17fa640 1 -- 172.21.15.53:0/3307671119 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f36cc0a9c80 con 0x7f36e40af750 2023-06-10T18:57:16.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.446+0000 7f36e17fa640 1 --2- 172.21.15.53:0/3307671119 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f36c40662b0 0x7f36c4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:16.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.446+0000 7f36e17fa640 1 -- 172.21.15.53:0/3307671119 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f36cc11dbe0 con 0x7f36e40af750 2023-06-10T18:57:16.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.446+0000 7f36e8e51640 1 --2- 172.21.15.53:0/3307671119 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f36c40662b0 0x7f36c4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:16.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.450+0000 7f36e8e51640 1 --2- 172.21.15.53:0/3307671119 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f36c40662b0 0x7f36c4068760 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f36d4004490 tx=0x7f36d4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:16.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.450+0000 7f36e17fa640 1 -- 172.21.15.53:0/3307671119 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f36cc0eb1a0 con 0x7f36e40af750 2023-06-10T18:57:16.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.598+0000 7f36eb0b5640 1 -- 172.21.15.53:0/3307671119 --> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f36e4070b40 con 0x7f36c40662b0 2023-06-10T18:57:16.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.618+0000 7f36e17fa640 1 -- 172.21.15.53:0/3307671119 <== mgr.4105 v2:172.21.15.117:6832/3061986771 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+297119 (secure 0 0 0) 0x7f36d400c050 con 0x7f36c40662b0 2023-06-10T18:57:16.626 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:57:16.627 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-06-10T18:57:16.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.622+0000 7f36eb0b5640 1 -- 172.21.15.53:0/3307671119 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f36c40662b0 msgr2=0x7f36c4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:16.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.622+0000 7f36eb0b5640 1 --2- 172.21.15.53:0/3307671119 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f36c40662b0 0x7f36c4068760 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f36d4004490 tx=0x7f36d4008040 comp rx=0 tx=0).stop 2023-06-10T18:57:16.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.622+0000 7f36eb0b5640 1 -- 172.21.15.53:0/3307671119 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36e40af750 msgr2=0x7f36e415b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:16.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.622+0000 7f36eb0b5640 1 --2- 172.21.15.53:0/3307671119 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36e40af750 0x7f36e415b5d0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f36cc098040 tx=0x7f36d0005800 comp rx=0 tx=0).stop 2023-06-10T18:57:16.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.622+0000 7f36eb0b5640 1 -- 172.21.15.53:0/3307671119 shutdown_connections 2023-06-10T18:57:16.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.622+0000 7f36eb0b5640 1 --2- 172.21.15.53:0/3307671119 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f36c40662b0 0x7f36c4068760 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:16.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.622+0000 7f36eb0b5640 1 --2- 172.21.15.53:0/3307671119 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36e415bb10 0x7f36e40b0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:16.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.622+0000 7f36eb0b5640 1 --2- 172.21.15.53:0/3307671119 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36e40af750 0x7f36e415b5d0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:16.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.622+0000 7f36eb0b5640 1 --2- 172.21.15.53:0/3307671119 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36e414b1e0 0x7f36e40af210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:16.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.622+0000 7f36eb0b5640 1 -- 172.21.15.53:0/3307671119 >> 172.21.15.53:0/3307671119 conn(0x7f36e406a0d0 msgr2=0x7f36e40ca370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:16.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.622+0000 7f36eb0b5640 1 -- 172.21.15.53:0/3307671119 shutdown_connections 2023-06-10T18:57:16.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.622+0000 7f36eb0b5640 1 -- 172.21.15.53:0/3307671119 wait complete. 2023-06-10T18:57:16.643 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":200,"stamp":"2023-06-10T18:57:15.659031+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238960,"kb_used_data":6960,"kb_used_omap":0,"kb_used_meta":231936,"kb_avail":754735760,"statfs":{"total":773094113280,"available":772849418240,"internally_reserved":0,"allocated":7127040,"data_stored":3781845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":237502464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001139"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.858048+0000","last_change":"2023-06-10T18:57:11.858048+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.858048+0000","last_undegraded":"2023-06-10T18:57:11.858048+0000","last_fullsized":"2023-06-10T18:57:11.858048+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.867848+0000","last_change":"2023-06-10T18:57:11.867848+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.867848+0000","last_undegraded":"2023-06-10T18:57:11.867848+0000","last_fullsized":"2023-06-10T18:57:11.867848+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.867289+0000","last_change":"2023-06-10T18:57:11.867289+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.867289+0000","last_undegraded":"2023-06-10T18:57:11.867289+0000","last_fullsized":"2023-06-10T18:57:11.867289+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.868398+0000","last_change":"2023-06-10T18:57:11.868398+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.868398+0000","last_undegraded":"2023-06-10T18:57:11.868398+0000","last_fullsized":"2023-06-10T18:57:11.868398+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.864218+0000","last_change":"2023-06-10T18:57:11.864218+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.864218+0000","last_undegraded":"2023-06-10T18:57:11.864218+0000","last_fullsized":"2023-06-10T18:57:11.864218+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.865117+0000","last_change":"2023-06-10T18:57:11.865117+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.865117+0000","last_undegraded":"2023-06-10T18:57:11.865117+0000","last_fullsized":"2023-06-10T18:57:11.865117+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.864215+0000","last_change":"2023-06-10T18:57:11.864215+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.864215+0000","last_undegraded":"2023-06-10T18:57:11.864215+0000","last_fullsized":"2023-06-10T18:57:11.864215+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.852046+0000","last_change":"2023-06-10T18:57:11.852046+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.852046+0000","last_undegraded":"2023-06-10T18:57:11.852046+0000","last_fullsized":"2023-06-10T18:57:11.852046+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.858422+0000","last_change":"2023-06-10T18:57:11.858422+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.858422+0000","last_undegraded":"2023-06-10T18:57:11.858422+0000","last_fullsized":"2023-06-10T18:57:11.858422+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.853111+0000","last_change":"2023-06-10T18:57:11.853111+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.853111+0000","last_undegraded":"2023-06-10T18:57:11.853111+0000","last_fullsized":"2023-06-10T18:57:11.853111+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.858596+0000","last_change":"2023-06-10T18:57:11.858596+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.858596+0000","last_undegraded":"2023-06-10T18:57:11.858596+0000","last_fullsized":"2023-06-10T18:57:11.858596+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.858699+0000","last_change":"2023-06-10T18:57:11.858699+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.858699+0000","last_undegraded":"2023-06-10T18:57:11.858699+0000","last_fullsized":"2023-06-10T18:57:11.858699+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.858402+0000","last_change":"2023-06-10T18:57:11.858402+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.858402+0000","last_undegraded":"2023-06-10T18:57:11.858402+0000","last_fullsized":"2023-06-10T18:57:11.858402+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.872354+0000","last_change":"2023-06-10T18:57:11.872354+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.872354+0000","last_undegraded":"2023-06-10T18:57:11.872354+0000","last_fullsized":"2023-06-10T18:57:11.872354+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.857189+0000","last_change":"2023-06-10T18:57:11.857189+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.857189+0000","last_undegraded":"2023-06-10T18:57:11.857189+0000","last_fullsized":"2023-06-10T18:57:11.857189+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.853005+0000","last_change":"2023-06-10T18:57:11.853005+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.853005+0000","last_undegraded":"2023-06-10T18:57:11.853005+0000","last_fullsized":"2023-06-10T18:57:11.853005+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.871215+0000","last_change":"2023-06-10T18:57:11.871215+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.871215+0000","last_undegraded":"2023-06-10T18:57:11.871215+0000","last_fullsized":"2023-06-10T18:57:11.871215+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.871166+0000","last_change":"2023-06-10T18:57:11.871166+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.871166+0000","last_undegraded":"2023-06-10T18:57:11.871166+0000","last_fullsized":"2023-06-10T18:57:11.871166+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.868169+0000","last_change":"2023-06-10T18:57:11.868169+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.868169+0000","last_undegraded":"2023-06-10T18:57:11.868169+0000","last_fullsized":"2023-06-10T18:57:11.868169+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.857982+0000","last_change":"2023-06-10T18:57:11.857982+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.857982+0000","last_undegraded":"2023-06-10T18:57:11.857982+0000","last_fullsized":"2023-06-10T18:57:11.857982+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.857076+0000","last_change":"2023-06-10T18:57:11.857076+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.857076+0000","last_undegraded":"2023-06-10T18:57:11.857076+0000","last_fullsized":"2023-06-10T18:57:11.857076+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.864162+0000","last_change":"2023-06-10T18:57:11.864162+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.864162+0000","last_undegraded":"2023-06-10T18:57:11.864162+0000","last_fullsized":"2023-06-10T18:57:11.864162+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.865225+0000","last_change":"2023-06-10T18:57:11.865225+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.865225+0000","last_undegraded":"2023-06-10T18:57:11.865225+0000","last_fullsized":"2023-06-10T18:57:11.865225+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.857958+0000","last_change":"2023-06-10T18:57:11.857958+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.857958+0000","last_undegraded":"2023-06-10T18:57:11.857958+0000","last_fullsized":"2023-06-10T18:57:11.857958+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.864162+0000","last_change":"2023-06-10T18:57:11.864162+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.864162+0000","last_undegraded":"2023-06-10T18:57:11.864162+0000","last_fullsized":"2023-06-10T18:57:11.864162+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":243,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-06-10T18:57:11.860040+0000","last_change":"2023-06-10T18:52:34.951528+0000","last_active":"2023-06-10T18:57:11.860040+0000","last_peered":"2023-06-10T18:57:11.860040+0000","last_clean":"2023-06-10T18:57:11.860040+0000","last_became_active":"2023-06-10T18:52:34.949099+0000","last_became_peered":"2023-06-10T18:52:34.949099+0000","last_unstale":"2023-06-10T18:57:11.860040+0000","last_undegraded":"2023-06-10T18:57:11.860040+0000","last_fullsized":"2023-06-10T18:57:11.860040+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_clean_scrub_stamp":"2023-06-10T18:52:33.633295+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:02:34.447395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":89,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-06-10T18:57:11.873465+0000","last_change":"2023-06-10T18:52:40.506384+0000","last_active":"2023-06-10T18:57:11.873465+0000","last_peered":"2023-06-10T18:57:11.873465+0000","last_clean":"2023-06-10T18:57:11.873465+0000","last_became_active":"2023-06-10T18:52:40.505701+0000","last_became_peered":"2023-06-10T18:52:40.505701+0000","last_unstale":"2023-06-10T18:57:11.873465+0000","last_undegraded":"2023-06-10T18:57:11.873465+0000","last_fullsized":"2023-06-10T18:57:11.873465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:01:38.268612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.867782+0000","last_change":"2023-06-10T18:57:11.867782+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.867782+0000","last_undegraded":"2023-06-10T18:57:11.867782+0000","last_fullsized":"2023-06-10T18:57:11.867782+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":87,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-06-10T18:57:11.859674+0000","last_change":"2023-06-10T18:52:40.512015+0000","last_active":"2023-06-10T18:57:11.859674+0000","last_peered":"2023-06-10T18:57:11.859674+0000","last_clean":"2023-06-10T18:57:11.859674+0000","last_became_active":"2023-06-10T18:52:40.511382+0000","last_became_peered":"2023-06-10T18:52:40.511382+0000","last_unstale":"2023-06-10T18:57:11.859674+0000","last_undegraded":"2023-06-10T18:57:11.859674+0000","last_fullsized":"2023-06-10T18:57:11.859674+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:32:10.225462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.871187+0000","last_change":"2023-06-10T18:57:11.871187+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.871187+0000","last_undegraded":"2023-06-10T18:57:11.871187+0000","last_fullsized":"2023-06-10T18:57:11.871187+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":91,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-06-10T18:57:11.851098+0000","last_change":"2023-06-10T18:52:40.671725+0000","last_active":"2023-06-10T18:57:11.851098+0000","last_peered":"2023-06-10T18:57:11.851098+0000","last_clean":"2023-06-10T18:57:11.851098+0000","last_became_active":"2023-06-10T18:52:40.671442+0000","last_became_peered":"2023-06-10T18:52:40.671442+0000","last_unstale":"2023-06-10T18:57:11.851098+0000","last_undegraded":"2023-06-10T18:57:11.851098+0000","last_fullsized":"2023-06-10T18:57:11.851098+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:41:17.572105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.867223+0000","last_change":"2023-06-10T18:57:11.867223+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.867223+0000","last_undegraded":"2023-06-10T18:57:11.867223+0000","last_fullsized":"2023-06-10T18:57:11.867223+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":89,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-06-10T18:57:11.873707+0000","last_change":"2023-06-10T18:52:40.510258+0000","last_active":"2023-06-10T18:57:11.873707+0000","last_peered":"2023-06-10T18:57:11.873707+0000","last_clean":"2023-06-10T18:57:11.873707+0000","last_became_active":"2023-06-10T18:52:40.509560+0000","last_became_peered":"2023-06-10T18:52:40.509560+0000","last_unstale":"2023-06-10T18:57:11.873707+0000","last_undegraded":"2023-06-10T18:57:11.873707+0000","last_fullsized":"2023-06-10T18:57:11.873707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:02:39.344511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.872455+0000","last_change":"2023-06-10T18:57:11.872455+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.872455+0000","last_undegraded":"2023-06-10T18:57:11.872455+0000","last_fullsized":"2023-06-10T18:57:11.872455+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":83,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-06-10T18:57:11.859334+0000","last_change":"2023-06-10T18:52:40.672266+0000","last_active":"2023-06-10T18:57:11.859334+0000","last_peered":"2023-06-10T18:57:11.859334+0000","last_clean":"2023-06-10T18:57:11.859334+0000","last_became_active":"2023-06-10T18:52:40.671966+0000","last_became_peered":"2023-06-10T18:52:40.671966+0000","last_unstale":"2023-06-10T18:57:11.859334+0000","last_undegraded":"2023-06-10T18:57:11.859334+0000","last_fullsized":"2023-06-10T18:57:11.859334+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:20:22.653473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.857155+0000","last_change":"2023-06-10T18:57:11.857155+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.857155+0000","last_undegraded":"2023-06-10T18:57:11.857155+0000","last_fullsized":"2023-06-10T18:57:11.857155+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":87,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-06-10T18:57:11.860042+0000","last_change":"2023-06-10T18:52:40.671084+0000","last_active":"2023-06-10T18:57:11.860042+0000","last_peered":"2023-06-10T18:57:11.860042+0000","last_clean":"2023-06-10T18:57:11.860042+0000","last_became_active":"2023-06-10T18:52:40.670697+0000","last_became_peered":"2023-06-10T18:52:40.670697+0000","last_unstale":"2023-06-10T18:57:11.860042+0000","last_undegraded":"2023-06-10T18:57:11.860042+0000","last_fullsized":"2023-06-10T18:57:11.860042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:38:30.948317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.857096+0000","last_change":"2023-06-10T18:57:11.857096+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.857096+0000","last_undegraded":"2023-06-10T18:57:11.857096+0000","last_fullsized":"2023-06-10T18:57:11.857096+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":83,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-06-10T18:57:11.859351+0000","last_change":"2023-06-10T18:52:40.514114+0000","last_active":"2023-06-10T18:57:11.859351+0000","last_peered":"2023-06-10T18:57:11.859351+0000","last_clean":"2023-06-10T18:57:11.859351+0000","last_became_active":"2023-06-10T18:52:40.513638+0000","last_became_peered":"2023-06-10T18:52:40.513638+0000","last_unstale":"2023-06-10T18:57:11.859351+0000","last_undegraded":"2023-06-10T18:57:11.859351+0000","last_fullsized":"2023-06-10T18:57:11.859351+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:44:43.932666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.864245+0000","last_change":"2023-06-10T18:57:11.864245+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.864245+0000","last_undegraded":"2023-06-10T18:57:11.864245+0000","last_fullsized":"2023-06-10T18:57:11.864245+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":91,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-06-10T18:57:11.851590+0000","last_change":"2023-06-10T18:52:40.515396+0000","last_active":"2023-06-10T18:57:11.851590+0000","last_peered":"2023-06-10T18:57:11.851590+0000","last_clean":"2023-06-10T18:57:11.851590+0000","last_became_active":"2023-06-10T18:52:40.514663+0000","last_became_peered":"2023-06-10T18:52:40.514663+0000","last_unstale":"2023-06-10T18:57:11.851590+0000","last_undegraded":"2023-06-10T18:57:11.851590+0000","last_fullsized":"2023-06-10T18:57:11.851590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:26:51.297957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574907,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28260,"kb_used_data":1308,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343580,"statfs":{"total":96636764160,"available":96607825920,"internally_reserved":0,"allocated":1339392,"data_stored":916660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.89800000000000002,"15min":0.88},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.1850000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.038},{"interface":"front","average":{"1min":0.874,"5min":0.93300000000000005,"15min":0.92700000000000005},"min":{"1min":0.52900000000000003,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1910000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.66000000000000003}]},{"osd":1,"last update":"Sat Jun 10 18:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.93200000000000005,"15min":0.91800000000000004},"min":{"1min":0.56100000000000005,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.3759999999999999,"5min":1.377,"15min":1.377},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.93300000000000005,"15min":0.91300000000000003},"min":{"1min":0.70099999999999996,"5min":0.504,"15min":0.504},"max":{"1min":1.2529999999999999,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.78000000000000003}]},{"osd":2,"last update":"Sat Jun 10 18:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.83699999999999997,"15min":0.82699999999999996},"min":{"1min":0.49299999999999999,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.04,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.89100000000000001,"15min":0.90400000000000003},"min":{"1min":0.56100000000000005,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1930000000000001,"5min":1.367,"15min":1.367},"last":0.96199999999999997}]},{"osd":3,"last update":"Sat Jun 10 18:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.92900000000000005,"15min":0.90100000000000002},"min":{"1min":0.59699999999999998,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.167,"5min":1.502,"15min":1.502},"last":1.0649999999999999},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.94199999999999995,"15min":0.92900000000000005},"min":{"1min":0.63,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.2230000000000001,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":1.1279999999999999}]},{"osd":4,"last update":"Sat Jun 10 18:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.871,"15min":0.871},"min":{"1min":0.57399999999999995,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.1639999999999999,"5min":1.639,"15min":1.639},"last":1.097},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.95999999999999996,"15min":0.97799999999999998},"min":{"1min":0.65200000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.22,"5min":1.411,"15min":1.411},"last":1.1639999999999999}]},{"osd":5,"last update":"Sat Jun 10 18:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":1.0189999999999999,"15min":1.0309999999999999},"min":{"1min":0.60099999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.2210000000000001,"5min":1.806,"15min":1.806},"last":1.2210000000000001},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.038,"15min":1.048},"min":{"1min":0.71299999999999997,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.26,"5min":1.522,"15min":1.522},"last":1.2450000000000001}]},{"osd":6,"last update":"Sat Jun 10 18:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.995,"15min":1.002},"min":{"1min":0.66400000000000003,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.2170000000000001,"5min":1.718,"15min":1.718},"last":0.93000000000000005},{"interface":"front","average":{"1min":1.048,"5min":1.087,"15min":1.087},"min":{"1min":0.83599999999999997,"5min":0.441,"15min":0.441},"max":{"1min":1.2889999999999999,"5min":1.464,"15min":1.464},"last":1.3169999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574908,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27680,"kb_used_data":728,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344160,"statfs":{"total":96636764160,"available":96608419840,"internally_reserved":0,"allocated":745472,"data_stored":326292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:56:33 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.84999999999999998,"15min":0.81100000000000005},"min":{"1min":0.66700000000000004,"5min":0.502,"15min":0.502},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":0.755},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.878,"15min":0.84799999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.78800000000000003}]},{"osd":1,"last update":"Sat Jun 10 18:56:33 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.88,"15min":0.85399999999999998},"min":{"1min":0.53400000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0900000000000001,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.89500000000000002,"15min":0.86399999999999999},"min":{"1min":0.53800000000000003,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.587,"5min":1.778,"15min":1.778},"last":1.0640000000000001}]},{"osd":2,"last update":"Sat Jun 10 18:56:33 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.88300000000000001,"15min":0.86299999999999999},"min":{"1min":0.57399999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.1819999999999999,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.871,"5min":0.88100000000000001,"15min":0.88800000000000001},"min":{"1min":0.60299999999999998,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.177,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":1.012}]},{"osd":3,"last update":"Sat Jun 10 18:56:33 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":0.90800000000000003,"15min":0.85999999999999999},"min":{"1min":0.64500000000000002,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":0.60799999999999998},{"interface":"front","average":{"1min":1,"5min":0.998,"15min":0.996},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.90600000000000003}]},{"osd":4,"last update":"Sat Jun 10 18:56:33 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.93000000000000005,"15min":0.95199999999999996},"min":{"1min":0.63,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":0.86299999999999999},{"interface":"front","average":{"1min":1.024,"5min":1.0049999999999999,"15min":1.0189999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.54,"5min":1.54,"15min":1.54},"last":0.70299999999999996}]},{"osd":5,"last update":"Sat Jun 10 18:56:33 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.93500000000000005,"15min":0.95699999999999996},"min":{"1min":0.70299999999999996,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":1.097},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.044,"15min":1.032},"min":{"1min":0.83699999999999997,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":2.536,"5min":2.536,"15min":2.536},"last":0.96099999999999997}]},{"osd":7,"last update":"Sat Jun 10 18:56:33 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.036,"15min":1.048},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.917,"5min":1.917,"15min":1.917},"last":1.0389999999999999},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.05,"15min":1.0629999999999999},"min":{"1min":0.79400000000000004,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.395,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.81899999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574908,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27680,"kb_used_data":728,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344160,"statfs":{"total":96636764160,"available":96608419840,"internally_reserved":0,"allocated":745472,"data_stored":326292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84499999999999997,"15min":0.83099999999999996},"min":{"1min":0.60999999999999999,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.879,"5min":0.90300000000000002,"15min":0.93700000000000006},"min":{"1min":0.58799999999999997,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1499999999999999,"5min":1.637,"15min":1.637},"last":0.89800000000000002}]},{"osd":1,"last update":"Sat Jun 10 18:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.89000000000000001,"15min":0.91200000000000003},"min":{"1min":0.54400000000000004,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.107,"5min":1.335,"15min":1.335},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.91700000000000004,"15min":0.92100000000000004},"min":{"1min":0.63600000000000001,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.444,"5min":1.78,"15min":1.78},"last":0.57699999999999996}]},{"osd":2,"last update":"Sat Jun 10 18:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.84299999999999997,"15min":0.85099999999999998},"min":{"1min":0.54400000000000004,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.995,"5min":1.446,"15min":1.446},"last":1.0509999999999999},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.163,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.65700000000000003}]},{"osd":3,"last update":"Sat Jun 10 18:56:37 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":0.95299999999999996,"15min":0.94899999999999995},"min":{"1min":0.75900000000000001,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.3440000000000001,"5min":1.484,"15min":1.484},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.998,"15min":1.034},"min":{"1min":0.66700000000000004,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.1910000000000001,"5min":1.337,"15min":1.337},"last":1.0029999999999999}]},{"osd":4,"last update":"Sat Jun 10 18:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.94499999999999995,"15min":0.98099999999999998},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.0720000000000001,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":1.002,"5min":1.0189999999999999,"15min":1.0589999999999999},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.528,"5min":1.575,"15min":1.575},"last":0.69599999999999995}]},{"osd":6,"last update":"Sat Jun 10 18:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":1.0089999999999999,"15min":1.0680000000000001},"min":{"1min":0.629,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.1799999999999999,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.1499999999999999},{"interface":"front","average":{"1min":0.97899999999999998,"5min":1.0389999999999999,"15min":1.0720000000000001},"min":{"1min":0.67200000000000004,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.1859999999999999,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.81999999999999995}]},{"osd":7,"last update":"Sat Jun 10 18:56:37 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.123,"15min":1.169},"min":{"1min":0.85199999999999998,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.573,"5min":1.873,"15min":1.873},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.1339999999999999,"15min":1.1739999999999999},"min":{"1min":0.877,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.4750000000000001,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.3149999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574907,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27680,"kb_used_data":728,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344160,"statfs":{"total":96636764160,"available":96608419840,"internally_reserved":0,"allocated":745472,"data_stored":326292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.78700000000000003,"15min":0.752},"min":{"1min":0.49299999999999999,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.157,"5min":1.2,"15min":1.2},"last":0.998},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.89700000000000002,"15min":0.88500000000000001},"min":{"1min":0.66500000000000004,"5min":0.504,"15min":0.504},"max":{"1min":1.2350000000000001,"5min":1.73,"15min":1.73},"last":0.71799999999999997}]},{"osd":1,"last update":"Sat Jun 10 18:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.94799999999999995,"15min":0.95399999999999996},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.179,"5min":1.601,"15min":1.601},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.87,"5min":0.85299999999999998,"15min":0.83899999999999997},"min":{"1min":0.63400000000000001,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.3029999999999999,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.67600000000000005}]},{"osd":2,"last update":"Sat Jun 10 18:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.877,"15min":0.875},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.089,"5min":1.522,"15min":1.522},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.98999999999999999,"15min":1},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.2629999999999999,"5min":1.552,"15min":1.552},"last":0.57799999999999996}]},{"osd":3,"last update":"Sat Jun 10 18:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.89900000000000002,"15min":0.88},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.1990000000000001,"5min":1.22,"15min":1.22},"last":0.53900000000000003},{"interface":"front","average":{"1min":1.02,"5min":0.97299999999999998,"15min":0.95599999999999996},"min":{"1min":0.78900000000000003,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.159,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.92300000000000004}]},{"osd":5,"last update":"Sat Jun 10 18:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.95099999999999996,"15min":0.98899999999999999},"min":{"1min":0.68200000000000005,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.27,"5min":1.663,"15min":1.663},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.999,"5min":0.95499999999999996,"15min":0.98199999999999998},"min":{"1min":0.69899999999999995,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.234,"5min":1.353,"15min":1.353},"last":0.89300000000000002}]},{"osd":6,"last update":"Sat Jun 10 18:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.98799999999999999,"15min":1.024},"min":{"1min":0.65500000000000003,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.242,"5min":2.2639999999999998,"15min":2.2639999999999998},"last":1.105},{"interface":"front","average":{"1min":1.054,"5min":1.0669999999999999,"15min":1.0740000000000001},"min":{"1min":0.72599999999999998,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.2849999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.95299999999999996}]},{"osd":7,"last update":"Sat Jun 10 18:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.98399999999999999,"15min":0.99399999999999999},"min":{"1min":0.68999999999999995,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.2350000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.0600000000000001,"15min":1.0740000000000001},"min":{"1min":0.78500000000000003,"5min":0.628,"15min":0.628},"max":{"1min":1.3879999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":1.2669999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574906,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31772,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340068,"statfs":{"total":96636764160,"available":96604229632,"internally_reserved":0,"allocated":741376,"data_stored":325273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:56:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.60099999999999998,"15min":0.57999999999999996},"min":{"1min":0.432,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.65300000000000002,"15min":0.63700000000000001},"min":{"1min":0.35599999999999998,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.0129999999999999,"5min":1.286,"15min":1.286},"last":0.5}]},{"osd":1,"last update":"Sat Jun 10 18:56:36 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.67500000000000004,"15min":0.63200000000000001},"min":{"1min":0.45500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":1.2569999999999999},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.74299999999999999,"15min":0.72299999999999998},"min":{"1min":0.48599999999999999,"5min":0.318,"15min":0.318},"max":{"1min":1.143,"5min":1.411,"15min":1.411},"last":0.95399999999999996}]},{"osd":2,"last update":"Sat Jun 10 18:56:36 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.77400000000000002,"15min":0.754},"min":{"1min":0.48999999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.3759999999999999,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":0.749},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.76800000000000002,"15min":0.745},"min":{"1min":0.52900000000000003,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.125,"5min":1.264,"15min":1.264},"last":1.2170000000000001}]},{"osd":4,"last update":"Sat Jun 10 18:56:36 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.95399999999999996,"15min":0.96599999999999997},"min":{"1min":0.747,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.3360000000000001,"5min":1.488,"15min":1.488},"last":0.879},{"interface":"front","average":{"1min":1.026,"5min":0.997,"15min":0.99299999999999999},"min":{"1min":0.65500000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.3700000000000001,"5min":1.458,"15min":1.458},"last":1.3400000000000001}]},{"osd":5,"last update":"Sat Jun 10 18:56:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":1.026,"15min":1.0549999999999999},"min":{"1min":0.68000000000000005,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.431,"5min":2.024,"15min":2.024},"last":0.91600000000000004},{"interface":"front","average":{"1min":1.117,"5min":1.0469999999999999,"15min":1.0209999999999999},"min":{"1min":0.94299999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.4139999999999999,"5min":1.724,"15min":1.724},"last":1.304}]},{"osd":6,"last update":"Sat Jun 10 18:56:36 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.0669999999999999,"15min":1.0529999999999999},"min":{"1min":0.83199999999999996,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.5449999999999999,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":1.139},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.0640000000000001,"15min":1.0740000000000001},"min":{"1min":0.75900000000000001,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.514,"5min":1.78,"15min":1.78},"last":1.173}]},{"osd":7,"last update":"Sat Jun 10 18:56:36 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.105,"15min":1.129},"min":{"1min":0.82599999999999996,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.5900000000000001,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.099,"15min":1.077},"min":{"1min":0.71799999999999997,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.5429999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":1.091}]}]},{"osd":2,"up_from":13,"seq":55834574907,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31764,"kb_used_data":716,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340076,"statfs":{"total":96636764160,"available":96604237824,"internally_reserved":0,"allocated":733184,"data_stored":320122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.60699999999999998,"15min":0.58999999999999997},"min":{"1min":0.36499999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.91700000000000004,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.432},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.436,"5min":0.378,"15min":0.378},"max":{"1min":1.0580000000000001,"5min":1.224,"15min":1.224},"last":0.58199999999999996}]},{"osd":1,"last update":"Sat Jun 10 18:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.66300000000000003,"15min":0.65100000000000002},"min":{"1min":0.39700000000000002,"5min":0.307,"15min":0.307},"max":{"1min":1.0109999999999999,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":1.099},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.753,"15min":0.69999999999999996},"min":{"1min":0.41699999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.64100000000000001}]},{"osd":3,"last update":"Sat Jun 10 18:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.745,"15min":0.70899999999999996},"min":{"1min":0.44700000000000001,"5min":0.377,"15min":0.377},"max":{"1min":1.0609999999999999,"5min":1.165,"15min":1.165},"last":1.006},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.76400000000000001,"15min":0.751},"min":{"1min":0.32900000000000001,"5min":0.252,"15min":0.252},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.80500000000000005}]},{"osd":4,"last update":"Sat Jun 10 18:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.92300000000000004,"15min":0.91700000000000004},"min":{"1min":0.63,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.2769999999999999,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":1.05},{"interface":"front","average":{"1min":1.046,"5min":1.036,"15min":1.038},"min":{"1min":0.70199999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.3169999999999999,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.85399999999999998}]},{"osd":5,"last update":"Sat Jun 10 18:56:37 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.0289999999999999,"15min":1.0209999999999999},"min":{"1min":0.64600000000000002,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.3759999999999999,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":1.032},{"interface":"front","average":{"1min":1.056,"5min":1.02,"15min":0.98399999999999999},"min":{"1min":0.78200000000000003,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.4119999999999999,"5min":1.667,"15min":1.667},"last":0.88800000000000001}]},{"osd":6,"last update":"Sat Jun 10 18:56:37 2023","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.0609999999999999,"15min":1.0289999999999999},"min":{"1min":0.873,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.4550000000000001,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":1.153},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.0509999999999999,"15min":1.038},"min":{"1min":0.66000000000000003,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.96999999999999997}]},{"osd":7,"last update":"Sat Jun 10 18:56:37 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.1060000000000001,"15min":1.1020000000000001},"min":{"1min":0.83899999999999997,"5min":0.62,"15min":0.62},"max":{"1min":1.458,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.94599999999999995},{"interface":"front","average":{"1min":1.181,"5min":1.121,"15min":1.083},"min":{"1min":0.76400000000000001,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.5920000000000001,"5min":1.752,"15min":1.752},"last":0.71799999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574909,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31772,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340068,"statfs":{"total":96636764160,"available":96604229632,"internally_reserved":0,"allocated":741376,"data_stored":325273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.66600000000000004,"15min":0.65900000000000003},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.0149999999999999,"5min":1.288,"15min":1.288},"last":1.0600000000000001},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.72799999999999998,"15min":0.68799999999999994},"min":{"1min":0.38300000000000001,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.0089999999999999,"5min":1.694,"15min":1.694},"last":0.98099999999999998}]},{"osd":2,"last update":"Sat Jun 10 18:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.63200000000000001,"15min":0.61899999999999999},"min":{"1min":0.27300000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.77300000000000002,"5min":1.21,"15min":1.21},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71899999999999997,"15min":0.66300000000000003},"min":{"1min":0.33800000000000002,"5min":0.315,"15min":0.315},"max":{"1min":1.171,"5min":1.415,"15min":1.415},"last":0.63700000000000001}]},{"osd":3,"last update":"Sat Jun 10 18:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79200000000000004,"15min":0.75},"min":{"1min":0.33400000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.4139999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.755,"15min":0.747},"min":{"1min":0.35399999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.0649999999999999,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":0.79000000000000004}]},{"osd":4,"last update":"Sat Jun 10 18:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.875,"15min":0.83799999999999997},"min":{"1min":0.56799999999999995,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0329999999999999,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.95799999999999996,"5min":1.0960000000000001,"15min":1.0720000000000001},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.5129999999999999,"5min":5.8209999999999997,"15min":5.8209999999999997},"last":0.83499999999999996}]},{"osd":5,"last update":"Sat Jun 10 18:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":1.018,"15min":1.024},"min":{"1min":0.58499999999999996,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.2829999999999999,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":1.589},{"interface":"front","average":{"1min":0.90400000000000003,"5min":1.004,"15min":0.96799999999999997},"min":{"1min":0.60699999999999998,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.1599999999999999,"5min":3.089,"15min":3.089},"last":0.93899999999999995}]},{"osd":6,"last update":"Sat Jun 10 18:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":1.105,"15min":1.0309999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.472,"5min":7.2599999999999998,"15min":7.2599999999999998},"last":1.478},{"interface":"front","average":{"1min":0.92900000000000005,"5min":1.0940000000000001,"15min":1.026},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.2090000000000001,"5min":9.0069999999999997,"15min":9.0069999999999997},"last":1.1040000000000001}]},{"osd":7,"last update":"Sat Jun 10 18:56:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.0920000000000001,"15min":1.081},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.3440000000000001,"5min":2.105,"15min":2.105},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.083,"15min":1.0669999999999999},"min":{"1min":0.65600000000000003,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.673,"5min":2.2570000000000001,"15min":2.2570000000000001},"last":1.6399999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574908,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32352,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339488,"statfs":{"total":96636764160,"available":96603635712,"internally_reserved":0,"allocated":1335296,"data_stored":915641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jun 10 18:56:40 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.626,"15min":0.60299999999999998},"min":{"1min":0.35599999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.93899999999999995,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.78500000000000003,"15min":0.75},"min":{"1min":0.53100000000000003,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.028,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":1.0329999999999999}]},{"osd":2,"last update":"Sat Jun 10 18:56:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.71399999999999997,"15min":0.69899999999999995},"min":{"1min":0.39400000000000002,"5min":0.313,"15min":0.313},"max":{"1min":1.073,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65400000000000003,"15min":0.63300000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.95099999999999996,"5min":1.371,"15min":1.371},"last":0.56499999999999995}]},{"osd":3,"last update":"Sat Jun 10 18:56:40 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.70099999999999996,"15min":0.67700000000000005},"min":{"1min":0.377,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.087,"5min":1.226,"15min":1.226},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.84099999999999997,"15min":0.81399999999999995},"min":{"1min":0.435,"5min":0.375,"15min":0.375},"max":{"1min":1.296,"5min":1.829,"15min":1.829},"last":0.80500000000000005}]},{"osd":4,"last update":"Sat Jun 10 18:56:40 2023","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.91100000000000003,"15min":0.89300000000000002},"min":{"1min":0.59099999999999997,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.173,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.83399999999999996},{"interface":"front","average":{"1min":1.034,"5min":1.0369999999999999,"15min":1.034},"min":{"1min":0.65600000000000003,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.2729999999999999,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":1.1599999999999999}]},{"osd":5,"last update":"Sat Jun 10 18:56:40 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.64300000000000002,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.2450000000000001,"5min":1.694,"15min":1.694},"last":0.86599999999999999},{"interface":"front","average":{"1min":1.044,"5min":1.01,"15min":1.0009999999999999},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.3460000000000001,"5min":1.75,"15min":1.75},"last":0.996}]},{"osd":6,"last update":"Sat Jun 10 18:56:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.0740000000000001,"15min":1.0569999999999999},"min":{"1min":0.61699999999999999,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.2949999999999999,"5min":2.04,"15min":2.04},"last":1.2250000000000001},{"interface":"front","average":{"1min":1.03,"5min":1.0029999999999999,"15min":0.999},"min":{"1min":0.71099999999999997,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.3280000000000001,"5min":1.883,"15min":1.883},"last":1.0740000000000001}]},{"osd":7,"last update":"Sat Jun 10 18:56:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.044,"15min":1.0349999999999999},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.3360000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.96799999999999997},{"interface":"front","average":{"1min":1.099,"5min":1.0660000000000001,"15min":1.054},"min":{"1min":0.69299999999999995,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.4610000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.115}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-10T18:57:16.650 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-10T18:57:16.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.802+0000 7f475d5f1640 1 Processor -- start 2023-06-10T18:57:16.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.802+0000 7f475d5f1640 1 -- start start 2023-06-10T18:57:16.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.802+0000 7f475d5f1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47580cc690 0x7f47580d04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:16.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.802+0000 7f475d5f1640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47580d0020 con 0x7f47580ccae0 2023-06-10T18:57:16.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.802+0000 7f475d5f1640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47580cef40 con 0x7f47580b3ac0 2023-06-10T18:57:16.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.802+0000 7f475d5f1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47580cf220 con 0x7f47580cc690 2023-06-10T18:57:16.809 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.802+0000 7f47577fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f47580ccae0 0x7f47580d09f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:48262/0 (socket says 172.21.15.53:48262) 2023-06-10T18:57:16.809 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.802+0000 7f47577fe640 1 -- 172.21.15.53:0/2737938347 learned_addr learned my addr 172.21.15.53:0/2737938347 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:57:16.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.802+0000 7f47567fc640 1 --2- 172.21.15.53:0/2737938347 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47580cc690 0x7f47580d04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:16.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.802+0000 7f4755ffb640 1 -- 172.21.15.53:0/2737938347 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 79975350 0 0) 0x7f47580d0020 con 0x7f47580ccae0 2023-06-10T18:57:16.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.802+0000 7f4755ffb640 1 -- 172.21.15.53:0/2737938347 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4740003530 con 0x7f47580ccae0 2023-06-10T18:57:16.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.802+0000 7f4755ffb640 1 -- 172.21.15.53:0/2737938347 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3299704626 0 0) 0x7f47580cef40 con 0x7f47580b3ac0 2023-06-10T18:57:16.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.802+0000 7f4755ffb640 1 -- 172.21.15.53:0/2737938347 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47580d0020 con 0x7f47580b3ac0 2023-06-10T18:57:16.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.802+0000 7f4755ffb640 1 -- 172.21.15.53:0/2737938347 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4065333230 0 0) 0x7f4740003530 con 0x7f47580ccae0 2023-06-10T18:57:16.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.802+0000 7f4755ffb640 1 -- 172.21.15.53:0/2737938347 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47580cc690 msgr2=0x7f47580d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:16.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.802+0000 7f4755ffb640 1 --2- 172.21.15.53:0/2737938347 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47580cc690 0x7f47580d04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:16.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.802+0000 7f4755ffb640 1 -- 172.21.15.53:0/2737938347 >> v1:172.21.15.117:6789/0 conn(0x7f47580b3ac0 legacy=0x7f47580b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:16.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.802+0000 7f4755ffb640 1 -- 172.21.15.53:0/2737938347 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47580cf500 con 0x7f47580ccae0 2023-06-10T18:57:16.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.802+0000 7f4755ffb640 1 -- 172.21.15.53:0/2737938347 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f4750001a00 con 0x7f47580ccae0 2023-06-10T18:57:16.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.802+0000 7f4755ffb640 1 -- 172.21.15.53:0/2737938347 >> v1:172.21.15.53:6789/0 conn(0x7f47580ccae0 legacy=0x7f47580d09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:16.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.802+0000 7f4755ffb640 1 --2- 172.21.15.53:0/2737938347 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47580cc690 0x7f4740003bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:16.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.802+0000 7f4755ffb640 1 --2- 172.21.15.53:0/2737938347 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4740004110 0x7f47400047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:16.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.802+0000 7f4755ffb640 1 --2- 172.21.15.53:0/2737938347 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4740004d10 0x7f4740005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:16.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.802+0000 7f4755ffb640 1 -- 172.21.15.53:0/2737938347 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47580cf220 con 0x7f4740004110 2023-06-10T18:57:16.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.802+0000 7f4755ffb640 1 -- 172.21.15.53:0/2737938347 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f474000baa0 con 0x7f4740004d10 2023-06-10T18:57:16.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.802+0000 7f4755ffb640 1 -- 172.21.15.53:0/2737938347 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f474000bc60 con 0x7f47580cc690 2023-06-10T18:57:16.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.802+0000 7f47567fc640 1 --2- 172.21.15.53:0/2737938347 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4740004110 0x7f47400047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:16.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.802+0000 7f4756ffd640 1 --2- 172.21.15.53:0/2737938347 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47580cc690 0x7f4740003bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:16.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.802+0000 7f47577fe640 1 --2- 172.21.15.53:0/2737938347 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4740004d10 0x7f4740005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:16.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.802+0000 7f47567fc640 1 -- 172.21.15.53:0/2737938347 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47580cc690 msgr2=0x7f4740003bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:16.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.802+0000 7f47567fc640 1 --2- 172.21.15.53:0/2737938347 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47580cc690 0x7f4740003bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:16.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.802+0000 7f47567fc640 1 -- 172.21.15.53:0/2737938347 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4740004d10 msgr2=0x7f4740005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:16.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.802+0000 7f47567fc640 1 --2- 172.21.15.53:0/2737938347 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4740004d10 0x7f4740005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:16.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.802+0000 7f47567fc640 1 -- 172.21.15.53:0/2737938347 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4740003530 con 0x7f4740004110 2023-06-10T18:57:16.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.802+0000 7f47577fe640 1 --2- 172.21.15.53:0/2737938347 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4740004d10 0x7f4740005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:57:16.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.806+0000 7f47567fc640 1 --2- 172.21.15.53:0/2737938347 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4740004110 0x7f47400047d0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f474c009ae0 tx=0x7f474c01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b8ed1a12c8fb21c server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:16.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.806+0000 7f4755ffb640 1 -- 172.21.15.53:0/2737938347 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474c0a5640 con 0x7f4740004110 2023-06-10T18:57:16.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.806+0000 7f4755ffb640 1 -- 172.21.15.53:0/2737938347 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f474c0a57a0 con 0x7f4740004110 2023-06-10T18:57:16.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.806+0000 7f4755ffb640 1 -- 172.21.15.53:0/2737938347 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474c0a5b50 con 0x7f4740004110 2023-06-10T18:57:16.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.806+0000 7f475d5f1640 1 -- 172.21.15.53:0/2737938347 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4740004110 msgr2=0x7f47400047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:16.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.806+0000 7f475d5f1640 1 --2- 172.21.15.53:0/2737938347 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4740004110 0x7f47400047d0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f474c009ae0 tx=0x7f474c01ca50 comp rx=0 tx=0).stop 2023-06-10T18:57:16.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.806+0000 7f47577fe640 1 -- 172.21.15.53:0/2737938347 reap_dead start 2023-06-10T18:57:16.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.806+0000 7f475d5f1640 1 -- 172.21.15.53:0/2737938347 shutdown_connections 2023-06-10T18:57:16.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.806+0000 7f475d5f1640 1 -- 172.21.15.53:0/2737938347 >> 172.21.15.53:0/2737938347 conn(0x7f4758071790 msgr2=0x7f4758069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:16.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.806+0000 7f475d5f1640 1 -- 172.21.15.53:0/2737938347 shutdown_connections 2023-06-10T18:57:16.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.806+0000 7f475d5f1640 1 -- 172.21.15.53:0/2737938347 wait complete. 2023-06-10T18:57:16.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.810+0000 7f475d5f1640 1 Processor -- start 2023-06-10T18:57:16.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.810+0000 7f475d5f1640 1 -- start start 2023-06-10T18:57:16.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.810+0000 7f475d5f1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4740004110 0x7f4758150540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:16.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.810+0000 7f475d5f1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47580c9110 0x7f47580c7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:16.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.810+0000 7f475d5f1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47580b5ec0 0x7f47580b6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:16.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.810+0000 7f475d5f1640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47580b6870 con 0x7f47580c9110 2023-06-10T18:57:16.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.810+0000 7f475d5f1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47581514d0 con 0x7f4740004110 2023-06-10T18:57:16.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.810+0000 7f475d5f1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47580ca250 con 0x7f47580b5ec0 2023-06-10T18:57:16.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.810+0000 7f47567fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47580c9110 0x7f47580c7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:16.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.810+0000 7f47567fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47580c9110 0x7f47580c7bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52976/0 (socket says 172.21.15.53:52976) 2023-06-10T18:57:16.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.810+0000 7f47567fc640 1 -- 172.21.15.53:0/1172170523 learned_addr learned my addr 172.21.15.53:0/1172170523 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:57:16.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.810+0000 7f4756ffd640 1 --2- 172.21.15.53:0/1172170523 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4740004110 0x7f4758150540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:16.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.810+0000 7f47577fe640 1 --2- 172.21.15.53:0/1172170523 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47580b5ec0 0x7f47580b6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:16.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.810+0000 7f47567fc640 1 -- 172.21.15.53:0/1172170523 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47580b5ec0 msgr2=0x7f47580b6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:16.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.810+0000 7f47567fc640 1 --2- 172.21.15.53:0/1172170523 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47580b5ec0 0x7f47580b6330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:16.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.810+0000 7f47567fc640 1 -- 172.21.15.53:0/1172170523 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4740004110 msgr2=0x7f4758150540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:16.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.810+0000 7f47567fc640 1 --2- 172.21.15.53:0/1172170523 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4740004110 0x7f4758150540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:16.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.810+0000 7f47567fc640 1 -- 172.21.15.53:0/1172170523 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4758150a80 con 0x7f47580c9110 2023-06-10T18:57:16.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.810+0000 7f47567fc640 1 --2- 172.21.15.53:0/1172170523 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47580c9110 0x7f47580c7bc0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f474c01c880 tx=0x7f4740005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:16.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.810+0000 7f473f7fe640 1 -- 172.21.15.53:0/1172170523 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474c0bc070 con 0x7f47580c9110 2023-06-10T18:57:16.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.810+0000 7f473f7fe640 1 -- 172.21.15.53:0/1172170523 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f474c004020 con 0x7f47580c9110 2023-06-10T18:57:16.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.810+0000 7f473f7fe640 1 -- 172.21.15.53:0/1172170523 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474c0a5640 con 0x7f47580c9110 2023-06-10T18:57:16.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.810+0000 7f475d5f1640 1 -- 172.21.15.53:0/1172170523 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47580c9640 con 0x7f47580c9110 2023-06-10T18:57:16.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.810+0000 7f475d5f1640 1 -- 172.21.15.53:0/1172170523 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47580c9c00 con 0x7f47580c9110 2023-06-10T18:57:16.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.810+0000 7f475d5f1640 1 -- 172.21.15.53:0/1172170523 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f475804d790 con 0x7f47580c9110 2023-06-10T18:57:16.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.810+0000 7f473f7fe640 1 -- 172.21.15.53:0/1172170523 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f474c0b4040 con 0x7f47580c9110 2023-06-10T18:57:16.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.814+0000 7f473f7fe640 1 --2- 172.21.15.53:0/1172170523 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f47440662b0 0x7f4744068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:16.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.814+0000 7f473f7fe640 1 -- 172.21.15.53:0/1172170523 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f474c11d850 con 0x7f47580c9110 2023-06-10T18:57:16.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.814+0000 7f4756ffd640 1 --2- 172.21.15.53:0/1172170523 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f47440662b0 0x7f4744068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:16.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.814+0000 7f4756ffd640 1 --2- 172.21.15.53:0/1172170523 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f47440662b0 0x7f4744068760 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f4748007860 tx=0x7f4748007290 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:16.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.818+0000 7f473f7fe640 1 -- 172.21.15.53:0/1172170523 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f474c0eada0 con 0x7f47580c9110 2023-06-10T18:57:16.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.966+0000 7f475d5f1640 1 -- 172.21.15.53:0/1172170523 --> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f47580cfcb0 con 0x7f47440662b0 2023-06-10T18:57:16.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.986+0000 7f473f7fe640 1 -- 172.21.15.53:0/1172170523 <== mgr.4105 v2:172.21.15.117:6832/3061986771 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+297119 (secure 0 0 0) 0x7f4748016480 con 0x7f47440662b0 2023-06-10T18:57:16.995 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:57:16.997 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-06-10T18:57:16.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.994+0000 7f475d5f1640 1 -- 172.21.15.53:0/1172170523 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f47440662b0 msgr2=0x7f4744068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:16.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.994+0000 7f475d5f1640 1 --2- 172.21.15.53:0/1172170523 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f47440662b0 0x7f4744068760 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f4748007860 tx=0x7f4748007290 comp rx=0 tx=0).stop 2023-06-10T18:57:16.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.994+0000 7f475d5f1640 1 -- 172.21.15.53:0/1172170523 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47580c9110 msgr2=0x7f47580c7bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:17.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.994+0000 7f475d5f1640 1 --2- 172.21.15.53:0/1172170523 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47580c9110 0x7f47580c7bc0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f474c01c880 tx=0x7f4740005800 comp rx=0 tx=0).stop 2023-06-10T18:57:17.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.994+0000 7f475d5f1640 1 -- 172.21.15.53:0/1172170523 shutdown_connections 2023-06-10T18:57:17.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.994+0000 7f475d5f1640 1 --2- 172.21.15.53:0/1172170523 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f47440662b0 0x7f4744068760 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:17.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.994+0000 7f475d5f1640 1 --2- 172.21.15.53:0/1172170523 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47580b5ec0 0x7f47580b6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:17.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.994+0000 7f475d5f1640 1 --2- 172.21.15.53:0/1172170523 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47580c9110 0x7f47580c7bc0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:17.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.994+0000 7f475d5f1640 1 --2- 172.21.15.53:0/1172170523 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4740004110 0x7f4758150540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:17.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.994+0000 7f475d5f1640 1 -- 172.21.15.53:0/1172170523 >> 172.21.15.53:0/1172170523 conn(0x7f4758071790 msgr2=0x7f47580b3280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:17.002 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.994+0000 7f475d5f1640 1 -- 172.21.15.53:0/1172170523 shutdown_connections 2023-06-10T18:57:17.002 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:16.994+0000 7f475d5f1640 1 -- 172.21.15.53:0/1172170523 wait complete. 2023-06-10T18:57:17.014 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":200,"stamp":"2023-06-10T18:57:15.659031+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238960,"kb_used_data":6960,"kb_used_omap":0,"kb_used_meta":231936,"kb_avail":754735760,"statfs":{"total":773094113280,"available":772849418240,"internally_reserved":0,"allocated":7127040,"data_stored":3781845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":237502464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001139"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.858048+0000","last_change":"2023-06-10T18:57:11.858048+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.858048+0000","last_undegraded":"2023-06-10T18:57:11.858048+0000","last_fullsized":"2023-06-10T18:57:11.858048+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.867848+0000","last_change":"2023-06-10T18:57:11.867848+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.867848+0000","last_undegraded":"2023-06-10T18:57:11.867848+0000","last_fullsized":"2023-06-10T18:57:11.867848+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.867289+0000","last_change":"2023-06-10T18:57:11.867289+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.867289+0000","last_undegraded":"2023-06-10T18:57:11.867289+0000","last_fullsized":"2023-06-10T18:57:11.867289+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.868398+0000","last_change":"2023-06-10T18:57:11.868398+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.868398+0000","last_undegraded":"2023-06-10T18:57:11.868398+0000","last_fullsized":"2023-06-10T18:57:11.868398+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.864218+0000","last_change":"2023-06-10T18:57:11.864218+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.864218+0000","last_undegraded":"2023-06-10T18:57:11.864218+0000","last_fullsized":"2023-06-10T18:57:11.864218+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.865117+0000","last_change":"2023-06-10T18:57:11.865117+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.865117+0000","last_undegraded":"2023-06-10T18:57:11.865117+0000","last_fullsized":"2023-06-10T18:57:11.865117+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.864215+0000","last_change":"2023-06-10T18:57:11.864215+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.864215+0000","last_undegraded":"2023-06-10T18:57:11.864215+0000","last_fullsized":"2023-06-10T18:57:11.864215+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.852046+0000","last_change":"2023-06-10T18:57:11.852046+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.852046+0000","last_undegraded":"2023-06-10T18:57:11.852046+0000","last_fullsized":"2023-06-10T18:57:11.852046+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.858422+0000","last_change":"2023-06-10T18:57:11.858422+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.858422+0000","last_undegraded":"2023-06-10T18:57:11.858422+0000","last_fullsized":"2023-06-10T18:57:11.858422+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.853111+0000","last_change":"2023-06-10T18:57:11.853111+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.853111+0000","last_undegraded":"2023-06-10T18:57:11.853111+0000","last_fullsized":"2023-06-10T18:57:11.853111+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.858596+0000","last_change":"2023-06-10T18:57:11.858596+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.858596+0000","last_undegraded":"2023-06-10T18:57:11.858596+0000","last_fullsized":"2023-06-10T18:57:11.858596+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.858699+0000","last_change":"2023-06-10T18:57:11.858699+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.858699+0000","last_undegraded":"2023-06-10T18:57:11.858699+0000","last_fullsized":"2023-06-10T18:57:11.858699+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.858402+0000","last_change":"2023-06-10T18:57:11.858402+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.858402+0000","last_undegraded":"2023-06-10T18:57:11.858402+0000","last_fullsized":"2023-06-10T18:57:11.858402+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.872354+0000","last_change":"2023-06-10T18:57:11.872354+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.872354+0000","last_undegraded":"2023-06-10T18:57:11.872354+0000","last_fullsized":"2023-06-10T18:57:11.872354+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.857189+0000","last_change":"2023-06-10T18:57:11.857189+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.857189+0000","last_undegraded":"2023-06-10T18:57:11.857189+0000","last_fullsized":"2023-06-10T18:57:11.857189+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.853005+0000","last_change":"2023-06-10T18:57:11.853005+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.853005+0000","last_undegraded":"2023-06-10T18:57:11.853005+0000","last_fullsized":"2023-06-10T18:57:11.853005+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.871215+0000","last_change":"2023-06-10T18:57:11.871215+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.871215+0000","last_undegraded":"2023-06-10T18:57:11.871215+0000","last_fullsized":"2023-06-10T18:57:11.871215+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.871166+0000","last_change":"2023-06-10T18:57:11.871166+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.871166+0000","last_undegraded":"2023-06-10T18:57:11.871166+0000","last_fullsized":"2023-06-10T18:57:11.871166+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.868169+0000","last_change":"2023-06-10T18:57:11.868169+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.868169+0000","last_undegraded":"2023-06-10T18:57:11.868169+0000","last_fullsized":"2023-06-10T18:57:11.868169+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.857982+0000","last_change":"2023-06-10T18:57:11.857982+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.857982+0000","last_undegraded":"2023-06-10T18:57:11.857982+0000","last_fullsized":"2023-06-10T18:57:11.857982+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.857076+0000","last_change":"2023-06-10T18:57:11.857076+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.857076+0000","last_undegraded":"2023-06-10T18:57:11.857076+0000","last_fullsized":"2023-06-10T18:57:11.857076+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.864162+0000","last_change":"2023-06-10T18:57:11.864162+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.864162+0000","last_undegraded":"2023-06-10T18:57:11.864162+0000","last_fullsized":"2023-06-10T18:57:11.864162+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.865225+0000","last_change":"2023-06-10T18:57:11.865225+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.865225+0000","last_undegraded":"2023-06-10T18:57:11.865225+0000","last_fullsized":"2023-06-10T18:57:11.865225+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.857958+0000","last_change":"2023-06-10T18:57:11.857958+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.857958+0000","last_undegraded":"2023-06-10T18:57:11.857958+0000","last_fullsized":"2023-06-10T18:57:11.857958+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.864162+0000","last_change":"2023-06-10T18:57:11.864162+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.864162+0000","last_undegraded":"2023-06-10T18:57:11.864162+0000","last_fullsized":"2023-06-10T18:57:11.864162+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":243,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-06-10T18:57:11.860040+0000","last_change":"2023-06-10T18:52:34.951528+0000","last_active":"2023-06-10T18:57:11.860040+0000","last_peered":"2023-06-10T18:57:11.860040+0000","last_clean":"2023-06-10T18:57:11.860040+0000","last_became_active":"2023-06-10T18:52:34.949099+0000","last_became_peered":"2023-06-10T18:52:34.949099+0000","last_unstale":"2023-06-10T18:57:11.860040+0000","last_undegraded":"2023-06-10T18:57:11.860040+0000","last_fullsized":"2023-06-10T18:57:11.860040+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_clean_scrub_stamp":"2023-06-10T18:52:33.633295+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:02:34.447395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":89,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-06-10T18:57:11.873465+0000","last_change":"2023-06-10T18:52:40.506384+0000","last_active":"2023-06-10T18:57:11.873465+0000","last_peered":"2023-06-10T18:57:11.873465+0000","last_clean":"2023-06-10T18:57:11.873465+0000","last_became_active":"2023-06-10T18:52:40.505701+0000","last_became_peered":"2023-06-10T18:52:40.505701+0000","last_unstale":"2023-06-10T18:57:11.873465+0000","last_undegraded":"2023-06-10T18:57:11.873465+0000","last_fullsized":"2023-06-10T18:57:11.873465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:01:38.268612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.867782+0000","last_change":"2023-06-10T18:57:11.867782+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.867782+0000","last_undegraded":"2023-06-10T18:57:11.867782+0000","last_fullsized":"2023-06-10T18:57:11.867782+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":87,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-06-10T18:57:11.859674+0000","last_change":"2023-06-10T18:52:40.512015+0000","last_active":"2023-06-10T18:57:11.859674+0000","last_peered":"2023-06-10T18:57:11.859674+0000","last_clean":"2023-06-10T18:57:11.859674+0000","last_became_active":"2023-06-10T18:52:40.511382+0000","last_became_peered":"2023-06-10T18:52:40.511382+0000","last_unstale":"2023-06-10T18:57:11.859674+0000","last_undegraded":"2023-06-10T18:57:11.859674+0000","last_fullsized":"2023-06-10T18:57:11.859674+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:32:10.225462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.871187+0000","last_change":"2023-06-10T18:57:11.871187+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.871187+0000","last_undegraded":"2023-06-10T18:57:11.871187+0000","last_fullsized":"2023-06-10T18:57:11.871187+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":91,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-06-10T18:57:11.851098+0000","last_change":"2023-06-10T18:52:40.671725+0000","last_active":"2023-06-10T18:57:11.851098+0000","last_peered":"2023-06-10T18:57:11.851098+0000","last_clean":"2023-06-10T18:57:11.851098+0000","last_became_active":"2023-06-10T18:52:40.671442+0000","last_became_peered":"2023-06-10T18:52:40.671442+0000","last_unstale":"2023-06-10T18:57:11.851098+0000","last_undegraded":"2023-06-10T18:57:11.851098+0000","last_fullsized":"2023-06-10T18:57:11.851098+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:41:17.572105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.867223+0000","last_change":"2023-06-10T18:57:11.867223+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.867223+0000","last_undegraded":"2023-06-10T18:57:11.867223+0000","last_fullsized":"2023-06-10T18:57:11.867223+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":89,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-06-10T18:57:11.873707+0000","last_change":"2023-06-10T18:52:40.510258+0000","last_active":"2023-06-10T18:57:11.873707+0000","last_peered":"2023-06-10T18:57:11.873707+0000","last_clean":"2023-06-10T18:57:11.873707+0000","last_became_active":"2023-06-10T18:52:40.509560+0000","last_became_peered":"2023-06-10T18:52:40.509560+0000","last_unstale":"2023-06-10T18:57:11.873707+0000","last_undegraded":"2023-06-10T18:57:11.873707+0000","last_fullsized":"2023-06-10T18:57:11.873707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:02:39.344511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.872455+0000","last_change":"2023-06-10T18:57:11.872455+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.872455+0000","last_undegraded":"2023-06-10T18:57:11.872455+0000","last_fullsized":"2023-06-10T18:57:11.872455+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":83,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-06-10T18:57:11.859334+0000","last_change":"2023-06-10T18:52:40.672266+0000","last_active":"2023-06-10T18:57:11.859334+0000","last_peered":"2023-06-10T18:57:11.859334+0000","last_clean":"2023-06-10T18:57:11.859334+0000","last_became_active":"2023-06-10T18:52:40.671966+0000","last_became_peered":"2023-06-10T18:52:40.671966+0000","last_unstale":"2023-06-10T18:57:11.859334+0000","last_undegraded":"2023-06-10T18:57:11.859334+0000","last_fullsized":"2023-06-10T18:57:11.859334+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:20:22.653473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.857155+0000","last_change":"2023-06-10T18:57:11.857155+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.857155+0000","last_undegraded":"2023-06-10T18:57:11.857155+0000","last_fullsized":"2023-06-10T18:57:11.857155+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":87,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-06-10T18:57:11.860042+0000","last_change":"2023-06-10T18:52:40.671084+0000","last_active":"2023-06-10T18:57:11.860042+0000","last_peered":"2023-06-10T18:57:11.860042+0000","last_clean":"2023-06-10T18:57:11.860042+0000","last_became_active":"2023-06-10T18:52:40.670697+0000","last_became_peered":"2023-06-10T18:52:40.670697+0000","last_unstale":"2023-06-10T18:57:11.860042+0000","last_undegraded":"2023-06-10T18:57:11.860042+0000","last_fullsized":"2023-06-10T18:57:11.860042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:38:30.948317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.857096+0000","last_change":"2023-06-10T18:57:11.857096+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.857096+0000","last_undegraded":"2023-06-10T18:57:11.857096+0000","last_fullsized":"2023-06-10T18:57:11.857096+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":83,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-06-10T18:57:11.859351+0000","last_change":"2023-06-10T18:52:40.514114+0000","last_active":"2023-06-10T18:57:11.859351+0000","last_peered":"2023-06-10T18:57:11.859351+0000","last_clean":"2023-06-10T18:57:11.859351+0000","last_became_active":"2023-06-10T18:52:40.513638+0000","last_became_peered":"2023-06-10T18:52:40.513638+0000","last_unstale":"2023-06-10T18:57:11.859351+0000","last_undegraded":"2023-06-10T18:57:11.859351+0000","last_fullsized":"2023-06-10T18:57:11.859351+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:44:43.932666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T18:57:12.846581+0000","last_change":"2023-06-10T18:57:12.846581+0000","last_active":"2023-06-10T18:57:12.846581+0000","last_peered":"2023-06-10T18:57:12.846581+0000","last_clean":"2023-06-10T18:57:12.846581+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:12.846581+0000","last_undegraded":"2023-06-10T18:57:12.846581+0000","last_fullsized":"2023-06-10T18:57:12.846581+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-06-10T18:57:11.864245+0000","last_change":"2023-06-10T18:57:11.864245+0000","last_active":"2023-06-10T18:57:11.842880+0000","last_peered":"2023-06-10T18:57:11.842880+0000","last_clean":"2023-06-10T18:57:11.842880+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T18:57:11.864245+0000","last_undegraded":"2023-06-10T18:57:11.864245+0000","last_fullsized":"2023-06-10T18:57:11.864245+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":91,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-06-10T18:57:11.851590+0000","last_change":"2023-06-10T18:52:40.515396+0000","last_active":"2023-06-10T18:57:11.851590+0000","last_peered":"2023-06-10T18:57:11.851590+0000","last_clean":"2023-06-10T18:57:11.851590+0000","last_became_active":"2023-06-10T18:52:40.514663+0000","last_became_peered":"2023-06-10T18:52:40.514663+0000","last_unstale":"2023-06-10T18:57:11.851590+0000","last_undegraded":"2023-06-10T18:57:11.851590+0000","last_fullsized":"2023-06-10T18:57:11.851590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:26:51.297957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574907,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28260,"kb_used_data":1308,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343580,"statfs":{"total":96636764160,"available":96607825920,"internally_reserved":0,"allocated":1339392,"data_stored":916660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.89800000000000002,"15min":0.88},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.1850000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.038},{"interface":"front","average":{"1min":0.874,"5min":0.93300000000000005,"15min":0.92700000000000005},"min":{"1min":0.52900000000000003,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1910000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.66000000000000003}]},{"osd":1,"last update":"Sat Jun 10 18:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.93200000000000005,"15min":0.91800000000000004},"min":{"1min":0.56100000000000005,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.3759999999999999,"5min":1.377,"15min":1.377},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.93300000000000005,"15min":0.91300000000000003},"min":{"1min":0.70099999999999996,"5min":0.504,"15min":0.504},"max":{"1min":1.2529999999999999,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.78000000000000003}]},{"osd":2,"last update":"Sat Jun 10 18:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.83699999999999997,"15min":0.82699999999999996},"min":{"1min":0.49299999999999999,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.04,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.89100000000000001,"15min":0.90400000000000003},"min":{"1min":0.56100000000000005,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1930000000000001,"5min":1.367,"15min":1.367},"last":0.96199999999999997}]},{"osd":3,"last update":"Sat Jun 10 18:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.92900000000000005,"15min":0.90100000000000002},"min":{"1min":0.59699999999999998,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.167,"5min":1.502,"15min":1.502},"last":1.0649999999999999},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.94199999999999995,"15min":0.92900000000000005},"min":{"1min":0.63,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.2230000000000001,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":1.1279999999999999}]},{"osd":4,"last update":"Sat Jun 10 18:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.871,"15min":0.871},"min":{"1min":0.57399999999999995,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.1639999999999999,"5min":1.639,"15min":1.639},"last":1.097},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.95999999999999996,"15min":0.97799999999999998},"min":{"1min":0.65200000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.22,"5min":1.411,"15min":1.411},"last":1.1639999999999999}]},{"osd":5,"last update":"Sat Jun 10 18:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":1.0189999999999999,"15min":1.0309999999999999},"min":{"1min":0.60099999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.2210000000000001,"5min":1.806,"15min":1.806},"last":1.2210000000000001},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.038,"15min":1.048},"min":{"1min":0.71299999999999997,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.26,"5min":1.522,"15min":1.522},"last":1.2450000000000001}]},{"osd":6,"last update":"Sat Jun 10 18:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.995,"15min":1.002},"min":{"1min":0.66400000000000003,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.2170000000000001,"5min":1.718,"15min":1.718},"last":0.93000000000000005},{"interface":"front","average":{"1min":1.048,"5min":1.087,"15min":1.087},"min":{"1min":0.83599999999999997,"5min":0.441,"15min":0.441},"max":{"1min":1.2889999999999999,"5min":1.464,"15min":1.464},"last":1.3169999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574908,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27680,"kb_used_data":728,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344160,"statfs":{"total":96636764160,"available":96608419840,"internally_reserved":0,"allocated":745472,"data_stored":326292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:56:33 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.84999999999999998,"15min":0.81100000000000005},"min":{"1min":0.66700000000000004,"5min":0.502,"15min":0.502},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":0.755},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.878,"15min":0.84799999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.78800000000000003}]},{"osd":1,"last update":"Sat Jun 10 18:56:33 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.88,"15min":0.85399999999999998},"min":{"1min":0.53400000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0900000000000001,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.89500000000000002,"15min":0.86399999999999999},"min":{"1min":0.53800000000000003,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.587,"5min":1.778,"15min":1.778},"last":1.0640000000000001}]},{"osd":2,"last update":"Sat Jun 10 18:56:33 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.88300000000000001,"15min":0.86299999999999999},"min":{"1min":0.57399999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.1819999999999999,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.871,"5min":0.88100000000000001,"15min":0.88800000000000001},"min":{"1min":0.60299999999999998,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.177,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":1.012}]},{"osd":3,"last update":"Sat Jun 10 18:56:33 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":0.90800000000000003,"15min":0.85999999999999999},"min":{"1min":0.64500000000000002,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":0.60799999999999998},{"interface":"front","average":{"1min":1,"5min":0.998,"15min":0.996},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.90600000000000003}]},{"osd":4,"last update":"Sat Jun 10 18:56:33 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.93000000000000005,"15min":0.95199999999999996},"min":{"1min":0.63,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":0.86299999999999999},{"interface":"front","average":{"1min":1.024,"5min":1.0049999999999999,"15min":1.0189999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.54,"5min":1.54,"15min":1.54},"last":0.70299999999999996}]},{"osd":5,"last update":"Sat Jun 10 18:56:33 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.93500000000000005,"15min":0.95699999999999996},"min":{"1min":0.70299999999999996,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":1.097},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.044,"15min":1.032},"min":{"1min":0.83699999999999997,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":2.536,"5min":2.536,"15min":2.536},"last":0.96099999999999997}]},{"osd":7,"last update":"Sat Jun 10 18:56:33 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.036,"15min":1.048},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.917,"5min":1.917,"15min":1.917},"last":1.0389999999999999},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.05,"15min":1.0629999999999999},"min":{"1min":0.79400000000000004,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.395,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.81899999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574908,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27680,"kb_used_data":728,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344160,"statfs":{"total":96636764160,"available":96608419840,"internally_reserved":0,"allocated":745472,"data_stored":326292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84499999999999997,"15min":0.83099999999999996},"min":{"1min":0.60999999999999999,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.879,"5min":0.90300000000000002,"15min":0.93700000000000006},"min":{"1min":0.58799999999999997,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1499999999999999,"5min":1.637,"15min":1.637},"last":0.89800000000000002}]},{"osd":1,"last update":"Sat Jun 10 18:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.89000000000000001,"15min":0.91200000000000003},"min":{"1min":0.54400000000000004,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.107,"5min":1.335,"15min":1.335},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.91700000000000004,"15min":0.92100000000000004},"min":{"1min":0.63600000000000001,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.444,"5min":1.78,"15min":1.78},"last":0.57699999999999996}]},{"osd":2,"last update":"Sat Jun 10 18:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.84299999999999997,"15min":0.85099999999999998},"min":{"1min":0.54400000000000004,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.995,"5min":1.446,"15min":1.446},"last":1.0509999999999999},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.163,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.65700000000000003}]},{"osd":3,"last update":"Sat Jun 10 18:56:37 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":0.95299999999999996,"15min":0.94899999999999995},"min":{"1min":0.75900000000000001,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.3440000000000001,"5min":1.484,"15min":1.484},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.998,"15min":1.034},"min":{"1min":0.66700000000000004,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.1910000000000001,"5min":1.337,"15min":1.337},"last":1.0029999999999999}]},{"osd":4,"last update":"Sat Jun 10 18:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.94499999999999995,"15min":0.98099999999999998},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.0720000000000001,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":1.002,"5min":1.0189999999999999,"15min":1.0589999999999999},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.528,"5min":1.575,"15min":1.575},"last":0.69599999999999995}]},{"osd":6,"last update":"Sat Jun 10 18:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":1.0089999999999999,"15min":1.0680000000000001},"min":{"1min":0.629,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.1799999999999999,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.1499999999999999},{"interface":"front","average":{"1min":0.97899999999999998,"5min":1.0389999999999999,"15min":1.0720000000000001},"min":{"1min":0.67200000000000004,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.1859999999999999,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.81999999999999995}]},{"osd":7,"last update":"Sat Jun 10 18:56:37 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.123,"15min":1.169},"min":{"1min":0.85199999999999998,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.573,"5min":1.873,"15min":1.873},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.1339999999999999,"15min":1.1739999999999999},"min":{"1min":0.877,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.4750000000000001,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.3149999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574907,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27680,"kb_used_data":728,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344160,"statfs":{"total":96636764160,"available":96608419840,"internally_reserved":0,"allocated":745472,"data_stored":326292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.78700000000000003,"15min":0.752},"min":{"1min":0.49299999999999999,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.157,"5min":1.2,"15min":1.2},"last":0.998},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.89700000000000002,"15min":0.88500000000000001},"min":{"1min":0.66500000000000004,"5min":0.504,"15min":0.504},"max":{"1min":1.2350000000000001,"5min":1.73,"15min":1.73},"last":0.71799999999999997}]},{"osd":1,"last update":"Sat Jun 10 18:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.94799999999999995,"15min":0.95399999999999996},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.179,"5min":1.601,"15min":1.601},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.87,"5min":0.85299999999999998,"15min":0.83899999999999997},"min":{"1min":0.63400000000000001,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.3029999999999999,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.67600000000000005}]},{"osd":2,"last update":"Sat Jun 10 18:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.877,"15min":0.875},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.089,"5min":1.522,"15min":1.522},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.98999999999999999,"15min":1},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.2629999999999999,"5min":1.552,"15min":1.552},"last":0.57799999999999996}]},{"osd":3,"last update":"Sat Jun 10 18:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.89900000000000002,"15min":0.88},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.1990000000000001,"5min":1.22,"15min":1.22},"last":0.53900000000000003},{"interface":"front","average":{"1min":1.02,"5min":0.97299999999999998,"15min":0.95599999999999996},"min":{"1min":0.78900000000000003,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.159,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.92300000000000004}]},{"osd":5,"last update":"Sat Jun 10 18:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.95099999999999996,"15min":0.98899999999999999},"min":{"1min":0.68200000000000005,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.27,"5min":1.663,"15min":1.663},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.999,"5min":0.95499999999999996,"15min":0.98199999999999998},"min":{"1min":0.69899999999999995,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.234,"5min":1.353,"15min":1.353},"last":0.89300000000000002}]},{"osd":6,"last update":"Sat Jun 10 18:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.98799999999999999,"15min":1.024},"min":{"1min":0.65500000000000003,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.242,"5min":2.2639999999999998,"15min":2.2639999999999998},"last":1.105},{"interface":"front","average":{"1min":1.054,"5min":1.0669999999999999,"15min":1.0740000000000001},"min":{"1min":0.72599999999999998,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.2849999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.95299999999999996}]},{"osd":7,"last update":"Sat Jun 10 18:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.98399999999999999,"15min":0.99399999999999999},"min":{"1min":0.68999999999999995,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.2350000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.0600000000000001,"15min":1.0740000000000001},"min":{"1min":0.78500000000000003,"5min":0.628,"15min":0.628},"max":{"1min":1.3879999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":1.2669999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574906,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31772,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340068,"statfs":{"total":96636764160,"available":96604229632,"internally_reserved":0,"allocated":741376,"data_stored":325273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:56:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.60099999999999998,"15min":0.57999999999999996},"min":{"1min":0.432,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.65300000000000002,"15min":0.63700000000000001},"min":{"1min":0.35599999999999998,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.0129999999999999,"5min":1.286,"15min":1.286},"last":0.5}]},{"osd":1,"last update":"Sat Jun 10 18:56:36 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.67500000000000004,"15min":0.63200000000000001},"min":{"1min":0.45500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":1.2569999999999999},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.74299999999999999,"15min":0.72299999999999998},"min":{"1min":0.48599999999999999,"5min":0.318,"15min":0.318},"max":{"1min":1.143,"5min":1.411,"15min":1.411},"last":0.95399999999999996}]},{"osd":2,"last update":"Sat Jun 10 18:56:36 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.77400000000000002,"15min":0.754},"min":{"1min":0.48999999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.3759999999999999,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":0.749},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.76800000000000002,"15min":0.745},"min":{"1min":0.52900000000000003,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.125,"5min":1.264,"15min":1.264},"last":1.2170000000000001}]},{"osd":4,"last update":"Sat Jun 10 18:56:36 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.95399999999999996,"15min":0.96599999999999997},"min":{"1min":0.747,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.3360000000000001,"5min":1.488,"15min":1.488},"last":0.879},{"interface":"front","average":{"1min":1.026,"5min":0.997,"15min":0.99299999999999999},"min":{"1min":0.65500000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.3700000000000001,"5min":1.458,"15min":1.458},"last":1.3400000000000001}]},{"osd":5,"last update":"Sat Jun 10 18:56:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":1.026,"15min":1.0549999999999999},"min":{"1min":0.68000000000000005,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.431,"5min":2.024,"15min":2.024},"last":0.91600000000000004},{"interface":"front","average":{"1min":1.117,"5min":1.0469999999999999,"15min":1.0209999999999999},"min":{"1min":0.94299999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.4139999999999999,"5min":1.724,"15min":1.724},"last":1.304}]},{"osd":6,"last update":"Sat Jun 10 18:56:36 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.0669999999999999,"15min":1.0529999999999999},"min":{"1min":0.83199999999999996,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.5449999999999999,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":1.139},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.0640000000000001,"15min":1.0740000000000001},"min":{"1min":0.75900000000000001,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.514,"5min":1.78,"15min":1.78},"last":1.173}]},{"osd":7,"last update":"Sat Jun 10 18:56:36 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.105,"15min":1.129},"min":{"1min":0.82599999999999996,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.5900000000000001,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.099,"15min":1.077},"min":{"1min":0.71799999999999997,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.5429999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":1.091}]}]},{"osd":2,"up_from":13,"seq":55834574907,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31764,"kb_used_data":716,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340076,"statfs":{"total":96636764160,"available":96604237824,"internally_reserved":0,"allocated":733184,"data_stored":320122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.60699999999999998,"15min":0.58999999999999997},"min":{"1min":0.36499999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.91700000000000004,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.432},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.436,"5min":0.378,"15min":0.378},"max":{"1min":1.0580000000000001,"5min":1.224,"15min":1.224},"last":0.58199999999999996}]},{"osd":1,"last update":"Sat Jun 10 18:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.66300000000000003,"15min":0.65100000000000002},"min":{"1min":0.39700000000000002,"5min":0.307,"15min":0.307},"max":{"1min":1.0109999999999999,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":1.099},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.753,"15min":0.69999999999999996},"min":{"1min":0.41699999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.64100000000000001}]},{"osd":3,"last update":"Sat Jun 10 18:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.745,"15min":0.70899999999999996},"min":{"1min":0.44700000000000001,"5min":0.377,"15min":0.377},"max":{"1min":1.0609999999999999,"5min":1.165,"15min":1.165},"last":1.006},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.76400000000000001,"15min":0.751},"min":{"1min":0.32900000000000001,"5min":0.252,"15min":0.252},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.80500000000000005}]},{"osd":4,"last update":"Sat Jun 10 18:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.92300000000000004,"15min":0.91700000000000004},"min":{"1min":0.63,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.2769999999999999,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":1.05},{"interface":"front","average":{"1min":1.046,"5min":1.036,"15min":1.038},"min":{"1min":0.70199999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.3169999999999999,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.85399999999999998}]},{"osd":5,"last update":"Sat Jun 10 18:56:37 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.0289999999999999,"15min":1.0209999999999999},"min":{"1min":0.64600000000000002,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.3759999999999999,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":1.032},{"interface":"front","average":{"1min":1.056,"5min":1.02,"15min":0.98399999999999999},"min":{"1min":0.78200000000000003,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.4119999999999999,"5min":1.667,"15min":1.667},"last":0.88800000000000001}]},{"osd":6,"last update":"Sat Jun 10 18:56:37 2023","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.0609999999999999,"15min":1.0289999999999999},"min":{"1min":0.873,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.4550000000000001,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":1.153},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.0509999999999999,"15min":1.038},"min":{"1min":0.66000000000000003,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.96999999999999997}]},{"osd":7,"last update":"Sat Jun 10 18:56:37 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.1060000000000001,"15min":1.1020000000000001},"min":{"1min":0.83899999999999997,"5min":0.62,"15min":0.62},"max":{"1min":1.458,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.94599999999999995},{"interface":"front","average":{"1min":1.181,"5min":1.121,"15min":1.083},"min":{"1min":0.76400000000000001,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.5920000000000001,"5min":1.752,"15min":1.752},"last":0.71799999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574909,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31772,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340068,"statfs":{"total":96636764160,"available":96604229632,"internally_reserved":0,"allocated":741376,"data_stored":325273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.66600000000000004,"15min":0.65900000000000003},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.0149999999999999,"5min":1.288,"15min":1.288},"last":1.0600000000000001},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.72799999999999998,"15min":0.68799999999999994},"min":{"1min":0.38300000000000001,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.0089999999999999,"5min":1.694,"15min":1.694},"last":0.98099999999999998}]},{"osd":2,"last update":"Sat Jun 10 18:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.63200000000000001,"15min":0.61899999999999999},"min":{"1min":0.27300000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.77300000000000002,"5min":1.21,"15min":1.21},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71899999999999997,"15min":0.66300000000000003},"min":{"1min":0.33800000000000002,"5min":0.315,"15min":0.315},"max":{"1min":1.171,"5min":1.415,"15min":1.415},"last":0.63700000000000001}]},{"osd":3,"last update":"Sat Jun 10 18:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79200000000000004,"15min":0.75},"min":{"1min":0.33400000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.4139999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.755,"15min":0.747},"min":{"1min":0.35399999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.0649999999999999,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":0.79000000000000004}]},{"osd":4,"last update":"Sat Jun 10 18:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.875,"15min":0.83799999999999997},"min":{"1min":0.56799999999999995,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0329999999999999,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.95799999999999996,"5min":1.0960000000000001,"15min":1.0720000000000001},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.5129999999999999,"5min":5.8209999999999997,"15min":5.8209999999999997},"last":0.83499999999999996}]},{"osd":5,"last update":"Sat Jun 10 18:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":1.018,"15min":1.024},"min":{"1min":0.58499999999999996,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.2829999999999999,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":1.589},{"interface":"front","average":{"1min":0.90400000000000003,"5min":1.004,"15min":0.96799999999999997},"min":{"1min":0.60699999999999998,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.1599999999999999,"5min":3.089,"15min":3.089},"last":0.93899999999999995}]},{"osd":6,"last update":"Sat Jun 10 18:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":1.105,"15min":1.0309999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.472,"5min":7.2599999999999998,"15min":7.2599999999999998},"last":1.478},{"interface":"front","average":{"1min":0.92900000000000005,"5min":1.0940000000000001,"15min":1.026},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.2090000000000001,"5min":9.0069999999999997,"15min":9.0069999999999997},"last":1.1040000000000001}]},{"osd":7,"last update":"Sat Jun 10 18:56:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.0920000000000001,"15min":1.081},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.3440000000000001,"5min":2.105,"15min":2.105},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.083,"15min":1.0669999999999999},"min":{"1min":0.65600000000000003,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.673,"5min":2.2570000000000001,"15min":2.2570000000000001},"last":1.6399999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574908,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32352,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339488,"statfs":{"total":96636764160,"available":96603635712,"internally_reserved":0,"allocated":1335296,"data_stored":915641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jun 10 18:56:40 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.626,"15min":0.60299999999999998},"min":{"1min":0.35599999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.93899999999999995,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.78500000000000003,"15min":0.75},"min":{"1min":0.53100000000000003,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.028,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":1.0329999999999999}]},{"osd":2,"last update":"Sat Jun 10 18:56:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.71399999999999997,"15min":0.69899999999999995},"min":{"1min":0.39400000000000002,"5min":0.313,"15min":0.313},"max":{"1min":1.073,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65400000000000003,"15min":0.63300000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.95099999999999996,"5min":1.371,"15min":1.371},"last":0.56499999999999995}]},{"osd":3,"last update":"Sat Jun 10 18:56:40 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.70099999999999996,"15min":0.67700000000000005},"min":{"1min":0.377,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.087,"5min":1.226,"15min":1.226},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.84099999999999997,"15min":0.81399999999999995},"min":{"1min":0.435,"5min":0.375,"15min":0.375},"max":{"1min":1.296,"5min":1.829,"15min":1.829},"last":0.80500000000000005}]},{"osd":4,"last update":"Sat Jun 10 18:56:40 2023","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.91100000000000003,"15min":0.89300000000000002},"min":{"1min":0.59099999999999997,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.173,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.83399999999999996},{"interface":"front","average":{"1min":1.034,"5min":1.0369999999999999,"15min":1.034},"min":{"1min":0.65600000000000003,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.2729999999999999,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":1.1599999999999999}]},{"osd":5,"last update":"Sat Jun 10 18:56:40 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.64300000000000002,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.2450000000000001,"5min":1.694,"15min":1.694},"last":0.86599999999999999},{"interface":"front","average":{"1min":1.044,"5min":1.01,"15min":1.0009999999999999},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.3460000000000001,"5min":1.75,"15min":1.75},"last":0.996}]},{"osd":6,"last update":"Sat Jun 10 18:56:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.0740000000000001,"15min":1.0569999999999999},"min":{"1min":0.61699999999999999,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.2949999999999999,"5min":2.04,"15min":2.04},"last":1.2250000000000001},{"interface":"front","average":{"1min":1.03,"5min":1.0029999999999999,"15min":0.999},"min":{"1min":0.71099999999999997,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.3280000000000001,"5min":1.883,"15min":1.883},"last":1.0740000000000001}]},{"osd":7,"last update":"Sat Jun 10 18:56:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.044,"15min":1.0349999999999999},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.3360000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.96799999999999997},{"interface":"front","average":{"1min":1.099,"5min":1.0660000000000001,"15min":1.054},"min":{"1min":0.69299999999999995,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.4610000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.115}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-10T18:57:17.021 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3f is not active+clean 2023-06-10T18:57:17.021 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:57:12.846581+0000', 'last_change': '2023-06-10T18:57:12.846581+0000', 'last_active': '2023-06-10T18:57:12.846581+0000', 'last_peered': '2023-06-10T18:57:12.846581+0000', 'last_clean': '2023-06-10T18:57:12.846581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:12.846581+0000', 'last_undegraded': '2023-06-10T18:57:12.846581+0000', 'last_fullsized': '2023-06-10T18:57:12.846581+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:57:17.022 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3e is not active+clean 2023-06-10T18:57:17.022 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:57:12.846581+0000', 'last_change': '2023-06-10T18:57:12.846581+0000', 'last_active': '2023-06-10T18:57:12.846581+0000', 'last_peered': '2023-06-10T18:57:12.846581+0000', 'last_clean': '2023-06-10T18:57:12.846581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:12.846581+0000', 'last_undegraded': '2023-06-10T18:57:12.846581+0000', 'last_fullsized': '2023-06-10T18:57:12.846581+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:57:17.022 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3d is not active+clean 2023-06-10T18:57:17.023 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:57:12.846581+0000', 'last_change': '2023-06-10T18:57:12.846581+0000', 'last_active': '2023-06-10T18:57:12.846581+0000', 'last_peered': '2023-06-10T18:57:12.846581+0000', 'last_clean': '2023-06-10T18:57:12.846581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:12.846581+0000', 'last_undegraded': '2023-06-10T18:57:12.846581+0000', 'last_fullsized': '2023-06-10T18:57:12.846581+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:57:17.023 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3c is not active+clean 2023-06-10T18:57:17.023 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:57:12.846581+0000', 'last_change': '2023-06-10T18:57:12.846581+0000', 'last_active': '2023-06-10T18:57:12.846581+0000', 'last_peered': '2023-06-10T18:57:12.846581+0000', 'last_clean': '2023-06-10T18:57:12.846581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:12.846581+0000', 'last_undegraded': '2023-06-10T18:57:12.846581+0000', 'last_fullsized': '2023-06-10T18:57:12.846581+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:57:17.024 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3b is not active+clean 2023-06-10T18:57:17.024 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:57:12.846581+0000', 'last_change': '2023-06-10T18:57:12.846581+0000', 'last_active': '2023-06-10T18:57:12.846581+0000', 'last_peered': '2023-06-10T18:57:12.846581+0000', 'last_clean': '2023-06-10T18:57:12.846581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:12.846581+0000', 'last_undegraded': '2023-06-10T18:57:12.846581+0000', 'last_fullsized': '2023-06-10T18:57:12.846581+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:57:17.024 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3a is not active+clean 2023-06-10T18:57:17.025 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:57:12.846581+0000', 'last_change': '2023-06-10T18:57:12.846581+0000', 'last_active': '2023-06-10T18:57:12.846581+0000', 'last_peered': '2023-06-10T18:57:12.846581+0000', 'last_clean': '2023-06-10T18:57:12.846581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:12.846581+0000', 'last_undegraded': '2023-06-10T18:57:12.846581+0000', 'last_fullsized': '2023-06-10T18:57:12.846581+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:57:17.026 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.39 is not active+clean 2023-06-10T18:57:17.026 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:57:12.846581+0000', 'last_change': '2023-06-10T18:57:12.846581+0000', 'last_active': '2023-06-10T18:57:12.846581+0000', 'last_peered': '2023-06-10T18:57:12.846581+0000', 'last_clean': '2023-06-10T18:57:12.846581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:12.846581+0000', 'last_undegraded': '2023-06-10T18:57:12.846581+0000', 'last_fullsized': '2023-06-10T18:57:12.846581+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:57:17.027 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.38 is not active+clean 2023-06-10T18:57:17.027 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:57:12.846581+0000', 'last_change': '2023-06-10T18:57:12.846581+0000', 'last_active': '2023-06-10T18:57:12.846581+0000', 'last_peered': '2023-06-10T18:57:12.846581+0000', 'last_clean': '2023-06-10T18:57:12.846581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:12.846581+0000', 'last_undegraded': '2023-06-10T18:57:12.846581+0000', 'last_fullsized': '2023-06-10T18:57:12.846581+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:57:17.028 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.37 is not active+clean 2023-06-10T18:57:17.029 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:57:12.846581+0000', 'last_change': '2023-06-10T18:57:12.846581+0000', 'last_active': '2023-06-10T18:57:12.846581+0000', 'last_peered': '2023-06-10T18:57:12.846581+0000', 'last_clean': '2023-06-10T18:57:12.846581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:12.846581+0000', 'last_undegraded': '2023-06-10T18:57:12.846581+0000', 'last_fullsized': '2023-06-10T18:57:12.846581+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:57:17.029 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.36 is not active+clean 2023-06-10T18:57:17.029 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:57:12.846581+0000', 'last_change': '2023-06-10T18:57:12.846581+0000', 'last_active': '2023-06-10T18:57:12.846581+0000', 'last_peered': '2023-06-10T18:57:12.846581+0000', 'last_clean': '2023-06-10T18:57:12.846581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:12.846581+0000', 'last_undegraded': '2023-06-10T18:57:12.846581+0000', 'last_fullsized': '2023-06-10T18:57:12.846581+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:57:17.030 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.35 is not active+clean 2023-06-10T18:57:17.030 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:57:12.846581+0000', 'last_change': '2023-06-10T18:57:12.846581+0000', 'last_active': '2023-06-10T18:57:12.846581+0000', 'last_peered': '2023-06-10T18:57:12.846581+0000', 'last_clean': '2023-06-10T18:57:12.846581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:12.846581+0000', 'last_undegraded': '2023-06-10T18:57:12.846581+0000', 'last_fullsized': '2023-06-10T18:57:12.846581+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:57:17.030 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.34 is not active+clean 2023-06-10T18:57:17.031 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:57:12.846581+0000', 'last_change': '2023-06-10T18:57:12.846581+0000', 'last_active': '2023-06-10T18:57:12.846581+0000', 'last_peered': '2023-06-10T18:57:12.846581+0000', 'last_clean': '2023-06-10T18:57:12.846581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:12.846581+0000', 'last_undegraded': '2023-06-10T18:57:12.846581+0000', 'last_fullsized': '2023-06-10T18:57:12.846581+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:57:17.031 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.33 is not active+clean 2023-06-10T18:57:17.031 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:57:12.846581+0000', 'last_change': '2023-06-10T18:57:12.846581+0000', 'last_active': '2023-06-10T18:57:12.846581+0000', 'last_peered': '2023-06-10T18:57:12.846581+0000', 'last_clean': '2023-06-10T18:57:12.846581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:12.846581+0000', 'last_undegraded': '2023-06-10T18:57:12.846581+0000', 'last_fullsized': '2023-06-10T18:57:12.846581+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:57:17.032 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.32 is not active+clean 2023-06-10T18:57:17.032 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:57:12.846581+0000', 'last_change': '2023-06-10T18:57:12.846581+0000', 'last_active': '2023-06-10T18:57:12.846581+0000', 'last_peered': '2023-06-10T18:57:12.846581+0000', 'last_clean': '2023-06-10T18:57:12.846581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:12.846581+0000', 'last_undegraded': '2023-06-10T18:57:12.846581+0000', 'last_fullsized': '2023-06-10T18:57:12.846581+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:57:17.032 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.31 is not active+clean 2023-06-10T18:57:17.033 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:57:12.846581+0000', 'last_change': '2023-06-10T18:57:12.846581+0000', 'last_active': '2023-06-10T18:57:12.846581+0000', 'last_peered': '2023-06-10T18:57:12.846581+0000', 'last_clean': '2023-06-10T18:57:12.846581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:12.846581+0000', 'last_undegraded': '2023-06-10T18:57:12.846581+0000', 'last_fullsized': '2023-06-10T18:57:12.846581+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:57:17.033 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.30 is not active+clean 2023-06-10T18:57:17.034 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:57:12.846581+0000', 'last_change': '2023-06-10T18:57:12.846581+0000', 'last_active': '2023-06-10T18:57:12.846581+0000', 'last_peered': '2023-06-10T18:57:12.846581+0000', 'last_clean': '2023-06-10T18:57:12.846581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:12.846581+0000', 'last_undegraded': '2023-06-10T18:57:12.846581+0000', 'last_fullsized': '2023-06-10T18:57:12.846581+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:57:17.035 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2f is not active+clean 2023-06-10T18:57:17.036 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:57:12.846581+0000', 'last_change': '2023-06-10T18:57:12.846581+0000', 'last_active': '2023-06-10T18:57:12.846581+0000', 'last_peered': '2023-06-10T18:57:12.846581+0000', 'last_clean': '2023-06-10T18:57:12.846581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:12.846581+0000', 'last_undegraded': '2023-06-10T18:57:12.846581+0000', 'last_fullsized': '2023-06-10T18:57:12.846581+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:57:17.036 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2e is not active+clean 2023-06-10T18:57:17.037 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:57:12.846581+0000', 'last_change': '2023-06-10T18:57:12.846581+0000', 'last_active': '2023-06-10T18:57:12.846581+0000', 'last_peered': '2023-06-10T18:57:12.846581+0000', 'last_clean': '2023-06-10T18:57:12.846581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:12.846581+0000', 'last_undegraded': '2023-06-10T18:57:12.846581+0000', 'last_fullsized': '2023-06-10T18:57:12.846581+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:57:17.038 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2d is not active+clean 2023-06-10T18:57:17.039 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:57:12.846581+0000', 'last_change': '2023-06-10T18:57:12.846581+0000', 'last_active': '2023-06-10T18:57:12.846581+0000', 'last_peered': '2023-06-10T18:57:12.846581+0000', 'last_clean': '2023-06-10T18:57:12.846581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:12.846581+0000', 'last_undegraded': '2023-06-10T18:57:12.846581+0000', 'last_fullsized': '2023-06-10T18:57:12.846581+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:57:17.039 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2c is not active+clean 2023-06-10T18:57:17.041 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:57:12.846581+0000', 'last_change': '2023-06-10T18:57:12.846581+0000', 'last_active': '2023-06-10T18:57:12.846581+0000', 'last_peered': '2023-06-10T18:57:12.846581+0000', 'last_clean': '2023-06-10T18:57:12.846581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:12.846581+0000', 'last_undegraded': '2023-06-10T18:57:12.846581+0000', 'last_fullsized': '2023-06-10T18:57:12.846581+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:57:17.041 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2b is not active+clean 2023-06-10T18:57:17.042 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:57:12.846581+0000', 'last_change': '2023-06-10T18:57:12.846581+0000', 'last_active': '2023-06-10T18:57:12.846581+0000', 'last_peered': '2023-06-10T18:57:12.846581+0000', 'last_clean': '2023-06-10T18:57:12.846581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:12.846581+0000', 'last_undegraded': '2023-06-10T18:57:12.846581+0000', 'last_fullsized': '2023-06-10T18:57:12.846581+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:57:17.042 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2a is not active+clean 2023-06-10T18:57:17.043 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:57:12.846581+0000', 'last_change': '2023-06-10T18:57:12.846581+0000', 'last_active': '2023-06-10T18:57:12.846581+0000', 'last_peered': '2023-06-10T18:57:12.846581+0000', 'last_clean': '2023-06-10T18:57:12.846581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:12.846581+0000', 'last_undegraded': '2023-06-10T18:57:12.846581+0000', 'last_fullsized': '2023-06-10T18:57:12.846581+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:57:17.043 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.29 is not active+clean 2023-06-10T18:57:17.043 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:57:12.846581+0000', 'last_change': '2023-06-10T18:57:12.846581+0000', 'last_active': '2023-06-10T18:57:12.846581+0000', 'last_peered': '2023-06-10T18:57:12.846581+0000', 'last_clean': '2023-06-10T18:57:12.846581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:12.846581+0000', 'last_undegraded': '2023-06-10T18:57:12.846581+0000', 'last_fullsized': '2023-06-10T18:57:12.846581+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:57:17.044 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.28 is not active+clean 2023-06-10T18:57:17.044 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:57:12.846581+0000', 'last_change': '2023-06-10T18:57:12.846581+0000', 'last_active': '2023-06-10T18:57:12.846581+0000', 'last_peered': '2023-06-10T18:57:12.846581+0000', 'last_clean': '2023-06-10T18:57:12.846581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:12.846581+0000', 'last_undegraded': '2023-06-10T18:57:12.846581+0000', 'last_fullsized': '2023-06-10T18:57:12.846581+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:57:17.044 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.27 is not active+clean 2023-06-10T18:57:17.045 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:57:12.846581+0000', 'last_change': '2023-06-10T18:57:12.846581+0000', 'last_active': '2023-06-10T18:57:12.846581+0000', 'last_peered': '2023-06-10T18:57:12.846581+0000', 'last_clean': '2023-06-10T18:57:12.846581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:12.846581+0000', 'last_undegraded': '2023-06-10T18:57:12.846581+0000', 'last_fullsized': '2023-06-10T18:57:12.846581+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:57:17.045 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.26 is not active+clean 2023-06-10T18:57:17.045 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:57:12.846581+0000', 'last_change': '2023-06-10T18:57:12.846581+0000', 'last_active': '2023-06-10T18:57:12.846581+0000', 'last_peered': '2023-06-10T18:57:12.846581+0000', 'last_clean': '2023-06-10T18:57:12.846581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:12.846581+0000', 'last_undegraded': '2023-06-10T18:57:12.846581+0000', 'last_fullsized': '2023-06-10T18:57:12.846581+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:57:17.046 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.25 is not active+clean 2023-06-10T18:57:17.046 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:57:12.846581+0000', 'last_change': '2023-06-10T18:57:12.846581+0000', 'last_active': '2023-06-10T18:57:12.846581+0000', 'last_peered': '2023-06-10T18:57:12.846581+0000', 'last_clean': '2023-06-10T18:57:12.846581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:12.846581+0000', 'last_undegraded': '2023-06-10T18:57:12.846581+0000', 'last_fullsized': '2023-06-10T18:57:12.846581+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:57:17.046 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.24 is not active+clean 2023-06-10T18:57:17.047 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:57:12.846581+0000', 'last_change': '2023-06-10T18:57:12.846581+0000', 'last_active': '2023-06-10T18:57:12.846581+0000', 'last_peered': '2023-06-10T18:57:12.846581+0000', 'last_clean': '2023-06-10T18:57:12.846581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:12.846581+0000', 'last_undegraded': '2023-06-10T18:57:12.846581+0000', 'last_fullsized': '2023-06-10T18:57:12.846581+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:57:17.047 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.23 is not active+clean 2023-06-10T18:57:17.047 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:57:12.846581+0000', 'last_change': '2023-06-10T18:57:12.846581+0000', 'last_active': '2023-06-10T18:57:12.846581+0000', 'last_peered': '2023-06-10T18:57:12.846581+0000', 'last_clean': '2023-06-10T18:57:12.846581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:12.846581+0000', 'last_undegraded': '2023-06-10T18:57:12.846581+0000', 'last_fullsized': '2023-06-10T18:57:12.846581+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:57:17.048 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.22 is not active+clean 2023-06-10T18:57:17.048 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:57:12.846581+0000', 'last_change': '2023-06-10T18:57:12.846581+0000', 'last_active': '2023-06-10T18:57:12.846581+0000', 'last_peered': '2023-06-10T18:57:12.846581+0000', 'last_clean': '2023-06-10T18:57:12.846581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:12.846581+0000', 'last_undegraded': '2023-06-10T18:57:12.846581+0000', 'last_fullsized': '2023-06-10T18:57:12.846581+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:57:17.048 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.21 is not active+clean 2023-06-10T18:57:17.048 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:57:12.846581+0000', 'last_change': '2023-06-10T18:57:12.846581+0000', 'last_active': '2023-06-10T18:57:12.846581+0000', 'last_peered': '2023-06-10T18:57:12.846581+0000', 'last_clean': '2023-06-10T18:57:12.846581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:12.846581+0000', 'last_undegraded': '2023-06-10T18:57:12.846581+0000', 'last_fullsized': '2023-06-10T18:57:12.846581+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:57:17.049 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.20 is not active+clean 2023-06-10T18:57:17.049 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:57:12.846581+0000', 'last_change': '2023-06-10T18:57:12.846581+0000', 'last_active': '2023-06-10T18:57:12.846581+0000', 'last_peered': '2023-06-10T18:57:12.846581+0000', 'last_clean': '2023-06-10T18:57:12.846581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:12.846581+0000', 'last_undegraded': '2023-06-10T18:57:12.846581+0000', 'last_fullsized': '2023-06-10T18:57:12.846581+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:57:17.049 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1c is not active+clean 2023-06-10T18:57:17.050 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:57:12.846581+0000', 'last_change': '2023-06-10T18:57:12.846581+0000', 'last_active': '2023-06-10T18:57:12.846581+0000', 'last_peered': '2023-06-10T18:57:12.846581+0000', 'last_clean': '2023-06-10T18:57:12.846581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:12.846581+0000', 'last_undegraded': '2023-06-10T18:57:12.846581+0000', 'last_fullsized': '2023-06-10T18:57:12.846581+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:57:17.050 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1f is not active+clean 2023-06-10T18:57:17.050 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2023-06-10T18:57:11.858048+0000', 'last_change': '2023-06-10T18:57:11.858048+0000', 'last_active': '2023-06-10T18:57:11.842880+0000', 'last_peered': '2023-06-10T18:57:11.842880+0000', 'last_clean': '2023-06-10T18:57:11.842880+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:11.858048+0000', 'last_undegraded': '2023-06-10T18:57:11.858048+0000', 'last_fullsized': '2023-06-10T18:57:11.858048+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-06-10T18:57:17.051 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1d is not active+clean 2023-06-10T18:57:17.051 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:57:12.846581+0000', 'last_change': '2023-06-10T18:57:12.846581+0000', 'last_active': '2023-06-10T18:57:12.846581+0000', 'last_peered': '2023-06-10T18:57:12.846581+0000', 'last_clean': '2023-06-10T18:57:12.846581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:12.846581+0000', 'last_undegraded': '2023-06-10T18:57:12.846581+0000', 'last_fullsized': '2023-06-10T18:57:12.846581+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:57:17.051 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1e is not active+clean 2023-06-10T18:57:17.051 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2023-06-10T18:57:11.867848+0000', 'last_change': '2023-06-10T18:57:11.867848+0000', 'last_active': '2023-06-10T18:57:11.842880+0000', 'last_peered': '2023-06-10T18:57:11.842880+0000', 'last_clean': '2023-06-10T18:57:11.842880+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:11.867848+0000', 'last_undegraded': '2023-06-10T18:57:11.867848+0000', 'last_fullsized': '2023-06-10T18:57:11.867848+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-06-10T18:57:17.052 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1e is not active+clean 2023-06-10T18:57:17.052 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:57:12.846581+0000', 'last_change': '2023-06-10T18:57:12.846581+0000', 'last_active': '2023-06-10T18:57:12.846581+0000', 'last_peered': '2023-06-10T18:57:12.846581+0000', 'last_clean': '2023-06-10T18:57:12.846581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:12.846581+0000', 'last_undegraded': '2023-06-10T18:57:12.846581+0000', 'last_fullsized': '2023-06-10T18:57:12.846581+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:57:17.052 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1d is not active+clean 2023-06-10T18:57:17.053 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2023-06-10T18:57:11.867289+0000', 'last_change': '2023-06-10T18:57:11.867289+0000', 'last_active': '2023-06-10T18:57:11.842880+0000', 'last_peered': '2023-06-10T18:57:11.842880+0000', 'last_clean': '2023-06-10T18:57:11.842880+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:11.867289+0000', 'last_undegraded': '2023-06-10T18:57:11.867289+0000', 'last_fullsized': '2023-06-10T18:57:11.867289+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-06-10T18:57:17.053 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1f is not active+clean 2023-06-10T18:57:17.053 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:57:12.846581+0000', 'last_change': '2023-06-10T18:57:12.846581+0000', 'last_active': '2023-06-10T18:57:12.846581+0000', 'last_peered': '2023-06-10T18:57:12.846581+0000', 'last_clean': '2023-06-10T18:57:12.846581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:12.846581+0000', 'last_undegraded': '2023-06-10T18:57:12.846581+0000', 'last_fullsized': '2023-06-10T18:57:12.846581+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:57:17.054 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1c is not active+clean 2023-06-10T18:57:17.054 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2023-06-10T18:57:11.868398+0000', 'last_change': '2023-06-10T18:57:11.868398+0000', 'last_active': '2023-06-10T18:57:11.842880+0000', 'last_peered': '2023-06-10T18:57:11.842880+0000', 'last_clean': '2023-06-10T18:57:11.842880+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:11.868398+0000', 'last_undegraded': '2023-06-10T18:57:11.868398+0000', 'last_fullsized': '2023-06-10T18:57:11.868398+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-06-10T18:57:17.054 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.18 is not active+clean 2023-06-10T18:57:17.055 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:57:12.846581+0000', 'last_change': '2023-06-10T18:57:12.846581+0000', 'last_active': '2023-06-10T18:57:12.846581+0000', 'last_peered': '2023-06-10T18:57:12.846581+0000', 'last_clean': '2023-06-10T18:57:12.846581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:12.846581+0000', 'last_undegraded': '2023-06-10T18:57:12.846581+0000', 'last_fullsized': '2023-06-10T18:57:12.846581+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:57:17.055 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1b is not active+clean 2023-06-10T18:57:17.055 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2023-06-10T18:57:11.864218+0000', 'last_change': '2023-06-10T18:57:11.864218+0000', 'last_active': '2023-06-10T18:57:11.842880+0000', 'last_peered': '2023-06-10T18:57:11.842880+0000', 'last_clean': '2023-06-10T18:57:11.842880+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:11.864218+0000', 'last_undegraded': '2023-06-10T18:57:11.864218+0000', 'last_fullsized': '2023-06-10T18:57:11.864218+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-06-10T18:57:17.056 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.19 is not active+clean 2023-06-10T18:57:17.056 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:57:12.846581+0000', 'last_change': '2023-06-10T18:57:12.846581+0000', 'last_active': '2023-06-10T18:57:12.846581+0000', 'last_peered': '2023-06-10T18:57:12.846581+0000', 'last_clean': '2023-06-10T18:57:12.846581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:12.846581+0000', 'last_undegraded': '2023-06-10T18:57:12.846581+0000', 'last_fullsized': '2023-06-10T18:57:12.846581+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:57:17.056 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1a is not active+clean 2023-06-10T18:57:17.056 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2023-06-10T18:57:11.865117+0000', 'last_change': '2023-06-10T18:57:11.865117+0000', 'last_active': '2023-06-10T18:57:11.842880+0000', 'last_peered': '2023-06-10T18:57:11.842880+0000', 'last_clean': '2023-06-10T18:57:11.842880+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:11.865117+0000', 'last_undegraded': '2023-06-10T18:57:11.865117+0000', 'last_fullsized': '2023-06-10T18:57:11.865117+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-06-10T18:57:17.057 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1a is not active+clean 2023-06-10T18:57:17.057 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:57:12.846581+0000', 'last_change': '2023-06-10T18:57:12.846581+0000', 'last_active': '2023-06-10T18:57:12.846581+0000', 'last_peered': '2023-06-10T18:57:12.846581+0000', 'last_clean': '2023-06-10T18:57:12.846581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:12.846581+0000', 'last_undegraded': '2023-06-10T18:57:12.846581+0000', 'last_fullsized': '2023-06-10T18:57:12.846581+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:57:17.057 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.19 is not active+clean 2023-06-10T18:57:17.058 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2023-06-10T18:57:11.864215+0000', 'last_change': '2023-06-10T18:57:11.864215+0000', 'last_active': '2023-06-10T18:57:11.842880+0000', 'last_peered': '2023-06-10T18:57:11.842880+0000', 'last_clean': '2023-06-10T18:57:11.842880+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:11.864215+0000', 'last_undegraded': '2023-06-10T18:57:11.864215+0000', 'last_fullsized': '2023-06-10T18:57:11.864215+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-06-10T18:57:17.058 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1b is not active+clean 2023-06-10T18:57:17.058 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:57:12.846581+0000', 'last_change': '2023-06-10T18:57:12.846581+0000', 'last_active': '2023-06-10T18:57:12.846581+0000', 'last_peered': '2023-06-10T18:57:12.846581+0000', 'last_clean': '2023-06-10T18:57:12.846581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:12.846581+0000', 'last_undegraded': '2023-06-10T18:57:12.846581+0000', 'last_fullsized': '2023-06-10T18:57:12.846581+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:57:17.059 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.18 is not active+clean 2023-06-10T18:57:17.059 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2023-06-10T18:57:11.852046+0000', 'last_change': '2023-06-10T18:57:11.852046+0000', 'last_active': '2023-06-10T18:57:11.842880+0000', 'last_peered': '2023-06-10T18:57:11.842880+0000', 'last_clean': '2023-06-10T18:57:11.842880+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:11.852046+0000', 'last_undegraded': '2023-06-10T18:57:11.852046+0000', 'last_fullsized': '2023-06-10T18:57:11.852046+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-06-10T18:57:17.059 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.14 is not active+clean 2023-06-10T18:57:17.059 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:57:12.846581+0000', 'last_change': '2023-06-10T18:57:12.846581+0000', 'last_active': '2023-06-10T18:57:12.846581+0000', 'last_peered': '2023-06-10T18:57:12.846581+0000', 'last_clean': '2023-06-10T18:57:12.846581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:12.846581+0000', 'last_undegraded': '2023-06-10T18:57:12.846581+0000', 'last_fullsized': '2023-06-10T18:57:12.846581+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:57:17.060 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.17 is not active+clean 2023-06-10T18:57:17.060 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2023-06-10T18:57:11.858422+0000', 'last_change': '2023-06-10T18:57:11.858422+0000', 'last_active': '2023-06-10T18:57:11.842880+0000', 'last_peered': '2023-06-10T18:57:11.842880+0000', 'last_clean': '2023-06-10T18:57:11.842880+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:11.858422+0000', 'last_undegraded': '2023-06-10T18:57:11.858422+0000', 'last_fullsized': '2023-06-10T18:57:11.858422+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-06-10T18:57:17.060 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.15 is not active+clean 2023-06-10T18:57:17.061 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:57:12.846581+0000', 'last_change': '2023-06-10T18:57:12.846581+0000', 'last_active': '2023-06-10T18:57:12.846581+0000', 'last_peered': '2023-06-10T18:57:12.846581+0000', 'last_clean': '2023-06-10T18:57:12.846581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:12.846581+0000', 'last_undegraded': '2023-06-10T18:57:12.846581+0000', 'last_fullsized': '2023-06-10T18:57:12.846581+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:57:17.061 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.16 is not active+clean 2023-06-10T18:57:17.061 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2023-06-10T18:57:11.853111+0000', 'last_change': '2023-06-10T18:57:11.853111+0000', 'last_active': '2023-06-10T18:57:11.842880+0000', 'last_peered': '2023-06-10T18:57:11.842880+0000', 'last_clean': '2023-06-10T18:57:11.842880+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:11.853111+0000', 'last_undegraded': '2023-06-10T18:57:11.853111+0000', 'last_fullsized': '2023-06-10T18:57:11.853111+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-06-10T18:57:17.062 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.16 is not active+clean 2023-06-10T18:57:17.062 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:57:12.846581+0000', 'last_change': '2023-06-10T18:57:12.846581+0000', 'last_active': '2023-06-10T18:57:12.846581+0000', 'last_peered': '2023-06-10T18:57:12.846581+0000', 'last_clean': '2023-06-10T18:57:12.846581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:12.846581+0000', 'last_undegraded': '2023-06-10T18:57:12.846581+0000', 'last_fullsized': '2023-06-10T18:57:12.846581+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:57:17.062 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.15 is not active+clean 2023-06-10T18:57:17.063 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2023-06-10T18:57:11.858596+0000', 'last_change': '2023-06-10T18:57:11.858596+0000', 'last_active': '2023-06-10T18:57:11.842880+0000', 'last_peered': '2023-06-10T18:57:11.842880+0000', 'last_clean': '2023-06-10T18:57:11.842880+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:11.858596+0000', 'last_undegraded': '2023-06-10T18:57:11.858596+0000', 'last_fullsized': '2023-06-10T18:57:11.858596+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-06-10T18:57:17.063 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.17 is not active+clean 2023-06-10T18:57:17.063 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:57:12.846581+0000', 'last_change': '2023-06-10T18:57:12.846581+0000', 'last_active': '2023-06-10T18:57:12.846581+0000', 'last_peered': '2023-06-10T18:57:12.846581+0000', 'last_clean': '2023-06-10T18:57:12.846581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:12.846581+0000', 'last_undegraded': '2023-06-10T18:57:12.846581+0000', 'last_fullsized': '2023-06-10T18:57:12.846581+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:57:17.064 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.14 is not active+clean 2023-06-10T18:57:17.064 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2023-06-10T18:57:11.858699+0000', 'last_change': '2023-06-10T18:57:11.858699+0000', 'last_active': '2023-06-10T18:57:11.842880+0000', 'last_peered': '2023-06-10T18:57:11.842880+0000', 'last_clean': '2023-06-10T18:57:11.842880+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:11.858699+0000', 'last_undegraded': '2023-06-10T18:57:11.858699+0000', 'last_fullsized': '2023-06-10T18:57:11.858699+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-06-10T18:57:17.064 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.10 is not active+clean 2023-06-10T18:57:17.064 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:57:12.846581+0000', 'last_change': '2023-06-10T18:57:12.846581+0000', 'last_active': '2023-06-10T18:57:12.846581+0000', 'last_peered': '2023-06-10T18:57:12.846581+0000', 'last_clean': '2023-06-10T18:57:12.846581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:12.846581+0000', 'last_undegraded': '2023-06-10T18:57:12.846581+0000', 'last_fullsized': '2023-06-10T18:57:12.846581+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:57:17.065 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.13 is not active+clean 2023-06-10T18:57:17.065 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2023-06-10T18:57:11.858402+0000', 'last_change': '2023-06-10T18:57:11.858402+0000', 'last_active': '2023-06-10T18:57:11.842880+0000', 'last_peered': '2023-06-10T18:57:11.842880+0000', 'last_clean': '2023-06-10T18:57:11.842880+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:11.858402+0000', 'last_undegraded': '2023-06-10T18:57:11.858402+0000', 'last_fullsized': '2023-06-10T18:57:11.858402+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-06-10T18:57:17.065 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.11 is not active+clean 2023-06-10T18:57:17.066 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:57:12.846581+0000', 'last_change': '2023-06-10T18:57:12.846581+0000', 'last_active': '2023-06-10T18:57:12.846581+0000', 'last_peered': '2023-06-10T18:57:12.846581+0000', 'last_clean': '2023-06-10T18:57:12.846581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:12.846581+0000', 'last_undegraded': '2023-06-10T18:57:12.846581+0000', 'last_fullsized': '2023-06-10T18:57:12.846581+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:57:17.066 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.12 is not active+clean 2023-06-10T18:57:17.066 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2023-06-10T18:57:11.872354+0000', 'last_change': '2023-06-10T18:57:11.872354+0000', 'last_active': '2023-06-10T18:57:11.842880+0000', 'last_peered': '2023-06-10T18:57:11.842880+0000', 'last_clean': '2023-06-10T18:57:11.842880+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:11.872354+0000', 'last_undegraded': '2023-06-10T18:57:11.872354+0000', 'last_fullsized': '2023-06-10T18:57:11.872354+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-06-10T18:57:17.067 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.12 is not active+clean 2023-06-10T18:57:17.067 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:57:12.846581+0000', 'last_change': '2023-06-10T18:57:12.846581+0000', 'last_active': '2023-06-10T18:57:12.846581+0000', 'last_peered': '2023-06-10T18:57:12.846581+0000', 'last_clean': '2023-06-10T18:57:12.846581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:12.846581+0000', 'last_undegraded': '2023-06-10T18:57:12.846581+0000', 'last_fullsized': '2023-06-10T18:57:12.846581+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:57:17.067 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.11 is not active+clean 2023-06-10T18:57:17.067 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2023-06-10T18:57:11.857189+0000', 'last_change': '2023-06-10T18:57:11.857189+0000', 'last_active': '2023-06-10T18:57:11.842880+0000', 'last_peered': '2023-06-10T18:57:11.842880+0000', 'last_clean': '2023-06-10T18:57:11.842880+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:11.857189+0000', 'last_undegraded': '2023-06-10T18:57:11.857189+0000', 'last_fullsized': '2023-06-10T18:57:11.857189+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-06-10T18:57:17.068 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.13 is not active+clean 2023-06-10T18:57:17.068 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:57:12.846581+0000', 'last_change': '2023-06-10T18:57:12.846581+0000', 'last_active': '2023-06-10T18:57:12.846581+0000', 'last_peered': '2023-06-10T18:57:12.846581+0000', 'last_clean': '2023-06-10T18:57:12.846581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:12.846581+0000', 'last_undegraded': '2023-06-10T18:57:12.846581+0000', 'last_fullsized': '2023-06-10T18:57:12.846581+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:57:17.068 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.10 is not active+clean 2023-06-10T18:57:17.069 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2023-06-10T18:57:11.853005+0000', 'last_change': '2023-06-10T18:57:11.853005+0000', 'last_active': '2023-06-10T18:57:11.842880+0000', 'last_peered': '2023-06-10T18:57:11.842880+0000', 'last_clean': '2023-06-10T18:57:11.842880+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:11.853005+0000', 'last_undegraded': '2023-06-10T18:57:11.853005+0000', 'last_fullsized': '2023-06-10T18:57:11.853005+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-06-10T18:57:17.069 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.4 is not active+clean 2023-06-10T18:57:17.069 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:57:12.846581+0000', 'last_change': '2023-06-10T18:57:12.846581+0000', 'last_active': '2023-06-10T18:57:12.846581+0000', 'last_peered': '2023-06-10T18:57:12.846581+0000', 'last_clean': '2023-06-10T18:57:12.846581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:12.846581+0000', 'last_undegraded': '2023-06-10T18:57:12.846581+0000', 'last_fullsized': '2023-06-10T18:57:12.846581+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:57:17.070 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.7 is not active+clean 2023-06-10T18:57:17.070 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2023-06-10T18:57:11.871215+0000', 'last_change': '2023-06-10T18:57:11.871215+0000', 'last_active': '2023-06-10T18:57:11.842880+0000', 'last_peered': '2023-06-10T18:57:11.842880+0000', 'last_clean': '2023-06-10T18:57:11.842880+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:11.871215+0000', 'last_undegraded': '2023-06-10T18:57:11.871215+0000', 'last_fullsized': '2023-06-10T18:57:11.871215+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-06-10T18:57:17.070 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.5 is not active+clean 2023-06-10T18:57:17.071 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:57:12.846581+0000', 'last_change': '2023-06-10T18:57:12.846581+0000', 'last_active': '2023-06-10T18:57:12.846581+0000', 'last_peered': '2023-06-10T18:57:12.846581+0000', 'last_clean': '2023-06-10T18:57:12.846581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:12.846581+0000', 'last_undegraded': '2023-06-10T18:57:12.846581+0000', 'last_fullsized': '2023-06-10T18:57:12.846581+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:57:17.071 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.6 is not active+clean 2023-06-10T18:57:17.071 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2023-06-10T18:57:11.871166+0000', 'last_change': '2023-06-10T18:57:11.871166+0000', 'last_active': '2023-06-10T18:57:11.842880+0000', 'last_peered': '2023-06-10T18:57:11.842880+0000', 'last_clean': '2023-06-10T18:57:11.842880+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:11.871166+0000', 'last_undegraded': '2023-06-10T18:57:11.871166+0000', 'last_fullsized': '2023-06-10T18:57:11.871166+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-06-10T18:57:17.071 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.6 is not active+clean 2023-06-10T18:57:17.072 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:57:12.846581+0000', 'last_change': '2023-06-10T18:57:12.846581+0000', 'last_active': '2023-06-10T18:57:12.846581+0000', 'last_peered': '2023-06-10T18:57:12.846581+0000', 'last_clean': '2023-06-10T18:57:12.846581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:12.846581+0000', 'last_undegraded': '2023-06-10T18:57:12.846581+0000', 'last_fullsized': '2023-06-10T18:57:12.846581+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:57:17.072 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.5 is not active+clean 2023-06-10T18:57:17.072 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2023-06-10T18:57:11.868169+0000', 'last_change': '2023-06-10T18:57:11.868169+0000', 'last_active': '2023-06-10T18:57:11.842880+0000', 'last_peered': '2023-06-10T18:57:11.842880+0000', 'last_clean': '2023-06-10T18:57:11.842880+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:11.868169+0000', 'last_undegraded': '2023-06-10T18:57:11.868169+0000', 'last_fullsized': '2023-06-10T18:57:11.868169+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-06-10T18:57:17.073 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.7 is not active+clean 2023-06-10T18:57:17.073 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:57:12.846581+0000', 'last_change': '2023-06-10T18:57:12.846581+0000', 'last_active': '2023-06-10T18:57:12.846581+0000', 'last_peered': '2023-06-10T18:57:12.846581+0000', 'last_clean': '2023-06-10T18:57:12.846581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:12.846581+0000', 'last_undegraded': '2023-06-10T18:57:12.846581+0000', 'last_fullsized': '2023-06-10T18:57:12.846581+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:57:17.073 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.4 is not active+clean 2023-06-10T18:57:17.074 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2023-06-10T18:57:11.857982+0000', 'last_change': '2023-06-10T18:57:11.857982+0000', 'last_active': '2023-06-10T18:57:11.842880+0000', 'last_peered': '2023-06-10T18:57:11.842880+0000', 'last_clean': '2023-06-10T18:57:11.842880+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:11.857982+0000', 'last_undegraded': '2023-06-10T18:57:11.857982+0000', 'last_fullsized': '2023-06-10T18:57:11.857982+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-06-10T18:57:17.074 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.0 is not active+clean 2023-06-10T18:57:17.074 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:57:12.846581+0000', 'last_change': '2023-06-10T18:57:12.846581+0000', 'last_active': '2023-06-10T18:57:12.846581+0000', 'last_peered': '2023-06-10T18:57:12.846581+0000', 'last_clean': '2023-06-10T18:57:12.846581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:12.846581+0000', 'last_undegraded': '2023-06-10T18:57:12.846581+0000', 'last_fullsized': '2023-06-10T18:57:12.846581+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:57:17.075 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3 is not active+clean 2023-06-10T18:57:17.075 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2023-06-10T18:57:11.857076+0000', 'last_change': '2023-06-10T18:57:11.857076+0000', 'last_active': '2023-06-10T18:57:11.842880+0000', 'last_peered': '2023-06-10T18:57:11.842880+0000', 'last_clean': '2023-06-10T18:57:11.842880+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:11.857076+0000', 'last_undegraded': '2023-06-10T18:57:11.857076+0000', 'last_fullsized': '2023-06-10T18:57:11.857076+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-06-10T18:57:17.075 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1 is not active+clean 2023-06-10T18:57:17.075 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:57:12.846581+0000', 'last_change': '2023-06-10T18:57:12.846581+0000', 'last_active': '2023-06-10T18:57:12.846581+0000', 'last_peered': '2023-06-10T18:57:12.846581+0000', 'last_clean': '2023-06-10T18:57:12.846581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:12.846581+0000', 'last_undegraded': '2023-06-10T18:57:12.846581+0000', 'last_fullsized': '2023-06-10T18:57:12.846581+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:57:17.076 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2 is not active+clean 2023-06-10T18:57:17.076 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2023-06-10T18:57:11.864162+0000', 'last_change': '2023-06-10T18:57:11.864162+0000', 'last_active': '2023-06-10T18:57:11.842880+0000', 'last_peered': '2023-06-10T18:57:11.842880+0000', 'last_clean': '2023-06-10T18:57:11.842880+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:11.864162+0000', 'last_undegraded': '2023-06-10T18:57:11.864162+0000', 'last_fullsized': '2023-06-10T18:57:11.864162+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-06-10T18:57:17.076 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2 is not active+clean 2023-06-10T18:57:17.077 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:57:12.846581+0000', 'last_change': '2023-06-10T18:57:12.846581+0000', 'last_active': '2023-06-10T18:57:12.846581+0000', 'last_peered': '2023-06-10T18:57:12.846581+0000', 'last_clean': '2023-06-10T18:57:12.846581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:12.846581+0000', 'last_undegraded': '2023-06-10T18:57:12.846581+0000', 'last_fullsized': '2023-06-10T18:57:12.846581+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:57:17.077 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1 is not active+clean 2023-06-10T18:57:17.077 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2023-06-10T18:57:11.865225+0000', 'last_change': '2023-06-10T18:57:11.865225+0000', 'last_active': '2023-06-10T18:57:11.842880+0000', 'last_peered': '2023-06-10T18:57:11.842880+0000', 'last_clean': '2023-06-10T18:57:11.842880+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:11.865225+0000', 'last_undegraded': '2023-06-10T18:57:11.865225+0000', 'last_fullsized': '2023-06-10T18:57:11.865225+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-06-10T18:57:17.078 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3 is not active+clean 2023-06-10T18:57:17.078 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:57:12.846581+0000', 'last_change': '2023-06-10T18:57:12.846581+0000', 'last_active': '2023-06-10T18:57:12.846581+0000', 'last_peered': '2023-06-10T18:57:12.846581+0000', 'last_clean': '2023-06-10T18:57:12.846581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:12.846581+0000', 'last_undegraded': '2023-06-10T18:57:12.846581+0000', 'last_fullsized': '2023-06-10T18:57:12.846581+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:57:17.078 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.0 is not active+clean 2023-06-10T18:57:17.079 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2023-06-10T18:57:11.857958+0000', 'last_change': '2023-06-10T18:57:11.857958+0000', 'last_active': '2023-06-10T18:57:11.842880+0000', 'last_peered': '2023-06-10T18:57:11.842880+0000', 'last_clean': '2023-06-10T18:57:11.842880+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:11.857958+0000', 'last_undegraded': '2023-06-10T18:57:11.857958+0000', 'last_fullsized': '2023-06-10T18:57:11.857958+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-06-10T18:57:17.079 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.b is not active+clean 2023-06-10T18:57:17.079 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:57:12.846581+0000', 'last_change': '2023-06-10T18:57:12.846581+0000', 'last_active': '2023-06-10T18:57:12.846581+0000', 'last_peered': '2023-06-10T18:57:12.846581+0000', 'last_clean': '2023-06-10T18:57:12.846581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:12.846581+0000', 'last_undegraded': '2023-06-10T18:57:12.846581+0000', 'last_fullsized': '2023-06-10T18:57:12.846581+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:57:17.079 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.8 is not active+clean 2023-06-10T18:57:17.080 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2023-06-10T18:57:11.864162+0000', 'last_change': '2023-06-10T18:57:11.864162+0000', 'last_active': '2023-06-10T18:57:11.842880+0000', 'last_peered': '2023-06-10T18:57:11.842880+0000', 'last_clean': '2023-06-10T18:57:11.842880+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:11.864162+0000', 'last_undegraded': '2023-06-10T18:57:11.864162+0000', 'last_fullsized': '2023-06-10T18:57:11.864162+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-06-10T18:57:17.080 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.8 is not active+clean 2023-06-10T18:57:17.080 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:57:12.846581+0000', 'last_change': '2023-06-10T18:57:12.846581+0000', 'last_active': '2023-06-10T18:57:12.846581+0000', 'last_peered': '2023-06-10T18:57:12.846581+0000', 'last_clean': '2023-06-10T18:57:12.846581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:12.846581+0000', 'last_undegraded': '2023-06-10T18:57:12.846581+0000', 'last_fullsized': '2023-06-10T18:57:12.846581+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:57:17.081 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.b is not active+clean 2023-06-10T18:57:17.081 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2023-06-10T18:57:11.867782+0000', 'last_change': '2023-06-10T18:57:11.867782+0000', 'last_active': '2023-06-10T18:57:11.842880+0000', 'last_peered': '2023-06-10T18:57:11.842880+0000', 'last_clean': '2023-06-10T18:57:11.842880+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:11.867782+0000', 'last_undegraded': '2023-06-10T18:57:11.867782+0000', 'last_fullsized': '2023-06-10T18:57:11.867782+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-06-10T18:57:17.081 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.9 is not active+clean 2023-06-10T18:57:17.082 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:57:12.846581+0000', 'last_change': '2023-06-10T18:57:12.846581+0000', 'last_active': '2023-06-10T18:57:12.846581+0000', 'last_peered': '2023-06-10T18:57:12.846581+0000', 'last_clean': '2023-06-10T18:57:12.846581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:12.846581+0000', 'last_undegraded': '2023-06-10T18:57:12.846581+0000', 'last_fullsized': '2023-06-10T18:57:12.846581+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:57:17.082 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.a is not active+clean 2023-06-10T18:57:17.082 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2023-06-10T18:57:11.871187+0000', 'last_change': '2023-06-10T18:57:11.871187+0000', 'last_active': '2023-06-10T18:57:11.842880+0000', 'last_peered': '2023-06-10T18:57:11.842880+0000', 'last_clean': '2023-06-10T18:57:11.842880+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:11.871187+0000', 'last_undegraded': '2023-06-10T18:57:11.871187+0000', 'last_fullsized': '2023-06-10T18:57:11.871187+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-06-10T18:57:17.083 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.a is not active+clean 2023-06-10T18:57:17.083 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:57:12.846581+0000', 'last_change': '2023-06-10T18:57:12.846581+0000', 'last_active': '2023-06-10T18:57:12.846581+0000', 'last_peered': '2023-06-10T18:57:12.846581+0000', 'last_clean': '2023-06-10T18:57:12.846581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:12.846581+0000', 'last_undegraded': '2023-06-10T18:57:12.846581+0000', 'last_fullsized': '2023-06-10T18:57:12.846581+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:57:17.083 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.9 is not active+clean 2023-06-10T18:57:17.083 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2023-06-10T18:57:11.867223+0000', 'last_change': '2023-06-10T18:57:11.867223+0000', 'last_active': '2023-06-10T18:57:11.842880+0000', 'last_peered': '2023-06-10T18:57:11.842880+0000', 'last_clean': '2023-06-10T18:57:11.842880+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:11.867223+0000', 'last_undegraded': '2023-06-10T18:57:11.867223+0000', 'last_fullsized': '2023-06-10T18:57:11.867223+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-06-10T18:57:17.084 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.c is not active+clean 2023-06-10T18:57:17.084 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:57:12.846581+0000', 'last_change': '2023-06-10T18:57:12.846581+0000', 'last_active': '2023-06-10T18:57:12.846581+0000', 'last_peered': '2023-06-10T18:57:12.846581+0000', 'last_clean': '2023-06-10T18:57:12.846581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:12.846581+0000', 'last_undegraded': '2023-06-10T18:57:12.846581+0000', 'last_fullsized': '2023-06-10T18:57:12.846581+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:57:17.084 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.f is not active+clean 2023-06-10T18:57:17.085 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2023-06-10T18:57:11.872455+0000', 'last_change': '2023-06-10T18:57:11.872455+0000', 'last_active': '2023-06-10T18:57:11.842880+0000', 'last_peered': '2023-06-10T18:57:11.842880+0000', 'last_clean': '2023-06-10T18:57:11.842880+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:11.872455+0000', 'last_undegraded': '2023-06-10T18:57:11.872455+0000', 'last_fullsized': '2023-06-10T18:57:11.872455+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-06-10T18:57:17.085 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.d is not active+clean 2023-06-10T18:57:17.085 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:57:12.846581+0000', 'last_change': '2023-06-10T18:57:12.846581+0000', 'last_active': '2023-06-10T18:57:12.846581+0000', 'last_peered': '2023-06-10T18:57:12.846581+0000', 'last_clean': '2023-06-10T18:57:12.846581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:12.846581+0000', 'last_undegraded': '2023-06-10T18:57:12.846581+0000', 'last_fullsized': '2023-06-10T18:57:12.846581+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:57:17.086 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.e is not active+clean 2023-06-10T18:57:17.086 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2023-06-10T18:57:11.857155+0000', 'last_change': '2023-06-10T18:57:11.857155+0000', 'last_active': '2023-06-10T18:57:11.842880+0000', 'last_peered': '2023-06-10T18:57:11.842880+0000', 'last_clean': '2023-06-10T18:57:11.842880+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:11.857155+0000', 'last_undegraded': '2023-06-10T18:57:11.857155+0000', 'last_fullsized': '2023-06-10T18:57:11.857155+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-06-10T18:57:17.086 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.e is not active+clean 2023-06-10T18:57:17.087 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:57:12.846581+0000', 'last_change': '2023-06-10T18:57:12.846581+0000', 'last_active': '2023-06-10T18:57:12.846581+0000', 'last_peered': '2023-06-10T18:57:12.846581+0000', 'last_clean': '2023-06-10T18:57:12.846581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:12.846581+0000', 'last_undegraded': '2023-06-10T18:57:12.846581+0000', 'last_fullsized': '2023-06-10T18:57:12.846581+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:57:17.087 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.d is not active+clean 2023-06-10T18:57:17.087 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2023-06-10T18:57:11.857096+0000', 'last_change': '2023-06-10T18:57:11.857096+0000', 'last_active': '2023-06-10T18:57:11.842880+0000', 'last_peered': '2023-06-10T18:57:11.842880+0000', 'last_clean': '2023-06-10T18:57:11.842880+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:11.857096+0000', 'last_undegraded': '2023-06-10T18:57:11.857096+0000', 'last_fullsized': '2023-06-10T18:57:11.857096+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-06-10T18:57:17.087 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.f is not active+clean 2023-06-10T18:57:17.088 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T18:57:12.846581+0000', 'last_change': '2023-06-10T18:57:12.846581+0000', 'last_active': '2023-06-10T18:57:12.846581+0000', 'last_peered': '2023-06-10T18:57:12.846581+0000', 'last_clean': '2023-06-10T18:57:12.846581+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:12.846581+0000', 'last_undegraded': '2023-06-10T18:57:12.846581+0000', 'last_fullsized': '2023-06-10T18:57:12.846581+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:12.846581+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T18:57:17.088 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.c is not active+clean 2023-06-10T18:57:17.088 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2023-06-10T18:57:11.864245+0000', 'last_change': '2023-06-10T18:57:11.864245+0000', 'last_active': '2023-06-10T18:57:11.842880+0000', 'last_peered': '2023-06-10T18:57:11.842880+0000', 'last_clean': '2023-06-10T18:57:11.842880+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T18:57:11.864245+0000', 'last_undegraded': '2023-06-10T18:57:11.864245+0000', 'last_fullsized': '2023-06-10T18:57:11.864245+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'last_clean_scrub_stamp': '2023-06-10T18:57:11.842880+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-06-10T18:57:17.089 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-06-10T18:57:17.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.210+0000 7f98048e0640 1 Processor -- start 2023-06-10T18:57:17.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.210+0000 7f98048e0640 1 -- start start 2023-06-10T18:57:17.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.214+0000 7f98048e0640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f98000c9840 0x7f98000c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:17.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.214+0000 7f98048e0640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9800071060 0x7f98000af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:17.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.214+0000 7f98048e0640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9800159b50 con 0x7f98000afc60 2023-06-10T18:57:17.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.214+0000 7f98048e0640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98000ca150 con 0x7f98000c9840 2023-06-10T18:57:17.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.214+0000 7f98048e0640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98000702a0 con 0x7f9800071060 2023-06-10T18:57:17.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.214+0000 7f97fe59c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f98000c9840 0x7f98000c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:17.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.214+0000 7f97fed9d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f98000afc60 0x7f980015d2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:48278/0 (socket says 172.21.15.53:48278) 2023-06-10T18:57:17.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.214+0000 7f97fed9d640 1 -- 172.21.15.53:0/753655637 learned_addr learned my addr 172.21.15.53:0/753655637 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:57:17.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.214+0000 7f97fdd9b640 1 --2- 172.21.15.53:0/753655637 >> v2:172.21.15.117:3300/0 conn(0x7f9800071060 0x7f98000af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:17.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.214+0000 7f97fe59c640 1 -- 172.21.15.53:0/753655637 >> v2:172.21.15.117:3300/0 conn(0x7f9800071060 msgr2=0x7f98000af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:17.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.214+0000 7f97fe59c640 1 --2- 172.21.15.53:0/753655637 >> v2:172.21.15.117:3300/0 conn(0x7f9800071060 0x7f98000af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:17.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.214+0000 7f97fe59c640 1 -- 172.21.15.53:0/753655637 >> v1:172.21.15.53:6789/0 conn(0x7f98000afc60 legacy=0x7f980015d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:17.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.214+0000 7f97fe59c640 1 -- 172.21.15.53:0/753655637 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9800070580 con 0x7f98000c9840 2023-06-10T18:57:17.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.214+0000 7f97fd59a640 1 -- 172.21.15.53:0/753655637 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4211857966 0 0) 0x7f9800159b50 con 0x7f98000afc60 2023-06-10T18:57:17.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.214+0000 7f97fdd9b640 1 --2- 172.21.15.53:0/753655637 >> v2:172.21.15.117:3300/0 conn(0x7f9800071060 0x7f98000af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:57:17.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.214+0000 7f97fe59c640 1 --2- 172.21.15.53:0/753655637 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98000c9840 0x7f98000c9c10 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f980006e650 tx=0x7f97f001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=855ffff82dbe3a0a server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:17.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.214+0000 7f97fd59a640 1 -- 172.21.15.53:0/753655637 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f0004230 con 0x7f98000c9840 2023-06-10T18:57:17.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.214+0000 7f97fd59a640 1 -- 172.21.15.53:0/753655637 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97f00a7050 con 0x7f98000c9840 2023-06-10T18:57:17.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.214+0000 7f97fd59a640 1 -- 172.21.15.53:0/753655637 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f0003620 con 0x7f98000c9840 2023-06-10T18:57:17.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.214+0000 7f98048e0640 1 -- 172.21.15.53:0/753655637 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98000c9840 msgr2=0x7f98000c9c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:17.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.214+0000 7f98048e0640 1 --2- 172.21.15.53:0/753655637 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98000c9840 0x7f98000c9c10 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f980006e650 tx=0x7f97f001c430 comp rx=0 tx=0).stop 2023-06-10T18:57:17.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.218+0000 7f98048e0640 1 -- 172.21.15.53:0/753655637 shutdown_connections 2023-06-10T18:57:17.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.218+0000 7f98048e0640 1 --2- 172.21.15.53:0/753655637 >> v2:172.21.15.117:3300/0 conn(0x7f9800071060 0x7f98000af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:17.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.218+0000 7f98048e0640 1 --2- 172.21.15.53:0/753655637 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98000c9840 0x7f98000c9c10 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:17.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.218+0000 7f98048e0640 1 -- 172.21.15.53:0/753655637 >> 172.21.15.53:0/753655637 conn(0x7f980006a0d0 msgr2=0x7f98000ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:17.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.218+0000 7f98048e0640 1 -- 172.21.15.53:0/753655637 shutdown_connections 2023-06-10T18:57:17.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.218+0000 7f98048e0640 1 -- 172.21.15.53:0/753655637 wait complete. 2023-06-10T18:57:17.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.218+0000 7f98048e0640 1 Processor -- start 2023-06-10T18:57:17.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.218+0000 7f98048e0640 1 -- start start 2023-06-10T18:57:17.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.218+0000 7f98048e0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9800071060 0x7f98000b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:17.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.218+0000 7f98048e0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98000afc60 0x7f98000c3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:17.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.218+0000 7f98048e0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98000c9840 0x7f98000aeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:17.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.218+0000 7f98048e0640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98000c3760 con 0x7f98000c9840 2023-06-10T18:57:17.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.218+0000 7f98048e0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98000c2e50 con 0x7f98000afc60 2023-06-10T18:57:17.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.218+0000 7f98048e0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98000c6e30 con 0x7f9800071060 2023-06-10T18:57:17.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.218+0000 7f97fed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98000c9840 0x7f98000aeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:17.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.218+0000 7f97fed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98000c9840 0x7f98000aeaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53000/0 (socket says 172.21.15.53:53000) 2023-06-10T18:57:17.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.218+0000 7f97fed9d640 1 -- 172.21.15.53:0/1950510781 learned_addr learned my addr 172.21.15.53:0/1950510781 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:57:17.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.218+0000 7f97fe59c640 1 --2- 172.21.15.53:0/1950510781 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9800071060 0x7f98000b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:17.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.218+0000 7f97fdd9b640 1 --2- 172.21.15.53:0/1950510781 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98000afc60 0x7f98000c3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:17.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.218+0000 7f97fed9d640 1 -- 172.21.15.53:0/1950510781 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9800071060 msgr2=0x7f98000b32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:17.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.218+0000 7f97fed9d640 1 --2- 172.21.15.53:0/1950510781 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9800071060 0x7f98000b32e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:17.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.218+0000 7f97fed9d640 1 -- 172.21.15.53:0/1950510781 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98000afc60 msgr2=0x7f98000c3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:17.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.218+0000 7f97fed9d640 1 --2- 172.21.15.53:0/1950510781 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98000afc60 0x7f98000c3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:17.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.218+0000 7f97fed9d640 1 -- 172.21.15.53:0/1950510781 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f0009420 con 0x7f98000c9840 2023-06-10T18:57:17.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.218+0000 7f97fed9d640 1 --2- 172.21.15.53:0/1950510781 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98000c9840 0x7f98000aeaf0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f97f800c7a0 tx=0x7f97f800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:17.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.218+0000 7f97eeffd640 1 -- 172.21.15.53:0/1950510781 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f800a640 con 0x7f98000c9840 2023-06-10T18:57:17.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.218+0000 7f97eeffd640 1 -- 172.21.15.53:0/1950510781 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97f800a7a0 con 0x7f98000c9840 2023-06-10T18:57:17.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.218+0000 7f98048e0640 1 -- 172.21.15.53:0/1950510781 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98000c3110 con 0x7f98000c9840 2023-06-10T18:57:17.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.218+0000 7f97eeffd640 1 -- 172.21.15.53:0/1950510781 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f800abd0 con 0x7f98000c9840 2023-06-10T18:57:17.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.218+0000 7f98048e0640 1 -- 172.21.15.53:0/1950510781 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98000c4130 con 0x7f98000c9840 2023-06-10T18:57:17.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.218+0000 7f98048e0640 1 -- 172.21.15.53:0/1950510781 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98000c3910 con 0x7f98000c9840 2023-06-10T18:57:17.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.222+0000 7f97eeffd640 1 -- 172.21.15.53:0/1950510781 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f97f800ad30 con 0x7f98000c9840 2023-06-10T18:57:17.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.222+0000 7f97eeffd640 1 --2- 172.21.15.53:0/1950510781 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f97e0066280 0x7f97e0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:17.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.222+0000 7f97eeffd640 1 -- 172.21.15.53:0/1950510781 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f97f8083490 con 0x7f98000c9840 2023-06-10T18:57:17.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.222+0000 7f97fe59c640 1 --2- 172.21.15.53:0/1950510781 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f97e0066280 0x7f97e0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:17.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.222+0000 7f97fe59c640 1 --2- 172.21.15.53:0/1950510781 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f97e0066280 0x7f97e0068730 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f97f00ad000 tx=0x7f97f00a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:17.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.226+0000 7f97eeffd640 1 -- 172.21.15.53:0/1950510781 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f98000c3910 con 0x7f98000c9840 2023-06-10T18:57:17.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.434+0000 7f98048e0640 1 -- 172.21.15.53:0/1950510781 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f980004d790 con 0x7f98000c9840 2023-06-10T18:57:17.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.434+0000 7f97eeffd640 1 -- 172.21.15.53:0/1950510781 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1109 (secure 0 0 0) 0x7f97f80509a0 con 0x7f98000c9840 2023-06-10T18:57:17.440 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:57:17.440 INFO:teuthology.orchestra.run.smithi053.stdout:{"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":296,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":65,"num_osds":8,"num_up_osds":8,"osd_up_since":1686423152,"num_in_osds":8,"osd_in_since":1686423143,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":9}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":244695040,"bytes_avail":772849418240,"bytes_total":773094113280,"unknown_pgs_ratio":0.60952383279800415,"inactive_pgs_ratio":0.30476191639900208},"fsmap":{"epoch":26,"id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"a","status":"up:active","gid":6507}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2023-06-10T18:54:59.607497+0000","services":{}},"progress_events":{}} 2023-06-10T18:57:17.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.438+0000 7f98048e0640 1 -- 172.21.15.53:0/1950510781 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f97e0066280 msgr2=0x7f97e0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:17.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.438+0000 7f98048e0640 1 --2- 172.21.15.53:0/1950510781 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f97e0066280 0x7f97e0068730 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f97f00ad000 tx=0x7f97f00a6000 comp rx=0 tx=0).stop 2023-06-10T18:57:17.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.438+0000 7f98048e0640 1 -- 172.21.15.53:0/1950510781 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98000c9840 msgr2=0x7f98000aeaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:17.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.438+0000 7f98048e0640 1 --2- 172.21.15.53:0/1950510781 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98000c9840 0x7f98000aeaf0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f97f800c7a0 tx=0x7f97f800cc60 comp rx=0 tx=0).stop 2023-06-10T18:57:17.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.438+0000 7f98048e0640 1 -- 172.21.15.53:0/1950510781 shutdown_connections 2023-06-10T18:57:17.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.438+0000 7f98048e0640 1 --2- 172.21.15.53:0/1950510781 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f97e0066280 0x7f97e0068730 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:17.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.438+0000 7f98048e0640 1 --2- 172.21.15.53:0/1950510781 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98000c9840 0x7f98000aeaf0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:17.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.438+0000 7f98048e0640 1 --2- 172.21.15.53:0/1950510781 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98000afc60 0x7f98000c3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:17.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.438+0000 7f98048e0640 1 --2- 172.21.15.53:0/1950510781 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9800071060 0x7f98000b32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:17.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.438+0000 7f98048e0640 1 -- 172.21.15.53:0/1950510781 >> 172.21.15.53:0/1950510781 conn(0x7f980006a0d0 msgr2=0x7f98000adc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:17.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.438+0000 7f98048e0640 1 -- 172.21.15.53:0/1950510781 shutdown_connections 2023-06-10T18:57:17.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.438+0000 7f98048e0640 1 -- 172.21.15.53:0/1950510781 wait complete. 2023-06-10T18:57:17.457 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-06-10T18:57:17.458 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-10T18:57:17.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.574+0000 7fe67a6a7640 1 Processor -- start 2023-06-10T18:57:17.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.574+0000 7fe67a6a7640 1 -- start start 2023-06-10T18:57:17.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.574+0000 7fe67a6a7640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe6740c9840 0x7fe6740c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:17.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.574+0000 7fe67a6a7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe674071060 0x7fe6740af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:17.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.574+0000 7fe67a6a7640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe674159b50 con 0x7fe6740afc60 2023-06-10T18:57:17.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.574+0000 7fe67a6a7640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6740ca150 con 0x7fe6740c9840 2023-06-10T18:57:17.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.574+0000 7fe67a6a7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6740702a0 con 0x7fe674071060 2023-06-10T18:57:17.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.574+0000 7fe66b7fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe674071060 0x7fe6740af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:17.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.574+0000 7fe673fff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe6740c9840 0x7fe6740c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:17.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.574+0000 7fe678c44640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fe6740afc60 0x7fe67415d2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.53:57678/0 (socket says 172.21.15.53:57678) 2023-06-10T18:57:17.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.574+0000 7fe678c44640 1 -- 172.21.15.53:0/691320279 learned_addr learned my addr 172.21.15.53:0/691320279 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:57:17.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.574+0000 7fe66b7fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe674071060 0x7fe6740af720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.53:42402/0 (socket says 172.21.15.53:42402) 2023-06-10T18:57:17.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.574+0000 7fe673fff640 1 -- 172.21.15.53:0/691320279 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe674071060 msgr2=0x7fe6740af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:17.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.574+0000 7fe673fff640 1 --2- 172.21.15.53:0/691320279 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe674071060 0x7fe6740af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:17.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.574+0000 7fe673fff640 1 -- 172.21.15.53:0/691320279 >> v1:172.21.15.117:6789/0 conn(0x7fe6740afc60 legacy=0x7fe67415d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:17.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.574+0000 7fe673fff640 1 -- 172.21.15.53:0/691320279 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe674070580 con 0x7fe6740c9840 2023-06-10T18:57:17.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.578+0000 7fe673fff640 1 --2- 172.21.15.53:0/691320279 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6740c9840 0x7fe6740c9c10 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe65c0097c0 tx=0x7fe65c01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e04dac4d95a32f1e server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:17.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.578+0000 7fe6737fe640 1 -- 172.21.15.53:0/691320279 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe65c0ab600 con 0x7fe6740c9840 2023-06-10T18:57:17.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.578+0000 7fe6737fe640 1 -- 172.21.15.53:0/691320279 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe65c0a7050 con 0x7fe6740c9840 2023-06-10T18:57:17.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.578+0000 7fe6737fe640 1 -- 172.21.15.53:0/691320279 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe65c0ab980 con 0x7fe6740c9840 2023-06-10T18:57:17.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.578+0000 7fe67a6a7640 1 -- 172.21.15.53:0/691320279 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6740c9840 msgr2=0x7fe6740c9c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:17.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.578+0000 7fe67a6a7640 1 --2- 172.21.15.53:0/691320279 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6740c9840 0x7fe6740c9c10 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe65c0097c0 tx=0x7fe65c01c450 comp rx=0 tx=0).stop 2023-06-10T18:57:17.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.578+0000 7fe67a6a7640 1 -- 172.21.15.53:0/691320279 shutdown_connections 2023-06-10T18:57:17.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.578+0000 7fe67a6a7640 1 --2- 172.21.15.53:0/691320279 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe674071060 0x7fe6740af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:17.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.578+0000 7fe67a6a7640 1 --2- 172.21.15.53:0/691320279 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6740c9840 0x7fe6740c9c10 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:17.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.578+0000 7fe67a6a7640 1 -- 172.21.15.53:0/691320279 >> 172.21.15.53:0/691320279 conn(0x7fe67406a0d0 msgr2=0x7fe6740ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:17.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.578+0000 7fe67a6a7640 1 -- 172.21.15.53:0/691320279 shutdown_connections 2023-06-10T18:57:17.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.578+0000 7fe67a6a7640 1 -- 172.21.15.53:0/691320279 wait complete. 2023-06-10T18:57:17.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.582+0000 7fe67a6a7640 1 Processor -- start 2023-06-10T18:57:17.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.582+0000 7fe67a6a7640 1 -- start start 2023-06-10T18:57:17.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.582+0000 7fe67a6a7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe674071060 0x7fe67414e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:17.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.582+0000 7fe67a6a7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6740afc60 0x7fe67415bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:17.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.582+0000 7fe67a6a7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6740c9840 0x7fe6740b26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:17.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.582+0000 7fe67a6a7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe67414e420 con 0x7fe6740c9840 2023-06-10T18:57:17.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.582+0000 7fe67a6a7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6740b1ad0 con 0x7fe6740afc60 2023-06-10T18:57:17.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.582+0000 7fe67a6a7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe67414d530 con 0x7fe674071060 2023-06-10T18:57:17.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.582+0000 7fe678c44640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6740c9840 0x7fe6740b26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:17.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.582+0000 7fe678c44640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6740c9840 0x7fe6740b26a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53012/0 (socket says 172.21.15.53:53012) 2023-06-10T18:57:17.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.582+0000 7fe678c44640 1 -- 172.21.15.53:0/758721799 learned_addr learned my addr 172.21.15.53:0/758721799 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:57:17.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.582+0000 7fe66b7fe640 1 --2- 172.21.15.53:0/758721799 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6740afc60 0x7fe67415bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:17.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.582+0000 7fe673fff640 1 --2- 172.21.15.53:0/758721799 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe674071060 0x7fe67414e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:17.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.582+0000 7fe678c44640 1 -- 172.21.15.53:0/758721799 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe674071060 msgr2=0x7fe67414e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:17.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.582+0000 7fe678c44640 1 --2- 172.21.15.53:0/758721799 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe674071060 0x7fe67414e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:17.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.582+0000 7fe678c44640 1 -- 172.21.15.53:0/758721799 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6740afc60 msgr2=0x7fe67415bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:17.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.582+0000 7fe678c44640 1 --2- 172.21.15.53:0/758721799 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6740afc60 0x7fe67415bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:17.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.582+0000 7fe678c44640 1 -- 172.21.15.53:0/758721799 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe65c009420 con 0x7fe6740c9840 2023-06-10T18:57:17.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.582+0000 7fe678c44640 1 --2- 172.21.15.53:0/758721799 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6740c9840 0x7fe6740b26a0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fe66c00cbf0 tx=0x7fe66c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:17.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.582+0000 7fe6717fa640 1 -- 172.21.15.53:0/758721799 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66c00ad40 con 0x7fe6740c9840 2023-06-10T18:57:17.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.582+0000 7fe6717fa640 1 -- 172.21.15.53:0/758721799 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe66c012400 con 0x7fe6740c9840 2023-06-10T18:57:17.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.582+0000 7fe67a6a7640 1 -- 172.21.15.53:0/758721799 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe67414d810 con 0x7fe6740c9840 2023-06-10T18:57:17.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.582+0000 7fe6717fa640 1 -- 172.21.15.53:0/758721799 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66c00aea0 con 0x7fe6740c9840 2023-06-10T18:57:17.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.582+0000 7fe67a6a7640 1 -- 172.21.15.53:0/758721799 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe67414ddd0 con 0x7fe6740c9840 2023-06-10T18:57:17.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.582+0000 7fe67a6a7640 1 -- 172.21.15.53:0/758721799 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe67414e5d0 con 0x7fe6740c9840 2023-06-10T18:57:17.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.582+0000 7fe6717fa640 1 -- 172.21.15.53:0/758721799 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe66c007070 con 0x7fe6740c9840 2023-06-10T18:57:17.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.586+0000 7fe6717fa640 1 --2- 172.21.15.53:0/758721799 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe654066280 0x7fe654068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:17.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.586+0000 7fe6717fa640 1 -- 172.21.15.53:0/758721799 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe66c083b60 con 0x7fe6740c9840 2023-06-10T18:57:17.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.586+0000 7fe673fff640 1 --2- 172.21.15.53:0/758721799 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe654066280 0x7fe654068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:17.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.586+0000 7fe673fff640 1 --2- 172.21.15.53:0/758721799 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe654066280 0x7fe654068730 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fe65c0ad000 tx=0x7fe65c0a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:17.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.590+0000 7fe6717fa640 1 -- 172.21.15.53:0/758721799 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe67414e5d0 con 0x7fe6740c9840 2023-06-10T18:57:17.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.734+0000 7fe67a6a7640 1 -- 172.21.15.53:0/758721799 --> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe6740b01c0 con 0x7fe654066280 2023-06-10T18:57:17.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.758+0000 7fe6717fa640 1 -- 172.21.15.53:0/758721799 <== mgr.4105 v2:172.21.15.117:6832/3061986771 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+309206 (secure 0 0 0) 0x7fe65c0be420 con 0x7fe654066280 2023-06-10T18:57:17.765 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:57:17.766 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-06-10T18:57:17.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.762+0000 7fe67a6a7640 1 -- 172.21.15.53:0/758721799 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe654066280 msgr2=0x7fe654068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:17.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.762+0000 7fe67a6a7640 1 --2- 172.21.15.53:0/758721799 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe654066280 0x7fe654068730 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fe65c0ad000 tx=0x7fe65c0a6000 comp rx=0 tx=0).stop 2023-06-10T18:57:17.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.762+0000 7fe67a6a7640 1 -- 172.21.15.53:0/758721799 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6740c9840 msgr2=0x7fe6740b26a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:17.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.762+0000 7fe67a6a7640 1 --2- 172.21.15.53:0/758721799 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6740c9840 0x7fe6740b26a0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fe66c00cbf0 tx=0x7fe66c00a430 comp rx=0 tx=0).stop 2023-06-10T18:57:17.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.762+0000 7fe67a6a7640 1 -- 172.21.15.53:0/758721799 shutdown_connections 2023-06-10T18:57:17.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.762+0000 7fe67a6a7640 1 --2- 172.21.15.53:0/758721799 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe654066280 0x7fe654068730 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:17.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.762+0000 7fe67a6a7640 1 --2- 172.21.15.53:0/758721799 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6740c9840 0x7fe6740b26a0 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:17.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.762+0000 7fe67a6a7640 1 --2- 172.21.15.53:0/758721799 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6740afc60 0x7fe67415bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:17.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.762+0000 7fe67a6a7640 1 --2- 172.21.15.53:0/758721799 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe674071060 0x7fe67414e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:17.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.762+0000 7fe67a6a7640 1 -- 172.21.15.53:0/758721799 >> 172.21.15.53:0/758721799 conn(0x7fe67406a0d0 msgr2=0x7fe6741524a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:17.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.762+0000 7fe67a6a7640 1 -- 172.21.15.53:0/758721799 shutdown_connections 2023-06-10T18:57:17.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:17.762+0000 7fe67a6a7640 1 -- 172.21.15.53:0/758721799 wait complete. 2023-06-10T18:57:17.782 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":201,"stamp":"2023-06-10T18:57:17.659621+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":207,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":243420,"kb_used_data":7324,"kb_used_omap":0,"kb_used_meta":236032,"kb_avail":754731300,"statfs":{"total":773094113280,"available":772844851200,"internally_reserved":0,"allocated":7499776,"data_stored":3955947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":241696768},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":60,"apply_latency_ms":60,"commit_latency_ns":60000000,"apply_latency_ns":60000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.811659"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.933452+0000","last_change":"2023-06-10T18:57:13.278051+0000","last_active":"2023-06-10T18:57:14.933452+0000","last_peered":"2023-06-10T18:57:14.933452+0000","last_clean":"2023-06-10T18:57:14.933452+0000","last_became_active":"2023-06-10T18:57:13.277771+0000","last_became_peered":"2023-06-10T18:57:13.277771+0000","last_unstale":"2023-06-10T18:57:14.933452+0000","last_undegraded":"2023-06-10T18:57:14.933452+0000","last_fullsized":"2023-06-10T18:57:14.933452+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:11:32.262466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.932566+0000","last_change":"2023-06-10T18:57:13.261112+0000","last_active":"2023-06-10T18:57:14.932566+0000","last_peered":"2023-06-10T18:57:14.932566+0000","last_clean":"2023-06-10T18:57:14.932566+0000","last_became_active":"2023-06-10T18:57:13.260798+0000","last_became_peered":"2023-06-10T18:57:13.260798+0000","last_unstale":"2023-06-10T18:57:14.932566+0000","last_undegraded":"2023-06-10T18:57:14.932566+0000","last_fullsized":"2023-06-10T18:57:14.932566+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:04:24.808506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.930890+0000","last_change":"2023-06-10T18:57:13.302793+0000","last_active":"2023-06-10T18:57:14.930890+0000","last_peered":"2023-06-10T18:57:14.930890+0000","last_clean":"2023-06-10T18:57:14.930890+0000","last_became_active":"2023-06-10T18:57:13.302292+0000","last_became_peered":"2023-06-10T18:57:13.302292+0000","last_unstale":"2023-06-10T18:57:14.930890+0000","last_undegraded":"2023-06-10T18:57:14.930890+0000","last_fullsized":"2023-06-10T18:57:14.930890+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:31:12.523092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.258225+0000","last_change":"2023-06-10T18:57:13.264864+0000","last_active":"2023-06-10T18:57:14.258225+0000","last_peered":"2023-06-10T18:57:14.258225+0000","last_clean":"2023-06-10T18:57:14.258225+0000","last_became_active":"2023-06-10T18:57:13.264053+0000","last_became_peered":"2023-06-10T18:57:13.264053+0000","last_unstale":"2023-06-10T18:57:14.258225+0000","last_undegraded":"2023-06-10T18:57:14.258225+0000","last_fullsized":"2023-06-10T18:57:14.258225+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:32:32.565830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.525789+0000","last_change":"2023-06-10T18:57:13.290607+0000","last_active":"2023-06-10T18:57:14.525789+0000","last_peered":"2023-06-10T18:57:14.525789+0000","last_clean":"2023-06-10T18:57:14.525789+0000","last_became_active":"2023-06-10T18:57:13.290080+0000","last_became_peered":"2023-06-10T18:57:13.290080+0000","last_unstale":"2023-06-10T18:57:14.525789+0000","last_undegraded":"2023-06-10T18:57:14.525789+0000","last_fullsized":"2023-06-10T18:57:14.525789+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:56:01.364135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.254455+0000","last_change":"2023-06-10T18:57:13.303419+0000","last_active":"2023-06-10T18:57:14.254455+0000","last_peered":"2023-06-10T18:57:14.254455+0000","last_clean":"2023-06-10T18:57:14.254455+0000","last_became_active":"2023-06-10T18:57:13.303159+0000","last_became_peered":"2023-06-10T18:57:13.303159+0000","last_unstale":"2023-06-10T18:57:14.254455+0000","last_undegraded":"2023-06-10T18:57:14.254455+0000","last_fullsized":"2023-06-10T18:57:14.254455+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:17:07.552044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.428307+0000","last_change":"2023-06-10T18:57:13.302161+0000","last_active":"2023-06-10T18:57:14.428307+0000","last_peered":"2023-06-10T18:57:14.428307+0000","last_clean":"2023-06-10T18:57:14.428307+0000","last_became_active":"2023-06-10T18:57:13.301885+0000","last_became_peered":"2023-06-10T18:57:13.301885+0000","last_unstale":"2023-06-10T18:57:14.428307+0000","last_undegraded":"2023-06-10T18:57:14.428307+0000","last_fullsized":"2023-06-10T18:57:14.428307+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:37:43.312076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.256541+0000","last_change":"2023-06-10T18:57:13.306439+0000","last_active":"2023-06-10T18:57:14.256541+0000","last_peered":"2023-06-10T18:57:14.256541+0000","last_clean":"2023-06-10T18:57:14.256541+0000","last_became_active":"2023-06-10T18:57:13.305973+0000","last_became_peered":"2023-06-10T18:57:13.305973+0000","last_unstale":"2023-06-10T18:57:14.256541+0000","last_undegraded":"2023-06-10T18:57:14.256541+0000","last_fullsized":"2023-06-10T18:57:14.256541+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:20:12.151730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.931903+0000","last_change":"2023-06-10T18:57:13.302706+0000","last_active":"2023-06-10T18:57:14.931903+0000","last_peered":"2023-06-10T18:57:14.931903+0000","last_clean":"2023-06-10T18:57:14.931903+0000","last_became_active":"2023-06-10T18:57:13.302238+0000","last_became_peered":"2023-06-10T18:57:13.302238+0000","last_unstale":"2023-06-10T18:57:14.931903+0000","last_undegraded":"2023-06-10T18:57:14.931903+0000","last_fullsized":"2023-06-10T18:57:14.931903+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:23:38.131145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.931280+0000","last_change":"2023-06-10T18:57:13.302805+0000","last_active":"2023-06-10T18:57:14.931280+0000","last_peered":"2023-06-10T18:57:14.931280+0000","last_clean":"2023-06-10T18:57:14.931280+0000","last_became_active":"2023-06-10T18:57:13.302333+0000","last_became_peered":"2023-06-10T18:57:13.302333+0000","last_unstale":"2023-06-10T18:57:14.931280+0000","last_undegraded":"2023-06-10T18:57:14.931280+0000","last_fullsized":"2023-06-10T18:57:14.931280+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:27:56.500157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.256956+0000","last_change":"2023-06-10T18:57:13.271316+0000","last_active":"2023-06-10T18:57:14.256956+0000","last_peered":"2023-06-10T18:57:14.256956+0000","last_clean":"2023-06-10T18:57:14.256956+0000","last_became_active":"2023-06-10T18:57:13.270760+0000","last_became_peered":"2023-06-10T18:57:13.270760+0000","last_unstale":"2023-06-10T18:57:14.256956+0000","last_undegraded":"2023-06-10T18:57:14.256956+0000","last_fullsized":"2023-06-10T18:57:14.256956+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:27:56.045659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.259150+0000","last_change":"2023-06-10T18:57:13.306777+0000","last_active":"2023-06-10T18:57:14.259150+0000","last_peered":"2023-06-10T18:57:14.259150+0000","last_clean":"2023-06-10T18:57:14.259150+0000","last_became_active":"2023-06-10T18:57:13.306199+0000","last_became_peered":"2023-06-10T18:57:13.306199+0000","last_unstale":"2023-06-10T18:57:14.259150+0000","last_undegraded":"2023-06-10T18:57:14.259150+0000","last_fullsized":"2023-06-10T18:57:14.259150+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:23:35.468930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.259112+0000","last_change":"2023-06-10T18:57:13.283978+0000","last_active":"2023-06-10T18:57:14.259112+0000","last_peered":"2023-06-10T18:57:14.259112+0000","last_clean":"2023-06-10T18:57:14.259112+0000","last_became_active":"2023-06-10T18:57:13.279402+0000","last_became_peered":"2023-06-10T18:57:13.279402+0000","last_unstale":"2023-06-10T18:57:14.259112+0000","last_undegraded":"2023-06-10T18:57:14.259112+0000","last_fullsized":"2023-06-10T18:57:14.259112+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:07:36.811657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.931252+0000","last_change":"2023-06-10T18:57:13.304779+0000","last_active":"2023-06-10T18:57:14.931252+0000","last_peered":"2023-06-10T18:57:14.931252+0000","last_clean":"2023-06-10T18:57:14.931252+0000","last_became_active":"2023-06-10T18:57:13.304282+0000","last_became_peered":"2023-06-10T18:57:13.304282+0000","last_unstale":"2023-06-10T18:57:14.931252+0000","last_undegraded":"2023-06-10T18:57:14.931252+0000","last_fullsized":"2023-06-10T18:57:14.931252+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:13:18.646310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.931199+0000","last_change":"2023-06-10T18:57:13.308071+0000","last_active":"2023-06-10T18:57:14.931199+0000","last_peered":"2023-06-10T18:57:14.931199+0000","last_clean":"2023-06-10T18:57:14.931199+0000","last_became_active":"2023-06-10T18:57:13.307631+0000","last_became_peered":"2023-06-10T18:57:13.307631+0000","last_unstale":"2023-06-10T18:57:14.931199+0000","last_undegraded":"2023-06-10T18:57:14.931199+0000","last_fullsized":"2023-06-10T18:57:14.931199+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:23:41.231797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.428530+0000","last_change":"2023-06-10T18:57:13.270900+0000","last_active":"2023-06-10T18:57:14.428530+0000","last_peered":"2023-06-10T18:57:14.428530+0000","last_clean":"2023-06-10T18:57:14.428530+0000","last_became_active":"2023-06-10T18:57:13.270589+0000","last_became_peered":"2023-06-10T18:57:13.270589+0000","last_unstale":"2023-06-10T18:57:14.428530+0000","last_undegraded":"2023-06-10T18:57:14.428530+0000","last_fullsized":"2023-06-10T18:57:14.428530+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:15:18.216952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.933634+0000","last_change":"2023-06-10T18:57:13.284023+0000","last_active":"2023-06-10T18:57:14.933634+0000","last_peered":"2023-06-10T18:57:14.933634+0000","last_clean":"2023-06-10T18:57:14.933634+0000","last_became_active":"2023-06-10T18:57:13.283702+0000","last_became_peered":"2023-06-10T18:57:13.283702+0000","last_unstale":"2023-06-10T18:57:14.933634+0000","last_undegraded":"2023-06-10T18:57:14.933634+0000","last_fullsized":"2023-06-10T18:57:14.933634+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:49:10.083059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.257442+0000","last_change":"2023-06-10T18:57:13.266645+0000","last_active":"2023-06-10T18:57:14.257442+0000","last_peered":"2023-06-10T18:57:14.257442+0000","last_clean":"2023-06-10T18:57:14.257442+0000","last_became_active":"2023-06-10T18:57:13.265777+0000","last_became_peered":"2023-06-10T18:57:13.265777+0000","last_unstale":"2023-06-10T18:57:14.257442+0000","last_undegraded":"2023-06-10T18:57:14.257442+0000","last_fullsized":"2023-06-10T18:57:14.257442+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:15:04.375077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.526115+0000","last_change":"2023-06-10T18:57:13.293678+0000","last_active":"2023-06-10T18:57:14.526115+0000","last_peered":"2023-06-10T18:57:14.526115+0000","last_clean":"2023-06-10T18:57:14.526115+0000","last_became_active":"2023-06-10T18:57:13.292900+0000","last_became_peered":"2023-06-10T18:57:13.292900+0000","last_unstale":"2023-06-10T18:57:14.526115+0000","last_undegraded":"2023-06-10T18:57:14.526115+0000","last_fullsized":"2023-06-10T18:57:14.526115+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:33:25.949638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.932708+0000","last_change":"2023-06-10T18:57:13.293251+0000","last_active":"2023-06-10T18:57:14.932708+0000","last_peered":"2023-06-10T18:57:14.932708+0000","last_clean":"2023-06-10T18:57:14.932708+0000","last_became_active":"2023-06-10T18:57:13.292981+0000","last_became_peered":"2023-06-10T18:57:13.292981+0000","last_unstale":"2023-06-10T18:57:14.932708+0000","last_undegraded":"2023-06-10T18:57:14.932708+0000","last_fullsized":"2023-06-10T18:57:14.932708+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:46:12.638932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.259304+0000","last_change":"2023-06-10T18:57:13.260785+0000","last_active":"2023-06-10T18:57:14.259304+0000","last_peered":"2023-06-10T18:57:14.259304+0000","last_clean":"2023-06-10T18:57:14.259304+0000","last_became_active":"2023-06-10T18:57:13.260401+0000","last_became_peered":"2023-06-10T18:57:13.260401+0000","last_unstale":"2023-06-10T18:57:14.259304+0000","last_undegraded":"2023-06-10T18:57:14.259304+0000","last_fullsized":"2023-06-10T18:57:14.259304+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:36:49.054784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.931139+0000","last_change":"2023-06-10T18:57:13.305964+0000","last_active":"2023-06-10T18:57:14.931139+0000","last_peered":"2023-06-10T18:57:14.931139+0000","last_clean":"2023-06-10T18:57:14.931139+0000","last_became_active":"2023-06-10T18:57:13.305612+0000","last_became_peered":"2023-06-10T18:57:13.305612+0000","last_unstale":"2023-06-10T18:57:14.931139+0000","last_undegraded":"2023-06-10T18:57:14.931139+0000","last_fullsized":"2023-06-10T18:57:14.931139+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:14:28.319502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.931006+0000","last_change":"2023-06-10T18:57:13.308981+0000","last_active":"2023-06-10T18:57:14.931006+0000","last_peered":"2023-06-10T18:57:14.931006+0000","last_clean":"2023-06-10T18:57:14.931006+0000","last_became_active":"2023-06-10T18:57:13.308775+0000","last_became_peered":"2023-06-10T18:57:13.308775+0000","last_unstale":"2023-06-10T18:57:14.931006+0000","last_undegraded":"2023-06-10T18:57:14.931006+0000","last_fullsized":"2023-06-10T18:57:14.931006+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:10:36.804829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.930561+0000","last_change":"2023-06-10T18:57:13.304069+0000","last_active":"2023-06-10T18:57:14.930561+0000","last_peered":"2023-06-10T18:57:14.930561+0000","last_clean":"2023-06-10T18:57:14.930561+0000","last_became_active":"2023-06-10T18:57:13.303550+0000","last_became_peered":"2023-06-10T18:57:13.303550+0000","last_unstale":"2023-06-10T18:57:14.930561+0000","last_undegraded":"2023-06-10T18:57:14.930561+0000","last_fullsized":"2023-06-10T18:57:14.930561+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:09:13.320949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.259429+0000","last_change":"2023-06-10T18:57:13.276616+0000","last_active":"2023-06-10T18:57:14.259429+0000","last_peered":"2023-06-10T18:57:14.259429+0000","last_clean":"2023-06-10T18:57:14.259429+0000","last_became_active":"2023-06-10T18:57:13.275794+0000","last_became_peered":"2023-06-10T18:57:13.275794+0000","last_unstale":"2023-06-10T18:57:14.259429+0000","last_undegraded":"2023-06-10T18:57:14.259429+0000","last_fullsized":"2023-06-10T18:57:14.259429+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:54:04.527705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.259336+0000","last_change":"2023-06-10T18:57:13.276773+0000","last_active":"2023-06-10T18:57:14.259336+0000","last_peered":"2023-06-10T18:57:14.259336+0000","last_clean":"2023-06-10T18:57:14.259336+0000","last_became_active":"2023-06-10T18:57:13.271488+0000","last_became_peered":"2023-06-10T18:57:13.271488+0000","last_unstale":"2023-06-10T18:57:14.259336+0000","last_undegraded":"2023-06-10T18:57:14.259336+0000","last_fullsized":"2023-06-10T18:57:14.259336+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:21:00.769885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.257698+0000","last_change":"2023-06-10T18:57:13.264289+0000","last_active":"2023-06-10T18:57:14.257698+0000","last_peered":"2023-06-10T18:57:14.257698+0000","last_clean":"2023-06-10T18:57:14.257698+0000","last_became_active":"2023-06-10T18:57:13.263483+0000","last_became_peered":"2023-06-10T18:57:13.263483+0000","last_unstale":"2023-06-10T18:57:14.257698+0000","last_undegraded":"2023-06-10T18:57:14.257698+0000","last_fullsized":"2023-06-10T18:57:14.257698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:11:40.265194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.932095+0000","last_change":"2023-06-10T18:57:13.293553+0000","last_active":"2023-06-10T18:57:14.932095+0000","last_peered":"2023-06-10T18:57:14.932095+0000","last_clean":"2023-06-10T18:57:14.932095+0000","last_became_active":"2023-06-10T18:57:13.293120+0000","last_became_peered":"2023-06-10T18:57:13.293120+0000","last_unstale":"2023-06-10T18:57:14.932095+0000","last_undegraded":"2023-06-10T18:57:14.932095+0000","last_fullsized":"2023-06-10T18:57:14.932095+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:12:20.350661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.931125+0000","last_change":"2023-06-10T18:57:13.303656+0000","last_active":"2023-06-10T18:57:14.931125+0000","last_peered":"2023-06-10T18:57:14.931125+0000","last_clean":"2023-06-10T18:57:14.931125+0000","last_became_active":"2023-06-10T18:57:13.303200+0000","last_became_peered":"2023-06-10T18:57:13.303200+0000","last_unstale":"2023-06-10T18:57:14.931125+0000","last_undegraded":"2023-06-10T18:57:14.931125+0000","last_fullsized":"2023-06-10T18:57:14.931125+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:25:29.323185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.256400+0000","last_change":"2023-06-10T18:57:13.301288+0000","last_active":"2023-06-10T18:57:14.256400+0000","last_peered":"2023-06-10T18:57:14.256400+0000","last_clean":"2023-06-10T18:57:14.256400+0000","last_became_active":"2023-06-10T18:57:13.300810+0000","last_became_peered":"2023-06-10T18:57:13.300810+0000","last_unstale":"2023-06-10T18:57:14.256400+0000","last_undegraded":"2023-06-10T18:57:14.256400+0000","last_fullsized":"2023-06-10T18:57:14.256400+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:58:08.876809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.256349+0000","last_change":"2023-06-10T18:57:13.264140+0000","last_active":"2023-06-10T18:57:14.256349+0000","last_peered":"2023-06-10T18:57:14.256349+0000","last_clean":"2023-06-10T18:57:14.256349+0000","last_became_active":"2023-06-10T18:57:13.263391+0000","last_became_peered":"2023-06-10T18:57:13.263391+0000","last_unstale":"2023-06-10T18:57:14.256349+0000","last_undegraded":"2023-06-10T18:57:14.256349+0000","last_fullsized":"2023-06-10T18:57:14.256349+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:14:37.779531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.254016+0000","last_change":"2023-06-10T18:57:13.264481+0000","last_active":"2023-06-10T18:57:14.254016+0000","last_peered":"2023-06-10T18:57:14.254016+0000","last_clean":"2023-06-10T18:57:14.254016+0000","last_became_active":"2023-06-10T18:57:13.263901+0000","last_became_peered":"2023-06-10T18:57:13.263901+0000","last_unstale":"2023-06-10T18:57:14.254016+0000","last_undegraded":"2023-06-10T18:57:14.254016+0000","last_fullsized":"2023-06-10T18:57:14.254016+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:00:05.985666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.526019+0000","last_change":"2023-06-10T18:57:13.291422+0000","last_active":"2023-06-10T18:57:14.526019+0000","last_peered":"2023-06-10T18:57:14.526019+0000","last_clean":"2023-06-10T18:57:14.526019+0000","last_became_active":"2023-06-10T18:57:13.290699+0000","last_became_peered":"2023-06-10T18:57:13.290699+0000","last_unstale":"2023-06-10T18:57:14.526019+0000","last_undegraded":"2023-06-10T18:57:14.526019+0000","last_fullsized":"2023-06-10T18:57:14.526019+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:35:37.322933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"64'4","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.933693+0000","last_change":"2023-06-10T18:57:12.893921+0000","last_active":"2023-06-10T18:57:14.933693+0000","last_peered":"2023-06-10T18:57:14.933693+0000","last_clean":"2023-06-10T18:57:14.933693+0000","last_became_active":"2023-06-10T18:57:12.893212+0000","last_became_peered":"2023-06-10T18:57:12.893212+0000","last_unstale":"2023-06-10T18:57:14.933693+0000","last_undegraded":"2023-06-10T18:57:14.933693+0000","last_fullsized":"2023-06-10T18:57:14.933693+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:10:11.278359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.257374+0000","last_change":"2023-06-10T18:57:13.295085+0000","last_active":"2023-06-10T18:57:14.257374+0000","last_peered":"2023-06-10T18:57:14.257374+0000","last_clean":"2023-06-10T18:57:14.257374+0000","last_became_active":"2023-06-10T18:57:13.294187+0000","last_became_peered":"2023-06-10T18:57:13.294187+0000","last_unstale":"2023-06-10T18:57:14.257374+0000","last_undegraded":"2023-06-10T18:57:14.257374+0000","last_fullsized":"2023-06-10T18:57:14.257374+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:23:02.874276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"64'1","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.254783+0000","last_change":"2023-06-10T18:57:12.877228+0000","last_active":"2023-06-10T18:57:14.254783+0000","last_peered":"2023-06-10T18:57:14.254783+0000","last_clean":"2023-06-10T18:57:14.254783+0000","last_became_active":"2023-06-10T18:57:12.876876+0000","last_became_peered":"2023-06-10T18:57:12.876876+0000","last_unstale":"2023-06-10T18:57:14.254783+0000","last_undegraded":"2023-06-10T18:57:14.254783+0000","last_fullsized":"2023-06-10T18:57:14.254783+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:29:55.585262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.254719+0000","last_change":"2023-06-10T18:57:13.259304+0000","last_active":"2023-06-10T18:57:14.254719+0000","last_peered":"2023-06-10T18:57:14.254719+0000","last_clean":"2023-06-10T18:57:14.254719+0000","last_became_active":"2023-06-10T18:57:13.255417+0000","last_became_peered":"2023-06-10T18:57:13.255417+0000","last_unstale":"2023-06-10T18:57:14.254719+0000","last_undegraded":"2023-06-10T18:57:14.254719+0000","last_fullsized":"2023-06-10T18:57:14.254719+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:12:20.350661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"64'2","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.254626+0000","last_change":"2023-06-10T18:57:12.902028+0000","last_active":"2023-06-10T18:57:14.254626+0000","last_peered":"2023-06-10T18:57:14.254626+0000","last_clean":"2023-06-10T18:57:14.254626+0000","last_became_active":"2023-06-10T18:57:12.901767+0000","last_became_peered":"2023-06-10T18:57:12.901767+0000","last_unstale":"2023-06-10T18:57:14.254626+0000","last_undegraded":"2023-06-10T18:57:14.254626+0000","last_fullsized":"2023-06-10T18:57:14.254626+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:46:01.209420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.931656+0000","last_change":"2023-06-10T18:57:13.304760+0000","last_active":"2023-06-10T18:57:14.931656+0000","last_peered":"2023-06-10T18:57:14.931656+0000","last_clean":"2023-06-10T18:57:14.931656+0000","last_became_active":"2023-06-10T18:57:13.304261+0000","last_became_peered":"2023-06-10T18:57:13.304261+0000","last_unstale":"2023-06-10T18:57:14.931656+0000","last_undegraded":"2023-06-10T18:57:14.931656+0000","last_fullsized":"2023-06-10T18:57:14.931656+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:06:06.959841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"64'2","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.254507+0000","last_change":"2023-06-10T18:57:12.885066+0000","last_active":"2023-06-10T18:57:14.254507+0000","last_peered":"2023-06-10T18:57:14.254507+0000","last_clean":"2023-06-10T18:57:14.254507+0000","last_became_active":"2023-06-10T18:57:12.884678+0000","last_became_peered":"2023-06-10T18:57:12.884678+0000","last_unstale":"2023-06-10T18:57:14.254507+0000","last_undegraded":"2023-06-10T18:57:14.254507+0000","last_fullsized":"2023-06-10T18:57:14.254507+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:36:08.850060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.428348+0000","last_change":"2023-06-10T18:57:13.262250+0000","last_active":"2023-06-10T18:57:14.428348+0000","last_peered":"2023-06-10T18:57:14.428348+0000","last_clean":"2023-06-10T18:57:14.428348+0000","last_became_active":"2023-06-10T18:57:13.261948+0000","last_became_peered":"2023-06-10T18:57:13.261948+0000","last_unstale":"2023-06-10T18:57:14.428348+0000","last_undegraded":"2023-06-10T18:57:14.428348+0000","last_fullsized":"2023-06-10T18:57:14.428348+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:06:48.956658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"64'1","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.932855+0000","last_change":"2023-06-10T18:57:12.878370+0000","last_active":"2023-06-10T18:57:14.932855+0000","last_peered":"2023-06-10T18:57:14.932855+0000","last_clean":"2023-06-10T18:57:14.932855+0000","last_became_active":"2023-06-10T18:57:12.878087+0000","last_became_peered":"2023-06-10T18:57:12.878087+0000","last_unstale":"2023-06-10T18:57:14.932855+0000","last_undegraded":"2023-06-10T18:57:14.932855+0000","last_fullsized":"2023-06-10T18:57:14.932855+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:17:06.548343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.931421+0000","last_change":"2023-06-10T18:57:13.283934+0000","last_active":"2023-06-10T18:57:14.931421+0000","last_peered":"2023-06-10T18:57:14.931421+0000","last_clean":"2023-06-10T18:57:14.931421+0000","last_became_active":"2023-06-10T18:57:13.283624+0000","last_became_peered":"2023-06-10T18:57:13.283624+0000","last_unstale":"2023-06-10T18:57:14.931421+0000","last_undegraded":"2023-06-10T18:57:14.931421+0000","last_fullsized":"2023-06-10T18:57:14.931421+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:36:09.853761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"64'1","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.931439+0000","last_change":"2023-06-10T18:57:12.877474+0000","last_active":"2023-06-10T18:57:14.931439+0000","last_peered":"2023-06-10T18:57:14.931439+0000","last_clean":"2023-06-10T18:57:14.931439+0000","last_became_active":"2023-06-10T18:57:12.877038+0000","last_became_peered":"2023-06-10T18:57:12.877038+0000","last_unstale":"2023-06-10T18:57:14.931439+0000","last_undegraded":"2023-06-10T18:57:14.931439+0000","last_fullsized":"2023-06-10T18:57:14.931439+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:37:56.895566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.525684+0000","last_change":"2023-06-10T18:57:13.295004+0000","last_active":"2023-06-10T18:57:14.525684+0000","last_peered":"2023-06-10T18:57:14.525684+0000","last_clean":"2023-06-10T18:57:14.525684+0000","last_became_active":"2023-06-10T18:57:13.292895+0000","last_became_peered":"2023-06-10T18:57:13.292895+0000","last_unstale":"2023-06-10T18:57:14.525684+0000","last_undegraded":"2023-06-10T18:57:14.525684+0000","last_fullsized":"2023-06-10T18:57:14.525684+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:07:33.212842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.931257+0000","last_change":"2023-06-10T18:57:12.906166+0000","last_active":"2023-06-10T18:57:14.931257+0000","last_peered":"2023-06-10T18:57:14.931257+0000","last_clean":"2023-06-10T18:57:14.931257+0000","last_became_active":"2023-06-10T18:57:12.905372+0000","last_became_peered":"2023-06-10T18:57:12.905372+0000","last_unstale":"2023-06-10T18:57:14.931257+0000","last_undegraded":"2023-06-10T18:57:14.931257+0000","last_fullsized":"2023-06-10T18:57:14.931257+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:12:54.670196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.933545+0000","last_change":"2023-06-10T18:57:13.268932+0000","last_active":"2023-06-10T18:57:14.933545+0000","last_peered":"2023-06-10T18:57:14.933545+0000","last_clean":"2023-06-10T18:57:14.933545+0000","last_became_active":"2023-06-10T18:57:13.268693+0000","last_became_peered":"2023-06-10T18:57:13.268693+0000","last_unstale":"2023-06-10T18:57:14.933545+0000","last_undegraded":"2023-06-10T18:57:14.933545+0000","last_fullsized":"2023-06-10T18:57:14.933545+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:12:20.350661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.525458+0000","last_change":"2023-06-10T18:57:12.896449+0000","last_active":"2023-06-10T18:57:14.525458+0000","last_peered":"2023-06-10T18:57:14.525458+0000","last_clean":"2023-06-10T18:57:14.525458+0000","last_became_active":"2023-06-10T18:57:12.895644+0000","last_became_peered":"2023-06-10T18:57:12.895644+0000","last_unstale":"2023-06-10T18:57:14.525458+0000","last_undegraded":"2023-06-10T18:57:14.525458+0000","last_fullsized":"2023-06-10T18:57:14.525458+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:35:10.385306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.932252+0000","last_change":"2023-06-10T18:57:13.265935+0000","last_active":"2023-06-10T18:57:14.932252+0000","last_peered":"2023-06-10T18:57:14.932252+0000","last_clean":"2023-06-10T18:57:14.932252+0000","last_became_active":"2023-06-10T18:57:13.265687+0000","last_became_peered":"2023-06-10T18:57:13.265687+0000","last_unstale":"2023-06-10T18:57:14.932252+0000","last_undegraded":"2023-06-10T18:57:14.932252+0000","last_fullsized":"2023-06-10T18:57:14.932252+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:13:45.391733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.931887+0000","last_change":"2023-06-10T18:57:12.892531+0000","last_active":"2023-06-10T18:57:14.931887+0000","last_peered":"2023-06-10T18:57:14.931887+0000","last_clean":"2023-06-10T18:57:14.931887+0000","last_became_active":"2023-06-10T18:57:12.891758+0000","last_became_peered":"2023-06-10T18:57:12.891758+0000","last_unstale":"2023-06-10T18:57:14.931887+0000","last_undegraded":"2023-06-10T18:57:14.931887+0000","last_fullsized":"2023-06-10T18:57:14.931887+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:50:03.962948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.932995+0000","last_change":"2023-06-10T18:57:13.272204+0000","last_active":"2023-06-10T18:57:14.932995+0000","last_peered":"2023-06-10T18:57:14.932995+0000","last_clean":"2023-06-10T18:57:14.932995+0000","last_became_active":"2023-06-10T18:57:13.271878+0000","last_became_peered":"2023-06-10T18:57:13.271878+0000","last_unstale":"2023-06-10T18:57:14.932995+0000","last_undegraded":"2023-06-10T18:57:14.932995+0000","last_fullsized":"2023-06-10T18:57:14.932995+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:36:09.853761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.257601+0000","last_change":"2023-06-10T18:57:12.885188+0000","last_active":"2023-06-10T18:57:14.257601+0000","last_peered":"2023-06-10T18:57:14.257601+0000","last_clean":"2023-06-10T18:57:14.257601+0000","last_became_active":"2023-06-10T18:57:12.884455+0000","last_became_peered":"2023-06-10T18:57:12.884455+0000","last_unstale":"2023-06-10T18:57:14.257601+0000","last_undegraded":"2023-06-10T18:57:14.257601+0000","last_fullsized":"2023-06-10T18:57:14.257601+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:48:55.365352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.526502+0000","last_change":"2023-06-10T18:57:13.291570+0000","last_active":"2023-06-10T18:57:14.526502+0000","last_peered":"2023-06-10T18:57:14.526502+0000","last_clean":"2023-06-10T18:57:14.526502+0000","last_became_active":"2023-06-10T18:57:13.290200+0000","last_became_peered":"2023-06-10T18:57:13.290200+0000","last_unstale":"2023-06-10T18:57:14.526502+0000","last_undegraded":"2023-06-10T18:57:14.526502+0000","last_fullsized":"2023-06-10T18:57:14.526502+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:49:43.926660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"64'3","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.931183+0000","last_change":"2023-06-10T18:57:12.892912+0000","last_active":"2023-06-10T18:57:14.931183+0000","last_peered":"2023-06-10T18:57:14.931183+0000","last_clean":"2023-06-10T18:57:14.931183+0000","last_became_active":"2023-06-10T18:57:12.891491+0000","last_became_peered":"2023-06-10T18:57:12.891491+0000","last_unstale":"2023-06-10T18:57:14.931183+0000","last_undegraded":"2023-06-10T18:57:14.931183+0000","last_fullsized":"2023-06-10T18:57:14.931183+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:02:06.216392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.258041+0000","last_change":"2023-06-10T18:57:13.278609+0000","last_active":"2023-06-10T18:57:14.258041+0000","last_peered":"2023-06-10T18:57:14.258041+0000","last_clean":"2023-06-10T18:57:14.258041+0000","last_became_active":"2023-06-10T18:57:13.277767+0000","last_became_peered":"2023-06-10T18:57:13.277767+0000","last_unstale":"2023-06-10T18:57:14.258041+0000","last_undegraded":"2023-06-10T18:57:14.258041+0000","last_fullsized":"2023-06-10T18:57:14.258041+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:40:50.862809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"64'6","reported_seq":19,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.932534+0000","last_change":"2023-06-10T18:57:12.893600+0000","last_active":"2023-06-10T18:57:14.932534+0000","last_peered":"2023-06-10T18:57:14.932534+0000","last_clean":"2023-06-10T18:57:14.932534+0000","last_became_active":"2023-06-10T18:57:12.893280+0000","last_became_peered":"2023-06-10T18:57:12.893280+0000","last_unstale":"2023-06-10T18:57:14.932534+0000","last_undegraded":"2023-06-10T18:57:14.932534+0000","last_fullsized":"2023-06-10T18:57:14.932534+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:05:22.219760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.255491+0000","last_change":"2023-06-10T18:57:13.302334+0000","last_active":"2023-06-10T18:57:14.255491+0000","last_peered":"2023-06-10T18:57:14.255491+0000","last_clean":"2023-06-10T18:57:14.255491+0000","last_became_active":"2023-06-10T18:57:13.300953+0000","last_became_peered":"2023-06-10T18:57:13.300953+0000","last_unstale":"2023-06-10T18:57:14.255491+0000","last_undegraded":"2023-06-10T18:57:14.255491+0000","last_fullsized":"2023-06-10T18:57:14.255491+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:49:43.926660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"64'2","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.931703+0000","last_change":"2023-06-10T18:57:12.905702+0000","last_active":"2023-06-10T18:57:14.931703+0000","last_peered":"2023-06-10T18:57:14.931703+0000","last_clean":"2023-06-10T18:57:14.931703+0000","last_became_active":"2023-06-10T18:57:12.905010+0000","last_became_peered":"2023-06-10T18:57:12.905010+0000","last_unstale":"2023-06-10T18:57:14.931703+0000","last_undegraded":"2023-06-10T18:57:14.931703+0000","last_fullsized":"2023-06-10T18:57:14.931703+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:29:45.863194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.256343+0000","last_change":"2023-06-10T18:57:13.255158+0000","last_active":"2023-06-10T18:57:14.256343+0000","last_peered":"2023-06-10T18:57:14.256343+0000","last_clean":"2023-06-10T18:57:14.256343+0000","last_became_active":"2023-06-10T18:57:13.254056+0000","last_became_peered":"2023-06-10T18:57:13.254056+0000","last_unstale":"2023-06-10T18:57:14.256343+0000","last_undegraded":"2023-06-10T18:57:14.256343+0000","last_fullsized":"2023-06-10T18:57:14.256343+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:22:15.141932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.258473+0000","last_change":"2023-06-10T18:57:12.883017+0000","last_active":"2023-06-10T18:57:14.258473+0000","last_peered":"2023-06-10T18:57:14.258473+0000","last_clean":"2023-06-10T18:57:14.258473+0000","last_became_active":"2023-06-10T18:57:12.881943+0000","last_became_peered":"2023-06-10T18:57:12.881943+0000","last_unstale":"2023-06-10T18:57:14.258473+0000","last_undegraded":"2023-06-10T18:57:14.258473+0000","last_fullsized":"2023-06-10T18:57:14.258473+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:56:01.045393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.526216+0000","last_change":"2023-06-10T18:57:13.294633+0000","last_active":"2023-06-10T18:57:14.526216+0000","last_peered":"2023-06-10T18:57:14.526216+0000","last_clean":"2023-06-10T18:57:14.526216+0000","last_became_active":"2023-06-10T18:57:13.292238+0000","last_became_peered":"2023-06-10T18:57:13.292238+0000","last_unstale":"2023-06-10T18:57:14.526216+0000","last_undegraded":"2023-06-10T18:57:14.526216+0000","last_fullsized":"2023-06-10T18:57:14.526216+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:20:47.566495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.931373+0000","last_change":"2023-06-10T18:57:12.892328+0000","last_active":"2023-06-10T18:57:14.931373+0000","last_peered":"2023-06-10T18:57:14.931373+0000","last_clean":"2023-06-10T18:57:14.931373+0000","last_became_active":"2023-06-10T18:57:12.891514+0000","last_became_peered":"2023-06-10T18:57:12.891514+0000","last_unstale":"2023-06-10T18:57:14.931373+0000","last_undegraded":"2023-06-10T18:57:14.931373+0000","last_fullsized":"2023-06-10T18:57:14.931373+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:11:21.739946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.932092+0000","last_change":"2023-06-10T18:57:13.304629+0000","last_active":"2023-06-10T18:57:14.932092+0000","last_peered":"2023-06-10T18:57:14.932092+0000","last_clean":"2023-06-10T18:57:14.932092+0000","last_became_active":"2023-06-10T18:57:13.304404+0000","last_became_peered":"2023-06-10T18:57:13.304404+0000","last_unstale":"2023-06-10T18:57:14.932092+0000","last_undegraded":"2023-06-10T18:57:14.932092+0000","last_fullsized":"2023-06-10T18:57:14.932092+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:29:56.588963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"64'8","reported_seq":21,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.255324+0000","last_change":"2023-06-10T18:57:12.889495+0000","last_active":"2023-06-10T18:57:14.255324+0000","last_peered":"2023-06-10T18:57:14.255324+0000","last_clean":"2023-06-10T18:57:14.255324+0000","last_became_active":"2023-06-10T18:57:12.888617+0000","last_became_peered":"2023-06-10T18:57:12.888617+0000","last_unstale":"2023-06-10T18:57:14.255324+0000","last_undegraded":"2023-06-10T18:57:14.255324+0000","last_fullsized":"2023-06-10T18:57:14.255324+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:27:13.927042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.254369+0000","last_change":"2023-06-10T18:57:13.277598+0000","last_active":"2023-06-10T18:57:14.254369+0000","last_peered":"2023-06-10T18:57:14.254369+0000","last_clean":"2023-06-10T18:57:14.254369+0000","last_became_active":"2023-06-10T18:57:13.277349+0000","last_became_peered":"2023-06-10T18:57:13.277349+0000","last_unstale":"2023-06-10T18:57:14.254369+0000","last_undegraded":"2023-06-10T18:57:14.254369+0000","last_fullsized":"2023-06-10T18:57:14.254369+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:37:57.899268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"64'2","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.259835+0000","last_change":"2023-06-10T18:57:12.889724+0000","last_active":"2023-06-10T18:57:14.259835+0000","last_peered":"2023-06-10T18:57:14.259835+0000","last_clean":"2023-06-10T18:57:14.259835+0000","last_became_active":"2023-06-10T18:57:12.889210+0000","last_became_peered":"2023-06-10T18:57:12.889210+0000","last_unstale":"2023-06-10T18:57:14.259835+0000","last_undegraded":"2023-06-10T18:57:14.259835+0000","last_fullsized":"2023-06-10T18:57:14.259835+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:56:37.298983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.428519+0000","last_change":"2023-06-10T18:57:13.253522+0000","last_active":"2023-06-10T18:57:14.428519+0000","last_peered":"2023-06-10T18:57:14.428519+0000","last_clean":"2023-06-10T18:57:14.428519+0000","last_became_active":"2023-06-10T18:57:13.253297+0000","last_became_peered":"2023-06-10T18:57:13.253297+0000","last_unstale":"2023-06-10T18:57:14.428519+0000","last_undegraded":"2023-06-10T18:57:14.428519+0000","last_fullsized":"2023-06-10T18:57:14.428519+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:04:01.753221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.259610+0000","last_change":"2023-06-10T18:57:12.883077+0000","last_active":"2023-06-10T18:57:14.259610+0000","last_peered":"2023-06-10T18:57:14.259610+0000","last_clean":"2023-06-10T18:57:14.259610+0000","last_became_active":"2023-06-10T18:57:12.881984+0000","last_became_peered":"2023-06-10T18:57:12.881984+0000","last_unstale":"2023-06-10T18:57:14.259610+0000","last_undegraded":"2023-06-10T18:57:14.259610+0000","last_fullsized":"2023-06-10T18:57:14.259610+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:07:12.656980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.259436+0000","last_change":"2023-06-10T18:57:13.270873+0000","last_active":"2023-06-10T18:57:14.259436+0000","last_peered":"2023-06-10T18:57:14.259436+0000","last_clean":"2023-06-10T18:57:14.259436+0000","last_became_active":"2023-06-10T18:57:13.269691+0000","last_became_peered":"2023-06-10T18:57:13.269691+0000","last_unstale":"2023-06-10T18:57:14.259436+0000","last_undegraded":"2023-06-10T18:57:14.259436+0000","last_fullsized":"2023-06-10T18:57:14.259436+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:36:43.597201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.254566+0000","last_change":"2023-06-10T18:57:12.902386+0000","last_active":"2023-06-10T18:57:14.254566+0000","last_peered":"2023-06-10T18:57:14.254566+0000","last_clean":"2023-06-10T18:57:14.254566+0000","last_became_active":"2023-06-10T18:57:12.901985+0000","last_became_peered":"2023-06-10T18:57:12.901985+0000","last_unstale":"2023-06-10T18:57:14.254566+0000","last_undegraded":"2023-06-10T18:57:14.254566+0000","last_fullsized":"2023-06-10T18:57:14.254566+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:32:53.427136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.526240+0000","last_change":"2023-06-10T18:57:13.294846+0000","last_active":"2023-06-10T18:57:14.526240+0000","last_peered":"2023-06-10T18:57:14.526240+0000","last_clean":"2023-06-10T18:57:14.526240+0000","last_became_active":"2023-06-10T18:57:13.291799+0000","last_became_peered":"2023-06-10T18:57:13.291799+0000","last_unstale":"2023-06-10T18:57:14.526240+0000","last_undegraded":"2023-06-10T18:57:14.526240+0000","last_fullsized":"2023-06-10T18:57:14.526240+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:45:22.999372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.932884+0000","last_change":"2023-06-10T18:57:12.893797+0000","last_active":"2023-06-10T18:57:14.932884+0000","last_peered":"2023-06-10T18:57:14.932884+0000","last_clean":"2023-06-10T18:57:14.932884+0000","last_became_active":"2023-06-10T18:57:12.893210+0000","last_became_peered":"2023-06-10T18:57:12.893210+0000","last_unstale":"2023-06-10T18:57:14.932884+0000","last_undegraded":"2023-06-10T18:57:14.932884+0000","last_fullsized":"2023-06-10T18:57:14.932884+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:32:41.365666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.525513+0000","last_change":"2023-06-10T18:57:13.293893+0000","last_active":"2023-06-10T18:57:14.525513+0000","last_peered":"2023-06-10T18:57:14.525513+0000","last_clean":"2023-06-10T18:57:14.525513+0000","last_became_active":"2023-06-10T18:57:13.293423+0000","last_became_peered":"2023-06-10T18:57:13.293423+0000","last_unstale":"2023-06-10T18:57:14.525513+0000","last_undegraded":"2023-06-10T18:57:14.525513+0000","last_fullsized":"2023-06-10T18:57:14.525513+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:21:55.629492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.931383+0000","last_change":"2023-06-10T18:57:12.892224+0000","last_active":"2023-06-10T18:57:14.931383+0000","last_peered":"2023-06-10T18:57:14.931383+0000","last_clean":"2023-06-10T18:57:14.931383+0000","last_became_active":"2023-06-10T18:57:12.891612+0000","last_became_peered":"2023-06-10T18:57:12.891612+0000","last_unstale":"2023-06-10T18:57:14.931383+0000","last_undegraded":"2023-06-10T18:57:14.931383+0000","last_fullsized":"2023-06-10T18:57:14.931383+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:10:31.008558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.256121+0000","last_change":"2023-06-10T18:57:13.301567+0000","last_active":"2023-06-10T18:57:14.256121+0000","last_peered":"2023-06-10T18:57:14.256121+0000","last_clean":"2023-06-10T18:57:14.256121+0000","last_became_active":"2023-06-10T18:57:13.301091+0000","last_became_peered":"2023-06-10T18:57:13.301091+0000","last_unstale":"2023-06-10T18:57:14.256121+0000","last_undegraded":"2023-06-10T18:57:14.256121+0000","last_fullsized":"2023-06-10T18:57:14.256121+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:34:21.615921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.933231+0000","last_change":"2023-06-10T18:57:12.884298+0000","last_active":"2023-06-10T18:57:14.933231+0000","last_peered":"2023-06-10T18:57:14.933231+0000","last_clean":"2023-06-10T18:57:14.933231+0000","last_became_active":"2023-06-10T18:57:12.883945+0000","last_became_peered":"2023-06-10T18:57:12.883945+0000","last_unstale":"2023-06-10T18:57:14.933231+0000","last_undegraded":"2023-06-10T18:57:14.933231+0000","last_fullsized":"2023-06-10T18:57:14.933231+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:46:01.209420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.932009+0000","last_change":"2023-06-10T18:57:13.284004+0000","last_active":"2023-06-10T18:57:14.932009+0000","last_peered":"2023-06-10T18:57:14.932009+0000","last_clean":"2023-06-10T18:57:14.932009+0000","last_became_active":"2023-06-10T18:57:13.283585+0000","last_became_peered":"2023-06-10T18:57:13.283585+0000","last_unstale":"2023-06-10T18:57:14.932009+0000","last_undegraded":"2023-06-10T18:57:14.932009+0000","last_fullsized":"2023-06-10T18:57:14.932009+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:46:02.213122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.931021+0000","last_change":"2023-06-10T18:57:12.905450+0000","last_active":"2023-06-10T18:57:14.931021+0000","last_peered":"2023-06-10T18:57:14.931021+0000","last_clean":"2023-06-10T18:57:14.931021+0000","last_became_active":"2023-06-10T18:57:12.905165+0000","last_became_peered":"2023-06-10T18:57:12.905165+0000","last_unstale":"2023-06-10T18:57:14.931021+0000","last_undegraded":"2023-06-10T18:57:14.931021+0000","last_fullsized":"2023-06-10T18:57:14.931021+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:00:04.981964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.428385+0000","last_change":"2023-06-10T18:57:13.274020+0000","last_active":"2023-06-10T18:57:14.428385+0000","last_peered":"2023-06-10T18:57:14.428385+0000","last_clean":"2023-06-10T18:57:14.428385+0000","last_became_active":"2023-06-10T18:57:13.273679+0000","last_became_peered":"2023-06-10T18:57:13.273679+0000","last_unstale":"2023-06-10T18:57:14.428385+0000","last_undegraded":"2023-06-10T18:57:14.428385+0000","last_fullsized":"2023-06-10T18:57:14.428385+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:48:06.315568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.931810+0000","last_change":"2023-06-10T18:57:12.906185+0000","last_active":"2023-06-10T18:57:14.931810+0000","last_peered":"2023-06-10T18:57:14.931810+0000","last_clean":"2023-06-10T18:57:14.931810+0000","last_became_active":"2023-06-10T18:57:12.905968+0000","last_became_peered":"2023-06-10T18:57:12.905968+0000","last_unstale":"2023-06-10T18:57:14.931810+0000","last_undegraded":"2023-06-10T18:57:14.931810+0000","last_fullsized":"2023-06-10T18:57:14.931810+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:32:53.427136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.525900+0000","last_change":"2023-06-10T18:57:13.291409+0000","last_active":"2023-06-10T18:57:14.525900+0000","last_peered":"2023-06-10T18:57:14.525900+0000","last_clean":"2023-06-10T18:57:14.525900+0000","last_became_active":"2023-06-10T18:57:13.290768+0000","last_became_peered":"2023-06-10T18:57:13.290768+0000","last_unstale":"2023-06-10T18:57:14.525900+0000","last_undegraded":"2023-06-10T18:57:14.525900+0000","last_fullsized":"2023-06-10T18:57:14.525900+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:13:06.807526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.930798+0000","last_change":"2023-06-10T18:57:12.878281+0000","last_active":"2023-06-10T18:57:14.930798+0000","last_peered":"2023-06-10T18:57:14.930798+0000","last_clean":"2023-06-10T18:57:14.930798+0000","last_became_active":"2023-06-10T18:57:12.877987+0000","last_became_peered":"2023-06-10T18:57:12.877987+0000","last_unstale":"2023-06-10T18:57:14.930798+0000","last_undegraded":"2023-06-10T18:57:14.930798+0000","last_fullsized":"2023-06-10T18:57:14.930798+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:57:38.602424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":249,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.931118+0000","last_change":"2023-06-10T18:52:34.951528+0000","last_active":"2023-06-10T18:57:14.931118+0000","last_peered":"2023-06-10T18:57:14.931118+0000","last_clean":"2023-06-10T18:57:14.931118+0000","last_became_active":"2023-06-10T18:52:34.949099+0000","last_became_peered":"2023-06-10T18:52:34.949099+0000","last_unstale":"2023-06-10T18:57:14.931118+0000","last_undegraded":"2023-06-10T18:57:14.931118+0000","last_fullsized":"2023-06-10T18:57:14.931118+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_clean_scrub_stamp":"2023-06-10T18:52:33.633295+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:50:13.411009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":95,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.259287+0000","last_change":"2023-06-10T18:52:40.506384+0000","last_active":"2023-06-10T18:57:14.259287+0000","last_peered":"2023-06-10T18:57:14.259287+0000","last_clean":"2023-06-10T18:57:14.259287+0000","last_became_active":"2023-06-10T18:52:40.505701+0000","last_became_peered":"2023-06-10T18:52:40.505701+0000","last_unstale":"2023-06-10T18:57:14.259287+0000","last_undegraded":"2023-06-10T18:57:14.259287+0000","last_fullsized":"2023-06-10T18:57:14.259287+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:21:55.236256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.254058+0000","last_change":"2023-06-10T18:57:13.264235+0000","last_active":"2023-06-10T18:57:14.254058+0000","last_peered":"2023-06-10T18:57:14.254058+0000","last_clean":"2023-06-10T18:57:14.254058+0000","last_became_active":"2023-06-10T18:57:13.263890+0000","last_became_peered":"2023-06-10T18:57:13.263890+0000","last_unstale":"2023-06-10T18:57:14.254058+0000","last_undegraded":"2023-06-10T18:57:14.254058+0000","last_fullsized":"2023-06-10T18:57:14.254058+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:14:28.319502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"64'2","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.254288+0000","last_change":"2023-06-10T18:57:12.885559+0000","last_active":"2023-06-10T18:57:14.254288+0000","last_peered":"2023-06-10T18:57:14.254288+0000","last_clean":"2023-06-10T18:57:14.254288+0000","last_became_active":"2023-06-10T18:57:12.885246+0000","last_became_peered":"2023-06-10T18:57:12.885246+0000","last_unstale":"2023-06-10T18:57:14.254288+0000","last_undegraded":"2023-06-10T18:57:14.254288+0000","last_fullsized":"2023-06-10T18:57:14.254288+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:46:11.635230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":93,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.930784+0000","last_change":"2023-06-10T18:52:40.512015+0000","last_active":"2023-06-10T18:57:14.930784+0000","last_peered":"2023-06-10T18:57:14.930784+0000","last_clean":"2023-06-10T18:57:14.930784+0000","last_became_active":"2023-06-10T18:52:40.511382+0000","last_became_peered":"2023-06-10T18:52:40.511382+0000","last_unstale":"2023-06-10T18:57:14.930784+0000","last_undegraded":"2023-06-10T18:57:14.930784+0000","last_fullsized":"2023-06-10T18:57:14.930784+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:14:20.492303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.256640+0000","last_change":"2023-06-10T18:57:13.270711+0000","last_active":"2023-06-10T18:57:14.256640+0000","last_peered":"2023-06-10T18:57:14.256640+0000","last_clean":"2023-06-10T18:57:14.256640+0000","last_became_active":"2023-06-10T18:57:13.269922+0000","last_became_peered":"2023-06-10T18:57:13.269922+0000","last_unstale":"2023-06-10T18:57:14.256640+0000","last_undegraded":"2023-06-10T18:57:14.256640+0000","last_fullsized":"2023-06-10T18:57:14.256640+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:50:22.954368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.256697+0000","last_change":"2023-06-10T18:57:12.893530+0000","last_active":"2023-06-10T18:57:14.256697+0000","last_peered":"2023-06-10T18:57:14.256697+0000","last_clean":"2023-06-10T18:57:14.256697+0000","last_became_active":"2023-06-10T18:57:12.892910+0000","last_became_peered":"2023-06-10T18:57:12.892910+0000","last_unstale":"2023-06-10T18:57:14.256697+0000","last_undegraded":"2023-06-10T18:57:14.256697+0000","last_fullsized":"2023-06-10T18:57:14.256697+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:37:49.865915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":97,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.428439+0000","last_change":"2023-06-10T18:52:40.671725+0000","last_active":"2023-06-10T18:57:14.428439+0000","last_peered":"2023-06-10T18:57:14.428439+0000","last_clean":"2023-06-10T18:57:14.428439+0000","last_became_active":"2023-06-10T18:52:40.671442+0000","last_became_peered":"2023-06-10T18:52:40.671442+0000","last_unstale":"2023-06-10T18:57:14.428439+0000","last_undegraded":"2023-06-10T18:57:14.428439+0000","last_fullsized":"2023-06-10T18:57:14.428439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T18:53:52.770522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.526052+0000","last_change":"2023-06-10T18:57:13.295430+0000","last_active":"2023-06-10T18:57:14.526052+0000","last_peered":"2023-06-10T18:57:14.526052+0000","last_clean":"2023-06-10T18:57:14.526052+0000","last_became_active":"2023-06-10T18:57:13.294135+0000","last_became_peered":"2023-06-10T18:57:13.294135+0000","last_unstale":"2023-06-10T18:57:14.526052+0000","last_undegraded":"2023-06-10T18:57:14.526052+0000","last_fullsized":"2023-06-10T18:57:14.526052+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:46:35.743380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.254234+0000","last_change":"2023-06-10T18:57:12.886396+0000","last_active":"2023-06-10T18:57:14.254234+0000","last_peered":"2023-06-10T18:57:14.254234+0000","last_clean":"2023-06-10T18:57:14.254234+0000","last_became_active":"2023-06-10T18:57:12.885991+0000","last_became_peered":"2023-06-10T18:57:12.885991+0000","last_unstale":"2023-06-10T18:57:14.254234+0000","last_undegraded":"2023-06-10T18:57:14.254234+0000","last_fullsized":"2023-06-10T18:57:14.254234+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:12:54.670196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":95,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.258885+0000","last_change":"2023-06-10T18:52:40.510258+0000","last_active":"2023-06-10T18:57:14.258885+0000","last_peered":"2023-06-10T18:57:14.258885+0000","last_clean":"2023-06-10T18:57:14.258885+0000","last_became_active":"2023-06-10T18:52:40.509560+0000","last_became_peered":"2023-06-10T18:52:40.509560+0000","last_unstale":"2023-06-10T18:57:14.258885+0000","last_undegraded":"2023-06-10T18:57:14.258885+0000","last_fullsized":"2023-06-10T18:57:14.258885+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:31:48.923521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.931234+0000","last_change":"2023-06-10T18:57:13.303033+0000","last_active":"2023-06-10T18:57:14.931234+0000","last_peered":"2023-06-10T18:57:14.931234+0000","last_clean":"2023-06-10T18:57:14.931234+0000","last_became_active":"2023-06-10T18:57:13.302527+0000","last_became_peered":"2023-06-10T18:57:13.302527+0000","last_unstale":"2023-06-10T18:57:14.931234+0000","last_undegraded":"2023-06-10T18:57:14.931234+0000","last_fullsized":"2023-06-10T18:57:14.931234+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:24:35.933576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"64'1","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.259656+0000","last_change":"2023-06-10T18:57:12.892196+0000","last_active":"2023-06-10T18:57:14.259656+0000","last_peered":"2023-06-10T18:57:14.259656+0000","last_clean":"2023-06-10T18:57:14.259656+0000","last_became_active":"2023-06-10T18:57:12.891587+0000","last_became_peered":"2023-06-10T18:57:12.891587+0000","last_unstale":"2023-06-10T18:57:14.259656+0000","last_undegraded":"2023-06-10T18:57:14.259656+0000","last_fullsized":"2023-06-10T18:57:14.259656+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:43:03.316354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":89,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.933163+0000","last_change":"2023-06-10T18:52:40.672266+0000","last_active":"2023-06-10T18:57:14.933163+0000","last_peered":"2023-06-10T18:57:14.933163+0000","last_clean":"2023-06-10T18:57:14.933163+0000","last_became_active":"2023-06-10T18:52:40.671966+0000","last_became_peered":"2023-06-10T18:52:40.671966+0000","last_unstale":"2023-06-10T18:57:14.933163+0000","last_undegraded":"2023-06-10T18:57:14.933163+0000","last_fullsized":"2023-06-10T18:57:14.933163+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:32:47.809991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.526185+0000","last_change":"2023-06-10T18:57:13.290811+0000","last_active":"2023-06-10T18:57:14.526185+0000","last_peered":"2023-06-10T18:57:14.526185+0000","last_clean":"2023-06-10T18:57:14.526185+0000","last_became_active":"2023-06-10T18:57:13.289995+0000","last_became_peered":"2023-06-10T18:57:13.289995+0000","last_unstale":"2023-06-10T18:57:14.526185+0000","last_undegraded":"2023-06-10T18:57:14.526185+0000","last_fullsized":"2023-06-10T18:57:14.526185+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:53:44.170332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"64'2","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.931563+0000","last_change":"2023-06-10T18:57:12.898334+0000","last_active":"2023-06-10T18:57:14.931563+0000","last_peered":"2023-06-10T18:57:14.931563+0000","last_clean":"2023-06-10T18:57:14.931563+0000","last_became_active":"2023-06-10T18:57:12.897715+0000","last_became_peered":"2023-06-10T18:57:12.897715+0000","last_unstale":"2023-06-10T18:57:14.931563+0000","last_undegraded":"2023-06-10T18:57:14.931563+0000","last_fullsized":"2023-06-10T18:57:14.931563+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:12:39.320145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":93,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.931809+0000","last_change":"2023-06-10T18:52:40.671084+0000","last_active":"2023-06-10T18:57:14.931809+0000","last_peered":"2023-06-10T18:57:14.931809+0000","last_clean":"2023-06-10T18:57:14.931809+0000","last_became_active":"2023-06-10T18:52:40.670697+0000","last_became_peered":"2023-06-10T18:52:40.670697+0000","last_unstale":"2023-06-10T18:57:14.931809+0000","last_undegraded":"2023-06-10T18:57:14.931809+0000","last_fullsized":"2023-06-10T18:57:14.931809+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:20:07.840833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.257572+0000","last_change":"2023-06-10T18:57:13.292992+0000","last_active":"2023-06-10T18:57:14.257572+0000","last_peered":"2023-06-10T18:57:14.257572+0000","last_clean":"2023-06-10T18:57:14.257572+0000","last_became_active":"2023-06-10T18:57:13.292455+0000","last_became_peered":"2023-06-10T18:57:13.292455+0000","last_unstale":"2023-06-10T18:57:14.257572+0000","last_undegraded":"2023-06-10T18:57:14.257572+0000","last_fullsized":"2023-06-10T18:57:14.257572+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:47:16.795794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"64'1","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.931519+0000","last_change":"2023-06-10T18:57:12.894181+0000","last_active":"2023-06-10T18:57:14.931519+0000","last_peered":"2023-06-10T18:57:14.931519+0000","last_clean":"2023-06-10T18:57:14.931519+0000","last_became_active":"2023-06-10T18:57:12.893501+0000","last_became_peered":"2023-06-10T18:57:12.893501+0000","last_unstale":"2023-06-10T18:57:14.931519+0000","last_undegraded":"2023-06-10T18:57:14.931519+0000","last_fullsized":"2023-06-10T18:57:14.931519+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:50:05.786456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":89,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.932781+0000","last_change":"2023-06-10T18:52:40.514114+0000","last_active":"2023-06-10T18:57:14.932781+0000","last_peered":"2023-06-10T18:57:14.932781+0000","last_clean":"2023-06-10T18:57:14.932781+0000","last_became_active":"2023-06-10T18:52:40.513638+0000","last_became_peered":"2023-06-10T18:52:40.513638+0000","last_unstale":"2023-06-10T18:57:14.932781+0000","last_undegraded":"2023-06-10T18:57:14.932781+0000","last_fullsized":"2023-06-10T18:57:14.932781+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:26:18.095403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.526358+0000","last_change":"2023-06-10T18:57:13.291180+0000","last_active":"2023-06-10T18:57:14.526358+0000","last_peered":"2023-06-10T18:57:14.526358+0000","last_clean":"2023-06-10T18:57:14.526358+0000","last_became_active":"2023-06-10T18:57:13.290398+0000","last_became_peered":"2023-06-10T18:57:13.290398+0000","last_unstale":"2023-06-10T18:57:14.526358+0000","last_undegraded":"2023-06-10T18:57:14.526358+0000","last_fullsized":"2023-06-10T18:57:14.526358+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:58:05.988682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.932937+0000","last_change":"2023-06-10T18:57:12.899055+0000","last_active":"2023-06-10T18:57:14.932937+0000","last_peered":"2023-06-10T18:57:14.932937+0000","last_clean":"2023-06-10T18:57:14.932937+0000","last_became_active":"2023-06-10T18:57:12.898805+0000","last_became_peered":"2023-06-10T18:57:12.898805+0000","last_unstale":"2023-06-10T18:57:14.932937+0000","last_undegraded":"2023-06-10T18:57:14.932937+0000","last_fullsized":"2023-06-10T18:57:14.932937+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:32:53.427136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":97,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.526362+0000","last_change":"2023-06-10T18:52:40.515396+0000","last_active":"2023-06-10T18:57:14.526362+0000","last_peered":"2023-06-10T18:57:14.526362+0000","last_clean":"2023-06-10T18:57:14.526362+0000","last_became_active":"2023-06-10T18:52:40.514663+0000","last_became_peered":"2023-06-10T18:52:40.514663+0000","last_unstale":"2023-06-10T18:57:14.526362+0000","last_undegraded":"2023-06-10T18:57:14.526362+0000","last_fullsized":"2023-06-10T18:57:14.526362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:22:41.559005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574908,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32408,"kb_used_data":1360,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339432,"statfs":{"total":96636764160,"available":96603578368,"internally_reserved":0,"allocated":1392640,"data_stored":937837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.89800000000000002,"15min":0.88},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.1850000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.874,"5min":0.93300000000000005,"15min":0.92700000000000005},"min":{"1min":0.52900000000000003,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1910000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.96399999999999997}]},{"osd":1,"last update":"Sat Jun 10 18:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.93200000000000005,"15min":0.91800000000000004},"min":{"1min":0.56100000000000005,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.3759999999999999,"5min":1.377,"15min":1.377},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.93300000000000005,"15min":0.91300000000000003},"min":{"1min":0.70099999999999996,"5min":0.504,"15min":0.504},"max":{"1min":1.2529999999999999,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.077}]},{"osd":2,"last update":"Sat Jun 10 18:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.83699999999999997,"15min":0.82699999999999996},"min":{"1min":0.49299999999999999,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.04,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.627},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.89100000000000001,"15min":0.90400000000000003},"min":{"1min":0.56100000000000005,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1930000000000001,"5min":1.367,"15min":1.367},"last":1.0029999999999999}]},{"osd":3,"last update":"Sat Jun 10 18:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.92900000000000005,"15min":0.90100000000000002},"min":{"1min":0.59699999999999998,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.167,"5min":1.502,"15min":1.502},"last":1.1040000000000001},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.94199999999999995,"15min":0.92900000000000005},"min":{"1min":0.63,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.2230000000000001,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.74099999999999999}]},{"osd":4,"last update":"Sat Jun 10 18:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.871,"15min":0.871},"min":{"1min":0.57399999999999995,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.1639999999999999,"5min":1.639,"15min":1.639},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.95999999999999996,"15min":0.97799999999999998},"min":{"1min":0.65200000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.22,"5min":1.411,"15min":1.411},"last":1.04}]},{"osd":5,"last update":"Sat Jun 10 18:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":1.0189999999999999,"15min":1.0309999999999999},"min":{"1min":0.60099999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.2210000000000001,"5min":1.806,"15min":1.806},"last":1.125},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.038,"15min":1.048},"min":{"1min":0.71299999999999997,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.26,"5min":1.522,"15min":1.522},"last":0.88500000000000001}]},{"osd":6,"last update":"Sat Jun 10 18:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.995,"15min":1.002},"min":{"1min":0.66400000000000003,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.2170000000000001,"5min":1.718,"15min":1.718},"last":1.1719999999999999},{"interface":"front","average":{"1min":1.048,"5min":1.087,"15min":1.087},"min":{"1min":0.83599999999999997,"5min":0.441,"15min":0.441},"max":{"1min":1.2889999999999999,"5min":1.464,"15min":1.464},"last":1.147}]}]},{"osd":6,"up_from":13,"seq":55834574909,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27720,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344120,"statfs":{"total":96636764160,"available":96608378880,"internally_reserved":0,"allocated":786432,"data_stored":346727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:56:33 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.84999999999999998,"15min":0.81100000000000005},"min":{"1min":0.66700000000000004,"5min":0.502,"15min":0.502},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.878,"15min":0.84799999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":1.0569999999999999}]},{"osd":1,"last update":"Sat Jun 10 18:56:33 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.88,"15min":0.85399999999999998},"min":{"1min":0.53400000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0900000000000001,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.89500000000000002,"15min":0.86399999999999999},"min":{"1min":0.53800000000000003,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.587,"5min":1.778,"15min":1.778},"last":0.75900000000000001}]},{"osd":2,"last update":"Sat Jun 10 18:56:33 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.88300000000000001,"15min":0.86299999999999999},"min":{"1min":0.57399999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.1819999999999999,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.871,"5min":0.88100000000000001,"15min":0.88800000000000001},"min":{"1min":0.60299999999999998,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.177,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.72599999999999998}]},{"osd":3,"last update":"Sat Jun 10 18:56:33 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":0.90800000000000003,"15min":0.85999999999999999},"min":{"1min":0.64500000000000002,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":1.0329999999999999},{"interface":"front","average":{"1min":1,"5min":0.998,"15min":0.996},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.90100000000000002}]},{"osd":4,"last update":"Sat Jun 10 18:56:33 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.93000000000000005,"15min":0.95199999999999996},"min":{"1min":0.63,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":0.66700000000000004},{"interface":"front","average":{"1min":1.024,"5min":1.0049999999999999,"15min":1.0189999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.54,"5min":1.54,"15min":1.54},"last":0.999}]},{"osd":5,"last update":"Sat Jun 10 18:56:33 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.93500000000000005,"15min":0.95699999999999996},"min":{"1min":0.70299999999999996,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.92600000000000005},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.044,"15min":1.032},"min":{"1min":0.83699999999999997,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":2.536,"5min":2.536,"15min":2.536},"last":0.93799999999999994}]},{"osd":7,"last update":"Sat Jun 10 18:56:33 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.036,"15min":1.048},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.917,"5min":1.917,"15min":1.917},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.05,"15min":1.0629999999999999},"min":{"1min":0.79400000000000004,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.395,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.85199999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574909,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27720,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344120,"statfs":{"total":96636764160,"available":96608378880,"internally_reserved":0,"allocated":786432,"data_stored":346715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84499999999999997,"15min":0.83099999999999996},"min":{"1min":0.60999999999999999,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.879,"5min":0.90300000000000002,"15min":0.93700000000000006},"min":{"1min":0.58799999999999997,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1499999999999999,"5min":1.637,"15min":1.637},"last":0.56699999999999995}]},{"osd":1,"last update":"Sat Jun 10 18:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.89000000000000001,"15min":0.91200000000000003},"min":{"1min":0.54400000000000004,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.107,"5min":1.335,"15min":1.335},"last":1.234},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.91700000000000004,"15min":0.92100000000000004},"min":{"1min":0.63600000000000001,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.444,"5min":1.78,"15min":1.78},"last":0.74199999999999999}]},{"osd":2,"last update":"Sat Jun 10 18:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.84299999999999997,"15min":0.85099999999999998},"min":{"1min":0.54400000000000004,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.995,"5min":1.446,"15min":1.446},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.163,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":1.056}]},{"osd":3,"last update":"Sat Jun 10 18:56:37 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":0.95299999999999996,"15min":0.94899999999999995},"min":{"1min":0.75900000000000001,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.3440000000000001,"5min":1.484,"15min":1.484},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.998,"15min":1.034},"min":{"1min":0.66700000000000004,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.1910000000000001,"5min":1.337,"15min":1.337},"last":0.66300000000000003}]},{"osd":4,"last update":"Sat Jun 10 18:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.94499999999999995,"15min":0.98099999999999998},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.0720000000000001,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":1.161},{"interface":"front","average":{"1min":1.002,"5min":1.0189999999999999,"15min":1.0589999999999999},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.528,"5min":1.575,"15min":1.575},"last":0.88}]},{"osd":6,"last update":"Sat Jun 10 18:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":1.0089999999999999,"15min":1.0680000000000001},"min":{"1min":0.629,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.1799999999999999,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.97899999999999998,"5min":1.0389999999999999,"15min":1.0720000000000001},"min":{"1min":0.67200000000000004,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.1859999999999999,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.3029999999999999}]},{"osd":7,"last update":"Sat Jun 10 18:56:37 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.123,"15min":1.169},"min":{"1min":0.85199999999999998,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.573,"5min":1.873,"15min":1.873},"last":1.1060000000000001},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.1339999999999999,"15min":1.1739999999999999},"min":{"1min":0.877,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.4750000000000001,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.028}]}]},{"osd":4,"up_from":13,"seq":55834574908,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27728,"kb_used_data":776,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344112,"statfs":{"total":96636764160,"available":96608370688,"internally_reserved":0,"allocated":794624,"data_stored":348257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.78700000000000003,"15min":0.752},"min":{"1min":0.49299999999999999,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.157,"5min":1.2,"15min":1.2},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.89700000000000002,"15min":0.88500000000000001},"min":{"1min":0.66500000000000004,"5min":0.504,"15min":0.504},"max":{"1min":1.2350000000000001,"5min":1.73,"15min":1.73},"last":0.53500000000000003}]},{"osd":1,"last update":"Sat Jun 10 18:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.94799999999999995,"15min":0.95399999999999996},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.179,"5min":1.601,"15min":1.601},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.87,"5min":0.85299999999999998,"15min":0.83899999999999997},"min":{"1min":0.63400000000000001,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.3029999999999999,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.503}]},{"osd":2,"last update":"Sat Jun 10 18:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.877,"15min":0.875},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.089,"5min":1.522,"15min":1.522},"last":1.0289999999999999},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.98999999999999999,"15min":1},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.2629999999999999,"5min":1.552,"15min":1.552},"last":0.73699999999999999}]},{"osd":3,"last update":"Sat Jun 10 18:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.89900000000000002,"15min":0.88},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.1990000000000001,"5min":1.22,"15min":1.22},"last":0.60399999999999998},{"interface":"front","average":{"1min":1.02,"5min":0.97299999999999998,"15min":0.95599999999999996},"min":{"1min":0.78900000000000003,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.159,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.78400000000000003}]},{"osd":5,"last update":"Sat Jun 10 18:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.95099999999999996,"15min":0.98899999999999999},"min":{"1min":0.68200000000000005,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.27,"5min":1.663,"15min":1.663},"last":1.014},{"interface":"front","average":{"1min":0.999,"5min":0.95499999999999996,"15min":0.98199999999999998},"min":{"1min":0.69899999999999995,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.234,"5min":1.353,"15min":1.353},"last":0.89300000000000002}]},{"osd":6,"last update":"Sat Jun 10 18:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.98799999999999999,"15min":1.024},"min":{"1min":0.65500000000000003,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.242,"5min":2.2639999999999998,"15min":2.2639999999999998},"last":0.93000000000000005},{"interface":"front","average":{"1min":1.054,"5min":1.0669999999999999,"15min":1.0740000000000001},"min":{"1min":0.72599999999999998,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.2849999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.95699999999999996}]},{"osd":7,"last update":"Sat Jun 10 18:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.98399999999999999,"15min":0.99399999999999999},"min":{"1min":0.68999999999999995,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.2350000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.0600000000000001,"15min":1.0740000000000001},"min":{"1min":0.78500000000000003,"5min":0.628,"15min":0.628},"max":{"1min":1.3879999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":1.071}]}]},{"osd":3,"up_from":13,"seq":55834574907,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31808,"kb_used_data":760,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340032,"statfs":{"total":96636764160,"available":96604192768,"internally_reserved":0,"allocated":778240,"data_stored":345674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:56:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.60099999999999998,"15min":0.57999999999999996},"min":{"1min":0.432,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.65300000000000002,"15min":0.63700000000000001},"min":{"1min":0.35599999999999998,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.0129999999999999,"5min":1.286,"15min":1.286},"last":0.78400000000000003}]},{"osd":1,"last update":"Sat Jun 10 18:56:36 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.67500000000000004,"15min":0.63200000000000001},"min":{"1min":0.45500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.74299999999999999,"15min":0.72299999999999998},"min":{"1min":0.48599999999999999,"5min":0.318,"15min":0.318},"max":{"1min":1.143,"5min":1.411,"15min":1.411},"last":0.84599999999999997}]},{"osd":2,"last update":"Sat Jun 10 18:56:36 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.77400000000000002,"15min":0.754},"min":{"1min":0.48999999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.3759999999999999,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":1.179},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.76800000000000002,"15min":0.745},"min":{"1min":0.52900000000000003,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.125,"5min":1.264,"15min":1.264},"last":0.94499999999999995}]},{"osd":4,"last update":"Sat Jun 10 18:56:36 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.95399999999999996,"15min":0.96599999999999997},"min":{"1min":0.747,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.3360000000000001,"5min":1.488,"15min":1.488},"last":0.90500000000000003},{"interface":"front","average":{"1min":1.026,"5min":0.997,"15min":0.99299999999999999},"min":{"1min":0.65500000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.3700000000000001,"5min":1.458,"15min":1.458},"last":1.0900000000000001}]},{"osd":5,"last update":"Sat Jun 10 18:56:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":1.026,"15min":1.0549999999999999},"min":{"1min":0.68000000000000005,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.431,"5min":2.024,"15min":2.024},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.117,"5min":1.0469999999999999,"15min":1.0209999999999999},"min":{"1min":0.94299999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.4139999999999999,"5min":1.724,"15min":1.724},"last":1.4079999999999999}]},{"osd":6,"last update":"Sat Jun 10 18:56:36 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.0669999999999999,"15min":1.0529999999999999},"min":{"1min":0.83199999999999996,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.5449999999999999,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":1.349},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.0640000000000001,"15min":1.0740000000000001},"min":{"1min":0.75900000000000001,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.514,"5min":1.78,"15min":1.78},"last":1.0229999999999999}]},{"osd":7,"last update":"Sat Jun 10 18:56:36 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.105,"15min":1.129},"min":{"1min":0.82599999999999996,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.5900000000000001,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.129},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.099,"15min":1.077},"min":{"1min":0.71799999999999997,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.5429999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":1.248}]}]},{"osd":2,"up_from":13,"seq":55834574908,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31812,"kb_used_data":764,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340028,"statfs":{"total":96636764160,"available":96604188672,"internally_reserved":0,"allocated":782336,"data_stored":346693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.60699999999999998,"15min":0.58999999999999997},"min":{"1min":0.36499999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.91700000000000004,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.436,"5min":0.378,"15min":0.378},"max":{"1min":1.0580000000000001,"5min":1.224,"15min":1.224},"last":0.66900000000000004}]},{"osd":1,"last update":"Sat Jun 10 18:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.66300000000000003,"15min":0.65100000000000002},"min":{"1min":0.39700000000000002,"5min":0.307,"15min":0.307},"max":{"1min":1.0109999999999999,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.753,"15min":0.69999999999999996},"min":{"1min":0.41699999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.97499999999999998}]},{"osd":3,"last update":"Sat Jun 10 18:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.745,"15min":0.70899999999999996},"min":{"1min":0.44700000000000001,"5min":0.377,"15min":0.377},"max":{"1min":1.0609999999999999,"5min":1.165,"15min":1.165},"last":0.88},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.76400000000000001,"15min":0.751},"min":{"1min":0.32900000000000001,"5min":0.252,"15min":0.252},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":1.0269999999999999}]},{"osd":4,"last update":"Sat Jun 10 18:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.92300000000000004,"15min":0.91700000000000004},"min":{"1min":0.63,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.2769999999999999,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":1.046,"5min":1.036,"15min":1.038},"min":{"1min":0.70199999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.3169999999999999,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":1.2210000000000001}]},{"osd":5,"last update":"Sat Jun 10 18:56:37 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.0289999999999999,"15min":1.0209999999999999},"min":{"1min":0.64600000000000002,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.3759999999999999,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":1.127},{"interface":"front","average":{"1min":1.056,"5min":1.02,"15min":0.98399999999999999},"min":{"1min":0.78200000000000003,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.4119999999999999,"5min":1.667,"15min":1.667},"last":1.1080000000000001}]},{"osd":6,"last update":"Sat Jun 10 18:56:37 2023","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.0609999999999999,"15min":1.0289999999999999},"min":{"1min":0.873,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.4550000000000001,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":1.1619999999999999},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.0509999999999999,"15min":1.038},"min":{"1min":0.66000000000000003,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":1.1899999999999999}]},{"osd":7,"last update":"Sat Jun 10 18:56:37 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.1060000000000001,"15min":1.1020000000000001},"min":{"1min":0.83899999999999997,"5min":0.62,"15min":0.62},"max":{"1min":1.458,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.4039999999999999},{"interface":"front","average":{"1min":1.181,"5min":1.121,"15min":1.083},"min":{"1min":0.76400000000000001,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.5920000000000001,"5min":1.752,"15min":1.752},"last":1.325}]}]},{"osd":1,"up_from":13,"seq":55834574910,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31836,"kb_used_data":788,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340004,"statfs":{"total":96636764160,"available":96604164096,"internally_reserved":0,"allocated":806912,"data_stored":348002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.66600000000000004,"15min":0.65900000000000003},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.0149999999999999,"5min":1.288,"15min":1.288},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.72799999999999998,"15min":0.68799999999999994},"min":{"1min":0.38300000000000001,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.0089999999999999,"5min":1.694,"15min":1.694},"last":0.77600000000000002}]},{"osd":2,"last update":"Sat Jun 10 18:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.63200000000000001,"15min":0.61899999999999999},"min":{"1min":0.27300000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.77300000000000002,"5min":1.21,"15min":1.21},"last":0.5},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71899999999999997,"15min":0.66300000000000003},"min":{"1min":0.33800000000000002,"5min":0.315,"15min":0.315},"max":{"1min":1.171,"5min":1.415,"15min":1.415},"last":0.57699999999999996}]},{"osd":3,"last update":"Sat Jun 10 18:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79200000000000004,"15min":0.75},"min":{"1min":0.33400000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.4139999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.755,"15min":0.747},"min":{"1min":0.35399999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.0649999999999999,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":0.53100000000000003}]},{"osd":4,"last update":"Sat Jun 10 18:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.875,"15min":0.83799999999999997},"min":{"1min":0.56799999999999995,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0329999999999999,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.95799999999999996,"5min":1.0960000000000001,"15min":1.0720000000000001},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.5129999999999999,"5min":5.8209999999999997,"15min":5.8209999999999997},"last":1.1699999999999999}]},{"osd":5,"last update":"Sat Jun 10 18:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":1.018,"15min":1.024},"min":{"1min":0.58499999999999996,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.2829999999999999,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":0.98599999999999999},{"interface":"front","average":{"1min":0.90400000000000003,"5min":1.004,"15min":0.96799999999999997},"min":{"1min":0.60699999999999998,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.1599999999999999,"5min":3.089,"15min":3.089},"last":0.96899999999999997}]},{"osd":6,"last update":"Sat Jun 10 18:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":1.105,"15min":1.0309999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.472,"5min":7.2599999999999998,"15min":7.2599999999999998},"last":1.135},{"interface":"front","average":{"1min":0.92900000000000005,"5min":1.0940000000000001,"15min":1.026},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.2090000000000001,"5min":9.0069999999999997,"15min":9.0069999999999997},"last":0.92900000000000005}]},{"osd":7,"last update":"Sat Jun 10 18:56:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.0920000000000001,"15min":1.081},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.3440000000000001,"5min":2.105,"15min":2.105},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.083,"15min":1.0669999999999999},"min":{"1min":0.65600000000000003,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.673,"5min":2.2570000000000001,"15min":2.2570000000000001},"last":1.0620000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574909,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32388,"kb_used_data":1340,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339452,"statfs":{"total":96636764160,"available":96603598848,"internally_reserved":0,"allocated":1372160,"data_stored":936042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jun 10 18:56:40 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.626,"15min":0.60299999999999998},"min":{"1min":0.35599999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.93899999999999995,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.78500000000000003,"15min":0.75},"min":{"1min":0.53100000000000003,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.028,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.379}]},{"osd":2,"last update":"Sat Jun 10 18:56:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.71399999999999997,"15min":0.69899999999999995},"min":{"1min":0.39400000000000002,"5min":0.313,"15min":0.313},"max":{"1min":1.073,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.308},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65400000000000003,"15min":0.63300000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.95099999999999996,"5min":1.371,"15min":1.371},"last":0.39800000000000002}]},{"osd":3,"last update":"Sat Jun 10 18:56:40 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.70099999999999996,"15min":0.67700000000000005},"min":{"1min":0.377,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.087,"5min":1.226,"15min":1.226},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.84099999999999997,"15min":0.81399999999999995},"min":{"1min":0.435,"5min":0.375,"15min":0.375},"max":{"1min":1.296,"5min":1.829,"15min":1.829},"last":0.41099999999999998}]},{"osd":4,"last update":"Sat Jun 10 18:56:40 2023","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.91100000000000003,"15min":0.89300000000000002},"min":{"1min":0.59099999999999997,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.173,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.63},{"interface":"front","average":{"1min":1.034,"5min":1.0369999999999999,"15min":1.034},"min":{"1min":0.65600000000000003,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.2729999999999999,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":0.74399999999999999}]},{"osd":5,"last update":"Sat Jun 10 18:56:40 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.64300000000000002,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.2450000000000001,"5min":1.694,"15min":1.694},"last":0.72399999999999998},{"interface":"front","average":{"1min":1.044,"5min":1.01,"15min":1.0009999999999999},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.3460000000000001,"5min":1.75,"15min":1.75},"last":0.57599999999999996}]},{"osd":6,"last update":"Sat Jun 10 18:56:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.0740000000000001,"15min":1.0569999999999999},"min":{"1min":0.61699999999999999,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.2949999999999999,"5min":2.04,"15min":2.04},"last":0.83099999999999996},{"interface":"front","average":{"1min":1.03,"5min":1.0029999999999999,"15min":0.999},"min":{"1min":0.71099999999999997,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.3280000000000001,"5min":1.883,"15min":1.883},"last":0.60899999999999999}]},{"osd":7,"last update":"Sat Jun 10 18:56:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.044,"15min":1.0349999999999999},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.3360000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":1.099,"5min":1.0660000000000001,"15min":1.054},"min":{"1min":0.69299999999999995,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.4610000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":0.69099999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-10T18:57:19.220 INFO:tasks.ceph.mds.a.smithi053.stderr:2023-06-10T18:57:19.214+0000 7fa571a57640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-06-10T18:57:20.790 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-10T18:57:20.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:20.922+0000 7f4fbe0bb640 1 Processor -- start 2023-06-10T18:57:20.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:20.922+0000 7f4fbe0bb640 1 -- start start 2023-06-10T18:57:20.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:20.922+0000 7f4fbe0bb640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4fb80c9840 0x7f4fb80c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:20.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:20.922+0000 7f4fbe0bb640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4fb8071060 0x7f4fb80af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:20.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:20.922+0000 7f4fbe0bb640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fb8159b50 con 0x7f4fb80afc60 2023-06-10T18:57:20.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:20.922+0000 7f4fbe0bb640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fb80ca150 con 0x7f4fb8071060 2023-06-10T18:57:20.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:20.922+0000 7f4fbe0bb640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb80702a0 con 0x7f4fb80c9840 2023-06-10T18:57:20.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:20.922+0000 7f4fb7fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f4fb80afc60 0x7f4fb815d2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:48288/0 (socket says 172.21.15.53:48288) 2023-06-10T18:57:20.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:20.922+0000 7f4fb7fff640 1 -- 172.21.15.53:0/314372499 learned_addr learned my addr 172.21.15.53:0/314372499 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:57:20.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:20.922+0000 7f4fb77fe640 1 --2- 172.21.15.53:0/314372499 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4fb80c9840 0x7f4fb80c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:20.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:20.922+0000 7f4fb6ffd640 1 --2- 172.21.15.53:0/314372499 >> v2:172.21.15.117:3300/0 conn(0x7f4fb8071060 0x7f4fb80af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:20.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:20.922+0000 7f4fb67fc640 1 -- 172.21.15.53:0/314372499 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2099224354 0 0) 0x7f4fb8159b50 con 0x7f4fb80afc60 2023-06-10T18:57:20.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:20.922+0000 7f4fb67fc640 1 -- 172.21.15.53:0/314372499 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4fa4003530 con 0x7f4fb80afc60 2023-06-10T18:57:20.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:20.922+0000 7f4fb67fc640 1 -- 172.21.15.53:0/314372499 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3217769925 0 0) 0x7f4fa4003530 con 0x7f4fb80afc60 2023-06-10T18:57:20.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:20.922+0000 7f4fb67fc640 1 -- 172.21.15.53:0/314372499 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4fb80c9840 msgr2=0x7f4fb80c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:20.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:20.922+0000 7f4fb67fc640 1 --2- 172.21.15.53:0/314372499 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4fb80c9840 0x7f4fb80c9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:20.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:20.922+0000 7f4fb67fc640 1 -- 172.21.15.53:0/314372499 >> v2:172.21.15.117:3300/0 conn(0x7f4fb8071060 msgr2=0x7f4fb80af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:20.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:20.922+0000 7f4fb67fc640 1 --2- 172.21.15.53:0/314372499 >> v2:172.21.15.117:3300/0 conn(0x7f4fb8071060 0x7f4fb80af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:20.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:20.922+0000 7f4fb67fc640 1 -- 172.21.15.53:0/314372499 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fb8070580 con 0x7f4fb80afc60 2023-06-10T18:57:20.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:20.922+0000 7f4fb67fc640 1 -- 172.21.15.53:0/314372499 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f4fb0001a00 con 0x7f4fb80afc60 2023-06-10T18:57:20.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:20.922+0000 7f4fb67fc640 1 -- 172.21.15.53:0/314372499 >> v1:172.21.15.53:6789/0 conn(0x7f4fb80afc60 legacy=0x7f4fb815d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:20.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:20.922+0000 7f4fb67fc640 1 --2- 172.21.15.53:0/314372499 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4fa40039f0 0x7f4fa4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:20.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:20.922+0000 7f4fb67fc640 1 --2- 172.21.15.53:0/314372499 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4fa40047d0 0x7f4fa4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:20.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:20.922+0000 7f4fb67fc640 1 --2- 172.21.15.53:0/314372499 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4fa4005180 0x7f4fa400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:20.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:20.922+0000 7f4fb67fc640 1 -- 172.21.15.53:0/314372499 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb80ca150 con 0x7f4fa4005180 2023-06-10T18:57:20.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:20.922+0000 7f4fb67fc640 1 -- 172.21.15.53:0/314372499 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb80702a0 con 0x7f4fa40047d0 2023-06-10T18:57:20.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:20.922+0000 7f4fb67fc640 1 -- 172.21.15.53:0/314372499 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa400bed0 con 0x7f4fa40039f0 2023-06-10T18:57:20.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:20.922+0000 7f4fb77fe640 1 --2- 172.21.15.53:0/314372499 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4fb80c9840 0x7f4fb80c9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-10T18:57:20.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:20.922+0000 7f4fb7fff640 1 --2- 172.21.15.53:0/314372499 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4fa4005180 0x7f4fa400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:20.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:20.922+0000 7f4fb6ffd640 1 --2- 172.21.15.53:0/314372499 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4fa40047d0 0x7f4fa4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:20.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:20.922+0000 7f4fb7fff640 1 -- 172.21.15.53:0/314372499 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4fa40039f0 msgr2=0x7f4fa4003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:20.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:20.922+0000 7f4fb77fe640 1 --2- 172.21.15.53:0/314372499 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4fa40039f0 0x7f4fa4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:20.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:20.922+0000 7f4fb7fff640 1 --2- 172.21.15.53:0/314372499 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4fa40039f0 0x7f4fa4003e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:20.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:20.922+0000 7f4fb7fff640 1 -- 172.21.15.53:0/314372499 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4fa40047d0 msgr2=0x7f4fa4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:20.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:20.922+0000 7f4fb7fff640 1 --2- 172.21.15.53:0/314372499 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4fa40047d0 0x7f4fa4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:20.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:20.922+0000 7f4fb7fff640 1 -- 172.21.15.53:0/314372499 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fa4003530 con 0x7f4fa4005180 2023-06-10T18:57:20.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:20.926+0000 7f4fb7fff640 1 --2- 172.21.15.53:0/314372499 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4fa4005180 0x7f4fa400b990 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f4fb000a890 tx=0x7f4fb001d300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4bb112fd7e202fc server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:20.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:20.926+0000 7f4fb67fc640 1 -- 172.21.15.53:0/314372499 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb00ad630 con 0x7f4fa4005180 2023-06-10T18:57:20.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:20.926+0000 7f4fb67fc640 1 -- 172.21.15.53:0/314372499 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fb00a8070 con 0x7f4fa4005180 2023-06-10T18:57:20.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:20.926+0000 7f4fb67fc640 1 -- 172.21.15.53:0/314372499 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb00ada50 con 0x7f4fa4005180 2023-06-10T18:57:20.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:20.926+0000 7f4fbe0bb640 1 -- 172.21.15.53:0/314372499 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4fa4005180 msgr2=0x7f4fa400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:20.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:20.926+0000 7f4fbe0bb640 1 --2- 172.21.15.53:0/314372499 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4fa4005180 0x7f4fa400b990 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f4fb000a890 tx=0x7f4fb001d300 comp rx=0 tx=0).stop 2023-06-10T18:57:20.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:20.926+0000 7f4fb7fff640 1 -- 172.21.15.53:0/314372499 reap_dead start 2023-06-10T18:57:20.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:20.926+0000 7f4fbe0bb640 1 -- 172.21.15.53:0/314372499 shutdown_connections 2023-06-10T18:57:20.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:20.926+0000 7f4fbe0bb640 1 -- 172.21.15.53:0/314372499 >> 172.21.15.53:0/314372499 conn(0x7f4fb806a0d0 msgr2=0x7f4fb80ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:20.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:20.926+0000 7f4fbe0bb640 1 -- 172.21.15.53:0/314372499 shutdown_connections 2023-06-10T18:57:20.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:20.926+0000 7f4fbe0bb640 1 -- 172.21.15.53:0/314372499 wait complete. 2023-06-10T18:57:20.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:20.926+0000 7f4fbe0bb640 1 Processor -- start 2023-06-10T18:57:20.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:20.926+0000 7f4fbe0bb640 1 -- start start 2023-06-10T18:57:20.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:20.930+0000 7f4fbe0bb640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4fa4005180 0x7f4fb80c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:20.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:20.930+0000 7f4fbe0bb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4fb815ad30 0x7f4fb815d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:20.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:20.930+0000 7f4fbe0bb640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4fb815b180 0x7f4fb80b2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:20.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:20.930+0000 7f4fbe0bb640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb80c4110 con 0x7f4fb815ad30 2023-06-10T18:57:20.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:20.930+0000 7f4fbe0bb640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb80c2b30 con 0x7f4fb815b180 2023-06-10T18:57:20.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:20.930+0000 7f4fbe0bb640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb80c2e10 con 0x7f4fa4005180 2023-06-10T18:57:20.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:20.930+0000 7f4fb6ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4fb815ad30 0x7f4fb815d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:20.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:20.930+0000 7f4fb6ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4fb815ad30 0x7f4fb815d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53034/0 (socket says 172.21.15.53:53034) 2023-06-10T18:57:20.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:20.930+0000 7f4fb6ffd640 1 -- 172.21.15.53:0/2328933612 learned_addr learned my addr 172.21.15.53:0/2328933612 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:57:20.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:20.930+0000 7f4fb77fe640 1 --2- 172.21.15.53:0/2328933612 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4fa4005180 0x7f4fb80c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:20.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:20.930+0000 7f4fb7fff640 1 --2- 172.21.15.53:0/2328933612 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4fb815b180 0x7f4fb80b2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:20.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:20.930+0000 7f4fb6ffd640 1 -- 172.21.15.53:0/2328933612 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4fa4005180 msgr2=0x7f4fb80c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:20.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:20.930+0000 7f4fb6ffd640 1 --2- 172.21.15.53:0/2328933612 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4fa4005180 0x7f4fb80c3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:20.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:20.930+0000 7f4fb6ffd640 1 -- 172.21.15.53:0/2328933612 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4fb815b180 msgr2=0x7f4fb80b2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:20.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:20.930+0000 7f4fb6ffd640 1 --2- 172.21.15.53:0/2328933612 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4fb815b180 0x7f4fb80b2fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:20.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:20.930+0000 7f4fb6ffd640 1 -- 172.21.15.53:0/2328933612 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fb80c30f0 con 0x7f4fb815ad30 2023-06-10T18:57:20.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:20.930+0000 7f4fb6ffd640 1 --2- 172.21.15.53:0/2328933612 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4fb815ad30 0x7f4fb815d4a0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f4fa8011600 tx=0x7f4fa8011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:20.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:20.930+0000 7f4faffff640 1 -- 172.21.15.53:0/2328933612 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa8004220 con 0x7f4fb815ad30 2023-06-10T18:57:20.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:20.930+0000 7f4faffff640 1 -- 172.21.15.53:0/2328933612 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fa8004380 con 0x7f4fb815ad30 2023-06-10T18:57:20.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:20.930+0000 7f4fbe0bb640 1 -- 172.21.15.53:0/2328933612 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fb80c33d0 con 0x7f4fb815ad30 2023-06-10T18:57:20.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:20.930+0000 7f4faffff640 1 -- 172.21.15.53:0/2328933612 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa800f960 con 0x7f4fb815ad30 2023-06-10T18:57:20.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:20.930+0000 7f4fbe0bb640 1 -- 172.21.15.53:0/2328933612 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fb80c2820 con 0x7f4fb815ad30 2023-06-10T18:57:20.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:20.930+0000 7f4fbe0bb640 1 -- 172.21.15.53:0/2328933612 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fb804d790 con 0x7f4fb815ad30 2023-06-10T18:57:20.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:20.930+0000 7f4faffff640 1 -- 172.21.15.53:0/2328933612 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4fa800fac0 con 0x7f4fb815ad30 2023-06-10T18:57:20.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:20.930+0000 7f4faffff640 1 --2- 172.21.15.53:0/2328933612 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4f980662b0 0x7f4f98068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:20.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:20.930+0000 7f4faffff640 1 -- 172.21.15.53:0/2328933612 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4fa8083f50 con 0x7f4fb815ad30 2023-06-10T18:57:20.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:20.930+0000 7f4fb77fe640 1 --2- 172.21.15.53:0/2328933612 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4f980662b0 0x7f4f98068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:20.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:20.934+0000 7f4fb77fe640 1 --2- 172.21.15.53:0/2328933612 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4f980662b0 0x7f4f98068760 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f4fb8071d80 tx=0x7f4fa0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:20.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:20.934+0000 7f4faffff640 1 -- 172.21.15.53:0/2328933612 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4fa8051460 con 0x7f4fb815ad30 2023-06-10T18:57:21.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.086+0000 7f4fbe0bb640 1 -- 172.21.15.53:0/2328933612 --> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4fb8070b40 con 0x7f4f980662b0 2023-06-10T18:57:21.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.110+0000 7f4faffff640 1 -- 172.21.15.53:0/2328933612 <== mgr.4105 v2:172.21.15.117:6832/3061986771 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+309206 (secure 0 0 0) 0x7f4fa00124f0 con 0x7f4f980662b0 2023-06-10T18:57:21.118 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:57:21.119 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-06-10T18:57:21.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.114+0000 7f4fbe0bb640 1 -- 172.21.15.53:0/2328933612 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4f980662b0 msgr2=0x7f4f98068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:21.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.114+0000 7f4fbe0bb640 1 --2- 172.21.15.53:0/2328933612 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4f980662b0 0x7f4f98068760 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f4fb8071d80 tx=0x7f4fa0008040 comp rx=0 tx=0).stop 2023-06-10T18:57:21.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.114+0000 7f4fbe0bb640 1 -- 172.21.15.53:0/2328933612 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4fb815ad30 msgr2=0x7f4fb815d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:21.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.114+0000 7f4fbe0bb640 1 --2- 172.21.15.53:0/2328933612 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4fb815ad30 0x7f4fb815d4a0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f4fa8011600 tx=0x7f4fa8011ac0 comp rx=0 tx=0).stop 2023-06-10T18:57:21.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.114+0000 7f4fbe0bb640 1 -- 172.21.15.53:0/2328933612 shutdown_connections 2023-06-10T18:57:21.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.114+0000 7f4fbe0bb640 1 --2- 172.21.15.53:0/2328933612 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4f980662b0 0x7f4f98068760 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:21.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.114+0000 7f4fbe0bb640 1 --2- 172.21.15.53:0/2328933612 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4fb815b180 0x7f4fb80b2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:21.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.114+0000 7f4fbe0bb640 1 --2- 172.21.15.53:0/2328933612 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4fb815ad30 0x7f4fb815d4a0 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:21.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.114+0000 7f4fbe0bb640 1 --2- 172.21.15.53:0/2328933612 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4fa4005180 0x7f4fb80c3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:21.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.114+0000 7f4fbe0bb640 1 -- 172.21.15.53:0/2328933612 >> 172.21.15.53:0/2328933612 conn(0x7f4fb806a0d0 msgr2=0x7f4fb80c8be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:21.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.114+0000 7f4fbe0bb640 1 -- 172.21.15.53:0/2328933612 shutdown_connections 2023-06-10T18:57:21.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.114+0000 7f4fbe0bb640 1 -- 172.21.15.53:0/2328933612 wait complete. 2023-06-10T18:57:21.138 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":202,"stamp":"2023-06-10T18:57:19.660512+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":207,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":243420,"kb_used_data":7324,"kb_used_omap":0,"kb_used_meta":236032,"kb_avail":754731300,"statfs":{"total":773094113280,"available":772844851200,"internally_reserved":0,"allocated":7499776,"data_stored":3955947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":241696768},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":60,"apply_latency_ms":60,"commit_latency_ns":60000000,"apply_latency_ns":60000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.807293"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.933452+0000","last_change":"2023-06-10T18:57:13.278051+0000","last_active":"2023-06-10T18:57:14.933452+0000","last_peered":"2023-06-10T18:57:14.933452+0000","last_clean":"2023-06-10T18:57:14.933452+0000","last_became_active":"2023-06-10T18:57:13.277771+0000","last_became_peered":"2023-06-10T18:57:13.277771+0000","last_unstale":"2023-06-10T18:57:14.933452+0000","last_undegraded":"2023-06-10T18:57:14.933452+0000","last_fullsized":"2023-06-10T18:57:14.933452+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:11:32.262466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.932566+0000","last_change":"2023-06-10T18:57:13.261112+0000","last_active":"2023-06-10T18:57:14.932566+0000","last_peered":"2023-06-10T18:57:14.932566+0000","last_clean":"2023-06-10T18:57:14.932566+0000","last_became_active":"2023-06-10T18:57:13.260798+0000","last_became_peered":"2023-06-10T18:57:13.260798+0000","last_unstale":"2023-06-10T18:57:14.932566+0000","last_undegraded":"2023-06-10T18:57:14.932566+0000","last_fullsized":"2023-06-10T18:57:14.932566+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:04:24.808506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.930890+0000","last_change":"2023-06-10T18:57:13.302793+0000","last_active":"2023-06-10T18:57:14.930890+0000","last_peered":"2023-06-10T18:57:14.930890+0000","last_clean":"2023-06-10T18:57:14.930890+0000","last_became_active":"2023-06-10T18:57:13.302292+0000","last_became_peered":"2023-06-10T18:57:13.302292+0000","last_unstale":"2023-06-10T18:57:14.930890+0000","last_undegraded":"2023-06-10T18:57:14.930890+0000","last_fullsized":"2023-06-10T18:57:14.930890+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:31:12.523092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.258225+0000","last_change":"2023-06-10T18:57:13.264864+0000","last_active":"2023-06-10T18:57:14.258225+0000","last_peered":"2023-06-10T18:57:14.258225+0000","last_clean":"2023-06-10T18:57:14.258225+0000","last_became_active":"2023-06-10T18:57:13.264053+0000","last_became_peered":"2023-06-10T18:57:13.264053+0000","last_unstale":"2023-06-10T18:57:14.258225+0000","last_undegraded":"2023-06-10T18:57:14.258225+0000","last_fullsized":"2023-06-10T18:57:14.258225+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:32:32.565830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.525789+0000","last_change":"2023-06-10T18:57:13.290607+0000","last_active":"2023-06-10T18:57:14.525789+0000","last_peered":"2023-06-10T18:57:14.525789+0000","last_clean":"2023-06-10T18:57:14.525789+0000","last_became_active":"2023-06-10T18:57:13.290080+0000","last_became_peered":"2023-06-10T18:57:13.290080+0000","last_unstale":"2023-06-10T18:57:14.525789+0000","last_undegraded":"2023-06-10T18:57:14.525789+0000","last_fullsized":"2023-06-10T18:57:14.525789+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:56:01.364135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.254455+0000","last_change":"2023-06-10T18:57:13.303419+0000","last_active":"2023-06-10T18:57:14.254455+0000","last_peered":"2023-06-10T18:57:14.254455+0000","last_clean":"2023-06-10T18:57:14.254455+0000","last_became_active":"2023-06-10T18:57:13.303159+0000","last_became_peered":"2023-06-10T18:57:13.303159+0000","last_unstale":"2023-06-10T18:57:14.254455+0000","last_undegraded":"2023-06-10T18:57:14.254455+0000","last_fullsized":"2023-06-10T18:57:14.254455+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:17:07.552044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.428307+0000","last_change":"2023-06-10T18:57:13.302161+0000","last_active":"2023-06-10T18:57:14.428307+0000","last_peered":"2023-06-10T18:57:14.428307+0000","last_clean":"2023-06-10T18:57:14.428307+0000","last_became_active":"2023-06-10T18:57:13.301885+0000","last_became_peered":"2023-06-10T18:57:13.301885+0000","last_unstale":"2023-06-10T18:57:14.428307+0000","last_undegraded":"2023-06-10T18:57:14.428307+0000","last_fullsized":"2023-06-10T18:57:14.428307+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:37:43.312076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.256541+0000","last_change":"2023-06-10T18:57:13.306439+0000","last_active":"2023-06-10T18:57:14.256541+0000","last_peered":"2023-06-10T18:57:14.256541+0000","last_clean":"2023-06-10T18:57:14.256541+0000","last_became_active":"2023-06-10T18:57:13.305973+0000","last_became_peered":"2023-06-10T18:57:13.305973+0000","last_unstale":"2023-06-10T18:57:14.256541+0000","last_undegraded":"2023-06-10T18:57:14.256541+0000","last_fullsized":"2023-06-10T18:57:14.256541+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:20:12.151730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.931903+0000","last_change":"2023-06-10T18:57:13.302706+0000","last_active":"2023-06-10T18:57:14.931903+0000","last_peered":"2023-06-10T18:57:14.931903+0000","last_clean":"2023-06-10T18:57:14.931903+0000","last_became_active":"2023-06-10T18:57:13.302238+0000","last_became_peered":"2023-06-10T18:57:13.302238+0000","last_unstale":"2023-06-10T18:57:14.931903+0000","last_undegraded":"2023-06-10T18:57:14.931903+0000","last_fullsized":"2023-06-10T18:57:14.931903+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:23:38.131145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.931280+0000","last_change":"2023-06-10T18:57:13.302805+0000","last_active":"2023-06-10T18:57:14.931280+0000","last_peered":"2023-06-10T18:57:14.931280+0000","last_clean":"2023-06-10T18:57:14.931280+0000","last_became_active":"2023-06-10T18:57:13.302333+0000","last_became_peered":"2023-06-10T18:57:13.302333+0000","last_unstale":"2023-06-10T18:57:14.931280+0000","last_undegraded":"2023-06-10T18:57:14.931280+0000","last_fullsized":"2023-06-10T18:57:14.931280+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:27:56.500157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.256956+0000","last_change":"2023-06-10T18:57:13.271316+0000","last_active":"2023-06-10T18:57:14.256956+0000","last_peered":"2023-06-10T18:57:14.256956+0000","last_clean":"2023-06-10T18:57:14.256956+0000","last_became_active":"2023-06-10T18:57:13.270760+0000","last_became_peered":"2023-06-10T18:57:13.270760+0000","last_unstale":"2023-06-10T18:57:14.256956+0000","last_undegraded":"2023-06-10T18:57:14.256956+0000","last_fullsized":"2023-06-10T18:57:14.256956+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:27:56.045659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.259150+0000","last_change":"2023-06-10T18:57:13.306777+0000","last_active":"2023-06-10T18:57:14.259150+0000","last_peered":"2023-06-10T18:57:14.259150+0000","last_clean":"2023-06-10T18:57:14.259150+0000","last_became_active":"2023-06-10T18:57:13.306199+0000","last_became_peered":"2023-06-10T18:57:13.306199+0000","last_unstale":"2023-06-10T18:57:14.259150+0000","last_undegraded":"2023-06-10T18:57:14.259150+0000","last_fullsized":"2023-06-10T18:57:14.259150+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:23:35.468930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.259112+0000","last_change":"2023-06-10T18:57:13.283978+0000","last_active":"2023-06-10T18:57:14.259112+0000","last_peered":"2023-06-10T18:57:14.259112+0000","last_clean":"2023-06-10T18:57:14.259112+0000","last_became_active":"2023-06-10T18:57:13.279402+0000","last_became_peered":"2023-06-10T18:57:13.279402+0000","last_unstale":"2023-06-10T18:57:14.259112+0000","last_undegraded":"2023-06-10T18:57:14.259112+0000","last_fullsized":"2023-06-10T18:57:14.259112+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:07:36.811657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.931252+0000","last_change":"2023-06-10T18:57:13.304779+0000","last_active":"2023-06-10T18:57:14.931252+0000","last_peered":"2023-06-10T18:57:14.931252+0000","last_clean":"2023-06-10T18:57:14.931252+0000","last_became_active":"2023-06-10T18:57:13.304282+0000","last_became_peered":"2023-06-10T18:57:13.304282+0000","last_unstale":"2023-06-10T18:57:14.931252+0000","last_undegraded":"2023-06-10T18:57:14.931252+0000","last_fullsized":"2023-06-10T18:57:14.931252+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:13:18.646310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.931199+0000","last_change":"2023-06-10T18:57:13.308071+0000","last_active":"2023-06-10T18:57:14.931199+0000","last_peered":"2023-06-10T18:57:14.931199+0000","last_clean":"2023-06-10T18:57:14.931199+0000","last_became_active":"2023-06-10T18:57:13.307631+0000","last_became_peered":"2023-06-10T18:57:13.307631+0000","last_unstale":"2023-06-10T18:57:14.931199+0000","last_undegraded":"2023-06-10T18:57:14.931199+0000","last_fullsized":"2023-06-10T18:57:14.931199+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:23:41.231797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.428530+0000","last_change":"2023-06-10T18:57:13.270900+0000","last_active":"2023-06-10T18:57:14.428530+0000","last_peered":"2023-06-10T18:57:14.428530+0000","last_clean":"2023-06-10T18:57:14.428530+0000","last_became_active":"2023-06-10T18:57:13.270589+0000","last_became_peered":"2023-06-10T18:57:13.270589+0000","last_unstale":"2023-06-10T18:57:14.428530+0000","last_undegraded":"2023-06-10T18:57:14.428530+0000","last_fullsized":"2023-06-10T18:57:14.428530+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:15:18.216952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.933634+0000","last_change":"2023-06-10T18:57:13.284023+0000","last_active":"2023-06-10T18:57:14.933634+0000","last_peered":"2023-06-10T18:57:14.933634+0000","last_clean":"2023-06-10T18:57:14.933634+0000","last_became_active":"2023-06-10T18:57:13.283702+0000","last_became_peered":"2023-06-10T18:57:13.283702+0000","last_unstale":"2023-06-10T18:57:14.933634+0000","last_undegraded":"2023-06-10T18:57:14.933634+0000","last_fullsized":"2023-06-10T18:57:14.933634+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:49:10.083059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.257442+0000","last_change":"2023-06-10T18:57:13.266645+0000","last_active":"2023-06-10T18:57:14.257442+0000","last_peered":"2023-06-10T18:57:14.257442+0000","last_clean":"2023-06-10T18:57:14.257442+0000","last_became_active":"2023-06-10T18:57:13.265777+0000","last_became_peered":"2023-06-10T18:57:13.265777+0000","last_unstale":"2023-06-10T18:57:14.257442+0000","last_undegraded":"2023-06-10T18:57:14.257442+0000","last_fullsized":"2023-06-10T18:57:14.257442+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:15:04.375077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.526115+0000","last_change":"2023-06-10T18:57:13.293678+0000","last_active":"2023-06-10T18:57:14.526115+0000","last_peered":"2023-06-10T18:57:14.526115+0000","last_clean":"2023-06-10T18:57:14.526115+0000","last_became_active":"2023-06-10T18:57:13.292900+0000","last_became_peered":"2023-06-10T18:57:13.292900+0000","last_unstale":"2023-06-10T18:57:14.526115+0000","last_undegraded":"2023-06-10T18:57:14.526115+0000","last_fullsized":"2023-06-10T18:57:14.526115+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:33:25.949638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.932708+0000","last_change":"2023-06-10T18:57:13.293251+0000","last_active":"2023-06-10T18:57:14.932708+0000","last_peered":"2023-06-10T18:57:14.932708+0000","last_clean":"2023-06-10T18:57:14.932708+0000","last_became_active":"2023-06-10T18:57:13.292981+0000","last_became_peered":"2023-06-10T18:57:13.292981+0000","last_unstale":"2023-06-10T18:57:14.932708+0000","last_undegraded":"2023-06-10T18:57:14.932708+0000","last_fullsized":"2023-06-10T18:57:14.932708+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:46:12.638932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.259304+0000","last_change":"2023-06-10T18:57:13.260785+0000","last_active":"2023-06-10T18:57:14.259304+0000","last_peered":"2023-06-10T18:57:14.259304+0000","last_clean":"2023-06-10T18:57:14.259304+0000","last_became_active":"2023-06-10T18:57:13.260401+0000","last_became_peered":"2023-06-10T18:57:13.260401+0000","last_unstale":"2023-06-10T18:57:14.259304+0000","last_undegraded":"2023-06-10T18:57:14.259304+0000","last_fullsized":"2023-06-10T18:57:14.259304+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:36:49.054784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.931139+0000","last_change":"2023-06-10T18:57:13.305964+0000","last_active":"2023-06-10T18:57:14.931139+0000","last_peered":"2023-06-10T18:57:14.931139+0000","last_clean":"2023-06-10T18:57:14.931139+0000","last_became_active":"2023-06-10T18:57:13.305612+0000","last_became_peered":"2023-06-10T18:57:13.305612+0000","last_unstale":"2023-06-10T18:57:14.931139+0000","last_undegraded":"2023-06-10T18:57:14.931139+0000","last_fullsized":"2023-06-10T18:57:14.931139+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:14:28.319502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.931006+0000","last_change":"2023-06-10T18:57:13.308981+0000","last_active":"2023-06-10T18:57:14.931006+0000","last_peered":"2023-06-10T18:57:14.931006+0000","last_clean":"2023-06-10T18:57:14.931006+0000","last_became_active":"2023-06-10T18:57:13.308775+0000","last_became_peered":"2023-06-10T18:57:13.308775+0000","last_unstale":"2023-06-10T18:57:14.931006+0000","last_undegraded":"2023-06-10T18:57:14.931006+0000","last_fullsized":"2023-06-10T18:57:14.931006+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:10:36.804829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.930561+0000","last_change":"2023-06-10T18:57:13.304069+0000","last_active":"2023-06-10T18:57:14.930561+0000","last_peered":"2023-06-10T18:57:14.930561+0000","last_clean":"2023-06-10T18:57:14.930561+0000","last_became_active":"2023-06-10T18:57:13.303550+0000","last_became_peered":"2023-06-10T18:57:13.303550+0000","last_unstale":"2023-06-10T18:57:14.930561+0000","last_undegraded":"2023-06-10T18:57:14.930561+0000","last_fullsized":"2023-06-10T18:57:14.930561+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:09:13.320949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.259429+0000","last_change":"2023-06-10T18:57:13.276616+0000","last_active":"2023-06-10T18:57:14.259429+0000","last_peered":"2023-06-10T18:57:14.259429+0000","last_clean":"2023-06-10T18:57:14.259429+0000","last_became_active":"2023-06-10T18:57:13.275794+0000","last_became_peered":"2023-06-10T18:57:13.275794+0000","last_unstale":"2023-06-10T18:57:14.259429+0000","last_undegraded":"2023-06-10T18:57:14.259429+0000","last_fullsized":"2023-06-10T18:57:14.259429+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:54:04.527705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.259336+0000","last_change":"2023-06-10T18:57:13.276773+0000","last_active":"2023-06-10T18:57:14.259336+0000","last_peered":"2023-06-10T18:57:14.259336+0000","last_clean":"2023-06-10T18:57:14.259336+0000","last_became_active":"2023-06-10T18:57:13.271488+0000","last_became_peered":"2023-06-10T18:57:13.271488+0000","last_unstale":"2023-06-10T18:57:14.259336+0000","last_undegraded":"2023-06-10T18:57:14.259336+0000","last_fullsized":"2023-06-10T18:57:14.259336+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:21:00.769885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.257698+0000","last_change":"2023-06-10T18:57:13.264289+0000","last_active":"2023-06-10T18:57:14.257698+0000","last_peered":"2023-06-10T18:57:14.257698+0000","last_clean":"2023-06-10T18:57:14.257698+0000","last_became_active":"2023-06-10T18:57:13.263483+0000","last_became_peered":"2023-06-10T18:57:13.263483+0000","last_unstale":"2023-06-10T18:57:14.257698+0000","last_undegraded":"2023-06-10T18:57:14.257698+0000","last_fullsized":"2023-06-10T18:57:14.257698+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:11:40.265194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.932095+0000","last_change":"2023-06-10T18:57:13.293553+0000","last_active":"2023-06-10T18:57:14.932095+0000","last_peered":"2023-06-10T18:57:14.932095+0000","last_clean":"2023-06-10T18:57:14.932095+0000","last_became_active":"2023-06-10T18:57:13.293120+0000","last_became_peered":"2023-06-10T18:57:13.293120+0000","last_unstale":"2023-06-10T18:57:14.932095+0000","last_undegraded":"2023-06-10T18:57:14.932095+0000","last_fullsized":"2023-06-10T18:57:14.932095+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:12:20.350661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.931125+0000","last_change":"2023-06-10T18:57:13.303656+0000","last_active":"2023-06-10T18:57:14.931125+0000","last_peered":"2023-06-10T18:57:14.931125+0000","last_clean":"2023-06-10T18:57:14.931125+0000","last_became_active":"2023-06-10T18:57:13.303200+0000","last_became_peered":"2023-06-10T18:57:13.303200+0000","last_unstale":"2023-06-10T18:57:14.931125+0000","last_undegraded":"2023-06-10T18:57:14.931125+0000","last_fullsized":"2023-06-10T18:57:14.931125+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:25:29.323185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.256400+0000","last_change":"2023-06-10T18:57:13.301288+0000","last_active":"2023-06-10T18:57:14.256400+0000","last_peered":"2023-06-10T18:57:14.256400+0000","last_clean":"2023-06-10T18:57:14.256400+0000","last_became_active":"2023-06-10T18:57:13.300810+0000","last_became_peered":"2023-06-10T18:57:13.300810+0000","last_unstale":"2023-06-10T18:57:14.256400+0000","last_undegraded":"2023-06-10T18:57:14.256400+0000","last_fullsized":"2023-06-10T18:57:14.256400+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:58:08.876809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.256349+0000","last_change":"2023-06-10T18:57:13.264140+0000","last_active":"2023-06-10T18:57:14.256349+0000","last_peered":"2023-06-10T18:57:14.256349+0000","last_clean":"2023-06-10T18:57:14.256349+0000","last_became_active":"2023-06-10T18:57:13.263391+0000","last_became_peered":"2023-06-10T18:57:13.263391+0000","last_unstale":"2023-06-10T18:57:14.256349+0000","last_undegraded":"2023-06-10T18:57:14.256349+0000","last_fullsized":"2023-06-10T18:57:14.256349+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:14:37.779531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.254016+0000","last_change":"2023-06-10T18:57:13.264481+0000","last_active":"2023-06-10T18:57:14.254016+0000","last_peered":"2023-06-10T18:57:14.254016+0000","last_clean":"2023-06-10T18:57:14.254016+0000","last_became_active":"2023-06-10T18:57:13.263901+0000","last_became_peered":"2023-06-10T18:57:13.263901+0000","last_unstale":"2023-06-10T18:57:14.254016+0000","last_undegraded":"2023-06-10T18:57:14.254016+0000","last_fullsized":"2023-06-10T18:57:14.254016+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:00:05.985666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.526019+0000","last_change":"2023-06-10T18:57:13.291422+0000","last_active":"2023-06-10T18:57:14.526019+0000","last_peered":"2023-06-10T18:57:14.526019+0000","last_clean":"2023-06-10T18:57:14.526019+0000","last_became_active":"2023-06-10T18:57:13.290699+0000","last_became_peered":"2023-06-10T18:57:13.290699+0000","last_unstale":"2023-06-10T18:57:14.526019+0000","last_undegraded":"2023-06-10T18:57:14.526019+0000","last_fullsized":"2023-06-10T18:57:14.526019+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:35:37.322933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"64'4","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.933693+0000","last_change":"2023-06-10T18:57:12.893921+0000","last_active":"2023-06-10T18:57:14.933693+0000","last_peered":"2023-06-10T18:57:14.933693+0000","last_clean":"2023-06-10T18:57:14.933693+0000","last_became_active":"2023-06-10T18:57:12.893212+0000","last_became_peered":"2023-06-10T18:57:12.893212+0000","last_unstale":"2023-06-10T18:57:14.933693+0000","last_undegraded":"2023-06-10T18:57:14.933693+0000","last_fullsized":"2023-06-10T18:57:14.933693+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:10:11.278359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.257374+0000","last_change":"2023-06-10T18:57:13.295085+0000","last_active":"2023-06-10T18:57:14.257374+0000","last_peered":"2023-06-10T18:57:14.257374+0000","last_clean":"2023-06-10T18:57:14.257374+0000","last_became_active":"2023-06-10T18:57:13.294187+0000","last_became_peered":"2023-06-10T18:57:13.294187+0000","last_unstale":"2023-06-10T18:57:14.257374+0000","last_undegraded":"2023-06-10T18:57:14.257374+0000","last_fullsized":"2023-06-10T18:57:14.257374+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:23:02.874276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"64'1","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.254783+0000","last_change":"2023-06-10T18:57:12.877228+0000","last_active":"2023-06-10T18:57:14.254783+0000","last_peered":"2023-06-10T18:57:14.254783+0000","last_clean":"2023-06-10T18:57:14.254783+0000","last_became_active":"2023-06-10T18:57:12.876876+0000","last_became_peered":"2023-06-10T18:57:12.876876+0000","last_unstale":"2023-06-10T18:57:14.254783+0000","last_undegraded":"2023-06-10T18:57:14.254783+0000","last_fullsized":"2023-06-10T18:57:14.254783+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:29:55.585262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.254719+0000","last_change":"2023-06-10T18:57:13.259304+0000","last_active":"2023-06-10T18:57:14.254719+0000","last_peered":"2023-06-10T18:57:14.254719+0000","last_clean":"2023-06-10T18:57:14.254719+0000","last_became_active":"2023-06-10T18:57:13.255417+0000","last_became_peered":"2023-06-10T18:57:13.255417+0000","last_unstale":"2023-06-10T18:57:14.254719+0000","last_undegraded":"2023-06-10T18:57:14.254719+0000","last_fullsized":"2023-06-10T18:57:14.254719+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:12:20.350661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"64'2","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.254626+0000","last_change":"2023-06-10T18:57:12.902028+0000","last_active":"2023-06-10T18:57:14.254626+0000","last_peered":"2023-06-10T18:57:14.254626+0000","last_clean":"2023-06-10T18:57:14.254626+0000","last_became_active":"2023-06-10T18:57:12.901767+0000","last_became_peered":"2023-06-10T18:57:12.901767+0000","last_unstale":"2023-06-10T18:57:14.254626+0000","last_undegraded":"2023-06-10T18:57:14.254626+0000","last_fullsized":"2023-06-10T18:57:14.254626+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:46:01.209420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.931656+0000","last_change":"2023-06-10T18:57:13.304760+0000","last_active":"2023-06-10T18:57:14.931656+0000","last_peered":"2023-06-10T18:57:14.931656+0000","last_clean":"2023-06-10T18:57:14.931656+0000","last_became_active":"2023-06-10T18:57:13.304261+0000","last_became_peered":"2023-06-10T18:57:13.304261+0000","last_unstale":"2023-06-10T18:57:14.931656+0000","last_undegraded":"2023-06-10T18:57:14.931656+0000","last_fullsized":"2023-06-10T18:57:14.931656+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:06:06.959841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"64'2","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.254507+0000","last_change":"2023-06-10T18:57:12.885066+0000","last_active":"2023-06-10T18:57:14.254507+0000","last_peered":"2023-06-10T18:57:14.254507+0000","last_clean":"2023-06-10T18:57:14.254507+0000","last_became_active":"2023-06-10T18:57:12.884678+0000","last_became_peered":"2023-06-10T18:57:12.884678+0000","last_unstale":"2023-06-10T18:57:14.254507+0000","last_undegraded":"2023-06-10T18:57:14.254507+0000","last_fullsized":"2023-06-10T18:57:14.254507+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:36:08.850060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.428348+0000","last_change":"2023-06-10T18:57:13.262250+0000","last_active":"2023-06-10T18:57:14.428348+0000","last_peered":"2023-06-10T18:57:14.428348+0000","last_clean":"2023-06-10T18:57:14.428348+0000","last_became_active":"2023-06-10T18:57:13.261948+0000","last_became_peered":"2023-06-10T18:57:13.261948+0000","last_unstale":"2023-06-10T18:57:14.428348+0000","last_undegraded":"2023-06-10T18:57:14.428348+0000","last_fullsized":"2023-06-10T18:57:14.428348+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:06:48.956658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"64'1","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.932855+0000","last_change":"2023-06-10T18:57:12.878370+0000","last_active":"2023-06-10T18:57:14.932855+0000","last_peered":"2023-06-10T18:57:14.932855+0000","last_clean":"2023-06-10T18:57:14.932855+0000","last_became_active":"2023-06-10T18:57:12.878087+0000","last_became_peered":"2023-06-10T18:57:12.878087+0000","last_unstale":"2023-06-10T18:57:14.932855+0000","last_undegraded":"2023-06-10T18:57:14.932855+0000","last_fullsized":"2023-06-10T18:57:14.932855+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:17:06.548343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.931421+0000","last_change":"2023-06-10T18:57:13.283934+0000","last_active":"2023-06-10T18:57:14.931421+0000","last_peered":"2023-06-10T18:57:14.931421+0000","last_clean":"2023-06-10T18:57:14.931421+0000","last_became_active":"2023-06-10T18:57:13.283624+0000","last_became_peered":"2023-06-10T18:57:13.283624+0000","last_unstale":"2023-06-10T18:57:14.931421+0000","last_undegraded":"2023-06-10T18:57:14.931421+0000","last_fullsized":"2023-06-10T18:57:14.931421+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:36:09.853761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"64'1","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.931439+0000","last_change":"2023-06-10T18:57:12.877474+0000","last_active":"2023-06-10T18:57:14.931439+0000","last_peered":"2023-06-10T18:57:14.931439+0000","last_clean":"2023-06-10T18:57:14.931439+0000","last_became_active":"2023-06-10T18:57:12.877038+0000","last_became_peered":"2023-06-10T18:57:12.877038+0000","last_unstale":"2023-06-10T18:57:14.931439+0000","last_undegraded":"2023-06-10T18:57:14.931439+0000","last_fullsized":"2023-06-10T18:57:14.931439+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:37:56.895566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.525684+0000","last_change":"2023-06-10T18:57:13.295004+0000","last_active":"2023-06-10T18:57:14.525684+0000","last_peered":"2023-06-10T18:57:14.525684+0000","last_clean":"2023-06-10T18:57:14.525684+0000","last_became_active":"2023-06-10T18:57:13.292895+0000","last_became_peered":"2023-06-10T18:57:13.292895+0000","last_unstale":"2023-06-10T18:57:14.525684+0000","last_undegraded":"2023-06-10T18:57:14.525684+0000","last_fullsized":"2023-06-10T18:57:14.525684+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:07:33.212842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.931257+0000","last_change":"2023-06-10T18:57:12.906166+0000","last_active":"2023-06-10T18:57:14.931257+0000","last_peered":"2023-06-10T18:57:14.931257+0000","last_clean":"2023-06-10T18:57:14.931257+0000","last_became_active":"2023-06-10T18:57:12.905372+0000","last_became_peered":"2023-06-10T18:57:12.905372+0000","last_unstale":"2023-06-10T18:57:14.931257+0000","last_undegraded":"2023-06-10T18:57:14.931257+0000","last_fullsized":"2023-06-10T18:57:14.931257+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:12:54.670196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.933545+0000","last_change":"2023-06-10T18:57:13.268932+0000","last_active":"2023-06-10T18:57:14.933545+0000","last_peered":"2023-06-10T18:57:14.933545+0000","last_clean":"2023-06-10T18:57:14.933545+0000","last_became_active":"2023-06-10T18:57:13.268693+0000","last_became_peered":"2023-06-10T18:57:13.268693+0000","last_unstale":"2023-06-10T18:57:14.933545+0000","last_undegraded":"2023-06-10T18:57:14.933545+0000","last_fullsized":"2023-06-10T18:57:14.933545+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:12:20.350661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.525458+0000","last_change":"2023-06-10T18:57:12.896449+0000","last_active":"2023-06-10T18:57:14.525458+0000","last_peered":"2023-06-10T18:57:14.525458+0000","last_clean":"2023-06-10T18:57:14.525458+0000","last_became_active":"2023-06-10T18:57:12.895644+0000","last_became_peered":"2023-06-10T18:57:12.895644+0000","last_unstale":"2023-06-10T18:57:14.525458+0000","last_undegraded":"2023-06-10T18:57:14.525458+0000","last_fullsized":"2023-06-10T18:57:14.525458+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:35:10.385306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.932252+0000","last_change":"2023-06-10T18:57:13.265935+0000","last_active":"2023-06-10T18:57:14.932252+0000","last_peered":"2023-06-10T18:57:14.932252+0000","last_clean":"2023-06-10T18:57:14.932252+0000","last_became_active":"2023-06-10T18:57:13.265687+0000","last_became_peered":"2023-06-10T18:57:13.265687+0000","last_unstale":"2023-06-10T18:57:14.932252+0000","last_undegraded":"2023-06-10T18:57:14.932252+0000","last_fullsized":"2023-06-10T18:57:14.932252+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:13:45.391733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.931887+0000","last_change":"2023-06-10T18:57:12.892531+0000","last_active":"2023-06-10T18:57:14.931887+0000","last_peered":"2023-06-10T18:57:14.931887+0000","last_clean":"2023-06-10T18:57:14.931887+0000","last_became_active":"2023-06-10T18:57:12.891758+0000","last_became_peered":"2023-06-10T18:57:12.891758+0000","last_unstale":"2023-06-10T18:57:14.931887+0000","last_undegraded":"2023-06-10T18:57:14.931887+0000","last_fullsized":"2023-06-10T18:57:14.931887+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:50:03.962948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.932995+0000","last_change":"2023-06-10T18:57:13.272204+0000","last_active":"2023-06-10T18:57:14.932995+0000","last_peered":"2023-06-10T18:57:14.932995+0000","last_clean":"2023-06-10T18:57:14.932995+0000","last_became_active":"2023-06-10T18:57:13.271878+0000","last_became_peered":"2023-06-10T18:57:13.271878+0000","last_unstale":"2023-06-10T18:57:14.932995+0000","last_undegraded":"2023-06-10T18:57:14.932995+0000","last_fullsized":"2023-06-10T18:57:14.932995+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:36:09.853761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.257601+0000","last_change":"2023-06-10T18:57:12.885188+0000","last_active":"2023-06-10T18:57:14.257601+0000","last_peered":"2023-06-10T18:57:14.257601+0000","last_clean":"2023-06-10T18:57:14.257601+0000","last_became_active":"2023-06-10T18:57:12.884455+0000","last_became_peered":"2023-06-10T18:57:12.884455+0000","last_unstale":"2023-06-10T18:57:14.257601+0000","last_undegraded":"2023-06-10T18:57:14.257601+0000","last_fullsized":"2023-06-10T18:57:14.257601+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:48:55.365352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.526502+0000","last_change":"2023-06-10T18:57:13.291570+0000","last_active":"2023-06-10T18:57:14.526502+0000","last_peered":"2023-06-10T18:57:14.526502+0000","last_clean":"2023-06-10T18:57:14.526502+0000","last_became_active":"2023-06-10T18:57:13.290200+0000","last_became_peered":"2023-06-10T18:57:13.290200+0000","last_unstale":"2023-06-10T18:57:14.526502+0000","last_undegraded":"2023-06-10T18:57:14.526502+0000","last_fullsized":"2023-06-10T18:57:14.526502+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:49:43.926660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"64'3","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.931183+0000","last_change":"2023-06-10T18:57:12.892912+0000","last_active":"2023-06-10T18:57:14.931183+0000","last_peered":"2023-06-10T18:57:14.931183+0000","last_clean":"2023-06-10T18:57:14.931183+0000","last_became_active":"2023-06-10T18:57:12.891491+0000","last_became_peered":"2023-06-10T18:57:12.891491+0000","last_unstale":"2023-06-10T18:57:14.931183+0000","last_undegraded":"2023-06-10T18:57:14.931183+0000","last_fullsized":"2023-06-10T18:57:14.931183+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:02:06.216392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.258041+0000","last_change":"2023-06-10T18:57:13.278609+0000","last_active":"2023-06-10T18:57:14.258041+0000","last_peered":"2023-06-10T18:57:14.258041+0000","last_clean":"2023-06-10T18:57:14.258041+0000","last_became_active":"2023-06-10T18:57:13.277767+0000","last_became_peered":"2023-06-10T18:57:13.277767+0000","last_unstale":"2023-06-10T18:57:14.258041+0000","last_undegraded":"2023-06-10T18:57:14.258041+0000","last_fullsized":"2023-06-10T18:57:14.258041+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:40:50.862809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"64'6","reported_seq":19,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.932534+0000","last_change":"2023-06-10T18:57:12.893600+0000","last_active":"2023-06-10T18:57:14.932534+0000","last_peered":"2023-06-10T18:57:14.932534+0000","last_clean":"2023-06-10T18:57:14.932534+0000","last_became_active":"2023-06-10T18:57:12.893280+0000","last_became_peered":"2023-06-10T18:57:12.893280+0000","last_unstale":"2023-06-10T18:57:14.932534+0000","last_undegraded":"2023-06-10T18:57:14.932534+0000","last_fullsized":"2023-06-10T18:57:14.932534+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:05:22.219760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.255491+0000","last_change":"2023-06-10T18:57:13.302334+0000","last_active":"2023-06-10T18:57:14.255491+0000","last_peered":"2023-06-10T18:57:14.255491+0000","last_clean":"2023-06-10T18:57:14.255491+0000","last_became_active":"2023-06-10T18:57:13.300953+0000","last_became_peered":"2023-06-10T18:57:13.300953+0000","last_unstale":"2023-06-10T18:57:14.255491+0000","last_undegraded":"2023-06-10T18:57:14.255491+0000","last_fullsized":"2023-06-10T18:57:14.255491+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:49:43.926660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"64'2","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.931703+0000","last_change":"2023-06-10T18:57:12.905702+0000","last_active":"2023-06-10T18:57:14.931703+0000","last_peered":"2023-06-10T18:57:14.931703+0000","last_clean":"2023-06-10T18:57:14.931703+0000","last_became_active":"2023-06-10T18:57:12.905010+0000","last_became_peered":"2023-06-10T18:57:12.905010+0000","last_unstale":"2023-06-10T18:57:14.931703+0000","last_undegraded":"2023-06-10T18:57:14.931703+0000","last_fullsized":"2023-06-10T18:57:14.931703+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:29:45.863194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.256343+0000","last_change":"2023-06-10T18:57:13.255158+0000","last_active":"2023-06-10T18:57:14.256343+0000","last_peered":"2023-06-10T18:57:14.256343+0000","last_clean":"2023-06-10T18:57:14.256343+0000","last_became_active":"2023-06-10T18:57:13.254056+0000","last_became_peered":"2023-06-10T18:57:13.254056+0000","last_unstale":"2023-06-10T18:57:14.256343+0000","last_undegraded":"2023-06-10T18:57:14.256343+0000","last_fullsized":"2023-06-10T18:57:14.256343+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:22:15.141932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.258473+0000","last_change":"2023-06-10T18:57:12.883017+0000","last_active":"2023-06-10T18:57:14.258473+0000","last_peered":"2023-06-10T18:57:14.258473+0000","last_clean":"2023-06-10T18:57:14.258473+0000","last_became_active":"2023-06-10T18:57:12.881943+0000","last_became_peered":"2023-06-10T18:57:12.881943+0000","last_unstale":"2023-06-10T18:57:14.258473+0000","last_undegraded":"2023-06-10T18:57:14.258473+0000","last_fullsized":"2023-06-10T18:57:14.258473+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:56:01.045393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.526216+0000","last_change":"2023-06-10T18:57:13.294633+0000","last_active":"2023-06-10T18:57:14.526216+0000","last_peered":"2023-06-10T18:57:14.526216+0000","last_clean":"2023-06-10T18:57:14.526216+0000","last_became_active":"2023-06-10T18:57:13.292238+0000","last_became_peered":"2023-06-10T18:57:13.292238+0000","last_unstale":"2023-06-10T18:57:14.526216+0000","last_undegraded":"2023-06-10T18:57:14.526216+0000","last_fullsized":"2023-06-10T18:57:14.526216+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:20:47.566495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.931373+0000","last_change":"2023-06-10T18:57:12.892328+0000","last_active":"2023-06-10T18:57:14.931373+0000","last_peered":"2023-06-10T18:57:14.931373+0000","last_clean":"2023-06-10T18:57:14.931373+0000","last_became_active":"2023-06-10T18:57:12.891514+0000","last_became_peered":"2023-06-10T18:57:12.891514+0000","last_unstale":"2023-06-10T18:57:14.931373+0000","last_undegraded":"2023-06-10T18:57:14.931373+0000","last_fullsized":"2023-06-10T18:57:14.931373+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:11:21.739946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.932092+0000","last_change":"2023-06-10T18:57:13.304629+0000","last_active":"2023-06-10T18:57:14.932092+0000","last_peered":"2023-06-10T18:57:14.932092+0000","last_clean":"2023-06-10T18:57:14.932092+0000","last_became_active":"2023-06-10T18:57:13.304404+0000","last_became_peered":"2023-06-10T18:57:13.304404+0000","last_unstale":"2023-06-10T18:57:14.932092+0000","last_undegraded":"2023-06-10T18:57:14.932092+0000","last_fullsized":"2023-06-10T18:57:14.932092+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:29:56.588963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"64'8","reported_seq":21,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.255324+0000","last_change":"2023-06-10T18:57:12.889495+0000","last_active":"2023-06-10T18:57:14.255324+0000","last_peered":"2023-06-10T18:57:14.255324+0000","last_clean":"2023-06-10T18:57:14.255324+0000","last_became_active":"2023-06-10T18:57:12.888617+0000","last_became_peered":"2023-06-10T18:57:12.888617+0000","last_unstale":"2023-06-10T18:57:14.255324+0000","last_undegraded":"2023-06-10T18:57:14.255324+0000","last_fullsized":"2023-06-10T18:57:14.255324+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:27:13.927042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.254369+0000","last_change":"2023-06-10T18:57:13.277598+0000","last_active":"2023-06-10T18:57:14.254369+0000","last_peered":"2023-06-10T18:57:14.254369+0000","last_clean":"2023-06-10T18:57:14.254369+0000","last_became_active":"2023-06-10T18:57:13.277349+0000","last_became_peered":"2023-06-10T18:57:13.277349+0000","last_unstale":"2023-06-10T18:57:14.254369+0000","last_undegraded":"2023-06-10T18:57:14.254369+0000","last_fullsized":"2023-06-10T18:57:14.254369+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:37:57.899268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"64'2","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.259835+0000","last_change":"2023-06-10T18:57:12.889724+0000","last_active":"2023-06-10T18:57:14.259835+0000","last_peered":"2023-06-10T18:57:14.259835+0000","last_clean":"2023-06-10T18:57:14.259835+0000","last_became_active":"2023-06-10T18:57:12.889210+0000","last_became_peered":"2023-06-10T18:57:12.889210+0000","last_unstale":"2023-06-10T18:57:14.259835+0000","last_undegraded":"2023-06-10T18:57:14.259835+0000","last_fullsized":"2023-06-10T18:57:14.259835+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:56:37.298983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.428519+0000","last_change":"2023-06-10T18:57:13.253522+0000","last_active":"2023-06-10T18:57:14.428519+0000","last_peered":"2023-06-10T18:57:14.428519+0000","last_clean":"2023-06-10T18:57:14.428519+0000","last_became_active":"2023-06-10T18:57:13.253297+0000","last_became_peered":"2023-06-10T18:57:13.253297+0000","last_unstale":"2023-06-10T18:57:14.428519+0000","last_undegraded":"2023-06-10T18:57:14.428519+0000","last_fullsized":"2023-06-10T18:57:14.428519+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:04:01.753221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.259610+0000","last_change":"2023-06-10T18:57:12.883077+0000","last_active":"2023-06-10T18:57:14.259610+0000","last_peered":"2023-06-10T18:57:14.259610+0000","last_clean":"2023-06-10T18:57:14.259610+0000","last_became_active":"2023-06-10T18:57:12.881984+0000","last_became_peered":"2023-06-10T18:57:12.881984+0000","last_unstale":"2023-06-10T18:57:14.259610+0000","last_undegraded":"2023-06-10T18:57:14.259610+0000","last_fullsized":"2023-06-10T18:57:14.259610+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:07:12.656980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.259436+0000","last_change":"2023-06-10T18:57:13.270873+0000","last_active":"2023-06-10T18:57:14.259436+0000","last_peered":"2023-06-10T18:57:14.259436+0000","last_clean":"2023-06-10T18:57:14.259436+0000","last_became_active":"2023-06-10T18:57:13.269691+0000","last_became_peered":"2023-06-10T18:57:13.269691+0000","last_unstale":"2023-06-10T18:57:14.259436+0000","last_undegraded":"2023-06-10T18:57:14.259436+0000","last_fullsized":"2023-06-10T18:57:14.259436+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:36:43.597201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.254566+0000","last_change":"2023-06-10T18:57:12.902386+0000","last_active":"2023-06-10T18:57:14.254566+0000","last_peered":"2023-06-10T18:57:14.254566+0000","last_clean":"2023-06-10T18:57:14.254566+0000","last_became_active":"2023-06-10T18:57:12.901985+0000","last_became_peered":"2023-06-10T18:57:12.901985+0000","last_unstale":"2023-06-10T18:57:14.254566+0000","last_undegraded":"2023-06-10T18:57:14.254566+0000","last_fullsized":"2023-06-10T18:57:14.254566+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:32:53.427136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.526240+0000","last_change":"2023-06-10T18:57:13.294846+0000","last_active":"2023-06-10T18:57:14.526240+0000","last_peered":"2023-06-10T18:57:14.526240+0000","last_clean":"2023-06-10T18:57:14.526240+0000","last_became_active":"2023-06-10T18:57:13.291799+0000","last_became_peered":"2023-06-10T18:57:13.291799+0000","last_unstale":"2023-06-10T18:57:14.526240+0000","last_undegraded":"2023-06-10T18:57:14.526240+0000","last_fullsized":"2023-06-10T18:57:14.526240+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:45:22.999372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.932884+0000","last_change":"2023-06-10T18:57:12.893797+0000","last_active":"2023-06-10T18:57:14.932884+0000","last_peered":"2023-06-10T18:57:14.932884+0000","last_clean":"2023-06-10T18:57:14.932884+0000","last_became_active":"2023-06-10T18:57:12.893210+0000","last_became_peered":"2023-06-10T18:57:12.893210+0000","last_unstale":"2023-06-10T18:57:14.932884+0000","last_undegraded":"2023-06-10T18:57:14.932884+0000","last_fullsized":"2023-06-10T18:57:14.932884+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:32:41.365666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.525513+0000","last_change":"2023-06-10T18:57:13.293893+0000","last_active":"2023-06-10T18:57:14.525513+0000","last_peered":"2023-06-10T18:57:14.525513+0000","last_clean":"2023-06-10T18:57:14.525513+0000","last_became_active":"2023-06-10T18:57:13.293423+0000","last_became_peered":"2023-06-10T18:57:13.293423+0000","last_unstale":"2023-06-10T18:57:14.525513+0000","last_undegraded":"2023-06-10T18:57:14.525513+0000","last_fullsized":"2023-06-10T18:57:14.525513+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:21:55.629492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.931383+0000","last_change":"2023-06-10T18:57:12.892224+0000","last_active":"2023-06-10T18:57:14.931383+0000","last_peered":"2023-06-10T18:57:14.931383+0000","last_clean":"2023-06-10T18:57:14.931383+0000","last_became_active":"2023-06-10T18:57:12.891612+0000","last_became_peered":"2023-06-10T18:57:12.891612+0000","last_unstale":"2023-06-10T18:57:14.931383+0000","last_undegraded":"2023-06-10T18:57:14.931383+0000","last_fullsized":"2023-06-10T18:57:14.931383+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:10:31.008558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.256121+0000","last_change":"2023-06-10T18:57:13.301567+0000","last_active":"2023-06-10T18:57:14.256121+0000","last_peered":"2023-06-10T18:57:14.256121+0000","last_clean":"2023-06-10T18:57:14.256121+0000","last_became_active":"2023-06-10T18:57:13.301091+0000","last_became_peered":"2023-06-10T18:57:13.301091+0000","last_unstale":"2023-06-10T18:57:14.256121+0000","last_undegraded":"2023-06-10T18:57:14.256121+0000","last_fullsized":"2023-06-10T18:57:14.256121+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:34:21.615921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.933231+0000","last_change":"2023-06-10T18:57:12.884298+0000","last_active":"2023-06-10T18:57:14.933231+0000","last_peered":"2023-06-10T18:57:14.933231+0000","last_clean":"2023-06-10T18:57:14.933231+0000","last_became_active":"2023-06-10T18:57:12.883945+0000","last_became_peered":"2023-06-10T18:57:12.883945+0000","last_unstale":"2023-06-10T18:57:14.933231+0000","last_undegraded":"2023-06-10T18:57:14.933231+0000","last_fullsized":"2023-06-10T18:57:14.933231+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:46:01.209420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.932009+0000","last_change":"2023-06-10T18:57:13.284004+0000","last_active":"2023-06-10T18:57:14.932009+0000","last_peered":"2023-06-10T18:57:14.932009+0000","last_clean":"2023-06-10T18:57:14.932009+0000","last_became_active":"2023-06-10T18:57:13.283585+0000","last_became_peered":"2023-06-10T18:57:13.283585+0000","last_unstale":"2023-06-10T18:57:14.932009+0000","last_undegraded":"2023-06-10T18:57:14.932009+0000","last_fullsized":"2023-06-10T18:57:14.932009+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:46:02.213122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.931021+0000","last_change":"2023-06-10T18:57:12.905450+0000","last_active":"2023-06-10T18:57:14.931021+0000","last_peered":"2023-06-10T18:57:14.931021+0000","last_clean":"2023-06-10T18:57:14.931021+0000","last_became_active":"2023-06-10T18:57:12.905165+0000","last_became_peered":"2023-06-10T18:57:12.905165+0000","last_unstale":"2023-06-10T18:57:14.931021+0000","last_undegraded":"2023-06-10T18:57:14.931021+0000","last_fullsized":"2023-06-10T18:57:14.931021+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:00:04.981964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.428385+0000","last_change":"2023-06-10T18:57:13.274020+0000","last_active":"2023-06-10T18:57:14.428385+0000","last_peered":"2023-06-10T18:57:14.428385+0000","last_clean":"2023-06-10T18:57:14.428385+0000","last_became_active":"2023-06-10T18:57:13.273679+0000","last_became_peered":"2023-06-10T18:57:13.273679+0000","last_unstale":"2023-06-10T18:57:14.428385+0000","last_undegraded":"2023-06-10T18:57:14.428385+0000","last_fullsized":"2023-06-10T18:57:14.428385+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:48:06.315568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.931810+0000","last_change":"2023-06-10T18:57:12.906185+0000","last_active":"2023-06-10T18:57:14.931810+0000","last_peered":"2023-06-10T18:57:14.931810+0000","last_clean":"2023-06-10T18:57:14.931810+0000","last_became_active":"2023-06-10T18:57:12.905968+0000","last_became_peered":"2023-06-10T18:57:12.905968+0000","last_unstale":"2023-06-10T18:57:14.931810+0000","last_undegraded":"2023-06-10T18:57:14.931810+0000","last_fullsized":"2023-06-10T18:57:14.931810+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:32:53.427136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.525900+0000","last_change":"2023-06-10T18:57:13.291409+0000","last_active":"2023-06-10T18:57:14.525900+0000","last_peered":"2023-06-10T18:57:14.525900+0000","last_clean":"2023-06-10T18:57:14.525900+0000","last_became_active":"2023-06-10T18:57:13.290768+0000","last_became_peered":"2023-06-10T18:57:13.290768+0000","last_unstale":"2023-06-10T18:57:14.525900+0000","last_undegraded":"2023-06-10T18:57:14.525900+0000","last_fullsized":"2023-06-10T18:57:14.525900+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:13:06.807526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.930798+0000","last_change":"2023-06-10T18:57:12.878281+0000","last_active":"2023-06-10T18:57:14.930798+0000","last_peered":"2023-06-10T18:57:14.930798+0000","last_clean":"2023-06-10T18:57:14.930798+0000","last_became_active":"2023-06-10T18:57:12.877987+0000","last_became_peered":"2023-06-10T18:57:12.877987+0000","last_unstale":"2023-06-10T18:57:14.930798+0000","last_undegraded":"2023-06-10T18:57:14.930798+0000","last_fullsized":"2023-06-10T18:57:14.930798+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:57:38.602424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":249,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.931118+0000","last_change":"2023-06-10T18:52:34.951528+0000","last_active":"2023-06-10T18:57:14.931118+0000","last_peered":"2023-06-10T18:57:14.931118+0000","last_clean":"2023-06-10T18:57:14.931118+0000","last_became_active":"2023-06-10T18:52:34.949099+0000","last_became_peered":"2023-06-10T18:52:34.949099+0000","last_unstale":"2023-06-10T18:57:14.931118+0000","last_undegraded":"2023-06-10T18:57:14.931118+0000","last_fullsized":"2023-06-10T18:57:14.931118+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_clean_scrub_stamp":"2023-06-10T18:52:33.633295+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:50:13.411009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":95,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.259287+0000","last_change":"2023-06-10T18:52:40.506384+0000","last_active":"2023-06-10T18:57:14.259287+0000","last_peered":"2023-06-10T18:57:14.259287+0000","last_clean":"2023-06-10T18:57:14.259287+0000","last_became_active":"2023-06-10T18:52:40.505701+0000","last_became_peered":"2023-06-10T18:52:40.505701+0000","last_unstale":"2023-06-10T18:57:14.259287+0000","last_undegraded":"2023-06-10T18:57:14.259287+0000","last_fullsized":"2023-06-10T18:57:14.259287+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:21:55.236256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.254058+0000","last_change":"2023-06-10T18:57:13.264235+0000","last_active":"2023-06-10T18:57:14.254058+0000","last_peered":"2023-06-10T18:57:14.254058+0000","last_clean":"2023-06-10T18:57:14.254058+0000","last_became_active":"2023-06-10T18:57:13.263890+0000","last_became_peered":"2023-06-10T18:57:13.263890+0000","last_unstale":"2023-06-10T18:57:14.254058+0000","last_undegraded":"2023-06-10T18:57:14.254058+0000","last_fullsized":"2023-06-10T18:57:14.254058+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:14:28.319502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"64'2","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.254288+0000","last_change":"2023-06-10T18:57:12.885559+0000","last_active":"2023-06-10T18:57:14.254288+0000","last_peered":"2023-06-10T18:57:14.254288+0000","last_clean":"2023-06-10T18:57:14.254288+0000","last_became_active":"2023-06-10T18:57:12.885246+0000","last_became_peered":"2023-06-10T18:57:12.885246+0000","last_unstale":"2023-06-10T18:57:14.254288+0000","last_undegraded":"2023-06-10T18:57:14.254288+0000","last_fullsized":"2023-06-10T18:57:14.254288+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:46:11.635230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":93,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.930784+0000","last_change":"2023-06-10T18:52:40.512015+0000","last_active":"2023-06-10T18:57:14.930784+0000","last_peered":"2023-06-10T18:57:14.930784+0000","last_clean":"2023-06-10T18:57:14.930784+0000","last_became_active":"2023-06-10T18:52:40.511382+0000","last_became_peered":"2023-06-10T18:52:40.511382+0000","last_unstale":"2023-06-10T18:57:14.930784+0000","last_undegraded":"2023-06-10T18:57:14.930784+0000","last_fullsized":"2023-06-10T18:57:14.930784+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:14:20.492303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.256640+0000","last_change":"2023-06-10T18:57:13.270711+0000","last_active":"2023-06-10T18:57:14.256640+0000","last_peered":"2023-06-10T18:57:14.256640+0000","last_clean":"2023-06-10T18:57:14.256640+0000","last_became_active":"2023-06-10T18:57:13.269922+0000","last_became_peered":"2023-06-10T18:57:13.269922+0000","last_unstale":"2023-06-10T18:57:14.256640+0000","last_undegraded":"2023-06-10T18:57:14.256640+0000","last_fullsized":"2023-06-10T18:57:14.256640+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:50:22.954368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.256697+0000","last_change":"2023-06-10T18:57:12.893530+0000","last_active":"2023-06-10T18:57:14.256697+0000","last_peered":"2023-06-10T18:57:14.256697+0000","last_clean":"2023-06-10T18:57:14.256697+0000","last_became_active":"2023-06-10T18:57:12.892910+0000","last_became_peered":"2023-06-10T18:57:12.892910+0000","last_unstale":"2023-06-10T18:57:14.256697+0000","last_undegraded":"2023-06-10T18:57:14.256697+0000","last_fullsized":"2023-06-10T18:57:14.256697+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:37:49.865915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":97,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.428439+0000","last_change":"2023-06-10T18:52:40.671725+0000","last_active":"2023-06-10T18:57:14.428439+0000","last_peered":"2023-06-10T18:57:14.428439+0000","last_clean":"2023-06-10T18:57:14.428439+0000","last_became_active":"2023-06-10T18:52:40.671442+0000","last_became_peered":"2023-06-10T18:52:40.671442+0000","last_unstale":"2023-06-10T18:57:14.428439+0000","last_undegraded":"2023-06-10T18:57:14.428439+0000","last_fullsized":"2023-06-10T18:57:14.428439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T18:53:52.770522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.526052+0000","last_change":"2023-06-10T18:57:13.295430+0000","last_active":"2023-06-10T18:57:14.526052+0000","last_peered":"2023-06-10T18:57:14.526052+0000","last_clean":"2023-06-10T18:57:14.526052+0000","last_became_active":"2023-06-10T18:57:13.294135+0000","last_became_peered":"2023-06-10T18:57:13.294135+0000","last_unstale":"2023-06-10T18:57:14.526052+0000","last_undegraded":"2023-06-10T18:57:14.526052+0000","last_fullsized":"2023-06-10T18:57:14.526052+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:46:35.743380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.254234+0000","last_change":"2023-06-10T18:57:12.886396+0000","last_active":"2023-06-10T18:57:14.254234+0000","last_peered":"2023-06-10T18:57:14.254234+0000","last_clean":"2023-06-10T18:57:14.254234+0000","last_became_active":"2023-06-10T18:57:12.885991+0000","last_became_peered":"2023-06-10T18:57:12.885991+0000","last_unstale":"2023-06-10T18:57:14.254234+0000","last_undegraded":"2023-06-10T18:57:14.254234+0000","last_fullsized":"2023-06-10T18:57:14.254234+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:12:54.670196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":95,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.258885+0000","last_change":"2023-06-10T18:52:40.510258+0000","last_active":"2023-06-10T18:57:14.258885+0000","last_peered":"2023-06-10T18:57:14.258885+0000","last_clean":"2023-06-10T18:57:14.258885+0000","last_became_active":"2023-06-10T18:52:40.509560+0000","last_became_peered":"2023-06-10T18:52:40.509560+0000","last_unstale":"2023-06-10T18:57:14.258885+0000","last_undegraded":"2023-06-10T18:57:14.258885+0000","last_fullsized":"2023-06-10T18:57:14.258885+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:31:48.923521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.931234+0000","last_change":"2023-06-10T18:57:13.303033+0000","last_active":"2023-06-10T18:57:14.931234+0000","last_peered":"2023-06-10T18:57:14.931234+0000","last_clean":"2023-06-10T18:57:14.931234+0000","last_became_active":"2023-06-10T18:57:13.302527+0000","last_became_peered":"2023-06-10T18:57:13.302527+0000","last_unstale":"2023-06-10T18:57:14.931234+0000","last_undegraded":"2023-06-10T18:57:14.931234+0000","last_fullsized":"2023-06-10T18:57:14.931234+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:24:35.933576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"64'1","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.259656+0000","last_change":"2023-06-10T18:57:12.892196+0000","last_active":"2023-06-10T18:57:14.259656+0000","last_peered":"2023-06-10T18:57:14.259656+0000","last_clean":"2023-06-10T18:57:14.259656+0000","last_became_active":"2023-06-10T18:57:12.891587+0000","last_became_peered":"2023-06-10T18:57:12.891587+0000","last_unstale":"2023-06-10T18:57:14.259656+0000","last_undegraded":"2023-06-10T18:57:14.259656+0000","last_fullsized":"2023-06-10T18:57:14.259656+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:43:03.316354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":89,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.933163+0000","last_change":"2023-06-10T18:52:40.672266+0000","last_active":"2023-06-10T18:57:14.933163+0000","last_peered":"2023-06-10T18:57:14.933163+0000","last_clean":"2023-06-10T18:57:14.933163+0000","last_became_active":"2023-06-10T18:52:40.671966+0000","last_became_peered":"2023-06-10T18:52:40.671966+0000","last_unstale":"2023-06-10T18:57:14.933163+0000","last_undegraded":"2023-06-10T18:57:14.933163+0000","last_fullsized":"2023-06-10T18:57:14.933163+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:32:47.809991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.526185+0000","last_change":"2023-06-10T18:57:13.290811+0000","last_active":"2023-06-10T18:57:14.526185+0000","last_peered":"2023-06-10T18:57:14.526185+0000","last_clean":"2023-06-10T18:57:14.526185+0000","last_became_active":"2023-06-10T18:57:13.289995+0000","last_became_peered":"2023-06-10T18:57:13.289995+0000","last_unstale":"2023-06-10T18:57:14.526185+0000","last_undegraded":"2023-06-10T18:57:14.526185+0000","last_fullsized":"2023-06-10T18:57:14.526185+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:53:44.170332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"64'2","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.931563+0000","last_change":"2023-06-10T18:57:12.898334+0000","last_active":"2023-06-10T18:57:14.931563+0000","last_peered":"2023-06-10T18:57:14.931563+0000","last_clean":"2023-06-10T18:57:14.931563+0000","last_became_active":"2023-06-10T18:57:12.897715+0000","last_became_peered":"2023-06-10T18:57:12.897715+0000","last_unstale":"2023-06-10T18:57:14.931563+0000","last_undegraded":"2023-06-10T18:57:14.931563+0000","last_fullsized":"2023-06-10T18:57:14.931563+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:12:39.320145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":93,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.931809+0000","last_change":"2023-06-10T18:52:40.671084+0000","last_active":"2023-06-10T18:57:14.931809+0000","last_peered":"2023-06-10T18:57:14.931809+0000","last_clean":"2023-06-10T18:57:14.931809+0000","last_became_active":"2023-06-10T18:52:40.670697+0000","last_became_peered":"2023-06-10T18:52:40.670697+0000","last_unstale":"2023-06-10T18:57:14.931809+0000","last_undegraded":"2023-06-10T18:57:14.931809+0000","last_fullsized":"2023-06-10T18:57:14.931809+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:20:07.840833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.257572+0000","last_change":"2023-06-10T18:57:13.292992+0000","last_active":"2023-06-10T18:57:14.257572+0000","last_peered":"2023-06-10T18:57:14.257572+0000","last_clean":"2023-06-10T18:57:14.257572+0000","last_became_active":"2023-06-10T18:57:13.292455+0000","last_became_peered":"2023-06-10T18:57:13.292455+0000","last_unstale":"2023-06-10T18:57:14.257572+0000","last_undegraded":"2023-06-10T18:57:14.257572+0000","last_fullsized":"2023-06-10T18:57:14.257572+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:47:16.795794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"64'1","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.931519+0000","last_change":"2023-06-10T18:57:12.894181+0000","last_active":"2023-06-10T18:57:14.931519+0000","last_peered":"2023-06-10T18:57:14.931519+0000","last_clean":"2023-06-10T18:57:14.931519+0000","last_became_active":"2023-06-10T18:57:12.893501+0000","last_became_peered":"2023-06-10T18:57:12.893501+0000","last_unstale":"2023-06-10T18:57:14.931519+0000","last_undegraded":"2023-06-10T18:57:14.931519+0000","last_fullsized":"2023-06-10T18:57:14.931519+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:50:05.786456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":89,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.932781+0000","last_change":"2023-06-10T18:52:40.514114+0000","last_active":"2023-06-10T18:57:14.932781+0000","last_peered":"2023-06-10T18:57:14.932781+0000","last_clean":"2023-06-10T18:57:14.932781+0000","last_became_active":"2023-06-10T18:52:40.513638+0000","last_became_peered":"2023-06-10T18:52:40.513638+0000","last_unstale":"2023-06-10T18:57:14.932781+0000","last_undegraded":"2023-06-10T18:57:14.932781+0000","last_fullsized":"2023-06-10T18:57:14.932781+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:26:18.095403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.526358+0000","last_change":"2023-06-10T18:57:13.291180+0000","last_active":"2023-06-10T18:57:14.526358+0000","last_peered":"2023-06-10T18:57:14.526358+0000","last_clean":"2023-06-10T18:57:14.526358+0000","last_became_active":"2023-06-10T18:57:13.290398+0000","last_became_peered":"2023-06-10T18:57:13.290398+0000","last_unstale":"2023-06-10T18:57:14.526358+0000","last_undegraded":"2023-06-10T18:57:14.526358+0000","last_fullsized":"2023-06-10T18:57:14.526358+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:12.846581+0000","last_clean_scrub_stamp":"2023-06-10T18:57:12.846581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:58:05.988682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.932937+0000","last_change":"2023-06-10T18:57:12.899055+0000","last_active":"2023-06-10T18:57:14.932937+0000","last_peered":"2023-06-10T18:57:14.932937+0000","last_clean":"2023-06-10T18:57:14.932937+0000","last_became_active":"2023-06-10T18:57:12.898805+0000","last_became_peered":"2023-06-10T18:57:12.898805+0000","last_unstale":"2023-06-10T18:57:14.932937+0000","last_undegraded":"2023-06-10T18:57:14.932937+0000","last_fullsized":"2023-06-10T18:57:14.932937+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:57:11.842880+0000","last_clean_scrub_stamp":"2023-06-10T18:57:11.842880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:32:53.427136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":97,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-06-10T18:57:14.526362+0000","last_change":"2023-06-10T18:52:40.515396+0000","last_active":"2023-06-10T18:57:14.526362+0000","last_peered":"2023-06-10T18:57:14.526362+0000","last_clean":"2023-06-10T18:57:14.526362+0000","last_became_active":"2023-06-10T18:52:40.514663+0000","last_became_peered":"2023-06-10T18:52:40.514663+0000","last_unstale":"2023-06-10T18:57:14.526362+0000","last_undegraded":"2023-06-10T18:57:14.526362+0000","last_fullsized":"2023-06-10T18:57:14.526362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:22:41.559005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574908,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32408,"kb_used_data":1360,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339432,"statfs":{"total":96636764160,"available":96603578368,"internally_reserved":0,"allocated":1392640,"data_stored":937837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.89800000000000002,"15min":0.88},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.1850000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.874,"5min":0.93300000000000005,"15min":0.92700000000000005},"min":{"1min":0.52900000000000003,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1910000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.96399999999999997}]},{"osd":1,"last update":"Sat Jun 10 18:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.93200000000000005,"15min":0.91800000000000004},"min":{"1min":0.56100000000000005,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.3759999999999999,"5min":1.377,"15min":1.377},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.93300000000000005,"15min":0.91300000000000003},"min":{"1min":0.70099999999999996,"5min":0.504,"15min":0.504},"max":{"1min":1.2529999999999999,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.077}]},{"osd":2,"last update":"Sat Jun 10 18:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.83699999999999997,"15min":0.82699999999999996},"min":{"1min":0.49299999999999999,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.04,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.627},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.89100000000000001,"15min":0.90400000000000003},"min":{"1min":0.56100000000000005,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1930000000000001,"5min":1.367,"15min":1.367},"last":1.0029999999999999}]},{"osd":3,"last update":"Sat Jun 10 18:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.92900000000000005,"15min":0.90100000000000002},"min":{"1min":0.59699999999999998,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.167,"5min":1.502,"15min":1.502},"last":1.1040000000000001},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.94199999999999995,"15min":0.92900000000000005},"min":{"1min":0.63,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.2230000000000001,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.74099999999999999}]},{"osd":4,"last update":"Sat Jun 10 18:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.871,"15min":0.871},"min":{"1min":0.57399999999999995,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.1639999999999999,"5min":1.639,"15min":1.639},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.95999999999999996,"15min":0.97799999999999998},"min":{"1min":0.65200000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.22,"5min":1.411,"15min":1.411},"last":1.04}]},{"osd":5,"last update":"Sat Jun 10 18:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":1.0189999999999999,"15min":1.0309999999999999},"min":{"1min":0.60099999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.2210000000000001,"5min":1.806,"15min":1.806},"last":1.125},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.038,"15min":1.048},"min":{"1min":0.71299999999999997,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.26,"5min":1.522,"15min":1.522},"last":0.88500000000000001}]},{"osd":6,"last update":"Sat Jun 10 18:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.995,"15min":1.002},"min":{"1min":0.66400000000000003,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.2170000000000001,"5min":1.718,"15min":1.718},"last":1.1719999999999999},{"interface":"front","average":{"1min":1.048,"5min":1.087,"15min":1.087},"min":{"1min":0.83599999999999997,"5min":0.441,"15min":0.441},"max":{"1min":1.2889999999999999,"5min":1.464,"15min":1.464},"last":1.147}]}]},{"osd":6,"up_from":13,"seq":55834574909,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27720,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344120,"statfs":{"total":96636764160,"available":96608378880,"internally_reserved":0,"allocated":786432,"data_stored":346727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:56:33 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.84999999999999998,"15min":0.81100000000000005},"min":{"1min":0.66700000000000004,"5min":0.502,"15min":0.502},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.878,"15min":0.84799999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":1.0569999999999999}]},{"osd":1,"last update":"Sat Jun 10 18:56:33 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.88,"15min":0.85399999999999998},"min":{"1min":0.53400000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0900000000000001,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.89500000000000002,"15min":0.86399999999999999},"min":{"1min":0.53800000000000003,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.587,"5min":1.778,"15min":1.778},"last":0.75900000000000001}]},{"osd":2,"last update":"Sat Jun 10 18:56:33 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.88300000000000001,"15min":0.86299999999999999},"min":{"1min":0.57399999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.1819999999999999,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.871,"5min":0.88100000000000001,"15min":0.88800000000000001},"min":{"1min":0.60299999999999998,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.177,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.72599999999999998}]},{"osd":3,"last update":"Sat Jun 10 18:56:33 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":0.90800000000000003,"15min":0.85999999999999999},"min":{"1min":0.64500000000000002,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":1.0329999999999999},{"interface":"front","average":{"1min":1,"5min":0.998,"15min":0.996},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.90100000000000002}]},{"osd":4,"last update":"Sat Jun 10 18:56:33 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.93000000000000005,"15min":0.95199999999999996},"min":{"1min":0.63,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":0.66700000000000004},{"interface":"front","average":{"1min":1.024,"5min":1.0049999999999999,"15min":1.0189999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.54,"5min":1.54,"15min":1.54},"last":0.999}]},{"osd":5,"last update":"Sat Jun 10 18:56:33 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.93500000000000005,"15min":0.95699999999999996},"min":{"1min":0.70299999999999996,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.92600000000000005},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.044,"15min":1.032},"min":{"1min":0.83699999999999997,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":2.536,"5min":2.536,"15min":2.536},"last":0.93799999999999994}]},{"osd":7,"last update":"Sat Jun 10 18:56:33 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.036,"15min":1.048},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.917,"5min":1.917,"15min":1.917},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.05,"15min":1.0629999999999999},"min":{"1min":0.79400000000000004,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.395,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.85199999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574909,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27720,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344120,"statfs":{"total":96636764160,"available":96608378880,"internally_reserved":0,"allocated":786432,"data_stored":346715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84499999999999997,"15min":0.83099999999999996},"min":{"1min":0.60999999999999999,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.879,"5min":0.90300000000000002,"15min":0.93700000000000006},"min":{"1min":0.58799999999999997,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1499999999999999,"5min":1.637,"15min":1.637},"last":0.56699999999999995}]},{"osd":1,"last update":"Sat Jun 10 18:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.89000000000000001,"15min":0.91200000000000003},"min":{"1min":0.54400000000000004,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.107,"5min":1.335,"15min":1.335},"last":1.234},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.91700000000000004,"15min":0.92100000000000004},"min":{"1min":0.63600000000000001,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.444,"5min":1.78,"15min":1.78},"last":0.74199999999999999}]},{"osd":2,"last update":"Sat Jun 10 18:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.84299999999999997,"15min":0.85099999999999998},"min":{"1min":0.54400000000000004,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.995,"5min":1.446,"15min":1.446},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.163,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":1.056}]},{"osd":3,"last update":"Sat Jun 10 18:56:37 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":0.95299999999999996,"15min":0.94899999999999995},"min":{"1min":0.75900000000000001,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.3440000000000001,"5min":1.484,"15min":1.484},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.998,"15min":1.034},"min":{"1min":0.66700000000000004,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.1910000000000001,"5min":1.337,"15min":1.337},"last":0.66300000000000003}]},{"osd":4,"last update":"Sat Jun 10 18:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.94499999999999995,"15min":0.98099999999999998},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.0720000000000001,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":1.161},{"interface":"front","average":{"1min":1.002,"5min":1.0189999999999999,"15min":1.0589999999999999},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.528,"5min":1.575,"15min":1.575},"last":0.88}]},{"osd":6,"last update":"Sat Jun 10 18:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":1.0089999999999999,"15min":1.0680000000000001},"min":{"1min":0.629,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.1799999999999999,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.97899999999999998,"5min":1.0389999999999999,"15min":1.0720000000000001},"min":{"1min":0.67200000000000004,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.1859999999999999,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.3029999999999999}]},{"osd":7,"last update":"Sat Jun 10 18:56:37 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.123,"15min":1.169},"min":{"1min":0.85199999999999998,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.573,"5min":1.873,"15min":1.873},"last":1.1060000000000001},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.1339999999999999,"15min":1.1739999999999999},"min":{"1min":0.877,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.4750000000000001,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.028}]}]},{"osd":4,"up_from":13,"seq":55834574908,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27728,"kb_used_data":776,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344112,"statfs":{"total":96636764160,"available":96608370688,"internally_reserved":0,"allocated":794624,"data_stored":348257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.78700000000000003,"15min":0.752},"min":{"1min":0.49299999999999999,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.157,"5min":1.2,"15min":1.2},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.89700000000000002,"15min":0.88500000000000001},"min":{"1min":0.66500000000000004,"5min":0.504,"15min":0.504},"max":{"1min":1.2350000000000001,"5min":1.73,"15min":1.73},"last":0.53500000000000003}]},{"osd":1,"last update":"Sat Jun 10 18:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.94799999999999995,"15min":0.95399999999999996},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.179,"5min":1.601,"15min":1.601},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.87,"5min":0.85299999999999998,"15min":0.83899999999999997},"min":{"1min":0.63400000000000001,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.3029999999999999,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.503}]},{"osd":2,"last update":"Sat Jun 10 18:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.877,"15min":0.875},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.089,"5min":1.522,"15min":1.522},"last":1.0289999999999999},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.98999999999999999,"15min":1},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.2629999999999999,"5min":1.552,"15min":1.552},"last":0.73699999999999999}]},{"osd":3,"last update":"Sat Jun 10 18:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.89900000000000002,"15min":0.88},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.1990000000000001,"5min":1.22,"15min":1.22},"last":0.60399999999999998},{"interface":"front","average":{"1min":1.02,"5min":0.97299999999999998,"15min":0.95599999999999996},"min":{"1min":0.78900000000000003,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.159,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.78400000000000003}]},{"osd":5,"last update":"Sat Jun 10 18:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.95099999999999996,"15min":0.98899999999999999},"min":{"1min":0.68200000000000005,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.27,"5min":1.663,"15min":1.663},"last":1.014},{"interface":"front","average":{"1min":0.999,"5min":0.95499999999999996,"15min":0.98199999999999998},"min":{"1min":0.69899999999999995,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.234,"5min":1.353,"15min":1.353},"last":0.89300000000000002}]},{"osd":6,"last update":"Sat Jun 10 18:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.98799999999999999,"15min":1.024},"min":{"1min":0.65500000000000003,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.242,"5min":2.2639999999999998,"15min":2.2639999999999998},"last":0.93000000000000005},{"interface":"front","average":{"1min":1.054,"5min":1.0669999999999999,"15min":1.0740000000000001},"min":{"1min":0.72599999999999998,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.2849999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.95699999999999996}]},{"osd":7,"last update":"Sat Jun 10 18:56:43 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.98399999999999999,"15min":0.99399999999999999},"min":{"1min":0.68999999999999995,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.2350000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.0600000000000001,"15min":1.0740000000000001},"min":{"1min":0.78500000000000003,"5min":0.628,"15min":0.628},"max":{"1min":1.3879999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":1.071}]}]},{"osd":3,"up_from":13,"seq":55834574907,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31808,"kb_used_data":760,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340032,"statfs":{"total":96636764160,"available":96604192768,"internally_reserved":0,"allocated":778240,"data_stored":345674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:56:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.60099999999999998,"15min":0.57999999999999996},"min":{"1min":0.432,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.65300000000000002,"15min":0.63700000000000001},"min":{"1min":0.35599999999999998,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.0129999999999999,"5min":1.286,"15min":1.286},"last":0.78400000000000003}]},{"osd":1,"last update":"Sat Jun 10 18:56:36 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.67500000000000004,"15min":0.63200000000000001},"min":{"1min":0.45500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.74299999999999999,"15min":0.72299999999999998},"min":{"1min":0.48599999999999999,"5min":0.318,"15min":0.318},"max":{"1min":1.143,"5min":1.411,"15min":1.411},"last":0.84599999999999997}]},{"osd":2,"last update":"Sat Jun 10 18:56:36 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.77400000000000002,"15min":0.754},"min":{"1min":0.48999999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.3759999999999999,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":1.179},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.76800000000000002,"15min":0.745},"min":{"1min":0.52900000000000003,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.125,"5min":1.264,"15min":1.264},"last":0.94499999999999995}]},{"osd":4,"last update":"Sat Jun 10 18:56:36 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.95399999999999996,"15min":0.96599999999999997},"min":{"1min":0.747,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.3360000000000001,"5min":1.488,"15min":1.488},"last":0.90500000000000003},{"interface":"front","average":{"1min":1.026,"5min":0.997,"15min":0.99299999999999999},"min":{"1min":0.65500000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.3700000000000001,"5min":1.458,"15min":1.458},"last":1.0900000000000001}]},{"osd":5,"last update":"Sat Jun 10 18:56:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":1.026,"15min":1.0549999999999999},"min":{"1min":0.68000000000000005,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.431,"5min":2.024,"15min":2.024},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.117,"5min":1.0469999999999999,"15min":1.0209999999999999},"min":{"1min":0.94299999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.4139999999999999,"5min":1.724,"15min":1.724},"last":1.4079999999999999}]},{"osd":6,"last update":"Sat Jun 10 18:56:36 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.0669999999999999,"15min":1.0529999999999999},"min":{"1min":0.83199999999999996,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.5449999999999999,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":1.349},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.0640000000000001,"15min":1.0740000000000001},"min":{"1min":0.75900000000000001,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.514,"5min":1.78,"15min":1.78},"last":1.0229999999999999}]},{"osd":7,"last update":"Sat Jun 10 18:56:36 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.105,"15min":1.129},"min":{"1min":0.82599999999999996,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.5900000000000001,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.129},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.099,"15min":1.077},"min":{"1min":0.71799999999999997,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.5429999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":1.248}]}]},{"osd":2,"up_from":13,"seq":55834574908,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31812,"kb_used_data":764,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340028,"statfs":{"total":96636764160,"available":96604188672,"internally_reserved":0,"allocated":782336,"data_stored":346693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.60699999999999998,"15min":0.58999999999999997},"min":{"1min":0.36499999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.91700000000000004,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.436,"5min":0.378,"15min":0.378},"max":{"1min":1.0580000000000001,"5min":1.224,"15min":1.224},"last":0.66900000000000004}]},{"osd":1,"last update":"Sat Jun 10 18:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.66300000000000003,"15min":0.65100000000000002},"min":{"1min":0.39700000000000002,"5min":0.307,"15min":0.307},"max":{"1min":1.0109999999999999,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.753,"15min":0.69999999999999996},"min":{"1min":0.41699999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.97499999999999998}]},{"osd":3,"last update":"Sat Jun 10 18:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.745,"15min":0.70899999999999996},"min":{"1min":0.44700000000000001,"5min":0.377,"15min":0.377},"max":{"1min":1.0609999999999999,"5min":1.165,"15min":1.165},"last":0.88},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.76400000000000001,"15min":0.751},"min":{"1min":0.32900000000000001,"5min":0.252,"15min":0.252},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":1.0269999999999999}]},{"osd":4,"last update":"Sat Jun 10 18:56:37 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.92300000000000004,"15min":0.91700000000000004},"min":{"1min":0.63,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.2769999999999999,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":1.046,"5min":1.036,"15min":1.038},"min":{"1min":0.70199999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.3169999999999999,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":1.2210000000000001}]},{"osd":5,"last update":"Sat Jun 10 18:56:37 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.0289999999999999,"15min":1.0209999999999999},"min":{"1min":0.64600000000000002,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.3759999999999999,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":1.127},{"interface":"front","average":{"1min":1.056,"5min":1.02,"15min":0.98399999999999999},"min":{"1min":0.78200000000000003,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.4119999999999999,"5min":1.667,"15min":1.667},"last":1.1080000000000001}]},{"osd":6,"last update":"Sat Jun 10 18:56:37 2023","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.0609999999999999,"15min":1.0289999999999999},"min":{"1min":0.873,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.4550000000000001,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":1.1619999999999999},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.0509999999999999,"15min":1.038},"min":{"1min":0.66000000000000003,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":1.1899999999999999}]},{"osd":7,"last update":"Sat Jun 10 18:56:37 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.1060000000000001,"15min":1.1020000000000001},"min":{"1min":0.83899999999999997,"5min":0.62,"15min":0.62},"max":{"1min":1.458,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.4039999999999999},{"interface":"front","average":{"1min":1.181,"5min":1.121,"15min":1.083},"min":{"1min":0.76400000000000001,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.5920000000000001,"5min":1.752,"15min":1.752},"last":1.325}]}]},{"osd":1,"up_from":13,"seq":55834574910,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31836,"kb_used_data":788,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340004,"statfs":{"total":96636764160,"available":96604164096,"internally_reserved":0,"allocated":806912,"data_stored":348002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.66600000000000004,"15min":0.65900000000000003},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.0149999999999999,"5min":1.288,"15min":1.288},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.72799999999999998,"15min":0.68799999999999994},"min":{"1min":0.38300000000000001,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.0089999999999999,"5min":1.694,"15min":1.694},"last":0.77600000000000002}]},{"osd":2,"last update":"Sat Jun 10 18:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.63200000000000001,"15min":0.61899999999999999},"min":{"1min":0.27300000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.77300000000000002,"5min":1.21,"15min":1.21},"last":0.5},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71899999999999997,"15min":0.66300000000000003},"min":{"1min":0.33800000000000002,"5min":0.315,"15min":0.315},"max":{"1min":1.171,"5min":1.415,"15min":1.415},"last":0.57699999999999996}]},{"osd":3,"last update":"Sat Jun 10 18:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79200000000000004,"15min":0.75},"min":{"1min":0.33400000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.4139999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.755,"15min":0.747},"min":{"1min":0.35399999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.0649999999999999,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":0.53100000000000003}]},{"osd":4,"last update":"Sat Jun 10 18:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.875,"15min":0.83799999999999997},"min":{"1min":0.56799999999999995,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0329999999999999,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.95799999999999996,"5min":1.0960000000000001,"15min":1.0720000000000001},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.5129999999999999,"5min":5.8209999999999997,"15min":5.8209999999999997},"last":1.1699999999999999}]},{"osd":5,"last update":"Sat Jun 10 18:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":1.018,"15min":1.024},"min":{"1min":0.58499999999999996,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.2829999999999999,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":0.98599999999999999},{"interface":"front","average":{"1min":0.90400000000000003,"5min":1.004,"15min":0.96799999999999997},"min":{"1min":0.60699999999999998,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.1599999999999999,"5min":3.089,"15min":3.089},"last":0.96899999999999997}]},{"osd":6,"last update":"Sat Jun 10 18:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":1.105,"15min":1.0309999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.472,"5min":7.2599999999999998,"15min":7.2599999999999998},"last":1.135},{"interface":"front","average":{"1min":0.92900000000000005,"5min":1.0940000000000001,"15min":1.026},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.2090000000000001,"5min":9.0069999999999997,"15min":9.0069999999999997},"last":0.92900000000000005}]},{"osd":7,"last update":"Sat Jun 10 18:56:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.0920000000000001,"15min":1.081},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.3440000000000001,"5min":2.105,"15min":2.105},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.083,"15min":1.0669999999999999},"min":{"1min":0.65600000000000003,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.673,"5min":2.2570000000000001,"15min":2.2570000000000001},"last":1.0620000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574909,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32388,"kb_used_data":1340,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339452,"statfs":{"total":96636764160,"available":96603598848,"internally_reserved":0,"allocated":1372160,"data_stored":936042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jun 10 18:56:40 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.626,"15min":0.60299999999999998},"min":{"1min":0.35599999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.93899999999999995,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.78500000000000003,"15min":0.75},"min":{"1min":0.53100000000000003,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.028,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.379}]},{"osd":2,"last update":"Sat Jun 10 18:56:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.71399999999999997,"15min":0.69899999999999995},"min":{"1min":0.39400000000000002,"5min":0.313,"15min":0.313},"max":{"1min":1.073,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.308},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65400000000000003,"15min":0.63300000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.95099999999999996,"5min":1.371,"15min":1.371},"last":0.39800000000000002}]},{"osd":3,"last update":"Sat Jun 10 18:56:40 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.70099999999999996,"15min":0.67700000000000005},"min":{"1min":0.377,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.087,"5min":1.226,"15min":1.226},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.84099999999999997,"15min":0.81399999999999995},"min":{"1min":0.435,"5min":0.375,"15min":0.375},"max":{"1min":1.296,"5min":1.829,"15min":1.829},"last":0.41099999999999998}]},{"osd":4,"last update":"Sat Jun 10 18:56:40 2023","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.91100000000000003,"15min":0.89300000000000002},"min":{"1min":0.59099999999999997,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.173,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.63},{"interface":"front","average":{"1min":1.034,"5min":1.0369999999999999,"15min":1.034},"min":{"1min":0.65600000000000003,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.2729999999999999,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":0.74399999999999999}]},{"osd":5,"last update":"Sat Jun 10 18:56:40 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.64300000000000002,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.2450000000000001,"5min":1.694,"15min":1.694},"last":0.72399999999999998},{"interface":"front","average":{"1min":1.044,"5min":1.01,"15min":1.0009999999999999},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.3460000000000001,"5min":1.75,"15min":1.75},"last":0.57599999999999996}]},{"osd":6,"last update":"Sat Jun 10 18:56:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.0740000000000001,"15min":1.0569999999999999},"min":{"1min":0.61699999999999999,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.2949999999999999,"5min":2.04,"15min":2.04},"last":0.83099999999999996},{"interface":"front","average":{"1min":1.03,"5min":1.0029999999999999,"15min":0.999},"min":{"1min":0.71099999999999997,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.3280000000000001,"5min":1.883,"15min":1.883},"last":0.60899999999999999}]},{"osd":7,"last update":"Sat Jun 10 18:56:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.044,"15min":1.0349999999999999},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.3360000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":1.099,"5min":1.0660000000000001,"15min":1.054},"min":{"1min":0.69299999999999995,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.4610000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":0.69099999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-10T18:57:21.145 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-06-10T18:57:21.146 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-06-10T18:57:21.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.318+0000 7fe9884c0640 1 Processor -- start 2023-06-10T18:57:21.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.318+0000 7fe9884c0640 1 -- start start 2023-06-10T18:57:21.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.322+0000 7fe9884c0640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe9800b1e00 0x7fe9800b3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:21.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.322+0000 7fe9884c0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9800cf980 0x7fe980069e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:21.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.322+0000 7fe9884c0640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9800699d0 con 0x7fe98015b9f0 2023-06-10T18:57:21.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.322+0000 7fe9884c0640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe980069450 con 0x7fe9800b1e00 2023-06-10T18:57:21.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.322+0000 7fe9884c0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe98015bdc0 con 0x7fe9800cf980 2023-06-10T18:57:21.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.322+0000 7fe985a5b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe9800b1e00 0x7fe9800b3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:21.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.322+0000 7fe98625c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fe98015b9f0 0x7fe9800b3630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:42252/0 (socket says 172.21.15.53:42252) 2023-06-10T18:57:21.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.322+0000 7fe98625c640 1 -- 172.21.15.53:0/1096074474 learned_addr learned my addr 172.21.15.53:0/1096074474 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:57:21.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.322+0000 7fe986a5d640 1 --2- 172.21.15.53:0/1096074474 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9800cf980 0x7fe980069e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:21.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.322+0000 7fe985a5b640 1 -- 172.21.15.53:0/1096074474 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9800cf980 msgr2=0x7fe980069e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:21.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.322+0000 7fe985a5b640 1 --2- 172.21.15.53:0/1096074474 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9800cf980 0x7fe980069e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:21.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.322+0000 7fe985a5b640 1 -- 172.21.15.53:0/1096074474 >> v1:172.21.15.53:6789/0 conn(0x7fe98015b9f0 legacy=0x7fe9800b3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:21.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.322+0000 7fe985a5b640 1 -- 172.21.15.53:0/1096074474 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe980070ca0 con 0x7fe9800b1e00 2023-06-10T18:57:21.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.322+0000 7fe98525a640 1 -- 172.21.15.53:0/1096074474 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 975543696 0 0) 0x7fe9800699d0 con 0x7fe98015b9f0 2023-06-10T18:57:21.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.322+0000 7fe986a5d640 1 --2- 172.21.15.53:0/1096074474 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9800cf980 0x7fe980069e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:57:21.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.322+0000 7fe985a5b640 1 --2- 172.21.15.53:0/1096074474 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9800b1e00 0x7fe9800b3d40 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fe97c0097c0 tx=0x7fe97c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ebe58dfea820a97 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:21.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.322+0000 7fe98525a640 1 -- 172.21.15.53:0/1096074474 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe97c0ab600 con 0x7fe9800b1e00 2023-06-10T18:57:21.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.322+0000 7fe98525a640 1 -- 172.21.15.53:0/1096074474 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe97c0a7050 con 0x7fe9800b1e00 2023-06-10T18:57:21.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.322+0000 7fe98525a640 1 -- 172.21.15.53:0/1096074474 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe97c0ab980 con 0x7fe9800b1e00 2023-06-10T18:57:21.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.322+0000 7fe9884c0640 1 -- 172.21.15.53:0/1096074474 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9800b1e00 msgr2=0x7fe9800b3d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:21.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.322+0000 7fe9884c0640 1 --2- 172.21.15.53:0/1096074474 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9800b1e00 0x7fe9800b3d40 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fe97c0097c0 tx=0x7fe97c01c480 comp rx=0 tx=0).stop 2023-06-10T18:57:21.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.322+0000 7fe9884c0640 1 -- 172.21.15.53:0/1096074474 shutdown_connections 2023-06-10T18:57:21.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.322+0000 7fe9884c0640 1 --2- 172.21.15.53:0/1096074474 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9800b1e00 0x7fe9800b3d40 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:21.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.322+0000 7fe9884c0640 1 --2- 172.21.15.53:0/1096074474 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9800cf980 0x7fe980069e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:21.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.322+0000 7fe9884c0640 1 -- 172.21.15.53:0/1096074474 >> 172.21.15.53:0/1096074474 conn(0x7fe9800b42b0 msgr2=0x7fe9800b46b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:21.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.322+0000 7fe9884c0640 1 -- 172.21.15.53:0/1096074474 shutdown_connections 2023-06-10T18:57:21.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.322+0000 7fe9884c0640 1 -- 172.21.15.53:0/1096074474 wait complete. 2023-06-10T18:57:21.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.326+0000 7fe9884c0640 1 Processor -- start 2023-06-10T18:57:21.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.326+0000 7fe9884c0640 1 -- start start 2023-06-10T18:57:21.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.326+0000 7fe9884c0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9800b1e00 0x7fe9800ae390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:21.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.326+0000 7fe9884c0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9800cf980 0x7fe98015bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:21.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.326+0000 7fe9884c0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe98015b9f0 0x7fe9800afa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:21.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.326+0000 7fe9884c0640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe98015c440 con 0x7fe9800b1e00 2023-06-10T18:57:21.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.326+0000 7fe9884c0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe98015cf10 con 0x7fe98015b9f0 2023-06-10T18:57:21.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.326+0000 7fe9884c0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe98015c670 con 0x7fe9800cf980 2023-06-10T18:57:21.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.326+0000 7fe98625c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9800b1e00 0x7fe9800ae390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:21.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.326+0000 7fe98625c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9800b1e00 0x7fe9800ae390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53940/0 (socket says 172.21.15.53:53940) 2023-06-10T18:57:21.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.326+0000 7fe98625c640 1 -- 172.21.15.53:0/1117697277 learned_addr learned my addr 172.21.15.53:0/1117697277 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:57:21.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.326+0000 7fe986a5d640 1 --2- 172.21.15.53:0/1117697277 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe98015b9f0 0x7fe9800afa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:21.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.326+0000 7fe985a5b640 1 --2- 172.21.15.53:0/1117697277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9800cf980 0x7fe98015bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:21.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.326+0000 7fe98625c640 1 -- 172.21.15.53:0/1117697277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9800cf980 msgr2=0x7fe98015bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:21.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.326+0000 7fe98625c640 1 --2- 172.21.15.53:0/1117697277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9800cf980 0x7fe98015bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:21.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.326+0000 7fe98625c640 1 -- 172.21.15.53:0/1117697277 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe98015b9f0 msgr2=0x7fe9800afa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:21.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.326+0000 7fe98625c640 1 --2- 172.21.15.53:0/1117697277 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe98015b9f0 0x7fe9800afa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:21.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.326+0000 7fe98625c640 1 -- 172.21.15.53:0/1117697277 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe97c009420 con 0x7fe9800b1e00 2023-06-10T18:57:21.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.326+0000 7fe985a5b640 1 --2- 172.21.15.53:0/1117697277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9800cf980 0x7fe98015bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:57:21.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.326+0000 7fe986a5d640 1 --2- 172.21.15.53:0/1117697277 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe98015b9f0 0x7fe9800afa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:57:21.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.326+0000 7fe98625c640 1 --2- 172.21.15.53:0/1117697277 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9800b1e00 0x7fe9800ae390 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fe97000c480 tx=0x7fe97000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:21.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.326+0000 7fe976ffd640 1 -- 172.21.15.53:0/1117697277 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9700074e0 con 0x7fe9800b1e00 2023-06-10T18:57:21.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.326+0000 7fe976ffd640 1 -- 172.21.15.53:0/1117697277 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe970007660 con 0x7fe9800b1e00 2023-06-10T18:57:21.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.326+0000 7fe976ffd640 1 -- 172.21.15.53:0/1117697277 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe970004a30 con 0x7fe9800b1e00 2023-06-10T18:57:21.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.326+0000 7fe9884c0640 1 -- 172.21.15.53:0/1117697277 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe98015c950 con 0x7fe9800b1e00 2023-06-10T18:57:21.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.326+0000 7fe9884c0640 1 -- 172.21.15.53:0/1117697277 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9801489d0 con 0x7fe9800b1e00 2023-06-10T18:57:21.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.326+0000 7fe9884c0640 1 -- 172.21.15.53:0/1117697277 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe980148830 con 0x7fe9800b1e00 2023-06-10T18:57:21.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.330+0000 7fe976ffd640 1 -- 172.21.15.53:0/1117697277 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe970004b90 con 0x7fe9800b1e00 2023-06-10T18:57:21.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.330+0000 7fe976ffd640 1 --2- 172.21.15.53:0/1117697277 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe964066280 0x7fe964068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:21.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.330+0000 7fe976ffd640 1 -- 172.21.15.53:0/1117697277 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe970082f30 con 0x7fe9800b1e00 2023-06-10T18:57:21.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.330+0000 7fe985a5b640 1 --2- 172.21.15.53:0/1117697277 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe964066280 0x7fe964068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:21.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.330+0000 7fe985a5b640 1 --2- 172.21.15.53:0/1117697277 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe964066280 0x7fe964068730 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fe97c0ad000 tx=0x7fe97c0a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:21.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.334+0000 7fe976ffd640 1 -- 172.21.15.53:0/1117697277 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe980148830 con 0x7fe9800b1e00 2023-06-10T18:57:21.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.542+0000 7fe9884c0640 1 -- 172.21.15.53:0/1117697277 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fe980148830 con 0x7fe9800b1e00 2023-06-10T18:57:21.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.554+0000 7fe976ffd640 1 -- 172.21.15.53:0/1117697277 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+0 (secure 0 0 0) 0x7fe980148830 con 0x7fe9800b1e00 2023-06-10T18:57:21.558 INFO:teuthology.orchestra.run.smithi053.stderr:updated caps for client.0 2023-06-10T18:57:21.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.554+0000 7fe9884c0640 1 -- 172.21.15.53:0/1117697277 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe964066280 msgr2=0x7fe964068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:21.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.554+0000 7fe9884c0640 1 --2- 172.21.15.53:0/1117697277 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe964066280 0x7fe964068730 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fe97c0ad000 tx=0x7fe97c0a6000 comp rx=0 tx=0).stop 2023-06-10T18:57:21.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.554+0000 7fe9884c0640 1 -- 172.21.15.53:0/1117697277 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9800b1e00 msgr2=0x7fe9800ae390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:21.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.554+0000 7fe9884c0640 1 --2- 172.21.15.53:0/1117697277 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9800b1e00 0x7fe9800ae390 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fe97000c480 tx=0x7fe97000c940 comp rx=0 tx=0).stop 2023-06-10T18:57:21.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.554+0000 7fe9884c0640 1 -- 172.21.15.53:0/1117697277 shutdown_connections 2023-06-10T18:57:21.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.554+0000 7fe9884c0640 1 --2- 172.21.15.53:0/1117697277 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe964066280 0x7fe964068730 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:21.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.554+0000 7fe9884c0640 1 --2- 172.21.15.53:0/1117697277 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe98015b9f0 0x7fe9800afa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:21.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.554+0000 7fe9884c0640 1 --2- 172.21.15.53:0/1117697277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9800cf980 0x7fe98015bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:21.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.554+0000 7fe9884c0640 1 --2- 172.21.15.53:0/1117697277 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9800b1e00 0x7fe9800ae390 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:21.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.554+0000 7fe9884c0640 1 -- 172.21.15.53:0/1117697277 >> 172.21.15.53:0/1117697277 conn(0x7fe9800b42b0 msgr2=0x7fe9800b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:21.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.554+0000 7fe9884c0640 1 -- 172.21.15.53:0/1117697277 shutdown_connections 2023-06-10T18:57:21.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.554+0000 7fe9884c0640 1 -- 172.21.15.53:0/1117697277 wait complete. 2023-06-10T18:57:21.578 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T18:57:21.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.702+0000 7fed5679a640 1 Processor -- start 2023-06-10T18:57:21.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.702+0000 7fed5679a640 1 -- start start 2023-06-10T18:57:21.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.702+0000 7fed5679a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fed5015fe00 0x7fed50163980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:21.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.702+0000 7fed5679a640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed501648e0 con 0x7fed500cb870 2023-06-10T18:57:21.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.702+0000 7fed5679a640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed5006b2c0 con 0x7fed500afe30 2023-06-10T18:57:21.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.702+0000 7fed5679a640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed500cbcc0 con 0x7fed5015fe00 2023-06-10T18:57:21.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.702+0000 7fed4ffff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fed5015fe00 0x7fed50163980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:21.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.702+0000 7fed4ffff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fed5015fe00 0x7fed50163980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53946/0 (socket says 172.21.15.53:53946) 2023-06-10T18:57:21.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.702+0000 7fed4ffff640 1 -- 172.21.15.53:0/415590835 learned_addr learned my addr 172.21.15.53:0/415590835 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:57:21.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.702+0000 7fed47fff640 1 --1- 172.21.15.53:0/415590835 >> v1:172.21.15.53:6789/0 conn(0x7fed500cb870 0x7fed500af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:42256/0 (socket says 172.21.15.53:42256) 2023-06-10T18:57:21.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.702+0000 7fed4ffff640 1 -- 172.21.15.53:0/415590835 >> v1:172.21.15.117:6789/0 conn(0x7fed500afe30 legacy=0x7fed5006b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:21.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.702+0000 7fed4ffff640 1 -- 172.21.15.53:0/415590835 >> v1:172.21.15.53:6789/0 conn(0x7fed500cb870 legacy=0x7fed500af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:21.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.702+0000 7fed4ffff640 1 -- 172.21.15.53:0/415590835 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed50164040 con 0x7fed5015fe00 2023-06-10T18:57:21.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.702+0000 7fed4f7fe640 1 -- 172.21.15.53:0/415590835 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3009398674 0 0) 0x7fed501648e0 con 0x7fed500cb870 2023-06-10T18:57:21.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.706+0000 7fed4ffff640 1 --2- 172.21.15.53:0/415590835 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed5015fe00 0x7fed50163980 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fed40009870 tx=0x7fed4001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e95e2cfca65ca37 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:21.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.706+0000 7fed4f7fe640 1 -- 172.21.15.53:0/415590835 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed400aa430 con 0x7fed5015fe00 2023-06-10T18:57:21.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.706+0000 7fed4f7fe640 1 -- 172.21.15.53:0/415590835 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed400aa590 con 0x7fed5015fe00 2023-06-10T18:57:21.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.706+0000 7fed4f7fe640 1 -- 172.21.15.53:0/415590835 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed400aa920 con 0x7fed5015fe00 2023-06-10T18:57:21.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.706+0000 7fed5679a640 1 -- 172.21.15.53:0/415590835 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed5015fe00 msgr2=0x7fed50163980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:21.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.706+0000 7fed5679a640 1 --2- 172.21.15.53:0/415590835 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed5015fe00 0x7fed50163980 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fed40009870 tx=0x7fed4001c4d0 comp rx=0 tx=0).stop 2023-06-10T18:57:21.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.706+0000 7fed5679a640 1 -- 172.21.15.53:0/415590835 shutdown_connections 2023-06-10T18:57:21.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.706+0000 7fed5679a640 1 --2- 172.21.15.53:0/415590835 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed5015fe00 0x7fed50163980 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:21.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.706+0000 7fed5679a640 1 -- 172.21.15.53:0/415590835 >> 172.21.15.53:0/415590835 conn(0x7fed5006a0d0 msgr2=0x7fed500ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:21.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.706+0000 7fed5679a640 1 -- 172.21.15.53:0/415590835 shutdown_connections 2023-06-10T18:57:21.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.706+0000 7fed5679a640 1 -- 172.21.15.53:0/415590835 wait complete. 2023-06-10T18:57:21.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.706+0000 7fed5679a640 1 Processor -- start 2023-06-10T18:57:21.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.706+0000 7fed5679a640 1 -- start start 2023-06-10T18:57:21.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.706+0000 7fed5679a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed500afe30 0x7fed500c7620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:21.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.706+0000 7fed5679a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed500cb870 0x7fed5015acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:21.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.706+0000 7fed5679a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed5015fe00 0x7fed5015b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:21.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.706+0000 7fed5679a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed500c2040 con 0x7fed500cb870 2023-06-10T18:57:21.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.706+0000 7fed5679a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed5015ec00 con 0x7fed500afe30 2023-06-10T18:57:21.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.706+0000 7fed5679a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed500c1710 con 0x7fed5015fe00 2023-06-10T18:57:21.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.706+0000 7fed47fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed500cb870 0x7fed5015acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:21.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.706+0000 7fed47fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed500cb870 0x7fed5015acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53962/0 (socket says 172.21.15.53:53962) 2023-06-10T18:57:21.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.706+0000 7fed47fff640 1 -- 172.21.15.53:0/435946447 learned_addr learned my addr 172.21.15.53:0/435946447 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:57:21.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.706+0000 7fed4ffff640 1 --2- 172.21.15.53:0/435946447 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed500afe30 0x7fed500c7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:21.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.706+0000 7fed54d37640 1 --2- 172.21.15.53:0/435946447 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed5015fe00 0x7fed5015b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:21.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.706+0000 7fed47fff640 1 -- 172.21.15.53:0/435946447 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed5015fe00 msgr2=0x7fed5015b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:21.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.706+0000 7fed47fff640 1 --2- 172.21.15.53:0/435946447 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed5015fe00 0x7fed5015b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:21.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.706+0000 7fed47fff640 1 -- 172.21.15.53:0/435946447 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed500afe30 msgr2=0x7fed500c7620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:21.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.706+0000 7fed47fff640 1 --2- 172.21.15.53:0/435946447 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed500afe30 0x7fed500c7620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:21.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.706+0000 7fed47fff640 1 -- 172.21.15.53:0/435946447 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed400094d0 con 0x7fed500cb870 2023-06-10T18:57:21.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.706+0000 7fed4ffff640 1 --2- 172.21.15.53:0/435946447 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed500afe30 0x7fed500c7620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:57:21.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.706+0000 7fed54d37640 1 --2- 172.21.15.53:0/435946447 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed5015fe00 0x7fed5015b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:57:21.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.710+0000 7fed47fff640 1 --2- 172.21.15.53:0/435946447 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed500cb870 0x7fed5015acc0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fed380011f0 tx=0x7fed3800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:21.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.710+0000 7fed4d7fa640 1 -- 172.21.15.53:0/435946447 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed380074e0 con 0x7fed500cb870 2023-06-10T18:57:21.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.710+0000 7fed4d7fa640 1 -- 172.21.15.53:0/435946447 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed38007640 con 0x7fed500cb870 2023-06-10T18:57:21.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.710+0000 7fed5679a640 1 -- 172.21.15.53:0/435946447 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed500c19f0 con 0x7fed500cb870 2023-06-10T18:57:21.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.710+0000 7fed4d7fa640 1 -- 172.21.15.53:0/435946447 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed38004a10 con 0x7fed500cb870 2023-06-10T18:57:21.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.710+0000 7fed5679a640 1 -- 172.21.15.53:0/435946447 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed500c7b60 con 0x7fed500cb870 2023-06-10T18:57:21.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.710+0000 7fed5679a640 1 -- 172.21.15.53:0/435946447 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed500c21f0 con 0x7fed500cb870 2023-06-10T18:57:21.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.710+0000 7fed4d7fa640 1 -- 172.21.15.53:0/435946447 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fed38004b70 con 0x7fed500cb870 2023-06-10T18:57:21.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.710+0000 7fed4d7fa640 1 --2- 172.21.15.53:0/435946447 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fed300662b0 0x7fed30068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:21.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.710+0000 7fed4d7fa640 1 -- 172.21.15.53:0/435946447 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fed38083260 con 0x7fed500cb870 2023-06-10T18:57:21.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.710+0000 7fed4ffff640 1 --2- 172.21.15.53:0/435946447 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fed300662b0 0x7fed30068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:21.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.710+0000 7fed4ffff640 1 --2- 172.21.15.53:0/435946447 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fed300662b0 0x7fed30068760 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fed400ae000 tx=0x7fed40008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:21.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.714+0000 7fed4d7fa640 1 -- 172.21.15.53:0/435946447 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fed500c21f0 con 0x7fed500cb870 2023-06-10T18:57:21.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.902+0000 7fed5679a640 1 -- 172.21.15.53:0/435946447 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fed500c8400 con 0x7fed500cb870 2023-06-10T18:57:21.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.902+0000 7fed4d7fa640 1 -- 172.21.15.53:0/435946447 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4669 (secure 0 0 0) 0x7fed380506e0 con 0x7fed500cb870 2023-06-10T18:57:21.907 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:57:21.908 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":26,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5444,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1300171732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":1300171732},{"type":"v1","addr":"172.21.15.117:6837","nonce":1300171732}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5818,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/507478314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":507478314},{"type":"v1","addr":"172.21.15.117:6836","nonce":507478314}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":6504,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/169051241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":169051241},{"type":"v1","addr":"172.21.15.53:6833","nonce":169051241}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T18:57:13.234809+0000","modified":"2023-06-10T18:57:15.250305+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6507},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6507":{"gid":6507,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/486797221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":486797221},{"type":"v1","addr":"172.21.15.53:6835","nonce":486797221}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-06-10T18:57:21.908 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 26 2023-06-10T18:57:21.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.902+0000 7fed5679a640 1 -- 172.21.15.53:0/435946447 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fed300662b0 msgr2=0x7fed30068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:21.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.902+0000 7fed5679a640 1 --2- 172.21.15.53:0/435946447 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fed300662b0 0x7fed30068760 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fed400ae000 tx=0x7fed40008040 comp rx=0 tx=0).stop 2023-06-10T18:57:21.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.906+0000 7fed5679a640 1 -- 172.21.15.53:0/435946447 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed500cb870 msgr2=0x7fed5015acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:21.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.906+0000 7fed5679a640 1 --2- 172.21.15.53:0/435946447 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed500cb870 0x7fed5015acc0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fed380011f0 tx=0x7fed3800c9b0 comp rx=0 tx=0).stop 2023-06-10T18:57:21.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.906+0000 7fed5679a640 1 -- 172.21.15.53:0/435946447 shutdown_connections 2023-06-10T18:57:21.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.906+0000 7fed5679a640 1 --2- 172.21.15.53:0/435946447 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fed300662b0 0x7fed30068760 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:21.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.906+0000 7fed5679a640 1 --2- 172.21.15.53:0/435946447 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed5015fe00 0x7fed5015b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:21.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.906+0000 7fed5679a640 1 --2- 172.21.15.53:0/435946447 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed500cb870 0x7fed5015acc0 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:21.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.906+0000 7fed5679a640 1 --2- 172.21.15.53:0/435946447 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed500afe30 0x7fed500c7620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:21.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.906+0000 7fed5679a640 1 -- 172.21.15.53:0/435946447 >> 172.21.15.53:0/435946447 conn(0x7fed5006a0d0 msgr2=0x7fed5006b750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:21.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.906+0000 7fed5679a640 1 -- 172.21.15.53:0/435946447 shutdown_connections 2023-06-10T18:57:21.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:21.906+0000 7fed5679a640 1 -- 172.21.15.53:0/435946447 wait complete. 2023-06-10T18:57:22.328 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-06-10T18:57:13.234809+0000', 'modified': '2023-06-10T18:57:15.250305+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6507}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6507': {'gid': 6507, 'name': 'a', 'rank': 0, 'incarnation': 24, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.53:6835/486797221', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.53:6834', 'nonce': 486797221}, {'type': 'v1', 'addr': '172.21.15.53:6835', 'nonce': 486797221}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-06-10T18:57:22.329 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-06-10T18:57:22.329 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-06-10T18:57:22.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.458+0000 7f800adc6640 1 Processor -- start 2023-06-10T18:57:22.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.458+0000 7f800adc6640 1 -- start start 2023-06-10T18:57:22.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.458+0000 7f800adc6640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f80041571a0 0x7f80040c9f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:22.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.458+0000 7f800adc6640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8004071190 con 0x7f8004070100 2023-06-10T18:57:22.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.458+0000 7f800adc6640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80040ca440 con 0x7f80040afee0 2023-06-10T18:57:22.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.458+0000 7f800adc6640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8004070580 con 0x7f80041571a0 2023-06-10T18:57:22.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.458+0000 7f8008b62640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f80041571a0 0x7f80040c9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:22.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.458+0000 7f8003fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f8004070100 0x7f80040af7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:42266/0 (socket says 172.21.15.53:42266) 2023-06-10T18:57:22.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.458+0000 7f8003fff640 1 -- 172.21.15.53:0/2496457129 learned_addr learned my addr 172.21.15.53:0/2496457129 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:57:22.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.462+0000 7f8008b62640 1 -- 172.21.15.53:0/2496457129 >> v1:172.21.15.117:6789/0 conn(0x7f80040afee0 legacy=0x7f80040c83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:22.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.462+0000 7f8008b62640 1 -- 172.21.15.53:0/2496457129 >> v1:172.21.15.53:6789/0 conn(0x7f8004070100 legacy=0x7f80040af7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:22.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.462+0000 7f8008b62640 1 -- 172.21.15.53:0/2496457129 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8004070860 con 0x7f80041571a0 2023-06-10T18:57:22.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.462+0000 7f8008b62640 1 --2- 172.21.15.53:0/2496457129 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80041571a0 0x7f80040c9f00 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f7ff40097a0 tx=0x7f7ff401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33d88509c8ab4b5f server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:22.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.462+0000 7f80037fe640 1 -- 172.21.15.53:0/2496457129 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff40a7070 con 0x7f80041571a0 2023-06-10T18:57:22.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.462+0000 7f80037fe640 1 -- 172.21.15.53:0/2496457129 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ff40ab430 con 0x7f80041571a0 2023-06-10T18:57:22.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.462+0000 7f80037fe640 1 -- 172.21.15.53:0/2496457129 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff40ab7c0 con 0x7f80041571a0 2023-06-10T18:57:22.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.462+0000 7f800adc6640 1 -- 172.21.15.53:0/2496457129 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80041571a0 msgr2=0x7f80040c9f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:22.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.462+0000 7f800adc6640 1 --2- 172.21.15.53:0/2496457129 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80041571a0 0x7f80040c9f00 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f7ff40097a0 tx=0x7f7ff401c430 comp rx=0 tx=0).stop 2023-06-10T18:57:22.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.462+0000 7f800adc6640 1 -- 172.21.15.53:0/2496457129 shutdown_connections 2023-06-10T18:57:22.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.462+0000 7f800adc6640 1 --2- 172.21.15.53:0/2496457129 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80041571a0 0x7f80040c9f00 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:22.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.462+0000 7f800adc6640 1 -- 172.21.15.53:0/2496457129 >> 172.21.15.53:0/2496457129 conn(0x7f80040ce9e0 msgr2=0x7f80040ca7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:22.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.462+0000 7f800adc6640 1 -- 172.21.15.53:0/2496457129 shutdown_connections 2023-06-10T18:57:22.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.462+0000 7f800adc6640 1 -- 172.21.15.53:0/2496457129 wait complete. 2023-06-10T18:57:22.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.466+0000 7f800adc6640 1 Processor -- start 2023-06-10T18:57:22.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.466+0000 7f800adc6640 1 -- start start 2023-06-10T18:57:22.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.466+0000 7f800adc6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80040afee0 0x7f80040cbb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:22.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.466+0000 7f800adc6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80041571a0 0x7f8004147010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:22.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.466+0000 7f800adc6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8004147550 0x7f800415b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:22.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.466+0000 7f800adc6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f800415d040 con 0x7f80041571a0 2023-06-10T18:57:22.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.466+0000 7f800adc6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80040b2f20 con 0x7f80040afee0 2023-06-10T18:57:22.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.466+0000 7f800adc6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f800415d320 con 0x7f8004147550 2023-06-10T18:57:22.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.466+0000 7f8003fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80041571a0 0x7f8004147010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:22.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.466+0000 7f8003fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80041571a0 0x7f8004147010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53986/0 (socket says 172.21.15.53:53986) 2023-06-10T18:57:22.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.466+0000 7f8003fff640 1 -- 172.21.15.53:0/460522448 learned_addr learned my addr 172.21.15.53:0/460522448 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:57:22.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.466+0000 7f8009363640 1 --2- 172.21.15.53:0/460522448 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8004147550 0x7f800415b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:22.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.466+0000 7f8008b62640 1 --2- 172.21.15.53:0/460522448 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80040afee0 0x7f80040cbb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:22.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.466+0000 7f8003fff640 1 -- 172.21.15.53:0/460522448 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8004147550 msgr2=0x7f800415b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:22.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.466+0000 7f8003fff640 1 --2- 172.21.15.53:0/460522448 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8004147550 0x7f800415b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:22.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.466+0000 7f8003fff640 1 -- 172.21.15.53:0/460522448 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80040afee0 msgr2=0x7f80040cbb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:22.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.466+0000 7f8003fff640 1 --2- 172.21.15.53:0/460522448 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80040afee0 0x7f80040cbb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:22.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.466+0000 7f8003fff640 1 -- 172.21.15.53:0/460522448 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ff40093b0 con 0x7f80041571a0 2023-06-10T18:57:22.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.466+0000 7f8008b62640 1 --2- 172.21.15.53:0/460522448 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80040afee0 0x7f80040cbb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:57:22.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.466+0000 7f8003fff640 1 --2- 172.21.15.53:0/460522448 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80041571a0 0x7f8004147010 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f7ff800c4d0 tx=0x7f7ff800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:22.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.466+0000 7f80017fa640 1 -- 172.21.15.53:0/460522448 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff8005cf0 con 0x7f80041571a0 2023-06-10T18:57:22.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.466+0000 7f80017fa640 1 -- 172.21.15.53:0/460522448 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ff8005e50 con 0x7f80041571a0 2023-06-10T18:57:22.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.466+0000 7f800adc6640 1 -- 172.21.15.53:0/460522448 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80041479b0 con 0x7f80041571a0 2023-06-10T18:57:22.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.466+0000 7f80017fa640 1 -- 172.21.15.53:0/460522448 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff8007270 con 0x7f80041571a0 2023-06-10T18:57:22.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.466+0000 7f800adc6640 1 -- 172.21.15.53:0/460522448 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f800415c980 con 0x7f80041571a0 2023-06-10T18:57:22.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.470+0000 7f80017fa640 1 -- 172.21.15.53:0/460522448 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7ff80073d0 con 0x7f80041571a0 2023-06-10T18:57:22.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.470+0000 7f80017fa640 1 --2- 172.21.15.53:0/460522448 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7ff0066280 0x7f7ff0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:22.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.470+0000 7f80017fa640 1 -- 172.21.15.53:0/460522448 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7ff80830f0 con 0x7f80041571a0 2023-06-10T18:57:22.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.470+0000 7f8008b62640 1 --2- 172.21.15.53:0/460522448 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7ff0066280 0x7f7ff0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:22.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.470+0000 7f800dee2000 1 Processor -- start 2023-06-10T18:57:22.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.470+0000 7f800dee2000 1 -- start start 2023-06-10T18:57:22.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.470+0000 7f8008b62640 1 --2- 172.21.15.53:0/460522448 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7ff0066280 0x7f7ff0068730 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f7ff40af000 tx=0x7f7ff4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:22.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.470+0000 7f800dee2000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ec28aebd40 0x55ec28aec110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:22.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.470+0000 7f800dee2000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec28aec650 0x55ec28aa1c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:22.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.470+0000 7f800dee2000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ec28aa2190 0x55ec28aa2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:22.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.470+0000 7f800dee2000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec28965ac0 con 0x55ec28aec650 2023-06-10T18:57:22.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.470+0000 7f800dee2000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec2889f840 con 0x55ec28aa2190 2023-06-10T18:57:22.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.470+0000 7f800dee2000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ec288f32e0 con 0x55ec28aebd40 2023-06-10T18:57:22.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.470+0000 7f8003fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec28aec650 0x55ec28aa1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:22.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.470+0000 7f8003fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec28aec650 0x55ec28aa1c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54000/0 (socket says 172.21.15.53:54000) 2023-06-10T18:57:22.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.470+0000 7f8003fff640 1 -- 172.21.15.53:0/3856001216 learned_addr learned my addr 172.21.15.53:0/3856001216 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:57:22.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.470+0000 7f8003fff640 1 -- 172.21.15.53:0/3856001216 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ec28aebd40 msgr2=0x55ec28aec110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:22.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.470+0000 7f8003fff640 1 --2- 172.21.15.53:0/3856001216 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ec28aebd40 0x55ec28aec110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:22.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.470+0000 7f8003fff640 1 -- 172.21.15.53:0/3856001216 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ec28aa2190 msgr2=0x55ec28aa2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:22.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.470+0000 7f8003fff640 1 --2- 172.21.15.53:0/3856001216 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ec28aa2190 0x55ec28aa2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:22.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.470+0000 7f8003fff640 1 -- 172.21.15.53:0/3856001216 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ec285e8890 con 0x55ec28aec650 2023-06-10T18:57:22.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.470+0000 7f8003fff640 1 --2- 172.21.15.53:0/3856001216 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec28aec650 0x55ec28aa1c50 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f7ff8081570 tx=0x7f7ff8058400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b918362564b7a264 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:22.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.470+0000 7f7fea7fc640 1 -- 172.21.15.53:0/3856001216 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff8052570 con 0x55ec28aec650 2023-06-10T18:57:22.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.470+0000 7f7fea7fc640 1 -- 172.21.15.53:0/3856001216 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ff8007680 con 0x55ec28aec650 2023-06-10T18:57:22.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.470+0000 7f7fea7fc640 1 -- 172.21.15.53:0/3856001216 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff805c180 con 0x55ec28aec650 2023-06-10T18:57:22.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.470+0000 7f800dee2000 1 -- 172.21.15.53:0/3856001216 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec28aec650 msgr2=0x55ec28aa1c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:22.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.470+0000 7f800dee2000 1 --2- 172.21.15.53:0/3856001216 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec28aec650 0x55ec28aa1c50 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f7ff8081570 tx=0x7f7ff8058400 comp rx=0 tx=0).stop 2023-06-10T18:57:22.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.470+0000 7f800dee2000 1 -- 172.21.15.53:0/3856001216 shutdown_connections 2023-06-10T18:57:22.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.470+0000 7f800dee2000 1 --2- 172.21.15.53:0/3856001216 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ec28aa2190 0x55ec28aa2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:22.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.470+0000 7f800dee2000 1 --2- 172.21.15.53:0/3856001216 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec28aec650 0x55ec28aa1c50 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:22.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.470+0000 7f800dee2000 1 --2- 172.21.15.53:0/3856001216 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ec28aebd40 0x55ec28aec110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:22.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.474+0000 7f800dee2000 1 -- 172.21.15.53:0/3856001216 >> 172.21.15.53:0/3856001216 conn(0x55ec28a95800 msgr2=0x55ec28aa4800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:22.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.474+0000 7f800dee2000 1 -- 172.21.15.53:0/3856001216 shutdown_connections 2023-06-10T18:57:22.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.474+0000 7f800dee2000 1 -- 172.21.15.53:0/3856001216 wait complete. 2023-06-10T18:57:22.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.474+0000 7f800dee2000 1 -- start start 2023-06-10T18:57:22.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.474+0000 7f800dee2000 1 Processor -- start 2023-06-10T18:57:22.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.474+0000 7f800dee2000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec28aa2190 0x55ec28ad9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:22.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.474+0000 7f800dee2000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ec28aebd40 0x55ec28ada020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:22.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.474+0000 7f800dee2000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ec28aec650 0x55ec28ada560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:22.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.474+0000 7f800dee2000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec288ec380 con 0x55ec28aa2190 2023-06-10T18:57:22.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.474+0000 7f800dee2000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec288a8ae0 con 0x55ec28aec650 2023-06-10T18:57:22.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.474+0000 7f800dee2000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ec288a8780 con 0x55ec28aebd40 2023-06-10T18:57:22.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.474+0000 7f800dee2000 10 client.0 _ll_register_callbacks cb 0x55ec28a89e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-10T18:57:22.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.474+0000 7f8008b62640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec28aa2190 0x55ec28ad9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:22.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.474+0000 7f8008b62640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec28aa2190 0x55ec28ad9ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54008/0 (socket says 172.21.15.53:54008) 2023-06-10T18:57:22.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.474+0000 7f8008b62640 1 -- 172.21.15.53:0/1907956272 learned_addr learned my addr 172.21.15.53:0/1907956272 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:57:22.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.474+0000 7f8009363640 1 --2- 172.21.15.53:0/1907956272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ec28aec650 0x55ec28ada560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:22.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.474+0000 7f8003fff640 1 --2- 172.21.15.53:0/1907956272 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ec28aebd40 0x55ec28ada020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:22.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.474+0000 7f8008b62640 1 -- 172.21.15.53:0/1907956272 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ec28aebd40 msgr2=0x55ec28ada020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:22.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.474+0000 7f8008b62640 1 --2- 172.21.15.53:0/1907956272 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ec28aebd40 0x55ec28ada020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:22.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.474+0000 7f8008b62640 1 -- 172.21.15.53:0/1907956272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ec28aec650 msgr2=0x55ec28ada560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:22.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.474+0000 7f8008b62640 1 --2- 172.21.15.53:0/1907956272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ec28aec650 0x55ec28ada560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:22.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.474+0000 7f8008b62640 1 -- 172.21.15.53:0/1907956272 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f800415c980 con 0x55ec28aa2190 2023-06-10T18:57:22.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.474+0000 7f8008b62640 1 --2- 172.21.15.53:0/1907956272 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec28aa2190 0x55ec28ad9ae0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f7ff401c470 tx=0x7f7ff401ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=800f72726c09b9da server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:22.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.474+0000 7f7fe37fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-06-10T18:57:22.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.474+0000 7f7fe37fe640 1 -- 172.21.15.53:0/1907956272 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff40c13f0 con 0x55ec28aa2190 2023-06-10T18:57:22.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.474+0000 7f7fe37fe640 1 -- 172.21.15.53:0/1907956272 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(65..65 src has 1..65) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7ff40c1550 con 0x55ec28aa2190 2023-06-10T18:57:22.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.474+0000 7f800dee2000 1 -- 172.21.15.53:0/1907956272 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ec288b3a20 con 0x55ec28aa2190 2023-06-10T18:57:22.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.474+0000 7f7fe37fe640 1 -- 172.21.15.53:0/1907956272 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7ff40c1730 con 0x55ec28aa2190 2023-06-10T18:57:22.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.474+0000 7f800dee2000 10 client.6681 fetch_fsmap learned FSMap version 26 2023-06-10T18:57:22.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.474+0000 7f800dee2000 1 -- 172.21.15.53:0/1907956272 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x55ec288b0d10 con 0x55ec28aa2190 2023-06-10T18:57:22.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.474+0000 7f7fe37fe640 1 -- 172.21.15.53:0/1907956272 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ec288b3a20 con 0x55ec28aa2190 2023-06-10T18:57:22.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.474+0000 7f7fe37fe640 1 -- 172.21.15.53:0/1907956272 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 26) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f7ff40c0070 con 0x55ec28aa2190 2023-06-10T18:57:22.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.474+0000 7f800dee2000 10 client.6681 fetch_fsmap finished waiting for FSMap version 26 2023-06-10T18:57:22.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.474+0000 7f800dee2000 10 client.6681 resolve_mds: resolved name 'a' to daemon mds.a 2023-06-10T18:57:22.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.474+0000 7f800dee2000 20 client.6681 populate_metadata read hostname 'smithi053' 2023-06-10T18:57:22.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.474+0000 7f800dee2000 1 --2- 172.21.15.53:0/1907956272 >> [v2:172.21.15.53:6834/486797221,v1:172.21.15.53:6835/486797221] conn(0x55ec28adae30 0x55ec28afd290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:22.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.474+0000 7f800dee2000 4 client.6681 mds_command: new command op to 6507 tid=0[{"prefix": "get_command_descriptions"}] 2023-06-10T18:57:22.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.474+0000 7f800dee2000 1 -- 172.21.15.53:0/1907956272 --> [v2:172.21.15.53:6834/486797221,v1:172.21.15.53:6835/486797221] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ec2891b710 con 0x55ec28adae30 2023-06-10T18:57:22.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.474+0000 7f8003fff640 1 --2- 172.21.15.53:0/1907956272 >> [v2:172.21.15.53:6834/486797221,v1:172.21.15.53:6835/486797221] conn(0x55ec28adae30 0x55ec28afd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:22.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.474+0000 7f7fe37fe640 10 client.6681 ms_handle_connect on v2:172.21.15.53:6834/486797221 2023-06-10T18:57:22.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.474+0000 7f8003fff640 1 --2- 172.21.15.53:0/1907956272 >> [v2:172.21.15.53:6834/486797221,v1:172.21.15.53:6835/486797221] conn(0x55ec28adae30 0x55ec28afd290 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd700e5599bdfcf6 server_cookie=cb17ceffe3d236d0 in_seq=0 out_seq=0 2023-06-10T18:57:22.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.474+0000 7f7fe37fe640 1 -- 172.21.15.53:0/1907956272 <== mds.0 v2:172.21.15.53:6834/486797221 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55ec2891b710 con 0x55ec28adae30 2023-06-10T18:57:22.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.478+0000 7f7fe37fe640 10 client.6681 handle_command_reply: tid=0 2023-06-10T18:57:22.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.478+0000 7f800dee2000 1 client.6681 shutdown 2023-06-10T18:57:22.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.478+0000 7f800dee2000 1 -- 172.21.15.53:0/1907956272 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec28aa2190 msgr2=0x55ec28ad9ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:22.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.478+0000 7f800dee2000 1 --2- 172.21.15.53:0/1907956272 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec28aa2190 0x55ec28ad9ae0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f7ff401c470 tx=0x7f7ff401ac70 comp rx=0 tx=0).stop 2023-06-10T18:57:22.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.478+0000 7f800dee2000 1 -- 172.21.15.53:0/1907956272 shutdown_connections 2023-06-10T18:57:22.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.478+0000 7f800dee2000 1 --2- 172.21.15.53:0/1907956272 >> [v2:172.21.15.53:6834/486797221,v1:172.21.15.53:6835/486797221] conn(0x55ec28adae30 0x55ec28afd290 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:22.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.478+0000 7f800dee2000 1 --2- 172.21.15.53:0/1907956272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ec28aec650 0x55ec28ada560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:22.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.478+0000 7f800dee2000 1 --2- 172.21.15.53:0/1907956272 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ec28aebd40 0x55ec28ada020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:22.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.478+0000 7f7fe37fe640 0 client.6681 ms_handle_reset on v2:172.21.15.53:6834/486797221 2023-06-10T18:57:22.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.478+0000 7f800dee2000 1 --2- 172.21.15.53:0/1907956272 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec28aa2190 0x55ec28ad9ae0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:22.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.478+0000 7f800dee2000 1 -- 172.21.15.53:0/1907956272 >> 172.21.15.53:0/1907956272 conn(0x55ec28a95800 msgr2=0x55ec28aa3000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:22.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.478+0000 7f800dee2000 1 -- 172.21.15.53:0/1907956272 shutdown_connections 2023-06-10T18:57:22.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.478+0000 7f800dee2000 1 -- 172.21.15.53:0/1907956272 wait complete. 2023-06-10T18:57:22.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.478+0000 7f800dee2000 20 client.6681 trim_cache size 0 max 16384 2023-06-10T18:57:22.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.490+0000 7f800dee2000 1 Processor -- start 2023-06-10T18:57:22.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.494+0000 7f800dee2000 1 -- start start 2023-06-10T18:57:22.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.494+0000 7f800dee2000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ec28aa2190 0x55ec28a9c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:22.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.494+0000 7f800dee2000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec28aebd40 0x55ec28a9cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:22.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.494+0000 7f800dee2000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ec28aec650 0x55ec28afb280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:22.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.494+0000 7f800dee2000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec285a9940 con 0x55ec28aebd40 2023-06-10T18:57:22.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.494+0000 7f800dee2000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec28aff8f0 con 0x55ec28aec650 2023-06-10T18:57:22.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.494+0000 7f800dee2000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ec288bae10 con 0x55ec28aa2190 2023-06-10T18:57:22.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.494+0000 7f8003fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec28aebd40 0x55ec28a9cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:22.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.494+0000 7f8003fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec28aebd40 0x55ec28a9cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54020/0 (socket says 172.21.15.53:54020) 2023-06-10T18:57:22.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.494+0000 7f8003fff640 1 -- 172.21.15.53:0/2849573168 learned_addr learned my addr 172.21.15.53:0/2849573168 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:57:22.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.494+0000 7f8003fff640 1 -- 172.21.15.53:0/2849573168 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ec28aa2190 msgr2=0x55ec28a9c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:22.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.494+0000 7f8003fff640 1 --2- 172.21.15.53:0/2849573168 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ec28aa2190 0x55ec28a9c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:22.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.494+0000 7f8003fff640 1 -- 172.21.15.53:0/2849573168 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ec28aec650 msgr2=0x55ec28afb280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:22.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.494+0000 7f8003fff640 1 --2- 172.21.15.53:0/2849573168 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ec28aec650 0x55ec28afb280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:22.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.494+0000 7f8003fff640 1 -- 172.21.15.53:0/2849573168 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ec28896fa0 con 0x55ec28aebd40 2023-06-10T18:57:22.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.494+0000 7f8003fff640 1 --2- 172.21.15.53:0/2849573168 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec28aebd40 0x55ec28a9cbf0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f7ff8054300 tx=0x7f7ff801e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb68380a80d05ff5 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:22.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.494+0000 7f7feaffd640 1 -- 172.21.15.53:0/2849573168 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff8052710 con 0x55ec28aebd40 2023-06-10T18:57:22.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.494+0000 7f7feaffd640 1 -- 172.21.15.53:0/2849573168 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ff8050a80 con 0x55ec28aebd40 2023-06-10T18:57:22.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.494+0000 7f7feaffd640 1 -- 172.21.15.53:0/2849573168 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff805c380 con 0x55ec28aebd40 2023-06-10T18:57:22.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.494+0000 7f800dee2000 1 -- 172.21.15.53:0/2849573168 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec28aebd40 msgr2=0x55ec28a9cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:22.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.494+0000 7f800dee2000 1 --2- 172.21.15.53:0/2849573168 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec28aebd40 0x55ec28a9cbf0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f7ff8054300 tx=0x7f7ff801e000 comp rx=0 tx=0).stop 2023-06-10T18:57:22.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.494+0000 7f800dee2000 1 -- 172.21.15.53:0/2849573168 shutdown_connections 2023-06-10T18:57:22.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.494+0000 7f800dee2000 1 --2- 172.21.15.53:0/2849573168 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ec28aec650 0x55ec28afb280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:22.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.494+0000 7f800dee2000 1 --2- 172.21.15.53:0/2849573168 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec28aebd40 0x55ec28a9cbf0 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:22.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.494+0000 7f800dee2000 1 --2- 172.21.15.53:0/2849573168 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ec28aa2190 0x55ec28a9c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:22.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.494+0000 7f800dee2000 1 -- 172.21.15.53:0/2849573168 >> 172.21.15.53:0/2849573168 conn(0x55ec28a95800 msgr2=0x55ec28a9bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:22.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.494+0000 7f800dee2000 1 -- 172.21.15.53:0/2849573168 shutdown_connections 2023-06-10T18:57:22.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.494+0000 7f800dee2000 1 -- 172.21.15.53:0/2849573168 wait complete. 2023-06-10T18:57:22.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.494+0000 7f800dee2000 1 -- start start 2023-06-10T18:57:22.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.494+0000 7f800dee2000 1 Processor -- start 2023-06-10T18:57:22.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.494+0000 7f800dee2000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ec28aa2190 0x55ec28afe330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:22.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.494+0000 7f800dee2000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec28aebd40 0x55ec28b066f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:22.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.494+0000 7f800dee2000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ec28aec650 0x55ec28b06c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:22.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.494+0000 7f800dee2000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec28894450 con 0x55ec28aebd40 2023-06-10T18:57:22.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.494+0000 7f800dee2000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec288bb320 con 0x55ec28aa2190 2023-06-10T18:57:22.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.494+0000 7f800dee2000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ec288e9b90 con 0x55ec28aec650 2023-06-10T18:57:22.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.494+0000 7f800dee2000 10 client.0 _ll_register_callbacks cb 0x55ec288b07f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-10T18:57:22.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.494+0000 7f8003fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec28aebd40 0x55ec28b066f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:22.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.494+0000 7f8003fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec28aebd40 0x55ec28b066f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54034/0 (socket says 172.21.15.53:54034) 2023-06-10T18:57:22.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.494+0000 7f8003fff640 1 -- 172.21.15.53:0/3131343804 learned_addr learned my addr 172.21.15.53:0/3131343804 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:57:22.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.494+0000 7f8008b62640 1 --2- 172.21.15.53:0/3131343804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ec28aa2190 0x55ec28afe330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:22.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.498+0000 7f8009363640 1 --2- 172.21.15.53:0/3131343804 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ec28aec650 0x55ec28b06c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:22.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.498+0000 7f8003fff640 1 -- 172.21.15.53:0/3131343804 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ec28aec650 msgr2=0x55ec28b06c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:22.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.498+0000 7f8003fff640 1 --2- 172.21.15.53:0/3131343804 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ec28aec650 0x55ec28b06c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:22.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.498+0000 7f8003fff640 1 -- 172.21.15.53:0/3131343804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ec28aa2190 msgr2=0x55ec28afe330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:22.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.498+0000 7f8003fff640 1 --2- 172.21.15.53:0/3131343804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ec28aa2190 0x55ec28afe330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:22.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.498+0000 7f8003fff640 1 -- 172.21.15.53:0/3131343804 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ec285e8890 con 0x55ec28aebd40 2023-06-10T18:57:22.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.498+0000 7f8008b62640 1 --2- 172.21.15.53:0/3131343804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ec28aa2190 0x55ec28afe330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:57:22.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.498+0000 7f8003fff640 1 --2- 172.21.15.53:0/3131343804 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec28aebd40 0x55ec28b066f0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f7ff8054070 tx=0x7f7ff8001210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b887f9c6ec21d2ff server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:22.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.498+0000 7f7fe37fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-06-10T18:57:22.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.498+0000 7f7fe37fe640 1 -- 172.21.15.53:0/3131343804 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff805c380 con 0x55ec28aebd40 2023-06-10T18:57:22.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.498+0000 7f7fe37fe640 1 -- 172.21.15.53:0/3131343804 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(65..65 src has 1..65) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7ff8050160 con 0x55ec28aebd40 2023-06-10T18:57:22.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.498+0000 7f800dee2000 1 -- 172.21.15.53:0/3131343804 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ec28aaa940 con 0x55ec28aebd40 2023-06-10T18:57:22.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.498+0000 7f7fe37fe640 1 -- 172.21.15.53:0/3131343804 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7ff80812b0 con 0x55ec28aebd40 2023-06-10T18:57:22.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.498+0000 7f800dee2000 10 client.6687 fetch_fsmap learned FSMap version 26 2023-06-10T18:57:22.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.498+0000 7f800dee2000 1 -- 172.21.15.53:0/3131343804 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x55ec285e8cc0 con 0x55ec28aebd40 2023-06-10T18:57:22.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.498+0000 7f7fe37fe640 1 -- 172.21.15.53:0/3131343804 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ec28aaa940 con 0x55ec28aebd40 2023-06-10T18:57:22.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.498+0000 7f7fe37fe640 1 -- 172.21.15.53:0/3131343804 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 26) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f7ff8050320 con 0x55ec28aebd40 2023-06-10T18:57:22.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.498+0000 7f800dee2000 10 client.6687 fetch_fsmap finished waiting for FSMap version 26 2023-06-10T18:57:22.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.498+0000 7f800dee2000 10 client.6687 resolve_mds: resolved name 'a' to daemon mds.a 2023-06-10T18:57:22.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.498+0000 7f800dee2000 20 client.6687 populate_metadata read hostname 'smithi053' 2023-06-10T18:57:22.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.498+0000 7f800dee2000 1 --2- 172.21.15.53:0/3131343804 >> [v2:172.21.15.53:6834/486797221,v1:172.21.15.53:6835/486797221] conn(0x55ec28b49b20 0x55ec28b49ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:22.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.498+0000 7f800dee2000 4 client.6687 mds_command: new command op to 6507 tid=0[{"prefix": "status"}] 2023-06-10T18:57:22.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.498+0000 7f800dee2000 1 -- 172.21.15.53:0/3131343804 --> [v2:172.21.15.53:6834/486797221,v1:172.21.15.53:6835/486797221] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55ec288eacd0 con 0x55ec28b49b20 2023-06-10T18:57:22.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.498+0000 7f8008b62640 1 --2- 172.21.15.53:0/3131343804 >> [v2:172.21.15.53:6834/486797221,v1:172.21.15.53:6835/486797221] conn(0x55ec28b49b20 0x55ec28b49ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:22.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.498+0000 7f7fe37fe640 10 client.6687 ms_handle_connect on v2:172.21.15.53:6834/486797221 2023-06-10T18:57:22.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.498+0000 7f8008b62640 1 --2- 172.21.15.53:0/3131343804 >> [v2:172.21.15.53:6834/486797221,v1:172.21.15.53:6835/486797221] conn(0x55ec28b49b20 0x55ec28b49ef0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0c0d07042689484 server_cookie=5c4e20c9295dfc07 in_seq=0 out_seq=0 2023-06-10T18:57:22.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.498+0000 7f7fe37fe640 1 -- 172.21.15.53:0/3131343804 <== mds.0 v2:172.21.15.53:6834/486797221 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55ec288eacd0 con 0x55ec28b49b20 2023-06-10T18:57:22.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.498+0000 7f7fe37fe640 10 client.6687 handle_command_reply: tid=0 2023-06-10T18:57:22.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.498+0000 7f800dee2000 1 client.6687 shutdown 2023-06-10T18:57:22.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.498+0000 7f800dee2000 1 -- 172.21.15.53:0/3131343804 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec28aebd40 msgr2=0x55ec28b066f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:22.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.498+0000 7f800dee2000 1 --2- 172.21.15.53:0/3131343804 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec28aebd40 0x55ec28b066f0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f7ff8054070 tx=0x7f7ff8001210 comp rx=0 tx=0).stop 2023-06-10T18:57:22.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.498+0000 7f800dee2000 1 -- 172.21.15.53:0/3131343804 shutdown_connections 2023-06-10T18:57:22.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.498+0000 7f800dee2000 1 --2- 172.21.15.53:0/3131343804 >> [v2:172.21.15.53:6834/486797221,v1:172.21.15.53:6835/486797221] conn(0x55ec28b49b20 0x55ec28b49ef0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:22.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.498+0000 7f800dee2000 1 --2- 172.21.15.53:0/3131343804 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55ec28aec650 0x55ec28b06c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:22.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.498+0000 7f7fe37fe640 0 client.6687 ms_handle_reset on v2:172.21.15.53:6834/486797221 2023-06-10T18:57:22.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.498+0000 7f800dee2000 1 --2- 172.21.15.53:0/3131343804 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec28aebd40 0x55ec28b066f0 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:22.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.498+0000 7f800dee2000 1 --2- 172.21.15.53:0/3131343804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ec28aa2190 0x55ec28afe330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:22.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.498+0000 7f800dee2000 1 -- 172.21.15.53:0/3131343804 >> 172.21.15.53:0/3131343804 conn(0x55ec28a95800 msgr2=0x55ec28a9c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:22.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.498+0000 7f800dee2000 1 -- 172.21.15.53:0/3131343804 shutdown_connections 2023-06-10T18:57:22.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.498+0000 7f800dee2000 1 -- 172.21.15.53:0/3131343804 wait complete. 2023-06-10T18:57:22.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.498+0000 7f800dee2000 20 client.6687 trim_cache size 0 max 16384 2023-06-10T18:57:22.512 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-06-10T18:57:22.513 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_fsid": "c8c64bed-c406-4936-93f9-d16335f1067d", 2023-06-10T18:57:22.513 INFO:teuthology.orchestra.run.smithi053.stdout: "whoami": 0, 2023-06-10T18:57:22.513 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 6507, 2023-06-10T18:57:22.513 INFO:teuthology.orchestra.run.smithi053.stdout: "want_state": "up:active", 2023-06-10T18:57:22.513 INFO:teuthology.orchestra.run.smithi053.stdout: "state": "up:active", 2023-06-10T18:57:22.513 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs", 2023-06-10T18:57:22.513 INFO:teuthology.orchestra.run.smithi053.stdout: "rank_uptime": 9.2616070120000007, 2023-06-10T18:57:22.514 INFO:teuthology.orchestra.run.smithi053.stdout: "mdsmap_epoch": 26, 2023-06-10T18:57:22.514 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch": 65, 2023-06-10T18:57:22.514 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch_barrier": 65, 2023-06-10T18:57:22.514 INFO:teuthology.orchestra.run.smithi053.stdout: "uptime": 14.259634184999999 2023-06-10T18:57:22.514 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-06-10T18:57:22.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.498+0000 7f800adc6640 1 -- 172.21.15.53:0/460522448 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7ff0066280 msgr2=0x7f7ff0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:22.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.498+0000 7f800adc6640 1 --2- 172.21.15.53:0/460522448 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7ff0066280 0x7f7ff0068730 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f7ff40af000 tx=0x7f7ff4008040 comp rx=0 tx=0).stop 2023-06-10T18:57:22.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.498+0000 7f800adc6640 1 -- 172.21.15.53:0/460522448 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80041571a0 msgr2=0x7f8004147010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:22.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.498+0000 7f800adc6640 1 --2- 172.21.15.53:0/460522448 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80041571a0 0x7f8004147010 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f7ff800c4d0 tx=0x7f7ff800c990 comp rx=0 tx=0).stop 2023-06-10T18:57:22.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.498+0000 7f800adc6640 1 -- 172.21.15.53:0/460522448 shutdown_connections 2023-06-10T18:57:22.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.498+0000 7f800adc6640 1 --2- 172.21.15.53:0/460522448 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7ff0066280 0x7f7ff0068730 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:22.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.498+0000 7f800adc6640 1 --2- 172.21.15.53:0/460522448 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8004147550 0x7f800415b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:22.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.498+0000 7f800adc6640 1 --2- 172.21.15.53:0/460522448 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80041571a0 0x7f8004147010 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:22.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.498+0000 7f800adc6640 1 --2- 172.21.15.53:0/460522448 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80040afee0 0x7f80040cbb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:22.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.498+0000 7f800adc6640 1 -- 172.21.15.53:0/460522448 >> 172.21.15.53:0/460522448 conn(0x7f80040ce9e0 msgr2=0x7f80040ae850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:22.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.498+0000 7f800adc6640 1 -- 172.21.15.53:0/460522448 shutdown_connections 2023-06-10T18:57:22.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.498+0000 7f800adc6640 1 -- 172.21.15.53:0/460522448 wait complete. 2023-06-10T18:57:22.521 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-10T18:57:22.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.634+0000 7f8fbe825640 1 Processor -- start 2023-06-10T18:57:22.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.634+0000 7f8fbe825640 1 -- start start 2023-06-10T18:57:22.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.634+0000 7f8fbe825640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8fb80cc690 0x7f8fb80d04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:22.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.634+0000 7f8fbe825640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fb80d0020 con 0x7f8fb80b3ac0 2023-06-10T18:57:22.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.634+0000 7f8fbe825640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fb80cef40 con 0x7f8fb80ccae0 2023-06-10T18:57:22.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.634+0000 7f8fbe825640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fb80cf220 con 0x7f8fb80cc690 2023-06-10T18:57:22.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.634+0000 7f8fb7fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f8fb80b3ac0 0x7f8fb80b3e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:42270/0 (socket says 172.21.15.53:42270) 2023-06-10T18:57:22.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.634+0000 7f8fb7fff640 1 -- 172.21.15.53:0/2921813059 learned_addr learned my addr 172.21.15.53:0/2921813059 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:57:22.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.634+0000 7f8fb77fe640 1 --2- 172.21.15.53:0/2921813059 >> v2:172.21.15.117:3300/0 conn(0x7f8fb80cc690 0x7f8fb80d04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:22.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.634+0000 7f8fb6ffd640 1 -- 172.21.15.53:0/2921813059 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1720332474 0 0) 0x7f8fb80d0020 con 0x7f8fb80b3ac0 2023-06-10T18:57:22.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.634+0000 7f8fb6ffd640 1 -- 172.21.15.53:0/2921813059 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8fa4003530 con 0x7f8fb80b3ac0 2023-06-10T18:57:22.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.634+0000 7f8fb6ffd640 1 -- 172.21.15.53:0/2921813059 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 992295968 0 0) 0x7f8fa4003530 con 0x7f8fb80b3ac0 2023-06-10T18:57:22.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.634+0000 7f8fb6ffd640 1 -- 172.21.15.53:0/2921813059 >> v2:172.21.15.117:3300/0 conn(0x7f8fb80cc690 msgr2=0x7f8fb80d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:22.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.634+0000 7f8fb6ffd640 1 --2- 172.21.15.53:0/2921813059 >> v2:172.21.15.117:3300/0 conn(0x7f8fb80cc690 0x7f8fb80d04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:22.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.634+0000 7f8fb6ffd640 1 -- 172.21.15.53:0/2921813059 >> v1:172.21.15.117:6789/0 conn(0x7f8fb80ccae0 legacy=0x7f8fb80d09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:22.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.634+0000 7f8fb6ffd640 1 -- 172.21.15.53:0/2921813059 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb80cf500 con 0x7f8fb80b3ac0 2023-06-10T18:57:22.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.634+0000 7f8fb6ffd640 1 -- 172.21.15.53:0/2921813059 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f8fa0001a00 con 0x7f8fb80b3ac0 2023-06-10T18:57:22.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.634+0000 7f8fb6ffd640 1 -- 172.21.15.53:0/2921813059 >> v1:172.21.15.53:6789/0 conn(0x7f8fb80b3ac0 legacy=0x7f8fb80b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:22.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.634+0000 7f8fb6ffd640 1 --2- 172.21.15.53:0/2921813059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8fa40039f0 0x7f8fa4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:22.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.634+0000 7f8fb6ffd640 1 --2- 172.21.15.53:0/2921813059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fa40047d0 0x7f8fa4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:22.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.634+0000 7f8fb6ffd640 1 --2- 172.21.15.53:0/2921813059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8fa4005180 0x7f8fa400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:22.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.634+0000 7f8fb6ffd640 1 -- 172.21.15.53:0/2921813059 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb80cf220 con 0x7f8fa4005180 2023-06-10T18:57:22.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.634+0000 7f8fb6ffd640 1 -- 172.21.15.53:0/2921813059 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa400c060 con 0x7f8fa40047d0 2023-06-10T18:57:22.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.634+0000 7f8fb6ffd640 1 -- 172.21.15.53:0/2921813059 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa400c220 con 0x7f8fa40039f0 2023-06-10T18:57:22.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.634+0000 7f8fbcdc2640 1 --2- 172.21.15.53:0/2921813059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8fa4005180 0x7f8fa400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:22.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.634+0000 7f8fb7fff640 1 --2- 172.21.15.53:0/2921813059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8fa40039f0 0x7f8fa4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:22.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.634+0000 7f8fb77fe640 1 --2- 172.21.15.53:0/2921813059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fa40047d0 0x7f8fa4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:22.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.634+0000 7f8fbcdc2640 1 -- 172.21.15.53:0/2921813059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8fa40039f0 msgr2=0x7f8fa4003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:22.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.634+0000 7f8fbcdc2640 1 --2- 172.21.15.53:0/2921813059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8fa40039f0 0x7f8fa4003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:22.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.634+0000 7f8fbcdc2640 1 -- 172.21.15.53:0/2921813059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fa40047d0 msgr2=0x7f8fa4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:22.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.634+0000 7f8fbcdc2640 1 --2- 172.21.15.53:0/2921813059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fa40047d0 0x7f8fa4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:22.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.634+0000 7f8fbcdc2640 1 -- 172.21.15.53:0/2921813059 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fa4003530 con 0x7f8fa4005180 2023-06-10T18:57:22.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.638+0000 7f8fbcdc2640 1 -- 172.21.15.53:0/2921813059 reap_dead start 2023-06-10T18:57:22.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.638+0000 7f8fbcdc2640 1 --2- 172.21.15.53:0/2921813059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8fa4005180 0x7f8fa400b990 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f8fa8001780 tx=0x7f8fa801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40f4a7df78a0ecaf server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:22.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.638+0000 7f8fb6ffd640 1 -- 172.21.15.53:0/2921813059 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa80052d0 con 0x7f8fa4005180 2023-06-10T18:57:22.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.638+0000 7f8fb6ffd640 1 -- 172.21.15.53:0/2921813059 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa80a7050 con 0x7f8fa4005180 2023-06-10T18:57:22.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.638+0000 7f8fb6ffd640 1 -- 172.21.15.53:0/2921813059 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa8003600 con 0x7f8fa4005180 2023-06-10T18:57:22.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.638+0000 7f8fbe825640 1 -- 172.21.15.53:0/2921813059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8fa4005180 msgr2=0x7f8fa400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:22.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.638+0000 7f8fbe825640 1 --2- 172.21.15.53:0/2921813059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8fa4005180 0x7f8fa400b990 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f8fa8001780 tx=0x7f8fa801c400 comp rx=0 tx=0).stop 2023-06-10T18:57:22.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.638+0000 7f8fbe825640 1 -- 172.21.15.53:0/2921813059 shutdown_connections 2023-06-10T18:57:22.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.638+0000 7f8fbe825640 1 --2- 172.21.15.53:0/2921813059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8fa4005180 0x7f8fa400b990 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:22.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.638+0000 7f8fbe825640 1 -- 172.21.15.53:0/2921813059 >> 172.21.15.53:0/2921813059 conn(0x7f8fb8071790 msgr2=0x7f8fb8069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:22.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.638+0000 7f8fbe825640 1 -- 172.21.15.53:0/2921813059 shutdown_connections 2023-06-10T18:57:22.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.638+0000 7f8fbe825640 1 -- 172.21.15.53:0/2921813059 wait complete. 2023-06-10T18:57:22.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.638+0000 7f8fbe825640 1 Processor -- start 2023-06-10T18:57:22.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.638+0000 7f8fbe825640 1 -- start start 2023-06-10T18:57:22.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.642+0000 7f8fbe825640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8fa4005180 0x7f8fb81f1120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:22.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.642+0000 7f8fbe825640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8fb80cb7e0 0x7f8fb80ca7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:22.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.642+0000 7f8fbe825640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fb80c6b10 0x7f8fb815de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:22.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.642+0000 7f8fbe825640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb815c450 con 0x7f8fb80cb7e0 2023-06-10T18:57:22.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.642+0000 7f8fbe825640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb80cad20 con 0x7f8fb80c6b10 2023-06-10T18:57:22.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.642+0000 7f8fbe825640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb81f17d0 con 0x7f8fa4005180 2023-06-10T18:57:22.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.642+0000 7f8fb77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8fb80cb7e0 0x7f8fb80ca7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:22.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.642+0000 7f8fb77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8fb80cb7e0 0x7f8fb80ca7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54052/0 (socket says 172.21.15.53:54052) 2023-06-10T18:57:22.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.642+0000 7f8fb77fe640 1 -- 172.21.15.53:0/3328843134 learned_addr learned my addr 172.21.15.53:0/3328843134 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:57:22.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.642+0000 7f8fb7fff640 1 --2- 172.21.15.53:0/3328843134 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8fa4005180 0x7f8fb81f1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:22.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.642+0000 7f8fbcdc2640 1 --2- 172.21.15.53:0/3328843134 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fb80c6b10 0x7f8fb815de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:22.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.642+0000 7f8fb77fe640 1 -- 172.21.15.53:0/3328843134 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8fa4005180 msgr2=0x7f8fb81f1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:22.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.642+0000 7f8fb77fe640 1 --2- 172.21.15.53:0/3328843134 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8fa4005180 0x7f8fb81f1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:22.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.642+0000 7f8fb77fe640 1 -- 172.21.15.53:0/3328843134 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fb80c6b10 msgr2=0x7f8fb815de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:22.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.642+0000 7f8fb77fe640 1 --2- 172.21.15.53:0/3328843134 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fb80c6b10 0x7f8fb815de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:22.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.642+0000 7f8fb77fe640 1 -- 172.21.15.53:0/3328843134 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb81f1ab0 con 0x7f8fb80cb7e0 2023-06-10T18:57:22.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.642+0000 7f8fb77fe640 1 --2- 172.21.15.53:0/3328843134 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8fb80cb7e0 0x7f8fb80ca7e0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f8fb0011560 tx=0x7f8fb0011a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:22.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.642+0000 7f8fb4ff9640 1 -- 172.21.15.53:0/3328843134 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb0015930 con 0x7f8fb80cb7e0 2023-06-10T18:57:22.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.642+0000 7f8fb4ff9640 1 -- 172.21.15.53:0/3328843134 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fb0015a90 con 0x7f8fb80cb7e0 2023-06-10T18:57:22.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.642+0000 7f8fbe825640 1 -- 172.21.15.53:0/3328843134 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fb81f1d90 con 0x7f8fb80cb7e0 2023-06-10T18:57:22.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.642+0000 7f8fb4ff9640 1 -- 172.21.15.53:0/3328843134 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb0015e20 con 0x7f8fb80cb7e0 2023-06-10T18:57:22.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.642+0000 7f8fbe825640 1 -- 172.21.15.53:0/3328843134 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fb815c000 con 0x7f8fb80cb7e0 2023-06-10T18:57:22.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.642+0000 7f8fbe825640 1 -- 172.21.15.53:0/3328843134 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fb815c590 con 0x7f8fb80cb7e0 2023-06-10T18:57:22.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.642+0000 7f8fb4ff9640 1 -- 172.21.15.53:0/3328843134 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8fb000f460 con 0x7f8fb80cb7e0 2023-06-10T18:57:22.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.642+0000 7f8fb4ff9640 1 --2- 172.21.15.53:0/3328843134 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8f98066280 0x7f8f98068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:22.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.642+0000 7f8fb4ff9640 1 -- 172.21.15.53:0/3328843134 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8fb00844a0 con 0x7f8fb80cb7e0 2023-06-10T18:57:22.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.642+0000 7f8fb7fff640 1 --2- 172.21.15.53:0/3328843134 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8f98066280 0x7f8f98068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:22.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.646+0000 7f8fb7fff640 1 --2- 172.21.15.53:0/3328843134 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8f98066280 0x7f8f98068730 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f8fa0002240 tx=0x7f8fa0002030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:22.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.646+0000 7f8fb4ff9640 1 -- 172.21.15.53:0/3328843134 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8fb815c590 con 0x7f8fb80cb7e0 2023-06-10T18:57:22.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.846+0000 7f8fbe825640 1 -- 172.21.15.53:0/3328843134 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8fb815c590 con 0x7f8fb80cb7e0 2023-06-10T18:57:22.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.846+0000 7f8fb4ff9640 1 -- 172.21.15.53:0/3328843134 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v26) v1 ==== 53+0+73 (secure 0 0 0) 0x7f8fb815c590 con 0x7f8fb80cb7e0 2023-06-10T18:57:22.852 INFO:teuthology.orchestra.run.smithi053.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-06-10T18:57:22.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.850+0000 7f8fbe825640 1 -- 172.21.15.53:0/3328843134 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8f98066280 msgr2=0x7f8f98068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:22.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.850+0000 7f8fbe825640 1 --2- 172.21.15.53:0/3328843134 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8f98066280 0x7f8f98068730 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f8fa0002240 tx=0x7f8fa0002030 comp rx=0 tx=0).stop 2023-06-10T18:57:22.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.850+0000 7f8fbe825640 1 -- 172.21.15.53:0/3328843134 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8fb80cb7e0 msgr2=0x7f8fb80ca7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:22.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.850+0000 7f8fbe825640 1 --2- 172.21.15.53:0/3328843134 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8fb80cb7e0 0x7f8fb80ca7e0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f8fb0011560 tx=0x7f8fb0011a20 comp rx=0 tx=0).stop 2023-06-10T18:57:22.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.850+0000 7f8fbe825640 1 -- 172.21.15.53:0/3328843134 shutdown_connections 2023-06-10T18:57:22.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.850+0000 7f8fbe825640 1 --2- 172.21.15.53:0/3328843134 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8f98066280 0x7f8f98068730 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:22.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.850+0000 7f8fbe825640 1 --2- 172.21.15.53:0/3328843134 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fb80c6b10 0x7f8fb815de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:22.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.850+0000 7f8fbe825640 1 --2- 172.21.15.53:0/3328843134 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8fb80cb7e0 0x7f8fb80ca7e0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:22.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.850+0000 7f8fbe825640 1 --2- 172.21.15.53:0/3328843134 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8fa4005180 0x7f8fb81f1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:22.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.850+0000 7f8fbe825640 1 -- 172.21.15.53:0/3328843134 >> 172.21.15.53:0/3328843134 conn(0x7f8fb8071790 msgr2=0x7f8fb80cd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:22.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.850+0000 7f8fbe825640 1 -- 172.21.15.53:0/3328843134 shutdown_connections 2023-06-10T18:57:22.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:22.850+0000 7f8fbe825640 1 -- 172.21.15.53:0/3328843134 wait complete. 2023-06-10T18:57:22.872 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-10T18:57:22.872 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-10T18:57:22.873 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi053.front.sepia.ceph.com 2023-06-10T18:57:22.873 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-06-10T18:57:22.873 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-06-10T18:57:22.873 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-10T18:57:22.874 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-10T18:57:22.874 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-10T18:57:22.874 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-06-10T18:57:22.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:57:22.875 DEBUG:teuthology.orchestra.run.smithi053:> ip addr 2023-06-10T18:57:22.881 INFO:teuthology.orchestra.run.smithi053.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-10T18:57:22.881 INFO:teuthology.orchestra.run.smithi053.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-10T18:57:22.881 INFO:teuthology.orchestra.run.smithi053.stdout: inet 127.0.0.1/8 scope host lo 2023-06-10T18:57:22.881 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:57:22.881 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 ::1/128 scope host 2023-06-10T18:57:22.882 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:57:22.882 INFO:teuthology.orchestra.run.smithi053.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T18:57:22.882 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:da brd ff:ff:ff:ff:ff:ff 2023-06-10T18:57:22.882 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f0 2023-06-10T18:57:22.882 INFO:teuthology.orchestra.run.smithi053.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T18:57:22.882 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:db brd ff:ff:ff:ff:ff:ff 2023-06-10T18:57:22.882 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f1 2023-06-10T18:57:22.883 INFO:teuthology.orchestra.run.smithi053.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-10T18:57:22.883 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:18 brd ff:ff:ff:ff:ff:ff 2023-06-10T18:57:22.883 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f0 2023-06-10T18:57:22.883 INFO:teuthology.orchestra.run.smithi053.stdout: inet 172.21.15.53/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-06-10T18:57:22.883 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft 42206sec preferred_lft 42206sec 2023-06-10T18:57:22.883 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::ae1f:6bff:fef8:3718/64 scope link 2023-06-10T18:57:22.883 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:57:22.883 INFO:teuthology.orchestra.run.smithi053.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T18:57:22.884 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:19 brd ff:ff:ff:ff:ff:ff 2023-06-10T18:57:22.884 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f1 2023-06-10T18:57:22.884 INFO:teuthology.orchestra.run.smithi053.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-06-10T18:57:22.884 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 02:42:49:3d:ee:1e brd ff:ff:ff:ff:ff:ff 2023-06-10T18:57:22.884 INFO:teuthology.orchestra.run.smithi053.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-06-10T18:57:22.884 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:57:22.884 INFO:teuthology.orchestra.run.smithi053.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-10T18:57:22.885 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-06-10T18:57:22.885 INFO:teuthology.orchestra.run.smithi053.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-06-10T18:57:22.885 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:57:22.885 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-06-10T18:57:22.885 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:57:22.885 INFO:teuthology.orchestra.run.smithi053.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-10T18:57:22.886 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-06-10T18:57:22.886 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-06-10T18:57:22.886 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:57:22.886 INFO:teuthology.orchestra.run.smithi053.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-10T18:57:22.887 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-06-10T18:57:22.887 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-06-10T18:57:22.887 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:57:22.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:57:22.888 DEBUG:teuthology.orchestra.run.smithi053:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-10T18:57:22.936 INFO:teuthology.orchestra.run.smithi053.stdout:1 2023-06-10T18:57:22.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:57:22.938 DEBUG:teuthology.orchestra.run.smithi053:> route 2023-06-10T18:57:22.987 INFO:teuthology.orchestra.run.smithi053.stdout:Kernel IP routing table 2023-06-10T18:57:22.987 INFO:teuthology.orchestra.run.smithi053.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-10T18:57:22.987 INFO:teuthology.orchestra.run.smithi053.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-06-10T18:57:22.987 INFO:teuthology.orchestra.run.smithi053.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-06-10T18:57:22.987 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-06-10T18:57:22.987 INFO:teuthology.orchestra.run.smithi053.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-10T18:57:22.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:57:22.988 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec bash -c ' 2023-06-10T18:57:22.989 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2023-06-10T18:57:22.989 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-06-10T18:57:22.989 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-06-10T18:57:22.989 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-06-10T18:57:22.990 DEBUG:teuthology.orchestra.run.smithi053:> ') 2023-06-10T18:57:23.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:57:23.063 DEBUG:teuthology.orchestra.run.smithi053:> ip netns list 2023-06-10T18:57:23.110 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-06-10T18:57:23.110 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-06-10T18:57:23.110 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-06-10T18:57:23.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:57:23.111 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link set brx.0 up 2023-06-10T18:57:23.166 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-06-10T18:57:23.167 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-10T18:57:23.167 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-06-10T18:57:23.214 INFO:teuthology.orchestra.run.smithi053.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-06-10T18:57:23.214 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-10T18:57:23.215 DEBUG:teuthology.orchestra.run.smithi053:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-06-10T18:57:23.262 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2023-06-10T18:57:23.320 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T18:57:23.321 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T18:57:23.374 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T18:57:23.375 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T18:57:23.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:57:23.376 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2023-06-10T18:57:23.422 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-06-10T18:57:23.422 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-06-10T18:57:23.467 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2023-06-10T18:57:23.481 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T18:57:23.482 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T18:57:23.537 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T18:57:23.538 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T18:57:23.538 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:57:23.539 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2023-06-10T18:57:23.552 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:2023-06-10T18:57:23.546+0000 7f7b09eb5580 -1 init, newargv = 0x563cbab2dee0 newargc=15 2023-06-10T18:57:23.553 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[52485]: starting ceph client 2023-06-10T18:57:23.558 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[52485]: starting fuse 2023-06-10T18:57:24.658 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2023-06-10T18:57:24.675 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T18:57:24.676 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T18:57:24.730 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T18:57:24.731 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T18:57:24.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:57:24.732 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2023-06-10T18:57:24.778 INFO:teuthology.orchestra.run.smithi053.stdout:45 2023-06-10T18:57:24.778 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-06-10T18:57:24.778 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-06-10T18:57:24.779 DEBUG:teuthology.orchestra.run.smithi053:> import glob 2023-06-10T18:57:24.779 DEBUG:teuthology.orchestra.run.smithi053:> import re 2023-06-10T18:57:24.779 DEBUG:teuthology.orchestra.run.smithi053:> import os 2023-06-10T18:57:24.780 DEBUG:teuthology.orchestra.run.smithi053:> import subprocess 2023-06-10T18:57:24.780 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T18:57:24.780 DEBUG:teuthology.orchestra.run.smithi053:> def _find_admin_socket(client_name): 2023-06-10T18:57:24.781 DEBUG:teuthology.orchestra.run.smithi053:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-06-10T18:57:24.781 DEBUG:teuthology.orchestra.run.smithi053:> files = glob.glob(asok_path) 2023-06-10T18:57:24.781 DEBUG:teuthology.orchestra.run.smithi053:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-06-10T18:57:24.782 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T18:57:24.782 DEBUG:teuthology.orchestra.run.smithi053:> # Given a non-glob path, it better be there 2023-06-10T18:57:24.782 DEBUG:teuthology.orchestra.run.smithi053:> if "*" not in asok_path: 2023-06-10T18:57:24.782 DEBUG:teuthology.orchestra.run.smithi053:> assert(len(files) == 1) 2023-06-10T18:57:24.783 DEBUG:teuthology.orchestra.run.smithi053:> return files[0] 2023-06-10T18:57:24.783 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T18:57:24.783 DEBUG:teuthology.orchestra.run.smithi053:> for f in files: 2023-06-10T18:57:24.784 DEBUG:teuthology.orchestra.run.smithi053:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-06-10T18:57:24.784 DEBUG:teuthology.orchestra.run.smithi053:> if os.path.exists("/proc/{0}".format(pid)): 2023-06-10T18:57:24.784 DEBUG:teuthology.orchestra.run.smithi053:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-06-10T18:57:24.785 DEBUG:teuthology.orchestra.run.smithi053:> contents = proc_f.read() 2023-06-10T18:57:24.785 DEBUG:teuthology.orchestra.run.smithi053:> if mountpoint in contents: 2023-06-10T18:57:24.786 DEBUG:teuthology.orchestra.run.smithi053:> return f 2023-06-10T18:57:24.786 DEBUG:teuthology.orchestra.run.smithi053:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-06-10T18:57:24.787 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T18:57:24.787 DEBUG:teuthology.orchestra.run.smithi053:> print(_find_admin_socket("client.0")) 2023-06-10T18:57:24.787 DEBUG:teuthology.orchestra.run.smithi053:> ' 2023-06-10T18:57:24.902 INFO:teuthology.orchestra.run.smithi053.stdout:/var/run/ceph/ceph-client.0.52485.asok 2023-06-10T18:57:25.084 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.52485.asok 2023-06-10T18:57:25.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:57:25.085 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.52485.asok status 2023-06-10T18:57:25.244 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-06-10T18:57:25.245 INFO:teuthology.orchestra.run.smithi053.stdout: "metadata": { 2023-06-10T18:57:25.245 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_sha1": "219d315c3a0b2075e570fb1964be2ad33fe7a9c8", 2023-06-10T18:57:25.245 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_version": "ceph version 18.0.0-4359-g219d315c (219d315c3a0b2075e570fb1964be2ad33fe7a9c8) reef (dev)", 2023-06-10T18:57:25.245 INFO:teuthology.orchestra.run.smithi053.stdout: "entity_id": "0", 2023-06-10T18:57:25.245 INFO:teuthology.orchestra.run.smithi053.stdout: "hostname": "smithi053", 2023-06-10T18:57:25.245 INFO:teuthology.orchestra.run.smithi053.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-06-10T18:57:25.246 INFO:teuthology.orchestra.run.smithi053.stdout: "pid": "52485", 2023-06-10T18:57:25.246 INFO:teuthology.orchestra.run.smithi053.stdout: "root": "/" 2023-06-10T18:57:25.246 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:57:25.246 INFO:teuthology.orchestra.run.smithi053.stdout: "dentry_count": 0, 2023-06-10T18:57:25.246 INFO:teuthology.orchestra.run.smithi053.stdout: "dentry_pinned_count": 0, 2023-06-10T18:57:25.246 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 6702, 2023-06-10T18:57:25.247 INFO:teuthology.orchestra.run.smithi053.stdout: "inst": { 2023-06-10T18:57:25.247 INFO:teuthology.orchestra.run.smithi053.stdout: "name": { 2023-06-10T18:57:25.247 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "client", 2023-06-10T18:57:25.247 INFO:teuthology.orchestra.run.smithi053.stdout: "num": 6702 2023-06-10T18:57:25.247 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:57:25.247 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": { 2023-06-10T18:57:25.247 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2023-06-10T18:57:25.248 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "192.168.0.1:0", 2023-06-10T18:57:25.249 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 683847329 2023-06-10T18:57:25.249 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:57:25.249 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:57:25.249 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": { 2023-06-10T18:57:25.249 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2023-06-10T18:57:25.249 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "192.168.0.1:0", 2023-06-10T18:57:25.249 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 683847329 2023-06-10T18:57:25.250 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:57:25.250 INFO:teuthology.orchestra.run.smithi053.stdout: "inst_str": "client.6702 192.168.0.1:0/683847329", 2023-06-10T18:57:25.250 INFO:teuthology.orchestra.run.smithi053.stdout: "addr_str": "192.168.0.1:0/683847329", 2023-06-10T18:57:25.250 INFO:teuthology.orchestra.run.smithi053.stdout: "inode_count": 1, 2023-06-10T18:57:25.250 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_epoch": 26, 2023-06-10T18:57:25.250 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_epoch": 65, 2023-06-10T18:57:25.250 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_epoch_barrier": 0, 2023-06-10T18:57:25.250 INFO:teuthology.orchestra.run.smithi053.stdout: "blocklisted": false, 2023-06-10T18:57:25.251 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs" 2023-06-10T18:57:25.251 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-06-10T18:57:25.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:57:25.259 DEBUG:teuthology.orchestra.run.smithi053:> stat --file-system '--printf=%T 2023-06-10T18:57:25.259 DEBUG:teuthology.orchestra.run.smithi053:> ' -- /home/ubuntu/cephtest/mnt.0 2023-06-10T18:57:25.264 INFO:teuthology.orchestra.run.smithi053.stdout:fuseblk 2023-06-10T18:57:25.265 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-06-10T18:57:25.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:57:25.265 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-06-10T18:57:25.316 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-10T18:57:25.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:25.482+0000 7f7f3777c640 1 Processor -- start 2023-06-10T18:57:25.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:25.482+0000 7f7f3777c640 1 -- start start 2023-06-10T18:57:25.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:25.482+0000 7f7f3777c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7f3015c810 0x7f7f300cd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:25.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:25.482+0000 7f7f3777c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f300cbfc0 0x7f7f300c8d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:25.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:25.482+0000 7f7f3777c640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f300c9270 con 0x7f7f3015ba70 2023-06-10T18:57:25.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:25.482+0000 7f7f3777c640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f300cc6c0 con 0x7f7f3015c810 2023-06-10T18:57:25.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:25.482+0000 7f7f3777c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f300cc9a0 con 0x7f7f300cbfc0 2023-06-10T18:57:25.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:25.482+0000 7f7f35d19640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f300cbfc0 0x7f7f300c8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:25.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:25.482+0000 7f7f34d17640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7f3015c810 0x7f7f300cd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:25.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:25.482+0000 7f7f34d17640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7f3015c810 0x7f7f300cd760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.53:59812/0 (socket says 172.21.15.53:59812) 2023-06-10T18:57:25.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:25.482+0000 7f7f35d19640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f300cbfc0 0x7f7f300c8d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.53:58800/0 (socket says 172.21.15.53:58800) 2023-06-10T18:57:25.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:25.482+0000 7f7f35518640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f7f3015ba70 0x7f7f3015c100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.53:38954/0 (socket says 172.21.15.53:38954) 2023-06-10T18:57:25.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:25.482+0000 7f7f34d17640 1 -- 172.21.15.53:0/2403345104 learned_addr learned my addr 172.21.15.53:0/2403345104 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:57:25.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:25.482+0000 7f7f34d17640 1 -- 172.21.15.53:0/2403345104 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f300cbfc0 msgr2=0x7f7f300c8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:25.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:25.482+0000 7f7f34d17640 1 --2- 172.21.15.53:0/2403345104 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f300cbfc0 0x7f7f300c8d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:25.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:25.482+0000 7f7f34d17640 1 -- 172.21.15.53:0/2403345104 >> v1:172.21.15.117:6789/0 conn(0x7f7f3015ba70 legacy=0x7f7f3015c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:25.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:25.482+0000 7f7f34d17640 1 -- 172.21.15.53:0/2403345104 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f300ccc80 con 0x7f7f3015c810 2023-06-10T18:57:25.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:25.486+0000 7f7f34d17640 1 --2- 172.21.15.53:0/2403345104 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f3015c810 0x7f7f300cd760 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f7f20009870 tx=0x7f7f2001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aec605f65a4d9d38 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:25.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:25.486+0000 7f7f27fff640 1 -- 172.21.15.53:0/2403345104 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f200ab680 con 0x7f7f3015c810 2023-06-10T18:57:25.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:25.486+0000 7f7f27fff640 1 -- 172.21.15.53:0/2403345104 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f200ab7e0 con 0x7f7f3015c810 2023-06-10T18:57:25.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:25.486+0000 7f7f27fff640 1 -- 172.21.15.53:0/2403345104 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f200abb70 con 0x7f7f3015c810 2023-06-10T18:57:25.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:25.486+0000 7f7f3777c640 1 -- 172.21.15.53:0/2403345104 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f3015c810 msgr2=0x7f7f300cd760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:25.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:25.486+0000 7f7f3777c640 1 --2- 172.21.15.53:0/2403345104 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f3015c810 0x7f7f300cd760 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f7f20009870 tx=0x7f7f2001c480 comp rx=0 tx=0).stop 2023-06-10T18:57:25.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:25.486+0000 7f7f3777c640 1 -- 172.21.15.53:0/2403345104 shutdown_connections 2023-06-10T18:57:25.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:25.486+0000 7f7f3777c640 1 --2- 172.21.15.53:0/2403345104 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f300cbfc0 0x7f7f300c8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:25.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:25.486+0000 7f7f3777c640 1 --2- 172.21.15.53:0/2403345104 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f3015c810 0x7f7f300cd760 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:25.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:25.486+0000 7f7f3777c640 1 -- 172.21.15.53:0/2403345104 >> 172.21.15.53:0/2403345104 conn(0x7f7f3006a0d0 msgr2=0x7f7f300ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:25.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:25.486+0000 7f7f3777c640 1 -- 172.21.15.53:0/2403345104 shutdown_connections 2023-06-10T18:57:25.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:25.486+0000 7f7f3777c640 1 -- 172.21.15.53:0/2403345104 wait complete. 2023-06-10T18:57:25.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:25.486+0000 7f7f3777c640 1 Processor -- start 2023-06-10T18:57:25.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:25.486+0000 7f7f3777c640 1 -- start start 2023-06-10T18:57:25.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:25.486+0000 7f7f3777c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f300cbfc0 0x7f7f3014cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:25.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:25.486+0000 7f7f3777c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f3015ba70 0x7f7f301474e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:25.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:25.486+0000 7f7f3777c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f3015c810 0x7f7f30156e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:25.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:25.486+0000 7f7f3777c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3014d430 con 0x7f7f300cbfc0 2023-06-10T18:57:25.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:25.486+0000 7f7f3777c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3015b2e0 con 0x7f7f3015c810 2023-06-10T18:57:25.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:25.486+0000 7f7f3777c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3015ad20 con 0x7f7f3015ba70 2023-06-10T18:57:25.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:25.486+0000 7f7f35518640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f300cbfc0 0x7f7f3014cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:25.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:25.486+0000 7f7f35518640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f300cbfc0 0x7f7f3014cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54066/0 (socket says 172.21.15.53:54066) 2023-06-10T18:57:25.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:25.486+0000 7f7f35518640 1 -- 172.21.15.53:0/686541523 learned_addr learned my addr 172.21.15.53:0/686541523 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:57:25.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:25.486+0000 7f7f35d19640 1 --2- 172.21.15.53:0/686541523 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f3015c810 0x7f7f30156e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:25.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:25.490+0000 7f7f34d17640 1 --2- 172.21.15.53:0/686541523 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f3015ba70 0x7f7f301474e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:25.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:25.490+0000 7f7f35518640 1 -- 172.21.15.53:0/686541523 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f3015ba70 msgr2=0x7f7f301474e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:25.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:25.490+0000 7f7f35518640 1 --2- 172.21.15.53:0/686541523 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f3015ba70 0x7f7f301474e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:25.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:25.490+0000 7f7f35518640 1 -- 172.21.15.53:0/686541523 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f3015c810 msgr2=0x7f7f30156e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:25.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:25.490+0000 7f7f35518640 1 --2- 172.21.15.53:0/686541523 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f3015c810 0x7f7f30156e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:25.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:25.490+0000 7f7f35518640 1 -- 172.21.15.53:0/686541523 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f200094d0 con 0x7f7f300cbfc0 2023-06-10T18:57:25.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:25.490+0000 7f7f35518640 1 --2- 172.21.15.53:0/686541523 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f300cbfc0 0x7f7f3014cef0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c00c7f0 tx=0x7f7f2c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:25.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:25.490+0000 7f7f25ffb640 1 -- 172.21.15.53:0/686541523 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f2c00a640 con 0x7f7f300cbfc0 2023-06-10T18:57:25.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:25.490+0000 7f7f25ffb640 1 -- 172.21.15.53:0/686541523 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f2c00a7c0 con 0x7f7f300cbfc0 2023-06-10T18:57:25.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:25.490+0000 7f7f3777c640 1 -- 172.21.15.53:0/686541523 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f3015b000 con 0x7f7f300cbfc0 2023-06-10T18:57:25.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:25.490+0000 7f7f25ffb640 1 -- 172.21.15.53:0/686541523 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f2c00ab70 con 0x7f7f300cbfc0 2023-06-10T18:57:25.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:25.490+0000 7f7f3777c640 1 -- 172.21.15.53:0/686541523 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f3014b640 con 0x7f7f300cbfc0 2023-06-10T18:57:25.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:25.490+0000 7f7f3777c640 1 -- 172.21.15.53:0/686541523 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f300ca040 con 0x7f7f300cbfc0 2023-06-10T18:57:25.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:25.490+0000 7f7f25ffb640 1 -- 172.21.15.53:0/686541523 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7f2c00acd0 con 0x7f7f300cbfc0 2023-06-10T18:57:25.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:25.490+0000 7f7f25ffb640 1 --2- 172.21.15.53:0/686541523 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7f14066280 0x7f7f14068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:25.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:25.490+0000 7f7f25ffb640 1 -- 172.21.15.53:0/686541523 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7f2c083390 con 0x7f7f300cbfc0 2023-06-10T18:57:25.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:25.490+0000 7f7f34d17640 1 --2- 172.21.15.53:0/686541523 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7f14066280 0x7f7f14068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:25.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:25.490+0000 7f7f34d17640 1 --2- 172.21.15.53:0/686541523 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7f14066280 0x7f7f14068730 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f7f200af000 tx=0x7f7f200b6040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:25.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:25.494+0000 7f7f25ffb640 1 -- 172.21.15.53:0/686541523 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7f2c050950 con 0x7f7f300cbfc0 2023-06-10T18:57:25.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:25.682+0000 7f7f3777c640 1 -- 172.21.15.53:0/686541523 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7f300c9270 con 0x7f7f300cbfc0 2023-06-10T18:57:25.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:25.682+0000 7f7f25ffb640 1 -- 172.21.15.53:0/686541523 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v26) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7f300c9270 con 0x7f7f300cbfc0 2023-06-10T18:57:25.689 INFO:teuthology.orchestra.run.smithi053.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-06-10T18:57:25.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:25.686+0000 7f7f3777c640 1 -- 172.21.15.53:0/686541523 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7f14066280 msgr2=0x7f7f14068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:25.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:25.686+0000 7f7f3777c640 1 --2- 172.21.15.53:0/686541523 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7f14066280 0x7f7f14068730 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f7f200af000 tx=0x7f7f200b6040 comp rx=0 tx=0).stop 2023-06-10T18:57:25.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:25.686+0000 7f7f3777c640 1 -- 172.21.15.53:0/686541523 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f300cbfc0 msgr2=0x7f7f3014cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:25.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:25.686+0000 7f7f3777c640 1 --2- 172.21.15.53:0/686541523 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f300cbfc0 0x7f7f3014cef0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c00c7f0 tx=0x7f7f2c00ccb0 comp rx=0 tx=0).stop 2023-06-10T18:57:25.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:25.686+0000 7f7f3777c640 1 -- 172.21.15.53:0/686541523 shutdown_connections 2023-06-10T18:57:25.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:25.686+0000 7f7f3777c640 1 --2- 172.21.15.53:0/686541523 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7f14066280 0x7f7f14068730 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:25.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:25.686+0000 7f7f3777c640 1 --2- 172.21.15.53:0/686541523 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f3015c810 0x7f7f30156e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:25.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:25.686+0000 7f7f3777c640 1 --2- 172.21.15.53:0/686541523 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f3015ba70 0x7f7f301474e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:25.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:25.686+0000 7f7f3777c640 1 --2- 172.21.15.53:0/686541523 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f300cbfc0 0x7f7f3014cef0 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:25.693 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:25.686+0000 7f7f3777c640 1 -- 172.21.15.53:0/686541523 >> 172.21.15.53:0/686541523 conn(0x7f7f3006a0d0 msgr2=0x7f7f3014d680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:25.693 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:25.686+0000 7f7f3777c640 1 -- 172.21.15.53:0/686541523 shutdown_connections 2023-06-10T18:57:25.693 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:25.686+0000 7f7f3777c640 1 -- 172.21.15.53:0/686541523 wait complete. 2023-06-10T18:57:25.708 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-10T18:57:25.709 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-10T18:57:25.709 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi117.front.sepia.ceph.com 2023-06-10T18:57:25.709 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-06-10T18:57:25.709 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-06-10T18:57:25.710 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-10T18:57:25.710 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-10T18:57:25.710 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-10T18:57:25.710 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-06-10T18:57:25.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:57:25.711 DEBUG:teuthology.orchestra.run.smithi117:> ip addr 2023-06-10T18:57:25.718 INFO:teuthology.orchestra.run.smithi117.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-10T18:57:25.718 INFO:teuthology.orchestra.run.smithi117.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-10T18:57:25.718 INFO:teuthology.orchestra.run.smithi117.stdout: inet 127.0.0.1/8 scope host lo 2023-06-10T18:57:25.719 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:57:25.719 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 ::1/128 scope host 2023-06-10T18:57:25.719 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:57:25.719 INFO:teuthology.orchestra.run.smithi117.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T18:57:25.719 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8a brd ff:ff:ff:ff:ff:ff 2023-06-10T18:57:25.719 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f0 2023-06-10T18:57:25.719 INFO:teuthology.orchestra.run.smithi117.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T18:57:25.720 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8b brd ff:ff:ff:ff:ff:ff 2023-06-10T18:57:25.720 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f1 2023-06-10T18:57:25.720 INFO:teuthology.orchestra.run.smithi117.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T18:57:25.720 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:62 brd ff:ff:ff:ff:ff:ff 2023-06-10T18:57:25.720 INFO:teuthology.orchestra.run.smithi117.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-10T18:57:25.720 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:63 brd ff:ff:ff:ff:ff:ff 2023-06-10T18:57:25.720 INFO:teuthology.orchestra.run.smithi117.stdout: inet 172.21.15.117/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-06-10T18:57:25.720 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft 42204sec preferred_lft 42204sec 2023-06-10T18:57:25.721 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::ec4:7aff:fe8f:4463/64 scope link 2023-06-10T18:57:25.721 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:57:25.721 INFO:teuthology.orchestra.run.smithi117.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-06-10T18:57:25.721 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 02:42:f8:40:b2:dc brd ff:ff:ff:ff:ff:ff 2023-06-10T18:57:25.721 INFO:teuthology.orchestra.run.smithi117.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-06-10T18:57:25.721 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:57:25.721 INFO:teuthology.orchestra.run.smithi117.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-10T18:57:25.721 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-06-10T18:57:25.722 INFO:teuthology.orchestra.run.smithi117.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-06-10T18:57:25.722 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:57:25.722 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-06-10T18:57:25.722 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:57:25.722 INFO:teuthology.orchestra.run.smithi117.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-10T18:57:25.723 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-06-10T18:57:25.723 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-06-10T18:57:25.724 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:57:25.724 INFO:teuthology.orchestra.run.smithi117.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-10T18:57:25.724 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-06-10T18:57:25.724 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-06-10T18:57:25.724 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T18:57:25.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:57:25.725 DEBUG:teuthology.orchestra.run.smithi117:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-10T18:57:25.775 INFO:teuthology.orchestra.run.smithi117.stdout:1 2023-06-10T18:57:25.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:57:25.777 DEBUG:teuthology.orchestra.run.smithi117:> route 2023-06-10T18:57:25.826 INFO:teuthology.orchestra.run.smithi117.stdout:Kernel IP routing table 2023-06-10T18:57:25.826 INFO:teuthology.orchestra.run.smithi117.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-10T18:57:25.826 INFO:teuthology.orchestra.run.smithi117.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-06-10T18:57:25.827 INFO:teuthology.orchestra.run.smithi117.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-06-10T18:57:25.827 INFO:teuthology.orchestra.run.smithi117.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-06-10T18:57:25.827 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-06-10T18:57:25.827 INFO:teuthology.orchestra.run.smithi117.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-10T18:57:25.828 INFO:teuthology.orchestra.run.smithi117.stdout:ns2.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-10T18:57:25.828 INFO:teuthology.orchestra.run.smithi117.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-10T18:57:25.828 INFO:teuthology.orchestra.run.smithi117.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-10T18:57:25.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:57:25.829 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec bash -c ' 2023-06-10T18:57:25.830 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2023-06-10T18:57:25.831 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-06-10T18:57:25.831 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-06-10T18:57:25.832 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-06-10T18:57:25.832 DEBUG:teuthology.orchestra.run.smithi117:> ') 2023-06-10T18:57:25.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:57:25.905 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list 2023-06-10T18:57:25.965 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-06-10T18:57:25.966 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-06-10T18:57:25.966 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-06-10T18:57:25.966 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:57:25.967 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link set brx.0 up 2023-06-10T18:57:26.040 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-06-10T18:57:26.040 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-10T18:57:26.041 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-06-10T18:57:26.093 INFO:teuthology.orchestra.run.smithi117.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-06-10T18:57:26.094 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-10T18:57:26.094 DEBUG:teuthology.orchestra.run.smithi117:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-06-10T18:57:26.160 DEBUG:teuthology.orchestra.run.smithi117:> sudo modprobe fuse 2023-06-10T18:57:26.219 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T18:57:26.220 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T18:57:26.276 INFO:teuthology.orchestra.run.smithi117.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T18:57:26.277 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T18:57:26.278 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:57:26.278 DEBUG:teuthology.orchestra.run.smithi117:> ls /sys/fs/fuse/connections 2023-06-10T18:57:26.330 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-06-10T18:57:26.331 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-06-10T18:57:26.380 DEBUG:teuthology.orchestra.run.smithi117:> sudo modprobe fuse 2023-06-10T18:57:26.397 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T18:57:26.398 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T18:57:26.449 INFO:teuthology.orchestra.run.smithi117.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T18:57:26.450 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T18:57:26.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:57:26.452 DEBUG:teuthology.orchestra.run.smithi117:> ls /sys/fs/fuse/connections 2023-06-10T18:57:26.455 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi117.stderr:2023-06-10T18:57:26.448+0000 7f7d1b71b580 -1 init, newargv = 0x564626c3ccb0 newargc=15 2023-06-10T18:57:26.455 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi117.stderr:ceph-fuse[44452]: starting ceph client 2023-06-10T18:57:26.463 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi117.stderr:ceph-fuse[44452]: starting fuse 2023-06-10T18:57:27.563 DEBUG:teuthology.orchestra.run.smithi117:> sudo modprobe fuse 2023-06-10T18:57:27.580 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T18:57:27.581 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T18:57:27.639 INFO:teuthology.orchestra.run.smithi117.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T18:57:27.640 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T18:57:27.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:57:27.641 DEBUG:teuthology.orchestra.run.smithi117:> ls /sys/fs/fuse/connections 2023-06-10T18:57:27.688 INFO:teuthology.orchestra.run.smithi117.stdout:45 2023-06-10T18:57:27.688 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-06-10T18:57:27.688 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-06-10T18:57:27.689 DEBUG:teuthology.orchestra.run.smithi117:> import glob 2023-06-10T18:57:27.689 DEBUG:teuthology.orchestra.run.smithi117:> import re 2023-06-10T18:57:27.689 DEBUG:teuthology.orchestra.run.smithi117:> import os 2023-06-10T18:57:27.690 DEBUG:teuthology.orchestra.run.smithi117:> import subprocess 2023-06-10T18:57:27.690 DEBUG:teuthology.orchestra.run.smithi117:> 2023-06-10T18:57:27.690 DEBUG:teuthology.orchestra.run.smithi117:> def _find_admin_socket(client_name): 2023-06-10T18:57:27.691 DEBUG:teuthology.orchestra.run.smithi117:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-06-10T18:57:27.691 DEBUG:teuthology.orchestra.run.smithi117:> files = glob.glob(asok_path) 2023-06-10T18:57:27.691 DEBUG:teuthology.orchestra.run.smithi117:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-06-10T18:57:27.691 DEBUG:teuthology.orchestra.run.smithi117:> 2023-06-10T18:57:27.692 DEBUG:teuthology.orchestra.run.smithi117:> # Given a non-glob path, it better be there 2023-06-10T18:57:27.692 DEBUG:teuthology.orchestra.run.smithi117:> if "*" not in asok_path: 2023-06-10T18:57:27.692 DEBUG:teuthology.orchestra.run.smithi117:> assert(len(files) == 1) 2023-06-10T18:57:27.693 DEBUG:teuthology.orchestra.run.smithi117:> return files[0] 2023-06-10T18:57:27.693 DEBUG:teuthology.orchestra.run.smithi117:> 2023-06-10T18:57:27.693 DEBUG:teuthology.orchestra.run.smithi117:> for f in files: 2023-06-10T18:57:27.693 DEBUG:teuthology.orchestra.run.smithi117:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-06-10T18:57:27.694 DEBUG:teuthology.orchestra.run.smithi117:> if os.path.exists("/proc/{0}".format(pid)): 2023-06-10T18:57:27.694 DEBUG:teuthology.orchestra.run.smithi117:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-06-10T18:57:27.694 DEBUG:teuthology.orchestra.run.smithi117:> contents = proc_f.read() 2023-06-10T18:57:27.695 DEBUG:teuthology.orchestra.run.smithi117:> if mountpoint in contents: 2023-06-10T18:57:27.695 DEBUG:teuthology.orchestra.run.smithi117:> return f 2023-06-10T18:57:27.696 DEBUG:teuthology.orchestra.run.smithi117:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-06-10T18:57:27.696 DEBUG:teuthology.orchestra.run.smithi117:> 2023-06-10T18:57:27.696 DEBUG:teuthology.orchestra.run.smithi117:> print(_find_admin_socket("client.1")) 2023-06-10T18:57:27.697 DEBUG:teuthology.orchestra.run.smithi117:> ' 2023-06-10T18:57:27.808 INFO:teuthology.orchestra.run.smithi117.stdout:/var/run/ceph/ceph-client.1.44452.asok 2023-06-10T18:57:27.990 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.44452.asok 2023-06-10T18:57:27.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:57:27.991 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.44452.asok status 2023-06-10T18:57:28.150 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2023-06-10T18:57:28.150 INFO:teuthology.orchestra.run.smithi117.stdout: "metadata": { 2023-06-10T18:57:28.151 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_sha1": "219d315c3a0b2075e570fb1964be2ad33fe7a9c8", 2023-06-10T18:57:28.151 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_version": "ceph version 18.0.0-4359-g219d315c (219d315c3a0b2075e570fb1964be2ad33fe7a9c8) reef (dev)", 2023-06-10T18:57:28.151 INFO:teuthology.orchestra.run.smithi117.stdout: "entity_id": "1", 2023-06-10T18:57:28.151 INFO:teuthology.orchestra.run.smithi117.stdout: "hostname": "smithi117", 2023-06-10T18:57:28.151 INFO:teuthology.orchestra.run.smithi117.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-06-10T18:57:28.151 INFO:teuthology.orchestra.run.smithi117.stdout: "pid": "44452", 2023-06-10T18:57:28.151 INFO:teuthology.orchestra.run.smithi117.stdout: "root": "/" 2023-06-10T18:57:28.152 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-06-10T18:57:28.152 INFO:teuthology.orchestra.run.smithi117.stdout: "dentry_count": 0, 2023-06-10T18:57:28.152 INFO:teuthology.orchestra.run.smithi117.stdout: "dentry_pinned_count": 0, 2023-06-10T18:57:28.152 INFO:teuthology.orchestra.run.smithi117.stdout: "id": 5977, 2023-06-10T18:57:28.152 INFO:teuthology.orchestra.run.smithi117.stdout: "inst": { 2023-06-10T18:57:28.152 INFO:teuthology.orchestra.run.smithi117.stdout: "name": { 2023-06-10T18:57:28.152 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "client", 2023-06-10T18:57:28.153 INFO:teuthology.orchestra.run.smithi117.stdout: "num": 5977 2023-06-10T18:57:28.153 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-06-10T18:57:28.153 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": { 2023-06-10T18:57:28.153 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "v1", 2023-06-10T18:57:28.153 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": "192.168.0.1:0", 2023-06-10T18:57:28.153 INFO:teuthology.orchestra.run.smithi117.stdout: "nonce": 914859131 2023-06-10T18:57:28.153 INFO:teuthology.orchestra.run.smithi117.stdout: } 2023-06-10T18:57:28.154 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-06-10T18:57:28.154 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": { 2023-06-10T18:57:28.154 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "v1", 2023-06-10T18:57:28.154 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": "192.168.0.1:0", 2023-06-10T18:57:28.154 INFO:teuthology.orchestra.run.smithi117.stdout: "nonce": 914859131 2023-06-10T18:57:28.154 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-06-10T18:57:28.154 INFO:teuthology.orchestra.run.smithi117.stdout: "inst_str": "client.5977 192.168.0.1:0/914859131", 2023-06-10T18:57:28.155 INFO:teuthology.orchestra.run.smithi117.stdout: "addr_str": "192.168.0.1:0/914859131", 2023-06-10T18:57:28.155 INFO:teuthology.orchestra.run.smithi117.stdout: "inode_count": 1, 2023-06-10T18:57:28.155 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_epoch": 26, 2023-06-10T18:57:28.155 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_epoch": 65, 2023-06-10T18:57:28.155 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_epoch_barrier": 0, 2023-06-10T18:57:28.156 INFO:teuthology.orchestra.run.smithi117.stdout: "blocklisted": false, 2023-06-10T18:57:28.156 INFO:teuthology.orchestra.run.smithi117.stdout: "fs_name": "cephfs" 2023-06-10T18:57:28.156 INFO:teuthology.orchestra.run.smithi117.stdout:} 2023-06-10T18:57:28.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:57:28.164 DEBUG:teuthology.orchestra.run.smithi117:> stat --file-system '--printf=%T 2023-06-10T18:57:28.164 DEBUG:teuthology.orchestra.run.smithi117:> ' -- /home/ubuntu/cephtest/mnt.1 2023-06-10T18:57:28.170 INFO:teuthology.orchestra.run.smithi117.stdout:fuseblk 2023-06-10T18:57:28.170 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-06-10T18:57:28.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:57:28.171 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-06-10T18:57:28.221 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config get mds_reconnect_timeout 2023-06-10T18:57:28.367 INFO:teuthology.orchestra.run.smithi053.stdout:{"mds_reconnect_timeout":"45.000000"} 2023-06-10T18:57:28.367 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_reconnect_timeout": "45.000000" } 2023-06-10T18:57:28.368 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config get ms_max_backoff 2023-06-10T18:57:28.500 INFO:teuthology.orchestra.run.smithi053.stdout:{"ms_max_backoff":"15.000000"} 2023-06-10T18:57:28.500 DEBUG:tasks.cephfs.filesystem:_json_asok output { "ms_max_backoff": "15.000000" } 2023-06-10T18:57:28.501 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T18:57:28.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.614+0000 7fc59690c640 1 Processor -- start 2023-06-10T18:57:28.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.614+0000 7fc59690c640 1 -- start start 2023-06-10T18:57:28.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.614+0000 7fc59690c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc590070f80 0x7fc5900ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:28.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.614+0000 7fc59690c640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc59015f2c0 con 0x7fc59015eef0 2023-06-10T18:57:28.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.614+0000 7fc59690c640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc59015fdc0 con 0x7fc5900ce990 2023-06-10T18:57:28.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.614+0000 7fc59690c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5901600a0 con 0x7fc590070f80 2023-06-10T18:57:28.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.614+0000 7fc58ffff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fc59015eef0 0x7fc59015f570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:42272/0 (socket says 172.21.15.53:42272) 2023-06-10T18:57:28.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.614+0000 7fc58ffff640 1 -- 172.21.15.53:0/1841632579 learned_addr learned my addr 172.21.15.53:0/1841632579 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:57:28.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.614+0000 7fc58effd640 1 -- 172.21.15.53:0/1841632579 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3860069295 0 0) 0x7fc59015f2c0 con 0x7fc59015eef0 2023-06-10T18:57:28.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.614+0000 7fc58f7fe640 1 --2- 172.21.15.53:0/1841632579 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc590070f80 0x7fc5900ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:28.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.614+0000 7fc58effd640 1 -- 172.21.15.53:0/1841632579 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc578003530 con 0x7fc59015eef0 2023-06-10T18:57:28.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.614+0000 7fc58effd640 1 -- 172.21.15.53:0/1841632579 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4123117788 0 0) 0x7fc578003530 con 0x7fc59015eef0 2023-06-10T18:57:28.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.614+0000 7fc58effd640 1 -- 172.21.15.53:0/1841632579 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc590070f80 msgr2=0x7fc5900ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:28.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.614+0000 7fc58effd640 1 --2- 172.21.15.53:0/1841632579 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc590070f80 0x7fc5900ce450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:28.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.614+0000 7fc58effd640 1 -- 172.21.15.53:0/1841632579 >> v1:172.21.15.117:6789/0 conn(0x7fc5900ce990 legacy=0x7fc590069450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:28.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.614+0000 7fc58effd640 1 -- 172.21.15.53:0/1841632579 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc590160380 con 0x7fc59015eef0 2023-06-10T18:57:28.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.614+0000 7fc58effd640 1 -- 172.21.15.53:0/1841632579 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fc584001680 con 0x7fc59015eef0 2023-06-10T18:57:28.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.614+0000 7fc58effd640 1 -- 172.21.15.53:0/1841632579 >> v1:172.21.15.53:6789/0 conn(0x7fc59015eef0 legacy=0x7fc59015f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:28.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.614+0000 7fc58effd640 1 --2- 172.21.15.53:0/1841632579 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc578003a20 0x7fc578003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:28.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.614+0000 7fc58effd640 1 --2- 172.21.15.53:0/1841632579 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5780047d0 0x7fc578004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:28.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.614+0000 7fc58effd640 1 --2- 172.21.15.53:0/1841632579 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc590070f80 0x7fc578005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:28.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.614+0000 7fc58effd640 1 -- 172.21.15.53:0/1841632579 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5901600a0 con 0x7fc578003a20 2023-06-10T18:57:28.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.614+0000 7fc58effd640 1 -- 172.21.15.53:0/1841632579 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc57800baa0 con 0x7fc5780047d0 2023-06-10T18:57:28.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.614+0000 7fc58effd640 1 -- 172.21.15.53:0/1841632579 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc57800bc60 con 0x7fc590070f80 2023-06-10T18:57:28.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.614+0000 7fc58ffff640 1 --2- 172.21.15.53:0/1841632579 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc578003a20 0x7fc578003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:28.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.614+0000 7fc58f7fe640 1 --2- 172.21.15.53:0/1841632579 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5780047d0 0x7fc578004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:28.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.614+0000 7fc58ffff640 1 -- 172.21.15.53:0/1841632579 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc590070f80 msgr2=0x7fc578005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:28.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.614+0000 7fc594ea9640 1 --2- 172.21.15.53:0/1841632579 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc590070f80 0x7fc578005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:28.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.614+0000 7fc58ffff640 1 --2- 172.21.15.53:0/1841632579 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc590070f80 0x7fc578005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:28.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.614+0000 7fc58ffff640 1 -- 172.21.15.53:0/1841632579 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5780047d0 msgr2=0x7fc578004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:28.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.614+0000 7fc58ffff640 1 --2- 172.21.15.53:0/1841632579 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5780047d0 0x7fc578004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:28.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.614+0000 7fc58ffff640 1 -- 172.21.15.53:0/1841632579 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc578003530 con 0x7fc578003a20 2023-06-10T18:57:28.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.614+0000 7fc58f7fe640 1 --2- 172.21.15.53:0/1841632579 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5780047d0 0x7fc578004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:57:28.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.618+0000 7fc58ffff640 1 --2- 172.21.15.53:0/1841632579 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc578003a20 0x7fc578003e30 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fc58400c240 tx=0x7fc58401cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66e00fa864c971fa server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:28.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.618+0000 7fc58effd640 1 -- 172.21.15.53:0/1841632579 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc584005ae0 con 0x7fc578003a20 2023-06-10T18:57:28.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.618+0000 7fc58effd640 1 -- 172.21.15.53:0/1841632579 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc584005c40 con 0x7fc578003a20 2023-06-10T18:57:28.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.618+0000 7fc58effd640 1 -- 172.21.15.53:0/1841632579 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc584007070 con 0x7fc578003a20 2023-06-10T18:57:28.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.618+0000 7fc59690c640 1 -- 172.21.15.53:0/1841632579 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc578003a20 msgr2=0x7fc578003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:28.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.618+0000 7fc59690c640 1 --2- 172.21.15.53:0/1841632579 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc578003a20 0x7fc578003e30 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fc58400c240 tx=0x7fc58401cc40 comp rx=0 tx=0).stop 2023-06-10T18:57:28.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.618+0000 7fc594ea9640 1 -- 172.21.15.53:0/1841632579 reap_dead start 2023-06-10T18:57:28.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.618+0000 7fc59690c640 1 -- 172.21.15.53:0/1841632579 shutdown_connections 2023-06-10T18:57:28.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.618+0000 7fc59690c640 1 -- 172.21.15.53:0/1841632579 >> 172.21.15.53:0/1841632579 conn(0x7fc59006a560 msgr2=0x7fc59006a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:28.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.618+0000 7fc59690c640 1 -- 172.21.15.53:0/1841632579 shutdown_connections 2023-06-10T18:57:28.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.618+0000 7fc59690c640 1 -- 172.21.15.53:0/1841632579 wait complete. 2023-06-10T18:57:28.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.618+0000 7fc59690c640 1 Processor -- start 2023-06-10T18:57:28.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.618+0000 7fc59690c640 1 -- start start 2023-06-10T18:57:28.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.622+0000 7fc59690c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc578003a20 0x7fc5901588c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:28.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.622+0000 7fc59690c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc590161910 0x7fc590156f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:28.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.622+0000 7fc59690c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc59015e200 0x7fc59014cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:28.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.622+0000 7fc59690c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5901584c0 con 0x7fc59015e200 2023-06-10T18:57:28.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.622+0000 7fc59690c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc590157840 con 0x7fc590161910 2023-06-10T18:57:28.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.622+0000 7fc59690c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc590157b20 con 0x7fc578003a20 2023-06-10T18:57:28.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.622+0000 7fc594ea9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc59015e200 0x7fc59014cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:28.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.622+0000 7fc594ea9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc59015e200 0x7fc59014cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54080/0 (socket says 172.21.15.53:54080) 2023-06-10T18:57:28.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.622+0000 7fc594ea9640 1 -- 172.21.15.53:0/3096968578 learned_addr learned my addr 172.21.15.53:0/3096968578 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:57:28.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.622+0000 7fc58f7fe640 1 --2- 172.21.15.53:0/3096968578 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc590161910 0x7fc590156f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:28.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.622+0000 7fc58ffff640 1 --2- 172.21.15.53:0/3096968578 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc578003a20 0x7fc5901588c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:28.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.622+0000 7fc594ea9640 1 -- 172.21.15.53:0/3096968578 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc578003a20 msgr2=0x7fc5901588c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:28.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.622+0000 7fc594ea9640 1 --2- 172.21.15.53:0/3096968578 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc578003a20 0x7fc5901588c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:28.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.622+0000 7fc594ea9640 1 -- 172.21.15.53:0/3096968578 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc590161910 msgr2=0x7fc590156f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:28.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.622+0000 7fc594ea9640 1 --2- 172.21.15.53:0/3096968578 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc590161910 0x7fc590156f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:28.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.622+0000 7fc594ea9640 1 -- 172.21.15.53:0/3096968578 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc590157e00 con 0x7fc59015e200 2023-06-10T18:57:28.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.622+0000 7fc594ea9640 1 --2- 172.21.15.53:0/3096968578 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc59015e200 0x7fc59014cb70 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fc5900c9390 tx=0x7fc58800d830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:28.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.622+0000 7fc58cff9640 1 -- 172.21.15.53:0/3096968578 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58800b070 con 0x7fc59015e200 2023-06-10T18:57:28.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.622+0000 7fc58cff9640 1 -- 172.21.15.53:0/3096968578 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc588003980 con 0x7fc59015e200 2023-06-10T18:57:28.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.622+0000 7fc58cff9640 1 -- 172.21.15.53:0/3096968578 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc588003d30 con 0x7fc59015e200 2023-06-10T18:57:28.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.622+0000 7fc59690c640 1 -- 172.21.15.53:0/3096968578 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5901580e0 con 0x7fc59015e200 2023-06-10T18:57:28.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.622+0000 7fc59690c640 1 -- 172.21.15.53:0/3096968578 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc59015e660 con 0x7fc59015e200 2023-06-10T18:57:28.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.622+0000 7fc59690c640 1 -- 172.21.15.53:0/3096968578 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc59004d790 con 0x7fc59015e200 2023-06-10T18:57:28.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.622+0000 7fc58cff9640 1 -- 172.21.15.53:0/3096968578 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc588005070 con 0x7fc59015e200 2023-06-10T18:57:28.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.622+0000 7fc58cff9640 1 --2- 172.21.15.53:0/3096968578 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc57c066280 0x7fc57c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:28.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.626+0000 7fc58cff9640 1 -- 172.21.15.53:0/3096968578 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6178+0+0 (secure 0 0 0) 0x7fc588082f40 con 0x7fc59015e200 2023-06-10T18:57:28.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.626+0000 7fc58ffff640 1 --2- 172.21.15.53:0/3096968578 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc57c066280 0x7fc57c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:28.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.626+0000 7fc58ffff640 1 --2- 172.21.15.53:0/3096968578 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc57c066280 0x7fc57c068730 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fc5840ab000 tx=0x7fc5840a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:28.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.630+0000 7fc58cff9640 1 -- 172.21.15.53:0/3096968578 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc588050350 con 0x7fc59015e200 2023-06-10T18:57:28.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.826+0000 7fc59690c640 1 -- 172.21.15.53:0/3096968578 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc5900c5470 con 0x7fc59015e200 2023-06-10T18:57:28.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.830+0000 7fc58cff9640 1 -- 172.21.15.53:0/3096968578 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4669 (secure 0 0 0) 0x7fc588018070 con 0x7fc59015e200 2023-06-10T18:57:28.834 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:57:28.834 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":26,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5444,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1300171732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":1300171732},{"type":"v1","addr":"172.21.15.117:6837","nonce":1300171732}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5818,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/507478314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":507478314},{"type":"v1","addr":"172.21.15.117:6836","nonce":507478314}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":6504,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/169051241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":169051241},{"type":"v1","addr":"172.21.15.53:6833","nonce":169051241}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T18:57:13.234809+0000","modified":"2023-06-10T18:57:15.250305+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6507},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6507":{"gid":6507,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/486797221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":486797221},{"type":"v1","addr":"172.21.15.53:6835","nonce":486797221}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-06-10T18:57:28.835 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 26 2023-06-10T18:57:28.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.834+0000 7fc59690c640 1 -- 172.21.15.53:0/3096968578 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc57c066280 msgr2=0x7fc57c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:28.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.834+0000 7fc59690c640 1 --2- 172.21.15.53:0/3096968578 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc57c066280 0x7fc57c068730 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fc5840ab000 tx=0x7fc5840a7070 comp rx=0 tx=0).stop 2023-06-10T18:57:28.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.834+0000 7fc59690c640 1 -- 172.21.15.53:0/3096968578 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc59015e200 msgr2=0x7fc59014cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:28.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.834+0000 7fc59690c640 1 --2- 172.21.15.53:0/3096968578 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc59015e200 0x7fc59014cb70 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fc5900c9390 tx=0x7fc58800d830 comp rx=0 tx=0).stop 2023-06-10T18:57:28.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.834+0000 7fc59690c640 1 -- 172.21.15.53:0/3096968578 shutdown_connections 2023-06-10T18:57:28.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.834+0000 7fc59690c640 1 --2- 172.21.15.53:0/3096968578 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc57c066280 0x7fc57c068730 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:28.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.834+0000 7fc59690c640 1 --2- 172.21.15.53:0/3096968578 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc59015e200 0x7fc59014cb70 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:28.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.834+0000 7fc59690c640 1 --2- 172.21.15.53:0/3096968578 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc590161910 0x7fc590156f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:28.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.834+0000 7fc59690c640 1 --2- 172.21.15.53:0/3096968578 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc578003a20 0x7fc5901588c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:28.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.834+0000 7fc59690c640 1 -- 172.21.15.53:0/3096968578 >> 172.21.15.53:0/3096968578 conn(0x7fc59006a560 msgr2=0x7fc59015b530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:28.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.834+0000 7fc59690c640 1 -- 172.21.15.53:0/3096968578 shutdown_connections 2023-06-10T18:57:28.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:28.834+0000 7fc59690c640 1 -- 172.21.15.53:0/3096968578 wait complete. 2023-06-10T18:57:28.854 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_defer_session_stale false 2023-06-10T18:57:28.998 INFO:teuthology.orchestra.run.smithi053.stdout:{"success":"mds_defer_session_stale = 'false' (not observed, change may require restart) "} 2023-06-10T18:57:28.998 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_defer_session_stale = 'false' (not observed, change may require restart) " } 2023-06-10T18:57:28.999 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T18:57:29.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.114+0000 7fc10a186640 1 Processor -- start 2023-06-10T18:57:29.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.114+0000 7fc10a186640 1 -- start start 2023-06-10T18:57:29.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.114+0000 7fc10a186640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc104159830 0x7fc1040c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:29.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.114+0000 7fc10a186640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc10415a310 0x7fc1040c8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:29.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.114+0000 7fc10a186640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc10415d260 con 0x7fc1040c9c80 2023-06-10T18:57:29.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.114+0000 7fc10a186640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1040ca120 con 0x7fc104159830 2023-06-10T18:57:29.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.114+0000 7fc10a186640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc10415aa30 con 0x7fc10415a310 2023-06-10T18:57:29.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.114+0000 7fc1037fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc104159830 0x7fc1040c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:29.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.114+0000 7fc1037fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc104159830 0x7fc1040c9740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54082/0 (socket says 172.21.15.53:54082) 2023-06-10T18:57:29.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.114+0000 7fc1037fe640 1 -- 172.21.15.53:0/3372214890 learned_addr learned my addr 172.21.15.53:0/3372214890 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:57:29.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.114+0000 7fc103fff640 1 --2- 172.21.15.53:0/3372214890 >> v2:172.21.15.117:3300/0 conn(0x7fc10415a310 0x7fc1040c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:29.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.114+0000 7fc1037fe640 1 -- 172.21.15.53:0/3372214890 >> v2:172.21.15.117:3300/0 conn(0x7fc10415a310 msgr2=0x7fc1040c8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:29.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.114+0000 7fc1037fe640 1 --2- 172.21.15.53:0/3372214890 >> v2:172.21.15.117:3300/0 conn(0x7fc10415a310 0x7fc1040c8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:29.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.114+0000 7fc1037fe640 1 -- 172.21.15.53:0/3372214890 >> v1:172.21.15.117:6789/0 conn(0x7fc1040c9c80 legacy=0x7fc104159c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:29.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.114+0000 7fc1037fe640 1 -- 172.21.15.53:0/3372214890 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc10415d4b0 con 0x7fc104159830 2023-06-10T18:57:29.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.118+0000 7fc1037fe640 1 --2- 172.21.15.53:0/3372214890 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc104159830 0x7fc1040c9740 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fc1040cec70 tx=0x7fc0f401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc17b77581bef697 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:29.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.118+0000 7fc1027fc640 1 -- 172.21.15.53:0/3372214890 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f40ab600 con 0x7fc104159830 2023-06-10T18:57:29.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.118+0000 7fc1027fc640 1 -- 172.21.15.53:0/3372214890 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0f40ab760 con 0x7fc104159830 2023-06-10T18:57:29.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.118+0000 7fc1027fc640 1 -- 172.21.15.53:0/3372214890 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f40abaf0 con 0x7fc104159830 2023-06-10T18:57:29.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.118+0000 7fc10a186640 1 -- 172.21.15.53:0/3372214890 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc104159830 msgr2=0x7fc1040c9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:29.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.118+0000 7fc10a186640 1 --2- 172.21.15.53:0/3372214890 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc104159830 0x7fc1040c9740 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fc1040cec70 tx=0x7fc0f401c400 comp rx=0 tx=0).stop 2023-06-10T18:57:29.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.118+0000 7fc10a186640 1 -- 172.21.15.53:0/3372214890 shutdown_connections 2023-06-10T18:57:29.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.118+0000 7fc10a186640 1 --2- 172.21.15.53:0/3372214890 >> v2:172.21.15.117:3300/0 conn(0x7fc10415a310 0x7fc1040c8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:29.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.118+0000 7fc10a186640 1 --2- 172.21.15.53:0/3372214890 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc104159830 0x7fc1040c9740 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:29.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.118+0000 7fc10a186640 1 -- 172.21.15.53:0/3372214890 >> 172.21.15.53:0/3372214890 conn(0x7fc1040cdca0 msgr2=0x7fc1040ce0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:29.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.118+0000 7fc10a186640 1 -- 172.21.15.53:0/3372214890 shutdown_connections 2023-06-10T18:57:29.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.118+0000 7fc10a186640 1 -- 172.21.15.53:0/3372214890 wait complete. 2023-06-10T18:57:29.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.118+0000 7fc10a186640 1 Processor -- start 2023-06-10T18:57:29.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.118+0000 7fc10a186640 1 -- start start 2023-06-10T18:57:29.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.118+0000 7fc10a186640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1040c9c80 0x7fc1040aea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:29.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.118+0000 7fc10a186640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc104159830 0x7fc104154af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:29.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.118+0000 7fc10a186640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc10415a310 0x7fc104155030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:29.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.118+0000 7fc10a186640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1040c7cd0 con 0x7fc104159830 2023-06-10T18:57:29.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.118+0000 7fc10a186640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1041f4d50 con 0x7fc1040c9c80 2023-06-10T18:57:29.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.118+0000 7fc10a186640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1040ad700 con 0x7fc10415a310 2023-06-10T18:57:29.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.118+0000 7fc102ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc104159830 0x7fc104154af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:29.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.118+0000 7fc102ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc104159830 0x7fc104154af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54096/0 (socket says 172.21.15.53:54096) 2023-06-10T18:57:29.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.118+0000 7fc102ffd640 1 -- 172.21.15.53:0/2534248210 learned_addr learned my addr 172.21.15.53:0/2534248210 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:57:29.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.122+0000 7fc102ffd640 1 -- 172.21.15.53:0/2534248210 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc10415a310 msgr2=0x7fc104155030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:29.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.122+0000 7fc102ffd640 1 --2- 172.21.15.53:0/2534248210 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc10415a310 0x7fc104155030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:29.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.122+0000 7fc102ffd640 1 -- 172.21.15.53:0/2534248210 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1040c9c80 msgr2=0x7fc1040aea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:29.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.122+0000 7fc102ffd640 1 --2- 172.21.15.53:0/2534248210 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1040c9c80 0x7fc1040aea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:29.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.122+0000 7fc102ffd640 1 -- 172.21.15.53:0/2534248210 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0f40094d0 con 0x7fc104159830 2023-06-10T18:57:29.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.122+0000 7fc102ffd640 1 --2- 172.21.15.53:0/2534248210 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc104159830 0x7fc104154af0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fc0f800c450 tx=0x7fc0f800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:29.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.122+0000 7fc0ebfff640 1 -- 172.21.15.53:0/2534248210 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f8012830 con 0x7fc104159830 2023-06-10T18:57:29.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.122+0000 7fc0ebfff640 1 -- 172.21.15.53:0/2534248210 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0f80129b0 con 0x7fc104159830 2023-06-10T18:57:29.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.122+0000 7fc0ebfff640 1 -- 172.21.15.53:0/2534248210 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f8012d60 con 0x7fc104159830 2023-06-10T18:57:29.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.122+0000 7fc10a186640 1 -- 172.21.15.53:0/2534248210 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc10415e110 con 0x7fc104159830 2023-06-10T18:57:29.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.122+0000 7fc10a186640 1 -- 172.21.15.53:0/2534248210 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1040adcc0 con 0x7fc104159830 2023-06-10T18:57:29.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.122+0000 7fc10a186640 1 -- 172.21.15.53:0/2534248210 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc10404d790 con 0x7fc104159830 2023-06-10T18:57:29.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.122+0000 7fc0ebfff640 1 -- 172.21.15.53:0/2534248210 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc0f801c460 con 0x7fc104159830 2023-06-10T18:57:29.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.122+0000 7fc0ebfff640 1 --2- 172.21.15.53:0/2534248210 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc0f00662b0 0x7fc0f0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:29.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.122+0000 7fc0ebfff640 1 -- 172.21.15.53:0/2534248210 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6178+0+0 (secure 0 0 0) 0x7fc0f8083b90 con 0x7fc104159830 2023-06-10T18:57:29.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.122+0000 7fc1037fe640 1 --2- 172.21.15.53:0/2534248210 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc0f00662b0 0x7fc0f0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:29.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.126+0000 7fc1037fe640 1 --2- 172.21.15.53:0/2534248210 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc0f00662b0 0x7fc0f0068760 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fc0f40af000 tx=0x7fc0f4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:29.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.126+0000 7fc0ebfff640 1 -- 172.21.15.53:0/2534248210 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc0f8051020 con 0x7fc104159830 2023-06-10T18:57:29.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.318+0000 7fc10a186640 1 -- 172.21.15.53:0/2534248210 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc10406b8b0 con 0x7fc104159830 2023-06-10T18:57:29.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.318+0000 7fc0ebfff640 1 -- 172.21.15.53:0/2534248210 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4669 (secure 0 0 0) 0x7fc0f8054640 con 0x7fc104159830 2023-06-10T18:57:29.325 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:57:29.326 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":26,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5444,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1300171732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":1300171732},{"type":"v1","addr":"172.21.15.117:6837","nonce":1300171732}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5818,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/507478314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":507478314},{"type":"v1","addr":"172.21.15.117:6836","nonce":507478314}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":6504,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/169051241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":169051241},{"type":"v1","addr":"172.21.15.53:6833","nonce":169051241}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T18:57:13.234809+0000","modified":"2023-06-10T18:57:15.250305+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6507},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6507":{"gid":6507,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/486797221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":486797221},{"type":"v1","addr":"172.21.15.53:6835","nonce":486797221}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-06-10T18:57:29.327 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 26 2023-06-10T18:57:29.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.322+0000 7fc10a186640 1 -- 172.21.15.53:0/2534248210 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc0f00662b0 msgr2=0x7fc0f0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:29.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.322+0000 7fc10a186640 1 --2- 172.21.15.53:0/2534248210 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc0f00662b0 0x7fc0f0068760 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fc0f40af000 tx=0x7fc0f4008040 comp rx=0 tx=0).stop 2023-06-10T18:57:29.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.322+0000 7fc10a186640 1 -- 172.21.15.53:0/2534248210 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc104159830 msgr2=0x7fc104154af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:29.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.322+0000 7fc10a186640 1 --2- 172.21.15.53:0/2534248210 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc104159830 0x7fc104154af0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fc0f800c450 tx=0x7fc0f800c910 comp rx=0 tx=0).stop 2023-06-10T18:57:29.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.322+0000 7fc10a186640 1 -- 172.21.15.53:0/2534248210 shutdown_connections 2023-06-10T18:57:29.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.322+0000 7fc10a186640 1 --2- 172.21.15.53:0/2534248210 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc0f00662b0 0x7fc0f0068760 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:29.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.322+0000 7fc10a186640 1 --2- 172.21.15.53:0/2534248210 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc10415a310 0x7fc104155030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:29.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.322+0000 7fc10a186640 1 --2- 172.21.15.53:0/2534248210 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc104159830 0x7fc104154af0 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:29.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.322+0000 7fc10a186640 1 --2- 172.21.15.53:0/2534248210 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1040c9c80 0x7fc1040aea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:29.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.322+0000 7fc10a186640 1 -- 172.21.15.53:0/2534248210 >> 172.21.15.53:0/2534248210 conn(0x7fc1040cdca0 msgr2=0x7fc104155960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:29.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.322+0000 7fc10a186640 1 -- 172.21.15.53:0/2534248210 shutdown_connections 2023-06-10T18:57:29.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.322+0000 7fc10a186640 1 -- 172.21.15.53:0/2534248210 wait complete. 2023-06-10T18:57:29.344 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-06-10T18:57:29.344 DEBUG:teuthology.orchestra.run.smithi053:> import glob 2023-06-10T18:57:29.345 DEBUG:teuthology.orchestra.run.smithi053:> import re 2023-06-10T18:57:29.345 DEBUG:teuthology.orchestra.run.smithi053:> import os 2023-06-10T18:57:29.345 DEBUG:teuthology.orchestra.run.smithi053:> import subprocess 2023-06-10T18:57:29.346 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T18:57:29.346 DEBUG:teuthology.orchestra.run.smithi053:> def _find_admin_socket(client_name): 2023-06-10T18:57:29.346 DEBUG:teuthology.orchestra.run.smithi053:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-06-10T18:57:29.346 DEBUG:teuthology.orchestra.run.smithi053:> files = glob.glob(asok_path) 2023-06-10T18:57:29.347 DEBUG:teuthology.orchestra.run.smithi053:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-06-10T18:57:29.347 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T18:57:29.347 DEBUG:teuthology.orchestra.run.smithi053:> # Given a non-glob path, it better be there 2023-06-10T18:57:29.347 DEBUG:teuthology.orchestra.run.smithi053:> if "*" not in asok_path: 2023-06-10T18:57:29.348 DEBUG:teuthology.orchestra.run.smithi053:> assert(len(files) == 1) 2023-06-10T18:57:29.348 DEBUG:teuthology.orchestra.run.smithi053:> return files[0] 2023-06-10T18:57:29.348 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T18:57:29.349 DEBUG:teuthology.orchestra.run.smithi053:> for f in files: 2023-06-10T18:57:29.349 DEBUG:teuthology.orchestra.run.smithi053:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-06-10T18:57:29.349 DEBUG:teuthology.orchestra.run.smithi053:> if os.path.exists("/proc/{0}".format(pid)): 2023-06-10T18:57:29.349 DEBUG:teuthology.orchestra.run.smithi053:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-06-10T18:57:29.350 DEBUG:teuthology.orchestra.run.smithi053:> contents = proc_f.read() 2023-06-10T18:57:29.350 DEBUG:teuthology.orchestra.run.smithi053:> if mountpoint in contents: 2023-06-10T18:57:29.350 DEBUG:teuthology.orchestra.run.smithi053:> return f 2023-06-10T18:57:29.350 DEBUG:teuthology.orchestra.run.smithi053:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-06-10T18:57:29.351 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T18:57:29.351 DEBUG:teuthology.orchestra.run.smithi053:> print(_find_admin_socket("client.0")) 2023-06-10T18:57:29.351 DEBUG:teuthology.orchestra.run.smithi053:> ' 2023-06-10T18:57:29.427 INFO:teuthology.orchestra.run.smithi053.stdout:/var/run/ceph/ceph-client.0.52485.asok 2023-06-10T18:57:29.609 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.52485.asok 2023-06-10T18:57:29.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:57:29.611 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.52485.asok mds_sessions 2023-06-10T18:57:29.771 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-06-10T18:57:29.772 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 6702, 2023-06-10T18:57:29.772 INFO:teuthology.orchestra.run.smithi053.stdout: "inst": { 2023-06-10T18:57:29.772 INFO:teuthology.orchestra.run.smithi053.stdout: "name": { 2023-06-10T18:57:29.772 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "client", 2023-06-10T18:57:29.773 INFO:teuthology.orchestra.run.smithi053.stdout: "num": 6702 2023-06-10T18:57:29.773 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:57:29.773 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": { 2023-06-10T18:57:29.774 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2023-06-10T18:57:29.774 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "192.168.0.1:0", 2023-06-10T18:57:29.774 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 683847329 2023-06-10T18:57:29.774 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:57:29.775 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:57:29.775 INFO:teuthology.orchestra.run.smithi053.stdout: "inst_str": "client.6702 v1:192.168.0.1:0/683847329", 2023-06-10T18:57:29.775 INFO:teuthology.orchestra.run.smithi053.stdout: "addr_str": "v1:192.168.0.1:0/683847329", 2023-06-10T18:57:29.775 INFO:teuthology.orchestra.run.smithi053.stdout: "sessions": [ 2023-06-10T18:57:29.776 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T18:57:29.776 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": 0, 2023-06-10T18:57:29.776 INFO:teuthology.orchestra.run.smithi053.stdout: "addrs": { 2023-06-10T18:57:29.777 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2023-06-10T18:57:29.777 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T18:57:29.777 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2023-06-10T18:57:29.777 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.53:6834", 2023-06-10T18:57:29.778 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 486797221 2023-06-10T18:57:29.778 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:57:29.778 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T18:57:29.778 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2023-06-10T18:57:29.778 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.53:6835", 2023-06-10T18:57:29.779 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 486797221 2023-06-10T18:57:29.779 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:57:29.779 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2023-06-10T18:57:29.779 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T18:57:29.779 INFO:teuthology.orchestra.run.smithi053.stdout: "seq": 0, 2023-06-10T18:57:29.779 INFO:teuthology.orchestra.run.smithi053.stdout: "cap_gen": 0, 2023-06-10T18:57:29.780 INFO:teuthology.orchestra.run.smithi053.stdout: "cap_ttl": "2023-06-10T18:58:24.552371+0000", 2023-06-10T18:57:29.780 INFO:teuthology.orchestra.run.smithi053.stdout: "last_cap_renew_request": "2023-06-10T18:57:24.552371+0000", 2023-06-10T18:57:29.780 INFO:teuthology.orchestra.run.smithi053.stdout: "cap_renew_seq": 2, 2023-06-10T18:57:29.780 INFO:teuthology.orchestra.run.smithi053.stdout: "num_caps": 1, 2023-06-10T18:57:29.781 INFO:teuthology.orchestra.run.smithi053.stdout: "state": "open" 2023-06-10T18:57:29.781 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T18:57:29.781 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2023-06-10T18:57:29.781 INFO:teuthology.orchestra.run.smithi053.stdout: "mdsmap_epoch": 26 2023-06-10T18:57:29.781 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-06-10T18:57:29.785 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T18:57:29.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.910+0000 7f85f2b3e640 1 Processor -- start 2023-06-10T18:57:29.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.910+0000 7f85f2b3e640 1 -- start start 2023-06-10T18:57:29.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.910+0000 7f85f2b3e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f85ec159a60 0x7f85ec070950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:29.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.910+0000 7f85f2b3e640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85ec0cb080 con 0x7f85ec0b0f30 2023-06-10T18:57:29.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.910+0000 7f85f2b3e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85ec0cb320 con 0x7f85ec159690 2023-06-10T18:57:29.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.910+0000 7f85f2b3e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85ec070e90 con 0x7f85ec159a60 2023-06-10T18:57:29.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.910+0000 7f85ebfff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f85ec0b0f30 0x7f85ec0c2900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:42276/0 (socket says 172.21.15.53:42276) 2023-06-10T18:57:29.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.910+0000 7f85ebfff640 1 -- 172.21.15.53:0/4162049498 learned_addr learned my addr 172.21.15.53:0/4162049498 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:57:29.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.910+0000 7f85f10db640 1 --2- 172.21.15.53:0/4162049498 >> v2:172.21.15.117:3300/0 conn(0x7f85ec159a60 0x7f85ec070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:29.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.910+0000 7f85eb7fe640 1 -- 172.21.15.53:0/4162049498 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1094711093 0 0) 0x7f85ec0cb080 con 0x7f85ec0b0f30 2023-06-10T18:57:29.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.910+0000 7f85eb7fe640 1 -- 172.21.15.53:0/4162049498 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85dc003530 con 0x7f85ec0b0f30 2023-06-10T18:57:29.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.910+0000 7f85eb7fe640 1 -- 172.21.15.53:0/4162049498 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1803601701 0 0) 0x7f85dc003530 con 0x7f85ec0b0f30 2023-06-10T18:57:29.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.910+0000 7f85eb7fe640 1 -- 172.21.15.53:0/4162049498 >> v2:172.21.15.117:3300/0 conn(0x7f85ec159a60 msgr2=0x7f85ec070950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:29.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.910+0000 7f85eb7fe640 1 --2- 172.21.15.53:0/4162049498 >> v2:172.21.15.117:3300/0 conn(0x7f85ec159a60 0x7f85ec070950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:29.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.910+0000 7f85eb7fe640 1 -- 172.21.15.53:0/4162049498 >> v1:172.21.15.117:6789/0 conn(0x7f85ec159690 legacy=0x7f85ec0cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:29.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.910+0000 7f85eb7fe640 1 -- 172.21.15.53:0/4162049498 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85ec0cb600 con 0x7f85ec0b0f30 2023-06-10T18:57:29.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.910+0000 7f85eb7fe640 1 -- 172.21.15.53:0/4162049498 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f85d8001680 con 0x7f85ec0b0f30 2023-06-10T18:57:29.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.910+0000 7f85eb7fe640 1 -- 172.21.15.53:0/4162049498 >> v1:172.21.15.53:6789/0 conn(0x7f85ec0b0f30 legacy=0x7f85ec0c2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:29.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.910+0000 7f85eb7fe640 1 --2- 172.21.15.53:0/4162049498 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85dc003a40 0x7f85dc003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:29.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.910+0000 7f85eb7fe640 1 --2- 172.21.15.53:0/4162049498 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85dc0047d0 0x7f85dc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:29.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.910+0000 7f85eb7fe640 1 --2- 172.21.15.53:0/4162049498 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85dc005180 0x7f85dc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:29.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.910+0000 7f85eb7fe640 1 -- 172.21.15.53:0/4162049498 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85ec070e90 con 0x7f85dc003a40 2023-06-10T18:57:29.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.910+0000 7f85eb7fe640 1 -- 172.21.15.53:0/4162049498 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85dc00c0c0 con 0x7f85dc005180 2023-06-10T18:57:29.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.910+0000 7f85eb7fe640 1 -- 172.21.15.53:0/4162049498 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85dc00c280 con 0x7f85dc0047d0 2023-06-10T18:57:29.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.910+0000 7f85f08da640 1 --2- 172.21.15.53:0/4162049498 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85dc003a40 0x7f85dc003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:29.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.910+0000 7f85f10db640 1 --2- 172.21.15.53:0/4162049498 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85dc005180 0x7f85dc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:29.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.910+0000 7f85ebfff640 1 --2- 172.21.15.53:0/4162049498 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85dc0047d0 0x7f85dc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:29.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.910+0000 7f85f08da640 1 -- 172.21.15.53:0/4162049498 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85dc0047d0 msgr2=0x7f85dc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:29.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.910+0000 7f85f08da640 1 --2- 172.21.15.53:0/4162049498 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85dc0047d0 0x7f85dc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:29.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.910+0000 7f85f08da640 1 -- 172.21.15.53:0/4162049498 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85dc005180 msgr2=0x7f85dc00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:29.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.910+0000 7f85f08da640 1 --2- 172.21.15.53:0/4162049498 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85dc005180 0x7f85dc00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:29.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.910+0000 7f85f10db640 1 -- 172.21.15.53:0/4162049498 reap_dead start 2023-06-10T18:57:29.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.910+0000 7f85f08da640 1 -- 172.21.15.53:0/4162049498 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85dc003530 con 0x7f85dc003a40 2023-06-10T18:57:29.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.910+0000 7f85ebfff640 1 --2- 172.21.15.53:0/4162049498 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85dc0047d0 0x7f85dc004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:57:29.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.914+0000 7f85f08da640 1 --2- 172.21.15.53:0/4162049498 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85dc003a40 0x7f85dc003e50 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f85e0001750 tx=0x7f85e001c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e90f210e1c4fc82 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:29.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.914+0000 7f85eb7fe640 1 -- 172.21.15.53:0/4162049498 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e00052d0 con 0x7f85dc003a40 2023-06-10T18:57:29.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.914+0000 7f85eb7fe640 1 -- 172.21.15.53:0/4162049498 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85e00a7050 con 0x7f85dc003a40 2023-06-10T18:57:29.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.914+0000 7f85eb7fe640 1 -- 172.21.15.53:0/4162049498 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e0003600 con 0x7f85dc003a40 2023-06-10T18:57:29.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.914+0000 7f85f2b3e640 1 -- 172.21.15.53:0/4162049498 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85dc003a40 msgr2=0x7f85dc003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:29.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.914+0000 7f85f2b3e640 1 --2- 172.21.15.53:0/4162049498 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85dc003a40 0x7f85dc003e50 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f85e0001750 tx=0x7f85e001c3a0 comp rx=0 tx=0).stop 2023-06-10T18:57:29.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.914+0000 7f85f2b3e640 1 -- 172.21.15.53:0/4162049498 shutdown_connections 2023-06-10T18:57:29.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.914+0000 7f85f2b3e640 1 --2- 172.21.15.53:0/4162049498 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85dc003a40 0x7f85dc003e50 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:29.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.914+0000 7f85f2b3e640 1 -- 172.21.15.53:0/4162049498 >> 172.21.15.53:0/4162049498 conn(0x7f85ec06a560 msgr2=0x7f85ec06a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:29.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.914+0000 7f85f2b3e640 1 -- 172.21.15.53:0/4162049498 shutdown_connections 2023-06-10T18:57:29.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.914+0000 7f85f2b3e640 1 -- 172.21.15.53:0/4162049498 wait complete. 2023-06-10T18:57:29.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.918+0000 7f85f2b3e640 1 Processor -- start 2023-06-10T18:57:29.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.918+0000 7f85f2b3e640 1 -- start start 2023-06-10T18:57:29.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.918+0000 7f85f2b3e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85dc003a40 0x7f85ec0c8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:29.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.918+0000 7f85f2b3e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85ec154d50 0x7f85ec0c72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:29.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.918+0000 7f85f2b3e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85ec154520 0x7f85ec0b3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:29.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.918+0000 7f85f2b3e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85ec155660 con 0x7f85dc003a40 2023-06-10T18:57:29.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.918+0000 7f85f2b3e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85ec0c8d90 con 0x7f85ec154d50 2023-06-10T18:57:29.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.918+0000 7f85f2b3e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85ec0c7820 con 0x7f85ec154520 2023-06-10T18:57:29.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.918+0000 7f85f08da640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85dc003a40 0x7f85ec0c8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:29.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.918+0000 7f85f08da640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85dc003a40 0x7f85ec0c8850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54110/0 (socket says 172.21.15.53:54110) 2023-06-10T18:57:29.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.918+0000 7f85f08da640 1 -- 172.21.15.53:0/1275361488 learned_addr learned my addr 172.21.15.53:0/1275361488 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:57:29.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.918+0000 7f85f10db640 1 --2- 172.21.15.53:0/1275361488 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85ec154520 0x7f85ec0b3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:29.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.918+0000 7f85ebfff640 1 --2- 172.21.15.53:0/1275361488 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85ec154d50 0x7f85ec0c72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:29.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.918+0000 7f85f08da640 1 -- 172.21.15.53:0/1275361488 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85ec154520 msgr2=0x7f85ec0b3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:29.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.918+0000 7f85f08da640 1 --2- 172.21.15.53:0/1275361488 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85ec154520 0x7f85ec0b3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:29.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.918+0000 7f85f08da640 1 -- 172.21.15.53:0/1275361488 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85ec154d50 msgr2=0x7f85ec0c72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:29.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.918+0000 7f85f08da640 1 --2- 172.21.15.53:0/1275361488 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85ec154d50 0x7f85ec0c72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:29.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.918+0000 7f85f08da640 1 -- 172.21.15.53:0/1275361488 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85ec0c6e50 con 0x7f85dc003a40 2023-06-10T18:57:29.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.918+0000 7f85f08da640 1 --2- 172.21.15.53:0/1275361488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85dc003a40 0x7f85ec0c8850 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f85e0000c10 tx=0x7f85dc005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:29.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.918+0000 7f85e97fa640 1 -- 172.21.15.53:0/1275361488 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e00072f0 con 0x7f85dc003a40 2023-06-10T18:57:29.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.918+0000 7f85e97fa640 1 -- 172.21.15.53:0/1275361488 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85e0007450 con 0x7f85dc003a40 2023-06-10T18:57:29.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.918+0000 7f85e97fa640 1 -- 172.21.15.53:0/1275361488 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e00067e0 con 0x7f85dc003a40 2023-06-10T18:57:29.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.918+0000 7f85f2b3e640 1 -- 172.21.15.53:0/1275361488 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85ec0c6850 con 0x7f85dc003a40 2023-06-10T18:57:29.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.918+0000 7f85f2b3e640 1 -- 172.21.15.53:0/1275361488 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85ec0b2f70 con 0x7f85dc003a40 2023-06-10T18:57:29.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.922+0000 7f85f2b3e640 1 -- 172.21.15.53:0/1275361488 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85ec0b4dc0 con 0x7f85dc003a40 2023-06-10T18:57:29.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.922+0000 7f85e97fa640 1 -- 172.21.15.53:0/1275361488 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f85e00a4d50 con 0x7f85dc003a40 2023-06-10T18:57:29.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.922+0000 7f85e97fa640 1 --2- 172.21.15.53:0/1275361488 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f85d0066280 0x7f85d0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:29.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.922+0000 7f85e97fa640 1 -- 172.21.15.53:0/1275361488 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6178+0+0 (secure 0 0 0) 0x7f85e011e6f0 con 0x7f85dc003a40 2023-06-10T18:57:29.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.922+0000 7f85ebfff640 1 --2- 172.21.15.53:0/1275361488 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f85d0066280 0x7f85d0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:29.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.922+0000 7f85ebfff640 1 --2- 172.21.15.53:0/1275361488 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f85d0066280 0x7f85d0068730 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f85d8000fc0 tx=0x7f85d8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:29.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:29.926+0000 7f85e97fa640 1 -- 172.21.15.53:0/1275361488 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f85e00ef710 con 0x7f85dc003a40 2023-06-10T18:57:30.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.114+0000 7f85f2b3e640 1 -- 172.21.15.53:0/1275361488 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f85ec04d790 con 0x7f85dc003a40 2023-06-10T18:57:30.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.114+0000 7f85e97fa640 1 -- 172.21.15.53:0/1275361488 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4669 (secure 0 0 0) 0x7f85e00ef2a0 con 0x7f85dc003a40 2023-06-10T18:57:30.119 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:57:30.119 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":26,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5444,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1300171732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":1300171732},{"type":"v1","addr":"172.21.15.117:6837","nonce":1300171732}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5818,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/507478314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":507478314},{"type":"v1","addr":"172.21.15.117:6836","nonce":507478314}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":6504,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/169051241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":169051241},{"type":"v1","addr":"172.21.15.53:6833","nonce":169051241}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T18:57:13.234809+0000","modified":"2023-06-10T18:57:15.250305+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6507},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6507":{"gid":6507,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/486797221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":486797221},{"type":"v1","addr":"172.21.15.53:6835","nonce":486797221}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-06-10T18:57:30.119 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 26 2023-06-10T18:57:30.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.114+0000 7f85f2b3e640 1 -- 172.21.15.53:0/1275361488 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f85d0066280 msgr2=0x7f85d0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:30.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.114+0000 7f85f2b3e640 1 --2- 172.21.15.53:0/1275361488 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f85d0066280 0x7f85d0068730 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f85d8000fc0 tx=0x7f85d8009040 comp rx=0 tx=0).stop 2023-06-10T18:57:30.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.114+0000 7f85f2b3e640 1 -- 172.21.15.53:0/1275361488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85dc003a40 msgr2=0x7f85ec0c8850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:30.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.114+0000 7f85f2b3e640 1 --2- 172.21.15.53:0/1275361488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85dc003a40 0x7f85ec0c8850 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f85e0000c10 tx=0x7f85dc005800 comp rx=0 tx=0).stop 2023-06-10T18:57:30.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.114+0000 7f85f2b3e640 1 -- 172.21.15.53:0/1275361488 shutdown_connections 2023-06-10T18:57:30.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.114+0000 7f85f2b3e640 1 --2- 172.21.15.53:0/1275361488 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f85d0066280 0x7f85d0068730 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:30.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.114+0000 7f85f2b3e640 1 --2- 172.21.15.53:0/1275361488 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85ec154520 0x7f85ec0b3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:30.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.114+0000 7f85f2b3e640 1 --2- 172.21.15.53:0/1275361488 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85ec154d50 0x7f85ec0c72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:30.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.114+0000 7f85f2b3e640 1 --2- 172.21.15.53:0/1275361488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85dc003a40 0x7f85ec0c8850 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:30.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.114+0000 7f85f2b3e640 1 -- 172.21.15.53:0/1275361488 >> 172.21.15.53:0/1275361488 conn(0x7f85ec06a560 msgr2=0x7f85ec06cbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:30.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.114+0000 7f85f2b3e640 1 -- 172.21.15.53:0/1275361488 shutdown_connections 2023-06-10T18:57:30.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.114+0000 7f85f2b3e640 1 -- 172.21.15.53:0/1275361488 wait complete. 2023-06-10T18:57:30.139 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session config 6702 timeout 120 2023-06-10T18:57:30.281 DEBUG:tasks.cephfs.filesystem:_json_asok output empty 2023-06-10T18:57:30.281 INFO:tasks.cephfs.mount:Killing connection on ubuntu@smithi053.front.sepia.ceph.com... 2023-06-10T18:57:30.281 INFO:tasks.cephfs.mount:Suspending the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-06-10T18:57:30.282 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T18:57:30.282 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link set brx.0 down 2023-06-10T18:57:30.297 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T18:57:30.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.462+0000 7f30dd00a640 1 Processor -- start 2023-06-10T18:57:30.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.462+0000 7f30dd00a640 1 -- start start 2023-06-10T18:57:30.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.462+0000 7f30dd00a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30d80c9840 0x7f30d80c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:30.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.462+0000 7f30dd00a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f30d8071060 0x7f30d80af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:30.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.462+0000 7f30dd00a640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30d8159b50 con 0x7f30d80afc60 2023-06-10T18:57:30.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.462+0000 7f30dd00a640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30d80ca150 con 0x7f30d8071060 2023-06-10T18:57:30.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.462+0000 7f30dd00a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30d80702a0 con 0x7f30d80c9840 2023-06-10T18:57:30.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.462+0000 7f30d659c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f30d8071060 0x7f30d80af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:30.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.462+0000 7f30d759e640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f30d80afc60 0x7f30d815d2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:42282/0 (socket says 172.21.15.53:42282) 2023-06-10T18:57:30.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.462+0000 7f30d759e640 1 -- 172.21.15.53:0/3144127625 learned_addr learned my addr 172.21.15.53:0/3144127625 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:57:30.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.462+0000 7f30d6d9d640 1 --2- 172.21.15.53:0/3144127625 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30d80c9840 0x7f30d80c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:30.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.462+0000 7f30d659c640 1 -- 172.21.15.53:0/3144127625 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30d80c9840 msgr2=0x7f30d80c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:57:30.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.462+0000 7f30d659c640 1 --2- 172.21.15.53:0/3144127625 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30d80c9840 0x7f30d80c9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:30.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.462+0000 7f30d659c640 1 -- 172.21.15.53:0/3144127625 >> v1:172.21.15.53:6789/0 conn(0x7f30d80afc60 legacy=0x7f30d815d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:30.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.462+0000 7f30d659c640 1 -- 172.21.15.53:0/3144127625 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30d8070580 con 0x7f30d8071060 2023-06-10T18:57:30.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.462+0000 7f30d6d9d640 1 --2- 172.21.15.53:0/3144127625 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30d80c9840 0x7f30d80c9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T18:57:30.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.466+0000 7f30d659c640 1 --2- 172.21.15.53:0/3144127625 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30d8071060 0x7f30d80af720 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f30c80097c0 tx=0x7f30c801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92f85a1491e4e9b9 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:30.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.466+0000 7f30d5d9b640 1 -- 172.21.15.53:0/3144127625 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c80ab600 con 0x7f30d8071060 2023-06-10T18:57:30.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.466+0000 7f30d5d9b640 1 -- 172.21.15.53:0/3144127625 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30c80a7050 con 0x7f30d8071060 2023-06-10T18:57:30.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.466+0000 7f30d5d9b640 1 -- 172.21.15.53:0/3144127625 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c80ab980 con 0x7f30d8071060 2023-06-10T18:57:30.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.466+0000 7f30dd00a640 1 -- 172.21.15.53:0/3144127625 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30d8071060 msgr2=0x7f30d80af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:30.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.466+0000 7f30dd00a640 1 --2- 172.21.15.53:0/3144127625 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30d8071060 0x7f30d80af720 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f30c80097c0 tx=0x7f30c801c450 comp rx=0 tx=0).stop 2023-06-10T18:57:30.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.466+0000 7f30dd00a640 1 -- 172.21.15.53:0/3144127625 shutdown_connections 2023-06-10T18:57:30.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.466+0000 7f30dd00a640 1 --2- 172.21.15.53:0/3144127625 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30d8071060 0x7f30d80af720 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:30.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.466+0000 7f30dd00a640 1 --2- 172.21.15.53:0/3144127625 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30d80c9840 0x7f30d80c9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:30.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.466+0000 7f30dd00a640 1 -- 172.21.15.53:0/3144127625 >> 172.21.15.53:0/3144127625 conn(0x7f30d806a0d0 msgr2=0x7f30d80ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:30.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.466+0000 7f30dd00a640 1 -- 172.21.15.53:0/3144127625 shutdown_connections 2023-06-10T18:57:30.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.466+0000 7f30dd00a640 1 -- 172.21.15.53:0/3144127625 wait complete. 2023-06-10T18:57:30.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.466+0000 7f30dd00a640 1 Processor -- start 2023-06-10T18:57:30.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.466+0000 7f30dd00a640 1 -- start start 2023-06-10T18:57:30.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.466+0000 7f30dd00a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30d8071060 0x7f30d80ccca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:30.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.466+0000 7f30dd00a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30d80afc60 0x7f30d814b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:30.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.466+0000 7f30dd00a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30d80c9840 0x7f30d81584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:30.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.466+0000 7f30dd00a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30d80ac800 con 0x7f30d80c9840 2023-06-10T18:57:30.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.466+0000 7f30dd00a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30d814ab50 con 0x7f30d80afc60 2023-06-10T18:57:30.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.466+0000 7f30dd00a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30d814ae30 con 0x7f30d8071060 2023-06-10T18:57:30.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.466+0000 7f30d759e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30d80c9840 0x7f30d81584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:30.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.466+0000 7f30d759e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30d80c9840 0x7f30d81584d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54140/0 (socket says 172.21.15.53:54140) 2023-06-10T18:57:30.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.466+0000 7f30d759e640 1 -- 172.21.15.53:0/3910980805 learned_addr learned my addr 172.21.15.53:0/3910980805 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:57:30.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.466+0000 7f30d6d9d640 1 --2- 172.21.15.53:0/3910980805 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30d8071060 0x7f30d80ccca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:30.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.470+0000 7f30d659c640 1 --2- 172.21.15.53:0/3910980805 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30d80afc60 0x7f30d814b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:30.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.470+0000 7f30d759e640 1 -- 172.21.15.53:0/3910980805 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30d8071060 msgr2=0x7f30d80ccca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:30.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.470+0000 7f30d759e640 1 --2- 172.21.15.53:0/3910980805 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30d8071060 0x7f30d80ccca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:30.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.470+0000 7f30d759e640 1 -- 172.21.15.53:0/3910980805 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30d80afc60 msgr2=0x7f30d814b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:30.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.470+0000 7f30d759e640 1 --2- 172.21.15.53:0/3910980805 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30d80afc60 0x7f30d814b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:30.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.470+0000 7f30d759e640 1 -- 172.21.15.53:0/3910980805 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30c8009420 con 0x7f30d80c9840 2023-06-10T18:57:30.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.470+0000 7f30d759e640 1 --2- 172.21.15.53:0/3910980805 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30d80c9840 0x7f30d81584d0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f30d000cbc0 tx=0x7f30d000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:30.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.470+0000 7f30bf7fe640 1 -- 172.21.15.53:0/3910980805 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d000ad40 con 0x7f30d80c9840 2023-06-10T18:57:30.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.470+0000 7f30bf7fe640 1 -- 172.21.15.53:0/3910980805 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30d0012400 con 0x7f30d80c9840 2023-06-10T18:57:30.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.470+0000 7f30dd00a640 1 -- 172.21.15.53:0/3910980805 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30d814b110 con 0x7f30d80c9840 2023-06-10T18:57:30.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.470+0000 7f30bf7fe640 1 -- 172.21.15.53:0/3910980805 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d000aea0 con 0x7f30d80c9840 2023-06-10T18:57:30.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.470+0000 7f30dd00a640 1 -- 172.21.15.53:0/3910980805 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30d814bb70 con 0x7f30d80c9840 2023-06-10T18:57:30.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.470+0000 7f30dd00a640 1 -- 172.21.15.53:0/3910980805 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30d814be20 con 0x7f30d80c9840 2023-06-10T18:57:30.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.470+0000 7f30bf7fe640 1 -- 172.21.15.53:0/3910980805 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f30d0007070 con 0x7f30d80c9840 2023-06-10T18:57:30.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.470+0000 7f30bf7fe640 1 --2- 172.21.15.53:0/3910980805 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f30c4066280 0x7f30c4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:57:30.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.470+0000 7f30bf7fe640 1 -- 172.21.15.53:0/3910980805 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6178+0+0 (secure 0 0 0) 0x7f30d0083d40 con 0x7f30d80c9840 2023-06-10T18:57:30.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.470+0000 7f30d6d9d640 1 --2- 172.21.15.53:0/3910980805 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f30c4066280 0x7f30c4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:57:30.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.470+0000 7f30d6d9d640 1 --2- 172.21.15.53:0/3910980805 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f30c4066280 0x7f30c4068730 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f30cc006fd0 tx=0x7f30cc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:57:30.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.474+0000 7f30bf7fe640 1 -- 172.21.15.53:0/3910980805 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f30d0051150 con 0x7f30d80c9840 2023-06-10T18:57:30.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.662+0000 7f30dd00a640 1 -- 172.21.15.53:0/3910980805 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f30d814a9b0 con 0x7f30d80c9840 2023-06-10T18:57:30.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.666+0000 7f30bf7fe640 1 -- 172.21.15.53:0/3910980805 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4669 (secure 0 0 0) 0x7f30d814a9b0 con 0x7f30d80c9840 2023-06-10T18:57:30.670 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:57:30.670 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":26,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5444,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1300171732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":1300171732},{"type":"v1","addr":"172.21.15.117:6837","nonce":1300171732}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5818,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/507478314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":507478314},{"type":"v1","addr":"172.21.15.117:6836","nonce":507478314}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":6504,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/169051241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":169051241},{"type":"v1","addr":"172.21.15.53:6833","nonce":169051241}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T18:57:13.234809+0000","modified":"2023-06-10T18:57:15.250305+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6507},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6507":{"gid":6507,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/486797221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":486797221},{"type":"v1","addr":"172.21.15.53:6835","nonce":486797221}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-06-10T18:57:30.670 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 26 2023-06-10T18:57:30.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.666+0000 7f30dd00a640 1 -- 172.21.15.53:0/3910980805 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f30c4066280 msgr2=0x7f30c4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:30.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.666+0000 7f30dd00a640 1 --2- 172.21.15.53:0/3910980805 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f30c4066280 0x7f30c4068730 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f30cc006fd0 tx=0x7f30cc008040 comp rx=0 tx=0).stop 2023-06-10T18:57:30.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.666+0000 7f30dd00a640 1 -- 172.21.15.53:0/3910980805 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30d80c9840 msgr2=0x7f30d81584d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:57:30.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.666+0000 7f30dd00a640 1 --2- 172.21.15.53:0/3910980805 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30d80c9840 0x7f30d81584d0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f30d000cbc0 tx=0x7f30d000a430 comp rx=0 tx=0).stop 2023-06-10T18:57:30.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.666+0000 7f30dd00a640 1 -- 172.21.15.53:0/3910980805 shutdown_connections 2023-06-10T18:57:30.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.666+0000 7f30dd00a640 1 --2- 172.21.15.53:0/3910980805 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f30c4066280 0x7f30c4068730 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:30.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.666+0000 7f30dd00a640 1 --2- 172.21.15.53:0/3910980805 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30d80c9840 0x7f30d81584d0 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:30.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.666+0000 7f30dd00a640 1 --2- 172.21.15.53:0/3910980805 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30d80afc60 0x7f30d814b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:30.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.666+0000 7f30dd00a640 1 --2- 172.21.15.53:0/3910980805 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f30d8071060 0x7f30d80ccca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:57:30.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.666+0000 7f30dd00a640 1 -- 172.21.15.53:0/3910980805 >> 172.21.15.53:0/3910980805 conn(0x7f30d806a0d0 msgr2=0x7f30d8150620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:57:30.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.666+0000 7f30dd00a640 1 -- 172.21.15.53:0/3910980805 shutdown_connections 2023-06-10T18:57:30.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:57:30.666+0000 7f30dd00a640 1 -- 172.21.15.53:0/3910980805 wait complete. 2023-06-10T18:57:30.689 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2023-06-10T18:57:30.816 INFO:teuthology.orchestra.run.smithi053.stdout:[{"id":5977,"entity":{"name":{"type":"client","num":5977},"addr":{"type":"any","addr":"192.168.0.1:0","nonce":914859131}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":0,"uptime":4.3439598640000003,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":0.99002267055643489,"halflife":300},"cap_acquisition":{"value":0,"halflife":10},"last_trim_completed_requests_tid":1,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.5977 192.168.0.1:0/914859131","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x00000000000fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"219d315c3a0b2075e570fb1964be2ad33fe7a9c8","ceph_version":"ceph version 18.0.0-4359-g219d315c (219d315c3a0b2075e570fb1964be2ad33fe7a9c8) reef (dev)","entity_id":"1","hostname":"smithi117","mount_point":"/home/ubuntu/cephtest/mnt.1","pid":"44452","root":"/"}},{"id":6702,"entity":{"name":{"type":"client","num":6702},"addr":{"type":"any","addr":"192.168.0.1:0","nonce":683847329}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":1,"uptime":7.2479330229999999,"requests_in_flight":0,"num_completed_requests":1,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":0.98340224682435784,"halflife":300},"cap_acquisition":{"value":0,"halflife":10},"last_trim_completed_requests_tid":2,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.6702 192.168.0.1:0/683847329","completed_requests":[{"tid":2,"created_ino":"0x0"}],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x00000000000fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"219d315c3a0b2075e570fb1964be2ad33fe7a9c8","ceph_version":"ceph version 18.0.0-4359-g219d315c (219d315c3a0b2075e570fb1964be2ad33fe7a9c8) reef (dev)","entity_id":"0","hostname":"smithi053","mount_point":"/home/ubuntu/cephtest/mnt.0","pid":"52485","root":"/","timeout":"120"}}] 2023-06-10T18:57:30.817 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 10, "value": 0 }, "client_metadata": { "ceph_sha1": "219d315c3a0b2075e570fb1964be2ad33fe7a9c8", "ceph_version": "ceph version 18.0.0-4359-g219d315c (219d315c3a0b2075e570fb1964be2ad33fe7a9c8) reef (dev)", "client_features": { "feature_bits": "0x00000000000fffff" }, "entity_id": "1", "hostname": "smithi117", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "mount_point": "/home/ubuntu/cephtest/mnt.1", "pid": "44452", "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 914859131, "type": "any" }, "name": { "num": 5977, "type": "client" } }, "id": 5977, "inst": "client.5977 192.168.0.1:0/914859131", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 1, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 0, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 0.9900226705564349 }, "state": "open", "uptime": 4.343959864 }, { "cap_acquisition": { "halflife": 10, "value": 0 }, "client_metadata": { "ceph_sha1": "219d315c3a0b2075e570fb1964be2ad33fe7a9c8", "ceph_version": "ceph version 18.0.0-4359-g219d315c (219d315c3a0b2075e570fb1964be2ad33fe7a9c8) reef (dev)", "client_features": { "feature_bits": "0x00000000000fffff" }, "entity_id": "0", "hostname": "smithi053", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "mount_point": "/home/ubuntu/cephtest/mnt.0", "pid": "52485", "root": "/", "timeout": "120" }, "completed_requests": [ { "created_ino": "0x0", "tid": 2 } ], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 683847329, "type": "any" }, "name": { "num": 6702, "type": "client" } }, "id": 6702, "inst": "client.6702 192.168.0.1:0/683847329", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 2, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 1, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 1, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 0.9834022468243578 }, "state": "open", "uptime": 7.247933023 } ] 2023-06-10T18:57:36.569 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-10T18:57:36.573 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-10T18:58:06.700 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-10T18:58:06.703 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-10T18:58:36.811 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-10T18:58:36.814 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-10T18:59:00.818 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T18:59:00.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:59:00.949+0000 7f0dba5cc640 1 Processor -- start 2023-06-10T18:59:00.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:59:00.949+0000 7f0dba5cc640 1 -- start start 2023-06-10T18:59:00.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:59:00.949+0000 7f0dba5cc640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0db415c7f0 0x7f0db415f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:59:00.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:59:00.949+0000 7f0dba5cc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0db415f860 0x7f0db40ceb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:59:00.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:59:00.949+0000 7f0dba5cc640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0db415cc40 con 0x7f0db406b780 2023-06-10T18:59:00.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:59:00.949+0000 7f0dba5cc640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0db415c3d0 con 0x7f0db415f860 2023-06-10T18:59:00.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:59:00.949+0000 7f0dba5cc640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0db40af530 con 0x7f0db415c7f0 2023-06-10T18:59:00.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:59:00.949+0000 7f0db8b69640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0db415f860 0x7f0db40ceb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:59:00.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:59:00.949+0000 7f0db3fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f0db406b780 0x7f0db406bb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:46478/0 (socket says 172.21.15.53:46478) 2023-06-10T18:59:00.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:59:00.949+0000 7f0db8b69640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0db415f860 0x7f0db40ceb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48918/0 (socket says 172.21.15.53:48918) 2023-06-10T18:59:00.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:59:00.949+0000 7f0db3fff640 1 -- 172.21.15.53:0/1131831367 learned_addr learned my addr 172.21.15.53:0/1131831367 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T18:59:00.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:59:00.949+0000 7f0db37fe640 1 --2- 172.21.15.53:0/1131831367 >> v2:172.21.15.117:3300/0 conn(0x7f0db415c7f0 0x7f0db415f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:59:00.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:59:00.949+0000 7f0db8b69640 1 -- 172.21.15.53:0/1131831367 >> v2:172.21.15.117:3300/0 conn(0x7f0db415c7f0 msgr2=0x7f0db415f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T18:59:00.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:59:00.949+0000 7f0db8b69640 1 --2- 172.21.15.53:0/1131831367 >> v2:172.21.15.117:3300/0 conn(0x7f0db415c7f0 0x7f0db415f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:59:00.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:59:00.949+0000 7f0db8b69640 1 -- 172.21.15.53:0/1131831367 >> v1:172.21.15.53:6789/0 conn(0x7f0db406b780 legacy=0x7f0db406bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:59:00.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:59:00.949+0000 7f0db8b69640 1 -- 172.21.15.53:0/1131831367 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db415fd70 con 0x7f0db415f860 2023-06-10T18:59:00.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:59:00.949+0000 7f0db8b69640 1 --2- 172.21.15.53:0/1131831367 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0db415f860 0x7f0db40ceb20 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f0db40cdad0 tx=0x7f0dac01c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cd685c9fc7b6666 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:59:00.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:59:00.953+0000 7f0db2ffd640 1 -- 172.21.15.53:0/1131831367 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dac0a5940 con 0x7f0db415f860 2023-06-10T18:59:00.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:59:00.953+0000 7f0db2ffd640 1 -- 172.21.15.53:0/1131831367 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dac0a5aa0 con 0x7f0db415f860 2023-06-10T18:59:00.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:59:00.953+0000 7f0db2ffd640 1 -- 172.21.15.53:0/1131831367 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dac0a5e30 con 0x7f0db415f860 2023-06-10T18:59:00.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:59:00.953+0000 7f0dba5cc640 1 -- 172.21.15.53:0/1131831367 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0db415f860 msgr2=0x7f0db40ceb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:59:00.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:59:00.953+0000 7f0dba5cc640 1 --2- 172.21.15.53:0/1131831367 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0db415f860 0x7f0db40ceb20 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f0db40cdad0 tx=0x7f0dac01c880 comp rx=0 tx=0).stop 2023-06-10T18:59:00.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:59:00.953+0000 7f0dba5cc640 1 -- 172.21.15.53:0/1131831367 shutdown_connections 2023-06-10T18:59:00.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:59:00.953+0000 7f0dba5cc640 1 --2- 172.21.15.53:0/1131831367 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0db415f860 0x7f0db40ceb20 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:59:00.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:59:00.953+0000 7f0dba5cc640 1 --2- 172.21.15.53:0/1131831367 >> v2:172.21.15.117:3300/0 conn(0x7f0db415c7f0 0x7f0db415f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:59:00.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:59:00.953+0000 7f0dba5cc640 1 -- 172.21.15.53:0/1131831367 >> 172.21.15.53:0/1131831367 conn(0x7f0db406a090 msgr2=0x7f0db406d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:59:00.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:59:00.953+0000 7f0dba5cc640 1 -- 172.21.15.53:0/1131831367 shutdown_connections 2023-06-10T18:59:00.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:59:00.953+0000 7f0dba5cc640 1 -- 172.21.15.53:0/1131831367 wait complete. 2023-06-10T18:59:00.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:59:00.953+0000 7f0dba5cc640 1 Processor -- start 2023-06-10T18:59:00.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:59:00.953+0000 7f0dba5cc640 1 -- start start 2023-06-10T18:59:00.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:59:00.953+0000 7f0dba5cc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0db406b780 0x7f0db4152af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:59:00.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:59:00.953+0000 7f0dba5cc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0db415c7f0 0x7f0db415e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:59:00.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:59:00.953+0000 7f0dba5cc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0db415f860 0x7f0db415e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:59:00.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:59:00.953+0000 7f0dba5cc640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db4153030 con 0x7f0db415f860 2023-06-10T18:59:00.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:59:00.953+0000 7f0dba5cc640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db41412c0 con 0x7f0db406b780 2023-06-10T18:59:00.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:59:00.953+0000 7f0dba5cc640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0db41415a0 con 0x7f0db415c7f0 2023-06-10T18:59:00.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:59:00.953+0000 7f0db8b69640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0db415f860 0x7f0db415e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:59:00.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:59:00.953+0000 7f0db8b69640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0db415f860 0x7f0db415e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48934/0 (socket says 172.21.15.53:48934) 2023-06-10T18:59:00.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:59:00.953+0000 7f0db8b69640 1 -- 172.21.15.53:0/31626682 learned_addr learned my addr 172.21.15.53:0/31626682 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T18:59:00.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:59:00.953+0000 7f0db37fe640 1 --2- 172.21.15.53:0/31626682 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0db415c7f0 0x7f0db415e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:59:00.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:59:00.953+0000 7f0db3fff640 1 --2- 172.21.15.53:0/31626682 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0db406b780 0x7f0db4152af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:59:00.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:59:00.953+0000 7f0db8b69640 1 -- 172.21.15.53:0/31626682 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0db415c7f0 msgr2=0x7f0db415e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:59:00.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:59:00.953+0000 7f0db8b69640 1 --2- 172.21.15.53:0/31626682 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0db415c7f0 0x7f0db415e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:59:00.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:59:00.953+0000 7f0db8b69640 1 -- 172.21.15.53:0/31626682 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0db406b780 msgr2=0x7f0db4152af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:59:00.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:59:00.953+0000 7f0db8b69640 1 --2- 172.21.15.53:0/31626682 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0db406b780 0x7f0db4152af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:59:00.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:59:00.953+0000 7f0db8b69640 1 -- 172.21.15.53:0/31626682 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dac009a70 con 0x7f0db415f860 2023-06-10T18:59:00.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:59:00.957+0000 7f0db8b69640 1 --2- 172.21.15.53:0/31626682 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0db415f860 0x7f0db415e540 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f0dac019490 tx=0x7f0dac019620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:59:00.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:59:00.957+0000 7f0db0ff9640 1 -- 172.21.15.53:0/31626682 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dac0ade20 con 0x7f0db415f860 2023-06-10T18:59:00.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:59:00.957+0000 7f0db0ff9640 1 -- 172.21.15.53:0/31626682 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dac009450 con 0x7f0db415f860 2023-06-10T18:59:00.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:59:00.957+0000 7f0dba5cc640 1 -- 172.21.15.53:0/31626682 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0db4141880 con 0x7f0db415f860 2023-06-10T18:59:00.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:59:00.957+0000 7f0db0ff9640 1 -- 172.21.15.53:0/31626682 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dac0b7650 con 0x7f0db415f860 2023-06-10T18:59:00.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:59:00.957+0000 7f0dba5cc640 1 -- 172.21.15.53:0/31626682 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0db4141e40 con 0x7f0db415f860 2023-06-10T18:59:00.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:59:00.957+0000 7f0dba5cc640 1 -- 172.21.15.53:0/31626682 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0db4142030 con 0x7f0db415f860 2023-06-10T18:59:00.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:59:00.957+0000 7f0db0ff9640 1 -- 172.21.15.53:0/31626682 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0dac0b4050 con 0x7f0db415f860 2023-06-10T18:59:00.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:59:00.957+0000 7f0db0ff9640 1 --2- 172.21.15.53:0/31626682 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0da0066280 0x7f0da0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T18:59:00.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:59:00.957+0000 7f0db0ff9640 1 -- 172.21.15.53:0/31626682 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6178+0+0 (secure 0 0 0) 0x7f0dac11f060 con 0x7f0db415f860 2023-06-10T18:59:00.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:59:00.957+0000 7f0db3fff640 1 --2- 172.21.15.53:0/31626682 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0da0066280 0x7f0da0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T18:59:00.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:59:00.957+0000 7f0db3fff640 1 --2- 172.21.15.53:0/31626682 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0da0066280 0x7f0da0068730 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f0da4005890 tx=0x7f0da4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T18:59:00.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:59:00.961+0000 7f0db0ff9640 1 -- 172.21.15.53:0/31626682 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0dac0ec510 con 0x7f0db415f860 2023-06-10T18:59:01.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:59:01.145+0000 7f0dba5cc640 1 -- 172.21.15.53:0/31626682 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0db404d790 con 0x7f0db415f860 2023-06-10T18:59:01.150 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:59:01.145+0000 7f0db0ff9640 1 -- 172.21.15.53:0/31626682 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4669 (secure 0 0 0) 0x7f0dac0b2090 con 0x7f0db415f860 2023-06-10T18:59:01.151 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T18:59:01.151 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":26,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5444,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1300171732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":1300171732},{"type":"v1","addr":"172.21.15.117:6837","nonce":1300171732}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5818,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/507478314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":507478314},{"type":"v1","addr":"172.21.15.117:6836","nonce":507478314}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":6504,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/169051241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":169051241},{"type":"v1","addr":"172.21.15.53:6833","nonce":169051241}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T18:57:13.234809+0000","modified":"2023-06-10T18:57:15.250305+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6507},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6507":{"gid":6507,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/486797221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":486797221},{"type":"v1","addr":"172.21.15.53:6835","nonce":486797221}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-06-10T18:59:01.151 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 26 2023-06-10T18:59:01.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:59:01.149+0000 7f0dba5cc640 1 -- 172.21.15.53:0/31626682 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0da0066280 msgr2=0x7f0da0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:59:01.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:59:01.149+0000 7f0dba5cc640 1 --2- 172.21.15.53:0/31626682 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0da0066280 0x7f0da0068730 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f0da4005890 tx=0x7f0da4009040 comp rx=0 tx=0).stop 2023-06-10T18:59:01.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:59:01.149+0000 7f0dba5cc640 1 -- 172.21.15.53:0/31626682 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0db415f860 msgr2=0x7f0db415e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T18:59:01.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:59:01.149+0000 7f0dba5cc640 1 --2- 172.21.15.53:0/31626682 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0db415f860 0x7f0db415e540 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f0dac019490 tx=0x7f0dac019620 comp rx=0 tx=0).stop 2023-06-10T18:59:01.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:59:01.149+0000 7f0dba5cc640 1 -- 172.21.15.53:0/31626682 shutdown_connections 2023-06-10T18:59:01.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:59:01.149+0000 7f0dba5cc640 1 --2- 172.21.15.53:0/31626682 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0da0066280 0x7f0da0068730 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:59:01.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:59:01.149+0000 7f0dba5cc640 1 --2- 172.21.15.53:0/31626682 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0db415f860 0x7f0db415e540 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:59:01.154 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:59:01.149+0000 7f0dba5cc640 1 --2- 172.21.15.53:0/31626682 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0db415c7f0 0x7f0db415e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:59:01.154 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:59:01.149+0000 7f0dba5cc640 1 --2- 172.21.15.53:0/31626682 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0db406b780 0x7f0db4152af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T18:59:01.154 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:59:01.149+0000 7f0dba5cc640 1 -- 172.21.15.53:0/31626682 >> 172.21.15.53:0/31626682 conn(0x7f0db406a090 msgr2=0x7f0db40aeb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T18:59:01.154 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:59:01.149+0000 7f0dba5cc640 1 -- 172.21.15.53:0/31626682 shutdown_connections 2023-06-10T18:59:01.154 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T18:59:01.149+0000 7f0dba5cc640 1 -- 172.21.15.53:0/31626682 wait complete. 2023-06-10T18:59:01.170 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2023-06-10T18:59:01.295 INFO:teuthology.orchestra.run.smithi053.stdout:[{"id":5977,"entity":{"name":{"type":"client","num":5977},"addr":{"type":"any","addr":"192.168.0.1:0","nonce":914859131}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":0,"uptime":94.823127783999993,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":0.8032584962439463,"halflife":300},"cap_acquisition":{"value":0,"halflife":10},"last_trim_completed_requests_tid":1,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.5977 192.168.0.1:0/914859131","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x00000000000fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"219d315c3a0b2075e570fb1964be2ad33fe7a9c8","ceph_version":"ceph version 18.0.0-4359-g219d315c (219d315c3a0b2075e570fb1964be2ad33fe7a9c8) reef (dev)","entity_id":"1","hostname":"smithi117","mount_point":"/home/ubuntu/cephtest/mnt.1","pid":"44452","root":"/"}},{"id":6702,"entity":{"name":{"type":"client","num":6702},"addr":{"type":"any","addr":"192.168.0.1:0","nonce":683847329}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":0,"uptime":97.727100942999996,"requests_in_flight":0,"num_completed_requests":1,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":0.79788699135857066,"halflife":300},"cap_acquisition":{"value":0,"halflife":10},"last_trim_completed_requests_tid":2,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.6702 192.168.0.1:0/683847329","completed_requests":[{"tid":2,"created_ino":"0x0"}],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x00000000000fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"219d315c3a0b2075e570fb1964be2ad33fe7a9c8","ceph_version":"ceph version 18.0.0-4359-g219d315c (219d315c3a0b2075e570fb1964be2ad33fe7a9c8) reef (dev)","entity_id":"0","hostname":"smithi053","mount_point":"/home/ubuntu/cephtest/mnt.0","pid":"52485","root":"/","timeout":"120"}}] 2023-06-10T18:59:01.296 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 10, "value": 0 }, "client_metadata": { "ceph_sha1": "219d315c3a0b2075e570fb1964be2ad33fe7a9c8", "ceph_version": "ceph version 18.0.0-4359-g219d315c (219d315c3a0b2075e570fb1964be2ad33fe7a9c8) reef (dev)", "client_features": { "feature_bits": "0x00000000000fffff" }, "entity_id": "1", "hostname": "smithi117", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "mount_point": "/home/ubuntu/cephtest/mnt.1", "pid": "44452", "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 914859131, "type": "any" }, "name": { "num": 5977, "type": "client" } }, "id": 5977, "inst": "client.5977 192.168.0.1:0/914859131", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 1, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 0, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 0.8032584962439463 }, "state": "open", "uptime": 94.823127784 }, { "cap_acquisition": { "halflife": 10, "value": 0 }, "client_metadata": { "ceph_sha1": "219d315c3a0b2075e570fb1964be2ad33fe7a9c8", "ceph_version": "ceph version 18.0.0-4359-g219d315c (219d315c3a0b2075e570fb1964be2ad33fe7a9c8) reef (dev)", "client_features": { "feature_bits": "0x00000000000fffff" }, "entity_id": "0", "hostname": "smithi053", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "mount_point": "/home/ubuntu/cephtest/mnt.0", "pid": "52485", "root": "/", "timeout": "120" }, "completed_requests": [ { "created_ino": "0x0", "tid": 2 } ], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 683847329, "type": "any" }, "name": { "num": 6702, "type": "client" } }, "id": 6702, "inst": "client.6702 192.168.0.1:0/683847329", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 2, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 1, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 0, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 0.7978869913585707 }, "state": "open", "uptime": 97.727100943 } ] 2023-06-10T18:59:06.863 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-10T18:59:06.866 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-10T18:59:36.968 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-10T18:59:36.971 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-10T19:00:01.297 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:00:01.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.425+0000 7f9b1b2e5640 1 Processor -- start 2023-06-10T19:00:01.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.425+0000 7f9b1b2e5640 1 -- start start 2023-06-10T19:00:01.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.429+0000 7f9b1b2e5640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9b140c9750 0x7f9b140aced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:01.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.429+0000 7f9b1b2e5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b140cb870 0x7f9b140af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:01.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.429+0000 7f9b1b2e5640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b140ad410 con 0x7f9b140afc60 2023-06-10T19:00:01.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.429+0000 7f9b1b2e5640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b140cd990 con 0x7f9b140c9750 2023-06-10T19:00:01.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.429+0000 7f9b1b2e5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b140b00e0 con 0x7f9b140cb870 2023-06-10T19:00:01.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.429+0000 7f9b19882640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f9b140afc60 0x7f9b1415bec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:33486/0 (socket says 172.21.15.53:33486) 2023-06-10T19:00:01.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.429+0000 7f9b19882640 1 -- 172.21.15.53:0/2962518234 learned_addr learned my addr 172.21.15.53:0/2962518234 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:00:01.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.429+0000 7f9b19081640 1 --2- 172.21.15.53:0/2962518234 >> v2:172.21.15.117:3300/0 conn(0x7f9b140c9750 0x7f9b140aced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:01.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.429+0000 7f9b18880640 1 --2- 172.21.15.53:0/2962518234 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b140cb870 0x7f9b140af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:01.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.429+0000 7f9b0bfff640 1 -- 172.21.15.53:0/2962518234 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3799198368 0 0) 0x7f9b140ad410 con 0x7f9b140afc60 2023-06-10T19:00:01.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.429+0000 7f9b0bfff640 1 -- 172.21.15.53:0/2962518234 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b00003530 con 0x7f9b140afc60 2023-06-10T19:00:01.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.429+0000 7f9b0bfff640 1 -- 172.21.15.53:0/2962518234 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 894284381 0 0) 0x7f9b00003530 con 0x7f9b140afc60 2023-06-10T19:00:01.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.429+0000 7f9b0bfff640 1 -- 172.21.15.53:0/2962518234 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b140cb870 msgr2=0x7f9b140af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:01.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.429+0000 7f9b0bfff640 1 --2- 172.21.15.53:0/2962518234 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b140cb870 0x7f9b140af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:01.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.429+0000 7f9b0bfff640 1 -- 172.21.15.53:0/2962518234 >> v2:172.21.15.117:3300/0 conn(0x7f9b140c9750 msgr2=0x7f9b140aced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:01.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.429+0000 7f9b0bfff640 1 --2- 172.21.15.53:0/2962518234 >> v2:172.21.15.117:3300/0 conn(0x7f9b140c9750 0x7f9b140aced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:01.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.429+0000 7f9b0bfff640 1 -- 172.21.15.53:0/2962518234 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b141600d0 con 0x7f9b140afc60 2023-06-10T19:00:01.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.429+0000 7f9b0bfff640 1 -- 172.21.15.53:0/2962518234 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f9b0c001a00 con 0x7f9b140afc60 2023-06-10T19:00:01.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.429+0000 7f9b0bfff640 1 -- 172.21.15.53:0/2962518234 >> v1:172.21.15.53:6789/0 conn(0x7f9b140afc60 legacy=0x7f9b1415bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:01.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.429+0000 7f9b0bfff640 1 --2- 172.21.15.53:0/2962518234 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b000039f0 0x7f9b00003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:01.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.429+0000 7f9b0bfff640 1 --2- 172.21.15.53:0/2962518234 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b000047d0 0x7f9b00004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:01.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.429+0000 7f9b0bfff640 1 --2- 172.21.15.53:0/2962518234 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b140cb870 0x7f9b00005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:01.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.429+0000 7f9b0bfff640 1 -- 172.21.15.53:0/2962518234 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b140cd990 con 0x7f9b000039f0 2023-06-10T19:00:01.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.429+0000 7f9b0bfff640 1 -- 172.21.15.53:0/2962518234 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b140b00e0 con 0x7f9b000047d0 2023-06-10T19:00:01.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.429+0000 7f9b0bfff640 1 -- 172.21.15.53:0/2962518234 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b0000b990 con 0x7f9b140cb870 2023-06-10T19:00:01.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.429+0000 7f9b19081640 1 --2- 172.21.15.53:0/2962518234 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b000039f0 0x7f9b00003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:01.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.429+0000 7f9b18880640 1 --2- 172.21.15.53:0/2962518234 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b000047d0 0x7f9b00004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:01.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.429+0000 7f9b19081640 1 -- 172.21.15.53:0/2962518234 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b140cb870 msgr2=0x7f9b00005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:01.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.429+0000 7f9b19081640 1 --2- 172.21.15.53:0/2962518234 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b140cb870 0x7f9b00005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:01.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.429+0000 7f9b19081640 1 -- 172.21.15.53:0/2962518234 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b000047d0 msgr2=0x7f9b00004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:01.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.429+0000 7f9b19081640 1 --2- 172.21.15.53:0/2962518234 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b000047d0 0x7f9b00004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:01.445 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.429+0000 7f9b19081640 1 -- 172.21.15.53:0/2962518234 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b00003530 con 0x7f9b000039f0 2023-06-10T19:00:01.445 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.429+0000 7f9b18880640 1 --2- 172.21.15.53:0/2962518234 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b000047d0 0x7f9b00004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:00:01.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.433+0000 7f9b19081640 1 --2- 172.21.15.53:0/2962518234 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b000039f0 0x7f9b00003e00 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f9b10009ae0 tx=0x7f9b1001ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5962ab67d43d2659 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:01.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.433+0000 7f9b0bfff640 1 -- 172.21.15.53:0/2962518234 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b100a5540 con 0x7f9b000039f0 2023-06-10T19:00:01.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.433+0000 7f9b0bfff640 1 -- 172.21.15.53:0/2962518234 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b100a56a0 con 0x7f9b000039f0 2023-06-10T19:00:01.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.433+0000 7f9b0bfff640 1 -- 172.21.15.53:0/2962518234 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b100a5a50 con 0x7f9b000039f0 2023-06-10T19:00:01.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.433+0000 7f9b1b2e5640 1 -- 172.21.15.53:0/2962518234 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b000039f0 msgr2=0x7f9b00003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:01.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.433+0000 7f9b1b2e5640 1 --2- 172.21.15.53:0/2962518234 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b000039f0 0x7f9b00003e00 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f9b10009ae0 tx=0x7f9b1001ca60 comp rx=0 tx=0).stop 2023-06-10T19:00:01.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.433+0000 7f9b19882640 1 -- 172.21.15.53:0/2962518234 reap_dead start 2023-06-10T19:00:01.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.433+0000 7f9b1b2e5640 1 -- 172.21.15.53:0/2962518234 shutdown_connections 2023-06-10T19:00:01.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.433+0000 7f9b1b2e5640 1 -- 172.21.15.53:0/2962518234 >> 172.21.15.53:0/2962518234 conn(0x7f9b1406a0d0 msgr2=0x7f9b140ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:01.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.433+0000 7f9b1b2e5640 1 -- 172.21.15.53:0/2962518234 shutdown_connections 2023-06-10T19:00:01.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.433+0000 7f9b1b2e5640 1 -- 172.21.15.53:0/2962518234 wait complete. 2023-06-10T19:00:01.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.433+0000 7f9b1b2e5640 1 Processor -- start 2023-06-10T19:00:01.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.433+0000 7f9b1b2e5640 1 -- start start 2023-06-10T19:00:01.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.437+0000 7f9b1b2e5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b000039f0 0x7f9b14153e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:01.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.437+0000 7f9b1b2e5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b14156500 0x7f9b14156950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:01.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.437+0000 7f9b1b2e5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b1415d0d0 0x7f9b1415d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:01.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.437+0000 7f9b1b2e5640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1415dab0 con 0x7f9b1415d0d0 2023-06-10T19:00:01.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.437+0000 7f9b1b2e5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b14154380 con 0x7f9b000039f0 2023-06-10T19:00:01.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.437+0000 7f9b1b2e5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b141557b0 con 0x7f9b14156500 2023-06-10T19:00:01.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.437+0000 7f9b19882640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b1415d0d0 0x7f9b1415d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:01.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.437+0000 7f9b19882640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b1415d0d0 0x7f9b1415d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48732/0 (socket says 172.21.15.53:48732) 2023-06-10T19:00:01.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.437+0000 7f9b19882640 1 -- 172.21.15.53:0/340953270 learned_addr learned my addr 172.21.15.53:0/340953270 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:01.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.437+0000 7f9b19081640 1 --2- 172.21.15.53:0/340953270 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b000039f0 0x7f9b14153e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:01.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.437+0000 7f9b18880640 1 --2- 172.21.15.53:0/340953270 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b14156500 0x7f9b14156950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:01.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.437+0000 7f9b19882640 1 -- 172.21.15.53:0/340953270 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b14156500 msgr2=0x7f9b14156950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:01.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.437+0000 7f9b19882640 1 --2- 172.21.15.53:0/340953270 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b14156500 0x7f9b14156950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:01.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.437+0000 7f9b19882640 1 -- 172.21.15.53:0/340953270 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b000039f0 msgr2=0x7f9b14153e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:01.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.437+0000 7f9b19882640 1 --2- 172.21.15.53:0/340953270 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b000039f0 0x7f9b14153e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:01.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.437+0000 7f9b19882640 1 -- 172.21.15.53:0/340953270 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b14155a90 con 0x7f9b1415d0d0 2023-06-10T19:00:01.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.437+0000 7f9b18880640 1 --2- 172.21.15.53:0/340953270 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b14156500 0x7f9b14156950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:00:01.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.437+0000 7f9b19882640 1 --2- 172.21.15.53:0/340953270 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b1415d0d0 0x7f9b1415d570 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f9b140c8280 tx=0x7f9b0c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:01.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.437+0000 7f9b09ffb640 1 -- 172.21.15.53:0/340953270 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b0c004d70 con 0x7f9b1415d0d0 2023-06-10T19:00:01.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.437+0000 7f9b09ffb640 1 -- 172.21.15.53:0/340953270 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b0c00cea0 con 0x7f9b1415d0d0 2023-06-10T19:00:01.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.437+0000 7f9b1b2e5640 1 -- 172.21.15.53:0/340953270 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b14155d70 con 0x7f9b1415d0d0 2023-06-10T19:00:01.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.437+0000 7f9b09ffb640 1 -- 172.21.15.53:0/340953270 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b0c0072b0 con 0x7f9b1415d0d0 2023-06-10T19:00:01.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.437+0000 7f9b1b2e5640 1 -- 172.21.15.53:0/340953270 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b14156050 con 0x7f9b1415d0d0 2023-06-10T19:00:01.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.437+0000 7f9b1b2e5640 1 -- 172.21.15.53:0/340953270 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b1404d790 con 0x7f9b1415d0d0 2023-06-10T19:00:01.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.437+0000 7f9b09ffb640 1 -- 172.21.15.53:0/340953270 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9b0c007410 con 0x7f9b1415d0d0 2023-06-10T19:00:01.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.437+0000 7f9b09ffb640 1 --2- 172.21.15.53:0/340953270 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9af80662b0 0x7f9af8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:01.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.441+0000 7f9b09ffb640 1 -- 172.21.15.53:0/340953270 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6221+0+0 (secure 0 0 0) 0x7f9b0c082c30 con 0x7f9b1415d0d0 2023-06-10T19:00:01.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.441+0000 7f9b19081640 1 --2- 172.21.15.53:0/340953270 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9af80662b0 0x7f9af8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:01.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.441+0000 7f9b19081640 1 --2- 172.21.15.53:0/340953270 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9af80662b0 0x7f9af8068760 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f9b100af000 tx=0x7f9b100046d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:01.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.445+0000 7f9b09ffb640 1 -- 172.21.15.53:0/340953270 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9b0c0500c0 con 0x7f9b1415d0d0 2023-06-10T19:00:01.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.629+0000 7f9b1b2e5640 1 -- 172.21.15.53:0/340953270 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9b1406f130 con 0x7f9b1415d0d0 2023-06-10T19:00:01.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.629+0000 7f9b09ffb640 1 -- 172.21.15.53:0/340953270 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4669 (secure 0 0 0) 0x7f9b0c019020 con 0x7f9b1415d0d0 2023-06-10T19:00:01.634 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:00:01.634 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":26,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5444,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1300171732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":1300171732},{"type":"v1","addr":"172.21.15.117:6837","nonce":1300171732}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5818,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/507478314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":507478314},{"type":"v1","addr":"172.21.15.117:6836","nonce":507478314}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":6504,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/169051241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":169051241},{"type":"v1","addr":"172.21.15.53:6833","nonce":169051241}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T18:57:13.234809+0000","modified":"2023-06-10T18:57:15.250305+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6507},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6507":{"gid":6507,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/486797221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":486797221},{"type":"v1","addr":"172.21.15.53:6835","nonce":486797221}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-06-10T19:00:01.635 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 26 2023-06-10T19:00:01.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.633+0000 7f9b1b2e5640 1 -- 172.21.15.53:0/340953270 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9af80662b0 msgr2=0x7f9af8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:01.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.633+0000 7f9b1b2e5640 1 --2- 172.21.15.53:0/340953270 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9af80662b0 0x7f9af8068760 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f9b100af000 tx=0x7f9b100046d0 comp rx=0 tx=0).stop 2023-06-10T19:00:01.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.633+0000 7f9b1b2e5640 1 -- 172.21.15.53:0/340953270 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b1415d0d0 msgr2=0x7f9b1415d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:01.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.633+0000 7f9b1b2e5640 1 --2- 172.21.15.53:0/340953270 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b1415d0d0 0x7f9b1415d570 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f9b140c8280 tx=0x7f9b0c00c830 comp rx=0 tx=0).stop 2023-06-10T19:00:01.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.633+0000 7f9b1b2e5640 1 -- 172.21.15.53:0/340953270 shutdown_connections 2023-06-10T19:00:01.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.633+0000 7f9b1b2e5640 1 --2- 172.21.15.53:0/340953270 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9af80662b0 0x7f9af8068760 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:01.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.633+0000 7f9b1b2e5640 1 --2- 172.21.15.53:0/340953270 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b1415d0d0 0x7f9b1415d570 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:01.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.633+0000 7f9b1b2e5640 1 --2- 172.21.15.53:0/340953270 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b14156500 0x7f9b14156950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:01.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.633+0000 7f9b1b2e5640 1 --2- 172.21.15.53:0/340953270 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b000039f0 0x7f9b14153e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:01.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.633+0000 7f9b1b2e5640 1 -- 172.21.15.53:0/340953270 >> 172.21.15.53:0/340953270 conn(0x7f9b1406a0d0 msgr2=0x7f9b14159ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:01.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.633+0000 7f9b1b2e5640 1 -- 172.21.15.53:0/340953270 shutdown_connections 2023-06-10T19:00:01.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.633+0000 7f9b1b2e5640 1 -- 172.21.15.53:0/340953270 wait complete. 2023-06-10T19:00:01.652 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2023-06-10T19:00:01.790 INFO:teuthology.orchestra.run.smithi053.stdout:[{"id":5977,"entity":{"name":{"type":"client","num":5977},"addr":{"type":"any","addr":"192.168.0.1:0","nonce":914859131}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":0,"uptime":155.31457487700001,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":0.69848356908148301,"halflife":300},"cap_acquisition":{"value":0,"halflife":10},"last_trim_completed_requests_tid":1,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.5977 192.168.0.1:0/914859131","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x00000000000fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"219d315c3a0b2075e570fb1964be2ad33fe7a9c8","ceph_version":"ceph version 18.0.0-4359-g219d315c (219d315c3a0b2075e570fb1964be2ad33fe7a9c8) reef (dev)","entity_id":"1","hostname":"smithi117","mount_point":"/home/ubuntu/cephtest/mnt.1","pid":"44452","root":"/"}}] 2023-06-10T19:00:01.790 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 10, "value": 0 }, "client_metadata": { "ceph_sha1": "219d315c3a0b2075e570fb1964be2ad33fe7a9c8", "ceph_version": "ceph version 18.0.0-4359-g219d315c (219d315c3a0b2075e570fb1964be2ad33fe7a9c8) reef (dev)", "client_features": { "feature_bits": "0x00000000000fffff" }, "entity_id": "1", "hostname": "smithi117", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "mount_point": "/home/ubuntu/cephtest/mnt.1", "pid": "44452", "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 914859131, "type": "any" }, "name": { "num": 5977, "type": "client" } }, "id": 5977, "inst": "client.5977 192.168.0.1:0/914859131", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 1, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 0, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 0.698483569081483 }, "state": "open", "uptime": 155.314574877 } ] 2023-06-10T19:00:01.791 INFO:tasks.cephfs.mount:Cleaning up killed connection on ubuntu@smithi053.front.sepia.ceph.com 2023-06-10T19:00:01.791 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T19:00:01.792 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:00:01.797 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:00:01.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.965+0000 7ffaf248e640 1 Processor -- start 2023-06-10T19:00:01.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.965+0000 7ffaf248e640 1 -- start start 2023-06-10T19:00:01.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.965+0000 7ffaf248e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ffaec0afe30 0x7ffaec06efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:01.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.965+0000 7ffaf248e640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaec0c9e50 con 0x7ffaec157e10 2023-06-10T19:00:01.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.965+0000 7ffaf248e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaec0c82f0 con 0x7ffaec06bb30 2023-06-10T19:00:01.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.965+0000 7ffaf248e640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaec06bf00 con 0x7ffaec0afe30 2023-06-10T19:00:01.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.965+0000 7ffaeb7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ffaec0afe30 0x7ffaec06efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:01.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.965+0000 7ffaebfff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ffaec157e10 0x7ffaec0af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:33490/0 (socket says 172.21.15.53:33490) 2023-06-10T19:00:01.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.965+0000 7ffaeb7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ffaec0afe30 0x7ffaec06efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48744/0 (socket says 172.21.15.53:48744) 2023-06-10T19:00:01.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.965+0000 7ffaebfff640 1 -- 172.21.15.53:0/1610946093 learned_addr learned my addr 172.21.15.53:0/1610946093 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:00:01.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.965+0000 7ffaeb7fe640 1 -- 172.21.15.53:0/1610946093 >> v1:172.21.15.117:6789/0 conn(0x7ffaec06bb30 legacy=0x7ffaec15bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:01.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.965+0000 7ffaeb7fe640 1 -- 172.21.15.53:0/1610946093 >> v1:172.21.15.53:6789/0 conn(0x7ffaec157e10 legacy=0x7ffaec0af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:01.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.965+0000 7ffaeb7fe640 1 -- 172.21.15.53:0/1610946093 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaec0ca080 con 0x7ffaec0afe30 2023-06-10T19:00:01.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.969+0000 7ffaeb7fe640 1 --2- 172.21.15.53:0/1610946093 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffaec0afe30 0x7ffaec06efc0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7ffae00097c0 tx=0x7ffae001c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdb1a838be73a1d7 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:01.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.969+0000 7ffaeaffd640 1 -- 172.21.15.53:0/1610946093 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae00ad680 con 0x7ffaec0afe30 2023-06-10T19:00:01.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.969+0000 7ffaeaffd640 1 -- 172.21.15.53:0/1610946093 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffae00ad7e0 con 0x7ffaec0afe30 2023-06-10T19:00:01.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.969+0000 7ffaeaffd640 1 -- 172.21.15.53:0/1610946093 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae00adb70 con 0x7ffaec0afe30 2023-06-10T19:00:01.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.969+0000 7ffaf248e640 1 -- 172.21.15.53:0/1610946093 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffaec0afe30 msgr2=0x7ffaec06efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:01.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.969+0000 7ffaf248e640 1 --2- 172.21.15.53:0/1610946093 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffaec0afe30 0x7ffaec06efc0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7ffae00097c0 tx=0x7ffae001c380 comp rx=0 tx=0).stop 2023-06-10T19:00:01.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.969+0000 7ffaf248e640 1 -- 172.21.15.53:0/1610946093 shutdown_connections 2023-06-10T19:00:01.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.969+0000 7ffaf248e640 1 --2- 172.21.15.53:0/1610946093 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffaec0afe30 0x7ffaec06efc0 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:01.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.969+0000 7ffaf248e640 1 -- 172.21.15.53:0/1610946093 >> 172.21.15.53:0/1610946093 conn(0x7ffaec06a0d0 msgr2=0x7ffaec0ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:01.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.969+0000 7ffaf248e640 1 -- 172.21.15.53:0/1610946093 shutdown_connections 2023-06-10T19:00:01.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.969+0000 7ffaf248e640 1 -- 172.21.15.53:0/1610946093 wait complete. 2023-06-10T19:00:01.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.969+0000 7ffaf248e640 1 Processor -- start 2023-06-10T19:00:01.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.969+0000 7ffaf248e640 1 -- start start 2023-06-10T19:00:01.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.973+0000 7ffaf248e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffaec06bb30 0x7ffaec153bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:01.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.973+0000 7ffaf248e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffaec0afe30 0x7ffaec0b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:01.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.973+0000 7ffaf248e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffaec157e10 0x7ffaec14ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:01.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.973+0000 7ffaf248e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaec152180 con 0x7ffaec157e10 2023-06-10T19:00:01.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.973+0000 7ffaf248e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaec06f590 con 0x7ffaec06bb30 2023-06-10T19:00:01.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.973+0000 7ffaf248e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaec1541b0 con 0x7ffaec0afe30 2023-06-10T19:00:01.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.973+0000 7ffaf0a2b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffaec157e10 0x7ffaec14ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:01.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.973+0000 7ffaf0a2b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffaec157e10 0x7ffaec14ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48756/0 (socket says 172.21.15.53:48756) 2023-06-10T19:00:01.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.973+0000 7ffaf0a2b640 1 -- 172.21.15.53:0/132328924 learned_addr learned my addr 172.21.15.53:0/132328924 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:01.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.973+0000 7ffaebfff640 1 --2- 172.21.15.53:0/132328924 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffaec06bb30 0x7ffaec153bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:01.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.973+0000 7ffaeb7fe640 1 --2- 172.21.15.53:0/132328924 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffaec0afe30 0x7ffaec0b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:01.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.973+0000 7ffaf0a2b640 1 -- 172.21.15.53:0/132328924 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffaec0afe30 msgr2=0x7ffaec0b3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:01.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.973+0000 7ffaf0a2b640 1 --2- 172.21.15.53:0/132328924 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffaec0afe30 0x7ffaec0b3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:01.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.973+0000 7ffaf0a2b640 1 -- 172.21.15.53:0/132328924 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffaec06bb30 msgr2=0x7ffaec153bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:01.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.973+0000 7ffaf0a2b640 1 --2- 172.21.15.53:0/132328924 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffaec06bb30 0x7ffaec153bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:01.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.973+0000 7ffaf0a2b640 1 -- 172.21.15.53:0/132328924 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffae0009420 con 0x7ffaec157e10 2023-06-10T19:00:01.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.973+0000 7ffaf0a2b640 1 --2- 172.21.15.53:0/132328924 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffaec157e10 0x7ffaec14ecb0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7ffae400ea20 tx=0x7ffae400eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:01.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.973+0000 7ffae8ff9640 1 -- 172.21.15.53:0/132328924 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae4004760 con 0x7ffaec157e10 2023-06-10T19:00:01.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.973+0000 7ffae8ff9640 1 -- 172.21.15.53:0/132328924 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffae4011470 con 0x7ffaec157e10 2023-06-10T19:00:01.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.973+0000 7ffaf248e640 1 -- 172.21.15.53:0/132328924 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaec06f850 con 0x7ffaec157e10 2023-06-10T19:00:01.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.973+0000 7ffae8ff9640 1 -- 172.21.15.53:0/132328924 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae4011860 con 0x7ffaec157e10 2023-06-10T19:00:01.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.973+0000 7ffaf248e640 1 -- 172.21.15.53:0/132328924 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaec06fe10 con 0x7ffaec157e10 2023-06-10T19:00:01.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.973+0000 7ffaf248e640 1 -- 172.21.15.53:0/132328924 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaec04d790 con 0x7ffaec157e10 2023-06-10T19:00:01.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.977+0000 7ffae8ff9640 1 -- 172.21.15.53:0/132328924 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ffae40119c0 con 0x7ffaec157e10 2023-06-10T19:00:01.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.977+0000 7ffae8ff9640 1 --2- 172.21.15.53:0/132328924 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ffad8066280 0x7ffad8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:01.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.977+0000 7ffae8ff9640 1 -- 172.21.15.53:0/132328924 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6221+0+0 (secure 0 0 0) 0x7ffae40868e0 con 0x7ffaec157e10 2023-06-10T19:00:01.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.977+0000 7ffaebfff640 1 --2- 172.21.15.53:0/132328924 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ffad8066280 0x7ffad8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:01.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.977+0000 7ffaebfff640 1 --2- 172.21.15.53:0/132328924 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ffad8066280 0x7ffad8068730 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7ffadc005890 tx=0x7ffadc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:01.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:01.977+0000 7ffae8ff9640 1 -- 172.21.15.53:0/132328924 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ffae40578c0 con 0x7ffaec157e10 2023-06-10T19:00:02.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.137+0000 7ffaf248e640 1 -- 172.21.15.53:0/132328924 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffaec0b3c20 con 0x7ffaec157e10 2023-06-10T19:00:02.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.137+0000 7ffae8ff9640 1 -- 172.21.15.53:0/132328924 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) v1 ==== 74+0+18533 (secure 0 0 0) 0x7ffae4057450 con 0x7ffaec157e10 2023-06-10T19:00:02.144 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:00:02.144 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":68,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T18:59:28.908909+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-06-10T18:57:11.323255+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-06-10T18:57:12.231973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.13","mappings":[{"from":7,"to":2}]},{"pgid":"10.10","mappings":[{"from":4,"to":3}]},{"pgid":"10.21","mappings":[{"from":4,"to":3}]},{"pgid":"10.25","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.0.1:0/683847329":"2023-06-10T19:59:28.260070+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:00:02.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.141+0000 7ffaf248e640 1 -- 172.21.15.53:0/132328924 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ffad8066280 msgr2=0x7ffad8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:02.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.141+0000 7ffaf248e640 1 --2- 172.21.15.53:0/132328924 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ffad8066280 0x7ffad8068730 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7ffadc005890 tx=0x7ffadc009040 comp rx=0 tx=0).stop 2023-06-10T19:00:02.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.141+0000 7ffaf248e640 1 -- 172.21.15.53:0/132328924 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffaec157e10 msgr2=0x7ffaec14ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:02.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.141+0000 7ffaf248e640 1 --2- 172.21.15.53:0/132328924 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffaec157e10 0x7ffaec14ecb0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7ffae400ea20 tx=0x7ffae400eee0 comp rx=0 tx=0).stop 2023-06-10T19:00:02.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.141+0000 7ffaf248e640 1 -- 172.21.15.53:0/132328924 shutdown_connections 2023-06-10T19:00:02.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.141+0000 7ffaf248e640 1 --2- 172.21.15.53:0/132328924 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ffad8066280 0x7ffad8068730 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:02.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.141+0000 7ffaf248e640 1 --2- 172.21.15.53:0/132328924 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffaec157e10 0x7ffaec14ecb0 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:02.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.141+0000 7ffaf248e640 1 --2- 172.21.15.53:0/132328924 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffaec0afe30 0x7ffaec0b3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:02.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.141+0000 7ffaf248e640 1 --2- 172.21.15.53:0/132328924 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffaec06bb30 0x7ffaec153bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:02.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.141+0000 7ffaf248e640 1 -- 172.21.15.53:0/132328924 >> 172.21.15.53:0/132328924 conn(0x7ffaec06a0d0 msgr2=0x7ffaec15bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:02.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.141+0000 7ffaf248e640 1 -- 172.21.15.53:0/132328924 shutdown_connections 2023-06-10T19:00:02.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.141+0000 7ffaf248e640 1 -- 172.21.15.53:0/132328924 wait complete. 2023-06-10T19:00:02.163 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-10T18:52:33.633114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-10T18:52:39.171487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-10T18:57:11.323255+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '64', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2023-06-10T18:57:12.231973+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '65', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-10T19:00:02.164 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-10T19:00:02.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.289+0000 7fc018ceb640 1 Processor -- start 2023-06-10T19:00:02.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.289+0000 7fc018ceb640 1 -- start start 2023-06-10T19:00:02.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.289+0000 7fc018ceb640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc01415c090 0x7fc0140b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:02.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.289+0000 7fc018ceb640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0140cc7c0 con 0x7fc0140b0b90 2023-06-10T19:00:02.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.289+0000 7fc018ceb640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0140ccaa0 con 0x7fc0140b7e30 2023-06-10T19:00:02.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.289+0000 7fc018ceb640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0140ccd80 con 0x7fc01415c090 2023-06-10T19:00:02.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.289+0000 7fc011d9b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fc0140b0b90 0x7fc0140b7720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:33504/0 (socket says 172.21.15.53:33504) 2023-06-10T19:00:02.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.289+0000 7fc011d9b640 1 -- 172.21.15.53:0/3101631718 learned_addr learned my addr 172.21.15.53:0/3101631718 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:00:02.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.289+0000 7fc01259c640 1 --2- 172.21.15.53:0/3101631718 >> v2:172.21.15.117:3300/0 conn(0x7fc01415c090 0x7fc0140b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:02.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.289+0000 7fc01159a640 1 -- 172.21.15.53:0/3101631718 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3299579232 0 0) 0x7fc0140cc7c0 con 0x7fc0140b0b90 2023-06-10T19:00:02.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.289+0000 7fc01159a640 1 -- 172.21.15.53:0/3101631718 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc000003530 con 0x7fc0140b0b90 2023-06-10T19:00:02.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.289+0000 7fc01159a640 1 -- 172.21.15.53:0/3101631718 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1641875303 0 0) 0x7fc000003530 con 0x7fc0140b0b90 2023-06-10T19:00:02.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.289+0000 7fc01159a640 1 -- 172.21.15.53:0/3101631718 >> v2:172.21.15.117:3300/0 conn(0x7fc01415c090 msgr2=0x7fc0140b10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:02.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.289+0000 7fc01159a640 1 --2- 172.21.15.53:0/3101631718 >> v2:172.21.15.117:3300/0 conn(0x7fc01415c090 0x7fc0140b10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:02.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.289+0000 7fc01159a640 1 -- 172.21.15.53:0/3101631718 >> v1:172.21.15.117:6789/0 conn(0x7fc0140b7e30 legacy=0x7fc0140d04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:02.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.289+0000 7fc01159a640 1 -- 172.21.15.53:0/3101631718 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0140cd060 con 0x7fc0140b0b90 2023-06-10T19:00:02.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.289+0000 7fc01159a640 1 -- 172.21.15.53:0/3101631718 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fbffc0016a0 con 0x7fc0140b0b90 2023-06-10T19:00:02.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.289+0000 7fc01159a640 1 -- 172.21.15.53:0/3101631718 >> v1:172.21.15.53:6789/0 conn(0x7fc0140b0b90 legacy=0x7fc0140b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:02.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.289+0000 7fc01159a640 1 --2- 172.21.15.53:0/3101631718 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc000003980 0x7fc000003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:02.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.289+0000 7fc01159a640 1 --2- 172.21.15.53:0/3101631718 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0000047d0 0x7fc000004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:02.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.289+0000 7fc01159a640 1 --2- 172.21.15.53:0/3101631718 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc000005180 0x7fc00000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:02.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.289+0000 7fc01159a640 1 -- 172.21.15.53:0/3101631718 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0140ccd80 con 0x7fc0000047d0 2023-06-10T19:00:02.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.289+0000 7fc01159a640 1 -- 172.21.15.53:0/3101631718 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc00000c090 con 0x7fc000005180 2023-06-10T19:00:02.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.289+0000 7fc01159a640 1 -- 172.21.15.53:0/3101631718 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc00000c250 con 0x7fc000003980 2023-06-10T19:00:02.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.289+0000 7fc011d9b640 1 --2- 172.21.15.53:0/3101631718 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0000047d0 0x7fc000004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:02.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.289+0000 7fc012d9d640 1 --2- 172.21.15.53:0/3101631718 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc000005180 0x7fc00000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:02.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.289+0000 7fc01259c640 1 --2- 172.21.15.53:0/3101631718 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc000003980 0x7fc000003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:02.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.289+0000 7fc011d9b640 1 -- 172.21.15.53:0/3101631718 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc000003980 msgr2=0x7fc000003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:02.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.289+0000 7fc011d9b640 1 --2- 172.21.15.53:0/3101631718 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc000003980 0x7fc000003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:02.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.289+0000 7fc011d9b640 1 -- 172.21.15.53:0/3101631718 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc000005180 msgr2=0x7fc00000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:02.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.289+0000 7fc011d9b640 1 --2- 172.21.15.53:0/3101631718 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc000005180 0x7fc00000b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:02.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.289+0000 7fc011d9b640 1 -- 172.21.15.53:0/3101631718 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc000003530 con 0x7fc0000047d0 2023-06-10T19:00:02.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.293+0000 7fc012d9d640 1 -- 172.21.15.53:0/3101631718 reap_dead start 2023-06-10T19:00:02.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.293+0000 7fc011d9b640 1 --2- 172.21.15.53:0/3101631718 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0000047d0 0x7fc000004c40 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fc0140b1010 tx=0x7fbffc01cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19c22a1a4dac173c server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:02.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.293+0000 7fc01159a640 1 -- 172.21.15.53:0/3101631718 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbffc005ae0 con 0x7fc0000047d0 2023-06-10T19:00:02.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.293+0000 7fc01159a640 1 -- 172.21.15.53:0/3101631718 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbffc005c40 con 0x7fc0000047d0 2023-06-10T19:00:02.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.293+0000 7fc01159a640 1 -- 172.21.15.53:0/3101631718 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbffc0a5a10 con 0x7fc0000047d0 2023-06-10T19:00:02.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.293+0000 7fc018ceb640 1 -- 172.21.15.53:0/3101631718 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0000047d0 msgr2=0x7fc000004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:02.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.293+0000 7fc018ceb640 1 --2- 172.21.15.53:0/3101631718 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0000047d0 0x7fc000004c40 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fc0140b1010 tx=0x7fbffc01cbb0 comp rx=0 tx=0).stop 2023-06-10T19:00:02.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.293+0000 7fc018ceb640 1 -- 172.21.15.53:0/3101631718 shutdown_connections 2023-06-10T19:00:02.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.293+0000 7fc018ceb640 1 --2- 172.21.15.53:0/3101631718 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0000047d0 0x7fc000004c40 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:02.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.293+0000 7fc018ceb640 1 -- 172.21.15.53:0/3101631718 >> 172.21.15.53:0/3101631718 conn(0x7fc014069e20 msgr2=0x7fc01406a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:02.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.293+0000 7fc018ceb640 1 -- 172.21.15.53:0/3101631718 shutdown_connections 2023-06-10T19:00:02.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.293+0000 7fc018ceb640 1 -- 172.21.15.53:0/3101631718 wait complete. 2023-06-10T19:00:02.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.297+0000 7fc018ceb640 1 Processor -- start 2023-06-10T19:00:02.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.297+0000 7fc018ceb640 1 -- start start 2023-06-10T19:00:02.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.297+0000 7fc018ceb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0000047d0 0x7fc014147be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:02.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.297+0000 7fc018ceb640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0140b4fd0 0x7fc0140c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:02.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.297+0000 7fc018ceb640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc01415eb60 0x7fc01415f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:02.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.297+0000 7fc018ceb640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0140c9ab0 con 0x7fc0000047d0 2023-06-10T19:00:02.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.297+0000 7fc018ceb640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc01415e150 con 0x7fc01415eb60 2023-06-10T19:00:02.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.297+0000 7fc018ceb640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc01415f540 con 0x7fc0140b4fd0 2023-06-10T19:00:02.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.297+0000 7fc01259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0000047d0 0x7fc014147be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:02.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.297+0000 7fc01259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0000047d0 0x7fc014147be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48768/0 (socket says 172.21.15.53:48768) 2023-06-10T19:00:02.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.297+0000 7fc01259c640 1 -- 172.21.15.53:0/1302840535 learned_addr learned my addr 172.21.15.53:0/1302840535 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:02.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.297+0000 7fc011d9b640 1 --2- 172.21.15.53:0/1302840535 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0140b4fd0 0x7fc0140c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:02.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.297+0000 7fc012d9d640 1 --2- 172.21.15.53:0/1302840535 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc01415eb60 0x7fc01415f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:02.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.297+0000 7fc01259c640 1 -- 172.21.15.53:0/1302840535 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0140b4fd0 msgr2=0x7fc0140c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:02.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.297+0000 7fc01259c640 1 --2- 172.21.15.53:0/1302840535 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0140b4fd0 0x7fc0140c5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:02.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.297+0000 7fc01259c640 1 -- 172.21.15.53:0/1302840535 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc01415eb60 msgr2=0x7fc01415f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:02.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.297+0000 7fc01259c640 1 --2- 172.21.15.53:0/1302840535 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc01415eb60 0x7fc01415f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:02.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.297+0000 7fc01259c640 1 -- 172.21.15.53:0/1302840535 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0140c94f0 con 0x7fc0000047d0 2023-06-10T19:00:02.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.297+0000 7fc011d9b640 1 --2- 172.21.15.53:0/1302840535 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0140b4fd0 0x7fc0140c5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:00:02.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.297+0000 7fc012d9d640 1 --2- 172.21.15.53:0/1302840535 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc01415eb60 0x7fc01415f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:00:02.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.297+0000 7fc01259c640 1 --2- 172.21.15.53:0/1302840535 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0000047d0 0x7fc014147be0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fc00c00f3d0 tx=0x7fc00c00f890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:02.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.297+0000 7fc00affd640 1 -- 172.21.15.53:0/1302840535 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc00c016620 con 0x7fc0000047d0 2023-06-10T19:00:02.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.297+0000 7fc00affd640 1 -- 172.21.15.53:0/1302840535 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc00c0167a0 con 0x7fc0000047d0 2023-06-10T19:00:02.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.297+0000 7fc018ceb640 1 -- 172.21.15.53:0/1302840535 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0140c97d0 con 0x7fc0000047d0 2023-06-10T19:00:02.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.297+0000 7fc00affd640 1 -- 172.21.15.53:0/1302840535 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc00c016b50 con 0x7fc0000047d0 2023-06-10T19:00:02.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.297+0000 7fc018ceb640 1 -- 172.21.15.53:0/1302840535 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc01415e640 con 0x7fc0000047d0 2023-06-10T19:00:02.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.297+0000 7fc018ceb640 1 -- 172.21.15.53:0/1302840535 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc01404d790 con 0x7fc0000047d0 2023-06-10T19:00:02.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.297+0000 7fc00affd640 1 -- 172.21.15.53:0/1302840535 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc00c016cb0 con 0x7fc0000047d0 2023-06-10T19:00:02.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.297+0000 7fc00affd640 1 --2- 172.21.15.53:0/1302840535 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbff40662b0 0x7fbff4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:02.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.297+0000 7fc00affd640 1 -- 172.21.15.53:0/1302840535 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6221+0+0 (secure 0 0 0) 0x7fc00c084e40 con 0x7fc0000047d0 2023-06-10T19:00:02.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.301+0000 7fc011d9b640 1 --2- 172.21.15.53:0/1302840535 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbff40662b0 0x7fbff4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:02.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.301+0000 7fc011d9b640 1 --2- 172.21.15.53:0/1302840535 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbff40662b0 0x7fbff4068760 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fbffc0ab000 tx=0x7fbffc0a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:02.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.301+0000 7fc00affd640 1 -- 172.21.15.53:0/1302840535 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc00c052180 con 0x7fc0000047d0 2023-06-10T19:00:02.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.457+0000 7fc018ceb640 1 -- 172.21.15.53:0/1302840535 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc0140b72f0 con 0x7fc0000047d0 2023-06-10T19:00:02.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.457+0000 7fc00affd640 1 -- 172.21.15.53:0/1302840535 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v68) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc00c0557a0 con 0x7fc0000047d0 2023-06-10T19:00:02.461 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-06-10T19:00:02.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.457+0000 7fc018ceb640 1 -- 172.21.15.53:0/1302840535 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbff40662b0 msgr2=0x7fbff4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:02.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.457+0000 7fc018ceb640 1 --2- 172.21.15.53:0/1302840535 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbff40662b0 0x7fbff4068760 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fbffc0ab000 tx=0x7fbffc0a7070 comp rx=0 tx=0).stop 2023-06-10T19:00:02.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.457+0000 7fc018ceb640 1 -- 172.21.15.53:0/1302840535 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0000047d0 msgr2=0x7fc014147be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:02.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.457+0000 7fc018ceb640 1 --2- 172.21.15.53:0/1302840535 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0000047d0 0x7fc014147be0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fc00c00f3d0 tx=0x7fc00c00f890 comp rx=0 tx=0).stop 2023-06-10T19:00:02.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.457+0000 7fc018ceb640 1 -- 172.21.15.53:0/1302840535 shutdown_connections 2023-06-10T19:00:02.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.457+0000 7fc018ceb640 1 --2- 172.21.15.53:0/1302840535 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbff40662b0 0x7fbff4068760 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:02.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.457+0000 7fc018ceb640 1 --2- 172.21.15.53:0/1302840535 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc01415eb60 0x7fc01415f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:02.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.457+0000 7fc018ceb640 1 --2- 172.21.15.53:0/1302840535 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0140b4fd0 0x7fc0140c5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:02.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.457+0000 7fc018ceb640 1 --2- 172.21.15.53:0/1302840535 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0000047d0 0x7fc014147be0 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:02.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.457+0000 7fc018ceb640 1 -- 172.21.15.53:0/1302840535 >> 172.21.15.53:0/1302840535 conn(0x7fc014069e20 msgr2=0x7fc0140b2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:02.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.457+0000 7fc018ceb640 1 -- 172.21.15.53:0/1302840535 shutdown_connections 2023-06-10T19:00:02.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.457+0000 7fc018ceb640 1 -- 172.21.15.53:0/1302840535 wait complete. 2023-06-10T19:00:02.480 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-10T19:00:02.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.597+0000 7f6eb1e08640 1 Processor -- start 2023-06-10T19:00:02.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.597+0000 7f6eb1e08640 1 -- start start 2023-06-10T19:00:02.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.601+0000 7f6eb1e08640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6eac070b80 0x7f6eac06b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:02.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.601+0000 7f6eb1e08640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6eac0706f0 con 0x7f6eac0af760 2023-06-10T19:00:02.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.601+0000 7f6eb1e08640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6eac15ab10 con 0x7f6eac0c9830 2023-06-10T19:00:02.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.601+0000 7f6eb1e08640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6eac0700e0 con 0x7f6eac070b80 2023-06-10T19:00:02.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.601+0000 7f6eab7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f6eac0af760 0x7f6eac0afb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:33512/0 (socket says 172.21.15.53:33512) 2023-06-10T19:00:02.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.601+0000 7f6eab7fe640 1 -- 172.21.15.53:0/812640995 learned_addr learned my addr 172.21.15.53:0/812640995 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:00:02.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.601+0000 7f6eabfff640 1 --2- 172.21.15.53:0/812640995 >> v2:172.21.15.117:3300/0 conn(0x7f6eac070b80 0x7f6eac06b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:02.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.601+0000 7f6eaa7fc640 1 -- 172.21.15.53:0/812640995 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1513148741 0 0) 0x7f6eac0706f0 con 0x7f6eac0af760 2023-06-10T19:00:02.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.601+0000 7f6eaa7fc640 1 -- 172.21.15.53:0/812640995 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e94003530 con 0x7f6eac0af760 2023-06-10T19:00:02.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.601+0000 7f6eaa7fc640 1 -- 172.21.15.53:0/812640995 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2881944058 0 0) 0x7f6e94003530 con 0x7f6eac0af760 2023-06-10T19:00:02.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.601+0000 7f6eaa7fc640 1 -- 172.21.15.53:0/812640995 >> v2:172.21.15.117:3300/0 conn(0x7f6eac070b80 msgr2=0x7f6eac06b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:02.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.601+0000 7f6eaa7fc640 1 --2- 172.21.15.53:0/812640995 >> v2:172.21.15.117:3300/0 conn(0x7f6eac070b80 0x7f6eac06b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:02.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.601+0000 7f6eaa7fc640 1 -- 172.21.15.53:0/812640995 >> v1:172.21.15.117:6789/0 conn(0x7f6eac0c9830 legacy=0x7f6eac15dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:02.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.601+0000 7f6eaa7fc640 1 -- 172.21.15.53:0/812640995 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eac0c9e10 con 0x7f6eac0af760 2023-06-10T19:00:02.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.601+0000 7f6eaa7fc640 1 -- 172.21.15.53:0/812640995 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f6e9c001680 con 0x7f6eac0af760 2023-06-10T19:00:02.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.601+0000 7f6eaa7fc640 1 -- 172.21.15.53:0/812640995 >> v1:172.21.15.53:6789/0 conn(0x7f6eac0af760 legacy=0x7f6eac0afb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:02.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.601+0000 7f6eaa7fc640 1 --2- 172.21.15.53:0/812640995 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6e94003980 0x7f6e94003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:02.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.601+0000 7f6eaa7fc640 1 --2- 172.21.15.53:0/812640995 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6e940047d0 0x7f6e94004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:02.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.601+0000 7f6eaa7fc640 1 --2- 172.21.15.53:0/812640995 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e94005180 0x7f6e9400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:02.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.601+0000 7f6eaa7fc640 1 -- 172.21.15.53:0/812640995 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eac0700e0 con 0x7f6e94005180 2023-06-10T19:00:02.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.601+0000 7f6eaa7fc640 1 -- 172.21.15.53:0/812640995 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9400c000 con 0x7f6e940047d0 2023-06-10T19:00:02.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.601+0000 7f6eaa7fc640 1 -- 172.21.15.53:0/812640995 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9400c1c0 con 0x7f6e94003980 2023-06-10T19:00:02.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.601+0000 7f6eabfff640 1 --2- 172.21.15.53:0/812640995 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e94005180 0x7f6e9400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:02.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.601+0000 7f6eaaffd640 1 --2- 172.21.15.53:0/812640995 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6e940047d0 0x7f6e94004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:02.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.601+0000 7f6eab7fe640 1 --2- 172.21.15.53:0/812640995 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6e94003980 0x7f6e94003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:02.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.601+0000 7f6eabfff640 1 -- 172.21.15.53:0/812640995 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6e94003980 msgr2=0x7f6e94003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:02.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.601+0000 7f6eabfff640 1 --2- 172.21.15.53:0/812640995 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6e94003980 0x7f6e94003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:02.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.601+0000 7f6eabfff640 1 -- 172.21.15.53:0/812640995 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6e940047d0 msgr2=0x7f6e94004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:02.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.601+0000 7f6eabfff640 1 --2- 172.21.15.53:0/812640995 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6e940047d0 0x7f6e94004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:02.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.601+0000 7f6eabfff640 1 -- 172.21.15.53:0/812640995 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e94003530 con 0x7f6e94005180 2023-06-10T19:00:02.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.601+0000 7f6eab7fe640 1 --2- 172.21.15.53:0/812640995 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6e94003980 0x7f6e94003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:00:02.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.601+0000 7f6eabfff640 1 -- 172.21.15.53:0/812640995 reap_dead start 2023-06-10T19:00:02.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.601+0000 7f6eabfff640 1 --2- 172.21.15.53:0/812640995 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e94005180 0x7f6e9400b990 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f6ea4009fc0 tx=0x7f6ea401cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd9275803e7a8ee2 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:02.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.605+0000 7f6eaa7fc640 1 -- 172.21.15.53:0/812640995 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea40a5cb0 con 0x7f6e94005180 2023-06-10T19:00:02.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.605+0000 7f6eaa7fc640 1 -- 172.21.15.53:0/812640995 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ea400f040 con 0x7f6e94005180 2023-06-10T19:00:02.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.605+0000 7f6eaa7fc640 1 -- 172.21.15.53:0/812640995 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea4003be0 con 0x7f6e94005180 2023-06-10T19:00:02.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.605+0000 7f6eb1e08640 1 -- 172.21.15.53:0/812640995 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e94005180 msgr2=0x7f6e9400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:02.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.605+0000 7f6eb1e08640 1 --2- 172.21.15.53:0/812640995 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e94005180 0x7f6e9400b990 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f6ea4009fc0 tx=0x7f6ea401cca0 comp rx=0 tx=0).stop 2023-06-10T19:00:02.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.605+0000 7f6eb1e08640 1 -- 172.21.15.53:0/812640995 shutdown_connections 2023-06-10T19:00:02.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.605+0000 7f6eb1e08640 1 --2- 172.21.15.53:0/812640995 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e94005180 0x7f6e9400b990 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:02.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.605+0000 7f6eb1e08640 1 -- 172.21.15.53:0/812640995 >> 172.21.15.53:0/812640995 conn(0x7f6eac06a0e0 msgr2=0x7f6eac0cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:02.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.605+0000 7f6eb1e08640 1 -- 172.21.15.53:0/812640995 shutdown_connections 2023-06-10T19:00:02.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.605+0000 7f6eb1e08640 1 -- 172.21.15.53:0/812640995 wait complete. 2023-06-10T19:00:02.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.605+0000 7f6eb1e08640 1 Processor -- start 2023-06-10T19:00:02.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.605+0000 7f6eb1e08640 1 -- start start 2023-06-10T19:00:02.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.605+0000 7f6eb1e08640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6e94005180 0x7f6eac14d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:02.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.605+0000 7f6eb1e08640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6eac0c4300 0x7f6eac0c1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:02.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.605+0000 7f6eb1e08640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6eac147520 0x7f6eac0ad740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:02.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.605+0000 7f6eb1e08640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eac0c1ca0 con 0x7f6eac147520 2023-06-10T19:00:02.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.605+0000 7f6eb1e08640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eac0c4750 con 0x7f6e94005180 2023-06-10T19:00:02.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.605+0000 7f6eb1e08640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eac0c1e90 con 0x7f6eac0c4300 2023-06-10T19:00:02.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.605+0000 7f6eabfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6eac147520 0x7f6eac0ad740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:02.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.605+0000 7f6eabfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6eac147520 0x7f6eac0ad740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48784/0 (socket says 172.21.15.53:48784) 2023-06-10T19:00:02.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.605+0000 7f6eabfff640 1 -- 172.21.15.53:0/1540654163 learned_addr learned my addr 172.21.15.53:0/1540654163 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:02.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.605+0000 7f6eab7fe640 1 --2- 172.21.15.53:0/1540654163 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6e94005180 0x7f6eac14d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:02.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.605+0000 7f6eaaffd640 1 --2- 172.21.15.53:0/1540654163 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6eac0c4300 0x7f6eac0c1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:02.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.605+0000 7f6eabfff640 1 -- 172.21.15.53:0/1540654163 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6eac0c4300 msgr2=0x7f6eac0c1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:02.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.605+0000 7f6eabfff640 1 --2- 172.21.15.53:0/1540654163 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6eac0c4300 0x7f6eac0c1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:02.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.605+0000 7f6eabfff640 1 -- 172.21.15.53:0/1540654163 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6e94005180 msgr2=0x7f6eac14d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:02.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.605+0000 7f6eabfff640 1 --2- 172.21.15.53:0/1540654163 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6e94005180 0x7f6eac14d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:02.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.605+0000 7f6eabfff640 1 -- 172.21.15.53:0/1540654163 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eac0c32c0 con 0x7f6eac147520 2023-06-10T19:00:02.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.605+0000 7f6eab7fe640 1 --2- 172.21.15.53:0/1540654163 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6e94005180 0x7f6eac14d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:00:02.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.605+0000 7f6eabfff640 1 --2- 172.21.15.53:0/1540654163 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6eac147520 0x7f6eac0ad740 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f6ea40987d0 tx=0x7f6ea4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:02.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.605+0000 7f6e93fff640 1 -- 172.21.15.53:0/1540654163 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea4003db0 con 0x7f6eac147520 2023-06-10T19:00:02.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.605+0000 7f6e93fff640 1 -- 172.21.15.53:0/1540654163 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ea4004030 con 0x7f6eac147520 2023-06-10T19:00:02.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.605+0000 7f6eb1e08640 1 -- 172.21.15.53:0/1540654163 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6eac147990 con 0x7f6eac147520 2023-06-10T19:00:02.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.605+0000 7f6e93fff640 1 -- 172.21.15.53:0/1540654163 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea40043e0 con 0x7f6eac147520 2023-06-10T19:00:02.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.605+0000 7f6eb1e08640 1 -- 172.21.15.53:0/1540654163 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6eac0c3820 con 0x7f6eac147520 2023-06-10T19:00:02.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.609+0000 7f6eb1e08640 1 -- 172.21.15.53:0/1540654163 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6eac04d790 con 0x7f6eac147520 2023-06-10T19:00:02.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.609+0000 7f6e93fff640 1 -- 172.21.15.53:0/1540654163 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6ea4004540 con 0x7f6eac147520 2023-06-10T19:00:02.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.609+0000 7f6e93fff640 1 --2- 172.21.15.53:0/1540654163 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6e980662b0 0x7f6e98068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:02.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.609+0000 7f6e93fff640 1 -- 172.21.15.53:0/1540654163 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6221+0+0 (secure 0 0 0) 0x7f6ea40a6e40 con 0x7f6eac147520 2023-06-10T19:00:02.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.609+0000 7f6eab7fe640 1 --2- 172.21.15.53:0/1540654163 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6e980662b0 0x7f6e98068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:02.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.609+0000 7f6eab7fe640 1 --2- 172.21.15.53:0/1540654163 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6e980662b0 0x7f6e98068760 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c0018f0 tx=0x7f6e9c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:02.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.613+0000 7f6e93fff640 1 -- 172.21.15.53:0/1540654163 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6ea40ebde0 con 0x7f6eac147520 2023-06-10T19:00:02.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.765+0000 7f6eb1e08640 1 -- 172.21.15.53:0/1540654163 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6eac154f30 con 0x7f6eac147520 2023-06-10T19:00:02.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.765+0000 7f6e93fff640 1 -- 172.21.15.53:0/1540654163 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v68) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6ea40bc0a0 con 0x7f6eac147520 2023-06-10T19:00:02.771 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-06-10T19:00:02.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.769+0000 7f6eb1e08640 1 -- 172.21.15.53:0/1540654163 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6e980662b0 msgr2=0x7f6e98068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:02.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.769+0000 7f6eb1e08640 1 --2- 172.21.15.53:0/1540654163 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6e980662b0 0x7f6e98068760 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c0018f0 tx=0x7f6e9c009040 comp rx=0 tx=0).stop 2023-06-10T19:00:02.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.769+0000 7f6eb1e08640 1 -- 172.21.15.53:0/1540654163 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6eac147520 msgr2=0x7f6eac0ad740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:02.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.769+0000 7f6eb1e08640 1 --2- 172.21.15.53:0/1540654163 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6eac147520 0x7f6eac0ad740 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f6ea40987d0 tx=0x7f6ea4009750 comp rx=0 tx=0).stop 2023-06-10T19:00:02.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.769+0000 7f6eb1e08640 1 -- 172.21.15.53:0/1540654163 shutdown_connections 2023-06-10T19:00:02.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.769+0000 7f6eb1e08640 1 --2- 172.21.15.53:0/1540654163 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6e980662b0 0x7f6e98068760 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:02.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.769+0000 7f6eb1e08640 1 --2- 172.21.15.53:0/1540654163 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6eac147520 0x7f6eac0ad740 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:02.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.769+0000 7f6eb1e08640 1 --2- 172.21.15.53:0/1540654163 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6eac0c4300 0x7f6eac0c1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:02.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.769+0000 7f6eb1e08640 1 --2- 172.21.15.53:0/1540654163 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6e94005180 0x7f6eac14d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:02.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.769+0000 7f6eb1e08640 1 -- 172.21.15.53:0/1540654163 >> 172.21.15.53:0/1540654163 conn(0x7f6eac06a0e0 msgr2=0x7f6eac0b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:02.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.769+0000 7f6eb1e08640 1 -- 172.21.15.53:0/1540654163 shutdown_connections 2023-06-10T19:00:02.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.769+0000 7f6eb1e08640 1 -- 172.21.15.53:0/1540654163 wait complete. 2023-06-10T19:00:02.789 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-10T19:00:02.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.913+0000 7fb1eb0e7640 1 Processor -- start 2023-06-10T19:00:02.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.913+0000 7fb1eb0e7640 1 -- start start 2023-06-10T19:00:02.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.913+0000 7fb1eb0e7640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb1e40c82a0 0x7fb1e40c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:02.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.913+0000 7fb1eb0e7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb1e40af760 0x7fb1e40afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:02.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.913+0000 7fb1eb0e7640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1e406b090 con 0x7fb1e40c9fa0 2023-06-10T19:00:02.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.913+0000 7fb1eb0e7640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1e40b0120 con 0x7fb1e40af760 2023-06-10T19:00:02.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.913+0000 7fb1eb0e7640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1e40ca370 con 0x7fb1e40c82a0 2023-06-10T19:00:02.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.913+0000 7fb1e9684640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb1e40af760 0x7fb1e40afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:02.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.913+0000 7fb1e8e83640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fb1e40c9fa0 0x7fb1e406bae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:33526/0 (socket says 172.21.15.53:33526) 2023-06-10T19:00:02.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.913+0000 7fb1e8e83640 1 -- 172.21.15.53:0/4084978231 learned_addr learned my addr 172.21.15.53:0/4084978231 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:00:02.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.913+0000 7fb1e3fff640 1 --2- 172.21.15.53:0/4084978231 >> v2:172.21.15.117:3300/0 conn(0x7fb1e40c82a0 0x7fb1e40c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:02.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.913+0000 7fb1e9684640 1 -- 172.21.15.53:0/4084978231 >> v2:172.21.15.117:3300/0 conn(0x7fb1e40c82a0 msgr2=0x7fb1e40c86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:02.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.913+0000 7fb1e9684640 1 --2- 172.21.15.53:0/4084978231 >> v2:172.21.15.117:3300/0 conn(0x7fb1e40c82a0 0x7fb1e40c86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:02.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.913+0000 7fb1e9684640 1 -- 172.21.15.53:0/4084978231 >> v1:172.21.15.53:6789/0 conn(0x7fb1e40c9fa0 legacy=0x7fb1e406bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:02.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.913+0000 7fb1e9684640 1 -- 172.21.15.53:0/4084978231 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e4070d50 con 0x7fb1e40af760 2023-06-10T19:00:02.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.917+0000 7fb1e9684640 1 --2- 172.21.15.53:0/4084978231 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb1e40af760 0x7fb1e40afbe0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fb1e406ecb0 tx=0x7fb1dc01c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69aec9127d6c4b7f server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:02.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.917+0000 7fb1e37fe640 1 -- 172.21.15.53:0/4084978231 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1dc0a5910 con 0x7fb1e40af760 2023-06-10T19:00:02.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.917+0000 7fb1e37fe640 1 -- 172.21.15.53:0/4084978231 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1dc0a5a70 con 0x7fb1e40af760 2023-06-10T19:00:02.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.917+0000 7fb1e37fe640 1 -- 172.21.15.53:0/4084978231 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1dc0a5e00 con 0x7fb1e40af760 2023-06-10T19:00:02.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.917+0000 7fb1eb0e7640 1 -- 172.21.15.53:0/4084978231 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb1e40af760 msgr2=0x7fb1e40afbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:02.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.917+0000 7fb1eb0e7640 1 --2- 172.21.15.53:0/4084978231 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb1e40af760 0x7fb1e40afbe0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fb1e406ecb0 tx=0x7fb1dc01c850 comp rx=0 tx=0).stop 2023-06-10T19:00:02.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.917+0000 7fb1eb0e7640 1 -- 172.21.15.53:0/4084978231 shutdown_connections 2023-06-10T19:00:02.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.917+0000 7fb1eb0e7640 1 --2- 172.21.15.53:0/4084978231 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb1e40af760 0x7fb1e40afbe0 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:02.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.917+0000 7fb1eb0e7640 1 --2- 172.21.15.53:0/4084978231 >> v2:172.21.15.117:3300/0 conn(0x7fb1e40c82a0 0x7fb1e40c86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:02.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.917+0000 7fb1eb0e7640 1 -- 172.21.15.53:0/4084978231 >> 172.21.15.53:0/4084978231 conn(0x7fb1e406a0e0 msgr2=0x7fb1e40cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:02.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.917+0000 7fb1eb0e7640 1 -- 172.21.15.53:0/4084978231 shutdown_connections 2023-06-10T19:00:02.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.917+0000 7fb1eb0e7640 1 -- 172.21.15.53:0/4084978231 wait complete. 2023-06-10T19:00:02.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.917+0000 7fb1eb0e7640 1 Processor -- start 2023-06-10T19:00:02.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.917+0000 7fb1eb0e7640 1 -- start start 2023-06-10T19:00:02.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.917+0000 7fb1eb0e7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb1e40af760 0x7fb1e4153070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:02.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.917+0000 7fb1eb0e7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1e40c82a0 0x7fb1e40c3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:02.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.917+0000 7fb1eb0e7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb1e40c9fa0 0x7fb1e40a9630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:02.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.917+0000 7fb1eb0e7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e40a8930 con 0x7fb1e40c9fa0 2023-06-10T19:00:02.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.917+0000 7fb1eb0e7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e40aa540 con 0x7fb1e40c82a0 2023-06-10T19:00:02.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.917+0000 7fb1eb0e7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e41535b0 con 0x7fb1e40af760 2023-06-10T19:00:02.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.917+0000 7fb1e9684640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb1e40c9fa0 0x7fb1e40a9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:02.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.921+0000 7fb1e8e83640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb1e40af760 0x7fb1e4153070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:02.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.921+0000 7fb1e3fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1e40c82a0 0x7fb1e40c3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:02.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.921+0000 7fb1e9684640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb1e40c9fa0 0x7fb1e40a9630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48802/0 (socket says 172.21.15.53:48802) 2023-06-10T19:00:02.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.921+0000 7fb1e9684640 1 -- 172.21.15.53:0/177797325 learned_addr learned my addr 172.21.15.53:0/177797325 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:02.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.921+0000 7fb1e9684640 1 -- 172.21.15.53:0/177797325 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb1e40af760 msgr2=0x7fb1e4153070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:02.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.921+0000 7fb1e9684640 1 --2- 172.21.15.53:0/177797325 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb1e40af760 0x7fb1e4153070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:02.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.921+0000 7fb1e9684640 1 -- 172.21.15.53:0/177797325 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1e40c82a0 msgr2=0x7fb1e40c3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:02.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.921+0000 7fb1e9684640 1 --2- 172.21.15.53:0/177797325 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1e40c82a0 0x7fb1e40c3b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:02.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.921+0000 7fb1e9684640 1 -- 172.21.15.53:0/177797325 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1dc009a70 con 0x7fb1e40c9fa0 2023-06-10T19:00:02.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.921+0000 7fb1e9684640 1 --2- 172.21.15.53:0/177797325 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb1e40c9fa0 0x7fb1e40a9630 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc019460 tx=0x7fb1dc0195f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:02.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.921+0000 7fb1e17fa640 1 -- 172.21.15.53:0/177797325 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1dc0b9860 con 0x7fb1e40c9fa0 2023-06-10T19:00:02.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.921+0000 7fb1e17fa640 1 -- 172.21.15.53:0/177797325 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1dc0b99c0 con 0x7fb1e40c9fa0 2023-06-10T19:00:02.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.921+0000 7fb1e17fa640 1 -- 172.21.15.53:0/177797325 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1dc0b9d70 con 0x7fb1e40c9fa0 2023-06-10T19:00:02.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.921+0000 7fb1eb0e7640 1 -- 172.21.15.53:0/177797325 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1e40a8000 con 0x7fb1e40c9fa0 2023-06-10T19:00:02.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.921+0000 7fb1eb0e7640 1 -- 172.21.15.53:0/177797325 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1e40a85c0 con 0x7fb1e40c9fa0 2023-06-10T19:00:02.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.921+0000 7fb1eb0e7640 1 -- 172.21.15.53:0/177797325 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1e40a8aa0 con 0x7fb1e40c9fa0 2023-06-10T19:00:02.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.921+0000 7fb1e17fa640 1 -- 172.21.15.53:0/177797325 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb1dc0ad440 con 0x7fb1e40c9fa0 2023-06-10T19:00:02.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.921+0000 7fb1e17fa640 1 --2- 172.21.15.53:0/177797325 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb1d0066280 0x7fb1d0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:02.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.921+0000 7fb1e17fa640 1 -- 172.21.15.53:0/177797325 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6221+0+0 (secure 0 0 0) 0x7fb1dc11f180 con 0x7fb1e40c9fa0 2023-06-10T19:00:02.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.921+0000 7fb1e8e83640 1 --2- 172.21.15.53:0/177797325 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb1d0066280 0x7fb1d0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:02.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.921+0000 7fb1e8e83640 1 --2- 172.21.15.53:0/177797325 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb1d0066280 0x7fb1d0068730 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fb1d4005890 tx=0x7fb1d4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:02.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:02.925+0000 7fb1e17fa640 1 -- 172.21.15.53:0/177797325 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb1dc0ec730 con 0x7fb1e40c9fa0 2023-06-10T19:00:03.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.077+0000 7fb1eb0e7640 1 -- 172.21.15.53:0/177797325 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb1e404d790 con 0x7fb1e40c9fa0 2023-06-10T19:00:03.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.077+0000 7fb1e17fa640 1 -- 172.21.15.53:0/177797325 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v68) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb1dc0efd50 con 0x7fb1e40c9fa0 2023-06-10T19:00:03.083 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-06-10T19:00:03.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.081+0000 7fb1eb0e7640 1 -- 172.21.15.53:0/177797325 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb1d0066280 msgr2=0x7fb1d0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:03.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.081+0000 7fb1eb0e7640 1 --2- 172.21.15.53:0/177797325 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb1d0066280 0x7fb1d0068730 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fb1d4005890 tx=0x7fb1d4009040 comp rx=0 tx=0).stop 2023-06-10T19:00:03.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.081+0000 7fb1eb0e7640 1 -- 172.21.15.53:0/177797325 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb1e40c9fa0 msgr2=0x7fb1e40a9630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:03.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.081+0000 7fb1eb0e7640 1 --2- 172.21.15.53:0/177797325 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb1e40c9fa0 0x7fb1e40a9630 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc019460 tx=0x7fb1dc0195f0 comp rx=0 tx=0).stop 2023-06-10T19:00:03.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.081+0000 7fb1eb0e7640 1 -- 172.21.15.53:0/177797325 shutdown_connections 2023-06-10T19:00:03.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.081+0000 7fb1eb0e7640 1 --2- 172.21.15.53:0/177797325 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb1d0066280 0x7fb1d0068730 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:03.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.081+0000 7fb1eb0e7640 1 --2- 172.21.15.53:0/177797325 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb1e40c9fa0 0x7fb1e40a9630 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:03.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.081+0000 7fb1eb0e7640 1 --2- 172.21.15.53:0/177797325 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1e40c82a0 0x7fb1e40c3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:03.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.081+0000 7fb1eb0e7640 1 --2- 172.21.15.53:0/177797325 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb1e40af760 0x7fb1e4153070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:03.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.081+0000 7fb1eb0e7640 1 -- 172.21.15.53:0/177797325 >> 172.21.15.53:0/177797325 conn(0x7fb1e406a0e0 msgr2=0x7fb1e40c79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:03.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.081+0000 7fb1eb0e7640 1 -- 172.21.15.53:0/177797325 shutdown_connections 2023-06-10T19:00:03.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.081+0000 7fb1eb0e7640 1 -- 172.21.15.53:0/177797325 wait complete. 2023-06-10T19:00:03.102 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-10T19:00:03.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.213+0000 7f52c354e640 1 Processor -- start 2023-06-10T19:00:03.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.213+0000 7f52c354e640 1 -- start start 2023-06-10T19:00:03.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.217+0000 7f52c354e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f52bc0afe70 0x7f52bc0c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:03.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.217+0000 7f52c354e640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52bc06b090 con 0x7f52bc0c82a0 2023-06-10T19:00:03.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.217+0000 7f52c354e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52bc0ca370 con 0x7f52bc0c9fa0 2023-06-10T19:00:03.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.217+0000 7f52c354e640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52bc070d50 con 0x7f52bc0afe70 2023-06-10T19:00:03.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.217+0000 7f52c1aeb640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f52bc0afe70 0x7f52bc0c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:03.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.217+0000 7f52c0ae9640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f52bc0c82a0 0x7f52bc0af760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:33532/0 (socket says 172.21.15.53:33532) 2023-06-10T19:00:03.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.217+0000 7f52c0ae9640 1 -- 172.21.15.53:0/3385075230 learned_addr learned my addr 172.21.15.53:0/3385075230 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:00:03.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.217+0000 7f52c1aeb640 1 -- 172.21.15.53:0/3385075230 >> v1:172.21.15.117:6789/0 conn(0x7f52bc0c9fa0 legacy=0x7f52bc06bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:03.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.217+0000 7f52c1aeb640 1 -- 172.21.15.53:0/3385075230 >> v1:172.21.15.53:6789/0 conn(0x7f52bc0c82a0 legacy=0x7f52bc0af760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:03.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.217+0000 7f52c1aeb640 1 -- 172.21.15.53:0/3385075230 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52bc071030 con 0x7f52bc0afe70 2023-06-10T19:00:03.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.217+0000 7f52c1aeb640 1 --2- 172.21.15.53:0/3385075230 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52bc0afe70 0x7f52bc0c86f0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f52ac0097c0 tx=0x7f52ac01c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74e19d15bc9b6a7f server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:03.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.217+0000 7f52bbfff640 1 -- 172.21.15.53:0/3385075230 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ac0ad680 con 0x7f52bc0afe70 2023-06-10T19:00:03.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.217+0000 7f52bbfff640 1 -- 172.21.15.53:0/3385075230 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52ac0ad7e0 con 0x7f52bc0afe70 2023-06-10T19:00:03.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.217+0000 7f52bbfff640 1 -- 172.21.15.53:0/3385075230 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ac0adb70 con 0x7f52bc0afe70 2023-06-10T19:00:03.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.217+0000 7f52c354e640 1 -- 172.21.15.53:0/3385075230 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52bc0afe70 msgr2=0x7f52bc0c86f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:03.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.217+0000 7f52c354e640 1 --2- 172.21.15.53:0/3385075230 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52bc0afe70 0x7f52bc0c86f0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f52ac0097c0 tx=0x7f52ac01c380 comp rx=0 tx=0).stop 2023-06-10T19:00:03.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.217+0000 7f52c354e640 1 -- 172.21.15.53:0/3385075230 shutdown_connections 2023-06-10T19:00:03.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.217+0000 7f52c354e640 1 --2- 172.21.15.53:0/3385075230 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52bc0afe70 0x7f52bc0c86f0 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:03.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.217+0000 7f52c354e640 1 -- 172.21.15.53:0/3385075230 >> 172.21.15.53:0/3385075230 conn(0x7f52bc06a0e0 msgr2=0x7f52bc0cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:03.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.217+0000 7f52c354e640 1 -- 172.21.15.53:0/3385075230 shutdown_connections 2023-06-10T19:00:03.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.217+0000 7f52c354e640 1 -- 172.21.15.53:0/3385075230 wait complete. 2023-06-10T19:00:03.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.221+0000 7f52c354e640 1 Processor -- start 2023-06-10T19:00:03.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.221+0000 7f52c354e640 1 -- start start 2023-06-10T19:00:03.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.221+0000 7f52c354e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f52bc0afe70 0x7f52bc151200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:03.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.221+0000 7f52c354e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f52bc0c82a0 0x7f52bc0c38e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:03.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.221+0000 7f52c354e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52bc0c9fa0 0x7f52bc158c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:03.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.221+0000 7f52c354e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52bc157520 con 0x7f52bc0c9fa0 2023-06-10T19:00:03.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.221+0000 7f52c354e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52bc156910 con 0x7f52bc0afe70 2023-06-10T19:00:03.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.221+0000 7f52c354e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52bc156bf0 con 0x7f52bc0c82a0 2023-06-10T19:00:03.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.221+0000 7f52c1aeb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52bc0c9fa0 0x7f52bc158c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:03.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.221+0000 7f52c1aeb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52bc0c9fa0 0x7f52bc158c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48808/0 (socket says 172.21.15.53:48808) 2023-06-10T19:00:03.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.221+0000 7f52c1aeb640 1 -- 172.21.15.53:0/1184896103 learned_addr learned my addr 172.21.15.53:0/1184896103 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:03.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.221+0000 7f52c0ae9640 1 --2- 172.21.15.53:0/1184896103 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f52bc0c82a0 0x7f52bc0c38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:03.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.221+0000 7f52c12ea640 1 --2- 172.21.15.53:0/1184896103 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f52bc0afe70 0x7f52bc151200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:03.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.221+0000 7f52c1aeb640 1 -- 172.21.15.53:0/1184896103 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f52bc0c82a0 msgr2=0x7f52bc0c38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:03.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.221+0000 7f52c1aeb640 1 --2- 172.21.15.53:0/1184896103 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f52bc0c82a0 0x7f52bc0c38e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:03.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.221+0000 7f52c1aeb640 1 -- 172.21.15.53:0/1184896103 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f52bc0afe70 msgr2=0x7f52bc151200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:03.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.221+0000 7f52c1aeb640 1 --2- 172.21.15.53:0/1184896103 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f52bc0afe70 0x7f52bc151200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:03.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.221+0000 7f52c1aeb640 1 -- 172.21.15.53:0/1184896103 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52ac009420 con 0x7f52bc0c9fa0 2023-06-10T19:00:03.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.221+0000 7f52c0ae9640 1 --2- 172.21.15.53:0/1184896103 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f52bc0c82a0 0x7f52bc0c38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:00:03.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.221+0000 7f52c1aeb640 1 --2- 172.21.15.53:0/1184896103 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52bc0c9fa0 0x7f52bc158c20 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f52ac018f90 tx=0x7f52ac01abc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:03.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.221+0000 7f52b9ffb640 1 -- 172.21.15.53:0/1184896103 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ac0adde0 con 0x7f52bc0c9fa0 2023-06-10T19:00:03.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.221+0000 7f52b9ffb640 1 -- 172.21.15.53:0/1184896103 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52ac0b8420 con 0x7f52bc0c9fa0 2023-06-10T19:00:03.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.221+0000 7f52c354e640 1 -- 172.21.15.53:0/1184896103 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52bc156ed0 con 0x7f52bc0c9fa0 2023-06-10T19:00:03.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.221+0000 7f52b9ffb640 1 -- 172.21.15.53:0/1184896103 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ac0b87d0 con 0x7f52bc0c9fa0 2023-06-10T19:00:03.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.221+0000 7f52c354e640 1 -- 172.21.15.53:0/1184896103 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52bc151740 con 0x7f52bc0c9fa0 2023-06-10T19:00:03.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.221+0000 7f52c354e640 1 -- 172.21.15.53:0/1184896103 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52bc157690 con 0x7f52bc0c9fa0 2023-06-10T19:00:03.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.221+0000 7f52b9ffb640 1 -- 172.21.15.53:0/1184896103 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f52ac0b4040 con 0x7f52bc0c9fa0 2023-06-10T19:00:03.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.221+0000 7f52b9ffb640 1 --2- 172.21.15.53:0/1184896103 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f52a8066280 0x7f52a8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:03.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.225+0000 7f52b9ffb640 1 -- 172.21.15.53:0/1184896103 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6221+0+0 (secure 0 0 0) 0x7f52ac11e460 con 0x7f52bc0c9fa0 2023-06-10T19:00:03.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.225+0000 7f52c12ea640 1 --2- 172.21.15.53:0/1184896103 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f52a8066280 0x7f52a8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:03.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.225+0000 7f52c12ea640 1 --2- 172.21.15.53:0/1184896103 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f52a8066280 0x7f52a8068730 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f52bc0af4b0 tx=0x7f52b40072f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:03.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.229+0000 7f52b9ffb640 1 -- 172.21.15.53:0/1184896103 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f52ac0eb840 con 0x7f52bc0c9fa0 2023-06-10T19:00:03.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.377+0000 7f52c354e640 1 -- 172.21.15.53:0/1184896103 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f52bc04d790 con 0x7f52bc0c9fa0 2023-06-10T19:00:03.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.377+0000 7f52b9ffb640 1 -- 172.21.15.53:0/1184896103 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v68) v1 ==== 100+0+11 (secure 0 0 0) 0x7f52ac0eee60 con 0x7f52bc0c9fa0 2023-06-10T19:00:03.382 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-06-10T19:00:03.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.377+0000 7f52c354e640 1 -- 172.21.15.53:0/1184896103 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f52a8066280 msgr2=0x7f52a8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:03.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.377+0000 7f52c354e640 1 --2- 172.21.15.53:0/1184896103 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f52a8066280 0x7f52a8068730 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f52bc0af4b0 tx=0x7f52b40072f0 comp rx=0 tx=0).stop 2023-06-10T19:00:03.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.377+0000 7f52c354e640 1 -- 172.21.15.53:0/1184896103 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52bc0c9fa0 msgr2=0x7f52bc158c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:03.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.377+0000 7f52c354e640 1 --2- 172.21.15.53:0/1184896103 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52bc0c9fa0 0x7f52bc158c20 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f52ac018f90 tx=0x7f52ac01abc0 comp rx=0 tx=0).stop 2023-06-10T19:00:03.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.381+0000 7f52c354e640 1 -- 172.21.15.53:0/1184896103 shutdown_connections 2023-06-10T19:00:03.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.381+0000 7f52c354e640 1 --2- 172.21.15.53:0/1184896103 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f52a8066280 0x7f52a8068730 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:03.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.381+0000 7f52c354e640 1 --2- 172.21.15.53:0/1184896103 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52bc0c9fa0 0x7f52bc158c20 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:03.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.381+0000 7f52c354e640 1 --2- 172.21.15.53:0/1184896103 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f52bc0c82a0 0x7f52bc0c38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:03.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.381+0000 7f52c354e640 1 --2- 172.21.15.53:0/1184896103 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f52bc0afe70 0x7f52bc151200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:03.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.381+0000 7f52c354e640 1 -- 172.21.15.53:0/1184896103 >> 172.21.15.53:0/1184896103 conn(0x7f52bc06a0e0 msgr2=0x7f52bc0b18d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:03.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.381+0000 7f52c354e640 1 -- 172.21.15.53:0/1184896103 shutdown_connections 2023-06-10T19:00:03.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.381+0000 7f52c354e640 1 -- 172.21.15.53:0/1184896103 wait complete. 2023-06-10T19:00:03.399 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-10T19:00:03.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.505+0000 7f8028b91640 1 Processor -- start 2023-06-10T19:00:03.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.505+0000 7f8028b91640 1 -- start start 2023-06-10T19:00:03.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.505+0000 7f8028b91640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f80240afb70 0x7f802406f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:03.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.505+0000 7f8028b91640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80240cd2b0 con 0x7f80241585d0 2023-06-10T19:00:03.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.505+0000 7f8028b91640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80240cbf70 con 0x7f80240af720 2023-06-10T19:00:03.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.505+0000 7f8028b91640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80240c9260 con 0x7f80240afb70 2023-06-10T19:00:03.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.505+0000 7f802259c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f80241585d0 0x7f80240c8b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:33536/0 (socket says 172.21.15.53:33536) 2023-06-10T19:00:03.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.505+0000 7f802259c640 1 -- 172.21.15.53:0/3350824398 learned_addr learned my addr 172.21.15.53:0/3350824398 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:00:03.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.505+0000 7f8022d9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f80240afb70 0x7f802406f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:03.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.505+0000 7f802159a640 1 -- 172.21.15.53:0/3350824398 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 450452342 0 0) 0x7f80240cd2b0 con 0x7f80241585d0 2023-06-10T19:00:03.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.505+0000 7f802159a640 1 -- 172.21.15.53:0/3350824398 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f800c003530 con 0x7f80241585d0 2023-06-10T19:00:03.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.505+0000 7f8022d9d640 1 -- 172.21.15.53:0/3350824398 >> v1:172.21.15.117:6789/0 conn(0x7f80240af720 legacy=0x7f802406ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:03.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.505+0000 7f8022d9d640 1 -- 172.21.15.53:0/3350824398 >> v1:172.21.15.53:6789/0 conn(0x7f80241585d0 legacy=0x7f80240c8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:03.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.505+0000 7f8022d9d640 1 -- 172.21.15.53:0/3350824398 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80241589a0 con 0x7f80240afb70 2023-06-10T19:00:03.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.509+0000 7f8022d9d640 1 --2- 172.21.15.53:0/3350824398 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80240afb70 0x7f802406f680 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f801c009d90 tx=0x7f801c01c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=845ab9b52f43a0a0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:03.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.509+0000 7f802159a640 1 -- 172.21.15.53:0/3350824398 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801c0a5950 con 0x7f80240afb70 2023-06-10T19:00:03.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.509+0000 7f802159a640 1 -- 172.21.15.53:0/3350824398 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f801c0a5ab0 con 0x7f80240afb70 2023-06-10T19:00:03.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.509+0000 7f802159a640 1 -- 172.21.15.53:0/3350824398 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801c0a5e40 con 0x7f80240afb70 2023-06-10T19:00:03.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.509+0000 7f8028b91640 1 -- 172.21.15.53:0/3350824398 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80240afb70 msgr2=0x7f802406f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:03.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.509+0000 7f8028b91640 1 --2- 172.21.15.53:0/3350824398 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80240afb70 0x7f802406f680 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f801c009d90 tx=0x7f801c01c890 comp rx=0 tx=0).stop 2023-06-10T19:00:03.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.509+0000 7f8028b91640 1 -- 172.21.15.53:0/3350824398 shutdown_connections 2023-06-10T19:00:03.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.509+0000 7f8028b91640 1 --2- 172.21.15.53:0/3350824398 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80240afb70 0x7f802406f680 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:03.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.509+0000 7f8028b91640 1 -- 172.21.15.53:0/3350824398 >> 172.21.15.53:0/3350824398 conn(0x7f80240cdca0 msgr2=0x7f80240ce0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:03.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.509+0000 7f8028b91640 1 -- 172.21.15.53:0/3350824398 shutdown_connections 2023-06-10T19:00:03.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.509+0000 7f8028b91640 1 -- 172.21.15.53:0/3350824398 wait complete. 2023-06-10T19:00:03.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.509+0000 7f8028b91640 1 Processor -- start 2023-06-10T19:00:03.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.509+0000 7f8028b91640 1 -- start start 2023-06-10T19:00:03.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.513+0000 7f8028b91640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80240af720 0x7f80241424c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:03.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.513+0000 7f8028b91640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f80240afb70 0x7f80241462a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:03.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.513+0000 7f8028b91640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80241585d0 0x7f8024143e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:03.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.513+0000 7f8028b91640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8024141a20 con 0x7f80241585d0 2023-06-10T19:00:03.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.513+0000 7f8028b91640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8024144530 con 0x7f80240af720 2023-06-10T19:00:03.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.513+0000 7f8028b91640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8024144810 con 0x7f80240afb70 2023-06-10T19:00:03.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.513+0000 7f8022d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80241585d0 0x7f8024143e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:03.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.513+0000 7f8022d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80241585d0 0x7f8024143e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48830/0 (socket says 172.21.15.53:48830) 2023-06-10T19:00:03.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.513+0000 7f8022d9d640 1 -- 172.21.15.53:0/1246680835 learned_addr learned my addr 172.21.15.53:0/1246680835 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:03.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.513+0000 7f802259c640 1 --2- 172.21.15.53:0/1246680835 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80240af720 0x7f80241424c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:03.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.513+0000 7f8021d9b640 1 --2- 172.21.15.53:0/1246680835 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f80240afb70 0x7f80241462a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:03.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.513+0000 7f8022d9d640 1 -- 172.21.15.53:0/1246680835 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f80240afb70 msgr2=0x7f80241462a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:03.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.513+0000 7f8022d9d640 1 --2- 172.21.15.53:0/1246680835 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f80240afb70 0x7f80241462a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:03.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.513+0000 7f8022d9d640 1 -- 172.21.15.53:0/1246680835 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80240af720 msgr2=0x7f80241424c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:03.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.513+0000 7f8022d9d640 1 --2- 172.21.15.53:0/1246680835 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80240af720 0x7f80241424c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:03.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.513+0000 7f8022d9d640 1 -- 172.21.15.53:0/1246680835 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f801c009a70 con 0x7f80241585d0 2023-06-10T19:00:03.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.513+0000 7f802259c640 1 --2- 172.21.15.53:0/1246680835 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80240af720 0x7f80241424c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:00:03.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.513+0000 7f8022d9d640 1 --2- 172.21.15.53:0/1246680835 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80241585d0 0x7f8024143e20 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f801c0b0040 tx=0x7f801c019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:03.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.513+0000 7f8012ffd640 1 -- 172.21.15.53:0/1246680835 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801c0add90 con 0x7f80241585d0 2023-06-10T19:00:03.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.513+0000 7f8012ffd640 1 -- 172.21.15.53:0/1246680835 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f801c009450 con 0x7f80241585d0 2023-06-10T19:00:03.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.513+0000 7f8028b91640 1 -- 172.21.15.53:0/1246680835 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8024141cc0 con 0x7f80241585d0 2023-06-10T19:00:03.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.513+0000 7f8012ffd640 1 -- 172.21.15.53:0/1246680835 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801c0b9690 con 0x7f80241585d0 2023-06-10T19:00:03.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.513+0000 7f8028b91640 1 -- 172.21.15.53:0/1246680835 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80240c09f0 con 0x7f80241585d0 2023-06-10T19:00:03.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.513+0000 7f8028b91640 1 -- 172.21.15.53:0/1246680835 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80240cca90 con 0x7f80241585d0 2023-06-10T19:00:03.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.513+0000 7f8012ffd640 1 -- 172.21.15.53:0/1246680835 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f801c0b97f0 con 0x7f80241585d0 2023-06-10T19:00:03.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.513+0000 7f8012ffd640 1 --2- 172.21.15.53:0/1246680835 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f80040662b0 0x7f8004068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:03.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.513+0000 7f8012ffd640 1 -- 172.21.15.53:0/1246680835 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6221+0+0 (secure 0 0 0) 0x7f801c11f4b0 con 0x7f80241585d0 2023-06-10T19:00:03.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.513+0000 7f802259c640 1 --2- 172.21.15.53:0/1246680835 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f80040662b0 0x7f8004068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:03.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.517+0000 7f802259c640 1 --2- 172.21.15.53:0/1246680835 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f80040662b0 0x7f8004068760 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f80140011f0 tx=0x7f8014009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:03.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.517+0000 7f8012ffd640 1 -- 172.21.15.53:0/1246680835 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f80240cca90 con 0x7f80241585d0 2023-06-10T19:00:03.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.677+0000 7f8028b91640 1 -- 172.21.15.53:0/1246680835 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f80240cca90 con 0x7f80241585d0 2023-06-10T19:00:03.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.677+0000 7f8012ffd640 1 -- 172.21.15.53:0/1246680835 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 1 entries v68) v1 ==== 80+0+56 (secure 0 0 0) 0x7f80240cca90 con 0x7f80241585d0 2023-06-10T19:00:03.682 INFO:teuthology.orchestra.run.smithi053.stdout:192.168.0.1:0/683847329 2023-06-10T19:59:28.260070+0000 2023-06-10T19:00:03.682 INFO:teuthology.orchestra.run.smithi053.stderr:listed 1 entries 2023-06-10T19:00:03.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.681+0000 7f8028b91640 1 -- 172.21.15.53:0/1246680835 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f80040662b0 msgr2=0x7f8004068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:03.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.681+0000 7f8028b91640 1 --2- 172.21.15.53:0/1246680835 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f80040662b0 0x7f8004068760 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f80140011f0 tx=0x7f8014009040 comp rx=0 tx=0).stop 2023-06-10T19:00:03.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.681+0000 7f8028b91640 1 -- 172.21.15.53:0/1246680835 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80241585d0 msgr2=0x7f8024143e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:03.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.681+0000 7f8028b91640 1 --2- 172.21.15.53:0/1246680835 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80241585d0 0x7f8024143e20 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f801c0b0040 tx=0x7f801c019630 comp rx=0 tx=0).stop 2023-06-10T19:00:03.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.681+0000 7f8028b91640 1 -- 172.21.15.53:0/1246680835 shutdown_connections 2023-06-10T19:00:03.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.681+0000 7f8028b91640 1 --2- 172.21.15.53:0/1246680835 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f80040662b0 0x7f8004068760 secure :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f80140011f0 tx=0x7f8014009040 comp rx=0 tx=0).stop 2023-06-10T19:00:03.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.681+0000 7f8028b91640 1 --2- 172.21.15.53:0/1246680835 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80241585d0 0x7f8024143e20 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:03.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.681+0000 7f8028b91640 1 --2- 172.21.15.53:0/1246680835 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f80240afb70 0x7f80241462a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:03.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.681+0000 7f8028b91640 1 --2- 172.21.15.53:0/1246680835 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80240af720 0x7f80241424c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:03.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.681+0000 7f8028b91640 1 -- 172.21.15.53:0/1246680835 >> 172.21.15.53:0/1246680835 conn(0x7f80240cdca0 msgr2=0x7f802415c500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:03.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.681+0000 7f8028b91640 1 -- 172.21.15.53:0/1246680835 shutdown_connections 2023-06-10T19:00:03.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:03.681+0000 7f8028b91640 1 -- 172.21.15.53:0/1246680835 wait complete. 2023-06-10T19:00:03.700 DEBUG:tasks.cephfs.mount:Force/lazy unmounting on client.0 2023-06-10T19:00:03.701 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:00:03.701 DEBUG:teuthology.orchestra.run.smithi053:> sudo umount --lazy --force /home/ubuntu/cephtest/mnt.0 2023-06-10T19:00:03.720 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi053.front.sepia.ceph.com 2023-06-10T19:00:03.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:00:03.721 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-06-10T19:00:03.772 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-06-10T19:00:03.773 DEBUG:teuthology.orchestra.run.smithi053:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-06-10T19:00:03.881 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-06-10T19:00:03.947 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-06-10T19:00:03.947 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T19:00:03.948 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:00:03.953 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16345192k,nr_inodes=4086298,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276544k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=407 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276540k,nr_inodes=819135,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276544k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-06-10T19:00:03.953 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi053.front.sepia.ceph.com 2023-06-10T19:00:03.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:00:03.954 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-06-10T19:00:04.000 INFO:teuthology.orchestra.run.smithi053.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-06-10T19:00:04.000 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-10T19:00:04.001 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T19:00:04.001 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:00:04.008 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:00:04.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.169+0000 7f4288256640 1 Processor -- start 2023-06-10T19:00:04.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.169+0000 7f4288256640 1 -- start start 2023-06-10T19:00:04.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.169+0000 7f4288256640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f42800cc690 0x7f42800d04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:04.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.169+0000 7f4288256640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42800d0020 con 0x7f42800ccae0 2023-06-10T19:00:04.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.169+0000 7f4288256640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42800cef40 con 0x7f42800b3ac0 2023-06-10T19:00:04.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.169+0000 7f4288256640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42800cf220 con 0x7f42800cc690 2023-06-10T19:00:04.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.169+0000 7f42867f3640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f42800ccae0 0x7f42800d09f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:33548/0 (socket says 172.21.15.53:33548) 2023-06-10T19:00:04.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.169+0000 7f42867f3640 1 -- 172.21.15.53:0/215829694 learned_addr learned my addr 172.21.15.53:0/215829694 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:00:04.175 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.169+0000 7f42857f1640 1 --2- 172.21.15.53:0/215829694 >> v2:172.21.15.117:3300/0 conn(0x7f42800cc690 0x7f42800d04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:04.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.169+0000 7f4284ff0640 1 -- 172.21.15.53:0/215829694 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3975129933 0 0) 0x7f42800d0020 con 0x7f42800ccae0 2023-06-10T19:00:04.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.169+0000 7f4284ff0640 1 -- 172.21.15.53:0/215829694 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f426c003530 con 0x7f42800ccae0 2023-06-10T19:00:04.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.169+0000 7f4284ff0640 1 -- 172.21.15.53:0/215829694 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2137045921 0 0) 0x7f426c003530 con 0x7f42800ccae0 2023-06-10T19:00:04.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.169+0000 7f4284ff0640 1 -- 172.21.15.53:0/215829694 >> v2:172.21.15.117:3300/0 conn(0x7f42800cc690 msgr2=0x7f42800d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:04.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.169+0000 7f4284ff0640 1 --2- 172.21.15.53:0/215829694 >> v2:172.21.15.117:3300/0 conn(0x7f42800cc690 0x7f42800d04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:04.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.169+0000 7f4284ff0640 1 -- 172.21.15.53:0/215829694 >> v1:172.21.15.117:6789/0 conn(0x7f42800b3ac0 legacy=0x7f42800b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:04.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.169+0000 7f4284ff0640 1 -- 172.21.15.53:0/215829694 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42800cf500 con 0x7f42800ccae0 2023-06-10T19:00:04.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.169+0000 7f4284ff0640 1 -- 172.21.15.53:0/215829694 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f4278001a00 con 0x7f42800ccae0 2023-06-10T19:00:04.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.169+0000 7f4284ff0640 1 -- 172.21.15.53:0/215829694 >> v1:172.21.15.53:6789/0 conn(0x7f42800ccae0 legacy=0x7f42800d09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:04.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.169+0000 7f4284ff0640 1 --2- 172.21.15.53:0/215829694 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f426c0039f0 0x7f426c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:04.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.169+0000 7f4284ff0640 1 --2- 172.21.15.53:0/215829694 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f426c0047d0 0x7f426c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:04.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.169+0000 7f4284ff0640 1 --2- 172.21.15.53:0/215829694 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f426c005180 0x7f426c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:04.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.169+0000 7f4284ff0640 1 -- 172.21.15.53:0/215829694 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42800cf220 con 0x7f426c0047d0 2023-06-10T19:00:04.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.169+0000 7f4284ff0640 1 -- 172.21.15.53:0/215829694 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f426c00c060 con 0x7f426c0039f0 2023-06-10T19:00:04.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.169+0000 7f4284ff0640 1 -- 172.21.15.53:0/215829694 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f426c00c220 con 0x7f426c005180 2023-06-10T19:00:04.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.169+0000 7f42857f1640 1 --2- 172.21.15.53:0/215829694 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f426c0047d0 0x7f426c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:04.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.169+0000 7f4285ff2640 1 --2- 172.21.15.53:0/215829694 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f426c0039f0 0x7f426c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:04.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.169+0000 7f42867f3640 1 --2- 172.21.15.53:0/215829694 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f426c005180 0x7f426c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:04.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.169+0000 7f42857f1640 1 -- 172.21.15.53:0/215829694 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f426c005180 msgr2=0x7f426c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:04.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.169+0000 7f42857f1640 1 --2- 172.21.15.53:0/215829694 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f426c005180 0x7f426c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:04.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.169+0000 7f42857f1640 1 -- 172.21.15.53:0/215829694 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f426c0039f0 msgr2=0x7f426c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:04.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.169+0000 7f42857f1640 1 --2- 172.21.15.53:0/215829694 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f426c0039f0 0x7f426c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:04.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.169+0000 7f42857f1640 1 -- 172.21.15.53:0/215829694 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f426c003530 con 0x7f426c0047d0 2023-06-10T19:00:04.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.169+0000 7f42867f3640 1 --2- 172.21.15.53:0/215829694 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f426c005180 0x7f426c00b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:00:04.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.169+0000 7f4285ff2640 1 --2- 172.21.15.53:0/215829694 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f426c0039f0 0x7f426c003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:00:04.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.169+0000 7f42867f3640 1 -- 172.21.15.53:0/215829694 reap_dead start 2023-06-10T19:00:04.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.173+0000 7f42857f1640 1 --2- 172.21.15.53:0/215829694 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f426c0047d0 0x7f426c004c40 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f4270009ae0 tx=0x7f427001ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20939ffcf58c618 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:04.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.173+0000 7f4284ff0640 1 -- 172.21.15.53:0/215829694 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42700a5640 con 0x7f426c0047d0 2023-06-10T19:00:04.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.173+0000 7f4284ff0640 1 -- 172.21.15.53:0/215829694 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4278002100 con 0x7f426c0047d0 2023-06-10T19:00:04.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.173+0000 7f4284ff0640 1 -- 172.21.15.53:0/215829694 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42700a59e0 con 0x7f426c0047d0 2023-06-10T19:00:04.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.173+0000 7f4288256640 1 -- 172.21.15.53:0/215829694 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f426c0047d0 msgr2=0x7f426c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:04.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.173+0000 7f4288256640 1 --2- 172.21.15.53:0/215829694 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f426c0047d0 0x7f426c004c40 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f4270009ae0 tx=0x7f427001ca50 comp rx=0 tx=0).stop 2023-06-10T19:00:04.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.173+0000 7f4288256640 1 -- 172.21.15.53:0/215829694 shutdown_connections 2023-06-10T19:00:04.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.173+0000 7f4288256640 1 --2- 172.21.15.53:0/215829694 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f426c0047d0 0x7f426c004c40 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:04.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.173+0000 7f4288256640 1 -- 172.21.15.53:0/215829694 >> 172.21.15.53:0/215829694 conn(0x7f4280071790 msgr2=0x7f4280069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:04.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.173+0000 7f4288256640 1 -- 172.21.15.53:0/215829694 shutdown_connections 2023-06-10T19:00:04.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.173+0000 7f4288256640 1 -- 172.21.15.53:0/215829694 wait complete. 2023-06-10T19:00:04.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.173+0000 7f4288256640 1 Processor -- start 2023-06-10T19:00:04.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.173+0000 7f4288256640 1 -- start start 2023-06-10T19:00:04.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.177+0000 7f4288256640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f426c0047d0 0x7f4280152ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:04.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.177+0000 7f4288256640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f428015be00 0x7f4280152540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:04.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.177+0000 7f4288256640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f428015d3f0 0x7f42800c5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:04.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.177+0000 7f4288256640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f428015d860 con 0x7f428015d3f0 2023-06-10T19:00:04.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.177+0000 7f4288256640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f428015c350 con 0x7f428015be00 2023-06-10T19:00:04.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.177+0000 7f4288256640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f428015c630 con 0x7f426c0047d0 2023-06-10T19:00:04.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.177+0000 7f42867f3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f428015d3f0 0x7f42800c5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:04.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.177+0000 7f42867f3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f428015d3f0 0x7f42800c5b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48842/0 (socket says 172.21.15.53:48842) 2023-06-10T19:00:04.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.177+0000 7f42867f3640 1 -- 172.21.15.53:0/4119028716 learned_addr learned my addr 172.21.15.53:0/4119028716 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:04.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.177+0000 7f42857f1640 1 --2- 172.21.15.53:0/4119028716 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f428015be00 0x7f4280152540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:04.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.177+0000 7f4285ff2640 1 --2- 172.21.15.53:0/4119028716 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f426c0047d0 0x7f4280152ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:04.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.177+0000 7f42867f3640 1 -- 172.21.15.53:0/4119028716 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f426c0047d0 msgr2=0x7f4280152ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:04.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.177+0000 7f42867f3640 1 --2- 172.21.15.53:0/4119028716 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f426c0047d0 0x7f4280152ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:04.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.177+0000 7f42867f3640 1 -- 172.21.15.53:0/4119028716 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f428015be00 msgr2=0x7f4280152540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:04.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.177+0000 7f42867f3640 1 --2- 172.21.15.53:0/4119028716 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f428015be00 0x7f4280152540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:04.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.177+0000 7f42867f3640 1 -- 172.21.15.53:0/4119028716 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f428015c910 con 0x7f428015d3f0 2023-06-10T19:00:04.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.177+0000 7f42857f1640 1 --2- 172.21.15.53:0/4119028716 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f428015be00 0x7f4280152540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:00:04.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.177+0000 7f42867f3640 1 --2- 172.21.15.53:0/4119028716 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f428015d3f0 0x7f42800c5b70 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f42800cceb0 tx=0x7f42780108b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:04.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.177+0000 7f42767fc640 1 -- 172.21.15.53:0/4119028716 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4278015400 con 0x7f428015d3f0 2023-06-10T19:00:04.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.177+0000 7f42767fc640 1 -- 172.21.15.53:0/4119028716 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4278015560 con 0x7f428015d3f0 2023-06-10T19:00:04.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.177+0000 7f4288256640 1 -- 172.21.15.53:0/4119028716 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f428015cbf0 con 0x7f428015d3f0 2023-06-10T19:00:04.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.177+0000 7f42767fc640 1 -- 172.21.15.53:0/4119028716 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4278015910 con 0x7f428015d3f0 2023-06-10T19:00:04.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.177+0000 7f4288256640 1 -- 172.21.15.53:0/4119028716 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42800c6830 con 0x7f428015d3f0 2023-06-10T19:00:04.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.177+0000 7f4288256640 1 -- 172.21.15.53:0/4119028716 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f428004d790 con 0x7f428015d3f0 2023-06-10T19:00:04.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.177+0000 7f42767fc640 1 -- 172.21.15.53:0/4119028716 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f427801e3b0 con 0x7f428015d3f0 2023-06-10T19:00:04.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.177+0000 7f42767fc640 1 --2- 172.21.15.53:0/4119028716 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4264066280 0x7f4264068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:04.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.177+0000 7f42767fc640 1 -- 172.21.15.53:0/4119028716 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6221+0+0 (secure 0 0 0) 0x7f42780861e0 con 0x7f428015d3f0 2023-06-10T19:00:04.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.177+0000 7f4285ff2640 1 --2- 172.21.15.53:0/4119028716 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4264066280 0x7f4264068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:04.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.181+0000 7f4285ff2640 1 --2- 172.21.15.53:0/4119028716 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4264066280 0x7f4264068730 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f428015daa0 tx=0x7f427c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:04.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.181+0000 7f42767fc640 1 -- 172.21.15.53:0/4119028716 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f42780570e0 con 0x7f428015d3f0 2023-06-10T19:00:04.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.337+0000 7f4288256640 1 -- 172.21.15.53:0/4119028716 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f42800b3570 con 0x7f428015d3f0 2023-06-10T19:00:04.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.341+0000 7f42767fc640 1 -- 172.21.15.53:0/4119028716 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) v1 ==== 74+0+18533 (secure 0 0 0) 0x7f4278056c70 con 0x7f428015d3f0 2023-06-10T19:00:04.346 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:00:04.346 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":68,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T18:59:28.908909+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-06-10T18:57:11.323255+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-06-10T18:57:12.231973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.13","mappings":[{"from":7,"to":2}]},{"pgid":"10.10","mappings":[{"from":4,"to":3}]},{"pgid":"10.21","mappings":[{"from":4,"to":3}]},{"pgid":"10.25","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.0.1:0/683847329":"2023-06-10T19:59:28.260070+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:00:04.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.341+0000 7f4288256640 1 -- 172.21.15.53:0/4119028716 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4264066280 msgr2=0x7f4264068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:04.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.341+0000 7f4288256640 1 --2- 172.21.15.53:0/4119028716 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4264066280 0x7f4264068730 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f428015daa0 tx=0x7f427c009040 comp rx=0 tx=0).stop 2023-06-10T19:00:04.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.341+0000 7f4288256640 1 -- 172.21.15.53:0/4119028716 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f428015d3f0 msgr2=0x7f42800c5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:04.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.341+0000 7f4288256640 1 --2- 172.21.15.53:0/4119028716 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f428015d3f0 0x7f42800c5b70 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f42800cceb0 tx=0x7f42780108b0 comp rx=0 tx=0).stop 2023-06-10T19:00:04.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.345+0000 7f4288256640 1 -- 172.21.15.53:0/4119028716 shutdown_connections 2023-06-10T19:00:04.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.345+0000 7f4288256640 1 --2- 172.21.15.53:0/4119028716 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4264066280 0x7f4264068730 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:04.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.345+0000 7f4288256640 1 --2- 172.21.15.53:0/4119028716 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f428015d3f0 0x7f42800c5b70 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:04.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.345+0000 7f4288256640 1 --2- 172.21.15.53:0/4119028716 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f428015be00 0x7f4280152540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:04.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.345+0000 7f4288256640 1 --2- 172.21.15.53:0/4119028716 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f426c0047d0 0x7f4280152ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:04.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.345+0000 7f4288256640 1 -- 172.21.15.53:0/4119028716 >> 172.21.15.53:0/4119028716 conn(0x7f4280071790 msgr2=0x7f42800b6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:04.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.345+0000 7f4288256640 1 -- 172.21.15.53:0/4119028716 shutdown_connections 2023-06-10T19:00:04.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.345+0000 7f4288256640 1 -- 172.21.15.53:0/4119028716 wait complete. 2023-06-10T19:00:04.365 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-10T18:52:33.633114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-10T18:52:39.171487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-10T18:57:11.323255+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '64', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2023-06-10T18:57:12.231973+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '65', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-10T19:00:04.367 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-10T19:00:04.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.493+0000 7f7de3ccb640 1 Processor -- start 2023-06-10T19:00:04.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.493+0000 7f7de3ccb640 1 -- start start 2023-06-10T19:00:04.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.493+0000 7f7de3ccb640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ddc15c070 0x7f7ddc15c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:04.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.493+0000 7f7de3ccb640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7ddc06b800 0x7f7ddc06bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:04.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.493+0000 7f7de3ccb640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ddc15ca00 con 0x7f7ddc156180 2023-06-10T19:00:04.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.493+0000 7f7de3ccb640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ddc06b090 con 0x7f7ddc06b800 2023-06-10T19:00:04.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.493+0000 7f7de3ccb640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ddc06efa0 con 0x7f7ddc15c070 2023-06-10T19:00:04.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.493+0000 7f7de1a67640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f7ddc156180 0x7f7ddc0cd4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:33560/0 (socket says 172.21.15.53:33560) 2023-06-10T19:00:04.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.493+0000 7f7de1a67640 1 -- 172.21.15.53:0/707937766 learned_addr learned my addr 172.21.15.53:0/707937766 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:00:04.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.493+0000 7f7de2268640 1 --2- 172.21.15.53:0/707937766 >> v2:172.21.15.53:3300/0 conn(0x7f7ddc06b800 0x7f7ddc06bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:04.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.493+0000 7f7de0a65640 1 -- 172.21.15.53:0/707937766 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 425996281 0 0) 0x7f7dd0001120 con 0x7f7ddc156180 2023-06-10T19:00:04.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.493+0000 7f7de1266640 1 --2- 172.21.15.53:0/707937766 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ddc15c070 0x7f7ddc15c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:04.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.493+0000 7f7de0a65640 1 -- 172.21.15.53:0/707937766 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7dc8003530 con 0x7f7ddc156180 2023-06-10T19:00:04.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.493+0000 7f7de0a65640 1 -- 172.21.15.53:0/707937766 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2875160322 0 0) 0x7f7dc8003530 con 0x7f7ddc156180 2023-06-10T19:00:04.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.493+0000 7f7de0a65640 1 -- 172.21.15.53:0/707937766 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ddc15c070 msgr2=0x7f7ddc15c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:04.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.493+0000 7f7de0a65640 1 --2- 172.21.15.53:0/707937766 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ddc15c070 0x7f7ddc15c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:04.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.493+0000 7f7de0a65640 1 -- 172.21.15.53:0/707937766 >> v2:172.21.15.53:3300/0 conn(0x7f7ddc06b800 msgr2=0x7f7ddc06bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:04.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.493+0000 7f7de0a65640 1 --2- 172.21.15.53:0/707937766 >> v2:172.21.15.53:3300/0 conn(0x7f7ddc06b800 0x7f7ddc06bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:04.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.493+0000 7f7de0a65640 1 -- 172.21.15.53:0/707937766 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ddc0cc720 con 0x7f7ddc156180 2023-06-10T19:00:04.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.493+0000 7f7de0a65640 1 -- 172.21.15.53:0/707937766 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f7dd0001810 con 0x7f7ddc156180 2023-06-10T19:00:04.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.493+0000 7f7de2268640 1 --2- 172.21.15.53:0/707937766 >> v2:172.21.15.53:3300/0 conn(0x7f7ddc06b800 0x7f7ddc06bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-10T19:00:04.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.493+0000 7f7de0a65640 1 -- 172.21.15.53:0/707937766 >> v1:172.21.15.53:6789/0 conn(0x7f7ddc156180 legacy=0x7f7ddc0cd4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:04.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.493+0000 7f7de0a65640 1 --2- 172.21.15.53:0/707937766 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7dc8003980 0x7f7dc8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:04.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.493+0000 7f7de0a65640 1 --2- 172.21.15.53:0/707937766 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ddc15c070 0x7f7dc80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:04.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.493+0000 7f7de0a65640 1 --2- 172.21.15.53:0/707937766 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7dc8004d10 0x7f7dc8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:04.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.493+0000 7f7de0a65640 1 -- 172.21.15.53:0/707937766 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ddc06b090 con 0x7f7dc8004d10 2023-06-10T19:00:04.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.493+0000 7f7de0a65640 1 -- 172.21.15.53:0/707937766 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ddc06efa0 con 0x7f7dc8003980 2023-06-10T19:00:04.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.493+0000 7f7de0a65640 1 -- 172.21.15.53:0/707937766 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc800b990 con 0x7f7ddc15c070 2023-06-10T19:00:04.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.493+0000 7f7de2268640 1 --2- 172.21.15.53:0/707937766 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7dc8004d10 0x7f7dc8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:04.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.493+0000 7f7de1a67640 1 --2- 172.21.15.53:0/707937766 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7dc8003980 0x7f7dc8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:04.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.493+0000 7f7de2268640 1 -- 172.21.15.53:0/707937766 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ddc15c070 msgr2=0x7f7dc80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:04.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.493+0000 7f7de1266640 1 --2- 172.21.15.53:0/707937766 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ddc15c070 0x7f7dc80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:04.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.493+0000 7f7de2268640 1 --2- 172.21.15.53:0/707937766 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ddc15c070 0x7f7dc80047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:04.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.493+0000 7f7de2268640 1 -- 172.21.15.53:0/707937766 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7dc8003980 msgr2=0x7f7dc8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:04.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.493+0000 7f7de2268640 1 --2- 172.21.15.53:0/707937766 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7dc8003980 0x7f7dc8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:04.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.493+0000 7f7de2268640 1 -- 172.21.15.53:0/707937766 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dc8003530 con 0x7f7dc8004d10 2023-06-10T19:00:04.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.493+0000 7f7de1a67640 1 --2- 172.21.15.53:0/707937766 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7dc8003980 0x7f7dc8003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:00:04.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.497+0000 7f7de2268640 1 --2- 172.21.15.53:0/707937766 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7dc8004d10 0x7f7dc8005180 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f7dd400e350 tx=0x7f7dd401ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd88d5666ec48672 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:04.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.497+0000 7f7de0a65640 1 -- 172.21.15.53:0/707937766 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd40a5e70 con 0x7f7dc8004d10 2023-06-10T19:00:04.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.497+0000 7f7de0a65640 1 -- 172.21.15.53:0/707937766 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dd400f040 con 0x7f7dc8004d10 2023-06-10T19:00:04.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.497+0000 7f7de0a65640 1 -- 172.21.15.53:0/707937766 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd40ad640 con 0x7f7dc8004d10 2023-06-10T19:00:04.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.497+0000 7f7de3ccb640 1 -- 172.21.15.53:0/707937766 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7dc8004d10 msgr2=0x7f7dc8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:04.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.497+0000 7f7de3ccb640 1 --2- 172.21.15.53:0/707937766 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7dc8004d10 0x7f7dc8005180 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f7dd400e350 tx=0x7f7dd401ce00 comp rx=0 tx=0).stop 2023-06-10T19:00:04.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.497+0000 7f7de2268640 1 -- 172.21.15.53:0/707937766 reap_dead start 2023-06-10T19:00:04.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.497+0000 7f7de3ccb640 1 -- 172.21.15.53:0/707937766 shutdown_connections 2023-06-10T19:00:04.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.497+0000 7f7de3ccb640 1 -- 172.21.15.53:0/707937766 >> 172.21.15.53:0/707937766 conn(0x7f7ddc06a0e0 msgr2=0x7f7ddc0cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:04.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.497+0000 7f7de3ccb640 1 -- 172.21.15.53:0/707937766 shutdown_connections 2023-06-10T19:00:04.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.497+0000 7f7de3ccb640 1 -- 172.21.15.53:0/707937766 wait complete. 2023-06-10T19:00:04.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.497+0000 7f7de3ccb640 1 Processor -- start 2023-06-10T19:00:04.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.497+0000 7f7de3ccb640 1 -- start start 2023-06-10T19:00:04.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.501+0000 7f7de3ccb640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ddc0afa30 0x7f7ddc148940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:04.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.501+0000 7f7de3ccb640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ddc0afe00 0x7f7ddc0c7940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:04.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.501+0000 7f7de3ccb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ddc14afa0 0x7f7ddc14b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:04.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.501+0000 7f7de3ccb640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ddc14b980 con 0x7f7ddc14afa0 2023-06-10T19:00:04.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.501+0000 7f7de3ccb640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ddc0b1d00 con 0x7f7ddc0afa30 2023-06-10T19:00:04.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.501+0000 7f7de3ccb640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ddc0b1fe0 con 0x7f7ddc0afe00 2023-06-10T19:00:04.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.501+0000 7f7de2268640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ddc14afa0 0x7f7ddc14b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:04.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.501+0000 7f7de2268640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ddc14afa0 0x7f7ddc14b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48868/0 (socket says 172.21.15.53:48868) 2023-06-10T19:00:04.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.501+0000 7f7de2268640 1 -- 172.21.15.53:0/464734401 learned_addr learned my addr 172.21.15.53:0/464734401 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:04.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.501+0000 7f7de1266640 1 --2- 172.21.15.53:0/464734401 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ddc0afe00 0x7f7ddc0c7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:04.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.501+0000 7f7de1a67640 1 --2- 172.21.15.53:0/464734401 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ddc0afa30 0x7f7ddc148940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:04.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.501+0000 7f7de2268640 1 -- 172.21.15.53:0/464734401 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ddc0afe00 msgr2=0x7f7ddc0c7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:04.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.501+0000 7f7de2268640 1 --2- 172.21.15.53:0/464734401 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ddc0afe00 0x7f7ddc0c7940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:04.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.501+0000 7f7de2268640 1 -- 172.21.15.53:0/464734401 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ddc0afa30 msgr2=0x7f7ddc148940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:04.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.501+0000 7f7de2268640 1 --2- 172.21.15.53:0/464734401 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ddc0afa30 0x7f7ddc148940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:04.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.501+0000 7f7de2268640 1 -- 172.21.15.53:0/464734401 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ddc0b22c0 con 0x7f7ddc14afa0 2023-06-10T19:00:04.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.501+0000 7f7de1a67640 1 --2- 172.21.15.53:0/464734401 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ddc0afa30 0x7f7ddc148940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:00:04.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.501+0000 7f7de2268640 1 --2- 172.21.15.53:0/464734401 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ddc14afa0 0x7f7ddc14b440 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f7dd400e350 tx=0x7f7dd4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:04.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.501+0000 7f7dce7fc640 1 -- 172.21.15.53:0/464734401 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd40bc070 con 0x7f7ddc14afa0 2023-06-10T19:00:04.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.501+0000 7f7dce7fc640 1 -- 172.21.15.53:0/464734401 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dd40ade00 con 0x7f7ddc14afa0 2023-06-10T19:00:04.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.501+0000 7f7de3ccb640 1 -- 172.21.15.53:0/464734401 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ddc0b25a0 con 0x7f7ddc14afa0 2023-06-10T19:00:04.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.501+0000 7f7dce7fc640 1 -- 172.21.15.53:0/464734401 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd4003bc0 con 0x7f7ddc14afa0 2023-06-10T19:00:04.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.501+0000 7f7de3ccb640 1 -- 172.21.15.53:0/464734401 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ddc0a7ff0 con 0x7f7ddc14afa0 2023-06-10T19:00:04.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.501+0000 7f7de3ccb640 1 -- 172.21.15.53:0/464734401 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ddc04d790 con 0x7f7ddc14afa0 2023-06-10T19:00:04.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.501+0000 7f7dce7fc640 1 -- 172.21.15.53:0/464734401 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7dd40b4040 con 0x7f7ddc14afa0 2023-06-10T19:00:04.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.501+0000 7f7dce7fc640 1 --2- 172.21.15.53:0/464734401 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7dc00662b0 0x7f7dc0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:04.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.501+0000 7f7dce7fc640 1 -- 172.21.15.53:0/464734401 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6221+0+0 (secure 0 0 0) 0x7f7dd411e480 con 0x7f7ddc14afa0 2023-06-10T19:00:04.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.501+0000 7f7de1a67640 1 --2- 172.21.15.53:0/464734401 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7dc00662b0 0x7f7dc0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:04.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.505+0000 7f7de1a67640 1 --2- 172.21.15.53:0/464734401 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7dc00662b0 0x7f7dc0068760 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f7dd00012c0 tx=0x7f7dd0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:04.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.505+0000 7f7dce7fc640 1 -- 172.21.15.53:0/464734401 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7dd40eb980 con 0x7f7ddc14afa0 2023-06-10T19:00:04.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.661+0000 7f7de3ccb640 1 -- 172.21.15.53:0/464734401 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7ddc04d790 con 0x7f7ddc14afa0 2023-06-10T19:00:04.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.661+0000 7f7dce7fc640 1 -- 172.21.15.53:0/464734401 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v68) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7dd4009de0 con 0x7f7ddc14afa0 2023-06-10T19:00:04.665 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-06-10T19:00:04.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.661+0000 7f7de3ccb640 1 -- 172.21.15.53:0/464734401 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7dc00662b0 msgr2=0x7f7dc0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:04.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.661+0000 7f7de3ccb640 1 --2- 172.21.15.53:0/464734401 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7dc00662b0 0x7f7dc0068760 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f7dd00012c0 tx=0x7f7dd0009040 comp rx=0 tx=0).stop 2023-06-10T19:00:04.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.661+0000 7f7de3ccb640 1 -- 172.21.15.53:0/464734401 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ddc14afa0 msgr2=0x7f7ddc14b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:04.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.661+0000 7f7de3ccb640 1 --2- 172.21.15.53:0/464734401 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ddc14afa0 0x7f7ddc14b440 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f7dd400e350 tx=0x7f7dd4009750 comp rx=0 tx=0).stop 2023-06-10T19:00:04.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.661+0000 7f7de3ccb640 1 -- 172.21.15.53:0/464734401 shutdown_connections 2023-06-10T19:00:04.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.661+0000 7f7de3ccb640 1 --2- 172.21.15.53:0/464734401 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7dc00662b0 0x7f7dc0068760 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:04.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.661+0000 7f7de3ccb640 1 --2- 172.21.15.53:0/464734401 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ddc14afa0 0x7f7ddc14b440 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:04.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.661+0000 7f7de3ccb640 1 --2- 172.21.15.53:0/464734401 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ddc0afe00 0x7f7ddc0c7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:04.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.661+0000 7f7de3ccb640 1 --2- 172.21.15.53:0/464734401 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ddc0afa30 0x7f7ddc148940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:04.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.661+0000 7f7de3ccb640 1 -- 172.21.15.53:0/464734401 >> 172.21.15.53:0/464734401 conn(0x7f7ddc06a0e0 msgr2=0x7f7ddc0ca6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:04.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.661+0000 7f7de3ccb640 1 -- 172.21.15.53:0/464734401 shutdown_connections 2023-06-10T19:00:04.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.661+0000 7f7de3ccb640 1 -- 172.21.15.53:0/464734401 wait complete. 2023-06-10T19:00:04.685 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-10T19:00:04.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.805+0000 7ff26d65d640 1 Processor -- start 2023-06-10T19:00:04.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.805+0000 7ff26d65d640 1 -- start start 2023-06-10T19:00:04.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.809+0000 7ff26d65d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff26815c070 0x7ff26815c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:04.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.809+0000 7ff26d65d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff26806b800 0x7ff26806bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:04.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.809+0000 7ff26d65d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff26806b090 con 0x7ff268156180 2023-06-10T19:00:04.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.809+0000 7ff26d65d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff26815ca30 con 0x7ff26815c070 2023-06-10T19:00:04.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.809+0000 7ff26d65d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff26806efa0 con 0x7ff26806b800 2023-06-10T19:00:04.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.809+0000 7ff2667fc640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff26815c070 0x7ff26815c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:04.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.809+0000 7ff2677fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff26806b800 0x7ff26806bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:04.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.809+0000 7ff2677fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff26806b800 0x7ff26806bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.53:44662/0 (socket says 172.21.15.53:44662) 2023-06-10T19:00:04.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.809+0000 7ff2677fe640 1 -- 172.21.15.53:0/3052080838 learned_addr learned my addr 172.21.15.53:0/3052080838 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:04.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.809+0000 7ff2667fc640 1 -- 172.21.15.53:0/3052080838 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff26806b800 msgr2=0x7ff26806bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:04.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.809+0000 7ff2667fc640 1 --2- 172.21.15.53:0/3052080838 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff26806b800 0x7ff26806bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:04.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.809+0000 7ff2667fc640 1 -- 172.21.15.53:0/3052080838 >> v1:172.21.15.117:6789/0 conn(0x7ff268156180 legacy=0x7ff2680cd4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:04.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.809+0000 7ff2667fc640 1 -- 172.21.15.53:0/3052080838 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2680cc720 con 0x7ff26815c070 2023-06-10T19:00:04.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.809+0000 7ff2667fc640 1 --2- 172.21.15.53:0/3052080838 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff26815c070 0x7ff26815c4f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff25c0097c0 tx=0x7ff25c01c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e06b862864bef7e5 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:04.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.813+0000 7ff265ffb640 1 -- 172.21.15.53:0/3052080838 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff25c0ab600 con 0x7ff26815c070 2023-06-10T19:00:04.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.813+0000 7ff265ffb640 1 -- 172.21.15.53:0/3052080838 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff25c0a7050 con 0x7ff26815c070 2023-06-10T19:00:04.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.813+0000 7ff265ffb640 1 -- 172.21.15.53:0/3052080838 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff25c0ab980 con 0x7ff26815c070 2023-06-10T19:00:04.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.813+0000 7ff26d65d640 1 -- 172.21.15.53:0/3052080838 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff26815c070 msgr2=0x7ff26815c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:04.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.813+0000 7ff26d65d640 1 --2- 172.21.15.53:0/3052080838 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff26815c070 0x7ff26815c4f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff25c0097c0 tx=0x7ff25c01c480 comp rx=0 tx=0).stop 2023-06-10T19:00:04.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.813+0000 7ff26d65d640 1 -- 172.21.15.53:0/3052080838 shutdown_connections 2023-06-10T19:00:04.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.813+0000 7ff26d65d640 1 --2- 172.21.15.53:0/3052080838 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff26806b800 0x7ff26806bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:04.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.813+0000 7ff26d65d640 1 --2- 172.21.15.53:0/3052080838 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff26815c070 0x7ff26815c4f0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:04.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.813+0000 7ff26d65d640 1 -- 172.21.15.53:0/3052080838 >> 172.21.15.53:0/3052080838 conn(0x7ff26806a0e0 msgr2=0x7ff2680cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:04.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.813+0000 7ff26d65d640 1 -- 172.21.15.53:0/3052080838 shutdown_connections 2023-06-10T19:00:04.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.813+0000 7ff26d65d640 1 -- 172.21.15.53:0/3052080838 wait complete. 2023-06-10T19:00:04.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.813+0000 7ff26d65d640 1 Processor -- start 2023-06-10T19:00:04.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.813+0000 7ff26d65d640 1 -- start start 2023-06-10T19:00:04.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.813+0000 7ff26d65d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff26806b800 0x7ff26815a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:04.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.813+0000 7ff26d65d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff268156180 0x7ff2681493d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:04.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.813+0000 7ff26d65d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff26815c070 0x7ff26814f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:04.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.813+0000 7ff26d65d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff26814bd90 con 0x7ff268156180 2023-06-10T19:00:04.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.813+0000 7ff26d65d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff26814aeb0 con 0x7ff26806b800 2023-06-10T19:00:04.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.813+0000 7ff26d65d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff26815ab00 con 0x7ff26815c070 2023-06-10T19:00:04.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.813+0000 7ff2667fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff268156180 0x7ff2681493d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:04.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.813+0000 7ff2667fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff268156180 0x7ff2681493d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48876/0 (socket says 172.21.15.53:48876) 2023-06-10T19:00:04.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.813+0000 7ff2667fc640 1 -- 172.21.15.53:0/1397192521 learned_addr learned my addr 172.21.15.53:0/1397192521 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:04.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.817+0000 7ff2677fe640 1 --2- 172.21.15.53:0/1397192521 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff26815c070 0x7ff26814f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:04.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.817+0000 7ff266ffd640 1 --2- 172.21.15.53:0/1397192521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff26806b800 0x7ff26815a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:04.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.817+0000 7ff2667fc640 1 -- 172.21.15.53:0/1397192521 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff26815c070 msgr2=0x7ff26814f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:04.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.817+0000 7ff2667fc640 1 --2- 172.21.15.53:0/1397192521 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff26815c070 0x7ff26814f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:04.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.817+0000 7ff2667fc640 1 -- 172.21.15.53:0/1397192521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff26806b800 msgr2=0x7ff26815a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:04.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.817+0000 7ff2667fc640 1 --2- 172.21.15.53:0/1397192521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff26806b800 0x7ff26815a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:04.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.817+0000 7ff2667fc640 1 -- 172.21.15.53:0/1397192521 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff25c009420 con 0x7ff268156180 2023-06-10T19:00:04.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.817+0000 7ff2667fc640 1 --2- 172.21.15.53:0/1397192521 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff268156180 0x7ff2681493d0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7ff25c01a0b0 tx=0x7ff25c019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:04.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.817+0000 7ff24f7fe640 1 -- 172.21.15.53:0/1397192521 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff25c006e20 con 0x7ff268156180 2023-06-10T19:00:04.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.817+0000 7ff24f7fe640 1 -- 172.21.15.53:0/1397192521 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff25c0b4400 con 0x7ff268156180 2023-06-10T19:00:04.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.817+0000 7ff26d65d640 1 -- 172.21.15.53:0/1397192521 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff26815ad30 con 0x7ff268156180 2023-06-10T19:00:04.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.817+0000 7ff24f7fe640 1 -- 172.21.15.53:0/1397192521 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff25c0b47b0 con 0x7ff268156180 2023-06-10T19:00:04.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.817+0000 7ff26d65d640 1 -- 172.21.15.53:0/1397192521 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2680abce0 con 0x7ff268156180 2023-06-10T19:00:04.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.817+0000 7ff26d65d640 1 -- 172.21.15.53:0/1397192521 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2680ab860 con 0x7ff268156180 2023-06-10T19:00:04.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.817+0000 7ff24f7fe640 1 -- 172.21.15.53:0/1397192521 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff25c0b2040 con 0x7ff268156180 2023-06-10T19:00:04.824 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.817+0000 7ff24f7fe640 1 --2- 172.21.15.53:0/1397192521 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff254066280 0x7ff254068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:04.824 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.817+0000 7ff24f7fe640 1 -- 172.21.15.53:0/1397192521 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6221+0+0 (secure 0 0 0) 0x7ff25c11dc30 con 0x7ff268156180 2023-06-10T19:00:04.824 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.817+0000 7ff266ffd640 1 --2- 172.21.15.53:0/1397192521 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff254066280 0x7ff254068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:04.824 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.817+0000 7ff266ffd640 1 --2- 172.21.15.53:0/1397192521 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff254066280 0x7ff254068730 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7ff258001650 tx=0x7ff258009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:04.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.821+0000 7ff24f7fe640 1 -- 172.21.15.53:0/1397192521 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff2680ab860 con 0x7ff268156180 2023-06-10T19:00:04.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.969+0000 7ff26d65d640 1 -- 172.21.15.53:0/1397192521 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff2680ab860 con 0x7ff268156180 2023-06-10T19:00:04.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.969+0000 7ff24f7fe640 1 -- 172.21.15.53:0/1397192521 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v68) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff2680ab860 con 0x7ff268156180 2023-06-10T19:00:04.976 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-06-10T19:00:04.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.973+0000 7ff26d65d640 1 -- 172.21.15.53:0/1397192521 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff254066280 msgr2=0x7ff254068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:04.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.973+0000 7ff26d65d640 1 --2- 172.21.15.53:0/1397192521 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff254066280 0x7ff254068730 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7ff258001650 tx=0x7ff258009040 comp rx=0 tx=0).stop 2023-06-10T19:00:04.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.973+0000 7ff26d65d640 1 -- 172.21.15.53:0/1397192521 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff268156180 msgr2=0x7ff2681493d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:04.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.973+0000 7ff26d65d640 1 --2- 172.21.15.53:0/1397192521 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff268156180 0x7ff2681493d0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7ff25c01a0b0 tx=0x7ff25c019220 comp rx=0 tx=0).stop 2023-06-10T19:00:04.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.973+0000 7ff26d65d640 1 -- 172.21.15.53:0/1397192521 shutdown_connections 2023-06-10T19:00:04.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.973+0000 7ff26d65d640 1 --2- 172.21.15.53:0/1397192521 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff254066280 0x7ff254068730 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:04.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.973+0000 7ff26d65d640 1 --2- 172.21.15.53:0/1397192521 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff26815c070 0x7ff26814f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:04.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.973+0000 7ff26d65d640 1 --2- 172.21.15.53:0/1397192521 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff268156180 0x7ff2681493d0 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:04.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.973+0000 7ff26d65d640 1 --2- 172.21.15.53:0/1397192521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff26806b800 0x7ff26815a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:04.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.973+0000 7ff26d65d640 1 -- 172.21.15.53:0/1397192521 >> 172.21.15.53:0/1397192521 conn(0x7ff26806a0e0 msgr2=0x7ff268070b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:04.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.973+0000 7ff26d65d640 1 -- 172.21.15.53:0/1397192521 shutdown_connections 2023-06-10T19:00:04.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:04.973+0000 7ff26d65d640 1 -- 172.21.15.53:0/1397192521 wait complete. 2023-06-10T19:00:04.993 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-10T19:00:05.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.105+0000 7fcccc7bb640 1 Processor -- start 2023-06-10T19:00:05.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.105+0000 7fcccc7bb640 1 -- start start 2023-06-10T19:00:05.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.105+0000 7fcccc7bb640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fccc4070de0 0x7fccc415cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:05.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.105+0000 7fcccc7bb640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fccc40cc020 0x7fccc406bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:05.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.105+0000 7fcccc7bb640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccc40cc460 con 0x7fccc415c060 2023-06-10T19:00:05.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.105+0000 7fcccc7bb640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccc40c8d50 con 0x7fccc40cc020 2023-06-10T19:00:05.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.105+0000 7fcccc7bb640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccc40c9030 con 0x7fccc4070de0 2023-06-10T19:00:05.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.105+0000 7fccca557640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fccc415c060 0x7fccc415c430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:33564/0 (socket says 172.21.15.53:33564) 2023-06-10T19:00:05.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.105+0000 7fccca557640 1 -- 172.21.15.53:0/3948632958 learned_addr learned my addr 172.21.15.53:0/3948632958 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:00:05.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.105+0000 7fcccad58640 1 --2- 172.21.15.53:0/3948632958 >> v2:172.21.15.117:3300/0 conn(0x7fccc40cc020 0x7fccc406bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:05.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.105+0000 7fccc9555640 1 -- 172.21.15.53:0/3948632958 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3898477251 0 0) 0x7fccc40cc460 con 0x7fccc415c060 2023-06-10T19:00:05.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.105+0000 7fccc9d56640 1 --2- 172.21.15.53:0/3948632958 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fccc4070de0 0x7fccc415cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:05.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.105+0000 7fccc9555640 1 -- 172.21.15.53:0/3948632958 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fccb0003530 con 0x7fccc415c060 2023-06-10T19:00:05.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.105+0000 7fccc9555640 1 -- 172.21.15.53:0/3948632958 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 317885426 0 0) 0x7fccb0003530 con 0x7fccc415c060 2023-06-10T19:00:05.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.105+0000 7fccc9555640 1 -- 172.21.15.53:0/3948632958 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fccc4070de0 msgr2=0x7fccc415cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:05.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.105+0000 7fccc9555640 1 --2- 172.21.15.53:0/3948632958 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fccc4070de0 0x7fccc415cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:05.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.105+0000 7fccc9555640 1 -- 172.21.15.53:0/3948632958 >> v2:172.21.15.117:3300/0 conn(0x7fccc40cc020 msgr2=0x7fccc406bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:05.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.105+0000 7fccc9555640 1 --2- 172.21.15.53:0/3948632958 >> v2:172.21.15.117:3300/0 conn(0x7fccc40cc020 0x7fccc406bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:05.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.105+0000 7fccc9555640 1 -- 172.21.15.53:0/3948632958 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccc4070300 con 0x7fccc415c060 2023-06-10T19:00:05.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.105+0000 7fccc9555640 1 -- 172.21.15.53:0/3948632958 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fccc0001680 con 0x7fccc415c060 2023-06-10T19:00:05.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.105+0000 7fccc9555640 1 -- 172.21.15.53:0/3948632958 >> v1:172.21.15.53:6789/0 conn(0x7fccc415c060 legacy=0x7fccc415c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:05.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.105+0000 7fccc9555640 1 --2- 172.21.15.53:0/3948632958 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fccb0003980 0x7fccb0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:05.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.105+0000 7fccc9555640 1 --2- 172.21.15.53:0/3948632958 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fccb00043b0 0x7fccb0004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:05.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.105+0000 7fccc9555640 1 --2- 172.21.15.53:0/3948632958 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fccc4070de0 0x7fccb0004fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:05.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.105+0000 7fccc9555640 1 -- 172.21.15.53:0/3948632958 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc40c8d50 con 0x7fccb0003980 2023-06-10T19:00:05.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.105+0000 7fccc9555640 1 -- 172.21.15.53:0/3948632958 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc40c9030 con 0x7fccb00043b0 2023-06-10T19:00:05.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.105+0000 7fccc9555640 1 -- 172.21.15.53:0/3948632958 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccb000b990 con 0x7fccc4070de0 2023-06-10T19:00:05.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.105+0000 7fccca557640 1 --2- 172.21.15.53:0/3948632958 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fccb0003980 0x7fccb0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:05.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.105+0000 7fccc9d56640 1 --2- 172.21.15.53:0/3948632958 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fccb00043b0 0x7fccb0004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:05.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.105+0000 7fcccad58640 1 --2- 172.21.15.53:0/3948632958 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fccc4070de0 0x7fccb0004fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:05.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.105+0000 7fccca557640 1 -- 172.21.15.53:0/3948632958 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fccc4070de0 msgr2=0x7fccb0004fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:05.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.105+0000 7fccca557640 1 --2- 172.21.15.53:0/3948632958 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fccc4070de0 0x7fccb0004fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:05.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.105+0000 7fccca557640 1 -- 172.21.15.53:0/3948632958 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fccb00043b0 msgr2=0x7fccb0004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:05.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.105+0000 7fccca557640 1 --2- 172.21.15.53:0/3948632958 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fccb00043b0 0x7fccb0004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:05.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.105+0000 7fccca557640 1 -- 172.21.15.53:0/3948632958 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccb0003530 con 0x7fccb0003980 2023-06-10T19:00:05.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.105+0000 7fccc9d56640 1 --2- 172.21.15.53:0/3948632958 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fccb00043b0 0x7fccb0004870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:00:05.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.105+0000 7fcccad58640 1 --2- 172.21.15.53:0/3948632958 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fccc4070de0 0x7fccb0004fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:00:05.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.109+0000 7fccca557640 1 --2- 172.21.15.53:0/3948632958 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fccb0003980 0x7fccb0003d90 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fccc000c2c0 tx=0x7fccc001cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89506194d32d8ad1 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:05.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.109+0000 7fccc9555640 1 -- 172.21.15.53:0/3948632958 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc00058e0 con 0x7fccb0003980 2023-06-10T19:00:05.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.113+0000 7fccc9555640 1 -- 172.21.15.53:0/3948632958 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccc0005a40 con 0x7fccb0003980 2023-06-10T19:00:05.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.113+0000 7fccc9555640 1 -- 172.21.15.53:0/3948632958 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc0005df0 con 0x7fccb0003980 2023-06-10T19:00:05.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.113+0000 7fcccc7bb640 1 -- 172.21.15.53:0/3948632958 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fccb0003980 msgr2=0x7fccb0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:05.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.113+0000 7fcccc7bb640 1 --2- 172.21.15.53:0/3948632958 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fccb0003980 0x7fccb0003d90 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fccc000c2c0 tx=0x7fccc001cc90 comp rx=0 tx=0).stop 2023-06-10T19:00:05.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.113+0000 7fcccad58640 1 -- 172.21.15.53:0/3948632958 reap_dead start 2023-06-10T19:00:05.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.113+0000 7fcccc7bb640 1 -- 172.21.15.53:0/3948632958 shutdown_connections 2023-06-10T19:00:05.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.113+0000 7fcccc7bb640 1 -- 172.21.15.53:0/3948632958 >> 172.21.15.53:0/3948632958 conn(0x7fccc406a0e0 msgr2=0x7fccc40cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:05.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.113+0000 7fcccc7bb640 1 -- 172.21.15.53:0/3948632958 shutdown_connections 2023-06-10T19:00:05.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.113+0000 7fcccc7bb640 1 -- 172.21.15.53:0/3948632958 wait complete. 2023-06-10T19:00:05.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.113+0000 7fcccc7bb640 1 Processor -- start 2023-06-10T19:00:05.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.113+0000 7fcccc7bb640 1 -- start start 2023-06-10T19:00:05.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.113+0000 7fcccc7bb640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fccc414f1f0 0x7fccc4156f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:05.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.113+0000 7fcccc7bb640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fccc41574b0 0x7fccc4154fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:05.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.113+0000 7fcccc7bb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fccc40b2030 0x7fccc4155500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:05.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.113+0000 7fcccc7bb640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc40b3a90 con 0x7fccc40b2030 2023-06-10T19:00:05.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.113+0000 7fcccc7bb640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc40b2f10 con 0x7fccc414f1f0 2023-06-10T19:00:05.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.113+0000 7fcccc7bb640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccc40b31f0 con 0x7fccc41574b0 2023-06-10T19:00:05.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.113+0000 7fcccad58640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fccc40b2030 0x7fccc4155500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:05.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.113+0000 7fcccad58640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fccc40b2030 0x7fccc4155500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48900/0 (socket says 172.21.15.53:48900) 2023-06-10T19:00:05.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.113+0000 7fcccad58640 1 -- 172.21.15.53:0/269374495 learned_addr learned my addr 172.21.15.53:0/269374495 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:05.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.113+0000 7fccc9d56640 1 --2- 172.21.15.53:0/269374495 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fccc41574b0 0x7fccc4154fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:05.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.113+0000 7fccca557640 1 --2- 172.21.15.53:0/269374495 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fccc414f1f0 0x7fccc4156f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:05.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.113+0000 7fcccad58640 1 -- 172.21.15.53:0/269374495 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fccc41574b0 msgr2=0x7fccc4154fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:05.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.113+0000 7fcccad58640 1 --2- 172.21.15.53:0/269374495 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fccc41574b0 0x7fccc4154fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:05.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.113+0000 7fcccad58640 1 -- 172.21.15.53:0/269374495 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fccc414f1f0 msgr2=0x7fccc4156f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:05.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.113+0000 7fcccad58640 1 --2- 172.21.15.53:0/269374495 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fccc414f1f0 0x7fccc4156f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:05.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.113+0000 7fcccad58640 1 -- 172.21.15.53:0/269374495 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccc40b34d0 con 0x7fccc40b2030 2023-06-10T19:00:05.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.113+0000 7fccc9d56640 1 --2- 172.21.15.53:0/269374495 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fccc41574b0 0x7fccc4154fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:00:05.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.113+0000 7fcccad58640 1 --2- 172.21.15.53:0/269374495 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fccc40b2030 0x7fccc4155500 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fccc415bfc0 tx=0x7fccbc007e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:05.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.113+0000 7fccbaffd640 1 -- 172.21.15.53:0/269374495 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccbc01b070 con 0x7fccc40b2030 2023-06-10T19:00:05.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.113+0000 7fccbaffd640 1 -- 172.21.15.53:0/269374495 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccbc00f040 con 0x7fccc40b2030 2023-06-10T19:00:05.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.113+0000 7fcccc7bb640 1 -- 172.21.15.53:0/269374495 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccc40b37b0 con 0x7fccc40b2030 2023-06-10T19:00:05.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.113+0000 7fccbaffd640 1 -- 172.21.15.53:0/269374495 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccbc00e050 con 0x7fccc40b2030 2023-06-10T19:00:05.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.113+0000 7fcccc7bb640 1 -- 172.21.15.53:0/269374495 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccc414f790 con 0x7fccc40b2030 2023-06-10T19:00:05.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.117+0000 7fcccc7bb640 1 -- 172.21.15.53:0/269374495 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccc404d790 con 0x7fccc40b2030 2023-06-10T19:00:05.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.117+0000 7fccbaffd640 1 -- 172.21.15.53:0/269374495 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fccbc003be0 con 0x7fccc40b2030 2023-06-10T19:00:05.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.117+0000 7fccbaffd640 1 --2- 172.21.15.53:0/269374495 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcca8066280 0x7fcca8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:05.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.117+0000 7fccbaffd640 1 -- 172.21.15.53:0/269374495 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6221+0+0 (secure 0 0 0) 0x7fccbc083cf0 con 0x7fccc40b2030 2023-06-10T19:00:05.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.117+0000 7fccca557640 1 --2- 172.21.15.53:0/269374495 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcca8066280 0x7fcca8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:05.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.117+0000 7fccca557640 1 --2- 172.21.15.53:0/269374495 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcca8066280 0x7fcca8068730 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fccc00aa000 tx=0x7fccc0001a10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:05.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.121+0000 7fccbaffd640 1 -- 172.21.15.53:0/269374495 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fccbc051040 con 0x7fccc40b2030 2023-06-10T19:00:05.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.269+0000 7fcccc7bb640 1 -- 172.21.15.53:0/269374495 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fccc415d7b0 con 0x7fccc40b2030 2023-06-10T19:00:05.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.269+0000 7fccbaffd640 1 -- 172.21.15.53:0/269374495 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v68) v1 ==== 104+0+11 (secure 0 0 0) 0x7fccbc054660 con 0x7fccc40b2030 2023-06-10T19:00:05.273 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-06-10T19:00:05.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.269+0000 7fcccc7bb640 1 -- 172.21.15.53:0/269374495 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcca8066280 msgr2=0x7fcca8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:05.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.269+0000 7fcccc7bb640 1 --2- 172.21.15.53:0/269374495 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcca8066280 0x7fcca8068730 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fccc00aa000 tx=0x7fccc0001a10 comp rx=0 tx=0).stop 2023-06-10T19:00:05.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.269+0000 7fcccc7bb640 1 -- 172.21.15.53:0/269374495 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fccc40b2030 msgr2=0x7fccc4155500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:05.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.269+0000 7fcccc7bb640 1 --2- 172.21.15.53:0/269374495 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fccc40b2030 0x7fccc4155500 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fccc415bfc0 tx=0x7fccbc007e40 comp rx=0 tx=0).stop 2023-06-10T19:00:05.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.269+0000 7fcccc7bb640 1 -- 172.21.15.53:0/269374495 shutdown_connections 2023-06-10T19:00:05.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.269+0000 7fcccc7bb640 1 --2- 172.21.15.53:0/269374495 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcca8066280 0x7fcca8068730 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:05.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.269+0000 7fcccc7bb640 1 --2- 172.21.15.53:0/269374495 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fccc40b2030 0x7fccc4155500 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:05.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.269+0000 7fcccc7bb640 1 --2- 172.21.15.53:0/269374495 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fccc41574b0 0x7fccc4154fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:05.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.269+0000 7fcccc7bb640 1 --2- 172.21.15.53:0/269374495 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fccc414f1f0 0x7fccc4156f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:05.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.269+0000 7fcccc7bb640 1 -- 172.21.15.53:0/269374495 >> 172.21.15.53:0/269374495 conn(0x7fccc406a0e0 msgr2=0x7fccc4153050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:05.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.269+0000 7fcccc7bb640 1 -- 172.21.15.53:0/269374495 shutdown_connections 2023-06-10T19:00:05.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.269+0000 7fcccc7bb640 1 -- 172.21.15.53:0/269374495 wait complete. 2023-06-10T19:00:05.290 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-10T19:00:05.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.401+0000 7ff94f999640 1 Processor -- start 2023-06-10T19:00:05.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.401+0000 7ff94f999640 1 -- start start 2023-06-10T19:00:05.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.401+0000 7ff94f999640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff9480c97d0 0x7ff9480cb820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:05.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.401+0000 7ff94f999640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9480af760 0x7ff9480afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:05.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.401+0000 7ff94f999640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9480ac910 con 0x7ff94806c350 2023-06-10T19:00:05.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.401+0000 7ff94f999640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9480ca5c0 con 0x7ff9480c97d0 2023-06-10T19:00:05.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.401+0000 7ff94f999640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9480b0120 con 0x7ff9480af760 2023-06-10T19:00:05.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.401+0000 7ff94cf34640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ff94806c350 0x7ff9480ac200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:33568/0 (socket says 172.21.15.53:33568) 2023-06-10T19:00:05.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.401+0000 7ff94cf34640 1 -- 172.21.15.53:0/1198855508 learned_addr learned my addr 172.21.15.53:0/1198855508 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:00:05.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.401+0000 7ff94d735640 1 --2- 172.21.15.53:0/1198855508 >> v2:172.21.15.117:3300/0 conn(0x7ff9480c97d0 0x7ff9480cb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:05.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.401+0000 7ff94df36640 1 --2- 172.21.15.53:0/1198855508 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9480af760 0x7ff9480afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:05.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.401+0000 7ff93ffff640 1 -- 172.21.15.53:0/1198855508 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1382688665 0 0) 0x7ff9480ac910 con 0x7ff94806c350 2023-06-10T19:00:05.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.401+0000 7ff93ffff640 1 -- 172.21.15.53:0/1198855508 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff934003530 con 0x7ff94806c350 2023-06-10T19:00:05.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.401+0000 7ff93ffff640 1 -- 172.21.15.53:0/1198855508 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 43610189 0 0) 0x7ff934003530 con 0x7ff94806c350 2023-06-10T19:00:05.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.401+0000 7ff93ffff640 1 -- 172.21.15.53:0/1198855508 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9480af760 msgr2=0x7ff9480afbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:05.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.401+0000 7ff93ffff640 1 --2- 172.21.15.53:0/1198855508 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9480af760 0x7ff9480afbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:05.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.401+0000 7ff93ffff640 1 -- 172.21.15.53:0/1198855508 >> v2:172.21.15.117:3300/0 conn(0x7ff9480c97d0 msgr2=0x7ff9480cb820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:05.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.401+0000 7ff93ffff640 1 --2- 172.21.15.53:0/1198855508 >> v2:172.21.15.117:3300/0 conn(0x7ff9480c97d0 0x7ff9480cb820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:05.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.401+0000 7ff93ffff640 1 -- 172.21.15.53:0/1198855508 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9480cbd60 con 0x7ff94806c350 2023-06-10T19:00:05.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.401+0000 7ff93ffff640 1 -- 172.21.15.53:0/1198855508 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7ff938001680 con 0x7ff94806c350 2023-06-10T19:00:05.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.401+0000 7ff93ffff640 1 -- 172.21.15.53:0/1198855508 >> v1:172.21.15.53:6789/0 conn(0x7ff94806c350 legacy=0x7ff9480ac200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:05.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.401+0000 7ff93ffff640 1 --2- 172.21.15.53:0/1198855508 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff934003980 0x7ff934003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:05.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.401+0000 7ff93ffff640 1 --2- 172.21.15.53:0/1198855508 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9340047d0 0x7ff934004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:05.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.401+0000 7ff93ffff640 1 --2- 172.21.15.53:0/1198855508 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9480af760 0x7ff934005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:05.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.401+0000 7ff93ffff640 1 -- 172.21.15.53:0/1198855508 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9480ca5c0 con 0x7ff934003980 2023-06-10T19:00:05.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.401+0000 7ff93ffff640 1 -- 172.21.15.53:0/1198855508 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9480b0120 con 0x7ff9340047d0 2023-06-10T19:00:05.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.401+0000 7ff93ffff640 1 -- 172.21.15.53:0/1198855508 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff93400ba40 con 0x7ff9480af760 2023-06-10T19:00:05.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.401+0000 7ff94d735640 1 --2- 172.21.15.53:0/1198855508 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff934003980 0x7ff934003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:05.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.401+0000 7ff94cf34640 1 --2- 172.21.15.53:0/1198855508 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9340047d0 0x7ff934004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:05.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.401+0000 7ff94df36640 1 --2- 172.21.15.53:0/1198855508 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9480af760 0x7ff934005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:05.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.401+0000 7ff94d735640 1 -- 172.21.15.53:0/1198855508 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9480af760 msgr2=0x7ff934005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:05.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.401+0000 7ff94d735640 1 --2- 172.21.15.53:0/1198855508 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9480af760 0x7ff934005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:05.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.401+0000 7ff94d735640 1 -- 172.21.15.53:0/1198855508 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9340047d0 msgr2=0x7ff934004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:05.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.401+0000 7ff94d735640 1 --2- 172.21.15.53:0/1198855508 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9340047d0 0x7ff934004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:05.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.401+0000 7ff94d735640 1 -- 172.21.15.53:0/1198855508 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff934003530 con 0x7ff934003980 2023-06-10T19:00:05.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.405+0000 7ff94d735640 1 --2- 172.21.15.53:0/1198855508 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff934003980 0x7ff934003d90 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7ff944009fc0 tx=0x7ff94401cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f4360fc041ca6ce server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:05.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.405+0000 7ff93ffff640 1 -- 172.21.15.53:0/1198855508 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9440a5a90 con 0x7ff934003980 2023-06-10T19:00:05.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.405+0000 7ff93ffff640 1 -- 172.21.15.53:0/1198855508 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff94400f040 con 0x7ff934003980 2023-06-10T19:00:05.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.405+0000 7ff93ffff640 1 -- 172.21.15.53:0/1198855508 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9440a5e30 con 0x7ff934003980 2023-06-10T19:00:05.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.405+0000 7ff94f999640 1 -- 172.21.15.53:0/1198855508 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff934003980 msgr2=0x7ff934003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:05.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.405+0000 7ff94f999640 1 --2- 172.21.15.53:0/1198855508 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff934003980 0x7ff934003d90 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7ff944009fc0 tx=0x7ff94401cca0 comp rx=0 tx=0).stop 2023-06-10T19:00:05.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.405+0000 7ff94df36640 1 -- 172.21.15.53:0/1198855508 reap_dead start 2023-06-10T19:00:05.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.405+0000 7ff94f999640 1 -- 172.21.15.53:0/1198855508 shutdown_connections 2023-06-10T19:00:05.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.405+0000 7ff94f999640 1 -- 172.21.15.53:0/1198855508 >> 172.21.15.53:0/1198855508 conn(0x7ff94806a0e0 msgr2=0x7ff9480cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:05.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.405+0000 7ff94f999640 1 -- 172.21.15.53:0/1198855508 shutdown_connections 2023-06-10T19:00:05.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.405+0000 7ff94f999640 1 -- 172.21.15.53:0/1198855508 wait complete. 2023-06-10T19:00:05.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.405+0000 7ff94f999640 1 Processor -- start 2023-06-10T19:00:05.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.405+0000 7ff94f999640 1 -- start start 2023-06-10T19:00:05.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.405+0000 7ff94f999640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff934003980 0x7ff9481554e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:05.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.405+0000 7ff94f999640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9480c5730 0x7ff948153570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:05.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.405+0000 7ff94f999640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff94815c470 0x7ff94815c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:05.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.405+0000 7ff94f999640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9480c5c30 con 0x7ff9480c5730 2023-06-10T19:00:05.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.405+0000 7ff94f999640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9480c5f10 con 0x7ff934003980 2023-06-10T19:00:05.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.405+0000 7ff94f999640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9480c61f0 con 0x7ff94815c470 2023-06-10T19:00:05.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.405+0000 7ff94cf34640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9480c5730 0x7ff948153570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:05.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.405+0000 7ff94cf34640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9480c5730 0x7ff948153570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48928/0 (socket says 172.21.15.53:48928) 2023-06-10T19:00:05.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.405+0000 7ff94cf34640 1 -- 172.21.15.53:0/2358780963 learned_addr learned my addr 172.21.15.53:0/2358780963 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:05.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.405+0000 7ff94d735640 1 --2- 172.21.15.53:0/2358780963 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff934003980 0x7ff9481554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:05.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.405+0000 7ff94df36640 1 --2- 172.21.15.53:0/2358780963 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff94815c470 0x7ff94815c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:05.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.409+0000 7ff94cf34640 1 -- 172.21.15.53:0/2358780963 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff94815c470 msgr2=0x7ff94815c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:05.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.409+0000 7ff94cf34640 1 --2- 172.21.15.53:0/2358780963 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff94815c470 0x7ff94815c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:05.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.409+0000 7ff94cf34640 1 -- 172.21.15.53:0/2358780963 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff934003980 msgr2=0x7ff9481554e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:05.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.409+0000 7ff94cf34640 1 --2- 172.21.15.53:0/2358780963 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff934003980 0x7ff9481554e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:05.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.409+0000 7ff94cf34640 1 -- 172.21.15.53:0/2358780963 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9480c64d0 con 0x7ff9480c5730 2023-06-10T19:00:05.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.409+0000 7ff94df36640 1 --2- 172.21.15.53:0/2358780963 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff94815c470 0x7ff94815c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:00:05.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.409+0000 7ff94cf34640 1 --2- 172.21.15.53:0/2358780963 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9480c5730 0x7ff948153570 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7ff93800e780 tx=0x7ff93800ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:05.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.409+0000 7ff93dffb640 1 -- 172.21.15.53:0/2358780963 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93800c6c0 con 0x7ff9480c5730 2023-06-10T19:00:05.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.409+0000 7ff93dffb640 1 -- 172.21.15.53:0/2358780963 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff93800c820 con 0x7ff9480c5730 2023-06-10T19:00:05.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.409+0000 7ff94f999640 1 -- 172.21.15.53:0/2358780963 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9480c67b0 con 0x7ff9480c5730 2023-06-10T19:00:05.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.409+0000 7ff93dffb640 1 -- 172.21.15.53:0/2358780963 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93800cbd0 con 0x7ff9480c5730 2023-06-10T19:00:05.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.409+0000 7ff94f999640 1 -- 172.21.15.53:0/2358780963 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff948153ab0 con 0x7ff9480c5730 2023-06-10T19:00:05.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.409+0000 7ff94f999640 1 -- 172.21.15.53:0/2358780963 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9480c69d0 con 0x7ff9480c5730 2023-06-10T19:00:05.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.409+0000 7ff93dffb640 1 -- 172.21.15.53:0/2358780963 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff93800cd30 con 0x7ff9480c5730 2023-06-10T19:00:05.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.409+0000 7ff93dffb640 1 --2- 172.21.15.53:0/2358780963 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff92c066280 0x7ff92c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:05.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.409+0000 7ff93dffb640 1 -- 172.21.15.53:0/2358780963 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6221+0+0 (secure 0 0 0) 0x7ff938083b60 con 0x7ff9480c5730 2023-06-10T19:00:05.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.409+0000 7ff94d735640 1 --2- 172.21.15.53:0/2358780963 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff92c066280 0x7ff92c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:05.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.409+0000 7ff94d735640 1 --2- 172.21.15.53:0/2358780963 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff92c066280 0x7ff92c068730 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7ff9440af000 tx=0x7ff9440a7040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:05.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.413+0000 7ff93dffb640 1 -- 172.21.15.53:0/2358780963 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff938054940 con 0x7ff9480c5730 2023-06-10T19:00:05.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.569+0000 7ff94f999640 1 -- 172.21.15.53:0/2358780963 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff9480cbd60 con 0x7ff9480c5730 2023-06-10T19:00:05.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.569+0000 7ff93dffb640 1 -- 172.21.15.53:0/2358780963 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v68) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff9480cbd60 con 0x7ff9480c5730 2023-06-10T19:00:05.572 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-06-10T19:00:05.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.569+0000 7ff94f999640 1 -- 172.21.15.53:0/2358780963 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff92c066280 msgr2=0x7ff92c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:05.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.569+0000 7ff94f999640 1 --2- 172.21.15.53:0/2358780963 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff92c066280 0x7ff92c068730 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7ff9440af000 tx=0x7ff9440a7040 comp rx=0 tx=0).stop 2023-06-10T19:00:05.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.569+0000 7ff94f999640 1 -- 172.21.15.53:0/2358780963 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9480c5730 msgr2=0x7ff948153570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:05.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.569+0000 7ff94f999640 1 --2- 172.21.15.53:0/2358780963 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9480c5730 0x7ff948153570 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7ff93800e780 tx=0x7ff93800ec40 comp rx=0 tx=0).stop 2023-06-10T19:00:05.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.569+0000 7ff94f999640 1 -- 172.21.15.53:0/2358780963 shutdown_connections 2023-06-10T19:00:05.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.569+0000 7ff94f999640 1 --2- 172.21.15.53:0/2358780963 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff92c066280 0x7ff92c068730 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:05.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.569+0000 7ff94f999640 1 --2- 172.21.15.53:0/2358780963 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff94815c470 0x7ff94815c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:05.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.569+0000 7ff94f999640 1 --2- 172.21.15.53:0/2358780963 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9480c5730 0x7ff948153570 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:05.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.569+0000 7ff94f999640 1 --2- 172.21.15.53:0/2358780963 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff934003980 0x7ff9481554e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:05.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.569+0000 7ff94f999640 1 -- 172.21.15.53:0/2358780963 >> 172.21.15.53:0/2358780963 conn(0x7ff94806a0e0 msgr2=0x7ff94806b8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:05.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.569+0000 7ff94f999640 1 -- 172.21.15.53:0/2358780963 shutdown_connections 2023-06-10T19:00:05.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.569+0000 7ff94f999640 1 -- 172.21.15.53:0/2358780963 wait complete. 2023-06-10T19:00:05.591 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-10T19:00:05.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.709+0000 7fbc2a4a6640 1 Processor -- start 2023-06-10T19:00:05.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.709+0000 7fbc2a4a6640 1 -- start start 2023-06-10T19:00:05.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.709+0000 7fbc2a4a6640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbc240cd6d0 0x7fbc240caee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:05.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.709+0000 7fbc2a4a6640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc2406b7a0 con 0x7fbc240af7d0 2023-06-10T19:00:05.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.709+0000 7fbc2a4a6640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc240cdb40 con 0x7fbc2415b900 2023-06-10T19:00:05.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.709+0000 7fbc2a4a6640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc2406a8b0 con 0x7fbc240cd6d0 2023-06-10T19:00:05.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.709+0000 7fbc28a43640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fbc240af7d0 0x7fbc240afbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:33570/0 (socket says 172.21.15.53:33570) 2023-06-10T19:00:05.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.709+0000 7fbc28a43640 1 -- 172.21.15.53:0/984476934 learned_addr learned my addr 172.21.15.53:0/984476934 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:00:05.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.709+0000 7fbc237fe640 1 --2- 172.21.15.53:0/984476934 >> v2:172.21.15.117:3300/0 conn(0x7fbc240cd6d0 0x7fbc240caee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:05.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.709+0000 7fbc22ffd640 1 -- 172.21.15.53:0/984476934 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2670125602 0 0) 0x7fbc2406b7a0 con 0x7fbc240af7d0 2023-06-10T19:00:05.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.709+0000 7fbc22ffd640 1 -- 172.21.15.53:0/984476934 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc0c003530 con 0x7fbc240af7d0 2023-06-10T19:00:05.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.709+0000 7fbc22ffd640 1 -- 172.21.15.53:0/984476934 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1646371837 0 0) 0x7fbc0c003530 con 0x7fbc240af7d0 2023-06-10T19:00:05.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.709+0000 7fbc22ffd640 1 -- 172.21.15.53:0/984476934 >> v2:172.21.15.117:3300/0 conn(0x7fbc240cd6d0 msgr2=0x7fbc240caee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:05.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.709+0000 7fbc22ffd640 1 --2- 172.21.15.53:0/984476934 >> v2:172.21.15.117:3300/0 conn(0x7fbc240cd6d0 0x7fbc240caee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:05.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.709+0000 7fbc22ffd640 1 -- 172.21.15.53:0/984476934 >> v1:172.21.15.117:6789/0 conn(0x7fbc2415b900 legacy=0x7fbc240c83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:05.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.709+0000 7fbc22ffd640 1 -- 172.21.15.53:0/984476934 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc2406ab90 con 0x7fbc240af7d0 2023-06-10T19:00:05.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.709+0000 7fbc22ffd640 1 -- 172.21.15.53:0/984476934 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fbc1c001a00 con 0x7fbc240af7d0 2023-06-10T19:00:05.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.709+0000 7fbc22ffd640 1 -- 172.21.15.53:0/984476934 >> v1:172.21.15.53:6789/0 conn(0x7fbc240af7d0 legacy=0x7fbc240afbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:05.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.709+0000 7fbc22ffd640 1 --2- 172.21.15.53:0/984476934 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc0c003980 0x7fbc0c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:05.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.709+0000 7fbc22ffd640 1 --2- 172.21.15.53:0/984476934 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc0c0047d0 0x7fbc0c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:05.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.709+0000 7fbc22ffd640 1 --2- 172.21.15.53:0/984476934 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc0c005180 0x7fbc0c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:05.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.709+0000 7fbc22ffd640 1 -- 172.21.15.53:0/984476934 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2406a8b0 con 0x7fbc0c0047d0 2023-06-10T19:00:05.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.709+0000 7fbc22ffd640 1 -- 172.21.15.53:0/984476934 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc0c00c000 con 0x7fbc0c003980 2023-06-10T19:00:05.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.709+0000 7fbc22ffd640 1 -- 172.21.15.53:0/984476934 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc0c00c1c0 con 0x7fbc0c005180 2023-06-10T19:00:05.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.709+0000 7fbc237fe640 1 --2- 172.21.15.53:0/984476934 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc0c0047d0 0x7fbc0c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:05.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.709+0000 7fbc23fff640 1 --2- 172.21.15.53:0/984476934 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc0c003980 0x7fbc0c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:05.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.709+0000 7fbc28a43640 1 --2- 172.21.15.53:0/984476934 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc0c005180 0x7fbc0c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:05.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.709+0000 7fbc237fe640 1 -- 172.21.15.53:0/984476934 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc0c005180 msgr2=0x7fbc0c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:05.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.709+0000 7fbc237fe640 1 --2- 172.21.15.53:0/984476934 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc0c005180 0x7fbc0c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:05.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.709+0000 7fbc237fe640 1 -- 172.21.15.53:0/984476934 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc0c003980 msgr2=0x7fbc0c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:05.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.709+0000 7fbc237fe640 1 --2- 172.21.15.53:0/984476934 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc0c003980 0x7fbc0c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:05.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.709+0000 7fbc237fe640 1 -- 172.21.15.53:0/984476934 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc0c003530 con 0x7fbc0c0047d0 2023-06-10T19:00:05.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.709+0000 7fbc28a43640 1 -- 172.21.15.53:0/984476934 reap_dead start 2023-06-10T19:00:05.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.709+0000 7fbc23fff640 1 --2- 172.21.15.53:0/984476934 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc0c003980 0x7fbc0c003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:00:05.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.713+0000 7fbc237fe640 1 --2- 172.21.15.53:0/984476934 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc0c0047d0 0x7fbc0c004c40 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fbc18009ae0 tx=0x7fbc1801ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba62ef1e80fb58e server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:05.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.713+0000 7fbc22ffd640 1 -- 172.21.15.53:0/984476934 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc180a6460 con 0x7fbc0c0047d0 2023-06-10T19:00:05.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.713+0000 7fbc22ffd640 1 -- 172.21.15.53:0/984476934 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc180a65c0 con 0x7fbc0c0047d0 2023-06-10T19:00:05.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.713+0000 7fbc22ffd640 1 -- 172.21.15.53:0/984476934 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc180a6970 con 0x7fbc0c0047d0 2023-06-10T19:00:05.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.713+0000 7fbc2a4a6640 1 -- 172.21.15.53:0/984476934 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc0c0047d0 msgr2=0x7fbc0c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:05.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.713+0000 7fbc2a4a6640 1 --2- 172.21.15.53:0/984476934 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc0c0047d0 0x7fbc0c004c40 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fbc18009ae0 tx=0x7fbc1801ca50 comp rx=0 tx=0).stop 2023-06-10T19:00:05.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.713+0000 7fbc2a4a6640 1 -- 172.21.15.53:0/984476934 shutdown_connections 2023-06-10T19:00:05.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.713+0000 7fbc2a4a6640 1 --2- 172.21.15.53:0/984476934 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc0c0047d0 0x7fbc0c004c40 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:05.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.713+0000 7fbc2a4a6640 1 -- 172.21.15.53:0/984476934 >> 172.21.15.53:0/984476934 conn(0x7fbc240ce9e0 msgr2=0x7fbc240ca7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:05.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.713+0000 7fbc2a4a6640 1 -- 172.21.15.53:0/984476934 shutdown_connections 2023-06-10T19:00:05.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.713+0000 7fbc2a4a6640 1 -- 172.21.15.53:0/984476934 wait complete. 2023-06-10T19:00:05.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.717+0000 7fbc2a4a6640 1 Processor -- start 2023-06-10T19:00:05.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.717+0000 7fbc2a4a6640 1 -- start start 2023-06-10T19:00:05.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.717+0000 7fbc2a4a6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc0c0047d0 0x7fbc240b20f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:05.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.717+0000 7fbc2a4a6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc240b37c0 0x7fbc240b1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:05.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.717+0000 7fbc2a4a6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc24145000 0x7fbc24159630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:05.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.717+0000 7fbc2a4a6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc240b1ad0 con 0x7fbc0c0047d0 2023-06-10T19:00:05.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.717+0000 7fbc2a4a6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc240b2720 con 0x7fbc240b37c0 2023-06-10T19:00:05.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.717+0000 7fbc2a4a6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc240b2a00 con 0x7fbc24145000 2023-06-10T19:00:05.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.717+0000 7fbc23fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc0c0047d0 0x7fbc240b20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:05.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.717+0000 7fbc23fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc0c0047d0 0x7fbc240b20f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48946/0 (socket says 172.21.15.53:48946) 2023-06-10T19:00:05.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.717+0000 7fbc23fff640 1 -- 172.21.15.53:0/3525808444 learned_addr learned my addr 172.21.15.53:0/3525808444 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:05.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.717+0000 7fbc237fe640 1 --2- 172.21.15.53:0/3525808444 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc240b37c0 0x7fbc240b1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:05.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.717+0000 7fbc28a43640 1 --2- 172.21.15.53:0/3525808444 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc24145000 0x7fbc24159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:05.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.717+0000 7fbc23fff640 1 -- 172.21.15.53:0/3525808444 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc24145000 msgr2=0x7fbc24159630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:05.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.717+0000 7fbc23fff640 1 --2- 172.21.15.53:0/3525808444 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc24145000 0x7fbc24159630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:05.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.717+0000 7fbc23fff640 1 -- 172.21.15.53:0/3525808444 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc240b37c0 msgr2=0x7fbc240b1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:05.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.717+0000 7fbc23fff640 1 --2- 172.21.15.53:0/3525808444 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc240b37c0 0x7fbc240b1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:05.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.717+0000 7fbc23fff640 1 -- 172.21.15.53:0/3525808444 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc240b2ce0 con 0x7fbc0c0047d0 2023-06-10T19:00:05.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.717+0000 7fbc237fe640 1 --2- 172.21.15.53:0/3525808444 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc240b37c0 0x7fbc240b1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:00:05.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.717+0000 7fbc23fff640 1 --2- 172.21.15.53:0/3525808444 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc0c0047d0 0x7fbc240b20f0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7fbc14001f10 tx=0x7fbc1400e4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:05.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.717+0000 7fbc20ff9640 1 -- 172.21.15.53:0/3525808444 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc140050d0 con 0x7fbc0c0047d0 2023-06-10T19:00:05.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.717+0000 7fbc20ff9640 1 -- 172.21.15.53:0/3525808444 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc14005230 con 0x7fbc0c0047d0 2023-06-10T19:00:05.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.717+0000 7fbc20ff9640 1 -- 172.21.15.53:0/3525808444 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc14003650 con 0x7fbc0c0047d0 2023-06-10T19:00:05.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.717+0000 7fbc2a4a6640 1 -- 172.21.15.53:0/3525808444 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc240b2fc0 con 0x7fbc0c0047d0 2023-06-10T19:00:05.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.717+0000 7fbc2a4a6640 1 -- 172.21.15.53:0/3525808444 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc24145470 con 0x7fbc0c0047d0 2023-06-10T19:00:05.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.717+0000 7fbc2a4a6640 1 -- 172.21.15.53:0/3525808444 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc24145690 con 0x7fbc0c0047d0 2023-06-10T19:00:05.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.717+0000 7fbc20ff9640 1 -- 172.21.15.53:0/3525808444 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbc140037b0 con 0x7fbc0c0047d0 2023-06-10T19:00:05.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.721+0000 7fbc20ff9640 1 --2- 172.21.15.53:0/3525808444 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbc10066280 0x7fbc10068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:05.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.721+0000 7fbc20ff9640 1 -- 172.21.15.53:0/3525808444 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6221+0+0 (secure 0 0 0) 0x7fbc14083240 con 0x7fbc0c0047d0 2023-06-10T19:00:05.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.721+0000 7fbc237fe640 1 --2- 172.21.15.53:0/3525808444 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbc10066280 0x7fbc10068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:05.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.721+0000 7fbc237fe640 1 --2- 172.21.15.53:0/3525808444 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbc10066280 0x7fbc10068730 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fbc180ad000 tx=0x7fbc180b2040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:05.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.725+0000 7fbc20ff9640 1 -- 172.21.15.53:0/3525808444 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbc14050630 con 0x7fbc0c0047d0 2023-06-10T19:00:05.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.893+0000 7fbc2a4a6640 1 -- 172.21.15.53:0/3525808444 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fbc2404d790 con 0x7fbc0c0047d0 2023-06-10T19:00:05.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.893+0000 7fbc20ff9640 1 -- 172.21.15.53:0/3525808444 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 1 entries v68) v1 ==== 80+0+56 (secure 0 0 0) 0x7fbc14053c50 con 0x7fbc0c0047d0 2023-06-10T19:00:05.898 INFO:teuthology.orchestra.run.smithi053.stdout:192.168.0.1:0/683847329 2023-06-10T19:59:28.260070+0000 2023-06-10T19:00:05.899 INFO:teuthology.orchestra.run.smithi053.stderr:listed 1 entries 2023-06-10T19:00:05.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.897+0000 7fbc2a4a6640 1 -- 172.21.15.53:0/3525808444 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbc10066280 msgr2=0x7fbc10068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:05.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.897+0000 7fbc2a4a6640 1 --2- 172.21.15.53:0/3525808444 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbc10066280 0x7fbc10068730 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fbc180ad000 tx=0x7fbc180b2040 comp rx=0 tx=0).stop 2023-06-10T19:00:05.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.897+0000 7fbc2a4a6640 1 -- 172.21.15.53:0/3525808444 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc0c0047d0 msgr2=0x7fbc240b20f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:05.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.897+0000 7fbc2a4a6640 1 --2- 172.21.15.53:0/3525808444 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc0c0047d0 0x7fbc240b20f0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7fbc14001f10 tx=0x7fbc1400e4d0 comp rx=0 tx=0).stop 2023-06-10T19:00:05.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.897+0000 7fbc2a4a6640 1 -- 172.21.15.53:0/3525808444 shutdown_connections 2023-06-10T19:00:05.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.897+0000 7fbc2a4a6640 1 --2- 172.21.15.53:0/3525808444 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbc10066280 0x7fbc10068730 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:05.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.897+0000 7fbc2a4a6640 1 --2- 172.21.15.53:0/3525808444 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc24145000 0x7fbc24159630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:05.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.897+0000 7fbc2a4a6640 1 --2- 172.21.15.53:0/3525808444 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc240b37c0 0x7fbc240b1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:05.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.897+0000 7fbc2a4a6640 1 --2- 172.21.15.53:0/3525808444 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc0c0047d0 0x7fbc240b20f0 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:05.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.897+0000 7fbc2a4a6640 1 -- 172.21.15.53:0/3525808444 >> 172.21.15.53:0/3525808444 conn(0x7fbc240ce9e0 msgr2=0x7fbc240702d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:05.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.897+0000 7fbc2a4a6640 1 -- 172.21.15.53:0/3525808444 shutdown_connections 2023-06-10T19:00:05.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:05.897+0000 7fbc2a4a6640 1 -- 172.21.15.53:0/3525808444 wait complete. 2023-06-10T19:00:05.919 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi117.front.sepia.ceph.com... 2023-06-10T19:00:05.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:00:05.920 DEBUG:teuthology.orchestra.run.smithi117:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-06-10T19:00:05.933 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi117.stderr:ceph-fuse[44452]: fuse finished with error 0 and tester_r 0 2023-06-10T19:00:05.935 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi117.front.sepia.ceph.com 2023-06-10T19:00:05.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:00:05.935 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-06-10T19:00:06.080 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T19:00:06.080 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:00:06.086 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16345192k,nr_inodes=4086298,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276544k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=407 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276540k,nr_inodes=819135,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276544k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-06-10T19:00:06.087 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi053.front.sepia.ceph.com 2023-06-10T19:00:06.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:00:06.087 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-06-10T19:00:06.132 INFO:teuthology.orchestra.run.smithi053.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-06-10T19:00:06.133 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-10T19:00:06.133 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T19:00:06.134 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:00:06.140 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16342088k,nr_inodes=4085522,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275924k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18845 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275920k,nr_inodes=818980,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275924k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-06-10T19:00:06.140 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi117.front.sepia.ceph.com 2023-06-10T19:00:06.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:00:06.141 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-06-10T19:00:06.186 INFO:teuthology.orchestra.run.smithi117.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-06-10T19:00:06.186 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-10T19:00:06.187 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:00:06.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.313+0000 7f3206946640 1 Processor -- start 2023-06-10T19:00:06.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.313+0000 7f3206946640 1 -- start start 2023-06-10T19:00:06.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.317+0000 7f3206946640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f32000afe30 0x7f320006efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:06.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.317+0000 7f3206946640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f320006bb30 0x7f32000ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:06.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.317+0000 7f3206946640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32000c9e50 con 0x7f3200157e10 2023-06-10T19:00:06.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.317+0000 7f3206946640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32000cd520 con 0x7f32000afe30 2023-06-10T19:00:06.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.317+0000 7f3206946640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32000c82f0 con 0x7f320006bb30 2023-06-10T19:00:06.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.317+0000 7f31fffff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f3200157e10 0x7f32000af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:33578/0 (socket says 172.21.15.53:33578) 2023-06-10T19:00:06.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.317+0000 7f31fffff640 1 -- 172.21.15.53:0/413324158 learned_addr learned my addr 172.21.15.53:0/413324158 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:00:06.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.317+0000 7f31ff7fe640 1 --2- 172.21.15.53:0/413324158 >> v2:172.21.15.53:3300/0 conn(0x7f32000afe30 0x7f320006efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:06.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.317+0000 7f3204ee3640 1 --2- 172.21.15.53:0/413324158 >> v2:172.21.15.117:3300/0 conn(0x7f320006bb30 0x7f32000ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:06.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.317+0000 7f31feffd640 1 -- 172.21.15.53:0/413324158 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2335625306 0 0) 0x7f32000c9e50 con 0x7f3200157e10 2023-06-10T19:00:06.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.317+0000 7f31feffd640 1 -- 172.21.15.53:0/413324158 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31ec003530 con 0x7f3200157e10 2023-06-10T19:00:06.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.317+0000 7f31ff7fe640 1 -- 172.21.15.53:0/413324158 >> v2:172.21.15.117:3300/0 conn(0x7f320006bb30 msgr2=0x7f32000ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:06.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.317+0000 7f31ff7fe640 1 --2- 172.21.15.53:0/413324158 >> v2:172.21.15.117:3300/0 conn(0x7f320006bb30 0x7f32000ccfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:06.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.317+0000 7f31ff7fe640 1 -- 172.21.15.53:0/413324158 >> v1:172.21.15.53:6789/0 conn(0x7f3200157e10 legacy=0x7f32000af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:06.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.317+0000 7f31ff7fe640 1 -- 172.21.15.53:0/413324158 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f320006bf00 con 0x7f32000afe30 2023-06-10T19:00:06.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.317+0000 7f31ff7fe640 1 --2- 172.21.15.53:0/413324158 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32000afe30 0x7f320006efc0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f32000c4cf0 tx=0x7f31e801c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84bcf4a28fd0322c server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:06.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.317+0000 7f31feffd640 1 -- 172.21.15.53:0/413324158 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e80a5780 con 0x7f32000afe30 2023-06-10T19:00:06.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.317+0000 7f31feffd640 1 -- 172.21.15.53:0/413324158 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31e80a58e0 con 0x7f32000afe30 2023-06-10T19:00:06.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.317+0000 7f31feffd640 1 -- 172.21.15.53:0/413324158 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e80a5c70 con 0x7f32000afe30 2023-06-10T19:00:06.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.321+0000 7f3206946640 1 -- 172.21.15.53:0/413324158 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32000afe30 msgr2=0x7f320006efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:06.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.321+0000 7f3206946640 1 --2- 172.21.15.53:0/413324158 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32000afe30 0x7f320006efc0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f32000c4cf0 tx=0x7f31e801c850 comp rx=0 tx=0).stop 2023-06-10T19:00:06.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.321+0000 7f3206946640 1 -- 172.21.15.53:0/413324158 shutdown_connections 2023-06-10T19:00:06.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.321+0000 7f3206946640 1 --2- 172.21.15.53:0/413324158 >> v2:172.21.15.117:3300/0 conn(0x7f320006bb30 0x7f32000ccfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:06.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.321+0000 7f3206946640 1 --2- 172.21.15.53:0/413324158 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32000afe30 0x7f320006efc0 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:06.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.321+0000 7f3206946640 1 -- 172.21.15.53:0/413324158 >> 172.21.15.53:0/413324158 conn(0x7f320006a0d0 msgr2=0x7f32000ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:06.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.321+0000 7f3206946640 1 -- 172.21.15.53:0/413324158 shutdown_connections 2023-06-10T19:00:06.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.321+0000 7f3206946640 1 -- 172.21.15.53:0/413324158 wait complete. 2023-06-10T19:00:06.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.321+0000 7f3206946640 1 Processor -- start 2023-06-10T19:00:06.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.321+0000 7f3206946640 1 -- start start 2023-06-10T19:00:06.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.321+0000 7f3206946640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f320006bb30 0x7f32000c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:06.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.321+0000 7f3206946640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32000afe30 0x7f320014ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:06.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.321+0000 7f3206946640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3200157e10 0x7f320014c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:06.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.321+0000 7f3206946640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f320014f470 con 0x7f320006bb30 2023-06-10T19:00:06.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.321+0000 7f3206946640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3200158490 con 0x7f32000afe30 2023-06-10T19:00:06.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.321+0000 7f3206946640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f320014e690 con 0x7f3200157e10 2023-06-10T19:00:06.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.321+0000 7f31fffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f320006bb30 0x7f32000c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:06.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.321+0000 7f31fffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f320006bb30 0x7f32000c7cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48968/0 (socket says 172.21.15.53:48968) 2023-06-10T19:00:06.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.321+0000 7f31fffff640 1 -- 172.21.15.53:0/1905670239 learned_addr learned my addr 172.21.15.53:0/1905670239 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:06.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.321+0000 7f31fffff640 1 -- 172.21.15.53:0/1905670239 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3200157e10 msgr2=0x7f320014c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:06.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.321+0000 7f31fffff640 1 --2- 172.21.15.53:0/1905670239 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3200157e10 0x7f320014c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:06.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.321+0000 7f31fffff640 1 -- 172.21.15.53:0/1905670239 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32000afe30 msgr2=0x7f320014ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:06.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.321+0000 7f31ff7fe640 1 --2- 172.21.15.53:0/1905670239 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32000afe30 0x7f320014ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:06.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.321+0000 7f31fffff640 1 --2- 172.21.15.53:0/1905670239 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32000afe30 0x7f320014ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:06.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.321+0000 7f31fffff640 1 -- 172.21.15.53:0/1905670239 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e8009a70 con 0x7f320006bb30 2023-06-10T19:00:06.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.321+0000 7f31fffff640 1 --2- 172.21.15.53:0/1905670239 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f320006bb30 0x7f32000c7cf0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f31f800c3c0 tx=0x7f31f800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:06.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.321+0000 7f31fcff9640 1 -- 172.21.15.53:0/1905670239 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f8005cf0 con 0x7f320006bb30 2023-06-10T19:00:06.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.321+0000 7f31fcff9640 1 -- 172.21.15.53:0/1905670239 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31f8005e50 con 0x7f320006bb30 2023-06-10T19:00:06.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.321+0000 7f3206946640 1 -- 172.21.15.53:0/1905670239 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f320014e970 con 0x7f320006bb30 2023-06-10T19:00:06.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.321+0000 7f31fcff9640 1 -- 172.21.15.53:0/1905670239 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f80072f0 con 0x7f320006bb30 2023-06-10T19:00:06.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.321+0000 7f3206946640 1 -- 172.21.15.53:0/1905670239 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f320014c970 con 0x7f320006bb30 2023-06-10T19:00:06.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.325+0000 7f3206946640 1 -- 172.21.15.53:0/1905670239 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f320004d790 con 0x7f320006bb30 2023-06-10T19:00:06.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.325+0000 7f31fcff9640 1 -- 172.21.15.53:0/1905670239 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f31f8007450 con 0x7f320006bb30 2023-06-10T19:00:06.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.325+0000 7f31fcff9640 1 --2- 172.21.15.53:0/1905670239 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f31e00662b0 0x7f31e0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:06.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.325+0000 7f31fcff9640 1 -- 172.21.15.53:0/1905670239 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6221+0+0 (secure 0 0 0) 0x7f31f80832b0 con 0x7f320006bb30 2023-06-10T19:00:06.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.325+0000 7f31ff7fe640 1 --2- 172.21.15.53:0/1905670239 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f31e00662b0 0x7f31e0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:06.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.325+0000 7f31ff7fe640 1 --2- 172.21.15.53:0/1905670239 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f31e00662b0 0x7f31e0068760 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f31e80af000 tx=0x7f31e80a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:06.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.329+0000 7f31fcff9640 1 -- 172.21.15.53:0/1905670239 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f31f8050720 con 0x7f320006bb30 2023-06-10T19:00:06.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.517+0000 7f3206946640 1 -- 172.21.15.53:0/1905670239 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f32000b3c20 con 0x7f320006bb30 2023-06-10T19:00:06.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.517+0000 7f31fcff9640 1 -- 172.21.15.53:0/1905670239 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4669 (secure 0 0 0) 0x7f31f8053d40 con 0x7f320006bb30 2023-06-10T19:00:06.521 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:00:06.521 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":26,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5444,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1300171732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":1300171732},{"type":"v1","addr":"172.21.15.117:6837","nonce":1300171732}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5818,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/507478314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":507478314},{"type":"v1","addr":"172.21.15.117:6836","nonce":507478314}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":6504,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/169051241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":169051241},{"type":"v1","addr":"172.21.15.53:6833","nonce":169051241}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T18:57:13.234809+0000","modified":"2023-06-10T18:57:15.250305+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6507},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6507":{"gid":6507,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/486797221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":486797221},{"type":"v1","addr":"172.21.15.53:6835","nonce":486797221}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-06-10T19:00:06.521 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 26 2023-06-10T19:00:06.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.517+0000 7f3206946640 1 -- 172.21.15.53:0/1905670239 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f31e00662b0 msgr2=0x7f31e0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:06.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.517+0000 7f3206946640 1 --2- 172.21.15.53:0/1905670239 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f31e00662b0 0x7f31e0068760 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f31e80af000 tx=0x7f31e80a7070 comp rx=0 tx=0).stop 2023-06-10T19:00:06.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.517+0000 7f3206946640 1 -- 172.21.15.53:0/1905670239 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f320006bb30 msgr2=0x7f32000c7cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:06.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.517+0000 7f3206946640 1 --2- 172.21.15.53:0/1905670239 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f320006bb30 0x7f32000c7cf0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f31f800c3c0 tx=0x7f31f800c880 comp rx=0 tx=0).stop 2023-06-10T19:00:06.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.517+0000 7f3206946640 1 -- 172.21.15.53:0/1905670239 shutdown_connections 2023-06-10T19:00:06.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.517+0000 7f3206946640 1 --2- 172.21.15.53:0/1905670239 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f31e00662b0 0x7f31e0068760 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:06.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.517+0000 7f3206946640 1 --2- 172.21.15.53:0/1905670239 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3200157e10 0x7f320014c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:06.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.517+0000 7f3206946640 1 --2- 172.21.15.53:0/1905670239 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32000afe30 0x7f320014ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:06.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.517+0000 7f3206946640 1 --2- 172.21.15.53:0/1905670239 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f320006bb30 0x7f32000c7cf0 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:06.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.517+0000 7f3206946640 1 -- 172.21.15.53:0/1905670239 >> 172.21.15.53:0/1905670239 conn(0x7f320006a0d0 msgr2=0x7f32000cb850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:06.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.517+0000 7f3206946640 1 -- 172.21.15.53:0/1905670239 shutdown_connections 2023-06-10T19:00:06.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.517+0000 7f3206946640 1 -- 172.21.15.53:0/1905670239 wait complete. 2023-06-10T19:00:06.539 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:00:06.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.657+0000 7f1fc3664640 1 Processor -- start 2023-06-10T19:00:06.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.657+0000 7f1fc3664640 1 -- start start 2023-06-10T19:00:06.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.661+0000 7f1fc3664640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1fbc0afe30 0x7f1fbc06efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:06.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.661+0000 7f1fc3664640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fbc0c9e50 con 0x7f1fbc157e10 2023-06-10T19:00:06.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.661+0000 7f1fc3664640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fbc0c82f0 con 0x7f1fbc06bb30 2023-06-10T19:00:06.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.661+0000 7f1fc3664640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fbc06bf00 con 0x7f1fbc0afe30 2023-06-10T19:00:06.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.661+0000 7f1fc1400640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f1fbc157e10 0x7f1fbc0af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:33592/0 (socket says 172.21.15.53:33592) 2023-06-10T19:00:06.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.661+0000 7f1fc1400640 1 -- 172.21.15.53:0/3910916954 learned_addr learned my addr 172.21.15.53:0/3910916954 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:00:06.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.661+0000 7f1fc0bff640 1 --2- 172.21.15.53:0/3910916954 >> v2:172.21.15.117:3300/0 conn(0x7f1fbc0afe30 0x7f1fbc06efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:06.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.661+0000 7f1fb3fff640 1 -- 172.21.15.53:0/3910916954 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1824834467 0 0) 0x7f1fbc0c9e50 con 0x7f1fbc157e10 2023-06-10T19:00:06.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.661+0000 7f1fb3fff640 1 -- 172.21.15.53:0/3910916954 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1fa8003530 con 0x7f1fbc157e10 2023-06-10T19:00:06.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.661+0000 7f1fb3fff640 1 -- 172.21.15.53:0/3910916954 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1389029064 0 0) 0x7f1fa8003530 con 0x7f1fbc157e10 2023-06-10T19:00:06.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.661+0000 7f1fb3fff640 1 -- 172.21.15.53:0/3910916954 >> v2:172.21.15.117:3300/0 conn(0x7f1fbc0afe30 msgr2=0x7f1fbc06efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:06.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.661+0000 7f1fb3fff640 1 --2- 172.21.15.53:0/3910916954 >> v2:172.21.15.117:3300/0 conn(0x7f1fbc0afe30 0x7f1fbc06efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:06.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.661+0000 7f1fb3fff640 1 -- 172.21.15.53:0/3910916954 >> v1:172.21.15.117:6789/0 conn(0x7f1fbc06bb30 legacy=0x7f1fbc15bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:06.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.661+0000 7f1fb3fff640 1 -- 172.21.15.53:0/3910916954 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fbc0ca080 con 0x7f1fbc157e10 2023-06-10T19:00:06.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.661+0000 7f1fb3fff640 1 -- 172.21.15.53:0/3910916954 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f1fb8001680 con 0x7f1fbc157e10 2023-06-10T19:00:06.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.661+0000 7f1fb3fff640 1 -- 172.21.15.53:0/3910916954 >> v1:172.21.15.53:6789/0 conn(0x7f1fbc157e10 legacy=0x7f1fbc0af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:06.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.661+0000 7f1fb3fff640 1 --2- 172.21.15.53:0/3910916954 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1fa80039f0 0x7f1fa8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:06.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.661+0000 7f1fb3fff640 1 --2- 172.21.15.53:0/3910916954 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1fa80047d0 0x7f1fa8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:06.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.661+0000 7f1fb3fff640 1 --2- 172.21.15.53:0/3910916954 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1fa80051d0 0x7f1fa800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:06.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.661+0000 7f1fb3fff640 1 -- 172.21.15.53:0/3910916954 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fbc06bf00 con 0x7f1fa80039f0 2023-06-10T19:00:06.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.661+0000 7f1fb3fff640 1 -- 172.21.15.53:0/3910916954 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa800c110 con 0x7f1fa80047d0 2023-06-10T19:00:06.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.661+0000 7f1fb3fff640 1 -- 172.21.15.53:0/3910916954 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa800c2d0 con 0x7f1fa80051d0 2023-06-10T19:00:06.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.661+0000 7f1fc1400640 1 --2- 172.21.15.53:0/3910916954 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1fa80039f0 0x7f1fa8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:06.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.661+0000 7f1fc0bff640 1 --2- 172.21.15.53:0/3910916954 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1fa80047d0 0x7f1fa8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:06.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.661+0000 7f1fc1c01640 1 --2- 172.21.15.53:0/3910916954 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1fa80051d0 0x7f1fa800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:06.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.661+0000 7f1fc1400640 1 -- 172.21.15.53:0/3910916954 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1fa80051d0 msgr2=0x7f1fa800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:06.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.661+0000 7f1fc1400640 1 --2- 172.21.15.53:0/3910916954 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1fa80051d0 0x7f1fa800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:06.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.661+0000 7f1fc1400640 1 -- 172.21.15.53:0/3910916954 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1fa80047d0 msgr2=0x7f1fa8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:06.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.661+0000 7f1fc1400640 1 --2- 172.21.15.53:0/3910916954 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1fa80047d0 0x7f1fa8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:06.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.661+0000 7f1fc1400640 1 -- 172.21.15.53:0/3910916954 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa8003530 con 0x7f1fa80039f0 2023-06-10T19:00:06.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.661+0000 7f1fc1c01640 1 -- 172.21.15.53:0/3910916954 reap_dead start 2023-06-10T19:00:06.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.665+0000 7f1fc1400640 1 --2- 172.21.15.53:0/3910916954 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1fa80039f0 0x7f1fa8003e00 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f1fb800c210 tx=0x7f1fb801cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d652eceee33a366b server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:06.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.665+0000 7f1fb3fff640 1 -- 172.21.15.53:0/3910916954 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb8005ae0 con 0x7f1fa80039f0 2023-06-10T19:00:06.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.665+0000 7f1fb3fff640 1 -- 172.21.15.53:0/3910916954 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fb8005c40 con 0x7f1fa80039f0 2023-06-10T19:00:06.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.665+0000 7f1fb3fff640 1 -- 172.21.15.53:0/3910916954 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb80a5a00 con 0x7f1fa80039f0 2023-06-10T19:00:06.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.665+0000 7f1fc3664640 1 -- 172.21.15.53:0/3910916954 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1fa80039f0 msgr2=0x7f1fa8003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:06.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.665+0000 7f1fc3664640 1 --2- 172.21.15.53:0/3910916954 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1fa80039f0 0x7f1fa8003e00 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f1fb800c210 tx=0x7f1fb801cbd0 comp rx=0 tx=0).stop 2023-06-10T19:00:06.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.665+0000 7f1fc3664640 1 -- 172.21.15.53:0/3910916954 shutdown_connections 2023-06-10T19:00:06.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.665+0000 7f1fc3664640 1 --2- 172.21.15.53:0/3910916954 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1fa80039f0 0x7f1fa8003e00 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:06.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.665+0000 7f1fc3664640 1 -- 172.21.15.53:0/3910916954 >> 172.21.15.53:0/3910916954 conn(0x7f1fbc06a0d0 msgr2=0x7f1fbc0ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:06.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.665+0000 7f1fc3664640 1 -- 172.21.15.53:0/3910916954 shutdown_connections 2023-06-10T19:00:06.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.665+0000 7f1fc3664640 1 -- 172.21.15.53:0/3910916954 wait complete. 2023-06-10T19:00:06.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.669+0000 7f1fc3664640 1 Processor -- start 2023-06-10T19:00:06.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.669+0000 7f1fc3664640 1 -- start start 2023-06-10T19:00:06.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.669+0000 7f1fc3664640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1fa80039f0 0x7f1fbc15adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:06.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.669+0000 7f1fc3664640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1fbc153310 0x7f1fbc163110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:06.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.669+0000 7f1fc3664640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1fbc0c3de0 0x7f1fbc0c4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:06.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.669+0000 7f1fc3664640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fbc0c39c0 con 0x7f1fbc153310 2023-06-10T19:00:06.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.669+0000 7f1fc3664640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fbc1655f0 con 0x7f1fa80039f0 2023-06-10T19:00:06.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.669+0000 7f1fc3664640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fbc153780 con 0x7f1fbc0c3de0 2023-06-10T19:00:06.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.669+0000 7f1fc0bff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1fbc153310 0x7f1fbc163110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:06.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.669+0000 7f1fc0bff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1fbc153310 0x7f1fbc163110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48978/0 (socket says 172.21.15.53:48978) 2023-06-10T19:00:06.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.669+0000 7f1fc0bff640 1 -- 172.21.15.53:0/3803425710 learned_addr learned my addr 172.21.15.53:0/3803425710 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:06.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.669+0000 7f1fc1400640 1 --2- 172.21.15.53:0/3803425710 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1fa80039f0 0x7f1fbc15adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:06.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.669+0000 7f1fc1c01640 1 --2- 172.21.15.53:0/3803425710 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1fbc0c3de0 0x7f1fbc0c4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:06.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.669+0000 7f1fc0bff640 1 -- 172.21.15.53:0/3803425710 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1fbc0c3de0 msgr2=0x7f1fbc0c4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:06.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.669+0000 7f1fc0bff640 1 --2- 172.21.15.53:0/3803425710 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1fbc0c3de0 0x7f1fbc0c4280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:06.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.669+0000 7f1fc0bff640 1 -- 172.21.15.53:0/3803425710 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1fa80039f0 msgr2=0x7f1fbc15adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:06.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.669+0000 7f1fc0bff640 1 --2- 172.21.15.53:0/3803425710 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1fa80039f0 0x7f1fbc15adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:06.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.669+0000 7f1fc0bff640 1 -- 172.21.15.53:0/3803425710 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fbc163810 con 0x7f1fbc153310 2023-06-10T19:00:06.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.669+0000 7f1fc0bff640 1 --2- 172.21.15.53:0/3803425710 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1fbc153310 0x7f1fbc163110 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f1fac011530 tx=0x7f1fac011620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:06.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.669+0000 7f1fb1ffb640 1 -- 172.21.15.53:0/3803425710 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fac015660 con 0x7f1fbc153310 2023-06-10T19:00:06.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.669+0000 7f1fb1ffb640 1 -- 172.21.15.53:0/3803425710 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fac0157c0 con 0x7f1fbc153310 2023-06-10T19:00:06.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.669+0000 7f1fc3664640 1 -- 172.21.15.53:0/3803425710 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fbc163af0 con 0x7f1fbc153310 2023-06-10T19:00:06.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.669+0000 7f1fb1ffb640 1 -- 172.21.15.53:0/3803425710 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fac015b30 con 0x7f1fbc153310 2023-06-10T19:00:06.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.669+0000 7f1fc3664640 1 -- 172.21.15.53:0/3803425710 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fbc0c3590 con 0x7f1fbc153310 2023-06-10T19:00:06.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.669+0000 7f1fc3664640 1 -- 172.21.15.53:0/3803425710 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fbc04d790 con 0x7f1fbc153310 2023-06-10T19:00:06.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.673+0000 7f1fb1ffb640 1 -- 172.21.15.53:0/3803425710 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1fac015c90 con 0x7f1fbc153310 2023-06-10T19:00:06.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.673+0000 7f1fb1ffb640 1 --2- 172.21.15.53:0/3803425710 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1fa0066280 0x7f1fa0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:06.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.673+0000 7f1fb1ffb640 1 -- 172.21.15.53:0/3803425710 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6221+0+0 (secure 0 0 0) 0x7f1fac083d30 con 0x7f1fbc153310 2023-06-10T19:00:06.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.673+0000 7f1fc1400640 1 --2- 172.21.15.53:0/3803425710 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1fa0066280 0x7f1fa0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:06.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.673+0000 7f1fc1400640 1 --2- 172.21.15.53:0/3803425710 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1fa0066280 0x7f1fa0068730 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f1fb80ab000 tx=0x7f1fb80a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:06.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.677+0000 7f1fb1ffb640 1 -- 172.21.15.53:0/3803425710 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1fac0511a0 con 0x7f1fbc153310 2023-06-10T19:00:06.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.829+0000 7f1fc3664640 1 -- 172.21.15.53:0/3803425710 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1fbc165780 con 0x7f1fbc153310 2023-06-10T19:00:06.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.833+0000 7f1fb1ffb640 1 -- 172.21.15.53:0/3803425710 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) v1 ==== 74+0+18533 (secure 0 0 0) 0x7f1fac0547c0 con 0x7f1fbc153310 2023-06-10T19:00:06.837 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:00:06.838 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":68,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T18:59:28.908909+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-06-10T18:57:11.323255+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-06-10T18:57:12.231973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.13","mappings":[{"from":7,"to":2}]},{"pgid":"10.10","mappings":[{"from":4,"to":3}]},{"pgid":"10.21","mappings":[{"from":4,"to":3}]},{"pgid":"10.25","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.0.1:0/683847329":"2023-06-10T19:59:28.260070+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:00:06.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.833+0000 7f1fc3664640 1 -- 172.21.15.53:0/3803425710 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1fa0066280 msgr2=0x7f1fa0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:06.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.833+0000 7f1fc3664640 1 --2- 172.21.15.53:0/3803425710 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1fa0066280 0x7f1fa0068730 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f1fb80ab000 tx=0x7f1fb80a7070 comp rx=0 tx=0).stop 2023-06-10T19:00:06.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.833+0000 7f1fc3664640 1 -- 172.21.15.53:0/3803425710 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1fbc153310 msgr2=0x7f1fbc163110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:06.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.833+0000 7f1fc3664640 1 --2- 172.21.15.53:0/3803425710 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1fbc153310 0x7f1fbc163110 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f1fac011530 tx=0x7f1fac011620 comp rx=0 tx=0).stop 2023-06-10T19:00:06.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.833+0000 7f1fc3664640 1 -- 172.21.15.53:0/3803425710 shutdown_connections 2023-06-10T19:00:06.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.833+0000 7f1fc3664640 1 --2- 172.21.15.53:0/3803425710 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1fa0066280 0x7f1fa0068730 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:06.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.833+0000 7f1fc3664640 1 --2- 172.21.15.53:0/3803425710 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1fbc0c3de0 0x7f1fbc0c4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:06.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.833+0000 7f1fc3664640 1 --2- 172.21.15.53:0/3803425710 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1fbc153310 0x7f1fbc163110 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:06.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.833+0000 7f1fc3664640 1 --2- 172.21.15.53:0/3803425710 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1fa80039f0 0x7f1fbc15adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:06.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.833+0000 7f1fc3664640 1 -- 172.21.15.53:0/3803425710 >> 172.21.15.53:0/3803425710 conn(0x7f1fbc06a0d0 msgr2=0x7f1fbc1570e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:06.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.833+0000 7f1fc3664640 1 -- 172.21.15.53:0/3803425710 shutdown_connections 2023-06-10T19:00:06.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.833+0000 7f1fc3664640 1 -- 172.21.15.53:0/3803425710 wait complete. 2023-06-10T19:00:06.857 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-10T18:52:33.633114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-10T18:52:39.171487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-10T18:57:11.323255+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '64', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2023-06-10T18:57:12.231973+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '65', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-10T19:00:06.858 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-10T19:00:06.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.977+0000 7f1382cc0640 1 Processor -- start 2023-06-10T19:00:06.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.977+0000 7f1382cc0640 1 -- start start 2023-06-10T19:00:06.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.977+0000 7f1382cc0640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f137c0c9fa0 0x7f137c06bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:06.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.977+0000 7f1382cc0640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f137c06b090 con 0x7f137c0af760 2023-06-10T19:00:06.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.977+0000 7f1382cc0640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f137c0ca370 con 0x7f137c06c020 2023-06-10T19:00:06.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.977+0000 7f1382cc0640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f137c070d50 con 0x7f137c0c9fa0 2023-06-10T19:00:06.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.977+0000 7f1380a5c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f137c0c9fa0 0x7f137c06bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:06.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.977+0000 7f1380a5c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f137c0c9fa0 0x7f137c06bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48990/0 (socket says 172.21.15.53:48990) 2023-06-10T19:00:06.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.977+0000 7f1380a5c640 1 -- 172.21.15.53:0/365261122 learned_addr learned my addr 172.21.15.53:0/365261122 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:06.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.977+0000 7f138125d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f137c0af760 0x7f137c0700e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:33594/0 (socket says 172.21.15.53:33594) 2023-06-10T19:00:06.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.977+0000 7f1380a5c640 1 -- 172.21.15.53:0/365261122 >> v1:172.21.15.117:6789/0 conn(0x7f137c06c020 legacy=0x7f137c0c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:06.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.977+0000 7f1380a5c640 1 -- 172.21.15.53:0/365261122 >> v1:172.21.15.53:6789/0 conn(0x7f137c0af760 legacy=0x7f137c0700e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:06.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.977+0000 7f1380a5c640 1 -- 172.21.15.53:0/365261122 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f137c071030 con 0x7f137c0c9fa0 2023-06-10T19:00:06.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.977+0000 7f137b7fe640 1 -- 172.21.15.53:0/365261122 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 912837983 0 0) 0x7f137c06b090 con 0x7f137c0af760 2023-06-10T19:00:06.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.981+0000 7f1380a5c640 1 --2- 172.21.15.53:0/365261122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f137c0c9fa0 0x7f137c06bae0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f136c009870 tx=0x7f136c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db4aad611a52741d server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:06.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.981+0000 7f137b7fe640 1 -- 172.21.15.53:0/365261122 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f136c0ab640 con 0x7f137c0c9fa0 2023-06-10T19:00:06.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.981+0000 7f137b7fe640 1 -- 172.21.15.53:0/365261122 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f136c0a7070 con 0x7f137c0c9fa0 2023-06-10T19:00:06.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.981+0000 7f137b7fe640 1 -- 172.21.15.53:0/365261122 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f136c0ab9c0 con 0x7f137c0c9fa0 2023-06-10T19:00:06.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.981+0000 7f1382cc0640 1 -- 172.21.15.53:0/365261122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f137c0c9fa0 msgr2=0x7f137c06bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:06.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.981+0000 7f1382cc0640 1 --2- 172.21.15.53:0/365261122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f137c0c9fa0 0x7f137c06bae0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f136c009870 tx=0x7f136c01c440 comp rx=0 tx=0).stop 2023-06-10T19:00:06.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.981+0000 7f1382cc0640 1 -- 172.21.15.53:0/365261122 shutdown_connections 2023-06-10T19:00:06.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.981+0000 7f1382cc0640 1 --2- 172.21.15.53:0/365261122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f137c0c9fa0 0x7f137c06bae0 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:06.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.981+0000 7f1382cc0640 1 -- 172.21.15.53:0/365261122 >> 172.21.15.53:0/365261122 conn(0x7f137c06a0e0 msgr2=0x7f137c0cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:06.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.981+0000 7f1382cc0640 1 -- 172.21.15.53:0/365261122 shutdown_connections 2023-06-10T19:00:06.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.981+0000 7f1382cc0640 1 -- 172.21.15.53:0/365261122 wait complete. 2023-06-10T19:00:06.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.981+0000 7f1382cc0640 1 Processor -- start 2023-06-10T19:00:06.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.981+0000 7f1382cc0640 1 -- start start 2023-06-10T19:00:06.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.981+0000 7f1382cc0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f137c06c020 0x7f137c1538b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:06.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.981+0000 7f1382cc0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f137c0af760 0x7f137c0c2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:06.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.981+0000 7f1382cc0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f137c0c9fa0 0x7f137c0c2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:06.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.981+0000 7f1382cc0640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f137c0c11f0 con 0x7f137c0af760 2023-06-10T19:00:06.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.981+0000 7f1382cc0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f137c0b0ec0 con 0x7f137c0c9fa0 2023-06-10T19:00:06.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.981+0000 7f1382cc0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f137c158f70 con 0x7f137c06c020 2023-06-10T19:00:06.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.981+0000 7f137bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f137c0af760 0x7f137c0c2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:06.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.981+0000 7f137bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f137c0af760 0x7f137c0c2a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48994/0 (socket says 172.21.15.53:48994) 2023-06-10T19:00:06.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.981+0000 7f137bfff640 1 -- 172.21.15.53:0/39780025 learned_addr learned my addr 172.21.15.53:0/39780025 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:06.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.981+0000 7f1380a5c640 1 --2- 172.21.15.53:0/39780025 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f137c06c020 0x7f137c1538b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:06.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.981+0000 7f138125d640 1 --2- 172.21.15.53:0/39780025 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f137c0c9fa0 0x7f137c0c2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:06.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.981+0000 7f137bfff640 1 -- 172.21.15.53:0/39780025 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f137c06c020 msgr2=0x7f137c1538b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:06.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.981+0000 7f137bfff640 1 --2- 172.21.15.53:0/39780025 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f137c06c020 0x7f137c1538b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:06.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.981+0000 7f137bfff640 1 -- 172.21.15.53:0/39780025 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f137c0c9fa0 msgr2=0x7f137c0c2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:06.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.981+0000 7f137bfff640 1 --2- 172.21.15.53:0/39780025 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f137c0c9fa0 0x7f137c0c2fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:06.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.981+0000 7f137bfff640 1 -- 172.21.15.53:0/39780025 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f136c0094d0 con 0x7f137c0af760 2023-06-10T19:00:06.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.981+0000 7f138125d640 1 --2- 172.21.15.53:0/39780025 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f137c0c9fa0 0x7f137c0c2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:00:06.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.985+0000 7f137bfff640 1 --2- 172.21.15.53:0/39780025 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f137c0af760 0x7f137c0c2a60 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f137000c450 tx=0x7f137000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:06.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.985+0000 7f13797fa640 1 -- 172.21.15.53:0/39780025 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1370012830 con 0x7f137c0af760 2023-06-10T19:00:06.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.985+0000 7f13797fa640 1 -- 172.21.15.53:0/39780025 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13700129b0 con 0x7f137c0af760 2023-06-10T19:00:06.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.985+0000 7f1382cc0640 1 -- 172.21.15.53:0/39780025 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f137c159250 con 0x7f137c0af760 2023-06-10T19:00:06.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.985+0000 7f13797fa640 1 -- 172.21.15.53:0/39780025 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1370012d60 con 0x7f137c0af760 2023-06-10T19:00:06.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.985+0000 7f1382cc0640 1 -- 172.21.15.53:0/39780025 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f137c0c38f0 con 0x7f137c0af760 2023-06-10T19:00:06.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.985+0000 7f1382cc0640 1 -- 172.21.15.53:0/39780025 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f137c0c3b10 con 0x7f137c0af760 2023-06-10T19:00:06.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.985+0000 7f13797fa640 1 -- 172.21.15.53:0/39780025 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f137001c460 con 0x7f137c0af760 2023-06-10T19:00:06.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.985+0000 7f13797fa640 1 --2- 172.21.15.53:0/39780025 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1368066280 0x7f1368068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:06.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.985+0000 7f13797fa640 1 -- 172.21.15.53:0/39780025 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6221+0+0 (secure 0 0 0) 0x7f1370083c20 con 0x7f137c0af760 2023-06-10T19:00:06.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.985+0000 7f1380a5c640 1 --2- 172.21.15.53:0/39780025 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1368066280 0x7f1368068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:06.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.985+0000 7f1380a5c640 1 --2- 172.21.15.53:0/39780025 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1368066280 0x7f1368068730 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f136c0af000 tx=0x7f136c0a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:06.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:06.989+0000 7f13797fa640 1 -- 172.21.15.53:0/39780025 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1370051090 con 0x7f137c0af760 2023-06-10T19:00:07.079 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-10T19:00:07.081 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-10T19:00:07.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.137+0000 7f1382cc0640 1 -- 172.21.15.53:0/39780025 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f137c0af1a0 con 0x7f137c0af760 2023-06-10T19:00:07.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.137+0000 7f13797fa640 1 -- 172.21.15.53:0/39780025 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v68) v1 ==== 93+0+10 (secure 0 0 0) 0x7f13700546b0 con 0x7f137c0af760 2023-06-10T19:00:07.143 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-06-10T19:00:07.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.141+0000 7f1382cc0640 1 -- 172.21.15.53:0/39780025 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1368066280 msgr2=0x7f1368068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:07.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.141+0000 7f1382cc0640 1 --2- 172.21.15.53:0/39780025 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1368066280 0x7f1368068730 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f136c0af000 tx=0x7f136c0a7000 comp rx=0 tx=0).stop 2023-06-10T19:00:07.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.141+0000 7f1382cc0640 1 -- 172.21.15.53:0/39780025 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f137c0af760 msgr2=0x7f137c0c2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:07.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.141+0000 7f1382cc0640 1 --2- 172.21.15.53:0/39780025 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f137c0af760 0x7f137c0c2a60 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f137000c450 tx=0x7f137000c910 comp rx=0 tx=0).stop 2023-06-10T19:00:07.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.141+0000 7f1382cc0640 1 -- 172.21.15.53:0/39780025 shutdown_connections 2023-06-10T19:00:07.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.141+0000 7f1382cc0640 1 --2- 172.21.15.53:0/39780025 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1368066280 0x7f1368068730 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:07.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.141+0000 7f1382cc0640 1 --2- 172.21.15.53:0/39780025 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f137c0c9fa0 0x7f137c0c2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:07.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.141+0000 7f1382cc0640 1 --2- 172.21.15.53:0/39780025 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f137c0af760 0x7f137c0c2a60 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:07.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.141+0000 7f1382cc0640 1 --2- 172.21.15.53:0/39780025 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f137c06c020 0x7f137c1538b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:07.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.141+0000 7f1382cc0640 1 -- 172.21.15.53:0/39780025 >> 172.21.15.53:0/39780025 conn(0x7f137c06a0e0 msgr2=0x7f137c0c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:07.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.141+0000 7f1382cc0640 1 -- 172.21.15.53:0/39780025 shutdown_connections 2023-06-10T19:00:07.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.141+0000 7f1382cc0640 1 -- 172.21.15.53:0/39780025 wait complete. 2023-06-10T19:00:07.160 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-10T19:00:07.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.313+0000 7f4050843640 1 Processor -- start 2023-06-10T19:00:07.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.313+0000 7f4050843640 1 -- start start 2023-06-10T19:00:07.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.313+0000 7f4050843640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f404c0b7e30 0x7f404c0b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:07.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.313+0000 7f4050843640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f404c0b0b90 0x7f404c0d04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:07.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.313+0000 7f4050843640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f404c0cc7c0 con 0x7f404c15c090 2023-06-10T19:00:07.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.313+0000 7f4050843640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f404c0ccaa0 con 0x7f404c0b7e30 2023-06-10T19:00:07.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.313+0000 7f4050843640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f404c0ccd80 con 0x7f404c0b0b90 2023-06-10T19:00:07.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.313+0000 7f4049d9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f404c0b7e30 0x7f404c0b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:07.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.313+0000 7f404a59c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f404c15c090 0x7f404c0b7720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:33610/0 (socket says 172.21.15.53:33610) 2023-06-10T19:00:07.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.313+0000 7f4049d9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f404c0b7e30 0x7f404c0b10c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48996/0 (socket says 172.21.15.53:48996) 2023-06-10T19:00:07.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.313+0000 7f404a59c640 1 -- 172.21.15.53:0/2093689335 learned_addr learned my addr 172.21.15.53:0/2093689335 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:00:07.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.313+0000 7f404ad9d640 1 --2- 172.21.15.53:0/2093689335 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f404c0b0b90 0x7f404c0d04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:07.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.313+0000 7f4049d9b640 1 -- 172.21.15.53:0/2093689335 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f404c0b0b90 msgr2=0x7f404c0d04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:07.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.313+0000 7f4049d9b640 1 --2- 172.21.15.53:0/2093689335 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f404c0b0b90 0x7f404c0d04d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:07.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.313+0000 7f4049d9b640 1 -- 172.21.15.53:0/2093689335 >> v1:172.21.15.53:6789/0 conn(0x7f404c15c090 legacy=0x7f404c0b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:07.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.313+0000 7f4049d9b640 1 -- 172.21.15.53:0/2093689335 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f404c0cd060 con 0x7f404c0b7e30 2023-06-10T19:00:07.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.317+0000 7f4049d9b640 1 --2- 172.21.15.53:0/2093689335 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f404c0b7e30 0x7f404c0b10c0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f40400097c0 tx=0x7f404001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c44e3e8e48a418e5 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:07.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.317+0000 7f404959a640 1 -- 172.21.15.53:0/2093689335 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40400ab600 con 0x7f404c0b7e30 2023-06-10T19:00:07.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.317+0000 7f404959a640 1 -- 172.21.15.53:0/2093689335 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40400a7050 con 0x7f404c0b7e30 2023-06-10T19:00:07.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.317+0000 7f404959a640 1 -- 172.21.15.53:0/2093689335 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40400ab980 con 0x7f404c0b7e30 2023-06-10T19:00:07.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.317+0000 7f4050843640 1 -- 172.21.15.53:0/2093689335 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f404c0b7e30 msgr2=0x7f404c0b10c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:07.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.317+0000 7f4050843640 1 --2- 172.21.15.53:0/2093689335 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f404c0b7e30 0x7f404c0b10c0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f40400097c0 tx=0x7f404001c3c0 comp rx=0 tx=0).stop 2023-06-10T19:00:07.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.317+0000 7f4050843640 1 -- 172.21.15.53:0/2093689335 shutdown_connections 2023-06-10T19:00:07.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.317+0000 7f4050843640 1 --2- 172.21.15.53:0/2093689335 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f404c0b7e30 0x7f404c0b10c0 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:07.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.317+0000 7f4050843640 1 --2- 172.21.15.53:0/2093689335 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f404c0b0b90 0x7f404c0d04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:07.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.317+0000 7f4050843640 1 -- 172.21.15.53:0/2093689335 >> 172.21.15.53:0/2093689335 conn(0x7f404c069e20 msgr2=0x7f404c06a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:07.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.317+0000 7f4050843640 1 -- 172.21.15.53:0/2093689335 shutdown_connections 2023-06-10T19:00:07.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.317+0000 7f4050843640 1 -- 172.21.15.53:0/2093689335 wait complete. 2023-06-10T19:00:07.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.317+0000 7f4050843640 1 Processor -- start 2023-06-10T19:00:07.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.317+0000 7f4050843640 1 -- start start 2023-06-10T19:00:07.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.317+0000 7f4050843640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f404c0b0b90 0x7f404c149900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:07.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.317+0000 7f4050843640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f404c0b7e30 0x7f404c155920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:07.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.317+0000 7f4050843640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f404c15c090 0x7f404c14b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:07.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.317+0000 7f4050843640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f404c14b690 con 0x7f404c0b0b90 2023-06-10T19:00:07.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.317+0000 7f4050843640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f404c14a4f0 con 0x7f404c0b7e30 2023-06-10T19:00:07.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.317+0000 7f4050843640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f404c14afd0 con 0x7f404c15c090 2023-06-10T19:00:07.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.317+0000 7f404a59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f404c0b0b90 0x7f404c149900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:07.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.317+0000 7f404a59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f404c0b0b90 0x7f404c149900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49002/0 (socket says 172.21.15.53:49002) 2023-06-10T19:00:07.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.317+0000 7f404a59c640 1 -- 172.21.15.53:0/557793005 learned_addr learned my addr 172.21.15.53:0/557793005 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:07.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.317+0000 7f404ad9d640 1 --2- 172.21.15.53:0/557793005 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f404c15c090 0x7f404c14b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:07.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.317+0000 7f4049d9b640 1 --2- 172.21.15.53:0/557793005 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f404c0b7e30 0x7f404c155920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:07.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.317+0000 7f404a59c640 1 -- 172.21.15.53:0/557793005 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f404c15c090 msgr2=0x7f404c14b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:07.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.317+0000 7f404a59c640 1 --2- 172.21.15.53:0/557793005 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f404c15c090 0x7f404c14b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:07.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.317+0000 7f404a59c640 1 -- 172.21.15.53:0/557793005 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f404c0b7e30 msgr2=0x7f404c155920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:07.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.317+0000 7f404a59c640 1 --2- 172.21.15.53:0/557793005 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f404c0b7e30 0x7f404c155920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:07.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.317+0000 7f404a59c640 1 -- 172.21.15.53:0/557793005 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4040009420 con 0x7f404c0b0b90 2023-06-10T19:00:07.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.317+0000 7f4049d9b640 1 --2- 172.21.15.53:0/557793005 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f404c0b7e30 0x7f404c155920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:00:07.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.317+0000 7f404a59c640 1 --2- 172.21.15.53:0/557793005 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f404c0b0b90 0x7f404c149900 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f403c007fd0 tx=0x7f403c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:07.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.317+0000 7f403affd640 1 -- 172.21.15.53:0/557793005 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403c005cf0 con 0x7f404c0b0b90 2023-06-10T19:00:07.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.317+0000 7f403affd640 1 -- 172.21.15.53:0/557793005 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f403c005e70 con 0x7f404c0b0b90 2023-06-10T19:00:07.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.317+0000 7f4050843640 1 -- 172.21.15.53:0/557793005 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f404c14b2b0 con 0x7f404c0b0b90 2023-06-10T19:00:07.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.317+0000 7f403affd640 1 -- 172.21.15.53:0/557793005 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403c0072f0 con 0x7f404c0b0b90 2023-06-10T19:00:07.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.317+0000 7f4050843640 1 -- 172.21.15.53:0/557793005 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f404c14a7d0 con 0x7f404c0b0b90 2023-06-10T19:00:07.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.321+0000 7f4050843640 1 -- 172.21.15.53:0/557793005 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f404c04d790 con 0x7f404c0b0b90 2023-06-10T19:00:07.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.321+0000 7f403affd640 1 -- 172.21.15.53:0/557793005 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f403c007450 con 0x7f404c0b0b90 2023-06-10T19:00:07.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.321+0000 7f403affd640 1 --2- 172.21.15.53:0/557793005 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f402c066280 0x7f402c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:07.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.321+0000 7f403affd640 1 -- 172.21.15.53:0/557793005 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6221+0+0 (secure 0 0 0) 0x7f403c083300 con 0x7f404c0b0b90 2023-06-10T19:00:07.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.321+0000 7f4049d9b640 1 --2- 172.21.15.53:0/557793005 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f402c066280 0x7f402c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:07.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.321+0000 7f4049d9b640 1 --2- 172.21.15.53:0/557793005 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f402c066280 0x7f402c068730 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f40400ad000 tx=0x7f4040008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:07.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.325+0000 7f403affd640 1 -- 172.21.15.53:0/557793005 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f403c050770 con 0x7f404c0b0b90 2023-06-10T19:00:07.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.473+0000 7f4050843640 1 -- 172.21.15.53:0/557793005 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f404c155750 con 0x7f404c0b0b90 2023-06-10T19:00:07.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.477+0000 7f403affd640 1 -- 172.21.15.53:0/557793005 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v68) v1 ==== 92+0+10 (secure 0 0 0) 0x7f403c053d90 con 0x7f404c0b0b90 2023-06-10T19:00:07.480 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-06-10T19:00:07.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.477+0000 7f4050843640 1 -- 172.21.15.53:0/557793005 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f402c066280 msgr2=0x7f402c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:07.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.477+0000 7f4050843640 1 --2- 172.21.15.53:0/557793005 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f402c066280 0x7f402c068730 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f40400ad000 tx=0x7f4040008040 comp rx=0 tx=0).stop 2023-06-10T19:00:07.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.477+0000 7f4050843640 1 -- 172.21.15.53:0/557793005 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f404c0b0b90 msgr2=0x7f404c149900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:07.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.477+0000 7f4050843640 1 --2- 172.21.15.53:0/557793005 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f404c0b0b90 0x7f404c149900 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f403c007fd0 tx=0x7f403c00c890 comp rx=0 tx=0).stop 2023-06-10T19:00:07.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.477+0000 7f4050843640 1 -- 172.21.15.53:0/557793005 shutdown_connections 2023-06-10T19:00:07.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.477+0000 7f4050843640 1 --2- 172.21.15.53:0/557793005 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f402c066280 0x7f402c068730 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:07.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.477+0000 7f4050843640 1 --2- 172.21.15.53:0/557793005 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f404c15c090 0x7f404c14b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:07.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.477+0000 7f4050843640 1 --2- 172.21.15.53:0/557793005 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f404c0b7e30 0x7f404c155920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:07.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.477+0000 7f4050843640 1 --2- 172.21.15.53:0/557793005 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f404c0b0b90 0x7f404c149900 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:07.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.477+0000 7f4050843640 1 -- 172.21.15.53:0/557793005 >> 172.21.15.53:0/557793005 conn(0x7f404c069e20 msgr2=0x7f404c153c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:07.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.477+0000 7f4050843640 1 -- 172.21.15.53:0/557793005 shutdown_connections 2023-06-10T19:00:07.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.477+0000 7f4050843640 1 -- 172.21.15.53:0/557793005 wait complete. 2023-06-10T19:00:07.498 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-10T19:00:07.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.605+0000 7f1581bc9640 1 Processor -- start 2023-06-10T19:00:07.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.605+0000 7f1581bc9640 1 -- start start 2023-06-10T19:00:07.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.609+0000 7f1581bc9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f157c15c090 0x7f157c0b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:07.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.609+0000 7f1581bc9640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f157c0b7e30 0x7f157c0d04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:07.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.609+0000 7f1581bc9640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f157c0cc7c0 con 0x7f157c0b0b90 2023-06-10T19:00:07.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.609+0000 7f1581bc9640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f157c0ccaa0 con 0x7f157c0b7e30 2023-06-10T19:00:07.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.609+0000 7f1581bc9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f157c0ccd80 con 0x7f157c15c090 2023-06-10T19:00:07.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.609+0000 7f1573fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f157c0b0b90 0x7f157c0b7720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:33622/0 (socket says 172.21.15.53:33622) 2023-06-10T19:00:07.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.609+0000 7f1573fff640 1 -- 172.21.15.53:0/3507588917 learned_addr learned my addr 172.21.15.53:0/3507588917 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:00:07.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.609+0000 7f157bfff640 1 --2- 172.21.15.53:0/3507588917 >> v2:172.21.15.117:3300/0 conn(0x7f157c0b7e30 0x7f157c0d04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:07.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.609+0000 7f157b7fe640 1 --2- 172.21.15.53:0/3507588917 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f157c15c090 0x7f157c0b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:07.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.609+0000 7f157affd640 1 -- 172.21.15.53:0/3507588917 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2325725840 0 0) 0x7f157c0cc7c0 con 0x7f157c0b0b90 2023-06-10T19:00:07.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.609+0000 7f157affd640 1 -- 172.21.15.53:0/3507588917 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1568003530 con 0x7f157c0b0b90 2023-06-10T19:00:07.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.609+0000 7f157affd640 1 -- 172.21.15.53:0/3507588917 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 56690626 0 0) 0x7f1568003530 con 0x7f157c0b0b90 2023-06-10T19:00:07.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.609+0000 7f157affd640 1 -- 172.21.15.53:0/3507588917 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f157c15c090 msgr2=0x7f157c0b10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:07.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.609+0000 7f157affd640 1 --2- 172.21.15.53:0/3507588917 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f157c15c090 0x7f157c0b10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:07.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.609+0000 7f157affd640 1 -- 172.21.15.53:0/3507588917 >> v2:172.21.15.117:3300/0 conn(0x7f157c0b7e30 msgr2=0x7f157c0d04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:07.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.609+0000 7f157affd640 1 --2- 172.21.15.53:0/3507588917 >> v2:172.21.15.117:3300/0 conn(0x7f157c0b7e30 0x7f157c0d04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:07.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.609+0000 7f157affd640 1 -- 172.21.15.53:0/3507588917 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f157c0cd060 con 0x7f157c0b0b90 2023-06-10T19:00:07.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.609+0000 7f157affd640 1 -- 172.21.15.53:0/3507588917 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f1564001680 con 0x7f157c0b0b90 2023-06-10T19:00:07.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.609+0000 7f157affd640 1 -- 172.21.15.53:0/3507588917 >> v1:172.21.15.53:6789/0 conn(0x7f157c0b0b90 legacy=0x7f157c0b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:07.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.609+0000 7f157affd640 1 --2- 172.21.15.53:0/3507588917 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f157c15c090 0x7f1568003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:07.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.609+0000 7f157affd640 1 --2- 172.21.15.53:0/3507588917 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1568003f00 0x7f15680047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:07.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.609+0000 7f157affd640 1 --2- 172.21.15.53:0/3507588917 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1568004d10 0x7f1568005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:07.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.609+0000 7f157affd640 1 -- 172.21.15.53:0/3507588917 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f157c0ccaa0 con 0x7f1568003f00 2023-06-10T19:00:07.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.609+0000 7f157affd640 1 -- 172.21.15.53:0/3507588917 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f157c0ccd80 con 0x7f1568004d10 2023-06-10T19:00:07.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.609+0000 7f157affd640 1 -- 172.21.15.53:0/3507588917 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f156800b9c0 con 0x7f157c15c090 2023-06-10T19:00:07.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.609+0000 7f1573fff640 1 --2- 172.21.15.53:0/3507588917 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1568003f00 0x7f15680047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:07.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.609+0000 7f157b7fe640 1 --2- 172.21.15.53:0/3507588917 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f157c15c090 0x7f1568003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:07.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.609+0000 7f157bfff640 1 --2- 172.21.15.53:0/3507588917 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1568004d10 0x7f1568005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:07.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.609+0000 7f1573fff640 1 -- 172.21.15.53:0/3507588917 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f157c15c090 msgr2=0x7f1568003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:07.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.609+0000 7f1573fff640 1 --2- 172.21.15.53:0/3507588917 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f157c15c090 0x7f1568003980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:07.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.609+0000 7f1573fff640 1 -- 172.21.15.53:0/3507588917 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1568004d10 msgr2=0x7f1568005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:07.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.609+0000 7f1573fff640 1 --2- 172.21.15.53:0/3507588917 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1568004d10 0x7f1568005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:07.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.609+0000 7f1573fff640 1 -- 172.21.15.53:0/3507588917 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1568003530 con 0x7f1568003f00 2023-06-10T19:00:07.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.613+0000 7f1573fff640 1 --2- 172.21.15.53:0/3507588917 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1568003f00 0x7f15680047d0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f156400c290 tx=0x7f156401cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c66aa751ee879c9 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:07.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.613+0000 7f157affd640 1 -- 172.21.15.53:0/3507588917 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15640058e0 con 0x7f1568003f00 2023-06-10T19:00:07.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.613+0000 7f157affd640 1 -- 172.21.15.53:0/3507588917 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1564005a40 con 0x7f1568003f00 2023-06-10T19:00:07.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.613+0000 7f157affd640 1 -- 172.21.15.53:0/3507588917 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1564005df0 con 0x7f1568003f00 2023-06-10T19:00:07.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.613+0000 7f1581bc9640 1 -- 172.21.15.53:0/3507588917 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1568003f00 msgr2=0x7f15680047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:07.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.613+0000 7f1581bc9640 1 --2- 172.21.15.53:0/3507588917 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1568003f00 0x7f15680047d0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f156400c290 tx=0x7f156401cc50 comp rx=0 tx=0).stop 2023-06-10T19:00:07.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.613+0000 7f157bfff640 1 -- 172.21.15.53:0/3507588917 reap_dead start 2023-06-10T19:00:07.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.613+0000 7f1581bc9640 1 -- 172.21.15.53:0/3507588917 shutdown_connections 2023-06-10T19:00:07.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.613+0000 7f1581bc9640 1 -- 172.21.15.53:0/3507588917 >> 172.21.15.53:0/3507588917 conn(0x7f157c069e20 msgr2=0x7f157c06a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:07.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.613+0000 7f1581bc9640 1 -- 172.21.15.53:0/3507588917 shutdown_connections 2023-06-10T19:00:07.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.613+0000 7f1581bc9640 1 -- 172.21.15.53:0/3507588917 wait complete. 2023-06-10T19:00:07.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.613+0000 7f1581bc9640 1 Processor -- start 2023-06-10T19:00:07.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.613+0000 7f1581bc9640 1 -- start start 2023-06-10T19:00:07.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.613+0000 7f1581bc9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f157c0b46f0 0x7f157c0c7d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:07.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.613+0000 7f1581bc9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f157c15c670 0x7f157c15e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:07.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.613+0000 7f1581bc9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f157c15ec90 0x7f157c15cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:07.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.613+0000 7f1581bc9640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f157c15f110 con 0x7f157c0b46f0 2023-06-10T19:00:07.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.613+0000 7f1581bc9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f157c0b1af0 con 0x7f157c15c670 2023-06-10T19:00:07.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.613+0000 7f1581bc9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f157c0b4ac0 con 0x7f157c15ec90 2023-06-10T19:00:07.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.613+0000 7f157b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f157c0b46f0 0x7f157c0c7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:07.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.613+0000 7f157b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f157c0b46f0 0x7f157c0c7d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49022/0 (socket says 172.21.15.53:49022) 2023-06-10T19:00:07.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.613+0000 7f157b7fe640 1 -- 172.21.15.53:0/1053763135 learned_addr learned my addr 172.21.15.53:0/1053763135 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:07.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.613+0000 7f157bfff640 1 --2- 172.21.15.53:0/1053763135 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f157c15ec90 0x7f157c15cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:07.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.613+0000 7f1573fff640 1 --2- 172.21.15.53:0/1053763135 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f157c15c670 0x7f157c15e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:07.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.613+0000 7f157b7fe640 1 -- 172.21.15.53:0/1053763135 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f157c15ec90 msgr2=0x7f157c15cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:07.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.613+0000 7f157b7fe640 1 --2- 172.21.15.53:0/1053763135 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f157c15ec90 0x7f157c15cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:07.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.613+0000 7f157b7fe640 1 -- 172.21.15.53:0/1053763135 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f157c15c670 msgr2=0x7f157c15e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:07.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.613+0000 7f157b7fe640 1 --2- 172.21.15.53:0/1053763135 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f157c15c670 0x7f157c15e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:07.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.613+0000 7f157b7fe640 1 -- 172.21.15.53:0/1053763135 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f157c15f440 con 0x7f157c0b46f0 2023-06-10T19:00:07.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.613+0000 7f157bfff640 1 --2- 172.21.15.53:0/1053763135 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f157c15ec90 0x7f157c15cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:00:07.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.613+0000 7f157b7fe640 1 --2- 172.21.15.53:0/1053763135 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f157c0b46f0 0x7f157c0c7d10 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f156c0108c0 tx=0x7f156c010d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:07.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.613+0000 7f1578ff9640 1 -- 172.21.15.53:0/1053763135 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f156c009630 con 0x7f157c0b46f0 2023-06-10T19:00:07.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.613+0000 7f1578ff9640 1 -- 172.21.15.53:0/1053763135 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f156c00eb60 con 0x7f157c0b46f0 2023-06-10T19:00:07.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.613+0000 7f1581bc9640 1 -- 172.21.15.53:0/1053763135 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f157c0c8380 con 0x7f157c0b46f0 2023-06-10T19:00:07.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.613+0000 7f1578ff9640 1 -- 172.21.15.53:0/1053763135 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f156c01c400 con 0x7f157c0b46f0 2023-06-10T19:00:07.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.613+0000 7f1581bc9640 1 -- 172.21.15.53:0/1053763135 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f157c0c8940 con 0x7f157c0b46f0 2023-06-10T19:00:07.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.617+0000 7f1581bc9640 1 -- 172.21.15.53:0/1053763135 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f157c04d790 con 0x7f157c0b46f0 2023-06-10T19:00:07.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.617+0000 7f1578ff9640 1 -- 172.21.15.53:0/1053763135 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f156c01c560 con 0x7f157c0b46f0 2023-06-10T19:00:07.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.617+0000 7f1578ff9640 1 --2- 172.21.15.53:0/1053763135 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f155c0662b0 0x7f155c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:07.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.617+0000 7f1578ff9640 1 -- 172.21.15.53:0/1053763135 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6221+0+0 (secure 0 0 0) 0x7f156c084240 con 0x7f157c0b46f0 2023-06-10T19:00:07.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.617+0000 7f1573fff640 1 --2- 172.21.15.53:0/1053763135 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f155c0662b0 0x7f155c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:07.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.617+0000 7f1573fff640 1 --2- 172.21.15.53:0/1053763135 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f155c0662b0 0x7f155c068760 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f15640aa000 tx=0x7f1564001a10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:07.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.621+0000 7f1578ff9640 1 -- 172.21.15.53:0/1053763135 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f156c051760 con 0x7f157c0b46f0 2023-06-10T19:00:07.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.773+0000 7f1581bc9640 1 -- 172.21.15.53:0/1053763135 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f157c0b72f0 con 0x7f157c0b46f0 2023-06-10T19:00:07.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.773+0000 7f1578ff9640 1 -- 172.21.15.53:0/1053763135 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v68) v1 ==== 104+0+11 (secure 0 0 0) 0x7f156c054d80 con 0x7f157c0b46f0 2023-06-10T19:00:07.779 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-06-10T19:00:07.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.777+0000 7f1581bc9640 1 -- 172.21.15.53:0/1053763135 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f155c0662b0 msgr2=0x7f155c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:07.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.777+0000 7f1581bc9640 1 --2- 172.21.15.53:0/1053763135 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f155c0662b0 0x7f155c068760 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f15640aa000 tx=0x7f1564001a10 comp rx=0 tx=0).stop 2023-06-10T19:00:07.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.777+0000 7f1581bc9640 1 -- 172.21.15.53:0/1053763135 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f157c0b46f0 msgr2=0x7f157c0c7d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:07.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.777+0000 7f1581bc9640 1 --2- 172.21.15.53:0/1053763135 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f157c0b46f0 0x7f157c0c7d10 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f156c0108c0 tx=0x7f156c010d80 comp rx=0 tx=0).stop 2023-06-10T19:00:07.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.777+0000 7f1581bc9640 1 -- 172.21.15.53:0/1053763135 shutdown_connections 2023-06-10T19:00:07.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.777+0000 7f1581bc9640 1 --2- 172.21.15.53:0/1053763135 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f155c0662b0 0x7f155c068760 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:07.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.777+0000 7f1581bc9640 1 --2- 172.21.15.53:0/1053763135 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f157c15ec90 0x7f157c15cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:07.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.777+0000 7f1581bc9640 1 --2- 172.21.15.53:0/1053763135 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f157c15c670 0x7f157c15e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:07.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.777+0000 7f1581bc9640 1 --2- 172.21.15.53:0/1053763135 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f157c0b46f0 0x7f157c0c7d10 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:07.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.777+0000 7f1581bc9640 1 -- 172.21.15.53:0/1053763135 >> 172.21.15.53:0/1053763135 conn(0x7f157c069e20 msgr2=0x7f157c0b6260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:07.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.777+0000 7f1581bc9640 1 -- 172.21.15.53:0/1053763135 shutdown_connections 2023-06-10T19:00:07.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.777+0000 7f1581bc9640 1 -- 172.21.15.53:0/1053763135 wait complete. 2023-06-10T19:00:07.799 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-10T19:00:07.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.921+0000 7fa6bc03a640 1 Processor -- start 2023-06-10T19:00:07.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.921+0000 7fa6bc03a640 1 -- start start 2023-06-10T19:00:07.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.925+0000 7fa6bc03a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa6b4159450 0x7fa6b415d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:07.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.925+0000 7fa6bc03a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6b40cf350 0x7fa6b40cbf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:07.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.925+0000 7fa6bc03a640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6b40cbac0 con 0x7fa6b415d680 2023-06-10T19:00:07.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.925+0000 7fa6bc03a640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6b415dc00 con 0x7fa6b4159450 2023-06-10T19:00:07.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.925+0000 7fa6bc03a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b415dee0 con 0x7fa6b40cf350 2023-06-10T19:00:07.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.925+0000 7fa6b9dd6640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa6b4159450 0x7fa6b415d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:07.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.925+0000 7fa6b9dd6640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa6b4159450 0x7fa6b415d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49038/0 (socket says 172.21.15.53:49038) 2023-06-10T19:00:07.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.925+0000 7fa6b9dd6640 1 -- 172.21.15.53:0/50215341 learned_addr learned my addr 172.21.15.53:0/50215341 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:07.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.925+0000 7fa6ba5d7640 1 --2- 172.21.15.53:0/50215341 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6b40cf350 0x7fa6b40cbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:07.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.925+0000 7fa6b9dd6640 1 -- 172.21.15.53:0/50215341 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6b40cf350 msgr2=0x7fa6b40cbf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:07.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.925+0000 7fa6b9dd6640 1 --2- 172.21.15.53:0/50215341 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6b40cf350 0x7fa6b40cbf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:07.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.925+0000 7fa6b9dd6640 1 -- 172.21.15.53:0/50215341 >> v1:172.21.15.53:6789/0 conn(0x7fa6b415d680 legacy=0x7fa6b40cec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:07.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.925+0000 7fa6b9dd6640 1 -- 172.21.15.53:0/50215341 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6b40cb750 con 0x7fa6b4159450 2023-06-10T19:00:07.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.925+0000 7fa6b8dd4640 1 -- 172.21.15.53:0/50215341 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2372834370 0 0) 0x7fa6b40cbac0 con 0x7fa6b415d680 2023-06-10T19:00:07.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.925+0000 7fa6ba5d7640 1 --2- 172.21.15.53:0/50215341 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6b40cf350 0x7fa6b40cbf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:00:07.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.925+0000 7fa6b9dd6640 1 --2- 172.21.15.53:0/50215341 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6b4159450 0x7fa6b415d140 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fa6a0009870 tx=0x7fa6a001c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d2ce577e86822dc server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:07.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.925+0000 7fa6b8dd4640 1 -- 172.21.15.53:0/50215341 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a00aa660 con 0x7fa6b4159450 2023-06-10T19:00:07.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.925+0000 7fa6b8dd4640 1 -- 172.21.15.53:0/50215341 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6a00aa7c0 con 0x7fa6b4159450 2023-06-10T19:00:07.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.925+0000 7fa6b8dd4640 1 -- 172.21.15.53:0/50215341 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a00aab50 con 0x7fa6b4159450 2023-06-10T19:00:07.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.925+0000 7fa6bc03a640 1 -- 172.21.15.53:0/50215341 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6b4159450 msgr2=0x7fa6b415d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:07.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.925+0000 7fa6bc03a640 1 --2- 172.21.15.53:0/50215341 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6b4159450 0x7fa6b415d140 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fa6a0009870 tx=0x7fa6a001c4e0 comp rx=0 tx=0).stop 2023-06-10T19:00:07.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.925+0000 7fa6bc03a640 1 -- 172.21.15.53:0/50215341 shutdown_connections 2023-06-10T19:00:07.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.925+0000 7fa6bc03a640 1 --2- 172.21.15.53:0/50215341 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6b40cf350 0x7fa6b40cbf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:07.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.925+0000 7fa6bc03a640 1 --2- 172.21.15.53:0/50215341 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6b4159450 0x7fa6b415d140 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:07.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.925+0000 7fa6bc03a640 1 -- 172.21.15.53:0/50215341 >> 172.21.15.53:0/50215341 conn(0x7fa6b406a090 msgr2=0x7fa6b406d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:07.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.929+0000 7fa6bc03a640 1 -- 172.21.15.53:0/50215341 shutdown_connections 2023-06-10T19:00:07.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.929+0000 7fa6bc03a640 1 -- 172.21.15.53:0/50215341 wait complete. 2023-06-10T19:00:07.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.929+0000 7fa6bc03a640 1 Processor -- start 2023-06-10T19:00:07.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.929+0000 7fa6bc03a640 1 -- start start 2023-06-10T19:00:07.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.929+0000 7fa6bc03a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6b40cf350 0x7fa6b4149620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:07.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.929+0000 7fa6bc03a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6b4159450 0x7fa6b4152420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:07.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.929+0000 7fa6bc03a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6b415d680 0x7fa6b4157690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:07.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.929+0000 7fa6bc03a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b4154080 con 0x7fa6b4159450 2023-06-10T19:00:07.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.929+0000 7fa6bc03a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b4154360 con 0x7fa6b415d680 2023-06-10T19:00:07.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.929+0000 7fa6bc03a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b4154640 con 0x7fa6b40cf350 2023-06-10T19:00:07.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.929+0000 7fa6b95d5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6b4159450 0x7fa6b4152420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:07.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.929+0000 7fa6b95d5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6b4159450 0x7fa6b4152420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49044/0 (socket says 172.21.15.53:49044) 2023-06-10T19:00:07.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.929+0000 7fa6b95d5640 1 -- 172.21.15.53:0/1233312647 learned_addr learned my addr 172.21.15.53:0/1233312647 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:07.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.929+0000 7fa6b95d5640 1 -- 172.21.15.53:0/1233312647 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6b40cf350 msgr2=0x7fa6b4149620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:07.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.929+0000 7fa6b9dd6640 1 --2- 172.21.15.53:0/1233312647 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6b40cf350 0x7fa6b4149620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:07.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.929+0000 7fa6ba5d7640 1 --2- 172.21.15.53:0/1233312647 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6b415d680 0x7fa6b4157690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:07.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.929+0000 7fa6b95d5640 1 --2- 172.21.15.53:0/1233312647 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6b40cf350 0x7fa6b4149620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:07.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.929+0000 7fa6b95d5640 1 -- 172.21.15.53:0/1233312647 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6b415d680 msgr2=0x7fa6b4157690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:07.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.929+0000 7fa6b95d5640 1 --2- 172.21.15.53:0/1233312647 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6b415d680 0x7fa6b4157690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:07.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.929+0000 7fa6b95d5640 1 -- 172.21.15.53:0/1233312647 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6a00094d0 con 0x7fa6b4159450 2023-06-10T19:00:07.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.929+0000 7fa6b9dd6640 1 --2- 172.21.15.53:0/1233312647 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6b40cf350 0x7fa6b4149620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:00:07.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.929+0000 7fa6b95d5640 1 --2- 172.21.15.53:0/1233312647 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6b4159450 0x7fa6b4152420 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fa6a800c7a0 tx=0x7fa6a800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:07.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.929+0000 7fa6b27fc640 1 -- 172.21.15.53:0/1233312647 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a8003db0 con 0x7fa6b4159450 2023-06-10T19:00:07.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.929+0000 7fa6b27fc640 1 -- 172.21.15.53:0/1233312647 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6a8005070 con 0x7fa6b4159450 2023-06-10T19:00:07.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.929+0000 7fa6b27fc640 1 -- 172.21.15.53:0/1233312647 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a8005420 con 0x7fa6b4159450 2023-06-10T19:00:07.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.929+0000 7fa6bc03a640 1 -- 172.21.15.53:0/1233312647 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6b4154920 con 0x7fa6b4159450 2023-06-10T19:00:07.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.929+0000 7fa6bc03a640 1 -- 172.21.15.53:0/1233312647 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6b40c7150 con 0x7fa6b4159450 2023-06-10T19:00:07.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.929+0000 7fa6bc03a640 1 -- 172.21.15.53:0/1233312647 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6b40c8880 con 0x7fa6b4159450 2023-06-10T19:00:07.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.933+0000 7fa6b27fc640 1 -- 172.21.15.53:0/1233312647 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa6a8005580 con 0x7fa6b4159450 2023-06-10T19:00:07.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.933+0000 7fa6b27fc640 1 --2- 172.21.15.53:0/1233312647 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa698066280 0x7fa698068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:07.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.933+0000 7fa6b27fc640 1 -- 172.21.15.53:0/1233312647 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6221+0+0 (secure 0 0 0) 0x7fa6a80834b0 con 0x7fa6b4159450 2023-06-10T19:00:07.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.933+0000 7fa6b9dd6640 1 --2- 172.21.15.53:0/1233312647 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa698066280 0x7fa698068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:07.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.933+0000 7fa6b9dd6640 1 --2- 172.21.15.53:0/1233312647 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa698066280 0x7fa698068730 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fa6a00ae000 tx=0x7fa6a0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:07.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:07.937+0000 7fa6b27fc640 1 -- 172.21.15.53:0/1233312647 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa6a80509d0 con 0x7fa6b4159450 2023-06-10T19:00:08.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.089+0000 7fa6bc03a640 1 -- 172.21.15.53:0/1233312647 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa6b41541c0 con 0x7fa6b4159450 2023-06-10T19:00:08.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.089+0000 7fa6b27fc640 1 -- 172.21.15.53:0/1233312647 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v68) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa6a8017020 con 0x7fa6b4159450 2023-06-10T19:00:08.095 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-06-10T19:00:08.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.093+0000 7fa6bc03a640 1 -- 172.21.15.53:0/1233312647 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa698066280 msgr2=0x7fa698068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:08.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.093+0000 7fa6bc03a640 1 --2- 172.21.15.53:0/1233312647 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa698066280 0x7fa698068730 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fa6a00ae000 tx=0x7fa6a0008040 comp rx=0 tx=0).stop 2023-06-10T19:00:08.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.093+0000 7fa6bc03a640 1 -- 172.21.15.53:0/1233312647 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6b4159450 msgr2=0x7fa6b4152420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:08.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.093+0000 7fa6bc03a640 1 --2- 172.21.15.53:0/1233312647 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6b4159450 0x7fa6b4152420 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fa6a800c7a0 tx=0x7fa6a800cc60 comp rx=0 tx=0).stop 2023-06-10T19:00:08.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.093+0000 7fa6bc03a640 1 -- 172.21.15.53:0/1233312647 shutdown_connections 2023-06-10T19:00:08.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.093+0000 7fa6bc03a640 1 --2- 172.21.15.53:0/1233312647 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa698066280 0x7fa698068730 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:08.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.093+0000 7fa6bc03a640 1 --2- 172.21.15.53:0/1233312647 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6b415d680 0x7fa6b4157690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:08.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.093+0000 7fa6bc03a640 1 --2- 172.21.15.53:0/1233312647 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6b4159450 0x7fa6b4152420 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:08.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.093+0000 7fa6bc03a640 1 --2- 172.21.15.53:0/1233312647 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6b40cf350 0x7fa6b4149620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:08.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.093+0000 7fa6bc03a640 1 -- 172.21.15.53:0/1233312647 >> 172.21.15.53:0/1233312647 conn(0x7fa6b406a090 msgr2=0x7fa6b40b1f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:08.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.093+0000 7fa6bc03a640 1 -- 172.21.15.53:0/1233312647 shutdown_connections 2023-06-10T19:00:08.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.093+0000 7fa6bc03a640 1 -- 172.21.15.53:0/1233312647 wait complete. 2023-06-10T19:00:08.115 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:00:08.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.225+0000 7f2f9eb67640 1 Processor -- start 2023-06-10T19:00:08.235 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.225+0000 7f2f9eb67640 1 -- start start 2023-06-10T19:00:08.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.229+0000 7f2f9eb67640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2f980b3ac0 0x7f2f980b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:08.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.229+0000 7f2f9eb67640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f980d14c0 0x7f2f9815fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:08.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.229+0000 7f2f9eb67640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f980d0020 con 0x7f2f980cc690 2023-06-10T19:00:08.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.229+0000 7f2f9eb67640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f980b43d0 con 0x7f2f980b3ac0 2023-06-10T19:00:08.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.229+0000 7f2f9eb67640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f980cef40 con 0x7f2f980d14c0 2023-06-10T19:00:08.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.229+0000 7f2f9c903640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2f980b3ac0 0x7f2f980b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:08.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.229+0000 7f2f9c903640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2f980b3ac0 0x7f2f980b3e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49048/0 (socket says 172.21.15.53:49048) 2023-06-10T19:00:08.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.229+0000 7f2f9c903640 1 -- 172.21.15.53:0/1198676826 learned_addr learned my addr 172.21.15.53:0/1198676826 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:08.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.229+0000 7f2f9d104640 1 --2- 172.21.15.53:0/1198676826 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f980d14c0 0x7f2f9815fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:08.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.229+0000 7f2f9c903640 1 -- 172.21.15.53:0/1198676826 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f980d14c0 msgr2=0x7f2f9815fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:08.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.229+0000 7f2f9c903640 1 --2- 172.21.15.53:0/1198676826 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f980d14c0 0x7f2f9815fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:08.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.229+0000 7f2f9c903640 1 -- 172.21.15.53:0/1198676826 >> v1:172.21.15.117:6789/0 conn(0x7f2f980cc690 legacy=0x7f2f9815f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:08.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.229+0000 7f2f9c903640 1 -- 172.21.15.53:0/1198676826 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f980cf220 con 0x7f2f980b3ac0 2023-06-10T19:00:08.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.229+0000 7f2f9c903640 1 --2- 172.21.15.53:0/1198676826 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f980b3ac0 0x7f2f980b3e90 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f2f90009870 tx=0x7f2f9001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c13e6366c8e985d6 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:08.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.229+0000 7f2f977fe640 1 -- 172.21.15.53:0/1198676826 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f900ab620 con 0x7f2f980b3ac0 2023-06-10T19:00:08.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.229+0000 7f2f977fe640 1 -- 172.21.15.53:0/1198676826 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f900ab780 con 0x7f2f980b3ac0 2023-06-10T19:00:08.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.229+0000 7f2f977fe640 1 -- 172.21.15.53:0/1198676826 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f900abb10 con 0x7f2f980b3ac0 2023-06-10T19:00:08.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.229+0000 7f2f9eb67640 1 -- 172.21.15.53:0/1198676826 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f980b3ac0 msgr2=0x7f2f980b3e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:08.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.229+0000 7f2f9eb67640 1 --2- 172.21.15.53:0/1198676826 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f980b3ac0 0x7f2f980b3e90 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f2f90009870 tx=0x7f2f9001c510 comp rx=0 tx=0).stop 2023-06-10T19:00:08.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.229+0000 7f2f9eb67640 1 -- 172.21.15.53:0/1198676826 shutdown_connections 2023-06-10T19:00:08.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.229+0000 7f2f9eb67640 1 --2- 172.21.15.53:0/1198676826 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f980d14c0 0x7f2f9815fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:08.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.229+0000 7f2f9eb67640 1 --2- 172.21.15.53:0/1198676826 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f980b3ac0 0x7f2f980b3e90 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:08.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.229+0000 7f2f9eb67640 1 -- 172.21.15.53:0/1198676826 >> 172.21.15.53:0/1198676826 conn(0x7f2f98071790 msgr2=0x7f2f98069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:08.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.229+0000 7f2f9eb67640 1 -- 172.21.15.53:0/1198676826 shutdown_connections 2023-06-10T19:00:08.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.229+0000 7f2f9eb67640 1 -- 172.21.15.53:0/1198676826 wait complete. 2023-06-10T19:00:08.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.233+0000 7f2f9eb67640 1 Processor -- start 2023-06-10T19:00:08.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.233+0000 7f2f9eb67640 1 -- start start 2023-06-10T19:00:08.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.233+0000 7f2f9eb67640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f980b3ac0 0x7f2f98153f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:08.243 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.233+0000 7f2f9eb67640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f980cc690 0x7f2f9815db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:08.243 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.233+0000 7f2f9eb67640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2f980d14c0 0x7f2f9815e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:08.243 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.233+0000 7f2f9eb67640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f98155190 con 0x7f2f980b3ac0 2023-06-10T19:00:08.243 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.233+0000 7f2f9eb67640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f980cac00 con 0x7f2f980d14c0 2023-06-10T19:00:08.243 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.233+0000 7f2f9eb67640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f981548f0 con 0x7f2f980cc690 2023-06-10T19:00:08.243 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.233+0000 7f2f9c903640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f980b3ac0 0x7f2f98153f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:08.243 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.233+0000 7f2f9c903640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f980b3ac0 0x7f2f98153f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49056/0 (socket says 172.21.15.53:49056) 2023-06-10T19:00:08.244 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.233+0000 7f2f9c903640 1 -- 172.21.15.53:0/1683236018 learned_addr learned my addr 172.21.15.53:0/1683236018 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:08.244 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.233+0000 7f2f9d104640 1 --2- 172.21.15.53:0/1683236018 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2f980d14c0 0x7f2f9815e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:08.244 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.233+0000 7f2f97fff640 1 --2- 172.21.15.53:0/1683236018 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f980cc690 0x7f2f9815db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:08.244 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.233+0000 7f2f9c903640 1 -- 172.21.15.53:0/1683236018 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f980cc690 msgr2=0x7f2f9815db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:08.244 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.233+0000 7f2f9c903640 1 --2- 172.21.15.53:0/1683236018 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f980cc690 0x7f2f9815db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:08.244 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.233+0000 7f2f9c903640 1 -- 172.21.15.53:0/1683236018 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2f980d14c0 msgr2=0x7f2f9815e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:08.244 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.233+0000 7f2f9c903640 1 --2- 172.21.15.53:0/1683236018 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2f980d14c0 0x7f2f9815e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:08.244 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.233+0000 7f2f9c903640 1 -- 172.21.15.53:0/1683236018 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f900094d0 con 0x7f2f980b3ac0 2023-06-10T19:00:08.245 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.233+0000 7f2f9d104640 1 --2- 172.21.15.53:0/1683236018 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2f980d14c0 0x7f2f9815e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:00:08.245 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.233+0000 7f2f9c903640 1 --2- 172.21.15.53:0/1683236018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f980b3ac0 0x7f2f98153f30 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f2f900097c0 tx=0x7f2f9001ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:08.245 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.233+0000 7f2f957fa640 1 -- 172.21.15.53:0/1683236018 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f900be3f0 con 0x7f2f980b3ac0 2023-06-10T19:00:08.245 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.233+0000 7f2f957fa640 1 -- 172.21.15.53:0/1683236018 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f900be570 con 0x7f2f980b3ac0 2023-06-10T19:00:08.245 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.233+0000 7f2f9eb67640 1 -- 172.21.15.53:0/1683236018 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f98154bd0 con 0x7f2f980b3ac0 2023-06-10T19:00:08.245 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.233+0000 7f2f957fa640 1 -- 172.21.15.53:0/1683236018 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f900be920 con 0x7f2f980b3ac0 2023-06-10T19:00:08.245 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.233+0000 7f2f9eb67640 1 -- 172.21.15.53:0/1683236018 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f980caea0 con 0x7f2f980b3ac0 2023-06-10T19:00:08.246 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.233+0000 7f2f9eb67640 1 -- 172.21.15.53:0/1683236018 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f980cb090 con 0x7f2f980b3ac0 2023-06-10T19:00:08.246 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.237+0000 7f2f957fa640 1 -- 172.21.15.53:0/1683236018 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2f900c9480 con 0x7f2f980b3ac0 2023-06-10T19:00:08.246 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.237+0000 7f2f957fa640 1 --2- 172.21.15.53:0/1683236018 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2f84066280 0x7f2f84068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:08.246 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.237+0000 7f2f957fa640 1 -- 172.21.15.53:0/1683236018 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6221+0+0 (secure 0 0 0) 0x7f2f9011e400 con 0x7f2f980b3ac0 2023-06-10T19:00:08.246 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.237+0000 7f2f97fff640 1 --2- 172.21.15.53:0/1683236018 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2f84066280 0x7f2f84068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:08.246 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.237+0000 7f2f97fff640 1 --2- 172.21.15.53:0/1683236018 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2f84066280 0x7f2f84068730 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f2f980b6dd0 tx=0x7f2f8c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:08.247 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.241+0000 7f2f957fa640 1 -- 172.21.15.53:0/1683236018 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2f900eba00 con 0x7f2f980b3ac0 2023-06-10T19:00:08.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.421+0000 7f2f9eb67640 1 -- 172.21.15.53:0/1683236018 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2f9804d790 con 0x7f2f980b3ac0 2023-06-10T19:00:08.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.421+0000 7f2f957fa640 1 -- 172.21.15.53:0/1683236018 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4669 (secure 0 0 0) 0x7f2f900ef020 con 0x7f2f980b3ac0 2023-06-10T19:00:08.426 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:00:08.426 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":26,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5444,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1300171732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":1300171732},{"type":"v1","addr":"172.21.15.117:6837","nonce":1300171732}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5818,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/507478314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":507478314},{"type":"v1","addr":"172.21.15.117:6836","nonce":507478314}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":6504,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/169051241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":169051241},{"type":"v1","addr":"172.21.15.53:6833","nonce":169051241}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T18:57:13.234809+0000","modified":"2023-06-10T18:57:15.250305+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6507},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6507":{"gid":6507,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/486797221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":486797221},{"type":"v1","addr":"172.21.15.53:6835","nonce":486797221}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-06-10T19:00:08.427 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 26 2023-06-10T19:00:08.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.425+0000 7f2f9eb67640 1 -- 172.21.15.53:0/1683236018 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2f84066280 msgr2=0x7f2f84068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:08.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.425+0000 7f2f9eb67640 1 --2- 172.21.15.53:0/1683236018 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2f84066280 0x7f2f84068730 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f2f980b6dd0 tx=0x7f2f8c009040 comp rx=0 tx=0).stop 2023-06-10T19:00:08.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.425+0000 7f2f9eb67640 1 -- 172.21.15.53:0/1683236018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f980b3ac0 msgr2=0x7f2f98153f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:08.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.425+0000 7f2f9eb67640 1 --2- 172.21.15.53:0/1683236018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f980b3ac0 0x7f2f98153f30 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f2f900097c0 tx=0x7f2f9001ad50 comp rx=0 tx=0).stop 2023-06-10T19:00:08.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.425+0000 7f2f9eb67640 1 -- 172.21.15.53:0/1683236018 shutdown_connections 2023-06-10T19:00:08.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.425+0000 7f2f9eb67640 1 --2- 172.21.15.53:0/1683236018 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2f84066280 0x7f2f84068730 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:08.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.425+0000 7f2f9eb67640 1 --2- 172.21.15.53:0/1683236018 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2f980d14c0 0x7f2f9815e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:08.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.425+0000 7f2f9eb67640 1 --2- 172.21.15.53:0/1683236018 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2f980cc690 0x7f2f9815db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:08.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.425+0000 7f2f9eb67640 1 --2- 172.21.15.53:0/1683236018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f980b3ac0 0x7f2f98153f30 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:08.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.425+0000 7f2f9eb67640 1 -- 172.21.15.53:0/1683236018 >> 172.21.15.53:0/1683236018 conn(0x7f2f98071790 msgr2=0x7f2f980ce250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:08.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.425+0000 7f2f9eb67640 1 -- 172.21.15.53:0/1683236018 shutdown_connections 2023-06-10T19:00:08.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.425+0000 7f2f9eb67640 1 -- 172.21.15.53:0/1683236018 wait complete. 2023-06-10T19:00:08.443 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:00:08.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.553+0000 7fe42fc5a640 1 Processor -- start 2023-06-10T19:00:08.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.553+0000 7fe42fc5a640 1 -- start start 2023-06-10T19:00:08.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.553+0000 7fe42fc5a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4280b3ac0 0x7fe4280b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:08.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.553+0000 7fe42fc5a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe4280cc690 0x7fe42815f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:08.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.553+0000 7fe42fc5a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe4280ccae0 0x7fe42815f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:08.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.553+0000 7fe42fc5a640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4280d0020 con 0x7fe4280cc690 2023-06-10T19:00:08.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.553+0000 7fe42fc5a640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4280b43d0 con 0x7fe4280ccae0 2023-06-10T19:00:08.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.553+0000 7fe42fc5a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4280cef40 con 0x7fe4280b3ac0 2023-06-10T19:00:08.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.557+0000 7fe42d1f5640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe4280cc690 0x7fe42815f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:08.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.557+0000 7fe42d1f5640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe4280cc690 0x7fe42815f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49060/0 (socket says 172.21.15.53:49060) 2023-06-10T19:00:08.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.557+0000 7fe42d1f5640 1 -- 172.21.15.53:0/836439944 learned_addr learned my addr 172.21.15.53:0/836439944 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:08.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.557+0000 7fe42e1f7640 1 --2- 172.21.15.53:0/836439944 >> v2:172.21.15.117:3300/0 conn(0x7fe4280ccae0 0x7fe42815f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:08.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.557+0000 7fe42d9f6640 1 --2- 172.21.15.53:0/836439944 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4280b3ac0 0x7fe4280b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:08.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.557+0000 7fe42d1f5640 1 -- 172.21.15.53:0/836439944 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4280b3ac0 msgr2=0x7fe4280b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:08.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.557+0000 7fe42d1f5640 1 --2- 172.21.15.53:0/836439944 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4280b3ac0 0x7fe4280b3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:08.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.557+0000 7fe42d1f5640 1 -- 172.21.15.53:0/836439944 >> v2:172.21.15.117:3300/0 conn(0x7fe4280ccae0 msgr2=0x7fe42815f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:08.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.557+0000 7fe42d1f5640 1 --2- 172.21.15.53:0/836439944 >> v2:172.21.15.117:3300/0 conn(0x7fe4280ccae0 0x7fe42815f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:08.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.557+0000 7fe42d1f5640 1 -- 172.21.15.53:0/836439944 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4280cf220 con 0x7fe4280cc690 2023-06-10T19:00:08.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.557+0000 7fe42d9f6640 1 --2- 172.21.15.53:0/836439944 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4280b3ac0 0x7fe4280b3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:00:08.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.557+0000 7fe42e1f7640 1 --2- 172.21.15.53:0/836439944 >> v2:172.21.15.117:3300/0 conn(0x7fe4280ccae0 0x7fe42815f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:00:08.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.557+0000 7fe42d1f5640 1 --2- 172.21.15.53:0/836439944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4280cc690 0x7fe42815f370 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fe4280b14a0 tx=0x7fe41801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d24c564bda52456 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:08.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.557+0000 7fe42c9f4640 1 -- 172.21.15.53:0/836439944 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4180ac600 con 0x7fe4280cc690 2023-06-10T19:00:08.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.557+0000 7fe42c9f4640 1 -- 172.21.15.53:0/836439944 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4180a8050 con 0x7fe4280cc690 2023-06-10T19:00:08.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.557+0000 7fe42c9f4640 1 -- 172.21.15.53:0/836439944 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4180ac980 con 0x7fe4280cc690 2023-06-10T19:00:08.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.557+0000 7fe42fc5a640 1 -- 172.21.15.53:0/836439944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4280cc690 msgr2=0x7fe42815f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:08.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.557+0000 7fe42fc5a640 1 --2- 172.21.15.53:0/836439944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4280cc690 0x7fe42815f370 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fe4280b14a0 tx=0x7fe41801c4d0 comp rx=0 tx=0).stop 2023-06-10T19:00:08.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.557+0000 7fe42fc5a640 1 -- 172.21.15.53:0/836439944 shutdown_connections 2023-06-10T19:00:08.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.557+0000 7fe42fc5a640 1 --2- 172.21.15.53:0/836439944 >> v2:172.21.15.117:3300/0 conn(0x7fe4280ccae0 0x7fe42815f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:08.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.557+0000 7fe42fc5a640 1 --2- 172.21.15.53:0/836439944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4280cc690 0x7fe42815f370 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:08.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.557+0000 7fe42fc5a640 1 --2- 172.21.15.53:0/836439944 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4280b3ac0 0x7fe4280b3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:08.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.557+0000 7fe42fc5a640 1 -- 172.21.15.53:0/836439944 >> 172.21.15.53:0/836439944 conn(0x7fe428071790 msgr2=0x7fe428069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:08.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.557+0000 7fe42fc5a640 1 -- 172.21.15.53:0/836439944 shutdown_connections 2023-06-10T19:00:08.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.557+0000 7fe42fc5a640 1 -- 172.21.15.53:0/836439944 wait complete. 2023-06-10T19:00:08.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.561+0000 7fe42fc5a640 1 Processor -- start 2023-06-10T19:00:08.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.561+0000 7fe42fc5a640 1 -- start start 2023-06-10T19:00:08.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.561+0000 7fe42fc5a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4280b3ac0 0x7fe428152000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:08.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.561+0000 7fe42fc5a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4280cc690 0x7fe428156e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:08.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.561+0000 7fe42fc5a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4280ccae0 0x7fe428153020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:08.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.561+0000 7fe42fc5a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4281584b0 con 0x7fe4280b3ac0 2023-06-10T19:00:08.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.561+0000 7fe42fc5a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4281578a0 con 0x7fe4280cc690 2023-06-10T19:00:08.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.561+0000 7fe42fc5a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe428157b80 con 0x7fe4280ccae0 2023-06-10T19:00:08.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.561+0000 7fe42d9f6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4280b3ac0 0x7fe428152000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:08.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.561+0000 7fe42d9f6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4280b3ac0 0x7fe428152000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49068/0 (socket says 172.21.15.53:49068) 2023-06-10T19:00:08.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.561+0000 7fe42d9f6640 1 -- 172.21.15.53:0/2100412437 learned_addr learned my addr 172.21.15.53:0/2100412437 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:08.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.561+0000 7fe42d1f5640 1 --2- 172.21.15.53:0/2100412437 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4280cc690 0x7fe428156e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:08.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.561+0000 7fe42e1f7640 1 --2- 172.21.15.53:0/2100412437 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4280ccae0 0x7fe428153020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:08.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.561+0000 7fe42d9f6640 1 -- 172.21.15.53:0/2100412437 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4280ccae0 msgr2=0x7fe428153020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:08.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.561+0000 7fe42d9f6640 1 --2- 172.21.15.53:0/2100412437 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4280ccae0 0x7fe428153020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:08.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.561+0000 7fe42d9f6640 1 -- 172.21.15.53:0/2100412437 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4280cc690 msgr2=0x7fe428156e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:08.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.561+0000 7fe42d9f6640 1 --2- 172.21.15.53:0/2100412437 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4280cc690 0x7fe428156e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:08.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.561+0000 7fe42d9f6640 1 -- 172.21.15.53:0/2100412437 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4180094d0 con 0x7fe4280b3ac0 2023-06-10T19:00:08.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.561+0000 7fe42e1f7640 1 --2- 172.21.15.53:0/2100412437 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4280ccae0 0x7fe428153020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:00:08.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.561+0000 7fe42d1f5640 1 --2- 172.21.15.53:0/2100412437 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4280cc690 0x7fe428156e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:00:08.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.561+0000 7fe42d9f6640 1 --2- 172.21.15.53:0/2100412437 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4280b3ac0 0x7fe428152000 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fe42400c7c0 tx=0x7fe42400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:08.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.561+0000 7fe41e7fc640 1 -- 172.21.15.53:0/2100412437 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe424007a30 con 0x7fe4280b3ac0 2023-06-10T19:00:08.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.561+0000 7fe41e7fc640 1 -- 172.21.15.53:0/2100412437 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe424007b90 con 0x7fe4280b3ac0 2023-06-10T19:00:08.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.561+0000 7fe42fc5a640 1 -- 172.21.15.53:0/2100412437 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe428157e60 con 0x7fe4280b3ac0 2023-06-10T19:00:08.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.561+0000 7fe41e7fc640 1 -- 172.21.15.53:0/2100412437 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe42400ce70 con 0x7fe4280b3ac0 2023-06-10T19:00:08.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.561+0000 7fe42fc5a640 1 -- 172.21.15.53:0/2100412437 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe42815cea0 con 0x7fe4280b3ac0 2023-06-10T19:00:08.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.561+0000 7fe42fc5a640 1 -- 172.21.15.53:0/2100412437 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe42804d790 con 0x7fe4280b3ac0 2023-06-10T19:00:08.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.561+0000 7fe41e7fc640 1 -- 172.21.15.53:0/2100412437 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe4240113f0 con 0x7fe4280b3ac0 2023-06-10T19:00:08.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.565+0000 7fe41e7fc640 1 --2- 172.21.15.53:0/2100412437 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe40c066280 0x7fe40c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:08.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.565+0000 7fe41e7fc640 1 -- 172.21.15.53:0/2100412437 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6221+0+0 (secure 0 0 0) 0x7fe424084040 con 0x7fe4280b3ac0 2023-06-10T19:00:08.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.565+0000 7fe42d1f5640 1 --2- 172.21.15.53:0/2100412437 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe40c066280 0x7fe40c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:08.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.565+0000 7fe42d1f5640 1 --2- 172.21.15.53:0/2100412437 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe40c066280 0x7fe40c068730 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fe4180ae000 tx=0x7fe418008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:08.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.569+0000 7fe41e7fc640 1 -- 172.21.15.53:0/2100412437 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe4240b4700 con 0x7fe4280b3ac0 2023-06-10T19:00:08.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.721+0000 7fe42fc5a640 1 -- 172.21.15.53:0/2100412437 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe4280b1b10 con 0x7fe4280b3ac0 2023-06-10T19:00:08.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.721+0000 7fe41e7fc640 1 -- 172.21.15.53:0/2100412437 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) v1 ==== 74+0+18533 (secure 0 0 0) 0x7fe424051380 con 0x7fe4280b3ac0 2023-06-10T19:00:08.728 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:00:08.728 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":68,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T18:59:28.908909+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-06-10T18:57:11.323255+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-06-10T18:57:12.231973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.13","mappings":[{"from":7,"to":2}]},{"pgid":"10.10","mappings":[{"from":4,"to":3}]},{"pgid":"10.21","mappings":[{"from":4,"to":3}]},{"pgid":"10.25","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.0.1:0/683847329":"2023-06-10T19:59:28.260070+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:00:08.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.725+0000 7fe42fc5a640 1 -- 172.21.15.53:0/2100412437 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe40c066280 msgr2=0x7fe40c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:08.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.725+0000 7fe42fc5a640 1 --2- 172.21.15.53:0/2100412437 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe40c066280 0x7fe40c068730 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fe4180ae000 tx=0x7fe418008040 comp rx=0 tx=0).stop 2023-06-10T19:00:08.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.725+0000 7fe42fc5a640 1 -- 172.21.15.53:0/2100412437 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4280b3ac0 msgr2=0x7fe428152000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:08.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.725+0000 7fe42fc5a640 1 --2- 172.21.15.53:0/2100412437 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4280b3ac0 0x7fe428152000 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fe42400c7c0 tx=0x7fe42400cc80 comp rx=0 tx=0).stop 2023-06-10T19:00:08.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.725+0000 7fe42fc5a640 1 -- 172.21.15.53:0/2100412437 shutdown_connections 2023-06-10T19:00:08.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.725+0000 7fe42fc5a640 1 --2- 172.21.15.53:0/2100412437 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe40c066280 0x7fe40c068730 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:08.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.725+0000 7fe42fc5a640 1 --2- 172.21.15.53:0/2100412437 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4280ccae0 0x7fe428153020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:08.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.725+0000 7fe42fc5a640 1 --2- 172.21.15.53:0/2100412437 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4280cc690 0x7fe428156e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:08.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.725+0000 7fe42fc5a640 1 --2- 172.21.15.53:0/2100412437 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4280b3ac0 0x7fe428152000 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:08.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.725+0000 7fe42fc5a640 1 -- 172.21.15.53:0/2100412437 >> 172.21.15.53:0/2100412437 conn(0x7fe428071790 msgr2=0x7fe4280b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:08.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.725+0000 7fe42fc5a640 1 -- 172.21.15.53:0/2100412437 shutdown_connections 2023-06-10T19:00:08.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.725+0000 7fe42fc5a640 1 -- 172.21.15.53:0/2100412437 wait complete. 2023-06-10T19:00:08.746 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-06-10T19:00:08.746 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:00:08.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.861+0000 7f45708cd640 1 Processor -- start 2023-06-10T19:00:08.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.861+0000 7f45708cd640 1 -- start start 2023-06-10T19:00:08.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.865+0000 7f45708cd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f456c0c9750 0x7f456c0aced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:08.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.865+0000 7f45708cd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f456c0cb870 0x7f456c0af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:08.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.865+0000 7f45708cd640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f456c0ad410 con 0x7f456c0afc60 2023-06-10T19:00:08.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.865+0000 7f45708cd640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f456c0cd990 con 0x7f456c0cb870 2023-06-10T19:00:08.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.865+0000 7f45708cd640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f456c0b00e0 con 0x7f456c0c9750 2023-06-10T19:00:08.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.865+0000 7f4569d9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f456c0cb870 0x7f456c0af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:08.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.865+0000 7f456ad9d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f456c0afc60 0x7f456c15bec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:33632/0 (socket says 172.21.15.53:33632) 2023-06-10T19:00:08.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.865+0000 7f456ad9d640 1 -- 172.21.15.53:0/1286572610 learned_addr learned my addr 172.21.15.53:0/1286572610 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:00:08.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.865+0000 7f456a59c640 1 --2- 172.21.15.53:0/1286572610 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f456c0c9750 0x7f456c0aced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:08.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.865+0000 7f4569d9b640 1 -- 172.21.15.53:0/1286572610 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f456c0c9750 msgr2=0x7f456c0aced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:08.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.865+0000 7f4569d9b640 1 --2- 172.21.15.53:0/1286572610 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f456c0c9750 0x7f456c0aced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:08.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.865+0000 7f4569d9b640 1 -- 172.21.15.53:0/1286572610 >> v1:172.21.15.53:6789/0 conn(0x7f456c0afc60 legacy=0x7f456c15bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:08.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.865+0000 7f4569d9b640 1 -- 172.21.15.53:0/1286572610 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f456c1600d0 con 0x7f456c0cb870 2023-06-10T19:00:08.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.865+0000 7f456959a640 1 -- 172.21.15.53:0/1286572610 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 37103914 0 0) 0x7f456c0ad410 con 0x7f456c0afc60 2023-06-10T19:00:08.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.865+0000 7f4569d9b640 1 --2- 172.21.15.53:0/1286572610 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f456c0cb870 0x7f456c0af720 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f45600097c0 tx=0x7f456001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ed8216c03965bc server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:08.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.865+0000 7f456959a640 1 -- 172.21.15.53:0/1286572610 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45600ab650 con 0x7f456c0cb870 2023-06-10T19:00:08.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.869+0000 7f456959a640 1 -- 172.21.15.53:0/1286572610 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45600ab7b0 con 0x7f456c0cb870 2023-06-10T19:00:08.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.869+0000 7f456959a640 1 -- 172.21.15.53:0/1286572610 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45600abb40 con 0x7f456c0cb870 2023-06-10T19:00:08.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.869+0000 7f45708cd640 1 -- 172.21.15.53:0/1286572610 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f456c0cb870 msgr2=0x7f456c0af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:08.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.869+0000 7f45708cd640 1 --2- 172.21.15.53:0/1286572610 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f456c0cb870 0x7f456c0af720 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f45600097c0 tx=0x7f456001c450 comp rx=0 tx=0).stop 2023-06-10T19:00:08.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.869+0000 7f45708cd640 1 -- 172.21.15.53:0/1286572610 shutdown_connections 2023-06-10T19:00:08.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.869+0000 7f45708cd640 1 --2- 172.21.15.53:0/1286572610 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f456c0cb870 0x7f456c0af720 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:08.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.869+0000 7f45708cd640 1 --2- 172.21.15.53:0/1286572610 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f456c0c9750 0x7f456c0aced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:08.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.869+0000 7f45708cd640 1 -- 172.21.15.53:0/1286572610 >> 172.21.15.53:0/1286572610 conn(0x7f456c06a0d0 msgr2=0x7f456c0ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:08.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.869+0000 7f45708cd640 1 -- 172.21.15.53:0/1286572610 shutdown_connections 2023-06-10T19:00:08.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.869+0000 7f45708cd640 1 -- 172.21.15.53:0/1286572610 wait complete. 2023-06-10T19:00:08.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.869+0000 7f45708cd640 1 Processor -- start 2023-06-10T19:00:08.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.869+0000 7f45708cd640 1 -- start start 2023-06-10T19:00:08.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.869+0000 7f45708cd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f456c0afc60 0x7f456c15ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:08.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.869+0000 7f45708cd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f456c0c9750 0x7f456c154fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:08.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.869+0000 7f45708cd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f456c0cb870 0x7f456c0ae0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:08.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.869+0000 7f45708cd640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f456c151e10 con 0x7f456c0afc60 2023-06-10T19:00:08.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.869+0000 7f45708cd640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f456c149c60 con 0x7f456c0c9750 2023-06-10T19:00:08.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.869+0000 7f45708cd640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f456c151980 con 0x7f456c0cb870 2023-06-10T19:00:08.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.869+0000 7f456a59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f456c0afc60 0x7f456c15ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:08.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.869+0000 7f456a59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f456c0afc60 0x7f456c15ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49082/0 (socket says 172.21.15.53:49082) 2023-06-10T19:00:08.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.869+0000 7f456a59c640 1 -- 172.21.15.53:0/4236390161 learned_addr learned my addr 172.21.15.53:0/4236390161 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:08.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.869+0000 7f456ad9d640 1 --2- 172.21.15.53:0/4236390161 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f456c0cb870 0x7f456c0ae0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:08.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.869+0000 7f4569d9b640 1 --2- 172.21.15.53:0/4236390161 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f456c0c9750 0x7f456c154fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:08.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.869+0000 7f456a59c640 1 -- 172.21.15.53:0/4236390161 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f456c0cb870 msgr2=0x7f456c0ae0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:08.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.869+0000 7f456a59c640 1 --2- 172.21.15.53:0/4236390161 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f456c0cb870 0x7f456c0ae0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:08.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.869+0000 7f456a59c640 1 -- 172.21.15.53:0/4236390161 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f456c0c9750 msgr2=0x7f456c154fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:08.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.869+0000 7f456a59c640 1 --2- 172.21.15.53:0/4236390161 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f456c0c9750 0x7f456c154fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:08.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.869+0000 7f456a59c640 1 -- 172.21.15.53:0/4236390161 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4560009420 con 0x7f456c0afc60 2023-06-10T19:00:08.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.869+0000 7f4569d9b640 1 --2- 172.21.15.53:0/4236390161 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f456c0c9750 0x7f456c154fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:00:08.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.869+0000 7f456a59c640 1 --2- 172.21.15.53:0/4236390161 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f456c0afc60 0x7f456c15ec80 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f455c00d5f0 tx=0x7f455c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:08.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.869+0000 7f455affd640 1 -- 172.21.15.53:0/4236390161 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f455c0125f0 con 0x7f456c0afc60 2023-06-10T19:00:08.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.869+0000 7f455affd640 1 -- 172.21.15.53:0/4236390161 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f455c012750 con 0x7f456c0afc60 2023-06-10T19:00:08.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.869+0000 7f455affd640 1 -- 172.21.15.53:0/4236390161 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f455c012ae0 con 0x7f456c0afc60 2023-06-10T19:00:08.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.873+0000 7f45708cd640 1 -- 172.21.15.53:0/4236390161 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f456c0ae940 con 0x7f456c0afc60 2023-06-10T19:00:08.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.873+0000 7f45708cd640 1 -- 172.21.15.53:0/4236390161 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f456c151610 con 0x7f456c0afc60 2023-06-10T19:00:08.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.873+0000 7f45708cd640 1 -- 172.21.15.53:0/4236390161 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f456c04d790 con 0x7f456c0afc60 2023-06-10T19:00:08.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.873+0000 7f455affd640 1 -- 172.21.15.53:0/4236390161 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f455c012c40 con 0x7f456c0afc60 2023-06-10T19:00:08.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.873+0000 7f455affd640 1 --2- 172.21.15.53:0/4236390161 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f454c0662b0 0x7f454c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:08.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.873+0000 7f455affd640 1 -- 172.21.15.53:0/4236390161 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6221+0+0 (secure 0 0 0) 0x7f455c084210 con 0x7f456c0afc60 2023-06-10T19:00:08.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.873+0000 7f4569d9b640 1 --2- 172.21.15.53:0/4236390161 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f454c0662b0 0x7f454c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:08.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.873+0000 7f4569d9b640 1 --2- 172.21.15.53:0/4236390161 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f454c0662b0 0x7f454c068760 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f45600af000 tx=0x7f45600a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:08.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:08.877+0000 7f455affd640 1 -- 172.21.15.53:0/4236390161 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f455c0515f0 con 0x7f456c0afc60 2023-06-10T19:00:09.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.065+0000 7f45708cd640 1 -- 172.21.15.53:0/4236390161 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f456c0b0680 con 0x7f456c0afc60 2023-06-10T19:00:09.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.065+0000 7f455affd640 1 -- 172.21.15.53:0/4236390161 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4669 (secure 0 0 0) 0x7f455c007380 con 0x7f456c0afc60 2023-06-10T19:00:09.070 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:00:09.070 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":26,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5444,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1300171732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":1300171732},{"type":"v1","addr":"172.21.15.117:6837","nonce":1300171732}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5818,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/507478314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":507478314},{"type":"v1","addr":"172.21.15.117:6836","nonce":507478314}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":6504,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/169051241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":169051241},{"type":"v1","addr":"172.21.15.53:6833","nonce":169051241}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T18:57:13.234809+0000","modified":"2023-06-10T18:57:15.250305+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6507},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6507":{"gid":6507,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/486797221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":486797221},{"type":"v1","addr":"172.21.15.53:6835","nonce":486797221}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-06-10T19:00:09.071 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 26 2023-06-10T19:00:09.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.069+0000 7f45708cd640 1 -- 172.21.15.53:0/4236390161 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f454c0662b0 msgr2=0x7f454c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:09.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.069+0000 7f45708cd640 1 --2- 172.21.15.53:0/4236390161 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f454c0662b0 0x7f454c068760 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f45600af000 tx=0x7f45600a7000 comp rx=0 tx=0).stop 2023-06-10T19:00:09.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.069+0000 7f45708cd640 1 -- 172.21.15.53:0/4236390161 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f456c0afc60 msgr2=0x7f456c15ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:09.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.069+0000 7f45708cd640 1 --2- 172.21.15.53:0/4236390161 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f456c0afc60 0x7f456c15ec80 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f455c00d5f0 tx=0x7f455c00dab0 comp rx=0 tx=0).stop 2023-06-10T19:00:09.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.069+0000 7f45708cd640 1 -- 172.21.15.53:0/4236390161 shutdown_connections 2023-06-10T19:00:09.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.069+0000 7f45708cd640 1 --2- 172.21.15.53:0/4236390161 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f454c0662b0 0x7f454c068760 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:09.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.069+0000 7f45708cd640 1 --2- 172.21.15.53:0/4236390161 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f456c0cb870 0x7f456c0ae0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:09.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.069+0000 7f45708cd640 1 --2- 172.21.15.53:0/4236390161 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f456c0c9750 0x7f456c154fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:09.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.069+0000 7f45708cd640 1 --2- 172.21.15.53:0/4236390161 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f456c0afc60 0x7f456c15ec80 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:09.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.069+0000 7f45708cd640 1 -- 172.21.15.53:0/4236390161 >> 172.21.15.53:0/4236390161 conn(0x7f456c06a0d0 msgr2=0x7f456c06b120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:09.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.069+0000 7f45708cd640 1 -- 172.21.15.53:0/4236390161 shutdown_connections 2023-06-10T19:00:09.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.069+0000 7f45708cd640 1 -- 172.21.15.53:0/4236390161 wait complete. 2023-06-10T19:00:09.089 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:00:09.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.205+0000 7f6eec451640 1 Processor -- start 2023-06-10T19:00:09.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.205+0000 7f6eec451640 1 -- start start 2023-06-10T19:00:09.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.209+0000 7f6eec451640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6ee40af720 0x7f6ee4070e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:09.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.209+0000 7f6eec451640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ee406b090 0x7f6ee406b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:09.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.209+0000 7f6eec451640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ee40afba0 con 0x7f6ee40b3390 2023-06-10T19:00:09.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.209+0000 7f6eec451640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ee406ba50 con 0x7f6ee40af720 2023-06-10T19:00:09.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.209+0000 7f6eec451640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee40c82f0 con 0x7f6ee406b090 2023-06-10T19:00:09.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.209+0000 7f6eea1ed640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f6ee40b3390 0x7f6ee40c8d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:33646/0 (socket says 172.21.15.53:33646) 2023-06-10T19:00:09.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.209+0000 7f6eea1ed640 1 -- 172.21.15.53:0/3089364439 learned_addr learned my addr 172.21.15.53:0/3089364439 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:00:09.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.209+0000 7f6ee99ec640 1 --2- 172.21.15.53:0/3089364439 >> v2:172.21.15.53:3300/0 conn(0x7f6ee40af720 0x7f6ee4070e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:09.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.209+0000 7f6eea9ee640 1 --2- 172.21.15.53:0/3089364439 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ee406b090 0x7f6ee406b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:09.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.209+0000 7f6ee91eb640 1 -- 172.21.15.53:0/3089364439 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3448923800 0 0) 0x7f6ee40afba0 con 0x7f6ee40b3390 2023-06-10T19:00:09.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.209+0000 7f6ee91eb640 1 -- 172.21.15.53:0/3089364439 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ed0003530 con 0x7f6ee40b3390 2023-06-10T19:00:09.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.209+0000 7f6ee99ec640 1 -- 172.21.15.53:0/3089364439 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ee406b090 msgr2=0x7f6ee406b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:09.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.209+0000 7f6ee99ec640 1 --2- 172.21.15.53:0/3089364439 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ee406b090 0x7f6ee406b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:09.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.209+0000 7f6ee99ec640 1 -- 172.21.15.53:0/3089364439 >> v1:172.21.15.53:6789/0 conn(0x7f6ee40b3390 legacy=0x7f6ee40c8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:09.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.209+0000 7f6ee99ec640 1 -- 172.21.15.53:0/3089364439 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ee40b3760 con 0x7f6ee40af720 2023-06-10T19:00:09.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.209+0000 7f6ee99ec640 1 --2- 172.21.15.53:0/3089364439 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ee40af720 0x7f6ee4070e30 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f6ed40097c0 tx=0x7f6ed401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c172d140ac47d510 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:09.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.209+0000 7f6ee91eb640 1 -- 172.21.15.53:0/3089364439 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed40ab600 con 0x7f6ee40af720 2023-06-10T19:00:09.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.209+0000 7f6ee91eb640 1 -- 172.21.15.53:0/3089364439 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ed40a7050 con 0x7f6ee40af720 2023-06-10T19:00:09.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.209+0000 7f6ee91eb640 1 -- 172.21.15.53:0/3089364439 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed40ab960 con 0x7f6ee40af720 2023-06-10T19:00:09.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.209+0000 7f6eec451640 1 -- 172.21.15.53:0/3089364439 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ee40af720 msgr2=0x7f6ee4070e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:09.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.209+0000 7f6eec451640 1 --2- 172.21.15.53:0/3089364439 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ee40af720 0x7f6ee4070e30 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f6ed40097c0 tx=0x7f6ed401c480 comp rx=0 tx=0).stop 2023-06-10T19:00:09.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.209+0000 7f6eec451640 1 -- 172.21.15.53:0/3089364439 shutdown_connections 2023-06-10T19:00:09.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.209+0000 7f6eec451640 1 --2- 172.21.15.53:0/3089364439 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ee40af720 0x7f6ee4070e30 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:09.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.209+0000 7f6eec451640 1 --2- 172.21.15.53:0/3089364439 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ee406b090 0x7f6ee406b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:09.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.209+0000 7f6eec451640 1 -- 172.21.15.53:0/3089364439 >> 172.21.15.53:0/3089364439 conn(0x7f6ee406a0d0 msgr2=0x7f6ee40ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:09.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.209+0000 7f6eec451640 1 -- 172.21.15.53:0/3089364439 shutdown_connections 2023-06-10T19:00:09.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.209+0000 7f6eec451640 1 -- 172.21.15.53:0/3089364439 wait complete. 2023-06-10T19:00:09.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.213+0000 7f6eec451640 1 Processor -- start 2023-06-10T19:00:09.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.213+0000 7f6eec451640 1 -- start start 2023-06-10T19:00:09.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.213+0000 7f6eec451640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ee406b090 0x7f6ee4153260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:09.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.213+0000 7f6eec451640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ee40af720 0x7f6ee40c7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:09.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.213+0000 7f6eec451640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ee40b3390 0x7f6ee40acbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:09.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.213+0000 7f6eec451640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee41537a0 con 0x7f6ee406b090 2023-06-10T19:00:09.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.213+0000 7f6eec451640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee40ab860 con 0x7f6ee40af720 2023-06-10T19:00:09.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.213+0000 7f6eec451640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee40abb40 con 0x7f6ee40b3390 2023-06-10T19:00:09.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.213+0000 7f6eea1ed640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ee406b090 0x7f6ee4153260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:09.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.213+0000 7f6eea1ed640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ee406b090 0x7f6ee4153260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49100/0 (socket says 172.21.15.53:49100) 2023-06-10T19:00:09.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.213+0000 7f6eea1ed640 1 -- 172.21.15.53:0/2853624713 learned_addr learned my addr 172.21.15.53:0/2853624713 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:09.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.213+0000 7f6ee99ec640 1 --2- 172.21.15.53:0/2853624713 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ee40af720 0x7f6ee40c7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:09.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.213+0000 7f6eea9ee640 1 --2- 172.21.15.53:0/2853624713 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ee40b3390 0x7f6ee40acbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:09.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.213+0000 7f6eea1ed640 1 -- 172.21.15.53:0/2853624713 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ee40b3390 msgr2=0x7f6ee40acbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:09.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.213+0000 7f6eea1ed640 1 --2- 172.21.15.53:0/2853624713 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ee40b3390 0x7f6ee40acbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:09.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.213+0000 7f6eea1ed640 1 -- 172.21.15.53:0/2853624713 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ee40af720 msgr2=0x7f6ee40c7730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:09.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.213+0000 7f6eea1ed640 1 --2- 172.21.15.53:0/2853624713 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ee40af720 0x7f6ee40c7730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:09.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.213+0000 7f6eea1ed640 1 -- 172.21.15.53:0/2853624713 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ed4009420 con 0x7f6ee406b090 2023-06-10T19:00:09.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.213+0000 7f6ee99ec640 1 --2- 172.21.15.53:0/2853624713 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ee40af720 0x7f6ee40c7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:00:09.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.213+0000 7f6eea1ed640 1 --2- 172.21.15.53:0/2853624713 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ee406b090 0x7f6ee4153260 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f6ee000cb40 tx=0x7f6ee000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:09.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.213+0000 7f6edaffd640 1 -- 172.21.15.53:0/2853624713 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee000aca0 con 0x7f6ee406b090 2023-06-10T19:00:09.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.213+0000 7f6edaffd640 1 -- 172.21.15.53:0/2853624713 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ee000ae00 con 0x7f6ee406b090 2023-06-10T19:00:09.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.213+0000 7f6eec451640 1 -- 172.21.15.53:0/2853624713 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ee40abe20 con 0x7f6ee406b090 2023-06-10T19:00:09.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.213+0000 7f6edaffd640 1 -- 172.21.15.53:0/2853624713 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee0012620 con 0x7f6ee406b090 2023-06-10T19:00:09.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.213+0000 7f6eec451640 1 -- 172.21.15.53:0/2853624713 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ee40ac3e0 con 0x7f6ee406b090 2023-06-10T19:00:09.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.213+0000 7f6eec451640 1 -- 172.21.15.53:0/2853624713 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ee404d790 con 0x7f6ee406b090 2023-06-10T19:00:09.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.217+0000 7f6edaffd640 1 -- 172.21.15.53:0/2853624713 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6ee0007070 con 0x7f6ee406b090 2023-06-10T19:00:09.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.217+0000 7f6edaffd640 1 --2- 172.21.15.53:0/2853624713 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6ec80662b0 0x7f6ec8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:09.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.217+0000 7f6edaffd640 1 -- 172.21.15.53:0/2853624713 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6221+0+0 (secure 0 0 0) 0x7f6ee0083d30 con 0x7f6ee406b090 2023-06-10T19:00:09.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.217+0000 7f6ee99ec640 1 --2- 172.21.15.53:0/2853624713 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6ec80662b0 0x7f6ec8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:09.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.217+0000 7f6ee99ec640 1 --2- 172.21.15.53:0/2853624713 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6ec80662b0 0x7f6ec8068760 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f6ed40ad000 tx=0x7f6ed40a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:09.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.221+0000 7f6edaffd640 1 -- 172.21.15.53:0/2853624713 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6ee00511a0 con 0x7f6ee406b090 2023-06-10T19:00:09.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.405+0000 7f6eec451640 1 -- 172.21.15.53:0/2853624713 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6ee4070f30 con 0x7f6ee406b090 2023-06-10T19:00:09.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.405+0000 7f6edaffd640 1 -- 172.21.15.53:0/2853624713 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4669 (secure 0 0 0) 0x7f6ee0017070 con 0x7f6ee406b090 2023-06-10T19:00:09.410 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:00:09.410 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":26,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5444,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1300171732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":1300171732},{"type":"v1","addr":"172.21.15.117:6837","nonce":1300171732}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5818,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/507478314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":507478314},{"type":"v1","addr":"172.21.15.117:6836","nonce":507478314}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":6504,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/169051241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":169051241},{"type":"v1","addr":"172.21.15.53:6833","nonce":169051241}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T18:57:13.234809+0000","modified":"2023-06-10T18:57:15.250305+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6507},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6507":{"gid":6507,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/486797221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":486797221},{"type":"v1","addr":"172.21.15.53:6835","nonce":486797221}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-06-10T19:00:09.411 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 26 2023-06-10T19:00:09.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.409+0000 7f6eec451640 1 -- 172.21.15.53:0/2853624713 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6ec80662b0 msgr2=0x7f6ec8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:09.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.409+0000 7f6eec451640 1 --2- 172.21.15.53:0/2853624713 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6ec80662b0 0x7f6ec8068760 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f6ed40ad000 tx=0x7f6ed40a6000 comp rx=0 tx=0).stop 2023-06-10T19:00:09.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.409+0000 7f6eec451640 1 -- 172.21.15.53:0/2853624713 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ee406b090 msgr2=0x7f6ee4153260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:09.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.409+0000 7f6eec451640 1 --2- 172.21.15.53:0/2853624713 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ee406b090 0x7f6ee4153260 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f6ee000cb40 tx=0x7f6ee000a060 comp rx=0 tx=0).stop 2023-06-10T19:00:09.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.409+0000 7f6eec451640 1 -- 172.21.15.53:0/2853624713 shutdown_connections 2023-06-10T19:00:09.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.409+0000 7f6eec451640 1 --2- 172.21.15.53:0/2853624713 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6ec80662b0 0x7f6ec8068760 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:09.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.409+0000 7f6eec451640 1 --2- 172.21.15.53:0/2853624713 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ee40b3390 0x7f6ee40acbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:09.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.409+0000 7f6eec451640 1 --2- 172.21.15.53:0/2853624713 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ee40af720 0x7f6ee40c7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:09.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.409+0000 7f6eec451640 1 --2- 172.21.15.53:0/2853624713 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ee406b090 0x7f6ee4153260 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:09.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.409+0000 7f6eec451640 1 -- 172.21.15.53:0/2853624713 >> 172.21.15.53:0/2853624713 conn(0x7f6ee406a0d0 msgr2=0x7f6ee40ad700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:09.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.409+0000 7f6eec451640 1 -- 172.21.15.53:0/2853624713 shutdown_connections 2023-06-10T19:00:09.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.409+0000 7f6eec451640 1 -- 172.21.15.53:0/2853624713 wait complete. 2023-06-10T19:00:09.427 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:00:09.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.533+0000 7f946c17c640 1 Processor -- start 2023-06-10T19:00:09.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.533+0000 7f946c17c640 1 -- start start 2023-06-10T19:00:09.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.533+0000 7f946c17c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f946415eef0 0x7f9464070f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:09.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.533+0000 7f946c17c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f946415f570 0x7f94640ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:09.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.533+0000 7f946c17c640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f946415f2c0 con 0x7f94640ce990 2023-06-10T19:00:09.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.533+0000 7f946c17c640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f946415fdc0 con 0x7f946415eef0 2023-06-10T19:00:09.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.533+0000 7f946c17c640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94641600a0 con 0x7f946415f570 2023-06-10T19:00:09.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.533+0000 7f9469f18640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f946415eef0 0x7f9464070f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:09.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.533+0000 7f946a719640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f94640ce990 0x7f9464069450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:33656/0 (socket says 172.21.15.53:33656) 2023-06-10T19:00:09.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.533+0000 7f946a719640 1 -- 172.21.15.53:0/372791239 learned_addr learned my addr 172.21.15.53:0/372791239 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:00:09.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.533+0000 7f9469717640 1 --2- 172.21.15.53:0/372791239 >> v2:172.21.15.117:3300/0 conn(0x7f946415f570 0x7f94640ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:09.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.533+0000 7f9469f18640 1 -- 172.21.15.53:0/372791239 >> v2:172.21.15.117:3300/0 conn(0x7f946415f570 msgr2=0x7f94640ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:09.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.533+0000 7f9469f18640 1 --2- 172.21.15.53:0/372791239 >> v2:172.21.15.117:3300/0 conn(0x7f946415f570 0x7f94640ce450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:09.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.533+0000 7f9469f18640 1 -- 172.21.15.53:0/372791239 >> v1:172.21.15.53:6789/0 conn(0x7f94640ce990 legacy=0x7f9464069450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:09.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.533+0000 7f9469f18640 1 -- 172.21.15.53:0/372791239 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9464160380 con 0x7f946415eef0 2023-06-10T19:00:09.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.533+0000 7f9468f16640 1 -- 172.21.15.53:0/372791239 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 863702811 0 0) 0x7f946415f2c0 con 0x7f94640ce990 2023-06-10T19:00:09.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.533+0000 7f9469717640 1 --2- 172.21.15.53:0/372791239 >> v2:172.21.15.117:3300/0 conn(0x7f946415f570 0x7f94640ce450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:00:09.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.537+0000 7f9469f18640 1 --2- 172.21.15.53:0/372791239 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f946415eef0 0x7f9464070f80 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f9464070060 tx=0x7f946001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6d93dbe65670ce7 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:09.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.537+0000 7f9468f16640 1 -- 172.21.15.53:0/372791239 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94600ab600 con 0x7f946415eef0 2023-06-10T19:00:09.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.537+0000 7f9468f16640 1 -- 172.21.15.53:0/372791239 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94600a7050 con 0x7f946415eef0 2023-06-10T19:00:09.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.537+0000 7f9468f16640 1 -- 172.21.15.53:0/372791239 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94600ab980 con 0x7f946415eef0 2023-06-10T19:00:09.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.537+0000 7f946c17c640 1 -- 172.21.15.53:0/372791239 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f946415eef0 msgr2=0x7f9464070f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:09.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.537+0000 7f946c17c640 1 --2- 172.21.15.53:0/372791239 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f946415eef0 0x7f9464070f80 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f9464070060 tx=0x7f946001c460 comp rx=0 tx=0).stop 2023-06-10T19:00:09.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.537+0000 7f946c17c640 1 -- 172.21.15.53:0/372791239 shutdown_connections 2023-06-10T19:00:09.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.537+0000 7f946c17c640 1 --2- 172.21.15.53:0/372791239 >> v2:172.21.15.117:3300/0 conn(0x7f946415f570 0x7f94640ce450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:09.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.537+0000 7f946c17c640 1 --2- 172.21.15.53:0/372791239 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f946415eef0 0x7f9464070f80 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:09.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.537+0000 7f946c17c640 1 -- 172.21.15.53:0/372791239 >> 172.21.15.53:0/372791239 conn(0x7f946406a560 msgr2=0x7f946406a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:09.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.537+0000 7f946c17c640 1 -- 172.21.15.53:0/372791239 shutdown_connections 2023-06-10T19:00:09.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.537+0000 7f946c17c640 1 -- 172.21.15.53:0/372791239 wait complete. 2023-06-10T19:00:09.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.537+0000 7f946c17c640 1 Processor -- start 2023-06-10T19:00:09.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.537+0000 7f946c17c640 1 -- start start 2023-06-10T19:00:09.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.537+0000 7f946c17c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94640ce990 0x7f9464149da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:09.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.537+0000 7f946c17c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f946415eef0 0x7f946414da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:09.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.537+0000 7f946c17c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f946415f570 0x7f94640c9f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:09.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.537+0000 7f946c17c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94640c5490 con 0x7f946415f570 2023-06-10T19:00:09.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.537+0000 7f946c17c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94640c2c50 con 0x7f946415eef0 2023-06-10T19:00:09.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.537+0000 7f946c17c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94640c2f30 con 0x7f94640ce990 2023-06-10T19:00:09.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.541+0000 7f946a719640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f946415f570 0x7f94640c9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:09.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.541+0000 7f946a719640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f946415f570 0x7f94640c9f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49118/0 (socket says 172.21.15.53:49118) 2023-06-10T19:00:09.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.541+0000 7f946a719640 1 -- 172.21.15.53:0/1445364105 learned_addr learned my addr 172.21.15.53:0/1445364105 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:09.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.541+0000 7f9469717640 1 --2- 172.21.15.53:0/1445364105 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f946415eef0 0x7f946414da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:09.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.541+0000 7f9469f18640 1 --2- 172.21.15.53:0/1445364105 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94640ce990 0x7f9464149da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:09.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.541+0000 7f946a719640 1 -- 172.21.15.53:0/1445364105 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94640ce990 msgr2=0x7f9464149da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:09.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.541+0000 7f946a719640 1 --2- 172.21.15.53:0/1445364105 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94640ce990 0x7f9464149da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:09.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.541+0000 7f946a719640 1 -- 172.21.15.53:0/1445364105 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f946415eef0 msgr2=0x7f946414da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:09.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.541+0000 7f946a719640 1 --2- 172.21.15.53:0/1445364105 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f946415eef0 0x7f946414da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:09.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.541+0000 7f946a719640 1 -- 172.21.15.53:0/1445364105 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9460009420 con 0x7f946415f570 2023-06-10T19:00:09.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.541+0000 7f946a719640 1 --2- 172.21.15.53:0/1445364105 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f946415f570 0x7f94640c9f60 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f945c001570 tx=0x7f945c00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:09.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.541+0000 7f945a7fc640 1 -- 172.21.15.53:0/1445364105 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f945c00a640 con 0x7f946415f570 2023-06-10T19:00:09.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.541+0000 7f945a7fc640 1 -- 172.21.15.53:0/1445364105 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f945c00a7c0 con 0x7f946415f570 2023-06-10T19:00:09.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.541+0000 7f946c17c640 1 -- 172.21.15.53:0/1445364105 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94640c3210 con 0x7f946415f570 2023-06-10T19:00:09.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.541+0000 7f945a7fc640 1 -- 172.21.15.53:0/1445364105 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f945c00ab70 con 0x7f946415f570 2023-06-10T19:00:09.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.541+0000 7f946c17c640 1 -- 172.21.15.53:0/1445364105 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94640c37d0 con 0x7f946415f570 2023-06-10T19:00:09.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.541+0000 7f946c17c640 1 -- 172.21.15.53:0/1445364105 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f946404d790 con 0x7f946415f570 2023-06-10T19:00:09.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.541+0000 7f945a7fc640 1 -- 172.21.15.53:0/1445364105 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f945c00acd0 con 0x7f946415f570 2023-06-10T19:00:09.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.541+0000 7f945a7fc640 1 --2- 172.21.15.53:0/1445364105 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f94480662b0 0x7f9448068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:09.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.541+0000 7f945a7fc640 1 -- 172.21.15.53:0/1445364105 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6221+0+0 (secure 0 0 0) 0x7f945c083670 con 0x7f946415f570 2023-06-10T19:00:09.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.541+0000 7f9469f18640 1 --2- 172.21.15.53:0/1445364105 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f94480662b0 0x7f9448068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:09.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.541+0000 7f9469f18640 1 --2- 172.21.15.53:0/1445364105 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f94480662b0 0x7f9448068760 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f94600ad000 tx=0x7f9460008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:09.550 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.545+0000 7f945a7fc640 1 -- 172.21.15.53:0/1445364105 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f945c0509b0 con 0x7f946415f570 2023-06-10T19:00:09.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.697+0000 7f946c17c640 1 -- 172.21.15.53:0/1445364105 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f94640c9180 con 0x7f946415f570 2023-06-10T19:00:09.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.697+0000 7f945a7fc640 1 -- 172.21.15.53:0/1445364105 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) v1 ==== 74+0+18533 (secure 0 0 0) 0x7f945c053fd0 con 0x7f946415f570 2023-06-10T19:00:09.701 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:00:09.702 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":68,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T18:59:28.908909+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-06-10T18:57:11.323255+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-06-10T18:57:12.231973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.13","mappings":[{"from":7,"to":2}]},{"pgid":"10.10","mappings":[{"from":4,"to":3}]},{"pgid":"10.21","mappings":[{"from":4,"to":3}]},{"pgid":"10.25","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.0.1:0/683847329":"2023-06-10T19:59:28.260070+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:00:09.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.697+0000 7f946c17c640 1 -- 172.21.15.53:0/1445364105 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f94480662b0 msgr2=0x7f9448068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:09.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.697+0000 7f946c17c640 1 --2- 172.21.15.53:0/1445364105 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f94480662b0 0x7f9448068760 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f94600ad000 tx=0x7f9460008040 comp rx=0 tx=0).stop 2023-06-10T19:00:09.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.697+0000 7f946c17c640 1 -- 172.21.15.53:0/1445364105 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f946415f570 msgr2=0x7f94640c9f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:09.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.697+0000 7f946c17c640 1 --2- 172.21.15.53:0/1445364105 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f946415f570 0x7f94640c9f60 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f945c001570 tx=0x7f945c00cca0 comp rx=0 tx=0).stop 2023-06-10T19:00:09.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.697+0000 7f946c17c640 1 -- 172.21.15.53:0/1445364105 shutdown_connections 2023-06-10T19:00:09.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.697+0000 7f946c17c640 1 --2- 172.21.15.53:0/1445364105 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f94480662b0 0x7f9448068760 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:09.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.697+0000 7f946c17c640 1 --2- 172.21.15.53:0/1445364105 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f946415f570 0x7f94640c9f60 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:09.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.697+0000 7f946c17c640 1 --2- 172.21.15.53:0/1445364105 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f946415eef0 0x7f946414da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:09.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.697+0000 7f946c17c640 1 --2- 172.21.15.53:0/1445364105 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94640ce990 0x7f9464149da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:09.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.697+0000 7f946c17c640 1 -- 172.21.15.53:0/1445364105 >> 172.21.15.53:0/1445364105 conn(0x7f946406a560 msgr2=0x7f9464156ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:09.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.697+0000 7f946c17c640 1 -- 172.21.15.53:0/1445364105 shutdown_connections 2023-06-10T19:00:09.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.697+0000 7f946c17c640 1 -- 172.21.15.53:0/1445364105 wait complete. 2023-06-10T19:00:09.719 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-06-10T19:00:09.832 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.829+0000 7fed55afe640 1 Processor -- start 2023-06-10T19:00:09.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.829+0000 7fed55afe640 1 -- start start 2023-06-10T19:00:09.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.829+0000 7fed55afe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed50152e70 0x7fed500c8d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:09.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.829+0000 7fed55afe640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fed5015c240 0x7fed5015c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:09.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.829+0000 7fed55afe640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed5015cbd0 con 0x7fed50158c00 2023-06-10T19:00:09.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.829+0000 7fed55afe640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed5015d090 con 0x7fed5015c240 2023-06-10T19:00:09.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.829+0000 7fed55afe640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed500cdac0 con 0x7fed50152e70 2023-06-10T19:00:09.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.829+0000 7fed4f7fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed50152e70 0x7fed500c8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:09.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.829+0000 7fed4effd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fed5015c240 0x7fed5015c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:09.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.829+0000 7fed4effd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fed5015c240 0x7fed5015c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.53:46662/0 (socket says 172.21.15.53:46662) 2023-06-10T19:00:09.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.829+0000 7fed4f7fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed50152e70 0x7fed500c8d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.53:44914/0 (socket says 172.21.15.53:44914) 2023-06-10T19:00:09.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.829+0000 7fed4effd640 1 -- 172.21.15.53:0/2191207076 learned_addr learned my addr 172.21.15.53:0/2191207076 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:09.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.829+0000 7fed4effd640 1 -- 172.21.15.53:0/2191207076 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed50152e70 msgr2=0x7fed500c8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:09.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.829+0000 7fed4effd640 1 --2- 172.21.15.53:0/2191207076 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed50152e70 0x7fed500c8d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:09.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.829+0000 7fed4effd640 1 -- 172.21.15.53:0/2191207076 >> v1:172.21.15.117:6789/0 conn(0x7fed50158c00 legacy=0x7fed50159080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:09.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.829+0000 7fed4effd640 1 -- 172.21.15.53:0/2191207076 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed500ccf40 con 0x7fed5015c240 2023-06-10T19:00:09.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.833+0000 7fed4effd640 1 --2- 172.21.15.53:0/2191207076 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed5015c240 0x7fed5015c690 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fed38009870 tx=0x7fed3801c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7332425f047f8ade server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:09.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.833+0000 7fed4e7fc640 1 -- 172.21.15.53:0/2191207076 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed380aa670 con 0x7fed5015c240 2023-06-10T19:00:09.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.833+0000 7fed4e7fc640 1 -- 172.21.15.53:0/2191207076 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed380aa7d0 con 0x7fed5015c240 2023-06-10T19:00:09.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.833+0000 7fed4e7fc640 1 -- 172.21.15.53:0/2191207076 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed380aab60 con 0x7fed5015c240 2023-06-10T19:00:09.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.833+0000 7fed55afe640 1 -- 172.21.15.53:0/2191207076 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed5015c240 msgr2=0x7fed5015c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:09.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.833+0000 7fed55afe640 1 --2- 172.21.15.53:0/2191207076 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed5015c240 0x7fed5015c690 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fed38009870 tx=0x7fed3801c510 comp rx=0 tx=0).stop 2023-06-10T19:00:09.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.833+0000 7fed55afe640 1 -- 172.21.15.53:0/2191207076 shutdown_connections 2023-06-10T19:00:09.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.833+0000 7fed55afe640 1 --2- 172.21.15.53:0/2191207076 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed5015c240 0x7fed5015c690 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:09.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.833+0000 7fed55afe640 1 --2- 172.21.15.53:0/2191207076 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed50152e70 0x7fed500c8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:09.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.833+0000 7fed55afe640 1 -- 172.21.15.53:0/2191207076 >> 172.21.15.53:0/2191207076 conn(0x7fed500ce9e0 msgr2=0x7fed500ca7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:09.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.833+0000 7fed55afe640 1 -- 172.21.15.53:0/2191207076 shutdown_connections 2023-06-10T19:00:09.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.833+0000 7fed55afe640 1 -- 172.21.15.53:0/2191207076 wait complete. 2023-06-10T19:00:09.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.837+0000 7fed55afe640 1 Processor -- start 2023-06-10T19:00:09.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.837+0000 7fed55afe640 1 -- start start 2023-06-10T19:00:09.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.837+0000 7fed55afe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed50152e70 0x7fed50151fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:09.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.837+0000 7fed55afe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed50158c00 0x7fed501510f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:09.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.837+0000 7fed55afe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed5015c240 0x7fed5014c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:09.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.837+0000 7fed55afe640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed5014b230 con 0x7fed50158c00 2023-06-10T19:00:09.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.837+0000 7fed55afe640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed500adb30 con 0x7fed50152e70 2023-06-10T19:00:09.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.837+0000 7fed55afe640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed500ade10 con 0x7fed5015c240 2023-06-10T19:00:09.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.837+0000 7fed4effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed50158c00 0x7fed501510f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:09.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.837+0000 7fed4effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed50158c00 0x7fed501510f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49132/0 (socket says 172.21.15.53:49132) 2023-06-10T19:00:09.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.837+0000 7fed4effd640 1 -- 172.21.15.53:0/313116036 learned_addr learned my addr 172.21.15.53:0/313116036 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:09.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.837+0000 7fed4f7fe640 1 --2- 172.21.15.53:0/313116036 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed50152e70 0x7fed50151fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:09.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.837+0000 7fed4ffff640 1 --2- 172.21.15.53:0/313116036 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed5015c240 0x7fed5014c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:09.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.837+0000 7fed4effd640 1 -- 172.21.15.53:0/313116036 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed5015c240 msgr2=0x7fed5014c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:09.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.837+0000 7fed4effd640 1 --2- 172.21.15.53:0/313116036 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed5015c240 0x7fed5014c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:09.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.837+0000 7fed4effd640 1 -- 172.21.15.53:0/313116036 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed50152e70 msgr2=0x7fed50151fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:09.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.837+0000 7fed4effd640 1 --2- 172.21.15.53:0/313116036 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed50152e70 0x7fed50151fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:09.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.837+0000 7fed4effd640 1 -- 172.21.15.53:0/313116036 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed380094d0 con 0x7fed50158c00 2023-06-10T19:00:09.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.837+0000 7fed4effd640 1 --2- 172.21.15.53:0/313116036 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed50158c00 0x7fed501510f0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7fed380ac040 tx=0x7fed3801ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:09.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.837+0000 7fed47fff640 1 -- 172.21.15.53:0/313116036 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed380b3800 con 0x7fed50158c00 2023-06-10T19:00:09.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.837+0000 7fed47fff640 1 -- 172.21.15.53:0/313116036 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed380b3960 con 0x7fed50158c00 2023-06-10T19:00:09.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.837+0000 7fed55afe640 1 -- 172.21.15.53:0/313116036 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed50150610 con 0x7fed50158c00 2023-06-10T19:00:09.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.837+0000 7fed47fff640 1 -- 172.21.15.53:0/313116036 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed380b3d10 con 0x7fed50158c00 2023-06-10T19:00:09.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.837+0000 7fed55afe640 1 -- 172.21.15.53:0/313116036 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed50150bd0 con 0x7fed50158c00 2023-06-10T19:00:09.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.837+0000 7fed55afe640 1 -- 172.21.15.53:0/313116036 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed50150470 con 0x7fed50158c00 2023-06-10T19:00:09.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.837+0000 7fed47fff640 1 -- 172.21.15.53:0/313116036 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fed380c6390 con 0x7fed50158c00 2023-06-10T19:00:09.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.837+0000 7fed47fff640 1 --2- 172.21.15.53:0/313116036 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fed30066280 0x7fed30068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:09.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.837+0000 7fed47fff640 1 -- 172.21.15.53:0/313116036 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6221+0+0 (secure 0 0 0) 0x7fed3811e9c0 con 0x7fed50158c00 2023-06-10T19:00:09.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.841+0000 7fed4f7fe640 1 --2- 172.21.15.53:0/313116036 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fed30066280 0x7fed30068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:09.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.841+0000 7fed4f7fe640 1 --2- 172.21.15.53:0/313116036 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fed30066280 0x7fed30068730 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fed48007440 tx=0x7fed4800b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:09.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:09.841+0000 7fed47fff640 1 -- 172.21.15.53:0/313116036 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fed50150470 con 0x7fed50158c00 2023-06-10T19:00:10.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:10.021+0000 7fed55afe640 1 -- 172.21.15.53:0/313116036 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fed50150470 con 0x7fed50158c00 2023-06-10T19:00:10.091 INFO:tasks.ceph.mon.a.smithi053.stderr:2023-06-10T19:00:10.089+0000 7f74752c1640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-06-10T19:00:10.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:10.101+0000 7fed47fff640 1 -- 172.21.15.53:0/313116036 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v27) v1 ==== 161+0+0 (secure 0 0 0) 0x7fed50150470 con 0x7fed50158c00 2023-06-10T19:00:10.106 INFO:teuthology.orchestra.run.smithi053.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-06-10T19:00:10.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:10.105+0000 7fed55afe640 1 -- 172.21.15.53:0/313116036 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fed30066280 msgr2=0x7fed30068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:10.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:10.105+0000 7fed55afe640 1 --2- 172.21.15.53:0/313116036 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fed30066280 0x7fed30068730 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fed48007440 tx=0x7fed4800b040 comp rx=0 tx=0).stop 2023-06-10T19:00:10.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:10.105+0000 7fed55afe640 1 -- 172.21.15.53:0/313116036 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed50158c00 msgr2=0x7fed501510f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:10.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:10.105+0000 7fed55afe640 1 --2- 172.21.15.53:0/313116036 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed50158c00 0x7fed501510f0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7fed380ac040 tx=0x7fed3801ad50 comp rx=0 tx=0).stop 2023-06-10T19:00:10.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:10.105+0000 7fed55afe640 1 -- 172.21.15.53:0/313116036 shutdown_connections 2023-06-10T19:00:10.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:10.105+0000 7fed55afe640 1 --2- 172.21.15.53:0/313116036 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fed30066280 0x7fed30068730 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:10.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:10.105+0000 7fed55afe640 1 --2- 172.21.15.53:0/313116036 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fed5015c240 0x7fed5014c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:10.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:10.105+0000 7fed55afe640 1 --2- 172.21.15.53:0/313116036 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed50158c00 0x7fed501510f0 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:10.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:10.105+0000 7fed55afe640 1 --2- 172.21.15.53:0/313116036 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed50152e70 0x7fed50151fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:10.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:10.105+0000 7fed55afe640 1 -- 172.21.15.53:0/313116036 >> 172.21.15.53:0/313116036 conn(0x7fed500ce9e0 msgr2=0x7fed500ca760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:10.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:10.105+0000 7fed55afe640 1 -- 172.21.15.53:0/313116036 shutdown_connections 2023-06-10T19:00:10.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:10.105+0000 7fed55afe640 1 -- 172.21.15.53:0/313116036 wait complete. 2023-06-10T19:00:10.115 INFO:tasks.ceph.mds.a.smithi053.stderr: -6803> 2023-06-10T18:57:19.214+0000 7fa571a57640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-06-10T19:00:10.125 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-06-10T19:00:10.176 INFO:tasks.ceph.mds.a.smithi053.stdout:starting mds.a at 2023-06-10T19:00:10.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:10.245+0000 7f03f83a7640 1 Processor -- start 2023-06-10T19:00:10.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:10.245+0000 7f03f83a7640 1 -- start start 2023-06-10T19:00:10.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:10.245+0000 7f03f83a7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03f015c060 0x7f03f00cc020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:10.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:10.245+0000 7f03f83a7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f03f0070de0 0x7f03f015c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:10.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:10.249+0000 7f03f83a7640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03f00c8d50 con 0x7f03f015c970 2023-06-10T19:00:10.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:10.249+0000 7f03f83a7640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03f00c9030 con 0x7f03f0070de0 2023-06-10T19:00:10.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:10.249+0000 7f03f83a7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03f0070300 con 0x7f03f015c060 2023-06-10T19:00:10.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:10.249+0000 7f03f5942640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f03f0070de0 0x7f03f015c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:10.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:10.249+0000 7f03f5942640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f03f0070de0 0x7f03f015c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49168/0 (socket says 172.21.15.53:49168) 2023-06-10T19:00:10.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:10.249+0000 7f03f5942640 1 -- 172.21.15.53:0/3514790186 learned_addr learned my addr 172.21.15.53:0/3514790186 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:10.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:10.249+0000 7f03f6143640 1 --2- 172.21.15.53:0/3514790186 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03f015c060 0x7f03f00cc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:10.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:10.249+0000 7f03f5942640 1 -- 172.21.15.53:0/3514790186 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03f015c060 msgr2=0x7f03f00cc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:10.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:10.249+0000 7f03f5942640 1 --2- 172.21.15.53:0/3514790186 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03f015c060 0x7f03f00cc020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:10.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:10.249+0000 7f03f5942640 1 -- 172.21.15.53:0/3514790186 >> v1:172.21.15.117:6789/0 conn(0x7f03f015c970 legacy=0x7f03f006bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:10.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:10.249+0000 7f03f5942640 1 -- 172.21.15.53:0/3514790186 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03f00705e0 con 0x7f03f0070de0 2023-06-10T19:00:10.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:10.249+0000 7f03f6143640 1 --2- 172.21.15.53:0/3514790186 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03f015c060 0x7f03f00cc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:00:10.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:10.249+0000 7f03f5942640 1 --2- 172.21.15.53:0/3514790186 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03f0070de0 0x7f03f015c430 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f03e0009870 tx=0x7f03e001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad1f0ae06d8cc52a server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:10.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:10.249+0000 7f03f5141640 1 -- 172.21.15.53:0/3514790186 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e00ad660 con 0x7f03f0070de0 2023-06-10T19:00:10.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:10.249+0000 7f03f5141640 1 -- 172.21.15.53:0/3514790186 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03e00ad7c0 con 0x7f03f0070de0 2023-06-10T19:00:10.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:10.249+0000 7f03f5141640 1 -- 172.21.15.53:0/3514790186 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e00adb50 con 0x7f03f0070de0 2023-06-10T19:00:10.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:10.249+0000 7f03f83a7640 1 -- 172.21.15.53:0/3514790186 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03f0070de0 msgr2=0x7f03f015c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:10.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:10.249+0000 7f03f83a7640 1 --2- 172.21.15.53:0/3514790186 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03f0070de0 0x7f03f015c430 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f03e0009870 tx=0x7f03e001c470 comp rx=0 tx=0).stop 2023-06-10T19:00:10.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:10.249+0000 7f03f83a7640 1 -- 172.21.15.53:0/3514790186 shutdown_connections 2023-06-10T19:00:10.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:10.249+0000 7f03f83a7640 1 --2- 172.21.15.53:0/3514790186 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03f0070de0 0x7f03f015c430 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:10.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:10.249+0000 7f03f83a7640 1 --2- 172.21.15.53:0/3514790186 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03f015c060 0x7f03f00cc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:10.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:10.249+0000 7f03f83a7640 1 -- 172.21.15.53:0/3514790186 >> 172.21.15.53:0/3514790186 conn(0x7f03f006a0e0 msgr2=0x7f03f00cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:10.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:10.249+0000 7f03f83a7640 1 -- 172.21.15.53:0/3514790186 shutdown_connections 2023-06-10T19:00:10.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:10.249+0000 7f03f83a7640 1 -- 172.21.15.53:0/3514790186 wait complete. 2023-06-10T19:00:10.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:10.253+0000 7f03f83a7640 1 Processor -- start 2023-06-10T19:00:10.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:10.253+0000 7f03f83a7640 1 -- start start 2023-06-10T19:00:10.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:10.253+0000 7f03f83a7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03f0070de0 0x7f03f00c6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:10.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:10.253+0000 7f03f83a7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03f015c060 0x7f03f00b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:10.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:10.253+0000 7f03f83a7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03f015c970 0x7f03f014e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:10.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:10.253+0000 7f03f83a7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f00c7040 con 0x7f03f015c060 2023-06-10T19:00:10.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:10.253+0000 7f03f83a7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f00c54b0 con 0x7f03f015c970 2023-06-10T19:00:10.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:10.253+0000 7f03f83a7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03f00c5790 con 0x7f03f0070de0 2023-06-10T19:00:10.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:10.253+0000 7f03f5942640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03f015c060 0x7f03f00b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:10.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:10.253+0000 7f03f5942640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03f015c060 0x7f03f00b31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49174/0 (socket says 172.21.15.53:49174) 2023-06-10T19:00:10.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:10.253+0000 7f03f5942640 1 -- 172.21.15.53:0/3497847619 learned_addr learned my addr 172.21.15.53:0/3497847619 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:10.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:10.253+0000 7f03f5942640 1 -- 172.21.15.53:0/3497847619 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03f0070de0 msgr2=0x7f03f00c6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:10.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:10.253+0000 7f03f6944640 1 --2- 172.21.15.53:0/3497847619 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03f015c970 0x7f03f014e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:10.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:10.253+0000 7f03f5942640 1 --2- 172.21.15.53:0/3497847619 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03f0070de0 0x7f03f00c6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:10.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:10.253+0000 7f03f5942640 1 -- 172.21.15.53:0/3497847619 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03f015c970 msgr2=0x7f03f014e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:10.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:10.253+0000 7f03f5942640 1 --2- 172.21.15.53:0/3497847619 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03f015c970 0x7f03f014e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:10.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:10.253+0000 7f03f5942640 1 -- 172.21.15.53:0/3497847619 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03e00094d0 con 0x7f03f015c060 2023-06-10T19:00:10.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:10.253+0000 7f03f5942640 1 --2- 172.21.15.53:0/3497847619 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03f015c060 0x7f03f00b31e0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f03e00b0040 tx=0x7f03e0019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:10.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:10.253+0000 7f03e6ffd640 1 -- 172.21.15.53:0/3497847619 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e00b6640 con 0x7f03f015c060 2023-06-10T19:00:10.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:10.253+0000 7f03e6ffd640 1 -- 172.21.15.53:0/3497847619 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03e00b67c0 con 0x7f03f015c060 2023-06-10T19:00:10.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:10.253+0000 7f03e6ffd640 1 -- 172.21.15.53:0/3497847619 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e00b6b70 con 0x7f03f015c060 2023-06-10T19:00:10.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:10.253+0000 7f03f83a7640 1 -- 172.21.15.53:0/3497847619 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03f0158950 con 0x7f03f015c060 2023-06-10T19:00:10.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:10.253+0000 7f03f83a7640 1 -- 172.21.15.53:0/3497847619 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03f00c5d50 con 0x7f03f015c060 2023-06-10T19:00:10.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:10.253+0000 7f03f83a7640 1 -- 172.21.15.53:0/3497847619 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03f004d790 con 0x7f03f015c060 2023-06-10T19:00:10.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:10.253+0000 7f03e6ffd640 1 -- 172.21.15.53:0/3497847619 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f03e00b4070 con 0x7f03f015c060 2023-06-10T19:00:10.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:10.253+0000 7f03e6ffd640 1 --2- 172.21.15.53:0/3497847619 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f03d4066280 0x7f03d4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:10.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:10.257+0000 7f03e6ffd640 1 -- 172.21.15.53:0/3497847619 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f03e011e2b0 con 0x7f03f015c060 2023-06-10T19:00:10.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:10.257+0000 7f03f6143640 1 --2- 172.21.15.53:0/3497847619 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f03d4066280 0x7f03d4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:10.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:10.257+0000 7f03f6143640 1 --2- 172.21.15.53:0/3497847619 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f03d4066280 0x7f03d4068730 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f03ec00a890 tx=0x7f03ec008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:10.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:10.261+0000 7f03e6ffd640 1 -- 172.21.15.53:0/3497847619 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f03e00eb750 con 0x7f03f015c060 2023-06-10T19:00:10.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:10.445+0000 7f03f83a7640 1 -- 172.21.15.53:0/3497847619 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f03f0163140 con 0x7f03f015c060 2023-06-10T19:00:11.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.113+0000 7f03e6ffd640 1 -- 172.21.15.53:0/3497847619 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v28) v1 ==== 104+0+0 (secure 0 0 0) 0x7f03e00eed70 con 0x7f03f015c060 2023-06-10T19:00:11.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.117+0000 7f03f83a7640 1 -- 172.21.15.53:0/3497847619 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f03d4066280 msgr2=0x7f03d4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:11.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.117+0000 7f03f83a7640 1 --2- 172.21.15.53:0/3497847619 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f03d4066280 0x7f03d4068730 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f03ec00a890 tx=0x7f03ec008040 comp rx=0 tx=0).stop 2023-06-10T19:00:11.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.117+0000 7f03f83a7640 1 -- 172.21.15.53:0/3497847619 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03f015c060 msgr2=0x7f03f00b31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:11.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.117+0000 7f03f83a7640 1 --2- 172.21.15.53:0/3497847619 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03f015c060 0x7f03f00b31e0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f03e00b0040 tx=0x7f03e0019210 comp rx=0 tx=0).stop 2023-06-10T19:00:11.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.117+0000 7f03f83a7640 1 -- 172.21.15.53:0/3497847619 shutdown_connections 2023-06-10T19:00:11.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.117+0000 7f03f83a7640 1 --2- 172.21.15.53:0/3497847619 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f03d4066280 0x7f03d4068730 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:11.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.117+0000 7f03f83a7640 1 --2- 172.21.15.53:0/3497847619 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03f015c970 0x7f03f014e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:11.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.117+0000 7f03f83a7640 1 --2- 172.21.15.53:0/3497847619 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03f015c060 0x7f03f00b31e0 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:11.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.117+0000 7f03f83a7640 1 --2- 172.21.15.53:0/3497847619 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03f0070de0 0x7f03f00c6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:11.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.117+0000 7f03f83a7640 1 -- 172.21.15.53:0/3497847619 >> 172.21.15.53:0/3497847619 conn(0x7f03f006a0e0 msgr2=0x7f03f00ae890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:11.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.117+0000 7f03f83a7640 1 -- 172.21.15.53:0/3497847619 shutdown_connections 2023-06-10T19:00:11.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.117+0000 7f03f83a7640 1 -- 172.21.15.53:0/3497847619 wait complete. 2023-06-10T19:00:11.143 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-06-10T19:00:11.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.273+0000 7fb6737ff640 1 Processor -- start 2023-06-10T19:00:11.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.273+0000 7fb6737ff640 1 -- start start 2023-06-10T19:00:11.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.273+0000 7fb6737ff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb66c06c210 0x7fb66c06c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:11.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.273+0000 7fb6737ff640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb66c06cb20 con 0x7fb66c158bc0 2023-06-10T19:00:11.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.273+0000 7fb6737ff640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb66c159120 con 0x7fb66c15d0b0 2023-06-10T19:00:11.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.273+0000 7fb6737ff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb66c0c9520 con 0x7fb66c06c210 2023-06-10T19:00:11.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.273+0000 7fb671d9c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fb66c158bc0 0x7fb66c0cbe20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52570/0 (socket says 172.21.15.53:52570) 2023-06-10T19:00:11.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.273+0000 7fb671d9c640 1 -- 172.21.15.53:0/994573839 learned_addr learned my addr 172.21.15.53:0/994573839 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:00:11.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.273+0000 7fb67159b640 1 --2- 172.21.15.53:0/994573839 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb66c06c210 0x7fb66c06c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:11.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.273+0000 7fb663fff640 1 -- 172.21.15.53:0/994573839 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 555013399 0 0) 0x7fb66c06cb20 con 0x7fb66c158bc0 2023-06-10T19:00:11.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.273+0000 7fb663fff640 1 -- 172.21.15.53:0/994573839 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb658003530 con 0x7fb66c158bc0 2023-06-10T19:00:11.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.273+0000 7fb663fff640 1 -- 172.21.15.53:0/994573839 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1258783201 0 0) 0x7fb658003530 con 0x7fb66c158bc0 2023-06-10T19:00:11.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.273+0000 7fb663fff640 1 -- 172.21.15.53:0/994573839 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb66c06c210 msgr2=0x7fb66c06c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:11.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.273+0000 7fb663fff640 1 --2- 172.21.15.53:0/994573839 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb66c06c210 0x7fb66c06c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:11.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.273+0000 7fb663fff640 1 -- 172.21.15.53:0/994573839 >> v1:172.21.15.117:6789/0 conn(0x7fb66c15d0b0 legacy=0x7fb66c0c8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:11.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.273+0000 7fb663fff640 1 -- 172.21.15.53:0/994573839 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb66c159400 con 0x7fb66c158bc0 2023-06-10T19:00:11.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.273+0000 7fb663fff640 1 -- 172.21.15.53:0/994573839 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fb664001a00 con 0x7fb66c158bc0 2023-06-10T19:00:11.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.273+0000 7fb663fff640 1 -- 172.21.15.53:0/994573839 >> v1:172.21.15.53:6789/0 conn(0x7fb66c158bc0 legacy=0x7fb66c0cbe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:11.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.273+0000 7fb663fff640 1 --2- 172.21.15.53:0/994573839 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6580039b0 0x7fb658003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:11.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.277+0000 7fb663fff640 1 --2- 172.21.15.53:0/994573839 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb66c06c210 0x7fb6580047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:11.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.277+0000 7fb663fff640 1 --2- 172.21.15.53:0/994573839 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb658004d10 0x7fb658005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:11.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.277+0000 7fb663fff640 1 -- 172.21.15.53:0/994573839 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb66c0c9520 con 0x7fb6580039b0 2023-06-10T19:00:11.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.277+0000 7fb663fff640 1 -- 172.21.15.53:0/994573839 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb65800ba40 con 0x7fb658004d10 2023-06-10T19:00:11.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.277+0000 7fb663fff640 1 -- 172.21.15.53:0/994573839 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb65800bbd0 con 0x7fb66c06c210 2023-06-10T19:00:11.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.277+0000 7fb67159b640 1 --2- 172.21.15.53:0/994573839 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6580039b0 0x7fb658003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:11.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.277+0000 7fb670d9a640 1 --2- 172.21.15.53:0/994573839 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb66c06c210 0x7fb6580047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:11.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.277+0000 7fb67159b640 1 -- 172.21.15.53:0/994573839 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb66c06c210 msgr2=0x7fb6580047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:11.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.277+0000 7fb671d9c640 1 --2- 172.21.15.53:0/994573839 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb658004d10 0x7fb658005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:11.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.277+0000 7fb67159b640 1 --2- 172.21.15.53:0/994573839 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb66c06c210 0x7fb6580047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:11.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.277+0000 7fb67159b640 1 -- 172.21.15.53:0/994573839 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb658004d10 msgr2=0x7fb658005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:11.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.277+0000 7fb67159b640 1 --2- 172.21.15.53:0/994573839 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb658004d10 0x7fb658005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:11.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.277+0000 7fb67159b640 1 -- 172.21.15.53:0/994573839 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb658003530 con 0x7fb6580039b0 2023-06-10T19:00:11.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.277+0000 7fb670d9a640 1 --2- 172.21.15.53:0/994573839 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb66c06c210 0x7fb6580047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:00:11.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.277+0000 7fb67159b640 1 --2- 172.21.15.53:0/994573839 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6580039b0 0x7fb658003dc0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7fb668009ae0 tx=0x7fb66801ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8609b6f1b7974fd server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:11.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.277+0000 7fb663fff640 1 -- 172.21.15.53:0/994573839 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6680a6510 con 0x7fb6580039b0 2023-06-10T19:00:11.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.277+0000 7fb663fff640 1 -- 172.21.15.53:0/994573839 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6680a6670 con 0x7fb6580039b0 2023-06-10T19:00:11.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.277+0000 7fb663fff640 1 -- 172.21.15.53:0/994573839 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6680a6a20 con 0x7fb6580039b0 2023-06-10T19:00:11.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.277+0000 7fb6737ff640 1 -- 172.21.15.53:0/994573839 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6580039b0 msgr2=0x7fb658003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:11.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.277+0000 7fb6737ff640 1 --2- 172.21.15.53:0/994573839 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6580039b0 0x7fb658003dc0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7fb668009ae0 tx=0x7fb66801ca20 comp rx=0 tx=0).stop 2023-06-10T19:00:11.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.277+0000 7fb671d9c640 1 -- 172.21.15.53:0/994573839 reap_dead start 2023-06-10T19:00:11.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.277+0000 7fb6737ff640 1 -- 172.21.15.53:0/994573839 shutdown_connections 2023-06-10T19:00:11.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.277+0000 7fb6737ff640 1 -- 172.21.15.53:0/994573839 >> 172.21.15.53:0/994573839 conn(0x7fb66c0ca830 msgr2=0x7fb66c0cac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:11.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.277+0000 7fb6737ff640 1 -- 172.21.15.53:0/994573839 shutdown_connections 2023-06-10T19:00:11.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.277+0000 7fb6737ff640 1 -- 172.21.15.53:0/994573839 wait complete. 2023-06-10T19:00:11.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.281+0000 7fb6737ff640 1 Processor -- start 2023-06-10T19:00:11.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.281+0000 7fb6737ff640 1 -- start start 2023-06-10T19:00:11.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.281+0000 7fb6737ff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb6580039b0 0x7fb66c1f51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:11.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.281+0000 7fb6737ff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb66c0b0e80 0x7fb66c0c3f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:11.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.281+0000 7fb6737ff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb66c157210 0x7fb66c157680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:11.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.281+0000 7fb6737ff640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb66c157bc0 con 0x7fb66c0b0e80 2023-06-10T19:00:11.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.281+0000 7fb6737ff640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb66c1f21c0 con 0x7fb6580039b0 2023-06-10T19:00:11.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.281+0000 7fb6737ff640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb66c0b1690 con 0x7fb66c157210 2023-06-10T19:00:11.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.281+0000 7fb670d9a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb66c0b0e80 0x7fb66c0c3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:11.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.281+0000 7fb670d9a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb66c0b0e80 0x7fb66c0c3f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60768/0 (socket says 172.21.15.53:60768) 2023-06-10T19:00:11.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.281+0000 7fb670d9a640 1 -- 172.21.15.53:0/1187849366 learned_addr learned my addr 172.21.15.53:0/1187849366 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:11.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.281+0000 7fb671d9c640 1 --2- 172.21.15.53:0/1187849366 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb66c157210 0x7fb66c157680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:11.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.281+0000 7fb67159b640 1 --2- 172.21.15.53:0/1187849366 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb6580039b0 0x7fb66c1f51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:11.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.281+0000 7fb670d9a640 1 -- 172.21.15.53:0/1187849366 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb66c157210 msgr2=0x7fb66c157680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:11.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.281+0000 7fb670d9a640 1 --2- 172.21.15.53:0/1187849366 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb66c157210 0x7fb66c157680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:11.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.281+0000 7fb670d9a640 1 -- 172.21.15.53:0/1187849366 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb6580039b0 msgr2=0x7fb66c1f51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:11.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.281+0000 7fb670d9a640 1 --2- 172.21.15.53:0/1187849366 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb6580039b0 0x7fb66c1f51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:11.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.281+0000 7fb670d9a640 1 -- 172.21.15.53:0/1187849366 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb66c0b1970 con 0x7fb66c0b0e80 2023-06-10T19:00:11.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.281+0000 7fb67159b640 1 --2- 172.21.15.53:0/1187849366 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb6580039b0 0x7fb66c1f51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:00:11.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.281+0000 7fb670d9a640 1 --2- 172.21.15.53:0/1187849366 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb66c0b0e80 0x7fb66c0c3f40 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fb65c00d7d0 tx=0x7fb65c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:11.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.281+0000 7fb661ffb640 1 -- 172.21.15.53:0/1187849366 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb65c017070 con 0x7fb66c0b0e80 2023-06-10T19:00:11.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.281+0000 7fb661ffb640 1 -- 172.21.15.53:0/1187849366 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb65c005070 con 0x7fb66c0b0e80 2023-06-10T19:00:11.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.281+0000 7fb661ffb640 1 -- 172.21.15.53:0/1187849366 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb65c005400 con 0x7fb66c0b0e80 2023-06-10T19:00:11.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.281+0000 7fb6737ff640 1 -- 172.21.15.53:0/1187849366 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb66c0b1c50 con 0x7fb66c0b0e80 2023-06-10T19:00:11.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.281+0000 7fb6737ff640 1 -- 172.21.15.53:0/1187849366 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb66c0c4480 con 0x7fb66c0b0e80 2023-06-10T19:00:11.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.281+0000 7fb6737ff640 1 -- 172.21.15.53:0/1187849366 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb66c0b2170 con 0x7fb66c0b0e80 2023-06-10T19:00:11.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.281+0000 7fb661ffb640 1 -- 172.21.15.53:0/1187849366 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb65c007030 con 0x7fb66c0b0e80 2023-06-10T19:00:11.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.285+0000 7fb661ffb640 1 --2- 172.21.15.53:0/1187849366 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb6500662b0 0x7fb650068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:11.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.285+0000 7fb661ffb640 1 -- 172.21.15.53:0/1187849366 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6307+0+0 (secure 0 0 0) 0x7fb65c083570 con 0x7fb66c0b0e80 2023-06-10T19:00:11.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.285+0000 7fb67159b640 1 --2- 172.21.15.53:0/1187849366 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb6500662b0 0x7fb650068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:11.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.285+0000 7fb67159b640 1 --2- 172.21.15.53:0/1187849366 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb6500662b0 0x7fb650068760 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fb6680af000 tx=0x7fb6680046d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:11.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.289+0000 7fb661ffb640 1 -- 172.21.15.53:0/1187849366 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb65c0508f0 con 0x7fb66c0b0e80 2023-06-10T19:00:11.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:11.441+0000 7fb6737ff640 1 -- 172.21.15.53:0/1187849366 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb66c1f2300 con 0x7fb66c0b0e80 2023-06-10T19:00:12.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:12.133+0000 7fb661ffb640 1 -- 172.21.15.53:0/1187849366 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v70) v1 ==== 181+0+0 (secure 0 0 0) 0x7fb66c1f2300 con 0x7fb66c0b0e80 2023-06-10T19:00:12.140 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_metadata' removed 2023-06-10T19:00:12.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:12.141+0000 7fb6737ff640 1 -- 172.21.15.53:0/1187849366 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb6500662b0 msgr2=0x7fb650068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:12.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:12.141+0000 7fb6737ff640 1 --2- 172.21.15.53:0/1187849366 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb6500662b0 0x7fb650068760 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fb6680af000 tx=0x7fb6680046d0 comp rx=0 tx=0).stop 2023-06-10T19:00:12.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:12.141+0000 7fb6737ff640 1 -- 172.21.15.53:0/1187849366 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb66c0b0e80 msgr2=0x7fb66c0c3f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:12.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:12.141+0000 7fb6737ff640 1 --2- 172.21.15.53:0/1187849366 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb66c0b0e80 0x7fb66c0c3f40 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fb65c00d7d0 tx=0x7fb65c00dc90 comp rx=0 tx=0).stop 2023-06-10T19:00:12.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:12.141+0000 7fb6737ff640 1 -- 172.21.15.53:0/1187849366 shutdown_connections 2023-06-10T19:00:12.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:12.141+0000 7fb6737ff640 1 --2- 172.21.15.53:0/1187849366 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb6500662b0 0x7fb650068760 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:12.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:12.141+0000 7fb6737ff640 1 --2- 172.21.15.53:0/1187849366 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb66c157210 0x7fb66c157680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:12.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:12.141+0000 7fb6737ff640 1 --2- 172.21.15.53:0/1187849366 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb66c0b0e80 0x7fb66c0c3f40 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:12.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:12.141+0000 7fb6737ff640 1 --2- 172.21.15.53:0/1187849366 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb6580039b0 0x7fb66c1f51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:12.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:12.141+0000 7fb6737ff640 1 -- 172.21.15.53:0/1187849366 >> 172.21.15.53:0/1187849366 conn(0x7fb66c0ca830 msgr2=0x7fb66c070970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:12.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:12.141+0000 7fb6737ff640 1 -- 172.21.15.53:0/1187849366 shutdown_connections 2023-06-10T19:00:12.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:12.141+0000 7fb6737ff640 1 -- 172.21.15.53:0/1187849366 wait complete. 2023-06-10T19:00:12.174 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-06-10T19:00:12.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:12.297+0000 7f84bd4ba640 1 Processor -- start 2023-06-10T19:00:12.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:12.297+0000 7f84bd4ba640 1 -- start start 2023-06-10T19:00:12.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:12.297+0000 7f84bd4ba640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f84b8150730 0x7f84b806bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:12.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:12.297+0000 7f84bd4ba640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84b815d430 con 0x7f84b8150b00 2023-06-10T19:00:12.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:12.297+0000 7f84bd4ba640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84b815d6d0 con 0x7f84b80b0a20 2023-06-10T19:00:12.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:12.297+0000 7f84bd4ba640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84b815d9b0 con 0x7f84b8150730 2023-06-10T19:00:12.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:12.297+0000 7f84ae7fc640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f84b8150b00 0x7f84b80cb1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52584/0 (socket says 172.21.15.53:52584) 2023-06-10T19:00:12.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:12.297+0000 7f84ae7fc640 1 -- 172.21.15.53:0/2467837909 learned_addr learned my addr 172.21.15.53:0/2467837909 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:00:12.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:12.297+0000 7f84b6ffd640 1 --2- 172.21.15.53:0/2467837909 >> v2:172.21.15.117:3300/0 conn(0x7f84b8150730 0x7f84b806bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:12.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:12.297+0000 7f84b67fc640 1 -- 172.21.15.53:0/2467837909 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4250551221 0 0) 0x7f84b815d430 con 0x7f84b8150b00 2023-06-10T19:00:12.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:12.297+0000 7f84b67fc640 1 -- 172.21.15.53:0/2467837909 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84a4003530 con 0x7f84b8150b00 2023-06-10T19:00:12.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:12.297+0000 7f84b67fc640 1 -- 172.21.15.53:0/2467837909 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 263854995 0 0) 0x7f84a4003530 con 0x7f84b8150b00 2023-06-10T19:00:12.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:12.297+0000 7f84b6ffd640 1 -- 172.21.15.53:0/2467837909 >> v1:172.21.15.117:6789/0 conn(0x7f84b80b0a20 legacy=0x7f84b815a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:12.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:12.297+0000 7f84b6ffd640 1 -- 172.21.15.53:0/2467837909 >> v1:172.21.15.53:6789/0 conn(0x7f84b8150b00 legacy=0x7f84b80cb1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:12.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:12.297+0000 7f84b6ffd640 1 -- 172.21.15.53:0/2467837909 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b815dc90 con 0x7f84b8150730 2023-06-10T19:00:12.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:12.301+0000 7f84b6ffd640 1 --2- 172.21.15.53:0/2467837909 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84b8150730 0x7f84b806bf10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f84a80097c0 tx=0x7f84a801c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=434294978349c5e2 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:12.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:12.301+0000 7f84b67fc640 1 -- 172.21.15.53:0/2467837909 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a80a4ea0 con 0x7f84b8150730 2023-06-10T19:00:12.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:12.301+0000 7f84b67fc640 1 -- 172.21.15.53:0/2467837909 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84a80a7050 con 0x7f84b8150730 2023-06-10T19:00:12.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:12.301+0000 7f84b67fc640 1 -- 172.21.15.53:0/2467837909 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a0001800 con 0x7f84b8150730 2023-06-10T19:00:12.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:12.301+0000 7f84bd4ba640 1 -- 172.21.15.53:0/2467837909 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84b8150730 msgr2=0x7f84b806bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:12.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:12.301+0000 7f84bd4ba640 1 --2- 172.21.15.53:0/2467837909 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84b8150730 0x7f84b806bf10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f84a80097c0 tx=0x7f84a801c3a0 comp rx=0 tx=0).stop 2023-06-10T19:00:12.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:12.301+0000 7f84bd4ba640 1 -- 172.21.15.53:0/2467837909 shutdown_connections 2023-06-10T19:00:12.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:12.301+0000 7f84bd4ba640 1 --2- 172.21.15.53:0/2467837909 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84b8150730 0x7f84b806bf10 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:12.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:12.301+0000 7f84bd4ba640 1 -- 172.21.15.53:0/2467837909 >> 172.21.15.53:0/2467837909 conn(0x7f84b80b42b0 msgr2=0x7f84b80b46b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:12.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:12.301+0000 7f84bd4ba640 1 -- 172.21.15.53:0/2467837909 shutdown_connections 2023-06-10T19:00:12.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:12.301+0000 7f84bd4ba640 1 -- 172.21.15.53:0/2467837909 wait complete. 2023-06-10T19:00:12.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:12.305+0000 7f84bd4ba640 1 Processor -- start 2023-06-10T19:00:12.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:12.305+0000 7f84bd4ba640 1 -- start start 2023-06-10T19:00:12.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:12.305+0000 7f84bd4ba640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f84b80b0a20 0x7f84b813ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:12.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:12.305+0000 7f84bd4ba640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84b8150730 0x7f84b8142330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:12.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:12.305+0000 7f84bd4ba640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84b8150b00 0x7f84b80af1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:12.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:12.305+0000 7f84bd4ba640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b814aa20 con 0x7f84b8150b00 2023-06-10T19:00:12.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:12.305+0000 7f84bd4ba640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b814a460 con 0x7f84b8150730 2023-06-10T19:00:12.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:12.305+0000 7f84bd4ba640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84b814a740 con 0x7f84b80b0a20 2023-06-10T19:00:12.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:12.305+0000 7f84b77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84b8150b00 0x7f84b80af1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:12.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:12.305+0000 7f84b77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84b8150b00 0x7f84b80af1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60784/0 (socket says 172.21.15.53:60784) 2023-06-10T19:00:12.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:12.305+0000 7f84b77fe640 1 -- 172.21.15.53:0/93208409 learned_addr learned my addr 172.21.15.53:0/93208409 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:12.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:12.305+0000 7f84b6ffd640 1 --2- 172.21.15.53:0/93208409 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f84b80b0a20 0x7f84b813ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:12.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:12.305+0000 7f84ae7fc640 1 --2- 172.21.15.53:0/93208409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84b8150730 0x7f84b8142330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:12.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:12.305+0000 7f84b77fe640 1 -- 172.21.15.53:0/93208409 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f84b80b0a20 msgr2=0x7f84b813ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:12.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:12.305+0000 7f84b77fe640 1 --2- 172.21.15.53:0/93208409 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f84b80b0a20 0x7f84b813ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:12.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:12.305+0000 7f84b77fe640 1 -- 172.21.15.53:0/93208409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84b8150730 msgr2=0x7f84b8142330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:12.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:12.305+0000 7f84b77fe640 1 --2- 172.21.15.53:0/93208409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84b8150730 0x7f84b8142330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:12.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:12.305+0000 7f84b77fe640 1 -- 172.21.15.53:0/93208409 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84a8009420 con 0x7f84b8150b00 2023-06-10T19:00:12.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:12.305+0000 7f84b77fe640 1 --2- 172.21.15.53:0/93208409 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84b8150b00 0x7f84b80af1f0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f84b000c770 tx=0x7f84b000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:12.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:12.305+0000 7f84affff640 1 -- 172.21.15.53:0/93208409 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b0003b80 con 0x7f84b8150b00 2023-06-10T19:00:12.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:12.305+0000 7f84affff640 1 -- 172.21.15.53:0/93208409 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84b0003ce0 con 0x7f84b8150b00 2023-06-10T19:00:12.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:12.305+0000 7f84affff640 1 -- 172.21.15.53:0/93208409 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b000aa90 con 0x7f84b8150b00 2023-06-10T19:00:12.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:12.305+0000 7f84bd4ba640 1 -- 172.21.15.53:0/93208409 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84b8144a40 con 0x7f84b8150b00 2023-06-10T19:00:12.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:12.305+0000 7f84bd4ba640 1 -- 172.21.15.53:0/93208409 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84b813d1f0 con 0x7f84b8150b00 2023-06-10T19:00:12.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:12.305+0000 7f84bd4ba640 1 -- 172.21.15.53:0/93208409 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84b8144f60 con 0x7f84b8150b00 2023-06-10T19:00:12.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:12.309+0000 7f84affff640 1 -- 172.21.15.53:0/93208409 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f84b000abf0 con 0x7f84b8150b00 2023-06-10T19:00:12.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:12.309+0000 7f84affff640 1 --2- 172.21.15.53:0/93208409 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8498066280 0x7f8498068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:12.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:12.309+0000 7f84affff640 1 -- 172.21.15.53:0/93208409 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5840+0+0 (secure 0 0 0) 0x7f84b0083b30 con 0x7f84b8150b00 2023-06-10T19:00:12.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:12.309+0000 7f84b6ffd640 1 --2- 172.21.15.53:0/93208409 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8498066280 0x7f8498068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:12.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:12.309+0000 7f84b6ffd640 1 --2- 172.21.15.53:0/93208409 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8498066280 0x7f8498068730 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f84a80ad000 tx=0x7f84a80a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:12.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:12.313+0000 7f84affff640 1 -- 172.21.15.53:0/93208409 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f84b8144f60 con 0x7f84b8150b00 2023-06-10T19:00:12.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:12.473+0000 7f84bd4ba640 1 -- 172.21.15.53:0/93208409 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f84b8144f60 con 0x7f84b8150b00 2023-06-10T19:00:13.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.133+0000 7f84affff640 1 -- 172.21.15.53:0/93208409 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v71) v1 ==== 169+0+0 (secure 0 0 0) 0x7f84b8144f60 con 0x7f84b8150b00 2023-06-10T19:00:13.138 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_data' removed 2023-06-10T19:00:13.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.141+0000 7f84bd4ba640 1 -- 172.21.15.53:0/93208409 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8498066280 msgr2=0x7f8498068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:13.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.141+0000 7f84bd4ba640 1 --2- 172.21.15.53:0/93208409 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8498066280 0x7f8498068730 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f84a80ad000 tx=0x7f84a80a6000 comp rx=0 tx=0).stop 2023-06-10T19:00:13.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.141+0000 7f84bd4ba640 1 -- 172.21.15.53:0/93208409 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84b8150b00 msgr2=0x7f84b80af1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:13.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.141+0000 7f84bd4ba640 1 --2- 172.21.15.53:0/93208409 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84b8150b00 0x7f84b80af1f0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f84b000c770 tx=0x7f84b000cc30 comp rx=0 tx=0).stop 2023-06-10T19:00:13.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.145+0000 7f84bd4ba640 1 -- 172.21.15.53:0/93208409 shutdown_connections 2023-06-10T19:00:13.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.145+0000 7f84bd4ba640 1 --2- 172.21.15.53:0/93208409 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8498066280 0x7f8498068730 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:13.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.145+0000 7f84bd4ba640 1 --2- 172.21.15.53:0/93208409 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84b8150b00 0x7f84b80af1f0 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:13.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.145+0000 7f84bd4ba640 1 --2- 172.21.15.53:0/93208409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84b8150730 0x7f84b8142330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:13.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.145+0000 7f84bd4ba640 1 --2- 172.21.15.53:0/93208409 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f84b80b0a20 0x7f84b813ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:13.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.145+0000 7f84bd4ba640 1 -- 172.21.15.53:0/93208409 >> 172.21.15.53:0/93208409 conn(0x7f84b80b42b0 msgr2=0x7f84b806bf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:13.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.145+0000 7f84bd4ba640 1 -- 172.21.15.53:0/93208409 shutdown_connections 2023-06-10T19:00:13.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.145+0000 7f84bd4ba640 1 -- 172.21.15.53:0/93208409 wait complete. 2023-06-10T19:00:13.175 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-06-10T19:00:13.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.293+0000 7f362cb81640 1 Processor -- start 2023-06-10T19:00:13.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.293+0000 7f362cb81640 1 -- start start 2023-06-10T19:00:13.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.293+0000 7f362cb81640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f36280c9fa0 0x7f362806bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:13.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.293+0000 7f362cb81640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f362806c020 0x7f36280c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:13.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.293+0000 7f362cb81640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f362806b090 con 0x7f36280c87e0 2023-06-10T19:00:13.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.293+0000 7f362cb81640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36280ca370 con 0x7f36280c9fa0 2023-06-10T19:00:13.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.293+0000 7f362cb81640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3628070d50 con 0x7f362806c020 2023-06-10T19:00:13.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.297+0000 7f362659c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f36280c9fa0 0x7f362806bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:13.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.297+0000 7f362659c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f36280c9fa0 0x7f362806bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60788/0 (socket says 172.21.15.53:60788) 2023-06-10T19:00:13.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.297+0000 7f362659c640 1 -- 172.21.15.53:0/2500442116 learned_addr learned my addr 172.21.15.53:0/2500442116 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:13.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.297+0000 7f3625d9b640 1 --2- 172.21.15.53:0/2500442116 >> v2:172.21.15.117:3300/0 conn(0x7f362806c020 0x7f36280c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:13.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.297+0000 7f362659c640 1 -- 172.21.15.53:0/2500442116 >> v2:172.21.15.117:3300/0 conn(0x7f362806c020 msgr2=0x7f36280c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:13.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.297+0000 7f362659c640 1 --2- 172.21.15.53:0/2500442116 >> v2:172.21.15.117:3300/0 conn(0x7f362806c020 0x7f36280c82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:13.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.297+0000 7f362659c640 1 -- 172.21.15.53:0/2500442116 >> v1:172.21.15.117:6789/0 conn(0x7f36280c87e0 legacy=0x7f36280af760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:13.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.297+0000 7f362659c640 1 -- 172.21.15.53:0/2500442116 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3628071030 con 0x7f36280c9fa0 2023-06-10T19:00:13.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.297+0000 7f3625d9b640 1 --2- 172.21.15.53:0/2500442116 >> v2:172.21.15.117:3300/0 conn(0x7f362806c020 0x7f36280c82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:00:13.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.297+0000 7f362659c640 1 --2- 172.21.15.53:0/2500442116 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36280c9fa0 0x7f362806bae0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f362806ecb0 tx=0x7f362001c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f893ae8aed05664b server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:13.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.297+0000 7f362559a640 1 -- 172.21.15.53:0/2500442116 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36200a56a0 con 0x7f36280c9fa0 2023-06-10T19:00:13.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.297+0000 7f362559a640 1 -- 172.21.15.53:0/2500442116 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36200a5800 con 0x7f36280c9fa0 2023-06-10T19:00:13.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.297+0000 7f362559a640 1 -- 172.21.15.53:0/2500442116 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36200a5b90 con 0x7f36280c9fa0 2023-06-10T19:00:13.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.297+0000 7f362cb81640 1 -- 172.21.15.53:0/2500442116 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36280c9fa0 msgr2=0x7f362806bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:13.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.297+0000 7f362cb81640 1 --2- 172.21.15.53:0/2500442116 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36280c9fa0 0x7f362806bae0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f362806ecb0 tx=0x7f362001c8d0 comp rx=0 tx=0).stop 2023-06-10T19:00:13.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.297+0000 7f362cb81640 1 -- 172.21.15.53:0/2500442116 shutdown_connections 2023-06-10T19:00:13.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.297+0000 7f362cb81640 1 --2- 172.21.15.53:0/2500442116 >> v2:172.21.15.117:3300/0 conn(0x7f362806c020 0x7f36280c82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:13.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.297+0000 7f362cb81640 1 --2- 172.21.15.53:0/2500442116 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36280c9fa0 0x7f362806bae0 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:13.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.297+0000 7f362cb81640 1 -- 172.21.15.53:0/2500442116 >> 172.21.15.53:0/2500442116 conn(0x7f362806a0e0 msgr2=0x7f36280cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:13.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.297+0000 7f362cb81640 1 -- 172.21.15.53:0/2500442116 shutdown_connections 2023-06-10T19:00:13.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.297+0000 7f362cb81640 1 -- 172.21.15.53:0/2500442116 wait complete. 2023-06-10T19:00:13.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.301+0000 7f362cb81640 1 Processor -- start 2023-06-10T19:00:13.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.301+0000 7f362cb81640 1 -- start start 2023-06-10T19:00:13.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.301+0000 7f362cb81640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f362806c020 0x7f3628153f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:13.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.301+0000 7f362cb81640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36280c87e0 0x7f36280ad690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:13.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.301+0000 7f362cb81640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36280c9fa0 0x7f36280adbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:13.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.301+0000 7f362cb81640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3628156080 con 0x7f362806c020 2023-06-10T19:00:13.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.301+0000 7f362cb81640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36280c36a0 con 0x7f36280c9fa0 2023-06-10T19:00:13.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.301+0000 7f362cb81640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36280c3980 con 0x7f36280c87e0 2023-06-10T19:00:13.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.301+0000 7f362659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f362806c020 0x7f3628153f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:13.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.301+0000 7f362659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f362806c020 0x7f3628153f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60790/0 (socket says 172.21.15.53:60790) 2023-06-10T19:00:13.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.301+0000 7f362659c640 1 -- 172.21.15.53:0/2387435176 learned_addr learned my addr 172.21.15.53:0/2387435176 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:13.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.301+0000 7f3625d9b640 1 --2- 172.21.15.53:0/2387435176 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36280c87e0 0x7f36280ad690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:13.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.301+0000 7f3626d9d640 1 --2- 172.21.15.53:0/2387435176 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36280c9fa0 0x7f36280adbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:13.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.301+0000 7f362659c640 1 -- 172.21.15.53:0/2387435176 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36280c87e0 msgr2=0x7f36280ad690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:13.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.301+0000 7f362659c640 1 --2- 172.21.15.53:0/2387435176 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36280c87e0 0x7f36280ad690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:13.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.301+0000 7f362659c640 1 -- 172.21.15.53:0/2387435176 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36280c9fa0 msgr2=0x7f36280adbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:13.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.301+0000 7f362659c640 1 --2- 172.21.15.53:0/2387435176 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36280c9fa0 0x7f36280adbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:13.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.301+0000 7f362659c640 1 -- 172.21.15.53:0/2387435176 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3620009b30 con 0x7f362806c020 2023-06-10T19:00:13.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.301+0000 7f3626d9d640 1 --2- 172.21.15.53:0/2387435176 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36280c9fa0 0x7f36280adbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:00:13.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.301+0000 7f362659c640 1 --2- 172.21.15.53:0/2387435176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f362806c020 0x7f3628153f60 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f36200af040 tx=0x7f3620019670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:13.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.301+0000 7f361effd640 1 -- 172.21.15.53:0/2387435176 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36200b8670 con 0x7f362806c020 2023-06-10T19:00:13.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.301+0000 7f361effd640 1 -- 172.21.15.53:0/2387435176 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36200b87f0 con 0x7f362806c020 2023-06-10T19:00:13.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.301+0000 7f361effd640 1 -- 172.21.15.53:0/2387435176 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36200b8ba0 con 0x7f362806c020 2023-06-10T19:00:13.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.301+0000 7f362cb81640 1 -- 172.21.15.53:0/2387435176 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36280c3c60 con 0x7f362806c020 2023-06-10T19:00:13.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.301+0000 7f362cb81640 1 -- 172.21.15.53:0/2387435176 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36281544a0 con 0x7f362806c020 2023-06-10T19:00:13.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.301+0000 7f362cb81640 1 -- 172.21.15.53:0/2387435176 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f362804d790 con 0x7f362806c020 2023-06-10T19:00:13.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.305+0000 7f361effd640 1 -- 172.21.15.53:0/2387435176 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f36200b8d00 con 0x7f362806c020 2023-06-10T19:00:13.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.305+0000 7f361effd640 1 --2- 172.21.15.53:0/2387435176 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3608066280 0x7f3608068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:13.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.305+0000 7f361effd640 1 -- 172.21.15.53:0/2387435176 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f362011f090 con 0x7f362806c020 2023-06-10T19:00:13.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.305+0000 7f3625d9b640 1 --2- 172.21.15.53:0/2387435176 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3608066280 0x7f3608068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:13.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.305+0000 7f3625d9b640 1 --2- 172.21.15.53:0/2387435176 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3608066280 0x7f3608068730 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f3610006fd0 tx=0x7f3610008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:13.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.309+0000 7f361effd640 1 -- 172.21.15.53:0/2387435176 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f36200ec8f0 con 0x7f362806c020 2023-06-10T19:00:13.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.477+0000 7f362cb81640 1 -- 172.21.15.53:0/2387435176 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f36280ce670 con 0x7f362806c020 2023-06-10T19:00:13.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.481+0000 7f361effd640 1 -- 172.21.15.53:0/2387435176 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7f36200eff10 con 0x7f362806c020 2023-06-10T19:00:13.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.485+0000 7f362cb81640 1 -- 172.21.15.53:0/2387435176 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3608066280 msgr2=0x7f3608068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:13.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.485+0000 7f362cb81640 1 --2- 172.21.15.53:0/2387435176 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3608066280 0x7f3608068730 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f3610006fd0 tx=0x7f3610008040 comp rx=0 tx=0).stop 2023-06-10T19:00:13.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.485+0000 7f362cb81640 1 -- 172.21.15.53:0/2387435176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f362806c020 msgr2=0x7f3628153f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:13.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.485+0000 7f362cb81640 1 --2- 172.21.15.53:0/2387435176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f362806c020 0x7f3628153f60 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f36200af040 tx=0x7f3620019670 comp rx=0 tx=0).stop 2023-06-10T19:00:13.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.485+0000 7f362cb81640 1 -- 172.21.15.53:0/2387435176 shutdown_connections 2023-06-10T19:00:13.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.485+0000 7f362cb81640 1 --2- 172.21.15.53:0/2387435176 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3608066280 0x7f3608068730 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:13.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.485+0000 7f362cb81640 1 --2- 172.21.15.53:0/2387435176 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36280c9fa0 0x7f36280adbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:13.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.485+0000 7f362cb81640 1 --2- 172.21.15.53:0/2387435176 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36280c87e0 0x7f36280ad690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:13.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.485+0000 7f362cb81640 1 --2- 172.21.15.53:0/2387435176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f362806c020 0x7f3628153f60 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:13.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.485+0000 7f362cb81640 1 -- 172.21.15.53:0/2387435176 >> 172.21.15.53:0/2387435176 conn(0x7f362806a0e0 msgr2=0x7f36280acba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:13.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.485+0000 7f362cb81640 1 -- 172.21.15.53:0/2387435176 shutdown_connections 2023-06-10T19:00:13.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.485+0000 7f362cb81640 1 -- 172.21.15.53:0/2387435176 wait complete. 2023-06-10T19:00:13.507 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_config_session_timeout' 2023-06-10T19:00:13.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.625+0000 7faaa3451640 1 Processor -- start 2023-06-10T19:00:13.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.625+0000 7faaa3451640 1 -- start start 2023-06-10T19:00:13.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.625+0000 7faaa3451640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7faa9c15cc50 0x7faa9c15d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:13.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.625+0000 7faaa3451640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa9c0c8df0 con 0x7faa9c0afb10 2023-06-10T19:00:13.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.625+0000 7faaa3451640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa9c15dae0 con 0x7faa9c0ad340 2023-06-10T19:00:13.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.625+0000 7faaa3451640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa9c15d020 con 0x7faa9c15cc50 2023-06-10T19:00:13.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.625+0000 7faaa19ee640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7faa9c0afb10 0x7faa9c070d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52592/0 (socket says 172.21.15.53:52592) 2023-06-10T19:00:13.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.625+0000 7faaa19ee640 1 -- 172.21.15.53:0/4012524434 learned_addr learned my addr 172.21.15.53:0/4012524434 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:00:13.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.625+0000 7faaa11ed640 1 --2- 172.21.15.53:0/4012524434 >> v2:172.21.15.117:3300/0 conn(0x7faa9c15cc50 0x7faa9c15d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:13.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.625+0000 7faa93fff640 1 -- 172.21.15.53:0/4012524434 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 24901978 0 0) 0x7faa9c0c8df0 con 0x7faa9c0afb10 2023-06-10T19:00:13.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.625+0000 7faa93fff640 1 -- 172.21.15.53:0/4012524434 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa88003530 con 0x7faa9c0afb10 2023-06-10T19:00:13.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.625+0000 7faa93fff640 1 -- 172.21.15.53:0/4012524434 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2799958478 0 0) 0x7faa88003530 con 0x7faa9c0afb10 2023-06-10T19:00:13.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.625+0000 7faa93fff640 1 -- 172.21.15.53:0/4012524434 >> v2:172.21.15.117:3300/0 conn(0x7faa9c15cc50 msgr2=0x7faa9c15d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:13.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.625+0000 7faa93fff640 1 --2- 172.21.15.53:0/4012524434 >> v2:172.21.15.117:3300/0 conn(0x7faa9c15cc50 0x7faa9c15d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:13.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.625+0000 7faa93fff640 1 -- 172.21.15.53:0/4012524434 >> v1:172.21.15.117:6789/0 conn(0x7faa9c0ad340 legacy=0x7faa9c0c86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:13.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.625+0000 7faa93fff640 1 -- 172.21.15.53:0/4012524434 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa9c15ddc0 con 0x7faa9c0afb10 2023-06-10T19:00:13.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.625+0000 7faa93fff640 1 -- 172.21.15.53:0/4012524434 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7faa94001a00 con 0x7faa9c0afb10 2023-06-10T19:00:13.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.625+0000 7faa93fff640 1 -- 172.21.15.53:0/4012524434 >> v1:172.21.15.53:6789/0 conn(0x7faa9c0afb10 legacy=0x7faa9c070d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:13.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.625+0000 7faa93fff640 1 --2- 172.21.15.53:0/4012524434 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faa880039f0 0x7faa88003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:13.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.625+0000 7faa93fff640 1 --2- 172.21.15.53:0/4012524434 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa880047d0 0x7faa88004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:13.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.625+0000 7faa93fff640 1 --2- 172.21.15.53:0/4012524434 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa88005180 0x7faa8800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:13.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.625+0000 7faa93fff640 1 -- 172.21.15.53:0/4012524434 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa8800c060 con 0x7faa880047d0 2023-06-10T19:00:13.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.625+0000 7faa93fff640 1 -- 172.21.15.53:0/4012524434 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa8800c1a0 con 0x7faa88005180 2023-06-10T19:00:13.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.625+0000 7faa93fff640 1 -- 172.21.15.53:0/4012524434 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa8800c360 con 0x7faa880039f0 2023-06-10T19:00:13.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.625+0000 7faaa09ec640 1 --2- 172.21.15.53:0/4012524434 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa880047d0 0x7faa88004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:13.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.625+0000 7faaa19ee640 1 --2- 172.21.15.53:0/4012524434 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa88005180 0x7faa8800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:13.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.625+0000 7faaa11ed640 1 --2- 172.21.15.53:0/4012524434 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faa880039f0 0x7faa88003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:13.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.625+0000 7faaa09ec640 1 -- 172.21.15.53:0/4012524434 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faa880039f0 msgr2=0x7faa88003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:13.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.625+0000 7faaa09ec640 1 --2- 172.21.15.53:0/4012524434 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faa880039f0 0x7faa88003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:13.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.625+0000 7faaa09ec640 1 -- 172.21.15.53:0/4012524434 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa88005180 msgr2=0x7faa8800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:13.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.625+0000 7faaa09ec640 1 --2- 172.21.15.53:0/4012524434 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa88005180 0x7faa8800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:13.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.625+0000 7faaa09ec640 1 -- 172.21.15.53:0/4012524434 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa88003530 con 0x7faa880047d0 2023-06-10T19:00:13.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.625+0000 7faaa11ed640 1 --2- 172.21.15.53:0/4012524434 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faa880039f0 0x7faa88003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:00:13.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.625+0000 7faaa19ee640 1 --2- 172.21.15.53:0/4012524434 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa88005180 0x7faa8800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:00:13.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.625+0000 7faaa19ee640 1 -- 172.21.15.53:0/4012524434 reap_dead start 2023-06-10T19:00:13.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.629+0000 7faaa09ec640 1 --2- 172.21.15.53:0/4012524434 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa880047d0 0x7faa88004c40 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7faa8c001780 tx=0x7faa8c01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb1e57f33dca2614 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:13.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.629+0000 7faa93fff640 1 -- 172.21.15.53:0/4012524434 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa8c0052d0 con 0x7faa880047d0 2023-06-10T19:00:13.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.629+0000 7faa93fff640 1 -- 172.21.15.53:0/4012524434 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa8c0a7050 con 0x7faa880047d0 2023-06-10T19:00:13.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.629+0000 7faa93fff640 1 -- 172.21.15.53:0/4012524434 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa8c003600 con 0x7faa880047d0 2023-06-10T19:00:13.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.629+0000 7faaa3451640 1 -- 172.21.15.53:0/4012524434 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa880047d0 msgr2=0x7faa88004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:13.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.629+0000 7faaa3451640 1 --2- 172.21.15.53:0/4012524434 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa880047d0 0x7faa88004c40 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7faa8c001780 tx=0x7faa8c01c3e0 comp rx=0 tx=0).stop 2023-06-10T19:00:13.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.629+0000 7faaa3451640 1 -- 172.21.15.53:0/4012524434 shutdown_connections 2023-06-10T19:00:13.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.629+0000 7faaa3451640 1 --2- 172.21.15.53:0/4012524434 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa880047d0 0x7faa88004c40 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:13.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.629+0000 7faaa3451640 1 -- 172.21.15.53:0/4012524434 >> 172.21.15.53:0/4012524434 conn(0x7faa9c0cab10 msgr2=0x7faa9c0caf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:13.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.629+0000 7faaa3451640 1 -- 172.21.15.53:0/4012524434 shutdown_connections 2023-06-10T19:00:13.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.629+0000 7faaa3451640 1 -- 172.21.15.53:0/4012524434 wait complete. 2023-06-10T19:00:13.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.629+0000 7faaa3451640 1 Processor -- start 2023-06-10T19:00:13.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.629+0000 7faaa3451640 1 -- start start 2023-06-10T19:00:13.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.629+0000 7faaa3451640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faa880047d0 0x7faa9c1563b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:13.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.629+0000 7faaa3451640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa9c0cd980 0x7faa9c0cbc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:13.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.629+0000 7faaa3451640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa9c0cc1a0 0x7faa9c0c35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:13.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.629+0000 7faaa3451640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa9c0cc640 con 0x7faa9c0cd980 2023-06-10T19:00:13.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.629+0000 7faaa3451640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa9c0cc8e0 con 0x7faa9c0cc1a0 2023-06-10T19:00:13.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.629+0000 7faaa3451640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa9c0ccbc0 con 0x7faa880047d0 2023-06-10T19:00:13.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.629+0000 7faaa09ec640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa9c0cd980 0x7faa9c0cbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:13.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.629+0000 7faaa09ec640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa9c0cd980 0x7faa9c0cbc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60812/0 (socket says 172.21.15.53:60812) 2023-06-10T19:00:13.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.629+0000 7faaa09ec640 1 -- 172.21.15.53:0/3604182340 learned_addr learned my addr 172.21.15.53:0/3604182340 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:13.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.633+0000 7faaa11ed640 1 --2- 172.21.15.53:0/3604182340 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faa880047d0 0x7faa9c1563b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:13.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.633+0000 7faaa19ee640 1 --2- 172.21.15.53:0/3604182340 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa9c0cc1a0 0x7faa9c0c35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:13.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.633+0000 7faaa09ec640 1 -- 172.21.15.53:0/3604182340 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faa880047d0 msgr2=0x7faa9c1563b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:13.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.633+0000 7faaa09ec640 1 --2- 172.21.15.53:0/3604182340 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faa880047d0 0x7faa9c1563b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:13.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.633+0000 7faaa09ec640 1 -- 172.21.15.53:0/3604182340 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa9c0cc1a0 msgr2=0x7faa9c0c35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:13.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.633+0000 7faaa09ec640 1 --2- 172.21.15.53:0/3604182340 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa9c0cc1a0 0x7faa9c0c35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:13.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.633+0000 7faaa09ec640 1 -- 172.21.15.53:0/3604182340 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa9c0ccea0 con 0x7faa9c0cd980 2023-06-10T19:00:13.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.633+0000 7faaa09ec640 1 --2- 172.21.15.53:0/3604182340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa9c0cd980 0x7faa9c0cbc60 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7faa8c01c210 tx=0x7faa88005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:13.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.633+0000 7faa91ffb640 1 -- 172.21.15.53:0/3604182340 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa8c007440 con 0x7faa9c0cd980 2023-06-10T19:00:13.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.633+0000 7faa91ffb640 1 -- 172.21.15.53:0/3604182340 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa94002100 con 0x7faa9c0cd980 2023-06-10T19:00:13.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.633+0000 7faaa3451640 1 -- 172.21.15.53:0/3604182340 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa9c0cd180 con 0x7faa9c0cd980 2023-06-10T19:00:13.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.633+0000 7faa91ffb640 1 -- 172.21.15.53:0/3604182340 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa8c0067e0 con 0x7faa9c0cd980 2023-06-10T19:00:13.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.633+0000 7faaa3451640 1 -- 172.21.15.53:0/3604182340 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa9c1568f0 con 0x7faa9c0cd980 2023-06-10T19:00:13.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.633+0000 7faaa3451640 1 -- 172.21.15.53:0/3604182340 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa9c156ae0 con 0x7faa9c0cd980 2023-06-10T19:00:13.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.633+0000 7faa91ffb640 1 -- 172.21.15.53:0/3604182340 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7faa8c006940 con 0x7faa9c0cd980 2023-06-10T19:00:13.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.633+0000 7faa91ffb640 1 --2- 172.21.15.53:0/3604182340 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7faa800662b0 0x7faa80068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:13.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.633+0000 7faa91ffb640 1 -- 172.21.15.53:0/3604182340 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5339+0+0 (secure 0 0 0) 0x7faa8c11db80 con 0x7faa9c0cd980 2023-06-10T19:00:13.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.633+0000 7faaa11ed640 1 --2- 172.21.15.53:0/3604182340 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7faa800662b0 0x7faa80068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:13.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.633+0000 7faaa11ed640 1 --2- 172.21.15.53:0/3604182340 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7faa800662b0 0x7faa80068760 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7faa9c04eaa0 tx=0x7faa98008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:13.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.637+0000 7faa91ffb640 1 -- 172.21.15.53:0/3604182340 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7faa9c156ae0 con 0x7faa9c0cd980 2023-06-10T19:00:13.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:13.849+0000 7faaa3451640 1 -- 172.21.15.53:0/3604182340 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_config_session_timeout"]} v 0) v1 -- 0x7faa9c156ae0 con 0x7faa9c0cd980 2023-06-10T19:00:14.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:14.149+0000 7faa91ffb640 1 -- 172.21.15.53:0/3604182340 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_config_session_timeout"]}]=0 v332) v1 ==== 159+0+0 (secure 0 0 0) 0x7faa9c156ae0 con 0x7faa9c0cd980 2023-06-10T19:00:14.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:14.153+0000 7faaa3451640 1 -- 172.21.15.53:0/3604182340 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7faa800662b0 msgr2=0x7faa80068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:14.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:14.153+0000 7faaa3451640 1 --2- 172.21.15.53:0/3604182340 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7faa800662b0 0x7faa80068760 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7faa9c04eaa0 tx=0x7faa98008040 comp rx=0 tx=0).stop 2023-06-10T19:00:14.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:14.153+0000 7faaa3451640 1 -- 172.21.15.53:0/3604182340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa9c0cd980 msgr2=0x7faa9c0cbc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:14.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:14.153+0000 7faaa3451640 1 --2- 172.21.15.53:0/3604182340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa9c0cd980 0x7faa9c0cbc60 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7faa8c01c210 tx=0x7faa88005800 comp rx=0 tx=0).stop 2023-06-10T19:00:14.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:14.153+0000 7faaa3451640 1 -- 172.21.15.53:0/3604182340 shutdown_connections 2023-06-10T19:00:14.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:14.153+0000 7faaa3451640 1 --2- 172.21.15.53:0/3604182340 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7faa800662b0 0x7faa80068760 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:14.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:14.153+0000 7faaa3451640 1 --2- 172.21.15.53:0/3604182340 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa9c0cc1a0 0x7faa9c0c35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:14.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:14.153+0000 7faaa3451640 1 --2- 172.21.15.53:0/3604182340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa9c0cd980 0x7faa9c0cbc60 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:14.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:14.153+0000 7faaa3451640 1 --2- 172.21.15.53:0/3604182340 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faa880047d0 0x7faa9c1563b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:14.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:14.153+0000 7faaa3451640 1 -- 172.21.15.53:0/3604182340 >> 172.21.15.53:0/3604182340 conn(0x7faa9c0cab10 msgr2=0x7faa9c0c8fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:14.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:14.153+0000 7faaa3451640 1 -- 172.21.15.53:0/3604182340 shutdown_connections 2023-06-10T19:00:14.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:14.153+0000 7faaa3451640 1 -- 172.21.15.53:0/3604182340 wait complete. 2023-06-10T19:00:14.179 INFO:tasks.cephfs_test_runner:test_config_session_timeout (tasks.cephfs.test_client_recovery.TestClientRecovery) ... ok 2023-06-10T19:00:14.179 INFO:tasks.cephfs_test_runner:Starting test: test_create_fsync (tasks.cephfs.test_client_recovery.TestClientRecovery) 2023-06-10T19:00:14.180 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_create_fsync' 2023-06-10T19:00:14.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:14.309+0000 7f4b2e53e640 1 Processor -- start 2023-06-10T19:00:14.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:14.309+0000 7f4b2e53e640 1 -- start start 2023-06-10T19:00:14.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:14.309+0000 7f4b2e53e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b2806bb30 0x7f4b28157e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:14.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:14.309+0000 7f4b2e53e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4b280ccfe0 0x7f4b280af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:14.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:14.309+0000 7f4b2e53e640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b280c9e50 con 0x7f4b2806efc0 2023-06-10T19:00:14.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:14.309+0000 7f4b2e53e640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b280cb540 con 0x7f4b280ccfe0 2023-06-10T19:00:14.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:14.309+0000 7f4b2e53e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b280c82f0 con 0x7f4b2806bb30 2023-06-10T19:00:14.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:14.309+0000 7f4b27fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f4b2806efc0 0x7f4b280cae30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52596/0 (socket says 172.21.15.53:52596) 2023-06-10T19:00:14.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:14.309+0000 7f4b27fff640 1 -- 172.21.15.53:0/2566733906 learned_addr learned my addr 172.21.15.53:0/2566733906 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:00:14.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:14.309+0000 7f4b2cadb640 1 --2- 172.21.15.53:0/2566733906 >> v2:172.21.15.53:3300/0 conn(0x7f4b280ccfe0 0x7f4b280af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:14.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:14.309+0000 7f4b277fe640 1 --2- 172.21.15.53:0/2566733906 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b2806bb30 0x7f4b28157e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:14.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:14.309+0000 7f4b26ffd640 1 -- 172.21.15.53:0/2566733906 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4239949477 0 0) 0x7f4b280c9e50 con 0x7f4b2806efc0 2023-06-10T19:00:14.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:14.309+0000 7f4b26ffd640 1 -- 172.21.15.53:0/2566733906 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b10005740 con 0x7f4b2806efc0 2023-06-10T19:00:14.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:14.309+0000 7f4b2cadb640 1 -- 172.21.15.53:0/2566733906 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b2806bb30 msgr2=0x7f4b28157e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:14.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:14.309+0000 7f4b2cadb640 1 --2- 172.21.15.53:0/2566733906 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b2806bb30 0x7f4b28157e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:14.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:14.309+0000 7f4b2cadb640 1 -- 172.21.15.53:0/2566733906 >> v1:172.21.15.53:6789/0 conn(0x7f4b2806efc0 legacy=0x7f4b280cae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:14.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:14.309+0000 7f4b2cadb640 1 -- 172.21.15.53:0/2566733906 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b2806bf80 con 0x7f4b280ccfe0 2023-06-10T19:00:14.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:14.309+0000 7f4b2cadb640 1 --2- 172.21.15.53:0/2566733906 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4b280ccfe0 0x7f4b280af720 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f4b20009d90 tx=0x7f4b2001c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=615bb749134f0236 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:14.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:14.309+0000 7f4b26ffd640 1 -- 172.21.15.53:0/2566733906 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b200a5920 con 0x7f4b280ccfe0 2023-06-10T19:00:14.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:14.313+0000 7f4b26ffd640 1 -- 172.21.15.53:0/2566733906 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b200a5a80 con 0x7f4b280ccfe0 2023-06-10T19:00:14.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:14.313+0000 7f4b26ffd640 1 -- 172.21.15.53:0/2566733906 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b200a5df0 con 0x7f4b280ccfe0 2023-06-10T19:00:14.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:14.313+0000 7f4b2e53e640 1 -- 172.21.15.53:0/2566733906 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4b280ccfe0 msgr2=0x7f4b280af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:14.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:14.313+0000 7f4b2e53e640 1 --2- 172.21.15.53:0/2566733906 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4b280ccfe0 0x7f4b280af720 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f4b20009d90 tx=0x7f4b2001c950 comp rx=0 tx=0).stop 2023-06-10T19:00:14.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:14.313+0000 7f4b2e53e640 1 -- 172.21.15.53:0/2566733906 shutdown_connections 2023-06-10T19:00:14.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:14.313+0000 7f4b2e53e640 1 --2- 172.21.15.53:0/2566733906 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4b280ccfe0 0x7f4b280af720 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:14.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:14.313+0000 7f4b2e53e640 1 --2- 172.21.15.53:0/2566733906 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b2806bb30 0x7f4b28157e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:14.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:14.313+0000 7f4b2e53e640 1 -- 172.21.15.53:0/2566733906 >> 172.21.15.53:0/2566733906 conn(0x7f4b2806a0d0 msgr2=0x7f4b280ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:14.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:14.313+0000 7f4b2e53e640 1 -- 172.21.15.53:0/2566733906 shutdown_connections 2023-06-10T19:00:14.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:14.313+0000 7f4b2e53e640 1 -- 172.21.15.53:0/2566733906 wait complete. 2023-06-10T19:00:14.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:14.313+0000 7f4b2e53e640 1 Processor -- start 2023-06-10T19:00:14.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:14.313+0000 7f4b2e53e640 1 -- start start 2023-06-10T19:00:14.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:14.313+0000 7f4b2e53e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b2806bb30 0x7f4b280c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:14.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:14.313+0000 7f4b2e53e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4b2806efc0 0x7f4b281f36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:14.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:14.313+0000 7f4b2e53e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b280ccfe0 0x7f4b281f3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:14.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:14.313+0000 7f4b2e53e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b28155980 con 0x7f4b2806efc0 2023-06-10T19:00:14.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:14.313+0000 7f4b2e53e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b281f4500 con 0x7f4b280ccfe0 2023-06-10T19:00:14.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:14.313+0000 7f4b2e53e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b280c77a0 con 0x7f4b2806bb30 2023-06-10T19:00:14.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:14.313+0000 7f4b277fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4b2806efc0 0x7f4b281f36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:14.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:14.313+0000 7f4b277fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4b2806efc0 0x7f4b281f36c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60824/0 (socket says 172.21.15.53:60824) 2023-06-10T19:00:14.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:14.313+0000 7f4b277fe640 1 -- 172.21.15.53:0/3169670637 learned_addr learned my addr 172.21.15.53:0/3169670637 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:14.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:14.313+0000 7f4b27fff640 1 --2- 172.21.15.53:0/3169670637 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b2806bb30 0x7f4b280c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:14.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:14.313+0000 7f4b277fe640 1 -- 172.21.15.53:0/3169670637 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b2806bb30 msgr2=0x7f4b280c42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:14.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:14.313+0000 7f4b277fe640 1 --2- 172.21.15.53:0/3169670637 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b2806bb30 0x7f4b280c42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:14.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:14.313+0000 7f4b277fe640 1 -- 172.21.15.53:0/3169670637 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b280ccfe0 msgr2=0x7f4b281f3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:14.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:14.313+0000 7f4b277fe640 1 --2- 172.21.15.53:0/3169670637 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b280ccfe0 0x7f4b281f3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:14.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:14.313+0000 7f4b277fe640 1 -- 172.21.15.53:0/3169670637 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b20009a70 con 0x7f4b2806efc0 2023-06-10T19:00:14.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:14.313+0000 7f4b27fff640 1 --2- 172.21.15.53:0/3169670637 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b2806bb30 0x7f4b280c42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:00:14.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:14.317+0000 7f4b277fe640 1 --2- 172.21.15.53:0/3169670637 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4b2806efc0 0x7f4b281f36c0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c00d800 tx=0x7f4b1c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:14.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:14.317+0000 7f4b24ff9640 1 -- 172.21.15.53:0/3169670637 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1c00b6c0 con 0x7f4b2806efc0 2023-06-10T19:00:14.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:14.317+0000 7f4b24ff9640 1 -- 172.21.15.53:0/3169670637 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b1c00b820 con 0x7f4b2806efc0 2023-06-10T19:00:14.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:14.317+0000 7f4b24ff9640 1 -- 172.21.15.53:0/3169670637 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1c00bb90 con 0x7f4b2806efc0 2023-06-10T19:00:14.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:14.317+0000 7f4b2e53e640 1 -- 172.21.15.53:0/3169670637 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b280c7a80 con 0x7f4b2806efc0 2023-06-10T19:00:14.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:14.317+0000 7f4b2e53e640 1 -- 172.21.15.53:0/3169670637 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b28155eb0 con 0x7f4b2806efc0 2023-06-10T19:00:14.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:14.317+0000 7f4b2e53e640 1 -- 172.21.15.53:0/3169670637 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b2804d790 con 0x7f4b2806efc0 2023-06-10T19:00:14.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:14.317+0000 7f4b24ff9640 1 -- 172.21.15.53:0/3169670637 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4b1c00bcf0 con 0x7f4b2806efc0 2023-06-10T19:00:14.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:14.317+0000 7f4b24ff9640 1 --2- 172.21.15.53:0/3169670637 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4b14066280 0x7f4b14068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:14.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:14.317+0000 7f4b24ff9640 1 -- 172.21.15.53:0/3169670637 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f4b1c083f40 con 0x7f4b2806efc0 2023-06-10T19:00:14.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:14.317+0000 7f4b27fff640 1 --2- 172.21.15.53:0/3169670637 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4b14066280 0x7f4b14068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:14.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:14.317+0000 7f4b27fff640 1 --2- 172.21.15.53:0/3169670637 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4b14066280 0x7f4b14068730 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f4b18005890 tx=0x7f4b18009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:14.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:14.321+0000 7f4b24ff9640 1 -- 172.21.15.53:0/3169670637 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4b1c0551b0 con 0x7f4b2806efc0 2023-06-10T19:00:14.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:14.532+0000 7f4b2e53e640 1 -- 172.21.15.53:0/3169670637 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_create_fsync"]} v 0) v1 -- 0x7f4b28153570 con 0x7f4b2806efc0 2023-06-10T19:00:15.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.152+0000 7f4b24ff9640 1 -- 172.21.15.53:0/3169670637 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_create_fsync"]}]=0 v333) v1 ==== 152+0+0 (secure 0 0 0) 0x7f4b1c054d40 con 0x7f4b2806efc0 2023-06-10T19:00:15.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.152+0000 7f4b2e53e640 1 -- 172.21.15.53:0/3169670637 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4b14066280 msgr2=0x7f4b14068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:15.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.152+0000 7f4b2e53e640 1 --2- 172.21.15.53:0/3169670637 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4b14066280 0x7f4b14068730 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f4b18005890 tx=0x7f4b18009040 comp rx=0 tx=0).stop 2023-06-10T19:00:15.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.152+0000 7f4b2e53e640 1 -- 172.21.15.53:0/3169670637 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4b2806efc0 msgr2=0x7f4b281f36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:15.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.152+0000 7f4b2e53e640 1 --2- 172.21.15.53:0/3169670637 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4b2806efc0 0x7f4b281f36c0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c00d800 tx=0x7f4b1c00dcc0 comp rx=0 tx=0).stop 2023-06-10T19:00:15.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.152+0000 7f4b2e53e640 1 -- 172.21.15.53:0/3169670637 shutdown_connections 2023-06-10T19:00:15.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.152+0000 7f4b2e53e640 1 --2- 172.21.15.53:0/3169670637 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4b14066280 0x7f4b14068730 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:15.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.152+0000 7f4b2e53e640 1 --2- 172.21.15.53:0/3169670637 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b280ccfe0 0x7f4b281f3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:15.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.152+0000 7f4b2e53e640 1 --2- 172.21.15.53:0/3169670637 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4b2806efc0 0x7f4b281f36c0 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:15.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.152+0000 7f4b2e53e640 1 --2- 172.21.15.53:0/3169670637 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4b2806bb30 0x7f4b280c42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:15.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.152+0000 7f4b2e53e640 1 -- 172.21.15.53:0/3169670637 >> 172.21.15.53:0/3169670637 conn(0x7f4b2806a0d0 msgr2=0x7f4b2806f510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:15.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.152+0000 7f4b2e53e640 1 -- 172.21.15.53:0/3169670637 shutdown_connections 2023-06-10T19:00:15.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.152+0000 7f4b2e53e640 1 -- 172.21.15.53:0/3169670637 wait complete. 2023-06-10T19:00:15.182 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-06-10T19:00:15.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.312+0000 7fe3b7b69640 1 Processor -- start 2023-06-10T19:00:15.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.312+0000 7fe3b7b69640 1 -- start start 2023-06-10T19:00:15.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.312+0000 7fe3b7b69640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3b00c9fa0 0x7fe3b006bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:15.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.312+0000 7fe3b7b69640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe3b00af760 0x7fe3b00afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:15.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.312+0000 7fe3b7b69640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3b006b090 con 0x7fe3b006c020 2023-06-10T19:00:15.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.312+0000 7fe3b7b69640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3b00b0120 con 0x7fe3b00af760 2023-06-10T19:00:15.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.312+0000 7fe3b7b69640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b00ca370 con 0x7fe3b00c9fa0 2023-06-10T19:00:15.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.312+0000 7fe3b6106640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe3b00af760 0x7fe3b00afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:15.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.312+0000 7fe3b6106640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe3b00af760 0x7fe3b00afbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60830/0 (socket says 172.21.15.53:60830) 2023-06-10T19:00:15.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.312+0000 7fe3b6106640 1 -- 172.21.15.53:0/2556127825 learned_addr learned my addr 172.21.15.53:0/2556127825 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:15.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.312+0000 7fe3b6106640 1 -- 172.21.15.53:0/2556127825 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3b00c9fa0 msgr2=0x7fe3b006bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:15.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.312+0000 7fe3b5905640 1 --2- 172.21.15.53:0/2556127825 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3b00c9fa0 0x7fe3b006bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:15.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.312+0000 7fe3b6106640 1 --2- 172.21.15.53:0/2556127825 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3b00c9fa0 0x7fe3b006bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:15.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.312+0000 7fe3b6106640 1 -- 172.21.15.53:0/2556127825 >> v1:172.21.15.117:6789/0 conn(0x7fe3b006c020 legacy=0x7fe3b00c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:15.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.312+0000 7fe3b6106640 1 -- 172.21.15.53:0/2556127825 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3b0070d50 con 0x7fe3b00af760 2023-06-10T19:00:15.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.316+0000 7fe3b6106640 1 --2- 172.21.15.53:0/2556127825 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3b00af760 0x7fe3b00afbe0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fe3a8009e50 tx=0x7fe3a801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63d651538793f1f server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:15.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.316+0000 7fe3b4903640 1 -- 172.21.15.53:0/2556127825 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a80a5790 con 0x7fe3b00af760 2023-06-10T19:00:15.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.316+0000 7fe3b4903640 1 -- 172.21.15.53:0/2556127825 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3a80a58f0 con 0x7fe3b00af760 2023-06-10T19:00:15.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.316+0000 7fe3b4903640 1 -- 172.21.15.53:0/2556127825 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a80a5c80 con 0x7fe3b00af760 2023-06-10T19:00:15.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.316+0000 7fe3b7b69640 1 -- 172.21.15.53:0/2556127825 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3b00af760 msgr2=0x7fe3b00afbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:15.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.316+0000 7fe3b7b69640 1 --2- 172.21.15.53:0/2556127825 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3b00af760 0x7fe3b00afbe0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fe3a8009e50 tx=0x7fe3a801c910 comp rx=0 tx=0).stop 2023-06-10T19:00:15.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.316+0000 7fe3b7b69640 1 -- 172.21.15.53:0/2556127825 shutdown_connections 2023-06-10T19:00:15.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.316+0000 7fe3b7b69640 1 --2- 172.21.15.53:0/2556127825 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3b00af760 0x7fe3b00afbe0 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:15.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.316+0000 7fe3b7b69640 1 --2- 172.21.15.53:0/2556127825 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3b00c9fa0 0x7fe3b006bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:15.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.316+0000 7fe3b7b69640 1 -- 172.21.15.53:0/2556127825 >> 172.21.15.53:0/2556127825 conn(0x7fe3b006a0e0 msgr2=0x7fe3b00cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:15.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.316+0000 7fe3b7b69640 1 -- 172.21.15.53:0/2556127825 shutdown_connections 2023-06-10T19:00:15.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.316+0000 7fe3b7b69640 1 -- 172.21.15.53:0/2556127825 wait complete. 2023-06-10T19:00:15.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.316+0000 7fe3b7b69640 1 Processor -- start 2023-06-10T19:00:15.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.316+0000 7fe3b7b69640 1 -- start start 2023-06-10T19:00:15.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.316+0000 7fe3b7b69640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3b006c020 0x7fe3b00c3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:15.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.316+0000 7fe3b7b69640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3b00af760 0x7fe3b0143730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:15.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.316+0000 7fe3b7b69640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3b00c9fa0 0x7fe3b01588d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:15.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.316+0000 7fe3b7b69640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b01441d0 con 0x7fe3b00c9fa0 2023-06-10T19:00:15.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.316+0000 7fe3b7b69640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b01444b0 con 0x7fe3b006c020 2023-06-10T19:00:15.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.316+0000 7fe3b7b69640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b0144790 con 0x7fe3b00af760 2023-06-10T19:00:15.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.316+0000 7fe3b6106640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3b00c9fa0 0x7fe3b01588d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:15.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.316+0000 7fe3b6106640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3b00c9fa0 0x7fe3b01588d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60838/0 (socket says 172.21.15.53:60838) 2023-06-10T19:00:15.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.316+0000 7fe3b6106640 1 -- 172.21.15.53:0/3106839073 learned_addr learned my addr 172.21.15.53:0/3106839073 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:15.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.316+0000 7fe3b5905640 1 --2- 172.21.15.53:0/3106839073 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3b006c020 0x7fe3b00c3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:15.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.316+0000 7fe3b5104640 1 --2- 172.21.15.53:0/3106839073 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3b00af760 0x7fe3b0143730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:15.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.316+0000 7fe3b6106640 1 -- 172.21.15.53:0/3106839073 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3b00af760 msgr2=0x7fe3b0143730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:15.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.316+0000 7fe3b6106640 1 --2- 172.21.15.53:0/3106839073 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3b00af760 0x7fe3b0143730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:15.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.316+0000 7fe3b6106640 1 -- 172.21.15.53:0/3106839073 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3b006c020 msgr2=0x7fe3b00c3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:15.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.316+0000 7fe3b6106640 1 --2- 172.21.15.53:0/3106839073 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3b006c020 0x7fe3b00c3a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:15.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.316+0000 7fe3b6106640 1 -- 172.21.15.53:0/3106839073 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3a8009b30 con 0x7fe3b00c9fa0 2023-06-10T19:00:15.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.316+0000 7fe3b6106640 1 --2- 172.21.15.53:0/3106839073 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3b00c9fa0 0x7fe3b01588d0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fe3a801afc0 tx=0x7fe3a80196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:15.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.320+0000 7fe3a67fc640 1 -- 172.21.15.53:0/3106839073 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a80b8670 con 0x7fe3b00c9fa0 2023-06-10T19:00:15.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.320+0000 7fe3a67fc640 1 -- 172.21.15.53:0/3106839073 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3a80b87d0 con 0x7fe3b00c9fa0 2023-06-10T19:00:15.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.320+0000 7fe3b7b69640 1 -- 172.21.15.53:0/3106839073 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3b0144a70 con 0x7fe3b00c9fa0 2023-06-10T19:00:15.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.320+0000 7fe3a67fc640 1 -- 172.21.15.53:0/3106839073 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a80b8b80 con 0x7fe3b00c9fa0 2023-06-10T19:00:15.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.320+0000 7fe3b7b69640 1 -- 172.21.15.53:0/3106839073 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3b00c3fa0 con 0x7fe3b00c9fa0 2023-06-10T19:00:15.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.320+0000 7fe3b7b69640 1 -- 172.21.15.53:0/3106839073 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3b004d790 con 0x7fe3b00c9fa0 2023-06-10T19:00:15.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.320+0000 7fe3a67fc640 1 -- 172.21.15.53:0/3106839073 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe3a80b8ce0 con 0x7fe3b00c9fa0 2023-06-10T19:00:15.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.320+0000 7fe3a67fc640 1 --2- 172.21.15.53:0/3106839073 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe394066280 0x7fe394068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:15.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.320+0000 7fe3a67fc640 1 -- 172.21.15.53:0/3106839073 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fe3a811f160 con 0x7fe3b00c9fa0 2023-06-10T19:00:15.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.320+0000 7fe3b5905640 1 --2- 172.21.15.53:0/3106839073 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe394066280 0x7fe394068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:15.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.320+0000 7fe3b5905640 1 --2- 172.21.15.53:0/3106839073 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe394066280 0x7fe394068730 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fe3ac00a8d0 tx=0x7fe3ac008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:15.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.324+0000 7fe3a67fc640 1 -- 172.21.15.53:0/3106839073 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe3a80eca10 con 0x7fe3b00c9fa0 2023-06-10T19:00:15.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.476+0000 7fe3b7b69640 1 -- 172.21.15.53:0/3106839073 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fe3b0144f20 con 0x7fe3b00c9fa0 2023-06-10T19:00:15.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.488+0000 7fe3a67fc640 1 -- 172.21.15.53:0/3106839073 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe3a80f0030 con 0x7fe3b00c9fa0 2023-06-10T19:00:15.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.488+0000 7fe3b7b69640 1 -- 172.21.15.53:0/3106839073 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe394066280 msgr2=0x7fe394068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:15.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.488+0000 7fe3b7b69640 1 --2- 172.21.15.53:0/3106839073 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe394066280 0x7fe394068730 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fe3ac00a8d0 tx=0x7fe3ac008040 comp rx=0 tx=0).stop 2023-06-10T19:00:15.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.488+0000 7fe3b7b69640 1 -- 172.21.15.53:0/3106839073 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3b00c9fa0 msgr2=0x7fe3b01588d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:15.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.488+0000 7fe3b7b69640 1 --2- 172.21.15.53:0/3106839073 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3b00c9fa0 0x7fe3b01588d0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fe3a801afc0 tx=0x7fe3a80196b0 comp rx=0 tx=0).stop 2023-06-10T19:00:15.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.488+0000 7fe3b7b69640 1 -- 172.21.15.53:0/3106839073 shutdown_connections 2023-06-10T19:00:15.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.488+0000 7fe3b7b69640 1 --2- 172.21.15.53:0/3106839073 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe394066280 0x7fe394068730 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:15.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.488+0000 7fe3b7b69640 1 --2- 172.21.15.53:0/3106839073 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe3b00c9fa0 0x7fe3b01588d0 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:15.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.488+0000 7fe3b7b69640 1 --2- 172.21.15.53:0/3106839073 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3b00af760 0x7fe3b0143730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:15.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.488+0000 7fe3b7b69640 1 --2- 172.21.15.53:0/3106839073 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3b006c020 0x7fe3b00c3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:15.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.488+0000 7fe3b7b69640 1 -- 172.21.15.53:0/3106839073 >> 172.21.15.53:0/3106839073 conn(0x7fe3b006a0e0 msgr2=0x7fe3b00aeb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:15.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.488+0000 7fe3b7b69640 1 -- 172.21.15.53:0/3106839073 shutdown_connections 2023-06-10T19:00:15.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.488+0000 7fe3b7b69640 1 -- 172.21.15.53:0/3106839073 wait complete. 2023-06-10T19:00:15.511 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-06-10T19:00:15.511 DEBUG:teuthology.orchestra.run.smithi053:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-06-10T19:00:15.565 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-06-10T19:00:15.615 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-06-10T19:00:15.615 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T19:00:15.616 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:00:15.621 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16345192k,nr_inodes=4086298,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276544k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=407 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276540k,nr_inodes=819135,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276544k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-06-10T19:00:15.621 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T19:00:15.622 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:00:15.627 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16342088k,nr_inodes=4085522,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275924k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18845 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275920k,nr_inodes=818980,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275924k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-06-10T19:00:15.627 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T19:00:15.627 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:00:15.668 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16345192k,nr_inodes=4086298,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276544k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=407 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276540k,nr_inodes=819135,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276544k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-06-10T19:00:15.668 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T19:00:15.669 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:00:15.674 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16342088k,nr_inodes=4085522,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275924k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18845 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275920k,nr_inodes=818980,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275924k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-06-10T19:00:15.674 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-06-10T19:00:15.675 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:00:15.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.820+0000 7ff7f5c54640 1 Processor -- start 2023-06-10T19:00:15.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.820+0000 7ff7f5c54640 1 -- start start 2023-06-10T19:00:15.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.824+0000 7ff7f5c54640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff7f00c8d00 0x7ff7f006b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:15.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.824+0000 7ff7f5c54640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff7f006bc00 0x7ff7f0162180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:15.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.824+0000 7ff7f5c54640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7f0158a90 con 0x7ff7f006b2f0 2023-06-10T19:00:15.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.824+0000 7ff7f5c54640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7f006f780 con 0x7ff7f00c8d00 2023-06-10T19:00:15.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.824+0000 7ff7f5c54640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7f00705d0 con 0x7ff7f006bc00 2023-06-10T19:00:15.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.824+0000 7ff7ef7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ff7f006b2f0 0x7ff7f006f070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52612/0 (socket says 172.21.15.53:52612) 2023-06-10T19:00:15.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.824+0000 7ff7ef7fe640 1 -- 172.21.15.53:0/2705942322 learned_addr learned my addr 172.21.15.53:0/2705942322 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:00:15.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.824+0000 7ff7eeffd640 1 --2- 172.21.15.53:0/2705942322 >> v2:172.21.15.53:3300/0 conn(0x7ff7f00c8d00 0x7ff7f006b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:15.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.824+0000 7ff7ee7fc640 1 -- 172.21.15.53:0/2705942322 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 132740097 0 0) 0x7ff7e0001120 con 0x7ff7f006b2f0 2023-06-10T19:00:15.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.824+0000 7ff7ee7fc640 1 -- 172.21.15.53:0/2705942322 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7d8003530 con 0x7ff7f006b2f0 2023-06-10T19:00:15.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.824+0000 7ff7effff640 1 --2- 172.21.15.53:0/2705942322 >> v2:172.21.15.117:3300/0 conn(0x7ff7f006bc00 0x7ff7f0162180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:15.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.824+0000 7ff7eeffd640 1 -- 172.21.15.53:0/2705942322 >> v2:172.21.15.117:3300/0 conn(0x7ff7f006bc00 msgr2=0x7ff7f0162180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:15.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.824+0000 7ff7eeffd640 1 --2- 172.21.15.53:0/2705942322 >> v2:172.21.15.117:3300/0 conn(0x7ff7f006bc00 0x7ff7f0162180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:15.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.824+0000 7ff7eeffd640 1 -- 172.21.15.53:0/2705942322 >> v1:172.21.15.53:6789/0 conn(0x7ff7f006b2f0 legacy=0x7ff7f006f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:15.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.824+0000 7ff7ee7fc640 1 -- 172.21.15.53:0/2705942322 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3434518771 0 0) 0x7ff7d8003530 con 0x7ff7f006b2f0 2023-06-10T19:00:15.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.824+0000 7ff7eeffd640 1 -- 172.21.15.53:0/2705942322 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7f00cce10 con 0x7ff7f00c8d00 2023-06-10T19:00:15.832 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.828+0000 7ff7eeffd640 1 --2- 172.21.15.53:0/2705942322 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff7f00c8d00 0x7ff7f006b6c0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7ff7f00c87f0 tx=0x7ff7e401eb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8000f4f57da27ca9 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:15.832 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.828+0000 7ff7ee7fc640 1 -- 172.21.15.53:0/2705942322 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e0001810 con 0x7ff7f00c8d00 2023-06-10T19:00:15.832 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.828+0000 7ff7ee7fc640 1 -- 172.21.15.53:0/2705942322 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7e40a85f0 con 0x7ff7f00c8d00 2023-06-10T19:00:15.832 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.828+0000 7ff7ee7fc640 1 -- 172.21.15.53:0/2705942322 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e40a8980 con 0x7ff7f00c8d00 2023-06-10T19:00:15.832 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.828+0000 7ff7f5c54640 1 -- 172.21.15.53:0/2705942322 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff7f00c8d00 msgr2=0x7ff7f006b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:15.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.828+0000 7ff7f5c54640 1 --2- 172.21.15.53:0/2705942322 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff7f00c8d00 0x7ff7f006b6c0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7ff7f00c87f0 tx=0x7ff7e401eb70 comp rx=0 tx=0).stop 2023-06-10T19:00:15.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.828+0000 7ff7f5c54640 1 -- 172.21.15.53:0/2705942322 shutdown_connections 2023-06-10T19:00:15.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.828+0000 7ff7f5c54640 1 --2- 172.21.15.53:0/2705942322 >> v2:172.21.15.117:3300/0 conn(0x7ff7f006bc00 0x7ff7f0162180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:15.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.828+0000 7ff7f5c54640 1 --2- 172.21.15.53:0/2705942322 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff7f00c8d00 0x7ff7f006b6c0 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:15.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.828+0000 7ff7f5c54640 1 -- 172.21.15.53:0/2705942322 >> 172.21.15.53:0/2705942322 conn(0x7ff7f006a0d0 msgr2=0x7ff7f00ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:15.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.828+0000 7ff7f5c54640 1 -- 172.21.15.53:0/2705942322 shutdown_connections 2023-06-10T19:00:15.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.828+0000 7ff7f5c54640 1 -- 172.21.15.53:0/2705942322 wait complete. 2023-06-10T19:00:15.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.828+0000 7ff7f5c54640 1 Processor -- start 2023-06-10T19:00:15.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.828+0000 7ff7f5c54640 1 -- start start 2023-06-10T19:00:15.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.828+0000 7ff7f5c54640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff7f006b2f0 0x7ff7f01f2d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:15.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.828+0000 7ff7f5c54640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7f006bc00 0x7ff7f01ee6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:15.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.828+0000 7ff7f5c54640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7f00c8d00 0x7ff7f00c7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:15.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.828+0000 7ff7f5c54640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f00afc90 con 0x7ff7f006b2f0 2023-06-10T19:00:15.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.828+0000 7ff7f5c54640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f0148bc0 con 0x7ff7f00c8d00 2023-06-10T19:00:15.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.828+0000 7ff7f5c54640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f0148f80 con 0x7ff7f006bc00 2023-06-10T19:00:15.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.828+0000 7ff7ef7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff7f006b2f0 0x7ff7f01f2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:15.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.828+0000 7ff7ef7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff7f006b2f0 0x7ff7f01f2d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60854/0 (socket says 172.21.15.53:60854) 2023-06-10T19:00:15.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.828+0000 7ff7ef7fe640 1 -- 172.21.15.53:0/3794064796 learned_addr learned my addr 172.21.15.53:0/3794064796 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:15.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.828+0000 7ff7eeffd640 1 --2- 172.21.15.53:0/3794064796 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7f006bc00 0x7ff7f01ee6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:15.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.828+0000 7ff7ef7fe640 1 -- 172.21.15.53:0/3794064796 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7f006bc00 msgr2=0x7ff7f01ee6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:15.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.828+0000 7ff7ef7fe640 1 --2- 172.21.15.53:0/3794064796 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7f006bc00 0x7ff7f01ee6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:15.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.828+0000 7ff7effff640 1 --2- 172.21.15.53:0/3794064796 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7f00c8d00 0x7ff7f00c7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:15.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.828+0000 7ff7ef7fe640 1 -- 172.21.15.53:0/3794064796 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7f00c8d00 msgr2=0x7ff7f00c7b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:15.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.828+0000 7ff7ef7fe640 1 --2- 172.21.15.53:0/3794064796 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7f00c8d00 0x7ff7f00c7b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:15.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.828+0000 7ff7ef7fe640 1 -- 172.21.15.53:0/3794064796 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7e4009420 con 0x7ff7f006b2f0 2023-06-10T19:00:15.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.828+0000 7ff7eeffd640 1 --2- 172.21.15.53:0/3794064796 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7f006bc00 0x7ff7f01ee6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:00:15.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.828+0000 7ff7ef7fe640 1 --2- 172.21.15.53:0/3794064796 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff7f006b2f0 0x7ff7f01f2d10 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7ff7e000c780 tx=0x7ff7e000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:15.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.828+0000 7ff7d7fff640 1 -- 172.21.15.53:0/3794064796 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e0005cf0 con 0x7ff7f006b2f0 2023-06-10T19:00:15.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.828+0000 7ff7d7fff640 1 -- 172.21.15.53:0/3794064796 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7e0005e50 con 0x7ff7f006b2f0 2023-06-10T19:00:15.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.828+0000 7ff7f5c54640 1 -- 172.21.15.53:0/3794064796 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7f01eec10 con 0x7ff7f006b2f0 2023-06-10T19:00:15.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.832+0000 7ff7d7fff640 1 -- 172.21.15.53:0/3794064796 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e0007290 con 0x7ff7f006b2f0 2023-06-10T19:00:15.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.832+0000 7ff7f5c54640 1 -- 172.21.15.53:0/3794064796 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7f014b780 con 0x7ff7f006b2f0 2023-06-10T19:00:15.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.832+0000 7ff7f5c54640 1 -- 172.21.15.53:0/3794064796 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7f004d790 con 0x7ff7f006b2f0 2023-06-10T19:00:15.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.832+0000 7ff7d7fff640 1 -- 172.21.15.53:0/3794064796 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff7e00073f0 con 0x7ff7f006b2f0 2023-06-10T19:00:15.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.832+0000 7ff7d7fff640 1 --2- 172.21.15.53:0/3794064796 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff7dc066280 0x7ff7dc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:15.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.832+0000 7ff7d7fff640 1 -- 172.21.15.53:0/3794064796 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5339+0+0 (secure 0 0 0) 0x7ff7e0083700 con 0x7ff7f006b2f0 2023-06-10T19:00:15.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.832+0000 7ff7eeffd640 1 --2- 172.21.15.53:0/3794064796 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff7dc066280 0x7ff7dc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:15.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.832+0000 7ff7eeffd640 1 --2- 172.21.15.53:0/3794064796 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff7dc066280 0x7ff7dc068730 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7ff7e40b2000 tx=0x7ff7e40aa070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:15.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:15.836+0000 7ff7d7fff640 1 -- 172.21.15.53:0/3794064796 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff7e0050db0 con 0x7ff7f006b2f0 2023-06-10T19:00:16.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:16.024+0000 7ff7f5c54640 1 -- 172.21.15.53:0/3794064796 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff7f0158a70 con 0x7ff7f006b2f0 2023-06-10T19:00:16.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:16.024+0000 7ff7d7fff640 1 -- 172.21.15.53:0/3794064796 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+3529 (secure 0 0 0) 0x7ff7e0055e60 con 0x7ff7f006b2f0 2023-06-10T19:00:16.030 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:00:16.030 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":28,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5444,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1300171732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":1300171732},{"type":"v1","addr":"172.21.15.117:6837","nonce":1300171732}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5818,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/507478314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":507478314},{"type":"v1","addr":"172.21.15.117:6836","nonce":507478314}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":6504,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/169051241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":169051241},{"type":"v1","addr":"172.21.15.53:6833","nonce":169051241}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":6933,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2184372457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2184372457},{"type":"v1","addr":"172.21.15.53:6835","nonce":2184372457}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[]} 2023-06-10T19:00:16.031 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 28 2023-06-10T19:00:16.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:16.028+0000 7ff7f5c54640 1 -- 172.21.15.53:0/3794064796 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff7dc066280 msgr2=0x7ff7dc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:16.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:16.028+0000 7ff7f5c54640 1 --2- 172.21.15.53:0/3794064796 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff7dc066280 0x7ff7dc068730 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7ff7e40b2000 tx=0x7ff7e40aa070 comp rx=0 tx=0).stop 2023-06-10T19:00:16.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:16.028+0000 7ff7f5c54640 1 -- 172.21.15.53:0/3794064796 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff7f006b2f0 msgr2=0x7ff7f01f2d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:16.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:16.028+0000 7ff7f5c54640 1 --2- 172.21.15.53:0/3794064796 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff7f006b2f0 0x7ff7f01f2d10 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7ff7e000c780 tx=0x7ff7e000cc40 comp rx=0 tx=0).stop 2023-06-10T19:00:16.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:16.028+0000 7ff7f5c54640 1 -- 172.21.15.53:0/3794064796 shutdown_connections 2023-06-10T19:00:16.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:16.028+0000 7ff7f5c54640 1 --2- 172.21.15.53:0/3794064796 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff7dc066280 0x7ff7dc068730 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:16.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:16.028+0000 7ff7f5c54640 1 --2- 172.21.15.53:0/3794064796 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7f00c8d00 0x7ff7f00c7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:16.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:16.028+0000 7ff7f5c54640 1 --2- 172.21.15.53:0/3794064796 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7f006bc00 0x7ff7f01ee6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:16.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:16.028+0000 7ff7f5c54640 1 --2- 172.21.15.53:0/3794064796 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff7f006b2f0 0x7ff7f01f2d10 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:16.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:16.028+0000 7ff7f5c54640 1 -- 172.21.15.53:0/3794064796 >> 172.21.15.53:0/3794064796 conn(0x7ff7f006a0d0 msgr2=0x7ff7f00ad6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:16.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:16.028+0000 7ff7f5c54640 1 -- 172.21.15.53:0/3794064796 shutdown_connections 2023-06-10T19:00:16.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:16.028+0000 7ff7f5c54640 1 -- 172.21.15.53:0/3794064796 wait complete. 2023-06-10T19:00:16.050 INFO:tasks.ceph.mds.a:Restarting daemon 2023-06-10T19:00:16.050 INFO:tasks.ceph.mds.a:Stopping old one... 2023-06-10T19:00:16.050 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-06-10T19:00:16.051 INFO:teuthology.orchestra.run:waiting for 300 2023-06-10T19:00:16.051 INFO:tasks.ceph.mds.c:Restarting daemon 2023-06-10T19:00:16.051 INFO:tasks.ceph.mds.c:Stopping old one... 2023-06-10T19:00:16.051 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-06-10T19:00:16.051 INFO:teuthology.orchestra.run:waiting for 300 2023-06-10T19:00:16.052 INFO:tasks.ceph.mds.b:Restarting daemon 2023-06-10T19:00:16.052 INFO:tasks.ceph.mds.b:Stopping old one... 2023-06-10T19:00:16.052 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-06-10T19:00:16.052 INFO:teuthology.orchestra.run:waiting for 300 2023-06-10T19:00:16.053 INFO:tasks.ceph.mds.d:Restarting daemon 2023-06-10T19:00:16.053 INFO:tasks.ceph.mds.d:Stopping old one... 2023-06-10T19:00:16.053 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-06-10T19:00:16.053 INFO:teuthology.orchestra.run:waiting for 300 2023-06-10T19:00:16.060 INFO:tasks.ceph.mds.a:Stopped 2023-06-10T19:00:16.060 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-06-10T19:00:16.062 INFO:tasks.ceph.mds.c:Stopped 2023-06-10T19:00:16.063 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-06-10T19:00:16.065 INFO:tasks.ceph.mds.b:Stopped 2023-06-10T19:00:16.066 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-06-10T19:00:16.067 INFO:tasks.ceph.mds.d:Stopped 2023-06-10T19:00:16.067 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-06-10T19:00:16.104 INFO:tasks.ceph.mds.a:Started 2023-06-10T19:00:16.105 DEBUG:teuthology.parallel:result is None 2023-06-10T19:00:16.106 INFO:tasks.ceph.mds.c:Started 2023-06-10T19:00:16.107 DEBUG:teuthology.parallel:result is None 2023-06-10T19:00:16.114 INFO:tasks.ceph.mds.b:Started 2023-06-10T19:00:16.115 DEBUG:teuthology.parallel:result is None 2023-06-10T19:00:16.115 INFO:tasks.ceph.mds.d:Started 2023-06-10T19:00:16.116 DEBUG:teuthology.parallel:result is None 2023-06-10T19:00:16.116 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-06-10T19:00:16.170 INFO:tasks.ceph.mds.a.smithi053.stdout:starting mds.a at 2023-06-10T19:00:16.177 INFO:tasks.ceph.mds.c.smithi053.stdout:starting mds.c at 2023-06-10T19:00:16.181 INFO:tasks.ceph.mds.d.smithi117.stdout:starting mds.d at 2023-06-10T19:00:16.184 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2023-06-10T19:00:16.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:16.232+0000 7fced74b6640 1 Processor -- start 2023-06-10T19:00:16.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:16.232+0000 7fced74b6640 1 -- start start 2023-06-10T19:00:16.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:16.232+0000 7fced74b6640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fced00afee0 0x7fced01645f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:16.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:16.232+0000 7fced74b6640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fced0071190 con 0x7fced01571a0 2023-06-10T19:00:16.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:16.232+0000 7fced74b6640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fced0070580 con 0x7fced0070100 2023-06-10T19:00:16.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:16.232+0000 7fced74b6640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fced0070860 con 0x7fced00afee0 2023-06-10T19:00:16.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:16.232+0000 7fced5252640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fced01571a0 0x7fced00c9f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52626/0 (socket says 172.21.15.53:52626) 2023-06-10T19:00:16.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:16.232+0000 7fced5252640 1 -- 172.21.15.53:0/3644399469 learned_addr learned my addr 172.21.15.53:0/3644399469 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:00:16.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:16.232+0000 7fced5a53640 1 --2- 172.21.15.53:0/3644399469 >> v2:172.21.15.117:3300/0 conn(0x7fced00afee0 0x7fced01645f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:16.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:16.232+0000 7fcec7fff640 1 -- 172.21.15.53:0/3644399469 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2319264067 0 0) 0x7fced0071190 con 0x7fced01571a0 2023-06-10T19:00:16.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:16.232+0000 7fcec7fff640 1 -- 172.21.15.53:0/3644399469 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcebc003530 con 0x7fced01571a0 2023-06-10T19:00:16.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:16.232+0000 7fced5a53640 1 -- 172.21.15.53:0/3644399469 >> v1:172.21.15.117:6789/0 conn(0x7fced0070100 legacy=0x7fced00af7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:16.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:16.232+0000 7fcec7fff640 1 -- 172.21.15.53:0/3644399469 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4203115310 0 0) 0x7fced0070580 con 0x7fced0070100 2023-06-10T19:00:16.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:16.232+0000 7fced5a53640 1 -- 172.21.15.53:0/3644399469 >> v1:172.21.15.53:6789/0 conn(0x7fced01571a0 legacy=0x7fced00c9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:16.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:16.232+0000 7fced5a53640 1 -- 172.21.15.53:0/3644399469 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fced0070b40 con 0x7fced00afee0 2023-06-10T19:00:16.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:16.236+0000 7fced5a53640 1 --2- 172.21.15.53:0/3644399469 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fced00afee0 0x7fced01645f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fcec8009d90 tx=0x7fcec801c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18a0f713fcf702b2 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:16.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:16.236+0000 7fcec7fff640 1 -- 172.21.15.53:0/3644399469 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec80a5980 con 0x7fced00afee0 2023-06-10T19:00:16.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:16.236+0000 7fcec7fff640 1 -- 172.21.15.53:0/3644399469 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcec80a5ae0 con 0x7fced00afee0 2023-06-10T19:00:16.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:16.236+0000 7fcec7fff640 1 -- 172.21.15.53:0/3644399469 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec80a5e50 con 0x7fced00afee0 2023-06-10T19:00:16.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:16.236+0000 7fced74b6640 1 -- 172.21.15.53:0/3644399469 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fced00afee0 msgr2=0x7fced01645f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:16.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:16.236+0000 7fced74b6640 1 --2- 172.21.15.53:0/3644399469 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fced00afee0 0x7fced01645f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fcec8009d90 tx=0x7fcec801c920 comp rx=0 tx=0).stop 2023-06-10T19:00:16.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:16.236+0000 7fced74b6640 1 -- 172.21.15.53:0/3644399469 shutdown_connections 2023-06-10T19:00:16.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:16.236+0000 7fced74b6640 1 --2- 172.21.15.53:0/3644399469 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fced00afee0 0x7fced01645f0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:16.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:16.236+0000 7fced74b6640 1 -- 172.21.15.53:0/3644399469 >> 172.21.15.53:0/3644399469 conn(0x7fced00ce9e0 msgr2=0x7fced00ca7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:16.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:16.236+0000 7fced74b6640 1 -- 172.21.15.53:0/3644399469 shutdown_connections 2023-06-10T19:00:16.243 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:16.236+0000 7fced74b6640 1 -- 172.21.15.53:0/3644399469 wait complete. 2023-06-10T19:00:16.245 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:16.236+0000 7fced74b6640 1 Processor -- start 2023-06-10T19:00:16.245 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:16.236+0000 7fced74b6640 1 -- start start 2023-06-10T19:00:16.245 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:16.236+0000 7fced74b6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fced00afee0 0x7fced014f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:16.245 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:16.236+0000 7fced74b6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fced01571a0 0x7fced00c68f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:16.245 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:16.236+0000 7fced74b6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fced00c4d90 0x7fced00c5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:16.246 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:16.236+0000 7fced74b6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced00c5850 con 0x7fced00afee0 2023-06-10T19:00:16.246 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:16.236+0000 7fced74b6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced00c5b30 con 0x7fced00c4d90 2023-06-10T19:00:16.246 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:16.236+0000 7fced74b6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fced00c5e10 con 0x7fced01571a0 2023-06-10T19:00:16.246 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:16.236+0000 7fced5252640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fced00afee0 0x7fced014f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:16.246 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:16.236+0000 7fced5252640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fced00afee0 0x7fced014f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60902/0 (socket says 172.21.15.53:60902) 2023-06-10T19:00:16.247 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:16.236+0000 7fced5252640 1 -- 172.21.15.53:0/2010711347 learned_addr learned my addr 172.21.15.53:0/2010711347 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:16.247 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:16.236+0000 7fced4a51640 1 --2- 172.21.15.53:0/2010711347 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fced01571a0 0x7fced00c68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:16.247 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:16.236+0000 7fced5a53640 1 --2- 172.21.15.53:0/2010711347 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fced00c4d90 0x7fced00c5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:16.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:16.236+0000 7fced5252640 1 -- 172.21.15.53:0/2010711347 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fced01571a0 msgr2=0x7fced00c68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:16.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:16.236+0000 7fced5252640 1 --2- 172.21.15.53:0/2010711347 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fced01571a0 0x7fced00c68f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:16.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:16.236+0000 7fced5252640 1 -- 172.21.15.53:0/2010711347 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fced00c4d90 msgr2=0x7fced00c5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:16.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:16.236+0000 7fced5252640 1 --2- 172.21.15.53:0/2010711347 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fced00c4d90 0x7fced00c5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:16.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:16.236+0000 7fced5252640 1 -- 172.21.15.53:0/2010711347 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcec8009a70 con 0x7fced00afee0 2023-06-10T19:00:16.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:16.236+0000 7fced5252640 1 --2- 172.21.15.53:0/2010711347 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fced00afee0 0x7fced014f510 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fcecc001ec0 tx=0x7fcecc00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:16.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:16.240+0000 7fcec5ffb640 1 -- 172.21.15.53:0/2010711347 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcecc005cf0 con 0x7fced00afee0 2023-06-10T19:00:16.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:16.240+0000 7fcec5ffb640 1 -- 172.21.15.53:0/2010711347 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcecc005e50 con 0x7fced00afee0 2023-06-10T19:00:16.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:16.240+0000 7fced74b6640 1 -- 172.21.15.53:0/2010711347 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fced00c60f0 con 0x7fced00afee0 2023-06-10T19:00:16.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:16.240+0000 7fcec5ffb640 1 -- 172.21.15.53:0/2010711347 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcecc0072f0 con 0x7fced00afee0 2023-06-10T19:00:16.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:16.240+0000 7fced74b6640 1 -- 172.21.15.53:0/2010711347 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fced00c6e30 con 0x7fced00afee0 2023-06-10T19:00:16.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:16.240+0000 7fced74b6640 1 -- 172.21.15.53:0/2010711347 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fced004d790 con 0x7fced00afee0 2023-06-10T19:00:16.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:16.240+0000 7fcec5ffb640 1 -- 172.21.15.53:0/2010711347 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcecc007450 con 0x7fced00afee0 2023-06-10T19:00:16.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:16.240+0000 7fcec5ffb640 1 --2- 172.21.15.53:0/2010711347 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fceb40662b0 0x7fceb4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:16.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:16.240+0000 7fcec5ffb640 1 -- 172.21.15.53:0/2010711347 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fcecc082f30 con 0x7fced00afee0 2023-06-10T19:00:16.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:16.240+0000 7fced4a51640 1 --2- 172.21.15.53:0/2010711347 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fceb40662b0 0x7fceb4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:16.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:16.240+0000 7fced4a51640 1 --2- 172.21.15.53:0/2010711347 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fceb40662b0 0x7fceb4068760 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fced0157fb0 tx=0x7fcec0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:16.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:16.244+0000 7fcec5ffb640 1 -- 172.21.15.53:0/2010711347 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcecc050760 con 0x7fced00afee0 2023-06-10T19:00:16.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:16.408+0000 7fced74b6640 1 -- 172.21.15.53:0/2010711347 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fced00c65a0 con 0x7fced00afee0 2023-06-10T19:00:17.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.216+0000 7fcec5ffb640 1 -- 172.21.15.53:0/2010711347 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v76) v1 ==== 97+0+0 (secure 0 0 0) 0x7fcecc017080 con 0x7fced00afee0 2023-06-10T19:00:17.222 INFO:teuthology.orchestra.run.smithi053.stderr: removed all blocklist entries 2023-06-10T19:00:17.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.220+0000 7fced74b6640 1 -- 172.21.15.53:0/2010711347 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fceb40662b0 msgr2=0x7fceb4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:17.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.220+0000 7fced74b6640 1 --2- 172.21.15.53:0/2010711347 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fceb40662b0 0x7fceb4068760 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fced0157fb0 tx=0x7fcec0009040 comp rx=0 tx=0).stop 2023-06-10T19:00:17.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.220+0000 7fced74b6640 1 -- 172.21.15.53:0/2010711347 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fced00afee0 msgr2=0x7fced014f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:17.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.220+0000 7fced74b6640 1 --2- 172.21.15.53:0/2010711347 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fced00afee0 0x7fced014f510 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fcecc001ec0 tx=0x7fcecc00c890 comp rx=0 tx=0).stop 2023-06-10T19:00:17.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.220+0000 7fced74b6640 1 -- 172.21.15.53:0/2010711347 shutdown_connections 2023-06-10T19:00:17.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.220+0000 7fced74b6640 1 --2- 172.21.15.53:0/2010711347 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fceb40662b0 0x7fceb4068760 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:17.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.220+0000 7fced74b6640 1 --2- 172.21.15.53:0/2010711347 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fced00c4d90 0x7fced00c5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:17.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.220+0000 7fced74b6640 1 --2- 172.21.15.53:0/2010711347 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fced01571a0 0x7fced00c68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:17.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.220+0000 7fced74b6640 1 --2- 172.21.15.53:0/2010711347 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fced00afee0 0x7fced014f510 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:17.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.220+0000 7fced74b6640 1 -- 172.21.15.53:0/2010711347 >> 172.21.15.53:0/2010711347 conn(0x7fced00ce9e0 msgr2=0x7fced00c7ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:17.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.220+0000 7fced74b6640 1 -- 172.21.15.53:0/2010711347 shutdown_connections 2023-06-10T19:00:17.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.220+0000 7fced74b6640 1 -- 172.21.15.53:0/2010711347 wait complete. 2023-06-10T19:00:17.246 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-06-10T19:00:17.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.372+0000 7f6289c15640 1 Processor -- start 2023-06-10T19:00:17.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.372+0000 7f6289c15640 1 -- start start 2023-06-10T19:00:17.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.372+0000 7f6289c15640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62840cc690 0x7f62840d04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:17.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.372+0000 7f6289c15640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62840d0020 con 0x7f62840b3ac0 2023-06-10T19:00:17.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.372+0000 7f6289c15640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62840cef40 con 0x7f62840ccae0 2023-06-10T19:00:17.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.372+0000 7f6289c15640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62840cf220 con 0x7f62840cc690 2023-06-10T19:00:17.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.372+0000 7f62837fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f62840b3ac0 0x7f62840b3e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52640/0 (socket says 172.21.15.53:52640) 2023-06-10T19:00:17.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.372+0000 7f62837fe640 1 -- 172.21.15.53:0/3341377060 learned_addr learned my addr 172.21.15.53:0/3341377060 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:00:17.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.372+0000 7f627affd640 1 --2- 172.21.15.53:0/3341377060 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62840cc690 0x7f62840d04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:17.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.372+0000 7f6282ffd640 1 -- 172.21.15.53:0/3341377060 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2929049121 0 0) 0x7f62840d0020 con 0x7f62840b3ac0 2023-06-10T19:00:17.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.372+0000 7f6282ffd640 1 -- 172.21.15.53:0/3341377060 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6270003530 con 0x7f62840b3ac0 2023-06-10T19:00:17.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.372+0000 7f6282ffd640 1 -- 172.21.15.53:0/3341377060 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2948067137 0 0) 0x7f6270003530 con 0x7f62840b3ac0 2023-06-10T19:00:17.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.372+0000 7f6282ffd640 1 -- 172.21.15.53:0/3341377060 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62840cc690 msgr2=0x7f62840d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:17.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.372+0000 7f6282ffd640 1 --2- 172.21.15.53:0/3341377060 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62840cc690 0x7f62840d04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:17.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.372+0000 7f6282ffd640 1 -- 172.21.15.53:0/3341377060 >> v1:172.21.15.117:6789/0 conn(0x7f62840ccae0 legacy=0x7f62840d09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:17.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.372+0000 7f6282ffd640 1 -- 172.21.15.53:0/3341377060 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62840cf500 con 0x7f62840b3ac0 2023-06-10T19:00:17.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.372+0000 7f6282ffd640 1 -- 172.21.15.53:0/3341377060 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f6274001a00 con 0x7f62840b3ac0 2023-06-10T19:00:17.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.372+0000 7f6282ffd640 1 -- 172.21.15.53:0/3341377060 >> v1:172.21.15.53:6789/0 conn(0x7f62840b3ac0 legacy=0x7f62840b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:17.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.372+0000 7f6282ffd640 1 --2- 172.21.15.53:0/3341377060 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62840cc690 0x7f6270003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:17.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.372+0000 7f6282ffd640 1 --2- 172.21.15.53:0/3341377060 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6270003fa0 0x7f62700047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:17.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.372+0000 7f6282ffd640 1 --2- 172.21.15.53:0/3341377060 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6270004d10 0x7f6270005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:17.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.372+0000 7f6282ffd640 1 -- 172.21.15.53:0/3341377060 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62840cf220 con 0x7f6270004d10 2023-06-10T19:00:17.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.372+0000 7f6282ffd640 1 -- 172.21.15.53:0/3341377060 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f627000bad0 con 0x7f6270003fa0 2023-06-10T19:00:17.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.372+0000 7f6282ffd640 1 -- 172.21.15.53:0/3341377060 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f627000bc90 con 0x7f62840cc690 2023-06-10T19:00:17.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.372+0000 7f6283fff640 1 --2- 172.21.15.53:0/3341377060 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6270004d10 0x7f6270005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:17.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.372+0000 7f62837fe640 1 --2- 172.21.15.53:0/3341377060 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62840cc690 0x7f6270003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:17.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.372+0000 7f627affd640 1 --2- 172.21.15.53:0/3341377060 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6270003fa0 0x7f62700047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:17.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.372+0000 7f6283fff640 1 -- 172.21.15.53:0/3341377060 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62840cc690 msgr2=0x7f6270003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:17.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.372+0000 7f6283fff640 1 --2- 172.21.15.53:0/3341377060 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62840cc690 0x7f6270003a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:17.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.372+0000 7f6283fff640 1 -- 172.21.15.53:0/3341377060 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6270003fa0 msgr2=0x7f62700047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:17.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.372+0000 7f6283fff640 1 --2- 172.21.15.53:0/3341377060 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6270003fa0 0x7f62700047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:17.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.372+0000 7f6283fff640 1 -- 172.21.15.53:0/3341377060 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6270003530 con 0x7f6270004d10 2023-06-10T19:00:17.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.372+0000 7f62837fe640 1 --2- 172.21.15.53:0/3341377060 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62840cc690 0x7f6270003a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:00:17.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.372+0000 7f627affd640 1 --2- 172.21.15.53:0/3341377060 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6270003fa0 0x7f62700047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:00:17.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.376+0000 7f6283fff640 1 --2- 172.21.15.53:0/3341377060 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6270004d10 0x7f6270005180 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f627c001780 tx=0x7f627c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f57178bc039e4ae server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:17.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.376+0000 7f6282ffd640 1 -- 172.21.15.53:0/3341377060 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f627c0052d0 con 0x7f6270004d10 2023-06-10T19:00:17.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.376+0000 7f6282ffd640 1 -- 172.21.15.53:0/3341377060 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f627c0a7050 con 0x7f6270004d10 2023-06-10T19:00:17.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.376+0000 7f6282ffd640 1 -- 172.21.15.53:0/3341377060 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f627c003600 con 0x7f6270004d10 2023-06-10T19:00:17.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.376+0000 7f6289c15640 1 -- 172.21.15.53:0/3341377060 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6270004d10 msgr2=0x7f6270005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:17.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.376+0000 7f6289c15640 1 --2- 172.21.15.53:0/3341377060 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6270004d10 0x7f6270005180 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f627c001780 tx=0x7f627c01c400 comp rx=0 tx=0).stop 2023-06-10T19:00:17.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.376+0000 7f6283fff640 1 -- 172.21.15.53:0/3341377060 reap_dead start 2023-06-10T19:00:17.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.376+0000 7f6289c15640 1 -- 172.21.15.53:0/3341377060 shutdown_connections 2023-06-10T19:00:17.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.376+0000 7f6289c15640 1 -- 172.21.15.53:0/3341377060 >> 172.21.15.53:0/3341377060 conn(0x7f6284071790 msgr2=0x7f6284069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:17.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.376+0000 7f6289c15640 1 -- 172.21.15.53:0/3341377060 shutdown_connections 2023-06-10T19:00:17.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.376+0000 7f6289c15640 1 -- 172.21.15.53:0/3341377060 wait complete. 2023-06-10T19:00:17.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.376+0000 7f6289c15640 1 Processor -- start 2023-06-10T19:00:17.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.376+0000 7f6289c15640 1 -- start start 2023-06-10T19:00:17.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.380+0000 7f6289c15640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6270004d10 0x7f62841ee950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:17.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.380+0000 7f6289c15640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62840c5b70 0x7f628415dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:17.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.380+0000 7f6289c15640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62841f2500 0x7f6284158300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:17.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.380+0000 7f6289c15640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62840c78c0 con 0x7f62841f2500 2023-06-10T19:00:17.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.380+0000 7f6289c15640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62840c6130 con 0x7f6270004d10 2023-06-10T19:00:17.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.380+0000 7f6289c15640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62840c6410 con 0x7f62840c5b70 2023-06-10T19:00:17.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.380+0000 7f6283fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62841f2500 0x7f6284158300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:17.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.380+0000 7f6283fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62841f2500 0x7f6284158300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60914/0 (socket says 172.21.15.53:60914) 2023-06-10T19:00:17.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.380+0000 7f6283fff640 1 -- 172.21.15.53:0/2091588056 learned_addr learned my addr 172.21.15.53:0/2091588056 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:17.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.380+0000 7f627affd640 1 --2- 172.21.15.53:0/2091588056 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62840c5b70 0x7f628415dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:17.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.380+0000 7f62837fe640 1 --2- 172.21.15.53:0/2091588056 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6270004d10 0x7f62841ee950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:17.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.380+0000 7f6283fff640 1 -- 172.21.15.53:0/2091588056 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62840c5b70 msgr2=0x7f628415dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:17.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.380+0000 7f6283fff640 1 --2- 172.21.15.53:0/2091588056 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62840c5b70 0x7f628415dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:17.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.380+0000 7f6283fff640 1 -- 172.21.15.53:0/2091588056 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6270004d10 msgr2=0x7f62841ee950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:17.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.380+0000 7f6283fff640 1 --2- 172.21.15.53:0/2091588056 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6270004d10 0x7f62841ee950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:17.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.380+0000 7f6283fff640 1 -- 172.21.15.53:0/2091588056 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62840c66f0 con 0x7f62841f2500 2023-06-10T19:00:17.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.380+0000 7f6283fff640 1 --2- 172.21.15.53:0/2091588056 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62841f2500 0x7f6284158300 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f627c005040 tx=0x7f6270005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:17.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.380+0000 7f6280ff9640 1 -- 172.21.15.53:0/2091588056 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f627c007a40 con 0x7f62841f2500 2023-06-10T19:00:17.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.380+0000 7f6280ff9640 1 -- 172.21.15.53:0/2091588056 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f627c007500 con 0x7f62841f2500 2023-06-10T19:00:17.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.380+0000 7f6289c15640 1 -- 172.21.15.53:0/2091588056 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62841f1450 con 0x7f62841f2500 2023-06-10T19:00:17.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.380+0000 7f6280ff9640 1 -- 172.21.15.53:0/2091588056 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f627c0069e0 con 0x7f62841f2500 2023-06-10T19:00:17.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.380+0000 7f6289c15640 1 -- 172.21.15.53:0/2091588056 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62840c69d0 con 0x7f62841f2500 2023-06-10T19:00:17.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.380+0000 7f6289c15640 1 -- 172.21.15.53:0/2091588056 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f628404d790 con 0x7f62841f2500 2023-06-10T19:00:17.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.380+0000 7f6280ff9640 1 -- 172.21.15.53:0/2091588056 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f627c006b40 con 0x7f62841f2500 2023-06-10T19:00:17.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.380+0000 7f6280ff9640 1 --2- 172.21.15.53:0/2091588056 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6264066280 0x7f6264068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:17.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.380+0000 7f6280ff9640 1 -- 172.21.15.53:0/2091588056 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f627c11dd40 con 0x7f62841f2500 2023-06-10T19:00:17.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.380+0000 7f62837fe640 1 --2- 172.21.15.53:0/2091588056 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6264066280 0x7f6264068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:17.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.384+0000 7f62837fe640 1 --2- 172.21.15.53:0/2091588056 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6264066280 0x7f6264068730 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f6274001340 tx=0x7f6274009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:17.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.384+0000 7f6280ff9640 1 -- 172.21.15.53:0/2091588056 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f627c0eb5a0 con 0x7f62841f2500 2023-06-10T19:00:17.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.592+0000 7f6289c15640 1 -- 172.21.15.53:0/2091588056 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f628404d790 con 0x7f62841f2500 2023-06-10T19:00:17.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.592+0000 7f6280ff9640 1 -- 172.21.15.53:0/2091588056 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f627c0eebc0 con 0x7f62841f2500 2023-06-10T19:00:17.599 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:00:17.600 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-06-10T19:00:17.600 INFO:teuthology.orchestra.run.smithi053.stdout: "auth_dump": [ 2023-06-10T19:00:17.600 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:00:17.600 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.a", 2023-06-10T19:00:17.601 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkWqEQBhAAW+iEw0Gxfw744rsYc/tfTQ==", 2023-06-10T19:00:17.601 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:00:17.601 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T19:00:17.601 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2023-06-10T19:00:17.602 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2023-06-10T19:00:17.602 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:00:17.602 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:00:17.602 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:00:17.603 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:00:17.603 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.b", 2023-06-10T19:00:17.603 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkSu02FRAAFpo6NpcwDLZUt2Rgk/wm8w==", 2023-06-10T19:00:17.603 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:00:17.604 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T19:00:17.604 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2023-06-10T19:00:17.604 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2023-06-10T19:00:17.604 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:00:17.605 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:00:17.605 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:00:17.605 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:00:17.605 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.c", 2023-06-10T19:00:17.605 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRk19/ODhAAodfGGNLP7UbNhHySgaukrg==", 2023-06-10T19:00:17.606 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:00:17.606 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T19:00:17.606 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2023-06-10T19:00:17.606 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2023-06-10T19:00:17.606 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:00:17.607 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:00:17.607 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:00:17.607 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:00:17.607 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.d", 2023-06-10T19:00:17.608 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkogwkGxAAIavVKa8GtML1XQDEMwwokQ==", 2023-06-10T19:00:17.608 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:00:17.608 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T19:00:17.608 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2023-06-10T19:00:17.609 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2023-06-10T19:00:17.609 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:00:17.609 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:00:17.609 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:00:17.610 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:00:17.610 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.0", 2023-06-10T19:00:17.610 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA7xoRkoj1OMhAAYFc4W5kAlMBqY2yzeJZXQw==", 2023-06-10T19:00:17.610 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:00:17.611 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T19:00:17.611 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T19:00:17.611 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:00:17.611 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:00:17.612 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:00:17.612 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:00:17.612 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.1", 2023-06-10T19:00:17.612 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA+xoRk6FpDOBAALjxW3eaIh3Gu9b1rmMmqfw==", 2023-06-10T19:00:17.613 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:00:17.613 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T19:00:17.613 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T19:00:17.613 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:00:17.613 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:00:17.613 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:00:17.613 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:00:17.614 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.2", 2023-06-10T19:00:17.614 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBCxoRkaO2GBRAA0Xr5en+n5DxhZDg8kVswpQ==", 2023-06-10T19:00:17.614 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:00:17.614 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T19:00:17.614 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T19:00:17.614 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:00:17.614 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:00:17.614 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:00:17.615 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:00:17.615 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.3", 2023-06-10T19:00:17.615 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBFxoRkjfsBDhAAArYYrPnmXu5VcUMGVjQXZg==", 2023-06-10T19:00:17.615 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:00:17.615 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T19:00:17.615 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T19:00:17.615 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:00:17.615 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:00:17.616 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:00:17.616 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:00:17.616 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.4", 2023-06-10T19:00:17.616 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBLxoRkybumChAAdym/nl9bzyI71flvuy9Vtw==", 2023-06-10T19:00:17.616 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:00:17.616 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T19:00:17.616 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T19:00:17.617 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:00:17.617 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:00:17.617 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:00:17.617 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:00:17.617 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.5", 2023-06-10T19:00:17.617 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBOxoRkinSGIRAAwLbgYKI4NsbHKqGo9O4WuQ==", 2023-06-10T19:00:17.617 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:00:17.617 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T19:00:17.618 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T19:00:17.618 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:00:17.618 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:00:17.618 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:00:17.618 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:00:17.618 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.6", 2023-06-10T19:00:17.618 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBRxoRkj7VlKRAAs2ReBZ5iqtr17Nli9kUtGQ==", 2023-06-10T19:00:17.618 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:00:17.619 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T19:00:17.619 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T19:00:17.619 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:00:17.619 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:00:17.619 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:00:17.619 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:00:17.619 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.7", 2023-06-10T19:00:17.619 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBUxoRk48CnMhAASfbeuCo9jDuHQrYDQ8Vt3A==", 2023-06-10T19:00:17.620 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:00:17.620 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T19:00:17.620 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T19:00:17.620 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:00:17.620 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:00:17.620 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:00:17.620 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:00:17.621 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.0", 2023-06-10T19:00:17.621 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkgey1IBAAkNYrXMgUOnavBY/5uGyFrw==", 2023-06-10T19:00:17.621 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:00:17.621 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T19:00:17.621 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow r", 2023-06-10T19:00:17.621 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-06-10T19:00:17.621 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:00:17.621 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:00:17.622 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:00:17.622 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.1", 2023-06-10T19:00:17.622 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkBw+UKBAAuvT+vXmJLG5CvQVg5xItDQ==", 2023-06-10T19:00:17.622 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:00:17.622 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T19:00:17.622 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow r", 2023-06-10T19:00:17.622 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow rw", 2023-06-10T19:00:17.623 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rwx" 2023-06-10T19:00:17.623 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:00:17.623 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:00:17.623 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:00:17.623 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.2", 2023-06-10T19:00:17.623 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkewjeJRAA4pmIEVJ3Z7GKQFmA54CZ5Q==", 2023-06-10T19:00:17.623 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:00:17.623 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T19:00:17.624 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow r", 2023-06-10T19:00:17.624 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow rw", 2023-06-10T19:00:17.624 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rwx" 2023-06-10T19:00:17.624 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:00:17.624 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:00:17.624 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:00:17.624 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.3", 2023-06-10T19:00:17.625 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkHwCiLRAAWGt8UoWxGlG1Y1zSPbKUCg==", 2023-06-10T19:00:17.625 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:00:17.625 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T19:00:17.625 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow r", 2023-06-10T19:00:17.625 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow rw", 2023-06-10T19:00:17.625 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rwx" 2023-06-10T19:00:17.625 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:00:17.625 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:00:17.626 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:00:17.626 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.admin", 2023-06-10T19:00:17.626 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA5xoRkIVgrKBAABIxiaOPe9h5ne2y2l50aMg==", 2023-06-10T19:00:17.626 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:00:17.626 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow *", 2023-06-10T19:00:17.626 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2023-06-10T19:00:17.626 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2023-06-10T19:00:17.627 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:00:17.627 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:00:17.627 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:00:17.627 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:00:17.627 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mgr.x", 2023-06-10T19:00:17.627 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkzWG3AhAAh3NFYHAbp4fgn4FZeRRNuw==", 2023-06-10T19:00:17.627 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:00:17.627 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow *", 2023-06-10T19:00:17.628 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile mgr", 2023-06-10T19:00:17.628 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:00:17.628 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:00:17.628 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:00:17.628 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:00:17.628 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mgr.y", 2023-06-10T19:00:17.628 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA5xoRkBriKOxAA6G+T7Yp2rH7XV7z37lvMYQ==", 2023-06-10T19:00:17.628 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:00:17.629 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow *", 2023-06-10T19:00:17.629 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile mgr", 2023-06-10T19:00:17.629 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:00:17.629 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:00:17.629 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:00:17.629 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2023-06-10T19:00:17.629 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-06-10T19:00:17.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.596+0000 7f6289c15640 1 -- 172.21.15.53:0/2091588056 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6264066280 msgr2=0x7f6264068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:17.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.596+0000 7f6289c15640 1 --2- 172.21.15.53:0/2091588056 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6264066280 0x7f6264068730 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f6274001340 tx=0x7f6274009040 comp rx=0 tx=0).stop 2023-06-10T19:00:17.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.596+0000 7f6289c15640 1 -- 172.21.15.53:0/2091588056 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62841f2500 msgr2=0x7f6284158300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:17.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.596+0000 7f6289c15640 1 --2- 172.21.15.53:0/2091588056 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62841f2500 0x7f6284158300 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f627c005040 tx=0x7f6270005800 comp rx=0 tx=0).stop 2023-06-10T19:00:17.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.596+0000 7f6289c15640 1 -- 172.21.15.53:0/2091588056 shutdown_connections 2023-06-10T19:00:17.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.596+0000 7f6289c15640 1 --2- 172.21.15.53:0/2091588056 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6264066280 0x7f6264068730 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:17.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.596+0000 7f6289c15640 1 --2- 172.21.15.53:0/2091588056 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62841f2500 0x7f6284158300 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:17.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.596+0000 7f6289c15640 1 --2- 172.21.15.53:0/2091588056 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62840c5b70 0x7f628415dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:17.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.596+0000 7f6289c15640 1 --2- 172.21.15.53:0/2091588056 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6270004d10 0x7f62841ee950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:17.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.596+0000 7f6289c15640 1 -- 172.21.15.53:0/2091588056 >> 172.21.15.53:0/2091588056 conn(0x7f6284071790 msgr2=0x7f62840b5540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:17.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.596+0000 7f6289c15640 1 -- 172.21.15.53:0/2091588056 shutdown_connections 2023-06-10T19:00:17.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.596+0000 7f6289c15640 1 -- 172.21.15.53:0/2091588056 wait complete. 2023-06-10T19:00:17.633 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:00:17.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.748+0000 7f8114dc0640 1 Processor -- start 2023-06-10T19:00:17.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.748+0000 7f8114dc0640 1 -- start start 2023-06-10T19:00:17.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.752+0000 7f8114dc0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f81100cc690 0x7f81100d04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:17.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.752+0000 7f8114dc0640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f81100ccae0 0x7f81100d09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:17.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.752+0000 7f8114dc0640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81100d0020 con 0x7f81100b3ac0 2023-06-10T19:00:17.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.752+0000 7f8114dc0640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81100cef40 con 0x7f81100ccae0 2023-06-10T19:00:17.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.752+0000 7f8114dc0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81100cf220 con 0x7f81100cc690 2023-06-10T19:00:17.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.752+0000 7f8105d9b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f81100cc690 0x7f81100d04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:17.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.752+0000 7f8105d9b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f81100cc690 0x7f81100d04b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.53:39658/0 (socket says 172.21.15.53:39658) 2023-06-10T19:00:17.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.752+0000 7f8105d9b640 1 -- 172.21.15.53:0/3331449233 learned_addr learned my addr 172.21.15.53:0/3331449233 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:17.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.752+0000 7f810ed9d640 1 --2- 172.21.15.53:0/3331449233 >> v2:172.21.15.117:3300/0 conn(0x7f81100ccae0 0x7f81100d09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:17.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.752+0000 7f8105d9b640 1 -- 172.21.15.53:0/3331449233 >> v2:172.21.15.117:3300/0 conn(0x7f81100ccae0 msgr2=0x7f81100d09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:17.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.752+0000 7f8105d9b640 1 --2- 172.21.15.53:0/3331449233 >> v2:172.21.15.117:3300/0 conn(0x7f81100ccae0 0x7f81100d09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:17.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.752+0000 7f8105d9b640 1 -- 172.21.15.53:0/3331449233 >> v1:172.21.15.117:6789/0 conn(0x7f81100b3ac0 legacy=0x7f81100b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:17.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.752+0000 7f8105d9b640 1 -- 172.21.15.53:0/3331449233 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81100cf500 con 0x7f81100cc690 2023-06-10T19:00:17.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.752+0000 7f8105d9b640 1 --2- 172.21.15.53:0/3331449233 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f81100cc690 0x7f81100d04b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f80f8009870 tx=0x7f80f801c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2243e6b0a6e9671 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:17.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.756+0000 7f810dd9b640 1 -- 172.21.15.53:0/3331449233 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f80ab620 con 0x7f81100cc690 2023-06-10T19:00:17.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.756+0000 7f810dd9b640 1 -- 172.21.15.53:0/3331449233 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80f80ab780 con 0x7f81100cc690 2023-06-10T19:00:17.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.756+0000 7f810dd9b640 1 -- 172.21.15.53:0/3331449233 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f80abb10 con 0x7f81100cc690 2023-06-10T19:00:17.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.756+0000 7f8114dc0640 1 -- 172.21.15.53:0/3331449233 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f81100cc690 msgr2=0x7f81100d04b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:17.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.756+0000 7f8114dc0640 1 --2- 172.21.15.53:0/3331449233 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f81100cc690 0x7f81100d04b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f80f8009870 tx=0x7f80f801c510 comp rx=0 tx=0).stop 2023-06-10T19:00:17.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.756+0000 7f8114dc0640 1 -- 172.21.15.53:0/3331449233 shutdown_connections 2023-06-10T19:00:17.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.756+0000 7f8114dc0640 1 --2- 172.21.15.53:0/3331449233 >> v2:172.21.15.117:3300/0 conn(0x7f81100ccae0 0x7f81100d09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:17.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.756+0000 7f8114dc0640 1 --2- 172.21.15.53:0/3331449233 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f81100cc690 0x7f81100d04b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:17.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.756+0000 7f8114dc0640 1 -- 172.21.15.53:0/3331449233 >> 172.21.15.53:0/3331449233 conn(0x7f8110071790 msgr2=0x7f8110069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:17.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.756+0000 7f8114dc0640 1 -- 172.21.15.53:0/3331449233 shutdown_connections 2023-06-10T19:00:17.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.756+0000 7f8114dc0640 1 -- 172.21.15.53:0/3331449233 wait complete. 2023-06-10T19:00:17.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.756+0000 7f8114dc0640 1 Processor -- start 2023-06-10T19:00:17.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.756+0000 7f8114dc0640 1 -- start start 2023-06-10T19:00:17.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.756+0000 7f8114dc0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81100b3ac0 0x7f811015e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:17.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.756+0000 7f8114dc0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f81100cc690 0x7f811015adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:17.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.756+0000 7f8114dc0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f81100ccae0 0x7f81100b2400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:17.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.756+0000 7f8114dc0640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f811015ec80 con 0x7f81100ccae0 2023-06-10T19:00:17.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.756+0000 7f8114dc0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f811015e2b0 con 0x7f81100b3ac0 2023-06-10T19:00:17.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.756+0000 7f8114dc0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f811015b300 con 0x7f81100cc690 2023-06-10T19:00:17.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.756+0000 7f810ed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f81100ccae0 0x7f81100b2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:17.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.756+0000 7f810ed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f81100ccae0 0x7f81100b2400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60920/0 (socket says 172.21.15.53:60920) 2023-06-10T19:00:17.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.756+0000 7f810ed9d640 1 -- 172.21.15.53:0/3401314408 learned_addr learned my addr 172.21.15.53:0/3401314408 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:17.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.756+0000 7f8105d9b640 1 --2- 172.21.15.53:0/3401314408 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f81100cc690 0x7f811015adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:17.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.756+0000 7f810e59c640 1 --2- 172.21.15.53:0/3401314408 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81100b3ac0 0x7f811015e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:17.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.756+0000 7f810ed9d640 1 -- 172.21.15.53:0/3401314408 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f81100cc690 msgr2=0x7f811015adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:17.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.756+0000 7f810ed9d640 1 --2- 172.21.15.53:0/3401314408 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f81100cc690 0x7f811015adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:17.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.756+0000 7f810ed9d640 1 -- 172.21.15.53:0/3401314408 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81100b3ac0 msgr2=0x7f811015e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:17.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.756+0000 7f810ed9d640 1 --2- 172.21.15.53:0/3401314408 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81100b3ac0 0x7f811015e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:17.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.756+0000 7f810ed9d640 1 -- 172.21.15.53:0/3401314408 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80f80094d0 con 0x7f81100ccae0 2023-06-10T19:00:17.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.756+0000 7f810e59c640 1 --2- 172.21.15.53:0/3401314408 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81100b3ac0 0x7f811015e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:00:17.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.756+0000 7f810ed9d640 1 --2- 172.21.15.53:0/3401314408 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f81100ccae0 0x7f81100b2400 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f810800efc0 tx=0x7f810800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:17.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.756+0000 7f81077fe640 1 -- 172.21.15.53:0/3401314408 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8108009ba0 con 0x7f81100ccae0 2023-06-10T19:00:17.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.756+0000 7f81077fe640 1 -- 172.21.15.53:0/3401314408 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f810800f040 con 0x7f81100ccae0 2023-06-10T19:00:17.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.756+0000 7f81077fe640 1 -- 172.21.15.53:0/3401314408 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81080146c0 con 0x7f81100ccae0 2023-06-10T19:00:17.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.760+0000 7f8114dc0640 1 -- 172.21.15.53:0/3401314408 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f811015bac0 con 0x7f81100ccae0 2023-06-10T19:00:17.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.760+0000 7f8114dc0640 1 -- 172.21.15.53:0/3401314408 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f811015dc60 con 0x7f81100ccae0 2023-06-10T19:00:17.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.760+0000 7f8114dc0640 1 -- 172.21.15.53:0/3401314408 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f811015e440 con 0x7f81100ccae0 2023-06-10T19:00:17.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.760+0000 7f81077fe640 1 -- 172.21.15.53:0/3401314408 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8108014820 con 0x7f81100ccae0 2023-06-10T19:00:17.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.760+0000 7f81077fe640 1 --2- 172.21.15.53:0/3401314408 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f80f0066280 0x7f80f0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:17.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.760+0000 7f81077fe640 1 -- 172.21.15.53:0/3401314408 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f8108084860 con 0x7f81100ccae0 2023-06-10T19:00:17.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.760+0000 7f810e59c640 1 --2- 172.21.15.53:0/3401314408 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f80f0066280 0x7f80f0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:17.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.760+0000 7f810e59c640 1 --2- 172.21.15.53:0/3401314408 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f80f0066280 0x7f80f0068730 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f81000016f0 tx=0x7f8100009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:17.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.764+0000 7f81077fe640 1 -- 172.21.15.53:0/3401314408 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8108052020 con 0x7f81100ccae0 2023-06-10T19:00:17.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.920+0000 7f8114dc0640 1 -- 172.21.15.53:0/3401314408 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f811004d790 con 0x7f81100ccae0 2023-06-10T19:00:17.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.924+0000 7f81077fe640 1 -- 172.21.15.53:0/3401314408 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) v1 ==== 74+0+14628 (secure 0 0 0) 0x7f8108055640 con 0x7f81100ccae0 2023-06-10T19:00:17.928 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:00:17.928 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":76,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:00:17.211422+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:00:17.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.924+0000 7f8114dc0640 1 -- 172.21.15.53:0/3401314408 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f80f0066280 msgr2=0x7f80f0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:17.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.924+0000 7f8114dc0640 1 --2- 172.21.15.53:0/3401314408 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f80f0066280 0x7f80f0068730 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f81000016f0 tx=0x7f8100009040 comp rx=0 tx=0).stop 2023-06-10T19:00:17.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.924+0000 7f8114dc0640 1 -- 172.21.15.53:0/3401314408 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f81100ccae0 msgr2=0x7f81100b2400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:17.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.924+0000 7f8114dc0640 1 --2- 172.21.15.53:0/3401314408 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f81100ccae0 0x7f81100b2400 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f810800efc0 tx=0x7f810800c490 comp rx=0 tx=0).stop 2023-06-10T19:00:17.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.924+0000 7f8114dc0640 1 -- 172.21.15.53:0/3401314408 shutdown_connections 2023-06-10T19:00:17.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.924+0000 7f8114dc0640 1 --2- 172.21.15.53:0/3401314408 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f80f0066280 0x7f80f0068730 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:17.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.924+0000 7f8114dc0640 1 --2- 172.21.15.53:0/3401314408 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f81100ccae0 0x7f81100b2400 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:17.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.924+0000 7f8114dc0640 1 --2- 172.21.15.53:0/3401314408 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f81100cc690 0x7f811015adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:17.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.924+0000 7f8114dc0640 1 --2- 172.21.15.53:0/3401314408 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81100b3ac0 0x7f811015e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:17.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.924+0000 7f8114dc0640 1 -- 172.21.15.53:0/3401314408 >> 172.21.15.53:0/3401314408 conn(0x7f8110071790 msgr2=0x7f8110158ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:17.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.924+0000 7f8114dc0640 1 -- 172.21.15.53:0/3401314408 shutdown_connections 2023-06-10T19:00:17.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:17.924+0000 7f8114dc0640 1 -- 172.21.15.53:0/3401314408 wait complete. 2023-06-10T19:00:17.947 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-10T18:52:33.633114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-10T18:52:39.171487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-10T19:00:17.948 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-10T19:00:18.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.068+0000 7f593aa68640 1 Processor -- start 2023-06-10T19:00:18.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.068+0000 7f593aa68640 1 -- start start 2023-06-10T19:00:18.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.068+0000 7f593aa68640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f593415c090 0x7f59340b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:18.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.068+0000 7f593aa68640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f59340b0b90 0x7f59340b7720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:18.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.068+0000 7f593aa68640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59340b80a0 con 0x7f59340b7c60 2023-06-10T19:00:18.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.068+0000 7f593aa68640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59340cc7c0 con 0x7f593415c090 2023-06-10T19:00:18.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.068+0000 7f593aa68640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59340ccaa0 con 0x7f59340b0b90 2023-06-10T19:00:18.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.068+0000 7f5939005640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f59340b7c60 0x7f59340b3b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52648/0 (socket says 172.21.15.53:52648) 2023-06-10T19:00:18.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.068+0000 7f5939005640 1 -- 172.21.15.53:0/3905437498 learned_addr learned my addr 172.21.15.53:0/3905437498 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:00:18.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.068+0000 7f5938804640 1 --2- 172.21.15.53:0/3905437498 >> v2:172.21.15.53:3300/0 conn(0x7f593415c090 0x7f59340b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:18.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.068+0000 7f5933fff640 1 --2- 172.21.15.53:0/3905437498 >> v2:172.21.15.117:3300/0 conn(0x7f59340b0b90 0x7f59340b7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:18.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.068+0000 7f59337fe640 1 -- 172.21.15.53:0/3905437498 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3736123337 0 0) 0x7f59340b80a0 con 0x7f59340b7c60 2023-06-10T19:00:18.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.068+0000 7f59337fe640 1 -- 172.21.15.53:0/3905437498 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5924003530 con 0x7f59340b7c60 2023-06-10T19:00:18.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.068+0000 7f5938804640 1 -- 172.21.15.53:0/3905437498 >> v2:172.21.15.117:3300/0 conn(0x7f59340b0b90 msgr2=0x7f59340b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:18.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.068+0000 7f5938804640 1 --2- 172.21.15.53:0/3905437498 >> v2:172.21.15.117:3300/0 conn(0x7f59340b0b90 0x7f59340b7720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:18.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.068+0000 7f5938804640 1 -- 172.21.15.53:0/3905437498 >> v1:172.21.15.53:6789/0 conn(0x7f59340b7c60 legacy=0x7f59340b3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:18.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.068+0000 7f5938804640 1 -- 172.21.15.53:0/3905437498 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59340ccd80 con 0x7f593415c090 2023-06-10T19:00:18.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.072+0000 7f5938804640 1 --2- 172.21.15.53:0/3905437498 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f593415c090 0x7f59340b10c0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f59340b4c30 tx=0x7f592801c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11e72d76f9175d6a server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:18.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.072+0000 7f59337fe640 1 -- 172.21.15.53:0/3905437498 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59280ab600 con 0x7f593415c090 2023-06-10T19:00:18.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.072+0000 7f59337fe640 1 -- 172.21.15.53:0/3905437498 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59280a7050 con 0x7f593415c090 2023-06-10T19:00:18.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.072+0000 7f59337fe640 1 -- 172.21.15.53:0/3905437498 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59280ab980 con 0x7f593415c090 2023-06-10T19:00:18.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.072+0000 7f593aa68640 1 -- 172.21.15.53:0/3905437498 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f593415c090 msgr2=0x7f59340b10c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:18.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.072+0000 7f593aa68640 1 --2- 172.21.15.53:0/3905437498 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f593415c090 0x7f59340b10c0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f59340b4c30 tx=0x7f592801c3a0 comp rx=0 tx=0).stop 2023-06-10T19:00:18.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.072+0000 7f593aa68640 1 -- 172.21.15.53:0/3905437498 shutdown_connections 2023-06-10T19:00:18.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.072+0000 7f593aa68640 1 --2- 172.21.15.53:0/3905437498 >> v2:172.21.15.117:3300/0 conn(0x7f59340b0b90 0x7f59340b7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:18.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.072+0000 7f593aa68640 1 --2- 172.21.15.53:0/3905437498 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f593415c090 0x7f59340b10c0 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:18.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.072+0000 7f593aa68640 1 -- 172.21.15.53:0/3905437498 >> 172.21.15.53:0/3905437498 conn(0x7f5934069e20 msgr2=0x7f593406a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:18.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.072+0000 7f593aa68640 1 -- 172.21.15.53:0/3905437498 shutdown_connections 2023-06-10T19:00:18.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.072+0000 7f593aa68640 1 -- 172.21.15.53:0/3905437498 wait complete. 2023-06-10T19:00:18.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.072+0000 7f593aa68640 1 Processor -- start 2023-06-10T19:00:18.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.072+0000 7f593aa68640 1 -- start start 2023-06-10T19:00:18.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.072+0000 7f593aa68640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59340b0b90 0x7f5934149440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:18.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.072+0000 7f593aa68640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59340b7c60 0x7f5934158220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:18.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.072+0000 7f593aa68640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f593415c090 0x7f593414eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:18.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.072+0000 7f593aa68640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f593414e3d0 con 0x7f593415c090 2023-06-10T19:00:18.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.072+0000 7f593aa68640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f593414d330 con 0x7f59340b7c60 2023-06-10T19:00:18.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.072+0000 7f593aa68640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f593414d610 con 0x7f59340b0b90 2023-06-10T19:00:18.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.072+0000 7f5939005640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f593415c090 0x7f593414eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:18.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.072+0000 7f5939005640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f593415c090 0x7f593414eaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60928/0 (socket says 172.21.15.53:60928) 2023-06-10T19:00:18.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.072+0000 7f5939005640 1 -- 172.21.15.53:0/1406117757 learned_addr learned my addr 172.21.15.53:0/1406117757 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:18.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.072+0000 7f5938804640 1 --2- 172.21.15.53:0/1406117757 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59340b0b90 0x7f5934149440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:18.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.072+0000 7f5933fff640 1 --2- 172.21.15.53:0/1406117757 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59340b7c60 0x7f5934158220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:18.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.072+0000 7f5939005640 1 -- 172.21.15.53:0/1406117757 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59340b0b90 msgr2=0x7f5934149440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:18.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.072+0000 7f5939005640 1 --2- 172.21.15.53:0/1406117757 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59340b0b90 0x7f5934149440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:18.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.072+0000 7f5939005640 1 -- 172.21.15.53:0/1406117757 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59340b7c60 msgr2=0x7f5934158220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:18.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.072+0000 7f5939005640 1 --2- 172.21.15.53:0/1406117757 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59340b7c60 0x7f5934158220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:18.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.072+0000 7f5939005640 1 -- 172.21.15.53:0/1406117757 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5928009420 con 0x7f593415c090 2023-06-10T19:00:18.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.076+0000 7f5939005640 1 --2- 172.21.15.53:0/1406117757 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f593415c090 0x7f593414eaa0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f592c00cb40 tx=0x7f592c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:18.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.076+0000 7f59317fa640 1 -- 172.21.15.53:0/1406117757 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f592c00aca0 con 0x7f593415c090 2023-06-10T19:00:18.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.076+0000 7f59317fa640 1 -- 172.21.15.53:0/1406117757 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f592c00ae00 con 0x7f593415c090 2023-06-10T19:00:18.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.076+0000 7f593aa68640 1 -- 172.21.15.53:0/1406117757 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f593414d8f0 con 0x7f593415c090 2023-06-10T19:00:18.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.076+0000 7f59317fa640 1 -- 172.21.15.53:0/1406117757 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f592c012620 con 0x7f593415c090 2023-06-10T19:00:18.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.076+0000 7f593aa68640 1 -- 172.21.15.53:0/1406117757 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f593414deb0 con 0x7f593415c090 2023-06-10T19:00:18.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.076+0000 7f593aa68640 1 -- 172.21.15.53:0/1406117757 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f593414e0a0 con 0x7f593415c090 2023-06-10T19:00:18.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.076+0000 7f59317fa640 1 -- 172.21.15.53:0/1406117757 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f592c007070 con 0x7f593415c090 2023-06-10T19:00:18.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.076+0000 7f59317fa640 1 --2- 172.21.15.53:0/1406117757 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5918066280 0x7f5918068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:18.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.076+0000 7f59317fa640 1 -- 172.21.15.53:0/1406117757 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f592c0839c0 con 0x7f593415c090 2023-06-10T19:00:18.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.076+0000 7f5938804640 1 --2- 172.21.15.53:0/1406117757 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5918066280 0x7f5918068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:18.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.076+0000 7f5938804640 1 --2- 172.21.15.53:0/1406117757 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5918066280 0x7f5918068730 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f59280ad000 tx=0x7f59280a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:18.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.080+0000 7f59317fa640 1 -- 172.21.15.53:0/1406117757 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f592c051220 con 0x7f593415c090 2023-06-10T19:00:18.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.232+0000 7f593aa68640 1 -- 172.21.15.53:0/1406117757 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f593404d790 con 0x7f593415c090 2023-06-10T19:00:18.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.236+0000 7f59317fa640 1 -- 172.21.15.53:0/1406117757 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v76) v1 ==== 93+0+10 (secure 0 0 0) 0x7f592c0170a0 con 0x7f593415c090 2023-06-10T19:00:18.240 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-06-10T19:00:18.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.236+0000 7f593aa68640 1 -- 172.21.15.53:0/1406117757 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5918066280 msgr2=0x7f5918068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:18.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.236+0000 7f593aa68640 1 --2- 172.21.15.53:0/1406117757 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5918066280 0x7f5918068730 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f59280ad000 tx=0x7f59280a6000 comp rx=0 tx=0).stop 2023-06-10T19:00:18.243 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.236+0000 7f593aa68640 1 -- 172.21.15.53:0/1406117757 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f593415c090 msgr2=0x7f593414eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:18.243 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.236+0000 7f593aa68640 1 --2- 172.21.15.53:0/1406117757 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f593415c090 0x7f593414eaa0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f592c00cb40 tx=0x7f592c00a060 comp rx=0 tx=0).stop 2023-06-10T19:00:18.243 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.236+0000 7f593aa68640 1 -- 172.21.15.53:0/1406117757 shutdown_connections 2023-06-10T19:00:18.243 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.236+0000 7f593aa68640 1 --2- 172.21.15.53:0/1406117757 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5918066280 0x7f5918068730 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:18.243 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.236+0000 7f593aa68640 1 --2- 172.21.15.53:0/1406117757 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f593415c090 0x7f593414eaa0 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:18.243 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.236+0000 7f593aa68640 1 --2- 172.21.15.53:0/1406117757 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59340b7c60 0x7f5934158220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:18.243 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.236+0000 7f593aa68640 1 --2- 172.21.15.53:0/1406117757 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59340b0b90 0x7f5934149440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:18.243 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.236+0000 7f593aa68640 1 -- 172.21.15.53:0/1406117757 >> 172.21.15.53:0/1406117757 conn(0x7f5934069e20 msgr2=0x7f5934159c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:18.244 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.236+0000 7f593aa68640 1 -- 172.21.15.53:0/1406117757 shutdown_connections 2023-06-10T19:00:18.244 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.236+0000 7f593aa68640 1 -- 172.21.15.53:0/1406117757 wait complete. 2023-06-10T19:00:18.259 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-10T19:00:18.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.372+0000 7f7c6e1a6640 1 Processor -- start 2023-06-10T19:00:18.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.372+0000 7f7c6e1a6640 1 -- start start 2023-06-10T19:00:18.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.376+0000 7f7c6e1a6640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7c68156180 0x7f7c680cd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:18.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.376+0000 7f7c6e1a6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c6815c070 0x7f7c6815c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:18.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.376+0000 7f7c6e1a6640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c6815ca00 con 0x7f7c68158a80 2023-06-10T19:00:18.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.376+0000 7f7c6e1a6640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c6806b090 con 0x7f7c68156180 2023-06-10T19:00:18.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.376+0000 7f7c6e1a6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6806efa0 con 0x7f7c6815c070 2023-06-10T19:00:18.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.376+0000 7f7c67fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f7c68158a80 0x7f7c68158ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52658/0 (socket says 172.21.15.53:52658) 2023-06-10T19:00:18.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.376+0000 7f7c67fff640 1 -- 172.21.15.53:0/2675678579 learned_addr learned my addr 172.21.15.53:0/2675678579 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:00:18.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.376+0000 7f7c66ffd640 1 --2- 172.21.15.53:0/2675678579 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c6815c070 0x7f7c6815c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:18.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.376+0000 7f7c677fe640 1 --2- 172.21.15.53:0/2675678579 >> v2:172.21.15.117:3300/0 conn(0x7f7c68156180 0x7f7c680cd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:18.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.376+0000 7f7c667fc640 1 -- 172.21.15.53:0/2675678579 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2451079897 0 0) 0x7f7c58001120 con 0x7f7c68158a80 2023-06-10T19:00:18.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.376+0000 7f7c667fc640 1 -- 172.21.15.53:0/2675678579 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c54005740 con 0x7f7c68158a80 2023-06-10T19:00:18.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.376+0000 7f7c667fc640 1 -- 172.21.15.53:0/2675678579 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3201129197 0 0) 0x7f7c54005740 con 0x7f7c68158a80 2023-06-10T19:00:18.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.376+0000 7f7c667fc640 1 -- 172.21.15.53:0/2675678579 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c6815c070 msgr2=0x7f7c6815c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:18.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.376+0000 7f7c667fc640 1 --2- 172.21.15.53:0/2675678579 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c6815c070 0x7f7c6815c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:18.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.376+0000 7f7c667fc640 1 -- 172.21.15.53:0/2675678579 >> v2:172.21.15.117:3300/0 conn(0x7f7c68156180 msgr2=0x7f7c680cd4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:18.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.376+0000 7f7c667fc640 1 --2- 172.21.15.53:0/2675678579 >> v2:172.21.15.117:3300/0 conn(0x7f7c68156180 0x7f7c680cd4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:18.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.376+0000 7f7c667fc640 1 -- 172.21.15.53:0/2675678579 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c680cc720 con 0x7f7c68158a80 2023-06-10T19:00:18.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.376+0000 7f7c667fc640 1 -- 172.21.15.53:0/2675678579 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f7c58001810 con 0x7f7c68158a80 2023-06-10T19:00:18.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.376+0000 7f7c677fe640 1 --2- 172.21.15.53:0/2675678579 >> v2:172.21.15.117:3300/0 conn(0x7f7c68156180 0x7f7c680cd4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-10T19:00:18.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.376+0000 7f7c667fc640 1 -- 172.21.15.53:0/2675678579 >> v1:172.21.15.53:6789/0 conn(0x7f7c68158a80 legacy=0x7f7c68158ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:18.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.376+0000 7f7c667fc640 1 --2- 172.21.15.53:0/2675678579 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c54005b90 0x7f7c54005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:18.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.376+0000 7f7c667fc640 1 --2- 172.21.15.53:0/2675678579 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c540065c0 0x7f7c54006a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:18.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.376+0000 7f7c667fc640 1 --2- 172.21.15.53:0/2675678579 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c540070f0 0x7f7c5400dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:18.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.376+0000 7f7c667fc640 1 -- 172.21.15.53:0/2675678579 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6806b090 con 0x7f7c540065c0 2023-06-10T19:00:18.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.376+0000 7f7c667fc640 1 -- 172.21.15.53:0/2675678579 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6806efa0 con 0x7f7c54005b90 2023-06-10T19:00:18.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.376+0000 7f7c667fc640 1 -- 172.21.15.53:0/2675678579 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5400e0e0 con 0x7f7c540070f0 2023-06-10T19:00:18.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.376+0000 7f7c66ffd640 1 --2- 172.21.15.53:0/2675678579 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c6815c070 0x7f7c6815c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-10T19:00:18.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.376+0000 7f7c66ffd640 1 --2- 172.21.15.53:0/2675678579 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c540065c0 0x7f7c54006a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:18.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.376+0000 7f7c677fe640 1 --2- 172.21.15.53:0/2675678579 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c54005b90 0x7f7c54005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:18.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.376+0000 7f7c67fff640 1 --2- 172.21.15.53:0/2675678579 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c540070f0 0x7f7c5400dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:18.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.376+0000 7f7c66ffd640 1 -- 172.21.15.53:0/2675678579 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c540070f0 msgr2=0x7f7c5400dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:18.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.376+0000 7f7c66ffd640 1 --2- 172.21.15.53:0/2675678579 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c540070f0 0x7f7c5400dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:18.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.376+0000 7f7c66ffd640 1 -- 172.21.15.53:0/2675678579 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c54005b90 msgr2=0x7f7c54005fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:18.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.376+0000 7f7c66ffd640 1 --2- 172.21.15.53:0/2675678579 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c54005b90 0x7f7c54005fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:18.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.376+0000 7f7c66ffd640 1 -- 172.21.15.53:0/2675678579 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c54005740 con 0x7f7c540065c0 2023-06-10T19:00:18.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.380+0000 7f7c66ffd640 1 --2- 172.21.15.53:0/2675678579 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c540065c0 0x7f7c54006a80 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f7c50009b20 tx=0x7f7c5001ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8147f51c313c7e3f server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:18.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.380+0000 7f7c667fc640 1 -- 172.21.15.53:0/2675678579 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c50004030 con 0x7f7c540065c0 2023-06-10T19:00:18.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.380+0000 7f7c667fc640 1 -- 172.21.15.53:0/2675678579 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c50004190 con 0x7f7c540065c0 2023-06-10T19:00:18.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.380+0000 7f7c667fc640 1 -- 172.21.15.53:0/2675678579 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c50004520 con 0x7f7c540065c0 2023-06-10T19:00:18.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.380+0000 7f7c6e1a6640 1 -- 172.21.15.53:0/2675678579 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c540065c0 msgr2=0x7f7c54006a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:18.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.380+0000 7f7c6e1a6640 1 --2- 172.21.15.53:0/2675678579 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c540065c0 0x7f7c54006a80 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f7c50009b20 tx=0x7f7c5001ca90 comp rx=0 tx=0).stop 2023-06-10T19:00:18.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.380+0000 7f7c67fff640 1 -- 172.21.15.53:0/2675678579 reap_dead start 2023-06-10T19:00:18.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.380+0000 7f7c6e1a6640 1 -- 172.21.15.53:0/2675678579 shutdown_connections 2023-06-10T19:00:18.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.380+0000 7f7c6e1a6640 1 -- 172.21.15.53:0/2675678579 >> 172.21.15.53:0/2675678579 conn(0x7f7c6806a0e0 msgr2=0x7f7c680cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:18.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.380+0000 7f7c6e1a6640 1 -- 172.21.15.53:0/2675678579 shutdown_connections 2023-06-10T19:00:18.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.380+0000 7f7c6e1a6640 1 -- 172.21.15.53:0/2675678579 wait complete. 2023-06-10T19:00:18.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.380+0000 7f7c6e1a6640 1 Processor -- start 2023-06-10T19:00:18.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.380+0000 7f7c6e1a6640 1 -- start start 2023-06-10T19:00:18.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.380+0000 7f7c6e1a6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c540065c0 0x7f7c6815b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:18.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.380+0000 7f7c6e1a6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c680b0b10 0x7f7c6815b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:18.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.380+0000 7f7c6e1a6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c68157d10 0x7f7c681f0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:18.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.380+0000 7f7c6e1a6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c681578f0 con 0x7f7c68157d10 2023-06-10T19:00:18.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.380+0000 7f7c6e1a6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c680b1280 con 0x7f7c680b0b10 2023-06-10T19:00:18.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.380+0000 7f7c6e1a6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6815bdd0 con 0x7f7c540065c0 2023-06-10T19:00:18.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.380+0000 7f7c67fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c68157d10 0x7f7c681f0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:18.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.380+0000 7f7c67fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c68157d10 0x7f7c681f0570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60954/0 (socket says 172.21.15.53:60954) 2023-06-10T19:00:18.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.380+0000 7f7c67fff640 1 -- 172.21.15.53:0/2715349251 learned_addr learned my addr 172.21.15.53:0/2715349251 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:18.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.384+0000 7f7c677fe640 1 --2- 172.21.15.53:0/2715349251 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c540065c0 0x7f7c6815b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:18.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.384+0000 7f7c66ffd640 1 --2- 172.21.15.53:0/2715349251 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c680b0b10 0x7f7c6815b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:18.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.384+0000 7f7c67fff640 1 -- 172.21.15.53:0/2715349251 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c540065c0 msgr2=0x7f7c6815b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:18.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.384+0000 7f7c67fff640 1 --2- 172.21.15.53:0/2715349251 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c540065c0 0x7f7c6815b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:18.395 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.384+0000 7f7c67fff640 1 -- 172.21.15.53:0/2715349251 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c680b0b10 msgr2=0x7f7c6815b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:18.395 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.384+0000 7f7c67fff640 1 --2- 172.21.15.53:0/2715349251 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c680b0b10 0x7f7c6815b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:18.395 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.384+0000 7f7c67fff640 1 -- 172.21.15.53:0/2715349251 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c680b0fa0 con 0x7f7c68157d10 2023-06-10T19:00:18.395 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.384+0000 7f7c677fe640 1 --2- 172.21.15.53:0/2715349251 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c540065c0 0x7f7c6815b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:00:18.395 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.384+0000 7f7c67fff640 1 --2- 172.21.15.53:0/2715349251 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c68157d10 0x7f7c681f0570 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f7c68158e50 tx=0x7f7c580057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:18.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.384+0000 7f7c5ffff640 1 -- 172.21.15.53:0/2715349251 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c58012990 con 0x7f7c68157d10 2023-06-10T19:00:18.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.384+0000 7f7c5ffff640 1 -- 172.21.15.53:0/2715349251 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c58012b10 con 0x7f7c68157d10 2023-06-10T19:00:18.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.384+0000 7f7c5ffff640 1 -- 172.21.15.53:0/2715349251 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c58012ec0 con 0x7f7c68157d10 2023-06-10T19:00:18.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.384+0000 7f7c6e1a6640 1 -- 172.21.15.53:0/2715349251 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c68157230 con 0x7f7c68157d10 2023-06-10T19:00:18.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.384+0000 7f7c6e1a6640 1 -- 172.21.15.53:0/2715349251 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c68156eb0 con 0x7f7c68157d10 2023-06-10T19:00:18.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.384+0000 7f7c6e1a6640 1 -- 172.21.15.53:0/2715349251 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c681570a0 con 0x7f7c68157d10 2023-06-10T19:00:18.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.384+0000 7f7c5ffff640 1 -- 172.21.15.53:0/2715349251 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7c580153e0 con 0x7f7c68157d10 2023-06-10T19:00:18.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.384+0000 7f7c5ffff640 1 --2- 172.21.15.53:0/2715349251 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7c48066280 0x7f7c48068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:18.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.384+0000 7f7c5ffff640 1 -- 172.21.15.53:0/2715349251 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f7c580854f0 con 0x7f7c68157d10 2023-06-10T19:00:18.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.384+0000 7f7c677fe640 1 --2- 172.21.15.53:0/2715349251 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7c48066280 0x7f7c48068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:18.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.384+0000 7f7c677fe640 1 --2- 172.21.15.53:0/2715349251 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7c48066280 0x7f7c48068730 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f7c60007560 tx=0x7f7c6000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:18.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.388+0000 7f7c5ffff640 1 -- 172.21.15.53:0/2715349251 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7c58052d50 con 0x7f7c68157d10 2023-06-10T19:00:18.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.540+0000 7f7c6e1a6640 1 -- 172.21.15.53:0/2715349251 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7c68157a30 con 0x7f7c68157d10 2023-06-10T19:00:18.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.540+0000 7f7c5ffff640 1 -- 172.21.15.53:0/2715349251 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v76) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7c68157a30 con 0x7f7c68157d10 2023-06-10T19:00:18.545 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-06-10T19:00:18.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.540+0000 7f7c6e1a6640 1 -- 172.21.15.53:0/2715349251 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7c48066280 msgr2=0x7f7c48068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:18.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.540+0000 7f7c6e1a6640 1 --2- 172.21.15.53:0/2715349251 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7c48066280 0x7f7c48068730 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f7c60007560 tx=0x7f7c6000b040 comp rx=0 tx=0).stop 2023-06-10T19:00:18.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.540+0000 7f7c6e1a6640 1 -- 172.21.15.53:0/2715349251 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c68157d10 msgr2=0x7f7c681f0570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:18.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.540+0000 7f7c6e1a6640 1 --2- 172.21.15.53:0/2715349251 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c68157d10 0x7f7c681f0570 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f7c68158e50 tx=0x7f7c580057f0 comp rx=0 tx=0).stop 2023-06-10T19:00:18.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.540+0000 7f7c6e1a6640 1 -- 172.21.15.53:0/2715349251 shutdown_connections 2023-06-10T19:00:18.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.540+0000 7f7c6e1a6640 1 --2- 172.21.15.53:0/2715349251 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7c48066280 0x7f7c48068730 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:18.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.540+0000 7f7c6e1a6640 1 --2- 172.21.15.53:0/2715349251 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c68157d10 0x7f7c681f0570 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:18.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.540+0000 7f7c6e1a6640 1 --2- 172.21.15.53:0/2715349251 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c680b0b10 0x7f7c6815b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:18.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.540+0000 7f7c6e1a6640 1 --2- 172.21.15.53:0/2715349251 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c540065c0 0x7f7c6815b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:18.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.540+0000 7f7c6e1a6640 1 -- 172.21.15.53:0/2715349251 >> 172.21.15.53:0/2715349251 conn(0x7f7c6806a0e0 msgr2=0x7f7c68070050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:18.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.540+0000 7f7c6e1a6640 1 -- 172.21.15.53:0/2715349251 shutdown_connections 2023-06-10T19:00:18.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.540+0000 7f7c6e1a6640 1 -- 172.21.15.53:0/2715349251 wait complete. 2023-06-10T19:00:18.563 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-06-10T19:00:18.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.668+0000 7f77874ed640 1 Processor -- start 2023-06-10T19:00:18.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.668+0000 7f77874ed640 1 -- start start 2023-06-10T19:00:18.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.668+0000 7f77874ed640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f77800c9840 0x7f77800c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:18.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.668+0000 7f77874ed640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7780071060 0x7f77800af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:18.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.668+0000 7f77874ed640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7780159b50 con 0x7f77800afc60 2023-06-10T19:00:18.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.668+0000 7f77874ed640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77800ca150 con 0x7f77800c9840 2023-06-10T19:00:18.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.668+0000 7f77874ed640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77800702a0 con 0x7f7780071060 2023-06-10T19:00:18.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.672+0000 7f7784a88640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7780071060 0x7f77800af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:18.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.672+0000 7f7785289640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f77800c9840 0x7f77800c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:18.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.672+0000 7f7784a88640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7780071060 0x7f77800af720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.53:39710/0 (socket says 172.21.15.53:39710) 2023-06-10T19:00:18.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.672+0000 7f7784a88640 1 -- 172.21.15.53:0/1103795586 learned_addr learned my addr 172.21.15.53:0/1103795586 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:18.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.672+0000 7f7784a88640 1 -- 172.21.15.53:0/1103795586 >> v2:172.21.15.117:3300/0 conn(0x7f77800c9840 msgr2=0x7f77800c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:18.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.672+0000 7f7784a88640 1 --2- 172.21.15.53:0/1103795586 >> v2:172.21.15.117:3300/0 conn(0x7f77800c9840 0x7f77800c9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:18.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.672+0000 7f7784a88640 1 -- 172.21.15.53:0/1103795586 >> v1:172.21.15.117:6789/0 conn(0x7f77800afc60 legacy=0x7f778015d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:18.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.672+0000 7f7784a88640 1 -- 172.21.15.53:0/1103795586 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7780070580 con 0x7f7780071060 2023-06-10T19:00:18.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.672+0000 7f7785289640 1 --2- 172.21.15.53:0/1103795586 >> v2:172.21.15.117:3300/0 conn(0x7f77800c9840 0x7f77800c9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-10T19:00:18.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.672+0000 7f7784a88640 1 --2- 172.21.15.53:0/1103795586 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7780071060 0x7f77800af720 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7770009870 tx=0x7f777001c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f725c2edc3c7d8f server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:18.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.672+0000 7f7777fff640 1 -- 172.21.15.53:0/1103795586 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77700a7070 con 0x7f7780071060 2023-06-10T19:00:18.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.672+0000 7f7777fff640 1 -- 172.21.15.53:0/1103795586 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77700ab430 con 0x7f7780071060 2023-06-10T19:00:18.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.672+0000 7f7777fff640 1 -- 172.21.15.53:0/1103795586 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77700ab7c0 con 0x7f7780071060 2023-06-10T19:00:18.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.676+0000 7f77874ed640 1 -- 172.21.15.53:0/1103795586 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7780071060 msgr2=0x7f77800af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:18.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.676+0000 7f77874ed640 1 --2- 172.21.15.53:0/1103795586 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7780071060 0x7f77800af720 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7770009870 tx=0x7f777001c510 comp rx=0 tx=0).stop 2023-06-10T19:00:18.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.676+0000 7f77874ed640 1 -- 172.21.15.53:0/1103795586 shutdown_connections 2023-06-10T19:00:18.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.676+0000 7f77874ed640 1 --2- 172.21.15.53:0/1103795586 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7780071060 0x7f77800af720 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:18.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.676+0000 7f77874ed640 1 --2- 172.21.15.53:0/1103795586 >> v2:172.21.15.117:3300/0 conn(0x7f77800c9840 0x7f77800c9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:18.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.676+0000 7f77874ed640 1 -- 172.21.15.53:0/1103795586 >> 172.21.15.53:0/1103795586 conn(0x7f778006a0d0 msgr2=0x7f77800ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:18.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.676+0000 7f77874ed640 1 -- 172.21.15.53:0/1103795586 shutdown_connections 2023-06-10T19:00:18.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.676+0000 7f77874ed640 1 -- 172.21.15.53:0/1103795586 wait complete. 2023-06-10T19:00:18.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.676+0000 7f77874ed640 1 Processor -- start 2023-06-10T19:00:18.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.676+0000 7f77874ed640 1 -- start start 2023-06-10T19:00:18.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.676+0000 7f77874ed640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7780071060 0x7f77800cd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:18.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.676+0000 7f77874ed640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f77800afc60 0x7f7780150e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:18.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.676+0000 7f77874ed640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77800c9840 0x7f77800b2e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:18.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.676+0000 7f77874ed640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77800cd900 con 0x7f77800afc60 2023-06-10T19:00:18.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.676+0000 7f77874ed640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7780150cd0 con 0x7f7780071060 2023-06-10T19:00:18.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.676+0000 7f77874ed640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77800b18c0 con 0x7f77800c9840 2023-06-10T19:00:18.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.676+0000 7f7784a88640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f77800afc60 0x7f7780150e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:18.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.676+0000 7f7784a88640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f77800afc60 0x7f7780150e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60968/0 (socket says 172.21.15.53:60968) 2023-06-10T19:00:18.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.676+0000 7f7784a88640 1 -- 172.21.15.53:0/3524837120 learned_addr learned my addr 172.21.15.53:0/3524837120 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:18.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.676+0000 7f7785289640 1 --2- 172.21.15.53:0/3524837120 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7780071060 0x7f77800cd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:18.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.676+0000 7f7785a8a640 1 --2- 172.21.15.53:0/3524837120 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77800c9840 0x7f77800b2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:18.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.676+0000 7f7784a88640 1 -- 172.21.15.53:0/3524837120 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77800c9840 msgr2=0x7f77800b2e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:18.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.676+0000 7f7784a88640 1 --2- 172.21.15.53:0/3524837120 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77800c9840 0x7f77800b2e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:18.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.676+0000 7f7784a88640 1 -- 172.21.15.53:0/3524837120 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7780071060 msgr2=0x7f77800cd3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:18.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.676+0000 7f7784a88640 1 --2- 172.21.15.53:0/3524837120 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7780071060 0x7f77800cd3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:18.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.676+0000 7f7784a88640 1 -- 172.21.15.53:0/3524837120 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f777c009420 con 0x7f77800afc60 2023-06-10T19:00:18.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.676+0000 7f7785289640 1 --2- 172.21.15.53:0/3524837120 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7780071060 0x7f77800cd3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:00:18.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.676+0000 7f7784a88640 1 --2- 172.21.15.53:0/3524837120 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f77800afc60 0x7f7780150e60 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f77700ad040 tx=0x7f77700192b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:18.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.676+0000 7f7775ffb640 1 -- 172.21.15.53:0/3524837120 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77700b45f0 con 0x7f77800afc60 2023-06-10T19:00:18.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.676+0000 7f7775ffb640 1 -- 172.21.15.53:0/3524837120 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77700b4750 con 0x7f77800afc60 2023-06-10T19:00:18.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.676+0000 7f7775ffb640 1 -- 172.21.15.53:0/3524837120 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77700b4b00 con 0x7f77800afc60 2023-06-10T19:00:18.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.676+0000 7f77874ed640 1 -- 172.21.15.53:0/3524837120 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77700094d0 con 0x7f77800afc60 2023-06-10T19:00:18.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.676+0000 7f77874ed640 1 -- 172.21.15.53:0/3524837120 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77800abbe0 con 0x7f77800afc60 2023-06-10T19:00:18.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.676+0000 7f77874ed640 1 -- 172.21.15.53:0/3524837120 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f778004d790 con 0x7f77800afc60 2023-06-10T19:00:18.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.680+0000 7f7775ffb640 1 -- 172.21.15.53:0/3524837120 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f77700b4c60 con 0x7f77800afc60 2023-06-10T19:00:18.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.680+0000 7f7775ffb640 1 --2- 172.21.15.53:0/3524837120 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f77640662b0 0x7f7764068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:18.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.680+0000 7f7775ffb640 1 -- 172.21.15.53:0/3524837120 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f777011d0d0 con 0x7f77800afc60 2023-06-10T19:00:18.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.680+0000 7f7785289640 1 --2- 172.21.15.53:0/3524837120 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f77640662b0 0x7f7764068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:18.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.680+0000 7f7785289640 1 --2- 172.21.15.53:0/3524837120 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f77640662b0 0x7f7764068760 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f777c009bd0 tx=0x7f777c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:18.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.684+0000 7f7775ffb640 1 -- 172.21.15.53:0/3524837120 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f77700ea8a0 con 0x7f77800afc60 2023-06-10T19:00:18.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.840+0000 7f77874ed640 1 -- 172.21.15.53:0/3524837120 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f778015a420 con 0x7f77800afc60 2023-06-10T19:00:18.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.840+0000 7f7775ffb640 1 -- 172.21.15.53:0/3524837120 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v76) v1 ==== 84+0+126 (secure 0 0 0) 0x7f77700edec0 con 0x7f77800afc60 2023-06-10T19:00:18.845 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:00:18.845 INFO:teuthology.orchestra.run.smithi053.stdout:[ 2023-06-10T19:00:18.846 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:00:18.846 INFO:teuthology.orchestra.run.smithi053.stdout: "poolnum": 1, 2023-06-10T19:00:18.846 INFO:teuthology.orchestra.run.smithi053.stdout: "poolname": ".mgr" 2023-06-10T19:00:18.846 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:00:18.846 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:00:18.846 INFO:teuthology.orchestra.run.smithi053.stdout: "poolnum": 2, 2023-06-10T19:00:18.846 INFO:teuthology.orchestra.run.smithi053.stdout: "poolname": "rbd" 2023-06-10T19:00:18.846 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:00:18.847 INFO:teuthology.orchestra.run.smithi053.stdout:] 2023-06-10T19:00:18.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.840+0000 7f77874ed640 1 -- 172.21.15.53:0/3524837120 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f77640662b0 msgr2=0x7f7764068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:18.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.840+0000 7f77874ed640 1 --2- 172.21.15.53:0/3524837120 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f77640662b0 0x7f7764068760 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f777c009bd0 tx=0x7f777c008040 comp rx=0 tx=0).stop 2023-06-10T19:00:18.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.840+0000 7f77874ed640 1 -- 172.21.15.53:0/3524837120 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f77800afc60 msgr2=0x7f7780150e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:18.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.840+0000 7f77874ed640 1 --2- 172.21.15.53:0/3524837120 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f77800afc60 0x7f7780150e60 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f77700ad040 tx=0x7f77700192b0 comp rx=0 tx=0).stop 2023-06-10T19:00:18.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.840+0000 7f77874ed640 1 -- 172.21.15.53:0/3524837120 shutdown_connections 2023-06-10T19:00:18.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.840+0000 7f77874ed640 1 --2- 172.21.15.53:0/3524837120 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f77640662b0 0x7f7764068760 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:18.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.840+0000 7f77874ed640 1 --2- 172.21.15.53:0/3524837120 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77800c9840 0x7f77800b2e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:18.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.840+0000 7f77874ed640 1 --2- 172.21.15.53:0/3524837120 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f77800afc60 0x7f7780150e60 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:18.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.840+0000 7f77874ed640 1 --2- 172.21.15.53:0/3524837120 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7780071060 0x7f77800cd3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:18.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.840+0000 7f77874ed640 1 -- 172.21.15.53:0/3524837120 >> 172.21.15.53:0/3524837120 conn(0x7f778006a0d0 msgr2=0x7f77800cdc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:18.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.840+0000 7f77874ed640 1 -- 172.21.15.53:0/3524837120 shutdown_connections 2023-06-10T19:00:18.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.840+0000 7f77874ed640 1 -- 172.21.15.53:0/3524837120 wait complete. 2023-06-10T19:00:18.864 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-06-10T19:00:18.865 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-06-10T19:00:18.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.984+0000 7f0159f66640 1 Processor -- start 2023-06-10T19:00:18.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.984+0000 7f0159f66640 1 -- start start 2023-06-10T19:00:18.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.984+0000 7f0159f66640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f015406b840 0x7f01540cf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:18.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.984+0000 7f0159f66640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f015415f370 0x7f015415f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:18.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.984+0000 7f0159f66640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f015415fd50 con 0x7f015415ba00 2023-06-10T19:00:18.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.984+0000 7f0159f66640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01540ceb40 con 0x7f015415f370 2023-06-10T19:00:18.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.984+0000 7f0159f66640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f015415c1c0 con 0x7f015406b840 2023-06-10T19:00:18.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.984+0000 7f0153fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f015415f370 0x7f015415f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:18.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.984+0000 7f0152ffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f015415ba00 0x7f015406bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52672/0 (socket says 172.21.15.53:52672) 2023-06-10T19:00:18.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.984+0000 7f0152ffd640 1 -- 172.21.15.53:0/642044828 learned_addr learned my addr 172.21.15.53:0/642044828 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:00:18.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.988+0000 7f01537fe640 1 --2- 172.21.15.53:0/642044828 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f015406b840 0x7f01540cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:18.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.988+0000 7f01527fc640 1 -- 172.21.15.53:0/642044828 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 811290446 0 0) 0x7f015415fd50 con 0x7f015415ba00 2023-06-10T19:00:18.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.988+0000 7f01527fc640 1 -- 172.21.15.53:0/642044828 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f013c003530 con 0x7f015415ba00 2023-06-10T19:00:18.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.988+0000 7f0153fff640 1 -- 172.21.15.53:0/642044828 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f015406b840 msgr2=0x7f01540cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:18.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.988+0000 7f0153fff640 1 --2- 172.21.15.53:0/642044828 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f015406b840 0x7f01540cf810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:18.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.988+0000 7f0153fff640 1 -- 172.21.15.53:0/642044828 >> v1:172.21.15.53:6789/0 conn(0x7f015415ba00 legacy=0x7f015406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:18.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.988+0000 7f0153fff640 1 -- 172.21.15.53:0/642044828 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01540cf380 con 0x7f015415f370 2023-06-10T19:00:18.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.988+0000 7f0153fff640 1 --2- 172.21.15.53:0/642044828 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f015415f370 0x7f015415f810 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f014c0097c0 tx=0x7f014c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4caa57f4d441210f server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:18.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.988+0000 7f01527fc640 1 -- 172.21.15.53:0/642044828 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f014c0ad640 con 0x7f015415f370 2023-06-10T19:00:18.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.988+0000 7f01527fc640 1 -- 172.21.15.53:0/642044828 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f014c0ad7a0 con 0x7f015415f370 2023-06-10T19:00:18.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.988+0000 7f01527fc640 1 -- 172.21.15.53:0/642044828 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f014c0adb30 con 0x7f015415f370 2023-06-10T19:00:18.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.988+0000 7f0159f66640 1 -- 172.21.15.53:0/642044828 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f015415f370 msgr2=0x7f015415f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:18.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.988+0000 7f0159f66640 1 --2- 172.21.15.53:0/642044828 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f015415f370 0x7f015415f810 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f014c0097c0 tx=0x7f014c01c480 comp rx=0 tx=0).stop 2023-06-10T19:00:18.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.988+0000 7f0159f66640 1 -- 172.21.15.53:0/642044828 shutdown_connections 2023-06-10T19:00:18.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.988+0000 7f0159f66640 1 --2- 172.21.15.53:0/642044828 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f015415f370 0x7f015415f810 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:18.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.988+0000 7f0159f66640 1 --2- 172.21.15.53:0/642044828 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f015406b840 0x7f01540cf810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:18.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.988+0000 7f0159f66640 1 -- 172.21.15.53:0/642044828 >> 172.21.15.53:0/642044828 conn(0x7f015406a0b0 msgr2=0x7f015406d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:18.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.988+0000 7f0159f66640 1 -- 172.21.15.53:0/642044828 shutdown_connections 2023-06-10T19:00:18.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.988+0000 7f0159f66640 1 -- 172.21.15.53:0/642044828 wait complete. 2023-06-10T19:00:18.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.992+0000 7f0159f66640 1 Processor -- start 2023-06-10T19:00:18.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.992+0000 7f0159f66640 1 -- start start 2023-06-10T19:00:19.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.992+0000 7f0159f66640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f015406b840 0x7f01540c39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:19.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.992+0000 7f0159f66640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f015415ba00 0x7f01540c6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:19.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.992+0000 7f0159f66640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f015415f370 0x7f0154148fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:19.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.992+0000 7f0159f66640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f015414bb00 con 0x7f015406b840 2023-06-10T19:00:19.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.992+0000 7f0159f66640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0154165e00 con 0x7f015415f370 2023-06-10T19:00:19.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.992+0000 7f0159f66640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f015414b020 con 0x7f015415ba00 2023-06-10T19:00:19.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.992+0000 7f01537fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f015406b840 0x7f01540c39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:19.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.992+0000 7f01537fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f015406b840 0x7f01540c39a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60976/0 (socket says 172.21.15.53:60976) 2023-06-10T19:00:19.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.992+0000 7f01537fe640 1 -- 172.21.15.53:0/3416566517 learned_addr learned my addr 172.21.15.53:0/3416566517 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:19.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.992+0000 7f0152ffd640 1 --2- 172.21.15.53:0/3416566517 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f015415ba00 0x7f01540c6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:19.002 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.992+0000 7f01537fe640 1 -- 172.21.15.53:0/3416566517 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f015415ba00 msgr2=0x7f01540c6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:19.002 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.992+0000 7f0153fff640 1 --2- 172.21.15.53:0/3416566517 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f015415f370 0x7f0154148fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:19.002 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.992+0000 7f01537fe640 1 --2- 172.21.15.53:0/3416566517 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f015415ba00 0x7f01540c6940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:19.002 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.992+0000 7f01537fe640 1 -- 172.21.15.53:0/3416566517 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f015415f370 msgr2=0x7f0154148fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:19.002 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.992+0000 7f01537fe640 1 --2- 172.21.15.53:0/3416566517 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f015415f370 0x7f0154148fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:19.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.992+0000 7f01537fe640 1 -- 172.21.15.53:0/3416566517 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f014c009420 con 0x7f015406b840 2023-06-10T19:00:19.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.992+0000 7f0152ffd640 1 --2- 172.21.15.53:0/3416566517 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f015415ba00 0x7f01540c6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:00:19.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.992+0000 7f01537fe640 1 --2- 172.21.15.53:0/3416566517 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f015406b840 0x7f01540c39a0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f0144007ef0 tx=0x7f014400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:19.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.992+0000 7f013bfff640 1 -- 172.21.15.53:0/3416566517 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0144014620 con 0x7f015406b840 2023-06-10T19:00:19.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.992+0000 7f0159f66640 1 -- 172.21.15.53:0/3416566517 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01540c44e0 con 0x7f015406b840 2023-06-10T19:00:19.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.992+0000 7f0159f66640 1 -- 172.21.15.53:0/3416566517 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0154166050 con 0x7f015406b840 2023-06-10T19:00:19.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.992+0000 7f013bfff640 1 -- 172.21.15.53:0/3416566517 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0144014780 con 0x7f015406b840 2023-06-10T19:00:19.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.992+0000 7f013bfff640 1 -- 172.21.15.53:0/3416566517 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0144014af0 con 0x7f015406b840 2023-06-10T19:00:19.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.992+0000 7f0159f66640 1 -- 172.21.15.53:0/3416566517 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0134005260 con 0x7f015406b840 2023-06-10T19:00:19.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.996+0000 7f013bfff640 1 -- 172.21.15.53:0/3416566517 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0144014c50 con 0x7f015406b840 2023-06-10T19:00:19.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.996+0000 7f013bfff640 1 --2- 172.21.15.53:0/3416566517 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0140066280 0x7f0140068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:19.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.996+0000 7f013bfff640 1 -- 172.21.15.53:0/3416566517 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0144085150 con 0x7f015406b840 2023-06-10T19:00:19.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.996+0000 7f0152ffd640 1 --2- 172.21.15.53:0/3416566517 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0140066280 0x7f0140068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:19.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:18.996+0000 7f0152ffd640 1 --2- 172.21.15.53:0/3416566517 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0140066280 0x7f0140068730 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f01540c3ee0 tx=0x7f0148009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:19.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:19.000+0000 7f013bfff640 1 -- 172.21.15.53:0/3416566517 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0144052a90 con 0x7f015406b840 2023-06-10T19:00:19.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:19.148+0000 7f0159f66640 1 -- 172.21.15.53:0/3416566517 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f0134005880 con 0x7f015406b840 2023-06-10T19:00:19.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:19.224+0000 7f013bfff640 1 -- 172.21.15.53:0/3416566517 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v77) v1 ==== 138+0+0 (secure 0 0 0) 0x7f01440560b0 con 0x7f015406b840 2023-06-10T19:00:19.229 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_metadata' created 2023-06-10T19:00:19.232 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:19.228+0000 7f0159f66640 1 -- 172.21.15.53:0/3416566517 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0140066280 msgr2=0x7f0140068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:19.232 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:19.228+0000 7f0159f66640 1 --2- 172.21.15.53:0/3416566517 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0140066280 0x7f0140068730 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f01540c3ee0 tx=0x7f0148009040 comp rx=0 tx=0).stop 2023-06-10T19:00:19.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:19.228+0000 7f0159f66640 1 -- 172.21.15.53:0/3416566517 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f015406b840 msgr2=0x7f01540c39a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:19.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:19.228+0000 7f0159f66640 1 --2- 172.21.15.53:0/3416566517 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f015406b840 0x7f01540c39a0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f0144007ef0 tx=0x7f014400e4b0 comp rx=0 tx=0).stop 2023-06-10T19:00:19.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:19.228+0000 7f0159f66640 1 -- 172.21.15.53:0/3416566517 shutdown_connections 2023-06-10T19:00:19.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:19.228+0000 7f0159f66640 1 --2- 172.21.15.53:0/3416566517 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0140066280 0x7f0140068730 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:19.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:19.228+0000 7f0159f66640 1 --2- 172.21.15.53:0/3416566517 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f015415f370 0x7f0154148fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:19.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:19.228+0000 7f0159f66640 1 --2- 172.21.15.53:0/3416566517 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f015415ba00 0x7f01540c6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:19.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:19.228+0000 7f0159f66640 1 --2- 172.21.15.53:0/3416566517 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f015406b840 0x7f01540c39a0 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:19.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:19.228+0000 7f0159f66640 1 -- 172.21.15.53:0/3416566517 >> 172.21.15.53:0/3416566517 conn(0x7f015406a0b0 msgr2=0x7f015415e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:19.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:19.228+0000 7f0159f66640 1 -- 172.21.15.53:0/3416566517 shutdown_connections 2023-06-10T19:00:19.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:19.228+0000 7f0159f66640 1 -- 172.21.15.53:0/3416566517 wait complete. 2023-06-10T19:00:19.255 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-06-10T19:00:19.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:19.372+0000 7fef4b298640 1 Processor -- start 2023-06-10T19:00:19.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:19.372+0000 7fef4b298640 1 -- start start 2023-06-10T19:00:19.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:19.372+0000 7fef4b298640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fef440b7660 0x7fef44166e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:19.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:19.372+0000 7fef4b298640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef440b45c0 con 0x7fef4415c220 2023-06-10T19:00:19.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:19.372+0000 7fef4b298640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef440b4af0 con 0x7fef4415be50 2023-06-10T19:00:19.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:19.372+0000 7fef4b298640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef440cfec0 con 0x7fef440b7660 2023-06-10T19:00:19.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:19.372+0000 7fef49835640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fef440b7660 0x7fef44166e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:19.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:19.372+0000 7fef48833640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fef4415c220 0x7fef440cce90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52678/0 (socket says 172.21.15.53:52678) 2023-06-10T19:00:19.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:19.372+0000 7fef48833640 1 -- 172.21.15.53:0/1017999960 learned_addr learned my addr 172.21.15.53:0/1017999960 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:00:19.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:19.372+0000 7fef49835640 1 -- 172.21.15.53:0/1017999960 >> v1:172.21.15.117:6789/0 conn(0x7fef4415be50 legacy=0x7fef440cc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:19.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:19.372+0000 7fef49835640 1 -- 172.21.15.53:0/1017999960 >> v1:172.21.15.53:6789/0 conn(0x7fef4415c220 legacy=0x7fef440cce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:19.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:19.372+0000 7fef3bfff640 1 -- 172.21.15.53:0/1017999960 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2941889549 0 0) 0x7fef440b45c0 con 0x7fef4415c220 2023-06-10T19:00:19.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:19.372+0000 7fef49835640 1 -- 172.21.15.53:0/1017999960 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef440b7f00 con 0x7fef440b7660 2023-06-10T19:00:19.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:19.376+0000 7fef49835640 1 --2- 172.21.15.53:0/1017999960 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef440b7660 0x7fef44166e70 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fef3c009d90 tx=0x7fef3c01c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7773c0f4c334e898 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:19.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:19.376+0000 7fef3bfff640 1 -- 172.21.15.53:0/1017999960 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef3c0a5930 con 0x7fef440b7660 2023-06-10T19:00:19.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:19.376+0000 7fef3bfff640 1 -- 172.21.15.53:0/1017999960 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef3c0a5a90 con 0x7fef440b7660 2023-06-10T19:00:19.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:19.376+0000 7fef3bfff640 1 -- 172.21.15.53:0/1017999960 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef3c0a5e20 con 0x7fef440b7660 2023-06-10T19:00:19.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:19.376+0000 7fef4b298640 1 -- 172.21.15.53:0/1017999960 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef440b7660 msgr2=0x7fef44166e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:19.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:19.376+0000 7fef4b298640 1 --2- 172.21.15.53:0/1017999960 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef440b7660 0x7fef44166e70 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fef3c009d90 tx=0x7fef3c01c850 comp rx=0 tx=0).stop 2023-06-10T19:00:19.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:19.376+0000 7fef4b298640 1 -- 172.21.15.53:0/1017999960 shutdown_connections 2023-06-10T19:00:19.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:19.376+0000 7fef4b298640 1 --2- 172.21.15.53:0/1017999960 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef440b7660 0x7fef44166e70 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:19.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:19.376+0000 7fef4b298640 1 -- 172.21.15.53:0/1017999960 >> 172.21.15.53:0/1017999960 conn(0x7fef4406aa30 msgr2=0x7fef440cebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:19.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:19.376+0000 7fef4b298640 1 -- 172.21.15.53:0/1017999960 shutdown_connections 2023-06-10T19:00:19.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:19.376+0000 7fef4b298640 1 -- 172.21.15.53:0/1017999960 wait complete. 2023-06-10T19:00:19.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:19.376+0000 7fef4b298640 1 Processor -- start 2023-06-10T19:00:19.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:19.376+0000 7fef4b298640 1 -- start start 2023-06-10T19:00:19.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:19.376+0000 7fef4b298640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef440b7660 0x7fef44145ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:19.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:19.376+0000 7fef4b298640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef4415be50 0x7fef440c74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:19.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:19.376+0000 7fef4b298640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef4415c220 0x7fef441f8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:19.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:19.376+0000 7fef4b298640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef44146c60 con 0x7fef440b7660 2023-06-10T19:00:19.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:19.376+0000 7fef4b298640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef4415efc0 con 0x7fef4415be50 2023-06-10T19:00:19.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:19.376+0000 7fef4b298640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef4415ec90 con 0x7fef4415c220 2023-06-10T19:00:19.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:19.376+0000 7fef49034640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef440b7660 0x7fef44145ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:19.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:19.376+0000 7fef49034640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef440b7660 0x7fef44145ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60992/0 (socket says 172.21.15.53:60992) 2023-06-10T19:00:19.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:19.376+0000 7fef49034640 1 -- 172.21.15.53:0/2607641539 learned_addr learned my addr 172.21.15.53:0/2607641539 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:19.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:19.376+0000 7fef49034640 1 -- 172.21.15.53:0/2607641539 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef4415c220 msgr2=0x7fef441f8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:19.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:19.376+0000 7fef49034640 1 --2- 172.21.15.53:0/2607641539 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef4415c220 0x7fef441f8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:19.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:19.376+0000 7fef49034640 1 -- 172.21.15.53:0/2607641539 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef4415be50 msgr2=0x7fef440c74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:19.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:19.376+0000 7fef49034640 1 --2- 172.21.15.53:0/2607641539 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef4415be50 0x7fef440c74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:19.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:19.376+0000 7fef49034640 1 -- 172.21.15.53:0/2607641539 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef3c009a70 con 0x7fef440b7660 2023-06-10T19:00:19.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:19.376+0000 7fef49034640 1 --2- 172.21.15.53:0/2607641539 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef440b7660 0x7fef44145ed0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fef4000c450 tx=0x7fef4000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:19.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:19.380+0000 7fef39ffb640 1 -- 172.21.15.53:0/2607641539 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef40012830 con 0x7fef440b7660 2023-06-10T19:00:19.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:19.380+0000 7fef39ffb640 1 -- 172.21.15.53:0/2607641539 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef400129b0 con 0x7fef440b7660 2023-06-10T19:00:19.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:19.380+0000 7fef39ffb640 1 -- 172.21.15.53:0/2607641539 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef40012d60 con 0x7fef440b7660 2023-06-10T19:00:19.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:19.380+0000 7fef4b298640 1 -- 172.21.15.53:0/2607641539 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef4414a450 con 0x7fef440b7660 2023-06-10T19:00:19.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:19.380+0000 7fef4b298640 1 -- 172.21.15.53:0/2607641539 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef4414aa10 con 0x7fef440b7660 2023-06-10T19:00:19.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:19.380+0000 7fef4b298640 1 -- 172.21.15.53:0/2607641539 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef4404d790 con 0x7fef440b7660 2023-06-10T19:00:19.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:19.380+0000 7fef39ffb640 1 -- 172.21.15.53:0/2607641539 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fef4001c460 con 0x7fef440b7660 2023-06-10T19:00:19.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:19.380+0000 7fef39ffb640 1 --2- 172.21.15.53:0/2607641539 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fef28066280 0x7fef28068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:19.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:19.380+0000 7fef39ffb640 1 -- 172.21.15.53:0/2607641539 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5580+0+0 (secure 0 0 0) 0x7fef400844f0 con 0x7fef440b7660 2023-06-10T19:00:19.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:19.380+0000 7fef48833640 1 --2- 172.21.15.53:0/2607641539 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fef28066280 0x7fef28068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:19.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:19.380+0000 7fef48833640 1 --2- 172.21.15.53:0/2607641539 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fef28066280 0x7fef28068730 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fef340011f0 tx=0x7fef34007930 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:19.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:19.384+0000 7fef39ffb640 1 -- 172.21.15.53:0/2607641539 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fef40051bb0 con 0x7fef440b7660 2023-06-10T19:00:19.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:19.536+0000 7fef4b298640 1 -- 172.21.15.53:0/2607641539 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fef44065980 con 0x7fef440b7660 2023-06-10T19:00:20.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.232+0000 7fef39ffb640 1 -- 172.21.15.53:0/2607641539 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v78) v1 ==== 170+0+0 (secure 0 0 0) 0x7fef400551d0 con 0x7fef440b7660 2023-06-10T19:00:20.239 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_data' created 2023-06-10T19:00:20.246 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.240+0000 7fef4b298640 1 -- 172.21.15.53:0/2607641539 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fef28066280 msgr2=0x7fef28068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:20.247 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.240+0000 7fef4b298640 1 --2- 172.21.15.53:0/2607641539 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fef28066280 0x7fef28068730 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fef340011f0 tx=0x7fef34007930 comp rx=0 tx=0).stop 2023-06-10T19:00:20.247 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.240+0000 7fef4b298640 1 -- 172.21.15.53:0/2607641539 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef440b7660 msgr2=0x7fef44145ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:20.247 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.240+0000 7fef4b298640 1 --2- 172.21.15.53:0/2607641539 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef440b7660 0x7fef44145ed0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fef4000c450 tx=0x7fef4000c910 comp rx=0 tx=0).stop 2023-06-10T19:00:20.247 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.240+0000 7fef4b298640 1 -- 172.21.15.53:0/2607641539 shutdown_connections 2023-06-10T19:00:20.247 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.240+0000 7fef4b298640 1 --2- 172.21.15.53:0/2607641539 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fef28066280 0x7fef28068730 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:20.247 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.240+0000 7fef4b298640 1 --2- 172.21.15.53:0/2607641539 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef4415c220 0x7fef441f8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:20.247 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.240+0000 7fef4b298640 1 --2- 172.21.15.53:0/2607641539 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef4415be50 0x7fef440c74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:20.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.240+0000 7fef4b298640 1 --2- 172.21.15.53:0/2607641539 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef440b7660 0x7fef44145ed0 secure :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fef4000c450 tx=0x7fef4000c910 comp rx=0 tx=0).stop 2023-06-10T19:00:20.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.240+0000 7fef4b298640 1 -- 172.21.15.53:0/2607641539 >> 172.21.15.53:0/2607641539 conn(0x7fef4406aa30 msgr2=0x7fef440b6a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:20.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.244+0000 7fef4b298640 1 -- 172.21.15.53:0/2607641539 shutdown_connections 2023-06-10T19:00:20.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.244+0000 7fef4b298640 1 -- 172.21.15.53:0/2607641539 wait complete. 2023-06-10T19:00:20.282 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-06-10T19:00:20.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.400+0000 7f8f19db6640 1 Processor -- start 2023-06-10T19:00:20.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.400+0000 7f8f19db6640 1 -- start start 2023-06-10T19:00:20.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.404+0000 7f8f19db6640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8f1415c090 0x7f8f140b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:20.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.404+0000 7f8f19db6640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8f140b7e30 0x7f8f140d04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:20.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.404+0000 7f8f19db6640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f140cc7c0 con 0x7f8f140b0b90 2023-06-10T19:00:20.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.404+0000 7f8f19db6640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f140ccaa0 con 0x7f8f1415c090 2023-06-10T19:00:20.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.404+0000 7f8f19db6640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f140ccd80 con 0x7f8f140b7e30 2023-06-10T19:00:20.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.404+0000 7f8f137fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8f1415c090 0x7f8f140b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:20.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.404+0000 7f8f137fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8f1415c090 0x7f8f140b10c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60994/0 (socket says 172.21.15.53:60994) 2023-06-10T19:00:20.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.404+0000 7f8f137fe640 1 -- 172.21.15.53:0/2973769670 learned_addr learned my addr 172.21.15.53:0/2973769670 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:20.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.404+0000 7f8f13fff640 1 --2- 172.21.15.53:0/2973769670 >> v2:172.21.15.117:3300/0 conn(0x7f8f140b7e30 0x7f8f140d04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:20.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.404+0000 7f8f137fe640 1 -- 172.21.15.53:0/2973769670 >> v2:172.21.15.117:3300/0 conn(0x7f8f140b7e30 msgr2=0x7f8f140d04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:20.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.404+0000 7f8f137fe640 1 --2- 172.21.15.53:0/2973769670 >> v2:172.21.15.117:3300/0 conn(0x7f8f140b7e30 0x7f8f140d04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:20.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.404+0000 7f8f137fe640 1 -- 172.21.15.53:0/2973769670 >> v1:172.21.15.117:6789/0 conn(0x7f8f140b0b90 legacy=0x7f8f140b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:20.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.404+0000 7f8f137fe640 1 -- 172.21.15.53:0/2973769670 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f140cd060 con 0x7f8f1415c090 2023-06-10T19:00:20.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.404+0000 7f8f137fe640 1 --2- 172.21.15.53:0/2973769670 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f1415c090 0x7f8f140b10c0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f8f1406b200 tx=0x7f8f0401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=986c7f0b9462871 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:20.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.404+0000 7f8f127fc640 1 -- 172.21.15.53:0/2973769670 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f040ac600 con 0x7f8f1415c090 2023-06-10T19:00:20.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.404+0000 7f8f127fc640 1 -- 172.21.15.53:0/2973769670 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f040a8050 con 0x7f8f1415c090 2023-06-10T19:00:20.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.408+0000 7f8f127fc640 1 -- 172.21.15.53:0/2973769670 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f040ac980 con 0x7f8f1415c090 2023-06-10T19:00:20.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.408+0000 7f8f19db6640 1 -- 172.21.15.53:0/2973769670 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f1415c090 msgr2=0x7f8f140b10c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:20.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.408+0000 7f8f19db6640 1 --2- 172.21.15.53:0/2973769670 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f1415c090 0x7f8f140b10c0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f8f1406b200 tx=0x7f8f0401c440 comp rx=0 tx=0).stop 2023-06-10T19:00:20.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.408+0000 7f8f19db6640 1 -- 172.21.15.53:0/2973769670 shutdown_connections 2023-06-10T19:00:20.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.408+0000 7f8f19db6640 1 --2- 172.21.15.53:0/2973769670 >> v2:172.21.15.117:3300/0 conn(0x7f8f140b7e30 0x7f8f140d04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:20.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.408+0000 7f8f19db6640 1 --2- 172.21.15.53:0/2973769670 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f1415c090 0x7f8f140b10c0 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:20.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.408+0000 7f8f19db6640 1 -- 172.21.15.53:0/2973769670 >> 172.21.15.53:0/2973769670 conn(0x7f8f14069e20 msgr2=0x7f8f1406a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:20.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.408+0000 7f8f19db6640 1 -- 172.21.15.53:0/2973769670 shutdown_connections 2023-06-10T19:00:20.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.408+0000 7f8f19db6640 1 -- 172.21.15.53:0/2973769670 wait complete. 2023-06-10T19:00:20.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.408+0000 7f8f19db6640 1 Processor -- start 2023-06-10T19:00:20.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.408+0000 7f8f19db6640 1 -- start start 2023-06-10T19:00:20.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.408+0000 7f8f19db6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8f140b0b90 0x7f8f141532e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:20.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.408+0000 7f8f19db6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f140b7e30 0x7f8f141518c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:20.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.408+0000 7f8f19db6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8f1415c090 0x7f8f1414cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:20.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.408+0000 7f8f19db6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f14151e00 con 0x7f8f140b7e30 2023-06-10T19:00:20.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.408+0000 7f8f19db6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1415ebd0 con 0x7f8f1415c090 2023-06-10T19:00:20.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.408+0000 7f8f19db6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1415e290 con 0x7f8f140b0b90 2023-06-10T19:00:20.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.408+0000 7f8f12ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f140b7e30 0x7f8f141518c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:20.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.408+0000 7f8f12ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f140b7e30 0x7f8f141518c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:32776/0 (socket says 172.21.15.53:32776) 2023-06-10T19:00:20.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.408+0000 7f8f12ffd640 1 -- 172.21.15.53:0/167749440 learned_addr learned my addr 172.21.15.53:0/167749440 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:20.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.408+0000 7f8f137fe640 1 --2- 172.21.15.53:0/167749440 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8f140b0b90 0x7f8f141532e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:20.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.408+0000 7f8f13fff640 1 --2- 172.21.15.53:0/167749440 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8f1415c090 0x7f8f1414cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:20.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.408+0000 7f8f12ffd640 1 -- 172.21.15.53:0/167749440 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8f140b0b90 msgr2=0x7f8f141532e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:20.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.408+0000 7f8f12ffd640 1 --2- 172.21.15.53:0/167749440 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8f140b0b90 0x7f8f141532e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:20.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.408+0000 7f8f12ffd640 1 -- 172.21.15.53:0/167749440 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8f1415c090 msgr2=0x7f8f1414cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:20.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.408+0000 7f8f12ffd640 1 --2- 172.21.15.53:0/167749440 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8f1415c090 0x7f8f1414cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:20.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.408+0000 7f8f12ffd640 1 -- 172.21.15.53:0/167749440 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f040094d0 con 0x7f8f140b7e30 2023-06-10T19:00:20.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.408+0000 7f8f12ffd640 1 --2- 172.21.15.53:0/167749440 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f140b7e30 0x7f8f141518c0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f8f0800c420 tx=0x7f8f0800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:20.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.408+0000 7f8efbfff640 1 -- 172.21.15.53:0/167749440 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f080052d0 con 0x7f8f140b7e30 2023-06-10T19:00:20.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.408+0000 7f8efbfff640 1 -- 172.21.15.53:0/167749440 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f08005430 con 0x7f8f140b7e30 2023-06-10T19:00:20.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.408+0000 7f8f19db6640 1 -- 172.21.15.53:0/167749440 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f1414d4c0 con 0x7f8f140b7e30 2023-06-10T19:00:20.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.408+0000 7f8efbfff640 1 -- 172.21.15.53:0/167749440 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f08003820 con 0x7f8f140b7e30 2023-06-10T19:00:20.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.408+0000 7f8f19db6640 1 -- 172.21.15.53:0/167749440 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f1415e510 con 0x7f8f140b7e30 2023-06-10T19:00:20.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.412+0000 7f8f19db6640 1 -- 172.21.15.53:0/167749440 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f1404d790 con 0x7f8f140b7e30 2023-06-10T19:00:20.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.412+0000 7f8efbfff640 1 -- 172.21.15.53:0/167749440 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8f08003980 con 0x7f8f140b7e30 2023-06-10T19:00:20.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.412+0000 7f8efbfff640 1 --2- 172.21.15.53:0/167749440 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8f00066280 0x7f8f00068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:20.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.412+0000 7f8efbfff640 1 -- 172.21.15.53:0/167749440 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f8f08083180 con 0x7f8f140b7e30 2023-06-10T19:00:20.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.412+0000 7f8f137fe640 1 --2- 172.21.15.53:0/167749440 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8f00066280 0x7f8f00068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:20.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.412+0000 7f8f137fe640 1 --2- 172.21.15.53:0/167749440 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8f00066280 0x7f8f00068730 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f8f040ae000 tx=0x7f8f040a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:20.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.416+0000 7f8efbfff640 1 -- 172.21.15.53:0/167749440 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8f080507a0 con 0x7f8f140b7e30 2023-06-10T19:00:20.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.600+0000 7f8f19db6640 1 -- 172.21.15.53:0/167749440 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f8f140b72f0 con 0x7f8f140b7e30 2023-06-10T19:00:20.616 INFO:teuthology.orchestra.run.smithi053.stderr:new fs with metadata pool 11 and data pool 12 2023-06-10T19:00:20.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.612+0000 7f8efbfff640 1 -- 172.21.15.53:0/167749440 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 11 and data pool 12 v30) v1 ==== 174+0+0 (secure 0 0 0) 0x7f8f08053dc0 con 0x7f8f140b7e30 2023-06-10T19:00:20.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.616+0000 7f8f19db6640 1 -- 172.21.15.53:0/167749440 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8f00066280 msgr2=0x7f8f00068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:20.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.616+0000 7f8f19db6640 1 --2- 172.21.15.53:0/167749440 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8f00066280 0x7f8f00068730 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f8f040ae000 tx=0x7f8f040a7000 comp rx=0 tx=0).stop 2023-06-10T19:00:20.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.616+0000 7f8f19db6640 1 -- 172.21.15.53:0/167749440 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f140b7e30 msgr2=0x7f8f141518c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:20.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.616+0000 7f8f19db6640 1 --2- 172.21.15.53:0/167749440 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f140b7e30 0x7f8f141518c0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f8f0800c420 tx=0x7f8f0800c8e0 comp rx=0 tx=0).stop 2023-06-10T19:00:20.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.616+0000 7f8f19db6640 1 -- 172.21.15.53:0/167749440 shutdown_connections 2023-06-10T19:00:20.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.616+0000 7f8f19db6640 1 --2- 172.21.15.53:0/167749440 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8f00066280 0x7f8f00068730 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:20.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.616+0000 7f8f19db6640 1 --2- 172.21.15.53:0/167749440 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8f1415c090 0x7f8f1414cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:20.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.616+0000 7f8f19db6640 1 --2- 172.21.15.53:0/167749440 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f140b7e30 0x7f8f141518c0 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:20.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.616+0000 7f8f19db6640 1 --2- 172.21.15.53:0/167749440 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8f140b0b90 0x7f8f141532e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:20.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.616+0000 7f8f19db6640 1 -- 172.21.15.53:0/167749440 >> 172.21.15.53:0/167749440 conn(0x7f8f14069e20 msgr2=0x7f8f140ce8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:20.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.616+0000 7f8f19db6640 1 -- 172.21.15.53:0/167749440 shutdown_connections 2023-06-10T19:00:20.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.616+0000 7f8f19db6640 1 -- 172.21.15.53:0/167749440 wait complete. 2023-06-10T19:00:20.651 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:00:20.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.760+0000 7f59f3956640 1 Processor -- start 2023-06-10T19:00:20.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.760+0000 7f59f3956640 1 -- start start 2023-06-10T19:00:20.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.760+0000 7f59f3956640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f59ec06b2f0 0x7f59ec06f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:20.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.760+0000 7f59f3956640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f59ec0c8d00 0x7f59ec06b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:20.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.760+0000 7f59f3956640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59ec158a90 con 0x7f59ec06bc00 2023-06-10T19:00:20.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.760+0000 7f59f3956640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59ec0705d0 con 0x7f59ec0c8d00 2023-06-10T19:00:20.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.760+0000 7f59f3956640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59ec06f9c0 con 0x7f59ec06b2f0 2023-06-10T19:00:20.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.760+0000 7f59f1ef3640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f59ec06bc00 0x7f59ec0cbe00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52684/0 (socket says 172.21.15.53:52684) 2023-06-10T19:00:20.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.760+0000 7f59f1ef3640 1 -- 172.21.15.53:0/3084251800 learned_addr learned my addr 172.21.15.53:0/3084251800 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:00:20.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.760+0000 7f59f0ef1640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f59ec0c8d00 0x7f59ec06b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:20.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.760+0000 7f59f16f2640 1 --2- 172.21.15.53:0/3084251800 >> v2:172.21.15.117:3300/0 conn(0x7f59ec06b2f0 0x7f59ec06f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:20.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.760+0000 7f59e3fff640 1 -- 172.21.15.53:0/3084251800 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 805645318 0 0) 0x7f59e40014a0 con 0x7f59ec06bc00 2023-06-10T19:00:20.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.760+0000 7f59e3fff640 1 -- 172.21.15.53:0/3084251800 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59d8003530 con 0x7f59ec06bc00 2023-06-10T19:00:20.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.760+0000 7f59f0ef1640 1 -- 172.21.15.53:0/3084251800 >> v2:172.21.15.117:3300/0 conn(0x7f59ec06b2f0 msgr2=0x7f59ec06f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:20.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.760+0000 7f59f0ef1640 1 --2- 172.21.15.53:0/3084251800 >> v2:172.21.15.117:3300/0 conn(0x7f59ec06b2f0 0x7f59ec06f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:20.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.760+0000 7f59f0ef1640 1 -- 172.21.15.53:0/3084251800 >> v1:172.21.15.53:6789/0 conn(0x7f59ec06bc00 legacy=0x7f59ec0cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:20.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.760+0000 7f59f0ef1640 1 -- 172.21.15.53:0/3084251800 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59ec06fca0 con 0x7f59ec0c8d00 2023-06-10T19:00:20.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.764+0000 7f59f0ef1640 1 --2- 172.21.15.53:0/3084251800 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59ec0c8d00 0x7f59ec06b6c0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f59ec071d80 tx=0x7f59dc01ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ad6a9da7af93c06 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:20.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.764+0000 7f59e3fff640 1 -- 172.21.15.53:0/3084251800 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59dc0a8950 con 0x7f59ec0c8d00 2023-06-10T19:00:20.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.764+0000 7f59e3fff640 1 -- 172.21.15.53:0/3084251800 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59dc0a8ab0 con 0x7f59ec0c8d00 2023-06-10T19:00:20.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.764+0000 7f59e3fff640 1 -- 172.21.15.53:0/3084251800 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59dc0a8e40 con 0x7f59ec0c8d00 2023-06-10T19:00:20.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.764+0000 7f59f3956640 1 -- 172.21.15.53:0/3084251800 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59ec0c8d00 msgr2=0x7f59ec06b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:20.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.764+0000 7f59f3956640 1 --2- 172.21.15.53:0/3084251800 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59ec0c8d00 0x7f59ec06b6c0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f59ec071d80 tx=0x7f59dc01ec50 comp rx=0 tx=0).stop 2023-06-10T19:00:20.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.764+0000 7f59f3956640 1 -- 172.21.15.53:0/3084251800 shutdown_connections 2023-06-10T19:00:20.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.764+0000 7f59f3956640 1 --2- 172.21.15.53:0/3084251800 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59ec0c8d00 0x7f59ec06b6c0 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:20.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.764+0000 7f59f3956640 1 --2- 172.21.15.53:0/3084251800 >> v2:172.21.15.117:3300/0 conn(0x7f59ec06b2f0 0x7f59ec06f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:20.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.764+0000 7f59f3956640 1 -- 172.21.15.53:0/3084251800 >> 172.21.15.53:0/3084251800 conn(0x7f59ec06a0d0 msgr2=0x7f59ec0ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:20.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.764+0000 7f59f3956640 1 -- 172.21.15.53:0/3084251800 shutdown_connections 2023-06-10T19:00:20.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.764+0000 7f59f3956640 1 -- 172.21.15.53:0/3084251800 wait complete. 2023-06-10T19:00:20.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.764+0000 7f59f3956640 1 Processor -- start 2023-06-10T19:00:20.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.764+0000 7f59f3956640 1 -- start start 2023-06-10T19:00:20.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.764+0000 7f59f3956640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59ec06b2f0 0x7f59ec1f2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:20.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.764+0000 7f59f3956640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59ec06bc00 0x7f59ec0acbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:20.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.764+0000 7f59f3956640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59ec0c8d00 0x7f59ec0c7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:20.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.764+0000 7f59f3956640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59ec1eefb0 con 0x7f59ec0c8d00 2023-06-10T19:00:20.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.764+0000 7f59f3956640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59ec0ad130 con 0x7f59ec06b2f0 2023-06-10T19:00:20.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.764+0000 7f59f3956640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59ec1f2a50 con 0x7f59ec06bc00 2023-06-10T19:00:20.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.764+0000 7f59f1ef3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59ec0c8d00 0x7f59ec0c7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:20.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.764+0000 7f59f1ef3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59ec0c8d00 0x7f59ec0c7040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:32792/0 (socket says 172.21.15.53:32792) 2023-06-10T19:00:20.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.764+0000 7f59f1ef3640 1 -- 172.21.15.53:0/101339538 learned_addr learned my addr 172.21.15.53:0/101339538 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:20.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.764+0000 7f59f16f2640 1 --2- 172.21.15.53:0/101339538 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59ec06b2f0 0x7f59ec1f2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:20.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.764+0000 7f59f0ef1640 1 --2- 172.21.15.53:0/101339538 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59ec06bc00 0x7f59ec0acbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:20.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.764+0000 7f59f1ef3640 1 -- 172.21.15.53:0/101339538 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59ec06bc00 msgr2=0x7f59ec0acbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:20.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.764+0000 7f59f1ef3640 1 --2- 172.21.15.53:0/101339538 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59ec06bc00 0x7f59ec0acbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:20.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.764+0000 7f59f1ef3640 1 -- 172.21.15.53:0/101339538 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59ec06b2f0 msgr2=0x7f59ec1f2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:20.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.764+0000 7f59f1ef3640 1 --2- 172.21.15.53:0/101339538 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59ec06b2f0 0x7f59ec1f2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:20.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.764+0000 7f59f1ef3640 1 -- 172.21.15.53:0/101339538 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59dc009420 con 0x7f59ec0c8d00 2023-06-10T19:00:20.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.764+0000 7f59f1ef3640 1 --2- 172.21.15.53:0/101339538 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59ec0c8d00 0x7f59ec0c7040 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f59e400cb40 tx=0x7f59e400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:20.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.764+0000 7f59e1ffb640 1 -- 172.21.15.53:0/101339538 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e400aca0 con 0x7f59ec0c8d00 2023-06-10T19:00:20.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.764+0000 7f59e1ffb640 1 -- 172.21.15.53:0/101339538 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59e400ae00 con 0x7f59ec0c8d00 2023-06-10T19:00:20.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.764+0000 7f59f3956640 1 -- 172.21.15.53:0/101339538 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59ec1f2d30 con 0x7f59ec0c8d00 2023-06-10T19:00:20.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.764+0000 7f59e1ffb640 1 -- 172.21.15.53:0/101339538 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e4012620 con 0x7f59ec0c8d00 2023-06-10T19:00:20.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.764+0000 7f59f3956640 1 -- 172.21.15.53:0/101339538 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59ec0af3b0 con 0x7f59ec0c8d00 2023-06-10T19:00:20.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.768+0000 7f59f3956640 1 -- 172.21.15.53:0/101339538 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59ec1ef120 con 0x7f59ec0c8d00 2023-06-10T19:00:20.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.768+0000 7f59e1ffb640 1 -- 172.21.15.53:0/101339538 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f59e4007070 con 0x7f59ec0c8d00 2023-06-10T19:00:20.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.768+0000 7f59e1ffb640 1 --2- 172.21.15.53:0/101339538 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f59d0066280 0x7f59d0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:20.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.768+0000 7f59e1ffb640 1 -- 172.21.15.53:0/101339538 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f59e4083b80 con 0x7f59ec0c8d00 2023-06-10T19:00:20.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.768+0000 7f59f16f2640 1 --2- 172.21.15.53:0/101339538 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f59d0066280 0x7f59d0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:20.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.768+0000 7f59f16f2640 1 --2- 172.21.15.53:0/101339538 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f59d0066280 0x7f59d0068730 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f59ec0b30a0 tx=0x7f59e8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:20.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.772+0000 7f59e1ffb640 1 -- 172.21.15.53:0/101339538 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f59e4051090 con 0x7f59ec0c8d00 2023-06-10T19:00:20.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.928+0000 7f59f3956640 1 -- 172.21.15.53:0/101339538 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f59ec158a70 con 0x7f59ec0c8d00 2023-06-10T19:00:20.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.932+0000 7f59e1ffb640 1 -- 172.21.15.53:0/101339538 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+18355 (secure 0 0 0) 0x7f59e4017090 con 0x7f59ec0c8d00 2023-06-10T19:00:20.937 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:00:20.938 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":79,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:00:20.607396+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-06-10T19:00:19.188303+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-06-10T19:00:19.583756+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:00:20.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.932+0000 7f59f3956640 1 -- 172.21.15.53:0/101339538 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f59d0066280 msgr2=0x7f59d0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:20.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.932+0000 7f59f3956640 1 --2- 172.21.15.53:0/101339538 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f59d0066280 0x7f59d0068730 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f59ec0b30a0 tx=0x7f59e8008040 comp rx=0 tx=0).stop 2023-06-10T19:00:20.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.932+0000 7f59f3956640 1 -- 172.21.15.53:0/101339538 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59ec0c8d00 msgr2=0x7f59ec0c7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:20.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.932+0000 7f59f3956640 1 --2- 172.21.15.53:0/101339538 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59ec0c8d00 0x7f59ec0c7040 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f59e400cb40 tx=0x7f59e400a060 comp rx=0 tx=0).stop 2023-06-10T19:00:20.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.932+0000 7f59f3956640 1 -- 172.21.15.53:0/101339538 shutdown_connections 2023-06-10T19:00:20.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.932+0000 7f59f3956640 1 --2- 172.21.15.53:0/101339538 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f59d0066280 0x7f59d0068730 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:20.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.932+0000 7f59f3956640 1 --2- 172.21.15.53:0/101339538 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59ec0c8d00 0x7f59ec0c7040 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:20.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.932+0000 7f59f3956640 1 --2- 172.21.15.53:0/101339538 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f59ec06bc00 0x7f59ec0acbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:20.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.932+0000 7f59f3956640 1 --2- 172.21.15.53:0/101339538 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59ec06b2f0 0x7f59ec1f2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:20.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.932+0000 7f59f3956640 1 -- 172.21.15.53:0/101339538 >> 172.21.15.53:0/101339538 conn(0x7f59ec06a0d0 msgr2=0x7f59ec0ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:20.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.932+0000 7f59f3956640 1 -- 172.21.15.53:0/101339538 shutdown_connections 2023-06-10T19:00:20.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:20.932+0000 7f59f3956640 1 -- 172.21.15.53:0/101339538 wait complete. 2023-06-10T19:00:20.957 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:00:21.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.072+0000 7f436eb7f640 1 Processor -- start 2023-06-10T19:00:21.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.072+0000 7f436eb7f640 1 -- start start 2023-06-10T19:00:21.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.072+0000 7f436eb7f640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f43680c9750 0x7f43680aced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:21.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.072+0000 7f436eb7f640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43680ad410 con 0x7f43680cb870 2023-06-10T19:00:21.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.072+0000 7f436eb7f640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43681600d0 con 0x7f43680afe30 2023-06-10T19:00:21.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.072+0000 7f436eb7f640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43680cd990 con 0x7f43680c9750 2023-06-10T19:00:21.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.072+0000 7f4367fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f43680cb870 0x7f43680af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52698/0 (socket says 172.21.15.53:52698) 2023-06-10T19:00:21.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.072+0000 7f4367fff640 1 -- 172.21.15.53:0/228464512 learned_addr learned my addr 172.21.15.53:0/228464512 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:00:21.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.072+0000 7f436c91b640 1 --2- 172.21.15.53:0/228464512 >> v2:172.21.15.117:3300/0 conn(0x7f43680c9750 0x7f43680aced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:21.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.076+0000 7f43677fe640 1 -- 172.21.15.53:0/228464512 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 654648806 0 0) 0x7f43680ad410 con 0x7f43680cb870 2023-06-10T19:00:21.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.076+0000 7f43677fe640 1 -- 172.21.15.53:0/228464512 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4354003530 con 0x7f43680cb870 2023-06-10T19:00:21.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.076+0000 7f43677fe640 1 -- 172.21.15.53:0/228464512 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1609741359 0 0) 0x7f4354003530 con 0x7f43680cb870 2023-06-10T19:00:21.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.076+0000 7f43677fe640 1 -- 172.21.15.53:0/228464512 >> v2:172.21.15.117:3300/0 conn(0x7f43680c9750 msgr2=0x7f43680aced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:21.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.076+0000 7f43677fe640 1 --2- 172.21.15.53:0/228464512 >> v2:172.21.15.117:3300/0 conn(0x7f43680c9750 0x7f43680aced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:21.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.076+0000 7f43677fe640 1 -- 172.21.15.53:0/228464512 >> v1:172.21.15.117:6789/0 conn(0x7f43680afe30 legacy=0x7f43680aba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:21.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.076+0000 7f43677fe640 1 -- 172.21.15.53:0/228464512 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4368160370 con 0x7f43680cb870 2023-06-10T19:00:21.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.076+0000 7f43677fe640 1 -- 172.21.15.53:0/228464512 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f4358001680 con 0x7f43680cb870 2023-06-10T19:00:21.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.076+0000 7f43677fe640 1 -- 172.21.15.53:0/228464512 >> v1:172.21.15.53:6789/0 conn(0x7f43680cb870 legacy=0x7f43680af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:21.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.076+0000 7f43677fe640 1 --2- 172.21.15.53:0/228464512 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43540039f0 0x7f4354003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:21.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.076+0000 7f43677fe640 1 --2- 172.21.15.53:0/228464512 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f43540047d0 0x7f4354004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:21.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.076+0000 7f43677fe640 1 --2- 172.21.15.53:0/228464512 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4354005180 0x7f435400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:21.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.076+0000 7f43677fe640 1 -- 172.21.15.53:0/228464512 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43680cd990 con 0x7f43540039f0 2023-06-10T19:00:21.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.076+0000 7f43677fe640 1 -- 172.21.15.53:0/228464512 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f435400c060 con 0x7f4354005180 2023-06-10T19:00:21.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.076+0000 7f43677fe640 1 -- 172.21.15.53:0/228464512 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f435400c220 con 0x7f43540047d0 2023-06-10T19:00:21.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.076+0000 7f436c91b640 1 --2- 172.21.15.53:0/228464512 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43540039f0 0x7f4354003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:21.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.076+0000 7f4367fff640 1 --2- 172.21.15.53:0/228464512 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f43540047d0 0x7f4354004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:21.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.076+0000 7f436d11c640 1 --2- 172.21.15.53:0/228464512 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4354005180 0x7f435400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:21.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.076+0000 7f436c91b640 1 -- 172.21.15.53:0/228464512 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f43540047d0 msgr2=0x7f4354004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:21.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.076+0000 7f436c91b640 1 --2- 172.21.15.53:0/228464512 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f43540047d0 0x7f4354004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:21.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.076+0000 7f436c91b640 1 -- 172.21.15.53:0/228464512 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4354005180 msgr2=0x7f435400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:21.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.076+0000 7f436c91b640 1 --2- 172.21.15.53:0/228464512 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4354005180 0x7f435400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:21.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.076+0000 7f436c91b640 1 -- 172.21.15.53:0/228464512 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4354003530 con 0x7f43540039f0 2023-06-10T19:00:21.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.076+0000 7f4367fff640 1 --2- 172.21.15.53:0/228464512 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f43540047d0 0x7f4354004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:00:21.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.076+0000 7f436d11c640 1 --2- 172.21.15.53:0/228464512 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4354005180 0x7f435400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:00:21.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.076+0000 7f436d11c640 1 -- 172.21.15.53:0/228464512 reap_dead start 2023-06-10T19:00:21.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.076+0000 7f436c91b640 1 --2- 172.21.15.53:0/228464512 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43540039f0 0x7f4354003e00 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f4350009ae0 tx=0x7f435001ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27591250741f286e server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:21.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.076+0000 7f43677fe640 1 -- 172.21.15.53:0/228464512 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43500a5590 con 0x7f43540039f0 2023-06-10T19:00:21.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.076+0000 7f43677fe640 1 -- 172.21.15.53:0/228464512 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43500a56f0 con 0x7f43540039f0 2023-06-10T19:00:21.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.076+0000 7f43677fe640 1 -- 172.21.15.53:0/228464512 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43500a5aa0 con 0x7f43540039f0 2023-06-10T19:00:21.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.076+0000 7f436eb7f640 1 -- 172.21.15.53:0/228464512 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43540039f0 msgr2=0x7f4354003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:21.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.076+0000 7f436eb7f640 1 --2- 172.21.15.53:0/228464512 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43540039f0 0x7f4354003e00 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f4350009ae0 tx=0x7f435001ca20 comp rx=0 tx=0).stop 2023-06-10T19:00:21.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.076+0000 7f436eb7f640 1 -- 172.21.15.53:0/228464512 shutdown_connections 2023-06-10T19:00:21.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.076+0000 7f436eb7f640 1 --2- 172.21.15.53:0/228464512 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43540039f0 0x7f4354003e00 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:21.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.076+0000 7f436eb7f640 1 -- 172.21.15.53:0/228464512 >> 172.21.15.53:0/228464512 conn(0x7f436806a0d0 msgr2=0x7f43680ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:21.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.076+0000 7f436eb7f640 1 -- 172.21.15.53:0/228464512 shutdown_connections 2023-06-10T19:00:21.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.080+0000 7f436eb7f640 1 -- 172.21.15.53:0/228464512 wait complete. 2023-06-10T19:00:21.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.080+0000 7f436eb7f640 1 Processor -- start 2023-06-10T19:00:21.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.080+0000 7f436eb7f640 1 -- start start 2023-06-10T19:00:21.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.080+0000 7f436eb7f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f43540039f0 0x7f43680c40c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:21.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.080+0000 7f436eb7f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f43680b1720 0x7f43680b3380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:21.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.080+0000 7f436eb7f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43680adcf0 0x7f43680ae160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:21.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.080+0000 7f436eb7f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43680ae6a0 con 0x7f43680adcf0 2023-06-10T19:00:21.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.080+0000 7f436eb7f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43681f8c20 con 0x7f43540039f0 2023-06-10T19:00:21.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.080+0000 7f436eb7f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43680c4600 con 0x7f43680b1720 2023-06-10T19:00:21.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.080+0000 7f436d11c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43680adcf0 0x7f43680ae160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:21.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.080+0000 7f436d11c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43680adcf0 0x7f43680ae160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:32818/0 (socket says 172.21.15.53:32818) 2023-06-10T19:00:21.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.080+0000 7f436d11c640 1 -- 172.21.15.53:0/517808128 learned_addr learned my addr 172.21.15.53:0/517808128 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:21.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.080+0000 7f4367fff640 1 --2- 172.21.15.53:0/517808128 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f43680b1720 0x7f43680b3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:21.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.080+0000 7f436c91b640 1 --2- 172.21.15.53:0/517808128 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f43540039f0 0x7f43680c40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:21.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.080+0000 7f436d11c640 1 -- 172.21.15.53:0/517808128 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f43680b1720 msgr2=0x7f43680b3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:21.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.080+0000 7f436d11c640 1 --2- 172.21.15.53:0/517808128 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f43680b1720 0x7f43680b3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:21.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.080+0000 7f436d11c640 1 -- 172.21.15.53:0/517808128 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f43540039f0 msgr2=0x7f43680c40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:21.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.080+0000 7f436d11c640 1 --2- 172.21.15.53:0/517808128 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f43540039f0 0x7f43680c40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:21.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.080+0000 7f436d11c640 1 -- 172.21.15.53:0/517808128 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43681f7d30 con 0x7f43680adcf0 2023-06-10T19:00:21.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.080+0000 7f436d11c640 1 --2- 172.21.15.53:0/517808128 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43680adcf0 0x7f43680ae160 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f436806e970 tx=0x7f436000d830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:21.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.080+0000 7f43657fa640 1 -- 172.21.15.53:0/517808128 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436000b070 con 0x7f43680adcf0 2023-06-10T19:00:21.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.080+0000 7f43657fa640 1 -- 172.21.15.53:0/517808128 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4360003980 con 0x7f43680adcf0 2023-06-10T19:00:21.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.080+0000 7f436eb7f640 1 -- 172.21.15.53:0/517808128 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43681f8010 con 0x7f43680adcf0 2023-06-10T19:00:21.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.080+0000 7f43657fa640 1 -- 172.21.15.53:0/517808128 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4360003d30 con 0x7f43680adcf0 2023-06-10T19:00:21.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.080+0000 7f436eb7f640 1 -- 172.21.15.53:0/517808128 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43681f85d0 con 0x7f43680adcf0 2023-06-10T19:00:21.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.080+0000 7f436eb7f640 1 -- 172.21.15.53:0/517808128 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f436804d790 con 0x7f43680adcf0 2023-06-10T19:00:21.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.084+0000 7f43657fa640 1 -- 172.21.15.53:0/517808128 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f43600050d0 con 0x7f43680adcf0 2023-06-10T19:00:21.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.084+0000 7f43657fa640 1 --2- 172.21.15.53:0/517808128 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4348066280 0x7f4348068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:21.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.084+0000 7f43657fa640 1 -- 172.21.15.53:0/517808128 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4360082f20 con 0x7f43680adcf0 2023-06-10T19:00:21.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.084+0000 7f436c91b640 1 --2- 172.21.15.53:0/517808128 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4348066280 0x7f4348068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:21.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.084+0000 7f436c91b640 1 --2- 172.21.15.53:0/517808128 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4348066280 0x7f4348068730 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f43500af000 tx=0x7f4350008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:21.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.088+0000 7f43657fa640 1 -- 172.21.15.53:0/517808128 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4360050300 con 0x7f43680adcf0 2023-06-10T19:00:21.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.244+0000 7f436eb7f640 1 -- 172.21.15.53:0/517808128 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f43680b0680 con 0x7f43680adcf0 2023-06-10T19:00:21.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.244+0000 7f43657fa640 1 -- 172.21.15.53:0/517808128 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+18355 (secure 0 0 0) 0x7f4360018020 con 0x7f43680adcf0 2023-06-10T19:00:21.250 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:00:21.250 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":79,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:00:20.607396+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-06-10T19:00:19.188303+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-06-10T19:00:19.583756+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:00:21.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.248+0000 7f436eb7f640 1 -- 172.21.15.53:0/517808128 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4348066280 msgr2=0x7f4348068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:21.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.248+0000 7f436eb7f640 1 --2- 172.21.15.53:0/517808128 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4348066280 0x7f4348068730 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f43500af000 tx=0x7f4350008040 comp rx=0 tx=0).stop 2023-06-10T19:00:21.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.248+0000 7f436eb7f640 1 -- 172.21.15.53:0/517808128 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43680adcf0 msgr2=0x7f43680ae160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:21.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.248+0000 7f436eb7f640 1 --2- 172.21.15.53:0/517808128 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43680adcf0 0x7f43680ae160 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f436806e970 tx=0x7f436000d830 comp rx=0 tx=0).stop 2023-06-10T19:00:21.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.248+0000 7f436eb7f640 1 -- 172.21.15.53:0/517808128 shutdown_connections 2023-06-10T19:00:21.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.248+0000 7f436eb7f640 1 --2- 172.21.15.53:0/517808128 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4348066280 0x7f4348068730 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:21.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.248+0000 7f436eb7f640 1 --2- 172.21.15.53:0/517808128 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43680adcf0 0x7f43680ae160 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:21.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.248+0000 7f436eb7f640 1 --2- 172.21.15.53:0/517808128 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f43680b1720 0x7f43680b3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:21.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.248+0000 7f436eb7f640 1 --2- 172.21.15.53:0/517808128 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f43540039f0 0x7f43680c40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:21.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.248+0000 7f436eb7f640 1 -- 172.21.15.53:0/517808128 >> 172.21.15.53:0/517808128 conn(0x7f436806a0d0 msgr2=0x7f436806c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:21.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.248+0000 7f436eb7f640 1 -- 172.21.15.53:0/517808128 shutdown_connections 2023-06-10T19:00:21.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.248+0000 7f436eb7f640 1 -- 172.21.15.53:0/517808128 wait complete. 2023-06-10T19:00:21.270 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-06-10T19:00:21.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.392+0000 7f0eae9ad640 1 Processor -- start 2023-06-10T19:00:21.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.392+0000 7f0eae9ad640 1 -- start start 2023-06-10T19:00:21.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.392+0000 7f0eae9ad640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0ea80afe70 0x7f0ea80c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:21.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.392+0000 7f0eae9ad640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ea806b090 con 0x7f0ea80c9fa0 2023-06-10T19:00:21.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.392+0000 7f0eae9ad640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ea80ca370 con 0x7f0ea80c82a0 2023-06-10T19:00:21.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.392+0000 7f0eae9ad640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ea8070d50 con 0x7f0ea80afe70 2023-06-10T19:00:21.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.392+0000 7f0ea7fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f0ea80c9fa0 0x7f0ea806bae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:33698/0 (socket says 172.21.15.53:33698) 2023-06-10T19:00:21.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.392+0000 7f0ea7fff640 1 -- 172.21.15.53:0/692285090 learned_addr learned my addr 172.21.15.53:0/692285090 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:00:21.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.392+0000 7f0eacf4a640 1 --2- 172.21.15.53:0/692285090 >> v2:172.21.15.117:3300/0 conn(0x7f0ea80afe70 0x7f0ea80c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:21.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.392+0000 7f0ea6ffd640 1 -- 172.21.15.53:0/692285090 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2263484707 0 0) 0x7f0ea806b090 con 0x7f0ea80c9fa0 2023-06-10T19:00:21.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.392+0000 7f0ea6ffd640 1 -- 172.21.15.53:0/692285090 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e94003530 con 0x7f0ea80c9fa0 2023-06-10T19:00:21.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.392+0000 7f0ea6ffd640 1 -- 172.21.15.53:0/692285090 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3701992960 0 0) 0x7f0e94003530 con 0x7f0ea80c9fa0 2023-06-10T19:00:21.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.392+0000 7f0ea6ffd640 1 -- 172.21.15.53:0/692285090 >> v2:172.21.15.117:3300/0 conn(0x7f0ea80afe70 msgr2=0x7f0ea80c86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:21.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.392+0000 7f0ea6ffd640 1 --2- 172.21.15.53:0/692285090 >> v2:172.21.15.117:3300/0 conn(0x7f0ea80afe70 0x7f0ea80c86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:21.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.392+0000 7f0ea6ffd640 1 -- 172.21.15.53:0/692285090 >> v1:172.21.15.117:6789/0 conn(0x7f0ea80c82a0 legacy=0x7f0ea80af760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:21.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.392+0000 7f0ea6ffd640 1 -- 172.21.15.53:0/692285090 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ea8071030 con 0x7f0ea80c9fa0 2023-06-10T19:00:21.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.392+0000 7f0ea6ffd640 1 -- 172.21.15.53:0/692285090 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f0e98001680 con 0x7f0ea80c9fa0 2023-06-10T19:00:21.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.392+0000 7f0ea6ffd640 1 -- 172.21.15.53:0/692285090 >> v1:172.21.15.53:6789/0 conn(0x7f0ea80c9fa0 legacy=0x7f0ea806bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:21.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.392+0000 7f0ea6ffd640 1 --2- 172.21.15.53:0/692285090 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e940039d0 0x7f0e94003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:21.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.392+0000 7f0ea6ffd640 1 --2- 172.21.15.53:0/692285090 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0e940047d0 0x7f0e94004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:21.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.392+0000 7f0ea6ffd640 1 --2- 172.21.15.53:0/692285090 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0e940051d0 0x7f0e9400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:21.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.392+0000 7f0ea6ffd640 1 -- 172.21.15.53:0/692285090 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea8070d50 con 0x7f0e940039d0 2023-06-10T19:00:21.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.392+0000 7f0ea6ffd640 1 -- 172.21.15.53:0/692285090 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9400c0e0 con 0x7f0e940047d0 2023-06-10T19:00:21.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.392+0000 7f0ea6ffd640 1 -- 172.21.15.53:0/692285090 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9400c2a0 con 0x7f0e940051d0 2023-06-10T19:00:21.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.392+0000 7f0ea7fff640 1 --2- 172.21.15.53:0/692285090 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e940039d0 0x7f0e94003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:21.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.392+0000 7f0eacf4a640 1 --2- 172.21.15.53:0/692285090 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0e940051d0 0x7f0e9400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:21.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.392+0000 7f0ea77fe640 1 --2- 172.21.15.53:0/692285090 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0e940047d0 0x7f0e94004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:21.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.392+0000 7f0ea7fff640 1 -- 172.21.15.53:0/692285090 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0e940051d0 msgr2=0x7f0e9400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:21.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.392+0000 7f0ea7fff640 1 --2- 172.21.15.53:0/692285090 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0e940051d0 0x7f0e9400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:21.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.392+0000 7f0ea7fff640 1 -- 172.21.15.53:0/692285090 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0e940047d0 msgr2=0x7f0e94004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:21.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.392+0000 7f0ea7fff640 1 --2- 172.21.15.53:0/692285090 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0e940047d0 0x7f0e94004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:21.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.392+0000 7f0eacf4a640 1 -- 172.21.15.53:0/692285090 reap_dead start 2023-06-10T19:00:21.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.392+0000 7f0ea7fff640 1 -- 172.21.15.53:0/692285090 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e94003530 con 0x7f0e940039d0 2023-06-10T19:00:21.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.396+0000 7f0ea7fff640 1 --2- 172.21.15.53:0/692285090 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e940039d0 0x7f0e94003de0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f0e9800c0e0 tx=0x7f0e9801cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7e3809cd296f252 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:21.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.396+0000 7f0ea6ffd640 1 -- 172.21.15.53:0/692285090 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e98005ae0 con 0x7f0e940039d0 2023-06-10T19:00:21.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.396+0000 7f0ea6ffd640 1 -- 172.21.15.53:0/692285090 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e98005c40 con 0x7f0e940039d0 2023-06-10T19:00:21.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.396+0000 7f0ea6ffd640 1 -- 172.21.15.53:0/692285090 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e980a5a70 con 0x7f0e940039d0 2023-06-10T19:00:21.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.396+0000 7f0eae9ad640 1 -- 172.21.15.53:0/692285090 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e940039d0 msgr2=0x7f0e94003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:21.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.396+0000 7f0eae9ad640 1 --2- 172.21.15.53:0/692285090 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e940039d0 0x7f0e94003de0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f0e9800c0e0 tx=0x7f0e9801cab0 comp rx=0 tx=0).stop 2023-06-10T19:00:21.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.396+0000 7f0eae9ad640 1 -- 172.21.15.53:0/692285090 shutdown_connections 2023-06-10T19:00:21.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.396+0000 7f0eae9ad640 1 --2- 172.21.15.53:0/692285090 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e940039d0 0x7f0e94003de0 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:21.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.396+0000 7f0eae9ad640 1 -- 172.21.15.53:0/692285090 >> 172.21.15.53:0/692285090 conn(0x7f0ea806a0e0 msgr2=0x7f0ea80cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:21.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.396+0000 7f0eae9ad640 1 -- 172.21.15.53:0/692285090 shutdown_connections 2023-06-10T19:00:21.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.396+0000 7f0eae9ad640 1 -- 172.21.15.53:0/692285090 wait complete. 2023-06-10T19:00:21.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.396+0000 7f0eae9ad640 1 Processor -- start 2023-06-10T19:00:21.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.396+0000 7f0eae9ad640 1 -- start start 2023-06-10T19:00:21.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.396+0000 7f0eae9ad640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0e940039d0 0x7f0ea80c3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:21.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.396+0000 7f0eae9ad640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0ea8151f60 0x7f0ea81e4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:21.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.396+0000 7f0eae9ad640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ea81523b0 0x7f0ea81e4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:21.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.396+0000 7f0eae9ad640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea81e4cd0 con 0x7f0ea81523b0 2023-06-10T19:00:21.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.396+0000 7f0eae9ad640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea815ced0 con 0x7f0e940039d0 2023-06-10T19:00:21.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.396+0000 7f0eae9ad640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea80c5770 con 0x7f0ea8151f60 2023-06-10T19:00:21.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.396+0000 7f0eacf4a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ea81523b0 0x7f0ea81e4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:21.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.400+0000 7f0ea7fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0e940039d0 0x7f0ea80c3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:21.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.400+0000 7f0eacf4a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ea81523b0 0x7f0ea81e4790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33198/0 (socket says 172.21.15.53:33198) 2023-06-10T19:00:21.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.400+0000 7f0eacf4a640 1 -- 172.21.15.53:0/4079391787 learned_addr learned my addr 172.21.15.53:0/4079391787 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:21.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.400+0000 7f0ea77fe640 1 --2- 172.21.15.53:0/4079391787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0ea8151f60 0x7f0ea81e4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:21.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.400+0000 7f0eacf4a640 1 -- 172.21.15.53:0/4079391787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0ea8151f60 msgr2=0x7f0ea81e4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:21.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.400+0000 7f0eacf4a640 1 --2- 172.21.15.53:0/4079391787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0ea8151f60 0x7f0ea81e4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:21.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.400+0000 7f0eacf4a640 1 -- 172.21.15.53:0/4079391787 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0e940039d0 msgr2=0x7f0ea80c3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:21.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.400+0000 7f0eacf4a640 1 --2- 172.21.15.53:0/4079391787 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0e940039d0 0x7f0ea80c3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:21.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.400+0000 7f0eacf4a640 1 -- 172.21.15.53:0/4079391787 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ea80c5a50 con 0x7f0ea81523b0 2023-06-10T19:00:21.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.400+0000 7f0eacf4a640 1 --2- 172.21.15.53:0/4079391787 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ea81523b0 0x7f0ea81e4790 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f0ea80b0260 tx=0x7f0ea0007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:21.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.400+0000 7f0ea4ff9640 1 -- 172.21.15.53:0/4079391787 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea000e070 con 0x7f0ea81523b0 2023-06-10T19:00:21.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.400+0000 7f0ea4ff9640 1 -- 172.21.15.53:0/4079391787 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ea0003c70 con 0x7f0ea81523b0 2023-06-10T19:00:21.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.400+0000 7f0eae9ad640 1 -- 172.21.15.53:0/4079391787 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ea80c5d30 con 0x7f0ea81523b0 2023-06-10T19:00:21.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.400+0000 7f0ea4ff9640 1 -- 172.21.15.53:0/4079391787 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea0003e60 con 0x7f0ea81523b0 2023-06-10T19:00:21.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.400+0000 7f0eae9ad640 1 -- 172.21.15.53:0/4079391787 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ea80c3e70 con 0x7f0ea81523b0 2023-06-10T19:00:21.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.400+0000 7f0eae9ad640 1 -- 172.21.15.53:0/4079391787 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ea804d790 con 0x7f0ea81523b0 2023-06-10T19:00:21.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.400+0000 7f0ea4ff9640 1 -- 172.21.15.53:0/4079391787 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0ea0004030 con 0x7f0ea81523b0 2023-06-10T19:00:21.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.400+0000 7f0ea4ff9640 1 --2- 172.21.15.53:0/4079391787 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0e88066280 0x7f0e88068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:21.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.400+0000 7f0ea4ff9640 1 -- 172.21.15.53:0/4079391787 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0ea0083a50 con 0x7f0ea81523b0 2023-06-10T19:00:21.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.400+0000 7f0ea7fff640 1 --2- 172.21.15.53:0/4079391787 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0e88066280 0x7f0e88068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:21.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.400+0000 7f0ea7fff640 1 --2- 172.21.15.53:0/4079391787 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0e88066280 0x7f0e88068730 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f0e980ab000 tx=0x7f0e980a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:21.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.404+0000 7f0ea4ff9640 1 -- 172.21.15.53:0/4079391787 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0ea0050f80 con 0x7f0ea81523b0 2023-06-10T19:00:21.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:21.592+0000 7f0eae9ad640 1 -- 172.21.15.53:0/4079391787 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f0ea80c61e0 con 0x7f0ea81523b0 2023-06-10T19:00:22.177 INFO:tasks.ceph.mds.c.smithi053.stderr:2023-06-10T19:00:22.172+0000 7f3b2b9b2640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-06-10T19:00:22.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:22.264+0000 7f0ea4ff9640 1 -- 172.21.15.53:0/4079391787 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v32) v1 ==== 118+0+0 (secure 0 0 0) 0x7f0ea00545a0 con 0x7f0ea81523b0 2023-06-10T19:00:22.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:22.268+0000 7f0eae9ad640 1 -- 172.21.15.53:0/4079391787 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0e88066280 msgr2=0x7f0e88068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:22.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:22.268+0000 7f0eae9ad640 1 --2- 172.21.15.53:0/4079391787 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0e88066280 0x7f0e88068730 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f0e980ab000 tx=0x7f0e980a7070 comp rx=0 tx=0).stop 2023-06-10T19:00:22.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:22.268+0000 7f0eae9ad640 1 -- 172.21.15.53:0/4079391787 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ea81523b0 msgr2=0x7f0ea81e4790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:22.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:22.268+0000 7f0eae9ad640 1 --2- 172.21.15.53:0/4079391787 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ea81523b0 0x7f0ea81e4790 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f0ea80b0260 tx=0x7f0ea0007dd0 comp rx=0 tx=0).stop 2023-06-10T19:00:22.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:22.268+0000 7f0eae9ad640 1 -- 172.21.15.53:0/4079391787 shutdown_connections 2023-06-10T19:00:22.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:22.268+0000 7f0eae9ad640 1 --2- 172.21.15.53:0/4079391787 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0e88066280 0x7f0e88068730 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:22.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:22.268+0000 7f0eae9ad640 1 --2- 172.21.15.53:0/4079391787 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ea81523b0 0x7f0ea81e4790 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:22.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:22.268+0000 7f0eae9ad640 1 --2- 172.21.15.53:0/4079391787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0ea8151f60 0x7f0ea81e4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:22.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:22.268+0000 7f0eae9ad640 1 --2- 172.21.15.53:0/4079391787 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0e940039d0 0x7f0ea80c3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:22.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:22.268+0000 7f0eae9ad640 1 -- 172.21.15.53:0/4079391787 >> 172.21.15.53:0/4079391787 conn(0x7f0ea806a0e0 msgr2=0x7f0ea8158fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:22.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:22.268+0000 7f0eae9ad640 1 -- 172.21.15.53:0/4079391787 shutdown_connections 2023-06-10T19:00:22.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:22.268+0000 7f0eae9ad640 1 -- 172.21.15.53:0/4079391787 wait complete. 2023-06-10T19:00:22.296 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-06-10T19:00:22.296 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-06-10T19:00:22.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:22.424+0000 7ffb5cb86640 1 Processor -- start 2023-06-10T19:00:22.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:22.424+0000 7ffb5cb86640 1 -- start start 2023-06-10T19:00:22.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:22.424+0000 7ffb5cb86640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ffb5815c060 0x7ffb580cc020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:22.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:22.424+0000 7ffb5cb86640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb5815cb40 0x7ffb5806bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:22.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:22.424+0000 7ffb5cb86640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb5815cf60 con 0x7ffb58070de0 2023-06-10T19:00:22.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:22.424+0000 7ffb5cb86640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb580c8d50 con 0x7ffb5815c060 2023-06-10T19:00:22.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:22.424+0000 7ffb5cb86640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb580c9030 con 0x7ffb5815cb40 2023-06-10T19:00:22.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:22.424+0000 7ffb5659c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ffb5815c060 0x7ffb580cc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:22.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:22.424+0000 7ffb5659c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ffb5815c060 0x7ffb580cc020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33204/0 (socket says 172.21.15.53:33204) 2023-06-10T19:00:22.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:22.424+0000 7ffb5659c640 1 -- 172.21.15.53:0/3025594550 learned_addr learned my addr 172.21.15.53:0/3025594550 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:22.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:22.424+0000 7ffb56d9d640 1 --2- 172.21.15.53:0/3025594550 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb5815cb40 0x7ffb5806bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:22.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:22.424+0000 7ffb5659c640 1 -- 172.21.15.53:0/3025594550 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb5815cb40 msgr2=0x7ffb5806bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:22.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:22.424+0000 7ffb5659c640 1 --2- 172.21.15.53:0/3025594550 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb5815cb40 0x7ffb5806bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:22.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:22.424+0000 7ffb5659c640 1 -- 172.21.15.53:0/3025594550 >> v1:172.21.15.117:6789/0 conn(0x7ffb58070de0 legacy=0x7ffb5815c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:22.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:22.424+0000 7ffb5659c640 1 -- 172.21.15.53:0/3025594550 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb58070300 con 0x7ffb5815c060 2023-06-10T19:00:22.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:22.424+0000 7ffb56d9d640 1 --2- 172.21.15.53:0/3025594550 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb5815cb40 0x7ffb5806bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:00:22.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:22.428+0000 7ffb5659c640 1 --2- 172.21.15.53:0/3025594550 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb5815c060 0x7ffb580cc020 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7ffb48009e50 tx=0x7ffb4801c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d93869c6a8854e9 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:22.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:22.428+0000 7ffb5559a640 1 -- 172.21.15.53:0/3025594550 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb480a5750 con 0x7ffb5815c060 2023-06-10T19:00:22.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:22.428+0000 7ffb5559a640 1 -- 172.21.15.53:0/3025594550 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb480a58b0 con 0x7ffb5815c060 2023-06-10T19:00:22.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:22.428+0000 7ffb5559a640 1 -- 172.21.15.53:0/3025594550 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb480a5c40 con 0x7ffb5815c060 2023-06-10T19:00:22.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:22.428+0000 7ffb5cb86640 1 -- 172.21.15.53:0/3025594550 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb5815c060 msgr2=0x7ffb580cc020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:22.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:22.428+0000 7ffb5cb86640 1 --2- 172.21.15.53:0/3025594550 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb5815c060 0x7ffb580cc020 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7ffb48009e50 tx=0x7ffb4801c980 comp rx=0 tx=0).stop 2023-06-10T19:00:22.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:22.428+0000 7ffb5cb86640 1 -- 172.21.15.53:0/3025594550 shutdown_connections 2023-06-10T19:00:22.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:22.428+0000 7ffb5cb86640 1 --2- 172.21.15.53:0/3025594550 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb5815cb40 0x7ffb5806bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:22.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:22.428+0000 7ffb5cb86640 1 --2- 172.21.15.53:0/3025594550 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb5815c060 0x7ffb580cc020 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:22.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:22.428+0000 7ffb5cb86640 1 -- 172.21.15.53:0/3025594550 >> 172.21.15.53:0/3025594550 conn(0x7ffb5806a0e0 msgr2=0x7ffb580cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:22.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:22.428+0000 7ffb5cb86640 1 -- 172.21.15.53:0/3025594550 shutdown_connections 2023-06-10T19:00:22.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:22.428+0000 7ffb5cb86640 1 -- 172.21.15.53:0/3025594550 wait complete. 2023-06-10T19:00:22.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:22.428+0000 7ffb5cb86640 1 Processor -- start 2023-06-10T19:00:22.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:22.428+0000 7ffb5cb86640 1 -- start start 2023-06-10T19:00:22.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:22.432+0000 7ffb5cb86640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb58070de0 0x7ffb581f4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:22.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:22.432+0000 7ffb5cb86640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb5815c060 0x7ffb580cd270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:22.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:22.432+0000 7ffb5cb86640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb5815cb40 0x7ffb580b0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:22.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:22.432+0000 7ffb5cb86640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb581f4c50 con 0x7ffb58070de0 2023-06-10T19:00:22.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:22.432+0000 7ffb5cb86640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb581f49a0 con 0x7ffb5815c060 2023-06-10T19:00:22.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:22.432+0000 7ffb5cb86640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb58161630 con 0x7ffb5815cb40 2023-06-10T19:00:22.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:22.432+0000 7ffb5659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb58070de0 0x7ffb581f4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:22.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:22.432+0000 7ffb5659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb58070de0 0x7ffb581f4460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33208/0 (socket says 172.21.15.53:33208) 2023-06-10T19:00:22.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:22.432+0000 7ffb5659c640 1 -- 172.21.15.53:0/1063110320 learned_addr learned my addr 172.21.15.53:0/1063110320 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:22.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:22.432+0000 7ffb56d9d640 1 --2- 172.21.15.53:0/1063110320 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb5815cb40 0x7ffb580b0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:22.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:22.432+0000 7ffb5659c640 1 -- 172.21.15.53:0/1063110320 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb5815cb40 msgr2=0x7ffb580b0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:22.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:22.432+0000 7ffb5659c640 1 --2- 172.21.15.53:0/1063110320 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb5815cb40 0x7ffb580b0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:22.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:22.432+0000 7ffb5659c640 1 -- 172.21.15.53:0/1063110320 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb5815c060 msgr2=0x7ffb580cd270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:22.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:22.432+0000 7ffb55d9b640 1 --2- 172.21.15.53:0/1063110320 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb5815c060 0x7ffb580cd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:22.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:22.432+0000 7ffb5659c640 1 --2- 172.21.15.53:0/1063110320 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb5815c060 0x7ffb580cd270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:22.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:22.432+0000 7ffb5659c640 1 -- 172.21.15.53:0/1063110320 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb48009b30 con 0x7ffb58070de0 2023-06-10T19:00:22.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:22.432+0000 7ffb5659c640 1 --2- 172.21.15.53:0/1063110320 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb58070de0 0x7ffb581f4460 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7ffb4801a5b0 tx=0x7ffb48019720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:22.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:22.432+0000 7ffb46ffd640 1 -- 172.21.15.53:0/1063110320 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb480b8670 con 0x7ffb58070de0 2023-06-10T19:00:22.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:22.432+0000 7ffb46ffd640 1 -- 172.21.15.53:0/1063110320 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb480b87d0 con 0x7ffb58070de0 2023-06-10T19:00:22.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:22.432+0000 7ffb5cb86640 1 -- 172.21.15.53:0/1063110320 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb58161910 con 0x7ffb58070de0 2023-06-10T19:00:22.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:22.432+0000 7ffb46ffd640 1 -- 172.21.15.53:0/1063110320 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb480b8b60 con 0x7ffb58070de0 2023-06-10T19:00:22.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:22.432+0000 7ffb5cb86640 1 -- 172.21.15.53:0/1063110320 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb58161ed0 con 0x7ffb58070de0 2023-06-10T19:00:22.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:22.432+0000 7ffb5cb86640 1 -- 172.21.15.53:0/1063110320 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb58162060 con 0x7ffb58070de0 2023-06-10T19:00:22.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:22.432+0000 7ffb46ffd640 1 -- 172.21.15.53:0/1063110320 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ffb480b8cc0 con 0x7ffb58070de0 2023-06-10T19:00:22.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:22.432+0000 7ffb46ffd640 1 --2- 172.21.15.53:0/1063110320 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ffb38066280 0x7ffb38068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:22.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:22.432+0000 7ffb46ffd640 1 -- 172.21.15.53:0/1063110320 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ffb4811f470 con 0x7ffb58070de0 2023-06-10T19:00:22.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:22.436+0000 7ffb55d9b640 1 --2- 172.21.15.53:0/1063110320 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ffb38066280 0x7ffb38068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:22.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:22.436+0000 7ffb55d9b640 1 --2- 172.21.15.53:0/1063110320 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ffb38066280 0x7ffb38068730 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7ffb580c7b70 tx=0x7ffb4c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:22.445 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:22.436+0000 7ffb46ffd640 1 -- 172.21.15.53:0/1063110320 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ffb480eca60 con 0x7ffb58070de0 2023-06-10T19:00:22.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:22.628+0000 7ffb5cb86640 1 -- 172.21.15.53:0/1063110320 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7ffb5804d790 con 0x7ffb58070de0 2023-06-10T19:00:23.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.620+0000 7ffb46ffd640 1 -- 172.21.15.53:0/1063110320 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v33) v1 ==== 122+0+0 (secure 0 0 0) 0x7ffb480f0080 con 0x7ffb58070de0 2023-06-10T19:00:23.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.624+0000 7ffb5cb86640 1 -- 172.21.15.53:0/1063110320 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ffb38066280 msgr2=0x7ffb38068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:23.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.624+0000 7ffb5cb86640 1 --2- 172.21.15.53:0/1063110320 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ffb38066280 0x7ffb38068730 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7ffb580c7b70 tx=0x7ffb4c009040 comp rx=0 tx=0).stop 2023-06-10T19:00:23.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.624+0000 7ffb5cb86640 1 -- 172.21.15.53:0/1063110320 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb58070de0 msgr2=0x7ffb581f4460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:23.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.624+0000 7ffb5cb86640 1 --2- 172.21.15.53:0/1063110320 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb58070de0 0x7ffb581f4460 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7ffb4801a5b0 tx=0x7ffb48019720 comp rx=0 tx=0).stop 2023-06-10T19:00:23.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.624+0000 7ffb5cb86640 1 -- 172.21.15.53:0/1063110320 shutdown_connections 2023-06-10T19:00:23.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.624+0000 7ffb5cb86640 1 --2- 172.21.15.53:0/1063110320 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ffb38066280 0x7ffb38068730 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:23.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.624+0000 7ffb5cb86640 1 --2- 172.21.15.53:0/1063110320 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb5815cb40 0x7ffb580b0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:23.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.624+0000 7ffb5cb86640 1 --2- 172.21.15.53:0/1063110320 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb5815c060 0x7ffb580cd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:23.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.624+0000 7ffb5cb86640 1 --2- 172.21.15.53:0/1063110320 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb58070de0 0x7ffb581f4460 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:23.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.624+0000 7ffb5cb86640 1 -- 172.21.15.53:0/1063110320 >> 172.21.15.53:0/1063110320 conn(0x7ffb5806a0e0 msgr2=0x7ffb5815c430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:23.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.624+0000 7ffb5cb86640 1 -- 172.21.15.53:0/1063110320 shutdown_connections 2023-06-10T19:00:23.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.624+0000 7ffb5cb86640 1 -- 172.21.15.53:0/1063110320 wait complete. 2023-06-10T19:00:23.654 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-06-10T19:00:23.654 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:00:23.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.780+0000 7ffbad676640 1 Processor -- start 2023-06-10T19:00:23.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.780+0000 7ffbad676640 1 -- start start 2023-06-10T19:00:23.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.784+0000 7ffbad676640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ffba80cb870 0x7ffba80af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:23.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.784+0000 7ffbad676640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffba80afc60 0x7ffba80aba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:23.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.784+0000 7ffbad676640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffba81600d0 con 0x7ffba80c9750 2023-06-10T19:00:23.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.784+0000 7ffbad676640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffba80cd990 con 0x7ffba80cb870 2023-06-10T19:00:23.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.784+0000 7ffbad676640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffba80b00e0 con 0x7ffba80afc60 2023-06-10T19:00:23.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.784+0000 7ffba67fc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ffba80cb870 0x7ffba80af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:23.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.784+0000 7ffba6ffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ffba80c9750 0x7ffba80aced0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:33714/0 (socket says 172.21.15.53:33714) 2023-06-10T19:00:23.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.784+0000 7ffba6ffd640 1 -- 172.21.15.53:0/3575848471 learned_addr learned my addr 172.21.15.53:0/3575848471 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:00:23.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.784+0000 7ffba77fe640 1 --2- 172.21.15.53:0/3575848471 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffba80afc60 0x7ffba80aba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:23.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.784+0000 7ffba67fc640 1 -- 172.21.15.53:0/3575848471 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffba80afc60 msgr2=0x7ffba80aba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:23.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.784+0000 7ffba67fc640 1 --2- 172.21.15.53:0/3575848471 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffba80afc60 0x7ffba80aba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:23.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.784+0000 7ffba67fc640 1 -- 172.21.15.53:0/3575848471 >> v1:172.21.15.53:6789/0 conn(0x7ffba80c9750 legacy=0x7ffba80aced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:23.791 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.784+0000 7ffba67fc640 1 -- 172.21.15.53:0/3575848471 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffba8160370 con 0x7ffba80cb870 2023-06-10T19:00:23.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.784+0000 7ffba67fc640 1 --2- 172.21.15.53:0/3575848471 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffba80cb870 0x7ffba80af720 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7ffb98009d90 tx=0x7ffb9801c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ccd56c926c5fb02 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:23.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.784+0000 7ffba5ffb640 1 -- 172.21.15.53:0/3575848471 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb980a5a30 con 0x7ffba80cb870 2023-06-10T19:00:23.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.784+0000 7ffba5ffb640 1 -- 172.21.15.53:0/3575848471 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb980a5b90 con 0x7ffba80cb870 2023-06-10T19:00:23.793 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.784+0000 7ffba5ffb640 1 -- 172.21.15.53:0/3575848471 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb980ad440 con 0x7ffba80cb870 2023-06-10T19:00:23.793 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.788+0000 7ffbad676640 1 -- 172.21.15.53:0/3575848471 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffba80cb870 msgr2=0x7ffba80af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:23.793 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.788+0000 7ffbad676640 1 --2- 172.21.15.53:0/3575848471 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffba80cb870 0x7ffba80af720 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7ffb98009d90 tx=0x7ffb9801c950 comp rx=0 tx=0).stop 2023-06-10T19:00:23.793 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.788+0000 7ffbad676640 1 -- 172.21.15.53:0/3575848471 shutdown_connections 2023-06-10T19:00:23.794 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.788+0000 7ffbad676640 1 --2- 172.21.15.53:0/3575848471 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffba80cb870 0x7ffba80af720 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:23.794 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.788+0000 7ffbad676640 1 --2- 172.21.15.53:0/3575848471 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffba80afc60 0x7ffba80aba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:23.794 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.788+0000 7ffbad676640 1 -- 172.21.15.53:0/3575848471 >> 172.21.15.53:0/3575848471 conn(0x7ffba806a0d0 msgr2=0x7ffba80ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:23.795 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.788+0000 7ffbad676640 1 -- 172.21.15.53:0/3575848471 shutdown_connections 2023-06-10T19:00:23.795 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.788+0000 7ffbad676640 1 -- 172.21.15.53:0/3575848471 wait complete. 2023-06-10T19:00:23.799 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.788+0000 7ffbad676640 1 Processor -- start 2023-06-10T19:00:23.799 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.788+0000 7ffbad676640 1 -- start start 2023-06-10T19:00:23.799 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.788+0000 7ffbad676640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffba80afc60 0x7ffba81536d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:23.799 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.788+0000 7ffbad676640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffba80c9750 0x7ffba8156340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:23.800 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.788+0000 7ffbad676640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffba80cb870 0x7ffba814d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:23.800 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.788+0000 7ffbad676640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffba81532b0 con 0x7ffba80c9750 2023-06-10T19:00:23.800 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.788+0000 7ffbad676640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffba8152630 con 0x7ffba80afc60 2023-06-10T19:00:23.800 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.788+0000 7ffbad676640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffba8152910 con 0x7ffba80cb870 2023-06-10T19:00:23.801 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.788+0000 7ffba67fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffba80c9750 0x7ffba8156340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:23.801 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.788+0000 7ffba67fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffba80c9750 0x7ffba8156340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33226/0 (socket says 172.21.15.53:33226) 2023-06-10T19:00:23.801 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.788+0000 7ffba67fc640 1 -- 172.21.15.53:0/1586804418 learned_addr learned my addr 172.21.15.53:0/1586804418 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:23.801 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.788+0000 7ffba77fe640 1 --2- 172.21.15.53:0/1586804418 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffba80cb870 0x7ffba814d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:23.802 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.788+0000 7ffba6ffd640 1 --2- 172.21.15.53:0/1586804418 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffba80afc60 0x7ffba81536d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:23.802 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.788+0000 7ffba67fc640 1 -- 172.21.15.53:0/1586804418 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffba80cb870 msgr2=0x7ffba814d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:23.802 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.788+0000 7ffba67fc640 1 --2- 172.21.15.53:0/1586804418 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffba80cb870 0x7ffba814d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:23.802 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.788+0000 7ffba67fc640 1 -- 172.21.15.53:0/1586804418 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffba80afc60 msgr2=0x7ffba81536d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:23.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.788+0000 7ffba67fc640 1 --2- 172.21.15.53:0/1586804418 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffba80afc60 0x7ffba81536d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:23.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.788+0000 7ffba67fc640 1 -- 172.21.15.53:0/1586804418 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb98009a70 con 0x7ffba80c9750 2023-06-10T19:00:23.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.788+0000 7ffba6ffd640 1 --2- 172.21.15.53:0/1586804418 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffba80afc60 0x7ffba81536d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:00:23.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.788+0000 7ffba67fc640 1 --2- 172.21.15.53:0/1586804418 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffba80c9750 0x7ffba8156340 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7ffb9801b000 tx=0x7ffb980196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:23.804 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.788+0000 7ffb9f7fe640 1 -- 172.21.15.53:0/1586804418 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb980a5a30 con 0x7ffba80c9750 2023-06-10T19:00:23.804 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.788+0000 7ffb9f7fe640 1 -- 172.21.15.53:0/1586804418 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb98009450 con 0x7ffba80c9750 2023-06-10T19:00:23.804 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.788+0000 7ffbad676640 1 -- 172.21.15.53:0/1586804418 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffba8152bf0 con 0x7ffba80c9750 2023-06-10T19:00:23.805 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.788+0000 7ffb9f7fe640 1 -- 172.21.15.53:0/1586804418 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb980b7650 con 0x7ffba80c9750 2023-06-10T19:00:23.805 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.788+0000 7ffbad676640 1 -- 172.21.15.53:0/1586804418 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffba8156880 con 0x7ffba80c9750 2023-06-10T19:00:23.805 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.792+0000 7ffbad676640 1 -- 172.21.15.53:0/1586804418 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffba81533f0 con 0x7ffba80c9750 2023-06-10T19:00:23.805 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.792+0000 7ffb9f7fe640 1 -- 172.21.15.53:0/1586804418 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ffb980b4050 con 0x7ffba80c9750 2023-06-10T19:00:23.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.792+0000 7ffb9f7fe640 1 --2- 172.21.15.53:0/1586804418 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ffb88066280 0x7ffb88068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:23.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.792+0000 7ffb9f7fe640 1 -- 172.21.15.53:0/1586804418 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ffb9811f0c0 con 0x7ffba80c9750 2023-06-10T19:00:23.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.792+0000 7ffba6ffd640 1 --2- 172.21.15.53:0/1586804418 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ffb88066280 0x7ffb88068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:23.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.792+0000 7ffba6ffd640 1 --2- 172.21.15.53:0/1586804418 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ffb88066280 0x7ffb88068730 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7ffba8153e90 tx=0x7ffb90009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:23.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.796+0000 7ffb9f7fe640 1 -- 172.21.15.53:0/1586804418 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ffba81533f0 con 0x7ffba80c9750 2023-06-10T19:00:23.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.984+0000 7ffbad676640 1 -- 172.21.15.53:0/1586804418 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffba81533f0 con 0x7ffba80c9750 2023-06-10T19:00:23.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.984+0000 7ffb9f7fe640 1 -- 172.21.15.53:0/1586804418 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4676 (secure 0 0 0) 0x7ffba81533f0 con 0x7ffba80c9750 2023-06-10T19:00:23.990 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:00:23.990 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":33,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5663,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2600814414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2600814414},{"type":"v1","addr":"172.21.15.117:6835","nonce":2600814414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6136,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1615882017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1615882017},{"type":"v1","addr":"172.21.15.117:6837","nonce":1615882017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6993,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/3732245174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3732245174},{"type":"v1","addr":"172.21.15.53:6833","nonce":3732245174}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:00:20.607950+0000","modified":"2023-06-10T19:00:23.616327+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7002},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7002":{"gid":7002,"name":"c","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/882186121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":882186121},{"type":"v1","addr":"172.21.15.53:6835","nonce":882186121}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-06-10T19:00:23.991 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 33 2023-06-10T19:00:23.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.988+0000 7ffbad676640 1 -- 172.21.15.53:0/1586804418 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ffb88066280 msgr2=0x7ffb88068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:23.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.988+0000 7ffbad676640 1 --2- 172.21.15.53:0/1586804418 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ffb88066280 0x7ffb88068730 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7ffba8153e90 tx=0x7ffb90009040 comp rx=0 tx=0).stop 2023-06-10T19:00:23.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.988+0000 7ffbad676640 1 -- 172.21.15.53:0/1586804418 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffba80c9750 msgr2=0x7ffba8156340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:23.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.988+0000 7ffbad676640 1 --2- 172.21.15.53:0/1586804418 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffba80c9750 0x7ffba8156340 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7ffb9801b000 tx=0x7ffb980196f0 comp rx=0 tx=0).stop 2023-06-10T19:00:23.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.988+0000 7ffbad676640 1 -- 172.21.15.53:0/1586804418 shutdown_connections 2023-06-10T19:00:23.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.988+0000 7ffbad676640 1 --2- 172.21.15.53:0/1586804418 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ffb88066280 0x7ffb88068730 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:23.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.988+0000 7ffbad676640 1 --2- 172.21.15.53:0/1586804418 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffba80cb870 0x7ffba814d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:23.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.988+0000 7ffbad676640 1 --2- 172.21.15.53:0/1586804418 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffba80c9750 0x7ffba8156340 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:23.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.988+0000 7ffbad676640 1 --2- 172.21.15.53:0/1586804418 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffba80afc60 0x7ffba81536d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:23.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.988+0000 7ffbad676640 1 -- 172.21.15.53:0/1586804418 >> 172.21.15.53:0/1586804418 conn(0x7ffba806a0d0 msgr2=0x7ffba8154f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:23.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.988+0000 7ffbad676640 1 -- 172.21.15.53:0/1586804418 shutdown_connections 2023-06-10T19:00:23.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:23.988+0000 7ffbad676640 1 -- 172.21.15.53:0/1586804418 wait complete. 2023-06-10T19:00:24.009 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:00:24.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.124+0000 7fac57dab640 1 Processor -- start 2023-06-10T19:00:24.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.124+0000 7fac57dab640 1 -- start start 2023-06-10T19:00:24.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.124+0000 7fac57dab640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fac500c9840 0x7fac500c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:24.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.124+0000 7fac57dab640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fac50071060 0x7fac500af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:24.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.124+0000 7fac57dab640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fac500afc60 0x7fac5015d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:24.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.124+0000 7fac57dab640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac50159b50 con 0x7fac500afc60 2023-06-10T19:00:24.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.124+0000 7fac57dab640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac500ca150 con 0x7fac50071060 2023-06-10T19:00:24.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.124+0000 7fac57dab640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac500702a0 con 0x7fac500c9840 2023-06-10T19:00:24.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.124+0000 7fac56348640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fac500afc60 0x7fac5015d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:24.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.124+0000 7fac56348640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fac500afc60 0x7fac5015d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33234/0 (socket says 172.21.15.53:33234) 2023-06-10T19:00:24.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.124+0000 7fac56348640 1 -- 172.21.15.53:0/2733527147 learned_addr learned my addr 172.21.15.53:0/2733527147 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:24.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.124+0000 7fac55b47640 1 --2- 172.21.15.53:0/2733527147 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fac500c9840 0x7fac500c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:24.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.124+0000 7fac55346640 1 --2- 172.21.15.53:0/2733527147 >> v2:172.21.15.117:3300/0 conn(0x7fac50071060 0x7fac500af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:24.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.124+0000 7fac56348640 1 -- 172.21.15.53:0/2733527147 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fac500c9840 msgr2=0x7fac500c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:24.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.124+0000 7fac56348640 1 --2- 172.21.15.53:0/2733527147 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fac500c9840 0x7fac500c9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:24.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.124+0000 7fac56348640 1 -- 172.21.15.53:0/2733527147 >> v2:172.21.15.117:3300/0 conn(0x7fac50071060 msgr2=0x7fac500af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:24.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.124+0000 7fac56348640 1 --2- 172.21.15.53:0/2733527147 >> v2:172.21.15.117:3300/0 conn(0x7fac50071060 0x7fac500af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:24.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.124+0000 7fac56348640 1 -- 172.21.15.53:0/2733527147 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac50070580 con 0x7fac500afc60 2023-06-10T19:00:24.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.128+0000 7fac56348640 1 --2- 172.21.15.53:0/2733527147 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac500afc60 0x7fac5015d2c0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7fac5006e560 tx=0x7fac4801c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=638dbb94cdf6e4c9 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:24.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.128+0000 7fac54b45640 1 -- 172.21.15.53:0/2733527147 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac480a5560 con 0x7fac500afc60 2023-06-10T19:00:24.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.128+0000 7fac54b45640 1 -- 172.21.15.53:0/2733527147 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac480a56c0 con 0x7fac500afc60 2023-06-10T19:00:24.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.128+0000 7fac54b45640 1 -- 172.21.15.53:0/2733527147 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac480a5a50 con 0x7fac500afc60 2023-06-10T19:00:24.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.128+0000 7fac57dab640 1 -- 172.21.15.53:0/2733527147 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac500afc60 msgr2=0x7fac5015d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:24.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.128+0000 7fac57dab640 1 --2- 172.21.15.53:0/2733527147 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac500afc60 0x7fac5015d2c0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7fac5006e560 tx=0x7fac4801c6e0 comp rx=0 tx=0).stop 2023-06-10T19:00:24.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.128+0000 7fac57dab640 1 -- 172.21.15.53:0/2733527147 shutdown_connections 2023-06-10T19:00:24.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.128+0000 7fac57dab640 1 --2- 172.21.15.53:0/2733527147 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac500afc60 0x7fac5015d2c0 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:24.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.128+0000 7fac57dab640 1 --2- 172.21.15.53:0/2733527147 >> v2:172.21.15.117:3300/0 conn(0x7fac50071060 0x7fac500af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:24.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.128+0000 7fac57dab640 1 --2- 172.21.15.53:0/2733527147 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fac500c9840 0x7fac500c9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:24.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.128+0000 7fac57dab640 1 -- 172.21.15.53:0/2733527147 >> 172.21.15.53:0/2733527147 conn(0x7fac5006a0d0 msgr2=0x7fac500ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:24.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.128+0000 7fac57dab640 1 -- 172.21.15.53:0/2733527147 shutdown_connections 2023-06-10T19:00:24.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.128+0000 7fac57dab640 1 -- 172.21.15.53:0/2733527147 wait complete. 2023-06-10T19:00:24.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.128+0000 7fac57dab640 1 Processor -- start 2023-06-10T19:00:24.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.128+0000 7fac57dab640 1 -- start start 2023-06-10T19:00:24.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.132+0000 7fac57dab640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fac50071060 0x7fac5015b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:24.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.132+0000 7fac57dab640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fac500afc60 0x7fac500cd240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:24.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.132+0000 7fac57dab640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac500c9840 0x7fac5014fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:24.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.132+0000 7fac57dab640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac500cd780 con 0x7fac500c9840 2023-06-10T19:00:24.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.132+0000 7fac57dab640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac5015af30 con 0x7fac500afc60 2023-06-10T19:00:24.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.132+0000 7fac57dab640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac500ccc90 con 0x7fac50071060 2023-06-10T19:00:24.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.132+0000 7fac56348640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac500c9840 0x7fac5014fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:24.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.132+0000 7fac56348640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac500c9840 0x7fac5014fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33248/0 (socket says 172.21.15.53:33248) 2023-06-10T19:00:24.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.132+0000 7fac56348640 1 -- 172.21.15.53:0/271859222 learned_addr learned my addr 172.21.15.53:0/271859222 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:24.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.132+0000 7fac55b47640 1 --2- 172.21.15.53:0/271859222 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fac50071060 0x7fac5015b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:24.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.132+0000 7fac56348640 1 -- 172.21.15.53:0/271859222 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fac50071060 msgr2=0x7fac5015b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:24.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.132+0000 7fac56348640 1 --2- 172.21.15.53:0/271859222 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fac50071060 0x7fac5015b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:24.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.132+0000 7fac55346640 1 --2- 172.21.15.53:0/271859222 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fac500afc60 0x7fac500cd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:24.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.132+0000 7fac56348640 1 -- 172.21.15.53:0/271859222 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fac500afc60 msgr2=0x7fac500cd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:24.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.132+0000 7fac56348640 1 --2- 172.21.15.53:0/271859222 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fac500afc60 0x7fac500cd240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:24.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.132+0000 7fac56348640 1 -- 172.21.15.53:0/271859222 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac48009b30 con 0x7fac500c9840 2023-06-10T19:00:24.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.132+0000 7fac56348640 1 --2- 172.21.15.53:0/271859222 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac500c9840 0x7fac5014fbd0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7fac480af040 tx=0x7fac48019480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:24.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.132+0000 7fac467fc640 1 -- 172.21.15.53:0/271859222 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac480b8670 con 0x7fac500c9840 2023-06-10T19:00:24.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.132+0000 7fac467fc640 1 -- 172.21.15.53:0/271859222 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac480b87d0 con 0x7fac500c9840 2023-06-10T19:00:24.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.132+0000 7fac57dab640 1 -- 172.21.15.53:0/271859222 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac5015b180 con 0x7fac500c9840 2023-06-10T19:00:24.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.132+0000 7fac467fc640 1 -- 172.21.15.53:0/271859222 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac480b8b40 con 0x7fac500c9840 2023-06-10T19:00:24.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.132+0000 7fac57dab640 1 -- 172.21.15.53:0/271859222 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac500cc920 con 0x7fac500c9840 2023-06-10T19:00:24.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.132+0000 7fac57dab640 1 -- 172.21.15.53:0/271859222 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac500ccab0 con 0x7fac500c9840 2023-06-10T19:00:24.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.132+0000 7fac467fc640 1 -- 172.21.15.53:0/271859222 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fac480b8ca0 con 0x7fac500c9840 2023-06-10T19:00:24.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.132+0000 7fac467fc640 1 --2- 172.21.15.53:0/271859222 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fac34066280 0x7fac34068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:24.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.132+0000 7fac467fc640 1 -- 172.21.15.53:0/271859222 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fac4811f120 con 0x7fac500c9840 2023-06-10T19:00:24.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.132+0000 7fac55b47640 1 --2- 172.21.15.53:0/271859222 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fac34066280 0x7fac34068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:24.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.132+0000 7fac55b47640 1 --2- 172.21.15.53:0/271859222 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fac34066280 0x7fac34068730 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fac4c00b930 tx=0x7fac4c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:24.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.136+0000 7fac467fc640 1 -- 172.21.15.53:0/271859222 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fac480ec6e0 con 0x7fac500c9840 2023-06-10T19:00:24.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.288+0000 7fac57dab640 1 -- 172.21.15.53:0/271859222 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fac500cce00 con 0x7fac500c9840 2023-06-10T19:00:24.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.292+0000 7fac467fc640 1 -- 172.21.15.53:0/271859222 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+18342 (secure 0 0 0) 0x7fac48009510 con 0x7fac500c9840 2023-06-10T19:00:24.298 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:00:24.298 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":80,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:00:21.610926+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-06-10T19:00:19.188303+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-06-10T19:00:19.583756+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:00:24.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.292+0000 7fac57dab640 1 -- 172.21.15.53:0/271859222 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fac34066280 msgr2=0x7fac34068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:24.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.292+0000 7fac57dab640 1 --2- 172.21.15.53:0/271859222 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fac34066280 0x7fac34068730 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fac4c00b930 tx=0x7fac4c008040 comp rx=0 tx=0).stop 2023-06-10T19:00:24.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.292+0000 7fac57dab640 1 -- 172.21.15.53:0/271859222 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac500c9840 msgr2=0x7fac5014fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:24.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.292+0000 7fac57dab640 1 --2- 172.21.15.53:0/271859222 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac500c9840 0x7fac5014fbd0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7fac480af040 tx=0x7fac48019480 comp rx=0 tx=0).stop 2023-06-10T19:00:24.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.292+0000 7fac57dab640 1 -- 172.21.15.53:0/271859222 shutdown_connections 2023-06-10T19:00:24.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.292+0000 7fac57dab640 1 --2- 172.21.15.53:0/271859222 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fac34066280 0x7fac34068730 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:24.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.292+0000 7fac57dab640 1 --2- 172.21.15.53:0/271859222 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac500c9840 0x7fac5014fbd0 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:24.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.292+0000 7fac57dab640 1 --2- 172.21.15.53:0/271859222 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fac500afc60 0x7fac500cd240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:24.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.292+0000 7fac57dab640 1 --2- 172.21.15.53:0/271859222 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fac50071060 0x7fac5015b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:24.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.292+0000 7fac57dab640 1 -- 172.21.15.53:0/271859222 >> 172.21.15.53:0/271859222 conn(0x7fac5006a0d0 msgr2=0x7fac500abcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:24.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.296+0000 7fac57dab640 1 -- 172.21.15.53:0/271859222 shutdown_connections 2023-06-10T19:00:24.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.296+0000 7fac57dab640 1 -- 172.21.15.53:0/271859222 wait complete. 2023-06-10T19:00:24.315 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-06-10T19:00:24.316 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-10T19:00:24.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.424+0000 7fd72cc03640 1 Processor -- start 2023-06-10T19:00:24.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.424+0000 7fd72cc03640 1 -- start start 2023-06-10T19:00:24.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.424+0000 7fd72cc03640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd7280b0f30 0x7fd728070950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:24.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.424+0000 7fd72cc03640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7280cb080 con 0x7fd728159690 2023-06-10T19:00:24.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.424+0000 7fd72cc03640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7280cb320 con 0x7fd728159a60 2023-06-10T19:00:24.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.424+0000 7fd72cc03640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd728070e90 con 0x7fd7280b0f30 2023-06-10T19:00:24.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.424+0000 7fd72659c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fd728159690 0x7fd7280cbe00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:33716/0 (socket says 172.21.15.53:33716) 2023-06-10T19:00:24.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.424+0000 7fd72659c640 1 -- 172.21.15.53:0/4237109206 learned_addr learned my addr 172.21.15.53:0/4237109206 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:00:24.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.424+0000 7fd71dd9b640 1 --2- 172.21.15.53:0/4237109206 >> v2:172.21.15.117:3300/0 conn(0x7fd7280b0f30 0x7fd728070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:24.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.424+0000 7fd725d9b640 1 -- 172.21.15.53:0/4237109206 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3522444052 0 0) 0x7fd7280cb080 con 0x7fd728159690 2023-06-10T19:00:24.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.424+0000 7fd725d9b640 1 -- 172.21.15.53:0/4237109206 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd714003530 con 0x7fd728159690 2023-06-10T19:00:24.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.424+0000 7fd725d9b640 1 -- 172.21.15.53:0/4237109206 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3006755546 0 0) 0x7fd714003530 con 0x7fd728159690 2023-06-10T19:00:24.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.424+0000 7fd725d9b640 1 -- 172.21.15.53:0/4237109206 >> v2:172.21.15.117:3300/0 conn(0x7fd7280b0f30 msgr2=0x7fd728070950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:24.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.424+0000 7fd725d9b640 1 --2- 172.21.15.53:0/4237109206 >> v2:172.21.15.117:3300/0 conn(0x7fd7280b0f30 0x7fd728070950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:24.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.424+0000 7fd725d9b640 1 -- 172.21.15.53:0/4237109206 >> v1:172.21.15.117:6789/0 conn(0x7fd728159a60 legacy=0x7fd7280c2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:24.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.424+0000 7fd725d9b640 1 -- 172.21.15.53:0/4237109206 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7280cb600 con 0x7fd728159690 2023-06-10T19:00:24.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.424+0000 7fd725d9b640 1 -- 172.21.15.53:0/4237109206 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fd718001680 con 0x7fd728159690 2023-06-10T19:00:24.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.424+0000 7fd725d9b640 1 -- 172.21.15.53:0/4237109206 >> v1:172.21.15.53:6789/0 conn(0x7fd728159690 legacy=0x7fd7280cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:24.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.424+0000 7fd725d9b640 1 --2- 172.21.15.53:0/4237109206 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7140039f0 0x7fd714003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:24.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.424+0000 7fd725d9b640 1 --2- 172.21.15.53:0/4237109206 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7140047d0 0x7fd714004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:24.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.424+0000 7fd725d9b640 1 --2- 172.21.15.53:0/4237109206 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd714005180 0x7fd71400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:24.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.424+0000 7fd725d9b640 1 -- 172.21.15.53:0/4237109206 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd728070e90 con 0x7fd7140039f0 2023-06-10T19:00:24.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.424+0000 7fd725d9b640 1 -- 172.21.15.53:0/4237109206 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd71400c060 con 0x7fd714005180 2023-06-10T19:00:24.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.424+0000 7fd725d9b640 1 -- 172.21.15.53:0/4237109206 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd71400c220 con 0x7fd7140047d0 2023-06-10T19:00:24.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.424+0000 7fd72659c640 1 --2- 172.21.15.53:0/4237109206 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7140039f0 0x7fd714003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:24.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.424+0000 7fd71dd9b640 1 --2- 172.21.15.53:0/4237109206 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7140047d0 0x7fd714004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:24.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.424+0000 7fd72659c640 1 -- 172.21.15.53:0/4237109206 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7140047d0 msgr2=0x7fd714004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:24.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.424+0000 7fd72659c640 1 --2- 172.21.15.53:0/4237109206 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7140047d0 0x7fd714004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:24.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.424+0000 7fd72659c640 1 -- 172.21.15.53:0/4237109206 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd714005180 msgr2=0x7fd71400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:24.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.424+0000 7fd726d9d640 1 --2- 172.21.15.53:0/4237109206 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd714005180 0x7fd71400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:24.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.424+0000 7fd72659c640 1 --2- 172.21.15.53:0/4237109206 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd714005180 0x7fd71400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:24.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.424+0000 7fd72659c640 1 -- 172.21.15.53:0/4237109206 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd714003530 con 0x7fd7140039f0 2023-06-10T19:00:24.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.424+0000 7fd726d9d640 1 --2- 172.21.15.53:0/4237109206 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd714005180 0x7fd71400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:00:24.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.424+0000 7fd726d9d640 1 -- 172.21.15.53:0/4237109206 reap_dead start 2023-06-10T19:00:24.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.428+0000 7fd72659c640 1 --2- 172.21.15.53:0/4237109206 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7140039f0 0x7fd714003e00 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7fd71800c240 tx=0x7fd71801cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7e125793d457ff6 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:24.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.428+0000 7fd725d9b640 1 -- 172.21.15.53:0/4237109206 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd718005ae0 con 0x7fd7140039f0 2023-06-10T19:00:24.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.428+0000 7fd725d9b640 1 -- 172.21.15.53:0/4237109206 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd718005c40 con 0x7fd7140039f0 2023-06-10T19:00:24.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.428+0000 7fd725d9b640 1 -- 172.21.15.53:0/4237109206 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd718007070 con 0x7fd7140039f0 2023-06-10T19:00:24.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.428+0000 7fd72cc03640 1 -- 172.21.15.53:0/4237109206 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7140039f0 msgr2=0x7fd714003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:24.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.428+0000 7fd72cc03640 1 --2- 172.21.15.53:0/4237109206 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7140039f0 0x7fd714003e00 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7fd71800c240 tx=0x7fd71801cc40 comp rx=0 tx=0).stop 2023-06-10T19:00:24.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.428+0000 7fd72cc03640 1 -- 172.21.15.53:0/4237109206 shutdown_connections 2023-06-10T19:00:24.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.428+0000 7fd72cc03640 1 --2- 172.21.15.53:0/4237109206 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7140039f0 0x7fd714003e00 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:24.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.428+0000 7fd72cc03640 1 -- 172.21.15.53:0/4237109206 >> 172.21.15.53:0/4237109206 conn(0x7fd72806a560 msgr2=0x7fd72806a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:24.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.428+0000 7fd72cc03640 1 -- 172.21.15.53:0/4237109206 shutdown_connections 2023-06-10T19:00:24.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.428+0000 7fd72cc03640 1 -- 172.21.15.53:0/4237109206 wait complete. 2023-06-10T19:00:24.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.428+0000 7fd72cc03640 1 Processor -- start 2023-06-10T19:00:24.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.428+0000 7fd72cc03640 1 -- start start 2023-06-10T19:00:24.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.428+0000 7fd72cc03640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7140039f0 0x7fd728142cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:24.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.428+0000 7fd72cc03640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7281ef6b0 0x7fd728158570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:24.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.428+0000 7fd72cc03640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd728158ab0 0x7fd72815b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:24.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.428+0000 7fd72cc03640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7280c23e0 con 0x7fd728158ab0 2023-06-10T19:00:24.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.428+0000 7fd72cc03640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd728158f20 con 0x7fd7281ef6b0 2023-06-10T19:00:24.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.428+0000 7fd72cc03640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7281f2210 con 0x7fd7140039f0 2023-06-10T19:00:24.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.428+0000 7fd726d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd728158ab0 0x7fd72815b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:24.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.428+0000 7fd726d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd728158ab0 0x7fd72815b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33268/0 (socket says 172.21.15.53:33268) 2023-06-10T19:00:24.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.428+0000 7fd726d9d640 1 -- 172.21.15.53:0/2797701454 learned_addr learned my addr 172.21.15.53:0/2797701454 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:24.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.428+0000 7fd71dd9b640 1 --2- 172.21.15.53:0/2797701454 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7281ef6b0 0x7fd728158570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:24.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.428+0000 7fd72659c640 1 --2- 172.21.15.53:0/2797701454 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7140039f0 0x7fd728142cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:24.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.432+0000 7fd726d9d640 1 -- 172.21.15.53:0/2797701454 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7140039f0 msgr2=0x7fd728142cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:24.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.432+0000 7fd726d9d640 1 --2- 172.21.15.53:0/2797701454 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7140039f0 0x7fd728142cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:24.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.432+0000 7fd726d9d640 1 -- 172.21.15.53:0/2797701454 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7281ef6b0 msgr2=0x7fd728158570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:24.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.432+0000 7fd726d9d640 1 --2- 172.21.15.53:0/2797701454 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7281ef6b0 0x7fd728158570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:24.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.432+0000 7fd726d9d640 1 -- 172.21.15.53:0/2797701454 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7281f24d0 con 0x7fd728158ab0 2023-06-10T19:00:24.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.432+0000 7fd726d9d640 1 --2- 172.21.15.53:0/2797701454 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd728158ab0 0x7fd72815b0b0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7fd72806fbf0 tx=0x7fd72000d620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:24.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.432+0000 7fd71f7fe640 1 -- 172.21.15.53:0/2797701454 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd72000b070 con 0x7fd728158ab0 2023-06-10T19:00:24.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.432+0000 7fd71f7fe640 1 -- 172.21.15.53:0/2797701454 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd72000de60 con 0x7fd728158ab0 2023-06-10T19:00:24.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.432+0000 7fd71f7fe640 1 -- 172.21.15.53:0/2797701454 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd720003bc0 con 0x7fd728158ab0 2023-06-10T19:00:24.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.432+0000 7fd72cc03640 1 -- 172.21.15.53:0/2797701454 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7281f27b0 con 0x7fd728158ab0 2023-06-10T19:00:24.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.432+0000 7fd72cc03640 1 -- 172.21.15.53:0/2797701454 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7281f2d70 con 0x7fd728158ab0 2023-06-10T19:00:24.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.432+0000 7fd72cc03640 1 -- 172.21.15.53:0/2797701454 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7281f5800 con 0x7fd728158ab0 2023-06-10T19:00:24.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.432+0000 7fd71f7fe640 1 -- 172.21.15.53:0/2797701454 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd720003d20 con 0x7fd728158ab0 2023-06-10T19:00:24.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.432+0000 7fd71f7fe640 1 --2- 172.21.15.53:0/2797701454 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd70806a690 0x7fd70806cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:24.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.432+0000 7fd71f7fe640 1 -- 172.21.15.53:0/2797701454 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd720082e80 con 0x7fd728158ab0 2023-06-10T19:00:24.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.432+0000 7fd72659c640 1 --2- 172.21.15.53:0/2797701454 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd70806a690 0x7fd70806cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:24.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.432+0000 7fd72659c640 1 --2- 172.21.15.53:0/2797701454 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd70806a690 0x7fd70806cb40 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fd7180ab000 tx=0x7fd7180b1040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:24.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.436+0000 7fd71f7fe640 1 -- 172.21.15.53:0/2797701454 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd7281f5800 con 0x7fd728158ab0 2023-06-10T19:00:24.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.580+0000 7fd72cc03640 1 -- 172.21.15.53:0/2797701454 --> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd7281f5800 con 0x7fd70806a690 2023-06-10T19:00:24.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.608+0000 7fd71f7fe640 1 -- 172.21.15.53:0/2797701454 <== mgr.4105 v2:172.21.15.117:6832/3061986771 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+309804 (secure 0 0 0) 0x7fd7281f5800 con 0x7fd70806a690 2023-06-10T19:00:24.613 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:00:24.616 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-06-10T19:00:24.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.612+0000 7fd72cc03640 1 -- 172.21.15.53:0/2797701454 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd70806a690 msgr2=0x7fd70806cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:24.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.612+0000 7fd72cc03640 1 --2- 172.21.15.53:0/2797701454 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd70806a690 0x7fd70806cb40 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fd7180ab000 tx=0x7fd7180b1040 comp rx=0 tx=0).stop 2023-06-10T19:00:24.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.612+0000 7fd72cc03640 1 -- 172.21.15.53:0/2797701454 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd728158ab0 msgr2=0x7fd72815b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:24.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.612+0000 7fd72cc03640 1 --2- 172.21.15.53:0/2797701454 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd728158ab0 0x7fd72815b0b0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7fd72806fbf0 tx=0x7fd72000d620 comp rx=0 tx=0).stop 2023-06-10T19:00:24.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.612+0000 7fd72cc03640 1 -- 172.21.15.53:0/2797701454 shutdown_connections 2023-06-10T19:00:24.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.612+0000 7fd72cc03640 1 --2- 172.21.15.53:0/2797701454 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd70806a690 0x7fd70806cb40 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:24.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.612+0000 7fd72cc03640 1 --2- 172.21.15.53:0/2797701454 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd728158ab0 0x7fd72815b0b0 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:24.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.612+0000 7fd72cc03640 1 --2- 172.21.15.53:0/2797701454 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7281ef6b0 0x7fd728158570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:24.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.612+0000 7fd72cc03640 1 --2- 172.21.15.53:0/2797701454 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7140039f0 0x7fd728142cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:24.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.612+0000 7fd72cc03640 1 -- 172.21.15.53:0/2797701454 >> 172.21.15.53:0/2797701454 conn(0x7fd72806a560 msgr2=0x7fd72806a930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:24.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.612+0000 7fd72cc03640 1 -- 172.21.15.53:0/2797701454 shutdown_connections 2023-06-10T19:00:24.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.612+0000 7fd72cc03640 1 -- 172.21.15.53:0/2797701454 wait complete. 2023-06-10T19:00:24.634 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":309,"stamp":"2023-06-10T19:00:23.727556+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":153,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":249020,"kb_used_data":8828,"kb_used_omap":0,"kb_used_meta":240128,"kb_avail":754725700,"statfs":{"total":773094113280,"available":772839116800,"internally_reserved":0,"allocated":9039872,"data_stored":4701107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":245891072},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":58,"apply_latency_ms":58,"commit_latency_ns":58000000,"apply_latency_ns":58000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.505144"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.866766+0000","last_change":"2023-06-10T19:00:20.656108+0000","last_active":"2023-06-10T19:00:21.866766+0000","last_peered":"2023-06-10T19:00:21.866766+0000","last_clean":"2023-06-10T19:00:21.866766+0000","last_became_active":"2023-06-10T19:00:20.655299+0000","last_became_peered":"2023-06-10T19:00:20.655299+0000","last_unstale":"2023-06-10T19:00:21.866766+0000","last_undegraded":"2023-06-10T19:00:21.866766+0000","last_fullsized":"2023-06-10T19:00:21.866766+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:17:09.516687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.868207+0000","last_change":"2023-06-10T19:00:20.630037+0000","last_active":"2023-06-10T19:00:21.868207+0000","last_peered":"2023-06-10T19:00:21.868207+0000","last_clean":"2023-06-10T19:00:21.868207+0000","last_became_active":"2023-06-10T19:00:20.629763+0000","last_became_peered":"2023-06-10T19:00:20.629763+0000","last_unstale":"2023-06-10T19:00:21.868207+0000","last_undegraded":"2023-06-10T19:00:21.868207+0000","last_fullsized":"2023-06-10T19:00:21.868207+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:10:53.462334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.621401+0000","last_change":"2023-06-10T19:00:20.638851+0000","last_active":"2023-06-10T19:00:21.621401+0000","last_peered":"2023-06-10T19:00:21.621401+0000","last_clean":"2023-06-10T19:00:21.621401+0000","last_became_active":"2023-06-10T19:00:20.638659+0000","last_became_peered":"2023-06-10T19:00:20.638659+0000","last_unstale":"2023-06-10T19:00:21.621401+0000","last_undegraded":"2023-06-10T19:00:21.621401+0000","last_fullsized":"2023-06-10T19:00:21.621401+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:16:59.721513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.867687+0000","last_change":"2023-06-10T19:00:20.673838+0000","last_active":"2023-06-10T19:00:21.867687+0000","last_peered":"2023-06-10T19:00:21.867687+0000","last_clean":"2023-06-10T19:00:21.867687+0000","last_became_active":"2023-06-10T19:00:20.673269+0000","last_became_peered":"2023-06-10T19:00:20.673269+0000","last_unstale":"2023-06-10T19:00:21.867687+0000","last_undegraded":"2023-06-10T19:00:21.867687+0000","last_fullsized":"2023-06-10T19:00:21.867687+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:37:20.431150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.618632+0000","last_change":"2023-06-10T19:00:20.642083+0000","last_active":"2023-06-10T19:00:21.618632+0000","last_peered":"2023-06-10T19:00:21.618632+0000","last_clean":"2023-06-10T19:00:21.618632+0000","last_became_active":"2023-06-10T19:00:20.641813+0000","last_became_peered":"2023-06-10T19:00:20.641813+0000","last_unstale":"2023-06-10T19:00:21.618632+0000","last_undegraded":"2023-06-10T19:00:21.618632+0000","last_fullsized":"2023-06-10T19:00:21.618632+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:15:46.372539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.867067+0000","last_change":"2023-06-10T19:00:20.644680+0000","last_active":"2023-06-10T19:00:21.867067+0000","last_peered":"2023-06-10T19:00:21.867067+0000","last_clean":"2023-06-10T19:00:21.867067+0000","last_became_active":"2023-06-10T19:00:20.643878+0000","last_became_peered":"2023-06-10T19:00:20.643878+0000","last_unstale":"2023-06-10T19:00:21.867067+0000","last_undegraded":"2023-06-10T19:00:21.867067+0000","last_fullsized":"2023-06-10T19:00:21.867067+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:33:09.345089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.868612+0000","last_change":"2023-06-10T19:00:20.665812+0000","last_active":"2023-06-10T19:00:21.868612+0000","last_peered":"2023-06-10T19:00:21.868612+0000","last_clean":"2023-06-10T19:00:21.868612+0000","last_became_active":"2023-06-10T19:00:20.665012+0000","last_became_peered":"2023-06-10T19:00:20.665012+0000","last_unstale":"2023-06-10T19:00:21.868612+0000","last_undegraded":"2023-06-10T19:00:21.868612+0000","last_fullsized":"2023-06-10T19:00:21.868612+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:18:53.183988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.617859+0000","last_change":"2023-06-10T19:00:20.643693+0000","last_active":"2023-06-10T19:00:21.617859+0000","last_peered":"2023-06-10T19:00:21.617859+0000","last_clean":"2023-06-10T19:00:21.617859+0000","last_became_active":"2023-06-10T19:00:20.643208+0000","last_became_peered":"2023-06-10T19:00:20.643208+0000","last_unstale":"2023-06-10T19:00:21.617859+0000","last_undegraded":"2023-06-10T19:00:21.617859+0000","last_fullsized":"2023-06-10T19:00:21.617859+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:58:43.055998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.620199+0000","last_change":"2023-06-10T19:00:20.640485+0000","last_active":"2023-06-10T19:00:21.620199+0000","last_peered":"2023-06-10T19:00:21.620199+0000","last_clean":"2023-06-10T19:00:21.620199+0000","last_became_active":"2023-06-10T19:00:20.638510+0000","last_became_peered":"2023-06-10T19:00:20.638510+0000","last_unstale":"2023-06-10T19:00:21.620199+0000","last_undegraded":"2023-06-10T19:00:21.620199+0000","last_fullsized":"2023-06-10T19:00:21.620199+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:48:01.830385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.866653+0000","last_change":"2023-06-10T19:00:20.681722+0000","last_active":"2023-06-10T19:00:21.866653+0000","last_peered":"2023-06-10T19:00:21.866653+0000","last_clean":"2023-06-10T19:00:21.866653+0000","last_became_active":"2023-06-10T19:00:20.681328+0000","last_became_peered":"2023-06-10T19:00:20.681328+0000","last_unstale":"2023-06-10T19:00:21.866653+0000","last_undegraded":"2023-06-10T19:00:21.866653+0000","last_fullsized":"2023-06-10T19:00:21.866653+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:14:32.710277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.867308+0000","last_change":"2023-06-10T19:00:20.640970+0000","last_active":"2023-06-10T19:00:21.867308+0000","last_peered":"2023-06-10T19:00:21.867308+0000","last_clean":"2023-06-10T19:00:21.867308+0000","last_became_active":"2023-06-10T19:00:20.640655+0000","last_became_peered":"2023-06-10T19:00:20.640655+0000","last_unstale":"2023-06-10T19:00:21.867308+0000","last_undegraded":"2023-06-10T19:00:21.867308+0000","last_fullsized":"2023-06-10T19:00:21.867308+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:09:46.827942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.868120+0000","last_change":"2023-06-10T19:00:20.673832+0000","last_active":"2023-06-10T19:00:21.868120+0000","last_peered":"2023-06-10T19:00:21.868120+0000","last_clean":"2023-06-10T19:00:21.868120+0000","last_became_active":"2023-06-10T19:00:20.673057+0000","last_became_peered":"2023-06-10T19:00:20.673057+0000","last_unstale":"2023-06-10T19:00:21.868120+0000","last_undegraded":"2023-06-10T19:00:21.868120+0000","last_fullsized":"2023-06-10T19:00:21.868120+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:47:18.272145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.618899+0000","last_change":"2023-06-10T19:00:20.631187+0000","last_active":"2023-06-10T19:00:21.618899+0000","last_peered":"2023-06-10T19:00:21.618899+0000","last_clean":"2023-06-10T19:00:21.618899+0000","last_became_active":"2023-06-10T19:00:20.630908+0000","last_became_peered":"2023-06-10T19:00:20.630908+0000","last_unstale":"2023-06-10T19:00:21.618899+0000","last_undegraded":"2023-06-10T19:00:21.618899+0000","last_fullsized":"2023-06-10T19:00:21.618899+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:19:09.973452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.867425+0000","last_change":"2023-06-10T19:00:20.643847+0000","last_active":"2023-06-10T19:00:21.867425+0000","last_peered":"2023-06-10T19:00:21.867425+0000","last_clean":"2023-06-10T19:00:21.867425+0000","last_became_active":"2023-06-10T19:00:20.643581+0000","last_became_peered":"2023-06-10T19:00:20.643581+0000","last_unstale":"2023-06-10T19:00:21.867425+0000","last_undegraded":"2023-06-10T19:00:21.867425+0000","last_fullsized":"2023-06-10T19:00:21.867425+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:40:15.534897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.868314+0000","last_change":"2023-06-10T19:00:20.629892+0000","last_active":"2023-06-10T19:00:21.868314+0000","last_peered":"2023-06-10T19:00:21.868314+0000","last_clean":"2023-06-10T19:00:21.868314+0000","last_became_active":"2023-06-10T19:00:20.629525+0000","last_became_peered":"2023-06-10T19:00:20.629525+0000","last_unstale":"2023-06-10T19:00:21.868314+0000","last_undegraded":"2023-06-10T19:00:21.868314+0000","last_fullsized":"2023-06-10T19:00:21.868314+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:10:00.560123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.865295+0000","last_change":"2023-06-10T19:00:20.673782+0000","last_active":"2023-06-10T19:00:21.865295+0000","last_peered":"2023-06-10T19:00:21.865295+0000","last_clean":"2023-06-10T19:00:21.865295+0000","last_became_active":"2023-06-10T19:00:20.673151+0000","last_became_peered":"2023-06-10T19:00:20.673151+0000","last_unstale":"2023-06-10T19:00:21.865295+0000","last_undegraded":"2023-06-10T19:00:21.865295+0000","last_fullsized":"2023-06-10T19:00:21.865295+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:22:18.384870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.618318+0000","last_change":"2023-06-10T19:00:20.667800+0000","last_active":"2023-06-10T19:00:21.618318+0000","last_peered":"2023-06-10T19:00:21.618318+0000","last_clean":"2023-06-10T19:00:21.618318+0000","last_became_active":"2023-06-10T19:00:20.667537+0000","last_became_peered":"2023-06-10T19:00:20.667537+0000","last_unstale":"2023-06-10T19:00:21.618318+0000","last_undegraded":"2023-06-10T19:00:21.618318+0000","last_fullsized":"2023-06-10T19:00:21.618318+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:44:34.275650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.621114+0000","last_change":"2023-06-10T19:00:20.634770+0000","last_active":"2023-06-10T19:00:21.621114+0000","last_peered":"2023-06-10T19:00:21.621114+0000","last_clean":"2023-06-10T19:00:21.621114+0000","last_became_active":"2023-06-10T19:00:20.634294+0000","last_became_peered":"2023-06-10T19:00:20.634294+0000","last_unstale":"2023-06-10T19:00:21.621114+0000","last_undegraded":"2023-06-10T19:00:21.621114+0000","last_fullsized":"2023-06-10T19:00:21.621114+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:15:17.493981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.866859+0000","last_change":"2023-06-10T19:00:20.642763+0000","last_active":"2023-06-10T19:00:21.866859+0000","last_peered":"2023-06-10T19:00:21.866859+0000","last_clean":"2023-06-10T19:00:21.866859+0000","last_became_active":"2023-06-10T19:00:20.642401+0000","last_became_peered":"2023-06-10T19:00:20.642401+0000","last_unstale":"2023-06-10T19:00:21.866859+0000","last_undegraded":"2023-06-10T19:00:21.866859+0000","last_fullsized":"2023-06-10T19:00:21.866859+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:10:00.560123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.618551+0000","last_change":"2023-06-10T19:00:20.626939+0000","last_active":"2023-06-10T19:00:21.618551+0000","last_peered":"2023-06-10T19:00:21.618551+0000","last_clean":"2023-06-10T19:00:21.618551+0000","last_became_active":"2023-06-10T19:00:20.626665+0000","last_became_peered":"2023-06-10T19:00:20.626665+0000","last_unstale":"2023-06-10T19:00:21.618551+0000","last_undegraded":"2023-06-10T19:00:21.618551+0000","last_fullsized":"2023-06-10T19:00:21.618551+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:43:30.365105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.619536+0000","last_change":"2023-06-10T19:00:20.629900+0000","last_active":"2023-06-10T19:00:21.619536+0000","last_peered":"2023-06-10T19:00:21.619536+0000","last_clean":"2023-06-10T19:00:21.619536+0000","last_became_active":"2023-06-10T19:00:20.629195+0000","last_became_peered":"2023-06-10T19:00:20.629195+0000","last_unstale":"2023-06-10T19:00:21.619536+0000","last_undegraded":"2023-06-10T19:00:21.619536+0000","last_fullsized":"2023-06-10T19:00:21.619536+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:23:18.393701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.618186+0000","last_change":"2023-06-10T19:00:20.629414+0000","last_active":"2023-06-10T19:00:21.618186+0000","last_peered":"2023-06-10T19:00:21.618186+0000","last_clean":"2023-06-10T19:00:21.618186+0000","last_became_active":"2023-06-10T19:00:20.629131+0000","last_became_peered":"2023-06-10T19:00:20.629131+0000","last_unstale":"2023-06-10T19:00:21.618186+0000","last_undegraded":"2023-06-10T19:00:21.618186+0000","last_fullsized":"2023-06-10T19:00:21.618186+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:50:53.329240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.619065+0000","last_change":"2023-06-10T19:00:20.675924+0000","last_active":"2023-06-10T19:00:21.619065+0000","last_peered":"2023-06-10T19:00:21.619065+0000","last_clean":"2023-06-10T19:00:21.619065+0000","last_became_active":"2023-06-10T19:00:20.675272+0000","last_became_peered":"2023-06-10T19:00:20.675272+0000","last_unstale":"2023-06-10T19:00:21.619065+0000","last_undegraded":"2023-06-10T19:00:21.619065+0000","last_fullsized":"2023-06-10T19:00:21.619065+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:07:46.933835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.866133+0000","last_change":"2023-06-10T19:00:20.630539+0000","last_active":"2023-06-10T19:00:21.866133+0000","last_peered":"2023-06-10T19:00:21.866133+0000","last_clean":"2023-06-10T19:00:21.866133+0000","last_became_active":"2023-06-10T19:00:20.630282+0000","last_became_peered":"2023-06-10T19:00:20.630282+0000","last_unstale":"2023-06-10T19:00:21.866133+0000","last_undegraded":"2023-06-10T19:00:21.866133+0000","last_fullsized":"2023-06-10T19:00:21.866133+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:13:41.213765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.867321+0000","last_change":"2023-06-10T19:00:20.631627+0000","last_active":"2023-06-10T19:00:21.867321+0000","last_peered":"2023-06-10T19:00:21.867321+0000","last_clean":"2023-06-10T19:00:21.867321+0000","last_became_active":"2023-06-10T19:00:20.631365+0000","last_became_peered":"2023-06-10T19:00:20.631365+0000","last_unstale":"2023-06-10T19:00:21.867321+0000","last_undegraded":"2023-06-10T19:00:21.867321+0000","last_fullsized":"2023-06-10T19:00:21.867321+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:44:49.154985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.866991+0000","last_change":"2023-06-10T19:00:20.673496+0000","last_active":"2023-06-10T19:00:21.866991+0000","last_peered":"2023-06-10T19:00:21.866991+0000","last_clean":"2023-06-10T19:00:21.866991+0000","last_became_active":"2023-06-10T19:00:20.672691+0000","last_became_peered":"2023-06-10T19:00:20.672691+0000","last_unstale":"2023-06-10T19:00:21.866991+0000","last_undegraded":"2023-06-10T19:00:21.866991+0000","last_fullsized":"2023-06-10T19:00:21.866991+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:16:43.763717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.866245+0000","last_change":"2023-06-10T19:00:20.675125+0000","last_active":"2023-06-10T19:00:21.866245+0000","last_peered":"2023-06-10T19:00:21.866245+0000","last_clean":"2023-06-10T19:00:21.866245+0000","last_became_active":"2023-06-10T19:00:20.674435+0000","last_became_peered":"2023-06-10T19:00:20.674435+0000","last_unstale":"2023-06-10T19:00:21.866245+0000","last_undegraded":"2023-06-10T19:00:21.866245+0000","last_fullsized":"2023-06-10T19:00:21.866245+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:56:00.296463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.618880+0000","last_change":"2023-06-10T19:00:20.681240+0000","last_active":"2023-06-10T19:00:21.618880+0000","last_peered":"2023-06-10T19:00:21.618880+0000","last_clean":"2023-06-10T19:00:21.618880+0000","last_became_active":"2023-06-10T19:00:20.680942+0000","last_became_peered":"2023-06-10T19:00:20.680942+0000","last_unstale":"2023-06-10T19:00:21.618880+0000","last_undegraded":"2023-06-10T19:00:21.618880+0000","last_fullsized":"2023-06-10T19:00:21.618880+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:06:05.139523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.866842+0000","last_change":"2023-06-10T19:00:20.666401+0000","last_active":"2023-06-10T19:00:21.866842+0000","last_peered":"2023-06-10T19:00:21.866842+0000","last_clean":"2023-06-10T19:00:21.866842+0000","last_became_active":"2023-06-10T19:00:20.666076+0000","last_became_peered":"2023-06-10T19:00:20.666076+0000","last_unstale":"2023-06-10T19:00:21.866842+0000","last_undegraded":"2023-06-10T19:00:21.866842+0000","last_fullsized":"2023-06-10T19:00:21.866842+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:00:10.415232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.869463+0000","last_change":"2023-06-10T19:00:20.656663+0000","last_active":"2023-06-10T19:00:21.869463+0000","last_peered":"2023-06-10T19:00:21.869463+0000","last_clean":"2023-06-10T19:00:21.869463+0000","last_became_active":"2023-06-10T19:00:20.654273+0000","last_became_peered":"2023-06-10T19:00:20.654273+0000","last_unstale":"2023-06-10T19:00:21.869463+0000","last_undegraded":"2023-06-10T19:00:21.869463+0000","last_fullsized":"2023-06-10T19:00:21.869463+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:32:44.275724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.620723+0000","last_change":"2023-06-10T19:00:20.670527+0000","last_active":"2023-06-10T19:00:21.620723+0000","last_peered":"2023-06-10T19:00:21.620723+0000","last_clean":"2023-06-10T19:00:21.620723+0000","last_became_active":"2023-06-10T19:00:20.670166+0000","last_became_peered":"2023-06-10T19:00:20.670166+0000","last_unstale":"2023-06-10T19:00:21.620723+0000","last_undegraded":"2023-06-10T19:00:21.620723+0000","last_fullsized":"2023-06-10T19:00:21.620723+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:20:02.439773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.865472+0000","last_change":"2023-06-10T19:00:20.657164+0000","last_active":"2023-06-10T19:00:21.865472+0000","last_peered":"2023-06-10T19:00:21.865472+0000","last_clean":"2023-06-10T19:00:21.865472+0000","last_became_active":"2023-06-10T19:00:20.656548+0000","last_became_peered":"2023-06-10T19:00:20.656548+0000","last_unstale":"2023-06-10T19:00:21.865472+0000","last_undegraded":"2023-06-10T19:00:21.865472+0000","last_fullsized":"2023-06-10T19:00:21.865472+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:43:10.600135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.620647+0000","last_change":"2023-06-10T19:00:20.630013+0000","last_active":"2023-06-10T19:00:21.620647+0000","last_peered":"2023-06-10T19:00:21.620647+0000","last_clean":"2023-06-10T19:00:21.620647+0000","last_became_active":"2023-06-10T19:00:20.629741+0000","last_became_peered":"2023-06-10T19:00:20.629741+0000","last_unstale":"2023-06-10T19:00:21.620647+0000","last_undegraded":"2023-06-10T19:00:21.620647+0000","last_fullsized":"2023-06-10T19:00:21.620647+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:12:34.648101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"79'4","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.618567+0000","last_change":"2023-06-10T19:00:20.257791+0000","last_active":"2023-06-10T19:00:21.618567+0000","last_peered":"2023-06-10T19:00:21.618567+0000","last_clean":"2023-06-10T19:00:21.618567+0000","last_became_active":"2023-06-10T19:00:20.257272+0000","last_became_peered":"2023-06-10T19:00:20.257272+0000","last_unstale":"2023-06-10T19:00:21.618567+0000","last_undegraded":"2023-06-10T19:00:21.618567+0000","last_fullsized":"2023-06-10T19:00:21.618567+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_clean_scrub_stamp":"2023-06-10T19:00:19.216413+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:33:44.532510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.867708+0000","last_change":"2023-06-10T19:00:20.681097+0000","last_active":"2023-06-10T19:00:21.867708+0000","last_peered":"2023-06-10T19:00:21.867708+0000","last_clean":"2023-06-10T19:00:21.867708+0000","last_became_active":"2023-06-10T19:00:20.680811+0000","last_became_peered":"2023-06-10T19:00:20.680811+0000","last_unstale":"2023-06-10T19:00:21.867708+0000","last_undegraded":"2023-06-10T19:00:21.867708+0000","last_fullsized":"2023-06-10T19:00:21.867708+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:46:21.681693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"79'1","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.866126+0000","last_change":"2023-06-10T19:00:20.284301+0000","last_active":"2023-06-10T19:00:21.866126+0000","last_peered":"2023-06-10T19:00:21.866126+0000","last_clean":"2023-06-10T19:00:21.866126+0000","last_became_active":"2023-06-10T19:00:20.283793+0000","last_became_peered":"2023-06-10T19:00:20.283793+0000","last_unstale":"2023-06-10T19:00:21.866126+0000","last_undegraded":"2023-06-10T19:00:21.866126+0000","last_fullsized":"2023-06-10T19:00:21.866126+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_clean_scrub_stamp":"2023-06-10T19:00:19.216413+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:31:04.338826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.619096+0000","last_change":"2023-06-10T19:00:20.640684+0000","last_active":"2023-06-10T19:00:21.619096+0000","last_peered":"2023-06-10T19:00:21.619096+0000","last_clean":"2023-06-10T19:00:21.619096+0000","last_became_active":"2023-06-10T19:00:20.638963+0000","last_became_peered":"2023-06-10T19:00:20.638963+0000","last_unstale":"2023-06-10T19:00:21.619096+0000","last_undegraded":"2023-06-10T19:00:21.619096+0000","last_fullsized":"2023-06-10T19:00:21.619096+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:23:12.824855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"79'2","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.867646+0000","last_change":"2023-06-10T19:00:20.282320+0000","last_active":"2023-06-10T19:00:21.867646+0000","last_peered":"2023-06-10T19:00:21.867646+0000","last_clean":"2023-06-10T19:00:21.867646+0000","last_became_active":"2023-06-10T19:00:20.281222+0000","last_became_peered":"2023-06-10T19:00:20.281222+0000","last_unstale":"2023-06-10T19:00:21.867646+0000","last_undegraded":"2023-06-10T19:00:21.867646+0000","last_fullsized":"2023-06-10T19:00:21.867646+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_clean_scrub_stamp":"2023-06-10T19:00:19.216413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:52:50.999883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.619625+0000","last_change":"2023-06-10T19:00:20.628646+0000","last_active":"2023-06-10T19:00:21.619625+0000","last_peered":"2023-06-10T19:00:21.619625+0000","last_clean":"2023-06-10T19:00:21.619625+0000","last_became_active":"2023-06-10T19:00:20.627913+0000","last_became_peered":"2023-06-10T19:00:20.627913+0000","last_unstale":"2023-06-10T19:00:21.619625+0000","last_undegraded":"2023-06-10T19:00:21.619625+0000","last_fullsized":"2023-06-10T19:00:21.619625+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:11:21.840003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"79'2","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.868751+0000","last_change":"2023-06-10T19:00:20.274579+0000","last_active":"2023-06-10T19:00:21.868751+0000","last_peered":"2023-06-10T19:00:21.868751+0000","last_clean":"2023-06-10T19:00:21.868751+0000","last_became_active":"2023-06-10T19:00:20.273748+0000","last_became_peered":"2023-06-10T19:00:20.273748+0000","last_unstale":"2023-06-10T19:00:21.868751+0000","last_undegraded":"2023-06-10T19:00:21.868751+0000","last_fullsized":"2023-06-10T19:00:21.868751+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_clean_scrub_stamp":"2023-06-10T19:00:19.216413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:47:33.852982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.867528+0000","last_change":"2023-06-10T19:00:20.636810+0000","last_active":"2023-06-10T19:00:21.867528+0000","last_peered":"2023-06-10T19:00:21.867528+0000","last_clean":"2023-06-10T19:00:21.867528+0000","last_became_active":"2023-06-10T19:00:20.636418+0000","last_became_peered":"2023-06-10T19:00:20.636418+0000","last_unstale":"2023-06-10T19:00:21.867528+0000","last_undegraded":"2023-06-10T19:00:21.867528+0000","last_fullsized":"2023-06-10T19:00:21.867528+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:35:52.514197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"79'1","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.619898+0000","last_change":"2023-06-10T19:00:20.275345+0000","last_active":"2023-06-10T19:00:21.619898+0000","last_peered":"2023-06-10T19:00:21.619898+0000","last_clean":"2023-06-10T19:00:21.619898+0000","last_became_active":"2023-06-10T19:00:20.274645+0000","last_became_peered":"2023-06-10T19:00:20.274645+0000","last_unstale":"2023-06-10T19:00:21.619898+0000","last_undegraded":"2023-06-10T19:00:21.619898+0000","last_fullsized":"2023-06-10T19:00:21.619898+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_clean_scrub_stamp":"2023-06-10T19:00:19.216413+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:18:01.591546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.867705+0000","last_change":"2023-06-10T19:00:20.630397+0000","last_active":"2023-06-10T19:00:21.867705+0000","last_peered":"2023-06-10T19:00:21.867705+0000","last_clean":"2023-06-10T19:00:21.867705+0000","last_became_active":"2023-06-10T19:00:20.629701+0000","last_became_peered":"2023-06-10T19:00:20.629701+0000","last_unstale":"2023-06-10T19:00:21.867705+0000","last_undegraded":"2023-06-10T19:00:21.867705+0000","last_fullsized":"2023-06-10T19:00:21.867705+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:52:20.498970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"79'1","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.865987+0000","last_change":"2023-06-10T19:00:20.260864+0000","last_active":"2023-06-10T19:00:21.865987+0000","last_peered":"2023-06-10T19:00:21.865987+0000","last_clean":"2023-06-10T19:00:21.865987+0000","last_became_active":"2023-06-10T19:00:20.260130+0000","last_became_peered":"2023-06-10T19:00:20.260130+0000","last_unstale":"2023-06-10T19:00:21.865987+0000","last_undegraded":"2023-06-10T19:00:21.865987+0000","last_fullsized":"2023-06-10T19:00:21.865987+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_clean_scrub_stamp":"2023-06-10T19:00:19.216413+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:52:15.966860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.620216+0000","last_change":"2023-06-10T19:00:20.626132+0000","last_active":"2023-06-10T19:00:21.620216+0000","last_peered":"2023-06-10T19:00:21.620216+0000","last_clean":"2023-06-10T19:00:21.620216+0000","last_became_active":"2023-06-10T19:00:20.625065+0000","last_became_peered":"2023-06-10T19:00:20.625065+0000","last_unstale":"2023-06-10T19:00:21.620216+0000","last_undegraded":"2023-06-10T19:00:21.620216+0000","last_fullsized":"2023-06-10T19:00:21.620216+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:51:09.962165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.868039+0000","last_change":"2023-06-10T19:00:20.283101+0000","last_active":"2023-06-10T19:00:21.868039+0000","last_peered":"2023-06-10T19:00:21.868039+0000","last_clean":"2023-06-10T19:00:21.868039+0000","last_became_active":"2023-06-10T19:00:20.282730+0000","last_became_peered":"2023-06-10T19:00:20.282730+0000","last_unstale":"2023-06-10T19:00:21.868039+0000","last_undegraded":"2023-06-10T19:00:21.868039+0000","last_fullsized":"2023-06-10T19:00:21.868039+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_clean_scrub_stamp":"2023-06-10T19:00:19.216413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:45:53.704310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.869825+0000","last_change":"2023-06-10T19:00:20.665385+0000","last_active":"2023-06-10T19:00:21.869825+0000","last_peered":"2023-06-10T19:00:21.869825+0000","last_clean":"2023-06-10T19:00:21.869825+0000","last_became_active":"2023-06-10T19:00:20.664675+0000","last_became_peered":"2023-06-10T19:00:20.664675+0000","last_unstale":"2023-06-10T19:00:21.869825+0000","last_undegraded":"2023-06-10T19:00:21.869825+0000","last_fullsized":"2023-06-10T19:00:21.869825+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:03:32.447672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.617984+0000","last_change":"2023-06-10T19:00:20.253235+0000","last_active":"2023-06-10T19:00:21.617984+0000","last_peered":"2023-06-10T19:00:21.617984+0000","last_clean":"2023-06-10T19:00:21.617984+0000","last_became_active":"2023-06-10T19:00:20.252296+0000","last_became_peered":"2023-06-10T19:00:20.252296+0000","last_unstale":"2023-06-10T19:00:21.617984+0000","last_undegraded":"2023-06-10T19:00:21.617984+0000","last_fullsized":"2023-06-10T19:00:21.617984+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_clean_scrub_stamp":"2023-06-10T19:00:19.216413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:32:56.361864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.866247+0000","last_change":"2023-06-10T19:00:20.644646+0000","last_active":"2023-06-10T19:00:21.866247+0000","last_peered":"2023-06-10T19:00:21.866247+0000","last_clean":"2023-06-10T19:00:21.866247+0000","last_became_active":"2023-06-10T19:00:20.644370+0000","last_became_peered":"2023-06-10T19:00:20.644370+0000","last_unstale":"2023-06-10T19:00:21.866247+0000","last_undegraded":"2023-06-10T19:00:21.866247+0000","last_fullsized":"2023-06-10T19:00:21.866247+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:53:46.304849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.867062+0000","last_change":"2023-06-10T19:00:20.282095+0000","last_active":"2023-06-10T19:00:21.867062+0000","last_peered":"2023-06-10T19:00:21.867062+0000","last_clean":"2023-06-10T19:00:21.867062+0000","last_became_active":"2023-06-10T19:00:20.281207+0000","last_became_peered":"2023-06-10T19:00:20.281207+0000","last_unstale":"2023-06-10T19:00:21.867062+0000","last_undegraded":"2023-06-10T19:00:21.867062+0000","last_fullsized":"2023-06-10T19:00:21.867062+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_clean_scrub_stamp":"2023-06-10T19:00:19.216413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:13:12.793538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.866847+0000","last_change":"2023-06-10T19:00:20.672866+0000","last_active":"2023-06-10T19:00:21.866847+0000","last_peered":"2023-06-10T19:00:21.866847+0000","last_clean":"2023-06-10T19:00:21.866847+0000","last_became_active":"2023-06-10T19:00:20.672364+0000","last_became_peered":"2023-06-10T19:00:20.672364+0000","last_unstale":"2023-06-10T19:00:21.866847+0000","last_undegraded":"2023-06-10T19:00:21.866847+0000","last_fullsized":"2023-06-10T19:00:21.866847+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:01:29.756279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.867310+0000","last_change":"2023-06-10T19:00:20.273599+0000","last_active":"2023-06-10T19:00:21.867310+0000","last_peered":"2023-06-10T19:00:21.867310+0000","last_clean":"2023-06-10T19:00:21.867310+0000","last_became_active":"2023-06-10T19:00:20.272875+0000","last_became_peered":"2023-06-10T19:00:20.272875+0000","last_unstale":"2023-06-10T19:00:21.867310+0000","last_undegraded":"2023-06-10T19:00:21.867310+0000","last_fullsized":"2023-06-10T19:00:21.867310+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_clean_scrub_stamp":"2023-06-10T19:00:19.216413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:22:31.656506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.867758+0000","last_change":"2023-06-10T19:00:20.628599+0000","last_active":"2023-06-10T19:00:21.867758+0000","last_peered":"2023-06-10T19:00:21.867758+0000","last_clean":"2023-06-10T19:00:21.867758+0000","last_became_active":"2023-06-10T19:00:20.628010+0000","last_became_peered":"2023-06-10T19:00:20.628010+0000","last_unstale":"2023-06-10T19:00:21.867758+0000","last_undegraded":"2023-06-10T19:00:21.867758+0000","last_fullsized":"2023-06-10T19:00:21.867758+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:56:45.512224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"79'3","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.618855+0000","last_change":"2023-06-10T19:00:20.261734+0000","last_active":"2023-06-10T19:00:21.618855+0000","last_peered":"2023-06-10T19:00:21.618855+0000","last_clean":"2023-06-10T19:00:21.618855+0000","last_became_active":"2023-06-10T19:00:20.261407+0000","last_became_peered":"2023-06-10T19:00:20.261407+0000","last_unstale":"2023-06-10T19:00:21.618855+0000","last_undegraded":"2023-06-10T19:00:21.618855+0000","last_fullsized":"2023-06-10T19:00:21.618855+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_clean_scrub_stamp":"2023-06-10T19:00:19.216413+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:14:51.794117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.621182+0000","last_change":"2023-06-10T19:00:20.631141+0000","last_active":"2023-06-10T19:00:21.621182+0000","last_peered":"2023-06-10T19:00:21.621182+0000","last_clean":"2023-06-10T19:00:21.621182+0000","last_became_active":"2023-06-10T19:00:20.630868+0000","last_became_peered":"2023-06-10T19:00:20.630868+0000","last_unstale":"2023-06-10T19:00:21.621182+0000","last_undegraded":"2023-06-10T19:00:21.621182+0000","last_fullsized":"2023-06-10T19:00:21.621182+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:22:35.959810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"79'6","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.868892+0000","last_change":"2023-06-10T19:00:20.257720+0000","last_active":"2023-06-10T19:00:21.868892+0000","last_peered":"2023-06-10T19:00:21.868892+0000","last_clean":"2023-06-10T19:00:21.868892+0000","last_became_active":"2023-06-10T19:00:20.256889+0000","last_became_peered":"2023-06-10T19:00:20.256889+0000","last_unstale":"2023-06-10T19:00:21.868892+0000","last_undegraded":"2023-06-10T19:00:21.868892+0000","last_fullsized":"2023-06-10T19:00:21.868892+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_clean_scrub_stamp":"2023-06-10T19:00:19.216413+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:29:41.288976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.868096+0000","last_change":"2023-06-10T19:00:20.673530+0000","last_active":"2023-06-10T19:00:21.868096+0000","last_peered":"2023-06-10T19:00:21.868096+0000","last_clean":"2023-06-10T19:00:21.868096+0000","last_became_active":"2023-06-10T19:00:20.672637+0000","last_became_peered":"2023-06-10T19:00:20.672637+0000","last_unstale":"2023-06-10T19:00:21.868096+0000","last_undegraded":"2023-06-10T19:00:21.868096+0000","last_fullsized":"2023-06-10T19:00:21.868096+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:43:13.083824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"79'2","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.866556+0000","last_change":"2023-06-10T19:00:20.256799+0000","last_active":"2023-06-10T19:00:21.866556+0000","last_peered":"2023-06-10T19:00:21.866556+0000","last_clean":"2023-06-10T19:00:21.866556+0000","last_became_active":"2023-06-10T19:00:20.256028+0000","last_became_peered":"2023-06-10T19:00:20.256028+0000","last_unstale":"2023-06-10T19:00:21.866556+0000","last_undegraded":"2023-06-10T19:00:21.866556+0000","last_fullsized":"2023-06-10T19:00:21.866556+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_clean_scrub_stamp":"2023-06-10T19:00:19.216413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:51:48.920891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.868274+0000","last_change":"2023-06-10T19:00:20.668026+0000","last_active":"2023-06-10T19:00:21.868274+0000","last_peered":"2023-06-10T19:00:21.868274+0000","last_clean":"2023-06-10T19:00:21.868274+0000","last_became_active":"2023-06-10T19:00:20.667280+0000","last_became_peered":"2023-06-10T19:00:20.667280+0000","last_unstale":"2023-06-10T19:00:21.868274+0000","last_undegraded":"2023-06-10T19:00:21.868274+0000","last_fullsized":"2023-06-10T19:00:21.868274+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:07:51.564628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.865848+0000","last_change":"2023-06-10T19:00:20.281487+0000","last_active":"2023-06-10T19:00:21.865848+0000","last_peered":"2023-06-10T19:00:21.865848+0000","last_clean":"2023-06-10T19:00:21.865848+0000","last_became_active":"2023-06-10T19:00:20.281002+0000","last_became_peered":"2023-06-10T19:00:20.281002+0000","last_unstale":"2023-06-10T19:00:21.865848+0000","last_undegraded":"2023-06-10T19:00:21.865848+0000","last_fullsized":"2023-06-10T19:00:21.865848+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_clean_scrub_stamp":"2023-06-10T19:00:19.216413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:10:32.498213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.869775+0000","last_change":"2023-06-10T19:00:20.666238+0000","last_active":"2023-06-10T19:00:21.869775+0000","last_peered":"2023-06-10T19:00:21.869775+0000","last_clean":"2023-06-10T19:00:21.869775+0000","last_became_active":"2023-06-10T19:00:20.664239+0000","last_became_peered":"2023-06-10T19:00:20.664239+0000","last_unstale":"2023-06-10T19:00:21.869775+0000","last_undegraded":"2023-06-10T19:00:21.869775+0000","last_fullsized":"2023-06-10T19:00:21.869775+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:38:50.520363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.617851+0000","last_change":"2023-06-10T19:00:20.257908+0000","last_active":"2023-06-10T19:00:21.617851+0000","last_peered":"2023-06-10T19:00:21.617851+0000","last_clean":"2023-06-10T19:00:21.617851+0000","last_became_active":"2023-06-10T19:00:20.257547+0000","last_became_peered":"2023-06-10T19:00:20.257547+0000","last_unstale":"2023-06-10T19:00:21.617851+0000","last_undegraded":"2023-06-10T19:00:21.617851+0000","last_fullsized":"2023-06-10T19:00:21.617851+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_clean_scrub_stamp":"2023-06-10T19:00:19.216413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:46:44.692832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.869952+0000","last_change":"2023-06-10T19:00:20.654023+0000","last_active":"2023-06-10T19:00:21.869952+0000","last_peered":"2023-06-10T19:00:21.869952+0000","last_clean":"2023-06-10T19:00:21.869952+0000","last_became_active":"2023-06-10T19:00:20.653247+0000","last_became_peered":"2023-06-10T19:00:20.653247+0000","last_unstale":"2023-06-10T19:00:21.869952+0000","last_undegraded":"2023-06-10T19:00:21.869952+0000","last_fullsized":"2023-06-10T19:00:21.869952+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:15:34.592212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"79'8","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.866627+0000","last_change":"2023-06-10T19:00:20.267938+0000","last_active":"2023-06-10T19:00:21.866627+0000","last_peered":"2023-06-10T19:00:21.866627+0000","last_clean":"2023-06-10T19:00:21.866627+0000","last_became_active":"2023-06-10T19:00:20.267680+0000","last_became_peered":"2023-06-10T19:00:20.267680+0000","last_unstale":"2023-06-10T19:00:21.866627+0000","last_undegraded":"2023-06-10T19:00:21.866627+0000","last_fullsized":"2023-06-10T19:00:21.866627+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_clean_scrub_stamp":"2023-06-10T19:00:19.216413+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:16:40.199630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.619071+0000","last_change":"2023-06-10T19:00:20.650580+0000","last_active":"2023-06-10T19:00:21.619071+0000","last_peered":"2023-06-10T19:00:21.619071+0000","last_clean":"2023-06-10T19:00:21.619071+0000","last_became_active":"2023-06-10T19:00:20.649786+0000","last_became_peered":"2023-06-10T19:00:20.649786+0000","last_unstale":"2023-06-10T19:00:21.619071+0000","last_undegraded":"2023-06-10T19:00:21.619071+0000","last_fullsized":"2023-06-10T19:00:21.619071+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:43:49.450271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"79'2","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.867674+0000","last_change":"2023-06-10T19:00:20.261631+0000","last_active":"2023-06-10T19:00:21.867674+0000","last_peered":"2023-06-10T19:00:21.867674+0000","last_clean":"2023-06-10T19:00:21.867674+0000","last_became_active":"2023-06-10T19:00:20.260850+0000","last_became_peered":"2023-06-10T19:00:20.260850+0000","last_unstale":"2023-06-10T19:00:21.867674+0000","last_undegraded":"2023-06-10T19:00:21.867674+0000","last_fullsized":"2023-06-10T19:00:21.867674+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_clean_scrub_stamp":"2023-06-10T19:00:19.216413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:21:53.080252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.868940+0000","last_change":"2023-06-10T19:00:20.671587+0000","last_active":"2023-06-10T19:00:21.868940+0000","last_peered":"2023-06-10T19:00:21.868940+0000","last_clean":"2023-06-10T19:00:21.868940+0000","last_became_active":"2023-06-10T19:00:20.671086+0000","last_became_peered":"2023-06-10T19:00:20.671086+0000","last_unstale":"2023-06-10T19:00:21.868940+0000","last_undegraded":"2023-06-10T19:00:21.868940+0000","last_fullsized":"2023-06-10T19:00:21.868940+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:47:05.172704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"79'1","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.868550+0000","last_change":"2023-06-10T19:00:20.249469+0000","last_active":"2023-06-10T19:00:21.868550+0000","last_peered":"2023-06-10T19:00:21.868550+0000","last_clean":"2023-06-10T19:00:21.868550+0000","last_became_active":"2023-06-10T19:00:20.249188+0000","last_became_peered":"2023-06-10T19:00:20.249188+0000","last_unstale":"2023-06-10T19:00:21.868550+0000","last_undegraded":"2023-06-10T19:00:21.868550+0000","last_fullsized":"2023-06-10T19:00:21.868550+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_clean_scrub_stamp":"2023-06-10T19:00:19.216413+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:40:14.530687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.619158+0000","last_change":"2023-06-10T19:00:20.645675+0000","last_active":"2023-06-10T19:00:21.619158+0000","last_peered":"2023-06-10T19:00:21.619158+0000","last_clean":"2023-06-10T19:00:21.619158+0000","last_became_active":"2023-06-10T19:00:20.642700+0000","last_became_peered":"2023-06-10T19:00:20.642700+0000","last_unstale":"2023-06-10T19:00:21.619158+0000","last_undegraded":"2023-06-10T19:00:21.619158+0000","last_fullsized":"2023-06-10T19:00:21.619158+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:43:46.594771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.866876+0000","last_change":"2023-06-10T19:00:20.282652+0000","last_active":"2023-06-10T19:00:21.866876+0000","last_peered":"2023-06-10T19:00:21.866876+0000","last_clean":"2023-06-10T19:00:21.866876+0000","last_became_active":"2023-06-10T19:00:20.281827+0000","last_became_peered":"2023-06-10T19:00:20.281827+0000","last_unstale":"2023-06-10T19:00:21.866876+0000","last_undegraded":"2023-06-10T19:00:21.866876+0000","last_fullsized":"2023-06-10T19:00:21.866876+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_clean_scrub_stamp":"2023-06-10T19:00:19.216413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:50:08.470544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.867103+0000","last_change":"2023-06-10T19:00:20.642094+0000","last_active":"2023-06-10T19:00:21.867103+0000","last_peered":"2023-06-10T19:00:21.867103+0000","last_clean":"2023-06-10T19:00:21.867103+0000","last_became_active":"2023-06-10T19:00:20.641839+0000","last_became_peered":"2023-06-10T19:00:20.641839+0000","last_unstale":"2023-06-10T19:00:21.867103+0000","last_undegraded":"2023-06-10T19:00:21.867103+0000","last_fullsized":"2023-06-10T19:00:21.867103+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:41:06.052938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.866119+0000","last_change":"2023-06-10T19:00:20.283860+0000","last_active":"2023-06-10T19:00:21.866119+0000","last_peered":"2023-06-10T19:00:21.866119+0000","last_clean":"2023-06-10T19:00:21.866119+0000","last_became_active":"2023-06-10T19:00:20.283307+0000","last_became_peered":"2023-06-10T19:00:20.283307+0000","last_unstale":"2023-06-10T19:00:21.866119+0000","last_undegraded":"2023-06-10T19:00:21.866119+0000","last_fullsized":"2023-06-10T19:00:21.866119+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_clean_scrub_stamp":"2023-06-10T19:00:19.216413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:34:06.614085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.868718+0000","last_change":"2023-06-10T19:00:20.649292+0000","last_active":"2023-06-10T19:00:21.868718+0000","last_peered":"2023-06-10T19:00:21.868718+0000","last_clean":"2023-06-10T19:00:21.868718+0000","last_became_active":"2023-06-10T19:00:20.648683+0000","last_became_peered":"2023-06-10T19:00:20.648683+0000","last_unstale":"2023-06-10T19:00:21.868718+0000","last_undegraded":"2023-06-10T19:00:21.868718+0000","last_fullsized":"2023-06-10T19:00:21.868718+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:56:15.431163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.868399+0000","last_change":"2023-06-10T19:00:20.274982+0000","last_active":"2023-06-10T19:00:21.868399+0000","last_peered":"2023-06-10T19:00:21.868399+0000","last_clean":"2023-06-10T19:00:21.868399+0000","last_became_active":"2023-06-10T19:00:20.274222+0000","last_became_peered":"2023-06-10T19:00:20.274222+0000","last_unstale":"2023-06-10T19:00:21.868399+0000","last_undegraded":"2023-06-10T19:00:21.868399+0000","last_fullsized":"2023-06-10T19:00:21.868399+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_clean_scrub_stamp":"2023-06-10T19:00:19.216413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:38:32.051820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.868471+0000","last_change":"2023-06-10T19:00:20.665740+0000","last_active":"2023-06-10T19:00:21.868471+0000","last_peered":"2023-06-10T19:00:21.868471+0000","last_clean":"2023-06-10T19:00:21.868471+0000","last_became_active":"2023-06-10T19:00:20.664762+0000","last_became_peered":"2023-06-10T19:00:20.664762+0000","last_unstale":"2023-06-10T19:00:21.868471+0000","last_undegraded":"2023-06-10T19:00:21.868471+0000","last_fullsized":"2023-06-10T19:00:21.868471+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:59:53.247451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.618797+0000","last_change":"2023-06-10T19:00:20.257806+0000","last_active":"2023-06-10T19:00:21.618797+0000","last_peered":"2023-06-10T19:00:21.618797+0000","last_clean":"2023-06-10T19:00:21.618797+0000","last_became_active":"2023-06-10T19:00:20.257387+0000","last_became_peered":"2023-06-10T19:00:20.257387+0000","last_unstale":"2023-06-10T19:00:21.618797+0000","last_undegraded":"2023-06-10T19:00:21.618797+0000","last_fullsized":"2023-06-10T19:00:21.618797+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_clean_scrub_stamp":"2023-06-10T19:00:19.216413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:27:30.022143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.621310+0000","last_change":"2023-06-10T19:00:20.631749+0000","last_active":"2023-06-10T19:00:21.621310+0000","last_peered":"2023-06-10T19:00:21.621310+0000","last_clean":"2023-06-10T19:00:21.621310+0000","last_became_active":"2023-06-10T19:00:20.631463+0000","last_became_peered":"2023-06-10T19:00:20.631463+0000","last_unstale":"2023-06-10T19:00:21.621310+0000","last_undegraded":"2023-06-10T19:00:21.621310+0000","last_fullsized":"2023-06-10T19:00:21.621310+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:24:57.833501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.869220+0000","last_change":"2023-06-10T19:00:20.260913+0000","last_active":"2023-06-10T19:00:21.869220+0000","last_peered":"2023-06-10T19:00:21.869220+0000","last_clean":"2023-06-10T19:00:21.869220+0000","last_became_active":"2023-06-10T19:00:20.260137+0000","last_became_peered":"2023-06-10T19:00:20.260137+0000","last_unstale":"2023-06-10T19:00:21.869220+0000","last_undegraded":"2023-06-10T19:00:21.869220+0000","last_fullsized":"2023-06-10T19:00:21.869220+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_clean_scrub_stamp":"2023-06-10T19:00:19.216413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:24:15.249571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.621090+0000","last_change":"2023-06-10T19:00:20.657131+0000","last_active":"2023-06-10T19:00:21.621090+0000","last_peered":"2023-06-10T19:00:21.621090+0000","last_clean":"2023-06-10T19:00:21.621090+0000","last_became_active":"2023-06-10T19:00:20.656934+0000","last_became_peered":"2023-06-10T19:00:20.656934+0000","last_unstale":"2023-06-10T19:00:21.621090+0000","last_undegraded":"2023-06-10T19:00:21.621090+0000","last_fullsized":"2023-06-10T19:00:21.621090+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:12:02.718119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.620816+0000","last_change":"2023-06-10T19:00:20.254021+0000","last_active":"2023-06-10T19:00:21.620816+0000","last_peered":"2023-06-10T19:00:21.620816+0000","last_clean":"2023-06-10T19:00:21.620816+0000","last_became_active":"2023-06-10T19:00:20.253697+0000","last_became_peered":"2023-06-10T19:00:20.253697+0000","last_unstale":"2023-06-10T19:00:21.620816+0000","last_undegraded":"2023-06-10T19:00:21.620816+0000","last_fullsized":"2023-06-10T19:00:21.620816+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_clean_scrub_stamp":"2023-06-10T19:00:19.216413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:01:31.360790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.866585+0000","last_change":"2023-06-10T19:00:20.655778+0000","last_active":"2023-06-10T19:00:21.866585+0000","last_peered":"2023-06-10T19:00:21.866585+0000","last_clean":"2023-06-10T19:00:21.866585+0000","last_became_active":"2023-06-10T19:00:20.654871+0000","last_became_peered":"2023-06-10T19:00:20.654871+0000","last_unstale":"2023-06-10T19:00:21.866585+0000","last_undegraded":"2023-06-10T19:00:21.866585+0000","last_fullsized":"2023-06-10T19:00:21.866585+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:02:56.856433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.868746+0000","last_change":"2023-06-10T19:00:20.272093+0000","last_active":"2023-06-10T19:00:21.868746+0000","last_peered":"2023-06-10T19:00:21.868746+0000","last_clean":"2023-06-10T19:00:21.868746+0000","last_became_active":"2023-06-10T19:00:20.271644+0000","last_became_peered":"2023-06-10T19:00:20.271644+0000","last_unstale":"2023-06-10T19:00:21.868746+0000","last_undegraded":"2023-06-10T19:00:21.868746+0000","last_fullsized":"2023-06-10T19:00:21.868746+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_clean_scrub_stamp":"2023-06-10T19:00:19.216413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:57:04.374037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":276,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.866042+0000","last_change":"2023-06-10T18:52:34.951528+0000","last_active":"2023-06-10T19:00:21.866042+0000","last_peered":"2023-06-10T19:00:21.866042+0000","last_clean":"2023-06-10T19:00:21.866042+0000","last_became_active":"2023-06-10T18:52:34.949099+0000","last_became_peered":"2023-06-10T18:52:34.949099+0000","last_unstale":"2023-06-10T19:00:21.866042+0000","last_undegraded":"2023-06-10T19:00:21.866042+0000","last_fullsized":"2023-06-10T19:00:21.866042+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_clean_scrub_stamp":"2023-06-10T18:52:33.633295+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:12:35.896485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":124,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.866772+0000","last_change":"2023-06-10T18:52:40.506384+0000","last_active":"2023-06-10T19:00:21.866772+0000","last_peered":"2023-06-10T19:00:21.866772+0000","last_clean":"2023-06-10T19:00:21.866772+0000","last_became_active":"2023-06-10T18:52:40.505701+0000","last_became_peered":"2023-06-10T18:52:40.505701+0000","last_unstale":"2023-06-10T19:00:21.866772+0000","last_undegraded":"2023-06-10T19:00:21.866772+0000","last_fullsized":"2023-06-10T19:00:21.866772+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:00:48.680188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.868380+0000","last_change":"2023-06-10T19:00:20.636194+0000","last_active":"2023-06-10T19:00:21.868380+0000","last_peered":"2023-06-10T19:00:21.868380+0000","last_clean":"2023-06-10T19:00:21.868380+0000","last_became_active":"2023-06-10T19:00:20.635976+0000","last_became_peered":"2023-06-10T19:00:20.635976+0000","last_unstale":"2023-06-10T19:00:21.868380+0000","last_undegraded":"2023-06-10T19:00:21.868380+0000","last_fullsized":"2023-06-10T19:00:21.868380+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:33:09.345089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.869558+0000","last_change":"2023-06-10T19:00:20.268844+0000","last_active":"2023-06-10T19:00:21.869558+0000","last_peered":"2023-06-10T19:00:21.869558+0000","last_clean":"2023-06-10T19:00:21.869558+0000","last_became_active":"2023-06-10T19:00:20.268548+0000","last_became_peered":"2023-06-10T19:00:20.268548+0000","last_unstale":"2023-06-10T19:00:21.869558+0000","last_undegraded":"2023-06-10T19:00:21.869558+0000","last_fullsized":"2023-06-10T19:00:21.869558+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_clean_scrub_stamp":"2023-06-10T19:00:19.216413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:12:18.745605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":120,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.865713+0000","last_change":"2023-06-10T18:52:40.512015+0000","last_active":"2023-06-10T19:00:21.865713+0000","last_peered":"2023-06-10T19:00:21.865713+0000","last_clean":"2023-06-10T19:00:21.865713+0000","last_became_active":"2023-06-10T18:52:40.511382+0000","last_became_peered":"2023-06-10T18:52:40.511382+0000","last_unstale":"2023-06-10T19:00:21.865713+0000","last_undegraded":"2023-06-10T19:00:21.865713+0000","last_fullsized":"2023-06-10T19:00:21.865713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:40:30.497554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.869991+0000","last_change":"2023-06-10T19:00:20.676138+0000","last_active":"2023-06-10T19:00:21.869991+0000","last_peered":"2023-06-10T19:00:21.869991+0000","last_clean":"2023-06-10T19:00:21.869991+0000","last_became_active":"2023-06-10T19:00:20.675704+0000","last_became_peered":"2023-06-10T19:00:20.675704+0000","last_unstale":"2023-06-10T19:00:21.869991+0000","last_undegraded":"2023-06-10T19:00:21.869991+0000","last_fullsized":"2023-06-10T19:00:21.869991+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:13:31.953515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.866532+0000","last_change":"2023-06-10T19:00:20.269225+0000","last_active":"2023-06-10T19:00:21.866532+0000","last_peered":"2023-06-10T19:00:21.866532+0000","last_clean":"2023-06-10T19:00:21.866532+0000","last_became_active":"2023-06-10T19:00:20.268785+0000","last_became_peered":"2023-06-10T19:00:20.268785+0000","last_unstale":"2023-06-10T19:00:21.866532+0000","last_undegraded":"2023-06-10T19:00:21.866532+0000","last_fullsized":"2023-06-10T19:00:21.866532+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_clean_scrub_stamp":"2023-06-10T19:00:19.216413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:10:52.458124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":126,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.617971+0000","last_change":"2023-06-10T18:52:40.671725+0000","last_active":"2023-06-10T19:00:21.617971+0000","last_peered":"2023-06-10T19:00:21.617971+0000","last_clean":"2023-06-10T19:00:21.617971+0000","last_became_active":"2023-06-10T18:52:40.671442+0000","last_became_peered":"2023-06-10T18:52:40.671442+0000","last_unstale":"2023-06-10T19:00:21.617971+0000","last_undegraded":"2023-06-10T19:00:21.617971+0000","last_fullsized":"2023-06-10T19:00:21.617971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:03:23.063913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.867721+0000","last_change":"2023-06-10T19:00:20.681067+0000","last_active":"2023-06-10T19:00:21.867721+0000","last_peered":"2023-06-10T19:00:21.867721+0000","last_clean":"2023-06-10T19:00:21.867721+0000","last_became_active":"2023-06-10T19:00:20.680815+0000","last_became_peered":"2023-06-10T19:00:20.680815+0000","last_unstale":"2023-06-10T19:00:21.867721+0000","last_undegraded":"2023-06-10T19:00:21.867721+0000","last_fullsized":"2023-06-10T19:00:21.867721+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:14:05.349604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"79'2","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.869474+0000","last_change":"2023-06-10T19:00:20.261963+0000","last_active":"2023-06-10T19:00:21.869474+0000","last_peered":"2023-06-10T19:00:21.869474+0000","last_clean":"2023-06-10T19:00:21.869474+0000","last_became_active":"2023-06-10T19:00:20.261604+0000","last_became_peered":"2023-06-10T19:00:20.261604+0000","last_unstale":"2023-06-10T19:00:21.869474+0000","last_undegraded":"2023-06-10T19:00:21.869474+0000","last_fullsized":"2023-06-10T19:00:21.869474+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_clean_scrub_stamp":"2023-06-10T19:00:19.216413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:59:56.735063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":124,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.866151+0000","last_change":"2023-06-10T18:52:40.510258+0000","last_active":"2023-06-10T19:00:21.866151+0000","last_peered":"2023-06-10T19:00:21.866151+0000","last_clean":"2023-06-10T19:00:21.866151+0000","last_became_active":"2023-06-10T18:52:40.509560+0000","last_became_peered":"2023-06-10T18:52:40.509560+0000","last_unstale":"2023-06-10T19:00:21.866151+0000","last_undegraded":"2023-06-10T19:00:21.866151+0000","last_fullsized":"2023-06-10T19:00:21.866151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:29:11.397620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.618550+0000","last_change":"2023-06-10T19:00:20.632381+0000","last_active":"2023-06-10T19:00:21.618550+0000","last_peered":"2023-06-10T19:00:21.618550+0000","last_clean":"2023-06-10T19:00:21.618550+0000","last_became_active":"2023-06-10T19:00:20.632138+0000","last_became_peered":"2023-06-10T19:00:20.632138+0000","last_unstale":"2023-06-10T19:00:21.618550+0000","last_undegraded":"2023-06-10T19:00:21.618550+0000","last_fullsized":"2023-06-10T19:00:21.618550+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:41:18.176341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"79'1","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.619037+0000","last_change":"2023-06-10T19:00:20.250291+0000","last_active":"2023-06-10T19:00:21.619037+0000","last_peered":"2023-06-10T19:00:21.619037+0000","last_clean":"2023-06-10T19:00:21.619037+0000","last_became_active":"2023-06-10T19:00:20.249868+0000","last_became_peered":"2023-06-10T19:00:20.249868+0000","last_unstale":"2023-06-10T19:00:21.619037+0000","last_undegraded":"2023-06-10T19:00:21.619037+0000","last_fullsized":"2023-06-10T19:00:21.619037+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_clean_scrub_stamp":"2023-06-10T19:00:19.216413+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:55:10.648879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":114,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.621146+0000","last_change":"2023-06-10T18:52:40.672266+0000","last_active":"2023-06-10T19:00:21.621146+0000","last_peered":"2023-06-10T19:00:21.621146+0000","last_clean":"2023-06-10T19:00:21.621146+0000","last_became_active":"2023-06-10T18:52:40.671966+0000","last_became_peered":"2023-06-10T18:52:40.671966+0000","last_unstale":"2023-06-10T19:00:21.621146+0000","last_undegraded":"2023-06-10T19:00:21.621146+0000","last_fullsized":"2023-06-10T19:00:21.621146+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:36:29.851285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.869318+0000","last_change":"2023-06-10T19:00:20.640918+0000","last_active":"2023-06-10T19:00:21.869318+0000","last_peered":"2023-06-10T19:00:21.869318+0000","last_clean":"2023-06-10T19:00:21.869318+0000","last_became_active":"2023-06-10T19:00:20.640655+0000","last_became_peered":"2023-06-10T19:00:20.640655+0000","last_unstale":"2023-06-10T19:00:21.869318+0000","last_undegraded":"2023-06-10T19:00:21.869318+0000","last_fullsized":"2023-06-10T19:00:21.869318+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:18:45.834616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.620968+0000","last_change":"2023-06-10T19:00:20.259096+0000","last_active":"2023-06-10T19:00:21.620968+0000","last_peered":"2023-06-10T19:00:21.620968+0000","last_clean":"2023-06-10T19:00:21.620968+0000","last_became_active":"2023-06-10T19:00:20.258754+0000","last_became_peered":"2023-06-10T19:00:20.258754+0000","last_unstale":"2023-06-10T19:00:21.620968+0000","last_undegraded":"2023-06-10T19:00:21.620968+0000","last_fullsized":"2023-06-10T19:00:21.620968+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_clean_scrub_stamp":"2023-06-10T19:00:19.216413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:58:35.104960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":120,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.867072+0000","last_change":"2023-06-10T18:52:40.671084+0000","last_active":"2023-06-10T19:00:21.867072+0000","last_peered":"2023-06-10T19:00:21.867072+0000","last_clean":"2023-06-10T19:00:21.867072+0000","last_became_active":"2023-06-10T18:52:40.670697+0000","last_became_peered":"2023-06-10T18:52:40.670697+0000","last_unstale":"2023-06-10T19:00:21.867072+0000","last_undegraded":"2023-06-10T19:00:21.867072+0000","last_fullsized":"2023-06-10T19:00:21.867072+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:47:29.134406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.866198+0000","last_change":"2023-06-10T19:00:20.636907+0000","last_active":"2023-06-10T19:00:21.866198+0000","last_peered":"2023-06-10T19:00:21.866198+0000","last_clean":"2023-06-10T19:00:21.866198+0000","last_became_active":"2023-06-10T19:00:20.636657+0000","last_became_peered":"2023-06-10T19:00:20.636657+0000","last_unstale":"2023-06-10T19:00:21.866198+0000","last_undegraded":"2023-06-10T19:00:21.866198+0000","last_fullsized":"2023-06-10T19:00:21.866198+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:45:54.708520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"79'1","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.867374+0000","last_change":"2023-06-10T19:00:20.282747+0000","last_active":"2023-06-10T19:00:21.867374+0000","last_peered":"2023-06-10T19:00:21.867374+0000","last_clean":"2023-06-10T19:00:21.867374+0000","last_became_active":"2023-06-10T19:00:20.282173+0000","last_became_peered":"2023-06-10T19:00:20.282173+0000","last_unstale":"2023-06-10T19:00:21.867374+0000","last_undegraded":"2023-06-10T19:00:21.867374+0000","last_fullsized":"2023-06-10T19:00:21.867374+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_clean_scrub_stamp":"2023-06-10T19:00:19.216413+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:16:26.530271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":114,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.621362+0000","last_change":"2023-06-10T18:52:40.514114+0000","last_active":"2023-06-10T19:00:21.621362+0000","last_peered":"2023-06-10T19:00:21.621362+0000","last_clean":"2023-06-10T19:00:21.621362+0000","last_became_active":"2023-06-10T18:52:40.513638+0000","last_became_peered":"2023-06-10T18:52:40.513638+0000","last_unstale":"2023-06-10T19:00:21.621362+0000","last_undegraded":"2023-06-10T19:00:21.621362+0000","last_fullsized":"2023-06-10T19:00:21.621362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:54:50.528282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.617962+0000","last_change":"2023-06-10T19:00:20.670283+0000","last_active":"2023-06-10T19:00:21.617962+0000","last_peered":"2023-06-10T19:00:21.617962+0000","last_clean":"2023-06-10T19:00:21.617962+0000","last_became_active":"2023-06-10T19:00:20.669961+0000","last_became_peered":"2023-06-10T19:00:20.669961+0000","last_unstale":"2023-06-10T19:00:21.617962+0000","last_undegraded":"2023-06-10T19:00:21.617962+0000","last_fullsized":"2023-06-10T19:00:21.617962+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:31:05.035965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"79'2","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.620206+0000","last_change":"2023-06-10T19:00:20.262530+0000","last_active":"2023-06-10T19:00:21.620206+0000","last_peered":"2023-06-10T19:00:21.620206+0000","last_clean":"2023-06-10T19:00:21.620206+0000","last_became_active":"2023-06-10T19:00:20.261795+0000","last_became_peered":"2023-06-10T19:00:20.261795+0000","last_unstale":"2023-06-10T19:00:21.620206+0000","last_undegraded":"2023-06-10T19:00:21.620206+0000","last_fullsized":"2023-06-10T19:00:21.620206+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_clean_scrub_stamp":"2023-06-10T19:00:19.216413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:11:08.325612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":122,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.870153+0000","last_change":"2023-06-10T18:52:40.515396+0000","last_active":"2023-06-10T19:00:21.870153+0000","last_peered":"2023-06-10T19:00:21.870153+0000","last_clean":"2023-06-10T19:00:21.870153+0000","last_became_active":"2023-06-10T18:52:40.514663+0000","last_became_peered":"2023-06-10T18:52:40.514663+0000","last_unstale":"2023-06-10T19:00:21.870153+0000","last_undegraded":"2023-06-10T19:00:21.870153+0000","last_fullsized":"2023-06-10T19:00:21.870153+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:30:56.373122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574945,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32584,"kb_used_data":1536,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339256,"statfs":{"total":96636764160,"available":96603398144,"internally_reserved":0,"allocated":1572864,"data_stored":1030228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:59:50 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.93899999999999995,"15min":0.89500000000000002},"min":{"1min":0.64600000000000002,"5min":0.434,"15min":0.434},"max":{"1min":1.167,"5min":1.3759999999999999,"15min":1.6220000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.93400000000000005,"15min":0.92800000000000005},"min":{"1min":0.78100000000000003,"5min":0.496,"15min":0.496},"max":{"1min":1.1819999999999999,"5min":1.264,"15min":1.6870000000000001},"last":0.97099999999999997}]},{"osd":1,"last update":"Sat Jun 10 18:59:50 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.93000000000000005,"15min":0.92100000000000004},"min":{"1min":0.55100000000000005,"5min":0.54200000000000004,"15min":0.53900000000000003},"max":{"1min":1.262,"5min":1.3759999999999999,"15min":1.377},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.97899999999999998,"15min":0.93200000000000005},"min":{"1min":0.76600000000000001,"5min":0.70099999999999996,"15min":0.504},"max":{"1min":1.129,"5min":1.2529999999999999,"15min":1.5960000000000001},"last":0.72999999999999998}]},{"osd":2,"last update":"Sat Jun 10 18:59:50 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.84899999999999998,"15min":0.83299999999999996},"min":{"1min":0.64900000000000002,"5min":0.49299999999999999,"15min":0.47099999999999997},"max":{"1min":1.1599999999999999,"5min":1.214,"15min":1.4059999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.89200000000000002,"15min":0.90000000000000002},"min":{"1min":0.66900000000000004,"5min":0.53000000000000003,"15min":0.50600000000000001},"max":{"1min":1.157,"5min":1.325,"15min":1.367},"last":0.78100000000000003}]},{"osd":3,"last update":"Sat Jun 10 18:59:50 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.93799999999999994,"15min":0.90900000000000003},"min":{"1min":0.72499999999999998,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.1459999999999999,"5min":1.1799999999999999,"15min":1.502},"last":0.85199999999999998},{"interface":"front","average":{"1min":1.006,"5min":0.95199999999999996,"15min":0.93600000000000005},"min":{"1min":0.67800000000000005,"5min":0.59599999999999997,"15min":0.53800000000000003},"max":{"1min":1.2170000000000001,"5min":1.284,"15min":1.2929999999999999},"last":0.89800000000000002}]},{"osd":4,"last update":"Sat Jun 10 18:59:50 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.84699999999999998,"15min":0.86599999999999999},"min":{"1min":0.60599999999999998,"5min":0.57399999999999995,"15min":0.32700000000000001},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.639},"last":1.0620000000000001},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.95099999999999996,"15min":0.97299999999999998},"min":{"1min":0.68300000000000005,"5min":0.65200000000000002,"15min":0.40000000000000002},"max":{"1min":1.262,"5min":1.365,"15min":1.411},"last":0.93799999999999994}]},{"osd":5,"last update":"Sat Jun 10 18:59:50 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.99399999999999999,"15min":1.0209999999999999},"min":{"1min":0.70199999999999996,"5min":0.60099999999999998,"15min":0.38400000000000001},"max":{"1min":1.3029999999999999,"5min":1.395,"15min":1.806},"last":1.02},{"interface":"front","average":{"1min":1.026,"5min":1.0309999999999999,"15min":1.0429999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.46500000000000002},"max":{"1min":1.242,"5min":1.292,"15min":1.522},"last":1.0900000000000001}]},{"osd":6,"last update":"Sat Jun 10 18:59:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.016,"15min":1.0069999999999999},"min":{"1min":0.751,"5min":0.66400000000000003,"15min":0.36899999999999999},"max":{"1min":1.2470000000000001,"5min":1.369,"15min":1.718},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.1060000000000001,"15min":1.0920000000000001},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.441},"max":{"1min":1.325,"5min":1.4350000000000001,"15min":1.464},"last":1.161}]}]},{"osd":6,"up_from":13,"seq":55834574946,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":964,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":987136,"data_stored":441402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.92900000000000005,"15min":0.83999999999999997},"min":{"1min":0.58699999999999997,"5min":0.52600000000000002,"15min":0.502},"max":{"1min":1.1759999999999999,"5min":1.498,"15min":1.498},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.91900000000000004,"15min":0.86399999999999999},"min":{"1min":0.60899999999999999,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1619999999999999,"5min":1.496,"15min":1.496},"last":0.68999999999999995}]},{"osd":1,"last update":"Sat Jun 10 18:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.88800000000000001,"15min":0.85999999999999999},"min":{"1min":0.66000000000000003,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.143,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.93600000000000005,"15min":0.879},"min":{"1min":0.67500000000000004,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.167,"5min":1.778,"15min":1.778},"last":0.57299999999999995}]},{"osd":2,"last update":"Sat Jun 10 18:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.91200000000000003,"15min":0.874},"min":{"1min":0.67700000000000005,"5min":0.57399999999999995,"15min":0.56499999999999995},"max":{"1min":1.2,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.90400000000000003,"15min":0.89200000000000002},"min":{"1min":0.76900000000000002,"5min":0.60299999999999998,"15min":0.57999999999999996},"max":{"1min":1.0629999999999999,"5min":1.246,"15min":1.246},"last":0.83799999999999997}]},{"osd":3,"last update":"Sat Jun 10 18:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.95799999999999996,"15min":0.88100000000000001},"min":{"1min":0.69599999999999995,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.222,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0029999999999999,"15min":0.996},"min":{"1min":0.75900000000000001,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.25,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.86799999999999999}]},{"osd":4,"last update":"Sat Jun 10 18:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.88900000000000001,"15min":0.93899999999999995},"min":{"1min":0.59799999999999998,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.149,"5min":1.798,"15min":1.798},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.96499999999999997,"15min":1.0029999999999999},"min":{"1min":0.65400000000000003,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.2150000000000001,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.92900000000000005}]},{"osd":5,"last update":"Sat Jun 10 18:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.89700000000000002,"15min":0.94299999999999995},"min":{"1min":0.67300000000000004,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.1160000000000001,"5min":1.333,"15min":1.333},"last":0.63},{"interface":"front","average":{"1min":1.002,"5min":1.036,"15min":1.03},"min":{"1min":0.71099999999999997,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.2090000000000001,"5min":2.536,"15min":2.536},"last":0.90500000000000003}]},{"osd":7,"last update":"Sat Jun 10 18:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":1.008,"15min":1.0389999999999999},"min":{"1min":0.629,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.2649999999999999,"5min":1.917,"15min":1.917},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.999,"15min":1.0449999999999999},"min":{"1min":0.65500000000000003,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.1950000000000001,"5min":1.395,"15min":1.5569999999999999},"last":0.76000000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574946,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27908,"kb_used_data":956,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343932,"statfs":{"total":96636764160,"available":96608186368,"internally_reserved":0,"allocated":978944,"data_stored":439872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.89800000000000002,"15min":0.85099999999999998},"min":{"1min":0.59899999999999998,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.115,"5min":1.232,"15min":1.232},"last":0.97199999999999998},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.88900000000000001,"15min":0.92300000000000004},"min":{"1min":0.68500000000000005,"5min":0.51400000000000001,"15min":0.49399999999999999},"max":{"1min":1.111,"5min":1.292,"15min":1.637},"last":0.73599999999999999}]},{"osd":1,"last update":"Sat Jun 10 18:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.90000000000000002,"15min":0.91000000000000003},"min":{"1min":0.74299999999999999,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.177,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":1.0009999999999999},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.92100000000000004,"15min":0.91800000000000004},"min":{"1min":0.65900000000000003,"5min":0.57699999999999996,"15min":0.53800000000000003},"max":{"1min":1.264,"5min":1.444,"15min":1.78},"last":1.022}]},{"osd":2,"last update":"Sat Jun 10 18:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.88700000000000001,"15min":0.86199999999999999},"min":{"1min":0.70799999999999996,"5min":0.49299999999999999,"15min":0.48299999999999998},"max":{"1min":1.196,"5min":1.2849999999999999,"15min":1.446},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.92600000000000005,"15min":0.91400000000000003},"min":{"1min":0.73299999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.181,"5min":1.361,"15min":1.361},"last":1.0740000000000001}]},{"osd":3,"last update":"Sat Jun 10 18:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.95299999999999996,"15min":0.94699999999999995},"min":{"1min":0.755,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.111,"5min":1.3440000000000001,"15min":1.484},"last":0.91200000000000003},{"interface":"front","average":{"1min":1.04,"5min":0.96899999999999997,"15min":1.02},"min":{"1min":0.78600000000000003,"5min":0.66300000000000003,"15min":0.61699999999999999},"max":{"1min":1.236,"5min":1.2969999999999999,"15min":1.337},"last":1.042}]},{"osd":4,"last update":"Sat Jun 10 18:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89800000000000002,"15min":0.96099999999999997},"min":{"1min":0.67400000000000004,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.1419999999999999,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.97299999999999998,"15min":1.038},"min":{"1min":0.65300000000000002,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.204,"5min":1.528,"15min":1.575},"last":0.66600000000000004}]},{"osd":6,"last update":"Sat Jun 10 18:59:41 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":0.96299999999999997,"15min":1.044},"min":{"1min":0.67200000000000004,"5min":0.629,"15min":0.56399999999999995},"max":{"1min":1.292,"5min":1.3660000000000001,"15min":1.4330000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":1.056,"5min":1.0109999999999999,"15min":1.0580000000000001},"min":{"1min":0.80200000000000005,"5min":0.66500000000000004,"15min":0.57899999999999996},"max":{"1min":1.343,"5min":1.554,"15min":1.554},"last":1.1259999999999999}]},{"osd":7,"last update":"Sat Jun 10 18:59:41 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.0469999999999999,"15min":1.137},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.3759999999999999,"5min":1.573,"15min":1.873},"last":0.79100000000000004},{"interface":"front","average":{"1min":1.073,"5min":1.097,"15min":1.155},"min":{"1min":0.72499999999999998,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.4159999999999999,"5min":1.4750000000000001,"15min":1.5029999999999999},"last":1.0980000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574945,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32020,"kb_used_data":972,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339820,"statfs":{"total":96636764160,"available":96603975680,"internally_reserved":0,"allocated":995328,"data_stored":441506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:59:51 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.875,"15min":0.78400000000000003},"min":{"1min":0.59099999999999997,"5min":0.49299999999999999,"15min":0.45100000000000001},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.2},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96099999999999997,"15min":0.90200000000000002},"min":{"1min":0.70099999999999996,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1839999999999999,"5min":3.7280000000000002,"15min":3.7280000000000002},"last":0.76300000000000001}]},{"osd":1,"last update":"Sat Jun 10 18:59:51 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.96399999999999997,"15min":0.95499999999999996},"min":{"1min":0.73299999999999998,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.254,"5min":3.3969999999999998,"15min":3.3969999999999998},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.89500000000000002,"15min":0.85799999999999998},"min":{"1min":0.72299999999999998,"5min":0.503,"15min":0.503},"max":{"1min":1.1579999999999999,"5min":2.496,"15min":2.496},"last":0.89800000000000002}]},{"osd":2,"last update":"Sat Jun 10 18:59:51 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90900000000000003,"15min":0.88300000000000001},"min":{"1min":0.68100000000000005,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.177,"5min":1.522,"15min":1.522},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.056,"5min":1.0089999999999999,"15min":1.004},"min":{"1min":0.82999999999999996,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.2769999999999999,"5min":3.5750000000000002,"15min":3.5750000000000002},"last":0.68300000000000005}]},{"osd":3,"last update":"Sat Jun 10 18:59:51 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.91300000000000003,"15min":0.88800000000000001},"min":{"1min":0.74299999999999999,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.075,"5min":2.3809999999999998,"15min":2.3809999999999998},"last":0.97599999999999998},{"interface":"front","average":{"1min":1.0409999999999999,"5min":0.99199999999999999,"15min":0.96199999999999997},"min":{"1min":0.86699999999999999,"5min":0.65400000000000003,"15min":0.54400000000000004},"max":{"1min":1.214,"5min":1.4490000000000001,"15min":1.6479999999999999},"last":1.04}]},{"osd":5,"last update":"Sat Jun 10 18:59:51 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.95099999999999996,"15min":0.98699999999999999},"min":{"1min":0.69699999999999995,"5min":0.59199999999999997,"15min":0.56899999999999995},"max":{"1min":1.1910000000000001,"5min":3.6539999999999999,"15min":3.6539999999999999},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.94999999999999996,"15min":0.97499999999999998},"min":{"1min":0.65000000000000002,"5min":0.58099999999999996,"15min":0.54300000000000004},"max":{"1min":1.2470000000000001,"5min":2.6720000000000002,"15min":2.6720000000000002},"last":1.0660000000000001}]},{"osd":6,"last update":"Sat Jun 10 18:59:51 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.94399999999999995,"15min":1.0029999999999999},"min":{"1min":0.65600000000000003,"5min":0.629,"15min":0.54900000000000004},"max":{"1min":1.28,"5min":1.5720000000000001,"15min":2.2639999999999998},"last":0.81699999999999995},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.079,"15min":1.0760000000000001},"min":{"1min":0.71899999999999997,"5min":0.68999999999999995,"15min":0.57499999999999996},"max":{"1min":1.266,"5min":3.4980000000000002,"15min":3.4980000000000002},"last":0.84299999999999997}]},{"osd":7,"last update":"Sat Jun 10 18:59:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":0.98799999999999999,"15min":0.99199999999999999},"min":{"1min":0.67300000000000004,"5min":0.66300000000000003,"15min":0.41399999999999998},"max":{"1min":1.482,"5min":2.5910000000000002,"15min":2.5910000000000002},"last":1.123},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.0720000000000001,"15min":1.073},"min":{"1min":0.78900000000000003,"5min":0.628,"15min":0.628},"max":{"1min":1.2829999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.872}]}]},{"osd":3,"up_from":13,"seq":55834574944,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32000,"kb_used_data":952,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339840,"statfs":{"total":96636764160,"available":96603996160,"internally_reserved":0,"allocated":974848,"data_stored":439401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.65400000000000003,"15min":0.59399999999999997},"min":{"1min":0.54200000000000004,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.998,"5min":1.169,"15min":1.169},"last":1.01},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.70699999999999996,"15min":0.65100000000000002},"min":{"1min":0.60899999999999999,"5min":0.251,"15min":0.251},"max":{"1min":1.1679999999999999,"5min":1.286,"15min":1.286},"last":0.51300000000000001}]},{"osd":1,"last update":"Sat Jun 10 18:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.72699999999999998,"15min":0.64900000000000002},"min":{"1min":0.59199999999999997,"5min":0.34300000000000003,"15min":0.27500000000000002},"max":{"1min":1.01,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.77500000000000002,"15min":0.72999999999999998},"min":{"1min":0.52900000000000003,"5min":0.33000000000000002,"15min":0.318},"max":{"1min":1.149,"5min":1.296,"15min":1.411},"last":0.69299999999999995}]},{"osd":2,"last update":"Sat Jun 10 18:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.82099999999999995,"15min":0.76700000000000002},"min":{"1min":0.66900000000000004,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.1160000000000001,"5min":1.3759999999999999,"15min":1.9530000000000001},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.82499999999999996,"15min":0.76300000000000001},"min":{"1min":0.66200000000000003,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.1499999999999999,"5min":1.278,"15min":1.278},"last":0.77400000000000002}]},{"osd":4,"last update":"Sat Jun 10 18:59:41 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":0.94299999999999995,"15min":0.95899999999999996},"min":{"1min":0.73499999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.2729999999999999,"5min":1.3360000000000001,"15min":1.488},"last":0.96299999999999997},{"interface":"front","average":{"1min":1.048,"5min":1.0089999999999999,"15min":0.99199999999999999},"min":{"1min":0.83999999999999997,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.228,"5min":1.3700000000000001,"15min":1.458},"last":1.216}]},{"osd":5,"last update":"Sat Jun 10 18:59:41 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.0229999999999999,"15min":1.044},"min":{"1min":0.91200000000000003,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.212,"5min":1.431,"15min":2.024},"last":0.91000000000000003},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.0600000000000001,"15min":1.0249999999999999},"min":{"1min":0.80700000000000005,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.724},"last":1.139}]},{"osd":6,"last update":"Sat Jun 10 18:59:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.0900000000000001,"15min":1.0580000000000001},"min":{"1min":0.78100000000000003,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.597,"5min":1.597,"15min":1.8500000000000001},"last":1.252},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.0640000000000001,"15min":1.0669999999999999},"min":{"1min":0.89400000000000002,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.3420000000000001,"5min":1.514,"15min":1.78},"last":1.095}]},{"osd":7,"last update":"Sat Jun 10 18:59:41 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.103,"15min":1.1180000000000001},"min":{"1min":0.97199999999999998,"5min":0.60999999999999999,"15min":0.56999999999999995},"max":{"1min":1.3879999999999999,"5min":1.5900000000000001,"15min":1.9079999999999999},"last":1.181},{"interface":"front","average":{"1min":1.163,"5min":1.135,"15min":1.087},"min":{"1min":0.91200000000000003,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.3200000000000001,"5min":1.5429999999999999,"15min":1.6719999999999999},"last":1.048}]}]},{"osd":2,"up_from":13,"seq":55834574945,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32012,"kb_used_data":964,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339828,"statfs":{"total":96636764160,"available":96603983872,"internally_reserved":0,"allocated":987136,"data_stored":440580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:59:46 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.63500000000000001,"15min":0.59999999999999998},"min":{"1min":0.51000000000000001,"5min":0.28899999999999998,"15min":0.27300000000000002},"max":{"1min":0.98799999999999999,"5min":1.095,"15min":1.1220000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73999999999999999,"15min":0.72199999999999998},"min":{"1min":0.52600000000000002,"5min":0.436,"15min":0.378},"max":{"1min":0.93999999999999995,"5min":1.194,"15min":1.224},"last":1.141}]},{"osd":1,"last update":"Sat Jun 10 18:59:46 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69699999999999995,"15min":0.66100000000000003},"min":{"1min":0.49299999999999999,"5min":0.39700000000000002,"15min":0.307},"max":{"1min":0.91400000000000003,"5min":1.099,"15min":1.1950000000000001},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.878,"5min":0.81499999999999995,"15min":0.72499999999999998},"min":{"1min":0.54400000000000004,"5min":0.33300000000000002,"15min":0.29499999999999998},"max":{"1min":1.1579999999999999,"5min":1.264,"15min":1.264},"last":0.91700000000000004}]},{"osd":3,"last update":"Sat Jun 10 18:59:46 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82199999999999995,"15min":0.73799999999999999},"min":{"1min":0.60299999999999998,"5min":0.40999999999999998,"15min":0.377},"max":{"1min":1.145,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":1},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.82599999999999996,"15min":0.76800000000000002},"min":{"1min":0.61199999999999999,"5min":0.32900000000000001,"15min":0.252},"max":{"1min":1.1180000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":1.1040000000000001}]},{"osd":4,"last update":"Sat Jun 10 18:59:46 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.95899999999999996,"15min":0.92600000000000005},"min":{"1min":0.72799999999999998,"5min":0.56200000000000006,"15min":0.53400000000000003},"max":{"1min":1.1970000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.034,"5min":1.0329999999999999,"15min":1.032},"min":{"1min":0.65900000000000003,"5min":0.60899999999999999,"15min":0.57699999999999996},"max":{"1min":1.254,"5min":1.476,"15min":1.4950000000000001},"last":1.484}]},{"osd":5,"last update":"Sat Jun 10 18:59:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.034,"15min":1.02},"min":{"1min":0.72999999999999998,"5min":0.64600000000000002,"15min":0.54100000000000004},"max":{"1min":1.3,"5min":1.379,"15min":1.5700000000000001},"last":1.379},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0429999999999999,"15min":1},"min":{"1min":0.69499999999999995,"5min":0.68500000000000005,"15min":0.60099999999999998},"max":{"1min":1.2350000000000001,"5min":1.4119999999999999,"15min":1.667},"last":1.1910000000000001}]},{"osd":6,"last update":"Sat Jun 10 18:59:46 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.073,"15min":1.038},"min":{"1min":0.65200000000000002,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.2410000000000001,"5min":1.4550000000000001,"15min":1.5900000000000001},"last":1.4259999999999999},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.079,"15min":1.0449999999999999},"min":{"1min":0.77400000000000002,"5min":0.66000000000000003,"15min":0.60699999999999998},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":1.2589999999999999}]},{"osd":7,"last update":"Sat Jun 10 18:59:46 2023","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.1100000000000001,"15min":1.101},"min":{"1min":0.97399999999999998,"5min":0.623,"15min":0.62},"max":{"1min":1.724,"5min":1.724,"15min":1.724},"last":1.5800000000000001},{"interface":"front","average":{"1min":1.137,"5min":1.147,"15min":1.097},"min":{"1min":0.72699999999999998,"5min":0.71799999999999997,"15min":0.59299999999999997},"max":{"1min":1.3680000000000001,"5min":1.5920000000000001,"15min":1.752},"last":1.51}]}]},{"osd":1,"up_from":13,"seq":55834574947,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32004,"kb_used_data":956,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339836,"statfs":{"total":96636764160,"available":96603992064,"internally_reserved":0,"allocated":978944,"data_stored":438931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:59:52 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.71899999999999997,"15min":0.67500000000000004},"min":{"1min":0.47799999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.94399999999999995,"5min":1.288,"15min":1.288},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.88,"5min":0.80700000000000005,"15min":0.71899999999999997},"min":{"1min":0.745,"5min":0.33800000000000002,"15min":0.26900000000000002},"max":{"1min":1.024,"5min":1.056,"15min":1.694},"last":0.59599999999999997}]},{"osd":2,"last update":"Sat Jun 10 18:59:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.66000000000000003,"15min":0.63100000000000001},"min":{"1min":0.52900000000000003,"5min":0.27300000000000002,"15min":0.249},"max":{"1min":0.99399999999999999,"5min":1.21,"15min":1.21},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.78200000000000003,"15min":0.69099999999999995},"min":{"1min":0.55200000000000005,"5min":0.33800000000000002,"15min":0.315},"max":{"1min":1.097,"5min":1.415,"15min":1.415},"last":0.45000000000000001}]},{"osd":3,"last update":"Sat Jun 10 18:59:52 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.83899999999999997,"15min":0.76900000000000002},"min":{"1min":0.60199999999999998,"5min":0.33400000000000002,"15min":0.26400000000000001},"max":{"1min":1.3049999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.76800000000000002,"15min":0.753},"min":{"1min":0.60599999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":2.1749999999999998},"last":0.36699999999999999}]},{"osd":4,"last update":"Sat Jun 10 18:59:52 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.88900000000000001,"15min":0.84899999999999998},"min":{"1min":0.64500000000000002,"5min":0.56799999999999995,"15min":0.53000000000000003},"max":{"1min":1.2050000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0409999999999999,"15min":1.071},"min":{"1min":0.876,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.5129999999999999,"5min":1.5449999999999999,"15min":5.8209999999999997},"last":0.54600000000000004}]},{"osd":5,"last update":"Sat Jun 10 18:59:52 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.0069999999999999,"15min":1.02},"min":{"1min":0.76900000000000002,"5min":0.58499999999999996,"15min":0.56599999999999995},"max":{"1min":1.2649999999999999,"5min":1.589,"15min":1.8620000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.995,"5min":0.98499999999999999,"15min":0.97599999999999998},"min":{"1min":0.879,"5min":0.60699999999999998,"15min":0.57299999999999995},"max":{"1min":1.1930000000000001,"5min":1.3819999999999999,"15min":3.089},"last":0.70999999999999996}]},{"osd":6,"last update":"Sat Jun 10 18:59:52 2023","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.0680000000000001,"15min":1.0469999999999999},"min":{"1min":0.79300000000000004,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.353,"5min":1.5249999999999999,"15min":7.2599999999999998},"last":0.72299999999999998},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.026,"15min":1.036},"min":{"1min":0.82199999999999995,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.2829999999999999,"5min":1.591,"15min":9.0069999999999997},"last":0.68100000000000005}]},{"osd":7,"last update":"Sat Jun 10 18:59:52 2023","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.121,"15min":1.091},"min":{"1min":0.98599999999999999,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.573,"5min":1.6879999999999999,"15min":2.105},"last":0.69199999999999995},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.135,"15min":1.0860000000000001},"min":{"1min":1.008,"5min":0.65600000000000003,"15min":0.64100000000000001},"max":{"1min":1.343,"5min":1.673,"15min":2.2570000000000001},"last":0.61899999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574946,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32576,"kb_used_data":1528,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339264,"statfs":{"total":96636764160,"available":96603406336,"internally_reserved":0,"allocated":1564672,"data_stored":1029187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jun 10 18:59:44 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.67600000000000005,"15min":0.621},"min":{"1min":0.48999999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.99199999999999999,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.85899999999999999,"15min":0.77900000000000003},"min":{"1min":0.67600000000000005,"5min":0.34100000000000003,"15min":0.34000000000000002},"max":{"1min":1.2230000000000001,"5min":1.302,"15min":1.4059999999999999},"last":0.45000000000000001}]},{"osd":2,"last update":"Sat Jun 10 18:59:44 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.73499999999999999,"15min":0.70699999999999996},"min":{"1min":0.53700000000000003,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.071,"5min":1.1399999999999999,"15min":1.2829999999999999},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.68799999999999994,"15min":0.64700000000000002},"min":{"1min":0.56299999999999994,"5min":0.245,"15min":0.245},"max":{"1min":0.93799999999999994,"5min":1.139,"15min":1.371},"last":0.50900000000000001}]},{"osd":3,"last update":"Sat Jun 10 18:59:44 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.72799999999999998,"15min":0.68600000000000005},"min":{"1min":0.56999999999999995,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.93100000000000005,"5min":1.222,"15min":1.226},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.85899999999999999,"15min":0.82299999999999995},"min":{"1min":0.71899999999999997,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.107,"5min":1.296,"15min":1.829},"last":0.53700000000000003}]},{"osd":4,"last update":"Sat Jun 10 18:59:44 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.95999999999999996,"15min":0.91200000000000003},"min":{"1min":0.77000000000000002,"5min":0.59099999999999997,"15min":0.56100000000000005},"max":{"1min":1.1850000000000001,"5min":3.0209999999999999,"15min":3.0209999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":1.05,"5min":1.044,"15min":1.036},"min":{"1min":0.74099999999999999,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.2190000000000001,"5min":1.3819999999999999,"15min":1.9510000000000001},"last":0.751}]},{"osd":5,"last update":"Sat Jun 10 18:59:44 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.94499999999999995,"15min":0.95199999999999996},"min":{"1min":0.76100000000000001,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.175,"5min":1.351,"15min":1.694},"last":0.80800000000000005},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0429999999999999,"15min":1.014},"min":{"1min":0.753,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.3500000000000001,"5min":4.5620000000000003,"15min":4.5620000000000003},"last":0.73599999999999999}]},{"osd":6,"last update":"Sat Jun 10 18:59:44 2023","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.1319999999999999,"15min":1.079},"min":{"1min":0.89500000000000002,"5min":0.58499999999999996,"15min":0.55900000000000005},"max":{"1min":1.254,"5min":3.5569999999999999,"15min":3.5569999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0309999999999999,"15min":1.0049999999999999},"min":{"1min":0.85599999999999998,"5min":0.60899999999999999,"15min":0.59999999999999998},"max":{"1min":1.248,"5min":1.625,"15min":1.883},"last":0.92000000000000004}]},{"osd":7,"last update":"Sat Jun 10 18:59:44 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.0569999999999999,"15min":1.038},"min":{"1min":0.77600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.337,"5min":1.4850000000000001,"15min":1.5800000000000001},"last":0.875},{"interface":"front","average":{"1min":1.147,"5min":1.0880000000000001,"15min":1.0620000000000001},"min":{"1min":0.84299999999999997,"5min":0.61099999999999999,"15min":0.58699999999999997},"max":{"1min":1.407,"5min":1.4610000000000001,"15min":1.9830000000000001},"last":0.64900000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-10T19:00:24.641 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-10T19:00:24.804 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.800+0000 7fa73f875640 1 Processor -- start 2023-06-10T19:00:24.804 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.800+0000 7fa73f875640 1 -- start start 2023-06-10T19:00:24.805 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.800+0000 7fa73f875640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa73806b2f0 0x7fa73806f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:24.805 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.800+0000 7fa73f875640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa738158a90 con 0x7fa738160170 2023-06-10T19:00:24.805 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.800+0000 7fa73f875640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7380705d0 con 0x7fa7380c8d00 2023-06-10T19:00:24.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.800+0000 7fa73f875640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7380cce10 con 0x7fa73806b2f0 2023-06-10T19:00:24.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.800+0000 7fa73de12640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fa738160170 0x7fa738162550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:33732/0 (socket says 172.21.15.53:33732) 2023-06-10T19:00:24.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.800+0000 7fa73de12640 1 -- 172.21.15.53:0/1912213922 learned_addr learned my addr 172.21.15.53:0/1912213922 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:00:24.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.800+0000 7fa73d611640 1 --2- 172.21.15.53:0/1912213922 >> v2:172.21.15.117:3300/0 conn(0x7fa73806b2f0 0x7fa73806f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:24.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.800+0000 7fa72ffff640 1 -- 172.21.15.53:0/1912213922 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1554800845 0 0) 0x7fa7300014a0 con 0x7fa738160170 2023-06-10T19:00:24.808 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.800+0000 7fa72ffff640 1 -- 172.21.15.53:0/1912213922 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa724003530 con 0x7fa738160170 2023-06-10T19:00:24.808 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.800+0000 7fa72ffff640 1 -- 172.21.15.53:0/1912213922 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 590525405 0 0) 0x7fa724003530 con 0x7fa738160170 2023-06-10T19:00:24.808 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.800+0000 7fa72ffff640 1 -- 172.21.15.53:0/1912213922 >> v2:172.21.15.117:3300/0 conn(0x7fa73806b2f0 msgr2=0x7fa73806f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:24.808 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.800+0000 7fa72ffff640 1 --2- 172.21.15.53:0/1912213922 >> v2:172.21.15.117:3300/0 conn(0x7fa73806b2f0 0x7fa73806f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:24.808 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.800+0000 7fa72ffff640 1 -- 172.21.15.53:0/1912213922 >> v1:172.21.15.117:6789/0 conn(0x7fa7380c8d00 legacy=0x7fa73806b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:24.808 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.800+0000 7fa72ffff640 1 -- 172.21.15.53:0/1912213922 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa73806f9c0 con 0x7fa738160170 2023-06-10T19:00:24.808 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.800+0000 7fa72ffff640 1 -- 172.21.15.53:0/1912213922 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fa730001b90 con 0x7fa738160170 2023-06-10T19:00:24.809 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.800+0000 7fa72ffff640 1 -- 172.21.15.53:0/1912213922 >> v1:172.21.15.53:6789/0 conn(0x7fa738160170 legacy=0x7fa738162550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:24.809 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.800+0000 7fa72ffff640 1 --2- 172.21.15.53:0/1912213922 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7240039f0 0x7fa724003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:24.809 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.800+0000 7fa72ffff640 1 --2- 172.21.15.53:0/1912213922 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7240047d0 0x7fa724004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:24.809 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.800+0000 7fa72ffff640 1 --2- 172.21.15.53:0/1912213922 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa724005180 0x7fa72400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:24.809 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.800+0000 7fa72ffff640 1 -- 172.21.15.53:0/1912213922 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7380cce10 con 0x7fa7240039f0 2023-06-10T19:00:24.809 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.800+0000 7fa72ffff640 1 -- 172.21.15.53:0/1912213922 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa72400bed0 con 0x7fa724005180 2023-06-10T19:00:24.809 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.800+0000 7fa72ffff640 1 -- 172.21.15.53:0/1912213922 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa72400c090 con 0x7fa7240047d0 2023-06-10T19:00:24.809 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.800+0000 7fa73d611640 1 --2- 172.21.15.53:0/1912213922 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7240039f0 0x7fa724003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:24.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.800+0000 7fa73ce10640 1 --2- 172.21.15.53:0/1912213922 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7240047d0 0x7fa724004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:24.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.800+0000 7fa73de12640 1 --2- 172.21.15.53:0/1912213922 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa724005180 0x7fa72400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:24.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.800+0000 7fa73d611640 1 -- 172.21.15.53:0/1912213922 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7240047d0 msgr2=0x7fa724004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:24.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.800+0000 7fa73d611640 1 --2- 172.21.15.53:0/1912213922 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7240047d0 0x7fa724004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:24.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.800+0000 7fa73d611640 1 -- 172.21.15.53:0/1912213922 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa724005180 msgr2=0x7fa72400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:24.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.800+0000 7fa73d611640 1 --2- 172.21.15.53:0/1912213922 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa724005180 0x7fa72400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:24.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.800+0000 7fa73d611640 1 -- 172.21.15.53:0/1912213922 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa724003530 con 0x7fa7240039f0 2023-06-10T19:00:24.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.800+0000 7fa73de12640 1 -- 172.21.15.53:0/1912213922 reap_dead start 2023-06-10T19:00:24.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.800+0000 7fa73ce10640 1 --2- 172.21.15.53:0/1912213922 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7240047d0 0x7fa724004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:00:24.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.804+0000 7fa73d611640 1 --2- 172.21.15.53:0/1912213922 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7240039f0 0x7fa724003e00 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7fa734009ae0 tx=0x7fa73401ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c602d8dab1e9cdf server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:24.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.804+0000 7fa72ffff640 1 -- 172.21.15.53:0/1912213922 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7340a5640 con 0x7fa7240039f0 2023-06-10T19:00:24.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.804+0000 7fa72ffff640 1 -- 172.21.15.53:0/1912213922 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7340a57a0 con 0x7fa7240039f0 2023-06-10T19:00:24.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.804+0000 7fa72ffff640 1 -- 172.21.15.53:0/1912213922 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7340a5b50 con 0x7fa7240039f0 2023-06-10T19:00:24.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.804+0000 7fa73f875640 1 -- 172.21.15.53:0/1912213922 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7240039f0 msgr2=0x7fa724003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:24.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.804+0000 7fa73f875640 1 --2- 172.21.15.53:0/1912213922 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7240039f0 0x7fa724003e00 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7fa734009ae0 tx=0x7fa73401ca50 comp rx=0 tx=0).stop 2023-06-10T19:00:24.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.804+0000 7fa73f875640 1 -- 172.21.15.53:0/1912213922 shutdown_connections 2023-06-10T19:00:24.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.804+0000 7fa73f875640 1 --2- 172.21.15.53:0/1912213922 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7240039f0 0x7fa724003e00 secure :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7fa734009ae0 tx=0x7fa73401ca50 comp rx=0 tx=0).stop 2023-06-10T19:00:24.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.804+0000 7fa73f875640 1 -- 172.21.15.53:0/1912213922 >> 172.21.15.53:0/1912213922 conn(0x7fa73806a0d0 msgr2=0x7fa7380ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:24.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.804+0000 7fa73f875640 1 -- 172.21.15.53:0/1912213922 shutdown_connections 2023-06-10T19:00:24.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.804+0000 7fa73f875640 1 -- 172.21.15.53:0/1912213922 wait complete. 2023-06-10T19:00:24.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.804+0000 7fa73f875640 1 Processor -- start 2023-06-10T19:00:24.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.804+0000 7fa73f875640 1 -- start start 2023-06-10T19:00:24.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.808+0000 7fa73f875640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa738150940 0x7fa7380c2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:24.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.808+0000 7fa73f875640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa738150d10 0x7fa73813e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:24.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.808+0000 7fa73f875640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa7380c4740 0x7fa738154c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:24.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.808+0000 7fa73f875640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7380c21d0 con 0x7fa738150d10 2023-06-10T19:00:24.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.808+0000 7fa73f875640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73813ebc0 con 0x7fa7380c4740 2023-06-10T19:00:24.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.808+0000 7fa73f875640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7380c36a0 con 0x7fa738150940 2023-06-10T19:00:24.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.808+0000 7fa73ce10640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa738150d10 0x7fa73813e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:24.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.808+0000 7fa73d611640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa738150940 0x7fa7380c2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:24.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.808+0000 7fa73ce10640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa738150d10 0x7fa73813e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33276/0 (socket says 172.21.15.53:33276) 2023-06-10T19:00:24.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.808+0000 7fa73ce10640 1 -- 172.21.15.53:0/2276684051 learned_addr learned my addr 172.21.15.53:0/2276684051 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:24.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.808+0000 7fa73de12640 1 --2- 172.21.15.53:0/2276684051 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa7380c4740 0x7fa738154c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:24.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.808+0000 7fa73ce10640 1 -- 172.21.15.53:0/2276684051 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa738150940 msgr2=0x7fa7380c2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:24.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.808+0000 7fa73ce10640 1 --2- 172.21.15.53:0/2276684051 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa738150940 0x7fa7380c2fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:24.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.808+0000 7fa73ce10640 1 -- 172.21.15.53:0/2276684051 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa7380c4740 msgr2=0x7fa738154c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:24.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.808+0000 7fa73ce10640 1 --2- 172.21.15.53:0/2276684051 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa7380c4740 0x7fa738154c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:24.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.808+0000 7fa73ce10640 1 -- 172.21.15.53:0/2276684051 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7380c3980 con 0x7fa738150d10 2023-06-10T19:00:24.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.808+0000 7fa73ce10640 1 --2- 172.21.15.53:0/2276684051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa738150d10 0x7fa73813e680 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7fa72800d4a0 tx=0x7fa72800d4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:24.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.808+0000 7fa72dffb640 1 -- 172.21.15.53:0/2276684051 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72800b070 con 0x7fa738150d10 2023-06-10T19:00:24.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.808+0000 7fa72dffb640 1 -- 172.21.15.53:0/2276684051 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7280052d0 con 0x7fa738150d10 2023-06-10T19:00:24.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.808+0000 7fa73f875640 1 -- 172.21.15.53:0/2276684051 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7380c3c60 con 0x7fa738150d10 2023-06-10T19:00:24.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.808+0000 7fa72dffb640 1 -- 172.21.15.53:0/2276684051 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa728003860 con 0x7fa738150d10 2023-06-10T19:00:24.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.808+0000 7fa73f875640 1 -- 172.21.15.53:0/2276684051 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7380c4220 con 0x7fa738150d10 2023-06-10T19:00:24.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.808+0000 7fa73f875640 1 -- 172.21.15.53:0/2276684051 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7380c43e0 con 0x7fa738150d10 2023-06-10T19:00:24.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.808+0000 7fa72dffb640 1 -- 172.21.15.53:0/2276684051 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa7280039c0 con 0x7fa738150d10 2023-06-10T19:00:24.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.808+0000 7fa72dffb640 1 --2- 172.21.15.53:0/2276684051 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa71c0662b0 0x7fa71c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:24.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.808+0000 7fa72dffb640 1 -- 172.21.15.53:0/2276684051 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa728083120 con 0x7fa738150d10 2023-06-10T19:00:24.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.808+0000 7fa73d611640 1 --2- 172.21.15.53:0/2276684051 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa71c0662b0 0x7fa71c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:24.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.812+0000 7fa73d611640 1 --2- 172.21.15.53:0/2276684051 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa71c0662b0 0x7fa71c068760 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fa7340af000 tx=0x7fa7340046d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:24.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.812+0000 7fa72dffb640 1 -- 172.21.15.53:0/2276684051 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa728050650 con 0x7fa738150d10 2023-06-10T19:00:24.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.964+0000 7fa73f875640 1 -- 172.21.15.53:0/2276684051 --> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa73806ff80 con 0x7fa71c0662b0 2023-06-10T19:00:24.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.988+0000 7fa72dffb640 1 -- 172.21.15.53:0/2276684051 <== mgr.4105 v2:172.21.15.117:6832/3061986771 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+309804 (secure 0 0 0) 0x7fa73400f080 con 0x7fa71c0662b0 2023-06-10T19:00:24.996 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:00:24.997 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-06-10T19:00:24.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.992+0000 7fa73f875640 1 -- 172.21.15.53:0/2276684051 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa71c0662b0 msgr2=0x7fa71c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:24.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.992+0000 7fa73f875640 1 --2- 172.21.15.53:0/2276684051 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa71c0662b0 0x7fa71c068760 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fa7340af000 tx=0x7fa7340046d0 comp rx=0 tx=0).stop 2023-06-10T19:00:24.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.992+0000 7fa73f875640 1 -- 172.21.15.53:0/2276684051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa738150d10 msgr2=0x7fa73813e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:24.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.992+0000 7fa73f875640 1 --2- 172.21.15.53:0/2276684051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa738150d10 0x7fa73813e680 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7fa72800d4a0 tx=0x7fa72800d4d0 comp rx=0 tx=0).stop 2023-06-10T19:00:24.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.992+0000 7fa73f875640 1 -- 172.21.15.53:0/2276684051 shutdown_connections 2023-06-10T19:00:24.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.992+0000 7fa73f875640 1 --2- 172.21.15.53:0/2276684051 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa71c0662b0 0x7fa71c068760 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:24.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.992+0000 7fa73f875640 1 --2- 172.21.15.53:0/2276684051 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa7380c4740 0x7fa738154c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:24.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.992+0000 7fa73f875640 1 --2- 172.21.15.53:0/2276684051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa738150d10 0x7fa73813e680 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:24.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.992+0000 7fa73f875640 1 --2- 172.21.15.53:0/2276684051 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa738150940 0x7fa7380c2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:24.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.992+0000 7fa73f875640 1 -- 172.21.15.53:0/2276684051 >> 172.21.15.53:0/2276684051 conn(0x7fa73806a0d0 msgr2=0x7fa7380ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:25.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.992+0000 7fa73f875640 1 -- 172.21.15.53:0/2276684051 shutdown_connections 2023-06-10T19:00:25.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:24.992+0000 7fa73f875640 1 -- 172.21.15.53:0/2276684051 wait complete. 2023-06-10T19:00:25.014 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":309,"stamp":"2023-06-10T19:00:23.727556+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":153,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":249020,"kb_used_data":8828,"kb_used_omap":0,"kb_used_meta":240128,"kb_avail":754725700,"statfs":{"total":773094113280,"available":772839116800,"internally_reserved":0,"allocated":9039872,"data_stored":4701107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":245891072},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":58,"apply_latency_ms":58,"commit_latency_ns":58000000,"apply_latency_ns":58000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.505144"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.866766+0000","last_change":"2023-06-10T19:00:20.656108+0000","last_active":"2023-06-10T19:00:21.866766+0000","last_peered":"2023-06-10T19:00:21.866766+0000","last_clean":"2023-06-10T19:00:21.866766+0000","last_became_active":"2023-06-10T19:00:20.655299+0000","last_became_peered":"2023-06-10T19:00:20.655299+0000","last_unstale":"2023-06-10T19:00:21.866766+0000","last_undegraded":"2023-06-10T19:00:21.866766+0000","last_fullsized":"2023-06-10T19:00:21.866766+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:17:09.516687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.868207+0000","last_change":"2023-06-10T19:00:20.630037+0000","last_active":"2023-06-10T19:00:21.868207+0000","last_peered":"2023-06-10T19:00:21.868207+0000","last_clean":"2023-06-10T19:00:21.868207+0000","last_became_active":"2023-06-10T19:00:20.629763+0000","last_became_peered":"2023-06-10T19:00:20.629763+0000","last_unstale":"2023-06-10T19:00:21.868207+0000","last_undegraded":"2023-06-10T19:00:21.868207+0000","last_fullsized":"2023-06-10T19:00:21.868207+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:10:53.462334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.621401+0000","last_change":"2023-06-10T19:00:20.638851+0000","last_active":"2023-06-10T19:00:21.621401+0000","last_peered":"2023-06-10T19:00:21.621401+0000","last_clean":"2023-06-10T19:00:21.621401+0000","last_became_active":"2023-06-10T19:00:20.638659+0000","last_became_peered":"2023-06-10T19:00:20.638659+0000","last_unstale":"2023-06-10T19:00:21.621401+0000","last_undegraded":"2023-06-10T19:00:21.621401+0000","last_fullsized":"2023-06-10T19:00:21.621401+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:16:59.721513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.867687+0000","last_change":"2023-06-10T19:00:20.673838+0000","last_active":"2023-06-10T19:00:21.867687+0000","last_peered":"2023-06-10T19:00:21.867687+0000","last_clean":"2023-06-10T19:00:21.867687+0000","last_became_active":"2023-06-10T19:00:20.673269+0000","last_became_peered":"2023-06-10T19:00:20.673269+0000","last_unstale":"2023-06-10T19:00:21.867687+0000","last_undegraded":"2023-06-10T19:00:21.867687+0000","last_fullsized":"2023-06-10T19:00:21.867687+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:37:20.431150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.618632+0000","last_change":"2023-06-10T19:00:20.642083+0000","last_active":"2023-06-10T19:00:21.618632+0000","last_peered":"2023-06-10T19:00:21.618632+0000","last_clean":"2023-06-10T19:00:21.618632+0000","last_became_active":"2023-06-10T19:00:20.641813+0000","last_became_peered":"2023-06-10T19:00:20.641813+0000","last_unstale":"2023-06-10T19:00:21.618632+0000","last_undegraded":"2023-06-10T19:00:21.618632+0000","last_fullsized":"2023-06-10T19:00:21.618632+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:15:46.372539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.867067+0000","last_change":"2023-06-10T19:00:20.644680+0000","last_active":"2023-06-10T19:00:21.867067+0000","last_peered":"2023-06-10T19:00:21.867067+0000","last_clean":"2023-06-10T19:00:21.867067+0000","last_became_active":"2023-06-10T19:00:20.643878+0000","last_became_peered":"2023-06-10T19:00:20.643878+0000","last_unstale":"2023-06-10T19:00:21.867067+0000","last_undegraded":"2023-06-10T19:00:21.867067+0000","last_fullsized":"2023-06-10T19:00:21.867067+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:33:09.345089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.868612+0000","last_change":"2023-06-10T19:00:20.665812+0000","last_active":"2023-06-10T19:00:21.868612+0000","last_peered":"2023-06-10T19:00:21.868612+0000","last_clean":"2023-06-10T19:00:21.868612+0000","last_became_active":"2023-06-10T19:00:20.665012+0000","last_became_peered":"2023-06-10T19:00:20.665012+0000","last_unstale":"2023-06-10T19:00:21.868612+0000","last_undegraded":"2023-06-10T19:00:21.868612+0000","last_fullsized":"2023-06-10T19:00:21.868612+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:18:53.183988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.617859+0000","last_change":"2023-06-10T19:00:20.643693+0000","last_active":"2023-06-10T19:00:21.617859+0000","last_peered":"2023-06-10T19:00:21.617859+0000","last_clean":"2023-06-10T19:00:21.617859+0000","last_became_active":"2023-06-10T19:00:20.643208+0000","last_became_peered":"2023-06-10T19:00:20.643208+0000","last_unstale":"2023-06-10T19:00:21.617859+0000","last_undegraded":"2023-06-10T19:00:21.617859+0000","last_fullsized":"2023-06-10T19:00:21.617859+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:58:43.055998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.620199+0000","last_change":"2023-06-10T19:00:20.640485+0000","last_active":"2023-06-10T19:00:21.620199+0000","last_peered":"2023-06-10T19:00:21.620199+0000","last_clean":"2023-06-10T19:00:21.620199+0000","last_became_active":"2023-06-10T19:00:20.638510+0000","last_became_peered":"2023-06-10T19:00:20.638510+0000","last_unstale":"2023-06-10T19:00:21.620199+0000","last_undegraded":"2023-06-10T19:00:21.620199+0000","last_fullsized":"2023-06-10T19:00:21.620199+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:48:01.830385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.866653+0000","last_change":"2023-06-10T19:00:20.681722+0000","last_active":"2023-06-10T19:00:21.866653+0000","last_peered":"2023-06-10T19:00:21.866653+0000","last_clean":"2023-06-10T19:00:21.866653+0000","last_became_active":"2023-06-10T19:00:20.681328+0000","last_became_peered":"2023-06-10T19:00:20.681328+0000","last_unstale":"2023-06-10T19:00:21.866653+0000","last_undegraded":"2023-06-10T19:00:21.866653+0000","last_fullsized":"2023-06-10T19:00:21.866653+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:14:32.710277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.867308+0000","last_change":"2023-06-10T19:00:20.640970+0000","last_active":"2023-06-10T19:00:21.867308+0000","last_peered":"2023-06-10T19:00:21.867308+0000","last_clean":"2023-06-10T19:00:21.867308+0000","last_became_active":"2023-06-10T19:00:20.640655+0000","last_became_peered":"2023-06-10T19:00:20.640655+0000","last_unstale":"2023-06-10T19:00:21.867308+0000","last_undegraded":"2023-06-10T19:00:21.867308+0000","last_fullsized":"2023-06-10T19:00:21.867308+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:09:46.827942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.868120+0000","last_change":"2023-06-10T19:00:20.673832+0000","last_active":"2023-06-10T19:00:21.868120+0000","last_peered":"2023-06-10T19:00:21.868120+0000","last_clean":"2023-06-10T19:00:21.868120+0000","last_became_active":"2023-06-10T19:00:20.673057+0000","last_became_peered":"2023-06-10T19:00:20.673057+0000","last_unstale":"2023-06-10T19:00:21.868120+0000","last_undegraded":"2023-06-10T19:00:21.868120+0000","last_fullsized":"2023-06-10T19:00:21.868120+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:47:18.272145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.618899+0000","last_change":"2023-06-10T19:00:20.631187+0000","last_active":"2023-06-10T19:00:21.618899+0000","last_peered":"2023-06-10T19:00:21.618899+0000","last_clean":"2023-06-10T19:00:21.618899+0000","last_became_active":"2023-06-10T19:00:20.630908+0000","last_became_peered":"2023-06-10T19:00:20.630908+0000","last_unstale":"2023-06-10T19:00:21.618899+0000","last_undegraded":"2023-06-10T19:00:21.618899+0000","last_fullsized":"2023-06-10T19:00:21.618899+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:19:09.973452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.867425+0000","last_change":"2023-06-10T19:00:20.643847+0000","last_active":"2023-06-10T19:00:21.867425+0000","last_peered":"2023-06-10T19:00:21.867425+0000","last_clean":"2023-06-10T19:00:21.867425+0000","last_became_active":"2023-06-10T19:00:20.643581+0000","last_became_peered":"2023-06-10T19:00:20.643581+0000","last_unstale":"2023-06-10T19:00:21.867425+0000","last_undegraded":"2023-06-10T19:00:21.867425+0000","last_fullsized":"2023-06-10T19:00:21.867425+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:40:15.534897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.868314+0000","last_change":"2023-06-10T19:00:20.629892+0000","last_active":"2023-06-10T19:00:21.868314+0000","last_peered":"2023-06-10T19:00:21.868314+0000","last_clean":"2023-06-10T19:00:21.868314+0000","last_became_active":"2023-06-10T19:00:20.629525+0000","last_became_peered":"2023-06-10T19:00:20.629525+0000","last_unstale":"2023-06-10T19:00:21.868314+0000","last_undegraded":"2023-06-10T19:00:21.868314+0000","last_fullsized":"2023-06-10T19:00:21.868314+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:10:00.560123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.865295+0000","last_change":"2023-06-10T19:00:20.673782+0000","last_active":"2023-06-10T19:00:21.865295+0000","last_peered":"2023-06-10T19:00:21.865295+0000","last_clean":"2023-06-10T19:00:21.865295+0000","last_became_active":"2023-06-10T19:00:20.673151+0000","last_became_peered":"2023-06-10T19:00:20.673151+0000","last_unstale":"2023-06-10T19:00:21.865295+0000","last_undegraded":"2023-06-10T19:00:21.865295+0000","last_fullsized":"2023-06-10T19:00:21.865295+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:22:18.384870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.618318+0000","last_change":"2023-06-10T19:00:20.667800+0000","last_active":"2023-06-10T19:00:21.618318+0000","last_peered":"2023-06-10T19:00:21.618318+0000","last_clean":"2023-06-10T19:00:21.618318+0000","last_became_active":"2023-06-10T19:00:20.667537+0000","last_became_peered":"2023-06-10T19:00:20.667537+0000","last_unstale":"2023-06-10T19:00:21.618318+0000","last_undegraded":"2023-06-10T19:00:21.618318+0000","last_fullsized":"2023-06-10T19:00:21.618318+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:44:34.275650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.621114+0000","last_change":"2023-06-10T19:00:20.634770+0000","last_active":"2023-06-10T19:00:21.621114+0000","last_peered":"2023-06-10T19:00:21.621114+0000","last_clean":"2023-06-10T19:00:21.621114+0000","last_became_active":"2023-06-10T19:00:20.634294+0000","last_became_peered":"2023-06-10T19:00:20.634294+0000","last_unstale":"2023-06-10T19:00:21.621114+0000","last_undegraded":"2023-06-10T19:00:21.621114+0000","last_fullsized":"2023-06-10T19:00:21.621114+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:15:17.493981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.866859+0000","last_change":"2023-06-10T19:00:20.642763+0000","last_active":"2023-06-10T19:00:21.866859+0000","last_peered":"2023-06-10T19:00:21.866859+0000","last_clean":"2023-06-10T19:00:21.866859+0000","last_became_active":"2023-06-10T19:00:20.642401+0000","last_became_peered":"2023-06-10T19:00:20.642401+0000","last_unstale":"2023-06-10T19:00:21.866859+0000","last_undegraded":"2023-06-10T19:00:21.866859+0000","last_fullsized":"2023-06-10T19:00:21.866859+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:10:00.560123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.618551+0000","last_change":"2023-06-10T19:00:20.626939+0000","last_active":"2023-06-10T19:00:21.618551+0000","last_peered":"2023-06-10T19:00:21.618551+0000","last_clean":"2023-06-10T19:00:21.618551+0000","last_became_active":"2023-06-10T19:00:20.626665+0000","last_became_peered":"2023-06-10T19:00:20.626665+0000","last_unstale":"2023-06-10T19:00:21.618551+0000","last_undegraded":"2023-06-10T19:00:21.618551+0000","last_fullsized":"2023-06-10T19:00:21.618551+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:43:30.365105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.619536+0000","last_change":"2023-06-10T19:00:20.629900+0000","last_active":"2023-06-10T19:00:21.619536+0000","last_peered":"2023-06-10T19:00:21.619536+0000","last_clean":"2023-06-10T19:00:21.619536+0000","last_became_active":"2023-06-10T19:00:20.629195+0000","last_became_peered":"2023-06-10T19:00:20.629195+0000","last_unstale":"2023-06-10T19:00:21.619536+0000","last_undegraded":"2023-06-10T19:00:21.619536+0000","last_fullsized":"2023-06-10T19:00:21.619536+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:23:18.393701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.618186+0000","last_change":"2023-06-10T19:00:20.629414+0000","last_active":"2023-06-10T19:00:21.618186+0000","last_peered":"2023-06-10T19:00:21.618186+0000","last_clean":"2023-06-10T19:00:21.618186+0000","last_became_active":"2023-06-10T19:00:20.629131+0000","last_became_peered":"2023-06-10T19:00:20.629131+0000","last_unstale":"2023-06-10T19:00:21.618186+0000","last_undegraded":"2023-06-10T19:00:21.618186+0000","last_fullsized":"2023-06-10T19:00:21.618186+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:50:53.329240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.619065+0000","last_change":"2023-06-10T19:00:20.675924+0000","last_active":"2023-06-10T19:00:21.619065+0000","last_peered":"2023-06-10T19:00:21.619065+0000","last_clean":"2023-06-10T19:00:21.619065+0000","last_became_active":"2023-06-10T19:00:20.675272+0000","last_became_peered":"2023-06-10T19:00:20.675272+0000","last_unstale":"2023-06-10T19:00:21.619065+0000","last_undegraded":"2023-06-10T19:00:21.619065+0000","last_fullsized":"2023-06-10T19:00:21.619065+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:07:46.933835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.866133+0000","last_change":"2023-06-10T19:00:20.630539+0000","last_active":"2023-06-10T19:00:21.866133+0000","last_peered":"2023-06-10T19:00:21.866133+0000","last_clean":"2023-06-10T19:00:21.866133+0000","last_became_active":"2023-06-10T19:00:20.630282+0000","last_became_peered":"2023-06-10T19:00:20.630282+0000","last_unstale":"2023-06-10T19:00:21.866133+0000","last_undegraded":"2023-06-10T19:00:21.866133+0000","last_fullsized":"2023-06-10T19:00:21.866133+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:13:41.213765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.867321+0000","last_change":"2023-06-10T19:00:20.631627+0000","last_active":"2023-06-10T19:00:21.867321+0000","last_peered":"2023-06-10T19:00:21.867321+0000","last_clean":"2023-06-10T19:00:21.867321+0000","last_became_active":"2023-06-10T19:00:20.631365+0000","last_became_peered":"2023-06-10T19:00:20.631365+0000","last_unstale":"2023-06-10T19:00:21.867321+0000","last_undegraded":"2023-06-10T19:00:21.867321+0000","last_fullsized":"2023-06-10T19:00:21.867321+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:44:49.154985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.866991+0000","last_change":"2023-06-10T19:00:20.673496+0000","last_active":"2023-06-10T19:00:21.866991+0000","last_peered":"2023-06-10T19:00:21.866991+0000","last_clean":"2023-06-10T19:00:21.866991+0000","last_became_active":"2023-06-10T19:00:20.672691+0000","last_became_peered":"2023-06-10T19:00:20.672691+0000","last_unstale":"2023-06-10T19:00:21.866991+0000","last_undegraded":"2023-06-10T19:00:21.866991+0000","last_fullsized":"2023-06-10T19:00:21.866991+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:16:43.763717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.866245+0000","last_change":"2023-06-10T19:00:20.675125+0000","last_active":"2023-06-10T19:00:21.866245+0000","last_peered":"2023-06-10T19:00:21.866245+0000","last_clean":"2023-06-10T19:00:21.866245+0000","last_became_active":"2023-06-10T19:00:20.674435+0000","last_became_peered":"2023-06-10T19:00:20.674435+0000","last_unstale":"2023-06-10T19:00:21.866245+0000","last_undegraded":"2023-06-10T19:00:21.866245+0000","last_fullsized":"2023-06-10T19:00:21.866245+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:56:00.296463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.618880+0000","last_change":"2023-06-10T19:00:20.681240+0000","last_active":"2023-06-10T19:00:21.618880+0000","last_peered":"2023-06-10T19:00:21.618880+0000","last_clean":"2023-06-10T19:00:21.618880+0000","last_became_active":"2023-06-10T19:00:20.680942+0000","last_became_peered":"2023-06-10T19:00:20.680942+0000","last_unstale":"2023-06-10T19:00:21.618880+0000","last_undegraded":"2023-06-10T19:00:21.618880+0000","last_fullsized":"2023-06-10T19:00:21.618880+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:06:05.139523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.866842+0000","last_change":"2023-06-10T19:00:20.666401+0000","last_active":"2023-06-10T19:00:21.866842+0000","last_peered":"2023-06-10T19:00:21.866842+0000","last_clean":"2023-06-10T19:00:21.866842+0000","last_became_active":"2023-06-10T19:00:20.666076+0000","last_became_peered":"2023-06-10T19:00:20.666076+0000","last_unstale":"2023-06-10T19:00:21.866842+0000","last_undegraded":"2023-06-10T19:00:21.866842+0000","last_fullsized":"2023-06-10T19:00:21.866842+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:00:10.415232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.869463+0000","last_change":"2023-06-10T19:00:20.656663+0000","last_active":"2023-06-10T19:00:21.869463+0000","last_peered":"2023-06-10T19:00:21.869463+0000","last_clean":"2023-06-10T19:00:21.869463+0000","last_became_active":"2023-06-10T19:00:20.654273+0000","last_became_peered":"2023-06-10T19:00:20.654273+0000","last_unstale":"2023-06-10T19:00:21.869463+0000","last_undegraded":"2023-06-10T19:00:21.869463+0000","last_fullsized":"2023-06-10T19:00:21.869463+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:32:44.275724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.620723+0000","last_change":"2023-06-10T19:00:20.670527+0000","last_active":"2023-06-10T19:00:21.620723+0000","last_peered":"2023-06-10T19:00:21.620723+0000","last_clean":"2023-06-10T19:00:21.620723+0000","last_became_active":"2023-06-10T19:00:20.670166+0000","last_became_peered":"2023-06-10T19:00:20.670166+0000","last_unstale":"2023-06-10T19:00:21.620723+0000","last_undegraded":"2023-06-10T19:00:21.620723+0000","last_fullsized":"2023-06-10T19:00:21.620723+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:20:02.439773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.865472+0000","last_change":"2023-06-10T19:00:20.657164+0000","last_active":"2023-06-10T19:00:21.865472+0000","last_peered":"2023-06-10T19:00:21.865472+0000","last_clean":"2023-06-10T19:00:21.865472+0000","last_became_active":"2023-06-10T19:00:20.656548+0000","last_became_peered":"2023-06-10T19:00:20.656548+0000","last_unstale":"2023-06-10T19:00:21.865472+0000","last_undegraded":"2023-06-10T19:00:21.865472+0000","last_fullsized":"2023-06-10T19:00:21.865472+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:43:10.600135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.620647+0000","last_change":"2023-06-10T19:00:20.630013+0000","last_active":"2023-06-10T19:00:21.620647+0000","last_peered":"2023-06-10T19:00:21.620647+0000","last_clean":"2023-06-10T19:00:21.620647+0000","last_became_active":"2023-06-10T19:00:20.629741+0000","last_became_peered":"2023-06-10T19:00:20.629741+0000","last_unstale":"2023-06-10T19:00:21.620647+0000","last_undegraded":"2023-06-10T19:00:21.620647+0000","last_fullsized":"2023-06-10T19:00:21.620647+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:12:34.648101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"79'4","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.618567+0000","last_change":"2023-06-10T19:00:20.257791+0000","last_active":"2023-06-10T19:00:21.618567+0000","last_peered":"2023-06-10T19:00:21.618567+0000","last_clean":"2023-06-10T19:00:21.618567+0000","last_became_active":"2023-06-10T19:00:20.257272+0000","last_became_peered":"2023-06-10T19:00:20.257272+0000","last_unstale":"2023-06-10T19:00:21.618567+0000","last_undegraded":"2023-06-10T19:00:21.618567+0000","last_fullsized":"2023-06-10T19:00:21.618567+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_clean_scrub_stamp":"2023-06-10T19:00:19.216413+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:33:44.532510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.867708+0000","last_change":"2023-06-10T19:00:20.681097+0000","last_active":"2023-06-10T19:00:21.867708+0000","last_peered":"2023-06-10T19:00:21.867708+0000","last_clean":"2023-06-10T19:00:21.867708+0000","last_became_active":"2023-06-10T19:00:20.680811+0000","last_became_peered":"2023-06-10T19:00:20.680811+0000","last_unstale":"2023-06-10T19:00:21.867708+0000","last_undegraded":"2023-06-10T19:00:21.867708+0000","last_fullsized":"2023-06-10T19:00:21.867708+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:46:21.681693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"79'1","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.866126+0000","last_change":"2023-06-10T19:00:20.284301+0000","last_active":"2023-06-10T19:00:21.866126+0000","last_peered":"2023-06-10T19:00:21.866126+0000","last_clean":"2023-06-10T19:00:21.866126+0000","last_became_active":"2023-06-10T19:00:20.283793+0000","last_became_peered":"2023-06-10T19:00:20.283793+0000","last_unstale":"2023-06-10T19:00:21.866126+0000","last_undegraded":"2023-06-10T19:00:21.866126+0000","last_fullsized":"2023-06-10T19:00:21.866126+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_clean_scrub_stamp":"2023-06-10T19:00:19.216413+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:31:04.338826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.619096+0000","last_change":"2023-06-10T19:00:20.640684+0000","last_active":"2023-06-10T19:00:21.619096+0000","last_peered":"2023-06-10T19:00:21.619096+0000","last_clean":"2023-06-10T19:00:21.619096+0000","last_became_active":"2023-06-10T19:00:20.638963+0000","last_became_peered":"2023-06-10T19:00:20.638963+0000","last_unstale":"2023-06-10T19:00:21.619096+0000","last_undegraded":"2023-06-10T19:00:21.619096+0000","last_fullsized":"2023-06-10T19:00:21.619096+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:23:12.824855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"79'2","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.867646+0000","last_change":"2023-06-10T19:00:20.282320+0000","last_active":"2023-06-10T19:00:21.867646+0000","last_peered":"2023-06-10T19:00:21.867646+0000","last_clean":"2023-06-10T19:00:21.867646+0000","last_became_active":"2023-06-10T19:00:20.281222+0000","last_became_peered":"2023-06-10T19:00:20.281222+0000","last_unstale":"2023-06-10T19:00:21.867646+0000","last_undegraded":"2023-06-10T19:00:21.867646+0000","last_fullsized":"2023-06-10T19:00:21.867646+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_clean_scrub_stamp":"2023-06-10T19:00:19.216413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:52:50.999883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.619625+0000","last_change":"2023-06-10T19:00:20.628646+0000","last_active":"2023-06-10T19:00:21.619625+0000","last_peered":"2023-06-10T19:00:21.619625+0000","last_clean":"2023-06-10T19:00:21.619625+0000","last_became_active":"2023-06-10T19:00:20.627913+0000","last_became_peered":"2023-06-10T19:00:20.627913+0000","last_unstale":"2023-06-10T19:00:21.619625+0000","last_undegraded":"2023-06-10T19:00:21.619625+0000","last_fullsized":"2023-06-10T19:00:21.619625+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:11:21.840003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"79'2","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.868751+0000","last_change":"2023-06-10T19:00:20.274579+0000","last_active":"2023-06-10T19:00:21.868751+0000","last_peered":"2023-06-10T19:00:21.868751+0000","last_clean":"2023-06-10T19:00:21.868751+0000","last_became_active":"2023-06-10T19:00:20.273748+0000","last_became_peered":"2023-06-10T19:00:20.273748+0000","last_unstale":"2023-06-10T19:00:21.868751+0000","last_undegraded":"2023-06-10T19:00:21.868751+0000","last_fullsized":"2023-06-10T19:00:21.868751+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_clean_scrub_stamp":"2023-06-10T19:00:19.216413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:47:33.852982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.867528+0000","last_change":"2023-06-10T19:00:20.636810+0000","last_active":"2023-06-10T19:00:21.867528+0000","last_peered":"2023-06-10T19:00:21.867528+0000","last_clean":"2023-06-10T19:00:21.867528+0000","last_became_active":"2023-06-10T19:00:20.636418+0000","last_became_peered":"2023-06-10T19:00:20.636418+0000","last_unstale":"2023-06-10T19:00:21.867528+0000","last_undegraded":"2023-06-10T19:00:21.867528+0000","last_fullsized":"2023-06-10T19:00:21.867528+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:35:52.514197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"79'1","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.619898+0000","last_change":"2023-06-10T19:00:20.275345+0000","last_active":"2023-06-10T19:00:21.619898+0000","last_peered":"2023-06-10T19:00:21.619898+0000","last_clean":"2023-06-10T19:00:21.619898+0000","last_became_active":"2023-06-10T19:00:20.274645+0000","last_became_peered":"2023-06-10T19:00:20.274645+0000","last_unstale":"2023-06-10T19:00:21.619898+0000","last_undegraded":"2023-06-10T19:00:21.619898+0000","last_fullsized":"2023-06-10T19:00:21.619898+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_clean_scrub_stamp":"2023-06-10T19:00:19.216413+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:18:01.591546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.867705+0000","last_change":"2023-06-10T19:00:20.630397+0000","last_active":"2023-06-10T19:00:21.867705+0000","last_peered":"2023-06-10T19:00:21.867705+0000","last_clean":"2023-06-10T19:00:21.867705+0000","last_became_active":"2023-06-10T19:00:20.629701+0000","last_became_peered":"2023-06-10T19:00:20.629701+0000","last_unstale":"2023-06-10T19:00:21.867705+0000","last_undegraded":"2023-06-10T19:00:21.867705+0000","last_fullsized":"2023-06-10T19:00:21.867705+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:52:20.498970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"79'1","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.865987+0000","last_change":"2023-06-10T19:00:20.260864+0000","last_active":"2023-06-10T19:00:21.865987+0000","last_peered":"2023-06-10T19:00:21.865987+0000","last_clean":"2023-06-10T19:00:21.865987+0000","last_became_active":"2023-06-10T19:00:20.260130+0000","last_became_peered":"2023-06-10T19:00:20.260130+0000","last_unstale":"2023-06-10T19:00:21.865987+0000","last_undegraded":"2023-06-10T19:00:21.865987+0000","last_fullsized":"2023-06-10T19:00:21.865987+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_clean_scrub_stamp":"2023-06-10T19:00:19.216413+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:52:15.966860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.620216+0000","last_change":"2023-06-10T19:00:20.626132+0000","last_active":"2023-06-10T19:00:21.620216+0000","last_peered":"2023-06-10T19:00:21.620216+0000","last_clean":"2023-06-10T19:00:21.620216+0000","last_became_active":"2023-06-10T19:00:20.625065+0000","last_became_peered":"2023-06-10T19:00:20.625065+0000","last_unstale":"2023-06-10T19:00:21.620216+0000","last_undegraded":"2023-06-10T19:00:21.620216+0000","last_fullsized":"2023-06-10T19:00:21.620216+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:51:09.962165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.868039+0000","last_change":"2023-06-10T19:00:20.283101+0000","last_active":"2023-06-10T19:00:21.868039+0000","last_peered":"2023-06-10T19:00:21.868039+0000","last_clean":"2023-06-10T19:00:21.868039+0000","last_became_active":"2023-06-10T19:00:20.282730+0000","last_became_peered":"2023-06-10T19:00:20.282730+0000","last_unstale":"2023-06-10T19:00:21.868039+0000","last_undegraded":"2023-06-10T19:00:21.868039+0000","last_fullsized":"2023-06-10T19:00:21.868039+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_clean_scrub_stamp":"2023-06-10T19:00:19.216413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:45:53.704310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.869825+0000","last_change":"2023-06-10T19:00:20.665385+0000","last_active":"2023-06-10T19:00:21.869825+0000","last_peered":"2023-06-10T19:00:21.869825+0000","last_clean":"2023-06-10T19:00:21.869825+0000","last_became_active":"2023-06-10T19:00:20.664675+0000","last_became_peered":"2023-06-10T19:00:20.664675+0000","last_unstale":"2023-06-10T19:00:21.869825+0000","last_undegraded":"2023-06-10T19:00:21.869825+0000","last_fullsized":"2023-06-10T19:00:21.869825+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:03:32.447672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.617984+0000","last_change":"2023-06-10T19:00:20.253235+0000","last_active":"2023-06-10T19:00:21.617984+0000","last_peered":"2023-06-10T19:00:21.617984+0000","last_clean":"2023-06-10T19:00:21.617984+0000","last_became_active":"2023-06-10T19:00:20.252296+0000","last_became_peered":"2023-06-10T19:00:20.252296+0000","last_unstale":"2023-06-10T19:00:21.617984+0000","last_undegraded":"2023-06-10T19:00:21.617984+0000","last_fullsized":"2023-06-10T19:00:21.617984+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_clean_scrub_stamp":"2023-06-10T19:00:19.216413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:32:56.361864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.866247+0000","last_change":"2023-06-10T19:00:20.644646+0000","last_active":"2023-06-10T19:00:21.866247+0000","last_peered":"2023-06-10T19:00:21.866247+0000","last_clean":"2023-06-10T19:00:21.866247+0000","last_became_active":"2023-06-10T19:00:20.644370+0000","last_became_peered":"2023-06-10T19:00:20.644370+0000","last_unstale":"2023-06-10T19:00:21.866247+0000","last_undegraded":"2023-06-10T19:00:21.866247+0000","last_fullsized":"2023-06-10T19:00:21.866247+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:53:46.304849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.867062+0000","last_change":"2023-06-10T19:00:20.282095+0000","last_active":"2023-06-10T19:00:21.867062+0000","last_peered":"2023-06-10T19:00:21.867062+0000","last_clean":"2023-06-10T19:00:21.867062+0000","last_became_active":"2023-06-10T19:00:20.281207+0000","last_became_peered":"2023-06-10T19:00:20.281207+0000","last_unstale":"2023-06-10T19:00:21.867062+0000","last_undegraded":"2023-06-10T19:00:21.867062+0000","last_fullsized":"2023-06-10T19:00:21.867062+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_clean_scrub_stamp":"2023-06-10T19:00:19.216413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:13:12.793538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.866847+0000","last_change":"2023-06-10T19:00:20.672866+0000","last_active":"2023-06-10T19:00:21.866847+0000","last_peered":"2023-06-10T19:00:21.866847+0000","last_clean":"2023-06-10T19:00:21.866847+0000","last_became_active":"2023-06-10T19:00:20.672364+0000","last_became_peered":"2023-06-10T19:00:20.672364+0000","last_unstale":"2023-06-10T19:00:21.866847+0000","last_undegraded":"2023-06-10T19:00:21.866847+0000","last_fullsized":"2023-06-10T19:00:21.866847+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:01:29.756279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.867310+0000","last_change":"2023-06-10T19:00:20.273599+0000","last_active":"2023-06-10T19:00:21.867310+0000","last_peered":"2023-06-10T19:00:21.867310+0000","last_clean":"2023-06-10T19:00:21.867310+0000","last_became_active":"2023-06-10T19:00:20.272875+0000","last_became_peered":"2023-06-10T19:00:20.272875+0000","last_unstale":"2023-06-10T19:00:21.867310+0000","last_undegraded":"2023-06-10T19:00:21.867310+0000","last_fullsized":"2023-06-10T19:00:21.867310+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_clean_scrub_stamp":"2023-06-10T19:00:19.216413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:22:31.656506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.867758+0000","last_change":"2023-06-10T19:00:20.628599+0000","last_active":"2023-06-10T19:00:21.867758+0000","last_peered":"2023-06-10T19:00:21.867758+0000","last_clean":"2023-06-10T19:00:21.867758+0000","last_became_active":"2023-06-10T19:00:20.628010+0000","last_became_peered":"2023-06-10T19:00:20.628010+0000","last_unstale":"2023-06-10T19:00:21.867758+0000","last_undegraded":"2023-06-10T19:00:21.867758+0000","last_fullsized":"2023-06-10T19:00:21.867758+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:56:45.512224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"79'3","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.618855+0000","last_change":"2023-06-10T19:00:20.261734+0000","last_active":"2023-06-10T19:00:21.618855+0000","last_peered":"2023-06-10T19:00:21.618855+0000","last_clean":"2023-06-10T19:00:21.618855+0000","last_became_active":"2023-06-10T19:00:20.261407+0000","last_became_peered":"2023-06-10T19:00:20.261407+0000","last_unstale":"2023-06-10T19:00:21.618855+0000","last_undegraded":"2023-06-10T19:00:21.618855+0000","last_fullsized":"2023-06-10T19:00:21.618855+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_clean_scrub_stamp":"2023-06-10T19:00:19.216413+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:14:51.794117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.621182+0000","last_change":"2023-06-10T19:00:20.631141+0000","last_active":"2023-06-10T19:00:21.621182+0000","last_peered":"2023-06-10T19:00:21.621182+0000","last_clean":"2023-06-10T19:00:21.621182+0000","last_became_active":"2023-06-10T19:00:20.630868+0000","last_became_peered":"2023-06-10T19:00:20.630868+0000","last_unstale":"2023-06-10T19:00:21.621182+0000","last_undegraded":"2023-06-10T19:00:21.621182+0000","last_fullsized":"2023-06-10T19:00:21.621182+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:22:35.959810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"79'6","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.868892+0000","last_change":"2023-06-10T19:00:20.257720+0000","last_active":"2023-06-10T19:00:21.868892+0000","last_peered":"2023-06-10T19:00:21.868892+0000","last_clean":"2023-06-10T19:00:21.868892+0000","last_became_active":"2023-06-10T19:00:20.256889+0000","last_became_peered":"2023-06-10T19:00:20.256889+0000","last_unstale":"2023-06-10T19:00:21.868892+0000","last_undegraded":"2023-06-10T19:00:21.868892+0000","last_fullsized":"2023-06-10T19:00:21.868892+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_clean_scrub_stamp":"2023-06-10T19:00:19.216413+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:29:41.288976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.868096+0000","last_change":"2023-06-10T19:00:20.673530+0000","last_active":"2023-06-10T19:00:21.868096+0000","last_peered":"2023-06-10T19:00:21.868096+0000","last_clean":"2023-06-10T19:00:21.868096+0000","last_became_active":"2023-06-10T19:00:20.672637+0000","last_became_peered":"2023-06-10T19:00:20.672637+0000","last_unstale":"2023-06-10T19:00:21.868096+0000","last_undegraded":"2023-06-10T19:00:21.868096+0000","last_fullsized":"2023-06-10T19:00:21.868096+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:43:13.083824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"79'2","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.866556+0000","last_change":"2023-06-10T19:00:20.256799+0000","last_active":"2023-06-10T19:00:21.866556+0000","last_peered":"2023-06-10T19:00:21.866556+0000","last_clean":"2023-06-10T19:00:21.866556+0000","last_became_active":"2023-06-10T19:00:20.256028+0000","last_became_peered":"2023-06-10T19:00:20.256028+0000","last_unstale":"2023-06-10T19:00:21.866556+0000","last_undegraded":"2023-06-10T19:00:21.866556+0000","last_fullsized":"2023-06-10T19:00:21.866556+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_clean_scrub_stamp":"2023-06-10T19:00:19.216413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:51:48.920891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.868274+0000","last_change":"2023-06-10T19:00:20.668026+0000","last_active":"2023-06-10T19:00:21.868274+0000","last_peered":"2023-06-10T19:00:21.868274+0000","last_clean":"2023-06-10T19:00:21.868274+0000","last_became_active":"2023-06-10T19:00:20.667280+0000","last_became_peered":"2023-06-10T19:00:20.667280+0000","last_unstale":"2023-06-10T19:00:21.868274+0000","last_undegraded":"2023-06-10T19:00:21.868274+0000","last_fullsized":"2023-06-10T19:00:21.868274+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:07:51.564628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.865848+0000","last_change":"2023-06-10T19:00:20.281487+0000","last_active":"2023-06-10T19:00:21.865848+0000","last_peered":"2023-06-10T19:00:21.865848+0000","last_clean":"2023-06-10T19:00:21.865848+0000","last_became_active":"2023-06-10T19:00:20.281002+0000","last_became_peered":"2023-06-10T19:00:20.281002+0000","last_unstale":"2023-06-10T19:00:21.865848+0000","last_undegraded":"2023-06-10T19:00:21.865848+0000","last_fullsized":"2023-06-10T19:00:21.865848+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_clean_scrub_stamp":"2023-06-10T19:00:19.216413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:10:32.498213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.869775+0000","last_change":"2023-06-10T19:00:20.666238+0000","last_active":"2023-06-10T19:00:21.869775+0000","last_peered":"2023-06-10T19:00:21.869775+0000","last_clean":"2023-06-10T19:00:21.869775+0000","last_became_active":"2023-06-10T19:00:20.664239+0000","last_became_peered":"2023-06-10T19:00:20.664239+0000","last_unstale":"2023-06-10T19:00:21.869775+0000","last_undegraded":"2023-06-10T19:00:21.869775+0000","last_fullsized":"2023-06-10T19:00:21.869775+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:38:50.520363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.617851+0000","last_change":"2023-06-10T19:00:20.257908+0000","last_active":"2023-06-10T19:00:21.617851+0000","last_peered":"2023-06-10T19:00:21.617851+0000","last_clean":"2023-06-10T19:00:21.617851+0000","last_became_active":"2023-06-10T19:00:20.257547+0000","last_became_peered":"2023-06-10T19:00:20.257547+0000","last_unstale":"2023-06-10T19:00:21.617851+0000","last_undegraded":"2023-06-10T19:00:21.617851+0000","last_fullsized":"2023-06-10T19:00:21.617851+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_clean_scrub_stamp":"2023-06-10T19:00:19.216413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:46:44.692832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.869952+0000","last_change":"2023-06-10T19:00:20.654023+0000","last_active":"2023-06-10T19:00:21.869952+0000","last_peered":"2023-06-10T19:00:21.869952+0000","last_clean":"2023-06-10T19:00:21.869952+0000","last_became_active":"2023-06-10T19:00:20.653247+0000","last_became_peered":"2023-06-10T19:00:20.653247+0000","last_unstale":"2023-06-10T19:00:21.869952+0000","last_undegraded":"2023-06-10T19:00:21.869952+0000","last_fullsized":"2023-06-10T19:00:21.869952+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:15:34.592212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"79'8","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.866627+0000","last_change":"2023-06-10T19:00:20.267938+0000","last_active":"2023-06-10T19:00:21.866627+0000","last_peered":"2023-06-10T19:00:21.866627+0000","last_clean":"2023-06-10T19:00:21.866627+0000","last_became_active":"2023-06-10T19:00:20.267680+0000","last_became_peered":"2023-06-10T19:00:20.267680+0000","last_unstale":"2023-06-10T19:00:21.866627+0000","last_undegraded":"2023-06-10T19:00:21.866627+0000","last_fullsized":"2023-06-10T19:00:21.866627+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_clean_scrub_stamp":"2023-06-10T19:00:19.216413+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:16:40.199630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.619071+0000","last_change":"2023-06-10T19:00:20.650580+0000","last_active":"2023-06-10T19:00:21.619071+0000","last_peered":"2023-06-10T19:00:21.619071+0000","last_clean":"2023-06-10T19:00:21.619071+0000","last_became_active":"2023-06-10T19:00:20.649786+0000","last_became_peered":"2023-06-10T19:00:20.649786+0000","last_unstale":"2023-06-10T19:00:21.619071+0000","last_undegraded":"2023-06-10T19:00:21.619071+0000","last_fullsized":"2023-06-10T19:00:21.619071+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:43:49.450271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"79'2","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.867674+0000","last_change":"2023-06-10T19:00:20.261631+0000","last_active":"2023-06-10T19:00:21.867674+0000","last_peered":"2023-06-10T19:00:21.867674+0000","last_clean":"2023-06-10T19:00:21.867674+0000","last_became_active":"2023-06-10T19:00:20.260850+0000","last_became_peered":"2023-06-10T19:00:20.260850+0000","last_unstale":"2023-06-10T19:00:21.867674+0000","last_undegraded":"2023-06-10T19:00:21.867674+0000","last_fullsized":"2023-06-10T19:00:21.867674+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_clean_scrub_stamp":"2023-06-10T19:00:19.216413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:21:53.080252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.868940+0000","last_change":"2023-06-10T19:00:20.671587+0000","last_active":"2023-06-10T19:00:21.868940+0000","last_peered":"2023-06-10T19:00:21.868940+0000","last_clean":"2023-06-10T19:00:21.868940+0000","last_became_active":"2023-06-10T19:00:20.671086+0000","last_became_peered":"2023-06-10T19:00:20.671086+0000","last_unstale":"2023-06-10T19:00:21.868940+0000","last_undegraded":"2023-06-10T19:00:21.868940+0000","last_fullsized":"2023-06-10T19:00:21.868940+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:47:05.172704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"79'1","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.868550+0000","last_change":"2023-06-10T19:00:20.249469+0000","last_active":"2023-06-10T19:00:21.868550+0000","last_peered":"2023-06-10T19:00:21.868550+0000","last_clean":"2023-06-10T19:00:21.868550+0000","last_became_active":"2023-06-10T19:00:20.249188+0000","last_became_peered":"2023-06-10T19:00:20.249188+0000","last_unstale":"2023-06-10T19:00:21.868550+0000","last_undegraded":"2023-06-10T19:00:21.868550+0000","last_fullsized":"2023-06-10T19:00:21.868550+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_clean_scrub_stamp":"2023-06-10T19:00:19.216413+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:40:14.530687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.619158+0000","last_change":"2023-06-10T19:00:20.645675+0000","last_active":"2023-06-10T19:00:21.619158+0000","last_peered":"2023-06-10T19:00:21.619158+0000","last_clean":"2023-06-10T19:00:21.619158+0000","last_became_active":"2023-06-10T19:00:20.642700+0000","last_became_peered":"2023-06-10T19:00:20.642700+0000","last_unstale":"2023-06-10T19:00:21.619158+0000","last_undegraded":"2023-06-10T19:00:21.619158+0000","last_fullsized":"2023-06-10T19:00:21.619158+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:43:46.594771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.866876+0000","last_change":"2023-06-10T19:00:20.282652+0000","last_active":"2023-06-10T19:00:21.866876+0000","last_peered":"2023-06-10T19:00:21.866876+0000","last_clean":"2023-06-10T19:00:21.866876+0000","last_became_active":"2023-06-10T19:00:20.281827+0000","last_became_peered":"2023-06-10T19:00:20.281827+0000","last_unstale":"2023-06-10T19:00:21.866876+0000","last_undegraded":"2023-06-10T19:00:21.866876+0000","last_fullsized":"2023-06-10T19:00:21.866876+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_clean_scrub_stamp":"2023-06-10T19:00:19.216413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:50:08.470544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.867103+0000","last_change":"2023-06-10T19:00:20.642094+0000","last_active":"2023-06-10T19:00:21.867103+0000","last_peered":"2023-06-10T19:00:21.867103+0000","last_clean":"2023-06-10T19:00:21.867103+0000","last_became_active":"2023-06-10T19:00:20.641839+0000","last_became_peered":"2023-06-10T19:00:20.641839+0000","last_unstale":"2023-06-10T19:00:21.867103+0000","last_undegraded":"2023-06-10T19:00:21.867103+0000","last_fullsized":"2023-06-10T19:00:21.867103+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:41:06.052938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.866119+0000","last_change":"2023-06-10T19:00:20.283860+0000","last_active":"2023-06-10T19:00:21.866119+0000","last_peered":"2023-06-10T19:00:21.866119+0000","last_clean":"2023-06-10T19:00:21.866119+0000","last_became_active":"2023-06-10T19:00:20.283307+0000","last_became_peered":"2023-06-10T19:00:20.283307+0000","last_unstale":"2023-06-10T19:00:21.866119+0000","last_undegraded":"2023-06-10T19:00:21.866119+0000","last_fullsized":"2023-06-10T19:00:21.866119+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_clean_scrub_stamp":"2023-06-10T19:00:19.216413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:34:06.614085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.868718+0000","last_change":"2023-06-10T19:00:20.649292+0000","last_active":"2023-06-10T19:00:21.868718+0000","last_peered":"2023-06-10T19:00:21.868718+0000","last_clean":"2023-06-10T19:00:21.868718+0000","last_became_active":"2023-06-10T19:00:20.648683+0000","last_became_peered":"2023-06-10T19:00:20.648683+0000","last_unstale":"2023-06-10T19:00:21.868718+0000","last_undegraded":"2023-06-10T19:00:21.868718+0000","last_fullsized":"2023-06-10T19:00:21.868718+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:56:15.431163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.868399+0000","last_change":"2023-06-10T19:00:20.274982+0000","last_active":"2023-06-10T19:00:21.868399+0000","last_peered":"2023-06-10T19:00:21.868399+0000","last_clean":"2023-06-10T19:00:21.868399+0000","last_became_active":"2023-06-10T19:00:20.274222+0000","last_became_peered":"2023-06-10T19:00:20.274222+0000","last_unstale":"2023-06-10T19:00:21.868399+0000","last_undegraded":"2023-06-10T19:00:21.868399+0000","last_fullsized":"2023-06-10T19:00:21.868399+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_clean_scrub_stamp":"2023-06-10T19:00:19.216413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:38:32.051820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.868471+0000","last_change":"2023-06-10T19:00:20.665740+0000","last_active":"2023-06-10T19:00:21.868471+0000","last_peered":"2023-06-10T19:00:21.868471+0000","last_clean":"2023-06-10T19:00:21.868471+0000","last_became_active":"2023-06-10T19:00:20.664762+0000","last_became_peered":"2023-06-10T19:00:20.664762+0000","last_unstale":"2023-06-10T19:00:21.868471+0000","last_undegraded":"2023-06-10T19:00:21.868471+0000","last_fullsized":"2023-06-10T19:00:21.868471+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:59:53.247451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.618797+0000","last_change":"2023-06-10T19:00:20.257806+0000","last_active":"2023-06-10T19:00:21.618797+0000","last_peered":"2023-06-10T19:00:21.618797+0000","last_clean":"2023-06-10T19:00:21.618797+0000","last_became_active":"2023-06-10T19:00:20.257387+0000","last_became_peered":"2023-06-10T19:00:20.257387+0000","last_unstale":"2023-06-10T19:00:21.618797+0000","last_undegraded":"2023-06-10T19:00:21.618797+0000","last_fullsized":"2023-06-10T19:00:21.618797+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_clean_scrub_stamp":"2023-06-10T19:00:19.216413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:27:30.022143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.621310+0000","last_change":"2023-06-10T19:00:20.631749+0000","last_active":"2023-06-10T19:00:21.621310+0000","last_peered":"2023-06-10T19:00:21.621310+0000","last_clean":"2023-06-10T19:00:21.621310+0000","last_became_active":"2023-06-10T19:00:20.631463+0000","last_became_peered":"2023-06-10T19:00:20.631463+0000","last_unstale":"2023-06-10T19:00:21.621310+0000","last_undegraded":"2023-06-10T19:00:21.621310+0000","last_fullsized":"2023-06-10T19:00:21.621310+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:24:57.833501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.869220+0000","last_change":"2023-06-10T19:00:20.260913+0000","last_active":"2023-06-10T19:00:21.869220+0000","last_peered":"2023-06-10T19:00:21.869220+0000","last_clean":"2023-06-10T19:00:21.869220+0000","last_became_active":"2023-06-10T19:00:20.260137+0000","last_became_peered":"2023-06-10T19:00:20.260137+0000","last_unstale":"2023-06-10T19:00:21.869220+0000","last_undegraded":"2023-06-10T19:00:21.869220+0000","last_fullsized":"2023-06-10T19:00:21.869220+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_clean_scrub_stamp":"2023-06-10T19:00:19.216413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:24:15.249571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.621090+0000","last_change":"2023-06-10T19:00:20.657131+0000","last_active":"2023-06-10T19:00:21.621090+0000","last_peered":"2023-06-10T19:00:21.621090+0000","last_clean":"2023-06-10T19:00:21.621090+0000","last_became_active":"2023-06-10T19:00:20.656934+0000","last_became_peered":"2023-06-10T19:00:20.656934+0000","last_unstale":"2023-06-10T19:00:21.621090+0000","last_undegraded":"2023-06-10T19:00:21.621090+0000","last_fullsized":"2023-06-10T19:00:21.621090+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:12:02.718119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.620816+0000","last_change":"2023-06-10T19:00:20.254021+0000","last_active":"2023-06-10T19:00:21.620816+0000","last_peered":"2023-06-10T19:00:21.620816+0000","last_clean":"2023-06-10T19:00:21.620816+0000","last_became_active":"2023-06-10T19:00:20.253697+0000","last_became_peered":"2023-06-10T19:00:20.253697+0000","last_unstale":"2023-06-10T19:00:21.620816+0000","last_undegraded":"2023-06-10T19:00:21.620816+0000","last_fullsized":"2023-06-10T19:00:21.620816+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_clean_scrub_stamp":"2023-06-10T19:00:19.216413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:01:31.360790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.866585+0000","last_change":"2023-06-10T19:00:20.655778+0000","last_active":"2023-06-10T19:00:21.866585+0000","last_peered":"2023-06-10T19:00:21.866585+0000","last_clean":"2023-06-10T19:00:21.866585+0000","last_became_active":"2023-06-10T19:00:20.654871+0000","last_became_peered":"2023-06-10T19:00:20.654871+0000","last_unstale":"2023-06-10T19:00:21.866585+0000","last_undegraded":"2023-06-10T19:00:21.866585+0000","last_fullsized":"2023-06-10T19:00:21.866585+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:02:56.856433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.868746+0000","last_change":"2023-06-10T19:00:20.272093+0000","last_active":"2023-06-10T19:00:21.868746+0000","last_peered":"2023-06-10T19:00:21.868746+0000","last_clean":"2023-06-10T19:00:21.868746+0000","last_became_active":"2023-06-10T19:00:20.271644+0000","last_became_peered":"2023-06-10T19:00:20.271644+0000","last_unstale":"2023-06-10T19:00:21.868746+0000","last_undegraded":"2023-06-10T19:00:21.868746+0000","last_fullsized":"2023-06-10T19:00:21.868746+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_clean_scrub_stamp":"2023-06-10T19:00:19.216413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:57:04.374037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":276,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.866042+0000","last_change":"2023-06-10T18:52:34.951528+0000","last_active":"2023-06-10T19:00:21.866042+0000","last_peered":"2023-06-10T19:00:21.866042+0000","last_clean":"2023-06-10T19:00:21.866042+0000","last_became_active":"2023-06-10T18:52:34.949099+0000","last_became_peered":"2023-06-10T18:52:34.949099+0000","last_unstale":"2023-06-10T19:00:21.866042+0000","last_undegraded":"2023-06-10T19:00:21.866042+0000","last_fullsized":"2023-06-10T19:00:21.866042+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_clean_scrub_stamp":"2023-06-10T18:52:33.633295+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:12:35.896485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":124,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.866772+0000","last_change":"2023-06-10T18:52:40.506384+0000","last_active":"2023-06-10T19:00:21.866772+0000","last_peered":"2023-06-10T19:00:21.866772+0000","last_clean":"2023-06-10T19:00:21.866772+0000","last_became_active":"2023-06-10T18:52:40.505701+0000","last_became_peered":"2023-06-10T18:52:40.505701+0000","last_unstale":"2023-06-10T19:00:21.866772+0000","last_undegraded":"2023-06-10T19:00:21.866772+0000","last_fullsized":"2023-06-10T19:00:21.866772+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:00:48.680188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.868380+0000","last_change":"2023-06-10T19:00:20.636194+0000","last_active":"2023-06-10T19:00:21.868380+0000","last_peered":"2023-06-10T19:00:21.868380+0000","last_clean":"2023-06-10T19:00:21.868380+0000","last_became_active":"2023-06-10T19:00:20.635976+0000","last_became_peered":"2023-06-10T19:00:20.635976+0000","last_unstale":"2023-06-10T19:00:21.868380+0000","last_undegraded":"2023-06-10T19:00:21.868380+0000","last_fullsized":"2023-06-10T19:00:21.868380+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:33:09.345089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.869558+0000","last_change":"2023-06-10T19:00:20.268844+0000","last_active":"2023-06-10T19:00:21.869558+0000","last_peered":"2023-06-10T19:00:21.869558+0000","last_clean":"2023-06-10T19:00:21.869558+0000","last_became_active":"2023-06-10T19:00:20.268548+0000","last_became_peered":"2023-06-10T19:00:20.268548+0000","last_unstale":"2023-06-10T19:00:21.869558+0000","last_undegraded":"2023-06-10T19:00:21.869558+0000","last_fullsized":"2023-06-10T19:00:21.869558+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_clean_scrub_stamp":"2023-06-10T19:00:19.216413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:12:18.745605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":120,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.865713+0000","last_change":"2023-06-10T18:52:40.512015+0000","last_active":"2023-06-10T19:00:21.865713+0000","last_peered":"2023-06-10T19:00:21.865713+0000","last_clean":"2023-06-10T19:00:21.865713+0000","last_became_active":"2023-06-10T18:52:40.511382+0000","last_became_peered":"2023-06-10T18:52:40.511382+0000","last_unstale":"2023-06-10T19:00:21.865713+0000","last_undegraded":"2023-06-10T19:00:21.865713+0000","last_fullsized":"2023-06-10T19:00:21.865713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:40:30.497554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.869991+0000","last_change":"2023-06-10T19:00:20.676138+0000","last_active":"2023-06-10T19:00:21.869991+0000","last_peered":"2023-06-10T19:00:21.869991+0000","last_clean":"2023-06-10T19:00:21.869991+0000","last_became_active":"2023-06-10T19:00:20.675704+0000","last_became_peered":"2023-06-10T19:00:20.675704+0000","last_unstale":"2023-06-10T19:00:21.869991+0000","last_undegraded":"2023-06-10T19:00:21.869991+0000","last_fullsized":"2023-06-10T19:00:21.869991+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:13:31.953515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.866532+0000","last_change":"2023-06-10T19:00:20.269225+0000","last_active":"2023-06-10T19:00:21.866532+0000","last_peered":"2023-06-10T19:00:21.866532+0000","last_clean":"2023-06-10T19:00:21.866532+0000","last_became_active":"2023-06-10T19:00:20.268785+0000","last_became_peered":"2023-06-10T19:00:20.268785+0000","last_unstale":"2023-06-10T19:00:21.866532+0000","last_undegraded":"2023-06-10T19:00:21.866532+0000","last_fullsized":"2023-06-10T19:00:21.866532+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_clean_scrub_stamp":"2023-06-10T19:00:19.216413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:10:52.458124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":126,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.617971+0000","last_change":"2023-06-10T18:52:40.671725+0000","last_active":"2023-06-10T19:00:21.617971+0000","last_peered":"2023-06-10T19:00:21.617971+0000","last_clean":"2023-06-10T19:00:21.617971+0000","last_became_active":"2023-06-10T18:52:40.671442+0000","last_became_peered":"2023-06-10T18:52:40.671442+0000","last_unstale":"2023-06-10T19:00:21.617971+0000","last_undegraded":"2023-06-10T19:00:21.617971+0000","last_fullsized":"2023-06-10T19:00:21.617971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:03:23.063913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.867721+0000","last_change":"2023-06-10T19:00:20.681067+0000","last_active":"2023-06-10T19:00:21.867721+0000","last_peered":"2023-06-10T19:00:21.867721+0000","last_clean":"2023-06-10T19:00:21.867721+0000","last_became_active":"2023-06-10T19:00:20.680815+0000","last_became_peered":"2023-06-10T19:00:20.680815+0000","last_unstale":"2023-06-10T19:00:21.867721+0000","last_undegraded":"2023-06-10T19:00:21.867721+0000","last_fullsized":"2023-06-10T19:00:21.867721+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:14:05.349604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"79'2","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.869474+0000","last_change":"2023-06-10T19:00:20.261963+0000","last_active":"2023-06-10T19:00:21.869474+0000","last_peered":"2023-06-10T19:00:21.869474+0000","last_clean":"2023-06-10T19:00:21.869474+0000","last_became_active":"2023-06-10T19:00:20.261604+0000","last_became_peered":"2023-06-10T19:00:20.261604+0000","last_unstale":"2023-06-10T19:00:21.869474+0000","last_undegraded":"2023-06-10T19:00:21.869474+0000","last_fullsized":"2023-06-10T19:00:21.869474+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_clean_scrub_stamp":"2023-06-10T19:00:19.216413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:59:56.735063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":124,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.866151+0000","last_change":"2023-06-10T18:52:40.510258+0000","last_active":"2023-06-10T19:00:21.866151+0000","last_peered":"2023-06-10T19:00:21.866151+0000","last_clean":"2023-06-10T19:00:21.866151+0000","last_became_active":"2023-06-10T18:52:40.509560+0000","last_became_peered":"2023-06-10T18:52:40.509560+0000","last_unstale":"2023-06-10T19:00:21.866151+0000","last_undegraded":"2023-06-10T19:00:21.866151+0000","last_fullsized":"2023-06-10T19:00:21.866151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:29:11.397620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.618550+0000","last_change":"2023-06-10T19:00:20.632381+0000","last_active":"2023-06-10T19:00:21.618550+0000","last_peered":"2023-06-10T19:00:21.618550+0000","last_clean":"2023-06-10T19:00:21.618550+0000","last_became_active":"2023-06-10T19:00:20.632138+0000","last_became_peered":"2023-06-10T19:00:20.632138+0000","last_unstale":"2023-06-10T19:00:21.618550+0000","last_undegraded":"2023-06-10T19:00:21.618550+0000","last_fullsized":"2023-06-10T19:00:21.618550+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:41:18.176341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"79'1","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.619037+0000","last_change":"2023-06-10T19:00:20.250291+0000","last_active":"2023-06-10T19:00:21.619037+0000","last_peered":"2023-06-10T19:00:21.619037+0000","last_clean":"2023-06-10T19:00:21.619037+0000","last_became_active":"2023-06-10T19:00:20.249868+0000","last_became_peered":"2023-06-10T19:00:20.249868+0000","last_unstale":"2023-06-10T19:00:21.619037+0000","last_undegraded":"2023-06-10T19:00:21.619037+0000","last_fullsized":"2023-06-10T19:00:21.619037+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_clean_scrub_stamp":"2023-06-10T19:00:19.216413+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:55:10.648879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":114,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.621146+0000","last_change":"2023-06-10T18:52:40.672266+0000","last_active":"2023-06-10T19:00:21.621146+0000","last_peered":"2023-06-10T19:00:21.621146+0000","last_clean":"2023-06-10T19:00:21.621146+0000","last_became_active":"2023-06-10T18:52:40.671966+0000","last_became_peered":"2023-06-10T18:52:40.671966+0000","last_unstale":"2023-06-10T19:00:21.621146+0000","last_undegraded":"2023-06-10T19:00:21.621146+0000","last_fullsized":"2023-06-10T19:00:21.621146+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:36:29.851285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.869318+0000","last_change":"2023-06-10T19:00:20.640918+0000","last_active":"2023-06-10T19:00:21.869318+0000","last_peered":"2023-06-10T19:00:21.869318+0000","last_clean":"2023-06-10T19:00:21.869318+0000","last_became_active":"2023-06-10T19:00:20.640655+0000","last_became_peered":"2023-06-10T19:00:20.640655+0000","last_unstale":"2023-06-10T19:00:21.869318+0000","last_undegraded":"2023-06-10T19:00:21.869318+0000","last_fullsized":"2023-06-10T19:00:21.869318+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:18:45.834616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.620968+0000","last_change":"2023-06-10T19:00:20.259096+0000","last_active":"2023-06-10T19:00:21.620968+0000","last_peered":"2023-06-10T19:00:21.620968+0000","last_clean":"2023-06-10T19:00:21.620968+0000","last_became_active":"2023-06-10T19:00:20.258754+0000","last_became_peered":"2023-06-10T19:00:20.258754+0000","last_unstale":"2023-06-10T19:00:21.620968+0000","last_undegraded":"2023-06-10T19:00:21.620968+0000","last_fullsized":"2023-06-10T19:00:21.620968+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_clean_scrub_stamp":"2023-06-10T19:00:19.216413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:58:35.104960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":120,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.867072+0000","last_change":"2023-06-10T18:52:40.671084+0000","last_active":"2023-06-10T19:00:21.867072+0000","last_peered":"2023-06-10T19:00:21.867072+0000","last_clean":"2023-06-10T19:00:21.867072+0000","last_became_active":"2023-06-10T18:52:40.670697+0000","last_became_peered":"2023-06-10T18:52:40.670697+0000","last_unstale":"2023-06-10T19:00:21.867072+0000","last_undegraded":"2023-06-10T19:00:21.867072+0000","last_fullsized":"2023-06-10T19:00:21.867072+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:47:29.134406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.866198+0000","last_change":"2023-06-10T19:00:20.636907+0000","last_active":"2023-06-10T19:00:21.866198+0000","last_peered":"2023-06-10T19:00:21.866198+0000","last_clean":"2023-06-10T19:00:21.866198+0000","last_became_active":"2023-06-10T19:00:20.636657+0000","last_became_peered":"2023-06-10T19:00:20.636657+0000","last_unstale":"2023-06-10T19:00:21.866198+0000","last_undegraded":"2023-06-10T19:00:21.866198+0000","last_fullsized":"2023-06-10T19:00:21.866198+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:45:54.708520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"79'1","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.867374+0000","last_change":"2023-06-10T19:00:20.282747+0000","last_active":"2023-06-10T19:00:21.867374+0000","last_peered":"2023-06-10T19:00:21.867374+0000","last_clean":"2023-06-10T19:00:21.867374+0000","last_became_active":"2023-06-10T19:00:20.282173+0000","last_became_peered":"2023-06-10T19:00:20.282173+0000","last_unstale":"2023-06-10T19:00:21.867374+0000","last_undegraded":"2023-06-10T19:00:21.867374+0000","last_fullsized":"2023-06-10T19:00:21.867374+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_clean_scrub_stamp":"2023-06-10T19:00:19.216413+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:16:26.530271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":114,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.621362+0000","last_change":"2023-06-10T18:52:40.514114+0000","last_active":"2023-06-10T19:00:21.621362+0000","last_peered":"2023-06-10T19:00:21.621362+0000","last_clean":"2023-06-10T19:00:21.621362+0000","last_became_active":"2023-06-10T18:52:40.513638+0000","last_became_peered":"2023-06-10T18:52:40.513638+0000","last_unstale":"2023-06-10T19:00:21.621362+0000","last_undegraded":"2023-06-10T19:00:21.621362+0000","last_fullsized":"2023-06-10T19:00:21.621362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:54:50.528282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.617962+0000","last_change":"2023-06-10T19:00:20.670283+0000","last_active":"2023-06-10T19:00:21.617962+0000","last_peered":"2023-06-10T19:00:21.617962+0000","last_clean":"2023-06-10T19:00:21.617962+0000","last_became_active":"2023-06-10T19:00:20.669961+0000","last_became_peered":"2023-06-10T19:00:20.669961+0000","last_unstale":"2023-06-10T19:00:21.617962+0000","last_undegraded":"2023-06-10T19:00:21.617962+0000","last_fullsized":"2023-06-10T19:00:21.617962+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:20.220624+0000","last_clean_scrub_stamp":"2023-06-10T19:00:20.220624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:31:05.035965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"79'2","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.620206+0000","last_change":"2023-06-10T19:00:20.262530+0000","last_active":"2023-06-10T19:00:21.620206+0000","last_peered":"2023-06-10T19:00:21.620206+0000","last_clean":"2023-06-10T19:00:21.620206+0000","last_became_active":"2023-06-10T19:00:20.261795+0000","last_became_peered":"2023-06-10T19:00:20.261795+0000","last_unstale":"2023-06-10T19:00:21.620206+0000","last_undegraded":"2023-06-10T19:00:21.620206+0000","last_fullsized":"2023-06-10T19:00:21.620206+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:00:19.216413+0000","last_clean_scrub_stamp":"2023-06-10T19:00:19.216413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:11:08.325612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":122,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-06-10T19:00:21.870153+0000","last_change":"2023-06-10T18:52:40.515396+0000","last_active":"2023-06-10T19:00:21.870153+0000","last_peered":"2023-06-10T19:00:21.870153+0000","last_clean":"2023-06-10T19:00:21.870153+0000","last_became_active":"2023-06-10T18:52:40.514663+0000","last_became_peered":"2023-06-10T18:52:40.514663+0000","last_unstale":"2023-06-10T19:00:21.870153+0000","last_undegraded":"2023-06-10T19:00:21.870153+0000","last_fullsized":"2023-06-10T19:00:21.870153+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:30:56.373122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574945,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32584,"kb_used_data":1536,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339256,"statfs":{"total":96636764160,"available":96603398144,"internally_reserved":0,"allocated":1572864,"data_stored":1030228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:59:50 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.93899999999999995,"15min":0.89500000000000002},"min":{"1min":0.64600000000000002,"5min":0.434,"15min":0.434},"max":{"1min":1.167,"5min":1.3759999999999999,"15min":1.6220000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.93400000000000005,"15min":0.92800000000000005},"min":{"1min":0.78100000000000003,"5min":0.496,"15min":0.496},"max":{"1min":1.1819999999999999,"5min":1.264,"15min":1.6870000000000001},"last":0.97099999999999997}]},{"osd":1,"last update":"Sat Jun 10 18:59:50 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.93000000000000005,"15min":0.92100000000000004},"min":{"1min":0.55100000000000005,"5min":0.54200000000000004,"15min":0.53900000000000003},"max":{"1min":1.262,"5min":1.3759999999999999,"15min":1.377},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.97899999999999998,"15min":0.93200000000000005},"min":{"1min":0.76600000000000001,"5min":0.70099999999999996,"15min":0.504},"max":{"1min":1.129,"5min":1.2529999999999999,"15min":1.5960000000000001},"last":0.72999999999999998}]},{"osd":2,"last update":"Sat Jun 10 18:59:50 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.84899999999999998,"15min":0.83299999999999996},"min":{"1min":0.64900000000000002,"5min":0.49299999999999999,"15min":0.47099999999999997},"max":{"1min":1.1599999999999999,"5min":1.214,"15min":1.4059999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.89200000000000002,"15min":0.90000000000000002},"min":{"1min":0.66900000000000004,"5min":0.53000000000000003,"15min":0.50600000000000001},"max":{"1min":1.157,"5min":1.325,"15min":1.367},"last":0.78100000000000003}]},{"osd":3,"last update":"Sat Jun 10 18:59:50 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.93799999999999994,"15min":0.90900000000000003},"min":{"1min":0.72499999999999998,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.1459999999999999,"5min":1.1799999999999999,"15min":1.502},"last":0.85199999999999998},{"interface":"front","average":{"1min":1.006,"5min":0.95199999999999996,"15min":0.93600000000000005},"min":{"1min":0.67800000000000005,"5min":0.59599999999999997,"15min":0.53800000000000003},"max":{"1min":1.2170000000000001,"5min":1.284,"15min":1.2929999999999999},"last":0.89800000000000002}]},{"osd":4,"last update":"Sat Jun 10 18:59:50 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.84699999999999998,"15min":0.86599999999999999},"min":{"1min":0.60599999999999998,"5min":0.57399999999999995,"15min":0.32700000000000001},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.639},"last":1.0620000000000001},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.95099999999999996,"15min":0.97299999999999998},"min":{"1min":0.68300000000000005,"5min":0.65200000000000002,"15min":0.40000000000000002},"max":{"1min":1.262,"5min":1.365,"15min":1.411},"last":0.93799999999999994}]},{"osd":5,"last update":"Sat Jun 10 18:59:50 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.99399999999999999,"15min":1.0209999999999999},"min":{"1min":0.70199999999999996,"5min":0.60099999999999998,"15min":0.38400000000000001},"max":{"1min":1.3029999999999999,"5min":1.395,"15min":1.806},"last":1.02},{"interface":"front","average":{"1min":1.026,"5min":1.0309999999999999,"15min":1.0429999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.46500000000000002},"max":{"1min":1.242,"5min":1.292,"15min":1.522},"last":1.0900000000000001}]},{"osd":6,"last update":"Sat Jun 10 18:59:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.016,"15min":1.0069999999999999},"min":{"1min":0.751,"5min":0.66400000000000003,"15min":0.36899999999999999},"max":{"1min":1.2470000000000001,"5min":1.369,"15min":1.718},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.1060000000000001,"15min":1.0920000000000001},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.441},"max":{"1min":1.325,"5min":1.4350000000000001,"15min":1.464},"last":1.161}]}]},{"osd":6,"up_from":13,"seq":55834574946,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":964,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":987136,"data_stored":441402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.92900000000000005,"15min":0.83999999999999997},"min":{"1min":0.58699999999999997,"5min":0.52600000000000002,"15min":0.502},"max":{"1min":1.1759999999999999,"5min":1.498,"15min":1.498},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.91900000000000004,"15min":0.86399999999999999},"min":{"1min":0.60899999999999999,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1619999999999999,"5min":1.496,"15min":1.496},"last":0.68999999999999995}]},{"osd":1,"last update":"Sat Jun 10 18:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.88800000000000001,"15min":0.85999999999999999},"min":{"1min":0.66000000000000003,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.143,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.93600000000000005,"15min":0.879},"min":{"1min":0.67500000000000004,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.167,"5min":1.778,"15min":1.778},"last":0.57299999999999995}]},{"osd":2,"last update":"Sat Jun 10 18:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.91200000000000003,"15min":0.874},"min":{"1min":0.67700000000000005,"5min":0.57399999999999995,"15min":0.56499999999999995},"max":{"1min":1.2,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.90400000000000003,"15min":0.89200000000000002},"min":{"1min":0.76900000000000002,"5min":0.60299999999999998,"15min":0.57999999999999996},"max":{"1min":1.0629999999999999,"5min":1.246,"15min":1.246},"last":0.83799999999999997}]},{"osd":3,"last update":"Sat Jun 10 18:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.95799999999999996,"15min":0.88100000000000001},"min":{"1min":0.69599999999999995,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.222,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0029999999999999,"15min":0.996},"min":{"1min":0.75900000000000001,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.25,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.86799999999999999}]},{"osd":4,"last update":"Sat Jun 10 18:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.88900000000000001,"15min":0.93899999999999995},"min":{"1min":0.59799999999999998,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.149,"5min":1.798,"15min":1.798},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.96499999999999997,"15min":1.0029999999999999},"min":{"1min":0.65400000000000003,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.2150000000000001,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.92900000000000005}]},{"osd":5,"last update":"Sat Jun 10 18:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.89700000000000002,"15min":0.94299999999999995},"min":{"1min":0.67300000000000004,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.1160000000000001,"5min":1.333,"15min":1.333},"last":0.63},{"interface":"front","average":{"1min":1.002,"5min":1.036,"15min":1.03},"min":{"1min":0.71099999999999997,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.2090000000000001,"5min":2.536,"15min":2.536},"last":0.90500000000000003}]},{"osd":7,"last update":"Sat Jun 10 18:59:38 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":1.008,"15min":1.0389999999999999},"min":{"1min":0.629,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.2649999999999999,"5min":1.917,"15min":1.917},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.999,"15min":1.0449999999999999},"min":{"1min":0.65500000000000003,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.1950000000000001,"5min":1.395,"15min":1.5569999999999999},"last":0.76000000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574946,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27908,"kb_used_data":956,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343932,"statfs":{"total":96636764160,"available":96608186368,"internally_reserved":0,"allocated":978944,"data_stored":439872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.89800000000000002,"15min":0.85099999999999998},"min":{"1min":0.59899999999999998,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.115,"5min":1.232,"15min":1.232},"last":0.97199999999999998},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.88900000000000001,"15min":0.92300000000000004},"min":{"1min":0.68500000000000005,"5min":0.51400000000000001,"15min":0.49399999999999999},"max":{"1min":1.111,"5min":1.292,"15min":1.637},"last":0.73599999999999999}]},{"osd":1,"last update":"Sat Jun 10 18:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.90000000000000002,"15min":0.91000000000000003},"min":{"1min":0.74299999999999999,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.177,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":1.0009999999999999},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.92100000000000004,"15min":0.91800000000000004},"min":{"1min":0.65900000000000003,"5min":0.57699999999999996,"15min":0.53800000000000003},"max":{"1min":1.264,"5min":1.444,"15min":1.78},"last":1.022}]},{"osd":2,"last update":"Sat Jun 10 18:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.88700000000000001,"15min":0.86199999999999999},"min":{"1min":0.70799999999999996,"5min":0.49299999999999999,"15min":0.48299999999999998},"max":{"1min":1.196,"5min":1.2849999999999999,"15min":1.446},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.92600000000000005,"15min":0.91400000000000003},"min":{"1min":0.73299999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.181,"5min":1.361,"15min":1.361},"last":1.0740000000000001}]},{"osd":3,"last update":"Sat Jun 10 18:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.95299999999999996,"15min":0.94699999999999995},"min":{"1min":0.755,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.111,"5min":1.3440000000000001,"15min":1.484},"last":0.91200000000000003},{"interface":"front","average":{"1min":1.04,"5min":0.96899999999999997,"15min":1.02},"min":{"1min":0.78600000000000003,"5min":0.66300000000000003,"15min":0.61699999999999999},"max":{"1min":1.236,"5min":1.2969999999999999,"15min":1.337},"last":1.042}]},{"osd":4,"last update":"Sat Jun 10 18:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89800000000000002,"15min":0.96099999999999997},"min":{"1min":0.67400000000000004,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.1419999999999999,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.97299999999999998,"15min":1.038},"min":{"1min":0.65300000000000002,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.204,"5min":1.528,"15min":1.575},"last":0.66600000000000004}]},{"osd":6,"last update":"Sat Jun 10 18:59:41 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":0.96299999999999997,"15min":1.044},"min":{"1min":0.67200000000000004,"5min":0.629,"15min":0.56399999999999995},"max":{"1min":1.292,"5min":1.3660000000000001,"15min":1.4330000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":1.056,"5min":1.0109999999999999,"15min":1.0580000000000001},"min":{"1min":0.80200000000000005,"5min":0.66500000000000004,"15min":0.57899999999999996},"max":{"1min":1.343,"5min":1.554,"15min":1.554},"last":1.1259999999999999}]},{"osd":7,"last update":"Sat Jun 10 18:59:41 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.0469999999999999,"15min":1.137},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.3759999999999999,"5min":1.573,"15min":1.873},"last":0.79100000000000004},{"interface":"front","average":{"1min":1.073,"5min":1.097,"15min":1.155},"min":{"1min":0.72499999999999998,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.4159999999999999,"5min":1.4750000000000001,"15min":1.5029999999999999},"last":1.0980000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574945,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32020,"kb_used_data":972,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339820,"statfs":{"total":96636764160,"available":96603975680,"internally_reserved":0,"allocated":995328,"data_stored":441506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:59:51 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.875,"15min":0.78400000000000003},"min":{"1min":0.59099999999999997,"5min":0.49299999999999999,"15min":0.45100000000000001},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.2},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96099999999999997,"15min":0.90200000000000002},"min":{"1min":0.70099999999999996,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1839999999999999,"5min":3.7280000000000002,"15min":3.7280000000000002},"last":0.76300000000000001}]},{"osd":1,"last update":"Sat Jun 10 18:59:51 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.96399999999999997,"15min":0.95499999999999996},"min":{"1min":0.73299999999999998,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.254,"5min":3.3969999999999998,"15min":3.3969999999999998},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.89500000000000002,"15min":0.85799999999999998},"min":{"1min":0.72299999999999998,"5min":0.503,"15min":0.503},"max":{"1min":1.1579999999999999,"5min":2.496,"15min":2.496},"last":0.89800000000000002}]},{"osd":2,"last update":"Sat Jun 10 18:59:51 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90900000000000003,"15min":0.88300000000000001},"min":{"1min":0.68100000000000005,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.177,"5min":1.522,"15min":1.522},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.056,"5min":1.0089999999999999,"15min":1.004},"min":{"1min":0.82999999999999996,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.2769999999999999,"5min":3.5750000000000002,"15min":3.5750000000000002},"last":0.68300000000000005}]},{"osd":3,"last update":"Sat Jun 10 18:59:51 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.91300000000000003,"15min":0.88800000000000001},"min":{"1min":0.74299999999999999,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.075,"5min":2.3809999999999998,"15min":2.3809999999999998},"last":0.97599999999999998},{"interface":"front","average":{"1min":1.0409999999999999,"5min":0.99199999999999999,"15min":0.96199999999999997},"min":{"1min":0.86699999999999999,"5min":0.65400000000000003,"15min":0.54400000000000004},"max":{"1min":1.214,"5min":1.4490000000000001,"15min":1.6479999999999999},"last":1.04}]},{"osd":5,"last update":"Sat Jun 10 18:59:51 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.95099999999999996,"15min":0.98699999999999999},"min":{"1min":0.69699999999999995,"5min":0.59199999999999997,"15min":0.56899999999999995},"max":{"1min":1.1910000000000001,"5min":3.6539999999999999,"15min":3.6539999999999999},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.94999999999999996,"15min":0.97499999999999998},"min":{"1min":0.65000000000000002,"5min":0.58099999999999996,"15min":0.54300000000000004},"max":{"1min":1.2470000000000001,"5min":2.6720000000000002,"15min":2.6720000000000002},"last":1.0660000000000001}]},{"osd":6,"last update":"Sat Jun 10 18:59:51 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.94399999999999995,"15min":1.0029999999999999},"min":{"1min":0.65600000000000003,"5min":0.629,"15min":0.54900000000000004},"max":{"1min":1.28,"5min":1.5720000000000001,"15min":2.2639999999999998},"last":0.81699999999999995},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.079,"15min":1.0760000000000001},"min":{"1min":0.71899999999999997,"5min":0.68999999999999995,"15min":0.57499999999999996},"max":{"1min":1.266,"5min":3.4980000000000002,"15min":3.4980000000000002},"last":0.84299999999999997}]},{"osd":7,"last update":"Sat Jun 10 18:59:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":0.98799999999999999,"15min":0.99199999999999999},"min":{"1min":0.67300000000000004,"5min":0.66300000000000003,"15min":0.41399999999999998},"max":{"1min":1.482,"5min":2.5910000000000002,"15min":2.5910000000000002},"last":1.123},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.0720000000000001,"15min":1.073},"min":{"1min":0.78900000000000003,"5min":0.628,"15min":0.628},"max":{"1min":1.2829999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.872}]}]},{"osd":3,"up_from":13,"seq":55834574944,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32000,"kb_used_data":952,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339840,"statfs":{"total":96636764160,"available":96603996160,"internally_reserved":0,"allocated":974848,"data_stored":439401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.65400000000000003,"15min":0.59399999999999997},"min":{"1min":0.54200000000000004,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.998,"5min":1.169,"15min":1.169},"last":1.01},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.70699999999999996,"15min":0.65100000000000002},"min":{"1min":0.60899999999999999,"5min":0.251,"15min":0.251},"max":{"1min":1.1679999999999999,"5min":1.286,"15min":1.286},"last":0.51300000000000001}]},{"osd":1,"last update":"Sat Jun 10 18:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.72699999999999998,"15min":0.64900000000000002},"min":{"1min":0.59199999999999997,"5min":0.34300000000000003,"15min":0.27500000000000002},"max":{"1min":1.01,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.77500000000000002,"15min":0.72999999999999998},"min":{"1min":0.52900000000000003,"5min":0.33000000000000002,"15min":0.318},"max":{"1min":1.149,"5min":1.296,"15min":1.411},"last":0.69299999999999995}]},{"osd":2,"last update":"Sat Jun 10 18:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.82099999999999995,"15min":0.76700000000000002},"min":{"1min":0.66900000000000004,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.1160000000000001,"5min":1.3759999999999999,"15min":1.9530000000000001},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.82499999999999996,"15min":0.76300000000000001},"min":{"1min":0.66200000000000003,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.1499999999999999,"5min":1.278,"15min":1.278},"last":0.77400000000000002}]},{"osd":4,"last update":"Sat Jun 10 18:59:41 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":0.94299999999999995,"15min":0.95899999999999996},"min":{"1min":0.73499999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.2729999999999999,"5min":1.3360000000000001,"15min":1.488},"last":0.96299999999999997},{"interface":"front","average":{"1min":1.048,"5min":1.0089999999999999,"15min":0.99199999999999999},"min":{"1min":0.83999999999999997,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.228,"5min":1.3700000000000001,"15min":1.458},"last":1.216}]},{"osd":5,"last update":"Sat Jun 10 18:59:41 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.0229999999999999,"15min":1.044},"min":{"1min":0.91200000000000003,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.212,"5min":1.431,"15min":2.024},"last":0.91000000000000003},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.0600000000000001,"15min":1.0249999999999999},"min":{"1min":0.80700000000000005,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.724},"last":1.139}]},{"osd":6,"last update":"Sat Jun 10 18:59:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.0900000000000001,"15min":1.0580000000000001},"min":{"1min":0.78100000000000003,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.597,"5min":1.597,"15min":1.8500000000000001},"last":1.252},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.0640000000000001,"15min":1.0669999999999999},"min":{"1min":0.89400000000000002,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.3420000000000001,"5min":1.514,"15min":1.78},"last":1.095}]},{"osd":7,"last update":"Sat Jun 10 18:59:41 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.103,"15min":1.1180000000000001},"min":{"1min":0.97199999999999998,"5min":0.60999999999999999,"15min":0.56999999999999995},"max":{"1min":1.3879999999999999,"5min":1.5900000000000001,"15min":1.9079999999999999},"last":1.181},{"interface":"front","average":{"1min":1.163,"5min":1.135,"15min":1.087},"min":{"1min":0.91200000000000003,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.3200000000000001,"5min":1.5429999999999999,"15min":1.6719999999999999},"last":1.048}]}]},{"osd":2,"up_from":13,"seq":55834574945,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32012,"kb_used_data":964,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339828,"statfs":{"total":96636764160,"available":96603983872,"internally_reserved":0,"allocated":987136,"data_stored":440580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:59:46 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.63500000000000001,"15min":0.59999999999999998},"min":{"1min":0.51000000000000001,"5min":0.28899999999999998,"15min":0.27300000000000002},"max":{"1min":0.98799999999999999,"5min":1.095,"15min":1.1220000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73999999999999999,"15min":0.72199999999999998},"min":{"1min":0.52600000000000002,"5min":0.436,"15min":0.378},"max":{"1min":0.93999999999999995,"5min":1.194,"15min":1.224},"last":1.141}]},{"osd":1,"last update":"Sat Jun 10 18:59:46 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69699999999999995,"15min":0.66100000000000003},"min":{"1min":0.49299999999999999,"5min":0.39700000000000002,"15min":0.307},"max":{"1min":0.91400000000000003,"5min":1.099,"15min":1.1950000000000001},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.878,"5min":0.81499999999999995,"15min":0.72499999999999998},"min":{"1min":0.54400000000000004,"5min":0.33300000000000002,"15min":0.29499999999999998},"max":{"1min":1.1579999999999999,"5min":1.264,"15min":1.264},"last":0.91700000000000004}]},{"osd":3,"last update":"Sat Jun 10 18:59:46 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82199999999999995,"15min":0.73799999999999999},"min":{"1min":0.60299999999999998,"5min":0.40999999999999998,"15min":0.377},"max":{"1min":1.145,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":1},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.82599999999999996,"15min":0.76800000000000002},"min":{"1min":0.61199999999999999,"5min":0.32900000000000001,"15min":0.252},"max":{"1min":1.1180000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":1.1040000000000001}]},{"osd":4,"last update":"Sat Jun 10 18:59:46 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.95899999999999996,"15min":0.92600000000000005},"min":{"1min":0.72799999999999998,"5min":0.56200000000000006,"15min":0.53400000000000003},"max":{"1min":1.1970000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.034,"5min":1.0329999999999999,"15min":1.032},"min":{"1min":0.65900000000000003,"5min":0.60899999999999999,"15min":0.57699999999999996},"max":{"1min":1.254,"5min":1.476,"15min":1.4950000000000001},"last":1.484}]},{"osd":5,"last update":"Sat Jun 10 18:59:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.034,"15min":1.02},"min":{"1min":0.72999999999999998,"5min":0.64600000000000002,"15min":0.54100000000000004},"max":{"1min":1.3,"5min":1.379,"15min":1.5700000000000001},"last":1.379},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0429999999999999,"15min":1},"min":{"1min":0.69499999999999995,"5min":0.68500000000000005,"15min":0.60099999999999998},"max":{"1min":1.2350000000000001,"5min":1.4119999999999999,"15min":1.667},"last":1.1910000000000001}]},{"osd":6,"last update":"Sat Jun 10 18:59:46 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.073,"15min":1.038},"min":{"1min":0.65200000000000002,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.2410000000000001,"5min":1.4550000000000001,"15min":1.5900000000000001},"last":1.4259999999999999},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.079,"15min":1.0449999999999999},"min":{"1min":0.77400000000000002,"5min":0.66000000000000003,"15min":0.60699999999999998},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":1.2589999999999999}]},{"osd":7,"last update":"Sat Jun 10 18:59:46 2023","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.1100000000000001,"15min":1.101},"min":{"1min":0.97399999999999998,"5min":0.623,"15min":0.62},"max":{"1min":1.724,"5min":1.724,"15min":1.724},"last":1.5800000000000001},{"interface":"front","average":{"1min":1.137,"5min":1.147,"15min":1.097},"min":{"1min":0.72699999999999998,"5min":0.71799999999999997,"15min":0.59299999999999997},"max":{"1min":1.3680000000000001,"5min":1.5920000000000001,"15min":1.752},"last":1.51}]}]},{"osd":1,"up_from":13,"seq":55834574947,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32004,"kb_used_data":956,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339836,"statfs":{"total":96636764160,"available":96603992064,"internally_reserved":0,"allocated":978944,"data_stored":438931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 18:59:52 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.71899999999999997,"15min":0.67500000000000004},"min":{"1min":0.47799999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.94399999999999995,"5min":1.288,"15min":1.288},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.88,"5min":0.80700000000000005,"15min":0.71899999999999997},"min":{"1min":0.745,"5min":0.33800000000000002,"15min":0.26900000000000002},"max":{"1min":1.024,"5min":1.056,"15min":1.694},"last":0.59599999999999997}]},{"osd":2,"last update":"Sat Jun 10 18:59:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.66000000000000003,"15min":0.63100000000000001},"min":{"1min":0.52900000000000003,"5min":0.27300000000000002,"15min":0.249},"max":{"1min":0.99399999999999999,"5min":1.21,"15min":1.21},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.78200000000000003,"15min":0.69099999999999995},"min":{"1min":0.55200000000000005,"5min":0.33800000000000002,"15min":0.315},"max":{"1min":1.097,"5min":1.415,"15min":1.415},"last":0.45000000000000001}]},{"osd":3,"last update":"Sat Jun 10 18:59:52 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.83899999999999997,"15min":0.76900000000000002},"min":{"1min":0.60199999999999998,"5min":0.33400000000000002,"15min":0.26400000000000001},"max":{"1min":1.3049999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.76800000000000002,"15min":0.753},"min":{"1min":0.60599999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":2.1749999999999998},"last":0.36699999999999999}]},{"osd":4,"last update":"Sat Jun 10 18:59:52 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.88900000000000001,"15min":0.84899999999999998},"min":{"1min":0.64500000000000002,"5min":0.56799999999999995,"15min":0.53000000000000003},"max":{"1min":1.2050000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0409999999999999,"15min":1.071},"min":{"1min":0.876,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.5129999999999999,"5min":1.5449999999999999,"15min":5.8209999999999997},"last":0.54600000000000004}]},{"osd":5,"last update":"Sat Jun 10 18:59:52 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.0069999999999999,"15min":1.02},"min":{"1min":0.76900000000000002,"5min":0.58499999999999996,"15min":0.56599999999999995},"max":{"1min":1.2649999999999999,"5min":1.589,"15min":1.8620000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.995,"5min":0.98499999999999999,"15min":0.97599999999999998},"min":{"1min":0.879,"5min":0.60699999999999998,"15min":0.57299999999999995},"max":{"1min":1.1930000000000001,"5min":1.3819999999999999,"15min":3.089},"last":0.70999999999999996}]},{"osd":6,"last update":"Sat Jun 10 18:59:52 2023","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.0680000000000001,"15min":1.0469999999999999},"min":{"1min":0.79300000000000004,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.353,"5min":1.5249999999999999,"15min":7.2599999999999998},"last":0.72299999999999998},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.026,"15min":1.036},"min":{"1min":0.82199999999999995,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.2829999999999999,"5min":1.591,"15min":9.0069999999999997},"last":0.68100000000000005}]},{"osd":7,"last update":"Sat Jun 10 18:59:52 2023","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.121,"15min":1.091},"min":{"1min":0.98599999999999999,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.573,"5min":1.6879999999999999,"15min":2.105},"last":0.69199999999999995},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.135,"15min":1.0860000000000001},"min":{"1min":1.008,"5min":0.65600000000000003,"15min":0.64100000000000001},"max":{"1min":1.343,"5min":1.673,"15min":2.2570000000000001},"last":0.61899999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574946,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32576,"kb_used_data":1528,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339264,"statfs":{"total":96636764160,"available":96603406336,"internally_reserved":0,"allocated":1564672,"data_stored":1029187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jun 10 18:59:44 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.67600000000000005,"15min":0.621},"min":{"1min":0.48999999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.99199999999999999,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.85899999999999999,"15min":0.77900000000000003},"min":{"1min":0.67600000000000005,"5min":0.34100000000000003,"15min":0.34000000000000002},"max":{"1min":1.2230000000000001,"5min":1.302,"15min":1.4059999999999999},"last":0.45000000000000001}]},{"osd":2,"last update":"Sat Jun 10 18:59:44 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.73499999999999999,"15min":0.70699999999999996},"min":{"1min":0.53700000000000003,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.071,"5min":1.1399999999999999,"15min":1.2829999999999999},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.68799999999999994,"15min":0.64700000000000002},"min":{"1min":0.56299999999999994,"5min":0.245,"15min":0.245},"max":{"1min":0.93799999999999994,"5min":1.139,"15min":1.371},"last":0.50900000000000001}]},{"osd":3,"last update":"Sat Jun 10 18:59:44 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.72799999999999998,"15min":0.68600000000000005},"min":{"1min":0.56999999999999995,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.93100000000000005,"5min":1.222,"15min":1.226},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.85899999999999999,"15min":0.82299999999999995},"min":{"1min":0.71899999999999997,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.107,"5min":1.296,"15min":1.829},"last":0.53700000000000003}]},{"osd":4,"last update":"Sat Jun 10 18:59:44 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.95999999999999996,"15min":0.91200000000000003},"min":{"1min":0.77000000000000002,"5min":0.59099999999999997,"15min":0.56100000000000005},"max":{"1min":1.1850000000000001,"5min":3.0209999999999999,"15min":3.0209999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":1.05,"5min":1.044,"15min":1.036},"min":{"1min":0.74099999999999999,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.2190000000000001,"5min":1.3819999999999999,"15min":1.9510000000000001},"last":0.751}]},{"osd":5,"last update":"Sat Jun 10 18:59:44 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.94499999999999995,"15min":0.95199999999999996},"min":{"1min":0.76100000000000001,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.175,"5min":1.351,"15min":1.694},"last":0.80800000000000005},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0429999999999999,"15min":1.014},"min":{"1min":0.753,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.3500000000000001,"5min":4.5620000000000003,"15min":4.5620000000000003},"last":0.73599999999999999}]},{"osd":6,"last update":"Sat Jun 10 18:59:44 2023","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.1319999999999999,"15min":1.079},"min":{"1min":0.89500000000000002,"5min":0.58499999999999996,"15min":0.55900000000000005},"max":{"1min":1.254,"5min":3.5569999999999999,"15min":3.5569999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0309999999999999,"15min":1.0049999999999999},"min":{"1min":0.85599999999999998,"5min":0.60899999999999999,"15min":0.59999999999999998},"max":{"1min":1.248,"5min":1.625,"15min":1.883},"last":0.92000000000000004}]},{"osd":7,"last update":"Sat Jun 10 18:59:44 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.0569999999999999,"15min":1.038},"min":{"1min":0.77600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.337,"5min":1.4850000000000001,"15min":1.5800000000000001},"last":0.875},{"interface":"front","average":{"1min":1.147,"5min":1.0880000000000001,"15min":1.0620000000000001},"min":{"1min":0.84299999999999997,"5min":0.61099999999999999,"15min":0.58699999999999997},"max":{"1min":1.407,"5min":1.4610000000000001,"15min":1.9830000000000001},"last":0.64900000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-10T19:00:25.022 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-06-10T19:00:25.023 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-06-10T19:00:25.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.180+0000 7f6db22d2640 1 Processor -- start 2023-06-10T19:00:25.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.180+0000 7f6db22d2640 1 -- start start 2023-06-10T19:00:25.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.180+0000 7f6db22d2640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6dac158550 0x7f6dac0c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:25.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.180+0000 7f6db22d2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6dac0cd6a0 0x7f6dac0cbe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:25.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.180+0000 7f6db22d2640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dac0cc3c0 con 0x7f6dac15c160 2023-06-10T19:00:25.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.180+0000 7f6db22d2640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dac0c9450 con 0x7f6dac158550 2023-06-10T19:00:25.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.180+0000 7f6db22d2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dac0cc600 con 0x7f6dac0cd6a0 2023-06-10T19:00:25.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.180+0000 7f6dabfff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6dac158550 0x7f6dac0c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:25.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.180+0000 7f6dab7fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6dac0cd6a0 0x7f6dac0cbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:25.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.180+0000 7f6db086f640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f6dac15c160 0x7f6dac06f000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.53:47518/0 (socket says 172.21.15.53:47518) 2023-06-10T19:00:25.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.180+0000 7f6db086f640 1 -- 172.21.15.53:0/1947473229 learned_addr learned my addr 172.21.15.53:0/1947473229 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:00:25.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.184+0000 7f6dabfff640 1 -- 172.21.15.53:0/1947473229 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6dac0cd6a0 msgr2=0x7f6dac0cbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:25.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.184+0000 7f6dabfff640 1 --2- 172.21.15.53:0/1947473229 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6dac0cd6a0 0x7f6dac0cbe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:25.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.184+0000 7f6dabfff640 1 -- 172.21.15.53:0/1947473229 >> v1:172.21.15.117:6789/0 conn(0x7f6dac15c160 legacy=0x7f6dac06f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:25.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.184+0000 7f6dabfff640 1 -- 172.21.15.53:0/1947473229 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dac0cc8e0 con 0x7f6dac158550 2023-06-10T19:00:25.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.184+0000 7f6dab7fe640 1 --2- 172.21.15.53:0/1947473229 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6dac0cd6a0 0x7f6dac0cbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-10T19:00:25.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.184+0000 7f6dabfff640 1 --2- 172.21.15.53:0/1947473229 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6dac158550 0x7f6dac0c8f10 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c0097c0 tx=0x7f6d9c01ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2061de70f11e8288 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:25.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.184+0000 7f6daaffd640 1 -- 172.21.15.53:0/1947473229 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d9c0a8970 con 0x7f6dac158550 2023-06-10T19:00:25.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.184+0000 7f6daaffd640 1 -- 172.21.15.53:0/1947473229 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d9c0a8ad0 con 0x7f6dac158550 2023-06-10T19:00:25.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.184+0000 7f6daaffd640 1 -- 172.21.15.53:0/1947473229 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d9c0a8e60 con 0x7f6dac158550 2023-06-10T19:00:25.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.184+0000 7f6db22d2640 1 -- 172.21.15.53:0/1947473229 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6dac158550 msgr2=0x7f6dac0c8f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:25.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.184+0000 7f6db22d2640 1 --2- 172.21.15.53:0/1947473229 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6dac158550 0x7f6dac0c8f10 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c0097c0 tx=0x7f6d9c01ec70 comp rx=0 tx=0).stop 2023-06-10T19:00:25.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.184+0000 7f6db22d2640 1 -- 172.21.15.53:0/1947473229 shutdown_connections 2023-06-10T19:00:25.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.184+0000 7f6db22d2640 1 --2- 172.21.15.53:0/1947473229 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6dac0cd6a0 0x7f6dac0cbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:25.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.184+0000 7f6db22d2640 1 --2- 172.21.15.53:0/1947473229 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6dac158550 0x7f6dac0c8f10 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:25.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.184+0000 7f6db22d2640 1 -- 172.21.15.53:0/1947473229 >> 172.21.15.53:0/1947473229 conn(0x7f6dac06a0e0 msgr2=0x7f6dac0ca810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:25.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.184+0000 7f6db22d2640 1 -- 172.21.15.53:0/1947473229 shutdown_connections 2023-06-10T19:00:25.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.184+0000 7f6db22d2640 1 -- 172.21.15.53:0/1947473229 wait complete. 2023-06-10T19:00:25.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.188+0000 7f6db22d2640 1 Processor -- start 2023-06-10T19:00:25.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.188+0000 7f6db22d2640 1 -- start start 2023-06-10T19:00:25.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.188+0000 7f6db22d2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6dac0cd6a0 0x7f6dac1482e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:25.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.188+0000 7f6db22d2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6dac158550 0x7f6dac0c2e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:25.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.188+0000 7f6db22d2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6dac15c160 0x7f6dac0b2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:25.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.188+0000 7f6db22d2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dac0c29c0 con 0x7f6dac0cd6a0 2023-06-10T19:00:25.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.188+0000 7f6db22d2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dac148820 con 0x7f6dac158550 2023-06-10T19:00:25.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.188+0000 7f6db22d2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dac0c3390 con 0x7f6dac15c160 2023-06-10T19:00:25.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.188+0000 7f6dabfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6dac0cd6a0 0x7f6dac1482e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:25.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.188+0000 7f6dabfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6dac0cd6a0 0x7f6dac1482e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33278/0 (socket says 172.21.15.53:33278) 2023-06-10T19:00:25.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.188+0000 7f6dabfff640 1 -- 172.21.15.53:0/2857585401 learned_addr learned my addr 172.21.15.53:0/2857585401 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:25.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.188+0000 7f6dab7fe640 1 --2- 172.21.15.53:0/2857585401 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6dac158550 0x7f6dac0c2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:25.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.188+0000 7f6db086f640 1 --2- 172.21.15.53:0/2857585401 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6dac15c160 0x7f6dac0b2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:25.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.188+0000 7f6dabfff640 1 -- 172.21.15.53:0/2857585401 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6dac15c160 msgr2=0x7f6dac0b2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:25.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.188+0000 7f6dabfff640 1 --2- 172.21.15.53:0/2857585401 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6dac15c160 0x7f6dac0b2c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:25.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.188+0000 7f6dabfff640 1 -- 172.21.15.53:0/2857585401 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6dac158550 msgr2=0x7f6dac0c2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:25.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.188+0000 7f6dabfff640 1 --2- 172.21.15.53:0/2857585401 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6dac158550 0x7f6dac0c2e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:25.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.188+0000 7f6dabfff640 1 -- 172.21.15.53:0/2857585401 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6da0009420 con 0x7f6dac0cd6a0 2023-06-10T19:00:25.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.188+0000 7f6dabfff640 1 --2- 172.21.15.53:0/2857585401 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6dac0cd6a0 0x7f6dac1482e0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c01d320 tx=0x7f6d9c01ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:25.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.188+0000 7f6da8ff9640 1 -- 172.21.15.53:0/2857585401 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d9c0b1d40 con 0x7f6dac0cd6a0 2023-06-10T19:00:25.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.188+0000 7f6da8ff9640 1 -- 172.21.15.53:0/2857585401 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d9c0b9410 con 0x7f6dac0cd6a0 2023-06-10T19:00:25.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.188+0000 7f6db22d2640 1 -- 172.21.15.53:0/2857585401 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d9c009420 con 0x7f6dac0cd6a0 2023-06-10T19:00:25.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.188+0000 7f6da8ff9640 1 -- 172.21.15.53:0/2857585401 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d9c0b1ea0 con 0x7f6dac0cd6a0 2023-06-10T19:00:25.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.188+0000 7f6db22d2640 1 -- 172.21.15.53:0/2857585401 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dac0c2090 con 0x7f6dac0cd6a0 2023-06-10T19:00:25.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.188+0000 7f6db22d2640 1 -- 172.21.15.53:0/2857585401 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dac04d790 con 0x7f6dac0cd6a0 2023-06-10T19:00:25.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.188+0000 7f6da8ff9640 1 -- 172.21.15.53:0/2857585401 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6d9c0b7040 con 0x7f6dac0cd6a0 2023-06-10T19:00:25.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.192+0000 7f6da8ff9640 1 --2- 172.21.15.53:0/2857585401 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6d98066280 0x7f6d98068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:25.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.192+0000 7f6da8ff9640 1 -- 172.21.15.53:0/2857585401 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6d9c121670 con 0x7f6dac0cd6a0 2023-06-10T19:00:25.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.192+0000 7f6dab7fe640 1 --2- 172.21.15.53:0/2857585401 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6d98066280 0x7f6d98068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:25.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.192+0000 7f6dab7fe640 1 --2- 172.21.15.53:0/2857585401 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6d98066280 0x7f6d98068730 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f6dac15bad0 tx=0x7f6da0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:25.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.196+0000 7f6da8ff9640 1 -- 172.21.15.53:0/2857585401 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6d9c0eeaf0 con 0x7f6dac0cd6a0 2023-06-10T19:00:25.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.396+0000 7f6db22d2640 1 -- 172.21.15.53:0/2857585401 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f6dac0c1440 con 0x7f6dac0cd6a0 2023-06-10T19:00:25.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.404+0000 7f6da8ff9640 1 -- 172.21.15.53:0/2857585401 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) v1 ==== 190+0+0 (secure 0 0 0) 0x7f6d9c11fe60 con 0x7f6dac0cd6a0 2023-06-10T19:00:25.411 INFO:teuthology.orchestra.run.smithi053.stderr:updated caps for client.0 2023-06-10T19:00:25.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.408+0000 7f6db22d2640 1 -- 172.21.15.53:0/2857585401 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6d98066280 msgr2=0x7f6d98068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:25.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.408+0000 7f6db22d2640 1 --2- 172.21.15.53:0/2857585401 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6d98066280 0x7f6d98068730 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f6dac15bad0 tx=0x7f6da0008040 comp rx=0 tx=0).stop 2023-06-10T19:00:25.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.408+0000 7f6db22d2640 1 -- 172.21.15.53:0/2857585401 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6dac0cd6a0 msgr2=0x7f6dac1482e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:25.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.408+0000 7f6db22d2640 1 --2- 172.21.15.53:0/2857585401 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6dac0cd6a0 0x7f6dac1482e0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c01d320 tx=0x7f6d9c01ba10 comp rx=0 tx=0).stop 2023-06-10T19:00:25.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.408+0000 7f6db22d2640 1 -- 172.21.15.53:0/2857585401 shutdown_connections 2023-06-10T19:00:25.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.408+0000 7f6db22d2640 1 --2- 172.21.15.53:0/2857585401 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6d98066280 0x7f6d98068730 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:25.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.408+0000 7f6db22d2640 1 --2- 172.21.15.53:0/2857585401 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6dac15c160 0x7f6dac0b2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:25.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.408+0000 7f6db22d2640 1 --2- 172.21.15.53:0/2857585401 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6dac158550 0x7f6dac0c2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:25.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.408+0000 7f6db22d2640 1 --2- 172.21.15.53:0/2857585401 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6dac0cd6a0 0x7f6dac1482e0 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:25.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.408+0000 7f6db22d2640 1 -- 172.21.15.53:0/2857585401 >> 172.21.15.53:0/2857585401 conn(0x7f6dac06a0e0 msgr2=0x7f6dac15c530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:25.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.408+0000 7f6db22d2640 1 -- 172.21.15.53:0/2857585401 shutdown_connections 2023-06-10T19:00:25.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.408+0000 7f6db22d2640 1 -- 172.21.15.53:0/2857585401 wait complete. 2023-06-10T19:00:25.430 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:00:25.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.548+0000 7fb6c27e2640 1 Processor -- start 2023-06-10T19:00:25.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.548+0000 7fb6c27e2640 1 -- start start 2023-06-10T19:00:25.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.548+0000 7fb6c27e2640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb6bc0b3ac0 0x7fb6bc0b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:25.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.548+0000 7fb6c27e2640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb6bc0cc690 0x7fb6bc15f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:25.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.548+0000 7fb6c27e2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb6bc0ccae0 0x7fb6bc15f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:25.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.548+0000 7fb6c27e2640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6bc0d0020 con 0x7fb6bc0b3ac0 2023-06-10T19:00:25.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.548+0000 7fb6c27e2640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6bc0b43d0 con 0x7fb6bc0cc690 2023-06-10T19:00:25.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.548+0000 7fb6c27e2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6bc0cef40 con 0x7fb6bc0ccae0 2023-06-10T19:00:25.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.548+0000 7fb6bbfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb6bc0b3ac0 0x7fb6bc0b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:25.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.548+0000 7fb6bbfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb6bc0b3ac0 0x7fb6bc0b3e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33292/0 (socket says 172.21.15.53:33292) 2023-06-10T19:00:25.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.548+0000 7fb6bbfff640 1 -- 172.21.15.53:0/3078765695 learned_addr learned my addr 172.21.15.53:0/3078765695 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:25.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.548+0000 7fb6c0d7f640 1 --2- 172.21.15.53:0/3078765695 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb6bc0ccae0 0x7fb6bc15f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:25.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.548+0000 7fb6bb7fe640 1 --2- 172.21.15.53:0/3078765695 >> v2:172.21.15.117:3300/0 conn(0x7fb6bc0cc690 0x7fb6bc15f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:25.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.548+0000 7fb6bbfff640 1 -- 172.21.15.53:0/3078765695 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb6bc0ccae0 msgr2=0x7fb6bc15f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:25.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.548+0000 7fb6bbfff640 1 --2- 172.21.15.53:0/3078765695 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb6bc0ccae0 0x7fb6bc15f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:25.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.548+0000 7fb6bbfff640 1 -- 172.21.15.53:0/3078765695 >> v2:172.21.15.117:3300/0 conn(0x7fb6bc0cc690 msgr2=0x7fb6bc15f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:25.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.548+0000 7fb6bbfff640 1 --2- 172.21.15.53:0/3078765695 >> v2:172.21.15.117:3300/0 conn(0x7fb6bc0cc690 0x7fb6bc15f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:25.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.548+0000 7fb6bbfff640 1 -- 172.21.15.53:0/3078765695 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6bc0cf220 con 0x7fb6bc0b3ac0 2023-06-10T19:00:25.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.552+0000 7fb6bbfff640 1 --2- 172.21.15.53:0/3078765695 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6bc0b3ac0 0x7fb6bc0b3e90 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc08aa80 tx=0x7fb6ac01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e31c5ff22b504d0c server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:25.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.552+0000 7fb6baffd640 1 -- 172.21.15.53:0/3078765695 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6ac0ac600 con 0x7fb6bc0b3ac0 2023-06-10T19:00:25.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.552+0000 7fb6baffd640 1 -- 172.21.15.53:0/3078765695 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6ac0a8050 con 0x7fb6bc0b3ac0 2023-06-10T19:00:25.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.552+0000 7fb6baffd640 1 -- 172.21.15.53:0/3078765695 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6ac0ac980 con 0x7fb6bc0b3ac0 2023-06-10T19:00:25.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.552+0000 7fb6c27e2640 1 -- 172.21.15.53:0/3078765695 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6bc0b3ac0 msgr2=0x7fb6bc0b3e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:25.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.552+0000 7fb6c27e2640 1 --2- 172.21.15.53:0/3078765695 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6bc0b3ac0 0x7fb6bc0b3e90 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc08aa80 tx=0x7fb6ac01c4d0 comp rx=0 tx=0).stop 2023-06-10T19:00:25.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.552+0000 7fb6c27e2640 1 -- 172.21.15.53:0/3078765695 shutdown_connections 2023-06-10T19:00:25.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.552+0000 7fb6c27e2640 1 --2- 172.21.15.53:0/3078765695 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb6bc0ccae0 0x7fb6bc15f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:25.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.552+0000 7fb6c27e2640 1 --2- 172.21.15.53:0/3078765695 >> v2:172.21.15.117:3300/0 conn(0x7fb6bc0cc690 0x7fb6bc15f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:25.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.552+0000 7fb6c27e2640 1 --2- 172.21.15.53:0/3078765695 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6bc0b3ac0 0x7fb6bc0b3e90 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:25.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.552+0000 7fb6c27e2640 1 -- 172.21.15.53:0/3078765695 >> 172.21.15.53:0/3078765695 conn(0x7fb6bc071790 msgr2=0x7fb6bc069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:25.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.552+0000 7fb6c27e2640 1 -- 172.21.15.53:0/3078765695 shutdown_connections 2023-06-10T19:00:25.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.552+0000 7fb6c27e2640 1 -- 172.21.15.53:0/3078765695 wait complete. 2023-06-10T19:00:25.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.556+0000 7fb6c27e2640 1 Processor -- start 2023-06-10T19:00:25.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.556+0000 7fb6c27e2640 1 -- start start 2023-06-10T19:00:25.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.556+0000 7fb6c27e2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb6bc0b3ac0 0x7fb6bc0b6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:25.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.556+0000 7fb6c27e2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6bc0cc690 0x7fb6bc150be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:25.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.556+0000 7fb6c27e2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb6bc0ccae0 0x7fb6bc0cb680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:25.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.556+0000 7fb6c27e2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6bc1f8bc0 con 0x7fb6bc0cc690 2023-06-10T19:00:25.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.556+0000 7fb6c27e2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6bc15dd50 con 0x7fb6bc0b3ac0 2023-06-10T19:00:25.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.556+0000 7fb6c27e2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6bc15ed10 con 0x7fb6bc0ccae0 2023-06-10T19:00:25.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.556+0000 7fb6bb7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6bc0cc690 0x7fb6bc150be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:25.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.556+0000 7fb6bb7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6bc0cc690 0x7fb6bc150be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33302/0 (socket says 172.21.15.53:33302) 2023-06-10T19:00:25.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.556+0000 7fb6bb7fe640 1 -- 172.21.15.53:0/3531006745 learned_addr learned my addr 172.21.15.53:0/3531006745 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:25.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.556+0000 7fb6bbfff640 1 --2- 172.21.15.53:0/3531006745 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb6bc0b3ac0 0x7fb6bc0b6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:25.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.556+0000 7fb6c0d7f640 1 --2- 172.21.15.53:0/3531006745 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb6bc0ccae0 0x7fb6bc0cb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:25.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.556+0000 7fb6bb7fe640 1 -- 172.21.15.53:0/3531006745 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb6bc0ccae0 msgr2=0x7fb6bc0cb680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:25.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.556+0000 7fb6bb7fe640 1 --2- 172.21.15.53:0/3531006745 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb6bc0ccae0 0x7fb6bc0cb680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:25.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.556+0000 7fb6bb7fe640 1 -- 172.21.15.53:0/3531006745 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb6bc0b3ac0 msgr2=0x7fb6bc0b6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:25.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.556+0000 7fb6bb7fe640 1 --2- 172.21.15.53:0/3531006745 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb6bc0b3ac0 0x7fb6bc0b6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:25.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.556+0000 7fb6bb7fe640 1 -- 172.21.15.53:0/3531006745 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6ac0094d0 con 0x7fb6bc0cc690 2023-06-10T19:00:25.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.556+0000 7fb6c0d7f640 1 --2- 172.21.15.53:0/3531006745 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb6bc0ccae0 0x7fb6bc0cb680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:00:25.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.556+0000 7fb6bb7fe640 1 --2- 172.21.15.53:0/3531006745 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6bc0cc690 0x7fb6bc150be0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7fb6b000d830 tx=0x7fb6b000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:25.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.556+0000 7fb6b8ff9640 1 -- 172.21.15.53:0/3531006745 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b00096c0 con 0x7fb6bc0cc690 2023-06-10T19:00:25.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.556+0000 7fb6b8ff9640 1 -- 172.21.15.53:0/3531006745 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6b0009820 con 0x7fb6bc0cc690 2023-06-10T19:00:25.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.556+0000 7fb6b8ff9640 1 -- 172.21.15.53:0/3531006745 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b0009bd0 con 0x7fb6bc0cc690 2023-06-10T19:00:25.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.556+0000 7fb6c27e2640 1 -- 172.21.15.53:0/3531006745 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6bc15df70 con 0x7fb6bc0cc690 2023-06-10T19:00:25.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.556+0000 7fb6c27e2640 1 -- 172.21.15.53:0/3531006745 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6bc15e530 con 0x7fb6bc0cc690 2023-06-10T19:00:25.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.556+0000 7fb6c27e2640 1 -- 172.21.15.53:0/3531006745 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6bc04d790 con 0x7fb6bc0cc690 2023-06-10T19:00:25.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.556+0000 7fb6b8ff9640 1 -- 172.21.15.53:0/3531006745 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb6b0014410 con 0x7fb6bc0cc690 2023-06-10T19:00:25.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.560+0000 7fb6b8ff9640 1 --2- 172.21.15.53:0/3531006745 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb6a8066280 0x7fb6a8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:25.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.560+0000 7fb6b8ff9640 1 -- 172.21.15.53:0/3531006745 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb6b0084720 con 0x7fb6bc0cc690 2023-06-10T19:00:25.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.560+0000 7fb6bbfff640 1 --2- 172.21.15.53:0/3531006745 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb6a8066280 0x7fb6a8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:25.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.560+0000 7fb6bbfff640 1 --2- 172.21.15.53:0/3531006745 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb6a8066280 0x7fb6a8068730 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac0ae000 tx=0x7fb6ac0a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:25.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.564+0000 7fb6b8ff9640 1 -- 172.21.15.53:0/3531006745 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb6b0051b00 con 0x7fb6bc0cc690 2023-06-10T19:00:25.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.744+0000 7fb6c27e2640 1 -- 172.21.15.53:0/3531006745 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb6bc15bae0 con 0x7fb6bc0cc690 2023-06-10T19:00:25.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.744+0000 7fb6b8ff9640 1 -- 172.21.15.53:0/3531006745 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4676 (secure 0 0 0) 0x7fb6b000b440 con 0x7fb6bc0cc690 2023-06-10T19:00:25.750 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:00:25.751 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":33,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5663,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2600814414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2600814414},{"type":"v1","addr":"172.21.15.117:6835","nonce":2600814414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6136,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1615882017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1615882017},{"type":"v1","addr":"172.21.15.117:6837","nonce":1615882017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6993,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/3732245174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3732245174},{"type":"v1","addr":"172.21.15.53:6833","nonce":3732245174}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:00:20.607950+0000","modified":"2023-06-10T19:00:23.616327+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7002},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7002":{"gid":7002,"name":"c","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/882186121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":882186121},{"type":"v1","addr":"172.21.15.53:6835","nonce":882186121}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-06-10T19:00:25.751 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 33 2023-06-10T19:00:25.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.748+0000 7fb6c27e2640 1 -- 172.21.15.53:0/3531006745 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb6a8066280 msgr2=0x7fb6a8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:25.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.748+0000 7fb6c27e2640 1 --2- 172.21.15.53:0/3531006745 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb6a8066280 0x7fb6a8068730 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac0ae000 tx=0x7fb6ac0a7000 comp rx=0 tx=0).stop 2023-06-10T19:00:25.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.748+0000 7fb6c27e2640 1 -- 172.21.15.53:0/3531006745 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6bc0cc690 msgr2=0x7fb6bc150be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:25.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.748+0000 7fb6c27e2640 1 --2- 172.21.15.53:0/3531006745 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6bc0cc690 0x7fb6bc150be0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7fb6b000d830 tx=0x7fb6b000dcf0 comp rx=0 tx=0).stop 2023-06-10T19:00:25.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.748+0000 7fb6c27e2640 1 -- 172.21.15.53:0/3531006745 shutdown_connections 2023-06-10T19:00:25.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.748+0000 7fb6c27e2640 1 --2- 172.21.15.53:0/3531006745 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb6a8066280 0x7fb6a8068730 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:25.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.748+0000 7fb6c27e2640 1 --2- 172.21.15.53:0/3531006745 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb6bc0ccae0 0x7fb6bc0cb680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:25.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.748+0000 7fb6c27e2640 1 --2- 172.21.15.53:0/3531006745 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6bc0cc690 0x7fb6bc150be0 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:25.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.748+0000 7fb6c27e2640 1 --2- 172.21.15.53:0/3531006745 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb6bc0b3ac0 0x7fb6bc0b6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:25.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.748+0000 7fb6c27e2640 1 -- 172.21.15.53:0/3531006745 >> 172.21.15.53:0/3531006745 conn(0x7fb6bc071790 msgr2=0x7fb6bc1540d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:25.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.748+0000 7fb6c27e2640 1 -- 172.21.15.53:0/3531006745 shutdown_connections 2023-06-10T19:00:25.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:25.748+0000 7fb6c27e2640 1 -- 172.21.15.53:0/3531006745 wait complete. 2023-06-10T19:00:26.169 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 33, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-06-10T19:00:20.607950+0000', 'modified': '2023-06-10T19:00:23.616327+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7002}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7002': {'gid': 7002, 'name': 'c', 'rank': 0, 'incarnation': 30, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.53:6835/882186121', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.53:6834', 'nonce': 882186121}, {'type': 'v1', 'addr': '172.21.15.53:6835', 'nonce': 882186121}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-06-10T19:00:26.170 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-06-10T19:00:26.170 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-06-10T19:00:26.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.300+0000 7f2fa74a9640 1 Processor -- start 2023-06-10T19:00:26.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.300+0000 7f2fa74a9640 1 -- start start 2023-06-10T19:00:26.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.300+0000 7f2fa74a9640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2fa01570a0 0x7f2fa00c9df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:26.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.300+0000 7f2fa74a9640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2fa0157470 0x7f2fa00af7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:26.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.300+0000 7f2fa74a9640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fa00b0170 con 0x7f2fa00afd10 2023-06-10T19:00:26.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.300+0000 7f2fa74a9640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fa00701f0 con 0x7f2fa0157470 2023-06-10T19:00:26.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.300+0000 7f2fa74a9640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fa00703e0 con 0x7f2fa01570a0 2023-06-10T19:00:26.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.300+0000 7f2fa4a44640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2fa0157470 0x7f2fa00af7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:26.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.300+0000 7f2fa4a44640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2fa0157470 0x7f2fa00af7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33310/0 (socket says 172.21.15.53:33310) 2023-06-10T19:00:26.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.300+0000 7f2fa4a44640 1 -- 172.21.15.53:0/2941747480 learned_addr learned my addr 172.21.15.53:0/2941747480 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:26.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.300+0000 7f2fa5245640 1 --2- 172.21.15.53:0/2941747480 >> v2:172.21.15.117:3300/0 conn(0x7f2fa01570a0 0x7f2fa00c9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:26.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.300+0000 7f2fa4a44640 1 -- 172.21.15.53:0/2941747480 >> v2:172.21.15.117:3300/0 conn(0x7f2fa01570a0 msgr2=0x7f2fa00c9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:26.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.300+0000 7f2fa4a44640 1 --2- 172.21.15.53:0/2941747480 >> v2:172.21.15.117:3300/0 conn(0x7f2fa01570a0 0x7f2fa00c9df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:26.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.300+0000 7f2fa4a44640 1 -- 172.21.15.53:0/2941747480 >> v1:172.21.15.117:6789/0 conn(0x7f2fa00afd10 legacy=0x7f2fa00cb890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:26.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.300+0000 7f2fa4a44640 1 -- 172.21.15.53:0/2941747480 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fa00706c0 con 0x7f2fa0157470 2023-06-10T19:00:26.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.304+0000 7f2fa4a44640 1 --2- 172.21.15.53:0/2941747480 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2fa0157470 0x7f2fa00af7d0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f2fa006d4d0 tx=0x7f2f9001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b06424863bb9603 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:26.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.304+0000 7f2f97fff640 1 -- 172.21.15.53:0/2941747480 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f900aa5f0 con 0x7f2fa0157470 2023-06-10T19:00:26.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.304+0000 7f2f97fff640 1 -- 172.21.15.53:0/2941747480 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f900aa750 con 0x7f2fa0157470 2023-06-10T19:00:26.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.304+0000 7f2f97fff640 1 -- 172.21.15.53:0/2941747480 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f900aaae0 con 0x7f2fa0157470 2023-06-10T19:00:26.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.304+0000 7f2fa74a9640 1 -- 172.21.15.53:0/2941747480 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2fa0157470 msgr2=0x7f2fa00af7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:26.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.304+0000 7f2fa74a9640 1 --2- 172.21.15.53:0/2941747480 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2fa0157470 0x7f2fa00af7d0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f2fa006d4d0 tx=0x7f2f9001c490 comp rx=0 tx=0).stop 2023-06-10T19:00:26.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.304+0000 7f2fa74a9640 1 -- 172.21.15.53:0/2941747480 shutdown_connections 2023-06-10T19:00:26.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.304+0000 7f2fa74a9640 1 --2- 172.21.15.53:0/2941747480 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2fa0157470 0x7f2fa00af7d0 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:26.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.304+0000 7f2fa74a9640 1 --2- 172.21.15.53:0/2941747480 >> v2:172.21.15.117:3300/0 conn(0x7f2fa01570a0 0x7f2fa00c9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:26.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.304+0000 7f2fa74a9640 1 -- 172.21.15.53:0/2941747480 >> 172.21.15.53:0/2941747480 conn(0x7f2fa00ce9e0 msgr2=0x7f2fa00ca7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:26.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.304+0000 7f2fa74a9640 1 -- 172.21.15.53:0/2941747480 shutdown_connections 2023-06-10T19:00:26.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.304+0000 7f2fa74a9640 1 -- 172.21.15.53:0/2941747480 wait complete. 2023-06-10T19:00:26.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.304+0000 7f2fa74a9640 1 Processor -- start 2023-06-10T19:00:26.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.304+0000 7f2fa74a9640 1 -- start start 2023-06-10T19:00:26.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.308+0000 7f2fa74a9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2fa00afd10 0x7f2fa01f3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:26.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.308+0000 7f2fa74a9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2fa01570a0 0x7f2fa00c5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:26.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.308+0000 7f2fa74a9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2fa0157470 0x7f2fa015bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:26.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.308+0000 7f2fa74a9640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa0163ed0 con 0x7f2fa00afd10 2023-06-10T19:00:26.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.308+0000 7f2fa74a9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa0150b50 con 0x7f2fa01570a0 2023-06-10T19:00:26.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.308+0000 7f2fa74a9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa01f43d0 con 0x7f2fa0157470 2023-06-10T19:00:26.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.308+0000 7f2fa5245640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2fa00afd10 0x7f2fa01f3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:26.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.308+0000 7f2fa5245640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2fa00afd10 0x7f2fa01f3b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33320/0 (socket says 172.21.15.53:33320) 2023-06-10T19:00:26.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.308+0000 7f2fa5245640 1 -- 172.21.15.53:0/3771277979 learned_addr learned my addr 172.21.15.53:0/3771277979 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:26.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.308+0000 7f2fa4a44640 1 --2- 172.21.15.53:0/3771277979 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2fa01570a0 0x7f2fa00c5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:26.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.308+0000 7f2fa5a46640 1 --2- 172.21.15.53:0/3771277979 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2fa0157470 0x7f2fa015bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:26.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.308+0000 7f2fa5245640 1 -- 172.21.15.53:0/3771277979 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2fa0157470 msgr2=0x7f2fa015bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:26.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.308+0000 7f2fa5245640 1 --2- 172.21.15.53:0/3771277979 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2fa0157470 0x7f2fa015bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:26.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.308+0000 7f2fa5245640 1 -- 172.21.15.53:0/3771277979 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2fa01570a0 msgr2=0x7f2fa00c5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:26.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.308+0000 7f2fa5245640 1 --2- 172.21.15.53:0/3771277979 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2fa01570a0 0x7f2fa00c5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:26.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.308+0000 7f2fa5245640 1 -- 172.21.15.53:0/3771277979 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f900094d0 con 0x7f2fa00afd10 2023-06-10T19:00:26.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.308+0000 7f2fa5245640 1 --2- 172.21.15.53:0/3771277979 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2fa00afd10 0x7f2fa01f3b20 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c00d800 tx=0x7f2f9c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:26.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.308+0000 7f2f95ffb640 1 -- 172.21.15.53:0/3771277979 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f9c018070 con 0x7f2fa00afd10 2023-06-10T19:00:26.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.308+0000 7f2f95ffb640 1 -- 172.21.15.53:0/3771277979 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f9c0059a0 con 0x7f2fa00afd10 2023-06-10T19:00:26.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.308+0000 7f2f95ffb640 1 -- 172.21.15.53:0/3771277979 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f9c005b50 con 0x7f2fa00afd10 2023-06-10T19:00:26.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.308+0000 7f2fa74a9640 1 -- 172.21.15.53:0/3771277979 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fa01f46b0 con 0x7f2fa00afd10 2023-06-10T19:00:26.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.308+0000 7f2fa74a9640 1 -- 172.21.15.53:0/3771277979 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fa0159490 con 0x7f2fa00afd10 2023-06-10T19:00:26.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.308+0000 7f2f95ffb640 1 -- 172.21.15.53:0/3771277979 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2f9c005cb0 con 0x7f2fa00afd10 2023-06-10T19:00:26.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.308+0000 7f2f95ffb640 1 --2- 172.21.15.53:0/3771277979 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2f84066280 0x7f2f84068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:26.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.308+0000 7f2f95ffb640 1 -- 172.21.15.53:0/3771277979 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2f9c083bc0 con 0x7f2fa00afd10 2023-06-10T19:00:26.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.308+0000 7f2fa4a44640 1 --2- 172.21.15.53:0/3771277979 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2f84066280 0x7f2f84068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:26.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.312+0000 7f2faa5c5000 1 Processor -- start 2023-06-10T19:00:26.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.312+0000 7f2faa5c5000 1 -- start start 2023-06-10T19:00:26.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.312+0000 7f2fa4a44640 1 --2- 172.21.15.53:0/3771277979 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2f84066280 0x7f2f84068730 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f2f900ae000 tx=0x7f2f900a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:26.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.312+0000 7f2faa5c5000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56379f455740 0x56379f455b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:26.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.312+0000 7f2faa5c5000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56379f456050 0x56379f40b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:26.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.312+0000 7f2faa5c5000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56379f40bd80 0x56379f40c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:26.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.312+0000 7f2faa5c5000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56379f2d3ac0 con 0x56379f456050 2023-06-10T19:00:26.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.312+0000 7f2faa5c5000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x56379f20d840 con 0x56379f455740 2023-06-10T19:00:26.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.312+0000 7f2faa5c5000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x56379f2612e0 con 0x56379f40bd80 2023-06-10T19:00:26.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.312+0000 7f2fa4a44640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56379f456050 0x56379f40b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:26.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.312+0000 7f2fa4a44640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56379f456050 0x56379f40b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33322/0 (socket says 172.21.15.53:33322) 2023-06-10T19:00:26.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.312+0000 7f2fa4a44640 1 -- 172.21.15.53:0/414476221 learned_addr learned my addr 172.21.15.53:0/414476221 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:26.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.312+0000 7f2fa5245640 1 --2- 172.21.15.53:0/414476221 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56379f455740 0x56379f455b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:26.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.312+0000 7f2fa5a46640 1 --2- 172.21.15.53:0/414476221 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56379f40bd80 0x56379f40c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:26.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.312+0000 7f2fa4a44640 1 -- 172.21.15.53:0/414476221 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56379f40bd80 msgr2=0x56379f40c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:26.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.312+0000 7f2fa4a44640 1 --2- 172.21.15.53:0/414476221 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56379f40bd80 0x56379f40c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:26.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.312+0000 7f2fa4a44640 1 -- 172.21.15.53:0/414476221 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56379f455740 msgr2=0x56379f455b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:26.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.312+0000 7f2fa4a44640 1 --2- 172.21.15.53:0/414476221 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56379f455740 0x56379f455b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:26.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.312+0000 7f2fa4a44640 1 -- 172.21.15.53:0/414476221 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56379ef56890 con 0x56379f456050 2023-06-10T19:00:26.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.312+0000 7f2fa4a44640 1 --2- 172.21.15.53:0/414476221 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56379f456050 0x56379f40b840 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f2f9001a0c0 tx=0x7f2f90004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f1d580022852a38 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:26.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.312+0000 7f2f82ffd640 1 -- 172.21.15.53:0/414476221 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f900bf6d0 con 0x56379f456050 2023-06-10T19:00:26.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.312+0000 7f2f82ffd640 1 -- 172.21.15.53:0/414476221 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f900c3070 con 0x56379f456050 2023-06-10T19:00:26.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.312+0000 7f2f82ffd640 1 -- 172.21.15.53:0/414476221 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f900bfa30 con 0x56379f456050 2023-06-10T19:00:26.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.312+0000 7f2faa5c5000 1 -- 172.21.15.53:0/414476221 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56379f456050 msgr2=0x56379f40b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:26.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.312+0000 7f2faa5c5000 1 --2- 172.21.15.53:0/414476221 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56379f456050 0x56379f40b840 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f2f9001a0c0 tx=0x7f2f90004740 comp rx=0 tx=0).stop 2023-06-10T19:00:26.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.312+0000 7f2faa5c5000 1 -- 172.21.15.53:0/414476221 shutdown_connections 2023-06-10T19:00:26.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.312+0000 7f2faa5c5000 1 --2- 172.21.15.53:0/414476221 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56379f40bd80 0x56379f40c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:26.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.312+0000 7f2faa5c5000 1 --2- 172.21.15.53:0/414476221 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56379f456050 0x56379f40b840 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:26.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.312+0000 7f2faa5c5000 1 --2- 172.21.15.53:0/414476221 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56379f455740 0x56379f455b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:26.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.312+0000 7f2faa5c5000 1 -- 172.21.15.53:0/414476221 >> 172.21.15.53:0/414476221 conn(0x56379f403800 msgr2=0x56379f412800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:26.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.312+0000 7f2faa5c5000 1 -- 172.21.15.53:0/414476221 shutdown_connections 2023-06-10T19:00:26.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.312+0000 7f2faa5c5000 1 -- 172.21.15.53:0/414476221 wait complete. 2023-06-10T19:00:26.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.312+0000 7f2faa5c5000 1 -- start start 2023-06-10T19:00:26.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.312+0000 7f2faa5c5000 1 Processor -- start 2023-06-10T19:00:26.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.316+0000 7f2faa5c5000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56379f40bd80 0x56379f411490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:26.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.316+0000 7f2faa5c5000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56379f455740 0x56379f4119d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:26.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.316+0000 7f2faa5c5000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56379f456050 0x56379f4170e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:26.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.316+0000 7f2faa5c5000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56379f25a380 con 0x56379f455740 2023-06-10T19:00:26.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.316+0000 7f2faa5c5000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x56379f216ae0 con 0x56379f40bd80 2023-06-10T19:00:26.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.316+0000 7f2faa5c5000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x56379f216780 con 0x56379f456050 2023-06-10T19:00:26.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.316+0000 7f2faa5c5000 10 client.0 _ll_register_callbacks cb 0x56379f3f7e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-10T19:00:26.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.316+0000 7f2fa4a44640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56379f455740 0x56379f4119d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:26.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.316+0000 7f2fa4a44640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56379f455740 0x56379f4119d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33338/0 (socket says 172.21.15.53:33338) 2023-06-10T19:00:26.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.316+0000 7f2fa4a44640 1 -- 172.21.15.53:0/4149819493 learned_addr learned my addr 172.21.15.53:0/4149819493 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:26.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.316+0000 7f2fa5a46640 1 --2- 172.21.15.53:0/4149819493 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56379f456050 0x56379f4170e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:26.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.316+0000 7f2fa5245640 1 --2- 172.21.15.53:0/4149819493 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56379f40bd80 0x56379f411490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:26.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.316+0000 7f2fa4a44640 1 -- 172.21.15.53:0/4149819493 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56379f456050 msgr2=0x56379f4170e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:26.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.316+0000 7f2fa4a44640 1 --2- 172.21.15.53:0/4149819493 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56379f456050 0x56379f4170e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:26.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.316+0000 7f2fa4a44640 1 -- 172.21.15.53:0/4149819493 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56379f40bd80 msgr2=0x56379f411490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:26.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.316+0000 7f2fa4a44640 1 --2- 172.21.15.53:0/4149819493 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56379f40bd80 0x56379f411490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:26.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.316+0000 7f2fa4a44640 1 -- 172.21.15.53:0/4149819493 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f900b9070 con 0x56379f455740 2023-06-10T19:00:26.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.316+0000 7f2fa4a44640 1 --2- 172.21.15.53:0/4149819493 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56379f455740 0x56379f4119d0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f2f9001c970 tx=0x7f2f9001acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba42417abeabaacd server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:26.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.316+0000 7f2f7bfff640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-06-10T19:00:26.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.316+0000 7f2f7bfff640 1 -- 172.21.15.53:0/4149819493 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f900bf990 con 0x56379f455740 2023-06-10T19:00:26.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.316+0000 7f2f7bfff640 1 -- 172.21.15.53:0/4149819493 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(80..80 src has 1..80) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2f900a7070 con 0x56379f455740 2023-06-10T19:00:26.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.316+0000 7f2faa5c5000 1 -- 172.21.15.53:0/4149819493 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56379f221a20 con 0x56379f455740 2023-06-10T19:00:26.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.316+0000 7f2f7bfff640 1 -- 172.21.15.53:0/4149819493 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2f900bfaf0 con 0x56379f455740 2023-06-10T19:00:26.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.316+0000 7f2faa5c5000 10 client.7143 fetch_fsmap learned FSMap version 33 2023-06-10T19:00:26.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.316+0000 7f2faa5c5000 1 -- 172.21.15.53:0/4149819493 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) v3 -- 0x56379f21ed10 con 0x56379f455740 2023-06-10T19:00:26.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.316+0000 7f2f7bfff640 1 -- 172.21.15.53:0/4149819493 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56379f221a20 con 0x56379f455740 2023-06-10T19:00:26.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.316+0000 7f2f7bfff640 1 -- 172.21.15.53:0/4149819493 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 33) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f2f900a9070 con 0x56379f455740 2023-06-10T19:00:26.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.316+0000 7f2faa5c5000 10 client.7143 fetch_fsmap finished waiting for FSMap version 33 2023-06-10T19:00:26.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.316+0000 7f2faa5c5000 10 client.7143 resolve_mds: resolved name 'c' to daemon mds.c 2023-06-10T19:00:26.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.316+0000 7f2faa5c5000 20 client.7143 populate_metadata read hostname 'smithi053' 2023-06-10T19:00:26.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.316+0000 7f2faa5c5000 1 --2- 172.21.15.53:0/4149819493 >> [v2:172.21.15.53:6834/882186121,v1:172.21.15.53:6835/882186121] conn(0x56379f4647b0 0x56379f466b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:26.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.316+0000 7f2faa5c5000 4 client.7143 mds_command: new command op to 7002 tid=0[{"prefix": "get_command_descriptions"}] 2023-06-10T19:00:26.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.316+0000 7f2faa5c5000 1 -- 172.21.15.53:0/4149819493 --> [v2:172.21.15.53:6834/882186121,v1:172.21.15.53:6835/882186121] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56379f289710 con 0x56379f4647b0 2023-06-10T19:00:26.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.316+0000 7f2fa5245640 1 --2- 172.21.15.53:0/4149819493 >> [v2:172.21.15.53:6834/882186121,v1:172.21.15.53:6835/882186121] conn(0x56379f4647b0 0x56379f466b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:26.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.316+0000 7f2f7bfff640 10 client.7143 ms_handle_connect on v2:172.21.15.53:6834/882186121 2023-06-10T19:00:26.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.316+0000 7f2fa5245640 1 --2- 172.21.15.53:0/4149819493 >> [v2:172.21.15.53:6834/882186121,v1:172.21.15.53:6835/882186121] conn(0x56379f4647b0 0x56379f466b90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61b66db498e0c026 server_cookie=b94e8f18c3f1f37f in_seq=0 out_seq=0 2023-06-10T19:00:26.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.316+0000 7f2f7bfff640 1 -- 172.21.15.53:0/4149819493 <== mds.0 v2:172.21.15.53:6834/882186121 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x56379f289710 con 0x56379f4647b0 2023-06-10T19:00:26.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.316+0000 7f2f7bfff640 10 client.7143 handle_command_reply: tid=0 2023-06-10T19:00:26.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.316+0000 7f2faa5c5000 1 client.7143 shutdown 2023-06-10T19:00:26.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.316+0000 7f2faa5c5000 1 -- 172.21.15.53:0/4149819493 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56379f455740 msgr2=0x56379f4119d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:26.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.316+0000 7f2faa5c5000 1 --2- 172.21.15.53:0/4149819493 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56379f455740 0x56379f4119d0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f2f9001c970 tx=0x7f2f9001acd0 comp rx=0 tx=0).stop 2023-06-10T19:00:26.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.316+0000 7f2faa5c5000 1 -- 172.21.15.53:0/4149819493 shutdown_connections 2023-06-10T19:00:26.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.316+0000 7f2faa5c5000 1 --2- 172.21.15.53:0/4149819493 >> [v2:172.21.15.53:6834/882186121,v1:172.21.15.53:6835/882186121] conn(0x56379f4647b0 0x56379f466b90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:26.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.316+0000 7f2faa5c5000 1 --2- 172.21.15.53:0/4149819493 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56379f456050 0x56379f4170e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:26.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.316+0000 7f2faa5c5000 1 --2- 172.21.15.53:0/4149819493 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56379f455740 0x56379f4119d0 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:26.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.316+0000 7f2f7bfff640 0 client.7143 ms_handle_reset on v2:172.21.15.53:6834/882186121 2023-06-10T19:00:26.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.316+0000 7f2faa5c5000 1 --2- 172.21.15.53:0/4149819493 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56379f40bd80 0x56379f411490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:26.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.316+0000 7f2faa5c5000 1 -- 172.21.15.53:0/4149819493 >> 172.21.15.53:0/4149819493 conn(0x56379f403800 msgr2=0x56379f40a830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:26.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.316+0000 7f2faa5c5000 1 -- 172.21.15.53:0/4149819493 shutdown_connections 2023-06-10T19:00:26.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.316+0000 7f2faa5c5000 1 -- 172.21.15.53:0/4149819493 wait complete. 2023-06-10T19:00:26.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.316+0000 7f2faa5c5000 20 client.7143 trim_cache size 0 max 16384 2023-06-10T19:00:26.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.332+0000 7f2faa5c5000 1 Processor -- start 2023-06-10T19:00:26.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.332+0000 7f2faa5c5000 1 -- start start 2023-06-10T19:00:26.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.332+0000 7f2faa5c5000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56379f40bd80 0x56379f468b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:26.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.332+0000 7f2faa5c5000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56379f455740 0x56379f464b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:26.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.332+0000 7f2faa5c5000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56379f456050 0x56379f4650c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:26.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.332+0000 7f2faa5c5000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56379ef17940 con 0x56379f40bd80 2023-06-10T19:00:26.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.332+0000 7f2faa5c5000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x56379f25cee0 con 0x56379f455740 2023-06-10T19:00:26.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.332+0000 7f2faa5c5000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x56379f21bad0 con 0x56379f456050 2023-06-10T19:00:26.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.332+0000 7f2fa5245640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56379f40bd80 0x56379f468b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:26.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.332+0000 7f2fa5245640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56379f40bd80 0x56379f468b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33354/0 (socket says 172.21.15.53:33354) 2023-06-10T19:00:26.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.332+0000 7f2fa5245640 1 -- 172.21.15.53:0/79613983 learned_addr learned my addr 172.21.15.53:0/79613983 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:26.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.332+0000 7f2fa5245640 1 -- 172.21.15.53:0/79613983 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56379f456050 msgr2=0x56379f4650c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:26.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.332+0000 7f2fa5245640 1 --2- 172.21.15.53:0/79613983 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56379f456050 0x56379f4650c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:26.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.332+0000 7f2fa5245640 1 -- 172.21.15.53:0/79613983 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56379f455740 msgr2=0x56379f464b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:26.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.332+0000 7f2fa5245640 1 --2- 172.21.15.53:0/79613983 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56379f455740 0x56379f464b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:26.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.332+0000 7f2fa5245640 1 -- 172.21.15.53:0/79613983 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56379f40e450 con 0x56379f40bd80 2023-06-10T19:00:26.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.332+0000 7f2fa5245640 1 --2- 172.21.15.53:0/79613983 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56379f40bd80 0x56379f468b00 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c054c90 tx=0x7f2f9c05a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ba2b085bd5cfd54 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:26.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.332+0000 7f2f837fe640 1 -- 172.21.15.53:0/79613983 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f9c052e40 con 0x56379f40bd80 2023-06-10T19:00:26.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.332+0000 7f2f837fe640 1 -- 172.21.15.53:0/79613983 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f9c0530a0 con 0x56379f40bd80 2023-06-10T19:00:26.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.332+0000 7f2f837fe640 1 -- 172.21.15.53:0/79613983 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f9c081390 con 0x56379f40bd80 2023-06-10T19:00:26.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.332+0000 7f2faa5c5000 1 -- 172.21.15.53:0/79613983 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56379f40bd80 msgr2=0x56379f468b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:26.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.332+0000 7f2faa5c5000 1 --2- 172.21.15.53:0/79613983 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56379f40bd80 0x56379f468b00 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c054c90 tx=0x7f2f9c05a040 comp rx=0 tx=0).stop 2023-06-10T19:00:26.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.336+0000 7f2faa5c5000 1 -- 172.21.15.53:0/79613983 shutdown_connections 2023-06-10T19:00:26.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.336+0000 7f2faa5c5000 1 --2- 172.21.15.53:0/79613983 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56379f456050 0x56379f4650c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:26.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.336+0000 7f2faa5c5000 1 --2- 172.21.15.53:0/79613983 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56379f455740 0x56379f464b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:26.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.336+0000 7f2faa5c5000 1 --2- 172.21.15.53:0/79613983 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56379f40bd80 0x56379f468b00 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:26.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.336+0000 7f2faa5c5000 1 -- 172.21.15.53:0/79613983 >> 172.21.15.53:0/79613983 conn(0x56379f403800 msgr2=0x56379f40aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:26.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.336+0000 7f2faa5c5000 1 -- 172.21.15.53:0/79613983 shutdown_connections 2023-06-10T19:00:26.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.336+0000 7f2faa5c5000 1 -- 172.21.15.53:0/79613983 wait complete. 2023-06-10T19:00:26.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.336+0000 7f2faa5c5000 1 -- start start 2023-06-10T19:00:26.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.336+0000 7f2faa5c5000 1 Processor -- start 2023-06-10T19:00:26.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.336+0000 7f2faa5c5000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56379f40bd80 0x56379f468240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:26.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.336+0000 7f2faa5c5000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56379f455740 0x56379f4b2b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:26.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.336+0000 7f2faa5c5000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56379f456050 0x56379f4b30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:26.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.336+0000 7f2faa5c5000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56379f4158a0 con 0x56379f456050 2023-06-10T19:00:26.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.336+0000 7f2faa5c5000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x56379f3165d0 con 0x56379f455740 2023-06-10T19:00:26.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.336+0000 7f2faa5c5000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x56379f229320 con 0x56379f40bd80 2023-06-10T19:00:26.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.336+0000 7f2faa5c5000 10 client.0 _ll_register_callbacks cb 0x56379f21e7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-10T19:00:26.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.336+0000 7f2fa5a46640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56379f456050 0x56379f4b30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:26.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.336+0000 7f2fa5a46640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56379f456050 0x56379f4b30a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33368/0 (socket says 172.21.15.53:33368) 2023-06-10T19:00:26.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.336+0000 7f2fa5a46640 1 -- 172.21.15.53:0/1545955616 learned_addr learned my addr 172.21.15.53:0/1545955616 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:26.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.336+0000 7f2fa5a46640 1 -- 172.21.15.53:0/1545955616 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56379f40bd80 msgr2=0x56379f468240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:26.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.336+0000 7f2fa5245640 1 --2- 172.21.15.53:0/1545955616 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56379f40bd80 0x56379f468240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:26.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.336+0000 7f2fa4a44640 1 --2- 172.21.15.53:0/1545955616 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56379f455740 0x56379f4b2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:26.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.336+0000 7f2fa5a46640 1 --2- 172.21.15.53:0/1545955616 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56379f40bd80 0x56379f468240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:26.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.336+0000 7f2fa5a46640 1 -- 172.21.15.53:0/1545955616 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56379f455740 msgr2=0x56379f4b2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:26.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.336+0000 7f2fa5a46640 1 --2- 172.21.15.53:0/1545955616 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56379f455740 0x56379f4b2b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:26.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.336+0000 7f2fa5a46640 1 -- 172.21.15.53:0/1545955616 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f9c058040 con 0x56379f456050 2023-06-10T19:00:26.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.336+0000 7f2fa5a46640 1 --2- 172.21.15.53:0/1545955616 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56379f456050 0x56379f4b30a0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f2f98011470 tx=0x7f2f98011930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca939003915ccbcb server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:26.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.336+0000 7f2f7bfff640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-06-10T19:00:26.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.336+0000 7f2f7bfff640 1 -- 172.21.15.53:0/1545955616 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f98016880 con 0x56379f456050 2023-06-10T19:00:26.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.336+0000 7f2f7bfff640 1 -- 172.21.15.53:0/1545955616 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(80..80 src has 1..80) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2f980169e0 con 0x56379f456050 2023-06-10T19:00:26.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.336+0000 7f2faa5c5000 1 -- 172.21.15.53:0/1545955616 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56379f40f6e0 con 0x56379f456050 2023-06-10T19:00:26.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.336+0000 7f2f7bfff640 1 -- 172.21.15.53:0/1545955616 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2f98016ba0 con 0x56379f456050 2023-06-10T19:00:26.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.336+0000 7f2faa5c5000 10 client.7149 fetch_fsmap learned FSMap version 33 2023-06-10T19:00:26.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.336+0000 7f2faa5c5000 1 -- 172.21.15.53:0/1545955616 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) v3 -- 0x56379f204fa0 con 0x56379f456050 2023-06-10T19:00:26.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.336+0000 7f2f7bfff640 1 -- 172.21.15.53:0/1545955616 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56379f40f6e0 con 0x56379f456050 2023-06-10T19:00:26.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.336+0000 7f2f7bfff640 1 -- 172.21.15.53:0/1545955616 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 33) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f2f98016d00 con 0x56379f456050 2023-06-10T19:00:26.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.336+0000 7f2faa5c5000 10 client.7149 fetch_fsmap finished waiting for FSMap version 33 2023-06-10T19:00:26.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.336+0000 7f2faa5c5000 10 client.7149 resolve_mds: resolved name 'c' to daemon mds.c 2023-06-10T19:00:26.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.336+0000 7f2faa5c5000 20 client.7149 populate_metadata read hostname 'smithi053' 2023-06-10T19:00:26.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.336+0000 7f2faa5c5000 1 --2- 172.21.15.53:0/1545955616 >> [v2:172.21.15.53:6834/882186121,v1:172.21.15.53:6835/882186121] conn(0x56379f46fff0 0x56379f4703c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:26.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.336+0000 7f2faa5c5000 4 client.7149 mds_command: new command op to 7002 tid=0[{"prefix": "status"}] 2023-06-10T19:00:26.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.336+0000 7f2faa5c5000 1 -- 172.21.15.53:0/1545955616 --> [v2:172.21.15.53:6834/882186121,v1:172.21.15.53:6835/882186121] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56379f258cd0 con 0x56379f46fff0 2023-06-10T19:00:26.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.336+0000 7f2fa5245640 1 --2- 172.21.15.53:0/1545955616 >> [v2:172.21.15.53:6834/882186121,v1:172.21.15.53:6835/882186121] conn(0x56379f46fff0 0x56379f4703c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:26.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.336+0000 7f2f7bfff640 10 client.7149 ms_handle_connect on v2:172.21.15.53:6834/882186121 2023-06-10T19:00:26.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.336+0000 7f2fa5245640 1 --2- 172.21.15.53:0/1545955616 >> [v2:172.21.15.53:6834/882186121,v1:172.21.15.53:6835/882186121] conn(0x56379f46fff0 0x56379f4703c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=efa8e278b2b8e84c server_cookie=157e9f77823496be in_seq=0 out_seq=0 2023-06-10T19:00:26.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.336+0000 7f2f7bfff640 1 -- 172.21.15.53:0/1545955616 <== mds.0 v2:172.21.15.53:6834/882186121 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x56379f258cd0 con 0x56379f46fff0 2023-06-10T19:00:26.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.336+0000 7f2f7bfff640 10 client.7149 handle_command_reply: tid=0 2023-06-10T19:00:26.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.336+0000 7f2faa5c5000 1 client.7149 shutdown 2023-06-10T19:00:26.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.336+0000 7f2faa5c5000 1 -- 172.21.15.53:0/1545955616 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56379f456050 msgr2=0x56379f4b30a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:26.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.336+0000 7f2faa5c5000 1 --2- 172.21.15.53:0/1545955616 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56379f456050 0x56379f4b30a0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f2f98011470 tx=0x7f2f98011930 comp rx=0 tx=0).stop 2023-06-10T19:00:26.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.336+0000 7f2faa5c5000 1 -- 172.21.15.53:0/1545955616 shutdown_connections 2023-06-10T19:00:26.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.336+0000 7f2faa5c5000 1 --2- 172.21.15.53:0/1545955616 >> [v2:172.21.15.53:6834/882186121,v1:172.21.15.53:6835/882186121] conn(0x56379f46fff0 0x56379f4703c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:26.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.336+0000 7f2faa5c5000 1 --2- 172.21.15.53:0/1545955616 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56379f456050 0x56379f4b30a0 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:26.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.336+0000 7f2faa5c5000 1 --2- 172.21.15.53:0/1545955616 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56379f455740 0x56379f4b2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:26.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.336+0000 7f2faa5c5000 1 --2- 172.21.15.53:0/1545955616 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56379f40bd80 0x56379f468240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:26.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.336+0000 7f2faa5c5000 1 -- 172.21.15.53:0/1545955616 >> 172.21.15.53:0/1545955616 conn(0x56379f403800 msgr2=0x56379f454060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:26.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.336+0000 7f2f7bfff640 0 client.7149 ms_handle_reset on v2:172.21.15.53:6834/882186121 2023-06-10T19:00:26.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.336+0000 7f2faa5c5000 1 -- 172.21.15.53:0/1545955616 shutdown_connections 2023-06-10T19:00:26.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.336+0000 7f2faa5c5000 1 -- 172.21.15.53:0/1545955616 wait complete. 2023-06-10T19:00:26.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.336+0000 7f2faa5c5000 20 client.7149 trim_cache size 0 max 16384 2023-06-10T19:00:26.354 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-06-10T19:00:26.354 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_fsid": "c8c64bed-c406-4936-93f9-d16335f1067d", 2023-06-10T19:00:26.355 INFO:teuthology.orchestra.run.smithi053.stdout: "whoami": 0, 2023-06-10T19:00:26.355 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 7002, 2023-06-10T19:00:26.355 INFO:teuthology.orchestra.run.smithi053.stdout: "want_state": "up:active", 2023-06-10T19:00:26.355 INFO:teuthology.orchestra.run.smithi053.stdout: "state": "up:active", 2023-06-10T19:00:26.355 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs", 2023-06-10T19:00:26.355 INFO:teuthology.orchestra.run.smithi053.stdout: "rank_uptime": 5.7307894560000001, 2023-06-10T19:00:26.355 INFO:teuthology.orchestra.run.smithi053.stdout: "mdsmap_epoch": 33, 2023-06-10T19:00:26.356 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch": 80, 2023-06-10T19:00:26.356 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch_barrier": 80, 2023-06-10T19:00:26.356 INFO:teuthology.orchestra.run.smithi053.stdout: "uptime": 10.164214134 2023-06-10T19:00:26.356 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-06-10T19:00:26.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.340+0000 7f2fa74a9640 1 -- 172.21.15.53:0/3771277979 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2f84066280 msgr2=0x7f2f84068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:26.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.340+0000 7f2fa74a9640 1 --2- 172.21.15.53:0/3771277979 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2f84066280 0x7f2f84068730 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f2f900ae000 tx=0x7f2f900a7000 comp rx=0 tx=0).stop 2023-06-10T19:00:26.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.340+0000 7f2fa74a9640 1 -- 172.21.15.53:0/3771277979 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2fa00afd10 msgr2=0x7f2fa01f3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:26.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.340+0000 7f2fa74a9640 1 --2- 172.21.15.53:0/3771277979 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2fa00afd10 0x7f2fa01f3b20 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c00d800 tx=0x7f2f9c00dcc0 comp rx=0 tx=0).stop 2023-06-10T19:00:26.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.340+0000 7f2fa74a9640 1 -- 172.21.15.53:0/3771277979 shutdown_connections 2023-06-10T19:00:26.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.340+0000 7f2fa74a9640 1 --2- 172.21.15.53:0/3771277979 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2f84066280 0x7f2f84068730 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:26.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.340+0000 7f2fa74a9640 1 --2- 172.21.15.53:0/3771277979 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2fa0157470 0x7f2fa015bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:26.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.340+0000 7f2fa74a9640 1 --2- 172.21.15.53:0/3771277979 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2fa01570a0 0x7f2fa00c5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:26.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.340+0000 7f2fa74a9640 1 --2- 172.21.15.53:0/3771277979 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2fa00afd10 0x7f2fa01f3b20 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:26.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.340+0000 7f2fa74a9640 1 -- 172.21.15.53:0/3771277979 >> 172.21.15.53:0/3771277979 conn(0x7f2fa00ce9e0 msgr2=0x7f2fa01584b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:26.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.340+0000 7f2fa74a9640 1 -- 172.21.15.53:0/3771277979 shutdown_connections 2023-06-10T19:00:26.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.340+0000 7f2fa74a9640 1 -- 172.21.15.53:0/3771277979 wait complete. 2023-06-10T19:00:26.360 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-10T19:00:26.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.468+0000 7f272535e640 1 Processor -- start 2023-06-10T19:00:26.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.468+0000 7f272535e640 1 -- start start 2023-06-10T19:00:26.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.472+0000 7f272535e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f27200c9840 0x7f27200c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:26.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.472+0000 7f272535e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2720071060 0x7f27200af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:26.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.472+0000 7f272535e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27200afc60 0x7f272015d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:26.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.472+0000 7f272535e640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2720159b50 con 0x7f27200c9840 2023-06-10T19:00:26.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.472+0000 7f272535e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27200ca150 con 0x7f2720071060 2023-06-10T19:00:26.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.472+0000 7f272535e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27200702a0 con 0x7f27200afc60 2023-06-10T19:00:26.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.472+0000 7f271effd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f27200c9840 0x7f27200c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:26.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.472+0000 7f271effd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f27200c9840 0x7f27200c9c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33380/0 (socket says 172.21.15.53:33380) 2023-06-10T19:00:26.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.472+0000 7f271effd640 1 -- 172.21.15.53:0/3635033577 learned_addr learned my addr 172.21.15.53:0/3635033577 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:26.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.472+0000 7f271f7fe640 1 --2- 172.21.15.53:0/3635033577 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27200afc60 0x7f272015d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:26.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.472+0000 7f271effd640 1 -- 172.21.15.53:0/3635033577 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27200afc60 msgr2=0x7f272015d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:26.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.472+0000 7f27167fc640 1 --2- 172.21.15.53:0/3635033577 >> v2:172.21.15.117:3300/0 conn(0x7f2720071060 0x7f27200af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:26.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.472+0000 7f271effd640 1 --2- 172.21.15.53:0/3635033577 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27200afc60 0x7f272015d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:26.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.472+0000 7f271effd640 1 -- 172.21.15.53:0/3635033577 >> v2:172.21.15.117:3300/0 conn(0x7f2720071060 msgr2=0x7f27200af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:26.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.472+0000 7f271effd640 1 --2- 172.21.15.53:0/3635033577 >> v2:172.21.15.117:3300/0 conn(0x7f2720071060 0x7f27200af720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:26.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.472+0000 7f271effd640 1 -- 172.21.15.53:0/3635033577 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2720070580 con 0x7f27200c9840 2023-06-10T19:00:26.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.472+0000 7f271effd640 1 --2- 172.21.15.53:0/3635033577 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27200c9840 0x7f27200c9c10 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f272006e650 tx=0x7f271001c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87b12115dd23e771 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:26.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.472+0000 7f271e7fc640 1 -- 172.21.15.53:0/3635033577 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27100ab600 con 0x7f27200c9840 2023-06-10T19:00:26.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.472+0000 7f271e7fc640 1 -- 172.21.15.53:0/3635033577 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27100a7050 con 0x7f27200c9840 2023-06-10T19:00:26.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.472+0000 7f271e7fc640 1 -- 172.21.15.53:0/3635033577 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27100ab980 con 0x7f27200c9840 2023-06-10T19:00:26.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.476+0000 7f272535e640 1 -- 172.21.15.53:0/3635033577 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27200c9840 msgr2=0x7f27200c9c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:26.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.476+0000 7f272535e640 1 --2- 172.21.15.53:0/3635033577 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27200c9840 0x7f27200c9c10 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f272006e650 tx=0x7f271001c210 comp rx=0 tx=0).stop 2023-06-10T19:00:26.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.476+0000 7f272535e640 1 -- 172.21.15.53:0/3635033577 shutdown_connections 2023-06-10T19:00:26.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.476+0000 7f272535e640 1 --2- 172.21.15.53:0/3635033577 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27200afc60 0x7f272015d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:26.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.476+0000 7f272535e640 1 --2- 172.21.15.53:0/3635033577 >> v2:172.21.15.117:3300/0 conn(0x7f2720071060 0x7f27200af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:26.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.476+0000 7f272535e640 1 --2- 172.21.15.53:0/3635033577 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27200c9840 0x7f27200c9c10 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:26.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.476+0000 7f272535e640 1 -- 172.21.15.53:0/3635033577 >> 172.21.15.53:0/3635033577 conn(0x7f272006a0d0 msgr2=0x7f27200ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:26.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.476+0000 7f272535e640 1 -- 172.21.15.53:0/3635033577 shutdown_connections 2023-06-10T19:00:26.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.476+0000 7f272535e640 1 -- 172.21.15.53:0/3635033577 wait complete. 2023-06-10T19:00:26.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.476+0000 7f272535e640 1 Processor -- start 2023-06-10T19:00:26.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.476+0000 7f272535e640 1 -- start start 2023-06-10T19:00:26.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.476+0000 7f272535e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2720071060 0x7f2720151480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:26.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.476+0000 7f272535e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27200afc60 0x7f2720156340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:26.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.476+0000 7f272535e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27200c9840 0x7f2720156880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:26.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.476+0000 7f272535e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27200b30b0 con 0x7f2720071060 2023-06-10T19:00:26.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.476+0000 7f272535e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27200b2530 con 0x7f27200c9840 2023-06-10T19:00:26.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.476+0000 7f272535e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27200b2810 con 0x7f27200afc60 2023-06-10T19:00:26.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.476+0000 7f271effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2720071060 0x7f2720151480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:26.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.476+0000 7f271effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2720071060 0x7f2720151480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33394/0 (socket says 172.21.15.53:33394) 2023-06-10T19:00:26.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.476+0000 7f271effd640 1 -- 172.21.15.53:0/1347843384 learned_addr learned my addr 172.21.15.53:0/1347843384 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:26.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.476+0000 7f27167fc640 1 --2- 172.21.15.53:0/1347843384 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27200afc60 0x7f2720156340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:26.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.476+0000 7f271f7fe640 1 --2- 172.21.15.53:0/1347843384 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27200c9840 0x7f2720156880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:26.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.476+0000 7f271effd640 1 -- 172.21.15.53:0/1347843384 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27200afc60 msgr2=0x7f2720156340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:26.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.476+0000 7f271effd640 1 --2- 172.21.15.53:0/1347843384 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27200afc60 0x7f2720156340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:26.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.476+0000 7f271effd640 1 -- 172.21.15.53:0/1347843384 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27200c9840 msgr2=0x7f2720156880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:26.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.476+0000 7f271effd640 1 --2- 172.21.15.53:0/1347843384 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27200c9840 0x7f2720156880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:26.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.476+0000 7f271effd640 1 -- 172.21.15.53:0/1347843384 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27100094d0 con 0x7f2720071060 2023-06-10T19:00:26.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.476+0000 7f271effd640 1 --2- 172.21.15.53:0/1347843384 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2720071060 0x7f2720151480 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f27100ae040 tx=0x7f2710018fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:26.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.476+0000 7f2717fff640 1 -- 172.21.15.53:0/1347843384 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27100b4640 con 0x7f2720071060 2023-06-10T19:00:26.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.480+0000 7f2717fff640 1 -- 172.21.15.53:0/1347843384 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27100b47c0 con 0x7f2720071060 2023-06-10T19:00:26.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.480+0000 7f272535e640 1 -- 172.21.15.53:0/1347843384 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27200b2af0 con 0x7f2720071060 2023-06-10T19:00:26.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.480+0000 7f2717fff640 1 -- 172.21.15.53:0/1347843384 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27100b4b70 con 0x7f2720071060 2023-06-10T19:00:26.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.480+0000 7f272535e640 1 -- 172.21.15.53:0/1347843384 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27200b17d0 con 0x7f2720071060 2023-06-10T19:00:26.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.480+0000 7f272535e640 1 -- 172.21.15.53:0/1347843384 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27200c4e00 con 0x7f2720071060 2023-06-10T19:00:26.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.480+0000 7f2717fff640 1 -- 172.21.15.53:0/1347843384 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f27100b2070 con 0x7f2720071060 2023-06-10T19:00:26.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.480+0000 7f2717fff640 1 --2- 172.21.15.53:0/1347843384 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2700066280 0x7f2700068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:26.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.480+0000 7f2717fff640 1 -- 172.21.15.53:0/1347843384 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f271011dbd0 con 0x7f2720071060 2023-06-10T19:00:26.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.480+0000 7f27167fc640 1 --2- 172.21.15.53:0/1347843384 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2700066280 0x7f2700068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:26.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.480+0000 7f27167fc640 1 --2- 172.21.15.53:0/1347843384 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2700066280 0x7f2700068730 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f272015d540 tx=0x7f2708008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:26.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.484+0000 7f2717fff640 1 -- 172.21.15.53:0/1347843384 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f27200c4e00 con 0x7f2720071060 2023-06-10T19:00:26.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.672+0000 7f272535e640 1 -- 172.21.15.53:0/1347843384 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f27200c4e00 con 0x7f2720071060 2023-06-10T19:00:26.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.672+0000 7f2717fff640 1 -- 172.21.15.53:0/1347843384 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v33) v1 ==== 53+0+73 (secure 0 0 0) 0x7f27200c4e00 con 0x7f2720071060 2023-06-10T19:00:26.678 INFO:teuthology.orchestra.run.smithi053.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-06-10T19:00:26.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.676+0000 7f272535e640 1 -- 172.21.15.53:0/1347843384 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2700066280 msgr2=0x7f2700068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:26.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.676+0000 7f272535e640 1 --2- 172.21.15.53:0/1347843384 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2700066280 0x7f2700068730 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f272015d540 tx=0x7f2708008040 comp rx=0 tx=0).stop 2023-06-10T19:00:26.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.676+0000 7f272535e640 1 -- 172.21.15.53:0/1347843384 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2720071060 msgr2=0x7f2720151480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:26.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.676+0000 7f272535e640 1 --2- 172.21.15.53:0/1347843384 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2720071060 0x7f2720151480 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f27100ae040 tx=0x7f2710018fb0 comp rx=0 tx=0).stop 2023-06-10T19:00:26.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.676+0000 7f272535e640 1 -- 172.21.15.53:0/1347843384 shutdown_connections 2023-06-10T19:00:26.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.676+0000 7f272535e640 1 --2- 172.21.15.53:0/1347843384 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2700066280 0x7f2700068730 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:26.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.676+0000 7f272535e640 1 --2- 172.21.15.53:0/1347843384 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27200c9840 0x7f2720156880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:26.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.676+0000 7f272535e640 1 --2- 172.21.15.53:0/1347843384 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27200afc60 0x7f2720156340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:26.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.676+0000 7f272535e640 1 --2- 172.21.15.53:0/1347843384 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2720071060 0x7f2720151480 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:26.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.676+0000 7f272535e640 1 -- 172.21.15.53:0/1347843384 >> 172.21.15.53:0/1347843384 conn(0x7f272006a0d0 msgr2=0x7f2720159c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:26.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.676+0000 7f272535e640 1 -- 172.21.15.53:0/1347843384 shutdown_connections 2023-06-10T19:00:26.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:26.676+0000 7f272535e640 1 -- 172.21.15.53:0/1347843384 wait complete. 2023-06-10T19:00:26.696 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-10T19:00:26.696 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-10T19:00:26.697 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi053.front.sepia.ceph.com 2023-06-10T19:00:26.697 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-06-10T19:00:26.697 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-06-10T19:00:26.697 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-10T19:00:26.698 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-10T19:00:26.698 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-10T19:00:26.698 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-06-10T19:00:26.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:00:26.699 DEBUG:teuthology.orchestra.run.smithi053:> ip addr 2023-06-10T19:00:26.705 INFO:teuthology.orchestra.run.smithi053.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-10T19:00:26.705 INFO:teuthology.orchestra.run.smithi053.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-10T19:00:26.705 INFO:teuthology.orchestra.run.smithi053.stdout: inet 127.0.0.1/8 scope host lo 2023-06-10T19:00:26.705 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:00:26.705 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 ::1/128 scope host 2023-06-10T19:00:26.705 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:00:26.706 INFO:teuthology.orchestra.run.smithi053.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T19:00:26.706 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:da brd ff:ff:ff:ff:ff:ff 2023-06-10T19:00:26.706 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f0 2023-06-10T19:00:26.706 INFO:teuthology.orchestra.run.smithi053.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T19:00:26.706 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:db brd ff:ff:ff:ff:ff:ff 2023-06-10T19:00:26.706 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f1 2023-06-10T19:00:26.706 INFO:teuthology.orchestra.run.smithi053.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-10T19:00:26.706 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:18 brd ff:ff:ff:ff:ff:ff 2023-06-10T19:00:26.707 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f0 2023-06-10T19:00:26.707 INFO:teuthology.orchestra.run.smithi053.stdout: inet 172.21.15.53/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-06-10T19:00:26.707 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft 42023sec preferred_lft 42023sec 2023-06-10T19:00:26.707 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::ae1f:6bff:fef8:3718/64 scope link 2023-06-10T19:00:26.707 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:00:26.707 INFO:teuthology.orchestra.run.smithi053.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T19:00:26.707 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:19 brd ff:ff:ff:ff:ff:ff 2023-06-10T19:00:26.708 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f1 2023-06-10T19:00:26.708 INFO:teuthology.orchestra.run.smithi053.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-06-10T19:00:26.708 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 02:42:49:3d:ee:1e brd ff:ff:ff:ff:ff:ff 2023-06-10T19:00:26.708 INFO:teuthology.orchestra.run.smithi053.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-06-10T19:00:26.708 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:00:26.708 INFO:teuthology.orchestra.run.smithi053.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-10T19:00:26.708 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-06-10T19:00:26.708 INFO:teuthology.orchestra.run.smithi053.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-06-10T19:00:26.709 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:00:26.709 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-06-10T19:00:26.709 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:00:26.709 INFO:teuthology.orchestra.run.smithi053.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state DOWN group default qlen 1000 2023-06-10T19:00:26.709 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-06-10T19:00:26.709 INFO:teuthology.orchestra.run.smithi053.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-10T19:00:26.709 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-06-10T19:00:26.709 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-06-10T19:00:26.710 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:00:26.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:00:26.710 DEBUG:teuthology.orchestra.run.smithi053:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-10T19:00:26.757 INFO:teuthology.orchestra.run.smithi053.stdout:1 2023-06-10T19:00:26.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:00:26.759 DEBUG:teuthology.orchestra.run.smithi053:> route 2023-06-10T19:00:26.804 INFO:teuthology.orchestra.run.smithi053.stdout:Kernel IP routing table 2023-06-10T19:00:26.805 INFO:teuthology.orchestra.run.smithi053.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-10T19:00:26.805 INFO:teuthology.orchestra.run.smithi053.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-06-10T19:00:26.805 INFO:teuthology.orchestra.run.smithi053.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-06-10T19:00:26.805 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-06-10T19:00:26.805 INFO:teuthology.orchestra.run.smithi053.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-10T19:00:26.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:00:26.806 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec bash -c ' 2023-06-10T19:00:26.806 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2023-06-10T19:00:26.806 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-06-10T19:00:26.807 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-06-10T19:00:26.807 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-06-10T19:00:26.807 DEBUG:teuthology.orchestra.run.smithi053:> ') 2023-06-10T19:00:26.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:00:26.883 DEBUG:teuthology.orchestra.run.smithi053:> ip netns list 2023-06-10T19:00:26.932 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-06-10T19:00:26.933 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-06-10T19:00:26.933 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-06-10T19:00:26.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:00:26.934 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link set brx.0 up 2023-06-10T19:00:26.989 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-06-10T19:00:26.989 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-10T19:00:26.989 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-06-10T19:00:27.040 INFO:teuthology.orchestra.run.smithi053.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-06-10T19:00:27.041 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-10T19:00:27.041 DEBUG:teuthology.orchestra.run.smithi053:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-06-10T19:00:27.088 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2023-06-10T19:00:27.146 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T19:00:27.146 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T19:00:27.199 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T19:00:27.200 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T19:00:27.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:00:27.201 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2023-06-10T19:00:27.248 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-06-10T19:00:27.249 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-06-10T19:00:27.293 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2023-06-10T19:00:27.309 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T19:00:27.309 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T19:00:27.361 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T19:00:27.362 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T19:00:27.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:00:27.363 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2023-06-10T19:00:27.380 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:2023-06-10T19:00:27.376+0000 7fd6e65d5580 -1 init, newargv = 0x55f6ccc3d010 newargc=15 2023-06-10T19:00:27.380 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[54306]: starting ceph client 2023-06-10T19:00:27.386 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[54306]: starting fuse 2023-06-10T19:00:28.485 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2023-06-10T19:00:28.502 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T19:00:28.503 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T19:00:28.556 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T19:00:28.557 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T19:00:28.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:00:28.559 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2023-06-10T19:00:28.609 INFO:teuthology.orchestra.run.smithi053.stdout:45 2023-06-10T19:00:28.609 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-06-10T19:00:28.609 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-06-10T19:00:28.610 DEBUG:teuthology.orchestra.run.smithi053:> import glob 2023-06-10T19:00:28.610 DEBUG:teuthology.orchestra.run.smithi053:> import re 2023-06-10T19:00:28.610 DEBUG:teuthology.orchestra.run.smithi053:> import os 2023-06-10T19:00:28.611 DEBUG:teuthology.orchestra.run.smithi053:> import subprocess 2023-06-10T19:00:28.611 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:00:28.611 DEBUG:teuthology.orchestra.run.smithi053:> def _find_admin_socket(client_name): 2023-06-10T19:00:28.611 DEBUG:teuthology.orchestra.run.smithi053:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-06-10T19:00:28.612 DEBUG:teuthology.orchestra.run.smithi053:> files = glob.glob(asok_path) 2023-06-10T19:00:28.612 DEBUG:teuthology.orchestra.run.smithi053:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-06-10T19:00:28.612 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:00:28.613 DEBUG:teuthology.orchestra.run.smithi053:> # Given a non-glob path, it better be there 2023-06-10T19:00:28.613 DEBUG:teuthology.orchestra.run.smithi053:> if "*" not in asok_path: 2023-06-10T19:00:28.613 DEBUG:teuthology.orchestra.run.smithi053:> assert(len(files) == 1) 2023-06-10T19:00:28.614 DEBUG:teuthology.orchestra.run.smithi053:> return files[0] 2023-06-10T19:00:28.614 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:00:28.614 DEBUG:teuthology.orchestra.run.smithi053:> for f in files: 2023-06-10T19:00:28.614 DEBUG:teuthology.orchestra.run.smithi053:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-06-10T19:00:28.615 DEBUG:teuthology.orchestra.run.smithi053:> if os.path.exists("/proc/{0}".format(pid)): 2023-06-10T19:00:28.615 DEBUG:teuthology.orchestra.run.smithi053:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-06-10T19:00:28.615 DEBUG:teuthology.orchestra.run.smithi053:> contents = proc_f.read() 2023-06-10T19:00:28.616 DEBUG:teuthology.orchestra.run.smithi053:> if mountpoint in contents: 2023-06-10T19:00:28.616 DEBUG:teuthology.orchestra.run.smithi053:> return f 2023-06-10T19:00:28.616 DEBUG:teuthology.orchestra.run.smithi053:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-06-10T19:00:28.617 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:00:28.617 DEBUG:teuthology.orchestra.run.smithi053:> print(_find_admin_socket("client.0")) 2023-06-10T19:00:28.617 DEBUG:teuthology.orchestra.run.smithi053:> ' 2023-06-10T19:00:28.733 INFO:teuthology.orchestra.run.smithi053.stdout:/var/run/ceph/ceph-client.0.54306.asok 2023-06-10T19:00:28.915 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.54306.asok 2023-06-10T19:00:28.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:00:28.916 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.54306.asok status 2023-06-10T19:00:29.082 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-06-10T19:00:29.082 INFO:teuthology.orchestra.run.smithi053.stdout: "metadata": { 2023-06-10T19:00:29.082 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_sha1": "219d315c3a0b2075e570fb1964be2ad33fe7a9c8", 2023-06-10T19:00:29.082 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_version": "ceph version 18.0.0-4359-g219d315c (219d315c3a0b2075e570fb1964be2ad33fe7a9c8) reef (dev)", 2023-06-10T19:00:29.083 INFO:teuthology.orchestra.run.smithi053.stdout: "entity_id": "0", 2023-06-10T19:00:29.083 INFO:teuthology.orchestra.run.smithi053.stdout: "hostname": "smithi053", 2023-06-10T19:00:29.084 INFO:teuthology.orchestra.run.smithi053.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-06-10T19:00:29.084 INFO:teuthology.orchestra.run.smithi053.stdout: "pid": "54306", 2023-06-10T19:00:29.084 INFO:teuthology.orchestra.run.smithi053.stdout: "root": "/" 2023-06-10T19:00:29.084 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:00:29.085 INFO:teuthology.orchestra.run.smithi053.stdout: "dentry_count": 0, 2023-06-10T19:00:29.085 INFO:teuthology.orchestra.run.smithi053.stdout: "dentry_pinned_count": 0, 2023-06-10T19:00:29.085 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 7158, 2023-06-10T19:00:29.085 INFO:teuthology.orchestra.run.smithi053.stdout: "inst": { 2023-06-10T19:00:29.086 INFO:teuthology.orchestra.run.smithi053.stdout: "name": { 2023-06-10T19:00:29.086 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "client", 2023-06-10T19:00:29.086 INFO:teuthology.orchestra.run.smithi053.stdout: "num": 7158 2023-06-10T19:00:29.086 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:00:29.086 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": { 2023-06-10T19:00:29.086 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2023-06-10T19:00:29.086 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "192.168.0.1:0", 2023-06-10T19:00:29.087 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 716140912 2023-06-10T19:00:29.087 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:00:29.087 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:00:29.087 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": { 2023-06-10T19:00:29.087 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2023-06-10T19:00:29.087 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "192.168.0.1:0", 2023-06-10T19:00:29.088 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 716140912 2023-06-10T19:00:29.088 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:00:29.089 INFO:teuthology.orchestra.run.smithi053.stdout: "inst_str": "client.7158 192.168.0.1:0/716140912", 2023-06-10T19:00:29.089 INFO:teuthology.orchestra.run.smithi053.stdout: "addr_str": "192.168.0.1:0/716140912", 2023-06-10T19:00:29.089 INFO:teuthology.orchestra.run.smithi053.stdout: "inode_count": 1, 2023-06-10T19:00:29.089 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_epoch": 33, 2023-06-10T19:00:29.089 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_epoch": 80, 2023-06-10T19:00:29.089 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_epoch_barrier": 0, 2023-06-10T19:00:29.089 INFO:teuthology.orchestra.run.smithi053.stdout: "blocklisted": false, 2023-06-10T19:00:29.090 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs" 2023-06-10T19:00:29.090 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-06-10T19:00:29.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:00:29.095 DEBUG:teuthology.orchestra.run.smithi053:> stat --file-system '--printf=%T 2023-06-10T19:00:29.096 DEBUG:teuthology.orchestra.run.smithi053:> ' -- /home/ubuntu/cephtest/mnt.0 2023-06-10T19:00:29.101 INFO:teuthology.orchestra.run.smithi053.stdout:fuseblk 2023-06-10T19:00:29.101 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-06-10T19:00:29.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:00:29.102 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-06-10T19:00:29.156 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-10T19:00:29.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:29.320+0000 7fd1294e4640 1 Processor -- start 2023-06-10T19:00:29.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:29.320+0000 7fd1294e4640 1 -- start start 2023-06-10T19:00:29.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:29.324+0000 7fd1294e4640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd1240b3ac0 0x7fd1240b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:29.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:29.324+0000 7fd1294e4640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd1240d14c0 0x7fd12415fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:29.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:29.324+0000 7fd1294e4640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1240d0020 con 0x7fd1240cc690 2023-06-10T19:00:29.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:29.324+0000 7fd1294e4640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1240b43d0 con 0x7fd1240b3ac0 2023-06-10T19:00:29.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:29.324+0000 7fd1294e4640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1240cef40 con 0x7fd1240d14c0 2023-06-10T19:00:29.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:29.324+0000 7fd122ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd1240b3ac0 0x7fd1240b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:29.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:29.324+0000 7fd11a7fc640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fd1240cc690 0x7fd12415f370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:33734/0 (socket says 172.21.15.53:33734) 2023-06-10T19:00:29.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:29.324+0000 7fd11a7fc640 1 -- 172.21.15.53:0/1451536675 learned_addr learned my addr 172.21.15.53:0/1451536675 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:00:29.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:29.324+0000 7fd122ffd640 1 -- 172.21.15.53:0/1451536675 >> v2:172.21.15.117:3300/0 conn(0x7fd1240d14c0 msgr2=0x7fd12415fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:29.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:29.324+0000 7fd1237fe640 1 --2- 172.21.15.53:0/1451536675 >> v2:172.21.15.117:3300/0 conn(0x7fd1240d14c0 0x7fd12415fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:29.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:29.324+0000 7fd1227fc640 1 -- 172.21.15.53:0/1451536675 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2804376375 0 0) 0x7fd1240d0020 con 0x7fd1240cc690 2023-06-10T19:00:29.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:29.324+0000 7fd122ffd640 1 --2- 172.21.15.53:0/1451536675 >> v2:172.21.15.117:3300/0 conn(0x7fd1240d14c0 0x7fd12415fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:29.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:29.324+0000 7fd122ffd640 1 -- 172.21.15.53:0/1451536675 >> v1:172.21.15.53:6789/0 conn(0x7fd1240cc690 legacy=0x7fd12415f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:29.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:29.324+0000 7fd122ffd640 1 -- 172.21.15.53:0/1451536675 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1240cf220 con 0x7fd1240b3ac0 2023-06-10T19:00:29.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:29.324+0000 7fd1237fe640 1 --2- 172.21.15.53:0/1451536675 >> v2:172.21.15.117:3300/0 conn(0x7fd1240d14c0 0x7fd12415fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:00:29.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:29.324+0000 7fd122ffd640 1 --2- 172.21.15.53:0/1451536675 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1240b3ac0 0x7fd1240b3e90 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fd124160410 tx=0x7fd11401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c431610dfaf391c8 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:29.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:29.324+0000 7fd1227fc640 1 -- 172.21.15.53:0/1451536675 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1140ab600 con 0x7fd1240b3ac0 2023-06-10T19:00:29.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:29.324+0000 7fd1227fc640 1 -- 172.21.15.53:0/1451536675 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1140a7050 con 0x7fd1240b3ac0 2023-06-10T19:00:29.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:29.324+0000 7fd1227fc640 1 -- 172.21.15.53:0/1451536675 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1140ab980 con 0x7fd1240b3ac0 2023-06-10T19:00:29.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:29.324+0000 7fd1294e4640 1 -- 172.21.15.53:0/1451536675 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1240b3ac0 msgr2=0x7fd1240b3e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:29.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:29.324+0000 7fd1294e4640 1 --2- 172.21.15.53:0/1451536675 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1240b3ac0 0x7fd1240b3e90 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fd124160410 tx=0x7fd11401c430 comp rx=0 tx=0).stop 2023-06-10T19:00:29.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:29.324+0000 7fd1294e4640 1 -- 172.21.15.53:0/1451536675 shutdown_connections 2023-06-10T19:00:29.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:29.324+0000 7fd1294e4640 1 --2- 172.21.15.53:0/1451536675 >> v2:172.21.15.117:3300/0 conn(0x7fd1240d14c0 0x7fd12415fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:29.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:29.324+0000 7fd1294e4640 1 --2- 172.21.15.53:0/1451536675 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1240b3ac0 0x7fd1240b3e90 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:29.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:29.324+0000 7fd1294e4640 1 -- 172.21.15.53:0/1451536675 >> 172.21.15.53:0/1451536675 conn(0x7fd124071790 msgr2=0x7fd124069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:29.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:29.328+0000 7fd1294e4640 1 -- 172.21.15.53:0/1451536675 shutdown_connections 2023-06-10T19:00:29.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:29.328+0000 7fd1294e4640 1 -- 172.21.15.53:0/1451536675 wait complete. 2023-06-10T19:00:29.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:29.328+0000 7fd1294e4640 1 Processor -- start 2023-06-10T19:00:29.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:29.328+0000 7fd1294e4640 1 -- start start 2023-06-10T19:00:29.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:29.328+0000 7fd1294e4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd1240b3ac0 0x7fd1241563e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:29.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:29.328+0000 7fd1294e4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1240cc690 0x7fd124145230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:29.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:29.328+0000 7fd1294e4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd1240d14c0 0x7fd1240cb560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:29.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:29.328+0000 7fd1294e4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1240c5c40 con 0x7fd1240cc690 2023-06-10T19:00:29.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:29.328+0000 7fd1294e4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd124156920 con 0x7fd1240d14c0 2023-06-10T19:00:29.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:29.328+0000 7fd1294e4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1240c9c20 con 0x7fd1240b3ac0 2023-06-10T19:00:29.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:29.328+0000 7fd11a7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1240cc690 0x7fd124145230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:29.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:29.328+0000 7fd11a7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1240cc690 0x7fd124145230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33402/0 (socket says 172.21.15.53:33402) 2023-06-10T19:00:29.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:29.328+0000 7fd11a7fc640 1 -- 172.21.15.53:0/3178429546 learned_addr learned my addr 172.21.15.53:0/3178429546 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:29.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:29.328+0000 7fd122ffd640 1 --2- 172.21.15.53:0/3178429546 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd1240b3ac0 0x7fd1241563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:29.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:29.328+0000 7fd1237fe640 1 --2- 172.21.15.53:0/3178429546 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd1240d14c0 0x7fd1240cb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:29.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:29.328+0000 7fd11a7fc640 1 -- 172.21.15.53:0/3178429546 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd1240b3ac0 msgr2=0x7fd1241563e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:29.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:29.328+0000 7fd11a7fc640 1 --2- 172.21.15.53:0/3178429546 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd1240b3ac0 0x7fd1241563e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:29.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:29.328+0000 7fd11a7fc640 1 -- 172.21.15.53:0/3178429546 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd1240d14c0 msgr2=0x7fd1240cb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:29.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:29.328+0000 7fd11a7fc640 1 --2- 172.21.15.53:0/3178429546 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd1240d14c0 0x7fd1240cb560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:29.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:29.328+0000 7fd11a7fc640 1 -- 172.21.15.53:0/3178429546 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd114009420 con 0x7fd1240cc690 2023-06-10T19:00:29.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:29.328+0000 7fd11a7fc640 1 --2- 172.21.15.53:0/3178429546 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1240cc690 0x7fd124145230 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fd10c0011f0 tx=0x7fd10c00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:29.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:29.328+0000 7fd11bfff640 1 -- 172.21.15.53:0/3178429546 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd10c0074e0 con 0x7fd1240cc690 2023-06-10T19:00:29.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:29.328+0000 7fd11bfff640 1 -- 172.21.15.53:0/3178429546 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd10c007640 con 0x7fd1240cc690 2023-06-10T19:00:29.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:29.328+0000 7fd11bfff640 1 -- 172.21.15.53:0/3178429546 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd10c004a10 con 0x7fd1240cc690 2023-06-10T19:00:29.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:29.328+0000 7fd1294e4640 1 -- 172.21.15.53:0/3178429546 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1240c9f00 con 0x7fd1240cc690 2023-06-10T19:00:29.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:29.328+0000 7fd1294e4640 1 -- 172.21.15.53:0/3178429546 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1240ca290 con 0x7fd1240cc690 2023-06-10T19:00:29.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:29.332+0000 7fd1294e4640 1 -- 172.21.15.53:0/3178429546 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd12404d790 con 0x7fd1240cc690 2023-06-10T19:00:29.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:29.332+0000 7fd11bfff640 1 -- 172.21.15.53:0/3178429546 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd10c004b70 con 0x7fd1240cc690 2023-06-10T19:00:29.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:29.332+0000 7fd11bfff640 1 --2- 172.21.15.53:0/3178429546 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd1040662b0 0x7fd104068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:29.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:29.332+0000 7fd11bfff640 1 -- 172.21.15.53:0/3178429546 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd10c082f20 con 0x7fd1240cc690 2023-06-10T19:00:29.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:29.332+0000 7fd122ffd640 1 --2- 172.21.15.53:0/3178429546 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd1040662b0 0x7fd104068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:29.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:29.332+0000 7fd122ffd640 1 --2- 172.21.15.53:0/3178429546 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd1040662b0 0x7fd104068760 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fd12408aa80 tx=0x7fd1140a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:29.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:29.336+0000 7fd11bfff640 1 -- 172.21.15.53:0/3178429546 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd10c0503a0 con 0x7fd1240cc690 2023-06-10T19:00:29.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:29.524+0000 7fd1294e4640 1 -- 172.21.15.53:0/3178429546 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd12408a200 con 0x7fd1240cc690 2023-06-10T19:00:29.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:29.524+0000 7fd11bfff640 1 -- 172.21.15.53:0/3178429546 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v33) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd10c018020 con 0x7fd1240cc690 2023-06-10T19:00:29.531 INFO:teuthology.orchestra.run.smithi053.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-06-10T19:00:29.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:29.528+0000 7fd1294e4640 1 -- 172.21.15.53:0/3178429546 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd1040662b0 msgr2=0x7fd104068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:29.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:29.528+0000 7fd1294e4640 1 --2- 172.21.15.53:0/3178429546 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd1040662b0 0x7fd104068760 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fd12408aa80 tx=0x7fd1140a6000 comp rx=0 tx=0).stop 2023-06-10T19:00:29.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:29.528+0000 7fd1294e4640 1 -- 172.21.15.53:0/3178429546 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1240cc690 msgr2=0x7fd124145230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:29.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:29.528+0000 7fd1294e4640 1 --2- 172.21.15.53:0/3178429546 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1240cc690 0x7fd124145230 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fd10c0011f0 tx=0x7fd10c00c9b0 comp rx=0 tx=0).stop 2023-06-10T19:00:29.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:29.528+0000 7fd1294e4640 1 -- 172.21.15.53:0/3178429546 shutdown_connections 2023-06-10T19:00:29.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:29.528+0000 7fd1294e4640 1 --2- 172.21.15.53:0/3178429546 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd1040662b0 0x7fd104068760 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:29.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:29.528+0000 7fd1294e4640 1 --2- 172.21.15.53:0/3178429546 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd1240d14c0 0x7fd1240cb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:29.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:29.528+0000 7fd1294e4640 1 --2- 172.21.15.53:0/3178429546 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1240cc690 0x7fd124145230 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:29.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:29.528+0000 7fd1294e4640 1 --2- 172.21.15.53:0/3178429546 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd1240b3ac0 0x7fd1241563e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:29.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:29.528+0000 7fd1294e4640 1 -- 172.21.15.53:0/3178429546 >> 172.21.15.53:0/3178429546 conn(0x7fd124071790 msgr2=0x7fd1240b5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:29.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:29.528+0000 7fd1294e4640 1 -- 172.21.15.53:0/3178429546 shutdown_connections 2023-06-10T19:00:29.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:29.528+0000 7fd1294e4640 1 -- 172.21.15.53:0/3178429546 wait complete. 2023-06-10T19:00:29.550 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-10T19:00:29.551 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-10T19:00:29.551 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi117.front.sepia.ceph.com 2023-06-10T19:00:29.551 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-06-10T19:00:29.552 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-06-10T19:00:29.552 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-10T19:00:29.552 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-10T19:00:29.553 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-10T19:00:29.553 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-06-10T19:00:29.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:00:29.554 DEBUG:teuthology.orchestra.run.smithi117:> ip addr 2023-06-10T19:00:29.562 INFO:teuthology.orchestra.run.smithi117.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-10T19:00:29.562 INFO:teuthology.orchestra.run.smithi117.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-10T19:00:29.562 INFO:teuthology.orchestra.run.smithi117.stdout: inet 127.0.0.1/8 scope host lo 2023-06-10T19:00:29.563 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:00:29.563 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 ::1/128 scope host 2023-06-10T19:00:29.563 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:00:29.563 INFO:teuthology.orchestra.run.smithi117.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T19:00:29.563 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8a brd ff:ff:ff:ff:ff:ff 2023-06-10T19:00:29.564 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f0 2023-06-10T19:00:29.564 INFO:teuthology.orchestra.run.smithi117.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T19:00:29.564 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8b brd ff:ff:ff:ff:ff:ff 2023-06-10T19:00:29.565 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f1 2023-06-10T19:00:29.565 INFO:teuthology.orchestra.run.smithi117.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T19:00:29.565 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:62 brd ff:ff:ff:ff:ff:ff 2023-06-10T19:00:29.565 INFO:teuthology.orchestra.run.smithi117.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-10T19:00:29.566 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:63 brd ff:ff:ff:ff:ff:ff 2023-06-10T19:00:29.566 INFO:teuthology.orchestra.run.smithi117.stdout: inet 172.21.15.117/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-06-10T19:00:29.566 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft 42020sec preferred_lft 42020sec 2023-06-10T19:00:29.566 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::ec4:7aff:fe8f:4463/64 scope link 2023-06-10T19:00:29.566 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:00:29.566 INFO:teuthology.orchestra.run.smithi117.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-06-10T19:00:29.566 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 02:42:f8:40:b2:dc brd ff:ff:ff:ff:ff:ff 2023-06-10T19:00:29.567 INFO:teuthology.orchestra.run.smithi117.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-06-10T19:00:29.567 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:00:29.567 INFO:teuthology.orchestra.run.smithi117.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-10T19:00:29.567 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-06-10T19:00:29.567 INFO:teuthology.orchestra.run.smithi117.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-06-10T19:00:29.567 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:00:29.567 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-06-10T19:00:29.567 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:00:29.568 INFO:teuthology.orchestra.run.smithi117.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-10T19:00:29.568 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-06-10T19:00:29.568 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-06-10T19:00:29.568 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:00:29.568 INFO:teuthology.orchestra.run.smithi117.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-10T19:00:29.568 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-06-10T19:00:29.568 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-06-10T19:00:29.569 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:00:29.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:00:29.569 DEBUG:teuthology.orchestra.run.smithi117:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-10T19:00:29.618 INFO:teuthology.orchestra.run.smithi117.stdout:1 2023-06-10T19:00:29.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:00:29.620 DEBUG:teuthology.orchestra.run.smithi117:> route 2023-06-10T19:00:29.672 INFO:teuthology.orchestra.run.smithi117.stdout:Kernel IP routing table 2023-06-10T19:00:29.672 INFO:teuthology.orchestra.run.smithi117.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-10T19:00:29.672 INFO:teuthology.orchestra.run.smithi117.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-06-10T19:00:29.672 INFO:teuthology.orchestra.run.smithi117.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-06-10T19:00:29.672 INFO:teuthology.orchestra.run.smithi117.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-06-10T19:00:29.673 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-06-10T19:00:29.673 INFO:teuthology.orchestra.run.smithi117.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-10T19:00:29.673 INFO:teuthology.orchestra.run.smithi117.stdout:ns2.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-10T19:00:29.673 INFO:teuthology.orchestra.run.smithi117.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-10T19:00:29.673 INFO:teuthology.orchestra.run.smithi117.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-10T19:00:29.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:00:29.674 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec bash -c ' 2023-06-10T19:00:29.674 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2023-06-10T19:00:29.674 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-06-10T19:00:29.675 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-06-10T19:00:29.675 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-06-10T19:00:29.675 DEBUG:teuthology.orchestra.run.smithi117:> ') 2023-06-10T19:00:29.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:00:29.747 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list 2023-06-10T19:00:29.793 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-06-10T19:00:29.794 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-06-10T19:00:29.794 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-06-10T19:00:29.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:00:29.795 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link set brx.0 up 2023-06-10T19:00:29.849 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-06-10T19:00:29.849 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-10T19:00:29.849 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-06-10T19:00:29.898 INFO:teuthology.orchestra.run.smithi117.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-06-10T19:00:29.898 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-10T19:00:29.899 DEBUG:teuthology.orchestra.run.smithi117:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-06-10T19:00:29.945 DEBUG:teuthology.orchestra.run.smithi117:> sudo modprobe fuse 2023-06-10T19:00:30.002 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T19:00:30.003 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T19:00:30.061 INFO:teuthology.orchestra.run.smithi117.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T19:00:30.062 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T19:00:30.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:00:30.063 DEBUG:teuthology.orchestra.run.smithi117:> ls /sys/fs/fuse/connections 2023-06-10T19:00:30.109 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-06-10T19:00:30.110 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-06-10T19:00:30.154 DEBUG:teuthology.orchestra.run.smithi117:> sudo modprobe fuse 2023-06-10T19:00:30.170 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T19:00:30.171 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T19:00:30.224 INFO:teuthology.orchestra.run.smithi117.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T19:00:30.225 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T19:00:30.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:00:30.226 DEBUG:teuthology.orchestra.run.smithi117:> ls /sys/fs/fuse/connections 2023-06-10T19:00:30.236 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi117.stderr:2023-06-10T19:00:30.230+0000 7f70fec61580 -1 init, newargv = 0x5638d6178fe0 newargc=15 2023-06-10T19:00:30.236 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi117.stderr:ceph-fuse[44622]: starting ceph client 2023-06-10T19:00:30.243 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi117.stderr:ceph-fuse[44622]: starting fuse 2023-06-10T19:00:31.341 DEBUG:teuthology.orchestra.run.smithi117:> sudo modprobe fuse 2023-06-10T19:00:31.358 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T19:00:31.359 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T19:00:31.413 INFO:teuthology.orchestra.run.smithi117.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T19:00:31.414 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T19:00:31.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:00:31.415 DEBUG:teuthology.orchestra.run.smithi117:> ls /sys/fs/fuse/connections 2023-06-10T19:00:31.461 INFO:teuthology.orchestra.run.smithi117.stdout:45 2023-06-10T19:00:31.461 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-06-10T19:00:31.462 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-06-10T19:00:31.462 DEBUG:teuthology.orchestra.run.smithi117:> import glob 2023-06-10T19:00:31.463 DEBUG:teuthology.orchestra.run.smithi117:> import re 2023-06-10T19:00:31.463 DEBUG:teuthology.orchestra.run.smithi117:> import os 2023-06-10T19:00:31.463 DEBUG:teuthology.orchestra.run.smithi117:> import subprocess 2023-06-10T19:00:31.463 DEBUG:teuthology.orchestra.run.smithi117:> 2023-06-10T19:00:31.464 DEBUG:teuthology.orchestra.run.smithi117:> def _find_admin_socket(client_name): 2023-06-10T19:00:31.464 DEBUG:teuthology.orchestra.run.smithi117:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-06-10T19:00:31.464 DEBUG:teuthology.orchestra.run.smithi117:> files = glob.glob(asok_path) 2023-06-10T19:00:31.465 DEBUG:teuthology.orchestra.run.smithi117:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-06-10T19:00:31.465 DEBUG:teuthology.orchestra.run.smithi117:> 2023-06-10T19:00:31.465 DEBUG:teuthology.orchestra.run.smithi117:> # Given a non-glob path, it better be there 2023-06-10T19:00:31.466 DEBUG:teuthology.orchestra.run.smithi117:> if "*" not in asok_path: 2023-06-10T19:00:31.466 DEBUG:teuthology.orchestra.run.smithi117:> assert(len(files) == 1) 2023-06-10T19:00:31.466 DEBUG:teuthology.orchestra.run.smithi117:> return files[0] 2023-06-10T19:00:31.466 DEBUG:teuthology.orchestra.run.smithi117:> 2023-06-10T19:00:31.467 DEBUG:teuthology.orchestra.run.smithi117:> for f in files: 2023-06-10T19:00:31.467 DEBUG:teuthology.orchestra.run.smithi117:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-06-10T19:00:31.467 DEBUG:teuthology.orchestra.run.smithi117:> if os.path.exists("/proc/{0}".format(pid)): 2023-06-10T19:00:31.468 DEBUG:teuthology.orchestra.run.smithi117:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-06-10T19:00:31.468 DEBUG:teuthology.orchestra.run.smithi117:> contents = proc_f.read() 2023-06-10T19:00:31.468 DEBUG:teuthology.orchestra.run.smithi117:> if mountpoint in contents: 2023-06-10T19:00:31.469 DEBUG:teuthology.orchestra.run.smithi117:> return f 2023-06-10T19:00:31.469 DEBUG:teuthology.orchestra.run.smithi117:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-06-10T19:00:31.469 DEBUG:teuthology.orchestra.run.smithi117:> 2023-06-10T19:00:31.470 DEBUG:teuthology.orchestra.run.smithi117:> print(_find_admin_socket("client.1")) 2023-06-10T19:00:31.470 DEBUG:teuthology.orchestra.run.smithi117:> ' 2023-06-10T19:00:31.582 INFO:teuthology.orchestra.run.smithi117.stdout:/var/run/ceph/ceph-client.1.44622.asok 2023-06-10T19:00:31.764 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.44622.asok 2023-06-10T19:00:31.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:00:31.765 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.44622.asok status 2023-06-10T19:00:31.922 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2023-06-10T19:00:31.922 INFO:teuthology.orchestra.run.smithi117.stdout: "metadata": { 2023-06-10T19:00:31.922 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_sha1": "219d315c3a0b2075e570fb1964be2ad33fe7a9c8", 2023-06-10T19:00:31.922 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_version": "ceph version 18.0.0-4359-g219d315c (219d315c3a0b2075e570fb1964be2ad33fe7a9c8) reef (dev)", 2023-06-10T19:00:31.923 INFO:teuthology.orchestra.run.smithi117.stdout: "entity_id": "1", 2023-06-10T19:00:31.923 INFO:teuthology.orchestra.run.smithi117.stdout: "hostname": "smithi117", 2023-06-10T19:00:31.923 INFO:teuthology.orchestra.run.smithi117.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-06-10T19:00:31.923 INFO:teuthology.orchestra.run.smithi117.stdout: "pid": "44622", 2023-06-10T19:00:31.923 INFO:teuthology.orchestra.run.smithi117.stdout: "root": "/" 2023-06-10T19:00:31.923 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-06-10T19:00:31.923 INFO:teuthology.orchestra.run.smithi117.stdout: "dentry_count": 0, 2023-06-10T19:00:31.924 INFO:teuthology.orchestra.run.smithi117.stdout: "dentry_pinned_count": 0, 2023-06-10T19:00:31.924 INFO:teuthology.orchestra.run.smithi117.stdout: "id": 5762, 2023-06-10T19:00:31.924 INFO:teuthology.orchestra.run.smithi117.stdout: "inst": { 2023-06-10T19:00:31.924 INFO:teuthology.orchestra.run.smithi117.stdout: "name": { 2023-06-10T19:00:31.924 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "client", 2023-06-10T19:00:31.924 INFO:teuthology.orchestra.run.smithi117.stdout: "num": 5762 2023-06-10T19:00:31.924 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-06-10T19:00:31.924 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": { 2023-06-10T19:00:31.925 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "v1", 2023-06-10T19:00:31.925 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": "192.168.0.1:0", 2023-06-10T19:00:31.925 INFO:teuthology.orchestra.run.smithi117.stdout: "nonce": 3277489670 2023-06-10T19:00:31.925 INFO:teuthology.orchestra.run.smithi117.stdout: } 2023-06-10T19:00:31.925 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-06-10T19:00:31.925 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": { 2023-06-10T19:00:31.925 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "v1", 2023-06-10T19:00:31.925 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": "192.168.0.1:0", 2023-06-10T19:00:31.926 INFO:teuthology.orchestra.run.smithi117.stdout: "nonce": 3277489670 2023-06-10T19:00:31.926 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-06-10T19:00:31.926 INFO:teuthology.orchestra.run.smithi117.stdout: "inst_str": "client.5762 192.168.0.1:0/3277489670", 2023-06-10T19:00:31.926 INFO:teuthology.orchestra.run.smithi117.stdout: "addr_str": "192.168.0.1:0/3277489670", 2023-06-10T19:00:31.926 INFO:teuthology.orchestra.run.smithi117.stdout: "inode_count": 1, 2023-06-10T19:00:31.926 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_epoch": 33, 2023-06-10T19:00:31.926 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_epoch": 80, 2023-06-10T19:00:31.926 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_epoch_barrier": 0, 2023-06-10T19:00:31.927 INFO:teuthology.orchestra.run.smithi117.stdout: "blocklisted": false, 2023-06-10T19:00:31.927 INFO:teuthology.orchestra.run.smithi117.stdout: "fs_name": "cephfs" 2023-06-10T19:00:31.927 INFO:teuthology.orchestra.run.smithi117.stdout:} 2023-06-10T19:00:31.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:00:31.937 DEBUG:teuthology.orchestra.run.smithi117:> stat --file-system '--printf=%T 2023-06-10T19:00:31.938 DEBUG:teuthology.orchestra.run.smithi117:> ' -- /home/ubuntu/cephtest/mnt.1 2023-06-10T19:00:31.943 INFO:teuthology.orchestra.run.smithi117.stdout:fuseblk 2023-06-10T19:00:31.944 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-06-10T19:00:31.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:00:31.944 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-06-10T19:00:32.001 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config get mds_reconnect_timeout 2023-06-10T19:00:32.147 INFO:teuthology.orchestra.run.smithi053.stdout:{"mds_reconnect_timeout":"45.000000"} 2023-06-10T19:00:32.147 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_reconnect_timeout": "45.000000" } 2023-06-10T19:00:32.148 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config get ms_max_backoff 2023-06-10T19:00:32.289 INFO:teuthology.orchestra.run.smithi053.stdout:{"ms_max_backoff":"15.000000"} 2023-06-10T19:00:32.289 DEBUG:tasks.cephfs.filesystem:_json_asok output { "ms_max_backoff": "15.000000" } 2023-06-10T19:00:32.290 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T19:00:32.290 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:00:32.296 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:00:32.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.416+0000 7f06c8cf9640 1 Processor -- start 2023-06-10T19:00:32.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.416+0000 7f06c8cf9640 1 -- start start 2023-06-10T19:00:32.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.420+0000 7f06c8cf9640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f06c40c9840 0x7f06c40c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:32.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.420+0000 7f06c8cf9640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f06c406b090 0x7f06c406b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:32.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.420+0000 7f06c8cf9640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06c4159b50 con 0x7f06c4071060 2023-06-10T19:00:32.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.420+0000 7f06c8cf9640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06c40ca150 con 0x7f06c40c9840 2023-06-10T19:00:32.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.420+0000 7f06c8cf9640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06c40702a0 con 0x7f06c406b090 2023-06-10T19:00:32.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.420+0000 7f06c259c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f06c40c9840 0x7f06c40c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:32.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.420+0000 7f06c259c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f06c40c9840 0x7f06c40c9c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44382/0 (socket says 172.21.15.53:44382) 2023-06-10T19:00:32.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.420+0000 7f06c259c640 1 -- 172.21.15.53:0/3297195969 learned_addr learned my addr 172.21.15.53:0/3297195969 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:32.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.420+0000 7f06c2d9d640 1 --2- 172.21.15.53:0/3297195969 >> v2:172.21.15.117:3300/0 conn(0x7f06c406b090 0x7f06c406b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:32.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.420+0000 7f06c259c640 1 -- 172.21.15.53:0/3297195969 >> v2:172.21.15.117:3300/0 conn(0x7f06c406b090 msgr2=0x7f06c406b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:32.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.420+0000 7f06c259c640 1 --2- 172.21.15.53:0/3297195969 >> v2:172.21.15.117:3300/0 conn(0x7f06c406b090 0x7f06c406b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:32.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.420+0000 7f06c259c640 1 -- 172.21.15.53:0/3297195969 >> v1:172.21.15.117:6789/0 conn(0x7f06c4071060 legacy=0x7f06c40af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:32.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.420+0000 7f06c259c640 1 -- 172.21.15.53:0/3297195969 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c4070580 con 0x7f06c40c9840 2023-06-10T19:00:32.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.420+0000 7f06c2d9d640 1 --2- 172.21.15.53:0/3297195969 >> v2:172.21.15.117:3300/0 conn(0x7f06c406b090 0x7f06c406b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:00:32.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.420+0000 7f06c259c640 1 --2- 172.21.15.53:0/3297195969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06c40c9840 0x7f06c40c9c10 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f06c415e360 tx=0x7f06b401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11104ab544f0cc1f server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:32.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.420+0000 7f06c159a640 1 -- 172.21.15.53:0/3297195969 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b40aa5f0 con 0x7f06c40c9840 2023-06-10T19:00:32.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.420+0000 7f06c159a640 1 -- 172.21.15.53:0/3297195969 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06b40aa750 con 0x7f06c40c9840 2023-06-10T19:00:32.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.420+0000 7f06c159a640 1 -- 172.21.15.53:0/3297195969 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b40aaae0 con 0x7f06c40c9840 2023-06-10T19:00:32.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.424+0000 7f06c8cf9640 1 -- 172.21.15.53:0/3297195969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06c40c9840 msgr2=0x7f06c40c9c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:32.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.424+0000 7f06c8cf9640 1 --2- 172.21.15.53:0/3297195969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06c40c9840 0x7f06c40c9c10 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f06c415e360 tx=0x7f06b401c490 comp rx=0 tx=0).stop 2023-06-10T19:00:32.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.424+0000 7f06c8cf9640 1 -- 172.21.15.53:0/3297195969 shutdown_connections 2023-06-10T19:00:32.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.424+0000 7f06c8cf9640 1 --2- 172.21.15.53:0/3297195969 >> v2:172.21.15.117:3300/0 conn(0x7f06c406b090 0x7f06c406b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:32.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.424+0000 7f06c8cf9640 1 --2- 172.21.15.53:0/3297195969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06c40c9840 0x7f06c40c9c10 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:32.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.424+0000 7f06c8cf9640 1 -- 172.21.15.53:0/3297195969 >> 172.21.15.53:0/3297195969 conn(0x7f06c406a0d0 msgr2=0x7f06c40ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:32.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.424+0000 7f06c8cf9640 1 -- 172.21.15.53:0/3297195969 shutdown_connections 2023-06-10T19:00:32.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.424+0000 7f06c8cf9640 1 -- 172.21.15.53:0/3297195969 wait complete. 2023-06-10T19:00:32.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.424+0000 7f06c8cf9640 1 Processor -- start 2023-06-10T19:00:32.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.424+0000 7f06c8cf9640 1 -- start start 2023-06-10T19:00:32.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.424+0000 7f06c8cf9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06c406b090 0x7f06c414e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:32.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.424+0000 7f06c8cf9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06c4071060 0x7f06c414b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:32.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.424+0000 7f06c8cf9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06c40c9840 0x7f06c414bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:32.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.424+0000 7f06c8cf9640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c4154200 con 0x7f06c40c9840 2023-06-10T19:00:32.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.424+0000 7f06c8cf9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c41544e0 con 0x7f06c4071060 2023-06-10T19:00:32.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.424+0000 7f06c8cf9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06c41547c0 con 0x7f06c406b090 2023-06-10T19:00:32.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.424+0000 7f06c2d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06c40c9840 0x7f06c414bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:32.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.424+0000 7f06c2d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06c40c9840 0x7f06c414bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44388/0 (socket says 172.21.15.53:44388) 2023-06-10T19:00:32.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.424+0000 7f06c2d9d640 1 -- 172.21.15.53:0/4166884004 learned_addr learned my addr 172.21.15.53:0/4166884004 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:32.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.424+0000 7f06c259c640 1 --2- 172.21.15.53:0/4166884004 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06c406b090 0x7f06c414e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:32.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.424+0000 7f06c1d9b640 1 --2- 172.21.15.53:0/4166884004 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06c4071060 0x7f06c414b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:32.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.424+0000 7f06c2d9d640 1 -- 172.21.15.53:0/4166884004 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06c406b090 msgr2=0x7f06c414e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:32.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.424+0000 7f06c2d9d640 1 --2- 172.21.15.53:0/4166884004 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06c406b090 0x7f06c414e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:32.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.424+0000 7f06c2d9d640 1 -- 172.21.15.53:0/4166884004 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06c4071060 msgr2=0x7f06c414b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:32.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.424+0000 7f06c2d9d640 1 --2- 172.21.15.53:0/4166884004 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06c4071060 0x7f06c414b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:32.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.424+0000 7f06c2d9d640 1 -- 172.21.15.53:0/4166884004 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06b40094d0 con 0x7f06c40c9840 2023-06-10T19:00:32.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.424+0000 7f06c1d9b640 1 --2- 172.21.15.53:0/4166884004 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06c4071060 0x7f06c414b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:00:32.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.424+0000 7f06c2d9d640 1 --2- 172.21.15.53:0/4166884004 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06c40c9840 0x7f06c414bd70 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f06bc00cef0 tx=0x7f06bc00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:32.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.424+0000 7f06b2ffd640 1 -- 172.21.15.53:0/4166884004 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06bc00d840 con 0x7f06c40c9840 2023-06-10T19:00:32.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.424+0000 7f06b2ffd640 1 -- 172.21.15.53:0/4166884004 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06bc00d9c0 con 0x7f06c40c9840 2023-06-10T19:00:32.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.424+0000 7f06c8cf9640 1 -- 172.21.15.53:0/4166884004 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06c4154aa0 con 0x7f06c40c9840 2023-06-10T19:00:32.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.424+0000 7f06b2ffd640 1 -- 172.21.15.53:0/4166884004 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06bc00dd70 con 0x7f06c40c9840 2023-06-10T19:00:32.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.424+0000 7f06c8cf9640 1 -- 172.21.15.53:0/4166884004 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06c414e920 con 0x7f06c40c9840 2023-06-10T19:00:32.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.428+0000 7f06c8cf9640 1 -- 172.21.15.53:0/4166884004 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06c404d790 con 0x7f06c40c9840 2023-06-10T19:00:32.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.428+0000 7f06b2ffd640 1 -- 172.21.15.53:0/4166884004 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f06bc01e3b0 con 0x7f06c40c9840 2023-06-10T19:00:32.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.428+0000 7f06b2ffd640 1 --2- 172.21.15.53:0/4166884004 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f06a4066280 0x7f06a4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:32.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.428+0000 7f06b2ffd640 1 -- 172.21.15.53:0/4166884004 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f06bc084870 con 0x7f06c40c9840 2023-06-10T19:00:32.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.428+0000 7f06c259c640 1 --2- 172.21.15.53:0/4166884004 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f06a4066280 0x7f06a4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:32.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.428+0000 7f06c259c640 1 --2- 172.21.15.53:0/4166884004 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f06a4066280 0x7f06a4068730 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f06b40ae000 tx=0x7f06b40a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:32.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.432+0000 7f06b2ffd640 1 -- 172.21.15.53:0/4166884004 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f06bc051d10 con 0x7f06c40c9840 2023-06-10T19:00:32.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.588+0000 7f06c8cf9640 1 -- 172.21.15.53:0/4166884004 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f06c4154340 con 0x7f06c40c9840 2023-06-10T19:00:32.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.588+0000 7f06b2ffd640 1 -- 172.21.15.53:0/4166884004 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+18342 (secure 0 0 0) 0x7f06c4154340 con 0x7f06c40c9840 2023-06-10T19:00:32.595 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:00:32.595 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":80,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:00:21.610926+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-06-10T19:00:19.188303+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-06-10T19:00:19.583756+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:00:32.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.592+0000 7f06c8cf9640 1 -- 172.21.15.53:0/4166884004 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f06a4066280 msgr2=0x7f06a4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:32.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.592+0000 7f06c8cf9640 1 --2- 172.21.15.53:0/4166884004 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f06a4066280 0x7f06a4068730 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f06b40ae000 tx=0x7f06b40a7000 comp rx=0 tx=0).stop 2023-06-10T19:00:32.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.592+0000 7f06c8cf9640 1 -- 172.21.15.53:0/4166884004 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06c40c9840 msgr2=0x7f06c414bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:32.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.592+0000 7f06c8cf9640 1 --2- 172.21.15.53:0/4166884004 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06c40c9840 0x7f06c414bd70 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f06bc00cef0 tx=0x7f06bc00a710 comp rx=0 tx=0).stop 2023-06-10T19:00:32.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.592+0000 7f06c8cf9640 1 -- 172.21.15.53:0/4166884004 shutdown_connections 2023-06-10T19:00:32.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.592+0000 7f06c8cf9640 1 --2- 172.21.15.53:0/4166884004 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f06a4066280 0x7f06a4068730 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:32.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.592+0000 7f06c8cf9640 1 --2- 172.21.15.53:0/4166884004 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06c40c9840 0x7f06c414bd70 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:32.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.592+0000 7f06c8cf9640 1 --2- 172.21.15.53:0/4166884004 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06c4071060 0x7f06c414b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:32.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.592+0000 7f06c8cf9640 1 --2- 172.21.15.53:0/4166884004 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06c406b090 0x7f06c414e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:32.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.592+0000 7f06c8cf9640 1 -- 172.21.15.53:0/4166884004 >> 172.21.15.53:0/4166884004 conn(0x7f06c406a0d0 msgr2=0x7f06c4157480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:32.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.592+0000 7f06c8cf9640 1 -- 172.21.15.53:0/4166884004 shutdown_connections 2023-06-10T19:00:32.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.592+0000 7f06c8cf9640 1 -- 172.21.15.53:0/4166884004 wait complete. 2023-06-10T19:00:32.614 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-10T18:52:33.633114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-10T18:52:39.171487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-10T19:00:19.188303+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2023-06-10T19:00:19.583756+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-10T19:00:32.615 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-10T19:00:32.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.736+0000 7faebfd4b640 1 Processor -- start 2023-06-10T19:00:32.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.736+0000 7faebfd4b640 1 -- start start 2023-06-10T19:00:32.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.736+0000 7faebfd4b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faeb80c97d0 0x7faeb80cb820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:32.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.736+0000 7faebfd4b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7faeb806c350 0x7faeb80ac200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:32.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.736+0000 7faebfd4b640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faeb80cbd60 con 0x7faeb80af760 2023-06-10T19:00:32.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.736+0000 7faebfd4b640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faeb80ca5c0 con 0x7faeb806c350 2023-06-10T19:00:32.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.736+0000 7faebfd4b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeb80abd70 con 0x7faeb80c97d0 2023-06-10T19:00:32.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.736+0000 7faebd2e6640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7faeb806c350 0x7faeb80ac200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:32.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.736+0000 7faebd2e6640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7faeb806c350 0x7faeb80ac200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44398/0 (socket says 172.21.15.53:44398) 2023-06-10T19:00:32.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.736+0000 7faebd2e6640 1 -- 172.21.15.53:0/1632587278 learned_addr learned my addr 172.21.15.53:0/1632587278 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:32.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.736+0000 7faebdae7640 1 --2- 172.21.15.53:0/1632587278 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faeb80c97d0 0x7faeb80cb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:32.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.736+0000 7faebd2e6640 1 -- 172.21.15.53:0/1632587278 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faeb80c97d0 msgr2=0x7faeb80cb820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:32.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.736+0000 7faebd2e6640 1 --2- 172.21.15.53:0/1632587278 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faeb80c97d0 0x7faeb80cb820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:32.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.736+0000 7faebd2e6640 1 -- 172.21.15.53:0/1632587278 >> v1:172.21.15.117:6789/0 conn(0x7faeb80af760 legacy=0x7faeb806b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:32.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.736+0000 7faebd2e6640 1 -- 172.21.15.53:0/1632587278 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeb80c9ba0 con 0x7faeb806c350 2023-06-10T19:00:32.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.740+0000 7faebd2e6640 1 --2- 172.21.15.53:0/1632587278 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faeb806c350 0x7faeb80ac200 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7faeb4009870 tx=0x7faeb401c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc3e7dca04721c62 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:32.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.740+0000 7faebcae5640 1 -- 172.21.15.53:0/1632587278 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb40ab600 con 0x7faeb806c350 2023-06-10T19:00:32.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.740+0000 7faebcae5640 1 -- 172.21.15.53:0/1632587278 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeb40a7050 con 0x7faeb806c350 2023-06-10T19:00:32.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.740+0000 7faebcae5640 1 -- 172.21.15.53:0/1632587278 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb40ab980 con 0x7faeb806c350 2023-06-10T19:00:32.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.740+0000 7faebfd4b640 1 -- 172.21.15.53:0/1632587278 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faeb806c350 msgr2=0x7faeb80ac200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:32.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.740+0000 7faebfd4b640 1 --2- 172.21.15.53:0/1632587278 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faeb806c350 0x7faeb80ac200 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7faeb4009870 tx=0x7faeb401c420 comp rx=0 tx=0).stop 2023-06-10T19:00:32.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.740+0000 7faebfd4b640 1 -- 172.21.15.53:0/1632587278 shutdown_connections 2023-06-10T19:00:32.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.740+0000 7faebfd4b640 1 --2- 172.21.15.53:0/1632587278 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faeb806c350 0x7faeb80ac200 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:32.747 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.740+0000 7faebfd4b640 1 --2- 172.21.15.53:0/1632587278 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faeb80c97d0 0x7faeb80cb820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:32.747 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.740+0000 7faebfd4b640 1 -- 172.21.15.53:0/1632587278 >> 172.21.15.53:0/1632587278 conn(0x7faeb806a0e0 msgr2=0x7faeb80cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:32.747 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.740+0000 7faebfd4b640 1 -- 172.21.15.53:0/1632587278 shutdown_connections 2023-06-10T19:00:32.747 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.740+0000 7faebfd4b640 1 -- 172.21.15.53:0/1632587278 wait complete. 2023-06-10T19:00:32.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.740+0000 7faebfd4b640 1 Processor -- start 2023-06-10T19:00:32.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.740+0000 7faebfd4b640 1 -- start start 2023-06-10T19:00:32.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.740+0000 7faebfd4b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faeb806c350 0x7faeb8156b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:32.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.740+0000 7faebfd4b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faeb80af760 0x7faeb814d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:32.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.740+0000 7faebfd4b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faeb80c97d0 0x7faeb80adfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:32.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.740+0000 7faebfd4b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb806f350 con 0x7faeb806c350 2023-06-10T19:00:32.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.740+0000 7faebfd4b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb80ae510 con 0x7faeb80c97d0 2023-06-10T19:00:32.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.740+0000 7faebfd4b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeb81571e0 con 0x7faeb80af760 2023-06-10T19:00:32.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.740+0000 7faebdae7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faeb806c350 0x7faeb8156b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:32.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.740+0000 7faebdae7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faeb806c350 0x7faeb8156b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44408/0 (socket says 172.21.15.53:44408) 2023-06-10T19:00:32.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.740+0000 7faebdae7640 1 -- 172.21.15.53:0/1917796832 learned_addr learned my addr 172.21.15.53:0/1917796832 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:32.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.740+0000 7faebd2e6640 1 --2- 172.21.15.53:0/1917796832 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faeb80af760 0x7faeb814d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:32.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.740+0000 7faebe2e8640 1 --2- 172.21.15.53:0/1917796832 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faeb80c97d0 0x7faeb80adfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:32.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.740+0000 7faebdae7640 1 -- 172.21.15.53:0/1917796832 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faeb80af760 msgr2=0x7faeb814d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:32.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.740+0000 7faebdae7640 1 --2- 172.21.15.53:0/1917796832 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faeb80af760 0x7faeb814d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:32.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.740+0000 7faebdae7640 1 -- 172.21.15.53:0/1917796832 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faeb80c97d0 msgr2=0x7faeb80adfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:32.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.740+0000 7faebdae7640 1 --2- 172.21.15.53:0/1917796832 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faeb80c97d0 0x7faeb80adfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:32.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.740+0000 7faebdae7640 1 -- 172.21.15.53:0/1917796832 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeb40094d0 con 0x7faeb806c350 2023-06-10T19:00:32.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.740+0000 7faebd2e6640 1 --2- 172.21.15.53:0/1917796832 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faeb80af760 0x7faeb814d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:00:32.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.740+0000 7faebe2e8640 1 --2- 172.21.15.53:0/1917796832 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faeb80c97d0 0x7faeb80adfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:00:32.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.744+0000 7faebdae7640 1 --2- 172.21.15.53:0/1917796832 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faeb806c350 0x7faeb8156b00 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7faeac00d800 tx=0x7faeac00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:32.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.744+0000 7faeaa7fc640 1 -- 172.21.15.53:0/1917796832 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeac00b6c0 con 0x7faeb806c350 2023-06-10T19:00:32.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.744+0000 7faeaa7fc640 1 -- 172.21.15.53:0/1917796832 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeac00b820 con 0x7faeb806c350 2023-06-10T19:00:32.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.744+0000 7faebfd4b640 1 -- 172.21.15.53:0/1917796832 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faeb81574c0 con 0x7faeb806c350 2023-06-10T19:00:32.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.744+0000 7faeaa7fc640 1 -- 172.21.15.53:0/1917796832 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeac00bb90 con 0x7faeb806c350 2023-06-10T19:00:32.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.744+0000 7faebfd4b640 1 -- 172.21.15.53:0/1917796832 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeb8157a80 con 0x7faeb806c350 2023-06-10T19:00:32.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.744+0000 7faebfd4b640 1 -- 172.21.15.53:0/1917796832 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faeb804d790 con 0x7faeb806c350 2023-06-10T19:00:32.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.744+0000 7faeaa7fc640 1 -- 172.21.15.53:0/1917796832 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7faeac00bcf0 con 0x7faeb806c350 2023-06-10T19:00:32.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.744+0000 7faeaa7fc640 1 --2- 172.21.15.53:0/1917796832 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fae9c066280 0x7fae9c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:32.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.744+0000 7faeaa7fc640 1 -- 172.21.15.53:0/1917796832 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6062+0+0 (secure 0 0 0) 0x7faeac0842b0 con 0x7faeb806c350 2023-06-10T19:00:32.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.744+0000 7faebd2e6640 1 --2- 172.21.15.53:0/1917796832 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fae9c066280 0x7fae9c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:32.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.744+0000 7faebd2e6640 1 --2- 172.21.15.53:0/1917796832 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fae9c066280 0x7fae9c068730 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7faeb40ad000 tx=0x7faeb4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:32.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.748+0000 7faeaa7fc640 1 -- 172.21.15.53:0/1917796832 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7faeac0551b0 con 0x7faeb806c350 2023-06-10T19:00:32.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.904+0000 7faebfd4b640 1 -- 172.21.15.53:0/1917796832 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7faeb80ce8f0 con 0x7faeb806c350 2023-06-10T19:00:32.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.904+0000 7faeaa7fc640 1 -- 172.21.15.53:0/1917796832 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v80) v1 ==== 93+0+10 (secure 0 0 0) 0x7faeac054d40 con 0x7faeb806c350 2023-06-10T19:00:32.909 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-06-10T19:00:32.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.904+0000 7faebfd4b640 1 -- 172.21.15.53:0/1917796832 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fae9c066280 msgr2=0x7fae9c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:32.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.904+0000 7faebfd4b640 1 --2- 172.21.15.53:0/1917796832 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fae9c066280 0x7fae9c068730 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7faeb40ad000 tx=0x7faeb4008040 comp rx=0 tx=0).stop 2023-06-10T19:00:32.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.904+0000 7faebfd4b640 1 -- 172.21.15.53:0/1917796832 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faeb806c350 msgr2=0x7faeb8156b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:32.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.904+0000 7faebfd4b640 1 --2- 172.21.15.53:0/1917796832 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faeb806c350 0x7faeb8156b00 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7faeac00d800 tx=0x7faeac00dcc0 comp rx=0 tx=0).stop 2023-06-10T19:00:32.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.904+0000 7faebfd4b640 1 -- 172.21.15.53:0/1917796832 shutdown_connections 2023-06-10T19:00:32.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.904+0000 7faebfd4b640 1 --2- 172.21.15.53:0/1917796832 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fae9c066280 0x7fae9c068730 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:32.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.904+0000 7faebfd4b640 1 --2- 172.21.15.53:0/1917796832 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faeb80c97d0 0x7faeb80adfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:32.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.904+0000 7faebfd4b640 1 --2- 172.21.15.53:0/1917796832 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faeb80af760 0x7faeb814d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:32.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.904+0000 7faebfd4b640 1 --2- 172.21.15.53:0/1917796832 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faeb806c350 0x7faeb8156b00 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:32.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.904+0000 7faebfd4b640 1 -- 172.21.15.53:0/1917796832 >> 172.21.15.53:0/1917796832 conn(0x7faeb806a0e0 msgr2=0x7faeb806b090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:32.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.904+0000 7faebfd4b640 1 -- 172.21.15.53:0/1917796832 shutdown_connections 2023-06-10T19:00:32.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:32.904+0000 7faebfd4b640 1 -- 172.21.15.53:0/1917796832 wait complete. 2023-06-10T19:00:32.930 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-10T19:00:33.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.056+0000 7f6516441640 1 Processor -- start 2023-06-10T19:00:33.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.056+0000 7f6516441640 1 -- start start 2023-06-10T19:00:33.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.056+0000 7f6516441640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65100b0f30 0x7f6510070950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:33.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.056+0000 7f6516441640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65100cb080 con 0x7f6510159690 2023-06-10T19:00:33.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.056+0000 7f6516441640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65100cb320 con 0x7f6510159a60 2023-06-10T19:00:33.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.056+0000 7f6516441640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6510070e90 con 0x7f65100b0f30 2023-06-10T19:00:33.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.056+0000 7f650ffff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f6510159690 0x7f65100cbe00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60034/0 (socket says 172.21.15.53:60034) 2023-06-10T19:00:33.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.056+0000 7f650ffff640 1 -- 172.21.15.53:0/2378939531 learned_addr learned my addr 172.21.15.53:0/2378939531 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:00:33.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.056+0000 7f650f7fe640 1 --2- 172.21.15.53:0/2378939531 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65100b0f30 0x7f6510070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:33.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.056+0000 7f650effd640 1 -- 172.21.15.53:0/2378939531 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2649459167 0 0) 0x7f65100cb080 con 0x7f6510159690 2023-06-10T19:00:33.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.056+0000 7f650effd640 1 -- 172.21.15.53:0/2378939531 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64f0003530 con 0x7f6510159690 2023-06-10T19:00:33.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.056+0000 7f650effd640 1 -- 172.21.15.53:0/2378939531 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 109236195 0 0) 0x7f64f0003530 con 0x7f6510159690 2023-06-10T19:00:33.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.056+0000 7f650effd640 1 -- 172.21.15.53:0/2378939531 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65100b0f30 msgr2=0x7f6510070950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:33.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.056+0000 7f650effd640 1 --2- 172.21.15.53:0/2378939531 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65100b0f30 0x7f6510070950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:33.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.056+0000 7f650effd640 1 -- 172.21.15.53:0/2378939531 >> v1:172.21.15.117:6789/0 conn(0x7f6510159a60 legacy=0x7f65100c2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:33.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.056+0000 7f650effd640 1 -- 172.21.15.53:0/2378939531 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65100cb600 con 0x7f6510159690 2023-06-10T19:00:33.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.056+0000 7f650effd640 1 -- 172.21.15.53:0/2378939531 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f64f8001a00 con 0x7f6510159690 2023-06-10T19:00:33.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.056+0000 7f650effd640 1 -- 172.21.15.53:0/2378939531 >> v1:172.21.15.53:6789/0 conn(0x7f6510159690 legacy=0x7f65100cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:33.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.056+0000 7f650effd640 1 --2- 172.21.15.53:0/2378939531 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64f00039b0 0x7f64f0003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:33.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.056+0000 7f650effd640 1 --2- 172.21.15.53:0/2378939531 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64f0004350 0x7f64f0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:33.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.056+0000 7f650effd640 1 --2- 172.21.15.53:0/2378939531 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65100b0f30 0x7f64f0005070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:33.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.056+0000 7f650effd640 1 -- 172.21.15.53:0/2378939531 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6510070e90 con 0x7f64f00039b0 2023-06-10T19:00:33.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.056+0000 7f650effd640 1 -- 172.21.15.53:0/2378939531 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64f000b990 con 0x7f64f0004350 2023-06-10T19:00:33.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.056+0000 7f650effd640 1 -- 172.21.15.53:0/2378939531 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64f000bb20 con 0x7f65100b0f30 2023-06-10T19:00:33.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.056+0000 7f650ffff640 1 --2- 172.21.15.53:0/2378939531 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64f00039b0 0x7f64f0003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:33.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.056+0000 7f650f7fe640 1 --2- 172.21.15.53:0/2378939531 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64f0004350 0x7f64f0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:33.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.056+0000 7f65149de640 1 --2- 172.21.15.53:0/2378939531 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65100b0f30 0x7f64f0005070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:33.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.056+0000 7f650ffff640 1 -- 172.21.15.53:0/2378939531 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65100b0f30 msgr2=0x7f64f0005070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:33.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.056+0000 7f650ffff640 1 --2- 172.21.15.53:0/2378939531 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65100b0f30 0x7f64f0005070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:33.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.056+0000 7f650ffff640 1 -- 172.21.15.53:0/2378939531 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64f0004350 msgr2=0x7f64f0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:33.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.056+0000 7f650ffff640 1 --2- 172.21.15.53:0/2378939531 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64f0004350 0x7f64f0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:33.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.056+0000 7f650ffff640 1 -- 172.21.15.53:0/2378939531 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64f0003530 con 0x7f64f00039b0 2023-06-10T19:00:33.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.060+0000 7f650ffff640 1 --2- 172.21.15.53:0/2378939531 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64f00039b0 0x7f64f0003d80 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f64f800a850 tx=0x7f64f801d380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=289974d343246aef server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:33.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.060+0000 7f650effd640 1 -- 172.21.15.53:0/2378939531 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f80ad630 con 0x7f64f00039b0 2023-06-10T19:00:33.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.060+0000 7f650effd640 1 -- 172.21.15.53:0/2378939531 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64f80a8070 con 0x7f64f00039b0 2023-06-10T19:00:33.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.060+0000 7f650effd640 1 -- 172.21.15.53:0/2378939531 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f80ad9d0 con 0x7f64f00039b0 2023-06-10T19:00:33.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.060+0000 7f6516441640 1 -- 172.21.15.53:0/2378939531 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64f00039b0 msgr2=0x7f64f0003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:33.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.060+0000 7f6516441640 1 --2- 172.21.15.53:0/2378939531 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64f00039b0 0x7f64f0003d80 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f64f800a850 tx=0x7f64f801d380 comp rx=0 tx=0).stop 2023-06-10T19:00:33.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.060+0000 7f65149de640 1 -- 172.21.15.53:0/2378939531 reap_dead start 2023-06-10T19:00:33.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.060+0000 7f6516441640 1 -- 172.21.15.53:0/2378939531 shutdown_connections 2023-06-10T19:00:33.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.060+0000 7f6516441640 1 -- 172.21.15.53:0/2378939531 >> 172.21.15.53:0/2378939531 conn(0x7f651006a560 msgr2=0x7f651006a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:33.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.060+0000 7f6516441640 1 -- 172.21.15.53:0/2378939531 shutdown_connections 2023-06-10T19:00:33.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.060+0000 7f6516441640 1 -- 172.21.15.53:0/2378939531 wait complete. 2023-06-10T19:00:33.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.064+0000 7f6516441640 1 Processor -- start 2023-06-10T19:00:33.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.064+0000 7f6516441640 1 -- start start 2023-06-10T19:00:33.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.064+0000 7f6516441640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65101ef6a0 0x7f65100cd110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:33.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.064+0000 7f6516441640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f651015dd30 0x7f65100cd650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:33.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.064+0000 7f6516441640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6510150850 0x7f65100cdb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:33.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.064+0000 7f6516441640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6510152d40 con 0x7f6510150850 2023-06-10T19:00:33.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.064+0000 7f6516441640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6510150da0 con 0x7f65101ef6a0 2023-06-10T19:00:33.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.064+0000 7f6516441640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6510151080 con 0x7f651015dd30 2023-06-10T19:00:33.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.064+0000 7f65149de640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6510150850 0x7f65100cdb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:33.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.064+0000 7f65149de640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6510150850 0x7f65100cdb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44422/0 (socket says 172.21.15.53:44422) 2023-06-10T19:00:33.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.064+0000 7f65149de640 1 -- 172.21.15.53:0/1954130540 learned_addr learned my addr 172.21.15.53:0/1954130540 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:33.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.064+0000 7f650ffff640 1 --2- 172.21.15.53:0/1954130540 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65101ef6a0 0x7f65100cd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:33.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.064+0000 7f650f7fe640 1 --2- 172.21.15.53:0/1954130540 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f651015dd30 0x7f65100cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:33.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.064+0000 7f65149de640 1 -- 172.21.15.53:0/1954130540 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f651015dd30 msgr2=0x7f65100cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:33.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.064+0000 7f65149de640 1 --2- 172.21.15.53:0/1954130540 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f651015dd30 0x7f65100cd650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:33.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.064+0000 7f65149de640 1 -- 172.21.15.53:0/1954130540 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65101ef6a0 msgr2=0x7f65100cd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:33.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.064+0000 7f65149de640 1 --2- 172.21.15.53:0/1954130540 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65101ef6a0 0x7f65100cd110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:33.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.064+0000 7f65149de640 1 -- 172.21.15.53:0/1954130540 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6510152f90 con 0x7f6510150850 2023-06-10T19:00:33.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.064+0000 7f65149de640 1 --2- 172.21.15.53:0/1954130540 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6510150850 0x7f65100cdb90 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f651015d390 tx=0x7f650000d4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:33.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.064+0000 7f650cff9640 1 -- 172.21.15.53:0/1954130540 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f650000b070 con 0x7f6510150850 2023-06-10T19:00:33.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.064+0000 7f650cff9640 1 -- 172.21.15.53:0/1954130540 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f650000d890 con 0x7f6510150850 2023-06-10T19:00:33.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.064+0000 7f6516441640 1 -- 172.21.15.53:0/1954130540 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6510153270 con 0x7f6510150850 2023-06-10T19:00:33.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.064+0000 7f650cff9640 1 -- 172.21.15.53:0/1954130540 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f650000dc40 con 0x7f6510150850 2023-06-10T19:00:33.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.064+0000 7f6516441640 1 -- 172.21.15.53:0/1954130540 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65101efa70 con 0x7f6510150850 2023-06-10T19:00:33.079 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.064+0000 7f6516441640 1 -- 172.21.15.53:0/1954130540 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6510153460 con 0x7f6510150850 2023-06-10T19:00:33.079 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.064+0000 7f650cff9640 1 -- 172.21.15.53:0/1954130540 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6500003600 con 0x7f6510150850 2023-06-10T19:00:33.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.068+0000 7f650cff9640 1 --2- 172.21.15.53:0/1954130540 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f64f40662b0 0x7f64f4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:33.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.068+0000 7f650cff9640 1 -- 172.21.15.53:0/1954130540 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6500082bb0 con 0x7f6510150850 2023-06-10T19:00:33.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.068+0000 7f650ffff640 1 --2- 172.21.15.53:0/1954130540 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f64f40662b0 0x7f64f4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:33.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.068+0000 7f650ffff640 1 --2- 172.21.15.53:0/1954130540 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f64f40662b0 0x7f64f4068760 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f64f80ad000 tx=0x7f64f80a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:33.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.072+0000 7f650cff9640 1 -- 172.21.15.53:0/1954130540 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f65000500d0 con 0x7f6510150850 2023-06-10T19:00:33.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.228+0000 7f6516441640 1 -- 172.21.15.53:0/1954130540 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f651004d790 con 0x7f6510150850 2023-06-10T19:00:33.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.228+0000 7f650cff9640 1 -- 172.21.15.53:0/1954130540 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v80) v1 ==== 92+0+10 (secure 0 0 0) 0x7f65000536f0 con 0x7f6510150850 2023-06-10T19:00:33.235 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-06-10T19:00:33.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.232+0000 7f6516441640 1 -- 172.21.15.53:0/1954130540 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f64f40662b0 msgr2=0x7f64f4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:33.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.232+0000 7f6516441640 1 --2- 172.21.15.53:0/1954130540 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f64f40662b0 0x7f64f4068760 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f64f80ad000 tx=0x7f64f80a7000 comp rx=0 tx=0).stop 2023-06-10T19:00:33.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.232+0000 7f6516441640 1 -- 172.21.15.53:0/1954130540 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6510150850 msgr2=0x7f65100cdb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:33.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.232+0000 7f6516441640 1 --2- 172.21.15.53:0/1954130540 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6510150850 0x7f65100cdb90 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f651015d390 tx=0x7f650000d4c0 comp rx=0 tx=0).stop 2023-06-10T19:00:33.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.232+0000 7f6516441640 1 -- 172.21.15.53:0/1954130540 shutdown_connections 2023-06-10T19:00:33.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.232+0000 7f6516441640 1 --2- 172.21.15.53:0/1954130540 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f64f40662b0 0x7f64f4068760 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:33.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.232+0000 7f6516441640 1 --2- 172.21.15.53:0/1954130540 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6510150850 0x7f65100cdb90 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:33.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.232+0000 7f6516441640 1 --2- 172.21.15.53:0/1954130540 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f651015dd30 0x7f65100cd650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:33.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.232+0000 7f6516441640 1 --2- 172.21.15.53:0/1954130540 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65101ef6a0 0x7f65100cd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:33.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.232+0000 7f6516441640 1 -- 172.21.15.53:0/1954130540 >> 172.21.15.53:0/1954130540 conn(0x7f651006a560 msgr2=0x7f651006a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:33.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.232+0000 7f6516441640 1 -- 172.21.15.53:0/1954130540 shutdown_connections 2023-06-10T19:00:33.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.232+0000 7f6516441640 1 -- 172.21.15.53:0/1954130540 wait complete. 2023-06-10T19:00:33.254 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-10T19:00:33.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.380+0000 7f5876425640 1 Processor -- start 2023-06-10T19:00:33.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.380+0000 7f5876425640 1 -- start start 2023-06-10T19:00:33.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.380+0000 7f5876425640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f587006c7d0 0x7f58701586f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:33.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.380+0000 7f5876425640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f587015c260 con 0x7f587006c400 2023-06-10T19:00:33.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.380+0000 7f5876425640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f587015c540 con 0x7f58700ccc90 2023-06-10T19:00:33.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.380+0000 7f5876425640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f587015cee0 con 0x7f587006c7d0 2023-06-10T19:00:33.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.380+0000 7f586ffff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f587006c400 0x7f5870157fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60046/0 (socket says 172.21.15.53:60046) 2023-06-10T19:00:33.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.380+0000 7f586ffff640 1 -- 172.21.15.53:0/2421673139 learned_addr learned my addr 172.21.15.53:0/2421673139 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:00:33.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.380+0000 7f586f7fe640 1 --2- 172.21.15.53:0/2421673139 >> v2:172.21.15.117:3300/0 conn(0x7f587006c7d0 0x7f58701586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:33.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.380+0000 7f586effd640 1 -- 172.21.15.53:0/2421673139 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3058877702 0 0) 0x7f587015c260 con 0x7f587006c400 2023-06-10T19:00:33.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.380+0000 7f586effd640 1 -- 172.21.15.53:0/2421673139 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5858003530 con 0x7f587006c400 2023-06-10T19:00:33.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.380+0000 7f586effd640 1 -- 172.21.15.53:0/2421673139 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3959159886 0 0) 0x7f5858003530 con 0x7f587006c400 2023-06-10T19:00:33.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.380+0000 7f586effd640 1 -- 172.21.15.53:0/2421673139 >> v2:172.21.15.117:3300/0 conn(0x7f587006c7d0 msgr2=0x7f58701586f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:33.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.380+0000 7f586effd640 1 --2- 172.21.15.53:0/2421673139 >> v2:172.21.15.117:3300/0 conn(0x7f587006c7d0 0x7f58701586f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:33.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.380+0000 7f586effd640 1 -- 172.21.15.53:0/2421673139 >> v1:172.21.15.117:6789/0 conn(0x7f58700ccc90 legacy=0x7f58700cd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:33.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.380+0000 7f586effd640 1 -- 172.21.15.53:0/2421673139 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f587015c820 con 0x7f587006c400 2023-06-10T19:00:33.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.380+0000 7f586effd640 1 -- 172.21.15.53:0/2421673139 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f5864001680 con 0x7f587006c400 2023-06-10T19:00:33.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.380+0000 7f586f7fe640 1 --2- 172.21.15.53:0/2421673139 >> v2:172.21.15.117:3300/0 conn(0x7f587006c7d0 0x7f58701586f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:00:33.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.380+0000 7f586effd640 1 -- 172.21.15.53:0/2421673139 >> v1:172.21.15.53:6789/0 conn(0x7f587006c400 legacy=0x7f5870157fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:33.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.380+0000 7f586effd640 1 --2- 172.21.15.53:0/2421673139 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5858003980 0x7f5858003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:33.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.380+0000 7f586effd640 1 --2- 172.21.15.53:0/2421673139 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f58580047d0 0x7f5858004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:33.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.380+0000 7f586effd640 1 --2- 172.21.15.53:0/2421673139 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58580052a0 0x7f585800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:33.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.380+0000 7f586effd640 1 -- 172.21.15.53:0/2421673139 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f587015cee0 con 0x7f58580047d0 2023-06-10T19:00:33.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.380+0000 7f586effd640 1 -- 172.21.15.53:0/2421673139 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f585800c160 con 0x7f5858003980 2023-06-10T19:00:33.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.380+0000 7f586effd640 1 -- 172.21.15.53:0/2421673139 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f585800c320 con 0x7f58580052a0 2023-06-10T19:00:33.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.380+0000 7f586f7fe640 1 --2- 172.21.15.53:0/2421673139 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f58580047d0 0x7f5858004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:33.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.380+0000 7f586ffff640 1 --2- 172.21.15.53:0/2421673139 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5858003980 0x7f5858003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:33.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.380+0000 7f58749c2640 1 --2- 172.21.15.53:0/2421673139 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58580052a0 0x7f585800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:33.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.380+0000 7f586f7fe640 1 -- 172.21.15.53:0/2421673139 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58580052a0 msgr2=0x7f585800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:33.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.380+0000 7f586f7fe640 1 --2- 172.21.15.53:0/2421673139 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58580052a0 0x7f585800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:33.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.380+0000 7f586f7fe640 1 -- 172.21.15.53:0/2421673139 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5858003980 msgr2=0x7f5858003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:33.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.380+0000 7f586f7fe640 1 --2- 172.21.15.53:0/2421673139 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5858003980 0x7f5858003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:33.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.380+0000 7f586f7fe640 1 -- 172.21.15.53:0/2421673139 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5858003530 con 0x7f58580047d0 2023-06-10T19:00:33.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.384+0000 7f58749c2640 1 --2- 172.21.15.53:0/2421673139 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58580052a0 0x7f585800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:00:33.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.384+0000 7f58749c2640 1 -- 172.21.15.53:0/2421673139 reap_dead start 2023-06-10T19:00:33.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.384+0000 7f586f7fe640 1 --2- 172.21.15.53:0/2421673139 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f58580047d0 0x7f5858004c40 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f58600098d0 tx=0x7f586001c580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7377a9131c1d572d server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:33.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.384+0000 7f586effd640 1 -- 172.21.15.53:0/2421673139 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58600aa650 con 0x7f58580047d0 2023-06-10T19:00:33.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.384+0000 7f586effd640 1 -- 172.21.15.53:0/2421673139 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58600aa7b0 con 0x7f58580047d0 2023-06-10T19:00:33.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.384+0000 7f586effd640 1 -- 172.21.15.53:0/2421673139 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58600aab20 con 0x7f58580047d0 2023-06-10T19:00:33.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.384+0000 7f5876425640 1 -- 172.21.15.53:0/2421673139 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f58580047d0 msgr2=0x7f5858004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:33.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.384+0000 7f5876425640 1 --2- 172.21.15.53:0/2421673139 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f58580047d0 0x7f5858004c40 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f58600098d0 tx=0x7f586001c580 comp rx=0 tx=0).stop 2023-06-10T19:00:33.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.384+0000 7f5876425640 1 -- 172.21.15.53:0/2421673139 shutdown_connections 2023-06-10T19:00:33.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.384+0000 7f5876425640 1 --2- 172.21.15.53:0/2421673139 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f58580047d0 0x7f5858004c40 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:33.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.384+0000 7f5876425640 1 -- 172.21.15.53:0/2421673139 >> 172.21.15.53:0/2421673139 conn(0x7f587006a560 msgr2=0x7f587006a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:33.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.384+0000 7f5876425640 1 -- 172.21.15.53:0/2421673139 shutdown_connections 2023-06-10T19:00:33.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.384+0000 7f5876425640 1 -- 172.21.15.53:0/2421673139 wait complete. 2023-06-10T19:00:33.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.388+0000 7f5876425640 1 Processor -- start 2023-06-10T19:00:33.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.388+0000 7f5876425640 1 -- start start 2023-06-10T19:00:33.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.388+0000 7f5876425640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f58580047d0 0x7f587014b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:33.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.388+0000 7f5876425640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f587014de10 0x7f587014e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:33.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.388+0000 7f5876425640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58700ae7d0 0x7f58700aec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:33.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.388+0000 7f5876425640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58701596c0 con 0x7f58580047d0 2023-06-10T19:00:33.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.388+0000 7f5876425640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58700af180 con 0x7f58700ae7d0 2023-06-10T19:00:33.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.388+0000 7f5876425640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f587014bc70 con 0x7f587014de10 2023-06-10T19:00:33.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.388+0000 7f586ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f58580047d0 0x7f587014b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:33.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.388+0000 7f586ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f58580047d0 0x7f587014b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44450/0 (socket says 172.21.15.53:44450) 2023-06-10T19:00:33.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.388+0000 7f586ffff640 1 -- 172.21.15.53:0/1861176785 learned_addr learned my addr 172.21.15.53:0/1861176785 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:33.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.388+0000 7f586f7fe640 1 --2- 172.21.15.53:0/1861176785 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f587014de10 0x7f587014e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:33.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.388+0000 7f58749c2640 1 --2- 172.21.15.53:0/1861176785 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58700ae7d0 0x7f58700aec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:33.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.388+0000 7f586ffff640 1 -- 172.21.15.53:0/1861176785 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f587014de10 msgr2=0x7f587014e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:33.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.388+0000 7f586ffff640 1 --2- 172.21.15.53:0/1861176785 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f587014de10 0x7f587014e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:33.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.388+0000 7f586ffff640 1 -- 172.21.15.53:0/1861176785 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58700ae7d0 msgr2=0x7f58700aec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:33.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.388+0000 7f586ffff640 1 --2- 172.21.15.53:0/1861176785 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58700ae7d0 0x7f58700aec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:33.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.388+0000 7f586ffff640 1 -- 172.21.15.53:0/1861176785 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58700c5650 con 0x7f58580047d0 2023-06-10T19:00:33.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.388+0000 7f58749c2640 1 --2- 172.21.15.53:0/1861176785 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58700ae7d0 0x7f58700aec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:00:33.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.388+0000 7f586ffff640 1 --2- 172.21.15.53:0/1861176785 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f58580047d0 0x7f587014b730 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f5864007290 tx=0x7f5864007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:33.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.388+0000 7f586cff9640 1 -- 172.21.15.53:0/1861176785 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586400f9c0 con 0x7f58580047d0 2023-06-10T19:00:33.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.388+0000 7f586cff9640 1 -- 172.21.15.53:0/1861176785 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f586400fb20 con 0x7f58580047d0 2023-06-10T19:00:33.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.388+0000 7f5876425640 1 -- 172.21.15.53:0/1861176785 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f587014e980 con 0x7f58580047d0 2023-06-10T19:00:33.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.388+0000 7f586cff9640 1 -- 172.21.15.53:0/1861176785 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586400fed0 con 0x7f58580047d0 2023-06-10T19:00:33.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.388+0000 7f5876425640 1 -- 172.21.15.53:0/1861176785 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f587014ef40 con 0x7f58580047d0 2023-06-10T19:00:33.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.388+0000 7f5876425640 1 -- 172.21.15.53:0/1861176785 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f587004d790 con 0x7f58580047d0 2023-06-10T19:00:33.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.392+0000 7f586cff9640 1 -- 172.21.15.53:0/1861176785 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f586401d460 con 0x7f58580047d0 2023-06-10T19:00:33.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.392+0000 7f586cff9640 1 --2- 172.21.15.53:0/1861176785 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f585c0662b0 0x7f585c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:33.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.392+0000 7f586cff9640 1 -- 172.21.15.53:0/1861176785 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5864083ed0 con 0x7f58580047d0 2023-06-10T19:00:33.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.392+0000 7f586f7fe640 1 --2- 172.21.15.53:0/1861176785 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f585c0662b0 0x7f585c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:33.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.392+0000 7f586f7fe640 1 --2- 172.21.15.53:0/1861176785 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f585c0662b0 0x7f585c068760 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f58600ae000 tx=0x7f58600b6040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:33.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.396+0000 7f586cff9640 1 -- 172.21.15.53:0/1861176785 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f58640513e0 con 0x7f58580047d0 2023-06-10T19:00:33.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.548+0000 7f5876425640 1 -- 172.21.15.53:0/1861176785 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f58700b4d30 con 0x7f58580047d0 2023-06-10T19:00:33.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.548+0000 7f586cff9640 1 -- 172.21.15.53:0/1861176785 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v80) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5864054a00 con 0x7f58580047d0 2023-06-10T19:00:33.554 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-06-10T19:00:33.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.552+0000 7f5876425640 1 -- 172.21.15.53:0/1861176785 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f585c0662b0 msgr2=0x7f585c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:33.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.552+0000 7f5876425640 1 --2- 172.21.15.53:0/1861176785 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f585c0662b0 0x7f585c068760 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f58600ae000 tx=0x7f58600b6040 comp rx=0 tx=0).stop 2023-06-10T19:00:33.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.552+0000 7f5876425640 1 -- 172.21.15.53:0/1861176785 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f58580047d0 msgr2=0x7f587014b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:33.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.552+0000 7f5876425640 1 --2- 172.21.15.53:0/1861176785 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f58580047d0 0x7f587014b730 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f5864007290 tx=0x7f5864007750 comp rx=0 tx=0).stop 2023-06-10T19:00:33.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.552+0000 7f5876425640 1 -- 172.21.15.53:0/1861176785 shutdown_connections 2023-06-10T19:00:33.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.552+0000 7f5876425640 1 --2- 172.21.15.53:0/1861176785 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f585c0662b0 0x7f585c068760 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:33.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.552+0000 7f5876425640 1 --2- 172.21.15.53:0/1861176785 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58700ae7d0 0x7f58700aec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:33.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.552+0000 7f5876425640 1 --2- 172.21.15.53:0/1861176785 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f587014de10 0x7f587014e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:33.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.552+0000 7f5876425640 1 --2- 172.21.15.53:0/1861176785 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f58580047d0 0x7f587014b730 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:33.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.552+0000 7f5876425640 1 -- 172.21.15.53:0/1861176785 >> 172.21.15.53:0/1861176785 conn(0x7f587006a560 msgr2=0x7f58700ca0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:33.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.552+0000 7f5876425640 1 -- 172.21.15.53:0/1861176785 shutdown_connections 2023-06-10T19:00:33.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.552+0000 7f5876425640 1 -- 172.21.15.53:0/1861176785 wait complete. 2023-06-10T19:00:33.573 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-10T19:00:33.696 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.692+0000 7fc025506640 1 Processor -- start 2023-06-10T19:00:33.696 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.692+0000 7fc025506640 1 -- start start 2023-06-10T19:00:33.697 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.692+0000 7fc025506640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc0200c82a0 0x7fc0200c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:33.697 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.692+0000 7fc025506640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc0200af760 0x7fc0200afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:33.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.692+0000 7fc025506640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc02006b090 con 0x7fc0200c9fa0 2023-06-10T19:00:33.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.692+0000 7fc025506640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0200b0120 con 0x7fc0200c82a0 2023-06-10T19:00:33.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.692+0000 7fc025506640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0200ca370 con 0x7fc0200af760 2023-06-10T19:00:33.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.692+0000 7fc01effd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fc0200c9fa0 0x7fc02006bae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60052/0 (socket says 172.21.15.53:60052) 2023-06-10T19:00:33.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.692+0000 7fc01effd640 1 -- 172.21.15.53:0/2468007302 learned_addr learned my addr 172.21.15.53:0/2468007302 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:00:33.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.692+0000 7fc01e7fc640 1 --2- 172.21.15.53:0/2468007302 >> v2:172.21.15.53:3300/0 conn(0x7fc0200c82a0 0x7fc0200c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:33.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.692+0000 7fc01dffb640 1 -- 172.21.15.53:0/2468007302 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3252608339 0 0) 0x7fc02006b090 con 0x7fc0200c9fa0 2023-06-10T19:00:33.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.692+0000 7fc01f7fe640 1 --2- 172.21.15.53:0/2468007302 >> v2:172.21.15.117:3300/0 conn(0x7fc0200af760 0x7fc0200afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:33.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.692+0000 7fc01dffb640 1 -- 172.21.15.53:0/2468007302 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc008003530 con 0x7fc0200c9fa0 2023-06-10T19:00:33.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.692+0000 7fc01e7fc640 1 -- 172.21.15.53:0/2468007302 >> v2:172.21.15.117:3300/0 conn(0x7fc0200af760 msgr2=0x7fc0200afbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:33.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.692+0000 7fc01e7fc640 1 --2- 172.21.15.53:0/2468007302 >> v2:172.21.15.117:3300/0 conn(0x7fc0200af760 0x7fc0200afbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:33.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.692+0000 7fc01e7fc640 1 -- 172.21.15.53:0/2468007302 >> v1:172.21.15.53:6789/0 conn(0x7fc0200c9fa0 legacy=0x7fc02006bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:33.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.692+0000 7fc01e7fc640 1 -- 172.21.15.53:0/2468007302 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc020070d50 con 0x7fc0200c82a0 2023-06-10T19:00:33.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.692+0000 7fc01f7fe640 1 --2- 172.21.15.53:0/2468007302 >> v2:172.21.15.117:3300/0 conn(0x7fc0200af760 0x7fc0200afbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:00:33.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.696+0000 7fc01e7fc640 1 --2- 172.21.15.53:0/2468007302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0200c82a0 0x7fc0200c86f0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7fc02006fc20 tx=0x7fc01001c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd73269d300f9824 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:33.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.696+0000 7fc01dffb640 1 -- 172.21.15.53:0/2468007302 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0100ac600 con 0x7fc0200c82a0 2023-06-10T19:00:33.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.696+0000 7fc01dffb640 1 -- 172.21.15.53:0/2468007302 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0100a8050 con 0x7fc0200c82a0 2023-06-10T19:00:33.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.696+0000 7fc01dffb640 1 -- 172.21.15.53:0/2468007302 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0100ac980 con 0x7fc0200c82a0 2023-06-10T19:00:33.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.696+0000 7fc025506640 1 -- 172.21.15.53:0/2468007302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0200c82a0 msgr2=0x7fc0200c86f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:33.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.696+0000 7fc025506640 1 --2- 172.21.15.53:0/2468007302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0200c82a0 0x7fc0200c86f0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7fc02006fc20 tx=0x7fc01001c3a0 comp rx=0 tx=0).stop 2023-06-10T19:00:33.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.696+0000 7fc025506640 1 -- 172.21.15.53:0/2468007302 shutdown_connections 2023-06-10T19:00:33.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.696+0000 7fc025506640 1 --2- 172.21.15.53:0/2468007302 >> v2:172.21.15.117:3300/0 conn(0x7fc0200af760 0x7fc0200afbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:33.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.696+0000 7fc025506640 1 --2- 172.21.15.53:0/2468007302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0200c82a0 0x7fc0200c86f0 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:33.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.696+0000 7fc025506640 1 -- 172.21.15.53:0/2468007302 >> 172.21.15.53:0/2468007302 conn(0x7fc02006a0e0 msgr2=0x7fc0200cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:33.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.696+0000 7fc025506640 1 -- 172.21.15.53:0/2468007302 shutdown_connections 2023-06-10T19:00:33.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.696+0000 7fc025506640 1 -- 172.21.15.53:0/2468007302 wait complete. 2023-06-10T19:00:33.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.696+0000 7fc025506640 1 Processor -- start 2023-06-10T19:00:33.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.696+0000 7fc025506640 1 -- start start 2023-06-10T19:00:33.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.696+0000 7fc025506640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0200af760 0x7fc0200b1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:33.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.696+0000 7fc025506640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0200c82a0 0x7fc0200c2c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:33.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.696+0000 7fc025506640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0200c9fa0 0x7fc0200c31a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:33.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.696+0000 7fc025506640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0200cb8b0 con 0x7fc0200c9fa0 2023-06-10T19:00:33.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.696+0000 7fc025506640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0201f4690 con 0x7fc0200c82a0 2023-06-10T19:00:33.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.696+0000 7fc025506640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0201f4970 con 0x7fc0200af760 2023-06-10T19:00:33.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.696+0000 7fc01f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0200c9fa0 0x7fc0200c31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:33.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.696+0000 7fc01f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0200c9fa0 0x7fc0200c31a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44464/0 (socket says 172.21.15.53:44464) 2023-06-10T19:00:33.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.696+0000 7fc01f7fe640 1 -- 172.21.15.53:0/2354058757 learned_addr learned my addr 172.21.15.53:0/2354058757 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:33.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.700+0000 7fc01effd640 1 --2- 172.21.15.53:0/2354058757 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0200af760 0x7fc0200b1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:33.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.700+0000 7fc01e7fc640 1 --2- 172.21.15.53:0/2354058757 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0200c82a0 0x7fc0200c2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:33.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.700+0000 7fc01f7fe640 1 -- 172.21.15.53:0/2354058757 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0200af760 msgr2=0x7fc0200b1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:33.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.700+0000 7fc01f7fe640 1 --2- 172.21.15.53:0/2354058757 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0200af760 0x7fc0200b1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:33.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.700+0000 7fc01f7fe640 1 -- 172.21.15.53:0/2354058757 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0200c82a0 msgr2=0x7fc0200c2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:33.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.700+0000 7fc01f7fe640 1 --2- 172.21.15.53:0/2354058757 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0200c82a0 0x7fc0200c2c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:33.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.700+0000 7fc01f7fe640 1 -- 172.21.15.53:0/2354058757 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc010009420 con 0x7fc0200c9fa0 2023-06-10T19:00:33.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.700+0000 7fc01f7fe640 1 --2- 172.21.15.53:0/2354058757 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0200c9fa0 0x7fc0200c31a0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7fc01800cef0 tx=0x7fc01800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:33.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.700+0000 7fc0077fe640 1 -- 172.21.15.53:0/2354058757 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc01800d840 con 0x7fc0200c9fa0 2023-06-10T19:00:33.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.700+0000 7fc0077fe640 1 -- 172.21.15.53:0/2354058757 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc01800d9c0 con 0x7fc0200c9fa0 2023-06-10T19:00:33.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.700+0000 7fc0077fe640 1 -- 172.21.15.53:0/2354058757 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc01800dd70 con 0x7fc0200c9fa0 2023-06-10T19:00:33.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.700+0000 7fc025506640 1 -- 172.21.15.53:0/2354058757 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0201f4c50 con 0x7fc0200c9fa0 2023-06-10T19:00:33.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.700+0000 7fc025506640 1 -- 172.21.15.53:0/2354058757 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0200b24e0 con 0x7fc0200c9fa0 2023-06-10T19:00:33.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.700+0000 7fc025506640 1 -- 172.21.15.53:0/2354058757 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0200cba20 con 0x7fc0200c9fa0 2023-06-10T19:00:33.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.700+0000 7fc0077fe640 1 -- 172.21.15.53:0/2354058757 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc01801e3b0 con 0x7fc0200c9fa0 2023-06-10T19:00:33.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.700+0000 7fc0077fe640 1 --2- 172.21.15.53:0/2354058757 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc00c066250 0x7fc00c068700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:33.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.700+0000 7fc0077fe640 1 -- 172.21.15.53:0/2354058757 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc0180847e0 con 0x7fc0200c9fa0 2023-06-10T19:00:33.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.700+0000 7fc01effd640 1 --2- 172.21.15.53:0/2354058757 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc00c066250 0x7fc00c068700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:33.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.704+0000 7fc01effd640 1 --2- 172.21.15.53:0/2354058757 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc00c066250 0x7fc00c068700 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fc0140011f0 tx=0x7fc014009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:33.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.704+0000 7fc0077fe640 1 -- 172.21.15.53:0/2354058757 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc018051d10 con 0x7fc0200c9fa0 2023-06-10T19:00:33.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.856+0000 7fc025506640 1 -- 172.21.15.53:0/2354058757 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc02004d790 con 0x7fc0200c9fa0 2023-06-10T19:00:33.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.860+0000 7fc0077fe640 1 -- 172.21.15.53:0/2354058757 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v80) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc018055330 con 0x7fc0200c9fa0 2023-06-10T19:00:33.864 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-06-10T19:00:33.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.860+0000 7fc025506640 1 -- 172.21.15.53:0/2354058757 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc00c066250 msgr2=0x7fc00c068700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:33.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.860+0000 7fc025506640 1 --2- 172.21.15.53:0/2354058757 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc00c066250 0x7fc00c068700 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fc0140011f0 tx=0x7fc014009040 comp rx=0 tx=0).stop 2023-06-10T19:00:33.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.860+0000 7fc025506640 1 -- 172.21.15.53:0/2354058757 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0200c9fa0 msgr2=0x7fc0200c31a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:33.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.860+0000 7fc025506640 1 --2- 172.21.15.53:0/2354058757 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0200c9fa0 0x7fc0200c31a0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7fc01800cef0 tx=0x7fc01800a710 comp rx=0 tx=0).stop 2023-06-10T19:00:33.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.860+0000 7fc025506640 1 -- 172.21.15.53:0/2354058757 shutdown_connections 2023-06-10T19:00:33.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.860+0000 7fc025506640 1 --2- 172.21.15.53:0/2354058757 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc00c066250 0x7fc00c068700 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:33.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.860+0000 7fc025506640 1 --2- 172.21.15.53:0/2354058757 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0200c9fa0 0x7fc0200c31a0 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:33.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.860+0000 7fc025506640 1 --2- 172.21.15.53:0/2354058757 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0200c82a0 0x7fc0200c2c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:33.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.860+0000 7fc025506640 1 --2- 172.21.15.53:0/2354058757 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0200af760 0x7fc0200b1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:33.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.860+0000 7fc025506640 1 -- 172.21.15.53:0/2354058757 >> 172.21.15.53:0/2354058757 conn(0x7fc02006a0e0 msgr2=0x7fc0200b3130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:33.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.860+0000 7fc025506640 1 -- 172.21.15.53:0/2354058757 shutdown_connections 2023-06-10T19:00:33.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:33.860+0000 7fc025506640 1 -- 172.21.15.53:0/2354058757 wait complete. 2023-06-10T19:00:33.883 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-10T19:00:34.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.000+0000 7fc434ab6640 1 Processor -- start 2023-06-10T19:00:34.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.000+0000 7fc434ab6640 1 -- start start 2023-06-10T19:00:34.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.000+0000 7fc434ab6640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc43006b780 0x7fc43015c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:34.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.000+0000 7fc434ab6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4300ceb20 0x7fc4300cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:34.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.000+0000 7fc434ab6640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4300af530 con 0x7fc43006bb50 2023-06-10T19:00:34.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.000+0000 7fc434ab6640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc43015c3d0 con 0x7fc43006b780 2023-06-10T19:00:34.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.000+0000 7fc434ab6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc43015fd70 con 0x7fc4300ceb20 2023-06-10T19:00:34.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.000+0000 7fc42e59c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc43006b780 0x7fc43015c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:34.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.000+0000 7fc42e59c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc43006b780 0x7fc43015c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44476/0 (socket says 172.21.15.53:44476) 2023-06-10T19:00:34.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.000+0000 7fc42e59c640 1 -- 172.21.15.53:0/3057822334 learned_addr learned my addr 172.21.15.53:0/3057822334 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:34.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.000+0000 7fc42ed9d640 1 --2- 172.21.15.53:0/3057822334 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4300ceb20 0x7fc4300cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:34.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.000+0000 7fc42e59c640 1 -- 172.21.15.53:0/3057822334 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4300ceb20 msgr2=0x7fc4300cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:34.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.000+0000 7fc42e59c640 1 --2- 172.21.15.53:0/3057822334 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4300ceb20 0x7fc4300cefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:34.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.000+0000 7fc42e59c640 1 -- 172.21.15.53:0/3057822334 >> v1:172.21.15.117:6789/0 conn(0x7fc43006bb50 legacy=0x7fc43015f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:34.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.000+0000 7fc42e59c640 1 -- 172.21.15.53:0/3057822334 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc430160050 con 0x7fc43006b780 2023-06-10T19:00:34.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.004+0000 7fc42e59c640 1 --2- 172.21.15.53:0/3057822334 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc43006b780 0x7fc43015c7f0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7fc420009870 tx=0x7fc42001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e2068722ad2e448 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:34.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.004+0000 7fc42d59a640 1 -- 172.21.15.53:0/3057822334 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4200ab600 con 0x7fc43006b780 2023-06-10T19:00:34.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.004+0000 7fc42d59a640 1 -- 172.21.15.53:0/3057822334 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4200a7050 con 0x7fc43006b780 2023-06-10T19:00:34.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.004+0000 7fc42d59a640 1 -- 172.21.15.53:0/3057822334 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4200ab980 con 0x7fc43006b780 2023-06-10T19:00:34.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.004+0000 7fc434ab6640 1 -- 172.21.15.53:0/3057822334 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc43006b780 msgr2=0x7fc43015c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:34.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.004+0000 7fc434ab6640 1 --2- 172.21.15.53:0/3057822334 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc43006b780 0x7fc43015c7f0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7fc420009870 tx=0x7fc42001c470 comp rx=0 tx=0).stop 2023-06-10T19:00:34.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.004+0000 7fc434ab6640 1 -- 172.21.15.53:0/3057822334 shutdown_connections 2023-06-10T19:00:34.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.004+0000 7fc434ab6640 1 --2- 172.21.15.53:0/3057822334 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4300ceb20 0x7fc4300cefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:34.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.004+0000 7fc434ab6640 1 --2- 172.21.15.53:0/3057822334 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc43006b780 0x7fc43015c7f0 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:34.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.004+0000 7fc434ab6640 1 -- 172.21.15.53:0/3057822334 >> 172.21.15.53:0/3057822334 conn(0x7fc43006a0b0 msgr2=0x7fc43006d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:34.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.004+0000 7fc434ab6640 1 -- 172.21.15.53:0/3057822334 shutdown_connections 2023-06-10T19:00:34.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.004+0000 7fc434ab6640 1 -- 172.21.15.53:0/3057822334 wait complete. 2023-06-10T19:00:34.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.004+0000 7fc434ab6640 1 Processor -- start 2023-06-10T19:00:34.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.004+0000 7fc434ab6640 1 -- start start 2023-06-10T19:00:34.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.008+0000 7fc434ab6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc43006b780 0x7fc4300ca480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:34.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.008+0000 7fc434ab6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc43006bb50 0x7fc430156990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:34.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.008+0000 7fc434ab6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc4300ceb20 0x7fc4300cbfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:34.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.008+0000 7fc434ab6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4300c74d0 con 0x7fc4300ceb20 2023-06-10T19:00:34.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.008+0000 7fc434ab6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc430156ed0 con 0x7fc43006b780 2023-06-10T19:00:34.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.008+0000 7fc434ab6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4300cd300 con 0x7fc43006bb50 2023-06-10T19:00:34.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.008+0000 7fc42ed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc4300ceb20 0x7fc4300cbfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:34.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.008+0000 7fc42ed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc4300ceb20 0x7fc4300cbfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44490/0 (socket says 172.21.15.53:44490) 2023-06-10T19:00:34.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.008+0000 7fc42ed9d640 1 -- 172.21.15.53:0/3356857694 learned_addr learned my addr 172.21.15.53:0/3356857694 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:34.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.008+0000 7fc42dd9b640 1 --2- 172.21.15.53:0/3356857694 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc43006bb50 0x7fc430156990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:34.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.008+0000 7fc42e59c640 1 --2- 172.21.15.53:0/3356857694 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc43006b780 0x7fc4300ca480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:34.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.008+0000 7fc42ed9d640 1 -- 172.21.15.53:0/3356857694 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc43006bb50 msgr2=0x7fc430156990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:34.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.008+0000 7fc42ed9d640 1 --2- 172.21.15.53:0/3356857694 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc43006bb50 0x7fc430156990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:34.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.008+0000 7fc42ed9d640 1 -- 172.21.15.53:0/3356857694 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc43006b780 msgr2=0x7fc4300ca480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:34.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.008+0000 7fc42ed9d640 1 --2- 172.21.15.53:0/3356857694 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc43006b780 0x7fc4300ca480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:34.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.008+0000 7fc42ed9d640 1 -- 172.21.15.53:0/3356857694 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4200094d0 con 0x7fc4300ceb20 2023-06-10T19:00:34.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.008+0000 7fc42ed9d640 1 --2- 172.21.15.53:0/3356857694 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc4300ceb20 0x7fc4300cbfe0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7fc428007e40 tx=0x7fc42800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:34.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.008+0000 7fc41effd640 1 -- 172.21.15.53:0/3356857694 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc428014620 con 0x7fc4300ceb20 2023-06-10T19:00:34.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.008+0000 7fc434ab6640 1 -- 172.21.15.53:0/3356857694 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4300ccd40 con 0x7fc4300ceb20 2023-06-10T19:00:34.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.008+0000 7fc41effd640 1 -- 172.21.15.53:0/3356857694 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc42800ee90 con 0x7fc4300ceb20 2023-06-10T19:00:34.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.008+0000 7fc41effd640 1 -- 172.21.15.53:0/3356857694 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4280149e0 con 0x7fc4300ceb20 2023-06-10T19:00:34.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.008+0000 7fc434ab6640 1 -- 172.21.15.53:0/3356857694 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4300cab10 con 0x7fc4300ceb20 2023-06-10T19:00:34.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.008+0000 7fc434ab6640 1 -- 172.21.15.53:0/3356857694 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc43006bf80 con 0x7fc4300ceb20 2023-06-10T19:00:34.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.008+0000 7fc41effd640 1 -- 172.21.15.53:0/3356857694 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc428014b40 con 0x7fc4300ceb20 2023-06-10T19:00:34.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.008+0000 7fc41effd640 1 --2- 172.21.15.53:0/3356857694 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc410066280 0x7fc410068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:34.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.012+0000 7fc41effd640 1 -- 172.21.15.53:0/3356857694 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc428084600 con 0x7fc4300ceb20 2023-06-10T19:00:34.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.012+0000 7fc42e59c640 1 --2- 172.21.15.53:0/3356857694 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc410066280 0x7fc410068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:34.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.012+0000 7fc42e59c640 1 --2- 172.21.15.53:0/3356857694 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc410066280 0x7fc410068730 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fc4300cdad0 tx=0x7fc4200a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:34.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.016+0000 7fc41effd640 1 -- 172.21.15.53:0/3356857694 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc43006bf80 con 0x7fc4300ceb20 2023-06-10T19:00:34.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.180+0000 7fc434ab6640 1 -- 172.21.15.53:0/3356857694 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc4300c7610 con 0x7fc4300ceb20 2023-06-10T19:00:34.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.180+0000 7fc41effd640 1 -- 172.21.15.53:0/3356857694 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v80) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc4300c7610 con 0x7fc4300ceb20 2023-06-10T19:00:34.188 INFO:teuthology.orchestra.run.smithi053.stderr:listed 0 entries 2023-06-10T19:00:34.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.184+0000 7fc434ab6640 1 -- 172.21.15.53:0/3356857694 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc410066280 msgr2=0x7fc410068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:34.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.184+0000 7fc434ab6640 1 --2- 172.21.15.53:0/3356857694 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc410066280 0x7fc410068730 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fc4300cdad0 tx=0x7fc4200a6000 comp rx=0 tx=0).stop 2023-06-10T19:00:34.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.184+0000 7fc434ab6640 1 -- 172.21.15.53:0/3356857694 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc4300ceb20 msgr2=0x7fc4300cbfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:34.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.184+0000 7fc434ab6640 1 --2- 172.21.15.53:0/3356857694 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc4300ceb20 0x7fc4300cbfe0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7fc428007e40 tx=0x7fc42800e4b0 comp rx=0 tx=0).stop 2023-06-10T19:00:34.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.184+0000 7fc434ab6640 1 -- 172.21.15.53:0/3356857694 shutdown_connections 2023-06-10T19:00:34.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.184+0000 7fc434ab6640 1 --2- 172.21.15.53:0/3356857694 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc410066280 0x7fc410068730 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:34.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.184+0000 7fc434ab6640 1 --2- 172.21.15.53:0/3356857694 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc4300ceb20 0x7fc4300cbfe0 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:34.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.184+0000 7fc434ab6640 1 --2- 172.21.15.53:0/3356857694 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc43006bb50 0x7fc430156990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:34.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.184+0000 7fc434ab6640 1 --2- 172.21.15.53:0/3356857694 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc43006b780 0x7fc4300ca480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:34.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.184+0000 7fc434ab6640 1 -- 172.21.15.53:0/3356857694 >> 172.21.15.53:0/3356857694 conn(0x7fc43006a0b0 msgr2=0x7fc4300af750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:34.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.184+0000 7fc434ab6640 1 -- 172.21.15.53:0/3356857694 shutdown_connections 2023-06-10T19:00:34.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.184+0000 7fc434ab6640 1 -- 172.21.15.53:0/3356857694 wait complete. 2023-06-10T19:00:34.207 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T19:00:34.207 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:00:34.214 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:00:34.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.320+0000 7f39b761e640 1 Processor -- start 2023-06-10T19:00:34.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.324+0000 7f39b761e640 1 -- start start 2023-06-10T19:00:34.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.324+0000 7f39b761e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f39b00b3390 0x7f39b00af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:34.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.324+0000 7f39b761e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f39b006b090 0x7f39b006b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:34.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.324+0000 7f39b761e640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39b00b3760 con 0x7f39b0070e30 2023-06-10T19:00:34.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.324+0000 7f39b761e640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39b006ba50 con 0x7f39b006b090 2023-06-10T19:00:34.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.324+0000 7f39b761e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39b00c82f0 con 0x7f39b00b3390 2023-06-10T19:00:34.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.324+0000 7f39b5bbb640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f39b006b090 0x7f39b006b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:34.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.324+0000 7f39b5bbb640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f39b006b090 0x7f39b006b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44506/0 (socket says 172.21.15.53:44506) 2023-06-10T19:00:34.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.324+0000 7f39b5bbb640 1 -- 172.21.15.53:0/2069666257 learned_addr learned my addr 172.21.15.53:0/2069666257 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:34.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.324+0000 7f39b4bb9640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f39b0070e30 0x7f39b00c8d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60056/0 (socket says 172.21.15.53:60056) 2023-06-10T19:00:34.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.324+0000 7f39b53ba640 1 --2- 172.21.15.53:0/2069666257 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f39b00b3390 0x7f39b00af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:34.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.324+0000 7f39b5bbb640 1 -- 172.21.15.53:0/2069666257 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f39b00b3390 msgr2=0x7f39b00af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:34.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.324+0000 7f39b5bbb640 1 --2- 172.21.15.53:0/2069666257 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f39b00b3390 0x7f39b00af720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:34.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.324+0000 7f39b5bbb640 1 -- 172.21.15.53:0/2069666257 >> v1:172.21.15.53:6789/0 conn(0x7f39b0070e30 legacy=0x7f39b00c8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:34.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.324+0000 7f39b5bbb640 1 -- 172.21.15.53:0/2069666257 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39b0071280 con 0x7f39b006b090 2023-06-10T19:00:34.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.324+0000 7f39a7fff640 1 -- 172.21.15.53:0/2069666257 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3837262585 0 0) 0x7f39b00b3760 con 0x7f39b0070e30 2023-06-10T19:00:34.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.324+0000 7f39b5bbb640 1 --2- 172.21.15.53:0/2069666257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f39b006b090 0x7f39b006b510 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f39a8009e50 tx=0x7f39a801ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf8766f7c6d8110d server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:34.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.324+0000 7f39a7fff640 1 -- 172.21.15.53:0/2069666257 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a80a58e0 con 0x7f39b006b090 2023-06-10T19:00:34.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.324+0000 7f39a7fff640 1 -- 172.21.15.53:0/2069666257 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39a80a5a40 con 0x7f39b006b090 2023-06-10T19:00:34.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.324+0000 7f39a7fff640 1 -- 172.21.15.53:0/2069666257 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a80a5dd0 con 0x7f39b006b090 2023-06-10T19:00:34.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.328+0000 7f39b761e640 1 -- 172.21.15.53:0/2069666257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f39b006b090 msgr2=0x7f39b006b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:34.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.328+0000 7f39b761e640 1 --2- 172.21.15.53:0/2069666257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f39b006b090 0x7f39b006b510 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f39a8009e50 tx=0x7f39a801ca10 comp rx=0 tx=0).stop 2023-06-10T19:00:34.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.328+0000 7f39b761e640 1 -- 172.21.15.53:0/2069666257 shutdown_connections 2023-06-10T19:00:34.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.328+0000 7f39b761e640 1 --2- 172.21.15.53:0/2069666257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f39b006b090 0x7f39b006b510 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:34.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.328+0000 7f39b761e640 1 --2- 172.21.15.53:0/2069666257 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f39b00b3390 0x7f39b00af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:34.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.328+0000 7f39b761e640 1 -- 172.21.15.53:0/2069666257 >> 172.21.15.53:0/2069666257 conn(0x7f39b006a0d0 msgr2=0x7f39b00ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:34.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.328+0000 7f39b761e640 1 -- 172.21.15.53:0/2069666257 shutdown_connections 2023-06-10T19:00:34.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.328+0000 7f39b761e640 1 -- 172.21.15.53:0/2069666257 wait complete. 2023-06-10T19:00:34.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.328+0000 7f39b761e640 1 Processor -- start 2023-06-10T19:00:34.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.328+0000 7f39b761e640 1 -- start start 2023-06-10T19:00:34.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.328+0000 7f39b761e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f39b006b090 0x7f39b014b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:34.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.328+0000 7f39b761e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39b0070e30 0x7f39b0156ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:34.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.328+0000 7f39b761e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f39b00b3390 0x7f39b00c56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:34.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.328+0000 7f39b761e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39b0158bc0 con 0x7f39b00b3390 2023-06-10T19:00:34.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.328+0000 7f39b761e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39b0158ea0 con 0x7f39b0070e30 2023-06-10T19:00:34.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.328+0000 7f39b761e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39b0159180 con 0x7f39b006b090 2023-06-10T19:00:34.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.328+0000 7f39b5bbb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f39b00b3390 0x7f39b00c56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:34.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.328+0000 7f39b5bbb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f39b00b3390 0x7f39b00c56d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44520/0 (socket says 172.21.15.53:44520) 2023-06-10T19:00:34.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.328+0000 7f39b5bbb640 1 -- 172.21.15.53:0/1385158950 learned_addr learned my addr 172.21.15.53:0/1385158950 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:34.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.328+0000 7f39b4bb9640 1 --2- 172.21.15.53:0/1385158950 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39b0070e30 0x7f39b0156ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:34.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.328+0000 7f39b53ba640 1 --2- 172.21.15.53:0/1385158950 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f39b006b090 0x7f39b014b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:34.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.328+0000 7f39b5bbb640 1 -- 172.21.15.53:0/1385158950 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f39b006b090 msgr2=0x7f39b014b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:34.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.328+0000 7f39b5bbb640 1 --2- 172.21.15.53:0/1385158950 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f39b006b090 0x7f39b014b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:34.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.328+0000 7f39b5bbb640 1 -- 172.21.15.53:0/1385158950 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39b0070e30 msgr2=0x7f39b0156ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:34.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.328+0000 7f39b5bbb640 1 --2- 172.21.15.53:0/1385158950 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39b0070e30 0x7f39b0156ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:34.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.328+0000 7f39b5bbb640 1 -- 172.21.15.53:0/1385158950 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39a8009b30 con 0x7f39b00b3390 2023-06-10T19:00:34.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.328+0000 7f39b4bb9640 1 --2- 172.21.15.53:0/1385158950 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39b0070e30 0x7f39b0156ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:00:34.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.328+0000 7f39b53ba640 1 --2- 172.21.15.53:0/1385158950 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f39b006b090 0x7f39b014b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:00:34.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.328+0000 7f39b5bbb640 1 --2- 172.21.15.53:0/1385158950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f39b00b3390 0x7f39b00c56d0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f39a8009e50 tx=0x7f39a80197b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:34.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.328+0000 7f39a5ffb640 1 -- 172.21.15.53:0/1385158950 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a80b8880 con 0x7f39b00b3390 2023-06-10T19:00:34.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.328+0000 7f39a5ffb640 1 -- 172.21.15.53:0/1385158950 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39a80b89e0 con 0x7f39b00b3390 2023-06-10T19:00:34.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.328+0000 7f39a5ffb640 1 -- 172.21.15.53:0/1385158950 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a80b8d70 con 0x7f39b00b3390 2023-06-10T19:00:34.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.328+0000 7f39b761e640 1 -- 172.21.15.53:0/1385158950 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39b0159460 con 0x7f39b00b3390 2023-06-10T19:00:34.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.328+0000 7f39b761e640 1 -- 172.21.15.53:0/1385158950 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39b014ba40 con 0x7f39b00b3390 2023-06-10T19:00:34.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.328+0000 7f39b761e640 1 -- 172.21.15.53:0/1385158950 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39b014bd50 con 0x7f39b00b3390 2023-06-10T19:00:34.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.332+0000 7f39a5ffb640 1 -- 172.21.15.53:0/1385158950 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f39a80b6440 con 0x7f39b00b3390 2023-06-10T19:00:34.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.332+0000 7f39a5ffb640 1 --2- 172.21.15.53:0/1385158950 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f39940662b0 0x7f3994068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:34.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.332+0000 7f39a5ffb640 1 -- 172.21.15.53:0/1385158950 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f39a811e730 con 0x7f39b00b3390 2023-06-10T19:00:34.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.332+0000 7f39b53ba640 1 --2- 172.21.15.53:0/1385158950 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f39940662b0 0x7f3994068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:34.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.332+0000 7f39b53ba640 1 --2- 172.21.15.53:0/1385158950 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f39940662b0 0x7f3994068760 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f39ac006fd0 tx=0x7f39ac008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:34.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.336+0000 7f39a5ffb640 1 -- 172.21.15.53:0/1385158950 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f39b014bd50 con 0x7f39b00b3390 2023-06-10T19:00:34.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.488+0000 7f39b761e640 1 -- 172.21.15.53:0/1385158950 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f39b014bd50 con 0x7f39b00b3390 2023-06-10T19:00:34.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.492+0000 7f39a5ffb640 1 -- 172.21.15.53:0/1385158950 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+18342 (secure 0 0 0) 0x7f39b014bd50 con 0x7f39b00b3390 2023-06-10T19:00:34.497 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:00:34.498 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":80,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:00:21.610926+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-06-10T19:00:19.188303+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-06-10T19:00:19.583756+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:00:34.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.492+0000 7f39b761e640 1 -- 172.21.15.53:0/1385158950 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f39940662b0 msgr2=0x7f3994068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:34.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.492+0000 7f39b761e640 1 --2- 172.21.15.53:0/1385158950 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f39940662b0 0x7f3994068760 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f39ac006fd0 tx=0x7f39ac008040 comp rx=0 tx=0).stop 2023-06-10T19:00:34.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.492+0000 7f39b761e640 1 -- 172.21.15.53:0/1385158950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f39b00b3390 msgr2=0x7f39b00c56d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:34.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.492+0000 7f39b761e640 1 --2- 172.21.15.53:0/1385158950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f39b00b3390 0x7f39b00c56d0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f39a8009e50 tx=0x7f39a80197b0 comp rx=0 tx=0).stop 2023-06-10T19:00:34.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.492+0000 7f39b761e640 1 -- 172.21.15.53:0/1385158950 shutdown_connections 2023-06-10T19:00:34.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.492+0000 7f39b761e640 1 --2- 172.21.15.53:0/1385158950 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f39940662b0 0x7f3994068760 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:34.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.492+0000 7f39b761e640 1 --2- 172.21.15.53:0/1385158950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f39b00b3390 0x7f39b00c56d0 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:34.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.492+0000 7f39b761e640 1 --2- 172.21.15.53:0/1385158950 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39b0070e30 0x7f39b0156ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:34.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.492+0000 7f39b761e640 1 --2- 172.21.15.53:0/1385158950 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f39b006b090 0x7f39b014b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:34.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.492+0000 7f39b761e640 1 -- 172.21.15.53:0/1385158950 >> 172.21.15.53:0/1385158950 conn(0x7f39b006a0d0 msgr2=0x7f39b00c8d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:34.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.492+0000 7f39b761e640 1 -- 172.21.15.53:0/1385158950 shutdown_connections 2023-06-10T19:00:34.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.492+0000 7f39b761e640 1 -- 172.21.15.53:0/1385158950 wait complete. 2023-06-10T19:00:34.516 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-10T18:52:33.633114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-10T18:52:39.171487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-10T19:00:19.188303+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2023-06-10T19:00:19.583756+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-10T19:00:34.517 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-10T19:00:34.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.648+0000 7fe490ae9640 1 Processor -- start 2023-06-10T19:00:34.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.648+0000 7fe490ae9640 1 -- start start 2023-06-10T19:00:34.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.648+0000 7fe490ae9640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe48c0afe70 0x7fe48c0c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:34.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.648+0000 7fe490ae9640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe48c06b090 con 0x7fe48c0c9fa0 2023-06-10T19:00:34.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.648+0000 7fe490ae9640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe48c0ca370 con 0x7fe48c0c82a0 2023-06-10T19:00:34.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.648+0000 7fe490ae9640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe48c070d50 con 0x7fe48c0afe70 2023-06-10T19:00:34.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.648+0000 7fe48ad9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe48c0afe70 0x7fe48c0c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:34.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.648+0000 7fe48a59c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fe48c0c9fa0 0x7fe48c06bae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60070/0 (socket says 172.21.15.53:60070) 2023-06-10T19:00:34.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.648+0000 7fe48a59c640 1 -- 172.21.15.53:0/3505065475 learned_addr learned my addr 172.21.15.53:0/3505065475 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:00:34.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.648+0000 7fe48959a640 1 -- 172.21.15.53:0/3505065475 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2162220328 0 0) 0x7fe48c06b090 con 0x7fe48c0c9fa0 2023-06-10T19:00:34.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.648+0000 7fe48959a640 1 -- 172.21.15.53:0/3505065475 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe474003530 con 0x7fe48c0c9fa0 2023-06-10T19:00:34.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.648+0000 7fe48ad9d640 1 -- 172.21.15.53:0/3505065475 >> v1:172.21.15.117:6789/0 conn(0x7fe48c0c82a0 legacy=0x7fe48c0af760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:34.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.648+0000 7fe48ad9d640 1 -- 172.21.15.53:0/3505065475 >> v1:172.21.15.53:6789/0 conn(0x7fe48c0c9fa0 legacy=0x7fe48c06bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:34.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.648+0000 7fe48ad9d640 1 -- 172.21.15.53:0/3505065475 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe48c071030 con 0x7fe48c0afe70 2023-06-10T19:00:34.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.652+0000 7fe48ad9d640 1 --2- 172.21.15.53:0/3505065475 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe48c0afe70 0x7fe48c0c86f0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7fe484009d90 tx=0x7fe48401c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7407cfc38994d846 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:34.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.652+0000 7fe48959a640 1 -- 172.21.15.53:0/3505065475 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4840a5910 con 0x7fe48c0afe70 2023-06-10T19:00:34.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.652+0000 7fe48959a640 1 -- 172.21.15.53:0/3505065475 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4840a5a70 con 0x7fe48c0afe70 2023-06-10T19:00:34.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.652+0000 7fe48959a640 1 -- 172.21.15.53:0/3505065475 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4840a5de0 con 0x7fe48c0afe70 2023-06-10T19:00:34.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.652+0000 7fe490ae9640 1 -- 172.21.15.53:0/3505065475 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe48c0afe70 msgr2=0x7fe48c0c86f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:34.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.652+0000 7fe490ae9640 1 --2- 172.21.15.53:0/3505065475 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe48c0afe70 0x7fe48c0c86f0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7fe484009d90 tx=0x7fe48401c850 comp rx=0 tx=0).stop 2023-06-10T19:00:34.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.652+0000 7fe490ae9640 1 -- 172.21.15.53:0/3505065475 shutdown_connections 2023-06-10T19:00:34.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.652+0000 7fe490ae9640 1 --2- 172.21.15.53:0/3505065475 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe48c0afe70 0x7fe48c0c86f0 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:34.660 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.652+0000 7fe490ae9640 1 -- 172.21.15.53:0/3505065475 >> 172.21.15.53:0/3505065475 conn(0x7fe48c06a0e0 msgr2=0x7fe48c0cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:34.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.652+0000 7fe490ae9640 1 -- 172.21.15.53:0/3505065475 shutdown_connections 2023-06-10T19:00:34.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.652+0000 7fe490ae9640 1 -- 172.21.15.53:0/3505065475 wait complete. 2023-06-10T19:00:34.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.652+0000 7fe490ae9640 1 Processor -- start 2023-06-10T19:00:34.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.652+0000 7fe490ae9640 1 -- start start 2023-06-10T19:00:34.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.652+0000 7fe490ae9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe48c0afe70 0x7fe48c150e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:34.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.652+0000 7fe490ae9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe48c0c82a0 0x7fe48c0c3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:34.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.652+0000 7fe490ae9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe48c0c9fa0 0x7fe48c0c42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:34.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.656+0000 7fe490ae9640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe48c0c2090 con 0x7fe48c0c9fa0 2023-06-10T19:00:34.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.656+0000 7fe490ae9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe48c0c47f0 con 0x7fe48c0afe70 2023-06-10T19:00:34.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.656+0000 7fe490ae9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe48c0c28f0 con 0x7fe48c0c82a0 2023-06-10T19:00:34.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.656+0000 7fe48ad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe48c0c9fa0 0x7fe48c0c42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:34.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.656+0000 7fe48ad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe48c0c9fa0 0x7fe48c0c42b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44526/0 (socket says 172.21.15.53:44526) 2023-06-10T19:00:34.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.656+0000 7fe48ad9d640 1 -- 172.21.15.53:0/1137395157 learned_addr learned my addr 172.21.15.53:0/1137395157 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:34.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.656+0000 7fe48a59c640 1 --2- 172.21.15.53:0/1137395157 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe48c0afe70 0x7fe48c150e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:34.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.656+0000 7fe489d9b640 1 --2- 172.21.15.53:0/1137395157 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe48c0c82a0 0x7fe48c0c3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:34.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.656+0000 7fe48ad9d640 1 -- 172.21.15.53:0/1137395157 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe48c0c82a0 msgr2=0x7fe48c0c3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:34.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.656+0000 7fe48ad9d640 1 --2- 172.21.15.53:0/1137395157 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe48c0c82a0 0x7fe48c0c3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:34.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.656+0000 7fe48ad9d640 1 -- 172.21.15.53:0/1137395157 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe48c0afe70 msgr2=0x7fe48c150e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:34.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.656+0000 7fe48ad9d640 1 --2- 172.21.15.53:0/1137395157 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe48c0afe70 0x7fe48c150e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:34.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.656+0000 7fe48ad9d640 1 -- 172.21.15.53:0/1137395157 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe484009a70 con 0x7fe48c0c9fa0 2023-06-10T19:00:34.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.656+0000 7fe489d9b640 1 --2- 172.21.15.53:0/1137395157 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe48c0c82a0 0x7fe48c0c3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:00:34.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.656+0000 7fe48ad9d640 1 --2- 172.21.15.53:0/1137395157 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe48c0c9fa0 0x7fe48c0c42b0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fe484019460 tx=0x7fe4840195f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:34.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.656+0000 7fe47affd640 1 -- 172.21.15.53:0/1137395157 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4840a5910 con 0x7fe48c0c9fa0 2023-06-10T19:00:34.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.656+0000 7fe47affd640 1 -- 172.21.15.53:0/1137395157 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe484003db0 con 0x7fe48c0c9fa0 2023-06-10T19:00:34.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.656+0000 7fe490ae9640 1 -- 172.21.15.53:0/1137395157 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe48c154a70 con 0x7fe48c0c9fa0 2023-06-10T19:00:34.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.656+0000 7fe47affd640 1 -- 172.21.15.53:0/1137395157 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe484004240 con 0x7fe48c0c9fa0 2023-06-10T19:00:34.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.656+0000 7fe490ae9640 1 -- 172.21.15.53:0/1137395157 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe48c0c2580 con 0x7fe48c0c9fa0 2023-06-10T19:00:34.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.656+0000 7fe490ae9640 1 -- 172.21.15.53:0/1137395157 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe48c04d790 con 0x7fe48c0c9fa0 2023-06-10T19:00:34.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.656+0000 7fe47affd640 1 -- 172.21.15.53:0/1137395157 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe4840b4070 con 0x7fe48c0c9fa0 2023-06-10T19:00:34.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.656+0000 7fe47affd640 1 --2- 172.21.15.53:0/1137395157 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe46c0662b0 0x7fe46c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:34.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.656+0000 7fe47affd640 1 -- 172.21.15.53:0/1137395157 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe48411e930 con 0x7fe48c0c9fa0 2023-06-10T19:00:34.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.656+0000 7fe48a59c640 1 --2- 172.21.15.53:0/1137395157 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe46c0662b0 0x7fe46c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:34.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.656+0000 7fe48a59c640 1 --2- 172.21.15.53:0/1137395157 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe46c0662b0 0x7fe46c068760 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fe47c005890 tx=0x7fe47c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:34.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.660+0000 7fe47affd640 1 -- 172.21.15.53:0/1137395157 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe4840ebf40 con 0x7fe48c0c9fa0 2023-06-10T19:00:34.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.816+0000 7fe490ae9640 1 -- 172.21.15.53:0/1137395157 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe48c157c40 con 0x7fe48c0c9fa0 2023-06-10T19:00:34.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.816+0000 7fe47affd640 1 -- 172.21.15.53:0/1137395157 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v80) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe4840b2020 con 0x7fe48c0c9fa0 2023-06-10T19:00:34.823 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-06-10T19:00:34.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.820+0000 7fe490ae9640 1 -- 172.21.15.53:0/1137395157 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe46c0662b0 msgr2=0x7fe46c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:34.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.820+0000 7fe490ae9640 1 --2- 172.21.15.53:0/1137395157 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe46c0662b0 0x7fe46c068760 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fe47c005890 tx=0x7fe47c009040 comp rx=0 tx=0).stop 2023-06-10T19:00:34.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.820+0000 7fe490ae9640 1 -- 172.21.15.53:0/1137395157 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe48c0c9fa0 msgr2=0x7fe48c0c42b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:34.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.820+0000 7fe490ae9640 1 --2- 172.21.15.53:0/1137395157 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe48c0c9fa0 0x7fe48c0c42b0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fe484019460 tx=0x7fe4840195f0 comp rx=0 tx=0).stop 2023-06-10T19:00:34.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.820+0000 7fe490ae9640 1 -- 172.21.15.53:0/1137395157 shutdown_connections 2023-06-10T19:00:34.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.820+0000 7fe490ae9640 1 --2- 172.21.15.53:0/1137395157 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe46c0662b0 0x7fe46c068760 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:34.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.820+0000 7fe490ae9640 1 --2- 172.21.15.53:0/1137395157 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe48c0c9fa0 0x7fe48c0c42b0 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:34.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.820+0000 7fe490ae9640 1 --2- 172.21.15.53:0/1137395157 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe48c0c82a0 0x7fe48c0c3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:34.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.820+0000 7fe490ae9640 1 --2- 172.21.15.53:0/1137395157 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe48c0afe70 0x7fe48c150e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:34.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.820+0000 7fe490ae9640 1 -- 172.21.15.53:0/1137395157 >> 172.21.15.53:0/1137395157 conn(0x7fe48c06a0e0 msgr2=0x7fe48c154e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:34.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.820+0000 7fe490ae9640 1 -- 172.21.15.53:0/1137395157 shutdown_connections 2023-06-10T19:00:34.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.820+0000 7fe490ae9640 1 -- 172.21.15.53:0/1137395157 wait complete. 2023-06-10T19:00:34.842 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-10T19:00:34.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.956+0000 7fce5a8b3640 1 Processor -- start 2023-06-10T19:00:34.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.956+0000 7fce5a8b3640 1 -- start start 2023-06-10T19:00:34.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.956+0000 7fce5a8b3640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fce540b0b90 0x7fce540b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:34.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.956+0000 7fce5a8b3640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce540cc7c0 con 0x7fce540b7e30 2023-06-10T19:00:34.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.956+0000 7fce5a8b3640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce540ccaa0 con 0x7fce5415c090 2023-06-10T19:00:34.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.956+0000 7fce5a8b3640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce540ccd80 con 0x7fce540b0b90 2023-06-10T19:00:34.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.956+0000 7fce537fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fce540b7e30 0x7fce540d04d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60084/0 (socket says 172.21.15.53:60084) 2023-06-10T19:00:34.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.956+0000 7fce537fe640 1 -- 172.21.15.53:0/2444553549 learned_addr learned my addr 172.21.15.53:0/2444553549 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:00:34.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.956+0000 7fce58e50640 1 --2- 172.21.15.53:0/2444553549 >> v2:172.21.15.117:3300/0 conn(0x7fce540b0b90 0x7fce540b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:34.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.956+0000 7fce52ffd640 1 -- 172.21.15.53:0/2444553549 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 765317316 0 0) 0x7fce540cc7c0 con 0x7fce540b7e30 2023-06-10T19:00:34.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.956+0000 7fce52ffd640 1 -- 172.21.15.53:0/2444553549 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce3c003530 con 0x7fce540b7e30 2023-06-10T19:00:34.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.960+0000 7fce52ffd640 1 -- 172.21.15.53:0/2444553549 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2355373905 0 0) 0x7fce3c003530 con 0x7fce540b7e30 2023-06-10T19:00:34.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.960+0000 7fce52ffd640 1 -- 172.21.15.53:0/2444553549 >> v2:172.21.15.117:3300/0 conn(0x7fce540b0b90 msgr2=0x7fce540b10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:34.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.960+0000 7fce52ffd640 1 --2- 172.21.15.53:0/2444553549 >> v2:172.21.15.117:3300/0 conn(0x7fce540b0b90 0x7fce540b10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:34.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.960+0000 7fce52ffd640 1 -- 172.21.15.53:0/2444553549 >> v1:172.21.15.117:6789/0 conn(0x7fce5415c090 legacy=0x7fce540b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:34.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.960+0000 7fce52ffd640 1 -- 172.21.15.53:0/2444553549 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce540cd060 con 0x7fce540b7e30 2023-06-10T19:00:34.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.960+0000 7fce52ffd640 1 -- 172.21.15.53:0/2444553549 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fce48001680 con 0x7fce540b7e30 2023-06-10T19:00:34.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.960+0000 7fce52ffd640 1 -- 172.21.15.53:0/2444553549 >> v1:172.21.15.53:6789/0 conn(0x7fce540b7e30 legacy=0x7fce540d04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:34.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.960+0000 7fce52ffd640 1 --2- 172.21.15.53:0/2444553549 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce3c003980 0x7fce3c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:34.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.960+0000 7fce52ffd640 1 --2- 172.21.15.53:0/2444553549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce3c0047d0 0x7fce3c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:34.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.960+0000 7fce52ffd640 1 --2- 172.21.15.53:0/2444553549 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce3c005180 0x7fce3c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:34.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.960+0000 7fce52ffd640 1 -- 172.21.15.53:0/2444553549 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce540ccd80 con 0x7fce3c0047d0 2023-06-10T19:00:34.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.960+0000 7fce52ffd640 1 -- 172.21.15.53:0/2444553549 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce3c00c090 con 0x7fce3c003980 2023-06-10T19:00:34.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.960+0000 7fce52ffd640 1 -- 172.21.15.53:0/2444553549 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce3c00c250 con 0x7fce3c005180 2023-06-10T19:00:34.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.960+0000 7fce537fe640 1 --2- 172.21.15.53:0/2444553549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce3c0047d0 0x7fce3c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:34.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.960+0000 7fce53fff640 1 --2- 172.21.15.53:0/2444553549 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce3c003980 0x7fce3c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:34.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.960+0000 7fce58e50640 1 --2- 172.21.15.53:0/2444553549 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce3c005180 0x7fce3c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:34.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.960+0000 7fce537fe640 1 -- 172.21.15.53:0/2444553549 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce3c005180 msgr2=0x7fce3c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:34.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.960+0000 7fce537fe640 1 --2- 172.21.15.53:0/2444553549 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce3c005180 0x7fce3c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:34.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.960+0000 7fce537fe640 1 -- 172.21.15.53:0/2444553549 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce3c003980 msgr2=0x7fce3c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:34.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.960+0000 7fce537fe640 1 --2- 172.21.15.53:0/2444553549 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce3c003980 0x7fce3c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:34.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.960+0000 7fce537fe640 1 -- 172.21.15.53:0/2444553549 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce3c003530 con 0x7fce3c0047d0 2023-06-10T19:00:34.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.960+0000 7fce58e50640 1 --2- 172.21.15.53:0/2444553549 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce3c005180 0x7fce3c00b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:00:34.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.960+0000 7fce58e50640 1 -- 172.21.15.53:0/2444553549 reap_dead start 2023-06-10T19:00:34.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.960+0000 7fce537fe640 1 --2- 172.21.15.53:0/2444553549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce3c0047d0 0x7fce3c004c40 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fce4800c240 tx=0x7fce4801cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdbafa3d061d6308 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:34.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.960+0000 7fce52ffd640 1 -- 172.21.15.53:0/2444553549 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce48005ae0 con 0x7fce3c0047d0 2023-06-10T19:00:34.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.960+0000 7fce52ffd640 1 -- 172.21.15.53:0/2444553549 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce48005c40 con 0x7fce3c0047d0 2023-06-10T19:00:34.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.960+0000 7fce52ffd640 1 -- 172.21.15.53:0/2444553549 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce480072b0 con 0x7fce3c0047d0 2023-06-10T19:00:34.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.960+0000 7fce5a8b3640 1 -- 172.21.15.53:0/2444553549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce3c0047d0 msgr2=0x7fce3c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:34.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.960+0000 7fce5a8b3640 1 --2- 172.21.15.53:0/2444553549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce3c0047d0 0x7fce3c004c40 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fce4800c240 tx=0x7fce4801cb50 comp rx=0 tx=0).stop 2023-06-10T19:00:34.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.960+0000 7fce5a8b3640 1 -- 172.21.15.53:0/2444553549 shutdown_connections 2023-06-10T19:00:34.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.960+0000 7fce5a8b3640 1 --2- 172.21.15.53:0/2444553549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce3c0047d0 0x7fce3c004c40 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:34.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.960+0000 7fce5a8b3640 1 -- 172.21.15.53:0/2444553549 >> 172.21.15.53:0/2444553549 conn(0x7fce54069e20 msgr2=0x7fce5406a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:34.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.960+0000 7fce5a8b3640 1 -- 172.21.15.53:0/2444553549 shutdown_connections 2023-06-10T19:00:34.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.960+0000 7fce5a8b3640 1 -- 172.21.15.53:0/2444553549 wait complete. 2023-06-10T19:00:34.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.964+0000 7fce5a8b3640 1 Processor -- start 2023-06-10T19:00:34.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.964+0000 7fce5a8b3640 1 -- start start 2023-06-10T19:00:34.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.964+0000 7fce5a8b3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce3c0047d0 0x7fce5414e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:34.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.964+0000 7fce5a8b3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce540cb760 0x7fce540cbbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:34.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.964+0000 7fce5a8b3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce54158f80 0x7fce541593f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:34.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.964+0000 7fce5a8b3640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce540ca9a0 con 0x7fce3c0047d0 2023-06-10T19:00:34.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.964+0000 7fce5a8b3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce540cac80 con 0x7fce540cb760 2023-06-10T19:00:34.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.964+0000 7fce5a8b3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce540caf60 con 0x7fce54158f80 2023-06-10T19:00:34.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.964+0000 7fce53fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce3c0047d0 0x7fce5414e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:34.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.964+0000 7fce58e50640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce54158f80 0x7fce541593f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:34.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.964+0000 7fce58e50640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce54158f80 0x7fce541593f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.53:49596/0 (socket says 172.21.15.53:49596) 2023-06-10T19:00:34.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.964+0000 7fce58e50640 1 -- 172.21.15.53:0/3085252047 learned_addr learned my addr 172.21.15.53:0/3085252047 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:34.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.964+0000 7fce537fe640 1 --2- 172.21.15.53:0/3085252047 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce540cb760 0x7fce540cbbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:34.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.964+0000 7fce53fff640 1 -- 172.21.15.53:0/3085252047 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce54158f80 msgr2=0x7fce541593f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:34.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.964+0000 7fce53fff640 1 --2- 172.21.15.53:0/3085252047 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce54158f80 0x7fce541593f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:34.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.964+0000 7fce53fff640 1 -- 172.21.15.53:0/3085252047 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce540cb760 msgr2=0x7fce540cbbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:34.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.964+0000 7fce53fff640 1 --2- 172.21.15.53:0/3085252047 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce540cb760 0x7fce540cbbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:34.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.964+0000 7fce53fff640 1 -- 172.21.15.53:0/3085252047 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce540cb240 con 0x7fce3c0047d0 2023-06-10T19:00:34.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.964+0000 7fce53fff640 1 --2- 172.21.15.53:0/3085252047 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce3c0047d0 0x7fce5414e570 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7fce4400e440 tx=0x7fce4400e900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:34.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.964+0000 7fce50ff9640 1 -- 172.21.15.53:0/3085252047 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce440052e0 con 0x7fce3c0047d0 2023-06-10T19:00:34.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.964+0000 7fce50ff9640 1 -- 172.21.15.53:0/3085252047 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce44005440 con 0x7fce3c0047d0 2023-06-10T19:00:34.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.964+0000 7fce5a8b3640 1 -- 172.21.15.53:0/3085252047 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce5414eab0 con 0x7fce3c0047d0 2023-06-10T19:00:34.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.964+0000 7fce50ff9640 1 -- 172.21.15.53:0/3085252047 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce44003820 con 0x7fce3c0047d0 2023-06-10T19:00:34.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.964+0000 7fce5a8b3640 1 -- 172.21.15.53:0/3085252047 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce5415e7b0 con 0x7fce3c0047d0 2023-06-10T19:00:34.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.964+0000 7fce5a8b3640 1 -- 172.21.15.53:0/3085252047 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce540cb3d0 con 0x7fce3c0047d0 2023-06-10T19:00:34.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.964+0000 7fce50ff9640 1 -- 172.21.15.53:0/3085252047 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fce44003980 con 0x7fce3c0047d0 2023-06-10T19:00:34.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.968+0000 7fce50ff9640 1 --2- 172.21.15.53:0/3085252047 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fce400662b0 0x7fce40068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:34.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.968+0000 7fce50ff9640 1 -- 172.21.15.53:0/3085252047 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fce44083180 con 0x7fce3c0047d0 2023-06-10T19:00:34.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.968+0000 7fce537fe640 1 --2- 172.21.15.53:0/3085252047 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fce400662b0 0x7fce40068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:34.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.968+0000 7fce537fe640 1 --2- 172.21.15.53:0/3085252047 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fce400662b0 0x7fce40068760 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fce480ab000 tx=0x7fce480b1040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:34.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:34.972+0000 7fce50ff9640 1 -- 172.21.15.53:0/3085252047 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fce44050740 con 0x7fce3c0047d0 2023-06-10T19:00:35.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.120+0000 7fce5a8b3640 1 -- 172.21.15.53:0/3085252047 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fce540caae0 con 0x7fce3c0047d0 2023-06-10T19:00:35.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.120+0000 7fce50ff9640 1 -- 172.21.15.53:0/3085252047 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v80) v1 ==== 92+0+10 (secure 0 0 0) 0x7fce540caae0 con 0x7fce3c0047d0 2023-06-10T19:00:35.125 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-06-10T19:00:35.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.120+0000 7fce5a8b3640 1 -- 172.21.15.53:0/3085252047 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fce400662b0 msgr2=0x7fce40068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:35.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.120+0000 7fce5a8b3640 1 --2- 172.21.15.53:0/3085252047 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fce400662b0 0x7fce40068760 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fce480ab000 tx=0x7fce480b1040 comp rx=0 tx=0).stop 2023-06-10T19:00:35.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.120+0000 7fce5a8b3640 1 -- 172.21.15.53:0/3085252047 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce3c0047d0 msgr2=0x7fce5414e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:35.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.120+0000 7fce5a8b3640 1 --2- 172.21.15.53:0/3085252047 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce3c0047d0 0x7fce5414e570 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7fce4400e440 tx=0x7fce4400e900 comp rx=0 tx=0).stop 2023-06-10T19:00:35.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.120+0000 7fce5a8b3640 1 -- 172.21.15.53:0/3085252047 shutdown_connections 2023-06-10T19:00:35.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.120+0000 7fce5a8b3640 1 --2- 172.21.15.53:0/3085252047 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fce400662b0 0x7fce40068760 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:35.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.120+0000 7fce5a8b3640 1 --2- 172.21.15.53:0/3085252047 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce54158f80 0x7fce541593f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:35.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.120+0000 7fce5a8b3640 1 --2- 172.21.15.53:0/3085252047 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce540cb760 0x7fce540cbbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:35.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.120+0000 7fce5a8b3640 1 --2- 172.21.15.53:0/3085252047 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce3c0047d0 0x7fce5414e570 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:35.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.120+0000 7fce5a8b3640 1 -- 172.21.15.53:0/3085252047 >> 172.21.15.53:0/3085252047 conn(0x7fce54069e20 msgr2=0x7fce540d04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:35.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.120+0000 7fce5a8b3640 1 -- 172.21.15.53:0/3085252047 shutdown_connections 2023-06-10T19:00:35.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.120+0000 7fce5a8b3640 1 -- 172.21.15.53:0/3085252047 wait complete. 2023-06-10T19:00:35.142 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-10T19:00:35.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.268+0000 7f9a38e0c640 1 Processor -- start 2023-06-10T19:00:35.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.268+0000 7f9a38e0c640 1 -- start start 2023-06-10T19:00:35.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.268+0000 7f9a38e0c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9a34159690 0x7f9a34070950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:35.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.268+0000 7f9a38e0c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9a340b0f30 0x7f9a340cbe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:35.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.268+0000 7f9a38e0c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a34159a60 0x7f9a340c2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:35.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.268+0000 7f9a38e0c640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a34070e90 con 0x7f9a340b0f30 2023-06-10T19:00:35.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.268+0000 7f9a38e0c640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a3406d450 con 0x7f9a34159690 2023-06-10T19:00:35.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.268+0000 7f9a38e0c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a340cb080 con 0x7f9a34159a60 2023-06-10T19:00:35.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.268+0000 7f9a2bfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9a340b0f30 0x7f9a340cbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:35.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.268+0000 7f9a2bfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9a340b0f30 0x7f9a340cbe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44540/0 (socket says 172.21.15.53:44540) 2023-06-10T19:00:35.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.268+0000 7f9a2bfff640 1 -- 172.21.15.53:0/839174227 learned_addr learned my addr 172.21.15.53:0/839174227 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:35.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.268+0000 7f9a3259c640 1 --2- 172.21.15.53:0/839174227 >> v2:172.21.15.117:3300/0 conn(0x7f9a34159690 0x7f9a34070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:35.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.268+0000 7f9a32d9d640 1 --2- 172.21.15.53:0/839174227 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a34159a60 0x7f9a340c2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:35.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.268+0000 7f9a2bfff640 1 -- 172.21.15.53:0/839174227 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a34159a60 msgr2=0x7f9a340c2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:35.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.268+0000 7f9a2bfff640 1 --2- 172.21.15.53:0/839174227 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a34159a60 0x7f9a340c2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:35.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.268+0000 7f9a2bfff640 1 -- 172.21.15.53:0/839174227 >> v2:172.21.15.117:3300/0 conn(0x7f9a34159690 msgr2=0x7f9a34070950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:35.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.268+0000 7f9a2bfff640 1 --2- 172.21.15.53:0/839174227 >> v2:172.21.15.117:3300/0 conn(0x7f9a34159690 0x7f9a34070950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:35.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.268+0000 7f9a2bfff640 1 -- 172.21.15.53:0/839174227 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a340cb320 con 0x7f9a340b0f30 2023-06-10T19:00:35.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.268+0000 7f9a32d9d640 1 --2- 172.21.15.53:0/839174227 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a34159a60 0x7f9a340c2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:00:35.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.272+0000 7f9a2bfff640 1 --2- 172.21.15.53:0/839174227 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a340b0f30 0x7f9a340cbe00 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f9a34071570 tx=0x7f9a1c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36c1fc89184dd611 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:35.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.272+0000 7f9a31d9b640 1 -- 172.21.15.53:0/839174227 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1c0aa5f0 con 0x7f9a340b0f30 2023-06-10T19:00:35.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.272+0000 7f9a31d9b640 1 -- 172.21.15.53:0/839174227 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a1c0aa750 con 0x7f9a340b0f30 2023-06-10T19:00:35.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.272+0000 7f9a31d9b640 1 -- 172.21.15.53:0/839174227 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1c0aaae0 con 0x7f9a340b0f30 2023-06-10T19:00:35.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.272+0000 7f9a38e0c640 1 -- 172.21.15.53:0/839174227 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a340b0f30 msgr2=0x7f9a340cbe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:35.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.272+0000 7f9a38e0c640 1 --2- 172.21.15.53:0/839174227 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a340b0f30 0x7f9a340cbe00 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f9a34071570 tx=0x7f9a1c01c4d0 comp rx=0 tx=0).stop 2023-06-10T19:00:35.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.272+0000 7f9a38e0c640 1 -- 172.21.15.53:0/839174227 shutdown_connections 2023-06-10T19:00:35.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.272+0000 7f9a38e0c640 1 --2- 172.21.15.53:0/839174227 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a34159a60 0x7f9a340c2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:35.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.272+0000 7f9a38e0c640 1 --2- 172.21.15.53:0/839174227 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a340b0f30 0x7f9a340cbe00 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:35.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.272+0000 7f9a38e0c640 1 --2- 172.21.15.53:0/839174227 >> v2:172.21.15.117:3300/0 conn(0x7f9a34159690 0x7f9a34070950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:35.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.272+0000 7f9a38e0c640 1 -- 172.21.15.53:0/839174227 >> 172.21.15.53:0/839174227 conn(0x7f9a3406a560 msgr2=0x7f9a3406a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:35.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.272+0000 7f9a38e0c640 1 -- 172.21.15.53:0/839174227 shutdown_connections 2023-06-10T19:00:35.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.272+0000 7f9a38e0c640 1 -- 172.21.15.53:0/839174227 wait complete. 2023-06-10T19:00:35.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.272+0000 7f9a38e0c640 1 Processor -- start 2023-06-10T19:00:35.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.272+0000 7f9a38e0c640 1 -- start start 2023-06-10T19:00:35.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.272+0000 7f9a38e0c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a340b0f30 0x7f9a340ad280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:35.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.272+0000 7f9a38e0c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a34159690 0x7f9a3414e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:35.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.272+0000 7f9a38e0c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a34159a60 0x7f9a3414ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:35.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.272+0000 7f9a38e0c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a340ae390 con 0x7f9a340b0f30 2023-06-10T19:00:35.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.272+0000 7f9a38e0c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a340acdf0 con 0x7f9a34159690 2023-06-10T19:00:35.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.272+0000 7f9a38e0c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a340ac240 con 0x7f9a34159a60 2023-06-10T19:00:35.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.272+0000 7f9a3259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a340b0f30 0x7f9a340ad280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:35.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.272+0000 7f9a3259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a340b0f30 0x7f9a340ad280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44548/0 (socket says 172.21.15.53:44548) 2023-06-10T19:00:35.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.272+0000 7f9a3259c640 1 -- 172.21.15.53:0/3466145406 learned_addr learned my addr 172.21.15.53:0/3466145406 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:35.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.272+0000 7f9a2bfff640 1 --2- 172.21.15.53:0/3466145406 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a34159690 0x7f9a3414e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:35.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.272+0000 7f9a32d9d640 1 --2- 172.21.15.53:0/3466145406 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a34159a60 0x7f9a3414ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:35.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.272+0000 7f9a3259c640 1 -- 172.21.15.53:0/3466145406 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a34159a60 msgr2=0x7f9a3414ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:35.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.272+0000 7f9a3259c640 1 --2- 172.21.15.53:0/3466145406 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a34159a60 0x7f9a3414ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:35.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.272+0000 7f9a3259c640 1 -- 172.21.15.53:0/3466145406 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a34159690 msgr2=0x7f9a3414e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:35.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.272+0000 7f9a3259c640 1 --2- 172.21.15.53:0/3466145406 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a34159690 0x7f9a3414e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:35.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.272+0000 7f9a3259c640 1 -- 172.21.15.53:0/3466145406 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a1c0094d0 con 0x7f9a340b0f30 2023-06-10T19:00:35.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.272+0000 7f9a3259c640 1 --2- 172.21.15.53:0/3466145406 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a340b0f30 0x7f9a340ad280 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f9a2400d800 tx=0x7f9a2400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:35.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.272+0000 7f9a2affd640 1 -- 172.21.15.53:0/3466145406 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2400b660 con 0x7f9a340b0f30 2023-06-10T19:00:35.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.272+0000 7f9a2affd640 1 -- 172.21.15.53:0/3466145406 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a2400b7c0 con 0x7f9a340b0f30 2023-06-10T19:00:35.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.272+0000 7f9a38e0c640 1 -- 172.21.15.53:0/3466145406 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a340ac4c0 con 0x7f9a340b0f30 2023-06-10T19:00:35.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.272+0000 7f9a2affd640 1 -- 172.21.15.53:0/3466145406 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2400bb30 con 0x7f9a340b0f30 2023-06-10T19:00:35.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.272+0000 7f9a38e0c640 1 -- 172.21.15.53:0/3466145406 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a340aca80 con 0x7f9a340b0f30 2023-06-10T19:00:35.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.276+0000 7f9a38e0c640 1 -- 172.21.15.53:0/3466145406 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a3404d790 con 0x7f9a340b0f30 2023-06-10T19:00:35.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.276+0000 7f9a2affd640 1 -- 172.21.15.53:0/3466145406 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9a2400bc90 con 0x7f9a340b0f30 2023-06-10T19:00:35.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.276+0000 7f9a2affd640 1 --2- 172.21.15.53:0/3466145406 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9a14066280 0x7f9a14068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:35.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.276+0000 7f9a2affd640 1 -- 172.21.15.53:0/3466145406 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9a24084260 con 0x7f9a340b0f30 2023-06-10T19:00:35.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.276+0000 7f9a2bfff640 1 --2- 172.21.15.53:0/3466145406 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9a14066280 0x7f9a14068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:35.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.276+0000 7f9a2bfff640 1 --2- 172.21.15.53:0/3466145406 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9a14066280 0x7f9a14068730 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c0ae000 tx=0x7f9a1c0a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:35.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.280+0000 7f9a2affd640 1 -- 172.21.15.53:0/3466145406 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9a240516e0 con 0x7f9a340b0f30 2023-06-10T19:00:35.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.432+0000 7f9a38e0c640 1 -- 172.21.15.53:0/3466145406 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9a34146730 con 0x7f9a340b0f30 2023-06-10T19:00:35.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.432+0000 7f9a2affd640 1 -- 172.21.15.53:0/3466145406 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v80) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9a24054d00 con 0x7f9a340b0f30 2023-06-10T19:00:35.439 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-06-10T19:00:35.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.436+0000 7f9a38e0c640 1 -- 172.21.15.53:0/3466145406 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9a14066280 msgr2=0x7f9a14068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:35.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.436+0000 7f9a38e0c640 1 --2- 172.21.15.53:0/3466145406 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9a14066280 0x7f9a14068730 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c0ae000 tx=0x7f9a1c0a7000 comp rx=0 tx=0).stop 2023-06-10T19:00:35.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.436+0000 7f9a38e0c640 1 -- 172.21.15.53:0/3466145406 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a340b0f30 msgr2=0x7f9a340ad280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:35.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.436+0000 7f9a38e0c640 1 --2- 172.21.15.53:0/3466145406 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a340b0f30 0x7f9a340ad280 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f9a2400d800 tx=0x7f9a2400dcc0 comp rx=0 tx=0).stop 2023-06-10T19:00:35.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.436+0000 7f9a38e0c640 1 -- 172.21.15.53:0/3466145406 shutdown_connections 2023-06-10T19:00:35.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.436+0000 7f9a38e0c640 1 --2- 172.21.15.53:0/3466145406 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9a14066280 0x7f9a14068730 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:35.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.436+0000 7f9a38e0c640 1 --2- 172.21.15.53:0/3466145406 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a34159a60 0x7f9a3414ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:35.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.436+0000 7f9a38e0c640 1 --2- 172.21.15.53:0/3466145406 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a34159690 0x7f9a3414e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:35.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.436+0000 7f9a38e0c640 1 --2- 172.21.15.53:0/3466145406 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a340b0f30 0x7f9a340ad280 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:35.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.436+0000 7f9a38e0c640 1 -- 172.21.15.53:0/3466145406 >> 172.21.15.53:0/3466145406 conn(0x7f9a3406a560 msgr2=0x7f9a3406c920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:35.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.436+0000 7f9a38e0c640 1 -- 172.21.15.53:0/3466145406 shutdown_connections 2023-06-10T19:00:35.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.436+0000 7f9a38e0c640 1 -- 172.21.15.53:0/3466145406 wait complete. 2023-06-10T19:00:35.459 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-10T19:00:35.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.580+0000 7f3e11888640 1 Processor -- start 2023-06-10T19:00:35.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.580+0000 7f3e11888640 1 -- start start 2023-06-10T19:00:35.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.584+0000 7f3e11888640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3e0c0c82a0 0x7f3e0c0c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:35.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.584+0000 7f3e11888640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3e0c0af760 0x7f3e0c0afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:35.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.584+0000 7f3e11888640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e0c06b090 con 0x7f3e0c0c9fa0 2023-06-10T19:00:35.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.584+0000 7f3e11888640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e0c0b0120 con 0x7f3e0c0af760 2023-06-10T19:00:35.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.584+0000 7f3e11888640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e0c0ca370 con 0x7f3e0c0c82a0 2023-06-10T19:00:35.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.584+0000 7f3e0b7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3e0c0af760 0x7f3e0c0afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:35.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.584+0000 7f3e0affd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f3e0c0c9fa0 0x7f3e0c06bae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60094/0 (socket says 172.21.15.53:60094) 2023-06-10T19:00:35.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.584+0000 7f3e0affd640 1 -- 172.21.15.53:0/2431692235 learned_addr learned my addr 172.21.15.53:0/2431692235 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:00:35.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.584+0000 7f3e0a7fc640 1 --2- 172.21.15.53:0/2431692235 >> v2:172.21.15.117:3300/0 conn(0x7f3e0c0c82a0 0x7f3e0c0c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:35.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.584+0000 7f3e09ffb640 1 -- 172.21.15.53:0/2431692235 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1839975309 0 0) 0x7f3e0c06b090 con 0x7f3e0c0c9fa0 2023-06-10T19:00:35.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.584+0000 7f3e09ffb640 1 -- 172.21.15.53:0/2431692235 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3df4003530 con 0x7f3e0c0c9fa0 2023-06-10T19:00:35.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.584+0000 7f3e0b7fe640 1 -- 172.21.15.53:0/2431692235 >> v2:172.21.15.117:3300/0 conn(0x7f3e0c0c82a0 msgr2=0x7f3e0c0c86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:35.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.584+0000 7f3e0b7fe640 1 --2- 172.21.15.53:0/2431692235 >> v2:172.21.15.117:3300/0 conn(0x7f3e0c0c82a0 0x7f3e0c0c86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:35.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.584+0000 7f3e0b7fe640 1 -- 172.21.15.53:0/2431692235 >> v1:172.21.15.53:6789/0 conn(0x7f3e0c0c9fa0 legacy=0x7f3e0c06bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:35.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.584+0000 7f3e0b7fe640 1 -- 172.21.15.53:0/2431692235 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e0c070d50 con 0x7f3e0c0af760 2023-06-10T19:00:35.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.584+0000 7f3e0b7fe640 1 --2- 172.21.15.53:0/2431692235 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e0c0af760 0x7f3e0c0afbe0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c06ecb0 tx=0x7f3e0401c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff915e06c3269b4f server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:35.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.584+0000 7f3e09ffb640 1 -- 172.21.15.53:0/2431692235 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e040a5910 con 0x7f3e0c0af760 2023-06-10T19:00:35.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.584+0000 7f3e09ffb640 1 -- 172.21.15.53:0/2431692235 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e040a5a70 con 0x7f3e0c0af760 2023-06-10T19:00:35.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.584+0000 7f3e09ffb640 1 -- 172.21.15.53:0/2431692235 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e040a5de0 con 0x7f3e0c0af760 2023-06-10T19:00:35.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.584+0000 7f3e11888640 1 -- 172.21.15.53:0/2431692235 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e0c0af760 msgr2=0x7f3e0c0afbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:35.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.584+0000 7f3e11888640 1 --2- 172.21.15.53:0/2431692235 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e0c0af760 0x7f3e0c0afbe0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c06ecb0 tx=0x7f3e0401c850 comp rx=0 tx=0).stop 2023-06-10T19:00:35.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.588+0000 7f3e11888640 1 -- 172.21.15.53:0/2431692235 shutdown_connections 2023-06-10T19:00:35.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.588+0000 7f3e11888640 1 --2- 172.21.15.53:0/2431692235 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e0c0af760 0x7f3e0c0afbe0 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:35.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.588+0000 7f3e11888640 1 --2- 172.21.15.53:0/2431692235 >> v2:172.21.15.117:3300/0 conn(0x7f3e0c0c82a0 0x7f3e0c0c86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:35.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.588+0000 7f3e11888640 1 -- 172.21.15.53:0/2431692235 >> 172.21.15.53:0/2431692235 conn(0x7f3e0c06a0e0 msgr2=0x7f3e0c0cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:35.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.588+0000 7f3e11888640 1 -- 172.21.15.53:0/2431692235 shutdown_connections 2023-06-10T19:00:35.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.588+0000 7f3e11888640 1 -- 172.21.15.53:0/2431692235 wait complete. 2023-06-10T19:00:35.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.588+0000 7f3e11888640 1 Processor -- start 2023-06-10T19:00:35.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.588+0000 7f3e11888640 1 -- start start 2023-06-10T19:00:35.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.588+0000 7f3e11888640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3e0c0af760 0x7f3e0c153910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:35.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.588+0000 7f3e11888640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e0c0c82a0 0x7f3e0c0c5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:35.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.588+0000 7f3e11888640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3e0c0c9fa0 0x7f3e0c1530e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:35.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.588+0000 7f3e11888640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e0c0c61b0 con 0x7f3e0c0c82a0 2023-06-10T19:00:35.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.588+0000 7f3e11888640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e0c0c5690 con 0x7f3e0c0c9fa0 2023-06-10T19:00:35.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.588+0000 7f3e11888640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e0c0c5910 con 0x7f3e0c0af760 2023-06-10T19:00:35.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.588+0000 7f3e0a7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e0c0c82a0 0x7f3e0c0c5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:35.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.588+0000 7f3e0a7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e0c0c82a0 0x7f3e0c0c5150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44558/0 (socket says 172.21.15.53:44558) 2023-06-10T19:00:35.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.588+0000 7f3e0a7fc640 1 -- 172.21.15.53:0/2470212289 learned_addr learned my addr 172.21.15.53:0/2470212289 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:35.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.588+0000 7f3e0b7fe640 1 --2- 172.21.15.53:0/2470212289 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3e0c0c9fa0 0x7f3e0c1530e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:35.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.588+0000 7f3e0affd640 1 --2- 172.21.15.53:0/2470212289 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3e0c0af760 0x7f3e0c153910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:35.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.588+0000 7f3e0a7fc640 1 -- 172.21.15.53:0/2470212289 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3e0c0af760 msgr2=0x7f3e0c153910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:35.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.588+0000 7f3e0a7fc640 1 --2- 172.21.15.53:0/2470212289 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3e0c0af760 0x7f3e0c153910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:35.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.588+0000 7f3e0a7fc640 1 -- 172.21.15.53:0/2470212289 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3e0c0c9fa0 msgr2=0x7f3e0c1530e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:35.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.588+0000 7f3e0a7fc640 1 --2- 172.21.15.53:0/2470212289 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3e0c0c9fa0 0x7f3e0c1530e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:35.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.588+0000 7f3e0a7fc640 1 -- 172.21.15.53:0/2470212289 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e04009a70 con 0x7f3e0c0c82a0 2023-06-10T19:00:35.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.588+0000 7f3e0affd640 1 --2- 172.21.15.53:0/2470212289 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3e0c0af760 0x7f3e0c153910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:00:35.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.588+0000 7f3e0a7fc640 1 --2- 172.21.15.53:0/2470212289 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e0c0c82a0 0x7f3e0c0c5150 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc00d800 tx=0x7f3dfc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:35.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.588+0000 7f3df3fff640 1 -- 172.21.15.53:0/2470212289 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc00b6c0 con 0x7f3e0c0c82a0 2023-06-10T19:00:35.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.588+0000 7f3df3fff640 1 -- 172.21.15.53:0/2470212289 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dfc00b820 con 0x7f3e0c0c82a0 2023-06-10T19:00:35.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.588+0000 7f3e11888640 1 -- 172.21.15.53:0/2470212289 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e0c0c5bf0 con 0x7f3e0c0c82a0 2023-06-10T19:00:35.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.588+0000 7f3df3fff640 1 -- 172.21.15.53:0/2470212289 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc00bb90 con 0x7f3e0c0c82a0 2023-06-10T19:00:35.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.588+0000 7f3e11888640 1 -- 172.21.15.53:0/2470212289 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e0c0b1e10 con 0x7f3e0c0c82a0 2023-06-10T19:00:35.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.588+0000 7f3e11888640 1 -- 172.21.15.53:0/2470212289 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e0c0b1c40 con 0x7f3e0c0c82a0 2023-06-10T19:00:35.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.592+0000 7f3df3fff640 1 -- 172.21.15.53:0/2470212289 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3dfc00bcf0 con 0x7f3e0c0c82a0 2023-06-10T19:00:35.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.592+0000 7f3df3fff640 1 --2- 172.21.15.53:0/2470212289 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3df8066280 0x7f3df8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:35.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.592+0000 7f3df3fff640 1 -- 172.21.15.53:0/2470212289 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3dfc084360 con 0x7f3e0c0c82a0 2023-06-10T19:00:35.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.592+0000 7f3e0affd640 1 --2- 172.21.15.53:0/2470212289 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3df8066280 0x7f3df8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:35.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.592+0000 7f3e0affd640 1 --2- 172.21.15.53:0/2470212289 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3df8066280 0x7f3df8068730 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f3e00005890 tx=0x7f3e00009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:35.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.596+0000 7f3df3fff640 1 -- 172.21.15.53:0/2470212289 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3dfc0551d0 con 0x7f3e0c0c82a0 2023-06-10T19:00:35.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.744+0000 7f3e11888640 1 -- 172.21.15.53:0/2470212289 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3e0c04d790 con 0x7f3e0c0c82a0 2023-06-10T19:00:35.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.748+0000 7f3df3fff640 1 -- 172.21.15.53:0/2470212289 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v80) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3dfc054d60 con 0x7f3e0c0c82a0 2023-06-10T19:00:35.752 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-06-10T19:00:35.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.748+0000 7f3e11888640 1 -- 172.21.15.53:0/2470212289 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3df8066280 msgr2=0x7f3df8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:35.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.748+0000 7f3e11888640 1 --2- 172.21.15.53:0/2470212289 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3df8066280 0x7f3df8068730 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f3e00005890 tx=0x7f3e00009040 comp rx=0 tx=0).stop 2023-06-10T19:00:35.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.748+0000 7f3e11888640 1 -- 172.21.15.53:0/2470212289 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e0c0c82a0 msgr2=0x7f3e0c0c5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:35.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.748+0000 7f3e11888640 1 --2- 172.21.15.53:0/2470212289 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e0c0c82a0 0x7f3e0c0c5150 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc00d800 tx=0x7f3dfc00dcc0 comp rx=0 tx=0).stop 2023-06-10T19:00:35.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.748+0000 7f3e11888640 1 -- 172.21.15.53:0/2470212289 shutdown_connections 2023-06-10T19:00:35.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.748+0000 7f3e11888640 1 --2- 172.21.15.53:0/2470212289 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3df8066280 0x7f3df8068730 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:35.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.748+0000 7f3e11888640 1 --2- 172.21.15.53:0/2470212289 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3e0c0c9fa0 0x7f3e0c1530e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:35.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.748+0000 7f3e11888640 1 --2- 172.21.15.53:0/2470212289 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e0c0c82a0 0x7f3e0c0c5150 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:35.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.748+0000 7f3e11888640 1 --2- 172.21.15.53:0/2470212289 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3e0c0af760 0x7f3e0c153910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:35.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.748+0000 7f3e11888640 1 -- 172.21.15.53:0/2470212289 >> 172.21.15.53:0/2470212289 conn(0x7f3e0c06a0e0 msgr2=0x7f3e0c157f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:35.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.748+0000 7f3e11888640 1 -- 172.21.15.53:0/2470212289 shutdown_connections 2023-06-10T19:00:35.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.748+0000 7f3e11888640 1 -- 172.21.15.53:0/2470212289 wait complete. 2023-06-10T19:00:35.771 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-10T19:00:35.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.892+0000 7ff1ae59f640 1 Processor -- start 2023-06-10T19:00:35.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.892+0000 7ff1ae59f640 1 -- start start 2023-06-10T19:00:35.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.892+0000 7ff1ae59f640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff1a80cd6d0 0x7ff1a815b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:35.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.892+0000 7ff1ae59f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1a80afee0 0x7ff1a8158660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:35.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.892+0000 7ff1ae59f640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1a806b7a0 con 0x7ff1a80c83c0 2023-06-10T19:00:35.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.892+0000 7ff1ae59f640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1a806a8b0 con 0x7ff1a80cd6d0 2023-06-10T19:00:35.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.892+0000 7ff1ae59f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a806ab90 con 0x7ff1a80afee0 2023-06-10T19:00:35.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.892+0000 7ff1a77fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ff1a80c83c0 0x7ff1a80af7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60102/0 (socket says 172.21.15.53:60102) 2023-06-10T19:00:35.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.892+0000 7ff1a77fe640 1 -- 172.21.15.53:0/2443048165 learned_addr learned my addr 172.21.15.53:0/2443048165 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:00:35.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.892+0000 7ff1a7fff640 1 --2- 172.21.15.53:0/2443048165 >> v2:172.21.15.117:3300/0 conn(0x7ff1a80cd6d0 0x7ff1a815b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:35.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.892+0000 7ff1acb3c640 1 --2- 172.21.15.53:0/2443048165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1a80afee0 0x7ff1a8158660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:35.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.892+0000 7ff1a6ffd640 1 -- 172.21.15.53:0/2443048165 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3054737622 0 0) 0x7ff1a806b7a0 con 0x7ff1a80c83c0 2023-06-10T19:00:35.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.892+0000 7ff1a6ffd640 1 -- 172.21.15.53:0/2443048165 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff194003530 con 0x7ff1a80c83c0 2023-06-10T19:00:35.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.892+0000 7ff1a6ffd640 1 -- 172.21.15.53:0/2443048165 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 86913774 0 0) 0x7ff194003530 con 0x7ff1a80c83c0 2023-06-10T19:00:35.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.892+0000 7ff1a6ffd640 1 -- 172.21.15.53:0/2443048165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1a80afee0 msgr2=0x7ff1a8158660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:35.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.892+0000 7ff1a6ffd640 1 --2- 172.21.15.53:0/2443048165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1a80afee0 0x7ff1a8158660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:35.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.892+0000 7ff1a6ffd640 1 -- 172.21.15.53:0/2443048165 >> v2:172.21.15.117:3300/0 conn(0x7ff1a80cd6d0 msgr2=0x7ff1a815b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:35.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.892+0000 7ff1a6ffd640 1 --2- 172.21.15.53:0/2443048165 >> v2:172.21.15.117:3300/0 conn(0x7ff1a80cd6d0 0x7ff1a815b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:35.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.892+0000 7ff1a6ffd640 1 -- 172.21.15.53:0/2443048165 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1a806ae70 con 0x7ff1a80c83c0 2023-06-10T19:00:35.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.896+0000 7ff1a6ffd640 1 -- 172.21.15.53:0/2443048165 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7ff190001680 con 0x7ff1a80c83c0 2023-06-10T19:00:35.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.896+0000 7ff1a6ffd640 1 -- 172.21.15.53:0/2443048165 >> v1:172.21.15.53:6789/0 conn(0x7ff1a80c83c0 legacy=0x7ff1a80af7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:35.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.896+0000 7ff1a6ffd640 1 --2- 172.21.15.53:0/2443048165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1a80afee0 0x7ff194003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:35.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.896+0000 7ff1a6ffd640 1 --2- 172.21.15.53:0/2443048165 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff194003ec0 0x7ff1940047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:35.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.896+0000 7ff1a6ffd640 1 --2- 172.21.15.53:0/2443048165 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff194004d10 0x7ff194005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:35.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.896+0000 7ff1a6ffd640 1 -- 172.21.15.53:0/2443048165 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a806a8b0 con 0x7ff194004d10 2023-06-10T19:00:35.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.896+0000 7ff1a6ffd640 1 -- 172.21.15.53:0/2443048165 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a806ab90 con 0x7ff194003ec0 2023-06-10T19:00:35.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.896+0000 7ff1a6ffd640 1 -- 172.21.15.53:0/2443048165 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff19400b990 con 0x7ff1a80afee0 2023-06-10T19:00:35.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.896+0000 7ff1acb3c640 1 --2- 172.21.15.53:0/2443048165 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff194004d10 0x7ff194005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:35.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.896+0000 7ff1a77fe640 1 --2- 172.21.15.53:0/2443048165 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff194003ec0 0x7ff1940047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:35.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.896+0000 7ff1a7fff640 1 --2- 172.21.15.53:0/2443048165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1a80afee0 0x7ff194003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:35.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.896+0000 7ff1acb3c640 1 -- 172.21.15.53:0/2443048165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1a80afee0 msgr2=0x7ff194003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:35.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.896+0000 7ff1acb3c640 1 --2- 172.21.15.53:0/2443048165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1a80afee0 0x7ff194003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:35.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.896+0000 7ff1acb3c640 1 -- 172.21.15.53:0/2443048165 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff194003ec0 msgr2=0x7ff1940047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:35.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.896+0000 7ff1acb3c640 1 --2- 172.21.15.53:0/2443048165 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff194003ec0 0x7ff1940047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:35.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.896+0000 7ff1acb3c640 1 -- 172.21.15.53:0/2443048165 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff194003530 con 0x7ff194004d10 2023-06-10T19:00:35.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.896+0000 7ff1acb3c640 1 --2- 172.21.15.53:0/2443048165 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff194004d10 0x7ff194005180 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7ff198009ab0 tx=0x7ff19801ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=313f9ac9c898d235 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:35.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.896+0000 7ff1a6ffd640 1 -- 172.21.15.53:0/2443048165 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1980a5620 con 0x7ff194004d10 2023-06-10T19:00:35.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.896+0000 7ff1a6ffd640 1 -- 172.21.15.53:0/2443048165 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1980a5780 con 0x7ff194004d10 2023-06-10T19:00:35.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.896+0000 7ff1a6ffd640 1 -- 172.21.15.53:0/2443048165 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1980a5b30 con 0x7ff194004d10 2023-06-10T19:00:35.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.896+0000 7ff1ae59f640 1 -- 172.21.15.53:0/2443048165 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff194004d10 msgr2=0x7ff194005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:35.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.896+0000 7ff1ae59f640 1 --2- 172.21.15.53:0/2443048165 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff194004d10 0x7ff194005180 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7ff198009ab0 tx=0x7ff19801ca30 comp rx=0 tx=0).stop 2023-06-10T19:00:35.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.896+0000 7ff1acb3c640 1 -- 172.21.15.53:0/2443048165 reap_dead start 2023-06-10T19:00:35.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.896+0000 7ff1ae59f640 1 -- 172.21.15.53:0/2443048165 shutdown_connections 2023-06-10T19:00:35.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.896+0000 7ff1ae59f640 1 -- 172.21.15.53:0/2443048165 >> 172.21.15.53:0/2443048165 conn(0x7ff1a80ce9e0 msgr2=0x7ff1a80ca7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:35.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.896+0000 7ff1ae59f640 1 -- 172.21.15.53:0/2443048165 shutdown_connections 2023-06-10T19:00:35.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.896+0000 7ff1ae59f640 1 -- 172.21.15.53:0/2443048165 wait complete. 2023-06-10T19:00:35.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.900+0000 7ff1ae59f640 1 Processor -- start 2023-06-10T19:00:35.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.900+0000 7ff1ae59f640 1 -- start start 2023-06-10T19:00:35.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.900+0000 7ff1ae59f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff194004d10 0x7ff1a80cc580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:35.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.900+0000 7ff1ae59f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1a815aa40 0x7ff1a8151410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:35.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.900+0000 7ff1ae59f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1a806ef00 0x7ff1a806f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:35.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.900+0000 7ff1ae59f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a806f8b0 con 0x7ff1a806ef00 2023-06-10T19:00:35.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.900+0000 7ff1ae59f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a806fbf0 con 0x7ff1a815aa40 2023-06-10T19:00:35.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.900+0000 7ff1ae59f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a81534f0 con 0x7ff194004d10 2023-06-10T19:00:35.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.900+0000 7ff1acb3c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1a806ef00 0x7ff1a806f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:35.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.900+0000 7ff1acb3c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1a806ef00 0x7ff1a806f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44578/0 (socket says 172.21.15.53:44578) 2023-06-10T19:00:35.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.900+0000 7ff1acb3c640 1 -- 172.21.15.53:0/3261447561 learned_addr learned my addr 172.21.15.53:0/3261447561 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:35.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.900+0000 7ff1a77fe640 1 --2- 172.21.15.53:0/3261447561 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1a815aa40 0x7ff1a8151410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:35.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.900+0000 7ff1a7fff640 1 --2- 172.21.15.53:0/3261447561 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff194004d10 0x7ff1a80cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:35.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.900+0000 7ff1acb3c640 1 -- 172.21.15.53:0/3261447561 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff194004d10 msgr2=0x7ff1a80cc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:35.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.900+0000 7ff1acb3c640 1 --2- 172.21.15.53:0/3261447561 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff194004d10 0x7ff1a80cc580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:35.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.900+0000 7ff1acb3c640 1 -- 172.21.15.53:0/3261447561 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1a815aa40 msgr2=0x7ff1a8151410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:35.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.900+0000 7ff1acb3c640 1 --2- 172.21.15.53:0/3261447561 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1a815aa40 0x7ff1a8151410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:35.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.900+0000 7ff1acb3c640 1 -- 172.21.15.53:0/3261447561 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1a81537d0 con 0x7ff1a806ef00 2023-06-10T19:00:35.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.900+0000 7ff1a7fff640 1 --2- 172.21.15.53:0/3261447561 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff194004d10 0x7ff1a80cc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:00:35.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.900+0000 7ff1acb3c640 1 --2- 172.21.15.53:0/3261447561 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1a806ef00 0x7ff1a806f370 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7ff198009ab0 tx=0x7ff194005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:35.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.900+0000 7ff1a4ff9640 1 -- 172.21.15.53:0/3261447561 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1980a5620 con 0x7ff1a806ef00 2023-06-10T19:00:35.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.900+0000 7ff1a4ff9640 1 -- 172.21.15.53:0/3261447561 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff198004250 con 0x7ff1a806ef00 2023-06-10T19:00:35.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.900+0000 7ff1ae59f640 1 -- 172.21.15.53:0/3261447561 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1a8153ab0 con 0x7ff1a806ef00 2023-06-10T19:00:35.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.900+0000 7ff1a4ff9640 1 -- 172.21.15.53:0/3261447561 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff198003620 con 0x7ff1a806ef00 2023-06-10T19:00:35.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.900+0000 7ff1ae59f640 1 -- 172.21.15.53:0/3261447561 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1a8154070 con 0x7ff1a806ef00 2023-06-10T19:00:35.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.900+0000 7ff1ae59f640 1 -- 172.21.15.53:0/3261447561 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1a804d790 con 0x7ff1a806ef00 2023-06-10T19:00:35.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.904+0000 7ff1a4ff9640 1 -- 172.21.15.53:0/3261447561 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff1980b4070 con 0x7ff1a806ef00 2023-06-10T19:00:35.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.904+0000 7ff1a4ff9640 1 --2- 172.21.15.53:0/3261447561 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff188066280 0x7ff188068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:35.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.904+0000 7ff1a4ff9640 1 -- 172.21.15.53:0/3261447561 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff19811d550 con 0x7ff1a806ef00 2023-06-10T19:00:35.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.904+0000 7ff1a7fff640 1 --2- 172.21.15.53:0/3261447561 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff188066280 0x7ff188068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:35.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.904+0000 7ff1a7fff640 1 --2- 172.21.15.53:0/3261447561 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff188066280 0x7ff188068730 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7ff1a0007520 tx=0x7ff1a000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:35.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:35.908+0000 7ff1a4ff9640 1 -- 172.21.15.53:0/3261447561 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff1980ea950 con 0x7ff1a806ef00 2023-06-10T19:00:36.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:36.072+0000 7ff1ae59f640 1 -- 172.21.15.53:0/3261447561 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff1a80b3cd0 con 0x7ff1a806ef00 2023-06-10T19:00:36.079 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:36.072+0000 7ff1a4ff9640 1 -- 172.21.15.53:0/3261447561 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v80) v1 ==== 80+0+0 (secure 0 0 0) 0x7ff1980edf70 con 0x7ff1a806ef00 2023-06-10T19:00:36.079 INFO:teuthology.orchestra.run.smithi053.stderr:listed 0 entries 2023-06-10T19:00:36.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:36.076+0000 7ff1ae59f640 1 -- 172.21.15.53:0/3261447561 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff188066280 msgr2=0x7ff188068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:36.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:36.076+0000 7ff1ae59f640 1 --2- 172.21.15.53:0/3261447561 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff188066280 0x7ff188068730 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7ff1a0007520 tx=0x7ff1a000b040 comp rx=0 tx=0).stop 2023-06-10T19:00:36.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:36.076+0000 7ff1ae59f640 1 -- 172.21.15.53:0/3261447561 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1a806ef00 msgr2=0x7ff1a806f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:36.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:36.076+0000 7ff1ae59f640 1 --2- 172.21.15.53:0/3261447561 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1a806ef00 0x7ff1a806f370 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7ff198009ab0 tx=0x7ff194005800 comp rx=0 tx=0).stop 2023-06-10T19:00:36.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:36.076+0000 7ff1ae59f640 1 -- 172.21.15.53:0/3261447561 shutdown_connections 2023-06-10T19:00:36.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:36.076+0000 7ff1ae59f640 1 --2- 172.21.15.53:0/3261447561 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff188066280 0x7ff188068730 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:36.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:36.076+0000 7ff1ae59f640 1 --2- 172.21.15.53:0/3261447561 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1a806ef00 0x7ff1a806f370 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:36.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:36.076+0000 7ff1ae59f640 1 --2- 172.21.15.53:0/3261447561 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1a815aa40 0x7ff1a8151410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:36.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:36.076+0000 7ff1ae59f640 1 --2- 172.21.15.53:0/3261447561 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff194004d10 0x7ff1a80cc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:36.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:36.076+0000 7ff1ae59f640 1 -- 172.21.15.53:0/3261447561 >> 172.21.15.53:0/3261447561 conn(0x7ff1a80ce9e0 msgr2=0x7ff1a8151f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:36.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:36.076+0000 7ff1ae59f640 1 -- 172.21.15.53:0/3261447561 shutdown_connections 2023-06-10T19:00:36.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:36.076+0000 7ff1ae59f640 1 -- 172.21.15.53:0/3261447561 wait complete. 2023-06-10T19:00:36.097 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi117.front.sepia.ceph.com... 2023-06-10T19:00:36.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:00:36.098 DEBUG:teuthology.orchestra.run.smithi117:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-06-10T19:00:36.111 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi117.stderr:ceph-fuse[44622]: fuse finished with error 0 and tester_r 0 2023-06-10T19:00:36.112 INFO:teuthology.orchestra.run:waiting for 300 2023-06-10T19:00:37.366 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-10T19:00:37.369 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-10T19:00:42.214 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi117.front.sepia.ceph.com 2023-06-10T19:00:42.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:00:42.216 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-06-10T19:00:42.224 DEBUG:teuthology.orchestra.run.smithi053:> adjust-ulimits daemon-helper kill python3 -c ' 2023-06-10T19:00:42.224 DEBUG:teuthology.orchestra.run.smithi053:> import os 2023-06-10T19:00:42.224 DEBUG:teuthology.orchestra.run.smithi053:> import time 2023-06-10T19:00:42.225 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:00:42.225 DEBUG:teuthology.orchestra.run.smithi053:> path = "/home/ubuntu/cephtest/mnt.0/subdir" 2023-06-10T19:00:42.225 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:00:42.226 DEBUG:teuthology.orchestra.run.smithi053:> print("Starting creation...") 2023-06-10T19:00:42.226 DEBUG:teuthology.orchestra.run.smithi053:> start = time.time() 2023-06-10T19:00:42.226 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:00:42.227 DEBUG:teuthology.orchestra.run.smithi053:> os.mkdir(path) 2023-06-10T19:00:42.227 DEBUG:teuthology.orchestra.run.smithi053:> dfd = os.open(path, os.O_DIRECTORY) 2023-06-10T19:00:42.227 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:00:42.227 DEBUG:teuthology.orchestra.run.smithi053:> fd = open(os.path.join(path, "childfile"), "w") 2023-06-10T19:00:42.228 DEBUG:teuthology.orchestra.run.smithi053:> print("Finished creation in {0}s".format(time.time() - start)) 2023-06-10T19:00:42.228 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:00:42.228 DEBUG:teuthology.orchestra.run.smithi053:> print("Starting fsync...") 2023-06-10T19:00:42.228 DEBUG:teuthology.orchestra.run.smithi053:> start = time.time() 2023-06-10T19:00:42.229 DEBUG:teuthology.orchestra.run.smithi053:> if False: 2023-06-10T19:00:42.229 DEBUG:teuthology.orchestra.run.smithi053:> os.fsync(dfd) 2023-06-10T19:00:42.229 DEBUG:teuthology.orchestra.run.smithi053:> else: 2023-06-10T19:00:42.230 DEBUG:teuthology.orchestra.run.smithi053:> os.fsync(fd) 2023-06-10T19:00:42.230 DEBUG:teuthology.orchestra.run.smithi053:> print("Finished fsync in {0}s".format(time.time() - start)) 2023-06-10T19:00:42.230 DEBUG:teuthology.orchestra.run.smithi053:> ' 2023-06-10T19:00:42.316 INFO:teuthology.orchestra.run.smithi053.stdout:Starting creation... 2023-06-10T19:00:42.317 INFO:teuthology.orchestra.run.smithi053.stdout:Finished creation in 0.012456417083740234s 2023-06-10T19:00:42.317 INFO:teuthology.orchestra.run.smithi053.stdout:Starting fsync... 2023-06-10T19:00:42.317 INFO:teuthology.orchestra.run.smithi053.stdout:Finished fsync in 0.0048274993896484375s 2023-06-10T19:00:42.488 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-06-10T19:00:42.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:42.660+0000 7f6cc55a5640 1 Processor -- start 2023-06-10T19:00:42.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:42.660+0000 7f6cc55a5640 1 -- start start 2023-06-10T19:00:42.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:42.664+0000 7f6cc55a5640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6cc00b24c0 0x7f6cc00c2c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:42.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:42.664+0000 7f6cc55a5640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cc006c060 con 0x7f6cc01642c0 2023-06-10T19:00:42.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:42.664+0000 7f6cc55a5640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cc01637e0 con 0x7f6cc015d5d0 2023-06-10T19:00:42.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:42.664+0000 7f6cc55a5640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cc0163ac0 con 0x7f6cc00b24c0 2023-06-10T19:00:42.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:42.664+0000 7f6cb7fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6cc00b24c0 0x7f6cc00c2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:42.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:42.664+0000 7f6cb7fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6cc00b24c0 0x7f6cc00c2c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47496/0 (socket says 172.21.15.53:47496) 2023-06-10T19:00:42.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:42.664+0000 7f6cb7fff640 1 -- 172.21.15.53:0/3189910485 learned_addr learned my addr 172.21.15.53:0/3189910485 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:42.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:42.664+0000 7f6cb7fff640 1 -- 172.21.15.53:0/3189910485 >> v1:172.21.15.117:6789/0 conn(0x7f6cc015d5d0 legacy=0x7f6cc006b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:42.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:42.664+0000 7f6cb7fff640 1 -- 172.21.15.53:0/3189910485 >> v1:172.21.15.53:6789/0 conn(0x7f6cc01642c0 legacy=0x7f6cc01600c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:42.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:42.664+0000 7f6cb7fff640 1 -- 172.21.15.53:0/3189910485 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cc0163da0 con 0x7f6cc00b24c0 2023-06-10T19:00:42.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:42.664+0000 7f6cb7fff640 1 --2- 172.21.15.53:0/3189910485 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6cc00b24c0 0x7f6cc00c2c60 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f6ca8009870 tx=0x7f6ca801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=561aa1a3846ac2ae server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:42.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:42.664+0000 7f6cbe7fc640 1 -- 172.21.15.53:0/3189910485 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca80ab600 con 0x7f6cc00b24c0 2023-06-10T19:00:42.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:42.664+0000 7f6cbe7fc640 1 -- 172.21.15.53:0/3189910485 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ca80a7050 con 0x7f6cc00b24c0 2023-06-10T19:00:42.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:42.664+0000 7f6cbe7fc640 1 -- 172.21.15.53:0/3189910485 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca80ab980 con 0x7f6cc00b24c0 2023-06-10T19:00:42.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:42.664+0000 7f6cc55a5640 1 -- 172.21.15.53:0/3189910485 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6cc00b24c0 msgr2=0x7f6cc00c2c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:42.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:42.664+0000 7f6cc55a5640 1 --2- 172.21.15.53:0/3189910485 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6cc00b24c0 0x7f6cc00c2c60 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f6ca8009870 tx=0x7f6ca801c470 comp rx=0 tx=0).stop 2023-06-10T19:00:42.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:42.664+0000 7f6cc55a5640 1 -- 172.21.15.53:0/3189910485 shutdown_connections 2023-06-10T19:00:42.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:42.664+0000 7f6cc55a5640 1 --2- 172.21.15.53:0/3189910485 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6cc00b24c0 0x7f6cc00c2c60 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:42.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:42.664+0000 7f6cc55a5640 1 -- 172.21.15.53:0/3189910485 >> 172.21.15.53:0/3189910485 conn(0x7f6cc006a0b0 msgr2=0x7f6cc006d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:42.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:42.668+0000 7f6cc55a5640 1 -- 172.21.15.53:0/3189910485 shutdown_connections 2023-06-10T19:00:42.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:42.668+0000 7f6cc55a5640 1 -- 172.21.15.53:0/3189910485 wait complete. 2023-06-10T19:00:42.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:42.668+0000 7f6cc55a5640 1 Processor -- start 2023-06-10T19:00:42.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:42.668+0000 7f6cc55a5640 1 -- start start 2023-06-10T19:00:42.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:42.668+0000 7f6cc55a5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6cc00b24c0 0x7f6cc0159250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:42.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:42.668+0000 7f6cc55a5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6cc015d5d0 0x7f6cc01529c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:42.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:42.668+0000 7f6cc55a5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6cc01642c0 0x7f6cc01510c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:42.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:42.668+0000 7f6cc55a5640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc015a560 con 0x7f6cc015d5d0 2023-06-10T19:00:42.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:42.668+0000 7f6cc55a5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc0159950 con 0x7f6cc00b24c0 2023-06-10T19:00:42.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:42.668+0000 7f6cc55a5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc0159c30 con 0x7f6cc01642c0 2023-06-10T19:00:42.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:42.668+0000 7f6cb7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6cc015d5d0 0x7f6cc01529c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:42.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:42.668+0000 7f6cb7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6cc015d5d0 0x7f6cc01529c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47502/0 (socket says 172.21.15.53:47502) 2023-06-10T19:00:42.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:42.668+0000 7f6cb7fff640 1 -- 172.21.15.53:0/3197516061 learned_addr learned my addr 172.21.15.53:0/3197516061 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:42.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:42.668+0000 7f6cbeffd640 1 --2- 172.21.15.53:0/3197516061 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6cc00b24c0 0x7f6cc0159250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:42.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:42.668+0000 7f6cbf7fe640 1 --2- 172.21.15.53:0/3197516061 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6cc01642c0 0x7f6cc01510c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:42.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:42.668+0000 7f6cb7fff640 1 -- 172.21.15.53:0/3197516061 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6cc01642c0 msgr2=0x7f6cc01510c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:42.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:42.668+0000 7f6cb7fff640 1 --2- 172.21.15.53:0/3197516061 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6cc01642c0 0x7f6cc01510c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:42.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:42.668+0000 7f6cb7fff640 1 -- 172.21.15.53:0/3197516061 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6cc00b24c0 msgr2=0x7f6cc0159250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:42.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:42.668+0000 7f6cb7fff640 1 --2- 172.21.15.53:0/3197516061 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6cc00b24c0 0x7f6cc0159250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:42.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:42.668+0000 7f6cb7fff640 1 -- 172.21.15.53:0/3197516061 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca80094d0 con 0x7f6cc015d5d0 2023-06-10T19:00:42.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:42.668+0000 7f6cbf7fe640 1 --2- 172.21.15.53:0/3197516061 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6cc01642c0 0x7f6cc01510c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:00:42.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:42.668+0000 7f6cb7fff640 1 --2- 172.21.15.53:0/3197516061 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6cc015d5d0 0x7f6cc01529c0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f6ca8000c10 tx=0x7f6ca8019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:42.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:42.668+0000 7f6cb77fe640 1 -- 172.21.15.53:0/3197516061 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca80b4630 con 0x7f6cc015d5d0 2023-06-10T19:00:42.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:42.668+0000 7f6cb77fe640 1 -- 172.21.15.53:0/3197516061 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ca80b47d0 con 0x7f6cc015d5d0 2023-06-10T19:00:42.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:42.668+0000 7f6cc55a5640 1 -- 172.21.15.53:0/3197516061 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cc0159f10 con 0x7f6cc015d5d0 2023-06-10T19:00:42.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:42.668+0000 7f6cb77fe640 1 -- 172.21.15.53:0/3197516061 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca80b4b80 con 0x7f6cc015d5d0 2023-06-10T19:00:42.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:42.668+0000 7f6cc55a5640 1 -- 172.21.15.53:0/3197516061 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cc0151600 con 0x7f6cc015d5d0 2023-06-10T19:00:42.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:42.672+0000 7f6cc55a5640 1 -- 172.21.15.53:0/3197516061 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cc004d790 con 0x7f6cc015d5d0 2023-06-10T19:00:42.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:42.672+0000 7f6cb77fe640 1 -- 172.21.15.53:0/3197516061 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6ca80b2040 con 0x7f6cc015d5d0 2023-06-10T19:00:42.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:42.672+0000 7f6cb77fe640 1 --2- 172.21.15.53:0/3197516061 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6ca0066280 0x7f6ca0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:42.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:42.672+0000 7f6cb77fe640 1 -- 172.21.15.53:0/3197516061 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6ca811e730 con 0x7f6cc015d5d0 2023-06-10T19:00:42.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:42.672+0000 7f6cbeffd640 1 --2- 172.21.15.53:0/3197516061 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6ca0066280 0x7f6ca0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:42.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:42.672+0000 7f6cbeffd640 1 --2- 172.21.15.53:0/3197516061 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6ca0066280 0x7f6ca0068730 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f6cb0007fd0 tx=0x7f6cb0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:42.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:42.676+0000 7f6cb77fe640 1 -- 172.21.15.53:0/3197516061 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6ca80ebd40 con 0x7f6cc015d5d0 2023-06-10T19:00:42.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:42.864+0000 7f6cc55a5640 1 -- 172.21.15.53:0/3197516061 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f6cc006df70 con 0x7f6cc015d5d0 2023-06-10T19:00:42.960 INFO:tasks.ceph.mon.a.smithi053.stderr:2023-06-10T19:00:42.956+0000 7f74752c1640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-06-10T19:00:42.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:42.964+0000 7f6cb77fe640 1 -- 172.21.15.53:0/3197516061 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v34) v1 ==== 161+0+0 (secure 0 0 0) 0x7f6ca80ef360 con 0x7f6cc015d5d0 2023-06-10T19:00:42.969 INFO:teuthology.orchestra.run.smithi053.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-06-10T19:00:42.972 INFO:tasks.ceph.mds.c.smithi053.stderr: -1736> 2023-06-10T19:00:22.172+0000 7f3b2b9b2640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-06-10T19:00:42.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:42.968+0000 7f6cc55a5640 1 -- 172.21.15.53:0/3197516061 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6ca0066280 msgr2=0x7f6ca0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:42.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:42.968+0000 7f6cc55a5640 1 --2- 172.21.15.53:0/3197516061 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6ca0066280 0x7f6ca0068730 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f6cb0007fd0 tx=0x7f6cb0009040 comp rx=0 tx=0).stop 2023-06-10T19:00:42.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:42.968+0000 7f6cc55a5640 1 -- 172.21.15.53:0/3197516061 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6cc015d5d0 msgr2=0x7f6cc01529c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:42.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:42.968+0000 7f6cc55a5640 1 --2- 172.21.15.53:0/3197516061 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6cc015d5d0 0x7f6cc01529c0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f6ca8000c10 tx=0x7f6ca8019210 comp rx=0 tx=0).stop 2023-06-10T19:00:42.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:42.968+0000 7f6cc55a5640 1 -- 172.21.15.53:0/3197516061 shutdown_connections 2023-06-10T19:00:42.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:42.968+0000 7f6cc55a5640 1 --2- 172.21.15.53:0/3197516061 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6ca0066280 0x7f6ca0068730 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:42.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:42.968+0000 7f6cc55a5640 1 --2- 172.21.15.53:0/3197516061 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6cc01642c0 0x7f6cc01510c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:42.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:42.968+0000 7f6cc55a5640 1 --2- 172.21.15.53:0/3197516061 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6cc015d5d0 0x7f6cc01529c0 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:42.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:42.968+0000 7f6cc55a5640 1 --2- 172.21.15.53:0/3197516061 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6cc00b24c0 0x7f6cc0159250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:42.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:42.968+0000 7f6cc55a5640 1 -- 172.21.15.53:0/3197516061 >> 172.21.15.53:0/3197516061 conn(0x7f6cc006a0b0 msgr2=0x7f6cc0157710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:42.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:42.968+0000 7f6cc55a5640 1 -- 172.21.15.53:0/3197516061 shutdown_connections 2023-06-10T19:00:42.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:42.968+0000 7f6cc55a5640 1 -- 172.21.15.53:0/3197516061 wait complete. 2023-06-10T19:00:42.994 INFO:tasks.cephfs.mount:Killing connection on ubuntu@smithi053.front.sepia.ceph.com... 2023-06-10T19:00:42.995 INFO:tasks.cephfs.mount:Suspending the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-06-10T19:00:42.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:00:42.995 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link set brx.0 down 2023-06-10T19:00:43.008 INFO:tasks.cephfs.mount:Cleaning up killed connection on ubuntu@smithi053.front.sepia.ceph.com 2023-06-10T19:00:43.009 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T19:00:43.009 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:00:43.010 INFO:tasks.ceph.mds.c.smithi053.stdout:starting mds.c at 2023-06-10T19:00:43.016 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:00:43.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.168+0000 7f8e771c9640 1 Processor -- start 2023-06-10T19:00:43.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.168+0000 7f8e771c9640 1 -- start start 2023-06-10T19:00:43.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.168+0000 7f8e771c9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8e7015b870 0x7f8e7006a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:43.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.168+0000 7f8e771c9640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e7006ae70 con 0x7f8e700b03f0 2023-06-10T19:00:43.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.168+0000 7f8e771c9640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e700655c0 con 0x7f8e700affc0 2023-06-10T19:00:43.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.168+0000 7f8e771c9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e700cc110 con 0x7f8e7015b870 2023-06-10T19:00:43.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.168+0000 7f8e75766640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f8e700b03f0 0x7f8e70069b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:57652/0 (socket says 172.21.15.53:57652) 2023-06-10T19:00:43.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.168+0000 7f8e75766640 1 -- 172.21.15.53:0/3039100647 learned_addr learned my addr 172.21.15.53:0/3039100647 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:00:43.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.168+0000 7f8e74f65640 1 --2- 172.21.15.53:0/3039100647 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8e7015b870 0x7f8e7006a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:43.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.168+0000 7f8e6f7fe640 1 -- 172.21.15.53:0/3039100647 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 805470518 0 0) 0x7f8e680014a0 con 0x7f8e700b03f0 2023-06-10T19:00:43.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.168+0000 7f8e6f7fe640 1 -- 172.21.15.53:0/3039100647 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e58003530 con 0x7f8e700b03f0 2023-06-10T19:00:43.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.168+0000 7f8e6f7fe640 1 -- 172.21.15.53:0/3039100647 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 875342257 0 0) 0x7f8e58003530 con 0x7f8e700b03f0 2023-06-10T19:00:43.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.168+0000 7f8e6f7fe640 1 -- 172.21.15.53:0/3039100647 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8e7015b870 msgr2=0x7f8e7006a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:43.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.168+0000 7f8e6f7fe640 1 --2- 172.21.15.53:0/3039100647 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8e7015b870 0x7f8e7006a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:43.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.168+0000 7f8e6f7fe640 1 -- 172.21.15.53:0/3039100647 >> v1:172.21.15.117:6789/0 conn(0x7f8e700affc0 legacy=0x7f8e70069450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:43.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.168+0000 7f8e6f7fe640 1 -- 172.21.15.53:0/3039100647 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e700cc3f0 con 0x7f8e700b03f0 2023-06-10T19:00:43.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.168+0000 7f8e6f7fe640 1 -- 172.21.15.53:0/3039100647 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f8e68001b90 con 0x7f8e700b03f0 2023-06-10T19:00:43.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.168+0000 7f8e6f7fe640 1 -- 172.21.15.53:0/3039100647 >> v1:172.21.15.53:6789/0 conn(0x7f8e700b03f0 legacy=0x7f8e70069b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:43.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.168+0000 7f8e6f7fe640 1 --2- 172.21.15.53:0/3039100647 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8e58003a20 0x7f8e58003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:43.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.168+0000 7f8e6f7fe640 1 --2- 172.21.15.53:0/3039100647 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8e7015b870 0x7f8e580047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:43.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.168+0000 7f8e6f7fe640 1 --2- 172.21.15.53:0/3039100647 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e58004d10 0x7f8e58005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:43.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.168+0000 7f8e6f7fe640 1 -- 172.21.15.53:0/3039100647 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e700cc110 con 0x7f8e58004d10 2023-06-10T19:00:43.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.168+0000 7f8e6f7fe640 1 -- 172.21.15.53:0/3039100647 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5800bb20 con 0x7f8e58003a20 2023-06-10T19:00:43.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.168+0000 7f8e6f7fe640 1 -- 172.21.15.53:0/3039100647 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5800bce0 con 0x7f8e7015b870 2023-06-10T19:00:43.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.168+0000 7f8e75766640 1 --2- 172.21.15.53:0/3039100647 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e58004d10 0x7f8e58005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:43.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.168+0000 7f8e74f65640 1 --2- 172.21.15.53:0/3039100647 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8e58003a20 0x7f8e58003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:43.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.168+0000 7f8e6ffff640 1 --2- 172.21.15.53:0/3039100647 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8e7015b870 0x7f8e580047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:43.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.168+0000 7f8e75766640 1 -- 172.21.15.53:0/3039100647 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8e7015b870 msgr2=0x7f8e580047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:43.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.168+0000 7f8e75766640 1 --2- 172.21.15.53:0/3039100647 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8e7015b870 0x7f8e580047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:43.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.168+0000 7f8e75766640 1 -- 172.21.15.53:0/3039100647 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8e58003a20 msgr2=0x7f8e58003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:43.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.168+0000 7f8e75766640 1 --2- 172.21.15.53:0/3039100647 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8e58003a20 0x7f8e58003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:43.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.168+0000 7f8e75766640 1 -- 172.21.15.53:0/3039100647 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e58003530 con 0x7f8e58004d10 2023-06-10T19:00:43.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.172+0000 7f8e75766640 1 --2- 172.21.15.53:0/3039100647 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e58004d10 0x7f8e58005180 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f8e6800a830 tx=0x7f8e6801faa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c54e4b3a1923c7a4 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:43.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.172+0000 7f8e6f7fe640 1 -- 172.21.15.53:0/3039100647 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e680aa6d0 con 0x7f8e58004d10 2023-06-10T19:00:43.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.172+0000 7f8e6f7fe640 1 -- 172.21.15.53:0/3039100647 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e680aa850 con 0x7f8e58004d10 2023-06-10T19:00:43.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.172+0000 7f8e6f7fe640 1 -- 172.21.15.53:0/3039100647 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e680aac00 con 0x7f8e58004d10 2023-06-10T19:00:43.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.172+0000 7f8e771c9640 1 -- 172.21.15.53:0/3039100647 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e58004d10 msgr2=0x7f8e58005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:43.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.172+0000 7f8e771c9640 1 --2- 172.21.15.53:0/3039100647 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e58004d10 0x7f8e58005180 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f8e6800a830 tx=0x7f8e6801faa0 comp rx=0 tx=0).stop 2023-06-10T19:00:43.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.172+0000 7f8e75766640 1 -- 172.21.15.53:0/3039100647 reap_dead start 2023-06-10T19:00:43.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.172+0000 7f8e771c9640 1 -- 172.21.15.53:0/3039100647 shutdown_connections 2023-06-10T19:00:43.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.172+0000 7f8e771c9640 1 -- 172.21.15.53:0/3039100647 >> 172.21.15.53:0/3039100647 conn(0x7f8e700cafc0 msgr2=0x7f8e700cb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:43.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.172+0000 7f8e771c9640 1 -- 172.21.15.53:0/3039100647 shutdown_connections 2023-06-10T19:00:43.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.172+0000 7f8e771c9640 1 -- 172.21.15.53:0/3039100647 wait complete. 2023-06-10T19:00:43.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.172+0000 7f8e771c9640 1 Processor -- start 2023-06-10T19:00:43.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.172+0000 7f8e771c9640 1 -- start start 2023-06-10T19:00:43.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.176+0000 7f8e771c9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8e58004d10 0x7f8e70144630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:43.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.176+0000 7f8e771c9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8e70157880 0x7f8e700c58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:43.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.176+0000 7f8e771c9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e700c6400 0x7f8e700c6880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:43.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.176+0000 7f8e771c9640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e700c4f40 con 0x7f8e700c6400 2023-06-10T19:00:43.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.176+0000 7f8e771c9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e7015eb20 con 0x7f8e70157880 2023-06-10T19:00:43.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.176+0000 7f8e771c9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e70144b70 con 0x7f8e58004d10 2023-06-10T19:00:43.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.176+0000 7f8e75766640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e700c6400 0x7f8e700c6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:43.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.176+0000 7f8e75766640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e700c6400 0x7f8e700c6880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47542/0 (socket says 172.21.15.53:47542) 2023-06-10T19:00:43.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.176+0000 7f8e75766640 1 -- 172.21.15.53:0/532383526 learned_addr learned my addr 172.21.15.53:0/532383526 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:43.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.176+0000 7f8e6ffff640 1 --2- 172.21.15.53:0/532383526 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8e70157880 0x7f8e700c58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:43.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.176+0000 7f8e74f65640 1 --2- 172.21.15.53:0/532383526 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8e58004d10 0x7f8e70144630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:43.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.176+0000 7f8e75766640 1 -- 172.21.15.53:0/532383526 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8e58004d10 msgr2=0x7f8e70144630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:43.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.176+0000 7f8e75766640 1 --2- 172.21.15.53:0/532383526 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8e58004d10 0x7f8e70144630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:43.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.176+0000 7f8e75766640 1 -- 172.21.15.53:0/532383526 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8e70157880 msgr2=0x7f8e700c58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:43.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.176+0000 7f8e75766640 1 --2- 172.21.15.53:0/532383526 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8e70157880 0x7f8e700c58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:43.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.176+0000 7f8e75766640 1 -- 172.21.15.53:0/532383526 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e7015e840 con 0x7f8e700c6400 2023-06-10T19:00:43.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.176+0000 7f8e75766640 1 --2- 172.21.15.53:0/532383526 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e700c6400 0x7f8e700c6880 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f8e6809c1e0 tx=0x7f8e58005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:43.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.176+0000 7f8e6d7fa640 1 -- 172.21.15.53:0/532383526 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e680b6030 con 0x7f8e700c6400 2023-06-10T19:00:43.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.176+0000 7f8e6d7fa640 1 -- 172.21.15.53:0/532383526 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e680aa6d0 con 0x7f8e700c6400 2023-06-10T19:00:43.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.176+0000 7f8e771c9640 1 -- 172.21.15.53:0/532383526 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e700c4980 con 0x7f8e700c6400 2023-06-10T19:00:43.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.176+0000 7f8e6d7fa640 1 -- 172.21.15.53:0/532383526 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e68001b50 con 0x7f8e700c6400 2023-06-10T19:00:43.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.176+0000 7f8e771c9640 1 -- 172.21.15.53:0/532383526 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e700c5e20 con 0x7f8e700c6400 2023-06-10T19:00:43.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.176+0000 7f8e771c9640 1 -- 172.21.15.53:0/532383526 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e700c4ea0 con 0x7f8e700c6400 2023-06-10T19:00:43.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.176+0000 7f8e6d7fa640 1 -- 172.21.15.53:0/532383526 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8e68004b70 con 0x7f8e700c6400 2023-06-10T19:00:43.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.176+0000 7f8e6d7fa640 1 --2- 172.21.15.53:0/532383526 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8e5c066280 0x7f8e5c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:43.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.176+0000 7f8e6d7fa640 1 -- 172.21.15.53:0/532383526 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f8e680b9040 con 0x7f8e700c6400 2023-06-10T19:00:43.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.176+0000 7f8e74f65640 1 --2- 172.21.15.53:0/532383526 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8e5c066280 0x7f8e5c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:43.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.180+0000 7f8e74f65640 1 --2- 172.21.15.53:0/532383526 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8e5c066280 0x7f8e5c068730 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f8e60009a30 tx=0x7f8e60008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:43.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.180+0000 7f8e6d7fa640 1 -- 172.21.15.53:0/532383526 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8e680eeb30 con 0x7f8e700c6400 2023-06-10T19:00:43.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.336+0000 7f8e771c9640 1 -- 172.21.15.53:0/532383526 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8e7006ae70 con 0x7f8e700c6400 2023-06-10T19:00:43.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.340+0000 7f8e6d7fa640 1 -- 172.21.15.53:0/532383526 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+18469 (secure 0 0 0) 0x7f8e7006ae70 con 0x7f8e700c6400 2023-06-10T19:00:43.345 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:00:43.346 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":81,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:00:42.868063+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-06-10T19:00:19.188303+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-06-10T19:00:19.583756+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.53:6835/882186121":"2023-06-11T19:00:42.868037+0000","172.21.15.53:6834/882186121":"2023-06-11T19:00:42.868037+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:00:43.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.340+0000 7f8e771c9640 1 -- 172.21.15.53:0/532383526 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8e5c066280 msgr2=0x7f8e5c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:43.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.340+0000 7f8e771c9640 1 --2- 172.21.15.53:0/532383526 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8e5c066280 0x7f8e5c068730 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f8e60009a30 tx=0x7f8e60008040 comp rx=0 tx=0).stop 2023-06-10T19:00:43.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.340+0000 7f8e771c9640 1 -- 172.21.15.53:0/532383526 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e700c6400 msgr2=0x7f8e700c6880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:43.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.340+0000 7f8e771c9640 1 --2- 172.21.15.53:0/532383526 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e700c6400 0x7f8e700c6880 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f8e6809c1e0 tx=0x7f8e58005800 comp rx=0 tx=0).stop 2023-06-10T19:00:43.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.344+0000 7f8e771c9640 1 -- 172.21.15.53:0/532383526 shutdown_connections 2023-06-10T19:00:43.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.344+0000 7f8e771c9640 1 --2- 172.21.15.53:0/532383526 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8e5c066280 0x7f8e5c068730 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:43.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.344+0000 7f8e771c9640 1 --2- 172.21.15.53:0/532383526 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e700c6400 0x7f8e700c6880 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:43.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.344+0000 7f8e771c9640 1 --2- 172.21.15.53:0/532383526 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8e70157880 0x7f8e700c58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:43.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.344+0000 7f8e771c9640 1 --2- 172.21.15.53:0/532383526 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8e58004d10 0x7f8e70144630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:43.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.344+0000 7f8e771c9640 1 -- 172.21.15.53:0/532383526 >> 172.21.15.53:0/532383526 conn(0x7f8e700cafc0 msgr2=0x7f8e700b1520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:43.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.344+0000 7f8e771c9640 1 -- 172.21.15.53:0/532383526 shutdown_connections 2023-06-10T19:00:43.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.344+0000 7f8e771c9640 1 -- 172.21.15.53:0/532383526 wait complete. 2023-06-10T19:00:43.365 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-10T18:52:33.633114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-10T18:52:39.171487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-10T19:00:19.188303+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2023-06-10T19:00:19.583756+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-10T19:00:43.366 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-10T19:00:43.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.488+0000 7f51872ee640 1 Processor -- start 2023-06-10T19:00:43.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.488+0000 7f51872ee640 1 -- start start 2023-06-10T19:00:43.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.492+0000 7f51872ee640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f51800c9fa0 0x7f518006bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:43.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.492+0000 7f51872ee640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f518006c020 0x7f51800c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:43.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.492+0000 7f51872ee640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f518006b090 con 0x7f51800c87e0 2023-06-10T19:00:43.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.492+0000 7f51872ee640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51800ca370 con 0x7f51800c9fa0 2023-06-10T19:00:43.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.492+0000 7f51872ee640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5180070d50 con 0x7f518006c020 2023-06-10T19:00:43.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.492+0000 7f518508a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f51800c9fa0 0x7f518006bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:43.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.492+0000 7f518508a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f51800c9fa0 0x7f518006bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47554/0 (socket says 172.21.15.53:47554) 2023-06-10T19:00:43.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.492+0000 7f518508a640 1 -- 172.21.15.53:0/1247210408 learned_addr learned my addr 172.21.15.53:0/1247210408 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:43.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.492+0000 7f5184889640 1 --2- 172.21.15.53:0/1247210408 >> v2:172.21.15.117:3300/0 conn(0x7f518006c020 0x7f51800c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:43.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.492+0000 7f518508a640 1 -- 172.21.15.53:0/1247210408 >> v2:172.21.15.117:3300/0 conn(0x7f518006c020 msgr2=0x7f51800c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:43.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.492+0000 7f518508a640 1 --2- 172.21.15.53:0/1247210408 >> v2:172.21.15.117:3300/0 conn(0x7f518006c020 0x7f51800c82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:43.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.492+0000 7f518508a640 1 -- 172.21.15.53:0/1247210408 >> v1:172.21.15.117:6789/0 conn(0x7f51800c87e0 legacy=0x7f51800af760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:43.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.492+0000 7f518508a640 1 -- 172.21.15.53:0/1247210408 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5180071030 con 0x7f51800c9fa0 2023-06-10T19:00:43.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.492+0000 7f5184889640 1 --2- 172.21.15.53:0/1247210408 >> v2:172.21.15.117:3300/0 conn(0x7f518006c020 0x7f51800c82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:00:43.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.492+0000 7f518508a640 1 --2- 172.21.15.53:0/1247210408 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51800c9fa0 0x7f518006bae0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f518006ecb0 tx=0x7f517001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ccac462f51cc2fc server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:43.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.492+0000 7f5177fff640 1 -- 172.21.15.53:0/1247210408 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51700ac640 con 0x7f51800c9fa0 2023-06-10T19:00:43.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.492+0000 7f5177fff640 1 -- 172.21.15.53:0/1247210408 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51700ac7a0 con 0x7f51800c9fa0 2023-06-10T19:00:43.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.492+0000 7f5177fff640 1 -- 172.21.15.53:0/1247210408 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51700acb30 con 0x7f51800c9fa0 2023-06-10T19:00:43.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.496+0000 7f51872ee640 1 -- 172.21.15.53:0/1247210408 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51800c9fa0 msgr2=0x7f518006bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:43.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.496+0000 7f51872ee640 1 --2- 172.21.15.53:0/1247210408 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51800c9fa0 0x7f518006bae0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f518006ecb0 tx=0x7f517001c400 comp rx=0 tx=0).stop 2023-06-10T19:00:43.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.496+0000 7f51872ee640 1 -- 172.21.15.53:0/1247210408 shutdown_connections 2023-06-10T19:00:43.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.496+0000 7f51872ee640 1 --2- 172.21.15.53:0/1247210408 >> v2:172.21.15.117:3300/0 conn(0x7f518006c020 0x7f51800c82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:43.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.496+0000 7f51872ee640 1 --2- 172.21.15.53:0/1247210408 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51800c9fa0 0x7f518006bae0 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:43.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.496+0000 7f51872ee640 1 -- 172.21.15.53:0/1247210408 >> 172.21.15.53:0/1247210408 conn(0x7f518006a0e0 msgr2=0x7f51800cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:43.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.496+0000 7f51872ee640 1 -- 172.21.15.53:0/1247210408 shutdown_connections 2023-06-10T19:00:43.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.496+0000 7f51872ee640 1 -- 172.21.15.53:0/1247210408 wait complete. 2023-06-10T19:00:43.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.496+0000 7f51872ee640 1 Processor -- start 2023-06-10T19:00:43.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.496+0000 7f51872ee640 1 -- start start 2023-06-10T19:00:43.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.496+0000 7f51872ee640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f518006c020 0x7f51801f1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:43.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.496+0000 7f51872ee640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51800c87e0 0x7f51801f48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:43.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.496+0000 7f51872ee640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51800c9fa0 0x7f51800afd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:43.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.496+0000 7f51872ee640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51800a8710 con 0x7f51800c9fa0 2023-06-10T19:00:43.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.496+0000 7f51872ee640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51801f4de0 con 0x7f518006c020 2023-06-10T19:00:43.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.496+0000 7f51872ee640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51800a7a90 con 0x7f51800c87e0 2023-06-10T19:00:43.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.496+0000 7f518588b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51800c9fa0 0x7f51800afd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:43.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.496+0000 7f518588b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51800c9fa0 0x7f51800afd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47564/0 (socket says 172.21.15.53:47564) 2023-06-10T19:00:43.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.496+0000 7f518588b640 1 -- 172.21.15.53:0/1744817108 learned_addr learned my addr 172.21.15.53:0/1744817108 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:43.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.496+0000 7f5184889640 1 --2- 172.21.15.53:0/1744817108 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51800c87e0 0x7f51801f48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:43.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.496+0000 7f518508a640 1 --2- 172.21.15.53:0/1744817108 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f518006c020 0x7f51801f1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:43.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.496+0000 7f518588b640 1 -- 172.21.15.53:0/1744817108 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51800c87e0 msgr2=0x7f51801f48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:43.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.496+0000 7f518588b640 1 --2- 172.21.15.53:0/1744817108 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51800c87e0 0x7f51801f48a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:43.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.496+0000 7f518588b640 1 -- 172.21.15.53:0/1744817108 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f518006c020 msgr2=0x7f51801f1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:43.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.496+0000 7f518588b640 1 --2- 172.21.15.53:0/1744817108 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f518006c020 0x7f51801f1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:43.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.496+0000 7f518588b640 1 -- 172.21.15.53:0/1744817108 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51700094d0 con 0x7f51800c9fa0 2023-06-10T19:00:43.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.496+0000 7f518588b640 1 --2- 172.21.15.53:0/1744817108 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51800c9fa0 0x7f51800afd30 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f517800c780 tx=0x7f517800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:43.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.496+0000 7f5175ffb640 1 -- 172.21.15.53:0/1744817108 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5178004b70 con 0x7f51800c9fa0 2023-06-10T19:00:43.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.496+0000 7f5175ffb640 1 -- 172.21.15.53:0/1744817108 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f517800ce90 con 0x7f51800c9fa0 2023-06-10T19:00:43.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.496+0000 7f51872ee640 1 -- 172.21.15.53:0/1744817108 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51800a7d70 con 0x7f51800c9fa0 2023-06-10T19:00:43.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.496+0000 7f5175ffb640 1 -- 172.21.15.53:0/1744817108 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f517800a850 con 0x7f51800c9fa0 2023-06-10T19:00:43.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.496+0000 7f51872ee640 1 -- 172.21.15.53:0/1744817108 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51800a8330 con 0x7f51800c9fa0 2023-06-10T19:00:43.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.500+0000 7f51872ee640 1 -- 172.21.15.53:0/1744817108 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51800a8850 con 0x7f51800c9fa0 2023-06-10T19:00:43.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.500+0000 7f5175ffb640 1 -- 172.21.15.53:0/1744817108 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f517800a9b0 con 0x7f51800c9fa0 2023-06-10T19:00:43.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.500+0000 7f5175ffb640 1 --2- 172.21.15.53:0/1744817108 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5164066280 0x7f5164068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:43.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.500+0000 7f5175ffb640 1 -- 172.21.15.53:0/1744817108 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f5178083ed0 con 0x7f51800c9fa0 2023-06-10T19:00:43.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.500+0000 7f518508a640 1 --2- 172.21.15.53:0/1744817108 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5164066280 0x7f5164068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:43.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.500+0000 7f518508a640 1 --2- 172.21.15.53:0/1744817108 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5164066280 0x7f5164068730 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f51700ae000 tx=0x7f51700a6070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:43.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.504+0000 7f5175ffb640 1 -- 172.21.15.53:0/1744817108 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f51800a8850 con 0x7f51800c9fa0 2023-06-10T19:00:43.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.656+0000 7f51872ee640 1 -- 172.21.15.53:0/1744817108 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f51800a8850 con 0x7f51800c9fa0 2023-06-10T19:00:43.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.656+0000 7f5175ffb640 1 -- 172.21.15.53:0/1744817108 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) v1 ==== 93+0+10 (secure 0 0 0) 0x7f51800a8850 con 0x7f51800c9fa0 2023-06-10T19:00:43.662 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-06-10T19:00:43.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.660+0000 7f51872ee640 1 -- 172.21.15.53:0/1744817108 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5164066280 msgr2=0x7f5164068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:43.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.660+0000 7f51872ee640 1 --2- 172.21.15.53:0/1744817108 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5164066280 0x7f5164068730 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f51700ae000 tx=0x7f51700a6070 comp rx=0 tx=0).stop 2023-06-10T19:00:43.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.660+0000 7f51872ee640 1 -- 172.21.15.53:0/1744817108 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51800c9fa0 msgr2=0x7f51800afd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:43.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.660+0000 7f51872ee640 1 --2- 172.21.15.53:0/1744817108 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51800c9fa0 0x7f51800afd30 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f517800c780 tx=0x7f517800cc40 comp rx=0 tx=0).stop 2023-06-10T19:00:43.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.660+0000 7f51872ee640 1 -- 172.21.15.53:0/1744817108 shutdown_connections 2023-06-10T19:00:43.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.660+0000 7f51872ee640 1 --2- 172.21.15.53:0/1744817108 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5164066280 0x7f5164068730 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:43.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.660+0000 7f51872ee640 1 --2- 172.21.15.53:0/1744817108 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51800c9fa0 0x7f51800afd30 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:43.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.660+0000 7f51872ee640 1 --2- 172.21.15.53:0/1744817108 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51800c87e0 0x7f51801f48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:43.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.660+0000 7f51872ee640 1 --2- 172.21.15.53:0/1744817108 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f518006c020 0x7f51801f1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:43.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.660+0000 7f51872ee640 1 -- 172.21.15.53:0/1744817108 >> 172.21.15.53:0/1744817108 conn(0x7f518006a0e0 msgr2=0x7f51800c4d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:43.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.660+0000 7f51872ee640 1 -- 172.21.15.53:0/1744817108 shutdown_connections 2023-06-10T19:00:43.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.660+0000 7f51872ee640 1 -- 172.21.15.53:0/1744817108 wait complete. 2023-06-10T19:00:43.682 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-10T19:00:43.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.808+0000 7f3f2eac9640 1 Processor -- start 2023-06-10T19:00:43.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.808+0000 7f3f2eac9640 1 -- start start 2023-06-10T19:00:43.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.808+0000 7f3f2eac9640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3f280afe70 0x7f3f280cb820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:43.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.808+0000 7f3f2eac9640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f280ac910 con 0x7f3f2806c350 2023-06-10T19:00:43.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.808+0000 7f3f2eac9640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f280cbd60 con 0x7f3f280c97d0 2023-06-10T19:00:43.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.808+0000 7f3f2eac9640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f280ca5c0 con 0x7f3f280afe70 2023-06-10T19:00:43.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.808+0000 7f3f27fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f3f2806c350 0x7f3f280af760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:57656/0 (socket says 172.21.15.53:57656) 2023-06-10T19:00:43.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.808+0000 7f3f27fff640 1 -- 172.21.15.53:0/1557915100 learned_addr learned my addr 172.21.15.53:0/1557915100 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:00:43.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.808+0000 7f3f2d066640 1 --2- 172.21.15.53:0/1557915100 >> v2:172.21.15.117:3300/0 conn(0x7f3f280afe70 0x7f3f280cb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:43.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.808+0000 7f3f277fe640 1 -- 172.21.15.53:0/1557915100 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 772516395 0 0) 0x7f3f280ac910 con 0x7f3f2806c350 2023-06-10T19:00:43.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.808+0000 7f3f277fe640 1 -- 172.21.15.53:0/1557915100 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f10003530 con 0x7f3f2806c350 2023-06-10T19:00:43.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.808+0000 7f3f277fe640 1 -- 172.21.15.53:0/1557915100 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3429646013 0 0) 0x7f3f18001120 con 0x7f3f280c97d0 2023-06-10T19:00:43.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.808+0000 7f3f277fe640 1 -- 172.21.15.53:0/1557915100 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f280ac910 con 0x7f3f280c97d0 2023-06-10T19:00:43.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.808+0000 7f3f277fe640 1 -- 172.21.15.53:0/1557915100 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2196255403 0 0) 0x7f3f10003530 con 0x7f3f2806c350 2023-06-10T19:00:43.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.808+0000 7f3f277fe640 1 -- 172.21.15.53:0/1557915100 >> v2:172.21.15.117:3300/0 conn(0x7f3f280afe70 msgr2=0x7f3f280cb820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:43.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.808+0000 7f3f277fe640 1 --2- 172.21.15.53:0/1557915100 >> v2:172.21.15.117:3300/0 conn(0x7f3f280afe70 0x7f3f280cb820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:43.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.808+0000 7f3f277fe640 1 -- 172.21.15.53:0/1557915100 >> v1:172.21.15.117:6789/0 conn(0x7f3f280c97d0 legacy=0x7f3f280ac200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:43.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.808+0000 7f3f277fe640 1 -- 172.21.15.53:0/1557915100 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f280abd70 con 0x7f3f2806c350 2023-06-10T19:00:43.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.808+0000 7f3f277fe640 1 -- 172.21.15.53:0/1557915100 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f3f1c001680 con 0x7f3f2806c350 2023-06-10T19:00:43.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.808+0000 7f3f277fe640 1 -- 172.21.15.53:0/1557915100 >> v1:172.21.15.53:6789/0 conn(0x7f3f2806c350 legacy=0x7f3f280af760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:43.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.808+0000 7f3f277fe640 1 --2- 172.21.15.53:0/1557915100 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3f10003b10 0x7f3f10003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:43.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.808+0000 7f3f277fe640 1 --2- 172.21.15.53:0/1557915100 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f100047d0 0x7f3f10004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:43.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.808+0000 7f3f277fe640 1 --2- 172.21.15.53:0/1557915100 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f100051f0 0x7f3f1000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:43.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.808+0000 7f3f277fe640 1 -- 172.21.15.53:0/1557915100 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f280ca5c0 con 0x7f3f100047d0 2023-06-10T19:00:43.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.808+0000 7f3f277fe640 1 -- 172.21.15.53:0/1557915100 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1000c130 con 0x7f3f100051f0 2023-06-10T19:00:43.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.808+0000 7f3f277fe640 1 -- 172.21.15.53:0/1557915100 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1000c2f0 con 0x7f3f10003b10 2023-06-10T19:00:43.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.808+0000 7f3f27fff640 1 --2- 172.21.15.53:0/1557915100 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f100047d0 0x7f3f10004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:43.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.808+0000 7f3f2d066640 1 --2- 172.21.15.53:0/1557915100 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f100051f0 0x7f3f1000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:43.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.808+0000 7f3f2c865640 1 --2- 172.21.15.53:0/1557915100 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3f10003b10 0x7f3f10003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:43.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.808+0000 7f3f27fff640 1 -- 172.21.15.53:0/1557915100 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3f10003b10 msgr2=0x7f3f10003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:43.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.808+0000 7f3f27fff640 1 --2- 172.21.15.53:0/1557915100 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3f10003b10 0x7f3f10003f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:43.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.808+0000 7f3f27fff640 1 -- 172.21.15.53:0/1557915100 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f100051f0 msgr2=0x7f3f1000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:43.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.808+0000 7f3f27fff640 1 --2- 172.21.15.53:0/1557915100 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f100051f0 0x7f3f1000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:43.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.808+0000 7f3f2d066640 1 -- 172.21.15.53:0/1557915100 reap_dead start 2023-06-10T19:00:43.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.808+0000 7f3f27fff640 1 -- 172.21.15.53:0/1557915100 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f10003530 con 0x7f3f100047d0 2023-06-10T19:00:43.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.808+0000 7f3f2c865640 1 --2- 172.21.15.53:0/1557915100 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3f10003b10 0x7f3f10003f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:00:43.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.812+0000 7f3f27fff640 1 --2- 172.21.15.53:0/1557915100 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f100047d0 0x7f3f10004c40 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c00c190 tx=0x7f3f1c01cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b45b4282d56d090f server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:43.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.812+0000 7f3f277fe640 1 -- 172.21.15.53:0/1557915100 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f1c0058e0 con 0x7f3f100047d0 2023-06-10T19:00:43.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.812+0000 7f3f277fe640 1 -- 172.21.15.53:0/1557915100 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f1c005a40 con 0x7f3f100047d0 2023-06-10T19:00:43.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.812+0000 7f3f277fe640 1 -- 172.21.15.53:0/1557915100 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f1c005e50 con 0x7f3f100047d0 2023-06-10T19:00:43.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.812+0000 7f3f2eac9640 1 -- 172.21.15.53:0/1557915100 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f100047d0 msgr2=0x7f3f10004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:43.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.812+0000 7f3f2eac9640 1 --2- 172.21.15.53:0/1557915100 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f100047d0 0x7f3f10004c40 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c00c190 tx=0x7f3f1c01cba0 comp rx=0 tx=0).stop 2023-06-10T19:00:43.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.812+0000 7f3f2eac9640 1 -- 172.21.15.53:0/1557915100 shutdown_connections 2023-06-10T19:00:43.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.812+0000 7f3f2eac9640 1 --2- 172.21.15.53:0/1557915100 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f100047d0 0x7f3f10004c40 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:43.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.812+0000 7f3f2eac9640 1 -- 172.21.15.53:0/1557915100 >> 172.21.15.53:0/1557915100 conn(0x7f3f2806a0e0 msgr2=0x7f3f280cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:43.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.812+0000 7f3f2eac9640 1 -- 172.21.15.53:0/1557915100 shutdown_connections 2023-06-10T19:00:43.824 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.812+0000 7f3f2eac9640 1 -- 172.21.15.53:0/1557915100 wait complete. 2023-06-10T19:00:43.824 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.816+0000 7f3f2eac9640 1 Processor -- start 2023-06-10T19:00:43.824 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.816+0000 7f3f2eac9640 1 -- start start 2023-06-10T19:00:43.824 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.816+0000 7f3f2eac9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f100047d0 0x7f3f280b3320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:43.824 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.816+0000 7f3f2eac9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f2815e810 0x7f3f281f4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:43.824 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.816+0000 7f3f2eac9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3f281f4c70 0x7f3f2815c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:43.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.816+0000 7f3f2eac9640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2815e380 con 0x7f3f100047d0 2023-06-10T19:00:43.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.816+0000 7f3f2eac9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2815d7b0 con 0x7f3f2815e810 2023-06-10T19:00:43.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.816+0000 7f3f2eac9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f281f50e0 con 0x7f3f281f4c70 2023-06-10T19:00:43.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.816+0000 7f3f2c865640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f100047d0 0x7f3f280b3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:43.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.816+0000 7f3f2c865640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f100047d0 0x7f3f280b3320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47594/0 (socket says 172.21.15.53:47594) 2023-06-10T19:00:43.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.816+0000 7f3f2c865640 1 -- 172.21.15.53:0/2716863647 learned_addr learned my addr 172.21.15.53:0/2716863647 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:43.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.816+0000 7f3f2d066640 1 --2- 172.21.15.53:0/2716863647 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3f281f4c70 0x7f3f2815c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:43.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.816+0000 7f3f27fff640 1 --2- 172.21.15.53:0/2716863647 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f2815e810 0x7f3f281f4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:43.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.816+0000 7f3f2c865640 1 -- 172.21.15.53:0/2716863647 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3f281f4c70 msgr2=0x7f3f2815c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:43.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.816+0000 7f3f2c865640 1 --2- 172.21.15.53:0/2716863647 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3f281f4c70 0x7f3f2815c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:43.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.816+0000 7f3f2c865640 1 -- 172.21.15.53:0/2716863647 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f2815e810 msgr2=0x7f3f281f4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:43.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.816+0000 7f3f2c865640 1 --2- 172.21.15.53:0/2716863647 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f2815e810 0x7f3f281f4730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:43.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.816+0000 7f3f2c865640 1 -- 172.21.15.53:0/2716863647 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f2815da50 con 0x7f3f100047d0 2023-06-10T19:00:43.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.816+0000 7f3f2c865640 1 --2- 172.21.15.53:0/2716863647 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f100047d0 0x7f3f280b3320 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f3f1800d480 tx=0x7f3f1800d570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:43.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.816+0000 7f3f257fa640 1 -- 172.21.15.53:0/2716863647 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f18007020 con 0x7f3f100047d0 2023-06-10T19:00:43.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.816+0000 7f3f257fa640 1 -- 172.21.15.53:0/2716863647 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f18007180 con 0x7f3f100047d0 2023-06-10T19:00:43.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.816+0000 7f3f2eac9640 1 -- 172.21.15.53:0/2716863647 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f2815dd30 con 0x7f3f100047d0 2023-06-10T19:00:43.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.816+0000 7f3f257fa640 1 -- 172.21.15.53:0/2716863647 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f18007510 con 0x7f3f100047d0 2023-06-10T19:00:43.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.816+0000 7f3f2eac9640 1 -- 172.21.15.53:0/2716863647 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f2815ec80 con 0x7f3f100047d0 2023-06-10T19:00:43.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.816+0000 7f3f2eac9640 1 -- 172.21.15.53:0/2716863647 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f2804d790 con 0x7f3f100047d0 2023-06-10T19:00:43.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.816+0000 7f3f257fa640 1 -- 172.21.15.53:0/2716863647 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3f180067e0 con 0x7f3f100047d0 2023-06-10T19:00:43.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.820+0000 7f3f257fa640 1 --2- 172.21.15.53:0/2716863647 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3f14066280 0x7f3f14068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:43.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.820+0000 7f3f257fa640 1 -- 172.21.15.53:0/2716863647 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f3f18083780 con 0x7f3f100047d0 2023-06-10T19:00:43.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.820+0000 7f3f27fff640 1 --2- 172.21.15.53:0/2716863647 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3f14066280 0x7f3f14068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:43.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.820+0000 7f3f27fff640 1 --2- 172.21.15.53:0/2716863647 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3f14066280 0x7f3f14068730 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c0aa000 tx=0x7f3f1c001990 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:43.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.824+0000 7f3f257fa640 1 -- 172.21.15.53:0/2716863647 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3f18054630 con 0x7f3f100047d0 2023-06-10T19:00:43.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.984+0000 7f3f2eac9640 1 -- 172.21.15.53:0/2716863647 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3f280cbd60 con 0x7f3f100047d0 2023-06-10T19:00:43.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.984+0000 7f3f257fa640 1 -- 172.21.15.53:0/2716863647 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v81) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3f280cbd60 con 0x7f3f100047d0 2023-06-10T19:00:43.991 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-06-10T19:00:43.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.988+0000 7f3f2eac9640 1 -- 172.21.15.53:0/2716863647 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3f14066280 msgr2=0x7f3f14068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:43.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.988+0000 7f3f2eac9640 1 --2- 172.21.15.53:0/2716863647 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3f14066280 0x7f3f14068730 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c0aa000 tx=0x7f3f1c001990 comp rx=0 tx=0).stop 2023-06-10T19:00:43.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.988+0000 7f3f2eac9640 1 -- 172.21.15.53:0/2716863647 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f100047d0 msgr2=0x7f3f280b3320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:43.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.988+0000 7f3f2eac9640 1 --2- 172.21.15.53:0/2716863647 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f100047d0 0x7f3f280b3320 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f3f1800d480 tx=0x7f3f1800d570 comp rx=0 tx=0).stop 2023-06-10T19:00:43.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.988+0000 7f3f2eac9640 1 -- 172.21.15.53:0/2716863647 shutdown_connections 2023-06-10T19:00:43.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.988+0000 7f3f2eac9640 1 --2- 172.21.15.53:0/2716863647 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3f14066280 0x7f3f14068730 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:43.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.988+0000 7f3f2eac9640 1 --2- 172.21.15.53:0/2716863647 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3f281f4c70 0x7f3f2815c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:43.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.988+0000 7f3f2eac9640 1 --2- 172.21.15.53:0/2716863647 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f2815e810 0x7f3f281f4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:43.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.988+0000 7f3f2eac9640 1 --2- 172.21.15.53:0/2716863647 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f100047d0 0x7f3f280b3320 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:43.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.988+0000 7f3f2eac9640 1 -- 172.21.15.53:0/2716863647 >> 172.21.15.53:0/2716863647 conn(0x7f3f2806a0e0 msgr2=0x7f3f2806f910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:43.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.988+0000 7f3f2eac9640 1 -- 172.21.15.53:0/2716863647 shutdown_connections 2023-06-10T19:00:43.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:43.988+0000 7f3f2eac9640 1 -- 172.21.15.53:0/2716863647 wait complete. 2023-06-10T19:00:44.010 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-10T19:00:44.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.128+0000 7fa047c48640 1 Processor -- start 2023-06-10T19:00:44.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.128+0000 7fa047c48640 1 -- start start 2023-06-10T19:00:44.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.128+0000 7fa047c48640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa0400c9fa0 0x7fa04006bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:44.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.128+0000 7fa047c48640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa04006c020 0x7fa0400c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:44.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.128+0000 7fa047c48640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa04006b090 con 0x7fa0400c87e0 2023-06-10T19:00:44.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.128+0000 7fa047c48640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0400ca370 con 0x7fa0400c9fa0 2023-06-10T19:00:44.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.128+0000 7fa047c48640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa040070d50 con 0x7fa04006c020 2023-06-10T19:00:44.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.128+0000 7fa0459e4640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa0400c9fa0 0x7fa04006bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:44.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.128+0000 7fa0451e3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa04006c020 0x7fa0400c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:44.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.128+0000 7fa0459e4640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa0400c9fa0 0x7fa04006bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.53:39922/0 (socket says 172.21.15.53:39922) 2023-06-10T19:00:44.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.128+0000 7fa0459e4640 1 -- 172.21.15.53:0/1175634532 learned_addr learned my addr 172.21.15.53:0/1175634532 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:44.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.128+0000 7fa0451e3640 1 -- 172.21.15.53:0/1175634532 >> v2:172.21.15.117:3300/0 conn(0x7fa0400c9fa0 msgr2=0x7fa04006bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:44.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.128+0000 7fa0451e3640 1 --2- 172.21.15.53:0/1175634532 >> v2:172.21.15.117:3300/0 conn(0x7fa0400c9fa0 0x7fa04006bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:44.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.128+0000 7fa0451e3640 1 -- 172.21.15.53:0/1175634532 >> v1:172.21.15.117:6789/0 conn(0x7fa0400c87e0 legacy=0x7fa0400af760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:44.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.128+0000 7fa0451e3640 1 -- 172.21.15.53:0/1175634532 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa040071030 con 0x7fa04006c020 2023-06-10T19:00:44.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.128+0000 7fa0459e4640 1 --2- 172.21.15.53:0/1175634532 >> v2:172.21.15.117:3300/0 conn(0x7fa0400c9fa0 0x7fa04006bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-10T19:00:44.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.132+0000 7fa0451e3640 1 --2- 172.21.15.53:0/1175634532 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa04006c020 0x7fa0400c82a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa0300097c0 tx=0x7fa03001c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=329f2980143f3639 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:44.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.132+0000 7fa0449e2640 1 -- 172.21.15.53:0/1175634532 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0300ab600 con 0x7fa04006c020 2023-06-10T19:00:44.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.132+0000 7fa0449e2640 1 -- 172.21.15.53:0/1175634532 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0300a7050 con 0x7fa04006c020 2023-06-10T19:00:44.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.132+0000 7fa0449e2640 1 -- 172.21.15.53:0/1175634532 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0300ab980 con 0x7fa04006c020 2023-06-10T19:00:44.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.132+0000 7fa047c48640 1 -- 172.21.15.53:0/1175634532 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa04006c020 msgr2=0x7fa0400c82a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:44.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.132+0000 7fa047c48640 1 --2- 172.21.15.53:0/1175634532 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa04006c020 0x7fa0400c82a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa0300097c0 tx=0x7fa03001c3c0 comp rx=0 tx=0).stop 2023-06-10T19:00:44.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.132+0000 7fa047c48640 1 -- 172.21.15.53:0/1175634532 shutdown_connections 2023-06-10T19:00:44.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.132+0000 7fa047c48640 1 --2- 172.21.15.53:0/1175634532 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa04006c020 0x7fa0400c82a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:44.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.132+0000 7fa047c48640 1 --2- 172.21.15.53:0/1175634532 >> v2:172.21.15.117:3300/0 conn(0x7fa0400c9fa0 0x7fa04006bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:44.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.132+0000 7fa047c48640 1 -- 172.21.15.53:0/1175634532 >> 172.21.15.53:0/1175634532 conn(0x7fa04006a0e0 msgr2=0x7fa0400cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:44.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.132+0000 7fa047c48640 1 -- 172.21.15.53:0/1175634532 shutdown_connections 2023-06-10T19:00:44.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.132+0000 7fa047c48640 1 -- 172.21.15.53:0/1175634532 wait complete. 2023-06-10T19:00:44.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.132+0000 7fa047c48640 1 Processor -- start 2023-06-10T19:00:44.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.132+0000 7fa047c48640 1 -- start start 2023-06-10T19:00:44.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.136+0000 7fa047c48640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa04006c020 0x7fa0400cb820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:44.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.136+0000 7fa047c48640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0400c87e0 0x7fa0400aec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:44.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.136+0000 7fa047c48640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0400c9fa0 0x7fa040151270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:44.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.136+0000 7fa047c48640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0400cca10 con 0x7fa0400c9fa0 2023-06-10T19:00:44.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.136+0000 7fa047c48640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0400cbe00 con 0x7fa04006c020 2023-06-10T19:00:44.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.136+0000 7fa047c48640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0400cc0e0 con 0x7fa0400c87e0 2023-06-10T19:00:44.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.136+0000 7fa0461e5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0400c9fa0 0x7fa040151270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:44.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.136+0000 7fa0461e5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0400c9fa0 0x7fa040151270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47608/0 (socket says 172.21.15.53:47608) 2023-06-10T19:00:44.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.136+0000 7fa0461e5640 1 -- 172.21.15.53:0/1148944998 learned_addr learned my addr 172.21.15.53:0/1148944998 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:44.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.136+0000 7fa0451e3640 1 --2- 172.21.15.53:0/1148944998 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0400c87e0 0x7fa0400aec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:44.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.136+0000 7fa0459e4640 1 --2- 172.21.15.53:0/1148944998 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa04006c020 0x7fa0400cb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:44.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.136+0000 7fa0461e5640 1 -- 172.21.15.53:0/1148944998 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0400c87e0 msgr2=0x7fa0400aec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:44.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.136+0000 7fa0461e5640 1 --2- 172.21.15.53:0/1148944998 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0400c87e0 0x7fa0400aec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:44.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.136+0000 7fa0461e5640 1 -- 172.21.15.53:0/1148944998 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa04006c020 msgr2=0x7fa0400cb820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:44.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.136+0000 7fa0461e5640 1 --2- 172.21.15.53:0/1148944998 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa04006c020 0x7fa0400cb820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:44.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.136+0000 7fa0461e5640 1 -- 172.21.15.53:0/1148944998 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa03c0094d0 con 0x7fa0400c9fa0 2023-06-10T19:00:44.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.136+0000 7fa0461e5640 1 --2- 172.21.15.53:0/1148944998 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0400c9fa0 0x7fa040151270 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7fa03800c710 tx=0x7fa03800cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:44.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.136+0000 7fa0367fc640 1 -- 172.21.15.53:0/1148944998 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa038006d60 con 0x7fa0400c9fa0 2023-06-10T19:00:44.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.136+0000 7fa0367fc640 1 -- 172.21.15.53:0/1148944998 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa03800ce20 con 0x7fa0400c9fa0 2023-06-10T19:00:44.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.136+0000 7fa047c48640 1 -- 172.21.15.53:0/1148944998 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa030009420 con 0x7fa0400c9fa0 2023-06-10T19:00:44.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.136+0000 7fa0367fc640 1 -- 172.21.15.53:0/1148944998 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa038003bc0 con 0x7fa0400c9fa0 2023-06-10T19:00:44.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.136+0000 7fa047c48640 1 -- 172.21.15.53:0/1148944998 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0400cc6a0 con 0x7fa0400c9fa0 2023-06-10T19:00:44.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.136+0000 7fa0367fc640 1 -- 172.21.15.53:0/1148944998 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa038003d20 con 0x7fa0400c9fa0 2023-06-10T19:00:44.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.136+0000 7fa047c48640 1 -- 172.21.15.53:0/1148944998 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0400ccb80 con 0x7fa0400c9fa0 2023-06-10T19:00:44.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.136+0000 7fa0367fc640 1 --2- 172.21.15.53:0/1148944998 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa024066280 0x7fa024068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:44.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.136+0000 7fa0367fc640 1 -- 172.21.15.53:0/1148944998 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6148+0+0 (secure 0 0 0) 0x7fa0380837b0 con 0x7fa0400c9fa0 2023-06-10T19:00:44.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.136+0000 7fa0459e4640 1 --2- 172.21.15.53:0/1148944998 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa024066280 0x7fa024068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:44.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.140+0000 7fa0459e4640 1 --2- 172.21.15.53:0/1148944998 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa024066280 0x7fa024068730 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fa03c006cb0 tx=0x7fa03c009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:44.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.140+0000 7fa0367fc640 1 -- 172.21.15.53:0/1148944998 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa0380547a0 con 0x7fa0400c9fa0 2023-06-10T19:00:44.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.296+0000 7fa047c48640 1 -- 172.21.15.53:0/1148944998 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa04004d790 con 0x7fa0400c9fa0 2023-06-10T19:00:44.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.296+0000 7fa0367fc640 1 -- 172.21.15.53:0/1148944998 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v81) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa038054330 con 0x7fa0400c9fa0 2023-06-10T19:00:44.303 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-06-10T19:00:44.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.300+0000 7fa047c48640 1 -- 172.21.15.53:0/1148944998 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa024066280 msgr2=0x7fa024068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:44.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.300+0000 7fa047c48640 1 --2- 172.21.15.53:0/1148944998 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa024066280 0x7fa024068730 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fa03c006cb0 tx=0x7fa03c009240 comp rx=0 tx=0).stop 2023-06-10T19:00:44.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.300+0000 7fa047c48640 1 -- 172.21.15.53:0/1148944998 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0400c9fa0 msgr2=0x7fa040151270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:44.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.300+0000 7fa047c48640 1 --2- 172.21.15.53:0/1148944998 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0400c9fa0 0x7fa040151270 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7fa03800c710 tx=0x7fa03800cbd0 comp rx=0 tx=0).stop 2023-06-10T19:00:44.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.300+0000 7fa047c48640 1 -- 172.21.15.53:0/1148944998 shutdown_connections 2023-06-10T19:00:44.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.300+0000 7fa047c48640 1 --2- 172.21.15.53:0/1148944998 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa024066280 0x7fa024068730 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:44.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.300+0000 7fa047c48640 1 --2- 172.21.15.53:0/1148944998 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa0400c9fa0 0x7fa040151270 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:44.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.300+0000 7fa047c48640 1 --2- 172.21.15.53:0/1148944998 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa0400c87e0 0x7fa0400aec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:44.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.300+0000 7fa047c48640 1 --2- 172.21.15.53:0/1148944998 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa04006c020 0x7fa0400cb820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:44.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.300+0000 7fa047c48640 1 -- 172.21.15.53:0/1148944998 >> 172.21.15.53:0/1148944998 conn(0x7fa04006a0e0 msgr2=0x7fa0400ad7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:44.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.300+0000 7fa047c48640 1 -- 172.21.15.53:0/1148944998 shutdown_connections 2023-06-10T19:00:44.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.300+0000 7fa047c48640 1 -- 172.21.15.53:0/1148944998 wait complete. 2023-06-10T19:00:44.322 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-10T19:00:44.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.444+0000 7f9da5229640 1 Processor -- start 2023-06-10T19:00:44.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.444+0000 7f9da5229640 1 -- start start 2023-06-10T19:00:44.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.444+0000 7f9da5229640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9da00c9fa0 0x7f9da006bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:44.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.444+0000 7f9da5229640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9da00af760 0x7f9da00afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:44.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.444+0000 7f9da5229640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9da006b090 con 0x7f9da006c020 2023-06-10T19:00:44.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.444+0000 7f9da5229640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9da00b0120 con 0x7f9da00c9fa0 2023-06-10T19:00:44.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.444+0000 7f9da5229640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9da00ca370 con 0x7f9da00af760 2023-06-10T19:00:44.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.444+0000 7f9d9e59c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f9da006c020 0x7f9da00c82a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:57672/0 (socket says 172.21.15.53:57672) 2023-06-10T19:00:44.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.444+0000 7f9d9e59c640 1 -- 172.21.15.53:0/2556606558 learned_addr learned my addr 172.21.15.53:0/2556606558 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:00:44.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.444+0000 7f9d9f59e640 1 --2- 172.21.15.53:0/2556606558 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9da00af760 0x7f9da00afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:44.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.444+0000 7f9d9ed9d640 1 --2- 172.21.15.53:0/2556606558 >> v2:172.21.15.117:3300/0 conn(0x7f9da00c9fa0 0x7f9da006bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:44.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.444+0000 7f9d9dd9b640 1 -- 172.21.15.53:0/2556606558 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4109901504 0 0) 0x7f9da006b090 con 0x7f9da006c020 2023-06-10T19:00:44.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.444+0000 7f9d9dd9b640 1 -- 172.21.15.53:0/2556606558 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d88003530 con 0x7f9da006c020 2023-06-10T19:00:44.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.444+0000 7f9d9dd9b640 1 -- 172.21.15.53:0/2556606558 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3244164823 0 0) 0x7f9d88003530 con 0x7f9da006c020 2023-06-10T19:00:44.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.444+0000 7f9d9dd9b640 1 -- 172.21.15.53:0/2556606558 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9da00af760 msgr2=0x7f9da00afbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:44.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.444+0000 7f9d9dd9b640 1 --2- 172.21.15.53:0/2556606558 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9da00af760 0x7f9da00afbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:44.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.444+0000 7f9d9dd9b640 1 -- 172.21.15.53:0/2556606558 >> v2:172.21.15.117:3300/0 conn(0x7f9da00c9fa0 msgr2=0x7f9da006bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:44.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.444+0000 7f9d9dd9b640 1 --2- 172.21.15.53:0/2556606558 >> v2:172.21.15.117:3300/0 conn(0x7f9da00c9fa0 0x7f9da006bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:44.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.444+0000 7f9d9dd9b640 1 -- 172.21.15.53:0/2556606558 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9da0070d50 con 0x7f9da006c020 2023-06-10T19:00:44.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.444+0000 7f9d9dd9b640 1 -- 172.21.15.53:0/2556606558 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f9d94001680 con 0x7f9da006c020 2023-06-10T19:00:44.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.444+0000 7f9d9ed9d640 1 --2- 172.21.15.53:0/2556606558 >> v2:172.21.15.117:3300/0 conn(0x7f9da00c9fa0 0x7f9da006bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:00:44.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.444+0000 7f9d9dd9b640 1 -- 172.21.15.53:0/2556606558 >> v1:172.21.15.53:6789/0 conn(0x7f9da006c020 legacy=0x7f9da00c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:44.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.444+0000 7f9d9dd9b640 1 --2- 172.21.15.53:0/2556606558 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d88003980 0x7f9d88003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:44.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.444+0000 7f9d9dd9b640 1 --2- 172.21.15.53:0/2556606558 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d880047d0 0x7f9d88004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:44.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.444+0000 7f9d9dd9b640 1 --2- 172.21.15.53:0/2556606558 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d88005180 0x7f9d8800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:44.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.444+0000 7f9d9dd9b640 1 -- 172.21.15.53:0/2556606558 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da00b0120 con 0x7f9d88005180 2023-06-10T19:00:44.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.444+0000 7f9d9dd9b640 1 -- 172.21.15.53:0/2556606558 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da00ca370 con 0x7f9d880047d0 2023-06-10T19:00:44.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.444+0000 7f9d9dd9b640 1 -- 172.21.15.53:0/2556606558 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8800c030 con 0x7f9d88003980 2023-06-10T19:00:44.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.444+0000 7f9d9f59e640 1 --2- 172.21.15.53:0/2556606558 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9da00af760 0x7f9da00afbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:00:44.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.444+0000 7f9d9f59e640 1 --2- 172.21.15.53:0/2556606558 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d88005180 0x7f9d8800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:44.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.444+0000 7f9d9e59c640 1 --2- 172.21.15.53:0/2556606558 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d880047d0 0x7f9d88004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:44.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.444+0000 7f9d9ed9d640 1 --2- 172.21.15.53:0/2556606558 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d88003980 0x7f9d88003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:44.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.444+0000 7f9d9f59e640 1 -- 172.21.15.53:0/2556606558 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d88003980 msgr2=0x7f9d88003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:44.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.444+0000 7f9d9f59e640 1 --2- 172.21.15.53:0/2556606558 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d88003980 0x7f9d88003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:44.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.444+0000 7f9d9f59e640 1 -- 172.21.15.53:0/2556606558 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d880047d0 msgr2=0x7f9d88004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:44.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.444+0000 7f9d9f59e640 1 --2- 172.21.15.53:0/2556606558 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d880047d0 0x7f9d88004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:44.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.444+0000 7f9d9f59e640 1 -- 172.21.15.53:0/2556606558 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d88003530 con 0x7f9d88005180 2023-06-10T19:00:44.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.444+0000 7f9d9e59c640 1 --2- 172.21.15.53:0/2556606558 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d880047d0 0x7f9d88004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:00:44.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.448+0000 7f9d9f59e640 1 --2- 172.21.15.53:0/2556606558 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d88005180 0x7f9d8800b990 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f9d980096c0 tx=0x7f9d9801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=381ee5a908749ab7 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:44.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.448+0000 7f9d9dd9b640 1 -- 172.21.15.53:0/2556606558 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d980ab600 con 0x7f9d88005180 2023-06-10T19:00:44.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.448+0000 7f9d9dd9b640 1 -- 172.21.15.53:0/2556606558 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d980a7050 con 0x7f9d88005180 2023-06-10T19:00:44.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.448+0000 7f9d9dd9b640 1 -- 172.21.15.53:0/2556606558 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d980ab980 con 0x7f9d88005180 2023-06-10T19:00:44.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.448+0000 7f9da5229640 1 -- 172.21.15.53:0/2556606558 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d88005180 msgr2=0x7f9d8800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:44.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.448+0000 7f9da5229640 1 --2- 172.21.15.53:0/2556606558 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d88005180 0x7f9d8800b990 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f9d980096c0 tx=0x7f9d9801c3d0 comp rx=0 tx=0).stop 2023-06-10T19:00:44.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.448+0000 7f9d9f59e640 1 -- 172.21.15.53:0/2556606558 reap_dead start 2023-06-10T19:00:44.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.448+0000 7f9da5229640 1 -- 172.21.15.53:0/2556606558 shutdown_connections 2023-06-10T19:00:44.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.448+0000 7f9da5229640 1 -- 172.21.15.53:0/2556606558 >> 172.21.15.53:0/2556606558 conn(0x7f9da006a0e0 msgr2=0x7f9da00cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:44.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.448+0000 7f9da5229640 1 -- 172.21.15.53:0/2556606558 shutdown_connections 2023-06-10T19:00:44.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.448+0000 7f9da5229640 1 -- 172.21.15.53:0/2556606558 wait complete. 2023-06-10T19:00:44.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.448+0000 7f9da5229640 1 Processor -- start 2023-06-10T19:00:44.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.448+0000 7f9da5229640 1 -- start start 2023-06-10T19:00:44.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.448+0000 7f9da5229640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d88005180 0x7f9da01f14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:44.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.448+0000 7f9da5229640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9da01562c0 0x7f9da00cb820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:44.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.448+0000 7f9da5229640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9da00b2ee0 0x7f9da00b3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:44.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.448+0000 7f9da5229640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da00c6620 con 0x7f9d88005180 2023-06-10T19:00:44.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.448+0000 7f9da5229640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da00b3890 con 0x7f9da00b2ee0 2023-06-10T19:00:44.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.448+0000 7f9da5229640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9da01f19e0 con 0x7f9da01562c0 2023-06-10T19:00:44.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.452+0000 7f9d9ed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d88005180 0x7f9da01f14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:44.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.452+0000 7f9d9ed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d88005180 0x7f9da01f14a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47620/0 (socket says 172.21.15.53:47620) 2023-06-10T19:00:44.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.452+0000 7f9d9ed9d640 1 -- 172.21.15.53:0/869839104 learned_addr learned my addr 172.21.15.53:0/869839104 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:44.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.452+0000 7f9d9f59e640 1 --2- 172.21.15.53:0/869839104 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9da00b2ee0 0x7f9da00b3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:44.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.452+0000 7f9d9e59c640 1 --2- 172.21.15.53:0/869839104 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9da01562c0 0x7f9da00cb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:44.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.452+0000 7f9d9ed9d640 1 -- 172.21.15.53:0/869839104 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9da01562c0 msgr2=0x7f9da00cb820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:44.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.452+0000 7f9d9ed9d640 1 --2- 172.21.15.53:0/869839104 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9da01562c0 0x7f9da00cb820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:44.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.452+0000 7f9d9ed9d640 1 -- 172.21.15.53:0/869839104 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9da00b2ee0 msgr2=0x7f9da00b3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:44.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.452+0000 7f9d9ed9d640 1 --2- 172.21.15.53:0/869839104 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9da00b2ee0 0x7f9da00b3350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:44.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.452+0000 7f9d9ed9d640 1 -- 172.21.15.53:0/869839104 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9da01f4480 con 0x7f9d88005180 2023-06-10T19:00:44.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.452+0000 7f9d9e59c640 1 --2- 172.21.15.53:0/869839104 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9da01562c0 0x7f9da00cb820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:00:44.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.452+0000 7f9d9ed9d640 1 --2- 172.21.15.53:0/869839104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d88005180 0x7f9da01f14a0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f9d900046f0 tx=0x7f9d90007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:44.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.452+0000 7f9d877fe640 1 -- 172.21.15.53:0/869839104 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d90014610 con 0x7f9d88005180 2023-06-10T19:00:44.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.452+0000 7f9d877fe640 1 -- 172.21.15.53:0/869839104 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d9000f050 con 0x7f9d88005180 2023-06-10T19:00:44.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.452+0000 7f9d877fe640 1 -- 172.21.15.53:0/869839104 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d900149b0 con 0x7f9d88005180 2023-06-10T19:00:44.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.452+0000 7f9da5229640 1 -- 172.21.15.53:0/869839104 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9da01f4760 con 0x7f9d88005180 2023-06-10T19:00:44.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.452+0000 7f9da5229640 1 -- 172.21.15.53:0/869839104 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9da01f4d20 con 0x7f9d88005180 2023-06-10T19:00:44.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.452+0000 7f9da5229640 1 -- 172.21.15.53:0/869839104 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9da01f4ee0 con 0x7f9d88005180 2023-06-10T19:00:44.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.452+0000 7f9d877fe640 1 -- 172.21.15.53:0/869839104 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9d90014b10 con 0x7f9d88005180 2023-06-10T19:00:44.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.452+0000 7f9d877fe640 1 --2- 172.21.15.53:0/869839104 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9d8c0662b0 0x7f9d8c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:44.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.452+0000 7f9d877fe640 1 -- 172.21.15.53:0/869839104 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f9d900846b0 con 0x7f9d88005180 2023-06-10T19:00:44.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.452+0000 7f9d9e59c640 1 --2- 172.21.15.53:0/869839104 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9d8c0662b0 0x7f9d8c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:44.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.452+0000 7f9d9e59c640 1 --2- 172.21.15.53:0/869839104 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9d8c0662b0 0x7f9d8c068760 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f9d94001ec0 tx=0x7f9d94001450 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:44.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.456+0000 7f9d877fe640 1 -- 172.21.15.53:0/869839104 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9d90051ad0 con 0x7f9d88005180 2023-06-10T19:00:44.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.612+0000 7f9da5229640 1 -- 172.21.15.53:0/869839104 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9da004d790 con 0x7f9d88005180 2023-06-10T19:00:44.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.612+0000 7f9d877fe640 1 -- 172.21.15.53:0/869839104 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v81) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9d900550f0 con 0x7f9d88005180 2023-06-10T19:00:44.617 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-06-10T19:00:44.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.612+0000 7f9da5229640 1 -- 172.21.15.53:0/869839104 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9d8c0662b0 msgr2=0x7f9d8c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:44.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.612+0000 7f9da5229640 1 --2- 172.21.15.53:0/869839104 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9d8c0662b0 0x7f9d8c068760 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f9d94001ec0 tx=0x7f9d94001450 comp rx=0 tx=0).stop 2023-06-10T19:00:44.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.612+0000 7f9da5229640 1 -- 172.21.15.53:0/869839104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d88005180 msgr2=0x7f9da01f14a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:44.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.612+0000 7f9da5229640 1 --2- 172.21.15.53:0/869839104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d88005180 0x7f9da01f14a0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f9d900046f0 tx=0x7f9d90007700 comp rx=0 tx=0).stop 2023-06-10T19:00:44.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.612+0000 7f9da5229640 1 -- 172.21.15.53:0/869839104 shutdown_connections 2023-06-10T19:00:44.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.612+0000 7f9da5229640 1 --2- 172.21.15.53:0/869839104 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9d8c0662b0 0x7f9d8c068760 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:44.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.612+0000 7f9da5229640 1 --2- 172.21.15.53:0/869839104 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9da00b2ee0 0x7f9da00b3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:44.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.612+0000 7f9da5229640 1 --2- 172.21.15.53:0/869839104 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9da01562c0 0x7f9da00cb820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:44.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.612+0000 7f9da5229640 1 --2- 172.21.15.53:0/869839104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d88005180 0x7f9da01f14a0 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:44.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.612+0000 7f9da5229640 1 -- 172.21.15.53:0/869839104 >> 172.21.15.53:0/869839104 conn(0x7f9da006a0e0 msgr2=0x7f9da01429f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:44.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.612+0000 7f9da5229640 1 -- 172.21.15.53:0/869839104 shutdown_connections 2023-06-10T19:00:44.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.612+0000 7f9da5229640 1 -- 172.21.15.53:0/869839104 wait complete. 2023-06-10T19:00:44.637 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-10T19:00:44.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.748+0000 7fa39573d640 1 Processor -- start 2023-06-10T19:00:44.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.748+0000 7fa39573d640 1 -- start start 2023-06-10T19:00:44.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.752+0000 7fa39573d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa3900afee0 0x7fa3900aca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:44.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.752+0000 7fa39573d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3900ad0e0 con 0x7fa3900ac320 2023-06-10T19:00:44.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.752+0000 7fa39573d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3900cd400 con 0x7fa39015b870 2023-06-10T19:00:44.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.752+0000 7fa39573d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3900ccd40 con 0x7fa3900afee0 2023-06-10T19:00:44.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.752+0000 7fa38e7fc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa3900afee0 0x7fa3900aca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:44.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.752+0000 7fa38e7fc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa3900afee0 0x7fa3900aca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47634/0 (socket says 172.21.15.53:47634) 2023-06-10T19:00:44.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.752+0000 7fa38f7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fa3900ac320 0x7fa3900c8760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:57682/0 (socket says 172.21.15.53:57682) 2023-06-10T19:00:44.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.752+0000 7fa38e7fc640 1 -- 172.21.15.53:0/1919766841 learned_addr learned my addr 172.21.15.53:0/1919766841 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:44.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.752+0000 7fa38e7fc640 1 -- 172.21.15.53:0/1919766841 >> v1:172.21.15.117:6789/0 conn(0x7fa39015b870 legacy=0x7fa3900af7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:44.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.752+0000 7fa38e7fc640 1 -- 172.21.15.53:0/1919766841 >> v1:172.21.15.53:6789/0 conn(0x7fa3900ac320 legacy=0x7fa3900c8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:44.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.752+0000 7fa38e7fc640 1 -- 172.21.15.53:0/1919766841 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3900cd6e0 con 0x7fa3900afee0 2023-06-10T19:00:44.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.752+0000 7fa38e7fc640 1 --2- 172.21.15.53:0/1919766841 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3900afee0 0x7fa3900aca00 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7fa378009870 tx=0x7fa37801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e10268614626748 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:44.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.752+0000 7fa38dffb640 1 -- 172.21.15.53:0/1919766841 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3780ad680 con 0x7fa3900afee0 2023-06-10T19:00:44.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.752+0000 7fa38dffb640 1 -- 172.21.15.53:0/1919766841 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3780ad7e0 con 0x7fa3900afee0 2023-06-10T19:00:44.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.752+0000 7fa38dffb640 1 -- 172.21.15.53:0/1919766841 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3780adb70 con 0x7fa3900afee0 2023-06-10T19:00:44.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.752+0000 7fa39573d640 1 -- 172.21.15.53:0/1919766841 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3900afee0 msgr2=0x7fa3900aca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:44.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.752+0000 7fa39573d640 1 --2- 172.21.15.53:0/1919766841 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3900afee0 0x7fa3900aca00 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7fa378009870 tx=0x7fa37801c500 comp rx=0 tx=0).stop 2023-06-10T19:00:44.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.752+0000 7fa39573d640 1 -- 172.21.15.53:0/1919766841 shutdown_connections 2023-06-10T19:00:44.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.752+0000 7fa39573d640 1 --2- 172.21.15.53:0/1919766841 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3900afee0 0x7fa3900aca00 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:44.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.752+0000 7fa39573d640 1 -- 172.21.15.53:0/1919766841 >> 172.21.15.53:0/1919766841 conn(0x7fa3900ce9e0 msgr2=0x7fa3900ca7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:44.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.752+0000 7fa39573d640 1 -- 172.21.15.53:0/1919766841 shutdown_connections 2023-06-10T19:00:44.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.752+0000 7fa39573d640 1 -- 172.21.15.53:0/1919766841 wait complete. 2023-06-10T19:00:44.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.756+0000 7fa39573d640 1 Processor -- start 2023-06-10T19:00:44.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.756+0000 7fa39573d640 1 -- start start 2023-06-10T19:00:44.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.756+0000 7fa39573d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3900ac320 0x7fa390157840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:44.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.756+0000 7fa39573d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3900afee0 0x7fa390153970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:44.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.756+0000 7fa39573d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa39015b870 0x7fa390151e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:44.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.756+0000 7fa39573d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa390153eb0 con 0x7fa3900afee0 2023-06-10T19:00:44.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.756+0000 7fa39573d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa390158a50 con 0x7fa39015b870 2023-06-10T19:00:44.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.756+0000 7fa39573d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa390157ed0 con 0x7fa3900ac320 2023-06-10T19:00:44.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.756+0000 7fa38e7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3900afee0 0x7fa390153970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:44.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.756+0000 7fa38e7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3900afee0 0x7fa390153970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47646/0 (socket says 172.21.15.53:47646) 2023-06-10T19:00:44.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.756+0000 7fa38e7fc640 1 -- 172.21.15.53:0/2456525600 learned_addr learned my addr 172.21.15.53:0/2456525600 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:44.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.756+0000 7fa38f7fe640 1 --2- 172.21.15.53:0/2456525600 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa39015b870 0x7fa390151e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:44.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.756+0000 7fa38e7fc640 1 -- 172.21.15.53:0/2456525600 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3900ac320 msgr2=0x7fa390157840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:44.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.756+0000 7fa38effd640 1 --2- 172.21.15.53:0/2456525600 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3900ac320 0x7fa390157840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:44.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.756+0000 7fa38e7fc640 1 --2- 172.21.15.53:0/2456525600 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3900ac320 0x7fa390157840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:44.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.756+0000 7fa38e7fc640 1 -- 172.21.15.53:0/2456525600 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa39015b870 msgr2=0x7fa390151e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:44.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.756+0000 7fa38e7fc640 1 --2- 172.21.15.53:0/2456525600 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa39015b870 0x7fa390151e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:44.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.756+0000 7fa38e7fc640 1 -- 172.21.15.53:0/2456525600 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3780094d0 con 0x7fa3900afee0 2023-06-10T19:00:44.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.756+0000 7fa38f7fe640 1 --2- 172.21.15.53:0/2456525600 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa39015b870 0x7fa390151e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:00:44.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.756+0000 7fa38e7fc640 1 --2- 172.21.15.53:0/2456525600 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3900afee0 0x7fa390153970 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7fa378019110 tx=0x7fa37801ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:44.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.756+0000 7fa3877fe640 1 -- 172.21.15.53:0/2456525600 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3780bd070 con 0x7fa3900afee0 2023-06-10T19:00:44.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.756+0000 7fa3877fe640 1 -- 172.21.15.53:0/2456525600 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3780adce0 con 0x7fa3900afee0 2023-06-10T19:00:44.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.756+0000 7fa39573d640 1 -- 172.21.15.53:0/2456525600 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3901581b0 con 0x7fa3900afee0 2023-06-10T19:00:44.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.756+0000 7fa3877fe640 1 -- 172.21.15.53:0/2456525600 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3780b8670 con 0x7fa3900afee0 2023-06-10T19:00:44.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.756+0000 7fa39573d640 1 -- 172.21.15.53:0/2456525600 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa390158770 con 0x7fa3900afee0 2023-06-10T19:00:44.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.756+0000 7fa39573d640 1 -- 172.21.15.53:0/2456525600 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3900c2c40 con 0x7fa3900afee0 2023-06-10T19:00:44.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.760+0000 7fa3877fe640 1 -- 172.21.15.53:0/2456525600 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa3780b4070 con 0x7fa3900afee0 2023-06-10T19:00:44.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.760+0000 7fa3877fe640 1 --2- 172.21.15.53:0/2456525600 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa370066280 0x7fa370068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:44.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.760+0000 7fa3877fe640 1 -- 172.21.15.53:0/2456525600 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6148+0+0 (secure 0 0 0) 0x7fa37811d9c0 con 0x7fa3900afee0 2023-06-10T19:00:44.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.760+0000 7fa38effd640 1 --2- 172.21.15.53:0/2456525600 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa370066280 0x7fa370068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:44.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.760+0000 7fa38effd640 1 --2- 172.21.15.53:0/2456525600 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa370066280 0x7fa370068730 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fa380007bf0 tx=0x7fa380007240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:44.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.764+0000 7fa3877fe640 1 -- 172.21.15.53:0/2456525600 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa3900c2c40 con 0x7fa3900afee0 2023-06-10T19:00:44.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.932+0000 7fa39573d640 1 -- 172.21.15.53:0/2456525600 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa3900c2c40 con 0x7fa3900afee0 2023-06-10T19:00:44.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.932+0000 7fa3877fe640 1 -- 172.21.15.53:0/2456525600 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v81) v1 ==== 80+0+120 (secure 0 0 0) 0x7fa3900c2c40 con 0x7fa3900afee0 2023-06-10T19:00:44.937 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:6835/882186121 2023-06-11T19:00:42.868037+0000 2023-06-10T19:00:44.937 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:6834/882186121 2023-06-11T19:00:42.868037+0000 2023-06-10T19:00:44.937 INFO:teuthology.orchestra.run.smithi053.stderr:listed 2 entries 2023-06-10T19:00:44.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.932+0000 7fa39573d640 1 -- 172.21.15.53:0/2456525600 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa370066280 msgr2=0x7fa370068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:44.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.932+0000 7fa39573d640 1 --2- 172.21.15.53:0/2456525600 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa370066280 0x7fa370068730 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fa380007bf0 tx=0x7fa380007240 comp rx=0 tx=0).stop 2023-06-10T19:00:44.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.932+0000 7fa39573d640 1 -- 172.21.15.53:0/2456525600 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3900afee0 msgr2=0x7fa390153970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:44.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.932+0000 7fa39573d640 1 --2- 172.21.15.53:0/2456525600 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3900afee0 0x7fa390153970 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7fa378019110 tx=0x7fa37801ad40 comp rx=0 tx=0).stop 2023-06-10T19:00:44.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.932+0000 7fa39573d640 1 -- 172.21.15.53:0/2456525600 shutdown_connections 2023-06-10T19:00:44.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.932+0000 7fa39573d640 1 --2- 172.21.15.53:0/2456525600 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa370066280 0x7fa370068730 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:44.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.932+0000 7fa39573d640 1 --2- 172.21.15.53:0/2456525600 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa39015b870 0x7fa390151e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:44.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.932+0000 7fa39573d640 1 --2- 172.21.15.53:0/2456525600 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3900afee0 0x7fa390153970 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:44.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.932+0000 7fa39573d640 1 --2- 172.21.15.53:0/2456525600 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3900ac320 0x7fa390157840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:44.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.932+0000 7fa39573d640 1 -- 172.21.15.53:0/2456525600 >> 172.21.15.53:0/2456525600 conn(0x7fa3900ce9e0 msgr2=0x7fa3900723f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:44.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.932+0000 7fa39573d640 1 -- 172.21.15.53:0/2456525600 shutdown_connections 2023-06-10T19:00:44.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:44.932+0000 7fa39573d640 1 -- 172.21.15.53:0/2456525600 wait complete. 2023-06-10T19:00:44.956 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T19:00:44.956 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:00:44.961 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:00:45.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.120+0000 7f7256e31640 1 Processor -- start 2023-06-10T19:00:45.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.120+0000 7f7256e31640 1 -- start start 2023-06-10T19:00:45.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.120+0000 7f7256e31640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7250070f80 0x7f72500ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:45.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.120+0000 7f7256e31640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72500ce990 0x7f7250069450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:45.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.120+0000 7f7256e31640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f725015f2c0 con 0x7f725015eef0 2023-06-10T19:00:45.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.120+0000 7f7256e31640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f725015fdc0 con 0x7f7250070f80 2023-06-10T19:00:45.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.120+0000 7f7256e31640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72501600a0 con 0x7f72500ce990 2023-06-10T19:00:45.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.120+0000 7f724ffff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7250070f80 0x7f72500ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:45.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.120+0000 7f724ffff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7250070f80 0x7f72500ce450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47662/0 (socket says 172.21.15.53:47662) 2023-06-10T19:00:45.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.120+0000 7f724ffff640 1 -- 172.21.15.53:0/3541518731 learned_addr learned my addr 172.21.15.53:0/3541518731 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:45.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.120+0000 7f72553ce640 1 --2- 172.21.15.53:0/3541518731 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72500ce990 0x7f7250069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:45.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.120+0000 7f724ffff640 1 -- 172.21.15.53:0/3541518731 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72500ce990 msgr2=0x7f7250069450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:45.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.120+0000 7f724ffff640 1 --2- 172.21.15.53:0/3541518731 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72500ce990 0x7f7250069450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:45.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.120+0000 7f724ffff640 1 -- 172.21.15.53:0/3541518731 >> v1:172.21.15.117:6789/0 conn(0x7f725015eef0 legacy=0x7f725015f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:45.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.120+0000 7f724ffff640 1 -- 172.21.15.53:0/3541518731 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7250160380 con 0x7f7250070f80 2023-06-10T19:00:45.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.120+0000 7f72553ce640 1 --2- 172.21.15.53:0/3541518731 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72500ce990 0x7f7250069450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:00:45.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.124+0000 7f724ffff640 1 --2- 172.21.15.53:0/3541518731 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7250070f80 0x7f72500ce450 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f7244009870 tx=0x7f724401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0586ec4da41233 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:45.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.124+0000 7f724f7fe640 1 -- 172.21.15.53:0/3541518731 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72440ab600 con 0x7f7250070f80 2023-06-10T19:00:45.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.124+0000 7f724f7fe640 1 -- 172.21.15.53:0/3541518731 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72440a7050 con 0x7f7250070f80 2023-06-10T19:00:45.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.124+0000 7f724f7fe640 1 -- 172.21.15.53:0/3541518731 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72440ab980 con 0x7f7250070f80 2023-06-10T19:00:45.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.124+0000 7f7256e31640 1 -- 172.21.15.53:0/3541518731 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7250070f80 msgr2=0x7f72500ce450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:45.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.124+0000 7f7256e31640 1 --2- 172.21.15.53:0/3541518731 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7250070f80 0x7f72500ce450 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f7244009870 tx=0x7f724401c540 comp rx=0 tx=0).stop 2023-06-10T19:00:45.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.124+0000 7f7256e31640 1 -- 172.21.15.53:0/3541518731 shutdown_connections 2023-06-10T19:00:45.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.124+0000 7f7256e31640 1 --2- 172.21.15.53:0/3541518731 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72500ce990 0x7f7250069450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:45.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.124+0000 7f7256e31640 1 --2- 172.21.15.53:0/3541518731 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7250070f80 0x7f72500ce450 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:45.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.124+0000 7f7256e31640 1 -- 172.21.15.53:0/3541518731 >> 172.21.15.53:0/3541518731 conn(0x7f725006a560 msgr2=0x7f725006a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:45.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.124+0000 7f7256e31640 1 -- 172.21.15.53:0/3541518731 shutdown_connections 2023-06-10T19:00:45.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.124+0000 7f7256e31640 1 -- 172.21.15.53:0/3541518731 wait complete. 2023-06-10T19:00:45.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.124+0000 7f7256e31640 1 Processor -- start 2023-06-10T19:00:45.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.124+0000 7f7256e31640 1 -- start start 2023-06-10T19:00:45.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.128+0000 7f7256e31640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7250070f80 0x7f7250156590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:45.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.128+0000 7f7256e31640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f72500ce990 0x7f7250151c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:45.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.128+0000 7f7256e31640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f725015eef0 0x7f72501521d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:45.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.128+0000 7f7256e31640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72500ae840 con 0x7f72500ce990 2023-06-10T19:00:45.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.128+0000 7f7256e31640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7250152e80 con 0x7f725015eef0 2023-06-10T19:00:45.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.128+0000 7f7256e31640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72501536e0 con 0x7f7250070f80 2023-06-10T19:00:45.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.128+0000 7f724ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f72500ce990 0x7f7250151c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:45.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.128+0000 7f724ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f72500ce990 0x7f7250151c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47670/0 (socket says 172.21.15.53:47670) 2023-06-10T19:00:45.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.128+0000 7f724ffff640 1 -- 172.21.15.53:0/3762729868 learned_addr learned my addr 172.21.15.53:0/3762729868 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:45.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.128+0000 7f7254bcd640 1 --2- 172.21.15.53:0/3762729868 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7250070f80 0x7f7250156590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:45.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.128+0000 7f72553ce640 1 --2- 172.21.15.53:0/3762729868 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f725015eef0 0x7f72501521d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:45.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.128+0000 7f724ffff640 1 -- 172.21.15.53:0/3762729868 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7250070f80 msgr2=0x7f7250156590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:45.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.128+0000 7f724ffff640 1 --2- 172.21.15.53:0/3762729868 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7250070f80 0x7f7250156590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:45.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.128+0000 7f724ffff640 1 -- 172.21.15.53:0/3762729868 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f725015eef0 msgr2=0x7f72501521d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:45.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.128+0000 7f724ffff640 1 --2- 172.21.15.53:0/3762729868 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f725015eef0 0x7f72501521d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:45.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.128+0000 7f724ffff640 1 -- 172.21.15.53:0/3762729868 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72440094d0 con 0x7f72500ce990 2023-06-10T19:00:45.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.128+0000 7f72553ce640 1 --2- 172.21.15.53:0/3762729868 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f725015eef0 0x7f72501521d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:00:45.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.128+0000 7f724ffff640 1 --2- 172.21.15.53:0/3762729868 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f72500ce990 0x7f7250151c90 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f724401a170 tx=0x7f72440192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:45.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.128+0000 7f724d7fa640 1 -- 172.21.15.53:0/3762729868 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72440aa7b0 con 0x7f72500ce990 2023-06-10T19:00:45.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.128+0000 7f724d7fa640 1 -- 172.21.15.53:0/3762729868 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72440aa910 con 0x7f72500ce990 2023-06-10T19:00:45.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.128+0000 7f724d7fa640 1 -- 172.21.15.53:0/3762729868 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72440aac80 con 0x7f72500ce990 2023-06-10T19:00:45.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.128+0000 7f7256e31640 1 -- 172.21.15.53:0/3762729868 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72500ae560 con 0x7f72500ce990 2023-06-10T19:00:45.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.128+0000 7f7256e31640 1 -- 172.21.15.53:0/3762729868 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7250153370 con 0x7f72500ce990 2023-06-10T19:00:45.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.128+0000 7f7256e31640 1 -- 172.21.15.53:0/3762729868 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f725004dfe0 con 0x7f72500ce990 2023-06-10T19:00:45.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.128+0000 7f724d7fa640 1 -- 172.21.15.53:0/3762729868 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f72440b2070 con 0x7f72500ce990 2023-06-10T19:00:45.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.128+0000 7f724d7fa640 1 --2- 172.21.15.53:0/3762729868 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f723c0662b0 0x7f723c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:45.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.128+0000 7f724d7fa640 1 -- 172.21.15.53:0/3762729868 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f724411d300 con 0x7f72500ce990 2023-06-10T19:00:45.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.128+0000 7f7254bcd640 1 --2- 172.21.15.53:0/3762729868 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f723c0662b0 0x7f723c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:45.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.132+0000 7f7254bcd640 1 --2- 172.21.15.53:0/3762729868 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f723c0662b0 0x7f723c068760 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f725006a210 tx=0x7f7240009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:45.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.132+0000 7f724d7fa640 1 -- 172.21.15.53:0/3762729868 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f72440ea7b0 con 0x7f72500ce990 2023-06-10T19:00:45.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.288+0000 7f7256e31640 1 -- 172.21.15.53:0/3762729868 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7250153850 con 0x7f72500ce990 2023-06-10T19:00:45.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.292+0000 7f724d7fa640 1 -- 172.21.15.53:0/3762729868 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+18469 (secure 0 0 0) 0x7f72440eddd0 con 0x7f72500ce990 2023-06-10T19:00:45.296 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:00:45.296 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":81,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:00:42.868063+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-06-10T19:00:19.188303+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-06-10T19:00:19.583756+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.53:6835/882186121":"2023-06-11T19:00:42.868037+0000","172.21.15.53:6834/882186121":"2023-06-11T19:00:42.868037+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:00:45.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.292+0000 7f7256e31640 1 -- 172.21.15.53:0/3762729868 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f723c0662b0 msgr2=0x7f723c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:45.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.292+0000 7f7256e31640 1 --2- 172.21.15.53:0/3762729868 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f723c0662b0 0x7f723c068760 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f725006a210 tx=0x7f7240009040 comp rx=0 tx=0).stop 2023-06-10T19:00:45.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.292+0000 7f7256e31640 1 -- 172.21.15.53:0/3762729868 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f72500ce990 msgr2=0x7f7250151c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:45.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.292+0000 7f7256e31640 1 --2- 172.21.15.53:0/3762729868 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f72500ce990 0x7f7250151c90 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f724401a170 tx=0x7f72440192e0 comp rx=0 tx=0).stop 2023-06-10T19:00:45.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.292+0000 7f7256e31640 1 -- 172.21.15.53:0/3762729868 shutdown_connections 2023-06-10T19:00:45.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.292+0000 7f7256e31640 1 --2- 172.21.15.53:0/3762729868 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f723c0662b0 0x7f723c068760 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:45.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.292+0000 7f7256e31640 1 --2- 172.21.15.53:0/3762729868 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f725015eef0 0x7f72501521d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:45.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.292+0000 7f7256e31640 1 --2- 172.21.15.53:0/3762729868 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f72500ce990 0x7f7250151c90 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:45.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.292+0000 7f7256e31640 1 --2- 172.21.15.53:0/3762729868 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7250070f80 0x7f7250156590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:45.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.292+0000 7f7256e31640 1 -- 172.21.15.53:0/3762729868 >> 172.21.15.53:0/3762729868 conn(0x7f725006a560 msgr2=0x7f72500ab860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:45.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.292+0000 7f7256e31640 1 -- 172.21.15.53:0/3762729868 shutdown_connections 2023-06-10T19:00:45.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.292+0000 7f7256e31640 1 -- 172.21.15.53:0/3762729868 wait complete. 2023-06-10T19:00:45.314 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-10T18:52:33.633114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-10T18:52:39.171487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-10T19:00:19.188303+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2023-06-10T19:00:19.583756+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-10T19:00:45.315 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-10T19:00:45.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.424+0000 7efcbf280640 1 Processor -- start 2023-06-10T19:00:45.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.428+0000 7efcbf280640 1 -- start start 2023-06-10T19:00:45.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.428+0000 7efcbf280640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7efcb80c9fa0 0x7efcb806bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:45.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.428+0000 7efcbf280640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcb806b090 con 0x7efcb80af760 2023-06-10T19:00:45.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.428+0000 7efcbf280640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcb80ca370 con 0x7efcb806c020 2023-06-10T19:00:45.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.428+0000 7efcbf280640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcb8070d50 con 0x7efcb80c9fa0 2023-06-10T19:00:45.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.428+0000 7efcbd01c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7efcb80c9fa0 0x7efcb806bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:45.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.428+0000 7efcbd01c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7efcb80c9fa0 0x7efcb806bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47680/0 (socket says 172.21.15.53:47680) 2023-06-10T19:00:45.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.428+0000 7efcbd01c640 1 -- 172.21.15.53:0/1025160334 learned_addr learned my addr 172.21.15.53:0/1025160334 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:45.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.428+0000 7efcbd01c640 1 -- 172.21.15.53:0/1025160334 >> v1:172.21.15.117:6789/0 conn(0x7efcb806c020 legacy=0x7efcb80c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:45.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.428+0000 7efcbd01c640 1 -- 172.21.15.53:0/1025160334 >> v1:172.21.15.53:6789/0 conn(0x7efcb80af760 legacy=0x7efcb80700e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:45.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.428+0000 7efcbd01c640 1 -- 172.21.15.53:0/1025160334 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcb8071030 con 0x7efcb80c9fa0 2023-06-10T19:00:45.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.428+0000 7efcbd01c640 1 --2- 172.21.15.53:0/1025160334 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efcb80c9fa0 0x7efcb806bae0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7efcb4009870 tx=0x7efcb401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a26f9f6112d568d9 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:45.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.432+0000 7efcaffff640 1 -- 172.21.15.53:0/1025160334 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb40ab640 con 0x7efcb80c9fa0 2023-06-10T19:00:45.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.432+0000 7efcaffff640 1 -- 172.21.15.53:0/1025160334 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcb40a7070 con 0x7efcb80c9fa0 2023-06-10T19:00:45.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.432+0000 7efcaffff640 1 -- 172.21.15.53:0/1025160334 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb40ab9c0 con 0x7efcb80c9fa0 2023-06-10T19:00:45.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.432+0000 7efcbf280640 1 -- 172.21.15.53:0/1025160334 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efcb80c9fa0 msgr2=0x7efcb806bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:45.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.432+0000 7efcbf280640 1 --2- 172.21.15.53:0/1025160334 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efcb80c9fa0 0x7efcb806bae0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7efcb4009870 tx=0x7efcb401c440 comp rx=0 tx=0).stop 2023-06-10T19:00:45.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.432+0000 7efcbf280640 1 -- 172.21.15.53:0/1025160334 shutdown_connections 2023-06-10T19:00:45.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.432+0000 7efcbf280640 1 --2- 172.21.15.53:0/1025160334 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efcb80c9fa0 0x7efcb806bae0 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:45.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.432+0000 7efcbf280640 1 -- 172.21.15.53:0/1025160334 >> 172.21.15.53:0/1025160334 conn(0x7efcb806a0e0 msgr2=0x7efcb80cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:45.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.432+0000 7efcbf280640 1 -- 172.21.15.53:0/1025160334 shutdown_connections 2023-06-10T19:00:45.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.432+0000 7efcbf280640 1 -- 172.21.15.53:0/1025160334 wait complete. 2023-06-10T19:00:45.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.432+0000 7efcbf280640 1 Processor -- start 2023-06-10T19:00:45.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.432+0000 7efcbf280640 1 -- start start 2023-06-10T19:00:45.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.432+0000 7efcbf280640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efcb806c020 0x7efcb80c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:45.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.432+0000 7efcbf280640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efcb80af760 0x7efcb8155d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:45.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.432+0000 7efcbf280640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcb80c9fa0 0x7efcb80c7680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:45.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.432+0000 7efcbf280640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb80c65e0 con 0x7efcb806c020 2023-06-10T19:00:45.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.432+0000 7efcbf280640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb80c68c0 con 0x7efcb80c9fa0 2023-06-10T19:00:45.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.432+0000 7efcbf280640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcb80c6ba0 con 0x7efcb80af760 2023-06-10T19:00:45.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.432+0000 7efcbd01c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efcb806c020 0x7efcb80c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:45.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.432+0000 7efcbd01c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efcb806c020 0x7efcb80c5b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47688/0 (socket says 172.21.15.53:47688) 2023-06-10T19:00:45.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.432+0000 7efcbd01c640 1 -- 172.21.15.53:0/1922348696 learned_addr learned my addr 172.21.15.53:0/1922348696 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:45.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.432+0000 7efcbd81d640 1 --2- 172.21.15.53:0/1922348696 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcb80c9fa0 0x7efcb80c7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:45.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.432+0000 7efcbc81b640 1 --2- 172.21.15.53:0/1922348696 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efcb80af760 0x7efcb8155d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:45.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.432+0000 7efcbd01c640 1 -- 172.21.15.53:0/1922348696 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efcb80af760 msgr2=0x7efcb8155d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:45.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.432+0000 7efcbd01c640 1 --2- 172.21.15.53:0/1922348696 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efcb80af760 0x7efcb8155d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:45.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.432+0000 7efcbd01c640 1 -- 172.21.15.53:0/1922348696 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcb80c9fa0 msgr2=0x7efcb80c7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:45.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.432+0000 7efcbd01c640 1 --2- 172.21.15.53:0/1922348696 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcb80c9fa0 0x7efcb80c7680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:45.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.432+0000 7efcbd01c640 1 -- 172.21.15.53:0/1922348696 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcb40094d0 con 0x7efcb806c020 2023-06-10T19:00:45.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.432+0000 7efcbd81d640 1 --2- 172.21.15.53:0/1922348696 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcb80c9fa0 0x7efcb80c7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:00:45.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.432+0000 7efcbd01c640 1 --2- 172.21.15.53:0/1922348696 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efcb806c020 0x7efcb80c5b20 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7efcb40ad040 tx=0x7efcb401ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:45.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.432+0000 7efcadffb640 1 -- 172.21.15.53:0/1922348696 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb40be3f0 con 0x7efcb806c020 2023-06-10T19:00:45.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.432+0000 7efcadffb640 1 -- 172.21.15.53:0/1922348696 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcb40be570 con 0x7efcb806c020 2023-06-10T19:00:45.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.432+0000 7efcbf280640 1 -- 172.21.15.53:0/1922348696 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcb80c6e80 con 0x7efcb806c020 2023-06-10T19:00:45.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.432+0000 7efcadffb640 1 -- 172.21.15.53:0/1922348696 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb40be920 con 0x7efcb806c020 2023-06-10T19:00:45.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.432+0000 7efcbf280640 1 -- 172.21.15.53:0/1922348696 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcb80bdc40 con 0x7efcb806c020 2023-06-10T19:00:45.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.436+0000 7efcbf280640 1 -- 172.21.15.53:0/1922348696 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcb804d790 con 0x7efcb806c020 2023-06-10T19:00:45.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.436+0000 7efcadffb640 1 -- 172.21.15.53:0/1922348696 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7efcb40b43f0 con 0x7efcb806c020 2023-06-10T19:00:45.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.436+0000 7efcadffb640 1 --2- 172.21.15.53:0/1922348696 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efc9c066280 0x7efc9c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:45.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.436+0000 7efcadffb640 1 -- 172.21.15.53:0/1922348696 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6148+0+0 (secure 0 0 0) 0x7efcb411e410 con 0x7efcb806c020 2023-06-10T19:00:45.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.436+0000 7efcbc81b640 1 --2- 172.21.15.53:0/1922348696 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efc9c066280 0x7efc9c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:45.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.436+0000 7efcbc81b640 1 --2- 172.21.15.53:0/1922348696 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efc9c066280 0x7efc9c068730 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7efcb80c1320 tx=0x7efca8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:45.445 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.440+0000 7efcadffb640 1 -- 172.21.15.53:0/1922348696 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7efcb40eb7c0 con 0x7efcb806c020 2023-06-10T19:00:45.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.588+0000 7efcbf280640 1 -- 172.21.15.53:0/1922348696 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efcb80ce670 con 0x7efcb806c020 2023-06-10T19:00:45.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.592+0000 7efcadffb640 1 -- 172.21.15.53:0/1922348696 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) v1 ==== 93+0+10 (secure 0 0 0) 0x7efcb40eede0 con 0x7efcb806c020 2023-06-10T19:00:45.597 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-06-10T19:00:45.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.592+0000 7efcbf280640 1 -- 172.21.15.53:0/1922348696 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efc9c066280 msgr2=0x7efc9c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:45.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.592+0000 7efcbf280640 1 --2- 172.21.15.53:0/1922348696 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efc9c066280 0x7efc9c068730 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7efcb80c1320 tx=0x7efca8009040 comp rx=0 tx=0).stop 2023-06-10T19:00:45.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.592+0000 7efcbf280640 1 -- 172.21.15.53:0/1922348696 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efcb806c020 msgr2=0x7efcb80c5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:45.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.592+0000 7efcbf280640 1 --2- 172.21.15.53:0/1922348696 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efcb806c020 0x7efcb80c5b20 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7efcb40ad040 tx=0x7efcb401ac80 comp rx=0 tx=0).stop 2023-06-10T19:00:45.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.592+0000 7efcbf280640 1 -- 172.21.15.53:0/1922348696 shutdown_connections 2023-06-10T19:00:45.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.592+0000 7efcbf280640 1 --2- 172.21.15.53:0/1922348696 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efc9c066280 0x7efc9c068730 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:45.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.592+0000 7efcbf280640 1 --2- 172.21.15.53:0/1922348696 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcb80c9fa0 0x7efcb80c7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:45.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.592+0000 7efcbf280640 1 --2- 172.21.15.53:0/1922348696 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efcb80af760 0x7efcb8155d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:45.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.592+0000 7efcbf280640 1 --2- 172.21.15.53:0/1922348696 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efcb806c020 0x7efcb80c5b20 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:45.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.592+0000 7efcbf280640 1 -- 172.21.15.53:0/1922348696 >> 172.21.15.53:0/1922348696 conn(0x7efcb806a0e0 msgr2=0x7efcb80b0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:45.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.592+0000 7efcbf280640 1 -- 172.21.15.53:0/1922348696 shutdown_connections 2023-06-10T19:00:45.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.592+0000 7efcbf280640 1 -- 172.21.15.53:0/1922348696 wait complete. 2023-06-10T19:00:45.614 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-10T19:00:45.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.736+0000 7f93ffdce640 1 Processor -- start 2023-06-10T19:00:45.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.736+0000 7f93ffdce640 1 -- start start 2023-06-10T19:00:45.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.736+0000 7f93ffdce640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f93f815c090 0x7f93f80b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:45.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.736+0000 7f93ffdce640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f93f80b0b90 0x7f93f80b7720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:45.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.736+0000 7f93ffdce640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93f80b7c60 0x7f93f80b3b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:45.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.736+0000 7f93ffdce640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93f80b80e0 con 0x7f93f80b0b90 2023-06-10T19:00:45.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.736+0000 7f93ffdce640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93f80cc7c0 con 0x7f93f815c090 2023-06-10T19:00:45.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.736+0000 7f93ffdce640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93f80ccaa0 con 0x7f93f80b7c60 2023-06-10T19:00:45.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.736+0000 7f93fd369640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f93f80b0b90 0x7f93f80b7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:45.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.736+0000 7f93fd369640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f93f80b0b90 0x7f93f80b7720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47700/0 (socket says 172.21.15.53:47700) 2023-06-10T19:00:45.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.736+0000 7f93fd369640 1 -- 172.21.15.53:0/4278675293 learned_addr learned my addr 172.21.15.53:0/4278675293 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:45.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.736+0000 7f93fdb6a640 1 --2- 172.21.15.53:0/4278675293 >> v2:172.21.15.117:3300/0 conn(0x7f93f815c090 0x7f93f80b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:45.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.736+0000 7f93fe36b640 1 --2- 172.21.15.53:0/4278675293 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93f80b7c60 0x7f93f80b3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:45.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.736+0000 7f93fd369640 1 -- 172.21.15.53:0/4278675293 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93f80b7c60 msgr2=0x7f93f80b3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:45.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.736+0000 7f93fd369640 1 --2- 172.21.15.53:0/4278675293 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93f80b7c60 0x7f93f80b3b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:45.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.736+0000 7f93fd369640 1 -- 172.21.15.53:0/4278675293 >> v2:172.21.15.117:3300/0 conn(0x7f93f815c090 msgr2=0x7f93f80b10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:45.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.736+0000 7f93fd369640 1 --2- 172.21.15.53:0/4278675293 >> v2:172.21.15.117:3300/0 conn(0x7f93f815c090 0x7f93f80b10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:45.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.736+0000 7f93fd369640 1 -- 172.21.15.53:0/4278675293 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93f80ccd80 con 0x7f93f80b0b90 2023-06-10T19:00:45.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.740+0000 7f93fd369640 1 --2- 172.21.15.53:0/4278675293 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93f80b0b90 0x7f93f80b7720 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f93f808a080 tx=0x7f93e801c180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dd73f6225a8cec5 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:45.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.740+0000 7f93fcb68640 1 -- 172.21.15.53:0/4278675293 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e80ab600 con 0x7f93f80b0b90 2023-06-10T19:00:45.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.740+0000 7f93fcb68640 1 -- 172.21.15.53:0/4278675293 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93e80a7050 con 0x7f93f80b0b90 2023-06-10T19:00:45.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.740+0000 7f93fcb68640 1 -- 172.21.15.53:0/4278675293 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e80ab980 con 0x7f93f80b0b90 2023-06-10T19:00:45.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.740+0000 7f93ffdce640 1 -- 172.21.15.53:0/4278675293 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93f80b0b90 msgr2=0x7f93f80b7720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:45.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.740+0000 7f93ffdce640 1 --2- 172.21.15.53:0/4278675293 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93f80b0b90 0x7f93f80b7720 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f93f808a080 tx=0x7f93e801c180 comp rx=0 tx=0).stop 2023-06-10T19:00:45.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.740+0000 7f93ffdce640 1 -- 172.21.15.53:0/4278675293 shutdown_connections 2023-06-10T19:00:45.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.740+0000 7f93ffdce640 1 --2- 172.21.15.53:0/4278675293 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93f80b7c60 0x7f93f80b3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:45.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.740+0000 7f93ffdce640 1 --2- 172.21.15.53:0/4278675293 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93f80b0b90 0x7f93f80b7720 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:45.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.740+0000 7f93ffdce640 1 --2- 172.21.15.53:0/4278675293 >> v2:172.21.15.117:3300/0 conn(0x7f93f815c090 0x7f93f80b10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:45.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.740+0000 7f93ffdce640 1 -- 172.21.15.53:0/4278675293 >> 172.21.15.53:0/4278675293 conn(0x7f93f8069e20 msgr2=0x7f93f806a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:45.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.740+0000 7f93ffdce640 1 -- 172.21.15.53:0/4278675293 shutdown_connections 2023-06-10T19:00:45.747 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.740+0000 7f93ffdce640 1 -- 172.21.15.53:0/4278675293 wait complete. 2023-06-10T19:00:45.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.740+0000 7f93ffdce640 1 Processor -- start 2023-06-10T19:00:45.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.740+0000 7f93ffdce640 1 -- start start 2023-06-10T19:00:45.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.744+0000 7f93ffdce640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93f80b0b90 0x7f93f80b2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:45.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.744+0000 7f93ffdce640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93f80b7c60 0x7f93f80b68c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:45.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.744+0000 7f93ffdce640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93f815c090 0x7f93f814b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:45.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.744+0000 7f93ffdce640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93f8150b10 con 0x7f93f815c090 2023-06-10T19:00:45.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.744+0000 7f93ffdce640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93f80b2ae0 con 0x7f93f80b0b90 2023-06-10T19:00:45.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.744+0000 7f93ffdce640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93f80b5de0 con 0x7f93f80b7c60 2023-06-10T19:00:45.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.744+0000 7f93fe36b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93f815c090 0x7f93f814b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:45.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.744+0000 7f93fe36b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93f815c090 0x7f93f814b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47710/0 (socket says 172.21.15.53:47710) 2023-06-10T19:00:45.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.744+0000 7f93fe36b640 1 -- 172.21.15.53:0/2674708161 learned_addr learned my addr 172.21.15.53:0/2674708161 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:45.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.744+0000 7f93fd369640 1 --2- 172.21.15.53:0/2674708161 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93f80b7c60 0x7f93f80b68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:45.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.744+0000 7f93fdb6a640 1 --2- 172.21.15.53:0/2674708161 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93f80b0b90 0x7f93f80b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:45.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.744+0000 7f93fe36b640 1 -- 172.21.15.53:0/2674708161 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93f80b7c60 msgr2=0x7f93f80b68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:45.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.744+0000 7f93fe36b640 1 --2- 172.21.15.53:0/2674708161 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93f80b7c60 0x7f93f80b68c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:45.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.744+0000 7f93fe36b640 1 -- 172.21.15.53:0/2674708161 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93f80b0b90 msgr2=0x7f93f80b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:45.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.744+0000 7f93fe36b640 1 --2- 172.21.15.53:0/2674708161 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93f80b0b90 0x7f93f80b2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:45.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.744+0000 7f93fe36b640 1 -- 172.21.15.53:0/2674708161 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93e80094d0 con 0x7f93f815c090 2023-06-10T19:00:45.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.744+0000 7f93fdb6a640 1 --2- 172.21.15.53:0/2674708161 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93f80b0b90 0x7f93f80b2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:00:45.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.744+0000 7f93fe36b640 1 --2- 172.21.15.53:0/2674708161 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93f815c090 0x7f93f814b520 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f93f0007e60 tx=0x7f93f000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:45.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.744+0000 7f93ee7fc640 1 -- 172.21.15.53:0/2674708161 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f0014620 con 0x7f93f815c090 2023-06-10T19:00:45.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.744+0000 7f93ee7fc640 1 -- 172.21.15.53:0/2674708161 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93f000ee90 con 0x7f93f815c090 2023-06-10T19:00:45.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.744+0000 7f93ee7fc640 1 -- 172.21.15.53:0/2674708161 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f00149e0 con 0x7f93f815c090 2023-06-10T19:00:45.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.744+0000 7f93ffdce640 1 -- 172.21.15.53:0/2674708161 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93f80b60c0 con 0x7f93f815c090 2023-06-10T19:00:45.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.744+0000 7f93ffdce640 1 -- 172.21.15.53:0/2674708161 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93f80b2dc0 con 0x7f93f815c090 2023-06-10T19:00:45.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.744+0000 7f93ffdce640 1 -- 172.21.15.53:0/2674708161 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93f804d790 con 0x7f93f815c090 2023-06-10T19:00:45.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.744+0000 7f93ee7fc640 1 -- 172.21.15.53:0/2674708161 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f93f0014b40 con 0x7f93f815c090 2023-06-10T19:00:45.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.744+0000 7f93ee7fc640 1 --2- 172.21.15.53:0/2674708161 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f93dc066280 0x7f93dc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:45.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.744+0000 7f93ee7fc640 1 -- 172.21.15.53:0/2674708161 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f93f00846d0 con 0x7f93f815c090 2023-06-10T19:00:45.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.744+0000 7f93fdb6a640 1 --2- 172.21.15.53:0/2674708161 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f93dc066280 0x7f93dc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:45.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.748+0000 7f93fdb6a640 1 --2- 172.21.15.53:0/2674708161 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f93dc066280 0x7f93dc068730 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f93f80b3530 tx=0x7f93f4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:45.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.748+0000 7f93ee7fc640 1 -- 172.21.15.53:0/2674708161 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f93f0051af0 con 0x7f93f815c090 2023-06-10T19:00:45.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.896+0000 7f93ffdce640 1 -- 172.21.15.53:0/2674708161 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f93f8153d70 con 0x7f93f815c090 2023-06-10T19:00:45.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.896+0000 7f93ee7fc640 1 -- 172.21.15.53:0/2674708161 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v81) v1 ==== 92+0+10 (secure 0 0 0) 0x7f93f0082e60 con 0x7f93f815c090 2023-06-10T19:00:45.901 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-06-10T19:00:45.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.896+0000 7f93ffdce640 1 -- 172.21.15.53:0/2674708161 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f93dc066280 msgr2=0x7f93dc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:45.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.896+0000 7f93ffdce640 1 --2- 172.21.15.53:0/2674708161 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f93dc066280 0x7f93dc068730 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f93f80b3530 tx=0x7f93f4008040 comp rx=0 tx=0).stop 2023-06-10T19:00:45.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.896+0000 7f93ffdce640 1 -- 172.21.15.53:0/2674708161 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93f815c090 msgr2=0x7f93f814b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:45.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.896+0000 7f93ffdce640 1 --2- 172.21.15.53:0/2674708161 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93f815c090 0x7f93f814b520 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f93f0007e60 tx=0x7f93f000e4b0 comp rx=0 tx=0).stop 2023-06-10T19:00:45.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.896+0000 7f93ffdce640 1 -- 172.21.15.53:0/2674708161 shutdown_connections 2023-06-10T19:00:45.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.896+0000 7f93ffdce640 1 --2- 172.21.15.53:0/2674708161 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f93dc066280 0x7f93dc068730 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:45.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.896+0000 7f93ffdce640 1 --2- 172.21.15.53:0/2674708161 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93f815c090 0x7f93f814b520 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:45.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.896+0000 7f93ffdce640 1 --2- 172.21.15.53:0/2674708161 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f93f80b7c60 0x7f93f80b68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:45.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.896+0000 7f93ffdce640 1 --2- 172.21.15.53:0/2674708161 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93f80b0b90 0x7f93f80b2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:45.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.896+0000 7f93ffdce640 1 -- 172.21.15.53:0/2674708161 >> 172.21.15.53:0/2674708161 conn(0x7f93f8069e20 msgr2=0x7f93f8153580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:45.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.896+0000 7f93ffdce640 1 -- 172.21.15.53:0/2674708161 shutdown_connections 2023-06-10T19:00:45.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:45.896+0000 7f93ffdce640 1 -- 172.21.15.53:0/2674708161 wait complete. 2023-06-10T19:00:45.919 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-10T19:00:46.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.032+0000 7f87445d0640 1 Processor -- start 2023-06-10T19:00:46.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.036+0000 7f87445d0640 1 -- start start 2023-06-10T19:00:46.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.036+0000 7f87445d0640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f873c0cc690 0x7f873c0d04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:46.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.036+0000 7f87445d0640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f873c0ccae0 0x7f873c0d09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:46.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.036+0000 7f87445d0640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f873c0d0020 con 0x7f873c0b3ac0 2023-06-10T19:00:46.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.036+0000 7f87445d0640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f873c0cef40 con 0x7f873c0ccae0 2023-06-10T19:00:46.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.036+0000 7f87445d0640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f873c0cf220 con 0x7f873c0cc690 2023-06-10T19:00:46.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.036+0000 7f8742b6d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f873c0ccae0 0x7f873c0d09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:46.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.036+0000 7f8742b6d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f873c0ccae0 0x7f873c0d09f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47722/0 (socket says 172.21.15.53:47722) 2023-06-10T19:00:46.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.036+0000 7f8742b6d640 1 -- 172.21.15.53:0/3980222072 learned_addr learned my addr 172.21.15.53:0/3980222072 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:46.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.036+0000 7f8742b6d640 1 -- 172.21.15.53:0/3980222072 >> v2:172.21.15.117:3300/0 conn(0x7f873c0cc690 msgr2=0x7f873c0d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:46.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.036+0000 7f8742b6d640 1 --2- 172.21.15.53:0/3980222072 >> v2:172.21.15.117:3300/0 conn(0x7f873c0cc690 0x7f873c0d04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:46.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.036+0000 7f8742b6d640 1 -- 172.21.15.53:0/3980222072 >> v1:172.21.15.117:6789/0 conn(0x7f873c0b3ac0 legacy=0x7f873c0b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:46.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.036+0000 7f8742b6d640 1 -- 172.21.15.53:0/3980222072 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f873c0cf500 con 0x7f873c0ccae0 2023-06-10T19:00:46.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.036+0000 7f8742b6d640 1 --2- 172.21.15.53:0/3980222072 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f873c0ccae0 0x7f873c0d09f0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f873c08aa80 tx=0x7f873401c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cf123ab82f7e12 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:46.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.036+0000 7f874136a640 1 -- 172.21.15.53:0/3980222072 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87340a5840 con 0x7f873c0ccae0 2023-06-10T19:00:46.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.036+0000 7f874136a640 1 -- 172.21.15.53:0/3980222072 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87340a59a0 con 0x7f873c0ccae0 2023-06-10T19:00:46.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.036+0000 7f874136a640 1 -- 172.21.15.53:0/3980222072 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87340a5d30 con 0x7f873c0ccae0 2023-06-10T19:00:46.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.040+0000 7f87445d0640 1 -- 172.21.15.53:0/3980222072 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f873c0ccae0 msgr2=0x7f873c0d09f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:46.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.040+0000 7f87445d0640 1 --2- 172.21.15.53:0/3980222072 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f873c0ccae0 0x7f873c0d09f0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f873c08aa80 tx=0x7f873401c960 comp rx=0 tx=0).stop 2023-06-10T19:00:46.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.040+0000 7f87445d0640 1 -- 172.21.15.53:0/3980222072 shutdown_connections 2023-06-10T19:00:46.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.040+0000 7f87445d0640 1 --2- 172.21.15.53:0/3980222072 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f873c0ccae0 0x7f873c0d09f0 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:46.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.040+0000 7f87445d0640 1 --2- 172.21.15.53:0/3980222072 >> v2:172.21.15.117:3300/0 conn(0x7f873c0cc690 0x7f873c0d04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:46.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.040+0000 7f87445d0640 1 -- 172.21.15.53:0/3980222072 >> 172.21.15.53:0/3980222072 conn(0x7f873c071790 msgr2=0x7f873c069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:46.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.040+0000 7f87445d0640 1 -- 172.21.15.53:0/3980222072 shutdown_connections 2023-06-10T19:00:46.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.040+0000 7f87445d0640 1 -- 172.21.15.53:0/3980222072 wait complete. 2023-06-10T19:00:46.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.040+0000 7f87445d0640 1 Processor -- start 2023-06-10T19:00:46.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.040+0000 7f87445d0640 1 -- start start 2023-06-10T19:00:46.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.040+0000 7f87445d0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f873c0b3ac0 0x7f873c1542b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:46.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.040+0000 7f87445d0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f873c0cc690 0x7f873c157060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:46.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.040+0000 7f87445d0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f873c0ccae0 0x7f873c1575a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:46.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.040+0000 7f87445d0640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f873c13f850 con 0x7f873c0b3ac0 2023-06-10T19:00:46.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.040+0000 7f87445d0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f873c1547f0 con 0x7f873c0cc690 2023-06-10T19:00:46.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.040+0000 7f87445d0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f873c157bb0 con 0x7f873c0ccae0 2023-06-10T19:00:46.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.040+0000 7f874236c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f873c0b3ac0 0x7f873c1542b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:46.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.040+0000 7f874236c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f873c0b3ac0 0x7f873c1542b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47730/0 (socket says 172.21.15.53:47730) 2023-06-10T19:00:46.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.040+0000 7f874236c640 1 -- 172.21.15.53:0/2215467795 learned_addr learned my addr 172.21.15.53:0/2215467795 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:46.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.040+0000 7f874236c640 1 -- 172.21.15.53:0/2215467795 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f873c0ccae0 msgr2=0x7f873c1575a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:46.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.040+0000 7f874236c640 1 --2- 172.21.15.53:0/2215467795 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f873c0ccae0 0x7f873c1575a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:46.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.040+0000 7f8741b6b640 1 --2- 172.21.15.53:0/2215467795 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f873c0cc690 0x7f873c157060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:46.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.040+0000 7f874236c640 1 -- 172.21.15.53:0/2215467795 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f873c0cc690 msgr2=0x7f873c157060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:46.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.040+0000 7f874236c640 1 --2- 172.21.15.53:0/2215467795 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f873c0cc690 0x7f873c157060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:46.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.040+0000 7f874236c640 1 -- 172.21.15.53:0/2215467795 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8734009b30 con 0x7f873c0b3ac0 2023-06-10T19:00:46.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.040+0000 7f8741b6b640 1 --2- 172.21.15.53:0/2215467795 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f873c0cc690 0x7f873c157060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:00:46.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.040+0000 7f874236c640 1 --2- 172.21.15.53:0/2215467795 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f873c0b3ac0 0x7f873c1542b0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f873800c490 tx=0x7f8738001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:46.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.040+0000 7f8732ffd640 1 -- 172.21.15.53:0/2215467795 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8738003600 con 0x7f873c0b3ac0 2023-06-10T19:00:46.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.040+0000 7f8732ffd640 1 -- 172.21.15.53:0/2215467795 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8738003780 con 0x7f873c0b3ac0 2023-06-10T19:00:46.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.040+0000 7f87445d0640 1 -- 172.21.15.53:0/2215467795 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f873c157e90 con 0x7f873c0b3ac0 2023-06-10T19:00:46.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.040+0000 7f8732ffd640 1 -- 172.21.15.53:0/2215467795 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8738003b70 con 0x7f873c0b3ac0 2023-06-10T19:00:46.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.040+0000 7f87445d0640 1 -- 172.21.15.53:0/2215467795 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f873c0b6880 con 0x7f873c0b3ac0 2023-06-10T19:00:46.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.040+0000 7f87445d0640 1 -- 172.21.15.53:0/2215467795 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f873c1580d0 con 0x7f873c0b3ac0 2023-06-10T19:00:46.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.044+0000 7f8732ffd640 1 -- 172.21.15.53:0/2215467795 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8738003cd0 con 0x7f873c0b3ac0 2023-06-10T19:00:46.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.044+0000 7f8732ffd640 1 --2- 172.21.15.53:0/2215467795 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8720066280 0x7f8720068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:46.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.044+0000 7f8732ffd640 1 -- 172.21.15.53:0/2215467795 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f87380833a0 con 0x7f873c0b3ac0 2023-06-10T19:00:46.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.044+0000 7f8741b6b640 1 --2- 172.21.15.53:0/2215467795 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8720066280 0x7f8720068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:46.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.044+0000 7f8741b6b640 1 --2- 172.21.15.53:0/2215467795 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8720066280 0x7f8720068730 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f873c166670 tx=0x7f872c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:46.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.048+0000 7f8732ffd640 1 -- 172.21.15.53:0/2215467795 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f873c1580d0 con 0x7f873c0b3ac0 2023-06-10T19:00:46.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.200+0000 7f87445d0640 1 -- 172.21.15.53:0/2215467795 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f873c1580d0 con 0x7f873c0b3ac0 2023-06-10T19:00:46.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.200+0000 7f8732ffd640 1 -- 172.21.15.53:0/2215467795 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v81) v1 ==== 104+0+11 (secure 0 0 0) 0x7f873c1580d0 con 0x7f873c0b3ac0 2023-06-10T19:00:46.206 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-06-10T19:00:46.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.200+0000 7f87445d0640 1 -- 172.21.15.53:0/2215467795 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8720066280 msgr2=0x7f8720068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:46.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.200+0000 7f87445d0640 1 --2- 172.21.15.53:0/2215467795 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8720066280 0x7f8720068730 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f873c166670 tx=0x7f872c008040 comp rx=0 tx=0).stop 2023-06-10T19:00:46.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.200+0000 7f87445d0640 1 -- 172.21.15.53:0/2215467795 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f873c0b3ac0 msgr2=0x7f873c1542b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:46.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.200+0000 7f87445d0640 1 --2- 172.21.15.53:0/2215467795 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f873c0b3ac0 0x7f873c1542b0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f873800c490 tx=0x7f8738001e80 comp rx=0 tx=0).stop 2023-06-10T19:00:46.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.200+0000 7f87445d0640 1 -- 172.21.15.53:0/2215467795 shutdown_connections 2023-06-10T19:00:46.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.200+0000 7f87445d0640 1 --2- 172.21.15.53:0/2215467795 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8720066280 0x7f8720068730 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:46.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.200+0000 7f87445d0640 1 --2- 172.21.15.53:0/2215467795 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f873c0ccae0 0x7f873c1575a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:46.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.200+0000 7f87445d0640 1 --2- 172.21.15.53:0/2215467795 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f873c0cc690 0x7f873c157060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:46.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.200+0000 7f87445d0640 1 --2- 172.21.15.53:0/2215467795 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f873c0b3ac0 0x7f873c1542b0 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:46.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.200+0000 7f87445d0640 1 -- 172.21.15.53:0/2215467795 >> 172.21.15.53:0/2215467795 conn(0x7f873c071790 msgr2=0x7f873c15b450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:46.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.200+0000 7f87445d0640 1 -- 172.21.15.53:0/2215467795 shutdown_connections 2023-06-10T19:00:46.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.200+0000 7f87445d0640 1 -- 172.21.15.53:0/2215467795 wait complete. 2023-06-10T19:00:46.224 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-10T19:00:46.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.348+0000 7f8cd480b640 1 Processor -- start 2023-06-10T19:00:46.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.348+0000 7f8cd480b640 1 -- start start 2023-06-10T19:00:46.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.348+0000 7f8cd480b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8cd006c350 0x7f8cd00cb820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:46.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.348+0000 7f8cd480b640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cd00ac910 con 0x7f8cd00c97d0 2023-06-10T19:00:46.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.348+0000 7f8cd480b640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cd00cbd60 con 0x7f8cd00af760 2023-06-10T19:00:46.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.348+0000 7f8cd480b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd00ca5c0 con 0x7f8cd006c350 2023-06-10T19:00:46.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.348+0000 7f8cce59c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f8cd00c97d0 0x7f8cd00ac200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:57706/0 (socket says 172.21.15.53:57706) 2023-06-10T19:00:46.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.348+0000 7f8cce59c640 1 -- 172.21.15.53:0/893098500 learned_addr learned my addr 172.21.15.53:0/893098500 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:00:46.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.348+0000 7f8ccd59a640 1 -- 172.21.15.53:0/893098500 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3091223325 0 0) 0x7f8cd00ac910 con 0x7f8cd00c97d0 2023-06-10T19:00:46.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.348+0000 7f8ccd59a640 1 -- 172.21.15.53:0/893098500 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8cb8003530 con 0x7f8cd00c97d0 2023-06-10T19:00:46.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.348+0000 7f8ccdd9b640 1 --2- 172.21.15.53:0/893098500 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8cd006c350 0x7f8cd00cb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:46.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.348+0000 7f8ccd59a640 1 -- 172.21.15.53:0/893098500 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1456317322 0 0) 0x7f8cb8003530 con 0x7f8cd00c97d0 2023-06-10T19:00:46.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.348+0000 7f8ccd59a640 1 -- 172.21.15.53:0/893098500 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8cd006c350 msgr2=0x7f8cd00cb820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:46.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.348+0000 7f8ccd59a640 1 --2- 172.21.15.53:0/893098500 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8cd006c350 0x7f8cd00cb820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:46.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.348+0000 7f8ccd59a640 1 -- 172.21.15.53:0/893098500 >> v1:172.21.15.117:6789/0 conn(0x7f8cd00af760 legacy=0x7f8cd006b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:46.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.348+0000 7f8ccd59a640 1 -- 172.21.15.53:0/893098500 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cd00abd70 con 0x7f8cd00c97d0 2023-06-10T19:00:46.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.348+0000 7f8ccd59a640 1 -- 172.21.15.53:0/893098500 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f8cc0001680 con 0x7f8cd00c97d0 2023-06-10T19:00:46.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.348+0000 7f8ccd59a640 1 -- 172.21.15.53:0/893098500 >> v1:172.21.15.53:6789/0 conn(0x7f8cd00c97d0 legacy=0x7f8cd00ac200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:46.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.348+0000 7f8ccd59a640 1 --2- 172.21.15.53:0/893098500 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8cd006c350 0x7f8cb80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:46.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.348+0000 7f8ccd59a640 1 --2- 172.21.15.53:0/893098500 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8cb8003fe0 0x7f8cb80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:46.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.348+0000 7f8ccd59a640 1 --2- 172.21.15.53:0/893098500 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8cb8004d60 0x7f8cb80051b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:46.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.348+0000 7f8ccd59a640 1 -- 172.21.15.53:0/893098500 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd00ca5c0 con 0x7f8cb8004d60 2023-06-10T19:00:46.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.348+0000 7f8ccd59a640 1 -- 172.21.15.53:0/893098500 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb800bc40 con 0x7f8cb8003fe0 2023-06-10T19:00:46.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.348+0000 7f8ccd59a640 1 -- 172.21.15.53:0/893098500 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb800be00 con 0x7f8cd006c350 2023-06-10T19:00:46.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.348+0000 7f8cced9d640 1 --2- 172.21.15.53:0/893098500 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8cb8004d60 0x7f8cb80051b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:46.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.348+0000 7f8cce59c640 1 --2- 172.21.15.53:0/893098500 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8cd006c350 0x7f8cb80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:46.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.348+0000 7f8ccdd9b640 1 --2- 172.21.15.53:0/893098500 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8cb8003fe0 0x7f8cb80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:46.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.348+0000 7f8cced9d640 1 -- 172.21.15.53:0/893098500 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8cd006c350 msgr2=0x7f8cb80039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:46.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.348+0000 7f8cced9d640 1 --2- 172.21.15.53:0/893098500 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8cd006c350 0x7f8cb80039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:46.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.348+0000 7f8cced9d640 1 -- 172.21.15.53:0/893098500 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8cb8003fe0 msgr2=0x7f8cb80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:46.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.348+0000 7f8cced9d640 1 --2- 172.21.15.53:0/893098500 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8cb8003fe0 0x7f8cb80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:46.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.348+0000 7f8cced9d640 1 -- 172.21.15.53:0/893098500 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cb8003530 con 0x7f8cb8004d60 2023-06-10T19:00:46.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.352+0000 7f8cced9d640 1 --2- 172.21.15.53:0/893098500 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8cb8004d60 0x7f8cb80051b0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f8cc8001cd0 tx=0x7f8cc801c5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ff2daab4219bcf8 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:46.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.352+0000 7f8ccd59a640 1 -- 172.21.15.53:0/893098500 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc8003b80 con 0x7f8cb8004d60 2023-06-10T19:00:46.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.352+0000 7f8ccd59a640 1 -- 172.21.15.53:0/893098500 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cc80a7050 con 0x7f8cb8004d60 2023-06-10T19:00:46.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.352+0000 7f8ccd59a640 1 -- 172.21.15.53:0/893098500 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc80050d0 con 0x7f8cb8004d60 2023-06-10T19:00:46.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.352+0000 7f8cd480b640 1 -- 172.21.15.53:0/893098500 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8cb8004d60 msgr2=0x7f8cb80051b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:46.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.352+0000 7f8cd480b640 1 --2- 172.21.15.53:0/893098500 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8cb8004d60 0x7f8cb80051b0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f8cc8001cd0 tx=0x7f8cc801c5c0 comp rx=0 tx=0).stop 2023-06-10T19:00:46.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.352+0000 7f8cced9d640 1 -- 172.21.15.53:0/893098500 reap_dead start 2023-06-10T19:00:46.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.352+0000 7f8cd480b640 1 -- 172.21.15.53:0/893098500 shutdown_connections 2023-06-10T19:00:46.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.352+0000 7f8cd480b640 1 -- 172.21.15.53:0/893098500 >> 172.21.15.53:0/893098500 conn(0x7f8cd006a0e0 msgr2=0x7f8cd00cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:46.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.352+0000 7f8cd480b640 1 -- 172.21.15.53:0/893098500 shutdown_connections 2023-06-10T19:00:46.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.352+0000 7f8cd480b640 1 -- 172.21.15.53:0/893098500 wait complete. 2023-06-10T19:00:46.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.352+0000 7f8cd480b640 1 Processor -- start 2023-06-10T19:00:46.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.352+0000 7f8cd480b640 1 -- start start 2023-06-10T19:00:46.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.356+0000 7f8cd480b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8cb8004d60 0x7f8cd015d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:46.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.356+0000 7f8cd480b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8cd01581a0 0x7f8cd015fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:46.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.356+0000 7f8cd480b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8cd01616a0 0x7f8cd0161b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:46.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.356+0000 7f8cd480b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd0162050 con 0x7f8cb8004d60 2023-06-10T19:00:46.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.356+0000 7f8cd480b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd01603c0 con 0x7f8cd01616a0 2023-06-10T19:00:46.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.356+0000 7f8cd480b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd01606a0 con 0x7f8cd01581a0 2023-06-10T19:00:46.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.356+0000 7f8cce59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8cb8004d60 0x7f8cd015d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:46.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.356+0000 7f8cce59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8cb8004d60 0x7f8cd015d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47758/0 (socket says 172.21.15.53:47758) 2023-06-10T19:00:46.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.356+0000 7f8cce59c640 1 -- 172.21.15.53:0/2863004249 learned_addr learned my addr 172.21.15.53:0/2863004249 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:46.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.356+0000 7f8ccdd9b640 1 --2- 172.21.15.53:0/2863004249 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8cd01581a0 0x7f8cd015fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:46.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.356+0000 7f8cce59c640 1 -- 172.21.15.53:0/2863004249 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8cd01581a0 msgr2=0x7f8cd015fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:46.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.356+0000 7f8cce59c640 1 --2- 172.21.15.53:0/2863004249 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8cd01581a0 0x7f8cd015fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:46.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.356+0000 7f8cce59c640 1 -- 172.21.15.53:0/2863004249 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8cd01616a0 msgr2=0x7f8cd0161b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:46.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.356+0000 7f8cce59c640 1 --2- 172.21.15.53:0/2863004249 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8cd01616a0 0x7f8cd0161b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:46.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.356+0000 7f8cce59c640 1 -- 172.21.15.53:0/2863004249 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cd0160980 con 0x7f8cb8004d60 2023-06-10T19:00:46.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.356+0000 7f8ccdd9b640 1 --2- 172.21.15.53:0/2863004249 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8cd01581a0 0x7f8cd015fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:00:46.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.356+0000 7f8cce59c640 1 --2- 172.21.15.53:0/2863004249 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8cb8004d60 0x7f8cd015d630 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f8cc000e7b0 tx=0x7f8cc000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:46.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.356+0000 7f8cbeffd640 1 -- 172.21.15.53:0/2863004249 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc000c850 con 0x7f8cb8004d60 2023-06-10T19:00:46.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.356+0000 7f8cbeffd640 1 -- 172.21.15.53:0/2863004249 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cc000c9b0 con 0x7f8cb8004d60 2023-06-10T19:00:46.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.356+0000 7f8cbeffd640 1 -- 172.21.15.53:0/2863004249 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc000cd60 con 0x7f8cb8004d60 2023-06-10T19:00:46.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.356+0000 7f8cd480b640 1 -- 172.21.15.53:0/2863004249 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cd0160c60 con 0x7f8cb8004d60 2023-06-10T19:00:46.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.356+0000 7f8cd480b640 1 -- 172.21.15.53:0/2863004249 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cd01600c0 con 0x7f8cb8004d60 2023-06-10T19:00:46.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.356+0000 7f8cd480b640 1 -- 172.21.15.53:0/2863004249 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cd0072af0 con 0x7f8cb8004d60 2023-06-10T19:00:46.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.356+0000 7f8cbeffd640 1 -- 172.21.15.53:0/2863004249 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8cc001d460 con 0x7f8cb8004d60 2023-06-10T19:00:46.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.356+0000 7f8cbeffd640 1 --2- 172.21.15.53:0/2863004249 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8cb0066280 0x7f8cb0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:46.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.356+0000 7f8cbeffd640 1 -- 172.21.15.53:0/2863004249 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f8cc0083d60 con 0x7f8cb8004d60 2023-06-10T19:00:46.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.356+0000 7f8ccdd9b640 1 --2- 172.21.15.53:0/2863004249 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8cb0066280 0x7f8cb0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:46.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.356+0000 7f8ccdd9b640 1 --2- 172.21.15.53:0/2863004249 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8cb0066280 0x7f8cb0068730 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f8cd00c91b0 tx=0x7f8cc4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:46.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.360+0000 7f8cbeffd640 1 -- 172.21.15.53:0/2863004249 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8cc0051180 con 0x7f8cb8004d60 2023-06-10T19:00:46.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.504+0000 7f8cd480b640 1 -- 172.21.15.53:0/2863004249 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8cd0161180 con 0x7f8cb8004d60 2023-06-10T19:00:46.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.508+0000 7f8cbeffd640 1 -- 172.21.15.53:0/2863004249 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v81) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8cd0161180 con 0x7f8cb8004d60 2023-06-10T19:00:46.512 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-06-10T19:00:46.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.508+0000 7f8cd480b640 1 -- 172.21.15.53:0/2863004249 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8cb0066280 msgr2=0x7f8cb0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:46.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.508+0000 7f8cd480b640 1 --2- 172.21.15.53:0/2863004249 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8cb0066280 0x7f8cb0068730 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f8cd00c91b0 tx=0x7f8cc4008040 comp rx=0 tx=0).stop 2023-06-10T19:00:46.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.508+0000 7f8cd480b640 1 -- 172.21.15.53:0/2863004249 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8cb8004d60 msgr2=0x7f8cd015d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:46.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.508+0000 7f8cd480b640 1 --2- 172.21.15.53:0/2863004249 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8cb8004d60 0x7f8cd015d630 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f8cc000e7b0 tx=0x7f8cc000ec70 comp rx=0 tx=0).stop 2023-06-10T19:00:46.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.508+0000 7f8cd480b640 1 -- 172.21.15.53:0/2863004249 shutdown_connections 2023-06-10T19:00:46.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.508+0000 7f8cd480b640 1 --2- 172.21.15.53:0/2863004249 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8cb0066280 0x7f8cb0068730 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:46.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.508+0000 7f8cd480b640 1 --2- 172.21.15.53:0/2863004249 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8cd01616a0 0x7f8cd0161b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:46.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.508+0000 7f8cd480b640 1 --2- 172.21.15.53:0/2863004249 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8cd01581a0 0x7f8cd015fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:46.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.508+0000 7f8cd480b640 1 --2- 172.21.15.53:0/2863004249 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8cb8004d60 0x7f8cd015d630 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:46.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.508+0000 7f8cd480b640 1 -- 172.21.15.53:0/2863004249 >> 172.21.15.53:0/2863004249 conn(0x7f8cd006a0e0 msgr2=0x7f8cd0070500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:46.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.508+0000 7f8cd480b640 1 -- 172.21.15.53:0/2863004249 shutdown_connections 2023-06-10T19:00:46.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.508+0000 7f8cd480b640 1 -- 172.21.15.53:0/2863004249 wait complete. 2023-06-10T19:00:46.530 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-10T19:00:46.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.652+0000 7ff6a2f88640 1 Processor -- start 2023-06-10T19:00:46.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.652+0000 7ff6a2f88640 1 -- start start 2023-06-10T19:00:46.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.652+0000 7ff6a2f88640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff69c0b3ac0 0x7ff69c0b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:46.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.652+0000 7ff6a2f88640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff69c0cc690 0x7ff69c0b43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:46.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.652+0000 7ff6a2f88640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff69c0ccde0 con 0x7ff69c0d1b00 2023-06-10T19:00:46.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.652+0000 7ff6a2f88640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff69c0ced00 con 0x7ff69c0b3ac0 2023-06-10T19:00:46.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.652+0000 7ff6a2f88640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff69c0cfc10 con 0x7ff69c0cc690 2023-06-10T19:00:46.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.652+0000 7ff6a1525640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ff69c0d1b00 0x7ff69c15f3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:57714/0 (socket says 172.21.15.53:57714) 2023-06-10T19:00:46.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.652+0000 7ff6a1525640 1 -- 172.21.15.53:0/4014411912 learned_addr learned my addr 172.21.15.53:0/4014411912 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:00:46.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.652+0000 7ff6a0d24640 1 --2- 172.21.15.53:0/4014411912 >> v2:172.21.15.53:3300/0 conn(0x7ff69c0b3ac0 0x7ff69c0b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:46.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.652+0000 7ff69bfff640 1 --2- 172.21.15.53:0/4014411912 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff69c0cc690 0x7ff69c0b43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:46.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.652+0000 7ff69b7fe640 1 -- 172.21.15.53:0/4014411912 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2723573761 0 0) 0x7ff69c0ccde0 con 0x7ff69c0d1b00 2023-06-10T19:00:46.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.652+0000 7ff69b7fe640 1 -- 172.21.15.53:0/4014411912 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff684003530 con 0x7ff69c0d1b00 2023-06-10T19:00:46.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.652+0000 7ff6a0d24640 1 -- 172.21.15.53:0/4014411912 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff69c0cc690 msgr2=0x7ff69c0b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:46.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.652+0000 7ff6a0d24640 1 --2- 172.21.15.53:0/4014411912 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff69c0cc690 0x7ff69c0b43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:46.660 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.652+0000 7ff6a0d24640 1 -- 172.21.15.53:0/4014411912 >> v1:172.21.15.53:6789/0 conn(0x7ff69c0d1b00 legacy=0x7ff69c15f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:46.660 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.652+0000 7ff6a0d24640 1 -- 172.21.15.53:0/4014411912 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff69c0b4910 con 0x7ff69c0b3ac0 2023-06-10T19:00:46.660 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.652+0000 7ff69bfff640 1 --2- 172.21.15.53:0/4014411912 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff69c0cc690 0x7ff69c0b43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:00:46.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.656+0000 7ff6a0d24640 1 --2- 172.21.15.53:0/4014411912 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff69c0b3ac0 0x7ff69c0b3e90 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7ff68c0097c0 tx=0x7ff68c01c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5974fabd3820d5a3 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:46.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.656+0000 7ff69b7fe640 1 -- 172.21.15.53:0/4014411912 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff68c0ab600 con 0x7ff69c0b3ac0 2023-06-10T19:00:46.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.656+0000 7ff69b7fe640 1 -- 172.21.15.53:0/4014411912 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff68c0a7050 con 0x7ff69c0b3ac0 2023-06-10T19:00:46.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.656+0000 7ff69b7fe640 1 -- 172.21.15.53:0/4014411912 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff68c0ab980 con 0x7ff69c0b3ac0 2023-06-10T19:00:46.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.656+0000 7ff6a2f88640 1 -- 172.21.15.53:0/4014411912 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff69c0b3ac0 msgr2=0x7ff69c0b3e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:46.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.656+0000 7ff6a2f88640 1 --2- 172.21.15.53:0/4014411912 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff69c0b3ac0 0x7ff69c0b3e90 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7ff68c0097c0 tx=0x7ff68c01c360 comp rx=0 tx=0).stop 2023-06-10T19:00:46.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.656+0000 7ff6a2f88640 1 -- 172.21.15.53:0/4014411912 shutdown_connections 2023-06-10T19:00:46.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.656+0000 7ff6a2f88640 1 --2- 172.21.15.53:0/4014411912 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff69c0cc690 0x7ff69c0b43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:46.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.656+0000 7ff6a2f88640 1 --2- 172.21.15.53:0/4014411912 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff69c0b3ac0 0x7ff69c0b3e90 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:46.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.656+0000 7ff6a2f88640 1 -- 172.21.15.53:0/4014411912 >> 172.21.15.53:0/4014411912 conn(0x7ff69c069de0 msgr2=0x7ff69c06a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:46.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.656+0000 7ff6a2f88640 1 -- 172.21.15.53:0/4014411912 shutdown_connections 2023-06-10T19:00:46.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.656+0000 7ff6a2f88640 1 -- 172.21.15.53:0/4014411912 wait complete. 2023-06-10T19:00:46.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.656+0000 7ff6a2f88640 1 Processor -- start 2023-06-10T19:00:46.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.656+0000 7ff6a2f88640 1 -- start start 2023-06-10T19:00:46.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.656+0000 7ff6a2f88640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff69c0b3ac0 0x7ff69c155470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:46.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.656+0000 7ff6a2f88640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff69c0cc690 0x7ff69c15c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:46.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.656+0000 7ff6a2f88640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff69c0d1b00 0x7ff69c0b5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:46.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.656+0000 7ff6a2f88640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff69c15e6b0 con 0x7ff69c0cc690 2023-06-10T19:00:46.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.656+0000 7ff6a2f88640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff69c0c8a50 con 0x7ff69c0b3ac0 2023-06-10T19:00:46.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.656+0000 7ff6a2f88640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff69c15d750 con 0x7ff69c0d1b00 2023-06-10T19:00:46.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.656+0000 7ff69bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff69c0cc690 0x7ff69c15c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:46.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.656+0000 7ff69bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff69c0cc690 0x7ff69c15c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47774/0 (socket says 172.21.15.53:47774) 2023-06-10T19:00:46.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.656+0000 7ff69bfff640 1 -- 172.21.15.53:0/4130735071 learned_addr learned my addr 172.21.15.53:0/4130735071 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:46.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.660+0000 7ff6a0d24640 1 --2- 172.21.15.53:0/4130735071 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff69c0b3ac0 0x7ff69c155470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:46.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.660+0000 7ff69bfff640 1 -- 172.21.15.53:0/4130735071 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff69c0d1b00 msgr2=0x7ff69c0b5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:46.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.660+0000 7ff6a1525640 1 --2- 172.21.15.53:0/4130735071 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff69c0d1b00 0x7ff69c0b5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:46.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.660+0000 7ff69bfff640 1 --2- 172.21.15.53:0/4130735071 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff69c0d1b00 0x7ff69c0b5e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:46.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.660+0000 7ff69bfff640 1 -- 172.21.15.53:0/4130735071 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff69c0b3ac0 msgr2=0x7ff69c155470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:46.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.660+0000 7ff69bfff640 1 --2- 172.21.15.53:0/4130735071 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff69c0b3ac0 0x7ff69c155470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:46.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.660+0000 7ff69bfff640 1 -- 172.21.15.53:0/4130735071 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff68c009420 con 0x7ff69c0cc690 2023-06-10T19:00:46.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.660+0000 7ff6a0d24640 1 --2- 172.21.15.53:0/4130735071 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff69c0b3ac0 0x7ff69c155470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:00:46.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.660+0000 7ff69bfff640 1 --2- 172.21.15.53:0/4130735071 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff69c0cc690 0x7ff69c15c8c0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7ff69000e810 tx=0x7ff69000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:46.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.660+0000 7ff6997fa640 1 -- 172.21.15.53:0/4130735071 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69000c8d0 con 0x7ff69c0cc690 2023-06-10T19:00:46.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.660+0000 7ff6997fa640 1 -- 172.21.15.53:0/4130735071 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff69000ca30 con 0x7ff69c0cc690 2023-06-10T19:00:46.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.660+0000 7ff6a2f88640 1 -- 172.21.15.53:0/4130735071 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff69c15da30 con 0x7ff69c0cc690 2023-06-10T19:00:46.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.660+0000 7ff6997fa640 1 -- 172.21.15.53:0/4130735071 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69000cdc0 con 0x7ff69c0cc690 2023-06-10T19:00:46.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.660+0000 7ff6a2f88640 1 -- 172.21.15.53:0/4130735071 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff69c15dff0 con 0x7ff69c0cc690 2023-06-10T19:00:46.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.660+0000 7ff6a2f88640 1 -- 172.21.15.53:0/4130735071 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff69c04d790 con 0x7ff69c0cc690 2023-06-10T19:00:46.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.660+0000 7ff6997fa640 1 -- 172.21.15.53:0/4130735071 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff690013410 con 0x7ff69c0cc690 2023-06-10T19:00:46.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.660+0000 7ff6997fa640 1 --2- 172.21.15.53:0/4130735071 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff688066280 0x7ff688068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:46.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.660+0000 7ff6997fa640 1 -- 172.21.15.53:0/4130735071 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6148+0+0 (secure 0 0 0) 0x7ff690083b40 con 0x7ff69c0cc690 2023-06-10T19:00:46.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.660+0000 7ff6a0d24640 1 --2- 172.21.15.53:0/4130735071 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff688066280 0x7ff688068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:46.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.660+0000 7ff6a0d24640 1 --2- 172.21.15.53:0/4130735071 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff688066280 0x7ff688068730 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7ff68c0ad000 tx=0x7ff68c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:46.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.664+0000 7ff6997fa640 1 -- 172.21.15.53:0/4130735071 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff690050ff0 con 0x7ff69c0cc690 2023-06-10T19:00:46.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.832+0000 7ff6a2f88640 1 -- 172.21.15.53:0/4130735071 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff69c06ac70 con 0x7ff69c0cc690 2023-06-10T19:00:46.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.836+0000 7ff6997fa640 1 -- 172.21.15.53:0/4130735071 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v81) v1 ==== 80+0+120 (secure 0 0 0) 0x7ff690009480 con 0x7ff69c0cc690 2023-06-10T19:00:46.840 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:6835/882186121 2023-06-11T19:00:42.868037+0000 2023-06-10T19:00:46.840 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:6834/882186121 2023-06-11T19:00:42.868037+0000 2023-06-10T19:00:46.841 INFO:teuthology.orchestra.run.smithi053.stderr:listed 2 entries 2023-06-10T19:00:46.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.836+0000 7ff6a2f88640 1 -- 172.21.15.53:0/4130735071 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff688066280 msgr2=0x7ff688068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:46.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.836+0000 7ff6a2f88640 1 --2- 172.21.15.53:0/4130735071 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff688066280 0x7ff688068730 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7ff68c0ad000 tx=0x7ff68c008040 comp rx=0 tx=0).stop 2023-06-10T19:00:46.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.836+0000 7ff6a2f88640 1 -- 172.21.15.53:0/4130735071 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff69c0cc690 msgr2=0x7ff69c15c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:46.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.836+0000 7ff6a2f88640 1 --2- 172.21.15.53:0/4130735071 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff69c0cc690 0x7ff69c15c8c0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7ff69000e810 tx=0x7ff69000ecd0 comp rx=0 tx=0).stop 2023-06-10T19:00:46.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.836+0000 7ff6a2f88640 1 -- 172.21.15.53:0/4130735071 shutdown_connections 2023-06-10T19:00:46.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.836+0000 7ff6a2f88640 1 --2- 172.21.15.53:0/4130735071 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff688066280 0x7ff688068730 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:46.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.836+0000 7ff6a2f88640 1 --2- 172.21.15.53:0/4130735071 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff69c0d1b00 0x7ff69c0b5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:46.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.836+0000 7ff6a2f88640 1 --2- 172.21.15.53:0/4130735071 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff69c0cc690 0x7ff69c15c8c0 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:46.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.836+0000 7ff6a2f88640 1 --2- 172.21.15.53:0/4130735071 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff69c0b3ac0 0x7ff69c155470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:46.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.836+0000 7ff6a2f88640 1 -- 172.21.15.53:0/4130735071 >> 172.21.15.53:0/4130735071 conn(0x7ff69c069de0 msgr2=0x7ff69c15f3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:46.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.836+0000 7ff6a2f88640 1 -- 172.21.15.53:0/4130735071 shutdown_connections 2023-06-10T19:00:46.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:46.836+0000 7ff6a2f88640 1 -- 172.21.15.53:0/4130735071 wait complete. 2023-06-10T19:00:46.859 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi053.front.sepia.ceph.com... 2023-06-10T19:00:46.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:00:46.860 DEBUG:teuthology.orchestra.run.smithi053:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-06-10T19:00:46.872 INFO:teuthology.orchestra.run:waiting for 300 2023-06-10T19:00:46.873 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi053.front.sepia.ceph.com 2023-06-10T19:00:46.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:00:46.874 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-06-10T19:00:46.924 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2023-06-10T19:00:47.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:47.092+0000 7f33d21af640 1 Processor -- start 2023-06-10T19:00:47.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:47.092+0000 7f33d21af640 1 -- start start 2023-06-10T19:00:47.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:47.092+0000 7f33d21af640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f33cc159450 0x7f33cc15d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:47.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:47.092+0000 7f33d21af640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33cc0cf350 0x7f33cc0cbf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:47.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:47.092+0000 7f33d21af640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33cc0cbac0 con 0x7f33cc15d680 2023-06-10T19:00:47.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:47.092+0000 7f33d21af640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33cc15dc00 con 0x7f33cc159450 2023-06-10T19:00:47.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:47.092+0000 7f33d21af640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33cc15dee0 con 0x7f33cc0cf350 2023-06-10T19:00:47.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:47.096+0000 7f33cbfff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33cc0cf350 0x7f33cc0cbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:47.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:47.096+0000 7f33cb7fe640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f33cc159450 0x7f33cc15d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:47.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:47.096+0000 7f33cbfff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33cc0cf350 0x7f33cc0cbf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.53:36900/0 (socket says 172.21.15.53:36900) 2023-06-10T19:00:47.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:47.096+0000 7f33cbfff640 1 -- 172.21.15.53:0/3129437559 learned_addr learned my addr 172.21.15.53:0/3129437559 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:47.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:47.096+0000 7f33cb7fe640 1 -- 172.21.15.53:0/3129437559 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33cc0cf350 msgr2=0x7f33cc0cbf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:47.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:47.096+0000 7f33cb7fe640 1 --2- 172.21.15.53:0/3129437559 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33cc0cf350 0x7f33cc0cbf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:47.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:47.096+0000 7f33cb7fe640 1 -- 172.21.15.53:0/3129437559 >> v1:172.21.15.117:6789/0 conn(0x7f33cc15d680 legacy=0x7f33cc0cec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:47.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:47.096+0000 7f33cb7fe640 1 -- 172.21.15.53:0/3129437559 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33cc0cb750 con 0x7f33cc159450 2023-06-10T19:00:47.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:47.096+0000 7f33cbfff640 1 --2- 172.21.15.53:0/3129437559 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33cc0cf350 0x7f33cc0cbf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-10T19:00:47.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:47.096+0000 7f33cb7fe640 1 --2- 172.21.15.53:0/3129437559 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33cc159450 0x7f33cc15d140 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f33bc0097c0 tx=0x7f33bc01c420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ee7129b2d5361fd server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:47.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:47.096+0000 7f33ca7fc640 1 -- 172.21.15.53:0/3129437559 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33bc0ab640 con 0x7f33cc159450 2023-06-10T19:00:47.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:47.096+0000 7f33ca7fc640 1 -- 172.21.15.53:0/3129437559 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33bc0a7070 con 0x7f33cc159450 2023-06-10T19:00:47.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:47.096+0000 7f33ca7fc640 1 -- 172.21.15.53:0/3129437559 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33bc0ab9c0 con 0x7f33cc159450 2023-06-10T19:00:47.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:47.100+0000 7f33d21af640 1 -- 172.21.15.53:0/3129437559 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33cc159450 msgr2=0x7f33cc15d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:47.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:47.100+0000 7f33d21af640 1 --2- 172.21.15.53:0/3129437559 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33cc159450 0x7f33cc15d140 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f33bc0097c0 tx=0x7f33bc01c420 comp rx=0 tx=0).stop 2023-06-10T19:00:47.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:47.100+0000 7f33d21af640 1 -- 172.21.15.53:0/3129437559 shutdown_connections 2023-06-10T19:00:47.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:47.100+0000 7f33d21af640 1 --2- 172.21.15.53:0/3129437559 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33cc0cf350 0x7f33cc0cbf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:47.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:47.100+0000 7f33d21af640 1 --2- 172.21.15.53:0/3129437559 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33cc159450 0x7f33cc15d140 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:47.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:47.100+0000 7f33d21af640 1 -- 172.21.15.53:0/3129437559 >> 172.21.15.53:0/3129437559 conn(0x7f33cc06a090 msgr2=0x7f33cc06d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:47.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:47.100+0000 7f33d21af640 1 -- 172.21.15.53:0/3129437559 shutdown_connections 2023-06-10T19:00:47.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:47.100+0000 7f33d21af640 1 -- 172.21.15.53:0/3129437559 wait complete. 2023-06-10T19:00:47.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:47.100+0000 7f33d21af640 1 Processor -- start 2023-06-10T19:00:47.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:47.100+0000 7f33d21af640 1 -- start start 2023-06-10T19:00:47.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:47.100+0000 7f33d21af640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33cc0cf350 0x7f33cc158450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:47.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:47.100+0000 7f33d21af640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33cc159450 0x7f33cc1512a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:47.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:47.100+0000 7f33d21af640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f33cc15d680 0x7f33cc0c7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:47.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:47.100+0000 7f33d21af640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33cc1525c0 con 0x7f33cc15d680 2023-06-10T19:00:47.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:47.100+0000 7f33d21af640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33cc151d20 con 0x7f33cc159450 2023-06-10T19:00:47.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:47.100+0000 7f33d21af640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33cc152000 con 0x7f33cc0cf350 2023-06-10T19:00:47.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:47.100+0000 7f33cbfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f33cc15d680 0x7f33cc0c7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:47.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:47.100+0000 7f33cbfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f33cc15d680 0x7f33cc0c7f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47776/0 (socket says 172.21.15.53:47776) 2023-06-10T19:00:47.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:47.100+0000 7f33cbfff640 1 -- 172.21.15.53:0/2929190492 learned_addr learned my addr 172.21.15.53:0/2929190492 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:47.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:47.100+0000 7f33cb7fe640 1 --2- 172.21.15.53:0/2929190492 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33cc0cf350 0x7f33cc158450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:47.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:47.100+0000 7f33caffd640 1 --2- 172.21.15.53:0/2929190492 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33cc159450 0x7f33cc1512a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:47.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:47.100+0000 7f33cbfff640 1 -- 172.21.15.53:0/2929190492 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33cc0cf350 msgr2=0x7f33cc158450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:47.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:47.100+0000 7f33cbfff640 1 --2- 172.21.15.53:0/2929190492 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33cc0cf350 0x7f33cc158450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:47.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:47.100+0000 7f33cbfff640 1 -- 172.21.15.53:0/2929190492 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33cc159450 msgr2=0x7f33cc1512a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:47.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:47.100+0000 7f33cbfff640 1 --2- 172.21.15.53:0/2929190492 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33cc159450 0x7f33cc1512a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:47.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:47.100+0000 7f33cbfff640 1 -- 172.21.15.53:0/2929190492 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33c4009b30 con 0x7f33cc15d680 2023-06-10T19:00:47.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:47.100+0000 7f33cbfff640 1 --2- 172.21.15.53:0/2929190492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f33cc15d680 0x7f33cc0c7f70 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f33c400ef90 tx=0x7f33c400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:47.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:47.100+0000 7f33b3fff640 1 -- 172.21.15.53:0/2929190492 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c400cde0 con 0x7f33cc15d680 2023-06-10T19:00:47.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:47.100+0000 7f33b3fff640 1 -- 172.21.15.53:0/2929190492 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33c400f040 con 0x7f33cc15d680 2023-06-10T19:00:47.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:47.100+0000 7f33b3fff640 1 -- 172.21.15.53:0/2929190492 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c4003be0 con 0x7f33cc15d680 2023-06-10T19:00:47.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:47.100+0000 7f33d21af640 1 -- 172.21.15.53:0/2929190492 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33bc009420 con 0x7f33cc15d680 2023-06-10T19:00:47.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:47.104+0000 7f33d21af640 1 -- 172.21.15.53:0/2929190492 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33cc15b3f0 con 0x7f33cc15d680 2023-06-10T19:00:47.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:47.104+0000 7f33d21af640 1 -- 172.21.15.53:0/2929190492 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33cc15b250 con 0x7f33cc15d680 2023-06-10T19:00:47.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:47.104+0000 7f33b3fff640 1 -- 172.21.15.53:0/2929190492 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f33c4003d40 con 0x7f33cc15d680 2023-06-10T19:00:47.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:47.104+0000 7f33b3fff640 1 --2- 172.21.15.53:0/2929190492 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f33b8066280 0x7f33b8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:47.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:47.104+0000 7f33b3fff640 1 -- 172.21.15.53:0/2929190492 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f33c4084500 con 0x7f33cc15d680 2023-06-10T19:00:47.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:47.104+0000 7f33cb7fe640 1 --2- 172.21.15.53:0/2929190492 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f33b8066280 0x7f33b8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:47.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:47.104+0000 7f33cb7fe640 1 --2- 172.21.15.53:0/2929190492 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f33b8066280 0x7f33b8068730 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f33bc0af000 tx=0x7f33bc0a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:47.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:47.108+0000 7f33b3fff640 1 -- 172.21.15.53:0/2929190492 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f33cc15b250 con 0x7f33cc15d680 2023-06-10T19:00:47.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:47.296+0000 7f33d21af640 1 -- 172.21.15.53:0/2929190492 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7f33cc15b250 con 0x7f33cc15d680 2023-06-10T19:00:48.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.012+0000 7f33b3fff640 1 -- 172.21.15.53:0/2929190492 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v36) v1 ==== 162+0+0 (secure 0 0 0) 0x7f33cc15b250 con 0x7f33cc15d680 2023-06-10T19:00:48.019 INFO:teuthology.orchestra.run.smithi053.stderr:cephfs marked joinable; MDS may join as newly active. 2023-06-10T19:00:48.022 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.016+0000 7f33d21af640 1 -- 172.21.15.53:0/2929190492 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f33b8066280 msgr2=0x7f33b8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:48.022 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.016+0000 7f33d21af640 1 --2- 172.21.15.53:0/2929190492 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f33b8066280 0x7f33b8068730 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f33bc0af000 tx=0x7f33bc0a7000 comp rx=0 tx=0).stop 2023-06-10T19:00:48.022 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.016+0000 7f33d21af640 1 -- 172.21.15.53:0/2929190492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f33cc15d680 msgr2=0x7f33cc0c7f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:48.022 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.016+0000 7f33d21af640 1 --2- 172.21.15.53:0/2929190492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f33cc15d680 0x7f33cc0c7f70 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f33c400ef90 tx=0x7f33c400c490 comp rx=0 tx=0).stop 2023-06-10T19:00:48.022 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.016+0000 7f33d21af640 1 -- 172.21.15.53:0/2929190492 shutdown_connections 2023-06-10T19:00:48.023 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.016+0000 7f33d21af640 1 --2- 172.21.15.53:0/2929190492 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f33b8066280 0x7f33b8068730 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:48.023 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.016+0000 7f33d21af640 1 --2- 172.21.15.53:0/2929190492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f33cc15d680 0x7f33cc0c7f70 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:48.023 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.016+0000 7f33d21af640 1 --2- 172.21.15.53:0/2929190492 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33cc159450 0x7f33cc1512a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:48.023 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.016+0000 7f33d21af640 1 --2- 172.21.15.53:0/2929190492 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33cc0cf350 0x7f33cc158450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:48.023 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.016+0000 7f33d21af640 1 -- 172.21.15.53:0/2929190492 >> 172.21.15.53:0/2929190492 conn(0x7f33cc06a090 msgr2=0x7f33cc0cd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:48.023 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.016+0000 7f33d21af640 1 -- 172.21.15.53:0/2929190492 shutdown_connections 2023-06-10T19:00:48.023 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.016+0000 7f33d21af640 1 -- 172.21.15.53:0/2929190492 wait complete. 2023-06-10T19:00:48.050 INFO:tasks.cephfs.test_client_recovery:Waiting for reconnect... 2023-06-10T19:00:48.050 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:00:48.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.172+0000 7fcefce32640 1 Processor -- start 2023-06-10T19:00:48.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.172+0000 7fcefce32640 1 -- start start 2023-06-10T19:00:48.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.172+0000 7fcefce32640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcef8159630 0x7fcef815d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:48.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.172+0000 7fcefce32640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fcef8069450 0x7fcef80698f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:48.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.172+0000 7fcefce32640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcef8070f10 con 0x7fcef80ad730 2023-06-10T19:00:48.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.172+0000 7fcefce32640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcef815db60 con 0x7fcef8069450 2023-06-10T19:00:48.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.172+0000 7fcefce32640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcef815de40 con 0x7fcef8159630 2023-06-10T19:00:48.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.172+0000 7fcef6d9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fcef8069450 0x7fcef80698f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:48.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.172+0000 7fcef5d9b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fcef80ad730 0x7fcef80713a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:57730/0 (socket says 172.21.15.53:57730) 2023-06-10T19:00:48.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.172+0000 7fcef5d9b640 1 -- 172.21.15.53:0/3357677104 learned_addr learned my addr 172.21.15.53:0/3357677104 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:00:48.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.172+0000 7fcef659c640 1 --2- 172.21.15.53:0/3357677104 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcef8159630 0x7fcef815d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:48.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.172+0000 7fcef559a640 1 -- 172.21.15.53:0/3357677104 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2487254803 0 0) 0x7fcef8070f10 con 0x7fcef80ad730 2023-06-10T19:00:48.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.172+0000 7fcef559a640 1 -- 172.21.15.53:0/3357677104 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcee4003530 con 0x7fcef80ad730 2023-06-10T19:00:48.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.172+0000 7fcef6d9d640 1 -- 172.21.15.53:0/3357677104 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcef8159630 msgr2=0x7fcef815d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:48.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.172+0000 7fcef6d9d640 1 --2- 172.21.15.53:0/3357677104 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcef8159630 0x7fcef815d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:48.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.172+0000 7fcef6d9d640 1 -- 172.21.15.53:0/3357677104 >> v1:172.21.15.53:6789/0 conn(0x7fcef80ad730 legacy=0x7fcef80713a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:48.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.172+0000 7fcef6d9d640 1 -- 172.21.15.53:0/3357677104 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcef815e120 con 0x7fcef8069450 2023-06-10T19:00:48.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.176+0000 7fcef6d9d640 1 --2- 172.21.15.53:0/3357677104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcef8069450 0x7fcef80698f0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7fcee8009d90 tx=0x7fcee801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bef0362b9d2afdc4 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:48.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.176+0000 7fcef559a640 1 -- 172.21.15.53:0/3357677104 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee80a58f0 con 0x7fcef8069450 2023-06-10T19:00:48.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.176+0000 7fcef559a640 1 -- 172.21.15.53:0/3357677104 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcee80a5a50 con 0x7fcef8069450 2023-06-10T19:00:48.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.176+0000 7fcef559a640 1 -- 172.21.15.53:0/3357677104 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee80a5de0 con 0x7fcef8069450 2023-06-10T19:00:48.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.176+0000 7fcefce32640 1 -- 172.21.15.53:0/3357677104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcef8069450 msgr2=0x7fcef80698f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:48.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.176+0000 7fcefce32640 1 --2- 172.21.15.53:0/3357677104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcef8069450 0x7fcef80698f0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7fcee8009d90 tx=0x7fcee801c920 comp rx=0 tx=0).stop 2023-06-10T19:00:48.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.176+0000 7fcefce32640 1 -- 172.21.15.53:0/3357677104 shutdown_connections 2023-06-10T19:00:48.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.176+0000 7fcefce32640 1 --2- 172.21.15.53:0/3357677104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcef8069450 0x7fcef80698f0 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:48.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.176+0000 7fcefce32640 1 --2- 172.21.15.53:0/3357677104 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcef8159630 0x7fcef815d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:48.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.176+0000 7fcefce32640 1 -- 172.21.15.53:0/3357677104 >> 172.21.15.53:0/3357677104 conn(0x7fcef80cafc0 msgr2=0x7fcef80cb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:48.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.176+0000 7fcefce32640 1 -- 172.21.15.53:0/3357677104 shutdown_connections 2023-06-10T19:00:48.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.176+0000 7fcefce32640 1 -- 172.21.15.53:0/3357677104 wait complete. 2023-06-10T19:00:48.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.176+0000 7fcefce32640 1 Processor -- start 2023-06-10T19:00:48.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.176+0000 7fcefce32640 1 -- start start 2023-06-10T19:00:48.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.176+0000 7fcefce32640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcef8069450 0x7fcef81617b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:48.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.176+0000 7fcefce32640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcef80ad730 0x7fcef815bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:48.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.176+0000 7fcefce32640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcef8159630 0x7fcef815c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:48.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.176+0000 7fcefce32640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef8162d60 con 0x7fcef80ad730 2023-06-10T19:00:48.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.176+0000 7fcefce32640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef8163180 con 0x7fcef8159630 2023-06-10T19:00:48.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.176+0000 7fcefce32640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcef81620e0 con 0x7fcef8069450 2023-06-10T19:00:48.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.176+0000 7fcef5d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcef80ad730 0x7fcef815bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:48.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.176+0000 7fcef5d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcef80ad730 0x7fcef815bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47800/0 (socket says 172.21.15.53:47800) 2023-06-10T19:00:48.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.176+0000 7fcef5d9b640 1 -- 172.21.15.53:0/3710830546 learned_addr learned my addr 172.21.15.53:0/3710830546 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:48.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.176+0000 7fcef659c640 1 --2- 172.21.15.53:0/3710830546 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcef8069450 0x7fcef81617b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:48.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.176+0000 7fcef6d9d640 1 --2- 172.21.15.53:0/3710830546 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcef8159630 0x7fcef815c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:48.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.176+0000 7fcef5d9b640 1 -- 172.21.15.53:0/3710830546 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcef8069450 msgr2=0x7fcef81617b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:48.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.176+0000 7fcef5d9b640 1 --2- 172.21.15.53:0/3710830546 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcef8069450 0x7fcef81617b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:48.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.176+0000 7fcef5d9b640 1 -- 172.21.15.53:0/3710830546 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcef8159630 msgr2=0x7fcef815c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:48.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.176+0000 7fcef5d9b640 1 --2- 172.21.15.53:0/3710830546 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcef8159630 0x7fcef815c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:48.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.176+0000 7fcef5d9b640 1 -- 172.21.15.53:0/3710830546 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcee8009a70 con 0x7fcef80ad730 2023-06-10T19:00:48.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.176+0000 7fcef6d9d640 1 --2- 172.21.15.53:0/3710830546 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcef8159630 0x7fcef815c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:00:48.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.180+0000 7fcef5d9b640 1 --2- 172.21.15.53:0/3710830546 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcef80ad730 0x7fcef815bef0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7fcee000c4d0 tx=0x7fcee000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:48.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.180+0000 7fceeeffd640 1 -- 172.21.15.53:0/3710830546 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee0005cf0 con 0x7fcef80ad730 2023-06-10T19:00:48.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.180+0000 7fceeeffd640 1 -- 172.21.15.53:0/3710830546 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcee0005e50 con 0x7fcef80ad730 2023-06-10T19:00:48.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.180+0000 7fcefce32640 1 -- 172.21.15.53:0/3710830546 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcef81623c0 con 0x7fcef80ad730 2023-06-10T19:00:48.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.180+0000 7fceeeffd640 1 -- 172.21.15.53:0/3710830546 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee0007270 con 0x7fcef80ad730 2023-06-10T19:00:48.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.180+0000 7fcefce32640 1 -- 172.21.15.53:0/3710830546 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcef8162980 con 0x7fcef80ad730 2023-06-10T19:00:48.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.180+0000 7fcefce32640 1 -- 172.21.15.53:0/3710830546 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcef80cbd00 con 0x7fcef80ad730 2023-06-10T19:00:48.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.180+0000 7fceeeffd640 1 -- 172.21.15.53:0/3710830546 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcee00073d0 con 0x7fcef80ad730 2023-06-10T19:00:48.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.180+0000 7fceeeffd640 1 --2- 172.21.15.53:0/3710830546 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fced8066280 0x7fced8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:48.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.180+0000 7fceeeffd640 1 -- 172.21.15.53:0/3710830546 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6148+0+0 (secure 0 0 0) 0x7fcee0083290 con 0x7fcef80ad730 2023-06-10T19:00:48.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.180+0000 7fcef659c640 1 --2- 172.21.15.53:0/3710830546 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fced8066280 0x7fced8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:48.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.180+0000 7fcef659c640 1 --2- 172.21.15.53:0/3710830546 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fced8066280 0x7fced8068730 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fcef80b3710 tx=0x7fcef0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:48.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.184+0000 7fceeeffd640 1 -- 172.21.15.53:0/3710830546 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcee00507f0 con 0x7fcef80ad730 2023-06-10T19:00:48.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.376+0000 7fcefce32640 1 -- 172.21.15.53:0/3710830546 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcef8162ea0 con 0x7fcef80ad730 2023-06-10T19:00:48.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.376+0000 7fceeeffd640 1 -- 172.21.15.53:0/3710830546 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+4680 (secure 0 0 0) 0x7fcef8162ea0 con 0x7fcef80ad730 2023-06-10T19:00:48.381 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:00:48.381 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":37,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5663,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2600814414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2600814414},{"type":"v1","addr":"172.21.15.117:6835","nonce":2600814414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6136,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1615882017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1615882017},{"type":"v1","addr":"172.21.15.117:6837","nonce":1615882017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6993,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/3732245174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3732245174},{"type":"v1","addr":"172.21.15.53:6833","nonce":3732245174}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:00:20.607950+0000","modified":"2023-06-10T19:00:48.018342+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7266":{"gid":7266,"name":"c","rank":0,"incarnation":37,"state":"up:replay","state_seq":1,"addr":"172.21.15.53:6835/2829993338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2829993338},{"type":"v1","addr":"172.21.15.53:6835","nonce":2829993338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-06-10T19:00:48.382 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 37 2023-06-10T19:00:48.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.376+0000 7fcefce32640 1 -- 172.21.15.53:0/3710830546 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fced8066280 msgr2=0x7fced8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:48.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.376+0000 7fcefce32640 1 --2- 172.21.15.53:0/3710830546 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fced8066280 0x7fced8068730 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fcef80b3710 tx=0x7fcef0008040 comp rx=0 tx=0).stop 2023-06-10T19:00:48.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.376+0000 7fcefce32640 1 -- 172.21.15.53:0/3710830546 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcef80ad730 msgr2=0x7fcef815bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:48.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.376+0000 7fcefce32640 1 --2- 172.21.15.53:0/3710830546 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcef80ad730 0x7fcef815bef0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7fcee000c4d0 tx=0x7fcee000c990 comp rx=0 tx=0).stop 2023-06-10T19:00:48.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.376+0000 7fcefce32640 1 -- 172.21.15.53:0/3710830546 shutdown_connections 2023-06-10T19:00:48.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.376+0000 7fcefce32640 1 --2- 172.21.15.53:0/3710830546 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fced8066280 0x7fced8068730 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:48.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.376+0000 7fcefce32640 1 --2- 172.21.15.53:0/3710830546 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcef8159630 0x7fcef815c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:48.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.376+0000 7fcefce32640 1 --2- 172.21.15.53:0/3710830546 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcef80ad730 0x7fcef815bef0 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:48.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.376+0000 7fcefce32640 1 --2- 172.21.15.53:0/3710830546 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcef8069450 0x7fcef81617b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:48.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.376+0000 7fcefce32640 1 -- 172.21.15.53:0/3710830546 >> 172.21.15.53:0/3710830546 conn(0x7fcef80cafc0 msgr2=0x7fcef80ca070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:48.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.376+0000 7fcefce32640 1 -- 172.21.15.53:0/3710830546 shutdown_connections 2023-06-10T19:00:48.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:48.376+0000 7fcefce32640 1 -- 172.21.15.53:0/3710830546 wait complete. 2023-06-10T19:00:48.401 DEBUG:tasks.cephfs.filesystem:mapped states ['up:replay'] to None 2023-06-10T19:00:49.402 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:00:49.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.532+0000 7fee76b38640 1 Processor -- start 2023-06-10T19:00:49.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.532+0000 7fee76b38640 1 -- start start 2023-06-10T19:00:49.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.536+0000 7fee76b38640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fee70071060 0x7fee700af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:49.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.536+0000 7fee76b38640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee700afc60 0x7fee7006b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:49.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.536+0000 7fee76b38640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee70159b50 con 0x7fee700c9840 2023-06-10T19:00:49.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.536+0000 7fee76b38640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee700702a0 con 0x7fee70071060 2023-06-10T19:00:49.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.536+0000 7fee76b38640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee70070580 con 0x7fee700afc60 2023-06-10T19:00:49.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.536+0000 7fee6ffff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fee70071060 0x7fee700af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:49.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.536+0000 7fee750d5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee700afc60 0x7fee7006b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:49.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.536+0000 7fee750d5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee700afc60 0x7fee7006b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.53:36932/0 (socket says 172.21.15.53:36932) 2023-06-10T19:00:49.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.536+0000 7fee750d5640 1 -- 172.21.15.53:0/1031303262 learned_addr learned my addr 172.21.15.53:0/1031303262 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:49.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.536+0000 7fee748d4640 1 --1- 172.21.15.53:0/1031303262 >> v1:172.21.15.117:6789/0 conn(0x7fee700c9840 0x7fee700c9c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.53:54962/0 (socket says 172.21.15.53:54962) 2023-06-10T19:00:49.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.536+0000 7fee6ffff640 1 -- 172.21.15.53:0/1031303262 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee700afc60 msgr2=0x7fee7006b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:49.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.536+0000 7fee6ffff640 1 --2- 172.21.15.53:0/1031303262 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee700afc60 0x7fee7006b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:49.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.536+0000 7fee6ffff640 1 -- 172.21.15.53:0/1031303262 >> v1:172.21.15.117:6789/0 conn(0x7fee700c9840 legacy=0x7fee700c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:49.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.536+0000 7fee6f7fe640 1 -- 172.21.15.53:0/1031303262 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2989638468 0 0) 0x7fee70159b50 con 0x7fee700c9840 2023-06-10T19:00:49.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.536+0000 7fee6ffff640 1 -- 172.21.15.53:0/1031303262 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee70070860 con 0x7fee70071060 2023-06-10T19:00:49.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.536+0000 7fee750d5640 1 --2- 172.21.15.53:0/1031303262 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee700afc60 0x7fee7006b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-10T19:00:49.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.536+0000 7fee6ffff640 1 --2- 172.21.15.53:0/1031303262 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee70071060 0x7fee700af720 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fee64009d90 tx=0x7fee6401c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46d4e6316b572e10 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:49.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.540+0000 7fee6f7fe640 1 -- 172.21.15.53:0/1031303262 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee640a5a00 con 0x7fee70071060 2023-06-10T19:00:49.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.540+0000 7fee6f7fe640 1 -- 172.21.15.53:0/1031303262 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee640a5b60 con 0x7fee70071060 2023-06-10T19:00:49.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.540+0000 7fee6f7fe640 1 -- 172.21.15.53:0/1031303262 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee640ad440 con 0x7fee70071060 2023-06-10T19:00:49.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.540+0000 7fee76b38640 1 -- 172.21.15.53:0/1031303262 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee70071060 msgr2=0x7fee700af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:49.550 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.540+0000 7fee76b38640 1 --2- 172.21.15.53:0/1031303262 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee70071060 0x7fee700af720 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fee64009d90 tx=0x7fee6401c920 comp rx=0 tx=0).stop 2023-06-10T19:00:49.550 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.540+0000 7fee76b38640 1 -- 172.21.15.53:0/1031303262 shutdown_connections 2023-06-10T19:00:49.551 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.540+0000 7fee76b38640 1 --2- 172.21.15.53:0/1031303262 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee700afc60 0x7fee7006b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:49.551 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.540+0000 7fee76b38640 1 --2- 172.21.15.53:0/1031303262 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee70071060 0x7fee700af720 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:49.551 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.540+0000 7fee76b38640 1 -- 172.21.15.53:0/1031303262 >> 172.21.15.53:0/1031303262 conn(0x7fee7006a0d0 msgr2=0x7fee700ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:49.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.540+0000 7fee76b38640 1 -- 172.21.15.53:0/1031303262 shutdown_connections 2023-06-10T19:00:49.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.540+0000 7fee76b38640 1 -- 172.21.15.53:0/1031303262 wait complete. 2023-06-10T19:00:49.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.540+0000 7fee76b38640 1 Processor -- start 2023-06-10T19:00:49.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.540+0000 7fee76b38640 1 -- start start 2023-06-10T19:00:49.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.540+0000 7fee76b38640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee70071060 0x7fee700c4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:49.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.540+0000 7fee76b38640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee700afc60 0x7fee700c4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:49.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.540+0000 7fee76b38640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee700c9840 0x7fee700c52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:49.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.540+0000 7fee76b38640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee700b1a80 con 0x7fee700afc60 2023-06-10T19:00:49.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.540+0000 7fee76b38640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee700b28d0 con 0x7fee700c9840 2023-06-10T19:00:49.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.540+0000 7fee76b38640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee700b1cc0 con 0x7fee70071060 2023-06-10T19:00:49.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.540+0000 7fee6ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee700afc60 0x7fee700c4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:49.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.540+0000 7fee6ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee700afc60 0x7fee700c4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47804/0 (socket says 172.21.15.53:47804) 2023-06-10T19:00:49.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.540+0000 7fee6ffff640 1 -- 172.21.15.53:0/2261489525 learned_addr learned my addr 172.21.15.53:0/2261489525 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:49.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.540+0000 7fee748d4640 1 --2- 172.21.15.53:0/2261489525 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee70071060 0x7fee700c4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:49.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.540+0000 7fee750d5640 1 --2- 172.21.15.53:0/2261489525 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee700c9840 0x7fee700c52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:49.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.540+0000 7fee6ffff640 1 -- 172.21.15.53:0/2261489525 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee70071060 msgr2=0x7fee700c4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:49.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.540+0000 7fee6ffff640 1 --2- 172.21.15.53:0/2261489525 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee70071060 0x7fee700c4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:49.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.540+0000 7fee6ffff640 1 -- 172.21.15.53:0/2261489525 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee700c9840 msgr2=0x7fee700c52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:49.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.540+0000 7fee6ffff640 1 --2- 172.21.15.53:0/2261489525 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee700c9840 0x7fee700c52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:49.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.540+0000 7fee6ffff640 1 -- 172.21.15.53:0/2261489525 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee680094d0 con 0x7fee700afc60 2023-06-10T19:00:49.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.540+0000 7fee6ffff640 1 --2- 172.21.15.53:0/2261489525 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee700afc60 0x7fee700c4d70 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7fee64009d90 tx=0x7fee640196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:49.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.540+0000 7fee6d7fa640 1 -- 172.21.15.53:0/2261489525 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee640aed30 con 0x7fee700afc60 2023-06-10T19:00:49.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.544+0000 7fee6d7fa640 1 -- 172.21.15.53:0/2261489525 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee640aee90 con 0x7fee700afc60 2023-06-10T19:00:49.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.544+0000 7fee6d7fa640 1 -- 172.21.15.53:0/2261489525 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee640b7610 con 0x7fee700afc60 2023-06-10T19:00:49.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.544+0000 7fee76b38640 1 -- 172.21.15.53:0/2261489525 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee64009a70 con 0x7fee700afc60 2023-06-10T19:00:49.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.544+0000 7fee76b38640 1 -- 172.21.15.53:0/2261489525 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee700b2280 con 0x7fee700afc60 2023-06-10T19:00:49.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.544+0000 7fee76b38640 1 -- 172.21.15.53:0/2261489525 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee700b2a60 con 0x7fee700afc60 2023-06-10T19:00:49.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.544+0000 7fee6d7fa640 1 -- 172.21.15.53:0/2261489525 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fee640b4050 con 0x7fee700afc60 2023-06-10T19:00:49.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.544+0000 7fee6d7fa640 1 --2- 172.21.15.53:0/2261489525 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fee5c066280 0x7fee5c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:49.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.544+0000 7fee6d7fa640 1 -- 172.21.15.53:0/2261489525 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6148+0+0 (secure 0 0 0) 0x7fee6411e570 con 0x7fee700afc60 2023-06-10T19:00:49.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.544+0000 7fee748d4640 1 --2- 172.21.15.53:0/2261489525 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fee5c066280 0x7fee5c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:49.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.544+0000 7fee748d4640 1 --2- 172.21.15.53:0/2261489525 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fee5c066280 0x7fee5c068730 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fee60000f70 tx=0x7fee60007d10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:49.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.548+0000 7fee6d7fa640 1 -- 172.21.15.53:0/2261489525 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fee640eb910 con 0x7fee700afc60 2023-06-10T19:00:49.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.736+0000 7fee76b38640 1 -- 172.21.15.53:0/2261489525 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fee7004d790 con 0x7fee700afc60 2023-06-10T19:00:49.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.736+0000 7fee6d7fa640 1 -- 172.21.15.53:0/2261489525 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4683 (secure 0 0 0) 0x7fee64009450 con 0x7fee700afc60 2023-06-10T19:00:49.741 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:00:49.742 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":38,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5663,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2600814414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2600814414},{"type":"v1","addr":"172.21.15.117:6835","nonce":2600814414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6136,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1615882017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1615882017},{"type":"v1","addr":"172.21.15.117:6837","nonce":1615882017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6993,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/3732245174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3732245174},{"type":"v1","addr":"172.21.15.53:6833","nonce":3732245174}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:00:20.607950+0000","modified":"2023-06-10T19:00:49.023162+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7266":{"gid":7266,"name":"c","rank":0,"incarnation":37,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.53:6835/2829993338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2829993338},{"type":"v1","addr":"172.21.15.53:6835","nonce":2829993338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-06-10T19:00:49.742 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 38 2023-06-10T19:00:49.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.740+0000 7fee76b38640 1 -- 172.21.15.53:0/2261489525 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fee5c066280 msgr2=0x7fee5c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:49.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.740+0000 7fee76b38640 1 --2- 172.21.15.53:0/2261489525 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fee5c066280 0x7fee5c068730 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fee60000f70 tx=0x7fee60007d10 comp rx=0 tx=0).stop 2023-06-10T19:00:49.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.740+0000 7fee76b38640 1 -- 172.21.15.53:0/2261489525 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee700afc60 msgr2=0x7fee700c4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:49.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.740+0000 7fee76b38640 1 --2- 172.21.15.53:0/2261489525 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee700afc60 0x7fee700c4d70 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7fee64009d90 tx=0x7fee640196c0 comp rx=0 tx=0).stop 2023-06-10T19:00:49.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.740+0000 7fee76b38640 1 -- 172.21.15.53:0/2261489525 shutdown_connections 2023-06-10T19:00:49.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.740+0000 7fee76b38640 1 --2- 172.21.15.53:0/2261489525 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fee5c066280 0x7fee5c068730 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:49.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.740+0000 7fee76b38640 1 --2- 172.21.15.53:0/2261489525 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee700c9840 0x7fee700c52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:49.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.740+0000 7fee76b38640 1 --2- 172.21.15.53:0/2261489525 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee700afc60 0x7fee700c4d70 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:49.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.740+0000 7fee76b38640 1 --2- 172.21.15.53:0/2261489525 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee70071060 0x7fee700c4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:49.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.740+0000 7fee76b38640 1 -- 172.21.15.53:0/2261489525 >> 172.21.15.53:0/2261489525 conn(0x7fee7006a0d0 msgr2=0x7fee700c8b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:49.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.740+0000 7fee76b38640 1 -- 172.21.15.53:0/2261489525 shutdown_connections 2023-06-10T19:00:49.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.740+0000 7fee76b38640 1 -- 172.21.15.53:0/2261489525 wait complete. 2023-06-10T19:00:49.759 DEBUG:tasks.cephfs.filesystem:mapped states ['up:reconnect'] to up:reconnect 2023-06-10T19:00:49.760 DEBUG:tasks.cephfs.filesystem:reached state 'up:reconnect' in 1.709472417831421s 2023-06-10T19:00:49.760 INFO:tasks.cephfs.test_client_recovery:Waiting for active... 2023-06-10T19:00:49.760 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:00:49.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.868+0000 7f577c71f640 1 Processor -- start 2023-06-10T19:00:49.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.868+0000 7f577c71f640 1 -- start start 2023-06-10T19:00:49.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.868+0000 7f577c71f640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5774071060 0x7f57740af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:49.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.868+0000 7f577c71f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f57740afc60 0x7f577406b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:49.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.868+0000 7f577c71f640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5774159b50 con 0x7f57740c9840 2023-06-10T19:00:49.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.868+0000 7f577c71f640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57740702a0 con 0x7f57740afc60 2023-06-10T19:00:49.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.868+0000 7f577c71f640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5774070580 con 0x7f5774071060 2023-06-10T19:00:49.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.868+0000 7f577acbc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f57740afc60 0x7f577406b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:49.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.868+0000 7f577acbc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f57740afc60 0x7f577406b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47806/0 (socket says 172.21.15.53:47806) 2023-06-10T19:00:49.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.868+0000 7f577acbc640 1 -- 172.21.15.53:0/4135469699 learned_addr learned my addr 172.21.15.53:0/4135469699 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:49.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.868+0000 7f5779cba640 1 --2- 172.21.15.53:0/4135469699 >> v2:172.21.15.117:3300/0 conn(0x7f5774071060 0x7f57740af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:49.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.868+0000 7f577acbc640 1 -- 172.21.15.53:0/4135469699 >> v2:172.21.15.117:3300/0 conn(0x7f5774071060 msgr2=0x7f57740af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:49.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.868+0000 7f577acbc640 1 --2- 172.21.15.53:0/4135469699 >> v2:172.21.15.117:3300/0 conn(0x7f5774071060 0x7f57740af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:49.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.868+0000 7f577acbc640 1 -- 172.21.15.53:0/4135469699 >> v1:172.21.15.117:6789/0 conn(0x7f57740c9840 legacy=0x7f57740c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:49.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.868+0000 7f577acbc640 1 -- 172.21.15.53:0/4135469699 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5774070860 con 0x7f57740afc60 2023-06-10T19:00:49.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.872+0000 7f577acbc640 1 --2- 172.21.15.53:0/4135469699 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57740afc60 0x7f577406b090 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f577406e650 tx=0x7f576c01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2455db29eff880b6 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:49.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.872+0000 7f57794b9640 1 -- 172.21.15.53:0/4135469699 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576c0a5880 con 0x7f57740afc60 2023-06-10T19:00:49.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.872+0000 7f57794b9640 1 -- 172.21.15.53:0/4135469699 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f576c0a59e0 con 0x7f57740afc60 2023-06-10T19:00:49.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.872+0000 7f57794b9640 1 -- 172.21.15.53:0/4135469699 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576c0a5d70 con 0x7f57740afc60 2023-06-10T19:00:49.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.872+0000 7f577c71f640 1 -- 172.21.15.53:0/4135469699 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57740afc60 msgr2=0x7f577406b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:49.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.872+0000 7f577c71f640 1 --2- 172.21.15.53:0/4135469699 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57740afc60 0x7f577406b090 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f577406e650 tx=0x7f576c01c9a0 comp rx=0 tx=0).stop 2023-06-10T19:00:49.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.872+0000 7f577c71f640 1 -- 172.21.15.53:0/4135469699 shutdown_connections 2023-06-10T19:00:49.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.872+0000 7f577c71f640 1 --2- 172.21.15.53:0/4135469699 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57740afc60 0x7f577406b090 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:49.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.872+0000 7f577c71f640 1 --2- 172.21.15.53:0/4135469699 >> v2:172.21.15.117:3300/0 conn(0x7f5774071060 0x7f57740af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:49.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.872+0000 7f577c71f640 1 -- 172.21.15.53:0/4135469699 >> 172.21.15.53:0/4135469699 conn(0x7f577406a0d0 msgr2=0x7f57740ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:49.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.872+0000 7f577c71f640 1 -- 172.21.15.53:0/4135469699 shutdown_connections 2023-06-10T19:00:49.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.872+0000 7f577c71f640 1 -- 172.21.15.53:0/4135469699 wait complete. 2023-06-10T19:00:49.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.872+0000 7f577c71f640 1 Processor -- start 2023-06-10T19:00:49.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.872+0000 7f577c71f640 1 -- start start 2023-06-10T19:00:49.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.876+0000 7f577c71f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5774071060 0x7f5774146a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:49.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.876+0000 7f577c71f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57740afc60 0x7f57741584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:49.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.876+0000 7f577c71f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57740c9840 0x7f5774151130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:49.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.876+0000 7f577c71f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5774152320 con 0x7f57740afc60 2023-06-10T19:00:49.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.876+0000 7f577c71f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57740b0e40 con 0x7f57740c9840 2023-06-10T19:00:49.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.876+0000 7f577c71f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57740c1870 con 0x7f5774071060 2023-06-10T19:00:49.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.876+0000 7f5779cba640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57740afc60 0x7f57741584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:49.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.876+0000 7f5779cba640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57740afc60 0x7f57741584d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47818/0 (socket says 172.21.15.53:47818) 2023-06-10T19:00:49.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.876+0000 7f5779cba640 1 -- 172.21.15.53:0/2257982042 learned_addr learned my addr 172.21.15.53:0/2257982042 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:49.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.876+0000 7f577acbc640 1 --2- 172.21.15.53:0/2257982042 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57740c9840 0x7f5774151130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:49.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.876+0000 7f5779cba640 1 -- 172.21.15.53:0/2257982042 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5774071060 msgr2=0x7f5774146a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:49.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.876+0000 7f5779cba640 1 --2- 172.21.15.53:0/2257982042 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5774071060 0x7f5774146a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:49.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.876+0000 7f5779cba640 1 -- 172.21.15.53:0/2257982042 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57740c9840 msgr2=0x7f5774151130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:49.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.876+0000 7f5779cba640 1 --2- 172.21.15.53:0/2257982042 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57740c9840 0x7f5774151130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:49.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.876+0000 7f5779cba640 1 -- 172.21.15.53:0/2257982042 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f576c009b30 con 0x7f57740afc60 2023-06-10T19:00:49.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.876+0000 7f5779cba640 1 --2- 172.21.15.53:0/2257982042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57740afc60 0x7f57741584d0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f577000e900 tx=0x7f577000edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:49.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.876+0000 7f5766ffd640 1 -- 172.21.15.53:0/2257982042 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5770009690 con 0x7f57740afc60 2023-06-10T19:00:49.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.876+0000 7f5766ffd640 1 -- 172.21.15.53:0/2257982042 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f577000ca00 con 0x7f57740afc60 2023-06-10T19:00:49.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.876+0000 7f577c71f640 1 -- 172.21.15.53:0/2257982042 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57740c1b50 con 0x7f57740afc60 2023-06-10T19:00:49.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.876+0000 7f5766ffd640 1 -- 172.21.15.53:0/2257982042 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f577000cdb0 con 0x7f57740afc60 2023-06-10T19:00:49.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.876+0000 7f577c71f640 1 -- 172.21.15.53:0/2257982042 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57740b0ad0 con 0x7f57740afc60 2023-06-10T19:00:49.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.876+0000 7f577c71f640 1 -- 172.21.15.53:0/2257982042 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f577404d790 con 0x7f57740afc60 2023-06-10T19:00:49.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.876+0000 7f5766ffd640 1 -- 172.21.15.53:0/2257982042 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5770013470 con 0x7f57740afc60 2023-06-10T19:00:49.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.876+0000 7f5766ffd640 1 --2- 172.21.15.53:0/2257982042 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5758066280 0x7f5758068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:49.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.876+0000 7f5766ffd640 1 -- 172.21.15.53:0/2257982042 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f5770084010 con 0x7f57740afc60 2023-06-10T19:00:49.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.876+0000 7f577a4bb640 1 --2- 172.21.15.53:0/2257982042 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5758066280 0x7f5758068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:49.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.880+0000 7f577a4bb640 1 --2- 172.21.15.53:0/2257982042 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5758066280 0x7f5758068730 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f5768000f70 tx=0x7f57680079c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:49.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:49.880+0000 7f5766ffd640 1 -- 172.21.15.53:0/2257982042 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5770051430 con 0x7f57740afc60 2023-06-10T19:00:50.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:50.064+0000 7f577c71f640 1 -- 172.21.15.53:0/2257982042 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f57740cb140 con 0x7f57740afc60 2023-06-10T19:00:50.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:50.064+0000 7f5766ffd640 1 -- 172.21.15.53:0/2257982042 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4683 (secure 0 0 0) 0x7f5770054a50 con 0x7f57740afc60 2023-06-10T19:00:50.068 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:00:50.068 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":38,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5663,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2600814414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2600814414},{"type":"v1","addr":"172.21.15.117:6835","nonce":2600814414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6136,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1615882017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1615882017},{"type":"v1","addr":"172.21.15.117:6837","nonce":1615882017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6993,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/3732245174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3732245174},{"type":"v1","addr":"172.21.15.53:6833","nonce":3732245174}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:00:20.607950+0000","modified":"2023-06-10T19:00:49.023162+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7266":{"gid":7266,"name":"c","rank":0,"incarnation":37,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.53:6835/2829993338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2829993338},{"type":"v1","addr":"172.21.15.53:6835","nonce":2829993338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-06-10T19:00:50.069 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 38 2023-06-10T19:00:50.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:50.064+0000 7f577c71f640 1 -- 172.21.15.53:0/2257982042 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5758066280 msgr2=0x7f5758068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:50.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:50.064+0000 7f577c71f640 1 --2- 172.21.15.53:0/2257982042 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5758066280 0x7f5758068730 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f5768000f70 tx=0x7f57680079c0 comp rx=0 tx=0).stop 2023-06-10T19:00:50.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:50.064+0000 7f577c71f640 1 -- 172.21.15.53:0/2257982042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57740afc60 msgr2=0x7f57741584d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:50.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:50.064+0000 7f577c71f640 1 --2- 172.21.15.53:0/2257982042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57740afc60 0x7f57741584d0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f577000e900 tx=0x7f577000edc0 comp rx=0 tx=0).stop 2023-06-10T19:00:50.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:50.064+0000 7f577c71f640 1 -- 172.21.15.53:0/2257982042 shutdown_connections 2023-06-10T19:00:50.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:50.064+0000 7f577c71f640 1 --2- 172.21.15.53:0/2257982042 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5758066280 0x7f5758068730 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:50.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:50.064+0000 7f577c71f640 1 --2- 172.21.15.53:0/2257982042 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57740c9840 0x7f5774151130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:50.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:50.064+0000 7f577c71f640 1 --2- 172.21.15.53:0/2257982042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57740afc60 0x7f57741584d0 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:50.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:50.064+0000 7f577c71f640 1 --2- 172.21.15.53:0/2257982042 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5774071060 0x7f5774146a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:50.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:50.064+0000 7f577c71f640 1 -- 172.21.15.53:0/2257982042 >> 172.21.15.53:0/2257982042 conn(0x7f577406a0d0 msgr2=0x7f57740ae200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:50.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:50.064+0000 7f577c71f640 1 -- 172.21.15.53:0/2257982042 shutdown_connections 2023-06-10T19:00:50.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:50.064+0000 7f577c71f640 1 -- 172.21.15.53:0/2257982042 wait complete. 2023-06-10T19:00:50.086 DEBUG:tasks.cephfs.filesystem:mapped states ['up:reconnect'] to None 2023-06-10T19:00:51.088 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:00:51.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:51.220+0000 7fd8c0720640 1 Processor -- start 2023-06-10T19:00:51.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:51.220+0000 7fd8c0720640 1 -- start start 2023-06-10T19:00:51.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:51.220+0000 7fd8c0720640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd8b815c0b0 0x7fd8b8070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:51.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:51.220+0000 7fd8c0720640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8b80cbd50 0x7fd8b806bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:51.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:51.220+0000 7fd8c0720640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8b8070080 con 0x7fd8b80cc160 2023-06-10T19:00:51.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:51.220+0000 7fd8c0720640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8b80705c0 con 0x7fd8b815c0b0 2023-06-10T19:00:51.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:51.220+0000 7fd8c0720640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b80c8e30 con 0x7fd8b80cbd50 2023-06-10T19:00:51.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:51.224+0000 7fd8bdcbb640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8b80cbd50 0x7fd8b806bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:51.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:51.224+0000 7fd8be4bc640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd8b815c0b0 0x7fd8b8070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:51.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:51.224+0000 7fd8bdcbb640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8b80cbd50 0x7fd8b806bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.53:41538/0 (socket says 172.21.15.53:41538) 2023-06-10T19:00:51.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:51.224+0000 7fd8bdcbb640 1 -- 172.21.15.53:0/786008940 learned_addr learned my addr 172.21.15.53:0/786008940 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:51.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:51.224+0000 7fd8be4bc640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd8b815c0b0 0x7fd8b8070f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.53:38186/0 (socket says 172.21.15.53:38186) 2023-06-10T19:00:51.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:51.224+0000 7fd8bdcbb640 1 -- 172.21.15.53:0/786008940 >> v2:172.21.15.117:3300/0 conn(0x7fd8b815c0b0 msgr2=0x7fd8b8070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:51.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:51.224+0000 7fd8bdcbb640 1 --2- 172.21.15.53:0/786008940 >> v2:172.21.15.117:3300/0 conn(0x7fd8b815c0b0 0x7fd8b8070f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:51.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:51.224+0000 7fd8bdcbb640 1 -- 172.21.15.53:0/786008940 >> v1:172.21.15.117:6789/0 conn(0x7fd8b80cc160 legacy=0x7fd8b815c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:51.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:51.224+0000 7fd8bdcbb640 1 -- 172.21.15.53:0/786008940 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b806baa0 con 0x7fd8b80cbd50 2023-06-10T19:00:51.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:51.224+0000 7fd8bdcbb640 1 --2- 172.21.15.53:0/786008940 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8b80cbd50 0x7fd8b806bf80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd8a8009870 tx=0x7fd8a801c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66b70e9edd6706eb server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:51.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:51.224+0000 7fd8bd4ba640 1 -- 172.21.15.53:0/786008940 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a80a7070 con 0x7fd8b80cbd50 2023-06-10T19:00:51.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:51.224+0000 7fd8bd4ba640 1 -- 172.21.15.53:0/786008940 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8a80ab430 con 0x7fd8b80cbd50 2023-06-10T19:00:51.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:51.224+0000 7fd8bd4ba640 1 -- 172.21.15.53:0/786008940 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a80ab7c0 con 0x7fd8b80cbd50 2023-06-10T19:00:51.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:51.228+0000 7fd8c0720640 1 -- 172.21.15.53:0/786008940 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8b80cbd50 msgr2=0x7fd8b806bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:51.232 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:51.228+0000 7fd8c0720640 1 --2- 172.21.15.53:0/786008940 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8b80cbd50 0x7fd8b806bf80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd8a8009870 tx=0x7fd8a801c540 comp rx=0 tx=0).stop 2023-06-10T19:00:51.232 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:51.228+0000 7fd8c0720640 1 -- 172.21.15.53:0/786008940 shutdown_connections 2023-06-10T19:00:51.232 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:51.228+0000 7fd8c0720640 1 --2- 172.21.15.53:0/786008940 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8b80cbd50 0x7fd8b806bf80 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:51.232 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:51.228+0000 7fd8c0720640 1 --2- 172.21.15.53:0/786008940 >> v2:172.21.15.117:3300/0 conn(0x7fd8b815c0b0 0x7fd8b8070f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:51.232 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:51.228+0000 7fd8c0720640 1 -- 172.21.15.53:0/786008940 >> 172.21.15.53:0/786008940 conn(0x7fd8b806a0d0 msgr2=0x7fd8b80ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:51.232 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:51.228+0000 7fd8c0720640 1 -- 172.21.15.53:0/786008940 shutdown_connections 2023-06-10T19:00:51.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:51.228+0000 7fd8c0720640 1 -- 172.21.15.53:0/786008940 wait complete. 2023-06-10T19:00:51.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:51.228+0000 7fd8c0720640 1 Processor -- start 2023-06-10T19:00:51.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:51.228+0000 7fd8c0720640 1 -- start start 2023-06-10T19:00:51.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:51.228+0000 7fd8c0720640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8b80cbd50 0x7fd8b80c7750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:51.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:51.228+0000 7fd8c0720640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8b80cc160 0x7fd8b8155050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:51.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:51.228+0000 7fd8c0720640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8b815c0b0 0x7fd8b81529d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:51.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:51.228+0000 7fd8c0720640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b8154c30 con 0x7fd8b815c0b0 2023-06-10T19:00:51.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:51.228+0000 7fd8c0720640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b8153d60 con 0x7fd8b80cc160 2023-06-10T19:00:51.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:51.228+0000 7fd8c0720640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b8155590 con 0x7fd8b80cbd50 2023-06-10T19:00:51.235 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:51.228+0000 7fd8becbd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8b815c0b0 0x7fd8b81529d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:51.235 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:51.228+0000 7fd8becbd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8b815c0b0 0x7fd8b81529d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54122/0 (socket says 172.21.15.53:54122) 2023-06-10T19:00:51.235 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:51.228+0000 7fd8becbd640 1 -- 172.21.15.53:0/3342405063 learned_addr learned my addr 172.21.15.53:0/3342405063 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:51.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:51.228+0000 7fd8bdcbb640 1 --2- 172.21.15.53:0/3342405063 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8b80cc160 0x7fd8b8155050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:51.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:51.228+0000 7fd8be4bc640 1 --2- 172.21.15.53:0/3342405063 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8b80cbd50 0x7fd8b80c7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:51.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:51.228+0000 7fd8becbd640 1 -- 172.21.15.53:0/3342405063 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8b80cbd50 msgr2=0x7fd8b80c7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:51.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:51.228+0000 7fd8becbd640 1 --2- 172.21.15.53:0/3342405063 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8b80cbd50 0x7fd8b80c7750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:51.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:51.228+0000 7fd8becbd640 1 -- 172.21.15.53:0/3342405063 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8b80cc160 msgr2=0x7fd8b8155050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:51.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:51.228+0000 7fd8becbd640 1 --2- 172.21.15.53:0/3342405063 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8b80cc160 0x7fd8b8155050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:51.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:51.228+0000 7fd8becbd640 1 -- 172.21.15.53:0/3342405063 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8a80094d0 con 0x7fd8b815c0b0 2023-06-10T19:00:51.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:51.228+0000 7fd8becbd640 1 --2- 172.21.15.53:0/3342405063 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8b815c0b0 0x7fd8b81529d0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7fd8b000c390 tx=0x7fd8b000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:51.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:51.228+0000 7fd8aeffd640 1 -- 172.21.15.53:0/3342405063 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b00052d0 con 0x7fd8b815c0b0 2023-06-10T19:00:51.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:51.228+0000 7fd8aeffd640 1 -- 172.21.15.53:0/3342405063 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8b0005430 con 0x7fd8b815c0b0 2023-06-10T19:00:51.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:51.228+0000 7fd8aeffd640 1 -- 172.21.15.53:0/3342405063 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b0007240 con 0x7fd8b815c0b0 2023-06-10T19:00:51.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:51.228+0000 7fd8c0720640 1 -- 172.21.15.53:0/3342405063 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8b8153fb0 con 0x7fd8b815c0b0 2023-06-10T19:00:51.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:51.228+0000 7fd8c0720640 1 -- 172.21.15.53:0/3342405063 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8b8154570 con 0x7fd8b815c0b0 2023-06-10T19:00:51.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:51.232+0000 7fd8c0720640 1 -- 172.21.15.53:0/3342405063 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8b8154d70 con 0x7fd8b815c0b0 2023-06-10T19:00:51.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:51.232+0000 7fd8aeffd640 1 -- 172.21.15.53:0/3342405063 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd8b00073a0 con 0x7fd8b815c0b0 2023-06-10T19:00:51.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:51.232+0000 7fd8aeffd640 1 --2- 172.21.15.53:0/3342405063 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd89c066280 0x7fd89c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:51.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:51.232+0000 7fd8aeffd640 1 -- 172.21.15.53:0/3342405063 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6148+0+0 (secure 0 0 0) 0x7fd8b00830e0 con 0x7fd8b815c0b0 2023-06-10T19:00:51.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:51.232+0000 7fd8be4bc640 1 --2- 172.21.15.53:0/3342405063 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd89c066280 0x7fd89c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:51.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:51.232+0000 7fd8be4bc640 1 --2- 172.21.15.53:0/3342405063 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd89c066280 0x7fd89c068730 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fd8b8065d80 tx=0x7fd8b400b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:51.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:51.236+0000 7fd8aeffd640 1 -- 172.21.15.53:0/3342405063 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd8b0050590 con 0x7fd8b815c0b0 2023-06-10T19:00:51.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:51.420+0000 7fd8c0720640 1 -- 172.21.15.53:0/3342405063 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd8b804d790 con 0x7fd8b815c0b0 2023-06-10T19:00:51.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:51.420+0000 7fd8aeffd640 1 -- 172.21.15.53:0/3342405063 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4683 (secure 0 0 0) 0x7fd8b0053bb0 con 0x7fd8b815c0b0 2023-06-10T19:00:51.425 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:00:51.426 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":38,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5663,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2600814414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2600814414},{"type":"v1","addr":"172.21.15.117:6835","nonce":2600814414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6136,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1615882017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1615882017},{"type":"v1","addr":"172.21.15.117:6837","nonce":1615882017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6993,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/3732245174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3732245174},{"type":"v1","addr":"172.21.15.53:6833","nonce":3732245174}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:00:20.607950+0000","modified":"2023-06-10T19:00:49.023162+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7266":{"gid":7266,"name":"c","rank":0,"incarnation":37,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.53:6835/2829993338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2829993338},{"type":"v1","addr":"172.21.15.53:6835","nonce":2829993338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-06-10T19:00:51.427 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 38 2023-06-10T19:00:51.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:51.420+0000 7fd8c0720640 1 -- 172.21.15.53:0/3342405063 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd89c066280 msgr2=0x7fd89c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:51.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:51.420+0000 7fd8c0720640 1 --2- 172.21.15.53:0/3342405063 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd89c066280 0x7fd89c068730 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fd8b8065d80 tx=0x7fd8b400b040 comp rx=0 tx=0).stop 2023-06-10T19:00:51.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:51.420+0000 7fd8c0720640 1 -- 172.21.15.53:0/3342405063 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8b815c0b0 msgr2=0x7fd8b81529d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:51.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:51.420+0000 7fd8c0720640 1 --2- 172.21.15.53:0/3342405063 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8b815c0b0 0x7fd8b81529d0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7fd8b000c390 tx=0x7fd8b000c850 comp rx=0 tx=0).stop 2023-06-10T19:00:51.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:51.420+0000 7fd8c0720640 1 -- 172.21.15.53:0/3342405063 shutdown_connections 2023-06-10T19:00:51.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:51.420+0000 7fd8c0720640 1 --2- 172.21.15.53:0/3342405063 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd89c066280 0x7fd89c068730 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:51.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:51.420+0000 7fd8c0720640 1 --2- 172.21.15.53:0/3342405063 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8b815c0b0 0x7fd8b81529d0 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:51.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:51.420+0000 7fd8c0720640 1 --2- 172.21.15.53:0/3342405063 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8b80cc160 0x7fd8b8155050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:51.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:51.420+0000 7fd8c0720640 1 --2- 172.21.15.53:0/3342405063 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8b80cbd50 0x7fd8b80c7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:51.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:51.420+0000 7fd8c0720640 1 -- 172.21.15.53:0/3342405063 >> 172.21.15.53:0/3342405063 conn(0x7fd8b806a0d0 msgr2=0x7fd8b80ce4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:51.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:51.420+0000 7fd8c0720640 1 -- 172.21.15.53:0/3342405063 shutdown_connections 2023-06-10T19:00:51.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:51.420+0000 7fd8c0720640 1 -- 172.21.15.53:0/3342405063 wait complete. 2023-06-10T19:00:51.443 DEBUG:tasks.cephfs.filesystem:mapped states ['up:reconnect'] to None 2023-06-10T19:00:52.444 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:00:52.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:52.576+0000 7f74a4955640 1 Processor -- start 2023-06-10T19:00:52.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:52.576+0000 7f74a4955640 1 -- start start 2023-06-10T19:00:52.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:52.580+0000 7f74a4955640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f74a006b2f0 0x7f74a006f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:52.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:52.580+0000 7f74a4955640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f74a00c8d00 0x7f74a006b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:52.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:52.580+0000 7f74a4955640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74a0158a90 con 0x7f74a006bc00 2023-06-10T19:00:52.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:52.580+0000 7f74a4955640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74a00705d0 con 0x7f74a006b2f0 2023-06-10T19:00:52.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:52.580+0000 7f74a4955640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74a006f9c0 con 0x7f74a00c8d00 2023-06-10T19:00:52.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:52.580+0000 7f749e59c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f74a006b2f0 0x7f74a006f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:52.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:52.580+0000 7f749ed9d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f74a006bc00 0x7f74a00cbe00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:58084/0 (socket says 172.21.15.53:58084) 2023-06-10T19:00:52.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:52.580+0000 7f749ed9d640 1 -- 172.21.15.53:0/2737232566 learned_addr learned my addr 172.21.15.53:0/2737232566 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:00:52.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:52.580+0000 7f749dd9b640 1 --2- 172.21.15.53:0/2737232566 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f74a00c8d00 0x7f74a006b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:52.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:52.580+0000 7f749e59c640 1 -- 172.21.15.53:0/2737232566 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f74a00c8d00 msgr2=0x7f74a006b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:52.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:52.580+0000 7f749e59c640 1 --2- 172.21.15.53:0/2737232566 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f74a00c8d00 0x7f74a006b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:52.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:52.580+0000 7f749e59c640 1 -- 172.21.15.53:0/2737232566 >> v1:172.21.15.53:6789/0 conn(0x7f74a006bc00 legacy=0x7f74a00cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:52.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:52.580+0000 7f749d59a640 1 -- 172.21.15.53:0/2737232566 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2082751429 0 0) 0x7f7498001120 con 0x7f74a006bc00 2023-06-10T19:00:52.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:52.580+0000 7f749e59c640 1 -- 172.21.15.53:0/2737232566 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a006fca0 con 0x7f74a006b2f0 2023-06-10T19:00:52.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:52.580+0000 7f749e59c640 1 --2- 172.21.15.53:0/2737232566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74a006b2f0 0x7f74a006f070 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f7490009dc0 tx=0x7f749001f120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e8dc1975f0add49 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:52.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:52.580+0000 7f749d59a640 1 -- 172.21.15.53:0/2737232566 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74900af600 con 0x7f74a006b2f0 2023-06-10T19:00:52.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:52.580+0000 7f749d59a640 1 -- 172.21.15.53:0/2737232566 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74900ab050 con 0x7f74a006b2f0 2023-06-10T19:00:52.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:52.580+0000 7f749d59a640 1 -- 172.21.15.53:0/2737232566 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74900af980 con 0x7f74a006b2f0 2023-06-10T19:00:52.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:52.580+0000 7f74a4955640 1 -- 172.21.15.53:0/2737232566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74a006b2f0 msgr2=0x7f74a006f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:52.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:52.580+0000 7f74a4955640 1 --2- 172.21.15.53:0/2737232566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74a006b2f0 0x7f74a006f070 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f7490009dc0 tx=0x7f749001f120 comp rx=0 tx=0).stop 2023-06-10T19:00:52.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:52.580+0000 7f74a4955640 1 -- 172.21.15.53:0/2737232566 shutdown_connections 2023-06-10T19:00:52.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:52.580+0000 7f74a4955640 1 --2- 172.21.15.53:0/2737232566 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f74a00c8d00 0x7f74a006b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:52.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:52.580+0000 7f74a4955640 1 --2- 172.21.15.53:0/2737232566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74a006b2f0 0x7f74a006f070 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:52.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:52.580+0000 7f74a4955640 1 -- 172.21.15.53:0/2737232566 >> 172.21.15.53:0/2737232566 conn(0x7f74a006a0d0 msgr2=0x7f74a00ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:52.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:52.580+0000 7f74a4955640 1 -- 172.21.15.53:0/2737232566 shutdown_connections 2023-06-10T19:00:52.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:52.580+0000 7f74a4955640 1 -- 172.21.15.53:0/2737232566 wait complete. 2023-06-10T19:00:52.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:52.584+0000 7f74a4955640 1 Processor -- start 2023-06-10T19:00:52.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:52.584+0000 7f74a4955640 1 -- start start 2023-06-10T19:00:52.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:52.584+0000 7f74a4955640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f74a006b2f0 0x7f74a00b1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:52.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:52.584+0000 7f74a4955640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74a006bc00 0x7f74a0155230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:52.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:52.584+0000 7f74a4955640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f74a00c8d00 0x7f74a00ae180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:52.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:52.584+0000 7f74a4955640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a00abb80 con 0x7f74a006bc00 2023-06-10T19:00:52.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:52.584+0000 7f74a4955640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a00af270 con 0x7f74a00c8d00 2023-06-10T19:00:52.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:52.584+0000 7f74a4955640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74a0155770 con 0x7f74a006b2f0 2023-06-10T19:00:52.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:52.584+0000 7f749dd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74a006bc00 0x7f74a0155230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:52.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:52.584+0000 7f749dd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74a006bc00 0x7f74a0155230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54128/0 (socket says 172.21.15.53:54128) 2023-06-10T19:00:52.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:52.584+0000 7f749dd9b640 1 -- 172.21.15.53:0/857091505 learned_addr learned my addr 172.21.15.53:0/857091505 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:52.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:52.584+0000 7f749e59c640 1 --2- 172.21.15.53:0/857091505 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f74a006b2f0 0x7f74a00b1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:52.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:52.584+0000 7f749ed9d640 1 --2- 172.21.15.53:0/857091505 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f74a00c8d00 0x7f74a00ae180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:52.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:52.584+0000 7f749dd9b640 1 -- 172.21.15.53:0/857091505 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f74a006b2f0 msgr2=0x7f74a00b1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:52.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:52.584+0000 7f749dd9b640 1 --2- 172.21.15.53:0/857091505 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f74a006b2f0 0x7f74a00b1bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:52.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:52.584+0000 7f749dd9b640 1 -- 172.21.15.53:0/857091505 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f74a00c8d00 msgr2=0x7f74a00ae180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:52.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:52.584+0000 7f749dd9b640 1 --2- 172.21.15.53:0/857091505 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f74a00c8d00 0x7f74a00ae180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:52.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:52.584+0000 7f749dd9b640 1 -- 172.21.15.53:0/857091505 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7490009a70 con 0x7f74a006bc00 2023-06-10T19:00:52.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:52.584+0000 7f749ed9d640 1 --2- 172.21.15.53:0/857091505 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f74a00c8d00 0x7f74a00ae180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:00:52.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:52.584+0000 7f749dd9b640 1 --2- 172.21.15.53:0/857091505 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74a006bc00 0x7f74a0155230 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f749400d5f0 tx=0x7f749400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:52.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:52.584+0000 7f748effd640 1 -- 172.21.15.53:0/857091505 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74940125f0 con 0x7f74a006bc00 2023-06-10T19:00:52.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:52.584+0000 7f748effd640 1 -- 172.21.15.53:0/857091505 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7494012750 con 0x7f74a006bc00 2023-06-10T19:00:52.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:52.584+0000 7f748effd640 1 -- 172.21.15.53:0/857091505 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7494012ae0 con 0x7f74a006bc00 2023-06-10T19:00:52.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:52.584+0000 7f74a4955640 1 -- 172.21.15.53:0/857091505 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74a00ae9d0 con 0x7f74a006bc00 2023-06-10T19:00:52.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:52.584+0000 7f74a4955640 1 -- 172.21.15.53:0/857091505 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74a00aef90 con 0x7f74a006bc00 2023-06-10T19:00:52.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:52.584+0000 7f74a4955640 1 -- 172.21.15.53:0/857091505 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74a0070a40 con 0x7f74a006bc00 2023-06-10T19:00:52.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:52.588+0000 7f748effd640 1 -- 172.21.15.53:0/857091505 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7494012c40 con 0x7f74a006bc00 2023-06-10T19:00:52.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:52.588+0000 7f748effd640 1 --2- 172.21.15.53:0/857091505 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7480066280 0x7f7480068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:52.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:52.588+0000 7f748effd640 1 -- 172.21.15.53:0/857091505 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f74940842b0 con 0x7f74a006bc00 2023-06-10T19:00:52.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:52.588+0000 7f749e59c640 1 --2- 172.21.15.53:0/857091505 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7480066280 0x7f7480068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:52.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:52.588+0000 7f749e59c640 1 --2- 172.21.15.53:0/857091505 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7480066280 0x7f7480068730 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f74900b1000 tx=0x7f74900aa000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:52.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:52.592+0000 7f748effd640 1 -- 172.21.15.53:0/857091505 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f74a0070a40 con 0x7f74a006bc00 2023-06-10T19:00:52.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:52.780+0000 7f74a4955640 1 -- 172.21.15.53:0/857091505 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f74a0070a40 con 0x7f74a006bc00 2023-06-10T19:00:52.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:52.780+0000 7f748effd640 1 -- 172.21.15.53:0/857091505 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4683 (secure 0 0 0) 0x7f74a0070a40 con 0x7f74a006bc00 2023-06-10T19:00:52.786 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:00:52.786 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":38,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5663,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2600814414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2600814414},{"type":"v1","addr":"172.21.15.117:6835","nonce":2600814414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6136,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1615882017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1615882017},{"type":"v1","addr":"172.21.15.117:6837","nonce":1615882017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6993,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/3732245174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3732245174},{"type":"v1","addr":"172.21.15.53:6833","nonce":3732245174}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:00:20.607950+0000","modified":"2023-06-10T19:00:49.023162+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7266":{"gid":7266,"name":"c","rank":0,"incarnation":37,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.53:6835/2829993338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2829993338},{"type":"v1","addr":"172.21.15.53:6835","nonce":2829993338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-06-10T19:00:52.787 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 38 2023-06-10T19:00:52.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:52.784+0000 7f74a4955640 1 -- 172.21.15.53:0/857091505 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7480066280 msgr2=0x7f7480068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:52.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:52.784+0000 7f74a4955640 1 --2- 172.21.15.53:0/857091505 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7480066280 0x7f7480068730 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f74900b1000 tx=0x7f74900aa000 comp rx=0 tx=0).stop 2023-06-10T19:00:52.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:52.784+0000 7f74a4955640 1 -- 172.21.15.53:0/857091505 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74a006bc00 msgr2=0x7f74a0155230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:52.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:52.784+0000 7f74a4955640 1 --2- 172.21.15.53:0/857091505 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74a006bc00 0x7f74a0155230 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f749400d5f0 tx=0x7f749400dab0 comp rx=0 tx=0).stop 2023-06-10T19:00:52.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:52.784+0000 7f74a4955640 1 -- 172.21.15.53:0/857091505 shutdown_connections 2023-06-10T19:00:52.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:52.784+0000 7f74a4955640 1 --2- 172.21.15.53:0/857091505 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7480066280 0x7f7480068730 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:52.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:52.784+0000 7f74a4955640 1 --2- 172.21.15.53:0/857091505 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f74a00c8d00 0x7f74a00ae180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:52.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:52.784+0000 7f74a4955640 1 --2- 172.21.15.53:0/857091505 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74a006bc00 0x7f74a0155230 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:52.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:52.784+0000 7f74a4955640 1 --2- 172.21.15.53:0/857091505 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f74a006b2f0 0x7f74a00b1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:52.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:52.784+0000 7f74a4955640 1 -- 172.21.15.53:0/857091505 >> 172.21.15.53:0/857091505 conn(0x7f74a006a0d0 msgr2=0x7f74a01e4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:52.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:52.784+0000 7f74a4955640 1 -- 172.21.15.53:0/857091505 shutdown_connections 2023-06-10T19:00:52.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:52.784+0000 7f74a4955640 1 -- 172.21.15.53:0/857091505 wait complete. 2023-06-10T19:00:52.804 DEBUG:tasks.cephfs.filesystem:mapped states ['up:reconnect'] to None 2023-06-10T19:00:53.805 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:00:53.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:53.936+0000 7ff0d76d8640 1 Processor -- start 2023-06-10T19:00:53.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:53.936+0000 7ff0d76d8640 1 -- start start 2023-06-10T19:00:53.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:53.936+0000 7ff0d76d8640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0d00b3ac0 0x7ff0d00b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:53.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:53.936+0000 7ff0d76d8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff0d00cc690 0x7ff0d015f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:53.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:53.936+0000 7ff0d76d8640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff0d00ccae0 0x7ff0d015f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:53.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:53.936+0000 7ff0d76d8640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0d00d0020 con 0x7ff0d00cc690 2023-06-10T19:00:53.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:53.936+0000 7ff0d76d8640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0d00b43d0 con 0x7ff0d00ccae0 2023-06-10T19:00:53.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:53.936+0000 7ff0d76d8640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d00cef40 con 0x7ff0d00b3ac0 2023-06-10T19:00:53.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:53.936+0000 7ff0d4c73640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff0d00cc690 0x7ff0d015f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:53.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:53.936+0000 7ff0d4c73640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff0d00cc690 0x7ff0d015f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54142/0 (socket says 172.21.15.53:54142) 2023-06-10T19:00:53.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:53.936+0000 7ff0d4c73640 1 -- 172.21.15.53:0/283106307 learned_addr learned my addr 172.21.15.53:0/283106307 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:53.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:53.936+0000 7ff0d5474640 1 --2- 172.21.15.53:0/283106307 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0d00b3ac0 0x7ff0d00b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:53.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:53.936+0000 7ff0d5c75640 1 --2- 172.21.15.53:0/283106307 >> v2:172.21.15.117:3300/0 conn(0x7ff0d00ccae0 0x7ff0d015f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:53.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:53.936+0000 7ff0d4c73640 1 -- 172.21.15.53:0/283106307 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0d00b3ac0 msgr2=0x7ff0d00b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:53.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:53.936+0000 7ff0d4c73640 1 --2- 172.21.15.53:0/283106307 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0d00b3ac0 0x7ff0d00b3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:53.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:53.936+0000 7ff0d4c73640 1 -- 172.21.15.53:0/283106307 >> v2:172.21.15.117:3300/0 conn(0x7ff0d00ccae0 msgr2=0x7ff0d015f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:53.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:53.936+0000 7ff0d4c73640 1 --2- 172.21.15.53:0/283106307 >> v2:172.21.15.117:3300/0 conn(0x7ff0d00ccae0 0x7ff0d015f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:53.944 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:53.936+0000 7ff0d4c73640 1 -- 172.21.15.53:0/283106307 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d00cf220 con 0x7ff0d00cc690 2023-06-10T19:00:53.944 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:53.936+0000 7ff0d5474640 1 --2- 172.21.15.53:0/283106307 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0d00b3ac0 0x7ff0d00b3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:00:53.944 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:53.936+0000 7ff0d5c75640 1 --2- 172.21.15.53:0/283106307 >> v2:172.21.15.117:3300/0 conn(0x7ff0d00ccae0 0x7ff0d015f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:00:53.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:53.940+0000 7ff0d4c73640 1 --2- 172.21.15.53:0/283106307 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff0d00cc690 0x7ff0d015f370 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7ff0d00b14a0 tx=0x7ff0c001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7a12cc58e82cb23 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:53.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:53.940+0000 7ff0c7fff640 1 -- 172.21.15.53:0/283106307 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c00ac600 con 0x7ff0d00cc690 2023-06-10T19:00:53.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:53.940+0000 7ff0c7fff640 1 -- 172.21.15.53:0/283106307 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0c00a8050 con 0x7ff0d00cc690 2023-06-10T19:00:53.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:53.940+0000 7ff0c7fff640 1 -- 172.21.15.53:0/283106307 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c00ac980 con 0x7ff0d00cc690 2023-06-10T19:00:53.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:53.940+0000 7ff0d76d8640 1 -- 172.21.15.53:0/283106307 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff0d00cc690 msgr2=0x7ff0d015f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:53.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:53.940+0000 7ff0d76d8640 1 --2- 172.21.15.53:0/283106307 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff0d00cc690 0x7ff0d015f370 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7ff0d00b14a0 tx=0x7ff0c001c4d0 comp rx=0 tx=0).stop 2023-06-10T19:00:53.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:53.940+0000 7ff0d76d8640 1 -- 172.21.15.53:0/283106307 shutdown_connections 2023-06-10T19:00:53.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:53.940+0000 7ff0d76d8640 1 --2- 172.21.15.53:0/283106307 >> v2:172.21.15.117:3300/0 conn(0x7ff0d00ccae0 0x7ff0d015f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:53.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:53.940+0000 7ff0d76d8640 1 --2- 172.21.15.53:0/283106307 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff0d00cc690 0x7ff0d015f370 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:53.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:53.940+0000 7ff0d76d8640 1 --2- 172.21.15.53:0/283106307 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0d00b3ac0 0x7ff0d00b3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:53.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:53.940+0000 7ff0d76d8640 1 -- 172.21.15.53:0/283106307 >> 172.21.15.53:0/283106307 conn(0x7ff0d0071790 msgr2=0x7ff0d0069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:53.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:53.940+0000 7ff0d76d8640 1 -- 172.21.15.53:0/283106307 shutdown_connections 2023-06-10T19:00:53.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:53.940+0000 7ff0d76d8640 1 -- 172.21.15.53:0/283106307 wait complete. 2023-06-10T19:00:53.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:53.940+0000 7ff0d76d8640 1 Processor -- start 2023-06-10T19:00:53.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:53.940+0000 7ff0d76d8640 1 -- start start 2023-06-10T19:00:53.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:53.940+0000 7ff0d76d8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0d00b3ac0 0x7ff0d00c68e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:53.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:53.940+0000 7ff0d76d8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff0d00cc690 0x7ff0d015e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:53.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:53.940+0000 7ff0d76d8640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0d00ccae0 0x7ff0d0153570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:53.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:53.940+0000 7ff0d76d8640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d00c7bb0 con 0x7ff0d00cc690 2023-06-10T19:00:53.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:53.940+0000 7ff0d76d8640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d015ec50 con 0x7ff0d00b3ac0 2023-06-10T19:00:53.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:53.940+0000 7ff0d76d8640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d00c6fa0 con 0x7ff0d00ccae0 2023-06-10T19:00:53.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:53.940+0000 7ff0d4c73640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff0d00cc690 0x7ff0d015e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:53.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:53.940+0000 7ff0d4c73640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff0d00cc690 0x7ff0d015e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54148/0 (socket says 172.21.15.53:54148) 2023-06-10T19:00:53.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:53.940+0000 7ff0d4c73640 1 -- 172.21.15.53:0/3827994966 learned_addr learned my addr 172.21.15.53:0/3827994966 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:53.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:53.940+0000 7ff0d5c75640 1 --2- 172.21.15.53:0/3827994966 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0d00ccae0 0x7ff0d0153570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:53.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:53.940+0000 7ff0d5474640 1 --2- 172.21.15.53:0/3827994966 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0d00b3ac0 0x7ff0d00c68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:53.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:53.940+0000 7ff0d4c73640 1 -- 172.21.15.53:0/3827994966 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0d00ccae0 msgr2=0x7ff0d0153570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:53.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:53.940+0000 7ff0d4c73640 1 --2- 172.21.15.53:0/3827994966 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0d00ccae0 0x7ff0d0153570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:53.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:53.940+0000 7ff0d4c73640 1 -- 172.21.15.53:0/3827994966 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0d00b3ac0 msgr2=0x7ff0d00c68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:53.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:53.944+0000 7ff0d4c73640 1 --2- 172.21.15.53:0/3827994966 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0d00b3ac0 0x7ff0d00c68e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:53.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:53.944+0000 7ff0d4c73640 1 -- 172.21.15.53:0/3827994966 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0c00094d0 con 0x7ff0d00cc690 2023-06-10T19:00:53.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:53.944+0000 7ff0d4c73640 1 --2- 172.21.15.53:0/3827994966 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff0d00cc690 0x7ff0d015e710 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7ff0c001ab80 tx=0x7ff0c0019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:53.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:53.944+0000 7ff0c5ffb640 1 -- 172.21.15.53:0/3827994966 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c00bb070 con 0x7ff0d00cc690 2023-06-10T19:00:53.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:53.944+0000 7ff0c5ffb640 1 -- 172.21.15.53:0/3827994966 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0c00b5410 con 0x7ff0d00cc690 2023-06-10T19:00:53.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:53.944+0000 7ff0c5ffb640 1 -- 172.21.15.53:0/3827994966 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c00b57c0 con 0x7ff0d00cc690 2023-06-10T19:00:53.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:53.944+0000 7ff0d76d8640 1 -- 172.21.15.53:0/3827994966 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0d00c7280 con 0x7ff0d00cc690 2023-06-10T19:00:53.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:53.944+0000 7ff0d76d8640 1 -- 172.21.15.53:0/3827994966 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0d00c7840 con 0x7ff0d00cc690 2023-06-10T19:00:53.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:53.944+0000 7ff0d76d8640 1 -- 172.21.15.53:0/3827994966 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0d00c7d20 con 0x7ff0d00cc690 2023-06-10T19:00:53.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:53.944+0000 7ff0c5ffb640 1 -- 172.21.15.53:0/3827994966 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff0c00b3040 con 0x7ff0d00cc690 2023-06-10T19:00:53.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:53.944+0000 7ff0c5ffb640 1 --2- 172.21.15.53:0/3827994966 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff0b40662b0 0x7ff0b4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:53.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:53.944+0000 7ff0c5ffb640 1 -- 172.21.15.53:0/3827994966 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6148+0+0 (secure 0 0 0) 0x7ff0c011d600 con 0x7ff0d00cc690 2023-06-10T19:00:53.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:53.944+0000 7ff0d5474640 1 --2- 172.21.15.53:0/3827994966 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff0b40662b0 0x7ff0b4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:53.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:53.944+0000 7ff0d5474640 1 --2- 172.21.15.53:0/3827994966 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff0b40662b0 0x7ff0b4068760 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7ff0d0158550 tx=0x7ff0cc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:53.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:53.948+0000 7ff0c5ffb640 1 -- 172.21.15.53:0/3827994966 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff0c00eaa20 con 0x7ff0d00cc690 2023-06-10T19:00:54.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:54.132+0000 7ff0d76d8640 1 -- 172.21.15.53:0/3827994966 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff0d004d790 con 0x7ff0d00cc690 2023-06-10T19:00:54.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:54.132+0000 7ff0c5ffb640 1 -- 172.21.15.53:0/3827994966 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4683 (secure 0 0 0) 0x7ff0c00ee040 con 0x7ff0d00cc690 2023-06-10T19:00:54.139 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:00:54.139 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":38,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5663,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2600814414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2600814414},{"type":"v1","addr":"172.21.15.117:6835","nonce":2600814414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6136,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1615882017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1615882017},{"type":"v1","addr":"172.21.15.117:6837","nonce":1615882017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6993,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/3732245174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3732245174},{"type":"v1","addr":"172.21.15.53:6833","nonce":3732245174}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:00:20.607950+0000","modified":"2023-06-10T19:00:49.023162+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7266":{"gid":7266,"name":"c","rank":0,"incarnation":37,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.53:6835/2829993338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2829993338},{"type":"v1","addr":"172.21.15.53:6835","nonce":2829993338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-06-10T19:00:54.140 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 38 2023-06-10T19:00:54.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:54.136+0000 7ff0d76d8640 1 -- 172.21.15.53:0/3827994966 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff0b40662b0 msgr2=0x7ff0b4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:54.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:54.136+0000 7ff0d76d8640 1 --2- 172.21.15.53:0/3827994966 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff0b40662b0 0x7ff0b4068760 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7ff0d0158550 tx=0x7ff0cc008040 comp rx=0 tx=0).stop 2023-06-10T19:00:54.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:54.136+0000 7ff0d76d8640 1 -- 172.21.15.53:0/3827994966 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff0d00cc690 msgr2=0x7ff0d015e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:54.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:54.136+0000 7ff0d76d8640 1 --2- 172.21.15.53:0/3827994966 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff0d00cc690 0x7ff0d015e710 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7ff0c001ab80 tx=0x7ff0c0019270 comp rx=0 tx=0).stop 2023-06-10T19:00:54.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:54.136+0000 7ff0d76d8640 1 -- 172.21.15.53:0/3827994966 shutdown_connections 2023-06-10T19:00:54.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:54.136+0000 7ff0d76d8640 1 --2- 172.21.15.53:0/3827994966 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff0b40662b0 0x7ff0b4068760 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:54.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:54.136+0000 7ff0d76d8640 1 --2- 172.21.15.53:0/3827994966 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0d00ccae0 0x7ff0d0153570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:54.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:54.136+0000 7ff0d76d8640 1 --2- 172.21.15.53:0/3827994966 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff0d00cc690 0x7ff0d015e710 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:54.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:54.136+0000 7ff0d76d8640 1 --2- 172.21.15.53:0/3827994966 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0d00b3ac0 0x7ff0d00c68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:54.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:54.136+0000 7ff0d76d8640 1 -- 172.21.15.53:0/3827994966 >> 172.21.15.53:0/3827994966 conn(0x7ff0d0071790 msgr2=0x7ff0d01585f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:54.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:54.136+0000 7ff0d76d8640 1 -- 172.21.15.53:0/3827994966 shutdown_connections 2023-06-10T19:00:54.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:54.136+0000 7ff0d76d8640 1 -- 172.21.15.53:0/3827994966 wait complete. 2023-06-10T19:00:54.155 DEBUG:tasks.cephfs.filesystem:mapped states ['up:reconnect'] to None 2023-06-10T19:00:55.156 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:00:55.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:55.292+0000 7f4c4a772640 1 Processor -- start 2023-06-10T19:00:55.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:55.292+0000 7f4c4a772640 1 -- start start 2023-06-10T19:00:55.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:55.292+0000 7f4c4a772640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4c4415eef0 0x7f4c44070f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:55.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:55.292+0000 7f4c4a772640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4c44069450 0x7f4c440698b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:55.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:55.292+0000 7f4c4a772640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c44069df0 con 0x7f4c4415f570 2023-06-10T19:00:55.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:55.292+0000 7f4c4a772640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c4415f2c0 con 0x7f4c44069450 2023-06-10T19:00:55.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:55.292+0000 7f4c4a772640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c4415fdc0 con 0x7f4c4415eef0 2023-06-10T19:00:55.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:55.292+0000 7f4c43fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4c4415eef0 0x7f4c44070f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:55.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:55.292+0000 7f4c48d0f640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4c44069450 0x7f4c440698b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:55.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:55.292+0000 7f4c43fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4c4415eef0 0x7f4c44070f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.53:41590/0 (socket says 172.21.15.53:41590) 2023-06-10T19:00:55.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:55.292+0000 7f4c43fff640 1 -- 172.21.15.53:0/2656151427 learned_addr learned my addr 172.21.15.53:0/2656151427 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:55.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:55.292+0000 7f4c43fff640 1 -- 172.21.15.53:0/2656151427 >> v2:172.21.15.117:3300/0 conn(0x7f4c44069450 msgr2=0x7f4c440698b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:55.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:55.292+0000 7f4c43fff640 1 --2- 172.21.15.53:0/2656151427 >> v2:172.21.15.117:3300/0 conn(0x7f4c44069450 0x7f4c440698b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:55.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:55.292+0000 7f4c43fff640 1 -- 172.21.15.53:0/2656151427 >> v1:172.21.15.117:6789/0 conn(0x7f4c4415f570 legacy=0x7f4c440ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:55.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:55.292+0000 7f4c43fff640 1 -- 172.21.15.53:0/2656151427 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c441600a0 con 0x7f4c4415eef0 2023-06-10T19:00:55.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:55.292+0000 7f4c48d0f640 1 --2- 172.21.15.53:0/2656151427 >> v2:172.21.15.117:3300/0 conn(0x7f4c44069450 0x7f4c440698b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-10T19:00:55.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:55.296+0000 7f4c43fff640 1 --2- 172.21.15.53:0/2656151427 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4c4415eef0 0x7f4c44070f80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c009e50 tx=0x7f4c3c01ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2b74cf39560311b server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:55.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:55.296+0000 7f4c42ffd640 1 -- 172.21.15.53:0/2656151427 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3c0a57d0 con 0x7f4c4415eef0 2023-06-10T19:00:55.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:55.296+0000 7f4c42ffd640 1 -- 172.21.15.53:0/2656151427 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c3c0a5930 con 0x7f4c4415eef0 2023-06-10T19:00:55.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:55.296+0000 7f4c42ffd640 1 -- 172.21.15.53:0/2656151427 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3c0a5cc0 con 0x7f4c4415eef0 2023-06-10T19:00:55.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:55.296+0000 7f4c4a772640 1 -- 172.21.15.53:0/2656151427 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4c4415eef0 msgr2=0x7f4c44070f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:55.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:55.296+0000 7f4c4a772640 1 --2- 172.21.15.53:0/2656151427 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4c4415eef0 0x7f4c44070f80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c009e50 tx=0x7f4c3c01ca10 comp rx=0 tx=0).stop 2023-06-10T19:00:55.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:55.296+0000 7f4c4a772640 1 -- 172.21.15.53:0/2656151427 shutdown_connections 2023-06-10T19:00:55.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:55.296+0000 7f4c4a772640 1 --2- 172.21.15.53:0/2656151427 >> v2:172.21.15.117:3300/0 conn(0x7f4c44069450 0x7f4c440698b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:55.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:55.296+0000 7f4c4a772640 1 --2- 172.21.15.53:0/2656151427 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4c4415eef0 0x7f4c44070f80 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:55.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:55.296+0000 7f4c4a772640 1 -- 172.21.15.53:0/2656151427 >> 172.21.15.53:0/2656151427 conn(0x7f4c4406a560 msgr2=0x7f4c4406a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:55.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:55.296+0000 7f4c4a772640 1 -- 172.21.15.53:0/2656151427 shutdown_connections 2023-06-10T19:00:55.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:55.296+0000 7f4c4a772640 1 -- 172.21.15.53:0/2656151427 wait complete. 2023-06-10T19:00:55.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:55.296+0000 7f4c4a772640 1 Processor -- start 2023-06-10T19:00:55.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:55.296+0000 7f4c4a772640 1 -- start start 2023-06-10T19:00:55.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:55.300+0000 7f4c4a772640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4c44069450 0x7f4c440c32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:55.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:55.300+0000 7f4c4a772640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c4415eef0 0x7f4c441536f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:55.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:55.300+0000 7f4c4a772640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c4415f570 0x7f4c44158f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:55.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:55.300+0000 7f4c4a772640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c44156020 con 0x7f4c4415f570 2023-06-10T19:00:55.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:55.300+0000 7f4c4a772640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c440b20a0 con 0x7f4c4415eef0 2023-06-10T19:00:55.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:55.300+0000 7f4c4a772640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c440b2380 con 0x7f4c44069450 2023-06-10T19:00:55.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:55.300+0000 7f4c48d0f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c4415f570 0x7f4c44158f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:55.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:55.300+0000 7f4c48d0f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c4415f570 0x7f4c44158f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54160/0 (socket says 172.21.15.53:54160) 2023-06-10T19:00:55.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:55.300+0000 7f4c48d0f640 1 -- 172.21.15.53:0/3141881214 learned_addr learned my addr 172.21.15.53:0/3141881214 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:55.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:55.300+0000 7f4c43fff640 1 --2- 172.21.15.53:0/3141881214 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4c44069450 0x7f4c440c32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:55.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:55.300+0000 7f4c437fe640 1 --2- 172.21.15.53:0/3141881214 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c4415eef0 0x7f4c441536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:55.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:55.300+0000 7f4c48d0f640 1 -- 172.21.15.53:0/3141881214 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4c44069450 msgr2=0x7f4c440c32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:55.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:55.300+0000 7f4c48d0f640 1 --2- 172.21.15.53:0/3141881214 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4c44069450 0x7f4c440c32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:55.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:55.300+0000 7f4c48d0f640 1 -- 172.21.15.53:0/3141881214 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c4415eef0 msgr2=0x7f4c441536f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:55.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:55.300+0000 7f4c48d0f640 1 --2- 172.21.15.53:0/3141881214 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c4415eef0 0x7f4c441536f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:55.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:55.300+0000 7f4c48d0f640 1 -- 172.21.15.53:0/3141881214 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c34009420 con 0x7f4c4415f570 2023-06-10T19:00:55.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:55.300+0000 7f4c48d0f640 1 --2- 172.21.15.53:0/3141881214 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c4415f570 0x7f4c44158f70 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f4c3400e930 tx=0x7f4c3400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:55.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:55.300+0000 7f4c40ff9640 1 -- 172.21.15.53:0/3141881214 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c34009680 con 0x7f4c4415f570 2023-06-10T19:00:55.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:55.300+0000 7f4c40ff9640 1 -- 172.21.15.53:0/3141881214 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c34004020 con 0x7f4c4415f570 2023-06-10T19:00:55.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:55.300+0000 7f4c40ff9640 1 -- 172.21.15.53:0/3141881214 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c340043f0 con 0x7f4c4415f570 2023-06-10T19:00:55.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:55.300+0000 7f4c4a772640 1 -- 172.21.15.53:0/3141881214 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c3c009b30 con 0x7f4c4415f570 2023-06-10T19:00:55.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:55.300+0000 7f4c4a772640 1 -- 172.21.15.53:0/3141881214 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c440b2940 con 0x7f4c4415f570 2023-06-10T19:00:55.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:55.300+0000 7f4c4a772640 1 -- 172.21.15.53:0/3141881214 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c4404d790 con 0x7f4c4415f570 2023-06-10T19:00:55.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:55.300+0000 7f4c40ff9640 1 -- 172.21.15.53:0/3141881214 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4c3400c940 con 0x7f4c4415f570 2023-06-10T19:00:55.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:55.300+0000 7f4c40ff9640 1 --2- 172.21.15.53:0/3141881214 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4c30066280 0x7f4c30068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:55.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:55.300+0000 7f4c40ff9640 1 -- 172.21.15.53:0/3141881214 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f4c34083b20 con 0x7f4c4415f570 2023-06-10T19:00:55.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:55.300+0000 7f4c43fff640 1 --2- 172.21.15.53:0/3141881214 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4c30066280 0x7f4c30068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:55.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:55.304+0000 7f4c43fff640 1 --2- 172.21.15.53:0/3141881214 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4c30066280 0x7f4c30068730 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c0ae000 tx=0x7f4c3c0a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:55.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:55.304+0000 7f4c40ff9640 1 -- 172.21.15.53:0/3141881214 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4c34051080 con 0x7f4c4415f570 2023-06-10T19:00:55.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:55.492+0000 7f4c4a772640 1 -- 172.21.15.53:0/3141881214 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4c4415a5e0 con 0x7f4c4415f570 2023-06-10T19:00:55.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:55.496+0000 7f4c40ff9640 1 -- 172.21.15.53:0/3141881214 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4683 (secure 0 0 0) 0x7f4c340546a0 con 0x7f4c4415f570 2023-06-10T19:00:55.500 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:00:55.500 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":38,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5663,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2600814414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2600814414},{"type":"v1","addr":"172.21.15.117:6835","nonce":2600814414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6136,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1615882017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1615882017},{"type":"v1","addr":"172.21.15.117:6837","nonce":1615882017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6993,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/3732245174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3732245174},{"type":"v1","addr":"172.21.15.53:6833","nonce":3732245174}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:00:20.607950+0000","modified":"2023-06-10T19:00:49.023162+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7266":{"gid":7266,"name":"c","rank":0,"incarnation":37,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.53:6835/2829993338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2829993338},{"type":"v1","addr":"172.21.15.53:6835","nonce":2829993338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-06-10T19:00:55.501 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 38 2023-06-10T19:00:55.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:55.496+0000 7f4c4a772640 1 -- 172.21.15.53:0/3141881214 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4c30066280 msgr2=0x7f4c30068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:55.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:55.496+0000 7f4c4a772640 1 --2- 172.21.15.53:0/3141881214 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4c30066280 0x7f4c30068730 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c0ae000 tx=0x7f4c3c0a7070 comp rx=0 tx=0).stop 2023-06-10T19:00:55.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:55.496+0000 7f4c4a772640 1 -- 172.21.15.53:0/3141881214 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c4415f570 msgr2=0x7f4c44158f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:55.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:55.496+0000 7f4c4a772640 1 --2- 172.21.15.53:0/3141881214 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c4415f570 0x7f4c44158f70 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f4c3400e930 tx=0x7f4c3400edf0 comp rx=0 tx=0).stop 2023-06-10T19:00:55.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:55.496+0000 7f4c4a772640 1 -- 172.21.15.53:0/3141881214 shutdown_connections 2023-06-10T19:00:55.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:55.496+0000 7f4c4a772640 1 --2- 172.21.15.53:0/3141881214 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4c30066280 0x7f4c30068730 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:55.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:55.496+0000 7f4c4a772640 1 --2- 172.21.15.53:0/3141881214 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c4415f570 0x7f4c44158f70 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:55.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:55.496+0000 7f4c4a772640 1 --2- 172.21.15.53:0/3141881214 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c4415eef0 0x7f4c441536f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:55.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:55.496+0000 7f4c4a772640 1 --2- 172.21.15.53:0/3141881214 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4c44069450 0x7f4c440c32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:55.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:55.496+0000 7f4c4a772640 1 -- 172.21.15.53:0/3141881214 >> 172.21.15.53:0/3141881214 conn(0x7f4c4406a560 msgr2=0x7f4c440ced70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:55.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:55.496+0000 7f4c4a772640 1 -- 172.21.15.53:0/3141881214 shutdown_connections 2023-06-10T19:00:55.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:55.496+0000 7f4c4a772640 1 -- 172.21.15.53:0/3141881214 wait complete. 2023-06-10T19:00:55.519 DEBUG:tasks.cephfs.filesystem:mapped states ['up:reconnect'] to None 2023-06-10T19:00:56.521 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:00:56.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.652+0000 7fd700779640 1 Processor -- start 2023-06-10T19:00:56.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.652+0000 7fd700779640 1 -- start start 2023-06-10T19:00:56.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.652+0000 7fd700779640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd6f8071060 0x7fd6f80af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:56.660 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.652+0000 7fd700779640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6f8159b50 con 0x7fd6f80c9840 2023-06-10T19:00:56.660 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.652+0000 7fd700779640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6f80702a0 con 0x7fd6f80afc60 2023-06-10T19:00:56.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.652+0000 7fd700779640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6f8070580 con 0x7fd6f8071060 2023-06-10T19:00:56.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.652+0000 7fd6fe515640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fd6f80c9840 0x7fd6f80c9c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:58092/0 (socket says 172.21.15.53:58092) 2023-06-10T19:00:56.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.652+0000 7fd6fe515640 1 -- 172.21.15.53:0/2546265092 learned_addr learned my addr 172.21.15.53:0/2546265092 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:00:56.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.652+0000 7fd6fdd14640 1 --2- 172.21.15.53:0/2546265092 >> v2:172.21.15.117:3300/0 conn(0x7fd6f8071060 0x7fd6f80af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:56.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.652+0000 7fd6fd513640 1 -- 172.21.15.53:0/2546265092 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2174924944 0 0) 0x7fd6f8159b50 con 0x7fd6f80c9840 2023-06-10T19:00:56.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.652+0000 7fd6fd513640 1 -- 172.21.15.53:0/2546265092 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6e0003530 con 0x7fd6f80c9840 2023-06-10T19:00:56.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.652+0000 7fd6fd513640 1 -- 172.21.15.53:0/2546265092 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1298211182 0 0) 0x7fd6e0003530 con 0x7fd6f80c9840 2023-06-10T19:00:56.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.652+0000 7fd6fd513640 1 -- 172.21.15.53:0/2546265092 >> v2:172.21.15.117:3300/0 conn(0x7fd6f8071060 msgr2=0x7fd6f80af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:56.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.652+0000 7fd6fd513640 1 --2- 172.21.15.53:0/2546265092 >> v2:172.21.15.117:3300/0 conn(0x7fd6f8071060 0x7fd6f80af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:56.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.652+0000 7fd6fd513640 1 -- 172.21.15.53:0/2546265092 >> v1:172.21.15.117:6789/0 conn(0x7fd6f80afc60 legacy=0x7fd6f806b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:56.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.652+0000 7fd6fd513640 1 -- 172.21.15.53:0/2546265092 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f8070860 con 0x7fd6f80c9840 2023-06-10T19:00:56.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.652+0000 7fd6fd513640 1 -- 172.21.15.53:0/2546265092 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fd6e8001680 con 0x7fd6f80c9840 2023-06-10T19:00:56.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.652+0000 7fd6fd513640 1 -- 172.21.15.53:0/2546265092 >> v1:172.21.15.53:6789/0 conn(0x7fd6f80c9840 legacy=0x7fd6f80c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:56.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.652+0000 7fd6fd513640 1 --2- 172.21.15.53:0/2546265092 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6e00039f0 0x7fd6e0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:56.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.652+0000 7fd6fd513640 1 --2- 172.21.15.53:0/2546265092 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6e00047d0 0x7fd6e0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:56.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.652+0000 7fd6fd513640 1 --2- 172.21.15.53:0/2546265092 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6e0005180 0x7fd6e000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:56.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.652+0000 7fd6fd513640 1 -- 172.21.15.53:0/2546265092 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f8070580 con 0x7fd6e0005180 2023-06-10T19:00:56.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.652+0000 7fd6fd513640 1 -- 172.21.15.53:0/2546265092 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e000c060 con 0x7fd6e00047d0 2023-06-10T19:00:56.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.652+0000 7fd6fd513640 1 -- 172.21.15.53:0/2546265092 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e000c220 con 0x7fd6e00039f0 2023-06-10T19:00:56.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.652+0000 7fd6fed16640 1 --2- 172.21.15.53:0/2546265092 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6e0005180 0x7fd6e000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:56.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.652+0000 7fd6fe515640 1 --2- 172.21.15.53:0/2546265092 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6e00039f0 0x7fd6e0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:56.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.652+0000 7fd6fdd14640 1 --2- 172.21.15.53:0/2546265092 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6e00047d0 0x7fd6e0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:56.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.652+0000 7fd6fed16640 1 -- 172.21.15.53:0/2546265092 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6e00039f0 msgr2=0x7fd6e0003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:56.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.652+0000 7fd6fed16640 1 --2- 172.21.15.53:0/2546265092 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6e00039f0 0x7fd6e0003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:56.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.652+0000 7fd6fed16640 1 -- 172.21.15.53:0/2546265092 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6e00047d0 msgr2=0x7fd6e0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:56.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.652+0000 7fd6fed16640 1 --2- 172.21.15.53:0/2546265092 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6e00047d0 0x7fd6e0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:56.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.652+0000 7fd6fed16640 1 -- 172.21.15.53:0/2546265092 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6e0003530 con 0x7fd6e0005180 2023-06-10T19:00:56.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.652+0000 7fd6fdd14640 1 --2- 172.21.15.53:0/2546265092 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6e00047d0 0x7fd6e0004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:00:56.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.656+0000 7fd6fed16640 1 -- 172.21.15.53:0/2546265092 reap_dead start 2023-06-10T19:00:56.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.656+0000 7fd6fed16640 1 --2- 172.21.15.53:0/2546265092 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6e0005180 0x7fd6e000b990 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7fd6f0001780 tx=0x7fd6f001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=588f111ccf1e2ad2 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:56.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.656+0000 7fd6fd513640 1 -- 172.21.15.53:0/2546265092 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f00052d0 con 0x7fd6e0005180 2023-06-10T19:00:56.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.656+0000 7fd6fd513640 1 -- 172.21.15.53:0/2546265092 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6f00a7050 con 0x7fd6e0005180 2023-06-10T19:00:56.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.656+0000 7fd6fd513640 1 -- 172.21.15.53:0/2546265092 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f0003840 con 0x7fd6e0005180 2023-06-10T19:00:56.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.656+0000 7fd700779640 1 -- 172.21.15.53:0/2546265092 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6e0005180 msgr2=0x7fd6e000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:56.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.656+0000 7fd700779640 1 --2- 172.21.15.53:0/2546265092 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6e0005180 0x7fd6e000b990 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7fd6f0001780 tx=0x7fd6f001c400 comp rx=0 tx=0).stop 2023-06-10T19:00:56.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.656+0000 7fd700779640 1 -- 172.21.15.53:0/2546265092 shutdown_connections 2023-06-10T19:00:56.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.656+0000 7fd700779640 1 --2- 172.21.15.53:0/2546265092 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6e0005180 0x7fd6e000b990 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:56.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.656+0000 7fd700779640 1 -- 172.21.15.53:0/2546265092 >> 172.21.15.53:0/2546265092 conn(0x7fd6f806a0d0 msgr2=0x7fd6f80ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:56.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.656+0000 7fd700779640 1 -- 172.21.15.53:0/2546265092 shutdown_connections 2023-06-10T19:00:56.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.656+0000 7fd700779640 1 -- 172.21.15.53:0/2546265092 wait complete. 2023-06-10T19:00:56.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.656+0000 7fd700779640 1 Processor -- start 2023-06-10T19:00:56.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.656+0000 7fd700779640 1 -- start start 2023-06-10T19:00:56.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.656+0000 7fd700779640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6e0005180 0x7fd6f81e3970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:56.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.656+0000 7fd700779640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6f80b2b70 0x7fd6f80b2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:56.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.656+0000 7fd700779640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6f80cb900 0x7fd6f80cbd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:56.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.656+0000 7fd700779640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f80b3520 con 0x7fd6f80b2b70 2023-06-10T19:00:56.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.656+0000 7fd700779640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f81e3eb0 con 0x7fd6e0005180 2023-06-10T19:00:56.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.656+0000 7fd700779640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f80cc6c0 con 0x7fd6f80cb900 2023-06-10T19:00:56.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.660+0000 7fd6fdd14640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6f80b2b70 0x7fd6f80b2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:56.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.660+0000 7fd6fdd14640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6f80b2b70 0x7fd6f80b2fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54170/0 (socket says 172.21.15.53:54170) 2023-06-10T19:00:56.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.660+0000 7fd6fdd14640 1 -- 172.21.15.53:0/2851458784 learned_addr learned my addr 172.21.15.53:0/2851458784 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:56.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.660+0000 7fd6fed16640 1 --2- 172.21.15.53:0/2851458784 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6f80cb900 0x7fd6f80cbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:56.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.660+0000 7fd6fe515640 1 --2- 172.21.15.53:0/2851458784 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6e0005180 0x7fd6f81e3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:56.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.660+0000 7fd6fdd14640 1 -- 172.21.15.53:0/2851458784 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6f80cb900 msgr2=0x7fd6f80cbd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:56.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.660+0000 7fd6fdd14640 1 --2- 172.21.15.53:0/2851458784 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6f80cb900 0x7fd6f80cbd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:56.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.660+0000 7fd6fdd14640 1 -- 172.21.15.53:0/2851458784 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6e0005180 msgr2=0x7fd6f81e3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:56.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.660+0000 7fd6fdd14640 1 --2- 172.21.15.53:0/2851458784 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6e0005180 0x7fd6f81e3970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:56.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.660+0000 7fd6fdd14640 1 -- 172.21.15.53:0/2851458784 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f80cc9a0 con 0x7fd6f80b2b70 2023-06-10T19:00:56.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.660+0000 7fd6fe515640 1 --2- 172.21.15.53:0/2851458784 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6e0005180 0x7fd6f81e3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:00:56.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.660+0000 7fd6fdd14640 1 --2- 172.21.15.53:0/2851458784 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6f80b2b70 0x7fd6f80b2fe0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec00f380 tx=0x7fd6ec00f840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:56.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.660+0000 7fd6f6ffd640 1 -- 172.21.15.53:0/2851458784 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6ec003ba0 con 0x7fd6f80b2b70 2023-06-10T19:00:56.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.660+0000 7fd6f6ffd640 1 -- 172.21.15.53:0/2851458784 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6ec011040 con 0x7fd6f80b2b70 2023-06-10T19:00:56.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.660+0000 7fd700779640 1 -- 172.21.15.53:0/2851458784 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6f80ccc80 con 0x7fd6f80b2b70 2023-06-10T19:00:56.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.660+0000 7fd6f6ffd640 1 -- 172.21.15.53:0/2851458784 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6ec004020 con 0x7fd6f80b2b70 2023-06-10T19:00:56.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.660+0000 7fd700779640 1 -- 172.21.15.53:0/2851458784 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6f80cd240 con 0x7fd6f80b2b70 2023-06-10T19:00:56.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.660+0000 7fd700779640 1 -- 172.21.15.53:0/2851458784 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6f80cd400 con 0x7fd6f80b2b70 2023-06-10T19:00:56.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.660+0000 7fd6f6ffd640 1 -- 172.21.15.53:0/2851458784 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd6ec004180 con 0x7fd6f80b2b70 2023-06-10T19:00:56.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.660+0000 7fd6f6ffd640 1 --2- 172.21.15.53:0/2851458784 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd6e40662b0 0x7fd6e4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:56.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.660+0000 7fd6f6ffd640 1 -- 172.21.15.53:0/2851458784 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6148+0+0 (secure 0 0 0) 0x7fd6ec0844d0 con 0x7fd6f80b2b70 2023-06-10T19:00:56.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.660+0000 7fd6fe515640 1 --2- 172.21.15.53:0/2851458784 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd6e40662b0 0x7fd6e4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:56.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.660+0000 7fd6fe515640 1 --2- 172.21.15.53:0/2851458784 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd6e40662b0 0x7fd6e4068760 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fd6e80018f0 tx=0x7fd6e8000f00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:56.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.664+0000 7fd6f6ffd640 1 -- 172.21.15.53:0/2851458784 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd6ec0518f0 con 0x7fd6f80b2b70 2023-06-10T19:00:56.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.856+0000 7fd700779640 1 -- 172.21.15.53:0/2851458784 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd6f804d790 con 0x7fd6f80b2b70 2023-06-10T19:00:56.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.856+0000 7fd6f6ffd640 1 -- 172.21.15.53:0/2851458784 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4683 (secure 0 0 0) 0x7fd6ec054f10 con 0x7fd6f80b2b70 2023-06-10T19:00:56.862 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:00:56.862 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":38,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5663,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2600814414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2600814414},{"type":"v1","addr":"172.21.15.117:6835","nonce":2600814414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6136,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1615882017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1615882017},{"type":"v1","addr":"172.21.15.117:6837","nonce":1615882017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6993,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/3732245174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3732245174},{"type":"v1","addr":"172.21.15.53:6833","nonce":3732245174}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:00:20.607950+0000","modified":"2023-06-10T19:00:49.023162+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7266":{"gid":7266,"name":"c","rank":0,"incarnation":37,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.53:6835/2829993338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2829993338},{"type":"v1","addr":"172.21.15.53:6835","nonce":2829993338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-06-10T19:00:56.863 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 38 2023-06-10T19:00:56.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.860+0000 7fd700779640 1 -- 172.21.15.53:0/2851458784 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd6e40662b0 msgr2=0x7fd6e4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:56.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.860+0000 7fd700779640 1 --2- 172.21.15.53:0/2851458784 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd6e40662b0 0x7fd6e4068760 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fd6e80018f0 tx=0x7fd6e8000f00 comp rx=0 tx=0).stop 2023-06-10T19:00:56.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.860+0000 7fd700779640 1 -- 172.21.15.53:0/2851458784 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6f80b2b70 msgr2=0x7fd6f80b2fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:56.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.860+0000 7fd700779640 1 --2- 172.21.15.53:0/2851458784 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6f80b2b70 0x7fd6f80b2fe0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec00f380 tx=0x7fd6ec00f840 comp rx=0 tx=0).stop 2023-06-10T19:00:56.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.860+0000 7fd700779640 1 -- 172.21.15.53:0/2851458784 shutdown_connections 2023-06-10T19:00:56.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.860+0000 7fd700779640 1 --2- 172.21.15.53:0/2851458784 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd6e40662b0 0x7fd6e4068760 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:56.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.860+0000 7fd700779640 1 --2- 172.21.15.53:0/2851458784 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6f80cb900 0x7fd6f80cbd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:56.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.860+0000 7fd700779640 1 --2- 172.21.15.53:0/2851458784 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6f80b2b70 0x7fd6f80b2fe0 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:56.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.860+0000 7fd700779640 1 --2- 172.21.15.53:0/2851458784 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6e0005180 0x7fd6f81e3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:56.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.860+0000 7fd700779640 1 -- 172.21.15.53:0/2851458784 >> 172.21.15.53:0/2851458784 conn(0x7fd6f806a0d0 msgr2=0x7fd6f80ad700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:56.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.860+0000 7fd700779640 1 -- 172.21.15.53:0/2851458784 shutdown_connections 2023-06-10T19:00:56.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:56.860+0000 7fd700779640 1 -- 172.21.15.53:0/2851458784 wait complete. 2023-06-10T19:00:56.881 DEBUG:tasks.cephfs.filesystem:mapped states ['up:reconnect'] to None 2023-06-10T19:00:57.882 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:00:58.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.012+0000 7f7229706640 1 Processor -- start 2023-06-10T19:00:58.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.012+0000 7f7229706640 1 -- start start 2023-06-10T19:00:58.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.012+0000 7f7229706640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7224162640 0x7f7224164a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:58.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.012+0000 7f7229706640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7224159b50 con 0x7f72240c9840 2023-06-10T19:00:58.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.012+0000 7f7229706640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72240702a0 con 0x7f7224071060 2023-06-10T19:00:58.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.012+0000 7f7229706640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7224070580 con 0x7f7224162640 2023-06-10T19:00:58.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.012+0000 7f7222ffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f72240c9840 0x7f72240c9c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:58106/0 (socket says 172.21.15.53:58106) 2023-06-10T19:00:58.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.012+0000 7f7222ffd640 1 -- 172.21.15.53:0/3951695431 learned_addr learned my addr 172.21.15.53:0/3951695431 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:00:58.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.012+0000 7f72237fe640 1 --2- 172.21.15.53:0/3951695431 >> v2:172.21.15.117:3300/0 conn(0x7f7224162640 0x7f7224164a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:58.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.012+0000 7f7221ffb640 1 -- 172.21.15.53:0/3951695431 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2110739823 0 0) 0x7f7224159b50 con 0x7f72240c9840 2023-06-10T19:00:58.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.012+0000 7f7221ffb640 1 -- 172.21.15.53:0/3951695431 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f720c003530 con 0x7f72240c9840 2023-06-10T19:00:58.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.012+0000 7f7221ffb640 1 -- 172.21.15.53:0/3951695431 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4038813838 0 0) 0x7f720c003530 con 0x7f72240c9840 2023-06-10T19:00:58.020 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.012+0000 7f7221ffb640 1 -- 172.21.15.53:0/3951695431 >> v2:172.21.15.117:3300/0 conn(0x7f7224162640 msgr2=0x7f7224164a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:58.020 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.012+0000 7f7221ffb640 1 --2- 172.21.15.53:0/3951695431 >> v2:172.21.15.117:3300/0 conn(0x7f7224162640 0x7f7224164a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:58.020 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.012+0000 7f7221ffb640 1 -- 172.21.15.53:0/3951695431 >> v1:172.21.15.117:6789/0 conn(0x7f7224071060 legacy=0x7f72240af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:58.020 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.012+0000 7f7221ffb640 1 -- 172.21.15.53:0/3951695431 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7224070860 con 0x7f72240c9840 2023-06-10T19:00:58.020 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.012+0000 7f7221ffb640 1 -- 172.21.15.53:0/3951695431 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f7214001680 con 0x7f72240c9840 2023-06-10T19:00:58.020 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.012+0000 7f7221ffb640 1 -- 172.21.15.53:0/3951695431 >> v1:172.21.15.53:6789/0 conn(0x7f72240c9840 legacy=0x7f72240c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:58.020 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.012+0000 7f7221ffb640 1 --2- 172.21.15.53:0/3951695431 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f720c0039f0 0x7f720c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:58.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.012+0000 7f7221ffb640 1 --2- 172.21.15.53:0/3951695431 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f720c0047d0 0x7f720c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:58.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.012+0000 7f7221ffb640 1 --2- 172.21.15.53:0/3951695431 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f720c005180 0x7f720c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:58.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.012+0000 7f7221ffb640 1 -- 172.21.15.53:0/3951695431 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7224070580 con 0x7f720c0047d0 2023-06-10T19:00:58.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.012+0000 7f7221ffb640 1 -- 172.21.15.53:0/3951695431 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f720c00c060 con 0x7f720c0039f0 2023-06-10T19:00:58.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.012+0000 7f7221ffb640 1 -- 172.21.15.53:0/3951695431 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f720c00c220 con 0x7f720c005180 2023-06-10T19:00:58.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.012+0000 7f72227fc640 1 --2- 172.21.15.53:0/3951695431 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f720c0047d0 0x7f720c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:58.022 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.012+0000 7f7222ffd640 1 --2- 172.21.15.53:0/3951695431 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f720c0039f0 0x7f720c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:58.022 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.012+0000 7f72237fe640 1 --2- 172.21.15.53:0/3951695431 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f720c005180 0x7f720c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:58.022 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.012+0000 7f72227fc640 1 -- 172.21.15.53:0/3951695431 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f720c005180 msgr2=0x7f720c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:58.022 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.012+0000 7f72227fc640 1 --2- 172.21.15.53:0/3951695431 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f720c005180 0x7f720c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:58.022 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.012+0000 7f72227fc640 1 -- 172.21.15.53:0/3951695431 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f720c0039f0 msgr2=0x7f720c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:58.023 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.012+0000 7f72227fc640 1 --2- 172.21.15.53:0/3951695431 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f720c0039f0 0x7f720c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:58.023 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.012+0000 7f72227fc640 1 -- 172.21.15.53:0/3951695431 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f720c003530 con 0x7f720c0047d0 2023-06-10T19:00:58.023 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.012+0000 7f72237fe640 1 -- 172.21.15.53:0/3951695431 reap_dead start 2023-06-10T19:00:58.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.016+0000 7f72227fc640 1 --2- 172.21.15.53:0/3951695431 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f720c0047d0 0x7f720c004c40 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f7218001750 tx=0x7f721801c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a70a50120ff713bc server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:58.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.016+0000 7f7221ffb640 1 -- 172.21.15.53:0/3951695431 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72180052d0 con 0x7f720c0047d0 2023-06-10T19:00:58.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.016+0000 7f7221ffb640 1 -- 172.21.15.53:0/3951695431 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72180a7050 con 0x7f720c0047d0 2023-06-10T19:00:58.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.016+0000 7f7221ffb640 1 -- 172.21.15.53:0/3951695431 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7218003600 con 0x7f720c0047d0 2023-06-10T19:00:58.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.016+0000 7f7229706640 1 -- 172.21.15.53:0/3951695431 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f720c0047d0 msgr2=0x7f720c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:58.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.016+0000 7f7229706640 1 --2- 172.21.15.53:0/3951695431 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f720c0047d0 0x7f720c004c40 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f7218001750 tx=0x7f721801c3a0 comp rx=0 tx=0).stop 2023-06-10T19:00:58.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.016+0000 7f7229706640 1 -- 172.21.15.53:0/3951695431 shutdown_connections 2023-06-10T19:00:58.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.016+0000 7f7229706640 1 --2- 172.21.15.53:0/3951695431 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f720c0047d0 0x7f720c004c40 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:58.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.016+0000 7f7229706640 1 -- 172.21.15.53:0/3951695431 >> 172.21.15.53:0/3951695431 conn(0x7f722406a0d0 msgr2=0x7f72240ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:58.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.016+0000 7f7229706640 1 -- 172.21.15.53:0/3951695431 shutdown_connections 2023-06-10T19:00:58.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.016+0000 7f7229706640 1 -- 172.21.15.53:0/3951695431 wait complete. 2023-06-10T19:00:58.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.016+0000 7f7229706640 1 Processor -- start 2023-06-10T19:00:58.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.016+0000 7f7229706640 1 -- start start 2023-06-10T19:00:58.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.020+0000 7f7229706640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f720c0047d0 0x7f7224150f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:58.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.020+0000 7f7229706640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7224152b50 0x7f72241f4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:58.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.020+0000 7f7229706640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72241f53f0 0x7f722414fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:58.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.020+0000 7f7229706640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72240cb870 con 0x7f7224152b50 2023-06-10T19:00:58.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.020+0000 7f7229706640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72240af1f0 con 0x7f720c0047d0 2023-06-10T19:00:58.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.020+0000 7f7229706640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72240af490 con 0x7f72241f53f0 2023-06-10T19:00:58.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.020+0000 7f72227fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7224152b50 0x7f72241f4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:58.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.020+0000 7f72227fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7224152b50 0x7f72241f4eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54184/0 (socket says 172.21.15.53:54184) 2023-06-10T19:00:58.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.020+0000 7f72227fc640 1 -- 172.21.15.53:0/146369148 learned_addr learned my addr 172.21.15.53:0/146369148 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:58.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.020+0000 7f72237fe640 1 --2- 172.21.15.53:0/146369148 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72241f53f0 0x7f722414fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:58.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.020+0000 7f7222ffd640 1 --2- 172.21.15.53:0/146369148 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f720c0047d0 0x7f7224150f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:58.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.020+0000 7f72227fc640 1 -- 172.21.15.53:0/146369148 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72241f53f0 msgr2=0x7f722414fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:58.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.020+0000 7f72227fc640 1 --2- 172.21.15.53:0/146369148 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72241f53f0 0x7f722414fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:58.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.020+0000 7f72227fc640 1 -- 172.21.15.53:0/146369148 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f720c0047d0 msgr2=0x7f7224150f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:58.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.020+0000 7f72227fc640 1 --2- 172.21.15.53:0/146369148 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f720c0047d0 0x7f7224150f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:58.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.020+0000 7f72227fc640 1 -- 172.21.15.53:0/146369148 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72240af770 con 0x7f7224152b50 2023-06-10T19:00:58.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.020+0000 7f72227fc640 1 --2- 172.21.15.53:0/146369148 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7224152b50 0x7f72241f4eb0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f721801c1d0 tx=0x7f720c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:58.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.020+0000 7f720b7fe640 1 -- 172.21.15.53:0/146369148 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7218003e40 con 0x7f7224152b50 2023-06-10T19:00:58.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.020+0000 7f720b7fe640 1 -- 172.21.15.53:0/146369148 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7218007030 con 0x7f7224152b50 2023-06-10T19:00:58.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.020+0000 7f7229706640 1 -- 172.21.15.53:0/146369148 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72240afa50 con 0x7f7224152b50 2023-06-10T19:00:58.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.020+0000 7f720b7fe640 1 -- 172.21.15.53:0/146369148 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72180073e0 con 0x7f7224152b50 2023-06-10T19:00:58.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.020+0000 7f7229706640 1 -- 172.21.15.53:0/146369148 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72241514c0 con 0x7f7224152b50 2023-06-10T19:00:58.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.020+0000 7f7229706640 1 -- 172.21.15.53:0/146369148 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f722406c7e0 con 0x7f7224152b50 2023-06-10T19:00:58.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.020+0000 7f720b7fe640 1 -- 172.21.15.53:0/146369148 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7218007540 con 0x7f7224152b50 2023-06-10T19:00:58.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.020+0000 7f720b7fe640 1 --2- 172.21.15.53:0/146369148 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7210066280 0x7f7210068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:58.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.020+0000 7f720b7fe640 1 -- 172.21.15.53:0/146369148 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f721811dfb0 con 0x7f7224152b50 2023-06-10T19:00:58.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.020+0000 7f7222ffd640 1 --2- 172.21.15.53:0/146369148 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7210066280 0x7f7210068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:58.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.024+0000 7f7222ffd640 1 --2- 172.21.15.53:0/146369148 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7210066280 0x7f7210068730 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f722404eaa0 tx=0x7f7214009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:58.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.024+0000 7f720b7fe640 1 -- 172.21.15.53:0/146369148 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f72180eb460 con 0x7f7224152b50 2023-06-10T19:00:58.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.208+0000 7f7229706640 1 -- 172.21.15.53:0/146369148 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f722404d790 con 0x7f7224152b50 2023-06-10T19:00:58.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.212+0000 7f720b7fe640 1 -- 172.21.15.53:0/146369148 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4683 (secure 0 0 0) 0x7f72180eea80 con 0x7f7224152b50 2023-06-10T19:00:58.216 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:00:58.216 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":38,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5663,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2600814414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2600814414},{"type":"v1","addr":"172.21.15.117:6835","nonce":2600814414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6136,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1615882017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1615882017},{"type":"v1","addr":"172.21.15.117:6837","nonce":1615882017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6993,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/3732245174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3732245174},{"type":"v1","addr":"172.21.15.53:6833","nonce":3732245174}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:00:20.607950+0000","modified":"2023-06-10T19:00:49.023162+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7266":{"gid":7266,"name":"c","rank":0,"incarnation":37,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.53:6835/2829993338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2829993338},{"type":"v1","addr":"172.21.15.53:6835","nonce":2829993338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-06-10T19:00:58.217 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 38 2023-06-10T19:00:58.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.212+0000 7f7229706640 1 -- 172.21.15.53:0/146369148 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7210066280 msgr2=0x7f7210068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:58.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.212+0000 7f7229706640 1 --2- 172.21.15.53:0/146369148 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7210066280 0x7f7210068730 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f722404eaa0 tx=0x7f7214009040 comp rx=0 tx=0).stop 2023-06-10T19:00:58.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.212+0000 7f7229706640 1 -- 172.21.15.53:0/146369148 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7224152b50 msgr2=0x7f72241f4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:58.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.212+0000 7f7229706640 1 --2- 172.21.15.53:0/146369148 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7224152b50 0x7f72241f4eb0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f721801c1d0 tx=0x7f720c005800 comp rx=0 tx=0).stop 2023-06-10T19:00:58.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.212+0000 7f7229706640 1 -- 172.21.15.53:0/146369148 shutdown_connections 2023-06-10T19:00:58.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.212+0000 7f7229706640 1 --2- 172.21.15.53:0/146369148 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7210066280 0x7f7210068730 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:58.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.212+0000 7f7229706640 1 --2- 172.21.15.53:0/146369148 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72241f53f0 0x7f722414fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:58.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.212+0000 7f7229706640 1 --2- 172.21.15.53:0/146369148 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7224152b50 0x7f72241f4eb0 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:58.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.212+0000 7f7229706640 1 --2- 172.21.15.53:0/146369148 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f720c0047d0 0x7f7224150f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:58.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.212+0000 7f7229706640 1 -- 172.21.15.53:0/146369148 >> 172.21.15.53:0/146369148 conn(0x7f722406a0d0 msgr2=0x7f7224153920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:58.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.212+0000 7f7229706640 1 -- 172.21.15.53:0/146369148 shutdown_connections 2023-06-10T19:00:58.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:58.212+0000 7f7229706640 1 -- 172.21.15.53:0/146369148 wait complete. 2023-06-10T19:00:58.233 DEBUG:tasks.cephfs.filesystem:mapped states ['up:reconnect'] to None 2023-06-10T19:00:59.234 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:00:59.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:59.364+0000 7f3bf00cd640 1 Processor -- start 2023-06-10T19:00:59.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:59.364+0000 7f3bf00cd640 1 -- start start 2023-06-10T19:00:59.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:59.364+0000 7f3bf00cd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3be815c7f0 0x7f3be815f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:59.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:59.364+0000 7f3bf00cd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3be815f860 0x7f3be80ceb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:59.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:59.364+0000 7f3bf00cd640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3be815cc40 con 0x7f3be806b780 2023-06-10T19:00:59.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:59.364+0000 7f3bf00cd640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3be815c3d0 con 0x7f3be815f860 2023-06-10T19:00:59.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:59.364+0000 7f3bf00cd640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3be80af530 con 0x7f3be815c7f0 2023-06-10T19:00:59.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:59.364+0000 7f3bee66a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3be815f860 0x7f3be80ceb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:59.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:59.364+0000 7f3bee66a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3be815f860 0x7f3be80ceb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54188/0 (socket says 172.21.15.53:54188) 2023-06-10T19:00:59.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:59.364+0000 7f3bee66a640 1 -- 172.21.15.53:0/1821132161 learned_addr learned my addr 172.21.15.53:0/1821132161 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:59.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:59.364+0000 7f3bed668640 1 --2- 172.21.15.53:0/1821132161 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3be815c7f0 0x7f3be815f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:59.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:59.364+0000 7f3bee66a640 1 -- 172.21.15.53:0/1821132161 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3be815c7f0 msgr2=0x7f3be815f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:59.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:59.364+0000 7f3bee66a640 1 --2- 172.21.15.53:0/1821132161 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3be815c7f0 0x7f3be815f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:59.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:59.364+0000 7f3bee66a640 1 -- 172.21.15.53:0/1821132161 >> v1:172.21.15.117:6789/0 conn(0x7f3be806b780 legacy=0x7f3be806bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:00:59.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:59.364+0000 7f3bee66a640 1 -- 172.21.15.53:0/1821132161 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3be815fd70 con 0x7f3be815f860 2023-06-10T19:00:59.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:59.368+0000 7f3bee66a640 1 --2- 172.21.15.53:0/1821132161 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3be815f860 0x7f3be80ceb20 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f3be0009e50 tx=0x7f3be001c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5de9719d9ac7133 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:59.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:59.368+0000 7f3bece67640 1 -- 172.21.15.53:0/1821132161 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be00a57c0 con 0x7f3be815f860 2023-06-10T19:00:59.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:59.368+0000 7f3bece67640 1 -- 172.21.15.53:0/1821132161 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3be00a5920 con 0x7f3be815f860 2023-06-10T19:00:59.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:59.368+0000 7f3bece67640 1 -- 172.21.15.53:0/1821132161 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be00a5cb0 con 0x7f3be815f860 2023-06-10T19:00:59.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:59.368+0000 7f3bf00cd640 1 -- 172.21.15.53:0/1821132161 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3be815f860 msgr2=0x7f3be80ceb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:59.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:59.368+0000 7f3bf00cd640 1 --2- 172.21.15.53:0/1821132161 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3be815f860 0x7f3be80ceb20 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f3be0009e50 tx=0x7f3be001c940 comp rx=0 tx=0).stop 2023-06-10T19:00:59.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:59.368+0000 7f3bf00cd640 1 -- 172.21.15.53:0/1821132161 shutdown_connections 2023-06-10T19:00:59.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:59.368+0000 7f3bf00cd640 1 --2- 172.21.15.53:0/1821132161 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3be815f860 0x7f3be80ceb20 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:59.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:59.368+0000 7f3bf00cd640 1 --2- 172.21.15.53:0/1821132161 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3be815c7f0 0x7f3be815f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:59.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:59.368+0000 7f3bf00cd640 1 -- 172.21.15.53:0/1821132161 >> 172.21.15.53:0/1821132161 conn(0x7f3be806a090 msgr2=0x7f3be806d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:59.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:59.368+0000 7f3bf00cd640 1 -- 172.21.15.53:0/1821132161 shutdown_connections 2023-06-10T19:00:59.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:59.368+0000 7f3bf00cd640 1 -- 172.21.15.53:0/1821132161 wait complete. 2023-06-10T19:00:59.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:59.368+0000 7f3bf00cd640 1 Processor -- start 2023-06-10T19:00:59.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:59.368+0000 7f3bf00cd640 1 -- start start 2023-06-10T19:00:59.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:59.368+0000 7f3bf00cd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3be806b780 0x7f3be815dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:59.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:59.368+0000 7f3bf00cd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3be815c7f0 0x7f3be815e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:59.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:59.368+0000 7f3bf00cd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3be815f860 0x7f3be81f75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:59.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:59.368+0000 7f3bf00cd640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3be81f3d00 con 0x7f3be815f860 2023-06-10T19:00:59.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:59.368+0000 7f3bf00cd640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3be80cb450 con 0x7f3be815c7f0 2023-06-10T19:00:59.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:59.368+0000 7f3bf00cd640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3be80c4ec0 con 0x7f3be806b780 2023-06-10T19:00:59.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:59.368+0000 7f3bee66a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3be815f860 0x7f3be81f75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:59.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:59.368+0000 7f3bee66a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3be815f860 0x7f3be81f75e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54190/0 (socket says 172.21.15.53:54190) 2023-06-10T19:00:59.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:59.368+0000 7f3bee66a640 1 -- 172.21.15.53:0/11437847 learned_addr learned my addr 172.21.15.53:0/11437847 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:00:59.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:59.368+0000 7f3bed668640 1 --2- 172.21.15.53:0/11437847 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3be815c7f0 0x7f3be815e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:59.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:59.368+0000 7f3bede69640 1 --2- 172.21.15.53:0/11437847 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3be806b780 0x7f3be815dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:59.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:59.368+0000 7f3bee66a640 1 -- 172.21.15.53:0/11437847 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3be806b780 msgr2=0x7f3be815dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:59.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:59.368+0000 7f3bee66a640 1 --2- 172.21.15.53:0/11437847 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3be806b780 0x7f3be815dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:59.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:59.368+0000 7f3bee66a640 1 -- 172.21.15.53:0/11437847 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3be815c7f0 msgr2=0x7f3be815e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:59.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:59.368+0000 7f3bee66a640 1 --2- 172.21.15.53:0/11437847 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3be815c7f0 0x7f3be815e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:59.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:59.368+0000 7f3bee66a640 1 -- 172.21.15.53:0/11437847 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3be0009b30 con 0x7f3be815f860 2023-06-10T19:00:59.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:59.368+0000 7f3bed668640 1 --2- 172.21.15.53:0/11437847 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3be815c7f0 0x7f3be815e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:00:59.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:59.368+0000 7f3bede69640 1 --2- 172.21.15.53:0/11437847 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3be806b780 0x7f3be815dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:00:59.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:59.368+0000 7f3bee66a640 1 --2- 172.21.15.53:0/11437847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3be815f860 0x7f3be81f75e0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f3be001aff0 tx=0x7f3be00196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:59.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:59.368+0000 7f3bde7fc640 1 -- 172.21.15.53:0/11437847 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be00b8640 con 0x7f3be815f860 2023-06-10T19:00:59.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:59.372+0000 7f3bde7fc640 1 -- 172.21.15.53:0/11437847 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3be00b87a0 con 0x7f3be815f860 2023-06-10T19:00:59.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:59.372+0000 7f3bf00cd640 1 -- 172.21.15.53:0/11437847 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3be80ca7d0 con 0x7f3be815f860 2023-06-10T19:00:59.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:59.372+0000 7f3bde7fc640 1 -- 172.21.15.53:0/11437847 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be00b8b50 con 0x7f3be815f860 2023-06-10T19:00:59.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:59.372+0000 7f3bf00cd640 1 -- 172.21.15.53:0/11437847 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3be80cad90 con 0x7f3be815f860 2023-06-10T19:00:59.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:59.372+0000 7f3bf00cd640 1 -- 172.21.15.53:0/11437847 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3be80cb590 con 0x7f3be815f860 2023-06-10T19:00:59.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:59.372+0000 7f3bde7fc640 1 -- 172.21.15.53:0/11437847 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3be00b8cb0 con 0x7f3be815f860 2023-06-10T19:00:59.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:59.372+0000 7f3bde7fc640 1 --2- 172.21.15.53:0/11437847 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3bcc066280 0x7f3bcc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:00:59.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:59.372+0000 7f3bde7fc640 1 -- 172.21.15.53:0/11437847 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f3be011f370 con 0x7f3be815f860 2023-06-10T19:00:59.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:59.372+0000 7f3bede69640 1 --2- 172.21.15.53:0/11437847 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3bcc066280 0x7f3bcc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:00:59.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:59.372+0000 7f3bede69640 1 --2- 172.21.15.53:0/11437847 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3bcc066280 0x7f3bcc068730 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f3be400a850 tx=0x7f3be4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:00:59.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:59.376+0000 7f3bde7fc640 1 -- 172.21.15.53:0/11437847 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3be80cb590 con 0x7f3be815f860 2023-06-10T19:00:59.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:59.568+0000 7f3bf00cd640 1 -- 172.21.15.53:0/11437847 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3be80cb590 con 0x7f3be815f860 2023-06-10T19:00:59.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:59.568+0000 7f3bde7fc640 1 -- 172.21.15.53:0/11437847 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4683 (secure 0 0 0) 0x7f3be80cb590 con 0x7f3be815f860 2023-06-10T19:00:59.573 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:00:59.573 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":38,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5663,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2600814414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2600814414},{"type":"v1","addr":"172.21.15.117:6835","nonce":2600814414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6136,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1615882017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1615882017},{"type":"v1","addr":"172.21.15.117:6837","nonce":1615882017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6993,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/3732245174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3732245174},{"type":"v1","addr":"172.21.15.53:6833","nonce":3732245174}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:00:20.607950+0000","modified":"2023-06-10T19:00:49.023162+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7266":{"gid":7266,"name":"c","rank":0,"incarnation":37,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.53:6835/2829993338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2829993338},{"type":"v1","addr":"172.21.15.53:6835","nonce":2829993338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-06-10T19:00:59.573 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 38 2023-06-10T19:00:59.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:59.568+0000 7f3bf00cd640 1 -- 172.21.15.53:0/11437847 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3bcc066280 msgr2=0x7f3bcc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:59.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:59.568+0000 7f3bf00cd640 1 --2- 172.21.15.53:0/11437847 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3bcc066280 0x7f3bcc068730 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f3be400a850 tx=0x7f3be4008040 comp rx=0 tx=0).stop 2023-06-10T19:00:59.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:59.568+0000 7f3bf00cd640 1 -- 172.21.15.53:0/11437847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3be815f860 msgr2=0x7f3be81f75e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:00:59.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:59.568+0000 7f3bf00cd640 1 --2- 172.21.15.53:0/11437847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3be815f860 0x7f3be81f75e0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f3be001aff0 tx=0x7f3be00196e0 comp rx=0 tx=0).stop 2023-06-10T19:00:59.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:59.568+0000 7f3bf00cd640 1 -- 172.21.15.53:0/11437847 shutdown_connections 2023-06-10T19:00:59.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:59.568+0000 7f3bf00cd640 1 --2- 172.21.15.53:0/11437847 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3bcc066280 0x7f3bcc068730 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:59.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:59.568+0000 7f3bf00cd640 1 --2- 172.21.15.53:0/11437847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3be815f860 0x7f3be81f75e0 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:59.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:59.568+0000 7f3bf00cd640 1 --2- 172.21.15.53:0/11437847 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3be815c7f0 0x7f3be815e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:59.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:59.568+0000 7f3bf00cd640 1 --2- 172.21.15.53:0/11437847 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3be806b780 0x7f3be815dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:00:59.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:59.568+0000 7f3bf00cd640 1 -- 172.21.15.53:0/11437847 >> 172.21.15.53:0/11437847 conn(0x7f3be806a090 msgr2=0x7f3be8158990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:00:59.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:59.568+0000 7f3bf00cd640 1 -- 172.21.15.53:0/11437847 shutdown_connections 2023-06-10T19:00:59.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:00:59.568+0000 7f3bf00cd640 1 -- 172.21.15.53:0/11437847 wait complete. 2023-06-10T19:00:59.592 DEBUG:tasks.cephfs.filesystem:mapped states ['up:reconnect'] to None 2023-06-10T19:01:00.594 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:01:00.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:00.724+0000 7f6a325d2640 1 Processor -- start 2023-06-10T19:01:00.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:00.724+0000 7f6a325d2640 1 -- start start 2023-06-10T19:01:00.732 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:00.728+0000 7f6a325d2640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6a2c0c9840 0x7f6a2c0c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:00.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:00.728+0000 7f6a325d2640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6a2c06b090 0x7f6a2c06b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:00.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:00.728+0000 7f6a325d2640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a2c159b50 con 0x7f6a2c071060 2023-06-10T19:01:00.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:00.728+0000 7f6a325d2640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a2c0ca150 con 0x7f6a2c06b090 2023-06-10T19:01:00.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:00.728+0000 7f6a325d2640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a2c0702a0 con 0x7f6a2c0c9840 2023-06-10T19:01:00.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:00.728+0000 7f6a30b6f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6a2c06b090 0x7f6a2c06b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:00.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:00.728+0000 7f6a2b7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f6a2c071060 0x7f6a2c0af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:58116/0 (socket says 172.21.15.53:58116) 2023-06-10T19:01:00.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:00.728+0000 7f6a30b6f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6a2c06b090 0x7f6a2c06b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54198/0 (socket says 172.21.15.53:54198) 2023-06-10T19:01:00.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:00.728+0000 7f6a2b7fe640 1 -- 172.21.15.53:0/29653419 learned_addr learned my addr 172.21.15.53:0/29653419 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:01:00.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:00.728+0000 7f6a2bfff640 1 --2- 172.21.15.53:0/29653419 >> v2:172.21.15.117:3300/0 conn(0x7f6a2c0c9840 0x7f6a2c0c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:00.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:00.728+0000 7f6a30b6f640 1 -- 172.21.15.53:0/29653419 >> v2:172.21.15.117:3300/0 conn(0x7f6a2c0c9840 msgr2=0x7f6a2c0c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:00.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:00.728+0000 7f6a30b6f640 1 --2- 172.21.15.53:0/29653419 >> v2:172.21.15.117:3300/0 conn(0x7f6a2c0c9840 0x7f6a2c0c9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:00.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:00.728+0000 7f6a30b6f640 1 -- 172.21.15.53:0/29653419 >> v1:172.21.15.53:6789/0 conn(0x7f6a2c071060 legacy=0x7f6a2c0af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:00.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:00.728+0000 7f6a30b6f640 1 -- 172.21.15.53:0/29653419 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a2c070580 con 0x7f6a2c06b090 2023-06-10T19:01:00.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:00.728+0000 7f6a30b6f640 1 --2- 172.21.15.53:0/29653419 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a2c06b090 0x7f6a2c06b510 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c071d80 tx=0x7f6a2401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c272cbb873716321 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:00.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:00.728+0000 7f6a2affd640 1 -- 172.21.15.53:0/29653419 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a240a59a0 con 0x7f6a2c06b090 2023-06-10T19:01:00.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:00.728+0000 7f6a2affd640 1 -- 172.21.15.53:0/29653419 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a240a5b00 con 0x7f6a2c06b090 2023-06-10T19:01:00.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:00.728+0000 7f6a2affd640 1 -- 172.21.15.53:0/29653419 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a240a5e90 con 0x7f6a2c06b090 2023-06-10T19:01:00.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:00.732+0000 7f6a325d2640 1 -- 172.21.15.53:0/29653419 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a2c06b090 msgr2=0x7f6a2c06b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:00.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:00.732+0000 7f6a325d2640 1 --2- 172.21.15.53:0/29653419 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a2c06b090 0x7f6a2c06b510 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c071d80 tx=0x7f6a2401c8e0 comp rx=0 tx=0).stop 2023-06-10T19:01:00.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:00.732+0000 7f6a325d2640 1 -- 172.21.15.53:0/29653419 shutdown_connections 2023-06-10T19:01:00.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:00.732+0000 7f6a325d2640 1 --2- 172.21.15.53:0/29653419 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a2c06b090 0x7f6a2c06b510 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:00.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:00.732+0000 7f6a325d2640 1 --2- 172.21.15.53:0/29653419 >> v2:172.21.15.117:3300/0 conn(0x7f6a2c0c9840 0x7f6a2c0c9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:00.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:00.732+0000 7f6a325d2640 1 -- 172.21.15.53:0/29653419 >> 172.21.15.53:0/29653419 conn(0x7f6a2c06a0d0 msgr2=0x7f6a2c0ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:00.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:00.732+0000 7f6a325d2640 1 -- 172.21.15.53:0/29653419 shutdown_connections 2023-06-10T19:01:00.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:00.732+0000 7f6a325d2640 1 -- 172.21.15.53:0/29653419 wait complete. 2023-06-10T19:01:00.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:00.732+0000 7f6a325d2640 1 Processor -- start 2023-06-10T19:01:00.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:00.732+0000 7f6a325d2640 1 -- start start 2023-06-10T19:01:00.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:00.732+0000 7f6a325d2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a2c06b090 0x7f6a2c0c29f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:00.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:00.732+0000 7f6a325d2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a2c071060 0x7f6a2c0cc280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:00.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:00.732+0000 7f6a325d2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6a2c0c9840 0x7f6a2c150a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:00.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:00.732+0000 7f6a325d2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2c0c3c00 con 0x7f6a2c071060 2023-06-10T19:01:00.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:00.732+0000 7f6a325d2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2c0cc7c0 con 0x7f6a2c06b090 2023-06-10T19:01:00.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:00.732+0000 7f6a325d2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2c0c2ff0 con 0x7f6a2c0c9840 2023-06-10T19:01:00.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:00.732+0000 7f6a2b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a2c071060 0x7f6a2c0cc280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:00.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:00.732+0000 7f6a2b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a2c071060 0x7f6a2c0cc280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54210/0 (socket says 172.21.15.53:54210) 2023-06-10T19:01:00.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:00.732+0000 7f6a2b7fe640 1 -- 172.21.15.53:0/417645721 learned_addr learned my addr 172.21.15.53:0/417645721 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:00.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:00.732+0000 7f6a30b6f640 1 --2- 172.21.15.53:0/417645721 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6a2c0c9840 0x7f6a2c150a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:00.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:00.732+0000 7f6a2bfff640 1 --2- 172.21.15.53:0/417645721 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a2c06b090 0x7f6a2c0c29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:00.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:00.732+0000 7f6a2b7fe640 1 -- 172.21.15.53:0/417645721 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6a2c0c9840 msgr2=0x7f6a2c150a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:00.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:00.732+0000 7f6a2b7fe640 1 --2- 172.21.15.53:0/417645721 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6a2c0c9840 0x7f6a2c150a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:00.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:00.732+0000 7f6a2b7fe640 1 -- 172.21.15.53:0/417645721 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a2c06b090 msgr2=0x7f6a2c0c29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:00.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:00.732+0000 7f6a2b7fe640 1 --2- 172.21.15.53:0/417645721 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a2c06b090 0x7f6a2c0c29f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:00.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:00.732+0000 7f6a2b7fe640 1 -- 172.21.15.53:0/417645721 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a24009a70 con 0x7f6a2c071060 2023-06-10T19:01:00.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:00.732+0000 7f6a2b7fe640 1 --2- 172.21.15.53:0/417645721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a2c071060 0x7f6a2c0cc280 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f6a2000c4d0 tx=0x7f6a2000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:00.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:00.732+0000 7f6a28ff9640 1 -- 172.21.15.53:0/417645721 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a20005cf0 con 0x7f6a2c071060 2023-06-10T19:01:00.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:00.732+0000 7f6a28ff9640 1 -- 172.21.15.53:0/417645721 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a20005e50 con 0x7f6a2c071060 2023-06-10T19:01:00.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:00.732+0000 7f6a28ff9640 1 -- 172.21.15.53:0/417645721 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a20007270 con 0x7f6a2c071060 2023-06-10T19:01:00.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:00.732+0000 7f6a325d2640 1 -- 172.21.15.53:0/417645721 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a2c0c32d0 con 0x7f6a2c071060 2023-06-10T19:01:00.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:00.732+0000 7f6a325d2640 1 -- 172.21.15.53:0/417645721 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a2c0c3890 con 0x7f6a2c071060 2023-06-10T19:01:00.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:00.736+0000 7f6a325d2640 1 -- 172.21.15.53:0/417645721 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a2c0c3db0 con 0x7f6a2c071060 2023-06-10T19:01:00.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:00.736+0000 7f6a28ff9640 1 -- 172.21.15.53:0/417645721 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6a200073d0 con 0x7f6a2c071060 2023-06-10T19:01:00.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:00.736+0000 7f6a28ff9640 1 --2- 172.21.15.53:0/417645721 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6a180662b0 0x7f6a18068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:00.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:00.736+0000 7f6a28ff9640 1 -- 172.21.15.53:0/417645721 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f6a20083120 con 0x7f6a2c071060 2023-06-10T19:01:00.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:00.736+0000 7f6a2bfff640 1 --2- 172.21.15.53:0/417645721 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6a180662b0 0x7f6a18068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:00.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:00.736+0000 7f6a2bfff640 1 --2- 172.21.15.53:0/417645721 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6a180662b0 0x7f6a18068760 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c0096f0 tx=0x7f6a1c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:00.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:00.740+0000 7f6a28ff9640 1 -- 172.21.15.53:0/417645721 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6a2c0c3db0 con 0x7f6a2c071060 2023-06-10T19:01:00.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:00.928+0000 7f6a325d2640 1 -- 172.21.15.53:0/417645721 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6a2c04d790 con 0x7f6a2c071060 2023-06-10T19:01:00.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:00.952+0000 7f6a28ff9640 1 -- 172.21.15.53:0/417645721 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4683 (secure 0 0 0) 0x7f6a20050680 con 0x7f6a2c071060 2023-06-10T19:01:00.956 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:01:00.956 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":38,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5663,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2600814414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2600814414},{"type":"v1","addr":"172.21.15.117:6835","nonce":2600814414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6136,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1615882017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1615882017},{"type":"v1","addr":"172.21.15.117:6837","nonce":1615882017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6993,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/3732245174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3732245174},{"type":"v1","addr":"172.21.15.53:6833","nonce":3732245174}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:00:20.607950+0000","modified":"2023-06-10T19:00:49.023162+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7266":{"gid":7266,"name":"c","rank":0,"incarnation":37,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.53:6835/2829993338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2829993338},{"type":"v1","addr":"172.21.15.53:6835","nonce":2829993338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-06-10T19:01:00.956 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 38 2023-06-10T19:01:00.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:00.952+0000 7f6a325d2640 1 -- 172.21.15.53:0/417645721 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6a180662b0 msgr2=0x7f6a18068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:00.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:00.952+0000 7f6a325d2640 1 --2- 172.21.15.53:0/417645721 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6a180662b0 0x7f6a18068760 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c0096f0 tx=0x7f6a1c008040 comp rx=0 tx=0).stop 2023-06-10T19:01:00.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:00.952+0000 7f6a325d2640 1 -- 172.21.15.53:0/417645721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a2c071060 msgr2=0x7f6a2c0cc280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:00.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:00.952+0000 7f6a325d2640 1 --2- 172.21.15.53:0/417645721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a2c071060 0x7f6a2c0cc280 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f6a2000c4d0 tx=0x7f6a2000c990 comp rx=0 tx=0).stop 2023-06-10T19:01:00.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:00.952+0000 7f6a325d2640 1 -- 172.21.15.53:0/417645721 shutdown_connections 2023-06-10T19:01:00.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:00.952+0000 7f6a325d2640 1 --2- 172.21.15.53:0/417645721 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6a180662b0 0x7f6a18068760 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:00.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:00.952+0000 7f6a325d2640 1 --2- 172.21.15.53:0/417645721 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6a2c0c9840 0x7f6a2c150a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:00.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:00.952+0000 7f6a325d2640 1 --2- 172.21.15.53:0/417645721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a2c071060 0x7f6a2c0cc280 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:00.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:00.952+0000 7f6a325d2640 1 --2- 172.21.15.53:0/417645721 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a2c06b090 0x7f6a2c0c29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:00.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:00.952+0000 7f6a325d2640 1 -- 172.21.15.53:0/417645721 >> 172.21.15.53:0/417645721 conn(0x7f6a2c06a0d0 msgr2=0x7f6a2c0af9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:00.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:00.952+0000 7f6a325d2640 1 -- 172.21.15.53:0/417645721 shutdown_connections 2023-06-10T19:01:00.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:00.952+0000 7f6a325d2640 1 -- 172.21.15.53:0/417645721 wait complete. 2023-06-10T19:01:00.978 DEBUG:tasks.cephfs.filesystem:mapped states ['up:reconnect'] to None 2023-06-10T19:01:01.979 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:01:02.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:02.108+0000 7f7b75cfd640 1 Processor -- start 2023-06-10T19:01:02.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:02.108+0000 7f7b75cfd640 1 -- start start 2023-06-10T19:01:02.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:02.108+0000 7f7b75cfd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7b700c9750 0x7f7b700aced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:02.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:02.108+0000 7f7b75cfd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7b700cb870 0x7f7b700af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:02.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:02.108+0000 7f7b75cfd640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b700b00a0 con 0x7f7b700afc60 2023-06-10T19:01:02.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:02.108+0000 7f7b75cfd640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b700cd990 con 0x7f7b700c9750 2023-06-10T19:01:02.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:02.108+0000 7f7b75cfd640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b700ad410 con 0x7f7b700cb870 2023-06-10T19:01:02.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:02.108+0000 7f7b6ffff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f7b700afc60 0x7f7b7015bec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:39488/0 (socket says 172.21.15.53:39488) 2023-06-10T19:01:02.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:02.108+0000 7f7b6ffff640 1 -- 172.21.15.53:0/1960990837 learned_addr learned my addr 172.21.15.53:0/1960990837 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:01:02.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:02.108+0000 7f7b6f7fe640 1 --2- 172.21.15.53:0/1960990837 >> v2:172.21.15.53:3300/0 conn(0x7f7b700c9750 0x7f7b700aced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:02.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:02.108+0000 7f7b6effd640 1 --2- 172.21.15.53:0/1960990837 >> v2:172.21.15.117:3300/0 conn(0x7f7b700cb870 0x7f7b700af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:02.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:02.108+0000 7f7b6f7fe640 1 -- 172.21.15.53:0/1960990837 >> v2:172.21.15.117:3300/0 conn(0x7f7b700cb870 msgr2=0x7f7b700af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:02.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:02.108+0000 7f7b6f7fe640 1 --2- 172.21.15.53:0/1960990837 >> v2:172.21.15.117:3300/0 conn(0x7f7b700cb870 0x7f7b700af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:02.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:02.108+0000 7f7b6f7fe640 1 -- 172.21.15.53:0/1960990837 >> v1:172.21.15.53:6789/0 conn(0x7f7b700afc60 legacy=0x7f7b7015bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:02.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:02.108+0000 7f7b6f7fe640 1 -- 172.21.15.53:0/1960990837 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b701600d0 con 0x7f7b700c9750 2023-06-10T19:01:02.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:02.108+0000 7f7b6e7fc640 1 -- 172.21.15.53:0/1960990837 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3403472050 0 0) 0x7f7b700b00a0 con 0x7f7b700afc60 2023-06-10T19:01:02.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:02.112+0000 7f7b6f7fe640 1 --2- 172.21.15.53:0/1960990837 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b700c9750 0x7f7b700aced0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f7b7015d0a0 tx=0x7f7b6001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87eb9e325c11a76a server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:02.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:02.112+0000 7f7b6e7fc640 1 -- 172.21.15.53:0/1960990837 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b600ab600 con 0x7f7b700c9750 2023-06-10T19:01:02.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:02.112+0000 7f7b6e7fc640 1 -- 172.21.15.53:0/1960990837 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b600a7050 con 0x7f7b700c9750 2023-06-10T19:01:02.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:02.112+0000 7f7b6e7fc640 1 -- 172.21.15.53:0/1960990837 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b600ab980 con 0x7f7b700c9750 2023-06-10T19:01:02.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:02.112+0000 7f7b75cfd640 1 -- 172.21.15.53:0/1960990837 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b700c9750 msgr2=0x7f7b700aced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:02.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:02.112+0000 7f7b75cfd640 1 --2- 172.21.15.53:0/1960990837 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b700c9750 0x7f7b700aced0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f7b7015d0a0 tx=0x7f7b6001c430 comp rx=0 tx=0).stop 2023-06-10T19:01:02.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:02.112+0000 7f7b75cfd640 1 -- 172.21.15.53:0/1960990837 shutdown_connections 2023-06-10T19:01:02.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:02.112+0000 7f7b75cfd640 1 --2- 172.21.15.53:0/1960990837 >> v2:172.21.15.117:3300/0 conn(0x7f7b700cb870 0x7f7b700af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:02.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:02.112+0000 7f7b75cfd640 1 --2- 172.21.15.53:0/1960990837 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b700c9750 0x7f7b700aced0 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:02.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:02.112+0000 7f7b75cfd640 1 -- 172.21.15.53:0/1960990837 >> 172.21.15.53:0/1960990837 conn(0x7f7b7006a0d0 msgr2=0x7f7b700ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:02.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:02.112+0000 7f7b75cfd640 1 -- 172.21.15.53:0/1960990837 shutdown_connections 2023-06-10T19:01:02.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:02.112+0000 7f7b75cfd640 1 -- 172.21.15.53:0/1960990837 wait complete. 2023-06-10T19:01:02.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:02.112+0000 7f7b75cfd640 1 Processor -- start 2023-06-10T19:01:02.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:02.112+0000 7f7b75cfd640 1 -- start start 2023-06-10T19:01:02.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:02.112+0000 7f7b75cfd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7b700afc60 0x7f7b700af680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:02.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:02.112+0000 7f7b75cfd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b700c9750 0x7f7b7014bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:02.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:02.112+0000 7f7b75cfd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7b700cb870 0x7f7b700abef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:02.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:02.112+0000 7f7b75cfd640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b70153b20 con 0x7f7b700c9750 2023-06-10T19:01:02.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:02.112+0000 7f7b75cfd640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7006c6e0 con 0x7f7b700afc60 2023-06-10T19:01:02.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:02.112+0000 7f7b75cfd640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b70153d70 con 0x7f7b700cb870 2023-06-10T19:01:02.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:02.116+0000 7f7b6effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b700c9750 0x7f7b7014bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:02.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:02.116+0000 7f7b6effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b700c9750 0x7f7b7014bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59378/0 (socket says 172.21.15.53:59378) 2023-06-10T19:01:02.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:02.116+0000 7f7b6effd640 1 -- 172.21.15.53:0/1618199721 learned_addr learned my addr 172.21.15.53:0/1618199721 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:02.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:02.116+0000 7f7b6ffff640 1 --2- 172.21.15.53:0/1618199721 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7b700cb870 0x7f7b700abef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:02.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:02.116+0000 7f7b6f7fe640 1 --2- 172.21.15.53:0/1618199721 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7b700afc60 0x7f7b700af680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:02.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:02.116+0000 7f7b6effd640 1 -- 172.21.15.53:0/1618199721 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7b700cb870 msgr2=0x7f7b700abef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:02.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:02.116+0000 7f7b6effd640 1 --2- 172.21.15.53:0/1618199721 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7b700cb870 0x7f7b700abef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:02.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:02.116+0000 7f7b6effd640 1 -- 172.21.15.53:0/1618199721 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7b700afc60 msgr2=0x7f7b700af680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:02.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:02.116+0000 7f7b6effd640 1 --2- 172.21.15.53:0/1618199721 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7b700afc60 0x7f7b700af680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:02.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:02.116+0000 7f7b6effd640 1 -- 172.21.15.53:0/1618199721 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b60009420 con 0x7f7b700c9750 2023-06-10T19:01:02.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:02.116+0000 7f7b6ffff640 1 --2- 172.21.15.53:0/1618199721 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7b700cb870 0x7f7b700abef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:01:02.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:02.116+0000 7f7b6effd640 1 --2- 172.21.15.53:0/1618199721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b700c9750 0x7f7b7014bca0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f7b58007e40 tx=0x7f7b5800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:02.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:02.116+0000 7f7b67fff640 1 -- 172.21.15.53:0/1618199721 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b58014620 con 0x7f7b700c9750 2023-06-10T19:01:02.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:02.116+0000 7f7b67fff640 1 -- 172.21.15.53:0/1618199721 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b5800ee90 con 0x7f7b700c9750 2023-06-10T19:01:02.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:02.116+0000 7f7b75cfd640 1 -- 172.21.15.53:0/1618199721 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b70154050 con 0x7f7b700c9750 2023-06-10T19:01:02.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:02.116+0000 7f7b67fff640 1 -- 172.21.15.53:0/1618199721 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b580149a0 con 0x7f7b700c9750 2023-06-10T19:01:02.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:02.116+0000 7f7b75cfd640 1 -- 172.21.15.53:0/1618199721 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b7014c580 con 0x7f7b700c9750 2023-06-10T19:01:02.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:02.116+0000 7f7b75cfd640 1 -- 172.21.15.53:0/1618199721 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b701541e0 con 0x7f7b700c9750 2023-06-10T19:01:02.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:02.116+0000 7f7b67fff640 1 -- 172.21.15.53:0/1618199721 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7b58014b00 con 0x7f7b700c9750 2023-06-10T19:01:02.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:02.116+0000 7f7b67fff640 1 --2- 172.21.15.53:0/1618199721 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7b50066280 0x7f7b50068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:02.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:02.116+0000 7f7b67fff640 1 -- 172.21.15.53:0/1618199721 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f7b58084660 con 0x7f7b700c9750 2023-06-10T19:01:02.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:02.116+0000 7f7b6f7fe640 1 --2- 172.21.15.53:0/1618199721 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7b50066280 0x7f7b50068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:02.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:02.116+0000 7f7b6f7fe640 1 --2- 172.21.15.53:0/1618199721 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7b50066280 0x7f7b50068730 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f7b7015f460 tx=0x7f7b600a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:02.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:02.120+0000 7f7b67fff640 1 -- 172.21.15.53:0/1618199721 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7b580555a0 con 0x7f7b700c9750 2023-06-10T19:01:02.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:02.308+0000 7f7b75cfd640 1 -- 172.21.15.53:0/1618199721 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7b700acbb0 con 0x7f7b700c9750 2023-06-10T19:01:02.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:02.308+0000 7f7b67fff640 1 -- 172.21.15.53:0/1618199721 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4683 (secure 0 0 0) 0x7f7b58014db0 con 0x7f7b700c9750 2023-06-10T19:01:02.314 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:01:02.314 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":38,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5663,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2600814414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2600814414},{"type":"v1","addr":"172.21.15.117:6835","nonce":2600814414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6136,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1615882017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1615882017},{"type":"v1","addr":"172.21.15.117:6837","nonce":1615882017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6993,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/3732245174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3732245174},{"type":"v1","addr":"172.21.15.53:6833","nonce":3732245174}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:00:20.607950+0000","modified":"2023-06-10T19:00:49.023162+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7266":{"gid":7266,"name":"c","rank":0,"incarnation":37,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.53:6835/2829993338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2829993338},{"type":"v1","addr":"172.21.15.53:6835","nonce":2829993338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-06-10T19:01:02.315 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 38 2023-06-10T19:01:02.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:02.312+0000 7f7b75cfd640 1 -- 172.21.15.53:0/1618199721 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7b50066280 msgr2=0x7f7b50068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:02.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:02.312+0000 7f7b75cfd640 1 --2- 172.21.15.53:0/1618199721 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7b50066280 0x7f7b50068730 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f7b7015f460 tx=0x7f7b600a6000 comp rx=0 tx=0).stop 2023-06-10T19:01:02.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:02.312+0000 7f7b75cfd640 1 -- 172.21.15.53:0/1618199721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b700c9750 msgr2=0x7f7b7014bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:02.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:02.312+0000 7f7b75cfd640 1 --2- 172.21.15.53:0/1618199721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b700c9750 0x7f7b7014bca0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f7b58007e40 tx=0x7f7b5800e4b0 comp rx=0 tx=0).stop 2023-06-10T19:01:02.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:02.312+0000 7f7b75cfd640 1 -- 172.21.15.53:0/1618199721 shutdown_connections 2023-06-10T19:01:02.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:02.312+0000 7f7b75cfd640 1 --2- 172.21.15.53:0/1618199721 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7b50066280 0x7f7b50068730 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:02.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:02.312+0000 7f7b75cfd640 1 --2- 172.21.15.53:0/1618199721 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7b700cb870 0x7f7b700abef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:02.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:02.312+0000 7f7b75cfd640 1 --2- 172.21.15.53:0/1618199721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b700c9750 0x7f7b7014bca0 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:02.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:02.312+0000 7f7b75cfd640 1 --2- 172.21.15.53:0/1618199721 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7b700afc60 0x7f7b700af680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:02.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:02.312+0000 7f7b75cfd640 1 -- 172.21.15.53:0/1618199721 >> 172.21.15.53:0/1618199721 conn(0x7f7b7006a0d0 msgr2=0x7f7b70070400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:02.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:02.312+0000 7f7b75cfd640 1 -- 172.21.15.53:0/1618199721 shutdown_connections 2023-06-10T19:01:02.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:02.312+0000 7f7b75cfd640 1 -- 172.21.15.53:0/1618199721 wait complete. 2023-06-10T19:01:02.332 DEBUG:tasks.cephfs.filesystem:mapped states ['up:reconnect'] to None 2023-06-10T19:01:03.333 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:01:03.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:03.464+0000 7fbb196b3640 1 Processor -- start 2023-06-10T19:01:03.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:03.464+0000 7fbb196b3640 1 -- start start 2023-06-10T19:01:03.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:03.464+0000 7fbb196b3640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbb1415ba70 0x7fbb140cd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:03.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:03.464+0000 7fbb196b3640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbb140cbfc0 0x7fbb140c8d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:03.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:03.464+0000 7fbb196b3640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb140c9270 con 0x7fbb1415c100 2023-06-10T19:01:03.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:03.464+0000 7fbb196b3640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb140cc420 con 0x7fbb140cbfc0 2023-06-10T19:01:03.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:03.464+0000 7fbb196b3640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb140cc6c0 con 0x7fbb1415ba70 2023-06-10T19:01:03.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:03.464+0000 7fbb127fc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbb140cbfc0 0x7fbb140c8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:03.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:03.464+0000 7fbb127fc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbb140cbfc0 0x7fbb140c8d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59394/0 (socket says 172.21.15.53:59394) 2023-06-10T19:01:03.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:03.464+0000 7fbb127fc640 1 -- 172.21.15.53:0/3872805275 learned_addr learned my addr 172.21.15.53:0/3872805275 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:03.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:03.464+0000 7fbb12ffd640 1 --2- 172.21.15.53:0/3872805275 >> v2:172.21.15.117:3300/0 conn(0x7fbb1415ba70 0x7fbb140cd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:03.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:03.464+0000 7fbb127fc640 1 -- 172.21.15.53:0/3872805275 >> v2:172.21.15.117:3300/0 conn(0x7fbb1415ba70 msgr2=0x7fbb140cd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:03.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:03.464+0000 7fbb127fc640 1 --2- 172.21.15.53:0/3872805275 >> v2:172.21.15.117:3300/0 conn(0x7fbb1415ba70 0x7fbb140cd760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:03.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:03.464+0000 7fbb127fc640 1 -- 172.21.15.53:0/3872805275 >> v1:172.21.15.117:6789/0 conn(0x7fbb1415c100 legacy=0x7fbb1415c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:03.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:03.464+0000 7fbb127fc640 1 -- 172.21.15.53:0/3872805275 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb140cc9a0 con 0x7fbb140cbfc0 2023-06-10T19:01:03.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:03.468+0000 7fbb127fc640 1 --2- 172.21.15.53:0/3872805275 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb140cbfc0 0x7fbb140c8d30 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7fbb140cb3e0 tx=0x7fbafc01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20c10c8541365257 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:03.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:03.468+0000 7fbb11ffb640 1 -- 172.21.15.53:0/3872805275 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbafc0ab640 con 0x7fbb140cbfc0 2023-06-10T19:01:03.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:03.468+0000 7fbb11ffb640 1 -- 172.21.15.53:0/3872805275 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbafc0a7070 con 0x7fbb140cbfc0 2023-06-10T19:01:03.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:03.468+0000 7fbb11ffb640 1 -- 172.21.15.53:0/3872805275 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbafc0ab9c0 con 0x7fbb140cbfc0 2023-06-10T19:01:03.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:03.468+0000 7fbb196b3640 1 -- 172.21.15.53:0/3872805275 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb140cbfc0 msgr2=0x7fbb140c8d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:03.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:03.468+0000 7fbb196b3640 1 --2- 172.21.15.53:0/3872805275 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb140cbfc0 0x7fbb140c8d30 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7fbb140cb3e0 tx=0x7fbafc01c440 comp rx=0 tx=0).stop 2023-06-10T19:01:03.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:03.468+0000 7fbb196b3640 1 -- 172.21.15.53:0/3872805275 shutdown_connections 2023-06-10T19:01:03.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:03.468+0000 7fbb196b3640 1 --2- 172.21.15.53:0/3872805275 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb140cbfc0 0x7fbb140c8d30 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:03.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:03.468+0000 7fbb196b3640 1 --2- 172.21.15.53:0/3872805275 >> v2:172.21.15.117:3300/0 conn(0x7fbb1415ba70 0x7fbb140cd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:03.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:03.468+0000 7fbb196b3640 1 -- 172.21.15.53:0/3872805275 >> 172.21.15.53:0/3872805275 conn(0x7fbb1406a0d0 msgr2=0x7fbb140ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:03.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:03.468+0000 7fbb196b3640 1 -- 172.21.15.53:0/3872805275 shutdown_connections 2023-06-10T19:01:03.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:03.468+0000 7fbb196b3640 1 -- 172.21.15.53:0/3872805275 wait complete. 2023-06-10T19:01:03.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:03.468+0000 7fbb196b3640 1 Processor -- start 2023-06-10T19:01:03.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:03.468+0000 7fbb196b3640 1 -- start start 2023-06-10T19:01:03.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:03.468+0000 7fbb196b3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb140cbfc0 0x7fbb140b3510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:03.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:03.468+0000 7fbb196b3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb1415ba70 0x7fbb1414b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:03.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:03.468+0000 7fbb196b3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbb1415c100 0x7fbb141463d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:03.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:03.468+0000 7fbb196b3640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb14147540 con 0x7fbb1415ba70 2023-06-10T19:01:03.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:03.468+0000 7fbb196b3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb14164710 con 0x7fbb140cbfc0 2023-06-10T19:01:03.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:03.468+0000 7fbb196b3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb14164150 con 0x7fbb1415c100 2023-06-10T19:01:03.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:03.468+0000 7fbb127fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb1415ba70 0x7fbb1414b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:03.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:03.468+0000 7fbb127fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb1415ba70 0x7fbb1414b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59400/0 (socket says 172.21.15.53:59400) 2023-06-10T19:01:03.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:03.468+0000 7fbb127fc640 1 -- 172.21.15.53:0/603269891 learned_addr learned my addr 172.21.15.53:0/603269891 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:03.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:03.468+0000 7fbb12ffd640 1 --2- 172.21.15.53:0/603269891 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb140cbfc0 0x7fbb140b3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:03.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:03.472+0000 7fbb137fe640 1 --2- 172.21.15.53:0/603269891 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbb1415c100 0x7fbb141463d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:03.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:03.472+0000 7fbb127fc640 1 -- 172.21.15.53:0/603269891 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbb1415c100 msgr2=0x7fbb141463d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:03.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:03.472+0000 7fbb127fc640 1 --2- 172.21.15.53:0/603269891 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbb1415c100 0x7fbb141463d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:03.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:03.472+0000 7fbb127fc640 1 -- 172.21.15.53:0/603269891 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb140cbfc0 msgr2=0x7fbb140b3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:03.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:03.472+0000 7fbb127fc640 1 --2- 172.21.15.53:0/603269891 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb140cbfc0 0x7fbb140b3510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:03.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:03.472+0000 7fbb127fc640 1 -- 172.21.15.53:0/603269891 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbafc0094d0 con 0x7fbb1415ba70 2023-06-10T19:01:03.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:03.472+0000 7fbb12ffd640 1 --2- 172.21.15.53:0/603269891 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb140cbfc0 0x7fbb140b3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:01:03.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:03.472+0000 7fbb127fc640 1 --2- 172.21.15.53:0/603269891 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb1415ba70 0x7fbb1414b4a0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7fbafc019050 tx=0x7fbafc01ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:03.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:03.472+0000 7fbb0b7fe640 1 -- 172.21.15.53:0/603269891 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbafc0be3f0 con 0x7fbb1415ba70 2023-06-10T19:01:03.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:03.472+0000 7fbb0b7fe640 1 -- 172.21.15.53:0/603269891 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbafc0be550 con 0x7fbb1415ba70 2023-06-10T19:01:03.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:03.472+0000 7fbb196b3640 1 -- 172.21.15.53:0/603269891 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb14164430 con 0x7fbb1415ba70 2023-06-10T19:01:03.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:03.472+0000 7fbb0b7fe640 1 -- 172.21.15.53:0/603269891 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbafc0be8c0 con 0x7fbb1415ba70 2023-06-10T19:01:03.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:03.472+0000 7fbb196b3640 1 -- 172.21.15.53:0/603269891 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb140b2090 con 0x7fbb1415ba70 2023-06-10T19:01:03.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:03.472+0000 7fbb196b3640 1 -- 172.21.15.53:0/603269891 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb140ca040 con 0x7fbb1415ba70 2023-06-10T19:01:03.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:03.472+0000 7fbb0b7fe640 1 -- 172.21.15.53:0/603269891 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbafc0b43f0 con 0x7fbb1415ba70 2023-06-10T19:01:03.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:03.472+0000 7fbb0b7fe640 1 --2- 172.21.15.53:0/603269891 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbaf4066280 0x7fbaf4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:03.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:03.472+0000 7fbb0b7fe640 1 -- 172.21.15.53:0/603269891 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6148+0+0 (secure 0 0 0) 0x7fbafc11dbe0 con 0x7fbb1415ba70 2023-06-10T19:01:03.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:03.472+0000 7fbb12ffd640 1 --2- 172.21.15.53:0/603269891 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbaf4066280 0x7fbaf4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:03.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:03.472+0000 7fbb12ffd640 1 --2- 172.21.15.53:0/603269891 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbaf4066280 0x7fbaf4068730 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fbb04009ae0 tx=0x7fbb04008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:03.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:03.476+0000 7fbb0b7fe640 1 -- 172.21.15.53:0/603269891 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbafc0eafe0 con 0x7fbb1415ba70 2023-06-10T19:01:03.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:03.660+0000 7fbb196b3640 1 -- 172.21.15.53:0/603269891 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbb140b1c10 con 0x7fbb1415ba70 2023-06-10T19:01:03.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:03.660+0000 7fbb0b7fe640 1 -- 172.21.15.53:0/603269891 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4683 (secure 0 0 0) 0x7fbb140b1c10 con 0x7fbb1415ba70 2023-06-10T19:01:03.667 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:01:03.667 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":38,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5663,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2600814414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2600814414},{"type":"v1","addr":"172.21.15.117:6835","nonce":2600814414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6136,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1615882017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1615882017},{"type":"v1","addr":"172.21.15.117:6837","nonce":1615882017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6993,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/3732245174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3732245174},{"type":"v1","addr":"172.21.15.53:6833","nonce":3732245174}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:00:20.607950+0000","modified":"2023-06-10T19:00:49.023162+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7266":{"gid":7266,"name":"c","rank":0,"incarnation":37,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.53:6835/2829993338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2829993338},{"type":"v1","addr":"172.21.15.53:6835","nonce":2829993338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-06-10T19:01:03.668 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 38 2023-06-10T19:01:03.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:03.664+0000 7fbb196b3640 1 -- 172.21.15.53:0/603269891 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbaf4066280 msgr2=0x7fbaf4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:03.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:03.664+0000 7fbb196b3640 1 --2- 172.21.15.53:0/603269891 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbaf4066280 0x7fbaf4068730 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fbb04009ae0 tx=0x7fbb04008040 comp rx=0 tx=0).stop 2023-06-10T19:01:03.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:03.664+0000 7fbb196b3640 1 -- 172.21.15.53:0/603269891 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb1415ba70 msgr2=0x7fbb1414b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:03.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:03.664+0000 7fbb196b3640 1 --2- 172.21.15.53:0/603269891 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb1415ba70 0x7fbb1414b4a0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7fbafc019050 tx=0x7fbafc01ac80 comp rx=0 tx=0).stop 2023-06-10T19:01:03.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:03.664+0000 7fbb196b3640 1 -- 172.21.15.53:0/603269891 shutdown_connections 2023-06-10T19:01:03.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:03.664+0000 7fbb196b3640 1 --2- 172.21.15.53:0/603269891 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbaf4066280 0x7fbaf4068730 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:03.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:03.664+0000 7fbb196b3640 1 --2- 172.21.15.53:0/603269891 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbb1415c100 0x7fbb141463d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:03.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:03.664+0000 7fbb196b3640 1 --2- 172.21.15.53:0/603269891 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb1415ba70 0x7fbb1414b4a0 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:03.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:03.664+0000 7fbb196b3640 1 --2- 172.21.15.53:0/603269891 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb140cbfc0 0x7fbb140b3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:03.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:03.664+0000 7fbb196b3640 1 -- 172.21.15.53:0/603269891 >> 172.21.15.53:0/603269891 conn(0x7fbb1406a0d0 msgr2=0x7fbb14150c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:03.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:03.664+0000 7fbb196b3640 1 -- 172.21.15.53:0/603269891 shutdown_connections 2023-06-10T19:01:03.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:03.664+0000 7fbb196b3640 1 -- 172.21.15.53:0/603269891 wait complete. 2023-06-10T19:01:03.685 DEBUG:tasks.cephfs.filesystem:mapped states ['up:reconnect'] to None 2023-06-10T19:01:04.687 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:01:04.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:04.824+0000 7fa2d6455640 1 Processor -- start 2023-06-10T19:01:04.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:04.824+0000 7fa2d6455640 1 -- start start 2023-06-10T19:01:04.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:04.824+0000 7fa2d6455640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa2d0159450 0x7fa2d015d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:04.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:04.824+0000 7fa2d6455640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2d015d680 0x7fa2d00cec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:04.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:04.824+0000 7fa2d6455640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2d00cbac0 con 0x7fa2d00cf180 2023-06-10T19:01:04.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:04.824+0000 7fa2d6455640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2d00cf600 con 0x7fa2d0159450 2023-06-10T19:01:04.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:04.824+0000 7fa2d6455640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d015dc00 con 0x7fa2d015d680 2023-06-10T19:01:04.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:04.824+0000 7fa2d49f2640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fa2d00cf180 0x7fa2d00cda20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:39498/0 (socket says 172.21.15.53:39498) 2023-06-10T19:01:04.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:04.824+0000 7fa2d49f2640 1 -- 172.21.15.53:0/2027266972 learned_addr learned my addr 172.21.15.53:0/2027266972 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:01:04.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:04.824+0000 7fa2cffff640 1 --2- 172.21.15.53:0/2027266972 >> v2:172.21.15.117:3300/0 conn(0x7fa2d0159450 0x7fa2d015d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:04.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:04.824+0000 7fa2c7fff640 1 --2- 172.21.15.53:0/2027266972 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2d015d680 0x7fa2d00cec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:04.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:04.824+0000 7fa2cf7fe640 1 -- 172.21.15.53:0/2027266972 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3131530276 0 0) 0x7fa2d00cbac0 con 0x7fa2d00cf180 2023-06-10T19:01:04.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:04.824+0000 7fa2cf7fe640 1 -- 172.21.15.53:0/2027266972 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2bc003530 con 0x7fa2d00cf180 2023-06-10T19:01:04.832 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:04.824+0000 7fa2cf7fe640 1 -- 172.21.15.53:0/2027266972 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 476661166 0 0) 0x7fa2bc003530 con 0x7fa2d00cf180 2023-06-10T19:01:04.832 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:04.824+0000 7fa2cf7fe640 1 -- 172.21.15.53:0/2027266972 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2d015d680 msgr2=0x7fa2d00cec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:04.832 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:04.824+0000 7fa2cf7fe640 1 --2- 172.21.15.53:0/2027266972 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2d015d680 0x7fa2d00cec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:04.832 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:04.824+0000 7fa2cf7fe640 1 -- 172.21.15.53:0/2027266972 >> v2:172.21.15.117:3300/0 conn(0x7fa2d0159450 msgr2=0x7fa2d015d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:04.832 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:04.824+0000 7fa2cf7fe640 1 --2- 172.21.15.53:0/2027266972 >> v2:172.21.15.117:3300/0 conn(0x7fa2d0159450 0x7fa2d015d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:04.832 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:04.824+0000 7fa2cf7fe640 1 -- 172.21.15.53:0/2027266972 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d015dee0 con 0x7fa2d00cf180 2023-06-10T19:01:04.832 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:04.824+0000 7fa2cf7fe640 1 -- 172.21.15.53:0/2027266972 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fa2c8001a00 con 0x7fa2d00cf180 2023-06-10T19:01:04.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:04.824+0000 7fa2cf7fe640 1 -- 172.21.15.53:0/2027266972 >> v1:172.21.15.53:6789/0 conn(0x7fa2d00cf180 legacy=0x7fa2d00cda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:04.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:04.824+0000 7fa2cf7fe640 1 --2- 172.21.15.53:0/2027266972 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2bc0039f0 0x7fa2bc003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:04.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:04.824+0000 7fa2cf7fe640 1 --2- 172.21.15.53:0/2027266972 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2d015d680 0x7fa2bc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:04.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:04.824+0000 7fa2cf7fe640 1 --2- 172.21.15.53:0/2027266972 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2bc004d10 0x7fa2bc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:04.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:04.824+0000 7fa2cf7fe640 1 -- 172.21.15.53:0/2027266972 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d00cf600 con 0x7fa2bc004d10 2023-06-10T19:01:04.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:04.824+0000 7fa2cf7fe640 1 -- 172.21.15.53:0/2027266972 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d015dc00 con 0x7fa2bc0039f0 2023-06-10T19:01:04.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:04.824+0000 7fa2cf7fe640 1 -- 172.21.15.53:0/2027266972 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2bc00b9e0 con 0x7fa2d015d680 2023-06-10T19:01:04.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:04.824+0000 7fa2d49f2640 1 --2- 172.21.15.53:0/2027266972 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2bc004d10 0x7fa2bc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:04.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:04.824+0000 7fa2cffff640 1 --2- 172.21.15.53:0/2027266972 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2bc0039f0 0x7fa2bc003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:04.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:04.824+0000 7fa2c7fff640 1 --2- 172.21.15.53:0/2027266972 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2d015d680 0x7fa2bc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:04.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:04.824+0000 7fa2d49f2640 1 -- 172.21.15.53:0/2027266972 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2d015d680 msgr2=0x7fa2bc0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:04.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:04.824+0000 7fa2d49f2640 1 --2- 172.21.15.53:0/2027266972 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2d015d680 0x7fa2bc0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:04.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:04.824+0000 7fa2d49f2640 1 -- 172.21.15.53:0/2027266972 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2bc0039f0 msgr2=0x7fa2bc003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:04.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:04.824+0000 7fa2d49f2640 1 --2- 172.21.15.53:0/2027266972 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2bc0039f0 0x7fa2bc003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:04.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:04.824+0000 7fa2d49f2640 1 -- 172.21.15.53:0/2027266972 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2bc003530 con 0x7fa2bc004d10 2023-06-10T19:01:04.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:04.828+0000 7fa2d49f2640 1 --2- 172.21.15.53:0/2027266972 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2bc004d10 0x7fa2bc005180 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7fa2c800a900 tx=0x7fa2c801fb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f0afbac97f8b5b1 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:04.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:04.828+0000 7fa2cf7fe640 1 -- 172.21.15.53:0/2027266972 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c80aa6c0 con 0x7fa2bc004d10 2023-06-10T19:01:04.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:04.828+0000 7fa2cf7fe640 1 -- 172.21.15.53:0/2027266972 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2c80aa820 con 0x7fa2bc004d10 2023-06-10T19:01:04.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:04.828+0000 7fa2cf7fe640 1 -- 172.21.15.53:0/2027266972 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c80aabd0 con 0x7fa2bc004d10 2023-06-10T19:01:04.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:04.828+0000 7fa2d6455640 1 -- 172.21.15.53:0/2027266972 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2bc004d10 msgr2=0x7fa2bc005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:04.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:04.828+0000 7fa2d6455640 1 --2- 172.21.15.53:0/2027266972 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2bc004d10 0x7fa2bc005180 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7fa2c800a900 tx=0x7fa2c801fb20 comp rx=0 tx=0).stop 2023-06-10T19:01:04.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:04.828+0000 7fa2d49f2640 1 -- 172.21.15.53:0/2027266972 reap_dead start 2023-06-10T19:01:04.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:04.828+0000 7fa2d6455640 1 -- 172.21.15.53:0/2027266972 shutdown_connections 2023-06-10T19:01:04.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:04.828+0000 7fa2d6455640 1 -- 172.21.15.53:0/2027266972 >> 172.21.15.53:0/2027266972 conn(0x7fa2d006a090 msgr2=0x7fa2d006d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:04.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:04.828+0000 7fa2d6455640 1 -- 172.21.15.53:0/2027266972 shutdown_connections 2023-06-10T19:01:04.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:04.828+0000 7fa2d6455640 1 -- 172.21.15.53:0/2027266972 wait complete. 2023-06-10T19:01:04.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:04.828+0000 7fa2d6455640 1 Processor -- start 2023-06-10T19:01:04.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:04.828+0000 7fa2d6455640 1 -- start start 2023-06-10T19:01:04.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:04.828+0000 7fa2d6455640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2bc004d10 0x7fa2d015c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:04.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:04.828+0000 7fa2d6455640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2d00c96b0 0x7fa2d0157220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:04.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:04.828+0000 7fa2d6455640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2d00a7450 0x7fa2d00a78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:04.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:04.828+0000 7fa2d6455640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d00a7e10 con 0x7fa2bc004d10 2023-06-10T19:01:04.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:04.832+0000 7fa2d6455640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d015c650 con 0x7fa2d00a7450 2023-06-10T19:01:04.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:04.832+0000 7fa2d6455640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d00c8980 con 0x7fa2d00c96b0 2023-06-10T19:01:04.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:04.832+0000 7fa2cffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2bc004d10 0x7fa2d015c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:04.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:04.832+0000 7fa2cffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2bc004d10 0x7fa2d015c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59422/0 (socket says 172.21.15.53:59422) 2023-06-10T19:01:04.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:04.832+0000 7fa2cffff640 1 -- 172.21.15.53:0/615454726 learned_addr learned my addr 172.21.15.53:0/615454726 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:04.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:04.832+0000 7fa2c7fff640 1 --2- 172.21.15.53:0/615454726 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2d00c96b0 0x7fa2d0157220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:04.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:04.832+0000 7fa2d49f2640 1 --2- 172.21.15.53:0/615454726 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2d00a7450 0x7fa2d00a78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:04.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:04.832+0000 7fa2cffff640 1 -- 172.21.15.53:0/615454726 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2d00c96b0 msgr2=0x7fa2d0157220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:04.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:04.832+0000 7fa2cffff640 1 --2- 172.21.15.53:0/615454726 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2d00c96b0 0x7fa2d0157220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:04.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:04.832+0000 7fa2cffff640 1 -- 172.21.15.53:0/615454726 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2d00a7450 msgr2=0x7fa2d00a78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:04.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:04.832+0000 7fa2cffff640 1 --2- 172.21.15.53:0/615454726 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2d00a7450 0x7fa2d00a78d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:04.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:04.832+0000 7fa2cffff640 1 -- 172.21.15.53:0/615454726 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d00c9220 con 0x7fa2bc004d10 2023-06-10T19:01:04.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:04.832+0000 7fa2cffff640 1 --2- 172.21.15.53:0/615454726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2bc004d10 0x7fa2d015c110 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7fa2c0011540 tx=0x7fa2c0011a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:04.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:04.832+0000 7fa2cd7fa640 1 -- 172.21.15.53:0/615454726 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c0015870 con 0x7fa2bc004d10 2023-06-10T19:01:04.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:04.832+0000 7fa2cd7fa640 1 -- 172.21.15.53:0/615454726 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2c00159d0 con 0x7fa2bc004d10 2023-06-10T19:01:04.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:04.832+0000 7fa2d6455640 1 -- 172.21.15.53:0/615454726 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2d015b710 con 0x7fa2bc004d10 2023-06-10T19:01:04.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:04.832+0000 7fa2cd7fa640 1 -- 172.21.15.53:0/615454726 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c0015d60 con 0x7fa2bc004d10 2023-06-10T19:01:04.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:04.832+0000 7fa2d6455640 1 -- 172.21.15.53:0/615454726 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2d00c8eb0 con 0x7fa2bc004d10 2023-06-10T19:01:04.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:04.832+0000 7fa2d6455640 1 -- 172.21.15.53:0/615454726 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2d004d790 con 0x7fa2bc004d10 2023-06-10T19:01:04.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:04.832+0000 7fa2cd7fa640 1 -- 172.21.15.53:0/615454726 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa2c001d400 con 0x7fa2bc004d10 2023-06-10T19:01:04.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:04.832+0000 7fa2cd7fa640 1 --2- 172.21.15.53:0/615454726 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa2b0066280 0x7fa2b0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:04.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:04.832+0000 7fa2cd7fa640 1 -- 172.21.15.53:0/615454726 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6148+0+0 (secure 0 0 0) 0x7fa2c00844b0 con 0x7fa2bc004d10 2023-06-10T19:01:04.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:04.832+0000 7fa2c7fff640 1 --2- 172.21.15.53:0/615454726 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa2b0066280 0x7fa2b0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:04.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:04.832+0000 7fa2c7fff640 1 --2- 172.21.15.53:0/615454726 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa2b0066280 0x7fa2b0068730 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fa2d00c9aa0 tx=0x7fa2b8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:04.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:04.836+0000 7fa2cd7fa640 1 -- 172.21.15.53:0/615454726 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa2c00554a0 con 0x7fa2bc004d10 2023-06-10T19:01:05.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:05.024+0000 7fa2d6455640 1 -- 172.21.15.53:0/615454726 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa2d00b4740 con 0x7fa2bc004d10 2023-06-10T19:01:05.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:05.024+0000 7fa2cd7fa640 1 -- 172.21.15.53:0/615454726 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4683 (secure 0 0 0) 0x7fa2c0055030 con 0x7fa2bc004d10 2023-06-10T19:01:05.029 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:01:05.029 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":38,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5663,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2600814414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2600814414},{"type":"v1","addr":"172.21.15.117:6835","nonce":2600814414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6136,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1615882017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1615882017},{"type":"v1","addr":"172.21.15.117:6837","nonce":1615882017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6993,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/3732245174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3732245174},{"type":"v1","addr":"172.21.15.53:6833","nonce":3732245174}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:00:20.607950+0000","modified":"2023-06-10T19:00:49.023162+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7266":{"gid":7266,"name":"c","rank":0,"incarnation":37,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.53:6835/2829993338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2829993338},{"type":"v1","addr":"172.21.15.53:6835","nonce":2829993338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-06-10T19:01:05.030 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 38 2023-06-10T19:01:05.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:05.024+0000 7fa2d6455640 1 -- 172.21.15.53:0/615454726 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa2b0066280 msgr2=0x7fa2b0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:05.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:05.024+0000 7fa2d6455640 1 --2- 172.21.15.53:0/615454726 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa2b0066280 0x7fa2b0068730 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fa2d00c9aa0 tx=0x7fa2b8008040 comp rx=0 tx=0).stop 2023-06-10T19:01:05.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:05.024+0000 7fa2d6455640 1 -- 172.21.15.53:0/615454726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2bc004d10 msgr2=0x7fa2d015c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:05.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:05.024+0000 7fa2d6455640 1 --2- 172.21.15.53:0/615454726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2bc004d10 0x7fa2d015c110 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7fa2c0011540 tx=0x7fa2c0011a00 comp rx=0 tx=0).stop 2023-06-10T19:01:05.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:05.024+0000 7fa2d6455640 1 -- 172.21.15.53:0/615454726 shutdown_connections 2023-06-10T19:01:05.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:05.024+0000 7fa2d6455640 1 --2- 172.21.15.53:0/615454726 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa2b0066280 0x7fa2b0068730 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:05.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:05.024+0000 7fa2d6455640 1 --2- 172.21.15.53:0/615454726 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2d00a7450 0x7fa2d00a78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:05.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:05.024+0000 7fa2d6455640 1 --2- 172.21.15.53:0/615454726 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2d00c96b0 0x7fa2d0157220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:05.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:05.024+0000 7fa2d6455640 1 --2- 172.21.15.53:0/615454726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2bc004d10 0x7fa2d015c110 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:05.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:05.024+0000 7fa2d6455640 1 -- 172.21.15.53:0/615454726 >> 172.21.15.53:0/615454726 conn(0x7fa2d006a090 msgr2=0x7fa2d00cde60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:05.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:05.024+0000 7fa2d6455640 1 -- 172.21.15.53:0/615454726 shutdown_connections 2023-06-10T19:01:05.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:05.024+0000 7fa2d6455640 1 -- 172.21.15.53:0/615454726 wait complete. 2023-06-10T19:01:05.047 DEBUG:tasks.cephfs.filesystem:mapped states ['up:reconnect'] to None 2023-06-10T19:01:06.049 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:01:06.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:06.180+0000 7f1358aa3640 1 Processor -- start 2023-06-10T19:01:06.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:06.180+0000 7f1358aa3640 1 -- start start 2023-06-10T19:01:06.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:06.180+0000 7f1358aa3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13540b3ac0 0x7f13540b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:06.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:06.180+0000 7f1358aa3640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f13540cc690 0x7f135415f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:06.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:06.180+0000 7f1358aa3640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13540d0020 con 0x7f13540ccae0 2023-06-10T19:01:06.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:06.180+0000 7f1358aa3640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13540b43d0 con 0x7f13540cc690 2023-06-10T19:01:06.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:06.180+0000 7f1358aa3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13540cef40 con 0x7f13540b3ac0 2023-06-10T19:01:06.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:06.180+0000 7f1351d9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f13540cc690 0x7f135415f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:06.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:06.180+0000 7f1352d9d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f13540ccae0 0x7f135415f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:39500/0 (socket says 172.21.15.53:39500) 2023-06-10T19:01:06.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:06.180+0000 7f1352d9d640 1 -- 172.21.15.53:0/1868298865 learned_addr learned my addr 172.21.15.53:0/1868298865 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:01:06.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:06.180+0000 7f135259c640 1 --2- 172.21.15.53:0/1868298865 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13540b3ac0 0x7f13540b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:06.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:06.180+0000 7f1351d9b640 1 -- 172.21.15.53:0/1868298865 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13540b3ac0 msgr2=0x7f13540b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:06.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:06.180+0000 7f1351d9b640 1 --2- 172.21.15.53:0/1868298865 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13540b3ac0 0x7f13540b3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:06.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:06.180+0000 7f1351d9b640 1 -- 172.21.15.53:0/1868298865 >> v1:172.21.15.53:6789/0 conn(0x7f13540ccae0 legacy=0x7f135415f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:06.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:06.180+0000 7f1351d9b640 1 -- 172.21.15.53:0/1868298865 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13540cf220 con 0x7f13540cc690 2023-06-10T19:01:06.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:06.180+0000 7f135159a640 1 -- 172.21.15.53:0/1868298865 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4079343500 0 0) 0x7f13540d0020 con 0x7f13540ccae0 2023-06-10T19:01:06.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:06.184+0000 7f1351d9b640 1 --2- 172.21.15.53:0/1868298865 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13540cc690 0x7f135415f370 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f1344009d90 tx=0x7f134401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e61ecfa249479cb server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:06.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:06.184+0000 7f135159a640 1 -- 172.21.15.53:0/1868298865 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13440a59e0 con 0x7f13540cc690 2023-06-10T19:01:06.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:06.184+0000 7f135159a640 1 -- 172.21.15.53:0/1868298865 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13440a5b40 con 0x7f13540cc690 2023-06-10T19:01:06.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:06.184+0000 7f135159a640 1 -- 172.21.15.53:0/1868298865 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13440ad440 con 0x7f13540cc690 2023-06-10T19:01:06.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:06.184+0000 7f1358aa3640 1 -- 172.21.15.53:0/1868298865 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13540cc690 msgr2=0x7f135415f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:06.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:06.184+0000 7f1358aa3640 1 --2- 172.21.15.53:0/1868298865 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13540cc690 0x7f135415f370 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f1344009d90 tx=0x7f134401c920 comp rx=0 tx=0).stop 2023-06-10T19:01:06.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:06.184+0000 7f1358aa3640 1 -- 172.21.15.53:0/1868298865 shutdown_connections 2023-06-10T19:01:06.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:06.184+0000 7f1358aa3640 1 --2- 172.21.15.53:0/1868298865 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13540cc690 0x7f135415f370 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:06.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:06.184+0000 7f1358aa3640 1 --2- 172.21.15.53:0/1868298865 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13540b3ac0 0x7f13540b3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:06.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:06.184+0000 7f1358aa3640 1 -- 172.21.15.53:0/1868298865 >> 172.21.15.53:0/1868298865 conn(0x7f1354071790 msgr2=0x7f1354069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:06.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:06.184+0000 7f1358aa3640 1 -- 172.21.15.53:0/1868298865 shutdown_connections 2023-06-10T19:01:06.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:06.184+0000 7f1358aa3640 1 -- 172.21.15.53:0/1868298865 wait complete. 2023-06-10T19:01:06.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:06.184+0000 7f1358aa3640 1 Processor -- start 2023-06-10T19:01:06.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:06.184+0000 7f1358aa3640 1 -- start start 2023-06-10T19:01:06.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:06.184+0000 7f1358aa3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13540b3ac0 0x7f13541574b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:06.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:06.184+0000 7f1358aa3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f13540cc690 0x7f1354152300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:06.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:06.184+0000 7f1358aa3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13540ccae0 0x7f1354152840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:06.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:06.184+0000 7f1358aa3640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13541f43d0 con 0x7f13540b3ac0 2023-06-10T19:01:06.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:06.184+0000 7f1358aa3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f135415ecc0 con 0x7f13540cc690 2023-06-10T19:01:06.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:06.184+0000 7f1358aa3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1354153330 con 0x7f13540ccae0 2023-06-10T19:01:06.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:06.184+0000 7f135259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13540b3ac0 0x7f13541574b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:06.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:06.184+0000 7f135259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13540b3ac0 0x7f13541574b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59438/0 (socket says 172.21.15.53:59438) 2023-06-10T19:01:06.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:06.184+0000 7f135259c640 1 -- 172.21.15.53:0/1097063618 learned_addr learned my addr 172.21.15.53:0/1097063618 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:06.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:06.184+0000 7f1351d9b640 1 --2- 172.21.15.53:0/1097063618 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f13540cc690 0x7f1354152300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:06.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:06.184+0000 7f135259c640 1 -- 172.21.15.53:0/1097063618 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13540ccae0 msgr2=0x7f1354152840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:06.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:06.184+0000 7f1352d9d640 1 --2- 172.21.15.53:0/1097063618 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13540ccae0 0x7f1354152840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:06.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:06.184+0000 7f135259c640 1 --2- 172.21.15.53:0/1097063618 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13540ccae0 0x7f1354152840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:06.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:06.184+0000 7f135259c640 1 -- 172.21.15.53:0/1097063618 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f13540cc690 msgr2=0x7f1354152300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:06.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:06.184+0000 7f135259c640 1 --2- 172.21.15.53:0/1097063618 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f13540cc690 0x7f1354152300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:06.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:06.184+0000 7f135259c640 1 -- 172.21.15.53:0/1097063618 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1344009a70 con 0x7f13540b3ac0 2023-06-10T19:01:06.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:06.184+0000 7f1351d9b640 1 --2- 172.21.15.53:0/1097063618 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f13540cc690 0x7f1354152300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:01:06.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:06.188+0000 7f135259c640 1 --2- 172.21.15.53:0/1097063618 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13540b3ac0 0x7f13541574b0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f134800d5f0 tx=0x7f134800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:06.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:06.188+0000 7f1342ffd640 1 -- 172.21.15.53:0/1097063618 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13480125f0 con 0x7f13540b3ac0 2023-06-10T19:01:06.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:06.188+0000 7f1342ffd640 1 -- 172.21.15.53:0/1097063618 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1348012750 con 0x7f13540b3ac0 2023-06-10T19:01:06.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:06.188+0000 7f1358aa3640 1 -- 172.21.15.53:0/1097063618 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f135415e700 con 0x7f13540b3ac0 2023-06-10T19:01:06.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:06.188+0000 7f1342ffd640 1 -- 172.21.15.53:0/1097063618 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1348012ae0 con 0x7f13540b3ac0 2023-06-10T19:01:06.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:06.188+0000 7f1358aa3640 1 -- 172.21.15.53:0/1097063618 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1354152fc0 con 0x7f13540b3ac0 2023-06-10T19:01:06.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:06.188+0000 7f1358aa3640 1 -- 172.21.15.53:0/1097063618 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f135404d790 con 0x7f13540b3ac0 2023-06-10T19:01:06.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:06.188+0000 7f1342ffd640 1 -- 172.21.15.53:0/1097063618 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1348012c40 con 0x7f13540b3ac0 2023-06-10T19:01:06.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:06.188+0000 7f1342ffd640 1 --2- 172.21.15.53:0/1097063618 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1334066280 0x7f1334068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:06.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:06.188+0000 7f1342ffd640 1 -- 172.21.15.53:0/1097063618 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f1348084210 con 0x7f13540b3ac0 2023-06-10T19:01:06.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:06.188+0000 7f1351d9b640 1 --2- 172.21.15.53:0/1097063618 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1334066280 0x7f1334068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:06.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:06.188+0000 7f1351d9b640 1 --2- 172.21.15.53:0/1097063618 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1334066280 0x7f1334068730 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f13440af000 tx=0x7f13440a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:06.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:06.192+0000 7f1342ffd640 1 -- 172.21.15.53:0/1097063618 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f13480516c0 con 0x7f13540b3ac0 2023-06-10T19:01:06.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:06.380+0000 7f1358aa3640 1 -- 172.21.15.53:0/1097063618 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1354158cb0 con 0x7f13540b3ac0 2023-06-10T19:01:06.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:06.380+0000 7f1342ffd640 1 -- 172.21.15.53:0/1097063618 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4683 (secure 0 0 0) 0x7f1348007380 con 0x7f13540b3ac0 2023-06-10T19:01:06.387 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:01:06.387 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":38,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5663,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2600814414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2600814414},{"type":"v1","addr":"172.21.15.117:6835","nonce":2600814414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6136,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1615882017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1615882017},{"type":"v1","addr":"172.21.15.117:6837","nonce":1615882017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6993,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/3732245174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3732245174},{"type":"v1","addr":"172.21.15.53:6833","nonce":3732245174}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:00:20.607950+0000","modified":"2023-06-10T19:00:49.023162+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7266":{"gid":7266,"name":"c","rank":0,"incarnation":37,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.53:6835/2829993338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2829993338},{"type":"v1","addr":"172.21.15.53:6835","nonce":2829993338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-06-10T19:01:06.387 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 38 2023-06-10T19:01:06.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:06.384+0000 7f1358aa3640 1 -- 172.21.15.53:0/1097063618 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1334066280 msgr2=0x7f1334068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:06.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:06.384+0000 7f1358aa3640 1 --2- 172.21.15.53:0/1097063618 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1334066280 0x7f1334068730 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f13440af000 tx=0x7f13440a7070 comp rx=0 tx=0).stop 2023-06-10T19:01:06.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:06.384+0000 7f1358aa3640 1 -- 172.21.15.53:0/1097063618 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13540b3ac0 msgr2=0x7f13541574b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:06.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:06.384+0000 7f1358aa3640 1 --2- 172.21.15.53:0/1097063618 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13540b3ac0 0x7f13541574b0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f134800d5f0 tx=0x7f134800dab0 comp rx=0 tx=0).stop 2023-06-10T19:01:06.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:06.384+0000 7f1358aa3640 1 -- 172.21.15.53:0/1097063618 shutdown_connections 2023-06-10T19:01:06.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:06.384+0000 7f1358aa3640 1 --2- 172.21.15.53:0/1097063618 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1334066280 0x7f1334068730 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:06.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:06.384+0000 7f1358aa3640 1 --2- 172.21.15.53:0/1097063618 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13540ccae0 0x7f1354152840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:06.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:06.384+0000 7f1358aa3640 1 --2- 172.21.15.53:0/1097063618 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f13540cc690 0x7f1354152300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:06.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:06.384+0000 7f1358aa3640 1 --2- 172.21.15.53:0/1097063618 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13540b3ac0 0x7f13541574b0 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:06.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:06.384+0000 7f1358aa3640 1 -- 172.21.15.53:0/1097063618 >> 172.21.15.53:0/1097063618 conn(0x7f1354071790 msgr2=0x7f13540b2110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:06.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:06.384+0000 7f1358aa3640 1 -- 172.21.15.53:0/1097063618 shutdown_connections 2023-06-10T19:01:06.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:06.384+0000 7f1358aa3640 1 -- 172.21.15.53:0/1097063618 wait complete. 2023-06-10T19:01:06.404 DEBUG:tasks.cephfs.filesystem:mapped states ['up:reconnect'] to None 2023-06-10T19:01:07.405 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:01:07.420 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-10T19:01:07.453 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-10T19:01:07.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:07.536+0000 7f90fb365640 1 Processor -- start 2023-06-10T19:01:07.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:07.536+0000 7f90fb365640 1 -- start start 2023-06-10T19:01:07.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:07.536+0000 7f90fb365640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f90f4071060 0x7f90f40af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:07.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:07.536+0000 7f90fb365640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90f40afc60 0x7f90f406b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:07.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:07.536+0000 7f90fb365640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90f4159b50 con 0x7f90f40c9840 2023-06-10T19:01:07.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:07.536+0000 7f90fb365640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90f40702a0 con 0x7f90f4071060 2023-06-10T19:01:07.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:07.536+0000 7f90fb365640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90f4070580 con 0x7f90f40afc60 2023-06-10T19:01:07.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:07.536+0000 7f90f8900640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f90f4071060 0x7f90f40af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:07.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:07.536+0000 7f90f9902640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90f40afc60 0x7f90f406b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:07.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:07.536+0000 7f90f9902640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90f40afc60 0x7f90f406b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.53:58264/0 (socket says 172.21.15.53:58264) 2023-06-10T19:01:07.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:07.536+0000 7f90f8900640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f90f4071060 0x7f90f40af720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.53:60310/0 (socket says 172.21.15.53:60310) 2023-06-10T19:01:07.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:07.536+0000 7f90f9902640 1 -- 172.21.15.53:0/2915574784 learned_addr learned my addr 172.21.15.53:0/2915574784 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:07.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:07.536+0000 7f90f9101640 1 --1- 172.21.15.53:0/2915574784 >> v1:172.21.15.117:6789/0 conn(0x7f90f40c9840 0x7f90f40c9c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.53:36378/0 (socket says 172.21.15.53:36378) 2023-06-10T19:01:07.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:07.536+0000 7f90ebfff640 1 -- 172.21.15.53:0/2915574784 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1783922355 0 0) 0x7f90f4159b50 con 0x7f90f40c9840 2023-06-10T19:01:07.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:07.536+0000 7f90ebfff640 1 -- 172.21.15.53:0/2915574784 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90e0003530 con 0x7f90f40c9840 2023-06-10T19:01:07.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:07.536+0000 7f90f8900640 1 -- 172.21.15.53:0/2915574784 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90f40afc60 msgr2=0x7f90f406b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:07.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:07.536+0000 7f90f8900640 1 --2- 172.21.15.53:0/2915574784 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90f40afc60 0x7f90f406b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:07.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:07.536+0000 7f90f8900640 1 -- 172.21.15.53:0/2915574784 >> v1:172.21.15.117:6789/0 conn(0x7f90f40c9840 legacy=0x7f90f40c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:07.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:07.536+0000 7f90f8900640 1 -- 172.21.15.53:0/2915574784 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90f4070860 con 0x7f90f4071060 2023-06-10T19:01:07.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:07.536+0000 7f90f9902640 1 --2- 172.21.15.53:0/2915574784 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90f40afc60 0x7f90f406b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-10T19:01:07.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:07.540+0000 7f90f8900640 1 --2- 172.21.15.53:0/2915574784 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90f4071060 0x7f90f40af720 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f90e40097c0 tx=0x7f90e401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=145862271bc6ec8 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:07.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:07.540+0000 7f90ebfff640 1 -- 172.21.15.53:0/2915574784 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e40ab670 con 0x7f90f4071060 2023-06-10T19:01:07.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:07.540+0000 7f90ebfff640 1 -- 172.21.15.53:0/2915574784 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90e40ab7d0 con 0x7f90f4071060 2023-06-10T19:01:07.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:07.540+0000 7f90ebfff640 1 -- 172.21.15.53:0/2915574784 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e40abb60 con 0x7f90f4071060 2023-06-10T19:01:07.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:07.540+0000 7f90fb365640 1 -- 172.21.15.53:0/2915574784 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90f4071060 msgr2=0x7f90f40af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:07.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:07.540+0000 7f90fb365640 1 --2- 172.21.15.53:0/2915574784 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90f4071060 0x7f90f40af720 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f90e40097c0 tx=0x7f90e401c450 comp rx=0 tx=0).stop 2023-06-10T19:01:07.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:07.540+0000 7f90fb365640 1 -- 172.21.15.53:0/2915574784 shutdown_connections 2023-06-10T19:01:07.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:07.540+0000 7f90fb365640 1 --2- 172.21.15.53:0/2915574784 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90f40afc60 0x7f90f406b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:07.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:07.540+0000 7f90fb365640 1 --2- 172.21.15.53:0/2915574784 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90f4071060 0x7f90f40af720 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:07.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:07.540+0000 7f90fb365640 1 -- 172.21.15.53:0/2915574784 >> 172.21.15.53:0/2915574784 conn(0x7f90f406a0d0 msgr2=0x7f90f40ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:07.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:07.540+0000 7f90fb365640 1 -- 172.21.15.53:0/2915574784 shutdown_connections 2023-06-10T19:01:07.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:07.540+0000 7f90fb365640 1 -- 172.21.15.53:0/2915574784 wait complete. 2023-06-10T19:01:07.551 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:07.540+0000 7f90fb365640 1 Processor -- start 2023-06-10T19:01:07.551 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:07.540+0000 7f90fb365640 1 -- start start 2023-06-10T19:01:07.551 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:07.544+0000 7f90fb365640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90f4071060 0x7f90f40c21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:07.551 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:07.544+0000 7f90fb365640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90f40afc60 0x7f90f414b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:07.551 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:07.544+0000 7f90fb365640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90f40c9840 0x7f90f40ae510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:07.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:07.544+0000 7f90fb365640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f40c2720 con 0x7f90f40afc60 2023-06-10T19:01:07.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:07.544+0000 7f90fb365640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f414bfa0 con 0x7f90f40c9840 2023-06-10T19:01:07.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:07.544+0000 7f90fb365640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90f414c1f0 con 0x7f90f4071060 2023-06-10T19:01:07.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:07.544+0000 7f90f8900640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90f40afc60 0x7f90f414b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:07.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:07.544+0000 7f90f8900640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90f40afc60 0x7f90f414b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59440/0 (socket says 172.21.15.53:59440) 2023-06-10T19:01:07.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:07.544+0000 7f90f8900640 1 -- 172.21.15.53:0/3751772367 learned_addr learned my addr 172.21.15.53:0/3751772367 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:07.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:07.544+0000 7f90f9101640 1 --2- 172.21.15.53:0/3751772367 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90f4071060 0x7f90f40c21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:07.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:07.544+0000 7f90f9902640 1 --2- 172.21.15.53:0/3751772367 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90f40c9840 0x7f90f40ae510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:07.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:07.544+0000 7f90f8900640 1 -- 172.21.15.53:0/3751772367 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90f4071060 msgr2=0x7f90f40c21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:07.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:07.544+0000 7f90f8900640 1 --2- 172.21.15.53:0/3751772367 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90f4071060 0x7f90f40c21e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:07.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:07.544+0000 7f90f8900640 1 -- 172.21.15.53:0/3751772367 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90f40c9840 msgr2=0x7f90f40ae510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:07.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:07.544+0000 7f90f8900640 1 --2- 172.21.15.53:0/3751772367 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90f40c9840 0x7f90f40ae510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:07.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:07.544+0000 7f90f8900640 1 -- 172.21.15.53:0/3751772367 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90ec009b30 con 0x7f90f40afc60 2023-06-10T19:01:07.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:07.544+0000 7f90f9101640 1 --2- 172.21.15.53:0/3751772367 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90f4071060 0x7f90f40c21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:01:07.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:07.544+0000 7f90f8900640 1 --2- 172.21.15.53:0/3751772367 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90f40afc60 0x7f90f414b6e0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f90e40ad040 tx=0x7f90e401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:07.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:07.544+0000 7f90e9ffb640 1 -- 172.21.15.53:0/3751772367 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e40bf610 con 0x7f90f40afc60 2023-06-10T19:01:07.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:07.544+0000 7f90fb365640 1 -- 172.21.15.53:0/3751772367 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90e4009420 con 0x7f90f40afc60 2023-06-10T19:01:07.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:07.544+0000 7f90e9ffb640 1 -- 172.21.15.53:0/3751772367 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90e40bf7b0 con 0x7f90f40afc60 2023-06-10T19:01:07.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:07.544+0000 7f90e9ffb640 1 -- 172.21.15.53:0/3751772367 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e40bfb60 con 0x7f90f40afc60 2023-06-10T19:01:07.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:07.544+0000 7f90fb365640 1 -- 172.21.15.53:0/3751772367 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90f414c7b0 con 0x7f90f40afc60 2023-06-10T19:01:07.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:07.544+0000 7f90fb365640 1 -- 172.21.15.53:0/3751772367 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90f404d790 con 0x7f90f40afc60 2023-06-10T19:01:07.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:07.544+0000 7f90e9ffb640 1 -- 172.21.15.53:0/3751772367 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f90e40b5400 con 0x7f90f40afc60 2023-06-10T19:01:07.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:07.544+0000 7f90e9ffb640 1 --2- 172.21.15.53:0/3751772367 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f90d8066280 0x7f90d8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:07.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:07.544+0000 7f90e9ffb640 1 -- 172.21.15.53:0/3751772367 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f90e411e9a0 con 0x7f90f40afc60 2023-06-10T19:01:07.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:07.544+0000 7f90f9101640 1 --2- 172.21.15.53:0/3751772367 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f90d8066280 0x7f90d8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:07.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:07.548+0000 7f90f9101640 1 --2- 172.21.15.53:0/3751772367 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f90d8066280 0x7f90d8068730 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f90f00011f0 tx=0x7f90f0007c40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:07.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:07.548+0000 7f90e9ffb640 1 -- 172.21.15.53:0/3751772367 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f90e40ebef0 con 0x7f90f40afc60 2023-06-10T19:01:07.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:07.736+0000 7f90fb365640 1 -- 172.21.15.53:0/3751772367 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f90f40ae2f0 con 0x7f90f40afc60 2023-06-10T19:01:07.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:07.736+0000 7f90e9ffb640 1 -- 172.21.15.53:0/3751772367 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4683 (secure 0 0 0) 0x7f90e40ef510 con 0x7f90f40afc60 2023-06-10T19:01:07.742 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:01:07.743 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":38,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5663,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2600814414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2600814414},{"type":"v1","addr":"172.21.15.117:6835","nonce":2600814414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6136,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1615882017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1615882017},{"type":"v1","addr":"172.21.15.117:6837","nonce":1615882017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6993,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/3732245174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3732245174},{"type":"v1","addr":"172.21.15.53:6833","nonce":3732245174}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:00:20.607950+0000","modified":"2023-06-10T19:00:49.023162+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7266":{"gid":7266,"name":"c","rank":0,"incarnation":37,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.53:6835/2829993338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2829993338},{"type":"v1","addr":"172.21.15.53:6835","nonce":2829993338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-06-10T19:01:07.743 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 38 2023-06-10T19:01:07.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:07.740+0000 7f90fb365640 1 -- 172.21.15.53:0/3751772367 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f90d8066280 msgr2=0x7f90d8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:07.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:07.740+0000 7f90fb365640 1 --2- 172.21.15.53:0/3751772367 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f90d8066280 0x7f90d8068730 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f90f00011f0 tx=0x7f90f0007c40 comp rx=0 tx=0).stop 2023-06-10T19:01:07.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:07.740+0000 7f90fb365640 1 -- 172.21.15.53:0/3751772367 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90f40afc60 msgr2=0x7f90f414b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:07.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:07.740+0000 7f90fb365640 1 --2- 172.21.15.53:0/3751772367 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90f40afc60 0x7f90f414b6e0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f90e40ad040 tx=0x7f90e401ac90 comp rx=0 tx=0).stop 2023-06-10T19:01:07.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:07.740+0000 7f90fb365640 1 -- 172.21.15.53:0/3751772367 shutdown_connections 2023-06-10T19:01:07.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:07.740+0000 7f90fb365640 1 --2- 172.21.15.53:0/3751772367 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f90d8066280 0x7f90d8068730 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:07.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:07.740+0000 7f90fb365640 1 --2- 172.21.15.53:0/3751772367 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90f40c9840 0x7f90f40ae510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:07.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:07.740+0000 7f90fb365640 1 --2- 172.21.15.53:0/3751772367 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90f40afc60 0x7f90f414b6e0 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:07.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:07.740+0000 7f90fb365640 1 --2- 172.21.15.53:0/3751772367 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90f4071060 0x7f90f40c21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:07.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:07.740+0000 7f90fb365640 1 -- 172.21.15.53:0/3751772367 >> 172.21.15.53:0/3751772367 conn(0x7f90f406a0d0 msgr2=0x7f90f40c9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:07.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:07.740+0000 7f90fb365640 1 -- 172.21.15.53:0/3751772367 shutdown_connections 2023-06-10T19:01:07.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:07.740+0000 7f90fb365640 1 -- 172.21.15.53:0/3751772367 wait complete. 2023-06-10T19:01:07.761 DEBUG:tasks.cephfs.filesystem:mapped states ['up:reconnect'] to None 2023-06-10T19:01:08.762 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:01:08.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:08.892+0000 7f62916fb640 1 Processor -- start 2023-06-10T19:01:08.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:08.892+0000 7f62916fb640 1 -- start start 2023-06-10T19:01:08.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:08.892+0000 7f62916fb640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f628c0cec40 0x7f628c0cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:08.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:08.892+0000 7f62916fb640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f628c0cbac0 con 0x7f628c159450 2023-06-10T19:01:08.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:08.892+0000 7f62916fb640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f628c15dc00 con 0x7f628c0cbf50 2023-06-10T19:01:08.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:08.892+0000 7f62916fb640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f628c0cf600 con 0x7f628c0cec40 2023-06-10T19:01:08.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:08.892+0000 7f628affd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f628c159450 0x7f628c15d140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:39512/0 (socket says 172.21.15.53:39512) 2023-06-10T19:01:08.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:08.892+0000 7f628affd640 1 -- 172.21.15.53:0/2640330586 learned_addr learned my addr 172.21.15.53:0/2640330586 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:01:08.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:08.892+0000 7f628a7fc640 1 --2- 172.21.15.53:0/2640330586 >> v2:172.21.15.117:3300/0 conn(0x7f628c0cec40 0x7f628c0cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:08.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:08.892+0000 7f6289ffb640 1 -- 172.21.15.53:0/2640330586 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4175127683 0 0) 0x7f628c0cbac0 con 0x7f628c159450 2023-06-10T19:01:08.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:08.892+0000 7f6289ffb640 1 -- 172.21.15.53:0/2640330586 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6274003530 con 0x7f628c159450 2023-06-10T19:01:08.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:08.892+0000 7f6289ffb640 1 -- 172.21.15.53:0/2640330586 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1137081717 0 0) 0x7f6274003530 con 0x7f628c159450 2023-06-10T19:01:08.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:08.892+0000 7f6289ffb640 1 -- 172.21.15.53:0/2640330586 >> v2:172.21.15.117:3300/0 conn(0x7f628c0cec40 msgr2=0x7f628c0cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:08.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:08.892+0000 7f6289ffb640 1 --2- 172.21.15.53:0/2640330586 >> v2:172.21.15.117:3300/0 conn(0x7f628c0cec40 0x7f628c0cf0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:08.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:08.892+0000 7f6289ffb640 1 -- 172.21.15.53:0/2640330586 >> v1:172.21.15.117:6789/0 conn(0x7f628c0cbf50 legacy=0x7f628c0cc390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:08.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:08.892+0000 7f6289ffb640 1 -- 172.21.15.53:0/2640330586 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f628c15dee0 con 0x7f628c159450 2023-06-10T19:01:08.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:08.892+0000 7f6289ffb640 1 -- 172.21.15.53:0/2640330586 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f627c001680 con 0x7f628c159450 2023-06-10T19:01:08.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:08.892+0000 7f6289ffb640 1 -- 172.21.15.53:0/2640330586 >> v1:172.21.15.53:6789/0 conn(0x7f628c159450 legacy=0x7f628c15d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:08.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:08.892+0000 7f6289ffb640 1 --2- 172.21.15.53:0/2640330586 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62740039f0 0x7f6274003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:08.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:08.892+0000 7f6289ffb640 1 --2- 172.21.15.53:0/2640330586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62740047d0 0x7f6274004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:08.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:08.892+0000 7f6289ffb640 1 --2- 172.21.15.53:0/2640330586 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6274005180 0x7f627400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:08.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:08.892+0000 7f6289ffb640 1 -- 172.21.15.53:0/2640330586 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f628c0cf600 con 0x7f62740047d0 2023-06-10T19:01:08.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:08.892+0000 7f6289ffb640 1 -- 172.21.15.53:0/2640330586 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f627400c060 con 0x7f62740039f0 2023-06-10T19:01:08.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:08.892+0000 7f6289ffb640 1 -- 172.21.15.53:0/2640330586 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f627400c220 con 0x7f6274005180 2023-06-10T19:01:08.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:08.892+0000 7f628a7fc640 1 --2- 172.21.15.53:0/2640330586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62740047d0 0x7f6274004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:08.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:08.892+0000 7f628affd640 1 --2- 172.21.15.53:0/2640330586 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62740039f0 0x7f6274003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:08.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:08.892+0000 7f628b7fe640 1 --2- 172.21.15.53:0/2640330586 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6274005180 0x7f627400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:08.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:08.892+0000 7f628a7fc640 1 -- 172.21.15.53:0/2640330586 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6274005180 msgr2=0x7f627400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:08.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:08.892+0000 7f628a7fc640 1 --2- 172.21.15.53:0/2640330586 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6274005180 0x7f627400b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:08.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:08.892+0000 7f628a7fc640 1 -- 172.21.15.53:0/2640330586 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62740039f0 msgr2=0x7f6274003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:08.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:08.892+0000 7f628a7fc640 1 --2- 172.21.15.53:0/2640330586 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62740039f0 0x7f6274003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:08.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:08.892+0000 7f628a7fc640 1 -- 172.21.15.53:0/2640330586 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6274003530 con 0x7f62740047d0 2023-06-10T19:01:08.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:08.892+0000 7f628b7fe640 1 -- 172.21.15.53:0/2640330586 reap_dead start 2023-06-10T19:01:08.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:08.892+0000 7f628affd640 1 --2- 172.21.15.53:0/2640330586 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62740039f0 0x7f6274003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:01:08.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:08.896+0000 7f628a7fc640 1 --2- 172.21.15.53:0/2640330586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62740047d0 0x7f6274004c40 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f6280009ae0 tx=0x7f628001ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=533fe565c2dcdd7a server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:08.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:08.896+0000 7f6289ffb640 1 -- 172.21.15.53:0/2640330586 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62800a5640 con 0x7f62740047d0 2023-06-10T19:01:08.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:08.896+0000 7f6289ffb640 1 -- 172.21.15.53:0/2640330586 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f627c001d80 con 0x7f62740047d0 2023-06-10T19:01:08.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:08.896+0000 7f6289ffb640 1 -- 172.21.15.53:0/2640330586 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62800a59e0 con 0x7f62740047d0 2023-06-10T19:01:08.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:08.896+0000 7f62916fb640 1 -- 172.21.15.53:0/2640330586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62740047d0 msgr2=0x7f6274004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:08.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:08.896+0000 7f62916fb640 1 --2- 172.21.15.53:0/2640330586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62740047d0 0x7f6274004c40 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f6280009ae0 tx=0x7f628001ca50 comp rx=0 tx=0).stop 2023-06-10T19:01:08.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:08.896+0000 7f62916fb640 1 -- 172.21.15.53:0/2640330586 shutdown_connections 2023-06-10T19:01:08.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:08.896+0000 7f62916fb640 1 --2- 172.21.15.53:0/2640330586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62740047d0 0x7f6274004c40 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:08.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:08.896+0000 7f62916fb640 1 -- 172.21.15.53:0/2640330586 >> 172.21.15.53:0/2640330586 conn(0x7f628c06a090 msgr2=0x7f628c06d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:08.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:08.896+0000 7f62916fb640 1 -- 172.21.15.53:0/2640330586 shutdown_connections 2023-06-10T19:01:08.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:08.896+0000 7f62916fb640 1 -- 172.21.15.53:0/2640330586 wait complete. 2023-06-10T19:01:08.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:08.896+0000 7f62916fb640 1 Processor -- start 2023-06-10T19:01:08.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:08.896+0000 7f62916fb640 1 -- start start 2023-06-10T19:01:08.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:08.900+0000 7f62916fb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62740047d0 0x7f628c150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:08.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:08.900+0000 7f62916fb640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f628c0c6f20 0x7f628c159820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:08.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:08.900+0000 7f62916fb640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f628c0b5300 0x7f628c152d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:08.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:08.900+0000 7f62916fb640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f628c1514e0 con 0x7f62740047d0 2023-06-10T19:01:08.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:08.900+0000 7f62916fb640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f628c0c73b0 con 0x7f628c0c6f20 2023-06-10T19:01:08.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:08.900+0000 7f62916fb640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f628c0c7690 con 0x7f628c0b5300 2023-06-10T19:01:08.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:08.900+0000 7f628affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62740047d0 0x7f628c150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:08.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:08.900+0000 7f628affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62740047d0 0x7f628c150fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59462/0 (socket says 172.21.15.53:59462) 2023-06-10T19:01:08.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:08.900+0000 7f628affd640 1 -- 172.21.15.53:0/3965744391 learned_addr learned my addr 172.21.15.53:0/3965744391 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:08.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:08.900+0000 7f628a7fc640 1 --2- 172.21.15.53:0/3965744391 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f628c0c6f20 0x7f628c159820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:08.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:08.900+0000 7f628b7fe640 1 --2- 172.21.15.53:0/3965744391 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f628c0b5300 0x7f628c152d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:08.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:08.900+0000 7f628affd640 1 -- 172.21.15.53:0/3965744391 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f628c0b5300 msgr2=0x7f628c152d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:08.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:08.900+0000 7f628affd640 1 --2- 172.21.15.53:0/3965744391 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f628c0b5300 0x7f628c152d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:08.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:08.900+0000 7f628affd640 1 -- 172.21.15.53:0/3965744391 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f628c0c6f20 msgr2=0x7f628c159820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:08.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:08.900+0000 7f628affd640 1 --2- 172.21.15.53:0/3965744391 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f628c0c6f20 0x7f628c159820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:08.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:08.900+0000 7f628affd640 1 -- 172.21.15.53:0/3965744391 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f628c0c7970 con 0x7f62740047d0 2023-06-10T19:01:08.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:08.900+0000 7f628b7fe640 1 --2- 172.21.15.53:0/3965744391 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f628c0b5300 0x7f628c152d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:01:08.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:08.900+0000 7f628a7fc640 1 --2- 172.21.15.53:0/3965744391 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f628c0c6f20 0x7f628c159820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:01:08.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:08.900+0000 7f628affd640 1 --2- 172.21.15.53:0/3965744391 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62740047d0 0x7f628c150fa0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f627c010b10 tx=0x7f627c010c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:08.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:08.900+0000 7f62737fe640 1 -- 172.21.15.53:0/3965744391 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f627c01a070 con 0x7f62740047d0 2023-06-10T19:01:08.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:08.900+0000 7f62737fe640 1 -- 172.21.15.53:0/3965744391 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f627c00e6e0 con 0x7f62740047d0 2023-06-10T19:01:08.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:08.900+0000 7f62737fe640 1 -- 172.21.15.53:0/3965744391 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f627c00ea50 con 0x7f62740047d0 2023-06-10T19:01:08.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:08.900+0000 7f62916fb640 1 -- 172.21.15.53:0/3965744391 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f628c0c7c50 con 0x7f62740047d0 2023-06-10T19:01:08.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:08.900+0000 7f62916fb640 1 -- 172.21.15.53:0/3965744391 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f628c159d60 con 0x7f62740047d0 2023-06-10T19:01:08.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:08.900+0000 7f62916fb640 1 -- 172.21.15.53:0/3965744391 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f628c04d790 con 0x7f62740047d0 2023-06-10T19:01:08.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:08.900+0000 7f62737fe640 1 -- 172.21.15.53:0/3965744391 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f627c00ebb0 con 0x7f62740047d0 2023-06-10T19:01:08.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:08.900+0000 7f62737fe640 1 --2- 172.21.15.53:0/3965744391 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f62780662b0 0x7f6278068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:08.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:08.904+0000 7f62737fe640 1 -- 172.21.15.53:0/3965744391 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f627c0869d0 con 0x7f62740047d0 2023-06-10T19:01:08.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:08.904+0000 7f628a7fc640 1 --2- 172.21.15.53:0/3965744391 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f62780662b0 0x7f6278068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:08.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:08.904+0000 7f628a7fc640 1 --2- 172.21.15.53:0/3965744391 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f62780662b0 0x7f6278068760 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f62800af000 tx=0x7f6280008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:08.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:08.908+0000 7f62737fe640 1 -- 172.21.15.53:0/3965744391 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f627c053eb0 con 0x7f62740047d0 2023-06-10T19:01:09.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:09.092+0000 7f62916fb640 1 -- 172.21.15.53:0/3965744391 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f628c06df70 con 0x7f62740047d0 2023-06-10T19:01:09.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:09.096+0000 7f62737fe640 1 -- 172.21.15.53:0/3965744391 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4683 (secure 0 0 0) 0x7f627c00ee60 con 0x7f62740047d0 2023-06-10T19:01:09.100 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:01:09.100 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":38,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5663,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2600814414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2600814414},{"type":"v1","addr":"172.21.15.117:6835","nonce":2600814414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6136,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1615882017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1615882017},{"type":"v1","addr":"172.21.15.117:6837","nonce":1615882017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6993,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/3732245174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3732245174},{"type":"v1","addr":"172.21.15.53:6833","nonce":3732245174}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:00:20.607950+0000","modified":"2023-06-10T19:00:49.023162+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7266":{"gid":7266,"name":"c","rank":0,"incarnation":37,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.53:6835/2829993338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2829993338},{"type":"v1","addr":"172.21.15.53:6835","nonce":2829993338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-06-10T19:01:09.100 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 38 2023-06-10T19:01:09.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:09.096+0000 7f62916fb640 1 -- 172.21.15.53:0/3965744391 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f62780662b0 msgr2=0x7f6278068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:09.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:09.096+0000 7f62916fb640 1 --2- 172.21.15.53:0/3965744391 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f62780662b0 0x7f6278068760 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f62800af000 tx=0x7f6280008040 comp rx=0 tx=0).stop 2023-06-10T19:01:09.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:09.096+0000 7f62916fb640 1 -- 172.21.15.53:0/3965744391 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62740047d0 msgr2=0x7f628c150fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:09.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:09.096+0000 7f62916fb640 1 --2- 172.21.15.53:0/3965744391 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62740047d0 0x7f628c150fa0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f627c010b10 tx=0x7f627c010c00 comp rx=0 tx=0).stop 2023-06-10T19:01:09.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:09.096+0000 7f62916fb640 1 -- 172.21.15.53:0/3965744391 shutdown_connections 2023-06-10T19:01:09.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:09.096+0000 7f62916fb640 1 --2- 172.21.15.53:0/3965744391 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f62780662b0 0x7f6278068760 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:09.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:09.096+0000 7f62916fb640 1 --2- 172.21.15.53:0/3965744391 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f628c0b5300 0x7f628c152d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:09.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:09.096+0000 7f62916fb640 1 --2- 172.21.15.53:0/3965744391 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f628c0c6f20 0x7f628c159820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:09.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:09.096+0000 7f62916fb640 1 --2- 172.21.15.53:0/3965744391 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62740047d0 0x7f628c150fa0 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:09.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:09.096+0000 7f62916fb640 1 -- 172.21.15.53:0/3965744391 >> 172.21.15.53:0/3965744391 conn(0x7f628c06a090 msgr2=0x7f628c0cd790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:09.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:09.096+0000 7f62916fb640 1 -- 172.21.15.53:0/3965744391 shutdown_connections 2023-06-10T19:01:09.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:09.096+0000 7f62916fb640 1 -- 172.21.15.53:0/3965744391 wait complete. 2023-06-10T19:01:09.118 DEBUG:tasks.cephfs.filesystem:mapped states ['up:reconnect'] to None 2023-06-10T19:01:10.120 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:01:10.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.252+0000 7f87c631d640 1 Processor -- start 2023-06-10T19:01:10.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.252+0000 7f87c631d640 1 -- start start 2023-06-10T19:01:10.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.252+0000 7f87c631d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87c00c9840 0x7f87c00c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:10.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.252+0000 7f87c631d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87c0159b50 con 0x7f87c0071060 2023-06-10T19:01:10.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.252+0000 7f87c631d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87c00ca150 con 0x7f87c006b090 2023-06-10T19:01:10.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.252+0000 7f87c631d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87c00702a0 con 0x7f87c00c9840 2023-06-10T19:01:10.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.252+0000 7f87bf7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f87c0071060 0x7f87c00af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:39514/0 (socket says 172.21.15.53:39514) 2023-06-10T19:01:10.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.252+0000 7f87bf7fe640 1 -- 172.21.15.53:0/3316134921 learned_addr learned my addr 172.21.15.53:0/3316134921 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:01:10.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.252+0000 7f87bffff640 1 --2- 172.21.15.53:0/3316134921 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87c00c9840 0x7f87c00c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:10.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.252+0000 7f87beffd640 1 -- 172.21.15.53:0/3316134921 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4249779841 0 0) 0x7f87c0159b50 con 0x7f87c0071060 2023-06-10T19:01:10.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.252+0000 7f87beffd640 1 -- 172.21.15.53:0/3316134921 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87ac003530 con 0x7f87c0071060 2023-06-10T19:01:10.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.252+0000 7f87beffd640 1 -- 172.21.15.53:0/3316134921 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2553060525 0 0) 0x7f87ac003530 con 0x7f87c0071060 2023-06-10T19:01:10.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.252+0000 7f87beffd640 1 -- 172.21.15.53:0/3316134921 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87c00c9840 msgr2=0x7f87c00c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:10.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.252+0000 7f87beffd640 1 --2- 172.21.15.53:0/3316134921 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87c00c9840 0x7f87c00c9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:10.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.252+0000 7f87beffd640 1 -- 172.21.15.53:0/3316134921 >> v1:172.21.15.117:6789/0 conn(0x7f87c006b090 legacy=0x7f87c006b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:10.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.252+0000 7f87beffd640 1 -- 172.21.15.53:0/3316134921 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87c0070580 con 0x7f87c0071060 2023-06-10T19:01:10.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.252+0000 7f87beffd640 1 -- 172.21.15.53:0/3316134921 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f87a8001680 con 0x7f87c0071060 2023-06-10T19:01:10.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.252+0000 7f87beffd640 1 -- 172.21.15.53:0/3316134921 >> v1:172.21.15.53:6789/0 conn(0x7f87c0071060 legacy=0x7f87c00af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:10.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.252+0000 7f87beffd640 1 --2- 172.21.15.53:0/3316134921 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87ac003a20 0x7f87ac003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:10.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.252+0000 7f87beffd640 1 --2- 172.21.15.53:0/3316134921 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87c00c9840 0x7f87ac0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:10.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.252+0000 7f87beffd640 1 --2- 172.21.15.53:0/3316134921 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87ac004d10 0x7f87ac005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:10.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.252+0000 7f87beffd640 1 -- 172.21.15.53:0/3316134921 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c00702a0 con 0x7f87ac004d10 2023-06-10T19:01:10.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.252+0000 7f87beffd640 1 -- 172.21.15.53:0/3316134921 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87ac00ba40 con 0x7f87ac003a20 2023-06-10T19:01:10.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.252+0000 7f87beffd640 1 -- 172.21.15.53:0/3316134921 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87ac00bbb0 con 0x7f87c00c9840 2023-06-10T19:01:10.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.252+0000 7f87c48ba640 1 --2- 172.21.15.53:0/3316134921 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87ac004d10 0x7f87ac005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:10.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.252+0000 7f87bffff640 1 --2- 172.21.15.53:0/3316134921 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87ac003a20 0x7f87ac003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:10.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.252+0000 7f87bf7fe640 1 --2- 172.21.15.53:0/3316134921 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87c00c9840 0x7f87ac0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:10.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.252+0000 7f87c48ba640 1 -- 172.21.15.53:0/3316134921 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87c00c9840 msgr2=0x7f87ac0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:10.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.252+0000 7f87c48ba640 1 --2- 172.21.15.53:0/3316134921 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87c00c9840 0x7f87ac0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:10.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.252+0000 7f87c48ba640 1 -- 172.21.15.53:0/3316134921 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87ac003a20 msgr2=0x7f87ac003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:10.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.252+0000 7f87c48ba640 1 --2- 172.21.15.53:0/3316134921 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87ac003a20 0x7f87ac003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:10.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.252+0000 7f87c48ba640 1 -- 172.21.15.53:0/3316134921 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87ac003530 con 0x7f87ac004d10 2023-06-10T19:01:10.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.256+0000 7f87c48ba640 1 --2- 172.21.15.53:0/3316134921 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87ac004d10 0x7f87ac005180 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f87b8001860 tx=0x7f87b801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5512b111a804816b server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:10.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.256+0000 7f87beffd640 1 -- 172.21.15.53:0/3316134921 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b80ac640 con 0x7f87ac004d10 2023-06-10T19:01:10.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.256+0000 7f87beffd640 1 -- 172.21.15.53:0/3316134921 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87b80ac7a0 con 0x7f87ac004d10 2023-06-10T19:01:10.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.256+0000 7f87beffd640 1 -- 172.21.15.53:0/3316134921 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b80acb50 con 0x7f87ac004d10 2023-06-10T19:01:10.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.256+0000 7f87c631d640 1 -- 172.21.15.53:0/3316134921 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87ac004d10 msgr2=0x7f87ac005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:10.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.256+0000 7f87c631d640 1 --2- 172.21.15.53:0/3316134921 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87ac004d10 0x7f87ac005180 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f87b8001860 tx=0x7f87b801c480 comp rx=0 tx=0).stop 2023-06-10T19:01:10.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.256+0000 7f87c48ba640 1 -- 172.21.15.53:0/3316134921 reap_dead start 2023-06-10T19:01:10.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.256+0000 7f87c631d640 1 -- 172.21.15.53:0/3316134921 shutdown_connections 2023-06-10T19:01:10.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.256+0000 7f87c631d640 1 -- 172.21.15.53:0/3316134921 >> 172.21.15.53:0/3316134921 conn(0x7f87c006a0d0 msgr2=0x7f87c00ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:10.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.256+0000 7f87c631d640 1 -- 172.21.15.53:0/3316134921 shutdown_connections 2023-06-10T19:01:10.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.256+0000 7f87c631d640 1 -- 172.21.15.53:0/3316134921 wait complete. 2023-06-10T19:01:10.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.256+0000 7f87c631d640 1 Processor -- start 2023-06-10T19:01:10.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.256+0000 7f87c631d640 1 -- start start 2023-06-10T19:01:10.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.260+0000 7f87c631d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87ac004d10 0x7f87c00c21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:10.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.260+0000 7f87c631d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87c01f2fc0 0x7f87c01f2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:10.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.260+0000 7f87c631d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87c01ee1b0 0x7f87c01ee650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:10.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.260+0000 7f87c631d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c00c50e0 con 0x7f87c01f2fc0 2023-06-10T19:01:10.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.260+0000 7f87c631d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c00c2af0 con 0x7f87ac004d10 2023-06-10T19:01:10.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.260+0000 7f87c631d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87c00c2dd0 con 0x7f87c01ee1b0 2023-06-10T19:01:10.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.260+0000 7f87bf7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87c01f2fc0 0x7f87c01f2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:10.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.260+0000 7f87bf7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87c01f2fc0 0x7f87c01f2530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59482/0 (socket says 172.21.15.53:59482) 2023-06-10T19:01:10.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.260+0000 7f87bf7fe640 1 -- 172.21.15.53:0/193974095 learned_addr learned my addr 172.21.15.53:0/193974095 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:10.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.260+0000 7f87c48ba640 1 --2- 172.21.15.53:0/193974095 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87c01ee1b0 0x7f87c01ee650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:10.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.260+0000 7f87bffff640 1 --2- 172.21.15.53:0/193974095 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87ac004d10 0x7f87c00c21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:10.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.260+0000 7f87bf7fe640 1 -- 172.21.15.53:0/193974095 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87c01ee1b0 msgr2=0x7f87c01ee650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:10.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.260+0000 7f87bf7fe640 1 --2- 172.21.15.53:0/193974095 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87c01ee1b0 0x7f87c01ee650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:10.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.260+0000 7f87bf7fe640 1 -- 172.21.15.53:0/193974095 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87ac004d10 msgr2=0x7f87c00c21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:10.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.260+0000 7f87bf7fe640 1 --2- 172.21.15.53:0/193974095 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87ac004d10 0x7f87c00c21e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:10.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.260+0000 7f87bf7fe640 1 -- 172.21.15.53:0/193974095 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87c00c30b0 con 0x7f87c01f2fc0 2023-06-10T19:01:10.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.260+0000 7f87bf7fe640 1 --2- 172.21.15.53:0/193974095 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87c01f2fc0 0x7f87c01f2530 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f87a8001cc0 tx=0x7f87a8011d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:10.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.260+0000 7f87bcff9640 1 -- 172.21.15.53:0/193974095 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a800fb30 con 0x7f87c01f2fc0 2023-06-10T19:01:10.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.260+0000 7f87bcff9640 1 -- 172.21.15.53:0/193974095 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87a800fc90 con 0x7f87c01f2fc0 2023-06-10T19:01:10.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.260+0000 7f87c631d640 1 -- 172.21.15.53:0/193974095 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87c00c4d70 con 0x7f87c01f2fc0 2023-06-10T19:01:10.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.260+0000 7f87bcff9640 1 -- 172.21.15.53:0/193974095 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a8015410 con 0x7f87c01f2fc0 2023-06-10T19:01:10.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.260+0000 7f87c631d640 1 -- 172.21.15.53:0/193974095 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87c00c2720 con 0x7f87c01f2fc0 2023-06-10T19:01:10.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.260+0000 7f87c631d640 1 -- 172.21.15.53:0/193974095 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87c00c5290 con 0x7f87c01f2fc0 2023-06-10T19:01:10.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.260+0000 7f87bcff9640 1 -- 172.21.15.53:0/193974095 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f87a8015570 con 0x7f87c01f2fc0 2023-06-10T19:01:10.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.260+0000 7f87bcff9640 1 --2- 172.21.15.53:0/193974095 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f87a00662b0 0x7f87a0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:10.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.260+0000 7f87bcff9640 1 -- 172.21.15.53:0/193974095 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f87a8087070 con 0x7f87c01f2fc0 2023-06-10T19:01:10.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.260+0000 7f87bffff640 1 --2- 172.21.15.53:0/193974095 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f87a00662b0 0x7f87a0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:10.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.264+0000 7f87bffff640 1 --2- 172.21.15.53:0/193974095 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f87a00662b0 0x7f87a0068760 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f87b0007520 tx=0x7f87b000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:10.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.264+0000 7f87bcff9640 1 -- 172.21.15.53:0/193974095 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f87c00c5290 con 0x7f87c01f2fc0 2023-06-10T19:01:10.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.460+0000 7f87c631d640 1 -- 172.21.15.53:0/193974095 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f87c00c5220 con 0x7f87c01f2fc0 2023-06-10T19:01:10.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.460+0000 7f87bcff9640 1 -- 172.21.15.53:0/193974095 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4683 (secure 0 0 0) 0x7f87a8054490 con 0x7f87c01f2fc0 2023-06-10T19:01:10.467 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:01:10.467 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":38,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5663,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2600814414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2600814414},{"type":"v1","addr":"172.21.15.117:6835","nonce":2600814414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6136,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1615882017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1615882017},{"type":"v1","addr":"172.21.15.117:6837","nonce":1615882017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6993,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/3732245174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3732245174},{"type":"v1","addr":"172.21.15.53:6833","nonce":3732245174}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:00:20.607950+0000","modified":"2023-06-10T19:00:49.023162+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7266":{"gid":7266,"name":"c","rank":0,"incarnation":37,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.53:6835/2829993338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2829993338},{"type":"v1","addr":"172.21.15.53:6835","nonce":2829993338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-06-10T19:01:10.467 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 38 2023-06-10T19:01:10.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.464+0000 7f87c631d640 1 -- 172.21.15.53:0/193974095 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f87a00662b0 msgr2=0x7f87a0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:10.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.464+0000 7f87c631d640 1 --2- 172.21.15.53:0/193974095 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f87a00662b0 0x7f87a0068760 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f87b0007520 tx=0x7f87b000b040 comp rx=0 tx=0).stop 2023-06-10T19:01:10.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.464+0000 7f87c631d640 1 -- 172.21.15.53:0/193974095 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87c01f2fc0 msgr2=0x7f87c01f2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:10.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.464+0000 7f87c631d640 1 --2- 172.21.15.53:0/193974095 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87c01f2fc0 0x7f87c01f2530 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f87a8001cc0 tx=0x7f87a8011d10 comp rx=0 tx=0).stop 2023-06-10T19:01:10.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.464+0000 7f87c631d640 1 -- 172.21.15.53:0/193974095 shutdown_connections 2023-06-10T19:01:10.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.464+0000 7f87c631d640 1 --2- 172.21.15.53:0/193974095 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f87a00662b0 0x7f87a0068760 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:10.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.464+0000 7f87c631d640 1 --2- 172.21.15.53:0/193974095 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f87c01ee1b0 0x7f87c01ee650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:10.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.464+0000 7f87c631d640 1 --2- 172.21.15.53:0/193974095 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87c01f2fc0 0x7f87c01f2530 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:10.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.464+0000 7f87c631d640 1 --2- 172.21.15.53:0/193974095 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87ac004d10 0x7f87c00c21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:10.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.464+0000 7f87c631d640 1 -- 172.21.15.53:0/193974095 >> 172.21.15.53:0/193974095 conn(0x7f87c006a0d0 msgr2=0x7f87c00c9090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:10.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.464+0000 7f87c631d640 1 -- 172.21.15.53:0/193974095 shutdown_connections 2023-06-10T19:01:10.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:10.464+0000 7f87c631d640 1 -- 172.21.15.53:0/193974095 wait complete. 2023-06-10T19:01:10.486 DEBUG:tasks.cephfs.filesystem:mapped states ['up:reconnect'] to None 2023-06-10T19:01:11.487 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:01:11.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.616+0000 7f238904e640 1 Processor -- start 2023-06-10T19:01:11.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.616+0000 7f238904e640 1 -- start start 2023-06-10T19:01:11.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.616+0000 7f238904e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23840c9840 0x7f23840c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:11.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.616+0000 7f238904e640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2384159b50 con 0x7f2384071060 2023-06-10T19:01:11.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.616+0000 7f238904e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23840ca150 con 0x7f238406b090 2023-06-10T19:01:11.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.616+0000 7f238904e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23840702a0 con 0x7f23840c9840 2023-06-10T19:01:11.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.616+0000 7f238259c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f2384071060 0x7f23840af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:38260/0 (socket says 172.21.15.53:38260) 2023-06-10T19:01:11.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.616+0000 7f238259c640 1 -- 172.21.15.53:0/802557774 learned_addr learned my addr 172.21.15.53:0/802557774 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:01:11.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.616+0000 7f2382d9d640 1 --2- 172.21.15.53:0/802557774 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23840c9840 0x7f23840c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:11.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.616+0000 7f2381d9b640 1 -- 172.21.15.53:0/802557774 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2443615625 0 0) 0x7f2384159b50 con 0x7f2384071060 2023-06-10T19:01:11.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.616+0000 7f2381d9b640 1 -- 172.21.15.53:0/802557774 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f236c003530 con 0x7f2384071060 2023-06-10T19:01:11.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.616+0000 7f2381d9b640 1 -- 172.21.15.53:0/802557774 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2322843030 0 0) 0x7f236c003530 con 0x7f2384071060 2023-06-10T19:01:11.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.616+0000 7f2381d9b640 1 -- 172.21.15.53:0/802557774 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23840c9840 msgr2=0x7f23840c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:11.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.616+0000 7f2381d9b640 1 --2- 172.21.15.53:0/802557774 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23840c9840 0x7f23840c9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:11.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.616+0000 7f2381d9b640 1 -- 172.21.15.53:0/802557774 >> v1:172.21.15.117:6789/0 conn(0x7f238406b090 legacy=0x7f238406b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:11.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.616+0000 7f2381d9b640 1 -- 172.21.15.53:0/802557774 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2384070580 con 0x7f2384071060 2023-06-10T19:01:11.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.616+0000 7f2381d9b640 1 -- 172.21.15.53:0/802557774 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f2378001680 con 0x7f2384071060 2023-06-10T19:01:11.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.616+0000 7f2381d9b640 1 -- 172.21.15.53:0/802557774 >> v1:172.21.15.53:6789/0 conn(0x7f2384071060 legacy=0x7f23840af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:11.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.616+0000 7f2381d9b640 1 --2- 172.21.15.53:0/802557774 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23840c9840 0x7f236c003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:11.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.616+0000 7f2381d9b640 1 --2- 172.21.15.53:0/802557774 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f236c003fa0 0x7f236c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:11.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.616+0000 7f2381d9b640 1 --2- 172.21.15.53:0/802557774 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f236c004d10 0x7f236c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:11.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.616+0000 7f2381d9b640 1 -- 172.21.15.53:0/802557774 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23840702a0 con 0x7f236c004d10 2023-06-10T19:01:11.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.616+0000 7f2381d9b640 1 -- 172.21.15.53:0/802557774 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f236c00bad0 con 0x7f236c003fa0 2023-06-10T19:01:11.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.616+0000 7f2381d9b640 1 -- 172.21.15.53:0/802557774 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f236c00bc90 con 0x7f23840c9840 2023-06-10T19:01:11.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.616+0000 7f238359e640 1 --2- 172.21.15.53:0/802557774 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f236c004d10 0x7f236c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:11.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.616+0000 7f2382d9d640 1 --2- 172.21.15.53:0/802557774 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23840c9840 0x7f236c003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:11.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.616+0000 7f238259c640 1 --2- 172.21.15.53:0/802557774 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f236c003fa0 0x7f236c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:11.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.616+0000 7f238359e640 1 -- 172.21.15.53:0/802557774 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23840c9840 msgr2=0x7f236c003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:11.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.616+0000 7f238359e640 1 --2- 172.21.15.53:0/802557774 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23840c9840 0x7f236c003a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:11.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.616+0000 7f238359e640 1 -- 172.21.15.53:0/802557774 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f236c003fa0 msgr2=0x7f236c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:11.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.616+0000 7f238359e640 1 --2- 172.21.15.53:0/802557774 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f236c003fa0 0x7f236c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:11.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.616+0000 7f238359e640 1 -- 172.21.15.53:0/802557774 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f236c003530 con 0x7f236c004d10 2023-06-10T19:01:11.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.620+0000 7f238359e640 1 --2- 172.21.15.53:0/802557774 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f236c004d10 0x7f236c005180 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f237c001e70 tx=0x7f237c01c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c09ed4f8f4f9c13 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:11.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.620+0000 7f2381d9b640 1 -- 172.21.15.53:0/802557774 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237c003b80 con 0x7f236c004d10 2023-06-10T19:01:11.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.620+0000 7f2381d9b640 1 -- 172.21.15.53:0/802557774 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f237c003ce0 con 0x7f236c004d10 2023-06-10T19:01:11.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.620+0000 7f2381d9b640 1 -- 172.21.15.53:0/802557774 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237c0052c0 con 0x7f236c004d10 2023-06-10T19:01:11.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.620+0000 7f238904e640 1 -- 172.21.15.53:0/802557774 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f236c004d10 msgr2=0x7f236c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:11.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.620+0000 7f238904e640 1 --2- 172.21.15.53:0/802557774 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f236c004d10 0x7f236c005180 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f237c001e70 tx=0x7f237c01c760 comp rx=0 tx=0).stop 2023-06-10T19:01:11.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.620+0000 7f238359e640 1 -- 172.21.15.53:0/802557774 reap_dead start 2023-06-10T19:01:11.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.620+0000 7f238904e640 1 -- 172.21.15.53:0/802557774 shutdown_connections 2023-06-10T19:01:11.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.620+0000 7f238904e640 1 -- 172.21.15.53:0/802557774 >> 172.21.15.53:0/802557774 conn(0x7f238406a0d0 msgr2=0x7f23840ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:11.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.620+0000 7f238904e640 1 -- 172.21.15.53:0/802557774 shutdown_connections 2023-06-10T19:01:11.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.620+0000 7f238904e640 1 -- 172.21.15.53:0/802557774 wait complete. 2023-06-10T19:01:11.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.620+0000 7f238904e640 1 Processor -- start 2023-06-10T19:01:11.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.620+0000 7f238904e640 1 -- start start 2023-06-10T19:01:11.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.624+0000 7f238904e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23840c7630 0x7f23840cca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:11.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.624+0000 7f238904e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23840ccf90 0x7f23841f4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:11.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.624+0000 7f238904e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f23841f5210 0x7f23840c6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:11.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.624+0000 7f238904e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23841f5650 con 0x7f23841f5210 2023-06-10T19:01:11.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.624+0000 7f238904e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23840cc6a0 con 0x7f23840ccf90 2023-06-10T19:01:11.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.624+0000 7f238904e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23841f2940 con 0x7f23840c7630 2023-06-10T19:01:11.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.624+0000 7f238359e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f23841f5210 0x7f23840c6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:11.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.624+0000 7f238359e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f23841f5210 0x7f23840c6190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33892/0 (socket says 172.21.15.53:33892) 2023-06-10T19:01:11.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.624+0000 7f238359e640 1 -- 172.21.15.53:0/3967144123 learned_addr learned my addr 172.21.15.53:0/3967144123 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:11.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.624+0000 7f2382d9d640 1 --2- 172.21.15.53:0/3967144123 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23840c7630 0x7f23840cca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:11.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.624+0000 7f238259c640 1 --2- 172.21.15.53:0/3967144123 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23840ccf90 0x7f23841f4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:11.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.624+0000 7f238359e640 1 -- 172.21.15.53:0/3967144123 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23840c7630 msgr2=0x7f23840cca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:11.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.624+0000 7f238359e640 1 --2- 172.21.15.53:0/3967144123 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23840c7630 0x7f23840cca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:11.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.624+0000 7f238359e640 1 -- 172.21.15.53:0/3967144123 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23840ccf90 msgr2=0x7f23841f4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:11.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.624+0000 7f238359e640 1 --2- 172.21.15.53:0/3967144123 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23840ccf90 0x7f23841f4cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:11.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.624+0000 7f238359e640 1 -- 172.21.15.53:0/3967144123 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23841f2c20 con 0x7f23841f5210 2023-06-10T19:01:11.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.624+0000 7f238259c640 1 --2- 172.21.15.53:0/3967144123 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23840ccf90 0x7f23841f4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:01:11.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.624+0000 7f238359e640 1 --2- 172.21.15.53:0/3967144123 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f23841f5210 0x7f23840c6190 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f237c01cc40 tx=0x7f236c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:11.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.624+0000 7f236b7fe640 1 -- 172.21.15.53:0/3967144123 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237c006d60 con 0x7f23841f5210 2023-06-10T19:01:11.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.624+0000 7f236b7fe640 1 -- 172.21.15.53:0/3967144123 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f237c007dc0 con 0x7f23841f5210 2023-06-10T19:01:11.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.624+0000 7f238904e640 1 -- 172.21.15.53:0/3967144123 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23841f2f00 con 0x7f23841f5210 2023-06-10T19:01:11.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.624+0000 7f236b7fe640 1 -- 172.21.15.53:0/3967144123 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237c007230 con 0x7f23841f5210 2023-06-10T19:01:11.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.624+0000 7f238904e640 1 -- 172.21.15.53:0/3967144123 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23841f34c0 con 0x7f23841f5210 2023-06-10T19:01:11.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.624+0000 7f238904e640 1 -- 172.21.15.53:0/3967144123 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23841f36e0 con 0x7f23841f5210 2023-06-10T19:01:11.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.624+0000 7f236b7fe640 1 -- 172.21.15.53:0/3967144123 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f237c007390 con 0x7f23841f5210 2023-06-10T19:01:11.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.624+0000 7f236b7fe640 1 --2- 172.21.15.53:0/3967144123 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f23700662b0 0x7f2370068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:11.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.624+0000 7f236b7fe640 1 -- 172.21.15.53:0/3967144123 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f237c11d020 con 0x7f23841f5210 2023-06-10T19:01:11.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.624+0000 7f2382d9d640 1 --2- 172.21.15.53:0/3967144123 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f23700662b0 0x7f2370068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:11.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.628+0000 7f2382d9d640 1 --2- 172.21.15.53:0/3967144123 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f23700662b0 0x7f2370068760 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f23840c1440 tx=0x7f2374008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:11.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.628+0000 7f236b7fe640 1 -- 172.21.15.53:0/3967144123 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f237c0ea3b0 con 0x7f23841f5210 2023-06-10T19:01:11.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.812+0000 7f238904e640 1 -- 172.21.15.53:0/3967144123 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f23841f5650 con 0x7f23841f5210 2023-06-10T19:01:11.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.816+0000 7f236b7fe640 1 -- 172.21.15.53:0/3967144123 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4683 (secure 0 0 0) 0x7f237c0b8070 con 0x7f23841f5210 2023-06-10T19:01:11.820 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:01:11.820 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":38,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5663,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2600814414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2600814414},{"type":"v1","addr":"172.21.15.117:6835","nonce":2600814414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6136,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1615882017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1615882017},{"type":"v1","addr":"172.21.15.117:6837","nonce":1615882017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6993,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/3732245174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3732245174},{"type":"v1","addr":"172.21.15.53:6833","nonce":3732245174}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:00:20.607950+0000","modified":"2023-06-10T19:00:49.023162+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7266":{"gid":7266,"name":"c","rank":0,"incarnation":37,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.53:6835/2829993338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2829993338},{"type":"v1","addr":"172.21.15.53:6835","nonce":2829993338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-06-10T19:01:11.821 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 38 2023-06-10T19:01:11.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.816+0000 7f238904e640 1 -- 172.21.15.53:0/3967144123 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f23700662b0 msgr2=0x7f2370068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:11.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.816+0000 7f238904e640 1 --2- 172.21.15.53:0/3967144123 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f23700662b0 0x7f2370068760 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f23840c1440 tx=0x7f2374008040 comp rx=0 tx=0).stop 2023-06-10T19:01:11.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.816+0000 7f238904e640 1 -- 172.21.15.53:0/3967144123 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f23841f5210 msgr2=0x7f23840c6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:11.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.816+0000 7f238904e640 1 --2- 172.21.15.53:0/3967144123 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f23841f5210 0x7f23840c6190 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f237c01cc40 tx=0x7f236c005800 comp rx=0 tx=0).stop 2023-06-10T19:01:11.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.816+0000 7f238904e640 1 -- 172.21.15.53:0/3967144123 shutdown_connections 2023-06-10T19:01:11.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.816+0000 7f238904e640 1 --2- 172.21.15.53:0/3967144123 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f23700662b0 0x7f2370068760 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:11.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.816+0000 7f238904e640 1 --2- 172.21.15.53:0/3967144123 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f23841f5210 0x7f23840c6190 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:11.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.816+0000 7f238904e640 1 --2- 172.21.15.53:0/3967144123 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23840ccf90 0x7f23841f4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:11.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.816+0000 7f238904e640 1 --2- 172.21.15.53:0/3967144123 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f23840c7630 0x7f23840cca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:11.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.816+0000 7f238904e640 1 -- 172.21.15.53:0/3967144123 >> 172.21.15.53:0/3967144123 conn(0x7f238406a0d0 msgr2=0x7f23840ca370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:11.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.816+0000 7f238904e640 1 -- 172.21.15.53:0/3967144123 shutdown_connections 2023-06-10T19:01:11.824 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:11.816+0000 7f238904e640 1 -- 172.21.15.53:0/3967144123 wait complete. 2023-06-10T19:01:11.838 DEBUG:tasks.cephfs.filesystem:mapped states ['up:reconnect'] to None 2023-06-10T19:01:12.839 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:01:12.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:12.968+0000 7f8dd4a60640 1 Processor -- start 2023-06-10T19:01:12.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:12.968+0000 7f8dd4a60640 1 -- start start 2023-06-10T19:01:12.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:12.968+0000 7f8dd4a60640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8dd015c810 0x7f8dd00cd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:12.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:12.968+0000 7f8dd4a60640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dd00cc6c0 con 0x7f8dd015ba70 2023-06-10T19:01:12.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:12.968+0000 7f8dd4a60640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dd00cc9a0 con 0x7f8dd00cbfc0 2023-06-10T19:01:12.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:12.968+0000 7f8dd4a60640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dd00ccc80 con 0x7f8dd015c810 2023-06-10T19:01:12.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:12.968+0000 7f8dce59c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f8dd015ba70 0x7f8dd015c100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:38272/0 (socket says 172.21.15.53:38272) 2023-06-10T19:01:12.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:12.968+0000 7f8dce59c640 1 -- 172.21.15.53:0/174292148 learned_addr learned my addr 172.21.15.53:0/174292148 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:01:12.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:12.968+0000 7f8dcdd9b640 1 --2- 172.21.15.53:0/174292148 >> v2:172.21.15.53:3300/0 conn(0x7f8dd015c810 0x7f8dd00cd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:12.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:12.968+0000 7f8dcd59a640 1 -- 172.21.15.53:0/174292148 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2068645705 0 0) 0x7f8dd00cc6c0 con 0x7f8dd015ba70 2023-06-10T19:01:12.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:12.968+0000 7f8dcd59a640 1 -- 172.21.15.53:0/174292148 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8db8005740 con 0x7f8dd015ba70 2023-06-10T19:01:12.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:12.968+0000 7f8dcdd9b640 1 -- 172.21.15.53:0/174292148 >> v1:172.21.15.117:6789/0 conn(0x7f8dd00cbfc0 legacy=0x7f8dd006efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:12.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:12.968+0000 7f8dcdd9b640 1 -- 172.21.15.53:0/174292148 >> v1:172.21.15.53:6789/0 conn(0x7f8dd015ba70 legacy=0x7f8dd015c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:12.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:12.968+0000 7f8dcdd9b640 1 -- 172.21.15.53:0/174292148 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dd00ccf60 con 0x7f8dd015c810 2023-06-10T19:01:12.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:12.972+0000 7f8dcdd9b640 1 --2- 172.21.15.53:0/174292148 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8dd015c810 0x7f8dd00cd760 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f8dc40097c0 tx=0x7f8dc401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c67308823aa5028 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:12.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:12.972+0000 7f8dcd59a640 1 -- 172.21.15.53:0/174292148 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc40ac600 con 0x7f8dd015c810 2023-06-10T19:01:12.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:12.972+0000 7f8dcd59a640 1 -- 172.21.15.53:0/174292148 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dc40a8050 con 0x7f8dd015c810 2023-06-10T19:01:12.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:12.972+0000 7f8dcd59a640 1 -- 172.21.15.53:0/174292148 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc40ac980 con 0x7f8dd015c810 2023-06-10T19:01:12.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:12.972+0000 7f8dd4a60640 1 -- 172.21.15.53:0/174292148 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8dd015c810 msgr2=0x7f8dd00cd760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:12.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:12.972+0000 7f8dd4a60640 1 --2- 172.21.15.53:0/174292148 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8dd015c810 0x7f8dd00cd760 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f8dc40097c0 tx=0x7f8dc401c3c0 comp rx=0 tx=0).stop 2023-06-10T19:01:12.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:12.972+0000 7f8dd4a60640 1 -- 172.21.15.53:0/174292148 shutdown_connections 2023-06-10T19:01:12.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:12.972+0000 7f8dd4a60640 1 --2- 172.21.15.53:0/174292148 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8dd015c810 0x7f8dd00cd760 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:12.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:12.972+0000 7f8dd4a60640 1 -- 172.21.15.53:0/174292148 >> 172.21.15.53:0/174292148 conn(0x7f8dd006a0d0 msgr2=0x7f8dd00ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:12.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:12.972+0000 7f8dd4a60640 1 -- 172.21.15.53:0/174292148 shutdown_connections 2023-06-10T19:01:12.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:12.972+0000 7f8dd4a60640 1 -- 172.21.15.53:0/174292148 wait complete. 2023-06-10T19:01:12.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:12.972+0000 7f8dd4a60640 1 Processor -- start 2023-06-10T19:01:12.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:12.972+0000 7f8dd4a60640 1 -- start start 2023-06-10T19:01:12.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:12.972+0000 7f8dd4a60640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8dd00cbfc0 0x7f8dd015ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:12.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:12.972+0000 7f8dd4a60640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8dd015ba70 0x7f8dd014b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:12.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:12.972+0000 7f8dd4a60640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8dd015c810 0x7f8dd0159310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:12.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:12.972+0000 7f8dd4a60640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd0159cf0 con 0x7f8dd015c810 2023-06-10T19:01:12.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:12.972+0000 7f8dd4a60640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd0159fd0 con 0x7f8dd00cbfc0 2023-06-10T19:01:12.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:12.972+0000 7f8dd4a60640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd015a2b0 con 0x7f8dd015ba70 2023-06-10T19:01:12.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:12.972+0000 7f8dced9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8dd015c810 0x7f8dd0159310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:12.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:12.972+0000 7f8dced9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8dd015c810 0x7f8dd0159310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33910/0 (socket says 172.21.15.53:33910) 2023-06-10T19:01:12.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:12.972+0000 7f8dced9d640 1 -- 172.21.15.53:0/2339793374 learned_addr learned my addr 172.21.15.53:0/2339793374 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:12.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:12.976+0000 7f8dcdd9b640 1 --2- 172.21.15.53:0/2339793374 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8dd015ba70 0x7f8dd014b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:12.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:12.976+0000 7f8dce59c640 1 --2- 172.21.15.53:0/2339793374 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8dd00cbfc0 0x7f8dd015ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:12.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:12.976+0000 7f8dced9d640 1 -- 172.21.15.53:0/2339793374 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8dd015ba70 msgr2=0x7f8dd014b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:12.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:12.976+0000 7f8dced9d640 1 --2- 172.21.15.53:0/2339793374 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8dd015ba70 0x7f8dd014b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:12.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:12.976+0000 7f8dced9d640 1 -- 172.21.15.53:0/2339793374 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8dd00cbfc0 msgr2=0x7f8dd015ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:12.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:12.976+0000 7f8dced9d640 1 --2- 172.21.15.53:0/2339793374 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8dd00cbfc0 0x7f8dd015ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:12.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:12.976+0000 7f8dced9d640 1 -- 172.21.15.53:0/2339793374 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dc4009420 con 0x7f8dd015c810 2023-06-10T19:01:12.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:12.976+0000 7f8dcdd9b640 1 --2- 172.21.15.53:0/2339793374 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8dd015ba70 0x7f8dd014b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:01:12.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:12.976+0000 7f8dced9d640 1 --2- 172.21.15.53:0/2339793374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8dd015c810 0x7f8dd0159310 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f8dc800c770 tx=0x7f8dc800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:12.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:12.976+0000 7f8dbeffd640 1 -- 172.21.15.53:0/2339793374 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc8003b80 con 0x7f8dd015c810 2023-06-10T19:01:12.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:12.976+0000 7f8dbeffd640 1 -- 172.21.15.53:0/2339793374 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dc8003ce0 con 0x7f8dd015c810 2023-06-10T19:01:12.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:12.976+0000 7f8dd4a60640 1 -- 172.21.15.53:0/2339793374 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dd015a590 con 0x7f8dd015c810 2023-06-10T19:01:12.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:12.976+0000 7f8dbeffd640 1 -- 172.21.15.53:0/2339793374 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc800aa90 con 0x7f8dd015c810 2023-06-10T19:01:12.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:12.976+0000 7f8dd4a60640 1 -- 172.21.15.53:0/2339793374 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dd014ba40 con 0x7f8dd015c810 2023-06-10T19:01:12.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:12.976+0000 7f8dd4a60640 1 -- 172.21.15.53:0/2339793374 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dd00ca040 con 0x7f8dd015c810 2023-06-10T19:01:12.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:12.976+0000 7f8dbeffd640 1 -- 172.21.15.53:0/2339793374 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8dc800abf0 con 0x7f8dd015c810 2023-06-10T19:01:12.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:12.976+0000 7f8dbeffd640 1 --2- 172.21.15.53:0/2339793374 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8db0066280 0x7f8db0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:12.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:12.976+0000 7f8dbeffd640 1 -- 172.21.15.53:0/2339793374 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f8dc8084580 con 0x7f8dd015c810 2023-06-10T19:01:12.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:12.976+0000 7f8dce59c640 1 --2- 172.21.15.53:0/2339793374 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8db0066280 0x7f8db0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:12.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:12.980+0000 7f8dce59c640 1 --2- 172.21.15.53:0/2339793374 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8db0066280 0x7f8db0068730 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f8dc00011f0 tx=0x7f8dc0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:12.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:12.980+0000 7f8dbeffd640 1 -- 172.21.15.53:0/2339793374 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8dc8051b10 con 0x7f8dd015c810 2023-06-10T19:01:13.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:13.168+0000 7f8dd4a60640 1 -- 172.21.15.53:0/2339793374 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8dd004d790 con 0x7f8dd015c810 2023-06-10T19:01:13.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:13.168+0000 7f8dbeffd640 1 -- 172.21.15.53:0/2339793374 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4683 (secure 0 0 0) 0x7f8dc8055130 con 0x7f8dd015c810 2023-06-10T19:01:13.174 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:01:13.174 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":38,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5663,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2600814414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2600814414},{"type":"v1","addr":"172.21.15.117:6835","nonce":2600814414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6136,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1615882017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1615882017},{"type":"v1","addr":"172.21.15.117:6837","nonce":1615882017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6993,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/3732245174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3732245174},{"type":"v1","addr":"172.21.15.53:6833","nonce":3732245174}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:00:20.607950+0000","modified":"2023-06-10T19:00:49.023162+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7266":{"gid":7266,"name":"c","rank":0,"incarnation":37,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.53:6835/2829993338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2829993338},{"type":"v1","addr":"172.21.15.53:6835","nonce":2829993338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-06-10T19:01:13.174 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 38 2023-06-10T19:01:13.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:13.172+0000 7f8dd4a60640 1 -- 172.21.15.53:0/2339793374 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8db0066280 msgr2=0x7f8db0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:13.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:13.172+0000 7f8dd4a60640 1 --2- 172.21.15.53:0/2339793374 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8db0066280 0x7f8db0068730 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f8dc00011f0 tx=0x7f8dc0009040 comp rx=0 tx=0).stop 2023-06-10T19:01:13.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:13.172+0000 7f8dd4a60640 1 -- 172.21.15.53:0/2339793374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8dd015c810 msgr2=0x7f8dd0159310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:13.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:13.172+0000 7f8dd4a60640 1 --2- 172.21.15.53:0/2339793374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8dd015c810 0x7f8dd0159310 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f8dc800c770 tx=0x7f8dc800cc30 comp rx=0 tx=0).stop 2023-06-10T19:01:13.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:13.172+0000 7f8dd4a60640 1 -- 172.21.15.53:0/2339793374 shutdown_connections 2023-06-10T19:01:13.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:13.172+0000 7f8dd4a60640 1 --2- 172.21.15.53:0/2339793374 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8db0066280 0x7f8db0068730 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:13.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:13.172+0000 7f8dd4a60640 1 --2- 172.21.15.53:0/2339793374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8dd015c810 0x7f8dd0159310 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:13.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:13.172+0000 7f8dd4a60640 1 --2- 172.21.15.53:0/2339793374 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8dd015ba70 0x7f8dd014b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:13.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:13.172+0000 7f8dd4a60640 1 --2- 172.21.15.53:0/2339793374 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8dd00cbfc0 0x7f8dd015ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:13.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:13.172+0000 7f8dd4a60640 1 -- 172.21.15.53:0/2339793374 >> 172.21.15.53:0/2339793374 conn(0x7f8dd006a0d0 msgr2=0x7f8dd00aef80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:13.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:13.172+0000 7f8dd4a60640 1 -- 172.21.15.53:0/2339793374 shutdown_connections 2023-06-10T19:01:13.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:13.172+0000 7f8dd4a60640 1 -- 172.21.15.53:0/2339793374 wait complete. 2023-06-10T19:01:13.194 DEBUG:tasks.cephfs.filesystem:mapped states ['up:reconnect'] to None 2023-06-10T19:01:14.195 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:01:14.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.324+0000 7fea8049b640 1 Processor -- start 2023-06-10T19:01:14.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.324+0000 7fea8049b640 1 -- start start 2023-06-10T19:01:14.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.328+0000 7fea8049b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fea7815c7f0 0x7fea7815f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:14.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.328+0000 7fea8049b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea7815f860 0x7fea780ceb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:14.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.328+0000 7fea8049b640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea7815cc40 con 0x7fea7806b780 2023-06-10T19:01:14.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.328+0000 7fea8049b640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea7815c3d0 con 0x7fea7815c7f0 2023-06-10T19:01:14.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.328+0000 7fea8049b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea780af530 con 0x7fea7815f860 2023-06-10T19:01:14.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.328+0000 7fea7e237640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fea7806b780 0x7fea7806bb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:38276/0 (socket says 172.21.15.53:38276) 2023-06-10T19:01:14.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.328+0000 7fea7e237640 1 -- 172.21.15.53:0/1059940629 learned_addr learned my addr 172.21.15.53:0/1059940629 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:01:14.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.328+0000 7fea7ea38640 1 --2- 172.21.15.53:0/1059940629 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea7815f860 0x7fea780ceb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:14.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.328+0000 7fea7da36640 1 --2- 172.21.15.53:0/1059940629 >> v2:172.21.15.117:3300/0 conn(0x7fea7815c7f0 0x7fea7815f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:14.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.328+0000 7fea7d235640 1 -- 172.21.15.53:0/1059940629 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 357925945 0 0) 0x7fea7815cc40 con 0x7fea7806b780 2023-06-10T19:01:14.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.328+0000 7fea7d235640 1 -- 172.21.15.53:0/1059940629 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea64003530 con 0x7fea7806b780 2023-06-10T19:01:14.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.328+0000 7fea7d235640 1 -- 172.21.15.53:0/1059940629 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 328011707 0 0) 0x7fea64003530 con 0x7fea7806b780 2023-06-10T19:01:14.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.328+0000 7fea7d235640 1 -- 172.21.15.53:0/1059940629 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea7815f860 msgr2=0x7fea780ceb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:14.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.328+0000 7fea7d235640 1 --2- 172.21.15.53:0/1059940629 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea7815f860 0x7fea780ceb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:14.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.328+0000 7fea7d235640 1 -- 172.21.15.53:0/1059940629 >> v2:172.21.15.117:3300/0 conn(0x7fea7815c7f0 msgr2=0x7fea7815f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:14.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.328+0000 7fea7d235640 1 --2- 172.21.15.53:0/1059940629 >> v2:172.21.15.117:3300/0 conn(0x7fea7815c7f0 0x7fea7815f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:14.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.328+0000 7fea7d235640 1 -- 172.21.15.53:0/1059940629 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea7815fd70 con 0x7fea7806b780 2023-06-10T19:01:14.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.328+0000 7fea7d235640 1 -- 172.21.15.53:0/1059940629 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fea74001680 con 0x7fea7806b780 2023-06-10T19:01:14.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.328+0000 7fea7d235640 1 -- 172.21.15.53:0/1059940629 >> v1:172.21.15.53:6789/0 conn(0x7fea7806b780 legacy=0x7fea7806bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:14.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.328+0000 7fea7d235640 1 --2- 172.21.15.53:0/1059940629 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea640039f0 0x7fea64003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:14.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.328+0000 7fea7d235640 1 --2- 172.21.15.53:0/1059940629 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea7815f860 0x7fea640047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:14.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.328+0000 7fea7d235640 1 --2- 172.21.15.53:0/1059940629 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea64004d10 0x7fea64005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:14.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.328+0000 7fea7d235640 1 -- 172.21.15.53:0/1059940629 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea7815c3d0 con 0x7fea64004d10 2023-06-10T19:01:14.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.328+0000 7fea7d235640 1 -- 172.21.15.53:0/1059940629 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea780af530 con 0x7fea640039f0 2023-06-10T19:01:14.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.328+0000 7fea7d235640 1 -- 172.21.15.53:0/1059940629 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea6400ba10 con 0x7fea7815f860 2023-06-10T19:01:14.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.328+0000 7fea7ea38640 1 --2- 172.21.15.53:0/1059940629 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea64004d10 0x7fea64005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:14.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.328+0000 7fea7da36640 1 --2- 172.21.15.53:0/1059940629 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea7815f860 0x7fea640047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:14.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.328+0000 7fea7e237640 1 --2- 172.21.15.53:0/1059940629 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea640039f0 0x7fea64003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:14.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.328+0000 7fea7ea38640 1 -- 172.21.15.53:0/1059940629 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea7815f860 msgr2=0x7fea640047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:14.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.328+0000 7fea7ea38640 1 --2- 172.21.15.53:0/1059940629 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea7815f860 0x7fea640047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:14.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.328+0000 7fea7ea38640 1 -- 172.21.15.53:0/1059940629 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea640039f0 msgr2=0x7fea64003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:14.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.328+0000 7fea7ea38640 1 --2- 172.21.15.53:0/1059940629 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea640039f0 0x7fea64003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:14.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.328+0000 7fea7ea38640 1 -- 172.21.15.53:0/1059940629 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea64003530 con 0x7fea64004d10 2023-06-10T19:01:14.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.328+0000 7fea7e237640 1 --2- 172.21.15.53:0/1059940629 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea640039f0 0x7fea64003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:01:14.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.332+0000 7fea7ea38640 1 --2- 172.21.15.53:0/1059940629 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea64004d10 0x7fea64005180 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7fea70009f90 tx=0x7fea7001cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=166d049044d99bed server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:14.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.332+0000 7fea7d235640 1 -- 172.21.15.53:0/1059940629 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea700a5b20 con 0x7fea64004d10 2023-06-10T19:01:14.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.332+0000 7fea7d235640 1 -- 172.21.15.53:0/1059940629 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea7000f040 con 0x7fea64004d10 2023-06-10T19:01:14.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.332+0000 7fea7d235640 1 -- 172.21.15.53:0/1059940629 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea700ad440 con 0x7fea64004d10 2023-06-10T19:01:14.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.332+0000 7fea8049b640 1 -- 172.21.15.53:0/1059940629 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea64004d10 msgr2=0x7fea64005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:14.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.332+0000 7fea8049b640 1 --2- 172.21.15.53:0/1059940629 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea64004d10 0x7fea64005180 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7fea70009f90 tx=0x7fea7001cc20 comp rx=0 tx=0).stop 2023-06-10T19:01:14.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.332+0000 7fea7ea38640 1 -- 172.21.15.53:0/1059940629 reap_dead start 2023-06-10T19:01:14.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.332+0000 7fea8049b640 1 -- 172.21.15.53:0/1059940629 shutdown_connections 2023-06-10T19:01:14.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.332+0000 7fea8049b640 1 -- 172.21.15.53:0/1059940629 >> 172.21.15.53:0/1059940629 conn(0x7fea7806a090 msgr2=0x7fea7806d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:14.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.332+0000 7fea8049b640 1 -- 172.21.15.53:0/1059940629 shutdown_connections 2023-06-10T19:01:14.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.332+0000 7fea8049b640 1 -- 172.21.15.53:0/1059940629 wait complete. 2023-06-10T19:01:14.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.332+0000 7fea8049b640 1 Processor -- start 2023-06-10T19:01:14.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.332+0000 7fea8049b640 1 -- start start 2023-06-10T19:01:14.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.332+0000 7fea8049b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea64004d10 0x7fea781f0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:14.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.332+0000 7fea8049b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea780b4560 0x7fea780b49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:14.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.332+0000 7fea8049b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea780b4f10 0x7fea780b3130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:14.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.332+0000 7fea8049b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea780b5380 con 0x7fea64004d10 2023-06-10T19:01:14.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.332+0000 7fea8049b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea780cae90 con 0x7fea780b4f10 2023-06-10T19:01:14.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.332+0000 7fea8049b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea780cb170 con 0x7fea780b4560 2023-06-10T19:01:14.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.332+0000 7fea7e237640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea64004d10 0x7fea781f0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:14.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.332+0000 7fea7e237640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea64004d10 0x7fea781f0940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33920/0 (socket says 172.21.15.53:33920) 2023-06-10T19:01:14.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.332+0000 7fea7e237640 1 -- 172.21.15.53:0/3299916902 learned_addr learned my addr 172.21.15.53:0/3299916902 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:14.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.332+0000 7fea7da36640 1 --2- 172.21.15.53:0/3299916902 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea780b4560 0x7fea780b49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:14.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.332+0000 7fea7ea38640 1 --2- 172.21.15.53:0/3299916902 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea780b4f10 0x7fea780b3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:14.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.332+0000 7fea7e237640 1 -- 172.21.15.53:0/3299916902 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea780b4560 msgr2=0x7fea780b49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:14.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.332+0000 7fea7e237640 1 --2- 172.21.15.53:0/3299916902 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea780b4560 0x7fea780b49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:14.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.332+0000 7fea7e237640 1 -- 172.21.15.53:0/3299916902 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea780b4f10 msgr2=0x7fea780b3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:14.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.332+0000 7fea7e237640 1 --2- 172.21.15.53:0/3299916902 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea780b4f10 0x7fea780b3130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:14.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.332+0000 7fea7e237640 1 -- 172.21.15.53:0/3299916902 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea780cb450 con 0x7fea64004d10 2023-06-10T19:01:14.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.332+0000 7fea7e237640 1 --2- 172.21.15.53:0/3299916902 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea64004d10 0x7fea781f0940 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7fea74004880 tx=0x7fea7400e4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:14.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.332+0000 7fea6effd640 1 -- 172.21.15.53:0/3299916902 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea7400edb0 con 0x7fea64004d10 2023-06-10T19:01:14.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.332+0000 7fea6effd640 1 -- 172.21.15.53:0/3299916902 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea740143a0 con 0x7fea64004d10 2023-06-10T19:01:14.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.332+0000 7fea6effd640 1 -- 172.21.15.53:0/3299916902 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea74014710 con 0x7fea64004d10 2023-06-10T19:01:14.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.336+0000 7fea8049b640 1 -- 172.21.15.53:0/3299916902 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea780cb730 con 0x7fea64004d10 2023-06-10T19:01:14.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.336+0000 7fea8049b640 1 -- 172.21.15.53:0/3299916902 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea780cbcf0 con 0x7fea64004d10 2023-06-10T19:01:14.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.336+0000 7fea8049b640 1 -- 172.21.15.53:0/3299916902 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea7815bc30 con 0x7fea64004d10 2023-06-10T19:01:14.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.336+0000 7fea6effd640 1 -- 172.21.15.53:0/3299916902 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fea74014870 con 0x7fea64004d10 2023-06-10T19:01:14.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.336+0000 7fea6effd640 1 --2- 172.21.15.53:0/3299916902 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fea5c066280 0x7fea5c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:14.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.336+0000 7fea6effd640 1 -- 172.21.15.53:0/3299916902 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6148+0+0 (secure 0 0 0) 0x7fea74086950 con 0x7fea64004d10 2023-06-10T19:01:14.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.336+0000 7fea7da36640 1 --2- 172.21.15.53:0/3299916902 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fea5c066280 0x7fea5c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:14.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.336+0000 7fea7da36640 1 --2- 172.21.15.53:0/3299916902 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fea5c066280 0x7fea5c068730 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fea780ccb10 tx=0x7fea68008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:14.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.340+0000 7fea6effd640 1 -- 172.21.15.53:0/3299916902 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fea7815bc30 con 0x7fea64004d10 2023-06-10T19:01:14.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.532+0000 7fea8049b640 1 -- 172.21.15.53:0/3299916902 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fea7815bc30 con 0x7fea64004d10 2023-06-10T19:01:14.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.532+0000 7fea6effd640 1 -- 172.21.15.53:0/3299916902 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4683 (secure 0 0 0) 0x7fea7815bc30 con 0x7fea64004d10 2023-06-10T19:01:14.538 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:01:14.538 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":38,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5663,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2600814414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2600814414},{"type":"v1","addr":"172.21.15.117:6835","nonce":2600814414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6136,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1615882017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1615882017},{"type":"v1","addr":"172.21.15.117:6837","nonce":1615882017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6993,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/3732245174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3732245174},{"type":"v1","addr":"172.21.15.53:6833","nonce":3732245174}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:00:20.607950+0000","modified":"2023-06-10T19:00:49.023162+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7266":{"gid":7266,"name":"c","rank":0,"incarnation":37,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.53:6835/2829993338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2829993338},{"type":"v1","addr":"172.21.15.53:6835","nonce":2829993338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-06-10T19:01:14.538 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 38 2023-06-10T19:01:14.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.536+0000 7fea8049b640 1 -- 172.21.15.53:0/3299916902 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fea5c066280 msgr2=0x7fea5c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:14.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.536+0000 7fea8049b640 1 --2- 172.21.15.53:0/3299916902 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fea5c066280 0x7fea5c068730 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fea780ccb10 tx=0x7fea68008040 comp rx=0 tx=0).stop 2023-06-10T19:01:14.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.536+0000 7fea8049b640 1 -- 172.21.15.53:0/3299916902 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea64004d10 msgr2=0x7fea781f0940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:14.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.536+0000 7fea8049b640 1 --2- 172.21.15.53:0/3299916902 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea64004d10 0x7fea781f0940 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7fea74004880 tx=0x7fea7400e4d0 comp rx=0 tx=0).stop 2023-06-10T19:01:14.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.536+0000 7fea8049b640 1 -- 172.21.15.53:0/3299916902 shutdown_connections 2023-06-10T19:01:14.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.536+0000 7fea8049b640 1 --2- 172.21.15.53:0/3299916902 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fea5c066280 0x7fea5c068730 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:14.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.536+0000 7fea8049b640 1 --2- 172.21.15.53:0/3299916902 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea780b4f10 0x7fea780b3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:14.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.536+0000 7fea8049b640 1 --2- 172.21.15.53:0/3299916902 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea780b4560 0x7fea780b49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:14.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.536+0000 7fea8049b640 1 --2- 172.21.15.53:0/3299916902 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea64004d10 0x7fea781f0940 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:14.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.536+0000 7fea8049b640 1 -- 172.21.15.53:0/3299916902 >> 172.21.15.53:0/3299916902 conn(0x7fea7806a090 msgr2=0x7fea7815ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:14.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.536+0000 7fea8049b640 1 -- 172.21.15.53:0/3299916902 shutdown_connections 2023-06-10T19:01:14.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:14.536+0000 7fea8049b640 1 -- 172.21.15.53:0/3299916902 wait complete. 2023-06-10T19:01:14.557 DEBUG:tasks.cephfs.filesystem:mapped states ['up:reconnect'] to None 2023-06-10T19:01:15.559 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:01:15.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:15.692+0000 7fded0a82640 1 Processor -- start 2023-06-10T19:01:15.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:15.692+0000 7fded0a82640 1 -- start start 2023-06-10T19:01:15.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:15.692+0000 7fded0a82640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fdecc071060 0x7fdecc0af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:15.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:15.692+0000 7fded0a82640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fdecc0afc60 0x7fdecc06b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:15.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:15.692+0000 7fded0a82640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdecc159b50 con 0x7fdecc0c9840 2023-06-10T19:01:15.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:15.692+0000 7fded0a82640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdecc0702a0 con 0x7fdecc0afc60 2023-06-10T19:01:15.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:15.692+0000 7fded0a82640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdecc070580 con 0x7fdecc071060 2023-06-10T19:01:15.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:15.696+0000 7fdecad9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fdecc0afc60 0x7fdecc06b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:15.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:15.696+0000 7fdeca59c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fdecc0c9840 0x7fdecc0c9c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:38282/0 (socket says 172.21.15.53:38282) 2023-06-10T19:01:15.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:15.696+0000 7fdeca59c640 1 -- 172.21.15.53:0/3184632089 learned_addr learned my addr 172.21.15.53:0/3184632089 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:01:15.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:15.696+0000 7fdec9d9b640 1 --2- 172.21.15.53:0/3184632089 >> v2:172.21.15.117:3300/0 conn(0x7fdecc071060 0x7fdecc0af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:15.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:15.696+0000 7fdecad9d640 1 -- 172.21.15.53:0/3184632089 >> v2:172.21.15.117:3300/0 conn(0x7fdecc071060 msgr2=0x7fdecc0af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:15.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:15.696+0000 7fdecad9d640 1 --2- 172.21.15.53:0/3184632089 >> v2:172.21.15.117:3300/0 conn(0x7fdecc071060 0x7fdecc0af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:15.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:15.696+0000 7fdecad9d640 1 -- 172.21.15.53:0/3184632089 >> v1:172.21.15.53:6789/0 conn(0x7fdecc0c9840 legacy=0x7fdecc0c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:15.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:15.696+0000 7fdecad9d640 1 -- 172.21.15.53:0/3184632089 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdecc070860 con 0x7fdecc0afc60 2023-06-10T19:01:15.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:15.696+0000 7fdec9d9b640 1 --2- 172.21.15.53:0/3184632089 >> v2:172.21.15.117:3300/0 conn(0x7fdecc071060 0x7fdecc0af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:01:15.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:15.696+0000 7fdec959a640 1 -- 172.21.15.53:0/3184632089 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3900767237 0 0) 0x7fdecc159b50 con 0x7fdecc0c9840 2023-06-10T19:01:15.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:15.696+0000 7fdecad9d640 1 --2- 172.21.15.53:0/3184632089 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdecc0afc60 0x7fdecc06b090 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7fdecc06e650 tx=0x7fdec401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c09b6417b1264b59 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:15.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:15.696+0000 7fdec959a640 1 -- 172.21.15.53:0/3184632089 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec40a59c0 con 0x7fdecc0afc60 2023-06-10T19:01:15.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:15.696+0000 7fdec959a640 1 -- 172.21.15.53:0/3184632089 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdec40a5b20 con 0x7fdecc0afc60 2023-06-10T19:01:15.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:15.696+0000 7fdec959a640 1 -- 172.21.15.53:0/3184632089 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec40ad440 con 0x7fdecc0afc60 2023-06-10T19:01:15.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:15.696+0000 7fded0a82640 1 -- 172.21.15.53:0/3184632089 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdecc0afc60 msgr2=0x7fdecc06b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:15.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:15.696+0000 7fded0a82640 1 --2- 172.21.15.53:0/3184632089 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdecc0afc60 0x7fdecc06b090 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7fdecc06e650 tx=0x7fdec401c8e0 comp rx=0 tx=0).stop 2023-06-10T19:01:15.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:15.696+0000 7fded0a82640 1 -- 172.21.15.53:0/3184632089 shutdown_connections 2023-06-10T19:01:15.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:15.696+0000 7fded0a82640 1 --2- 172.21.15.53:0/3184632089 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdecc0afc60 0x7fdecc06b090 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:15.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:15.696+0000 7fded0a82640 1 --2- 172.21.15.53:0/3184632089 >> v2:172.21.15.117:3300/0 conn(0x7fdecc071060 0x7fdecc0af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:15.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:15.696+0000 7fded0a82640 1 -- 172.21.15.53:0/3184632089 >> 172.21.15.53:0/3184632089 conn(0x7fdecc06a0d0 msgr2=0x7fdecc0ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:15.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:15.696+0000 7fded0a82640 1 -- 172.21.15.53:0/3184632089 shutdown_connections 2023-06-10T19:01:15.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:15.696+0000 7fded0a82640 1 -- 172.21.15.53:0/3184632089 wait complete. 2023-06-10T19:01:15.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:15.700+0000 7fded0a82640 1 Processor -- start 2023-06-10T19:01:15.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:15.700+0000 7fded0a82640 1 -- start start 2023-06-10T19:01:15.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:15.700+0000 7fded0a82640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdecc071060 0x7fdecc14be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:15.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:15.700+0000 7fded0a82640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdecc0afc60 0x7fdecc163210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:15.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:15.700+0000 7fded0a82640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdecc0c9840 0x7fdecc1540f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:15.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:15.700+0000 7fded0a82640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdecc0c1840 con 0x7fdecc071060 2023-06-10T19:01:15.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:15.700+0000 7fded0a82640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdecc0cbbd0 con 0x7fdecc0afc60 2023-06-10T19:01:15.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:15.700+0000 7fded0a82640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdecc14c3b0 con 0x7fdecc0c9840 2023-06-10T19:01:15.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:15.700+0000 7fdeca59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdecc071060 0x7fdecc14be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:15.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:15.700+0000 7fdeca59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdecc071060 0x7fdecc14be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33936/0 (socket says 172.21.15.53:33936) 2023-06-10T19:01:15.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:15.700+0000 7fdeca59c640 1 -- 172.21.15.53:0/3224027423 learned_addr learned my addr 172.21.15.53:0/3224027423 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:15.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:15.700+0000 7fdecad9d640 1 --2- 172.21.15.53:0/3224027423 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdecc0c9840 0x7fdecc1540f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:15.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:15.700+0000 7fdec9d9b640 1 --2- 172.21.15.53:0/3224027423 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdecc0afc60 0x7fdecc163210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:15.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:15.700+0000 7fdeca59c640 1 -- 172.21.15.53:0/3224027423 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdecc0c9840 msgr2=0x7fdecc1540f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:15.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:15.700+0000 7fdeca59c640 1 --2- 172.21.15.53:0/3224027423 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdecc0c9840 0x7fdecc1540f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:15.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:15.700+0000 7fdeca59c640 1 -- 172.21.15.53:0/3224027423 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdecc0afc60 msgr2=0x7fdecc163210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:15.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:15.700+0000 7fdeca59c640 1 --2- 172.21.15.53:0/3224027423 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdecc0afc60 0x7fdecc163210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:15.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:15.700+0000 7fdeca59c640 1 -- 172.21.15.53:0/3224027423 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdec4009a70 con 0x7fdecc071060 2023-06-10T19:01:15.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:15.700+0000 7fdeca59c640 1 --2- 172.21.15.53:0/3224027423 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdecc071060 0x7fdecc14be70 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7fdebc00c480 tx=0x7fdebc00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:15.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:15.700+0000 7fdebaffd640 1 -- 172.21.15.53:0/3224027423 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdebc0074e0 con 0x7fdecc071060 2023-06-10T19:01:15.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:15.700+0000 7fdebaffd640 1 -- 172.21.15.53:0/3224027423 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdebc007660 con 0x7fdecc071060 2023-06-10T19:01:15.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:15.700+0000 7fdebaffd640 1 -- 172.21.15.53:0/3224027423 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdebc004a30 con 0x7fdecc071060 2023-06-10T19:01:15.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:15.700+0000 7fded0a82640 1 -- 172.21.15.53:0/3224027423 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdecc163750 con 0x7fdecc071060 2023-06-10T19:01:15.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:15.700+0000 7fded0a82640 1 -- 172.21.15.53:0/3224027423 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdecc163d00 con 0x7fdecc071060 2023-06-10T19:01:15.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:15.700+0000 7fded0a82640 1 -- 172.21.15.53:0/3224027423 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdecc04d790 con 0x7fdecc071060 2023-06-10T19:01:15.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:15.704+0000 7fdebaffd640 1 -- 172.21.15.53:0/3224027423 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdebc004b90 con 0x7fdecc071060 2023-06-10T19:01:15.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:15.704+0000 7fdebaffd640 1 --2- 172.21.15.53:0/3224027423 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdeac066280 0x7fdeac068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:15.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:15.704+0000 7fdebaffd640 1 -- 172.21.15.53:0/3224027423 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6148+0+0 (secure 0 0 0) 0x7fdebc082f00 con 0x7fdecc071060 2023-06-10T19:01:15.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:15.704+0000 7fdec9d9b640 1 --2- 172.21.15.53:0/3224027423 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdeac066280 0x7fdeac068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:15.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:15.704+0000 7fdec9d9b640 1 --2- 172.21.15.53:0/3224027423 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdeac066280 0x7fdeac068730 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fdecc1f75d0 tx=0x7fdec0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:15.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:15.708+0000 7fdebaffd640 1 -- 172.21.15.53:0/3224027423 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdebc053e40 con 0x7fdecc071060 2023-06-10T19:01:15.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:15.888+0000 7fded0a82640 1 -- 172.21.15.53:0/3224027423 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdecc0cb140 con 0x7fdecc071060 2023-06-10T19:01:15.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:15.892+0000 7fdebaffd640 1 -- 172.21.15.53:0/3224027423 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4683 (secure 0 0 0) 0x7fdebc018020 con 0x7fdecc071060 2023-06-10T19:01:15.896 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:01:15.897 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":38,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5663,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2600814414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2600814414},{"type":"v1","addr":"172.21.15.117:6835","nonce":2600814414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6136,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1615882017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1615882017},{"type":"v1","addr":"172.21.15.117:6837","nonce":1615882017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6993,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/3732245174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3732245174},{"type":"v1","addr":"172.21.15.53:6833","nonce":3732245174}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:00:20.607950+0000","modified":"2023-06-10T19:00:49.023162+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7266":{"gid":7266,"name":"c","rank":0,"incarnation":37,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.53:6835/2829993338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2829993338},{"type":"v1","addr":"172.21.15.53:6835","nonce":2829993338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-06-10T19:01:15.898 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 38 2023-06-10T19:01:15.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:15.892+0000 7fded0a82640 1 -- 172.21.15.53:0/3224027423 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdeac066280 msgr2=0x7fdeac068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:15.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:15.892+0000 7fded0a82640 1 --2- 172.21.15.53:0/3224027423 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdeac066280 0x7fdeac068730 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fdecc1f75d0 tx=0x7fdec0008040 comp rx=0 tx=0).stop 2023-06-10T19:01:15.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:15.892+0000 7fded0a82640 1 -- 172.21.15.53:0/3224027423 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdecc071060 msgr2=0x7fdecc14be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:15.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:15.892+0000 7fded0a82640 1 --2- 172.21.15.53:0/3224027423 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdecc071060 0x7fdecc14be70 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7fdebc00c480 tx=0x7fdebc00c940 comp rx=0 tx=0).stop 2023-06-10T19:01:15.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:15.892+0000 7fded0a82640 1 -- 172.21.15.53:0/3224027423 shutdown_connections 2023-06-10T19:01:15.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:15.892+0000 7fded0a82640 1 --2- 172.21.15.53:0/3224027423 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdeac066280 0x7fdeac068730 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:15.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:15.892+0000 7fded0a82640 1 --2- 172.21.15.53:0/3224027423 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdecc0c9840 0x7fdecc1540f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:15.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:15.892+0000 7fded0a82640 1 --2- 172.21.15.53:0/3224027423 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdecc0afc60 0x7fdecc163210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:15.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:15.892+0000 7fded0a82640 1 --2- 172.21.15.53:0/3224027423 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdecc071060 0x7fdecc14be70 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:15.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:15.892+0000 7fded0a82640 1 -- 172.21.15.53:0/3224027423 >> 172.21.15.53:0/3224027423 conn(0x7fdecc06a0d0 msgr2=0x7fdecc0cdc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:15.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:15.892+0000 7fded0a82640 1 -- 172.21.15.53:0/3224027423 shutdown_connections 2023-06-10T19:01:15.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:15.892+0000 7fded0a82640 1 -- 172.21.15.53:0/3224027423 wait complete. 2023-06-10T19:01:15.914 DEBUG:tasks.cephfs.filesystem:mapped states ['up:reconnect'] to None 2023-06-10T19:01:16.916 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:01:17.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:17.048+0000 7f468f33d640 1 Processor -- start 2023-06-10T19:01:17.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:17.048+0000 7f468f33d640 1 -- start start 2023-06-10T19:01:17.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:17.048+0000 7f468f33d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f468815eef0 0x7f4688070f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:17.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:17.048+0000 7f468f33d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f468815f570 0x7f46880ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:17.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:17.048+0000 7f468f33d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f46880ce990 0x7f4688069450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:17.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:17.048+0000 7f468f33d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f468815f2c0 con 0x7f468815f570 2023-06-10T19:01:17.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:17.048+0000 7f468f33d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f468815fdc0 con 0x7f46880ce990 2023-06-10T19:01:17.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:17.048+0000 7f468f33d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46881600a0 con 0x7f468815eef0 2023-06-10T19:01:17.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:17.048+0000 7f468c8d8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f468815f570 0x7f46880ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:17.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:17.048+0000 7f468c8d8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f468815f570 0x7f46880ce450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33946/0 (socket says 172.21.15.53:33946) 2023-06-10T19:01:17.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:17.048+0000 7f468c8d8640 1 -- 172.21.15.53:0/4215554845 learned_addr learned my addr 172.21.15.53:0/4215554845 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:17.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:17.048+0000 7f468d0d9640 1 --2- 172.21.15.53:0/4215554845 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f468815eef0 0x7f4688070f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:17.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:17.048+0000 7f468d8da640 1 --2- 172.21.15.53:0/4215554845 >> v2:172.21.15.117:3300/0 conn(0x7f46880ce990 0x7f4688069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:17.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:17.048+0000 7f468c8d8640 1 -- 172.21.15.53:0/4215554845 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f468815eef0 msgr2=0x7f4688070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:17.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:17.048+0000 7f468c8d8640 1 --2- 172.21.15.53:0/4215554845 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f468815eef0 0x7f4688070f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:17.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:17.048+0000 7f468c8d8640 1 -- 172.21.15.53:0/4215554845 >> v2:172.21.15.117:3300/0 conn(0x7f46880ce990 msgr2=0x7f4688069450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:17.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:17.048+0000 7f468c8d8640 1 --2- 172.21.15.53:0/4215554845 >> v2:172.21.15.117:3300/0 conn(0x7f46880ce990 0x7f4688069450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:17.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:17.048+0000 7f468c8d8640 1 -- 172.21.15.53:0/4215554845 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4688160380 con 0x7f468815f570 2023-06-10T19:01:17.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:17.048+0000 7f468d8da640 1 --2- 172.21.15.53:0/4215554845 >> v2:172.21.15.117:3300/0 conn(0x7f46880ce990 0x7f4688069450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:01:17.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:17.052+0000 7f468c8d8640 1 --2- 172.21.15.53:0/4215554845 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f468815f570 0x7f46880ce450 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f468806fd30 tx=0x7f467801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4cf86bc15f280b6 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:17.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:17.052+0000 7f467ffff640 1 -- 172.21.15.53:0/4215554845 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46780ab600 con 0x7f468815f570 2023-06-10T19:01:17.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:17.052+0000 7f467ffff640 1 -- 172.21.15.53:0/4215554845 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46780a7050 con 0x7f468815f570 2023-06-10T19:01:17.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:17.052+0000 7f467ffff640 1 -- 172.21.15.53:0/4215554845 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46780ab980 con 0x7f468815f570 2023-06-10T19:01:17.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:17.052+0000 7f468f33d640 1 -- 172.21.15.53:0/4215554845 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f468815f570 msgr2=0x7f46880ce450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:17.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:17.052+0000 7f468f33d640 1 --2- 172.21.15.53:0/4215554845 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f468815f570 0x7f46880ce450 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f468806fd30 tx=0x7f467801c500 comp rx=0 tx=0).stop 2023-06-10T19:01:17.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:17.052+0000 7f468f33d640 1 -- 172.21.15.53:0/4215554845 shutdown_connections 2023-06-10T19:01:17.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:17.052+0000 7f468f33d640 1 --2- 172.21.15.53:0/4215554845 >> v2:172.21.15.117:3300/0 conn(0x7f46880ce990 0x7f4688069450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:17.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:17.052+0000 7f468f33d640 1 --2- 172.21.15.53:0/4215554845 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f468815f570 0x7f46880ce450 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:17.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:17.052+0000 7f468f33d640 1 --2- 172.21.15.53:0/4215554845 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f468815eef0 0x7f4688070f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:17.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:17.052+0000 7f468f33d640 1 -- 172.21.15.53:0/4215554845 >> 172.21.15.53:0/4215554845 conn(0x7f468806a560 msgr2=0x7f468806a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:17.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:17.052+0000 7f468f33d640 1 -- 172.21.15.53:0/4215554845 shutdown_connections 2023-06-10T19:01:17.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:17.052+0000 7f468f33d640 1 -- 172.21.15.53:0/4215554845 wait complete. 2023-06-10T19:01:17.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:17.052+0000 7f468f33d640 1 Processor -- start 2023-06-10T19:01:17.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:17.052+0000 7f468f33d640 1 -- start start 2023-06-10T19:01:17.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:17.052+0000 7f468f33d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46880ce990 0x7f4688153f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:17.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:17.052+0000 7f468f33d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f468815eef0 0x7f4688150df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:17.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:17.052+0000 7f468f33d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f468815f570 0x7f46880c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:17.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:17.052+0000 7f468f33d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4688153b00 con 0x7f468815eef0 2023-06-10T19:01:17.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:17.052+0000 7f468f33d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4688152e80 con 0x7f46880ce990 2023-06-10T19:01:17.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:17.052+0000 7f468f33d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4688153160 con 0x7f468815f570 2023-06-10T19:01:17.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:17.056+0000 7f468c8d8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f468815eef0 0x7f4688150df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:17.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:17.056+0000 7f468c8d8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f468815eef0 0x7f4688150df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33950/0 (socket says 172.21.15.53:33950) 2023-06-10T19:01:17.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:17.056+0000 7f468c8d8640 1 -- 172.21.15.53:0/1856793977 learned_addr learned my addr 172.21.15.53:0/1856793977 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:17.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:17.056+0000 7f468d8da640 1 --2- 172.21.15.53:0/1856793977 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f468815f570 0x7f46880c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:17.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:17.056+0000 7f468d0d9640 1 --2- 172.21.15.53:0/1856793977 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46880ce990 0x7f4688153f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:17.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:17.056+0000 7f468c8d8640 1 -- 172.21.15.53:0/1856793977 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f468815f570 msgr2=0x7f46880c6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:17.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:17.056+0000 7f468c8d8640 1 --2- 172.21.15.53:0/1856793977 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f468815f570 0x7f46880c6ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:17.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:17.056+0000 7f468c8d8640 1 -- 172.21.15.53:0/1856793977 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46880ce990 msgr2=0x7f4688153f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:17.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:17.056+0000 7f468c8d8640 1 --2- 172.21.15.53:0/1856793977 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46880ce990 0x7f4688153f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:17.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:17.056+0000 7f468c8d8640 1 -- 172.21.15.53:0/1856793977 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46780094d0 con 0x7f468815eef0 2023-06-10T19:01:17.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:17.056+0000 7f468d0d9640 1 --2- 172.21.15.53:0/1856793977 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46880ce990 0x7f4688153f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:01:17.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:17.056+0000 7f468c8d8640 1 --2- 172.21.15.53:0/1856793977 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f468815eef0 0x7f4688150df0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f46780ae040 tx=0x7f46780192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:17.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:17.056+0000 7f467dffb640 1 -- 172.21.15.53:0/1856793977 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46780bc070 con 0x7f468815eef0 2023-06-10T19:01:17.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:17.056+0000 7f467dffb640 1 -- 172.21.15.53:0/1856793977 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46780acdd0 con 0x7f468815eef0 2023-06-10T19:01:17.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:17.056+0000 7f468f33d640 1 -- 172.21.15.53:0/1856793977 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4688153440 con 0x7f468815eef0 2023-06-10T19:01:17.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:17.056+0000 7f467dffb640 1 -- 172.21.15.53:0/1856793977 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46780b6660 con 0x7f468815eef0 2023-06-10T19:01:17.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:17.056+0000 7f468f33d640 1 -- 172.21.15.53:0/1856793977 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4688154460 con 0x7f468815eef0 2023-06-10T19:01:17.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:17.056+0000 7f468f33d640 1 -- 172.21.15.53:0/1856793977 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f468804d790 con 0x7f468815eef0 2023-06-10T19:01:17.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:17.056+0000 7f467dffb640 1 -- 172.21.15.53:0/1856793977 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f46780b2040 con 0x7f468815eef0 2023-06-10T19:01:17.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:17.056+0000 7f467dffb640 1 --2- 172.21.15.53:0/1856793977 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f466c066280 0x7f466c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:17.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:17.056+0000 7f467dffb640 1 -- 172.21.15.53:0/1856793977 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f467811d9a0 con 0x7f468815eef0 2023-06-10T19:01:17.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:17.056+0000 7f468d0d9640 1 --2- 172.21.15.53:0/1856793977 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f466c066280 0x7f466c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:17.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:17.060+0000 7f468d0d9640 1 --2- 172.21.15.53:0/1856793977 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f466c066280 0x7f466c068730 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f4684009840 tx=0x7f4684008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:17.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:17.060+0000 7f467dffb640 1 -- 172.21.15.53:0/1856793977 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f46780ead40 con 0x7f468815eef0 2023-06-10T19:01:17.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:17.244+0000 7f468f33d640 1 -- 172.21.15.53:0/1856793977 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f468815b1a0 con 0x7f468815eef0 2023-06-10T19:01:17.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:17.244+0000 7f467dffb640 1 -- 172.21.15.53:0/1856793977 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4683 (secure 0 0 0) 0x7f46780ee360 con 0x7f468815eef0 2023-06-10T19:01:17.249 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:01:17.249 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":38,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5663,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2600814414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2600814414},{"type":"v1","addr":"172.21.15.117:6835","nonce":2600814414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6136,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1615882017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1615882017},{"type":"v1","addr":"172.21.15.117:6837","nonce":1615882017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6993,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/3732245174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3732245174},{"type":"v1","addr":"172.21.15.53:6833","nonce":3732245174}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:00:20.607950+0000","modified":"2023-06-10T19:00:49.023162+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7266":{"gid":7266,"name":"c","rank":0,"incarnation":37,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.53:6835/2829993338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2829993338},{"type":"v1","addr":"172.21.15.53:6835","nonce":2829993338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-06-10T19:01:17.249 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 38 2023-06-10T19:01:17.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:17.244+0000 7f468f33d640 1 -- 172.21.15.53:0/1856793977 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f466c066280 msgr2=0x7f466c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:17.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:17.244+0000 7f468f33d640 1 --2- 172.21.15.53:0/1856793977 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f466c066280 0x7f466c068730 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f4684009840 tx=0x7f4684008040 comp rx=0 tx=0).stop 2023-06-10T19:01:17.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:17.244+0000 7f468f33d640 1 -- 172.21.15.53:0/1856793977 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f468815eef0 msgr2=0x7f4688150df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:17.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:17.244+0000 7f468f33d640 1 --2- 172.21.15.53:0/1856793977 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f468815eef0 0x7f4688150df0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f46780ae040 tx=0x7f46780192a0 comp rx=0 tx=0).stop 2023-06-10T19:01:17.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:17.244+0000 7f468f33d640 1 -- 172.21.15.53:0/1856793977 shutdown_connections 2023-06-10T19:01:17.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:17.244+0000 7f468f33d640 1 --2- 172.21.15.53:0/1856793977 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f466c066280 0x7f466c068730 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:17.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:17.244+0000 7f468f33d640 1 --2- 172.21.15.53:0/1856793977 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f468815f570 0x7f46880c6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:17.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:17.244+0000 7f468f33d640 1 --2- 172.21.15.53:0/1856793977 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f468815eef0 0x7f4688150df0 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:17.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:17.244+0000 7f468f33d640 1 --2- 172.21.15.53:0/1856793977 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46880ce990 0x7f4688153f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:17.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:17.248+0000 7f468f33d640 1 -- 172.21.15.53:0/1856793977 >> 172.21.15.53:0/1856793977 conn(0x7f468806a560 msgr2=0x7f46880ab860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:17.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:17.248+0000 7f468f33d640 1 -- 172.21.15.53:0/1856793977 shutdown_connections 2023-06-10T19:01:17.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:17.248+0000 7f468f33d640 1 -- 172.21.15.53:0/1856793977 wait complete. 2023-06-10T19:01:17.267 DEBUG:tasks.cephfs.filesystem:mapped states ['up:reconnect'] to None 2023-06-10T19:01:18.269 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:01:18.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.400+0000 7f22ee272640 1 Processor -- start 2023-06-10T19:01:18.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.400+0000 7f22ee272640 1 -- start start 2023-06-10T19:01:18.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.400+0000 7f22ee272640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22e80cec40 0x7f22e80cf090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:18.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.400+0000 7f22ee272640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f22e80cbf50 0x7f22e80cc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:18.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.400+0000 7f22ee272640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22e80cf5d0 con 0x7f22e8159450 2023-06-10T19:01:18.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.400+0000 7f22ee272640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22e80cbac0 con 0x7f22e80cbf50 2023-06-10T19:01:18.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.400+0000 7f22ee272640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22e815dc00 con 0x7f22e80cec40 2023-06-10T19:01:18.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.400+0000 7f22e7fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f22e8159450 0x7f22e815d140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:38294/0 (socket says 172.21.15.53:38294) 2023-06-10T19:01:18.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.400+0000 7f22e7fff640 1 -- 172.21.15.53:0/3923992239 learned_addr learned my addr 172.21.15.53:0/3923992239 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:01:18.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.400+0000 7f22ec80f640 1 --2- 172.21.15.53:0/3923992239 >> v2:172.21.15.117:3300/0 conn(0x7f22e80cbf50 0x7f22e80cc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:18.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.400+0000 7f22e77fe640 1 --2- 172.21.15.53:0/3923992239 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22e80cec40 0x7f22e80cf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:18.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.400+0000 7f22e6ffd640 1 -- 172.21.15.53:0/3923992239 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3119779279 0 0) 0x7f22d0001120 con 0x7f22e8159450 2023-06-10T19:01:18.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.400+0000 7f22e6ffd640 1 -- 172.21.15.53:0/3923992239 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22d4003530 con 0x7f22e8159450 2023-06-10T19:01:18.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.400+0000 7f22e6ffd640 1 -- 172.21.15.53:0/3923992239 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1933378168 0 0) 0x7f22d4003530 con 0x7f22e8159450 2023-06-10T19:01:18.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.400+0000 7f22e6ffd640 1 -- 172.21.15.53:0/3923992239 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22e80cec40 msgr2=0x7f22e80cf090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:18.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.400+0000 7f22e6ffd640 1 --2- 172.21.15.53:0/3923992239 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22e80cec40 0x7f22e80cf090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:18.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.400+0000 7f22e6ffd640 1 -- 172.21.15.53:0/3923992239 >> v2:172.21.15.117:3300/0 conn(0x7f22e80cbf50 msgr2=0x7f22e80cc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:18.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.400+0000 7f22e6ffd640 1 --2- 172.21.15.53:0/3923992239 >> v2:172.21.15.117:3300/0 conn(0x7f22e80cbf50 0x7f22e80cc3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:18.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.400+0000 7f22e6ffd640 1 -- 172.21.15.53:0/3923992239 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22e815dee0 con 0x7f22e8159450 2023-06-10T19:01:18.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.400+0000 7f22e6ffd640 1 -- 172.21.15.53:0/3923992239 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f22d0001810 con 0x7f22e8159450 2023-06-10T19:01:18.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.400+0000 7f22e6ffd640 1 -- 172.21.15.53:0/3923992239 >> v1:172.21.15.53:6789/0 conn(0x7f22e8159450 legacy=0x7f22e815d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:18.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.400+0000 7f22e6ffd640 1 --2- 172.21.15.53:0/3923992239 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22d40039f0 0x7f22d4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:18.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.400+0000 7f22e6ffd640 1 --2- 172.21.15.53:0/3923992239 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22e80cec40 0x7f22d40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:18.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.400+0000 7f22e6ffd640 1 --2- 172.21.15.53:0/3923992239 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22d4004d10 0x7f22d4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:18.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.400+0000 7f22e6ffd640 1 -- 172.21.15.53:0/3923992239 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e80cbac0 con 0x7f22d40039f0 2023-06-10T19:01:18.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.400+0000 7f22e6ffd640 1 -- 172.21.15.53:0/3923992239 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e815dc00 con 0x7f22d4004d10 2023-06-10T19:01:18.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.400+0000 7f22e6ffd640 1 -- 172.21.15.53:0/3923992239 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22d400b990 con 0x7f22e80cec40 2023-06-10T19:01:18.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.400+0000 7f22e7fff640 1 --2- 172.21.15.53:0/3923992239 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22d40039f0 0x7f22d4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:18.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.400+0000 7f22ec80f640 1 --2- 172.21.15.53:0/3923992239 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22d4004d10 0x7f22d4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:18.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.400+0000 7f22e7fff640 1 -- 172.21.15.53:0/3923992239 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22e80cec40 msgr2=0x7f22d40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:18.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.400+0000 7f22e77fe640 1 --2- 172.21.15.53:0/3923992239 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22e80cec40 0x7f22d40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:18.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.400+0000 7f22e7fff640 1 --2- 172.21.15.53:0/3923992239 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22e80cec40 0x7f22d40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:18.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.400+0000 7f22e7fff640 1 -- 172.21.15.53:0/3923992239 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22d4004d10 msgr2=0x7f22d4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:18.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.400+0000 7f22e7fff640 1 --2- 172.21.15.53:0/3923992239 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22d4004d10 0x7f22d4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:18.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.400+0000 7f22e7fff640 1 -- 172.21.15.53:0/3923992239 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22d4003530 con 0x7f22d40039f0 2023-06-10T19:01:18.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.400+0000 7f22ec80f640 1 --2- 172.21.15.53:0/3923992239 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22d4004d10 0x7f22d4005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:01:18.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.400+0000 7f22e77fe640 1 --2- 172.21.15.53:0/3923992239 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22e80cec40 0x7f22d40047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:01:18.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.404+0000 7f22e7fff640 1 --2- 172.21.15.53:0/3923992239 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22d40039f0 0x7f22d4003e00 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f22d000c240 tx=0x7f22d001cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dbb59d95724a24c server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:18.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.404+0000 7f22e6ffd640 1 -- 172.21.15.53:0/3923992239 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d00058e0 con 0x7f22d40039f0 2023-06-10T19:01:18.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.404+0000 7f22e6ffd640 1 -- 172.21.15.53:0/3923992239 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22d0005a40 con 0x7f22d40039f0 2023-06-10T19:01:18.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.404+0000 7f22e6ffd640 1 -- 172.21.15.53:0/3923992239 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d0005e30 con 0x7f22d40039f0 2023-06-10T19:01:18.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.404+0000 7f22ee272640 1 -- 172.21.15.53:0/3923992239 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22d40039f0 msgr2=0x7f22d4003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:18.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.404+0000 7f22ee272640 1 --2- 172.21.15.53:0/3923992239 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22d40039f0 0x7f22d4003e00 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f22d000c240 tx=0x7f22d001cbb0 comp rx=0 tx=0).stop 2023-06-10T19:01:18.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.404+0000 7f22ec80f640 1 -- 172.21.15.53:0/3923992239 reap_dead start 2023-06-10T19:01:18.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.404+0000 7f22ee272640 1 -- 172.21.15.53:0/3923992239 shutdown_connections 2023-06-10T19:01:18.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.404+0000 7f22ee272640 1 -- 172.21.15.53:0/3923992239 >> 172.21.15.53:0/3923992239 conn(0x7f22e806a090 msgr2=0x7f22e806d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:18.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.404+0000 7f22ee272640 1 -- 172.21.15.53:0/3923992239 shutdown_connections 2023-06-10T19:01:18.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.404+0000 7f22ee272640 1 -- 172.21.15.53:0/3923992239 wait complete. 2023-06-10T19:01:18.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.408+0000 7f22ee272640 1 Processor -- start 2023-06-10T19:01:18.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.408+0000 7f22ee272640 1 -- start start 2023-06-10T19:01:18.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.408+0000 7f22ee272640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22d40039f0 0x7f22e80c7b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:18.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.408+0000 7f22ee272640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22e8156e50 0x7f22e81572a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:18.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.408+0000 7f22ee272640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22e80b3cd0 0x7f22e80b4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:18.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.408+0000 7f22ee272640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e81577e0 con 0x7f22d40039f0 2023-06-10T19:01:18.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.408+0000 7f22ee272640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e80b4680 con 0x7f22e8156e50 2023-06-10T19:01:18.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.408+0000 7f22ee272640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22e80b4950 con 0x7f22e80b3cd0 2023-06-10T19:01:18.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.408+0000 7f22e7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22d40039f0 0x7f22e80c7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:18.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.408+0000 7f22e7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22d40039f0 0x7f22e80c7b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33970/0 (socket says 172.21.15.53:33970) 2023-06-10T19:01:18.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.408+0000 7f22e7fff640 1 -- 172.21.15.53:0/4189138601 learned_addr learned my addr 172.21.15.53:0/4189138601 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:18.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.408+0000 7f22e77fe640 1 --2- 172.21.15.53:0/4189138601 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22e8156e50 0x7f22e81572a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:18.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.408+0000 7f22ec80f640 1 --2- 172.21.15.53:0/4189138601 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22e80b3cd0 0x7f22e80b4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:18.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.408+0000 7f22e7fff640 1 -- 172.21.15.53:0/4189138601 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22e80b3cd0 msgr2=0x7f22e80b4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:18.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.408+0000 7f22e7fff640 1 --2- 172.21.15.53:0/4189138601 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22e80b3cd0 0x7f22e80b4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:18.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.408+0000 7f22e7fff640 1 -- 172.21.15.53:0/4189138601 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22e8156e50 msgr2=0x7f22e81572a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:18.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.408+0000 7f22e7fff640 1 --2- 172.21.15.53:0/4189138601 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22e8156e50 0x7f22e81572a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:18.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.408+0000 7f22e7fff640 1 -- 172.21.15.53:0/4189138601 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22e815d9d0 con 0x7f22d40039f0 2023-06-10T19:01:18.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.408+0000 7f22e7fff640 1 --2- 172.21.15.53:0/4189138601 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22d40039f0 0x7f22e80c7b00 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f22d000c240 tx=0x7f22d4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:18.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.408+0000 7f22e4ff9640 1 -- 172.21.15.53:0/4189138601 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d0001850 con 0x7f22d40039f0 2023-06-10T19:01:18.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.408+0000 7f22e4ff9640 1 -- 172.21.15.53:0/4189138601 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22d00a5800 con 0x7f22d40039f0 2023-06-10T19:01:18.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.408+0000 7f22ee272640 1 -- 172.21.15.53:0/4189138601 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22e80b4c30 con 0x7f22d40039f0 2023-06-10T19:01:18.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.408+0000 7f22e4ff9640 1 -- 172.21.15.53:0/4189138601 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d00a5bb0 con 0x7f22d40039f0 2023-06-10T19:01:18.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.408+0000 7f22ee272640 1 -- 172.21.15.53:0/4189138601 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22e80b51f0 con 0x7f22d40039f0 2023-06-10T19:01:18.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.408+0000 7f22ee272640 1 -- 172.21.15.53:0/4189138601 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22e804d790 con 0x7f22d40039f0 2023-06-10T19:01:18.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.408+0000 7f22e4ff9640 1 -- 172.21.15.53:0/4189138601 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f22d00a5d10 con 0x7f22d40039f0 2023-06-10T19:01:18.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.408+0000 7f22e4ff9640 1 --2- 172.21.15.53:0/4189138601 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f22c8066280 0x7f22c8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:18.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.408+0000 7f22e4ff9640 1 -- 172.21.15.53:0/4189138601 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f22d011d160 con 0x7f22d40039f0 2023-06-10T19:01:18.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.412+0000 7f22e77fe640 1 --2- 172.21.15.53:0/4189138601 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f22c8066280 0x7f22c8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:18.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.412+0000 7f22e77fe640 1 --2- 172.21.15.53:0/4189138601 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f22c8066280 0x7f22c8068730 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f22e815cc60 tx=0x7f22d8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:18.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.412+0000 7f22e4ff9640 1 -- 172.21.15.53:0/4189138601 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f22d00ea580 con 0x7f22d40039f0 2023-06-10T19:01:18.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.600+0000 7f22ee272640 1 -- 172.21.15.53:0/4189138601 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f22e806df70 con 0x7f22d40039f0 2023-06-10T19:01:18.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.600+0000 7f22e4ff9640 1 -- 172.21.15.53:0/4189138601 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4683 (secure 0 0 0) 0x7f22d00edba0 con 0x7f22d40039f0 2023-06-10T19:01:18.607 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:01:18.607 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":38,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5663,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2600814414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2600814414},{"type":"v1","addr":"172.21.15.117:6835","nonce":2600814414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6136,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1615882017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1615882017},{"type":"v1","addr":"172.21.15.117:6837","nonce":1615882017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6993,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/3732245174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3732245174},{"type":"v1","addr":"172.21.15.53:6833","nonce":3732245174}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:00:20.607950+0000","modified":"2023-06-10T19:00:49.023162+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7266":{"gid":7266,"name":"c","rank":0,"incarnation":37,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.53:6835/2829993338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2829993338},{"type":"v1","addr":"172.21.15.53:6835","nonce":2829993338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-06-10T19:01:18.609 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 38 2023-06-10T19:01:18.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.604+0000 7f22ee272640 1 -- 172.21.15.53:0/4189138601 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f22c8066280 msgr2=0x7f22c8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:18.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.604+0000 7f22ee272640 1 --2- 172.21.15.53:0/4189138601 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f22c8066280 0x7f22c8068730 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f22e815cc60 tx=0x7f22d8008040 comp rx=0 tx=0).stop 2023-06-10T19:01:18.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.604+0000 7f22ee272640 1 -- 172.21.15.53:0/4189138601 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22d40039f0 msgr2=0x7f22e80c7b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:18.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.604+0000 7f22ee272640 1 --2- 172.21.15.53:0/4189138601 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22d40039f0 0x7f22e80c7b00 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f22d000c240 tx=0x7f22d4005800 comp rx=0 tx=0).stop 2023-06-10T19:01:18.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.604+0000 7f22ee272640 1 -- 172.21.15.53:0/4189138601 shutdown_connections 2023-06-10T19:01:18.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.604+0000 7f22ee272640 1 --2- 172.21.15.53:0/4189138601 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f22c8066280 0x7f22c8068730 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:18.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.604+0000 7f22ee272640 1 --2- 172.21.15.53:0/4189138601 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22e80b3cd0 0x7f22e80b4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:18.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.604+0000 7f22ee272640 1 --2- 172.21.15.53:0/4189138601 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22e8156e50 0x7f22e81572a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:18.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.604+0000 7f22ee272640 1 --2- 172.21.15.53:0/4189138601 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22d40039f0 0x7f22e80c7b00 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:18.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.604+0000 7f22ee272640 1 -- 172.21.15.53:0/4189138601 >> 172.21.15.53:0/4189138601 conn(0x7f22e806a090 msgr2=0x7f22e80aff40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:18.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.604+0000 7f22ee272640 1 -- 172.21.15.53:0/4189138601 shutdown_connections 2023-06-10T19:01:18.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:18.604+0000 7f22ee272640 1 -- 172.21.15.53:0/4189138601 wait complete. 2023-06-10T19:01:18.624 DEBUG:tasks.cephfs.filesystem:mapped states ['up:reconnect'] to None 2023-06-10T19:01:19.626 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:01:19.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:19.760+0000 7ff8c4cbe640 1 Processor -- start 2023-06-10T19:01:19.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:19.760+0000 7ff8c4cbe640 1 -- start start 2023-06-10T19:01:19.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:19.760+0000 7ff8c4cbe640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff8c00c9840 0x7ff8c00c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:19.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:19.760+0000 7ff8c4cbe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff8c006b090 0x7ff8c006b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:19.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:19.760+0000 7ff8c4cbe640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8c0159b50 con 0x7ff8c0071060 2023-06-10T19:01:19.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:19.760+0000 7ff8c4cbe640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8c00ca150 con 0x7ff8c006b090 2023-06-10T19:01:19.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:19.760+0000 7ff8c4cbe640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8c00702a0 con 0x7ff8c00c9840 2023-06-10T19:01:19.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:19.760+0000 7ff8bed9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff8c006b090 0x7ff8c006b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:19.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:19.760+0000 7ff8bed9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff8c006b090 0x7ff8c006b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33986/0 (socket says 172.21.15.53:33986) 2023-06-10T19:01:19.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:19.760+0000 7ff8bed9d640 1 -- 172.21.15.53:0/2354031971 learned_addr learned my addr 172.21.15.53:0/2354031971 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:19.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:19.760+0000 7ff8be59c640 1 --2- 172.21.15.53:0/2354031971 >> v2:172.21.15.117:3300/0 conn(0x7ff8c00c9840 0x7ff8c00c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:19.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:19.760+0000 7ff8bed9d640 1 -- 172.21.15.53:0/2354031971 >> v2:172.21.15.117:3300/0 conn(0x7ff8c00c9840 msgr2=0x7ff8c00c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:19.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:19.760+0000 7ff8bed9d640 1 --2- 172.21.15.53:0/2354031971 >> v2:172.21.15.117:3300/0 conn(0x7ff8c00c9840 0x7ff8c00c9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:19.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:19.760+0000 7ff8bed9d640 1 -- 172.21.15.53:0/2354031971 >> v1:172.21.15.117:6789/0 conn(0x7ff8c0071060 legacy=0x7ff8c00af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:19.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:19.760+0000 7ff8bed9d640 1 -- 172.21.15.53:0/2354031971 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8c0070580 con 0x7ff8c006b090 2023-06-10T19:01:19.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:19.760+0000 7ff8be59c640 1 --2- 172.21.15.53:0/2354031971 >> v2:172.21.15.117:3300/0 conn(0x7ff8c00c9840 0x7ff8c00c9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:01:19.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:19.764+0000 7ff8bed9d640 1 --2- 172.21.15.53:0/2354031971 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff8c006b090 0x7ff8c006b510 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7ff8c0071d80 tx=0x7ff8b801c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36f5fac5426e4944 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:19.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:19.764+0000 7ff8bd59a640 1 -- 172.21.15.53:0/2354031971 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b80a5820 con 0x7ff8c006b090 2023-06-10T19:01:19.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:19.764+0000 7ff8bd59a640 1 -- 172.21.15.53:0/2354031971 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8b80a5980 con 0x7ff8c006b090 2023-06-10T19:01:19.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:19.764+0000 7ff8bd59a640 1 -- 172.21.15.53:0/2354031971 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b80a5d10 con 0x7ff8c006b090 2023-06-10T19:01:19.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:19.764+0000 7ff8c4cbe640 1 -- 172.21.15.53:0/2354031971 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff8c006b090 msgr2=0x7ff8c006b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:19.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:19.764+0000 7ff8c4cbe640 1 --2- 172.21.15.53:0/2354031971 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff8c006b090 0x7ff8c006b510 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7ff8c0071d80 tx=0x7ff8b801c960 comp rx=0 tx=0).stop 2023-06-10T19:01:19.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:19.764+0000 7ff8c4cbe640 1 -- 172.21.15.53:0/2354031971 shutdown_connections 2023-06-10T19:01:19.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:19.764+0000 7ff8c4cbe640 1 --2- 172.21.15.53:0/2354031971 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff8c006b090 0x7ff8c006b510 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:19.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:19.764+0000 7ff8c4cbe640 1 --2- 172.21.15.53:0/2354031971 >> v2:172.21.15.117:3300/0 conn(0x7ff8c00c9840 0x7ff8c00c9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:19.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:19.764+0000 7ff8c4cbe640 1 -- 172.21.15.53:0/2354031971 >> 172.21.15.53:0/2354031971 conn(0x7ff8c006a0d0 msgr2=0x7ff8c00ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:19.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:19.764+0000 7ff8c4cbe640 1 -- 172.21.15.53:0/2354031971 shutdown_connections 2023-06-10T19:01:19.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:19.764+0000 7ff8c4cbe640 1 -- 172.21.15.53:0/2354031971 wait complete. 2023-06-10T19:01:19.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:19.764+0000 7ff8c4cbe640 1 Processor -- start 2023-06-10T19:01:19.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:19.764+0000 7ff8c4cbe640 1 -- start start 2023-06-10T19:01:19.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:19.764+0000 7ff8c4cbe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff8c006b090 0x7ff8c00b3200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:19.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:19.764+0000 7ff8c4cbe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8c0071060 0x7ff8c014ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:19.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:19.764+0000 7ff8c4cbe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8c00c9840 0x7ff8c00b0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:19.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:19.764+0000 7ff8c4cbe640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c014dfb0 con 0x7ff8c006b090 2023-06-10T19:01:19.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:19.764+0000 7ff8c4cbe640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c015afe0 con 0x7ff8c00c9840 2023-06-10T19:01:19.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:19.764+0000 7ff8c4cbe640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c0150c40 con 0x7ff8c0071060 2023-06-10T19:01:19.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:19.764+0000 7ff8be59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff8c006b090 0x7ff8c00b3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:19.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:19.764+0000 7ff8be59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff8c006b090 0x7ff8c00b3200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33990/0 (socket says 172.21.15.53:33990) 2023-06-10T19:01:19.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:19.764+0000 7ff8be59c640 1 -- 172.21.15.53:0/749065692 learned_addr learned my addr 172.21.15.53:0/749065692 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:19.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:19.764+0000 7ff8bed9d640 1 --2- 172.21.15.53:0/749065692 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8c00c9840 0x7ff8c00b0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:19.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:19.764+0000 7ff8bdd9b640 1 --2- 172.21.15.53:0/749065692 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8c0071060 0x7ff8c014ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:19.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:19.764+0000 7ff8be59c640 1 -- 172.21.15.53:0/749065692 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8c0071060 msgr2=0x7ff8c014ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:19.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:19.764+0000 7ff8be59c640 1 --2- 172.21.15.53:0/749065692 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8c0071060 0x7ff8c014ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:19.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:19.764+0000 7ff8be59c640 1 -- 172.21.15.53:0/749065692 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8c00c9840 msgr2=0x7ff8c00b0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:19.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:19.764+0000 7ff8be59c640 1 --2- 172.21.15.53:0/749065692 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8c00c9840 0x7ff8c00b0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:19.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:19.764+0000 7ff8be59c640 1 -- 172.21.15.53:0/749065692 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8b8009b30 con 0x7ff8c006b090 2023-06-10T19:01:19.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:19.768+0000 7ff8be59c640 1 --2- 172.21.15.53:0/749065692 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff8c006b090 0x7ff8c00b3200 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7ff8b000c820 tx=0x7ff8b000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:19.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:19.768+0000 7ff8aeffd640 1 -- 172.21.15.53:0/749065692 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b0007a30 con 0x7ff8c006b090 2023-06-10T19:01:19.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:19.768+0000 7ff8aeffd640 1 -- 172.21.15.53:0/749065692 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8b0007b90 con 0x7ff8c006b090 2023-06-10T19:01:19.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:19.768+0000 7ff8c4cbe640 1 -- 172.21.15.53:0/749065692 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8c00b3740 con 0x7ff8c006b090 2023-06-10T19:01:19.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:19.768+0000 7ff8aeffd640 1 -- 172.21.15.53:0/749065692 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b000ce10 con 0x7ff8c006b090 2023-06-10T19:01:19.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:19.768+0000 7ff8c4cbe640 1 -- 172.21.15.53:0/749065692 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8c0150960 con 0x7ff8c006b090 2023-06-10T19:01:19.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:19.768+0000 7ff8c4cbe640 1 -- 172.21.15.53:0/749065692 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8c004d790 con 0x7ff8c006b090 2023-06-10T19:01:19.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:19.768+0000 7ff8aeffd640 1 -- 172.21.15.53:0/749065692 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff8b00113f0 con 0x7ff8c006b090 2023-06-10T19:01:19.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:19.768+0000 7ff8aeffd640 1 --2- 172.21.15.53:0/749065692 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff8a00662b0 0x7ff8a0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:19.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:19.768+0000 7ff8aeffd640 1 -- 172.21.15.53:0/749065692 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6148+0+0 (secure 0 0 0) 0x7ff8b0083e90 con 0x7ff8c006b090 2023-06-10T19:01:19.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:19.768+0000 7ff8bdd9b640 1 --2- 172.21.15.53:0/749065692 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff8a00662b0 0x7ff8a0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:19.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:19.772+0000 7ff8bdd9b640 1 --2- 172.21.15.53:0/749065692 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff8a00662b0 0x7ff8a0068760 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7ff8c00b3af0 tx=0x7ff8b4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:19.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:19.772+0000 7ff8aeffd640 1 -- 172.21.15.53:0/749065692 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff8b00512b0 con 0x7ff8c006b090 2023-06-10T19:01:19.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:19.960+0000 7ff8c4cbe640 1 -- 172.21.15.53:0/749065692 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff8c00b2fe0 con 0x7ff8c006b090 2023-06-10T19:01:19.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:19.960+0000 7ff8aeffd640 1 -- 172.21.15.53:0/749065692 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4683 (secure 0 0 0) 0x7ff8b001f090 con 0x7ff8c006b090 2023-06-10T19:01:19.966 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:01:19.966 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":38,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5663,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2600814414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2600814414},{"type":"v1","addr":"172.21.15.117:6835","nonce":2600814414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6136,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1615882017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1615882017},{"type":"v1","addr":"172.21.15.117:6837","nonce":1615882017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6993,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/3732245174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3732245174},{"type":"v1","addr":"172.21.15.53:6833","nonce":3732245174}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:00:20.607950+0000","modified":"2023-06-10T19:00:49.023162+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7266":{"gid":7266,"name":"c","rank":0,"incarnation":37,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.53:6835/2829993338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2829993338},{"type":"v1","addr":"172.21.15.53:6835","nonce":2829993338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-06-10T19:01:19.966 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 38 2023-06-10T19:01:19.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:19.964+0000 7ff8c4cbe640 1 -- 172.21.15.53:0/749065692 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff8a00662b0 msgr2=0x7ff8a0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:19.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:19.964+0000 7ff8c4cbe640 1 --2- 172.21.15.53:0/749065692 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff8a00662b0 0x7ff8a0068760 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7ff8c00b3af0 tx=0x7ff8b4009040 comp rx=0 tx=0).stop 2023-06-10T19:01:19.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:19.964+0000 7ff8c4cbe640 1 -- 172.21.15.53:0/749065692 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff8c006b090 msgr2=0x7ff8c00b3200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:19.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:19.964+0000 7ff8c4cbe640 1 --2- 172.21.15.53:0/749065692 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff8c006b090 0x7ff8c00b3200 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7ff8b000c820 tx=0x7ff8b000cce0 comp rx=0 tx=0).stop 2023-06-10T19:01:19.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:19.964+0000 7ff8c4cbe640 1 -- 172.21.15.53:0/749065692 shutdown_connections 2023-06-10T19:01:19.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:19.964+0000 7ff8c4cbe640 1 --2- 172.21.15.53:0/749065692 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff8a00662b0 0x7ff8a0068760 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:19.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:19.964+0000 7ff8c4cbe640 1 --2- 172.21.15.53:0/749065692 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8c00c9840 0x7ff8c00b0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:19.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:19.964+0000 7ff8c4cbe640 1 --2- 172.21.15.53:0/749065692 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8c0071060 0x7ff8c014ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:19.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:19.964+0000 7ff8c4cbe640 1 --2- 172.21.15.53:0/749065692 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff8c006b090 0x7ff8c00b3200 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:19.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:19.964+0000 7ff8c4cbe640 1 -- 172.21.15.53:0/749065692 >> 172.21.15.53:0/749065692 conn(0x7ff8c006a0d0 msgr2=0x7ff8c0158a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:19.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:19.964+0000 7ff8c4cbe640 1 -- 172.21.15.53:0/749065692 shutdown_connections 2023-06-10T19:01:19.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:19.964+0000 7ff8c4cbe640 1 -- 172.21.15.53:0/749065692 wait complete. 2023-06-10T19:01:19.983 DEBUG:tasks.cephfs.filesystem:mapped states ['up:reconnect'] to None 2023-06-10T19:01:20.985 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:01:21.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.116+0000 7ff857e34640 1 Processor -- start 2023-06-10T19:01:21.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.116+0000 7ff857e34640 1 -- start start 2023-06-10T19:01:21.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.116+0000 7ff857e34640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff8500c9750 0x7ff8500aced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:21.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.116+0000 7ff857e34640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8500afe30 0x7ff8500aba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:21.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.116+0000 7ff857e34640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8500ad410 con 0x7ff8500cb870 2023-06-10T19:01:21.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.116+0000 7ff857e34640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8500cd990 con 0x7ff8500c9750 2023-06-10T19:01:21.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.116+0000 7ff857e34640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8501600d0 con 0x7ff8500afe30 2023-06-10T19:01:21.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.116+0000 7ff8553cf640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ff8500cb870 0x7ff8500af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:38298/0 (socket says 172.21.15.53:38298) 2023-06-10T19:01:21.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.116+0000 7ff8553cf640 1 -- 172.21.15.53:0/2442928596 learned_addr learned my addr 172.21.15.53:0/2442928596 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:01:21.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.116+0000 7ff8563d1640 1 --2- 172.21.15.53:0/2442928596 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8500afe30 0x7ff8500aba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:21.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.116+0000 7ff855bd0640 1 --2- 172.21.15.53:0/2442928596 >> v2:172.21.15.117:3300/0 conn(0x7ff8500c9750 0x7ff8500aced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:21.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.116+0000 7ff854bce640 1 -- 172.21.15.53:0/2442928596 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4228863773 0 0) 0x7ff8500ad410 con 0x7ff8500cb870 2023-06-10T19:01:21.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.116+0000 7ff854bce640 1 -- 172.21.15.53:0/2442928596 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff83c003530 con 0x7ff8500cb870 2023-06-10T19:01:21.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.116+0000 7ff854bce640 1 -- 172.21.15.53:0/2442928596 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3969116898 0 0) 0x7ff83c003530 con 0x7ff8500cb870 2023-06-10T19:01:21.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.116+0000 7ff854bce640 1 -- 172.21.15.53:0/2442928596 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8500afe30 msgr2=0x7ff8500aba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:21.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.116+0000 7ff854bce640 1 --2- 172.21.15.53:0/2442928596 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8500afe30 0x7ff8500aba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:21.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.116+0000 7ff854bce640 1 -- 172.21.15.53:0/2442928596 >> v2:172.21.15.117:3300/0 conn(0x7ff8500c9750 msgr2=0x7ff8500aced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:21.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.116+0000 7ff854bce640 1 --2- 172.21.15.53:0/2442928596 >> v2:172.21.15.117:3300/0 conn(0x7ff8500c9750 0x7ff8500aced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:21.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.116+0000 7ff854bce640 1 -- 172.21.15.53:0/2442928596 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff850160370 con 0x7ff8500cb870 2023-06-10T19:01:21.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.116+0000 7ff854bce640 1 -- 172.21.15.53:0/2442928596 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7ff840001680 con 0x7ff8500cb870 2023-06-10T19:01:21.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.116+0000 7ff854bce640 1 -- 172.21.15.53:0/2442928596 >> v1:172.21.15.53:6789/0 conn(0x7ff8500cb870 legacy=0x7ff8500af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:21.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.116+0000 7ff854bce640 1 --2- 172.21.15.53:0/2442928596 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8500afe30 0x7ff83c0039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:21.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.116+0000 7ff854bce640 1 --2- 172.21.15.53:0/2442928596 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff83c003f70 0x7ff83c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:21.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.116+0000 7ff854bce640 1 --2- 172.21.15.53:0/2442928596 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff83c004d10 0x7ff83c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:21.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.116+0000 7ff854bce640 1 -- 172.21.15.53:0/2442928596 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8500cd990 con 0x7ff83c003f70 2023-06-10T19:01:21.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.116+0000 7ff854bce640 1 -- 172.21.15.53:0/2442928596 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8501600d0 con 0x7ff83c004d10 2023-06-10T19:01:21.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.116+0000 7ff854bce640 1 -- 172.21.15.53:0/2442928596 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff83c00b990 con 0x7ff8500afe30 2023-06-10T19:01:21.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.116+0000 7ff8553cf640 1 --2- 172.21.15.53:0/2442928596 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff83c003f70 0x7ff83c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:21.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.116+0000 7ff855bd0640 1 --2- 172.21.15.53:0/2442928596 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8500afe30 0x7ff83c0039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:21.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.116+0000 7ff8563d1640 1 --2- 172.21.15.53:0/2442928596 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff83c004d10 0x7ff83c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:21.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.116+0000 7ff8553cf640 1 -- 172.21.15.53:0/2442928596 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8500afe30 msgr2=0x7ff83c0039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:21.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.116+0000 7ff8553cf640 1 --2- 172.21.15.53:0/2442928596 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8500afe30 0x7ff83c0039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:21.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.116+0000 7ff8553cf640 1 -- 172.21.15.53:0/2442928596 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff83c004d10 msgr2=0x7ff83c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:21.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.116+0000 7ff8553cf640 1 --2- 172.21.15.53:0/2442928596 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff83c004d10 0x7ff83c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:21.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.116+0000 7ff8553cf640 1 -- 172.21.15.53:0/2442928596 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff83c003530 con 0x7ff83c003f70 2023-06-10T19:01:21.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.116+0000 7ff8563d1640 1 --2- 172.21.15.53:0/2442928596 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff83c004d10 0x7ff83c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:01:21.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.120+0000 7ff8553cf640 1 --2- 172.21.15.53:0/2442928596 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff83c003f70 0x7ff83c0047d0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7ff84000c270 tx=0x7ff84001f3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=501c7473b7d21ca8 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:21.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.120+0000 7ff854bce640 1 -- 172.21.15.53:0/2442928596 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff840005ae0 con 0x7ff83c003f70 2023-06-10T19:01:21.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.120+0000 7ff854bce640 1 -- 172.21.15.53:0/2442928596 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8400ab070 con 0x7ff83c003f70 2023-06-10T19:01:21.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.120+0000 7ff854bce640 1 -- 172.21.15.53:0/2442928596 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff840007070 con 0x7ff83c003f70 2023-06-10T19:01:21.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.120+0000 7ff857e34640 1 -- 172.21.15.53:0/2442928596 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff83c003f70 msgr2=0x7ff83c0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:21.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.120+0000 7ff857e34640 1 --2- 172.21.15.53:0/2442928596 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff83c003f70 0x7ff83c0047d0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7ff84000c270 tx=0x7ff84001f3b0 comp rx=0 tx=0).stop 2023-06-10T19:01:21.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.120+0000 7ff8563d1640 1 -- 172.21.15.53:0/2442928596 reap_dead start 2023-06-10T19:01:21.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.120+0000 7ff857e34640 1 -- 172.21.15.53:0/2442928596 shutdown_connections 2023-06-10T19:01:21.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.120+0000 7ff857e34640 1 -- 172.21.15.53:0/2442928596 >> 172.21.15.53:0/2442928596 conn(0x7ff85006a0d0 msgr2=0x7ff8500ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:21.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.120+0000 7ff857e34640 1 -- 172.21.15.53:0/2442928596 shutdown_connections 2023-06-10T19:01:21.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.120+0000 7ff857e34640 1 -- 172.21.15.53:0/2442928596 wait complete. 2023-06-10T19:01:21.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.120+0000 7ff857e34640 1 Processor -- start 2023-06-10T19:01:21.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.120+0000 7ff857e34640 1 -- start start 2023-06-10T19:01:21.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.124+0000 7ff857e34640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff83c003f70 0x7ff8501502d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:21.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.124+0000 7ff857e34640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff8500ac070 0x7ff8500ac4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:21.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.124+0000 7ff857e34640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8500ae9f0 0x7ff8500aee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:21.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.124+0000 7ff857e34640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8500aca00 con 0x7ff8500ac070 2023-06-10T19:01:21.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.124+0000 7ff857e34640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8500b20c0 con 0x7ff83c003f70 2023-06-10T19:01:21.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.124+0000 7ff857e34640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8500af760 con 0x7ff8500ae9f0 2023-06-10T19:01:21.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.124+0000 7ff8553cf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff8500ac070 0x7ff8500ac4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:21.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.124+0000 7ff8553cf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff8500ac070 0x7ff8500ac4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34006/0 (socket says 172.21.15.53:34006) 2023-06-10T19:01:21.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.124+0000 7ff8553cf640 1 -- 172.21.15.53:0/632650126 learned_addr learned my addr 172.21.15.53:0/632650126 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:21.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.124+0000 7ff8563d1640 1 --2- 172.21.15.53:0/632650126 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8500ae9f0 0x7ff8500aee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:21.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.124+0000 7ff855bd0640 1 --2- 172.21.15.53:0/632650126 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff83c003f70 0x7ff8501502d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:21.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.124+0000 7ff8553cf640 1 -- 172.21.15.53:0/632650126 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8500ae9f0 msgr2=0x7ff8500aee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:21.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.124+0000 7ff8553cf640 1 --2- 172.21.15.53:0/632650126 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8500ae9f0 0x7ff8500aee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:21.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.124+0000 7ff8553cf640 1 -- 172.21.15.53:0/632650126 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff83c003f70 msgr2=0x7ff8501502d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:21.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.124+0000 7ff8553cf640 1 --2- 172.21.15.53:0/632650126 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff83c003f70 0x7ff8501502d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:21.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.124+0000 7ff8553cf640 1 -- 172.21.15.53:0/632650126 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8500b1790 con 0x7ff8500ac070 2023-06-10T19:01:21.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.124+0000 7ff855bd0640 1 --2- 172.21.15.53:0/632650126 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff83c003f70 0x7ff8501502d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:01:21.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.124+0000 7ff8553cf640 1 --2- 172.21.15.53:0/632650126 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff8500ac070 0x7ff8500ac4c0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7ff84001f1e0 tx=0x7ff83c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:21.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.124+0000 7ff8467fc640 1 -- 172.21.15.53:0/632650126 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8400b7070 con 0x7ff8500ac070 2023-06-10T19:01:21.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.124+0000 7ff8467fc640 1 -- 172.21.15.53:0/632650126 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8400047f0 con 0x7ff8500ac070 2023-06-10T19:01:21.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.124+0000 7ff857e34640 1 -- 172.21.15.53:0/632650126 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8500b1a70 con 0x7ff8500ac070 2023-06-10T19:01:21.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.124+0000 7ff8467fc640 1 -- 172.21.15.53:0/632650126 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff840004b60 con 0x7ff8500ac070 2023-06-10T19:01:21.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.124+0000 7ff857e34640 1 -- 172.21.15.53:0/632650126 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8500af3a0 con 0x7ff8500ac070 2023-06-10T19:01:21.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.124+0000 7ff857e34640 1 -- 172.21.15.53:0/632650126 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff85004d790 con 0x7ff8500ac070 2023-06-10T19:01:21.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.124+0000 7ff8467fc640 1 -- 172.21.15.53:0/632650126 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff8400ad020 con 0x7ff8500ac070 2023-06-10T19:01:21.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.124+0000 7ff8467fc640 1 --2- 172.21.15.53:0/632650126 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff8340662b0 0x7ff834068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:21.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.124+0000 7ff8467fc640 1 -- 172.21.15.53:0/632650126 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6148+0+0 (secure 0 0 0) 0x7ff8401208b0 con 0x7ff8500ac070 2023-06-10T19:01:21.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.124+0000 7ff855bd0640 1 --2- 172.21.15.53:0/632650126 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff8340662b0 0x7ff834068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:21.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.128+0000 7ff855bd0640 1 --2- 172.21.15.53:0/632650126 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff8340662b0 0x7ff834068760 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7ff84c009af0 tx=0x7ff84c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:21.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.128+0000 7ff8467fc640 1 -- 172.21.15.53:0/632650126 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff8400edd40 con 0x7ff8500ac070 2023-06-10T19:01:21.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.320+0000 7ff857e34640 1 -- 172.21.15.53:0/632650126 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff85015f010 con 0x7ff8500ac070 2023-06-10T19:01:21.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.324+0000 7ff8467fc640 1 -- 172.21.15.53:0/632650126 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4683 (secure 0 0 0) 0x7ff8400f1360 con 0x7ff8500ac070 2023-06-10T19:01:21.328 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:01:21.328 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":38,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5663,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2600814414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2600814414},{"type":"v1","addr":"172.21.15.117:6835","nonce":2600814414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6136,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1615882017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1615882017},{"type":"v1","addr":"172.21.15.117:6837","nonce":1615882017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6993,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/3732245174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3732245174},{"type":"v1","addr":"172.21.15.53:6833","nonce":3732245174}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:00:20.607950+0000","modified":"2023-06-10T19:00:49.023162+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7266":{"gid":7266,"name":"c","rank":0,"incarnation":37,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.53:6835/2829993338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2829993338},{"type":"v1","addr":"172.21.15.53:6835","nonce":2829993338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-06-10T19:01:21.329 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 38 2023-06-10T19:01:21.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.324+0000 7ff857e34640 1 -- 172.21.15.53:0/632650126 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff8340662b0 msgr2=0x7ff834068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:21.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.324+0000 7ff857e34640 1 --2- 172.21.15.53:0/632650126 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff8340662b0 0x7ff834068760 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7ff84c009af0 tx=0x7ff84c008040 comp rx=0 tx=0).stop 2023-06-10T19:01:21.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.324+0000 7ff857e34640 1 -- 172.21.15.53:0/632650126 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff8500ac070 msgr2=0x7ff8500ac4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:21.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.324+0000 7ff857e34640 1 --2- 172.21.15.53:0/632650126 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff8500ac070 0x7ff8500ac4c0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7ff84001f1e0 tx=0x7ff83c005800 comp rx=0 tx=0).stop 2023-06-10T19:01:21.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.324+0000 7ff857e34640 1 -- 172.21.15.53:0/632650126 shutdown_connections 2023-06-10T19:01:21.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.324+0000 7ff857e34640 1 --2- 172.21.15.53:0/632650126 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff8340662b0 0x7ff834068760 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:21.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.324+0000 7ff857e34640 1 --2- 172.21.15.53:0/632650126 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8500ae9f0 0x7ff8500aee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:21.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.324+0000 7ff857e34640 1 --2- 172.21.15.53:0/632650126 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff8500ac070 0x7ff8500ac4c0 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:21.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.324+0000 7ff857e34640 1 --2- 172.21.15.53:0/632650126 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff83c003f70 0x7ff8501502d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:21.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.324+0000 7ff857e34640 1 -- 172.21.15.53:0/632650126 >> 172.21.15.53:0/632650126 conn(0x7ff85006a0d0 msgr2=0x7ff85015f4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:21.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.324+0000 7ff857e34640 1 -- 172.21.15.53:0/632650126 shutdown_connections 2023-06-10T19:01:21.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:21.324+0000 7ff857e34640 1 -- 172.21.15.53:0/632650126 wait complete. 2023-06-10T19:01:21.348 DEBUG:tasks.cephfs.filesystem:mapped states ['up:reconnect'] to None 2023-06-10T19:01:22.349 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:01:22.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:22.476+0000 7f0b6aead640 1 Processor -- start 2023-06-10T19:01:22.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:22.476+0000 7f0b6aead640 1 -- start start 2023-06-10T19:01:22.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:22.480+0000 7f0b6aead640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0b640c9840 0x7f0b640c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:22.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:22.480+0000 7f0b6aead640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0b64071060 0x7f0b640af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:22.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:22.480+0000 7f0b6aead640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b64159b50 con 0x7f0b640afc60 2023-06-10T19:01:22.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:22.480+0000 7f0b6aead640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b640ca150 con 0x7f0b640c9840 2023-06-10T19:01:22.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:22.480+0000 7f0b6aead640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b640702a0 con 0x7f0b64071060 2023-06-10T19:01:22.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:22.480+0000 7f0b68c49640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0b640c9840 0x7f0b640c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:22.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:22.480+0000 7f0b68c49640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0b640c9840 0x7f0b640c9c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53510/0 (socket says 172.21.15.53:53510) 2023-06-10T19:01:22.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:22.480+0000 7f0b68c49640 1 -- 172.21.15.53:0/3536135381 learned_addr learned my addr 172.21.15.53:0/3536135381 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:22.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:22.480+0000 7f0b6944a640 1 --1- 172.21.15.53:0/3536135381 >> v1:172.21.15.53:6789/0 conn(0x7f0b640afc60 0x7f0b6415d2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:53726/0 (socket says 172.21.15.53:53726) 2023-06-10T19:01:22.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:22.480+0000 7f0b68c49640 1 -- 172.21.15.53:0/3536135381 >> v2:172.21.15.117:3300/0 conn(0x7f0b64071060 msgr2=0x7f0b640af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:22.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:22.480+0000 7f0b63fff640 1 --2- 172.21.15.53:0/3536135381 >> v2:172.21.15.117:3300/0 conn(0x7f0b64071060 0x7f0b640af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:22.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:22.480+0000 7f0b68c49640 1 --2- 172.21.15.53:0/3536135381 >> v2:172.21.15.117:3300/0 conn(0x7f0b64071060 0x7f0b640af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:22.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:22.480+0000 7f0b68c49640 1 -- 172.21.15.53:0/3536135381 >> v1:172.21.15.53:6789/0 conn(0x7f0b640afc60 legacy=0x7f0b6415d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:22.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:22.480+0000 7f0b68c49640 1 -- 172.21.15.53:0/3536135381 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b64070580 con 0x7f0b640c9840 2023-06-10T19:01:22.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:22.480+0000 7f0b637fe640 1 -- 172.21.15.53:0/3536135381 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1939262605 0 0) 0x7f0b64159b50 con 0x7f0b640afc60 2023-06-10T19:01:22.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:22.480+0000 7f0b63fff640 1 --2- 172.21.15.53:0/3536135381 >> v2:172.21.15.117:3300/0 conn(0x7f0b64071060 0x7f0b640af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:01:22.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:22.480+0000 7f0b68c49640 1 --2- 172.21.15.53:0/3536135381 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b640c9840 0x7f0b640c9c10 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f0b6406e650 tx=0x7f0b4c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=352b11b06881285b server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:22.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:22.480+0000 7f0b637fe640 1 -- 172.21.15.53:0/3536135381 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c0ab5f0 con 0x7f0b640c9840 2023-06-10T19:01:22.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:22.480+0000 7f0b637fe640 1 -- 172.21.15.53:0/3536135381 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b4c0ab750 con 0x7f0b640c9840 2023-06-10T19:01:22.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:22.480+0000 7f0b637fe640 1 -- 172.21.15.53:0/3536135381 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c0abae0 con 0x7f0b640c9840 2023-06-10T19:01:22.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:22.484+0000 7f0b6aead640 1 -- 172.21.15.53:0/3536135381 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b640c9840 msgr2=0x7f0b640c9c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:22.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:22.484+0000 7f0b6aead640 1 --2- 172.21.15.53:0/3536135381 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b640c9840 0x7f0b640c9c10 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f0b6406e650 tx=0x7f0b4c01c4d0 comp rx=0 tx=0).stop 2023-06-10T19:01:22.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:22.484+0000 7f0b6aead640 1 -- 172.21.15.53:0/3536135381 shutdown_connections 2023-06-10T19:01:22.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:22.484+0000 7f0b6aead640 1 --2- 172.21.15.53:0/3536135381 >> v2:172.21.15.117:3300/0 conn(0x7f0b64071060 0x7f0b640af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:22.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:22.484+0000 7f0b6aead640 1 --2- 172.21.15.53:0/3536135381 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b640c9840 0x7f0b640c9c10 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:22.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:22.484+0000 7f0b6aead640 1 -- 172.21.15.53:0/3536135381 >> 172.21.15.53:0/3536135381 conn(0x7f0b6406a0d0 msgr2=0x7f0b640ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:22.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:22.484+0000 7f0b6aead640 1 -- 172.21.15.53:0/3536135381 shutdown_connections 2023-06-10T19:01:22.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:22.484+0000 7f0b6aead640 1 -- 172.21.15.53:0/3536135381 wait complete. 2023-06-10T19:01:22.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:22.484+0000 7f0b6aead640 1 Processor -- start 2023-06-10T19:01:22.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:22.484+0000 7f0b6aead640 1 -- start start 2023-06-10T19:01:22.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:22.484+0000 7f0b6aead640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b64071060 0x7f0b640b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:22.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:22.484+0000 7f0b6aead640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b640afc60 0x7f0b640c3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:22.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:22.484+0000 7f0b6aead640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b640c9840 0x7f0b640aeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:22.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:22.484+0000 7f0b6aead640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b640c3760 con 0x7f0b640c9840 2023-06-10T19:01:22.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:22.484+0000 7f0b6aead640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b640c2e50 con 0x7f0b640afc60 2023-06-10T19:01:22.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:22.484+0000 7f0b6aead640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b640c6e30 con 0x7f0b64071060 2023-06-10T19:01:22.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:22.484+0000 7f0b6944a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b640c9840 0x7f0b640aeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:22.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:22.484+0000 7f0b6944a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b640c9840 0x7f0b640aeaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53518/0 (socket says 172.21.15.53:53518) 2023-06-10T19:01:22.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:22.484+0000 7f0b6944a640 1 -- 172.21.15.53:0/1232876882 learned_addr learned my addr 172.21.15.53:0/1232876882 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:22.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:22.484+0000 7f0b6944a640 1 -- 172.21.15.53:0/1232876882 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b64071060 msgr2=0x7f0b640b32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:22.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:22.484+0000 7f0b63fff640 1 --2- 172.21.15.53:0/1232876882 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b640afc60 0x7f0b640c3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:22.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:22.484+0000 7f0b68c49640 1 --2- 172.21.15.53:0/1232876882 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b64071060 0x7f0b640b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:22.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:22.484+0000 7f0b6944a640 1 --2- 172.21.15.53:0/1232876882 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b64071060 0x7f0b640b32e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:22.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:22.484+0000 7f0b6944a640 1 -- 172.21.15.53:0/1232876882 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b640afc60 msgr2=0x7f0b640c3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:22.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:22.484+0000 7f0b6944a640 1 --2- 172.21.15.53:0/1232876882 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b640afc60 0x7f0b640c3bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:22.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:22.484+0000 7f0b6944a640 1 -- 172.21.15.53:0/1232876882 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b4c0094d0 con 0x7f0b640c9840 2023-06-10T19:01:22.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:22.484+0000 7f0b6944a640 1 --2- 172.21.15.53:0/1232876882 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b640c9840 0x7f0b640aeaf0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c00c470 tx=0x7f0b5c00c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:22.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:22.484+0000 7f0b617fa640 1 -- 172.21.15.53:0/1232876882 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5c0074e0 con 0x7f0b640c9840 2023-06-10T19:01:22.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:22.484+0000 7f0b617fa640 1 -- 172.21.15.53:0/1232876882 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b5c007640 con 0x7f0b640c9840 2023-06-10T19:01:22.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:22.484+0000 7f0b6aead640 1 -- 172.21.15.53:0/1232876882 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b640c3110 con 0x7f0b640c9840 2023-06-10T19:01:22.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:22.484+0000 7f0b617fa640 1 -- 172.21.15.53:0/1232876882 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5c004a30 con 0x7f0b640c9840 2023-06-10T19:01:22.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:22.484+0000 7f0b6aead640 1 -- 172.21.15.53:0/1232876882 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b640c4130 con 0x7f0b640c9840 2023-06-10T19:01:22.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:22.488+0000 7f0b6aead640 1 -- 172.21.15.53:0/1232876882 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b640c3910 con 0x7f0b640c9840 2023-06-10T19:01:22.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:22.488+0000 7f0b617fa640 1 -- 172.21.15.53:0/1232876882 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0b5c004b90 con 0x7f0b640c9840 2023-06-10T19:01:22.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:22.488+0000 7f0b617fa640 1 --2- 172.21.15.53:0/1232876882 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0b44066280 0x7f0b44068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:22.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:22.488+0000 7f0b617fa640 1 -- 172.21.15.53:0/1232876882 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f0b5c083190 con 0x7f0b640c9840 2023-06-10T19:01:22.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:22.488+0000 7f0b68c49640 1 --2- 172.21.15.53:0/1232876882 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0b44066280 0x7f0b44068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:22.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:22.488+0000 7f0b68c49640 1 --2- 172.21.15.53:0/1232876882 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0b44066280 0x7f0b44068730 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c0af000 tx=0x7f0b4c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:22.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:22.492+0000 7f0b617fa640 1 -- 172.21.15.53:0/1232876882 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0b640c3910 con 0x7f0b640c9840 2023-06-10T19:01:22.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:22.676+0000 7f0b6aead640 1 -- 172.21.15.53:0/1232876882 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0b6404d790 con 0x7f0b640c9840 2023-06-10T19:01:22.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:22.676+0000 7f0b617fa640 1 -- 172.21.15.53:0/1232876882 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4683 (secure 0 0 0) 0x7f0b5c050640 con 0x7f0b640c9840 2023-06-10T19:01:22.681 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:01:22.681 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":38,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5663,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2600814414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2600814414},{"type":"v1","addr":"172.21.15.117:6835","nonce":2600814414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6136,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1615882017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1615882017},{"type":"v1","addr":"172.21.15.117:6837","nonce":1615882017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6993,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/3732245174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3732245174},{"type":"v1","addr":"172.21.15.53:6833","nonce":3732245174}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:00:20.607950+0000","modified":"2023-06-10T19:00:49.023162+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7266":{"gid":7266,"name":"c","rank":0,"incarnation":37,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.53:6835/2829993338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2829993338},{"type":"v1","addr":"172.21.15.53:6835","nonce":2829993338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-06-10T19:01:22.682 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 38 2023-06-10T19:01:22.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:22.676+0000 7f0b6aead640 1 -- 172.21.15.53:0/1232876882 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0b44066280 msgr2=0x7f0b44068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:22.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:22.676+0000 7f0b6aead640 1 --2- 172.21.15.53:0/1232876882 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0b44066280 0x7f0b44068730 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c0af000 tx=0x7f0b4c008040 comp rx=0 tx=0).stop 2023-06-10T19:01:22.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:22.676+0000 7f0b6aead640 1 -- 172.21.15.53:0/1232876882 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b640c9840 msgr2=0x7f0b640aeaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:22.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:22.676+0000 7f0b6aead640 1 --2- 172.21.15.53:0/1232876882 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b640c9840 0x7f0b640aeaf0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c00c470 tx=0x7f0b5c00c930 comp rx=0 tx=0).stop 2023-06-10T19:01:22.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:22.676+0000 7f0b6aead640 1 -- 172.21.15.53:0/1232876882 shutdown_connections 2023-06-10T19:01:22.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:22.676+0000 7f0b6aead640 1 --2- 172.21.15.53:0/1232876882 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0b44066280 0x7f0b44068730 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:22.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:22.676+0000 7f0b6aead640 1 --2- 172.21.15.53:0/1232876882 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b640c9840 0x7f0b640aeaf0 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:22.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:22.676+0000 7f0b6aead640 1 --2- 172.21.15.53:0/1232876882 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b640afc60 0x7f0b640c3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:22.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:22.676+0000 7f0b6aead640 1 --2- 172.21.15.53:0/1232876882 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b64071060 0x7f0b640b32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:22.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:22.676+0000 7f0b6aead640 1 -- 172.21.15.53:0/1232876882 >> 172.21.15.53:0/1232876882 conn(0x7f0b6406a0d0 msgr2=0x7f0b640adc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:22.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:22.676+0000 7f0b6aead640 1 -- 172.21.15.53:0/1232876882 shutdown_connections 2023-06-10T19:01:22.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:22.680+0000 7f0b6aead640 1 -- 172.21.15.53:0/1232876882 wait complete. 2023-06-10T19:01:22.698 DEBUG:tasks.cephfs.filesystem:mapped states ['up:reconnect'] to None 2023-06-10T19:01:23.699 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:01:23.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:23.832+0000 7f1064a96640 1 Processor -- start 2023-06-10T19:01:23.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:23.832+0000 7f1064a96640 1 -- start start 2023-06-10T19:01:23.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:23.832+0000 7f1064a96640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f10600c9840 0x7f10600c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:23.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:23.832+0000 7f1064a96640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1060071060 0x7f10600af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:23.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:23.832+0000 7f1064a96640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f10600afc60 0x7f106015d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:23.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:23.832+0000 7f1064a96640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1060159b50 con 0x7f10600afc60 2023-06-10T19:01:23.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:23.832+0000 7f1064a96640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10600ca150 con 0x7f1060071060 2023-06-10T19:01:23.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:23.832+0000 7f1064a96640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10600702a0 con 0x7f10600c9840 2023-06-10T19:01:23.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:23.832+0000 7f105ed9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f10600afc60 0x7f106015d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:23.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:23.832+0000 7f105ed9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f10600afc60 0x7f106015d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53530/0 (socket says 172.21.15.53:53530) 2023-06-10T19:01:23.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:23.832+0000 7f105ed9d640 1 -- 172.21.15.53:0/2048654899 learned_addr learned my addr 172.21.15.53:0/2048654899 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:23.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:23.832+0000 7f105e59c640 1 --2- 172.21.15.53:0/2048654899 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f10600c9840 0x7f10600c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:23.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:23.832+0000 7f105dd9b640 1 --2- 172.21.15.53:0/2048654899 >> v2:172.21.15.117:3300/0 conn(0x7f1060071060 0x7f10600af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:23.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:23.832+0000 7f105ed9d640 1 -- 172.21.15.53:0/2048654899 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f10600c9840 msgr2=0x7f10600c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:23.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:23.832+0000 7f105ed9d640 1 --2- 172.21.15.53:0/2048654899 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f10600c9840 0x7f10600c9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:23.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:23.832+0000 7f105ed9d640 1 -- 172.21.15.53:0/2048654899 >> v2:172.21.15.117:3300/0 conn(0x7f1060071060 msgr2=0x7f10600af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:23.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:23.832+0000 7f105ed9d640 1 --2- 172.21.15.53:0/2048654899 >> v2:172.21.15.117:3300/0 conn(0x7f1060071060 0x7f10600af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:23.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:23.832+0000 7f105ed9d640 1 -- 172.21.15.53:0/2048654899 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1060070580 con 0x7f10600afc60 2023-06-10T19:01:23.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:23.836+0000 7f105ed9d640 1 --2- 172.21.15.53:0/2048654899 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10600afc60 0x7f106015d2c0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f106006e560 tx=0x7f105801c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=838048b8284d7f9e server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:23.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:23.836+0000 7f105d59a640 1 -- 172.21.15.53:0/2048654899 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10580a5560 con 0x7f10600afc60 2023-06-10T19:01:23.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:23.836+0000 7f105d59a640 1 -- 172.21.15.53:0/2048654899 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10580a56c0 con 0x7f10600afc60 2023-06-10T19:01:23.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:23.836+0000 7f105d59a640 1 -- 172.21.15.53:0/2048654899 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10580a5a50 con 0x7f10600afc60 2023-06-10T19:01:23.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:23.836+0000 7f1064a96640 1 -- 172.21.15.53:0/2048654899 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10600afc60 msgr2=0x7f106015d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:23.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:23.836+0000 7f1064a96640 1 --2- 172.21.15.53:0/2048654899 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10600afc60 0x7f106015d2c0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f106006e560 tx=0x7f105801c6e0 comp rx=0 tx=0).stop 2023-06-10T19:01:23.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:23.836+0000 7f1064a96640 1 -- 172.21.15.53:0/2048654899 shutdown_connections 2023-06-10T19:01:23.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:23.836+0000 7f1064a96640 1 --2- 172.21.15.53:0/2048654899 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10600afc60 0x7f106015d2c0 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:23.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:23.836+0000 7f1064a96640 1 --2- 172.21.15.53:0/2048654899 >> v2:172.21.15.117:3300/0 conn(0x7f1060071060 0x7f10600af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:23.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:23.836+0000 7f1064a96640 1 --2- 172.21.15.53:0/2048654899 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f10600c9840 0x7f10600c9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:23.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:23.836+0000 7f1064a96640 1 -- 172.21.15.53:0/2048654899 >> 172.21.15.53:0/2048654899 conn(0x7f106006a0d0 msgr2=0x7f10600ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:23.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:23.836+0000 7f1064a96640 1 -- 172.21.15.53:0/2048654899 shutdown_connections 2023-06-10T19:01:23.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:23.836+0000 7f1064a96640 1 -- 172.21.15.53:0/2048654899 wait complete. 2023-06-10T19:01:23.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:23.836+0000 7f1064a96640 1 Processor -- start 2023-06-10T19:01:23.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:23.836+0000 7f1064a96640 1 -- start start 2023-06-10T19:01:23.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:23.836+0000 7f1064a96640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1060071060 0x7f10600b0e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:23.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:23.836+0000 7f1064a96640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10600afc60 0x7f10600c17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:23.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:23.836+0000 7f1064a96640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10600c9840 0x7f106015c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:23.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:23.836+0000 7f1064a96640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10600b39b0 con 0x7f10600c9840 2023-06-10T19:01:23.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:23.836+0000 7f1064a96640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10601530a0 con 0x7f10600afc60 2023-06-10T19:01:23.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:23.836+0000 7f1064a96640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10600c4030 con 0x7f1060071060 2023-06-10T19:01:23.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:23.836+0000 7f105ed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10600c9840 0x7f106015c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:23.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:23.836+0000 7f105ed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10600c9840 0x7f106015c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53544/0 (socket says 172.21.15.53:53544) 2023-06-10T19:01:23.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:23.836+0000 7f105ed9d640 1 -- 172.21.15.53:0/959611114 learned_addr learned my addr 172.21.15.53:0/959611114 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:23.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:23.840+0000 7f105e59c640 1 --2- 172.21.15.53:0/959611114 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1060071060 0x7f10600b0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:23.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:23.840+0000 7f105dd9b640 1 --2- 172.21.15.53:0/959611114 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10600afc60 0x7f10600c17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:23.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:23.840+0000 7f105ed9d640 1 -- 172.21.15.53:0/959611114 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1060071060 msgr2=0x7f10600b0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:23.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:23.840+0000 7f105ed9d640 1 --2- 172.21.15.53:0/959611114 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1060071060 0x7f10600b0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:23.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:23.840+0000 7f105ed9d640 1 -- 172.21.15.53:0/959611114 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10600afc60 msgr2=0x7f10600c17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:23.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:23.840+0000 7f105ed9d640 1 --2- 172.21.15.53:0/959611114 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10600afc60 0x7f10600c17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:23.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:23.840+0000 7f105ed9d640 1 -- 172.21.15.53:0/959611114 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1058009b30 con 0x7f10600c9840 2023-06-10T19:01:23.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:23.840+0000 7f105ed9d640 1 --2- 172.21.15.53:0/959611114 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10600c9840 0x7f106015c0a0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f10580af040 tx=0x7f1058019480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:23.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:23.840+0000 7f104effd640 1 -- 172.21.15.53:0/959611114 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10580b8670 con 0x7f10600c9840 2023-06-10T19:01:23.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:23.840+0000 7f104effd640 1 -- 172.21.15.53:0/959611114 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10580b87d0 con 0x7f10600c9840 2023-06-10T19:01:23.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:23.840+0000 7f1064a96640 1 -- 172.21.15.53:0/959611114 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f106015d570 con 0x7f10600c9840 2023-06-10T19:01:23.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:23.840+0000 7f104effd640 1 -- 172.21.15.53:0/959611114 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10580b8b40 con 0x7f10600c9840 2023-06-10T19:01:23.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:23.840+0000 7f1064a96640 1 -- 172.21.15.53:0/959611114 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f106015cfb0 con 0x7f10600c9840 2023-06-10T19:01:23.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:23.840+0000 7f1064a96640 1 -- 172.21.15.53:0/959611114 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f106006b010 con 0x7f10600c9840 2023-06-10T19:01:23.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:23.840+0000 7f104effd640 1 -- 172.21.15.53:0/959611114 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f10580b8ca0 con 0x7f10600c9840 2023-06-10T19:01:23.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:23.840+0000 7f104effd640 1 --2- 172.21.15.53:0/959611114 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1040066280 0x7f1040068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:23.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:23.840+0000 7f104effd640 1 -- 172.21.15.53:0/959611114 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f105811f280 con 0x7f10600c9840 2023-06-10T19:01:23.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:23.840+0000 7f105e59c640 1 --2- 172.21.15.53:0/959611114 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1040066280 0x7f1040068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:23.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:23.840+0000 7f105e59c640 1 --2- 172.21.15.53:0/959611114 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1040066280 0x7f1040068730 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f1060153b80 tx=0x7f1050008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:23.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:23.844+0000 7f104effd640 1 -- 172.21.15.53:0/959611114 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f10580ec740 con 0x7f10600c9840 2023-06-10T19:01:24.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:24.024+0000 7f1064a96640 1 -- 172.21.15.53:0/959611114 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f106004d790 con 0x7f10600c9840 2023-06-10T19:01:24.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:24.024+0000 7f104effd640 1 -- 172.21.15.53:0/959611114 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4683 (secure 0 0 0) 0x7f1058009510 con 0x7f10600c9840 2023-06-10T19:01:24.030 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:01:24.031 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":38,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5663,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2600814414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2600814414},{"type":"v1","addr":"172.21.15.117:6835","nonce":2600814414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6136,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1615882017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1615882017},{"type":"v1","addr":"172.21.15.117:6837","nonce":1615882017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6993,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/3732245174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3732245174},{"type":"v1","addr":"172.21.15.53:6833","nonce":3732245174}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:00:20.607950+0000","modified":"2023-06-10T19:00:49.023162+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7266":{"gid":7266,"name":"c","rank":0,"incarnation":37,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.53:6835/2829993338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2829993338},{"type":"v1","addr":"172.21.15.53:6835","nonce":2829993338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-06-10T19:01:24.031 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 38 2023-06-10T19:01:24.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:24.028+0000 7f1064a96640 1 -- 172.21.15.53:0/959611114 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1040066280 msgr2=0x7f1040068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:24.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:24.028+0000 7f1064a96640 1 --2- 172.21.15.53:0/959611114 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1040066280 0x7f1040068730 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f1060153b80 tx=0x7f1050008040 comp rx=0 tx=0).stop 2023-06-10T19:01:24.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:24.028+0000 7f1064a96640 1 -- 172.21.15.53:0/959611114 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10600c9840 msgr2=0x7f106015c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:24.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:24.028+0000 7f1064a96640 1 --2- 172.21.15.53:0/959611114 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10600c9840 0x7f106015c0a0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f10580af040 tx=0x7f1058019480 comp rx=0 tx=0).stop 2023-06-10T19:01:24.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:24.028+0000 7f1064a96640 1 -- 172.21.15.53:0/959611114 shutdown_connections 2023-06-10T19:01:24.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:24.028+0000 7f1064a96640 1 --2- 172.21.15.53:0/959611114 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1040066280 0x7f1040068730 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:24.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:24.028+0000 7f1064a96640 1 --2- 172.21.15.53:0/959611114 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10600c9840 0x7f106015c0a0 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:24.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:24.028+0000 7f1064a96640 1 --2- 172.21.15.53:0/959611114 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10600afc60 0x7f10600c17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:24.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:24.028+0000 7f1064a96640 1 --2- 172.21.15.53:0/959611114 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1060071060 0x7f10600b0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:24.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:24.028+0000 7f1064a96640 1 -- 172.21.15.53:0/959611114 >> 172.21.15.53:0/959611114 conn(0x7f106006a0d0 msgr2=0x7f106006b4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:24.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:24.028+0000 7f1064a96640 1 -- 172.21.15.53:0/959611114 shutdown_connections 2023-06-10T19:01:24.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:24.028+0000 7f1064a96640 1 -- 172.21.15.53:0/959611114 wait complete. 2023-06-10T19:01:24.048 DEBUG:tasks.cephfs.filesystem:mapped states ['up:reconnect'] to None 2023-06-10T19:01:25.049 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:01:25.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:25.180+0000 7fdd04862640 1 Processor -- start 2023-06-10T19:01:25.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:25.180+0000 7fdd04862640 1 -- start start 2023-06-10T19:01:25.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:25.180+0000 7fdd04862640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fdd000b3ac0 0x7fdd000b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:25.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:25.180+0000 7fdd04862640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fdd000cc690 0x7fdd0015f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:25.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:25.180+0000 7fdd04862640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd000d0020 con 0x7fdd000ccae0 2023-06-10T19:01:25.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:25.180+0000 7fdd04862640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd000b43d0 con 0x7fdd000b3ac0 2023-06-10T19:01:25.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:25.180+0000 7fdd04862640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd000cef40 con 0x7fdd000cc690 2023-06-10T19:01:25.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:25.180+0000 7fdcfe59c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fdd000b3ac0 0x7fdd000b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:25.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:25.180+0000 7fdcfed9d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fdd000ccae0 0x7fdd0015f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:53728/0 (socket says 172.21.15.53:53728) 2023-06-10T19:01:25.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:25.180+0000 7fdcfed9d640 1 -- 172.21.15.53:0/206186815 learned_addr learned my addr 172.21.15.53:0/206186815 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:01:25.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:25.180+0000 7fdcfd59a640 1 -- 172.21.15.53:0/206186815 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1878645296 0 0) 0x7fdd000d0020 con 0x7fdd000ccae0 2023-06-10T19:01:25.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:25.180+0000 7fdcfd59a640 1 -- 172.21.15.53:0/206186815 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdce8003530 con 0x7fdd000ccae0 2023-06-10T19:01:25.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:25.180+0000 7fdcfdd9b640 1 --2- 172.21.15.53:0/206186815 >> v2:172.21.15.117:3300/0 conn(0x7fdd000cc690 0x7fdd0015f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:25.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:25.180+0000 7fdcfe59c640 1 -- 172.21.15.53:0/206186815 >> v2:172.21.15.117:3300/0 conn(0x7fdd000cc690 msgr2=0x7fdd0015f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:25.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:25.180+0000 7fdcfe59c640 1 --2- 172.21.15.53:0/206186815 >> v2:172.21.15.117:3300/0 conn(0x7fdd000cc690 0x7fdd0015f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:25.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:25.180+0000 7fdcfe59c640 1 -- 172.21.15.53:0/206186815 >> v1:172.21.15.53:6789/0 conn(0x7fdd000ccae0 legacy=0x7fdd0015f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:25.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:25.180+0000 7fdcfe59c640 1 -- 172.21.15.53:0/206186815 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd000cf220 con 0x7fdd000b3ac0 2023-06-10T19:01:25.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:25.184+0000 7fdcfe59c640 1 --2- 172.21.15.53:0/206186815 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd000b3ac0 0x7fdd000b3e90 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7fdd0008aa80 tx=0x7fdcf001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50877c651bd2fd65 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:25.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:25.184+0000 7fdcfd59a640 1 -- 172.21.15.53:0/206186815 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf00ab600 con 0x7fdd000b3ac0 2023-06-10T19:01:25.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:25.184+0000 7fdcfd59a640 1 -- 172.21.15.53:0/206186815 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcf00a7050 con 0x7fdd000b3ac0 2023-06-10T19:01:25.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:25.184+0000 7fdcfd59a640 1 -- 172.21.15.53:0/206186815 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf00ab980 con 0x7fdd000b3ac0 2023-06-10T19:01:25.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:25.184+0000 7fdd04862640 1 -- 172.21.15.53:0/206186815 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd000b3ac0 msgr2=0x7fdd000b3e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:25.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:25.184+0000 7fdd04862640 1 --2- 172.21.15.53:0/206186815 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd000b3ac0 0x7fdd000b3e90 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7fdd0008aa80 tx=0x7fdcf001c430 comp rx=0 tx=0).stop 2023-06-10T19:01:25.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:25.184+0000 7fdd04862640 1 -- 172.21.15.53:0/206186815 shutdown_connections 2023-06-10T19:01:25.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:25.184+0000 7fdd04862640 1 --2- 172.21.15.53:0/206186815 >> v2:172.21.15.117:3300/0 conn(0x7fdd000cc690 0x7fdd0015f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:25.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:25.184+0000 7fdd04862640 1 --2- 172.21.15.53:0/206186815 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd000b3ac0 0x7fdd000b3e90 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:25.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:25.184+0000 7fdd04862640 1 -- 172.21.15.53:0/206186815 >> 172.21.15.53:0/206186815 conn(0x7fdd00071790 msgr2=0x7fdd00069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:25.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:25.184+0000 7fdd04862640 1 -- 172.21.15.53:0/206186815 shutdown_connections 2023-06-10T19:01:25.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:25.184+0000 7fdd04862640 1 -- 172.21.15.53:0/206186815 wait complete. 2023-06-10T19:01:25.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:25.184+0000 7fdd04862640 1 Processor -- start 2023-06-10T19:01:25.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:25.184+0000 7fdd04862640 1 -- start start 2023-06-10T19:01:25.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:25.184+0000 7fdd04862640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd000b3ac0 0x7fdd001533b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:25.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:25.184+0000 7fdd04862640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd000cc690 0x7fdd0015c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:25.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:25.184+0000 7fdd04862640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd000ccae0 0x7fdd000cb4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:25.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:25.184+0000 7fdd04862640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd000c8680 con 0x7fdd000cc690 2023-06-10T19:01:25.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:25.184+0000 7fdd04862640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0015ce10 con 0x7fdd000b3ac0 2023-06-10T19:01:25.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:25.184+0000 7fdd04862640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd000c88d0 con 0x7fdd000ccae0 2023-06-10T19:01:25.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:25.184+0000 7fdcfdd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd000cc690 0x7fdd0015c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:25.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:25.184+0000 7fdcfdd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd000cc690 0x7fdd0015c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53548/0 (socket says 172.21.15.53:53548) 2023-06-10T19:01:25.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:25.184+0000 7fdcfdd9b640 1 -- 172.21.15.53:0/2629356413 learned_addr learned my addr 172.21.15.53:0/2629356413 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:25.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:25.184+0000 7fdcfed9d640 1 --2- 172.21.15.53:0/2629356413 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd000ccae0 0x7fdd000cb4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:25.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:25.184+0000 7fdcfe59c640 1 --2- 172.21.15.53:0/2629356413 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd000b3ac0 0x7fdd001533b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:25.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:25.188+0000 7fdcfdd9b640 1 -- 172.21.15.53:0/2629356413 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd000ccae0 msgr2=0x7fdd000cb4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:25.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:25.188+0000 7fdcfdd9b640 1 --2- 172.21.15.53:0/2629356413 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd000ccae0 0x7fdd000cb4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:25.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:25.188+0000 7fdcfdd9b640 1 -- 172.21.15.53:0/2629356413 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd000b3ac0 msgr2=0x7fdd001533b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:25.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:25.188+0000 7fdcfdd9b640 1 --2- 172.21.15.53:0/2629356413 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd000b3ac0 0x7fdd001533b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:25.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:25.188+0000 7fdcfdd9b640 1 -- 172.21.15.53:0/2629356413 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcf0009420 con 0x7fdd000cc690 2023-06-10T19:01:25.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:25.188+0000 7fdcfdd9b640 1 --2- 172.21.15.53:0/2629356413 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd000cc690 0x7fdd0015c8d0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7fdcf400c7f0 tx=0x7fdcf400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:25.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:25.188+0000 7fdceeffd640 1 -- 172.21.15.53:0/2629356413 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf4004220 con 0x7fdd000cc690 2023-06-10T19:01:25.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:25.188+0000 7fdceeffd640 1 -- 172.21.15.53:0/2629356413 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcf40043a0 con 0x7fdd000cc690 2023-06-10T19:01:25.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:25.188+0000 7fdd04862640 1 -- 172.21.15.53:0/2629356413 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd000c8bb0 con 0x7fdd000cc690 2023-06-10T19:01:25.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:25.188+0000 7fdceeffd640 1 -- 172.21.15.53:0/2629356413 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf4004510 con 0x7fdd000cc690 2023-06-10T19:01:25.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:25.188+0000 7fdd04862640 1 -- 172.21.15.53:0/2629356413 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd000c9ab0 con 0x7fdd000cc690 2023-06-10T19:01:25.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:25.188+0000 7fdd04862640 1 -- 172.21.15.53:0/2629356413 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd000c9d90 con 0x7fdd000cc690 2023-06-10T19:01:25.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:25.188+0000 7fdceeffd640 1 -- 172.21.15.53:0/2629356413 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdcf4003a70 con 0x7fdd000cc690 2023-06-10T19:01:25.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:25.188+0000 7fdceeffd640 1 --2- 172.21.15.53:0/2629356413 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdce0066280 0x7fdce0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:25.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:25.188+0000 7fdceeffd640 1 -- 172.21.15.53:0/2629356413 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6148+0+0 (secure 0 0 0) 0x7fdcf40841a0 con 0x7fdd000cc690 2023-06-10T19:01:25.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:25.188+0000 7fdcfe59c640 1 --2- 172.21.15.53:0/2629356413 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdce0066280 0x7fdce0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:25.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:25.188+0000 7fdcfe59c640 1 --2- 172.21.15.53:0/2629356413 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdce0066280 0x7fdce0068730 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fdd00160410 tx=0x7fdcf00a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:25.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:25.192+0000 7fdceeffd640 1 -- 172.21.15.53:0/2629356413 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdcf40516a0 con 0x7fdd000cc690 2023-06-10T19:01:25.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:25.380+0000 7fdd04862640 1 -- 172.21.15.53:0/2629356413 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdd0004d790 con 0x7fdd000cc690 2023-06-10T19:01:25.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:25.380+0000 7fdceeffd640 1 -- 172.21.15.53:0/2629356413 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4683 (secure 0 0 0) 0x7fdcf4054cc0 con 0x7fdd000cc690 2023-06-10T19:01:25.387 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:01:25.388 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":38,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5663,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2600814414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2600814414},{"type":"v1","addr":"172.21.15.117:6835","nonce":2600814414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6136,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1615882017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1615882017},{"type":"v1","addr":"172.21.15.117:6837","nonce":1615882017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6993,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/3732245174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3732245174},{"type":"v1","addr":"172.21.15.53:6833","nonce":3732245174}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:00:20.607950+0000","modified":"2023-06-10T19:00:49.023162+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7266":{"gid":7266,"name":"c","rank":0,"incarnation":37,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.53:6835/2829993338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2829993338},{"type":"v1","addr":"172.21.15.53:6835","nonce":2829993338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-06-10T19:01:25.388 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 38 2023-06-10T19:01:25.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:25.384+0000 7fdd04862640 1 -- 172.21.15.53:0/2629356413 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdce0066280 msgr2=0x7fdce0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:25.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:25.384+0000 7fdd04862640 1 --2- 172.21.15.53:0/2629356413 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdce0066280 0x7fdce0068730 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fdd00160410 tx=0x7fdcf00a6000 comp rx=0 tx=0).stop 2023-06-10T19:01:25.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:25.384+0000 7fdd04862640 1 -- 172.21.15.53:0/2629356413 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd000cc690 msgr2=0x7fdd0015c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:25.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:25.384+0000 7fdd04862640 1 --2- 172.21.15.53:0/2629356413 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd000cc690 0x7fdd0015c8d0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7fdcf400c7f0 tx=0x7fdcf400ccb0 comp rx=0 tx=0).stop 2023-06-10T19:01:25.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:25.384+0000 7fdd04862640 1 -- 172.21.15.53:0/2629356413 shutdown_connections 2023-06-10T19:01:25.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:25.384+0000 7fdd04862640 1 --2- 172.21.15.53:0/2629356413 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdce0066280 0x7fdce0068730 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:25.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:25.384+0000 7fdd04862640 1 --2- 172.21.15.53:0/2629356413 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd000ccae0 0x7fdd000cb4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:25.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:25.384+0000 7fdd04862640 1 --2- 172.21.15.53:0/2629356413 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd000cc690 0x7fdd0015c8d0 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:25.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:25.384+0000 7fdd04862640 1 --2- 172.21.15.53:0/2629356413 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd000b3ac0 0x7fdd001533b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:25.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:25.384+0000 7fdd04862640 1 -- 172.21.15.53:0/2629356413 >> 172.21.15.53:0/2629356413 conn(0x7fdd00071790 msgr2=0x7fdd000b69d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:25.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:25.384+0000 7fdd04862640 1 -- 172.21.15.53:0/2629356413 shutdown_connections 2023-06-10T19:01:25.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:25.384+0000 7fdd04862640 1 -- 172.21.15.53:0/2629356413 wait complete. 2023-06-10T19:01:25.404 DEBUG:tasks.cephfs.filesystem:mapped states ['up:reconnect'] to None 2023-06-10T19:01:26.407 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:01:26.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:26.536+0000 7f08eeac0640 1 Processor -- start 2023-06-10T19:01:26.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:26.536+0000 7f08eeac0640 1 -- start start 2023-06-10T19:01:26.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:26.536+0000 7f08eeac0640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f08e8159450 0x7f08e815d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:26.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:26.536+0000 7f08eeac0640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08e80cbac0 con 0x7f08e80cf350 2023-06-10T19:01:26.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:26.536+0000 7f08eeac0640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08e815dc00 con 0x7f08e815d680 2023-06-10T19:01:26.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:26.536+0000 7f08eeac0640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08e815dee0 con 0x7f08e8159450 2023-06-10T19:01:26.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:26.536+0000 7f08ec85c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f08e8159450 0x7f08e815d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:26.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:26.536+0000 7f08ed05d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f08e80cf350 0x7f08e80cbf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:53742/0 (socket says 172.21.15.53:53742) 2023-06-10T19:01:26.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:26.536+0000 7f08ed05d640 1 -- 172.21.15.53:0/240898628 learned_addr learned my addr 172.21.15.53:0/240898628 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:01:26.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:26.536+0000 7f08ec85c640 1 -- 172.21.15.53:0/240898628 >> v1:172.21.15.117:6789/0 conn(0x7f08e815d680 legacy=0x7f08e80cec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:26.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:26.536+0000 7f08ec85c640 1 -- 172.21.15.53:0/240898628 >> v1:172.21.15.53:6789/0 conn(0x7f08e80cf350 legacy=0x7f08e80cbf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:26.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:26.536+0000 7f08ec85c640 1 -- 172.21.15.53:0/240898628 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08e80cb750 con 0x7f08e8159450 2023-06-10T19:01:26.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:26.536+0000 7f08e77fe640 1 -- 172.21.15.53:0/240898628 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1416050189 0 0) 0x7f08e80cbac0 con 0x7f08e80cf350 2023-06-10T19:01:26.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:26.540+0000 7f08ec85c640 1 --2- 172.21.15.53:0/240898628 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f08e8159450 0x7f08e815d140 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f08dc0097c0 tx=0x7f08dc01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cc4a1766f76aeea server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:26.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:26.540+0000 7f08e77fe640 1 -- 172.21.15.53:0/240898628 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08dc0ab640 con 0x7f08e8159450 2023-06-10T19:01:26.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:26.540+0000 7f08e77fe640 1 -- 172.21.15.53:0/240898628 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08dc0a7070 con 0x7f08e8159450 2023-06-10T19:01:26.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:26.540+0000 7f08e77fe640 1 -- 172.21.15.53:0/240898628 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08dc0ab9c0 con 0x7f08e8159450 2023-06-10T19:01:26.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:26.540+0000 7f08eeac0640 1 -- 172.21.15.53:0/240898628 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f08e8159450 msgr2=0x7f08e815d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:26.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:26.540+0000 7f08eeac0640 1 --2- 172.21.15.53:0/240898628 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f08e8159450 0x7f08e815d140 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f08dc0097c0 tx=0x7f08dc01c420 comp rx=0 tx=0).stop 2023-06-10T19:01:26.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:26.540+0000 7f08eeac0640 1 -- 172.21.15.53:0/240898628 shutdown_connections 2023-06-10T19:01:26.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:26.540+0000 7f08eeac0640 1 --2- 172.21.15.53:0/240898628 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f08e8159450 0x7f08e815d140 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:26.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:26.540+0000 7f08eeac0640 1 -- 172.21.15.53:0/240898628 >> 172.21.15.53:0/240898628 conn(0x7f08e806a090 msgr2=0x7f08e806d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:26.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:26.540+0000 7f08eeac0640 1 -- 172.21.15.53:0/240898628 shutdown_connections 2023-06-10T19:01:26.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:26.540+0000 7f08eeac0640 1 -- 172.21.15.53:0/240898628 wait complete. 2023-06-10T19:01:26.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:26.540+0000 7f08eeac0640 1 Processor -- start 2023-06-10T19:01:26.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:26.540+0000 7f08eeac0640 1 -- start start 2023-06-10T19:01:26.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:26.540+0000 7f08eeac0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08e80cf350 0x7f08e814f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:26.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:26.540+0000 7f08eeac0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08e8159450 0x7f08e815aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:26.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:26.540+0000 7f08eeac0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f08e815d680 0x7f08e815b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:26.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:26.540+0000 7f08eeac0640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e815bee0 con 0x7f08e815d680 2023-06-10T19:01:26.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:26.540+0000 7f08eeac0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e815b640 con 0x7f08e8159450 2023-06-10T19:01:26.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:26.540+0000 7f08eeac0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08e815b920 con 0x7f08e80cf350 2023-06-10T19:01:26.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:26.540+0000 7f08ed05d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f08e815d680 0x7f08e815b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:26.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:26.540+0000 7f08ed05d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f08e815d680 0x7f08e815b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53556/0 (socket says 172.21.15.53:53556) 2023-06-10T19:01:26.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:26.540+0000 7f08ed05d640 1 -- 172.21.15.53:0/1965099612 learned_addr learned my addr 172.21.15.53:0/1965099612 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:26.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:26.540+0000 7f08ec85c640 1 --2- 172.21.15.53:0/1965099612 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08e80cf350 0x7f08e814f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:26.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:26.540+0000 7f08ed05d640 1 -- 172.21.15.53:0/1965099612 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08e80cf350 msgr2=0x7f08e814f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:26.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:26.540+0000 7f08ed05d640 1 --2- 172.21.15.53:0/1965099612 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08e80cf350 0x7f08e814f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:26.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:26.540+0000 7f08e7fff640 1 --2- 172.21.15.53:0/1965099612 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08e8159450 0x7f08e815aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:26.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:26.540+0000 7f08ed05d640 1 -- 172.21.15.53:0/1965099612 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08e8159450 msgr2=0x7f08e815aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:26.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:26.540+0000 7f08ed05d640 1 --2- 172.21.15.53:0/1965099612 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08e8159450 0x7f08e815aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:26.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:26.540+0000 7f08ed05d640 1 -- 172.21.15.53:0/1965099612 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08dc009420 con 0x7f08e815d680 2023-06-10T19:01:26.550 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:26.540+0000 7f08ec85c640 1 --2- 172.21.15.53:0/1965099612 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08e80cf350 0x7f08e814f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:01:26.550 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:26.540+0000 7f08e7fff640 1 --2- 172.21.15.53:0/1965099612 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08e8159450 0x7f08e815aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:01:26.550 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:26.540+0000 7f08ed05d640 1 --2- 172.21.15.53:0/1965099612 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f08e815d680 0x7f08e815b000 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f08e0001570 tx=0x7f08e000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:26.550 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:26.544+0000 7f08e57fa640 1 -- 172.21.15.53:0/1965099612 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e000a640 con 0x7f08e815d680 2023-06-10T19:01:26.550 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:26.544+0000 7f08e57fa640 1 -- 172.21.15.53:0/1965099612 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08e000a7a0 con 0x7f08e815d680 2023-06-10T19:01:26.550 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:26.544+0000 7f08eeac0640 1 -- 172.21.15.53:0/1965099612 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08e815bc00 con 0x7f08e815d680 2023-06-10T19:01:26.550 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:26.544+0000 7f08e57fa640 1 -- 172.21.15.53:0/1965099612 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e000ab90 con 0x7f08e815d680 2023-06-10T19:01:26.550 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:26.544+0000 7f08eeac0640 1 -- 172.21.15.53:0/1965099612 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08e815c4c0 con 0x7f08e815d680 2023-06-10T19:01:26.551 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:26.544+0000 7f08eeac0640 1 -- 172.21.15.53:0/1965099612 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08e804d790 con 0x7f08e815d680 2023-06-10T19:01:26.551 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:26.544+0000 7f08e57fa640 1 -- 172.21.15.53:0/1965099612 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f08e000acf0 con 0x7f08e815d680 2023-06-10T19:01:26.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:26.544+0000 7f08e57fa640 1 --2- 172.21.15.53:0/1965099612 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f08cc066280 0x7f08cc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:26.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:26.544+0000 7f08e57fa640 1 -- 172.21.15.53:0/1965099612 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f08e0083210 con 0x7f08e815d680 2023-06-10T19:01:26.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:26.544+0000 7f08ec85c640 1 --2- 172.21.15.53:0/1965099612 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f08cc066280 0x7f08cc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:26.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:26.544+0000 7f08ec85c640 1 --2- 172.21.15.53:0/1965099612 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f08cc066280 0x7f08cc068730 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f08dc0af000 tx=0x7f08dc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:26.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:26.548+0000 7f08e57fa640 1 -- 172.21.15.53:0/1965099612 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f08e00506f0 con 0x7f08e815d680 2023-06-10T19:01:26.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:26.736+0000 7f08eeac0640 1 -- 172.21.15.53:0/1965099612 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f08e8156ab0 con 0x7f08e815d680 2023-06-10T19:01:26.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:26.736+0000 7f08e57fa640 1 -- 172.21.15.53:0/1965099612 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4683 (secure 0 0 0) 0x7f08e0053d10 con 0x7f08e815d680 2023-06-10T19:01:26.742 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:01:26.742 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":38,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5663,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2600814414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2600814414},{"type":"v1","addr":"172.21.15.117:6835","nonce":2600814414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6136,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1615882017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1615882017},{"type":"v1","addr":"172.21.15.117:6837","nonce":1615882017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6993,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/3732245174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3732245174},{"type":"v1","addr":"172.21.15.53:6833","nonce":3732245174}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:00:20.607950+0000","modified":"2023-06-10T19:00:49.023162+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7266":{"gid":7266,"name":"c","rank":0,"incarnation":37,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.53:6835/2829993338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2829993338},{"type":"v1","addr":"172.21.15.53:6835","nonce":2829993338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-06-10T19:01:26.742 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 38 2023-06-10T19:01:26.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:26.740+0000 7f08eeac0640 1 -- 172.21.15.53:0/1965099612 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f08cc066280 msgr2=0x7f08cc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:26.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:26.740+0000 7f08eeac0640 1 --2- 172.21.15.53:0/1965099612 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f08cc066280 0x7f08cc068730 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f08dc0af000 tx=0x7f08dc008040 comp rx=0 tx=0).stop 2023-06-10T19:01:26.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:26.740+0000 7f08eeac0640 1 -- 172.21.15.53:0/1965099612 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f08e815d680 msgr2=0x7f08e815b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:26.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:26.740+0000 7f08eeac0640 1 --2- 172.21.15.53:0/1965099612 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f08e815d680 0x7f08e815b000 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f08e0001570 tx=0x7f08e000cc70 comp rx=0 tx=0).stop 2023-06-10T19:01:26.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:26.740+0000 7f08eeac0640 1 -- 172.21.15.53:0/1965099612 shutdown_connections 2023-06-10T19:01:26.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:26.740+0000 7f08eeac0640 1 --2- 172.21.15.53:0/1965099612 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f08cc066280 0x7f08cc068730 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:26.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:26.740+0000 7f08eeac0640 1 --2- 172.21.15.53:0/1965099612 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f08e815d680 0x7f08e815b000 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:26.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:26.740+0000 7f08eeac0640 1 --2- 172.21.15.53:0/1965099612 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08e8159450 0x7f08e815aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:26.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:26.740+0000 7f08eeac0640 1 --2- 172.21.15.53:0/1965099612 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08e80cf350 0x7f08e814f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:26.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:26.740+0000 7f08eeac0640 1 -- 172.21.15.53:0/1965099612 >> 172.21.15.53:0/1965099612 conn(0x7f08e806a090 msgr2=0x7f08e80b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:26.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:26.740+0000 7f08eeac0640 1 -- 172.21.15.53:0/1965099612 shutdown_connections 2023-06-10T19:01:26.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:26.740+0000 7f08eeac0640 1 -- 172.21.15.53:0/1965099612 wait complete. 2023-06-10T19:01:26.759 DEBUG:tasks.cephfs.filesystem:mapped states ['up:reconnect'] to None 2023-06-10T19:01:27.760 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:01:27.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:27.888+0000 7f5fad3d2640 1 Processor -- start 2023-06-10T19:01:27.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:27.888+0000 7f5fad3d2640 1 -- start start 2023-06-10T19:01:27.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:27.892+0000 7f5fad3d2640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5fa806b2f0 0x7f5fa806f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:27.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:27.892+0000 7f5fad3d2640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5fa80c8d00 0x7f5fa806b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:27.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:27.892+0000 7f5fad3d2640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fa8158a90 con 0x7f5fa806bc00 2023-06-10T19:01:27.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:27.892+0000 7f5fad3d2640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fa80705d0 con 0x7f5fa80c8d00 2023-06-10T19:01:27.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:27.892+0000 7f5fad3d2640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fa806f9c0 con 0x7f5fa806b2f0 2023-06-10T19:01:27.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:27.892+0000 7f5fa67fc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5fa80c8d00 0x7f5fa806b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:27.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:27.892+0000 7f5fa67fc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5fa80c8d00 0x7f5fa806b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53560/0 (socket says 172.21.15.53:53560) 2023-06-10T19:01:27.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:27.892+0000 7f5fa67fc640 1 -- 172.21.15.53:0/1513900381 learned_addr learned my addr 172.21.15.53:0/1513900381 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:27.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:27.892+0000 7f5fa6ffd640 1 --2- 172.21.15.53:0/1513900381 >> v2:172.21.15.117:3300/0 conn(0x7f5fa806b2f0 0x7f5fa806f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:27.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:27.892+0000 7f5fa67fc640 1 -- 172.21.15.53:0/1513900381 >> v2:172.21.15.117:3300/0 conn(0x7f5fa806b2f0 msgr2=0x7f5fa806f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:27.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:27.892+0000 7f5fa67fc640 1 --2- 172.21.15.53:0/1513900381 >> v2:172.21.15.117:3300/0 conn(0x7f5fa806b2f0 0x7f5fa806f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:27.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:27.892+0000 7f5fa67fc640 1 -- 172.21.15.53:0/1513900381 >> v1:172.21.15.117:6789/0 conn(0x7f5fa806bc00 legacy=0x7f5fa80cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:27.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:27.892+0000 7f5fa67fc640 1 -- 172.21.15.53:0/1513900381 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fa806fca0 con 0x7f5fa80c8d00 2023-06-10T19:01:27.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:27.892+0000 7f5fa67fc640 1 --2- 172.21.15.53:0/1513900381 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5fa80c8d00 0x7f5fa806b6c0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f5fa8071d80 tx=0x7f5f9c01ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4c7488f3bbf2e9b server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:27.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:27.892+0000 7f5fa5ffb640 1 -- 172.21.15.53:0/1513900381 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f9c0a89b0 con 0x7f5fa80c8d00 2023-06-10T19:01:27.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:27.892+0000 7f5fa5ffb640 1 -- 172.21.15.53:0/1513900381 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f9c0a8b10 con 0x7f5fa80c8d00 2023-06-10T19:01:27.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:27.892+0000 7f5fa5ffb640 1 -- 172.21.15.53:0/1513900381 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f9c0a8ea0 con 0x7f5fa80c8d00 2023-06-10T19:01:27.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:27.896+0000 7f5fad3d2640 1 -- 172.21.15.53:0/1513900381 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5fa80c8d00 msgr2=0x7f5fa806b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:27.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:27.896+0000 7f5fad3d2640 1 --2- 172.21.15.53:0/1513900381 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5fa80c8d00 0x7f5fa806b6c0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f5fa8071d80 tx=0x7f5f9c01ecb0 comp rx=0 tx=0).stop 2023-06-10T19:01:27.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:27.896+0000 7f5fad3d2640 1 -- 172.21.15.53:0/1513900381 shutdown_connections 2023-06-10T19:01:27.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:27.896+0000 7f5fad3d2640 1 --2- 172.21.15.53:0/1513900381 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5fa80c8d00 0x7f5fa806b6c0 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:27.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:27.896+0000 7f5fad3d2640 1 --2- 172.21.15.53:0/1513900381 >> v2:172.21.15.117:3300/0 conn(0x7f5fa806b2f0 0x7f5fa806f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:27.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:27.896+0000 7f5fad3d2640 1 -- 172.21.15.53:0/1513900381 >> 172.21.15.53:0/1513900381 conn(0x7f5fa806a0d0 msgr2=0x7f5fa80ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:27.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:27.896+0000 7f5fad3d2640 1 -- 172.21.15.53:0/1513900381 shutdown_connections 2023-06-10T19:01:27.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:27.896+0000 7f5fad3d2640 1 -- 172.21.15.53:0/1513900381 wait complete. 2023-06-10T19:01:27.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:27.896+0000 7f5fad3d2640 1 Processor -- start 2023-06-10T19:01:27.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:27.896+0000 7f5fad3d2640 1 -- start start 2023-06-10T19:01:27.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:27.896+0000 7f5fad3d2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5fa806b2f0 0x7f5fa80c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:27.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:27.896+0000 7f5fad3d2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fa806bc00 0x7f5fa814ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:27.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:27.896+0000 7f5fad3d2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fa80c8d00 0x7f5fa814cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:27.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:27.896+0000 7f5fad3d2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa80b1c40 con 0x7f5fa806b2f0 2023-06-10T19:01:27.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:27.896+0000 7f5fad3d2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa80b1680 con 0x7f5fa80c8d00 2023-06-10T19:01:27.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:27.896+0000 7f5fad3d2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa80b1960 con 0x7f5fa806bc00 2023-06-10T19:01:27.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:27.896+0000 7f5fa6ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5fa806b2f0 0x7f5fa80c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:27.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:27.896+0000 7f5fa6ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5fa806b2f0 0x7f5fa80c7fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53576/0 (socket says 172.21.15.53:53576) 2023-06-10T19:01:27.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:27.896+0000 7f5fa6ffd640 1 -- 172.21.15.53:0/1386153271 learned_addr learned my addr 172.21.15.53:0/1386153271 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:27.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:27.896+0000 7f5fa67fc640 1 --2- 172.21.15.53:0/1386153271 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fa806bc00 0x7f5fa814ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:27.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:27.896+0000 7f5fa77fe640 1 --2- 172.21.15.53:0/1386153271 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fa80c8d00 0x7f5fa814cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:27.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:27.896+0000 7f5fa6ffd640 1 -- 172.21.15.53:0/1386153271 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fa806bc00 msgr2=0x7f5fa814ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:27.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:27.896+0000 7f5fa6ffd640 1 --2- 172.21.15.53:0/1386153271 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fa806bc00 0x7f5fa814ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:27.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:27.896+0000 7f5fa6ffd640 1 -- 172.21.15.53:0/1386153271 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fa80c8d00 msgr2=0x7f5fa814cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:27.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:27.896+0000 7f5fa6ffd640 1 --2- 172.21.15.53:0/1386153271 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fa80c8d00 0x7f5fa814cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:27.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:27.896+0000 7f5fa6ffd640 1 -- 172.21.15.53:0/1386153271 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f9c0094d0 con 0x7f5fa806b2f0 2023-06-10T19:01:27.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:27.896+0000 7f5fa6ffd640 1 --2- 172.21.15.53:0/1386153271 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5fa806b2f0 0x7f5fa80c7fb0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f5f9800c7f0 tx=0x7f5f9800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:27.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:27.896+0000 7f5f8f7fe640 1 -- 172.21.15.53:0/1386153271 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f98004220 con 0x7f5fa806b2f0 2023-06-10T19:01:27.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:27.896+0000 7f5f8f7fe640 1 -- 172.21.15.53:0/1386153271 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f980043a0 con 0x7f5fa806b2f0 2023-06-10T19:01:27.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:27.896+0000 7f5f8f7fe640 1 -- 172.21.15.53:0/1386153271 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f98004510 con 0x7f5fa806b2f0 2023-06-10T19:01:27.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:27.896+0000 7f5fad3d2640 1 -- 172.21.15.53:0/1386153271 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fa8158d60 con 0x7f5fa806b2f0 2023-06-10T19:01:27.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:27.896+0000 7f5fad3d2640 1 -- 172.21.15.53:0/1386153271 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fa80c84f0 con 0x7f5fa806b2f0 2023-06-10T19:01:27.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:27.896+0000 7f5fad3d2640 1 -- 172.21.15.53:0/1386153271 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fa804d790 con 0x7f5fa806b2f0 2023-06-10T19:01:27.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:27.900+0000 7f5f8f7fe640 1 -- 172.21.15.53:0/1386153271 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5f98003a70 con 0x7f5fa806b2f0 2023-06-10T19:01:27.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:27.900+0000 7f5f8f7fe640 1 --2- 172.21.15.53:0/1386153271 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5f94066280 0x7f5f94068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:27.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:27.900+0000 7f5f8f7fe640 1 -- 172.21.15.53:0/1386153271 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f5f98083cb0 con 0x7f5fa806b2f0 2023-06-10T19:01:27.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:27.900+0000 7f5fa67fc640 1 --2- 172.21.15.53:0/1386153271 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5f94066280 0x7f5f94068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:27.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:27.900+0000 7f5fa67fc640 1 --2- 172.21.15.53:0/1386153271 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5f94066280 0x7f5f94068730 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c0b2000 tx=0x7f5f9c0aa070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:27.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:27.904+0000 7f5f8f7fe640 1 -- 172.21.15.53:0/1386153271 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5f98051160 con 0x7f5fa806b2f0 2023-06-10T19:01:28.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:28.088+0000 7f5fad3d2640 1 -- 172.21.15.53:0/1386153271 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5fa80af1b0 con 0x7f5fa806b2f0 2023-06-10T19:01:28.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:28.088+0000 7f5f8f7fe640 1 -- 172.21.15.53:0/1386153271 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4683 (secure 0 0 0) 0x7f5f9801e020 con 0x7f5fa806b2f0 2023-06-10T19:01:28.092 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:01:28.093 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":38,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5663,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2600814414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2600814414},{"type":"v1","addr":"172.21.15.117:6835","nonce":2600814414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6136,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1615882017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1615882017},{"type":"v1","addr":"172.21.15.117:6837","nonce":1615882017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6993,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/3732245174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3732245174},{"type":"v1","addr":"172.21.15.53:6833","nonce":3732245174}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:00:20.607950+0000","modified":"2023-06-10T19:00:49.023162+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7266":{"gid":7266,"name":"c","rank":0,"incarnation":37,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.53:6835/2829993338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2829993338},{"type":"v1","addr":"172.21.15.53:6835","nonce":2829993338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-06-10T19:01:28.093 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 38 2023-06-10T19:01:28.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:28.088+0000 7f5fad3d2640 1 -- 172.21.15.53:0/1386153271 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5f94066280 msgr2=0x7f5f94068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:28.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:28.088+0000 7f5fad3d2640 1 --2- 172.21.15.53:0/1386153271 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5f94066280 0x7f5f94068730 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c0b2000 tx=0x7f5f9c0aa070 comp rx=0 tx=0).stop 2023-06-10T19:01:28.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:28.088+0000 7f5fad3d2640 1 -- 172.21.15.53:0/1386153271 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5fa806b2f0 msgr2=0x7f5fa80c7fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:28.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:28.088+0000 7f5fad3d2640 1 --2- 172.21.15.53:0/1386153271 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5fa806b2f0 0x7f5fa80c7fb0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f5f9800c7f0 tx=0x7f5f9800ccb0 comp rx=0 tx=0).stop 2023-06-10T19:01:28.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:28.088+0000 7f5fad3d2640 1 -- 172.21.15.53:0/1386153271 shutdown_connections 2023-06-10T19:01:28.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:28.088+0000 7f5fad3d2640 1 --2- 172.21.15.53:0/1386153271 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5f94066280 0x7f5f94068730 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:28.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:28.088+0000 7f5fad3d2640 1 --2- 172.21.15.53:0/1386153271 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fa80c8d00 0x7f5fa814cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:28.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:28.088+0000 7f5fad3d2640 1 --2- 172.21.15.53:0/1386153271 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fa806bc00 0x7f5fa814ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:28.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:28.088+0000 7f5fad3d2640 1 --2- 172.21.15.53:0/1386153271 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5fa806b2f0 0x7f5fa80c7fb0 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:28.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:28.088+0000 7f5fad3d2640 1 -- 172.21.15.53:0/1386153271 >> 172.21.15.53:0/1386153271 conn(0x7f5fa806a0d0 msgr2=0x7f5fa80ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:28.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:28.088+0000 7f5fad3d2640 1 -- 172.21.15.53:0/1386153271 shutdown_connections 2023-06-10T19:01:28.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:28.088+0000 7f5fad3d2640 1 -- 172.21.15.53:0/1386153271 wait complete. 2023-06-10T19:01:28.110 DEBUG:tasks.cephfs.filesystem:mapped states ['up:reconnect'] to None 2023-06-10T19:01:29.111 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:01:29.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:29.244+0000 7f226b87d640 1 Processor -- start 2023-06-10T19:01:29.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:29.244+0000 7f226b87d640 1 -- start start 2023-06-10T19:01:29.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:29.244+0000 7f226b87d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2264159630 0x7f226415d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:29.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:29.244+0000 7f226b87d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22640ad730 0x7f22640713a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:29.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:29.244+0000 7f226b87d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f22640718e0 0x7f2264069450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:29.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:29.244+0000 7f226b87d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2264070f10 con 0x7f22640718e0 2023-06-10T19:01:29.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:29.244+0000 7f226b87d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f226415db60 con 0x7f2264159630 2023-06-10T19:01:29.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:29.244+0000 7f226b87d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f226415de40 con 0x7f22640ad730 2023-06-10T19:01:29.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:29.244+0000 7f2269e1a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f22640718e0 0x7f2264069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:29.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:29.244+0000 7f2269e1a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f22640718e0 0x7f2264069450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53584/0 (socket says 172.21.15.53:53584) 2023-06-10T19:01:29.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:29.244+0000 7f2269e1a640 1 -- 172.21.15.53:0/3832664032 learned_addr learned my addr 172.21.15.53:0/3832664032 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:29.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:29.244+0000 7f2268e18640 1 --2- 172.21.15.53:0/3832664032 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22640ad730 0x7f22640713a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:29.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:29.244+0000 7f2269619640 1 --2- 172.21.15.53:0/3832664032 >> v2:172.21.15.117:3300/0 conn(0x7f2264159630 0x7f226415d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:29.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:29.244+0000 7f2269e1a640 1 -- 172.21.15.53:0/3832664032 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22640ad730 msgr2=0x7f22640713a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:29.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:29.244+0000 7f2269e1a640 1 --2- 172.21.15.53:0/3832664032 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22640ad730 0x7f22640713a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:29.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:29.244+0000 7f2269e1a640 1 -- 172.21.15.53:0/3832664032 >> v2:172.21.15.117:3300/0 conn(0x7f2264159630 msgr2=0x7f226415d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:29.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:29.244+0000 7f2269e1a640 1 --2- 172.21.15.53:0/3832664032 >> v2:172.21.15.117:3300/0 conn(0x7f2264159630 0x7f226415d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:29.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:29.244+0000 7f2269e1a640 1 -- 172.21.15.53:0/3832664032 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f226415e120 con 0x7f22640718e0 2023-06-10T19:01:29.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:29.248+0000 7f2269e1a640 1 --2- 172.21.15.53:0/3832664032 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22640718e0 0x7f2264069450 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f226406d680 tx=0x7f225c01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eda47e0e5e11a197 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:29.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:29.248+0000 7f225bfff640 1 -- 172.21.15.53:0/3832664032 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f225c0a5730 con 0x7f22640718e0 2023-06-10T19:01:29.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:29.248+0000 7f225bfff640 1 -- 172.21.15.53:0/3832664032 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f225c0a5890 con 0x7f22640718e0 2023-06-10T19:01:29.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:29.248+0000 7f225bfff640 1 -- 172.21.15.53:0/3832664032 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f225c0a5c20 con 0x7f22640718e0 2023-06-10T19:01:29.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:29.248+0000 7f226b87d640 1 -- 172.21.15.53:0/3832664032 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22640718e0 msgr2=0x7f2264069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:29.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:29.248+0000 7f226b87d640 1 --2- 172.21.15.53:0/3832664032 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22640718e0 0x7f2264069450 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f226406d680 tx=0x7f225c01c9a0 comp rx=0 tx=0).stop 2023-06-10T19:01:29.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:29.248+0000 7f226b87d640 1 -- 172.21.15.53:0/3832664032 shutdown_connections 2023-06-10T19:01:29.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:29.248+0000 7f226b87d640 1 --2- 172.21.15.53:0/3832664032 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22640718e0 0x7f2264069450 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:29.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:29.248+0000 7f226b87d640 1 --2- 172.21.15.53:0/3832664032 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22640ad730 0x7f22640713a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:29.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:29.248+0000 7f226b87d640 1 --2- 172.21.15.53:0/3832664032 >> v2:172.21.15.117:3300/0 conn(0x7f2264159630 0x7f226415d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:29.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:29.248+0000 7f226b87d640 1 -- 172.21.15.53:0/3832664032 >> 172.21.15.53:0/3832664032 conn(0x7f22640cafc0 msgr2=0x7f22640cb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:29.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:29.248+0000 7f226b87d640 1 -- 172.21.15.53:0/3832664032 shutdown_connections 2023-06-10T19:01:29.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:29.248+0000 7f226b87d640 1 -- 172.21.15.53:0/3832664032 wait complete. 2023-06-10T19:01:29.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:29.248+0000 7f226b87d640 1 Processor -- start 2023-06-10T19:01:29.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:29.248+0000 7f226b87d640 1 -- start start 2023-06-10T19:01:29.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:29.252+0000 7f226b87d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22640718e0 0x7f22640c4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:29.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:29.252+0000 7f226b87d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22640ad730 0x7f22640c6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:29.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:29.252+0000 7f226b87d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2264159630 0x7f22640cc110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:29.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:29.252+0000 7f226b87d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22641631f0 con 0x7f22640ad730 2023-06-10T19:01:29.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:29.252+0000 7f226b87d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22640ccb60 con 0x7f22640718e0 2023-06-10T19:01:29.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:29.252+0000 7f226b87d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22640cce40 con 0x7f2264159630 2023-06-10T19:01:29.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:29.252+0000 7f2268e18640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22640ad730 0x7f22640c6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:29.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:29.252+0000 7f2268e18640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22640ad730 0x7f22640c6930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53592/0 (socket says 172.21.15.53:53592) 2023-06-10T19:01:29.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:29.252+0000 7f2268e18640 1 -- 172.21.15.53:0/3645162962 learned_addr learned my addr 172.21.15.53:0/3645162962 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:29.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:29.252+0000 7f2269619640 1 --2- 172.21.15.53:0/3645162962 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22640718e0 0x7f22640c4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:29.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:29.252+0000 7f2269e1a640 1 --2- 172.21.15.53:0/3645162962 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2264159630 0x7f22640cc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:29.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:29.252+0000 7f2268e18640 1 -- 172.21.15.53:0/3645162962 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2264159630 msgr2=0x7f22640cc110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:29.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:29.252+0000 7f2268e18640 1 --2- 172.21.15.53:0/3645162962 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2264159630 0x7f22640cc110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:29.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:29.252+0000 7f2268e18640 1 -- 172.21.15.53:0/3645162962 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22640718e0 msgr2=0x7f22640c4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:29.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:29.252+0000 7f2268e18640 1 --2- 172.21.15.53:0/3645162962 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22640718e0 0x7f22640c4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:29.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:29.252+0000 7f2268e18640 1 -- 172.21.15.53:0/3645162962 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f225c009b30 con 0x7f22640ad730 2023-06-10T19:01:29.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:29.252+0000 7f2268e18640 1 --2- 172.21.15.53:0/3645162962 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22640ad730 0x7f22640c6930 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f225400d800 tx=0x7f225400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:29.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:29.252+0000 7f2259ffb640 1 -- 172.21.15.53:0/3645162962 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22540096a0 con 0x7f22640ad730 2023-06-10T19:01:29.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:29.252+0000 7f2259ffb640 1 -- 172.21.15.53:0/3645162962 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2254009800 con 0x7f22640ad730 2023-06-10T19:01:29.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:29.252+0000 7f226b87d640 1 -- 172.21.15.53:0/3645162962 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22640cd120 con 0x7f22640ad730 2023-06-10T19:01:29.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:29.252+0000 7f2259ffb640 1 -- 172.21.15.53:0/3645162962 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2254009b70 con 0x7f22640ad730 2023-06-10T19:01:29.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:29.252+0000 7f226b87d640 1 -- 172.21.15.53:0/3645162962 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22640c4890 con 0x7f22640ad730 2023-06-10T19:01:29.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:29.252+0000 7f226b87d640 1 -- 172.21.15.53:0/3645162962 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22640cbd00 con 0x7f22640ad730 2023-06-10T19:01:29.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:29.252+0000 7f2259ffb640 1 -- 172.21.15.53:0/3645162962 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2254009cd0 con 0x7f22640ad730 2023-06-10T19:01:29.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:29.252+0000 7f2259ffb640 1 --2- 172.21.15.53:0/3645162962 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f22480662b0 0x7f2248068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:29.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:29.252+0000 7f2259ffb640 1 -- 172.21.15.53:0/3645162962 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f22540844c0 con 0x7f22640ad730 2023-06-10T19:01:29.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:29.252+0000 7f2269619640 1 --2- 172.21.15.53:0/3645162962 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f22480662b0 0x7f2248068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:29.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:29.256+0000 7f2269619640 1 --2- 172.21.15.53:0/3645162962 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f22480662b0 0x7f2248068760 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f226000b930 tx=0x7f2260008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:29.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:29.256+0000 7f2259ffb640 1 -- 172.21.15.53:0/3645162962 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f22540518e0 con 0x7f22640ad730 2023-06-10T19:01:29.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:29.444+0000 7f226b87d640 1 -- 172.21.15.53:0/3645162962 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f226404d790 con 0x7f22640ad730 2023-06-10T19:01:29.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:29.444+0000 7f2259ffb640 1 -- 172.21.15.53:0/3645162962 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4683 (secure 0 0 0) 0x7f2254054f00 con 0x7f22640ad730 2023-06-10T19:01:29.450 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:01:29.450 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":38,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5663,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2600814414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2600814414},{"type":"v1","addr":"172.21.15.117:6835","nonce":2600814414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6136,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1615882017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1615882017},{"type":"v1","addr":"172.21.15.117:6837","nonce":1615882017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6993,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/3732245174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3732245174},{"type":"v1","addr":"172.21.15.53:6833","nonce":3732245174}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:00:20.607950+0000","modified":"2023-06-10T19:00:49.023162+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7266":{"gid":7266,"name":"c","rank":0,"incarnation":37,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.53:6835/2829993338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2829993338},{"type":"v1","addr":"172.21.15.53:6835","nonce":2829993338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-06-10T19:01:29.450 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 38 2023-06-10T19:01:29.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:29.448+0000 7f226b87d640 1 -- 172.21.15.53:0/3645162962 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f22480662b0 msgr2=0x7f2248068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:29.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:29.448+0000 7f226b87d640 1 --2- 172.21.15.53:0/3645162962 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f22480662b0 0x7f2248068760 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f226000b930 tx=0x7f2260008040 comp rx=0 tx=0).stop 2023-06-10T19:01:29.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:29.448+0000 7f226b87d640 1 -- 172.21.15.53:0/3645162962 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22640ad730 msgr2=0x7f22640c6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:29.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:29.448+0000 7f226b87d640 1 --2- 172.21.15.53:0/3645162962 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22640ad730 0x7f22640c6930 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f225400d800 tx=0x7f225400dcc0 comp rx=0 tx=0).stop 2023-06-10T19:01:29.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:29.448+0000 7f226b87d640 1 -- 172.21.15.53:0/3645162962 shutdown_connections 2023-06-10T19:01:29.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:29.448+0000 7f226b87d640 1 --2- 172.21.15.53:0/3645162962 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f22480662b0 0x7f2248068760 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:29.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:29.448+0000 7f226b87d640 1 --2- 172.21.15.53:0/3645162962 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2264159630 0x7f22640cc110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:29.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:29.448+0000 7f226b87d640 1 --2- 172.21.15.53:0/3645162962 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22640ad730 0x7f22640c6930 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:29.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:29.448+0000 7f226b87d640 1 --2- 172.21.15.53:0/3645162962 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22640718e0 0x7f22640c4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:29.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:29.448+0000 7f226b87d640 1 -- 172.21.15.53:0/3645162962 >> 172.21.15.53:0/3645162962 conn(0x7f22640cafc0 msgr2=0x7f22640c8fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:29.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:29.448+0000 7f226b87d640 1 -- 172.21.15.53:0/3645162962 shutdown_connections 2023-06-10T19:01:29.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:29.448+0000 7f226b87d640 1 -- 172.21.15.53:0/3645162962 wait complete. 2023-06-10T19:01:29.467 DEBUG:tasks.cephfs.filesystem:mapped states ['up:reconnect'] to None 2023-06-10T19:01:30.468 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:01:30.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:30.600+0000 7faf748ca640 1 Processor -- start 2023-06-10T19:01:30.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:30.600+0000 7faf748ca640 1 -- start start 2023-06-10T19:01:30.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:30.600+0000 7faf748ca640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7faf700c9840 0x7faf700c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:30.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:30.600+0000 7faf748ca640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7faf7006b090 0x7faf7006b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:30.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:30.600+0000 7faf748ca640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf70159b50 con 0x7faf70071060 2023-06-10T19:01:30.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:30.600+0000 7faf748ca640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf700ca150 con 0x7faf7006b090 2023-06-10T19:01:30.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:30.600+0000 7faf748ca640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf700702a0 con 0x7faf700c9840 2023-06-10T19:01:30.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:30.600+0000 7faf6ed9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7faf7006b090 0x7faf7006b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:30.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:30.600+0000 7faf6ed9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7faf7006b090 0x7faf7006b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53602/0 (socket says 172.21.15.53:53602) 2023-06-10T19:01:30.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:30.600+0000 7faf6ed9d640 1 -- 172.21.15.53:0/252438043 learned_addr learned my addr 172.21.15.53:0/252438043 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:30.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:30.600+0000 7faf6e59c640 1 --2- 172.21.15.53:0/252438043 >> v2:172.21.15.117:3300/0 conn(0x7faf700c9840 0x7faf700c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:30.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:30.600+0000 7faf6ed9d640 1 -- 172.21.15.53:0/252438043 >> v2:172.21.15.117:3300/0 conn(0x7faf700c9840 msgr2=0x7faf700c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:30.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:30.600+0000 7faf6ed9d640 1 --2- 172.21.15.53:0/252438043 >> v2:172.21.15.117:3300/0 conn(0x7faf700c9840 0x7faf700c9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:30.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:30.600+0000 7faf6ed9d640 1 -- 172.21.15.53:0/252438043 >> v1:172.21.15.117:6789/0 conn(0x7faf70071060 legacy=0x7faf700af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:30.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:30.600+0000 7faf6ed9d640 1 -- 172.21.15.53:0/252438043 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf70070580 con 0x7faf7006b090 2023-06-10T19:01:30.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:30.604+0000 7faf6ed9d640 1 --2- 172.21.15.53:0/252438043 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf7006b090 0x7faf7006b510 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7faf70071d80 tx=0x7faf6801c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d9fd56efa6c312f server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:30.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:30.604+0000 7faf6d59a640 1 -- 172.21.15.53:0/252438043 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf680a5820 con 0x7faf7006b090 2023-06-10T19:01:30.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:30.604+0000 7faf6d59a640 1 -- 172.21.15.53:0/252438043 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf680a5980 con 0x7faf7006b090 2023-06-10T19:01:30.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:30.604+0000 7faf6d59a640 1 -- 172.21.15.53:0/252438043 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf680a5d10 con 0x7faf7006b090 2023-06-10T19:01:30.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:30.604+0000 7faf748ca640 1 -- 172.21.15.53:0/252438043 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf7006b090 msgr2=0x7faf7006b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:30.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:30.604+0000 7faf748ca640 1 --2- 172.21.15.53:0/252438043 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf7006b090 0x7faf7006b510 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7faf70071d80 tx=0x7faf6801c960 comp rx=0 tx=0).stop 2023-06-10T19:01:30.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:30.604+0000 7faf748ca640 1 -- 172.21.15.53:0/252438043 shutdown_connections 2023-06-10T19:01:30.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:30.604+0000 7faf748ca640 1 --2- 172.21.15.53:0/252438043 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf7006b090 0x7faf7006b510 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:30.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:30.604+0000 7faf748ca640 1 --2- 172.21.15.53:0/252438043 >> v2:172.21.15.117:3300/0 conn(0x7faf700c9840 0x7faf700c9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:30.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:30.604+0000 7faf748ca640 1 -- 172.21.15.53:0/252438043 >> 172.21.15.53:0/252438043 conn(0x7faf7006a0d0 msgr2=0x7faf700ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:30.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:30.604+0000 7faf748ca640 1 -- 172.21.15.53:0/252438043 shutdown_connections 2023-06-10T19:01:30.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:30.604+0000 7faf748ca640 1 -- 172.21.15.53:0/252438043 wait complete. 2023-06-10T19:01:30.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:30.604+0000 7faf748ca640 1 Processor -- start 2023-06-10T19:01:30.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:30.604+0000 7faf748ca640 1 -- start start 2023-06-10T19:01:30.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:30.604+0000 7faf748ca640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf7006b090 0x7faf7014fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:30.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:30.604+0000 7faf748ca640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf70071060 0x7faf700c5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:30.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:30.604+0000 7faf748ca640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf700c9840 0x7faf700c56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:30.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:30.604+0000 7faf748ca640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf7015bdc0 con 0x7faf70071060 2023-06-10T19:01:30.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:30.604+0000 7faf748ca640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf7015c0a0 con 0x7faf700c9840 2023-06-10T19:01:30.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:30.604+0000 7faf748ca640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf7015c380 con 0x7faf7006b090 2023-06-10T19:01:30.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:30.604+0000 7faf6dd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf70071060 0x7faf700c5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:30.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:30.604+0000 7faf6dd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf70071060 0x7faf700c5190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53618/0 (socket says 172.21.15.53:53618) 2023-06-10T19:01:30.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:30.604+0000 7faf6dd9b640 1 -- 172.21.15.53:0/556725336 learned_addr learned my addr 172.21.15.53:0/556725336 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:30.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:30.604+0000 7faf6ed9d640 1 --2- 172.21.15.53:0/556725336 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf700c9840 0x7faf700c56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:30.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:30.608+0000 7faf6e59c640 1 --2- 172.21.15.53:0/556725336 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf7006b090 0x7faf7014fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:30.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:30.608+0000 7faf6dd9b640 1 -- 172.21.15.53:0/556725336 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf7006b090 msgr2=0x7faf7014fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:30.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:30.608+0000 7faf6dd9b640 1 --2- 172.21.15.53:0/556725336 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf7006b090 0x7faf7014fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:30.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:30.608+0000 7faf6dd9b640 1 -- 172.21.15.53:0/556725336 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf700c9840 msgr2=0x7faf700c56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:30.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:30.608+0000 7faf6dd9b640 1 --2- 172.21.15.53:0/556725336 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf700c9840 0x7faf700c56d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:30.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:30.608+0000 7faf6dd9b640 1 -- 172.21.15.53:0/556725336 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf68009b30 con 0x7faf70071060 2023-06-10T19:01:30.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:30.608+0000 7faf6dd9b640 1 --2- 172.21.15.53:0/556725336 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf70071060 0x7faf700c5190 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7faf6400c410 tx=0x7faf6400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:30.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:30.608+0000 7faf5effd640 1 -- 172.21.15.53:0/556725336 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf64011790 con 0x7faf70071060 2023-06-10T19:01:30.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:30.608+0000 7faf5effd640 1 -- 172.21.15.53:0/556725336 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf640118f0 con 0x7faf70071060 2023-06-10T19:01:30.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:30.608+0000 7faf748ca640 1 -- 172.21.15.53:0/556725336 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf7015c660 con 0x7faf70071060 2023-06-10T19:01:30.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:30.608+0000 7faf5effd640 1 -- 172.21.15.53:0/556725336 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf64011ce0 con 0x7faf70071060 2023-06-10T19:01:30.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:30.608+0000 7faf748ca640 1 -- 172.21.15.53:0/556725336 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf70150010 con 0x7faf70071060 2023-06-10T19:01:30.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:30.608+0000 7faf748ca640 1 -- 172.21.15.53:0/556725336 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf7004d790 con 0x7faf70071060 2023-06-10T19:01:30.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:30.608+0000 7faf5effd640 1 -- 172.21.15.53:0/556725336 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7faf6401c460 con 0x7faf70071060 2023-06-10T19:01:30.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:30.608+0000 7faf5effd640 1 --2- 172.21.15.53:0/556725336 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7faf50066280 0x7faf50068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:30.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:30.608+0000 7faf5effd640 1 -- 172.21.15.53:0/556725336 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6148+0+0 (secure 0 0 0) 0x7faf64083aa0 con 0x7faf70071060 2023-06-10T19:01:30.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:30.608+0000 7faf6e59c640 1 --2- 172.21.15.53:0/556725336 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7faf50066280 0x7faf50068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:30.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:30.608+0000 7faf6e59c640 1 --2- 172.21.15.53:0/556725336 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7faf50066280 0x7faf50068730 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7faf6000b930 tx=0x7faf60008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:30.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:30.612+0000 7faf5effd640 1 -- 172.21.15.53:0/556725336 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7faf64050ec0 con 0x7faf70071060 2023-06-10T19:01:30.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:30.800+0000 7faf748ca640 1 -- 172.21.15.53:0/556725336 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faf700cb140 con 0x7faf70071060 2023-06-10T19:01:30.804 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:30.800+0000 7faf5effd640 1 -- 172.21.15.53:0/556725336 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4683 (secure 0 0 0) 0x7faf640544e0 con 0x7faf70071060 2023-06-10T19:01:30.804 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:01:30.805 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":38,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5663,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2600814414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2600814414},{"type":"v1","addr":"172.21.15.117:6835","nonce":2600814414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6136,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1615882017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1615882017},{"type":"v1","addr":"172.21.15.117:6837","nonce":1615882017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6993,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/3732245174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3732245174},{"type":"v1","addr":"172.21.15.53:6833","nonce":3732245174}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:00:20.607950+0000","modified":"2023-06-10T19:00:49.023162+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7266":{"gid":7266,"name":"c","rank":0,"incarnation":37,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.53:6835/2829993338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2829993338},{"type":"v1","addr":"172.21.15.53:6835","nonce":2829993338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-06-10T19:01:30.805 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 38 2023-06-10T19:01:30.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:30.800+0000 7faf748ca640 1 -- 172.21.15.53:0/556725336 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7faf50066280 msgr2=0x7faf50068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:30.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:30.800+0000 7faf748ca640 1 --2- 172.21.15.53:0/556725336 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7faf50066280 0x7faf50068730 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7faf6000b930 tx=0x7faf60008040 comp rx=0 tx=0).stop 2023-06-10T19:01:30.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:30.800+0000 7faf748ca640 1 -- 172.21.15.53:0/556725336 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf70071060 msgr2=0x7faf700c5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:30.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:30.800+0000 7faf748ca640 1 --2- 172.21.15.53:0/556725336 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf70071060 0x7faf700c5190 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7faf6400c410 tx=0x7faf6400c8d0 comp rx=0 tx=0).stop 2023-06-10T19:01:30.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:30.800+0000 7faf748ca640 1 -- 172.21.15.53:0/556725336 shutdown_connections 2023-06-10T19:01:30.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:30.800+0000 7faf748ca640 1 --2- 172.21.15.53:0/556725336 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7faf50066280 0x7faf50068730 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:30.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:30.800+0000 7faf748ca640 1 --2- 172.21.15.53:0/556725336 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf700c9840 0x7faf700c56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:30.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:30.800+0000 7faf748ca640 1 --2- 172.21.15.53:0/556725336 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf70071060 0x7faf700c5190 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:30.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:30.800+0000 7faf748ca640 1 --2- 172.21.15.53:0/556725336 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf7006b090 0x7faf7014fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:30.808 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:30.800+0000 7faf748ca640 1 -- 172.21.15.53:0/556725336 >> 172.21.15.53:0/556725336 conn(0x7faf7006a0d0 msgr2=0x7faf700c8820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:30.808 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:30.800+0000 7faf748ca640 1 -- 172.21.15.53:0/556725336 shutdown_connections 2023-06-10T19:01:30.808 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:30.800+0000 7faf748ca640 1 -- 172.21.15.53:0/556725336 wait complete. 2023-06-10T19:01:30.823 DEBUG:tasks.cephfs.filesystem:mapped states ['up:reconnect'] to None 2023-06-10T19:01:31.825 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:01:31.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:31.955+0000 7f6fb30e2640 1 Processor -- start 2023-06-10T19:01:31.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:31.955+0000 7f6fb30e2640 1 -- start start 2023-06-10T19:01:31.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:31.955+0000 7f6fb30e2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6fac0cc690 0x7f6fac0d04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:31.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:31.955+0000 7f6fb30e2640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fac0d0020 con 0x7f6fac0ccae0 2023-06-10T19:01:31.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:31.955+0000 7f6fb30e2640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fac0cef40 con 0x7f6fac0b3ac0 2023-06-10T19:01:31.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:31.955+0000 7f6fb30e2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fac0cf220 con 0x7f6fac0cc690 2023-06-10T19:01:31.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:31.955+0000 7f6fb167f640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f6fac0ccae0 0x7f6fac0d09f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:48518/0 (socket says 172.21.15.53:48518) 2023-06-10T19:01:31.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:31.955+0000 7f6fb167f640 1 -- 172.21.15.53:0/1229259007 learned_addr learned my addr 172.21.15.53:0/1229259007 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:01:31.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:31.955+0000 7f6fabfff640 1 --2- 172.21.15.53:0/1229259007 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6fac0cc690 0x7f6fac0d04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:31.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:31.955+0000 7f6fab7fe640 1 -- 172.21.15.53:0/1229259007 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1550864078 0 0) 0x7f6fac0d0020 con 0x7f6fac0ccae0 2023-06-10T19:01:31.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:31.955+0000 7f6fab7fe640 1 -- 172.21.15.53:0/1229259007 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f94003530 con 0x7f6fac0ccae0 2023-06-10T19:01:31.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:31.955+0000 7f6fab7fe640 1 -- 172.21.15.53:0/1229259007 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3687450293 0 0) 0x7f6f94003530 con 0x7f6fac0ccae0 2023-06-10T19:01:31.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:31.955+0000 7f6fab7fe640 1 -- 172.21.15.53:0/1229259007 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6fac0cc690 msgr2=0x7f6fac0d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:31.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:31.955+0000 7f6fab7fe640 1 --2- 172.21.15.53:0/1229259007 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6fac0cc690 0x7f6fac0d04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:31.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:31.955+0000 7f6fab7fe640 1 -- 172.21.15.53:0/1229259007 >> v1:172.21.15.117:6789/0 conn(0x7f6fac0b3ac0 legacy=0x7f6fac0b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:31.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:31.955+0000 7f6fab7fe640 1 -- 172.21.15.53:0/1229259007 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fac0cf500 con 0x7f6fac0ccae0 2023-06-10T19:01:31.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:31.955+0000 7f6fab7fe640 1 -- 172.21.15.53:0/1229259007 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f6fa4001a00 con 0x7f6fac0ccae0 2023-06-10T19:01:31.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:31.955+0000 7f6fab7fe640 1 -- 172.21.15.53:0/1229259007 >> v1:172.21.15.53:6789/0 conn(0x7f6fac0ccae0 legacy=0x7f6fac0d09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:31.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:31.955+0000 7f6fab7fe640 1 --2- 172.21.15.53:0/1229259007 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6fac0cc690 0x7f6f94003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:31.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:31.955+0000 7f6fab7fe640 1 --2- 172.21.15.53:0/1229259007 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f94003f60 0x7f6f940047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:31.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:31.955+0000 7f6fab7fe640 1 --2- 172.21.15.53:0/1229259007 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6f94004d10 0x7f6f94005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:31.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:31.955+0000 7f6fab7fe640 1 -- 172.21.15.53:0/1229259007 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fac0cf220 con 0x7f6f94004d10 2023-06-10T19:01:31.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:31.955+0000 7f6fab7fe640 1 -- 172.21.15.53:0/1229259007 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9400ba40 con 0x7f6f94003f60 2023-06-10T19:01:31.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:31.955+0000 7f6fab7fe640 1 -- 172.21.15.53:0/1229259007 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9400bc00 con 0x7f6fac0cc690 2023-06-10T19:01:31.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:31.955+0000 7f6fb167f640 1 --2- 172.21.15.53:0/1229259007 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6f94004d10 0x7f6f94005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:31.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:31.955+0000 7f6fabfff640 1 --2- 172.21.15.53:0/1229259007 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f94003f60 0x7f6f940047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:31.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:31.955+0000 7f6fb0e7e640 1 --2- 172.21.15.53:0/1229259007 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6fac0cc690 0x7f6f94003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:31.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:31.955+0000 7f6fb167f640 1 -- 172.21.15.53:0/1229259007 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6fac0cc690 msgr2=0x7f6f94003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:31.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:31.955+0000 7f6fb167f640 1 --2- 172.21.15.53:0/1229259007 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6fac0cc690 0x7f6f94003a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:31.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:31.955+0000 7f6fb167f640 1 -- 172.21.15.53:0/1229259007 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f94003f60 msgr2=0x7f6f940047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:31.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:31.955+0000 7f6fb167f640 1 --2- 172.21.15.53:0/1229259007 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f94003f60 0x7f6f940047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:31.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:31.955+0000 7f6fb167f640 1 -- 172.21.15.53:0/1229259007 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f94003530 con 0x7f6f94004d10 2023-06-10T19:01:31.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:31.955+0000 7f6fb0e7e640 1 --2- 172.21.15.53:0/1229259007 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6fac0cc690 0x7f6f94003a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:01:31.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:31.959+0000 7f6fb167f640 1 --2- 172.21.15.53:0/1229259007 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6f94004d10 0x7f6f94005180 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f6fa4002240 tx=0x7f6fa401fa60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a65e746d6ce467ff server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:31.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:31.959+0000 7f6fab7fe640 1 -- 172.21.15.53:0/1229259007 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa40aa690 con 0x7f6f94004d10 2023-06-10T19:01:31.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:31.959+0000 7f6fab7fe640 1 -- 172.21.15.53:0/1229259007 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fa40aa810 con 0x7f6f94004d10 2023-06-10T19:01:31.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:31.959+0000 7f6fab7fe640 1 -- 172.21.15.53:0/1229259007 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa40aac00 con 0x7f6f94004d10 2023-06-10T19:01:31.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:31.959+0000 7f6fb30e2640 1 -- 172.21.15.53:0/1229259007 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6f94004d10 msgr2=0x7f6f94005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:31.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:31.959+0000 7f6fb30e2640 1 --2- 172.21.15.53:0/1229259007 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6f94004d10 0x7f6f94005180 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f6fa4002240 tx=0x7f6fa401fa60 comp rx=0 tx=0).stop 2023-06-10T19:01:31.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:31.959+0000 7f6fb167f640 1 -- 172.21.15.53:0/1229259007 reap_dead start 2023-06-10T19:01:31.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:31.959+0000 7f6fb30e2640 1 -- 172.21.15.53:0/1229259007 shutdown_connections 2023-06-10T19:01:31.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:31.959+0000 7f6fb30e2640 1 -- 172.21.15.53:0/1229259007 >> 172.21.15.53:0/1229259007 conn(0x7f6fac071790 msgr2=0x7f6fac069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:31.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:31.959+0000 7f6fb30e2640 1 -- 172.21.15.53:0/1229259007 shutdown_connections 2023-06-10T19:01:31.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:31.959+0000 7f6fb30e2640 1 -- 172.21.15.53:0/1229259007 wait complete. 2023-06-10T19:01:31.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:31.963+0000 7f6fb30e2640 1 Processor -- start 2023-06-10T19:01:31.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:31.963+0000 7f6fb30e2640 1 -- start start 2023-06-10T19:01:31.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:31.963+0000 7f6fb30e2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f94004d10 0x7f6fac151f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:31.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:31.963+0000 7f6fb30e2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6fac156a40 0x7f6fac0c73e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:31.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:31.963+0000 7f6fb30e2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6fac0c7920 0x7f6fac0c7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:31.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:31.963+0000 7f6fb30e2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fac15cbb0 con 0x7f6fac156a40 2023-06-10T19:01:31.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:31.963+0000 7f6fb30e2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fac1524a0 con 0x7f6f94004d10 2023-06-10T19:01:31.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:31.963+0000 7f6fb30e2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fac15bf30 con 0x7f6fac0c7920 2023-06-10T19:01:31.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:31.963+0000 7f6fabfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6fac156a40 0x7f6fac0c73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:31.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:31.963+0000 7f6fabfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6fac156a40 0x7f6fac0c73e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39686/0 (socket says 172.21.15.53:39686) 2023-06-10T19:01:31.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:31.963+0000 7f6fabfff640 1 -- 172.21.15.53:0/3723141938 learned_addr learned my addr 172.21.15.53:0/3723141938 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:31.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:31.963+0000 7f6fb0e7e640 1 --2- 172.21.15.53:0/3723141938 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f94004d10 0x7f6fac151f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:31.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:31.963+0000 7f6fb167f640 1 --2- 172.21.15.53:0/3723141938 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6fac0c7920 0x7f6fac0c7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:31.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:31.963+0000 7f6fabfff640 1 -- 172.21.15.53:0/3723141938 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6fac0c7920 msgr2=0x7f6fac0c7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:31.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:31.963+0000 7f6fabfff640 1 --2- 172.21.15.53:0/3723141938 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6fac0c7920 0x7f6fac0c7fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:31.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:31.963+0000 7f6fabfff640 1 -- 172.21.15.53:0/3723141938 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f94004d10 msgr2=0x7f6fac151f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:31.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:31.963+0000 7f6fabfff640 1 --2- 172.21.15.53:0/3723141938 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f94004d10 0x7f6fac151f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:31.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:31.963+0000 7f6fabfff640 1 -- 172.21.15.53:0/3723141938 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fac15c210 con 0x7f6fac156a40 2023-06-10T19:01:31.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:31.963+0000 7f6fabfff640 1 --2- 172.21.15.53:0/3723141938 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6fac156a40 0x7f6fac0c73e0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f6fa00115e0 tx=0x7f6fa0011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:31.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:31.963+0000 7f6fa97fa640 1 -- 172.21.15.53:0/3723141938 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa000f8f0 con 0x7f6fac156a40 2023-06-10T19:01:31.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:31.963+0000 7f6fa97fa640 1 -- 172.21.15.53:0/3723141938 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fa000fa50 con 0x7f6fac156a40 2023-06-10T19:01:31.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:31.963+0000 7f6fb30e2640 1 -- 172.21.15.53:0/3723141938 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fac15c4f0 con 0x7f6fac156a40 2023-06-10T19:01:31.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:31.963+0000 7f6fa97fa640 1 -- 172.21.15.53:0/3723141938 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa000fdc0 con 0x7f6fac156a40 2023-06-10T19:01:31.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:31.963+0000 7f6fb30e2640 1 -- 172.21.15.53:0/3723141938 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fac152d00 con 0x7f6fac156a40 2023-06-10T19:01:31.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:31.963+0000 7f6fb30e2640 1 -- 172.21.15.53:0/3723141938 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fac04d790 con 0x7f6fac156a40 2023-06-10T19:01:31.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:31.963+0000 7f6fa97fa640 1 -- 172.21.15.53:0/3723141938 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6fa0015460 con 0x7f6fac156a40 2023-06-10T19:01:31.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:31.963+0000 7f6fa97fa640 1 --2- 172.21.15.53:0/3723141938 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6f98066280 0x7f6f98068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:31.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:31.963+0000 7f6fa97fa640 1 -- 172.21.15.53:0/3723141938 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f6fa0084230 con 0x7f6fac156a40 2023-06-10T19:01:31.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:31.967+0000 7f6fb0e7e640 1 --2- 172.21.15.53:0/3723141938 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6f98066280 0x7f6f98068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:31.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:31.967+0000 7f6fb0e7e640 1 --2- 172.21.15.53:0/3723141938 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6f98066280 0x7f6f98068730 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c001670 tx=0x7f6f9c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:31.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:31.971+0000 7f6fa97fa640 1 -- 172.21.15.53:0/3723141938 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6fa00516e0 con 0x7f6fac156a40 2023-06-10T19:01:32.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:32.151+0000 7f6fb30e2640 1 -- 172.21.15.53:0/3723141938 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6fac1530a0 con 0x7f6fac156a40 2023-06-10T19:01:32.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:32.155+0000 7f6fa97fa640 1 -- 172.21.15.53:0/3723141938 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4683 (secure 0 0 0) 0x7f6fa0054d00 con 0x7f6fac156a40 2023-06-10T19:01:32.160 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:01:32.161 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":38,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5663,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2600814414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2600814414},{"type":"v1","addr":"172.21.15.117:6835","nonce":2600814414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6136,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1615882017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1615882017},{"type":"v1","addr":"172.21.15.117:6837","nonce":1615882017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6993,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/3732245174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3732245174},{"type":"v1","addr":"172.21.15.53:6833","nonce":3732245174}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:00:20.607950+0000","modified":"2023-06-10T19:00:49.023162+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7266":{"gid":7266,"name":"c","rank":0,"incarnation":37,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.53:6835/2829993338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2829993338},{"type":"v1","addr":"172.21.15.53:6835","nonce":2829993338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-06-10T19:01:32.161 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 38 2023-06-10T19:01:32.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:32.159+0000 7f6fb30e2640 1 -- 172.21.15.53:0/3723141938 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6f98066280 msgr2=0x7f6f98068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:32.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:32.159+0000 7f6fb30e2640 1 --2- 172.21.15.53:0/3723141938 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6f98066280 0x7f6f98068730 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c001670 tx=0x7f6f9c009040 comp rx=0 tx=0).stop 2023-06-10T19:01:32.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:32.159+0000 7f6fb30e2640 1 -- 172.21.15.53:0/3723141938 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6fac156a40 msgr2=0x7f6fac0c73e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:32.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:32.159+0000 7f6fb30e2640 1 --2- 172.21.15.53:0/3723141938 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6fac156a40 0x7f6fac0c73e0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f6fa00115e0 tx=0x7f6fa0011aa0 comp rx=0 tx=0).stop 2023-06-10T19:01:32.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:32.159+0000 7f6fb30e2640 1 -- 172.21.15.53:0/3723141938 shutdown_connections 2023-06-10T19:01:32.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:32.159+0000 7f6fb30e2640 1 --2- 172.21.15.53:0/3723141938 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6f98066280 0x7f6f98068730 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:32.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:32.159+0000 7f6fb30e2640 1 --2- 172.21.15.53:0/3723141938 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6fac0c7920 0x7f6fac0c7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:32.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:32.159+0000 7f6fb30e2640 1 --2- 172.21.15.53:0/3723141938 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6fac156a40 0x7f6fac0c73e0 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:32.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:32.159+0000 7f6fb30e2640 1 --2- 172.21.15.53:0/3723141938 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f94004d10 0x7f6fac151f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:32.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:32.159+0000 7f6fb30e2640 1 -- 172.21.15.53:0/3723141938 >> 172.21.15.53:0/3723141938 conn(0x7f6fac071790 msgr2=0x7f6fac0b6470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:32.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:32.159+0000 7f6fb30e2640 1 -- 172.21.15.53:0/3723141938 shutdown_connections 2023-06-10T19:01:32.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:32.159+0000 7f6fb30e2640 1 -- 172.21.15.53:0/3723141938 wait complete. 2023-06-10T19:01:32.180 DEBUG:tasks.cephfs.filesystem:mapped states ['up:reconnect'] to None 2023-06-10T19:01:33.181 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:01:33.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:33.311+0000 7fedf6548640 1 Processor -- start 2023-06-10T19:01:33.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:33.311+0000 7fedf6548640 1 -- start start 2023-06-10T19:01:33.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:33.315+0000 7fedf6548640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fedf0071060 0x7fedf00af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:33.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:33.315+0000 7fedf6548640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fedf00afc60 0x7fedf006b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:33.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:33.315+0000 7fedf6548640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedf0159b50 con 0x7fedf00c9840 2023-06-10T19:01:33.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:33.315+0000 7fedf6548640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedf00702a0 con 0x7fedf0071060 2023-06-10T19:01:33.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:33.315+0000 7fedf6548640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedf0070580 con 0x7fedf00afc60 2023-06-10T19:01:33.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:33.315+0000 7fedef7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fedf0071060 0x7fedf00af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:33.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:33.315+0000 7fedef7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fedf0071060 0x7fedf00af720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39698/0 (socket says 172.21.15.53:39698) 2023-06-10T19:01:33.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:33.315+0000 7fedef7fe640 1 -- 172.21.15.53:0/2345890286 learned_addr learned my addr 172.21.15.53:0/2345890286 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:33.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:33.315+0000 7fedf4ae5640 1 --2- 172.21.15.53:0/2345890286 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fedf00afc60 0x7fedf006b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:33.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:33.315+0000 7fedef7fe640 1 -- 172.21.15.53:0/2345890286 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fedf00afc60 msgr2=0x7fedf006b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:33.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:33.315+0000 7fedef7fe640 1 --2- 172.21.15.53:0/2345890286 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fedf00afc60 0x7fedf006b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:33.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:33.315+0000 7fedef7fe640 1 -- 172.21.15.53:0/2345890286 >> v1:172.21.15.117:6789/0 conn(0x7fedf00c9840 legacy=0x7fedf00c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:33.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:33.315+0000 7fedef7fe640 1 -- 172.21.15.53:0/2345890286 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedf0070860 con 0x7fedf0071060 2023-06-10T19:01:33.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:33.319+0000 7fedef7fe640 1 --2- 172.21.15.53:0/2345890286 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fedf0071060 0x7fedf00af720 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7fede4009870 tx=0x7fede401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ad12bc6e9df3256 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:33.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:33.319+0000 7fedeeffd640 1 -- 172.21.15.53:0/2345890286 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede40a95f0 con 0x7fedf0071060 2023-06-10T19:01:33.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:33.319+0000 7fedeeffd640 1 -- 172.21.15.53:0/2345890286 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fede40a9750 con 0x7fedf0071060 2023-06-10T19:01:33.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:33.319+0000 7fedeeffd640 1 -- 172.21.15.53:0/2345890286 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede40a9ae0 con 0x7fedf0071060 2023-06-10T19:01:33.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:33.319+0000 7fedf6548640 1 -- 172.21.15.53:0/2345890286 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fedf0071060 msgr2=0x7fedf00af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:33.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:33.319+0000 7fedf6548640 1 --2- 172.21.15.53:0/2345890286 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fedf0071060 0x7fedf00af720 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7fede4009870 tx=0x7fede401c510 comp rx=0 tx=0).stop 2023-06-10T19:01:33.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:33.319+0000 7fedf6548640 1 -- 172.21.15.53:0/2345890286 shutdown_connections 2023-06-10T19:01:33.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:33.319+0000 7fedf6548640 1 --2- 172.21.15.53:0/2345890286 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fedf00afc60 0x7fedf006b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:33.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:33.319+0000 7fedf6548640 1 --2- 172.21.15.53:0/2345890286 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fedf0071060 0x7fedf00af720 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:33.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:33.319+0000 7fedf6548640 1 -- 172.21.15.53:0/2345890286 >> 172.21.15.53:0/2345890286 conn(0x7fedf006a0d0 msgr2=0x7fedf00ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:33.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:33.319+0000 7fedf6548640 1 -- 172.21.15.53:0/2345890286 shutdown_connections 2023-06-10T19:01:33.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:33.319+0000 7fedf6548640 1 -- 172.21.15.53:0/2345890286 wait complete. 2023-06-10T19:01:33.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:33.319+0000 7fedf6548640 1 Processor -- start 2023-06-10T19:01:33.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:33.319+0000 7fedf6548640 1 -- start start 2023-06-10T19:01:33.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:33.319+0000 7fedf6548640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fedf0071060 0x7fedf0151840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:33.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:33.319+0000 7fedf6548640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fedf00afc60 0x7fedf00b2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:33.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:33.319+0000 7fedf6548640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fedf00c9840 0x7fedf00b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:33.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:33.319+0000 7fedf6548640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf00c17d0 con 0x7fedf0071060 2023-06-10T19:01:33.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:33.319+0000 7fedf6548640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf01538f0 con 0x7fedf00c9840 2023-06-10T19:01:33.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:33.319+0000 7fedf6548640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedf0152c50 con 0x7fedf00afc60 2023-06-10T19:01:33.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:33.319+0000 7fedeffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fedf0071060 0x7fedf0151840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:33.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:33.319+0000 7fedeffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fedf0071060 0x7fedf0151840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39700/0 (socket says 172.21.15.53:39700) 2023-06-10T19:01:33.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:33.319+0000 7fedeffff640 1 -- 172.21.15.53:0/258584271 learned_addr learned my addr 172.21.15.53:0/258584271 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:33.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:33.319+0000 7fedf4ae5640 1 --2- 172.21.15.53:0/258584271 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fedf00c9840 0x7fedf00b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:33.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:33.319+0000 7fedef7fe640 1 --2- 172.21.15.53:0/258584271 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fedf00afc60 0x7fedf00b2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:33.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:33.319+0000 7fedeffff640 1 -- 172.21.15.53:0/258584271 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fedf00afc60 msgr2=0x7fedf00b2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:33.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:33.319+0000 7fedeffff640 1 --2- 172.21.15.53:0/258584271 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fedf00afc60 0x7fedf00b2ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:33.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:33.319+0000 7fedeffff640 1 -- 172.21.15.53:0/258584271 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fedf00c9840 msgr2=0x7fedf00b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:33.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:33.319+0000 7fedeffff640 1 --2- 172.21.15.53:0/258584271 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fedf00c9840 0x7fedf00b31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:33.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:33.319+0000 7fedeffff640 1 -- 172.21.15.53:0/258584271 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fede40094d0 con 0x7fedf0071060 2023-06-10T19:01:33.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:33.319+0000 7fedef7fe640 1 --2- 172.21.15.53:0/258584271 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fedf00afc60 0x7fedf00b2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:01:33.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:33.323+0000 7fedeffff640 1 --2- 172.21.15.53:0/258584271 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fedf0071060 0x7fedf0151840 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7fede800c7a0 tx=0x7fede800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:33.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:33.323+0000 7fedecff9640 1 -- 172.21.15.53:0/258584271 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede8003b80 con 0x7fedf0071060 2023-06-10T19:01:33.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:33.323+0000 7fedecff9640 1 -- 172.21.15.53:0/258584271 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fede8003ce0 con 0x7fedf0071060 2023-06-10T19:01:33.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:33.323+0000 7fedf6548640 1 -- 172.21.15.53:0/258584271 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedf0152f30 con 0x7fedf0071060 2023-06-10T19:01:33.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:33.323+0000 7fedecff9640 1 -- 172.21.15.53:0/258584271 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede800aa90 con 0x7fedf0071060 2023-06-10T19:01:33.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:33.323+0000 7fedf6548640 1 -- 172.21.15.53:0/258584271 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedf00c1a20 con 0x7fedf0071060 2023-06-10T19:01:33.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:33.323+0000 7fedf6548640 1 -- 172.21.15.53:0/258584271 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedf004d790 con 0x7fedf0071060 2023-06-10T19:01:33.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:33.323+0000 7fedecff9640 1 -- 172.21.15.53:0/258584271 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fede800abf0 con 0x7fedf0071060 2023-06-10T19:01:33.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:33.323+0000 7fedecff9640 1 --2- 172.21.15.53:0/258584271 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7feddc066280 0x7feddc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:33.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:33.323+0000 7fedecff9640 1 -- 172.21.15.53:0/258584271 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6148+0+0 (secure 0 0 0) 0x7fede8084660 con 0x7fedf0071060 2023-06-10T19:01:33.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:33.323+0000 7fedef7fe640 1 --2- 172.21.15.53:0/258584271 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7feddc066280 0x7feddc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:33.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:33.327+0000 7fedef7fe640 1 --2- 172.21.15.53:0/258584271 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7feddc066280 0x7feddc068730 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fede40ae000 tx=0x7fede40b3040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:33.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:33.327+0000 7fedecff9640 1 -- 172.21.15.53:0/258584271 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fede8051af0 con 0x7fedf0071060 2023-06-10T19:01:33.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:33.519+0000 7fedf6548640 1 -- 172.21.15.53:0/258584271 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fedf00cb140 con 0x7fedf0071060 2023-06-10T19:01:33.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:33.519+0000 7fedecff9640 1 -- 172.21.15.53:0/258584271 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4683 (secure 0 0 0) 0x7fede8055110 con 0x7fedf0071060 2023-06-10T19:01:33.525 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:01:33.525 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":38,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5663,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2600814414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2600814414},{"type":"v1","addr":"172.21.15.117:6835","nonce":2600814414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6136,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1615882017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1615882017},{"type":"v1","addr":"172.21.15.117:6837","nonce":1615882017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6993,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/3732245174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3732245174},{"type":"v1","addr":"172.21.15.53:6833","nonce":3732245174}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:00:20.607950+0000","modified":"2023-06-10T19:00:49.023162+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7266":{"gid":7266,"name":"c","rank":0,"incarnation":37,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.53:6835/2829993338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2829993338},{"type":"v1","addr":"172.21.15.53:6835","nonce":2829993338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-06-10T19:01:33.526 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 38 2023-06-10T19:01:33.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:33.523+0000 7fedf6548640 1 -- 172.21.15.53:0/258584271 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7feddc066280 msgr2=0x7feddc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:33.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:33.523+0000 7fedf6548640 1 --2- 172.21.15.53:0/258584271 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7feddc066280 0x7feddc068730 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fede40ae000 tx=0x7fede40b3040 comp rx=0 tx=0).stop 2023-06-10T19:01:33.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:33.523+0000 7fedf6548640 1 -- 172.21.15.53:0/258584271 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fedf0071060 msgr2=0x7fedf0151840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:33.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:33.523+0000 7fedf6548640 1 --2- 172.21.15.53:0/258584271 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fedf0071060 0x7fedf0151840 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7fede800c7a0 tx=0x7fede800cc60 comp rx=0 tx=0).stop 2023-06-10T19:01:33.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:33.523+0000 7fedf6548640 1 -- 172.21.15.53:0/258584271 shutdown_connections 2023-06-10T19:01:33.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:33.523+0000 7fedf6548640 1 --2- 172.21.15.53:0/258584271 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7feddc066280 0x7feddc068730 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:33.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:33.523+0000 7fedf6548640 1 --2- 172.21.15.53:0/258584271 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fedf00c9840 0x7fedf00b31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:33.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:33.523+0000 7fedf6548640 1 --2- 172.21.15.53:0/258584271 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fedf00afc60 0x7fedf00b2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:33.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:33.523+0000 7fedf6548640 1 --2- 172.21.15.53:0/258584271 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fedf0071060 0x7fedf0151840 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:33.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:33.523+0000 7fedf6548640 1 -- 172.21.15.53:0/258584271 >> 172.21.15.53:0/258584271 conn(0x7fedf006a0d0 msgr2=0x7fedf00c82d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:33.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:33.523+0000 7fedf6548640 1 -- 172.21.15.53:0/258584271 shutdown_connections 2023-06-10T19:01:33.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:33.523+0000 7fedf6548640 1 -- 172.21.15.53:0/258584271 wait complete. 2023-06-10T19:01:33.546 DEBUG:tasks.cephfs.filesystem:mapped states ['up:reconnect'] to None 2023-06-10T19:01:34.549 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:01:34.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:34.675+0000 7f9286e4e640 1 Processor -- start 2023-06-10T19:01:34.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:34.675+0000 7f9286e4e640 1 -- start start 2023-06-10T19:01:34.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:34.679+0000 7f9286e4e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9280159690 0x7f9280070950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:34.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:34.679+0000 7f9286e4e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9280159a60 0x7f92800c2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:34.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:34.679+0000 7f9286e4e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92800cb080 con 0x7f92800b0f30 2023-06-10T19:01:34.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:34.679+0000 7f9286e4e640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9280070e90 con 0x7f9280159690 2023-06-10T19:01:34.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:34.679+0000 7f9286e4e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f928006d450 con 0x7f9280159a60 2023-06-10T19:01:34.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:34.679+0000 7f9284bea640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9280159690 0x7f9280070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:34.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:34.679+0000 7f9284bea640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9280159690 0x7f9280070950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39714/0 (socket says 172.21.15.53:39714) 2023-06-10T19:01:34.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:34.679+0000 7f9284bea640 1 -- 172.21.15.53:0/1027394028 learned_addr learned my addr 172.21.15.53:0/1027394028 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:34.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:34.679+0000 7f92853eb640 1 --2- 172.21.15.53:0/1027394028 >> v2:172.21.15.117:3300/0 conn(0x7f9280159a60 0x7f92800c2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:34.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:34.679+0000 7f9284bea640 1 -- 172.21.15.53:0/1027394028 >> v2:172.21.15.117:3300/0 conn(0x7f9280159a60 msgr2=0x7f92800c2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:34.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:34.679+0000 7f9284bea640 1 --2- 172.21.15.53:0/1027394028 >> v2:172.21.15.117:3300/0 conn(0x7f9280159a60 0x7f92800c2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:34.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:34.679+0000 7f9284bea640 1 -- 172.21.15.53:0/1027394028 >> v1:172.21.15.117:6789/0 conn(0x7f92800b0f30 legacy=0x7f92800cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:34.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:34.679+0000 7f9284bea640 1 -- 172.21.15.53:0/1027394028 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92800cb320 con 0x7f9280159690 2023-06-10T19:01:34.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:34.679+0000 7f9284bea640 1 --2- 172.21.15.53:0/1027394028 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9280159690 0x7f9280070950 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f9280070160 tx=0x7f926801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e19edb6002314351 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:34.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:34.679+0000 7f927f7fe640 1 -- 172.21.15.53:0/1027394028 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92680ac600 con 0x7f9280159690 2023-06-10T19:01:34.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:34.683+0000 7f927f7fe640 1 -- 172.21.15.53:0/1027394028 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92680a8050 con 0x7f9280159690 2023-06-10T19:01:34.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:34.683+0000 7f927f7fe640 1 -- 172.21.15.53:0/1027394028 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92680ac980 con 0x7f9280159690 2023-06-10T19:01:34.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:34.683+0000 7f9286e4e640 1 -- 172.21.15.53:0/1027394028 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9280159690 msgr2=0x7f9280070950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:34.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:34.683+0000 7f9286e4e640 1 --2- 172.21.15.53:0/1027394028 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9280159690 0x7f9280070950 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f9280070160 tx=0x7f926801c490 comp rx=0 tx=0).stop 2023-06-10T19:01:34.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:34.683+0000 7f9286e4e640 1 -- 172.21.15.53:0/1027394028 shutdown_connections 2023-06-10T19:01:34.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:34.683+0000 7f9286e4e640 1 --2- 172.21.15.53:0/1027394028 >> v2:172.21.15.117:3300/0 conn(0x7f9280159a60 0x7f92800c2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:34.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:34.683+0000 7f9286e4e640 1 --2- 172.21.15.53:0/1027394028 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9280159690 0x7f9280070950 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:34.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:34.683+0000 7f9286e4e640 1 -- 172.21.15.53:0/1027394028 >> 172.21.15.53:0/1027394028 conn(0x7f928006a560 msgr2=0x7f928006a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:34.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:34.683+0000 7f9286e4e640 1 -- 172.21.15.53:0/1027394028 shutdown_connections 2023-06-10T19:01:34.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:34.683+0000 7f9286e4e640 1 -- 172.21.15.53:0/1027394028 wait complete. 2023-06-10T19:01:34.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:34.683+0000 7f9286e4e640 1 Processor -- start 2023-06-10T19:01:34.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:34.683+0000 7f9286e4e640 1 -- start start 2023-06-10T19:01:34.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:34.683+0000 7f9286e4e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92800b0f30 0x7f92800cdac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:34.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:34.683+0000 7f9286e4e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9280159690 0x7f9280145b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:34.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:34.683+0000 7f9286e4e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9280159a60 0x7f92800ce250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:34.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:34.683+0000 7f9286e4e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92800ce000 con 0x7f92800b0f30 2023-06-10T19:01:34.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:34.683+0000 7f9286e4e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9280146070 con 0x7f9280159690 2023-06-10T19:01:34.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:34.683+0000 7f9286e4e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92800cca20 con 0x7f9280159a60 2023-06-10T19:01:34.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:34.683+0000 7f9284bea640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92800b0f30 0x7f92800cdac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:34.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:34.683+0000 7f9284bea640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92800b0f30 0x7f92800cdac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39724/0 (socket says 172.21.15.53:39724) 2023-06-10T19:01:34.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:34.683+0000 7f9284bea640 1 -- 172.21.15.53:0/4229938232 learned_addr learned my addr 172.21.15.53:0/4229938232 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:34.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:34.683+0000 7f92853eb640 1 --2- 172.21.15.53:0/4229938232 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9280159a60 0x7f92800ce250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:34.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:34.683+0000 7f927ffff640 1 --2- 172.21.15.53:0/4229938232 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9280159690 0x7f9280145b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:34.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:34.683+0000 7f9284bea640 1 -- 172.21.15.53:0/4229938232 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9280159a60 msgr2=0x7f92800ce250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:34.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:34.683+0000 7f9284bea640 1 --2- 172.21.15.53:0/4229938232 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9280159a60 0x7f92800ce250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:34.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:34.683+0000 7f9284bea640 1 -- 172.21.15.53:0/4229938232 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9280159690 msgr2=0x7f9280145b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:34.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:34.683+0000 7f9284bea640 1 --2- 172.21.15.53:0/4229938232 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9280159690 0x7f9280145b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:34.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:34.683+0000 7f9284bea640 1 -- 172.21.15.53:0/4229938232 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92680094d0 con 0x7f92800b0f30 2023-06-10T19:01:34.693 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:34.683+0000 7f927ffff640 1 --2- 172.21.15.53:0/4229938232 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9280159690 0x7f9280145b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:01:34.693 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:34.683+0000 7f9284bea640 1 --2- 172.21.15.53:0/4229938232 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92800b0f30 0x7f92800cdac0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f9268000c10 tx=0x7f926801acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:34.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:34.683+0000 7f927d7fa640 1 -- 172.21.15.53:0/4229938232 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92680b7620 con 0x7f92800b0f30 2023-06-10T19:01:34.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:34.683+0000 7f927d7fa640 1 -- 172.21.15.53:0/4229938232 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92680b77a0 con 0x7f92800b0f30 2023-06-10T19:01:34.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:34.683+0000 7f927d7fa640 1 -- 172.21.15.53:0/4229938232 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92680b7b50 con 0x7f92800b0f30 2023-06-10T19:01:34.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:34.683+0000 7f9286e4e640 1 -- 172.21.15.53:0/4229938232 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92800ccd00 con 0x7f92800b0f30 2023-06-10T19:01:34.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:34.683+0000 7f9286e4e640 1 -- 172.21.15.53:0/4229938232 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92800cd2c0 con 0x7f92800b0f30 2023-06-10T19:01:34.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:34.687+0000 7f9286e4e640 1 -- 172.21.15.53:0/4229938232 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92800b4dc0 con 0x7f92800b0f30 2023-06-10T19:01:34.695 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:34.687+0000 7f927d7fa640 1 -- 172.21.15.53:0/4229938232 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f92680b3040 con 0x7f92800b0f30 2023-06-10T19:01:34.695 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:34.687+0000 7f927d7fa640 1 --2- 172.21.15.53:0/4229938232 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9260066280 0x7f9260068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:34.695 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:34.687+0000 7f927d7fa640 1 -- 172.21.15.53:0/4229938232 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f926811e0b0 con 0x7f92800b0f30 2023-06-10T19:01:34.695 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:34.687+0000 7f927ffff640 1 --2- 172.21.15.53:0/4229938232 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9260066280 0x7f9260068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:34.695 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:34.687+0000 7f927ffff640 1 --2- 172.21.15.53:0/4229938232 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9260066280 0x7f9260068730 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f9270007fd0 tx=0x7f9270009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:34.697 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:34.691+0000 7f927d7fa640 1 -- 172.21.15.53:0/4229938232 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f92680eb440 con 0x7f92800b0f30 2023-06-10T19:01:34.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:34.879+0000 7f9286e4e640 1 -- 172.21.15.53:0/4229938232 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f928004d790 con 0x7f92800b0f30 2023-06-10T19:01:34.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:34.879+0000 7f927d7fa640 1 -- 172.21.15.53:0/4229938232 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4683 (secure 0 0 0) 0x7f92680eea60 con 0x7f92800b0f30 2023-06-10T19:01:34.886 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:01:34.886 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":38,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5663,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2600814414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2600814414},{"type":"v1","addr":"172.21.15.117:6835","nonce":2600814414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6136,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1615882017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1615882017},{"type":"v1","addr":"172.21.15.117:6837","nonce":1615882017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6993,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/3732245174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3732245174},{"type":"v1","addr":"172.21.15.53:6833","nonce":3732245174}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:00:20.607950+0000","modified":"2023-06-10T19:00:49.023162+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7266":{"gid":7266,"name":"c","rank":0,"incarnation":37,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.53:6835/2829993338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2829993338},{"type":"v1","addr":"172.21.15.53:6835","nonce":2829993338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-06-10T19:01:34.886 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 38 2023-06-10T19:01:34.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:34.883+0000 7f9286e4e640 1 -- 172.21.15.53:0/4229938232 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9260066280 msgr2=0x7f9260068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:34.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:34.883+0000 7f9286e4e640 1 --2- 172.21.15.53:0/4229938232 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9260066280 0x7f9260068730 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f9270007fd0 tx=0x7f9270009040 comp rx=0 tx=0).stop 2023-06-10T19:01:34.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:34.883+0000 7f9286e4e640 1 -- 172.21.15.53:0/4229938232 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92800b0f30 msgr2=0x7f92800cdac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:34.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:34.883+0000 7f9286e4e640 1 --2- 172.21.15.53:0/4229938232 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92800b0f30 0x7f92800cdac0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f9268000c10 tx=0x7f926801acd0 comp rx=0 tx=0).stop 2023-06-10T19:01:34.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:34.883+0000 7f9286e4e640 1 -- 172.21.15.53:0/4229938232 shutdown_connections 2023-06-10T19:01:34.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:34.883+0000 7f9286e4e640 1 --2- 172.21.15.53:0/4229938232 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9260066280 0x7f9260068730 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:34.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:34.883+0000 7f9286e4e640 1 --2- 172.21.15.53:0/4229938232 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9280159a60 0x7f92800ce250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:34.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:34.883+0000 7f9286e4e640 1 --2- 172.21.15.53:0/4229938232 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9280159690 0x7f9280145b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:34.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:34.883+0000 7f9286e4e640 1 --2- 172.21.15.53:0/4229938232 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92800b0f30 0x7f92800cdac0 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:34.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:34.883+0000 7f9286e4e640 1 -- 172.21.15.53:0/4229938232 >> 172.21.15.53:0/4229938232 conn(0x7f928006a560 msgr2=0x7f9280150560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:34.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:34.883+0000 7f9286e4e640 1 -- 172.21.15.53:0/4229938232 shutdown_connections 2023-06-10T19:01:34.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:34.883+0000 7f9286e4e640 1 -- 172.21.15.53:0/4229938232 wait complete. 2023-06-10T19:01:34.905 DEBUG:tasks.cephfs.filesystem:mapped states ['up:reconnect'] to None 2023-06-10T19:01:35.906 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:01:36.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:36.039+0000 7f1b83d32640 1 Processor -- start 2023-06-10T19:01:36.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:36.039+0000 7f1b83d32640 1 -- start start 2023-06-10T19:01:36.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:36.039+0000 7f1b83d32640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b7c0c9840 0x7f1b7c0c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:36.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:36.039+0000 7f1b83d32640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1b7c071060 0x7f1b7c0af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:36.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:36.039+0000 7f1b83d32640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1b7c0afc60 0x7f1b7c15d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:36.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:36.039+0000 7f1b83d32640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b7c159b50 con 0x7f1b7c071060 2023-06-10T19:01:36.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:36.039+0000 7f1b83d32640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b7c0ca150 con 0x7f1b7c0afc60 2023-06-10T19:01:36.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:36.039+0000 7f1b83d32640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b7c0702a0 con 0x7f1b7c0c9840 2023-06-10T19:01:36.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:36.039+0000 7f1b812cd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1b7c071060 0x7f1b7c0af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:36.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:36.039+0000 7f1b812cd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1b7c071060 0x7f1b7c0af720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39730/0 (socket says 172.21.15.53:39730) 2023-06-10T19:01:36.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:36.039+0000 7f1b812cd640 1 -- 172.21.15.53:0/3512422996 learned_addr learned my addr 172.21.15.53:0/3512422996 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:36.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:36.043+0000 7f1b81ace640 1 --2- 172.21.15.53:0/3512422996 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b7c0c9840 0x7f1b7c0c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:36.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:36.043+0000 7f1b822cf640 1 --2- 172.21.15.53:0/3512422996 >> v2:172.21.15.117:3300/0 conn(0x7f1b7c0afc60 0x7f1b7c15d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:36.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:36.043+0000 7f1b812cd640 1 -- 172.21.15.53:0/3512422996 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b7c0c9840 msgr2=0x7f1b7c0c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:36.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:36.043+0000 7f1b812cd640 1 --2- 172.21.15.53:0/3512422996 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b7c0c9840 0x7f1b7c0c9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:36.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:36.043+0000 7f1b812cd640 1 -- 172.21.15.53:0/3512422996 >> v2:172.21.15.117:3300/0 conn(0x7f1b7c0afc60 msgr2=0x7f1b7c15d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:36.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:36.043+0000 7f1b812cd640 1 --2- 172.21.15.53:0/3512422996 >> v2:172.21.15.117:3300/0 conn(0x7f1b7c0afc60 0x7f1b7c15d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:36.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:36.043+0000 7f1b812cd640 1 -- 172.21.15.53:0/3512422996 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b7c070580 con 0x7f1b7c071060 2023-06-10T19:01:36.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:36.043+0000 7f1b812cd640 1 --2- 172.21.15.53:0/3512422996 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b7c071060 0x7f1b7c0af720 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c06ef50 tx=0x7f1b6c01c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a22ffe97714dfa5 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:36.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:36.043+0000 7f1b80acc640 1 -- 172.21.15.53:0/3512422996 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b6c0ab600 con 0x7f1b7c071060 2023-06-10T19:01:36.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:36.043+0000 7f1b80acc640 1 -- 172.21.15.53:0/3512422996 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b6c0a7050 con 0x7f1b7c071060 2023-06-10T19:01:36.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:36.043+0000 7f1b80acc640 1 -- 172.21.15.53:0/3512422996 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b6c0ab980 con 0x7f1b7c071060 2023-06-10T19:01:36.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:36.043+0000 7f1b83d32640 1 -- 172.21.15.53:0/3512422996 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b7c071060 msgr2=0x7f1b7c0af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:36.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:36.043+0000 7f1b83d32640 1 --2- 172.21.15.53:0/3512422996 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b7c071060 0x7f1b7c0af720 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c06ef50 tx=0x7f1b6c01c210 comp rx=0 tx=0).stop 2023-06-10T19:01:36.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:36.043+0000 7f1b83d32640 1 -- 172.21.15.53:0/3512422996 shutdown_connections 2023-06-10T19:01:36.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:36.043+0000 7f1b83d32640 1 --2- 172.21.15.53:0/3512422996 >> v2:172.21.15.117:3300/0 conn(0x7f1b7c0afc60 0x7f1b7c15d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:36.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:36.043+0000 7f1b83d32640 1 --2- 172.21.15.53:0/3512422996 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b7c071060 0x7f1b7c0af720 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:36.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:36.043+0000 7f1b83d32640 1 --2- 172.21.15.53:0/3512422996 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b7c0c9840 0x7f1b7c0c9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:36.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:36.043+0000 7f1b83d32640 1 -- 172.21.15.53:0/3512422996 >> 172.21.15.53:0/3512422996 conn(0x7f1b7c06a0d0 msgr2=0x7f1b7c0ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:36.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:36.043+0000 7f1b83d32640 1 -- 172.21.15.53:0/3512422996 shutdown_connections 2023-06-10T19:01:36.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:36.043+0000 7f1b83d32640 1 -- 172.21.15.53:0/3512422996 wait complete. 2023-06-10T19:01:36.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:36.047+0000 7f1b83d32640 1 Processor -- start 2023-06-10T19:01:36.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:36.047+0000 7f1b83d32640 1 -- start start 2023-06-10T19:01:36.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:36.047+0000 7f1b83d32640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b7c071060 0x7f1b7c14e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:36.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:36.047+0000 7f1b83d32640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b7c0afc60 0x7f1b7c15c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:36.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:36.047+0000 7f1b83d32640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b7c0c9840 0x7f1b7c157680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:36.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:36.047+0000 7f1b83d32640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b7c15c400 con 0x7f1b7c071060 2023-06-10T19:01:36.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:36.047+0000 7f1b83d32640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b7c15b780 con 0x7f1b7c0c9840 2023-06-10T19:01:36.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:36.047+0000 7f1b83d32640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b7c15ba60 con 0x7f1b7c0afc60 2023-06-10T19:01:36.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:36.047+0000 7f1b81ace640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b7c071060 0x7f1b7c14e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:36.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:36.047+0000 7f1b81ace640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b7c071060 0x7f1b7c14e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39740/0 (socket says 172.21.15.53:39740) 2023-06-10T19:01:36.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:36.047+0000 7f1b81ace640 1 -- 172.21.15.53:0/2767218768 learned_addr learned my addr 172.21.15.53:0/2767218768 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:36.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:36.047+0000 7f1b812cd640 1 --2- 172.21.15.53:0/2767218768 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b7c0afc60 0x7f1b7c15c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:36.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:36.047+0000 7f1b822cf640 1 --2- 172.21.15.53:0/2767218768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b7c0c9840 0x7f1b7c157680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:36.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:36.047+0000 7f1b81ace640 1 -- 172.21.15.53:0/2767218768 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b7c0afc60 msgr2=0x7f1b7c15c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:36.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:36.047+0000 7f1b81ace640 1 --2- 172.21.15.53:0/2767218768 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b7c0afc60 0x7f1b7c15c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:36.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:36.047+0000 7f1b81ace640 1 -- 172.21.15.53:0/2767218768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b7c0c9840 msgr2=0x7f1b7c157680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:36.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:36.047+0000 7f1b81ace640 1 --2- 172.21.15.53:0/2767218768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b7c0c9840 0x7f1b7c157680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:36.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:36.047+0000 7f1b81ace640 1 -- 172.21.15.53:0/2767218768 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b6c0094d0 con 0x7f1b7c071060 2023-06-10T19:01:36.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:36.047+0000 7f1b81ace640 1 --2- 172.21.15.53:0/2767218768 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b7c071060 0x7f1b7c14e130 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f1b7800d5f0 tx=0x7f1b7800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:36.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:36.047+0000 7f1b727fc640 1 -- 172.21.15.53:0/2767218768 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b780125f0 con 0x7f1b7c071060 2023-06-10T19:01:36.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:36.047+0000 7f1b727fc640 1 -- 172.21.15.53:0/2767218768 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b78012750 con 0x7f1b7c071060 2023-06-10T19:01:36.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:36.047+0000 7f1b83d32640 1 -- 172.21.15.53:0/2767218768 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b7c15bd40 con 0x7f1b7c071060 2023-06-10T19:01:36.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:36.047+0000 7f1b727fc640 1 -- 172.21.15.53:0/2767218768 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b78012ae0 con 0x7f1b7c071060 2023-06-10T19:01:36.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:36.047+0000 7f1b83d32640 1 -- 172.21.15.53:0/2767218768 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b7c14e670 con 0x7f1b7c071060 2023-06-10T19:01:36.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:36.047+0000 7f1b83d32640 1 -- 172.21.15.53:0/2767218768 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b7c15aba0 con 0x7f1b7c071060 2023-06-10T19:01:36.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:36.051+0000 7f1b727fc640 1 -- 172.21.15.53:0/2767218768 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1b78012c40 con 0x7f1b7c071060 2023-06-10T19:01:36.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:36.051+0000 7f1b727fc640 1 --2- 172.21.15.53:0/2767218768 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1b60066280 0x7f1b60068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:36.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:36.051+0000 7f1b727fc640 1 -- 172.21.15.53:0/2767218768 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f1b78084230 con 0x7f1b7c071060 2023-06-10T19:01:36.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:36.051+0000 7f1b812cd640 1 --2- 172.21.15.53:0/2767218768 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1b60066280 0x7f1b60068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:36.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:36.051+0000 7f1b812cd640 1 --2- 172.21.15.53:0/2767218768 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1b60066280 0x7f1b60068730 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c0ad000 tx=0x7f1b6c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:36.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:36.055+0000 7f1b727fc640 1 -- 172.21.15.53:0/2767218768 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1b78051650 con 0x7f1b7c071060 2023-06-10T19:01:36.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:36.243+0000 7f1b83d32640 1 -- 172.21.15.53:0/2767218768 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1b7c06b010 con 0x7f1b7c071060 2023-06-10T19:01:36.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:36.243+0000 7f1b727fc640 1 -- 172.21.15.53:0/2767218768 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4683 (secure 0 0 0) 0x7f1b78054c70 con 0x7f1b7c071060 2023-06-10T19:01:36.249 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:01:36.250 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":38,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5663,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2600814414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2600814414},{"type":"v1","addr":"172.21.15.117:6835","nonce":2600814414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6136,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1615882017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1615882017},{"type":"v1","addr":"172.21.15.117:6837","nonce":1615882017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6993,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/3732245174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3732245174},{"type":"v1","addr":"172.21.15.53:6833","nonce":3732245174}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:00:20.607950+0000","modified":"2023-06-10T19:00:49.023162+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7266":{"gid":7266,"name":"c","rank":0,"incarnation":37,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.53:6835/2829993338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2829993338},{"type":"v1","addr":"172.21.15.53:6835","nonce":2829993338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-06-10T19:01:36.250 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 38 2023-06-10T19:01:36.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:36.247+0000 7f1b83d32640 1 -- 172.21.15.53:0/2767218768 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1b60066280 msgr2=0x7f1b60068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:36.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:36.247+0000 7f1b83d32640 1 --2- 172.21.15.53:0/2767218768 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1b60066280 0x7f1b60068730 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c0ad000 tx=0x7f1b6c008040 comp rx=0 tx=0).stop 2023-06-10T19:01:36.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:36.247+0000 7f1b83d32640 1 -- 172.21.15.53:0/2767218768 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b7c071060 msgr2=0x7f1b7c14e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:36.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:36.247+0000 7f1b83d32640 1 --2- 172.21.15.53:0/2767218768 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b7c071060 0x7f1b7c14e130 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f1b7800d5f0 tx=0x7f1b7800dab0 comp rx=0 tx=0).stop 2023-06-10T19:01:36.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:36.247+0000 7f1b83d32640 1 -- 172.21.15.53:0/2767218768 shutdown_connections 2023-06-10T19:01:36.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:36.247+0000 7f1b83d32640 1 --2- 172.21.15.53:0/2767218768 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1b60066280 0x7f1b60068730 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:36.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:36.247+0000 7f1b83d32640 1 --2- 172.21.15.53:0/2767218768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b7c0c9840 0x7f1b7c157680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:36.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:36.247+0000 7f1b83d32640 1 --2- 172.21.15.53:0/2767218768 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b7c0afc60 0x7f1b7c15c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:36.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:36.247+0000 7f1b83d32640 1 --2- 172.21.15.53:0/2767218768 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b7c071060 0x7f1b7c14e130 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:36.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:36.247+0000 7f1b83d32640 1 -- 172.21.15.53:0/2767218768 >> 172.21.15.53:0/2767218768 conn(0x7f1b7c06a0d0 msgr2=0x7f1b7c0ca290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:36.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:36.247+0000 7f1b83d32640 1 -- 172.21.15.53:0/2767218768 shutdown_connections 2023-06-10T19:01:36.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:36.247+0000 7f1b83d32640 1 -- 172.21.15.53:0/2767218768 wait complete. 2023-06-10T19:01:36.268 DEBUG:tasks.cephfs.filesystem:mapped states ['up:reconnect'] to None 2023-06-10T19:01:37.269 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:01:37.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:37.399+0000 7f470394f640 1 Processor -- start 2023-06-10T19:01:37.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:37.399+0000 7f470394f640 1 -- start start 2023-06-10T19:01:37.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:37.403+0000 7f470394f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f46fc071060 0x7f46fc0af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:37.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:37.403+0000 7f470394f640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f46fc0afc60 0x7f46fc06b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:37.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:37.403+0000 7f470394f640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46fc159b50 con 0x7f46fc0c9840 2023-06-10T19:01:37.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:37.403+0000 7f470394f640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46fc0702a0 con 0x7f46fc071060 2023-06-10T19:01:37.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:37.403+0000 7f470394f640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46fc070580 con 0x7f46fc0afc60 2023-06-10T19:01:37.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:37.403+0000 7f4700eea640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f46fc071060 0x7f46fc0af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:37.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:37.403+0000 7f47016eb640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f46fc0c9840 0x7f46fc0c9c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:48532/0 (socket says 172.21.15.53:48532) 2023-06-10T19:01:37.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:37.403+0000 7f47016eb640 1 -- 172.21.15.53:0/3744722406 learned_addr learned my addr 172.21.15.53:0/3744722406 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:01:37.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:37.403+0000 7f4701eec640 1 --2- 172.21.15.53:0/3744722406 >> v2:172.21.15.117:3300/0 conn(0x7f46fc0afc60 0x7f46fc06b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:37.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:37.403+0000 7f4700eea640 1 -- 172.21.15.53:0/3744722406 >> v2:172.21.15.117:3300/0 conn(0x7f46fc0afc60 msgr2=0x7f46fc06b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:37.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:37.403+0000 7f4700eea640 1 --2- 172.21.15.53:0/3744722406 >> v2:172.21.15.117:3300/0 conn(0x7f46fc0afc60 0x7f46fc06b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:37.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:37.403+0000 7f4700eea640 1 -- 172.21.15.53:0/3744722406 >> v1:172.21.15.53:6789/0 conn(0x7f46fc0c9840 legacy=0x7f46fc0c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:37.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:37.403+0000 7f46fbfff640 1 -- 172.21.15.53:0/3744722406 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1361380071 0 0) 0x7f46fc159b50 con 0x7f46fc0c9840 2023-06-10T19:01:37.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:37.403+0000 7f4700eea640 1 -- 172.21.15.53:0/3744722406 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46fc070860 con 0x7f46fc071060 2023-06-10T19:01:37.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:37.403+0000 7f4700eea640 1 --2- 172.21.15.53:0/3744722406 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46fc071060 0x7f46fc0af720 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f46fc15e360 tx=0x7f46f001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59194f5ab4ede34c server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:37.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:37.403+0000 7f46fbfff640 1 -- 172.21.15.53:0/3744722406 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f00a59c0 con 0x7f46fc071060 2023-06-10T19:01:37.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:37.403+0000 7f46fbfff640 1 -- 172.21.15.53:0/3744722406 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46f00a5b20 con 0x7f46fc071060 2023-06-10T19:01:37.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:37.403+0000 7f46fbfff640 1 -- 172.21.15.53:0/3744722406 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f00ad440 con 0x7f46fc071060 2023-06-10T19:01:37.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:37.407+0000 7f470394f640 1 -- 172.21.15.53:0/3744722406 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46fc071060 msgr2=0x7f46fc0af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:37.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:37.407+0000 7f470394f640 1 --2- 172.21.15.53:0/3744722406 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46fc071060 0x7f46fc0af720 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f46fc15e360 tx=0x7f46f001c8e0 comp rx=0 tx=0).stop 2023-06-10T19:01:37.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:37.407+0000 7f470394f640 1 -- 172.21.15.53:0/3744722406 shutdown_connections 2023-06-10T19:01:37.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:37.407+0000 7f470394f640 1 --2- 172.21.15.53:0/3744722406 >> v2:172.21.15.117:3300/0 conn(0x7f46fc0afc60 0x7f46fc06b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:37.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:37.407+0000 7f470394f640 1 --2- 172.21.15.53:0/3744722406 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46fc071060 0x7f46fc0af720 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:37.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:37.407+0000 7f470394f640 1 -- 172.21.15.53:0/3744722406 >> 172.21.15.53:0/3744722406 conn(0x7f46fc06a0d0 msgr2=0x7f46fc0ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:37.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:37.407+0000 7f470394f640 1 -- 172.21.15.53:0/3744722406 shutdown_connections 2023-06-10T19:01:37.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:37.407+0000 7f470394f640 1 -- 172.21.15.53:0/3744722406 wait complete. 2023-06-10T19:01:37.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:37.407+0000 7f470394f640 1 Processor -- start 2023-06-10T19:01:37.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:37.407+0000 7f470394f640 1 -- start start 2023-06-10T19:01:37.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:37.407+0000 7f470394f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46fc071060 0x7f46fc149ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:37.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:37.407+0000 7f470394f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46fc0afc60 0x7f46fc1535f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:37.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:37.407+0000 7f470394f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46fc0c9840 0x7f46fc14e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:37.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:37.407+0000 7f470394f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46fc14ece0 con 0x7f46fc071060 2023-06-10T19:01:37.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:37.407+0000 7f470394f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46fc154890 con 0x7f46fc0afc60 2023-06-10T19:01:37.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:37.407+0000 7f470394f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46fc153c80 con 0x7f46fc0c9840 2023-06-10T19:01:37.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:37.407+0000 7f47016eb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46fc071060 0x7f46fc149ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:37.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:37.407+0000 7f47016eb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46fc071060 0x7f46fc149ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39752/0 (socket says 172.21.15.53:39752) 2023-06-10T19:01:37.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:37.407+0000 7f47016eb640 1 -- 172.21.15.53:0/2301560129 learned_addr learned my addr 172.21.15.53:0/2301560129 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:37.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:37.407+0000 7f4701eec640 1 --2- 172.21.15.53:0/2301560129 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46fc0c9840 0x7f46fc14e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:37.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:37.407+0000 7f4700eea640 1 --2- 172.21.15.53:0/2301560129 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46fc0afc60 0x7f46fc1535f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:37.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:37.407+0000 7f47016eb640 1 -- 172.21.15.53:0/2301560129 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46fc0c9840 msgr2=0x7f46fc14e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:37.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:37.407+0000 7f47016eb640 1 --2- 172.21.15.53:0/2301560129 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46fc0c9840 0x7f46fc14e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:37.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:37.407+0000 7f47016eb640 1 -- 172.21.15.53:0/2301560129 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46fc0afc60 msgr2=0x7f46fc1535f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:37.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:37.407+0000 7f47016eb640 1 --2- 172.21.15.53:0/2301560129 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46fc0afc60 0x7f46fc1535f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:37.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:37.407+0000 7f47016eb640 1 -- 172.21.15.53:0/2301560129 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46f0009a70 con 0x7f46fc071060 2023-06-10T19:01:37.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:37.407+0000 7f4700eea640 1 --2- 172.21.15.53:0/2301560129 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46fc0afc60 0x7f46fc1535f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:01:37.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:37.407+0000 7f47016eb640 1 --2- 172.21.15.53:0/2301560129 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46fc071060 0x7f46fc149ff0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f46ec00c480 tx=0x7f46ec00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:37.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:37.407+0000 7f46f9ffb640 1 -- 172.21.15.53:0/2301560129 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ec0074e0 con 0x7f46fc071060 2023-06-10T19:01:37.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:37.407+0000 7f46f9ffb640 1 -- 172.21.15.53:0/2301560129 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46ec007660 con 0x7f46fc071060 2023-06-10T19:01:37.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:37.407+0000 7f470394f640 1 -- 172.21.15.53:0/2301560129 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46fc153f60 con 0x7f46fc071060 2023-06-10T19:01:37.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:37.407+0000 7f46f9ffb640 1 -- 172.21.15.53:0/2301560129 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ec004a30 con 0x7f46fc071060 2023-06-10T19:01:37.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:37.407+0000 7f470394f640 1 -- 172.21.15.53:0/2301560129 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46fc154520 con 0x7f46fc071060 2023-06-10T19:01:37.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:37.411+0000 7f470394f640 1 -- 172.21.15.53:0/2301560129 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46fc04d790 con 0x7f46fc071060 2023-06-10T19:01:37.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:37.411+0000 7f46f9ffb640 1 -- 172.21.15.53:0/2301560129 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f46ec004b90 con 0x7f46fc071060 2023-06-10T19:01:37.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:37.411+0000 7f46f9ffb640 1 --2- 172.21.15.53:0/2301560129 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f46e8066280 0x7f46e8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:37.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:37.411+0000 7f46f9ffb640 1 -- 172.21.15.53:0/2301560129 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f46ec083310 con 0x7f46fc071060 2023-06-10T19:01:37.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:37.411+0000 7f4700eea640 1 --2- 172.21.15.53:0/2301560129 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f46e8066280 0x7f46e8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:37.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:37.411+0000 7f4700eea640 1 --2- 172.21.15.53:0/2301560129 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f46e8066280 0x7f46e8068730 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f46f00af000 tx=0x7f46f00a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:37.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:37.415+0000 7f46f9ffb640 1 -- 172.21.15.53:0/2301560129 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f46ec0541b0 con 0x7f46fc071060 2023-06-10T19:01:37.508 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-10T19:01:37.510 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-10T19:01:37.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:37.603+0000 7f470394f640 1 -- 172.21.15.53:0/2301560129 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f46fc0cb140 con 0x7f46fc071060 2023-06-10T19:01:37.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:37.603+0000 7f46f9ffb640 1 -- 172.21.15.53:0/2301560129 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4683 (secure 0 0 0) 0x7f46ec053d40 con 0x7f46fc071060 2023-06-10T19:01:37.610 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:01:37.610 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":38,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5663,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2600814414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2600814414},{"type":"v1","addr":"172.21.15.117:6835","nonce":2600814414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6136,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1615882017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1615882017},{"type":"v1","addr":"172.21.15.117:6837","nonce":1615882017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6993,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/3732245174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3732245174},{"type":"v1","addr":"172.21.15.53:6833","nonce":3732245174}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:00:20.607950+0000","modified":"2023-06-10T19:00:49.023162+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7266":{"gid":7266,"name":"c","rank":0,"incarnation":37,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.53:6835/2829993338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2829993338},{"type":"v1","addr":"172.21.15.53:6835","nonce":2829993338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-06-10T19:01:37.611 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 38 2023-06-10T19:01:37.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:37.607+0000 7f470394f640 1 -- 172.21.15.53:0/2301560129 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f46e8066280 msgr2=0x7f46e8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:37.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:37.607+0000 7f470394f640 1 --2- 172.21.15.53:0/2301560129 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f46e8066280 0x7f46e8068730 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f46f00af000 tx=0x7f46f00a7070 comp rx=0 tx=0).stop 2023-06-10T19:01:37.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:37.607+0000 7f470394f640 1 -- 172.21.15.53:0/2301560129 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46fc071060 msgr2=0x7f46fc149ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:37.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:37.607+0000 7f470394f640 1 --2- 172.21.15.53:0/2301560129 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46fc071060 0x7f46fc149ff0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f46ec00c480 tx=0x7f46ec00c940 comp rx=0 tx=0).stop 2023-06-10T19:01:37.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:37.607+0000 7f470394f640 1 -- 172.21.15.53:0/2301560129 shutdown_connections 2023-06-10T19:01:37.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:37.607+0000 7f470394f640 1 --2- 172.21.15.53:0/2301560129 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f46e8066280 0x7f46e8068730 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:37.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:37.607+0000 7f470394f640 1 --2- 172.21.15.53:0/2301560129 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46fc0c9840 0x7f46fc14e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:37.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:37.607+0000 7f470394f640 1 --2- 172.21.15.53:0/2301560129 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46fc0afc60 0x7f46fc1535f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:37.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:37.607+0000 7f470394f640 1 --2- 172.21.15.53:0/2301560129 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46fc071060 0x7f46fc149ff0 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:37.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:37.607+0000 7f470394f640 1 -- 172.21.15.53:0/2301560129 >> 172.21.15.53:0/2301560129 conn(0x7f46fc06a0d0 msgr2=0x7f46fc0ad5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:37.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:37.607+0000 7f470394f640 1 -- 172.21.15.53:0/2301560129 shutdown_connections 2023-06-10T19:01:37.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:37.607+0000 7f470394f640 1 -- 172.21.15.53:0/2301560129 wait complete. 2023-06-10T19:01:37.629 DEBUG:tasks.cephfs.filesystem:mapped states ['up:reconnect'] to None 2023-06-10T19:01:38.631 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:01:38.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:38.759+0000 7f55f14e7640 1 Processor -- start 2023-06-10T19:01:38.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:38.759+0000 7f55f14e7640 1 -- start start 2023-06-10T19:01:38.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:38.759+0000 7f55f14e7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f55ec06b2f0 0x7f55ec06f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:38.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:38.759+0000 7f55f14e7640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f55ec0c8d00 0x7f55ec06b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:38.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:38.759+0000 7f55f14e7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55ec06bc00 0x7f55ec0cbe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:38.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:38.759+0000 7f55f14e7640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55ec158a90 con 0x7f55ec06b2f0 2023-06-10T19:01:38.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:38.759+0000 7f55f14e7640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55ec0705d0 con 0x7f55ec0c8d00 2023-06-10T19:01:38.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:38.759+0000 7f55f14e7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55ec06f9c0 con 0x7f55ec06bc00 2023-06-10T19:01:38.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:38.759+0000 7f55eaffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f55ec06b2f0 0x7f55ec06f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:38.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:38.759+0000 7f55eaffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f55ec06b2f0 0x7f55ec06f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39754/0 (socket says 172.21.15.53:39754) 2023-06-10T19:01:38.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:38.759+0000 7f55eaffd640 1 -- 172.21.15.53:0/1340788620 learned_addr learned my addr 172.21.15.53:0/1340788620 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:38.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:38.759+0000 7f55eb7fe640 1 --2- 172.21.15.53:0/1340788620 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55ec06bc00 0x7f55ec0cbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:38.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:38.759+0000 7f55ea7fc640 1 --2- 172.21.15.53:0/1340788620 >> v2:172.21.15.117:3300/0 conn(0x7f55ec0c8d00 0x7f55ec06b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:38.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:38.759+0000 7f55eaffd640 1 -- 172.21.15.53:0/1340788620 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55ec06bc00 msgr2=0x7f55ec0cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:38.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:38.759+0000 7f55eaffd640 1 --2- 172.21.15.53:0/1340788620 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55ec06bc00 0x7f55ec0cbe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:38.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:38.759+0000 7f55eaffd640 1 -- 172.21.15.53:0/1340788620 >> v2:172.21.15.117:3300/0 conn(0x7f55ec0c8d00 msgr2=0x7f55ec06b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:38.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:38.759+0000 7f55eaffd640 1 --2- 172.21.15.53:0/1340788620 >> v2:172.21.15.117:3300/0 conn(0x7f55ec0c8d00 0x7f55ec06b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:38.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:38.759+0000 7f55eaffd640 1 -- 172.21.15.53:0/1340788620 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55ec06fca0 con 0x7f55ec06b2f0 2023-06-10T19:01:38.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:38.759+0000 7f55eb7fe640 1 --2- 172.21.15.53:0/1340788620 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55ec06bc00 0x7f55ec0cbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:01:38.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:38.759+0000 7f55ea7fc640 1 --2- 172.21.15.53:0/1340788620 >> v2:172.21.15.117:3300/0 conn(0x7f55ec0c8d00 0x7f55ec06b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:01:38.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:38.763+0000 7f55eaffd640 1 --2- 172.21.15.53:0/1340788620 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55ec06b2f0 0x7f55ec06f070 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f55ec15c0b0 tx=0x7f55dc01ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cac0e9635344e9a server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:38.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:38.763+0000 7f55e9ffb640 1 -- 172.21.15.53:0/1340788620 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55dc0a89b0 con 0x7f55ec06b2f0 2023-06-10T19:01:38.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:38.763+0000 7f55e9ffb640 1 -- 172.21.15.53:0/1340788620 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55dc0a8b10 con 0x7f55ec06b2f0 2023-06-10T19:01:38.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:38.763+0000 7f55e9ffb640 1 -- 172.21.15.53:0/1340788620 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55dc0a8ea0 con 0x7f55ec06b2f0 2023-06-10T19:01:38.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:38.763+0000 7f55f14e7640 1 -- 172.21.15.53:0/1340788620 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55ec06b2f0 msgr2=0x7f55ec06f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:38.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:38.763+0000 7f55f14e7640 1 --2- 172.21.15.53:0/1340788620 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55ec06b2f0 0x7f55ec06f070 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f55ec15c0b0 tx=0x7f55dc01ecf0 comp rx=0 tx=0).stop 2023-06-10T19:01:38.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:38.763+0000 7f55f14e7640 1 -- 172.21.15.53:0/1340788620 shutdown_connections 2023-06-10T19:01:38.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:38.763+0000 7f55f14e7640 1 --2- 172.21.15.53:0/1340788620 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55ec06bc00 0x7f55ec0cbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:38.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:38.763+0000 7f55f14e7640 1 --2- 172.21.15.53:0/1340788620 >> v2:172.21.15.117:3300/0 conn(0x7f55ec0c8d00 0x7f55ec06b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:38.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:38.763+0000 7f55f14e7640 1 --2- 172.21.15.53:0/1340788620 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55ec06b2f0 0x7f55ec06f070 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:38.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:38.763+0000 7f55f14e7640 1 -- 172.21.15.53:0/1340788620 >> 172.21.15.53:0/1340788620 conn(0x7f55ec06a0d0 msgr2=0x7f55ec0ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:38.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:38.763+0000 7f55f14e7640 1 -- 172.21.15.53:0/1340788620 shutdown_connections 2023-06-10T19:01:38.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:38.763+0000 7f55f14e7640 1 -- 172.21.15.53:0/1340788620 wait complete. 2023-06-10T19:01:38.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:38.763+0000 7f55f14e7640 1 Processor -- start 2023-06-10T19:01:38.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:38.763+0000 7f55f14e7640 1 -- start start 2023-06-10T19:01:38.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:38.763+0000 7f55f14e7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55ec06b2f0 0x7f55ec155580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:38.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:38.763+0000 7f55f14e7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f55ec06bc00 0x7f55ec154d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:38.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:38.763+0000 7f55f14e7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55ec0c8d00 0x7f55ec1e6750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:38.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:38.763+0000 7f55f14e7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55ec1e3250 con 0x7f55ec0c8d00 2023-06-10T19:01:38.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:38.763+0000 7f55f14e7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55ec155ac0 con 0x7f55ec06bc00 2023-06-10T19:01:38.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:38.763+0000 7f55f14e7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55ec1e3460 con 0x7f55ec06b2f0 2023-06-10T19:01:38.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:38.763+0000 7f55eb7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55ec0c8d00 0x7f55ec1e6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:38.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:38.763+0000 7f55eb7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55ec0c8d00 0x7f55ec1e6750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39756/0 (socket says 172.21.15.53:39756) 2023-06-10T19:01:38.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:38.763+0000 7f55eb7fe640 1 -- 172.21.15.53:0/2936122445 learned_addr learned my addr 172.21.15.53:0/2936122445 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:38.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:38.763+0000 7f55ea7fc640 1 --2- 172.21.15.53:0/2936122445 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f55ec06bc00 0x7f55ec154d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:38.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:38.763+0000 7f55eaffd640 1 --2- 172.21.15.53:0/2936122445 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55ec06b2f0 0x7f55ec155580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:38.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:38.763+0000 7f55eb7fe640 1 -- 172.21.15.53:0/2936122445 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55ec06b2f0 msgr2=0x7f55ec155580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:38.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:38.763+0000 7f55eb7fe640 1 --2- 172.21.15.53:0/2936122445 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55ec06b2f0 0x7f55ec155580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:38.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:38.763+0000 7f55eb7fe640 1 -- 172.21.15.53:0/2936122445 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f55ec06bc00 msgr2=0x7f55ec154d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:38.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:38.763+0000 7f55eb7fe640 1 --2- 172.21.15.53:0/2936122445 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f55ec06bc00 0x7f55ec154d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:38.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:38.763+0000 7f55eb7fe640 1 -- 172.21.15.53:0/2936122445 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55dc0094d0 con 0x7f55ec0c8d00 2023-06-10T19:01:38.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:38.763+0000 7f55ea7fc640 1 --2- 172.21.15.53:0/2936122445 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f55ec06bc00 0x7f55ec154d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:01:38.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:38.767+0000 7f55eb7fe640 1 --2- 172.21.15.53:0/2936122445 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55ec0c8d00 0x7f55ec1e6750 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f55e400c5a0 tx=0x7f55e400ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:38.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:38.767+0000 7f55d37fe640 1 -- 172.21.15.53:0/2936122445 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e4004440 con 0x7f55ec0c8d00 2023-06-10T19:01:38.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:38.767+0000 7f55d37fe640 1 -- 172.21.15.53:0/2936122445 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55e4003620 con 0x7f55ec0c8d00 2023-06-10T19:01:38.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:38.767+0000 7f55d37fe640 1 -- 172.21.15.53:0/2936122445 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e40039d0 con 0x7f55ec0c8d00 2023-06-10T19:01:38.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:38.767+0000 7f55f14e7640 1 -- 172.21.15.53:0/2936122445 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55ec1e3740 con 0x7f55ec0c8d00 2023-06-10T19:01:38.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:38.767+0000 7f55f14e7640 1 -- 172.21.15.53:0/2936122445 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55ec1e3d00 con 0x7f55ec0c8d00 2023-06-10T19:01:38.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:38.767+0000 7f55f14e7640 1 -- 172.21.15.53:0/2936122445 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55ec06ff60 con 0x7f55ec0c8d00 2023-06-10T19:01:38.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:38.767+0000 7f55d37fe640 1 -- 172.21.15.53:0/2936122445 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f55e4003b30 con 0x7f55ec0c8d00 2023-06-10T19:01:38.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:38.767+0000 7f55d37fe640 1 --2- 172.21.15.53:0/2936122445 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f55d8066280 0x7f55d8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:38.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:38.771+0000 7f55d37fe640 1 -- 172.21.15.53:0/2936122445 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f55e4084400 con 0x7f55ec0c8d00 2023-06-10T19:01:38.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:38.771+0000 7f55eaffd640 1 --2- 172.21.15.53:0/2936122445 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f55d8066280 0x7f55d8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:38.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:38.771+0000 7f55eaffd640 1 --2- 172.21.15.53:0/2936122445 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f55d8066280 0x7f55d8068730 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f55dc0b2000 tx=0x7f55dc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:38.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:38.771+0000 7f55d37fe640 1 -- 172.21.15.53:0/2936122445 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f55e4051800 con 0x7f55ec0c8d00 2023-06-10T19:01:38.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:38.959+0000 7f55f14e7640 1 -- 172.21.15.53:0/2936122445 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f55ec06ff60 con 0x7f55ec0c8d00 2023-06-10T19:01:38.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:38.963+0000 7f55d37fe640 1 -- 172.21.15.53:0/2936122445 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4683 (secure 0 0 0) 0x7f55ec06ff60 con 0x7f55ec0c8d00 2023-06-10T19:01:38.968 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:01:38.968 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":38,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5663,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2600814414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2600814414},{"type":"v1","addr":"172.21.15.117:6835","nonce":2600814414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6136,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1615882017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1615882017},{"type":"v1","addr":"172.21.15.117:6837","nonce":1615882017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6993,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/3732245174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3732245174},{"type":"v1","addr":"172.21.15.53:6833","nonce":3732245174}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:00:20.607950+0000","modified":"2023-06-10T19:00:49.023162+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7266":{"gid":7266,"name":"c","rank":0,"incarnation":37,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.53:6835/2829993338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2829993338},{"type":"v1","addr":"172.21.15.53:6835","nonce":2829993338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-06-10T19:01:38.969 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 38 2023-06-10T19:01:38.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:38.963+0000 7f55f14e7640 1 -- 172.21.15.53:0/2936122445 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f55d8066280 msgr2=0x7f55d8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:38.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:38.963+0000 7f55f14e7640 1 --2- 172.21.15.53:0/2936122445 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f55d8066280 0x7f55d8068730 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f55dc0b2000 tx=0x7f55dc008040 comp rx=0 tx=0).stop 2023-06-10T19:01:38.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:38.963+0000 7f55f14e7640 1 -- 172.21.15.53:0/2936122445 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55ec0c8d00 msgr2=0x7f55ec1e6750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:38.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:38.963+0000 7f55f14e7640 1 --2- 172.21.15.53:0/2936122445 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55ec0c8d00 0x7f55ec1e6750 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f55e400c5a0 tx=0x7f55e400ca60 comp rx=0 tx=0).stop 2023-06-10T19:01:38.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:38.963+0000 7f55f14e7640 1 -- 172.21.15.53:0/2936122445 shutdown_connections 2023-06-10T19:01:38.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:38.963+0000 7f55f14e7640 1 --2- 172.21.15.53:0/2936122445 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f55d8066280 0x7f55d8068730 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:38.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:38.963+0000 7f55f14e7640 1 --2- 172.21.15.53:0/2936122445 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55ec0c8d00 0x7f55ec1e6750 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:38.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:38.963+0000 7f55f14e7640 1 --2- 172.21.15.53:0/2936122445 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f55ec06bc00 0x7f55ec154d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:38.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:38.963+0000 7f55f14e7640 1 --2- 172.21.15.53:0/2936122445 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55ec06b2f0 0x7f55ec155580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:38.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:38.963+0000 7f55f14e7640 1 -- 172.21.15.53:0/2936122445 >> 172.21.15.53:0/2936122445 conn(0x7f55ec06a0d0 msgr2=0x7f55ec0ac0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:38.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:38.963+0000 7f55f14e7640 1 -- 172.21.15.53:0/2936122445 shutdown_connections 2023-06-10T19:01:38.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:38.963+0000 7f55f14e7640 1 -- 172.21.15.53:0/2936122445 wait complete. 2023-06-10T19:01:38.988 DEBUG:tasks.cephfs.filesystem:mapped states ['up:reconnect'] to None 2023-06-10T19:01:39.989 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:01:40.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:40.115+0000 7f4473005640 1 Processor -- start 2023-06-10T19:01:40.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:40.115+0000 7f4473005640 1 -- start start 2023-06-10T19:01:40.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:40.119+0000 7f4473005640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f446c0b3ac0 0x7f446c0b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:40.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:40.119+0000 7f4473005640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f446c0d14c0 0x7f446c15fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:40.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:40.119+0000 7f4473005640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f446c0d0020 con 0x7f446c0cc690 2023-06-10T19:01:40.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:40.119+0000 7f4473005640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f446c0b43d0 con 0x7f446c0d14c0 2023-06-10T19:01:40.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:40.119+0000 7f4473005640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f446c0cef40 con 0x7f446c0b3ac0 2023-06-10T19:01:40.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:40.119+0000 7f446bfff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f446c0cc690 0x7f446c15f370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:48536/0 (socket says 172.21.15.53:48536) 2023-06-10T19:01:40.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:40.119+0000 7f446bfff640 1 -- 172.21.15.53:0/840148197 learned_addr learned my addr 172.21.15.53:0/840148197 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:01:40.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:40.119+0000 7f44715a2640 1 --2- 172.21.15.53:0/840148197 >> v2:172.21.15.53:3300/0 conn(0x7f446c0d14c0 0x7f446c15fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:40.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:40.119+0000 7f446b7fe640 1 -- 172.21.15.53:0/840148197 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1456076074 0 0) 0x7f446c0d0020 con 0x7f446c0cc690 2023-06-10T19:01:40.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:40.119+0000 7f4470da1640 1 --2- 172.21.15.53:0/840148197 >> v2:172.21.15.117:3300/0 conn(0x7f446c0b3ac0 0x7f446c0b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:40.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:40.119+0000 7f446b7fe640 1 -- 172.21.15.53:0/840148197 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4454003530 con 0x7f446c0cc690 2023-06-10T19:01:40.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:40.119+0000 7f44715a2640 1 -- 172.21.15.53:0/840148197 >> v2:172.21.15.117:3300/0 conn(0x7f446c0b3ac0 msgr2=0x7f446c0b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:40.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:40.119+0000 7f44715a2640 1 --2- 172.21.15.53:0/840148197 >> v2:172.21.15.117:3300/0 conn(0x7f446c0b3ac0 0x7f446c0b3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:40.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:40.119+0000 7f44715a2640 1 -- 172.21.15.53:0/840148197 >> v1:172.21.15.53:6789/0 conn(0x7f446c0cc690 legacy=0x7f446c15f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:40.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:40.119+0000 7f44715a2640 1 -- 172.21.15.53:0/840148197 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f446c0cf220 con 0x7f446c0d14c0 2023-06-10T19:01:40.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:40.119+0000 7f44715a2640 1 --2- 172.21.15.53:0/840148197 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f446c0d14c0 0x7f446c15fa80 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f446c0b4ba0 tx=0x7f446401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c68534498c5c655 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:40.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:40.119+0000 7f446b7fe640 1 -- 172.21.15.53:0/840148197 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44640ab600 con 0x7f446c0d14c0 2023-06-10T19:01:40.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:40.119+0000 7f446b7fe640 1 -- 172.21.15.53:0/840148197 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44640a7050 con 0x7f446c0d14c0 2023-06-10T19:01:40.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:40.119+0000 7f446b7fe640 1 -- 172.21.15.53:0/840148197 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44640ab980 con 0x7f446c0d14c0 2023-06-10T19:01:40.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:40.123+0000 7f4473005640 1 -- 172.21.15.53:0/840148197 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f446c0d14c0 msgr2=0x7f446c15fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:40.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:40.123+0000 7f4473005640 1 --2- 172.21.15.53:0/840148197 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f446c0d14c0 0x7f446c15fa80 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f446c0b4ba0 tx=0x7f446401c430 comp rx=0 tx=0).stop 2023-06-10T19:01:40.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:40.123+0000 7f4473005640 1 -- 172.21.15.53:0/840148197 shutdown_connections 2023-06-10T19:01:40.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:40.123+0000 7f4473005640 1 --2- 172.21.15.53:0/840148197 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f446c0d14c0 0x7f446c15fa80 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:40.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:40.123+0000 7f4473005640 1 --2- 172.21.15.53:0/840148197 >> v2:172.21.15.117:3300/0 conn(0x7f446c0b3ac0 0x7f446c0b3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:40.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:40.123+0000 7f4473005640 1 -- 172.21.15.53:0/840148197 >> 172.21.15.53:0/840148197 conn(0x7f446c071790 msgr2=0x7f446c069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:40.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:40.123+0000 7f4473005640 1 -- 172.21.15.53:0/840148197 shutdown_connections 2023-06-10T19:01:40.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:40.123+0000 7f4473005640 1 -- 172.21.15.53:0/840148197 wait complete. 2023-06-10T19:01:40.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:40.123+0000 7f4473005640 1 Processor -- start 2023-06-10T19:01:40.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:40.123+0000 7f4473005640 1 -- start start 2023-06-10T19:01:40.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:40.123+0000 7f4473005640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f446c0b3ac0 0x7f446c1532b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:40.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:40.123+0000 7f4473005640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f446c0cc690 0x7f446c0c9110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:40.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:40.123+0000 7f4473005640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f446c0d14c0 0x7f446c0cb4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:40.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:40.123+0000 7f4473005640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f446c15e160 con 0x7f446c0b3ac0 2023-06-10T19:01:40.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:40.123+0000 7f4473005640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f446c15dba0 con 0x7f446c0d14c0 2023-06-10T19:01:40.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:40.123+0000 7f4473005640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f446c15de80 con 0x7f446c0cc690 2023-06-10T19:01:40.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:40.123+0000 7f4470da1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f446c0b3ac0 0x7f446c1532b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:40.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:40.123+0000 7f4470da1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f446c0b3ac0 0x7f446c1532b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39778/0 (socket says 172.21.15.53:39778) 2023-06-10T19:01:40.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:40.123+0000 7f4470da1640 1 -- 172.21.15.53:0/1137539331 learned_addr learned my addr 172.21.15.53:0/1137539331 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:40.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:40.123+0000 7f446bfff640 1 --2- 172.21.15.53:0/1137539331 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f446c0cc690 0x7f446c0c9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:40.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:40.123+0000 7f44715a2640 1 --2- 172.21.15.53:0/1137539331 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f446c0d14c0 0x7f446c0cb4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:40.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:40.123+0000 7f4470da1640 1 -- 172.21.15.53:0/1137539331 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f446c0cc690 msgr2=0x7f446c0c9110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:40.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:40.123+0000 7f4470da1640 1 --2- 172.21.15.53:0/1137539331 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f446c0cc690 0x7f446c0c9110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:40.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:40.123+0000 7f4470da1640 1 -- 172.21.15.53:0/1137539331 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f446c0d14c0 msgr2=0x7f446c0cb4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:40.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:40.123+0000 7f4470da1640 1 --2- 172.21.15.53:0/1137539331 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f446c0d14c0 0x7f446c0cb4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:40.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:40.123+0000 7f4470da1640 1 -- 172.21.15.53:0/1137539331 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4464009420 con 0x7f446c0b3ac0 2023-06-10T19:01:40.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:40.123+0000 7f4470da1640 1 --2- 172.21.15.53:0/1137539331 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f446c0b3ac0 0x7f446c1532b0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f445c007e40 tx=0x7f445c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:40.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:40.123+0000 7f44697fa640 1 -- 172.21.15.53:0/1137539331 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445c014620 con 0x7f446c0b3ac0 2023-06-10T19:01:40.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:40.123+0000 7f44697fa640 1 -- 172.21.15.53:0/1137539331 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f445c00ee90 con 0x7f446c0b3ac0 2023-06-10T19:01:40.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:40.123+0000 7f4473005640 1 -- 172.21.15.53:0/1137539331 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f446c157130 con 0x7f446c0b3ac0 2023-06-10T19:01:40.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:40.123+0000 7f44697fa640 1 -- 172.21.15.53:0/1137539331 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445c0149c0 con 0x7f446c0b3ac0 2023-06-10T19:01:40.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:40.127+0000 7f4473005640 1 -- 172.21.15.53:0/1137539331 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f446c0c9820 con 0x7f446c0b3ac0 2023-06-10T19:01:40.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:40.127+0000 7f4473005640 1 -- 172.21.15.53:0/1137539331 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f446c04d790 con 0x7f446c0b3ac0 2023-06-10T19:01:40.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:40.127+0000 7f44697fa640 1 -- 172.21.15.53:0/1137539331 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f445c014b20 con 0x7f446c0b3ac0 2023-06-10T19:01:40.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:40.127+0000 7f44697fa640 1 --2- 172.21.15.53:0/1137539331 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4458066280 0x7f4458068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:40.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:40.127+0000 7f44697fa640 1 -- 172.21.15.53:0/1137539331 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6191+0+0 (secure 0 0 0) 0x7f445c0845f0 con 0x7f446c0b3ac0 2023-06-10T19:01:40.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:40.127+0000 7f446bfff640 1 --2- 172.21.15.53:0/1137539331 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4458066280 0x7f4458068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:40.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:40.127+0000 7f446bfff640 1 --2- 172.21.15.53:0/1137539331 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4458066280 0x7f4458068730 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f446c0c8120 tx=0x7f4460007d40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:40.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:40.131+0000 7f44697fa640 1 -- 172.21.15.53:0/1137539331 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f445c051a80 con 0x7f446c0b3ac0 2023-06-10T19:01:40.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:40.319+0000 7f4473005640 1 -- 172.21.15.53:0/1137539331 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f446c0cc240 con 0x7f446c0b3ac0 2023-06-10T19:01:40.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:40.319+0000 7f44697fa640 1 -- 172.21.15.53:0/1137539331 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4681 (secure 0 0 0) 0x7f445c0550a0 con 0x7f446c0b3ac0 2023-06-10T19:01:40.326 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:01:40.326 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":39,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5663,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2600814414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2600814414},{"type":"v1","addr":"172.21.15.117:6835","nonce":2600814414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6136,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1615882017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1615882017},{"type":"v1","addr":"172.21.15.117:6837","nonce":1615882017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6993,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/3732245174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3732245174},{"type":"v1","addr":"172.21.15.53:6833","nonce":3732245174}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:00:20.607950+0000","modified":"2023-06-10T19:01:39.995418+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7266":{"gid":7266,"name":"c","rank":0,"incarnation":37,"state":"up:rejoin","state_seq":16,"addr":"172.21.15.53:6835/2829993338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2829993338},{"type":"v1","addr":"172.21.15.53:6835","nonce":2829993338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-06-10T19:01:40.327 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 39 2023-06-10T19:01:40.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:40.323+0000 7f4473005640 1 -- 172.21.15.53:0/1137539331 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4458066280 msgr2=0x7f4458068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:40.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:40.323+0000 7f4473005640 1 --2- 172.21.15.53:0/1137539331 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4458066280 0x7f4458068730 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f446c0c8120 tx=0x7f4460007d40 comp rx=0 tx=0).stop 2023-06-10T19:01:40.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:40.323+0000 7f4473005640 1 -- 172.21.15.53:0/1137539331 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f446c0b3ac0 msgr2=0x7f446c1532b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:40.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:40.323+0000 7f4473005640 1 --2- 172.21.15.53:0/1137539331 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f446c0b3ac0 0x7f446c1532b0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f445c007e40 tx=0x7f445c00e4b0 comp rx=0 tx=0).stop 2023-06-10T19:01:40.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:40.323+0000 7f4473005640 1 -- 172.21.15.53:0/1137539331 shutdown_connections 2023-06-10T19:01:40.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:40.323+0000 7f4473005640 1 --2- 172.21.15.53:0/1137539331 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4458066280 0x7f4458068730 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:40.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:40.323+0000 7f4473005640 1 --2- 172.21.15.53:0/1137539331 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f446c0d14c0 0x7f446c0cb4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:40.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:40.323+0000 7f4473005640 1 --2- 172.21.15.53:0/1137539331 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f446c0cc690 0x7f446c0c9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:40.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:40.323+0000 7f4473005640 1 --2- 172.21.15.53:0/1137539331 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f446c0b3ac0 0x7f446c1532b0 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:40.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:40.323+0000 7f4473005640 1 -- 172.21.15.53:0/1137539331 >> 172.21.15.53:0/1137539331 conn(0x7f446c071790 msgr2=0x7f446c0b5040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:40.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:40.323+0000 7f4473005640 1 -- 172.21.15.53:0/1137539331 shutdown_connections 2023-06-10T19:01:40.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:40.323+0000 7f4473005640 1 -- 172.21.15.53:0/1137539331 wait complete. 2023-06-10T19:01:40.344 DEBUG:tasks.cephfs.filesystem:mapped states ['up:rejoin'] to None 2023-06-10T19:01:41.345 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:01:41.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.475+0000 7f4ae494e640 1 Processor -- start 2023-06-10T19:01:41.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.475+0000 7f4ae494e640 1 -- start start 2023-06-10T19:01:41.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.475+0000 7f4ae494e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4ae00c9840 0x7f4ae00c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:41.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.475+0000 7f4ae494e640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ae0159b50 con 0x7f4ae006b090 2023-06-10T19:01:41.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.475+0000 7f4ae494e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ae00ca150 con 0x7f4ae0071060 2023-06-10T19:01:41.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.475+0000 7f4ae494e640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ae00702a0 con 0x7f4ae00c9840 2023-06-10T19:01:41.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.475+0000 7f4ade59c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4ae00c9840 0x7f4ae00c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:41.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.475+0000 7f4aded9d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f4ae006b090 0x7f4ae006b510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:57040/0 (socket says 172.21.15.53:57040) 2023-06-10T19:01:41.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.475+0000 7f4aded9d640 1 -- 172.21.15.53:0/3946403245 learned_addr learned my addr 172.21.15.53:0/3946403245 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:01:41.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.475+0000 7f4addd9b640 1 -- 172.21.15.53:0/3946403245 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 767575983 0 0) 0x7f4ae0159b50 con 0x7f4ae006b090 2023-06-10T19:01:41.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.475+0000 7f4addd9b640 1 -- 172.21.15.53:0/3946403245 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4acc003530 con 0x7f4ae006b090 2023-06-10T19:01:41.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.475+0000 7f4ade59c640 1 -- 172.21.15.53:0/3946403245 >> v1:172.21.15.117:6789/0 conn(0x7f4ae0071060 legacy=0x7f4ae00af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:41.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.475+0000 7f4ade59c640 1 -- 172.21.15.53:0/3946403245 >> v1:172.21.15.53:6789/0 conn(0x7f4ae006b090 legacy=0x7f4ae006b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:41.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.475+0000 7f4ade59c640 1 -- 172.21.15.53:0/3946403245 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ae0070580 con 0x7f4ae00c9840 2023-06-10T19:01:41.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.479+0000 7f4ade59c640 1 --2- 172.21.15.53:0/3946403245 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ae00c9840 0x7f4ae00c9c10 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f4ad00097c0 tx=0x7f4ad001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e6a8def71704f3c server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:41.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.479+0000 7f4addd9b640 1 -- 172.21.15.53:0/3946403245 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad00ab610 con 0x7f4ae00c9840 2023-06-10T19:01:41.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.479+0000 7f4addd9b640 1 -- 172.21.15.53:0/3946403245 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ad00ab770 con 0x7f4ae00c9840 2023-06-10T19:01:41.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.479+0000 7f4addd9b640 1 -- 172.21.15.53:0/3946403245 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad00abb00 con 0x7f4ae00c9840 2023-06-10T19:01:41.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.479+0000 7f4ae494e640 1 -- 172.21.15.53:0/3946403245 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ae00c9840 msgr2=0x7f4ae00c9c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:41.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.479+0000 7f4ae494e640 1 --2- 172.21.15.53:0/3946403245 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ae00c9840 0x7f4ae00c9c10 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f4ad00097c0 tx=0x7f4ad001c410 comp rx=0 tx=0).stop 2023-06-10T19:01:41.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.479+0000 7f4ae494e640 1 -- 172.21.15.53:0/3946403245 shutdown_connections 2023-06-10T19:01:41.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.479+0000 7f4ae494e640 1 --2- 172.21.15.53:0/3946403245 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ae00c9840 0x7f4ae00c9c10 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:41.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.479+0000 7f4ae494e640 1 -- 172.21.15.53:0/3946403245 >> 172.21.15.53:0/3946403245 conn(0x7f4ae006a0d0 msgr2=0x7f4ae00ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:41.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.479+0000 7f4ae494e640 1 -- 172.21.15.53:0/3946403245 shutdown_connections 2023-06-10T19:01:41.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.479+0000 7f4ae494e640 1 -- 172.21.15.53:0/3946403245 wait complete. 2023-06-10T19:01:41.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.479+0000 7f4ae494e640 1 Processor -- start 2023-06-10T19:01:41.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.479+0000 7f4ae494e640 1 -- start start 2023-06-10T19:01:41.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.479+0000 7f4ae494e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ae006b090 0x7f4ae0156d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:41.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.479+0000 7f4ae494e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ae0071060 0x7f4ae00aed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:41.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.479+0000 7f4ae494e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ae00c9840 0x7f4ae00af270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:41.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.479+0000 7f4ae494e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae00b0ad0 con 0x7f4ae00c9840 2023-06-10T19:01:41.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.479+0000 7f4ae494e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae00b34b0 con 0x7f4ae006b090 2023-06-10T19:01:41.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.479+0000 7f4ae494e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae00b3790 con 0x7f4ae0071060 2023-06-10T19:01:41.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.479+0000 7f4aded9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ae00c9840 0x7f4ae00af270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:41.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.479+0000 7f4aded9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ae00c9840 0x7f4ae00af270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48416/0 (socket says 172.21.15.53:48416) 2023-06-10T19:01:41.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.479+0000 7f4aded9d640 1 -- 172.21.15.53:0/3778100959 learned_addr learned my addr 172.21.15.53:0/3778100959 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:41.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.479+0000 7f4ade59c640 1 --2- 172.21.15.53:0/3778100959 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ae006b090 0x7f4ae0156d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:41.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.479+0000 7f4ad7fff640 1 --2- 172.21.15.53:0/3778100959 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ae0071060 0x7f4ae00aed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:41.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.479+0000 7f4aded9d640 1 -- 172.21.15.53:0/3778100959 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ae0071060 msgr2=0x7f4ae00aed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:41.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.479+0000 7f4aded9d640 1 --2- 172.21.15.53:0/3778100959 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ae0071060 0x7f4ae00aed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:41.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.479+0000 7f4aded9d640 1 -- 172.21.15.53:0/3778100959 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ae006b090 msgr2=0x7f4ae0156d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:41.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.479+0000 7f4aded9d640 1 --2- 172.21.15.53:0/3778100959 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ae006b090 0x7f4ae0156d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:41.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.479+0000 7f4aded9d640 1 -- 172.21.15.53:0/3778100959 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ad0009420 con 0x7f4ae00c9840 2023-06-10T19:01:41.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.479+0000 7f4ade59c640 1 --2- 172.21.15.53:0/3778100959 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ae006b090 0x7f4ae0156d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:01:41.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.479+0000 7f4ad7fff640 1 --2- 172.21.15.53:0/3778100959 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ae0071060 0x7f4ae00aed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:01:41.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.479+0000 7f4aded9d640 1 --2- 172.21.15.53:0/3778100959 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ae00c9840 0x7f4ae00af270 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f4ad800caa0 tx=0x7f4ad800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:41.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.483+0000 7f4ad6ffd640 1 -- 172.21.15.53:0/3778100959 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad800ac00 con 0x7f4ae00c9840 2023-06-10T19:01:41.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.483+0000 7f4ad6ffd640 1 -- 172.21.15.53:0/3778100959 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ad800ad60 con 0x7f4ae00c9840 2023-06-10T19:01:41.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.483+0000 7f4ae494e640 1 -- 172.21.15.53:0/3778100959 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ae00b0ce0 con 0x7f4ae00c9840 2023-06-10T19:01:41.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.483+0000 7f4ad6ffd640 1 -- 172.21.15.53:0/3778100959 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad8012620 con 0x7f4ae00c9840 2023-06-10T19:01:41.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.483+0000 7f4ae494e640 1 -- 172.21.15.53:0/3778100959 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ae014ef80 con 0x7f4ae00c9840 2023-06-10T19:01:41.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.483+0000 7f4ae494e640 1 -- 172.21.15.53:0/3778100959 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ae00b0f20 con 0x7f4ae00c9840 2023-06-10T19:01:41.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.483+0000 7f4ad6ffd640 1 -- 172.21.15.53:0/3778100959 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4ad8007070 con 0x7f4ae00c9840 2023-06-10T19:01:41.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.483+0000 7f4ad6ffd640 1 --2- 172.21.15.53:0/3778100959 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4ac0066280 0x7f4ac0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:41.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.483+0000 7f4ad6ffd640 1 -- 172.21.15.53:0/3778100959 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6191+0+0 (secure 0 0 0) 0x7f4ad8083f60 con 0x7f4ae00c9840 2023-06-10T19:01:41.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.483+0000 7f4ade59c640 1 --2- 172.21.15.53:0/3778100959 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4ac0066280 0x7f4ac0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:41.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.483+0000 7f4ade59c640 1 --2- 172.21.15.53:0/3778100959 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4ac0066280 0x7f4ac0068730 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f4ad00af000 tx=0x7f4ad00a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:41.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.487+0000 7f4ad6ffd640 1 -- 172.21.15.53:0/3778100959 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4ad8051440 con 0x7f4ae00c9840 2023-06-10T19:01:41.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.679+0000 7f4ae494e640 1 -- 172.21.15.53:0/3778100959 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4ae00b0f20 con 0x7f4ae00c9840 2023-06-10T19:01:41.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.679+0000 7f4ad6ffd640 1 -- 172.21.15.53:0/3778100959 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4681 (secure 0 0 0) 0x7f4ae00b0f20 con 0x7f4ae00c9840 2023-06-10T19:01:41.685 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:01:41.685 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5663,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2600814414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2600814414},{"type":"v1","addr":"172.21.15.117:6835","nonce":2600814414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6136,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1615882017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1615882017},{"type":"v1","addr":"172.21.15.117:6837","nonce":1615882017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6993,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/3732245174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3732245174},{"type":"v1","addr":"172.21.15.53:6833","nonce":3732245174}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:00:20.607950+0000","modified":"2023-06-10T19:01:40.998259+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7266":{"gid":7266,"name":"c","rank":0,"incarnation":37,"state":"up:active","state_seq":17,"addr":"172.21.15.53:6835/2829993338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2829993338},{"type":"v1","addr":"172.21.15.53:6835","nonce":2829993338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-06-10T19:01:41.686 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 40 2023-06-10T19:01:41.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.679+0000 7f4ae494e640 1 -- 172.21.15.53:0/3778100959 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4ac0066280 msgr2=0x7f4ac0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:41.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.679+0000 7f4ae494e640 1 --2- 172.21.15.53:0/3778100959 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4ac0066280 0x7f4ac0068730 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f4ad00af000 tx=0x7f4ad00a7000 comp rx=0 tx=0).stop 2023-06-10T19:01:41.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.679+0000 7f4ae494e640 1 -- 172.21.15.53:0/3778100959 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ae00c9840 msgr2=0x7f4ae00af270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:41.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.679+0000 7f4ae494e640 1 --2- 172.21.15.53:0/3778100959 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ae00c9840 0x7f4ae00af270 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f4ad800caa0 tx=0x7f4ad800cf60 comp rx=0 tx=0).stop 2023-06-10T19:01:41.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.683+0000 7f4ae494e640 1 -- 172.21.15.53:0/3778100959 shutdown_connections 2023-06-10T19:01:41.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.683+0000 7f4ae494e640 1 --2- 172.21.15.53:0/3778100959 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4ac0066280 0x7f4ac0068730 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:41.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.683+0000 7f4ae494e640 1 --2- 172.21.15.53:0/3778100959 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ae00c9840 0x7f4ae00af270 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:41.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.683+0000 7f4ae494e640 1 --2- 172.21.15.53:0/3778100959 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ae0071060 0x7f4ae00aed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:41.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.683+0000 7f4ae494e640 1 --2- 172.21.15.53:0/3778100959 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ae006b090 0x7f4ae0156d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:41.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.683+0000 7f4ae494e640 1 -- 172.21.15.53:0/3778100959 >> 172.21.15.53:0/3778100959 conn(0x7f4ae006a0d0 msgr2=0x7f4ae00ca370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:41.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.683+0000 7f4ae494e640 1 -- 172.21.15.53:0/3778100959 shutdown_connections 2023-06-10T19:01:41.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.683+0000 7f4ae494e640 1 -- 172.21.15.53:0/3778100959 wait complete. 2023-06-10T19:01:41.704 DEBUG:tasks.cephfs.filesystem:mapped states ['up:active'] to up:active 2023-06-10T19:01:41.704 DEBUG:tasks.cephfs.filesystem:reached state 'up:active' in 51.94402289390564s 2023-06-10T19:01:41.705 INFO:tasks.cephfs.test_client_recovery:Reached active... 2023-06-10T19:01:41.705 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-10T19:01:41.832 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.827+0000 7f45293ab640 1 Processor -- start 2023-06-10T19:01:41.832 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.827+0000 7f45293ab640 1 -- start start 2023-06-10T19:01:41.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.827+0000 7f45293ab640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4524071060 0x7f45240af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:41.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.827+0000 7f45293ab640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f45240afc60 0x7f452406b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:41.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.827+0000 7f45293ab640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4524159b50 con 0x7f45240c9840 2023-06-10T19:01:41.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.827+0000 7f45293ab640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45240702a0 con 0x7f45240afc60 2023-06-10T19:01:41.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.827+0000 7f45293ab640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4524070580 con 0x7f4524071060 2023-06-10T19:01:41.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.827+0000 7f4522ffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f45240c9840 0x7f45240c9c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:57048/0 (socket says 172.21.15.53:57048) 2023-06-10T19:01:41.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.827+0000 7f4522ffd640 1 -- 172.21.15.53:0/663360659 learned_addr learned my addr 172.21.15.53:0/663360659 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:01:41.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.827+0000 7f45237fe640 1 --2- 172.21.15.53:0/663360659 >> v2:172.21.15.53:3300/0 conn(0x7f45240afc60 0x7f452406b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:41.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.827+0000 7f45227fc640 1 --2- 172.21.15.53:0/663360659 >> v2:172.21.15.117:3300/0 conn(0x7f4524071060 0x7f45240af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:41.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.827+0000 7f4521ffb640 1 -- 172.21.15.53:0/663360659 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2627390175 0 0) 0x7f4524159b50 con 0x7f45240c9840 2023-06-10T19:01:41.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.827+0000 7f4521ffb640 1 -- 172.21.15.53:0/663360659 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f450c003530 con 0x7f45240c9840 2023-06-10T19:01:41.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.827+0000 7f45237fe640 1 -- 172.21.15.53:0/663360659 >> v2:172.21.15.117:3300/0 conn(0x7f4524071060 msgr2=0x7f45240af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:41.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.827+0000 7f45237fe640 1 --2- 172.21.15.53:0/663360659 >> v2:172.21.15.117:3300/0 conn(0x7f4524071060 0x7f45240af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:41.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.827+0000 7f4521ffb640 1 -- 172.21.15.53:0/663360659 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 512764254 0 0) 0x7f450c003530 con 0x7f45240c9840 2023-06-10T19:01:41.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.827+0000 7f45237fe640 1 -- 172.21.15.53:0/663360659 >> v1:172.21.15.53:6789/0 conn(0x7f45240c9840 legacy=0x7f45240c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:41.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.827+0000 7f45237fe640 1 -- 172.21.15.53:0/663360659 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4524070860 con 0x7f45240afc60 2023-06-10T19:01:41.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.831+0000 7f45237fe640 1 --2- 172.21.15.53:0/663360659 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45240afc60 0x7f452406b090 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f452406e650 tx=0x7f451c01c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eb005245184815d server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:41.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.831+0000 7f4521ffb640 1 -- 172.21.15.53:0/663360659 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4514001680 con 0x7f45240afc60 2023-06-10T19:01:41.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.831+0000 7f4521ffb640 1 -- 172.21.15.53:0/663360659 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f451c0a5660 con 0x7f45240afc60 2023-06-10T19:01:41.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.831+0000 7f4521ffb640 1 -- 172.21.15.53:0/663360659 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451c0a59f0 con 0x7f45240afc60 2023-06-10T19:01:41.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.831+0000 7f45293ab640 1 -- 172.21.15.53:0/663360659 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45240afc60 msgr2=0x7f452406b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:41.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.831+0000 7f45293ab640 1 --2- 172.21.15.53:0/663360659 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45240afc60 0x7f452406b090 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f452406e650 tx=0x7f451c01c800 comp rx=0 tx=0).stop 2023-06-10T19:01:41.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.831+0000 7f45293ab640 1 -- 172.21.15.53:0/663360659 shutdown_connections 2023-06-10T19:01:41.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.831+0000 7f45293ab640 1 --2- 172.21.15.53:0/663360659 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45240afc60 0x7f452406b090 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:41.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.831+0000 7f45293ab640 1 --2- 172.21.15.53:0/663360659 >> v2:172.21.15.117:3300/0 conn(0x7f4524071060 0x7f45240af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:41.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.831+0000 7f45293ab640 1 -- 172.21.15.53:0/663360659 >> 172.21.15.53:0/663360659 conn(0x7f452406a0d0 msgr2=0x7f45240ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:41.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.831+0000 7f45293ab640 1 -- 172.21.15.53:0/663360659 shutdown_connections 2023-06-10T19:01:41.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.831+0000 7f45293ab640 1 -- 172.21.15.53:0/663360659 wait complete. 2023-06-10T19:01:41.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.831+0000 7f45293ab640 1 Processor -- start 2023-06-10T19:01:41.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.831+0000 7f45293ab640 1 -- start start 2023-06-10T19:01:41.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.835+0000 7f45293ab640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4524071060 0x7f45241510f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:41.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.835+0000 7f45293ab640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45240afc60 0x7f45241f8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:41.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.835+0000 7f45293ab640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45240c9840 0x7f45241f3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:41.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.835+0000 7f45293ab640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f452414ea40 con 0x7f45240afc60 2023-06-10T19:01:41.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.835+0000 7f45293ab640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45240c7760 con 0x7f4524071060 2023-06-10T19:01:41.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.835+0000 7f45293ab640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f452414ebd0 con 0x7f45240c9840 2023-06-10T19:01:41.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.835+0000 7f45227fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45240afc60 0x7f45241f8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:41.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.835+0000 7f45227fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45240afc60 0x7f45241f8220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48438/0 (socket says 172.21.15.53:48438) 2023-06-10T19:01:41.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.835+0000 7f45227fc640 1 -- 172.21.15.53:0/4169495494 learned_addr learned my addr 172.21.15.53:0/4169495494 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:41.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.835+0000 7f45237fe640 1 --2- 172.21.15.53:0/4169495494 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45240c9840 0x7f45241f3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:41.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.835+0000 7f4522ffd640 1 --2- 172.21.15.53:0/4169495494 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4524071060 0x7f45241510f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:41.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.835+0000 7f45227fc640 1 -- 172.21.15.53:0/4169495494 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45240c9840 msgr2=0x7f45241f3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:41.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.835+0000 7f45227fc640 1 --2- 172.21.15.53:0/4169495494 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45240c9840 0x7f45241f3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:41.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.835+0000 7f45227fc640 1 -- 172.21.15.53:0/4169495494 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4524071060 msgr2=0x7f45241510f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:41.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.835+0000 7f45227fc640 1 --2- 172.21.15.53:0/4169495494 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4524071060 0x7f45241510f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:41.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.835+0000 7f45227fc640 1 -- 172.21.15.53:0/4169495494 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f451c009a70 con 0x7f45240afc60 2023-06-10T19:01:41.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.835+0000 7f45227fc640 1 --2- 172.21.15.53:0/4169495494 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45240afc60 0x7f45241f8220 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f451800e900 tx=0x7f451800edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:41.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.835+0000 7f450b7fe640 1 -- 172.21.15.53:0/4169495494 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4518009690 con 0x7f45240afc60 2023-06-10T19:01:41.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.835+0000 7f450b7fe640 1 -- 172.21.15.53:0/4169495494 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f451800ca00 con 0x7f45240afc60 2023-06-10T19:01:41.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.835+0000 7f450b7fe640 1 -- 172.21.15.53:0/4169495494 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451800cdb0 con 0x7f45240afc60 2023-06-10T19:01:41.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.835+0000 7f45293ab640 1 -- 172.21.15.53:0/4169495494 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4524155d70 con 0x7f45240afc60 2023-06-10T19:01:41.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.835+0000 7f45293ab640 1 -- 172.21.15.53:0/4169495494 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45241f8760 con 0x7f45240afc60 2023-06-10T19:01:41.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.835+0000 7f45293ab640 1 -- 172.21.15.53:0/4169495494 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f452404d790 con 0x7f45240afc60 2023-06-10T19:01:41.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.835+0000 7f450b7fe640 1 -- 172.21.15.53:0/4169495494 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4518013470 con 0x7f45240afc60 2023-06-10T19:01:41.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.835+0000 7f450b7fe640 1 --2- 172.21.15.53:0/4169495494 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4510066280 0x7f4510068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:41.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.835+0000 7f450b7fe640 1 -- 172.21.15.53:0/4169495494 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6191+0+0 (secure 0 0 0) 0x7f4518083fe0 con 0x7f45240afc60 2023-06-10T19:01:41.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.835+0000 7f4522ffd640 1 --2- 172.21.15.53:0/4169495494 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4510066280 0x7f4510068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:41.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.839+0000 7f4522ffd640 1 --2- 172.21.15.53:0/4169495494 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4510066280 0x7f4510068730 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f4514001b00 tx=0x7f4514009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:41.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:41.839+0000 7f450b7fe640 1 -- 172.21.15.53:0/4169495494 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f45180513d0 con 0x7f45240afc60 2023-06-10T19:01:42.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:42.035+0000 7f45293ab640 1 -- 172.21.15.53:0/4169495494 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f45240cb140 con 0x7f45240afc60 2023-06-10T19:01:42.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:42.035+0000 7f450b7fe640 1 -- 172.21.15.53:0/4169495494 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v40) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4518017070 con 0x7f45240afc60 2023-06-10T19:01:42.040 INFO:teuthology.orchestra.run.smithi053.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-06-10T19:01:42.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:42.035+0000 7f45293ab640 1 -- 172.21.15.53:0/4169495494 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4510066280 msgr2=0x7f4510068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:42.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:42.035+0000 7f45293ab640 1 --2- 172.21.15.53:0/4169495494 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4510066280 0x7f4510068730 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f4514001b00 tx=0x7f4514009040 comp rx=0 tx=0).stop 2023-06-10T19:01:42.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:42.035+0000 7f45293ab640 1 -- 172.21.15.53:0/4169495494 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45240afc60 msgr2=0x7f45241f8220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:42.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:42.035+0000 7f45293ab640 1 --2- 172.21.15.53:0/4169495494 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45240afc60 0x7f45241f8220 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f451800e900 tx=0x7f451800edc0 comp rx=0 tx=0).stop 2023-06-10T19:01:42.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:42.035+0000 7f45293ab640 1 -- 172.21.15.53:0/4169495494 shutdown_connections 2023-06-10T19:01:42.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:42.035+0000 7f45293ab640 1 --2- 172.21.15.53:0/4169495494 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4510066280 0x7f4510068730 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:42.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:42.035+0000 7f45293ab640 1 --2- 172.21.15.53:0/4169495494 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45240c9840 0x7f45241f3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:42.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:42.035+0000 7f45293ab640 1 --2- 172.21.15.53:0/4169495494 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45240afc60 0x7f45241f8220 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:42.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:42.035+0000 7f45293ab640 1 --2- 172.21.15.53:0/4169495494 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4524071060 0x7f45241510f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:42.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:42.035+0000 7f45293ab640 1 -- 172.21.15.53:0/4169495494 >> 172.21.15.53:0/4169495494 conn(0x7f452406a0d0 msgr2=0x7f45240acbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:42.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:42.035+0000 7f45293ab640 1 -- 172.21.15.53:0/4169495494 shutdown_connections 2023-06-10T19:01:42.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:42.035+0000 7f45293ab640 1 -- 172.21.15.53:0/4169495494 wait complete. 2023-06-10T19:01:42.060 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-10T19:01:42.060 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-10T19:01:42.061 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi117.front.sepia.ceph.com 2023-06-10T19:01:42.061 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-06-10T19:01:42.061 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-06-10T19:01:42.061 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-10T19:01:42.062 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-10T19:01:42.062 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-10T19:01:42.062 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-06-10T19:01:42.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:01:42.063 DEBUG:teuthology.orchestra.run.smithi117:> ip addr 2023-06-10T19:01:42.070 INFO:teuthology.orchestra.run.smithi117.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-10T19:01:42.070 INFO:teuthology.orchestra.run.smithi117.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-10T19:01:42.070 INFO:teuthology.orchestra.run.smithi117.stdout: inet 127.0.0.1/8 scope host lo 2023-06-10T19:01:42.070 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:01:42.071 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 ::1/128 scope host 2023-06-10T19:01:42.071 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:01:42.071 INFO:teuthology.orchestra.run.smithi117.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T19:01:42.071 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8a brd ff:ff:ff:ff:ff:ff 2023-06-10T19:01:42.071 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f0 2023-06-10T19:01:42.071 INFO:teuthology.orchestra.run.smithi117.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T19:01:42.071 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8b brd ff:ff:ff:ff:ff:ff 2023-06-10T19:01:42.072 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f1 2023-06-10T19:01:42.072 INFO:teuthology.orchestra.run.smithi117.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T19:01:42.072 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:62 brd ff:ff:ff:ff:ff:ff 2023-06-10T19:01:42.072 INFO:teuthology.orchestra.run.smithi117.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-10T19:01:42.072 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:63 brd ff:ff:ff:ff:ff:ff 2023-06-10T19:01:42.072 INFO:teuthology.orchestra.run.smithi117.stdout: inet 172.21.15.117/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-06-10T19:01:42.072 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft 41947sec preferred_lft 41947sec 2023-06-10T19:01:42.073 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::ec4:7aff:fe8f:4463/64 scope link 2023-06-10T19:01:42.073 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:01:42.073 INFO:teuthology.orchestra.run.smithi117.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-06-10T19:01:42.073 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 02:42:f8:40:b2:dc brd ff:ff:ff:ff:ff:ff 2023-06-10T19:01:42.073 INFO:teuthology.orchestra.run.smithi117.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-06-10T19:01:42.073 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:01:42.073 INFO:teuthology.orchestra.run.smithi117.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-10T19:01:42.074 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-06-10T19:01:42.074 INFO:teuthology.orchestra.run.smithi117.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-06-10T19:01:42.074 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:01:42.074 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-06-10T19:01:42.074 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:01:42.074 INFO:teuthology.orchestra.run.smithi117.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-10T19:01:42.074 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-06-10T19:01:42.075 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-06-10T19:01:42.075 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:01:42.075 INFO:teuthology.orchestra.run.smithi117.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-10T19:01:42.075 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-06-10T19:01:42.075 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-06-10T19:01:42.075 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:01:42.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:01:42.076 DEBUG:teuthology.orchestra.run.smithi117:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-10T19:01:42.124 INFO:teuthology.orchestra.run.smithi117.stdout:1 2023-06-10T19:01:42.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:01:42.126 DEBUG:teuthology.orchestra.run.smithi117:> route 2023-06-10T19:01:42.175 INFO:teuthology.orchestra.run.smithi117.stdout:Kernel IP routing table 2023-06-10T19:01:42.176 INFO:teuthology.orchestra.run.smithi117.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-10T19:01:42.176 INFO:teuthology.orchestra.run.smithi117.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-06-10T19:01:42.176 INFO:teuthology.orchestra.run.smithi117.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-06-10T19:01:42.176 INFO:teuthology.orchestra.run.smithi117.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-06-10T19:01:42.176 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-06-10T19:01:42.176 INFO:teuthology.orchestra.run.smithi117.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-10T19:01:42.177 INFO:teuthology.orchestra.run.smithi117.stdout:ns2.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-10T19:01:42.177 INFO:teuthology.orchestra.run.smithi117.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-10T19:01:42.177 INFO:teuthology.orchestra.run.smithi117.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-10T19:01:42.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:01:42.178 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec bash -c ' 2023-06-10T19:01:42.178 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2023-06-10T19:01:42.178 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-06-10T19:01:42.178 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-06-10T19:01:42.179 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-06-10T19:01:42.179 DEBUG:teuthology.orchestra.run.smithi117:> ') 2023-06-10T19:01:42.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:01:42.251 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list 2023-06-10T19:01:42.297 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-06-10T19:01:42.297 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-06-10T19:01:42.298 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-06-10T19:01:42.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:01:42.298 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link set brx.0 up 2023-06-10T19:01:42.353 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-06-10T19:01:42.353 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-10T19:01:42.354 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-06-10T19:01:42.401 INFO:teuthology.orchestra.run.smithi117.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-06-10T19:01:42.402 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-10T19:01:42.402 DEBUG:teuthology.orchestra.run.smithi117:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-06-10T19:01:42.448 DEBUG:teuthology.orchestra.run.smithi117:> sudo modprobe fuse 2023-06-10T19:01:42.506 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T19:01:42.507 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T19:01:42.560 INFO:teuthology.orchestra.run.smithi117.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T19:01:42.561 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T19:01:42.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:01:42.562 DEBUG:teuthology.orchestra.run.smithi117:> ls /sys/fs/fuse/connections 2023-06-10T19:01:42.608 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-06-10T19:01:42.609 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-06-10T19:01:42.654 DEBUG:teuthology.orchestra.run.smithi117:> sudo modprobe fuse 2023-06-10T19:01:42.669 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T19:01:42.669 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T19:01:42.721 INFO:teuthology.orchestra.run.smithi117.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T19:01:42.722 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T19:01:42.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:01:42.723 DEBUG:teuthology.orchestra.run.smithi117:> ls /sys/fs/fuse/connections 2023-06-10T19:01:42.731 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi117.stderr:2023-06-10T19:01:42.725+0000 7fd8b1641580 -1 init, newargv = 0x5622009d3e00 newargc=15 2023-06-10T19:01:42.731 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi117.stderr:ceph-fuse[44719]: starting ceph client 2023-06-10T19:01:42.737 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi117.stderr:ceph-fuse[44719]: starting fuse 2023-06-10T19:01:43.837 DEBUG:teuthology.orchestra.run.smithi117:> sudo modprobe fuse 2023-06-10T19:01:43.853 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T19:01:43.854 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T19:01:43.908 INFO:teuthology.orchestra.run.smithi117.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T19:01:43.909 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T19:01:43.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:01:43.910 DEBUG:teuthology.orchestra.run.smithi117:> ls /sys/fs/fuse/connections 2023-06-10T19:01:43.957 INFO:teuthology.orchestra.run.smithi117.stdout:45 2023-06-10T19:01:43.957 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-06-10T19:01:43.958 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-06-10T19:01:43.959 DEBUG:teuthology.orchestra.run.smithi117:> import glob 2023-06-10T19:01:43.959 DEBUG:teuthology.orchestra.run.smithi117:> import re 2023-06-10T19:01:43.959 DEBUG:teuthology.orchestra.run.smithi117:> import os 2023-06-10T19:01:43.960 DEBUG:teuthology.orchestra.run.smithi117:> import subprocess 2023-06-10T19:01:43.960 DEBUG:teuthology.orchestra.run.smithi117:> 2023-06-10T19:01:43.960 DEBUG:teuthology.orchestra.run.smithi117:> def _find_admin_socket(client_name): 2023-06-10T19:01:43.961 DEBUG:teuthology.orchestra.run.smithi117:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-06-10T19:01:43.961 DEBUG:teuthology.orchestra.run.smithi117:> files = glob.glob(asok_path) 2023-06-10T19:01:43.961 DEBUG:teuthology.orchestra.run.smithi117:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-06-10T19:01:43.962 DEBUG:teuthology.orchestra.run.smithi117:> 2023-06-10T19:01:43.962 DEBUG:teuthology.orchestra.run.smithi117:> # Given a non-glob path, it better be there 2023-06-10T19:01:43.962 DEBUG:teuthology.orchestra.run.smithi117:> if "*" not in asok_path: 2023-06-10T19:01:43.963 DEBUG:teuthology.orchestra.run.smithi117:> assert(len(files) == 1) 2023-06-10T19:01:43.963 DEBUG:teuthology.orchestra.run.smithi117:> return files[0] 2023-06-10T19:01:43.963 DEBUG:teuthology.orchestra.run.smithi117:> 2023-06-10T19:01:43.964 DEBUG:teuthology.orchestra.run.smithi117:> for f in files: 2023-06-10T19:01:43.965 DEBUG:teuthology.orchestra.run.smithi117:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-06-10T19:01:43.966 DEBUG:teuthology.orchestra.run.smithi117:> if os.path.exists("/proc/{0}".format(pid)): 2023-06-10T19:01:43.967 DEBUG:teuthology.orchestra.run.smithi117:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-06-10T19:01:43.967 DEBUG:teuthology.orchestra.run.smithi117:> contents = proc_f.read() 2023-06-10T19:01:43.967 DEBUG:teuthology.orchestra.run.smithi117:> if mountpoint in contents: 2023-06-10T19:01:43.967 DEBUG:teuthology.orchestra.run.smithi117:> return f 2023-06-10T19:01:43.968 DEBUG:teuthology.orchestra.run.smithi117:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-06-10T19:01:43.968 DEBUG:teuthology.orchestra.run.smithi117:> 2023-06-10T19:01:43.969 DEBUG:teuthology.orchestra.run.smithi117:> print(_find_admin_socket("client.1")) 2023-06-10T19:01:43.969 DEBUG:teuthology.orchestra.run.smithi117:> ' 2023-06-10T19:01:44.077 INFO:teuthology.orchestra.run.smithi117.stdout:/var/run/ceph/ceph-client.1.44719.asok 2023-06-10T19:01:44.260 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.44719.asok 2023-06-10T19:01:44.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:01:44.261 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.44719.asok status 2023-06-10T19:01:44.421 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2023-06-10T19:01:44.421 INFO:teuthology.orchestra.run.smithi117.stdout: "metadata": { 2023-06-10T19:01:44.421 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_sha1": "219d315c3a0b2075e570fb1964be2ad33fe7a9c8", 2023-06-10T19:01:44.422 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_version": "ceph version 18.0.0-4359-g219d315c (219d315c3a0b2075e570fb1964be2ad33fe7a9c8) reef (dev)", 2023-06-10T19:01:44.422 INFO:teuthology.orchestra.run.smithi117.stdout: "entity_id": "1", 2023-06-10T19:01:44.422 INFO:teuthology.orchestra.run.smithi117.stdout: "hostname": "smithi117", 2023-06-10T19:01:44.422 INFO:teuthology.orchestra.run.smithi117.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-06-10T19:01:44.422 INFO:teuthology.orchestra.run.smithi117.stdout: "pid": "44719", 2023-06-10T19:01:44.422 INFO:teuthology.orchestra.run.smithi117.stdout: "root": "/" 2023-06-10T19:01:44.422 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-06-10T19:01:44.422 INFO:teuthology.orchestra.run.smithi117.stdout: "dentry_count": 0, 2023-06-10T19:01:44.423 INFO:teuthology.orchestra.run.smithi117.stdout: "dentry_pinned_count": 0, 2023-06-10T19:01:44.423 INFO:teuthology.orchestra.run.smithi117.stdout: "id": 5999, 2023-06-10T19:01:44.423 INFO:teuthology.orchestra.run.smithi117.stdout: "inst": { 2023-06-10T19:01:44.423 INFO:teuthology.orchestra.run.smithi117.stdout: "name": { 2023-06-10T19:01:44.423 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "client", 2023-06-10T19:01:44.423 INFO:teuthology.orchestra.run.smithi117.stdout: "num": 5999 2023-06-10T19:01:44.423 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-06-10T19:01:44.423 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": { 2023-06-10T19:01:44.424 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "v1", 2023-06-10T19:01:44.424 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": "192.168.0.1:0", 2023-06-10T19:01:44.424 INFO:teuthology.orchestra.run.smithi117.stdout: "nonce": 2653758239 2023-06-10T19:01:44.424 INFO:teuthology.orchestra.run.smithi117.stdout: } 2023-06-10T19:01:44.424 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-06-10T19:01:44.424 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": { 2023-06-10T19:01:44.424 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "v1", 2023-06-10T19:01:44.425 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": "192.168.0.1:0", 2023-06-10T19:01:44.425 INFO:teuthology.orchestra.run.smithi117.stdout: "nonce": 2653758239 2023-06-10T19:01:44.425 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-06-10T19:01:44.425 INFO:teuthology.orchestra.run.smithi117.stdout: "inst_str": "client.5999 192.168.0.1:0/2653758239", 2023-06-10T19:01:44.425 INFO:teuthology.orchestra.run.smithi117.stdout: "addr_str": "192.168.0.1:0/2653758239", 2023-06-10T19:01:44.425 INFO:teuthology.orchestra.run.smithi117.stdout: "inode_count": 1, 2023-06-10T19:01:44.425 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_epoch": 40, 2023-06-10T19:01:44.425 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_epoch": 82, 2023-06-10T19:01:44.426 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_epoch_barrier": 0, 2023-06-10T19:01:44.426 INFO:teuthology.orchestra.run.smithi117.stdout: "blocklisted": false, 2023-06-10T19:01:44.426 INFO:teuthology.orchestra.run.smithi117.stdout: "fs_name": "cephfs" 2023-06-10T19:01:44.426 INFO:teuthology.orchestra.run.smithi117.stdout:} 2023-06-10T19:01:44.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:01:44.436 DEBUG:teuthology.orchestra.run.smithi117:> stat --file-system '--printf=%T 2023-06-10T19:01:44.436 DEBUG:teuthology.orchestra.run.smithi117:> ' -- /home/ubuntu/cephtest/mnt.1 2023-06-10T19:01:44.443 INFO:teuthology.orchestra.run.smithi117.stdout:fuseblk 2023-06-10T19:01:44.443 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-06-10T19:01:44.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:01:44.444 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-06-10T19:01:44.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:01:44.495 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest/mnt.1 && exec ls subdir/childfile) 2023-06-10T19:01:44.548 INFO:teuthology.orchestra.run.smithi117.stdout:subdir/childfile 2023-06-10T19:01:44.549 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-06-10T19:01:44.550 DEBUG:teuthology.orchestra.run.smithi053:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-06-10T19:01:44.613 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-06-10T19:01:44.658 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-06-10T19:01:44.659 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T19:01:44.659 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:01:44.665 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16345192k,nr_inodes=4086298,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276544k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=407 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276540k,nr_inodes=819135,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276544k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-06-10T19:01:44.665 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi053.front.sepia.ceph.com 2023-06-10T19:01:44.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:01:44.666 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-06-10T19:01:44.712 INFO:teuthology.orchestra.run.smithi053.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-06-10T19:01:44.713 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-10T19:01:44.714 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T19:01:44.715 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:01:44.722 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:01:44.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:44.879+0000 7efe1bf51640 1 Processor -- start 2023-06-10T19:01:44.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:44.879+0000 7efe1bf51640 1 -- start start 2023-06-10T19:01:44.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:44.883+0000 7efe1bf51640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7efe1415cdb0 0x7efe140b30e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:44.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:44.883+0000 7efe1bf51640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7efe14071060 0x7efe140b3620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:44.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:44.883+0000 7efe1bf51640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe140c9840 0x7efe140c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:44.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:44.883+0000 7efe1bf51640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe140ca1c0 con 0x7efe1415cdb0 2023-06-10T19:01:44.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:44.883+0000 7efe1bf51640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe1406c620 con 0x7efe14071060 2023-06-10T19:01:44.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:44.883+0000 7efe1bf51640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe140702a0 con 0x7efe140c9840 2023-06-10T19:01:44.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:44.883+0000 7efe19ced640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7efe1415cdb0 0x7efe140b30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:44.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:44.883+0000 7efe19ced640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7efe1415cdb0 0x7efe140b30e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48444/0 (socket says 172.21.15.53:48444) 2023-06-10T19:01:44.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:44.883+0000 7efe19ced640 1 -- 172.21.15.53:0/1428120136 learned_addr learned my addr 172.21.15.53:0/1428120136 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:44.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:44.883+0000 7efe1a4ee640 1 --2- 172.21.15.53:0/1428120136 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe140c9840 0x7efe140c9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:44.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:44.883+0000 7efe19ced640 1 -- 172.21.15.53:0/1428120136 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe140c9840 msgr2=0x7efe140c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:44.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:44.883+0000 7efe19ced640 1 --2- 172.21.15.53:0/1428120136 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe140c9840 0x7efe140c9c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:44.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:44.883+0000 7efe19ced640 1 -- 172.21.15.53:0/1428120136 >> v2:172.21.15.117:3300/0 conn(0x7efe14071060 msgr2=0x7efe140b3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:44.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:44.883+0000 7efe194ec640 1 --2- 172.21.15.53:0/1428120136 >> v2:172.21.15.117:3300/0 conn(0x7efe14071060 0x7efe140b3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:44.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:44.883+0000 7efe19ced640 1 --2- 172.21.15.53:0/1428120136 >> v2:172.21.15.117:3300/0 conn(0x7efe14071060 0x7efe140b3620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:44.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:44.883+0000 7efe19ced640 1 -- 172.21.15.53:0/1428120136 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe14070580 con 0x7efe1415cdb0 2023-06-10T19:01:44.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:44.883+0000 7efe194ec640 1 --2- 172.21.15.53:0/1428120136 >> v2:172.21.15.117:3300/0 conn(0x7efe14071060 0x7efe140b3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:01:44.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:44.883+0000 7efe19ced640 1 --2- 172.21.15.53:0/1428120136 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe1415cdb0 0x7efe140b30e0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7efe1406ea70 tx=0x7efe1001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b4a891787b40b88 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:44.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:44.883+0000 7efe18ceb640 1 -- 172.21.15.53:0/1428120136 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe100aa5f0 con 0x7efe1415cdb0 2023-06-10T19:01:44.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:44.883+0000 7efe18ceb640 1 -- 172.21.15.53:0/1428120136 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe100aa750 con 0x7efe1415cdb0 2023-06-10T19:01:44.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:44.883+0000 7efe18ceb640 1 -- 172.21.15.53:0/1428120136 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe100aaae0 con 0x7efe1415cdb0 2023-06-10T19:01:44.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:44.887+0000 7efe1bf51640 1 -- 172.21.15.53:0/1428120136 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe1415cdb0 msgr2=0x7efe140b30e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:44.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:44.887+0000 7efe1bf51640 1 --2- 172.21.15.53:0/1428120136 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe1415cdb0 0x7efe140b30e0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7efe1406ea70 tx=0x7efe1001c4d0 comp rx=0 tx=0).stop 2023-06-10T19:01:44.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:44.887+0000 7efe1bf51640 1 -- 172.21.15.53:0/1428120136 shutdown_connections 2023-06-10T19:01:44.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:44.887+0000 7efe1bf51640 1 --2- 172.21.15.53:0/1428120136 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe140c9840 0x7efe140c9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:44.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:44.887+0000 7efe1bf51640 1 --2- 172.21.15.53:0/1428120136 >> v2:172.21.15.117:3300/0 conn(0x7efe14071060 0x7efe140b3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:44.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:44.887+0000 7efe1bf51640 1 --2- 172.21.15.53:0/1428120136 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe1415cdb0 0x7efe140b30e0 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:44.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:44.887+0000 7efe1bf51640 1 -- 172.21.15.53:0/1428120136 >> 172.21.15.53:0/1428120136 conn(0x7efe1406a0d0 msgr2=0x7efe140ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:44.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:44.887+0000 7efe1bf51640 1 -- 172.21.15.53:0/1428120136 shutdown_connections 2023-06-10T19:01:44.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:44.887+0000 7efe1bf51640 1 -- 172.21.15.53:0/1428120136 wait complete. 2023-06-10T19:01:44.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:44.887+0000 7efe1bf51640 1 Processor -- start 2023-06-10T19:01:44.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:44.887+0000 7efe1bf51640 1 -- start start 2023-06-10T19:01:44.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:44.887+0000 7efe1bf51640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe14071060 0x7efe1414e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:44.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:44.887+0000 7efe1bf51640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe140c9840 0x7efe14151140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:44.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:44.887+0000 7efe1bf51640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe1415cdb0 0x7efe1414a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:44.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:44.887+0000 7efe1bf51640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe14150a10 con 0x7efe1415cdb0 2023-06-10T19:01:44.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:44.887+0000 7efe1bf51640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe14150cb0 con 0x7efe14071060 2023-06-10T19:01:44.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:44.887+0000 7efe1bf51640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe140c3650 con 0x7efe140c9840 2023-06-10T19:01:44.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:44.887+0000 7efe1a4ee640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe1415cdb0 0x7efe1414a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:44.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:44.887+0000 7efe1a4ee640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe1415cdb0 0x7efe1414a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48454/0 (socket says 172.21.15.53:48454) 2023-06-10T19:01:44.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:44.887+0000 7efe1a4ee640 1 -- 172.21.15.53:0/346635739 learned_addr learned my addr 172.21.15.53:0/346635739 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:44.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:44.887+0000 7efe19ced640 1 --2- 172.21.15.53:0/346635739 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe14071060 0x7efe1414e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:44.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:44.887+0000 7efe194ec640 1 --2- 172.21.15.53:0/346635739 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe140c9840 0x7efe14151140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:44.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:44.887+0000 7efe1a4ee640 1 -- 172.21.15.53:0/346635739 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe140c9840 msgr2=0x7efe14151140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:44.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:44.887+0000 7efe1a4ee640 1 --2- 172.21.15.53:0/346635739 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe140c9840 0x7efe14151140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:44.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:44.887+0000 7efe1a4ee640 1 -- 172.21.15.53:0/346635739 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe14071060 msgr2=0x7efe1414e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:44.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:44.887+0000 7efe1a4ee640 1 --2- 172.21.15.53:0/346635739 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe14071060 0x7efe1414e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:44.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:44.887+0000 7efe1a4ee640 1 -- 172.21.15.53:0/346635739 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe100094d0 con 0x7efe1415cdb0 2023-06-10T19:01:44.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:44.887+0000 7efe1a4ee640 1 --2- 172.21.15.53:0/346635739 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe1415cdb0 0x7efe1414a850 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7efe0c00cd70 tx=0x7efe0c00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:44.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:44.891+0000 7efe0a7fc640 1 -- 172.21.15.53:0/346635739 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe0c003ba0 con 0x7efe1415cdb0 2023-06-10T19:01:44.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:44.891+0000 7efe0a7fc640 1 -- 172.21.15.53:0/346635739 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe0c003d00 con 0x7efe1415cdb0 2023-06-10T19:01:44.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:44.891+0000 7efe1bf51640 1 -- 172.21.15.53:0/346635739 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe140c3930 con 0x7efe1415cdb0 2023-06-10T19:01:44.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:44.891+0000 7efe0a7fc640 1 -- 172.21.15.53:0/346635739 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe0c004240 con 0x7efe1415cdb0 2023-06-10T19:01:44.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:44.891+0000 7efe1bf51640 1 -- 172.21.15.53:0/346635739 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe140c3ef0 con 0x7efe1415cdb0 2023-06-10T19:01:44.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:44.891+0000 7efe1bf51640 1 -- 172.21.15.53:0/346635739 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe140c4110 con 0x7efe1415cdb0 2023-06-10T19:01:44.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:44.891+0000 7efe0a7fc640 1 -- 172.21.15.53:0/346635739 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7efe0c0043a0 con 0x7efe1415cdb0 2023-06-10T19:01:44.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:44.891+0000 7efe0a7fc640 1 --2- 172.21.15.53:0/346635739 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efdf8066280 0x7efdf8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:44.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:44.891+0000 7efe0a7fc640 1 -- 172.21.15.53:0/346635739 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6191+0+0 (secure 0 0 0) 0x7efe0c012070 con 0x7efe1415cdb0 2023-06-10T19:01:44.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:44.891+0000 7efe19ced640 1 --2- 172.21.15.53:0/346635739 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efdf8066280 0x7efdf8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:44.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:44.891+0000 7efe19ced640 1 --2- 172.21.15.53:0/346635739 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efdf8066280 0x7efdf8068730 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7efe100ae000 tx=0x7efe100a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:44.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:44.895+0000 7efe0a7fc640 1 -- 172.21.15.53:0/346635739 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7efe0c051c20 con 0x7efe1415cdb0 2023-06-10T19:01:45.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.055+0000 7efe1bf51640 1 -- 172.21.15.53:0/346635739 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efe1404d790 con 0x7efe1415cdb0 2023-06-10T19:01:45.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.055+0000 7efe0a7fc640 1 -- 172.21.15.53:0/346635739 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+18529 (secure 0 0 0) 0x7efe0c055240 con 0x7efe1415cdb0 2023-06-10T19:01:45.064 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:01:45.064 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":82,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:01:38.982908+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-06-10T19:00:19.188303+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-06-10T19:00:19.583756+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.0.1:0/716140912":"2023-06-10T20:01:38.016422+0000","172.21.15.53:6835/882186121":"2023-06-11T19:00:42.868037+0000","172.21.15.53:6834/882186121":"2023-06-11T19:00:42.868037+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:01:45.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.059+0000 7efe1bf51640 1 -- 172.21.15.53:0/346635739 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efdf8066280 msgr2=0x7efdf8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:45.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.059+0000 7efe1bf51640 1 --2- 172.21.15.53:0/346635739 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efdf8066280 0x7efdf8068730 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7efe100ae000 tx=0x7efe100a7000 comp rx=0 tx=0).stop 2023-06-10T19:01:45.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.059+0000 7efe1bf51640 1 -- 172.21.15.53:0/346635739 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe1415cdb0 msgr2=0x7efe1414a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:45.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.059+0000 7efe1bf51640 1 --2- 172.21.15.53:0/346635739 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe1415cdb0 0x7efe1414a850 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7efe0c00cd70 tx=0x7efe0c00a660 comp rx=0 tx=0).stop 2023-06-10T19:01:45.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.059+0000 7efe1bf51640 1 -- 172.21.15.53:0/346635739 shutdown_connections 2023-06-10T19:01:45.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.059+0000 7efe1bf51640 1 --2- 172.21.15.53:0/346635739 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efdf8066280 0x7efdf8068730 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:45.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.059+0000 7efe1bf51640 1 --2- 172.21.15.53:0/346635739 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe1415cdb0 0x7efe1414a850 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:45.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.059+0000 7efe1bf51640 1 --2- 172.21.15.53:0/346635739 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe140c9840 0x7efe14151140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:45.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.059+0000 7efe1bf51640 1 --2- 172.21.15.53:0/346635739 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe14071060 0x7efe1414e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:45.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.059+0000 7efe1bf51640 1 -- 172.21.15.53:0/346635739 >> 172.21.15.53:0/346635739 conn(0x7efe1406a0d0 msgr2=0x7efe140b0ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:45.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.059+0000 7efe1bf51640 1 -- 172.21.15.53:0/346635739 shutdown_connections 2023-06-10T19:01:45.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.059+0000 7efe1bf51640 1 -- 172.21.15.53:0/346635739 wait complete. 2023-06-10T19:01:45.082 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-10T18:52:33.633114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-10T18:52:39.171487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-10T19:00:19.188303+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2023-06-10T19:00:19.583756+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-10T19:01:45.083 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-10T19:01:45.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.203+0000 7ff4e40e5640 1 Processor -- start 2023-06-10T19:01:45.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.203+0000 7ff4e40e5640 1 -- start start 2023-06-10T19:01:45.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.203+0000 7ff4e40e5640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff4dc0cf340 0x7ff4dc15d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:45.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.203+0000 7ff4e40e5640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4dc15a060 con 0x7ff4dc153c20 2023-06-10T19:01:45.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.203+0000 7ff4e40e5640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4dc159a70 con 0x7ff4dc15d060 2023-06-10T19:01:45.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.203+0000 7ff4e40e5640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4dc153ff0 con 0x7ff4dc0cf340 2023-06-10T19:01:45.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.203+0000 7ff4e1e81640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ff4dc153c20 0x7ff4dc15a4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:57058/0 (socket says 172.21.15.53:57058) 2023-06-10T19:01:45.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.203+0000 7ff4e1e81640 1 -- 172.21.15.53:0/4224218062 learned_addr learned my addr 172.21.15.53:0/4224218062 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:01:45.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.203+0000 7ff4e2682640 1 --2- 172.21.15.53:0/4224218062 >> v2:172.21.15.117:3300/0 conn(0x7ff4dc0cf340 0x7ff4dc15d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:45.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.203+0000 7ff4e0e7f640 1 -- 172.21.15.53:0/4224218062 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3053746565 0 0) 0x7ff4dc15a060 con 0x7ff4dc153c20 2023-06-10T19:01:45.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.203+0000 7ff4e0e7f640 1 -- 172.21.15.53:0/4224218062 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4c8003530 con 0x7ff4dc153c20 2023-06-10T19:01:45.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.203+0000 7ff4e0e7f640 1 -- 172.21.15.53:0/4224218062 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 92927406 0 0) 0x7ff4c8003530 con 0x7ff4dc153c20 2023-06-10T19:01:45.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.203+0000 7ff4e0e7f640 1 -- 172.21.15.53:0/4224218062 >> v2:172.21.15.117:3300/0 conn(0x7ff4dc0cf340 msgr2=0x7ff4dc15d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:45.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.203+0000 7ff4e0e7f640 1 --2- 172.21.15.53:0/4224218062 >> v2:172.21.15.117:3300/0 conn(0x7ff4dc0cf340 0x7ff4dc15d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:45.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.203+0000 7ff4e0e7f640 1 -- 172.21.15.53:0/4224218062 >> v1:172.21.15.117:6789/0 conn(0x7ff4dc15d060 legacy=0x7ff4dc0cec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:45.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.203+0000 7ff4e0e7f640 1 -- 172.21.15.53:0/4224218062 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4dc15db20 con 0x7ff4dc153c20 2023-06-10T19:01:45.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.203+0000 7ff4e0e7f640 1 -- 172.21.15.53:0/4224218062 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7ff4d8001680 con 0x7ff4dc153c20 2023-06-10T19:01:45.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.203+0000 7ff4e0e7f640 1 -- 172.21.15.53:0/4224218062 >> v1:172.21.15.53:6789/0 conn(0x7ff4dc153c20 legacy=0x7ff4dc15a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:45.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.203+0000 7ff4e0e7f640 1 --2- 172.21.15.53:0/4224218062 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4c8003980 0x7ff4c8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:45.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.203+0000 7ff4e0e7f640 1 --2- 172.21.15.53:0/4224218062 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4c80047d0 0x7ff4c8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:45.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.203+0000 7ff4e0e7f640 1 --2- 172.21.15.53:0/4224218062 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4c8005180 0x7ff4c800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:45.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.203+0000 7ff4e0e7f640 1 -- 172.21.15.53:0/4224218062 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4dc153ff0 con 0x7ff4c80047d0 2023-06-10T19:01:45.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.203+0000 7ff4e0e7f640 1 -- 172.21.15.53:0/4224218062 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c800c000 con 0x7ff4c8005180 2023-06-10T19:01:45.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.203+0000 7ff4e0e7f640 1 -- 172.21.15.53:0/4224218062 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c800c1c0 con 0x7ff4c8003980 2023-06-10T19:01:45.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.203+0000 7ff4e1680640 1 --2- 172.21.15.53:0/4224218062 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4c80047d0 0x7ff4c8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:45.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.203+0000 7ff4e1e81640 1 --2- 172.21.15.53:0/4224218062 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4c8003980 0x7ff4c8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:45.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.203+0000 7ff4e2682640 1 --2- 172.21.15.53:0/4224218062 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4c8005180 0x7ff4c800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:45.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.203+0000 7ff4e1680640 1 -- 172.21.15.53:0/4224218062 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4c8003980 msgr2=0x7ff4c8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:45.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.203+0000 7ff4e1680640 1 --2- 172.21.15.53:0/4224218062 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4c8003980 0x7ff4c8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:45.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.203+0000 7ff4e1680640 1 -- 172.21.15.53:0/4224218062 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4c8005180 msgr2=0x7ff4c800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:45.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.203+0000 7ff4e1680640 1 --2- 172.21.15.53:0/4224218062 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4c8005180 0x7ff4c800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:45.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.203+0000 7ff4e2682640 1 -- 172.21.15.53:0/4224218062 reap_dead start 2023-06-10T19:01:45.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.203+0000 7ff4e1680640 1 -- 172.21.15.53:0/4224218062 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4c8003530 con 0x7ff4c80047d0 2023-06-10T19:01:45.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.207+0000 7ff4e1680640 1 --2- 172.21.15.53:0/4224218062 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4c80047d0 0x7ff4c8004c40 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc001780 tx=0x7ff4cc01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c001c4f0684d12d0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:45.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.207+0000 7ff4e0e7f640 1 -- 172.21.15.53:0/4224218062 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4cc0052d0 con 0x7ff4c80047d0 2023-06-10T19:01:45.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.207+0000 7ff4e0e7f640 1 -- 172.21.15.53:0/4224218062 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4cc0a7050 con 0x7ff4c80047d0 2023-06-10T19:01:45.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.207+0000 7ff4e0e7f640 1 -- 172.21.15.53:0/4224218062 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4cc003600 con 0x7ff4c80047d0 2023-06-10T19:01:45.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.207+0000 7ff4e40e5640 1 -- 172.21.15.53:0/4224218062 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4c80047d0 msgr2=0x7ff4c8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:45.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.207+0000 7ff4e40e5640 1 --2- 172.21.15.53:0/4224218062 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4c80047d0 0x7ff4c8004c40 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc001780 tx=0x7ff4cc01c3e0 comp rx=0 tx=0).stop 2023-06-10T19:01:45.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.207+0000 7ff4e40e5640 1 -- 172.21.15.53:0/4224218062 shutdown_connections 2023-06-10T19:01:45.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.207+0000 7ff4e40e5640 1 --2- 172.21.15.53:0/4224218062 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4c80047d0 0x7ff4c8004c40 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:45.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.207+0000 7ff4e40e5640 1 -- 172.21.15.53:0/4224218062 >> 172.21.15.53:0/4224218062 conn(0x7ff4dc06d1e0 msgr2=0x7ff4dc06d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:45.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.207+0000 7ff4e40e5640 1 -- 172.21.15.53:0/4224218062 shutdown_connections 2023-06-10T19:01:45.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.207+0000 7ff4e40e5640 1 -- 172.21.15.53:0/4224218062 wait complete. 2023-06-10T19:01:45.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.207+0000 7ff4e40e5640 1 Processor -- start 2023-06-10T19:01:45.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.207+0000 7ff4e40e5640 1 -- start start 2023-06-10T19:01:45.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.211+0000 7ff4e40e5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4c80047d0 0x7ff4dc1f0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:45.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.211+0000 7ff4e40e5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4dc1523a0 0x7ff4dc0c4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:45.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.211+0000 7ff4e40e5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4dc0c4850 0x7ff4dc1516c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:45.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.211+0000 7ff4e40e5640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4dc1f0d50 con 0x7ff4dc1523a0 2023-06-10T19:01:45.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.211+0000 7ff4e40e5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4dc153030 con 0x7ff4c80047d0 2023-06-10T19:01:45.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.211+0000 7ff4e40e5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4dc150bb0 con 0x7ff4dc0c4850 2023-06-10T19:01:45.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.211+0000 7ff4e1680640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4dc1523a0 0x7ff4dc0c4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:45.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.211+0000 7ff4e1680640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4dc1523a0 0x7ff4dc0c4310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48466/0 (socket says 172.21.15.53:48466) 2023-06-10T19:01:45.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.211+0000 7ff4e1680640 1 -- 172.21.15.53:0/1275716020 learned_addr learned my addr 172.21.15.53:0/1275716020 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:45.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.211+0000 7ff4e2682640 1 --2- 172.21.15.53:0/1275716020 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4dc0c4850 0x7ff4dc1516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:45.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.211+0000 7ff4e1e81640 1 --2- 172.21.15.53:0/1275716020 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4c80047d0 0x7ff4dc1f0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:45.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.211+0000 7ff4e1680640 1 -- 172.21.15.53:0/1275716020 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4dc0c4850 msgr2=0x7ff4dc1516c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:45.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.211+0000 7ff4e1680640 1 --2- 172.21.15.53:0/1275716020 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4dc0c4850 0x7ff4dc1516c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:45.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.211+0000 7ff4e1680640 1 -- 172.21.15.53:0/1275716020 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4c80047d0 msgr2=0x7ff4dc1f0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:45.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.211+0000 7ff4e1680640 1 --2- 172.21.15.53:0/1275716020 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4c80047d0 0x7ff4dc1f0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:45.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.211+0000 7ff4e1680640 1 -- 172.21.15.53:0/1275716020 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4dc1513c0 con 0x7ff4dc1523a0 2023-06-10T19:01:45.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.211+0000 7ff4e1e81640 1 --2- 172.21.15.53:0/1275716020 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4c80047d0 0x7ff4dc1f0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:01:45.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.211+0000 7ff4e1680640 1 --2- 172.21.15.53:0/1275716020 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4dc1523a0 0x7ff4dc0c4310 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc01c210 tx=0x7ff4c8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:45.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.211+0000 7ff4d27fc640 1 -- 172.21.15.53:0/1275716020 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4cc003e40 con 0x7ff4dc1523a0 2023-06-10T19:01:45.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.211+0000 7ff4d27fc640 1 -- 172.21.15.53:0/1275716020 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4cc007030 con 0x7ff4dc1523a0 2023-06-10T19:01:45.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.211+0000 7ff4e40e5640 1 -- 172.21.15.53:0/1275716020 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4dc0c6340 con 0x7ff4dc1523a0 2023-06-10T19:01:45.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.211+0000 7ff4d27fc640 1 -- 172.21.15.53:0/1275716020 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4cc0073e0 con 0x7ff4dc1523a0 2023-06-10T19:01:45.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.211+0000 7ff4e40e5640 1 -- 172.21.15.53:0/1275716020 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4dc150d70 con 0x7ff4dc1523a0 2023-06-10T19:01:45.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.211+0000 7ff4e40e5640 1 -- 172.21.15.53:0/1275716020 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4dc0b1a40 con 0x7ff4dc1523a0 2023-06-10T19:01:45.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.211+0000 7ff4d27fc640 1 -- 172.21.15.53:0/1275716020 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff4cc007540 con 0x7ff4dc1523a0 2023-06-10T19:01:45.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.211+0000 7ff4d27fc640 1 --2- 172.21.15.53:0/1275716020 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff4c0066280 0x7ff4c0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:45.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.211+0000 7ff4d27fc640 1 -- 172.21.15.53:0/1275716020 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6191+0+0 (secure 0 0 0) 0x7ff4cc11e260 con 0x7ff4dc1523a0 2023-06-10T19:01:45.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.211+0000 7ff4e1e81640 1 --2- 172.21.15.53:0/1275716020 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff4c0066280 0x7ff4c0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:45.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.215+0000 7ff4e1e81640 1 --2- 172.21.15.53:0/1275716020 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff4c0066280 0x7ff4c0068730 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7ff4d8000c10 tx=0x7ff4d8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:45.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.215+0000 7ff4d27fc640 1 -- 172.21.15.53:0/1275716020 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff4cc0eb660 con 0x7ff4dc1523a0 2023-06-10T19:01:45.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.371+0000 7ff4e40e5640 1 -- 172.21.15.53:0/1275716020 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff4dc04dfe0 con 0x7ff4dc1523a0 2023-06-10T19:01:45.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.371+0000 7ff4d27fc640 1 -- 172.21.15.53:0/1275716020 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff4cc0eec80 con 0x7ff4dc1523a0 2023-06-10T19:01:45.377 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-06-10T19:01:45.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.375+0000 7ff4e40e5640 1 -- 172.21.15.53:0/1275716020 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff4c0066280 msgr2=0x7ff4c0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:45.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.375+0000 7ff4e40e5640 1 --2- 172.21.15.53:0/1275716020 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff4c0066280 0x7ff4c0068730 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7ff4d8000c10 tx=0x7ff4d8009040 comp rx=0 tx=0).stop 2023-06-10T19:01:45.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.375+0000 7ff4e40e5640 1 -- 172.21.15.53:0/1275716020 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4dc1523a0 msgr2=0x7ff4dc0c4310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:45.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.375+0000 7ff4e40e5640 1 --2- 172.21.15.53:0/1275716020 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4dc1523a0 0x7ff4dc0c4310 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc01c210 tx=0x7ff4c8005800 comp rx=0 tx=0).stop 2023-06-10T19:01:45.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.375+0000 7ff4e40e5640 1 -- 172.21.15.53:0/1275716020 shutdown_connections 2023-06-10T19:01:45.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.375+0000 7ff4e40e5640 1 --2- 172.21.15.53:0/1275716020 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff4c0066280 0x7ff4c0068730 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:45.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.375+0000 7ff4e40e5640 1 --2- 172.21.15.53:0/1275716020 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4dc0c4850 0x7ff4dc1516c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:45.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.375+0000 7ff4e40e5640 1 --2- 172.21.15.53:0/1275716020 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4dc1523a0 0x7ff4dc0c4310 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:45.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.375+0000 7ff4e40e5640 1 --2- 172.21.15.53:0/1275716020 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4c80047d0 0x7ff4dc1f0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:45.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.375+0000 7ff4e40e5640 1 -- 172.21.15.53:0/1275716020 >> 172.21.15.53:0/1275716020 conn(0x7ff4dc06d1e0 msgr2=0x7ff4dc158740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:45.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.375+0000 7ff4e40e5640 1 -- 172.21.15.53:0/1275716020 shutdown_connections 2023-06-10T19:01:45.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.375+0000 7ff4e40e5640 1 -- 172.21.15.53:0/1275716020 wait complete. 2023-06-10T19:01:45.396 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-10T19:01:45.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.511+0000 7fab92142640 1 Processor -- start 2023-06-10T19:01:45.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.511+0000 7fab92142640 1 -- start start 2023-06-10T19:01:45.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.511+0000 7fab92142640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab8c15c090 0x7fab8c0b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:45.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.511+0000 7fab92142640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab8c0cc7c0 con 0x7fab8c0b7e30 2023-06-10T19:01:45.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.511+0000 7fab92142640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab8c0ccaa0 con 0x7fab8c0b0b90 2023-06-10T19:01:45.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.511+0000 7fab92142640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab8c0ccd80 con 0x7fab8c15c090 2023-06-10T19:01:45.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.511+0000 7fab8bfff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fab8c0b7e30 0x7fab8c0d04d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:57074/0 (socket says 172.21.15.53:57074) 2023-06-10T19:01:45.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.511+0000 7fab8bfff640 1 -- 172.21.15.53:0/3802887785 learned_addr learned my addr 172.21.15.53:0/3802887785 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:01:45.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.511+0000 7fab8b7fe640 1 --2- 172.21.15.53:0/3802887785 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab8c15c090 0x7fab8c0b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:45.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.511+0000 7fab8a7fc640 1 -- 172.21.15.53:0/3802887785 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1720230974 0 0) 0x7fab8c0cc7c0 con 0x7fab8c0b7e30 2023-06-10T19:01:45.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.511+0000 7fab8a7fc640 1 -- 172.21.15.53:0/3802887785 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab74003530 con 0x7fab8c0b7e30 2023-06-10T19:01:45.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.511+0000 7fab8a7fc640 1 -- 172.21.15.53:0/3802887785 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 302892074 0 0) 0x7fab74003530 con 0x7fab8c0b7e30 2023-06-10T19:01:45.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.511+0000 7fab8a7fc640 1 -- 172.21.15.53:0/3802887785 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab8c15c090 msgr2=0x7fab8c0b10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:45.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.511+0000 7fab8a7fc640 1 --2- 172.21.15.53:0/3802887785 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab8c15c090 0x7fab8c0b10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:45.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.511+0000 7fab8a7fc640 1 -- 172.21.15.53:0/3802887785 >> v1:172.21.15.117:6789/0 conn(0x7fab8c0b0b90 legacy=0x7fab8c0b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:45.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.511+0000 7fab8a7fc640 1 -- 172.21.15.53:0/3802887785 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab8c0cd060 con 0x7fab8c0b7e30 2023-06-10T19:01:45.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.511+0000 7fab8a7fc640 1 -- 172.21.15.53:0/3802887785 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fab84001a00 con 0x7fab8c0b7e30 2023-06-10T19:01:45.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.511+0000 7fab8a7fc640 1 -- 172.21.15.53:0/3802887785 >> v1:172.21.15.53:6789/0 conn(0x7fab8c0b7e30 legacy=0x7fab8c0d04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:45.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.511+0000 7fab8a7fc640 1 --2- 172.21.15.53:0/3802887785 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab740039b0 0x7fab74003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:45.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.511+0000 7fab8a7fc640 1 --2- 172.21.15.53:0/3802887785 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab8c15c090 0x7fab740047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:45.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.511+0000 7fab8a7fc640 1 --2- 172.21.15.53:0/3802887785 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab74004d10 0x7fab74005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:45.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.511+0000 7fab8a7fc640 1 -- 172.21.15.53:0/3802887785 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab8c0ccd80 con 0x7fab74004d10 2023-06-10T19:01:45.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.511+0000 7fab8a7fc640 1 -- 172.21.15.53:0/3802887785 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab7400baa0 con 0x7fab740039b0 2023-06-10T19:01:45.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.511+0000 7fab8a7fc640 1 -- 172.21.15.53:0/3802887785 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab7400bc60 con 0x7fab8c15c090 2023-06-10T19:01:45.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.511+0000 7fab8bfff640 1 --2- 172.21.15.53:0/3802887785 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab74004d10 0x7fab74005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:45.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.511+0000 7fab8b7fe640 1 --2- 172.21.15.53:0/3802887785 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab740039b0 0x7fab74003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:45.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.511+0000 7fab8affd640 1 --2- 172.21.15.53:0/3802887785 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab8c15c090 0x7fab740047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:45.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.511+0000 7fab8bfff640 1 -- 172.21.15.53:0/3802887785 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab8c15c090 msgr2=0x7fab740047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:45.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.511+0000 7fab8bfff640 1 --2- 172.21.15.53:0/3802887785 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab8c15c090 0x7fab740047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:45.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.511+0000 7fab8bfff640 1 -- 172.21.15.53:0/3802887785 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab740039b0 msgr2=0x7fab74003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:45.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.511+0000 7fab8bfff640 1 --2- 172.21.15.53:0/3802887785 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab740039b0 0x7fab74003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:45.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.511+0000 7fab8bfff640 1 -- 172.21.15.53:0/3802887785 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab74003530 con 0x7fab74004d10 2023-06-10T19:01:45.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.511+0000 7fab8b7fe640 1 --2- 172.21.15.53:0/3802887785 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab740039b0 0x7fab74003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:01:45.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.515+0000 7fab8bfff640 1 --2- 172.21.15.53:0/3802887785 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab74004d10 0x7fab74005180 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7fab8c08a0d0 tx=0x7fab8401fa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19a8bf97c4d285e9 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:45.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.515+0000 7fab8a7fc640 1 -- 172.21.15.53:0/3802887785 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab840aa670 con 0x7fab74004d10 2023-06-10T19:01:45.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.515+0000 7fab8a7fc640 1 -- 172.21.15.53:0/3802887785 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab840aa7d0 con 0x7fab74004d10 2023-06-10T19:01:45.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.515+0000 7fab8a7fc640 1 -- 172.21.15.53:0/3802887785 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab840aabc0 con 0x7fab74004d10 2023-06-10T19:01:45.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.515+0000 7fab92142640 1 -- 172.21.15.53:0/3802887785 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab74004d10 msgr2=0x7fab74005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:45.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.515+0000 7fab92142640 1 --2- 172.21.15.53:0/3802887785 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab74004d10 0x7fab74005180 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7fab8c08a0d0 tx=0x7fab8401fa40 comp rx=0 tx=0).stop 2023-06-10T19:01:45.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.515+0000 7fab8bfff640 1 -- 172.21.15.53:0/3802887785 reap_dead start 2023-06-10T19:01:45.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.515+0000 7fab92142640 1 -- 172.21.15.53:0/3802887785 shutdown_connections 2023-06-10T19:01:45.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.515+0000 7fab92142640 1 -- 172.21.15.53:0/3802887785 >> 172.21.15.53:0/3802887785 conn(0x7fab8c069e20 msgr2=0x7fab8c06a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:45.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.515+0000 7fab92142640 1 -- 172.21.15.53:0/3802887785 shutdown_connections 2023-06-10T19:01:45.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.515+0000 7fab92142640 1 -- 172.21.15.53:0/3802887785 wait complete. 2023-06-10T19:01:45.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.515+0000 7fab92142640 1 Processor -- start 2023-06-10T19:01:45.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.515+0000 7fab92142640 1 -- start start 2023-06-10T19:01:45.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.519+0000 7fab92142640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab8c147280 0x7fab8c0cabe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:45.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.519+0000 7fab92142640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab8c0cb120 0x7fab8c14ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:45.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.519+0000 7fab92142640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab8c14b3d0 0x7fab8c155f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:45.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.519+0000 7fab92142640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab8c14b840 con 0x7fab8c147280 2023-06-10T19:01:45.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.519+0000 7fab92142640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab8c0cbfd0 con 0x7fab8c14b3d0 2023-06-10T19:01:45.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.519+0000 7fab92142640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab8c0cb730 con 0x7fab8c0cb120 2023-06-10T19:01:45.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.519+0000 7fab8b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab8c147280 0x7fab8c0cabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:45.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.519+0000 7fab8b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab8c147280 0x7fab8c0cabe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48472/0 (socket says 172.21.15.53:48472) 2023-06-10T19:01:45.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.519+0000 7fab8b7fe640 1 -- 172.21.15.53:0/583824340 learned_addr learned my addr 172.21.15.53:0/583824340 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:45.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.519+0000 7fab8affd640 1 --2- 172.21.15.53:0/583824340 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab8c0cb120 0x7fab8c14ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:45.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.519+0000 7fab8bfff640 1 --2- 172.21.15.53:0/583824340 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab8c14b3d0 0x7fab8c155f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:45.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.519+0000 7fab8b7fe640 1 -- 172.21.15.53:0/583824340 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab8c0cb120 msgr2=0x7fab8c14ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:45.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.519+0000 7fab8b7fe640 1 --2- 172.21.15.53:0/583824340 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab8c0cb120 0x7fab8c14ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:45.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.519+0000 7fab8b7fe640 1 -- 172.21.15.53:0/583824340 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab8c14b3d0 msgr2=0x7fab8c155f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:45.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.519+0000 7fab8b7fe640 1 --2- 172.21.15.53:0/583824340 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab8c14b3d0 0x7fab8c155f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:45.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.519+0000 7fab8b7fe640 1 -- 172.21.15.53:0/583824340 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab8c0cba10 con 0x7fab8c147280 2023-06-10T19:01:45.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.519+0000 7fab8bfff640 1 --2- 172.21.15.53:0/583824340 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab8c14b3d0 0x7fab8c155f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:01:45.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.519+0000 7fab8b7fe640 1 --2- 172.21.15.53:0/583824340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab8c147280 0x7fab8c0cabe0 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7fab7c0115f0 tx=0x7fab7c011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:45.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.519+0000 7fab73fff640 1 -- 172.21.15.53:0/583824340 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab7c004220 con 0x7fab8c147280 2023-06-10T19:01:45.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.519+0000 7fab73fff640 1 -- 172.21.15.53:0/583824340 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab7c004380 con 0x7fab8c147280 2023-06-10T19:01:45.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.519+0000 7fab73fff640 1 -- 172.21.15.53:0/583824340 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab7c00f8f0 con 0x7fab8c147280 2023-06-10T19:01:45.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.519+0000 7fab92142640 1 -- 172.21.15.53:0/583824340 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab8c0cbcf0 con 0x7fab8c147280 2023-06-10T19:01:45.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.519+0000 7fab92142640 1 -- 172.21.15.53:0/583824340 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab8c147650 con 0x7fab8c147280 2023-06-10T19:01:45.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.519+0000 7fab92142640 1 -- 172.21.15.53:0/583824340 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab8c0cb4f0 con 0x7fab8c147280 2023-06-10T19:01:45.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.519+0000 7fab73fff640 1 -- 172.21.15.53:0/583824340 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fab7c00fa50 con 0x7fab8c147280 2023-06-10T19:01:45.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.519+0000 7fab73fff640 1 --2- 172.21.15.53:0/583824340 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fab780662b0 0x7fab78068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:45.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.519+0000 7fab73fff640 1 -- 172.21.15.53:0/583824340 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6191+0+0 (secure 0 0 0) 0x7fab7c083eb0 con 0x7fab8c147280 2023-06-10T19:01:45.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.519+0000 7fab8affd640 1 --2- 172.21.15.53:0/583824340 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fab780662b0 0x7fab78068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:45.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.523+0000 7fab8affd640 1 --2- 172.21.15.53:0/583824340 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fab780662b0 0x7fab78068760 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fab8c0d1760 tx=0x7fab80009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:45.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.523+0000 7fab73fff640 1 -- 172.21.15.53:0/583824340 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fab8c0cb4f0 con 0x7fab8c147280 2023-06-10T19:01:45.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.675+0000 7fab92142640 1 -- 172.21.15.53:0/583824340 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fab8c0cb4f0 con 0x7fab8c147280 2023-06-10T19:01:45.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.675+0000 7fab73fff640 1 -- 172.21.15.53:0/583824340 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v82) v1 ==== 92+0+10 (secure 0 0 0) 0x7fab8c0cb4f0 con 0x7fab8c147280 2023-06-10T19:01:45.682 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-06-10T19:01:45.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.679+0000 7fab92142640 1 -- 172.21.15.53:0/583824340 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fab780662b0 msgr2=0x7fab78068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:45.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.679+0000 7fab92142640 1 --2- 172.21.15.53:0/583824340 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fab780662b0 0x7fab78068760 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fab8c0d1760 tx=0x7fab80009040 comp rx=0 tx=0).stop 2023-06-10T19:01:45.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.679+0000 7fab92142640 1 -- 172.21.15.53:0/583824340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab8c147280 msgr2=0x7fab8c0cabe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:45.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.679+0000 7fab92142640 1 --2- 172.21.15.53:0/583824340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab8c147280 0x7fab8c0cabe0 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7fab7c0115f0 tx=0x7fab7c011ab0 comp rx=0 tx=0).stop 2023-06-10T19:01:45.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.679+0000 7fab92142640 1 -- 172.21.15.53:0/583824340 shutdown_connections 2023-06-10T19:01:45.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.679+0000 7fab92142640 1 --2- 172.21.15.53:0/583824340 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fab780662b0 0x7fab78068760 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:45.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.679+0000 7fab92142640 1 --2- 172.21.15.53:0/583824340 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab8c14b3d0 0x7fab8c155f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:45.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.679+0000 7fab92142640 1 --2- 172.21.15.53:0/583824340 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab8c0cb120 0x7fab8c14ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:45.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.679+0000 7fab92142640 1 --2- 172.21.15.53:0/583824340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab8c147280 0x7fab8c0cabe0 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:45.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.679+0000 7fab92142640 1 -- 172.21.15.53:0/583824340 >> 172.21.15.53:0/583824340 conn(0x7fab8c069e20 msgr2=0x7fab8c0b5bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:45.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.679+0000 7fab92142640 1 -- 172.21.15.53:0/583824340 shutdown_connections 2023-06-10T19:01:45.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.679+0000 7fab92142640 1 -- 172.21.15.53:0/583824340 wait complete. 2023-06-10T19:01:45.699 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-10T19:01:45.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.815+0000 7f22cb21c640 1 Processor -- start 2023-06-10T19:01:45.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.815+0000 7f22cb21c640 1 -- start start 2023-06-10T19:01:45.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.815+0000 7f22cb21c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f22c40c82a0 0x7f22c40c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:45.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.815+0000 7f22cb21c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f22c40af760 0x7f22c40afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:45.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.815+0000 7f22cb21c640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22c406b090 con 0x7f22c40c9fa0 2023-06-10T19:01:45.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.815+0000 7f22cb21c640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22c40b0120 con 0x7f22c40c82a0 2023-06-10T19:01:45.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.815+0000 7f22cb21c640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22c40ca370 con 0x7f22c40af760 2023-06-10T19:01:45.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.815+0000 7f22c8fb8640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f22c40c9fa0 0x7f22c406bae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:57090/0 (socket says 172.21.15.53:57090) 2023-06-10T19:01:45.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.815+0000 7f22c8fb8640 1 -- 172.21.15.53:0/1626396327 learned_addr learned my addr 172.21.15.53:0/1626396327 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:01:45.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.815+0000 7f22c3fff640 1 --2- 172.21.15.53:0/1626396327 >> v2:172.21.15.53:3300/0 conn(0x7f22c40c82a0 0x7f22c40c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:45.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.815+0000 7f22c97b9640 1 --2- 172.21.15.53:0/1626396327 >> v2:172.21.15.117:3300/0 conn(0x7f22c40af760 0x7f22c40afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:45.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.815+0000 7f22c37fe640 1 -- 172.21.15.53:0/1626396327 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3028412363 0 0) 0x7f22c406b090 con 0x7f22c40c9fa0 2023-06-10T19:01:45.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.815+0000 7f22c37fe640 1 -- 172.21.15.53:0/1626396327 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22ac003530 con 0x7f22c40c9fa0 2023-06-10T19:01:45.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.815+0000 7f22c3fff640 1 -- 172.21.15.53:0/1626396327 >> v2:172.21.15.117:3300/0 conn(0x7f22c40af760 msgr2=0x7f22c40afbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:45.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.815+0000 7f22c3fff640 1 --2- 172.21.15.53:0/1626396327 >> v2:172.21.15.117:3300/0 conn(0x7f22c40af760 0x7f22c40afbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:45.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.815+0000 7f22c3fff640 1 -- 172.21.15.53:0/1626396327 >> v1:172.21.15.53:6789/0 conn(0x7f22c40c9fa0 legacy=0x7f22c406bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:45.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.815+0000 7f22c3fff640 1 -- 172.21.15.53:0/1626396327 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22c4070d50 con 0x7f22c40c82a0 2023-06-10T19:01:45.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.815+0000 7f22c97b9640 1 --2- 172.21.15.53:0/1626396327 >> v2:172.21.15.117:3300/0 conn(0x7f22c40af760 0x7f22c40afbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:01:45.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.819+0000 7f22c3fff640 1 --2- 172.21.15.53:0/1626396327 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22c40c82a0 0x7f22c40c86f0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f22c406fc20 tx=0x7f22b801c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=507017f01ca8147b server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:45.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.819+0000 7f22c37fe640 1 -- 172.21.15.53:0/1626396327 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b80ac600 con 0x7f22c40c82a0 2023-06-10T19:01:45.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.819+0000 7f22c37fe640 1 -- 172.21.15.53:0/1626396327 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22b80a8050 con 0x7f22c40c82a0 2023-06-10T19:01:45.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.819+0000 7f22c37fe640 1 -- 172.21.15.53:0/1626396327 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b80ac980 con 0x7f22c40c82a0 2023-06-10T19:01:45.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.819+0000 7f22cb21c640 1 -- 172.21.15.53:0/1626396327 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22c40c82a0 msgr2=0x7f22c40c86f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:45.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.819+0000 7f22cb21c640 1 --2- 172.21.15.53:0/1626396327 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22c40c82a0 0x7f22c40c86f0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f22c406fc20 tx=0x7f22b801c3a0 comp rx=0 tx=0).stop 2023-06-10T19:01:45.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.819+0000 7f22cb21c640 1 -- 172.21.15.53:0/1626396327 shutdown_connections 2023-06-10T19:01:45.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.819+0000 7f22cb21c640 1 --2- 172.21.15.53:0/1626396327 >> v2:172.21.15.117:3300/0 conn(0x7f22c40af760 0x7f22c40afbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:45.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.819+0000 7f22cb21c640 1 --2- 172.21.15.53:0/1626396327 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22c40c82a0 0x7f22c40c86f0 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:45.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.819+0000 7f22cb21c640 1 -- 172.21.15.53:0/1626396327 >> 172.21.15.53:0/1626396327 conn(0x7f22c406a0e0 msgr2=0x7f22c40cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:45.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.819+0000 7f22cb21c640 1 -- 172.21.15.53:0/1626396327 shutdown_connections 2023-06-10T19:01:45.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.819+0000 7f22cb21c640 1 -- 172.21.15.53:0/1626396327 wait complete. 2023-06-10T19:01:45.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.819+0000 7f22cb21c640 1 Processor -- start 2023-06-10T19:01:45.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.823+0000 7f22cb21c640 1 -- start start 2023-06-10T19:01:45.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.823+0000 7f22cb21c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22c40af760 0x7f22c40bfcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:45.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.823+0000 7f22cb21c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22c40c82a0 0x7f22c4151a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:45.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.823+0000 7f22cb21c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22c40c9fa0 0x7f22c40b1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:45.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.823+0000 7f22cb21c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22c4154ae0 con 0x7f22c40af760 2023-06-10T19:01:45.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.823+0000 7f22cb21c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22c4154dc0 con 0x7f22c40c9fa0 2023-06-10T19:01:45.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.823+0000 7f22cb21c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22c41550a0 con 0x7f22c40c82a0 2023-06-10T19:01:45.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.823+0000 7f22c8fb8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22c40af760 0x7f22c40bfcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:45.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.823+0000 7f22c8fb8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22c40af760 0x7f22c40bfcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48478/0 (socket says 172.21.15.53:48478) 2023-06-10T19:01:45.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.823+0000 7f22c8fb8640 1 -- 172.21.15.53:0/2509212194 learned_addr learned my addr 172.21.15.53:0/2509212194 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:45.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.823+0000 7f22c97b9640 1 --2- 172.21.15.53:0/2509212194 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22c40c9fa0 0x7f22c40b1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:45.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.823+0000 7f22c8fb8640 1 -- 172.21.15.53:0/2509212194 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22c40c82a0 msgr2=0x7f22c4151a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:45.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.823+0000 7f22c3fff640 1 --2- 172.21.15.53:0/2509212194 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22c40c82a0 0x7f22c4151a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:45.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.823+0000 7f22c8fb8640 1 --2- 172.21.15.53:0/2509212194 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22c40c82a0 0x7f22c4151a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:45.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.823+0000 7f22c8fb8640 1 -- 172.21.15.53:0/2509212194 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22c40c9fa0 msgr2=0x7f22c40b1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:45.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.823+0000 7f22c8fb8640 1 --2- 172.21.15.53:0/2509212194 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22c40c9fa0 0x7f22c40b1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:45.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.823+0000 7f22c8fb8640 1 -- 172.21.15.53:0/2509212194 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22b8009420 con 0x7f22c40af760 2023-06-10T19:01:45.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.823+0000 7f22c97b9640 1 --2- 172.21.15.53:0/2509212194 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22c40c9fa0 0x7f22c40b1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:01:45.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.823+0000 7f22c8fb8640 1 --2- 172.21.15.53:0/2509212194 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22c40af760 0x7f22c40bfcf0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f22b400c420 tx=0x7f22b400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:45.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.823+0000 7f22c17fa640 1 -- 172.21.15.53:0/2509212194 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b4005cf0 con 0x7f22c40af760 2023-06-10T19:01:45.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.823+0000 7f22c17fa640 1 -- 172.21.15.53:0/2509212194 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22b4005e50 con 0x7f22c40af760 2023-06-10T19:01:45.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.823+0000 7f22c17fa640 1 -- 172.21.15.53:0/2509212194 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b40072d0 con 0x7f22c40af760 2023-06-10T19:01:45.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.823+0000 7f22cb21c640 1 -- 172.21.15.53:0/2509212194 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22c4155380 con 0x7f22c40af760 2023-06-10T19:01:45.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.823+0000 7f22cb21c640 1 -- 172.21.15.53:0/2509212194 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22c4154700 con 0x7f22c40af760 2023-06-10T19:01:45.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.823+0000 7f22cb21c640 1 -- 172.21.15.53:0/2509212194 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22c404d790 con 0x7f22c40af760 2023-06-10T19:01:45.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.823+0000 7f22c17fa640 1 -- 172.21.15.53:0/2509212194 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f22b4007430 con 0x7f22c40af760 2023-06-10T19:01:45.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.823+0000 7f22c17fa640 1 --2- 172.21.15.53:0/2509212194 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f22b0066250 0x7f22b0068700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:45.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.823+0000 7f22c17fa640 1 -- 172.21.15.53:0/2509212194 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6191+0+0 (secure 0 0 0) 0x7f22b4083280 con 0x7f22c40af760 2023-06-10T19:01:45.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.827+0000 7f22c3fff640 1 --2- 172.21.15.53:0/2509212194 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f22b0066250 0x7f22b0068700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:45.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.827+0000 7f22c3fff640 1 --2- 172.21.15.53:0/2509212194 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f22b0066250 0x7f22b0068700 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f22b80ae000 tx=0x7f22b8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:45.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.831+0000 7f22c17fa640 1 -- 172.21.15.53:0/2509212194 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f22b40507c0 con 0x7f22c40af760 2023-06-10T19:01:45.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.975+0000 7f22cb21c640 1 -- 172.21.15.53:0/2509212194 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f22c4154c20 con 0x7f22c40af760 2023-06-10T19:01:45.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.975+0000 7f22c17fa640 1 -- 172.21.15.53:0/2509212194 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v82) v1 ==== 104+0+11 (secure 0 0 0) 0x7f22c4154c20 con 0x7f22c40af760 2023-06-10T19:01:45.981 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-06-10T19:01:45.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.975+0000 7f22cb21c640 1 -- 172.21.15.53:0/2509212194 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f22b0066250 msgr2=0x7f22b0068700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:45.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.975+0000 7f22cb21c640 1 --2- 172.21.15.53:0/2509212194 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f22b0066250 0x7f22b0068700 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f22b80ae000 tx=0x7f22b8008040 comp rx=0 tx=0).stop 2023-06-10T19:01:45.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.975+0000 7f22cb21c640 1 -- 172.21.15.53:0/2509212194 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22c40af760 msgr2=0x7f22c40bfcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:45.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.975+0000 7f22cb21c640 1 --2- 172.21.15.53:0/2509212194 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22c40af760 0x7f22c40bfcf0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f22b400c420 tx=0x7f22b400c8e0 comp rx=0 tx=0).stop 2023-06-10T19:01:45.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.975+0000 7f22cb21c640 1 -- 172.21.15.53:0/2509212194 shutdown_connections 2023-06-10T19:01:45.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.975+0000 7f22cb21c640 1 --2- 172.21.15.53:0/2509212194 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f22b0066250 0x7f22b0068700 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:45.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.975+0000 7f22cb21c640 1 --2- 172.21.15.53:0/2509212194 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22c40c9fa0 0x7f22c40b1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:45.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.975+0000 7f22cb21c640 1 --2- 172.21.15.53:0/2509212194 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22c40c82a0 0x7f22c4151a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:45.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.975+0000 7f22cb21c640 1 --2- 172.21.15.53:0/2509212194 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22c40af760 0x7f22c40bfcf0 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:45.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.975+0000 7f22cb21c640 1 -- 172.21.15.53:0/2509212194 >> 172.21.15.53:0/2509212194 conn(0x7f22c406a0e0 msgr2=0x7f22c4155ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:45.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.975+0000 7f22cb21c640 1 -- 172.21.15.53:0/2509212194 shutdown_connections 2023-06-10T19:01:45.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:45.975+0000 7f22cb21c640 1 -- 172.21.15.53:0/2509212194 wait complete. 2023-06-10T19:01:45.999 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-10T19:01:46.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.115+0000 7fdeb4511640 1 Processor -- start 2023-06-10T19:01:46.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.115+0000 7fdeb4511640 1 -- start start 2023-06-10T19:01:46.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.119+0000 7fdeb4511640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fdeac15cc50 0x7fdeac15d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:46.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.119+0000 7fdeb4511640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdeac0ad340 0x7fdeac0c86e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:46.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.119+0000 7fdeb4511640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdeac15dae0 con 0x7fdeac0afb10 2023-06-10T19:01:46.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.119+0000 7fdeb4511640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdeac15d020 con 0x7fdeac15cc50 2023-06-10T19:01:46.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.119+0000 7fdeb4511640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeac15ddc0 con 0x7fdeac0ad340 2023-06-10T19:01:46.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.119+0000 7fdeb2aae640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fdeac0afb10 0x7fdeac070d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:57094/0 (socket says 172.21.15.53:57094) 2023-06-10T19:01:46.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.119+0000 7fdeb2aae640 1 -- 172.21.15.53:0/1920521407 learned_addr learned my addr 172.21.15.53:0/1920521407 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:01:46.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.119+0000 7fdeb22ad640 1 --2- 172.21.15.53:0/1920521407 >> v2:172.21.15.117:3300/0 conn(0x7fdeac15cc50 0x7fdeac15d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:46.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.119+0000 7fdeb1aac640 1 --2- 172.21.15.53:0/1920521407 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdeac0ad340 0x7fdeac0c86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:46.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.119+0000 7fdeb12ab640 1 -- 172.21.15.53:0/1920521407 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1364664921 0 0) 0x7fdeac15dae0 con 0x7fdeac0afb10 2023-06-10T19:01:46.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.119+0000 7fdeb12ab640 1 -- 172.21.15.53:0/1920521407 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde98003530 con 0x7fdeac0afb10 2023-06-10T19:01:46.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.119+0000 7fdeb12ab640 1 -- 172.21.15.53:0/1920521407 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4171919182 0 0) 0x7fde98003530 con 0x7fdeac0afb10 2023-06-10T19:01:46.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.119+0000 7fdeb12ab640 1 -- 172.21.15.53:0/1920521407 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdeac0ad340 msgr2=0x7fdeac0c86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:46.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.119+0000 7fdeb12ab640 1 --2- 172.21.15.53:0/1920521407 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdeac0ad340 0x7fdeac0c86e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:46.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.119+0000 7fdeb12ab640 1 -- 172.21.15.53:0/1920521407 >> v2:172.21.15.117:3300/0 conn(0x7fdeac15cc50 msgr2=0x7fdeac15d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:46.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.119+0000 7fdeb12ab640 1 --2- 172.21.15.53:0/1920521407 >> v2:172.21.15.117:3300/0 conn(0x7fdeac15cc50 0x7fdeac15d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:46.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.119+0000 7fdeb12ab640 1 -- 172.21.15.53:0/1920521407 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeac15e0a0 con 0x7fdeac0afb10 2023-06-10T19:01:46.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.119+0000 7fdeb12ab640 1 -- 172.21.15.53:0/1920521407 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fdea4001a00 con 0x7fdeac0afb10 2023-06-10T19:01:46.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.119+0000 7fdeb1aac640 1 --2- 172.21.15.53:0/1920521407 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdeac0ad340 0x7fdeac0c86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:01:46.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.119+0000 7fdeb12ab640 1 -- 172.21.15.53:0/1920521407 >> v1:172.21.15.53:6789/0 conn(0x7fdeac0afb10 legacy=0x7fdeac070d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:46.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.119+0000 7fdeb12ab640 1 --2- 172.21.15.53:0/1920521407 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde98003980 0x7fde98003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:46.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.119+0000 7fdeb12ab640 1 --2- 172.21.15.53:0/1920521407 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdeac0ad340 0x7fde980047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:46.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.119+0000 7fdeb12ab640 1 --2- 172.21.15.53:0/1920521407 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde98004d10 0x7fde98005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:46.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.119+0000 7fdeb12ab640 1 -- 172.21.15.53:0/1920521407 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeac15ddc0 con 0x7fde98004d10 2023-06-10T19:01:46.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.119+0000 7fdeb12ab640 1 -- 172.21.15.53:0/1920521407 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde9800b990 con 0x7fde98003980 2023-06-10T19:01:46.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.119+0000 7fdeb12ab640 1 -- 172.21.15.53:0/1920521407 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde9800bad0 con 0x7fdeac0ad340 2023-06-10T19:01:46.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.119+0000 7fdeb2aae640 1 --2- 172.21.15.53:0/1920521407 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde98004d10 0x7fde98005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:46.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.119+0000 7fdeb22ad640 1 --2- 172.21.15.53:0/1920521407 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde98003980 0x7fde98003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:46.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.119+0000 7fdeb1aac640 1 --2- 172.21.15.53:0/1920521407 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdeac0ad340 0x7fde980047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:46.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.119+0000 7fdeb2aae640 1 -- 172.21.15.53:0/1920521407 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdeac0ad340 msgr2=0x7fde980047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:46.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.119+0000 7fdeb2aae640 1 --2- 172.21.15.53:0/1920521407 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdeac0ad340 0x7fde980047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:46.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.119+0000 7fdeb2aae640 1 -- 172.21.15.53:0/1920521407 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde98003980 msgr2=0x7fde98003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:46.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.119+0000 7fdeb2aae640 1 --2- 172.21.15.53:0/1920521407 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde98003980 0x7fde98003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:46.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.119+0000 7fdeb2aae640 1 -- 172.21.15.53:0/1920521407 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde98003530 con 0x7fde98004d10 2023-06-10T19:01:46.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.123+0000 7fdeb2aae640 1 --2- 172.21.15.53:0/1920521407 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde98004d10 0x7fde98005180 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7fdea400a860 tx=0x7fdea401d300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72ae3f1e50ac9832 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:46.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.123+0000 7fdeb12ab640 1 -- 172.21.15.53:0/1920521407 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea40ad630 con 0x7fde98004d10 2023-06-10T19:01:46.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.123+0000 7fdeb12ab640 1 -- 172.21.15.53:0/1920521407 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdea40a8070 con 0x7fde98004d10 2023-06-10T19:01:46.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.123+0000 7fdeb12ab640 1 -- 172.21.15.53:0/1920521407 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea40ad9f0 con 0x7fde98004d10 2023-06-10T19:01:46.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.123+0000 7fdeb4511640 1 -- 172.21.15.53:0/1920521407 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde98004d10 msgr2=0x7fde98005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:46.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.123+0000 7fdeb4511640 1 --2- 172.21.15.53:0/1920521407 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde98004d10 0x7fde98005180 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7fdea400a860 tx=0x7fdea401d300 comp rx=0 tx=0).stop 2023-06-10T19:01:46.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.123+0000 7fdeb2aae640 1 -- 172.21.15.53:0/1920521407 reap_dead start 2023-06-10T19:01:46.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.123+0000 7fdeb4511640 1 -- 172.21.15.53:0/1920521407 shutdown_connections 2023-06-10T19:01:46.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.123+0000 7fdeb4511640 1 -- 172.21.15.53:0/1920521407 >> 172.21.15.53:0/1920521407 conn(0x7fdeac0cab10 msgr2=0x7fdeac0caf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:46.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.123+0000 7fdeb4511640 1 -- 172.21.15.53:0/1920521407 shutdown_connections 2023-06-10T19:01:46.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.123+0000 7fdeb4511640 1 -- 172.21.15.53:0/1920521407 wait complete. 2023-06-10T19:01:46.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.123+0000 7fdeb4511640 1 Processor -- start 2023-06-10T19:01:46.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.123+0000 7fdeb4511640 1 -- start start 2023-06-10T19:01:46.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.123+0000 7fdeb4511640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdeac0c7130 0x7fdeac0c9170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:46.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.123+0000 7fdeb4511640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdeac0c7500 0x7fdeac0c4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:46.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.123+0000 7fdeb4511640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdeac14cd30 0x7fdeac14d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:46.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.123+0000 7fdeb4511640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeac14d6e0 con 0x7fdeac0c7130 2023-06-10T19:01:46.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.123+0000 7fdeb4511640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeac0cdc70 con 0x7fdeac0c7500 2023-06-10T19:01:46.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.123+0000 7fdeb4511640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeac0c4a50 con 0x7fdeac14cd30 2023-06-10T19:01:46.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.123+0000 7fdeb22ad640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdeac0c7130 0x7fdeac0c9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:46.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.123+0000 7fdeb22ad640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdeac0c7130 0x7fdeac0c9170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48500/0 (socket says 172.21.15.53:48500) 2023-06-10T19:01:46.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.123+0000 7fdeb22ad640 1 -- 172.21.15.53:0/1757394681 learned_addr learned my addr 172.21.15.53:0/1757394681 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:46.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.123+0000 7fdeb1aac640 1 --2- 172.21.15.53:0/1757394681 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdeac0c7500 0x7fdeac0c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:46.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.123+0000 7fdeb22ad640 1 -- 172.21.15.53:0/1757394681 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdeac14cd30 msgr2=0x7fdeac14d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:46.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.123+0000 7fdeb22ad640 1 --2- 172.21.15.53:0/1757394681 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdeac14cd30 0x7fdeac14d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:46.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.123+0000 7fdeb22ad640 1 -- 172.21.15.53:0/1757394681 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdeac0c7500 msgr2=0x7fdeac0c4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:46.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.123+0000 7fdeb22ad640 1 --2- 172.21.15.53:0/1757394681 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdeac0c7500 0x7fdeac0c4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:46.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.123+0000 7fdeb22ad640 1 -- 172.21.15.53:0/1757394681 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeac0c8060 con 0x7fdeac0c7130 2023-06-10T19:01:46.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.123+0000 7fdeb1aac640 1 --2- 172.21.15.53:0/1757394681 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdeac0c7500 0x7fdeac0c4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:01:46.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.123+0000 7fdeb22ad640 1 --2- 172.21.15.53:0/1757394681 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdeac0c7130 0x7fdeac0c9170 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7fdea0010900 tx=0x7fdea0010dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:46.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.127+0000 7fde9effd640 1 -- 172.21.15.53:0/1757394681 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea00096b0 con 0x7fdeac0c7130 2023-06-10T19:01:46.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.127+0000 7fde9effd640 1 -- 172.21.15.53:0/1757394681 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdea000eba0 con 0x7fdeac0c7130 2023-06-10T19:01:46.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.127+0000 7fdeb4511640 1 -- 172.21.15.53:0/1757394681 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdeac0c7aa0 con 0x7fdeac0c7130 2023-06-10T19:01:46.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.127+0000 7fde9effd640 1 -- 172.21.15.53:0/1757394681 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea001c400 con 0x7fdeac0c7130 2023-06-10T19:01:46.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.127+0000 7fdeb4511640 1 -- 172.21.15.53:0/1757394681 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdeac0c5200 con 0x7fdeac0c7130 2023-06-10T19:01:46.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.127+0000 7fdeb4511640 1 -- 172.21.15.53:0/1757394681 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdeac04d790 con 0x7fdeac0c7130 2023-06-10T19:01:46.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.127+0000 7fde9effd640 1 -- 172.21.15.53:0/1757394681 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdea001c560 con 0x7fdeac0c7130 2023-06-10T19:01:46.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.127+0000 7fde9effd640 1 --2- 172.21.15.53:0/1757394681 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fde900662b0 0x7fde90068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:46.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.127+0000 7fde9effd640 1 -- 172.21.15.53:0/1757394681 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6191+0+0 (secure 0 0 0) 0x7fdea00842a0 con 0x7fdeac0c7130 2023-06-10T19:01:46.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.127+0000 7fdeb1aac640 1 --2- 172.21.15.53:0/1757394681 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fde900662b0 0x7fde90068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:46.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.127+0000 7fdeb1aac640 1 --2- 172.21.15.53:0/1757394681 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fde900662b0 0x7fde90068760 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fdeac0ce870 tx=0x7fdea8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:46.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.131+0000 7fde9effd640 1 -- 172.21.15.53:0/1757394681 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdea0051730 con 0x7fdeac0c7130 2023-06-10T19:01:46.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.279+0000 7fdeb4511640 1 -- 172.21.15.53:0/1757394681 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdeac0b4010 con 0x7fdeac0c7130 2023-06-10T19:01:46.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.279+0000 7fde9effd640 1 -- 172.21.15.53:0/1757394681 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v82) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdea0054d50 con 0x7fdeac0c7130 2023-06-10T19:01:46.286 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-06-10T19:01:46.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.283+0000 7fdeb4511640 1 -- 172.21.15.53:0/1757394681 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fde900662b0 msgr2=0x7fde90068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:46.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.283+0000 7fdeb4511640 1 --2- 172.21.15.53:0/1757394681 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fde900662b0 0x7fde90068760 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fdeac0ce870 tx=0x7fdea8008040 comp rx=0 tx=0).stop 2023-06-10T19:01:46.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.283+0000 7fdeb4511640 1 -- 172.21.15.53:0/1757394681 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdeac0c7130 msgr2=0x7fdeac0c9170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:46.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.283+0000 7fdeb4511640 1 --2- 172.21.15.53:0/1757394681 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdeac0c7130 0x7fdeac0c9170 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7fdea0010900 tx=0x7fdea0010dc0 comp rx=0 tx=0).stop 2023-06-10T19:01:46.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.283+0000 7fdeb4511640 1 -- 172.21.15.53:0/1757394681 shutdown_connections 2023-06-10T19:01:46.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.283+0000 7fdeb4511640 1 --2- 172.21.15.53:0/1757394681 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fde900662b0 0x7fde90068760 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:46.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.283+0000 7fdeb4511640 1 --2- 172.21.15.53:0/1757394681 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdeac14cd30 0x7fdeac14d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:46.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.283+0000 7fdeb4511640 1 --2- 172.21.15.53:0/1757394681 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdeac0c7500 0x7fdeac0c4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:46.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.283+0000 7fdeb4511640 1 --2- 172.21.15.53:0/1757394681 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdeac0c7130 0x7fdeac0c9170 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:46.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.283+0000 7fdeb4511640 1 -- 172.21.15.53:0/1757394681 >> 172.21.15.53:0/1757394681 conn(0x7fdeac0cab10 msgr2=0x7fdeac0c86c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:46.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.283+0000 7fdeb4511640 1 -- 172.21.15.53:0/1757394681 shutdown_connections 2023-06-10T19:01:46.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.283+0000 7fdeb4511640 1 -- 172.21.15.53:0/1757394681 wait complete. 2023-06-10T19:01:46.303 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-10T19:01:46.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.423+0000 7f614df8d640 1 Processor -- start 2023-06-10T19:01:46.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.423+0000 7f614df8d640 1 -- start start 2023-06-10T19:01:46.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.423+0000 7f614df8d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f614815c920 0x7f61480c8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:46.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.423+0000 7f614df8d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f614806a9b0 0x7f614806adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:46.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.423+0000 7f614df8d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61480c8850 con 0x7f6148152bb0 2023-06-10T19:01:46.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.423+0000 7f614df8d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61480cc8f0 con 0x7f614815c920 2023-06-10T19:01:46.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.423+0000 7f614df8d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61480c8b90 con 0x7f614806a9b0 2023-06-10T19:01:46.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.423+0000 7f6146ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f614815c920 0x7f61480c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:46.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.423+0000 7f6146ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f614815c920 0x7f61480c8310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48506/0 (socket says 172.21.15.53:48506) 2023-06-10T19:01:46.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.423+0000 7f6146ffd640 1 -- 172.21.15.53:0/693977704 learned_addr learned my addr 172.21.15.53:0/693977704 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:46.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.423+0000 7f6147fff640 1 --2- 172.21.15.53:0/693977704 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f614806a9b0 0x7f614806adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:46.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.423+0000 7f6146ffd640 1 -- 172.21.15.53:0/693977704 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f614806a9b0 msgr2=0x7f614806adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:46.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.423+0000 7f6146ffd640 1 --2- 172.21.15.53:0/693977704 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f614806a9b0 0x7f614806adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:46.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.423+0000 7f6146ffd640 1 -- 172.21.15.53:0/693977704 >> v1:172.21.15.117:6789/0 conn(0x7f6148152bb0 legacy=0x7f614815c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:46.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.423+0000 7f6146ffd640 1 -- 172.21.15.53:0/693977704 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61480c8e70 con 0x7f614815c920 2023-06-10T19:01:46.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.427+0000 7f6146ffd640 1 --2- 172.21.15.53:0/693977704 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f614815c920 0x7f61480c8310 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f6130009870 tx=0x7f613001ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=301c9d338cb78009 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:46.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.427+0000 7f61467fc640 1 -- 172.21.15.53:0/693977704 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61300a8a30 con 0x7f614815c920 2023-06-10T19:01:46.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.427+0000 7f61467fc640 1 -- 172.21.15.53:0/693977704 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61300a8b90 con 0x7f614815c920 2023-06-10T19:01:46.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.427+0000 7f61467fc640 1 -- 172.21.15.53:0/693977704 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61300b0440 con 0x7f614815c920 2023-06-10T19:01:46.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.427+0000 7f614df8d640 1 -- 172.21.15.53:0/693977704 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f614815c920 msgr2=0x7f61480c8310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:46.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.427+0000 7f614df8d640 1 --2- 172.21.15.53:0/693977704 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f614815c920 0x7f61480c8310 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f6130009870 tx=0x7f613001ed30 comp rx=0 tx=0).stop 2023-06-10T19:01:46.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.427+0000 7f614df8d640 1 -- 172.21.15.53:0/693977704 shutdown_connections 2023-06-10T19:01:46.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.427+0000 7f614df8d640 1 --2- 172.21.15.53:0/693977704 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f614806a9b0 0x7f614806adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:46.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.427+0000 7f614df8d640 1 --2- 172.21.15.53:0/693977704 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f614815c920 0x7f61480c8310 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:46.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.427+0000 7f614df8d640 1 -- 172.21.15.53:0/693977704 >> 172.21.15.53:0/693977704 conn(0x7f61480ce9e0 msgr2=0x7f61480ca7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:46.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.427+0000 7f614df8d640 1 -- 172.21.15.53:0/693977704 shutdown_connections 2023-06-10T19:01:46.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.427+0000 7f614df8d640 1 -- 172.21.15.53:0/693977704 wait complete. 2023-06-10T19:01:46.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.431+0000 7f614df8d640 1 Processor -- start 2023-06-10T19:01:46.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.431+0000 7f614df8d640 1 -- start start 2023-06-10T19:01:46.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.431+0000 7f614df8d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f614806a9b0 0x7f614814db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:46.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.431+0000 7f614df8d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6148152bb0 0x7f61480c7590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:46.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.431+0000 7f614df8d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f614815c920 0x7f61480c7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:46.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.431+0000 7f614df8d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61480b3740 con 0x7f614815c920 2023-06-10T19:01:46.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.431+0000 7f614df8d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61480b3460 con 0x7f6148152bb0 2023-06-10T19:01:46.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.431+0000 7f614df8d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61480c4f30 con 0x7f614806a9b0 2023-06-10T19:01:46.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.431+0000 7f6147fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f614815c920 0x7f61480c7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:46.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.431+0000 7f6147fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f614815c920 0x7f61480c7ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48516/0 (socket says 172.21.15.53:48516) 2023-06-10T19:01:46.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.431+0000 7f6147fff640 1 -- 172.21.15.53:0/3127486612 learned_addr learned my addr 172.21.15.53:0/3127486612 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:46.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.431+0000 7f61477fe640 1 --2- 172.21.15.53:0/3127486612 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f614806a9b0 0x7f614814db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:46.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.431+0000 7f6146ffd640 1 --2- 172.21.15.53:0/3127486612 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6148152bb0 0x7f61480c7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:46.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.431+0000 7f6147fff640 1 -- 172.21.15.53:0/3127486612 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f614806a9b0 msgr2=0x7f614814db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:46.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.431+0000 7f6147fff640 1 --2- 172.21.15.53:0/3127486612 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f614806a9b0 0x7f614814db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:46.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.431+0000 7f6147fff640 1 -- 172.21.15.53:0/3127486612 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6148152bb0 msgr2=0x7f61480c7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:46.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.431+0000 7f6147fff640 1 --2- 172.21.15.53:0/3127486612 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6148152bb0 0x7f61480c7590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:46.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.431+0000 7f6147fff640 1 -- 172.21.15.53:0/3127486612 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61300094d0 con 0x7f614815c920 2023-06-10T19:01:46.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.431+0000 7f6147fff640 1 --2- 172.21.15.53:0/3127486612 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f614815c920 0x7f61480c7ad0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f6140007e60 tx=0x7f614000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:46.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.431+0000 7f613ffff640 1 -- 172.21.15.53:0/3127486612 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6140014420 con 0x7f614815c920 2023-06-10T19:01:46.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.431+0000 7f613ffff640 1 -- 172.21.15.53:0/3127486612 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61400145a0 con 0x7f614815c920 2023-06-10T19:01:46.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.431+0000 7f614df8d640 1 -- 172.21.15.53:0/3127486612 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61480c5210 con 0x7f614815c920 2023-06-10T19:01:46.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.431+0000 7f613ffff640 1 -- 172.21.15.53:0/3127486612 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6140014950 con 0x7f614815c920 2023-06-10T19:01:46.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.431+0000 7f614df8d640 1 -- 172.21.15.53:0/3127486612 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f614814e0a0 con 0x7f614815c920 2023-06-10T19:01:46.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.431+0000 7f614df8d640 1 -- 172.21.15.53:0/3127486612 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61480c4d90 con 0x7f614815c920 2023-06-10T19:01:46.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.431+0000 7f613ffff640 1 -- 172.21.15.53:0/3127486612 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6140014ab0 con 0x7f614815c920 2023-06-10T19:01:46.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.435+0000 7f613ffff640 1 --2- 172.21.15.53:0/3127486612 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f61280662b0 0x7f6128068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:46.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.435+0000 7f613ffff640 1 -- 172.21.15.53:0/3127486612 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6191+0+0 (secure 0 0 0) 0x7f6140084740 con 0x7f614815c920 2023-06-10T19:01:46.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.435+0000 7f61477fe640 1 --2- 172.21.15.53:0/3127486612 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f61280662b0 0x7f6128068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:46.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.435+0000 7f61477fe640 1 --2- 172.21.15.53:0/3127486612 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f61280662b0 0x7f6128068760 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f6138000fc0 tx=0x7f6138009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:46.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.439+0000 7f613ffff640 1 -- 172.21.15.53:0/3127486612 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f61480c4d90 con 0x7f614815c920 2023-06-10T19:01:46.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.603+0000 7f614df8d640 1 -- 172.21.15.53:0/3127486612 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f61480c4d90 con 0x7f614815c920 2023-06-10T19:01:46.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.607+0000 7f613ffff640 1 -- 172.21.15.53:0/3127486612 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 3 entries v82) v1 ==== 80+0+176 (secure 0 0 0) 0x7f61480c4d90 con 0x7f614815c920 2023-06-10T19:01:46.612 INFO:teuthology.orchestra.run.smithi053.stdout:192.168.0.1:0/716140912 2023-06-10T20:01:38.016422+0000 2023-06-10T19:01:46.612 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:6835/882186121 2023-06-11T19:00:42.868037+0000 2023-06-10T19:01:46.612 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:6834/882186121 2023-06-11T19:00:42.868037+0000 2023-06-10T19:01:46.613 INFO:teuthology.orchestra.run.smithi053.stderr:listed 3 entries 2023-06-10T19:01:46.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.607+0000 7f614df8d640 1 -- 172.21.15.53:0/3127486612 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f61280662b0 msgr2=0x7f6128068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:46.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.607+0000 7f614df8d640 1 --2- 172.21.15.53:0/3127486612 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f61280662b0 0x7f6128068760 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f6138000fc0 tx=0x7f6138009040 comp rx=0 tx=0).stop 2023-06-10T19:01:46.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.607+0000 7f614df8d640 1 -- 172.21.15.53:0/3127486612 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f614815c920 msgr2=0x7f61480c7ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:46.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.607+0000 7f614df8d640 1 --2- 172.21.15.53:0/3127486612 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f614815c920 0x7f61480c7ad0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f6140007e60 tx=0x7f614000e4b0 comp rx=0 tx=0).stop 2023-06-10T19:01:46.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.607+0000 7f614df8d640 1 -- 172.21.15.53:0/3127486612 shutdown_connections 2023-06-10T19:01:46.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.607+0000 7f614df8d640 1 --2- 172.21.15.53:0/3127486612 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f61280662b0 0x7f6128068760 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:46.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.607+0000 7f614df8d640 1 --2- 172.21.15.53:0/3127486612 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f614815c920 0x7f61480c7ad0 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:46.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.607+0000 7f614df8d640 1 --2- 172.21.15.53:0/3127486612 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6148152bb0 0x7f61480c7590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:46.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.607+0000 7f614df8d640 1 --2- 172.21.15.53:0/3127486612 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f614806a9b0 0x7f614814db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:46.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.607+0000 7f614df8d640 1 -- 172.21.15.53:0/3127486612 >> 172.21.15.53:0/3127486612 conn(0x7f61480ce9e0 msgr2=0x7f61480af840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:46.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.607+0000 7f614df8d640 1 -- 172.21.15.53:0/3127486612 shutdown_connections 2023-06-10T19:01:46.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.607+0000 7f614df8d640 1 -- 172.21.15.53:0/3127486612 wait complete. 2023-06-10T19:01:46.631 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi117.front.sepia.ceph.com... 2023-06-10T19:01:46.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:01:46.632 DEBUG:teuthology.orchestra.run.smithi117:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-06-10T19:01:46.645 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi117.stderr:ceph-fuse[44719]: fuse finished with error 0 and tester_r 0 2023-06-10T19:01:46.647 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi117.front.sepia.ceph.com 2023-06-10T19:01:46.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:01:46.648 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-06-10T19:01:46.722 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T19:01:46.723 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:01:46.729 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16345192k,nr_inodes=4086298,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276544k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=407 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276540k,nr_inodes=819135,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276544k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-06-10T19:01:46.729 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi053.front.sepia.ceph.com 2023-06-10T19:01:46.730 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:01:46.730 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-06-10T19:01:46.776 INFO:teuthology.orchestra.run.smithi053.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-06-10T19:01:46.777 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-10T19:01:46.777 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T19:01:46.778 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:01:46.783 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16342088k,nr_inodes=4085522,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275924k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18845 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275920k,nr_inodes=818980,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275924k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-06-10T19:01:46.784 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi117.front.sepia.ceph.com 2023-06-10T19:01:46.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:01:46.784 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-06-10T19:01:46.828 INFO:teuthology.orchestra.run.smithi117.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-06-10T19:01:46.829 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-10T19:01:46.830 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:01:46.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.959+0000 7fec3ad24640 1 Processor -- start 2023-06-10T19:01:46.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.959+0000 7fec3ad24640 1 -- start start 2023-06-10T19:01:46.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.959+0000 7fec3ad24640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fec340b0440 0x7fec34070c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:46.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.959+0000 7fec3ad24640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec3406fa60 con 0x7fec34157cf0 2023-06-10T19:01:46.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.959+0000 7fec3ad24640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec3406a340 con 0x7fec340affc0 2023-06-10T19:01:46.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.959+0000 7fec3ad24640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec340cae00 con 0x7fec340b0440 2023-06-10T19:01:46.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.959+0000 7fec38ac0640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fec34157cf0 0x7fec340ca6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:57100/0 (socket says 172.21.15.53:57100) 2023-06-10T19:01:46.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.959+0000 7fec38ac0640 1 -- 172.21.15.53:0/14634908 learned_addr learned my addr 172.21.15.53:0/14634908 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:01:46.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.959+0000 7fec392c1640 1 --2- 172.21.15.53:0/14634908 >> v2:172.21.15.117:3300/0 conn(0x7fec340b0440 0x7fec34070c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:46.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.959+0000 7fec337fe640 1 -- 172.21.15.53:0/14634908 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1270861982 0 0) 0x7fec3406fa60 con 0x7fec34157cf0 2023-06-10T19:01:46.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.959+0000 7fec337fe640 1 -- 172.21.15.53:0/14634908 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec1c003530 con 0x7fec34157cf0 2023-06-10T19:01:46.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.959+0000 7fec337fe640 1 -- 172.21.15.53:0/14634908 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4105520055 0 0) 0x7fec1c003530 con 0x7fec34157cf0 2023-06-10T19:01:46.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.959+0000 7fec337fe640 1 -- 172.21.15.53:0/14634908 >> v2:172.21.15.117:3300/0 conn(0x7fec340b0440 msgr2=0x7fec34070c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:46.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.959+0000 7fec337fe640 1 --2- 172.21.15.53:0/14634908 >> v2:172.21.15.117:3300/0 conn(0x7fec340b0440 0x7fec34070c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:46.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.959+0000 7fec337fe640 1 -- 172.21.15.53:0/14634908 >> v1:172.21.15.117:6789/0 conn(0x7fec340affc0 legacy=0x7fec34070500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:46.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.959+0000 7fec337fe640 1 -- 172.21.15.53:0/14634908 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec340c9250 con 0x7fec34157cf0 2023-06-10T19:01:46.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.959+0000 7fec337fe640 1 -- 172.21.15.53:0/14634908 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fec2c001a00 con 0x7fec34157cf0 2023-06-10T19:01:46.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.959+0000 7fec337fe640 1 -- 172.21.15.53:0/14634908 >> v1:172.21.15.53:6789/0 conn(0x7fec34157cf0 legacy=0x7fec340ca6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:46.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.959+0000 7fec337fe640 1 --2- 172.21.15.53:0/14634908 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec1c0039f0 0x7fec1c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:46.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.959+0000 7fec337fe640 1 --2- 172.21.15.53:0/14634908 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec1c0047d0 0x7fec1c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:46.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.959+0000 7fec337fe640 1 --2- 172.21.15.53:0/14634908 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec1c005180 0x7fec1c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:46.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.959+0000 7fec337fe640 1 -- 172.21.15.53:0/14634908 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec340cae00 con 0x7fec1c005180 2023-06-10T19:01:46.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.959+0000 7fec337fe640 1 -- 172.21.15.53:0/14634908 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec1c00c060 con 0x7fec1c0047d0 2023-06-10T19:01:46.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.959+0000 7fec337fe640 1 -- 172.21.15.53:0/14634908 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec1c00c220 con 0x7fec1c0039f0 2023-06-10T19:01:46.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.959+0000 7fec392c1640 1 --2- 172.21.15.53:0/14634908 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec1c005180 0x7fec1c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:46.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.959+0000 7fec38ac0640 1 --2- 172.21.15.53:0/14634908 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec1c0039f0 0x7fec1c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:46.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.959+0000 7fec33fff640 1 --2- 172.21.15.53:0/14634908 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec1c0047d0 0x7fec1c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:46.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.959+0000 7fec392c1640 1 -- 172.21.15.53:0/14634908 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec1c0039f0 msgr2=0x7fec1c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:46.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.959+0000 7fec392c1640 1 --2- 172.21.15.53:0/14634908 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec1c0039f0 0x7fec1c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:46.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.959+0000 7fec392c1640 1 -- 172.21.15.53:0/14634908 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec1c0047d0 msgr2=0x7fec1c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:46.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.959+0000 7fec392c1640 1 --2- 172.21.15.53:0/14634908 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec1c0047d0 0x7fec1c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:46.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.959+0000 7fec392c1640 1 -- 172.21.15.53:0/14634908 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec1c003530 con 0x7fec1c005180 2023-06-10T19:01:46.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.963+0000 7fec392c1640 1 -- 172.21.15.53:0/14634908 reap_dead start 2023-06-10T19:01:46.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.963+0000 7fec392c1640 1 --2- 172.21.15.53:0/14634908 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec1c005180 0x7fec1c00b990 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7fec2400bdd0 tx=0x7fec2401ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53e2ffa468706fb2 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:46.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.963+0000 7fec337fe640 1 -- 172.21.15.53:0/14634908 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec240a7c50 con 0x7fec1c005180 2023-06-10T19:01:46.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.963+0000 7fec337fe640 1 -- 172.21.15.53:0/14634908 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec240a7dd0 con 0x7fec1c005180 2023-06-10T19:01:46.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.963+0000 7fec337fe640 1 -- 172.21.15.53:0/14634908 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec24004260 con 0x7fec1c005180 2023-06-10T19:01:46.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.963+0000 7fec3ad24640 1 -- 172.21.15.53:0/14634908 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec1c005180 msgr2=0x7fec1c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:46.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.963+0000 7fec3ad24640 1 --2- 172.21.15.53:0/14634908 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec1c005180 0x7fec1c00b990 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7fec2400bdd0 tx=0x7fec2401ec60 comp rx=0 tx=0).stop 2023-06-10T19:01:46.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.963+0000 7fec3ad24640 1 -- 172.21.15.53:0/14634908 shutdown_connections 2023-06-10T19:01:46.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.963+0000 7fec3ad24640 1 --2- 172.21.15.53:0/14634908 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec1c005180 0x7fec1c00b990 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:46.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.963+0000 7fec3ad24640 1 -- 172.21.15.53:0/14634908 >> 172.21.15.53:0/14634908 conn(0x7fec340cafc0 msgr2=0x7fec340cb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:46.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.963+0000 7fec3ad24640 1 -- 172.21.15.53:0/14634908 shutdown_connections 2023-06-10T19:01:46.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.963+0000 7fec3ad24640 1 -- 172.21.15.53:0/14634908 wait complete. 2023-06-10T19:01:46.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.963+0000 7fec3ad24640 1 Processor -- start 2023-06-10T19:01:46.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.963+0000 7fec3ad24640 1 -- start start 2023-06-10T19:01:46.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.963+0000 7fec3ad24640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec1c005180 0x7fec341e0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:46.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.963+0000 7fec3ad24640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec341535b0 0x7fec341f1140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:46.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.963+0000 7fec3ad24640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec340b2ae0 0x7fec340b2f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:46.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.963+0000 7fec3ad24640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec341f1680 con 0x7fec1c005180 2023-06-10T19:01:46.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.963+0000 7fec3ad24640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec341e1490 con 0x7fec341535b0 2023-06-10T19:01:46.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.963+0000 7fec3ad24640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec340c2440 con 0x7fec340b2ae0 2023-06-10T19:01:46.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.967+0000 7fec38ac0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec1c005180 0x7fec341e0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:46.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.967+0000 7fec38ac0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec1c005180 0x7fec341e0560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48542/0 (socket says 172.21.15.53:48542) 2023-06-10T19:01:46.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.967+0000 7fec38ac0640 1 -- 172.21.15.53:0/3332391005 learned_addr learned my addr 172.21.15.53:0/3332391005 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:46.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.967+0000 7fec392c1640 1 --2- 172.21.15.53:0/3332391005 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec340b2ae0 0x7fec340b2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:46.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.967+0000 7fec33fff640 1 --2- 172.21.15.53:0/3332391005 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec341535b0 0x7fec341f1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:46.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.967+0000 7fec38ac0640 1 -- 172.21.15.53:0/3332391005 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec340b2ae0 msgr2=0x7fec340b2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:46.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.967+0000 7fec38ac0640 1 --2- 172.21.15.53:0/3332391005 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec340b2ae0 0x7fec340b2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:46.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.967+0000 7fec38ac0640 1 -- 172.21.15.53:0/3332391005 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec341535b0 msgr2=0x7fec341f1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:46.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.967+0000 7fec38ac0640 1 --2- 172.21.15.53:0/3332391005 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec341535b0 0x7fec341f1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:46.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.967+0000 7fec38ac0640 1 -- 172.21.15.53:0/3332391005 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec340b3490 con 0x7fec1c005180 2023-06-10T19:01:46.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.967+0000 7fec392c1640 1 --2- 172.21.15.53:0/3332391005 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec340b2ae0 0x7fec340b2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:01:46.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.967+0000 7fec33fff640 1 --2- 172.21.15.53:0/3332391005 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec341535b0 0x7fec341f1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:01:46.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.967+0000 7fec38ac0640 1 --2- 172.21.15.53:0/3332391005 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec1c005180 0x7fec341e0560 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7fec2c007a10 tx=0x7fec2c00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:46.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.967+0000 7fec317fa640 1 -- 172.21.15.53:0/3332391005 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec2c007b00 con 0x7fec1c005180 2023-06-10T19:01:46.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.967+0000 7fec317fa640 1 -- 172.21.15.53:0/3332391005 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec2c00edf0 con 0x7fec1c005180 2023-06-10T19:01:46.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.967+0000 7fec3ad24640 1 -- 172.21.15.53:0/3332391005 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec34153a20 con 0x7fec1c005180 2023-06-10T19:01:46.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.967+0000 7fec317fa640 1 -- 172.21.15.53:0/3332391005 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec2c0146a0 con 0x7fec1c005180 2023-06-10T19:01:46.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.967+0000 7fec3ad24640 1 -- 172.21.15.53:0/3332391005 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec341e0ed0 con 0x7fec1c005180 2023-06-10T19:01:46.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.967+0000 7fec3ad24640 1 -- 172.21.15.53:0/3332391005 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec3404d790 con 0x7fec1c005180 2023-06-10T19:01:46.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.967+0000 7fec317fa640 1 -- 172.21.15.53:0/3332391005 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fec2c01d3b0 con 0x7fec1c005180 2023-06-10T19:01:46.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.967+0000 7fec317fa640 1 --2- 172.21.15.53:0/3332391005 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fec20066280 0x7fec20068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:46.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.967+0000 7fec317fa640 1 -- 172.21.15.53:0/3332391005 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6191+0+0 (secure 0 0 0) 0x7fec2c083db0 con 0x7fec1c005180 2023-06-10T19:01:46.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.967+0000 7fec33fff640 1 --2- 172.21.15.53:0/3332391005 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fec20066280 0x7fec20068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:46.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.971+0000 7fec33fff640 1 --2- 172.21.15.53:0/3332391005 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fec20066280 0x7fec20068730 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fec341e18d0 tx=0x7fec28009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:46.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:46.971+0000 7fec317fa640 1 -- 172.21.15.53:0/3332391005 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fec2c051240 con 0x7fec1c005180 2023-06-10T19:01:47.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.151+0000 7fec3ad24640 1 -- 172.21.15.53:0/3332391005 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fec340b44c0 con 0x7fec1c005180 2023-06-10T19:01:47.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.151+0000 7fec317fa640 1 -- 172.21.15.53:0/3332391005 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4681 (secure 0 0 0) 0x7fec2c019020 con 0x7fec1c005180 2023-06-10T19:01:47.159 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:01:47.159 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5663,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2600814414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2600814414},{"type":"v1","addr":"172.21.15.117:6835","nonce":2600814414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6136,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1615882017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1615882017},{"type":"v1","addr":"172.21.15.117:6837","nonce":1615882017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6993,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/3732245174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3732245174},{"type":"v1","addr":"172.21.15.53:6833","nonce":3732245174}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:00:20.607950+0000","modified":"2023-06-10T19:01:40.998259+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7266":{"gid":7266,"name":"c","rank":0,"incarnation":37,"state":"up:active","state_seq":17,"addr":"172.21.15.53:6835/2829993338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2829993338},{"type":"v1","addr":"172.21.15.53:6835","nonce":2829993338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-06-10T19:01:47.159 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 40 2023-06-10T19:01:47.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.155+0000 7fec3ad24640 1 -- 172.21.15.53:0/3332391005 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fec20066280 msgr2=0x7fec20068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:47.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.155+0000 7fec3ad24640 1 --2- 172.21.15.53:0/3332391005 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fec20066280 0x7fec20068730 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fec341e18d0 tx=0x7fec28009040 comp rx=0 tx=0).stop 2023-06-10T19:01:47.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.155+0000 7fec3ad24640 1 -- 172.21.15.53:0/3332391005 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec1c005180 msgr2=0x7fec341e0560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:47.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.155+0000 7fec3ad24640 1 --2- 172.21.15.53:0/3332391005 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec1c005180 0x7fec341e0560 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7fec2c007a10 tx=0x7fec2c00e530 comp rx=0 tx=0).stop 2023-06-10T19:01:47.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.155+0000 7fec3ad24640 1 -- 172.21.15.53:0/3332391005 shutdown_connections 2023-06-10T19:01:47.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.155+0000 7fec3ad24640 1 --2- 172.21.15.53:0/3332391005 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fec20066280 0x7fec20068730 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:47.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.155+0000 7fec3ad24640 1 --2- 172.21.15.53:0/3332391005 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec340b2ae0 0x7fec340b2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:47.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.155+0000 7fec3ad24640 1 --2- 172.21.15.53:0/3332391005 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec341535b0 0x7fec341f1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:47.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.155+0000 7fec3ad24640 1 --2- 172.21.15.53:0/3332391005 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec1c005180 0x7fec341e0560 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:47.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.155+0000 7fec3ad24640 1 -- 172.21.15.53:0/3332391005 >> 172.21.15.53:0/3332391005 conn(0x7fec340cafc0 msgr2=0x7fec340ce4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:47.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.155+0000 7fec3ad24640 1 -- 172.21.15.53:0/3332391005 shutdown_connections 2023-06-10T19:01:47.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.155+0000 7fec3ad24640 1 -- 172.21.15.53:0/3332391005 wait complete. 2023-06-10T19:01:47.176 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:01:47.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.287+0000 7f0510080640 1 Processor -- start 2023-06-10T19:01:47.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.287+0000 7f0510080640 1 -- start start 2023-06-10T19:01:47.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.291+0000 7f0510080640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f05080c9840 0x7f05080c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:47.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.291+0000 7f0510080640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f050806b090 0x7f050806b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:47.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.291+0000 7f0510080640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0508159b50 con 0x7f0508071060 2023-06-10T19:01:47.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.291+0000 7f0510080640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05080ca150 con 0x7f05080c9840 2023-06-10T19:01:47.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.291+0000 7f0510080640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05080702a0 con 0x7f050806b090 2023-06-10T19:01:47.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.291+0000 7f050de1c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f05080c9840 0x7f05080c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:47.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.291+0000 7f050d61b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f0508071060 0x7f05080af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:57116/0 (socket says 172.21.15.53:57116) 2023-06-10T19:01:47.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.291+0000 7f050d61b640 1 -- 172.21.15.53:0/563906084 learned_addr learned my addr 172.21.15.53:0/563906084 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:01:47.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.291+0000 7f050e61d640 1 --2- 172.21.15.53:0/563906084 >> v2:172.21.15.117:3300/0 conn(0x7f050806b090 0x7f050806b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:47.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.291+0000 7f050de1c640 1 -- 172.21.15.53:0/563906084 >> v2:172.21.15.117:3300/0 conn(0x7f050806b090 msgr2=0x7f050806b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:47.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.291+0000 7f050de1c640 1 --2- 172.21.15.53:0/563906084 >> v2:172.21.15.117:3300/0 conn(0x7f050806b090 0x7f050806b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:47.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.291+0000 7f050de1c640 1 -- 172.21.15.53:0/563906084 >> v1:172.21.15.53:6789/0 conn(0x7f0508071060 legacy=0x7f05080af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:47.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.291+0000 7f050de1c640 1 -- 172.21.15.53:0/563906084 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0508070580 con 0x7f05080c9840 2023-06-10T19:01:47.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.291+0000 7f050e61d640 1 --2- 172.21.15.53:0/563906084 >> v2:172.21.15.117:3300/0 conn(0x7f050806b090 0x7f050806b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:01:47.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.291+0000 7f050de1c640 1 --2- 172.21.15.53:0/563906084 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f05080c9840 0x7f05080c9c10 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f050815e360 tx=0x7f050401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5502d2c804aea39c server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:47.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.291+0000 7f050ce1a640 1 -- 172.21.15.53:0/563906084 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05040a7070 con 0x7f05080c9840 2023-06-10T19:01:47.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.291+0000 7f050ce1a640 1 -- 172.21.15.53:0/563906084 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05040ab430 con 0x7f05080c9840 2023-06-10T19:01:47.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.291+0000 7f050ce1a640 1 -- 172.21.15.53:0/563906084 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05040ab7c0 con 0x7f05080c9840 2023-06-10T19:01:47.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.295+0000 7f0510080640 1 -- 172.21.15.53:0/563906084 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f05080c9840 msgr2=0x7f05080c9c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:47.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.295+0000 7f0510080640 1 --2- 172.21.15.53:0/563906084 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f05080c9840 0x7f05080c9c10 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f050815e360 tx=0x7f050401c430 comp rx=0 tx=0).stop 2023-06-10T19:01:47.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.295+0000 7f0510080640 1 -- 172.21.15.53:0/563906084 shutdown_connections 2023-06-10T19:01:47.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.295+0000 7f0510080640 1 --2- 172.21.15.53:0/563906084 >> v2:172.21.15.117:3300/0 conn(0x7f050806b090 0x7f050806b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:47.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.295+0000 7f0510080640 1 --2- 172.21.15.53:0/563906084 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f05080c9840 0x7f05080c9c10 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:47.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.295+0000 7f0510080640 1 -- 172.21.15.53:0/563906084 >> 172.21.15.53:0/563906084 conn(0x7f050806a0d0 msgr2=0x7f05080ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:47.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.295+0000 7f0510080640 1 -- 172.21.15.53:0/563906084 shutdown_connections 2023-06-10T19:01:47.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.295+0000 7f0510080640 1 -- 172.21.15.53:0/563906084 wait complete. 2023-06-10T19:01:47.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.295+0000 7f0510080640 1 Processor -- start 2023-06-10T19:01:47.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.295+0000 7f0510080640 1 -- start start 2023-06-10T19:01:47.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.295+0000 7f0510080640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f050806b090 0x7f05080b35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:47.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.295+0000 7f0510080640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0508071060 0x7f050815c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:47.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.295+0000 7f0510080640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05080c9840 0x7f0508157480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:47.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.295+0000 7f0510080640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f050815dba0 con 0x7f0508071060 2023-06-10T19:01:47.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.295+0000 7f0510080640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f050815cf90 con 0x7f05080c9840 2023-06-10T19:01:47.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.295+0000 7f0510080640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f050815d270 con 0x7f050806b090 2023-06-10T19:01:47.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.295+0000 7f050d61b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0508071060 0x7f050815c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:47.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.295+0000 7f050d61b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0508071060 0x7f050815c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48562/0 (socket says 172.21.15.53:48562) 2023-06-10T19:01:47.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.295+0000 7f050d61b640 1 -- 172.21.15.53:0/2147112998 learned_addr learned my addr 172.21.15.53:0/2147112998 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:47.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.295+0000 7f050de1c640 1 --2- 172.21.15.53:0/2147112998 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f050806b090 0x7f05080b35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:47.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.295+0000 7f050e61d640 1 --2- 172.21.15.53:0/2147112998 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05080c9840 0x7f0508157480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:47.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.295+0000 7f050d61b640 1 -- 172.21.15.53:0/2147112998 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f050806b090 msgr2=0x7f05080b35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:47.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.295+0000 7f050d61b640 1 --2- 172.21.15.53:0/2147112998 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f050806b090 0x7f05080b35d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:47.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.295+0000 7f050d61b640 1 -- 172.21.15.53:0/2147112998 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05080c9840 msgr2=0x7f0508157480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:47.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.295+0000 7f050d61b640 1 --2- 172.21.15.53:0/2147112998 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05080c9840 0x7f0508157480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:47.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.295+0000 7f050d61b640 1 -- 172.21.15.53:0/2147112998 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0504009420 con 0x7f0508071060 2023-06-10T19:01:47.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.295+0000 7f050de1c640 1 --2- 172.21.15.53:0/2147112998 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f050806b090 0x7f05080b35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:01:47.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.295+0000 7f050e61d640 1 --2- 172.21.15.53:0/2147112998 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05080c9840 0x7f0508157480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:01:47.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.295+0000 7f050d61b640 1 --2- 172.21.15.53:0/2147112998 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0508071060 0x7f050815c540 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f04f800c4d0 tx=0x7f04f800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:47.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.295+0000 7f04fe7fc640 1 -- 172.21.15.53:0/2147112998 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f8005cf0 con 0x7f0508071060 2023-06-10T19:01:47.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.295+0000 7f04fe7fc640 1 -- 172.21.15.53:0/2147112998 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04f8005e50 con 0x7f0508071060 2023-06-10T19:01:47.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.295+0000 7f0510080640 1 -- 172.21.15.53:0/2147112998 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f050815d550 con 0x7f0508071060 2023-06-10T19:01:47.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.295+0000 7f04fe7fc640 1 -- 172.21.15.53:0/2147112998 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f8007270 con 0x7f0508071060 2023-06-10T19:01:47.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.295+0000 7f0510080640 1 -- 172.21.15.53:0/2147112998 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05080b0b60 con 0x7f0508071060 2023-06-10T19:01:47.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.299+0000 7f0510080640 1 -- 172.21.15.53:0/2147112998 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05080b0e10 con 0x7f0508071060 2023-06-10T19:01:47.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.299+0000 7f04fe7fc640 1 -- 172.21.15.53:0/2147112998 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f04f80073d0 con 0x7f0508071060 2023-06-10T19:01:47.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.299+0000 7f04fe7fc640 1 --2- 172.21.15.53:0/2147112998 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f04ec066280 0x7f04ec068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:47.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.299+0000 7f04fe7fc640 1 -- 172.21.15.53:0/2147112998 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6191+0+0 (secure 0 0 0) 0x7f04f8083530 con 0x7f0508071060 2023-06-10T19:01:47.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.299+0000 7f050de1c640 1 --2- 172.21.15.53:0/2147112998 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f04ec066280 0x7f04ec068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:47.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.299+0000 7f050de1c640 1 --2- 172.21.15.53:0/2147112998 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f04ec066280 0x7f04ec068730 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f05040af000 tx=0x7f0504008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:47.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.303+0000 7f04fe7fc640 1 -- 172.21.15.53:0/2147112998 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f04f8050a50 con 0x7f0508071060 2023-06-10T19:01:47.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.459+0000 7f0510080640 1 -- 172.21.15.53:0/2147112998 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f05080b0e10 con 0x7f0508071060 2023-06-10T19:01:47.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.459+0000 7f04fe7fc640 1 -- 172.21.15.53:0/2147112998 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+18529 (secure 0 0 0) 0x7f05080b0e10 con 0x7f0508071060 2023-06-10T19:01:47.466 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:01:47.466 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":82,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:01:38.982908+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-06-10T19:00:19.188303+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-06-10T19:00:19.583756+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.0.1:0/716140912":"2023-06-10T20:01:38.016422+0000","172.21.15.53:6835/882186121":"2023-06-11T19:00:42.868037+0000","172.21.15.53:6834/882186121":"2023-06-11T19:00:42.868037+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:01:47.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.463+0000 7f0510080640 1 -- 172.21.15.53:0/2147112998 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f04ec066280 msgr2=0x7f04ec068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:47.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.463+0000 7f0510080640 1 --2- 172.21.15.53:0/2147112998 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f04ec066280 0x7f04ec068730 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f05040af000 tx=0x7f0504008040 comp rx=0 tx=0).stop 2023-06-10T19:01:47.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.463+0000 7f0510080640 1 -- 172.21.15.53:0/2147112998 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0508071060 msgr2=0x7f050815c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:47.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.463+0000 7f0510080640 1 --2- 172.21.15.53:0/2147112998 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0508071060 0x7f050815c540 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f04f800c4d0 tx=0x7f04f800c990 comp rx=0 tx=0).stop 2023-06-10T19:01:47.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.463+0000 7f0510080640 1 -- 172.21.15.53:0/2147112998 shutdown_connections 2023-06-10T19:01:47.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.463+0000 7f0510080640 1 --2- 172.21.15.53:0/2147112998 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f04ec066280 0x7f04ec068730 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:47.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.463+0000 7f0510080640 1 --2- 172.21.15.53:0/2147112998 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05080c9840 0x7f0508157480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:47.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.463+0000 7f0510080640 1 --2- 172.21.15.53:0/2147112998 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0508071060 0x7f050815c540 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:47.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.463+0000 7f0510080640 1 --2- 172.21.15.53:0/2147112998 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f050806b090 0x7f05080b35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:47.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.463+0000 7f0510080640 1 -- 172.21.15.53:0/2147112998 >> 172.21.15.53:0/2147112998 conn(0x7f050806a0d0 msgr2=0x7f05080c8f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:47.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.463+0000 7f0510080640 1 -- 172.21.15.53:0/2147112998 shutdown_connections 2023-06-10T19:01:47.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.463+0000 7f0510080640 1 -- 172.21.15.53:0/2147112998 wait complete. 2023-06-10T19:01:47.485 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-10T18:52:33.633114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-10T18:52:39.171487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-10T19:00:19.188303+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2023-06-10T19:00:19.583756+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-10T19:01:47.486 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-10T19:01:47.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.607+0000 7f98606e0640 1 Processor -- start 2023-06-10T19:01:47.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.607+0000 7f98606e0640 1 -- start start 2023-06-10T19:01:47.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.611+0000 7f98606e0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f985815c090 0x7f98580b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:47.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.611+0000 7f98606e0640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f98580b0b90 0x7f98580b7720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:47.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.611+0000 7f98606e0640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98580cc7c0 con 0x7f98580b7c60 2023-06-10T19:01:47.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.611+0000 7f98606e0640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98580b80e0 con 0x7f98580b0b90 2023-06-10T19:01:47.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.611+0000 7f98606e0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98580ccaa0 con 0x7f985815c090 2023-06-10T19:01:47.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.611+0000 7f985ec7d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f98580b7c60 0x7f98580b3b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:57126/0 (socket says 172.21.15.53:57126) 2023-06-10T19:01:47.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.611+0000 7f985ec7d640 1 -- 172.21.15.53:0/3579533282 learned_addr learned my addr 172.21.15.53:0/3579533282 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:01:47.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.611+0000 7f985e47c640 1 --2- 172.21.15.53:0/3579533282 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f985815c090 0x7f98580b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:47.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.611+0000 7f985dc7b640 1 --2- 172.21.15.53:0/3579533282 >> v2:172.21.15.117:3300/0 conn(0x7f98580b0b90 0x7f98580b7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:47.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.611+0000 7f985d47a640 1 -- 172.21.15.53:0/3579533282 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4139571391 0 0) 0x7f98580cc7c0 con 0x7f98580b7c60 2023-06-10T19:01:47.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.611+0000 7f985d47a640 1 -- 172.21.15.53:0/3579533282 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9844003530 con 0x7f98580b7c60 2023-06-10T19:01:47.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.611+0000 7f985d47a640 1 -- 172.21.15.53:0/3579533282 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 439748606 0 0) 0x7f9844003530 con 0x7f98580b7c60 2023-06-10T19:01:47.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.611+0000 7f985d47a640 1 -- 172.21.15.53:0/3579533282 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f985815c090 msgr2=0x7f98580b10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:47.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.611+0000 7f985d47a640 1 --2- 172.21.15.53:0/3579533282 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f985815c090 0x7f98580b10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:47.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.611+0000 7f985d47a640 1 -- 172.21.15.53:0/3579533282 >> v2:172.21.15.117:3300/0 conn(0x7f98580b0b90 msgr2=0x7f98580b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:47.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.611+0000 7f985d47a640 1 --2- 172.21.15.53:0/3579533282 >> v2:172.21.15.117:3300/0 conn(0x7f98580b0b90 0x7f98580b7720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:47.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.611+0000 7f985d47a640 1 -- 172.21.15.53:0/3579533282 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98580ccd80 con 0x7f98580b7c60 2023-06-10T19:01:47.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.611+0000 7f985d47a640 1 -- 172.21.15.53:0/3579533282 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f9850001a00 con 0x7f98580b7c60 2023-06-10T19:01:47.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.611+0000 7f985d47a640 1 -- 172.21.15.53:0/3579533282 >> v1:172.21.15.53:6789/0 conn(0x7f98580b7c60 legacy=0x7f98580b3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:47.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.611+0000 7f985d47a640 1 --2- 172.21.15.53:0/3579533282 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9844003980 0x7f9844003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:47.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.611+0000 7f985d47a640 1 --2- 172.21.15.53:0/3579533282 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98440043b0 0x7f9844004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:47.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.611+0000 7f985d47a640 1 --2- 172.21.15.53:0/3579533282 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f985815c090 0x7f9844004fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:47.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.611+0000 7f985d47a640 1 -- 172.21.15.53:0/3579533282 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98580b80e0 con 0x7f9844003980 2023-06-10T19:01:47.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.611+0000 7f985d47a640 1 -- 172.21.15.53:0/3579533282 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98580ccaa0 con 0x7f98440043b0 2023-06-10T19:01:47.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.611+0000 7f985d47a640 1 -- 172.21.15.53:0/3579533282 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f984400b990 con 0x7f985815c090 2023-06-10T19:01:47.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.611+0000 7f985e47c640 1 --2- 172.21.15.53:0/3579533282 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9844003980 0x7f9844003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:47.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.611+0000 7f985ec7d640 1 --2- 172.21.15.53:0/3579533282 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f985815c090 0x7f9844004fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:47.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.611+0000 7f985dc7b640 1 --2- 172.21.15.53:0/3579533282 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98440043b0 0x7f9844004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:47.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.611+0000 7f985e47c640 1 -- 172.21.15.53:0/3579533282 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f985815c090 msgr2=0x7f9844004fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:47.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.611+0000 7f985e47c640 1 --2- 172.21.15.53:0/3579533282 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f985815c090 0x7f9844004fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:47.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.611+0000 7f985e47c640 1 -- 172.21.15.53:0/3579533282 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98440043b0 msgr2=0x7f9844004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:47.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.611+0000 7f985e47c640 1 --2- 172.21.15.53:0/3579533282 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98440043b0 0x7f9844004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:47.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.611+0000 7f985e47c640 1 -- 172.21.15.53:0/3579533282 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9844003530 con 0x7f9844003980 2023-06-10T19:01:47.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.611+0000 7f985dc7b640 1 --2- 172.21.15.53:0/3579533282 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98440043b0 0x7f9844004870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:01:47.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.611+0000 7f985ec7d640 1 --2- 172.21.15.53:0/3579533282 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f985815c090 0x7f9844004fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:01:47.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.615+0000 7f985e47c640 1 --2- 172.21.15.53:0/3579533282 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9844003980 0x7f9844003d90 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f984c009b10 tx=0x7f984c01ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75574c2e9739918c server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:47.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.615+0000 7f985d47a640 1 -- 172.21.15.53:0/3579533282 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f984c0a6510 con 0x7f9844003980 2023-06-10T19:01:47.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.615+0000 7f985d47a640 1 -- 172.21.15.53:0/3579533282 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f984c0a6670 con 0x7f9844003980 2023-06-10T19:01:47.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.615+0000 7f985d47a640 1 -- 172.21.15.53:0/3579533282 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f984c0a6a20 con 0x7f9844003980 2023-06-10T19:01:47.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.615+0000 7f98606e0640 1 -- 172.21.15.53:0/3579533282 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9844003980 msgr2=0x7f9844003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:47.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.615+0000 7f98606e0640 1 --2- 172.21.15.53:0/3579533282 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9844003980 0x7f9844003d90 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f984c009b10 tx=0x7f984c01ca20 comp rx=0 tx=0).stop 2023-06-10T19:01:47.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.615+0000 7f985ec7d640 1 -- 172.21.15.53:0/3579533282 reap_dead start 2023-06-10T19:01:47.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.615+0000 7f98606e0640 1 -- 172.21.15.53:0/3579533282 shutdown_connections 2023-06-10T19:01:47.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.615+0000 7f98606e0640 1 -- 172.21.15.53:0/3579533282 >> 172.21.15.53:0/3579533282 conn(0x7f9858069e20 msgr2=0x7f985806a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:47.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.615+0000 7f98606e0640 1 -- 172.21.15.53:0/3579533282 shutdown_connections 2023-06-10T19:01:47.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.615+0000 7f98606e0640 1 -- 172.21.15.53:0/3579533282 wait complete. 2023-06-10T19:01:47.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.615+0000 7f98606e0640 1 Processor -- start 2023-06-10T19:01:47.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.615+0000 7f98606e0640 1 -- start start 2023-06-10T19:01:47.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.615+0000 7f98606e0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9844003980 0x7f9858145260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:47.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.615+0000 7f98606e0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9858148800 0x7f9858158e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:47.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.615+0000 7f98606e0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98580b6670 0x7f98580b6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:47.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.615+0000 7f98606e0640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98580b7020 con 0x7f98580b6670 2023-06-10T19:01:47.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.615+0000 7f98606e0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9858145c60 con 0x7f9858148800 2023-06-10T19:01:47.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.615+0000 7f98606e0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9858159770 con 0x7f9844003980 2023-06-10T19:01:47.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.615+0000 7f985ec7d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98580b6670 0x7f98580b6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:47.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.615+0000 7f985ec7d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98580b6670 0x7f98580b6ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48566/0 (socket says 172.21.15.53:48566) 2023-06-10T19:01:47.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.615+0000 7f985ec7d640 1 -- 172.21.15.53:0/3310982108 learned_addr learned my addr 172.21.15.53:0/3310982108 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:47.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.615+0000 7f985e47c640 1 --2- 172.21.15.53:0/3310982108 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9844003980 0x7f9858145260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:47.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.615+0000 7f985dc7b640 1 --2- 172.21.15.53:0/3310982108 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9858148800 0x7f9858158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:47.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.615+0000 7f985ec7d640 1 -- 172.21.15.53:0/3310982108 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9844003980 msgr2=0x7f9858145260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:47.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.615+0000 7f985ec7d640 1 --2- 172.21.15.53:0/3310982108 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9844003980 0x7f9858145260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:47.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.615+0000 7f985ec7d640 1 -- 172.21.15.53:0/3310982108 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9858148800 msgr2=0x7f9858158e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:47.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.615+0000 7f985ec7d640 1 --2- 172.21.15.53:0/3310982108 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9858148800 0x7f9858158e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:47.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.615+0000 7f985ec7d640 1 -- 172.21.15.53:0/3310982108 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9858159a50 con 0x7f98580b6670 2023-06-10T19:01:47.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.615+0000 7f985dc7b640 1 --2- 172.21.15.53:0/3310982108 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9858148800 0x7f9858158e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:01:47.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.615+0000 7f985ec7d640 1 --2- 172.21.15.53:0/3310982108 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98580b6670 0x7f98580b6ae0 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f985808a080 tx=0x7f985000dbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:47.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.615+0000 7f984affd640 1 -- 172.21.15.53:0/3310982108 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9850007070 con 0x7f98580b6670 2023-06-10T19:01:47.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.615+0000 7f984affd640 1 -- 172.21.15.53:0/3310982108 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98500071d0 con 0x7f98580b6670 2023-06-10T19:01:47.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.615+0000 7f984affd640 1 -- 172.21.15.53:0/3310982108 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9850007540 con 0x7f98580b6670 2023-06-10T19:01:47.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.615+0000 7f98606e0640 1 -- 172.21.15.53:0/3310982108 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9858159d30 con 0x7f98580b6670 2023-06-10T19:01:47.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.619+0000 7f98606e0640 1 -- 172.21.15.53:0/3310982108 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98581457a0 con 0x7f98580b6670 2023-06-10T19:01:47.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.619+0000 7f98606e0640 1 -- 172.21.15.53:0/3310982108 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f985804d790 con 0x7f98580b6670 2023-06-10T19:01:47.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.619+0000 7f984affd640 1 -- 172.21.15.53:0/3310982108 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f98500076a0 con 0x7f98580b6670 2023-06-10T19:01:47.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.619+0000 7f984affd640 1 --2- 172.21.15.53:0/3310982108 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f983c0662b0 0x7f983c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:47.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.619+0000 7f984affd640 1 -- 172.21.15.53:0/3310982108 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6191+0+0 (secure 0 0 0) 0x7f9850083230 con 0x7f98580b6670 2023-06-10T19:01:47.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.619+0000 7f985e47c640 1 --2- 172.21.15.53:0/3310982108 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f983c0662b0 0x7f983c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:47.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.619+0000 7f985e47c640 1 --2- 172.21.15.53:0/3310982108 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f983c0662b0 0x7f983c068760 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f984c0af000 tx=0x7f984c0046d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:47.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.623+0000 7f984affd640 1 -- 172.21.15.53:0/3310982108 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f98500506e0 con 0x7f98580b6670 2023-06-10T19:01:47.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.779+0000 7f98606e0640 1 -- 172.21.15.53:0/3310982108 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9858145da0 con 0x7f98580b6670 2023-06-10T19:01:47.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.779+0000 7f984affd640 1 -- 172.21.15.53:0/3310982108 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9850053d00 con 0x7f98580b6670 2023-06-10T19:01:47.786 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-06-10T19:01:47.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.783+0000 7f98606e0640 1 -- 172.21.15.53:0/3310982108 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f983c0662b0 msgr2=0x7f983c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:47.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.783+0000 7f98606e0640 1 --2- 172.21.15.53:0/3310982108 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f983c0662b0 0x7f983c068760 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f984c0af000 tx=0x7f984c0046d0 comp rx=0 tx=0).stop 2023-06-10T19:01:47.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.783+0000 7f98606e0640 1 -- 172.21.15.53:0/3310982108 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98580b6670 msgr2=0x7f98580b6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:47.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.783+0000 7f98606e0640 1 --2- 172.21.15.53:0/3310982108 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98580b6670 0x7f98580b6ae0 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f985808a080 tx=0x7f985000dbf0 comp rx=0 tx=0).stop 2023-06-10T19:01:47.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.783+0000 7f98606e0640 1 -- 172.21.15.53:0/3310982108 shutdown_connections 2023-06-10T19:01:47.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.783+0000 7f98606e0640 1 --2- 172.21.15.53:0/3310982108 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f983c0662b0 0x7f983c068760 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:47.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.783+0000 7f98606e0640 1 --2- 172.21.15.53:0/3310982108 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98580b6670 0x7f98580b6ae0 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:47.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.783+0000 7f98606e0640 1 --2- 172.21.15.53:0/3310982108 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9858148800 0x7f9858158e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:47.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.783+0000 7f98606e0640 1 --2- 172.21.15.53:0/3310982108 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9844003980 0x7f9858145260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:47.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.783+0000 7f98606e0640 1 -- 172.21.15.53:0/3310982108 >> 172.21.15.53:0/3310982108 conn(0x7f9858069e20 msgr2=0x7f98580d0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:47.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.783+0000 7f98606e0640 1 -- 172.21.15.53:0/3310982108 shutdown_connections 2023-06-10T19:01:47.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.783+0000 7f98606e0640 1 -- 172.21.15.53:0/3310982108 wait complete. 2023-06-10T19:01:47.805 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-10T19:01:47.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.931+0000 7f5febdde640 1 Processor -- start 2023-06-10T19:01:47.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.931+0000 7f5febdde640 1 -- start start 2023-06-10T19:01:47.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.931+0000 7f5febdde640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5fe415c090 0x7f5fe40b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:47.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.931+0000 7f5febdde640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5fe40b7e30 0x7f5fe40d04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:47.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.931+0000 7f5febdde640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fe40cc7c0 con 0x7f5fe40b0b90 2023-06-10T19:01:47.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.931+0000 7f5febdde640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fe40ccaa0 con 0x7f5fe415c090 2023-06-10T19:01:47.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.931+0000 7f5febdde640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fe40ccd80 con 0x7f5fe40b7e30 2023-06-10T19:01:47.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.931+0000 7f5fe9b7a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5fe415c090 0x7f5fe40b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:47.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.931+0000 7f5fe9379640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f5fe40b0b90 0x7f5fe40b7720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:57130/0 (socket says 172.21.15.53:57130) 2023-06-10T19:01:47.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.931+0000 7f5fe9379640 1 -- 172.21.15.53:0/3954692747 learned_addr learned my addr 172.21.15.53:0/3954692747 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:01:47.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.931+0000 7f5fea37b640 1 --2- 172.21.15.53:0/3954692747 >> v2:172.21.15.117:3300/0 conn(0x7f5fe40b7e30 0x7f5fe40d04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:47.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.931+0000 7f5fe9b7a640 1 -- 172.21.15.53:0/3954692747 >> v2:172.21.15.117:3300/0 conn(0x7f5fe40b7e30 msgr2=0x7f5fe40d04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:47.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.931+0000 7f5fe9b7a640 1 --2- 172.21.15.53:0/3954692747 >> v2:172.21.15.117:3300/0 conn(0x7f5fe40b7e30 0x7f5fe40d04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:47.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.931+0000 7f5fe9b7a640 1 -- 172.21.15.53:0/3954692747 >> v1:172.21.15.53:6789/0 conn(0x7f5fe40b0b90 legacy=0x7f5fe40b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:47.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.931+0000 7f5fe8b78640 1 -- 172.21.15.53:0/3954692747 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3471005004 0 0) 0x7f5fe40cc7c0 con 0x7f5fe40b0b90 2023-06-10T19:01:47.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.931+0000 7f5fe9b7a640 1 -- 172.21.15.53:0/3954692747 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fe40cd060 con 0x7f5fe415c090 2023-06-10T19:01:47.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.935+0000 7f5fe9b7a640 1 --2- 172.21.15.53:0/3954692747 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5fe415c090 0x7f5fe40b10c0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f5fe406b200 tx=0x7f5fe001c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b1b1c391549adb5 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:47.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.935+0000 7f5fe8b78640 1 -- 172.21.15.53:0/3954692747 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe00ab600 con 0x7f5fe415c090 2023-06-10T19:01:47.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.935+0000 7f5fe8b78640 1 -- 172.21.15.53:0/3954692747 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe00a7050 con 0x7f5fe415c090 2023-06-10T19:01:47.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.935+0000 7f5fe8b78640 1 -- 172.21.15.53:0/3954692747 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe00ab980 con 0x7f5fe415c090 2023-06-10T19:01:47.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.935+0000 7f5febdde640 1 -- 172.21.15.53:0/3954692747 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5fe415c090 msgr2=0x7f5fe40b10c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:47.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.935+0000 7f5febdde640 1 --2- 172.21.15.53:0/3954692747 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5fe415c090 0x7f5fe40b10c0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f5fe406b200 tx=0x7f5fe001c3a0 comp rx=0 tx=0).stop 2023-06-10T19:01:47.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.935+0000 7f5febdde640 1 -- 172.21.15.53:0/3954692747 shutdown_connections 2023-06-10T19:01:47.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.935+0000 7f5febdde640 1 --2- 172.21.15.53:0/3954692747 >> v2:172.21.15.117:3300/0 conn(0x7f5fe40b7e30 0x7f5fe40d04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:47.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.935+0000 7f5febdde640 1 --2- 172.21.15.53:0/3954692747 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5fe415c090 0x7f5fe40b10c0 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:47.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.935+0000 7f5febdde640 1 -- 172.21.15.53:0/3954692747 >> 172.21.15.53:0/3954692747 conn(0x7f5fe4069e20 msgr2=0x7f5fe406a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:47.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.935+0000 7f5febdde640 1 -- 172.21.15.53:0/3954692747 shutdown_connections 2023-06-10T19:01:47.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.935+0000 7f5febdde640 1 -- 172.21.15.53:0/3954692747 wait complete. 2023-06-10T19:01:47.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.935+0000 7f5febdde640 1 Processor -- start 2023-06-10T19:01:47.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.935+0000 7f5febdde640 1 -- start start 2023-06-10T19:01:47.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.935+0000 7f5febdde640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fe40b0b90 0x7f5fe4146ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:47.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.935+0000 7f5febdde640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fe40b7e30 0x7f5fe4147430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:47.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.935+0000 7f5febdde640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5fe415c090 0x7f5fe40b26d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:47.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.935+0000 7f5febdde640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe40c7380 con 0x7f5fe415c090 2023-06-10T19:01:47.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.935+0000 7f5febdde640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe40c7660 con 0x7f5fe40b0b90 2023-06-10T19:01:47.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.939+0000 7f5febdde640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe40b1ed0 con 0x7f5fe40b7e30 2023-06-10T19:01:47.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.939+0000 7f5fea37b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5fe415c090 0x7f5fe40b26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:47.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.939+0000 7f5fea37b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5fe415c090 0x7f5fe40b26d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48578/0 (socket says 172.21.15.53:48578) 2023-06-10T19:01:47.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.939+0000 7f5fea37b640 1 -- 172.21.15.53:0/503484945 learned_addr learned my addr 172.21.15.53:0/503484945 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:47.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.939+0000 7f5fe9b7a640 1 --2- 172.21.15.53:0/503484945 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fe40b0b90 0x7f5fe4146ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:47.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.939+0000 7f5fe9379640 1 --2- 172.21.15.53:0/503484945 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fe40b7e30 0x7f5fe4147430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:47.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.939+0000 7f5fea37b640 1 -- 172.21.15.53:0/503484945 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fe40b7e30 msgr2=0x7f5fe4147430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:47.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.939+0000 7f5fea37b640 1 --2- 172.21.15.53:0/503484945 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fe40b7e30 0x7f5fe4147430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:47.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.939+0000 7f5fea37b640 1 -- 172.21.15.53:0/503484945 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fe40b0b90 msgr2=0x7f5fe4146ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:47.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.939+0000 7f5fea37b640 1 --2- 172.21.15.53:0/503484945 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fe40b0b90 0x7f5fe4146ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:47.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.939+0000 7f5fea37b640 1 -- 172.21.15.53:0/503484945 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fe0009420 con 0x7f5fe415c090 2023-06-10T19:01:47.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.939+0000 7f5fea37b640 1 --2- 172.21.15.53:0/503484945 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5fe415c090 0x7f5fe40b26d0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc007e30 tx=0x7f5fdc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:47.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.939+0000 7f5fd67fc640 1 -- 172.21.15.53:0/503484945 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fdc014620 con 0x7f5fe415c090 2023-06-10T19:01:47.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.939+0000 7f5fd67fc640 1 -- 172.21.15.53:0/503484945 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fdc00ee90 con 0x7f5fe415c090 2023-06-10T19:01:47.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.939+0000 7f5febdde640 1 -- 172.21.15.53:0/503484945 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fe40b21b0 con 0x7f5fe415c090 2023-06-10T19:01:47.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.939+0000 7f5fd67fc640 1 -- 172.21.15.53:0/503484945 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fdc0149c0 con 0x7f5fe415c090 2023-06-10T19:01:47.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.939+0000 7f5febdde640 1 -- 172.21.15.53:0/503484945 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fe40cbba0 con 0x7f5fe415c090 2023-06-10T19:01:47.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.939+0000 7f5febdde640 1 -- 172.21.15.53:0/503484945 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fe40b23f0 con 0x7f5fe415c090 2023-06-10T19:01:47.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.939+0000 7f5fd67fc640 1 -- 172.21.15.53:0/503484945 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5fdc014b20 con 0x7f5fe415c090 2023-06-10T19:01:47.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.939+0000 7f5fd67fc640 1 --2- 172.21.15.53:0/503484945 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5fc80662b0 0x7f5fc8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:47.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.939+0000 7f5fd67fc640 1 -- 172.21.15.53:0/503484945 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6191+0+0 (secure 0 0 0) 0x7f5fdc0846f0 con 0x7f5fe415c090 2023-06-10T19:01:47.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.939+0000 7f5fe9b7a640 1 --2- 172.21.15.53:0/503484945 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5fc80662b0 0x7f5fc8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:47.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.943+0000 7f5fe9b7a640 1 --2- 172.21.15.53:0/503484945 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5fc80662b0 0x7f5fc8068760 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f5fe00ad000 tx=0x7f5fe00a4f90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:47.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:47.943+0000 7f5fd67fc640 1 -- 172.21.15.53:0/503484945 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5fe40b23f0 con 0x7f5fe415c090 2023-06-10T19:01:48.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.099+0000 7f5febdde640 1 -- 172.21.15.53:0/503484945 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5fe40b23f0 con 0x7f5fe415c090 2023-06-10T19:01:48.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.103+0000 7f5fd67fc640 1 -- 172.21.15.53:0/503484945 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v82) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5fe40b23f0 con 0x7f5fe415c090 2023-06-10T19:01:48.109 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-06-10T19:01:48.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.107+0000 7f5febdde640 1 -- 172.21.15.53:0/503484945 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5fc80662b0 msgr2=0x7f5fc8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:48.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.107+0000 7f5febdde640 1 --2- 172.21.15.53:0/503484945 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5fc80662b0 0x7f5fc8068760 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f5fe00ad000 tx=0x7f5fe00a4f90 comp rx=0 tx=0).stop 2023-06-10T19:01:48.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.107+0000 7f5febdde640 1 -- 172.21.15.53:0/503484945 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5fe415c090 msgr2=0x7f5fe40b26d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:48.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.107+0000 7f5febdde640 1 --2- 172.21.15.53:0/503484945 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5fe415c090 0x7f5fe40b26d0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc007e30 tx=0x7f5fdc00e4b0 comp rx=0 tx=0).stop 2023-06-10T19:01:48.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.107+0000 7f5febdde640 1 -- 172.21.15.53:0/503484945 shutdown_connections 2023-06-10T19:01:48.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.107+0000 7f5febdde640 1 --2- 172.21.15.53:0/503484945 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5fc80662b0 0x7f5fc8068760 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:48.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.107+0000 7f5febdde640 1 --2- 172.21.15.53:0/503484945 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5fe415c090 0x7f5fe40b26d0 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:48.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.107+0000 7f5febdde640 1 --2- 172.21.15.53:0/503484945 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fe40b7e30 0x7f5fe4147430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:48.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.107+0000 7f5febdde640 1 --2- 172.21.15.53:0/503484945 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fe40b0b90 0x7f5fe4146ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:48.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.107+0000 7f5febdde640 1 -- 172.21.15.53:0/503484945 >> 172.21.15.53:0/503484945 conn(0x7f5fe4069e20 msgr2=0x7f5fe4159140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:48.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.107+0000 7f5febdde640 1 -- 172.21.15.53:0/503484945 shutdown_connections 2023-06-10T19:01:48.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.107+0000 7f5febdde640 1 -- 172.21.15.53:0/503484945 wait complete. 2023-06-10T19:01:48.128 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-10T19:01:48.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.243+0000 7f4fa3016640 1 Processor -- start 2023-06-10T19:01:48.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.243+0000 7f4fa3016640 1 -- start start 2023-06-10T19:01:48.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.247+0000 7f4fa3016640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4f9c15eef0 0x7f4f9c070f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:48.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.247+0000 7f4fa3016640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4f9c15f570 0x7f4f9c0ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:48.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.247+0000 7f4fa3016640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f9c15f2c0 con 0x7f4f9c0ce990 2023-06-10T19:01:48.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.247+0000 7f4fa3016640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f9c15fdc0 con 0x7f4f9c15eef0 2023-06-10T19:01:48.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.247+0000 7f4fa3016640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f9c1600a0 con 0x7f4f9c15f570 2023-06-10T19:01:48.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.247+0000 7f4fa15b3640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f4f9c0ce990 0x7f4f9c069450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:57140/0 (socket says 172.21.15.53:57140) 2023-06-10T19:01:48.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.247+0000 7f4fa0db2640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4f9c15eef0 0x7f4f9c070f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:48.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.247+0000 7f4fa15b3640 1 -- 172.21.15.53:0/2182006900 learned_addr learned my addr 172.21.15.53:0/2182006900 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:01:48.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.247+0000 7f4f9bfff640 1 --2- 172.21.15.53:0/2182006900 >> v2:172.21.15.117:3300/0 conn(0x7f4f9c15f570 0x7f4f9c0ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:48.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.247+0000 7f4fa0db2640 1 -- 172.21.15.53:0/2182006900 >> v2:172.21.15.117:3300/0 conn(0x7f4f9c15f570 msgr2=0x7f4f9c0ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:48.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.247+0000 7f4fa0db2640 1 --2- 172.21.15.53:0/2182006900 >> v2:172.21.15.117:3300/0 conn(0x7f4f9c15f570 0x7f4f9c0ce450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:48.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.247+0000 7f4fa0db2640 1 -- 172.21.15.53:0/2182006900 >> v1:172.21.15.53:6789/0 conn(0x7f4f9c0ce990 legacy=0x7f4f9c069450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:48.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.247+0000 7f4f9b7fe640 1 -- 172.21.15.53:0/2182006900 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2484090566 0 0) 0x7f4f9c15f2c0 con 0x7f4f9c0ce990 2023-06-10T19:01:48.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.247+0000 7f4fa0db2640 1 -- 172.21.15.53:0/2182006900 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f9c160380 con 0x7f4f9c15eef0 2023-06-10T19:01:48.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.247+0000 7f4fa0db2640 1 --2- 172.21.15.53:0/2182006900 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f9c15eef0 0x7f4f9c070f80 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c070060 tx=0x7f4f9001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=505ee677cb5f5fba server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:48.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.247+0000 7f4f9b7fe640 1 -- 172.21.15.53:0/2182006900 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f900ab600 con 0x7f4f9c15eef0 2023-06-10T19:01:48.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.247+0000 7f4f9b7fe640 1 -- 172.21.15.53:0/2182006900 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f900a7050 con 0x7f4f9c15eef0 2023-06-10T19:01:48.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.247+0000 7f4f9b7fe640 1 -- 172.21.15.53:0/2182006900 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f900ab980 con 0x7f4f9c15eef0 2023-06-10T19:01:48.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.251+0000 7f4fa3016640 1 -- 172.21.15.53:0/2182006900 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f9c15eef0 msgr2=0x7f4f9c070f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:48.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.251+0000 7f4fa3016640 1 --2- 172.21.15.53:0/2182006900 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f9c15eef0 0x7f4f9c070f80 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c070060 tx=0x7f4f9001c460 comp rx=0 tx=0).stop 2023-06-10T19:01:48.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.251+0000 7f4fa3016640 1 -- 172.21.15.53:0/2182006900 shutdown_connections 2023-06-10T19:01:48.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.251+0000 7f4fa3016640 1 --2- 172.21.15.53:0/2182006900 >> v2:172.21.15.117:3300/0 conn(0x7f4f9c15f570 0x7f4f9c0ce450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:48.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.251+0000 7f4fa3016640 1 --2- 172.21.15.53:0/2182006900 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f9c15eef0 0x7f4f9c070f80 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:48.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.251+0000 7f4fa3016640 1 -- 172.21.15.53:0/2182006900 >> 172.21.15.53:0/2182006900 conn(0x7f4f9c06a560 msgr2=0x7f4f9c06a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:48.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.251+0000 7f4fa3016640 1 -- 172.21.15.53:0/2182006900 shutdown_connections 2023-06-10T19:01:48.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.251+0000 7f4fa3016640 1 -- 172.21.15.53:0/2182006900 wait complete. 2023-06-10T19:01:48.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.251+0000 7f4fa3016640 1 Processor -- start 2023-06-10T19:01:48.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.251+0000 7f4fa3016640 1 -- start start 2023-06-10T19:01:48.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.251+0000 7f4fa3016640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f9c0ce990 0x7f4f9c0c28e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:48.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.251+0000 7f4fa3016640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f9c15eef0 0x7f4f9c0b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:48.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.251+0000 7f4fa3016640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f9c15f570 0x7f4f9c0c5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:48.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.251+0000 7f4fa3016640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9c0b2ae0 con 0x7f4f9c0ce990 2023-06-10T19:01:48.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.251+0000 7f4fa3016640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9c0c5640 con 0x7f4f9c15f570 2023-06-10T19:01:48.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.251+0000 7f4fa3016640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9c154720 con 0x7f4f9c15eef0 2023-06-10T19:01:48.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.251+0000 7f4fa0db2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f9c0ce990 0x7f4f9c0c28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:48.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.251+0000 7f4fa0db2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f9c0ce990 0x7f4f9c0c28e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48592/0 (socket says 172.21.15.53:48592) 2023-06-10T19:01:48.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.251+0000 7f4fa0db2640 1 -- 172.21.15.53:0/2421955976 learned_addr learned my addr 172.21.15.53:0/2421955976 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:48.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.251+0000 7f4f9bfff640 1 --2- 172.21.15.53:0/2421955976 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f9c15eef0 0x7f4f9c0b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:48.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.251+0000 7f4fa0db2640 1 -- 172.21.15.53:0/2421955976 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f9c15eef0 msgr2=0x7f4f9c0b25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:48.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.251+0000 7f4fa0db2640 1 --2- 172.21.15.53:0/2421955976 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f9c15eef0 0x7f4f9c0b25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:48.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.251+0000 7f4fa0db2640 1 -- 172.21.15.53:0/2421955976 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f9c15f570 msgr2=0x7f4f9c0c5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:48.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.251+0000 7f4fa0db2640 1 --2- 172.21.15.53:0/2421955976 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f9c15f570 0x7f4f9c0c5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:48.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.251+0000 7f4fa0db2640 1 -- 172.21.15.53:0/2421955976 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f90009420 con 0x7f4f9c0ce990 2023-06-10T19:01:48.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.251+0000 7f4f9bfff640 1 --2- 172.21.15.53:0/2421955976 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f9c15eef0 0x7f4f9c0b25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:01:48.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.251+0000 7f4fa0db2640 1 --2- 172.21.15.53:0/2421955976 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f9c0ce990 0x7f4f9c0c28e0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f4f900ae040 tx=0x7f4f90019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:48.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.251+0000 7f4f997fa640 1 -- 172.21.15.53:0/2421955976 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f900b4610 con 0x7f4f9c0ce990 2023-06-10T19:01:48.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.251+0000 7f4f997fa640 1 -- 172.21.15.53:0/2421955976 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f900b4770 con 0x7f4f9c0ce990 2023-06-10T19:01:48.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.251+0000 7f4fa3016640 1 -- 172.21.15.53:0/2421955976 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f9c154ce0 con 0x7f4f9c0ce990 2023-06-10T19:01:48.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.251+0000 7f4f997fa640 1 -- 172.21.15.53:0/2421955976 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f900b4b20 con 0x7f4f9c0ce990 2023-06-10T19:01:48.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.251+0000 7f4fa3016640 1 -- 172.21.15.53:0/2421955976 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f9c0b2fd0 con 0x7f4f9c0ce990 2023-06-10T19:01:48.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.255+0000 7f4fa3016640 1 -- 172.21.15.53:0/2421955976 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f9c04d790 con 0x7f4f9c0ce990 2023-06-10T19:01:48.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.255+0000 7f4f997fa640 1 -- 172.21.15.53:0/2421955976 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4f900b2040 con 0x7f4f9c0ce990 2023-06-10T19:01:48.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.255+0000 7f4f997fa640 1 --2- 172.21.15.53:0/2421955976 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4f800662b0 0x7f4f80068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:48.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.255+0000 7f4f997fa640 1 -- 172.21.15.53:0/2421955976 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6191+0+0 (secure 0 0 0) 0x7f4f9011dec0 con 0x7f4f9c0ce990 2023-06-10T19:01:48.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.255+0000 7f4f9bfff640 1 --2- 172.21.15.53:0/2421955976 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4f800662b0 0x7f4f80068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:48.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.255+0000 7f4f9bfff640 1 --2- 172.21.15.53:0/2421955976 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4f800662b0 0x7f4f80068760 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c1f73b0 tx=0x7f4f88008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:48.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.259+0000 7f4f997fa640 1 -- 172.21.15.53:0/2421955976 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4f900eb350 con 0x7f4f9c0ce990 2023-06-10T19:01:48.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.411+0000 7f4fa3016640 1 -- 172.21.15.53:0/2421955976 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4f9c156d70 con 0x7f4f9c0ce990 2023-06-10T19:01:48.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.411+0000 7f4f997fa640 1 -- 172.21.15.53:0/2421955976 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v82) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4f900c2020 con 0x7f4f9c0ce990 2023-06-10T19:01:48.417 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-06-10T19:01:48.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.415+0000 7f4fa3016640 1 -- 172.21.15.53:0/2421955976 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4f800662b0 msgr2=0x7f4f80068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:48.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.415+0000 7f4fa3016640 1 --2- 172.21.15.53:0/2421955976 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4f800662b0 0x7f4f80068760 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c1f73b0 tx=0x7f4f88008040 comp rx=0 tx=0).stop 2023-06-10T19:01:48.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.415+0000 7f4fa3016640 1 -- 172.21.15.53:0/2421955976 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f9c0ce990 msgr2=0x7f4f9c0c28e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:48.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.415+0000 7f4fa3016640 1 --2- 172.21.15.53:0/2421955976 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f9c0ce990 0x7f4f9c0c28e0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f4f900ae040 tx=0x7f4f90019200 comp rx=0 tx=0).stop 2023-06-10T19:01:48.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.415+0000 7f4fa3016640 1 -- 172.21.15.53:0/2421955976 shutdown_connections 2023-06-10T19:01:48.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.415+0000 7f4fa3016640 1 --2- 172.21.15.53:0/2421955976 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4f800662b0 0x7f4f80068760 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:48.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.415+0000 7f4fa3016640 1 --2- 172.21.15.53:0/2421955976 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f9c15f570 0x7f4f9c0c5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:48.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.415+0000 7f4fa3016640 1 --2- 172.21.15.53:0/2421955976 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4f9c15eef0 0x7f4f9c0b25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:48.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.415+0000 7f4fa3016640 1 --2- 172.21.15.53:0/2421955976 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f9c0ce990 0x7f4f9c0c28e0 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:48.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.415+0000 7f4fa3016640 1 -- 172.21.15.53:0/2421955976 >> 172.21.15.53:0/2421955976 conn(0x7f4f9c06a560 msgr2=0x7f4f9c15a390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:48.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.415+0000 7f4fa3016640 1 -- 172.21.15.53:0/2421955976 shutdown_connections 2023-06-10T19:01:48.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.415+0000 7f4fa3016640 1 -- 172.21.15.53:0/2421955976 wait complete. 2023-06-10T19:01:48.435 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-10T19:01:48.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.559+0000 7f7a63ba6640 1 Processor -- start 2023-06-10T19:01:48.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.559+0000 7f7a63ba6640 1 -- start start 2023-06-10T19:01:48.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.559+0000 7f7a63ba6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a5c159690 0x7f7a5c070950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:48.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.559+0000 7f7a63ba6640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7a5c0b0f30 0x7f7a5c0cbe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:48.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.559+0000 7f7a63ba6640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7a5c159a60 0x7f7a5c0c2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:48.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.559+0000 7f7a63ba6640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a5c070e90 con 0x7f7a5c159a60 2023-06-10T19:01:48.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.559+0000 7f7a63ba6640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a5c06d450 con 0x7f7a5c0b0f30 2023-06-10T19:01:48.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.559+0000 7f7a63ba6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5c0cb080 con 0x7f7a5c159690 2023-06-10T19:01:48.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.559+0000 7f7a62143640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7a5c159a60 0x7f7a5c0c2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:48.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.559+0000 7f7a62143640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7a5c159a60 0x7f7a5c0c2900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48596/0 (socket says 172.21.15.53:48596) 2023-06-10T19:01:48.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.559+0000 7f7a62143640 1 -- 172.21.15.53:0/2022476241 learned_addr learned my addr 172.21.15.53:0/2022476241 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:48.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.559+0000 7f7a61942640 1 --2- 172.21.15.53:0/2022476241 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a5c159690 0x7f7a5c070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:48.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.559+0000 7f7a61141640 1 --2- 172.21.15.53:0/2022476241 >> v2:172.21.15.117:3300/0 conn(0x7f7a5c0b0f30 0x7f7a5c0cbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:48.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.559+0000 7f7a62143640 1 -- 172.21.15.53:0/2022476241 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a5c159690 msgr2=0x7f7a5c070950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:48.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.559+0000 7f7a62143640 1 --2- 172.21.15.53:0/2022476241 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a5c159690 0x7f7a5c070950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:48.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.559+0000 7f7a62143640 1 -- 172.21.15.53:0/2022476241 >> v2:172.21.15.117:3300/0 conn(0x7f7a5c0b0f30 msgr2=0x7f7a5c0cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:48.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.559+0000 7f7a62143640 1 --2- 172.21.15.53:0/2022476241 >> v2:172.21.15.117:3300/0 conn(0x7f7a5c0b0f30 0x7f7a5c0cbe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:48.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.559+0000 7f7a62143640 1 -- 172.21.15.53:0/2022476241 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a5c0cb320 con 0x7f7a5c159a60 2023-06-10T19:01:48.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.559+0000 7f7a61141640 1 --2- 172.21.15.53:0/2022476241 >> v2:172.21.15.117:3300/0 conn(0x7f7a5c0b0f30 0x7f7a5c0cbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:01:48.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.563+0000 7f7a62143640 1 --2- 172.21.15.53:0/2022476241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a5c159a60 0x7f7a5c0c2900 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c06a530 tx=0x7f7a5401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd6547bc1300080c server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:48.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.563+0000 7f7a60940640 1 -- 172.21.15.53:0/2022476241 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a540a5730 con 0x7f7a5c159a60 2023-06-10T19:01:48.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.563+0000 7f7a60940640 1 -- 172.21.15.53:0/2022476241 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a540a5890 con 0x7f7a5c159a60 2023-06-10T19:01:48.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.563+0000 7f7a60940640 1 -- 172.21.15.53:0/2022476241 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a540a5c20 con 0x7f7a5c159a60 2023-06-10T19:01:48.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.563+0000 7f7a63ba6640 1 -- 172.21.15.53:0/2022476241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a5c159a60 msgr2=0x7f7a5c0c2900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:48.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.563+0000 7f7a63ba6640 1 --2- 172.21.15.53:0/2022476241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a5c159a60 0x7f7a5c0c2900 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c06a530 tx=0x7f7a5401c9a0 comp rx=0 tx=0).stop 2023-06-10T19:01:48.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.563+0000 7f7a63ba6640 1 -- 172.21.15.53:0/2022476241 shutdown_connections 2023-06-10T19:01:48.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.563+0000 7f7a63ba6640 1 --2- 172.21.15.53:0/2022476241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a5c159a60 0x7f7a5c0c2900 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:48.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.563+0000 7f7a63ba6640 1 --2- 172.21.15.53:0/2022476241 >> v2:172.21.15.117:3300/0 conn(0x7f7a5c0b0f30 0x7f7a5c0cbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:48.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.563+0000 7f7a63ba6640 1 --2- 172.21.15.53:0/2022476241 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a5c159690 0x7f7a5c070950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:48.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.563+0000 7f7a63ba6640 1 -- 172.21.15.53:0/2022476241 >> 172.21.15.53:0/2022476241 conn(0x7f7a5c06a560 msgr2=0x7f7a5c06a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:48.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.563+0000 7f7a63ba6640 1 -- 172.21.15.53:0/2022476241 shutdown_connections 2023-06-10T19:01:48.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.563+0000 7f7a63ba6640 1 -- 172.21.15.53:0/2022476241 wait complete. 2023-06-10T19:01:48.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.563+0000 7f7a63ba6640 1 Processor -- start 2023-06-10T19:01:48.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.563+0000 7f7a63ba6640 1 -- start start 2023-06-10T19:01:48.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.563+0000 7f7a63ba6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a5c0b0f30 0x7f7a5c14d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:48.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.563+0000 7f7a63ba6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a5c159690 0x7f7a5c1518f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:48.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.563+0000 7f7a63ba6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a5c159a60 0x7f7a5c153900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:48.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.563+0000 7f7a63ba6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5c14d860 con 0x7f7a5c0b0f30 2023-06-10T19:01:48.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.563+0000 7f7a63ba6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5c0af2f0 con 0x7f7a5c159690 2023-06-10T19:01:48.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.563+0000 7f7a63ba6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5c151e30 con 0x7f7a5c159a60 2023-06-10T19:01:48.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.563+0000 7f7a61942640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a5c0b0f30 0x7f7a5c14d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:48.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.563+0000 7f7a61942640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a5c0b0f30 0x7f7a5c14d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48602/0 (socket says 172.21.15.53:48602) 2023-06-10T19:01:48.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.567+0000 7f7a61942640 1 -- 172.21.15.53:0/432490390 learned_addr learned my addr 172.21.15.53:0/432490390 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:48.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.567+0000 7f7a62143640 1 --2- 172.21.15.53:0/432490390 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a5c159a60 0x7f7a5c153900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:48.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.567+0000 7f7a61141640 1 --2- 172.21.15.53:0/432490390 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a5c159690 0x7f7a5c1518f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:48.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.567+0000 7f7a61942640 1 -- 172.21.15.53:0/432490390 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a5c159a60 msgr2=0x7f7a5c153900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:48.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.567+0000 7f7a61942640 1 --2- 172.21.15.53:0/432490390 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a5c159a60 0x7f7a5c153900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:48.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.567+0000 7f7a61942640 1 -- 172.21.15.53:0/432490390 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a5c159690 msgr2=0x7f7a5c1518f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:48.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.567+0000 7f7a61942640 1 --2- 172.21.15.53:0/432490390 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a5c159690 0x7f7a5c1518f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:48.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.567+0000 7f7a61942640 1 -- 172.21.15.53:0/432490390 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a54009b30 con 0x7f7a5c0b0f30 2023-06-10T19:01:48.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.567+0000 7f7a61141640 1 --2- 172.21.15.53:0/432490390 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a5c159690 0x7f7a5c1518f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:01:48.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.567+0000 7f7a61942640 1 --2- 172.21.15.53:0/432490390 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a5c0b0f30 0x7f7a5c14d320 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f7a5800d5f0 tx=0x7f7a5800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:48.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.567+0000 7f7a527fc640 1 -- 172.21.15.53:0/432490390 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a580125f0 con 0x7f7a5c0b0f30 2023-06-10T19:01:48.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.567+0000 7f7a527fc640 1 -- 172.21.15.53:0/432490390 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a58012750 con 0x7f7a5c0b0f30 2023-06-10T19:01:48.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.567+0000 7f7a63ba6640 1 -- 172.21.15.53:0/432490390 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a5c0af540 con 0x7f7a5c0b0f30 2023-06-10T19:01:48.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.567+0000 7f7a527fc640 1 -- 172.21.15.53:0/432490390 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a58012ae0 con 0x7f7a5c0b0f30 2023-06-10T19:01:48.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.567+0000 7f7a63ba6640 1 -- 172.21.15.53:0/432490390 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a5c0afb00 con 0x7f7a5c0b0f30 2023-06-10T19:01:48.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.567+0000 7f7a63ba6640 1 -- 172.21.15.53:0/432490390 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a5c04d790 con 0x7f7a5c0b0f30 2023-06-10T19:01:48.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.567+0000 7f7a527fc640 1 -- 172.21.15.53:0/432490390 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7a58012c40 con 0x7f7a5c0b0f30 2023-06-10T19:01:48.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.567+0000 7f7a527fc640 1 --2- 172.21.15.53:0/432490390 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7a40066280 0x7f7a40068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:48.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.567+0000 7f7a527fc640 1 -- 172.21.15.53:0/432490390 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6191+0+0 (secure 0 0 0) 0x7f7a580841f0 con 0x7f7a5c0b0f30 2023-06-10T19:01:48.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.567+0000 7f7a61141640 1 --2- 172.21.15.53:0/432490390 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7a40066280 0x7f7a40068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:48.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.571+0000 7f7a61141640 1 --2- 172.21.15.53:0/432490390 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7a40066280 0x7f7a40068730 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c1535f0 tx=0x7f7a4c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:48.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.571+0000 7f7a527fc640 1 -- 172.21.15.53:0/432490390 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7a58051550 con 0x7f7a5c0b0f30 2023-06-10T19:01:48.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.727+0000 7f7a63ba6640 1 -- 172.21.15.53:0/432490390 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7a5c155cc0 con 0x7f7a5c0b0f30 2023-06-10T19:01:48.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.727+0000 7f7a527fc640 1 -- 172.21.15.53:0/432490390 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v82) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7a58007380 con 0x7f7a5c0b0f30 2023-06-10T19:01:48.735 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-06-10T19:01:48.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.731+0000 7f7a63ba6640 1 -- 172.21.15.53:0/432490390 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7a40066280 msgr2=0x7f7a40068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:48.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.731+0000 7f7a63ba6640 1 --2- 172.21.15.53:0/432490390 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7a40066280 0x7f7a40068730 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c1535f0 tx=0x7f7a4c008040 comp rx=0 tx=0).stop 2023-06-10T19:01:48.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.731+0000 7f7a63ba6640 1 -- 172.21.15.53:0/432490390 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a5c0b0f30 msgr2=0x7f7a5c14d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:48.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.731+0000 7f7a63ba6640 1 --2- 172.21.15.53:0/432490390 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a5c0b0f30 0x7f7a5c14d320 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f7a5800d5f0 tx=0x7f7a5800dab0 comp rx=0 tx=0).stop 2023-06-10T19:01:48.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.731+0000 7f7a63ba6640 1 -- 172.21.15.53:0/432490390 shutdown_connections 2023-06-10T19:01:48.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.731+0000 7f7a63ba6640 1 --2- 172.21.15.53:0/432490390 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7a40066280 0x7f7a40068730 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:48.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.731+0000 7f7a63ba6640 1 --2- 172.21.15.53:0/432490390 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7a5c159a60 0x7f7a5c153900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:48.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.731+0000 7f7a63ba6640 1 --2- 172.21.15.53:0/432490390 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a5c159690 0x7f7a5c1518f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:48.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.731+0000 7f7a63ba6640 1 --2- 172.21.15.53:0/432490390 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a5c0b0f30 0x7f7a5c14d320 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:48.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.731+0000 7f7a63ba6640 1 -- 172.21.15.53:0/432490390 >> 172.21.15.53:0/432490390 conn(0x7f7a5c06a560 msgr2=0x7f7a5c06a930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:48.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.731+0000 7f7a63ba6640 1 -- 172.21.15.53:0/432490390 shutdown_connections 2023-06-10T19:01:48.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.731+0000 7f7a63ba6640 1 -- 172.21.15.53:0/432490390 wait complete. 2023-06-10T19:01:48.752 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:01:48.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.863+0000 7f88d0490640 1 Processor -- start 2023-06-10T19:01:48.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.863+0000 7f88d0490640 1 -- start start 2023-06-10T19:01:48.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.863+0000 7f88d0490640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f88c80af720 0x7f88c8070e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:48.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.867+0000 7f88d0490640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88c80afba0 con 0x7f88c80b3390 2023-06-10T19:01:48.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.867+0000 7f88d0490640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88c80b3760 con 0x7f88c806b090 2023-06-10T19:01:48.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.867+0000 7f88d0490640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88c80c82f0 con 0x7f88c80af720 2023-06-10T19:01:48.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.867+0000 7f88cda2b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f88c80af720 0x7f88c8070e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:48.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.867+0000 7f88cda2b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f88c80af720 0x7f88c8070e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48610/0 (socket says 172.21.15.53:48610) 2023-06-10T19:01:48.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.867+0000 7f88cda2b640 1 -- 172.21.15.53:0/3324645271 learned_addr learned my addr 172.21.15.53:0/3324645271 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:48.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.867+0000 7f88cda2b640 1 -- 172.21.15.53:0/3324645271 >> v1:172.21.15.117:6789/0 conn(0x7f88c806b090 legacy=0x7f88c80c9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:48.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.867+0000 7f88cda2b640 1 -- 172.21.15.53:0/3324645271 >> v1:172.21.15.53:6789/0 conn(0x7f88c80b3390 legacy=0x7f88c80c8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:48.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.867+0000 7f88cd22a640 1 -- 172.21.15.53:0/3324645271 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3096968399 0 0) 0x7f88c80afba0 con 0x7f88c80b3390 2023-06-10T19:01:48.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.867+0000 7f88cda2b640 1 -- 172.21.15.53:0/3324645271 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c80afe20 con 0x7f88c80af720 2023-06-10T19:01:48.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.867+0000 7f88cda2b640 1 --2- 172.21.15.53:0/3324645271 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88c80af720 0x7f88c8070e30 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f88b8009870 tx=0x7f88b801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c891577959c99232 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:48.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.867+0000 7f88cd22a640 1 -- 172.21.15.53:0/3324645271 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b80ab5f0 con 0x7f88c80af720 2023-06-10T19:01:48.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.867+0000 7f88cd22a640 1 -- 172.21.15.53:0/3324645271 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88b80ab750 con 0x7f88c80af720 2023-06-10T19:01:48.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.867+0000 7f88cd22a640 1 -- 172.21.15.53:0/3324645271 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b80abae0 con 0x7f88c80af720 2023-06-10T19:01:48.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.867+0000 7f88d0490640 1 -- 172.21.15.53:0/3324645271 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88c80af720 msgr2=0x7f88c8070e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:48.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.867+0000 7f88d0490640 1 --2- 172.21.15.53:0/3324645271 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88c80af720 0x7f88c8070e30 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f88b8009870 tx=0x7f88b801c500 comp rx=0 tx=0).stop 2023-06-10T19:01:48.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.867+0000 7f88d0490640 1 -- 172.21.15.53:0/3324645271 shutdown_connections 2023-06-10T19:01:48.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.867+0000 7f88d0490640 1 --2- 172.21.15.53:0/3324645271 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88c80af720 0x7f88c8070e30 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:48.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.867+0000 7f88d0490640 1 -- 172.21.15.53:0/3324645271 >> 172.21.15.53:0/3324645271 conn(0x7f88c806a0d0 msgr2=0x7f88c80ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:48.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.867+0000 7f88d0490640 1 -- 172.21.15.53:0/3324645271 shutdown_connections 2023-06-10T19:01:48.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.867+0000 7f88d0490640 1 -- 172.21.15.53:0/3324645271 wait complete. 2023-06-10T19:01:48.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.871+0000 7f88d0490640 1 Processor -- start 2023-06-10T19:01:48.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.871+0000 7f88d0490640 1 -- start start 2023-06-10T19:01:48.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.871+0000 7f88d0490640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88c806b090 0x7f88c814c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:48.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.871+0000 7f88d0490640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88c80af720 0x7f88c8150430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:48.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.871+0000 7f88d0490640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88c80b3390 0x7f88c813ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:48.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.871+0000 7f88d0490640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c814ffa0 con 0x7f88c80af720 2023-06-10T19:01:48.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.871+0000 7f88d0490640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c814f390 con 0x7f88c806b090 2023-06-10T19:01:48.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.871+0000 7f88d0490640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88c814f670 con 0x7f88c80b3390 2023-06-10T19:01:48.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.871+0000 7f88cda2b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88c80af720 0x7f88c8150430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:48.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.871+0000 7f88cda2b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88c80af720 0x7f88c8150430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48612/0 (socket says 172.21.15.53:48612) 2023-06-10T19:01:48.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.871+0000 7f88cda2b640 1 -- 172.21.15.53:0/189973721 learned_addr learned my addr 172.21.15.53:0/189973721 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:48.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.871+0000 7f88cea2d640 1 --2- 172.21.15.53:0/189973721 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88c80b3390 0x7f88c813ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:48.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.871+0000 7f88cda2b640 1 -- 172.21.15.53:0/189973721 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88c80b3390 msgr2=0x7f88c813ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:48.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.871+0000 7f88cda2b640 1 --2- 172.21.15.53:0/189973721 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88c80b3390 0x7f88c813ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:48.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.871+0000 7f88cda2b640 1 -- 172.21.15.53:0/189973721 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88c806b090 msgr2=0x7f88c814c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:48.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.871+0000 7f88cda2b640 1 --2- 172.21.15.53:0/189973721 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88c806b090 0x7f88c814c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:48.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.871+0000 7f88cda2b640 1 -- 172.21.15.53:0/189973721 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b80094d0 con 0x7f88c80af720 2023-06-10T19:01:48.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.871+0000 7f88cea2d640 1 --2- 172.21.15.53:0/189973721 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88c80b3390 0x7f88c813ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:01:48.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.871+0000 7f88cda2b640 1 --2- 172.21.15.53:0/189973721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88c80af720 0x7f88c8150430 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f88b80ad040 tx=0x7f88b801ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:48.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.871+0000 7f88beffd640 1 -- 172.21.15.53:0/189973721 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b80abcd0 con 0x7f88c80af720 2023-06-10T19:01:48.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.871+0000 7f88beffd640 1 -- 172.21.15.53:0/189973721 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88b80b8070 con 0x7f88c80af720 2023-06-10T19:01:48.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.871+0000 7f88d0490640 1 -- 172.21.15.53:0/189973721 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88c814f950 con 0x7f88c80af720 2023-06-10T19:01:48.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.871+0000 7f88beffd640 1 -- 172.21.15.53:0/189973721 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b8004240 con 0x7f88c80af720 2023-06-10T19:01:48.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.871+0000 7f88d0490640 1 -- 172.21.15.53:0/189973721 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88c80c4530 con 0x7f88c80af720 2023-06-10T19:01:48.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.871+0000 7f88d0490640 1 -- 172.21.15.53:0/189973721 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88c804d790 con 0x7f88c80af720 2023-06-10T19:01:48.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.871+0000 7f88beffd640 1 -- 172.21.15.53:0/189973721 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f88b80043a0 con 0x7f88c80af720 2023-06-10T19:01:48.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.871+0000 7f88beffd640 1 --2- 172.21.15.53:0/189973721 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f88ac066280 0x7f88ac068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:48.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.871+0000 7f88beffd640 1 -- 172.21.15.53:0/189973721 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6191+0+0 (secure 0 0 0) 0x7f88b80a8050 con 0x7f88c80af720 2023-06-10T19:01:48.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.875+0000 7f88ce22c640 1 --2- 172.21.15.53:0/189973721 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f88ac066280 0x7f88ac068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:48.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.875+0000 7f88ce22c640 1 --2- 172.21.15.53:0/189973721 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f88ac066280 0x7f88ac068730 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f88c4007fd0 tx=0x7f88c4007920 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:48.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:48.875+0000 7f88beffd640 1 -- 172.21.15.53:0/189973721 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f88b80eb3d0 con 0x7f88c80af720 2023-06-10T19:01:49.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.059+0000 7f88d0490640 1 -- 172.21.15.53:0/189973721 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f88c80c87b0 con 0x7f88c80af720 2023-06-10T19:01:49.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.059+0000 7f88beffd640 1 -- 172.21.15.53:0/189973721 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4681 (secure 0 0 0) 0x7f88b80ba020 con 0x7f88c80af720 2023-06-10T19:01:49.065 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:01:49.065 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5663,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2600814414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2600814414},{"type":"v1","addr":"172.21.15.117:6835","nonce":2600814414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6136,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1615882017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1615882017},{"type":"v1","addr":"172.21.15.117:6837","nonce":1615882017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6993,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/3732245174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3732245174},{"type":"v1","addr":"172.21.15.53:6833","nonce":3732245174}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:00:20.607950+0000","modified":"2023-06-10T19:01:40.998259+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7266":{"gid":7266,"name":"c","rank":0,"incarnation":37,"state":"up:active","state_seq":17,"addr":"172.21.15.53:6835/2829993338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2829993338},{"type":"v1","addr":"172.21.15.53:6835","nonce":2829993338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-06-10T19:01:49.066 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 40 2023-06-10T19:01:49.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.059+0000 7f88d0490640 1 -- 172.21.15.53:0/189973721 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f88ac066280 msgr2=0x7f88ac068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:49.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.063+0000 7f88d0490640 1 --2- 172.21.15.53:0/189973721 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f88ac066280 0x7f88ac068730 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f88c4007fd0 tx=0x7f88c4007920 comp rx=0 tx=0).stop 2023-06-10T19:01:49.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.063+0000 7f88d0490640 1 -- 172.21.15.53:0/189973721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88c80af720 msgr2=0x7f88c8150430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:49.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.063+0000 7f88d0490640 1 --2- 172.21.15.53:0/189973721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88c80af720 0x7f88c8150430 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f88b80ad040 tx=0x7f88b801ad40 comp rx=0 tx=0).stop 2023-06-10T19:01:49.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.063+0000 7f88d0490640 1 -- 172.21.15.53:0/189973721 shutdown_connections 2023-06-10T19:01:49.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.063+0000 7f88d0490640 1 --2- 172.21.15.53:0/189973721 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f88ac066280 0x7f88ac068730 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:49.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.063+0000 7f88d0490640 1 --2- 172.21.15.53:0/189973721 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88c80b3390 0x7f88c813ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:49.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.063+0000 7f88d0490640 1 --2- 172.21.15.53:0/189973721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88c80af720 0x7f88c8150430 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:49.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.063+0000 7f88d0490640 1 --2- 172.21.15.53:0/189973721 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88c806b090 0x7f88c814c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:49.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.063+0000 7f88d0490640 1 -- 172.21.15.53:0/189973721 >> 172.21.15.53:0/189973721 conn(0x7f88c806a0d0 msgr2=0x7f88c80b0ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:49.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.063+0000 7f88d0490640 1 -- 172.21.15.53:0/189973721 shutdown_connections 2023-06-10T19:01:49.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.063+0000 7f88d0490640 1 -- 172.21.15.53:0/189973721 wait complete. 2023-06-10T19:01:49.083 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:01:49.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.199+0000 7f0aae651640 1 Processor -- start 2023-06-10T19:01:49.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.199+0000 7f0aae651640 1 -- start start 2023-06-10T19:01:49.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.199+0000 7f0aae651640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0aa8162640 0x7f0aa8164a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:49.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.199+0000 7f0aae651640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0aa8159b50 con 0x7f0aa8071060 2023-06-10T19:01:49.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.199+0000 7f0aae651640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0aa80702a0 con 0x7f0aa80c9840 2023-06-10T19:01:49.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.199+0000 7f0aae651640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0aa8070580 con 0x7f0aa8162640 2023-06-10T19:01:49.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.199+0000 7f0aacbee640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0aa8162640 0x7f0aa8164a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:49.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.199+0000 7f0aa77fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f0aa8071060 0x7f0aa80af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:57152/0 (socket says 172.21.15.53:57152) 2023-06-10T19:01:49.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.199+0000 7f0aacbee640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0aa8162640 0x7f0aa8164a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48620/0 (socket says 172.21.15.53:48620) 2023-06-10T19:01:49.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.199+0000 7f0aa77fe640 1 -- 172.21.15.53:0/734032820 learned_addr learned my addr 172.21.15.53:0/734032820 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:01:49.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.199+0000 7f0aacbee640 1 -- 172.21.15.53:0/734032820 >> v1:172.21.15.117:6789/0 conn(0x7f0aa80c9840 legacy=0x7f0aa80c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:49.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.199+0000 7f0aacbee640 1 -- 172.21.15.53:0/734032820 >> v1:172.21.15.53:6789/0 conn(0x7f0aa8071060 legacy=0x7f0aa80af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:49.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.199+0000 7f0aa6ffd640 1 -- 172.21.15.53:0/734032820 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3556796576 0 0) 0x7f0aa8159b50 con 0x7f0aa8071060 2023-06-10T19:01:49.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.199+0000 7f0aacbee640 1 -- 172.21.15.53:0/734032820 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aa8070860 con 0x7f0aa8162640 2023-06-10T19:01:49.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.199+0000 7f0aacbee640 1 --2- 172.21.15.53:0/734032820 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0aa8162640 0x7f0aa8164a20 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f0aa0009d90 tx=0x7f0aa001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86840fdb764c3d79 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:49.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.203+0000 7f0aa6ffd640 1 -- 172.21.15.53:0/734032820 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa00a59c0 con 0x7f0aa8162640 2023-06-10T19:01:49.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.203+0000 7f0aa6ffd640 1 -- 172.21.15.53:0/734032820 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aa00a5b20 con 0x7f0aa8162640 2023-06-10T19:01:49.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.203+0000 7f0aa6ffd640 1 -- 172.21.15.53:0/734032820 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa00ad440 con 0x7f0aa8162640 2023-06-10T19:01:49.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.203+0000 7f0aae651640 1 -- 172.21.15.53:0/734032820 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0aa8162640 msgr2=0x7f0aa8164a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:49.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.203+0000 7f0aae651640 1 --2- 172.21.15.53:0/734032820 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0aa8162640 0x7f0aa8164a20 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f0aa0009d90 tx=0x7f0aa001c8e0 comp rx=0 tx=0).stop 2023-06-10T19:01:49.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.203+0000 7f0aae651640 1 -- 172.21.15.53:0/734032820 shutdown_connections 2023-06-10T19:01:49.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.203+0000 7f0aae651640 1 --2- 172.21.15.53:0/734032820 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0aa8162640 0x7f0aa8164a20 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:49.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.203+0000 7f0aae651640 1 -- 172.21.15.53:0/734032820 >> 172.21.15.53:0/734032820 conn(0x7f0aa806a0d0 msgr2=0x7f0aa80ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:49.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.203+0000 7f0aae651640 1 -- 172.21.15.53:0/734032820 shutdown_connections 2023-06-10T19:01:49.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.203+0000 7f0aae651640 1 -- 172.21.15.53:0/734032820 wait complete. 2023-06-10T19:01:49.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.203+0000 7f0aae651640 1 Processor -- start 2023-06-10T19:01:49.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.203+0000 7f0aae651640 1 -- start start 2023-06-10T19:01:49.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.203+0000 7f0aae651640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0aa8071060 0x7f0aa81f7f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:49.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.203+0000 7f0aae651640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0aa80c9840 0x7f0aa80ace30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:49.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.203+0000 7f0aae651640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0aa8162640 0x7f0aa81581f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:49.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.203+0000 7f0aae651640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa80ad370 con 0x7f0aa80c9840 2023-06-10T19:01:49.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.203+0000 7f0aae651640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa81f4b70 con 0x7f0aa8071060 2023-06-10T19:01:49.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.203+0000 7f0aae651640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa81f4240 con 0x7f0aa8162640 2023-06-10T19:01:49.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.203+0000 7f0aa77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0aa80c9840 0x7f0aa80ace30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:49.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.203+0000 7f0aa77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0aa80c9840 0x7f0aa80ace30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48624/0 (socket says 172.21.15.53:48624) 2023-06-10T19:01:49.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.203+0000 7f0aa77fe640 1 -- 172.21.15.53:0/759332397 learned_addr learned my addr 172.21.15.53:0/759332397 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:49.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.203+0000 7f0aacbee640 1 --2- 172.21.15.53:0/759332397 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0aa8162640 0x7f0aa81581f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:49.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.203+0000 7f0aa7fff640 1 --2- 172.21.15.53:0/759332397 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0aa8071060 0x7f0aa81f7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:49.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.203+0000 7f0aa77fe640 1 -- 172.21.15.53:0/759332397 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0aa8162640 msgr2=0x7f0aa81581f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:49.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.203+0000 7f0aa77fe640 1 --2- 172.21.15.53:0/759332397 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0aa8162640 0x7f0aa81581f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:49.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.203+0000 7f0aa77fe640 1 -- 172.21.15.53:0/759332397 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0aa8071060 msgr2=0x7f0aa81f7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:49.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.203+0000 7f0aa77fe640 1 --2- 172.21.15.53:0/759332397 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0aa8071060 0x7f0aa81f7f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:49.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.203+0000 7f0aa77fe640 1 -- 172.21.15.53:0/759332397 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aa0009a70 con 0x7f0aa80c9840 2023-06-10T19:01:49.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.203+0000 7f0aa77fe640 1 --2- 172.21.15.53:0/759332397 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0aa80c9840 0x7f0aa80ace30 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c00c4b0 tx=0x7f0a9c00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:49.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.203+0000 7f0aa4ff9640 1 -- 172.21.15.53:0/759332397 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c0074e0 con 0x7f0aa80c9840 2023-06-10T19:01:49.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.203+0000 7f0aa4ff9640 1 -- 172.21.15.53:0/759332397 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a9c007660 con 0x7f0aa80c9840 2023-06-10T19:01:49.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.203+0000 7f0aae651640 1 -- 172.21.15.53:0/759332397 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0aa81f4520 con 0x7f0aa80c9840 2023-06-10T19:01:49.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.203+0000 7f0aa4ff9640 1 -- 172.21.15.53:0/759332397 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c004a30 con 0x7f0aa80c9840 2023-06-10T19:01:49.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.203+0000 7f0aae651640 1 -- 172.21.15.53:0/759332397 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0aa8151a30 con 0x7f0aa80c9840 2023-06-10T19:01:49.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.207+0000 7f0aae651640 1 -- 172.21.15.53:0/759332397 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0aa81f4ce0 con 0x7f0aa80c9840 2023-06-10T19:01:49.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.207+0000 7f0aa4ff9640 1 -- 172.21.15.53:0/759332397 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0a9c004b90 con 0x7f0aa80c9840 2023-06-10T19:01:49.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.207+0000 7f0aa4ff9640 1 --2- 172.21.15.53:0/759332397 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0a94066280 0x7f0a94068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:49.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.207+0000 7f0aa4ff9640 1 -- 172.21.15.53:0/759332397 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6191+0+0 (secure 0 0 0) 0x7f0a9c083250 con 0x7f0aa80c9840 2023-06-10T19:01:49.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.207+0000 7f0aa7fff640 1 --2- 172.21.15.53:0/759332397 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0a94066280 0x7f0a94068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:49.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.207+0000 7f0aa7fff640 1 --2- 172.21.15.53:0/759332397 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0a94066280 0x7f0a94068730 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f0aa80cda50 tx=0x7f0a98009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:49.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.211+0000 7f0aa4ff9640 1 -- 172.21.15.53:0/759332397 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0a9c0507a0 con 0x7f0aa80c9840 2023-06-10T19:01:49.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.367+0000 7f0aae651640 1 -- 172.21.15.53:0/759332397 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0aa804d790 con 0x7f0aa80c9840 2023-06-10T19:01:49.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.371+0000 7f0aa4ff9640 1 -- 172.21.15.53:0/759332397 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+18529 (secure 0 0 0) 0x7f0a9c053dc0 con 0x7f0aa80c9840 2023-06-10T19:01:49.376 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:01:49.376 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":82,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:01:38.982908+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-06-10T19:00:19.188303+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-06-10T19:00:19.583756+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.0.1:0/716140912":"2023-06-10T20:01:38.016422+0000","172.21.15.53:6835/882186121":"2023-06-11T19:00:42.868037+0000","172.21.15.53:6834/882186121":"2023-06-11T19:00:42.868037+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:01:49.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.371+0000 7f0aae651640 1 -- 172.21.15.53:0/759332397 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0a94066280 msgr2=0x7f0a94068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:49.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.371+0000 7f0aae651640 1 --2- 172.21.15.53:0/759332397 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0a94066280 0x7f0a94068730 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f0aa80cda50 tx=0x7f0a98009040 comp rx=0 tx=0).stop 2023-06-10T19:01:49.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.371+0000 7f0aae651640 1 -- 172.21.15.53:0/759332397 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0aa80c9840 msgr2=0x7f0aa80ace30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:49.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.371+0000 7f0aae651640 1 --2- 172.21.15.53:0/759332397 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0aa80c9840 0x7f0aa80ace30 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c00c4b0 tx=0x7f0a9c00c970 comp rx=0 tx=0).stop 2023-06-10T19:01:49.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.371+0000 7f0aae651640 1 -- 172.21.15.53:0/759332397 shutdown_connections 2023-06-10T19:01:49.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.371+0000 7f0aae651640 1 --2- 172.21.15.53:0/759332397 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0a94066280 0x7f0a94068730 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:49.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.371+0000 7f0aae651640 1 --2- 172.21.15.53:0/759332397 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0aa8162640 0x7f0aa81581f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:49.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.371+0000 7f0aae651640 1 --2- 172.21.15.53:0/759332397 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0aa80c9840 0x7f0aa80ace30 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:49.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.371+0000 7f0aae651640 1 --2- 172.21.15.53:0/759332397 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0aa8071060 0x7f0aa81f7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:49.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.371+0000 7f0aae651640 1 -- 172.21.15.53:0/759332397 >> 172.21.15.53:0/759332397 conn(0x7f0aa806a0d0 msgr2=0x7f0aa80cdc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:49.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.371+0000 7f0aae651640 1 -- 172.21.15.53:0/759332397 shutdown_connections 2023-06-10T19:01:49.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.371+0000 7f0aae651640 1 -- 172.21.15.53:0/759332397 wait complete. 2023-06-10T19:01:49.395 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-06-10T19:01:49.396 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:01:49.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.507+0000 7fd955dad640 1 Processor -- start 2023-06-10T19:01:49.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.507+0000 7fd955dad640 1 -- start start 2023-06-10T19:01:49.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.511+0000 7fd955dad640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd950071060 0x7fd9500af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:49.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.511+0000 7fd955dad640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd9500afc60 0x7fd95006b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:49.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.511+0000 7fd955dad640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd950159b50 con 0x7fd9500c9840 2023-06-10T19:01:49.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.511+0000 7fd955dad640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9500702a0 con 0x7fd950071060 2023-06-10T19:01:49.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.511+0000 7fd955dad640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd950070580 con 0x7fd9500afc60 2023-06-10T19:01:49.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.511+0000 7fd94ffff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd9500afc60 0x7fd95006b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:49.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.511+0000 7fd94effd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd950071060 0x7fd9500af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:49.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.511+0000 7fd94ffff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd9500afc60 0x7fd95006b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.53:58702/0 (socket says 172.21.15.53:58702) 2023-06-10T19:01:49.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.511+0000 7fd94ffff640 1 -- 172.21.15.53:0/119693745 learned_addr learned my addr 172.21.15.53:0/119693745 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:49.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.511+0000 7fd94ffff640 1 -- 172.21.15.53:0/119693745 >> v2:172.21.15.117:3300/0 conn(0x7fd950071060 msgr2=0x7fd9500af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:49.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.511+0000 7fd94ffff640 1 --2- 172.21.15.53:0/119693745 >> v2:172.21.15.117:3300/0 conn(0x7fd950071060 0x7fd9500af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:49.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.511+0000 7fd94ffff640 1 -- 172.21.15.53:0/119693745 >> v1:172.21.15.117:6789/0 conn(0x7fd9500c9840 legacy=0x7fd9500c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:49.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.511+0000 7fd94ffff640 1 -- 172.21.15.53:0/119693745 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd950070860 con 0x7fd9500afc60 2023-06-10T19:01:49.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.511+0000 7fd94e7fc640 1 -- 172.21.15.53:0/119693745 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1741771189 0 0) 0x7fd950159b50 con 0x7fd9500c9840 2023-06-10T19:01:49.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.511+0000 7fd94effd640 1 --2- 172.21.15.53:0/119693745 >> v2:172.21.15.117:3300/0 conn(0x7fd950071060 0x7fd9500af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-10T19:01:49.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.515+0000 7fd94ffff640 1 --2- 172.21.15.53:0/119693745 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd9500afc60 0x7fd95006b090 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd948009870 tx=0x7fd94801c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6499a855b5cc9db server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:49.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.515+0000 7fd94e7fc640 1 -- 172.21.15.53:0/119693745 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9480ab620 con 0x7fd9500afc60 2023-06-10T19:01:49.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.515+0000 7fd94e7fc640 1 -- 172.21.15.53:0/119693745 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9480ab780 con 0x7fd9500afc60 2023-06-10T19:01:49.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.515+0000 7fd94e7fc640 1 -- 172.21.15.53:0/119693745 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9480abb10 con 0x7fd9500afc60 2023-06-10T19:01:49.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.515+0000 7fd955dad640 1 -- 172.21.15.53:0/119693745 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd9500afc60 msgr2=0x7fd95006b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:49.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.515+0000 7fd955dad640 1 --2- 172.21.15.53:0/119693745 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd9500afc60 0x7fd95006b090 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd948009870 tx=0x7fd94801c510 comp rx=0 tx=0).stop 2023-06-10T19:01:49.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.515+0000 7fd955dad640 1 -- 172.21.15.53:0/119693745 shutdown_connections 2023-06-10T19:01:49.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.515+0000 7fd955dad640 1 --2- 172.21.15.53:0/119693745 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd9500afc60 0x7fd95006b090 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:49.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.515+0000 7fd955dad640 1 --2- 172.21.15.53:0/119693745 >> v2:172.21.15.117:3300/0 conn(0x7fd950071060 0x7fd9500af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:49.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.515+0000 7fd955dad640 1 -- 172.21.15.53:0/119693745 >> 172.21.15.53:0/119693745 conn(0x7fd95006a0d0 msgr2=0x7fd9500ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:49.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.515+0000 7fd955dad640 1 -- 172.21.15.53:0/119693745 shutdown_connections 2023-06-10T19:01:49.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.515+0000 7fd955dad640 1 -- 172.21.15.53:0/119693745 wait complete. 2023-06-10T19:01:49.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.515+0000 7fd955dad640 1 Processor -- start 2023-06-10T19:01:49.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.515+0000 7fd955dad640 1 -- start start 2023-06-10T19:01:49.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.515+0000 7fd955dad640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd950071060 0x7fd950154fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:49.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.515+0000 7fd955dad640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd9500afc60 0x7fd9500ad910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:49.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.515+0000 7fd955dad640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9500c9840 0x7fd9500ade50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:49.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.515+0000 7fd955dad640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9500c70c0 con 0x7fd9500c9840 2023-06-10T19:01:49.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.515+0000 7fd955dad640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9500c64b0 con 0x7fd950071060 2023-06-10T19:01:49.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.515+0000 7fd955dad640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9500c6790 con 0x7fd9500afc60 2023-06-10T19:01:49.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.515+0000 7fd94ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9500c9840 0x7fd9500ade50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:49.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.515+0000 7fd94ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9500c9840 0x7fd9500ade50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48626/0 (socket says 172.21.15.53:48626) 2023-06-10T19:01:49.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.515+0000 7fd94ffff640 1 -- 172.21.15.53:0/700937395 learned_addr learned my addr 172.21.15.53:0/700937395 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:49.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.515+0000 7fd94f7fe640 1 --2- 172.21.15.53:0/700937395 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd950071060 0x7fd950154fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:49.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.515+0000 7fd94effd640 1 --2- 172.21.15.53:0/700937395 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd9500afc60 0x7fd9500ad910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:49.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.515+0000 7fd94ffff640 1 -- 172.21.15.53:0/700937395 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd9500afc60 msgr2=0x7fd9500ad910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:49.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.515+0000 7fd94ffff640 1 --2- 172.21.15.53:0/700937395 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd9500afc60 0x7fd9500ad910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:49.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.515+0000 7fd94ffff640 1 -- 172.21.15.53:0/700937395 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd950071060 msgr2=0x7fd950154fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:49.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.515+0000 7fd94ffff640 1 --2- 172.21.15.53:0/700937395 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd950071060 0x7fd950154fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:49.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.519+0000 7fd94ffff640 1 -- 172.21.15.53:0/700937395 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd938009420 con 0x7fd9500c9840 2023-06-10T19:01:49.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.519+0000 7fd94f7fe640 1 --2- 172.21.15.53:0/700937395 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd950071060 0x7fd950154fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:01:49.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.519+0000 7fd94ffff640 1 --2- 172.21.15.53:0/700937395 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9500c9840 0x7fd9500ade50 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7fd9480ad040 tx=0x7fd94801ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:49.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.519+0000 7fd947fff640 1 -- 172.21.15.53:0/700937395 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9480abd00 con 0x7fd9500c9840 2023-06-10T19:01:49.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.519+0000 7fd955dad640 1 -- 172.21.15.53:0/700937395 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9480094d0 con 0x7fd9500c9840 2023-06-10T19:01:49.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.519+0000 7fd947fff640 1 -- 172.21.15.53:0/700937395 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9480b8070 con 0x7fd9500c9840 2023-06-10T19:01:49.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.519+0000 7fd947fff640 1 -- 172.21.15.53:0/700937395 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd948004220 con 0x7fd9500c9840 2023-06-10T19:01:49.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.519+0000 7fd955dad640 1 -- 172.21.15.53:0/700937395 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9500c6d50 con 0x7fd9500c9840 2023-06-10T19:01:49.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.519+0000 7fd955dad640 1 -- 172.21.15.53:0/700937395 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9500c7230 con 0x7fd9500c9840 2023-06-10T19:01:49.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.519+0000 7fd947fff640 1 -- 172.21.15.53:0/700937395 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd948004380 con 0x7fd9500c9840 2023-06-10T19:01:49.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.519+0000 7fd947fff640 1 --2- 172.21.15.53:0/700937395 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd9300662b0 0x7fd930068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:49.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.519+0000 7fd947fff640 1 -- 172.21.15.53:0/700937395 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6191+0+0 (secure 0 0 0) 0x7fd94811dfd0 con 0x7fd9500c9840 2023-06-10T19:01:49.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.519+0000 7fd94f7fe640 1 --2- 172.21.15.53:0/700937395 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd9300662b0 0x7fd930068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:49.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.519+0000 7fd94f7fe640 1 --2- 172.21.15.53:0/700937395 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd9300662b0 0x7fd930068760 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fd9400012f0 tx=0x7fd940009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:49.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.523+0000 7fd947fff640 1 -- 172.21.15.53:0/700937395 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd9480eb3e0 con 0x7fd9500c9840 2023-06-10T19:01:49.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.715+0000 7fd955dad640 1 -- 172.21.15.53:0/700937395 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd95004d790 con 0x7fd9500c9840 2023-06-10T19:01:49.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.715+0000 7fd947fff640 1 -- 172.21.15.53:0/700937395 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4681 (secure 0 0 0) 0x7fd9480abe60 con 0x7fd9500c9840 2023-06-10T19:01:49.721 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:01:49.721 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5663,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2600814414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2600814414},{"type":"v1","addr":"172.21.15.117:6835","nonce":2600814414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6136,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1615882017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1615882017},{"type":"v1","addr":"172.21.15.117:6837","nonce":1615882017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6993,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/3732245174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3732245174},{"type":"v1","addr":"172.21.15.53:6833","nonce":3732245174}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:00:20.607950+0000","modified":"2023-06-10T19:01:40.998259+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7266":{"gid":7266,"name":"c","rank":0,"incarnation":37,"state":"up:active","state_seq":17,"addr":"172.21.15.53:6835/2829993338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2829993338},{"type":"v1","addr":"172.21.15.53:6835","nonce":2829993338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-06-10T19:01:49.722 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 40 2023-06-10T19:01:49.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.715+0000 7fd955dad640 1 -- 172.21.15.53:0/700937395 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd9300662b0 msgr2=0x7fd930068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:49.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.715+0000 7fd955dad640 1 --2- 172.21.15.53:0/700937395 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd9300662b0 0x7fd930068760 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fd9400012f0 tx=0x7fd940009040 comp rx=0 tx=0).stop 2023-06-10T19:01:49.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.715+0000 7fd955dad640 1 -- 172.21.15.53:0/700937395 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9500c9840 msgr2=0x7fd9500ade50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:49.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.715+0000 7fd955dad640 1 --2- 172.21.15.53:0/700937395 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9500c9840 0x7fd9500ade50 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7fd9480ad040 tx=0x7fd94801ad50 comp rx=0 tx=0).stop 2023-06-10T19:01:49.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.715+0000 7fd955dad640 1 -- 172.21.15.53:0/700937395 shutdown_connections 2023-06-10T19:01:49.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.715+0000 7fd955dad640 1 --2- 172.21.15.53:0/700937395 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd9300662b0 0x7fd930068760 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:49.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.715+0000 7fd955dad640 1 --2- 172.21.15.53:0/700937395 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9500c9840 0x7fd9500ade50 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:49.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.715+0000 7fd955dad640 1 --2- 172.21.15.53:0/700937395 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd9500afc60 0x7fd9500ad910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:49.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.719+0000 7fd955dad640 1 --2- 172.21.15.53:0/700937395 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd950071060 0x7fd950154fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:49.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.719+0000 7fd955dad640 1 -- 172.21.15.53:0/700937395 >> 172.21.15.53:0/700937395 conn(0x7fd95006a0d0 msgr2=0x7fd9500aee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:49.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.719+0000 7fd955dad640 1 -- 172.21.15.53:0/700937395 shutdown_connections 2023-06-10T19:01:49.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.719+0000 7fd955dad640 1 -- 172.21.15.53:0/700937395 wait complete. 2023-06-10T19:01:49.740 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:01:49.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.855+0000 7f7c4d211640 1 Processor -- start 2023-06-10T19:01:49.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.855+0000 7f7c4d211640 1 -- start start 2023-06-10T19:01:49.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.855+0000 7f7c4d211640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7c480b3ac0 0x7f7c480b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:49.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.855+0000 7f7c4d211640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c480d0020 con 0x7f7c480cc690 2023-06-10T19:01:49.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.855+0000 7f7c4d211640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c48160190 con 0x7f7c480d14c0 2023-06-10T19:01:49.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.855+0000 7f7c4d211640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c480b43d0 con 0x7f7c480b3ac0 2023-06-10T19:01:49.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.855+0000 7f7c4659c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f7c480cc690 0x7f7c4815f370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:57154/0 (socket says 172.21.15.53:57154) 2023-06-10T19:01:49.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.855+0000 7f7c4659c640 1 -- 172.21.15.53:0/2177885750 learned_addr learned my addr 172.21.15.53:0/2177885750 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:01:49.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.855+0000 7f7c46d9d640 1 --2- 172.21.15.53:0/2177885750 >> v2:172.21.15.117:3300/0 conn(0x7f7c480b3ac0 0x7f7c480b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:49.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.855+0000 7f7c45d9b640 1 -- 172.21.15.53:0/2177885750 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1931220516 0 0) 0x7f7c480d0020 con 0x7f7c480cc690 2023-06-10T19:01:49.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.855+0000 7f7c45d9b640 1 -- 172.21.15.53:0/2177885750 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c30003530 con 0x7f7c480cc690 2023-06-10T19:01:49.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.855+0000 7f7c45d9b640 1 -- 172.21.15.53:0/2177885750 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3765575742 0 0) 0x7f7c30003530 con 0x7f7c480cc690 2023-06-10T19:01:49.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.855+0000 7f7c45d9b640 1 -- 172.21.15.53:0/2177885750 >> v2:172.21.15.117:3300/0 conn(0x7f7c480b3ac0 msgr2=0x7f7c480b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:49.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.855+0000 7f7c45d9b640 1 --2- 172.21.15.53:0/2177885750 >> v2:172.21.15.117:3300/0 conn(0x7f7c480b3ac0 0x7f7c480b3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:49.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.855+0000 7f7c45d9b640 1 -- 172.21.15.53:0/2177885750 >> v1:172.21.15.117:6789/0 conn(0x7f7c480d14c0 legacy=0x7f7c4815fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:49.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.855+0000 7f7c45d9b640 1 -- 172.21.15.53:0/2177885750 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c480cef40 con 0x7f7c480cc690 2023-06-10T19:01:49.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.855+0000 7f7c45d9b640 1 -- 172.21.15.53:0/2177885750 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f7c3c001680 con 0x7f7c480cc690 2023-06-10T19:01:49.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.855+0000 7f7c45d9b640 1 -- 172.21.15.53:0/2177885750 >> v1:172.21.15.53:6789/0 conn(0x7f7c480cc690 legacy=0x7f7c4815f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:49.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.855+0000 7f7c45d9b640 1 --2- 172.21.15.53:0/2177885750 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c300039f0 0x7f7c30003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:49.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.855+0000 7f7c45d9b640 1 --2- 172.21.15.53:0/2177885750 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c300047d0 0x7f7c30004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:49.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.855+0000 7f7c45d9b640 1 --2- 172.21.15.53:0/2177885750 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c30005180 0x7f7c3000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:49.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.855+0000 7f7c45d9b640 1 -- 172.21.15.53:0/2177885750 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c480b43d0 con 0x7f7c300039f0 2023-06-10T19:01:49.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.855+0000 7f7c45d9b640 1 -- 172.21.15.53:0/2177885750 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3000c060 con 0x7f7c300047d0 2023-06-10T19:01:49.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.855+0000 7f7c45d9b640 1 -- 172.21.15.53:0/2177885750 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3000c220 con 0x7f7c30005180 2023-06-10T19:01:49.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.855+0000 7f7c46d9d640 1 --2- 172.21.15.53:0/2177885750 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c300039f0 0x7f7c30003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:49.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.855+0000 7f7c4659c640 1 --2- 172.21.15.53:0/2177885750 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c300047d0 0x7f7c30004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:49.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.855+0000 7f7c4759e640 1 --2- 172.21.15.53:0/2177885750 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c30005180 0x7f7c3000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:49.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.855+0000 7f7c46d9d640 1 -- 172.21.15.53:0/2177885750 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c30005180 msgr2=0x7f7c3000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:49.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.855+0000 7f7c46d9d640 1 --2- 172.21.15.53:0/2177885750 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c30005180 0x7f7c3000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:49.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.855+0000 7f7c46d9d640 1 -- 172.21.15.53:0/2177885750 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c300047d0 msgr2=0x7f7c30004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:49.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.855+0000 7f7c46d9d640 1 --2- 172.21.15.53:0/2177885750 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c300047d0 0x7f7c30004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:49.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.855+0000 7f7c46d9d640 1 -- 172.21.15.53:0/2177885750 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c30003530 con 0x7f7c300039f0 2023-06-10T19:01:49.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.855+0000 7f7c4759e640 1 -- 172.21.15.53:0/2177885750 reap_dead start 2023-06-10T19:01:49.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.859+0000 7f7c46d9d640 1 --2- 172.21.15.53:0/2177885750 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c300039f0 0x7f7c30003e00 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f7c38009ae0 tx=0x7f7c3801ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b88cf9f6fcac70e4 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:49.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.859+0000 7f7c45d9b640 1 -- 172.21.15.53:0/2177885750 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c380a64e0 con 0x7f7c300039f0 2023-06-10T19:01:49.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.859+0000 7f7c45d9b640 1 -- 172.21.15.53:0/2177885750 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c380a6640 con 0x7f7c300039f0 2023-06-10T19:01:49.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.859+0000 7f7c45d9b640 1 -- 172.21.15.53:0/2177885750 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c380a69f0 con 0x7f7c300039f0 2023-06-10T19:01:49.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.859+0000 7f7c4d211640 1 -- 172.21.15.53:0/2177885750 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c300039f0 msgr2=0x7f7c30003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:49.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.859+0000 7f7c4d211640 1 --2- 172.21.15.53:0/2177885750 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c300039f0 0x7f7c30003e00 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f7c38009ae0 tx=0x7f7c3801ca20 comp rx=0 tx=0).stop 2023-06-10T19:01:49.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.859+0000 7f7c4d211640 1 -- 172.21.15.53:0/2177885750 shutdown_connections 2023-06-10T19:01:49.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.859+0000 7f7c4d211640 1 --2- 172.21.15.53:0/2177885750 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c300039f0 0x7f7c30003e00 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:49.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.859+0000 7f7c4d211640 1 -- 172.21.15.53:0/2177885750 >> 172.21.15.53:0/2177885750 conn(0x7f7c48071790 msgr2=0x7f7c48069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:49.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.859+0000 7f7c4d211640 1 -- 172.21.15.53:0/2177885750 shutdown_connections 2023-06-10T19:01:49.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.859+0000 7f7c4d211640 1 -- 172.21.15.53:0/2177885750 wait complete. 2023-06-10T19:01:49.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.859+0000 7f7c4d211640 1 Processor -- start 2023-06-10T19:01:49.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.859+0000 7f7c4d211640 1 -- start start 2023-06-10T19:01:49.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.859+0000 7f7c4d211640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c300039f0 0x7f7c4815be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:49.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.859+0000 7f7c4d211640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c48157400 0x7f7c480c4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:49.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.859+0000 7f7c4d211640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c48158a10 0x7f7c48158e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:49.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.859+0000 7f7c4d211640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c48158580 con 0x7f7c48157400 2023-06-10T19:01:49.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.859+0000 7f7c4d211640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4815c340 con 0x7f7c48158a10 2023-06-10T19:01:49.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.859+0000 7f7c4d211640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c48157970 con 0x7f7c300039f0 2023-06-10T19:01:49.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.859+0000 7f7c4659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c48157400 0x7f7c480c4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:49.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.859+0000 7f7c4659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c48157400 0x7f7c480c4c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48644/0 (socket says 172.21.15.53:48644) 2023-06-10T19:01:49.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.859+0000 7f7c4659c640 1 -- 172.21.15.53:0/690439499 learned_addr learned my addr 172.21.15.53:0/690439499 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:49.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.863+0000 7f7c4759e640 1 --2- 172.21.15.53:0/690439499 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c48158a10 0x7f7c48158e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:49.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.863+0000 7f7c46d9d640 1 --2- 172.21.15.53:0/690439499 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c300039f0 0x7f7c4815be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:49.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.863+0000 7f7c4659c640 1 -- 172.21.15.53:0/690439499 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c300039f0 msgr2=0x7f7c4815be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:49.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.863+0000 7f7c4659c640 1 --2- 172.21.15.53:0/690439499 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c300039f0 0x7f7c4815be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:49.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.863+0000 7f7c4659c640 1 -- 172.21.15.53:0/690439499 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c48158a10 msgr2=0x7f7c48158e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:49.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.863+0000 7f7c4659c640 1 --2- 172.21.15.53:0/690439499 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c48158a10 0x7f7c48158e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:49.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.863+0000 7f7c4659c640 1 -- 172.21.15.53:0/690439499 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c48157c50 con 0x7f7c48157400 2023-06-10T19:01:49.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.863+0000 7f7c4759e640 1 --2- 172.21.15.53:0/690439499 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c48158a10 0x7f7c48158e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:01:49.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.863+0000 7f7c4659c640 1 --2- 172.21.15.53:0/690439499 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c48157400 0x7f7c480c4c60 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c00e7e0 tx=0x7f7c3c00e8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:49.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.863+0000 7f7c2f7fe640 1 -- 172.21.15.53:0/690439499 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c014480 con 0x7f7c48157400 2023-06-10T19:01:49.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.863+0000 7f7c2f7fe640 1 -- 172.21.15.53:0/690439499 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c3c0145e0 con 0x7f7c48157400 2023-06-10T19:01:49.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.863+0000 7f7c4d211640 1 -- 172.21.15.53:0/690439499 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c48157f30 con 0x7f7c48157400 2023-06-10T19:01:49.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.863+0000 7f7c2f7fe640 1 -- 172.21.15.53:0/690439499 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c014990 con 0x7f7c48157400 2023-06-10T19:01:49.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.863+0000 7f7c4d211640 1 -- 172.21.15.53:0/690439499 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c48152d80 con 0x7f7c48157400 2023-06-10T19:01:49.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.863+0000 7f7c4d211640 1 -- 172.21.15.53:0/690439499 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c4804d790 con 0x7f7c48157400 2023-06-10T19:01:49.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.863+0000 7f7c2f7fe640 1 -- 172.21.15.53:0/690439499 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7c3c0114f0 con 0x7f7c48157400 2023-06-10T19:01:49.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.863+0000 7f7c2f7fe640 1 --2- 172.21.15.53:0/690439499 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7c34066280 0x7f7c34068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:49.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.863+0000 7f7c2f7fe640 1 -- 172.21.15.53:0/690439499 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6191+0+0 (secure 0 0 0) 0x7f7c3c0833f0 con 0x7f7c48157400 2023-06-10T19:01:49.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.863+0000 7f7c46d9d640 1 --2- 172.21.15.53:0/690439499 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7c34066280 0x7f7c34068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:49.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.863+0000 7f7c46d9d640 1 --2- 172.21.15.53:0/690439499 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7c34066280 0x7f7c34068730 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f7c380af000 tx=0x7f7c380046d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:49.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:49.867+0000 7f7c2f7fe640 1 -- 172.21.15.53:0/690439499 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7c3c050880 con 0x7f7c48157400 2023-06-10T19:01:50.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.107+0000 7f7c4d211640 1 -- 172.21.15.53:0/690439499 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7c4808a200 con 0x7f7c48157400 2023-06-10T19:01:50.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.111+0000 7f7c2f7fe640 1 -- 172.21.15.53:0/690439499 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4681 (secure 0 0 0) 0x7f7c3c053ea0 con 0x7f7c48157400 2023-06-10T19:01:50.116 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:01:50.117 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5663,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2600814414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2600814414},{"type":"v1","addr":"172.21.15.117:6835","nonce":2600814414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6136,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1615882017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1615882017},{"type":"v1","addr":"172.21.15.117:6837","nonce":1615882017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6993,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/3732245174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3732245174},{"type":"v1","addr":"172.21.15.53:6833","nonce":3732245174}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:00:20.607950+0000","modified":"2023-06-10T19:01:40.998259+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7266":{"gid":7266,"name":"c","rank":0,"incarnation":37,"state":"up:active","state_seq":17,"addr":"172.21.15.53:6835/2829993338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2829993338},{"type":"v1","addr":"172.21.15.53:6835","nonce":2829993338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-06-10T19:01:50.117 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 40 2023-06-10T19:01:50.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.111+0000 7f7c4d211640 1 -- 172.21.15.53:0/690439499 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7c34066280 msgr2=0x7f7c34068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:50.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.111+0000 7f7c4d211640 1 --2- 172.21.15.53:0/690439499 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7c34066280 0x7f7c34068730 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f7c380af000 tx=0x7f7c380046d0 comp rx=0 tx=0).stop 2023-06-10T19:01:50.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.111+0000 7f7c4d211640 1 -- 172.21.15.53:0/690439499 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c48157400 msgr2=0x7f7c480c4c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:50.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.111+0000 7f7c4d211640 1 --2- 172.21.15.53:0/690439499 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c48157400 0x7f7c480c4c60 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c00e7e0 tx=0x7f7c3c00e8d0 comp rx=0 tx=0).stop 2023-06-10T19:01:50.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.111+0000 7f7c4d211640 1 -- 172.21.15.53:0/690439499 shutdown_connections 2023-06-10T19:01:50.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.111+0000 7f7c4d211640 1 --2- 172.21.15.53:0/690439499 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7c34066280 0x7f7c34068730 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:50.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.111+0000 7f7c4d211640 1 --2- 172.21.15.53:0/690439499 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c48158a10 0x7f7c48158e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:50.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.111+0000 7f7c4d211640 1 --2- 172.21.15.53:0/690439499 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c48157400 0x7f7c480c4c60 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:50.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.111+0000 7f7c4d211640 1 --2- 172.21.15.53:0/690439499 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c300039f0 0x7f7c4815be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:50.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.111+0000 7f7c4d211640 1 -- 172.21.15.53:0/690439499 >> 172.21.15.53:0/690439499 conn(0x7f7c48071790 msgr2=0x7f7c480cd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:50.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.111+0000 7f7c4d211640 1 -- 172.21.15.53:0/690439499 shutdown_connections 2023-06-10T19:01:50.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.111+0000 7f7c4d211640 1 -- 172.21.15.53:0/690439499 wait complete. 2023-06-10T19:01:50.134 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:01:50.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.255+0000 7f1ec2256640 1 Processor -- start 2023-06-10T19:01:50.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.255+0000 7f1ec2256640 1 -- start start 2023-06-10T19:01:50.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.255+0000 7f1ec2256640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1ebc0b0f30 0x7f1ebc070950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:50.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.255+0000 7f1ec2256640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ebc159a60 0x7f1ebc0c2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:50.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.255+0000 7f1ec2256640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ebc0cb080 con 0x7f1ebc159690 2023-06-10T19:01:50.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.255+0000 7f1ec2256640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ebc070e90 con 0x7f1ebc0b0f30 2023-06-10T19:01:50.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.255+0000 7f1ec2256640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ebc06d450 con 0x7f1ebc159a60 2023-06-10T19:01:50.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.255+0000 7f1ebb7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f1ebc159690 0x7f1ebc0cbe00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:57164/0 (socket says 172.21.15.53:57164) 2023-06-10T19:01:50.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.255+0000 7f1ebb7fe640 1 -- 172.21.15.53:0/246286147 learned_addr learned my addr 172.21.15.53:0/246286147 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:01:50.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.255+0000 7f1ebaffd640 1 --2- 172.21.15.53:0/246286147 >> v2:172.21.15.53:3300/0 conn(0x7f1ebc0b0f30 0x7f1ebc070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:50.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.255+0000 7f1ebbfff640 1 --2- 172.21.15.53:0/246286147 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ebc159a60 0x7f1ebc0c2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:50.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.255+0000 7f1eba7fc640 1 -- 172.21.15.53:0/246286147 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4097166938 0 0) 0x7f1ebc0cb080 con 0x7f1ebc159690 2023-06-10T19:01:50.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.255+0000 7f1eba7fc640 1 -- 172.21.15.53:0/246286147 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ea4003530 con 0x7f1ebc159690 2023-06-10T19:01:50.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.255+0000 7f1ebaffd640 1 -- 172.21.15.53:0/246286147 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ebc159a60 msgr2=0x7f1ebc0c2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:50.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.255+0000 7f1ebaffd640 1 --2- 172.21.15.53:0/246286147 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ebc159a60 0x7f1ebc0c2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:50.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.255+0000 7f1ebaffd640 1 -- 172.21.15.53:0/246286147 >> v1:172.21.15.53:6789/0 conn(0x7f1ebc159690 legacy=0x7f1ebc0cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:50.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.255+0000 7f1ebaffd640 1 -- 172.21.15.53:0/246286147 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ebc0cb320 con 0x7f1ebc0b0f30 2023-06-10T19:01:50.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.259+0000 7f1ebaffd640 1 --2- 172.21.15.53:0/246286147 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ebc0b0f30 0x7f1ebc070950 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f1eb00097c0 tx=0x7f1eb001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bef163f4b7f014df server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:50.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.259+0000 7f1eba7fc640 1 -- 172.21.15.53:0/246286147 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb00ad660 con 0x7f1ebc0b0f30 2023-06-10T19:01:50.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.259+0000 7f1eba7fc640 1 -- 172.21.15.53:0/246286147 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1eb00ad7c0 con 0x7f1ebc0b0f30 2023-06-10T19:01:50.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.259+0000 7f1eba7fc640 1 -- 172.21.15.53:0/246286147 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb00adb50 con 0x7f1ebc0b0f30 2023-06-10T19:01:50.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.259+0000 7f1ec2256640 1 -- 172.21.15.53:0/246286147 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ebc0b0f30 msgr2=0x7f1ebc070950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:50.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.259+0000 7f1ec2256640 1 --2- 172.21.15.53:0/246286147 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ebc0b0f30 0x7f1ebc070950 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f1eb00097c0 tx=0x7f1eb001c450 comp rx=0 tx=0).stop 2023-06-10T19:01:50.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.259+0000 7f1ec2256640 1 -- 172.21.15.53:0/246286147 shutdown_connections 2023-06-10T19:01:50.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.259+0000 7f1ec2256640 1 --2- 172.21.15.53:0/246286147 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ebc0b0f30 0x7f1ebc070950 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:50.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.259+0000 7f1ec2256640 1 --2- 172.21.15.53:0/246286147 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ebc159a60 0x7f1ebc0c2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:50.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.259+0000 7f1ec2256640 1 -- 172.21.15.53:0/246286147 >> 172.21.15.53:0/246286147 conn(0x7f1ebc06a560 msgr2=0x7f1ebc06a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:50.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.259+0000 7f1ec2256640 1 -- 172.21.15.53:0/246286147 shutdown_connections 2023-06-10T19:01:50.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.259+0000 7f1ec2256640 1 -- 172.21.15.53:0/246286147 wait complete. 2023-06-10T19:01:50.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.259+0000 7f1ec2256640 1 Processor -- start 2023-06-10T19:01:50.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.259+0000 7f1ec2256640 1 -- start start 2023-06-10T19:01:50.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.263+0000 7f1ec2256640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ebc0b0f30 0x7f1ebc1472d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:50.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.263+0000 7f1ec2256640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ebc159690 0x7f1ebc0c83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:50.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.263+0000 7f1ec2256640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ebc159a60 0x7f1ebc14b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:50.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.263+0000 7f1ec2256640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ebc15be60 con 0x7f1ebc159a60 2023-06-10T19:01:50.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.263+0000 7f1ec2256640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ebc15c140 con 0x7f1ebc0b0f30 2023-06-10T19:01:50.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.263+0000 7f1ec2256640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ebc15c420 con 0x7f1ebc159690 2023-06-10T19:01:50.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.263+0000 7f1ebbfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ebc159a60 0x7f1ebc14b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:50.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.263+0000 7f1ebbfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ebc159a60 0x7f1ebc14b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48666/0 (socket says 172.21.15.53:48666) 2023-06-10T19:01:50.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.263+0000 7f1ebbfff640 1 -- 172.21.15.53:0/4128486610 learned_addr learned my addr 172.21.15.53:0/4128486610 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:50.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.263+0000 7f1ebaffd640 1 --2- 172.21.15.53:0/4128486610 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ebc159690 0x7f1ebc0c83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:50.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.263+0000 7f1ebb7fe640 1 --2- 172.21.15.53:0/4128486610 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ebc0b0f30 0x7f1ebc1472d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:50.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.263+0000 7f1ebbfff640 1 -- 172.21.15.53:0/4128486610 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ebc159690 msgr2=0x7f1ebc0c83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:50.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.263+0000 7f1ebbfff640 1 --2- 172.21.15.53:0/4128486610 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ebc159690 0x7f1ebc0c83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:50.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.263+0000 7f1ebbfff640 1 -- 172.21.15.53:0/4128486610 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ebc0b0f30 msgr2=0x7f1ebc1472d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:50.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.263+0000 7f1ebbfff640 1 --2- 172.21.15.53:0/4128486610 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ebc0b0f30 0x7f1ebc1472d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:50.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.263+0000 7f1ebbfff640 1 -- 172.21.15.53:0/4128486610 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eb0009420 con 0x7f1ebc159a60 2023-06-10T19:01:50.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.263+0000 7f1ebaffd640 1 --2- 172.21.15.53:0/4128486610 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ebc159690 0x7f1ebc0c83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:01:50.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.263+0000 7f1ebbfff640 1 --2- 172.21.15.53:0/4128486610 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ebc159a60 0x7f1ebc14b630 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f1eb4007e60 tx=0x7f1eb400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:50.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.263+0000 7f1ea3fff640 1 -- 172.21.15.53:0/4128486610 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb4014420 con 0x7f1ebc159a60 2023-06-10T19:01:50.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.263+0000 7f1ea3fff640 1 -- 172.21.15.53:0/4128486610 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1eb40145a0 con 0x7f1ebc159a60 2023-06-10T19:01:50.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.263+0000 7f1ec2256640 1 -- 172.21.15.53:0/4128486610 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ebc15c700 con 0x7f1ebc159a60 2023-06-10T19:01:50.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.263+0000 7f1ea3fff640 1 -- 172.21.15.53:0/4128486610 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb4014950 con 0x7f1ebc159a60 2023-06-10T19:01:50.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.263+0000 7f1ec2256640 1 -- 172.21.15.53:0/4128486610 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ebc0c8920 con 0x7f1ebc159a60 2023-06-10T19:01:50.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.263+0000 7f1ec2256640 1 -- 172.21.15.53:0/4128486610 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ebc0c8b10 con 0x7f1ebc159a60 2023-06-10T19:01:50.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.263+0000 7f1ea3fff640 1 -- 172.21.15.53:0/4128486610 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1eb4014ab0 con 0x7f1ebc159a60 2023-06-10T19:01:50.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.263+0000 7f1ea3fff640 1 --2- 172.21.15.53:0/4128486610 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1ea80662b0 0x7f1ea8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:50.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.263+0000 7f1ea3fff640 1 -- 172.21.15.53:0/4128486610 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6191+0+0 (secure 0 0 0) 0x7f1eb40846b0 con 0x7f1ebc159a60 2023-06-10T19:01:50.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.263+0000 7f1ebb7fe640 1 --2- 172.21.15.53:0/4128486610 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1ea80662b0 0x7f1ea8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:50.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.267+0000 7f1ebb7fe640 1 --2- 172.21.15.53:0/4128486610 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1ea80662b0 0x7f1ea8068760 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f1eac0011f0 tx=0x7f1eac009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:50.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.267+0000 7f1ea3fff640 1 -- 172.21.15.53:0/4128486610 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1ebc0c8b10 con 0x7f1ebc159a60 2023-06-10T19:01:50.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.423+0000 7f1ec2256640 1 -- 172.21.15.53:0/4128486610 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1ebc14b350 con 0x7f1ebc159a60 2023-06-10T19:01:50.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.427+0000 7f1ea3fff640 1 -- 172.21.15.53:0/4128486610 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+18529 (secure 0 0 0) 0x7f1ebc14b350 con 0x7f1ebc159a60 2023-06-10T19:01:50.431 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:01:50.432 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":82,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:01:38.982908+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-06-10T19:00:19.188303+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-06-10T19:00:19.583756+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.0.1:0/716140912":"2023-06-10T20:01:38.016422+0000","172.21.15.53:6835/882186121":"2023-06-11T19:00:42.868037+0000","172.21.15.53:6834/882186121":"2023-06-11T19:00:42.868037+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:01:50.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.427+0000 7f1ec2256640 1 -- 172.21.15.53:0/4128486610 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1ea80662b0 msgr2=0x7f1ea8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:50.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.427+0000 7f1ec2256640 1 --2- 172.21.15.53:0/4128486610 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1ea80662b0 0x7f1ea8068760 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f1eac0011f0 tx=0x7f1eac009040 comp rx=0 tx=0).stop 2023-06-10T19:01:50.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.427+0000 7f1ec2256640 1 -- 172.21.15.53:0/4128486610 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ebc159a60 msgr2=0x7f1ebc14b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:50.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.427+0000 7f1ec2256640 1 --2- 172.21.15.53:0/4128486610 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ebc159a60 0x7f1ebc14b630 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f1eb4007e60 tx=0x7f1eb400e4b0 comp rx=0 tx=0).stop 2023-06-10T19:01:50.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.427+0000 7f1ec2256640 1 -- 172.21.15.53:0/4128486610 shutdown_connections 2023-06-10T19:01:50.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.427+0000 7f1ec2256640 1 --2- 172.21.15.53:0/4128486610 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1ea80662b0 0x7f1ea8068760 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:50.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.427+0000 7f1ec2256640 1 --2- 172.21.15.53:0/4128486610 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ebc159a60 0x7f1ebc14b630 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:50.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.427+0000 7f1ec2256640 1 --2- 172.21.15.53:0/4128486610 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ebc159690 0x7f1ebc0c83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:50.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.427+0000 7f1ec2256640 1 --2- 172.21.15.53:0/4128486610 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ebc0b0f30 0x7f1ebc1472d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:50.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.427+0000 7f1ec2256640 1 -- 172.21.15.53:0/4128486610 >> 172.21.15.53:0/4128486610 conn(0x7f1ebc06a560 msgr2=0x7f1ebc0af930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:50.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.427+0000 7f1ec2256640 1 -- 172.21.15.53:0/4128486610 shutdown_connections 2023-06-10T19:01:50.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.427+0000 7f1ec2256640 1 -- 172.21.15.53:0/4128486610 wait complete. 2023-06-10T19:01:50.451 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-06-10T19:01:50.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.559+0000 7fd6c9beb640 1 Processor -- start 2023-06-10T19:01:50.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.559+0000 7fd6c9beb640 1 -- start start 2023-06-10T19:01:50.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.559+0000 7fd6c9beb640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd6c4159450 0x7fd6c415d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:50.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.559+0000 7fd6c9beb640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6c415d680 0x7fd6c40cec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:50.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.559+0000 7fd6c9beb640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd6c40cf180 0x7fd6c40cda20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:50.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.559+0000 7fd6c9beb640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6c40cf600 con 0x7fd6c40cf180 2023-06-10T19:01:50.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.559+0000 7fd6c9beb640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6c40cbac0 con 0x7fd6c4159450 2023-06-10T19:01:50.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.559+0000 7fd6c9beb640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c415dc00 con 0x7fd6c415d680 2023-06-10T19:01:50.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.563+0000 7fd6c3fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd6c40cf180 0x7fd6c40cda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:50.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.563+0000 7fd6c3fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd6c40cf180 0x7fd6c40cda20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48682/0 (socket says 172.21.15.53:48682) 2023-06-10T19:01:50.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.563+0000 7fd6c3fff640 1 -- 172.21.15.53:0/1452236150 learned_addr learned my addr 172.21.15.53:0/1452236150 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:50.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.563+0000 7fd6c2ffd640 1 --2- 172.21.15.53:0/1452236150 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6c415d680 0x7fd6c40cec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:50.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.563+0000 7fd6c37fe640 1 --2- 172.21.15.53:0/1452236150 >> v2:172.21.15.117:3300/0 conn(0x7fd6c4159450 0x7fd6c415d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:50.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.563+0000 7fd6c3fff640 1 -- 172.21.15.53:0/1452236150 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6c415d680 msgr2=0x7fd6c40cec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:50.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.563+0000 7fd6c3fff640 1 --2- 172.21.15.53:0/1452236150 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6c415d680 0x7fd6c40cec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:50.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.563+0000 7fd6c3fff640 1 -- 172.21.15.53:0/1452236150 >> v2:172.21.15.117:3300/0 conn(0x7fd6c4159450 msgr2=0x7fd6c415d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:50.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.563+0000 7fd6c3fff640 1 --2- 172.21.15.53:0/1452236150 >> v2:172.21.15.117:3300/0 conn(0x7fd6c4159450 0x7fd6c415d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:50.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.563+0000 7fd6c3fff640 1 -- 172.21.15.53:0/1452236150 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6c415dee0 con 0x7fd6c40cf180 2023-06-10T19:01:50.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.563+0000 7fd6c3fff640 1 --2- 172.21.15.53:0/1452236150 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6c40cf180 0x7fd6c40cda20 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7fd6c40b29a0 tx=0x7fd6bc01c650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ccecca7a6838cf4 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:50.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.563+0000 7fd6c27fc640 1 -- 172.21.15.53:0/1452236150 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6bc0a64a0 con 0x7fd6c40cf180 2023-06-10T19:01:50.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.563+0000 7fd6c27fc640 1 -- 172.21.15.53:0/1452236150 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6bc0a6600 con 0x7fd6c40cf180 2023-06-10T19:01:50.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.563+0000 7fd6c27fc640 1 -- 172.21.15.53:0/1452236150 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6bc0a6990 con 0x7fd6c40cf180 2023-06-10T19:01:50.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.563+0000 7fd6c9beb640 1 -- 172.21.15.53:0/1452236150 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6c40cf180 msgr2=0x7fd6c40cda20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:50.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.563+0000 7fd6c9beb640 1 --2- 172.21.15.53:0/1452236150 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6c40cf180 0x7fd6c40cda20 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7fd6c40b29a0 tx=0x7fd6bc01c650 comp rx=0 tx=0).stop 2023-06-10T19:01:50.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.563+0000 7fd6c9beb640 1 -- 172.21.15.53:0/1452236150 shutdown_connections 2023-06-10T19:01:50.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.563+0000 7fd6c9beb640 1 --2- 172.21.15.53:0/1452236150 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6c40cf180 0x7fd6c40cda20 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:50.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.563+0000 7fd6c9beb640 1 --2- 172.21.15.53:0/1452236150 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6c415d680 0x7fd6c40cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:50.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.563+0000 7fd6c9beb640 1 --2- 172.21.15.53:0/1452236150 >> v2:172.21.15.117:3300/0 conn(0x7fd6c4159450 0x7fd6c415d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:50.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.563+0000 7fd6c9beb640 1 -- 172.21.15.53:0/1452236150 >> 172.21.15.53:0/1452236150 conn(0x7fd6c406a0b0 msgr2=0x7fd6c406d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:50.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.563+0000 7fd6c9beb640 1 -- 172.21.15.53:0/1452236150 shutdown_connections 2023-06-10T19:01:50.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.563+0000 7fd6c9beb640 1 -- 172.21.15.53:0/1452236150 wait complete. 2023-06-10T19:01:50.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.567+0000 7fd6c9beb640 1 Processor -- start 2023-06-10T19:01:50.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.567+0000 7fd6c9beb640 1 -- start start 2023-06-10T19:01:50.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.567+0000 7fd6c9beb640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6c40cf180 0x7fd6c41578a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:50.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.567+0000 7fd6c9beb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6c4159450 0x7fd6c40c5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:50.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.567+0000 7fd6c9beb640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6c415d680 0x7fd6c40b53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:50.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.567+0000 7fd6c9beb640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c4157410 con 0x7fd6c4159450 2023-06-10T19:01:50.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.567+0000 7fd6c9beb640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c40c6110 con 0x7fd6c415d680 2023-06-10T19:01:50.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.567+0000 7fd6c9beb640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c4156800 con 0x7fd6c40cf180 2023-06-10T19:01:50.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.567+0000 7fd6c2ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6c4159450 0x7fd6c40c5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:50.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.567+0000 7fd6c2ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6c4159450 0x7fd6c40c5bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48698/0 (socket says 172.21.15.53:48698) 2023-06-10T19:01:50.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.567+0000 7fd6c2ffd640 1 -- 172.21.15.53:0/1004960894 learned_addr learned my addr 172.21.15.53:0/1004960894 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:50.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.567+0000 7fd6c37fe640 1 --2- 172.21.15.53:0/1004960894 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6c40cf180 0x7fd6c41578a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:50.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.567+0000 7fd6c3fff640 1 --2- 172.21.15.53:0/1004960894 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6c415d680 0x7fd6c40b53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:50.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.567+0000 7fd6c2ffd640 1 -- 172.21.15.53:0/1004960894 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6c40cf180 msgr2=0x7fd6c41578a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:50.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.567+0000 7fd6c2ffd640 1 --2- 172.21.15.53:0/1004960894 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6c40cf180 0x7fd6c41578a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:50.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.567+0000 7fd6c2ffd640 1 -- 172.21.15.53:0/1004960894 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6c415d680 msgr2=0x7fd6c40b53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:50.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.567+0000 7fd6c2ffd640 1 --2- 172.21.15.53:0/1004960894 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6c415d680 0x7fd6c40b53d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:50.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.567+0000 7fd6c2ffd640 1 -- 172.21.15.53:0/1004960894 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6bc009b30 con 0x7fd6c4159450 2023-06-10T19:01:50.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.567+0000 7fd6c3fff640 1 --2- 172.21.15.53:0/1004960894 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6c415d680 0x7fd6c40b53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:01:50.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.567+0000 7fd6c2ffd640 1 --2- 172.21.15.53:0/1004960894 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6c4159450 0x7fd6c40c5bd0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7fd6b800d800 tx=0x7fd6b800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:50.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.567+0000 7fd6abfff640 1 -- 172.21.15.53:0/1004960894 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b800b6c0 con 0x7fd6c4159450 2023-06-10T19:01:50.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.567+0000 7fd6abfff640 1 -- 172.21.15.53:0/1004960894 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6b800b820 con 0x7fd6c4159450 2023-06-10T19:01:50.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.567+0000 7fd6c9beb640 1 -- 172.21.15.53:0/1004960894 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6c4156ae0 con 0x7fd6c4159450 2023-06-10T19:01:50.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.567+0000 7fd6abfff640 1 -- 172.21.15.53:0/1004960894 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b800bb90 con 0x7fd6c4159450 2023-06-10T19:01:50.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.567+0000 7fd6c9beb640 1 -- 172.21.15.53:0/1004960894 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6c41570a0 con 0x7fd6c4159450 2023-06-10T19:01:50.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.567+0000 7fd6c9beb640 1 -- 172.21.15.53:0/1004960894 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6c404d790 con 0x7fd6c4159450 2023-06-10T19:01:50.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.571+0000 7fd6abfff640 1 -- 172.21.15.53:0/1004960894 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd6b800bcf0 con 0x7fd6c4159450 2023-06-10T19:01:50.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.571+0000 7fd6abfff640 1 --2- 172.21.15.53:0/1004960894 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd6b00662b0 0x7fd6b0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:50.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.571+0000 7fd6abfff640 1 -- 172.21.15.53:0/1004960894 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6191+0+0 (secure 0 0 0) 0x7fd6b8084de0 con 0x7fd6c4159450 2023-06-10T19:01:50.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.571+0000 7fd6c37fe640 1 --2- 172.21.15.53:0/1004960894 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd6b00662b0 0x7fd6b0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:50.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.571+0000 7fd6c37fe640 1 --2- 172.21.15.53:0/1004960894 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd6b00662b0 0x7fd6b0068760 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fd6b400b930 tx=0x7fd6b4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:50.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.575+0000 7fd6abfff640 1 -- 172.21.15.53:0/1004960894 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd6b80521c0 con 0x7fd6c4159450 2023-06-10T19:01:50.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:50.759+0000 7fd6c9beb640 1 -- 172.21.15.53:0/1004960894 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fd6c406df70 con 0x7fd6c4159450 2023-06-10T19:01:51.087 INFO:tasks.ceph.mon.a.smithi053.stderr:2023-06-10T19:01:51.083+0000 7f74752c1640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-06-10T19:01:51.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:51.099+0000 7fd6abfff640 1 -- 172.21.15.53:0/1004960894 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v41) v1 ==== 161+0+0 (secure 0 0 0) 0x7fd6b80557e0 con 0x7fd6c4159450 2023-06-10T19:01:51.106 INFO:teuthology.orchestra.run.smithi053.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-06-10T19:01:51.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:51.103+0000 7fd6c9beb640 1 -- 172.21.15.53:0/1004960894 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd6b00662b0 msgr2=0x7fd6b0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:51.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:51.103+0000 7fd6c9beb640 1 --2- 172.21.15.53:0/1004960894 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd6b00662b0 0x7fd6b0068760 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fd6b400b930 tx=0x7fd6b4008040 comp rx=0 tx=0).stop 2023-06-10T19:01:51.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:51.103+0000 7fd6c9beb640 1 -- 172.21.15.53:0/1004960894 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6c4159450 msgr2=0x7fd6c40c5bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:51.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:51.103+0000 7fd6c9beb640 1 --2- 172.21.15.53:0/1004960894 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6c4159450 0x7fd6c40c5bd0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7fd6b800d800 tx=0x7fd6b800dcc0 comp rx=0 tx=0).stop 2023-06-10T19:01:51.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:51.103+0000 7fd6c9beb640 1 -- 172.21.15.53:0/1004960894 shutdown_connections 2023-06-10T19:01:51.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:51.103+0000 7fd6c9beb640 1 --2- 172.21.15.53:0/1004960894 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd6b00662b0 0x7fd6b0068760 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:51.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:51.103+0000 7fd6c9beb640 1 --2- 172.21.15.53:0/1004960894 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6c415d680 0x7fd6c40b53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:51.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:51.103+0000 7fd6c9beb640 1 --2- 172.21.15.53:0/1004960894 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6c4159450 0x7fd6c40c5bd0 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:51.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:51.103+0000 7fd6c9beb640 1 --2- 172.21.15.53:0/1004960894 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6c40cf180 0x7fd6c41578a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:51.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:51.103+0000 7fd6c9beb640 1 -- 172.21.15.53:0/1004960894 >> 172.21.15.53:0/1004960894 conn(0x7fd6c406a0b0 msgr2=0x7fd6c4158620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:51.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:51.103+0000 7fd6c9beb640 1 -- 172.21.15.53:0/1004960894 shutdown_connections 2023-06-10T19:01:51.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:51.103+0000 7fd6c9beb640 1 -- 172.21.15.53:0/1004960894 wait complete. 2023-06-10T19:01:51.128 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-06-10T19:01:51.168 INFO:tasks.ceph.mds.c.smithi053.stdout:starting mds.c at 2023-06-10T19:01:51.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:51.251+0000 7f9221f2b640 1 Processor -- start 2023-06-10T19:01:51.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:51.251+0000 7f9221f2b640 1 -- start start 2023-06-10T19:01:51.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:51.251+0000 7f9221f2b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f921c15b870 0x7f921c06a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:51.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:51.251+0000 7f9221f2b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f921c0b03f0 0x7f921c069b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:51.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:51.251+0000 7f9221f2b640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f921c06ae70 con 0x7f921c0affc0 2023-06-10T19:01:51.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:51.251+0000 7f9221f2b640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f921c0655c0 con 0x7f921c15b870 2023-06-10T19:01:51.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:51.251+0000 7f9221f2b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f921c0cc110 con 0x7f921c0b03f0 2023-06-10T19:01:51.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:51.251+0000 7f921b7fe640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f921c15b870 0x7f921c06a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:51.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:51.251+0000 7f921bfff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f921c0b03f0 0x7f921c069b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:51.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:51.251+0000 7f921bfff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f921c0b03f0 0x7f921c069b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.53:35576/0 (socket says 172.21.15.53:35576) 2023-06-10T19:01:51.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:51.251+0000 7f921bfff640 1 -- 172.21.15.53:0/2303304723 learned_addr learned my addr 172.21.15.53:0/2303304723 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:51.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:51.251+0000 7f921bfff640 1 -- 172.21.15.53:0/2303304723 >> v2:172.21.15.117:3300/0 conn(0x7f921c15b870 msgr2=0x7f921c06a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:51.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:51.251+0000 7f921bfff640 1 --2- 172.21.15.53:0/2303304723 >> v2:172.21.15.117:3300/0 conn(0x7f921c15b870 0x7f921c06a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:51.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:51.251+0000 7f921bfff640 1 -- 172.21.15.53:0/2303304723 >> v1:172.21.15.117:6789/0 conn(0x7f921c0affc0 legacy=0x7f921c069450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:51.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:51.251+0000 7f921bfff640 1 -- 172.21.15.53:0/2303304723 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f921c0cc3f0 con 0x7f921c0b03f0 2023-06-10T19:01:51.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:51.255+0000 7f921bfff640 1 --2- 172.21.15.53:0/2303304723 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f921c0b03f0 0x7f921c069b60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9214009e50 tx=0x7f921401c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c684fd01efec84b3 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:51.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:51.255+0000 7f921a7fc640 1 -- 172.21.15.53:0/2303304723 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92140a5710 con 0x7f921c0b03f0 2023-06-10T19:01:51.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:51.255+0000 7f921a7fc640 1 -- 172.21.15.53:0/2303304723 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92140a5870 con 0x7f921c0b03f0 2023-06-10T19:01:51.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:51.255+0000 7f921a7fc640 1 -- 172.21.15.53:0/2303304723 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92140a5c00 con 0x7f921c0b03f0 2023-06-10T19:01:51.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:51.255+0000 7f9221f2b640 1 -- 172.21.15.53:0/2303304723 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f921c0b03f0 msgr2=0x7f921c069b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:51.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:51.255+0000 7f9221f2b640 1 --2- 172.21.15.53:0/2303304723 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f921c0b03f0 0x7f921c069b60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9214009e50 tx=0x7f921401c950 comp rx=0 tx=0).stop 2023-06-10T19:01:51.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:51.255+0000 7f9221f2b640 1 -- 172.21.15.53:0/2303304723 shutdown_connections 2023-06-10T19:01:51.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:51.255+0000 7f9221f2b640 1 --2- 172.21.15.53:0/2303304723 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f921c0b03f0 0x7f921c069b60 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:51.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:51.255+0000 7f9221f2b640 1 --2- 172.21.15.53:0/2303304723 >> v2:172.21.15.117:3300/0 conn(0x7f921c15b870 0x7f921c06a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:51.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:51.255+0000 7f9221f2b640 1 -- 172.21.15.53:0/2303304723 >> 172.21.15.53:0/2303304723 conn(0x7f921c0cafc0 msgr2=0x7f921c0cb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:51.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:51.255+0000 7f9221f2b640 1 -- 172.21.15.53:0/2303304723 shutdown_connections 2023-06-10T19:01:51.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:51.255+0000 7f9221f2b640 1 -- 172.21.15.53:0/2303304723 wait complete. 2023-06-10T19:01:51.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:51.259+0000 7f9221f2b640 1 Processor -- start 2023-06-10T19:01:51.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:51.259+0000 7f9221f2b640 1 -- start start 2023-06-10T19:01:51.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:51.259+0000 7f9221f2b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f921c0affc0 0x7f921c151af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:51.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:51.259+0000 7f9221f2b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f921c0b03f0 0x7f921c1582c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:51.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:51.259+0000 7f9221f2b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f921c15b870 0x7f921c158800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:51.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:51.259+0000 7f9221f2b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f921c15c820 con 0x7f921c0b03f0 2023-06-10T19:01:51.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:51.259+0000 7f9221f2b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f921c141680 con 0x7f921c15b870 2023-06-10T19:01:51.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:51.259+0000 7f9221f2b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f921c13e7a0 con 0x7f921c0affc0 2023-06-10T19:01:51.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:51.259+0000 7f921affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f921c0b03f0 0x7f921c1582c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:51.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:51.259+0000 7f921affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f921c0b03f0 0x7f921c1582c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59830/0 (socket says 172.21.15.53:59830) 2023-06-10T19:01:51.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:51.259+0000 7f921affd640 1 -- 172.21.15.53:0/1674400611 learned_addr learned my addr 172.21.15.53:0/1674400611 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:51.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:51.259+0000 7f921b7fe640 1 --2- 172.21.15.53:0/1674400611 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f921c0affc0 0x7f921c151af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:51.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:51.259+0000 7f921bfff640 1 --2- 172.21.15.53:0/1674400611 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f921c15b870 0x7f921c158800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:51.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:51.259+0000 7f921affd640 1 -- 172.21.15.53:0/1674400611 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f921c0affc0 msgr2=0x7f921c151af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:51.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:51.259+0000 7f921affd640 1 --2- 172.21.15.53:0/1674400611 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f921c0affc0 0x7f921c151af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:51.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:51.259+0000 7f921affd640 1 -- 172.21.15.53:0/1674400611 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f921c15b870 msgr2=0x7f921c158800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:51.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:51.259+0000 7f921affd640 1 --2- 172.21.15.53:0/1674400611 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f921c15b870 0x7f921c158800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:51.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:51.259+0000 7f921affd640 1 -- 172.21.15.53:0/1674400611 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9214009b30 con 0x7f921c0b03f0 2023-06-10T19:01:51.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:51.259+0000 7f921b7fe640 1 --2- 172.21.15.53:0/1674400611 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f921c0affc0 0x7f921c151af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:01:51.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:51.259+0000 7f921bfff640 1 --2- 172.21.15.53:0/1674400611 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f921c15b870 0x7f921c158800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:01:51.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:51.259+0000 7f921affd640 1 --2- 172.21.15.53:0/1674400611 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f921c0b03f0 0x7f921c1582c0 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f920c00c3c0 tx=0x7f920c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:51.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:51.259+0000 7f9213fff640 1 -- 172.21.15.53:0/1674400611 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f920c0052d0 con 0x7f921c0b03f0 2023-06-10T19:01:51.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:51.259+0000 7f9213fff640 1 -- 172.21.15.53:0/1674400611 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f920c005430 con 0x7f921c0b03f0 2023-06-10T19:01:51.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:51.259+0000 7f9221f2b640 1 -- 172.21.15.53:0/1674400611 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f921c13ea80 con 0x7f921c0b03f0 2023-06-10T19:01:51.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:51.259+0000 7f9213fff640 1 -- 172.21.15.53:0/1674400611 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f920c003840 con 0x7f921c0b03f0 2023-06-10T19:01:51.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:51.259+0000 7f9221f2b640 1 -- 172.21.15.53:0/1674400611 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f921c13f040 con 0x7f921c0b03f0 2023-06-10T19:01:51.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:51.259+0000 7f9221f2b640 1 -- 172.21.15.53:0/1674400611 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f921c0b0870 con 0x7f921c0b03f0 2023-06-10T19:01:51.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:51.259+0000 7f9213fff640 1 -- 172.21.15.53:0/1674400611 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f920c0039a0 con 0x7f921c0b03f0 2023-06-10T19:01:51.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:51.259+0000 7f9213fff640 1 --2- 172.21.15.53:0/1674400611 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f91fc066280 0x7f91fc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:51.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:51.259+0000 7f9213fff640 1 -- 172.21.15.53:0/1674400611 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6277+0+0 (secure 0 0 0) 0x7f920c083100 con 0x7f921c0b03f0 2023-06-10T19:01:51.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:51.263+0000 7f921b7fe640 1 --2- 172.21.15.53:0/1674400611 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f91fc066280 0x7f91fc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:51.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:51.263+0000 7f921b7fe640 1 --2- 172.21.15.53:0/1674400611 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f91fc066280 0x7f91fc068730 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f9204009b10 tx=0x7f9204008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:51.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:51.263+0000 7f9213fff640 1 -- 172.21.15.53:0/1674400611 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f920c050530 con 0x7f921c0b03f0 2023-06-10T19:01:51.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:51.455+0000 7f9221f2b640 1 -- 172.21.15.53:0/1674400611 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f921c06ae70 con 0x7f921c0b03f0 2023-06-10T19:01:52.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.103+0000 7f9213fff640 1 -- 172.21.15.53:0/1674400611 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v42) v1 ==== 104+0+0 (secure 0 0 0) 0x7f921c06ae70 con 0x7f921c0b03f0 2023-06-10T19:01:52.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.107+0000 7f9221f2b640 1 -- 172.21.15.53:0/1674400611 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f91fc066280 msgr2=0x7f91fc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:52.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.107+0000 7f9221f2b640 1 --2- 172.21.15.53:0/1674400611 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f91fc066280 0x7f91fc068730 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f9204009b10 tx=0x7f9204008040 comp rx=0 tx=0).stop 2023-06-10T19:01:52.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.107+0000 7f9221f2b640 1 -- 172.21.15.53:0/1674400611 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f921c0b03f0 msgr2=0x7f921c1582c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:52.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.107+0000 7f9221f2b640 1 --2- 172.21.15.53:0/1674400611 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f921c0b03f0 0x7f921c1582c0 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f920c00c3c0 tx=0x7f920c00c880 comp rx=0 tx=0).stop 2023-06-10T19:01:52.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.107+0000 7f9221f2b640 1 -- 172.21.15.53:0/1674400611 shutdown_connections 2023-06-10T19:01:52.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.107+0000 7f9221f2b640 1 --2- 172.21.15.53:0/1674400611 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f91fc066280 0x7f91fc068730 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:52.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.107+0000 7f9221f2b640 1 --2- 172.21.15.53:0/1674400611 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f921c15b870 0x7f921c158800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:52.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.107+0000 7f9221f2b640 1 --2- 172.21.15.53:0/1674400611 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f921c0b03f0 0x7f921c1582c0 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:52.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.107+0000 7f9221f2b640 1 --2- 172.21.15.53:0/1674400611 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f921c0affc0 0x7f921c151af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:52.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.107+0000 7f9221f2b640 1 -- 172.21.15.53:0/1674400611 >> 172.21.15.53:0/1674400611 conn(0x7f921c0cafc0 msgr2=0x7f921c0cd050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:52.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.107+0000 7f9221f2b640 1 -- 172.21.15.53:0/1674400611 shutdown_connections 2023-06-10T19:01:52.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.107+0000 7f9221f2b640 1 -- 172.21.15.53:0/1674400611 wait complete. 2023-06-10T19:01:52.134 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-06-10T19:01:52.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.307+0000 7ff781c11640 1 Processor -- start 2023-06-10T19:01:52.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.307+0000 7ff781c11640 1 -- start start 2023-06-10T19:01:52.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.307+0000 7ff781c11640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff77c15b930 0x7ff77c15f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:52.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.307+0000 7ff781c11640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff77c15bd00 con 0x7ff77c0b1490 2023-06-10T19:01:52.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.307+0000 7ff781c11640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff77c0cf020 con 0x7ff77c0cfc30 2023-06-10T19:01:52.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.307+0000 7ff781c11640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff77c0cf5e0 con 0x7ff77c15b930 2023-06-10T19:01:52.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.307+0000 7ff77affd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ff77c0b1490 0x7ff77c15f940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56628/0 (socket says 172.21.15.53:56628) 2023-06-10T19:01:52.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.307+0000 7ff77affd640 1 -- 172.21.15.53:0/2120276135 learned_addr learned my addr 172.21.15.53:0/2120276135 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:01:52.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.311+0000 7ff77b7fe640 1 --2- 172.21.15.53:0/2120276135 >> v2:172.21.15.117:3300/0 conn(0x7ff77c15b930 0x7ff77c15f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:52.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.311+0000 7ff77a7fc640 1 -- 172.21.15.53:0/2120276135 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2322501837 0 0) 0x7ff77c15bd00 con 0x7ff77c0b1490 2023-06-10T19:01:52.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.311+0000 7ff77a7fc640 1 -- 172.21.15.53:0/2120276135 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff764003530 con 0x7ff77c0b1490 2023-06-10T19:01:52.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.311+0000 7ff77a7fc640 1 -- 172.21.15.53:0/2120276135 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1005414396 0 0) 0x7ff764003530 con 0x7ff77c0b1490 2023-06-10T19:01:52.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.311+0000 7ff77a7fc640 1 -- 172.21.15.53:0/2120276135 >> v2:172.21.15.117:3300/0 conn(0x7ff77c15b930 msgr2=0x7ff77c15f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:52.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.311+0000 7ff77a7fc640 1 --2- 172.21.15.53:0/2120276135 >> v2:172.21.15.117:3300/0 conn(0x7ff77c15b930 0x7ff77c15f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:52.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.311+0000 7ff77a7fc640 1 -- 172.21.15.53:0/2120276135 >> v1:172.21.15.117:6789/0 conn(0x7ff77c0cfc30 legacy=0x7ff77c0d0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:52.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.311+0000 7ff77a7fc640 1 -- 172.21.15.53:0/2120276135 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff77c0cf300 con 0x7ff77c0b1490 2023-06-10T19:01:52.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.311+0000 7ff77a7fc640 1 -- 172.21.15.53:0/2120276135 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7ff770001680 con 0x7ff77c0b1490 2023-06-10T19:01:52.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.311+0000 7ff77a7fc640 1 -- 172.21.15.53:0/2120276135 >> v1:172.21.15.53:6789/0 conn(0x7ff77c0b1490 legacy=0x7ff77c15f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:52.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.311+0000 7ff77a7fc640 1 --2- 172.21.15.53:0/2120276135 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff764003980 0x7ff764003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:52.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.311+0000 7ff77a7fc640 1 --2- 172.21.15.53:0/2120276135 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7640047d0 0x7ff764004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:52.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.311+0000 7ff77a7fc640 1 --2- 172.21.15.53:0/2120276135 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff764005180 0x7ff76400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:52.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.311+0000 7ff77a7fc640 1 -- 172.21.15.53:0/2120276135 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff77c0cf5e0 con 0x7ff764003980 2023-06-10T19:01:52.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.311+0000 7ff77a7fc640 1 -- 172.21.15.53:0/2120276135 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff76400c000 con 0x7ff764005180 2023-06-10T19:01:52.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.311+0000 7ff77a7fc640 1 -- 172.21.15.53:0/2120276135 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff76400c1c0 con 0x7ff7640047d0 2023-06-10T19:01:52.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.311+0000 7ff77b7fe640 1 --2- 172.21.15.53:0/2120276135 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff764003980 0x7ff764003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:52.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.311+0000 7ff77bfff640 1 --2- 172.21.15.53:0/2120276135 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff764005180 0x7ff76400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:52.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.311+0000 7ff77affd640 1 --2- 172.21.15.53:0/2120276135 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7640047d0 0x7ff764004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:52.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.311+0000 7ff77b7fe640 1 -- 172.21.15.53:0/2120276135 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7640047d0 msgr2=0x7ff764004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:52.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.311+0000 7ff77b7fe640 1 --2- 172.21.15.53:0/2120276135 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7640047d0 0x7ff764004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:52.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.311+0000 7ff77b7fe640 1 -- 172.21.15.53:0/2120276135 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff764005180 msgr2=0x7ff76400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:52.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.311+0000 7ff77b7fe640 1 --2- 172.21.15.53:0/2120276135 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff764005180 0x7ff76400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:52.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.311+0000 7ff77bfff640 1 -- 172.21.15.53:0/2120276135 reap_dead start 2023-06-10T19:01:52.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.311+0000 7ff77b7fe640 1 -- 172.21.15.53:0/2120276135 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff764003530 con 0x7ff764003980 2023-06-10T19:01:52.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.311+0000 7ff77b7fe640 1 --2- 172.21.15.53:0/2120276135 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff764003980 0x7ff764003d90 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7ff76c009ae0 tx=0x7ff76c01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cef82e1ad3743ba server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:52.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.311+0000 7ff77a7fc640 1 -- 172.21.15.53:0/2120276135 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff76c0a6460 con 0x7ff764003980 2023-06-10T19:01:52.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.311+0000 7ff77a7fc640 1 -- 172.21.15.53:0/2120276135 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff76c0a65c0 con 0x7ff764003980 2023-06-10T19:01:52.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.311+0000 7ff77a7fc640 1 -- 172.21.15.53:0/2120276135 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff76c0a6970 con 0x7ff764003980 2023-06-10T19:01:52.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.315+0000 7ff781c11640 1 -- 172.21.15.53:0/2120276135 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff764003980 msgr2=0x7ff764003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:52.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.315+0000 7ff781c11640 1 --2- 172.21.15.53:0/2120276135 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff764003980 0x7ff764003d90 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7ff76c009ae0 tx=0x7ff76c01ca50 comp rx=0 tx=0).stop 2023-06-10T19:01:52.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.315+0000 7ff781c11640 1 -- 172.21.15.53:0/2120276135 shutdown_connections 2023-06-10T19:01:52.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.315+0000 7ff781c11640 1 --2- 172.21.15.53:0/2120276135 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff764003980 0x7ff764003d90 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:52.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.315+0000 7ff781c11640 1 -- 172.21.15.53:0/2120276135 >> 172.21.15.53:0/2120276135 conn(0x7ff77c069d70 msgr2=0x7ff77c06a170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:52.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.315+0000 7ff781c11640 1 -- 172.21.15.53:0/2120276135 shutdown_connections 2023-06-10T19:01:52.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.315+0000 7ff781c11640 1 -- 172.21.15.53:0/2120276135 wait complete. 2023-06-10T19:01:52.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.315+0000 7ff781c11640 1 Processor -- start 2023-06-10T19:01:52.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.315+0000 7ff781c11640 1 -- start start 2023-06-10T19:01:52.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.315+0000 7ff781c11640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff764003980 0x7ff77c1504d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:52.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.315+0000 7ff781c11640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff77c0c86b0 0x7ff77c0c6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:52.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.315+0000 7ff781c11640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff77c15e350 0x7ff77c0b59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:52.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.315+0000 7ff781c11640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff77c15d320 con 0x7ff77c15e350 2023-06-10T19:01:52.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.315+0000 7ff781c11640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff77c15d590 con 0x7ff77c0c86b0 2023-06-10T19:01:52.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.315+0000 7ff781c11640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff77c15d870 con 0x7ff764003980 2023-06-10T19:01:52.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.315+0000 7ff77bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff77c15e350 0x7ff77c0b59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:52.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.315+0000 7ff77bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff77c15e350 0x7ff77c0b59f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59856/0 (socket says 172.21.15.53:59856) 2023-06-10T19:01:52.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.315+0000 7ff77bfff640 1 -- 172.21.15.53:0/3999256227 learned_addr learned my addr 172.21.15.53:0/3999256227 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:52.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.315+0000 7ff77b7fe640 1 --2- 172.21.15.53:0/3999256227 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff764003980 0x7ff77c1504d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:52.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.315+0000 7ff77affd640 1 --2- 172.21.15.53:0/3999256227 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff77c0c86b0 0x7ff77c0c6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:52.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.315+0000 7ff77bfff640 1 -- 172.21.15.53:0/3999256227 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff764003980 msgr2=0x7ff77c1504d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:52.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.315+0000 7ff77bfff640 1 --2- 172.21.15.53:0/3999256227 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff764003980 0x7ff77c1504d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:52.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.315+0000 7ff77bfff640 1 -- 172.21.15.53:0/3999256227 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff77c0c86b0 msgr2=0x7ff77c0c6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:52.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.315+0000 7ff77bfff640 1 --2- 172.21.15.53:0/3999256227 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff77c0c86b0 0x7ff77c0c6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:52.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.315+0000 7ff77bfff640 1 -- 172.21.15.53:0/3999256227 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff77c15db50 con 0x7ff77c15e350 2023-06-10T19:01:52.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.315+0000 7ff77affd640 1 --2- 172.21.15.53:0/3999256227 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff77c0c86b0 0x7ff77c0c6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:01:52.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.315+0000 7ff77bfff640 1 --2- 172.21.15.53:0/3999256227 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff77c15e350 0x7ff77c0b59f0 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7ff77c066920 tx=0x7ff77400e5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:52.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.315+0000 7ff763fff640 1 -- 172.21.15.53:0/3999256227 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff774006e30 con 0x7ff77c15e350 2023-06-10T19:01:52.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.315+0000 7ff763fff640 1 -- 172.21.15.53:0/3999256227 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff77400ea20 con 0x7ff77c15e350 2023-06-10T19:01:52.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.315+0000 7ff781c11640 1 -- 172.21.15.53:0/3999256227 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff77c15de30 con 0x7ff77c15e350 2023-06-10T19:01:52.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.315+0000 7ff763fff640 1 -- 172.21.15.53:0/3999256227 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff77400edd0 con 0x7ff77c15e350 2023-06-10T19:01:52.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.315+0000 7ff781c11640 1 -- 172.21.15.53:0/3999256227 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff77c0c6f90 con 0x7ff77c15e350 2023-06-10T19:01:52.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.319+0000 7ff781c11640 1 -- 172.21.15.53:0/3999256227 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff77c04d790 con 0x7ff77c15e350 2023-06-10T19:01:52.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.319+0000 7ff763fff640 1 -- 172.21.15.53:0/3999256227 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff774003980 con 0x7ff77c15e350 2023-06-10T19:01:52.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.319+0000 7ff763fff640 1 --2- 172.21.15.53:0/3999256227 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff7680662b0 0x7ff768068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:52.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.319+0000 7ff763fff640 1 -- 172.21.15.53:0/3999256227 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6277+0+0 (secure 0 0 0) 0x7ff774082cb0 con 0x7ff77c15e350 2023-06-10T19:01:52.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.319+0000 7ff77b7fe640 1 --2- 172.21.15.53:0/3999256227 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff7680662b0 0x7ff768068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:52.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.319+0000 7ff77b7fe640 1 --2- 172.21.15.53:0/3999256227 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff7680662b0 0x7ff768068760 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7ff76c0ad000 tx=0x7ff76c0046d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:52.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.323+0000 7ff763fff640 1 -- 172.21.15.53:0/3999256227 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff774050050 con 0x7ff77c15e350 2023-06-10T19:01:52.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:52.475+0000 7ff781c11640 1 -- 172.21.15.53:0/3999256227 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff77c0c8ef0 con 0x7ff77c15e350 2023-06-10T19:01:53.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:53.211+0000 7ff763fff640 1 -- 172.21.15.53:0/3999256227 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v84) v1 ==== 181+0+0 (secure 0 0 0) 0x7ff774053670 con 0x7ff77c15e350 2023-06-10T19:01:53.218 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_metadata' removed 2023-06-10T19:01:53.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:53.215+0000 7ff781c11640 1 -- 172.21.15.53:0/3999256227 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff7680662b0 msgr2=0x7ff768068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:53.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:53.215+0000 7ff781c11640 1 --2- 172.21.15.53:0/3999256227 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff7680662b0 0x7ff768068760 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7ff76c0ad000 tx=0x7ff76c0046d0 comp rx=0 tx=0).stop 2023-06-10T19:01:53.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:53.215+0000 7ff781c11640 1 -- 172.21.15.53:0/3999256227 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff77c15e350 msgr2=0x7ff77c0b59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:53.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:53.215+0000 7ff781c11640 1 --2- 172.21.15.53:0/3999256227 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff77c15e350 0x7ff77c0b59f0 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7ff77c066920 tx=0x7ff77400e5f0 comp rx=0 tx=0).stop 2023-06-10T19:01:53.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:53.215+0000 7ff781c11640 1 -- 172.21.15.53:0/3999256227 shutdown_connections 2023-06-10T19:01:53.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:53.215+0000 7ff781c11640 1 --2- 172.21.15.53:0/3999256227 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff7680662b0 0x7ff768068760 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:53.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:53.215+0000 7ff781c11640 1 --2- 172.21.15.53:0/3999256227 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff77c15e350 0x7ff77c0b59f0 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:53.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:53.215+0000 7ff781c11640 1 --2- 172.21.15.53:0/3999256227 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff77c0c86b0 0x7ff77c0c6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:53.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:53.215+0000 7ff781c11640 1 --2- 172.21.15.53:0/3999256227 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff764003980 0x7ff77c1504d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:53.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:53.215+0000 7ff781c11640 1 -- 172.21.15.53:0/3999256227 >> 172.21.15.53:0/3999256227 conn(0x7ff77c069d70 msgr2=0x7ff77c0b4e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:53.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:53.219+0000 7ff781c11640 1 -- 172.21.15.53:0/3999256227 shutdown_connections 2023-06-10T19:01:53.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:53.219+0000 7ff781c11640 1 -- 172.21.15.53:0/3999256227 wait complete. 2023-06-10T19:01:53.249 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-06-10T19:01:53.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:53.371+0000 7fd0c4516640 1 Processor -- start 2023-06-10T19:01:53.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:53.371+0000 7fd0c4516640 1 -- start start 2023-06-10T19:01:53.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:53.375+0000 7fd0c4516640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd0bc06c210 0x7fd0bc06c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:53.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:53.375+0000 7fd0c4516640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd0bc15d0b0 0x7fd0bc0c8e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:53.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:53.375+0000 7fd0c4516640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0bc06cb20 con 0x7fd0bc158bc0 2023-06-10T19:01:53.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:53.375+0000 7fd0c4516640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0bc159120 con 0x7fd0bc15d0b0 2023-06-10T19:01:53.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:53.375+0000 7fd0c4516640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0bc159400 con 0x7fd0bc06c210 2023-06-10T19:01:53.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:53.375+0000 7fd0c1ab1640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd0bc15d0b0 0x7fd0bc0c8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:53.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:53.375+0000 7fd0c2ab3640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fd0bc158bc0 0x7fd0bc0af830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56634/0 (socket says 172.21.15.53:56634) 2023-06-10T19:01:53.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:53.375+0000 7fd0c2ab3640 1 -- 172.21.15.53:0/168366638 learned_addr learned my addr 172.21.15.53:0/168366638 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:01:53.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:53.375+0000 7fd0c22b2640 1 --2- 172.21.15.53:0/168366638 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd0bc06c210 0x7fd0bc06c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:53.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:53.375+0000 7fd0c12b0640 1 -- 172.21.15.53:0/168366638 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 332745392 0 0) 0x7fd0bc06cb20 con 0x7fd0bc158bc0 2023-06-10T19:01:53.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:53.375+0000 7fd0c12b0640 1 -- 172.21.15.53:0/168366638 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0a4003530 con 0x7fd0bc158bc0 2023-06-10T19:01:53.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:53.375+0000 7fd0c1ab1640 1 -- 172.21.15.53:0/168366638 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd0bc06c210 msgr2=0x7fd0bc06c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:53.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:53.375+0000 7fd0c1ab1640 1 --2- 172.21.15.53:0/168366638 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd0bc06c210 0x7fd0bc06c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:53.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:53.375+0000 7fd0c1ab1640 1 -- 172.21.15.53:0/168366638 >> v1:172.21.15.53:6789/0 conn(0x7fd0bc158bc0 legacy=0x7fd0bc0af830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:53.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:53.375+0000 7fd0c1ab1640 1 -- 172.21.15.53:0/168366638 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0bc1596e0 con 0x7fd0bc15d0b0 2023-06-10T19:01:53.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:53.375+0000 7fd0c1ab1640 1 --2- 172.21.15.53:0/168366638 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0bc15d0b0 0x7fd0bc0c8e10 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7fd0b00097c0 tx=0x7fd0b001e660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a90908267bd4c98 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:53.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:53.375+0000 7fd0c12b0640 1 -- 172.21.15.53:0/168366638 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b00a8650 con 0x7fd0bc15d0b0 2023-06-10T19:01:53.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:53.375+0000 7fd0c12b0640 1 -- 172.21.15.53:0/168366638 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0b00a87b0 con 0x7fd0bc15d0b0 2023-06-10T19:01:53.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:53.375+0000 7fd0c12b0640 1 -- 172.21.15.53:0/168366638 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b00a8b40 con 0x7fd0bc15d0b0 2023-06-10T19:01:53.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:53.379+0000 7fd0c4516640 1 -- 172.21.15.53:0/168366638 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0bc15d0b0 msgr2=0x7fd0bc0c8e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:53.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:53.379+0000 7fd0c4516640 1 --2- 172.21.15.53:0/168366638 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0bc15d0b0 0x7fd0bc0c8e10 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7fd0b00097c0 tx=0x7fd0b001e660 comp rx=0 tx=0).stop 2023-06-10T19:01:53.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:53.379+0000 7fd0c4516640 1 -- 172.21.15.53:0/168366638 shutdown_connections 2023-06-10T19:01:53.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:53.379+0000 7fd0c4516640 1 --2- 172.21.15.53:0/168366638 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0bc15d0b0 0x7fd0bc0c8e10 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:53.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:53.379+0000 7fd0c4516640 1 --2- 172.21.15.53:0/168366638 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd0bc06c210 0x7fd0bc06c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:53.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:53.379+0000 7fd0c4516640 1 -- 172.21.15.53:0/168366638 >> 172.21.15.53:0/168366638 conn(0x7fd0bc0ca830 msgr2=0x7fd0bc0cac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:53.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:53.379+0000 7fd0c4516640 1 -- 172.21.15.53:0/168366638 shutdown_connections 2023-06-10T19:01:53.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:53.379+0000 7fd0c4516640 1 -- 172.21.15.53:0/168366638 wait complete. 2023-06-10T19:01:53.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:53.379+0000 7fd0c4516640 1 Processor -- start 2023-06-10T19:01:53.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:53.379+0000 7fd0c4516640 1 -- start start 2023-06-10T19:01:53.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:53.379+0000 7fd0c4516640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd0bc06c210 0x7fd0bc0af9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:53.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:53.379+0000 7fd0c4516640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0bc158bc0 0x7fd0bc0ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:53.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:53.379+0000 7fd0c4516640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0bc15d0b0 0x7fd0bc14ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:53.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:53.379+0000 7fd0c4516640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0bc0c18e0 con 0x7fd0bc158bc0 2023-06-10T19:01:53.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:53.379+0000 7fd0c4516640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0bc0c1b30 con 0x7fd0bc15d0b0 2023-06-10T19:01:53.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:53.379+0000 7fd0c4516640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0bc0c1e10 con 0x7fd0bc06c210 2023-06-10T19:01:53.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:53.379+0000 7fd0c1ab1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0bc158bc0 0x7fd0bc0ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:53.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:53.379+0000 7fd0c1ab1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0bc158bc0 0x7fd0bc0ad6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59874/0 (socket says 172.21.15.53:59874) 2023-06-10T19:01:53.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:53.379+0000 7fd0c1ab1640 1 -- 172.21.15.53:0/1997192741 learned_addr learned my addr 172.21.15.53:0/1997192741 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:53.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:53.379+0000 7fd0c22b2640 1 --2- 172.21.15.53:0/1997192741 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd0bc06c210 0x7fd0bc0af9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:53.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:53.379+0000 7fd0c2ab3640 1 --2- 172.21.15.53:0/1997192741 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0bc15d0b0 0x7fd0bc14ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:53.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:53.379+0000 7fd0c1ab1640 1 -- 172.21.15.53:0/1997192741 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd0bc06c210 msgr2=0x7fd0bc0af9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:53.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:53.379+0000 7fd0c1ab1640 1 --2- 172.21.15.53:0/1997192741 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd0bc06c210 0x7fd0bc0af9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:53.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:53.379+0000 7fd0c1ab1640 1 -- 172.21.15.53:0/1997192741 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0bc15d0b0 msgr2=0x7fd0bc14ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:53.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:53.379+0000 7fd0c1ab1640 1 --2- 172.21.15.53:0/1997192741 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0bc15d0b0 0x7fd0bc14ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:53.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:53.379+0000 7fd0c1ab1640 1 -- 172.21.15.53:0/1997192741 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0b0009420 con 0x7fd0bc158bc0 2023-06-10T19:01:53.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:53.379+0000 7fd0c22b2640 1 --2- 172.21.15.53:0/1997192741 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd0bc06c210 0x7fd0bc0af9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:01:53.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:53.379+0000 7fd0c1ab1640 1 --2- 172.21.15.53:0/1997192741 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0bc158bc0 0x7fd0bc0ad6f0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7fd0b001cd10 tx=0x7fd0b001b400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:53.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:53.379+0000 7fd0baffd640 1 -- 172.21.15.53:0/1997192741 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b00b3650 con 0x7fd0bc158bc0 2023-06-10T19:01:53.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:53.379+0000 7fd0baffd640 1 -- 172.21.15.53:0/1997192741 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0b00b37b0 con 0x7fd0bc158bc0 2023-06-10T19:01:53.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:53.379+0000 7fd0c4516640 1 -- 172.21.15.53:0/1997192741 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0bc0c3800 con 0x7fd0bc158bc0 2023-06-10T19:01:53.395 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:53.379+0000 7fd0baffd640 1 -- 172.21.15.53:0/1997192741 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b00b3b60 con 0x7fd0bc158bc0 2023-06-10T19:01:53.395 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:53.379+0000 7fd0c4516640 1 -- 172.21.15.53:0/1997192741 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0bc149c40 con 0x7fd0bc158bc0 2023-06-10T19:01:53.395 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:53.383+0000 7fd0c4516640 1 -- 172.21.15.53:0/1997192741 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0bc0c1fe0 con 0x7fd0bc158bc0 2023-06-10T19:01:53.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:53.383+0000 7fd0baffd640 1 -- 172.21.15.53:0/1997192741 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd0b00b3cc0 con 0x7fd0bc158bc0 2023-06-10T19:01:53.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:53.383+0000 7fd0baffd640 1 --2- 172.21.15.53:0/1997192741 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd0a8066280 0x7fd0a8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:53.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:53.383+0000 7fd0baffd640 1 -- 172.21.15.53:0/1997192741 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5839+0+0 (secure 0 0 0) 0x7fd0b0120540 con 0x7fd0bc158bc0 2023-06-10T19:01:53.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:53.383+0000 7fd0c22b2640 1 --2- 172.21.15.53:0/1997192741 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd0a8066280 0x7fd0a8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:53.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:53.383+0000 7fd0c22b2640 1 --2- 172.21.15.53:0/1997192741 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd0a8066280 0x7fd0a8068730 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac003fd0 tx=0x7fd0ac0039e0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:53.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:53.387+0000 7fd0baffd640 1 -- 172.21.15.53:0/1997192741 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd0b00eda80 con 0x7fd0bc158bc0 2023-06-10T19:01:53.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:53.543+0000 7fd0c4516640 1 -- 172.21.15.53:0/1997192741 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd0bc0c39f0 con 0x7fd0bc158bc0 2023-06-10T19:01:54.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.219+0000 7fd0baffd640 1 -- 172.21.15.53:0/1997192741 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v85) v1 ==== 169+0+0 (secure 0 0 0) 0x7fd0b00f10a0 con 0x7fd0bc158bc0 2023-06-10T19:01:54.225 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_data' removed 2023-06-10T19:01:54.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.231+0000 7fd0c4516640 1 -- 172.21.15.53:0/1997192741 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd0a8066280 msgr2=0x7fd0a8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:54.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.231+0000 7fd0c4516640 1 --2- 172.21.15.53:0/1997192741 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd0a8066280 0x7fd0a8068730 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac003fd0 tx=0x7fd0ac0039e0 comp rx=0 tx=0).stop 2023-06-10T19:01:54.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.231+0000 7fd0c4516640 1 -- 172.21.15.53:0/1997192741 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0bc158bc0 msgr2=0x7fd0bc0ad6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:54.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.231+0000 7fd0c4516640 1 --2- 172.21.15.53:0/1997192741 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0bc158bc0 0x7fd0bc0ad6f0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7fd0b001cd10 tx=0x7fd0b001b400 comp rx=0 tx=0).stop 2023-06-10T19:01:54.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.235+0000 7fd0c4516640 1 -- 172.21.15.53:0/1997192741 shutdown_connections 2023-06-10T19:01:54.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.235+0000 7fd0c4516640 1 --2- 172.21.15.53:0/1997192741 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd0a8066280 0x7fd0a8068730 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:54.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.235+0000 7fd0c4516640 1 --2- 172.21.15.53:0/1997192741 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0bc15d0b0 0x7fd0bc14ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:54.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.235+0000 7fd0c4516640 1 --2- 172.21.15.53:0/1997192741 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0bc158bc0 0x7fd0bc0ad6f0 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:54.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.235+0000 7fd0c4516640 1 --2- 172.21.15.53:0/1997192741 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd0bc06c210 0x7fd0bc0af9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:54.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.235+0000 7fd0c4516640 1 -- 172.21.15.53:0/1997192741 >> 172.21.15.53:0/1997192741 conn(0x7fd0bc0ca830 msgr2=0x7fd0bc06f340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:54.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.235+0000 7fd0c4516640 1 -- 172.21.15.53:0/1997192741 shutdown_connections 2023-06-10T19:01:54.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.235+0000 7fd0c4516640 1 -- 172.21.15.53:0/1997192741 wait complete. 2023-06-10T19:01:54.269 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-06-10T19:01:54.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.391+0000 7f68a6331640 1 Processor -- start 2023-06-10T19:01:54.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.391+0000 7f68a6331640 1 -- start start 2023-06-10T19:01:54.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.391+0000 7f68a6331640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f68a00af760 0x7f68a00c9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:54.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.391+0000 7f68a6331640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f68a00afb30 0x7f68a015dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:54.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.391+0000 7f68a6331640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68a00706f0 con 0x7f68a0070b80 2023-06-10T19:01:54.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.391+0000 7f68a6331640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68a015ab10 con 0x7f68a00af760 2023-06-10T19:01:54.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.391+0000 7f68a6331640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68a00700e0 con 0x7f68a00afb30 2023-06-10T19:01:54.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.391+0000 7f689ffff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f68a00af760 0x7f68a00c9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:54.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.391+0000 7f689ffff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f68a00af760 0x7f68a00c9830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59878/0 (socket says 172.21.15.53:59878) 2023-06-10T19:01:54.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.391+0000 7f689ffff640 1 -- 172.21.15.53:0/1931162671 learned_addr learned my addr 172.21.15.53:0/1931162671 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:54.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.391+0000 7f68a48ce640 1 --1- 172.21.15.53:0/1931162671 >> v1:172.21.15.53:6789/0 conn(0x7f68a0070b80 0x7f68a006b090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56648/0 (socket says 172.21.15.53:56648) 2023-06-10T19:01:54.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.391+0000 7f689f7fe640 1 --2- 172.21.15.53:0/1931162671 >> v2:172.21.15.117:3300/0 conn(0x7f68a00afb30 0x7f68a015dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:54.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.391+0000 7f689ffff640 1 -- 172.21.15.53:0/1931162671 >> v2:172.21.15.117:3300/0 conn(0x7f68a00afb30 msgr2=0x7f68a015dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:54.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.391+0000 7f689ffff640 1 --2- 172.21.15.53:0/1931162671 >> v2:172.21.15.117:3300/0 conn(0x7f68a00afb30 0x7f68a015dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:54.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.391+0000 7f689ffff640 1 -- 172.21.15.53:0/1931162671 >> v1:172.21.15.53:6789/0 conn(0x7f68a0070b80 legacy=0x7f68a006b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:54.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.391+0000 7f689ffff640 1 -- 172.21.15.53:0/1931162671 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68a00c9e10 con 0x7f68a00af760 2023-06-10T19:01:54.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.391+0000 7f689f7fe640 1 --2- 172.21.15.53:0/1931162671 >> v2:172.21.15.117:3300/0 conn(0x7f68a00afb30 0x7f68a015dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:01:54.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.395+0000 7f689ffff640 1 --2- 172.21.15.53:0/1931162671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68a00af760 0x7f68a00c9830 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f68a00ca630 tx=0x7f689001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81e2d3ba1debb28a server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:54.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.395+0000 7f689effd640 1 -- 172.21.15.53:0/1931162671 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68900aa430 con 0x7f68a00af760 2023-06-10T19:01:54.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.395+0000 7f689effd640 1 -- 172.21.15.53:0/1931162671 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68900aa590 con 0x7f68a00af760 2023-06-10T19:01:54.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.395+0000 7f689effd640 1 -- 172.21.15.53:0/1931162671 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68900aa920 con 0x7f68a00af760 2023-06-10T19:01:54.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.395+0000 7f68a6331640 1 -- 172.21.15.53:0/1931162671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68a00af760 msgr2=0x7f68a00c9830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:54.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.395+0000 7f68a6331640 1 --2- 172.21.15.53:0/1931162671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68a00af760 0x7f68a00c9830 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f68a00ca630 tx=0x7f689001c4d0 comp rx=0 tx=0).stop 2023-06-10T19:01:54.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.395+0000 7f68a6331640 1 -- 172.21.15.53:0/1931162671 shutdown_connections 2023-06-10T19:01:54.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.395+0000 7f68a6331640 1 --2- 172.21.15.53:0/1931162671 >> v2:172.21.15.117:3300/0 conn(0x7f68a00afb30 0x7f68a015dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:54.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.395+0000 7f68a6331640 1 --2- 172.21.15.53:0/1931162671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68a00af760 0x7f68a00c9830 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:54.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.395+0000 7f68a6331640 1 -- 172.21.15.53:0/1931162671 >> 172.21.15.53:0/1931162671 conn(0x7f68a006a0e0 msgr2=0x7f68a00cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:54.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.395+0000 7f68a6331640 1 -- 172.21.15.53:0/1931162671 shutdown_connections 2023-06-10T19:01:54.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.395+0000 7f68a6331640 1 -- 172.21.15.53:0/1931162671 wait complete. 2023-06-10T19:01:54.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.395+0000 7f68a6331640 1 Processor -- start 2023-06-10T19:01:54.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.395+0000 7f68a6331640 1 -- start start 2023-06-10T19:01:54.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.399+0000 7f68a6331640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68a0070b80 0x7f68a0155020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:54.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.399+0000 7f68a6331640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68a00af760 0x7f68a01f50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:54.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.399+0000 7f68a6331640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f68a00afb30 0x7f68a00c1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:54.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.399+0000 7f68a6331640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68a01f4700 con 0x7f68a0070b80 2023-06-10T19:01:54.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.399+0000 7f68a6331640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68a01f4c60 con 0x7f68a00af760 2023-06-10T19:01:54.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.399+0000 7f68a6331640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68a01f5630 con 0x7f68a00afb30 2023-06-10T19:01:54.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.399+0000 7f689ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68a0070b80 0x7f68a0155020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:54.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.399+0000 7f689ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68a0070b80 0x7f68a0155020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59882/0 (socket says 172.21.15.53:59882) 2023-06-10T19:01:54.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.399+0000 7f689ffff640 1 -- 172.21.15.53:0/1403383664 learned_addr learned my addr 172.21.15.53:0/1403383664 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:54.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.399+0000 7f68a48ce640 1 --2- 172.21.15.53:0/1403383664 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f68a00afb30 0x7f68a00c1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:54.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.399+0000 7f689f7fe640 1 --2- 172.21.15.53:0/1403383664 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68a00af760 0x7f68a01f50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:54.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.399+0000 7f689ffff640 1 -- 172.21.15.53:0/1403383664 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f68a00afb30 msgr2=0x7f68a00c1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:54.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.399+0000 7f689ffff640 1 --2- 172.21.15.53:0/1403383664 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f68a00afb30 0x7f68a00c1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:54.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.399+0000 7f689ffff640 1 -- 172.21.15.53:0/1403383664 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68a00af760 msgr2=0x7f68a01f50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:54.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.399+0000 7f689ffff640 1 --2- 172.21.15.53:0/1403383664 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68a00af760 0x7f68a01f50f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:54.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.399+0000 7f689ffff640 1 -- 172.21.15.53:0/1403383664 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68900094d0 con 0x7f68a0070b80 2023-06-10T19:01:54.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.399+0000 7f68a48ce640 1 --2- 172.21.15.53:0/1403383664 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f68a00afb30 0x7f68a00c1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:01:54.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.399+0000 7f689ffff640 1 --2- 172.21.15.53:0/1403383664 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68a0070b80 0x7f68a0155020 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f68900190e0 tx=0x7f689001ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:54.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.399+0000 7f689cff9640 1 -- 172.21.15.53:0/1403383664 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68900b3800 con 0x7f68a0070b80 2023-06-10T19:01:54.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.399+0000 7f689cff9640 1 -- 172.21.15.53:0/1403383664 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68900b3960 con 0x7f68a0070b80 2023-06-10T19:01:54.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.399+0000 7f68a6331640 1 -- 172.21.15.53:0/1403383664 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68a00c2120 con 0x7f68a0070b80 2023-06-10T19:01:54.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.399+0000 7f689cff9640 1 -- 172.21.15.53:0/1403383664 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68900b3d10 con 0x7f68a0070b80 2023-06-10T19:01:54.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.399+0000 7f68a6331640 1 -- 172.21.15.53:0/1403383664 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68a01f48f0 con 0x7f68a0070b80 2023-06-10T19:01:54.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.399+0000 7f68a6331640 1 -- 172.21.15.53:0/1403383664 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68a004d790 con 0x7f68a0070b80 2023-06-10T19:01:54.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.399+0000 7f689cff9640 1 -- 172.21.15.53:0/1403383664 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f68900b2380 con 0x7f68a0070b80 2023-06-10T19:01:54.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.399+0000 7f689cff9640 1 --2- 172.21.15.53:0/1403383664 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f688c066280 0x7f688c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:54.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.399+0000 7f689cff9640 1 -- 172.21.15.53:0/1403383664 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5425+0+0 (secure 0 0 0) 0x7f689011e040 con 0x7f68a0070b80 2023-06-10T19:01:54.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.399+0000 7f689f7fe640 1 --2- 172.21.15.53:0/1403383664 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f688c066280 0x7f688c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:54.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.403+0000 7f689f7fe640 1 --2- 172.21.15.53:0/1403383664 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f688c066280 0x7f688c068730 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f6894006fd0 tx=0x7f6894008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:54.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.403+0000 7f689cff9640 1 -- 172.21.15.53:0/1403383664 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f68900eb870 con 0x7f68a0070b80 2023-06-10T19:01:54.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.559+0000 7f68a6331640 1 -- 172.21.15.53:0/1403383664 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f68a00ce560 con 0x7f68a0070b80 2023-06-10T19:01:54.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.567+0000 7f689cff9640 1 -- 172.21.15.53:0/1403383664 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7f68900eee90 con 0x7f68a0070b80 2023-06-10T19:01:54.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.571+0000 7f68a6331640 1 -- 172.21.15.53:0/1403383664 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f688c066280 msgr2=0x7f688c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:54.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.571+0000 7f68a6331640 1 --2- 172.21.15.53:0/1403383664 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f688c066280 0x7f688c068730 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f6894006fd0 tx=0x7f6894008040 comp rx=0 tx=0).stop 2023-06-10T19:01:54.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.571+0000 7f68a6331640 1 -- 172.21.15.53:0/1403383664 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68a0070b80 msgr2=0x7f68a0155020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:54.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.571+0000 7f68a6331640 1 --2- 172.21.15.53:0/1403383664 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68a0070b80 0x7f68a0155020 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f68900190e0 tx=0x7f689001ad10 comp rx=0 tx=0).stop 2023-06-10T19:01:54.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.571+0000 7f68a6331640 1 -- 172.21.15.53:0/1403383664 shutdown_connections 2023-06-10T19:01:54.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.571+0000 7f68a6331640 1 --2- 172.21.15.53:0/1403383664 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f688c066280 0x7f688c068730 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:54.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.571+0000 7f68a6331640 1 --2- 172.21.15.53:0/1403383664 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f68a00afb30 0x7f68a00c1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:54.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.571+0000 7f68a6331640 1 --2- 172.21.15.53:0/1403383664 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68a00af760 0x7f68a01f50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:54.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.571+0000 7f68a6331640 1 --2- 172.21.15.53:0/1403383664 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68a0070b80 0x7f68a0155020 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:54.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.571+0000 7f68a6331640 1 -- 172.21.15.53:0/1403383664 >> 172.21.15.53:0/1403383664 conn(0x7f68a006a0e0 msgr2=0x7f68a006b090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:54.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.571+0000 7f68a6331640 1 -- 172.21.15.53:0/1403383664 shutdown_connections 2023-06-10T19:01:54.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.571+0000 7f68a6331640 1 -- 172.21.15.53:0/1403383664 wait complete. 2023-06-10T19:01:54.593 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_create_fsync' 2023-06-10T19:01:54.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.703+0000 7fef728c7640 1 Processor -- start 2023-06-10T19:01:54.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.703+0000 7fef728c7640 1 -- start start 2023-06-10T19:01:54.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.703+0000 7fef728c7640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fef6c071060 0x7fef6c0af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:54.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.703+0000 7fef728c7640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef6c159b50 con 0x7fef6c0c9840 2023-06-10T19:01:54.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.703+0000 7fef728c7640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef6c0702a0 con 0x7fef6c0afc60 2023-06-10T19:01:54.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.703+0000 7fef728c7640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef6c070580 con 0x7fef6c071060 2023-06-10T19:01:54.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.703+0000 7fef6bfff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fef6c0c9840 0x7fef6c0c9c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56664/0 (socket says 172.21.15.53:56664) 2023-06-10T19:01:54.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.703+0000 7fef6bfff640 1 -- 172.21.15.53:0/3952224182 learned_addr learned my addr 172.21.15.53:0/3952224182 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:01:54.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.703+0000 7fef6b7fe640 1 --2- 172.21.15.53:0/3952224182 >> v2:172.21.15.117:3300/0 conn(0x7fef6c071060 0x7fef6c0af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:54.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.703+0000 7fef6affd640 1 -- 172.21.15.53:0/3952224182 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 376260263 0 0) 0x7fef6c159b50 con 0x7fef6c0c9840 2023-06-10T19:01:54.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.703+0000 7fef6affd640 1 -- 172.21.15.53:0/3952224182 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef58003530 con 0x7fef6c0c9840 2023-06-10T19:01:54.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.703+0000 7fef6affd640 1 -- 172.21.15.53:0/3952224182 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3900723873 0 0) 0x7fef58003530 con 0x7fef6c0c9840 2023-06-10T19:01:54.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.703+0000 7fef6affd640 1 -- 172.21.15.53:0/3952224182 >> v2:172.21.15.117:3300/0 conn(0x7fef6c071060 msgr2=0x7fef6c0af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:54.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.703+0000 7fef6affd640 1 --2- 172.21.15.53:0/3952224182 >> v2:172.21.15.117:3300/0 conn(0x7fef6c071060 0x7fef6c0af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:54.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.703+0000 7fef6affd640 1 -- 172.21.15.53:0/3952224182 >> v1:172.21.15.117:6789/0 conn(0x7fef6c0afc60 legacy=0x7fef6c06b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:54.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.703+0000 7fef6affd640 1 -- 172.21.15.53:0/3952224182 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef6c070860 con 0x7fef6c0c9840 2023-06-10T19:01:54.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.703+0000 7fef6affd640 1 -- 172.21.15.53:0/3952224182 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fef5c001680 con 0x7fef6c0c9840 2023-06-10T19:01:54.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.703+0000 7fef6affd640 1 -- 172.21.15.53:0/3952224182 >> v1:172.21.15.53:6789/0 conn(0x7fef6c0c9840 legacy=0x7fef6c0c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:54.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.703+0000 7fef6affd640 1 --2- 172.21.15.53:0/3952224182 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef580039f0 0x7fef58003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:54.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.703+0000 7fef6affd640 1 --2- 172.21.15.53:0/3952224182 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef580047d0 0x7fef58004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:54.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.703+0000 7fef6affd640 1 --2- 172.21.15.53:0/3952224182 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef58005180 0x7fef5800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:54.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.703+0000 7fef6affd640 1 -- 172.21.15.53:0/3952224182 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef6c070580 con 0x7fef580039f0 2023-06-10T19:01:54.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.703+0000 7fef6affd640 1 -- 172.21.15.53:0/3952224182 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef5800c060 con 0x7fef580047d0 2023-06-10T19:01:54.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.703+0000 7fef6affd640 1 -- 172.21.15.53:0/3952224182 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef5800c220 con 0x7fef58005180 2023-06-10T19:01:54.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.703+0000 7fef6bfff640 1 --2- 172.21.15.53:0/3952224182 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef580039f0 0x7fef58003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:54.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.703+0000 7fef6b7fe640 1 --2- 172.21.15.53:0/3952224182 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef580047d0 0x7fef58004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:54.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.703+0000 7fef70e64640 1 --2- 172.21.15.53:0/3952224182 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef58005180 0x7fef5800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:54.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.703+0000 7fef6bfff640 1 -- 172.21.15.53:0/3952224182 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef58005180 msgr2=0x7fef5800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:54.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.703+0000 7fef6bfff640 1 --2- 172.21.15.53:0/3952224182 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef58005180 0x7fef5800b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:54.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.703+0000 7fef6bfff640 1 -- 172.21.15.53:0/3952224182 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef580047d0 msgr2=0x7fef58004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:54.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.703+0000 7fef6bfff640 1 --2- 172.21.15.53:0/3952224182 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef580047d0 0x7fef58004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:54.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.703+0000 7fef6bfff640 1 -- 172.21.15.53:0/3952224182 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef58003530 con 0x7fef580039f0 2023-06-10T19:01:54.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.703+0000 7fef70e64640 1 -- 172.21.15.53:0/3952224182 reap_dead start 2023-06-10T19:01:54.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.707+0000 7fef6bfff640 1 --2- 172.21.15.53:0/3952224182 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef580039f0 0x7fef58003e00 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7fef5c00c240 tx=0x7fef5c01cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f3287b2e00c3465 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:54.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.707+0000 7fef6affd640 1 -- 172.21.15.53:0/3952224182 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5c005ae0 con 0x7fef580039f0 2023-06-10T19:01:54.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.707+0000 7fef6affd640 1 -- 172.21.15.53:0/3952224182 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef5c005c60 con 0x7fef580039f0 2023-06-10T19:01:54.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.707+0000 7fef6affd640 1 -- 172.21.15.53:0/3952224182 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5c0a57d0 con 0x7fef580039f0 2023-06-10T19:01:54.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.707+0000 7fef728c7640 1 -- 172.21.15.53:0/3952224182 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef580039f0 msgr2=0x7fef58003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:54.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.707+0000 7fef728c7640 1 --2- 172.21.15.53:0/3952224182 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef580039f0 0x7fef58003e00 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7fef5c00c240 tx=0x7fef5c01cc10 comp rx=0 tx=0).stop 2023-06-10T19:01:54.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.707+0000 7fef728c7640 1 -- 172.21.15.53:0/3952224182 shutdown_connections 2023-06-10T19:01:54.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.707+0000 7fef728c7640 1 --2- 172.21.15.53:0/3952224182 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef580039f0 0x7fef58003e00 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:54.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.707+0000 7fef728c7640 1 -- 172.21.15.53:0/3952224182 >> 172.21.15.53:0/3952224182 conn(0x7fef6c06a0d0 msgr2=0x7fef6c0ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:54.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.707+0000 7fef728c7640 1 -- 172.21.15.53:0/3952224182 shutdown_connections 2023-06-10T19:01:54.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.707+0000 7fef728c7640 1 -- 172.21.15.53:0/3952224182 wait complete. 2023-06-10T19:01:54.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.707+0000 7fef728c7640 1 Processor -- start 2023-06-10T19:01:54.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.711+0000 7fef728c7640 1 -- start start 2023-06-10T19:01:54.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.711+0000 7fef728c7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef580039f0 0x7fef6c14c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:54.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.711+0000 7fef728c7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef6c0b2ea0 0x7fef6c0b3310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:54.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.711+0000 7fef728c7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef6c1535b0 0x7fef6c153a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:54.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.711+0000 7fef728c7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef6c0b22c0 con 0x7fef6c1535b0 2023-06-10T19:01:54.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.711+0000 7fef728c7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef6c0b3850 con 0x7fef6c0b2ea0 2023-06-10T19:01:54.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.711+0000 7fef728c7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef6c14c770 con 0x7fef580039f0 2023-06-10T19:01:54.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.711+0000 7fef70e64640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef6c1535b0 0x7fef6c153a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:54.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.711+0000 7fef70e64640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef6c1535b0 0x7fef6c153a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59894/0 (socket says 172.21.15.53:59894) 2023-06-10T19:01:54.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.711+0000 7fef70e64640 1 -- 172.21.15.53:0/3836344339 learned_addr learned my addr 172.21.15.53:0/3836344339 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:54.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.711+0000 7fef6b7fe640 1 --2- 172.21.15.53:0/3836344339 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef6c0b2ea0 0x7fef6c0b3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:54.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.711+0000 7fef6bfff640 1 --2- 172.21.15.53:0/3836344339 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef580039f0 0x7fef6c14c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:54.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.711+0000 7fef70e64640 1 -- 172.21.15.53:0/3836344339 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef580039f0 msgr2=0x7fef6c14c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:54.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.711+0000 7fef70e64640 1 --2- 172.21.15.53:0/3836344339 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef580039f0 0x7fef6c14c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:54.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.711+0000 7fef70e64640 1 -- 172.21.15.53:0/3836344339 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef6c0b2ea0 msgr2=0x7fef6c0b3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:54.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.711+0000 7fef70e64640 1 --2- 172.21.15.53:0/3836344339 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef6c0b2ea0 0x7fef6c0b3310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:54.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.711+0000 7fef70e64640 1 -- 172.21.15.53:0/3836344339 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef6c0b1680 con 0x7fef6c1535b0 2023-06-10T19:01:54.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.711+0000 7fef70e64640 1 --2- 172.21.15.53:0/3836344339 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef6c1535b0 0x7fef6c153a20 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7fef6400d400 tx=0x7fef6400d4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:54.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.711+0000 7fef68ff9640 1 -- 172.21.15.53:0/3836344339 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef6400b070 con 0x7fef6c1535b0 2023-06-10T19:01:54.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.711+0000 7fef68ff9640 1 -- 172.21.15.53:0/3836344339 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef640054e0 con 0x7fef6c1535b0 2023-06-10T19:01:54.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.711+0000 7fef68ff9640 1 -- 172.21.15.53:0/3836344339 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef6400da50 con 0x7fef6c1535b0 2023-06-10T19:01:54.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.711+0000 7fef728c7640 1 -- 172.21.15.53:0/3836344339 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef6c0b1920 con 0x7fef6c1535b0 2023-06-10T19:01:54.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.711+0000 7fef728c7640 1 -- 172.21.15.53:0/3836344339 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef6c0b1ee0 con 0x7fef6c1535b0 2023-06-10T19:01:54.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.711+0000 7fef728c7640 1 -- 172.21.15.53:0/3836344339 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef6c04d790 con 0x7fef6c1535b0 2023-06-10T19:01:54.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.711+0000 7fef68ff9640 1 -- 172.21.15.53:0/3836344339 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fef6400dbb0 con 0x7fef6c1535b0 2023-06-10T19:01:54.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.711+0000 7fef68ff9640 1 --2- 172.21.15.53:0/3836344339 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fef4c066280 0x7fef4c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:54.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.711+0000 7fef68ff9640 1 -- 172.21.15.53:0/3836344339 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5425+0+0 (secure 0 0 0) 0x7fef640828a0 con 0x7fef6c1535b0 2023-06-10T19:01:54.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.715+0000 7fef6bfff640 1 --2- 172.21.15.53:0/3836344339 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fef4c066280 0x7fef4c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:54.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.715+0000 7fef6bfff640 1 --2- 172.21.15.53:0/3836344339 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fef4c066280 0x7fef4c068730 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fef5c0ab000 tx=0x7fef5c0b1040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:54.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.715+0000 7fef68ff9640 1 -- 172.21.15.53:0/3836344339 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fef64053ab0 con 0x7fef6c1535b0 2023-06-10T19:01:54.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:54.927+0000 7fef728c7640 1 -- 172.21.15.53:0/3836344339 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_create_fsync"]} v 0) v1 -- 0x7fef6c0cb140 con 0x7fef6c1535b0 2023-06-10T19:01:55.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:55.215+0000 7fef68ff9640 1 -- 172.21.15.53:0/3836344339 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_create_fsync"]}]=0 v421) v1 ==== 149+0+0 (secure 0 0 0) 0x7fef640180d0 con 0x7fef6c1535b0 2023-06-10T19:01:55.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:55.219+0000 7fef728c7640 1 -- 172.21.15.53:0/3836344339 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fef4c066280 msgr2=0x7fef4c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:55.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:55.219+0000 7fef728c7640 1 --2- 172.21.15.53:0/3836344339 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fef4c066280 0x7fef4c068730 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fef5c0ab000 tx=0x7fef5c0b1040 comp rx=0 tx=0).stop 2023-06-10T19:01:55.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:55.219+0000 7fef728c7640 1 -- 172.21.15.53:0/3836344339 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef6c1535b0 msgr2=0x7fef6c153a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:55.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:55.219+0000 7fef728c7640 1 --2- 172.21.15.53:0/3836344339 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef6c1535b0 0x7fef6c153a20 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7fef6400d400 tx=0x7fef6400d4f0 comp rx=0 tx=0).stop 2023-06-10T19:01:55.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:55.219+0000 7fef728c7640 1 -- 172.21.15.53:0/3836344339 shutdown_connections 2023-06-10T19:01:55.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:55.219+0000 7fef728c7640 1 --2- 172.21.15.53:0/3836344339 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fef4c066280 0x7fef4c068730 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:55.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:55.219+0000 7fef728c7640 1 --2- 172.21.15.53:0/3836344339 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef6c1535b0 0x7fef6c153a20 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:55.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:55.219+0000 7fef728c7640 1 --2- 172.21.15.53:0/3836344339 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef6c0b2ea0 0x7fef6c0b3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:55.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:55.219+0000 7fef728c7640 1 --2- 172.21.15.53:0/3836344339 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef580039f0 0x7fef6c14c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:55.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:55.219+0000 7fef728c7640 1 -- 172.21.15.53:0/3836344339 >> 172.21.15.53:0/3836344339 conn(0x7fef6c06a0d0 msgr2=0x7fef6c0ca350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:55.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:55.219+0000 7fef728c7640 1 -- 172.21.15.53:0/3836344339 shutdown_connections 2023-06-10T19:01:55.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:55.219+0000 7fef728c7640 1 -- 172.21.15.53:0/3836344339 wait complete. 2023-06-10T19:01:55.248 INFO:tasks.cephfs_test_runner:test_create_fsync (tasks.cephfs.test_client_recovery.TestClientRecovery) ... ok 2023-06-10T19:01:55.249 INFO:tasks.cephfs_test_runner:Starting test: test_dir_fsync (tasks.cephfs.test_client_recovery.TestClientRecovery) 2023-06-10T19:01:55.249 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_dir_fsync' 2023-06-10T19:01:55.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:55.375+0000 7f5a8b541640 1 Processor -- start 2023-06-10T19:01:55.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:55.375+0000 7f5a8b541640 1 -- start start 2023-06-10T19:01:55.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:55.375+0000 7f5a8b541640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5a840b3ac0 0x7f5a840b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:55.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:55.375+0000 7f5a8b541640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5a840cc690 0x7f5a8415f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:55.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:55.375+0000 7f5a8b541640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5a840ccae0 0x7f5a8415f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:55.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:55.375+0000 7f5a8b541640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a840d0020 con 0x7f5a840ccae0 2023-06-10T19:01:55.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:55.375+0000 7f5a8b541640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a840b43d0 con 0x7f5a840cc690 2023-06-10T19:01:55.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:55.375+0000 7f5a8b541640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a840cef40 con 0x7f5a840b3ac0 2023-06-10T19:01:55.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:55.375+0000 7f5a89ade640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5a840ccae0 0x7f5a8415f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:55.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:55.375+0000 7f5a89ade640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5a840ccae0 0x7f5a8415f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59910/0 (socket says 172.21.15.53:59910) 2023-06-10T19:01:55.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:55.375+0000 7f5a89ade640 1 -- 172.21.15.53:0/2219773066 learned_addr learned my addr 172.21.15.53:0/2219773066 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:55.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:55.375+0000 7f5a892dd640 1 --2- 172.21.15.53:0/2219773066 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5a840b3ac0 0x7f5a840b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:55.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:55.375+0000 7f5a88adc640 1 --2- 172.21.15.53:0/2219773066 >> v2:172.21.15.117:3300/0 conn(0x7f5a840cc690 0x7f5a8415f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:55.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:55.375+0000 7f5a89ade640 1 -- 172.21.15.53:0/2219773066 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5a840b3ac0 msgr2=0x7f5a840b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:55.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:55.375+0000 7f5a89ade640 1 --2- 172.21.15.53:0/2219773066 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5a840b3ac0 0x7f5a840b3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:55.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:55.375+0000 7f5a89ade640 1 -- 172.21.15.53:0/2219773066 >> v2:172.21.15.117:3300/0 conn(0x7f5a840cc690 msgr2=0x7f5a8415f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:55.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:55.375+0000 7f5a89ade640 1 --2- 172.21.15.53:0/2219773066 >> v2:172.21.15.117:3300/0 conn(0x7f5a840cc690 0x7f5a8415f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:55.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:55.375+0000 7f5a89ade640 1 -- 172.21.15.53:0/2219773066 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a840cf220 con 0x7f5a840ccae0 2023-06-10T19:01:55.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:55.375+0000 7f5a88adc640 1 --2- 172.21.15.53:0/2219773066 >> v2:172.21.15.117:3300/0 conn(0x7f5a840cc690 0x7f5a8415f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:01:55.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:55.379+0000 7f5a89ade640 1 --2- 172.21.15.53:0/2219773066 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a840ccae0 0x7f5a8415f8b0 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f5a84069cb0 tx=0x7f5a7c01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa273e31642f218a server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:55.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:55.379+0000 7f5a7bfff640 1 -- 172.21.15.53:0/2219773066 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a7c0a5730 con 0x7f5a840ccae0 2023-06-10T19:01:55.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:55.379+0000 7f5a7bfff640 1 -- 172.21.15.53:0/2219773066 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a7c0a5890 con 0x7f5a840ccae0 2023-06-10T19:01:55.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:55.379+0000 7f5a7bfff640 1 -- 172.21.15.53:0/2219773066 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a7c0a5c20 con 0x7f5a840ccae0 2023-06-10T19:01:55.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:55.379+0000 7f5a8b541640 1 -- 172.21.15.53:0/2219773066 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a840ccae0 msgr2=0x7f5a8415f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:55.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:55.379+0000 7f5a8b541640 1 --2- 172.21.15.53:0/2219773066 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a840ccae0 0x7f5a8415f8b0 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f5a84069cb0 tx=0x7f5a7c01c9a0 comp rx=0 tx=0).stop 2023-06-10T19:01:55.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:55.379+0000 7f5a8b541640 1 -- 172.21.15.53:0/2219773066 shutdown_connections 2023-06-10T19:01:55.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:55.379+0000 7f5a8b541640 1 --2- 172.21.15.53:0/2219773066 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a840ccae0 0x7f5a8415f8b0 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:55.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:55.379+0000 7f5a8b541640 1 --2- 172.21.15.53:0/2219773066 >> v2:172.21.15.117:3300/0 conn(0x7f5a840cc690 0x7f5a8415f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:55.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:55.379+0000 7f5a8b541640 1 --2- 172.21.15.53:0/2219773066 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5a840b3ac0 0x7f5a840b3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:55.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:55.379+0000 7f5a8b541640 1 -- 172.21.15.53:0/2219773066 >> 172.21.15.53:0/2219773066 conn(0x7f5a84071790 msgr2=0x7f5a84069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:55.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:55.379+0000 7f5a8b541640 1 -- 172.21.15.53:0/2219773066 shutdown_connections 2023-06-10T19:01:55.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:55.379+0000 7f5a8b541640 1 -- 172.21.15.53:0/2219773066 wait complete. 2023-06-10T19:01:55.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:55.379+0000 7f5a8b541640 1 Processor -- start 2023-06-10T19:01:55.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:55.379+0000 7f5a8b541640 1 -- start start 2023-06-10T19:01:55.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:55.379+0000 7f5a8b541640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5a840b3ac0 0x7f5a841506d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:55.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:55.379+0000 7f5a8b541640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a840cc690 0x7f5a8415cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:55.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:55.383+0000 7f5a8b541640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5a840ccae0 0x7f5a84158c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:55.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:55.383+0000 7f5a8b541640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a84150d50 con 0x7f5a840cc690 2023-06-10T19:01:55.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:55.383+0000 7f5a8b541640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a84151bb0 con 0x7f5a840b3ac0 2023-06-10T19:01:55.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:55.383+0000 7f5a8b541640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a84150fa0 con 0x7f5a840ccae0 2023-06-10T19:01:55.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:55.383+0000 7f5a88adc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a840cc690 0x7f5a8415cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:55.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:55.383+0000 7f5a88adc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a840cc690 0x7f5a8415cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59922/0 (socket says 172.21.15.53:59922) 2023-06-10T19:01:55.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:55.383+0000 7f5a88adc640 1 -- 172.21.15.53:0/1004959625 learned_addr learned my addr 172.21.15.53:0/1004959625 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:55.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:55.383+0000 7f5a89ade640 1 --2- 172.21.15.53:0/1004959625 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5a840ccae0 0x7f5a84158c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:55.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:55.383+0000 7f5a892dd640 1 --2- 172.21.15.53:0/1004959625 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5a840b3ac0 0x7f5a841506d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:55.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:55.383+0000 7f5a88adc640 1 -- 172.21.15.53:0/1004959625 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5a840ccae0 msgr2=0x7f5a84158c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:55.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:55.383+0000 7f5a88adc640 1 --2- 172.21.15.53:0/1004959625 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5a840ccae0 0x7f5a84158c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:55.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:55.383+0000 7f5a88adc640 1 -- 172.21.15.53:0/1004959625 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5a840b3ac0 msgr2=0x7f5a841506d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:55.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:55.383+0000 7f5a88adc640 1 --2- 172.21.15.53:0/1004959625 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5a840b3ac0 0x7f5a841506d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:55.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:55.383+0000 7f5a88adc640 1 -- 172.21.15.53:0/1004959625 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a7c009b30 con 0x7f5a840cc690 2023-06-10T19:01:55.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:55.383+0000 7f5a89ade640 1 --2- 172.21.15.53:0/1004959625 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5a840ccae0 0x7f5a84158c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:01:55.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:55.383+0000 7f5a88adc640 1 --2- 172.21.15.53:0/1004959625 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a840cc690 0x7f5a8415cf70 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f5a7400c7c0 tx=0x7f5a7400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:55.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:55.383+0000 7f5a79ffb640 1 -- 172.21.15.53:0/1004959625 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a74007a30 con 0x7f5a840cc690 2023-06-10T19:01:55.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:55.383+0000 7f5a79ffb640 1 -- 172.21.15.53:0/1004959625 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a74007b90 con 0x7f5a840cc690 2023-06-10T19:01:55.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:55.383+0000 7f5a8b541640 1 -- 172.21.15.53:0/1004959625 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a84151280 con 0x7f5a840cc690 2023-06-10T19:01:55.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:55.383+0000 7f5a79ffb640 1 -- 172.21.15.53:0/1004959625 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a7400ce70 con 0x7f5a840cc690 2023-06-10T19:01:55.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:55.383+0000 7f5a8b541640 1 -- 172.21.15.53:0/1004959625 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a84151840 con 0x7f5a840cc690 2023-06-10T19:01:55.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:55.383+0000 7f5a8b541640 1 -- 172.21.15.53:0/1004959625 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a84151d20 con 0x7f5a840cc690 2023-06-10T19:01:55.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:55.383+0000 7f5a79ffb640 1 -- 172.21.15.53:0/1004959625 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5a740113f0 con 0x7f5a840cc690 2023-06-10T19:01:55.395 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:55.383+0000 7f5a79ffb640 1 --2- 172.21.15.53:0/1004959625 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5a68066280 0x7f5a68068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:55.395 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:55.383+0000 7f5a79ffb640 1 -- 172.21.15.53:0/1004959625 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5425+0+0 (secure 0 0 0) 0x7f5a74084060 con 0x7f5a840cc690 2023-06-10T19:01:55.395 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:55.383+0000 7f5a892dd640 1 --2- 172.21.15.53:0/1004959625 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5a68066280 0x7f5a68068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:55.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:55.387+0000 7f5a892dd640 1 --2- 172.21.15.53:0/1004959625 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5a68066280 0x7f5a68068730 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f5a84159fa0 tx=0x7f5a80008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:55.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:55.387+0000 7f5a79ffb640 1 -- 172.21.15.53:0/1004959625 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5a740b4700 con 0x7f5a840cc690 2023-06-10T19:01:55.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:55.595+0000 7f5a8b541640 1 -- 172.21.15.53:0/1004959625 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_dir_fsync"]} v 0) v1 -- 0x7f5a8404d790 con 0x7f5a840cc690 2023-06-10T19:01:56.235 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.227+0000 7f5a79ffb640 1 -- 172.21.15.53:0/1004959625 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_dir_fsync"]}]=0 v422) v1 ==== 149+0+0 (secure 0 0 0) 0x7f5a740516c0 con 0x7f5a840cc690 2023-06-10T19:01:56.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.231+0000 7f5a8b541640 1 -- 172.21.15.53:0/1004959625 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5a68066280 msgr2=0x7f5a68068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:56.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.231+0000 7f5a8b541640 1 --2- 172.21.15.53:0/1004959625 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5a68066280 0x7f5a68068730 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f5a84159fa0 tx=0x7f5a80008040 comp rx=0 tx=0).stop 2023-06-10T19:01:56.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.231+0000 7f5a8b541640 1 -- 172.21.15.53:0/1004959625 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a840cc690 msgr2=0x7f5a8415cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:56.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.231+0000 7f5a8b541640 1 --2- 172.21.15.53:0/1004959625 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a840cc690 0x7f5a8415cf70 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f5a7400c7c0 tx=0x7f5a7400cc80 comp rx=0 tx=0).stop 2023-06-10T19:01:56.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.231+0000 7f5a8b541640 1 -- 172.21.15.53:0/1004959625 shutdown_connections 2023-06-10T19:01:56.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.231+0000 7f5a8b541640 1 --2- 172.21.15.53:0/1004959625 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5a68066280 0x7f5a68068730 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:56.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.231+0000 7f5a8b541640 1 --2- 172.21.15.53:0/1004959625 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5a840ccae0 0x7f5a84158c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:56.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.231+0000 7f5a8b541640 1 --2- 172.21.15.53:0/1004959625 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a840cc690 0x7f5a8415cf70 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:56.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.231+0000 7f5a8b541640 1 --2- 172.21.15.53:0/1004959625 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5a840b3ac0 0x7f5a841506d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:56.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.231+0000 7f5a8b541640 1 -- 172.21.15.53:0/1004959625 >> 172.21.15.53:0/1004959625 conn(0x7f5a84071790 msgr2=0x7f5a840b30a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:56.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.231+0000 7f5a8b541640 1 -- 172.21.15.53:0/1004959625 shutdown_connections 2023-06-10T19:01:56.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.231+0000 7f5a8b541640 1 -- 172.21.15.53:0/1004959625 wait complete. 2023-06-10T19:01:56.261 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-06-10T19:01:56.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.387+0000 7ff634fe8640 1 Processor -- start 2023-06-10T19:01:56.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.387+0000 7ff634fe8640 1 -- start start 2023-06-10T19:01:56.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.387+0000 7ff634fe8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff6300c9fa0 0x7ff63006bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:56.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.387+0000 7ff634fe8640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6300af760 0x7ff6300afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:56.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.387+0000 7ff634fe8640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff63006b090 con 0x7ff63006c020 2023-06-10T19:01:56.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.387+0000 7ff634fe8640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6300b0120 con 0x7ff6300c9fa0 2023-06-10T19:01:56.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.387+0000 7ff634fe8640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6300ca370 con 0x7ff6300af760 2023-06-10T19:01:56.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.387+0000 7ff62e59c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff6300c9fa0 0x7ff63006bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:56.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.387+0000 7ff62dd9b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ff63006c020 0x7ff6300c82a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56672/0 (socket says 172.21.15.53:56672) 2023-06-10T19:01:56.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.387+0000 7ff62dd9b640 1 -- 172.21.15.53:0/3179726099 learned_addr learned my addr 172.21.15.53:0/3179726099 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:01:56.395 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.387+0000 7ff62ed9d640 1 --2- 172.21.15.53:0/3179726099 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6300af760 0x7ff6300afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:56.395 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.387+0000 7ff62e59c640 1 -- 172.21.15.53:0/3179726099 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6300af760 msgr2=0x7ff6300afbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:56.395 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.387+0000 7ff62e59c640 1 --2- 172.21.15.53:0/3179726099 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6300af760 0x7ff6300afbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:56.395 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.387+0000 7ff62e59c640 1 -- 172.21.15.53:0/3179726099 >> v1:172.21.15.53:6789/0 conn(0x7ff63006c020 legacy=0x7ff6300c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:56.395 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.387+0000 7ff62e59c640 1 -- 172.21.15.53:0/3179726099 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff630070d50 con 0x7ff6300c9fa0 2023-06-10T19:01:56.395 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.387+0000 7ff62d59a640 1 -- 172.21.15.53:0/3179726099 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1824279196 0 0) 0x7ff63006b090 con 0x7ff63006c020 2023-06-10T19:01:56.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.391+0000 7ff62e59c640 1 --2- 172.21.15.53:0/3179726099 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff6300c9fa0 0x7ff63006bae0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7ff618009d90 tx=0x7ff61801c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ee85becf6369384 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:56.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.391+0000 7ff62d59a640 1 -- 172.21.15.53:0/3179726099 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6180a5950 con 0x7ff6300c9fa0 2023-06-10T19:01:56.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.391+0000 7ff62d59a640 1 -- 172.21.15.53:0/3179726099 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6180a5ab0 con 0x7ff6300c9fa0 2023-06-10T19:01:56.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.391+0000 7ff62d59a640 1 -- 172.21.15.53:0/3179726099 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6180a5e40 con 0x7ff6300c9fa0 2023-06-10T19:01:56.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.391+0000 7ff634fe8640 1 -- 172.21.15.53:0/3179726099 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff6300c9fa0 msgr2=0x7ff63006bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:56.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.391+0000 7ff634fe8640 1 --2- 172.21.15.53:0/3179726099 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff6300c9fa0 0x7ff63006bae0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7ff618009d90 tx=0x7ff61801c890 comp rx=0 tx=0).stop 2023-06-10T19:01:56.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.391+0000 7ff634fe8640 1 -- 172.21.15.53:0/3179726099 shutdown_connections 2023-06-10T19:01:56.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.391+0000 7ff634fe8640 1 --2- 172.21.15.53:0/3179726099 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6300af760 0x7ff6300afbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:56.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.391+0000 7ff634fe8640 1 --2- 172.21.15.53:0/3179726099 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff6300c9fa0 0x7ff63006bae0 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:56.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.391+0000 7ff634fe8640 1 -- 172.21.15.53:0/3179726099 >> 172.21.15.53:0/3179726099 conn(0x7ff63006a0e0 msgr2=0x7ff6300cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:56.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.391+0000 7ff634fe8640 1 -- 172.21.15.53:0/3179726099 shutdown_connections 2023-06-10T19:01:56.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.391+0000 7ff634fe8640 1 -- 172.21.15.53:0/3179726099 wait complete. 2023-06-10T19:01:56.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.391+0000 7ff634fe8640 1 Processor -- start 2023-06-10T19:01:56.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.391+0000 7ff634fe8640 1 -- start start 2023-06-10T19:01:56.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.395+0000 7ff634fe8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff63006c020 0x7ff630159160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:56.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.395+0000 7ff634fe8640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6300af760 0x7ff6300c3be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:56.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.395+0000 7ff634fe8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff6300c9fa0 0x7ff6300c4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:56.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.395+0000 7ff634fe8640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6300cc2f0 con 0x7ff6300c9fa0 2023-06-10T19:01:56.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.395+0000 7ff634fe8640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6300adbd0 con 0x7ff63006c020 2023-06-10T19:01:56.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.395+0000 7ff634fe8640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6301f3fe0 con 0x7ff6300af760 2023-06-10T19:01:56.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.395+0000 7ff62ed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff6300c9fa0 0x7ff6300c4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:56.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.395+0000 7ff62ed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff6300c9fa0 0x7ff6300c4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59948/0 (socket says 172.21.15.53:59948) 2023-06-10T19:01:56.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.395+0000 7ff62ed9d640 1 -- 172.21.15.53:0/510271901 learned_addr learned my addr 172.21.15.53:0/510271901 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:56.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.395+0000 7ff62dd9b640 1 --2- 172.21.15.53:0/510271901 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6300af760 0x7ff6300c3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:56.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.395+0000 7ff62e59c640 1 --2- 172.21.15.53:0/510271901 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff63006c020 0x7ff630159160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:56.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.395+0000 7ff62ed9d640 1 -- 172.21.15.53:0/510271901 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6300af760 msgr2=0x7ff6300c3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:56.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.395+0000 7ff62ed9d640 1 --2- 172.21.15.53:0/510271901 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6300af760 0x7ff6300c3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:56.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.395+0000 7ff62ed9d640 1 -- 172.21.15.53:0/510271901 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff63006c020 msgr2=0x7ff630159160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:56.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.395+0000 7ff62ed9d640 1 --2- 172.21.15.53:0/510271901 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff63006c020 0x7ff630159160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:56.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.395+0000 7ff62ed9d640 1 -- 172.21.15.53:0/510271901 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff618009a70 con 0x7ff6300c9fa0 2023-06-10T19:01:56.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.395+0000 7ff62e59c640 1 --2- 172.21.15.53:0/510271901 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff63006c020 0x7ff630159160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:01:56.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.395+0000 7ff62dd9b640 1 --2- 172.21.15.53:0/510271901 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6300af760 0x7ff6300c3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:01:56.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.395+0000 7ff62ed9d640 1 --2- 172.21.15.53:0/510271901 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff6300c9fa0 0x7ff6300c4120 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7ff62800d800 tx=0x7ff62800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:56.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.395+0000 7ff626ffd640 1 -- 172.21.15.53:0/510271901 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff62800b6c0 con 0x7ff6300c9fa0 2023-06-10T19:01:56.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.395+0000 7ff626ffd640 1 -- 172.21.15.53:0/510271901 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff62800b820 con 0x7ff6300c9fa0 2023-06-10T19:01:56.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.395+0000 7ff634fe8640 1 -- 172.21.15.53:0/510271901 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6300cb950 con 0x7ff6300c9fa0 2023-06-10T19:01:56.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.395+0000 7ff626ffd640 1 -- 172.21.15.53:0/510271901 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff62800bbd0 con 0x7ff6300c9fa0 2023-06-10T19:01:56.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.395+0000 7ff634fe8640 1 -- 172.21.15.53:0/510271901 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6300cbf10 con 0x7ff6300c9fa0 2023-06-10T19:01:56.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.395+0000 7ff634fe8640 1 -- 172.21.15.53:0/510271901 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6300cc430 con 0x7ff6300c9fa0 2023-06-10T19:01:56.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.395+0000 7ff626ffd640 1 -- 172.21.15.53:0/510271901 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff62800bd30 con 0x7ff6300c9fa0 2023-06-10T19:01:56.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.395+0000 7ff626ffd640 1 --2- 172.21.15.53:0/510271901 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff610066280 0x7ff610068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:56.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.395+0000 7ff626ffd640 1 -- 172.21.15.53:0/510271901 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5425+0+0 (secure 0 0 0) 0x7ff628083ff0 con 0x7ff6300c9fa0 2023-06-10T19:01:56.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.395+0000 7ff62e59c640 1 --2- 172.21.15.53:0/510271901 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff610066280 0x7ff610068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:56.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.399+0000 7ff62e59c640 1 --2- 172.21.15.53:0/510271901 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff610066280 0x7ff610068730 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7ff6180af000 tx=0x7ff6180a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:56.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.399+0000 7ff626ffd640 1 -- 172.21.15.53:0/510271901 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff6280b4700 con 0x7ff6300c9fa0 2023-06-10T19:01:56.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.555+0000 7ff634fe8640 1 -- 172.21.15.53:0/510271901 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7ff6300cd890 con 0x7ff6300c9fa0 2023-06-10T19:01:56.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.559+0000 7ff626ffd640 1 -- 172.21.15.53:0/510271901 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff6300cd890 con 0x7ff6300c9fa0 2023-06-10T19:01:56.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.563+0000 7ff634fe8640 1 -- 172.21.15.53:0/510271901 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff610066280 msgr2=0x7ff610068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:56.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.563+0000 7ff634fe8640 1 --2- 172.21.15.53:0/510271901 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff610066280 0x7ff610068730 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7ff6180af000 tx=0x7ff6180a7070 comp rx=0 tx=0).stop 2023-06-10T19:01:56.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.563+0000 7ff634fe8640 1 -- 172.21.15.53:0/510271901 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff6300c9fa0 msgr2=0x7ff6300c4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:56.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.563+0000 7ff634fe8640 1 --2- 172.21.15.53:0/510271901 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff6300c9fa0 0x7ff6300c4120 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7ff62800d800 tx=0x7ff62800dcc0 comp rx=0 tx=0).stop 2023-06-10T19:01:56.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.563+0000 7ff634fe8640 1 -- 172.21.15.53:0/510271901 shutdown_connections 2023-06-10T19:01:56.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.563+0000 7ff634fe8640 1 --2- 172.21.15.53:0/510271901 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff610066280 0x7ff610068730 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:56.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.563+0000 7ff634fe8640 1 --2- 172.21.15.53:0/510271901 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff6300c9fa0 0x7ff6300c4120 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:56.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.563+0000 7ff634fe8640 1 --2- 172.21.15.53:0/510271901 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6300af760 0x7ff6300c3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:56.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.563+0000 7ff634fe8640 1 --2- 172.21.15.53:0/510271901 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff63006c020 0x7ff630159160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:56.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.563+0000 7ff634fe8640 1 -- 172.21.15.53:0/510271901 >> 172.21.15.53:0/510271901 conn(0x7ff63006a0e0 msgr2=0x7ff6300c8ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:56.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.563+0000 7ff634fe8640 1 -- 172.21.15.53:0/510271901 shutdown_connections 2023-06-10T19:01:56.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.563+0000 7ff634fe8640 1 -- 172.21.15.53:0/510271901 wait complete. 2023-06-10T19:01:56.586 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-06-10T19:01:56.587 DEBUG:teuthology.orchestra.run.smithi053:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-06-10T19:01:56.633 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-06-10T19:01:56.677 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-06-10T19:01:56.678 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T19:01:56.678 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:01:56.683 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16345192k,nr_inodes=4086298,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276544k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=407 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276540k,nr_inodes=819135,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276544k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-06-10T19:01:56.684 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T19:01:56.684 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:01:56.726 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16342088k,nr_inodes=4085522,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275924k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18845 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275920k,nr_inodes=818980,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275924k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-06-10T19:01:56.726 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T19:01:56.727 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:01:56.735 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16345192k,nr_inodes=4086298,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276544k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=407 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276540k,nr_inodes=819135,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276544k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-06-10T19:01:56.736 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T19:01:56.736 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:01:56.773 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16342088k,nr_inodes=4085522,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275924k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18845 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275920k,nr_inodes=818980,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275924k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-06-10T19:01:56.773 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-06-10T19:01:56.774 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:01:56.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.907+0000 7fc069357640 1 Processor -- start 2023-06-10T19:01:56.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.907+0000 7fc069357640 1 -- start start 2023-06-10T19:01:56.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.907+0000 7fc069357640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc064161180 0x7fc064163560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:56.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.907+0000 7fc069357640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc064158a90 con 0x7fc0640c8d00 2023-06-10T19:01:56.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.907+0000 7fc069357640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc06406f780 con 0x7fc06406b2f0 2023-06-10T19:01:56.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.907+0000 7fc069357640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0640705d0 con 0x7fc064161180 2023-06-10T19:01:56.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.907+0000 7fc0627fc640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fc0640c8d00 0x7fc06406b6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56688/0 (socket says 172.21.15.53:56688) 2023-06-10T19:01:56.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.907+0000 7fc0627fc640 1 -- 172.21.15.53:0/280989269 learned_addr learned my addr 172.21.15.53:0/280989269 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:01:56.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.907+0000 7fc0637fe640 1 --2- 172.21.15.53:0/280989269 >> v2:172.21.15.117:3300/0 conn(0x7fc064161180 0x7fc064163560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:56.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.907+0000 7fc061ffb640 1 -- 172.21.15.53:0/280989269 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1818892960 0 0) 0x7fc058001120 con 0x7fc0640c8d00 2023-06-10T19:01:56.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.907+0000 7fc061ffb640 1 -- 172.21.15.53:0/280989269 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc04c003530 con 0x7fc0640c8d00 2023-06-10T19:01:56.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.907+0000 7fc061ffb640 1 -- 172.21.15.53:0/280989269 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1957494744 0 0) 0x7fc04c003530 con 0x7fc0640c8d00 2023-06-10T19:01:56.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.907+0000 7fc061ffb640 1 -- 172.21.15.53:0/280989269 >> v2:172.21.15.117:3300/0 conn(0x7fc064161180 msgr2=0x7fc064163560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:56.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.907+0000 7fc061ffb640 1 --2- 172.21.15.53:0/280989269 >> v2:172.21.15.117:3300/0 conn(0x7fc064161180 0x7fc064163560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:56.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.907+0000 7fc061ffb640 1 -- 172.21.15.53:0/280989269 >> v1:172.21.15.117:6789/0 conn(0x7fc06406b2f0 legacy=0x7fc06406f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:56.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.907+0000 7fc061ffb640 1 -- 172.21.15.53:0/280989269 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0640cce10 con 0x7fc0640c8d00 2023-06-10T19:01:56.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.907+0000 7fc061ffb640 1 -- 172.21.15.53:0/280989269 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fc058001810 con 0x7fc0640c8d00 2023-06-10T19:01:56.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.907+0000 7fc061ffb640 1 -- 172.21.15.53:0/280989269 >> v1:172.21.15.53:6789/0 conn(0x7fc0640c8d00 legacy=0x7fc06406b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:56.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.907+0000 7fc061ffb640 1 --2- 172.21.15.53:0/280989269 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc04c0039f0 0x7fc04c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:56.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.907+0000 7fc061ffb640 1 --2- 172.21.15.53:0/280989269 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc04c0047d0 0x7fc04c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:56.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.907+0000 7fc061ffb640 1 --2- 172.21.15.53:0/280989269 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc04c005180 0x7fc04c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:56.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.907+0000 7fc061ffb640 1 -- 172.21.15.53:0/280989269 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0640705d0 con 0x7fc04c005180 2023-06-10T19:01:56.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.907+0000 7fc061ffb640 1 -- 172.21.15.53:0/280989269 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc04c00c070 con 0x7fc04c0047d0 2023-06-10T19:01:56.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.907+0000 7fc061ffb640 1 -- 172.21.15.53:0/280989269 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc04c00c230 con 0x7fc04c0039f0 2023-06-10T19:01:56.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.907+0000 7fc0637fe640 1 --2- 172.21.15.53:0/280989269 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc04c005180 0x7fc04c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:56.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.907+0000 7fc062ffd640 1 --2- 172.21.15.53:0/280989269 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc04c0039f0 0x7fc04c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:56.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.907+0000 7fc0627fc640 1 --2- 172.21.15.53:0/280989269 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc04c0047d0 0x7fc04c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:56.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.907+0000 7fc0637fe640 1 -- 172.21.15.53:0/280989269 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc04c0039f0 msgr2=0x7fc04c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:56.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.907+0000 7fc0637fe640 1 --2- 172.21.15.53:0/280989269 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc04c0039f0 0x7fc04c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:56.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.907+0000 7fc0637fe640 1 -- 172.21.15.53:0/280989269 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc04c0047d0 msgr2=0x7fc04c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:56.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.907+0000 7fc0637fe640 1 --2- 172.21.15.53:0/280989269 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc04c0047d0 0x7fc04c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:56.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.907+0000 7fc0637fe640 1 -- 172.21.15.53:0/280989269 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc04c003530 con 0x7fc04c005180 2023-06-10T19:01:56.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.907+0000 7fc0627fc640 1 --2- 172.21.15.53:0/280989269 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc04c0047d0 0x7fc04c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:01:56.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.911+0000 7fc0637fe640 1 -- 172.21.15.53:0/280989269 reap_dead start 2023-06-10T19:01:56.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.911+0000 7fc0637fe640 1 --2- 172.21.15.53:0/280989269 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc04c005180 0x7fc04c00b990 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7fc06406e7e0 tx=0x7fc05c01cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aad02d48675becdc server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:56.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.911+0000 7fc061ffb640 1 -- 172.21.15.53:0/280989269 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05c0a5c50 con 0x7fc04c005180 2023-06-10T19:01:56.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.911+0000 7fc061ffb640 1 -- 172.21.15.53:0/280989269 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc05c00f040 con 0x7fc04c005180 2023-06-10T19:01:56.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.911+0000 7fc061ffb640 1 -- 172.21.15.53:0/280989269 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05c0039a0 con 0x7fc04c005180 2023-06-10T19:01:56.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.911+0000 7fc069357640 1 -- 172.21.15.53:0/280989269 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc04c005180 msgr2=0x7fc04c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:56.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.911+0000 7fc069357640 1 --2- 172.21.15.53:0/280989269 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc04c005180 0x7fc04c00b990 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7fc06406e7e0 tx=0x7fc05c01cc40 comp rx=0 tx=0).stop 2023-06-10T19:01:56.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.911+0000 7fc069357640 1 -- 172.21.15.53:0/280989269 shutdown_connections 2023-06-10T19:01:56.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.911+0000 7fc069357640 1 --2- 172.21.15.53:0/280989269 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc04c005180 0x7fc04c00b990 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:56.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.911+0000 7fc069357640 1 -- 172.21.15.53:0/280989269 >> 172.21.15.53:0/280989269 conn(0x7fc06406a0d0 msgr2=0x7fc0640ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:56.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.911+0000 7fc069357640 1 -- 172.21.15.53:0/280989269 shutdown_connections 2023-06-10T19:01:56.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.911+0000 7fc069357640 1 -- 172.21.15.53:0/280989269 wait complete. 2023-06-10T19:01:56.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.911+0000 7fc069357640 1 Processor -- start 2023-06-10T19:01:56.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.911+0000 7fc069357640 1 -- start start 2023-06-10T19:01:56.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.915+0000 7fc069357640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc04c005180 0x7fc064152ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:56.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.915+0000 7fc069357640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0641539d0 0x7fc064154de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:56.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.915+0000 7fc069357640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc064153e40 0x7fc0640ab860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:56.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.915+0000 7fc069357640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0640c7f00 con 0x7fc04c005180 2023-06-10T19:01:56.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.915+0000 7fc069357640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0640c81e0 con 0x7fc0641539d0 2023-06-10T19:01:56.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.915+0000 7fc069357640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc064154300 con 0x7fc064153e40 2023-06-10T19:01:56.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.915+0000 7fc062ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc04c005180 0x7fc064152ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:56.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.915+0000 7fc062ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc04c005180 0x7fc064152ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59956/0 (socket says 172.21.15.53:59956) 2023-06-10T19:01:56.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.915+0000 7fc062ffd640 1 -- 172.21.15.53:0/1341922209 learned_addr learned my addr 172.21.15.53:0/1341922209 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:56.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.915+0000 7fc0637fe640 1 --2- 172.21.15.53:0/1341922209 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc064153e40 0x7fc0640ab860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:56.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.915+0000 7fc0627fc640 1 --2- 172.21.15.53:0/1341922209 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0641539d0 0x7fc064154de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:56.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.915+0000 7fc062ffd640 1 -- 172.21.15.53:0/1341922209 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc064153e40 msgr2=0x7fc0640ab860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:56.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.915+0000 7fc062ffd640 1 --2- 172.21.15.53:0/1341922209 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc064153e40 0x7fc0640ab860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:56.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.915+0000 7fc062ffd640 1 -- 172.21.15.53:0/1341922209 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0641539d0 msgr2=0x7fc064154de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:56.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.915+0000 7fc062ffd640 1 --2- 172.21.15.53:0/1341922209 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0641539d0 0x7fc064154de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:56.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.915+0000 7fc062ffd640 1 -- 172.21.15.53:0/1341922209 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0641545e0 con 0x7fc04c005180 2023-06-10T19:01:56.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.915+0000 7fc0637fe640 1 --2- 172.21.15.53:0/1341922209 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc064153e40 0x7fc0640ab860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:01:56.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.915+0000 7fc062ffd640 1 --2- 172.21.15.53:0/1341922209 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc04c005180 0x7fc064152ee0 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7fc05400e4b0 tx=0x7fc05400e970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:56.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.915+0000 7fc04b7fe640 1 -- 172.21.15.53:0/1341922209 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0540052e0 con 0x7fc04c005180 2023-06-10T19:01:56.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.915+0000 7fc04b7fe640 1 -- 172.21.15.53:0/1341922209 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc054005440 con 0x7fc04c005180 2023-06-10T19:01:56.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.915+0000 7fc069357640 1 -- 172.21.15.53:0/1341922209 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0641548c0 con 0x7fc04c005180 2023-06-10T19:01:56.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.915+0000 7fc04b7fe640 1 -- 172.21.15.53:0/1341922209 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc054003840 con 0x7fc04c005180 2023-06-10T19:01:56.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.915+0000 7fc069357640 1 -- 172.21.15.53:0/1341922209 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc064155320 con 0x7fc04c005180 2023-06-10T19:01:56.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.915+0000 7fc069357640 1 -- 172.21.15.53:0/1341922209 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc06404d790 con 0x7fc04c005180 2023-06-10T19:01:56.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.915+0000 7fc04b7fe640 1 -- 172.21.15.53:0/1341922209 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc0540039a0 con 0x7fc04c005180 2023-06-10T19:01:56.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.915+0000 7fc04b7fe640 1 --2- 172.21.15.53:0/1341922209 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc0500662b0 0x7fc050068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:56.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.915+0000 7fc04b7fe640 1 -- 172.21.15.53:0/1341922209 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5425+0+0 (secure 0 0 0) 0x7fc0540835e0 con 0x7fc04c005180 2023-06-10T19:01:56.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.915+0000 7fc0627fc640 1 --2- 172.21.15.53:0/1341922209 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc0500662b0 0x7fc050068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:56.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.919+0000 7fc0627fc640 1 --2- 172.21.15.53:0/1341922209 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc0500662b0 0x7fc050068760 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fc058001940 tx=0x7fc058009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:56.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:56.919+0000 7fc04b7fe640 1 -- 172.21.15.53:0/1341922209 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc054050d60 con 0x7fc04c005180 2023-06-10T19:01:57.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:57.107+0000 7fc069357640 1 -- 172.21.15.53:0/1341922209 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc06406f780 con 0x7fc04c005180 2023-06-10T19:01:57.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:57.107+0000 7fc04b7fe640 1 -- 172.21.15.53:0/1341922209 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+3535 (secure 0 0 0) 0x7fc06406f780 con 0x7fc04c005180 2023-06-10T19:01:57.115 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:01:57.115 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":42,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5663,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2600814414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2600814414},{"type":"v1","addr":"172.21.15.117:6835","nonce":2600814414}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6136,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1615882017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1615882017},{"type":"v1","addr":"172.21.15.117:6837","nonce":1615882017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6993,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/3732245174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3732245174},{"type":"v1","addr":"172.21.15.53:6833","nonce":3732245174}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":7764,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2583687091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2583687091},{"type":"v1","addr":"172.21.15.53:6835","nonce":2583687091}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42}],"filesystems":[]} 2023-06-10T19:01:57.116 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 42 2023-06-10T19:01:57.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:57.111+0000 7fc069357640 1 -- 172.21.15.53:0/1341922209 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc0500662b0 msgr2=0x7fc050068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:57.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:57.111+0000 7fc069357640 1 --2- 172.21.15.53:0/1341922209 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc0500662b0 0x7fc050068760 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fc058001940 tx=0x7fc058009040 comp rx=0 tx=0).stop 2023-06-10T19:01:57.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:57.111+0000 7fc069357640 1 -- 172.21.15.53:0/1341922209 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc04c005180 msgr2=0x7fc064152ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:57.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:57.111+0000 7fc069357640 1 --2- 172.21.15.53:0/1341922209 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc04c005180 0x7fc064152ee0 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7fc05400e4b0 tx=0x7fc05400e970 comp rx=0 tx=0).stop 2023-06-10T19:01:57.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:57.111+0000 7fc069357640 1 -- 172.21.15.53:0/1341922209 shutdown_connections 2023-06-10T19:01:57.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:57.111+0000 7fc069357640 1 --2- 172.21.15.53:0/1341922209 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc0500662b0 0x7fc050068760 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:57.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:57.111+0000 7fc069357640 1 --2- 172.21.15.53:0/1341922209 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc064153e40 0x7fc0640ab860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:57.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:57.111+0000 7fc069357640 1 --2- 172.21.15.53:0/1341922209 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0641539d0 0x7fc064154de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:57.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:57.111+0000 7fc069357640 1 --2- 172.21.15.53:0/1341922209 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc04c005180 0x7fc064152ee0 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:57.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:57.111+0000 7fc069357640 1 -- 172.21.15.53:0/1341922209 >> 172.21.15.53:0/1341922209 conn(0x7fc06406a0d0 msgr2=0x7fc06406b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:57.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:57.111+0000 7fc069357640 1 -- 172.21.15.53:0/1341922209 shutdown_connections 2023-06-10T19:01:57.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:57.111+0000 7fc069357640 1 -- 172.21.15.53:0/1341922209 wait complete. 2023-06-10T19:01:57.134 INFO:tasks.ceph.mds.a:Restarting daemon 2023-06-10T19:01:57.135 INFO:tasks.ceph.mds.a:Stopping old one... 2023-06-10T19:01:57.136 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-06-10T19:01:57.136 INFO:teuthology.orchestra.run:waiting for 300 2023-06-10T19:01:57.136 INFO:tasks.ceph.mds.c:Restarting daemon 2023-06-10T19:01:57.136 INFO:tasks.ceph.mds.c:Stopping old one... 2023-06-10T19:01:57.136 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-06-10T19:01:57.137 INFO:teuthology.orchestra.run:waiting for 300 2023-06-10T19:01:57.137 INFO:tasks.ceph.mds.b:Restarting daemon 2023-06-10T19:01:57.137 INFO:tasks.ceph.mds.b:Stopping old one... 2023-06-10T19:01:57.137 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-06-10T19:01:57.138 INFO:teuthology.orchestra.run:waiting for 300 2023-06-10T19:01:57.138 INFO:tasks.ceph.mds.d:Restarting daemon 2023-06-10T19:01:57.138 INFO:tasks.ceph.mds.d:Stopping old one... 2023-06-10T19:01:57.138 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-06-10T19:01:57.138 INFO:teuthology.orchestra.run:waiting for 300 2023-06-10T19:01:57.152 INFO:tasks.ceph.mds.a:Stopped 2023-06-10T19:01:57.153 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-06-10T19:01:57.153 INFO:tasks.ceph.mds.c:Stopped 2023-06-10T19:01:57.154 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-06-10T19:01:57.155 INFO:tasks.ceph.mds.b:Stopped 2023-06-10T19:01:57.155 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-06-10T19:01:57.156 INFO:tasks.ceph.mds.d:Stopped 2023-06-10T19:01:57.156 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-06-10T19:01:57.196 INFO:tasks.ceph.mds.a:Started 2023-06-10T19:01:57.197 INFO:tasks.ceph.mds.c:Started 2023-06-10T19:01:57.197 DEBUG:teuthology.parallel:result is None 2023-06-10T19:01:57.198 DEBUG:teuthology.parallel:result is None 2023-06-10T19:01:57.198 INFO:tasks.ceph.mds.b:Started 2023-06-10T19:01:57.199 INFO:tasks.ceph.mds.d:Started 2023-06-10T19:01:57.199 DEBUG:teuthology.parallel:result is None 2023-06-10T19:01:57.199 DEBUG:teuthology.parallel:result is None 2023-06-10T19:01:57.200 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-06-10T19:01:57.260 INFO:tasks.ceph.mds.a.smithi053.stdout:starting mds.a at 2023-06-10T19:01:57.261 INFO:tasks.ceph.mds.c.smithi053.stdout:starting mds.c at 2023-06-10T19:01:57.271 INFO:tasks.ceph.mds.d.smithi117.stdout:starting mds.d at 2023-06-10T19:01:57.271 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2023-06-10T19:01:57.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:57.315+0000 7fe35c593640 1 Processor -- start 2023-06-10T19:01:57.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:57.315+0000 7fe35c593640 1 -- start start 2023-06-10T19:01:57.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:57.315+0000 7fe35c593640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe35406b780 0x7fe35415c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:57.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:57.315+0000 7fe35c593640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3540af530 con 0x7fe35406bb50 2023-06-10T19:01:57.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:57.315+0000 7fe35c593640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe35415fd70 con 0x7fe3540ceb20 2023-06-10T19:01:57.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:57.315+0000 7fe35c593640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe35415c3d0 con 0x7fe35406b780 2023-06-10T19:01:57.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:57.315+0000 7fe359b2e640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fe35406bb50 0x7fe35415f320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56712/0 (socket says 172.21.15.53:56712) 2023-06-10T19:01:57.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:57.315+0000 7fe359b2e640 1 -- 172.21.15.53:0/2512873547 learned_addr learned my addr 172.21.15.53:0/2512873547 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:01:57.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:57.315+0000 7fe35a32f640 1 --2- 172.21.15.53:0/2512873547 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe35406b780 0x7fe35415c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:57.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:57.315+0000 7fe35932d640 1 -- 172.21.15.53:0/2512873547 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2925361898 0 0) 0x7fe3540af530 con 0x7fe35406bb50 2023-06-10T19:01:57.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:57.315+0000 7fe35932d640 1 -- 172.21.15.53:0/2512873547 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe340003530 con 0x7fe35406bb50 2023-06-10T19:01:57.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:57.315+0000 7fe35932d640 1 -- 172.21.15.53:0/2512873547 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3328441722 0 0) 0x7fe35415fd70 con 0x7fe3540ceb20 2023-06-10T19:01:57.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:57.315+0000 7fe35a32f640 1 -- 172.21.15.53:0/2512873547 >> v1:172.21.15.117:6789/0 conn(0x7fe3540ceb20 legacy=0x7fe3540cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:57.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:57.315+0000 7fe35a32f640 1 -- 172.21.15.53:0/2512873547 >> v1:172.21.15.53:6789/0 conn(0x7fe35406bb50 legacy=0x7fe35415f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:57.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:57.315+0000 7fe35a32f640 1 -- 172.21.15.53:0/2512873547 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe354160050 con 0x7fe35406b780 2023-06-10T19:01:57.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:57.319+0000 7fe35a32f640 1 --2- 172.21.15.53:0/2512873547 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe35406b780 0x7fe35415c7f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe3500097f0 tx=0x7fe35001c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d829272d8af509de server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:57.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:57.319+0000 7fe35932d640 1 -- 172.21.15.53:0/2512873547 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3500ac620 con 0x7fe35406b780 2023-06-10T19:01:57.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:57.319+0000 7fe35932d640 1 -- 172.21.15.53:0/2512873547 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3500ac780 con 0x7fe35406b780 2023-06-10T19:01:57.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:57.319+0000 7fe35932d640 1 -- 172.21.15.53:0/2512873547 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3500acb10 con 0x7fe35406b780 2023-06-10T19:01:57.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:57.319+0000 7fe35c593640 1 -- 172.21.15.53:0/2512873547 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe35406b780 msgr2=0x7fe35415c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:57.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:57.319+0000 7fe35c593640 1 --2- 172.21.15.53:0/2512873547 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe35406b780 0x7fe35415c7f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe3500097f0 tx=0x7fe35001c430 comp rx=0 tx=0).stop 2023-06-10T19:01:57.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:57.319+0000 7fe35c593640 1 -- 172.21.15.53:0/2512873547 shutdown_connections 2023-06-10T19:01:57.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:57.319+0000 7fe35c593640 1 --2- 172.21.15.53:0/2512873547 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe35406b780 0x7fe35415c7f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:57.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:57.319+0000 7fe35c593640 1 -- 172.21.15.53:0/2512873547 >> 172.21.15.53:0/2512873547 conn(0x7fe35406a0b0 msgr2=0x7fe35406d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:57.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:57.319+0000 7fe35c593640 1 -- 172.21.15.53:0/2512873547 shutdown_connections 2023-06-10T19:01:57.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:57.319+0000 7fe35c593640 1 -- 172.21.15.53:0/2512873547 wait complete. 2023-06-10T19:01:57.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:57.319+0000 7fe35c593640 1 Processor -- start 2023-06-10T19:01:57.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:57.319+0000 7fe35c593640 1 -- start start 2023-06-10T19:01:57.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:57.323+0000 7fe35c593640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe35406b780 0x7fe35415b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:57.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:57.323+0000 7fe35c593640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe35406bb50 0x7fe3540c5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:57.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:57.323+0000 7fe35c593640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3540ceb20 0x7fe35415dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:57.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:57.323+0000 7fe35c593640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe354158b90 con 0x7fe35406b780 2023-06-10T19:01:57.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:57.323+0000 7fe35c593640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe354158de0 con 0x7fe35406bb50 2023-06-10T19:01:57.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:57.323+0000 7fe35c593640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3541590c0 con 0x7fe3540ceb20 2023-06-10T19:01:57.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:57.323+0000 7fe35a32f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe35406b780 0x7fe35415b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:57.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:57.323+0000 7fe35a32f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe35406b780 0x7fe35415b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59984/0 (socket says 172.21.15.53:59984) 2023-06-10T19:01:57.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:57.323+0000 7fe35a32f640 1 -- 172.21.15.53:0/3923610930 learned_addr learned my addr 172.21.15.53:0/3923610930 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:57.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:57.323+0000 7fe359b2e640 1 --2- 172.21.15.53:0/3923610930 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe35406bb50 0x7fe3540c5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:57.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:57.323+0000 7fe35ab30640 1 --2- 172.21.15.53:0/3923610930 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3540ceb20 0x7fe35415dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:57.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:57.323+0000 7fe35a32f640 1 -- 172.21.15.53:0/3923610930 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3540ceb20 msgr2=0x7fe35415dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:57.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:57.323+0000 7fe35a32f640 1 --2- 172.21.15.53:0/3923610930 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3540ceb20 0x7fe35415dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:57.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:57.323+0000 7fe35a32f640 1 -- 172.21.15.53:0/3923610930 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe35406bb50 msgr2=0x7fe3540c5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:57.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:57.323+0000 7fe35a32f640 1 --2- 172.21.15.53:0/3923610930 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe35406bb50 0x7fe3540c5780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:57.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:57.323+0000 7fe35a32f640 1 -- 172.21.15.53:0/3923610930 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe350009420 con 0x7fe35406b780 2023-06-10T19:01:57.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:57.323+0000 7fe35a32f640 1 --2- 172.21.15.53:0/3923610930 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe35406b780 0x7fe35415b500 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7fe3500097f0 tx=0x7fe35001ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:57.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:57.323+0000 7fe34affd640 1 -- 172.21.15.53:0/3923610930 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3500ac420 con 0x7fe35406b780 2023-06-10T19:01:57.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:57.323+0000 7fe34affd640 1 -- 172.21.15.53:0/3923610930 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3500ac580 con 0x7fe35406b780 2023-06-10T19:01:57.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:57.323+0000 7fe34affd640 1 -- 172.21.15.53:0/3923610930 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe350004240 con 0x7fe35406b780 2023-06-10T19:01:57.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:57.323+0000 7fe35c593640 1 -- 172.21.15.53:0/3923610930 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3541593a0 con 0x7fe35406b780 2023-06-10T19:01:57.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:57.323+0000 7fe35c593640 1 -- 172.21.15.53:0/3923610930 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe354153f40 con 0x7fe35406b780 2023-06-10T19:01:57.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:57.323+0000 7fe35c593640 1 -- 172.21.15.53:0/3923610930 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3540b1a10 con 0x7fe35406b780 2023-06-10T19:01:57.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:57.323+0000 7fe34affd640 1 -- 172.21.15.53:0/3923610930 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe3500aa070 con 0x7fe35406b780 2023-06-10T19:01:57.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:57.323+0000 7fe34affd640 1 --2- 172.21.15.53:0/3923610930 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe338066280 0x7fe338068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:57.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:57.323+0000 7fe34affd640 1 -- 172.21.15.53:0/3923610930 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5425+0+0 (secure 0 0 0) 0x7fe35011dc70 con 0x7fe35406b780 2023-06-10T19:01:57.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:57.323+0000 7fe359b2e640 1 --2- 172.21.15.53:0/3923610930 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe338066280 0x7fe338068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:57.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:57.323+0000 7fe359b2e640 1 --2- 172.21.15.53:0/3923610930 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe338066280 0x7fe338068730 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fe344007fd0 tx=0x7fe344009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:57.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:57.327+0000 7fe34affd640 1 -- 172.21.15.53:0/3923610930 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe3500eb420 con 0x7fe35406b780 2023-06-10T19:01:57.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:57.495+0000 7fe35c593640 1 -- 172.21.15.53:0/3923610930 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fe35404d790 con 0x7fe35406b780 2023-06-10T19:01:58.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.327+0000 7fe34affd640 1 -- 172.21.15.53:0/3923610930 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v90) v1 ==== 97+0+0 (secure 0 0 0) 0x7fe3500eea40 con 0x7fe35406b780 2023-06-10T19:01:58.333 INFO:teuthology.orchestra.run.smithi053.stderr: removed all blocklist entries 2023-06-10T19:01:58.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.331+0000 7fe35c593640 1 -- 172.21.15.53:0/3923610930 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe338066280 msgr2=0x7fe338068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:58.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.331+0000 7fe35c593640 1 --2- 172.21.15.53:0/3923610930 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe338066280 0x7fe338068730 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fe344007fd0 tx=0x7fe344009040 comp rx=0 tx=0).stop 2023-06-10T19:01:58.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.331+0000 7fe35c593640 1 -- 172.21.15.53:0/3923610930 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe35406b780 msgr2=0x7fe35415b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:58.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.331+0000 7fe35c593640 1 --2- 172.21.15.53:0/3923610930 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe35406b780 0x7fe35415b500 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7fe3500097f0 tx=0x7fe35001ac70 comp rx=0 tx=0).stop 2023-06-10T19:01:58.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.331+0000 7fe35c593640 1 -- 172.21.15.53:0/3923610930 shutdown_connections 2023-06-10T19:01:58.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.331+0000 7fe35c593640 1 --2- 172.21.15.53:0/3923610930 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe338066280 0x7fe338068730 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:58.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.331+0000 7fe35c593640 1 --2- 172.21.15.53:0/3923610930 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe3540ceb20 0x7fe35415dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:58.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.331+0000 7fe35c593640 1 --2- 172.21.15.53:0/3923610930 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe35406bb50 0x7fe3540c5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:58.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.331+0000 7fe35c593640 1 --2- 172.21.15.53:0/3923610930 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe35406b780 0x7fe35415b500 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:58.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.331+0000 7fe35c593640 1 -- 172.21.15.53:0/3923610930 >> 172.21.15.53:0/3923610930 conn(0x7fe35406a0b0 msgr2=0x7fe35406f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:58.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.331+0000 7fe35c593640 1 -- 172.21.15.53:0/3923610930 shutdown_connections 2023-06-10T19:01:58.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.331+0000 7fe35c593640 1 -- 172.21.15.53:0/3923610930 wait complete. 2023-06-10T19:01:58.361 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-06-10T19:01:58.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.487+0000 7f086fa33640 1 Processor -- start 2023-06-10T19:01:58.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.487+0000 7f086fa33640 1 -- start start 2023-06-10T19:01:58.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.487+0000 7f086fa33640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f086806b780 0x7f086815c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:58.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.487+0000 7f086fa33640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f086806bb50 0x7f086815f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:58.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.487+0000 7f086fa33640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08680af530 con 0x7f086815f860 2023-06-10T19:01:58.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.487+0000 7f086fa33640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f086815c3d0 con 0x7f086806bb50 2023-06-10T19:01:58.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.487+0000 7f086fa33640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f086815fd70 con 0x7f086806b780 2023-06-10T19:01:58.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.487+0000 7f086dfd0640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f086815f860 0x7f08680ceb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56726/0 (socket says 172.21.15.53:56726) 2023-06-10T19:01:58.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.487+0000 7f086dfd0640 1 -- 172.21.15.53:0/957770051 learned_addr learned my addr 172.21.15.53:0/957770051 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:01:58.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.487+0000 7f086d7cf640 1 --2- 172.21.15.53:0/957770051 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f086806b780 0x7f086815c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:58.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.487+0000 7f086cfce640 1 --2- 172.21.15.53:0/957770051 >> v2:172.21.15.117:3300/0 conn(0x7f086806bb50 0x7f086815f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:58.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.487+0000 7f085ffff640 1 -- 172.21.15.53:0/957770051 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3958763428 0 0) 0x7f08680af530 con 0x7f086815f860 2023-06-10T19:01:58.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.487+0000 7f085ffff640 1 -- 172.21.15.53:0/957770051 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0854003530 con 0x7f086815f860 2023-06-10T19:01:58.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.487+0000 7f085ffff640 1 -- 172.21.15.53:0/957770051 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4236850355 0 0) 0x7f0854003530 con 0x7f086815f860 2023-06-10T19:01:58.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.487+0000 7f085ffff640 1 -- 172.21.15.53:0/957770051 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f086806b780 msgr2=0x7f086815c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:58.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.487+0000 7f085ffff640 1 --2- 172.21.15.53:0/957770051 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f086806b780 0x7f086815c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:58.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.487+0000 7f085ffff640 1 -- 172.21.15.53:0/957770051 >> v2:172.21.15.117:3300/0 conn(0x7f086806bb50 msgr2=0x7f086815f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:58.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.487+0000 7f085ffff640 1 --2- 172.21.15.53:0/957770051 >> v2:172.21.15.117:3300/0 conn(0x7f086806bb50 0x7f086815f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:58.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.487+0000 7f085ffff640 1 -- 172.21.15.53:0/957770051 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0868160050 con 0x7f086815f860 2023-06-10T19:01:58.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.487+0000 7f085ffff640 1 -- 172.21.15.53:0/957770051 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f0860001a00 con 0x7f086815f860 2023-06-10T19:01:58.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.487+0000 7f085ffff640 1 -- 172.21.15.53:0/957770051 >> v1:172.21.15.53:6789/0 conn(0x7f086815f860 legacy=0x7f08680ceb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:58.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.487+0000 7f085ffff640 1 --2- 172.21.15.53:0/957770051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f08540039f0 0x7f0854003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:58.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.487+0000 7f085ffff640 1 --2- 172.21.15.53:0/957770051 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08540047d0 0x7f0854004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:58.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.487+0000 7f085ffff640 1 --2- 172.21.15.53:0/957770051 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f086806b780 0x7f0854005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:58.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.487+0000 7f085ffff640 1 -- 172.21.15.53:0/957770051 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f086815c3d0 con 0x7f08540039f0 2023-06-10T19:01:58.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.487+0000 7f085ffff640 1 -- 172.21.15.53:0/957770051 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f086815fd70 con 0x7f08540047d0 2023-06-10T19:01:58.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.487+0000 7f085ffff640 1 -- 172.21.15.53:0/957770051 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f085400b9c0 con 0x7f086806b780 2023-06-10T19:01:58.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.487+0000 7f086d7cf640 1 --2- 172.21.15.53:0/957770051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f08540039f0 0x7f0854003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:58.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.487+0000 7f086cfce640 1 --2- 172.21.15.53:0/957770051 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08540047d0 0x7f0854004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:58.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.487+0000 7f086dfd0640 1 --2- 172.21.15.53:0/957770051 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f086806b780 0x7f0854005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:58.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.487+0000 7f086d7cf640 1 -- 172.21.15.53:0/957770051 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f086806b780 msgr2=0x7f0854005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:58.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.487+0000 7f086d7cf640 1 --2- 172.21.15.53:0/957770051 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f086806b780 0x7f0854005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:58.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.487+0000 7f086d7cf640 1 -- 172.21.15.53:0/957770051 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08540047d0 msgr2=0x7f0854004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:58.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.487+0000 7f086d7cf640 1 --2- 172.21.15.53:0/957770051 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08540047d0 0x7f0854004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:58.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.487+0000 7f086d7cf640 1 -- 172.21.15.53:0/957770051 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0854003530 con 0x7f08540039f0 2023-06-10T19:01:58.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.487+0000 7f086cfce640 1 --2- 172.21.15.53:0/957770051 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08540047d0 0x7f0854004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:01:58.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.491+0000 7f086d7cf640 1 --2- 172.21.15.53:0/957770051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f08540039f0 0x7f0854003e00 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f0864009ae0 tx=0x7f08680cfa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a93b88d7e23ed138 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:58.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.491+0000 7f085ffff640 1 -- 172.21.15.53:0/957770051 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08640a5620 con 0x7f08540039f0 2023-06-10T19:01:58.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.491+0000 7f085ffff640 1 -- 172.21.15.53:0/957770051 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08640a5780 con 0x7f08540039f0 2023-06-10T19:01:58.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.491+0000 7f085ffff640 1 -- 172.21.15.53:0/957770051 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08640a5b30 con 0x7f08540039f0 2023-06-10T19:01:58.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.491+0000 7f086fa33640 1 -- 172.21.15.53:0/957770051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f08540039f0 msgr2=0x7f0854003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:58.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.491+0000 7f086fa33640 1 --2- 172.21.15.53:0/957770051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f08540039f0 0x7f0854003e00 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f0864009ae0 tx=0x7f08680cfa40 comp rx=0 tx=0).stop 2023-06-10T19:01:58.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.491+0000 7f086dfd0640 1 -- 172.21.15.53:0/957770051 reap_dead start 2023-06-10T19:01:58.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.491+0000 7f086fa33640 1 -- 172.21.15.53:0/957770051 shutdown_connections 2023-06-10T19:01:58.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.491+0000 7f086fa33640 1 -- 172.21.15.53:0/957770051 >> 172.21.15.53:0/957770051 conn(0x7f086806a090 msgr2=0x7f086806d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:58.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.491+0000 7f086fa33640 1 -- 172.21.15.53:0/957770051 shutdown_connections 2023-06-10T19:01:58.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.491+0000 7f086fa33640 1 -- 172.21.15.53:0/957770051 wait complete. 2023-06-10T19:01:58.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.491+0000 7f086fa33640 1 Processor -- start 2023-06-10T19:01:58.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.491+0000 7f086fa33640 1 -- start start 2023-06-10T19:01:58.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.491+0000 7f086fa33640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f08540039f0 0x7f086815a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:58.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.491+0000 7f086fa33640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08680b0e70 0x7f08680b2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:58.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.491+0000 7f086fa33640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08680c5c90 0x7f08680c6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:58.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.491+0000 7f086fa33640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08680b18a0 con 0x7f08540039f0 2023-06-10T19:01:58.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.491+0000 7f086fa33640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08680c7ad0 con 0x7f08680c5c90 2023-06-10T19:01:58.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.491+0000 7f086fa33640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08680c6640 con 0x7f08680b0e70 2023-06-10T19:01:58.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.491+0000 7f086d7cf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f08540039f0 0x7f086815a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:58.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.491+0000 7f086d7cf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f08540039f0 0x7f086815a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60010/0 (socket says 172.21.15.53:60010) 2023-06-10T19:01:58.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.491+0000 7f086d7cf640 1 -- 172.21.15.53:0/3619306988 learned_addr learned my addr 172.21.15.53:0/3619306988 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:58.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.495+0000 7f086cfce640 1 --2- 172.21.15.53:0/3619306988 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08680b0e70 0x7f08680b2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:58.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.495+0000 7f086dfd0640 1 --2- 172.21.15.53:0/3619306988 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08680c5c90 0x7f08680c6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:58.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.495+0000 7f086d7cf640 1 -- 172.21.15.53:0/3619306988 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08680b0e70 msgr2=0x7f08680b2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:58.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.495+0000 7f086d7cf640 1 --2- 172.21.15.53:0/3619306988 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08680b0e70 0x7f08680b2c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:58.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.495+0000 7f086d7cf640 1 -- 172.21.15.53:0/3619306988 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08680c5c90 msgr2=0x7f08680c6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:58.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.495+0000 7f086d7cf640 1 --2- 172.21.15.53:0/3619306988 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08680c5c90 0x7f08680c6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:58.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.495+0000 7f086d7cf640 1 -- 172.21.15.53:0/3619306988 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08680b3390 con 0x7f08540039f0 2023-06-10T19:01:58.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.495+0000 7f086dfd0640 1 --2- 172.21.15.53:0/3619306988 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08680c5c90 0x7f08680c6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:01:58.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.495+0000 7f086d7cf640 1 --2- 172.21.15.53:0/3619306988 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f08540039f0 0x7f086815a7a0 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f08640b0040 tx=0x7f08640197f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:58.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.495+0000 7f085dffb640 1 -- 172.21.15.53:0/3619306988 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f086400f000 con 0x7f08540039f0 2023-06-10T19:01:58.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.495+0000 7f085dffb640 1 -- 172.21.15.53:0/3619306988 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0864004020 con 0x7f08540039f0 2023-06-10T19:01:58.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.495+0000 7f086fa33640 1 -- 172.21.15.53:0/3619306988 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08680b3670 con 0x7f08540039f0 2023-06-10T19:01:58.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.495+0000 7f085dffb640 1 -- 172.21.15.53:0/3619306988 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08640043d0 con 0x7f08540039f0 2023-06-10T19:01:58.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.495+0000 7f086fa33640 1 -- 172.21.15.53:0/3619306988 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08680b3c30 con 0x7f08540039f0 2023-06-10T19:01:58.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.495+0000 7f086fa33640 1 -- 172.21.15.53:0/3619306988 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08680b3df0 con 0x7f08540039f0 2023-06-10T19:01:58.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.495+0000 7f085dffb640 1 -- 172.21.15.53:0/3619306988 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f08640b4070 con 0x7f08540039f0 2023-06-10T19:01:58.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.495+0000 7f085dffb640 1 --2- 172.21.15.53:0/3619306988 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f084c066280 0x7f084c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:58.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.495+0000 7f085dffb640 1 -- 172.21.15.53:0/3619306988 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f086411d850 con 0x7f08540039f0 2023-06-10T19:01:58.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.495+0000 7f086cfce640 1 --2- 172.21.15.53:0/3619306988 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f084c066280 0x7f084c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:58.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.495+0000 7f086cfce640 1 --2- 172.21.15.53:0/3619306988 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f084c066280 0x7f084c068730 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f08680c31b0 tx=0x7f0858008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:58.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.499+0000 7f085dffb640 1 -- 172.21.15.53:0/3619306988 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f08640eb010 con 0x7f08540039f0 2023-06-10T19:01:58.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.711+0000 7f086fa33640 1 -- 172.21.15.53:0/3619306988 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f086815b960 con 0x7f08540039f0 2023-06-10T19:01:58.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.711+0000 7f085dffb640 1 -- 172.21.15.53:0/3619306988 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f08640ee630 con 0x7f08540039f0 2023-06-10T19:01:58.718 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:01:58.718 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-06-10T19:01:58.718 INFO:teuthology.orchestra.run.smithi053.stdout: "auth_dump": [ 2023-06-10T19:01:58.719 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:01:58.719 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.a", 2023-06-10T19:01:58.719 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkWqEQBhAAW+iEw0Gxfw744rsYc/tfTQ==", 2023-06-10T19:01:58.719 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:01:58.719 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T19:01:58.719 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2023-06-10T19:01:58.720 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2023-06-10T19:01:58.720 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:01:58.720 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:01:58.720 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:01:58.720 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:01:58.720 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.b", 2023-06-10T19:01:58.720 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkSu02FRAAFpo6NpcwDLZUt2Rgk/wm8w==", 2023-06-10T19:01:58.721 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:01:58.721 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T19:01:58.721 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2023-06-10T19:01:58.721 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2023-06-10T19:01:58.721 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:01:58.721 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:01:58.721 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:01:58.721 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:01:58.722 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.c", 2023-06-10T19:01:58.722 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRk19/ODhAAodfGGNLP7UbNhHySgaukrg==", 2023-06-10T19:01:58.722 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:01:58.722 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T19:01:58.722 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2023-06-10T19:01:58.722 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2023-06-10T19:01:58.723 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:01:58.723 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:01:58.723 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:01:58.723 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:01:58.723 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.d", 2023-06-10T19:01:58.723 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkogwkGxAAIavVKa8GtML1XQDEMwwokQ==", 2023-06-10T19:01:58.723 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:01:58.723 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T19:01:58.724 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2023-06-10T19:01:58.724 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2023-06-10T19:01:58.724 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:01:58.724 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:01:58.724 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:01:58.724 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:01:58.725 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.0", 2023-06-10T19:01:58.725 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA7xoRkoj1OMhAAYFc4W5kAlMBqY2yzeJZXQw==", 2023-06-10T19:01:58.725 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:01:58.725 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T19:01:58.725 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T19:01:58.725 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:01:58.725 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:01:58.726 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:01:58.726 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:01:58.726 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.1", 2023-06-10T19:01:58.726 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA+xoRk6FpDOBAALjxW3eaIh3Gu9b1rmMmqfw==", 2023-06-10T19:01:58.726 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:01:58.726 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T19:01:58.726 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T19:01:58.727 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:01:58.727 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:01:58.727 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:01:58.727 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:01:58.727 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.2", 2023-06-10T19:01:58.727 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBCxoRkaO2GBRAA0Xr5en+n5DxhZDg8kVswpQ==", 2023-06-10T19:01:58.727 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:01:58.728 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T19:01:58.728 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T19:01:58.728 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:01:58.728 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:01:58.728 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:01:58.729 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:01:58.729 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.3", 2023-06-10T19:01:58.729 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBFxoRkjfsBDhAAArYYrPnmXu5VcUMGVjQXZg==", 2023-06-10T19:01:58.729 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:01:58.729 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T19:01:58.729 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T19:01:58.729 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:01:58.730 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:01:58.730 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:01:58.730 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:01:58.730 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.4", 2023-06-10T19:01:58.730 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBLxoRkybumChAAdym/nl9bzyI71flvuy9Vtw==", 2023-06-10T19:01:58.730 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:01:58.730 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T19:01:58.730 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T19:01:58.731 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:01:58.731 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:01:58.731 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:01:58.731 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:01:58.731 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.5", 2023-06-10T19:01:58.731 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBOxoRkinSGIRAAwLbgYKI4NsbHKqGo9O4WuQ==", 2023-06-10T19:01:58.731 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:01:58.732 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T19:01:58.732 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T19:01:58.732 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:01:58.732 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:01:58.732 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:01:58.732 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:01:58.732 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.6", 2023-06-10T19:01:58.733 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBRxoRkj7VlKRAAs2ReBZ5iqtr17Nli9kUtGQ==", 2023-06-10T19:01:58.733 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:01:58.733 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T19:01:58.733 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T19:01:58.733 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:01:58.733 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:01:58.734 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:01:58.734 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:01:58.734 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.7", 2023-06-10T19:01:58.734 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBUxoRk48CnMhAASfbeuCo9jDuHQrYDQ8Vt3A==", 2023-06-10T19:01:58.734 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:01:58.734 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T19:01:58.735 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T19:01:58.735 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:01:58.735 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:01:58.735 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:01:58.735 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:01:58.735 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.0", 2023-06-10T19:01:58.736 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkgey1IBAAkNYrXMgUOnavBY/5uGyFrw==", 2023-06-10T19:01:58.736 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:01:58.736 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T19:01:58.736 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow r", 2023-06-10T19:01:58.736 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-06-10T19:01:58.737 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:01:58.737 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:01:58.737 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:01:58.737 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.1", 2023-06-10T19:01:58.737 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkBw+UKBAAuvT+vXmJLG5CvQVg5xItDQ==", 2023-06-10T19:01:58.737 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:01:58.737 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T19:01:58.738 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow r", 2023-06-10T19:01:58.738 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow rw", 2023-06-10T19:01:58.738 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rwx" 2023-06-10T19:01:58.740 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:01:58.740 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:01:58.740 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:01:58.740 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.2", 2023-06-10T19:01:58.740 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkewjeJRAA4pmIEVJ3Z7GKQFmA54CZ5Q==", 2023-06-10T19:01:58.740 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:01:58.741 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T19:01:58.741 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow r", 2023-06-10T19:01:58.741 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow rw", 2023-06-10T19:01:58.741 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rwx" 2023-06-10T19:01:58.741 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:01:58.741 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:01:58.741 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:01:58.741 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.3", 2023-06-10T19:01:58.742 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkHwCiLRAAWGt8UoWxGlG1Y1zSPbKUCg==", 2023-06-10T19:01:58.742 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:01:58.742 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T19:01:58.742 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow r", 2023-06-10T19:01:58.742 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow rw", 2023-06-10T19:01:58.742 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rwx" 2023-06-10T19:01:58.742 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:01:58.743 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:01:58.743 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:01:58.743 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.admin", 2023-06-10T19:01:58.743 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA5xoRkIVgrKBAABIxiaOPe9h5ne2y2l50aMg==", 2023-06-10T19:01:58.743 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:01:58.743 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow *", 2023-06-10T19:01:58.743 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2023-06-10T19:01:58.743 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2023-06-10T19:01:58.744 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:01:58.744 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:01:58.744 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:01:58.744 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:01:58.744 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mgr.x", 2023-06-10T19:01:58.744 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkzWG3AhAAh3NFYHAbp4fgn4FZeRRNuw==", 2023-06-10T19:01:58.745 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:01:58.745 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow *", 2023-06-10T19:01:58.745 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile mgr", 2023-06-10T19:01:58.745 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:01:58.745 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:01:58.745 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:01:58.745 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:01:58.746 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mgr.y", 2023-06-10T19:01:58.746 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA5xoRkBriKOxAA6G+T7Yp2rH7XV7z37lvMYQ==", 2023-06-10T19:01:58.746 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:01:58.746 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow *", 2023-06-10T19:01:58.746 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile mgr", 2023-06-10T19:01:58.747 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:01:58.747 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:01:58.747 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:01:58.747 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2023-06-10T19:01:58.748 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-06-10T19:01:58.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.715+0000 7f086fa33640 1 -- 172.21.15.53:0/3619306988 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f084c066280 msgr2=0x7f084c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:58.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.715+0000 7f086fa33640 1 --2- 172.21.15.53:0/3619306988 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f084c066280 0x7f084c068730 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f08680c31b0 tx=0x7f0858008040 comp rx=0 tx=0).stop 2023-06-10T19:01:58.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.715+0000 7f086fa33640 1 -- 172.21.15.53:0/3619306988 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f08540039f0 msgr2=0x7f086815a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:58.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.715+0000 7f086fa33640 1 --2- 172.21.15.53:0/3619306988 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f08540039f0 0x7f086815a7a0 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f08640b0040 tx=0x7f08640197f0 comp rx=0 tx=0).stop 2023-06-10T19:01:58.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.715+0000 7f086fa33640 1 -- 172.21.15.53:0/3619306988 shutdown_connections 2023-06-10T19:01:58.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.715+0000 7f086fa33640 1 --2- 172.21.15.53:0/3619306988 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f084c066280 0x7f084c068730 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:58.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.715+0000 7f086fa33640 1 --2- 172.21.15.53:0/3619306988 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08680c5c90 0x7f08680c6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:58.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.715+0000 7f086fa33640 1 --2- 172.21.15.53:0/3619306988 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08680b0e70 0x7f08680b2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:58.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.715+0000 7f086fa33640 1 --2- 172.21.15.53:0/3619306988 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f08540039f0 0x7f086815a7a0 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:58.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.715+0000 7f086fa33640 1 -- 172.21.15.53:0/3619306988 >> 172.21.15.53:0/3619306988 conn(0x7f086806a090 msgr2=0x7f08680af750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:58.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.715+0000 7f086fa33640 1 -- 172.21.15.53:0/3619306988 shutdown_connections 2023-06-10T19:01:58.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.715+0000 7f086fa33640 1 -- 172.21.15.53:0/3619306988 wait complete. 2023-06-10T19:01:58.754 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:01:58.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.875+0000 7f0b74565640 1 Processor -- start 2023-06-10T19:01:58.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.875+0000 7f0b74565640 1 -- start start 2023-06-10T19:01:58.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.879+0000 7f0b74565640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0b6c0c8d00 0x7f0b6c06b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:58.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.879+0000 7f0b74565640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0b6c06bc00 0x7f0b6c162180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:58.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.879+0000 7f0b74565640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b6c158a90 con 0x7f0b6c06b2f0 2023-06-10T19:01:58.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.879+0000 7f0b74565640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b6c06f780 con 0x7f0b6c06bc00 2023-06-10T19:01:58.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.879+0000 7f0b74565640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b6c0705d0 con 0x7f0b6c0c8d00 2023-06-10T19:01:58.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.879+0000 7f0b72b02640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0b6c06bc00 0x7f0b6c162180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:58.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.879+0000 7f0b72b02640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0b6c06bc00 0x7f0b6c162180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60016/0 (socket says 172.21.15.53:60016) 2023-06-10T19:01:58.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.879+0000 7f0b72b02640 1 -- 172.21.15.53:0/3216000758 learned_addr learned my addr 172.21.15.53:0/3216000758 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:58.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.879+0000 7f0b71b00640 1 --2- 172.21.15.53:0/3216000758 >> v2:172.21.15.117:3300/0 conn(0x7f0b6c0c8d00 0x7f0b6c06b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:58.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.879+0000 7f0b72b02640 1 -- 172.21.15.53:0/3216000758 >> v2:172.21.15.117:3300/0 conn(0x7f0b6c0c8d00 msgr2=0x7f0b6c06b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:58.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.879+0000 7f0b72b02640 1 --2- 172.21.15.53:0/3216000758 >> v2:172.21.15.117:3300/0 conn(0x7f0b6c0c8d00 0x7f0b6c06b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:58.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.879+0000 7f0b72b02640 1 -- 172.21.15.53:0/3216000758 >> v1:172.21.15.117:6789/0 conn(0x7f0b6c06b2f0 legacy=0x7f0b6c06f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:58.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.879+0000 7f0b72b02640 1 -- 172.21.15.53:0/3216000758 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b6c0cce10 con 0x7f0b6c06bc00 2023-06-10T19:01:58.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.879+0000 7f0b72b02640 1 --2- 172.21.15.53:0/3216000758 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b6c06bc00 0x7f0b6c162180 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c15c0b0 tx=0x7f0b6401f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f090bbc319eed843 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:58.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.879+0000 7f0b712ff640 1 -- 172.21.15.53:0/3216000758 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b640af400 con 0x7f0b6c06bc00 2023-06-10T19:01:58.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.879+0000 7f0b712ff640 1 -- 172.21.15.53:0/3216000758 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b640ab050 con 0x7f0b6c06bc00 2023-06-10T19:01:58.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.879+0000 7f0b712ff640 1 -- 172.21.15.53:0/3216000758 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b640af780 con 0x7f0b6c06bc00 2023-06-10T19:01:58.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.879+0000 7f0b74565640 1 -- 172.21.15.53:0/3216000758 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b6c06bc00 msgr2=0x7f0b6c162180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:58.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.879+0000 7f0b74565640 1 --2- 172.21.15.53:0/3216000758 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b6c06bc00 0x7f0b6c162180 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c15c0b0 tx=0x7f0b6401f1c0 comp rx=0 tx=0).stop 2023-06-10T19:01:58.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.879+0000 7f0b74565640 1 -- 172.21.15.53:0/3216000758 shutdown_connections 2023-06-10T19:01:58.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.879+0000 7f0b74565640 1 --2- 172.21.15.53:0/3216000758 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b6c06bc00 0x7f0b6c162180 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:58.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.879+0000 7f0b74565640 1 --2- 172.21.15.53:0/3216000758 >> v2:172.21.15.117:3300/0 conn(0x7f0b6c0c8d00 0x7f0b6c06b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:58.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.879+0000 7f0b74565640 1 -- 172.21.15.53:0/3216000758 >> 172.21.15.53:0/3216000758 conn(0x7f0b6c06a0d0 msgr2=0x7f0b6c0ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:58.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.879+0000 7f0b74565640 1 -- 172.21.15.53:0/3216000758 shutdown_connections 2023-06-10T19:01:58.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.879+0000 7f0b74565640 1 -- 172.21.15.53:0/3216000758 wait complete. 2023-06-10T19:01:58.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.883+0000 7f0b74565640 1 Processor -- start 2023-06-10T19:01:58.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.883+0000 7f0b74565640 1 -- start start 2023-06-10T19:01:58.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.883+0000 7f0b74565640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b6c06b2f0 0x7f0b6c14e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:58.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.883+0000 7f0b74565640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b6c06bc00 0x7f0b6c0a7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:58.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.883+0000 7f0b74565640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b6c0c8d00 0x7f0b6c0b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:58.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.883+0000 7f0b74565640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6c0a8740 con 0x7f0b6c0c8d00 2023-06-10T19:01:58.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.883+0000 7f0b74565640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6c0ab730 con 0x7f0b6c06bc00 2023-06-10T19:01:58.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.883+0000 7f0b74565640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6c0ab390 con 0x7f0b6c06b2f0 2023-06-10T19:01:58.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.883+0000 7f0b72b02640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b6c0c8d00 0x7f0b6c0b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:58.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.883+0000 7f0b72b02640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b6c0c8d00 0x7f0b6c0b2ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60032/0 (socket says 172.21.15.53:60032) 2023-06-10T19:01:58.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.883+0000 7f0b72b02640 1 -- 172.21.15.53:0/2994513811 learned_addr learned my addr 172.21.15.53:0/2994513811 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:58.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.883+0000 7f0b71b00640 1 --2- 172.21.15.53:0/2994513811 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b6c06bc00 0x7f0b6c0a7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:58.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.883+0000 7f0b72b02640 1 -- 172.21.15.53:0/2994513811 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b6c06b2f0 msgr2=0x7f0b6c14e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:58.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.883+0000 7f0b72b02640 1 --2- 172.21.15.53:0/2994513811 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b6c06b2f0 0x7f0b6c14e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:58.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.883+0000 7f0b72b02640 1 -- 172.21.15.53:0/2994513811 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b6c06bc00 msgr2=0x7f0b6c0a7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:58.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.883+0000 7f0b72b02640 1 --2- 172.21.15.53:0/2994513811 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b6c06bc00 0x7f0b6c0a7450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:58.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.883+0000 7f0b72b02640 1 -- 172.21.15.53:0/2994513811 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b64009b30 con 0x7f0b6c0c8d00 2023-06-10T19:01:58.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.883+0000 7f0b72b02640 1 --2- 172.21.15.53:0/2994513811 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b6c0c8d00 0x7f0b6c0b2ce0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f0b6401cdf0 tx=0x7f0b6401bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:58.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.883+0000 7f0b62ffd640 1 -- 172.21.15.53:0/2994513811 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b640afd30 con 0x7f0b6c0c8d00 2023-06-10T19:01:58.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.883+0000 7f0b62ffd640 1 -- 172.21.15.53:0/2994513811 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b64009510 con 0x7f0b6c0c8d00 2023-06-10T19:01:58.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.883+0000 7f0b74565640 1 -- 172.21.15.53:0/2994513811 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b6c0a7ea0 con 0x7f0b6c0c8d00 2023-06-10T19:01:58.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.883+0000 7f0b62ffd640 1 -- 172.21.15.53:0/2994513811 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b640ba680 con 0x7f0b6c0c8d00 2023-06-10T19:01:58.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.883+0000 7f0b74565640 1 -- 172.21.15.53:0/2994513811 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b6c0a8460 con 0x7f0b6c0c8d00 2023-06-10T19:01:58.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.883+0000 7f0b74565640 1 -- 172.21.15.53:0/2994513811 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b6c04d790 con 0x7f0b6c0c8d00 2023-06-10T19:01:58.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.887+0000 7f0b62ffd640 1 -- 172.21.15.53:0/2994513811 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0b640b6040 con 0x7f0b6c0c8d00 2023-06-10T19:01:58.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.887+0000 7f0b62ffd640 1 --2- 172.21.15.53:0/2994513811 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0b500662b0 0x7f0b50068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:58.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.887+0000 7f0b62ffd640 1 -- 172.21.15.53:0/2994513811 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0b64121c60 con 0x7f0b6c0c8d00 2023-06-10T19:01:58.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.887+0000 7f0b72301640 1 --2- 172.21.15.53:0/2994513811 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0b500662b0 0x7f0b50068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:58.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.887+0000 7f0b72301640 1 --2- 172.21.15.53:0/2994513811 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0b500662b0 0x7f0b50068760 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c000f70 tx=0x7f0b5c0079c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:58.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:58.891+0000 7f0b62ffd640 1 -- 172.21.15.53:0/2994513811 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0b640ef3c0 con 0x7f0b6c0c8d00 2023-06-10T19:01:59.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.047+0000 7f0b74565640 1 -- 172.21.15.53:0/2994513811 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0b6c0c9490 con 0x7f0b6c0c8d00 2023-06-10T19:01:59.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.051+0000 7f0b62ffd640 1 -- 172.21.15.53:0/2994513811 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+14628 (secure 0 0 0) 0x7f0b640f29e0 con 0x7f0b6c0c8d00 2023-06-10T19:01:59.056 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:01:59.056 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":90,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:01:58.316913+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:01:59.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.051+0000 7f0b74565640 1 -- 172.21.15.53:0/2994513811 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0b500662b0 msgr2=0x7f0b50068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:59.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.051+0000 7f0b74565640 1 --2- 172.21.15.53:0/2994513811 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0b500662b0 0x7f0b50068760 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c000f70 tx=0x7f0b5c0079c0 comp rx=0 tx=0).stop 2023-06-10T19:01:59.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.051+0000 7f0b74565640 1 -- 172.21.15.53:0/2994513811 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b6c0c8d00 msgr2=0x7f0b6c0b2ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:59.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.051+0000 7f0b74565640 1 --2- 172.21.15.53:0/2994513811 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b6c0c8d00 0x7f0b6c0b2ce0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f0b6401cdf0 tx=0x7f0b6401bf60 comp rx=0 tx=0).stop 2023-06-10T19:01:59.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.051+0000 7f0b74565640 1 -- 172.21.15.53:0/2994513811 shutdown_connections 2023-06-10T19:01:59.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.051+0000 7f0b74565640 1 --2- 172.21.15.53:0/2994513811 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0b500662b0 0x7f0b50068760 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:59.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.051+0000 7f0b74565640 1 --2- 172.21.15.53:0/2994513811 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b6c0c8d00 0x7f0b6c0b2ce0 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:59.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.051+0000 7f0b74565640 1 --2- 172.21.15.53:0/2994513811 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b6c06bc00 0x7f0b6c0a7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:59.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.051+0000 7f0b74565640 1 --2- 172.21.15.53:0/2994513811 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b6c06b2f0 0x7f0b6c14e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:59.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.051+0000 7f0b74565640 1 -- 172.21.15.53:0/2994513811 >> 172.21.15.53:0/2994513811 conn(0x7f0b6c06a0d0 msgr2=0x7f0b6c0c4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:59.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.051+0000 7f0b74565640 1 -- 172.21.15.53:0/2994513811 shutdown_connections 2023-06-10T19:01:59.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.051+0000 7f0b74565640 1 -- 172.21.15.53:0/2994513811 wait complete. 2023-06-10T19:01:59.075 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-10T18:52:33.633114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-10T18:52:39.171487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-10T19:01:59.076 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-10T19:01:59.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.191+0000 7f8425434640 1 Processor -- start 2023-06-10T19:01:59.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.191+0000 7f8425434640 1 -- start start 2023-06-10T19:01:59.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.195+0000 7f8425434640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f84200afe70 0x7f84200cb820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:59.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.195+0000 7f8425434640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84200ac910 con 0x7f842006c350 2023-06-10T19:01:59.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.195+0000 7f8425434640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84200cbd60 con 0x7f84200c97d0 2023-06-10T19:01:59.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.195+0000 7f8425434640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84200ca5c0 con 0x7f84200afe70 2023-06-10T19:01:59.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.195+0000 7f841f7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f84200afe70 0x7f84200cb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:59.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.195+0000 7f841e7fc640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f842006c350 0x7f84200af760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56740/0 (socket says 172.21.15.53:56740) 2023-06-10T19:01:59.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.195+0000 7f841f7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f84200afe70 0x7f84200cb820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60042/0 (socket says 172.21.15.53:60042) 2023-06-10T19:01:59.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.195+0000 7f841e7fc640 1 -- 172.21.15.53:0/3753365717 learned_addr learned my addr 172.21.15.53:0/3753365717 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:01:59.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.195+0000 7f841f7fe640 1 -- 172.21.15.53:0/3753365717 >> v1:172.21.15.117:6789/0 conn(0x7f84200c97d0 legacy=0x7f84200ac200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:59.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.195+0000 7f841f7fe640 1 -- 172.21.15.53:0/3753365717 >> v1:172.21.15.53:6789/0 conn(0x7f842006c350 legacy=0x7f84200af760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:59.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.195+0000 7f841dffb640 1 -- 172.21.15.53:0/3753365717 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1195616469 0 0) 0x7f84200ac910 con 0x7f842006c350 2023-06-10T19:01:59.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.195+0000 7f841f7fe640 1 -- 172.21.15.53:0/3753365717 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84200abd70 con 0x7f84200afe70 2023-06-10T19:01:59.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.195+0000 7f841f7fe640 1 --2- 172.21.15.53:0/3753365717 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84200afe70 0x7f84200cb820 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f8418009d90 tx=0x7f841801c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edb207e34f837837 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:59.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.195+0000 7f841dffb640 1 -- 172.21.15.53:0/3753365717 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84180a5800 con 0x7f84200afe70 2023-06-10T19:01:59.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.195+0000 7f841dffb640 1 -- 172.21.15.53:0/3753365717 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84180a5960 con 0x7f84200afe70 2023-06-10T19:01:59.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.195+0000 7f841dffb640 1 -- 172.21.15.53:0/3753365717 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84180a5cf0 con 0x7f84200afe70 2023-06-10T19:01:59.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.199+0000 7f8425434640 1 -- 172.21.15.53:0/3753365717 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84200afe70 msgr2=0x7f84200cb820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:59.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.199+0000 7f8425434640 1 --2- 172.21.15.53:0/3753365717 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84200afe70 0x7f84200cb820 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f8418009d90 tx=0x7f841801c830 comp rx=0 tx=0).stop 2023-06-10T19:01:59.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.199+0000 7f8425434640 1 -- 172.21.15.53:0/3753365717 shutdown_connections 2023-06-10T19:01:59.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.199+0000 7f8425434640 1 --2- 172.21.15.53:0/3753365717 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84200afe70 0x7f84200cb820 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:59.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.199+0000 7f8425434640 1 -- 172.21.15.53:0/3753365717 >> 172.21.15.53:0/3753365717 conn(0x7f842006a0e0 msgr2=0x7f84200cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:59.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.199+0000 7f8425434640 1 -- 172.21.15.53:0/3753365717 shutdown_connections 2023-06-10T19:01:59.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.199+0000 7f8425434640 1 -- 172.21.15.53:0/3753365717 wait complete. 2023-06-10T19:01:59.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.199+0000 7f8425434640 1 Processor -- start 2023-06-10T19:01:59.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.199+0000 7f8425434640 1 -- start start 2023-06-10T19:01:59.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.199+0000 7f8425434640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f842006c350 0x7f842015e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:59.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.199+0000 7f8425434640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84200afe70 0x7f842006f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:59.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.199+0000 7f8425434640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f84200c97d0 0x7f84201535d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:59.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.199+0000 7f8425434640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f842015be40 con 0x7f84200afe70 2023-06-10T19:01:59.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.199+0000 7f8425434640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f842015e9c0 con 0x7f842006c350 2023-06-10T19:01:59.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.199+0000 7f8425434640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f842006fe10 con 0x7f84200c97d0 2023-06-10T19:01:59.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.199+0000 7f841e7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84200afe70 0x7f842006f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:59.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.199+0000 7f841e7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84200afe70 0x7f842006f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60058/0 (socket says 172.21.15.53:60058) 2023-06-10T19:01:59.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.199+0000 7f841e7fc640 1 -- 172.21.15.53:0/1760704127 learned_addr learned my addr 172.21.15.53:0/1760704127 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:59.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.199+0000 7f841f7fe640 1 --2- 172.21.15.53:0/1760704127 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f84200c97d0 0x7f84201535d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:59.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.199+0000 7f841effd640 1 --2- 172.21.15.53:0/1760704127 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f842006c350 0x7f842015e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:59.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.199+0000 7f841e7fc640 1 -- 172.21.15.53:0/1760704127 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f84200c97d0 msgr2=0x7f84201535d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:59.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.199+0000 7f841e7fc640 1 --2- 172.21.15.53:0/1760704127 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f84200c97d0 0x7f84201535d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:59.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.199+0000 7f841e7fc640 1 -- 172.21.15.53:0/1760704127 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f842006c350 msgr2=0x7f842015e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:59.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.199+0000 7f841e7fc640 1 --2- 172.21.15.53:0/1760704127 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f842006c350 0x7f842015e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:59.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.199+0000 7f841e7fc640 1 -- 172.21.15.53:0/1760704127 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8418009a70 con 0x7f84200afe70 2023-06-10T19:01:59.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.199+0000 7f841effd640 1 --2- 172.21.15.53:0/1760704127 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f842006c350 0x7f842015e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:01:59.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.199+0000 7f841e7fc640 1 --2- 172.21.15.53:0/1760704127 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84200afe70 0x7f842006f8d0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f841400c4a0 tx=0x7f841400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:59.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.199+0000 7f84077fe640 1 -- 172.21.15.53:0/1760704127 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84140074e0 con 0x7f84200afe70 2023-06-10T19:01:59.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.199+0000 7f84077fe640 1 -- 172.21.15.53:0/1760704127 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8414007640 con 0x7f84200afe70 2023-06-10T19:01:59.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.199+0000 7f8425434640 1 -- 172.21.15.53:0/1760704127 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8420157ea0 con 0x7f84200afe70 2023-06-10T19:01:59.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.199+0000 7f84077fe640 1 -- 172.21.15.53:0/1760704127 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8414004a30 con 0x7f84200afe70 2023-06-10T19:01:59.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.199+0000 7f8425434640 1 -- 172.21.15.53:0/1760704127 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84201548d0 con 0x7f84200afe70 2023-06-10T19:01:59.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.203+0000 7f8425434640 1 -- 172.21.15.53:0/1760704127 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f842004d790 con 0x7f84200afe70 2023-06-10T19:01:59.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.203+0000 7f84077fe640 1 -- 172.21.15.53:0/1760704127 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8414004b90 con 0x7f84200afe70 2023-06-10T19:01:59.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.203+0000 7f84077fe640 1 --2- 172.21.15.53:0/1760704127 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f840c066280 0x7f840c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:59.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.203+0000 7f84077fe640 1 -- 172.21.15.53:0/1760704127 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f8414082d30 con 0x7f84200afe70 2023-06-10T19:01:59.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.203+0000 7f841effd640 1 --2- 172.21.15.53:0/1760704127 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f840c066280 0x7f840c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:59.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.203+0000 7f841effd640 1 --2- 172.21.15.53:0/1760704127 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f840c066280 0x7f840c068730 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f8410000f70 tx=0x7f8410009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:59.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.207+0000 7f84077fe640 1 -- 172.21.15.53:0/1760704127 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8414050460 con 0x7f84200afe70 2023-06-10T19:01:59.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.363+0000 7f8425434640 1 -- 172.21.15.53:0/1760704127 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f84200aca70 con 0x7f84200afe70 2023-06-10T19:01:59.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.363+0000 7f84077fe640 1 -- 172.21.15.53:0/1760704127 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v90) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8414018070 con 0x7f84200afe70 2023-06-10T19:01:59.368 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-06-10T19:01:59.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.363+0000 7f8425434640 1 -- 172.21.15.53:0/1760704127 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f840c066280 msgr2=0x7f840c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:59.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.363+0000 7f8425434640 1 --2- 172.21.15.53:0/1760704127 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f840c066280 0x7f840c068730 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f8410000f70 tx=0x7f8410009040 comp rx=0 tx=0).stop 2023-06-10T19:01:59.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.363+0000 7f8425434640 1 -- 172.21.15.53:0/1760704127 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84200afe70 msgr2=0x7f842006f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:59.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.363+0000 7f8425434640 1 --2- 172.21.15.53:0/1760704127 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84200afe70 0x7f842006f8d0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f841400c4a0 tx=0x7f841400c960 comp rx=0 tx=0).stop 2023-06-10T19:01:59.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.363+0000 7f8425434640 1 -- 172.21.15.53:0/1760704127 shutdown_connections 2023-06-10T19:01:59.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.363+0000 7f8425434640 1 --2- 172.21.15.53:0/1760704127 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f840c066280 0x7f840c068730 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:59.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.363+0000 7f8425434640 1 --2- 172.21.15.53:0/1760704127 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f84200c97d0 0x7f84201535d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:59.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.363+0000 7f8425434640 1 --2- 172.21.15.53:0/1760704127 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84200afe70 0x7f842006f8d0 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:59.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.363+0000 7f8425434640 1 --2- 172.21.15.53:0/1760704127 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f842006c350 0x7f842015e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:59.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.363+0000 7f8425434640 1 -- 172.21.15.53:0/1760704127 >> 172.21.15.53:0/1760704127 conn(0x7f842006a0e0 msgr2=0x7f84200af6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:59.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.363+0000 7f8425434640 1 -- 172.21.15.53:0/1760704127 shutdown_connections 2023-06-10T19:01:59.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.363+0000 7f8425434640 1 -- 172.21.15.53:0/1760704127 wait complete. 2023-06-10T19:01:59.387 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-10T19:01:59.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.511+0000 7f0e5712a640 1 Processor -- start 2023-06-10T19:01:59.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.511+0000 7f0e5712a640 1 -- start start 2023-06-10T19:01:59.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.511+0000 7f0e5712a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0e50156180 0x7f0e500cd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:59.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.511+0000 7f0e5712a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0e5015c070 0x7f0e5015c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:59.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.511+0000 7f0e5712a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0e50158a80 0x7f0e50158ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:59.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.511+0000 7f0e5712a640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e5015ca00 con 0x7f0e50158a80 2023-06-10T19:01:59.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.511+0000 7f0e5712a640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e5006b090 con 0x7f0e50156180 2023-06-10T19:01:59.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.511+0000 7f0e5712a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5006efa0 con 0x7f0e5015c070 2023-06-10T19:01:59.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.511+0000 7f0e556c7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0e50158a80 0x7f0e50158ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:59.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.511+0000 7f0e556c7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0e50158a80 0x7f0e50158ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60060/0 (socket says 172.21.15.53:60060) 2023-06-10T19:01:59.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.511+0000 7f0e556c7640 1 -- 172.21.15.53:0/372754323 learned_addr learned my addr 172.21.15.53:0/372754323 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:59.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.511+0000 7f0e54ec6640 1 --2- 172.21.15.53:0/372754323 >> v2:172.21.15.117:3300/0 conn(0x7f0e50156180 0x7f0e500cd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:59.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.511+0000 7f0e556c7640 1 -- 172.21.15.53:0/372754323 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0e5015c070 msgr2=0x7f0e5015c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:59.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.511+0000 7f0e556c7640 1 --2- 172.21.15.53:0/372754323 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0e5015c070 0x7f0e5015c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:59.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.511+0000 7f0e556c7640 1 -- 172.21.15.53:0/372754323 >> v2:172.21.15.117:3300/0 conn(0x7f0e50156180 msgr2=0x7f0e500cd4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:59.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.511+0000 7f0e556c7640 1 --2- 172.21.15.53:0/372754323 >> v2:172.21.15.117:3300/0 conn(0x7f0e50156180 0x7f0e500cd4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:59.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.511+0000 7f0e556c7640 1 -- 172.21.15.53:0/372754323 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e500cc720 con 0x7f0e50158a80 2023-06-10T19:01:59.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.515+0000 7f0e556c7640 1 --2- 172.21.15.53:0/372754323 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e50158a80 0x7f0e50158ea0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f0e500c8b70 tx=0x7f0e4801ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5284a761bc02f0d server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:59.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.515+0000 7f0e4f7fe640 1 -- 172.21.15.53:0/372754323 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4800b2d0 con 0x7f0e50158a80 2023-06-10T19:01:59.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.515+0000 7f0e4f7fe640 1 -- 172.21.15.53:0/372754323 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e4800b430 con 0x7f0e50158a80 2023-06-10T19:01:59.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.515+0000 7f0e4f7fe640 1 -- 172.21.15.53:0/372754323 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e480a7a70 con 0x7f0e50158a80 2023-06-10T19:01:59.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.515+0000 7f0e5712a640 1 -- 172.21.15.53:0/372754323 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e50158a80 msgr2=0x7f0e50158ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:59.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.515+0000 7f0e5712a640 1 --2- 172.21.15.53:0/372754323 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e50158a80 0x7f0e50158ea0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f0e500c8b70 tx=0x7f0e4801ebd0 comp rx=0 tx=0).stop 2023-06-10T19:01:59.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.515+0000 7f0e5712a640 1 -- 172.21.15.53:0/372754323 shutdown_connections 2023-06-10T19:01:59.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.515+0000 7f0e5712a640 1 --2- 172.21.15.53:0/372754323 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e50158a80 0x7f0e50158ea0 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:59.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.515+0000 7f0e5712a640 1 --2- 172.21.15.53:0/372754323 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0e5015c070 0x7f0e5015c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:59.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.515+0000 7f0e5712a640 1 --2- 172.21.15.53:0/372754323 >> v2:172.21.15.117:3300/0 conn(0x7f0e50156180 0x7f0e500cd4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:59.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.515+0000 7f0e5712a640 1 -- 172.21.15.53:0/372754323 >> 172.21.15.53:0/372754323 conn(0x7f0e5006a0e0 msgr2=0x7f0e500cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:59.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.515+0000 7f0e5712a640 1 -- 172.21.15.53:0/372754323 shutdown_connections 2023-06-10T19:01:59.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.515+0000 7f0e5712a640 1 -- 172.21.15.53:0/372754323 wait complete. 2023-06-10T19:01:59.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.515+0000 7f0e5712a640 1 Processor -- start 2023-06-10T19:01:59.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.515+0000 7f0e5712a640 1 -- start start 2023-06-10T19:01:59.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.515+0000 7f0e5712a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e50156180 0x7f0e500c2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:59.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.515+0000 7f0e5712a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0e50158a80 0x7f0e5006c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:59.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.515+0000 7f0e5712a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0e5015c070 0x7f0e50154a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:59.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.515+0000 7f0e5712a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e500c2dc0 con 0x7f0e50156180 2023-06-10T19:01:59.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.515+0000 7f0e5712a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e500b2d80 con 0x7f0e5015c070 2023-06-10T19:01:59.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.515+0000 7f0e5712a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e500b3060 con 0x7f0e50158a80 2023-06-10T19:01:59.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.515+0000 7f0e54ec6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e50156180 0x7f0e500c2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:59.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.515+0000 7f0e54ec6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e50156180 0x7f0e500c2570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60070/0 (socket says 172.21.15.53:60070) 2023-06-10T19:01:59.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.515+0000 7f0e54ec6640 1 -- 172.21.15.53:0/1758350686 learned_addr learned my addr 172.21.15.53:0/1758350686 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:59.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.515+0000 7f0e54ec6640 1 -- 172.21.15.53:0/1758350686 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0e50158a80 msgr2=0x7f0e5006c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:59.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.515+0000 7f0e54ec6640 1 --2- 172.21.15.53:0/1758350686 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0e50158a80 0x7f0e5006c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:59.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.515+0000 7f0e54ec6640 1 -- 172.21.15.53:0/1758350686 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0e5015c070 msgr2=0x7f0e50154a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:59.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.515+0000 7f0e54ec6640 1 --2- 172.21.15.53:0/1758350686 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0e5015c070 0x7f0e50154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:59.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.515+0000 7f0e54ec6640 1 -- 172.21.15.53:0/1758350686 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e4800bd40 con 0x7f0e50156180 2023-06-10T19:01:59.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.515+0000 7f0e54ec6640 1 --2- 172.21.15.53:0/1758350686 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e50156180 0x7f0e500c2570 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f0e4400c7f0 tx=0x7f0e4400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:59.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.515+0000 7f0e4d7fa640 1 -- 172.21.15.53:0/1758350686 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e44004220 con 0x7f0e50156180 2023-06-10T19:01:59.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.515+0000 7f0e4d7fa640 1 -- 172.21.15.53:0/1758350686 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e440043a0 con 0x7f0e50156180 2023-06-10T19:01:59.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.515+0000 7f0e5712a640 1 -- 172.21.15.53:0/1758350686 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e500b3340 con 0x7f0e50156180 2023-06-10T19:01:59.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.515+0000 7f0e4d7fa640 1 -- 172.21.15.53:0/1758350686 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e44004510 con 0x7f0e50156180 2023-06-10T19:01:59.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.515+0000 7f0e5712a640 1 -- 172.21.15.53:0/1758350686 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e500c30a0 con 0x7f0e50156180 2023-06-10T19:01:59.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.519+0000 7f0e5712a640 1 -- 172.21.15.53:0/1758350686 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e500b3560 con 0x7f0e50156180 2023-06-10T19:01:59.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.519+0000 7f0e4d7fa640 1 -- 172.21.15.53:0/1758350686 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0e44003860 con 0x7f0e50156180 2023-06-10T19:01:59.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.519+0000 7f0e4d7fa640 1 --2- 172.21.15.53:0/1758350686 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0e34066280 0x7f0e34068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:59.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.519+0000 7f0e4d7fa640 1 -- 172.21.15.53:0/1758350686 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0e44083850 con 0x7f0e50156180 2023-06-10T19:01:59.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.519+0000 7f0e4ffff640 1 --2- 172.21.15.53:0/1758350686 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0e34066280 0x7f0e34068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:59.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.519+0000 7f0e4ffff640 1 --2- 172.21.15.53:0/1758350686 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0e34066280 0x7f0e34068730 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f0e500c1720 tx=0x7f0e3c006c00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:59.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.523+0000 7f0e4d7fa640 1 -- 172.21.15.53:0/1758350686 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0e44050f80 con 0x7f0e50156180 2023-06-10T19:01:59.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.675+0000 7f0e5712a640 1 -- 172.21.15.53:0/1758350686 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0e5004d790 con 0x7f0e50156180 2023-06-10T19:01:59.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.679+0000 7f0e4d7fa640 1 -- 172.21.15.53:0/1758350686 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v90) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0e4401e0a0 con 0x7f0e50156180 2023-06-10T19:01:59.684 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-06-10T19:01:59.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.679+0000 7f0e5712a640 1 -- 172.21.15.53:0/1758350686 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0e34066280 msgr2=0x7f0e34068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:59.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.679+0000 7f0e5712a640 1 --2- 172.21.15.53:0/1758350686 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0e34066280 0x7f0e34068730 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f0e500c1720 tx=0x7f0e3c006c00 comp rx=0 tx=0).stop 2023-06-10T19:01:59.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.679+0000 7f0e5712a640 1 -- 172.21.15.53:0/1758350686 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e50156180 msgr2=0x7f0e500c2570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:59.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.679+0000 7f0e5712a640 1 --2- 172.21.15.53:0/1758350686 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e50156180 0x7f0e500c2570 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f0e4400c7f0 tx=0x7f0e4400ccb0 comp rx=0 tx=0).stop 2023-06-10T19:01:59.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.679+0000 7f0e5712a640 1 -- 172.21.15.53:0/1758350686 shutdown_connections 2023-06-10T19:01:59.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.679+0000 7f0e5712a640 1 --2- 172.21.15.53:0/1758350686 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0e34066280 0x7f0e34068730 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:59.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.679+0000 7f0e5712a640 1 --2- 172.21.15.53:0/1758350686 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0e5015c070 0x7f0e50154a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:59.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.679+0000 7f0e5712a640 1 --2- 172.21.15.53:0/1758350686 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0e50158a80 0x7f0e5006c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:59.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.679+0000 7f0e5712a640 1 --2- 172.21.15.53:0/1758350686 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e50156180 0x7f0e500c2570 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:59.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.679+0000 7f0e5712a640 1 -- 172.21.15.53:0/1758350686 >> 172.21.15.53:0/1758350686 conn(0x7f0e5006a0e0 msgr2=0x7f0e50157e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:59.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.679+0000 7f0e5712a640 1 -- 172.21.15.53:0/1758350686 shutdown_connections 2023-06-10T19:01:59.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.679+0000 7f0e5712a640 1 -- 172.21.15.53:0/1758350686 wait complete. 2023-06-10T19:01:59.703 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-06-10T19:01:59.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.811+0000 7fa3fe283640 1 Processor -- start 2023-06-10T19:01:59.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.811+0000 7fa3fe283640 1 -- start start 2023-06-10T19:01:59.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.811+0000 7fa3fe283640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa3f80c9840 0x7fa3f80c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:59.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.811+0000 7fa3fe283640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa3f8071060 0x7fa3f80af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:59.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.811+0000 7fa3fe283640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3f8159b50 con 0x7fa3f80afc60 2023-06-10T19:01:59.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.811+0000 7fa3fe283640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3f80ca150 con 0x7fa3f8071060 2023-06-10T19:01:59.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.811+0000 7fa3fe283640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3f80702a0 con 0x7fa3f80c9840 2023-06-10T19:01:59.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.811+0000 7fa3fc820640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fa3f80afc60 0x7fa3f815d2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56742/0 (socket says 172.21.15.53:56742) 2023-06-10T19:01:59.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.811+0000 7fa3f77fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa3f8071060 0x7fa3f80af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:59.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.811+0000 7fa3fc820640 1 -- 172.21.15.53:0/1562906182 learned_addr learned my addr 172.21.15.53:0/1562906182 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:01:59.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.811+0000 7fa3f7fff640 1 --2- 172.21.15.53:0/1562906182 >> v2:172.21.15.117:3300/0 conn(0x7fa3f80c9840 0x7fa3f80c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:59.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.811+0000 7fa3f77fe640 1 -- 172.21.15.53:0/1562906182 >> v2:172.21.15.117:3300/0 conn(0x7fa3f80c9840 msgr2=0x7fa3f80c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:01:59.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.811+0000 7fa3f77fe640 1 --2- 172.21.15.53:0/1562906182 >> v2:172.21.15.117:3300/0 conn(0x7fa3f80c9840 0x7fa3f80c9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:59.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.811+0000 7fa3f77fe640 1 -- 172.21.15.53:0/1562906182 >> v1:172.21.15.53:6789/0 conn(0x7fa3f80afc60 legacy=0x7fa3f815d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:59.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.811+0000 7fa3f77fe640 1 -- 172.21.15.53:0/1562906182 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f8070580 con 0x7fa3f8071060 2023-06-10T19:01:59.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.811+0000 7fa3f6ffd640 1 -- 172.21.15.53:0/1562906182 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2559481796 0 0) 0x7fa3f8159b50 con 0x7fa3f80afc60 2023-06-10T19:01:59.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.815+0000 7fa3f77fe640 1 --2- 172.21.15.53:0/1562906182 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3f8071060 0x7fa3f80af720 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7fa3f8071d80 tx=0x7fa3ec01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78064785e86bc08 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:59.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.815+0000 7fa3f6ffd640 1 -- 172.21.15.53:0/1562906182 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3ec004230 con 0x7fa3f8071060 2023-06-10T19:01:59.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.815+0000 7fa3f6ffd640 1 -- 172.21.15.53:0/1562906182 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3ec0a7050 con 0x7fa3f8071060 2023-06-10T19:01:59.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.815+0000 7fa3f6ffd640 1 -- 172.21.15.53:0/1562906182 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3ec003620 con 0x7fa3f8071060 2023-06-10T19:01:59.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.815+0000 7fa3fe283640 1 -- 172.21.15.53:0/1562906182 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3f8071060 msgr2=0x7fa3f80af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:59.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.815+0000 7fa3fe283640 1 --2- 172.21.15.53:0/1562906182 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3f8071060 0x7fa3f80af720 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7fa3f8071d80 tx=0x7fa3ec01c430 comp rx=0 tx=0).stop 2023-06-10T19:01:59.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.815+0000 7fa3fe283640 1 -- 172.21.15.53:0/1562906182 shutdown_connections 2023-06-10T19:01:59.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.815+0000 7fa3fe283640 1 --2- 172.21.15.53:0/1562906182 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3f8071060 0x7fa3f80af720 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:59.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.815+0000 7fa3fe283640 1 --2- 172.21.15.53:0/1562906182 >> v2:172.21.15.117:3300/0 conn(0x7fa3f80c9840 0x7fa3f80c9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:59.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.815+0000 7fa3fe283640 1 -- 172.21.15.53:0/1562906182 >> 172.21.15.53:0/1562906182 conn(0x7fa3f806a0d0 msgr2=0x7fa3f80ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:59.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.815+0000 7fa3fe283640 1 -- 172.21.15.53:0/1562906182 shutdown_connections 2023-06-10T19:01:59.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.815+0000 7fa3fe283640 1 -- 172.21.15.53:0/1562906182 wait complete. 2023-06-10T19:01:59.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.815+0000 7fa3fe283640 1 Processor -- start 2023-06-10T19:01:59.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.815+0000 7fa3fe283640 1 -- start start 2023-06-10T19:01:59.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.815+0000 7fa3fe283640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3f8071060 0x7fa3f81f3b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:59.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.815+0000 7fa3fe283640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3f80afc60 0x7fa3f81f8110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:59.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.815+0000 7fa3fe283640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3f80c9840 0x7fa3f81469e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:59.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.815+0000 7fa3fe283640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f814bc70 con 0x7fa3f8071060 2023-06-10T19:01:59.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.815+0000 7fa3fe283640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f81536c0 con 0x7fa3f80afc60 2023-06-10T19:01:59.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.815+0000 7fa3fe283640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f81f8650 con 0x7fa3f80c9840 2023-06-10T19:01:59.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.815+0000 7fa3f7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3f8071060 0x7fa3f81f3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:59.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.815+0000 7fa3f7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3f8071060 0x7fa3f81f3b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60094/0 (socket says 172.21.15.53:60094) 2023-06-10T19:01:59.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.819+0000 7fa3f7fff640 1 -- 172.21.15.53:0/1502183277 learned_addr learned my addr 172.21.15.53:0/1502183277 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:01:59.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.819+0000 7fa3fc820640 1 --2- 172.21.15.53:0/1502183277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3f80c9840 0x7fa3f81469e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:59.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.819+0000 7fa3f77fe640 1 --2- 172.21.15.53:0/1502183277 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3f80afc60 0x7fa3f81f8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:59.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.819+0000 7fa3f7fff640 1 -- 172.21.15.53:0/1502183277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3f80c9840 msgr2=0x7fa3f81469e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:59.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.819+0000 7fa3f7fff640 1 --2- 172.21.15.53:0/1502183277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3f80c9840 0x7fa3f81469e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:59.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.819+0000 7fa3f7fff640 1 -- 172.21.15.53:0/1502183277 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3f80afc60 msgr2=0x7fa3f81f8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:59.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.819+0000 7fa3f7fff640 1 --2- 172.21.15.53:0/1502183277 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3f80afc60 0x7fa3f81f8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:59.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.819+0000 7fa3f7fff640 1 -- 172.21.15.53:0/1502183277 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3ec009420 con 0x7fa3f8071060 2023-06-10T19:01:59.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.819+0000 7fa3f7fff640 1 --2- 172.21.15.53:0/1502183277 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3f8071060 0x7fa3f81f3b90 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7fa3e800e870 tx=0x7fa3e800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:59.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.819+0000 7fa3f4ff9640 1 -- 172.21.15.53:0/1502183277 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e8009510 con 0x7fa3f8071060 2023-06-10T19:01:59.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.819+0000 7fa3f4ff9640 1 -- 172.21.15.53:0/1502183277 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3e800eec0 con 0x7fa3f8071060 2023-06-10T19:01:59.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.819+0000 7fa3fe283640 1 -- 172.21.15.53:0/1502183277 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3f8147c90 con 0x7fa3f8071060 2023-06-10T19:01:59.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.819+0000 7fa3f4ff9640 1 -- 172.21.15.53:0/1502183277 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e800cae0 con 0x7fa3f8071060 2023-06-10T19:01:59.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.819+0000 7fa3fe283640 1 -- 172.21.15.53:0/1502183277 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3f814b5b0 con 0x7fa3f8071060 2023-06-10T19:01:59.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.819+0000 7fa3fe283640 1 -- 172.21.15.53:0/1502183277 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3f804d790 con 0x7fa3f8071060 2023-06-10T19:01:59.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.819+0000 7fa3f4ff9640 1 -- 172.21.15.53:0/1502183277 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa3e800cc40 con 0x7fa3f8071060 2023-06-10T19:01:59.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.819+0000 7fa3f4ff9640 1 --2- 172.21.15.53:0/1502183277 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa3e4066280 0x7fa3e4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:01:59.832 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.819+0000 7fa3f4ff9640 1 -- 172.21.15.53:0/1502183277 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fa3e8083b50 con 0x7fa3f8071060 2023-06-10T19:01:59.832 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.819+0000 7fa3f77fe640 1 --2- 172.21.15.53:0/1502183277 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa3e4066280 0x7fa3e4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:01:59.832 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.819+0000 7fa3f77fe640 1 --2- 172.21.15.53:0/1502183277 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa3e4066280 0x7fa3e4068730 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fa3ec0ad000 tx=0x7fa3ec0a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:01:59.832 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.823+0000 7fa3f4ff9640 1 -- 172.21.15.53:0/1502183277 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa3e80512a0 con 0x7fa3f8071060 2023-06-10T19:01:59.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.971+0000 7fa3fe283640 1 -- 172.21.15.53:0/1502183277 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fa3f80cb140 con 0x7fa3f8071060 2023-06-10T19:01:59.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.975+0000 7fa3f4ff9640 1 -- 172.21.15.53:0/1502183277 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v90) v1 ==== 84+0+126 (secure 0 0 0) 0x7fa3e80548c0 con 0x7fa3f8071060 2023-06-10T19:01:59.979 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:01:59.980 INFO:teuthology.orchestra.run.smithi053.stdout:[ 2023-06-10T19:01:59.980 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:01:59.980 INFO:teuthology.orchestra.run.smithi053.stdout: "poolnum": 1, 2023-06-10T19:01:59.980 INFO:teuthology.orchestra.run.smithi053.stdout: "poolname": ".mgr" 2023-06-10T19:01:59.980 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:01:59.980 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:01:59.981 INFO:teuthology.orchestra.run.smithi053.stdout: "poolnum": 2, 2023-06-10T19:01:59.981 INFO:teuthology.orchestra.run.smithi053.stdout: "poolname": "rbd" 2023-06-10T19:01:59.981 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:01:59.981 INFO:teuthology.orchestra.run.smithi053.stdout:] 2023-06-10T19:01:59.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.975+0000 7fa3fe283640 1 -- 172.21.15.53:0/1502183277 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa3e4066280 msgr2=0x7fa3e4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:59.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.975+0000 7fa3fe283640 1 --2- 172.21.15.53:0/1502183277 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa3e4066280 0x7fa3e4068730 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fa3ec0ad000 tx=0x7fa3ec0a6000 comp rx=0 tx=0).stop 2023-06-10T19:01:59.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.975+0000 7fa3fe283640 1 -- 172.21.15.53:0/1502183277 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3f8071060 msgr2=0x7fa3f81f3b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:01:59.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.975+0000 7fa3fe283640 1 --2- 172.21.15.53:0/1502183277 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3f8071060 0x7fa3f81f3b90 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7fa3e800e870 tx=0x7fa3e800ec70 comp rx=0 tx=0).stop 2023-06-10T19:01:59.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.975+0000 7fa3fe283640 1 -- 172.21.15.53:0/1502183277 shutdown_connections 2023-06-10T19:01:59.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.975+0000 7fa3fe283640 1 --2- 172.21.15.53:0/1502183277 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa3e4066280 0x7fa3e4068730 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:59.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.975+0000 7fa3fe283640 1 --2- 172.21.15.53:0/1502183277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3f80c9840 0x7fa3f81469e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:59.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.975+0000 7fa3fe283640 1 --2- 172.21.15.53:0/1502183277 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3f80afc60 0x7fa3f81f8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:59.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.975+0000 7fa3fe283640 1 --2- 172.21.15.53:0/1502183277 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3f8071060 0x7fa3f81f3b90 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:01:59.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.975+0000 7fa3fe283640 1 -- 172.21.15.53:0/1502183277 >> 172.21.15.53:0/1502183277 conn(0x7fa3f806a0d0 msgr2=0x7fa3f80ada10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:01:59.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.975+0000 7fa3fe283640 1 -- 172.21.15.53:0/1502183277 shutdown_connections 2023-06-10T19:01:59.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:01:59.975+0000 7fa3fe283640 1 -- 172.21.15.53:0/1502183277 wait complete. 2023-06-10T19:01:59.997 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-06-10T19:01:59.998 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-06-10T19:02:00.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:00.115+0000 7f4187d10640 1 Processor -- start 2023-06-10T19:02:00.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:00.115+0000 7f4187d10640 1 -- start start 2023-06-10T19:02:00.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:00.115+0000 7f4187d10640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41800ca220 0x7f41800af830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:00.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:00.115+0000 7f4187d10640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f41800afd70 0x7f41800c8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:00.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:00.115+0000 7f4187d10640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4180159d10 con 0x7f4180159940 2023-06-10T19:02:00.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:00.115+0000 7f4187d10640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f418006b100 con 0x7f41800afd70 2023-06-10T19:02:00.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:00.115+0000 7f4187d10640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f418006bc80 con 0x7f41800ca220 2023-06-10T19:02:00.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:00.115+0000 7f41862ad640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f41800afd70 0x7f41800c8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:00.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:00.115+0000 7f41862ad640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f41800afd70 0x7f41800c8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60102/0 (socket says 172.21.15.53:60102) 2023-06-10T19:02:00.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:00.115+0000 7f41862ad640 1 -- 172.21.15.53:0/2086073667 learned_addr learned my addr 172.21.15.53:0/2086073667 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:00.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:00.115+0000 7f41852ab640 1 --2- 172.21.15.53:0/2086073667 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41800ca220 0x7f41800af830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:00.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:00.115+0000 7f41862ad640 1 -- 172.21.15.53:0/2086073667 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41800ca220 msgr2=0x7f41800af830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:00.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:00.115+0000 7f41862ad640 1 --2- 172.21.15.53:0/2086073667 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41800ca220 0x7f41800af830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:00.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:00.115+0000 7f41862ad640 1 -- 172.21.15.53:0/2086073667 >> v1:172.21.15.117:6789/0 conn(0x7f4180159940 legacy=0x7f41800c9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:00.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:00.115+0000 7f41862ad640 1 -- 172.21.15.53:0/2086073667 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f418006c110 con 0x7f41800afd70 2023-06-10T19:02:00.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:00.119+0000 7f41862ad640 1 --2- 172.21.15.53:0/2086073667 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f41800afd70 0x7f41800c8400 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f4178009e50 tx=0x7f417801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16b5eb81a819f287 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:00.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:00.119+0000 7f4184aaa640 1 -- 172.21.15.53:0/2086073667 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41780a5790 con 0x7f41800afd70 2023-06-10T19:02:00.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:00.119+0000 7f4184aaa640 1 -- 172.21.15.53:0/2086073667 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41780a58f0 con 0x7f41800afd70 2023-06-10T19:02:00.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:00.119+0000 7f4184aaa640 1 -- 172.21.15.53:0/2086073667 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41780a5c80 con 0x7f41800afd70 2023-06-10T19:02:00.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:00.119+0000 7f4187d10640 1 -- 172.21.15.53:0/2086073667 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f41800afd70 msgr2=0x7f41800c8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:00.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:00.119+0000 7f4187d10640 1 --2- 172.21.15.53:0/2086073667 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f41800afd70 0x7f41800c8400 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f4178009e50 tx=0x7f417801c910 comp rx=0 tx=0).stop 2023-06-10T19:02:00.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:00.119+0000 7f4187d10640 1 -- 172.21.15.53:0/2086073667 shutdown_connections 2023-06-10T19:02:00.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:00.119+0000 7f4187d10640 1 --2- 172.21.15.53:0/2086073667 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f41800afd70 0x7f41800c8400 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:00.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:00.119+0000 7f4187d10640 1 --2- 172.21.15.53:0/2086073667 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f41800ca220 0x7f41800af830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:00.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:00.119+0000 7f4187d10640 1 -- 172.21.15.53:0/2086073667 >> 172.21.15.53:0/2086073667 conn(0x7f41800ca830 msgr2=0x7f41800cac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:00.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:00.119+0000 7f4187d10640 1 -- 172.21.15.53:0/2086073667 shutdown_connections 2023-06-10T19:02:00.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:00.119+0000 7f4187d10640 1 -- 172.21.15.53:0/2086073667 wait complete. 2023-06-10T19:02:00.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:00.119+0000 7f4187d10640 1 Processor -- start 2023-06-10T19:02:00.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:00.119+0000 7f4187d10640 1 -- start start 2023-06-10T19:02:00.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:00.119+0000 7f4187d10640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f41800afd70 0x7f41801502f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:00.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:00.119+0000 7f4187d10640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41800ca220 0x7f41800b0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:00.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:00.119+0000 7f4187d10640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4180159940 0x7f41801531c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:00.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:00.119+0000 7f4187d10640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41801519f0 con 0x7f41800afd70 2023-06-10T19:02:00.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:00.119+0000 7f4187d10640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4180151cd0 con 0x7f41800ca220 2023-06-10T19:02:00.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:00.119+0000 7f4187d10640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4180151fb0 con 0x7f4180159940 2023-06-10T19:02:00.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:00.119+0000 7f4185aac640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f41800afd70 0x7f41801502f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:00.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:00.119+0000 7f4185aac640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f41800afd70 0x7f41801502f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60118/0 (socket says 172.21.15.53:60118) 2023-06-10T19:02:00.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:00.119+0000 7f4185aac640 1 -- 172.21.15.53:0/3645643281 learned_addr learned my addr 172.21.15.53:0/3645643281 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:00.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:00.119+0000 7f41852ab640 1 --2- 172.21.15.53:0/3645643281 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41800ca220 0x7f41800b0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:00.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:00.119+0000 7f41862ad640 1 --2- 172.21.15.53:0/3645643281 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4180159940 0x7f41801531c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:00.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:00.119+0000 7f4185aac640 1 -- 172.21.15.53:0/3645643281 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4180159940 msgr2=0x7f41801531c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:00.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:00.123+0000 7f4185aac640 1 --2- 172.21.15.53:0/3645643281 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4180159940 0x7f41801531c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:00.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:00.123+0000 7f4185aac640 1 -- 172.21.15.53:0/3645643281 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41800ca220 msgr2=0x7f41800b0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:00.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:00.123+0000 7f4185aac640 1 --2- 172.21.15.53:0/3645643281 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41800ca220 0x7f41800b0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:00.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:00.123+0000 7f4185aac640 1 -- 172.21.15.53:0/3645643281 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4178009b30 con 0x7f41800afd70 2023-06-10T19:02:00.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:00.123+0000 7f4185aac640 1 --2- 172.21.15.53:0/3645643281 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f41800afd70 0x7f41801502f0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f417c00b410 tx=0x7f417c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:00.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:00.123+0000 7f41767fc640 1 -- 172.21.15.53:0/3645643281 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f417c004020 con 0x7f41800afd70 2023-06-10T19:02:00.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:00.123+0000 7f41767fc640 1 -- 172.21.15.53:0/3645643281 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f417c004180 con 0x7f41800afd70 2023-06-10T19:02:00.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:00.123+0000 7f4187d10640 1 -- 172.21.15.53:0/3645643281 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4180152290 con 0x7f41800afd70 2023-06-10T19:02:00.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:00.123+0000 7f41767fc640 1 -- 172.21.15.53:0/3645643281 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f417c011630 con 0x7f41800afd70 2023-06-10T19:02:00.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:00.123+0000 7f4187d10640 1 -- 172.21.15.53:0/3645643281 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4180150830 con 0x7f41800afd70 2023-06-10T19:02:00.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:00.123+0000 7f4187d10640 1 -- 172.21.15.53:0/3645643281 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f418004d790 con 0x7f41800afd70 2023-06-10T19:02:00.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:00.123+0000 7f41767fc640 1 -- 172.21.15.53:0/3645643281 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f417c011790 con 0x7f41800afd70 2023-06-10T19:02:00.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:00.123+0000 7f41767fc640 1 --2- 172.21.15.53:0/3645643281 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4164066280 0x7f4164068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:00.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:00.123+0000 7f41767fc640 1 -- 172.21.15.53:0/3645643281 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f417c0836a0 con 0x7f41800afd70 2023-06-10T19:02:00.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:00.123+0000 7f41852ab640 1 --2- 172.21.15.53:0/3645643281 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4164066280 0x7f4164068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:00.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:00.123+0000 7f41852ab640 1 --2- 172.21.15.53:0/3645643281 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4164066280 0x7f4164068730 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f41800c7c70 tx=0x7f4170008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:00.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:00.127+0000 7f41767fc640 1 -- 172.21.15.53:0/3645643281 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f417c050f00 con 0x7f41800afd70 2023-06-10T19:02:00.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:00.279+0000 7f4187d10640 1 -- 172.21.15.53:0/3645643281 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f4180152740 con 0x7f41800afd70 2023-06-10T19:02:01.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.251+0000 7f41767fc640 1 -- 172.21.15.53:0/3645643281 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v91) v1 ==== 138+0+0 (secure 0 0 0) 0x7f417c054520 con 0x7f41800afd70 2023-06-10T19:02:01.258 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_metadata' created 2023-06-10T19:02:01.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.255+0000 7f4187d10640 1 -- 172.21.15.53:0/3645643281 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4164066280 msgr2=0x7f4164068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:01.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.255+0000 7f4187d10640 1 --2- 172.21.15.53:0/3645643281 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4164066280 0x7f4164068730 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f41800c7c70 tx=0x7f4170008040 comp rx=0 tx=0).stop 2023-06-10T19:02:01.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.255+0000 7f4187d10640 1 -- 172.21.15.53:0/3645643281 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f41800afd70 msgr2=0x7f41801502f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:01.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.255+0000 7f4187d10640 1 --2- 172.21.15.53:0/3645643281 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f41800afd70 0x7f41801502f0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f417c00b410 tx=0x7f417c00b8d0 comp rx=0 tx=0).stop 2023-06-10T19:02:01.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.255+0000 7f4187d10640 1 -- 172.21.15.53:0/3645643281 shutdown_connections 2023-06-10T19:02:01.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.255+0000 7f4187d10640 1 --2- 172.21.15.53:0/3645643281 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4164066280 0x7f4164068730 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:01.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.255+0000 7f4187d10640 1 --2- 172.21.15.53:0/3645643281 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4180159940 0x7f41801531c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:01.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.255+0000 7f4187d10640 1 --2- 172.21.15.53:0/3645643281 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41800ca220 0x7f41800b0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:01.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.255+0000 7f4187d10640 1 --2- 172.21.15.53:0/3645643281 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f41800afd70 0x7f41801502f0 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:01.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.255+0000 7f4187d10640 1 -- 172.21.15.53:0/3645643281 >> 172.21.15.53:0/3645643281 conn(0x7f41800ca830 msgr2=0x7f41800c9540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:01.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.255+0000 7f4187d10640 1 -- 172.21.15.53:0/3645643281 shutdown_connections 2023-06-10T19:02:01.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.255+0000 7f4187d10640 1 -- 172.21.15.53:0/3645643281 wait complete. 2023-06-10T19:02:01.287 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-06-10T19:02:01.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.407+0000 7fdeb6525640 1 Processor -- start 2023-06-10T19:02:01.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.407+0000 7fdeb6525640 1 -- start start 2023-06-10T19:02:01.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.407+0000 7fdeb6525640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fdeb00b3d40 0x7fdeb00cf980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:01.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.407+0000 7fdeb6525640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdeb00699d0 con 0x7fdeb015b9f0 2023-06-10T19:02:01.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.407+0000 7fdeb6525640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdeb0070ca0 con 0x7fdeb00b1e00 2023-06-10T19:02:01.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.407+0000 7fdeb6525640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdeb0069450 con 0x7fdeb00b3d40 2023-06-10T19:02:01.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.407+0000 7fdeaffff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fdeb015b9f0 0x7fdeb00b3630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:38934/0 (socket says 172.21.15.53:38934) 2023-06-10T19:02:01.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.407+0000 7fdeaffff640 1 -- 172.21.15.53:0/2094132761 learned_addr learned my addr 172.21.15.53:0/2094132761 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:02:01.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.407+0000 7fdeb4ac2640 1 --2- 172.21.15.53:0/2094132761 >> v2:172.21.15.117:3300/0 conn(0x7fdeb00b3d40 0x7fdeb00cf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:01.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.407+0000 7fdeaeffd640 1 -- 172.21.15.53:0/2094132761 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3507793849 0 0) 0x7fdeb00699d0 con 0x7fdeb015b9f0 2023-06-10T19:02:01.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.407+0000 7fdeaeffd640 1 -- 172.21.15.53:0/2094132761 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde9c003530 con 0x7fdeb015b9f0 2023-06-10T19:02:01.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.407+0000 7fdeaeffd640 1 -- 172.21.15.53:0/2094132761 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3790187175 0 0) 0x7fde9c003530 con 0x7fdeb015b9f0 2023-06-10T19:02:01.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.407+0000 7fdeaeffd640 1 -- 172.21.15.53:0/2094132761 >> v2:172.21.15.117:3300/0 conn(0x7fdeb00b3d40 msgr2=0x7fdeb00cf980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:01.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.407+0000 7fdeaeffd640 1 --2- 172.21.15.53:0/2094132761 >> v2:172.21.15.117:3300/0 conn(0x7fdeb00b3d40 0x7fdeb00cf980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:01.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.407+0000 7fdeaeffd640 1 -- 172.21.15.53:0/2094132761 >> v1:172.21.15.117:6789/0 conn(0x7fdeb00b1e00 legacy=0x7fdeb015f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:01.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.407+0000 7fdeaeffd640 1 -- 172.21.15.53:0/2094132761 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeb0070f80 con 0x7fdeb015b9f0 2023-06-10T19:02:01.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.407+0000 7fdeaeffd640 1 -- 172.21.15.53:0/2094132761 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fdea0001a00 con 0x7fdeb015b9f0 2023-06-10T19:02:01.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.407+0000 7fdeaeffd640 1 -- 172.21.15.53:0/2094132761 >> v1:172.21.15.53:6789/0 conn(0x7fdeb015b9f0 legacy=0x7fdeb00b3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:01.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.407+0000 7fdeaeffd640 1 --2- 172.21.15.53:0/2094132761 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde9c003980 0x7fde9c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:01.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.407+0000 7fdeaeffd640 1 --2- 172.21.15.53:0/2094132761 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde9c0047d0 0x7fde9c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:01.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.407+0000 7fdeaeffd640 1 --2- 172.21.15.53:0/2094132761 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde9c005180 0x7fde9c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:01.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.407+0000 7fdeaeffd640 1 -- 172.21.15.53:0/2094132761 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb0069450 con 0x7fde9c0047d0 2023-06-10T19:02:01.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.407+0000 7fdeaeffd640 1 -- 172.21.15.53:0/2094132761 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde9c00c000 con 0x7fde9c003980 2023-06-10T19:02:01.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.407+0000 7fdeaeffd640 1 -- 172.21.15.53:0/2094132761 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde9c00c1c0 con 0x7fde9c005180 2023-06-10T19:02:01.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.407+0000 7fdeaf7fe640 1 --2- 172.21.15.53:0/2094132761 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde9c0047d0 0x7fde9c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:01.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.407+0000 7fdeaffff640 1 --2- 172.21.15.53:0/2094132761 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde9c003980 0x7fde9c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:01.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.407+0000 7fdeb4ac2640 1 --2- 172.21.15.53:0/2094132761 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde9c005180 0x7fde9c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:01.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.407+0000 7fdeaf7fe640 1 -- 172.21.15.53:0/2094132761 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde9c005180 msgr2=0x7fde9c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:01.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.407+0000 7fdeaf7fe640 1 --2- 172.21.15.53:0/2094132761 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde9c005180 0x7fde9c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:01.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.407+0000 7fdeaf7fe640 1 -- 172.21.15.53:0/2094132761 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde9c003980 msgr2=0x7fde9c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:01.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.407+0000 7fdeaf7fe640 1 --2- 172.21.15.53:0/2094132761 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde9c003980 0x7fde9c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:01.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.407+0000 7fdeaf7fe640 1 -- 172.21.15.53:0/2094132761 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde9c003530 con 0x7fde9c0047d0 2023-06-10T19:02:01.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.407+0000 7fdeb4ac2640 1 -- 172.21.15.53:0/2094132761 reap_dead start 2023-06-10T19:02:01.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.411+0000 7fdeaf7fe640 1 --2- 172.21.15.53:0/2094132761 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde9c0047d0 0x7fde9c004c40 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7fde98001780 tx=0x7fde9801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=230e5e657c75e119 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:01.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.411+0000 7fdeaeffd640 1 -- 172.21.15.53:0/2094132761 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde980052d0 con 0x7fde9c0047d0 2023-06-10T19:02:01.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.411+0000 7fdeaeffd640 1 -- 172.21.15.53:0/2094132761 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde980a7050 con 0x7fde9c0047d0 2023-06-10T19:02:01.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.411+0000 7fdeaeffd640 1 -- 172.21.15.53:0/2094132761 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde98003600 con 0x7fde9c0047d0 2023-06-10T19:02:01.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.411+0000 7fdeb6525640 1 -- 172.21.15.53:0/2094132761 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde9c0047d0 msgr2=0x7fde9c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:01.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.411+0000 7fdeb6525640 1 --2- 172.21.15.53:0/2094132761 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde9c0047d0 0x7fde9c004c40 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7fde98001780 tx=0x7fde9801c3e0 comp rx=0 tx=0).stop 2023-06-10T19:02:01.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.411+0000 7fdeb6525640 1 -- 172.21.15.53:0/2094132761 shutdown_connections 2023-06-10T19:02:01.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.411+0000 7fdeb6525640 1 --2- 172.21.15.53:0/2094132761 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde9c0047d0 0x7fde9c004c40 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:01.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.411+0000 7fdeb6525640 1 -- 172.21.15.53:0/2094132761 >> 172.21.15.53:0/2094132761 conn(0x7fdeb00b42b0 msgr2=0x7fdeb00b46b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:01.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.411+0000 7fdeb6525640 1 -- 172.21.15.53:0/2094132761 shutdown_connections 2023-06-10T19:02:01.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.411+0000 7fdeb6525640 1 -- 172.21.15.53:0/2094132761 wait complete. 2023-06-10T19:02:01.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.411+0000 7fdeb6525640 1 Processor -- start 2023-06-10T19:02:01.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.411+0000 7fdeb6525640 1 -- start start 2023-06-10T19:02:01.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.415+0000 7fdeb6525640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde9c0047d0 0x7fdeb014f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:01.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.415+0000 7fdeb6525640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdeb015dc10 0x7fdeb0154a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:01.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.415+0000 7fdeb6525640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdeb0154f50 0x7fdeb01f0c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:01.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.415+0000 7fdeb6525640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb01553c0 con 0x7fdeb015dc10 2023-06-10T19:02:01.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.415+0000 7fdeb6525640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb0151b40 con 0x7fde9c0047d0 2023-06-10T19:02:01.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.415+0000 7fdeb6525640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb0151e20 con 0x7fdeb0154f50 2023-06-10T19:02:01.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.415+0000 7fdeaf7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdeb015dc10 0x7fdeb0154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:01.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.415+0000 7fdeaf7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdeb015dc10 0x7fdeb0154a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37284/0 (socket says 172.21.15.53:37284) 2023-06-10T19:02:01.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.415+0000 7fdeaf7fe640 1 -- 172.21.15.53:0/130883940 learned_addr learned my addr 172.21.15.53:0/130883940 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:01.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.415+0000 7fdeaffff640 1 --2- 172.21.15.53:0/130883940 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde9c0047d0 0x7fdeb014f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:01.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.415+0000 7fdeb4ac2640 1 --2- 172.21.15.53:0/130883940 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdeb0154f50 0x7fdeb01f0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:01.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.415+0000 7fdeaf7fe640 1 -- 172.21.15.53:0/130883940 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdeb0154f50 msgr2=0x7fdeb01f0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:01.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.415+0000 7fdeaf7fe640 1 --2- 172.21.15.53:0/130883940 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdeb0154f50 0x7fdeb01f0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:01.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.415+0000 7fdeaf7fe640 1 -- 172.21.15.53:0/130883940 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde9c0047d0 msgr2=0x7fdeb014f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:01.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.415+0000 7fdeaf7fe640 1 --2- 172.21.15.53:0/130883940 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde9c0047d0 0x7fdeb014f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:01.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.415+0000 7fdeaf7fe640 1 -- 172.21.15.53:0/130883940 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeb01504b0 con 0x7fdeb015dc10 2023-06-10T19:02:01.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.415+0000 7fdeaf7fe640 1 --2- 172.21.15.53:0/130883940 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdeb015dc10 0x7fdeb0154a10 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7fde9801c210 tx=0x7fde9c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:01.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.415+0000 7fdeacff9640 1 -- 172.21.15.53:0/130883940 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde98003e40 con 0x7fdeb015dc10 2023-06-10T19:02:01.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.415+0000 7fdeacff9640 1 -- 172.21.15.53:0/130883940 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde98007030 con 0x7fdeb015dc10 2023-06-10T19:02:01.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.415+0000 7fdeb6525640 1 -- 172.21.15.53:0/130883940 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdeb0150790 con 0x7fdeb015dc10 2023-06-10T19:02:01.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.415+0000 7fdeacff9640 1 -- 172.21.15.53:0/130883940 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde980073c0 con 0x7fdeb015dc10 2023-06-10T19:02:01.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.415+0000 7fdeb6525640 1 -- 172.21.15.53:0/130883940 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdeb01f1170 con 0x7fdeb015dc10 2023-06-10T19:02:01.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.415+0000 7fdeb6525640 1 -- 172.21.15.53:0/130883940 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdeb0150310 con 0x7fdeb015dc10 2023-06-10T19:02:01.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.415+0000 7fdeacff9640 1 -- 172.21.15.53:0/130883940 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fde98007520 con 0x7fdeb015dc10 2023-06-10T19:02:01.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.415+0000 7fdeacff9640 1 --2- 172.21.15.53:0/130883940 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fde900662b0 0x7fde90068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:01.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.415+0000 7fdeacff9640 1 -- 172.21.15.53:0/130883940 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5580+0+0 (secure 0 0 0) 0x7fde9811dfd0 con 0x7fdeb015dc10 2023-06-10T19:02:01.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.415+0000 7fdeaffff640 1 --2- 172.21.15.53:0/130883940 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fde900662b0 0x7fde90068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:01.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.419+0000 7fdeaffff640 1 --2- 172.21.15.53:0/130883940 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fde900662b0 0x7fde90068760 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fdea0002020 tx=0x7fdea0001260 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:01.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.423+0000 7fdeacff9640 1 -- 172.21.15.53:0/130883940 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdeb0150310 con 0x7fdeb015dc10 2023-06-10T19:02:01.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:01.575+0000 7fdeb6525640 1 -- 172.21.15.53:0/130883940 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fdeb0150310 con 0x7fdeb015dc10 2023-06-10T19:02:02.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.263+0000 7fdeacff9640 1 -- 172.21.15.53:0/130883940 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v92) v1 ==== 170+0+0 (secure 0 0 0) 0x7fdeb0150310 con 0x7fdeb015dc10 2023-06-10T19:02:02.273 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_data' created 2023-06-10T19:02:02.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.275+0000 7fdeb6525640 1 -- 172.21.15.53:0/130883940 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fde900662b0 msgr2=0x7fde90068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:02.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.275+0000 7fdeb6525640 1 --2- 172.21.15.53:0/130883940 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fde900662b0 0x7fde90068760 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fdea0002020 tx=0x7fdea0001260 comp rx=0 tx=0).stop 2023-06-10T19:02:02.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.275+0000 7fdeb6525640 1 -- 172.21.15.53:0/130883940 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdeb015dc10 msgr2=0x7fdeb0154a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:02.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.275+0000 7fdeb6525640 1 --2- 172.21.15.53:0/130883940 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdeb015dc10 0x7fdeb0154a10 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7fde9801c210 tx=0x7fde9c005800 comp rx=0 tx=0).stop 2023-06-10T19:02:02.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.275+0000 7fdeb6525640 1 -- 172.21.15.53:0/130883940 shutdown_connections 2023-06-10T19:02:02.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.275+0000 7fdeb6525640 1 --2- 172.21.15.53:0/130883940 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fde900662b0 0x7fde90068760 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:02.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.275+0000 7fdeb6525640 1 --2- 172.21.15.53:0/130883940 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdeb0154f50 0x7fdeb01f0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:02.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.275+0000 7fdeb6525640 1 --2- 172.21.15.53:0/130883940 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdeb015dc10 0x7fdeb0154a10 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:02.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.275+0000 7fdeb6525640 1 --2- 172.21.15.53:0/130883940 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde9c0047d0 0x7fdeb014f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:02.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.275+0000 7fdeb6525640 1 -- 172.21.15.53:0/130883940 >> 172.21.15.53:0/130883940 conn(0x7fdeb00b42b0 msgr2=0x7fdeb00afdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:02.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.275+0000 7fdeb6525640 1 -- 172.21.15.53:0/130883940 shutdown_connections 2023-06-10T19:02:02.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.279+0000 7fdeb6525640 1 -- 172.21.15.53:0/130883940 wait complete. 2023-06-10T19:02:02.311 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-06-10T19:02:02.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.431+0000 7f0673836640 1 Processor -- start 2023-06-10T19:02:02.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.431+0000 7f0673836640 1 -- start start 2023-06-10T19:02:02.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.431+0000 7f0673836640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f066c15c090 0x7f066c0b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:02.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.431+0000 7f0673836640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f066c0b0b90 0x7f066c0b7720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:02.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.431+0000 7f0673836640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f066c0b80a0 con 0x7f066c0b7c60 2023-06-10T19:02:02.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.431+0000 7f0673836640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f066c0cc7c0 con 0x7f066c15c090 2023-06-10T19:02:02.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.431+0000 7f0673836640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f066c0ccaa0 con 0x7f066c0b0b90 2023-06-10T19:02:02.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.431+0000 7f06715d2640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f066c15c090 0x7f066c0b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:02.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.431+0000 7f06715d2640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f066c15c090 0x7f066c0b10c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37290/0 (socket says 172.21.15.53:37290) 2023-06-10T19:02:02.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.431+0000 7f06715d2640 1 -- 172.21.15.53:0/432354634 learned_addr learned my addr 172.21.15.53:0/432354634 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:02.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.431+0000 7f0671dd3640 1 --1- 172.21.15.53:0/432354634 >> v1:172.21.15.53:6789/0 conn(0x7f066c0b7c60 0x7f066c0b3b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:38936/0 (socket says 172.21.15.53:38936) 2023-06-10T19:02:02.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.431+0000 7f0670dd1640 1 --2- 172.21.15.53:0/432354634 >> v2:172.21.15.117:3300/0 conn(0x7f066c0b0b90 0x7f066c0b7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:02.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.431+0000 7f06715d2640 1 -- 172.21.15.53:0/432354634 >> v2:172.21.15.117:3300/0 conn(0x7f066c0b0b90 msgr2=0x7f066c0b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:02.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.431+0000 7f06715d2640 1 --2- 172.21.15.53:0/432354634 >> v2:172.21.15.117:3300/0 conn(0x7f066c0b0b90 0x7f066c0b7720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:02.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.431+0000 7f06715d2640 1 -- 172.21.15.53:0/432354634 >> v1:172.21.15.53:6789/0 conn(0x7f066c0b7c60 legacy=0x7f066c0b3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:02.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.431+0000 7f0663fff640 1 -- 172.21.15.53:0/432354634 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 124075510 0 0) 0x7f066c0b80a0 con 0x7f066c0b7c60 2023-06-10T19:02:02.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.431+0000 7f06715d2640 1 -- 172.21.15.53:0/432354634 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f066c0ccd80 con 0x7f066c15c090 2023-06-10T19:02:02.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.431+0000 7f0670dd1640 1 --2- 172.21.15.53:0/432354634 >> v2:172.21.15.117:3300/0 conn(0x7f066c0b0b90 0x7f066c0b7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:02:02.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.435+0000 7f06715d2640 1 --2- 172.21.15.53:0/432354634 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f066c15c090 0x7f066c0b10c0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f066c0b4c30 tx=0x7f066801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b58a73c8d3481a82 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:02.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.435+0000 7f0663fff640 1 -- 172.21.15.53:0/432354634 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06680ad660 con 0x7f066c15c090 2023-06-10T19:02:02.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.435+0000 7f0663fff640 1 -- 172.21.15.53:0/432354634 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06680ad7c0 con 0x7f066c15c090 2023-06-10T19:02:02.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.435+0000 7f0663fff640 1 -- 172.21.15.53:0/432354634 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06680adb50 con 0x7f066c15c090 2023-06-10T19:02:02.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.435+0000 7f0673836640 1 -- 172.21.15.53:0/432354634 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f066c15c090 msgr2=0x7f066c0b10c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:02.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.435+0000 7f0673836640 1 --2- 172.21.15.53:0/432354634 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f066c15c090 0x7f066c0b10c0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f066c0b4c30 tx=0x7f066801c440 comp rx=0 tx=0).stop 2023-06-10T19:02:02.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.435+0000 7f0673836640 1 -- 172.21.15.53:0/432354634 shutdown_connections 2023-06-10T19:02:02.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.439+0000 7f0673836640 1 --2- 172.21.15.53:0/432354634 >> v2:172.21.15.117:3300/0 conn(0x7f066c0b0b90 0x7f066c0b7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:02.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.439+0000 7f0673836640 1 --2- 172.21.15.53:0/432354634 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f066c15c090 0x7f066c0b10c0 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:02.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.439+0000 7f0673836640 1 -- 172.21.15.53:0/432354634 >> 172.21.15.53:0/432354634 conn(0x7f066c069e20 msgr2=0x7f066c06a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:02.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.439+0000 7f0673836640 1 -- 172.21.15.53:0/432354634 shutdown_connections 2023-06-10T19:02:02.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.439+0000 7f0673836640 1 -- 172.21.15.53:0/432354634 wait complete. 2023-06-10T19:02:02.445 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.439+0000 7f0673836640 1 Processor -- start 2023-06-10T19:02:02.445 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.439+0000 7f0673836640 1 -- start start 2023-06-10T19:02:02.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.439+0000 7f0673836640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f066c0b0b90 0x7f066c15ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:02.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.439+0000 7f0673836640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f066c0b7c60 0x7f066c149420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:02.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.439+0000 7f0673836640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f066c15c090 0x7f066c156780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:02.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.439+0000 7f0673836640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f066c14eb40 con 0x7f066c15c090 2023-06-10T19:02:02.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.439+0000 7f0673836640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f066c14ee20 con 0x7f066c0b7c60 2023-06-10T19:02:02.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.439+0000 7f0673836640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f066c14f100 con 0x7f066c0b0b90 2023-06-10T19:02:02.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.439+0000 7f0671dd3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f066c15c090 0x7f066c156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:02.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.439+0000 7f0671dd3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f066c15c090 0x7f066c156780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37294/0 (socket says 172.21.15.53:37294) 2023-06-10T19:02:02.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.439+0000 7f0671dd3640 1 -- 172.21.15.53:0/3657629548 learned_addr learned my addr 172.21.15.53:0/3657629548 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:02.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.439+0000 7f0670dd1640 1 --2- 172.21.15.53:0/3657629548 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f066c0b7c60 0x7f066c149420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:02.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.439+0000 7f06715d2640 1 --2- 172.21.15.53:0/3657629548 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f066c0b0b90 0x7f066c15ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:02.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.439+0000 7f0671dd3640 1 -- 172.21.15.53:0/3657629548 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f066c0b0b90 msgr2=0x7f066c15ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:02.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.439+0000 7f0671dd3640 1 --2- 172.21.15.53:0/3657629548 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f066c0b0b90 0x7f066c15ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:02.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.439+0000 7f0671dd3640 1 -- 172.21.15.53:0/3657629548 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f066c0b7c60 msgr2=0x7f066c149420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:02.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.439+0000 7f0671dd3640 1 --2- 172.21.15.53:0/3657629548 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f066c0b7c60 0x7f066c149420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:02.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.439+0000 7f0671dd3640 1 -- 172.21.15.53:0/3657629548 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06680094d0 con 0x7f066c15c090 2023-06-10T19:02:02.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.439+0000 7f06715d2640 1 --2- 172.21.15.53:0/3657629548 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f066c0b0b90 0x7f066c15ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:02:02.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.439+0000 7f0671dd3640 1 --2- 172.21.15.53:0/3657629548 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f066c15c090 0x7f066c156780 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f066400c7a0 tx=0x7f066400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:02.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.439+0000 7f0661ffb640 1 -- 172.21.15.53:0/3657629548 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066400a640 con 0x7f066c15c090 2023-06-10T19:02:02.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.439+0000 7f0661ffb640 1 -- 172.21.15.53:0/3657629548 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f066400a7a0 con 0x7f066c15c090 2023-06-10T19:02:02.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.439+0000 7f0661ffb640 1 -- 172.21.15.53:0/3657629548 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066400abd0 con 0x7f066c15c090 2023-06-10T19:02:02.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.439+0000 7f0673836640 1 -- 172.21.15.53:0/3657629548 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f066c14f3e0 con 0x7f066c15c090 2023-06-10T19:02:02.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.443+0000 7f0673836640 1 -- 172.21.15.53:0/3657629548 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f066c15b5d0 con 0x7f066c15c090 2023-06-10T19:02:02.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.443+0000 7f0673836640 1 -- 172.21.15.53:0/3657629548 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f066c14f900 con 0x7f066c15c090 2023-06-10T19:02:02.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.443+0000 7f0661ffb640 1 -- 172.21.15.53:0/3657629548 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f066400ad30 con 0x7f066c15c090 2023-06-10T19:02:02.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.443+0000 7f0661ffb640 1 --2- 172.21.15.53:0/3657629548 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0650066280 0x7f0650068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:02.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.443+0000 7f0661ffb640 1 -- 172.21.15.53:0/3657629548 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f0664083570 con 0x7f066c15c090 2023-06-10T19:02:02.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.443+0000 7f06715d2640 1 --2- 172.21.15.53:0/3657629548 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0650066280 0x7f0650068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:02.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.443+0000 7f06715d2640 1 --2- 172.21.15.53:0/3657629548 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0650066280 0x7f0650068730 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f06680af000 tx=0x7f06680a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:02.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.447+0000 7f0661ffb640 1 -- 172.21.15.53:0/3657629548 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0664050a20 con 0x7f066c15c090 2023-06-10T19:02:02.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.635+0000 7f0673836640 1 -- 172.21.15.53:0/3657629548 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f066c14f900 con 0x7f066c15c090 2023-06-10T19:02:02.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.647+0000 7f0661ffb640 1 -- 172.21.15.53:0/3657629548 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 13 and data pool 14 v44) v1 ==== 174+0+0 (secure 0 0 0) 0x7f066c14f900 con 0x7f066c15c090 2023-06-10T19:02:02.653 INFO:teuthology.orchestra.run.smithi053.stderr:new fs with metadata pool 13 and data pool 14 2023-06-10T19:02:02.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.651+0000 7f0673836640 1 -- 172.21.15.53:0/3657629548 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0650066280 msgr2=0x7f0650068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:02.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.651+0000 7f0673836640 1 --2- 172.21.15.53:0/3657629548 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0650066280 0x7f0650068730 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f06680af000 tx=0x7f06680a7000 comp rx=0 tx=0).stop 2023-06-10T19:02:02.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.651+0000 7f0673836640 1 -- 172.21.15.53:0/3657629548 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f066c15c090 msgr2=0x7f066c156780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:02.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.651+0000 7f0673836640 1 --2- 172.21.15.53:0/3657629548 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f066c15c090 0x7f066c156780 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f066400c7a0 tx=0x7f066400cc60 comp rx=0 tx=0).stop 2023-06-10T19:02:02.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.651+0000 7f0673836640 1 -- 172.21.15.53:0/3657629548 shutdown_connections 2023-06-10T19:02:02.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.651+0000 7f0673836640 1 --2- 172.21.15.53:0/3657629548 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0650066280 0x7f0650068730 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:02.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.651+0000 7f0673836640 1 --2- 172.21.15.53:0/3657629548 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f066c15c090 0x7f066c156780 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:02.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.651+0000 7f0673836640 1 --2- 172.21.15.53:0/3657629548 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f066c0b7c60 0x7f066c149420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:02.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.651+0000 7f0673836640 1 --2- 172.21.15.53:0/3657629548 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f066c0b0b90 0x7f066c15ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:02.660 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.651+0000 7f0673836640 1 -- 172.21.15.53:0/3657629548 >> 172.21.15.53:0/3657629548 conn(0x7f066c069e20 msgr2=0x7f066c0d1780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:02.660 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.651+0000 7f0673836640 1 -- 172.21.15.53:0/3657629548 shutdown_connections 2023-06-10T19:02:02.660 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.651+0000 7f0673836640 1 -- 172.21.15.53:0/3657629548 wait complete. 2023-06-10T19:02:02.692 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:02:02.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.803+0000 7f369032b640 1 Processor -- start 2023-06-10T19:02:02.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.803+0000 7f369032b640 1 -- start start 2023-06-10T19:02:02.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.807+0000 7f369032b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f36880ad730 0x7f36880713a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:02.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.807+0000 7f369032b640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3688070f10 con 0x7f3688159630 2023-06-10T19:02:02.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.807+0000 7f369032b640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f368815db60 con 0x7f36880718e0 2023-06-10T19:02:02.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.807+0000 7f369032b640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f368815d970 con 0x7f36880ad730 2023-06-10T19:02:02.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.807+0000 7f368e0c7640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f3688159630 0x7f368815d260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:38940/0 (socket says 172.21.15.53:38940) 2023-06-10T19:02:02.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.807+0000 7f368e0c7640 1 -- 172.21.15.53:0/3295457954 learned_addr learned my addr 172.21.15.53:0/3295457954 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:02:02.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.807+0000 7f368d8c6640 1 --2- 172.21.15.53:0/3295457954 >> v2:172.21.15.53:3300/0 conn(0x7f36880ad730 0x7f36880713a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:02.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.807+0000 7f368d8c6640 1 -- 172.21.15.53:0/3295457954 >> v1:172.21.15.117:6789/0 conn(0x7f36880718e0 legacy=0x7f3688069450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:02.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.807+0000 7f368d8c6640 1 -- 172.21.15.53:0/3295457954 >> v1:172.21.15.53:6789/0 conn(0x7f3688159630 legacy=0x7f368815d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:02.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.807+0000 7f368d8c6640 1 -- 172.21.15.53:0/3295457954 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f368815de40 con 0x7f36880ad730 2023-06-10T19:02:02.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.807+0000 7f368d8c6640 1 --2- 172.21.15.53:0/3295457954 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36880ad730 0x7f36880713a0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f36780097c0 tx=0x7f367801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19004c77e137ddfc server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:02.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.807+0000 7f368d0c5640 1 -- 172.21.15.53:0/3295457954 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36780ab610 con 0x7f36880ad730 2023-06-10T19:02:02.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.807+0000 7f368d0c5640 1 -- 172.21.15.53:0/3295457954 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36780ab770 con 0x7f36880ad730 2023-06-10T19:02:02.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.807+0000 7f368d0c5640 1 -- 172.21.15.53:0/3295457954 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36780abb00 con 0x7f36880ad730 2023-06-10T19:02:02.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.811+0000 7f369032b640 1 -- 172.21.15.53:0/3295457954 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36880ad730 msgr2=0x7f36880713a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:02.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.811+0000 7f369032b640 1 --2- 172.21.15.53:0/3295457954 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36880ad730 0x7f36880713a0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f36780097c0 tx=0x7f367801c410 comp rx=0 tx=0).stop 2023-06-10T19:02:02.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.811+0000 7f369032b640 1 -- 172.21.15.53:0/3295457954 shutdown_connections 2023-06-10T19:02:02.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.811+0000 7f369032b640 1 --2- 172.21.15.53:0/3295457954 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36880ad730 0x7f36880713a0 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:02.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.811+0000 7f369032b640 1 -- 172.21.15.53:0/3295457954 >> 172.21.15.53:0/3295457954 conn(0x7f36880cafc0 msgr2=0x7f36880cb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:02.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.811+0000 7f369032b640 1 -- 172.21.15.53:0/3295457954 shutdown_connections 2023-06-10T19:02:02.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.811+0000 7f369032b640 1 -- 172.21.15.53:0/3295457954 wait complete. 2023-06-10T19:02:02.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.811+0000 7f369032b640 1 Processor -- start 2023-06-10T19:02:02.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.811+0000 7f369032b640 1 -- start start 2023-06-10T19:02:02.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.811+0000 7f369032b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36880718e0 0x7f36880c4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:02.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.811+0000 7f369032b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36880ad730 0x7f3688154ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:02.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.811+0000 7f369032b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3688159630 0x7f3688154ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:02.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.811+0000 7f369032b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f368814fff0 con 0x7f36880ad730 2023-06-10T19:02:02.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.811+0000 7f369032b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3688152a90 con 0x7f36880718e0 2023-06-10T19:02:02.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.811+0000 7f369032b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3688155850 con 0x7f3688159630 2023-06-10T19:02:02.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.811+0000 7f368d8c6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36880ad730 0x7f3688154ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:02.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.811+0000 7f368d8c6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36880ad730 0x7f3688154ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37300/0 (socket says 172.21.15.53:37300) 2023-06-10T19:02:02.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.811+0000 7f368d8c6640 1 -- 172.21.15.53:0/1719482522 learned_addr learned my addr 172.21.15.53:0/1719482522 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:02.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.811+0000 7f368e0c7640 1 --2- 172.21.15.53:0/1719482522 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36880718e0 0x7f36880c4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:02.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.811+0000 7f368e8c8640 1 --2- 172.21.15.53:0/1719482522 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3688159630 0x7f3688154ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:02.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.811+0000 7f368d8c6640 1 -- 172.21.15.53:0/1719482522 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3688159630 msgr2=0x7f3688154ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:02.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.811+0000 7f368d8c6640 1 --2- 172.21.15.53:0/1719482522 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3688159630 0x7f3688154ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:02.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.811+0000 7f368d8c6640 1 -- 172.21.15.53:0/1719482522 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36880718e0 msgr2=0x7f36880c4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:02.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.811+0000 7f368d8c6640 1 --2- 172.21.15.53:0/1719482522 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36880718e0 0x7f36880c4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:02.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.811+0000 7f368d8c6640 1 -- 172.21.15.53:0/1719482522 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3678009420 con 0x7f36880ad730 2023-06-10T19:02:02.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.811+0000 7f368d8c6640 1 --2- 172.21.15.53:0/1719482522 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36880ad730 0x7f3688154ab0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f36780ad040 tx=0x7f367801ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:02.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.811+0000 7f367effd640 1 -- 172.21.15.53:0/1719482522 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36780b5810 con 0x7f36880ad730 2023-06-10T19:02:02.824 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.811+0000 7f367effd640 1 -- 172.21.15.53:0/1719482522 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36780b5990 con 0x7f36880ad730 2023-06-10T19:02:02.824 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.811+0000 7f367effd640 1 -- 172.21.15.53:0/1719482522 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36780b5d40 con 0x7f36880ad730 2023-06-10T19:02:02.824 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.811+0000 7f369032b640 1 -- 172.21.15.53:0/1719482522 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3688155b30 con 0x7f36880ad730 2023-06-10T19:02:02.824 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.811+0000 7f369032b640 1 -- 172.21.15.53:0/1719482522 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3688155530 con 0x7f36880ad730 2023-06-10T19:02:02.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.815+0000 7f369032b640 1 -- 172.21.15.53:0/1719482522 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36880cbd00 con 0x7f36880ad730 2023-06-10T19:02:02.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.815+0000 7f367effd640 1 -- 172.21.15.53:0/1719482522 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f36780ca430 con 0x7f36880ad730 2023-06-10T19:02:02.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.815+0000 7f367effd640 1 --2- 172.21.15.53:0/1719482522 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f366c066280 0x7f366c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:02.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.815+0000 7f367effd640 1 -- 172.21.15.53:0/1719482522 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f367811ec40 con 0x7f36880ad730 2023-06-10T19:02:02.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.815+0000 7f368e0c7640 1 --2- 172.21.15.53:0/1719482522 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f366c066280 0x7f366c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:02.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.815+0000 7f368e0c7640 1 --2- 172.21.15.53:0/1719482522 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f366c066280 0x7f366c068730 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f3684005890 tx=0x7f3684009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:02.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.819+0000 7f367effd640 1 -- 172.21.15.53:0/1719482522 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f36780ec0a0 con 0x7f36880ad730 2023-06-10T19:02:02.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.975+0000 7f369032b640 1 -- 172.21.15.53:0/1719482522 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3688155d70 con 0x7f36880ad730 2023-06-10T19:02:02.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.979+0000 7f367effd640 1 -- 172.21.15.53:0/1719482522 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) v1 ==== 74+0+18295 (secure 0 0 0) 0x7f36780ef6c0 con 0x7f36880ad730 2023-06-10T19:02:02.984 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:02:02.984 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":93,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:02:02.642039+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-06-10T19:02:00.325404+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-06-10T19:02:01.620938+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:02:02.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.979+0000 7f369032b640 1 -- 172.21.15.53:0/1719482522 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f366c066280 msgr2=0x7f366c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:02.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.979+0000 7f369032b640 1 --2- 172.21.15.53:0/1719482522 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f366c066280 0x7f366c068730 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f3684005890 tx=0x7f3684009040 comp rx=0 tx=0).stop 2023-06-10T19:02:02.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.979+0000 7f369032b640 1 -- 172.21.15.53:0/1719482522 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36880ad730 msgr2=0x7f3688154ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:02.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.979+0000 7f369032b640 1 --2- 172.21.15.53:0/1719482522 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36880ad730 0x7f3688154ab0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f36780ad040 tx=0x7f367801ac50 comp rx=0 tx=0).stop 2023-06-10T19:02:02.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.979+0000 7f369032b640 1 -- 172.21.15.53:0/1719482522 shutdown_connections 2023-06-10T19:02:02.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.979+0000 7f369032b640 1 --2- 172.21.15.53:0/1719482522 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f366c066280 0x7f366c068730 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:02.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.979+0000 7f369032b640 1 --2- 172.21.15.53:0/1719482522 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3688159630 0x7f3688154ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:02.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.979+0000 7f369032b640 1 --2- 172.21.15.53:0/1719482522 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36880ad730 0x7f3688154ab0 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:02.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.979+0000 7f369032b640 1 --2- 172.21.15.53:0/1719482522 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36880718e0 0x7f36880c4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:02.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.979+0000 7f369032b640 1 -- 172.21.15.53:0/1719482522 >> 172.21.15.53:0/1719482522 conn(0x7f36880cafc0 msgr2=0x7f36880cecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:02.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.979+0000 7f369032b640 1 -- 172.21.15.53:0/1719482522 shutdown_connections 2023-06-10T19:02:02.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:02.979+0000 7f369032b640 1 -- 172.21.15.53:0/1719482522 wait complete. 2023-06-10T19:02:03.003 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:02:03.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.115+0000 7f7e06c3e640 1 Processor -- start 2023-06-10T19:02:03.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.115+0000 7f7e06c3e640 1 -- start start 2023-06-10T19:02:03.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.119+0000 7f7e06c3e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7e000b3ac0 0x7f7e000b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:03.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.119+0000 7f7e06c3e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7e000cc690 0x7f7e0015f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:03.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.119+0000 7f7e06c3e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e000ccae0 0x7f7e0015f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:03.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.119+0000 7f7e06c3e640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e000d0020 con 0x7f7e000cc690 2023-06-10T19:02:03.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.119+0000 7f7e06c3e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e000b43d0 con 0x7f7e000b3ac0 2023-06-10T19:02:03.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.119+0000 7f7e06c3e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e000cef40 con 0x7f7e000ccae0 2023-06-10T19:02:03.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.119+0000 7f7dfffff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7e000cc690 0x7f7e0015f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:03.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.119+0000 7f7dfffff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7e000cc690 0x7f7e0015f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37312/0 (socket says 172.21.15.53:37312) 2023-06-10T19:02:03.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.119+0000 7f7dfffff640 1 -- 172.21.15.53:0/3402825292 learned_addr learned my addr 172.21.15.53:0/3402825292 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:03.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.119+0000 7f7e049da640 1 --2- 172.21.15.53:0/3402825292 >> v2:172.21.15.117:3300/0 conn(0x7f7e000b3ac0 0x7f7e000b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:03.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.119+0000 7f7e051db640 1 --2- 172.21.15.53:0/3402825292 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e000ccae0 0x7f7e0015f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:03.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.119+0000 7f7dfffff640 1 -- 172.21.15.53:0/3402825292 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e000ccae0 msgr2=0x7f7e0015f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:03.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.119+0000 7f7dfffff640 1 --2- 172.21.15.53:0/3402825292 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e000ccae0 0x7f7e0015f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:03.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.119+0000 7f7dfffff640 1 -- 172.21.15.53:0/3402825292 >> v2:172.21.15.117:3300/0 conn(0x7f7e000b3ac0 msgr2=0x7f7e000b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:03.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.119+0000 7f7dfffff640 1 --2- 172.21.15.53:0/3402825292 >> v2:172.21.15.117:3300/0 conn(0x7f7e000b3ac0 0x7f7e000b3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:03.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.119+0000 7f7dfffff640 1 -- 172.21.15.53:0/3402825292 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e000cf220 con 0x7f7e000cc690 2023-06-10T19:02:03.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.119+0000 7f7dfffff640 1 --2- 172.21.15.53:0/3402825292 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e000cc690 0x7f7e0015f370 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f7e000b4ba0 tx=0x7f7df401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc7ca5f044f5de25 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:03.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.123+0000 7f7dff7fe640 1 -- 172.21.15.53:0/3402825292 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df40ac600 con 0x7f7e000cc690 2023-06-10T19:02:03.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.123+0000 7f7dff7fe640 1 -- 172.21.15.53:0/3402825292 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7df40a8050 con 0x7f7e000cc690 2023-06-10T19:02:03.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.123+0000 7f7dff7fe640 1 -- 172.21.15.53:0/3402825292 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df40ac980 con 0x7f7e000cc690 2023-06-10T19:02:03.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.123+0000 7f7e06c3e640 1 -- 172.21.15.53:0/3402825292 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e000cc690 msgr2=0x7f7e0015f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:03.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.123+0000 7f7e06c3e640 1 --2- 172.21.15.53:0/3402825292 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e000cc690 0x7f7e0015f370 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f7e000b4ba0 tx=0x7f7df401c4d0 comp rx=0 tx=0).stop 2023-06-10T19:02:03.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.123+0000 7f7e06c3e640 1 -- 172.21.15.53:0/3402825292 shutdown_connections 2023-06-10T19:02:03.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.123+0000 7f7e06c3e640 1 --2- 172.21.15.53:0/3402825292 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e000ccae0 0x7f7e0015f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:03.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.123+0000 7f7e06c3e640 1 --2- 172.21.15.53:0/3402825292 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e000cc690 0x7f7e0015f370 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:03.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.123+0000 7f7e06c3e640 1 --2- 172.21.15.53:0/3402825292 >> v2:172.21.15.117:3300/0 conn(0x7f7e000b3ac0 0x7f7e000b3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:03.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.123+0000 7f7e06c3e640 1 -- 172.21.15.53:0/3402825292 >> 172.21.15.53:0/3402825292 conn(0x7f7e00071790 msgr2=0x7f7e00069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:03.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.123+0000 7f7e06c3e640 1 -- 172.21.15.53:0/3402825292 shutdown_connections 2023-06-10T19:02:03.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.123+0000 7f7e06c3e640 1 -- 172.21.15.53:0/3402825292 wait complete. 2023-06-10T19:02:03.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.123+0000 7f7e06c3e640 1 Processor -- start 2023-06-10T19:02:03.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.123+0000 7f7e06c3e640 1 -- start start 2023-06-10T19:02:03.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.123+0000 7f7e06c3e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e000b3ac0 0x7f7e00152590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:03.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.123+0000 7f7e06c3e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e000cc690 0x7f7e000b2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:03.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.123+0000 7f7e06c3e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e000ccae0 0x7f7e000b2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:03.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.123+0000 7f7e06c3e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0015e5b0 con 0x7f7e000ccae0 2023-06-10T19:02:03.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.123+0000 7f7e06c3e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0015d930 con 0x7f7e000b3ac0 2023-06-10T19:02:03.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.123+0000 7f7e06c3e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0015dc10 con 0x7f7e000cc690 2023-06-10T19:02:03.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.123+0000 7f7e051db640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e000ccae0 0x7f7e000b2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:03.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.123+0000 7f7e051db640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e000ccae0 0x7f7e000b2cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37316/0 (socket says 172.21.15.53:37316) 2023-06-10T19:02:03.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.123+0000 7f7e051db640 1 -- 172.21.15.53:0/1864557102 learned_addr learned my addr 172.21.15.53:0/1864557102 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:03.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.123+0000 7f7e049da640 1 --2- 172.21.15.53:0/1864557102 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e000b3ac0 0x7f7e00152590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:03.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.123+0000 7f7dfffff640 1 --2- 172.21.15.53:0/1864557102 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e000cc690 0x7f7e000b2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:03.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.123+0000 7f7e051db640 1 -- 172.21.15.53:0/1864557102 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e000cc690 msgr2=0x7f7e000b2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:03.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.123+0000 7f7e051db640 1 --2- 172.21.15.53:0/1864557102 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e000cc690 0x7f7e000b2790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:03.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.123+0000 7f7e051db640 1 -- 172.21.15.53:0/1864557102 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e000b3ac0 msgr2=0x7f7e00152590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:03.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.123+0000 7f7e051db640 1 --2- 172.21.15.53:0/1864557102 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e000b3ac0 0x7f7e00152590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:03.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.123+0000 7f7e051db640 1 -- 172.21.15.53:0/1864557102 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7df40094d0 con 0x7f7e000ccae0 2023-06-10T19:02:03.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.127+0000 7f7e051db640 1 --2- 172.21.15.53:0/1864557102 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e000ccae0 0x7f7e000b2cd0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f7df800efc0 tx=0x7f7df800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:03.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.127+0000 7f7dfd7fa640 1 -- 172.21.15.53:0/1864557102 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df8009ba0 con 0x7f7e000ccae0 2023-06-10T19:02:03.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.127+0000 7f7dfd7fa640 1 -- 172.21.15.53:0/1864557102 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7df800f040 con 0x7f7e000ccae0 2023-06-10T19:02:03.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.127+0000 7f7e06c3e640 1 -- 172.21.15.53:0/1864557102 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e0015def0 con 0x7f7e000ccae0 2023-06-10T19:02:03.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.127+0000 7f7dfd7fa640 1 -- 172.21.15.53:0/1864557102 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df80146c0 con 0x7f7e000ccae0 2023-06-10T19:02:03.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.127+0000 7f7e06c3e640 1 -- 172.21.15.53:0/1864557102 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e0015d570 con 0x7f7e000ccae0 2023-06-10T19:02:03.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.127+0000 7f7e06c3e640 1 -- 172.21.15.53:0/1864557102 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e0015e6f0 con 0x7f7e000ccae0 2023-06-10T19:02:03.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.127+0000 7f7dfd7fa640 1 -- 172.21.15.53:0/1864557102 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7df8014820 con 0x7f7e000ccae0 2023-06-10T19:02:03.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.127+0000 7f7dfd7fa640 1 --2- 172.21.15.53:0/1864557102 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7dec066280 0x7f7dec068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:03.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.127+0000 7f7dfd7fa640 1 -- 172.21.15.53:0/1864557102 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7df8084970 con 0x7f7e000ccae0 2023-06-10T19:02:03.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.127+0000 7f7e049da640 1 --2- 172.21.15.53:0/1864557102 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7dec066280 0x7f7dec068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:03.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.127+0000 7f7e049da640 1 --2- 172.21.15.53:0/1864557102 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7dec066280 0x7f7dec068730 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f7df0009ae0 tx=0x7f7df0009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:03.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.131+0000 7f7dfd7fa640 1 -- 172.21.15.53:0/1864557102 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7e0015e6f0 con 0x7f7e000ccae0 2023-06-10T19:02:03.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.287+0000 7f7e06c3e640 1 -- 172.21.15.53:0/1864557102 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7e0015e6f0 con 0x7f7e000ccae0 2023-06-10T19:02:03.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.291+0000 7f7dfd7fa640 1 -- 172.21.15.53:0/1864557102 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) v1 ==== 74+0+18295 (secure 0 0 0) 0x7f7e0015e6f0 con 0x7f7e000ccae0 2023-06-10T19:02:03.296 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:02:03.296 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":93,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:02:02.642039+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-06-10T19:02:00.325404+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-06-10T19:02:01.620938+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:02:03.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.291+0000 7f7e06c3e640 1 -- 172.21.15.53:0/1864557102 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7dec066280 msgr2=0x7f7dec068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:03.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.291+0000 7f7e06c3e640 1 --2- 172.21.15.53:0/1864557102 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7dec066280 0x7f7dec068730 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f7df0009ae0 tx=0x7f7df0009190 comp rx=0 tx=0).stop 2023-06-10T19:02:03.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.291+0000 7f7e06c3e640 1 -- 172.21.15.53:0/1864557102 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e000ccae0 msgr2=0x7f7e000b2cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:03.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.291+0000 7f7e06c3e640 1 --2- 172.21.15.53:0/1864557102 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e000ccae0 0x7f7e000b2cd0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f7df800efc0 tx=0x7f7df800c490 comp rx=0 tx=0).stop 2023-06-10T19:02:03.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.291+0000 7f7e06c3e640 1 -- 172.21.15.53:0/1864557102 shutdown_connections 2023-06-10T19:02:03.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.291+0000 7f7e06c3e640 1 --2- 172.21.15.53:0/1864557102 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7dec066280 0x7f7dec068730 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:03.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.291+0000 7f7e06c3e640 1 --2- 172.21.15.53:0/1864557102 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e000ccae0 0x7f7e000b2cd0 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:03.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.291+0000 7f7e06c3e640 1 --2- 172.21.15.53:0/1864557102 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e000cc690 0x7f7e000b2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:03.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.291+0000 7f7e06c3e640 1 --2- 172.21.15.53:0/1864557102 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e000b3ac0 0x7f7e00152590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:03.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.291+0000 7f7e06c3e640 1 -- 172.21.15.53:0/1864557102 >> 172.21.15.53:0/1864557102 conn(0x7f7e00071790 msgr2=0x7f7e0015f0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:03.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.291+0000 7f7e06c3e640 1 -- 172.21.15.53:0/1864557102 shutdown_connections 2023-06-10T19:02:03.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.291+0000 7f7e06c3e640 1 -- 172.21.15.53:0/1864557102 wait complete. 2023-06-10T19:02:03.315 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-06-10T19:02:03.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.443+0000 7fc58cdd6640 1 Processor -- start 2023-06-10T19:02:03.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.443+0000 7fc58cdd6640 1 -- start start 2023-06-10T19:02:03.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.443+0000 7fc58cdd6640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc58806eca0 0x7fc58806f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:03.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.443+0000 7fc58cdd6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc5880af0e0 0x7fc58815f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:03.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.443+0000 7fc58cdd6640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5880ccda0 con 0x7fc58815fc40 2023-06-10T19:02:03.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.443+0000 7fc58cdd6640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc58806f5b0 con 0x7fc58806eca0 2023-06-10T19:02:03.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.443+0000 7fc58cdd6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc58806a920 con 0x7fc5880af0e0 2023-06-10T19:02:03.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.443+0000 7fc58659c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc58806eca0 0x7fc58806f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:03.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.443+0000 7fc58659c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc58806eca0 0x7fc58806f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37318/0 (socket says 172.21.15.53:37318) 2023-06-10T19:02:03.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.443+0000 7fc58659c640 1 -- 172.21.15.53:0/2879954028 learned_addr learned my addr 172.21.15.53:0/2879954028 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:03.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.443+0000 7fc585d9b640 1 --2- 172.21.15.53:0/2879954028 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc5880af0e0 0x7fc58815f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:03.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.443+0000 7fc58659c640 1 -- 172.21.15.53:0/2879954028 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc5880af0e0 msgr2=0x7fc58815f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:03.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.443+0000 7fc58659c640 1 --2- 172.21.15.53:0/2879954028 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc5880af0e0 0x7fc58815f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:03.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.443+0000 7fc58659c640 1 -- 172.21.15.53:0/2879954028 >> v1:172.21.15.117:6789/0 conn(0x7fc58815fc40 legacy=0x7fc5880ced80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:03.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.443+0000 7fc58659c640 1 -- 172.21.15.53:0/2879954028 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc58806ac00 con 0x7fc58806eca0 2023-06-10T19:02:03.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.443+0000 7fc585d9b640 1 --2- 172.21.15.53:0/2879954028 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc5880af0e0 0x7fc58815f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:02:03.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.447+0000 7fc58659c640 1 --2- 172.21.15.53:0/2879954028 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc58806eca0 0x7fc58806f070 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7fc57c009870 tx=0x7fc57c01ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=438846ed41b11360 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:03.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.447+0000 7fc58559a640 1 -- 172.21.15.53:0/2879954028 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57c0a89b0 con 0x7fc58806eca0 2023-06-10T19:02:03.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.447+0000 7fc58559a640 1 -- 172.21.15.53:0/2879954028 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc57c0a8b10 con 0x7fc58806eca0 2023-06-10T19:02:03.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.447+0000 7fc58559a640 1 -- 172.21.15.53:0/2879954028 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57c0a8ea0 con 0x7fc58806eca0 2023-06-10T19:02:03.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.447+0000 7fc58cdd6640 1 -- 172.21.15.53:0/2879954028 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc58806eca0 msgr2=0x7fc58806f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:03.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.447+0000 7fc58cdd6640 1 --2- 172.21.15.53:0/2879954028 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc58806eca0 0x7fc58806f070 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7fc57c009870 tx=0x7fc57c01ecf0 comp rx=0 tx=0).stop 2023-06-10T19:02:03.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.447+0000 7fc58cdd6640 1 -- 172.21.15.53:0/2879954028 shutdown_connections 2023-06-10T19:02:03.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.447+0000 7fc58cdd6640 1 --2- 172.21.15.53:0/2879954028 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc5880af0e0 0x7fc58815f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:03.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.447+0000 7fc58cdd6640 1 --2- 172.21.15.53:0/2879954028 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc58806eca0 0x7fc58806f070 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:03.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.447+0000 7fc58cdd6640 1 -- 172.21.15.53:0/2879954028 >> 172.21.15.53:0/2879954028 conn(0x7fc58806a0e0 msgr2=0x7fc58806d270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:03.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.447+0000 7fc58cdd6640 1 -- 172.21.15.53:0/2879954028 shutdown_connections 2023-06-10T19:02:03.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.447+0000 7fc58cdd6640 1 -- 172.21.15.53:0/2879954028 wait complete. 2023-06-10T19:02:03.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.447+0000 7fc58cdd6640 1 Processor -- start 2023-06-10T19:02:03.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.447+0000 7fc58cdd6640 1 -- start start 2023-06-10T19:02:03.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.447+0000 7fc58cdd6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc58806eca0 0x7fc5880ab860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:03.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.447+0000 7fc58cdd6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc5880af0e0 0x7fc5880abda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:03.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.447+0000 7fc58cdd6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc58815fc40 0x7fc5880ad6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:03.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.447+0000 7fc58cdd6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5880b55f0 con 0x7fc58815fc40 2023-06-10T19:02:03.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.447+0000 7fc58cdd6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5880ae340 con 0x7fc58806eca0 2023-06-10T19:02:03.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.447+0000 7fc58cdd6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5880ae620 con 0x7fc5880af0e0 2023-06-10T19:02:03.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.447+0000 7fc586d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc58815fc40 0x7fc5880ad6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:03.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.447+0000 7fc586d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc58815fc40 0x7fc5880ad6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37322/0 (socket says 172.21.15.53:37322) 2023-06-10T19:02:03.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.447+0000 7fc586d9d640 1 -- 172.21.15.53:0/3554835419 learned_addr learned my addr 172.21.15.53:0/3554835419 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:03.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.447+0000 7fc58659c640 1 --2- 172.21.15.53:0/3554835419 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc58806eca0 0x7fc5880ab860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:03.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.447+0000 7fc585d9b640 1 --2- 172.21.15.53:0/3554835419 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc5880af0e0 0x7fc5880abda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:03.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.447+0000 7fc586d9d640 1 -- 172.21.15.53:0/3554835419 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc5880af0e0 msgr2=0x7fc5880abda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:03.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.447+0000 7fc586d9d640 1 --2- 172.21.15.53:0/3554835419 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc5880af0e0 0x7fc5880abda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:03.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.447+0000 7fc586d9d640 1 -- 172.21.15.53:0/3554835419 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc58806eca0 msgr2=0x7fc5880ab860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:03.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.447+0000 7fc586d9d640 1 --2- 172.21.15.53:0/3554835419 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc58806eca0 0x7fc5880ab860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:03.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.447+0000 7fc586d9d640 1 -- 172.21.15.53:0/3554835419 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc57c0094d0 con 0x7fc58815fc40 2023-06-10T19:02:03.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.447+0000 7fc58659c640 1 --2- 172.21.15.53:0/3554835419 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc58806eca0 0x7fc5880ab860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:02:03.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.447+0000 7fc586d9d640 1 --2- 172.21.15.53:0/3554835419 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc58815fc40 0x7fc5880ad6d0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7fc58000b410 tx=0x7fc58000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:03.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.447+0000 7fc576ffd640 1 -- 172.21.15.53:0/3554835419 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc580011830 con 0x7fc58815fc40 2023-06-10T19:02:03.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.451+0000 7fc576ffd640 1 -- 172.21.15.53:0/3554835419 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5800119d0 con 0x7fc58815fc40 2023-06-10T19:02:03.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.451+0000 7fc58cdd6640 1 -- 172.21.15.53:0/3554835419 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5880ae900 con 0x7fc58815fc40 2023-06-10T19:02:03.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.451+0000 7fc576ffd640 1 -- 172.21.15.53:0/3554835419 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc580011d80 con 0x7fc58815fc40 2023-06-10T19:02:03.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.451+0000 7fc58cdd6640 1 -- 172.21.15.53:0/3554835419 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5881f2ba0 con 0x7fc58815fc40 2023-06-10T19:02:03.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.451+0000 7fc58cdd6640 1 -- 172.21.15.53:0/3554835419 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5881f2dc0 con 0x7fc58815fc40 2023-06-10T19:02:03.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.451+0000 7fc576ffd640 1 -- 172.21.15.53:0/3554835419 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc58001a400 con 0x7fc58815fc40 2023-06-10T19:02:03.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.451+0000 7fc576ffd640 1 --2- 172.21.15.53:0/3554835419 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc568066280 0x7fc568068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:03.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.451+0000 7fc576ffd640 1 -- 172.21.15.53:0/3554835419 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc580083e10 con 0x7fc58815fc40 2023-06-10T19:02:03.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.451+0000 7fc58659c640 1 --2- 172.21.15.53:0/3554835419 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc568066280 0x7fc568068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:03.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.451+0000 7fc58659c640 1 --2- 172.21.15.53:0/3554835419 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc568066280 0x7fc568068730 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fc57c0b2000 tx=0x7fc57c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:03.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.455+0000 7fc576ffd640 1 -- 172.21.15.53:0/3554835419 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc580051290 con 0x7fc58815fc40 2023-06-10T19:02:03.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:03.647+0000 7fc58cdd6640 1 -- 172.21.15.53:0/3554835419 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fc58804d790 con 0x7fc58815fc40 2023-06-10T19:02:04.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:04.667+0000 7fc576ffd640 1 -- 172.21.15.53:0/3554835419 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v47) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc58005a020 con 0x7fc58815fc40 2023-06-10T19:02:04.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:04.671+0000 7fc58cdd6640 1 -- 172.21.15.53:0/3554835419 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc568066280 msgr2=0x7fc568068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:04.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:04.671+0000 7fc58cdd6640 1 --2- 172.21.15.53:0/3554835419 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc568066280 0x7fc568068730 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fc57c0b2000 tx=0x7fc57c008040 comp rx=0 tx=0).stop 2023-06-10T19:02:04.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:04.671+0000 7fc58cdd6640 1 -- 172.21.15.53:0/3554835419 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc58815fc40 msgr2=0x7fc5880ad6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:04.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:04.671+0000 7fc58cdd6640 1 --2- 172.21.15.53:0/3554835419 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc58815fc40 0x7fc5880ad6d0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7fc58000b410 tx=0x7fc58000b8d0 comp rx=0 tx=0).stop 2023-06-10T19:02:04.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:04.671+0000 7fc58cdd6640 1 -- 172.21.15.53:0/3554835419 shutdown_connections 2023-06-10T19:02:04.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:04.671+0000 7fc58cdd6640 1 --2- 172.21.15.53:0/3554835419 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc568066280 0x7fc568068730 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:04.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:04.671+0000 7fc58cdd6640 1 --2- 172.21.15.53:0/3554835419 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc58815fc40 0x7fc5880ad6d0 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:04.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:04.671+0000 7fc58cdd6640 1 --2- 172.21.15.53:0/3554835419 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc5880af0e0 0x7fc5880abda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:04.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:04.671+0000 7fc58cdd6640 1 --2- 172.21.15.53:0/3554835419 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc58806eca0 0x7fc5880ab860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:04.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:04.671+0000 7fc58cdd6640 1 -- 172.21.15.53:0/3554835419 >> 172.21.15.53:0/3554835419 conn(0x7fc58806a0e0 msgr2=0x7fc58806d270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:04.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:04.675+0000 7fc58cdd6640 1 -- 172.21.15.53:0/3554835419 shutdown_connections 2023-06-10T19:02:04.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:04.675+0000 7fc58cdd6640 1 -- 172.21.15.53:0/3554835419 wait complete. 2023-06-10T19:02:04.703 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-06-10T19:02:04.703 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-06-10T19:02:04.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:04.831+0000 7f34a6f22640 1 Processor -- start 2023-06-10T19:02:04.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:04.831+0000 7f34a6f22640 1 -- start start 2023-06-10T19:02:04.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:04.831+0000 7f34a6f22640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f34a00c82a0 0x7f34a00c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:04.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:04.831+0000 7f34a6f22640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f34a00af760 0x7f34a00afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:04.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:04.831+0000 7f34a6f22640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34a006b090 con 0x7f34a00c9fa0 2023-06-10T19:02:04.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:04.831+0000 7f34a6f22640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34a00b0120 con 0x7f34a00c82a0 2023-06-10T19:02:04.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:04.831+0000 7f34a6f22640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34a00ca370 con 0x7f34a00af760 2023-06-10T19:02:04.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:04.831+0000 7f349ffff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f34a00c82a0 0x7f34a00c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:04.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:04.831+0000 7f349ffff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f34a00c82a0 0x7f34a00c86f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37330/0 (socket says 172.21.15.53:37330) 2023-06-10T19:02:04.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:04.831+0000 7f349ffff640 1 -- 172.21.15.53:0/2612499865 learned_addr learned my addr 172.21.15.53:0/2612499865 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:04.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:04.831+0000 7f34a54bf640 1 --2- 172.21.15.53:0/2612499865 >> v2:172.21.15.117:3300/0 conn(0x7f34a00af760 0x7f34a00afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:04.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:04.831+0000 7f349ffff640 1 -- 172.21.15.53:0/2612499865 >> v2:172.21.15.117:3300/0 conn(0x7f34a00af760 msgr2=0x7f34a00afbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:04.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:04.831+0000 7f349ffff640 1 --2- 172.21.15.53:0/2612499865 >> v2:172.21.15.117:3300/0 conn(0x7f34a00af760 0x7f34a00afbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:04.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:04.831+0000 7f349ffff640 1 -- 172.21.15.53:0/2612499865 >> v1:172.21.15.117:6789/0 conn(0x7f34a00c9fa0 legacy=0x7f34a006bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:04.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:04.831+0000 7f349ffff640 1 -- 172.21.15.53:0/2612499865 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a0070d50 con 0x7f34a00c82a0 2023-06-10T19:02:04.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:04.835+0000 7f349ffff640 1 --2- 172.21.15.53:0/2612499865 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34a00c82a0 0x7f34a00c86f0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f34a006fc20 tx=0x7f349401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ec9b6a23ec4641e server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:04.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:04.835+0000 7f349f7fe640 1 -- 172.21.15.53:0/2612499865 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34940ab600 con 0x7f34a00c82a0 2023-06-10T19:02:04.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:04.835+0000 7f349f7fe640 1 -- 172.21.15.53:0/2612499865 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34940ab760 con 0x7f34a00c82a0 2023-06-10T19:02:04.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:04.835+0000 7f349f7fe640 1 -- 172.21.15.53:0/2612499865 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34940abaf0 con 0x7f34a00c82a0 2023-06-10T19:02:04.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:04.835+0000 7f34a6f22640 1 -- 172.21.15.53:0/2612499865 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34a00c82a0 msgr2=0x7f34a00c86f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:04.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:04.835+0000 7f34a6f22640 1 --2- 172.21.15.53:0/2612499865 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34a00c82a0 0x7f34a00c86f0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f34a006fc20 tx=0x7f349401c400 comp rx=0 tx=0).stop 2023-06-10T19:02:04.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:04.835+0000 7f34a6f22640 1 -- 172.21.15.53:0/2612499865 shutdown_connections 2023-06-10T19:02:04.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:04.835+0000 7f34a6f22640 1 --2- 172.21.15.53:0/2612499865 >> v2:172.21.15.117:3300/0 conn(0x7f34a00af760 0x7f34a00afbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:04.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:04.835+0000 7f34a6f22640 1 --2- 172.21.15.53:0/2612499865 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34a00c82a0 0x7f34a00c86f0 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:04.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:04.835+0000 7f34a6f22640 1 -- 172.21.15.53:0/2612499865 >> 172.21.15.53:0/2612499865 conn(0x7f34a006a0e0 msgr2=0x7f34a00cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:04.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:04.835+0000 7f34a6f22640 1 -- 172.21.15.53:0/2612499865 shutdown_connections 2023-06-10T19:02:04.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:04.835+0000 7f34a6f22640 1 -- 172.21.15.53:0/2612499865 wait complete. 2023-06-10T19:02:04.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:04.835+0000 7f34a6f22640 1 Processor -- start 2023-06-10T19:02:04.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:04.835+0000 7f34a6f22640 1 -- start start 2023-06-10T19:02:04.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:04.835+0000 7f34a6f22640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34a00af760 0x7f34a00b1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:04.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:04.835+0000 7f34a6f22640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f34a00c82a0 0x7f34a00b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:04.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:04.835+0000 7f34a6f22640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34a00c9fa0 0x7f34a0150a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:04.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:04.835+0000 7f34a6f22640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a00c4d20 con 0x7f34a00c9fa0 2023-06-10T19:02:04.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:04.835+0000 7f34a6f22640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a00c4f30 con 0x7f34a00af760 2023-06-10T19:02:04.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:04.835+0000 7f34a6f22640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34a00c5210 con 0x7f34a00c82a0 2023-06-10T19:02:04.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:04.835+0000 7f34a54bf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34a00c9fa0 0x7f34a0150a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:04.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:04.835+0000 7f34a54bf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34a00c9fa0 0x7f34a0150a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37346/0 (socket says 172.21.15.53:37346) 2023-06-10T19:02:04.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:04.835+0000 7f34a54bf640 1 -- 172.21.15.53:0/4211193636 learned_addr learned my addr 172.21.15.53:0/4211193636 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:04.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:04.839+0000 7f34a4cbe640 1 --2- 172.21.15.53:0/4211193636 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34a00af760 0x7f34a00b1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:04.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:04.839+0000 7f349ffff640 1 --2- 172.21.15.53:0/4211193636 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f34a00c82a0 0x7f34a00b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:04.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:04.839+0000 7f34a54bf640 1 -- 172.21.15.53:0/4211193636 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f34a00c82a0 msgr2=0x7f34a00b2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:04.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:04.839+0000 7f34a54bf640 1 --2- 172.21.15.53:0/4211193636 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f34a00c82a0 0x7f34a00b2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:04.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:04.839+0000 7f34a54bf640 1 -- 172.21.15.53:0/4211193636 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34a00af760 msgr2=0x7f34a00b1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:04.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:04.839+0000 7f34a54bf640 1 --2- 172.21.15.53:0/4211193636 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34a00af760 0x7f34a00b1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:04.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:04.839+0000 7f34a54bf640 1 -- 172.21.15.53:0/4211193636 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34940094d0 con 0x7f34a00c9fa0 2023-06-10T19:02:04.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:04.839+0000 7f34a54bf640 1 --2- 172.21.15.53:0/4211193636 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34a00c9fa0 0x7f34a0150a60 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f3498007e40 tx=0x7f349800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:04.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:04.839+0000 7f349d7fa640 1 -- 172.21.15.53:0/4211193636 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3498014620 con 0x7f34a00c9fa0 2023-06-10T19:02:04.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:04.839+0000 7f349d7fa640 1 -- 172.21.15.53:0/4211193636 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f349800ee90 con 0x7f34a00c9fa0 2023-06-10T19:02:04.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:04.839+0000 7f34a6f22640 1 -- 172.21.15.53:0/4211193636 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34a00c54f0 con 0x7f34a00c9fa0 2023-06-10T19:02:04.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:04.839+0000 7f349d7fa640 1 -- 172.21.15.53:0/4211193636 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34980149e0 con 0x7f34a00c9fa0 2023-06-10T19:02:04.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:04.839+0000 7f34a6f22640 1 -- 172.21.15.53:0/4211193636 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34a00c5ab0 con 0x7f34a00c9fa0 2023-06-10T19:02:04.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:04.839+0000 7f34a6f22640 1 -- 172.21.15.53:0/4211193636 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34a00c5cd0 con 0x7f34a00c9fa0 2023-06-10T19:02:04.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:04.839+0000 7f349d7fa640 1 -- 172.21.15.53:0/4211193636 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3498014b40 con 0x7f34a00c9fa0 2023-06-10T19:02:04.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:04.839+0000 7f349d7fa640 1 --2- 172.21.15.53:0/4211193636 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f348c066280 0x7f348c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:04.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:04.839+0000 7f349d7fa640 1 -- 172.21.15.53:0/4211193636 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3498084660 con 0x7f34a00c9fa0 2023-06-10T19:02:04.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:04.839+0000 7f34a4cbe640 1 --2- 172.21.15.53:0/4211193636 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f348c066280 0x7f348c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:04.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:04.839+0000 7f34a4cbe640 1 --2- 172.21.15.53:0/4211193636 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f348c066280 0x7f348c068730 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f349000b810 tx=0x7f3490008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:04.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:04.843+0000 7f349d7fa640 1 -- 172.21.15.53:0/4211193636 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3498051b70 con 0x7f34a00c9fa0 2023-06-10T19:02:05.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:05.031+0000 7f34a6f22640 1 -- 172.21.15.53:0/4211193636 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f34a004d790 con 0x7f34a00c9fa0 2023-06-10T19:02:05.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:05.679+0000 7f349d7fa640 1 -- 172.21.15.53:0/4211193636 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v48) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3498055190 con 0x7f34a00c9fa0 2023-06-10T19:02:05.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:05.683+0000 7f34a6f22640 1 -- 172.21.15.53:0/4211193636 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f348c066280 msgr2=0x7f348c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:05.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:05.683+0000 7f34a6f22640 1 --2- 172.21.15.53:0/4211193636 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f348c066280 0x7f348c068730 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f349000b810 tx=0x7f3490008040 comp rx=0 tx=0).stop 2023-06-10T19:02:05.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:05.683+0000 7f34a6f22640 1 -- 172.21.15.53:0/4211193636 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34a00c9fa0 msgr2=0x7f34a0150a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:05.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:05.683+0000 7f34a6f22640 1 --2- 172.21.15.53:0/4211193636 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34a00c9fa0 0x7f34a0150a60 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f3498007e40 tx=0x7f349800e4b0 comp rx=0 tx=0).stop 2023-06-10T19:02:05.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:05.683+0000 7f34a6f22640 1 -- 172.21.15.53:0/4211193636 shutdown_connections 2023-06-10T19:02:05.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:05.683+0000 7f34a6f22640 1 --2- 172.21.15.53:0/4211193636 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f348c066280 0x7f348c068730 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:05.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:05.683+0000 7f34a6f22640 1 --2- 172.21.15.53:0/4211193636 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f34a00c9fa0 0x7f34a0150a60 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:05.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:05.683+0000 7f34a6f22640 1 --2- 172.21.15.53:0/4211193636 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f34a00c82a0 0x7f34a00b2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:05.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:05.683+0000 7f34a6f22640 1 --2- 172.21.15.53:0/4211193636 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34a00af760 0x7f34a00b1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:05.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:05.683+0000 7f34a6f22640 1 -- 172.21.15.53:0/4211193636 >> 172.21.15.53:0/4211193636 conn(0x7f34a006a0e0 msgr2=0x7f34a0163df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:05.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:05.683+0000 7f34a6f22640 1 -- 172.21.15.53:0/4211193636 shutdown_connections 2023-06-10T19:02:05.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:05.683+0000 7f34a6f22640 1 -- 172.21.15.53:0/4211193636 wait complete. 2023-06-10T19:02:05.710 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-06-10T19:02:05.711 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:02:05.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:05.835+0000 7fd422a81640 1 Processor -- start 2023-06-10T19:02:05.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:05.835+0000 7fd422a81640 1 -- start start 2023-06-10T19:02:05.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:05.835+0000 7fd422a81640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd41c159450 0x7fd41c15d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:05.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:05.835+0000 7fd422a81640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd41c15d680 0x7fd41c0cec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:05.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:05.835+0000 7fd422a81640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd41c0cf180 0x7fd41c0cda20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:05.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:05.835+0000 7fd422a81640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd41c0cf600 con 0x7fd41c0cf180 2023-06-10T19:02:05.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:05.835+0000 7fd422a81640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd41c0cbac0 con 0x7fd41c159450 2023-06-10T19:02:05.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:05.835+0000 7fd422a81640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd41c15dc00 con 0x7fd41c15d680 2023-06-10T19:02:05.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:05.835+0000 7fd42101e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd41c0cf180 0x7fd41c0cda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:05.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:05.835+0000 7fd42101e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd41c0cf180 0x7fd41c0cda20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37358/0 (socket says 172.21.15.53:37358) 2023-06-10T19:02:05.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:05.835+0000 7fd42101e640 1 -- 172.21.15.53:0/2149706552 learned_addr learned my addr 172.21.15.53:0/2149706552 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:05.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:05.835+0000 7fd42081d640 1 --2- 172.21.15.53:0/2149706552 >> v2:172.21.15.117:3300/0 conn(0x7fd41c159450 0x7fd41c15d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:05.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:05.835+0000 7fd41bfff640 1 --2- 172.21.15.53:0/2149706552 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd41c15d680 0x7fd41c0cec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:05.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:05.835+0000 7fd42101e640 1 -- 172.21.15.53:0/2149706552 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd41c15d680 msgr2=0x7fd41c0cec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:05.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:05.835+0000 7fd42101e640 1 --2- 172.21.15.53:0/2149706552 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd41c15d680 0x7fd41c0cec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:05.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:05.835+0000 7fd42101e640 1 -- 172.21.15.53:0/2149706552 >> v2:172.21.15.117:3300/0 conn(0x7fd41c159450 msgr2=0x7fd41c15d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:05.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:05.835+0000 7fd42101e640 1 --2- 172.21.15.53:0/2149706552 >> v2:172.21.15.117:3300/0 conn(0x7fd41c159450 0x7fd41c15d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:05.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:05.835+0000 7fd42101e640 1 -- 172.21.15.53:0/2149706552 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd41c15dee0 con 0x7fd41c0cf180 2023-06-10T19:02:05.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:05.839+0000 7fd42101e640 1 --2- 172.21.15.53:0/2149706552 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd41c0cf180 0x7fd41c0cda20 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7fd41c0b29a0 tx=0x7fd41401c650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a581fd10dc154f3a server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:05.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:05.839+0000 7fd41b7fe640 1 -- 172.21.15.53:0/2149706552 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4140a64a0 con 0x7fd41c0cf180 2023-06-10T19:02:05.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:05.839+0000 7fd41b7fe640 1 -- 172.21.15.53:0/2149706552 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4140a6600 con 0x7fd41c0cf180 2023-06-10T19:02:05.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:05.839+0000 7fd41b7fe640 1 -- 172.21.15.53:0/2149706552 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4140a6990 con 0x7fd41c0cf180 2023-06-10T19:02:05.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:05.839+0000 7fd422a81640 1 -- 172.21.15.53:0/2149706552 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd41c0cf180 msgr2=0x7fd41c0cda20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:05.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:05.839+0000 7fd422a81640 1 --2- 172.21.15.53:0/2149706552 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd41c0cf180 0x7fd41c0cda20 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7fd41c0b29a0 tx=0x7fd41401c650 comp rx=0 tx=0).stop 2023-06-10T19:02:05.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:05.839+0000 7fd422a81640 1 -- 172.21.15.53:0/2149706552 shutdown_connections 2023-06-10T19:02:05.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:05.839+0000 7fd422a81640 1 --2- 172.21.15.53:0/2149706552 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd41c0cf180 0x7fd41c0cda20 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:05.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:05.839+0000 7fd422a81640 1 --2- 172.21.15.53:0/2149706552 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd41c15d680 0x7fd41c0cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:05.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:05.839+0000 7fd422a81640 1 --2- 172.21.15.53:0/2149706552 >> v2:172.21.15.117:3300/0 conn(0x7fd41c159450 0x7fd41c15d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:05.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:05.839+0000 7fd422a81640 1 -- 172.21.15.53:0/2149706552 >> 172.21.15.53:0/2149706552 conn(0x7fd41c06a090 msgr2=0x7fd41c06d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:05.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:05.839+0000 7fd422a81640 1 -- 172.21.15.53:0/2149706552 shutdown_connections 2023-06-10T19:02:05.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:05.839+0000 7fd422a81640 1 -- 172.21.15.53:0/2149706552 wait complete. 2023-06-10T19:02:05.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:05.839+0000 7fd422a81640 1 Processor -- start 2023-06-10T19:02:05.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:05.839+0000 7fd422a81640 1 -- start start 2023-06-10T19:02:05.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:05.839+0000 7fd422a81640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd41c0cf180 0x7fd41c06c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:05.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:05.839+0000 7fd422a81640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd41c159450 0x7fd41c14a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:05.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:05.839+0000 7fd422a81640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd41c15d680 0x7fd41c1541a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:05.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:05.839+0000 7fd422a81640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd41c162660 con 0x7fd41c0cf180 2023-06-10T19:02:05.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:05.839+0000 7fd422a81640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd41c06c5b0 con 0x7fd41c159450 2023-06-10T19:02:05.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:05.839+0000 7fd422a81640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd41c06b330 con 0x7fd41c15d680 2023-06-10T19:02:05.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:05.839+0000 7fd42081d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd41c0cf180 0x7fd41c06c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:05.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:05.839+0000 7fd42081d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd41c0cf180 0x7fd41c06c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37370/0 (socket says 172.21.15.53:37370) 2023-06-10T19:02:05.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:05.839+0000 7fd42081d640 1 -- 172.21.15.53:0/3300844310 learned_addr learned my addr 172.21.15.53:0/3300844310 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:05.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:05.843+0000 7fd42101e640 1 --2- 172.21.15.53:0/3300844310 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd41c15d680 0x7fd41c1541a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:05.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:05.843+0000 7fd41bfff640 1 --2- 172.21.15.53:0/3300844310 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd41c159450 0x7fd41c14a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:05.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:05.843+0000 7fd42081d640 1 -- 172.21.15.53:0/3300844310 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd41c15d680 msgr2=0x7fd41c1541a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:05.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:05.843+0000 7fd42081d640 1 --2- 172.21.15.53:0/3300844310 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd41c15d680 0x7fd41c1541a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:05.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:05.843+0000 7fd42081d640 1 -- 172.21.15.53:0/3300844310 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd41c159450 msgr2=0x7fd41c14a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:05.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:05.843+0000 7fd42081d640 1 --2- 172.21.15.53:0/3300844310 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd41c159450 0x7fd41c14a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:05.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:05.843+0000 7fd42081d640 1 -- 172.21.15.53:0/3300844310 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd414009b30 con 0x7fd41c0cf180 2023-06-10T19:02:05.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:05.843+0000 7fd42081d640 1 --2- 172.21.15.53:0/3300844310 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd41c0cf180 0x7fd41c06c070 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7fd40c00e870 tx=0x7fd40c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:05.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:05.843+0000 7fd4197fa640 1 -- 172.21.15.53:0/3300844310 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd40c009510 con 0x7fd41c0cf180 2023-06-10T19:02:05.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:05.843+0000 7fd4197fa640 1 -- 172.21.15.53:0/3300844310 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd40c00eec0 con 0x7fd41c0cf180 2023-06-10T19:02:05.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:05.843+0000 7fd422a81640 1 -- 172.21.15.53:0/3300844310 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd41c06b610 con 0x7fd41c0cf180 2023-06-10T19:02:05.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:05.843+0000 7fd4197fa640 1 -- 172.21.15.53:0/3300844310 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd40c00cb40 con 0x7fd41c0cf180 2023-06-10T19:02:05.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:05.843+0000 7fd422a81640 1 -- 172.21.15.53:0/3300844310 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd41c162840 con 0x7fd41c0cf180 2023-06-10T19:02:05.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:05.843+0000 7fd422a81640 1 -- 172.21.15.53:0/3300844310 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd41c06bb30 con 0x7fd41c0cf180 2023-06-10T19:02:05.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:05.843+0000 7fd4197fa640 1 -- 172.21.15.53:0/3300844310 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd40c00cca0 con 0x7fd41c0cf180 2023-06-10T19:02:05.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:05.843+0000 7fd4197fa640 1 --2- 172.21.15.53:0/3300844310 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd408066280 0x7fd408068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:05.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:05.843+0000 7fd4197fa640 1 -- 172.21.15.53:0/3300844310 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd40c083e40 con 0x7fd41c0cf180 2023-06-10T19:02:05.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:05.843+0000 7fd41bfff640 1 --2- 172.21.15.53:0/3300844310 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd408066280 0x7fd408068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:05.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:05.847+0000 7fd41bfff640 1 --2- 172.21.15.53:0/3300844310 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd408066280 0x7fd408068730 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fd41c0cf0f0 tx=0x7fd410008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:05.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:05.847+0000 7fd4197fa640 1 -- 172.21.15.53:0/3300844310 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd40c0512c0 con 0x7fd41c0cf180 2023-06-10T19:02:06.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.039+0000 7fd422a81640 1 -- 172.21.15.53:0/3300844310 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd41c04d790 con 0x7fd41c0cf180 2023-06-10T19:02:06.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.043+0000 7fd4197fa640 1 -- 172.21.15.53:0/3300844310 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+4679 (secure 0 0 0) 0x7fd40c017090 con 0x7fd41c0cf180 2023-06-10T19:02:06.044 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:02:06.044 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":48,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1617157670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1617157670},{"type":"v1","addr":"172.21.15.117:6836","nonce":1617157670}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6113,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3414416090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":3414416090},{"type":"v1","addr":"172.21.15.117:6837","nonce":3414416090}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6718,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2533467097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2533467097},{"type":"v1","addr":"172.21.15.53:6835","nonce":2533467097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:02:02.642809+0000","modified":"2023-06-10T19:02:05.668734+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7830},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7830":{"gid":7830,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6833/1894654263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":1894654263},{"type":"v1","addr":"172.21.15.53:6833","nonce":1894654263}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-06-10T19:02:06.044 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 48 2023-06-10T19:02:06.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.043+0000 7fd422a81640 1 -- 172.21.15.53:0/3300844310 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd408066280 msgr2=0x7fd408068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:06.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.043+0000 7fd422a81640 1 --2- 172.21.15.53:0/3300844310 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd408066280 0x7fd408068730 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fd41c0cf0f0 tx=0x7fd410008040 comp rx=0 tx=0).stop 2023-06-10T19:02:06.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.043+0000 7fd422a81640 1 -- 172.21.15.53:0/3300844310 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd41c0cf180 msgr2=0x7fd41c06c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:06.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.043+0000 7fd422a81640 1 --2- 172.21.15.53:0/3300844310 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd41c0cf180 0x7fd41c06c070 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7fd40c00e870 tx=0x7fd40c00ec70 comp rx=0 tx=0).stop 2023-06-10T19:02:06.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.043+0000 7fd422a81640 1 -- 172.21.15.53:0/3300844310 shutdown_connections 2023-06-10T19:02:06.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.043+0000 7fd422a81640 1 --2- 172.21.15.53:0/3300844310 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd408066280 0x7fd408068730 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:06.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.043+0000 7fd422a81640 1 --2- 172.21.15.53:0/3300844310 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd41c15d680 0x7fd41c1541a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:06.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.043+0000 7fd422a81640 1 --2- 172.21.15.53:0/3300844310 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd41c159450 0x7fd41c14a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:06.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.043+0000 7fd422a81640 1 --2- 172.21.15.53:0/3300844310 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd41c0cf180 0x7fd41c06c070 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:06.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.043+0000 7fd422a81640 1 -- 172.21.15.53:0/3300844310 >> 172.21.15.53:0/3300844310 conn(0x7fd41c06a090 msgr2=0x7fd41c0b1020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:06.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.043+0000 7fd422a81640 1 -- 172.21.15.53:0/3300844310 shutdown_connections 2023-06-10T19:02:06.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.043+0000 7fd422a81640 1 -- 172.21.15.53:0/3300844310 wait complete. 2023-06-10T19:02:06.063 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:02:06.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.179+0000 7f3d7080b640 1 Processor -- start 2023-06-10T19:02:06.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.179+0000 7f3d7080b640 1 -- start start 2023-06-10T19:02:06.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.183+0000 7f3d7080b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3d6c0cc690 0x7f3d6c0d04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:06.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.183+0000 7f3d7080b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3d6c0ccae0 0x7f3d6c0d09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:06.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.183+0000 7f3d7080b640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d6c0d0020 con 0x7f3d6c0b3ac0 2023-06-10T19:02:06.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.183+0000 7f3d7080b640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d6c0cef40 con 0x7f3d6c0cc690 2023-06-10T19:02:06.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.183+0000 7f3d7080b640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d6c0cf220 con 0x7f3d6c0ccae0 2023-06-10T19:02:06.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.183+0000 7f3d69d9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3d6c0cc690 0x7f3d6c0d04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:06.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.183+0000 7f3d69d9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3d6c0cc690 0x7f3d6c0d04b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37384/0 (socket says 172.21.15.53:37384) 2023-06-10T19:02:06.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.183+0000 7f3d69d9b640 1 -- 172.21.15.53:0/4244236853 learned_addr learned my addr 172.21.15.53:0/4244236853 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:06.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.183+0000 7f3d6ad9d640 1 --2- 172.21.15.53:0/4244236853 >> v2:172.21.15.117:3300/0 conn(0x7f3d6c0ccae0 0x7f3d6c0d09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:06.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.183+0000 7f3d69d9b640 1 -- 172.21.15.53:0/4244236853 >> v2:172.21.15.117:3300/0 conn(0x7f3d6c0ccae0 msgr2=0x7f3d6c0d09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:06.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.183+0000 7f3d69d9b640 1 --2- 172.21.15.53:0/4244236853 >> v2:172.21.15.117:3300/0 conn(0x7f3d6c0ccae0 0x7f3d6c0d09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:06.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.183+0000 7f3d69d9b640 1 -- 172.21.15.53:0/4244236853 >> v1:172.21.15.117:6789/0 conn(0x7f3d6c0b3ac0 legacy=0x7f3d6c0b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:06.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.183+0000 7f3d69d9b640 1 -- 172.21.15.53:0/4244236853 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d6c0cf500 con 0x7f3d6c0cc690 2023-06-10T19:02:06.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.183+0000 7f3d69d9b640 1 --2- 172.21.15.53:0/4244236853 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d6c0cc690 0x7f3d6c0d04b0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c160410 tx=0x7f3d6001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75809b9246cab09f server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:06.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.183+0000 7f3d6959a640 1 -- 172.21.15.53:0/4244236853 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d600ac640 con 0x7f3d6c0cc690 2023-06-10T19:02:06.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.183+0000 7f3d6959a640 1 -- 172.21.15.53:0/4244236853 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d600ac7a0 con 0x7f3d6c0cc690 2023-06-10T19:02:06.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.183+0000 7f3d6959a640 1 -- 172.21.15.53:0/4244236853 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d600acb30 con 0x7f3d6c0cc690 2023-06-10T19:02:06.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.187+0000 7f3d7080b640 1 -- 172.21.15.53:0/4244236853 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d6c0cc690 msgr2=0x7f3d6c0d04b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:06.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.187+0000 7f3d7080b640 1 --2- 172.21.15.53:0/4244236853 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d6c0cc690 0x7f3d6c0d04b0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c160410 tx=0x7f3d6001c4d0 comp rx=0 tx=0).stop 2023-06-10T19:02:06.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.187+0000 7f3d7080b640 1 -- 172.21.15.53:0/4244236853 shutdown_connections 2023-06-10T19:02:06.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.187+0000 7f3d7080b640 1 --2- 172.21.15.53:0/4244236853 >> v2:172.21.15.117:3300/0 conn(0x7f3d6c0ccae0 0x7f3d6c0d09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:06.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.187+0000 7f3d7080b640 1 --2- 172.21.15.53:0/4244236853 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d6c0cc690 0x7f3d6c0d04b0 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:06.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.187+0000 7f3d7080b640 1 -- 172.21.15.53:0/4244236853 >> 172.21.15.53:0/4244236853 conn(0x7f3d6c071790 msgr2=0x7f3d6c069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:06.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.187+0000 7f3d7080b640 1 -- 172.21.15.53:0/4244236853 shutdown_connections 2023-06-10T19:02:06.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.187+0000 7f3d7080b640 1 -- 172.21.15.53:0/4244236853 wait complete. 2023-06-10T19:02:06.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.187+0000 7f3d7080b640 1 Processor -- start 2023-06-10T19:02:06.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.187+0000 7f3d7080b640 1 -- start start 2023-06-10T19:02:06.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.187+0000 7f3d7080b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d6c0b3ac0 0x7f3d6c15af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:06.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.187+0000 7f3d7080b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d6c0cc690 0x7f3d6c14ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:06.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.187+0000 7f3d7080b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d6c0ccae0 0x7f3d6c14d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:06.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.187+0000 7f3d7080b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6c15b460 con 0x7f3d6c0cc690 2023-06-10T19:02:06.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.187+0000 7f3d7080b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6c14e950 con 0x7f3d6c0b3ac0 2023-06-10T19:02:06.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.187+0000 7f3d7080b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6c14f320 con 0x7f3d6c0ccae0 2023-06-10T19:02:06.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.187+0000 7f3d69d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d6c0cc690 0x7f3d6c14ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:06.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.187+0000 7f3d69d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d6c0cc690 0x7f3d6c14ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37388/0 (socket says 172.21.15.53:37388) 2023-06-10T19:02:06.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.187+0000 7f3d69d9b640 1 -- 172.21.15.53:0/1060559756 learned_addr learned my addr 172.21.15.53:0/1060559756 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:06.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.187+0000 7f3d6a59c640 1 --2- 172.21.15.53:0/1060559756 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d6c0b3ac0 0x7f3d6c15af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:06.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.187+0000 7f3d6ad9d640 1 --2- 172.21.15.53:0/1060559756 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d6c0ccae0 0x7f3d6c14d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:06.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.187+0000 7f3d69d9b640 1 -- 172.21.15.53:0/1060559756 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d6c0ccae0 msgr2=0x7f3d6c14d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:06.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.187+0000 7f3d69d9b640 1 --2- 172.21.15.53:0/1060559756 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d6c0ccae0 0x7f3d6c14d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:06.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.187+0000 7f3d69d9b640 1 -- 172.21.15.53:0/1060559756 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d6c0b3ac0 msgr2=0x7f3d6c15af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:06.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.187+0000 7f3d69d9b640 1 --2- 172.21.15.53:0/1060559756 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d6c0b3ac0 0x7f3d6c15af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:06.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.187+0000 7f3d69d9b640 1 -- 172.21.15.53:0/1060559756 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d600094d0 con 0x7f3d6c0cc690 2023-06-10T19:02:06.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.187+0000 7f3d69d9b640 1 --2- 172.21.15.53:0/1060559756 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d6c0cc690 0x7f3d6c14ede0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f3d60000c10 tx=0x7f3d60019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:06.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.187+0000 7f3d5affd640 1 -- 172.21.15.53:0/1060559756 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d600b6810 con 0x7f3d6c0cc690 2023-06-10T19:02:06.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.187+0000 7f3d5affd640 1 -- 172.21.15.53:0/1060559756 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d600b6990 con 0x7f3d6c0cc690 2023-06-10T19:02:06.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.187+0000 7f3d5affd640 1 -- 172.21.15.53:0/1060559756 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d600b6d40 con 0x7f3d6c0cc690 2023-06-10T19:02:06.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.187+0000 7f3d7080b640 1 -- 172.21.15.53:0/1060559756 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d6c14dde0 con 0x7f3d6c0cc690 2023-06-10T19:02:06.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.187+0000 7f3d7080b640 1 -- 172.21.15.53:0/1060559756 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d6c14e020 con 0x7f3d6c0cc690 2023-06-10T19:02:06.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.191+0000 7f3d7080b640 1 -- 172.21.15.53:0/1060559756 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d6c14eae0 con 0x7f3d6c0cc690 2023-06-10T19:02:06.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.191+0000 7f3d5affd640 1 -- 172.21.15.53:0/1060559756 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3d600c2460 con 0x7f3d6c0cc690 2023-06-10T19:02:06.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.191+0000 7f3d5affd640 1 --2- 172.21.15.53:0/1060559756 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3d4c066280 0x7f3d4c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:06.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.191+0000 7f3d5affd640 1 -- 172.21.15.53:0/1060559756 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3d6011e5c0 con 0x7f3d6c0cc690 2023-06-10T19:02:06.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.191+0000 7f3d6a59c640 1 --2- 172.21.15.53:0/1060559756 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3d4c066280 0x7f3d4c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:06.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.191+0000 7f3d6a59c640 1 --2- 172.21.15.53:0/1060559756 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3d4c066280 0x7f3d4c068730 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c001650 tx=0x7f3d5c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:06.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.195+0000 7f3d5affd640 1 -- 172.21.15.53:0/1060559756 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3d600eba40 con 0x7f3d6c0cc690 2023-06-10T19:02:06.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.347+0000 7f3d7080b640 1 -- 172.21.15.53:0/1060559756 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3d6c04d790 con 0x7f3d6c0cc690 2023-06-10T19:02:06.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.351+0000 7f3d5affd640 1 -- 172.21.15.53:0/1060559756 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+18282 (secure 0 0 0) 0x7f3d600ef060 con 0x7f3d6c0cc690 2023-06-10T19:02:06.354 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:02:06.354 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":94,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:02:03.646580+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-06-10T19:02:00.325404+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-06-10T19:02:01.620938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:02:06.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.355+0000 7f3d7080b640 1 -- 172.21.15.53:0/1060559756 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3d4c066280 msgr2=0x7f3d4c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:06.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.355+0000 7f3d7080b640 1 --2- 172.21.15.53:0/1060559756 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3d4c066280 0x7f3d4c068730 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c001650 tx=0x7f3d5c009040 comp rx=0 tx=0).stop 2023-06-10T19:02:06.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.355+0000 7f3d7080b640 1 -- 172.21.15.53:0/1060559756 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d6c0cc690 msgr2=0x7f3d6c14ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:06.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.355+0000 7f3d7080b640 1 --2- 172.21.15.53:0/1060559756 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d6c0cc690 0x7f3d6c14ede0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f3d60000c10 tx=0x7f3d60019270 comp rx=0 tx=0).stop 2023-06-10T19:02:06.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.355+0000 7f3d7080b640 1 -- 172.21.15.53:0/1060559756 shutdown_connections 2023-06-10T19:02:06.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.355+0000 7f3d7080b640 1 --2- 172.21.15.53:0/1060559756 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3d4c066280 0x7f3d4c068730 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:06.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.355+0000 7f3d7080b640 1 --2- 172.21.15.53:0/1060559756 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d6c0ccae0 0x7f3d6c14d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:06.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.355+0000 7f3d7080b640 1 --2- 172.21.15.53:0/1060559756 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d6c0cc690 0x7f3d6c14ede0 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:06.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.355+0000 7f3d7080b640 1 --2- 172.21.15.53:0/1060559756 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d6c0b3ac0 0x7f3d6c15af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:06.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.355+0000 7f3d7080b640 1 -- 172.21.15.53:0/1060559756 >> 172.21.15.53:0/1060559756 conn(0x7f3d6c071790 msgr2=0x7f3d6c069fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:06.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.355+0000 7f3d7080b640 1 -- 172.21.15.53:0/1060559756 shutdown_connections 2023-06-10T19:02:06.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.355+0000 7f3d7080b640 1 -- 172.21.15.53:0/1060559756 wait complete. 2023-06-10T19:02:06.373 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-06-10T19:02:06.373 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-10T19:02:06.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.483+0000 7f1db779d640 1 Processor -- start 2023-06-10T19:02:06.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.483+0000 7f1db779d640 1 -- start start 2023-06-10T19:02:06.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.483+0000 7f1db779d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1db00cc690 0x7f1db00d04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:06.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.483+0000 7f1db779d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1db00ccae0 0x7f1db00d09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:06.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.483+0000 7f1db779d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1db00d0020 con 0x7f1db00b3ac0 2023-06-10T19:02:06.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.483+0000 7f1db779d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1db00cef40 con 0x7f1db00ccae0 2023-06-10T19:02:06.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.483+0000 7f1db779d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1db00cf220 con 0x7f1db00cc690 2023-06-10T19:02:06.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.483+0000 7f1db5539640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f1db00b3ac0 0x7f1db00b3e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:38956/0 (socket says 172.21.15.53:38956) 2023-06-10T19:02:06.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.483+0000 7f1db5539640 1 -- 172.21.15.53:0/2185799924 learned_addr learned my addr 172.21.15.53:0/2185799924 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:02:06.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.483+0000 7f1db4d38640 1 --2- 172.21.15.53:0/2185799924 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1db00cc690 0x7f1db00d04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:06.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.483+0000 7f1db5d3a640 1 --2- 172.21.15.53:0/2185799924 >> v2:172.21.15.117:3300/0 conn(0x7f1db00ccae0 0x7f1db00d09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:06.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.483+0000 7f1daffff640 1 -- 172.21.15.53:0/2185799924 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1905372218 0 0) 0x7f1db00d0020 con 0x7f1db00b3ac0 2023-06-10T19:02:06.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.483+0000 7f1daffff640 1 -- 172.21.15.53:0/2185799924 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d98003530 con 0x7f1db00b3ac0 2023-06-10T19:02:06.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.483+0000 7f1daffff640 1 -- 172.21.15.53:0/2185799924 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3073559276 0 0) 0x7f1d98003530 con 0x7f1db00b3ac0 2023-06-10T19:02:06.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.483+0000 7f1daffff640 1 -- 172.21.15.53:0/2185799924 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1db00cc690 msgr2=0x7f1db00d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:06.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.483+0000 7f1daffff640 1 --2- 172.21.15.53:0/2185799924 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1db00cc690 0x7f1db00d04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:06.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.483+0000 7f1daffff640 1 -- 172.21.15.53:0/2185799924 >> v2:172.21.15.117:3300/0 conn(0x7f1db00ccae0 msgr2=0x7f1db00d09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:06.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.483+0000 7f1daffff640 1 --2- 172.21.15.53:0/2185799924 >> v2:172.21.15.117:3300/0 conn(0x7f1db00ccae0 0x7f1db00d09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:06.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.483+0000 7f1daffff640 1 -- 172.21.15.53:0/2185799924 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1db00cf500 con 0x7f1db00b3ac0 2023-06-10T19:02:06.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.483+0000 7f1daffff640 1 -- 172.21.15.53:0/2185799924 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f1da8001a00 con 0x7f1db00b3ac0 2023-06-10T19:02:06.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.483+0000 7f1daffff640 1 -- 172.21.15.53:0/2185799924 >> v1:172.21.15.53:6789/0 conn(0x7f1db00b3ac0 legacy=0x7f1db00b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:06.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.483+0000 7f1daffff640 1 --2- 172.21.15.53:0/2185799924 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1d980039f0 0x7f1d98003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:06.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.483+0000 7f1daffff640 1 --2- 172.21.15.53:0/2185799924 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d980047d0 0x7f1d98004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:06.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.483+0000 7f1daffff640 1 --2- 172.21.15.53:0/2185799924 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1db00cc690 0x7f1d98005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:06.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.483+0000 7f1daffff640 1 -- 172.21.15.53:0/2185799924 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db00cef40 con 0x7f1d980039f0 2023-06-10T19:02:06.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.483+0000 7f1daffff640 1 -- 172.21.15.53:0/2185799924 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db00cf220 con 0x7f1d980047d0 2023-06-10T19:02:06.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.483+0000 7f1daffff640 1 -- 172.21.15.53:0/2185799924 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9800b9e0 con 0x7f1db00cc690 2023-06-10T19:02:06.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.483+0000 7f1db5539640 1 --2- 172.21.15.53:0/2185799924 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1d980039f0 0x7f1d98003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:06.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.483+0000 7f1db5d3a640 1 --2- 172.21.15.53:0/2185799924 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1db00cc690 0x7f1d98005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:06.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.483+0000 7f1db5539640 1 -- 172.21.15.53:0/2185799924 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1db00cc690 msgr2=0x7f1d98005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:06.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.483+0000 7f1db4d38640 1 --2- 172.21.15.53:0/2185799924 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d980047d0 0x7f1d98004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:06.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.483+0000 7f1db5539640 1 --2- 172.21.15.53:0/2185799924 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1db00cc690 0x7f1d98005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:06.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.483+0000 7f1db5539640 1 -- 172.21.15.53:0/2185799924 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d980047d0 msgr2=0x7f1d98004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:06.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.483+0000 7f1db5539640 1 --2- 172.21.15.53:0/2185799924 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d980047d0 0x7f1d98004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:06.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.483+0000 7f1db5539640 1 -- 172.21.15.53:0/2185799924 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d98003530 con 0x7f1d980039f0 2023-06-10T19:02:06.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.487+0000 7f1db5539640 1 --2- 172.21.15.53:0/2185799924 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1d980039f0 0x7f1d98003e00 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f1da800a890 tx=0x7f1da801d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2574309d487814c server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:06.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.487+0000 7f1daffff640 1 -- 172.21.15.53:0/2185799924 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da80ad430 con 0x7f1d980039f0 2023-06-10T19:02:06.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.487+0000 7f1daffff640 1 -- 172.21.15.53:0/2185799924 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1da80a8070 con 0x7f1d980039f0 2023-06-10T19:02:06.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.487+0000 7f1daffff640 1 -- 172.21.15.53:0/2185799924 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da80ad7f0 con 0x7f1d980039f0 2023-06-10T19:02:06.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.487+0000 7f1db779d640 1 -- 172.21.15.53:0/2185799924 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1d980039f0 msgr2=0x7f1d98003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:06.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.487+0000 7f1db779d640 1 --2- 172.21.15.53:0/2185799924 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1d980039f0 0x7f1d98003e00 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f1da800a890 tx=0x7f1da801d330 comp rx=0 tx=0).stop 2023-06-10T19:02:06.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.487+0000 7f1db5d3a640 1 -- 172.21.15.53:0/2185799924 reap_dead start 2023-06-10T19:02:06.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.487+0000 7f1db779d640 1 -- 172.21.15.53:0/2185799924 shutdown_connections 2023-06-10T19:02:06.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.487+0000 7f1db779d640 1 -- 172.21.15.53:0/2185799924 >> 172.21.15.53:0/2185799924 conn(0x7f1db0071790 msgr2=0x7f1db0069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:06.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.487+0000 7f1db779d640 1 -- 172.21.15.53:0/2185799924 shutdown_connections 2023-06-10T19:02:06.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.487+0000 7f1db779d640 1 -- 172.21.15.53:0/2185799924 wait complete. 2023-06-10T19:02:06.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.487+0000 7f1db779d640 1 Processor -- start 2023-06-10T19:02:06.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.487+0000 7f1db779d640 1 -- start start 2023-06-10T19:02:06.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.491+0000 7f1db779d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d980039f0 0x7f1db0165a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:06.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.491+0000 7f1db779d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1db01569a0 0x7f1db015e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:06.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.491+0000 7f1db779d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1db015eaa0 0x7f1db0149020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:06.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.491+0000 7f1db779d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db00c9fc0 con 0x7f1db01569a0 2023-06-10T19:02:06.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.491+0000 7f1db779d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db00ca2a0 con 0x7f1db015eaa0 2023-06-10T19:02:06.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.491+0000 7f1db779d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1db00ca580 con 0x7f1d980039f0 2023-06-10T19:02:06.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.491+0000 7f1db4d38640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1db01569a0 0x7f1db015e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:06.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.491+0000 7f1db4d38640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1db01569a0 0x7f1db015e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37400/0 (socket says 172.21.15.53:37400) 2023-06-10T19:02:06.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.491+0000 7f1db4d38640 1 -- 172.21.15.53:0/2683118968 learned_addr learned my addr 172.21.15.53:0/2683118968 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:06.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.491+0000 7f1db5d3a640 1 --2- 172.21.15.53:0/2683118968 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1db015eaa0 0x7f1db0149020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:06.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.491+0000 7f1db4d38640 1 -- 172.21.15.53:0/2683118968 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d980039f0 msgr2=0x7f1db0165a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:06.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.491+0000 7f1db4d38640 1 --2- 172.21.15.53:0/2683118968 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d980039f0 0x7f1db0165a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:06.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.491+0000 7f1db4d38640 1 -- 172.21.15.53:0/2683118968 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1db015eaa0 msgr2=0x7f1db0149020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:06.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.491+0000 7f1db4d38640 1 --2- 172.21.15.53:0/2683118968 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1db015eaa0 0x7f1db0149020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:06.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.491+0000 7f1db4d38640 1 -- 172.21.15.53:0/2683118968 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1db00ca860 con 0x7f1db01569a0 2023-06-10T19:02:06.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.491+0000 7f1db5d3a640 1 --2- 172.21.15.53:0/2683118968 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1db015eaa0 0x7f1db0149020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:02:06.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.491+0000 7f1db4d38640 1 --2- 172.21.15.53:0/2683118968 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1db01569a0 0x7f1db015e560 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f1da400e810 tx=0x7f1da400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:06.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.491+0000 7f1dadffb640 1 -- 172.21.15.53:0/2683118968 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da400c6d0 con 0x7f1db01569a0 2023-06-10T19:02:06.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.491+0000 7f1dadffb640 1 -- 172.21.15.53:0/2683118968 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1da400c830 con 0x7f1db01569a0 2023-06-10T19:02:06.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.491+0000 7f1dadffb640 1 -- 172.21.15.53:0/2683118968 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da400cbe0 con 0x7f1db01569a0 2023-06-10T19:02:06.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.491+0000 7f1db779d640 1 -- 172.21.15.53:0/2683118968 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1db00cab40 con 0x7f1db01569a0 2023-06-10T19:02:06.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.491+0000 7f1db779d640 1 -- 172.21.15.53:0/2683118968 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1db01661a0 con 0x7f1db01569a0 2023-06-10T19:02:06.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.491+0000 7f1db779d640 1 -- 172.21.15.53:0/2683118968 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1db004d790 con 0x7f1db01569a0 2023-06-10T19:02:06.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.491+0000 7f1dadffb640 1 -- 172.21.15.53:0/2683118968 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1da400cd40 con 0x7f1db01569a0 2023-06-10T19:02:06.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.491+0000 7f1dadffb640 1 --2- 172.21.15.53:0/2683118968 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1d9c066280 0x7f1d9c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:06.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.491+0000 7f1dadffb640 1 -- 172.21.15.53:0/2683118968 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1da4083b10 con 0x7f1db01569a0 2023-06-10T19:02:06.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.491+0000 7f1db5539640 1 --2- 172.21.15.53:0/2683118968 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1d9c066280 0x7f1d9c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:06.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.491+0000 7f1db5539640 1 --2- 172.21.15.53:0/2683118968 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1d9c066280 0x7f1d9c068730 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f1da80ad000 tx=0x7f1da8001d90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:06.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.495+0000 7f1dadffb640 1 -- 172.21.15.53:0/2683118968 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1da4050f90 con 0x7f1db01569a0 2023-06-10T19:02:06.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.639+0000 7f1db779d640 1 -- 172.21.15.53:0/2683118968 --> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1db00ca410 con 0x7f1d9c066280 2023-06-10T19:02:06.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.663+0000 7f1dadffb640 1 -- 172.21.15.53:0/2683118968 <== mgr.4105 v2:172.21.15.117:6832/3061986771 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+309307 (secure 0 0 0) 0x7f1db00ca410 con 0x7f1d9c066280 2023-06-10T19:02:06.669 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:02:06.671 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-06-10T19:02:06.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.667+0000 7f1db779d640 1 -- 172.21.15.53:0/2683118968 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1d9c066280 msgr2=0x7f1d9c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:06.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.667+0000 7f1db779d640 1 --2- 172.21.15.53:0/2683118968 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1d9c066280 0x7f1d9c068730 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f1da80ad000 tx=0x7f1da8001d90 comp rx=0 tx=0).stop 2023-06-10T19:02:06.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.667+0000 7f1db779d640 1 -- 172.21.15.53:0/2683118968 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1db01569a0 msgr2=0x7f1db015e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:06.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.667+0000 7f1db779d640 1 --2- 172.21.15.53:0/2683118968 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1db01569a0 0x7f1db015e560 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f1da400e810 tx=0x7f1da400ecd0 comp rx=0 tx=0).stop 2023-06-10T19:02:06.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.667+0000 7f1db779d640 1 -- 172.21.15.53:0/2683118968 shutdown_connections 2023-06-10T19:02:06.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.667+0000 7f1db779d640 1 --2- 172.21.15.53:0/2683118968 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1d9c066280 0x7f1d9c068730 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:06.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.667+0000 7f1db779d640 1 --2- 172.21.15.53:0/2683118968 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1db015eaa0 0x7f1db0149020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:06.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.667+0000 7f1db779d640 1 --2- 172.21.15.53:0/2683118968 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1db01569a0 0x7f1db015e560 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:06.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.667+0000 7f1db779d640 1 --2- 172.21.15.53:0/2683118968 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1d980039f0 0x7f1db0165a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:06.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.667+0000 7f1db779d640 1 -- 172.21.15.53:0/2683118968 >> 172.21.15.53:0/2683118968 conn(0x7f1db0071790 msgr2=0x7f1db015fb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:06.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.667+0000 7f1db779d640 1 -- 172.21.15.53:0/2683118968 shutdown_connections 2023-06-10T19:02:06.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.667+0000 7f1db779d640 1 -- 172.21.15.53:0/2683118968 wait complete. 2023-06-10T19:02:06.686 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":374,"stamp":"2023-06-10T19:02:05.763460+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591838,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":202,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":27,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":258316,"kb_used_data":9932,"kb_used_omap":0,"kb_used_meta":248320,"kb_avail":754716404,"statfs":{"total":773094113280,"available":772829597696,"internally_reserved":0,"allocated":10170368,"data_stored":5252639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":254279680},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":60,"apply_latency_ms":60,"commit_latency_ns":60000000,"apply_latency_ns":60000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1470,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.509502"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.669171+0000","last_change":"2023-06-10T19:02:02.665348+0000","last_active":"2023-06-10T19:02:02.669171+0000","last_peered":"2023-06-10T19:02:02.669171+0000","last_clean":"2023-06-10T19:02:02.669171+0000","last_became_active":"2023-06-10T19:02:02.665052+0000","last_became_peered":"2023-06-10T19:02:02.665052+0000","last_unstale":"2023-06-10T19:02:02.669171+0000","last_undegraded":"2023-06-10T19:02:02.669171+0000","last_fullsized":"2023-06-10T19:02:02.669171+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:29:40.789452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.682118+0000","last_change":"2023-06-10T19:02:02.671565+0000","last_active":"2023-06-10T19:02:02.682118+0000","last_peered":"2023-06-10T19:02:02.682118+0000","last_clean":"2023-06-10T19:02:02.682118+0000","last_became_active":"2023-06-10T19:02:02.670788+0000","last_became_peered":"2023-06-10T19:02:02.670788+0000","last_unstale":"2023-06-10T19:02:02.682118+0000","last_undegraded":"2023-06-10T19:02:02.682118+0000","last_fullsized":"2023-06-10T19:02:02.682118+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:00:31.321984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":6,"reported_epoch":93,"state":"active","last_fresh":"2023-06-10T19:02:02.684122+0000","last_change":"2023-06-10T19:02:02.684069+0000","last_active":"2023-06-10T19:02:02.684122+0000","last_peered":"2023-06-10T19:02:02.684122+0000","last_clean":"2023-06-10T19:02:02.249926+0000","last_became_active":"2023-06-10T19:02:02.684069+0000","last_became_peered":"2023-06-10T19:02:02.684069+0000","last_unstale":"2023-06-10T19:02:02.684122+0000","last_undegraded":"2023-06-10T19:02:02.684122+0000","last_fullsized":"2023-06-10T19:02:02.684122+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:11:53.215763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":["3","4"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":3,"reported_epoch":93,"state":"creating+activating","last_fresh":"2023-06-10T19:02:02.661419+0000","last_change":"2023-06-10T19:02:02.661419+0000","last_active":"2023-06-10T19:02:02.249926+0000","last_peered":"2023-06-10T19:02:02.249926+0000","last_clean":"2023-06-10T19:02:02.249926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:02:02.661419+0000","last_undegraded":"2023-06-10T19:02:02.661419+0000","last_fullsized":"2023-06-10T19:02:02.661419+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:31:20.879352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":["1","6"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":3,"reported_epoch":93,"state":"creating+activating","last_fresh":"2023-06-10T19:02:02.657474+0000","last_change":"2023-06-10T19:02:02.657474+0000","last_active":"2023-06-10T19:02:02.249926+0000","last_peered":"2023-06-10T19:02:02.249926+0000","last_clean":"2023-06-10T19:02:02.249926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:02:02.657474+0000","last_undegraded":"2023-06-10T19:02:02.657474+0000","last_fullsized":"2023-06-10T19:02:02.657474+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:03:34.938582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":["4","6"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.675187+0000","last_change":"2023-06-10T19:02:02.673704+0000","last_active":"2023-06-10T19:02:02.675187+0000","last_peered":"2023-06-10T19:02:02.675187+0000","last_clean":"2023-06-10T19:02:02.675187+0000","last_became_active":"2023-06-10T19:02:02.673439+0000","last_became_peered":"2023-06-10T19:02:02.673439+0000","last_unstale":"2023-06-10T19:02:02.675187+0000","last_undegraded":"2023-06-10T19:02:02.675187+0000","last_fullsized":"2023-06-10T19:02:02.675187+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:06:44.533034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.695952+0000","last_change":"2023-06-10T19:02:02.695952+0000","last_active":"2023-06-10T19:02:02.695952+0000","last_peered":"2023-06-10T19:02:02.695952+0000","last_clean":"2023-06-10T19:02:02.695952+0000","last_became_active":"2023-06-10T19:02:02.695070+0000","last_became_peered":"2023-06-10T19:02:02.695070+0000","last_unstale":"2023-06-10T19:02:02.695952+0000","last_undegraded":"2023-06-10T19:02:02.695952+0000","last_fullsized":"2023-06-10T19:02:02.695952+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:37:04.857782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":3,"reported_epoch":93,"state":"creating+activating","last_fresh":"2023-06-10T19:02:02.659355+0000","last_change":"2023-06-10T19:02:02.659355+0000","last_active":"2023-06-10T19:02:02.249926+0000","last_peered":"2023-06-10T19:02:02.249926+0000","last_clean":"2023-06-10T19:02:02.249926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:02:02.659355+0000","last_undegraded":"2023-06-10T19:02:02.659355+0000","last_fullsized":"2023-06-10T19:02:02.659355+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:47:51.626220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":["1","7"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.680828+0000","last_change":"2023-06-10T19:02:02.680828+0000","last_active":"2023-06-10T19:02:02.680828+0000","last_peered":"2023-06-10T19:02:02.680828+0000","last_clean":"2023-06-10T19:02:02.680828+0000","last_became_active":"2023-06-10T19:02:02.680039+0000","last_became_peered":"2023-06-10T19:02:02.680039+0000","last_unstale":"2023-06-10T19:02:02.680828+0000","last_undegraded":"2023-06-10T19:02:02.680828+0000","last_fullsized":"2023-06-10T19:02:02.680828+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:24:00.414173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.666888+0000","last_change":"2023-06-10T19:02:02.665553+0000","last_active":"2023-06-10T19:02:02.666888+0000","last_peered":"2023-06-10T19:02:02.666888+0000","last_clean":"2023-06-10T19:02:02.666888+0000","last_became_active":"2023-06-10T19:02:02.665255+0000","last_became_peered":"2023-06-10T19:02:02.665255+0000","last_unstale":"2023-06-10T19:02:02.666888+0000","last_undegraded":"2023-06-10T19:02:02.666888+0000","last_fullsized":"2023-06-10T19:02:02.666888+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:01:36.281962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.683637+0000","last_change":"2023-06-10T19:02:02.683637+0000","last_active":"2023-06-10T19:02:02.683637+0000","last_peered":"2023-06-10T19:02:02.683637+0000","last_clean":"2023-06-10T19:02:02.683637+0000","last_became_active":"2023-06-10T19:02:02.682347+0000","last_became_peered":"2023-06-10T19:02:02.682347+0000","last_unstale":"2023-06-10T19:02:02.683637+0000","last_undegraded":"2023-06-10T19:02:02.683637+0000","last_fullsized":"2023-06-10T19:02:02.683637+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:43:54.501946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.672099+0000","last_change":"2023-06-10T19:02:02.670292+0000","last_active":"2023-06-10T19:02:02.672099+0000","last_peered":"2023-06-10T19:02:02.672099+0000","last_clean":"2023-06-10T19:02:02.672099+0000","last_became_active":"2023-06-10T19:02:02.670000+0000","last_became_peered":"2023-06-10T19:02:02.670000+0000","last_unstale":"2023-06-10T19:02:02.672099+0000","last_undegraded":"2023-06-10T19:02:02.672099+0000","last_fullsized":"2023-06-10T19:02:02.672099+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:11:24.917653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":3,"reported_epoch":93,"state":"creating+activating","last_fresh":"2023-06-10T19:02:02.659481+0000","last_change":"2023-06-10T19:02:02.659481+0000","last_active":"2023-06-10T19:02:02.249926+0000","last_peered":"2023-06-10T19:02:02.249926+0000","last_clean":"2023-06-10T19:02:02.249926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:02:02.659481+0000","last_undegraded":"2023-06-10T19:02:02.659481+0000","last_fullsized":"2023-06-10T19:02:02.659481+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:52:50.215857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":["1","7"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.685717+0000","last_change":"2023-06-10T19:02:02.685717+0000","last_active":"2023-06-10T19:02:02.685717+0000","last_peered":"2023-06-10T19:02:02.685717+0000","last_clean":"2023-06-10T19:02:02.685717+0000","last_became_active":"2023-06-10T19:02:02.685029+0000","last_became_peered":"2023-06-10T19:02:02.685029+0000","last_unstale":"2023-06-10T19:02:02.685717+0000","last_undegraded":"2023-06-10T19:02:02.685717+0000","last_fullsized":"2023-06-10T19:02:02.685717+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:26:09.337773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.678129+0000","last_change":"2023-06-10T19:02:02.672291+0000","last_active":"2023-06-10T19:02:02.678129+0000","last_peered":"2023-06-10T19:02:02.678129+0000","last_clean":"2023-06-10T19:02:02.678129+0000","last_became_active":"2023-06-10T19:02:02.672015+0000","last_became_peered":"2023-06-10T19:02:02.672015+0000","last_unstale":"2023-06-10T19:02:02.678129+0000","last_undegraded":"2023-06-10T19:02:02.678129+0000","last_fullsized":"2023-06-10T19:02:02.678129+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:40:40.525125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.674754+0000","last_change":"2023-06-10T19:02:02.672362+0000","last_active":"2023-06-10T19:02:02.674754+0000","last_peered":"2023-06-10T19:02:02.674754+0000","last_clean":"2023-06-10T19:02:02.674754+0000","last_became_active":"2023-06-10T19:02:02.672058+0000","last_became_peered":"2023-06-10T19:02:02.672058+0000","last_unstale":"2023-06-10T19:02:02.674754+0000","last_undegraded":"2023-06-10T19:02:02.674754+0000","last_fullsized":"2023-06-10T19:02:02.674754+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:31:04.035723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.671418+0000","last_change":"2023-06-10T19:02:02.667709+0000","last_active":"2023-06-10T19:02:02.671418+0000","last_peered":"2023-06-10T19:02:02.671418+0000","last_clean":"2023-06-10T19:02:02.671418+0000","last_became_active":"2023-06-10T19:02:02.667406+0000","last_became_peered":"2023-06-10T19:02:02.667406+0000","last_unstale":"2023-06-10T19:02:02.671418+0000","last_undegraded":"2023-06-10T19:02:02.671418+0000","last_fullsized":"2023-06-10T19:02:02.671418+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:33:34.138735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.670100+0000","last_change":"2023-06-10T19:02:02.668883+0000","last_active":"2023-06-10T19:02:02.670100+0000","last_peered":"2023-06-10T19:02:02.670100+0000","last_clean":"2023-06-10T19:02:02.670100+0000","last_became_active":"2023-06-10T19:02:02.668590+0000","last_became_peered":"2023-06-10T19:02:02.668590+0000","last_unstale":"2023-06-10T19:02:02.670100+0000","last_undegraded":"2023-06-10T19:02:02.670100+0000","last_fullsized":"2023-06-10T19:02:02.670100+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:53:17.016074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.699972+0000","last_change":"2023-06-10T19:02:02.699972+0000","last_active":"2023-06-10T19:02:02.699972+0000","last_peered":"2023-06-10T19:02:02.699972+0000","last_clean":"2023-06-10T19:02:02.699972+0000","last_became_active":"2023-06-10T19:02:02.699193+0000","last_became_peered":"2023-06-10T19:02:02.699193+0000","last_unstale":"2023-06-10T19:02:02.699972+0000","last_undegraded":"2023-06-10T19:02:02.699972+0000","last_fullsized":"2023-06-10T19:02:02.699972+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:57:42.325766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.675762+0000","last_change":"2023-06-10T19:02:02.671985+0000","last_active":"2023-06-10T19:02:02.675762+0000","last_peered":"2023-06-10T19:02:02.675762+0000","last_clean":"2023-06-10T19:02:02.675762+0000","last_became_active":"2023-06-10T19:02:02.671708+0000","last_became_peered":"2023-06-10T19:02:02.671708+0000","last_unstale":"2023-06-10T19:02:02.675762+0000","last_undegraded":"2023-06-10T19:02:02.675762+0000","last_fullsized":"2023-06-10T19:02:02.675762+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:00:44.753228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":6,"reported_epoch":93,"state":"active","last_fresh":"2023-06-10T19:02:02.700007+0000","last_change":"2023-06-10T19:02:02.699835+0000","last_active":"2023-06-10T19:02:02.700007+0000","last_peered":"2023-06-10T19:02:02.700007+0000","last_clean":"2023-06-10T19:02:02.249926+0000","last_became_active":"2023-06-10T19:02:02.699835+0000","last_became_peered":"2023-06-10T19:02:02.699835+0000","last_unstale":"2023-06-10T19:02:02.700007+0000","last_undegraded":"2023-06-10T19:02:02.700007+0000","last_fullsized":"2023-06-10T19:02:02.700007+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:32:47.372339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":["4","7"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.681477+0000","last_change":"2023-06-10T19:02:02.681477+0000","last_active":"2023-06-10T19:02:02.681477+0000","last_peered":"2023-06-10T19:02:02.681477+0000","last_clean":"2023-06-10T19:02:02.681477+0000","last_became_active":"2023-06-10T19:02:02.680610+0000","last_became_peered":"2023-06-10T19:02:02.680610+0000","last_unstale":"2023-06-10T19:02:02.681477+0000","last_undegraded":"2023-06-10T19:02:02.681477+0000","last_fullsized":"2023-06-10T19:02:02.681477+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:55:18.294198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":4,"reported_epoch":93,"state":"creating+activating","last_fresh":"2023-06-10T19:02:02.688412+0000","last_change":"2023-06-10T19:02:02.684696+0000","last_active":"2023-06-10T19:02:02.249926+0000","last_peered":"2023-06-10T19:02:02.249926+0000","last_clean":"2023-06-10T19:02:02.249926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:02:02.688412+0000","last_undegraded":"2023-06-10T19:02:02.688412+0000","last_fullsized":"2023-06-10T19:02:02.688412+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:11:53.215763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":["6","1"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.683119+0000","last_change":"2023-06-10T19:02:02.682530+0000","last_active":"2023-06-10T19:02:02.683119+0000","last_peered":"2023-06-10T19:02:02.683119+0000","last_clean":"2023-06-10T19:02:02.683119+0000","last_became_active":"2023-06-10T19:02:02.682004+0000","last_became_peered":"2023-06-10T19:02:02.682004+0000","last_unstale":"2023-06-10T19:02:02.683119+0000","last_undegraded":"2023-06-10T19:02:02.683119+0000","last_fullsized":"2023-06-10T19:02:02.683119+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:27:26.714581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":3,"reported_epoch":93,"state":"creating+activating","last_fresh":"2023-06-10T19:02:02.653940+0000","last_change":"2023-06-10T19:02:02.653940+0000","last_active":"2023-06-10T19:02:02.249926+0000","last_peered":"2023-06-10T19:02:02.249926+0000","last_clean":"2023-06-10T19:02:02.249926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:02:02.653940+0000","last_undegraded":"2023-06-10T19:02:02.653940+0000","last_fullsized":"2023-06-10T19:02:02.653940+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:07:43.322174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":["5","6"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.698521+0000","last_change":"2023-06-10T19:02:02.698521+0000","last_active":"2023-06-10T19:02:02.698521+0000","last_peered":"2023-06-10T19:02:02.698521+0000","last_clean":"2023-06-10T19:02:02.698521+0000","last_became_active":"2023-06-10T19:02:02.697781+0000","last_became_peered":"2023-06-10T19:02:02.697781+0000","last_unstale":"2023-06-10T19:02:02.698521+0000","last_undegraded":"2023-06-10T19:02:02.698521+0000","last_fullsized":"2023-06-10T19:02:02.698521+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:44:52.629437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":3,"reported_epoch":93,"state":"creating+activating","last_fresh":"2023-06-10T19:02:02.655425+0000","last_change":"2023-06-10T19:02:02.655425+0000","last_active":"2023-06-10T19:02:02.249926+0000","last_peered":"2023-06-10T19:02:02.249926+0000","last_clean":"2023-06-10T19:02:02.249926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:02:02.655425+0000","last_undegraded":"2023-06-10T19:02:02.655425+0000","last_fullsized":"2023-06-10T19:02:02.655425+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:36:26.678143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":["2","6"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":3,"reported_epoch":93,"state":"creating+activating","last_fresh":"2023-06-10T19:02:02.661225+0000","last_change":"2023-06-10T19:02:02.661225+0000","last_active":"2023-06-10T19:02:02.249926+0000","last_peered":"2023-06-10T19:02:02.249926+0000","last_clean":"2023-06-10T19:02:02.249926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:02:02.661225+0000","last_undegraded":"2023-06-10T19:02:02.661225+0000","last_fullsized":"2023-06-10T19:02:02.661225+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:20:57.647766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":["1","4"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":6,"reported_epoch":93,"state":"active","last_fresh":"2023-06-10T19:02:02.701356+0000","last_change":"2023-06-10T19:02:02.696178+0000","last_active":"2023-06-10T19:02:02.701356+0000","last_peered":"2023-06-10T19:02:02.701356+0000","last_clean":"2023-06-10T19:02:02.249926+0000","last_became_active":"2023-06-10T19:02:02.696178+0000","last_became_peered":"2023-06-10T19:02:02.696178+0000","last_unstale":"2023-06-10T19:02:02.701356+0000","last_undegraded":"2023-06-10T19:02:02.701356+0000","last_fullsized":"2023-06-10T19:02:02.701356+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:33:48.265078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":["7","2"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.681746+0000","last_change":"2023-06-10T19:02:02.681746+0000","last_active":"2023-06-10T19:02:02.681746+0000","last_peered":"2023-06-10T19:02:02.681746+0000","last_clean":"2023-06-10T19:02:02.681746+0000","last_became_active":"2023-06-10T19:02:02.678889+0000","last_became_peered":"2023-06-10T19:02:02.678889+0000","last_unstale":"2023-06-10T19:02:02.681746+0000","last_undegraded":"2023-06-10T19:02:02.681746+0000","last_fullsized":"2023-06-10T19:02:02.681746+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:17:32.462150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.682120+0000","last_change":"2023-06-10T19:02:02.666485+0000","last_active":"2023-06-10T19:02:02.682120+0000","last_peered":"2023-06-10T19:02:02.682120+0000","last_clean":"2023-06-10T19:02:02.682120+0000","last_became_active":"2023-06-10T19:02:02.665650+0000","last_became_peered":"2023-06-10T19:02:02.665650+0000","last_unstale":"2023-06-10T19:02:02.682120+0000","last_undegraded":"2023-06-10T19:02:02.682120+0000","last_fullsized":"2023-06-10T19:02:02.682120+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:22:27.373589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.672704+0000","last_change":"2023-06-10T19:02:02.668274+0000","last_active":"2023-06-10T19:02:02.672704+0000","last_peered":"2023-06-10T19:02:02.672704+0000","last_clean":"2023-06-10T19:02:02.672704+0000","last_became_active":"2023-06-10T19:02:02.668009+0000","last_became_peered":"2023-06-10T19:02:02.668009+0000","last_unstale":"2023-06-10T19:02:02.672704+0000","last_undegraded":"2023-06-10T19:02:02.672704+0000","last_fullsized":"2023-06-10T19:02:02.672704+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:06:19.466195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.681658+0000","last_change":"2023-06-10T19:02:02.680375+0000","last_active":"2023-06-10T19:02:02.681658+0000","last_peered":"2023-06-10T19:02:02.681658+0000","last_clean":"2023-06-10T19:02:02.681658+0000","last_became_active":"2023-06-10T19:02:02.680094+0000","last_became_peered":"2023-06-10T19:02:02.680094+0000","last_unstale":"2023-06-10T19:02:02.681658+0000","last_undegraded":"2023-06-10T19:02:02.681658+0000","last_fullsized":"2023-06-10T19:02:02.681658+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:42:19.372587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"93'4","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.691765+0000","last_change":"2023-06-10T19:02:02.307615+0000","last_active":"2023-06-10T19:02:02.691765+0000","last_peered":"2023-06-10T19:02:02.691765+0000","last_clean":"2023-06-10T19:02:02.691765+0000","last_became_active":"2023-06-10T19:02:02.306543+0000","last_became_peered":"2023-06-10T19:02:02.306543+0000","last_unstale":"2023-06-10T19:02:02.691765+0000","last_undegraded":"2023-06-10T19:02:02.691765+0000","last_fullsized":"2023-06-10T19:02:02.691765+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:10:52.708577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.669093+0000","last_change":"2023-06-10T19:02:02.662624+0000","last_active":"2023-06-10T19:02:02.669093+0000","last_peered":"2023-06-10T19:02:02.669093+0000","last_clean":"2023-06-10T19:02:02.669093+0000","last_became_active":"2023-06-10T19:02:02.662135+0000","last_became_peered":"2023-06-10T19:02:02.662135+0000","last_unstale":"2023-06-10T19:02:02.669093+0000","last_undegraded":"2023-06-10T19:02:02.669093+0000","last_fullsized":"2023-06-10T19:02:02.669093+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:14:40.833061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.662673+0000","last_change":"2023-06-10T19:02:02.308152+0000","last_active":"2023-06-10T19:02:02.662673+0000","last_peered":"2023-06-10T19:02:02.662673+0000","last_clean":"2023-06-10T19:02:02.662673+0000","last_became_active":"2023-06-10T19:02:02.307326+0000","last_became_peered":"2023-06-10T19:02:02.307326+0000","last_unstale":"2023-06-10T19:02:02.662673+0000","last_undegraded":"2023-06-10T19:02:02.662673+0000","last_fullsized":"2023-06-10T19:02:02.662673+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:49:52.268993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.698529+0000","last_change":"2023-06-10T19:02:02.698529+0000","last_active":"2023-06-10T19:02:02.698529+0000","last_peered":"2023-06-10T19:02:02.698529+0000","last_clean":"2023-06-10T19:02:02.698529+0000","last_became_active":"2023-06-10T19:02:02.697828+0000","last_became_peered":"2023-06-10T19:02:02.697828+0000","last_unstale":"2023-06-10T19:02:02.698529+0000","last_undegraded":"2023-06-10T19:02:02.698529+0000","last_fullsized":"2023-06-10T19:02:02.698529+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:33:31.316563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"93'2","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.674605+0000","last_change":"2023-06-10T19:02:02.298653+0000","last_active":"2023-06-10T19:02:02.674605+0000","last_peered":"2023-06-10T19:02:02.674605+0000","last_clean":"2023-06-10T19:02:02.674605+0000","last_became_active":"2023-06-10T19:02:02.297891+0000","last_became_peered":"2023-06-10T19:02:02.297891+0000","last_unstale":"2023-06-10T19:02:02.674605+0000","last_undegraded":"2023-06-10T19:02:02.674605+0000","last_fullsized":"2023-06-10T19:02:02.674605+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:53:23.935997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":3,"reported_epoch":93,"state":"creating+activating","last_fresh":"2023-06-10T19:02:02.650584+0000","last_change":"2023-06-10T19:02:02.650584+0000","last_active":"2023-06-10T19:02:02.249926+0000","last_peered":"2023-06-10T19:02:02.249926+0000","last_clean":"2023-06-10T19:02:02.249926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:02:02.650584+0000","last_undegraded":"2023-06-10T19:02:02.650584+0000","last_fullsized":"2023-06-10T19:02:02.650584+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:20:12.939183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":["0","6"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"93'2","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.691249+0000","last_change":"2023-06-10T19:02:02.309210+0000","last_active":"2023-06-10T19:02:02.691249+0000","last_peered":"2023-06-10T19:02:02.691249+0000","last_clean":"2023-06-10T19:02:02.691249+0000","last_became_active":"2023-06-10T19:02:02.307262+0000","last_became_peered":"2023-06-10T19:02:02.307262+0000","last_unstale":"2023-06-10T19:02:02.691249+0000","last_undegraded":"2023-06-10T19:02:02.691249+0000","last_fullsized":"2023-06-10T19:02:02.691249+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:53:16.012428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.678306+0000","last_change":"2023-06-10T19:02:02.675152+0000","last_active":"2023-06-10T19:02:02.678306+0000","last_peered":"2023-06-10T19:02:02.678306+0000","last_clean":"2023-06-10T19:02:02.678306+0000","last_became_active":"2023-06-10T19:02:02.672817+0000","last_became_peered":"2023-06-10T19:02:02.672817+0000","last_unstale":"2023-06-10T19:02:02.678306+0000","last_undegraded":"2023-06-10T19:02:02.678306+0000","last_fullsized":"2023-06-10T19:02:02.678306+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:43:35.825854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"93'1","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.697572+0000","last_change":"2023-06-10T19:02:02.285398+0000","last_active":"2023-06-10T19:02:02.697572+0000","last_peered":"2023-06-10T19:02:02.697572+0000","last_clean":"2023-06-10T19:02:02.697572+0000","last_became_active":"2023-06-10T19:02:02.284766+0000","last_became_peered":"2023-06-10T19:02:02.284766+0000","last_unstale":"2023-06-10T19:02:02.697572+0000","last_undegraded":"2023-06-10T19:02:02.697572+0000","last_fullsized":"2023-06-10T19:02:02.697572+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:35:48.643951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":4,"reported_epoch":93,"state":"creating+activating","last_fresh":"2023-06-10T19:02:02.687783+0000","last_change":"2023-06-10T19:02:02.684502+0000","last_active":"2023-06-10T19:02:02.249926+0000","last_peered":"2023-06-10T19:02:02.249926+0000","last_clean":"2023-06-10T19:02:02.249926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:02:02.687783+0000","last_undegraded":"2023-06-10T19:02:02.687783+0000","last_fullsized":"2023-06-10T19:02:02.687783+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:34:43.072692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":["6","0"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"93'1","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.675575+0000","last_change":"2023-06-10T19:02:02.280702+0000","last_active":"2023-06-10T19:02:02.675575+0000","last_peered":"2023-06-10T19:02:02.675575+0000","last_clean":"2023-06-10T19:02:02.675575+0000","last_became_active":"2023-06-10T19:02:02.280060+0000","last_became_peered":"2023-06-10T19:02:02.280060+0000","last_unstale":"2023-06-10T19:02:02.675575+0000","last_undegraded":"2023-06-10T19:02:02.675575+0000","last_fullsized":"2023-06-10T19:02:02.675575+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:42:06.945432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.677557+0000","last_change":"2023-06-10T19:02:02.676743+0000","last_active":"2023-06-10T19:02:02.677557+0000","last_peered":"2023-06-10T19:02:02.677557+0000","last_clean":"2023-06-10T19:02:02.677557+0000","last_became_active":"2023-06-10T19:02:02.676452+0000","last_became_peered":"2023-06-10T19:02:02.676452+0000","last_unstale":"2023-06-10T19:02:02.677557+0000","last_undegraded":"2023-06-10T19:02:02.677557+0000","last_fullsized":"2023-06-10T19:02:02.677557+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:40:33.473940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.658568+0000","last_change":"2023-06-10T19:02:02.291503+0000","last_active":"2023-06-10T19:02:02.658568+0000","last_peered":"2023-06-10T19:02:02.658568+0000","last_clean":"2023-06-10T19:02:02.658568+0000","last_became_active":"2023-06-10T19:02:02.291257+0000","last_became_peered":"2023-06-10T19:02:02.291257+0000","last_unstale":"2023-06-10T19:02:02.658568+0000","last_undegraded":"2023-06-10T19:02:02.658568+0000","last_fullsized":"2023-06-10T19:02:02.658568+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:10:52.708577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":3,"reported_epoch":93,"state":"creating+activating","last_fresh":"2023-06-10T19:02:02.659597+0000","last_change":"2023-06-10T19:02:02.659597+0000","last_active":"2023-06-10T19:02:02.249926+0000","last_peered":"2023-06-10T19:02:02.249926+0000","last_clean":"2023-06-10T19:02:02.249926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:02:02.659597+0000","last_undegraded":"2023-06-10T19:02:02.659597+0000","last_fullsized":"2023-06-10T19:02:02.659597+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:28:01.941970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":["1","6"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.671489+0000","last_change":"2023-06-10T19:02:02.298471+0000","last_active":"2023-06-10T19:02:02.671489+0000","last_peered":"2023-06-10T19:02:02.671489+0000","last_clean":"2023-06-10T19:02:02.671489+0000","last_became_active":"2023-06-10T19:02:02.297847+0000","last_became_peered":"2023-06-10T19:02:02.297847+0000","last_unstale":"2023-06-10T19:02:02.671489+0000","last_undegraded":"2023-06-10T19:02:02.671489+0000","last_fullsized":"2023-06-10T19:02:02.671489+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:22:24.304786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.699437+0000","last_change":"2023-06-10T19:02:02.699437+0000","last_active":"2023-06-10T19:02:02.699437+0000","last_peered":"2023-06-10T19:02:02.699437+0000","last_clean":"2023-06-10T19:02:02.699437+0000","last_became_active":"2023-06-10T19:02:02.698803+0000","last_became_peered":"2023-06-10T19:02:02.698803+0000","last_unstale":"2023-06-10T19:02:02.699437+0000","last_undegraded":"2023-06-10T19:02:02.699437+0000","last_fullsized":"2023-06-10T19:02:02.699437+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:22:04.513117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.656570+0000","last_change":"2023-06-10T19:02:02.293125+0000","last_active":"2023-06-10T19:02:02.656570+0000","last_peered":"2023-06-10T19:02:02.656570+0000","last_clean":"2023-06-10T19:02:02.656570+0000","last_became_active":"2023-06-10T19:02:02.292366+0000","last_became_peered":"2023-06-10T19:02:02.292366+0000","last_unstale":"2023-06-10T19:02:02.656570+0000","last_undegraded":"2023-06-10T19:02:02.656570+0000","last_fullsized":"2023-06-10T19:02:02.656570+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:29:48.947745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":3,"reported_epoch":93,"state":"creating+activating","last_fresh":"2023-06-10T19:02:02.673955+0000","last_change":"2023-06-10T19:02:02.673955+0000","last_active":"2023-06-10T19:02:02.249926+0000","last_peered":"2023-06-10T19:02:02.249926+0000","last_clean":"2023-06-10T19:02:02.249926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:02:02.673955+0000","last_undegraded":"2023-06-10T19:02:02.673955+0000","last_fullsized":"2023-06-10T19:02:02.673955+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:28:08.816029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":["7","4"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.655755+0000","last_change":"2023-06-10T19:02:02.286161+0000","last_active":"2023-06-10T19:02:02.655755+0000","last_peered":"2023-06-10T19:02:02.655755+0000","last_clean":"2023-06-10T19:02:02.655755+0000","last_became_active":"2023-06-10T19:02:02.285856+0000","last_became_peered":"2023-06-10T19:02:02.285856+0000","last_unstale":"2023-06-10T19:02:02.655755+0000","last_undegraded":"2023-06-10T19:02:02.655755+0000","last_fullsized":"2023-06-10T19:02:02.655755+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:24:38.099052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.669041+0000","last_change":"2023-06-10T19:02:02.665868+0000","last_active":"2023-06-10T19:02:02.669041+0000","last_peered":"2023-06-10T19:02:02.669041+0000","last_clean":"2023-06-10T19:02:02.669041+0000","last_became_active":"2023-06-10T19:02:02.665665+0000","last_became_peered":"2023-06-10T19:02:02.665665+0000","last_unstale":"2023-06-10T19:02:02.669041+0000","last_undegraded":"2023-06-10T19:02:02.669041+0000","last_fullsized":"2023-06-10T19:02:02.669041+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:58:45.386899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"93'3","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.698138+0000","last_change":"2023-06-10T19:02:02.294019+0000","last_active":"2023-06-10T19:02:02.698138+0000","last_peered":"2023-06-10T19:02:02.698138+0000","last_clean":"2023-06-10T19:02:02.698138+0000","last_became_active":"2023-06-10T19:02:02.293205+0000","last_became_peered":"2023-06-10T19:02:02.293205+0000","last_unstale":"2023-06-10T19:02:02.698138+0000","last_undegraded":"2023-06-10T19:02:02.698138+0000","last_fullsized":"2023-06-10T19:02:02.698138+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:04:37.882090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.681206+0000","last_change":"2023-06-10T19:02:02.680173+0000","last_active":"2023-06-10T19:02:02.681206+0000","last_peered":"2023-06-10T19:02:02.681206+0000","last_clean":"2023-06-10T19:02:02.681206+0000","last_became_active":"2023-06-10T19:02:02.679854+0000","last_became_peered":"2023-06-10T19:02:02.679854+0000","last_unstale":"2023-06-10T19:02:02.681206+0000","last_undegraded":"2023-06-10T19:02:02.681206+0000","last_fullsized":"2023-06-10T19:02:02.681206+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:21:52.001634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"93'5","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.650293+0000","last_change":"2023-06-10T19:02:02.310650+0000","last_active":"2023-06-10T19:02:02.650293+0000","last_peered":"2023-06-10T19:02:02.650293+0000","last_clean":"2023-06-10T19:02:02.650293+0000","last_became_active":"2023-06-10T19:02:02.310205+0000","last_became_peered":"2023-06-10T19:02:02.310205+0000","last_unstale":"2023-06-10T19:02:02.650293+0000","last_undegraded":"2023-06-10T19:02:02.650293+0000","last_fullsized":"2023-06-10T19:02:02.650293+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:42:24.597366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":3,"reported_epoch":93,"state":"creating+activating","last_fresh":"2023-06-10T19:02:02.659786+0000","last_change":"2023-06-10T19:02:02.659786+0000","last_active":"2023-06-10T19:02:02.249926+0000","last_peered":"2023-06-10T19:02:02.249926+0000","last_clean":"2023-06-10T19:02:02.249926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:02:02.659786+0000","last_undegraded":"2023-06-10T19:02:02.659786+0000","last_fullsized":"2023-06-10T19:02:02.659786+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:52:33.909329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":["1","7"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"93'2","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.674343+0000","last_change":"2023-06-10T19:02:02.298494+0000","last_active":"2023-06-10T19:02:02.674343+0000","last_peered":"2023-06-10T19:02:02.674343+0000","last_clean":"2023-06-10T19:02:02.674343+0000","last_became_active":"2023-06-10T19:02:02.298008+0000","last_became_peered":"2023-06-10T19:02:02.298008+0000","last_unstale":"2023-06-10T19:02:02.674343+0000","last_undegraded":"2023-06-10T19:02:02.674343+0000","last_fullsized":"2023-06-10T19:02:02.674343+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:26:51.452323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":3,"reported_epoch":93,"state":"creating+activating","last_fresh":"2023-06-10T19:02:02.659742+0000","last_change":"2023-06-10T19:02:02.659742+0000","last_active":"2023-06-10T19:02:02.249926+0000","last_peered":"2023-06-10T19:02:02.249926+0000","last_clean":"2023-06-10T19:02:02.249926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:02:02.659742+0000","last_undegraded":"2023-06-10T19:02:02.659742+0000","last_fullsized":"2023-06-10T19:02:02.659742+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:13:21.429650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":["4","6"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.650314+0000","last_change":"2023-06-10T19:02:02.297466+0000","last_active":"2023-06-10T19:02:02.650314+0000","last_peered":"2023-06-10T19:02:02.650314+0000","last_clean":"2023-06-10T19:02:02.650314+0000","last_became_active":"2023-06-10T19:02:02.297118+0000","last_became_peered":"2023-06-10T19:02:02.297118+0000","last_unstale":"2023-06-10T19:02:02.650314+0000","last_undegraded":"2023-06-10T19:02:02.650314+0000","last_fullsized":"2023-06-10T19:02:02.650314+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:02:26.409776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.677300+0000","last_change":"2023-06-10T19:02:02.676309+0000","last_active":"2023-06-10T19:02:02.677300+0000","last_peered":"2023-06-10T19:02:02.677300+0000","last_clean":"2023-06-10T19:02:02.677300+0000","last_became_active":"2023-06-10T19:02:02.676005+0000","last_became_peered":"2023-06-10T19:02:02.676005+0000","last_unstale":"2023-06-10T19:02:02.677300+0000","last_undegraded":"2023-06-10T19:02:02.677300+0000","last_fullsized":"2023-06-10T19:02:02.677300+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:31:23.514936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.661968+0000","last_change":"2023-06-10T19:02:02.309000+0000","last_active":"2023-06-10T19:02:02.661968+0000","last_peered":"2023-06-10T19:02:02.661968+0000","last_clean":"2023-06-10T19:02:02.661968+0000","last_became_active":"2023-06-10T19:02:02.308410+0000","last_became_peered":"2023-06-10T19:02:02.308410+0000","last_unstale":"2023-06-10T19:02:02.661968+0000","last_undegraded":"2023-06-10T19:02:02.661968+0000","last_fullsized":"2023-06-10T19:02:02.661968+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:05:00.965851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":3,"reported_epoch":93,"state":"creating+activating","last_fresh":"2023-06-10T19:02:02.654118+0000","last_change":"2023-06-10T19:02:02.654118+0000","last_active":"2023-06-10T19:02:02.249926+0000","last_peered":"2023-06-10T19:02:02.249926+0000","last_clean":"2023-06-10T19:02:02.249926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:02:02.654118+0000","last_undegraded":"2023-06-10T19:02:02.654118+0000","last_fullsized":"2023-06-10T19:02:02.654118+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:41:19.173789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":["2","4"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"93'8","reported_seq":19,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.676823+0000","last_change":"2023-06-10T19:02:02.281076+0000","last_active":"2023-06-10T19:02:02.676823+0000","last_peered":"2023-06-10T19:02:02.676823+0000","last_clean":"2023-06-10T19:02:02.676823+0000","last_became_active":"2023-06-10T19:02:02.280784+0000","last_became_peered":"2023-06-10T19:02:02.280784+0000","last_unstale":"2023-06-10T19:02:02.676823+0000","last_undegraded":"2023-06-10T19:02:02.676823+0000","last_fullsized":"2023-06-10T19:02:02.676823+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:52:28.532909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":3,"reported_epoch":93,"state":"creating+activating","last_fresh":"2023-06-10T19:02:02.684672+0000","last_change":"2023-06-10T19:02:02.684672+0000","last_active":"2023-06-10T19:02:02.249926+0000","last_peered":"2023-06-10T19:02:02.249926+0000","last_clean":"2023-06-10T19:02:02.249926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:02:02.684672+0000","last_undegraded":"2023-06-10T19:02:02.684672+0000","last_fullsized":"2023-06-10T19:02:02.684672+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:48:21.883343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":["6","7"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"93'2","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.677238+0000","last_change":"2023-06-10T19:02:02.310148+0000","last_active":"2023-06-10T19:02:02.677238+0000","last_peered":"2023-06-10T19:02:02.677238+0000","last_clean":"2023-06-10T19:02:02.677238+0000","last_became_active":"2023-06-10T19:02:02.309423+0000","last_became_peered":"2023-06-10T19:02:02.309423+0000","last_unstale":"2023-06-10T19:02:02.677238+0000","last_undegraded":"2023-06-10T19:02:02.677238+0000","last_fullsized":"2023-06-10T19:02:02.677238+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:53:30.670784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.686338+0000","last_change":"2023-06-10T19:02:02.685473+0000","last_active":"2023-06-10T19:02:02.686338+0000","last_peered":"2023-06-10T19:02:02.686338+0000","last_clean":"2023-06-10T19:02:02.686338+0000","last_became_active":"2023-06-10T19:02:02.685192+0000","last_became_peered":"2023-06-10T19:02:02.685192+0000","last_unstale":"2023-06-10T19:02:02.686338+0000","last_undegraded":"2023-06-10T19:02:02.686338+0000","last_fullsized":"2023-06-10T19:02:02.686338+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:40:55.001540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.662921+0000","last_change":"2023-06-10T19:02:02.292855+0000","last_active":"2023-06-10T19:02:02.662921+0000","last_peered":"2023-06-10T19:02:02.662921+0000","last_clean":"2023-06-10T19:02:02.662921+0000","last_became_active":"2023-06-10T19:02:02.291984+0000","last_became_peered":"2023-06-10T19:02:02.291984+0000","last_unstale":"2023-06-10T19:02:02.662921+0000","last_undegraded":"2023-06-10T19:02:02.662921+0000","last_fullsized":"2023-06-10T19:02:02.662921+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:12:14.528079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.667098+0000","last_change":"2023-06-10T19:02:02.662196+0000","last_active":"2023-06-10T19:02:02.667098+0000","last_peered":"2023-06-10T19:02:02.667098+0000","last_clean":"2023-06-10T19:02:02.667098+0000","last_became_active":"2023-06-10T19:02:02.661887+0000","last_became_peered":"2023-06-10T19:02:02.661887+0000","last_unstale":"2023-06-10T19:02:02.667098+0000","last_undegraded":"2023-06-10T19:02:02.667098+0000","last_fullsized":"2023-06-10T19:02:02.667098+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:49:47.303424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.673305+0000","last_change":"2023-06-10T19:02:02.289260+0000","last_active":"2023-06-10T19:02:02.673305+0000","last_peered":"2023-06-10T19:02:02.673305+0000","last_clean":"2023-06-10T19:02:02.673305+0000","last_became_active":"2023-06-10T19:02:02.288017+0000","last_became_peered":"2023-06-10T19:02:02.288017+0000","last_unstale":"2023-06-10T19:02:02.673305+0000","last_undegraded":"2023-06-10T19:02:02.673305+0000","last_fullsized":"2023-06-10T19:02:02.673305+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:51:50.500411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.692335+0000","last_change":"2023-06-10T19:02:02.686971+0000","last_active":"2023-06-10T19:02:02.692335+0000","last_peered":"2023-06-10T19:02:02.692335+0000","last_clean":"2023-06-10T19:02:02.692335+0000","last_became_active":"2023-06-10T19:02:02.682303+0000","last_became_peered":"2023-06-10T19:02:02.682303+0000","last_unstale":"2023-06-10T19:02:02.692335+0000","last_undegraded":"2023-06-10T19:02:02.692335+0000","last_fullsized":"2023-06-10T19:02:02.692335+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:41:22.771429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.691399+0000","last_change":"2023-06-10T19:02:02.307602+0000","last_active":"2023-06-10T19:02:02.691399+0000","last_peered":"2023-06-10T19:02:02.691399+0000","last_clean":"2023-06-10T19:02:02.691399+0000","last_became_active":"2023-06-10T19:02:02.306340+0000","last_became_peered":"2023-06-10T19:02:02.306340+0000","last_unstale":"2023-06-10T19:02:02.691399+0000","last_undegraded":"2023-06-10T19:02:02.691399+0000","last_fullsized":"2023-06-10T19:02:02.691399+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:36:15.254045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.672236+0000","last_change":"2023-06-10T19:02:02.670591+0000","last_active":"2023-06-10T19:02:02.672236+0000","last_peered":"2023-06-10T19:02:02.672236+0000","last_clean":"2023-06-10T19:02:02.672236+0000","last_became_active":"2023-06-10T19:02:02.670311+0000","last_became_peered":"2023-06-10T19:02:02.670311+0000","last_unstale":"2023-06-10T19:02:02.672236+0000","last_undegraded":"2023-06-10T19:02:02.672236+0000","last_fullsized":"2023-06-10T19:02:02.672236+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:42:05.486292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.650842+0000","last_change":"2023-06-10T19:02:02.297604+0000","last_active":"2023-06-10T19:02:02.650842+0000","last_peered":"2023-06-10T19:02:02.650842+0000","last_clean":"2023-06-10T19:02:02.650842+0000","last_became_active":"2023-06-10T19:02:02.297290+0000","last_became_peered":"2023-06-10T19:02:02.297290+0000","last_unstale":"2023-06-10T19:02:02.650842+0000","last_undegraded":"2023-06-10T19:02:02.650842+0000","last_fullsized":"2023-06-10T19:02:02.650842+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:43:04.035379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.678108+0000","last_change":"2023-06-10T19:02:02.676849+0000","last_active":"2023-06-10T19:02:02.678108+0000","last_peered":"2023-06-10T19:02:02.678108+0000","last_clean":"2023-06-10T19:02:02.678108+0000","last_became_active":"2023-06-10T19:02:02.676586+0000","last_became_peered":"2023-06-10T19:02:02.676586+0000","last_unstale":"2023-06-10T19:02:02.678108+0000","last_undegraded":"2023-06-10T19:02:02.678108+0000","last_fullsized":"2023-06-10T19:02:02.678108+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:36:16.257691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.660986+0000","last_change":"2023-06-10T19:02:02.286569+0000","last_active":"2023-06-10T19:02:02.660986+0000","last_peered":"2023-06-10T19:02:02.660986+0000","last_clean":"2023-06-10T19:02:02.660986+0000","last_became_active":"2023-06-10T19:02:02.285744+0000","last_became_peered":"2023-06-10T19:02:02.285744+0000","last_unstale":"2023-06-10T19:02:02.660986+0000","last_undegraded":"2023-06-10T19:02:02.660986+0000","last_fullsized":"2023-06-10T19:02:02.660986+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:31:49.054392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":4,"reported_epoch":93,"state":"creating+activating","last_fresh":"2023-06-10T19:02:02.688613+0000","last_change":"2023-06-10T19:02:02.685700+0000","last_active":"2023-06-10T19:02:02.249926+0000","last_peered":"2023-06-10T19:02:02.249926+0000","last_clean":"2023-06-10T19:02:02.249926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:02:02.688613+0000","last_undegraded":"2023-06-10T19:02:02.688613+0000","last_fullsized":"2023-06-10T19:02:02.688613+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:58:45.386899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":["6","1"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.690800+0000","last_change":"2023-06-10T19:02:02.306818+0000","last_active":"2023-06-10T19:02:02.690800+0000","last_peered":"2023-06-10T19:02:02.690800+0000","last_clean":"2023-06-10T19:02:02.690800+0000","last_became_active":"2023-06-10T19:02:02.306128+0000","last_became_peered":"2023-06-10T19:02:02.306128+0000","last_unstale":"2023-06-10T19:02:02.690800+0000","last_undegraded":"2023-06-10T19:02:02.690800+0000","last_fullsized":"2023-06-10T19:02:02.690800+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:27:25.710935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.674707+0000","last_change":"2023-06-10T19:02:02.671837+0000","last_active":"2023-06-10T19:02:02.674707+0000","last_peered":"2023-06-10T19:02:02.674707+0000","last_clean":"2023-06-10T19:02:02.674707+0000","last_became_active":"2023-06-10T19:02:02.671536+0000","last_became_peered":"2023-06-10T19:02:02.671536+0000","last_unstale":"2023-06-10T19:02:02.674707+0000","last_undegraded":"2023-06-10T19:02:02.674707+0000","last_fullsized":"2023-06-10T19:02:02.674707+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:44:04.162930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.671827+0000","last_change":"2023-06-10T19:02:02.299831+0000","last_active":"2023-06-10T19:02:02.671827+0000","last_peered":"2023-06-10T19:02:02.671827+0000","last_clean":"2023-06-10T19:02:02.671827+0000","last_became_active":"2023-06-10T19:02:02.299041+0000","last_became_peered":"2023-06-10T19:02:02.299041+0000","last_unstale":"2023-06-10T19:02:02.671827+0000","last_undegraded":"2023-06-10T19:02:02.671827+0000","last_fullsized":"2023-06-10T19:02:02.671827+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:50:24.253165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":4,"reported_epoch":93,"state":"creating+activating","last_fresh":"2023-06-10T19:02:02.681390+0000","last_change":"2023-06-10T19:02:02.676482+0000","last_active":"2023-06-10T19:02:02.249926+0000","last_peered":"2023-06-10T19:02:02.249926+0000","last_clean":"2023-06-10T19:02:02.249926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:02:02.681390+0000","last_undegraded":"2023-06-10T19:02:02.681390+0000","last_fullsized":"2023-06-10T19:02:02.681390+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:38:21.898235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":["7","3"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.663683+0000","last_change":"2023-06-10T19:02:02.286969+0000","last_active":"2023-06-10T19:02:02.663683+0000","last_peered":"2023-06-10T19:02:02.663683+0000","last_clean":"2023-06-10T19:02:02.663683+0000","last_became_active":"2023-06-10T19:02:02.286247+0000","last_became_peered":"2023-06-10T19:02:02.286247+0000","last_unstale":"2023-06-10T19:02:02.663683+0000","last_undegraded":"2023-06-10T19:02:02.663683+0000","last_fullsized":"2023-06-10T19:02:02.663683+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:41:41.781956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":301,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.672339+0000","last_change":"2023-06-10T18:52:34.951528+0000","last_active":"2023-06-10T19:02:02.672339+0000","last_peered":"2023-06-10T19:02:02.672339+0000","last_clean":"2023-06-10T19:02:02.672339+0000","last_became_active":"2023-06-10T18:52:34.949099+0000","last_became_peered":"2023-06-10T18:52:34.949099+0000","last_unstale":"2023-06-10T19:02:02.672339+0000","last_undegraded":"2023-06-10T19:02:02.672339+0000","last_fullsized":"2023-06-10T19:02:02.672339+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_clean_scrub_stamp":"2023-06-10T18:52:33.633295+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:35:49.274025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":149,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.652580+0000","last_change":"2023-06-10T18:52:40.506384+0000","last_active":"2023-06-10T19:02:02.652580+0000","last_peered":"2023-06-10T19:02:02.652580+0000","last_clean":"2023-06-10T19:02:02.652580+0000","last_became_active":"2023-06-10T18:52:40.505701+0000","last_became_peered":"2023-06-10T18:52:40.505701+0000","last_unstale":"2023-06-10T19:02:02.652580+0000","last_undegraded":"2023-06-10T19:02:02.652580+0000","last_fullsized":"2023-06-10T19:02:02.652580+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:34:26.323306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.681638+0000","last_change":"2023-06-10T19:02:02.680269+0000","last_active":"2023-06-10T19:02:02.681638+0000","last_peered":"2023-06-10T19:02:02.681638+0000","last_clean":"2023-06-10T19:02:02.681638+0000","last_became_active":"2023-06-10T19:02:02.679987+0000","last_became_peered":"2023-06-10T19:02:02.679987+0000","last_unstale":"2023-06-10T19:02:02.681638+0000","last_undegraded":"2023-06-10T19:02:02.681638+0000","last_fullsized":"2023-06-10T19:02:02.681638+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:12:24.156196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.691387+0000","last_change":"2023-06-10T19:02:02.309267+0000","last_active":"2023-06-10T19:02:02.691387+0000","last_peered":"2023-06-10T19:02:02.691387+0000","last_clean":"2023-06-10T19:02:02.691387+0000","last_became_active":"2023-06-10T19:02:02.308404+0000","last_became_peered":"2023-06-10T19:02:02.308404+0000","last_unstale":"2023-06-10T19:02:02.691387+0000","last_undegraded":"2023-06-10T19:02:02.691387+0000","last_fullsized":"2023-06-10T19:02:02.691387+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:24:38.099052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":145,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.672039+0000","last_change":"2023-06-10T18:52:40.512015+0000","last_active":"2023-06-10T19:02:02.672039+0000","last_peered":"2023-06-10T19:02:02.672039+0000","last_clean":"2023-06-10T19:02:02.672039+0000","last_became_active":"2023-06-10T18:52:40.511382+0000","last_became_peered":"2023-06-10T18:52:40.511382+0000","last_unstale":"2023-06-10T19:02:02.672039+0000","last_undegraded":"2023-06-10T19:02:02.672039+0000","last_fullsized":"2023-06-10T19:02:02.672039+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:28:15.481245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":4,"reported_epoch":93,"state":"creating+activating","last_fresh":"2023-06-10T19:02:02.693760+0000","last_change":"2023-06-10T19:02:02.685058+0000","last_active":"2023-06-10T19:02:02.249926+0000","last_peered":"2023-06-10T19:02:02.249926+0000","last_clean":"2023-06-10T19:02:02.249926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:02:02.693760+0000","last_undegraded":"2023-06-10T19:02:02.693760+0000","last_fullsized":"2023-06-10T19:02:02.693760+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:29:40.789452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":["6","5"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"93'2","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.694954+0000","last_change":"2023-06-10T19:02:02.300090+0000","last_active":"2023-06-10T19:02:02.694954+0000","last_peered":"2023-06-10T19:02:02.694954+0000","last_clean":"2023-06-10T19:02:02.694954+0000","last_became_active":"2023-06-10T19:02:02.299285+0000","last_became_peered":"2023-06-10T19:02:02.299285+0000","last_unstale":"2023-06-10T19:02:02.694954+0000","last_undegraded":"2023-06-10T19:02:02.694954+0000","last_fullsized":"2023-06-10T19:02:02.694954+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:17:26.780651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":151,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.655794+0000","last_change":"2023-06-10T18:52:40.671725+0000","last_active":"2023-06-10T19:02:02.655794+0000","last_peered":"2023-06-10T19:02:02.655794+0000","last_clean":"2023-06-10T19:02:02.655794+0000","last_became_active":"2023-06-10T18:52:40.671442+0000","last_became_peered":"2023-06-10T18:52:40.671442+0000","last_unstale":"2023-06-10T19:02:02.655794+0000","last_undegraded":"2023-06-10T19:02:02.655794+0000","last_fullsized":"2023-06-10T19:02:02.655794+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:17:15.147758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.681135+0000","last_change":"2023-06-10T19:02:02.681135+0000","last_active":"2023-06-10T19:02:02.681135+0000","last_peered":"2023-06-10T19:02:02.681135+0000","last_clean":"2023-06-10T19:02:02.681135+0000","last_became_active":"2023-06-10T19:02:02.680233+0000","last_became_peered":"2023-06-10T19:02:02.680233+0000","last_unstale":"2023-06-10T19:02:02.681135+0000","last_undegraded":"2023-06-10T19:02:02.681135+0000","last_fullsized":"2023-06-10T19:02:02.681135+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:56:02.719475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.672960+0000","last_change":"2023-06-10T19:02:02.292614+0000","last_active":"2023-06-10T19:02:02.672960+0000","last_peered":"2023-06-10T19:02:02.672960+0000","last_clean":"2023-06-10T19:02:02.672960+0000","last_became_active":"2023-06-10T19:02:02.291916+0000","last_became_peered":"2023-06-10T19:02:02.291916+0000","last_unstale":"2023-06-10T19:02:02.672960+0000","last_undegraded":"2023-06-10T19:02:02.672960+0000","last_fullsized":"2023-06-10T19:02:02.672960+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:18:50.542343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":149,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.660908+0000","last_change":"2023-06-10T18:52:40.510258+0000","last_active":"2023-06-10T19:02:02.660908+0000","last_peered":"2023-06-10T19:02:02.660908+0000","last_clean":"2023-06-10T19:02:02.660908+0000","last_became_active":"2023-06-10T18:52:40.509560+0000","last_became_peered":"2023-06-10T18:52:40.509560+0000","last_unstale":"2023-06-10T19:02:02.660908+0000","last_undegraded":"2023-06-10T19:02:02.660908+0000","last_fullsized":"2023-06-10T19:02:02.660908+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:00:07.712002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.668295+0000","last_change":"2023-06-10T19:02:02.663696+0000","last_active":"2023-06-10T19:02:02.668295+0000","last_peered":"2023-06-10T19:02:02.668295+0000","last_clean":"2023-06-10T19:02:02.668295+0000","last_became_active":"2023-06-10T19:02:02.663441+0000","last_became_peered":"2023-06-10T19:02:02.663441+0000","last_unstale":"2023-06-10T19:02:02.668295+0000","last_undegraded":"2023-06-10T19:02:02.668295+0000","last_fullsized":"2023-06-10T19:02:02.668295+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:05:29.276794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"93'2","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.684478+0000","last_change":"2023-06-10T19:02:02.286757+0000","last_active":"2023-06-10T19:02:02.684478+0000","last_peered":"2023-06-10T19:02:02.684478+0000","last_clean":"2023-06-10T19:02:02.684478+0000","last_became_active":"2023-06-10T19:02:02.285950+0000","last_became_peered":"2023-06-10T19:02:02.285950+0000","last_unstale":"2023-06-10T19:02:02.684478+0000","last_undegraded":"2023-06-10T19:02:02.684478+0000","last_fullsized":"2023-06-10T19:02:02.684478+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:47:52.566821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":137,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.663766+0000","last_change":"2023-06-10T18:52:40.672266+0000","last_active":"2023-06-10T19:02:02.663766+0000","last_peered":"2023-06-10T19:02:02.663766+0000","last_clean":"2023-06-10T19:02:02.663766+0000","last_became_active":"2023-06-10T18:52:40.671966+0000","last_became_peered":"2023-06-10T18:52:40.671966+0000","last_unstale":"2023-06-10T19:02:02.663766+0000","last_undegraded":"2023-06-10T19:02:02.663766+0000","last_fullsized":"2023-06-10T19:02:02.663766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:23:30.112577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.682181+0000","last_change":"2023-06-10T19:02:02.670012+0000","last_active":"2023-06-10T19:02:02.682181+0000","last_peered":"2023-06-10T19:02:02.682181+0000","last_clean":"2023-06-10T19:02:02.682181+0000","last_became_active":"2023-06-10T19:02:02.669278+0000","last_became_peered":"2023-06-10T19:02:02.669278+0000","last_unstale":"2023-06-10T19:02:02.682181+0000","last_undegraded":"2023-06-10T19:02:02.682181+0000","last_fullsized":"2023-06-10T19:02:02.682181+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:18:57.746056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.656217+0000","last_change":"2023-06-10T19:02:02.281757+0000","last_active":"2023-06-10T19:02:02.656217+0000","last_peered":"2023-06-10T19:02:02.656217+0000","last_clean":"2023-06-10T19:02:02.656217+0000","last_became_active":"2023-06-10T19:02:02.281378+0000","last_became_peered":"2023-06-10T19:02:02.281378+0000","last_unstale":"2023-06-10T19:02:02.656217+0000","last_undegraded":"2023-06-10T19:02:02.656217+0000","last_fullsized":"2023-06-10T19:02:02.656217+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:06:06.568248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":145,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.674878+0000","last_change":"2023-06-10T18:52:40.671084+0000","last_active":"2023-06-10T19:02:02.674878+0000","last_peered":"2023-06-10T19:02:02.674878+0000","last_clean":"2023-06-10T19:02:02.674878+0000","last_became_active":"2023-06-10T18:52:40.670697+0000","last_became_peered":"2023-06-10T18:52:40.670697+0000","last_unstale":"2023-06-10T19:02:02.674878+0000","last_undegraded":"2023-06-10T19:02:02.674878+0000","last_fullsized":"2023-06-10T19:02:02.674878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:36:37.423072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.688793+0000","last_change":"2023-06-10T19:02:02.679941+0000","last_active":"2023-06-10T19:02:02.688793+0000","last_peered":"2023-06-10T19:02:02.688793+0000","last_clean":"2023-06-10T19:02:02.688793+0000","last_became_active":"2023-06-10T19:02:02.679209+0000","last_became_peered":"2023-06-10T19:02:02.679209+0000","last_unstale":"2023-06-10T19:02:02.688793+0000","last_undegraded":"2023-06-10T19:02:02.688793+0000","last_fullsized":"2023-06-10T19:02:02.688793+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:09:25.545048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.655021+0000","last_change":"2023-06-10T19:02:02.288468+0000","last_active":"2023-06-10T19:02:02.655021+0000","last_peered":"2023-06-10T19:02:02.655021+0000","last_clean":"2023-06-10T19:02:02.655021+0000","last_became_active":"2023-06-10T19:02:02.287678+0000","last_became_peered":"2023-06-10T19:02:02.287678+0000","last_unstale":"2023-06-10T19:02:02.655021+0000","last_undegraded":"2023-06-10T19:02:02.655021+0000","last_fullsized":"2023-06-10T19:02:02.655021+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:06:24.821830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":137,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.663764+0000","last_change":"2023-06-10T18:52:40.514114+0000","last_active":"2023-06-10T19:02:02.663764+0000","last_peered":"2023-06-10T19:02:02.663764+0000","last_clean":"2023-06-10T19:02:02.663764+0000","last_became_active":"2023-06-10T18:52:40.513638+0000","last_became_peered":"2023-06-10T18:52:40.513638+0000","last_unstale":"2023-06-10T19:02:02.663764+0000","last_undegraded":"2023-06-10T19:02:02.663764+0000","last_fullsized":"2023-06-10T19:02:02.663764+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:34:10.418426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.666991+0000","last_change":"2023-06-10T19:02:02.661974+0000","last_active":"2023-06-10T19:02:02.666991+0000","last_peered":"2023-06-10T19:02:02.666991+0000","last_clean":"2023-06-10T19:02:02.666991+0000","last_became_active":"2023-06-10T19:02:02.661623+0000","last_became_peered":"2023-06-10T19:02:02.661623+0000","last_unstale":"2023-06-10T19:02:02.666991+0000","last_undegraded":"2023-06-10T19:02:02.666991+0000","last_fullsized":"2023-06-10T19:02:02.666991+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:53:04.166432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.656632+0000","last_change":"2023-06-10T19:02:02.294886+0000","last_active":"2023-06-10T19:02:02.656632+0000","last_peered":"2023-06-10T19:02:02.656632+0000","last_clean":"2023-06-10T19:02:02.656632+0000","last_became_active":"2023-06-10T19:02:02.294578+0000","last_became_peered":"2023-06-10T19:02:02.294578+0000","last_unstale":"2023-06-10T19:02:02.656632+0000","last_undegraded":"2023-06-10T19:02:02.656632+0000","last_fullsized":"2023-06-10T19:02:02.656632+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:33:34.686527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":145,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.691963+0000","last_change":"2023-06-10T18:52:40.515396+0000","last_active":"2023-06-10T19:02:02.691963+0000","last_peered":"2023-06-10T19:02:02.691963+0000","last_clean":"2023-06-10T19:02:02.691963+0000","last_became_active":"2023-06-10T18:52:40.514663+0000","last_became_peered":"2023-06-10T18:52:40.514663+0000","last_unstale":"2023-06-10T19:02:02.691963+0000","last_undegraded":"2023-06-10T19:02:02.691963+0000","last_fullsized":"2023-06-10T19:02:02.691963+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:42:42.732048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":1470,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":37,"ondisk_log_size":37,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574965,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32720,"kb_used_data":1672,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339120,"statfs":{"total":96636764160,"available":96603258880,"internally_reserved":0,"allocated":1712128,"data_stored":1096424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.94199999999999995,"15min":0.90300000000000002},"min":{"1min":0.63800000000000001,"5min":0.54700000000000004,"15min":0.434},"max":{"1min":1.196,"5min":1.327,"15min":1.6220000000000001},"last":1.0409999999999999},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.93000000000000005,"15min":0.92900000000000005},"min":{"1min":0.70999999999999996,"5min":0.496,"15min":0.496},"max":{"1min":1.149,"5min":1.264,"15min":1.6870000000000001},"last":1.002}]},{"osd":1,"last update":"Sat Jun 10 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.93200000000000005,"15min":0.92500000000000004},"min":{"1min":0.64700000000000002,"5min":0.54200000000000004,"15min":0.53900000000000003},"max":{"1min":1.238,"5min":1.262,"15min":1.377},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.97299999999999998,"15min":0.93600000000000005},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.504},"max":{"1min":1.1279999999999999,"5min":1.234,"15min":1.5960000000000001},"last":0.81100000000000005}]},{"osd":2,"last update":"Sat Jun 10 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.85599999999999998,"15min":0.83799999999999997},"min":{"1min":0.625,"5min":0.52100000000000002,"15min":0.47099999999999997},"max":{"1min":1.169,"5min":1.169,"15min":1.4059999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.91100000000000003,"15min":0.90400000000000003},"min":{"1min":0.67900000000000005,"5min":0.53000000000000003,"15min":0.50600000000000001},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.89600000000000002}]},{"osd":3,"last update":"Sat Jun 10 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.93600000000000005,"15min":0.91800000000000004},"min":{"1min":0.71899999999999997,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.502},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.0229999999999999,"5min":0.97599999999999998,"15min":0.94699999999999995},"min":{"1min":0.80400000000000005,"5min":0.59599999999999997,"15min":0.53800000000000003},"max":{"1min":1.2769999999999999,"5min":1.284,"15min":1.2929999999999999},"last":0.96399999999999997}]},{"osd":4,"last update":"Sat Jun 10 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.83199999999999996,"15min":0.85799999999999998},"min":{"1min":0.629,"5min":0.39500000000000002,"15min":0.32700000000000001},"max":{"1min":1.056,"5min":1.1990000000000001,"15min":1.639},"last":0.63900000000000001},{"interface":"front","average":{"1min":1.014,"5min":0.97199999999999998,"15min":0.97299999999999998},"min":{"1min":0.67200000000000004,"5min":0.434,"15min":0.40000000000000002},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.86799999999999999}]},{"osd":5,"last update":"Sat Jun 10 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":0.99199999999999999,"15min":1.016},"min":{"1min":0.73699999999999999,"5min":0.40500000000000003,"15min":0.38400000000000001},"max":{"1min":1.379,"5min":1.395,"15min":1.806},"last":0.84399999999999997},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0389999999999999,"15min":1.0429999999999999},"min":{"1min":0.70399999999999996,"5min":0.505,"15min":0.46500000000000002},"max":{"1min":1.579,"5min":1.579,"15min":1.579},"last":0.97999999999999998}]},{"osd":6,"last update":"Sat Jun 10 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0069999999999999},"min":{"1min":0.65100000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.391,"5min":1.391,"15min":1.718},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.149,"5min":1.1140000000000001,"15min":1.0960000000000001},"min":{"1min":0.82099999999999995,"5min":0.48799999999999999,"15min":0.441},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":1.022}]}]},{"osd":6,"up_from":13,"seq":55834574966,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32152,"kb_used_data":1104,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339688,"statfs":{"total":96636764160,"available":96603840512,"internally_reserved":0,"allocated":1130496,"data_stored":512684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.89700000000000002,"15min":0.84599999999999997},"min":{"1min":0.55000000000000004,"5min":0.52600000000000002,"15min":0.502},"max":{"1min":1.111,"5min":1.476,"15min":1.498},"last":1.079},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.89400000000000002,"15min":0.86899999999999999},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46100000000000002},"max":{"1min":1.2250000000000001,"5min":1.496,"15min":1.496},"last":0.94199999999999995}]},{"osd":1,"last update":"Sat Jun 10 19:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.86399999999999999,"15min":0.86199999999999999},"min":{"1min":0.502,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.079,"5min":1.1739999999999999,"15min":1.5229999999999999},"last":1.0229999999999999},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.90900000000000003,"15min":0.88400000000000001},"min":{"1min":0.61399999999999999,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.1599999999999999,"5min":1.2450000000000001,"15min":1.778},"last":0.78100000000000003}]},{"osd":2,"last update":"Sat Jun 10 19:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91300000000000003,"15min":0.88300000000000001},"min":{"1min":0.748,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.2130000000000001,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":1.111},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.90400000000000003,"15min":0.89200000000000002},"min":{"1min":0.66200000000000003,"5min":0.61299999999999999,"15min":0.57999999999999996},"max":{"1min":1.2330000000000001,"5min":1.246,"15min":1.246},"last":0.56100000000000005}]},{"osd":3,"last update":"Sat Jun 10 19:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.93300000000000005,"15min":0.89200000000000002},"min":{"1min":0.68200000000000005,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0860000000000001,"5min":1.399,"15min":1.7190000000000001},"last":1.141},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.98199999999999998,"15min":0.99099999999999999},"min":{"1min":0.77300000000000002,"5min":0.72599999999999998,"15min":0.58599999999999997},"max":{"1min":1.2470000000000001,"5min":1.272,"15min":1.4370000000000001},"last":1.371}]},{"osd":4,"last update":"Sat Jun 10 19:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.89800000000000002,"15min":0.93000000000000005},"min":{"1min":0.71999999999999997,"5min":0.59799999999999998,"15min":0.56799999999999995},"max":{"1min":1.1719999999999999,"5min":1.4159999999999999,"15min":1.798},"last":1.401},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.95799999999999996,"15min":0.996},"min":{"1min":0.64500000000000002,"5min":0.64000000000000001,"15min":0.51300000000000001},"max":{"1min":1.319,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":1.1619999999999999}]},{"osd":5,"last update":"Sat Jun 10 19:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.91100000000000003,"15min":0.93799999999999994},"min":{"1min":0.72099999999999997,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.194,"5min":1.333,"15min":1.333},"last":1.29},{"interface":"front","average":{"1min":1.012,"5min":1.02,"15min":1.03},"min":{"1min":0.77800000000000002,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.2210000000000001,"5min":1.405,"15min":2.536},"last":1.2230000000000001}]},{"osd":7,"last update":"Sat Jun 10 19:01:43 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.0169999999999999,"15min":1.036},"min":{"1min":0.82699999999999996,"5min":0.60899999999999999,"15min":0.57099999999999995},"max":{"1min":1.361,"5min":1.48,"15min":1.917},"last":1.427},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.98299999999999998,"15min":1.034},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.278,"5min":1.29,"15min":1.5569999999999999},"last":1.4850000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574966,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32140,"kb_used_data":1092,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339700,"statfs":{"total":96636764160,"available":96603852800,"internally_reserved":0,"allocated":1118208,"data_stored":506056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:01:45 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.91700000000000004,"15min":0.86199999999999999},"min":{"1min":0.58099999999999996,"5min":0.54100000000000004,"15min":0.50600000000000001},"max":{"1min":1.2070000000000001,"5min":1.232,"15min":1.232},"last":0.56599999999999995},{"interface":"front","average":{"1min":1.028,"5min":0.92400000000000004,"15min":0.92700000000000005},"min":{"1min":0.58999999999999997,"5min":0.51400000000000001,"15min":0.49399999999999999},"max":{"1min":2.347,"5min":2.347,"15min":2.347},"last":0.98299999999999998}]},{"osd":1,"last update":"Sat Jun 10 19:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":0.97199999999999998,"15min":0.92800000000000005},"min":{"1min":0.63400000000000001,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":7.0800000000000001,"5min":7.0800000000000001,"15min":7.0800000000000001},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.9550000000000001,"5min":1.1240000000000001,"15min":0.98799999999999999},"min":{"1min":0.59199999999999997,"5min":0.57699999999999996,"15min":0.53800000000000003},"max":{"1min":15.845000000000001,"5min":15.845000000000001,"15min":15.845000000000001},"last":0.91800000000000004}]},{"osd":2,"last update":"Sat Jun 10 19:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":0.94299999999999995,"15min":0.88100000000000001},"min":{"1min":0.68200000000000005,"5min":0.49299999999999999,"15min":0.48299999999999998},"max":{"1min":5.0049999999999999,"5min":5.0049999999999999,"15min":5.0049999999999999},"last":0.626},{"interface":"front","average":{"1min":1.296,"5min":1.008,"15min":0.94299999999999995},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":6.851,"5min":6.851,"15min":6.851},"last":0.86599999999999999}]},{"osd":3,"last update":"Sat Jun 10 19:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":0.96399999999999997,"15min":0.95499999999999996},"min":{"1min":0.65900000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.544,"5min":2.544,"15min":2.544},"last":1.0509999999999999},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0029999999999999,"15min":1.0169999999999999},"min":{"1min":0.63100000000000001,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":3.0830000000000002,"5min":3.0830000000000002,"15min":3.0830000000000002},"last":1.1080000000000001}]},{"osd":4,"last update":"Sat Jun 10 19:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":0.95799999999999996,"15min":0.96699999999999997},"min":{"1min":0.66800000000000004,"5min":0.64100000000000001,"15min":0.58099999999999996},"max":{"1min":6.7290000000000001,"5min":6.7290000000000001,"15min":6.7290000000000001},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.0369999999999999,"5min":0.98199999999999998,"15min":1.0269999999999999},"min":{"1min":0.68300000000000005,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.278,"5min":1.341,"15min":1.575},"last":0.755}]},{"osd":6,"last update":"Sat Jun 10 19:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":0.98199999999999998,"15min":1.03},"min":{"1min":0.65300000000000002,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.3029999999999999,"5min":1.3660000000000001,"15min":1.4330000000000001},"last":0.81799999999999995},{"interface":"front","average":{"1min":1.373,"5min":1.093,"15min":1.073},"min":{"1min":0.81499999999999995,"5min":0.66500000000000004,"15min":0.57899999999999996},"max":{"1min":6.923,"5min":6.923,"15min":6.923},"last":1.018}]},{"osd":7,"last update":"Sat Jun 10 19:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.0629999999999999,"15min":1.1259999999999999},"min":{"1min":0.81399999999999995,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":2.6080000000000001,"5min":2.6080000000000001,"15min":2.6080000000000001},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.4319999999999999,"5min":1.157,"15min":1.1619999999999999},"min":{"1min":0.95299999999999996,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":5.4169999999999998,"5min":5.4169999999999998,"15min":5.4169999999999998},"last":1.1719999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574965,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32152,"kb_used_data":1104,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339688,"statfs":{"total":96636764160,"available":96603840512,"internally_reserved":0,"allocated":1130496,"data_stored":512684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.872,"15min":0.79800000000000004},"min":{"1min":0.49199999999999999,"5min":0.48599999999999999,"15min":0.45100000000000001},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.91900000000000004,"15min":0.89800000000000002},"min":{"1min":0.58399999999999996,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0580000000000001,"5min":3.7280000000000002,"15min":3.7280000000000002},"last":0.70799999999999996}]},{"osd":1,"last update":"Sat Jun 10 19:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.93500000000000005,"15min":0.94599999999999995},"min":{"1min":0.63100000000000001,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1200000000000001,"5min":3.3969999999999998,"15min":3.3969999999999998},"last":1.0229999999999999},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.90100000000000002,"15min":0.86199999999999999},"min":{"1min":0.66100000000000003,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.1679999999999999,"5min":2.496,"15min":2.496},"last":0.753}]},{"osd":2,"last update":"Sat Jun 10 19:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.90200000000000002,"15min":0.88400000000000001},"min":{"1min":0.56799999999999995,"5min":0.51300000000000001,"15min":0.49299999999999999},"max":{"1min":1.3,"5min":1.3,"15min":1.522},"last":0.88400000000000001},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.006,"15min":1},"min":{"1min":0.74099999999999999,"5min":0.57799999999999996,"15min":0.55000000000000004},"max":{"1min":1.204,"5min":3.5750000000000002,"15min":3.5750000000000002},"last":0.82199999999999995}]},{"osd":3,"last update":"Sat Jun 10 19:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.91700000000000004,"15min":0.89600000000000002},"min":{"1min":0.71599999999999997,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.2909999999999999,"5min":2.3809999999999998,"15min":2.3809999999999998},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.97199999999999998,"15min":0.96399999999999997},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.54400000000000004},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.6479999999999999},"last":0.67200000000000004}]},{"osd":5,"last update":"Sat Jun 10 19:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.96899999999999997,"15min":0.97599999999999998},"min":{"1min":0.68700000000000006,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.1459999999999999,"5min":3.6539999999999999,"15min":3.6539999999999999},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.94599999999999995,"15min":0.96499999999999997},"min":{"1min":0.68400000000000005,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.204,"5min":2.6720000000000002,"15min":2.6720000000000002},"last":1.0529999999999999}]},{"osd":6,"last update":"Sat Jun 10 19:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.93999999999999995,"15min":0.98999999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.54900000000000004},"max":{"1min":1.276,"5min":1.3149999999999999,"15min":2.2639999999999998},"last":0.79800000000000004},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0549999999999999,"15min":1.0660000000000001},"min":{"1min":0.76500000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.3200000000000001,"5min":3.4980000000000002,"15min":3.4980000000000002},"last":1.093}]},{"osd":7,"last update":"Sat Jun 10 19:01:59 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":0.999,"15min":0.99399999999999999},"min":{"1min":0.72499999999999998,"5min":0.66300000000000003,"15min":0.41399999999999998},"max":{"1min":1.3360000000000001,"5min":2.5910000000000002,"15min":2.5910000000000002},"last":0.85199999999999998},{"interface":"front","average":{"1min":1.083,"5min":1.0660000000000001,"15min":1.069},"min":{"1min":0.68100000000000005,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.3740000000000001,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.98999999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574964,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":1088,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":1114112,"data_stored":505037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.627,"15min":0.59899999999999998},"min":{"1min":0.44600000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.88300000000000001,"5min":1.01,"15min":1.169},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.68100000000000005,"15min":0.65400000000000003},"min":{"1min":0.45300000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.96699999999999997,"5min":1.1679999999999999,"15min":1.286},"last":1.093}]},{"osd":1,"last update":"Sat Jun 10 19:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.68300000000000005,"15min":0.65600000000000003},"min":{"1min":0.501,"5min":0.34300000000000003,"15min":0.27500000000000002},"max":{"1min":0.94299999999999995,"5min":1.2569999999999999,"15min":1.2729999999999999},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.74399999999999999,"15min":0.73299999999999998},"min":{"1min":0.42999999999999999,"5min":0.33000000000000002,"15min":0.318},"max":{"1min":1.0449999999999999,"5min":1.296,"15min":1.411},"last":0.84599999999999997}]},{"osd":2,"last update":"Sat Jun 10 19:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.78500000000000003,"15min":0.76800000000000002},"min":{"1min":0.49199999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.018,"5min":1.3899999999999999,"15min":1.9530000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.80100000000000005,"15min":0.76700000000000002},"min":{"1min":0.58399999999999996,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.125,"5min":1.278,"15min":1.278},"last":0.94099999999999995}]},{"osd":4,"last update":"Sat Jun 10 19:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.93899999999999995,"15min":0.95499999999999996},"min":{"1min":0.69899999999999995,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.1899999999999999,"5min":1.488,"15min":1.488},"last":1.0489999999999999},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.98399999999999999,"15min":0.98999999999999999},"min":{"1min":0.68700000000000006,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.3069999999999999,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":1.1419999999999999}]},{"osd":5,"last update":"Sat Jun 10 19:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.008,"15min":1.0349999999999999},"min":{"1min":0.64200000000000002,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.2030000000000001,"5min":1.425,"15min":2.024},"last":1.006},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.014,"15min":1.0229999999999999},"min":{"1min":0.72099999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.3220000000000001,"5min":1.5069999999999999,"15min":1.724},"last":1.175}]},{"osd":6,"last update":"Sat Jun 10 19:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.0600000000000001,"15min":1.0580000000000001},"min":{"1min":0.79600000000000004,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.3600000000000001,"5min":1.597,"15min":1.8500000000000001},"last":1.119},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.0509999999999999,"15min":1.0649999999999999},"min":{"1min":0.73499999999999999,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.3380000000000001,"5min":1.4590000000000001,"15min":1.78},"last":0.97099999999999997}]},{"osd":7,"last update":"Sat Jun 10 19:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.0820000000000001,"15min":1.1100000000000001},"min":{"1min":0.75,"5min":0.60999999999999999,"15min":0.56999999999999995},"max":{"1min":1.373,"5min":1.444,"15min":1.9079999999999999},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.093,"5min":1.105,"15min":1.0900000000000001},"min":{"1min":0.72099999999999997,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.399,"5min":1.651,"15min":1.6719999999999999},"last":1.075}]}]},{"osd":2,"up_from":13,"seq":55834574965,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32152,"kb_used_data":1104,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339688,"statfs":{"total":96636764160,"available":96603840512,"internally_reserved":0,"allocated":1130496,"data_stored":512684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:01:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.628,"15min":0.60499999999999998},"min":{"1min":0.31,"5min":0.28899999999999998,"15min":0.27300000000000002},"max":{"1min":1.095,"5min":1.095,"15min":1.1220000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.72899999999999998,"15min":0.72199999999999998},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.0209999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.56999999999999995}]},{"osd":1,"last update":"Sat Jun 10 19:01:52 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.67500000000000004,"15min":0.66100000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.307},"max":{"1min":0.98199999999999998,"5min":1.099,"15min":1.1950000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.78100000000000003,"15min":0.73599999999999999},"min":{"1min":0.36699999999999999,"5min":0.33300000000000002,"15min":0.29499999999999998},"max":{"1min":1.0109999999999999,"5min":1.446,"15min":1.446},"last":1.2310000000000001}]},{"osd":3,"last update":"Sat Jun 10 19:01:52 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.80000000000000004,"15min":0.746},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.1599999999999999,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.80400000000000005,"15min":0.77100000000000002},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.252},"max":{"1min":0.999,"5min":1.1459999999999999,"15min":1.3340000000000001},"last":0.86499999999999999}]},{"osd":4,"last update":"Sat Jun 10 19:01:52 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.93500000000000005,"15min":0.92400000000000004},"min":{"1min":0.624,"5min":0.56200000000000006,"15min":0.53400000000000003},"max":{"1min":1.228,"5min":1.228,"15min":1.3620000000000001},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.998,"5min":1.0049999999999999,"15min":1.0269999999999999},"min":{"1min":0.753,"5min":0.60899999999999999,"15min":0.57699999999999996},"max":{"1min":1.486,"5min":1.486,"15min":1.4950000000000001},"last":0.95099999999999996}]},{"osd":5,"last update":"Sat Jun 10 19:01:52 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.008,"15min":1.018},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.54100000000000004},"max":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":1.5700000000000001},"last":1.139},{"interface":"front","average":{"1min":0.98699999999999999,"5min":1.0189999999999999,"15min":1.002},"min":{"1min":0.71999999999999997,"5min":0.66000000000000003,"15min":0.60099999999999998},"max":{"1min":1.2669999999999999,"5min":1.381,"15min":1.667},"last":1.008}]},{"osd":6,"last update":"Sat Jun 10 19:01:52 2023","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.044,"15min":1.0389999999999999},"min":{"1min":0.67400000000000004,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.304,"5min":1.4259999999999999,"15min":1.5900000000000001},"last":1.0620000000000001},{"interface":"front","average":{"1min":1.038,"5min":1.05,"15min":1.044},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.2989999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":1.1060000000000001}]},{"osd":7,"last update":"Sat Jun 10 19:01:52 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.0880000000000001,"15min":1.0980000000000001},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.4319999999999999,"5min":1.724,"15min":1.724},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.085,"5min":1.1080000000000001,"15min":1.0980000000000001},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.59299999999999997},"max":{"1min":1.363,"5min":1.51,"15min":1.752},"last":1.1759999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574967,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":1088,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":1114112,"data_stored":505037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:01:54 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.71699999999999997,"15min":0.68000000000000005},"min":{"1min":0.46500000000000002,"5min":0.28599999999999998,"15min":0.25800000000000001},"max":{"1min":1.111,"5min":1.1459999999999999,"15min":1.288},"last":0.629},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79000000000000004,"15min":0.72899999999999998},"min":{"1min":0.41899999999999998,"5min":0.32800000000000001,"15min":0.26900000000000002},"max":{"1min":0.98099999999999998,"5min":1.056,"15min":1.694},"last":0.58599999999999997}]},{"osd":2,"last update":"Sat Jun 10 19:01:54 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.65700000000000003,"15min":0.63400000000000001},"min":{"1min":0.39200000000000002,"5min":0.308,"15min":0.249},"max":{"1min":0.93999999999999995,"5min":1.0740000000000001,"15min":1.21},"last":0.371},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.754,"15min":0.70299999999999996},"min":{"1min":0.48599999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.0600000000000001,"5min":1.194,"15min":1.415},"last":0.38800000000000001}]},{"osd":3,"last update":"Sat Jun 10 19:01:54 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.80700000000000005,"15min":0.77600000000000002},"min":{"1min":0.58599999999999997,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.1679999999999999,"5min":1.3049999999999999,"15min":1.6299999999999999},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.75900000000000001,"15min":0.752},"min":{"1min":0.47199999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":2.1749999999999998},"last":0.44400000000000001}]},{"osd":4,"last update":"Sat Jun 10 19:01:54 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.878,"15min":0.85699999999999998},"min":{"1min":0.67400000000000004,"5min":0.58699999999999997,"15min":0.53000000000000003},"max":{"1min":1.343,"5min":1.343,"15min":1.4930000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.022,"15min":1.0600000000000001},"min":{"1min":0.71299999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.2569999999999999,"5min":1.5129999999999999,"15min":5.8209999999999997},"last":0.67800000000000005}]},{"osd":5,"last update":"Sat Jun 10 19:01:54 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.006,"15min":1.0169999999999999},"min":{"1min":0.60899999999999999,"5min":0.57699999999999996,"15min":0.56599999999999995},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.8620000000000001},"last":0.751},{"interface":"front","average":{"1min":1.018,"5min":0.997,"15min":0.98299999999999998},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.3069999999999999,"5min":1.3089999999999999,"15min":3.089},"last":0.66600000000000004}]},{"osd":6,"last update":"Sat Jun 10 19:01:54 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.0660000000000001,"15min":1.0549999999999999},"min":{"1min":0.73699999999999999,"5min":0.64100000000000001,"15min":0.56200000000000006},"max":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":7.2599999999999998},"last":0.81899999999999995},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0389999999999999,"15min":1.042},"min":{"1min":0.73599999999999999,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":9.0069999999999997},"last":0.60299999999999998}]},{"osd":7,"last update":"Sat Jun 10 19:01:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.113,"15min":1.0940000000000001},"min":{"1min":0.92400000000000004,"5min":0.495,"15min":0.495},"max":{"1min":1.494,"5min":1.573,"15min":2.105},"last":0.72399999999999998},{"interface":"front","average":{"1min":1.089,"5min":1.1180000000000001,"15min":1.087},"min":{"1min":0.63700000000000001,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.5620000000000001,"5min":1.6399999999999999,"15min":2.2570000000000001},"last":0.85299999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574966,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32728,"kb_used_data":1680,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339112,"statfs":{"total":96636764160,"available":96603250688,"internally_reserved":0,"allocated":1720320,"data_stored":1102033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jun 10 19:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.65500000000000003,"15min":0.624},"min":{"1min":0.34799999999999998,"5min":0.248,"15min":0.248},"max":{"1min":1.077,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.82899999999999996,"15min":0.78200000000000003},"min":{"1min":0.38600000000000001,"5min":0.34100000000000003,"15min":0.34000000000000002},"max":{"1min":1.1559999999999999,"5min":1.302,"15min":1.4059999999999999},"last":0.96899999999999997}]},{"osd":2,"last update":"Sat Jun 10 19:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.71399999999999997,"15min":0.70599999999999996},"min":{"1min":0.33500000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.149,"5min":1.149,"15min":1.2829999999999999},"last":1.2010000000000001},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66600000000000004,"15min":0.64700000000000002},"min":{"1min":0.318,"5min":0.245,"15min":0.245},"max":{"1min":0.88900000000000001,"5min":1.139,"15min":1.371},"last":0.70399999999999996}]},{"osd":3,"last update":"Sat Jun 10 19:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.67300000000000004,"15min":0.67900000000000005},"min":{"1min":0.30299999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.96199999999999997,"5min":1.222,"15min":1.226},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.80400000000000005,"15min":0.81499999999999995},"min":{"1min":0.41999999999999998,"5min":0.317,"15min":0.317},"max":{"1min":1.083,"5min":1.2549999999999999,"15min":1.829},"last":0.81599999999999995}]},{"osd":4,"last update":"Sat Jun 10 19:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.94099999999999995,"15min":0.91200000000000003},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1990000000000001,"5min":3.0209999999999999,"15min":3.0209999999999999},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.998,"5min":1.016,"15min":1.028},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.228,"5min":1.3819999999999999,"15min":1.9510000000000001},"last":1.097}]},{"osd":5,"last update":"Sat Jun 10 19:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.92400000000000004,"15min":0.94599999999999995},"min":{"1min":0.64700000000000002,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.095,"5min":1.2529999999999999,"15min":1.694},"last":1.071},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.024,"15min":1.01},"min":{"1min":0.58099999999999996,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.391,"5min":4.5620000000000003,"15min":4.5620000000000003},"last":1.0469999999999999}]},{"osd":6,"last update":"Sat Jun 10 19:01:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0940000000000001,"15min":1.0720000000000001},"min":{"1min":0.61899999999999999,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.423,"5min":3.5569999999999999,"15min":3.5569999999999999},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.012,"15min":1.004},"min":{"1min":0.67100000000000004,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.26,"5min":1.625,"15min":1.883},"last":1.018}]},{"osd":7,"last update":"Sat Jun 10 19:01:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0309999999999999,"15min":1.0349999999999999},"min":{"1min":0.69199999999999995,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.349,"5min":1.4850000000000001,"15min":1.5800000000000001},"last":0.91700000000000004},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.63,"5min":0.61099999999999999,"15min":0.58699999999999997},"max":{"1min":1.4179999999999999,"5min":1.425,"15min":1.9830000000000001},"last":1.131}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-10T19:02:06.740 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-10T19:02:06.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.859+0000 7f56a7ad1640 1 Processor -- start 2023-06-10T19:02:06.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.859+0000 7f56a7ad1640 1 -- start start 2023-06-10T19:02:06.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.859+0000 7f56a7ad1640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f56a00b3ac0 0x7f56a00b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:06.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.859+0000 7f56a7ad1640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f56a00d14c0 0x7f56a015fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:06.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.859+0000 7f56a7ad1640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56a00d0020 con 0x7f56a00cc690 2023-06-10T19:02:06.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.859+0000 7f56a7ad1640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56a00b43d0 con 0x7f56a00b3ac0 2023-06-10T19:02:06.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.859+0000 7f56a7ad1640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56a00cef40 con 0x7f56a00d14c0 2023-06-10T19:02:06.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.859+0000 7f56a586d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f56a00b3ac0 0x7f56a00b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:06.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.859+0000 7f56a506c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f56a00cc690 0x7f56a015f370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:38966/0 (socket says 172.21.15.53:38966) 2023-06-10T19:02:06.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.859+0000 7f56a506c640 1 -- 172.21.15.53:0/1616006160 learned_addr learned my addr 172.21.15.53:0/1616006160 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:02:06.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.859+0000 7f56a606e640 1 --2- 172.21.15.53:0/1616006160 >> v2:172.21.15.117:3300/0 conn(0x7f56a00d14c0 0x7f56a015fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:06.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.859+0000 7f56a586d640 1 -- 172.21.15.53:0/1616006160 >> v2:172.21.15.117:3300/0 conn(0x7f56a00d14c0 msgr2=0x7f56a015fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:06.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.859+0000 7f56a586d640 1 --2- 172.21.15.53:0/1616006160 >> v2:172.21.15.117:3300/0 conn(0x7f56a00d14c0 0x7f56a015fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:06.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.859+0000 7f56a586d640 1 -- 172.21.15.53:0/1616006160 >> v1:172.21.15.53:6789/0 conn(0x7f56a00cc690 legacy=0x7f56a015f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:06.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.859+0000 7f56a486b640 1 -- 172.21.15.53:0/1616006160 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1699558602 0 0) 0x7f56a00d0020 con 0x7f56a00cc690 2023-06-10T19:02:06.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.859+0000 7f56a586d640 1 -- 172.21.15.53:0/1616006160 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56a00cf220 con 0x7f56a00b3ac0 2023-06-10T19:02:06.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.863+0000 7f56a586d640 1 --2- 172.21.15.53:0/1616006160 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56a00b3ac0 0x7f56a00b3e90 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f56a0160410 tx=0x7f569801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37ba00b94a23de95 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:06.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.863+0000 7f56a486b640 1 -- 172.21.15.53:0/1616006160 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56980ab600 con 0x7f56a00b3ac0 2023-06-10T19:02:06.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.863+0000 7f56a486b640 1 -- 172.21.15.53:0/1616006160 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56980a7050 con 0x7f56a00b3ac0 2023-06-10T19:02:06.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.863+0000 7f56a486b640 1 -- 172.21.15.53:0/1616006160 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56980ab980 con 0x7f56a00b3ac0 2023-06-10T19:02:06.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.863+0000 7f56a7ad1640 1 -- 172.21.15.53:0/1616006160 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56a00b3ac0 msgr2=0x7f56a00b3e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:06.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.863+0000 7f56a7ad1640 1 --2- 172.21.15.53:0/1616006160 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56a00b3ac0 0x7f56a00b3e90 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f56a0160410 tx=0x7f569801c430 comp rx=0 tx=0).stop 2023-06-10T19:02:06.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.863+0000 7f56a7ad1640 1 -- 172.21.15.53:0/1616006160 shutdown_connections 2023-06-10T19:02:06.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.863+0000 7f56a7ad1640 1 --2- 172.21.15.53:0/1616006160 >> v2:172.21.15.117:3300/0 conn(0x7f56a00d14c0 0x7f56a015fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:06.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.863+0000 7f56a7ad1640 1 --2- 172.21.15.53:0/1616006160 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56a00b3ac0 0x7f56a00b3e90 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:06.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.863+0000 7f56a7ad1640 1 -- 172.21.15.53:0/1616006160 >> 172.21.15.53:0/1616006160 conn(0x7f56a0071790 msgr2=0x7f56a0069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:06.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.863+0000 7f56a7ad1640 1 -- 172.21.15.53:0/1616006160 shutdown_connections 2023-06-10T19:02:06.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.863+0000 7f56a7ad1640 1 -- 172.21.15.53:0/1616006160 wait complete. 2023-06-10T19:02:06.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.863+0000 7f56a7ad1640 1 Processor -- start 2023-06-10T19:02:06.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.863+0000 7f56a7ad1640 1 -- start start 2023-06-10T19:02:06.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.867+0000 7f56a7ad1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f56a00b3ac0 0x7f56a01f4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:06.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.867+0000 7f56a7ad1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56a00cc690 0x7f56a0155710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:06.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.867+0000 7f56a7ad1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56a00d14c0 0x7f56a00c92a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:06.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.867+0000 7f56a7ad1640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56a015d3d0 con 0x7f56a00d14c0 2023-06-10T19:02:06.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.867+0000 7f56a7ad1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56a015c7e0 con 0x7f56a00b3ac0 2023-06-10T19:02:06.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.867+0000 7f56a7ad1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56a015caa0 con 0x7f56a00cc690 2023-06-10T19:02:06.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.867+0000 7f56a606e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56a00d14c0 0x7f56a00c92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:06.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.867+0000 7f56a606e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56a00d14c0 0x7f56a00c92a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37424/0 (socket says 172.21.15.53:37424) 2023-06-10T19:02:06.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.867+0000 7f56a606e640 1 -- 172.21.15.53:0/4094652528 learned_addr learned my addr 172.21.15.53:0/4094652528 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:06.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.867+0000 7f56a586d640 1 --2- 172.21.15.53:0/4094652528 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f56a00b3ac0 0x7f56a01f4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:06.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.867+0000 7f56a506c640 1 --2- 172.21.15.53:0/4094652528 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56a00cc690 0x7f56a0155710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:06.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.867+0000 7f56a606e640 1 -- 172.21.15.53:0/4094652528 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56a00cc690 msgr2=0x7f56a0155710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:06.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.867+0000 7f56a606e640 1 --2- 172.21.15.53:0/4094652528 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56a00cc690 0x7f56a0155710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:06.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.867+0000 7f56a606e640 1 -- 172.21.15.53:0/4094652528 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f56a00b3ac0 msgr2=0x7f56a01f4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:06.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.867+0000 7f56a606e640 1 --2- 172.21.15.53:0/4094652528 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f56a00b3ac0 0x7f56a01f4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:06.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.867+0000 7f56a606e640 1 -- 172.21.15.53:0/4094652528 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5698009420 con 0x7f56a00d14c0 2023-06-10T19:02:06.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.867+0000 7f56a606e640 1 --2- 172.21.15.53:0/4094652528 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56a00d14c0 0x7f56a00c92a0 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f5690007e40 tx=0x7f569000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:06.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.867+0000 7f569e7fc640 1 -- 172.21.15.53:0/4094652528 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5690014620 con 0x7f56a00d14c0 2023-06-10T19:02:06.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.867+0000 7f569e7fc640 1 -- 172.21.15.53:0/4094652528 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f569000ee90 con 0x7f56a00d14c0 2023-06-10T19:02:06.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.867+0000 7f56a7ad1640 1 -- 172.21.15.53:0/4094652528 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56a015cd80 con 0x7f56a00d14c0 2023-06-10T19:02:06.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.867+0000 7f569e7fc640 1 -- 172.21.15.53:0/4094652528 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56900149e0 con 0x7f56a00d14c0 2023-06-10T19:02:06.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.867+0000 7f56a7ad1640 1 -- 172.21.15.53:0/4094652528 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56a01f4590 con 0x7f56a00d14c0 2023-06-10T19:02:06.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.867+0000 7f56a7ad1640 1 -- 172.21.15.53:0/4094652528 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56a015d580 con 0x7f56a00d14c0 2023-06-10T19:02:06.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.867+0000 7f569e7fc640 1 -- 172.21.15.53:0/4094652528 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5690014b40 con 0x7f56a00d14c0 2023-06-10T19:02:06.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.867+0000 7f569e7fc640 1 --2- 172.21.15.53:0/4094652528 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f568c066280 0x7f568c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:06.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.867+0000 7f569e7fc640 1 -- 172.21.15.53:0/4094652528 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5690084730 con 0x7f56a00d14c0 2023-06-10T19:02:06.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.867+0000 7f56a586d640 1 --2- 172.21.15.53:0/4094652528 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f568c066280 0x7f568c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:06.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.871+0000 7f56a586d640 1 --2- 172.21.15.53:0/4094652528 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f568c066280 0x7f568c068730 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f56a008aa80 tx=0x7f56980a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:06.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:06.871+0000 7f569e7fc640 1 -- 172.21.15.53:0/4094652528 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5690051b20 con 0x7f56a00d14c0 2023-06-10T19:02:07.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.023+0000 7f56a7ad1640 1 -- 172.21.15.53:0/4094652528 --> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f56a00b7a20 con 0x7f568c066280 2023-06-10T19:02:07.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.047+0000 7f569e7fc640 1 -- 172.21.15.53:0/4094652528 <== mgr.4105 v2:172.21.15.117:6832/3061986771 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+309307 (secure 0 0 0) 0x7f56980bc090 con 0x7f568c066280 2023-06-10T19:02:07.051 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:02:07.053 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-06-10T19:02:07.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.051+0000 7f56a7ad1640 1 -- 172.21.15.53:0/4094652528 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f568c066280 msgr2=0x7f568c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:07.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.051+0000 7f56a7ad1640 1 --2- 172.21.15.53:0/4094652528 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f568c066280 0x7f568c068730 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f56a008aa80 tx=0x7f56980a6000 comp rx=0 tx=0).stop 2023-06-10T19:02:07.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.051+0000 7f56a7ad1640 1 -- 172.21.15.53:0/4094652528 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56a00d14c0 msgr2=0x7f56a00c92a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:07.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.051+0000 7f56a7ad1640 1 --2- 172.21.15.53:0/4094652528 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56a00d14c0 0x7f56a00c92a0 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f5690007e40 tx=0x7f569000e4b0 comp rx=0 tx=0).stop 2023-06-10T19:02:07.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.051+0000 7f56a7ad1640 1 -- 172.21.15.53:0/4094652528 shutdown_connections 2023-06-10T19:02:07.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.051+0000 7f56a7ad1640 1 --2- 172.21.15.53:0/4094652528 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f568c066280 0x7f568c068730 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:07.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.051+0000 7f56a7ad1640 1 --2- 172.21.15.53:0/4094652528 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56a00d14c0 0x7f56a00c92a0 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:07.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.051+0000 7f56a7ad1640 1 --2- 172.21.15.53:0/4094652528 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56a00cc690 0x7f56a0155710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:07.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.051+0000 7f56a7ad1640 1 --2- 172.21.15.53:0/4094652528 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f56a00b3ac0 0x7f56a01f4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:07.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.051+0000 7f56a7ad1640 1 -- 172.21.15.53:0/4094652528 >> 172.21.15.53:0/4094652528 conn(0x7f56a0071790 msgr2=0x7f56a00ce250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:07.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.051+0000 7f56a7ad1640 1 -- 172.21.15.53:0/4094652528 shutdown_connections 2023-06-10T19:02:07.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.051+0000 7f56a7ad1640 1 -- 172.21.15.53:0/4094652528 wait complete. 2023-06-10T19:02:07.069 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":374,"stamp":"2023-06-10T19:02:05.763460+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591838,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":202,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":27,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":258316,"kb_used_data":9932,"kb_used_omap":0,"kb_used_meta":248320,"kb_avail":754716404,"statfs":{"total":773094113280,"available":772829597696,"internally_reserved":0,"allocated":10170368,"data_stored":5252639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":254279680},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":60,"apply_latency_ms":60,"commit_latency_ns":60000000,"apply_latency_ns":60000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1470,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.509502"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.669171+0000","last_change":"2023-06-10T19:02:02.665348+0000","last_active":"2023-06-10T19:02:02.669171+0000","last_peered":"2023-06-10T19:02:02.669171+0000","last_clean":"2023-06-10T19:02:02.669171+0000","last_became_active":"2023-06-10T19:02:02.665052+0000","last_became_peered":"2023-06-10T19:02:02.665052+0000","last_unstale":"2023-06-10T19:02:02.669171+0000","last_undegraded":"2023-06-10T19:02:02.669171+0000","last_fullsized":"2023-06-10T19:02:02.669171+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:29:40.789452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.682118+0000","last_change":"2023-06-10T19:02:02.671565+0000","last_active":"2023-06-10T19:02:02.682118+0000","last_peered":"2023-06-10T19:02:02.682118+0000","last_clean":"2023-06-10T19:02:02.682118+0000","last_became_active":"2023-06-10T19:02:02.670788+0000","last_became_peered":"2023-06-10T19:02:02.670788+0000","last_unstale":"2023-06-10T19:02:02.682118+0000","last_undegraded":"2023-06-10T19:02:02.682118+0000","last_fullsized":"2023-06-10T19:02:02.682118+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:00:31.321984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":6,"reported_epoch":93,"state":"active","last_fresh":"2023-06-10T19:02:02.684122+0000","last_change":"2023-06-10T19:02:02.684069+0000","last_active":"2023-06-10T19:02:02.684122+0000","last_peered":"2023-06-10T19:02:02.684122+0000","last_clean":"2023-06-10T19:02:02.249926+0000","last_became_active":"2023-06-10T19:02:02.684069+0000","last_became_peered":"2023-06-10T19:02:02.684069+0000","last_unstale":"2023-06-10T19:02:02.684122+0000","last_undegraded":"2023-06-10T19:02:02.684122+0000","last_fullsized":"2023-06-10T19:02:02.684122+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:11:53.215763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":["3","4"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":3,"reported_epoch":93,"state":"creating+activating","last_fresh":"2023-06-10T19:02:02.661419+0000","last_change":"2023-06-10T19:02:02.661419+0000","last_active":"2023-06-10T19:02:02.249926+0000","last_peered":"2023-06-10T19:02:02.249926+0000","last_clean":"2023-06-10T19:02:02.249926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:02:02.661419+0000","last_undegraded":"2023-06-10T19:02:02.661419+0000","last_fullsized":"2023-06-10T19:02:02.661419+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:31:20.879352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":["1","6"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":3,"reported_epoch":93,"state":"creating+activating","last_fresh":"2023-06-10T19:02:02.657474+0000","last_change":"2023-06-10T19:02:02.657474+0000","last_active":"2023-06-10T19:02:02.249926+0000","last_peered":"2023-06-10T19:02:02.249926+0000","last_clean":"2023-06-10T19:02:02.249926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:02:02.657474+0000","last_undegraded":"2023-06-10T19:02:02.657474+0000","last_fullsized":"2023-06-10T19:02:02.657474+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:03:34.938582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":["4","6"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.675187+0000","last_change":"2023-06-10T19:02:02.673704+0000","last_active":"2023-06-10T19:02:02.675187+0000","last_peered":"2023-06-10T19:02:02.675187+0000","last_clean":"2023-06-10T19:02:02.675187+0000","last_became_active":"2023-06-10T19:02:02.673439+0000","last_became_peered":"2023-06-10T19:02:02.673439+0000","last_unstale":"2023-06-10T19:02:02.675187+0000","last_undegraded":"2023-06-10T19:02:02.675187+0000","last_fullsized":"2023-06-10T19:02:02.675187+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:06:44.533034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.695952+0000","last_change":"2023-06-10T19:02:02.695952+0000","last_active":"2023-06-10T19:02:02.695952+0000","last_peered":"2023-06-10T19:02:02.695952+0000","last_clean":"2023-06-10T19:02:02.695952+0000","last_became_active":"2023-06-10T19:02:02.695070+0000","last_became_peered":"2023-06-10T19:02:02.695070+0000","last_unstale":"2023-06-10T19:02:02.695952+0000","last_undegraded":"2023-06-10T19:02:02.695952+0000","last_fullsized":"2023-06-10T19:02:02.695952+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:37:04.857782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":3,"reported_epoch":93,"state":"creating+activating","last_fresh":"2023-06-10T19:02:02.659355+0000","last_change":"2023-06-10T19:02:02.659355+0000","last_active":"2023-06-10T19:02:02.249926+0000","last_peered":"2023-06-10T19:02:02.249926+0000","last_clean":"2023-06-10T19:02:02.249926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:02:02.659355+0000","last_undegraded":"2023-06-10T19:02:02.659355+0000","last_fullsized":"2023-06-10T19:02:02.659355+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:47:51.626220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":["1","7"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.680828+0000","last_change":"2023-06-10T19:02:02.680828+0000","last_active":"2023-06-10T19:02:02.680828+0000","last_peered":"2023-06-10T19:02:02.680828+0000","last_clean":"2023-06-10T19:02:02.680828+0000","last_became_active":"2023-06-10T19:02:02.680039+0000","last_became_peered":"2023-06-10T19:02:02.680039+0000","last_unstale":"2023-06-10T19:02:02.680828+0000","last_undegraded":"2023-06-10T19:02:02.680828+0000","last_fullsized":"2023-06-10T19:02:02.680828+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:24:00.414173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.666888+0000","last_change":"2023-06-10T19:02:02.665553+0000","last_active":"2023-06-10T19:02:02.666888+0000","last_peered":"2023-06-10T19:02:02.666888+0000","last_clean":"2023-06-10T19:02:02.666888+0000","last_became_active":"2023-06-10T19:02:02.665255+0000","last_became_peered":"2023-06-10T19:02:02.665255+0000","last_unstale":"2023-06-10T19:02:02.666888+0000","last_undegraded":"2023-06-10T19:02:02.666888+0000","last_fullsized":"2023-06-10T19:02:02.666888+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:01:36.281962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.683637+0000","last_change":"2023-06-10T19:02:02.683637+0000","last_active":"2023-06-10T19:02:02.683637+0000","last_peered":"2023-06-10T19:02:02.683637+0000","last_clean":"2023-06-10T19:02:02.683637+0000","last_became_active":"2023-06-10T19:02:02.682347+0000","last_became_peered":"2023-06-10T19:02:02.682347+0000","last_unstale":"2023-06-10T19:02:02.683637+0000","last_undegraded":"2023-06-10T19:02:02.683637+0000","last_fullsized":"2023-06-10T19:02:02.683637+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:43:54.501946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.672099+0000","last_change":"2023-06-10T19:02:02.670292+0000","last_active":"2023-06-10T19:02:02.672099+0000","last_peered":"2023-06-10T19:02:02.672099+0000","last_clean":"2023-06-10T19:02:02.672099+0000","last_became_active":"2023-06-10T19:02:02.670000+0000","last_became_peered":"2023-06-10T19:02:02.670000+0000","last_unstale":"2023-06-10T19:02:02.672099+0000","last_undegraded":"2023-06-10T19:02:02.672099+0000","last_fullsized":"2023-06-10T19:02:02.672099+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:11:24.917653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":3,"reported_epoch":93,"state":"creating+activating","last_fresh":"2023-06-10T19:02:02.659481+0000","last_change":"2023-06-10T19:02:02.659481+0000","last_active":"2023-06-10T19:02:02.249926+0000","last_peered":"2023-06-10T19:02:02.249926+0000","last_clean":"2023-06-10T19:02:02.249926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:02:02.659481+0000","last_undegraded":"2023-06-10T19:02:02.659481+0000","last_fullsized":"2023-06-10T19:02:02.659481+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:52:50.215857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":["1","7"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.685717+0000","last_change":"2023-06-10T19:02:02.685717+0000","last_active":"2023-06-10T19:02:02.685717+0000","last_peered":"2023-06-10T19:02:02.685717+0000","last_clean":"2023-06-10T19:02:02.685717+0000","last_became_active":"2023-06-10T19:02:02.685029+0000","last_became_peered":"2023-06-10T19:02:02.685029+0000","last_unstale":"2023-06-10T19:02:02.685717+0000","last_undegraded":"2023-06-10T19:02:02.685717+0000","last_fullsized":"2023-06-10T19:02:02.685717+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:26:09.337773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.678129+0000","last_change":"2023-06-10T19:02:02.672291+0000","last_active":"2023-06-10T19:02:02.678129+0000","last_peered":"2023-06-10T19:02:02.678129+0000","last_clean":"2023-06-10T19:02:02.678129+0000","last_became_active":"2023-06-10T19:02:02.672015+0000","last_became_peered":"2023-06-10T19:02:02.672015+0000","last_unstale":"2023-06-10T19:02:02.678129+0000","last_undegraded":"2023-06-10T19:02:02.678129+0000","last_fullsized":"2023-06-10T19:02:02.678129+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:40:40.525125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.674754+0000","last_change":"2023-06-10T19:02:02.672362+0000","last_active":"2023-06-10T19:02:02.674754+0000","last_peered":"2023-06-10T19:02:02.674754+0000","last_clean":"2023-06-10T19:02:02.674754+0000","last_became_active":"2023-06-10T19:02:02.672058+0000","last_became_peered":"2023-06-10T19:02:02.672058+0000","last_unstale":"2023-06-10T19:02:02.674754+0000","last_undegraded":"2023-06-10T19:02:02.674754+0000","last_fullsized":"2023-06-10T19:02:02.674754+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:31:04.035723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.671418+0000","last_change":"2023-06-10T19:02:02.667709+0000","last_active":"2023-06-10T19:02:02.671418+0000","last_peered":"2023-06-10T19:02:02.671418+0000","last_clean":"2023-06-10T19:02:02.671418+0000","last_became_active":"2023-06-10T19:02:02.667406+0000","last_became_peered":"2023-06-10T19:02:02.667406+0000","last_unstale":"2023-06-10T19:02:02.671418+0000","last_undegraded":"2023-06-10T19:02:02.671418+0000","last_fullsized":"2023-06-10T19:02:02.671418+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:33:34.138735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.670100+0000","last_change":"2023-06-10T19:02:02.668883+0000","last_active":"2023-06-10T19:02:02.670100+0000","last_peered":"2023-06-10T19:02:02.670100+0000","last_clean":"2023-06-10T19:02:02.670100+0000","last_became_active":"2023-06-10T19:02:02.668590+0000","last_became_peered":"2023-06-10T19:02:02.668590+0000","last_unstale":"2023-06-10T19:02:02.670100+0000","last_undegraded":"2023-06-10T19:02:02.670100+0000","last_fullsized":"2023-06-10T19:02:02.670100+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:53:17.016074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.699972+0000","last_change":"2023-06-10T19:02:02.699972+0000","last_active":"2023-06-10T19:02:02.699972+0000","last_peered":"2023-06-10T19:02:02.699972+0000","last_clean":"2023-06-10T19:02:02.699972+0000","last_became_active":"2023-06-10T19:02:02.699193+0000","last_became_peered":"2023-06-10T19:02:02.699193+0000","last_unstale":"2023-06-10T19:02:02.699972+0000","last_undegraded":"2023-06-10T19:02:02.699972+0000","last_fullsized":"2023-06-10T19:02:02.699972+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:57:42.325766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.675762+0000","last_change":"2023-06-10T19:02:02.671985+0000","last_active":"2023-06-10T19:02:02.675762+0000","last_peered":"2023-06-10T19:02:02.675762+0000","last_clean":"2023-06-10T19:02:02.675762+0000","last_became_active":"2023-06-10T19:02:02.671708+0000","last_became_peered":"2023-06-10T19:02:02.671708+0000","last_unstale":"2023-06-10T19:02:02.675762+0000","last_undegraded":"2023-06-10T19:02:02.675762+0000","last_fullsized":"2023-06-10T19:02:02.675762+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:00:44.753228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":6,"reported_epoch":93,"state":"active","last_fresh":"2023-06-10T19:02:02.700007+0000","last_change":"2023-06-10T19:02:02.699835+0000","last_active":"2023-06-10T19:02:02.700007+0000","last_peered":"2023-06-10T19:02:02.700007+0000","last_clean":"2023-06-10T19:02:02.249926+0000","last_became_active":"2023-06-10T19:02:02.699835+0000","last_became_peered":"2023-06-10T19:02:02.699835+0000","last_unstale":"2023-06-10T19:02:02.700007+0000","last_undegraded":"2023-06-10T19:02:02.700007+0000","last_fullsized":"2023-06-10T19:02:02.700007+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:32:47.372339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":["4","7"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.681477+0000","last_change":"2023-06-10T19:02:02.681477+0000","last_active":"2023-06-10T19:02:02.681477+0000","last_peered":"2023-06-10T19:02:02.681477+0000","last_clean":"2023-06-10T19:02:02.681477+0000","last_became_active":"2023-06-10T19:02:02.680610+0000","last_became_peered":"2023-06-10T19:02:02.680610+0000","last_unstale":"2023-06-10T19:02:02.681477+0000","last_undegraded":"2023-06-10T19:02:02.681477+0000","last_fullsized":"2023-06-10T19:02:02.681477+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:55:18.294198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":4,"reported_epoch":93,"state":"creating+activating","last_fresh":"2023-06-10T19:02:02.688412+0000","last_change":"2023-06-10T19:02:02.684696+0000","last_active":"2023-06-10T19:02:02.249926+0000","last_peered":"2023-06-10T19:02:02.249926+0000","last_clean":"2023-06-10T19:02:02.249926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:02:02.688412+0000","last_undegraded":"2023-06-10T19:02:02.688412+0000","last_fullsized":"2023-06-10T19:02:02.688412+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:11:53.215763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":["6","1"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.683119+0000","last_change":"2023-06-10T19:02:02.682530+0000","last_active":"2023-06-10T19:02:02.683119+0000","last_peered":"2023-06-10T19:02:02.683119+0000","last_clean":"2023-06-10T19:02:02.683119+0000","last_became_active":"2023-06-10T19:02:02.682004+0000","last_became_peered":"2023-06-10T19:02:02.682004+0000","last_unstale":"2023-06-10T19:02:02.683119+0000","last_undegraded":"2023-06-10T19:02:02.683119+0000","last_fullsized":"2023-06-10T19:02:02.683119+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:27:26.714581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":3,"reported_epoch":93,"state":"creating+activating","last_fresh":"2023-06-10T19:02:02.653940+0000","last_change":"2023-06-10T19:02:02.653940+0000","last_active":"2023-06-10T19:02:02.249926+0000","last_peered":"2023-06-10T19:02:02.249926+0000","last_clean":"2023-06-10T19:02:02.249926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:02:02.653940+0000","last_undegraded":"2023-06-10T19:02:02.653940+0000","last_fullsized":"2023-06-10T19:02:02.653940+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:07:43.322174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":["5","6"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.698521+0000","last_change":"2023-06-10T19:02:02.698521+0000","last_active":"2023-06-10T19:02:02.698521+0000","last_peered":"2023-06-10T19:02:02.698521+0000","last_clean":"2023-06-10T19:02:02.698521+0000","last_became_active":"2023-06-10T19:02:02.697781+0000","last_became_peered":"2023-06-10T19:02:02.697781+0000","last_unstale":"2023-06-10T19:02:02.698521+0000","last_undegraded":"2023-06-10T19:02:02.698521+0000","last_fullsized":"2023-06-10T19:02:02.698521+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:44:52.629437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":3,"reported_epoch":93,"state":"creating+activating","last_fresh":"2023-06-10T19:02:02.655425+0000","last_change":"2023-06-10T19:02:02.655425+0000","last_active":"2023-06-10T19:02:02.249926+0000","last_peered":"2023-06-10T19:02:02.249926+0000","last_clean":"2023-06-10T19:02:02.249926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:02:02.655425+0000","last_undegraded":"2023-06-10T19:02:02.655425+0000","last_fullsized":"2023-06-10T19:02:02.655425+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:36:26.678143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":["2","6"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":3,"reported_epoch":93,"state":"creating+activating","last_fresh":"2023-06-10T19:02:02.661225+0000","last_change":"2023-06-10T19:02:02.661225+0000","last_active":"2023-06-10T19:02:02.249926+0000","last_peered":"2023-06-10T19:02:02.249926+0000","last_clean":"2023-06-10T19:02:02.249926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:02:02.661225+0000","last_undegraded":"2023-06-10T19:02:02.661225+0000","last_fullsized":"2023-06-10T19:02:02.661225+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:20:57.647766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":["1","4"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":6,"reported_epoch":93,"state":"active","last_fresh":"2023-06-10T19:02:02.701356+0000","last_change":"2023-06-10T19:02:02.696178+0000","last_active":"2023-06-10T19:02:02.701356+0000","last_peered":"2023-06-10T19:02:02.701356+0000","last_clean":"2023-06-10T19:02:02.249926+0000","last_became_active":"2023-06-10T19:02:02.696178+0000","last_became_peered":"2023-06-10T19:02:02.696178+0000","last_unstale":"2023-06-10T19:02:02.701356+0000","last_undegraded":"2023-06-10T19:02:02.701356+0000","last_fullsized":"2023-06-10T19:02:02.701356+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:33:48.265078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":["7","2"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.681746+0000","last_change":"2023-06-10T19:02:02.681746+0000","last_active":"2023-06-10T19:02:02.681746+0000","last_peered":"2023-06-10T19:02:02.681746+0000","last_clean":"2023-06-10T19:02:02.681746+0000","last_became_active":"2023-06-10T19:02:02.678889+0000","last_became_peered":"2023-06-10T19:02:02.678889+0000","last_unstale":"2023-06-10T19:02:02.681746+0000","last_undegraded":"2023-06-10T19:02:02.681746+0000","last_fullsized":"2023-06-10T19:02:02.681746+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:17:32.462150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.682120+0000","last_change":"2023-06-10T19:02:02.666485+0000","last_active":"2023-06-10T19:02:02.682120+0000","last_peered":"2023-06-10T19:02:02.682120+0000","last_clean":"2023-06-10T19:02:02.682120+0000","last_became_active":"2023-06-10T19:02:02.665650+0000","last_became_peered":"2023-06-10T19:02:02.665650+0000","last_unstale":"2023-06-10T19:02:02.682120+0000","last_undegraded":"2023-06-10T19:02:02.682120+0000","last_fullsized":"2023-06-10T19:02:02.682120+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:22:27.373589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.672704+0000","last_change":"2023-06-10T19:02:02.668274+0000","last_active":"2023-06-10T19:02:02.672704+0000","last_peered":"2023-06-10T19:02:02.672704+0000","last_clean":"2023-06-10T19:02:02.672704+0000","last_became_active":"2023-06-10T19:02:02.668009+0000","last_became_peered":"2023-06-10T19:02:02.668009+0000","last_unstale":"2023-06-10T19:02:02.672704+0000","last_undegraded":"2023-06-10T19:02:02.672704+0000","last_fullsized":"2023-06-10T19:02:02.672704+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:06:19.466195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.681658+0000","last_change":"2023-06-10T19:02:02.680375+0000","last_active":"2023-06-10T19:02:02.681658+0000","last_peered":"2023-06-10T19:02:02.681658+0000","last_clean":"2023-06-10T19:02:02.681658+0000","last_became_active":"2023-06-10T19:02:02.680094+0000","last_became_peered":"2023-06-10T19:02:02.680094+0000","last_unstale":"2023-06-10T19:02:02.681658+0000","last_undegraded":"2023-06-10T19:02:02.681658+0000","last_fullsized":"2023-06-10T19:02:02.681658+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:42:19.372587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"93'4","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.691765+0000","last_change":"2023-06-10T19:02:02.307615+0000","last_active":"2023-06-10T19:02:02.691765+0000","last_peered":"2023-06-10T19:02:02.691765+0000","last_clean":"2023-06-10T19:02:02.691765+0000","last_became_active":"2023-06-10T19:02:02.306543+0000","last_became_peered":"2023-06-10T19:02:02.306543+0000","last_unstale":"2023-06-10T19:02:02.691765+0000","last_undegraded":"2023-06-10T19:02:02.691765+0000","last_fullsized":"2023-06-10T19:02:02.691765+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:10:52.708577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.669093+0000","last_change":"2023-06-10T19:02:02.662624+0000","last_active":"2023-06-10T19:02:02.669093+0000","last_peered":"2023-06-10T19:02:02.669093+0000","last_clean":"2023-06-10T19:02:02.669093+0000","last_became_active":"2023-06-10T19:02:02.662135+0000","last_became_peered":"2023-06-10T19:02:02.662135+0000","last_unstale":"2023-06-10T19:02:02.669093+0000","last_undegraded":"2023-06-10T19:02:02.669093+0000","last_fullsized":"2023-06-10T19:02:02.669093+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:14:40.833061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.662673+0000","last_change":"2023-06-10T19:02:02.308152+0000","last_active":"2023-06-10T19:02:02.662673+0000","last_peered":"2023-06-10T19:02:02.662673+0000","last_clean":"2023-06-10T19:02:02.662673+0000","last_became_active":"2023-06-10T19:02:02.307326+0000","last_became_peered":"2023-06-10T19:02:02.307326+0000","last_unstale":"2023-06-10T19:02:02.662673+0000","last_undegraded":"2023-06-10T19:02:02.662673+0000","last_fullsized":"2023-06-10T19:02:02.662673+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:49:52.268993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.698529+0000","last_change":"2023-06-10T19:02:02.698529+0000","last_active":"2023-06-10T19:02:02.698529+0000","last_peered":"2023-06-10T19:02:02.698529+0000","last_clean":"2023-06-10T19:02:02.698529+0000","last_became_active":"2023-06-10T19:02:02.697828+0000","last_became_peered":"2023-06-10T19:02:02.697828+0000","last_unstale":"2023-06-10T19:02:02.698529+0000","last_undegraded":"2023-06-10T19:02:02.698529+0000","last_fullsized":"2023-06-10T19:02:02.698529+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:33:31.316563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"93'2","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.674605+0000","last_change":"2023-06-10T19:02:02.298653+0000","last_active":"2023-06-10T19:02:02.674605+0000","last_peered":"2023-06-10T19:02:02.674605+0000","last_clean":"2023-06-10T19:02:02.674605+0000","last_became_active":"2023-06-10T19:02:02.297891+0000","last_became_peered":"2023-06-10T19:02:02.297891+0000","last_unstale":"2023-06-10T19:02:02.674605+0000","last_undegraded":"2023-06-10T19:02:02.674605+0000","last_fullsized":"2023-06-10T19:02:02.674605+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:53:23.935997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":3,"reported_epoch":93,"state":"creating+activating","last_fresh":"2023-06-10T19:02:02.650584+0000","last_change":"2023-06-10T19:02:02.650584+0000","last_active":"2023-06-10T19:02:02.249926+0000","last_peered":"2023-06-10T19:02:02.249926+0000","last_clean":"2023-06-10T19:02:02.249926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:02:02.650584+0000","last_undegraded":"2023-06-10T19:02:02.650584+0000","last_fullsized":"2023-06-10T19:02:02.650584+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:20:12.939183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":["0","6"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"93'2","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.691249+0000","last_change":"2023-06-10T19:02:02.309210+0000","last_active":"2023-06-10T19:02:02.691249+0000","last_peered":"2023-06-10T19:02:02.691249+0000","last_clean":"2023-06-10T19:02:02.691249+0000","last_became_active":"2023-06-10T19:02:02.307262+0000","last_became_peered":"2023-06-10T19:02:02.307262+0000","last_unstale":"2023-06-10T19:02:02.691249+0000","last_undegraded":"2023-06-10T19:02:02.691249+0000","last_fullsized":"2023-06-10T19:02:02.691249+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:53:16.012428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.678306+0000","last_change":"2023-06-10T19:02:02.675152+0000","last_active":"2023-06-10T19:02:02.678306+0000","last_peered":"2023-06-10T19:02:02.678306+0000","last_clean":"2023-06-10T19:02:02.678306+0000","last_became_active":"2023-06-10T19:02:02.672817+0000","last_became_peered":"2023-06-10T19:02:02.672817+0000","last_unstale":"2023-06-10T19:02:02.678306+0000","last_undegraded":"2023-06-10T19:02:02.678306+0000","last_fullsized":"2023-06-10T19:02:02.678306+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:43:35.825854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"93'1","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.697572+0000","last_change":"2023-06-10T19:02:02.285398+0000","last_active":"2023-06-10T19:02:02.697572+0000","last_peered":"2023-06-10T19:02:02.697572+0000","last_clean":"2023-06-10T19:02:02.697572+0000","last_became_active":"2023-06-10T19:02:02.284766+0000","last_became_peered":"2023-06-10T19:02:02.284766+0000","last_unstale":"2023-06-10T19:02:02.697572+0000","last_undegraded":"2023-06-10T19:02:02.697572+0000","last_fullsized":"2023-06-10T19:02:02.697572+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:35:48.643951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":4,"reported_epoch":93,"state":"creating+activating","last_fresh":"2023-06-10T19:02:02.687783+0000","last_change":"2023-06-10T19:02:02.684502+0000","last_active":"2023-06-10T19:02:02.249926+0000","last_peered":"2023-06-10T19:02:02.249926+0000","last_clean":"2023-06-10T19:02:02.249926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:02:02.687783+0000","last_undegraded":"2023-06-10T19:02:02.687783+0000","last_fullsized":"2023-06-10T19:02:02.687783+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:34:43.072692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":["6","0"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"93'1","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.675575+0000","last_change":"2023-06-10T19:02:02.280702+0000","last_active":"2023-06-10T19:02:02.675575+0000","last_peered":"2023-06-10T19:02:02.675575+0000","last_clean":"2023-06-10T19:02:02.675575+0000","last_became_active":"2023-06-10T19:02:02.280060+0000","last_became_peered":"2023-06-10T19:02:02.280060+0000","last_unstale":"2023-06-10T19:02:02.675575+0000","last_undegraded":"2023-06-10T19:02:02.675575+0000","last_fullsized":"2023-06-10T19:02:02.675575+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:42:06.945432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.677557+0000","last_change":"2023-06-10T19:02:02.676743+0000","last_active":"2023-06-10T19:02:02.677557+0000","last_peered":"2023-06-10T19:02:02.677557+0000","last_clean":"2023-06-10T19:02:02.677557+0000","last_became_active":"2023-06-10T19:02:02.676452+0000","last_became_peered":"2023-06-10T19:02:02.676452+0000","last_unstale":"2023-06-10T19:02:02.677557+0000","last_undegraded":"2023-06-10T19:02:02.677557+0000","last_fullsized":"2023-06-10T19:02:02.677557+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:40:33.473940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.658568+0000","last_change":"2023-06-10T19:02:02.291503+0000","last_active":"2023-06-10T19:02:02.658568+0000","last_peered":"2023-06-10T19:02:02.658568+0000","last_clean":"2023-06-10T19:02:02.658568+0000","last_became_active":"2023-06-10T19:02:02.291257+0000","last_became_peered":"2023-06-10T19:02:02.291257+0000","last_unstale":"2023-06-10T19:02:02.658568+0000","last_undegraded":"2023-06-10T19:02:02.658568+0000","last_fullsized":"2023-06-10T19:02:02.658568+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:10:52.708577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":3,"reported_epoch":93,"state":"creating+activating","last_fresh":"2023-06-10T19:02:02.659597+0000","last_change":"2023-06-10T19:02:02.659597+0000","last_active":"2023-06-10T19:02:02.249926+0000","last_peered":"2023-06-10T19:02:02.249926+0000","last_clean":"2023-06-10T19:02:02.249926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:02:02.659597+0000","last_undegraded":"2023-06-10T19:02:02.659597+0000","last_fullsized":"2023-06-10T19:02:02.659597+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:28:01.941970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":["1","6"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.671489+0000","last_change":"2023-06-10T19:02:02.298471+0000","last_active":"2023-06-10T19:02:02.671489+0000","last_peered":"2023-06-10T19:02:02.671489+0000","last_clean":"2023-06-10T19:02:02.671489+0000","last_became_active":"2023-06-10T19:02:02.297847+0000","last_became_peered":"2023-06-10T19:02:02.297847+0000","last_unstale":"2023-06-10T19:02:02.671489+0000","last_undegraded":"2023-06-10T19:02:02.671489+0000","last_fullsized":"2023-06-10T19:02:02.671489+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:22:24.304786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.699437+0000","last_change":"2023-06-10T19:02:02.699437+0000","last_active":"2023-06-10T19:02:02.699437+0000","last_peered":"2023-06-10T19:02:02.699437+0000","last_clean":"2023-06-10T19:02:02.699437+0000","last_became_active":"2023-06-10T19:02:02.698803+0000","last_became_peered":"2023-06-10T19:02:02.698803+0000","last_unstale":"2023-06-10T19:02:02.699437+0000","last_undegraded":"2023-06-10T19:02:02.699437+0000","last_fullsized":"2023-06-10T19:02:02.699437+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:22:04.513117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.656570+0000","last_change":"2023-06-10T19:02:02.293125+0000","last_active":"2023-06-10T19:02:02.656570+0000","last_peered":"2023-06-10T19:02:02.656570+0000","last_clean":"2023-06-10T19:02:02.656570+0000","last_became_active":"2023-06-10T19:02:02.292366+0000","last_became_peered":"2023-06-10T19:02:02.292366+0000","last_unstale":"2023-06-10T19:02:02.656570+0000","last_undegraded":"2023-06-10T19:02:02.656570+0000","last_fullsized":"2023-06-10T19:02:02.656570+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:29:48.947745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":3,"reported_epoch":93,"state":"creating+activating","last_fresh":"2023-06-10T19:02:02.673955+0000","last_change":"2023-06-10T19:02:02.673955+0000","last_active":"2023-06-10T19:02:02.249926+0000","last_peered":"2023-06-10T19:02:02.249926+0000","last_clean":"2023-06-10T19:02:02.249926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:02:02.673955+0000","last_undegraded":"2023-06-10T19:02:02.673955+0000","last_fullsized":"2023-06-10T19:02:02.673955+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:28:08.816029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":["7","4"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.655755+0000","last_change":"2023-06-10T19:02:02.286161+0000","last_active":"2023-06-10T19:02:02.655755+0000","last_peered":"2023-06-10T19:02:02.655755+0000","last_clean":"2023-06-10T19:02:02.655755+0000","last_became_active":"2023-06-10T19:02:02.285856+0000","last_became_peered":"2023-06-10T19:02:02.285856+0000","last_unstale":"2023-06-10T19:02:02.655755+0000","last_undegraded":"2023-06-10T19:02:02.655755+0000","last_fullsized":"2023-06-10T19:02:02.655755+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:24:38.099052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.669041+0000","last_change":"2023-06-10T19:02:02.665868+0000","last_active":"2023-06-10T19:02:02.669041+0000","last_peered":"2023-06-10T19:02:02.669041+0000","last_clean":"2023-06-10T19:02:02.669041+0000","last_became_active":"2023-06-10T19:02:02.665665+0000","last_became_peered":"2023-06-10T19:02:02.665665+0000","last_unstale":"2023-06-10T19:02:02.669041+0000","last_undegraded":"2023-06-10T19:02:02.669041+0000","last_fullsized":"2023-06-10T19:02:02.669041+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:58:45.386899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"93'3","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.698138+0000","last_change":"2023-06-10T19:02:02.294019+0000","last_active":"2023-06-10T19:02:02.698138+0000","last_peered":"2023-06-10T19:02:02.698138+0000","last_clean":"2023-06-10T19:02:02.698138+0000","last_became_active":"2023-06-10T19:02:02.293205+0000","last_became_peered":"2023-06-10T19:02:02.293205+0000","last_unstale":"2023-06-10T19:02:02.698138+0000","last_undegraded":"2023-06-10T19:02:02.698138+0000","last_fullsized":"2023-06-10T19:02:02.698138+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:04:37.882090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.681206+0000","last_change":"2023-06-10T19:02:02.680173+0000","last_active":"2023-06-10T19:02:02.681206+0000","last_peered":"2023-06-10T19:02:02.681206+0000","last_clean":"2023-06-10T19:02:02.681206+0000","last_became_active":"2023-06-10T19:02:02.679854+0000","last_became_peered":"2023-06-10T19:02:02.679854+0000","last_unstale":"2023-06-10T19:02:02.681206+0000","last_undegraded":"2023-06-10T19:02:02.681206+0000","last_fullsized":"2023-06-10T19:02:02.681206+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:21:52.001634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"93'5","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.650293+0000","last_change":"2023-06-10T19:02:02.310650+0000","last_active":"2023-06-10T19:02:02.650293+0000","last_peered":"2023-06-10T19:02:02.650293+0000","last_clean":"2023-06-10T19:02:02.650293+0000","last_became_active":"2023-06-10T19:02:02.310205+0000","last_became_peered":"2023-06-10T19:02:02.310205+0000","last_unstale":"2023-06-10T19:02:02.650293+0000","last_undegraded":"2023-06-10T19:02:02.650293+0000","last_fullsized":"2023-06-10T19:02:02.650293+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:42:24.597366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":3,"reported_epoch":93,"state":"creating+activating","last_fresh":"2023-06-10T19:02:02.659786+0000","last_change":"2023-06-10T19:02:02.659786+0000","last_active":"2023-06-10T19:02:02.249926+0000","last_peered":"2023-06-10T19:02:02.249926+0000","last_clean":"2023-06-10T19:02:02.249926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:02:02.659786+0000","last_undegraded":"2023-06-10T19:02:02.659786+0000","last_fullsized":"2023-06-10T19:02:02.659786+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:52:33.909329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":["1","7"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"93'2","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.674343+0000","last_change":"2023-06-10T19:02:02.298494+0000","last_active":"2023-06-10T19:02:02.674343+0000","last_peered":"2023-06-10T19:02:02.674343+0000","last_clean":"2023-06-10T19:02:02.674343+0000","last_became_active":"2023-06-10T19:02:02.298008+0000","last_became_peered":"2023-06-10T19:02:02.298008+0000","last_unstale":"2023-06-10T19:02:02.674343+0000","last_undegraded":"2023-06-10T19:02:02.674343+0000","last_fullsized":"2023-06-10T19:02:02.674343+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:26:51.452323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":3,"reported_epoch":93,"state":"creating+activating","last_fresh":"2023-06-10T19:02:02.659742+0000","last_change":"2023-06-10T19:02:02.659742+0000","last_active":"2023-06-10T19:02:02.249926+0000","last_peered":"2023-06-10T19:02:02.249926+0000","last_clean":"2023-06-10T19:02:02.249926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:02:02.659742+0000","last_undegraded":"2023-06-10T19:02:02.659742+0000","last_fullsized":"2023-06-10T19:02:02.659742+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:13:21.429650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":["4","6"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.650314+0000","last_change":"2023-06-10T19:02:02.297466+0000","last_active":"2023-06-10T19:02:02.650314+0000","last_peered":"2023-06-10T19:02:02.650314+0000","last_clean":"2023-06-10T19:02:02.650314+0000","last_became_active":"2023-06-10T19:02:02.297118+0000","last_became_peered":"2023-06-10T19:02:02.297118+0000","last_unstale":"2023-06-10T19:02:02.650314+0000","last_undegraded":"2023-06-10T19:02:02.650314+0000","last_fullsized":"2023-06-10T19:02:02.650314+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:02:26.409776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.677300+0000","last_change":"2023-06-10T19:02:02.676309+0000","last_active":"2023-06-10T19:02:02.677300+0000","last_peered":"2023-06-10T19:02:02.677300+0000","last_clean":"2023-06-10T19:02:02.677300+0000","last_became_active":"2023-06-10T19:02:02.676005+0000","last_became_peered":"2023-06-10T19:02:02.676005+0000","last_unstale":"2023-06-10T19:02:02.677300+0000","last_undegraded":"2023-06-10T19:02:02.677300+0000","last_fullsized":"2023-06-10T19:02:02.677300+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:31:23.514936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.661968+0000","last_change":"2023-06-10T19:02:02.309000+0000","last_active":"2023-06-10T19:02:02.661968+0000","last_peered":"2023-06-10T19:02:02.661968+0000","last_clean":"2023-06-10T19:02:02.661968+0000","last_became_active":"2023-06-10T19:02:02.308410+0000","last_became_peered":"2023-06-10T19:02:02.308410+0000","last_unstale":"2023-06-10T19:02:02.661968+0000","last_undegraded":"2023-06-10T19:02:02.661968+0000","last_fullsized":"2023-06-10T19:02:02.661968+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:05:00.965851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":3,"reported_epoch":93,"state":"creating+activating","last_fresh":"2023-06-10T19:02:02.654118+0000","last_change":"2023-06-10T19:02:02.654118+0000","last_active":"2023-06-10T19:02:02.249926+0000","last_peered":"2023-06-10T19:02:02.249926+0000","last_clean":"2023-06-10T19:02:02.249926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:02:02.654118+0000","last_undegraded":"2023-06-10T19:02:02.654118+0000","last_fullsized":"2023-06-10T19:02:02.654118+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:41:19.173789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":["2","4"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"93'8","reported_seq":19,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.676823+0000","last_change":"2023-06-10T19:02:02.281076+0000","last_active":"2023-06-10T19:02:02.676823+0000","last_peered":"2023-06-10T19:02:02.676823+0000","last_clean":"2023-06-10T19:02:02.676823+0000","last_became_active":"2023-06-10T19:02:02.280784+0000","last_became_peered":"2023-06-10T19:02:02.280784+0000","last_unstale":"2023-06-10T19:02:02.676823+0000","last_undegraded":"2023-06-10T19:02:02.676823+0000","last_fullsized":"2023-06-10T19:02:02.676823+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:52:28.532909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":3,"reported_epoch":93,"state":"creating+activating","last_fresh":"2023-06-10T19:02:02.684672+0000","last_change":"2023-06-10T19:02:02.684672+0000","last_active":"2023-06-10T19:02:02.249926+0000","last_peered":"2023-06-10T19:02:02.249926+0000","last_clean":"2023-06-10T19:02:02.249926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:02:02.684672+0000","last_undegraded":"2023-06-10T19:02:02.684672+0000","last_fullsized":"2023-06-10T19:02:02.684672+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:48:21.883343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":["6","7"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"93'2","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.677238+0000","last_change":"2023-06-10T19:02:02.310148+0000","last_active":"2023-06-10T19:02:02.677238+0000","last_peered":"2023-06-10T19:02:02.677238+0000","last_clean":"2023-06-10T19:02:02.677238+0000","last_became_active":"2023-06-10T19:02:02.309423+0000","last_became_peered":"2023-06-10T19:02:02.309423+0000","last_unstale":"2023-06-10T19:02:02.677238+0000","last_undegraded":"2023-06-10T19:02:02.677238+0000","last_fullsized":"2023-06-10T19:02:02.677238+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:53:30.670784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.686338+0000","last_change":"2023-06-10T19:02:02.685473+0000","last_active":"2023-06-10T19:02:02.686338+0000","last_peered":"2023-06-10T19:02:02.686338+0000","last_clean":"2023-06-10T19:02:02.686338+0000","last_became_active":"2023-06-10T19:02:02.685192+0000","last_became_peered":"2023-06-10T19:02:02.685192+0000","last_unstale":"2023-06-10T19:02:02.686338+0000","last_undegraded":"2023-06-10T19:02:02.686338+0000","last_fullsized":"2023-06-10T19:02:02.686338+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:40:55.001540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.662921+0000","last_change":"2023-06-10T19:02:02.292855+0000","last_active":"2023-06-10T19:02:02.662921+0000","last_peered":"2023-06-10T19:02:02.662921+0000","last_clean":"2023-06-10T19:02:02.662921+0000","last_became_active":"2023-06-10T19:02:02.291984+0000","last_became_peered":"2023-06-10T19:02:02.291984+0000","last_unstale":"2023-06-10T19:02:02.662921+0000","last_undegraded":"2023-06-10T19:02:02.662921+0000","last_fullsized":"2023-06-10T19:02:02.662921+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:12:14.528079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.667098+0000","last_change":"2023-06-10T19:02:02.662196+0000","last_active":"2023-06-10T19:02:02.667098+0000","last_peered":"2023-06-10T19:02:02.667098+0000","last_clean":"2023-06-10T19:02:02.667098+0000","last_became_active":"2023-06-10T19:02:02.661887+0000","last_became_peered":"2023-06-10T19:02:02.661887+0000","last_unstale":"2023-06-10T19:02:02.667098+0000","last_undegraded":"2023-06-10T19:02:02.667098+0000","last_fullsized":"2023-06-10T19:02:02.667098+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:49:47.303424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.673305+0000","last_change":"2023-06-10T19:02:02.289260+0000","last_active":"2023-06-10T19:02:02.673305+0000","last_peered":"2023-06-10T19:02:02.673305+0000","last_clean":"2023-06-10T19:02:02.673305+0000","last_became_active":"2023-06-10T19:02:02.288017+0000","last_became_peered":"2023-06-10T19:02:02.288017+0000","last_unstale":"2023-06-10T19:02:02.673305+0000","last_undegraded":"2023-06-10T19:02:02.673305+0000","last_fullsized":"2023-06-10T19:02:02.673305+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:51:50.500411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.692335+0000","last_change":"2023-06-10T19:02:02.686971+0000","last_active":"2023-06-10T19:02:02.692335+0000","last_peered":"2023-06-10T19:02:02.692335+0000","last_clean":"2023-06-10T19:02:02.692335+0000","last_became_active":"2023-06-10T19:02:02.682303+0000","last_became_peered":"2023-06-10T19:02:02.682303+0000","last_unstale":"2023-06-10T19:02:02.692335+0000","last_undegraded":"2023-06-10T19:02:02.692335+0000","last_fullsized":"2023-06-10T19:02:02.692335+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:41:22.771429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.691399+0000","last_change":"2023-06-10T19:02:02.307602+0000","last_active":"2023-06-10T19:02:02.691399+0000","last_peered":"2023-06-10T19:02:02.691399+0000","last_clean":"2023-06-10T19:02:02.691399+0000","last_became_active":"2023-06-10T19:02:02.306340+0000","last_became_peered":"2023-06-10T19:02:02.306340+0000","last_unstale":"2023-06-10T19:02:02.691399+0000","last_undegraded":"2023-06-10T19:02:02.691399+0000","last_fullsized":"2023-06-10T19:02:02.691399+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:36:15.254045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.672236+0000","last_change":"2023-06-10T19:02:02.670591+0000","last_active":"2023-06-10T19:02:02.672236+0000","last_peered":"2023-06-10T19:02:02.672236+0000","last_clean":"2023-06-10T19:02:02.672236+0000","last_became_active":"2023-06-10T19:02:02.670311+0000","last_became_peered":"2023-06-10T19:02:02.670311+0000","last_unstale":"2023-06-10T19:02:02.672236+0000","last_undegraded":"2023-06-10T19:02:02.672236+0000","last_fullsized":"2023-06-10T19:02:02.672236+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:42:05.486292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.650842+0000","last_change":"2023-06-10T19:02:02.297604+0000","last_active":"2023-06-10T19:02:02.650842+0000","last_peered":"2023-06-10T19:02:02.650842+0000","last_clean":"2023-06-10T19:02:02.650842+0000","last_became_active":"2023-06-10T19:02:02.297290+0000","last_became_peered":"2023-06-10T19:02:02.297290+0000","last_unstale":"2023-06-10T19:02:02.650842+0000","last_undegraded":"2023-06-10T19:02:02.650842+0000","last_fullsized":"2023-06-10T19:02:02.650842+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:43:04.035379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.678108+0000","last_change":"2023-06-10T19:02:02.676849+0000","last_active":"2023-06-10T19:02:02.678108+0000","last_peered":"2023-06-10T19:02:02.678108+0000","last_clean":"2023-06-10T19:02:02.678108+0000","last_became_active":"2023-06-10T19:02:02.676586+0000","last_became_peered":"2023-06-10T19:02:02.676586+0000","last_unstale":"2023-06-10T19:02:02.678108+0000","last_undegraded":"2023-06-10T19:02:02.678108+0000","last_fullsized":"2023-06-10T19:02:02.678108+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:36:16.257691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.660986+0000","last_change":"2023-06-10T19:02:02.286569+0000","last_active":"2023-06-10T19:02:02.660986+0000","last_peered":"2023-06-10T19:02:02.660986+0000","last_clean":"2023-06-10T19:02:02.660986+0000","last_became_active":"2023-06-10T19:02:02.285744+0000","last_became_peered":"2023-06-10T19:02:02.285744+0000","last_unstale":"2023-06-10T19:02:02.660986+0000","last_undegraded":"2023-06-10T19:02:02.660986+0000","last_fullsized":"2023-06-10T19:02:02.660986+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:31:49.054392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":4,"reported_epoch":93,"state":"creating+activating","last_fresh":"2023-06-10T19:02:02.688613+0000","last_change":"2023-06-10T19:02:02.685700+0000","last_active":"2023-06-10T19:02:02.249926+0000","last_peered":"2023-06-10T19:02:02.249926+0000","last_clean":"2023-06-10T19:02:02.249926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:02:02.688613+0000","last_undegraded":"2023-06-10T19:02:02.688613+0000","last_fullsized":"2023-06-10T19:02:02.688613+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:58:45.386899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":["6","1"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.690800+0000","last_change":"2023-06-10T19:02:02.306818+0000","last_active":"2023-06-10T19:02:02.690800+0000","last_peered":"2023-06-10T19:02:02.690800+0000","last_clean":"2023-06-10T19:02:02.690800+0000","last_became_active":"2023-06-10T19:02:02.306128+0000","last_became_peered":"2023-06-10T19:02:02.306128+0000","last_unstale":"2023-06-10T19:02:02.690800+0000","last_undegraded":"2023-06-10T19:02:02.690800+0000","last_fullsized":"2023-06-10T19:02:02.690800+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:27:25.710935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.674707+0000","last_change":"2023-06-10T19:02:02.671837+0000","last_active":"2023-06-10T19:02:02.674707+0000","last_peered":"2023-06-10T19:02:02.674707+0000","last_clean":"2023-06-10T19:02:02.674707+0000","last_became_active":"2023-06-10T19:02:02.671536+0000","last_became_peered":"2023-06-10T19:02:02.671536+0000","last_unstale":"2023-06-10T19:02:02.674707+0000","last_undegraded":"2023-06-10T19:02:02.674707+0000","last_fullsized":"2023-06-10T19:02:02.674707+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:44:04.162930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.671827+0000","last_change":"2023-06-10T19:02:02.299831+0000","last_active":"2023-06-10T19:02:02.671827+0000","last_peered":"2023-06-10T19:02:02.671827+0000","last_clean":"2023-06-10T19:02:02.671827+0000","last_became_active":"2023-06-10T19:02:02.299041+0000","last_became_peered":"2023-06-10T19:02:02.299041+0000","last_unstale":"2023-06-10T19:02:02.671827+0000","last_undegraded":"2023-06-10T19:02:02.671827+0000","last_fullsized":"2023-06-10T19:02:02.671827+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:50:24.253165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":4,"reported_epoch":93,"state":"creating+activating","last_fresh":"2023-06-10T19:02:02.681390+0000","last_change":"2023-06-10T19:02:02.676482+0000","last_active":"2023-06-10T19:02:02.249926+0000","last_peered":"2023-06-10T19:02:02.249926+0000","last_clean":"2023-06-10T19:02:02.249926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:02:02.681390+0000","last_undegraded":"2023-06-10T19:02:02.681390+0000","last_fullsized":"2023-06-10T19:02:02.681390+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:38:21.898235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":["7","3"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.663683+0000","last_change":"2023-06-10T19:02:02.286969+0000","last_active":"2023-06-10T19:02:02.663683+0000","last_peered":"2023-06-10T19:02:02.663683+0000","last_clean":"2023-06-10T19:02:02.663683+0000","last_became_active":"2023-06-10T19:02:02.286247+0000","last_became_peered":"2023-06-10T19:02:02.286247+0000","last_unstale":"2023-06-10T19:02:02.663683+0000","last_undegraded":"2023-06-10T19:02:02.663683+0000","last_fullsized":"2023-06-10T19:02:02.663683+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:41:41.781956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":301,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.672339+0000","last_change":"2023-06-10T18:52:34.951528+0000","last_active":"2023-06-10T19:02:02.672339+0000","last_peered":"2023-06-10T19:02:02.672339+0000","last_clean":"2023-06-10T19:02:02.672339+0000","last_became_active":"2023-06-10T18:52:34.949099+0000","last_became_peered":"2023-06-10T18:52:34.949099+0000","last_unstale":"2023-06-10T19:02:02.672339+0000","last_undegraded":"2023-06-10T19:02:02.672339+0000","last_fullsized":"2023-06-10T19:02:02.672339+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_clean_scrub_stamp":"2023-06-10T18:52:33.633295+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:35:49.274025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":149,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.652580+0000","last_change":"2023-06-10T18:52:40.506384+0000","last_active":"2023-06-10T19:02:02.652580+0000","last_peered":"2023-06-10T19:02:02.652580+0000","last_clean":"2023-06-10T19:02:02.652580+0000","last_became_active":"2023-06-10T18:52:40.505701+0000","last_became_peered":"2023-06-10T18:52:40.505701+0000","last_unstale":"2023-06-10T19:02:02.652580+0000","last_undegraded":"2023-06-10T19:02:02.652580+0000","last_fullsized":"2023-06-10T19:02:02.652580+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:34:26.323306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.681638+0000","last_change":"2023-06-10T19:02:02.680269+0000","last_active":"2023-06-10T19:02:02.681638+0000","last_peered":"2023-06-10T19:02:02.681638+0000","last_clean":"2023-06-10T19:02:02.681638+0000","last_became_active":"2023-06-10T19:02:02.679987+0000","last_became_peered":"2023-06-10T19:02:02.679987+0000","last_unstale":"2023-06-10T19:02:02.681638+0000","last_undegraded":"2023-06-10T19:02:02.681638+0000","last_fullsized":"2023-06-10T19:02:02.681638+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:12:24.156196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.691387+0000","last_change":"2023-06-10T19:02:02.309267+0000","last_active":"2023-06-10T19:02:02.691387+0000","last_peered":"2023-06-10T19:02:02.691387+0000","last_clean":"2023-06-10T19:02:02.691387+0000","last_became_active":"2023-06-10T19:02:02.308404+0000","last_became_peered":"2023-06-10T19:02:02.308404+0000","last_unstale":"2023-06-10T19:02:02.691387+0000","last_undegraded":"2023-06-10T19:02:02.691387+0000","last_fullsized":"2023-06-10T19:02:02.691387+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:24:38.099052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":145,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.672039+0000","last_change":"2023-06-10T18:52:40.512015+0000","last_active":"2023-06-10T19:02:02.672039+0000","last_peered":"2023-06-10T19:02:02.672039+0000","last_clean":"2023-06-10T19:02:02.672039+0000","last_became_active":"2023-06-10T18:52:40.511382+0000","last_became_peered":"2023-06-10T18:52:40.511382+0000","last_unstale":"2023-06-10T19:02:02.672039+0000","last_undegraded":"2023-06-10T19:02:02.672039+0000","last_fullsized":"2023-06-10T19:02:02.672039+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:28:15.481245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":4,"reported_epoch":93,"state":"creating+activating","last_fresh":"2023-06-10T19:02:02.693760+0000","last_change":"2023-06-10T19:02:02.685058+0000","last_active":"2023-06-10T19:02:02.249926+0000","last_peered":"2023-06-10T19:02:02.249926+0000","last_clean":"2023-06-10T19:02:02.249926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:02:02.693760+0000","last_undegraded":"2023-06-10T19:02:02.693760+0000","last_fullsized":"2023-06-10T19:02:02.693760+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:29:40.789452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":["6","5"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"93'2","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.694954+0000","last_change":"2023-06-10T19:02:02.300090+0000","last_active":"2023-06-10T19:02:02.694954+0000","last_peered":"2023-06-10T19:02:02.694954+0000","last_clean":"2023-06-10T19:02:02.694954+0000","last_became_active":"2023-06-10T19:02:02.299285+0000","last_became_peered":"2023-06-10T19:02:02.299285+0000","last_unstale":"2023-06-10T19:02:02.694954+0000","last_undegraded":"2023-06-10T19:02:02.694954+0000","last_fullsized":"2023-06-10T19:02:02.694954+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:17:26.780651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":151,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.655794+0000","last_change":"2023-06-10T18:52:40.671725+0000","last_active":"2023-06-10T19:02:02.655794+0000","last_peered":"2023-06-10T19:02:02.655794+0000","last_clean":"2023-06-10T19:02:02.655794+0000","last_became_active":"2023-06-10T18:52:40.671442+0000","last_became_peered":"2023-06-10T18:52:40.671442+0000","last_unstale":"2023-06-10T19:02:02.655794+0000","last_undegraded":"2023-06-10T19:02:02.655794+0000","last_fullsized":"2023-06-10T19:02:02.655794+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:17:15.147758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.681135+0000","last_change":"2023-06-10T19:02:02.681135+0000","last_active":"2023-06-10T19:02:02.681135+0000","last_peered":"2023-06-10T19:02:02.681135+0000","last_clean":"2023-06-10T19:02:02.681135+0000","last_became_active":"2023-06-10T19:02:02.680233+0000","last_became_peered":"2023-06-10T19:02:02.680233+0000","last_unstale":"2023-06-10T19:02:02.681135+0000","last_undegraded":"2023-06-10T19:02:02.681135+0000","last_fullsized":"2023-06-10T19:02:02.681135+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:56:02.719475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.672960+0000","last_change":"2023-06-10T19:02:02.292614+0000","last_active":"2023-06-10T19:02:02.672960+0000","last_peered":"2023-06-10T19:02:02.672960+0000","last_clean":"2023-06-10T19:02:02.672960+0000","last_became_active":"2023-06-10T19:02:02.291916+0000","last_became_peered":"2023-06-10T19:02:02.291916+0000","last_unstale":"2023-06-10T19:02:02.672960+0000","last_undegraded":"2023-06-10T19:02:02.672960+0000","last_fullsized":"2023-06-10T19:02:02.672960+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:18:50.542343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":149,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.660908+0000","last_change":"2023-06-10T18:52:40.510258+0000","last_active":"2023-06-10T19:02:02.660908+0000","last_peered":"2023-06-10T19:02:02.660908+0000","last_clean":"2023-06-10T19:02:02.660908+0000","last_became_active":"2023-06-10T18:52:40.509560+0000","last_became_peered":"2023-06-10T18:52:40.509560+0000","last_unstale":"2023-06-10T19:02:02.660908+0000","last_undegraded":"2023-06-10T19:02:02.660908+0000","last_fullsized":"2023-06-10T19:02:02.660908+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:00:07.712002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.668295+0000","last_change":"2023-06-10T19:02:02.663696+0000","last_active":"2023-06-10T19:02:02.668295+0000","last_peered":"2023-06-10T19:02:02.668295+0000","last_clean":"2023-06-10T19:02:02.668295+0000","last_became_active":"2023-06-10T19:02:02.663441+0000","last_became_peered":"2023-06-10T19:02:02.663441+0000","last_unstale":"2023-06-10T19:02:02.668295+0000","last_undegraded":"2023-06-10T19:02:02.668295+0000","last_fullsized":"2023-06-10T19:02:02.668295+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:05:29.276794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"93'2","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.684478+0000","last_change":"2023-06-10T19:02:02.286757+0000","last_active":"2023-06-10T19:02:02.684478+0000","last_peered":"2023-06-10T19:02:02.684478+0000","last_clean":"2023-06-10T19:02:02.684478+0000","last_became_active":"2023-06-10T19:02:02.285950+0000","last_became_peered":"2023-06-10T19:02:02.285950+0000","last_unstale":"2023-06-10T19:02:02.684478+0000","last_undegraded":"2023-06-10T19:02:02.684478+0000","last_fullsized":"2023-06-10T19:02:02.684478+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:47:52.566821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":137,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.663766+0000","last_change":"2023-06-10T18:52:40.672266+0000","last_active":"2023-06-10T19:02:02.663766+0000","last_peered":"2023-06-10T19:02:02.663766+0000","last_clean":"2023-06-10T19:02:02.663766+0000","last_became_active":"2023-06-10T18:52:40.671966+0000","last_became_peered":"2023-06-10T18:52:40.671966+0000","last_unstale":"2023-06-10T19:02:02.663766+0000","last_undegraded":"2023-06-10T19:02:02.663766+0000","last_fullsized":"2023-06-10T19:02:02.663766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:23:30.112577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.682181+0000","last_change":"2023-06-10T19:02:02.670012+0000","last_active":"2023-06-10T19:02:02.682181+0000","last_peered":"2023-06-10T19:02:02.682181+0000","last_clean":"2023-06-10T19:02:02.682181+0000","last_became_active":"2023-06-10T19:02:02.669278+0000","last_became_peered":"2023-06-10T19:02:02.669278+0000","last_unstale":"2023-06-10T19:02:02.682181+0000","last_undegraded":"2023-06-10T19:02:02.682181+0000","last_fullsized":"2023-06-10T19:02:02.682181+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:18:57.746056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.656217+0000","last_change":"2023-06-10T19:02:02.281757+0000","last_active":"2023-06-10T19:02:02.656217+0000","last_peered":"2023-06-10T19:02:02.656217+0000","last_clean":"2023-06-10T19:02:02.656217+0000","last_became_active":"2023-06-10T19:02:02.281378+0000","last_became_peered":"2023-06-10T19:02:02.281378+0000","last_unstale":"2023-06-10T19:02:02.656217+0000","last_undegraded":"2023-06-10T19:02:02.656217+0000","last_fullsized":"2023-06-10T19:02:02.656217+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:06:06.568248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":145,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.674878+0000","last_change":"2023-06-10T18:52:40.671084+0000","last_active":"2023-06-10T19:02:02.674878+0000","last_peered":"2023-06-10T19:02:02.674878+0000","last_clean":"2023-06-10T19:02:02.674878+0000","last_became_active":"2023-06-10T18:52:40.670697+0000","last_became_peered":"2023-06-10T18:52:40.670697+0000","last_unstale":"2023-06-10T19:02:02.674878+0000","last_undegraded":"2023-06-10T19:02:02.674878+0000","last_fullsized":"2023-06-10T19:02:02.674878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:36:37.423072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.688793+0000","last_change":"2023-06-10T19:02:02.679941+0000","last_active":"2023-06-10T19:02:02.688793+0000","last_peered":"2023-06-10T19:02:02.688793+0000","last_clean":"2023-06-10T19:02:02.688793+0000","last_became_active":"2023-06-10T19:02:02.679209+0000","last_became_peered":"2023-06-10T19:02:02.679209+0000","last_unstale":"2023-06-10T19:02:02.688793+0000","last_undegraded":"2023-06-10T19:02:02.688793+0000","last_fullsized":"2023-06-10T19:02:02.688793+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:09:25.545048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.655021+0000","last_change":"2023-06-10T19:02:02.288468+0000","last_active":"2023-06-10T19:02:02.655021+0000","last_peered":"2023-06-10T19:02:02.655021+0000","last_clean":"2023-06-10T19:02:02.655021+0000","last_became_active":"2023-06-10T19:02:02.287678+0000","last_became_peered":"2023-06-10T19:02:02.287678+0000","last_unstale":"2023-06-10T19:02:02.655021+0000","last_undegraded":"2023-06-10T19:02:02.655021+0000","last_fullsized":"2023-06-10T19:02:02.655021+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:06:24.821830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":137,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.663764+0000","last_change":"2023-06-10T18:52:40.514114+0000","last_active":"2023-06-10T19:02:02.663764+0000","last_peered":"2023-06-10T19:02:02.663764+0000","last_clean":"2023-06-10T19:02:02.663764+0000","last_became_active":"2023-06-10T18:52:40.513638+0000","last_became_peered":"2023-06-10T18:52:40.513638+0000","last_unstale":"2023-06-10T19:02:02.663764+0000","last_undegraded":"2023-06-10T19:02:02.663764+0000","last_fullsized":"2023-06-10T19:02:02.663764+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:34:10.418426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.666991+0000","last_change":"2023-06-10T19:02:02.661974+0000","last_active":"2023-06-10T19:02:02.666991+0000","last_peered":"2023-06-10T19:02:02.666991+0000","last_clean":"2023-06-10T19:02:02.666991+0000","last_became_active":"2023-06-10T19:02:02.661623+0000","last_became_peered":"2023-06-10T19:02:02.661623+0000","last_unstale":"2023-06-10T19:02:02.666991+0000","last_undegraded":"2023-06-10T19:02:02.666991+0000","last_fullsized":"2023-06-10T19:02:02.666991+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:53:04.166432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.656632+0000","last_change":"2023-06-10T19:02:02.294886+0000","last_active":"2023-06-10T19:02:02.656632+0000","last_peered":"2023-06-10T19:02:02.656632+0000","last_clean":"2023-06-10T19:02:02.656632+0000","last_became_active":"2023-06-10T19:02:02.294578+0000","last_became_peered":"2023-06-10T19:02:02.294578+0000","last_unstale":"2023-06-10T19:02:02.656632+0000","last_undegraded":"2023-06-10T19:02:02.656632+0000","last_fullsized":"2023-06-10T19:02:02.656632+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:33:34.686527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":145,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.691963+0000","last_change":"2023-06-10T18:52:40.515396+0000","last_active":"2023-06-10T19:02:02.691963+0000","last_peered":"2023-06-10T19:02:02.691963+0000","last_clean":"2023-06-10T19:02:02.691963+0000","last_became_active":"2023-06-10T18:52:40.514663+0000","last_became_peered":"2023-06-10T18:52:40.514663+0000","last_unstale":"2023-06-10T19:02:02.691963+0000","last_undegraded":"2023-06-10T19:02:02.691963+0000","last_fullsized":"2023-06-10T19:02:02.691963+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:42:42.732048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":1470,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":37,"ondisk_log_size":37,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574965,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32720,"kb_used_data":1672,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339120,"statfs":{"total":96636764160,"available":96603258880,"internally_reserved":0,"allocated":1712128,"data_stored":1096424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.94199999999999995,"15min":0.90300000000000002},"min":{"1min":0.63800000000000001,"5min":0.54700000000000004,"15min":0.434},"max":{"1min":1.196,"5min":1.327,"15min":1.6220000000000001},"last":1.0409999999999999},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.93000000000000005,"15min":0.92900000000000005},"min":{"1min":0.70999999999999996,"5min":0.496,"15min":0.496},"max":{"1min":1.149,"5min":1.264,"15min":1.6870000000000001},"last":1.002}]},{"osd":1,"last update":"Sat Jun 10 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.93200000000000005,"15min":0.92500000000000004},"min":{"1min":0.64700000000000002,"5min":0.54200000000000004,"15min":0.53900000000000003},"max":{"1min":1.238,"5min":1.262,"15min":1.377},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.97299999999999998,"15min":0.93600000000000005},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.504},"max":{"1min":1.1279999999999999,"5min":1.234,"15min":1.5960000000000001},"last":0.81100000000000005}]},{"osd":2,"last update":"Sat Jun 10 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.85599999999999998,"15min":0.83799999999999997},"min":{"1min":0.625,"5min":0.52100000000000002,"15min":0.47099999999999997},"max":{"1min":1.169,"5min":1.169,"15min":1.4059999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.91100000000000003,"15min":0.90400000000000003},"min":{"1min":0.67900000000000005,"5min":0.53000000000000003,"15min":0.50600000000000001},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.89600000000000002}]},{"osd":3,"last update":"Sat Jun 10 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.93600000000000005,"15min":0.91800000000000004},"min":{"1min":0.71899999999999997,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.502},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.0229999999999999,"5min":0.97599999999999998,"15min":0.94699999999999995},"min":{"1min":0.80400000000000005,"5min":0.59599999999999997,"15min":0.53800000000000003},"max":{"1min":1.2769999999999999,"5min":1.284,"15min":1.2929999999999999},"last":0.96399999999999997}]},{"osd":4,"last update":"Sat Jun 10 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.83199999999999996,"15min":0.85799999999999998},"min":{"1min":0.629,"5min":0.39500000000000002,"15min":0.32700000000000001},"max":{"1min":1.056,"5min":1.1990000000000001,"15min":1.639},"last":0.63900000000000001},{"interface":"front","average":{"1min":1.014,"5min":0.97199999999999998,"15min":0.97299999999999998},"min":{"1min":0.67200000000000004,"5min":0.434,"15min":0.40000000000000002},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.86799999999999999}]},{"osd":5,"last update":"Sat Jun 10 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":0.99199999999999999,"15min":1.016},"min":{"1min":0.73699999999999999,"5min":0.40500000000000003,"15min":0.38400000000000001},"max":{"1min":1.379,"5min":1.395,"15min":1.806},"last":0.84399999999999997},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0389999999999999,"15min":1.0429999999999999},"min":{"1min":0.70399999999999996,"5min":0.505,"15min":0.46500000000000002},"max":{"1min":1.579,"5min":1.579,"15min":1.579},"last":0.97999999999999998}]},{"osd":6,"last update":"Sat Jun 10 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0069999999999999},"min":{"1min":0.65100000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.391,"5min":1.391,"15min":1.718},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.149,"5min":1.1140000000000001,"15min":1.0960000000000001},"min":{"1min":0.82099999999999995,"5min":0.48799999999999999,"15min":0.441},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":1.022}]}]},{"osd":6,"up_from":13,"seq":55834574966,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32152,"kb_used_data":1104,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339688,"statfs":{"total":96636764160,"available":96603840512,"internally_reserved":0,"allocated":1130496,"data_stored":512684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.89700000000000002,"15min":0.84599999999999997},"min":{"1min":0.55000000000000004,"5min":0.52600000000000002,"15min":0.502},"max":{"1min":1.111,"5min":1.476,"15min":1.498},"last":1.079},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.89400000000000002,"15min":0.86899999999999999},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46100000000000002},"max":{"1min":1.2250000000000001,"5min":1.496,"15min":1.496},"last":0.94199999999999995}]},{"osd":1,"last update":"Sat Jun 10 19:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.86399999999999999,"15min":0.86199999999999999},"min":{"1min":0.502,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.079,"5min":1.1739999999999999,"15min":1.5229999999999999},"last":1.0229999999999999},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.90900000000000003,"15min":0.88400000000000001},"min":{"1min":0.61399999999999999,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.1599999999999999,"5min":1.2450000000000001,"15min":1.778},"last":0.78100000000000003}]},{"osd":2,"last update":"Sat Jun 10 19:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91300000000000003,"15min":0.88300000000000001},"min":{"1min":0.748,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.2130000000000001,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":1.111},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.90400000000000003,"15min":0.89200000000000002},"min":{"1min":0.66200000000000003,"5min":0.61299999999999999,"15min":0.57999999999999996},"max":{"1min":1.2330000000000001,"5min":1.246,"15min":1.246},"last":0.56100000000000005}]},{"osd":3,"last update":"Sat Jun 10 19:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.93300000000000005,"15min":0.89200000000000002},"min":{"1min":0.68200000000000005,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0860000000000001,"5min":1.399,"15min":1.7190000000000001},"last":1.141},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.98199999999999998,"15min":0.99099999999999999},"min":{"1min":0.77300000000000002,"5min":0.72599999999999998,"15min":0.58599999999999997},"max":{"1min":1.2470000000000001,"5min":1.272,"15min":1.4370000000000001},"last":1.371}]},{"osd":4,"last update":"Sat Jun 10 19:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.89800000000000002,"15min":0.93000000000000005},"min":{"1min":0.71999999999999997,"5min":0.59799999999999998,"15min":0.56799999999999995},"max":{"1min":1.1719999999999999,"5min":1.4159999999999999,"15min":1.798},"last":1.401},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.95799999999999996,"15min":0.996},"min":{"1min":0.64500000000000002,"5min":0.64000000000000001,"15min":0.51300000000000001},"max":{"1min":1.319,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":1.1619999999999999}]},{"osd":5,"last update":"Sat Jun 10 19:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.91100000000000003,"15min":0.93799999999999994},"min":{"1min":0.72099999999999997,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.194,"5min":1.333,"15min":1.333},"last":1.29},{"interface":"front","average":{"1min":1.012,"5min":1.02,"15min":1.03},"min":{"1min":0.77800000000000002,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.2210000000000001,"5min":1.405,"15min":2.536},"last":1.2230000000000001}]},{"osd":7,"last update":"Sat Jun 10 19:01:43 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.0169999999999999,"15min":1.036},"min":{"1min":0.82699999999999996,"5min":0.60899999999999999,"15min":0.57099999999999995},"max":{"1min":1.361,"5min":1.48,"15min":1.917},"last":1.427},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.98299999999999998,"15min":1.034},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.278,"5min":1.29,"15min":1.5569999999999999},"last":1.4850000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574966,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32140,"kb_used_data":1092,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339700,"statfs":{"total":96636764160,"available":96603852800,"internally_reserved":0,"allocated":1118208,"data_stored":506056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:01:45 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.91700000000000004,"15min":0.86199999999999999},"min":{"1min":0.58099999999999996,"5min":0.54100000000000004,"15min":0.50600000000000001},"max":{"1min":1.2070000000000001,"5min":1.232,"15min":1.232},"last":0.56599999999999995},{"interface":"front","average":{"1min":1.028,"5min":0.92400000000000004,"15min":0.92700000000000005},"min":{"1min":0.58999999999999997,"5min":0.51400000000000001,"15min":0.49399999999999999},"max":{"1min":2.347,"5min":2.347,"15min":2.347},"last":0.98299999999999998}]},{"osd":1,"last update":"Sat Jun 10 19:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":0.97199999999999998,"15min":0.92800000000000005},"min":{"1min":0.63400000000000001,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":7.0800000000000001,"5min":7.0800000000000001,"15min":7.0800000000000001},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.9550000000000001,"5min":1.1240000000000001,"15min":0.98799999999999999},"min":{"1min":0.59199999999999997,"5min":0.57699999999999996,"15min":0.53800000000000003},"max":{"1min":15.845000000000001,"5min":15.845000000000001,"15min":15.845000000000001},"last":0.91800000000000004}]},{"osd":2,"last update":"Sat Jun 10 19:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":0.94299999999999995,"15min":0.88100000000000001},"min":{"1min":0.68200000000000005,"5min":0.49299999999999999,"15min":0.48299999999999998},"max":{"1min":5.0049999999999999,"5min":5.0049999999999999,"15min":5.0049999999999999},"last":0.626},{"interface":"front","average":{"1min":1.296,"5min":1.008,"15min":0.94299999999999995},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":6.851,"5min":6.851,"15min":6.851},"last":0.86599999999999999}]},{"osd":3,"last update":"Sat Jun 10 19:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":0.96399999999999997,"15min":0.95499999999999996},"min":{"1min":0.65900000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.544,"5min":2.544,"15min":2.544},"last":1.0509999999999999},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0029999999999999,"15min":1.0169999999999999},"min":{"1min":0.63100000000000001,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":3.0830000000000002,"5min":3.0830000000000002,"15min":3.0830000000000002},"last":1.1080000000000001}]},{"osd":4,"last update":"Sat Jun 10 19:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":0.95799999999999996,"15min":0.96699999999999997},"min":{"1min":0.66800000000000004,"5min":0.64100000000000001,"15min":0.58099999999999996},"max":{"1min":6.7290000000000001,"5min":6.7290000000000001,"15min":6.7290000000000001},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.0369999999999999,"5min":0.98199999999999998,"15min":1.0269999999999999},"min":{"1min":0.68300000000000005,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.278,"5min":1.341,"15min":1.575},"last":0.755}]},{"osd":6,"last update":"Sat Jun 10 19:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":0.98199999999999998,"15min":1.03},"min":{"1min":0.65300000000000002,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.3029999999999999,"5min":1.3660000000000001,"15min":1.4330000000000001},"last":0.81799999999999995},{"interface":"front","average":{"1min":1.373,"5min":1.093,"15min":1.073},"min":{"1min":0.81499999999999995,"5min":0.66500000000000004,"15min":0.57899999999999996},"max":{"1min":6.923,"5min":6.923,"15min":6.923},"last":1.018}]},{"osd":7,"last update":"Sat Jun 10 19:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.0629999999999999,"15min":1.1259999999999999},"min":{"1min":0.81399999999999995,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":2.6080000000000001,"5min":2.6080000000000001,"15min":2.6080000000000001},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.4319999999999999,"5min":1.157,"15min":1.1619999999999999},"min":{"1min":0.95299999999999996,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":5.4169999999999998,"5min":5.4169999999999998,"15min":5.4169999999999998},"last":1.1719999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574965,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32152,"kb_used_data":1104,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339688,"statfs":{"total":96636764160,"available":96603840512,"internally_reserved":0,"allocated":1130496,"data_stored":512684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.872,"15min":0.79800000000000004},"min":{"1min":0.49199999999999999,"5min":0.48599999999999999,"15min":0.45100000000000001},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.91900000000000004,"15min":0.89800000000000002},"min":{"1min":0.58399999999999996,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0580000000000001,"5min":3.7280000000000002,"15min":3.7280000000000002},"last":0.70799999999999996}]},{"osd":1,"last update":"Sat Jun 10 19:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.93500000000000005,"15min":0.94599999999999995},"min":{"1min":0.63100000000000001,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1200000000000001,"5min":3.3969999999999998,"15min":3.3969999999999998},"last":1.0229999999999999},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.90100000000000002,"15min":0.86199999999999999},"min":{"1min":0.66100000000000003,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.1679999999999999,"5min":2.496,"15min":2.496},"last":0.753}]},{"osd":2,"last update":"Sat Jun 10 19:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.90200000000000002,"15min":0.88400000000000001},"min":{"1min":0.56799999999999995,"5min":0.51300000000000001,"15min":0.49299999999999999},"max":{"1min":1.3,"5min":1.3,"15min":1.522},"last":0.88400000000000001},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.006,"15min":1},"min":{"1min":0.74099999999999999,"5min":0.57799999999999996,"15min":0.55000000000000004},"max":{"1min":1.204,"5min":3.5750000000000002,"15min":3.5750000000000002},"last":0.82199999999999995}]},{"osd":3,"last update":"Sat Jun 10 19:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.91700000000000004,"15min":0.89600000000000002},"min":{"1min":0.71599999999999997,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.2909999999999999,"5min":2.3809999999999998,"15min":2.3809999999999998},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.97199999999999998,"15min":0.96399999999999997},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.54400000000000004},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.6479999999999999},"last":0.67200000000000004}]},{"osd":5,"last update":"Sat Jun 10 19:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.96899999999999997,"15min":0.97599999999999998},"min":{"1min":0.68700000000000006,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.1459999999999999,"5min":3.6539999999999999,"15min":3.6539999999999999},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.94599999999999995,"15min":0.96499999999999997},"min":{"1min":0.68400000000000005,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.204,"5min":2.6720000000000002,"15min":2.6720000000000002},"last":1.0529999999999999}]},{"osd":6,"last update":"Sat Jun 10 19:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.93999999999999995,"15min":0.98999999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.54900000000000004},"max":{"1min":1.276,"5min":1.3149999999999999,"15min":2.2639999999999998},"last":0.79800000000000004},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0549999999999999,"15min":1.0660000000000001},"min":{"1min":0.76500000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.3200000000000001,"5min":3.4980000000000002,"15min":3.4980000000000002},"last":1.093}]},{"osd":7,"last update":"Sat Jun 10 19:01:59 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":0.999,"15min":0.99399999999999999},"min":{"1min":0.72499999999999998,"5min":0.66300000000000003,"15min":0.41399999999999998},"max":{"1min":1.3360000000000001,"5min":2.5910000000000002,"15min":2.5910000000000002},"last":0.85199999999999998},{"interface":"front","average":{"1min":1.083,"5min":1.0660000000000001,"15min":1.069},"min":{"1min":0.68100000000000005,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.3740000000000001,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.98999999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574964,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":1088,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":1114112,"data_stored":505037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.627,"15min":0.59899999999999998},"min":{"1min":0.44600000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.88300000000000001,"5min":1.01,"15min":1.169},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.68100000000000005,"15min":0.65400000000000003},"min":{"1min":0.45300000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.96699999999999997,"5min":1.1679999999999999,"15min":1.286},"last":1.093}]},{"osd":1,"last update":"Sat Jun 10 19:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.68300000000000005,"15min":0.65600000000000003},"min":{"1min":0.501,"5min":0.34300000000000003,"15min":0.27500000000000002},"max":{"1min":0.94299999999999995,"5min":1.2569999999999999,"15min":1.2729999999999999},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.74399999999999999,"15min":0.73299999999999998},"min":{"1min":0.42999999999999999,"5min":0.33000000000000002,"15min":0.318},"max":{"1min":1.0449999999999999,"5min":1.296,"15min":1.411},"last":0.84599999999999997}]},{"osd":2,"last update":"Sat Jun 10 19:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.78500000000000003,"15min":0.76800000000000002},"min":{"1min":0.49199999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.018,"5min":1.3899999999999999,"15min":1.9530000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.80100000000000005,"15min":0.76700000000000002},"min":{"1min":0.58399999999999996,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.125,"5min":1.278,"15min":1.278},"last":0.94099999999999995}]},{"osd":4,"last update":"Sat Jun 10 19:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.93899999999999995,"15min":0.95499999999999996},"min":{"1min":0.69899999999999995,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.1899999999999999,"5min":1.488,"15min":1.488},"last":1.0489999999999999},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.98399999999999999,"15min":0.98999999999999999},"min":{"1min":0.68700000000000006,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.3069999999999999,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":1.1419999999999999}]},{"osd":5,"last update":"Sat Jun 10 19:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.008,"15min":1.0349999999999999},"min":{"1min":0.64200000000000002,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.2030000000000001,"5min":1.425,"15min":2.024},"last":1.006},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.014,"15min":1.0229999999999999},"min":{"1min":0.72099999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.3220000000000001,"5min":1.5069999999999999,"15min":1.724},"last":1.175}]},{"osd":6,"last update":"Sat Jun 10 19:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.0600000000000001,"15min":1.0580000000000001},"min":{"1min":0.79600000000000004,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.3600000000000001,"5min":1.597,"15min":1.8500000000000001},"last":1.119},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.0509999999999999,"15min":1.0649999999999999},"min":{"1min":0.73499999999999999,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.3380000000000001,"5min":1.4590000000000001,"15min":1.78},"last":0.97099999999999997}]},{"osd":7,"last update":"Sat Jun 10 19:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.0820000000000001,"15min":1.1100000000000001},"min":{"1min":0.75,"5min":0.60999999999999999,"15min":0.56999999999999995},"max":{"1min":1.373,"5min":1.444,"15min":1.9079999999999999},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.093,"5min":1.105,"15min":1.0900000000000001},"min":{"1min":0.72099999999999997,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.399,"5min":1.651,"15min":1.6719999999999999},"last":1.075}]}]},{"osd":2,"up_from":13,"seq":55834574965,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32152,"kb_used_data":1104,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339688,"statfs":{"total":96636764160,"available":96603840512,"internally_reserved":0,"allocated":1130496,"data_stored":512684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:01:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.628,"15min":0.60499999999999998},"min":{"1min":0.31,"5min":0.28899999999999998,"15min":0.27300000000000002},"max":{"1min":1.095,"5min":1.095,"15min":1.1220000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.72899999999999998,"15min":0.72199999999999998},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.0209999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.56999999999999995}]},{"osd":1,"last update":"Sat Jun 10 19:01:52 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.67500000000000004,"15min":0.66100000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.307},"max":{"1min":0.98199999999999998,"5min":1.099,"15min":1.1950000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.78100000000000003,"15min":0.73599999999999999},"min":{"1min":0.36699999999999999,"5min":0.33300000000000002,"15min":0.29499999999999998},"max":{"1min":1.0109999999999999,"5min":1.446,"15min":1.446},"last":1.2310000000000001}]},{"osd":3,"last update":"Sat Jun 10 19:01:52 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.80000000000000004,"15min":0.746},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.1599999999999999,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.80400000000000005,"15min":0.77100000000000002},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.252},"max":{"1min":0.999,"5min":1.1459999999999999,"15min":1.3340000000000001},"last":0.86499999999999999}]},{"osd":4,"last update":"Sat Jun 10 19:01:52 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.93500000000000005,"15min":0.92400000000000004},"min":{"1min":0.624,"5min":0.56200000000000006,"15min":0.53400000000000003},"max":{"1min":1.228,"5min":1.228,"15min":1.3620000000000001},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.998,"5min":1.0049999999999999,"15min":1.0269999999999999},"min":{"1min":0.753,"5min":0.60899999999999999,"15min":0.57699999999999996},"max":{"1min":1.486,"5min":1.486,"15min":1.4950000000000001},"last":0.95099999999999996}]},{"osd":5,"last update":"Sat Jun 10 19:01:52 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.008,"15min":1.018},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.54100000000000004},"max":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":1.5700000000000001},"last":1.139},{"interface":"front","average":{"1min":0.98699999999999999,"5min":1.0189999999999999,"15min":1.002},"min":{"1min":0.71999999999999997,"5min":0.66000000000000003,"15min":0.60099999999999998},"max":{"1min":1.2669999999999999,"5min":1.381,"15min":1.667},"last":1.008}]},{"osd":6,"last update":"Sat Jun 10 19:01:52 2023","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.044,"15min":1.0389999999999999},"min":{"1min":0.67400000000000004,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.304,"5min":1.4259999999999999,"15min":1.5900000000000001},"last":1.0620000000000001},{"interface":"front","average":{"1min":1.038,"5min":1.05,"15min":1.044},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.2989999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":1.1060000000000001}]},{"osd":7,"last update":"Sat Jun 10 19:01:52 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.0880000000000001,"15min":1.0980000000000001},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.4319999999999999,"5min":1.724,"15min":1.724},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.085,"5min":1.1080000000000001,"15min":1.0980000000000001},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.59299999999999997},"max":{"1min":1.363,"5min":1.51,"15min":1.752},"last":1.1759999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574967,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":1088,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":1114112,"data_stored":505037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:01:54 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.71699999999999997,"15min":0.68000000000000005},"min":{"1min":0.46500000000000002,"5min":0.28599999999999998,"15min":0.25800000000000001},"max":{"1min":1.111,"5min":1.1459999999999999,"15min":1.288},"last":0.629},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79000000000000004,"15min":0.72899999999999998},"min":{"1min":0.41899999999999998,"5min":0.32800000000000001,"15min":0.26900000000000002},"max":{"1min":0.98099999999999998,"5min":1.056,"15min":1.694},"last":0.58599999999999997}]},{"osd":2,"last update":"Sat Jun 10 19:01:54 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.65700000000000003,"15min":0.63400000000000001},"min":{"1min":0.39200000000000002,"5min":0.308,"15min":0.249},"max":{"1min":0.93999999999999995,"5min":1.0740000000000001,"15min":1.21},"last":0.371},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.754,"15min":0.70299999999999996},"min":{"1min":0.48599999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.0600000000000001,"5min":1.194,"15min":1.415},"last":0.38800000000000001}]},{"osd":3,"last update":"Sat Jun 10 19:01:54 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.80700000000000005,"15min":0.77600000000000002},"min":{"1min":0.58599999999999997,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.1679999999999999,"5min":1.3049999999999999,"15min":1.6299999999999999},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.75900000000000001,"15min":0.752},"min":{"1min":0.47199999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":2.1749999999999998},"last":0.44400000000000001}]},{"osd":4,"last update":"Sat Jun 10 19:01:54 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.878,"15min":0.85699999999999998},"min":{"1min":0.67400000000000004,"5min":0.58699999999999997,"15min":0.53000000000000003},"max":{"1min":1.343,"5min":1.343,"15min":1.4930000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.022,"15min":1.0600000000000001},"min":{"1min":0.71299999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.2569999999999999,"5min":1.5129999999999999,"15min":5.8209999999999997},"last":0.67800000000000005}]},{"osd":5,"last update":"Sat Jun 10 19:01:54 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.006,"15min":1.0169999999999999},"min":{"1min":0.60899999999999999,"5min":0.57699999999999996,"15min":0.56599999999999995},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.8620000000000001},"last":0.751},{"interface":"front","average":{"1min":1.018,"5min":0.997,"15min":0.98299999999999998},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.3069999999999999,"5min":1.3089999999999999,"15min":3.089},"last":0.66600000000000004}]},{"osd":6,"last update":"Sat Jun 10 19:01:54 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.0660000000000001,"15min":1.0549999999999999},"min":{"1min":0.73699999999999999,"5min":0.64100000000000001,"15min":0.56200000000000006},"max":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":7.2599999999999998},"last":0.81899999999999995},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0389999999999999,"15min":1.042},"min":{"1min":0.73599999999999999,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":9.0069999999999997},"last":0.60299999999999998}]},{"osd":7,"last update":"Sat Jun 10 19:01:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.113,"15min":1.0940000000000001},"min":{"1min":0.92400000000000004,"5min":0.495,"15min":0.495},"max":{"1min":1.494,"5min":1.573,"15min":2.105},"last":0.72399999999999998},{"interface":"front","average":{"1min":1.089,"5min":1.1180000000000001,"15min":1.087},"min":{"1min":0.63700000000000001,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.5620000000000001,"5min":1.6399999999999999,"15min":2.2570000000000001},"last":0.85299999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574966,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32728,"kb_used_data":1680,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339112,"statfs":{"total":96636764160,"available":96603250688,"internally_reserved":0,"allocated":1720320,"data_stored":1102033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jun 10 19:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.65500000000000003,"15min":0.624},"min":{"1min":0.34799999999999998,"5min":0.248,"15min":0.248},"max":{"1min":1.077,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.82899999999999996,"15min":0.78200000000000003},"min":{"1min":0.38600000000000001,"5min":0.34100000000000003,"15min":0.34000000000000002},"max":{"1min":1.1559999999999999,"5min":1.302,"15min":1.4059999999999999},"last":0.96899999999999997}]},{"osd":2,"last update":"Sat Jun 10 19:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.71399999999999997,"15min":0.70599999999999996},"min":{"1min":0.33500000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.149,"5min":1.149,"15min":1.2829999999999999},"last":1.2010000000000001},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66600000000000004,"15min":0.64700000000000002},"min":{"1min":0.318,"5min":0.245,"15min":0.245},"max":{"1min":0.88900000000000001,"5min":1.139,"15min":1.371},"last":0.70399999999999996}]},{"osd":3,"last update":"Sat Jun 10 19:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.67300000000000004,"15min":0.67900000000000005},"min":{"1min":0.30299999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.96199999999999997,"5min":1.222,"15min":1.226},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.80400000000000005,"15min":0.81499999999999995},"min":{"1min":0.41999999999999998,"5min":0.317,"15min":0.317},"max":{"1min":1.083,"5min":1.2549999999999999,"15min":1.829},"last":0.81599999999999995}]},{"osd":4,"last update":"Sat Jun 10 19:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.94099999999999995,"15min":0.91200000000000003},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1990000000000001,"5min":3.0209999999999999,"15min":3.0209999999999999},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.998,"5min":1.016,"15min":1.028},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.228,"5min":1.3819999999999999,"15min":1.9510000000000001},"last":1.097}]},{"osd":5,"last update":"Sat Jun 10 19:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.92400000000000004,"15min":0.94599999999999995},"min":{"1min":0.64700000000000002,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.095,"5min":1.2529999999999999,"15min":1.694},"last":1.071},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.024,"15min":1.01},"min":{"1min":0.58099999999999996,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.391,"5min":4.5620000000000003,"15min":4.5620000000000003},"last":1.0469999999999999}]},{"osd":6,"last update":"Sat Jun 10 19:01:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0940000000000001,"15min":1.0720000000000001},"min":{"1min":0.61899999999999999,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.423,"5min":3.5569999999999999,"15min":3.5569999999999999},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.012,"15min":1.004},"min":{"1min":0.67100000000000004,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.26,"5min":1.625,"15min":1.883},"last":1.018}]},{"osd":7,"last update":"Sat Jun 10 19:01:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0309999999999999,"15min":1.0349999999999999},"min":{"1min":0.69199999999999995,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.349,"5min":1.4850000000000001,"15min":1.5800000000000001},"last":0.91700000000000004},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.63,"5min":0.61099999999999999,"15min":0.58699999999999997},"max":{"1min":1.4179999999999999,"5min":1.425,"15min":1.9830000000000001},"last":1.131}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-10T19:02:07.076 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-10T19:02:07.235 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.235+0000 7ffa6daa1640 1 Processor -- start 2023-06-10T19:02:07.235 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.235+0000 7ffa6daa1640 1 -- start start 2023-06-10T19:02:07.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.235+0000 7ffa6daa1640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ffa680c9750 0x7ffa680aced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:07.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.235+0000 7ffa6daa1640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa680ad410 con 0x7ffa680afe30 2023-06-10T19:02:07.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.235+0000 7ffa6daa1640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa681600d0 con 0x7ffa680cb870 2023-06-10T19:02:07.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.235+0000 7ffa6daa1640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa680cd990 con 0x7ffa680c9750 2023-06-10T19:02:07.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.235+0000 7ffa67fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ffa680afe30 0x7ffa680aba10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:38982/0 (socket says 172.21.15.53:38982) 2023-06-10T19:02:07.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.235+0000 7ffa67fff640 1 -- 172.21.15.53:0/1468865841 learned_addr learned my addr 172.21.15.53:0/1468865841 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:02:07.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.235+0000 7ffa677fe640 1 --2- 172.21.15.53:0/1468865841 >> v2:172.21.15.117:3300/0 conn(0x7ffa680c9750 0x7ffa680aced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:07.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.235+0000 7ffa66ffd640 1 -- 172.21.15.53:0/1468865841 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2813706718 0 0) 0x7ffa680ad410 con 0x7ffa680afe30 2023-06-10T19:02:07.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.235+0000 7ffa66ffd640 1 -- 172.21.15.53:0/1468865841 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa54003530 con 0x7ffa680afe30 2023-06-10T19:02:07.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.235+0000 7ffa66ffd640 1 -- 172.21.15.53:0/1468865841 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1619663429 0 0) 0x7ffa54003530 con 0x7ffa680afe30 2023-06-10T19:02:07.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.235+0000 7ffa66ffd640 1 -- 172.21.15.53:0/1468865841 >> v2:172.21.15.117:3300/0 conn(0x7ffa680c9750 msgr2=0x7ffa680aced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:07.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.235+0000 7ffa66ffd640 1 --2- 172.21.15.53:0/1468865841 >> v2:172.21.15.117:3300/0 conn(0x7ffa680c9750 0x7ffa680aced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:07.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.235+0000 7ffa66ffd640 1 -- 172.21.15.53:0/1468865841 >> v1:172.21.15.117:6789/0 conn(0x7ffa680cb870 legacy=0x7ffa680af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:07.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.235+0000 7ffa66ffd640 1 -- 172.21.15.53:0/1468865841 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa68160370 con 0x7ffa680afe30 2023-06-10T19:02:07.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.235+0000 7ffa66ffd640 1 -- 172.21.15.53:0/1468865841 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7ffa60001a00 con 0x7ffa680afe30 2023-06-10T19:02:07.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.235+0000 7ffa66ffd640 1 -- 172.21.15.53:0/1468865841 >> v1:172.21.15.53:6789/0 conn(0x7ffa680afe30 legacy=0x7ffa680aba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:07.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.235+0000 7ffa66ffd640 1 --2- 172.21.15.53:0/1468865841 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa540039f0 0x7ffa54003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:07.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.235+0000 7ffa66ffd640 1 --2- 172.21.15.53:0/1468865841 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa540047d0 0x7ffa54004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:07.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.235+0000 7ffa66ffd640 1 --2- 172.21.15.53:0/1468865841 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa54005180 0x7ffa5400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:07.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.235+0000 7ffa66ffd640 1 -- 172.21.15.53:0/1468865841 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa680cd990 con 0x7ffa540047d0 2023-06-10T19:02:07.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.235+0000 7ffa66ffd640 1 -- 172.21.15.53:0/1468865841 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5400c060 con 0x7ffa540039f0 2023-06-10T19:02:07.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.235+0000 7ffa66ffd640 1 -- 172.21.15.53:0/1468865841 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5400c220 con 0x7ffa54005180 2023-06-10T19:02:07.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.235+0000 7ffa5effd640 1 --2- 172.21.15.53:0/1468865841 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa540047d0 0x7ffa54004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:07.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.235+0000 7ffa677fe640 1 --2- 172.21.15.53:0/1468865841 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa540039f0 0x7ffa54003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:07.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.235+0000 7ffa67fff640 1 --2- 172.21.15.53:0/1468865841 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa54005180 0x7ffa5400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:07.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.235+0000 7ffa5effd640 1 -- 172.21.15.53:0/1468865841 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa54005180 msgr2=0x7ffa5400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:07.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.235+0000 7ffa5effd640 1 --2- 172.21.15.53:0/1468865841 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa54005180 0x7ffa5400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:07.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.235+0000 7ffa5effd640 1 -- 172.21.15.53:0/1468865841 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa540039f0 msgr2=0x7ffa54003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:07.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.235+0000 7ffa5effd640 1 --2- 172.21.15.53:0/1468865841 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa540039f0 0x7ffa54003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:07.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.235+0000 7ffa67fff640 1 -- 172.21.15.53:0/1468865841 reap_dead start 2023-06-10T19:02:07.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.235+0000 7ffa5effd640 1 -- 172.21.15.53:0/1468865841 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa54003530 con 0x7ffa540047d0 2023-06-10T19:02:07.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.235+0000 7ffa677fe640 1 --2- 172.21.15.53:0/1468865841 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa540039f0 0x7ffa54003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:02:07.243 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.239+0000 7ffa5effd640 1 --2- 172.21.15.53:0/1468865841 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa540047d0 0x7ffa54004c40 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7ffa50001780 tx=0x7ffa5001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9560ec2446dd54d2 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:07.243 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.239+0000 7ffa66ffd640 1 -- 172.21.15.53:0/1468865841 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa500052d0 con 0x7ffa540047d0 2023-06-10T19:02:07.243 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.239+0000 7ffa66ffd640 1 -- 172.21.15.53:0/1468865841 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa500a7050 con 0x7ffa540047d0 2023-06-10T19:02:07.243 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.239+0000 7ffa66ffd640 1 -- 172.21.15.53:0/1468865841 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa50003600 con 0x7ffa540047d0 2023-06-10T19:02:07.244 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.239+0000 7ffa6daa1640 1 -- 172.21.15.53:0/1468865841 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa540047d0 msgr2=0x7ffa54004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:07.244 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.239+0000 7ffa6daa1640 1 --2- 172.21.15.53:0/1468865841 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa540047d0 0x7ffa54004c40 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7ffa50001780 tx=0x7ffa5001c400 comp rx=0 tx=0).stop 2023-06-10T19:02:07.244 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.239+0000 7ffa6daa1640 1 -- 172.21.15.53:0/1468865841 shutdown_connections 2023-06-10T19:02:07.244 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.239+0000 7ffa6daa1640 1 --2- 172.21.15.53:0/1468865841 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa540047d0 0x7ffa54004c40 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:07.244 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.239+0000 7ffa6daa1640 1 -- 172.21.15.53:0/1468865841 >> 172.21.15.53:0/1468865841 conn(0x7ffa6806a0d0 msgr2=0x7ffa680ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:07.244 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.239+0000 7ffa6daa1640 1 -- 172.21.15.53:0/1468865841 shutdown_connections 2023-06-10T19:02:07.244 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.239+0000 7ffa6daa1640 1 -- 172.21.15.53:0/1468865841 wait complete. 2023-06-10T19:02:07.245 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.239+0000 7ffa6daa1640 1 Processor -- start 2023-06-10T19:02:07.245 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.239+0000 7ffa6daa1640 1 -- start start 2023-06-10T19:02:07.246 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.243+0000 7ffa6daa1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa540047d0 0x7ffa6815df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:07.246 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.243+0000 7ffa6daa1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa681f4bc0 0x7ffa681f5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:07.246 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.243+0000 7ffa6daa1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa681f5570 0x7ffa680adfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:07.247 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.243+0000 7ffa6daa1640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa68145f70 con 0x7ffa681f4bc0 2023-06-10T19:02:07.247 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.243+0000 7ffa6daa1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6815e480 con 0x7ffa540047d0 2023-06-10T19:02:07.247 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.243+0000 7ffa6daa1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa680adb10 con 0x7ffa681f5570 2023-06-10T19:02:07.247 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.243+0000 7ffa5effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa681f4bc0 0x7ffa681f5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:07.247 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.243+0000 7ffa5effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa681f4bc0 0x7ffa681f5030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37446/0 (socket says 172.21.15.53:37446) 2023-06-10T19:02:07.247 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.243+0000 7ffa5effd640 1 -- 172.21.15.53:0/2731721264 learned_addr learned my addr 172.21.15.53:0/2731721264 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:07.247 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.243+0000 7ffa677fe640 1 --2- 172.21.15.53:0/2731721264 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa540047d0 0x7ffa6815df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:07.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.243+0000 7ffa67fff640 1 --2- 172.21.15.53:0/2731721264 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa681f5570 0x7ffa680adfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:07.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.243+0000 7ffa5effd640 1 -- 172.21.15.53:0/2731721264 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa681f5570 msgr2=0x7ffa680adfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:07.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.243+0000 7ffa5effd640 1 --2- 172.21.15.53:0/2731721264 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa681f5570 0x7ffa680adfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:07.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.243+0000 7ffa5effd640 1 -- 172.21.15.53:0/2731721264 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa540047d0 msgr2=0x7ffa6815df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:07.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.243+0000 7ffa5effd640 1 --2- 172.21.15.53:0/2731721264 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa540047d0 0x7ffa6815df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:07.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.243+0000 7ffa5effd640 1 -- 172.21.15.53:0/2731721264 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa681f59e0 con 0x7ffa681f4bc0 2023-06-10T19:02:07.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.243+0000 7ffa67fff640 1 --2- 172.21.15.53:0/2731721264 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa681f5570 0x7ffa680adfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:02:07.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.243+0000 7ffa5effd640 1 --2- 172.21.15.53:0/2731721264 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa681f4bc0 0x7ffa681f5030 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7ffa50005040 tx=0x7ffa54005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:07.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.243+0000 7ffa64ff9640 1 -- 172.21.15.53:0/2731721264 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa50003e40 con 0x7ffa681f4bc0 2023-06-10T19:02:07.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.243+0000 7ffa64ff9640 1 -- 172.21.15.53:0/2731721264 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa50000ee0 con 0x7ffa681f4bc0 2023-06-10T19:02:07.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.243+0000 7ffa64ff9640 1 -- 172.21.15.53:0/2731721264 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa50007270 con 0x7ffa681f4bc0 2023-06-10T19:02:07.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.243+0000 7ffa6daa1640 1 -- 172.21.15.53:0/2731721264 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa6815e670 con 0x7ffa681f4bc0 2023-06-10T19:02:07.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.243+0000 7ffa6daa1640 1 -- 172.21.15.53:0/2731721264 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa6815ec30 con 0x7ffa681f4bc0 2023-06-10T19:02:07.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.243+0000 7ffa6daa1640 1 -- 172.21.15.53:0/2731721264 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa6804d790 con 0x7ffa681f4bc0 2023-06-10T19:02:07.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.243+0000 7ffa64ff9640 1 -- 172.21.15.53:0/2731721264 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ffa500073d0 con 0x7ffa681f4bc0 2023-06-10T19:02:07.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.243+0000 7ffa64ff9640 1 --2- 172.21.15.53:0/2731721264 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ffa48066280 0x7ffa48068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:07.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.247+0000 7ffa64ff9640 1 -- 172.21.15.53:0/2731721264 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ffa5011e130 con 0x7ffa681f4bc0 2023-06-10T19:02:07.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.247+0000 7ffa677fe640 1 --2- 172.21.15.53:0/2731721264 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ffa48066280 0x7ffa48068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:07.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.247+0000 7ffa677fe640 1 --2- 172.21.15.53:0/2731721264 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ffa48066280 0x7ffa48068730 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7ffa6804eaa0 tx=0x7ffa58008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:07.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.251+0000 7ffa64ff9640 1 -- 172.21.15.53:0/2731721264 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ffa500ef040 con 0x7ffa681f4bc0 2023-06-10T19:02:07.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.399+0000 7ffa6daa1640 1 -- 172.21.15.53:0/2731721264 --> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ffa680cd5b0 con 0x7ffa48066280 2023-06-10T19:02:07.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.423+0000 7ffa64ff9640 1 -- 172.21.15.53:0/2731721264 <== mgr.4105 v2:172.21.15.117:6832/3061986771 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+309307 (secure 0 0 0) 0x7ffa58013500 con 0x7ffa48066280 2023-06-10T19:02:07.427 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:02:07.430 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-06-10T19:02:07.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.427+0000 7ffa6daa1640 1 -- 172.21.15.53:0/2731721264 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ffa48066280 msgr2=0x7ffa48068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:07.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.427+0000 7ffa6daa1640 1 --2- 172.21.15.53:0/2731721264 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ffa48066280 0x7ffa48068730 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7ffa6804eaa0 tx=0x7ffa58008040 comp rx=0 tx=0).stop 2023-06-10T19:02:07.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.427+0000 7ffa6daa1640 1 -- 172.21.15.53:0/2731721264 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa681f4bc0 msgr2=0x7ffa681f5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:07.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.427+0000 7ffa6daa1640 1 --2- 172.21.15.53:0/2731721264 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa681f4bc0 0x7ffa681f5030 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7ffa50005040 tx=0x7ffa54005800 comp rx=0 tx=0).stop 2023-06-10T19:02:07.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.427+0000 7ffa6daa1640 1 -- 172.21.15.53:0/2731721264 shutdown_connections 2023-06-10T19:02:07.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.427+0000 7ffa6daa1640 1 --2- 172.21.15.53:0/2731721264 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ffa48066280 0x7ffa48068730 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:07.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.427+0000 7ffa6daa1640 1 --2- 172.21.15.53:0/2731721264 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa681f5570 0x7ffa680adfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:07.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.427+0000 7ffa6daa1640 1 --2- 172.21.15.53:0/2731721264 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa681f4bc0 0x7ffa681f5030 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:07.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.427+0000 7ffa6daa1640 1 --2- 172.21.15.53:0/2731721264 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa540047d0 0x7ffa6815df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:07.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.427+0000 7ffa6daa1640 1 -- 172.21.15.53:0/2731721264 >> 172.21.15.53:0/2731721264 conn(0x7ffa6806a0d0 msgr2=0x7ffa680723f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:07.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.427+0000 7ffa6daa1640 1 -- 172.21.15.53:0/2731721264 shutdown_connections 2023-06-10T19:02:07.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.427+0000 7ffa6daa1640 1 -- 172.21.15.53:0/2731721264 wait complete. 2023-06-10T19:02:07.448 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":374,"stamp":"2023-06-10T19:02:05.763460+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591838,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":202,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":27,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":258316,"kb_used_data":9932,"kb_used_omap":0,"kb_used_meta":248320,"kb_avail":754716404,"statfs":{"total":773094113280,"available":772829597696,"internally_reserved":0,"allocated":10170368,"data_stored":5252639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":254279680},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":60,"apply_latency_ms":60,"commit_latency_ns":60000000,"apply_latency_ns":60000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1470,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.509502"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.669171+0000","last_change":"2023-06-10T19:02:02.665348+0000","last_active":"2023-06-10T19:02:02.669171+0000","last_peered":"2023-06-10T19:02:02.669171+0000","last_clean":"2023-06-10T19:02:02.669171+0000","last_became_active":"2023-06-10T19:02:02.665052+0000","last_became_peered":"2023-06-10T19:02:02.665052+0000","last_unstale":"2023-06-10T19:02:02.669171+0000","last_undegraded":"2023-06-10T19:02:02.669171+0000","last_fullsized":"2023-06-10T19:02:02.669171+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:29:40.789452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.682118+0000","last_change":"2023-06-10T19:02:02.671565+0000","last_active":"2023-06-10T19:02:02.682118+0000","last_peered":"2023-06-10T19:02:02.682118+0000","last_clean":"2023-06-10T19:02:02.682118+0000","last_became_active":"2023-06-10T19:02:02.670788+0000","last_became_peered":"2023-06-10T19:02:02.670788+0000","last_unstale":"2023-06-10T19:02:02.682118+0000","last_undegraded":"2023-06-10T19:02:02.682118+0000","last_fullsized":"2023-06-10T19:02:02.682118+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:00:31.321984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":6,"reported_epoch":93,"state":"active","last_fresh":"2023-06-10T19:02:02.684122+0000","last_change":"2023-06-10T19:02:02.684069+0000","last_active":"2023-06-10T19:02:02.684122+0000","last_peered":"2023-06-10T19:02:02.684122+0000","last_clean":"2023-06-10T19:02:02.249926+0000","last_became_active":"2023-06-10T19:02:02.684069+0000","last_became_peered":"2023-06-10T19:02:02.684069+0000","last_unstale":"2023-06-10T19:02:02.684122+0000","last_undegraded":"2023-06-10T19:02:02.684122+0000","last_fullsized":"2023-06-10T19:02:02.684122+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:11:53.215763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":["3","4"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":3,"reported_epoch":93,"state":"creating+activating","last_fresh":"2023-06-10T19:02:02.661419+0000","last_change":"2023-06-10T19:02:02.661419+0000","last_active":"2023-06-10T19:02:02.249926+0000","last_peered":"2023-06-10T19:02:02.249926+0000","last_clean":"2023-06-10T19:02:02.249926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:02:02.661419+0000","last_undegraded":"2023-06-10T19:02:02.661419+0000","last_fullsized":"2023-06-10T19:02:02.661419+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:31:20.879352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":["1","6"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":3,"reported_epoch":93,"state":"creating+activating","last_fresh":"2023-06-10T19:02:02.657474+0000","last_change":"2023-06-10T19:02:02.657474+0000","last_active":"2023-06-10T19:02:02.249926+0000","last_peered":"2023-06-10T19:02:02.249926+0000","last_clean":"2023-06-10T19:02:02.249926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:02:02.657474+0000","last_undegraded":"2023-06-10T19:02:02.657474+0000","last_fullsized":"2023-06-10T19:02:02.657474+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:03:34.938582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":["4","6"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.675187+0000","last_change":"2023-06-10T19:02:02.673704+0000","last_active":"2023-06-10T19:02:02.675187+0000","last_peered":"2023-06-10T19:02:02.675187+0000","last_clean":"2023-06-10T19:02:02.675187+0000","last_became_active":"2023-06-10T19:02:02.673439+0000","last_became_peered":"2023-06-10T19:02:02.673439+0000","last_unstale":"2023-06-10T19:02:02.675187+0000","last_undegraded":"2023-06-10T19:02:02.675187+0000","last_fullsized":"2023-06-10T19:02:02.675187+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:06:44.533034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.695952+0000","last_change":"2023-06-10T19:02:02.695952+0000","last_active":"2023-06-10T19:02:02.695952+0000","last_peered":"2023-06-10T19:02:02.695952+0000","last_clean":"2023-06-10T19:02:02.695952+0000","last_became_active":"2023-06-10T19:02:02.695070+0000","last_became_peered":"2023-06-10T19:02:02.695070+0000","last_unstale":"2023-06-10T19:02:02.695952+0000","last_undegraded":"2023-06-10T19:02:02.695952+0000","last_fullsized":"2023-06-10T19:02:02.695952+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:37:04.857782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":3,"reported_epoch":93,"state":"creating+activating","last_fresh":"2023-06-10T19:02:02.659355+0000","last_change":"2023-06-10T19:02:02.659355+0000","last_active":"2023-06-10T19:02:02.249926+0000","last_peered":"2023-06-10T19:02:02.249926+0000","last_clean":"2023-06-10T19:02:02.249926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:02:02.659355+0000","last_undegraded":"2023-06-10T19:02:02.659355+0000","last_fullsized":"2023-06-10T19:02:02.659355+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:47:51.626220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":["1","7"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.680828+0000","last_change":"2023-06-10T19:02:02.680828+0000","last_active":"2023-06-10T19:02:02.680828+0000","last_peered":"2023-06-10T19:02:02.680828+0000","last_clean":"2023-06-10T19:02:02.680828+0000","last_became_active":"2023-06-10T19:02:02.680039+0000","last_became_peered":"2023-06-10T19:02:02.680039+0000","last_unstale":"2023-06-10T19:02:02.680828+0000","last_undegraded":"2023-06-10T19:02:02.680828+0000","last_fullsized":"2023-06-10T19:02:02.680828+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:24:00.414173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.666888+0000","last_change":"2023-06-10T19:02:02.665553+0000","last_active":"2023-06-10T19:02:02.666888+0000","last_peered":"2023-06-10T19:02:02.666888+0000","last_clean":"2023-06-10T19:02:02.666888+0000","last_became_active":"2023-06-10T19:02:02.665255+0000","last_became_peered":"2023-06-10T19:02:02.665255+0000","last_unstale":"2023-06-10T19:02:02.666888+0000","last_undegraded":"2023-06-10T19:02:02.666888+0000","last_fullsized":"2023-06-10T19:02:02.666888+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:01:36.281962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.683637+0000","last_change":"2023-06-10T19:02:02.683637+0000","last_active":"2023-06-10T19:02:02.683637+0000","last_peered":"2023-06-10T19:02:02.683637+0000","last_clean":"2023-06-10T19:02:02.683637+0000","last_became_active":"2023-06-10T19:02:02.682347+0000","last_became_peered":"2023-06-10T19:02:02.682347+0000","last_unstale":"2023-06-10T19:02:02.683637+0000","last_undegraded":"2023-06-10T19:02:02.683637+0000","last_fullsized":"2023-06-10T19:02:02.683637+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:43:54.501946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.672099+0000","last_change":"2023-06-10T19:02:02.670292+0000","last_active":"2023-06-10T19:02:02.672099+0000","last_peered":"2023-06-10T19:02:02.672099+0000","last_clean":"2023-06-10T19:02:02.672099+0000","last_became_active":"2023-06-10T19:02:02.670000+0000","last_became_peered":"2023-06-10T19:02:02.670000+0000","last_unstale":"2023-06-10T19:02:02.672099+0000","last_undegraded":"2023-06-10T19:02:02.672099+0000","last_fullsized":"2023-06-10T19:02:02.672099+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:11:24.917653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":3,"reported_epoch":93,"state":"creating+activating","last_fresh":"2023-06-10T19:02:02.659481+0000","last_change":"2023-06-10T19:02:02.659481+0000","last_active":"2023-06-10T19:02:02.249926+0000","last_peered":"2023-06-10T19:02:02.249926+0000","last_clean":"2023-06-10T19:02:02.249926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:02:02.659481+0000","last_undegraded":"2023-06-10T19:02:02.659481+0000","last_fullsized":"2023-06-10T19:02:02.659481+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:52:50.215857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":["1","7"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.685717+0000","last_change":"2023-06-10T19:02:02.685717+0000","last_active":"2023-06-10T19:02:02.685717+0000","last_peered":"2023-06-10T19:02:02.685717+0000","last_clean":"2023-06-10T19:02:02.685717+0000","last_became_active":"2023-06-10T19:02:02.685029+0000","last_became_peered":"2023-06-10T19:02:02.685029+0000","last_unstale":"2023-06-10T19:02:02.685717+0000","last_undegraded":"2023-06-10T19:02:02.685717+0000","last_fullsized":"2023-06-10T19:02:02.685717+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:26:09.337773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.678129+0000","last_change":"2023-06-10T19:02:02.672291+0000","last_active":"2023-06-10T19:02:02.678129+0000","last_peered":"2023-06-10T19:02:02.678129+0000","last_clean":"2023-06-10T19:02:02.678129+0000","last_became_active":"2023-06-10T19:02:02.672015+0000","last_became_peered":"2023-06-10T19:02:02.672015+0000","last_unstale":"2023-06-10T19:02:02.678129+0000","last_undegraded":"2023-06-10T19:02:02.678129+0000","last_fullsized":"2023-06-10T19:02:02.678129+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:40:40.525125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.674754+0000","last_change":"2023-06-10T19:02:02.672362+0000","last_active":"2023-06-10T19:02:02.674754+0000","last_peered":"2023-06-10T19:02:02.674754+0000","last_clean":"2023-06-10T19:02:02.674754+0000","last_became_active":"2023-06-10T19:02:02.672058+0000","last_became_peered":"2023-06-10T19:02:02.672058+0000","last_unstale":"2023-06-10T19:02:02.674754+0000","last_undegraded":"2023-06-10T19:02:02.674754+0000","last_fullsized":"2023-06-10T19:02:02.674754+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:31:04.035723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.671418+0000","last_change":"2023-06-10T19:02:02.667709+0000","last_active":"2023-06-10T19:02:02.671418+0000","last_peered":"2023-06-10T19:02:02.671418+0000","last_clean":"2023-06-10T19:02:02.671418+0000","last_became_active":"2023-06-10T19:02:02.667406+0000","last_became_peered":"2023-06-10T19:02:02.667406+0000","last_unstale":"2023-06-10T19:02:02.671418+0000","last_undegraded":"2023-06-10T19:02:02.671418+0000","last_fullsized":"2023-06-10T19:02:02.671418+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:33:34.138735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.670100+0000","last_change":"2023-06-10T19:02:02.668883+0000","last_active":"2023-06-10T19:02:02.670100+0000","last_peered":"2023-06-10T19:02:02.670100+0000","last_clean":"2023-06-10T19:02:02.670100+0000","last_became_active":"2023-06-10T19:02:02.668590+0000","last_became_peered":"2023-06-10T19:02:02.668590+0000","last_unstale":"2023-06-10T19:02:02.670100+0000","last_undegraded":"2023-06-10T19:02:02.670100+0000","last_fullsized":"2023-06-10T19:02:02.670100+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:53:17.016074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.699972+0000","last_change":"2023-06-10T19:02:02.699972+0000","last_active":"2023-06-10T19:02:02.699972+0000","last_peered":"2023-06-10T19:02:02.699972+0000","last_clean":"2023-06-10T19:02:02.699972+0000","last_became_active":"2023-06-10T19:02:02.699193+0000","last_became_peered":"2023-06-10T19:02:02.699193+0000","last_unstale":"2023-06-10T19:02:02.699972+0000","last_undegraded":"2023-06-10T19:02:02.699972+0000","last_fullsized":"2023-06-10T19:02:02.699972+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:57:42.325766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.675762+0000","last_change":"2023-06-10T19:02:02.671985+0000","last_active":"2023-06-10T19:02:02.675762+0000","last_peered":"2023-06-10T19:02:02.675762+0000","last_clean":"2023-06-10T19:02:02.675762+0000","last_became_active":"2023-06-10T19:02:02.671708+0000","last_became_peered":"2023-06-10T19:02:02.671708+0000","last_unstale":"2023-06-10T19:02:02.675762+0000","last_undegraded":"2023-06-10T19:02:02.675762+0000","last_fullsized":"2023-06-10T19:02:02.675762+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:00:44.753228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":6,"reported_epoch":93,"state":"active","last_fresh":"2023-06-10T19:02:02.700007+0000","last_change":"2023-06-10T19:02:02.699835+0000","last_active":"2023-06-10T19:02:02.700007+0000","last_peered":"2023-06-10T19:02:02.700007+0000","last_clean":"2023-06-10T19:02:02.249926+0000","last_became_active":"2023-06-10T19:02:02.699835+0000","last_became_peered":"2023-06-10T19:02:02.699835+0000","last_unstale":"2023-06-10T19:02:02.700007+0000","last_undegraded":"2023-06-10T19:02:02.700007+0000","last_fullsized":"2023-06-10T19:02:02.700007+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:32:47.372339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":["4","7"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.681477+0000","last_change":"2023-06-10T19:02:02.681477+0000","last_active":"2023-06-10T19:02:02.681477+0000","last_peered":"2023-06-10T19:02:02.681477+0000","last_clean":"2023-06-10T19:02:02.681477+0000","last_became_active":"2023-06-10T19:02:02.680610+0000","last_became_peered":"2023-06-10T19:02:02.680610+0000","last_unstale":"2023-06-10T19:02:02.681477+0000","last_undegraded":"2023-06-10T19:02:02.681477+0000","last_fullsized":"2023-06-10T19:02:02.681477+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:55:18.294198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":4,"reported_epoch":93,"state":"creating+activating","last_fresh":"2023-06-10T19:02:02.688412+0000","last_change":"2023-06-10T19:02:02.684696+0000","last_active":"2023-06-10T19:02:02.249926+0000","last_peered":"2023-06-10T19:02:02.249926+0000","last_clean":"2023-06-10T19:02:02.249926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:02:02.688412+0000","last_undegraded":"2023-06-10T19:02:02.688412+0000","last_fullsized":"2023-06-10T19:02:02.688412+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:11:53.215763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":["6","1"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.683119+0000","last_change":"2023-06-10T19:02:02.682530+0000","last_active":"2023-06-10T19:02:02.683119+0000","last_peered":"2023-06-10T19:02:02.683119+0000","last_clean":"2023-06-10T19:02:02.683119+0000","last_became_active":"2023-06-10T19:02:02.682004+0000","last_became_peered":"2023-06-10T19:02:02.682004+0000","last_unstale":"2023-06-10T19:02:02.683119+0000","last_undegraded":"2023-06-10T19:02:02.683119+0000","last_fullsized":"2023-06-10T19:02:02.683119+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:27:26.714581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":3,"reported_epoch":93,"state":"creating+activating","last_fresh":"2023-06-10T19:02:02.653940+0000","last_change":"2023-06-10T19:02:02.653940+0000","last_active":"2023-06-10T19:02:02.249926+0000","last_peered":"2023-06-10T19:02:02.249926+0000","last_clean":"2023-06-10T19:02:02.249926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:02:02.653940+0000","last_undegraded":"2023-06-10T19:02:02.653940+0000","last_fullsized":"2023-06-10T19:02:02.653940+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:07:43.322174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":["5","6"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.698521+0000","last_change":"2023-06-10T19:02:02.698521+0000","last_active":"2023-06-10T19:02:02.698521+0000","last_peered":"2023-06-10T19:02:02.698521+0000","last_clean":"2023-06-10T19:02:02.698521+0000","last_became_active":"2023-06-10T19:02:02.697781+0000","last_became_peered":"2023-06-10T19:02:02.697781+0000","last_unstale":"2023-06-10T19:02:02.698521+0000","last_undegraded":"2023-06-10T19:02:02.698521+0000","last_fullsized":"2023-06-10T19:02:02.698521+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:44:52.629437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":3,"reported_epoch":93,"state":"creating+activating","last_fresh":"2023-06-10T19:02:02.655425+0000","last_change":"2023-06-10T19:02:02.655425+0000","last_active":"2023-06-10T19:02:02.249926+0000","last_peered":"2023-06-10T19:02:02.249926+0000","last_clean":"2023-06-10T19:02:02.249926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:02:02.655425+0000","last_undegraded":"2023-06-10T19:02:02.655425+0000","last_fullsized":"2023-06-10T19:02:02.655425+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:36:26.678143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":["2","6"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":3,"reported_epoch":93,"state":"creating+activating","last_fresh":"2023-06-10T19:02:02.661225+0000","last_change":"2023-06-10T19:02:02.661225+0000","last_active":"2023-06-10T19:02:02.249926+0000","last_peered":"2023-06-10T19:02:02.249926+0000","last_clean":"2023-06-10T19:02:02.249926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:02:02.661225+0000","last_undegraded":"2023-06-10T19:02:02.661225+0000","last_fullsized":"2023-06-10T19:02:02.661225+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:20:57.647766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":["1","4"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":6,"reported_epoch":93,"state":"active","last_fresh":"2023-06-10T19:02:02.701356+0000","last_change":"2023-06-10T19:02:02.696178+0000","last_active":"2023-06-10T19:02:02.701356+0000","last_peered":"2023-06-10T19:02:02.701356+0000","last_clean":"2023-06-10T19:02:02.249926+0000","last_became_active":"2023-06-10T19:02:02.696178+0000","last_became_peered":"2023-06-10T19:02:02.696178+0000","last_unstale":"2023-06-10T19:02:02.701356+0000","last_undegraded":"2023-06-10T19:02:02.701356+0000","last_fullsized":"2023-06-10T19:02:02.701356+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:33:48.265078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":["7","2"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.681746+0000","last_change":"2023-06-10T19:02:02.681746+0000","last_active":"2023-06-10T19:02:02.681746+0000","last_peered":"2023-06-10T19:02:02.681746+0000","last_clean":"2023-06-10T19:02:02.681746+0000","last_became_active":"2023-06-10T19:02:02.678889+0000","last_became_peered":"2023-06-10T19:02:02.678889+0000","last_unstale":"2023-06-10T19:02:02.681746+0000","last_undegraded":"2023-06-10T19:02:02.681746+0000","last_fullsized":"2023-06-10T19:02:02.681746+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:17:32.462150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.682120+0000","last_change":"2023-06-10T19:02:02.666485+0000","last_active":"2023-06-10T19:02:02.682120+0000","last_peered":"2023-06-10T19:02:02.682120+0000","last_clean":"2023-06-10T19:02:02.682120+0000","last_became_active":"2023-06-10T19:02:02.665650+0000","last_became_peered":"2023-06-10T19:02:02.665650+0000","last_unstale":"2023-06-10T19:02:02.682120+0000","last_undegraded":"2023-06-10T19:02:02.682120+0000","last_fullsized":"2023-06-10T19:02:02.682120+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:22:27.373589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.672704+0000","last_change":"2023-06-10T19:02:02.668274+0000","last_active":"2023-06-10T19:02:02.672704+0000","last_peered":"2023-06-10T19:02:02.672704+0000","last_clean":"2023-06-10T19:02:02.672704+0000","last_became_active":"2023-06-10T19:02:02.668009+0000","last_became_peered":"2023-06-10T19:02:02.668009+0000","last_unstale":"2023-06-10T19:02:02.672704+0000","last_undegraded":"2023-06-10T19:02:02.672704+0000","last_fullsized":"2023-06-10T19:02:02.672704+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:06:19.466195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.681658+0000","last_change":"2023-06-10T19:02:02.680375+0000","last_active":"2023-06-10T19:02:02.681658+0000","last_peered":"2023-06-10T19:02:02.681658+0000","last_clean":"2023-06-10T19:02:02.681658+0000","last_became_active":"2023-06-10T19:02:02.680094+0000","last_became_peered":"2023-06-10T19:02:02.680094+0000","last_unstale":"2023-06-10T19:02:02.681658+0000","last_undegraded":"2023-06-10T19:02:02.681658+0000","last_fullsized":"2023-06-10T19:02:02.681658+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:42:19.372587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"93'4","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.691765+0000","last_change":"2023-06-10T19:02:02.307615+0000","last_active":"2023-06-10T19:02:02.691765+0000","last_peered":"2023-06-10T19:02:02.691765+0000","last_clean":"2023-06-10T19:02:02.691765+0000","last_became_active":"2023-06-10T19:02:02.306543+0000","last_became_peered":"2023-06-10T19:02:02.306543+0000","last_unstale":"2023-06-10T19:02:02.691765+0000","last_undegraded":"2023-06-10T19:02:02.691765+0000","last_fullsized":"2023-06-10T19:02:02.691765+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:10:52.708577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.669093+0000","last_change":"2023-06-10T19:02:02.662624+0000","last_active":"2023-06-10T19:02:02.669093+0000","last_peered":"2023-06-10T19:02:02.669093+0000","last_clean":"2023-06-10T19:02:02.669093+0000","last_became_active":"2023-06-10T19:02:02.662135+0000","last_became_peered":"2023-06-10T19:02:02.662135+0000","last_unstale":"2023-06-10T19:02:02.669093+0000","last_undegraded":"2023-06-10T19:02:02.669093+0000","last_fullsized":"2023-06-10T19:02:02.669093+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:14:40.833061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.662673+0000","last_change":"2023-06-10T19:02:02.308152+0000","last_active":"2023-06-10T19:02:02.662673+0000","last_peered":"2023-06-10T19:02:02.662673+0000","last_clean":"2023-06-10T19:02:02.662673+0000","last_became_active":"2023-06-10T19:02:02.307326+0000","last_became_peered":"2023-06-10T19:02:02.307326+0000","last_unstale":"2023-06-10T19:02:02.662673+0000","last_undegraded":"2023-06-10T19:02:02.662673+0000","last_fullsized":"2023-06-10T19:02:02.662673+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:49:52.268993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.698529+0000","last_change":"2023-06-10T19:02:02.698529+0000","last_active":"2023-06-10T19:02:02.698529+0000","last_peered":"2023-06-10T19:02:02.698529+0000","last_clean":"2023-06-10T19:02:02.698529+0000","last_became_active":"2023-06-10T19:02:02.697828+0000","last_became_peered":"2023-06-10T19:02:02.697828+0000","last_unstale":"2023-06-10T19:02:02.698529+0000","last_undegraded":"2023-06-10T19:02:02.698529+0000","last_fullsized":"2023-06-10T19:02:02.698529+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:33:31.316563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"93'2","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.674605+0000","last_change":"2023-06-10T19:02:02.298653+0000","last_active":"2023-06-10T19:02:02.674605+0000","last_peered":"2023-06-10T19:02:02.674605+0000","last_clean":"2023-06-10T19:02:02.674605+0000","last_became_active":"2023-06-10T19:02:02.297891+0000","last_became_peered":"2023-06-10T19:02:02.297891+0000","last_unstale":"2023-06-10T19:02:02.674605+0000","last_undegraded":"2023-06-10T19:02:02.674605+0000","last_fullsized":"2023-06-10T19:02:02.674605+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:53:23.935997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":3,"reported_epoch":93,"state":"creating+activating","last_fresh":"2023-06-10T19:02:02.650584+0000","last_change":"2023-06-10T19:02:02.650584+0000","last_active":"2023-06-10T19:02:02.249926+0000","last_peered":"2023-06-10T19:02:02.249926+0000","last_clean":"2023-06-10T19:02:02.249926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:02:02.650584+0000","last_undegraded":"2023-06-10T19:02:02.650584+0000","last_fullsized":"2023-06-10T19:02:02.650584+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:20:12.939183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":["0","6"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"93'2","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.691249+0000","last_change":"2023-06-10T19:02:02.309210+0000","last_active":"2023-06-10T19:02:02.691249+0000","last_peered":"2023-06-10T19:02:02.691249+0000","last_clean":"2023-06-10T19:02:02.691249+0000","last_became_active":"2023-06-10T19:02:02.307262+0000","last_became_peered":"2023-06-10T19:02:02.307262+0000","last_unstale":"2023-06-10T19:02:02.691249+0000","last_undegraded":"2023-06-10T19:02:02.691249+0000","last_fullsized":"2023-06-10T19:02:02.691249+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:53:16.012428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.678306+0000","last_change":"2023-06-10T19:02:02.675152+0000","last_active":"2023-06-10T19:02:02.678306+0000","last_peered":"2023-06-10T19:02:02.678306+0000","last_clean":"2023-06-10T19:02:02.678306+0000","last_became_active":"2023-06-10T19:02:02.672817+0000","last_became_peered":"2023-06-10T19:02:02.672817+0000","last_unstale":"2023-06-10T19:02:02.678306+0000","last_undegraded":"2023-06-10T19:02:02.678306+0000","last_fullsized":"2023-06-10T19:02:02.678306+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:43:35.825854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"93'1","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.697572+0000","last_change":"2023-06-10T19:02:02.285398+0000","last_active":"2023-06-10T19:02:02.697572+0000","last_peered":"2023-06-10T19:02:02.697572+0000","last_clean":"2023-06-10T19:02:02.697572+0000","last_became_active":"2023-06-10T19:02:02.284766+0000","last_became_peered":"2023-06-10T19:02:02.284766+0000","last_unstale":"2023-06-10T19:02:02.697572+0000","last_undegraded":"2023-06-10T19:02:02.697572+0000","last_fullsized":"2023-06-10T19:02:02.697572+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:35:48.643951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":4,"reported_epoch":93,"state":"creating+activating","last_fresh":"2023-06-10T19:02:02.687783+0000","last_change":"2023-06-10T19:02:02.684502+0000","last_active":"2023-06-10T19:02:02.249926+0000","last_peered":"2023-06-10T19:02:02.249926+0000","last_clean":"2023-06-10T19:02:02.249926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:02:02.687783+0000","last_undegraded":"2023-06-10T19:02:02.687783+0000","last_fullsized":"2023-06-10T19:02:02.687783+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:34:43.072692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":["6","0"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"93'1","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.675575+0000","last_change":"2023-06-10T19:02:02.280702+0000","last_active":"2023-06-10T19:02:02.675575+0000","last_peered":"2023-06-10T19:02:02.675575+0000","last_clean":"2023-06-10T19:02:02.675575+0000","last_became_active":"2023-06-10T19:02:02.280060+0000","last_became_peered":"2023-06-10T19:02:02.280060+0000","last_unstale":"2023-06-10T19:02:02.675575+0000","last_undegraded":"2023-06-10T19:02:02.675575+0000","last_fullsized":"2023-06-10T19:02:02.675575+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:42:06.945432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.677557+0000","last_change":"2023-06-10T19:02:02.676743+0000","last_active":"2023-06-10T19:02:02.677557+0000","last_peered":"2023-06-10T19:02:02.677557+0000","last_clean":"2023-06-10T19:02:02.677557+0000","last_became_active":"2023-06-10T19:02:02.676452+0000","last_became_peered":"2023-06-10T19:02:02.676452+0000","last_unstale":"2023-06-10T19:02:02.677557+0000","last_undegraded":"2023-06-10T19:02:02.677557+0000","last_fullsized":"2023-06-10T19:02:02.677557+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:40:33.473940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.658568+0000","last_change":"2023-06-10T19:02:02.291503+0000","last_active":"2023-06-10T19:02:02.658568+0000","last_peered":"2023-06-10T19:02:02.658568+0000","last_clean":"2023-06-10T19:02:02.658568+0000","last_became_active":"2023-06-10T19:02:02.291257+0000","last_became_peered":"2023-06-10T19:02:02.291257+0000","last_unstale":"2023-06-10T19:02:02.658568+0000","last_undegraded":"2023-06-10T19:02:02.658568+0000","last_fullsized":"2023-06-10T19:02:02.658568+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:10:52.708577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":3,"reported_epoch":93,"state":"creating+activating","last_fresh":"2023-06-10T19:02:02.659597+0000","last_change":"2023-06-10T19:02:02.659597+0000","last_active":"2023-06-10T19:02:02.249926+0000","last_peered":"2023-06-10T19:02:02.249926+0000","last_clean":"2023-06-10T19:02:02.249926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:02:02.659597+0000","last_undegraded":"2023-06-10T19:02:02.659597+0000","last_fullsized":"2023-06-10T19:02:02.659597+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:28:01.941970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":["1","6"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.671489+0000","last_change":"2023-06-10T19:02:02.298471+0000","last_active":"2023-06-10T19:02:02.671489+0000","last_peered":"2023-06-10T19:02:02.671489+0000","last_clean":"2023-06-10T19:02:02.671489+0000","last_became_active":"2023-06-10T19:02:02.297847+0000","last_became_peered":"2023-06-10T19:02:02.297847+0000","last_unstale":"2023-06-10T19:02:02.671489+0000","last_undegraded":"2023-06-10T19:02:02.671489+0000","last_fullsized":"2023-06-10T19:02:02.671489+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:22:24.304786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.699437+0000","last_change":"2023-06-10T19:02:02.699437+0000","last_active":"2023-06-10T19:02:02.699437+0000","last_peered":"2023-06-10T19:02:02.699437+0000","last_clean":"2023-06-10T19:02:02.699437+0000","last_became_active":"2023-06-10T19:02:02.698803+0000","last_became_peered":"2023-06-10T19:02:02.698803+0000","last_unstale":"2023-06-10T19:02:02.699437+0000","last_undegraded":"2023-06-10T19:02:02.699437+0000","last_fullsized":"2023-06-10T19:02:02.699437+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:22:04.513117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.656570+0000","last_change":"2023-06-10T19:02:02.293125+0000","last_active":"2023-06-10T19:02:02.656570+0000","last_peered":"2023-06-10T19:02:02.656570+0000","last_clean":"2023-06-10T19:02:02.656570+0000","last_became_active":"2023-06-10T19:02:02.292366+0000","last_became_peered":"2023-06-10T19:02:02.292366+0000","last_unstale":"2023-06-10T19:02:02.656570+0000","last_undegraded":"2023-06-10T19:02:02.656570+0000","last_fullsized":"2023-06-10T19:02:02.656570+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:29:48.947745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":3,"reported_epoch":93,"state":"creating+activating","last_fresh":"2023-06-10T19:02:02.673955+0000","last_change":"2023-06-10T19:02:02.673955+0000","last_active":"2023-06-10T19:02:02.249926+0000","last_peered":"2023-06-10T19:02:02.249926+0000","last_clean":"2023-06-10T19:02:02.249926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:02:02.673955+0000","last_undegraded":"2023-06-10T19:02:02.673955+0000","last_fullsized":"2023-06-10T19:02:02.673955+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:28:08.816029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":["7","4"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.655755+0000","last_change":"2023-06-10T19:02:02.286161+0000","last_active":"2023-06-10T19:02:02.655755+0000","last_peered":"2023-06-10T19:02:02.655755+0000","last_clean":"2023-06-10T19:02:02.655755+0000","last_became_active":"2023-06-10T19:02:02.285856+0000","last_became_peered":"2023-06-10T19:02:02.285856+0000","last_unstale":"2023-06-10T19:02:02.655755+0000","last_undegraded":"2023-06-10T19:02:02.655755+0000","last_fullsized":"2023-06-10T19:02:02.655755+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:24:38.099052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.669041+0000","last_change":"2023-06-10T19:02:02.665868+0000","last_active":"2023-06-10T19:02:02.669041+0000","last_peered":"2023-06-10T19:02:02.669041+0000","last_clean":"2023-06-10T19:02:02.669041+0000","last_became_active":"2023-06-10T19:02:02.665665+0000","last_became_peered":"2023-06-10T19:02:02.665665+0000","last_unstale":"2023-06-10T19:02:02.669041+0000","last_undegraded":"2023-06-10T19:02:02.669041+0000","last_fullsized":"2023-06-10T19:02:02.669041+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:58:45.386899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"93'3","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.698138+0000","last_change":"2023-06-10T19:02:02.294019+0000","last_active":"2023-06-10T19:02:02.698138+0000","last_peered":"2023-06-10T19:02:02.698138+0000","last_clean":"2023-06-10T19:02:02.698138+0000","last_became_active":"2023-06-10T19:02:02.293205+0000","last_became_peered":"2023-06-10T19:02:02.293205+0000","last_unstale":"2023-06-10T19:02:02.698138+0000","last_undegraded":"2023-06-10T19:02:02.698138+0000","last_fullsized":"2023-06-10T19:02:02.698138+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:04:37.882090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.681206+0000","last_change":"2023-06-10T19:02:02.680173+0000","last_active":"2023-06-10T19:02:02.681206+0000","last_peered":"2023-06-10T19:02:02.681206+0000","last_clean":"2023-06-10T19:02:02.681206+0000","last_became_active":"2023-06-10T19:02:02.679854+0000","last_became_peered":"2023-06-10T19:02:02.679854+0000","last_unstale":"2023-06-10T19:02:02.681206+0000","last_undegraded":"2023-06-10T19:02:02.681206+0000","last_fullsized":"2023-06-10T19:02:02.681206+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:21:52.001634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"93'5","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.650293+0000","last_change":"2023-06-10T19:02:02.310650+0000","last_active":"2023-06-10T19:02:02.650293+0000","last_peered":"2023-06-10T19:02:02.650293+0000","last_clean":"2023-06-10T19:02:02.650293+0000","last_became_active":"2023-06-10T19:02:02.310205+0000","last_became_peered":"2023-06-10T19:02:02.310205+0000","last_unstale":"2023-06-10T19:02:02.650293+0000","last_undegraded":"2023-06-10T19:02:02.650293+0000","last_fullsized":"2023-06-10T19:02:02.650293+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:42:24.597366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":3,"reported_epoch":93,"state":"creating+activating","last_fresh":"2023-06-10T19:02:02.659786+0000","last_change":"2023-06-10T19:02:02.659786+0000","last_active":"2023-06-10T19:02:02.249926+0000","last_peered":"2023-06-10T19:02:02.249926+0000","last_clean":"2023-06-10T19:02:02.249926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:02:02.659786+0000","last_undegraded":"2023-06-10T19:02:02.659786+0000","last_fullsized":"2023-06-10T19:02:02.659786+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:52:33.909329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":["1","7"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"93'2","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.674343+0000","last_change":"2023-06-10T19:02:02.298494+0000","last_active":"2023-06-10T19:02:02.674343+0000","last_peered":"2023-06-10T19:02:02.674343+0000","last_clean":"2023-06-10T19:02:02.674343+0000","last_became_active":"2023-06-10T19:02:02.298008+0000","last_became_peered":"2023-06-10T19:02:02.298008+0000","last_unstale":"2023-06-10T19:02:02.674343+0000","last_undegraded":"2023-06-10T19:02:02.674343+0000","last_fullsized":"2023-06-10T19:02:02.674343+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:26:51.452323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":3,"reported_epoch":93,"state":"creating+activating","last_fresh":"2023-06-10T19:02:02.659742+0000","last_change":"2023-06-10T19:02:02.659742+0000","last_active":"2023-06-10T19:02:02.249926+0000","last_peered":"2023-06-10T19:02:02.249926+0000","last_clean":"2023-06-10T19:02:02.249926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:02:02.659742+0000","last_undegraded":"2023-06-10T19:02:02.659742+0000","last_fullsized":"2023-06-10T19:02:02.659742+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:13:21.429650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":["4","6"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.650314+0000","last_change":"2023-06-10T19:02:02.297466+0000","last_active":"2023-06-10T19:02:02.650314+0000","last_peered":"2023-06-10T19:02:02.650314+0000","last_clean":"2023-06-10T19:02:02.650314+0000","last_became_active":"2023-06-10T19:02:02.297118+0000","last_became_peered":"2023-06-10T19:02:02.297118+0000","last_unstale":"2023-06-10T19:02:02.650314+0000","last_undegraded":"2023-06-10T19:02:02.650314+0000","last_fullsized":"2023-06-10T19:02:02.650314+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:02:26.409776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.677300+0000","last_change":"2023-06-10T19:02:02.676309+0000","last_active":"2023-06-10T19:02:02.677300+0000","last_peered":"2023-06-10T19:02:02.677300+0000","last_clean":"2023-06-10T19:02:02.677300+0000","last_became_active":"2023-06-10T19:02:02.676005+0000","last_became_peered":"2023-06-10T19:02:02.676005+0000","last_unstale":"2023-06-10T19:02:02.677300+0000","last_undegraded":"2023-06-10T19:02:02.677300+0000","last_fullsized":"2023-06-10T19:02:02.677300+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:31:23.514936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.661968+0000","last_change":"2023-06-10T19:02:02.309000+0000","last_active":"2023-06-10T19:02:02.661968+0000","last_peered":"2023-06-10T19:02:02.661968+0000","last_clean":"2023-06-10T19:02:02.661968+0000","last_became_active":"2023-06-10T19:02:02.308410+0000","last_became_peered":"2023-06-10T19:02:02.308410+0000","last_unstale":"2023-06-10T19:02:02.661968+0000","last_undegraded":"2023-06-10T19:02:02.661968+0000","last_fullsized":"2023-06-10T19:02:02.661968+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:05:00.965851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":3,"reported_epoch":93,"state":"creating+activating","last_fresh":"2023-06-10T19:02:02.654118+0000","last_change":"2023-06-10T19:02:02.654118+0000","last_active":"2023-06-10T19:02:02.249926+0000","last_peered":"2023-06-10T19:02:02.249926+0000","last_clean":"2023-06-10T19:02:02.249926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:02:02.654118+0000","last_undegraded":"2023-06-10T19:02:02.654118+0000","last_fullsized":"2023-06-10T19:02:02.654118+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:41:19.173789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":["2","4"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"93'8","reported_seq":19,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.676823+0000","last_change":"2023-06-10T19:02:02.281076+0000","last_active":"2023-06-10T19:02:02.676823+0000","last_peered":"2023-06-10T19:02:02.676823+0000","last_clean":"2023-06-10T19:02:02.676823+0000","last_became_active":"2023-06-10T19:02:02.280784+0000","last_became_peered":"2023-06-10T19:02:02.280784+0000","last_unstale":"2023-06-10T19:02:02.676823+0000","last_undegraded":"2023-06-10T19:02:02.676823+0000","last_fullsized":"2023-06-10T19:02:02.676823+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:52:28.532909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":3,"reported_epoch":93,"state":"creating+activating","last_fresh":"2023-06-10T19:02:02.684672+0000","last_change":"2023-06-10T19:02:02.684672+0000","last_active":"2023-06-10T19:02:02.249926+0000","last_peered":"2023-06-10T19:02:02.249926+0000","last_clean":"2023-06-10T19:02:02.249926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:02:02.684672+0000","last_undegraded":"2023-06-10T19:02:02.684672+0000","last_fullsized":"2023-06-10T19:02:02.684672+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:48:21.883343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":["6","7"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"93'2","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.677238+0000","last_change":"2023-06-10T19:02:02.310148+0000","last_active":"2023-06-10T19:02:02.677238+0000","last_peered":"2023-06-10T19:02:02.677238+0000","last_clean":"2023-06-10T19:02:02.677238+0000","last_became_active":"2023-06-10T19:02:02.309423+0000","last_became_peered":"2023-06-10T19:02:02.309423+0000","last_unstale":"2023-06-10T19:02:02.677238+0000","last_undegraded":"2023-06-10T19:02:02.677238+0000","last_fullsized":"2023-06-10T19:02:02.677238+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:53:30.670784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.686338+0000","last_change":"2023-06-10T19:02:02.685473+0000","last_active":"2023-06-10T19:02:02.686338+0000","last_peered":"2023-06-10T19:02:02.686338+0000","last_clean":"2023-06-10T19:02:02.686338+0000","last_became_active":"2023-06-10T19:02:02.685192+0000","last_became_peered":"2023-06-10T19:02:02.685192+0000","last_unstale":"2023-06-10T19:02:02.686338+0000","last_undegraded":"2023-06-10T19:02:02.686338+0000","last_fullsized":"2023-06-10T19:02:02.686338+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:40:55.001540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.662921+0000","last_change":"2023-06-10T19:02:02.292855+0000","last_active":"2023-06-10T19:02:02.662921+0000","last_peered":"2023-06-10T19:02:02.662921+0000","last_clean":"2023-06-10T19:02:02.662921+0000","last_became_active":"2023-06-10T19:02:02.291984+0000","last_became_peered":"2023-06-10T19:02:02.291984+0000","last_unstale":"2023-06-10T19:02:02.662921+0000","last_undegraded":"2023-06-10T19:02:02.662921+0000","last_fullsized":"2023-06-10T19:02:02.662921+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:12:14.528079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.667098+0000","last_change":"2023-06-10T19:02:02.662196+0000","last_active":"2023-06-10T19:02:02.667098+0000","last_peered":"2023-06-10T19:02:02.667098+0000","last_clean":"2023-06-10T19:02:02.667098+0000","last_became_active":"2023-06-10T19:02:02.661887+0000","last_became_peered":"2023-06-10T19:02:02.661887+0000","last_unstale":"2023-06-10T19:02:02.667098+0000","last_undegraded":"2023-06-10T19:02:02.667098+0000","last_fullsized":"2023-06-10T19:02:02.667098+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:49:47.303424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.673305+0000","last_change":"2023-06-10T19:02:02.289260+0000","last_active":"2023-06-10T19:02:02.673305+0000","last_peered":"2023-06-10T19:02:02.673305+0000","last_clean":"2023-06-10T19:02:02.673305+0000","last_became_active":"2023-06-10T19:02:02.288017+0000","last_became_peered":"2023-06-10T19:02:02.288017+0000","last_unstale":"2023-06-10T19:02:02.673305+0000","last_undegraded":"2023-06-10T19:02:02.673305+0000","last_fullsized":"2023-06-10T19:02:02.673305+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:51:50.500411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.692335+0000","last_change":"2023-06-10T19:02:02.686971+0000","last_active":"2023-06-10T19:02:02.692335+0000","last_peered":"2023-06-10T19:02:02.692335+0000","last_clean":"2023-06-10T19:02:02.692335+0000","last_became_active":"2023-06-10T19:02:02.682303+0000","last_became_peered":"2023-06-10T19:02:02.682303+0000","last_unstale":"2023-06-10T19:02:02.692335+0000","last_undegraded":"2023-06-10T19:02:02.692335+0000","last_fullsized":"2023-06-10T19:02:02.692335+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:41:22.771429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.691399+0000","last_change":"2023-06-10T19:02:02.307602+0000","last_active":"2023-06-10T19:02:02.691399+0000","last_peered":"2023-06-10T19:02:02.691399+0000","last_clean":"2023-06-10T19:02:02.691399+0000","last_became_active":"2023-06-10T19:02:02.306340+0000","last_became_peered":"2023-06-10T19:02:02.306340+0000","last_unstale":"2023-06-10T19:02:02.691399+0000","last_undegraded":"2023-06-10T19:02:02.691399+0000","last_fullsized":"2023-06-10T19:02:02.691399+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:36:15.254045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.672236+0000","last_change":"2023-06-10T19:02:02.670591+0000","last_active":"2023-06-10T19:02:02.672236+0000","last_peered":"2023-06-10T19:02:02.672236+0000","last_clean":"2023-06-10T19:02:02.672236+0000","last_became_active":"2023-06-10T19:02:02.670311+0000","last_became_peered":"2023-06-10T19:02:02.670311+0000","last_unstale":"2023-06-10T19:02:02.672236+0000","last_undegraded":"2023-06-10T19:02:02.672236+0000","last_fullsized":"2023-06-10T19:02:02.672236+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:42:05.486292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.650842+0000","last_change":"2023-06-10T19:02:02.297604+0000","last_active":"2023-06-10T19:02:02.650842+0000","last_peered":"2023-06-10T19:02:02.650842+0000","last_clean":"2023-06-10T19:02:02.650842+0000","last_became_active":"2023-06-10T19:02:02.297290+0000","last_became_peered":"2023-06-10T19:02:02.297290+0000","last_unstale":"2023-06-10T19:02:02.650842+0000","last_undegraded":"2023-06-10T19:02:02.650842+0000","last_fullsized":"2023-06-10T19:02:02.650842+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:43:04.035379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.678108+0000","last_change":"2023-06-10T19:02:02.676849+0000","last_active":"2023-06-10T19:02:02.678108+0000","last_peered":"2023-06-10T19:02:02.678108+0000","last_clean":"2023-06-10T19:02:02.678108+0000","last_became_active":"2023-06-10T19:02:02.676586+0000","last_became_peered":"2023-06-10T19:02:02.676586+0000","last_unstale":"2023-06-10T19:02:02.678108+0000","last_undegraded":"2023-06-10T19:02:02.678108+0000","last_fullsized":"2023-06-10T19:02:02.678108+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:36:16.257691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.660986+0000","last_change":"2023-06-10T19:02:02.286569+0000","last_active":"2023-06-10T19:02:02.660986+0000","last_peered":"2023-06-10T19:02:02.660986+0000","last_clean":"2023-06-10T19:02:02.660986+0000","last_became_active":"2023-06-10T19:02:02.285744+0000","last_became_peered":"2023-06-10T19:02:02.285744+0000","last_unstale":"2023-06-10T19:02:02.660986+0000","last_undegraded":"2023-06-10T19:02:02.660986+0000","last_fullsized":"2023-06-10T19:02:02.660986+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:31:49.054392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":4,"reported_epoch":93,"state":"creating+activating","last_fresh":"2023-06-10T19:02:02.688613+0000","last_change":"2023-06-10T19:02:02.685700+0000","last_active":"2023-06-10T19:02:02.249926+0000","last_peered":"2023-06-10T19:02:02.249926+0000","last_clean":"2023-06-10T19:02:02.249926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:02:02.688613+0000","last_undegraded":"2023-06-10T19:02:02.688613+0000","last_fullsized":"2023-06-10T19:02:02.688613+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:58:45.386899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":["6","1"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.690800+0000","last_change":"2023-06-10T19:02:02.306818+0000","last_active":"2023-06-10T19:02:02.690800+0000","last_peered":"2023-06-10T19:02:02.690800+0000","last_clean":"2023-06-10T19:02:02.690800+0000","last_became_active":"2023-06-10T19:02:02.306128+0000","last_became_peered":"2023-06-10T19:02:02.306128+0000","last_unstale":"2023-06-10T19:02:02.690800+0000","last_undegraded":"2023-06-10T19:02:02.690800+0000","last_fullsized":"2023-06-10T19:02:02.690800+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:27:25.710935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.674707+0000","last_change":"2023-06-10T19:02:02.671837+0000","last_active":"2023-06-10T19:02:02.674707+0000","last_peered":"2023-06-10T19:02:02.674707+0000","last_clean":"2023-06-10T19:02:02.674707+0000","last_became_active":"2023-06-10T19:02:02.671536+0000","last_became_peered":"2023-06-10T19:02:02.671536+0000","last_unstale":"2023-06-10T19:02:02.674707+0000","last_undegraded":"2023-06-10T19:02:02.674707+0000","last_fullsized":"2023-06-10T19:02:02.674707+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:44:04.162930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.671827+0000","last_change":"2023-06-10T19:02:02.299831+0000","last_active":"2023-06-10T19:02:02.671827+0000","last_peered":"2023-06-10T19:02:02.671827+0000","last_clean":"2023-06-10T19:02:02.671827+0000","last_became_active":"2023-06-10T19:02:02.299041+0000","last_became_peered":"2023-06-10T19:02:02.299041+0000","last_unstale":"2023-06-10T19:02:02.671827+0000","last_undegraded":"2023-06-10T19:02:02.671827+0000","last_fullsized":"2023-06-10T19:02:02.671827+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:50:24.253165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":4,"reported_epoch":93,"state":"creating+activating","last_fresh":"2023-06-10T19:02:02.681390+0000","last_change":"2023-06-10T19:02:02.676482+0000","last_active":"2023-06-10T19:02:02.249926+0000","last_peered":"2023-06-10T19:02:02.249926+0000","last_clean":"2023-06-10T19:02:02.249926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:02:02.681390+0000","last_undegraded":"2023-06-10T19:02:02.681390+0000","last_fullsized":"2023-06-10T19:02:02.681390+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:38:21.898235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":["7","3"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.663683+0000","last_change":"2023-06-10T19:02:02.286969+0000","last_active":"2023-06-10T19:02:02.663683+0000","last_peered":"2023-06-10T19:02:02.663683+0000","last_clean":"2023-06-10T19:02:02.663683+0000","last_became_active":"2023-06-10T19:02:02.286247+0000","last_became_peered":"2023-06-10T19:02:02.286247+0000","last_unstale":"2023-06-10T19:02:02.663683+0000","last_undegraded":"2023-06-10T19:02:02.663683+0000","last_fullsized":"2023-06-10T19:02:02.663683+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:41:41.781956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":301,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.672339+0000","last_change":"2023-06-10T18:52:34.951528+0000","last_active":"2023-06-10T19:02:02.672339+0000","last_peered":"2023-06-10T19:02:02.672339+0000","last_clean":"2023-06-10T19:02:02.672339+0000","last_became_active":"2023-06-10T18:52:34.949099+0000","last_became_peered":"2023-06-10T18:52:34.949099+0000","last_unstale":"2023-06-10T19:02:02.672339+0000","last_undegraded":"2023-06-10T19:02:02.672339+0000","last_fullsized":"2023-06-10T19:02:02.672339+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_clean_scrub_stamp":"2023-06-10T18:52:33.633295+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:35:49.274025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":149,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.652580+0000","last_change":"2023-06-10T18:52:40.506384+0000","last_active":"2023-06-10T19:02:02.652580+0000","last_peered":"2023-06-10T19:02:02.652580+0000","last_clean":"2023-06-10T19:02:02.652580+0000","last_became_active":"2023-06-10T18:52:40.505701+0000","last_became_peered":"2023-06-10T18:52:40.505701+0000","last_unstale":"2023-06-10T19:02:02.652580+0000","last_undegraded":"2023-06-10T19:02:02.652580+0000","last_fullsized":"2023-06-10T19:02:02.652580+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:34:26.323306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.681638+0000","last_change":"2023-06-10T19:02:02.680269+0000","last_active":"2023-06-10T19:02:02.681638+0000","last_peered":"2023-06-10T19:02:02.681638+0000","last_clean":"2023-06-10T19:02:02.681638+0000","last_became_active":"2023-06-10T19:02:02.679987+0000","last_became_peered":"2023-06-10T19:02:02.679987+0000","last_unstale":"2023-06-10T19:02:02.681638+0000","last_undegraded":"2023-06-10T19:02:02.681638+0000","last_fullsized":"2023-06-10T19:02:02.681638+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:12:24.156196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.691387+0000","last_change":"2023-06-10T19:02:02.309267+0000","last_active":"2023-06-10T19:02:02.691387+0000","last_peered":"2023-06-10T19:02:02.691387+0000","last_clean":"2023-06-10T19:02:02.691387+0000","last_became_active":"2023-06-10T19:02:02.308404+0000","last_became_peered":"2023-06-10T19:02:02.308404+0000","last_unstale":"2023-06-10T19:02:02.691387+0000","last_undegraded":"2023-06-10T19:02:02.691387+0000","last_fullsized":"2023-06-10T19:02:02.691387+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:24:38.099052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":145,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.672039+0000","last_change":"2023-06-10T18:52:40.512015+0000","last_active":"2023-06-10T19:02:02.672039+0000","last_peered":"2023-06-10T19:02:02.672039+0000","last_clean":"2023-06-10T19:02:02.672039+0000","last_became_active":"2023-06-10T18:52:40.511382+0000","last_became_peered":"2023-06-10T18:52:40.511382+0000","last_unstale":"2023-06-10T19:02:02.672039+0000","last_undegraded":"2023-06-10T19:02:02.672039+0000","last_fullsized":"2023-06-10T19:02:02.672039+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:28:15.481245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":4,"reported_epoch":93,"state":"creating+activating","last_fresh":"2023-06-10T19:02:02.693760+0000","last_change":"2023-06-10T19:02:02.685058+0000","last_active":"2023-06-10T19:02:02.249926+0000","last_peered":"2023-06-10T19:02:02.249926+0000","last_clean":"2023-06-10T19:02:02.249926+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:02:02.693760+0000","last_undegraded":"2023-06-10T19:02:02.693760+0000","last_fullsized":"2023-06-10T19:02:02.693760+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:29:40.789452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":["6","5"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"93'2","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.694954+0000","last_change":"2023-06-10T19:02:02.300090+0000","last_active":"2023-06-10T19:02:02.694954+0000","last_peered":"2023-06-10T19:02:02.694954+0000","last_clean":"2023-06-10T19:02:02.694954+0000","last_became_active":"2023-06-10T19:02:02.299285+0000","last_became_peered":"2023-06-10T19:02:02.299285+0000","last_unstale":"2023-06-10T19:02:02.694954+0000","last_undegraded":"2023-06-10T19:02:02.694954+0000","last_fullsized":"2023-06-10T19:02:02.694954+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:17:26.780651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":151,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.655794+0000","last_change":"2023-06-10T18:52:40.671725+0000","last_active":"2023-06-10T19:02:02.655794+0000","last_peered":"2023-06-10T19:02:02.655794+0000","last_clean":"2023-06-10T19:02:02.655794+0000","last_became_active":"2023-06-10T18:52:40.671442+0000","last_became_peered":"2023-06-10T18:52:40.671442+0000","last_unstale":"2023-06-10T19:02:02.655794+0000","last_undegraded":"2023-06-10T19:02:02.655794+0000","last_fullsized":"2023-06-10T19:02:02.655794+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:17:15.147758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.681135+0000","last_change":"2023-06-10T19:02:02.681135+0000","last_active":"2023-06-10T19:02:02.681135+0000","last_peered":"2023-06-10T19:02:02.681135+0000","last_clean":"2023-06-10T19:02:02.681135+0000","last_became_active":"2023-06-10T19:02:02.680233+0000","last_became_peered":"2023-06-10T19:02:02.680233+0000","last_unstale":"2023-06-10T19:02:02.681135+0000","last_undegraded":"2023-06-10T19:02:02.681135+0000","last_fullsized":"2023-06-10T19:02:02.681135+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:56:02.719475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.672960+0000","last_change":"2023-06-10T19:02:02.292614+0000","last_active":"2023-06-10T19:02:02.672960+0000","last_peered":"2023-06-10T19:02:02.672960+0000","last_clean":"2023-06-10T19:02:02.672960+0000","last_became_active":"2023-06-10T19:02:02.291916+0000","last_became_peered":"2023-06-10T19:02:02.291916+0000","last_unstale":"2023-06-10T19:02:02.672960+0000","last_undegraded":"2023-06-10T19:02:02.672960+0000","last_fullsized":"2023-06-10T19:02:02.672960+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:18:50.542343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":149,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.660908+0000","last_change":"2023-06-10T18:52:40.510258+0000","last_active":"2023-06-10T19:02:02.660908+0000","last_peered":"2023-06-10T19:02:02.660908+0000","last_clean":"2023-06-10T19:02:02.660908+0000","last_became_active":"2023-06-10T18:52:40.509560+0000","last_became_peered":"2023-06-10T18:52:40.509560+0000","last_unstale":"2023-06-10T19:02:02.660908+0000","last_undegraded":"2023-06-10T19:02:02.660908+0000","last_fullsized":"2023-06-10T19:02:02.660908+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:00:07.712002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.668295+0000","last_change":"2023-06-10T19:02:02.663696+0000","last_active":"2023-06-10T19:02:02.668295+0000","last_peered":"2023-06-10T19:02:02.668295+0000","last_clean":"2023-06-10T19:02:02.668295+0000","last_became_active":"2023-06-10T19:02:02.663441+0000","last_became_peered":"2023-06-10T19:02:02.663441+0000","last_unstale":"2023-06-10T19:02:02.668295+0000","last_undegraded":"2023-06-10T19:02:02.668295+0000","last_fullsized":"2023-06-10T19:02:02.668295+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:05:29.276794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"93'2","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.684478+0000","last_change":"2023-06-10T19:02:02.286757+0000","last_active":"2023-06-10T19:02:02.684478+0000","last_peered":"2023-06-10T19:02:02.684478+0000","last_clean":"2023-06-10T19:02:02.684478+0000","last_became_active":"2023-06-10T19:02:02.285950+0000","last_became_peered":"2023-06-10T19:02:02.285950+0000","last_unstale":"2023-06-10T19:02:02.684478+0000","last_undegraded":"2023-06-10T19:02:02.684478+0000","last_fullsized":"2023-06-10T19:02:02.684478+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:47:52.566821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":137,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.663766+0000","last_change":"2023-06-10T18:52:40.672266+0000","last_active":"2023-06-10T19:02:02.663766+0000","last_peered":"2023-06-10T19:02:02.663766+0000","last_clean":"2023-06-10T19:02:02.663766+0000","last_became_active":"2023-06-10T18:52:40.671966+0000","last_became_peered":"2023-06-10T18:52:40.671966+0000","last_unstale":"2023-06-10T19:02:02.663766+0000","last_undegraded":"2023-06-10T19:02:02.663766+0000","last_fullsized":"2023-06-10T19:02:02.663766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:23:30.112577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.682181+0000","last_change":"2023-06-10T19:02:02.670012+0000","last_active":"2023-06-10T19:02:02.682181+0000","last_peered":"2023-06-10T19:02:02.682181+0000","last_clean":"2023-06-10T19:02:02.682181+0000","last_became_active":"2023-06-10T19:02:02.669278+0000","last_became_peered":"2023-06-10T19:02:02.669278+0000","last_unstale":"2023-06-10T19:02:02.682181+0000","last_undegraded":"2023-06-10T19:02:02.682181+0000","last_fullsized":"2023-06-10T19:02:02.682181+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:18:57.746056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.656217+0000","last_change":"2023-06-10T19:02:02.281757+0000","last_active":"2023-06-10T19:02:02.656217+0000","last_peered":"2023-06-10T19:02:02.656217+0000","last_clean":"2023-06-10T19:02:02.656217+0000","last_became_active":"2023-06-10T19:02:02.281378+0000","last_became_peered":"2023-06-10T19:02:02.281378+0000","last_unstale":"2023-06-10T19:02:02.656217+0000","last_undegraded":"2023-06-10T19:02:02.656217+0000","last_fullsized":"2023-06-10T19:02:02.656217+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:06:06.568248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":145,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.674878+0000","last_change":"2023-06-10T18:52:40.671084+0000","last_active":"2023-06-10T19:02:02.674878+0000","last_peered":"2023-06-10T19:02:02.674878+0000","last_clean":"2023-06-10T19:02:02.674878+0000","last_became_active":"2023-06-10T18:52:40.670697+0000","last_became_peered":"2023-06-10T18:52:40.670697+0000","last_unstale":"2023-06-10T19:02:02.674878+0000","last_undegraded":"2023-06-10T19:02:02.674878+0000","last_fullsized":"2023-06-10T19:02:02.674878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:36:37.423072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.688793+0000","last_change":"2023-06-10T19:02:02.679941+0000","last_active":"2023-06-10T19:02:02.688793+0000","last_peered":"2023-06-10T19:02:02.688793+0000","last_clean":"2023-06-10T19:02:02.688793+0000","last_became_active":"2023-06-10T19:02:02.679209+0000","last_became_peered":"2023-06-10T19:02:02.679209+0000","last_unstale":"2023-06-10T19:02:02.688793+0000","last_undegraded":"2023-06-10T19:02:02.688793+0000","last_fullsized":"2023-06-10T19:02:02.688793+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:09:25.545048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.655021+0000","last_change":"2023-06-10T19:02:02.288468+0000","last_active":"2023-06-10T19:02:02.655021+0000","last_peered":"2023-06-10T19:02:02.655021+0000","last_clean":"2023-06-10T19:02:02.655021+0000","last_became_active":"2023-06-10T19:02:02.287678+0000","last_became_peered":"2023-06-10T19:02:02.287678+0000","last_unstale":"2023-06-10T19:02:02.655021+0000","last_undegraded":"2023-06-10T19:02:02.655021+0000","last_fullsized":"2023-06-10T19:02:02.655021+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:06:24.821830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":137,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.663764+0000","last_change":"2023-06-10T18:52:40.514114+0000","last_active":"2023-06-10T19:02:02.663764+0000","last_peered":"2023-06-10T19:02:02.663764+0000","last_clean":"2023-06-10T19:02:02.663764+0000","last_became_active":"2023-06-10T18:52:40.513638+0000","last_became_peered":"2023-06-10T18:52:40.513638+0000","last_unstale":"2023-06-10T19:02:02.663764+0000","last_undegraded":"2023-06-10T19:02:02.663764+0000","last_fullsized":"2023-06-10T19:02:02.663764+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:34:10.418426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.666991+0000","last_change":"2023-06-10T19:02:02.661974+0000","last_active":"2023-06-10T19:02:02.666991+0000","last_peered":"2023-06-10T19:02:02.666991+0000","last_clean":"2023-06-10T19:02:02.666991+0000","last_became_active":"2023-06-10T19:02:02.661623+0000","last_became_peered":"2023-06-10T19:02:02.661623+0000","last_unstale":"2023-06-10T19:02:02.666991+0000","last_undegraded":"2023-06-10T19:02:02.666991+0000","last_fullsized":"2023-06-10T19:02:02.666991+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:53:04.166432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.656632+0000","last_change":"2023-06-10T19:02:02.294886+0000","last_active":"2023-06-10T19:02:02.656632+0000","last_peered":"2023-06-10T19:02:02.656632+0000","last_clean":"2023-06-10T19:02:02.656632+0000","last_became_active":"2023-06-10T19:02:02.294578+0000","last_became_peered":"2023-06-10T19:02:02.294578+0000","last_unstale":"2023-06-10T19:02:02.656632+0000","last_undegraded":"2023-06-10T19:02:02.656632+0000","last_fullsized":"2023-06-10T19:02:02.656632+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:33:34.686527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":145,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-06-10T19:02:02.691963+0000","last_change":"2023-06-10T18:52:40.515396+0000","last_active":"2023-06-10T19:02:02.691963+0000","last_peered":"2023-06-10T19:02:02.691963+0000","last_clean":"2023-06-10T19:02:02.691963+0000","last_became_active":"2023-06-10T18:52:40.514663+0000","last_became_peered":"2023-06-10T18:52:40.514663+0000","last_unstale":"2023-06-10T19:02:02.691963+0000","last_undegraded":"2023-06-10T19:02:02.691963+0000","last_fullsized":"2023-06-10T19:02:02.691963+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:42:42.732048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":1470,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":37,"ondisk_log_size":37,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574965,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32720,"kb_used_data":1672,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339120,"statfs":{"total":96636764160,"available":96603258880,"internally_reserved":0,"allocated":1712128,"data_stored":1096424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.94199999999999995,"15min":0.90300000000000002},"min":{"1min":0.63800000000000001,"5min":0.54700000000000004,"15min":0.434},"max":{"1min":1.196,"5min":1.327,"15min":1.6220000000000001},"last":1.0409999999999999},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.93000000000000005,"15min":0.92900000000000005},"min":{"1min":0.70999999999999996,"5min":0.496,"15min":0.496},"max":{"1min":1.149,"5min":1.264,"15min":1.6870000000000001},"last":1.002}]},{"osd":1,"last update":"Sat Jun 10 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.93200000000000005,"15min":0.92500000000000004},"min":{"1min":0.64700000000000002,"5min":0.54200000000000004,"15min":0.53900000000000003},"max":{"1min":1.238,"5min":1.262,"15min":1.377},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.97299999999999998,"15min":0.93600000000000005},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.504},"max":{"1min":1.1279999999999999,"5min":1.234,"15min":1.5960000000000001},"last":0.81100000000000005}]},{"osd":2,"last update":"Sat Jun 10 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.85599999999999998,"15min":0.83799999999999997},"min":{"1min":0.625,"5min":0.52100000000000002,"15min":0.47099999999999997},"max":{"1min":1.169,"5min":1.169,"15min":1.4059999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.91100000000000003,"15min":0.90400000000000003},"min":{"1min":0.67900000000000005,"5min":0.53000000000000003,"15min":0.50600000000000001},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.89600000000000002}]},{"osd":3,"last update":"Sat Jun 10 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.93600000000000005,"15min":0.91800000000000004},"min":{"1min":0.71899999999999997,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.502},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.0229999999999999,"5min":0.97599999999999998,"15min":0.94699999999999995},"min":{"1min":0.80400000000000005,"5min":0.59599999999999997,"15min":0.53800000000000003},"max":{"1min":1.2769999999999999,"5min":1.284,"15min":1.2929999999999999},"last":0.96399999999999997}]},{"osd":4,"last update":"Sat Jun 10 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.83199999999999996,"15min":0.85799999999999998},"min":{"1min":0.629,"5min":0.39500000000000002,"15min":0.32700000000000001},"max":{"1min":1.056,"5min":1.1990000000000001,"15min":1.639},"last":0.63900000000000001},{"interface":"front","average":{"1min":1.014,"5min":0.97199999999999998,"15min":0.97299999999999998},"min":{"1min":0.67200000000000004,"5min":0.434,"15min":0.40000000000000002},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.86799999999999999}]},{"osd":5,"last update":"Sat Jun 10 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":0.99199999999999999,"15min":1.016},"min":{"1min":0.73699999999999999,"5min":0.40500000000000003,"15min":0.38400000000000001},"max":{"1min":1.379,"5min":1.395,"15min":1.806},"last":0.84399999999999997},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0389999999999999,"15min":1.0429999999999999},"min":{"1min":0.70399999999999996,"5min":0.505,"15min":0.46500000000000002},"max":{"1min":1.579,"5min":1.579,"15min":1.579},"last":0.97999999999999998}]},{"osd":6,"last update":"Sat Jun 10 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0069999999999999},"min":{"1min":0.65100000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.391,"5min":1.391,"15min":1.718},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.149,"5min":1.1140000000000001,"15min":1.0960000000000001},"min":{"1min":0.82099999999999995,"5min":0.48799999999999999,"15min":0.441},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":1.022}]}]},{"osd":6,"up_from":13,"seq":55834574966,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32152,"kb_used_data":1104,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339688,"statfs":{"total":96636764160,"available":96603840512,"internally_reserved":0,"allocated":1130496,"data_stored":512684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.89700000000000002,"15min":0.84599999999999997},"min":{"1min":0.55000000000000004,"5min":0.52600000000000002,"15min":0.502},"max":{"1min":1.111,"5min":1.476,"15min":1.498},"last":1.079},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.89400000000000002,"15min":0.86899999999999999},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46100000000000002},"max":{"1min":1.2250000000000001,"5min":1.496,"15min":1.496},"last":0.94199999999999995}]},{"osd":1,"last update":"Sat Jun 10 19:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.86399999999999999,"15min":0.86199999999999999},"min":{"1min":0.502,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.079,"5min":1.1739999999999999,"15min":1.5229999999999999},"last":1.0229999999999999},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.90900000000000003,"15min":0.88400000000000001},"min":{"1min":0.61399999999999999,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.1599999999999999,"5min":1.2450000000000001,"15min":1.778},"last":0.78100000000000003}]},{"osd":2,"last update":"Sat Jun 10 19:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91300000000000003,"15min":0.88300000000000001},"min":{"1min":0.748,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.2130000000000001,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":1.111},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.90400000000000003,"15min":0.89200000000000002},"min":{"1min":0.66200000000000003,"5min":0.61299999999999999,"15min":0.57999999999999996},"max":{"1min":1.2330000000000001,"5min":1.246,"15min":1.246},"last":0.56100000000000005}]},{"osd":3,"last update":"Sat Jun 10 19:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.93300000000000005,"15min":0.89200000000000002},"min":{"1min":0.68200000000000005,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0860000000000001,"5min":1.399,"15min":1.7190000000000001},"last":1.141},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.98199999999999998,"15min":0.99099999999999999},"min":{"1min":0.77300000000000002,"5min":0.72599999999999998,"15min":0.58599999999999997},"max":{"1min":1.2470000000000001,"5min":1.272,"15min":1.4370000000000001},"last":1.371}]},{"osd":4,"last update":"Sat Jun 10 19:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.89800000000000002,"15min":0.93000000000000005},"min":{"1min":0.71999999999999997,"5min":0.59799999999999998,"15min":0.56799999999999995},"max":{"1min":1.1719999999999999,"5min":1.4159999999999999,"15min":1.798},"last":1.401},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.95799999999999996,"15min":0.996},"min":{"1min":0.64500000000000002,"5min":0.64000000000000001,"15min":0.51300000000000001},"max":{"1min":1.319,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":1.1619999999999999}]},{"osd":5,"last update":"Sat Jun 10 19:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.91100000000000003,"15min":0.93799999999999994},"min":{"1min":0.72099999999999997,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.194,"5min":1.333,"15min":1.333},"last":1.29},{"interface":"front","average":{"1min":1.012,"5min":1.02,"15min":1.03},"min":{"1min":0.77800000000000002,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.2210000000000001,"5min":1.405,"15min":2.536},"last":1.2230000000000001}]},{"osd":7,"last update":"Sat Jun 10 19:01:43 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.0169999999999999,"15min":1.036},"min":{"1min":0.82699999999999996,"5min":0.60899999999999999,"15min":0.57099999999999995},"max":{"1min":1.361,"5min":1.48,"15min":1.917},"last":1.427},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.98299999999999998,"15min":1.034},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.278,"5min":1.29,"15min":1.5569999999999999},"last":1.4850000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574966,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32140,"kb_used_data":1092,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339700,"statfs":{"total":96636764160,"available":96603852800,"internally_reserved":0,"allocated":1118208,"data_stored":506056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:01:45 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.91700000000000004,"15min":0.86199999999999999},"min":{"1min":0.58099999999999996,"5min":0.54100000000000004,"15min":0.50600000000000001},"max":{"1min":1.2070000000000001,"5min":1.232,"15min":1.232},"last":0.56599999999999995},{"interface":"front","average":{"1min":1.028,"5min":0.92400000000000004,"15min":0.92700000000000005},"min":{"1min":0.58999999999999997,"5min":0.51400000000000001,"15min":0.49399999999999999},"max":{"1min":2.347,"5min":2.347,"15min":2.347},"last":0.98299999999999998}]},{"osd":1,"last update":"Sat Jun 10 19:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":0.97199999999999998,"15min":0.92800000000000005},"min":{"1min":0.63400000000000001,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":7.0800000000000001,"5min":7.0800000000000001,"15min":7.0800000000000001},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.9550000000000001,"5min":1.1240000000000001,"15min":0.98799999999999999},"min":{"1min":0.59199999999999997,"5min":0.57699999999999996,"15min":0.53800000000000003},"max":{"1min":15.845000000000001,"5min":15.845000000000001,"15min":15.845000000000001},"last":0.91800000000000004}]},{"osd":2,"last update":"Sat Jun 10 19:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":0.94299999999999995,"15min":0.88100000000000001},"min":{"1min":0.68200000000000005,"5min":0.49299999999999999,"15min":0.48299999999999998},"max":{"1min":5.0049999999999999,"5min":5.0049999999999999,"15min":5.0049999999999999},"last":0.626},{"interface":"front","average":{"1min":1.296,"5min":1.008,"15min":0.94299999999999995},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":6.851,"5min":6.851,"15min":6.851},"last":0.86599999999999999}]},{"osd":3,"last update":"Sat Jun 10 19:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":0.96399999999999997,"15min":0.95499999999999996},"min":{"1min":0.65900000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.544,"5min":2.544,"15min":2.544},"last":1.0509999999999999},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0029999999999999,"15min":1.0169999999999999},"min":{"1min":0.63100000000000001,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":3.0830000000000002,"5min":3.0830000000000002,"15min":3.0830000000000002},"last":1.1080000000000001}]},{"osd":4,"last update":"Sat Jun 10 19:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":0.95799999999999996,"15min":0.96699999999999997},"min":{"1min":0.66800000000000004,"5min":0.64100000000000001,"15min":0.58099999999999996},"max":{"1min":6.7290000000000001,"5min":6.7290000000000001,"15min":6.7290000000000001},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.0369999999999999,"5min":0.98199999999999998,"15min":1.0269999999999999},"min":{"1min":0.68300000000000005,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.278,"5min":1.341,"15min":1.575},"last":0.755}]},{"osd":6,"last update":"Sat Jun 10 19:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":0.98199999999999998,"15min":1.03},"min":{"1min":0.65300000000000002,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.3029999999999999,"5min":1.3660000000000001,"15min":1.4330000000000001},"last":0.81799999999999995},{"interface":"front","average":{"1min":1.373,"5min":1.093,"15min":1.073},"min":{"1min":0.81499999999999995,"5min":0.66500000000000004,"15min":0.57899999999999996},"max":{"1min":6.923,"5min":6.923,"15min":6.923},"last":1.018}]},{"osd":7,"last update":"Sat Jun 10 19:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.0629999999999999,"15min":1.1259999999999999},"min":{"1min":0.81399999999999995,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":2.6080000000000001,"5min":2.6080000000000001,"15min":2.6080000000000001},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.4319999999999999,"5min":1.157,"15min":1.1619999999999999},"min":{"1min":0.95299999999999996,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":5.4169999999999998,"5min":5.4169999999999998,"15min":5.4169999999999998},"last":1.1719999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574965,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32152,"kb_used_data":1104,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339688,"statfs":{"total":96636764160,"available":96603840512,"internally_reserved":0,"allocated":1130496,"data_stored":512684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.872,"15min":0.79800000000000004},"min":{"1min":0.49199999999999999,"5min":0.48599999999999999,"15min":0.45100000000000001},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.91900000000000004,"15min":0.89800000000000002},"min":{"1min":0.58399999999999996,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0580000000000001,"5min":3.7280000000000002,"15min":3.7280000000000002},"last":0.70799999999999996}]},{"osd":1,"last update":"Sat Jun 10 19:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.93500000000000005,"15min":0.94599999999999995},"min":{"1min":0.63100000000000001,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1200000000000001,"5min":3.3969999999999998,"15min":3.3969999999999998},"last":1.0229999999999999},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.90100000000000002,"15min":0.86199999999999999},"min":{"1min":0.66100000000000003,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.1679999999999999,"5min":2.496,"15min":2.496},"last":0.753}]},{"osd":2,"last update":"Sat Jun 10 19:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.90200000000000002,"15min":0.88400000000000001},"min":{"1min":0.56799999999999995,"5min":0.51300000000000001,"15min":0.49299999999999999},"max":{"1min":1.3,"5min":1.3,"15min":1.522},"last":0.88400000000000001},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.006,"15min":1},"min":{"1min":0.74099999999999999,"5min":0.57799999999999996,"15min":0.55000000000000004},"max":{"1min":1.204,"5min":3.5750000000000002,"15min":3.5750000000000002},"last":0.82199999999999995}]},{"osd":3,"last update":"Sat Jun 10 19:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.91700000000000004,"15min":0.89600000000000002},"min":{"1min":0.71599999999999997,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.2909999999999999,"5min":2.3809999999999998,"15min":2.3809999999999998},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.97199999999999998,"15min":0.96399999999999997},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.54400000000000004},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.6479999999999999},"last":0.67200000000000004}]},{"osd":5,"last update":"Sat Jun 10 19:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.96899999999999997,"15min":0.97599999999999998},"min":{"1min":0.68700000000000006,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.1459999999999999,"5min":3.6539999999999999,"15min":3.6539999999999999},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.94599999999999995,"15min":0.96499999999999997},"min":{"1min":0.68400000000000005,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.204,"5min":2.6720000000000002,"15min":2.6720000000000002},"last":1.0529999999999999}]},{"osd":6,"last update":"Sat Jun 10 19:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.93999999999999995,"15min":0.98999999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.54900000000000004},"max":{"1min":1.276,"5min":1.3149999999999999,"15min":2.2639999999999998},"last":0.79800000000000004},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0549999999999999,"15min":1.0660000000000001},"min":{"1min":0.76500000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.3200000000000001,"5min":3.4980000000000002,"15min":3.4980000000000002},"last":1.093}]},{"osd":7,"last update":"Sat Jun 10 19:01:59 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":0.999,"15min":0.99399999999999999},"min":{"1min":0.72499999999999998,"5min":0.66300000000000003,"15min":0.41399999999999998},"max":{"1min":1.3360000000000001,"5min":2.5910000000000002,"15min":2.5910000000000002},"last":0.85199999999999998},{"interface":"front","average":{"1min":1.083,"5min":1.0660000000000001,"15min":1.069},"min":{"1min":0.68100000000000005,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.3740000000000001,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.98999999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574964,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":1088,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":1114112,"data_stored":505037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.627,"15min":0.59899999999999998},"min":{"1min":0.44600000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.88300000000000001,"5min":1.01,"15min":1.169},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.68100000000000005,"15min":0.65400000000000003},"min":{"1min":0.45300000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.96699999999999997,"5min":1.1679999999999999,"15min":1.286},"last":1.093}]},{"osd":1,"last update":"Sat Jun 10 19:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.68300000000000005,"15min":0.65600000000000003},"min":{"1min":0.501,"5min":0.34300000000000003,"15min":0.27500000000000002},"max":{"1min":0.94299999999999995,"5min":1.2569999999999999,"15min":1.2729999999999999},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.74399999999999999,"15min":0.73299999999999998},"min":{"1min":0.42999999999999999,"5min":0.33000000000000002,"15min":0.318},"max":{"1min":1.0449999999999999,"5min":1.296,"15min":1.411},"last":0.84599999999999997}]},{"osd":2,"last update":"Sat Jun 10 19:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.78500000000000003,"15min":0.76800000000000002},"min":{"1min":0.49199999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.018,"5min":1.3899999999999999,"15min":1.9530000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.80100000000000005,"15min":0.76700000000000002},"min":{"1min":0.58399999999999996,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.125,"5min":1.278,"15min":1.278},"last":0.94099999999999995}]},{"osd":4,"last update":"Sat Jun 10 19:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.93899999999999995,"15min":0.95499999999999996},"min":{"1min":0.69899999999999995,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.1899999999999999,"5min":1.488,"15min":1.488},"last":1.0489999999999999},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.98399999999999999,"15min":0.98999999999999999},"min":{"1min":0.68700000000000006,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.3069999999999999,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":1.1419999999999999}]},{"osd":5,"last update":"Sat Jun 10 19:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.008,"15min":1.0349999999999999},"min":{"1min":0.64200000000000002,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.2030000000000001,"5min":1.425,"15min":2.024},"last":1.006},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.014,"15min":1.0229999999999999},"min":{"1min":0.72099999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.3220000000000001,"5min":1.5069999999999999,"15min":1.724},"last":1.175}]},{"osd":6,"last update":"Sat Jun 10 19:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.0600000000000001,"15min":1.0580000000000001},"min":{"1min":0.79600000000000004,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.3600000000000001,"5min":1.597,"15min":1.8500000000000001},"last":1.119},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.0509999999999999,"15min":1.0649999999999999},"min":{"1min":0.73499999999999999,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.3380000000000001,"5min":1.4590000000000001,"15min":1.78},"last":0.97099999999999997}]},{"osd":7,"last update":"Sat Jun 10 19:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.0820000000000001,"15min":1.1100000000000001},"min":{"1min":0.75,"5min":0.60999999999999999,"15min":0.56999999999999995},"max":{"1min":1.373,"5min":1.444,"15min":1.9079999999999999},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.093,"5min":1.105,"15min":1.0900000000000001},"min":{"1min":0.72099999999999997,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.399,"5min":1.651,"15min":1.6719999999999999},"last":1.075}]}]},{"osd":2,"up_from":13,"seq":55834574965,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32152,"kb_used_data":1104,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339688,"statfs":{"total":96636764160,"available":96603840512,"internally_reserved":0,"allocated":1130496,"data_stored":512684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:01:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.628,"15min":0.60499999999999998},"min":{"1min":0.31,"5min":0.28899999999999998,"15min":0.27300000000000002},"max":{"1min":1.095,"5min":1.095,"15min":1.1220000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.72899999999999998,"15min":0.72199999999999998},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.0209999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.56999999999999995}]},{"osd":1,"last update":"Sat Jun 10 19:01:52 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.67500000000000004,"15min":0.66100000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.307},"max":{"1min":0.98199999999999998,"5min":1.099,"15min":1.1950000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.78100000000000003,"15min":0.73599999999999999},"min":{"1min":0.36699999999999999,"5min":0.33300000000000002,"15min":0.29499999999999998},"max":{"1min":1.0109999999999999,"5min":1.446,"15min":1.446},"last":1.2310000000000001}]},{"osd":3,"last update":"Sat Jun 10 19:01:52 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.80000000000000004,"15min":0.746},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.1599999999999999,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.80400000000000005,"15min":0.77100000000000002},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.252},"max":{"1min":0.999,"5min":1.1459999999999999,"15min":1.3340000000000001},"last":0.86499999999999999}]},{"osd":4,"last update":"Sat Jun 10 19:01:52 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.93500000000000005,"15min":0.92400000000000004},"min":{"1min":0.624,"5min":0.56200000000000006,"15min":0.53400000000000003},"max":{"1min":1.228,"5min":1.228,"15min":1.3620000000000001},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.998,"5min":1.0049999999999999,"15min":1.0269999999999999},"min":{"1min":0.753,"5min":0.60899999999999999,"15min":0.57699999999999996},"max":{"1min":1.486,"5min":1.486,"15min":1.4950000000000001},"last":0.95099999999999996}]},{"osd":5,"last update":"Sat Jun 10 19:01:52 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.008,"15min":1.018},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.54100000000000004},"max":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":1.5700000000000001},"last":1.139},{"interface":"front","average":{"1min":0.98699999999999999,"5min":1.0189999999999999,"15min":1.002},"min":{"1min":0.71999999999999997,"5min":0.66000000000000003,"15min":0.60099999999999998},"max":{"1min":1.2669999999999999,"5min":1.381,"15min":1.667},"last":1.008}]},{"osd":6,"last update":"Sat Jun 10 19:01:52 2023","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.044,"15min":1.0389999999999999},"min":{"1min":0.67400000000000004,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.304,"5min":1.4259999999999999,"15min":1.5900000000000001},"last":1.0620000000000001},{"interface":"front","average":{"1min":1.038,"5min":1.05,"15min":1.044},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.2989999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":1.1060000000000001}]},{"osd":7,"last update":"Sat Jun 10 19:01:52 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.0880000000000001,"15min":1.0980000000000001},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.4319999999999999,"5min":1.724,"15min":1.724},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.085,"5min":1.1080000000000001,"15min":1.0980000000000001},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.59299999999999997},"max":{"1min":1.363,"5min":1.51,"15min":1.752},"last":1.1759999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574967,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":1088,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":1114112,"data_stored":505037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:01:54 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.71699999999999997,"15min":0.68000000000000005},"min":{"1min":0.46500000000000002,"5min":0.28599999999999998,"15min":0.25800000000000001},"max":{"1min":1.111,"5min":1.1459999999999999,"15min":1.288},"last":0.629},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79000000000000004,"15min":0.72899999999999998},"min":{"1min":0.41899999999999998,"5min":0.32800000000000001,"15min":0.26900000000000002},"max":{"1min":0.98099999999999998,"5min":1.056,"15min":1.694},"last":0.58599999999999997}]},{"osd":2,"last update":"Sat Jun 10 19:01:54 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.65700000000000003,"15min":0.63400000000000001},"min":{"1min":0.39200000000000002,"5min":0.308,"15min":0.249},"max":{"1min":0.93999999999999995,"5min":1.0740000000000001,"15min":1.21},"last":0.371},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.754,"15min":0.70299999999999996},"min":{"1min":0.48599999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.0600000000000001,"5min":1.194,"15min":1.415},"last":0.38800000000000001}]},{"osd":3,"last update":"Sat Jun 10 19:01:54 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.80700000000000005,"15min":0.77600000000000002},"min":{"1min":0.58599999999999997,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.1679999999999999,"5min":1.3049999999999999,"15min":1.6299999999999999},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.75900000000000001,"15min":0.752},"min":{"1min":0.47199999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":2.1749999999999998},"last":0.44400000000000001}]},{"osd":4,"last update":"Sat Jun 10 19:01:54 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.878,"15min":0.85699999999999998},"min":{"1min":0.67400000000000004,"5min":0.58699999999999997,"15min":0.53000000000000003},"max":{"1min":1.343,"5min":1.343,"15min":1.4930000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.022,"15min":1.0600000000000001},"min":{"1min":0.71299999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.2569999999999999,"5min":1.5129999999999999,"15min":5.8209999999999997},"last":0.67800000000000005}]},{"osd":5,"last update":"Sat Jun 10 19:01:54 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.006,"15min":1.0169999999999999},"min":{"1min":0.60899999999999999,"5min":0.57699999999999996,"15min":0.56599999999999995},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.8620000000000001},"last":0.751},{"interface":"front","average":{"1min":1.018,"5min":0.997,"15min":0.98299999999999998},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.3069999999999999,"5min":1.3089999999999999,"15min":3.089},"last":0.66600000000000004}]},{"osd":6,"last update":"Sat Jun 10 19:01:54 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.0660000000000001,"15min":1.0549999999999999},"min":{"1min":0.73699999999999999,"5min":0.64100000000000001,"15min":0.56200000000000006},"max":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":7.2599999999999998},"last":0.81899999999999995},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0389999999999999,"15min":1.042},"min":{"1min":0.73599999999999999,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":9.0069999999999997},"last":0.60299999999999998}]},{"osd":7,"last update":"Sat Jun 10 19:01:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.113,"15min":1.0940000000000001},"min":{"1min":0.92400000000000004,"5min":0.495,"15min":0.495},"max":{"1min":1.494,"5min":1.573,"15min":2.105},"last":0.72399999999999998},{"interface":"front","average":{"1min":1.089,"5min":1.1180000000000001,"15min":1.087},"min":{"1min":0.63700000000000001,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.5620000000000001,"5min":1.6399999999999999,"15min":2.2570000000000001},"last":0.85299999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574966,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32728,"kb_used_data":1680,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339112,"statfs":{"total":96636764160,"available":96603250688,"internally_reserved":0,"allocated":1720320,"data_stored":1102033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jun 10 19:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.65500000000000003,"15min":0.624},"min":{"1min":0.34799999999999998,"5min":0.248,"15min":0.248},"max":{"1min":1.077,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.82899999999999996,"15min":0.78200000000000003},"min":{"1min":0.38600000000000001,"5min":0.34100000000000003,"15min":0.34000000000000002},"max":{"1min":1.1559999999999999,"5min":1.302,"15min":1.4059999999999999},"last":0.96899999999999997}]},{"osd":2,"last update":"Sat Jun 10 19:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.71399999999999997,"15min":0.70599999999999996},"min":{"1min":0.33500000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.149,"5min":1.149,"15min":1.2829999999999999},"last":1.2010000000000001},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66600000000000004,"15min":0.64700000000000002},"min":{"1min":0.318,"5min":0.245,"15min":0.245},"max":{"1min":0.88900000000000001,"5min":1.139,"15min":1.371},"last":0.70399999999999996}]},{"osd":3,"last update":"Sat Jun 10 19:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.67300000000000004,"15min":0.67900000000000005},"min":{"1min":0.30299999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.96199999999999997,"5min":1.222,"15min":1.226},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.80400000000000005,"15min":0.81499999999999995},"min":{"1min":0.41999999999999998,"5min":0.317,"15min":0.317},"max":{"1min":1.083,"5min":1.2549999999999999,"15min":1.829},"last":0.81599999999999995}]},{"osd":4,"last update":"Sat Jun 10 19:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.94099999999999995,"15min":0.91200000000000003},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1990000000000001,"5min":3.0209999999999999,"15min":3.0209999999999999},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.998,"5min":1.016,"15min":1.028},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.228,"5min":1.3819999999999999,"15min":1.9510000000000001},"last":1.097}]},{"osd":5,"last update":"Sat Jun 10 19:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.92400000000000004,"15min":0.94599999999999995},"min":{"1min":0.64700000000000002,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.095,"5min":1.2529999999999999,"15min":1.694},"last":1.071},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.024,"15min":1.01},"min":{"1min":0.58099999999999996,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.391,"5min":4.5620000000000003,"15min":4.5620000000000003},"last":1.0469999999999999}]},{"osd":6,"last update":"Sat Jun 10 19:01:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0940000000000001,"15min":1.0720000000000001},"min":{"1min":0.61899999999999999,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.423,"5min":3.5569999999999999,"15min":3.5569999999999999},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.012,"15min":1.004},"min":{"1min":0.67100000000000004,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.26,"5min":1.625,"15min":1.883},"last":1.018}]},{"osd":7,"last update":"Sat Jun 10 19:01:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0309999999999999,"15min":1.0349999999999999},"min":{"1min":0.69199999999999995,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.349,"5min":1.4850000000000001,"15min":1.5800000000000001},"last":0.91700000000000004},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.63,"5min":0.61099999999999999,"15min":0.58699999999999997},"max":{"1min":1.4179999999999999,"5min":1.425,"15min":1.9830000000000001},"last":1.131}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-10T19:02:07.455 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3d is not active+clean 2023-06-10T19:02:07.455 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3d', 'version': "0'0", 'reported_seq': 6, 'reported_epoch': 93, 'state': 'active', 'last_fresh': '2023-06-10T19:02:02.684122+0000', 'last_change': '2023-06-10T19:02:02.684069+0000', 'last_active': '2023-06-10T19:02:02.684122+0000', 'last_peered': '2023-06-10T19:02:02.684122+0000', 'last_clean': '2023-06-10T19:02:02.249926+0000', 'last_became_active': '2023-06-10T19:02:02.684069+0000', 'last_became_peered': '2023-06-10T19:02:02.684069+0000', 'last_unstale': '2023-06-10T19:02:02.684122+0000', 'last_undegraded': '2023-06-10T19:02:02.684122+0000', 'last_fullsized': '2023-06-10T19:02:02.684122+0000', 'mapping_epoch': 92, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 92, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:02:02.249926+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:02:02.249926+0000', 'last_clean_scrub_stamp': '2023-06-10T19:02:02.249926+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-06-12T00:11:53.215763+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': ['3', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-06-10T19:02:07.456 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3c is not active+clean 2023-06-10T19:02:07.456 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3c', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 93, 'state': 'creating+activating', 'last_fresh': '2023-06-10T19:02:02.661419+0000', 'last_change': '2023-06-10T19:02:02.661419+0000', 'last_active': '2023-06-10T19:02:02.249926+0000', 'last_peered': '2023-06-10T19:02:02.249926+0000', 'last_clean': '2023-06-10T19:02:02.249926+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:02:02.661419+0000', 'last_undegraded': '2023-06-10T19:02:02.661419+0000', 'last_fullsized': '2023-06-10T19:02:02.661419+0000', 'mapping_epoch': 92, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 92, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:02:02.249926+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:02:02.249926+0000', 'last_clean_scrub_stamp': '2023-06-10T19:02:02.249926+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-06-12T02:31:20.879352+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': ['1', '6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-06-10T19:02:07.456 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3b is not active+clean 2023-06-10T19:02:07.457 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3b', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 93, 'state': 'creating+activating', 'last_fresh': '2023-06-10T19:02:02.657474+0000', 'last_change': '2023-06-10T19:02:02.657474+0000', 'last_active': '2023-06-10T19:02:02.249926+0000', 'last_peered': '2023-06-10T19:02:02.249926+0000', 'last_clean': '2023-06-10T19:02:02.249926+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:02:02.657474+0000', 'last_undegraded': '2023-06-10T19:02:02.657474+0000', 'last_fullsized': '2023-06-10T19:02:02.657474+0000', 'mapping_epoch': 92, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 92, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:02:02.249926+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:02:02.249926+0000', 'last_clean_scrub_stamp': '2023-06-10T19:02:02.249926+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-06-12T00:03:34.938582+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': ['4', '6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-06-10T19:02:07.457 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.38 is not active+clean 2023-06-10T19:02:07.457 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.38', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 93, 'state': 'creating+activating', 'last_fresh': '2023-06-10T19:02:02.659355+0000', 'last_change': '2023-06-10T19:02:02.659355+0000', 'last_active': '2023-06-10T19:02:02.249926+0000', 'last_peered': '2023-06-10T19:02:02.249926+0000', 'last_clean': '2023-06-10T19:02:02.249926+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:02:02.659355+0000', 'last_undegraded': '2023-06-10T19:02:02.659355+0000', 'last_fullsized': '2023-06-10T19:02:02.659355+0000', 'mapping_epoch': 92, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 92, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:02:02.249926+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:02:02.249926+0000', 'last_clean_scrub_stamp': '2023-06-10T19:02:02.249926+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-06-11T21:47:51.626220+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': ['1', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-06-10T19:02:07.458 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.33 is not active+clean 2023-06-10T19:02:07.458 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.33', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 93, 'state': 'creating+activating', 'last_fresh': '2023-06-10T19:02:02.659481+0000', 'last_change': '2023-06-10T19:02:02.659481+0000', 'last_active': '2023-06-10T19:02:02.249926+0000', 'last_peered': '2023-06-10T19:02:02.249926+0000', 'last_clean': '2023-06-10T19:02:02.249926+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:02:02.659481+0000', 'last_undegraded': '2023-06-10T19:02:02.659481+0000', 'last_fullsized': '2023-06-10T19:02:02.659481+0000', 'mapping_epoch': 92, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 92, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:02:02.249926+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:02:02.249926+0000', 'last_clean_scrub_stamp': '2023-06-10T19:02:02.249926+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-06-12T05:52:50.215857+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': ['1', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-06-10T19:02:07.458 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2b is not active+clean 2023-06-10T19:02:07.459 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2b', 'version': "0'0", 'reported_seq': 6, 'reported_epoch': 93, 'state': 'active', 'last_fresh': '2023-06-10T19:02:02.700007+0000', 'last_change': '2023-06-10T19:02:02.699835+0000', 'last_active': '2023-06-10T19:02:02.700007+0000', 'last_peered': '2023-06-10T19:02:02.700007+0000', 'last_clean': '2023-06-10T19:02:02.249926+0000', 'last_became_active': '2023-06-10T19:02:02.699835+0000', 'last_became_peered': '2023-06-10T19:02:02.699835+0000', 'last_unstale': '2023-06-10T19:02:02.700007+0000', 'last_undegraded': '2023-06-10T19:02:02.700007+0000', 'last_fullsized': '2023-06-10T19:02:02.700007+0000', 'mapping_epoch': 92, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 92, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:02:02.249926+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:02:02.249926+0000', 'last_clean_scrub_stamp': '2023-06-10T19:02:02.249926+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-06-12T06:32:47.372339+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': ['4', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-06-10T19:02:07.459 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.29 is not active+clean 2023-06-10T19:02:07.459 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.29', 'version': "0'0", 'reported_seq': 4, 'reported_epoch': 93, 'state': 'creating+activating', 'last_fresh': '2023-06-10T19:02:02.688412+0000', 'last_change': '2023-06-10T19:02:02.684696+0000', 'last_active': '2023-06-10T19:02:02.249926+0000', 'last_peered': '2023-06-10T19:02:02.249926+0000', 'last_clean': '2023-06-10T19:02:02.249926+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:02:02.688412+0000', 'last_undegraded': '2023-06-10T19:02:02.688412+0000', 'last_fullsized': '2023-06-10T19:02:02.688412+0000', 'mapping_epoch': 92, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 92, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:02:02.249926+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:02:02.249926+0000', 'last_clean_scrub_stamp': '2023-06-10T19:02:02.249926+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-06-12T00:11:53.215763+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': ['6', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-06-10T19:02:07.460 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.27 is not active+clean 2023-06-10T19:02:07.460 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.27', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 93, 'state': 'creating+activating', 'last_fresh': '2023-06-10T19:02:02.653940+0000', 'last_change': '2023-06-10T19:02:02.653940+0000', 'last_active': '2023-06-10T19:02:02.249926+0000', 'last_peered': '2023-06-10T19:02:02.249926+0000', 'last_clean': '2023-06-10T19:02:02.249926+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:02:02.653940+0000', 'last_undegraded': '2023-06-10T19:02:02.653940+0000', 'last_fullsized': '2023-06-10T19:02:02.653940+0000', 'mapping_epoch': 92, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 92, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:02:02.249926+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:02:02.249926+0000', 'last_clean_scrub_stamp': '2023-06-10T19:02:02.249926+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-06-11T20:07:43.322174+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': ['5', '6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-06-10T19:02:07.460 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.25 is not active+clean 2023-06-10T19:02:07.461 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.25', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 93, 'state': 'creating+activating', 'last_fresh': '2023-06-10T19:02:02.655425+0000', 'last_change': '2023-06-10T19:02:02.655425+0000', 'last_active': '2023-06-10T19:02:02.249926+0000', 'last_peered': '2023-06-10T19:02:02.249926+0000', 'last_clean': '2023-06-10T19:02:02.249926+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:02:02.655425+0000', 'last_undegraded': '2023-06-10T19:02:02.655425+0000', 'last_fullsized': '2023-06-10T19:02:02.655425+0000', 'mapping_epoch': 92, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 92, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:02:02.249926+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:02:02.249926+0000', 'last_clean_scrub_stamp': '2023-06-10T19:02:02.249926+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-06-11T22:36:26.678143+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': ['2', '6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-06-10T19:02:07.461 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.24 is not active+clean 2023-06-10T19:02:07.461 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.24', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 93, 'state': 'creating+activating', 'last_fresh': '2023-06-10T19:02:02.661225+0000', 'last_change': '2023-06-10T19:02:02.661225+0000', 'last_active': '2023-06-10T19:02:02.249926+0000', 'last_peered': '2023-06-10T19:02:02.249926+0000', 'last_clean': '2023-06-10T19:02:02.249926+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:02:02.661225+0000', 'last_undegraded': '2023-06-10T19:02:02.661225+0000', 'last_fullsized': '2023-06-10T19:02:02.661225+0000', 'mapping_epoch': 92, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 92, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:02:02.249926+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:02:02.249926+0000', 'last_clean_scrub_stamp': '2023-06-10T19:02:02.249926+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-06-12T04:20:57.647766+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': ['1', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-06-10T19:02:07.462 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.23 is not active+clean 2023-06-10T19:02:07.462 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.23', 'version': "0'0", 'reported_seq': 6, 'reported_epoch': 93, 'state': 'active', 'last_fresh': '2023-06-10T19:02:02.701356+0000', 'last_change': '2023-06-10T19:02:02.696178+0000', 'last_active': '2023-06-10T19:02:02.701356+0000', 'last_peered': '2023-06-10T19:02:02.701356+0000', 'last_clean': '2023-06-10T19:02:02.249926+0000', 'last_became_active': '2023-06-10T19:02:02.696178+0000', 'last_became_peered': '2023-06-10T19:02:02.696178+0000', 'last_unstale': '2023-06-10T19:02:02.701356+0000', 'last_undegraded': '2023-06-10T19:02:02.701356+0000', 'last_fullsized': '2023-06-10T19:02:02.701356+0000', 'mapping_epoch': 92, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 92, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:02:02.249926+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:02:02.249926+0000', 'last_clean_scrub_stamp': '2023-06-10T19:02:02.249926+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-06-12T00:33:48.265078+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': ['7', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-06-10T19:02:07.462 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1f is not active+clean 2023-06-10T19:02:07.463 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1f', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 93, 'state': 'creating+activating', 'last_fresh': '2023-06-10T19:02:02.650584+0000', 'last_change': '2023-06-10T19:02:02.650584+0000', 'last_active': '2023-06-10T19:02:02.249926+0000', 'last_peered': '2023-06-10T19:02:02.249926+0000', 'last_clean': '2023-06-10T19:02:02.249926+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:02:02.650584+0000', 'last_undegraded': '2023-06-10T19:02:02.650584+0000', 'last_fullsized': '2023-06-10T19:02:02.650584+0000', 'mapping_epoch': 92, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 92, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:02:02.249926+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:02:02.249926+0000', 'last_clean_scrub_stamp': '2023-06-10T19:02:02.249926+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-06-11T19:20:12.939183+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': ['0', '6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-06-10T19:02:07.463 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.19 is not active+clean 2023-06-10T19:02:07.463 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.19', 'version': "0'0", 'reported_seq': 4, 'reported_epoch': 93, 'state': 'creating+activating', 'last_fresh': '2023-06-10T19:02:02.687783+0000', 'last_change': '2023-06-10T19:02:02.684502+0000', 'last_active': '2023-06-10T19:02:02.249926+0000', 'last_peered': '2023-06-10T19:02:02.249926+0000', 'last_clean': '2023-06-10T19:02:02.249926+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:02:02.687783+0000', 'last_undegraded': '2023-06-10T19:02:02.687783+0000', 'last_fullsized': '2023-06-10T19:02:02.687783+0000', 'mapping_epoch': 92, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 92, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:02:02.249926+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:02:02.249926+0000', 'last_clean_scrub_stamp': '2023-06-10T19:02:02.249926+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-06-12T03:34:43.072692+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': ['6', '0'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-06-10T19:02:07.464 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1b is not active+clean 2023-06-10T19:02:07.464 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1b', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 93, 'state': 'creating+activating', 'last_fresh': '2023-06-10T19:02:02.659597+0000', 'last_change': '2023-06-10T19:02:02.659597+0000', 'last_active': '2023-06-10T19:02:02.249926+0000', 'last_peered': '2023-06-10T19:02:02.249926+0000', 'last_clean': '2023-06-10T19:02:02.249926+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:02:02.659597+0000', 'last_undegraded': '2023-06-10T19:02:02.659597+0000', 'last_fullsized': '2023-06-10T19:02:02.659597+0000', 'mapping_epoch': 92, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 92, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:02:02.249926+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:02:02.249926+0000', 'last_clean_scrub_stamp': '2023-06-10T19:02:02.249926+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-06-11T19:28:01.941970+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': ['1', '6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-06-10T19:02:07.464 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.15 is not active+clean 2023-06-10T19:02:07.464 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.15', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 93, 'state': 'creating+activating', 'last_fresh': '2023-06-10T19:02:02.673955+0000', 'last_change': '2023-06-10T19:02:02.673955+0000', 'last_active': '2023-06-10T19:02:02.249926+0000', 'last_peered': '2023-06-10T19:02:02.249926+0000', 'last_clean': '2023-06-10T19:02:02.249926+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:02:02.673955+0000', 'last_undegraded': '2023-06-10T19:02:02.673955+0000', 'last_fullsized': '2023-06-10T19:02:02.673955+0000', 'mapping_epoch': 92, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 92, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:02:02.249926+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:02:02.249926+0000', 'last_clean_scrub_stamp': '2023-06-10T19:02:02.249926+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-06-12T03:28:08.816029+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': ['7', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-06-10T19:02:07.465 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.10 is not active+clean 2023-06-10T19:02:07.465 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.10', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 93, 'state': 'creating+activating', 'last_fresh': '2023-06-10T19:02:02.659786+0000', 'last_change': '2023-06-10T19:02:02.659786+0000', 'last_active': '2023-06-10T19:02:02.249926+0000', 'last_peered': '2023-06-10T19:02:02.249926+0000', 'last_clean': '2023-06-10T19:02:02.249926+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:02:02.659786+0000', 'last_undegraded': '2023-06-10T19:02:02.659786+0000', 'last_fullsized': '2023-06-10T19:02:02.659786+0000', 'mapping_epoch': 92, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 92, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:02:02.249926+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:02:02.249926+0000', 'last_clean_scrub_stamp': '2023-06-10T19:02:02.249926+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-06-11T22:52:33.909329+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': ['1', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-06-10T19:02:07.465 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.11 is not active+clean 2023-06-10T19:02:07.466 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.11', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 93, 'state': 'creating+activating', 'last_fresh': '2023-06-10T19:02:02.659742+0000', 'last_change': '2023-06-10T19:02:02.659742+0000', 'last_active': '2023-06-10T19:02:02.249926+0000', 'last_peered': '2023-06-10T19:02:02.249926+0000', 'last_clean': '2023-06-10T19:02:02.249926+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:02:02.659742+0000', 'last_undegraded': '2023-06-10T19:02:02.659742+0000', 'last_fullsized': '2023-06-10T19:02:02.659742+0000', 'mapping_epoch': 92, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 92, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:02:02.249926+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:02:02.249926+0000', 'last_clean_scrub_stamp': '2023-06-10T19:02:02.249926+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-06-12T05:13:21.429650+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': ['4', '6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-06-10T19:02:07.466 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.13 is not active+clean 2023-06-10T19:02:07.466 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.13', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 93, 'state': 'creating+activating', 'last_fresh': '2023-06-10T19:02:02.654118+0000', 'last_change': '2023-06-10T19:02:02.654118+0000', 'last_active': '2023-06-10T19:02:02.249926+0000', 'last_peered': '2023-06-10T19:02:02.249926+0000', 'last_clean': '2023-06-10T19:02:02.249926+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:02:02.654118+0000', 'last_undegraded': '2023-06-10T19:02:02.654118+0000', 'last_fullsized': '2023-06-10T19:02:02.654118+0000', 'mapping_epoch': 92, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 92, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:02:02.249926+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:02:02.249926+0000', 'last_clean_scrub_stamp': '2023-06-10T19:02:02.249926+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-06-11T23:41:19.173789+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': ['2', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-06-10T19:02:07.467 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.4 is not active+clean 2023-06-10T19:02:07.467 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.4', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 93, 'state': 'creating+activating', 'last_fresh': '2023-06-10T19:02:02.684672+0000', 'last_change': '2023-06-10T19:02:02.684672+0000', 'last_active': '2023-06-10T19:02:02.249926+0000', 'last_peered': '2023-06-10T19:02:02.249926+0000', 'last_clean': '2023-06-10T19:02:02.249926+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:02:02.684672+0000', 'last_undegraded': '2023-06-10T19:02:02.684672+0000', 'last_fullsized': '2023-06-10T19:02:02.684672+0000', 'mapping_epoch': 92, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 92, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:02:02.249926+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:02:02.249926+0000', 'last_clean_scrub_stamp': '2023-06-10T19:02:02.249926+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-06-12T06:48:21.883343+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': ['6', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-06-10T19:02:07.467 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2 is not active+clean 2023-06-10T19:02:07.468 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2', 'version': "0'0", 'reported_seq': 4, 'reported_epoch': 93, 'state': 'creating+activating', 'last_fresh': '2023-06-10T19:02:02.688613+0000', 'last_change': '2023-06-10T19:02:02.685700+0000', 'last_active': '2023-06-10T19:02:02.249926+0000', 'last_peered': '2023-06-10T19:02:02.249926+0000', 'last_clean': '2023-06-10T19:02:02.249926+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:02:02.688613+0000', 'last_undegraded': '2023-06-10T19:02:02.688613+0000', 'last_fullsized': '2023-06-10T19:02:02.688613+0000', 'mapping_epoch': 92, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 92, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:02:02.249926+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:02:02.249926+0000', 'last_clean_scrub_stamp': '2023-06-10T19:02:02.249926+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-06-11T20:58:45.386899+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': ['6', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-06-10T19:02:07.468 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.f is not active+clean 2023-06-10T19:02:07.468 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.f', 'version': "0'0", 'reported_seq': 4, 'reported_epoch': 93, 'state': 'creating+activating', 'last_fresh': '2023-06-10T19:02:02.681390+0000', 'last_change': '2023-06-10T19:02:02.676482+0000', 'last_active': '2023-06-10T19:02:02.249926+0000', 'last_peered': '2023-06-10T19:02:02.249926+0000', 'last_clean': '2023-06-10T19:02:02.249926+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:02:02.681390+0000', 'last_undegraded': '2023-06-10T19:02:02.681390+0000', 'last_fullsized': '2023-06-10T19:02:02.681390+0000', 'mapping_epoch': 92, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 92, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:02:02.249926+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:02:02.249926+0000', 'last_clean_scrub_stamp': '2023-06-10T19:02:02.249926+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-06-12T00:38:21.898235+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': ['7', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-06-10T19:02:07.468 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.d is not active+clean 2023-06-10T19:02:07.469 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.d', 'version': "0'0", 'reported_seq': 4, 'reported_epoch': 93, 'state': 'creating+activating', 'last_fresh': '2023-06-10T19:02:02.693760+0000', 'last_change': '2023-06-10T19:02:02.685058+0000', 'last_active': '2023-06-10T19:02:02.249926+0000', 'last_peered': '2023-06-10T19:02:02.249926+0000', 'last_clean': '2023-06-10T19:02:02.249926+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:02:02.693760+0000', 'last_undegraded': '2023-06-10T19:02:02.693760+0000', 'last_fullsized': '2023-06-10T19:02:02.693760+0000', 'mapping_epoch': 92, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 92, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:02:02.249926+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:02:02.249926+0000', 'last_clean_scrub_stamp': '2023-06-10T19:02:02.249926+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-06-11T19:29:40.789452+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': ['6', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-06-10T19:02:07.470 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-06-10T19:02:07.577 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-10T19:02:07.580 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-10T19:02:07.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.615+0000 7f475cd6b640 1 Processor -- start 2023-06-10T19:02:07.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.615+0000 7f475cd6b640 1 -- start start 2023-06-10T19:02:07.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.615+0000 7f475cd6b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f47580affc0 0x7f47580b0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:07.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.615+0000 7f475cd6b640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f475806fa60 con 0x7f4758070500 2023-06-10T19:02:07.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.615+0000 7f475cd6b640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f475806a340 con 0x7f4758157cf0 2023-06-10T19:02:07.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.615+0000 7f475cd6b640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47580cae00 con 0x7f47580affc0 2023-06-10T19:02:07.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.619+0000 7f4756d9d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f4758070500 0x7f4758070920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:38996/0 (socket says 172.21.15.53:38996) 2023-06-10T19:02:07.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.619+0000 7f4756d9d640 1 -- 172.21.15.53:0/1673372862 learned_addr learned my addr 172.21.15.53:0/1673372862 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:02:07.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.619+0000 7f474dd9b640 1 --2- 172.21.15.53:0/1673372862 >> v2:172.21.15.117:3300/0 conn(0x7f47580affc0 0x7f47580b0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:07.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.619+0000 7f4755d9b640 1 -- 172.21.15.53:0/1673372862 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1670711811 0 0) 0x7f475806fa60 con 0x7f4758070500 2023-06-10T19:02:07.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.619+0000 7f4755d9b640 1 -- 172.21.15.53:0/1673372862 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4744003530 con 0x7f4758070500 2023-06-10T19:02:07.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.619+0000 7f4755d9b640 1 -- 172.21.15.53:0/1673372862 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1048329396 0 0) 0x7f4744003530 con 0x7f4758070500 2023-06-10T19:02:07.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.619+0000 7f4755d9b640 1 -- 172.21.15.53:0/1673372862 >> v2:172.21.15.117:3300/0 conn(0x7f47580affc0 msgr2=0x7f47580b0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:07.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.619+0000 7f4755d9b640 1 --2- 172.21.15.53:0/1673372862 >> v2:172.21.15.117:3300/0 conn(0x7f47580affc0 0x7f47580b0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:07.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.619+0000 7f4755d9b640 1 -- 172.21.15.53:0/1673372862 >> v1:172.21.15.117:6789/0 conn(0x7f4758157cf0 legacy=0x7f47580ca6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:07.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.619+0000 7f4755d9b640 1 -- 172.21.15.53:0/1673372862 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47580c9250 con 0x7f4758070500 2023-06-10T19:02:07.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.619+0000 7f4755d9b640 1 -- 172.21.15.53:0/1673372862 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f4750001a00 con 0x7f4758070500 2023-06-10T19:02:07.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.619+0000 7f4755d9b640 1 -- 172.21.15.53:0/1673372862 >> v1:172.21.15.53:6789/0 conn(0x7f4758070500 legacy=0x7f4758070920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:07.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.619+0000 7f4755d9b640 1 --2- 172.21.15.53:0/1673372862 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47440039f0 0x7f4744003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:07.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.619+0000 7f4755d9b640 1 --2- 172.21.15.53:0/1673372862 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47440047d0 0x7f4744004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:07.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.619+0000 7f4755d9b640 1 --2- 172.21.15.53:0/1673372862 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4744005180 0x7f474400dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:07.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.619+0000 7f4755d9b640 1 -- 172.21.15.53:0/1673372862 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47580cae00 con 0x7f4744005180 2023-06-10T19:02:07.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.619+0000 7f4755d9b640 1 -- 172.21.15.53:0/1673372862 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4744009980 con 0x7f47440047d0 2023-06-10T19:02:07.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.619+0000 7f4755d9b640 1 -- 172.21.15.53:0/1673372862 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4744009b40 con 0x7f47440039f0 2023-06-10T19:02:07.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.619+0000 7f4756d9d640 1 --2- 172.21.15.53:0/1673372862 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4744005180 0x7f474400dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:07.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.619+0000 7f474dd9b640 1 --2- 172.21.15.53:0/1673372862 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47440047d0 0x7f4744004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:07.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.619+0000 7f475659c640 1 --2- 172.21.15.53:0/1673372862 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47440039f0 0x7f4744003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:07.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.619+0000 7f4756d9d640 1 -- 172.21.15.53:0/1673372862 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47440039f0 msgr2=0x7f4744003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:07.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.619+0000 7f4756d9d640 1 --2- 172.21.15.53:0/1673372862 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47440039f0 0x7f4744003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:07.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.619+0000 7f4756d9d640 1 -- 172.21.15.53:0/1673372862 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47440047d0 msgr2=0x7f4744004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:07.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.619+0000 7f4756d9d640 1 --2- 172.21.15.53:0/1673372862 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47440047d0 0x7f4744004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:07.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.619+0000 7f4756d9d640 1 -- 172.21.15.53:0/1673372862 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4744003530 con 0x7f4744005180 2023-06-10T19:02:07.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.619+0000 7f4756d9d640 1 -- 172.21.15.53:0/1673372862 reap_dead start 2023-06-10T19:02:07.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.623+0000 7f4756d9d640 1 --2- 172.21.15.53:0/1673372862 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4744005180 0x7f474400dba0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f475000a830 tx=0x7f475001d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7a82f9786fb0175 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:07.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.623+0000 7f4755d9b640 1 -- 172.21.15.53:0/1673372862 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47500072d0 con 0x7f4744005180 2023-06-10T19:02:07.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.623+0000 7f4755d9b640 1 -- 172.21.15.53:0/1673372862 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47500a8070 con 0x7f4744005180 2023-06-10T19:02:07.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.623+0000 7f4755d9b640 1 -- 172.21.15.53:0/1673372862 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47500076b0 con 0x7f4744005180 2023-06-10T19:02:07.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.623+0000 7f475cd6b640 1 -- 172.21.15.53:0/1673372862 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4744005180 msgr2=0x7f474400dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:07.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.623+0000 7f475cd6b640 1 --2- 172.21.15.53:0/1673372862 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4744005180 0x7f474400dba0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f475000a830 tx=0x7f475001d340 comp rx=0 tx=0).stop 2023-06-10T19:02:07.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.623+0000 7f475cd6b640 1 -- 172.21.15.53:0/1673372862 shutdown_connections 2023-06-10T19:02:07.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.623+0000 7f475cd6b640 1 --2- 172.21.15.53:0/1673372862 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4744005180 0x7f474400dba0 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:07.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.623+0000 7f475cd6b640 1 -- 172.21.15.53:0/1673372862 >> 172.21.15.53:0/1673372862 conn(0x7f47580cafc0 msgr2=0x7f47580cb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:07.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.623+0000 7f475cd6b640 1 -- 172.21.15.53:0/1673372862 shutdown_connections 2023-06-10T19:02:07.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.623+0000 7f475cd6b640 1 -- 172.21.15.53:0/1673372862 wait complete. 2023-06-10T19:02:07.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.623+0000 7f475cd6b640 1 Processor -- start 2023-06-10T19:02:07.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.623+0000 7f475cd6b640 1 -- start start 2023-06-10T19:02:07.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.623+0000 7f475cd6b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4744005180 0x7f4758153bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:07.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.623+0000 7f475cd6b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4758159d90 0x7f475815a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:07.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.623+0000 7f475cd6b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f475815b850 0x7f475815bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:07.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.623+0000 7f475cd6b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f475815c200 con 0x7f4758159d90 2023-06-10T19:02:07.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.623+0000 7f475cd6b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f475815a830 con 0x7f475815b850 2023-06-10T19:02:07.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.623+0000 7f475cd6b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47581f0930 con 0x7f4744005180 2023-06-10T19:02:07.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.623+0000 7f474dd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4758159d90 0x7f475815a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:07.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.623+0000 7f474dd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4758159d90 0x7f475815a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37456/0 (socket says 172.21.15.53:37456) 2023-06-10T19:02:07.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.623+0000 7f474dd9b640 1 -- 172.21.15.53:0/2073310348 learned_addr learned my addr 172.21.15.53:0/2073310348 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:07.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.623+0000 7f475659c640 1 --2- 172.21.15.53:0/2073310348 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4744005180 0x7f4758153bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:07.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.623+0000 7f4756d9d640 1 --2- 172.21.15.53:0/2073310348 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f475815b850 0x7f475815bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:07.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.623+0000 7f474dd9b640 1 -- 172.21.15.53:0/2073310348 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4744005180 msgr2=0x7f4758153bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:07.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.623+0000 7f474dd9b640 1 --2- 172.21.15.53:0/2073310348 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4744005180 0x7f4758153bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:07.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.623+0000 7f474dd9b640 1 -- 172.21.15.53:0/2073310348 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f475815b850 msgr2=0x7f475815bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:07.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.623+0000 7f474dd9b640 1 --2- 172.21.15.53:0/2073310348 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f475815b850 0x7f475815bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:07.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.623+0000 7f474dd9b640 1 -- 172.21.15.53:0/2073310348 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47581f0c10 con 0x7f4758159d90 2023-06-10T19:02:07.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.623+0000 7f474dd9b640 1 --2- 172.21.15.53:0/2073310348 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4758159d90 0x7f475815a200 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f4740011960 tx=0x7f4740011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:07.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.627+0000 7f474f7fe640 1 -- 172.21.15.53:0/2073310348 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474000faf0 con 0x7f4758159d90 2023-06-10T19:02:07.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.627+0000 7f474f7fe640 1 -- 172.21.15.53:0/2073310348 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f474000fc50 con 0x7f4758159d90 2023-06-10T19:02:07.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.627+0000 7f475cd6b640 1 -- 172.21.15.53:0/2073310348 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47581f0ef0 con 0x7f4758159d90 2023-06-10T19:02:07.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.627+0000 7f474f7fe640 1 -- 172.21.15.53:0/2073310348 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4740014440 con 0x7f4758159d90 2023-06-10T19:02:07.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.627+0000 7f475cd6b640 1 -- 172.21.15.53:0/2073310348 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47581540f0 con 0x7f4758159d90 2023-06-10T19:02:07.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.627+0000 7f475cd6b640 1 -- 172.21.15.53:0/2073310348 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4758071be0 con 0x7f4758159d90 2023-06-10T19:02:07.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.627+0000 7f474f7fe640 1 -- 172.21.15.53:0/2073310348 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f47400145a0 con 0x7f4758159d90 2023-06-10T19:02:07.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.627+0000 7f474f7fe640 1 --2- 172.21.15.53:0/2073310348 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f47380662a0 0x7f4738068750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:07.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.627+0000 7f474f7fe640 1 -- 172.21.15.53:0/2073310348 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4740084530 con 0x7f4758159d90 2023-06-10T19:02:07.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.627+0000 7f475659c640 1 --2- 172.21.15.53:0/2073310348 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f47380662a0 0x7f4738068750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:07.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.627+0000 7f475659c640 1 --2- 172.21.15.53:0/2073310348 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f47380662a0 0x7f4738068750 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f475815b490 tx=0x7f4748009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:07.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.631+0000 7f474f7fe640 1 -- 172.21.15.53:0/2073310348 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f47400519b0 con 0x7f4758159d90 2023-06-10T19:02:07.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.843+0000 7f475cd6b640 1 -- 172.21.15.53:0/2073310348 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f47580c1e60 con 0x7f4758159d90 2023-06-10T19:02:07.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.843+0000 7f474f7fe640 1 -- 172.21.15.53:0/2073310348 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1137 (secure 0 0 0) 0x7f4740054fd0 con 0x7f4758159d90 2023-06-10T19:02:07.846 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:02:07.846 INFO:teuthology.orchestra.run.smithi053.stdout:{"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":586,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":94,"num_osds":8,"num_up_osds":8,"osd_up_since":1686423152,"num_in_osds":8,"osd_in_since":1686423143,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":83},{"state_name":"creating+activating","count":19},{"state_name":"active","count":3}],"num_pgs":105,"num_pools":4,"num_objects":22,"data_bytes":591838,"bytes_used":264515584,"bytes_avail":772829597696,"bytes_total":773094113280,"inactive_pgs_ratio":0.18095238506793976,"write_bytes_sec":2951,"read_op_per_sec":0,"write_op_per_sec":9},"fsmap":{"epoch":48,"id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"a","status":"up:active","gid":7830}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":11,"modified":"2023-06-10T19:01:51.759709+0000","services":{}},"progress_events":{}} 2023-06-10T19:02:07.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.847+0000 7f475cd6b640 1 -- 172.21.15.53:0/2073310348 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f47380662a0 msgr2=0x7f4738068750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:07.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.847+0000 7f475cd6b640 1 --2- 172.21.15.53:0/2073310348 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f47380662a0 0x7f4738068750 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f475815b490 tx=0x7f4748009040 comp rx=0 tx=0).stop 2023-06-10T19:02:07.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.847+0000 7f475cd6b640 1 -- 172.21.15.53:0/2073310348 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4758159d90 msgr2=0x7f475815a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:07.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.847+0000 7f475cd6b640 1 --2- 172.21.15.53:0/2073310348 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4758159d90 0x7f475815a200 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f4740011960 tx=0x7f4740011e20 comp rx=0 tx=0).stop 2023-06-10T19:02:07.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.847+0000 7f475cd6b640 1 -- 172.21.15.53:0/2073310348 shutdown_connections 2023-06-10T19:02:07.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.847+0000 7f475cd6b640 1 --2- 172.21.15.53:0/2073310348 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f47380662a0 0x7f4738068750 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:07.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.847+0000 7f475cd6b640 1 --2- 172.21.15.53:0/2073310348 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f475815b850 0x7f475815bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:07.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.847+0000 7f475cd6b640 1 --2- 172.21.15.53:0/2073310348 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4758159d90 0x7f475815a200 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:07.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.847+0000 7f475cd6b640 1 --2- 172.21.15.53:0/2073310348 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4744005180 0x7f4758153bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:07.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.847+0000 7f475cd6b640 1 -- 172.21.15.53:0/2073310348 >> 172.21.15.53:0/2073310348 conn(0x7f47580cafc0 msgr2=0x7f4758156fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:07.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.847+0000 7f475cd6b640 1 -- 172.21.15.53:0/2073310348 shutdown_connections 2023-06-10T19:02:07.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:07.847+0000 7f475cd6b640 1 -- 172.21.15.53:0/2073310348 wait complete. 2023-06-10T19:02:07.865 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-06-10T19:02:07.866 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-10T19:02:08.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.035+0000 7fa366327640 1 Processor -- start 2023-06-10T19:02:08.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.035+0000 7fa366327640 1 -- start start 2023-06-10T19:02:08.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.039+0000 7fa366327640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa360071060 0x7fa3600af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:08.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.039+0000 7fa366327640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa360159b50 con 0x7fa3600afc60 2023-06-10T19:02:08.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.039+0000 7fa366327640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3600702a0 con 0x7fa3600c9840 2023-06-10T19:02:08.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.039+0000 7fa366327640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa360070580 con 0x7fa360071060 2023-06-10T19:02:08.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.039+0000 7fa3648c4640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fa3600afc60 0x7fa36006b090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:39006/0 (socket says 172.21.15.53:39006) 2023-06-10T19:02:08.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.039+0000 7fa3648c4640 1 -- 172.21.15.53:0/1088451468 learned_addr learned my addr 172.21.15.53:0/1088451468 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:02:08.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.039+0000 7fa35f7fe640 1 --2- 172.21.15.53:0/1088451468 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa360071060 0x7fa3600af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:08.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.039+0000 7fa35effd640 1 -- 172.21.15.53:0/1088451468 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 122327363 0 0) 0x7fa360159b50 con 0x7fa3600afc60 2023-06-10T19:02:08.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.039+0000 7fa35effd640 1 -- 172.21.15.53:0/1088451468 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa34c003530 con 0x7fa3600afc60 2023-06-10T19:02:08.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.039+0000 7fa35effd640 1 -- 172.21.15.53:0/1088451468 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 40264118 0 0) 0x7fa34c003530 con 0x7fa3600afc60 2023-06-10T19:02:08.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.039+0000 7fa35effd640 1 -- 172.21.15.53:0/1088451468 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa360071060 msgr2=0x7fa3600af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:08.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.039+0000 7fa35effd640 1 --2- 172.21.15.53:0/1088451468 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa360071060 0x7fa3600af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:08.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.039+0000 7fa35effd640 1 -- 172.21.15.53:0/1088451468 >> v1:172.21.15.117:6789/0 conn(0x7fa3600c9840 legacy=0x7fa3600c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:08.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.039+0000 7fa35effd640 1 -- 172.21.15.53:0/1088451468 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa360070860 con 0x7fa3600afc60 2023-06-10T19:02:08.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.039+0000 7fa35effd640 1 -- 172.21.15.53:0/1088451468 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fa350001a00 con 0x7fa3600afc60 2023-06-10T19:02:08.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.039+0000 7fa35effd640 1 -- 172.21.15.53:0/1088451468 >> v1:172.21.15.53:6789/0 conn(0x7fa3600afc60 legacy=0x7fa36006b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:08.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.039+0000 7fa35effd640 1 --2- 172.21.15.53:0/1088451468 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa34c003a20 0x7fa34c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:08.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.039+0000 7fa35effd640 1 --2- 172.21.15.53:0/1088451468 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa360071060 0x7fa34c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:08.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.039+0000 7fa35effd640 1 --2- 172.21.15.53:0/1088451468 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa34c004d10 0x7fa34c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:08.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.039+0000 7fa35effd640 1 -- 172.21.15.53:0/1088451468 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa360070580 con 0x7fa34c003a20 2023-06-10T19:02:08.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.039+0000 7fa35effd640 1 -- 172.21.15.53:0/1088451468 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa34c00ba70 con 0x7fa34c004d10 2023-06-10T19:02:08.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.039+0000 7fa35effd640 1 -- 172.21.15.53:0/1088451468 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa34c00bc30 con 0x7fa360071060 2023-06-10T19:02:08.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.039+0000 7fa35ffff640 1 --2- 172.21.15.53:0/1088451468 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa34c003a20 0x7fa34c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:08.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.039+0000 7fa3648c4640 1 --2- 172.21.15.53:0/1088451468 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa34c004d10 0x7fa34c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:08.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.039+0000 7fa35f7fe640 1 --2- 172.21.15.53:0/1088451468 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa360071060 0x7fa34c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:08.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.039+0000 7fa35ffff640 1 -- 172.21.15.53:0/1088451468 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa360071060 msgr2=0x7fa34c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:08.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.039+0000 7fa35ffff640 1 --2- 172.21.15.53:0/1088451468 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa360071060 0x7fa34c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:08.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.039+0000 7fa35ffff640 1 -- 172.21.15.53:0/1088451468 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa34c004d10 msgr2=0x7fa34c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:08.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.039+0000 7fa35ffff640 1 --2- 172.21.15.53:0/1088451468 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa34c004d10 0x7fa34c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:08.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.039+0000 7fa35ffff640 1 -- 172.21.15.53:0/1088451468 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa34c003530 con 0x7fa34c003a20 2023-06-10T19:02:08.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.043+0000 7fa35ffff640 1 --2- 172.21.15.53:0/1088451468 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa34c003a20 0x7fa34c003e30 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7fa358001780 tx=0x7fa35801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99cef3675c62bbbb server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:08.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.043+0000 7fa35effd640 1 -- 172.21.15.53:0/1088451468 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3580052d0 con 0x7fa34c003a20 2023-06-10T19:02:08.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.043+0000 7fa35effd640 1 -- 172.21.15.53:0/1088451468 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3580a7050 con 0x7fa34c003a20 2023-06-10T19:02:08.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.043+0000 7fa35effd640 1 -- 172.21.15.53:0/1088451468 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa358003600 con 0x7fa34c003a20 2023-06-10T19:02:08.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.043+0000 7fa366327640 1 -- 172.21.15.53:0/1088451468 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa34c003a20 msgr2=0x7fa34c003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:08.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.043+0000 7fa366327640 1 --2- 172.21.15.53:0/1088451468 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa34c003a20 0x7fa34c003e30 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7fa358001780 tx=0x7fa35801c3d0 comp rx=0 tx=0).stop 2023-06-10T19:02:08.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.043+0000 7fa3648c4640 1 -- 172.21.15.53:0/1088451468 reap_dead start 2023-06-10T19:02:08.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.043+0000 7fa366327640 1 -- 172.21.15.53:0/1088451468 shutdown_connections 2023-06-10T19:02:08.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.043+0000 7fa366327640 1 -- 172.21.15.53:0/1088451468 >> 172.21.15.53:0/1088451468 conn(0x7fa36006a0d0 msgr2=0x7fa3600ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:08.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.043+0000 7fa366327640 1 -- 172.21.15.53:0/1088451468 shutdown_connections 2023-06-10T19:02:08.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.043+0000 7fa366327640 1 -- 172.21.15.53:0/1088451468 wait complete. 2023-06-10T19:02:08.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.043+0000 7fa366327640 1 Processor -- start 2023-06-10T19:02:08.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.043+0000 7fa366327640 1 -- start start 2023-06-10T19:02:08.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.043+0000 7fa366327640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa34c003a20 0x7fa3600ac930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:08.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.043+0000 7fa366327640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa360151e30 0x7fa360152380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:08.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.043+0000 7fa366327640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa360152cb0 0x7fa360151290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:08.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.043+0000 7fa366327640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3600ac4a0 con 0x7fa360151e30 2023-06-10T19:02:08.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.043+0000 7fa366327640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3600ab900 con 0x7fa360152cb0 2023-06-10T19:02:08.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.043+0000 7fa366327640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3600abb70 con 0x7fa34c003a20 2023-06-10T19:02:08.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.043+0000 7fa35f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa360151e30 0x7fa360152380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:08.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.043+0000 7fa35f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa360151e30 0x7fa360152380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37472/0 (socket says 172.21.15.53:37472) 2023-06-10T19:02:08.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.043+0000 7fa35f7fe640 1 -- 172.21.15.53:0/2993098911 learned_addr learned my addr 172.21.15.53:0/2993098911 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:08.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.047+0000 7fa35ffff640 1 --2- 172.21.15.53:0/2993098911 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa34c003a20 0x7fa3600ac930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:08.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.047+0000 7fa3648c4640 1 --2- 172.21.15.53:0/2993098911 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa360152cb0 0x7fa360151290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:08.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.047+0000 7fa35f7fe640 1 -- 172.21.15.53:0/2993098911 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa34c003a20 msgr2=0x7fa3600ac930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:08.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.047+0000 7fa35f7fe640 1 --2- 172.21.15.53:0/2993098911 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa34c003a20 0x7fa3600ac930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:08.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.047+0000 7fa35f7fe640 1 -- 172.21.15.53:0/2993098911 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa360152cb0 msgr2=0x7fa360151290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:08.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.047+0000 7fa35f7fe640 1 --2- 172.21.15.53:0/2993098911 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa360152cb0 0x7fa360151290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:08.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.047+0000 7fa35f7fe640 1 -- 172.21.15.53:0/2993098911 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3600abe50 con 0x7fa360151e30 2023-06-10T19:02:08.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.047+0000 7fa3648c4640 1 --2- 172.21.15.53:0/2993098911 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa360152cb0 0x7fa360151290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:02:08.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.047+0000 7fa35f7fe640 1 --2- 172.21.15.53:0/2993098911 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa360151e30 0x7fa360152380 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7fa3480115c0 tx=0x7fa348011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:08.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.047+0000 7fa35cff9640 1 -- 172.21.15.53:0/2993098911 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa348004220 con 0x7fa360151e30 2023-06-10T19:02:08.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.047+0000 7fa35cff9640 1 -- 172.21.15.53:0/2993098911 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa348004380 con 0x7fa360151e30 2023-06-10T19:02:08.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.047+0000 7fa366327640 1 -- 172.21.15.53:0/2993098911 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3600ac130 con 0x7fa360151e30 2023-06-10T19:02:08.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.047+0000 7fa35cff9640 1 -- 172.21.15.53:0/2993098911 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34800f8f0 con 0x7fa360151e30 2023-06-10T19:02:08.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.047+0000 7fa366327640 1 -- 172.21.15.53:0/2993098911 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa360153120 con 0x7fa360151e30 2023-06-10T19:02:08.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.047+0000 7fa366327640 1 -- 172.21.15.53:0/2993098911 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3601533a0 con 0x7fa360151e30 2023-06-10T19:02:08.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.047+0000 7fa35cff9640 1 -- 172.21.15.53:0/2993098911 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa34800fa50 con 0x7fa360151e30 2023-06-10T19:02:08.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.047+0000 7fa35cff9640 1 --2- 172.21.15.53:0/2993098911 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa3400662b0 0x7fa340068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:08.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.047+0000 7fa35cff9640 1 -- 172.21.15.53:0/2993098911 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa348083e20 con 0x7fa360151e30 2023-06-10T19:02:08.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.047+0000 7fa35ffff640 1 --2- 172.21.15.53:0/2993098911 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa3400662b0 0x7fa340068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:08.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.047+0000 7fa35ffff640 1 --2- 172.21.15.53:0/2993098911 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa3400662b0 0x7fa340068760 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fa3580ac000 tx=0x7fa3580011a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:08.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.051+0000 7fa35cff9640 1 -- 172.21.15.53:0/2993098911 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa3480512a0 con 0x7fa360151e30 2023-06-10T19:02:08.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.199+0000 7fa366327640 1 -- 172.21.15.53:0/2993098911 --> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa36015aba0 con 0x7fa3400662b0 2023-06-10T19:02:08.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.223+0000 7fa35cff9640 1 -- 172.21.15.53:0/2993098911 <== mgr.4105 v2:172.21.15.117:6832/3061986771 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+309980 (secure 0 0 0) 0x7fa358005370 con 0x7fa3400662b0 2023-06-10T19:02:08.226 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:02:08.229 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-06-10T19:02:08.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.227+0000 7fa366327640 1 -- 172.21.15.53:0/2993098911 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa3400662b0 msgr2=0x7fa340068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:08.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.227+0000 7fa366327640 1 --2- 172.21.15.53:0/2993098911 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa3400662b0 0x7fa340068760 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fa3580ac000 tx=0x7fa3580011a0 comp rx=0 tx=0).stop 2023-06-10T19:02:08.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.227+0000 7fa366327640 1 -- 172.21.15.53:0/2993098911 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa360151e30 msgr2=0x7fa360152380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:08.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.227+0000 7fa366327640 1 --2- 172.21.15.53:0/2993098911 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa360151e30 0x7fa360152380 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7fa3480115c0 tx=0x7fa348011a80 comp rx=0 tx=0).stop 2023-06-10T19:02:08.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.227+0000 7fa366327640 1 -- 172.21.15.53:0/2993098911 shutdown_connections 2023-06-10T19:02:08.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.227+0000 7fa366327640 1 --2- 172.21.15.53:0/2993098911 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa3400662b0 0x7fa340068760 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:08.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.227+0000 7fa366327640 1 --2- 172.21.15.53:0/2993098911 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa360152cb0 0x7fa360151290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:08.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.227+0000 7fa366327640 1 --2- 172.21.15.53:0/2993098911 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa360151e30 0x7fa360152380 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:08.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.227+0000 7fa366327640 1 --2- 172.21.15.53:0/2993098911 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa34c003a20 0x7fa3600ac930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:08.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.227+0000 7fa366327640 1 -- 172.21.15.53:0/2993098911 >> 172.21.15.53:0/2993098911 conn(0x7fa36006a0d0 msgr2=0x7fa3600c9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:08.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.227+0000 7fa366327640 1 -- 172.21.15.53:0/2993098911 shutdown_connections 2023-06-10T19:02:08.232 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:08.227+0000 7fa366327640 1 -- 172.21.15.53:0/2993098911 wait complete. 2023-06-10T19:02:08.246 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":375,"stamp":"2023-06-10T19:02:07.764030+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":258620,"kb_used_data":10236,"kb_used_omap":0,"kb_used_meta":248320,"kb_avail":754716100,"statfs":{"total":773094113280,"available":772829286400,"internally_reserved":0,"allocated":10481664,"data_stored":5394123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":254279680},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":52,"apply_latency_ms":52,"commit_latency_ns":52000000,"apply_latency_ns":52000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001707"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:05.665852+0000","last_change":"2023-06-10T19:02:02.665348+0000","last_active":"2023-06-10T19:02:05.665852+0000","last_peered":"2023-06-10T19:02:05.665852+0000","last_clean":"2023-06-10T19:02:05.665852+0000","last_became_active":"2023-06-10T19:02:02.665052+0000","last_became_peered":"2023-06-10T19:02:02.665052+0000","last_unstale":"2023-06-10T19:02:05.665852+0000","last_undegraded":"2023-06-10T19:02:05.665852+0000","last_fullsized":"2023-06-10T19:02:05.665852+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:02:31.253313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.665347+0000","last_change":"2023-06-10T19:02:02.671565+0000","last_active":"2023-06-10T19:02:03.665347+0000","last_peered":"2023-06-10T19:02:03.665347+0000","last_clean":"2023-06-10T19:02:03.665347+0000","last_became_active":"2023-06-10T19:02:02.670788+0000","last_became_peered":"2023-06-10T19:02:02.670788+0000","last_unstale":"2023-06-10T19:02:03.665347+0000","last_undegraded":"2023-06-10T19:02:03.665347+0000","last_fullsized":"2023-06-10T19:02:03.665347+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:09:27.770652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:05.665389+0000","last_change":"2023-06-10T19:02:02.684406+0000","last_active":"2023-06-10T19:02:05.665389+0000","last_peered":"2023-06-10T19:02:05.665389+0000","last_clean":"2023-06-10T19:02:05.665389+0000","last_became_active":"2023-06-10T19:02:02.684069+0000","last_became_peered":"2023-06-10T19:02:02.684069+0000","last_unstale":"2023-06-10T19:02:05.665389+0000","last_undegraded":"2023-06-10T19:02:05.665389+0000","last_fullsized":"2023-06-10T19:02:05.665389+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:23:03.514448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:05.667766+0000","last_change":"2023-06-10T19:02:02.704383+0000","last_active":"2023-06-10T19:02:05.667766+0000","last_peered":"2023-06-10T19:02:05.667766+0000","last_clean":"2023-06-10T19:02:05.667766+0000","last_became_active":"2023-06-10T19:02:02.704046+0000","last_became_peered":"2023-06-10T19:02:02.704046+0000","last_unstale":"2023-06-10T19:02:05.667766+0000","last_undegraded":"2023-06-10T19:02:05.667766+0000","last_fullsized":"2023-06-10T19:02:05.667766+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:57:05.604556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.663941+0000","last_change":"2023-06-10T19:02:02.705465+0000","last_active":"2023-06-10T19:02:03.663941+0000","last_peered":"2023-06-10T19:02:03.663941+0000","last_clean":"2023-06-10T19:02:03.663941+0000","last_became_active":"2023-06-10T19:02:02.704656+0000","last_became_peered":"2023-06-10T19:02:02.704656+0000","last_unstale":"2023-06-10T19:02:03.663941+0000","last_undegraded":"2023-06-10T19:02:03.663941+0000","last_fullsized":"2023-06-10T19:02:03.663941+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:17:35.748764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.660363+0000","last_change":"2023-06-10T19:02:02.673704+0000","last_active":"2023-06-10T19:02:03.660363+0000","last_peered":"2023-06-10T19:02:03.660363+0000","last_clean":"2023-06-10T19:02:03.660363+0000","last_became_active":"2023-06-10T19:02:02.673439+0000","last_became_peered":"2023-06-10T19:02:02.673439+0000","last_unstale":"2023-06-10T19:02:03.660363+0000","last_undegraded":"2023-06-10T19:02:03.660363+0000","last_fullsized":"2023-06-10T19:02:03.660363+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:05:05.427451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:04.256186+0000","last_change":"2023-06-10T19:02:02.695952+0000","last_active":"2023-06-10T19:02:04.256186+0000","last_peered":"2023-06-10T19:02:04.256186+0000","last_clean":"2023-06-10T19:02:04.256186+0000","last_became_active":"2023-06-10T19:02:02.695070+0000","last_became_peered":"2023-06-10T19:02:02.695070+0000","last_unstale":"2023-06-10T19:02:04.256186+0000","last_undegraded":"2023-06-10T19:02:04.256186+0000","last_fullsized":"2023-06-10T19:02:04.256186+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:53:41.678682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:05.667419+0000","last_change":"2023-06-10T19:02:02.696076+0000","last_active":"2023-06-10T19:02:05.667419+0000","last_peered":"2023-06-10T19:02:05.667419+0000","last_clean":"2023-06-10T19:02:05.667419+0000","last_became_active":"2023-06-10T19:02:02.695827+0000","last_became_peered":"2023-06-10T19:02:02.695827+0000","last_unstale":"2023-06-10T19:02:05.667419+0000","last_undegraded":"2023-06-10T19:02:05.667419+0000","last_fullsized":"2023-06-10T19:02:05.667419+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:34:31.102100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.666034+0000","last_change":"2023-06-10T19:02:02.680828+0000","last_active":"2023-06-10T19:02:03.666034+0000","last_peered":"2023-06-10T19:02:03.666034+0000","last_clean":"2023-06-10T19:02:03.666034+0000","last_became_active":"2023-06-10T19:02:02.680039+0000","last_became_peered":"2023-06-10T19:02:02.680039+0000","last_unstale":"2023-06-10T19:02:03.666034+0000","last_undegraded":"2023-06-10T19:02:03.666034+0000","last_fullsized":"2023-06-10T19:02:03.666034+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:53:35.742228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:04.686926+0000","last_change":"2023-06-10T19:02:02.665553+0000","last_active":"2023-06-10T19:02:04.686926+0000","last_peered":"2023-06-10T19:02:04.686926+0000","last_clean":"2023-06-10T19:02:04.686926+0000","last_became_active":"2023-06-10T19:02:02.665255+0000","last_became_peered":"2023-06-10T19:02:02.665255+0000","last_unstale":"2023-06-10T19:02:04.686926+0000","last_undegraded":"2023-06-10T19:02:04.686926+0000","last_fullsized":"2023-06-10T19:02:04.686926+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:50:17.367479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.665033+0000","last_change":"2023-06-10T19:02:02.683637+0000","last_active":"2023-06-10T19:02:03.665033+0000","last_peered":"2023-06-10T19:02:03.665033+0000","last_clean":"2023-06-10T19:02:03.665033+0000","last_became_active":"2023-06-10T19:02:02.682347+0000","last_became_peered":"2023-06-10T19:02:02.682347+0000","last_unstale":"2023-06-10T19:02:03.665033+0000","last_undegraded":"2023-06-10T19:02:03.665033+0000","last_fullsized":"2023-06-10T19:02:03.665033+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:52:44.045036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:04.686668+0000","last_change":"2023-06-10T19:02:02.670292+0000","last_active":"2023-06-10T19:02:04.686668+0000","last_peered":"2023-06-10T19:02:04.686668+0000","last_clean":"2023-06-10T19:02:04.686668+0000","last_became_active":"2023-06-10T19:02:02.670000+0000","last_became_peered":"2023-06-10T19:02:02.670000+0000","last_unstale":"2023-06-10T19:02:04.686668+0000","last_undegraded":"2023-06-10T19:02:04.686668+0000","last_fullsized":"2023-06-10T19:02:04.686668+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:33:33.449734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:05.667550+0000","last_change":"2023-06-10T19:02:02.697503+0000","last_active":"2023-06-10T19:02:05.667550+0000","last_peered":"2023-06-10T19:02:05.667550+0000","last_clean":"2023-06-10T19:02:05.667550+0000","last_became_active":"2023-06-10T19:02:02.697195+0000","last_became_peered":"2023-06-10T19:02:02.697195+0000","last_unstale":"2023-06-10T19:02:05.667550+0000","last_undegraded":"2023-06-10T19:02:05.667550+0000","last_fullsized":"2023-06-10T19:02:05.667550+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:31:47.474672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.662649+0000","last_change":"2023-06-10T19:02:02.685717+0000","last_active":"2023-06-10T19:02:03.662649+0000","last_peered":"2023-06-10T19:02:03.662649+0000","last_clean":"2023-06-10T19:02:03.662649+0000","last_became_active":"2023-06-10T19:02:02.685029+0000","last_became_peered":"2023-06-10T19:02:02.685029+0000","last_unstale":"2023-06-10T19:02:03.662649+0000","last_undegraded":"2023-06-10T19:02:03.662649+0000","last_fullsized":"2023-06-10T19:02:03.662649+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:54:34.033395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:05.666607+0000","last_change":"2023-06-10T19:02:02.672291+0000","last_active":"2023-06-10T19:02:05.666607+0000","last_peered":"2023-06-10T19:02:05.666607+0000","last_clean":"2023-06-10T19:02:05.666607+0000","last_became_active":"2023-06-10T19:02:02.672015+0000","last_became_peered":"2023-06-10T19:02:02.672015+0000","last_unstale":"2023-06-10T19:02:05.666607+0000","last_undegraded":"2023-06-10T19:02:05.666607+0000","last_fullsized":"2023-06-10T19:02:05.666607+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:58:47.859709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.660400+0000","last_change":"2023-06-10T19:02:02.672362+0000","last_active":"2023-06-10T19:02:03.660400+0000","last_peered":"2023-06-10T19:02:03.660400+0000","last_clean":"2023-06-10T19:02:03.660400+0000","last_became_active":"2023-06-10T19:02:02.672058+0000","last_became_peered":"2023-06-10T19:02:02.672058+0000","last_unstale":"2023-06-10T19:02:03.660400+0000","last_undegraded":"2023-06-10T19:02:03.660400+0000","last_fullsized":"2023-06-10T19:02:03.660400+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:41:51.504050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.661431+0000","last_change":"2023-06-10T19:02:02.667709+0000","last_active":"2023-06-10T19:02:03.661431+0000","last_peered":"2023-06-10T19:02:03.661431+0000","last_clean":"2023-06-10T19:02:03.661431+0000","last_became_active":"2023-06-10T19:02:02.667406+0000","last_became_peered":"2023-06-10T19:02:02.667406+0000","last_unstale":"2023-06-10T19:02:03.661431+0000","last_undegraded":"2023-06-10T19:02:03.661431+0000","last_fullsized":"2023-06-10T19:02:03.661431+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:40:40.525125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:05.666158+0000","last_change":"2023-06-10T19:02:02.668883+0000","last_active":"2023-06-10T19:02:05.666158+0000","last_peered":"2023-06-10T19:02:05.666158+0000","last_clean":"2023-06-10T19:02:05.666158+0000","last_became_active":"2023-06-10T19:02:02.668590+0000","last_became_peered":"2023-06-10T19:02:02.668590+0000","last_unstale":"2023-06-10T19:02:05.666158+0000","last_undegraded":"2023-06-10T19:02:05.666158+0000","last_fullsized":"2023-06-10T19:02:05.666158+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:34:07.221258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.663482+0000","last_change":"2023-06-10T19:02:02.699972+0000","last_active":"2023-06-10T19:02:03.663482+0000","last_peered":"2023-06-10T19:02:03.663482+0000","last_clean":"2023-06-10T19:02:03.663482+0000","last_became_active":"2023-06-10T19:02:02.699193+0000","last_became_peered":"2023-06-10T19:02:02.699193+0000","last_unstale":"2023-06-10T19:02:03.663482+0000","last_undegraded":"2023-06-10T19:02:03.663482+0000","last_fullsized":"2023-06-10T19:02:03.663482+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:21:23.368290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:05.667998+0000","last_change":"2023-06-10T19:02:02.671985+0000","last_active":"2023-06-10T19:02:05.667998+0000","last_peered":"2023-06-10T19:02:05.667998+0000","last_clean":"2023-06-10T19:02:05.667998+0000","last_became_active":"2023-06-10T19:02:02.671708+0000","last_became_peered":"2023-06-10T19:02:02.671708+0000","last_unstale":"2023-06-10T19:02:05.667998+0000","last_undegraded":"2023-06-10T19:02:05.667998+0000","last_fullsized":"2023-06-10T19:02:05.667998+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:17:49.406346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.662989+0000","last_change":"2023-06-10T19:02:02.700696+0000","last_active":"2023-06-10T19:02:03.662989+0000","last_peered":"2023-06-10T19:02:03.662989+0000","last_clean":"2023-06-10T19:02:03.662989+0000","last_became_active":"2023-06-10T19:02:02.699835+0000","last_became_peered":"2023-06-10T19:02:02.699835+0000","last_unstale":"2023-06-10T19:02:03.662989+0000","last_undegraded":"2023-06-10T19:02:03.662989+0000","last_fullsized":"2023-06-10T19:02:03.662989+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:24:30.859897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.662771+0000","last_change":"2023-06-10T19:02:02.681477+0000","last_active":"2023-06-10T19:02:03.662771+0000","last_peered":"2023-06-10T19:02:03.662771+0000","last_clean":"2023-06-10T19:02:03.662771+0000","last_became_active":"2023-06-10T19:02:02.680610+0000","last_became_peered":"2023-06-10T19:02:02.680610+0000","last_unstale":"2023-06-10T19:02:03.662771+0000","last_undegraded":"2023-06-10T19:02:03.662771+0000","last_fullsized":"2023-06-10T19:02:03.662771+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:34:26.305026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:05.664060+0000","last_change":"2023-06-10T19:02:02.704171+0000","last_active":"2023-06-10T19:02:05.664060+0000","last_peered":"2023-06-10T19:02:05.664060+0000","last_clean":"2023-06-10T19:02:05.664060+0000","last_became_active":"2023-06-10T19:02:02.702763+0000","last_became_peered":"2023-06-10T19:02:02.702763+0000","last_unstale":"2023-06-10T19:02:05.664060+0000","last_undegraded":"2023-06-10T19:02:05.664060+0000","last_fullsized":"2023-06-10T19:02:05.664060+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:23:03.514448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:05.665281+0000","last_change":"2023-06-10T19:02:02.682530+0000","last_active":"2023-06-10T19:02:05.665281+0000","last_peered":"2023-06-10T19:02:05.665281+0000","last_clean":"2023-06-10T19:02:05.665281+0000","last_became_active":"2023-06-10T19:02:02.682004+0000","last_became_peered":"2023-06-10T19:02:02.682004+0000","last_unstale":"2023-06-10T19:02:05.665281+0000","last_undegraded":"2023-06-10T19:02:05.665281+0000","last_fullsized":"2023-06-10T19:02:05.665281+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:39:38.012157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.665424+0000","last_change":"2023-06-10T19:02:02.709249+0000","last_active":"2023-06-10T19:02:03.665424+0000","last_peered":"2023-06-10T19:02:03.665424+0000","last_clean":"2023-06-10T19:02:03.665424+0000","last_became_active":"2023-06-10T19:02:02.708512+0000","last_became_peered":"2023-06-10T19:02:02.708512+0000","last_unstale":"2023-06-10T19:02:03.665424+0000","last_undegraded":"2023-06-10T19:02:03.665424+0000","last_fullsized":"2023-06-10T19:02:03.665424+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:25:02.496395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.665615+0000","last_change":"2023-06-10T19:02:02.698521+0000","last_active":"2023-06-10T19:02:03.665615+0000","last_peered":"2023-06-10T19:02:03.665615+0000","last_clean":"2023-06-10T19:02:03.665615+0000","last_became_active":"2023-06-10T19:02:02.697781+0000","last_became_peered":"2023-06-10T19:02:02.697781+0000","last_unstale":"2023-06-10T19:02:03.665615+0000","last_undegraded":"2023-06-10T19:02:03.665615+0000","last_fullsized":"2023-06-10T19:02:03.665615+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:30:58.125799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:04.686592+0000","last_change":"2023-06-10T19:02:02.704369+0000","last_active":"2023-06-10T19:02:04.686592+0000","last_peered":"2023-06-10T19:02:04.686592+0000","last_clean":"2023-06-10T19:02:04.686592+0000","last_became_active":"2023-06-10T19:02:02.704000+0000","last_became_peered":"2023-06-10T19:02:02.704000+0000","last_unstale":"2023-06-10T19:02:04.686592+0000","last_undegraded":"2023-06-10T19:02:04.686592+0000","last_fullsized":"2023-06-10T19:02:04.686592+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:24:36.649137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:05.668045+0000","last_change":"2023-06-10T19:02:02.700705+0000","last_active":"2023-06-10T19:02:05.668045+0000","last_peered":"2023-06-10T19:02:05.668045+0000","last_clean":"2023-06-10T19:02:05.668045+0000","last_became_active":"2023-06-10T19:02:02.700402+0000","last_became_peered":"2023-06-10T19:02:02.700402+0000","last_unstale":"2023-06-10T19:02:05.668045+0000","last_undegraded":"2023-06-10T19:02:05.668045+0000","last_fullsized":"2023-06-10T19:02:05.668045+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:47:53.570466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:04.256393+0000","last_change":"2023-06-10T19:02:02.707093+0000","last_active":"2023-06-10T19:02:04.256393+0000","last_peered":"2023-06-10T19:02:04.256393+0000","last_clean":"2023-06-10T19:02:04.256393+0000","last_became_active":"2023-06-10T19:02:02.696178+0000","last_became_peered":"2023-06-10T19:02:02.696178+0000","last_unstale":"2023-06-10T19:02:04.256393+0000","last_undegraded":"2023-06-10T19:02:04.256393+0000","last_fullsized":"2023-06-10T19:02:04.256393+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:18:03.087448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.663160+0000","last_change":"2023-06-10T19:02:02.681746+0000","last_active":"2023-06-10T19:02:03.663160+0000","last_peered":"2023-06-10T19:02:03.663160+0000","last_clean":"2023-06-10T19:02:03.663160+0000","last_became_active":"2023-06-10T19:02:02.678889+0000","last_became_peered":"2023-06-10T19:02:02.678889+0000","last_unstale":"2023-06-10T19:02:03.663160+0000","last_undegraded":"2023-06-10T19:02:03.663160+0000","last_fullsized":"2023-06-10T19:02:03.663160+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:13:29.163603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.664057+0000","last_change":"2023-06-10T19:02:02.666485+0000","last_active":"2023-06-10T19:02:03.664057+0000","last_peered":"2023-06-10T19:02:03.664057+0000","last_clean":"2023-06-10T19:02:03.664057+0000","last_became_active":"2023-06-10T19:02:02.665650+0000","last_became_peered":"2023-06-10T19:02:02.665650+0000","last_unstale":"2023-06-10T19:02:03.664057+0000","last_undegraded":"2023-06-10T19:02:03.664057+0000","last_fullsized":"2023-06-10T19:02:03.664057+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:02:40.695753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.660393+0000","last_change":"2023-06-10T19:02:02.668274+0000","last_active":"2023-06-10T19:02:03.660393+0000","last_peered":"2023-06-10T19:02:03.660393+0000","last_clean":"2023-06-10T19:02:03.660393+0000","last_became_active":"2023-06-10T19:02:02.668009+0000","last_became_peered":"2023-06-10T19:02:02.668009+0000","last_unstale":"2023-06-10T19:02:03.660393+0000","last_undegraded":"2023-06-10T19:02:03.660393+0000","last_fullsized":"2023-06-10T19:02:03.660393+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:43:34.042391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.660539+0000","last_change":"2023-06-10T19:02:02.680375+0000","last_active":"2023-06-10T19:02:03.660539+0000","last_peered":"2023-06-10T19:02:03.660539+0000","last_clean":"2023-06-10T19:02:03.660539+0000","last_became_active":"2023-06-10T19:02:02.680094+0000","last_became_peered":"2023-06-10T19:02:02.680094+0000","last_unstale":"2023-06-10T19:02:03.660539+0000","last_undegraded":"2023-06-10T19:02:03.660539+0000","last_fullsized":"2023-06-10T19:02:03.660539+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:52:07.928979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"93'4","reported_seq":17,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:05.664903+0000","last_change":"2023-06-10T19:02:02.307615+0000","last_active":"2023-06-10T19:02:05.664903+0000","last_peered":"2023-06-10T19:02:05.664903+0000","last_clean":"2023-06-10T19:02:05.664903+0000","last_became_active":"2023-06-10T19:02:02.306543+0000","last_became_peered":"2023-06-10T19:02:02.306543+0000","last_unstale":"2023-06-10T19:02:05.664903+0000","last_undegraded":"2023-06-10T19:02:05.664903+0000","last_fullsized":"2023-06-10T19:02:05.664903+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:20:45.097581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.660528+0000","last_change":"2023-06-10T19:02:02.662624+0000","last_active":"2023-06-10T19:02:03.660528+0000","last_peered":"2023-06-10T19:02:03.660528+0000","last_clean":"2023-06-10T19:02:03.660528+0000","last_became_active":"2023-06-10T19:02:02.662135+0000","last_became_peered":"2023-06-10T19:02:02.662135+0000","last_unstale":"2023-06-10T19:02:03.660528+0000","last_undegraded":"2023-06-10T19:02:03.660528+0000","last_fullsized":"2023-06-10T19:02:03.660528+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:26:58.550084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"93'1","reported_seq":14,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.664167+0000","last_change":"2023-06-10T19:02:02.308152+0000","last_active":"2023-06-10T19:02:03.664167+0000","last_peered":"2023-06-10T19:02:03.664167+0000","last_clean":"2023-06-10T19:02:03.664167+0000","last_became_active":"2023-06-10T19:02:02.307326+0000","last_became_peered":"2023-06-10T19:02:02.307326+0000","last_unstale":"2023-06-10T19:02:03.664167+0000","last_undegraded":"2023-06-10T19:02:03.664167+0000","last_fullsized":"2023-06-10T19:02:03.664167+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:27:54.962079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:04.256706+0000","last_change":"2023-06-10T19:02:02.698529+0000","last_active":"2023-06-10T19:02:04.256706+0000","last_peered":"2023-06-10T19:02:04.256706+0000","last_clean":"2023-06-10T19:02:04.256706+0000","last_became_active":"2023-06-10T19:02:02.697828+0000","last_became_peered":"2023-06-10T19:02:02.697828+0000","last_unstale":"2023-06-10T19:02:04.256706+0000","last_undegraded":"2023-06-10T19:02:04.256706+0000","last_fullsized":"2023-06-10T19:02:04.256706+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:43:38.275112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"93'2","reported_seq":15,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:04.256635+0000","last_change":"2023-06-10T19:02:02.298653+0000","last_active":"2023-06-10T19:02:04.256635+0000","last_peered":"2023-06-10T19:02:04.256635+0000","last_clean":"2023-06-10T19:02:04.256635+0000","last_became_active":"2023-06-10T19:02:02.297891+0000","last_became_peered":"2023-06-10T19:02:02.297891+0000","last_unstale":"2023-06-10T19:02:04.256635+0000","last_undegraded":"2023-06-10T19:02:04.256635+0000","last_fullsized":"2023-06-10T19:02:04.256635+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:51:44.650996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.661432+0000","last_change":"2023-06-10T19:02:02.709380+0000","last_active":"2023-06-10T19:02:03.661432+0000","last_peered":"2023-06-10T19:02:03.661432+0000","last_clean":"2023-06-10T19:02:03.661432+0000","last_became_active":"2023-06-10T19:02:02.708762+0000","last_became_peered":"2023-06-10T19:02:02.708762+0000","last_unstale":"2023-06-10T19:02:03.661432+0000","last_undegraded":"2023-06-10T19:02:03.661432+0000","last_fullsized":"2023-06-10T19:02:03.661432+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:21:52.001634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"93'2","reported_seq":15,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:05.664707+0000","last_change":"2023-06-10T19:02:02.309210+0000","last_active":"2023-06-10T19:02:05.664707+0000","last_peered":"2023-06-10T19:02:05.664707+0000","last_clean":"2023-06-10T19:02:05.664707+0000","last_became_active":"2023-06-10T19:02:02.307262+0000","last_became_peered":"2023-06-10T19:02:02.307262+0000","last_unstale":"2023-06-10T19:02:05.664707+0000","last_undegraded":"2023-06-10T19:02:05.664707+0000","last_fullsized":"2023-06-10T19:02:05.664707+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:52:02.971962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:05.666286+0000","last_change":"2023-06-10T19:02:02.675152+0000","last_active":"2023-06-10T19:02:05.666286+0000","last_peered":"2023-06-10T19:02:05.666286+0000","last_clean":"2023-06-10T19:02:05.666286+0000","last_became_active":"2023-06-10T19:02:02.672817+0000","last_became_peered":"2023-06-10T19:02:02.672817+0000","last_unstale":"2023-06-10T19:02:05.666286+0000","last_undegraded":"2023-06-10T19:02:05.666286+0000","last_fullsized":"2023-06-10T19:02:05.666286+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:28:03.009477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"93'1","reported_seq":14,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.663743+0000","last_change":"2023-06-10T19:02:02.285398+0000","last_active":"2023-06-10T19:02:03.663743+0000","last_peered":"2023-06-10T19:02:03.663743+0000","last_clean":"2023-06-10T19:02:03.663743+0000","last_became_active":"2023-06-10T19:02:02.284766+0000","last_became_peered":"2023-06-10T19:02:02.284766+0000","last_unstale":"2023-06-10T19:02:03.663743+0000","last_undegraded":"2023-06-10T19:02:03.663743+0000","last_fullsized":"2023-06-10T19:02:03.663743+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:56:58.963061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:05.664249+0000","last_change":"2023-06-10T19:02:02.703432+0000","last_active":"2023-06-10T19:02:05.664249+0000","last_peered":"2023-06-10T19:02:05.664249+0000","last_clean":"2023-06-10T19:02:05.664249+0000","last_became_active":"2023-06-10T19:02:02.702060+0000","last_became_peered":"2023-06-10T19:02:02.702060+0000","last_unstale":"2023-06-10T19:02:05.664249+0000","last_undegraded":"2023-06-10T19:02:05.664249+0000","last_fullsized":"2023-06-10T19:02:05.664249+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:34:07.221258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"93'1","reported_seq":14,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:05.666780+0000","last_change":"2023-06-10T19:02:02.280702+0000","last_active":"2023-06-10T19:02:05.666780+0000","last_peered":"2023-06-10T19:02:05.666780+0000","last_clean":"2023-06-10T19:02:05.666780+0000","last_became_active":"2023-06-10T19:02:02.280060+0000","last_became_peered":"2023-06-10T19:02:02.280060+0000","last_unstale":"2023-06-10T19:02:05.666780+0000","last_undegraded":"2023-06-10T19:02:05.666780+0000","last_fullsized":"2023-06-10T19:02:05.666780+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:09:33.798317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.660520+0000","last_change":"2023-06-10T19:02:02.676743+0000","last_active":"2023-06-10T19:02:03.660520+0000","last_peered":"2023-06-10T19:02:03.660520+0000","last_clean":"2023-06-10T19:02:03.660520+0000","last_became_active":"2023-06-10T19:02:02.676452+0000","last_became_peered":"2023-06-10T19:02:02.676452+0000","last_unstale":"2023-06-10T19:02:03.660520+0000","last_undegraded":"2023-06-10T19:02:03.660520+0000","last_fullsized":"2023-06-10T19:02:03.660520+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:39:18.604638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:05.665355+0000","last_change":"2023-06-10T19:02:02.291503+0000","last_active":"2023-06-10T19:02:05.665355+0000","last_peered":"2023-06-10T19:02:05.665355+0000","last_clean":"2023-06-10T19:02:05.665355+0000","last_became_active":"2023-06-10T19:02:02.291257+0000","last_became_peered":"2023-06-10T19:02:02.291257+0000","last_unstale":"2023-06-10T19:02:05.665355+0000","last_undegraded":"2023-06-10T19:02:05.665355+0000","last_fullsized":"2023-06-10T19:02:05.665355+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:51:34.839835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:05.667506+0000","last_change":"2023-06-10T19:02:02.705701+0000","last_active":"2023-06-10T19:02:05.667506+0000","last_peered":"2023-06-10T19:02:05.667506+0000","last_clean":"2023-06-10T19:02:05.667506+0000","last_became_active":"2023-06-10T19:02:02.705382+0000","last_became_peered":"2023-06-10T19:02:02.705382+0000","last_unstale":"2023-06-10T19:02:05.667506+0000","last_undegraded":"2023-06-10T19:02:05.667506+0000","last_fullsized":"2023-06-10T19:02:05.667506+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:28:42.792866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:04.256012+0000","last_change":"2023-06-10T19:02:02.298471+0000","last_active":"2023-06-10T19:02:04.256012+0000","last_peered":"2023-06-10T19:02:04.256012+0000","last_clean":"2023-06-10T19:02:04.256012+0000","last_became_active":"2023-06-10T19:02:02.297847+0000","last_became_peered":"2023-06-10T19:02:02.297847+0000","last_unstale":"2023-06-10T19:02:04.256012+0000","last_undegraded":"2023-06-10T19:02:04.256012+0000","last_fullsized":"2023-06-10T19:02:04.256012+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:49:17.566973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.663631+0000","last_change":"2023-06-10T19:02:02.699437+0000","last_active":"2023-06-10T19:02:03.663631+0000","last_peered":"2023-06-10T19:02:03.663631+0000","last_clean":"2023-06-10T19:02:03.663631+0000","last_became_active":"2023-06-10T19:02:02.698803+0000","last_became_peered":"2023-06-10T19:02:02.698803+0000","last_unstale":"2023-06-10T19:02:03.663631+0000","last_undegraded":"2023-06-10T19:02:03.663631+0000","last_fullsized":"2023-06-10T19:02:03.663631+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:05:16.584207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.665821+0000","last_change":"2023-06-10T19:02:02.293125+0000","last_active":"2023-06-10T19:02:03.665821+0000","last_peered":"2023-06-10T19:02:03.665821+0000","last_clean":"2023-06-10T19:02:03.665821+0000","last_became_active":"2023-06-10T19:02:02.292366+0000","last_became_peered":"2023-06-10T19:02:02.292366+0000","last_unstale":"2023-06-10T19:02:03.665821+0000","last_undegraded":"2023-06-10T19:02:03.665821+0000","last_fullsized":"2023-06-10T19:02:03.665821+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:41:55.619181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:04.256549+0000","last_change":"2023-06-10T19:02:02.718017+0000","last_active":"2023-06-10T19:02:04.256549+0000","last_peered":"2023-06-10T19:02:04.256549+0000","last_clean":"2023-06-10T19:02:04.256549+0000","last_became_active":"2023-06-10T19:02:02.717452+0000","last_became_peered":"2023-06-10T19:02:02.717452+0000","last_unstale":"2023-06-10T19:02:04.256549+0000","last_undegraded":"2023-06-10T19:02:04.256549+0000","last_fullsized":"2023-06-10T19:02:04.256549+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:53:07.798887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:05.666754+0000","last_change":"2023-06-10T19:02:02.286161+0000","last_active":"2023-06-10T19:02:05.666754+0000","last_peered":"2023-06-10T19:02:05.666754+0000","last_clean":"2023-06-10T19:02:05.666754+0000","last_became_active":"2023-06-10T19:02:02.285856+0000","last_became_peered":"2023-06-10T19:02:02.285856+0000","last_unstale":"2023-06-10T19:02:05.666754+0000","last_undegraded":"2023-06-10T19:02:05.666754+0000","last_fullsized":"2023-06-10T19:02:05.666754+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:45:25.753993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:05.666473+0000","last_change":"2023-06-10T19:02:02.665868+0000","last_active":"2023-06-10T19:02:05.666473+0000","last_peered":"2023-06-10T19:02:05.666473+0000","last_clean":"2023-06-10T19:02:05.666473+0000","last_became_active":"2023-06-10T19:02:02.665665+0000","last_became_peered":"2023-06-10T19:02:02.665665+0000","last_unstale":"2023-06-10T19:02:05.666473+0000","last_undegraded":"2023-06-10T19:02:05.666473+0000","last_fullsized":"2023-06-10T19:02:05.666473+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:36:15.427133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"93'3","reported_seq":16,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.664017+0000","last_change":"2023-06-10T19:02:02.294019+0000","last_active":"2023-06-10T19:02:03.664017+0000","last_peered":"2023-06-10T19:02:03.664017+0000","last_clean":"2023-06-10T19:02:03.664017+0000","last_became_active":"2023-06-10T19:02:02.293205+0000","last_became_peered":"2023-06-10T19:02:02.293205+0000","last_unstale":"2023-06-10T19:02:03.664017+0000","last_undegraded":"2023-06-10T19:02:03.664017+0000","last_fullsized":"2023-06-10T19:02:03.664017+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:25:37.472901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:05.667974+0000","last_change":"2023-06-10T19:02:02.680173+0000","last_active":"2023-06-10T19:02:05.667974+0000","last_peered":"2023-06-10T19:02:05.667974+0000","last_clean":"2023-06-10T19:02:05.667974+0000","last_became_active":"2023-06-10T19:02:02.679854+0000","last_became_peered":"2023-06-10T19:02:02.679854+0000","last_unstale":"2023-06-10T19:02:05.667974+0000","last_undegraded":"2023-06-10T19:02:05.667974+0000","last_fullsized":"2023-06-10T19:02:05.667974+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:28:26.086674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"93'6","reported_seq":19,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.660945+0000","last_change":"2023-06-10T19:02:02.310650+0000","last_active":"2023-06-10T19:02:03.660945+0000","last_peered":"2023-06-10T19:02:03.660945+0000","last_clean":"2023-06-10T19:02:03.660945+0000","last_became_active":"2023-06-10T19:02:02.310205+0000","last_became_peered":"2023-06-10T19:02:02.310205+0000","last_unstale":"2023-06-10T19:02:03.660945+0000","last_undegraded":"2023-06-10T19:02:03.660945+0000","last_fullsized":"2023-06-10T19:02:03.660945+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:52:49.212211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:05.666654+0000","last_change":"2023-06-10T19:02:02.697539+0000","last_active":"2023-06-10T19:02:05.666654+0000","last_peered":"2023-06-10T19:02:05.666654+0000","last_clean":"2023-06-10T19:02:05.666654+0000","last_became_active":"2023-06-10T19:02:02.697195+0000","last_became_peered":"2023-06-10T19:02:02.697195+0000","last_unstale":"2023-06-10T19:02:05.666654+0000","last_undegraded":"2023-06-10T19:02:05.666654+0000","last_fullsized":"2023-06-10T19:02:05.666654+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:27:13.039586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"93'2","reported_seq":15,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:04.256623+0000","last_change":"2023-06-10T19:02:02.298494+0000","last_active":"2023-06-10T19:02:04.256623+0000","last_peered":"2023-06-10T19:02:04.256623+0000","last_clean":"2023-06-10T19:02:04.256623+0000","last_became_active":"2023-06-10T19:02:02.298008+0000","last_became_peered":"2023-06-10T19:02:02.298008+0000","last_unstale":"2023-06-10T19:02:04.256623+0000","last_undegraded":"2023-06-10T19:02:04.256623+0000","last_fullsized":"2023-06-10T19:02:04.256623+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:33:47.082911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.662513+0000","last_change":"2023-06-10T19:02:02.706094+0000","last_active":"2023-06-10T19:02:03.662513+0000","last_peered":"2023-06-10T19:02:03.662513+0000","last_clean":"2023-06-10T19:02:03.662513+0000","last_became_active":"2023-06-10T19:02:02.705436+0000","last_became_peered":"2023-06-10T19:02:02.705436+0000","last_unstale":"2023-06-10T19:02:03.662513+0000","last_undegraded":"2023-06-10T19:02:03.662513+0000","last_fullsized":"2023-06-10T19:02:03.662513+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:18:09.563784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.660666+0000","last_change":"2023-06-10T19:02:02.297466+0000","last_active":"2023-06-10T19:02:03.660666+0000","last_peered":"2023-06-10T19:02:03.660666+0000","last_clean":"2023-06-10T19:02:03.660666+0000","last_became_active":"2023-06-10T19:02:02.297118+0000","last_became_peered":"2023-06-10T19:02:02.297118+0000","last_unstale":"2023-06-10T19:02:03.660666+0000","last_undegraded":"2023-06-10T19:02:03.660666+0000","last_fullsized":"2023-06-10T19:02:03.660666+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:10:06.854540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:04.686612+0000","last_change":"2023-06-10T19:02:02.676309+0000","last_active":"2023-06-10T19:02:04.686612+0000","last_peered":"2023-06-10T19:02:04.686612+0000","last_clean":"2023-06-10T19:02:04.686612+0000","last_became_active":"2023-06-10T19:02:02.676005+0000","last_became_peered":"2023-06-10T19:02:02.676005+0000","last_unstale":"2023-06-10T19:02:04.686612+0000","last_undegraded":"2023-06-10T19:02:04.686612+0000","last_fullsized":"2023-06-10T19:02:04.686612+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:42:08.162132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:05.667149+0000","last_change":"2023-06-10T19:02:02.309000+0000","last_active":"2023-06-10T19:02:05.667149+0000","last_peered":"2023-06-10T19:02:05.667149+0000","last_clean":"2023-06-10T19:02:05.667149+0000","last_became_active":"2023-06-10T19:02:02.308410+0000","last_became_peered":"2023-06-10T19:02:02.308410+0000","last_unstale":"2023-06-10T19:02:05.667149+0000","last_undegraded":"2023-06-10T19:02:05.667149+0000","last_fullsized":"2023-06-10T19:02:05.667149+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:04:28.390632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:04.686561+0000","last_change":"2023-06-10T19:02:02.682312+0000","last_active":"2023-06-10T19:02:04.686561+0000","last_peered":"2023-06-10T19:02:04.686561+0000","last_clean":"2023-06-10T19:02:04.686561+0000","last_became_active":"2023-06-10T19:02:02.682008+0000","last_became_peered":"2023-06-10T19:02:02.682008+0000","last_unstale":"2023-06-10T19:02:04.686561+0000","last_undegraded":"2023-06-10T19:02:04.686561+0000","last_fullsized":"2023-06-10T19:02:04.686561+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:19:20.960081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"93'8","reported_seq":21,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:05.666998+0000","last_change":"2023-06-10T19:02:02.281076+0000","last_active":"2023-06-10T19:02:05.666998+0000","last_peered":"2023-06-10T19:02:05.666998+0000","last_clean":"2023-06-10T19:02:05.666998+0000","last_became_active":"2023-06-10T19:02:02.280784+0000","last_became_peered":"2023-06-10T19:02:02.280784+0000","last_unstale":"2023-06-10T19:02:05.666998+0000","last_undegraded":"2023-06-10T19:02:05.666998+0000","last_fullsized":"2023-06-10T19:02:05.666998+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:38:36.110188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:05.664603+0000","last_change":"2023-06-10T19:02:02.709551+0000","last_active":"2023-06-10T19:02:05.664603+0000","last_peered":"2023-06-10T19:02:05.664603+0000","last_clean":"2023-06-10T19:02:05.664603+0000","last_became_active":"2023-06-10T19:02:02.708932+0000","last_became_peered":"2023-06-10T19:02:02.708932+0000","last_unstale":"2023-06-10T19:02:05.664603+0000","last_undegraded":"2023-06-10T19:02:05.664603+0000","last_fullsized":"2023-06-10T19:02:05.664603+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:45:26.757639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"93'2","reported_seq":15,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:04.257010+0000","last_change":"2023-06-10T19:02:02.310148+0000","last_active":"2023-06-10T19:02:04.257010+0000","last_peered":"2023-06-10T19:02:04.257010+0000","last_clean":"2023-06-10T19:02:04.257010+0000","last_became_active":"2023-06-10T19:02:02.309423+0000","last_became_peered":"2023-06-10T19:02:02.309423+0000","last_unstale":"2023-06-10T19:02:04.257010+0000","last_undegraded":"2023-06-10T19:02:04.257010+0000","last_fullsized":"2023-06-10T19:02:04.257010+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:10:24.513111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.661267+0000","last_change":"2023-06-10T19:02:02.685473+0000","last_active":"2023-06-10T19:02:03.661267+0000","last_peered":"2023-06-10T19:02:03.661267+0000","last_clean":"2023-06-10T19:02:03.661267+0000","last_became_active":"2023-06-10T19:02:02.685192+0000","last_became_peered":"2023-06-10T19:02:02.685192+0000","last_unstale":"2023-06-10T19:02:03.661267+0000","last_undegraded":"2023-06-10T19:02:03.661267+0000","last_fullsized":"2023-06-10T19:02:03.661267+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:52:33.909329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"94'1","reported_seq":14,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.664575+0000","last_change":"2023-06-10T19:02:02.292855+0000","last_active":"2023-06-10T19:02:03.664575+0000","last_peered":"2023-06-10T19:02:03.664575+0000","last_clean":"2023-06-10T19:02:03.664575+0000","last_became_active":"2023-06-10T19:02:02.291984+0000","last_became_peered":"2023-06-10T19:02:02.291984+0000","last_unstale":"2023-06-10T19:02:03.664575+0000","last_undegraded":"2023-06-10T19:02:03.664575+0000","last_fullsized":"2023-06-10T19:02:03.664575+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:19:37.942450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.661459+0000","last_change":"2023-06-10T19:02:02.662196+0000","last_active":"2023-06-10T19:02:03.661459+0000","last_peered":"2023-06-10T19:02:03.661459+0000","last_clean":"2023-06-10T19:02:03.661459+0000","last_became_active":"2023-06-10T19:02:02.661887+0000","last_became_peered":"2023-06-10T19:02:02.661887+0000","last_unstale":"2023-06-10T19:02:03.661459+0000","last_undegraded":"2023-06-10T19:02:03.661459+0000","last_fullsized":"2023-06-10T19:02:03.661459+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:43:35.825854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.664678+0000","last_change":"2023-06-10T19:02:02.289260+0000","last_active":"2023-06-10T19:02:03.664678+0000","last_peered":"2023-06-10T19:02:03.664678+0000","last_clean":"2023-06-10T19:02:03.664678+0000","last_became_active":"2023-06-10T19:02:02.288017+0000","last_became_peered":"2023-06-10T19:02:02.288017+0000","last_unstale":"2023-06-10T19:02:03.664678+0000","last_undegraded":"2023-06-10T19:02:03.664678+0000","last_fullsized":"2023-06-10T19:02:03.664678+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:29:27.650735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.665651+0000","last_change":"2023-06-10T19:02:02.686971+0000","last_active":"2023-06-10T19:02:03.665651+0000","last_peered":"2023-06-10T19:02:03.665651+0000","last_clean":"2023-06-10T19:02:03.665651+0000","last_became_active":"2023-06-10T19:02:02.682303+0000","last_became_peered":"2023-06-10T19:02:02.682303+0000","last_unstale":"2023-06-10T19:02:03.665651+0000","last_undegraded":"2023-06-10T19:02:03.665651+0000","last_fullsized":"2023-06-10T19:02:03.665651+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:39:21.732406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:05.664891+0000","last_change":"2023-06-10T19:02:02.307602+0000","last_active":"2023-06-10T19:02:05.664891+0000","last_peered":"2023-06-10T19:02:05.664891+0000","last_clean":"2023-06-10T19:02:05.664891+0000","last_became_active":"2023-06-10T19:02:02.306340+0000","last_became_peered":"2023-06-10T19:02:02.306340+0000","last_unstale":"2023-06-10T19:02:05.664891+0000","last_undegraded":"2023-06-10T19:02:05.664891+0000","last_fullsized":"2023-06-10T19:02:05.664891+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:40:18.378937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:04.686204+0000","last_change":"2023-06-10T19:02:02.670591+0000","last_active":"2023-06-10T19:02:04.686204+0000","last_peered":"2023-06-10T19:02:04.686204+0000","last_clean":"2023-06-10T19:02:04.686204+0000","last_became_active":"2023-06-10T19:02:02.670311+0000","last_became_peered":"2023-06-10T19:02:02.670311+0000","last_unstale":"2023-06-10T19:02:04.686204+0000","last_undegraded":"2023-06-10T19:02:04.686204+0000","last_fullsized":"2023-06-10T19:02:04.686204+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:50:38.457675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.661053+0000","last_change":"2023-06-10T19:02:02.297604+0000","last_active":"2023-06-10T19:02:03.661053+0000","last_peered":"2023-06-10T19:02:03.661053+0000","last_clean":"2023-06-10T19:02:03.661053+0000","last_became_active":"2023-06-10T19:02:02.297290+0000","last_became_peered":"2023-06-10T19:02:02.297290+0000","last_unstale":"2023-06-10T19:02:03.661053+0000","last_undegraded":"2023-06-10T19:02:03.661053+0000","last_fullsized":"2023-06-10T19:02:03.661053+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:28:00.938324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:05.665034+0000","last_change":"2023-06-10T19:02:02.676849+0000","last_active":"2023-06-10T19:02:05.665034+0000","last_peered":"2023-06-10T19:02:05.665034+0000","last_clean":"2023-06-10T19:02:05.665034+0000","last_became_active":"2023-06-10T19:02:02.676586+0000","last_became_peered":"2023-06-10T19:02:02.676586+0000","last_unstale":"2023-06-10T19:02:05.665034+0000","last_undegraded":"2023-06-10T19:02:05.665034+0000","last_fullsized":"2023-06-10T19:02:05.665034+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:43:38.999454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.664972+0000","last_change":"2023-06-10T19:02:02.286569+0000","last_active":"2023-06-10T19:02:03.664972+0000","last_peered":"2023-06-10T19:02:03.664972+0000","last_clean":"2023-06-10T19:02:03.664972+0000","last_became_active":"2023-06-10T19:02:02.285744+0000","last_became_peered":"2023-06-10T19:02:02.285744+0000","last_unstale":"2023-06-10T19:02:03.664972+0000","last_undegraded":"2023-06-10T19:02:03.664972+0000","last_fullsized":"2023-06-10T19:02:03.664972+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:01:54.214990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:05.664127+0000","last_change":"2023-06-10T19:02:02.702760+0000","last_active":"2023-06-10T19:02:05.664127+0000","last_peered":"2023-06-10T19:02:05.664127+0000","last_clean":"2023-06-10T19:02:05.664127+0000","last_became_active":"2023-06-10T19:02:02.702012+0000","last_became_peered":"2023-06-10T19:02:02.702012+0000","last_unstale":"2023-06-10T19:02:05.664127+0000","last_undegraded":"2023-06-10T19:02:05.664127+0000","last_fullsized":"2023-06-10T19:02:05.664127+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:02:31.253313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:05.664647+0000","last_change":"2023-06-10T19:02:02.306818+0000","last_active":"2023-06-10T19:02:05.664647+0000","last_peered":"2023-06-10T19:02:05.664647+0000","last_clean":"2023-06-10T19:02:05.664647+0000","last_became_active":"2023-06-10T19:02:02.306128+0000","last_became_peered":"2023-06-10T19:02:02.306128+0000","last_unstale":"2023-06-10T19:02:05.664647+0000","last_undegraded":"2023-06-10T19:02:05.664647+0000","last_fullsized":"2023-06-10T19:02:05.664647+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:12:17.671209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.660866+0000","last_change":"2023-06-10T19:02:02.671837+0000","last_active":"2023-06-10T19:02:03.660866+0000","last_peered":"2023-06-10T19:02:03.660866+0000","last_clean":"2023-06-10T19:02:03.660866+0000","last_became_active":"2023-06-10T19:02:02.671536+0000","last_became_peered":"2023-06-10T19:02:02.671536+0000","last_unstale":"2023-06-10T19:02:03.660866+0000","last_undegraded":"2023-06-10T19:02:03.660866+0000","last_fullsized":"2023-06-10T19:02:03.660866+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:47:51.626220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:04.256135+0000","last_change":"2023-06-10T19:02:02.299831+0000","last_active":"2023-06-10T19:02:04.256135+0000","last_peered":"2023-06-10T19:02:04.256135+0000","last_clean":"2023-06-10T19:02:04.256135+0000","last_became_active":"2023-06-10T19:02:02.299041+0000","last_became_peered":"2023-06-10T19:02:02.299041+0000","last_unstale":"2023-06-10T19:02:04.256135+0000","last_undegraded":"2023-06-10T19:02:04.256135+0000","last_fullsized":"2023-06-10T19:02:04.256135+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:52:31.657166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:04.256668+0000","last_change":"2023-06-10T19:02:02.708732+0000","last_active":"2023-06-10T19:02:04.256668+0000","last_peered":"2023-06-10T19:02:04.256668+0000","last_clean":"2023-06-10T19:02:04.256668+0000","last_became_active":"2023-06-10T19:02:02.708118+0000","last_became_peered":"2023-06-10T19:02:02.708118+0000","last_unstale":"2023-06-10T19:02:04.256668+0000","last_undegraded":"2023-06-10T19:02:04.256668+0000","last_fullsized":"2023-06-10T19:02:04.256668+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:36:16.278124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:05.668216+0000","last_change":"2023-06-10T19:02:02.286969+0000","last_active":"2023-06-10T19:02:05.668216+0000","last_peered":"2023-06-10T19:02:05.668216+0000","last_clean":"2023-06-10T19:02:05.668216+0000","last_became_active":"2023-06-10T19:02:02.286247+0000","last_became_peered":"2023-06-10T19:02:02.286247+0000","last_unstale":"2023-06-10T19:02:05.668216+0000","last_undegraded":"2023-06-10T19:02:05.668216+0000","last_fullsized":"2023-06-10T19:02:05.668216+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:18:56.742410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":303,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:04.256886+0000","last_change":"2023-06-10T18:52:34.951528+0000","last_active":"2023-06-10T19:02:04.256886+0000","last_peered":"2023-06-10T19:02:04.256886+0000","last_clean":"2023-06-10T19:02:04.256886+0000","last_became_active":"2023-06-10T18:52:34.949099+0000","last_became_peered":"2023-06-10T18:52:34.949099+0000","last_unstale":"2023-06-10T19:02:04.256886+0000","last_undegraded":"2023-06-10T19:02:04.256886+0000","last_fullsized":"2023-06-10T19:02:04.256886+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_clean_scrub_stamp":"2023-06-10T18:52:33.633295+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:08:14.308930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.664988+0000","last_change":"2023-06-10T18:52:40.506384+0000","last_active":"2023-06-10T19:02:03.664988+0000","last_peered":"2023-06-10T19:02:03.664988+0000","last_clean":"2023-06-10T19:02:03.664988+0000","last_became_active":"2023-06-10T18:52:40.505701+0000","last_became_peered":"2023-06-10T18:52:40.505701+0000","last_unstale":"2023-06-10T19:02:03.664988+0000","last_undegraded":"2023-06-10T19:02:03.664988+0000","last_fullsized":"2023-06-10T19:02:03.664988+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:39:04.857423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.660759+0000","last_change":"2023-06-10T19:02:02.680269+0000","last_active":"2023-06-10T19:02:03.660759+0000","last_peered":"2023-06-10T19:02:03.660759+0000","last_clean":"2023-06-10T19:02:03.660759+0000","last_became_active":"2023-06-10T19:02:02.679987+0000","last_became_peered":"2023-06-10T19:02:02.679987+0000","last_unstale":"2023-06-10T19:02:03.660759+0000","last_undegraded":"2023-06-10T19:02:03.660759+0000","last_fullsized":"2023-06-10T19:02:03.660759+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:48:04.181621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"93'1","reported_seq":14,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:05.664885+0000","last_change":"2023-06-10T19:02:02.309267+0000","last_active":"2023-06-10T19:02:05.664885+0000","last_peered":"2023-06-10T19:02:05.664885+0000","last_clean":"2023-06-10T19:02:05.664885+0000","last_became_active":"2023-06-10T19:02:02.308404+0000","last_became_peered":"2023-06-10T19:02:02.308404+0000","last_unstale":"2023-06-10T19:02:05.664885+0000","last_undegraded":"2023-06-10T19:02:05.664885+0000","last_fullsized":"2023-06-10T19:02:05.664885+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:45:10.554362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":147,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:04.256592+0000","last_change":"2023-06-10T18:52:40.512015+0000","last_active":"2023-06-10T19:02:04.256592+0000","last_peered":"2023-06-10T19:02:04.256592+0000","last_clean":"2023-06-10T19:02:04.256592+0000","last_became_active":"2023-06-10T18:52:40.511382+0000","last_became_peered":"2023-06-10T18:52:40.511382+0000","last_unstale":"2023-06-10T19:02:04.256592+0000","last_undegraded":"2023-06-10T19:02:04.256592+0000","last_fullsized":"2023-06-10T19:02:04.256592+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:53:47.802093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:05.664534+0000","last_change":"2023-06-10T19:02:02.702569+0000","last_active":"2023-06-10T19:02:05.664534+0000","last_peered":"2023-06-10T19:02:05.664534+0000","last_clean":"2023-06-10T19:02:05.664534+0000","last_became_active":"2023-06-10T19:02:02.701841+0000","last_became_peered":"2023-06-10T19:02:02.701841+0000","last_unstale":"2023-06-10T19:02:05.664534+0000","last_undegraded":"2023-06-10T19:02:05.664534+0000","last_fullsized":"2023-06-10T19:02:05.664534+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:36:15.427133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"93'2","reported_seq":15,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:04.257116+0000","last_change":"2023-06-10T19:02:02.300090+0000","last_active":"2023-06-10T19:02:04.257116+0000","last_peered":"2023-06-10T19:02:04.257116+0000","last_clean":"2023-06-10T19:02:04.257116+0000","last_became_active":"2023-06-10T19:02:02.299285+0000","last_became_peered":"2023-06-10T19:02:02.299285+0000","last_unstale":"2023-06-10T19:02:04.257116+0000","last_undegraded":"2023-06-10T19:02:04.257116+0000","last_fullsized":"2023-06-10T19:02:04.257116+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:31:27.685608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":153,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:04.686224+0000","last_change":"2023-06-10T18:52:40.671725+0000","last_active":"2023-06-10T19:02:04.686224+0000","last_peered":"2023-06-10T19:02:04.686224+0000","last_clean":"2023-06-10T19:02:04.686224+0000","last_became_active":"2023-06-10T18:52:40.671442+0000","last_became_peered":"2023-06-10T18:52:40.671442+0000","last_unstale":"2023-06-10T19:02:04.686224+0000","last_undegraded":"2023-06-10T19:02:04.686224+0000","last_fullsized":"2023-06-10T19:02:04.686224+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:18:01.434550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.663832+0000","last_change":"2023-06-10T19:02:02.681135+0000","last_active":"2023-06-10T19:02:03.663832+0000","last_peered":"2023-06-10T19:02:03.663832+0000","last_clean":"2023-06-10T19:02:03.663832+0000","last_became_active":"2023-06-10T19:02:02.680233+0000","last_became_peered":"2023-06-10T19:02:02.680233+0000","last_unstale":"2023-06-10T19:02:03.663832+0000","last_undegraded":"2023-06-10T19:02:03.663832+0000","last_fullsized":"2023-06-10T19:02:03.663832+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:12:25.753502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"93'1","reported_seq":14,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.664364+0000","last_change":"2023-06-10T19:02:02.292614+0000","last_active":"2023-06-10T19:02:03.664364+0000","last_peered":"2023-06-10T19:02:03.664364+0000","last_clean":"2023-06-10T19:02:03.664364+0000","last_became_active":"2023-06-10T19:02:02.291916+0000","last_became_peered":"2023-06-10T19:02:02.291916+0000","last_unstale":"2023-06-10T19:02:03.664364+0000","last_undegraded":"2023-06-10T19:02:03.664364+0000","last_fullsized":"2023-06-10T19:02:03.664364+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:10:50.789390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.665282+0000","last_change":"2023-06-10T18:52:40.510258+0000","last_active":"2023-06-10T19:02:03.665282+0000","last_peered":"2023-06-10T19:02:03.665282+0000","last_clean":"2023-06-10T19:02:03.665282+0000","last_became_active":"2023-06-10T18:52:40.509560+0000","last_became_peered":"2023-06-10T18:52:40.509560+0000","last_unstale":"2023-06-10T19:02:03.665282+0000","last_undegraded":"2023-06-10T19:02:03.665282+0000","last_fullsized":"2023-06-10T19:02:03.665282+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:27:31.812949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.660598+0000","last_change":"2023-06-10T19:02:02.663696+0000","last_active":"2023-06-10T19:02:03.660598+0000","last_peered":"2023-06-10T19:02:03.660598+0000","last_clean":"2023-06-10T19:02:03.660598+0000","last_became_active":"2023-06-10T19:02:02.663441+0000","last_became_peered":"2023-06-10T19:02:02.663441+0000","last_unstale":"2023-06-10T19:02:03.660598+0000","last_undegraded":"2023-06-10T19:02:03.660598+0000","last_fullsized":"2023-06-10T19:02:03.660598+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:29:20.330300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"93'2","reported_seq":15,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.664644+0000","last_change":"2023-06-10T19:02:02.286757+0000","last_active":"2023-06-10T19:02:03.664644+0000","last_peered":"2023-06-10T19:02:03.664644+0000","last_clean":"2023-06-10T19:02:03.664644+0000","last_became_active":"2023-06-10T19:02:02.285950+0000","last_became_peered":"2023-06-10T19:02:02.285950+0000","last_unstale":"2023-06-10T19:02:03.664644+0000","last_undegraded":"2023-06-10T19:02:03.664644+0000","last_fullsized":"2023-06-10T19:02:03.664644+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:51:41.019099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:05.668206+0000","last_change":"2023-06-10T18:52:40.672266+0000","last_active":"2023-06-10T19:02:05.668206+0000","last_peered":"2023-06-10T19:02:05.668206+0000","last_clean":"2023-06-10T19:02:05.668206+0000","last_became_active":"2023-06-10T18:52:40.671966+0000","last_became_peered":"2023-06-10T18:52:40.671966+0000","last_unstale":"2023-06-10T19:02:05.668206+0000","last_undegraded":"2023-06-10T19:02:05.668206+0000","last_fullsized":"2023-06-10T19:02:05.668206+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:34:26.323306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.664405+0000","last_change":"2023-06-10T19:02:02.670012+0000","last_active":"2023-06-10T19:02:03.664405+0000","last_peered":"2023-06-10T19:02:03.664405+0000","last_clean":"2023-06-10T19:02:03.664405+0000","last_became_active":"2023-06-10T19:02:02.669278+0000","last_became_peered":"2023-06-10T19:02:02.669278+0000","last_unstale":"2023-06-10T19:02:03.664405+0000","last_undegraded":"2023-06-10T19:02:03.664405+0000","last_fullsized":"2023-06-10T19:02:03.664405+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:49:36.186238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:04.686894+0000","last_change":"2023-06-10T19:02:02.281757+0000","last_active":"2023-06-10T19:02:04.686894+0000","last_peered":"2023-06-10T19:02:04.686894+0000","last_clean":"2023-06-10T19:02:04.686894+0000","last_became_active":"2023-06-10T19:02:02.281378+0000","last_became_peered":"2023-06-10T19:02:02.281378+0000","last_unstale":"2023-06-10T19:02:04.686894+0000","last_undegraded":"2023-06-10T19:02:04.686894+0000","last_fullsized":"2023-06-10T19:02:04.686894+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:25:45.181146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":147,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:04.256880+0000","last_change":"2023-06-10T18:52:40.671084+0000","last_active":"2023-06-10T19:02:04.256880+0000","last_peered":"2023-06-10T19:02:04.256880+0000","last_clean":"2023-06-10T19:02:04.256880+0000","last_became_active":"2023-06-10T18:52:40.670697+0000","last_became_peered":"2023-06-10T18:52:40.670697+0000","last_unstale":"2023-06-10T19:02:04.256880+0000","last_undegraded":"2023-06-10T19:02:04.256880+0000","last_fullsized":"2023-06-10T19:02:04.256880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:59:32.286326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.664638+0000","last_change":"2023-06-10T19:02:02.679941+0000","last_active":"2023-06-10T19:02:03.664638+0000","last_peered":"2023-06-10T19:02:03.664638+0000","last_clean":"2023-06-10T19:02:03.664638+0000","last_became_active":"2023-06-10T19:02:02.679209+0000","last_became_peered":"2023-06-10T19:02:02.679209+0000","last_unstale":"2023-06-10T19:02:03.664638+0000","last_undegraded":"2023-06-10T19:02:03.664638+0000","last_fullsized":"2023-06-10T19:02:03.664638+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:35:54.459085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.664721+0000","last_change":"2023-06-10T19:02:02.288468+0000","last_active":"2023-06-10T19:02:03.664721+0000","last_peered":"2023-06-10T19:02:03.664721+0000","last_clean":"2023-06-10T19:02:03.664721+0000","last_became_active":"2023-06-10T19:02:02.287678+0000","last_became_peered":"2023-06-10T19:02:02.287678+0000","last_unstale":"2023-06-10T19:02:03.664721+0000","last_undegraded":"2023-06-10T19:02:03.664721+0000","last_fullsized":"2023-06-10T19:02:03.664721+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:11:42.794747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:05.667706+0000","last_change":"2023-06-10T18:52:40.514114+0000","last_active":"2023-06-10T19:02:05.667706+0000","last_peered":"2023-06-10T19:02:05.667706+0000","last_clean":"2023-06-10T19:02:05.667706+0000","last_became_active":"2023-06-10T18:52:40.513638+0000","last_became_peered":"2023-06-10T18:52:40.513638+0000","last_unstale":"2023-06-10T19:02:05.667706+0000","last_undegraded":"2023-06-10T19:02:05.667706+0000","last_fullsized":"2023-06-10T19:02:05.667706+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:33:13.935275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.660662+0000","last_change":"2023-06-10T19:02:02.661974+0000","last_active":"2023-06-10T19:02:03.660662+0000","last_peered":"2023-06-10T19:02:03.660662+0000","last_clean":"2023-06-10T19:02:03.660662+0000","last_became_active":"2023-06-10T19:02:02.661623+0000","last_became_peered":"2023-06-10T19:02:02.661623+0000","last_unstale":"2023-06-10T19:02:03.660662+0000","last_undegraded":"2023-06-10T19:02:03.660662+0000","last_fullsized":"2023-06-10T19:02:03.660662+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:30:25.061636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:04.686296+0000","last_change":"2023-06-10T19:02:02.294886+0000","last_active":"2023-06-10T19:02:04.686296+0000","last_peered":"2023-06-10T19:02:04.686296+0000","last_clean":"2023-06-10T19:02:04.686296+0000","last_became_active":"2023-06-10T19:02:02.294578+0000","last_became_peered":"2023-06-10T19:02:02.294578+0000","last_unstale":"2023-06-10T19:02:04.686296+0000","last_undegraded":"2023-06-10T19:02:04.686296+0000","last_fullsized":"2023-06-10T19:02:04.686296+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:48:03.722713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":147,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:05.665070+0000","last_change":"2023-06-10T18:52:40.515396+0000","last_active":"2023-06-10T19:02:05.665070+0000","last_peered":"2023-06-10T19:02:05.665070+0000","last_clean":"2023-06-10T19:02:05.665070+0000","last_became_active":"2023-06-10T18:52:40.514663+0000","last_became_peered":"2023-06-10T18:52:40.514663+0000","last_unstale":"2023-06-10T19:02:05.665070+0000","last_undegraded":"2023-06-10T19:02:05.665070+0000","last_fullsized":"2023-06-10T19:02:05.665070+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:30:23.242897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574966,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32764,"kb_used_data":1716,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339076,"statfs":{"total":96636764160,"available":96603213824,"internally_reserved":0,"allocated":1757184,"data_stored":1116889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.94199999999999995,"15min":0.90300000000000002},"min":{"1min":0.63800000000000001,"5min":0.54700000000000004,"15min":0.434},"max":{"1min":1.196,"5min":1.327,"15min":1.6220000000000001},"last":1.042},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.93000000000000005,"15min":0.92900000000000005},"min":{"1min":0.70999999999999996,"5min":0.496,"15min":0.496},"max":{"1min":1.149,"5min":1.264,"15min":1.6870000000000001},"last":1.2909999999999999}]},{"osd":1,"last update":"Sat Jun 10 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.93200000000000005,"15min":0.92500000000000004},"min":{"1min":0.64700000000000002,"5min":0.54200000000000004,"15min":0.53900000000000003},"max":{"1min":1.238,"5min":1.262,"15min":1.377},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.97299999999999998,"15min":0.93600000000000005},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.504},"max":{"1min":1.1279999999999999,"5min":1.234,"15min":1.5960000000000001},"last":0.93500000000000005}]},{"osd":2,"last update":"Sat Jun 10 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.85599999999999998,"15min":0.83799999999999997},"min":{"1min":0.625,"5min":0.52100000000000002,"15min":0.47099999999999997},"max":{"1min":1.169,"5min":1.169,"15min":1.4059999999999999},"last":1.2450000000000001},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.91100000000000003,"15min":0.90400000000000003},"min":{"1min":0.67900000000000005,"5min":0.53000000000000003,"15min":0.50600000000000001},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.77900000000000003}]},{"osd":3,"last update":"Sat Jun 10 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.93600000000000005,"15min":0.91800000000000004},"min":{"1min":0.71899999999999997,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.502},"last":1.175},{"interface":"front","average":{"1min":1.0229999999999999,"5min":0.97599999999999998,"15min":0.94699999999999995},"min":{"1min":0.80400000000000005,"5min":0.59599999999999997,"15min":0.53800000000000003},"max":{"1min":1.2769999999999999,"5min":1.284,"15min":1.2929999999999999},"last":0.97399999999999998}]},{"osd":4,"last update":"Sat Jun 10 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.83199999999999996,"15min":0.85799999999999998},"min":{"1min":0.629,"5min":0.39500000000000002,"15min":0.32700000000000001},"max":{"1min":1.056,"5min":1.1990000000000001,"15min":1.639},"last":1.079},{"interface":"front","average":{"1min":1.014,"5min":0.97199999999999998,"15min":0.97299999999999998},"min":{"1min":0.67200000000000004,"5min":0.434,"15min":0.40000000000000002},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.454}]},{"osd":5,"last update":"Sat Jun 10 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":0.99199999999999999,"15min":1.016},"min":{"1min":0.73699999999999999,"5min":0.40500000000000003,"15min":0.38400000000000001},"max":{"1min":1.379,"5min":1.395,"15min":1.806},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0389999999999999,"15min":1.0429999999999999},"min":{"1min":0.70399999999999996,"5min":0.505,"15min":0.46500000000000002},"max":{"1min":1.579,"5min":1.579,"15min":1.579},"last":1.393}]},{"osd":6,"last update":"Sat Jun 10 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0069999999999999},"min":{"1min":0.65100000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.391,"5min":1.391,"15min":1.718},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.149,"5min":1.1140000000000001,"15min":1.0960000000000001},"min":{"1min":0.82099999999999995,"5min":0.48799999999999999,"15min":0.441},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":1.3169999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574967,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32196,"kb_used_data":1148,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339644,"statfs":{"total":96636764160,"available":96603795456,"internally_reserved":0,"allocated":1175552,"data_stored":528633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.89700000000000002,"15min":0.84599999999999997},"min":{"1min":0.55000000000000004,"5min":0.52600000000000002,"15min":0.502},"max":{"1min":1.111,"5min":1.476,"15min":1.498},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.89400000000000002,"15min":0.86899999999999999},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46100000000000002},"max":{"1min":1.2250000000000001,"5min":1.496,"15min":1.496},"last":0.79700000000000004}]},{"osd":1,"last update":"Sat Jun 10 19:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.86399999999999999,"15min":0.86199999999999999},"min":{"1min":0.502,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.079,"5min":1.1739999999999999,"15min":1.5229999999999999},"last":0.747},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.90900000000000003,"15min":0.88400000000000001},"min":{"1min":0.61399999999999999,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.1599999999999999,"5min":1.2450000000000001,"15min":1.778},"last":0.93100000000000005}]},{"osd":2,"last update":"Sat Jun 10 19:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91300000000000003,"15min":0.88300000000000001},"min":{"1min":0.748,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.2130000000000001,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":1.006},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.90400000000000003,"15min":0.89200000000000002},"min":{"1min":0.66200000000000003,"5min":0.61299999999999999,"15min":0.57999999999999996},"max":{"1min":1.2330000000000001,"5min":1.246,"15min":1.246},"last":0.98099999999999998}]},{"osd":3,"last update":"Sat Jun 10 19:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.93300000000000005,"15min":0.89200000000000002},"min":{"1min":0.68200000000000005,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0860000000000001,"5min":1.399,"15min":1.7190000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.98199999999999998,"15min":0.99099999999999999},"min":{"1min":0.77300000000000002,"5min":0.72599999999999998,"15min":0.58599999999999997},"max":{"1min":1.2470000000000001,"5min":1.272,"15min":1.4370000000000001},"last":0.95899999999999996}]},{"osd":4,"last update":"Sat Jun 10 19:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.89800000000000002,"15min":0.93000000000000005},"min":{"1min":0.71999999999999997,"5min":0.59799999999999998,"15min":0.56799999999999995},"max":{"1min":1.1719999999999999,"5min":1.4159999999999999,"15min":1.798},"last":1.0269999999999999},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.95799999999999996,"15min":0.996},"min":{"1min":0.64500000000000002,"5min":0.64000000000000001,"15min":0.51300000000000001},"max":{"1min":1.319,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":1.1200000000000001}]},{"osd":5,"last update":"Sat Jun 10 19:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.91100000000000003,"15min":0.93799999999999994},"min":{"1min":0.72099999999999997,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.194,"5min":1.333,"15min":1.333},"last":0.88800000000000001},{"interface":"front","average":{"1min":1.012,"5min":1.02,"15min":1.03},"min":{"1min":0.77800000000000002,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.2210000000000001,"5min":1.405,"15min":2.536},"last":0.83999999999999997}]},{"osd":7,"last update":"Sat Jun 10 19:01:43 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.0169999999999999,"15min":1.036},"min":{"1min":0.82699999999999996,"5min":0.60899999999999999,"15min":0.57099999999999995},"max":{"1min":1.361,"5min":1.48,"15min":1.917},"last":1.073},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.98299999999999998,"15min":1.034},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.278,"5min":1.29,"15min":1.5569999999999999},"last":1.0469999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574967,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32176,"kb_used_data":1128,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339664,"statfs":{"total":96636764160,"available":96603815936,"internally_reserved":0,"allocated":1155072,"data_stored":526465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:01:45 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.91700000000000004,"15min":0.86199999999999999},"min":{"1min":0.58099999999999996,"5min":0.54100000000000004,"15min":0.50600000000000001},"max":{"1min":1.2070000000000001,"5min":1.232,"15min":1.232},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.028,"5min":0.92400000000000004,"15min":0.92700000000000005},"min":{"1min":0.58999999999999997,"5min":0.51400000000000001,"15min":0.49399999999999999},"max":{"1min":2.347,"5min":2.347,"15min":2.347},"last":0.85099999999999998}]},{"osd":1,"last update":"Sat Jun 10 19:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":0.97199999999999998,"15min":0.92800000000000005},"min":{"1min":0.63400000000000001,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":7.0800000000000001,"5min":7.0800000000000001,"15min":7.0800000000000001},"last":1.103},{"interface":"front","average":{"1min":1.9550000000000001,"5min":1.1240000000000001,"15min":0.98799999999999999},"min":{"1min":0.59199999999999997,"5min":0.57699999999999996,"15min":0.53800000000000003},"max":{"1min":15.845000000000001,"5min":15.845000000000001,"15min":15.845000000000001},"last":0.68000000000000005}]},{"osd":2,"last update":"Sat Jun 10 19:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":0.94299999999999995,"15min":0.88100000000000001},"min":{"1min":0.68200000000000005,"5min":0.49299999999999999,"15min":0.48299999999999998},"max":{"1min":5.0049999999999999,"5min":5.0049999999999999,"15min":5.0049999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":1.296,"5min":1.008,"15min":0.94299999999999995},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":6.851,"5min":6.851,"15min":6.851},"last":0.996}]},{"osd":3,"last update":"Sat Jun 10 19:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":0.96399999999999997,"15min":0.95499999999999996},"min":{"1min":0.65900000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.544,"5min":2.544,"15min":2.544},"last":0.58099999999999996},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0029999999999999,"15min":1.0169999999999999},"min":{"1min":0.63100000000000001,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":3.0830000000000002,"5min":3.0830000000000002,"15min":3.0830000000000002},"last":0.91300000000000003}]},{"osd":4,"last update":"Sat Jun 10 19:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":0.95799999999999996,"15min":0.96699999999999997},"min":{"1min":0.66800000000000004,"5min":0.64100000000000001,"15min":0.58099999999999996},"max":{"1min":6.7290000000000001,"5min":6.7290000000000001,"15min":6.7290000000000001},"last":0.874},{"interface":"front","average":{"1min":1.0369999999999999,"5min":0.98199999999999998,"15min":1.0269999999999999},"min":{"1min":0.68300000000000005,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.278,"5min":1.341,"15min":1.575},"last":0.80000000000000004}]},{"osd":6,"last update":"Sat Jun 10 19:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":0.98199999999999998,"15min":1.03},"min":{"1min":0.65300000000000002,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.3029999999999999,"5min":1.3660000000000001,"15min":1.4330000000000001},"last":1.071},{"interface":"front","average":{"1min":1.373,"5min":1.093,"15min":1.073},"min":{"1min":0.81499999999999995,"5min":0.66500000000000004,"15min":0.57899999999999996},"max":{"1min":6.923,"5min":6.923,"15min":6.923},"last":1.0580000000000001}]},{"osd":7,"last update":"Sat Jun 10 19:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.0629999999999999,"15min":1.1259999999999999},"min":{"1min":0.81399999999999995,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":2.6080000000000001,"5min":2.6080000000000001,"15min":2.6080000000000001},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.4319999999999999,"5min":1.157,"15min":1.1619999999999999},"min":{"1min":0.95299999999999996,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":5.4169999999999998,"5min":5.4169999999999998,"15min":5.4169999999999998},"last":0.96999999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574966,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32184,"kb_used_data":1136,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339656,"statfs":{"total":96636764160,"available":96603807744,"internally_reserved":0,"allocated":1163264,"data_stored":526625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.872,"15min":0.79800000000000004},"min":{"1min":0.49199999999999999,"5min":0.48599999999999999,"15min":0.45100000000000001},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.91900000000000004,"15min":0.89800000000000002},"min":{"1min":0.58399999999999996,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0580000000000001,"5min":3.7280000000000002,"15min":3.7280000000000002},"last":1.018}]},{"osd":1,"last update":"Sat Jun 10 19:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.93500000000000005,"15min":0.94599999999999995},"min":{"1min":0.63100000000000001,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1200000000000001,"5min":3.3969999999999998,"15min":3.3969999999999998},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.90100000000000002,"15min":0.86199999999999999},"min":{"1min":0.66100000000000003,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.1679999999999999,"5min":2.496,"15min":2.496},"last":0.95599999999999996}]},{"osd":2,"last update":"Sat Jun 10 19:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.90200000000000002,"15min":0.88400000000000001},"min":{"1min":0.56799999999999995,"5min":0.51300000000000001,"15min":0.49299999999999999},"max":{"1min":1.3,"5min":1.3,"15min":1.522},"last":0.52200000000000002},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.006,"15min":1},"min":{"1min":0.74099999999999999,"5min":0.57799999999999996,"15min":0.55000000000000004},"max":{"1min":1.204,"5min":3.5750000000000002,"15min":3.5750000000000002},"last":0.73999999999999999}]},{"osd":3,"last update":"Sat Jun 10 19:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.91700000000000004,"15min":0.89600000000000002},"min":{"1min":0.71599999999999997,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.2909999999999999,"5min":2.3809999999999998,"15min":2.3809999999999998},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.97199999999999998,"15min":0.96399999999999997},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.54400000000000004},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.6479999999999999},"last":0.78400000000000003}]},{"osd":5,"last update":"Sat Jun 10 19:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.96899999999999997,"15min":0.97599999999999998},"min":{"1min":0.68700000000000006,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.1459999999999999,"5min":3.6539999999999999,"15min":3.6539999999999999},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.94599999999999995,"15min":0.96499999999999997},"min":{"1min":0.68400000000000005,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.204,"5min":2.6720000000000002,"15min":2.6720000000000002},"last":0.90400000000000003}]},{"osd":6,"last update":"Sat Jun 10 19:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.93999999999999995,"15min":0.98999999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.54900000000000004},"max":{"1min":1.276,"5min":1.3149999999999999,"15min":2.2639999999999998},"last":0.87},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0549999999999999,"15min":1.0660000000000001},"min":{"1min":0.76500000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.3200000000000001,"5min":3.4980000000000002,"15min":3.4980000000000002},"last":1.077}]},{"osd":7,"last update":"Sat Jun 10 19:01:59 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":0.999,"15min":0.99399999999999999},"min":{"1min":0.72499999999999998,"5min":0.66300000000000003,"15min":0.41399999999999998},"max":{"1min":1.3360000000000001,"5min":2.5910000000000002,"15min":2.5910000000000002},"last":0.66100000000000003},{"interface":"front","average":{"1min":1.083,"5min":1.0660000000000001,"15min":1.069},"min":{"1min":0.68100000000000005,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.3740000000000001,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.98099999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574965,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32172,"kb_used_data":1124,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339668,"statfs":{"total":96636764160,"available":96603820032,"internally_reserved":0,"allocated":1150976,"data_stored":525446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.627,"15min":0.59899999999999998},"min":{"1min":0.44600000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.88300000000000001,"5min":1.01,"15min":1.169},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.68100000000000005,"15min":0.65400000000000003},"min":{"1min":0.45300000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.96699999999999997,"5min":1.1679999999999999,"15min":1.286},"last":0.57599999999999996}]},{"osd":1,"last update":"Sat Jun 10 19:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.68300000000000005,"15min":0.65600000000000003},"min":{"1min":0.501,"5min":0.34300000000000003,"15min":0.27500000000000002},"max":{"1min":0.94299999999999995,"5min":1.2569999999999999,"15min":1.2729999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.74399999999999999,"15min":0.73299999999999998},"min":{"1min":0.42999999999999999,"5min":0.33000000000000002,"15min":0.318},"max":{"1min":1.0449999999999999,"5min":1.296,"15min":1.411},"last":0.73199999999999998}]},{"osd":2,"last update":"Sat Jun 10 19:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.78500000000000003,"15min":0.76800000000000002},"min":{"1min":0.49199999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.018,"5min":1.3899999999999999,"15min":1.9530000000000001},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.80100000000000005,"15min":0.76700000000000002},"min":{"1min":0.58399999999999996,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.125,"5min":1.278,"15min":1.278},"last":0.70299999999999996}]},{"osd":4,"last update":"Sat Jun 10 19:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.93899999999999995,"15min":0.95499999999999996},"min":{"1min":0.69899999999999995,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.1899999999999999,"5min":1.488,"15min":1.488},"last":1.073},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.98399999999999999,"15min":0.98999999999999999},"min":{"1min":0.68700000000000006,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.3069999999999999,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":1.1890000000000001}]},{"osd":5,"last update":"Sat Jun 10 19:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.008,"15min":1.0349999999999999},"min":{"1min":0.64200000000000002,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.2030000000000001,"5min":1.425,"15min":2.024},"last":0.997},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.014,"15min":1.0229999999999999},"min":{"1min":0.72099999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.3220000000000001,"5min":1.5069999999999999,"15min":1.724},"last":1.097}]},{"osd":6,"last update":"Sat Jun 10 19:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.0600000000000001,"15min":1.0580000000000001},"min":{"1min":0.79600000000000004,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.3600000000000001,"5min":1.597,"15min":1.8500000000000001},"last":1.143},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.0509999999999999,"15min":1.0649999999999999},"min":{"1min":0.73499999999999999,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.3380000000000001,"5min":1.4590000000000001,"15min":1.78},"last":1.022}]},{"osd":7,"last update":"Sat Jun 10 19:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.0820000000000001,"15min":1.1100000000000001},"min":{"1min":0.75,"5min":0.60999999999999999,"15min":0.56999999999999995},"max":{"1min":1.373,"5min":1.444,"15min":1.9079999999999999},"last":1.123},{"interface":"front","average":{"1min":1.093,"5min":1.105,"15min":1.0900000000000001},"min":{"1min":0.72099999999999997,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.399,"5min":1.651,"15min":1.6719999999999999},"last":1.2589999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574966,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32176,"kb_used_data":1128,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339664,"statfs":{"total":96636764160,"available":96603815936,"internally_reserved":0,"allocated":1155072,"data_stored":526465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:01:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.628,"15min":0.60499999999999998},"min":{"1min":0.31,"5min":0.28899999999999998,"15min":0.27300000000000002},"max":{"1min":1.095,"5min":1.095,"15min":1.1220000000000001},"last":0.503},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.72899999999999998,"15min":0.72199999999999998},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.0209999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.89800000000000002}]},{"osd":1,"last update":"Sat Jun 10 19:01:52 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.67500000000000004,"15min":0.66100000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.307},"max":{"1min":0.98199999999999998,"5min":1.099,"15min":1.1950000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.78100000000000003,"15min":0.73599999999999999},"min":{"1min":0.36699999999999999,"5min":0.33300000000000002,"15min":0.29499999999999998},"max":{"1min":1.0109999999999999,"5min":1.446,"15min":1.446},"last":0.80200000000000005}]},{"osd":3,"last update":"Sat Jun 10 19:01:52 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.80000000000000004,"15min":0.746},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.1599999999999999,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.80400000000000005,"15min":0.77100000000000002},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.252},"max":{"1min":0.999,"5min":1.1459999999999999,"15min":1.3340000000000001},"last":0.73599999999999999}]},{"osd":4,"last update":"Sat Jun 10 19:01:52 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.93500000000000005,"15min":0.92400000000000004},"min":{"1min":0.624,"5min":0.56200000000000006,"15min":0.53400000000000003},"max":{"1min":1.228,"5min":1.228,"15min":1.3620000000000001},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.998,"5min":1.0049999999999999,"15min":1.0269999999999999},"min":{"1min":0.753,"5min":0.60899999999999999,"15min":0.57699999999999996},"max":{"1min":1.486,"5min":1.486,"15min":1.4950000000000001},"last":0.97599999999999998}]},{"osd":5,"last update":"Sat Jun 10 19:01:52 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.008,"15min":1.018},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.54100000000000004},"max":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":1.5700000000000001},"last":1.119},{"interface":"front","average":{"1min":0.98699999999999999,"5min":1.0189999999999999,"15min":1.002},"min":{"1min":0.71999999999999997,"5min":0.66000000000000003,"15min":0.60099999999999998},"max":{"1min":1.2669999999999999,"5min":1.381,"15min":1.667},"last":1.0940000000000001}]},{"osd":6,"last update":"Sat Jun 10 19:01:52 2023","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.044,"15min":1.0389999999999999},"min":{"1min":0.67400000000000004,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.304,"5min":1.4259999999999999,"15min":1.5900000000000001},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.038,"5min":1.05,"15min":1.044},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.2989999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.85599999999999998}]},{"osd":7,"last update":"Sat Jun 10 19:01:52 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.0880000000000001,"15min":1.0980000000000001},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.4319999999999999,"5min":1.724,"15min":1.724},"last":1.3460000000000001},{"interface":"front","average":{"1min":1.085,"5min":1.1080000000000001,"15min":1.0980000000000001},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.59299999999999997},"max":{"1min":1.363,"5min":1.51,"15min":1.752},"last":1.236}]}]},{"osd":1,"up_from":13,"seq":55834574968,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32176,"kb_used_data":1128,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339664,"statfs":{"total":96636764160,"available":96603815936,"internally_reserved":0,"allocated":1155072,"data_stored":525516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:01:54 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.71699999999999997,"15min":0.68000000000000005},"min":{"1min":0.46500000000000002,"5min":0.28599999999999998,"15min":0.25800000000000001},"max":{"1min":1.111,"5min":1.1459999999999999,"15min":1.288},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79000000000000004,"15min":0.72899999999999998},"min":{"1min":0.41899999999999998,"5min":0.32800000000000001,"15min":0.26900000000000002},"max":{"1min":0.98099999999999998,"5min":1.056,"15min":1.694},"last":0.69199999999999995}]},{"osd":2,"last update":"Sat Jun 10 19:01:54 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.65700000000000003,"15min":0.63400000000000001},"min":{"1min":0.39200000000000002,"5min":0.308,"15min":0.249},"max":{"1min":0.93999999999999995,"5min":1.0740000000000001,"15min":1.21},"last":1.0329999999999999},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.754,"15min":0.70299999999999996},"min":{"1min":0.48599999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.0600000000000001,"5min":1.194,"15min":1.415},"last":0.54000000000000004}]},{"osd":3,"last update":"Sat Jun 10 19:01:54 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.80700000000000005,"15min":0.77600000000000002},"min":{"1min":0.58599999999999997,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.1679999999999999,"5min":1.3049999999999999,"15min":1.6299999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.75900000000000001,"15min":0.752},"min":{"1min":0.47199999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":2.1749999999999998},"last":0.58899999999999997}]},{"osd":4,"last update":"Sat Jun 10 19:01:54 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.878,"15min":0.85699999999999998},"min":{"1min":0.67400000000000004,"5min":0.58699999999999997,"15min":0.53000000000000003},"max":{"1min":1.343,"5min":1.343,"15min":1.4930000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.022,"15min":1.0600000000000001},"min":{"1min":0.71299999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.2569999999999999,"5min":1.5129999999999999,"15min":5.8209999999999997},"last":0.89400000000000002}]},{"osd":5,"last update":"Sat Jun 10 19:01:54 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.006,"15min":1.0169999999999999},"min":{"1min":0.60899999999999999,"5min":0.57699999999999996,"15min":0.56599999999999995},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.8620000000000001},"last":0.91500000000000004},{"interface":"front","average":{"1min":1.018,"5min":0.997,"15min":0.98299999999999998},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.3069999999999999,"5min":1.3089999999999999,"15min":3.089},"last":1.1040000000000001}]},{"osd":6,"last update":"Sat Jun 10 19:01:54 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.0660000000000001,"15min":1.0549999999999999},"min":{"1min":0.73699999999999999,"5min":0.64100000000000001,"15min":0.56200000000000006},"max":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":7.2599999999999998},"last":0.78100000000000003},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0389999999999999,"15min":1.042},"min":{"1min":0.73599999999999999,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":9.0069999999999997},"last":0.95299999999999996}]},{"osd":7,"last update":"Sat Jun 10 19:01:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.113,"15min":1.0940000000000001},"min":{"1min":0.92400000000000004,"5min":0.495,"15min":0.495},"max":{"1min":1.494,"5min":1.573,"15min":2.105},"last":0.93899999999999995},{"interface":"front","average":{"1min":1.089,"5min":1.1180000000000001,"15min":1.087},"min":{"1min":0.63700000000000001,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.5620000000000001,"5min":1.6399999999999999,"15min":2.2570000000000001},"last":0.98399999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574967,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32776,"kb_used_data":1728,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339064,"statfs":{"total":96636764160,"available":96603201536,"internally_reserved":0,"allocated":1769472,"data_stored":1118084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jun 10 19:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.65500000000000003,"15min":0.624},"min":{"1min":0.34799999999999998,"5min":0.248,"15min":0.248},"max":{"1min":1.077,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.82899999999999996,"15min":0.78200000000000003},"min":{"1min":0.38600000000000001,"5min":0.34100000000000003,"15min":0.34000000000000002},"max":{"1min":1.1559999999999999,"5min":1.302,"15min":1.4059999999999999},"last":0.87}]},{"osd":2,"last update":"Sat Jun 10 19:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.71399999999999997,"15min":0.70599999999999996},"min":{"1min":0.33500000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.149,"5min":1.149,"15min":1.2829999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66600000000000004,"15min":0.64700000000000002},"min":{"1min":0.318,"5min":0.245,"15min":0.245},"max":{"1min":0.88900000000000001,"5min":1.139,"15min":1.371},"last":0.63}]},{"osd":3,"last update":"Sat Jun 10 19:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.67300000000000004,"15min":0.67900000000000005},"min":{"1min":0.30299999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.96199999999999997,"5min":1.222,"15min":1.226},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.80400000000000005,"15min":0.81499999999999995},"min":{"1min":0.41999999999999998,"5min":0.317,"15min":0.317},"max":{"1min":1.083,"5min":1.2549999999999999,"15min":1.829},"last":0.54900000000000004}]},{"osd":4,"last update":"Sat Jun 10 19:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.94099999999999995,"15min":0.91200000000000003},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1990000000000001,"5min":3.0209999999999999,"15min":3.0209999999999999},"last":1.0009999999999999},{"interface":"front","average":{"1min":0.998,"5min":1.016,"15min":1.028},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.228,"5min":1.3819999999999999,"15min":1.9510000000000001},"last":0.80500000000000005}]},{"osd":5,"last update":"Sat Jun 10 19:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.92400000000000004,"15min":0.94599999999999995},"min":{"1min":0.64700000000000002,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.095,"5min":1.2529999999999999,"15min":1.694},"last":0.69899999999999995},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.024,"15min":1.01},"min":{"1min":0.58099999999999996,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.391,"5min":4.5620000000000003,"15min":4.5620000000000003},"last":0.93899999999999995}]},{"osd":6,"last update":"Sat Jun 10 19:01:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0940000000000001,"15min":1.0720000000000001},"min":{"1min":0.61899999999999999,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.423,"5min":3.5569999999999999,"15min":3.5569999999999999},"last":0.92600000000000005},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.012,"15min":1.004},"min":{"1min":0.67100000000000004,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.26,"5min":1.625,"15min":1.883},"last":0.90800000000000003}]},{"osd":7,"last update":"Sat Jun 10 19:01:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0309999999999999,"15min":1.0349999999999999},"min":{"1min":0.69199999999999995,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.349,"5min":1.4850000000000001,"15min":1.5800000000000001},"last":0.79200000000000004},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.63,"5min":0.61099999999999999,"15min":0.58699999999999997},"max":{"1min":1.4179999999999999,"5min":1.425,"15min":1.9830000000000001},"last":1.048}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-10T19:02:08.255 INFO:tasks.ceph.mds.a.smithi053.stderr:2023-06-10T19:02:08.255+0000 7fc48803b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-06-10T19:02:11.254 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-10T19:02:11.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.387+0000 7fd378622640 1 Processor -- start 2023-06-10T19:02:11.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.387+0000 7fd378622640 1 -- start start 2023-06-10T19:02:11.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.387+0000 7fd378622640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd3700b3ac0 0x7fd3700b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:11.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.387+0000 7fd378622640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3700cc690 0x7fd37015f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:11.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.387+0000 7fd378622640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3700d0020 con 0x7fd3700ccae0 2023-06-10T19:02:11.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.387+0000 7fd378622640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3700b43d0 con 0x7fd3700b3ac0 2023-06-10T19:02:11.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.387+0000 7fd378622640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3700cef40 con 0x7fd3700cc690 2023-06-10T19:02:11.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.387+0000 7fd3763be640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd3700b3ac0 0x7fd3700b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:11.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.387+0000 7fd3763be640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd3700b3ac0 0x7fd3700b3e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40634/0 (socket says 172.21.15.53:40634) 2023-06-10T19:02:11.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.387+0000 7fd3763be640 1 -- 172.21.15.53:0/1393949528 learned_addr learned my addr 172.21.15.53:0/1393949528 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:11.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.387+0000 7fd375bbd640 1 --2- 172.21.15.53:0/1393949528 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3700cc690 0x7fd37015f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:11.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.387+0000 7fd3763be640 1 -- 172.21.15.53:0/1393949528 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3700cc690 msgr2=0x7fd37015f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:11.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.387+0000 7fd3763be640 1 --2- 172.21.15.53:0/1393949528 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3700cc690 0x7fd37015f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:11.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.387+0000 7fd3763be640 1 -- 172.21.15.53:0/1393949528 >> v1:172.21.15.117:6789/0 conn(0x7fd3700ccae0 legacy=0x7fd37015f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:11.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.387+0000 7fd3763be640 1 -- 172.21.15.53:0/1393949528 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3700cf220 con 0x7fd3700b3ac0 2023-06-10T19:02:11.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.387+0000 7fd375bbd640 1 --2- 172.21.15.53:0/1393949528 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3700cc690 0x7fd37015f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:02:11.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.391+0000 7fd3763be640 1 --2- 172.21.15.53:0/1393949528 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3700b3ac0 0x7fd3700b3e90 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7fd36c009870 tx=0x7fd36c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2f04bd010461bb server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:11.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.391+0000 7fd3753bc640 1 -- 172.21.15.53:0/1393949528 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36c0aa5f0 con 0x7fd3700b3ac0 2023-06-10T19:02:11.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.391+0000 7fd3753bc640 1 -- 172.21.15.53:0/1393949528 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd36c0aa750 con 0x7fd3700b3ac0 2023-06-10T19:02:11.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.391+0000 7fd3753bc640 1 -- 172.21.15.53:0/1393949528 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36c0aaae0 con 0x7fd3700b3ac0 2023-06-10T19:02:11.395 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.391+0000 7fd378622640 1 -- 172.21.15.53:0/1393949528 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3700b3ac0 msgr2=0x7fd3700b3e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:11.395 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.391+0000 7fd378622640 1 --2- 172.21.15.53:0/1393949528 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3700b3ac0 0x7fd3700b3e90 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7fd36c009870 tx=0x7fd36c01c4d0 comp rx=0 tx=0).stop 2023-06-10T19:02:11.395 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.391+0000 7fd378622640 1 -- 172.21.15.53:0/1393949528 shutdown_connections 2023-06-10T19:02:11.395 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.391+0000 7fd378622640 1 --2- 172.21.15.53:0/1393949528 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3700cc690 0x7fd37015f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:11.395 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.391+0000 7fd378622640 1 --2- 172.21.15.53:0/1393949528 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3700b3ac0 0x7fd3700b3e90 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:11.395 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.391+0000 7fd378622640 1 -- 172.21.15.53:0/1393949528 >> 172.21.15.53:0/1393949528 conn(0x7fd370071790 msgr2=0x7fd370069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:11.395 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.391+0000 7fd378622640 1 -- 172.21.15.53:0/1393949528 shutdown_connections 2023-06-10T19:02:11.395 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.391+0000 7fd378622640 1 -- 172.21.15.53:0/1393949528 wait complete. 2023-06-10T19:02:11.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.395+0000 7fd378622640 1 Processor -- start 2023-06-10T19:02:11.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.395+0000 7fd378622640 1 -- start start 2023-06-10T19:02:11.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.395+0000 7fd378622640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3700b3ac0 0x7fd3700c7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:11.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.395+0000 7fd378622640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3700cc690 0x7fd37015e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:11.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.395+0000 7fd378622640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3700ccae0 0x7fd3701552f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:11.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.395+0000 7fd378622640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd370155830 con 0x7fd3700ccae0 2023-06-10T19:02:11.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.395+0000 7fd378622640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3700c6c90 con 0x7fd3700cc690 2023-06-10T19:02:11.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.395+0000 7fd378622640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3700c6080 con 0x7fd3700b3ac0 2023-06-10T19:02:11.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.395+0000 7fd376bbf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3700ccae0 0x7fd3701552f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:11.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.395+0000 7fd376bbf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3700ccae0 0x7fd3701552f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40636/0 (socket says 172.21.15.53:40636) 2023-06-10T19:02:11.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.395+0000 7fd376bbf640 1 -- 172.21.15.53:0/3163318266 learned_addr learned my addr 172.21.15.53:0/3163318266 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:11.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.395+0000 7fd375bbd640 1 --2- 172.21.15.53:0/3163318266 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3700cc690 0x7fd37015e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:11.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.395+0000 7fd3763be640 1 --2- 172.21.15.53:0/3163318266 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3700b3ac0 0x7fd3700c7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:11.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.395+0000 7fd376bbf640 1 -- 172.21.15.53:0/3163318266 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3700b3ac0 msgr2=0x7fd3700c7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:11.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.395+0000 7fd376bbf640 1 --2- 172.21.15.53:0/3163318266 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3700b3ac0 0x7fd3700c7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:11.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.395+0000 7fd376bbf640 1 -- 172.21.15.53:0/3163318266 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3700cc690 msgr2=0x7fd37015e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:11.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.395+0000 7fd376bbf640 1 --2- 172.21.15.53:0/3163318266 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3700cc690 0x7fd37015e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:11.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.395+0000 7fd376bbf640 1 -- 172.21.15.53:0/3163318266 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd36c0094d0 con 0x7fd3700ccae0 2023-06-10T19:02:11.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.395+0000 7fd3763be640 1 --2- 172.21.15.53:0/3163318266 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3700b3ac0 0x7fd3700c7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:02:11.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.395+0000 7fd376bbf640 1 --2- 172.21.15.53:0/3163318266 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3700ccae0 0x7fd3701552f0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7fd36800c780 tx=0x7fd36800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:11.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.395+0000 7fd362ffd640 1 -- 172.21.15.53:0/3163318266 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd368004b70 con 0x7fd3700ccae0 2023-06-10T19:02:11.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.395+0000 7fd362ffd640 1 -- 172.21.15.53:0/3163318266 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd36800ce90 con 0x7fd3700ccae0 2023-06-10T19:02:11.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.395+0000 7fd362ffd640 1 -- 172.21.15.53:0/3163318266 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36800a850 con 0x7fd3700ccae0 2023-06-10T19:02:11.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.395+0000 7fd378622640 1 -- 172.21.15.53:0/3163318266 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3700c6360 con 0x7fd3700ccae0 2023-06-10T19:02:11.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.395+0000 7fd378622640 1 -- 172.21.15.53:0/3163318266 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3700c6920 con 0x7fd3700ccae0 2023-06-10T19:02:11.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.395+0000 7fd378622640 1 -- 172.21.15.53:0/3163318266 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3700c6e40 con 0x7fd3700ccae0 2023-06-10T19:02:11.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.399+0000 7fd362ffd640 1 -- 172.21.15.53:0/3163318266 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd36800a9b0 con 0x7fd3700ccae0 2023-06-10T19:02:11.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.399+0000 7fd362ffd640 1 --2- 172.21.15.53:0/3163318266 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd3540662b0 0x7fd354068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:11.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.399+0000 7fd362ffd640 1 -- 172.21.15.53:0/3163318266 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd368083e80 con 0x7fd3700ccae0 2023-06-10T19:02:11.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.399+0000 7fd3763be640 1 --2- 172.21.15.53:0/3163318266 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd3540662b0 0x7fd354068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:11.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.399+0000 7fd3763be640 1 --2- 172.21.15.53:0/3163318266 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd3540662b0 0x7fd354068760 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fd36c0ae000 tx=0x7fd36c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:11.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.403+0000 7fd362ffd640 1 -- 172.21.15.53:0/3163318266 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd3700c6e40 con 0x7fd3700ccae0 2023-06-10T19:02:11.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.551+0000 7fd378622640 1 -- 172.21.15.53:0/3163318266 --> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd3700b7a20 con 0x7fd3540662b0 2023-06-10T19:02:11.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.575+0000 7fd362ffd640 1 -- 172.21.15.53:0/3163318266 <== mgr.4105 v2:172.21.15.117:6832/3061986771 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+309980 (secure 0 0 0) 0x7fd36c0ba090 con 0x7fd3540662b0 2023-06-10T19:02:11.579 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:02:11.583 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-06-10T19:02:11.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.579+0000 7fd378622640 1 -- 172.21.15.53:0/3163318266 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd3540662b0 msgr2=0x7fd354068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:11.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.579+0000 7fd378622640 1 --2- 172.21.15.53:0/3163318266 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd3540662b0 0x7fd354068760 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fd36c0ae000 tx=0x7fd36c008040 comp rx=0 tx=0).stop 2023-06-10T19:02:11.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.579+0000 7fd378622640 1 -- 172.21.15.53:0/3163318266 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3700ccae0 msgr2=0x7fd3701552f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:11.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.579+0000 7fd378622640 1 --2- 172.21.15.53:0/3163318266 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3700ccae0 0x7fd3701552f0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7fd36800c780 tx=0x7fd36800cc40 comp rx=0 tx=0).stop 2023-06-10T19:02:11.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.579+0000 7fd378622640 1 -- 172.21.15.53:0/3163318266 shutdown_connections 2023-06-10T19:02:11.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.579+0000 7fd378622640 1 --2- 172.21.15.53:0/3163318266 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd3540662b0 0x7fd354068760 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:11.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.579+0000 7fd378622640 1 --2- 172.21.15.53:0/3163318266 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3700ccae0 0x7fd3701552f0 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:11.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.579+0000 7fd378622640 1 --2- 172.21.15.53:0/3163318266 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3700cc690 0x7fd37015e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:11.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.579+0000 7fd378622640 1 --2- 172.21.15.53:0/3163318266 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3700b3ac0 0x7fd3700c7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:11.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.579+0000 7fd378622640 1 -- 172.21.15.53:0/3163318266 >> 172.21.15.53:0/3163318266 conn(0x7fd370071790 msgr2=0x7fd3700b51e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:11.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.579+0000 7fd378622640 1 -- 172.21.15.53:0/3163318266 shutdown_connections 2023-06-10T19:02:11.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.583+0000 7fd378622640 1 -- 172.21.15.53:0/3163318266 wait complete. 2023-06-10T19:02:11.602 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":376,"stamp":"2023-06-10T19:02:09.765032+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":258620,"kb_used_data":10236,"kb_used_omap":0,"kb_used_meta":248320,"kb_avail":754716100,"statfs":{"total":773094113280,"available":772829286400,"internally_reserved":0,"allocated":10481664,"data_stored":5394123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":254279680},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":52,"apply_latency_ms":52,"commit_latency_ns":52000000,"apply_latency_ns":52000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.507058"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:05.665852+0000","last_change":"2023-06-10T19:02:02.665348+0000","last_active":"2023-06-10T19:02:05.665852+0000","last_peered":"2023-06-10T19:02:05.665852+0000","last_clean":"2023-06-10T19:02:05.665852+0000","last_became_active":"2023-06-10T19:02:02.665052+0000","last_became_peered":"2023-06-10T19:02:02.665052+0000","last_unstale":"2023-06-10T19:02:05.665852+0000","last_undegraded":"2023-06-10T19:02:05.665852+0000","last_fullsized":"2023-06-10T19:02:05.665852+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:02:31.253313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.665347+0000","last_change":"2023-06-10T19:02:02.671565+0000","last_active":"2023-06-10T19:02:03.665347+0000","last_peered":"2023-06-10T19:02:03.665347+0000","last_clean":"2023-06-10T19:02:03.665347+0000","last_became_active":"2023-06-10T19:02:02.670788+0000","last_became_peered":"2023-06-10T19:02:02.670788+0000","last_unstale":"2023-06-10T19:02:03.665347+0000","last_undegraded":"2023-06-10T19:02:03.665347+0000","last_fullsized":"2023-06-10T19:02:03.665347+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:09:27.770652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:05.665389+0000","last_change":"2023-06-10T19:02:02.684406+0000","last_active":"2023-06-10T19:02:05.665389+0000","last_peered":"2023-06-10T19:02:05.665389+0000","last_clean":"2023-06-10T19:02:05.665389+0000","last_became_active":"2023-06-10T19:02:02.684069+0000","last_became_peered":"2023-06-10T19:02:02.684069+0000","last_unstale":"2023-06-10T19:02:05.665389+0000","last_undegraded":"2023-06-10T19:02:05.665389+0000","last_fullsized":"2023-06-10T19:02:05.665389+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:23:03.514448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:05.667766+0000","last_change":"2023-06-10T19:02:02.704383+0000","last_active":"2023-06-10T19:02:05.667766+0000","last_peered":"2023-06-10T19:02:05.667766+0000","last_clean":"2023-06-10T19:02:05.667766+0000","last_became_active":"2023-06-10T19:02:02.704046+0000","last_became_peered":"2023-06-10T19:02:02.704046+0000","last_unstale":"2023-06-10T19:02:05.667766+0000","last_undegraded":"2023-06-10T19:02:05.667766+0000","last_fullsized":"2023-06-10T19:02:05.667766+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:57:05.604556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.663941+0000","last_change":"2023-06-10T19:02:02.705465+0000","last_active":"2023-06-10T19:02:03.663941+0000","last_peered":"2023-06-10T19:02:03.663941+0000","last_clean":"2023-06-10T19:02:03.663941+0000","last_became_active":"2023-06-10T19:02:02.704656+0000","last_became_peered":"2023-06-10T19:02:02.704656+0000","last_unstale":"2023-06-10T19:02:03.663941+0000","last_undegraded":"2023-06-10T19:02:03.663941+0000","last_fullsized":"2023-06-10T19:02:03.663941+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:17:35.748764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.660363+0000","last_change":"2023-06-10T19:02:02.673704+0000","last_active":"2023-06-10T19:02:03.660363+0000","last_peered":"2023-06-10T19:02:03.660363+0000","last_clean":"2023-06-10T19:02:03.660363+0000","last_became_active":"2023-06-10T19:02:02.673439+0000","last_became_peered":"2023-06-10T19:02:02.673439+0000","last_unstale":"2023-06-10T19:02:03.660363+0000","last_undegraded":"2023-06-10T19:02:03.660363+0000","last_fullsized":"2023-06-10T19:02:03.660363+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:05:05.427451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:04.256186+0000","last_change":"2023-06-10T19:02:02.695952+0000","last_active":"2023-06-10T19:02:04.256186+0000","last_peered":"2023-06-10T19:02:04.256186+0000","last_clean":"2023-06-10T19:02:04.256186+0000","last_became_active":"2023-06-10T19:02:02.695070+0000","last_became_peered":"2023-06-10T19:02:02.695070+0000","last_unstale":"2023-06-10T19:02:04.256186+0000","last_undegraded":"2023-06-10T19:02:04.256186+0000","last_fullsized":"2023-06-10T19:02:04.256186+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:53:41.678682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:05.667419+0000","last_change":"2023-06-10T19:02:02.696076+0000","last_active":"2023-06-10T19:02:05.667419+0000","last_peered":"2023-06-10T19:02:05.667419+0000","last_clean":"2023-06-10T19:02:05.667419+0000","last_became_active":"2023-06-10T19:02:02.695827+0000","last_became_peered":"2023-06-10T19:02:02.695827+0000","last_unstale":"2023-06-10T19:02:05.667419+0000","last_undegraded":"2023-06-10T19:02:05.667419+0000","last_fullsized":"2023-06-10T19:02:05.667419+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:34:31.102100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.666034+0000","last_change":"2023-06-10T19:02:02.680828+0000","last_active":"2023-06-10T19:02:03.666034+0000","last_peered":"2023-06-10T19:02:03.666034+0000","last_clean":"2023-06-10T19:02:03.666034+0000","last_became_active":"2023-06-10T19:02:02.680039+0000","last_became_peered":"2023-06-10T19:02:02.680039+0000","last_unstale":"2023-06-10T19:02:03.666034+0000","last_undegraded":"2023-06-10T19:02:03.666034+0000","last_fullsized":"2023-06-10T19:02:03.666034+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:53:35.742228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:04.686926+0000","last_change":"2023-06-10T19:02:02.665553+0000","last_active":"2023-06-10T19:02:04.686926+0000","last_peered":"2023-06-10T19:02:04.686926+0000","last_clean":"2023-06-10T19:02:04.686926+0000","last_became_active":"2023-06-10T19:02:02.665255+0000","last_became_peered":"2023-06-10T19:02:02.665255+0000","last_unstale":"2023-06-10T19:02:04.686926+0000","last_undegraded":"2023-06-10T19:02:04.686926+0000","last_fullsized":"2023-06-10T19:02:04.686926+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:50:17.367479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.665033+0000","last_change":"2023-06-10T19:02:02.683637+0000","last_active":"2023-06-10T19:02:03.665033+0000","last_peered":"2023-06-10T19:02:03.665033+0000","last_clean":"2023-06-10T19:02:03.665033+0000","last_became_active":"2023-06-10T19:02:02.682347+0000","last_became_peered":"2023-06-10T19:02:02.682347+0000","last_unstale":"2023-06-10T19:02:03.665033+0000","last_undegraded":"2023-06-10T19:02:03.665033+0000","last_fullsized":"2023-06-10T19:02:03.665033+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:52:44.045036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:04.686668+0000","last_change":"2023-06-10T19:02:02.670292+0000","last_active":"2023-06-10T19:02:04.686668+0000","last_peered":"2023-06-10T19:02:04.686668+0000","last_clean":"2023-06-10T19:02:04.686668+0000","last_became_active":"2023-06-10T19:02:02.670000+0000","last_became_peered":"2023-06-10T19:02:02.670000+0000","last_unstale":"2023-06-10T19:02:04.686668+0000","last_undegraded":"2023-06-10T19:02:04.686668+0000","last_fullsized":"2023-06-10T19:02:04.686668+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:33:33.449734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:05.667550+0000","last_change":"2023-06-10T19:02:02.697503+0000","last_active":"2023-06-10T19:02:05.667550+0000","last_peered":"2023-06-10T19:02:05.667550+0000","last_clean":"2023-06-10T19:02:05.667550+0000","last_became_active":"2023-06-10T19:02:02.697195+0000","last_became_peered":"2023-06-10T19:02:02.697195+0000","last_unstale":"2023-06-10T19:02:05.667550+0000","last_undegraded":"2023-06-10T19:02:05.667550+0000","last_fullsized":"2023-06-10T19:02:05.667550+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:31:47.474672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.662649+0000","last_change":"2023-06-10T19:02:02.685717+0000","last_active":"2023-06-10T19:02:03.662649+0000","last_peered":"2023-06-10T19:02:03.662649+0000","last_clean":"2023-06-10T19:02:03.662649+0000","last_became_active":"2023-06-10T19:02:02.685029+0000","last_became_peered":"2023-06-10T19:02:02.685029+0000","last_unstale":"2023-06-10T19:02:03.662649+0000","last_undegraded":"2023-06-10T19:02:03.662649+0000","last_fullsized":"2023-06-10T19:02:03.662649+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:54:34.033395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:05.666607+0000","last_change":"2023-06-10T19:02:02.672291+0000","last_active":"2023-06-10T19:02:05.666607+0000","last_peered":"2023-06-10T19:02:05.666607+0000","last_clean":"2023-06-10T19:02:05.666607+0000","last_became_active":"2023-06-10T19:02:02.672015+0000","last_became_peered":"2023-06-10T19:02:02.672015+0000","last_unstale":"2023-06-10T19:02:05.666607+0000","last_undegraded":"2023-06-10T19:02:05.666607+0000","last_fullsized":"2023-06-10T19:02:05.666607+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:58:47.859709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.660400+0000","last_change":"2023-06-10T19:02:02.672362+0000","last_active":"2023-06-10T19:02:03.660400+0000","last_peered":"2023-06-10T19:02:03.660400+0000","last_clean":"2023-06-10T19:02:03.660400+0000","last_became_active":"2023-06-10T19:02:02.672058+0000","last_became_peered":"2023-06-10T19:02:02.672058+0000","last_unstale":"2023-06-10T19:02:03.660400+0000","last_undegraded":"2023-06-10T19:02:03.660400+0000","last_fullsized":"2023-06-10T19:02:03.660400+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:41:51.504050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.661431+0000","last_change":"2023-06-10T19:02:02.667709+0000","last_active":"2023-06-10T19:02:03.661431+0000","last_peered":"2023-06-10T19:02:03.661431+0000","last_clean":"2023-06-10T19:02:03.661431+0000","last_became_active":"2023-06-10T19:02:02.667406+0000","last_became_peered":"2023-06-10T19:02:02.667406+0000","last_unstale":"2023-06-10T19:02:03.661431+0000","last_undegraded":"2023-06-10T19:02:03.661431+0000","last_fullsized":"2023-06-10T19:02:03.661431+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:40:40.525125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:05.666158+0000","last_change":"2023-06-10T19:02:02.668883+0000","last_active":"2023-06-10T19:02:05.666158+0000","last_peered":"2023-06-10T19:02:05.666158+0000","last_clean":"2023-06-10T19:02:05.666158+0000","last_became_active":"2023-06-10T19:02:02.668590+0000","last_became_peered":"2023-06-10T19:02:02.668590+0000","last_unstale":"2023-06-10T19:02:05.666158+0000","last_undegraded":"2023-06-10T19:02:05.666158+0000","last_fullsized":"2023-06-10T19:02:05.666158+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:34:07.221258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.663482+0000","last_change":"2023-06-10T19:02:02.699972+0000","last_active":"2023-06-10T19:02:03.663482+0000","last_peered":"2023-06-10T19:02:03.663482+0000","last_clean":"2023-06-10T19:02:03.663482+0000","last_became_active":"2023-06-10T19:02:02.699193+0000","last_became_peered":"2023-06-10T19:02:02.699193+0000","last_unstale":"2023-06-10T19:02:03.663482+0000","last_undegraded":"2023-06-10T19:02:03.663482+0000","last_fullsized":"2023-06-10T19:02:03.663482+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:21:23.368290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:05.667998+0000","last_change":"2023-06-10T19:02:02.671985+0000","last_active":"2023-06-10T19:02:05.667998+0000","last_peered":"2023-06-10T19:02:05.667998+0000","last_clean":"2023-06-10T19:02:05.667998+0000","last_became_active":"2023-06-10T19:02:02.671708+0000","last_became_peered":"2023-06-10T19:02:02.671708+0000","last_unstale":"2023-06-10T19:02:05.667998+0000","last_undegraded":"2023-06-10T19:02:05.667998+0000","last_fullsized":"2023-06-10T19:02:05.667998+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:17:49.406346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.662989+0000","last_change":"2023-06-10T19:02:02.700696+0000","last_active":"2023-06-10T19:02:03.662989+0000","last_peered":"2023-06-10T19:02:03.662989+0000","last_clean":"2023-06-10T19:02:03.662989+0000","last_became_active":"2023-06-10T19:02:02.699835+0000","last_became_peered":"2023-06-10T19:02:02.699835+0000","last_unstale":"2023-06-10T19:02:03.662989+0000","last_undegraded":"2023-06-10T19:02:03.662989+0000","last_fullsized":"2023-06-10T19:02:03.662989+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:24:30.859897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.662771+0000","last_change":"2023-06-10T19:02:02.681477+0000","last_active":"2023-06-10T19:02:03.662771+0000","last_peered":"2023-06-10T19:02:03.662771+0000","last_clean":"2023-06-10T19:02:03.662771+0000","last_became_active":"2023-06-10T19:02:02.680610+0000","last_became_peered":"2023-06-10T19:02:02.680610+0000","last_unstale":"2023-06-10T19:02:03.662771+0000","last_undegraded":"2023-06-10T19:02:03.662771+0000","last_fullsized":"2023-06-10T19:02:03.662771+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:34:26.305026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:05.664060+0000","last_change":"2023-06-10T19:02:02.704171+0000","last_active":"2023-06-10T19:02:05.664060+0000","last_peered":"2023-06-10T19:02:05.664060+0000","last_clean":"2023-06-10T19:02:05.664060+0000","last_became_active":"2023-06-10T19:02:02.702763+0000","last_became_peered":"2023-06-10T19:02:02.702763+0000","last_unstale":"2023-06-10T19:02:05.664060+0000","last_undegraded":"2023-06-10T19:02:05.664060+0000","last_fullsized":"2023-06-10T19:02:05.664060+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:23:03.514448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:05.665281+0000","last_change":"2023-06-10T19:02:02.682530+0000","last_active":"2023-06-10T19:02:05.665281+0000","last_peered":"2023-06-10T19:02:05.665281+0000","last_clean":"2023-06-10T19:02:05.665281+0000","last_became_active":"2023-06-10T19:02:02.682004+0000","last_became_peered":"2023-06-10T19:02:02.682004+0000","last_unstale":"2023-06-10T19:02:05.665281+0000","last_undegraded":"2023-06-10T19:02:05.665281+0000","last_fullsized":"2023-06-10T19:02:05.665281+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:39:38.012157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.665424+0000","last_change":"2023-06-10T19:02:02.709249+0000","last_active":"2023-06-10T19:02:03.665424+0000","last_peered":"2023-06-10T19:02:03.665424+0000","last_clean":"2023-06-10T19:02:03.665424+0000","last_became_active":"2023-06-10T19:02:02.708512+0000","last_became_peered":"2023-06-10T19:02:02.708512+0000","last_unstale":"2023-06-10T19:02:03.665424+0000","last_undegraded":"2023-06-10T19:02:03.665424+0000","last_fullsized":"2023-06-10T19:02:03.665424+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:25:02.496395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.665615+0000","last_change":"2023-06-10T19:02:02.698521+0000","last_active":"2023-06-10T19:02:03.665615+0000","last_peered":"2023-06-10T19:02:03.665615+0000","last_clean":"2023-06-10T19:02:03.665615+0000","last_became_active":"2023-06-10T19:02:02.697781+0000","last_became_peered":"2023-06-10T19:02:02.697781+0000","last_unstale":"2023-06-10T19:02:03.665615+0000","last_undegraded":"2023-06-10T19:02:03.665615+0000","last_fullsized":"2023-06-10T19:02:03.665615+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:30:58.125799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:04.686592+0000","last_change":"2023-06-10T19:02:02.704369+0000","last_active":"2023-06-10T19:02:04.686592+0000","last_peered":"2023-06-10T19:02:04.686592+0000","last_clean":"2023-06-10T19:02:04.686592+0000","last_became_active":"2023-06-10T19:02:02.704000+0000","last_became_peered":"2023-06-10T19:02:02.704000+0000","last_unstale":"2023-06-10T19:02:04.686592+0000","last_undegraded":"2023-06-10T19:02:04.686592+0000","last_fullsized":"2023-06-10T19:02:04.686592+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:24:36.649137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:05.668045+0000","last_change":"2023-06-10T19:02:02.700705+0000","last_active":"2023-06-10T19:02:05.668045+0000","last_peered":"2023-06-10T19:02:05.668045+0000","last_clean":"2023-06-10T19:02:05.668045+0000","last_became_active":"2023-06-10T19:02:02.700402+0000","last_became_peered":"2023-06-10T19:02:02.700402+0000","last_unstale":"2023-06-10T19:02:05.668045+0000","last_undegraded":"2023-06-10T19:02:05.668045+0000","last_fullsized":"2023-06-10T19:02:05.668045+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:47:53.570466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:04.256393+0000","last_change":"2023-06-10T19:02:02.707093+0000","last_active":"2023-06-10T19:02:04.256393+0000","last_peered":"2023-06-10T19:02:04.256393+0000","last_clean":"2023-06-10T19:02:04.256393+0000","last_became_active":"2023-06-10T19:02:02.696178+0000","last_became_peered":"2023-06-10T19:02:02.696178+0000","last_unstale":"2023-06-10T19:02:04.256393+0000","last_undegraded":"2023-06-10T19:02:04.256393+0000","last_fullsized":"2023-06-10T19:02:04.256393+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:18:03.087448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.663160+0000","last_change":"2023-06-10T19:02:02.681746+0000","last_active":"2023-06-10T19:02:03.663160+0000","last_peered":"2023-06-10T19:02:03.663160+0000","last_clean":"2023-06-10T19:02:03.663160+0000","last_became_active":"2023-06-10T19:02:02.678889+0000","last_became_peered":"2023-06-10T19:02:02.678889+0000","last_unstale":"2023-06-10T19:02:03.663160+0000","last_undegraded":"2023-06-10T19:02:03.663160+0000","last_fullsized":"2023-06-10T19:02:03.663160+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:13:29.163603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.664057+0000","last_change":"2023-06-10T19:02:02.666485+0000","last_active":"2023-06-10T19:02:03.664057+0000","last_peered":"2023-06-10T19:02:03.664057+0000","last_clean":"2023-06-10T19:02:03.664057+0000","last_became_active":"2023-06-10T19:02:02.665650+0000","last_became_peered":"2023-06-10T19:02:02.665650+0000","last_unstale":"2023-06-10T19:02:03.664057+0000","last_undegraded":"2023-06-10T19:02:03.664057+0000","last_fullsized":"2023-06-10T19:02:03.664057+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:02:40.695753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.660393+0000","last_change":"2023-06-10T19:02:02.668274+0000","last_active":"2023-06-10T19:02:03.660393+0000","last_peered":"2023-06-10T19:02:03.660393+0000","last_clean":"2023-06-10T19:02:03.660393+0000","last_became_active":"2023-06-10T19:02:02.668009+0000","last_became_peered":"2023-06-10T19:02:02.668009+0000","last_unstale":"2023-06-10T19:02:03.660393+0000","last_undegraded":"2023-06-10T19:02:03.660393+0000","last_fullsized":"2023-06-10T19:02:03.660393+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:43:34.042391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.660539+0000","last_change":"2023-06-10T19:02:02.680375+0000","last_active":"2023-06-10T19:02:03.660539+0000","last_peered":"2023-06-10T19:02:03.660539+0000","last_clean":"2023-06-10T19:02:03.660539+0000","last_became_active":"2023-06-10T19:02:02.680094+0000","last_became_peered":"2023-06-10T19:02:02.680094+0000","last_unstale":"2023-06-10T19:02:03.660539+0000","last_undegraded":"2023-06-10T19:02:03.660539+0000","last_fullsized":"2023-06-10T19:02:03.660539+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:52:07.928979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"93'4","reported_seq":17,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:05.664903+0000","last_change":"2023-06-10T19:02:02.307615+0000","last_active":"2023-06-10T19:02:05.664903+0000","last_peered":"2023-06-10T19:02:05.664903+0000","last_clean":"2023-06-10T19:02:05.664903+0000","last_became_active":"2023-06-10T19:02:02.306543+0000","last_became_peered":"2023-06-10T19:02:02.306543+0000","last_unstale":"2023-06-10T19:02:05.664903+0000","last_undegraded":"2023-06-10T19:02:05.664903+0000","last_fullsized":"2023-06-10T19:02:05.664903+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:20:45.097581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.660528+0000","last_change":"2023-06-10T19:02:02.662624+0000","last_active":"2023-06-10T19:02:03.660528+0000","last_peered":"2023-06-10T19:02:03.660528+0000","last_clean":"2023-06-10T19:02:03.660528+0000","last_became_active":"2023-06-10T19:02:02.662135+0000","last_became_peered":"2023-06-10T19:02:02.662135+0000","last_unstale":"2023-06-10T19:02:03.660528+0000","last_undegraded":"2023-06-10T19:02:03.660528+0000","last_fullsized":"2023-06-10T19:02:03.660528+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:26:58.550084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"93'1","reported_seq":14,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.664167+0000","last_change":"2023-06-10T19:02:02.308152+0000","last_active":"2023-06-10T19:02:03.664167+0000","last_peered":"2023-06-10T19:02:03.664167+0000","last_clean":"2023-06-10T19:02:03.664167+0000","last_became_active":"2023-06-10T19:02:02.307326+0000","last_became_peered":"2023-06-10T19:02:02.307326+0000","last_unstale":"2023-06-10T19:02:03.664167+0000","last_undegraded":"2023-06-10T19:02:03.664167+0000","last_fullsized":"2023-06-10T19:02:03.664167+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:27:54.962079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:04.256706+0000","last_change":"2023-06-10T19:02:02.698529+0000","last_active":"2023-06-10T19:02:04.256706+0000","last_peered":"2023-06-10T19:02:04.256706+0000","last_clean":"2023-06-10T19:02:04.256706+0000","last_became_active":"2023-06-10T19:02:02.697828+0000","last_became_peered":"2023-06-10T19:02:02.697828+0000","last_unstale":"2023-06-10T19:02:04.256706+0000","last_undegraded":"2023-06-10T19:02:04.256706+0000","last_fullsized":"2023-06-10T19:02:04.256706+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:43:38.275112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"93'2","reported_seq":15,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:04.256635+0000","last_change":"2023-06-10T19:02:02.298653+0000","last_active":"2023-06-10T19:02:04.256635+0000","last_peered":"2023-06-10T19:02:04.256635+0000","last_clean":"2023-06-10T19:02:04.256635+0000","last_became_active":"2023-06-10T19:02:02.297891+0000","last_became_peered":"2023-06-10T19:02:02.297891+0000","last_unstale":"2023-06-10T19:02:04.256635+0000","last_undegraded":"2023-06-10T19:02:04.256635+0000","last_fullsized":"2023-06-10T19:02:04.256635+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:51:44.650996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.661432+0000","last_change":"2023-06-10T19:02:02.709380+0000","last_active":"2023-06-10T19:02:03.661432+0000","last_peered":"2023-06-10T19:02:03.661432+0000","last_clean":"2023-06-10T19:02:03.661432+0000","last_became_active":"2023-06-10T19:02:02.708762+0000","last_became_peered":"2023-06-10T19:02:02.708762+0000","last_unstale":"2023-06-10T19:02:03.661432+0000","last_undegraded":"2023-06-10T19:02:03.661432+0000","last_fullsized":"2023-06-10T19:02:03.661432+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:21:52.001634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"93'2","reported_seq":15,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:05.664707+0000","last_change":"2023-06-10T19:02:02.309210+0000","last_active":"2023-06-10T19:02:05.664707+0000","last_peered":"2023-06-10T19:02:05.664707+0000","last_clean":"2023-06-10T19:02:05.664707+0000","last_became_active":"2023-06-10T19:02:02.307262+0000","last_became_peered":"2023-06-10T19:02:02.307262+0000","last_unstale":"2023-06-10T19:02:05.664707+0000","last_undegraded":"2023-06-10T19:02:05.664707+0000","last_fullsized":"2023-06-10T19:02:05.664707+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:52:02.971962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:05.666286+0000","last_change":"2023-06-10T19:02:02.675152+0000","last_active":"2023-06-10T19:02:05.666286+0000","last_peered":"2023-06-10T19:02:05.666286+0000","last_clean":"2023-06-10T19:02:05.666286+0000","last_became_active":"2023-06-10T19:02:02.672817+0000","last_became_peered":"2023-06-10T19:02:02.672817+0000","last_unstale":"2023-06-10T19:02:05.666286+0000","last_undegraded":"2023-06-10T19:02:05.666286+0000","last_fullsized":"2023-06-10T19:02:05.666286+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:28:03.009477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"93'1","reported_seq":14,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.663743+0000","last_change":"2023-06-10T19:02:02.285398+0000","last_active":"2023-06-10T19:02:03.663743+0000","last_peered":"2023-06-10T19:02:03.663743+0000","last_clean":"2023-06-10T19:02:03.663743+0000","last_became_active":"2023-06-10T19:02:02.284766+0000","last_became_peered":"2023-06-10T19:02:02.284766+0000","last_unstale":"2023-06-10T19:02:03.663743+0000","last_undegraded":"2023-06-10T19:02:03.663743+0000","last_fullsized":"2023-06-10T19:02:03.663743+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:56:58.963061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:05.664249+0000","last_change":"2023-06-10T19:02:02.703432+0000","last_active":"2023-06-10T19:02:05.664249+0000","last_peered":"2023-06-10T19:02:05.664249+0000","last_clean":"2023-06-10T19:02:05.664249+0000","last_became_active":"2023-06-10T19:02:02.702060+0000","last_became_peered":"2023-06-10T19:02:02.702060+0000","last_unstale":"2023-06-10T19:02:05.664249+0000","last_undegraded":"2023-06-10T19:02:05.664249+0000","last_fullsized":"2023-06-10T19:02:05.664249+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:34:07.221258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"93'1","reported_seq":14,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:05.666780+0000","last_change":"2023-06-10T19:02:02.280702+0000","last_active":"2023-06-10T19:02:05.666780+0000","last_peered":"2023-06-10T19:02:05.666780+0000","last_clean":"2023-06-10T19:02:05.666780+0000","last_became_active":"2023-06-10T19:02:02.280060+0000","last_became_peered":"2023-06-10T19:02:02.280060+0000","last_unstale":"2023-06-10T19:02:05.666780+0000","last_undegraded":"2023-06-10T19:02:05.666780+0000","last_fullsized":"2023-06-10T19:02:05.666780+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:09:33.798317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.660520+0000","last_change":"2023-06-10T19:02:02.676743+0000","last_active":"2023-06-10T19:02:03.660520+0000","last_peered":"2023-06-10T19:02:03.660520+0000","last_clean":"2023-06-10T19:02:03.660520+0000","last_became_active":"2023-06-10T19:02:02.676452+0000","last_became_peered":"2023-06-10T19:02:02.676452+0000","last_unstale":"2023-06-10T19:02:03.660520+0000","last_undegraded":"2023-06-10T19:02:03.660520+0000","last_fullsized":"2023-06-10T19:02:03.660520+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:39:18.604638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:05.665355+0000","last_change":"2023-06-10T19:02:02.291503+0000","last_active":"2023-06-10T19:02:05.665355+0000","last_peered":"2023-06-10T19:02:05.665355+0000","last_clean":"2023-06-10T19:02:05.665355+0000","last_became_active":"2023-06-10T19:02:02.291257+0000","last_became_peered":"2023-06-10T19:02:02.291257+0000","last_unstale":"2023-06-10T19:02:05.665355+0000","last_undegraded":"2023-06-10T19:02:05.665355+0000","last_fullsized":"2023-06-10T19:02:05.665355+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:51:34.839835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:05.667506+0000","last_change":"2023-06-10T19:02:02.705701+0000","last_active":"2023-06-10T19:02:05.667506+0000","last_peered":"2023-06-10T19:02:05.667506+0000","last_clean":"2023-06-10T19:02:05.667506+0000","last_became_active":"2023-06-10T19:02:02.705382+0000","last_became_peered":"2023-06-10T19:02:02.705382+0000","last_unstale":"2023-06-10T19:02:05.667506+0000","last_undegraded":"2023-06-10T19:02:05.667506+0000","last_fullsized":"2023-06-10T19:02:05.667506+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:28:42.792866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:04.256012+0000","last_change":"2023-06-10T19:02:02.298471+0000","last_active":"2023-06-10T19:02:04.256012+0000","last_peered":"2023-06-10T19:02:04.256012+0000","last_clean":"2023-06-10T19:02:04.256012+0000","last_became_active":"2023-06-10T19:02:02.297847+0000","last_became_peered":"2023-06-10T19:02:02.297847+0000","last_unstale":"2023-06-10T19:02:04.256012+0000","last_undegraded":"2023-06-10T19:02:04.256012+0000","last_fullsized":"2023-06-10T19:02:04.256012+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:49:17.566973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.663631+0000","last_change":"2023-06-10T19:02:02.699437+0000","last_active":"2023-06-10T19:02:03.663631+0000","last_peered":"2023-06-10T19:02:03.663631+0000","last_clean":"2023-06-10T19:02:03.663631+0000","last_became_active":"2023-06-10T19:02:02.698803+0000","last_became_peered":"2023-06-10T19:02:02.698803+0000","last_unstale":"2023-06-10T19:02:03.663631+0000","last_undegraded":"2023-06-10T19:02:03.663631+0000","last_fullsized":"2023-06-10T19:02:03.663631+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:05:16.584207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.665821+0000","last_change":"2023-06-10T19:02:02.293125+0000","last_active":"2023-06-10T19:02:03.665821+0000","last_peered":"2023-06-10T19:02:03.665821+0000","last_clean":"2023-06-10T19:02:03.665821+0000","last_became_active":"2023-06-10T19:02:02.292366+0000","last_became_peered":"2023-06-10T19:02:02.292366+0000","last_unstale":"2023-06-10T19:02:03.665821+0000","last_undegraded":"2023-06-10T19:02:03.665821+0000","last_fullsized":"2023-06-10T19:02:03.665821+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:41:55.619181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:04.256549+0000","last_change":"2023-06-10T19:02:02.718017+0000","last_active":"2023-06-10T19:02:04.256549+0000","last_peered":"2023-06-10T19:02:04.256549+0000","last_clean":"2023-06-10T19:02:04.256549+0000","last_became_active":"2023-06-10T19:02:02.717452+0000","last_became_peered":"2023-06-10T19:02:02.717452+0000","last_unstale":"2023-06-10T19:02:04.256549+0000","last_undegraded":"2023-06-10T19:02:04.256549+0000","last_fullsized":"2023-06-10T19:02:04.256549+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:53:07.798887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:05.666754+0000","last_change":"2023-06-10T19:02:02.286161+0000","last_active":"2023-06-10T19:02:05.666754+0000","last_peered":"2023-06-10T19:02:05.666754+0000","last_clean":"2023-06-10T19:02:05.666754+0000","last_became_active":"2023-06-10T19:02:02.285856+0000","last_became_peered":"2023-06-10T19:02:02.285856+0000","last_unstale":"2023-06-10T19:02:05.666754+0000","last_undegraded":"2023-06-10T19:02:05.666754+0000","last_fullsized":"2023-06-10T19:02:05.666754+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:45:25.753993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:05.666473+0000","last_change":"2023-06-10T19:02:02.665868+0000","last_active":"2023-06-10T19:02:05.666473+0000","last_peered":"2023-06-10T19:02:05.666473+0000","last_clean":"2023-06-10T19:02:05.666473+0000","last_became_active":"2023-06-10T19:02:02.665665+0000","last_became_peered":"2023-06-10T19:02:02.665665+0000","last_unstale":"2023-06-10T19:02:05.666473+0000","last_undegraded":"2023-06-10T19:02:05.666473+0000","last_fullsized":"2023-06-10T19:02:05.666473+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:36:15.427133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"93'3","reported_seq":16,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.664017+0000","last_change":"2023-06-10T19:02:02.294019+0000","last_active":"2023-06-10T19:02:03.664017+0000","last_peered":"2023-06-10T19:02:03.664017+0000","last_clean":"2023-06-10T19:02:03.664017+0000","last_became_active":"2023-06-10T19:02:02.293205+0000","last_became_peered":"2023-06-10T19:02:02.293205+0000","last_unstale":"2023-06-10T19:02:03.664017+0000","last_undegraded":"2023-06-10T19:02:03.664017+0000","last_fullsized":"2023-06-10T19:02:03.664017+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:25:37.472901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:05.667974+0000","last_change":"2023-06-10T19:02:02.680173+0000","last_active":"2023-06-10T19:02:05.667974+0000","last_peered":"2023-06-10T19:02:05.667974+0000","last_clean":"2023-06-10T19:02:05.667974+0000","last_became_active":"2023-06-10T19:02:02.679854+0000","last_became_peered":"2023-06-10T19:02:02.679854+0000","last_unstale":"2023-06-10T19:02:05.667974+0000","last_undegraded":"2023-06-10T19:02:05.667974+0000","last_fullsized":"2023-06-10T19:02:05.667974+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:28:26.086674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"93'6","reported_seq":19,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.660945+0000","last_change":"2023-06-10T19:02:02.310650+0000","last_active":"2023-06-10T19:02:03.660945+0000","last_peered":"2023-06-10T19:02:03.660945+0000","last_clean":"2023-06-10T19:02:03.660945+0000","last_became_active":"2023-06-10T19:02:02.310205+0000","last_became_peered":"2023-06-10T19:02:02.310205+0000","last_unstale":"2023-06-10T19:02:03.660945+0000","last_undegraded":"2023-06-10T19:02:03.660945+0000","last_fullsized":"2023-06-10T19:02:03.660945+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:52:49.212211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:05.666654+0000","last_change":"2023-06-10T19:02:02.697539+0000","last_active":"2023-06-10T19:02:05.666654+0000","last_peered":"2023-06-10T19:02:05.666654+0000","last_clean":"2023-06-10T19:02:05.666654+0000","last_became_active":"2023-06-10T19:02:02.697195+0000","last_became_peered":"2023-06-10T19:02:02.697195+0000","last_unstale":"2023-06-10T19:02:05.666654+0000","last_undegraded":"2023-06-10T19:02:05.666654+0000","last_fullsized":"2023-06-10T19:02:05.666654+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:27:13.039586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"93'2","reported_seq":15,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:04.256623+0000","last_change":"2023-06-10T19:02:02.298494+0000","last_active":"2023-06-10T19:02:04.256623+0000","last_peered":"2023-06-10T19:02:04.256623+0000","last_clean":"2023-06-10T19:02:04.256623+0000","last_became_active":"2023-06-10T19:02:02.298008+0000","last_became_peered":"2023-06-10T19:02:02.298008+0000","last_unstale":"2023-06-10T19:02:04.256623+0000","last_undegraded":"2023-06-10T19:02:04.256623+0000","last_fullsized":"2023-06-10T19:02:04.256623+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:33:47.082911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.662513+0000","last_change":"2023-06-10T19:02:02.706094+0000","last_active":"2023-06-10T19:02:03.662513+0000","last_peered":"2023-06-10T19:02:03.662513+0000","last_clean":"2023-06-10T19:02:03.662513+0000","last_became_active":"2023-06-10T19:02:02.705436+0000","last_became_peered":"2023-06-10T19:02:02.705436+0000","last_unstale":"2023-06-10T19:02:03.662513+0000","last_undegraded":"2023-06-10T19:02:03.662513+0000","last_fullsized":"2023-06-10T19:02:03.662513+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:18:09.563784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.660666+0000","last_change":"2023-06-10T19:02:02.297466+0000","last_active":"2023-06-10T19:02:03.660666+0000","last_peered":"2023-06-10T19:02:03.660666+0000","last_clean":"2023-06-10T19:02:03.660666+0000","last_became_active":"2023-06-10T19:02:02.297118+0000","last_became_peered":"2023-06-10T19:02:02.297118+0000","last_unstale":"2023-06-10T19:02:03.660666+0000","last_undegraded":"2023-06-10T19:02:03.660666+0000","last_fullsized":"2023-06-10T19:02:03.660666+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:10:06.854540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:04.686612+0000","last_change":"2023-06-10T19:02:02.676309+0000","last_active":"2023-06-10T19:02:04.686612+0000","last_peered":"2023-06-10T19:02:04.686612+0000","last_clean":"2023-06-10T19:02:04.686612+0000","last_became_active":"2023-06-10T19:02:02.676005+0000","last_became_peered":"2023-06-10T19:02:02.676005+0000","last_unstale":"2023-06-10T19:02:04.686612+0000","last_undegraded":"2023-06-10T19:02:04.686612+0000","last_fullsized":"2023-06-10T19:02:04.686612+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:42:08.162132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:05.667149+0000","last_change":"2023-06-10T19:02:02.309000+0000","last_active":"2023-06-10T19:02:05.667149+0000","last_peered":"2023-06-10T19:02:05.667149+0000","last_clean":"2023-06-10T19:02:05.667149+0000","last_became_active":"2023-06-10T19:02:02.308410+0000","last_became_peered":"2023-06-10T19:02:02.308410+0000","last_unstale":"2023-06-10T19:02:05.667149+0000","last_undegraded":"2023-06-10T19:02:05.667149+0000","last_fullsized":"2023-06-10T19:02:05.667149+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:04:28.390632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:04.686561+0000","last_change":"2023-06-10T19:02:02.682312+0000","last_active":"2023-06-10T19:02:04.686561+0000","last_peered":"2023-06-10T19:02:04.686561+0000","last_clean":"2023-06-10T19:02:04.686561+0000","last_became_active":"2023-06-10T19:02:02.682008+0000","last_became_peered":"2023-06-10T19:02:02.682008+0000","last_unstale":"2023-06-10T19:02:04.686561+0000","last_undegraded":"2023-06-10T19:02:04.686561+0000","last_fullsized":"2023-06-10T19:02:04.686561+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:19:20.960081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"93'8","reported_seq":21,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:05.666998+0000","last_change":"2023-06-10T19:02:02.281076+0000","last_active":"2023-06-10T19:02:05.666998+0000","last_peered":"2023-06-10T19:02:05.666998+0000","last_clean":"2023-06-10T19:02:05.666998+0000","last_became_active":"2023-06-10T19:02:02.280784+0000","last_became_peered":"2023-06-10T19:02:02.280784+0000","last_unstale":"2023-06-10T19:02:05.666998+0000","last_undegraded":"2023-06-10T19:02:05.666998+0000","last_fullsized":"2023-06-10T19:02:05.666998+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:38:36.110188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:05.664603+0000","last_change":"2023-06-10T19:02:02.709551+0000","last_active":"2023-06-10T19:02:05.664603+0000","last_peered":"2023-06-10T19:02:05.664603+0000","last_clean":"2023-06-10T19:02:05.664603+0000","last_became_active":"2023-06-10T19:02:02.708932+0000","last_became_peered":"2023-06-10T19:02:02.708932+0000","last_unstale":"2023-06-10T19:02:05.664603+0000","last_undegraded":"2023-06-10T19:02:05.664603+0000","last_fullsized":"2023-06-10T19:02:05.664603+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:45:26.757639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"93'2","reported_seq":15,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:04.257010+0000","last_change":"2023-06-10T19:02:02.310148+0000","last_active":"2023-06-10T19:02:04.257010+0000","last_peered":"2023-06-10T19:02:04.257010+0000","last_clean":"2023-06-10T19:02:04.257010+0000","last_became_active":"2023-06-10T19:02:02.309423+0000","last_became_peered":"2023-06-10T19:02:02.309423+0000","last_unstale":"2023-06-10T19:02:04.257010+0000","last_undegraded":"2023-06-10T19:02:04.257010+0000","last_fullsized":"2023-06-10T19:02:04.257010+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:10:24.513111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.661267+0000","last_change":"2023-06-10T19:02:02.685473+0000","last_active":"2023-06-10T19:02:03.661267+0000","last_peered":"2023-06-10T19:02:03.661267+0000","last_clean":"2023-06-10T19:02:03.661267+0000","last_became_active":"2023-06-10T19:02:02.685192+0000","last_became_peered":"2023-06-10T19:02:02.685192+0000","last_unstale":"2023-06-10T19:02:03.661267+0000","last_undegraded":"2023-06-10T19:02:03.661267+0000","last_fullsized":"2023-06-10T19:02:03.661267+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:52:33.909329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"94'1","reported_seq":14,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.664575+0000","last_change":"2023-06-10T19:02:02.292855+0000","last_active":"2023-06-10T19:02:03.664575+0000","last_peered":"2023-06-10T19:02:03.664575+0000","last_clean":"2023-06-10T19:02:03.664575+0000","last_became_active":"2023-06-10T19:02:02.291984+0000","last_became_peered":"2023-06-10T19:02:02.291984+0000","last_unstale":"2023-06-10T19:02:03.664575+0000","last_undegraded":"2023-06-10T19:02:03.664575+0000","last_fullsized":"2023-06-10T19:02:03.664575+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:19:37.942450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.661459+0000","last_change":"2023-06-10T19:02:02.662196+0000","last_active":"2023-06-10T19:02:03.661459+0000","last_peered":"2023-06-10T19:02:03.661459+0000","last_clean":"2023-06-10T19:02:03.661459+0000","last_became_active":"2023-06-10T19:02:02.661887+0000","last_became_peered":"2023-06-10T19:02:02.661887+0000","last_unstale":"2023-06-10T19:02:03.661459+0000","last_undegraded":"2023-06-10T19:02:03.661459+0000","last_fullsized":"2023-06-10T19:02:03.661459+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:43:35.825854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.664678+0000","last_change":"2023-06-10T19:02:02.289260+0000","last_active":"2023-06-10T19:02:03.664678+0000","last_peered":"2023-06-10T19:02:03.664678+0000","last_clean":"2023-06-10T19:02:03.664678+0000","last_became_active":"2023-06-10T19:02:02.288017+0000","last_became_peered":"2023-06-10T19:02:02.288017+0000","last_unstale":"2023-06-10T19:02:03.664678+0000","last_undegraded":"2023-06-10T19:02:03.664678+0000","last_fullsized":"2023-06-10T19:02:03.664678+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:29:27.650735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.665651+0000","last_change":"2023-06-10T19:02:02.686971+0000","last_active":"2023-06-10T19:02:03.665651+0000","last_peered":"2023-06-10T19:02:03.665651+0000","last_clean":"2023-06-10T19:02:03.665651+0000","last_became_active":"2023-06-10T19:02:02.682303+0000","last_became_peered":"2023-06-10T19:02:02.682303+0000","last_unstale":"2023-06-10T19:02:03.665651+0000","last_undegraded":"2023-06-10T19:02:03.665651+0000","last_fullsized":"2023-06-10T19:02:03.665651+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:39:21.732406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:05.664891+0000","last_change":"2023-06-10T19:02:02.307602+0000","last_active":"2023-06-10T19:02:05.664891+0000","last_peered":"2023-06-10T19:02:05.664891+0000","last_clean":"2023-06-10T19:02:05.664891+0000","last_became_active":"2023-06-10T19:02:02.306340+0000","last_became_peered":"2023-06-10T19:02:02.306340+0000","last_unstale":"2023-06-10T19:02:05.664891+0000","last_undegraded":"2023-06-10T19:02:05.664891+0000","last_fullsized":"2023-06-10T19:02:05.664891+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:40:18.378937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:04.686204+0000","last_change":"2023-06-10T19:02:02.670591+0000","last_active":"2023-06-10T19:02:04.686204+0000","last_peered":"2023-06-10T19:02:04.686204+0000","last_clean":"2023-06-10T19:02:04.686204+0000","last_became_active":"2023-06-10T19:02:02.670311+0000","last_became_peered":"2023-06-10T19:02:02.670311+0000","last_unstale":"2023-06-10T19:02:04.686204+0000","last_undegraded":"2023-06-10T19:02:04.686204+0000","last_fullsized":"2023-06-10T19:02:04.686204+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:50:38.457675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.661053+0000","last_change":"2023-06-10T19:02:02.297604+0000","last_active":"2023-06-10T19:02:03.661053+0000","last_peered":"2023-06-10T19:02:03.661053+0000","last_clean":"2023-06-10T19:02:03.661053+0000","last_became_active":"2023-06-10T19:02:02.297290+0000","last_became_peered":"2023-06-10T19:02:02.297290+0000","last_unstale":"2023-06-10T19:02:03.661053+0000","last_undegraded":"2023-06-10T19:02:03.661053+0000","last_fullsized":"2023-06-10T19:02:03.661053+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:28:00.938324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:05.665034+0000","last_change":"2023-06-10T19:02:02.676849+0000","last_active":"2023-06-10T19:02:05.665034+0000","last_peered":"2023-06-10T19:02:05.665034+0000","last_clean":"2023-06-10T19:02:05.665034+0000","last_became_active":"2023-06-10T19:02:02.676586+0000","last_became_peered":"2023-06-10T19:02:02.676586+0000","last_unstale":"2023-06-10T19:02:05.665034+0000","last_undegraded":"2023-06-10T19:02:05.665034+0000","last_fullsized":"2023-06-10T19:02:05.665034+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:43:38.999454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.664972+0000","last_change":"2023-06-10T19:02:02.286569+0000","last_active":"2023-06-10T19:02:03.664972+0000","last_peered":"2023-06-10T19:02:03.664972+0000","last_clean":"2023-06-10T19:02:03.664972+0000","last_became_active":"2023-06-10T19:02:02.285744+0000","last_became_peered":"2023-06-10T19:02:02.285744+0000","last_unstale":"2023-06-10T19:02:03.664972+0000","last_undegraded":"2023-06-10T19:02:03.664972+0000","last_fullsized":"2023-06-10T19:02:03.664972+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:01:54.214990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:05.664127+0000","last_change":"2023-06-10T19:02:02.702760+0000","last_active":"2023-06-10T19:02:05.664127+0000","last_peered":"2023-06-10T19:02:05.664127+0000","last_clean":"2023-06-10T19:02:05.664127+0000","last_became_active":"2023-06-10T19:02:02.702012+0000","last_became_peered":"2023-06-10T19:02:02.702012+0000","last_unstale":"2023-06-10T19:02:05.664127+0000","last_undegraded":"2023-06-10T19:02:05.664127+0000","last_fullsized":"2023-06-10T19:02:05.664127+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:02:31.253313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:05.664647+0000","last_change":"2023-06-10T19:02:02.306818+0000","last_active":"2023-06-10T19:02:05.664647+0000","last_peered":"2023-06-10T19:02:05.664647+0000","last_clean":"2023-06-10T19:02:05.664647+0000","last_became_active":"2023-06-10T19:02:02.306128+0000","last_became_peered":"2023-06-10T19:02:02.306128+0000","last_unstale":"2023-06-10T19:02:05.664647+0000","last_undegraded":"2023-06-10T19:02:05.664647+0000","last_fullsized":"2023-06-10T19:02:05.664647+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:12:17.671209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.660866+0000","last_change":"2023-06-10T19:02:02.671837+0000","last_active":"2023-06-10T19:02:03.660866+0000","last_peered":"2023-06-10T19:02:03.660866+0000","last_clean":"2023-06-10T19:02:03.660866+0000","last_became_active":"2023-06-10T19:02:02.671536+0000","last_became_peered":"2023-06-10T19:02:02.671536+0000","last_unstale":"2023-06-10T19:02:03.660866+0000","last_undegraded":"2023-06-10T19:02:03.660866+0000","last_fullsized":"2023-06-10T19:02:03.660866+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:47:51.626220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:04.256135+0000","last_change":"2023-06-10T19:02:02.299831+0000","last_active":"2023-06-10T19:02:04.256135+0000","last_peered":"2023-06-10T19:02:04.256135+0000","last_clean":"2023-06-10T19:02:04.256135+0000","last_became_active":"2023-06-10T19:02:02.299041+0000","last_became_peered":"2023-06-10T19:02:02.299041+0000","last_unstale":"2023-06-10T19:02:04.256135+0000","last_undegraded":"2023-06-10T19:02:04.256135+0000","last_fullsized":"2023-06-10T19:02:04.256135+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:52:31.657166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:04.256668+0000","last_change":"2023-06-10T19:02:02.708732+0000","last_active":"2023-06-10T19:02:04.256668+0000","last_peered":"2023-06-10T19:02:04.256668+0000","last_clean":"2023-06-10T19:02:04.256668+0000","last_became_active":"2023-06-10T19:02:02.708118+0000","last_became_peered":"2023-06-10T19:02:02.708118+0000","last_unstale":"2023-06-10T19:02:04.256668+0000","last_undegraded":"2023-06-10T19:02:04.256668+0000","last_fullsized":"2023-06-10T19:02:04.256668+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:36:16.278124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:05.668216+0000","last_change":"2023-06-10T19:02:02.286969+0000","last_active":"2023-06-10T19:02:05.668216+0000","last_peered":"2023-06-10T19:02:05.668216+0000","last_clean":"2023-06-10T19:02:05.668216+0000","last_became_active":"2023-06-10T19:02:02.286247+0000","last_became_peered":"2023-06-10T19:02:02.286247+0000","last_unstale":"2023-06-10T19:02:05.668216+0000","last_undegraded":"2023-06-10T19:02:05.668216+0000","last_fullsized":"2023-06-10T19:02:05.668216+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:18:56.742410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":303,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:04.256886+0000","last_change":"2023-06-10T18:52:34.951528+0000","last_active":"2023-06-10T19:02:04.256886+0000","last_peered":"2023-06-10T19:02:04.256886+0000","last_clean":"2023-06-10T19:02:04.256886+0000","last_became_active":"2023-06-10T18:52:34.949099+0000","last_became_peered":"2023-06-10T18:52:34.949099+0000","last_unstale":"2023-06-10T19:02:04.256886+0000","last_undegraded":"2023-06-10T19:02:04.256886+0000","last_fullsized":"2023-06-10T19:02:04.256886+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_clean_scrub_stamp":"2023-06-10T18:52:33.633295+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:08:14.308930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.664988+0000","last_change":"2023-06-10T18:52:40.506384+0000","last_active":"2023-06-10T19:02:03.664988+0000","last_peered":"2023-06-10T19:02:03.664988+0000","last_clean":"2023-06-10T19:02:03.664988+0000","last_became_active":"2023-06-10T18:52:40.505701+0000","last_became_peered":"2023-06-10T18:52:40.505701+0000","last_unstale":"2023-06-10T19:02:03.664988+0000","last_undegraded":"2023-06-10T19:02:03.664988+0000","last_fullsized":"2023-06-10T19:02:03.664988+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:39:04.857423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.660759+0000","last_change":"2023-06-10T19:02:02.680269+0000","last_active":"2023-06-10T19:02:03.660759+0000","last_peered":"2023-06-10T19:02:03.660759+0000","last_clean":"2023-06-10T19:02:03.660759+0000","last_became_active":"2023-06-10T19:02:02.679987+0000","last_became_peered":"2023-06-10T19:02:02.679987+0000","last_unstale":"2023-06-10T19:02:03.660759+0000","last_undegraded":"2023-06-10T19:02:03.660759+0000","last_fullsized":"2023-06-10T19:02:03.660759+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:48:04.181621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"93'1","reported_seq":14,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:05.664885+0000","last_change":"2023-06-10T19:02:02.309267+0000","last_active":"2023-06-10T19:02:05.664885+0000","last_peered":"2023-06-10T19:02:05.664885+0000","last_clean":"2023-06-10T19:02:05.664885+0000","last_became_active":"2023-06-10T19:02:02.308404+0000","last_became_peered":"2023-06-10T19:02:02.308404+0000","last_unstale":"2023-06-10T19:02:05.664885+0000","last_undegraded":"2023-06-10T19:02:05.664885+0000","last_fullsized":"2023-06-10T19:02:05.664885+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:45:10.554362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":147,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:04.256592+0000","last_change":"2023-06-10T18:52:40.512015+0000","last_active":"2023-06-10T19:02:04.256592+0000","last_peered":"2023-06-10T19:02:04.256592+0000","last_clean":"2023-06-10T19:02:04.256592+0000","last_became_active":"2023-06-10T18:52:40.511382+0000","last_became_peered":"2023-06-10T18:52:40.511382+0000","last_unstale":"2023-06-10T19:02:04.256592+0000","last_undegraded":"2023-06-10T19:02:04.256592+0000","last_fullsized":"2023-06-10T19:02:04.256592+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:53:47.802093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:05.664534+0000","last_change":"2023-06-10T19:02:02.702569+0000","last_active":"2023-06-10T19:02:05.664534+0000","last_peered":"2023-06-10T19:02:05.664534+0000","last_clean":"2023-06-10T19:02:05.664534+0000","last_became_active":"2023-06-10T19:02:02.701841+0000","last_became_peered":"2023-06-10T19:02:02.701841+0000","last_unstale":"2023-06-10T19:02:05.664534+0000","last_undegraded":"2023-06-10T19:02:05.664534+0000","last_fullsized":"2023-06-10T19:02:05.664534+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:36:15.427133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"93'2","reported_seq":15,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:04.257116+0000","last_change":"2023-06-10T19:02:02.300090+0000","last_active":"2023-06-10T19:02:04.257116+0000","last_peered":"2023-06-10T19:02:04.257116+0000","last_clean":"2023-06-10T19:02:04.257116+0000","last_became_active":"2023-06-10T19:02:02.299285+0000","last_became_peered":"2023-06-10T19:02:02.299285+0000","last_unstale":"2023-06-10T19:02:04.257116+0000","last_undegraded":"2023-06-10T19:02:04.257116+0000","last_fullsized":"2023-06-10T19:02:04.257116+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:31:27.685608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":153,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:04.686224+0000","last_change":"2023-06-10T18:52:40.671725+0000","last_active":"2023-06-10T19:02:04.686224+0000","last_peered":"2023-06-10T19:02:04.686224+0000","last_clean":"2023-06-10T19:02:04.686224+0000","last_became_active":"2023-06-10T18:52:40.671442+0000","last_became_peered":"2023-06-10T18:52:40.671442+0000","last_unstale":"2023-06-10T19:02:04.686224+0000","last_undegraded":"2023-06-10T19:02:04.686224+0000","last_fullsized":"2023-06-10T19:02:04.686224+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:18:01.434550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.663832+0000","last_change":"2023-06-10T19:02:02.681135+0000","last_active":"2023-06-10T19:02:03.663832+0000","last_peered":"2023-06-10T19:02:03.663832+0000","last_clean":"2023-06-10T19:02:03.663832+0000","last_became_active":"2023-06-10T19:02:02.680233+0000","last_became_peered":"2023-06-10T19:02:02.680233+0000","last_unstale":"2023-06-10T19:02:03.663832+0000","last_undegraded":"2023-06-10T19:02:03.663832+0000","last_fullsized":"2023-06-10T19:02:03.663832+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:12:25.753502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"93'1","reported_seq":14,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.664364+0000","last_change":"2023-06-10T19:02:02.292614+0000","last_active":"2023-06-10T19:02:03.664364+0000","last_peered":"2023-06-10T19:02:03.664364+0000","last_clean":"2023-06-10T19:02:03.664364+0000","last_became_active":"2023-06-10T19:02:02.291916+0000","last_became_peered":"2023-06-10T19:02:02.291916+0000","last_unstale":"2023-06-10T19:02:03.664364+0000","last_undegraded":"2023-06-10T19:02:03.664364+0000","last_fullsized":"2023-06-10T19:02:03.664364+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:10:50.789390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.665282+0000","last_change":"2023-06-10T18:52:40.510258+0000","last_active":"2023-06-10T19:02:03.665282+0000","last_peered":"2023-06-10T19:02:03.665282+0000","last_clean":"2023-06-10T19:02:03.665282+0000","last_became_active":"2023-06-10T18:52:40.509560+0000","last_became_peered":"2023-06-10T18:52:40.509560+0000","last_unstale":"2023-06-10T19:02:03.665282+0000","last_undegraded":"2023-06-10T19:02:03.665282+0000","last_fullsized":"2023-06-10T19:02:03.665282+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:27:31.812949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.660598+0000","last_change":"2023-06-10T19:02:02.663696+0000","last_active":"2023-06-10T19:02:03.660598+0000","last_peered":"2023-06-10T19:02:03.660598+0000","last_clean":"2023-06-10T19:02:03.660598+0000","last_became_active":"2023-06-10T19:02:02.663441+0000","last_became_peered":"2023-06-10T19:02:02.663441+0000","last_unstale":"2023-06-10T19:02:03.660598+0000","last_undegraded":"2023-06-10T19:02:03.660598+0000","last_fullsized":"2023-06-10T19:02:03.660598+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:29:20.330300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"93'2","reported_seq":15,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.664644+0000","last_change":"2023-06-10T19:02:02.286757+0000","last_active":"2023-06-10T19:02:03.664644+0000","last_peered":"2023-06-10T19:02:03.664644+0000","last_clean":"2023-06-10T19:02:03.664644+0000","last_became_active":"2023-06-10T19:02:02.285950+0000","last_became_peered":"2023-06-10T19:02:02.285950+0000","last_unstale":"2023-06-10T19:02:03.664644+0000","last_undegraded":"2023-06-10T19:02:03.664644+0000","last_fullsized":"2023-06-10T19:02:03.664644+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:51:41.019099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:05.668206+0000","last_change":"2023-06-10T18:52:40.672266+0000","last_active":"2023-06-10T19:02:05.668206+0000","last_peered":"2023-06-10T19:02:05.668206+0000","last_clean":"2023-06-10T19:02:05.668206+0000","last_became_active":"2023-06-10T18:52:40.671966+0000","last_became_peered":"2023-06-10T18:52:40.671966+0000","last_unstale":"2023-06-10T19:02:05.668206+0000","last_undegraded":"2023-06-10T19:02:05.668206+0000","last_fullsized":"2023-06-10T19:02:05.668206+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:34:26.323306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.664405+0000","last_change":"2023-06-10T19:02:02.670012+0000","last_active":"2023-06-10T19:02:03.664405+0000","last_peered":"2023-06-10T19:02:03.664405+0000","last_clean":"2023-06-10T19:02:03.664405+0000","last_became_active":"2023-06-10T19:02:02.669278+0000","last_became_peered":"2023-06-10T19:02:02.669278+0000","last_unstale":"2023-06-10T19:02:03.664405+0000","last_undegraded":"2023-06-10T19:02:03.664405+0000","last_fullsized":"2023-06-10T19:02:03.664405+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:49:36.186238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:04.686894+0000","last_change":"2023-06-10T19:02:02.281757+0000","last_active":"2023-06-10T19:02:04.686894+0000","last_peered":"2023-06-10T19:02:04.686894+0000","last_clean":"2023-06-10T19:02:04.686894+0000","last_became_active":"2023-06-10T19:02:02.281378+0000","last_became_peered":"2023-06-10T19:02:02.281378+0000","last_unstale":"2023-06-10T19:02:04.686894+0000","last_undegraded":"2023-06-10T19:02:04.686894+0000","last_fullsized":"2023-06-10T19:02:04.686894+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:25:45.181146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":147,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:04.256880+0000","last_change":"2023-06-10T18:52:40.671084+0000","last_active":"2023-06-10T19:02:04.256880+0000","last_peered":"2023-06-10T19:02:04.256880+0000","last_clean":"2023-06-10T19:02:04.256880+0000","last_became_active":"2023-06-10T18:52:40.670697+0000","last_became_peered":"2023-06-10T18:52:40.670697+0000","last_unstale":"2023-06-10T19:02:04.256880+0000","last_undegraded":"2023-06-10T19:02:04.256880+0000","last_fullsized":"2023-06-10T19:02:04.256880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:59:32.286326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.664638+0000","last_change":"2023-06-10T19:02:02.679941+0000","last_active":"2023-06-10T19:02:03.664638+0000","last_peered":"2023-06-10T19:02:03.664638+0000","last_clean":"2023-06-10T19:02:03.664638+0000","last_became_active":"2023-06-10T19:02:02.679209+0000","last_became_peered":"2023-06-10T19:02:02.679209+0000","last_unstale":"2023-06-10T19:02:03.664638+0000","last_undegraded":"2023-06-10T19:02:03.664638+0000","last_fullsized":"2023-06-10T19:02:03.664638+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:35:54.459085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.664721+0000","last_change":"2023-06-10T19:02:02.288468+0000","last_active":"2023-06-10T19:02:03.664721+0000","last_peered":"2023-06-10T19:02:03.664721+0000","last_clean":"2023-06-10T19:02:03.664721+0000","last_became_active":"2023-06-10T19:02:02.287678+0000","last_became_peered":"2023-06-10T19:02:02.287678+0000","last_unstale":"2023-06-10T19:02:03.664721+0000","last_undegraded":"2023-06-10T19:02:03.664721+0000","last_fullsized":"2023-06-10T19:02:03.664721+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:11:42.794747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:05.667706+0000","last_change":"2023-06-10T18:52:40.514114+0000","last_active":"2023-06-10T19:02:05.667706+0000","last_peered":"2023-06-10T19:02:05.667706+0000","last_clean":"2023-06-10T19:02:05.667706+0000","last_became_active":"2023-06-10T18:52:40.513638+0000","last_became_peered":"2023-06-10T18:52:40.513638+0000","last_unstale":"2023-06-10T19:02:05.667706+0000","last_undegraded":"2023-06-10T19:02:05.667706+0000","last_fullsized":"2023-06-10T19:02:05.667706+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:33:13.935275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:03.660662+0000","last_change":"2023-06-10T19:02:02.661974+0000","last_active":"2023-06-10T19:02:03.660662+0000","last_peered":"2023-06-10T19:02:03.660662+0000","last_clean":"2023-06-10T19:02:03.660662+0000","last_became_active":"2023-06-10T19:02:02.661623+0000","last_became_peered":"2023-06-10T19:02:02.661623+0000","last_unstale":"2023-06-10T19:02:03.660662+0000","last_undegraded":"2023-06-10T19:02:03.660662+0000","last_fullsized":"2023-06-10T19:02:03.660662+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:02.249926+0000","last_clean_scrub_stamp":"2023-06-10T19:02:02.249926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:30:25.061636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:04.686296+0000","last_change":"2023-06-10T19:02:02.294886+0000","last_active":"2023-06-10T19:02:04.686296+0000","last_peered":"2023-06-10T19:02:04.686296+0000","last_clean":"2023-06-10T19:02:04.686296+0000","last_became_active":"2023-06-10T19:02:02.294578+0000","last_became_peered":"2023-06-10T19:02:02.294578+0000","last_unstale":"2023-06-10T19:02:04.686296+0000","last_undegraded":"2023-06-10T19:02:04.686296+0000","last_fullsized":"2023-06-10T19:02:04.686296+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:02:01.246280+0000","last_clean_scrub_stamp":"2023-06-10T19:02:01.246280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:48:03.722713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":147,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-06-10T19:02:05.665070+0000","last_change":"2023-06-10T18:52:40.515396+0000","last_active":"2023-06-10T19:02:05.665070+0000","last_peered":"2023-06-10T19:02:05.665070+0000","last_clean":"2023-06-10T19:02:05.665070+0000","last_became_active":"2023-06-10T18:52:40.514663+0000","last_became_peered":"2023-06-10T18:52:40.514663+0000","last_unstale":"2023-06-10T19:02:05.665070+0000","last_undegraded":"2023-06-10T19:02:05.665070+0000","last_fullsized":"2023-06-10T19:02:05.665070+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:30:23.242897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574966,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32764,"kb_used_data":1716,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339076,"statfs":{"total":96636764160,"available":96603213824,"internally_reserved":0,"allocated":1757184,"data_stored":1116889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.94199999999999995,"15min":0.90300000000000002},"min":{"1min":0.63800000000000001,"5min":0.54700000000000004,"15min":0.434},"max":{"1min":1.196,"5min":1.327,"15min":1.6220000000000001},"last":1.042},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.93000000000000005,"15min":0.92900000000000005},"min":{"1min":0.70999999999999996,"5min":0.496,"15min":0.496},"max":{"1min":1.149,"5min":1.264,"15min":1.6870000000000001},"last":1.2909999999999999}]},{"osd":1,"last update":"Sat Jun 10 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.93200000000000005,"15min":0.92500000000000004},"min":{"1min":0.64700000000000002,"5min":0.54200000000000004,"15min":0.53900000000000003},"max":{"1min":1.238,"5min":1.262,"15min":1.377},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.97299999999999998,"15min":0.93600000000000005},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.504},"max":{"1min":1.1279999999999999,"5min":1.234,"15min":1.5960000000000001},"last":0.93500000000000005}]},{"osd":2,"last update":"Sat Jun 10 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.85599999999999998,"15min":0.83799999999999997},"min":{"1min":0.625,"5min":0.52100000000000002,"15min":0.47099999999999997},"max":{"1min":1.169,"5min":1.169,"15min":1.4059999999999999},"last":1.2450000000000001},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.91100000000000003,"15min":0.90400000000000003},"min":{"1min":0.67900000000000005,"5min":0.53000000000000003,"15min":0.50600000000000001},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.77900000000000003}]},{"osd":3,"last update":"Sat Jun 10 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.93600000000000005,"15min":0.91800000000000004},"min":{"1min":0.71899999999999997,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.502},"last":1.175},{"interface":"front","average":{"1min":1.0229999999999999,"5min":0.97599999999999998,"15min":0.94699999999999995},"min":{"1min":0.80400000000000005,"5min":0.59599999999999997,"15min":0.53800000000000003},"max":{"1min":1.2769999999999999,"5min":1.284,"15min":1.2929999999999999},"last":0.97399999999999998}]},{"osd":4,"last update":"Sat Jun 10 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.83199999999999996,"15min":0.85799999999999998},"min":{"1min":0.629,"5min":0.39500000000000002,"15min":0.32700000000000001},"max":{"1min":1.056,"5min":1.1990000000000001,"15min":1.639},"last":1.079},{"interface":"front","average":{"1min":1.014,"5min":0.97199999999999998,"15min":0.97299999999999998},"min":{"1min":0.67200000000000004,"5min":0.434,"15min":0.40000000000000002},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.454}]},{"osd":5,"last update":"Sat Jun 10 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":0.99199999999999999,"15min":1.016},"min":{"1min":0.73699999999999999,"5min":0.40500000000000003,"15min":0.38400000000000001},"max":{"1min":1.379,"5min":1.395,"15min":1.806},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0389999999999999,"15min":1.0429999999999999},"min":{"1min":0.70399999999999996,"5min":0.505,"15min":0.46500000000000002},"max":{"1min":1.579,"5min":1.579,"15min":1.579},"last":1.393}]},{"osd":6,"last update":"Sat Jun 10 19:01:53 2023","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0069999999999999},"min":{"1min":0.65100000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.391,"5min":1.391,"15min":1.718},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.149,"5min":1.1140000000000001,"15min":1.0960000000000001},"min":{"1min":0.82099999999999995,"5min":0.48799999999999999,"15min":0.441},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":1.3169999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574967,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32196,"kb_used_data":1148,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339644,"statfs":{"total":96636764160,"available":96603795456,"internally_reserved":0,"allocated":1175552,"data_stored":528633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.89700000000000002,"15min":0.84599999999999997},"min":{"1min":0.55000000000000004,"5min":0.52600000000000002,"15min":0.502},"max":{"1min":1.111,"5min":1.476,"15min":1.498},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.89400000000000002,"15min":0.86899999999999999},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46100000000000002},"max":{"1min":1.2250000000000001,"5min":1.496,"15min":1.496},"last":0.79700000000000004}]},{"osd":1,"last update":"Sat Jun 10 19:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.86399999999999999,"15min":0.86199999999999999},"min":{"1min":0.502,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.079,"5min":1.1739999999999999,"15min":1.5229999999999999},"last":0.747},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.90900000000000003,"15min":0.88400000000000001},"min":{"1min":0.61399999999999999,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.1599999999999999,"5min":1.2450000000000001,"15min":1.778},"last":0.93100000000000005}]},{"osd":2,"last update":"Sat Jun 10 19:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91300000000000003,"15min":0.88300000000000001},"min":{"1min":0.748,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.2130000000000001,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":1.006},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.90400000000000003,"15min":0.89200000000000002},"min":{"1min":0.66200000000000003,"5min":0.61299999999999999,"15min":0.57999999999999996},"max":{"1min":1.2330000000000001,"5min":1.246,"15min":1.246},"last":0.98099999999999998}]},{"osd":3,"last update":"Sat Jun 10 19:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.93300000000000005,"15min":0.89200000000000002},"min":{"1min":0.68200000000000005,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0860000000000001,"5min":1.399,"15min":1.7190000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.98199999999999998,"15min":0.99099999999999999},"min":{"1min":0.77300000000000002,"5min":0.72599999999999998,"15min":0.58599999999999997},"max":{"1min":1.2470000000000001,"5min":1.272,"15min":1.4370000000000001},"last":0.95899999999999996}]},{"osd":4,"last update":"Sat Jun 10 19:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.89800000000000002,"15min":0.93000000000000005},"min":{"1min":0.71999999999999997,"5min":0.59799999999999998,"15min":0.56799999999999995},"max":{"1min":1.1719999999999999,"5min":1.4159999999999999,"15min":1.798},"last":1.0269999999999999},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.95799999999999996,"15min":0.996},"min":{"1min":0.64500000000000002,"5min":0.64000000000000001,"15min":0.51300000000000001},"max":{"1min":1.319,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":1.1200000000000001}]},{"osd":5,"last update":"Sat Jun 10 19:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.91100000000000003,"15min":0.93799999999999994},"min":{"1min":0.72099999999999997,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.194,"5min":1.333,"15min":1.333},"last":0.88800000000000001},{"interface":"front","average":{"1min":1.012,"5min":1.02,"15min":1.03},"min":{"1min":0.77800000000000002,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.2210000000000001,"5min":1.405,"15min":2.536},"last":0.83999999999999997}]},{"osd":7,"last update":"Sat Jun 10 19:01:43 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.0169999999999999,"15min":1.036},"min":{"1min":0.82699999999999996,"5min":0.60899999999999999,"15min":0.57099999999999995},"max":{"1min":1.361,"5min":1.48,"15min":1.917},"last":1.073},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.98299999999999998,"15min":1.034},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.278,"5min":1.29,"15min":1.5569999999999999},"last":1.0469999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574967,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32176,"kb_used_data":1128,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339664,"statfs":{"total":96636764160,"available":96603815936,"internally_reserved":0,"allocated":1155072,"data_stored":526465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:01:45 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.91700000000000004,"15min":0.86199999999999999},"min":{"1min":0.58099999999999996,"5min":0.54100000000000004,"15min":0.50600000000000001},"max":{"1min":1.2070000000000001,"5min":1.232,"15min":1.232},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.028,"5min":0.92400000000000004,"15min":0.92700000000000005},"min":{"1min":0.58999999999999997,"5min":0.51400000000000001,"15min":0.49399999999999999},"max":{"1min":2.347,"5min":2.347,"15min":2.347},"last":0.85099999999999998}]},{"osd":1,"last update":"Sat Jun 10 19:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":0.97199999999999998,"15min":0.92800000000000005},"min":{"1min":0.63400000000000001,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":7.0800000000000001,"5min":7.0800000000000001,"15min":7.0800000000000001},"last":1.103},{"interface":"front","average":{"1min":1.9550000000000001,"5min":1.1240000000000001,"15min":0.98799999999999999},"min":{"1min":0.59199999999999997,"5min":0.57699999999999996,"15min":0.53800000000000003},"max":{"1min":15.845000000000001,"5min":15.845000000000001,"15min":15.845000000000001},"last":0.68000000000000005}]},{"osd":2,"last update":"Sat Jun 10 19:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":0.94299999999999995,"15min":0.88100000000000001},"min":{"1min":0.68200000000000005,"5min":0.49299999999999999,"15min":0.48299999999999998},"max":{"1min":5.0049999999999999,"5min":5.0049999999999999,"15min":5.0049999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":1.296,"5min":1.008,"15min":0.94299999999999995},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":6.851,"5min":6.851,"15min":6.851},"last":0.996}]},{"osd":3,"last update":"Sat Jun 10 19:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":0.96399999999999997,"15min":0.95499999999999996},"min":{"1min":0.65900000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.544,"5min":2.544,"15min":2.544},"last":0.58099999999999996},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0029999999999999,"15min":1.0169999999999999},"min":{"1min":0.63100000000000001,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":3.0830000000000002,"5min":3.0830000000000002,"15min":3.0830000000000002},"last":0.91300000000000003}]},{"osd":4,"last update":"Sat Jun 10 19:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":0.95799999999999996,"15min":0.96699999999999997},"min":{"1min":0.66800000000000004,"5min":0.64100000000000001,"15min":0.58099999999999996},"max":{"1min":6.7290000000000001,"5min":6.7290000000000001,"15min":6.7290000000000001},"last":0.874},{"interface":"front","average":{"1min":1.0369999999999999,"5min":0.98199999999999998,"15min":1.0269999999999999},"min":{"1min":0.68300000000000005,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.278,"5min":1.341,"15min":1.575},"last":0.80000000000000004}]},{"osd":6,"last update":"Sat Jun 10 19:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":0.98199999999999998,"15min":1.03},"min":{"1min":0.65300000000000002,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.3029999999999999,"5min":1.3660000000000001,"15min":1.4330000000000001},"last":1.071},{"interface":"front","average":{"1min":1.373,"5min":1.093,"15min":1.073},"min":{"1min":0.81499999999999995,"5min":0.66500000000000004,"15min":0.57899999999999996},"max":{"1min":6.923,"5min":6.923,"15min":6.923},"last":1.0580000000000001}]},{"osd":7,"last update":"Sat Jun 10 19:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.0629999999999999,"15min":1.1259999999999999},"min":{"1min":0.81399999999999995,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":2.6080000000000001,"5min":2.6080000000000001,"15min":2.6080000000000001},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.4319999999999999,"5min":1.157,"15min":1.1619999999999999},"min":{"1min":0.95299999999999996,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":5.4169999999999998,"5min":5.4169999999999998,"15min":5.4169999999999998},"last":0.96999999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574966,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32184,"kb_used_data":1136,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339656,"statfs":{"total":96636764160,"available":96603807744,"internally_reserved":0,"allocated":1163264,"data_stored":526625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.872,"15min":0.79800000000000004},"min":{"1min":0.49199999999999999,"5min":0.48599999999999999,"15min":0.45100000000000001},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.91900000000000004,"15min":0.89800000000000002},"min":{"1min":0.58399999999999996,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0580000000000001,"5min":3.7280000000000002,"15min":3.7280000000000002},"last":1.018}]},{"osd":1,"last update":"Sat Jun 10 19:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.93500000000000005,"15min":0.94599999999999995},"min":{"1min":0.63100000000000001,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1200000000000001,"5min":3.3969999999999998,"15min":3.3969999999999998},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.90100000000000002,"15min":0.86199999999999999},"min":{"1min":0.66100000000000003,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.1679999999999999,"5min":2.496,"15min":2.496},"last":0.95599999999999996}]},{"osd":2,"last update":"Sat Jun 10 19:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.90200000000000002,"15min":0.88400000000000001},"min":{"1min":0.56799999999999995,"5min":0.51300000000000001,"15min":0.49299999999999999},"max":{"1min":1.3,"5min":1.3,"15min":1.522},"last":0.52200000000000002},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.006,"15min":1},"min":{"1min":0.74099999999999999,"5min":0.57799999999999996,"15min":0.55000000000000004},"max":{"1min":1.204,"5min":3.5750000000000002,"15min":3.5750000000000002},"last":0.73999999999999999}]},{"osd":3,"last update":"Sat Jun 10 19:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.91700000000000004,"15min":0.89600000000000002},"min":{"1min":0.71599999999999997,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.2909999999999999,"5min":2.3809999999999998,"15min":2.3809999999999998},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.97199999999999998,"15min":0.96399999999999997},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.54400000000000004},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.6479999999999999},"last":0.78400000000000003}]},{"osd":5,"last update":"Sat Jun 10 19:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.96899999999999997,"15min":0.97599999999999998},"min":{"1min":0.68700000000000006,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.1459999999999999,"5min":3.6539999999999999,"15min":3.6539999999999999},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.94599999999999995,"15min":0.96499999999999997},"min":{"1min":0.68400000000000005,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.204,"5min":2.6720000000000002,"15min":2.6720000000000002},"last":0.90400000000000003}]},{"osd":6,"last update":"Sat Jun 10 19:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.93999999999999995,"15min":0.98999999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.54900000000000004},"max":{"1min":1.276,"5min":1.3149999999999999,"15min":2.2639999999999998},"last":0.87},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0549999999999999,"15min":1.0660000000000001},"min":{"1min":0.76500000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.3200000000000001,"5min":3.4980000000000002,"15min":3.4980000000000002},"last":1.077}]},{"osd":7,"last update":"Sat Jun 10 19:01:59 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":0.999,"15min":0.99399999999999999},"min":{"1min":0.72499999999999998,"5min":0.66300000000000003,"15min":0.41399999999999998},"max":{"1min":1.3360000000000001,"5min":2.5910000000000002,"15min":2.5910000000000002},"last":0.66100000000000003},{"interface":"front","average":{"1min":1.083,"5min":1.0660000000000001,"15min":1.069},"min":{"1min":0.68100000000000005,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.3740000000000001,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.98099999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574965,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32172,"kb_used_data":1124,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339668,"statfs":{"total":96636764160,"available":96603820032,"internally_reserved":0,"allocated":1150976,"data_stored":525446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.627,"15min":0.59899999999999998},"min":{"1min":0.44600000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.88300000000000001,"5min":1.01,"15min":1.169},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.68100000000000005,"15min":0.65400000000000003},"min":{"1min":0.45300000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.96699999999999997,"5min":1.1679999999999999,"15min":1.286},"last":0.57599999999999996}]},{"osd":1,"last update":"Sat Jun 10 19:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.68300000000000005,"15min":0.65600000000000003},"min":{"1min":0.501,"5min":0.34300000000000003,"15min":0.27500000000000002},"max":{"1min":0.94299999999999995,"5min":1.2569999999999999,"15min":1.2729999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.74399999999999999,"15min":0.73299999999999998},"min":{"1min":0.42999999999999999,"5min":0.33000000000000002,"15min":0.318},"max":{"1min":1.0449999999999999,"5min":1.296,"15min":1.411},"last":0.73199999999999998}]},{"osd":2,"last update":"Sat Jun 10 19:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.78500000000000003,"15min":0.76800000000000002},"min":{"1min":0.49199999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.018,"5min":1.3899999999999999,"15min":1.9530000000000001},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.80100000000000005,"15min":0.76700000000000002},"min":{"1min":0.58399999999999996,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.125,"5min":1.278,"15min":1.278},"last":0.70299999999999996}]},{"osd":4,"last update":"Sat Jun 10 19:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.93899999999999995,"15min":0.95499999999999996},"min":{"1min":0.69899999999999995,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.1899999999999999,"5min":1.488,"15min":1.488},"last":1.073},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.98399999999999999,"15min":0.98999999999999999},"min":{"1min":0.68700000000000006,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.3069999999999999,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":1.1890000000000001}]},{"osd":5,"last update":"Sat Jun 10 19:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.008,"15min":1.0349999999999999},"min":{"1min":0.64200000000000002,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.2030000000000001,"5min":1.425,"15min":2.024},"last":0.997},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.014,"15min":1.0229999999999999},"min":{"1min":0.72099999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.3220000000000001,"5min":1.5069999999999999,"15min":1.724},"last":1.097}]},{"osd":6,"last update":"Sat Jun 10 19:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.0600000000000001,"15min":1.0580000000000001},"min":{"1min":0.79600000000000004,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.3600000000000001,"5min":1.597,"15min":1.8500000000000001},"last":1.143},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.0509999999999999,"15min":1.0649999999999999},"min":{"1min":0.73499999999999999,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.3380000000000001,"5min":1.4590000000000001,"15min":1.78},"last":1.022}]},{"osd":7,"last update":"Sat Jun 10 19:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.0820000000000001,"15min":1.1100000000000001},"min":{"1min":0.75,"5min":0.60999999999999999,"15min":0.56999999999999995},"max":{"1min":1.373,"5min":1.444,"15min":1.9079999999999999},"last":1.123},{"interface":"front","average":{"1min":1.093,"5min":1.105,"15min":1.0900000000000001},"min":{"1min":0.72099999999999997,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.399,"5min":1.651,"15min":1.6719999999999999},"last":1.2589999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574966,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32176,"kb_used_data":1128,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339664,"statfs":{"total":96636764160,"available":96603815936,"internally_reserved":0,"allocated":1155072,"data_stored":526465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:01:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.628,"15min":0.60499999999999998},"min":{"1min":0.31,"5min":0.28899999999999998,"15min":0.27300000000000002},"max":{"1min":1.095,"5min":1.095,"15min":1.1220000000000001},"last":0.503},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.72899999999999998,"15min":0.72199999999999998},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.0209999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.89800000000000002}]},{"osd":1,"last update":"Sat Jun 10 19:01:52 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.67500000000000004,"15min":0.66100000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.307},"max":{"1min":0.98199999999999998,"5min":1.099,"15min":1.1950000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.78100000000000003,"15min":0.73599999999999999},"min":{"1min":0.36699999999999999,"5min":0.33300000000000002,"15min":0.29499999999999998},"max":{"1min":1.0109999999999999,"5min":1.446,"15min":1.446},"last":0.80200000000000005}]},{"osd":3,"last update":"Sat Jun 10 19:01:52 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.80000000000000004,"15min":0.746},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.1599999999999999,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.80400000000000005,"15min":0.77100000000000002},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.252},"max":{"1min":0.999,"5min":1.1459999999999999,"15min":1.3340000000000001},"last":0.73599999999999999}]},{"osd":4,"last update":"Sat Jun 10 19:01:52 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.93500000000000005,"15min":0.92400000000000004},"min":{"1min":0.624,"5min":0.56200000000000006,"15min":0.53400000000000003},"max":{"1min":1.228,"5min":1.228,"15min":1.3620000000000001},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.998,"5min":1.0049999999999999,"15min":1.0269999999999999},"min":{"1min":0.753,"5min":0.60899999999999999,"15min":0.57699999999999996},"max":{"1min":1.486,"5min":1.486,"15min":1.4950000000000001},"last":0.97599999999999998}]},{"osd":5,"last update":"Sat Jun 10 19:01:52 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.008,"15min":1.018},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.54100000000000004},"max":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":1.5700000000000001},"last":1.119},{"interface":"front","average":{"1min":0.98699999999999999,"5min":1.0189999999999999,"15min":1.002},"min":{"1min":0.71999999999999997,"5min":0.66000000000000003,"15min":0.60099999999999998},"max":{"1min":1.2669999999999999,"5min":1.381,"15min":1.667},"last":1.0940000000000001}]},{"osd":6,"last update":"Sat Jun 10 19:01:52 2023","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.044,"15min":1.0389999999999999},"min":{"1min":0.67400000000000004,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.304,"5min":1.4259999999999999,"15min":1.5900000000000001},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.038,"5min":1.05,"15min":1.044},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.2989999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.85599999999999998}]},{"osd":7,"last update":"Sat Jun 10 19:01:52 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.0880000000000001,"15min":1.0980000000000001},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.4319999999999999,"5min":1.724,"15min":1.724},"last":1.3460000000000001},{"interface":"front","average":{"1min":1.085,"5min":1.1080000000000001,"15min":1.0980000000000001},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.59299999999999997},"max":{"1min":1.363,"5min":1.51,"15min":1.752},"last":1.236}]}]},{"osd":1,"up_from":13,"seq":55834574968,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32176,"kb_used_data":1128,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339664,"statfs":{"total":96636764160,"available":96603815936,"internally_reserved":0,"allocated":1155072,"data_stored":525516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:01:54 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.71699999999999997,"15min":0.68000000000000005},"min":{"1min":0.46500000000000002,"5min":0.28599999999999998,"15min":0.25800000000000001},"max":{"1min":1.111,"5min":1.1459999999999999,"15min":1.288},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79000000000000004,"15min":0.72899999999999998},"min":{"1min":0.41899999999999998,"5min":0.32800000000000001,"15min":0.26900000000000002},"max":{"1min":0.98099999999999998,"5min":1.056,"15min":1.694},"last":0.69199999999999995}]},{"osd":2,"last update":"Sat Jun 10 19:01:54 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.65700000000000003,"15min":0.63400000000000001},"min":{"1min":0.39200000000000002,"5min":0.308,"15min":0.249},"max":{"1min":0.93999999999999995,"5min":1.0740000000000001,"15min":1.21},"last":1.0329999999999999},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.754,"15min":0.70299999999999996},"min":{"1min":0.48599999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.0600000000000001,"5min":1.194,"15min":1.415},"last":0.54000000000000004}]},{"osd":3,"last update":"Sat Jun 10 19:01:54 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.80700000000000005,"15min":0.77600000000000002},"min":{"1min":0.58599999999999997,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.1679999999999999,"5min":1.3049999999999999,"15min":1.6299999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.75900000000000001,"15min":0.752},"min":{"1min":0.47199999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":2.1749999999999998},"last":0.58899999999999997}]},{"osd":4,"last update":"Sat Jun 10 19:01:54 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.878,"15min":0.85699999999999998},"min":{"1min":0.67400000000000004,"5min":0.58699999999999997,"15min":0.53000000000000003},"max":{"1min":1.343,"5min":1.343,"15min":1.4930000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.022,"15min":1.0600000000000001},"min":{"1min":0.71299999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.2569999999999999,"5min":1.5129999999999999,"15min":5.8209999999999997},"last":0.89400000000000002}]},{"osd":5,"last update":"Sat Jun 10 19:01:54 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.006,"15min":1.0169999999999999},"min":{"1min":0.60899999999999999,"5min":0.57699999999999996,"15min":0.56599999999999995},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.8620000000000001},"last":0.91500000000000004},{"interface":"front","average":{"1min":1.018,"5min":0.997,"15min":0.98299999999999998},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.3069999999999999,"5min":1.3089999999999999,"15min":3.089},"last":1.1040000000000001}]},{"osd":6,"last update":"Sat Jun 10 19:01:54 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.0660000000000001,"15min":1.0549999999999999},"min":{"1min":0.73699999999999999,"5min":0.64100000000000001,"15min":0.56200000000000006},"max":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":7.2599999999999998},"last":0.78100000000000003},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0389999999999999,"15min":1.042},"min":{"1min":0.73599999999999999,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":9.0069999999999997},"last":0.95299999999999996}]},{"osd":7,"last update":"Sat Jun 10 19:01:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.113,"15min":1.0940000000000001},"min":{"1min":0.92400000000000004,"5min":0.495,"15min":0.495},"max":{"1min":1.494,"5min":1.573,"15min":2.105},"last":0.93899999999999995},{"interface":"front","average":{"1min":1.089,"5min":1.1180000000000001,"15min":1.087},"min":{"1min":0.63700000000000001,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.5620000000000001,"5min":1.6399999999999999,"15min":2.2570000000000001},"last":0.98399999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574967,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32776,"kb_used_data":1728,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339064,"statfs":{"total":96636764160,"available":96603201536,"internally_reserved":0,"allocated":1769472,"data_stored":1118084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jun 10 19:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.65500000000000003,"15min":0.624},"min":{"1min":0.34799999999999998,"5min":0.248,"15min":0.248},"max":{"1min":1.077,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.82899999999999996,"15min":0.78200000000000003},"min":{"1min":0.38600000000000001,"5min":0.34100000000000003,"15min":0.34000000000000002},"max":{"1min":1.1559999999999999,"5min":1.302,"15min":1.4059999999999999},"last":0.87}]},{"osd":2,"last update":"Sat Jun 10 19:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.71399999999999997,"15min":0.70599999999999996},"min":{"1min":0.33500000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.149,"5min":1.149,"15min":1.2829999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66600000000000004,"15min":0.64700000000000002},"min":{"1min":0.318,"5min":0.245,"15min":0.245},"max":{"1min":0.88900000000000001,"5min":1.139,"15min":1.371},"last":0.63}]},{"osd":3,"last update":"Sat Jun 10 19:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.67300000000000004,"15min":0.67900000000000005},"min":{"1min":0.30299999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.96199999999999997,"5min":1.222,"15min":1.226},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.80400000000000005,"15min":0.81499999999999995},"min":{"1min":0.41999999999999998,"5min":0.317,"15min":0.317},"max":{"1min":1.083,"5min":1.2549999999999999,"15min":1.829},"last":0.54900000000000004}]},{"osd":4,"last update":"Sat Jun 10 19:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.94099999999999995,"15min":0.91200000000000003},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1990000000000001,"5min":3.0209999999999999,"15min":3.0209999999999999},"last":1.0009999999999999},{"interface":"front","average":{"1min":0.998,"5min":1.016,"15min":1.028},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.228,"5min":1.3819999999999999,"15min":1.9510000000000001},"last":0.80500000000000005}]},{"osd":5,"last update":"Sat Jun 10 19:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.92400000000000004,"15min":0.94599999999999995},"min":{"1min":0.64700000000000002,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.095,"5min":1.2529999999999999,"15min":1.694},"last":0.69899999999999995},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.024,"15min":1.01},"min":{"1min":0.58099999999999996,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.391,"5min":4.5620000000000003,"15min":4.5620000000000003},"last":0.93899999999999995}]},{"osd":6,"last update":"Sat Jun 10 19:01:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0940000000000001,"15min":1.0720000000000001},"min":{"1min":0.61899999999999999,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.423,"5min":3.5569999999999999,"15min":3.5569999999999999},"last":0.92600000000000005},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.012,"15min":1.004},"min":{"1min":0.67100000000000004,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.26,"5min":1.625,"15min":1.883},"last":0.90800000000000003}]},{"osd":7,"last update":"Sat Jun 10 19:01:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0309999999999999,"15min":1.0349999999999999},"min":{"1min":0.69199999999999995,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.349,"5min":1.4850000000000001,"15min":1.5800000000000001},"last":0.79200000000000004},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.63,"5min":0.61099999999999999,"15min":0.58699999999999997},"max":{"1min":1.4179999999999999,"5min":1.425,"15min":1.9830000000000001},"last":1.048}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-10T19:02:11.609 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-06-10T19:02:11.610 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-06-10T19:02:11.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.775+0000 7f297de25640 1 Processor -- start 2023-06-10T19:02:11.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.775+0000 7f297de25640 1 -- start start 2023-06-10T19:02:11.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.775+0000 7f297de25640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f29781508d0 0x7f297806bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:11.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.775+0000 7f297de25640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f29780b1130 0x7f29780cb5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:11.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.775+0000 7f297de25640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f297815e250 con 0x7f29780cb1a0 2023-06-10T19:02:11.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.775+0000 7f297de25640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f297815d430 con 0x7f29780b1130 2023-06-10T19:02:11.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.775+0000 7f297de25640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29780cfaf0 con 0x7f29781508d0 2023-06-10T19:02:11.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.779+0000 7f2977fff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f29780b1130 0x7f29780cb5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:11.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.779+0000 7f29777fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f29781508d0 0x7f297806bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:11.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.779+0000 7f2977fff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f29780b1130 0x7f29780cb5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.53:55442/0 (socket says 172.21.15.53:55442) 2023-06-10T19:02:11.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.779+0000 7f2977fff640 1 -- 172.21.15.53:0/2616735450 learned_addr learned my addr 172.21.15.53:0/2616735450 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:11.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.779+0000 7f29777fe640 1 -- 172.21.15.53:0/2616735450 >> v2:172.21.15.117:3300/0 conn(0x7f29780b1130 msgr2=0x7f29780cb5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:11.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.779+0000 7f29777fe640 1 --2- 172.21.15.53:0/2616735450 >> v2:172.21.15.117:3300/0 conn(0x7f29780b1130 0x7f29780cb5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:11.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.779+0000 7f29777fe640 1 -- 172.21.15.53:0/2616735450 >> v1:172.21.15.117:6789/0 conn(0x7f29780cb1a0 legacy=0x7f29780b0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:11.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.779+0000 7f29777fe640 1 -- 172.21.15.53:0/2616735450 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f297815d640 con 0x7f29781508d0 2023-06-10T19:02:11.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.779+0000 7f2977fff640 1 --2- 172.21.15.53:0/2616735450 >> v2:172.21.15.117:3300/0 conn(0x7f29780b1130 0x7f29780cb5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-10T19:02:11.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.779+0000 7f29777fe640 1 --2- 172.21.15.53:0/2616735450 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f29781508d0 0x7f297806bf10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2968009d90 tx=0x7f296801c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff80bce43be35fc5 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:11.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.779+0000 7f29767fc640 1 -- 172.21.15.53:0/2616735450 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29680a5900 con 0x7f29781508d0 2023-06-10T19:02:11.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.779+0000 7f29767fc640 1 -- 172.21.15.53:0/2616735450 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29680a5a60 con 0x7f29781508d0 2023-06-10T19:02:11.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.779+0000 7f29767fc640 1 -- 172.21.15.53:0/2616735450 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29680a5df0 con 0x7f29781508d0 2023-06-10T19:02:11.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.783+0000 7f297de25640 1 -- 172.21.15.53:0/2616735450 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f29781508d0 msgr2=0x7f297806bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:11.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.783+0000 7f297de25640 1 --2- 172.21.15.53:0/2616735450 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f29781508d0 0x7f297806bf10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2968009d90 tx=0x7f296801c950 comp rx=0 tx=0).stop 2023-06-10T19:02:11.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.783+0000 7f297de25640 1 -- 172.21.15.53:0/2616735450 shutdown_connections 2023-06-10T19:02:11.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.783+0000 7f297de25640 1 --2- 172.21.15.53:0/2616735450 >> v2:172.21.15.117:3300/0 conn(0x7f29780b1130 0x7f29780cb5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:11.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.783+0000 7f297de25640 1 --2- 172.21.15.53:0/2616735450 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f29781508d0 0x7f297806bf10 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:11.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.783+0000 7f297de25640 1 -- 172.21.15.53:0/2616735450 >> 172.21.15.53:0/2616735450 conn(0x7f29780b42b0 msgr2=0x7f29780b46b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:11.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.783+0000 7f297de25640 1 -- 172.21.15.53:0/2616735450 shutdown_connections 2023-06-10T19:02:11.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.783+0000 7f297de25640 1 -- 172.21.15.53:0/2616735450 wait complete. 2023-06-10T19:02:11.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.783+0000 7f297de25640 1 Processor -- start 2023-06-10T19:02:11.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.783+0000 7f297de25640 1 -- start start 2023-06-10T19:02:11.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.783+0000 7f297de25640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29780b1130 0x7f297813f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:11.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.783+0000 7f297de25640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f29780cb1a0 0x7f29780b0550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:11.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.783+0000 7f297de25640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29781508d0 0x7f297814cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:11.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.783+0000 7f297de25640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f297813f7c0 con 0x7f29780b1130 2023-06-10T19:02:11.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.783+0000 7f297de25640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29780b0a90 con 0x7f29781508d0 2023-06-10T19:02:11.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.783+0000 7f297de25640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f297814ed80 con 0x7f29780cb1a0 2023-06-10T19:02:11.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.783+0000 7f29777fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29780b1130 0x7f297813f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:11.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.783+0000 7f29777fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29780b1130 0x7f297813f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40644/0 (socket says 172.21.15.53:40644) 2023-06-10T19:02:11.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.783+0000 7f29777fe640 1 -- 172.21.15.53:0/992857783 learned_addr learned my addr 172.21.15.53:0/992857783 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:11.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.783+0000 7f2977fff640 1 --2- 172.21.15.53:0/992857783 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29781508d0 0x7f297814cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:11.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.783+0000 7f2976ffd640 1 --2- 172.21.15.53:0/992857783 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f29780cb1a0 0x7f29780b0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:11.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.783+0000 7f29777fe640 1 -- 172.21.15.53:0/992857783 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f29780cb1a0 msgr2=0x7f29780b0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:11.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.783+0000 7f29777fe640 1 --2- 172.21.15.53:0/992857783 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f29780cb1a0 0x7f29780b0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:11.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.783+0000 7f29777fe640 1 -- 172.21.15.53:0/992857783 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29781508d0 msgr2=0x7f297814cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:11.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.783+0000 7f29777fe640 1 --2- 172.21.15.53:0/992857783 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29781508d0 0x7f297814cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:11.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.783+0000 7f29777fe640 1 -- 172.21.15.53:0/992857783 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29700094d0 con 0x7f29780b1130 2023-06-10T19:02:11.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.783+0000 7f2977fff640 1 --2- 172.21.15.53:0/992857783 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29781508d0 0x7f297814cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:02:11.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.783+0000 7f29777fe640 1 --2- 172.21.15.53:0/992857783 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29780b1130 0x7f297813f280 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f296801a580 tx=0x7f29680196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:11.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.783+0000 7f295ffff640 1 -- 172.21.15.53:0/992857783 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29680ad850 con 0x7f29780b1130 2023-06-10T19:02:11.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.783+0000 7f295ffff640 1 -- 172.21.15.53:0/992857783 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29680a58f0 con 0x7f29780b1130 2023-06-10T19:02:11.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.783+0000 7f297de25640 1 -- 172.21.15.53:0/992857783 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2968009a70 con 0x7f29780b1130 2023-06-10T19:02:11.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.783+0000 7f295ffff640 1 -- 172.21.15.53:0/992857783 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29680adbd0 con 0x7f29780b1130 2023-06-10T19:02:11.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.783+0000 7f297de25640 1 -- 172.21.15.53:0/992857783 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f297815bfd0 con 0x7f29780b1130 2023-06-10T19:02:11.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.787+0000 7f297de25640 1 -- 172.21.15.53:0/992857783 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f297814d6a0 con 0x7f29780b1130 2023-06-10T19:02:11.791 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.787+0000 7f295ffff640 1 -- 172.21.15.53:0/992857783 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f29680b4050 con 0x7f29780b1130 2023-06-10T19:02:11.791 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.787+0000 7f295ffff640 1 --2- 172.21.15.53:0/992857783 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2964066280 0x7f2964068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:11.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.787+0000 7f295ffff640 1 -- 172.21.15.53:0/992857783 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f296811ea90 con 0x7f29780b1130 2023-06-10T19:02:11.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.787+0000 7f2976ffd640 1 --2- 172.21.15.53:0/992857783 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2964066280 0x7f2964068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:11.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.787+0000 7f2976ffd640 1 --2- 172.21.15.53:0/992857783 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2964066280 0x7f2964068730 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f2978164790 tx=0x7f296c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:11.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.791+0000 7f295ffff640 1 -- 172.21.15.53:0/992857783 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f29680ec030 con 0x7f29780b1130 2023-06-10T19:02:11.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.991+0000 7f297de25640 1 -- 172.21.15.53:0/992857783 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f297804d790 con 0x7f29780b1130 2023-06-10T19:02:12.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.999+0000 7f295ffff640 1 -- 172.21.15.53:0/992857783 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) v1 ==== 190+0+0 (secure 0 0 0) 0x7f29680b20e0 con 0x7f29780b1130 2023-06-10T19:02:12.001 INFO:teuthology.orchestra.run.smithi053.stderr:updated caps for client.0 2023-06-10T19:02:12.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.999+0000 7f297de25640 1 -- 172.21.15.53:0/992857783 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2964066280 msgr2=0x7f2964068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:12.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.999+0000 7f297de25640 1 --2- 172.21.15.53:0/992857783 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2964066280 0x7f2964068730 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f2978164790 tx=0x7f296c009040 comp rx=0 tx=0).stop 2023-06-10T19:02:12.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.999+0000 7f297de25640 1 -- 172.21.15.53:0/992857783 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29780b1130 msgr2=0x7f297813f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:12.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:11.999+0000 7f297de25640 1 --2- 172.21.15.53:0/992857783 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29780b1130 0x7f297813f280 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f296801a580 tx=0x7f29680196f0 comp rx=0 tx=0).stop 2023-06-10T19:02:12.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.003+0000 7f297de25640 1 -- 172.21.15.53:0/992857783 shutdown_connections 2023-06-10T19:02:12.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.003+0000 7f297de25640 1 --2- 172.21.15.53:0/992857783 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2964066280 0x7f2964068730 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:12.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.003+0000 7f297de25640 1 --2- 172.21.15.53:0/992857783 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29781508d0 0x7f297814cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:12.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.003+0000 7f297de25640 1 --2- 172.21.15.53:0/992857783 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f29780cb1a0 0x7f29780b0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:12.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.003+0000 7f297de25640 1 --2- 172.21.15.53:0/992857783 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f29780b1130 0x7f297813f280 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:12.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.003+0000 7f297de25640 1 -- 172.21.15.53:0/992857783 >> 172.21.15.53:0/992857783 conn(0x7f29780b42b0 msgr2=0x7f2978070870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:12.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.003+0000 7f297de25640 1 -- 172.21.15.53:0/992857783 shutdown_connections 2023-06-10T19:02:12.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.003+0000 7f297de25640 1 -- 172.21.15.53:0/992857783 wait complete. 2023-06-10T19:02:12.019 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:02:12.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.139+0000 7fae1e337640 1 Processor -- start 2023-06-10T19:02:12.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.143+0000 7fae1e337640 1 -- start start 2023-06-10T19:02:12.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.143+0000 7fae1e337640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fae180b3ac0 0x7fae180b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:12.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.143+0000 7fae1e337640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fae180cc690 0x7fae1815f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:12.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.143+0000 7fae1e337640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae180ccae0 0x7fae1815f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:12.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.143+0000 7fae1e337640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae180d0020 con 0x7fae180cc690 2023-06-10T19:02:12.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.143+0000 7fae1e337640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae180b43d0 con 0x7fae180b3ac0 2023-06-10T19:02:12.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.143+0000 7fae1e337640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae180cef40 con 0x7fae180ccae0 2023-06-10T19:02:12.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.143+0000 7fae177fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fae180cc690 0x7fae1815f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:12.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.143+0000 7fae177fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fae180cc690 0x7fae1815f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40650/0 (socket says 172.21.15.53:40650) 2023-06-10T19:02:12.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.143+0000 7fae177fe640 1 -- 172.21.15.53:0/3658230456 learned_addr learned my addr 172.21.15.53:0/3658230456 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:12.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.143+0000 7fae17fff640 1 --2- 172.21.15.53:0/3658230456 >> v2:172.21.15.117:3300/0 conn(0x7fae180b3ac0 0x7fae180b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:12.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.143+0000 7fae1c8d4640 1 --2- 172.21.15.53:0/3658230456 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae180ccae0 0x7fae1815f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:12.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.143+0000 7fae177fe640 1 -- 172.21.15.53:0/3658230456 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae180ccae0 msgr2=0x7fae1815f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:12.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.143+0000 7fae177fe640 1 --2- 172.21.15.53:0/3658230456 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae180ccae0 0x7fae1815f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:12.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.143+0000 7fae177fe640 1 -- 172.21.15.53:0/3658230456 >> v2:172.21.15.117:3300/0 conn(0x7fae180b3ac0 msgr2=0x7fae180b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:12.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.143+0000 7fae177fe640 1 --2- 172.21.15.53:0/3658230456 >> v2:172.21.15.117:3300/0 conn(0x7fae180b3ac0 0x7fae180b3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:12.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.143+0000 7fae177fe640 1 -- 172.21.15.53:0/3658230456 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae180cf220 con 0x7fae180cc690 2023-06-10T19:02:12.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.143+0000 7fae17fff640 1 --2- 172.21.15.53:0/3658230456 >> v2:172.21.15.117:3300/0 conn(0x7fae180b3ac0 0x7fae180b3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:02:12.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.147+0000 7fae177fe640 1 --2- 172.21.15.53:0/3658230456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae180cc690 0x7fae1815f370 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7fae180b4ba0 tx=0x7fae0c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f6c6890aed8df36 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:12.150 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.147+0000 7fae16ffd640 1 -- 172.21.15.53:0/3658230456 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0c0ac600 con 0x7fae180cc690 2023-06-10T19:02:12.150 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.147+0000 7fae16ffd640 1 -- 172.21.15.53:0/3658230456 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae0c0a8050 con 0x7fae180cc690 2023-06-10T19:02:12.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.147+0000 7fae16ffd640 1 -- 172.21.15.53:0/3658230456 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0c0ac980 con 0x7fae180cc690 2023-06-10T19:02:12.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.147+0000 7fae1e337640 1 -- 172.21.15.53:0/3658230456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae180cc690 msgr2=0x7fae1815f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:12.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.147+0000 7fae1e337640 1 --2- 172.21.15.53:0/3658230456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae180cc690 0x7fae1815f370 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7fae180b4ba0 tx=0x7fae0c01c4d0 comp rx=0 tx=0).stop 2023-06-10T19:02:12.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.147+0000 7fae1e337640 1 -- 172.21.15.53:0/3658230456 shutdown_connections 2023-06-10T19:02:12.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.147+0000 7fae1e337640 1 --2- 172.21.15.53:0/3658230456 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae180ccae0 0x7fae1815f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:12.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.147+0000 7fae1e337640 1 --2- 172.21.15.53:0/3658230456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae180cc690 0x7fae1815f370 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:12.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.147+0000 7fae1e337640 1 --2- 172.21.15.53:0/3658230456 >> v2:172.21.15.117:3300/0 conn(0x7fae180b3ac0 0x7fae180b3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:12.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.147+0000 7fae1e337640 1 -- 172.21.15.53:0/3658230456 >> 172.21.15.53:0/3658230456 conn(0x7fae18071790 msgr2=0x7fae18069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:12.154 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.147+0000 7fae1e337640 1 -- 172.21.15.53:0/3658230456 shutdown_connections 2023-06-10T19:02:12.154 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.147+0000 7fae1e337640 1 -- 172.21.15.53:0/3658230456 wait complete. 2023-06-10T19:02:12.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.147+0000 7fae1e337640 1 Processor -- start 2023-06-10T19:02:12.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.147+0000 7fae1e337640 1 -- start start 2023-06-10T19:02:12.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.151+0000 7fae1e337640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae180b3ac0 0x7fae180b26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:12.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.151+0000 7fae1e337640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae180cc690 0x7fae181517a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:12.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.151+0000 7fae1e337640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae180ccae0 0x7fae18151ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:12.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.151+0000 7fae1e337640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae18152660 con 0x7fae180ccae0 2023-06-10T19:02:12.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.151+0000 7fae1e337640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae180c8890 con 0x7fae180cc690 2023-06-10T19:02:12.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.151+0000 7fae1e337640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae180b57a0 con 0x7fae180b3ac0 2023-06-10T19:02:12.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.151+0000 7fae1c8d4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae180ccae0 0x7fae18151ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:12.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.151+0000 7fae1c8d4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae180ccae0 0x7fae18151ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40664/0 (socket says 172.21.15.53:40664) 2023-06-10T19:02:12.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.151+0000 7fae1c8d4640 1 -- 172.21.15.53:0/3990781997 learned_addr learned my addr 172.21.15.53:0/3990781997 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:12.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.151+0000 7fae17fff640 1 --2- 172.21.15.53:0/3990781997 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae180b3ac0 0x7fae180b26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:12.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.151+0000 7fae177fe640 1 --2- 172.21.15.53:0/3990781997 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae180cc690 0x7fae181517a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:12.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.151+0000 7fae1c8d4640 1 -- 172.21.15.53:0/3990781997 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae180b3ac0 msgr2=0x7fae180b26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:12.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.151+0000 7fae1c8d4640 1 --2- 172.21.15.53:0/3990781997 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae180b3ac0 0x7fae180b26a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:12.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.151+0000 7fae1c8d4640 1 -- 172.21.15.53:0/3990781997 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae180cc690 msgr2=0x7fae181517a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:12.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.151+0000 7fae1c8d4640 1 --2- 172.21.15.53:0/3990781997 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae180cc690 0x7fae181517a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:12.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.151+0000 7fae1c8d4640 1 -- 172.21.15.53:0/3990781997 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae0c0094d0 con 0x7fae180ccae0 2023-06-10T19:02:12.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.151+0000 7fae1c8d4640 1 --2- 172.21.15.53:0/3990781997 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae180ccae0 0x7fae18151ce0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7fae10007e60 tx=0x7fae1000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:12.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.151+0000 7fae14ff9640 1 -- 172.21.15.53:0/3990781997 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae10014420 con 0x7fae180ccae0 2023-06-10T19:02:12.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.151+0000 7fae14ff9640 1 -- 172.21.15.53:0/3990781997 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae100145a0 con 0x7fae180ccae0 2023-06-10T19:02:12.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.151+0000 7fae1e337640 1 -- 172.21.15.53:0/3990781997 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae180b5a80 con 0x7fae180ccae0 2023-06-10T19:02:12.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.151+0000 7fae14ff9640 1 -- 172.21.15.53:0/3990781997 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae10014950 con 0x7fae180ccae0 2023-06-10T19:02:12.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.151+0000 7fae1e337640 1 -- 172.21.15.53:0/3990781997 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae180b6040 con 0x7fae180ccae0 2023-06-10T19:02:12.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.151+0000 7fae1e337640 1 -- 172.21.15.53:0/3990781997 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae180b6230 con 0x7fae180ccae0 2023-06-10T19:02:12.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.151+0000 7fae14ff9640 1 -- 172.21.15.53:0/3990781997 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fae10014ab0 con 0x7fae180ccae0 2023-06-10T19:02:12.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.151+0000 7fae14ff9640 1 --2- 172.21.15.53:0/3990781997 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fae04066280 0x7fae04068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:12.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.151+0000 7fae14ff9640 1 -- 172.21.15.53:0/3990781997 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fae10084650 con 0x7fae180ccae0 2023-06-10T19:02:12.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.151+0000 7fae17fff640 1 --2- 172.21.15.53:0/3990781997 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fae04066280 0x7fae04068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:12.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.155+0000 7fae17fff640 1 --2- 172.21.15.53:0/3990781997 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fae04066280 0x7fae04068730 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fae0800c880 tx=0x7fae08008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:12.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.155+0000 7fae14ff9640 1 -- 172.21.15.53:0/3990781997 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fae10055560 con 0x7fae180ccae0 2023-06-10T19:02:12.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.343+0000 7fae1e337640 1 -- 172.21.15.53:0/3990781997 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fae1804d790 con 0x7fae180ccae0 2023-06-10T19:02:12.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.343+0000 7fae14ff9640 1 -- 172.21.15.53:0/3990781997 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+4679 (secure 0 0 0) 0x7fae100550f0 con 0x7fae180ccae0 2023-06-10T19:02:12.346 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:02:12.347 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":48,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1617157670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1617157670},{"type":"v1","addr":"172.21.15.117:6836","nonce":1617157670}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6113,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3414416090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":3414416090},{"type":"v1","addr":"172.21.15.117:6837","nonce":3414416090}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6718,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2533467097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2533467097},{"type":"v1","addr":"172.21.15.53:6835","nonce":2533467097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:02:02.642809+0000","modified":"2023-06-10T19:02:05.668734+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7830},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7830":{"gid":7830,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6833/1894654263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":1894654263},{"type":"v1","addr":"172.21.15.53:6833","nonce":1894654263}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-06-10T19:02:12.347 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 48 2023-06-10T19:02:12.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.347+0000 7fae1e337640 1 -- 172.21.15.53:0/3990781997 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fae04066280 msgr2=0x7fae04068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:12.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.347+0000 7fae1e337640 1 --2- 172.21.15.53:0/3990781997 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fae04066280 0x7fae04068730 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fae0800c880 tx=0x7fae08008040 comp rx=0 tx=0).stop 2023-06-10T19:02:12.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.347+0000 7fae1e337640 1 -- 172.21.15.53:0/3990781997 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae180ccae0 msgr2=0x7fae18151ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:12.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.347+0000 7fae1e337640 1 --2- 172.21.15.53:0/3990781997 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae180ccae0 0x7fae18151ce0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7fae10007e60 tx=0x7fae1000e4b0 comp rx=0 tx=0).stop 2023-06-10T19:02:12.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.347+0000 7fae1e337640 1 -- 172.21.15.53:0/3990781997 shutdown_connections 2023-06-10T19:02:12.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.347+0000 7fae1e337640 1 --2- 172.21.15.53:0/3990781997 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fae04066280 0x7fae04068730 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:12.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.347+0000 7fae1e337640 1 --2- 172.21.15.53:0/3990781997 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae180ccae0 0x7fae18151ce0 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:12.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.347+0000 7fae1e337640 1 --2- 172.21.15.53:0/3990781997 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae180cc690 0x7fae181517a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:12.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.347+0000 7fae1e337640 1 --2- 172.21.15.53:0/3990781997 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fae180b3ac0 0x7fae180b26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:12.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.347+0000 7fae1e337640 1 -- 172.21.15.53:0/3990781997 >> 172.21.15.53:0/3990781997 conn(0x7fae18071790 msgr2=0x7fae18154fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:12.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.347+0000 7fae1e337640 1 -- 172.21.15.53:0/3990781997 shutdown_connections 2023-06-10T19:02:12.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.347+0000 7fae1e337640 1 -- 172.21.15.53:0/3990781997 wait complete. 2023-06-10T19:02:12.767 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 48, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-06-10T19:02:02.642809+0000', 'modified': '2023-06-10T19:02:05.668734+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7830}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7830': {'gid': 7830, 'name': 'a', 'rank': 0, 'incarnation': 44, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.53:6833/1894654263', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.53:6832', 'nonce': 1894654263}, {'type': 'v1', 'addr': '172.21.15.53:6833', 'nonce': 1894654263}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-06-10T19:02:12.768 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-06-10T19:02:12.768 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-06-10T19:02:12.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.903+0000 7fe94a458640 1 Processor -- start 2023-06-10T19:02:12.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.903+0000 7fe94a458640 1 -- start start 2023-06-10T19:02:12.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.903+0000 7fe94a458640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9441571a0 0x7fe9440c9f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:12.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.903+0000 7fe94a458640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe944070100 0x7fe9440af7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:12.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.903+0000 7fe94a458640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9440b0160 con 0x7fe9440afd10 2023-06-10T19:02:12.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.903+0000 7fe94a458640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe944071190 con 0x7fe944070100 2023-06-10T19:02:12.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.903+0000 7fe94a458640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9440ca440 con 0x7fe9441571a0 2023-06-10T19:02:12.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.903+0000 7fe9437fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe944070100 0x7fe9440af7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:12.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.903+0000 7fe9437fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe944070100 0x7fe9440af7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40666/0 (socket says 172.21.15.53:40666) 2023-06-10T19:02:12.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.903+0000 7fe9489f5640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fe9440afd10 0x7fe94415d260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60874/0 (socket says 172.21.15.53:60874) 2023-06-10T19:02:12.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.903+0000 7fe9437fe640 1 -- 172.21.15.53:0/3740057657 learned_addr learned my addr 172.21.15.53:0/3740057657 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:12.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.903+0000 7fe943fff640 1 --2- 172.21.15.53:0/3740057657 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9441571a0 0x7fe9440c9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:12.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.903+0000 7fe9437fe640 1 -- 172.21.15.53:0/3740057657 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9441571a0 msgr2=0x7fe9440c9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:12.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.903+0000 7fe9437fe640 1 --2- 172.21.15.53:0/3740057657 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9441571a0 0x7fe9440c9f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:12.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.903+0000 7fe9437fe640 1 -- 172.21.15.53:0/3740057657 >> v1:172.21.15.53:6789/0 conn(0x7fe9440afd10 legacy=0x7fe94415d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:12.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.903+0000 7fe9437fe640 1 -- 172.21.15.53:0/3740057657 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe944070580 con 0x7fe944070100 2023-06-10T19:02:12.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.903+0000 7fe942ffd640 1 -- 172.21.15.53:0/3740057657 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1592702797 0 0) 0x7fe93c001120 con 0x7fe9440afd10 2023-06-10T19:02:12.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.907+0000 7fe9437fe640 1 --2- 172.21.15.53:0/3740057657 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe944070100 0x7fe9440af7d0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7fe938009e50 tx=0x7fe93801c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef5cd4173160db4f server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:12.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.907+0000 7fe942ffd640 1 -- 172.21.15.53:0/3740057657 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9380a58a0 con 0x7fe944070100 2023-06-10T19:02:12.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.907+0000 7fe942ffd640 1 -- 172.21.15.53:0/3740057657 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9380a5a00 con 0x7fe944070100 2023-06-10T19:02:12.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.907+0000 7fe942ffd640 1 -- 172.21.15.53:0/3740057657 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9380a5d90 con 0x7fe944070100 2023-06-10T19:02:12.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.907+0000 7fe94a458640 1 -- 172.21.15.53:0/3740057657 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe944070100 msgr2=0x7fe9440af7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:12.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.907+0000 7fe94a458640 1 --2- 172.21.15.53:0/3740057657 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe944070100 0x7fe9440af7d0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7fe938009e50 tx=0x7fe93801c9e0 comp rx=0 tx=0).stop 2023-06-10T19:02:12.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.907+0000 7fe94a458640 1 -- 172.21.15.53:0/3740057657 shutdown_connections 2023-06-10T19:02:12.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.907+0000 7fe94a458640 1 --2- 172.21.15.53:0/3740057657 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe944070100 0x7fe9440af7d0 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:12.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.907+0000 7fe94a458640 1 --2- 172.21.15.53:0/3740057657 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9441571a0 0x7fe9440c9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:12.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.907+0000 7fe94a458640 1 -- 172.21.15.53:0/3740057657 >> 172.21.15.53:0/3740057657 conn(0x7fe9440ce9e0 msgr2=0x7fe9440ca7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:12.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.907+0000 7fe94a458640 1 -- 172.21.15.53:0/3740057657 shutdown_connections 2023-06-10T19:02:12.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.907+0000 7fe94a458640 1 -- 172.21.15.53:0/3740057657 wait complete. 2023-06-10T19:02:12.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.911+0000 7fe94a458640 1 Processor -- start 2023-06-10T19:02:12.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.911+0000 7fe94a458640 1 -- start start 2023-06-10T19:02:12.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.911+0000 7fe94a458640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9440afd10 0x7fe9440c4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:12.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.911+0000 7fe94a458640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9441571a0 0x7fe9440b25e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:12.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.911+0000 7fe94a458640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe94414f360 0x7fe9440c3b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:12.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.911+0000 7fe94a458640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9440c6240 con 0x7fe9441571a0 2023-06-10T19:02:12.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.911+0000 7fe94a458640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9440b2cf0 con 0x7fe94414f360 2023-06-10T19:02:12.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.911+0000 7fe94a458640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9440b2fd0 con 0x7fe9440afd10 2023-06-10T19:02:12.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.911+0000 7fe9437fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9441571a0 0x7fe9440b25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:12.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.911+0000 7fe9437fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9441571a0 0x7fe9440b25e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40670/0 (socket says 172.21.15.53:40670) 2023-06-10T19:02:12.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.911+0000 7fe9437fe640 1 -- 172.21.15.53:0/3604916596 learned_addr learned my addr 172.21.15.53:0/3604916596 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:12.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.911+0000 7fe9437fe640 1 -- 172.21.15.53:0/3604916596 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9440afd10 msgr2=0x7fe9440c4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:12.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.911+0000 7fe943fff640 1 --2- 172.21.15.53:0/3604916596 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9440afd10 0x7fe9440c4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:12.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.911+0000 7fe9489f5640 1 --2- 172.21.15.53:0/3604916596 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe94414f360 0x7fe9440c3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:12.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.911+0000 7fe9437fe640 1 --2- 172.21.15.53:0/3604916596 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9440afd10 0x7fe9440c4730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:12.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.911+0000 7fe9437fe640 1 -- 172.21.15.53:0/3604916596 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe94414f360 msgr2=0x7fe9440c3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:12.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.911+0000 7fe9437fe640 1 --2- 172.21.15.53:0/3604916596 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe94414f360 0x7fe9440c3b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:12.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.911+0000 7fe9437fe640 1 -- 172.21.15.53:0/3604916596 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe938009b30 con 0x7fe9441571a0 2023-06-10T19:02:12.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.911+0000 7fe9437fe640 1 --2- 172.21.15.53:0/3604916596 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9441571a0 0x7fe9440b25e0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7fe93801a610 tx=0x7fe938019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:12.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.911+0000 7fe940ff9640 1 -- 172.21.15.53:0/3604916596 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9380b8880 con 0x7fe9441571a0 2023-06-10T19:02:12.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.911+0000 7fe940ff9640 1 -- 172.21.15.53:0/3604916596 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9380b8a00 con 0x7fe9441571a0 2023-06-10T19:02:12.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.911+0000 7fe94a458640 1 -- 172.21.15.53:0/3604916596 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9440b32b0 con 0x7fe9441571a0 2023-06-10T19:02:12.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.911+0000 7fe940ff9640 1 -- 172.21.15.53:0/3604916596 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9380b8db0 con 0x7fe9441571a0 2023-06-10T19:02:12.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.911+0000 7fe94a458640 1 -- 172.21.15.53:0/3604916596 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe94414f800 con 0x7fe9441571a0 2023-06-10T19:02:12.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.911+0000 7fe940ff9640 1 -- 172.21.15.53:0/3604916596 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe9380b6440 con 0x7fe9441571a0 2023-06-10T19:02:12.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.915+0000 7fe940ff9640 1 --2- 172.21.15.53:0/3604916596 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe930066280 0x7fe930068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:12.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.915+0000 7fe940ff9640 1 -- 172.21.15.53:0/3604916596 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe93811f460 con 0x7fe9441571a0 2023-06-10T19:02:12.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.915+0000 7fe943fff640 1 --2- 172.21.15.53:0/3604916596 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe930066280 0x7fe930068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:12.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.915+0000 7fe94d574000 1 Processor -- start 2023-06-10T19:02:12.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.915+0000 7fe94d574000 1 -- start start 2023-06-10T19:02:12.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.915+0000 7fe943fff640 1 --2- 172.21.15.53:0/3604916596 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe930066280 0x7fe930068730 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fe934006fd0 tx=0x7fe934008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:12.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.915+0000 7fe94d574000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557ce9418740 0x557ce9418b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:12.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.915+0000 7fe94d574000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557ce9419050 0x557ce93ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:12.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.915+0000 7fe94d574000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557ce93ced80 0x557ce93cf150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:12.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.915+0000 7fe94d574000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ce9296ac0 con 0x557ce93ced80 2023-06-10T19:02:12.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.915+0000 7fe94d574000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ce91d0840 con 0x557ce9419050 2023-06-10T19:02:12.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.915+0000 7fe94d574000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x557ce92242e0 con 0x557ce9418740 2023-06-10T19:02:12.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.915+0000 7fe9489f5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557ce93ced80 0x557ce93cf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:12.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.915+0000 7fe9489f5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557ce93ced80 0x557ce93cf150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40686/0 (socket says 172.21.15.53:40686) 2023-06-10T19:02:12.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.915+0000 7fe9489f5640 1 -- 172.21.15.53:0/2090369165 learned_addr learned my addr 172.21.15.53:0/2090369165 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:12.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.915+0000 7fe943fff640 1 --2- 172.21.15.53:0/2090369165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557ce9418740 0x557ce9418b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:12.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.915+0000 7fe9437fe640 1 --2- 172.21.15.53:0/2090369165 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557ce9419050 0x557ce93ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:12.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.915+0000 7fe9489f5640 1 -- 172.21.15.53:0/2090369165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557ce9418740 msgr2=0x557ce9418b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:12.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.915+0000 7fe9489f5640 1 --2- 172.21.15.53:0/2090369165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557ce9418740 0x557ce9418b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:12.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.915+0000 7fe9489f5640 1 -- 172.21.15.53:0/2090369165 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557ce9419050 msgr2=0x557ce93ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:12.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.915+0000 7fe9489f5640 1 --2- 172.21.15.53:0/2090369165 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557ce9419050 0x557ce93ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:12.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.915+0000 7fe9489f5640 1 -- 172.21.15.53:0/2090369165 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557ce8f19890 con 0x557ce93ced80 2023-06-10T19:02:12.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.915+0000 7fe943fff640 1 --2- 172.21.15.53:0/2090369165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557ce9418740 0x557ce9418b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:02:12.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.915+0000 7fe9437fe640 1 --2- 172.21.15.53:0/2090369165 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557ce9419050 0x557ce93ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:02:12.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.915+0000 7fe9489f5640 1 --2- 172.21.15.53:0/2090369165 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557ce93ced80 0x557ce93cf150 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7fe93c001820 tx=0x7fe93c001ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=473491cb7bce96f6 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:12.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.915+0000 7fe929ffb640 1 -- 172.21.15.53:0/2090369165 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe93c0074e0 con 0x557ce93ced80 2023-06-10T19:02:12.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.915+0000 7fe929ffb640 1 -- 172.21.15.53:0/2090369165 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe93c007640 con 0x557ce93ced80 2023-06-10T19:02:12.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.915+0000 7fe929ffb640 1 -- 172.21.15.53:0/2090369165 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe93c004a10 con 0x557ce93ced80 2023-06-10T19:02:12.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.915+0000 7fe94d574000 1 -- 172.21.15.53:0/2090369165 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557ce93ced80 msgr2=0x557ce93cf150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:12.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.915+0000 7fe94d574000 1 --2- 172.21.15.53:0/2090369165 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557ce93ced80 0x557ce93cf150 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7fe93c001820 tx=0x7fe93c001ce0 comp rx=0 tx=0).stop 2023-06-10T19:02:12.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.915+0000 7fe94d574000 1 -- 172.21.15.53:0/2090369165 shutdown_connections 2023-06-10T19:02:12.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.915+0000 7fe94d574000 1 --2- 172.21.15.53:0/2090369165 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557ce93ced80 0x557ce93cf150 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:12.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.915+0000 7fe94d574000 1 --2- 172.21.15.53:0/2090369165 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557ce9419050 0x557ce93ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:12.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.915+0000 7fe94d574000 1 --2- 172.21.15.53:0/2090369165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557ce9418740 0x557ce9418b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:12.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.915+0000 7fe94d574000 1 -- 172.21.15.53:0/2090369165 >> 172.21.15.53:0/2090369165 conn(0x557ce93c6800 msgr2=0x557ce93d5800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:12.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.915+0000 7fe94d574000 1 -- 172.21.15.53:0/2090369165 shutdown_connections 2023-06-10T19:02:12.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.915+0000 7fe94d574000 1 -- 172.21.15.53:0/2090369165 wait complete. 2023-06-10T19:02:12.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.915+0000 7fe94d574000 1 -- start start 2023-06-10T19:02:12.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.915+0000 7fe94d574000 1 Processor -- start 2023-06-10T19:02:12.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.919+0000 7fe94d574000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557ce93ced80 0x557ce93d4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:12.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.919+0000 7fe94d574000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557ce9418740 0x557ce93da0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:12.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.919+0000 7fe94d574000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557ce9419050 0x557ce93da620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:12.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.919+0000 7fe94d574000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ce921d380 con 0x557ce9419050 2023-06-10T19:02:12.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.919+0000 7fe94d574000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ce91d9ae0 con 0x557ce93ced80 2023-06-10T19:02:12.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.919+0000 7fe94d574000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x557ce91d9780 con 0x557ce9418740 2023-06-10T19:02:12.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.919+0000 7fe94d574000 10 client.0 _ll_register_callbacks cb 0x557ce93bae30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-10T19:02:12.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.919+0000 7fe9489f5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557ce9419050 0x557ce93da620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:12.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.919+0000 7fe9489f5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557ce9419050 0x557ce93da620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40690/0 (socket says 172.21.15.53:40690) 2023-06-10T19:02:12.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.919+0000 7fe9489f5640 1 -- 172.21.15.53:0/2393862374 learned_addr learned my addr 172.21.15.53:0/2393862374 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:12.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.919+0000 7fe943fff640 1 --2- 172.21.15.53:0/2393862374 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557ce93ced80 0x557ce93d4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:12.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.919+0000 7fe9437fe640 1 --2- 172.21.15.53:0/2393862374 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557ce9418740 0x557ce93da0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:12.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.919+0000 7fe9489f5640 1 -- 172.21.15.53:0/2393862374 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557ce9418740 msgr2=0x557ce93da0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:12.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.919+0000 7fe9489f5640 1 --2- 172.21.15.53:0/2393862374 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557ce9418740 0x557ce93da0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:12.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.919+0000 7fe9489f5640 1 -- 172.21.15.53:0/2393862374 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557ce93ced80 msgr2=0x557ce93d4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:12.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.919+0000 7fe9489f5640 1 --2- 172.21.15.53:0/2393862374 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557ce93ced80 0x557ce93d4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:12.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.919+0000 7fe9489f5640 1 -- 172.21.15.53:0/2393862374 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe93c001450 con 0x557ce9419050 2023-06-10T19:02:12.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.919+0000 7fe943fff640 1 --2- 172.21.15.53:0/2393862374 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557ce93ced80 0x557ce93d4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:02:12.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.919+0000 7fe9489f5640 1 --2- 172.21.15.53:0/2393862374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557ce9419050 0x557ce93da620 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7fe93c001d20 tx=0x7fe93c010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5731ef03c1f7ede server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:12.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.919+0000 7fe922ffd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-06-10T19:02:12.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.919+0000 7fe922ffd640 1 -- 172.21.15.53:0/2393862374 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe93c023070 con 0x557ce9419050 2023-06-10T19:02:12.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.919+0000 7fe922ffd640 1 -- 172.21.15.53:0/2393862374 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe93c004ba0 con 0x557ce9419050 2023-06-10T19:02:12.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.919+0000 7fe94d574000 1 -- 172.21.15.53:0/2393862374 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557ce91e4a20 con 0x557ce9419050 2023-06-10T19:02:12.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.919+0000 7fe922ffd640 1 -- 172.21.15.53:0/2393862374 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe93c0079a0 con 0x557ce9419050 2023-06-10T19:02:12.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.919+0000 7fe94d574000 10 client.8010 fetch_fsmap learned FSMap version 48 2023-06-10T19:02:12.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.919+0000 7fe94d574000 1 -- 172.21.15.53:0/2393862374 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=2+}) v3 -- 0x557ce91e1d10 con 0x557ce9419050 2023-06-10T19:02:12.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.919+0000 7fe922ffd640 1 -- 172.21.15.53:0/2393862374 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557ce91e4a20 con 0x557ce9419050 2023-06-10T19:02:12.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.919+0000 7fe922ffd640 1 -- 172.21.15.53:0/2393862374 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 48) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fe93c026020 con 0x557ce9419050 2023-06-10T19:02:12.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.919+0000 7fe94d574000 10 client.8010 fetch_fsmap finished waiting for FSMap version 48 2023-06-10T19:02:12.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.919+0000 7fe94d574000 10 client.8010 resolve_mds: resolved name 'a' to daemon mds.a 2023-06-10T19:02:12.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.919+0000 7fe94d574000 20 client.8010 populate_metadata read hostname 'smithi053' 2023-06-10T19:02:12.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.919+0000 7fe94d574000 1 --2- 172.21.15.53:0/2393862374 >> [v2:172.21.15.53:6832/1894654263,v1:172.21.15.53:6833/1894654263] conn(0x557ce9427c80 0x557ce942a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:12.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.919+0000 7fe94d574000 4 client.8010 mds_command: new command op to 7830 tid=0[{"prefix": "get_command_descriptions"}] 2023-06-10T19:02:12.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.919+0000 7fe94d574000 1 -- 172.21.15.53:0/2393862374 --> [v2:172.21.15.53:6832/1894654263,v1:172.21.15.53:6833/1894654263] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557ce924c710 con 0x557ce9427c80 2023-06-10T19:02:12.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.919+0000 7fe943fff640 1 --2- 172.21.15.53:0/2393862374 >> [v2:172.21.15.53:6832/1894654263,v1:172.21.15.53:6833/1894654263] conn(0x557ce9427c80 0x557ce942a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:12.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.919+0000 7fe943fff640 1 --2- 172.21.15.53:0/2393862374 >> [v2:172.21.15.53:6832/1894654263,v1:172.21.15.53:6833/1894654263] conn(0x557ce9427c80 0x557ce942a060 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dad3cccaa30884a2 server_cookie=80d4d1da24eacf0 in_seq=0 out_seq=0 2023-06-10T19:02:12.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.919+0000 7fe922ffd640 10 client.8010 ms_handle_connect on v2:172.21.15.53:6832/1894654263 2023-06-10T19:02:12.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.919+0000 7fe922ffd640 1 -- 172.21.15.53:0/2393862374 <== mds.0 v2:172.21.15.53:6832/1894654263 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x557ce924c710 con 0x557ce9427c80 2023-06-10T19:02:12.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.919+0000 7fe922ffd640 10 client.8010 handle_command_reply: tid=0 2023-06-10T19:02:12.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.919+0000 7fe94d574000 1 client.8010 shutdown 2023-06-10T19:02:12.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.919+0000 7fe94d574000 1 -- 172.21.15.53:0/2393862374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557ce9419050 msgr2=0x557ce93da620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:12.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.919+0000 7fe94d574000 1 --2- 172.21.15.53:0/2393862374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557ce9419050 0x557ce93da620 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7fe93c001d20 tx=0x7fe93c010000 comp rx=0 tx=0).stop 2023-06-10T19:02:12.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.919+0000 7fe94d574000 1 -- 172.21.15.53:0/2393862374 shutdown_connections 2023-06-10T19:02:12.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.919+0000 7fe94d574000 1 --2- 172.21.15.53:0/2393862374 >> [v2:172.21.15.53:6832/1894654263,v1:172.21.15.53:6833/1894654263] conn(0x557ce9427c80 0x557ce942a060 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:12.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.919+0000 7fe94d574000 1 --2- 172.21.15.53:0/2393862374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557ce9419050 0x557ce93da620 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:12.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.919+0000 7fe94d574000 1 --2- 172.21.15.53:0/2393862374 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557ce9418740 0x557ce93da0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:12.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.919+0000 7fe922ffd640 0 client.8010 ms_handle_reset on v2:172.21.15.53:6832/1894654263 2023-06-10T19:02:12.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.919+0000 7fe94d574000 1 --2- 172.21.15.53:0/2393862374 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557ce93ced80 0x557ce93d4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:12.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.919+0000 7fe94d574000 1 -- 172.21.15.53:0/2393862374 >> 172.21.15.53:0/2393862374 conn(0x557ce93c6800 msgr2=0x557ce93cd830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:12.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.919+0000 7fe94d574000 1 -- 172.21.15.53:0/2393862374 shutdown_connections 2023-06-10T19:02:12.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.919+0000 7fe94d574000 1 -- 172.21.15.53:0/2393862374 wait complete. 2023-06-10T19:02:12.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.919+0000 7fe94d574000 20 client.8010 trim_cache size 0 max 16384 2023-06-10T19:02:12.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.935+0000 7fe94d574000 1 Processor -- start 2023-06-10T19:02:12.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.935+0000 7fe94d574000 1 -- start start 2023-06-10T19:02:12.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.935+0000 7fe94d574000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557ce93ced80 0x557ce942bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:12.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.935+0000 7fe94d574000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557ce9418740 0x557ce9428050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:12.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.935+0000 7fe94d574000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557ce9419050 0x557ce9428590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:12.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.935+0000 7fe94d574000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ce8eda940 con 0x557ce9419050 2023-06-10T19:02:12.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.935+0000 7fe94d574000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ce921a780 con 0x557ce9418740 2023-06-10T19:02:12.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.935+0000 7fe94d574000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x557ce91bc930 con 0x557ce93ced80 2023-06-10T19:02:12.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.935+0000 7fe9489f5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557ce9419050 0x557ce9428590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:12.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.935+0000 7fe9489f5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557ce9419050 0x557ce9428590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40698/0 (socket says 172.21.15.53:40698) 2023-06-10T19:02:12.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.935+0000 7fe9489f5640 1 -- 172.21.15.53:0/2330403282 learned_addr learned my addr 172.21.15.53:0/2330403282 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:12.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.939+0000 7fe9437fe640 1 --2- 172.21.15.53:0/2330403282 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557ce9418740 0x557ce9428050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:12.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.939+0000 7fe9489f5640 1 -- 172.21.15.53:0/2330403282 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557ce93ced80 msgr2=0x557ce942bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:12.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.939+0000 7fe9489f5640 1 --2- 172.21.15.53:0/2330403282 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557ce93ced80 0x557ce942bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:12.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.939+0000 7fe9489f5640 1 -- 172.21.15.53:0/2330403282 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557ce9418740 msgr2=0x557ce9428050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:12.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.939+0000 7fe9489f5640 1 --2- 172.21.15.53:0/2330403282 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557ce9418740 0x557ce9428050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:12.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.939+0000 7fe9489f5640 1 -- 172.21.15.53:0/2330403282 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557ce93d1450 con 0x557ce9419050 2023-06-10T19:02:12.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.939+0000 7fe9489f5640 1 --2- 172.21.15.53:0/2330403282 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557ce9419050 0x557ce9428590 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7fe93c001240 tx=0x7fe93c00b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d04bb71f749b73c1 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:12.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.939+0000 7fe92a7fc640 1 -- 172.21.15.53:0/2330403282 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe93c023040 con 0x557ce9419050 2023-06-10T19:02:12.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.939+0000 7fe92a7fc640 1 -- 172.21.15.53:0/2330403282 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe93c0079a0 con 0x557ce9419050 2023-06-10T19:02:12.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.939+0000 7fe92a7fc640 1 -- 172.21.15.53:0/2330403282 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe93c00da00 con 0x557ce9419050 2023-06-10T19:02:12.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.939+0000 7fe94d574000 1 -- 172.21.15.53:0/2330403282 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557ce9419050 msgr2=0x557ce9428590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:12.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.939+0000 7fe94d574000 1 --2- 172.21.15.53:0/2330403282 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557ce9419050 0x557ce9428590 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7fe93c001240 tx=0x7fe93c00b000 comp rx=0 tx=0).stop 2023-06-10T19:02:12.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.939+0000 7fe94d574000 1 -- 172.21.15.53:0/2330403282 shutdown_connections 2023-06-10T19:02:12.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.939+0000 7fe94d574000 1 --2- 172.21.15.53:0/2330403282 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557ce9419050 0x557ce9428590 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:12.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.939+0000 7fe94d574000 1 --2- 172.21.15.53:0/2330403282 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557ce9418740 0x557ce9428050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:12.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.939+0000 7fe94d574000 1 --2- 172.21.15.53:0/2330403282 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557ce93ced80 0x557ce942bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:12.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.939+0000 7fe94d574000 1 -- 172.21.15.53:0/2330403282 >> 172.21.15.53:0/2330403282 conn(0x557ce93c6800 msgr2=0x557ce93cdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:12.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.939+0000 7fe94d574000 1 -- 172.21.15.53:0/2330403282 shutdown_connections 2023-06-10T19:02:12.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.939+0000 7fe94d574000 1 -- 172.21.15.53:0/2330403282 wait complete. 2023-06-10T19:02:12.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.939+0000 7fe94d574000 1 -- start start 2023-06-10T19:02:12.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.939+0000 7fe94d574000 1 Processor -- start 2023-06-10T19:02:12.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.939+0000 7fe94d574000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557ce93ced80 0x557ce942b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:12.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.939+0000 7fe94d574000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557ce9418740 0x557ce94334c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:12.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.939+0000 7fe94d574000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557ce9419050 0x557ce9433a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:12.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.939+0000 7fe94d574000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ce91cd3e0 con 0x557ce93ced80 2023-06-10T19:02:12.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.939+0000 7fe94d574000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ce91c5450 con 0x557ce9418740 2023-06-10T19:02:12.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.939+0000 7fe94d574000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x557ce93d5a30 con 0x557ce9419050 2023-06-10T19:02:12.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.939+0000 7fe94d574000 10 client.0 _ll_register_callbacks cb 0x557ce91e17f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-10T19:02:12.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.939+0000 7fe943fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557ce93ced80 0x557ce942b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:12.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.939+0000 7fe943fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557ce93ced80 0x557ce942b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40706/0 (socket says 172.21.15.53:40706) 2023-06-10T19:02:12.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.939+0000 7fe943fff640 1 -- 172.21.15.53:0/1759821864 learned_addr learned my addr 172.21.15.53:0/1759821864 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:12.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.939+0000 7fe9437fe640 1 --2- 172.21.15.53:0/1759821864 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557ce9418740 0x557ce94334c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:12.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.939+0000 7fe943fff640 1 -- 172.21.15.53:0/1759821864 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557ce9419050 msgr2=0x557ce9433a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:12.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.939+0000 7fe943fff640 1 --2- 172.21.15.53:0/1759821864 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557ce9419050 0x557ce9433a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:12.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.939+0000 7fe943fff640 1 -- 172.21.15.53:0/1759821864 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557ce9418740 msgr2=0x557ce94334c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:12.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.939+0000 7fe943fff640 1 --2- 172.21.15.53:0/1759821864 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557ce9418740 0x557ce94334c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:12.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.939+0000 7fe943fff640 1 -- 172.21.15.53:0/1759821864 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557ce91e1d10 con 0x557ce93ced80 2023-06-10T19:02:12.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.939+0000 7fe943fff640 1 --2- 172.21.15.53:0/1759821864 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557ce93ced80 0x557ce942b710 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x557ce921b6c0 tx=0x7fe9340046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceab2f3b56aa7e2e server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:12.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.939+0000 7fe922ffd640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-06-10T19:02:12.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.939+0000 7fe922ffd640 1 -- 172.21.15.53:0/1759821864 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe934004020 con 0x557ce93ced80 2023-06-10T19:02:12.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.939+0000 7fe922ffd640 1 -- 172.21.15.53:0/1759821864 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe934004180 con 0x557ce93ced80 2023-06-10T19:02:12.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.939+0000 7fe94d574000 1 -- 172.21.15.53:0/1759821864 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557ce93d26e0 con 0x557ce93ced80 2023-06-10T19:02:12.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.939+0000 7fe922ffd640 1 -- 172.21.15.53:0/1759821864 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe934004340 con 0x557ce93ced80 2023-06-10T19:02:12.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.939+0000 7fe94d574000 10 client.8016 fetch_fsmap learned FSMap version 48 2023-06-10T19:02:12.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.939+0000 7fe94d574000 1 -- 172.21.15.53:0/1759821864 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=2+}) v3 -- 0x557ce91c7fa0 con 0x557ce93ced80 2023-06-10T19:02:12.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.939+0000 7fe922ffd640 1 -- 172.21.15.53:0/1759821864 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557ce93d26e0 con 0x557ce93ced80 2023-06-10T19:02:12.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.939+0000 7fe922ffd640 1 -- 172.21.15.53:0/1759821864 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 48) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fe934020040 con 0x557ce93ced80 2023-06-10T19:02:12.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.939+0000 7fe94d574000 10 client.8016 fetch_fsmap finished waiting for FSMap version 48 2023-06-10T19:02:12.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.939+0000 7fe94d574000 10 client.8016 resolve_mds: resolved name 'a' to daemon mds.a 2023-06-10T19:02:12.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.939+0000 7fe94d574000 20 client.8016 populate_metadata read hostname 'smithi053' 2023-06-10T19:02:12.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.939+0000 7fe94d574000 1 --2- 172.21.15.53:0/1759821864 >> [v2:172.21.15.53:6832/1894654263,v1:172.21.15.53:6833/1894654263] conn(0x557ce9476d10 0x557ce94770e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:12.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.939+0000 7fe94d574000 4 client.8016 mds_command: new command op to 7830 tid=0[{"prefix": "status"}] 2023-06-10T19:02:12.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.939+0000 7fe94d574000 1 -- 172.21.15.53:0/1759821864 --> [v2:172.21.15.53:6832/1894654263,v1:172.21.15.53:6833/1894654263] -- command(tid 0: {"prefix": "status"}) v1 -- 0x557ce921bcd0 con 0x557ce9476d10 2023-06-10T19:02:12.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.943+0000 7fe9437fe640 1 --2- 172.21.15.53:0/1759821864 >> [v2:172.21.15.53:6832/1894654263,v1:172.21.15.53:6833/1894654263] conn(0x557ce9476d10 0x557ce94770e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:12.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.943+0000 7fe9437fe640 1 --2- 172.21.15.53:0/1759821864 >> [v2:172.21.15.53:6832/1894654263,v1:172.21.15.53:6833/1894654263] conn(0x557ce9476d10 0x557ce94770e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=583a1b21bcaf9eed server_cookie=e99e0e20e8eeba4f in_seq=0 out_seq=0 2023-06-10T19:02:12.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.943+0000 7fe922ffd640 10 client.8016 ms_handle_connect on v2:172.21.15.53:6832/1894654263 2023-06-10T19:02:12.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.943+0000 7fe922ffd640 1 -- 172.21.15.53:0/1759821864 <== mds.0 v2:172.21.15.53:6832/1894654263 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x557ce921bcd0 con 0x557ce9476d10 2023-06-10T19:02:12.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.943+0000 7fe922ffd640 10 client.8016 handle_command_reply: tid=0 2023-06-10T19:02:12.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.943+0000 7fe94d574000 1 client.8016 shutdown 2023-06-10T19:02:12.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.943+0000 7fe94d574000 1 -- 172.21.15.53:0/1759821864 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557ce93ced80 msgr2=0x557ce942b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:12.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.943+0000 7fe94d574000 1 --2- 172.21.15.53:0/1759821864 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557ce93ced80 0x557ce942b710 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x557ce921b6c0 tx=0x7fe9340046d0 comp rx=0 tx=0).stop 2023-06-10T19:02:12.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.943+0000 7fe94d574000 1 -- 172.21.15.53:0/1759821864 shutdown_connections 2023-06-10T19:02:12.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.943+0000 7fe94d574000 1 --2- 172.21.15.53:0/1759821864 >> [v2:172.21.15.53:6832/1894654263,v1:172.21.15.53:6833/1894654263] conn(0x557ce9476d10 0x557ce94770e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:12.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.943+0000 7fe94d574000 1 --2- 172.21.15.53:0/1759821864 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x557ce9419050 0x557ce9433a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:12.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.943+0000 7fe94d574000 1 --2- 172.21.15.53:0/1759821864 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557ce9418740 0x557ce94334c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:12.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.943+0000 7fe922ffd640 0 client.8016 ms_handle_reset on v2:172.21.15.53:6832/1894654263 2023-06-10T19:02:12.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.943+0000 7fe94d574000 1 --2- 172.21.15.53:0/1759821864 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557ce93ced80 0x557ce942b710 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:12.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.943+0000 7fe94d574000 1 -- 172.21.15.53:0/1759821864 >> 172.21.15.53:0/1759821864 conn(0x557ce93c6800 msgr2=0x557ce94170d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:12.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.943+0000 7fe94d574000 1 -- 172.21.15.53:0/1759821864 shutdown_connections 2023-06-10T19:02:12.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.943+0000 7fe94d574000 1 -- 172.21.15.53:0/1759821864 wait complete. 2023-06-10T19:02:12.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.943+0000 7fe94d574000 20 client.8016 trim_cache size 0 max 16384 2023-06-10T19:02:12.953 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-06-10T19:02:12.953 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_fsid": "c8c64bed-c406-4936-93f9-d16335f1067d", 2023-06-10T19:02:12.953 INFO:teuthology.orchestra.run.smithi053.stdout: "whoami": 0, 2023-06-10T19:02:12.954 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 7830, 2023-06-10T19:02:12.954 INFO:teuthology.orchestra.run.smithi053.stdout: "want_state": "up:active", 2023-06-10T19:02:12.954 INFO:teuthology.orchestra.run.smithi053.stdout: "state": "up:active", 2023-06-10T19:02:12.954 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs", 2023-06-10T19:02:12.954 INFO:teuthology.orchestra.run.smithi053.stdout: "rank_uptime": 10.297113866, 2023-06-10T19:02:12.954 INFO:teuthology.orchestra.run.smithi053.stdout: "mdsmap_epoch": 48, 2023-06-10T19:02:12.954 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch": 94, 2023-06-10T19:02:12.954 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch_barrier": 94, 2023-06-10T19:02:12.955 INFO:teuthology.orchestra.run.smithi053.stdout: "uptime": 15.681806674000001 2023-06-10T19:02:12.955 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-06-10T19:02:12.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.943+0000 7fe94a458640 1 -- 172.21.15.53:0/3604916596 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe930066280 msgr2=0x7fe930068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:12.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.943+0000 7fe94a458640 1 --2- 172.21.15.53:0/3604916596 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe930066280 0x7fe930068730 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fe934006fd0 tx=0x7fe934008040 comp rx=0 tx=0).stop 2023-06-10T19:02:12.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.943+0000 7fe94a458640 1 -- 172.21.15.53:0/3604916596 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9441571a0 msgr2=0x7fe9440b25e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:12.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.943+0000 7fe94a458640 1 --2- 172.21.15.53:0/3604916596 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9441571a0 0x7fe9440b25e0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7fe93801a610 tx=0x7fe938019780 comp rx=0 tx=0).stop 2023-06-10T19:02:12.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.943+0000 7fe94a458640 1 -- 172.21.15.53:0/3604916596 shutdown_connections 2023-06-10T19:02:12.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.943+0000 7fe94a458640 1 --2- 172.21.15.53:0/3604916596 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe930066280 0x7fe930068730 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:12.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.943+0000 7fe94a458640 1 --2- 172.21.15.53:0/3604916596 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe94414f360 0x7fe9440c3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:12.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.943+0000 7fe94a458640 1 --2- 172.21.15.53:0/3604916596 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9441571a0 0x7fe9440b25e0 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:12.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.943+0000 7fe94a458640 1 --2- 172.21.15.53:0/3604916596 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9440afd10 0x7fe9440c4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:12.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.943+0000 7fe94a458640 1 -- 172.21.15.53:0/3604916596 >> 172.21.15.53:0/3604916596 conn(0x7fe9440ce9e0 msgr2=0x7fe9440af400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:12.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.943+0000 7fe94a458640 1 -- 172.21.15.53:0/3604916596 shutdown_connections 2023-06-10T19:02:12.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:12.943+0000 7fe94a458640 1 -- 172.21.15.53:0/3604916596 wait complete. 2023-06-10T19:02:12.961 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-10T19:02:13.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:13.071+0000 7fa1156ca640 1 Processor -- start 2023-06-10T19:02:13.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:13.075+0000 7fa1156ca640 1 -- start start 2023-06-10T19:02:13.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:13.075+0000 7fa1156ca640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa110159630 0x7fa11015d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:13.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:13.075+0000 7fa1156ca640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa110069450 0x7fa1100698f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:13.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:13.075+0000 7fa1156ca640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa110070f10 con 0x7fa1100ad730 2023-06-10T19:02:13.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:13.075+0000 7fa1156ca640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa11015db60 con 0x7fa110069450 2023-06-10T19:02:13.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:13.075+0000 7fa1156ca640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa11015de40 con 0x7fa110159630 2023-06-10T19:02:13.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:13.075+0000 7fa10f7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa110069450 0x7fa1100698f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:13.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:13.075+0000 7fa10f7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa110069450 0x7fa1100698f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40710/0 (socket says 172.21.15.53:40710) 2023-06-10T19:02:13.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:13.075+0000 7fa10f7fe640 1 -- 172.21.15.53:0/1782378905 learned_addr learned my addr 172.21.15.53:0/1782378905 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:13.079 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:13.075+0000 7fa10effd640 1 --2- 172.21.15.53:0/1782378905 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa110159630 0x7fa11015d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:13.079 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:13.075+0000 7fa10f7fe640 1 -- 172.21.15.53:0/1782378905 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa110159630 msgr2=0x7fa11015d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:13.079 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:13.075+0000 7fa10f7fe640 1 --2- 172.21.15.53:0/1782378905 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa110159630 0x7fa11015d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:13.079 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:13.075+0000 7fa10f7fe640 1 -- 172.21.15.53:0/1782378905 >> v1:172.21.15.117:6789/0 conn(0x7fa1100ad730 legacy=0x7fa1100713a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:13.079 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:13.075+0000 7fa10f7fe640 1 -- 172.21.15.53:0/1782378905 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa11015e120 con 0x7fa110069450 2023-06-10T19:02:13.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:13.075+0000 7fa10f7fe640 1 --2- 172.21.15.53:0/1782378905 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa110069450 0x7fa1100698f0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7fa108009e50 tx=0x7fa10801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d459576a1991ecf2 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:13.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:13.075+0000 7fa10e7fc640 1 -- 172.21.15.53:0/1782378905 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1080a5730 con 0x7fa110069450 2023-06-10T19:02:13.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:13.075+0000 7fa10e7fc640 1 -- 172.21.15.53:0/1782378905 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1080a5890 con 0x7fa110069450 2023-06-10T19:02:13.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:13.075+0000 7fa10e7fc640 1 -- 172.21.15.53:0/1782378905 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1080a5c20 con 0x7fa110069450 2023-06-10T19:02:13.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:13.079+0000 7fa1156ca640 1 -- 172.21.15.53:0/1782378905 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa110069450 msgr2=0x7fa1100698f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:13.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:13.079+0000 7fa1156ca640 1 --2- 172.21.15.53:0/1782378905 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa110069450 0x7fa1100698f0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7fa108009e50 tx=0x7fa10801c9a0 comp rx=0 tx=0).stop 2023-06-10T19:02:13.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:13.079+0000 7fa1156ca640 1 -- 172.21.15.53:0/1782378905 shutdown_connections 2023-06-10T19:02:13.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:13.079+0000 7fa1156ca640 1 --2- 172.21.15.53:0/1782378905 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa110069450 0x7fa1100698f0 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:13.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:13.079+0000 7fa1156ca640 1 --2- 172.21.15.53:0/1782378905 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa110159630 0x7fa11015d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:13.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:13.079+0000 7fa1156ca640 1 -- 172.21.15.53:0/1782378905 >> 172.21.15.53:0/1782378905 conn(0x7fa1100cafc0 msgr2=0x7fa1100cb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:13.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:13.079+0000 7fa1156ca640 1 -- 172.21.15.53:0/1782378905 shutdown_connections 2023-06-10T19:02:13.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:13.079+0000 7fa1156ca640 1 -- 172.21.15.53:0/1782378905 wait complete. 2023-06-10T19:02:13.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:13.079+0000 7fa1156ca640 1 Processor -- start 2023-06-10T19:02:13.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:13.079+0000 7fa1156ca640 1 -- start start 2023-06-10T19:02:13.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:13.079+0000 7fa1156ca640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa110069450 0x7fa110150800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:13.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:13.079+0000 7fa1156ca640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1100ad730 0x7fa11015af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:13.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:13.079+0000 7fa1156ca640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa110159630 0x7fa11014f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:13.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:13.079+0000 7fa1156ca640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa110156d90 con 0x7fa110069450 2023-06-10T19:02:13.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:13.079+0000 7fa1156ca640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa110156a80 con 0x7fa1100ad730 2023-06-10T19:02:13.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:13.079+0000 7fa1156ca640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa11015c6e0 con 0x7fa110159630 2023-06-10T19:02:13.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:13.079+0000 7fa10effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa110069450 0x7fa110150800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:13.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:13.079+0000 7fa107fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1100ad730 0x7fa11015af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:13.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:13.079+0000 7fa10effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa110069450 0x7fa110150800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40726/0 (socket says 172.21.15.53:40726) 2023-06-10T19:02:13.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:13.079+0000 7fa10effd640 1 -- 172.21.15.53:0/2689773930 learned_addr learned my addr 172.21.15.53:0/2689773930 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:13.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:13.079+0000 7fa10f7fe640 1 --2- 172.21.15.53:0/2689773930 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa110159630 0x7fa11014f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:13.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:13.079+0000 7fa10effd640 1 -- 172.21.15.53:0/2689773930 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa110159630 msgr2=0x7fa11014f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:13.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:13.079+0000 7fa10effd640 1 --2- 172.21.15.53:0/2689773930 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa110159630 0x7fa11014f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:13.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:13.079+0000 7fa10effd640 1 -- 172.21.15.53:0/2689773930 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1100ad730 msgr2=0x7fa11015af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:13.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:13.079+0000 7fa10effd640 1 --2- 172.21.15.53:0/2689773930 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1100ad730 0x7fa11015af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:13.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:13.079+0000 7fa10effd640 1 -- 172.21.15.53:0/2689773930 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa108009b30 con 0x7fa110069450 2023-06-10T19:02:13.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:13.079+0000 7fa10effd640 1 --2- 172.21.15.53:0/2689773930 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa110069450 0x7fa110150800 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7fa10000c7f0 tx=0x7fa10000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:13.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:13.079+0000 7fa1077fe640 1 -- 172.21.15.53:0/2689773930 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa100007820 con 0x7fa110069450 2023-06-10T19:02:13.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:13.079+0000 7fa1077fe640 1 -- 172.21.15.53:0/2689773930 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa100007980 con 0x7fa110069450 2023-06-10T19:02:13.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:13.079+0000 7fa1077fe640 1 -- 172.21.15.53:0/2689773930 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa100007d30 con 0x7fa110069450 2023-06-10T19:02:13.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:13.079+0000 7fa1156ca640 1 -- 172.21.15.53:0/2689773930 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa11015c9c0 con 0x7fa110069450 2023-06-10T19:02:13.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:13.079+0000 7fa1156ca640 1 -- 172.21.15.53:0/2689773930 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa11015c3b0 con 0x7fa110069450 2023-06-10T19:02:13.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:13.083+0000 7fa1156ca640 1 -- 172.21.15.53:0/2689773930 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1100cbd00 con 0x7fa110069450 2023-06-10T19:02:13.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:13.083+0000 7fa1077fe640 1 -- 172.21.15.53:0/2689773930 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa1000113f0 con 0x7fa110069450 2023-06-10T19:02:13.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:13.083+0000 7fa1077fe640 1 --2- 172.21.15.53:0/2689773930 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa0f00662b0 0x7fa0f0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:13.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:13.083+0000 7fa1077fe640 1 -- 172.21.15.53:0/2689773930 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa100083ed0 con 0x7fa110069450 2023-06-10T19:02:13.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:13.083+0000 7fa107fff640 1 --2- 172.21.15.53:0/2689773930 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa0f00662b0 0x7fa0f0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:13.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:13.083+0000 7fa107fff640 1 --2- 172.21.15.53:0/2689773930 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa0f00662b0 0x7fa0f0068760 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fa1100c9620 tx=0x7fa0f8007e40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:13.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:13.087+0000 7fa1077fe640 1 -- 172.21.15.53:0/2689773930 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa100051400 con 0x7fa110069450 2023-06-10T19:02:13.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:13.279+0000 7fa1156ca640 1 -- 172.21.15.53:0/2689773930 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa11004d790 con 0x7fa110069450 2023-06-10T19:02:13.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:13.279+0000 7fa1077fe640 1 -- 172.21.15.53:0/2689773930 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v48) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa10001f070 con 0x7fa110069450 2023-06-10T19:02:13.280 INFO:teuthology.orchestra.run.smithi053.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-06-10T19:02:13.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:13.279+0000 7fa1156ca640 1 -- 172.21.15.53:0/2689773930 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa0f00662b0 msgr2=0x7fa0f0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:13.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:13.279+0000 7fa1156ca640 1 --2- 172.21.15.53:0/2689773930 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa0f00662b0 0x7fa0f0068760 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fa1100c9620 tx=0x7fa0f8007e40 comp rx=0 tx=0).stop 2023-06-10T19:02:13.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:13.279+0000 7fa1156ca640 1 -- 172.21.15.53:0/2689773930 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa110069450 msgr2=0x7fa110150800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:13.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:13.279+0000 7fa1156ca640 1 --2- 172.21.15.53:0/2689773930 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa110069450 0x7fa110150800 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7fa10000c7f0 tx=0x7fa10000ccb0 comp rx=0 tx=0).stop 2023-06-10T19:02:13.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:13.279+0000 7fa1156ca640 1 -- 172.21.15.53:0/2689773930 shutdown_connections 2023-06-10T19:02:13.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:13.279+0000 7fa1156ca640 1 --2- 172.21.15.53:0/2689773930 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa0f00662b0 0x7fa0f0068760 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:13.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:13.279+0000 7fa1156ca640 1 --2- 172.21.15.53:0/2689773930 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa110159630 0x7fa11014f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:13.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:13.279+0000 7fa1156ca640 1 --2- 172.21.15.53:0/2689773930 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1100ad730 0x7fa11015af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:13.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:13.279+0000 7fa1156ca640 1 --2- 172.21.15.53:0/2689773930 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa110069450 0x7fa110150800 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:13.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:13.279+0000 7fa1156ca640 1 -- 172.21.15.53:0/2689773930 >> 172.21.15.53:0/2689773930 conn(0x7fa1100cafc0 msgr2=0x7fa1100b1390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:13.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:13.279+0000 7fa1156ca640 1 -- 172.21.15.53:0/2689773930 shutdown_connections 2023-06-10T19:02:13.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:13.279+0000 7fa1156ca640 1 -- 172.21.15.53:0/2689773930 wait complete. 2023-06-10T19:02:13.299 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-10T19:02:13.299 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-10T19:02:13.299 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi053.front.sepia.ceph.com 2023-06-10T19:02:13.300 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-06-10T19:02:13.300 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-06-10T19:02:13.300 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-10T19:02:13.301 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-10T19:02:13.301 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-10T19:02:13.301 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-06-10T19:02:13.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:02:13.302 DEBUG:teuthology.orchestra.run.smithi053:> ip addr 2023-06-10T19:02:13.308 INFO:teuthology.orchestra.run.smithi053.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-10T19:02:13.308 INFO:teuthology.orchestra.run.smithi053.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-10T19:02:13.309 INFO:teuthology.orchestra.run.smithi053.stdout: inet 127.0.0.1/8 scope host lo 2023-06-10T19:02:13.309 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:02:13.309 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 ::1/128 scope host 2023-06-10T19:02:13.309 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:02:13.309 INFO:teuthology.orchestra.run.smithi053.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T19:02:13.309 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:da brd ff:ff:ff:ff:ff:ff 2023-06-10T19:02:13.309 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f0 2023-06-10T19:02:13.310 INFO:teuthology.orchestra.run.smithi053.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T19:02:13.310 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:db brd ff:ff:ff:ff:ff:ff 2023-06-10T19:02:13.310 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f1 2023-06-10T19:02:13.310 INFO:teuthology.orchestra.run.smithi053.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-10T19:02:13.310 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:18 brd ff:ff:ff:ff:ff:ff 2023-06-10T19:02:13.310 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f0 2023-06-10T19:02:13.310 INFO:teuthology.orchestra.run.smithi053.stdout: inet 172.21.15.53/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-06-10T19:02:13.311 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft 41916sec preferred_lft 41916sec 2023-06-10T19:02:13.311 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::ae1f:6bff:fef8:3718/64 scope link 2023-06-10T19:02:13.311 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:02:13.311 INFO:teuthology.orchestra.run.smithi053.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T19:02:13.311 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:19 brd ff:ff:ff:ff:ff:ff 2023-06-10T19:02:13.311 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f1 2023-06-10T19:02:13.311 INFO:teuthology.orchestra.run.smithi053.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-06-10T19:02:13.312 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 02:42:49:3d:ee:1e brd ff:ff:ff:ff:ff:ff 2023-06-10T19:02:13.312 INFO:teuthology.orchestra.run.smithi053.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-06-10T19:02:13.312 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:02:13.312 INFO:teuthology.orchestra.run.smithi053.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-10T19:02:13.312 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-06-10T19:02:13.312 INFO:teuthology.orchestra.run.smithi053.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-06-10T19:02:13.312 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:02:13.313 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-06-10T19:02:13.313 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:02:13.313 INFO:teuthology.orchestra.run.smithi053.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state DOWN group default qlen 1000 2023-06-10T19:02:13.313 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-06-10T19:02:13.313 INFO:teuthology.orchestra.run.smithi053.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-10T19:02:13.313 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-06-10T19:02:13.313 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-06-10T19:02:13.313 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:02:13.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:02:13.314 DEBUG:teuthology.orchestra.run.smithi053:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-10T19:02:13.360 INFO:teuthology.orchestra.run.smithi053.stdout:1 2023-06-10T19:02:13.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:02:13.362 DEBUG:teuthology.orchestra.run.smithi053:> route 2023-06-10T19:02:13.413 INFO:teuthology.orchestra.run.smithi053.stdout:Kernel IP routing table 2023-06-10T19:02:13.413 INFO:teuthology.orchestra.run.smithi053.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-10T19:02:13.413 INFO:teuthology.orchestra.run.smithi053.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-06-10T19:02:13.414 INFO:teuthology.orchestra.run.smithi053.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-06-10T19:02:13.414 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-06-10T19:02:13.414 INFO:teuthology.orchestra.run.smithi053.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-10T19:02:13.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:02:13.415 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec bash -c ' 2023-06-10T19:02:13.415 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2023-06-10T19:02:13.415 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-06-10T19:02:13.415 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-06-10T19:02:13.416 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-06-10T19:02:13.416 DEBUG:teuthology.orchestra.run.smithi053:> ') 2023-06-10T19:02:13.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:02:13.489 DEBUG:teuthology.orchestra.run.smithi053:> ip netns list 2023-06-10T19:02:13.536 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-06-10T19:02:13.536 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-06-10T19:02:13.536 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-06-10T19:02:13.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:02:13.537 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link set brx.0 up 2023-06-10T19:02:13.593 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-06-10T19:02:13.593 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-10T19:02:13.594 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-06-10T19:02:13.640 INFO:teuthology.orchestra.run.smithi053.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-06-10T19:02:13.640 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-10T19:02:13.641 DEBUG:teuthology.orchestra.run.smithi053:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-06-10T19:02:13.687 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2023-06-10T19:02:13.744 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T19:02:13.745 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T19:02:13.799 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T19:02:13.800 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T19:02:13.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:02:13.801 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2023-06-10T19:02:13.852 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-06-10T19:02:13.852 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-06-10T19:02:13.901 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2023-06-10T19:02:13.916 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T19:02:13.917 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T19:02:13.970 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T19:02:13.971 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T19:02:13.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:02:13.973 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2023-06-10T19:02:14.209 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:2023-06-10T19:02:14.207+0000 7f4aa91a2580 -1 init, newargv = 0x564c2f68dce0 newargc=15 2023-06-10T19:02:14.209 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[57694]: starting ceph client 2023-06-10T19:02:14.216 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[57694]: starting fuse 2023-06-10T19:02:15.121 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2023-06-10T19:02:15.137 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T19:02:15.138 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T19:02:15.191 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T19:02:15.192 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T19:02:15.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:02:15.193 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2023-06-10T19:02:15.240 INFO:teuthology.orchestra.run.smithi053.stdout:45 2023-06-10T19:02:15.240 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-06-10T19:02:15.241 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-06-10T19:02:15.241 DEBUG:teuthology.orchestra.run.smithi053:> import glob 2023-06-10T19:02:15.241 DEBUG:teuthology.orchestra.run.smithi053:> import re 2023-06-10T19:02:15.242 DEBUG:teuthology.orchestra.run.smithi053:> import os 2023-06-10T19:02:15.242 DEBUG:teuthology.orchestra.run.smithi053:> import subprocess 2023-06-10T19:02:15.242 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:02:15.242 DEBUG:teuthology.orchestra.run.smithi053:> def _find_admin_socket(client_name): 2023-06-10T19:02:15.243 DEBUG:teuthology.orchestra.run.smithi053:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-06-10T19:02:15.243 DEBUG:teuthology.orchestra.run.smithi053:> files = glob.glob(asok_path) 2023-06-10T19:02:15.243 DEBUG:teuthology.orchestra.run.smithi053:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-06-10T19:02:15.244 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:02:15.244 DEBUG:teuthology.orchestra.run.smithi053:> # Given a non-glob path, it better be there 2023-06-10T19:02:15.244 DEBUG:teuthology.orchestra.run.smithi053:> if "*" not in asok_path: 2023-06-10T19:02:15.244 DEBUG:teuthology.orchestra.run.smithi053:> assert(len(files) == 1) 2023-06-10T19:02:15.245 DEBUG:teuthology.orchestra.run.smithi053:> return files[0] 2023-06-10T19:02:15.245 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:02:15.245 DEBUG:teuthology.orchestra.run.smithi053:> for f in files: 2023-06-10T19:02:15.246 DEBUG:teuthology.orchestra.run.smithi053:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-06-10T19:02:15.246 DEBUG:teuthology.orchestra.run.smithi053:> if os.path.exists("/proc/{0}".format(pid)): 2023-06-10T19:02:15.247 DEBUG:teuthology.orchestra.run.smithi053:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-06-10T19:02:15.247 DEBUG:teuthology.orchestra.run.smithi053:> contents = proc_f.read() 2023-06-10T19:02:15.247 DEBUG:teuthology.orchestra.run.smithi053:> if mountpoint in contents: 2023-06-10T19:02:15.247 DEBUG:teuthology.orchestra.run.smithi053:> return f 2023-06-10T19:02:15.248 DEBUG:teuthology.orchestra.run.smithi053:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-06-10T19:02:15.248 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:02:15.248 DEBUG:teuthology.orchestra.run.smithi053:> print(_find_admin_socket("client.0")) 2023-06-10T19:02:15.249 DEBUG:teuthology.orchestra.run.smithi053:> ' 2023-06-10T19:02:15.365 INFO:teuthology.orchestra.run.smithi053.stdout:/var/run/ceph/ceph-client.0.57694.asok 2023-06-10T19:02:15.547 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.57694.asok 2023-06-10T19:02:15.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:02:15.547 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.57694.asok status 2023-06-10T19:02:15.707 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-06-10T19:02:15.708 INFO:teuthology.orchestra.run.smithi053.stdout: "metadata": { 2023-06-10T19:02:15.708 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_sha1": "219d315c3a0b2075e570fb1964be2ad33fe7a9c8", 2023-06-10T19:02:15.708 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_version": "ceph version 18.0.0-4359-g219d315c (219d315c3a0b2075e570fb1964be2ad33fe7a9c8) reef (dev)", 2023-06-10T19:02:15.708 INFO:teuthology.orchestra.run.smithi053.stdout: "entity_id": "0", 2023-06-10T19:02:15.708 INFO:teuthology.orchestra.run.smithi053.stdout: "hostname": "smithi053", 2023-06-10T19:02:15.708 INFO:teuthology.orchestra.run.smithi053.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-06-10T19:02:15.709 INFO:teuthology.orchestra.run.smithi053.stdout: "pid": "57694", 2023-06-10T19:02:15.709 INFO:teuthology.orchestra.run.smithi053.stdout: "root": "/" 2023-06-10T19:02:15.709 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:02:15.709 INFO:teuthology.orchestra.run.smithi053.stdout: "dentry_count": 0, 2023-06-10T19:02:15.709 INFO:teuthology.orchestra.run.smithi053.stdout: "dentry_pinned_count": 0, 2023-06-10T19:02:15.709 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 8031, 2023-06-10T19:02:15.709 INFO:teuthology.orchestra.run.smithi053.stdout: "inst": { 2023-06-10T19:02:15.709 INFO:teuthology.orchestra.run.smithi053.stdout: "name": { 2023-06-10T19:02:15.710 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "client", 2023-06-10T19:02:15.710 INFO:teuthology.orchestra.run.smithi053.stdout: "num": 8031 2023-06-10T19:02:15.710 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:02:15.710 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": { 2023-06-10T19:02:15.710 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2023-06-10T19:02:15.710 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "192.168.0.1:0", 2023-06-10T19:02:15.710 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 3897417564 2023-06-10T19:02:15.710 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:02:15.711 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:02:15.711 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": { 2023-06-10T19:02:15.711 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2023-06-10T19:02:15.711 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "192.168.0.1:0", 2023-06-10T19:02:15.711 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 3897417564 2023-06-10T19:02:15.711 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:02:15.711 INFO:teuthology.orchestra.run.smithi053.stdout: "inst_str": "client.8031 192.168.0.1:0/3897417564", 2023-06-10T19:02:15.711 INFO:teuthology.orchestra.run.smithi053.stdout: "addr_str": "192.168.0.1:0/3897417564", 2023-06-10T19:02:15.712 INFO:teuthology.orchestra.run.smithi053.stdout: "inode_count": 1, 2023-06-10T19:02:15.712 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_epoch": 48, 2023-06-10T19:02:15.712 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_epoch": 94, 2023-06-10T19:02:15.712 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_epoch_barrier": 0, 2023-06-10T19:02:15.712 INFO:teuthology.orchestra.run.smithi053.stdout: "blocklisted": false, 2023-06-10T19:02:15.712 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs" 2023-06-10T19:02:15.712 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-06-10T19:02:15.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:02:15.721 DEBUG:teuthology.orchestra.run.smithi053:> stat --file-system '--printf=%T 2023-06-10T19:02:15.722 DEBUG:teuthology.orchestra.run.smithi053:> ' -- /home/ubuntu/cephtest/mnt.0 2023-06-10T19:02:15.727 INFO:teuthology.orchestra.run.smithi053.stdout:fuseblk 2023-06-10T19:02:15.727 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-06-10T19:02:15.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:02:15.728 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-06-10T19:02:15.784 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-10T19:02:15.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:15.951+0000 7fd7d41f7640 1 Processor -- start 2023-06-10T19:02:15.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:15.951+0000 7fd7d41f7640 1 -- start start 2023-06-10T19:02:15.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:15.951+0000 7fd7d41f7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd7cc0b3ac0 0x7fd7cc0b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:15.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:15.951+0000 7fd7d41f7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7cc0cc690 0x7fd7cc15f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:15.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:15.951+0000 7fd7d41f7640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd7cc0ccae0 0x7fd7cc15f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:15.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:15.951+0000 7fd7d41f7640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7cc0d0020 con 0x7fd7cc0b3ac0 2023-06-10T19:02:15.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:15.951+0000 7fd7d41f7640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7cc0b43d0 con 0x7fd7cc0ccae0 2023-06-10T19:02:15.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:15.951+0000 7fd7d41f7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7cc0cef40 con 0x7fd7cc0cc690 2023-06-10T19:02:15.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:15.951+0000 7fd7d1f93640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd7cc0b3ac0 0x7fd7cc0b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:15.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:15.951+0000 7fd7d1f93640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd7cc0b3ac0 0x7fd7cc0b3e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40732/0 (socket says 172.21.15.53:40732) 2023-06-10T19:02:15.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:15.951+0000 7fd7d1f93640 1 -- 172.21.15.53:0/115578515 learned_addr learned my addr 172.21.15.53:0/115578515 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:15.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:15.951+0000 7fd7d2794640 1 --2- 172.21.15.53:0/115578515 >> v2:172.21.15.117:3300/0 conn(0x7fd7cc0ccae0 0x7fd7cc15f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:15.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:15.951+0000 7fd7d1792640 1 --2- 172.21.15.53:0/115578515 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7cc0cc690 0x7fd7cc15f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:15.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:15.951+0000 7fd7d1f93640 1 -- 172.21.15.53:0/115578515 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7cc0cc690 msgr2=0x7fd7cc15f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:15.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:15.951+0000 7fd7d1f93640 1 --2- 172.21.15.53:0/115578515 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7cc0cc690 0x7fd7cc15f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:15.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:15.951+0000 7fd7d1f93640 1 -- 172.21.15.53:0/115578515 >> v2:172.21.15.117:3300/0 conn(0x7fd7cc0ccae0 msgr2=0x7fd7cc15f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:15.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:15.951+0000 7fd7d1f93640 1 --2- 172.21.15.53:0/115578515 >> v2:172.21.15.117:3300/0 conn(0x7fd7cc0ccae0 0x7fd7cc15f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:15.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:15.951+0000 7fd7d1f93640 1 -- 172.21.15.53:0/115578515 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7cc0cf220 con 0x7fd7cc0b3ac0 2023-06-10T19:02:15.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:15.955+0000 7fd7d1f93640 1 --2- 172.21.15.53:0/115578515 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7cc0b3ac0 0x7fd7cc0b3e90 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc0b14a0 tx=0x7fd7bc01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f519fbb2a552e6a5 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:15.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:15.955+0000 7fd7d0f91640 1 -- 172.21.15.53:0/115578515 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7bc0ac600 con 0x7fd7cc0b3ac0 2023-06-10T19:02:15.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:15.955+0000 7fd7d0f91640 1 -- 172.21.15.53:0/115578515 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7bc0a8050 con 0x7fd7cc0b3ac0 2023-06-10T19:02:15.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:15.955+0000 7fd7d0f91640 1 -- 172.21.15.53:0/115578515 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7bc0ac980 con 0x7fd7cc0b3ac0 2023-06-10T19:02:15.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:15.955+0000 7fd7d41f7640 1 -- 172.21.15.53:0/115578515 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7cc0b3ac0 msgr2=0x7fd7cc0b3e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:15.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:15.955+0000 7fd7d41f7640 1 --2- 172.21.15.53:0/115578515 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7cc0b3ac0 0x7fd7cc0b3e90 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc0b14a0 tx=0x7fd7bc01c4d0 comp rx=0 tx=0).stop 2023-06-10T19:02:15.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:15.955+0000 7fd7d41f7640 1 -- 172.21.15.53:0/115578515 shutdown_connections 2023-06-10T19:02:15.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:15.955+0000 7fd7d41f7640 1 --2- 172.21.15.53:0/115578515 >> v2:172.21.15.117:3300/0 conn(0x7fd7cc0ccae0 0x7fd7cc15f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:15.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:15.955+0000 7fd7d41f7640 1 --2- 172.21.15.53:0/115578515 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7cc0cc690 0x7fd7cc15f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:15.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:15.955+0000 7fd7d41f7640 1 --2- 172.21.15.53:0/115578515 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7cc0b3ac0 0x7fd7cc0b3e90 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:15.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:15.955+0000 7fd7d41f7640 1 -- 172.21.15.53:0/115578515 >> 172.21.15.53:0/115578515 conn(0x7fd7cc071790 msgr2=0x7fd7cc069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:15.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:15.955+0000 7fd7d41f7640 1 -- 172.21.15.53:0/115578515 shutdown_connections 2023-06-10T19:02:15.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:15.955+0000 7fd7d41f7640 1 -- 172.21.15.53:0/115578515 wait complete. 2023-06-10T19:02:15.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:15.955+0000 7fd7d41f7640 1 Processor -- start 2023-06-10T19:02:15.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:15.955+0000 7fd7d41f7640 1 -- start start 2023-06-10T19:02:15.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:15.955+0000 7fd7d41f7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7cc0b3ac0 0x7fd7cc154e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:15.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:15.955+0000 7fd7d41f7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7cc0cc690 0x7fd7cc152990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:15.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:15.955+0000 7fd7d41f7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7cc0ccae0 0x7fd7cc1530d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:15.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:15.955+0000 7fd7d41f7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7cc1566a0 con 0x7fd7cc0b3ac0 2023-06-10T19:02:15.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:15.955+0000 7fd7d41f7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7cc15e610 con 0x7fd7cc0cc690 2023-06-10T19:02:15.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:15.955+0000 7fd7d41f7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7cc152ed0 con 0x7fd7cc0ccae0 2023-06-10T19:02:15.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:15.955+0000 7fd7d1f93640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7cc0b3ac0 0x7fd7cc154e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:15.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:15.955+0000 7fd7d1f93640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7cc0b3ac0 0x7fd7cc154e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40742/0 (socket says 172.21.15.53:40742) 2023-06-10T19:02:15.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:15.955+0000 7fd7d1f93640 1 -- 172.21.15.53:0/2764610044 learned_addr learned my addr 172.21.15.53:0/2764610044 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:15.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:15.955+0000 7fd7d1792640 1 --2- 172.21.15.53:0/2764610044 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7cc0cc690 0x7fd7cc152990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:15.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:15.955+0000 7fd7d2794640 1 --2- 172.21.15.53:0/2764610044 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7cc0ccae0 0x7fd7cc1530d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:15.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:15.955+0000 7fd7d1f93640 1 -- 172.21.15.53:0/2764610044 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7cc0ccae0 msgr2=0x7fd7cc1530d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:15.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:15.955+0000 7fd7d1f93640 1 --2- 172.21.15.53:0/2764610044 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7cc0ccae0 0x7fd7cc1530d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:15.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:15.955+0000 7fd7d1f93640 1 -- 172.21.15.53:0/2764610044 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7cc0cc690 msgr2=0x7fd7cc152990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:15.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:15.955+0000 7fd7d1f93640 1 --2- 172.21.15.53:0/2764610044 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7cc0cc690 0x7fd7cc152990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:15.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:15.955+0000 7fd7d1f93640 1 -- 172.21.15.53:0/2764610044 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7bc0094d0 con 0x7fd7cc0b3ac0 2023-06-10T19:02:15.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:15.955+0000 7fd7d2794640 1 --2- 172.21.15.53:0/2764610044 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7cc0ccae0 0x7fd7cc1530d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:02:15.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:15.959+0000 7fd7d1f93640 1 --2- 172.21.15.53:0/2764610044 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7cc0b3ac0 0x7fd7cc154e20 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc0097c0 tx=0x7fd7bc01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:15.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:15.959+0000 7fd7c27fc640 1 -- 172.21.15.53:0/2764610044 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7bc0b7650 con 0x7fd7cc0b3ac0 2023-06-10T19:02:15.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:15.959+0000 7fd7c27fc640 1 -- 172.21.15.53:0/2764610044 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7bc0b77b0 con 0x7fd7cc0b3ac0 2023-06-10T19:02:15.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:15.959+0000 7fd7c27fc640 1 -- 172.21.15.53:0/2764610044 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7bc0b7b60 con 0x7fd7cc0b3ac0 2023-06-10T19:02:15.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:15.959+0000 7fd7d41f7640 1 -- 172.21.15.53:0/2764610044 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7cc15da00 con 0x7fd7cc0b3ac0 2023-06-10T19:02:15.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:15.959+0000 7fd7d41f7640 1 -- 172.21.15.53:0/2764610044 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7cc15dfc0 con 0x7fd7cc0b3ac0 2023-06-10T19:02:15.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:15.959+0000 7fd7d41f7640 1 -- 172.21.15.53:0/2764610044 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7cc04d790 con 0x7fd7cc0b3ac0 2023-06-10T19:02:15.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:15.959+0000 7fd7c27fc640 1 -- 172.21.15.53:0/2764610044 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd7bc0b3070 con 0x7fd7cc0b3ac0 2023-06-10T19:02:15.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:15.959+0000 7fd7c27fc640 1 --2- 172.21.15.53:0/2764610044 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd7b0066280 0x7fd7b0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:15.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:15.959+0000 7fd7c27fc640 1 -- 172.21.15.53:0/2764610044 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd7bc11e4e0 con 0x7fd7cc0b3ac0 2023-06-10T19:02:15.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:15.959+0000 7fd7d1792640 1 --2- 172.21.15.53:0/2764610044 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd7b0066280 0x7fd7b0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:15.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:15.959+0000 7fd7d1792640 1 --2- 172.21.15.53:0/2764610044 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd7b0066280 0x7fd7b0068730 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc15eb90 tx=0x7fd7c8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:15.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:15.963+0000 7fd7c27fc640 1 -- 172.21.15.53:0/2764610044 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd7bc0eb830 con 0x7fd7cc0b3ac0 2023-06-10T19:02:16.154 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:16.151+0000 7fd7d41f7640 1 -- 172.21.15.53:0/2764610044 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd7cc08a200 con 0x7fd7cc0b3ac0 2023-06-10T19:02:16.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:16.151+0000 7fd7c27fc640 1 -- 172.21.15.53:0/2764610044 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v48) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd7bc0b1060 con 0x7fd7cc0b3ac0 2023-06-10T19:02:16.155 INFO:teuthology.orchestra.run.smithi053.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-06-10T19:02:16.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:16.155+0000 7fd7d41f7640 1 -- 172.21.15.53:0/2764610044 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd7b0066280 msgr2=0x7fd7b0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:16.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:16.155+0000 7fd7d41f7640 1 --2- 172.21.15.53:0/2764610044 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd7b0066280 0x7fd7b0068730 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc15eb90 tx=0x7fd7c8008040 comp rx=0 tx=0).stop 2023-06-10T19:02:16.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:16.155+0000 7fd7d41f7640 1 -- 172.21.15.53:0/2764610044 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7cc0b3ac0 msgr2=0x7fd7cc154e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:16.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:16.155+0000 7fd7d41f7640 1 --2- 172.21.15.53:0/2764610044 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7cc0b3ac0 0x7fd7cc154e20 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc0097c0 tx=0x7fd7bc01ad10 comp rx=0 tx=0).stop 2023-06-10T19:02:16.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:16.155+0000 7fd7d41f7640 1 -- 172.21.15.53:0/2764610044 shutdown_connections 2023-06-10T19:02:16.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:16.155+0000 7fd7d41f7640 1 --2- 172.21.15.53:0/2764610044 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd7b0066280 0x7fd7b0068730 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:16.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:16.155+0000 7fd7d41f7640 1 --2- 172.21.15.53:0/2764610044 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7cc0ccae0 0x7fd7cc1530d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:16.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:16.155+0000 7fd7d41f7640 1 --2- 172.21.15.53:0/2764610044 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7cc0cc690 0x7fd7cc152990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:16.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:16.155+0000 7fd7d41f7640 1 --2- 172.21.15.53:0/2764610044 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7cc0b3ac0 0x7fd7cc154e20 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:16.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:16.155+0000 7fd7d41f7640 1 -- 172.21.15.53:0/2764610044 >> 172.21.15.53:0/2764610044 conn(0x7fd7cc071790 msgr2=0x7fd7cc0b6710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:16.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:16.155+0000 7fd7d41f7640 1 -- 172.21.15.53:0/2764610044 shutdown_connections 2023-06-10T19:02:16.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:16.155+0000 7fd7d41f7640 1 -- 172.21.15.53:0/2764610044 wait complete. 2023-06-10T19:02:16.174 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-10T19:02:16.174 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-10T19:02:16.175 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi117.front.sepia.ceph.com 2023-06-10T19:02:16.175 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-06-10T19:02:16.175 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-06-10T19:02:16.175 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-10T19:02:16.176 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-10T19:02:16.176 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-10T19:02:16.176 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-06-10T19:02:16.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:02:16.177 DEBUG:teuthology.orchestra.run.smithi117:> ip addr 2023-06-10T19:02:16.183 INFO:teuthology.orchestra.run.smithi117.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-10T19:02:16.183 INFO:teuthology.orchestra.run.smithi117.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-10T19:02:16.184 INFO:teuthology.orchestra.run.smithi117.stdout: inet 127.0.0.1/8 scope host lo 2023-06-10T19:02:16.184 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:02:16.184 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 ::1/128 scope host 2023-06-10T19:02:16.184 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:02:16.184 INFO:teuthology.orchestra.run.smithi117.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T19:02:16.184 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8a brd ff:ff:ff:ff:ff:ff 2023-06-10T19:02:16.184 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f0 2023-06-10T19:02:16.185 INFO:teuthology.orchestra.run.smithi117.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T19:02:16.185 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8b brd ff:ff:ff:ff:ff:ff 2023-06-10T19:02:16.185 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f1 2023-06-10T19:02:16.185 INFO:teuthology.orchestra.run.smithi117.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T19:02:16.185 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:62 brd ff:ff:ff:ff:ff:ff 2023-06-10T19:02:16.185 INFO:teuthology.orchestra.run.smithi117.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-10T19:02:16.185 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:63 brd ff:ff:ff:ff:ff:ff 2023-06-10T19:02:16.185 INFO:teuthology.orchestra.run.smithi117.stdout: inet 172.21.15.117/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-06-10T19:02:16.186 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft 41913sec preferred_lft 41913sec 2023-06-10T19:02:16.186 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::ec4:7aff:fe8f:4463/64 scope link 2023-06-10T19:02:16.186 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:02:16.186 INFO:teuthology.orchestra.run.smithi117.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-06-10T19:02:16.186 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 02:42:f8:40:b2:dc brd ff:ff:ff:ff:ff:ff 2023-06-10T19:02:16.186 INFO:teuthology.orchestra.run.smithi117.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-06-10T19:02:16.186 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:02:16.186 INFO:teuthology.orchestra.run.smithi117.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-10T19:02:16.187 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-06-10T19:02:16.187 INFO:teuthology.orchestra.run.smithi117.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-06-10T19:02:16.187 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:02:16.187 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-06-10T19:02:16.187 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:02:16.187 INFO:teuthology.orchestra.run.smithi117.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-10T19:02:16.187 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-06-10T19:02:16.187 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-06-10T19:02:16.188 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:02:16.188 INFO:teuthology.orchestra.run.smithi117.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-10T19:02:16.188 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-06-10T19:02:16.188 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-06-10T19:02:16.188 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:02:16.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:02:16.189 DEBUG:teuthology.orchestra.run.smithi117:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-10T19:02:16.244 INFO:teuthology.orchestra.run.smithi117.stdout:1 2023-06-10T19:02:16.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:02:16.245 DEBUG:teuthology.orchestra.run.smithi117:> route 2023-06-10T19:02:16.294 INFO:teuthology.orchestra.run.smithi117.stdout:Kernel IP routing table 2023-06-10T19:02:16.294 INFO:teuthology.orchestra.run.smithi117.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-10T19:02:16.294 INFO:teuthology.orchestra.run.smithi117.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-06-10T19:02:16.295 INFO:teuthology.orchestra.run.smithi117.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-06-10T19:02:16.295 INFO:teuthology.orchestra.run.smithi117.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-06-10T19:02:16.295 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-06-10T19:02:16.295 INFO:teuthology.orchestra.run.smithi117.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-10T19:02:16.295 INFO:teuthology.orchestra.run.smithi117.stdout:ns2.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-10T19:02:16.295 INFO:teuthology.orchestra.run.smithi117.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-10T19:02:16.295 INFO:teuthology.orchestra.run.smithi117.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-10T19:02:16.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:02:16.296 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec bash -c ' 2023-06-10T19:02:16.297 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2023-06-10T19:02:16.297 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-06-10T19:02:16.297 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-06-10T19:02:16.297 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-06-10T19:02:16.298 DEBUG:teuthology.orchestra.run.smithi117:> ') 2023-06-10T19:02:16.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:02:16.371 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list 2023-06-10T19:02:16.421 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-06-10T19:02:16.421 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-06-10T19:02:16.421 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-06-10T19:02:16.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:02:16.422 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link set brx.0 up 2023-06-10T19:02:16.477 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-06-10T19:02:16.496 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-10T19:02:16.496 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-06-10T19:02:16.525 INFO:teuthology.orchestra.run.smithi117.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-06-10T19:02:16.525 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-10T19:02:16.525 DEBUG:teuthology.orchestra.run.smithi117:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-06-10T19:02:16.573 DEBUG:teuthology.orchestra.run.smithi117:> sudo modprobe fuse 2023-06-10T19:02:16.630 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T19:02:16.631 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T19:02:16.684 INFO:teuthology.orchestra.run.smithi117.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T19:02:16.685 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T19:02:16.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:02:16.686 DEBUG:teuthology.orchestra.run.smithi117:> ls /sys/fs/fuse/connections 2023-06-10T19:02:16.733 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-06-10T19:02:16.733 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-06-10T19:02:16.777 DEBUG:teuthology.orchestra.run.smithi117:> sudo modprobe fuse 2023-06-10T19:02:16.791 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T19:02:16.791 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T19:02:16.841 INFO:teuthology.orchestra.run.smithi117.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T19:02:16.842 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T19:02:16.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:02:16.843 DEBUG:teuthology.orchestra.run.smithi117:> ls /sys/fs/fuse/connections 2023-06-10T19:02:16.857 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi117.stderr:2023-06-10T19:02:16.853+0000 7fcc7ce65580 -1 init, newargv = 0x562151f740e0 newargc=15 2023-06-10T19:02:16.857 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi117.stderr:ceph-fuse[44872]: starting ceph client 2023-06-10T19:02:16.865 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi117.stderr:ceph-fuse[44872]: starting fuse 2023-06-10T19:02:17.962 DEBUG:teuthology.orchestra.run.smithi117:> sudo modprobe fuse 2023-06-10T19:02:17.977 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T19:02:17.978 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T19:02:18.036 INFO:teuthology.orchestra.run.smithi117.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T19:02:18.037 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T19:02:18.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:02:18.039 DEBUG:teuthology.orchestra.run.smithi117:> ls /sys/fs/fuse/connections 2023-06-10T19:02:18.084 INFO:teuthology.orchestra.run.smithi117.stdout:45 2023-06-10T19:02:18.085 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-06-10T19:02:18.085 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-06-10T19:02:18.085 DEBUG:teuthology.orchestra.run.smithi117:> import glob 2023-06-10T19:02:18.086 DEBUG:teuthology.orchestra.run.smithi117:> import re 2023-06-10T19:02:18.086 DEBUG:teuthology.orchestra.run.smithi117:> import os 2023-06-10T19:02:18.086 DEBUG:teuthology.orchestra.run.smithi117:> import subprocess 2023-06-10T19:02:18.087 DEBUG:teuthology.orchestra.run.smithi117:> 2023-06-10T19:02:18.087 DEBUG:teuthology.orchestra.run.smithi117:> def _find_admin_socket(client_name): 2023-06-10T19:02:18.087 DEBUG:teuthology.orchestra.run.smithi117:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-06-10T19:02:18.087 DEBUG:teuthology.orchestra.run.smithi117:> files = glob.glob(asok_path) 2023-06-10T19:02:18.088 DEBUG:teuthology.orchestra.run.smithi117:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-06-10T19:02:18.088 DEBUG:teuthology.orchestra.run.smithi117:> 2023-06-10T19:02:18.088 DEBUG:teuthology.orchestra.run.smithi117:> # Given a non-glob path, it better be there 2023-06-10T19:02:18.089 DEBUG:teuthology.orchestra.run.smithi117:> if "*" not in asok_path: 2023-06-10T19:02:18.091 DEBUG:teuthology.orchestra.run.smithi117:> assert(len(files) == 1) 2023-06-10T19:02:18.091 DEBUG:teuthology.orchestra.run.smithi117:> return files[0] 2023-06-10T19:02:18.092 DEBUG:teuthology.orchestra.run.smithi117:> 2023-06-10T19:02:18.092 DEBUG:teuthology.orchestra.run.smithi117:> for f in files: 2023-06-10T19:02:18.093 DEBUG:teuthology.orchestra.run.smithi117:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-06-10T19:02:18.093 DEBUG:teuthology.orchestra.run.smithi117:> if os.path.exists("/proc/{0}".format(pid)): 2023-06-10T19:02:18.093 DEBUG:teuthology.orchestra.run.smithi117:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-06-10T19:02:18.094 DEBUG:teuthology.orchestra.run.smithi117:> contents = proc_f.read() 2023-06-10T19:02:18.094 DEBUG:teuthology.orchestra.run.smithi117:> if mountpoint in contents: 2023-06-10T19:02:18.094 DEBUG:teuthology.orchestra.run.smithi117:> return f 2023-06-10T19:02:18.094 DEBUG:teuthology.orchestra.run.smithi117:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-06-10T19:02:18.095 DEBUG:teuthology.orchestra.run.smithi117:> 2023-06-10T19:02:18.095 DEBUG:teuthology.orchestra.run.smithi117:> print(_find_admin_socket("client.1")) 2023-06-10T19:02:18.095 DEBUG:teuthology.orchestra.run.smithi117:> ' 2023-06-10T19:02:18.204 INFO:teuthology.orchestra.run.smithi117.stdout:/var/run/ceph/ceph-client.1.44872.asok 2023-06-10T19:02:18.388 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.44872.asok 2023-06-10T19:02:18.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:02:18.389 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.44872.asok status 2023-06-10T19:02:18.544 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2023-06-10T19:02:18.544 INFO:teuthology.orchestra.run.smithi117.stdout: "metadata": { 2023-06-10T19:02:18.545 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_sha1": "219d315c3a0b2075e570fb1964be2ad33fe7a9c8", 2023-06-10T19:02:18.545 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_version": "ceph version 18.0.0-4359-g219d315c (219d315c3a0b2075e570fb1964be2ad33fe7a9c8) reef (dev)", 2023-06-10T19:02:18.545 INFO:teuthology.orchestra.run.smithi117.stdout: "entity_id": "1", 2023-06-10T19:02:18.545 INFO:teuthology.orchestra.run.smithi117.stdout: "hostname": "smithi117", 2023-06-10T19:02:18.545 INFO:teuthology.orchestra.run.smithi117.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-06-10T19:02:18.545 INFO:teuthology.orchestra.run.smithi117.stdout: "pid": "44872", 2023-06-10T19:02:18.545 INFO:teuthology.orchestra.run.smithi117.stdout: "root": "/" 2023-06-10T19:02:18.545 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-06-10T19:02:18.546 INFO:teuthology.orchestra.run.smithi117.stdout: "dentry_count": 0, 2023-06-10T19:02:18.546 INFO:teuthology.orchestra.run.smithi117.stdout: "dentry_pinned_count": 0, 2023-06-10T19:02:18.546 INFO:teuthology.orchestra.run.smithi117.stdout: "id": 6194, 2023-06-10T19:02:18.546 INFO:teuthology.orchestra.run.smithi117.stdout: "inst": { 2023-06-10T19:02:18.546 INFO:teuthology.orchestra.run.smithi117.stdout: "name": { 2023-06-10T19:02:18.546 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "client", 2023-06-10T19:02:18.546 INFO:teuthology.orchestra.run.smithi117.stdout: "num": 6194 2023-06-10T19:02:18.547 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-06-10T19:02:18.547 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": { 2023-06-10T19:02:18.547 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "v1", 2023-06-10T19:02:18.547 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": "192.168.0.1:0", 2023-06-10T19:02:18.547 INFO:teuthology.orchestra.run.smithi117.stdout: "nonce": 3032972211 2023-06-10T19:02:18.547 INFO:teuthology.orchestra.run.smithi117.stdout: } 2023-06-10T19:02:18.547 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-06-10T19:02:18.547 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": { 2023-06-10T19:02:18.548 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "v1", 2023-06-10T19:02:18.548 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": "192.168.0.1:0", 2023-06-10T19:02:18.548 INFO:teuthology.orchestra.run.smithi117.stdout: "nonce": 3032972211 2023-06-10T19:02:18.548 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-06-10T19:02:18.548 INFO:teuthology.orchestra.run.smithi117.stdout: "inst_str": "client.6194 192.168.0.1:0/3032972211", 2023-06-10T19:02:18.548 INFO:teuthology.orchestra.run.smithi117.stdout: "addr_str": "192.168.0.1:0/3032972211", 2023-06-10T19:02:18.548 INFO:teuthology.orchestra.run.smithi117.stdout: "inode_count": 1, 2023-06-10T19:02:18.549 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_epoch": 48, 2023-06-10T19:02:18.549 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_epoch": 94, 2023-06-10T19:02:18.549 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_epoch_barrier": 0, 2023-06-10T19:02:18.549 INFO:teuthology.orchestra.run.smithi117.stdout: "blocklisted": false, 2023-06-10T19:02:18.549 INFO:teuthology.orchestra.run.smithi117.stdout: "fs_name": "cephfs" 2023-06-10T19:02:18.549 INFO:teuthology.orchestra.run.smithi117.stdout:} 2023-06-10T19:02:18.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:02:18.558 DEBUG:teuthology.orchestra.run.smithi117:> stat --file-system '--printf=%T 2023-06-10T19:02:18.558 DEBUG:teuthology.orchestra.run.smithi117:> ' -- /home/ubuntu/cephtest/mnt.1 2023-06-10T19:02:18.564 INFO:teuthology.orchestra.run.smithi117.stdout:fuseblk 2023-06-10T19:02:18.565 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-06-10T19:02:18.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:02:18.566 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-06-10T19:02:18.619 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config get mds_reconnect_timeout 2023-06-10T19:02:18.769 INFO:teuthology.orchestra.run.smithi053.stdout:{"mds_reconnect_timeout":"45.000000"} 2023-06-10T19:02:18.770 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_reconnect_timeout": "45.000000" } 2023-06-10T19:02:18.771 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config get ms_max_backoff 2023-06-10T19:02:18.908 INFO:teuthology.orchestra.run.smithi053.stdout:{"ms_max_backoff":"15.000000"} 2023-06-10T19:02:18.909 DEBUG:tasks.cephfs.filesystem:_json_asok output { "ms_max_backoff": "15.000000" } 2023-06-10T19:02:18.909 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T19:02:18.910 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:02:18.916 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:02:19.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.043+0000 7f43b2daf640 1 Processor -- start 2023-06-10T19:02:19.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.043+0000 7f43b2daf640 1 -- start start 2023-06-10T19:02:19.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.043+0000 7f43b2daf640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f43ac0b0f30 0x7f43ac070950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:19.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.043+0000 7f43b2daf640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f43ac159a60 0x7f43ac0c2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:19.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.043+0000 7f43b2daf640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43ac0cb080 con 0x7f43ac159690 2023-06-10T19:02:19.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.043+0000 7f43b2daf640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43ac070e90 con 0x7f43ac159a60 2023-06-10T19:02:19.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.043+0000 7f43b2daf640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43ac06d450 con 0x7f43ac0b0f30 2023-06-10T19:02:19.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.043+0000 7f43b0b4b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f43ac159690 0x7f43ac0cbe00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60890/0 (socket says 172.21.15.53:60890) 2023-06-10T19:02:19.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.043+0000 7f43b134c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f43ac159a60 0x7f43ac0c2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:19.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.043+0000 7f43b0b4b640 1 -- 172.21.15.53:0/560194680 learned_addr learned my addr 172.21.15.53:0/560194680 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:02:19.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.043+0000 7f43b134c640 1 -- 172.21.15.53:0/560194680 >> v2:172.21.15.117:3300/0 conn(0x7f43ac0b0f30 msgr2=0x7f43ac070950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:19.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.043+0000 7f43b134c640 1 --2- 172.21.15.53:0/560194680 >> v2:172.21.15.117:3300/0 conn(0x7f43ac0b0f30 0x7f43ac070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:19.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.043+0000 7f43b134c640 1 -- 172.21.15.53:0/560194680 >> v1:172.21.15.53:6789/0 conn(0x7f43ac159690 legacy=0x7f43ac0cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:19.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.043+0000 7f43b134c640 1 -- 172.21.15.53:0/560194680 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43ac0cb320 con 0x7f43ac159a60 2023-06-10T19:02:19.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.047+0000 7f43b134c640 1 --2- 172.21.15.53:0/560194680 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43ac159a60 0x7f43ac0c2900 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f43ac0cec80 tx=0x7f43a401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26b96c731418dd43 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:19.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.047+0000 7f43ab7fe640 1 -- 172.21.15.53:0/560194680 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a40a58b0 con 0x7f43ac159a60 2023-06-10T19:02:19.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.047+0000 7f43ab7fe640 1 -- 172.21.15.53:0/560194680 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43a40a5a10 con 0x7f43ac159a60 2023-06-10T19:02:19.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.047+0000 7f43ab7fe640 1 -- 172.21.15.53:0/560194680 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a40a5da0 con 0x7f43ac159a60 2023-06-10T19:02:19.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.047+0000 7f43b2daf640 1 -- 172.21.15.53:0/560194680 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43ac159a60 msgr2=0x7f43ac0c2900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:19.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.047+0000 7f43b2daf640 1 --2- 172.21.15.53:0/560194680 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43ac159a60 0x7f43ac0c2900 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f43ac0cec80 tx=0x7f43a401c8e0 comp rx=0 tx=0).stop 2023-06-10T19:02:19.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.047+0000 7f43b2daf640 1 -- 172.21.15.53:0/560194680 shutdown_connections 2023-06-10T19:02:19.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.047+0000 7f43b2daf640 1 --2- 172.21.15.53:0/560194680 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43ac159a60 0x7f43ac0c2900 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:19.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.047+0000 7f43b2daf640 1 --2- 172.21.15.53:0/560194680 >> v2:172.21.15.117:3300/0 conn(0x7f43ac0b0f30 0x7f43ac070950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:19.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.047+0000 7f43b2daf640 1 -- 172.21.15.53:0/560194680 >> 172.21.15.53:0/560194680 conn(0x7f43ac06a560 msgr2=0x7f43ac06a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:19.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.047+0000 7f43b2daf640 1 -- 172.21.15.53:0/560194680 shutdown_connections 2023-06-10T19:02:19.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.047+0000 7f43b2daf640 1 -- 172.21.15.53:0/560194680 wait complete. 2023-06-10T19:02:19.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.047+0000 7f43b2daf640 1 Processor -- start 2023-06-10T19:02:19.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.047+0000 7f43b2daf640 1 -- start start 2023-06-10T19:02:19.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.047+0000 7f43b2daf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43ac0b0f30 0x7f43ac159f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:19.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.047+0000 7f43b2daf640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f43ac159690 0x7f43ac0b4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:19.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.047+0000 7f43b2daf640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f43ac159a60 0x7f43ac0bf870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:19.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.047+0000 7f43b2daf640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43ac15c5d0 con 0x7f43ac0b0f30 2023-06-10T19:02:19.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.051+0000 7f43b2daf640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43ac15c8b0 con 0x7f43ac159a60 2023-06-10T19:02:19.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.051+0000 7f43b2daf640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43ac15cb90 con 0x7f43ac159690 2023-06-10T19:02:19.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.051+0000 7f43b0b4b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43ac0b0f30 0x7f43ac159f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:19.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.051+0000 7f43b0b4b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43ac0b0f30 0x7f43ac159f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40760/0 (socket says 172.21.15.53:40760) 2023-06-10T19:02:19.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.051+0000 7f43b0b4b640 1 -- 172.21.15.53:0/824861964 learned_addr learned my addr 172.21.15.53:0/824861964 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:19.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.051+0000 7f43b134c640 1 --2- 172.21.15.53:0/824861964 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f43ac159a60 0x7f43ac0bf870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:19.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.051+0000 7f43abfff640 1 --2- 172.21.15.53:0/824861964 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f43ac159690 0x7f43ac0b4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:19.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.051+0000 7f43b0b4b640 1 -- 172.21.15.53:0/824861964 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f43ac159690 msgr2=0x7f43ac0b4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:19.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.051+0000 7f43b0b4b640 1 --2- 172.21.15.53:0/824861964 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f43ac159690 0x7f43ac0b4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:19.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.051+0000 7f43b0b4b640 1 -- 172.21.15.53:0/824861964 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f43ac159a60 msgr2=0x7f43ac0bf870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:19.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.051+0000 7f43b0b4b640 1 --2- 172.21.15.53:0/824861964 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f43ac159a60 0x7f43ac0bf870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:19.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.051+0000 7f43b0b4b640 1 -- 172.21.15.53:0/824861964 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43a4009a70 con 0x7f43ac0b0f30 2023-06-10T19:02:19.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.051+0000 7f43b134c640 1 --2- 172.21.15.53:0/824861964 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f43ac159a60 0x7f43ac0bf870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:02:19.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.051+0000 7f43b0b4b640 1 --2- 172.21.15.53:0/824861964 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43ac0b0f30 0x7f43ac159f30 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f439c00c420 tx=0x7f439c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:19.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.051+0000 7f43a97fa640 1 -- 172.21.15.53:0/824861964 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439c005cf0 con 0x7f43ac0b0f30 2023-06-10T19:02:19.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.051+0000 7f43a97fa640 1 -- 172.21.15.53:0/824861964 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f439c005e50 con 0x7f43ac0b0f30 2023-06-10T19:02:19.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.051+0000 7f43a97fa640 1 -- 172.21.15.53:0/824861964 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439c0072f0 con 0x7f43ac0b0f30 2023-06-10T19:02:19.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.051+0000 7f43b2daf640 1 -- 172.21.15.53:0/824861964 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43ac15ce70 con 0x7f43ac0b0f30 2023-06-10T19:02:19.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.051+0000 7f43b2daf640 1 -- 172.21.15.53:0/824861964 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43ac15b900 con 0x7f43ac0b0f30 2023-06-10T19:02:19.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.051+0000 7f43b2daf640 1 -- 172.21.15.53:0/824861964 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43ac15d0b0 con 0x7f43ac0b0f30 2023-06-10T19:02:19.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.051+0000 7f43a97fa640 1 -- 172.21.15.53:0/824861964 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f439c007450 con 0x7f43ac0b0f30 2023-06-10T19:02:19.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.051+0000 7f43a97fa640 1 --2- 172.21.15.53:0/824861964 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4398066280 0x7f4398068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:19.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.051+0000 7f43a97fa640 1 -- 172.21.15.53:0/824861964 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f439c083320 con 0x7f43ac0b0f30 2023-06-10T19:02:19.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.051+0000 7f43abfff640 1 --2- 172.21.15.53:0/824861964 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4398066280 0x7f4398068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:19.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.055+0000 7f43abfff640 1 --2- 172.21.15.53:0/824861964 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4398066280 0x7f4398068730 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f43ac0c0500 tx=0x7f43a0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:19.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.055+0000 7f43a97fa640 1 -- 172.21.15.53:0/824861964 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f43ac15d0b0 con 0x7f43ac0b0f30 2023-06-10T19:02:19.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.211+0000 7f43b2daf640 1 -- 172.21.15.53:0/824861964 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f43ac15d060 con 0x7f43ac0b0f30 2023-06-10T19:02:19.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.215+0000 7f43a97fa640 1 -- 172.21.15.53:0/824861964 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+18282 (secure 0 0 0) 0x7f439c054230 con 0x7f43ac0b0f30 2023-06-10T19:02:19.217 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:02:19.217 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":94,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:02:03.646580+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-06-10T19:02:00.325404+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-06-10T19:02:01.620938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:02:19.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.215+0000 7f43b2daf640 1 -- 172.21.15.53:0/824861964 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4398066280 msgr2=0x7f4398068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:19.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.215+0000 7f43b2daf640 1 --2- 172.21.15.53:0/824861964 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4398066280 0x7f4398068730 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f43ac0c0500 tx=0x7f43a0008040 comp rx=0 tx=0).stop 2023-06-10T19:02:19.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.215+0000 7f43b2daf640 1 -- 172.21.15.53:0/824861964 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43ac0b0f30 msgr2=0x7f43ac159f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:19.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.215+0000 7f43b2daf640 1 --2- 172.21.15.53:0/824861964 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43ac0b0f30 0x7f43ac159f30 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f439c00c420 tx=0x7f439c00c8e0 comp rx=0 tx=0).stop 2023-06-10T19:02:19.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.215+0000 7f43b2daf640 1 -- 172.21.15.53:0/824861964 shutdown_connections 2023-06-10T19:02:19.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.215+0000 7f43b2daf640 1 --2- 172.21.15.53:0/824861964 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4398066280 0x7f4398068730 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:19.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.215+0000 7f43b2daf640 1 --2- 172.21.15.53:0/824861964 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f43ac159a60 0x7f43ac0bf870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:19.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.215+0000 7f43b2daf640 1 --2- 172.21.15.53:0/824861964 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f43ac159690 0x7f43ac0b4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:19.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.215+0000 7f43b2daf640 1 --2- 172.21.15.53:0/824861964 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43ac0b0f30 0x7f43ac159f30 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:19.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.215+0000 7f43b2daf640 1 -- 172.21.15.53:0/824861964 >> 172.21.15.53:0/824861964 conn(0x7f43ac06a560 msgr2=0x7f43ac0cc930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:19.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.215+0000 7f43b2daf640 1 -- 172.21.15.53:0/824861964 shutdown_connections 2023-06-10T19:02:19.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.215+0000 7f43b2daf640 1 -- 172.21.15.53:0/824861964 wait complete. 2023-06-10T19:02:19.235 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-10T18:52:33.633114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-10T18:52:39.171487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-10T19:02:00.325404+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '93', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2023-06-10T19:02:01.620938+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '94', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-10T19:02:19.236 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-10T19:02:19.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.363+0000 7fb27024d640 1 Processor -- start 2023-06-10T19:02:19.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.363+0000 7fb27024d640 1 -- start start 2023-06-10T19:02:19.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.363+0000 7fb27024d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb2680b7e30 0x7fb2680b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:19.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.363+0000 7fb27024d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2680cc7c0 con 0x7fb2680b0b90 2023-06-10T19:02:19.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.363+0000 7fb27024d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2680ccaa0 con 0x7fb26815c090 2023-06-10T19:02:19.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.363+0000 7fb27024d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2680ccd80 con 0x7fb2680b7e30 2023-06-10T19:02:19.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.363+0000 7fb26d7e8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb2680b7e30 0x7fb2680b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:19.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.363+0000 7fb26e7ea640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fb2680b0b90 0x7fb2680d04d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60904/0 (socket says 172.21.15.53:60904) 2023-06-10T19:02:19.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.363+0000 7fb26e7ea640 1 -- 172.21.15.53:0/1229763995 learned_addr learned my addr 172.21.15.53:0/1229763995 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:02:19.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.363+0000 7fb26d7e8640 1 -- 172.21.15.53:0/1229763995 >> v1:172.21.15.117:6789/0 conn(0x7fb26815c090 legacy=0x7fb2680b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:19.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.363+0000 7fb26d7e8640 1 -- 172.21.15.53:0/1229763995 >> v1:172.21.15.53:6789/0 conn(0x7fb2680b0b90 legacy=0x7fb2680d04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:19.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.363+0000 7fb26cfe7640 1 -- 172.21.15.53:0/1229763995 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2735831522 0 0) 0x7fb2680cc7c0 con 0x7fb2680b0b90 2023-06-10T19:02:19.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.363+0000 7fb26d7e8640 1 -- 172.21.15.53:0/1229763995 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2680cd060 con 0x7fb2680b7e30 2023-06-10T19:02:19.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.367+0000 7fb26d7e8640 1 --2- 172.21.15.53:0/1229763995 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2680b7e30 0x7fb2680b10c0 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7fb2580097c0 tx=0x7fb25801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b8e8094c2ff831e server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:19.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.367+0000 7fb26cfe7640 1 -- 172.21.15.53:0/1229763995 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2580ab600 con 0x7fb2680b7e30 2023-06-10T19:02:19.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.367+0000 7fb26cfe7640 1 -- 172.21.15.53:0/1229763995 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2580a7050 con 0x7fb2680b7e30 2023-06-10T19:02:19.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.367+0000 7fb26cfe7640 1 -- 172.21.15.53:0/1229763995 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2580ab980 con 0x7fb2680b7e30 2023-06-10T19:02:19.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.367+0000 7fb27024d640 1 -- 172.21.15.53:0/1229763995 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2680b7e30 msgr2=0x7fb2680b10c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:19.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.367+0000 7fb27024d640 1 --2- 172.21.15.53:0/1229763995 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2680b7e30 0x7fb2680b10c0 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7fb2580097c0 tx=0x7fb25801c3c0 comp rx=0 tx=0).stop 2023-06-10T19:02:19.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.367+0000 7fb27024d640 1 -- 172.21.15.53:0/1229763995 shutdown_connections 2023-06-10T19:02:19.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.367+0000 7fb27024d640 1 --2- 172.21.15.53:0/1229763995 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2680b7e30 0x7fb2680b10c0 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:19.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.367+0000 7fb27024d640 1 -- 172.21.15.53:0/1229763995 >> 172.21.15.53:0/1229763995 conn(0x7fb268069e20 msgr2=0x7fb26806a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:19.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.367+0000 7fb27024d640 1 -- 172.21.15.53:0/1229763995 shutdown_connections 2023-06-10T19:02:19.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.367+0000 7fb27024d640 1 -- 172.21.15.53:0/1229763995 wait complete. 2023-06-10T19:02:19.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.367+0000 7fb27024d640 1 Processor -- start 2023-06-10T19:02:19.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.367+0000 7fb27024d640 1 -- start start 2023-06-10T19:02:19.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.367+0000 7fb27024d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2680b0b90 0x7fb2680d22c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:19.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.367+0000 7fb27024d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2680b7e30 0x7fb2680c5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:19.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.367+0000 7fb27024d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb26815c090 0x7fb26814db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:19.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.367+0000 7fb27024d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2680ca5a0 con 0x7fb2680b0b90 2023-06-10T19:02:19.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.367+0000 7fb27024d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2680ca880 con 0x7fb26815c090 2023-06-10T19:02:19.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.367+0000 7fb27024d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb26814d040 con 0x7fb2680b7e30 2023-06-10T19:02:19.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.367+0000 7fb26dfe9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2680b0b90 0x7fb2680d22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:19.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.367+0000 7fb26dfe9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2680b0b90 0x7fb2680d22c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40782/0 (socket says 172.21.15.53:40782) 2023-06-10T19:02:19.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.367+0000 7fb26dfe9640 1 -- 172.21.15.53:0/2777972224 learned_addr learned my addr 172.21.15.53:0/2777972224 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:19.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.367+0000 7fb26e7ea640 1 --2- 172.21.15.53:0/2777972224 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb26815c090 0x7fb26814db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:19.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.367+0000 7fb26d7e8640 1 --2- 172.21.15.53:0/2777972224 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2680b7e30 0x7fb2680c5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:19.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.367+0000 7fb26dfe9640 1 -- 172.21.15.53:0/2777972224 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2680b7e30 msgr2=0x7fb2680c5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:19.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.367+0000 7fb26dfe9640 1 --2- 172.21.15.53:0/2777972224 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2680b7e30 0x7fb2680c5bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:19.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.367+0000 7fb26dfe9640 1 -- 172.21.15.53:0/2777972224 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb26815c090 msgr2=0x7fb26814db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:19.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.367+0000 7fb26dfe9640 1 --2- 172.21.15.53:0/2777972224 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb26815c090 0x7fb26814db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:19.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.367+0000 7fb26dfe9640 1 -- 172.21.15.53:0/2777972224 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb258009420 con 0x7fb2680b0b90 2023-06-10T19:02:19.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.371+0000 7fb26dfe9640 1 --2- 172.21.15.53:0/2777972224 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2680b0b90 0x7fb2680d22c0 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7fb26400c7a0 tx=0x7fb26400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:19.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.371+0000 7fb25e7fc640 1 -- 172.21.15.53:0/2777972224 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb264003b80 con 0x7fb2680b0b90 2023-06-10T19:02:19.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.371+0000 7fb25e7fc640 1 -- 172.21.15.53:0/2777972224 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb264003ce0 con 0x7fb2680b0b90 2023-06-10T19:02:19.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.371+0000 7fb27024d640 1 -- 172.21.15.53:0/2777972224 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb26814d320 con 0x7fb2680b0b90 2023-06-10T19:02:19.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.371+0000 7fb25e7fc640 1 -- 172.21.15.53:0/2777972224 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb26400aa90 con 0x7fb2680b0b90 2023-06-10T19:02:19.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.371+0000 7fb27024d640 1 -- 172.21.15.53:0/2777972224 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2680c4fa0 con 0x7fb2680b0b90 2023-06-10T19:02:19.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.371+0000 7fb27024d640 1 -- 172.21.15.53:0/2777972224 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb26804d790 con 0x7fb2680b0b90 2023-06-10T19:02:19.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.371+0000 7fb25e7fc640 1 -- 172.21.15.53:0/2777972224 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb26400abf0 con 0x7fb2680b0b90 2023-06-10T19:02:19.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.371+0000 7fb25e7fc640 1 --2- 172.21.15.53:0/2777972224 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb24c066280 0x7fb24c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:19.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.371+0000 7fb25e7fc640 1 -- 172.21.15.53:0/2777972224 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb264083c10 con 0x7fb2680b0b90 2023-06-10T19:02:19.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.371+0000 7fb26d7e8640 1 --2- 172.21.15.53:0/2777972224 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb24c066280 0x7fb24c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:19.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.371+0000 7fb26d7e8640 1 --2- 172.21.15.53:0/2777972224 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb24c066280 0x7fb24c068730 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fb2580ad000 tx=0x7fb258008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:19.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.375+0000 7fb25e7fc640 1 -- 172.21.15.53:0/2777972224 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb264050ff0 con 0x7fb2680b0b90 2023-06-10T19:02:19.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.531+0000 7fb27024d640 1 -- 172.21.15.53:0/2777972224 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb2680caa40 con 0x7fb2680b0b90 2023-06-10T19:02:19.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.531+0000 7fb25e7fc640 1 -- 172.21.15.53:0/2777972224 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v94) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb2680caa40 con 0x7fb2680b0b90 2023-06-10T19:02:19.532 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-06-10T19:02:19.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.531+0000 7fb27024d640 1 -- 172.21.15.53:0/2777972224 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb24c066280 msgr2=0x7fb24c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:19.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.531+0000 7fb27024d640 1 --2- 172.21.15.53:0/2777972224 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb24c066280 0x7fb24c068730 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fb2580ad000 tx=0x7fb258008040 comp rx=0 tx=0).stop 2023-06-10T19:02:19.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.531+0000 7fb27024d640 1 -- 172.21.15.53:0/2777972224 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2680b0b90 msgr2=0x7fb2680d22c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:19.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.531+0000 7fb27024d640 1 --2- 172.21.15.53:0/2777972224 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2680b0b90 0x7fb2680d22c0 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7fb26400c7a0 tx=0x7fb26400cc60 comp rx=0 tx=0).stop 2023-06-10T19:02:19.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.531+0000 7fb27024d640 1 -- 172.21.15.53:0/2777972224 shutdown_connections 2023-06-10T19:02:19.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.531+0000 7fb27024d640 1 --2- 172.21.15.53:0/2777972224 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb24c066280 0x7fb24c068730 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:19.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.531+0000 7fb27024d640 1 --2- 172.21.15.53:0/2777972224 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb26815c090 0x7fb26814db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:19.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.531+0000 7fb27024d640 1 --2- 172.21.15.53:0/2777972224 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2680b7e30 0x7fb2680c5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:19.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.531+0000 7fb27024d640 1 --2- 172.21.15.53:0/2777972224 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2680b0b90 0x7fb2680d22c0 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:19.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.531+0000 7fb27024d640 1 -- 172.21.15.53:0/2777972224 >> 172.21.15.53:0/2777972224 conn(0x7fb268069e20 msgr2=0x7fb26806a280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:19.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.531+0000 7fb27024d640 1 -- 172.21.15.53:0/2777972224 shutdown_connections 2023-06-10T19:02:19.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.531+0000 7fb27024d640 1 -- 172.21.15.53:0/2777972224 wait complete. 2023-06-10T19:02:19.551 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-10T19:02:19.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.667+0000 7f5023e4a640 1 Processor -- start 2023-06-10T19:02:19.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.667+0000 7f5023e4a640 1 -- start start 2023-06-10T19:02:19.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.667+0000 7f5023e4a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f501c06b780 0x7f501c15c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:19.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.667+0000 7f5023e4a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f501c06bb50 0x7f501c15f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:19.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.667+0000 7f5023e4a640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f501c0af530 con 0x7f501c15f860 2023-06-10T19:02:19.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.667+0000 7f5023e4a640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f501c15c3d0 con 0x7f501c06b780 2023-06-10T19:02:19.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.667+0000 7f5023e4a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f501c15fd70 con 0x7f501c06bb50 2023-06-10T19:02:19.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.667+0000 7f50223e7640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f501c15f860 0x7f501c0ceb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60914/0 (socket says 172.21.15.53:60914) 2023-06-10T19:02:19.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.667+0000 7f50223e7640 1 -- 172.21.15.53:0/1234007490 learned_addr learned my addr 172.21.15.53:0/1234007490 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:02:19.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.667+0000 7f50213e5640 1 --2- 172.21.15.53:0/1234007490 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f501c06bb50 0x7f501c15f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:19.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.667+0000 7f5021be6640 1 --2- 172.21.15.53:0/1234007490 >> v2:172.21.15.117:3300/0 conn(0x7f501c06b780 0x7f501c15c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:19.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.667+0000 7f5020be4640 1 -- 172.21.15.53:0/1234007490 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1601637493 0 0) 0x7f501c0af530 con 0x7f501c15f860 2023-06-10T19:02:19.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.667+0000 7f5020be4640 1 -- 172.21.15.53:0/1234007490 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5008003530 con 0x7f501c15f860 2023-06-10T19:02:19.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.667+0000 7f5020be4640 1 -- 172.21.15.53:0/1234007490 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3362325882 0 0) 0x7f5008003530 con 0x7f501c15f860 2023-06-10T19:02:19.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.667+0000 7f5020be4640 1 -- 172.21.15.53:0/1234007490 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f501c06bb50 msgr2=0x7f501c15f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:19.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.667+0000 7f5020be4640 1 --2- 172.21.15.53:0/1234007490 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f501c06bb50 0x7f501c15f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:19.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.667+0000 7f5020be4640 1 -- 172.21.15.53:0/1234007490 >> v2:172.21.15.117:3300/0 conn(0x7f501c06b780 msgr2=0x7f501c15c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:19.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.667+0000 7f5020be4640 1 --2- 172.21.15.53:0/1234007490 >> v2:172.21.15.117:3300/0 conn(0x7f501c06b780 0x7f501c15c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:19.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.667+0000 7f5020be4640 1 -- 172.21.15.53:0/1234007490 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f501c160050 con 0x7f501c15f860 2023-06-10T19:02:19.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.667+0000 7f5020be4640 1 -- 172.21.15.53:0/1234007490 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f5014001a00 con 0x7f501c15f860 2023-06-10T19:02:19.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.667+0000 7f5020be4640 1 -- 172.21.15.53:0/1234007490 >> v1:172.21.15.53:6789/0 conn(0x7f501c15f860 legacy=0x7f501c0ceb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:19.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.667+0000 7f5020be4640 1 --2- 172.21.15.53:0/1234007490 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5008003980 0x7f5008003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:19.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.667+0000 7f5020be4640 1 --2- 172.21.15.53:0/1234007490 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50080047d0 0x7f5008004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:19.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.667+0000 7f5020be4640 1 --2- 172.21.15.53:0/1234007490 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f501c06bb50 0x7f5008005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:19.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.667+0000 7f5020be4640 1 -- 172.21.15.53:0/1234007490 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f501c15c3d0 con 0x7f50080047d0 2023-06-10T19:02:19.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.667+0000 7f5020be4640 1 -- 172.21.15.53:0/1234007490 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f501c15fd70 con 0x7f5008003980 2023-06-10T19:02:19.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.667+0000 7f5020be4640 1 -- 172.21.15.53:0/1234007490 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f500800ba70 con 0x7f501c06bb50 2023-06-10T19:02:19.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.667+0000 7f5021be6640 1 --2- 172.21.15.53:0/1234007490 >> v2:172.21.15.117:3300/0 conn(0x7f501c06b780 0x7f501c15c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:02:19.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.667+0000 7f50213e5640 1 --2- 172.21.15.53:0/1234007490 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50080047d0 0x7f5008004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:19.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.667+0000 7f50223e7640 1 --2- 172.21.15.53:0/1234007490 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f501c06bb50 0x7f5008005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:19.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.667+0000 7f50213e5640 1 -- 172.21.15.53:0/1234007490 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f501c06bb50 msgr2=0x7f5008005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:19.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.667+0000 7f50213e5640 1 --2- 172.21.15.53:0/1234007490 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f501c06bb50 0x7f5008005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:19.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.667+0000 7f50213e5640 1 -- 172.21.15.53:0/1234007490 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5008003980 msgr2=0x7f5008003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:19.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.667+0000 7f50213e5640 1 --2- 172.21.15.53:0/1234007490 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5008003980 0x7f5008003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:19.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.667+0000 7f50213e5640 1 -- 172.21.15.53:0/1234007490 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5008003530 con 0x7f50080047d0 2023-06-10T19:02:19.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.667+0000 7f50223e7640 1 --2- 172.21.15.53:0/1234007490 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f501c06bb50 0x7f5008005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:02:19.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.671+0000 7f50213e5640 1 --2- 172.21.15.53:0/1234007490 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50080047d0 0x7f5008004c40 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f500c009ae0 tx=0x7f501c0cfa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7793ec0742b5e1f server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:19.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.671+0000 7f5020be4640 1 -- 172.21.15.53:0/1234007490 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f500c0a5530 con 0x7f50080047d0 2023-06-10T19:02:19.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.671+0000 7f5020be4640 1 -- 172.21.15.53:0/1234007490 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f500c0a5690 con 0x7f50080047d0 2023-06-10T19:02:19.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.671+0000 7f5020be4640 1 -- 172.21.15.53:0/1234007490 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f500c0a5a40 con 0x7f50080047d0 2023-06-10T19:02:19.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.671+0000 7f5023e4a640 1 -- 172.21.15.53:0/1234007490 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50080047d0 msgr2=0x7f5008004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:19.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.671+0000 7f5023e4a640 1 --2- 172.21.15.53:0/1234007490 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50080047d0 0x7f5008004c40 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f500c009ae0 tx=0x7f501c0cfa40 comp rx=0 tx=0).stop 2023-06-10T19:02:19.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.671+0000 7f50223e7640 1 -- 172.21.15.53:0/1234007490 reap_dead start 2023-06-10T19:02:19.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.671+0000 7f5023e4a640 1 -- 172.21.15.53:0/1234007490 shutdown_connections 2023-06-10T19:02:19.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.671+0000 7f5023e4a640 1 -- 172.21.15.53:0/1234007490 >> 172.21.15.53:0/1234007490 conn(0x7f501c06a090 msgr2=0x7f501c06d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:19.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.671+0000 7f5023e4a640 1 -- 172.21.15.53:0/1234007490 shutdown_connections 2023-06-10T19:02:19.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.671+0000 7f5023e4a640 1 -- 172.21.15.53:0/1234007490 wait complete. 2023-06-10T19:02:19.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.671+0000 7f5023e4a640 1 Processor -- start 2023-06-10T19:02:19.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.671+0000 7f5023e4a640 1 -- start start 2023-06-10T19:02:19.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.675+0000 7f5023e4a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50080047d0 0x7f501c151280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:19.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.675+0000 7f5023e4a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f501c159c80 0x7f501c0ca5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:19.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.675+0000 7f5023e4a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f501c0cab00 0x7f501c157b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:19.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.675+0000 7f5023e4a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f501c15b280 con 0x7f501c0cab00 2023-06-10T19:02:19.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.675+0000 7f5023e4a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f501c15a0f0 con 0x7f50080047d0 2023-06-10T19:02:19.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.675+0000 7f5023e4a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f501c0b2e20 con 0x7f501c159c80 2023-06-10T19:02:19.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.675+0000 7f50223e7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f501c0cab00 0x7f501c157b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:19.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.675+0000 7f50223e7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f501c0cab00 0x7f501c157b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40796/0 (socket says 172.21.15.53:40796) 2023-06-10T19:02:19.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.675+0000 7f50223e7640 1 -- 172.21.15.53:0/2731784626 learned_addr learned my addr 172.21.15.53:0/2731784626 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:19.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.675+0000 7f5021be6640 1 --2- 172.21.15.53:0/2731784626 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50080047d0 0x7f501c151280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:19.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.675+0000 7f50213e5640 1 --2- 172.21.15.53:0/2731784626 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f501c159c80 0x7f501c0ca5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:19.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.675+0000 7f50223e7640 1 -- 172.21.15.53:0/2731784626 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f501c159c80 msgr2=0x7f501c0ca5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:19.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.675+0000 7f50223e7640 1 --2- 172.21.15.53:0/2731784626 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f501c159c80 0x7f501c0ca5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:19.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.675+0000 7f50223e7640 1 -- 172.21.15.53:0/2731784626 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50080047d0 msgr2=0x7f501c151280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:19.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.675+0000 7f50223e7640 1 --2- 172.21.15.53:0/2731784626 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50080047d0 0x7f501c151280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:19.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.675+0000 7f50223e7640 1 -- 172.21.15.53:0/2731784626 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f501c0b3100 con 0x7f501c0cab00 2023-06-10T19:02:19.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.675+0000 7f50223e7640 1 --2- 172.21.15.53:0/2731784626 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f501c0cab00 0x7f501c157b40 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f501c0cd910 tx=0x7f501400dd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:19.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.675+0000 7f50127fc640 1 -- 172.21.15.53:0/2731784626 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5014007070 con 0x7f501c0cab00 2023-06-10T19:02:19.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.675+0000 7f50127fc640 1 -- 172.21.15.53:0/2731784626 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50140071d0 con 0x7f501c0cab00 2023-06-10T19:02:19.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.675+0000 7f5023e4a640 1 -- 172.21.15.53:0/2731784626 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f501c0b33e0 con 0x7f501c0cab00 2023-06-10T19:02:19.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.675+0000 7f50127fc640 1 -- 172.21.15.53:0/2731784626 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5014007580 con 0x7f501c0cab00 2023-06-10T19:02:19.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.675+0000 7f5023e4a640 1 -- 172.21.15.53:0/2731784626 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f501c0b39a0 con 0x7f501c0cab00 2023-06-10T19:02:19.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.675+0000 7f5023e4a640 1 -- 172.21.15.53:0/2731784626 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f501c0b3b90 con 0x7f501c0cab00 2023-06-10T19:02:19.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.675+0000 7f50127fc640 1 -- 172.21.15.53:0/2731784626 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f50140076e0 con 0x7f501c0cab00 2023-06-10T19:02:19.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.675+0000 7f50127fc640 1 --2- 172.21.15.53:0/2731784626 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5000066280 0x7f5000068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:19.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.675+0000 7f50127fc640 1 -- 172.21.15.53:0/2731784626 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5014083410 con 0x7f501c0cab00 2023-06-10T19:02:19.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.675+0000 7f5021be6640 1 --2- 172.21.15.53:0/2731784626 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5000066280 0x7f5000068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:19.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.675+0000 7f5021be6640 1 --2- 172.21.15.53:0/2731784626 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5000066280 0x7f5000068730 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f5018006aa0 tx=0x7f5018008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:19.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.679+0000 7f50127fc640 1 -- 172.21.15.53:0/2731784626 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5014050870 con 0x7f501c0cab00 2023-06-10T19:02:19.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.834+0000 7f5023e4a640 1 -- 172.21.15.53:0/2731784626 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f501c04d790 con 0x7f501c0cab00 2023-06-10T19:02:19.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.834+0000 7f50127fc640 1 -- 172.21.15.53:0/2731784626 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v94) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5014053e90 con 0x7f501c0cab00 2023-06-10T19:02:19.836 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-06-10T19:02:19.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.834+0000 7f5023e4a640 1 -- 172.21.15.53:0/2731784626 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5000066280 msgr2=0x7f5000068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:19.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.834+0000 7f5023e4a640 1 --2- 172.21.15.53:0/2731784626 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5000066280 0x7f5000068730 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f5018006aa0 tx=0x7f5018008040 comp rx=0 tx=0).stop 2023-06-10T19:02:19.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.834+0000 7f5023e4a640 1 -- 172.21.15.53:0/2731784626 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f501c0cab00 msgr2=0x7f501c157b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:19.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.834+0000 7f5023e4a640 1 --2- 172.21.15.53:0/2731784626 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f501c0cab00 0x7f501c157b40 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f501c0cd910 tx=0x7f501400dd00 comp rx=0 tx=0).stop 2023-06-10T19:02:19.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.834+0000 7f5023e4a640 1 -- 172.21.15.53:0/2731784626 shutdown_connections 2023-06-10T19:02:19.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.834+0000 7f5023e4a640 1 --2- 172.21.15.53:0/2731784626 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5000066280 0x7f5000068730 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:19.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.834+0000 7f5023e4a640 1 --2- 172.21.15.53:0/2731784626 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f501c0cab00 0x7f501c157b40 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:19.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.834+0000 7f5023e4a640 1 --2- 172.21.15.53:0/2731784626 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f501c159c80 0x7f501c0ca5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:19.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.834+0000 7f5023e4a640 1 --2- 172.21.15.53:0/2731784626 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50080047d0 0x7f501c151280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:19.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.834+0000 7f5023e4a640 1 -- 172.21.15.53:0/2731784626 >> 172.21.15.53:0/2731784626 conn(0x7f501c06a090 msgr2=0x7f501c160a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:19.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.834+0000 7f5023e4a640 1 -- 172.21.15.53:0/2731784626 shutdown_connections 2023-06-10T19:02:19.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.834+0000 7f5023e4a640 1 -- 172.21.15.53:0/2731784626 wait complete. 2023-06-10T19:02:19.855 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-10T19:02:19.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.982+0000 7f7e65eed640 1 Processor -- start 2023-06-10T19:02:19.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.982+0000 7f7e65eed640 1 -- start start 2023-06-10T19:02:19.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.982+0000 7f7e65eed640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7e6006eca0 0x7f7e6006f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:19.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.982+0000 7f7e65eed640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e600af0e0 0x7f7e6015f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:19.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.982+0000 7f7e65eed640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e600ccda0 con 0x7f7e6015fc40 2023-06-10T19:02:19.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.982+0000 7f7e65eed640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e6006f5b0 con 0x7f7e6006eca0 2023-06-10T19:02:19.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.982+0000 7f7e65eed640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6006a920 con 0x7f7e600af0e0 2023-06-10T19:02:19.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.982+0000 7f7e5ffff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f7e6015fc40 0x7f7e600ced80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60920/0 (socket says 172.21.15.53:60920) 2023-06-10T19:02:19.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.982+0000 7f7e5ffff640 1 -- 172.21.15.53:0/4165278870 learned_addr learned my addr 172.21.15.53:0/4165278870 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:02:19.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.982+0000 7f7e5f7fe640 1 --2- 172.21.15.53:0/4165278870 >> v2:172.21.15.117:3300/0 conn(0x7f7e6006eca0 0x7f7e6006f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:19.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.982+0000 7f7e5effd640 1 --2- 172.21.15.53:0/4165278870 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e600af0e0 0x7f7e6015f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:19.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.982+0000 7f7e5e7fc640 1 -- 172.21.15.53:0/4165278870 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3171773235 0 0) 0x7f7e600ccda0 con 0x7f7e6015fc40 2023-06-10T19:02:19.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.982+0000 7f7e5e7fc640 1 -- 172.21.15.53:0/4165278870 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e48003530 con 0x7f7e6015fc40 2023-06-10T19:02:19.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.982+0000 7f7e5e7fc640 1 -- 172.21.15.53:0/4165278870 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1741185376 0 0) 0x7f7e48003530 con 0x7f7e6015fc40 2023-06-10T19:02:19.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.982+0000 7f7e5e7fc640 1 -- 172.21.15.53:0/4165278870 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e600af0e0 msgr2=0x7f7e6015f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:19.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.982+0000 7f7e5e7fc640 1 --2- 172.21.15.53:0/4165278870 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e600af0e0 0x7f7e6015f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:19.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.982+0000 7f7e5e7fc640 1 -- 172.21.15.53:0/4165278870 >> v2:172.21.15.117:3300/0 conn(0x7f7e6006eca0 msgr2=0x7f7e6006f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:19.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.982+0000 7f7e5e7fc640 1 --2- 172.21.15.53:0/4165278870 >> v2:172.21.15.117:3300/0 conn(0x7f7e6006eca0 0x7f7e6006f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:19.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.982+0000 7f7e5e7fc640 1 -- 172.21.15.53:0/4165278870 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e6006ac00 con 0x7f7e6015fc40 2023-06-10T19:02:19.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.982+0000 7f7e5e7fc640 1 -- 172.21.15.53:0/4165278870 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f7e58001a00 con 0x7f7e6015fc40 2023-06-10T19:02:19.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.982+0000 7f7e5e7fc640 1 -- 172.21.15.53:0/4165278870 >> v1:172.21.15.53:6789/0 conn(0x7f7e6015fc40 legacy=0x7f7e600ced80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:19.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.982+0000 7f7e5e7fc640 1 --2- 172.21.15.53:0/4165278870 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e600af0e0 0x7f7e48003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:19.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.982+0000 7f7e5e7fc640 1 --2- 172.21.15.53:0/4165278870 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e48003f00 0x7f7e480047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:19.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.982+0000 7f7e5e7fc640 1 --2- 172.21.15.53:0/4165278870 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e48004d10 0x7f7e48005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:19.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.982+0000 7f7e5e7fc640 1 -- 172.21.15.53:0/4165278870 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6006f5b0 con 0x7f7e48003f00 2023-06-10T19:02:19.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.982+0000 7f7e5e7fc640 1 -- 172.21.15.53:0/4165278870 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6006a920 con 0x7f7e48004d10 2023-06-10T19:02:19.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.982+0000 7f7e5e7fc640 1 -- 172.21.15.53:0/4165278870 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e4800b9c0 con 0x7f7e600af0e0 2023-06-10T19:02:19.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.982+0000 7f7e5effd640 1 --2- 172.21.15.53:0/4165278870 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e48003f00 0x7f7e480047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:19.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.982+0000 7f7e5ffff640 1 --2- 172.21.15.53:0/4165278870 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e48004d10 0x7f7e48005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:19.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.982+0000 7f7e5f7fe640 1 --2- 172.21.15.53:0/4165278870 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e600af0e0 0x7f7e48003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:19.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.982+0000 7f7e5effd640 1 -- 172.21.15.53:0/4165278870 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e600af0e0 msgr2=0x7f7e48003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:19.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.982+0000 7f7e5effd640 1 --2- 172.21.15.53:0/4165278870 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e600af0e0 0x7f7e48003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:19.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.982+0000 7f7e5effd640 1 -- 172.21.15.53:0/4165278870 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e48004d10 msgr2=0x7f7e48005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:19.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.982+0000 7f7e5effd640 1 --2- 172.21.15.53:0/4165278870 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e48004d10 0x7f7e48005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:19.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.982+0000 7f7e5effd640 1 -- 172.21.15.53:0/4165278870 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e48003530 con 0x7f7e48003f00 2023-06-10T19:02:19.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.982+0000 7f7e5ffff640 1 --2- 172.21.15.53:0/4165278870 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e48004d10 0x7f7e48005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:02:19.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.986+0000 7f7e5effd640 1 --2- 172.21.15.53:0/4165278870 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e48003f00 0x7f7e480047d0 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f7e54009ae0 tx=0x7f7e5401ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e332faecc32a5ce server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:19.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.986+0000 7f7e5e7fc640 1 -- 172.21.15.53:0/4165278870 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e540a5640 con 0x7f7e48003f00 2023-06-10T19:02:19.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.986+0000 7f7e5e7fc640 1 -- 172.21.15.53:0/4165278870 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e540a57a0 con 0x7f7e48003f00 2023-06-10T19:02:19.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.986+0000 7f7e5e7fc640 1 -- 172.21.15.53:0/4165278870 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e540a5b50 con 0x7f7e48003f00 2023-06-10T19:02:19.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.986+0000 7f7e65eed640 1 -- 172.21.15.53:0/4165278870 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e48003f00 msgr2=0x7f7e480047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:19.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.986+0000 7f7e65eed640 1 --2- 172.21.15.53:0/4165278870 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e48003f00 0x7f7e480047d0 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f7e54009ae0 tx=0x7f7e5401ca50 comp rx=0 tx=0).stop 2023-06-10T19:02:19.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.986+0000 7f7e5ffff640 1 -- 172.21.15.53:0/4165278870 reap_dead start 2023-06-10T19:02:19.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.986+0000 7f7e65eed640 1 -- 172.21.15.53:0/4165278870 shutdown_connections 2023-06-10T19:02:19.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.986+0000 7f7e65eed640 1 -- 172.21.15.53:0/4165278870 >> 172.21.15.53:0/4165278870 conn(0x7f7e6006a0e0 msgr2=0x7f7e6006d270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:19.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.986+0000 7f7e65eed640 1 -- 172.21.15.53:0/4165278870 shutdown_connections 2023-06-10T19:02:19.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.986+0000 7f7e65eed640 1 -- 172.21.15.53:0/4165278870 wait complete. 2023-06-10T19:02:19.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.986+0000 7f7e65eed640 1 Processor -- start 2023-06-10T19:02:19.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.986+0000 7f7e65eed640 1 -- start start 2023-06-10T19:02:20.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.986+0000 7f7e65eed640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e600c5ee0 0x7f7e60148f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:20.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.986+0000 7f7e65eed640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e6015d5e0 0x7f7e600b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:20.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.986+0000 7f7e65eed640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e600b4930 0x7f7e601e5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:20.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.986+0000 7f7e65eed640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e600b4da0 con 0x7f7e600b4930 2023-06-10T19:02:20.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.986+0000 7f7e65eed640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6015eef0 con 0x7f7e600c5ee0 2023-06-10T19:02:20.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.986+0000 7f7e65eed640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6015ea60 con 0x7f7e6015d5e0 2023-06-10T19:02:20.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.986+0000 7f7e5ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e600b4930 0x7f7e601e5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:20.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.986+0000 7f7e5ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e600b4930 0x7f7e601e5f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40824/0 (socket says 172.21.15.53:40824) 2023-06-10T19:02:20.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.986+0000 7f7e5ffff640 1 -- 172.21.15.53:0/3384633159 learned_addr learned my addr 172.21.15.53:0/3384633159 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:20.002 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.986+0000 7f7e5effd640 1 --2- 172.21.15.53:0/3384633159 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e6015d5e0 0x7f7e600b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:20.002 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.986+0000 7f7e5f7fe640 1 --2- 172.21.15.53:0/3384633159 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e600c5ee0 0x7f7e60148f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:20.002 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.986+0000 7f7e5ffff640 1 -- 172.21.15.53:0/3384633159 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e6015d5e0 msgr2=0x7f7e600b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:20.002 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.986+0000 7f7e5ffff640 1 --2- 172.21.15.53:0/3384633159 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e6015d5e0 0x7f7e600b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:20.002 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.986+0000 7f7e5ffff640 1 -- 172.21.15.53:0/3384633159 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e600c5ee0 msgr2=0x7f7e60148f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:20.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.986+0000 7f7e5ffff640 1 --2- 172.21.15.53:0/3384633159 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e600c5ee0 0x7f7e60148f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:20.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.986+0000 7f7e5ffff640 1 -- 172.21.15.53:0/3384633159 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e600c62b0 con 0x7f7e600b4930 2023-06-10T19:02:20.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.986+0000 7f7e5f7fe640 1 --2- 172.21.15.53:0/3384633159 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e600c5ee0 0x7f7e60148f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:02:20.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.990+0000 7f7e5ffff640 1 --2- 172.21.15.53:0/3384633159 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e600b4930 0x7f7e601e5f50 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f7e60071190 tx=0x7f7e5800dc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:20.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.990+0000 7f7e47fff640 1 -- 172.21.15.53:0/3384633159 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e58007440 con 0x7f7e600b4930 2023-06-10T19:02:20.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.990+0000 7f7e47fff640 1 -- 172.21.15.53:0/3384633159 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e580075c0 con 0x7f7e600b4930 2023-06-10T19:02:20.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.990+0000 7f7e65eed640 1 -- 172.21.15.53:0/3384633159 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e6015de50 con 0x7f7e600b4930 2023-06-10T19:02:20.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.990+0000 7f7e47fff640 1 -- 172.21.15.53:0/3384633159 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e58007970 con 0x7f7e600b4930 2023-06-10T19:02:20.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.990+0000 7f7e65eed640 1 -- 172.21.15.53:0/3384633159 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e6015e410 con 0x7f7e600b4930 2023-06-10T19:02:20.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.990+0000 7f7e65eed640 1 -- 172.21.15.53:0/3384633159 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e6004d790 con 0x7f7e600b4930 2023-06-10T19:02:20.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.990+0000 7f7e47fff640 1 -- 172.21.15.53:0/3384633159 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7e58014430 con 0x7f7e600b4930 2023-06-10T19:02:20.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.990+0000 7f7e47fff640 1 --2- 172.21.15.53:0/3384633159 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7e4c066280 0x7f7e4c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:20.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.990+0000 7f7e47fff640 1 -- 172.21.15.53:0/3384633159 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7e58083d30 con 0x7f7e600b4930 2023-06-10T19:02:20.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.990+0000 7f7e5f7fe640 1 --2- 172.21.15.53:0/3384633159 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7e4c066280 0x7f7e4c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:20.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.990+0000 7f7e5f7fe640 1 --2- 172.21.15.53:0/3384633159 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7e4c066280 0x7f7e4c068730 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f7e50009aa0 tx=0x7f7e50008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:20.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:19.994+0000 7f7e47fff640 1 -- 172.21.15.53:0/3384633159 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7e58054c40 con 0x7f7e600b4930 2023-06-10T19:02:20.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.154+0000 7f7e65eed640 1 -- 172.21.15.53:0/3384633159 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7e600cd560 con 0x7f7e600b4930 2023-06-10T19:02:20.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.154+0000 7f7e47fff640 1 -- 172.21.15.53:0/3384633159 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v94) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7e580547d0 con 0x7f7e600b4930 2023-06-10T19:02:20.157 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-06-10T19:02:20.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.154+0000 7f7e65eed640 1 -- 172.21.15.53:0/3384633159 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7e4c066280 msgr2=0x7f7e4c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:20.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.154+0000 7f7e65eed640 1 --2- 172.21.15.53:0/3384633159 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7e4c066280 0x7f7e4c068730 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f7e50009aa0 tx=0x7f7e50008040 comp rx=0 tx=0).stop 2023-06-10T19:02:20.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.154+0000 7f7e65eed640 1 -- 172.21.15.53:0/3384633159 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e600b4930 msgr2=0x7f7e601e5f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:20.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.154+0000 7f7e65eed640 1 --2- 172.21.15.53:0/3384633159 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e600b4930 0x7f7e601e5f50 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f7e60071190 tx=0x7f7e5800dc20 comp rx=0 tx=0).stop 2023-06-10T19:02:20.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.158+0000 7f7e65eed640 1 -- 172.21.15.53:0/3384633159 shutdown_connections 2023-06-10T19:02:20.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.158+0000 7f7e65eed640 1 --2- 172.21.15.53:0/3384633159 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7e4c066280 0x7f7e4c068730 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:20.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.158+0000 7f7e65eed640 1 --2- 172.21.15.53:0/3384633159 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e600b4930 0x7f7e601e5f50 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:20.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.158+0000 7f7e65eed640 1 --2- 172.21.15.53:0/3384633159 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e6015d5e0 0x7f7e600b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:20.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.158+0000 7f7e65eed640 1 --2- 172.21.15.53:0/3384633159 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e600c5ee0 0x7f7e60148f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:20.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.158+0000 7f7e65eed640 1 -- 172.21.15.53:0/3384633159 >> 172.21.15.53:0/3384633159 conn(0x7f7e6006a0e0 msgr2=0x7f7e6015a170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:20.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.158+0000 7f7e65eed640 1 -- 172.21.15.53:0/3384633159 shutdown_connections 2023-06-10T19:02:20.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.158+0000 7f7e65eed640 1 -- 172.21.15.53:0/3384633159 wait complete. 2023-06-10T19:02:20.176 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-10T19:02:20.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.306+0000 7f0c99676640 1 Processor -- start 2023-06-10T19:02:20.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.306+0000 7f0c99676640 1 -- start start 2023-06-10T19:02:20.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.306+0000 7f0c99676640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0c941586b0 0x7f0c9415c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:20.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.306+0000 7f0c99676640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0c9406a570 0x7f0c9415c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:20.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.306+0000 7f0c99676640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c940ccf20 con 0x7f0c9406f970 2023-06-10T19:02:20.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.306+0000 7f0c99676640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c940cc4c0 con 0x7f0c9406a570 2023-06-10T19:02:20.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.306+0000 7f0c99676640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c940ce3c0 con 0x7f0c941586b0 2023-06-10T19:02:20.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.306+0000 7f0c937fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0c9406a570 0x7f0c9415c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:20.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.306+0000 7f0c927fc640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f0c9406f970 0x7f0c94069e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60924/0 (socket says 172.21.15.53:60924) 2023-06-10T19:02:20.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.306+0000 7f0c927fc640 1 -- 172.21.15.53:0/3595204152 learned_addr learned my addr 172.21.15.53:0/3595204152 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:02:20.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.306+0000 7f0c92ffd640 1 --2- 172.21.15.53:0/3595204152 >> v2:172.21.15.117:3300/0 conn(0x7f0c941586b0 0x7f0c9415c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:20.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.306+0000 7f0c937fe640 1 -- 172.21.15.53:0/3595204152 >> v2:172.21.15.117:3300/0 conn(0x7f0c941586b0 msgr2=0x7f0c9415c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:20.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.306+0000 7f0c937fe640 1 --2- 172.21.15.53:0/3595204152 >> v2:172.21.15.117:3300/0 conn(0x7f0c941586b0 0x7f0c9415c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:20.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.306+0000 7f0c937fe640 1 -- 172.21.15.53:0/3595204152 >> v1:172.21.15.53:6789/0 conn(0x7f0c9406f970 legacy=0x7f0c94069e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:20.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.306+0000 7f0c937fe640 1 -- 172.21.15.53:0/3595204152 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c9406aa70 con 0x7f0c9406a570 2023-06-10T19:02:20.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.306+0000 7f0c91ffb640 1 -- 172.21.15.53:0/3595204152 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4179005625 0 0) 0x7f0c940ccf20 con 0x7f0c9406f970 2023-06-10T19:02:20.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.306+0000 7f0c937fe640 1 --2- 172.21.15.53:0/3595204152 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c9406a570 0x7f0c9415c780 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f0c94065200 tx=0x7f0c8c01ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=433e45cdcdb9a179 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:20.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.310+0000 7f0c91ffb640 1 -- 172.21.15.53:0/3595204152 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c8c0a8930 con 0x7f0c9406a570 2023-06-10T19:02:20.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.310+0000 7f0c91ffb640 1 -- 172.21.15.53:0/3595204152 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c8c0a8a90 con 0x7f0c9406a570 2023-06-10T19:02:20.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.310+0000 7f0c91ffb640 1 -- 172.21.15.53:0/3595204152 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c8c0a8e20 con 0x7f0c9406a570 2023-06-10T19:02:20.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.310+0000 7f0c99676640 1 -- 172.21.15.53:0/3595204152 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c9406a570 msgr2=0x7f0c9415c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:20.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.310+0000 7f0c99676640 1 --2- 172.21.15.53:0/3595204152 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c9406a570 0x7f0c9415c780 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f0c94065200 tx=0x7f0c8c01ec30 comp rx=0 tx=0).stop 2023-06-10T19:02:20.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.310+0000 7f0c99676640 1 -- 172.21.15.53:0/3595204152 shutdown_connections 2023-06-10T19:02:20.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.310+0000 7f0c99676640 1 --2- 172.21.15.53:0/3595204152 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c9406a570 0x7f0c9415c780 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:20.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.310+0000 7f0c99676640 1 --2- 172.21.15.53:0/3595204152 >> v2:172.21.15.117:3300/0 conn(0x7f0c941586b0 0x7f0c9415c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:20.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.310+0000 7f0c99676640 1 -- 172.21.15.53:0/3595204152 >> 172.21.15.53:0/3595204152 conn(0x7f0c940cafc0 msgr2=0x7f0c940cb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:20.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.310+0000 7f0c99676640 1 -- 172.21.15.53:0/3595204152 shutdown_connections 2023-06-10T19:02:20.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.310+0000 7f0c99676640 1 -- 172.21.15.53:0/3595204152 wait complete. 2023-06-10T19:02:20.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.310+0000 7f0c99676640 1 Processor -- start 2023-06-10T19:02:20.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.310+0000 7f0c99676640 1 -- start start 2023-06-10T19:02:20.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.310+0000 7f0c99676640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c9406a570 0x7f0c94152360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:20.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.310+0000 7f0c99676640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c9406f970 0x7f0c94152ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:20.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.310+0000 7f0c99676640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0c941586b0 0x7f0c94153010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:20.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.310+0000 7f0c99676640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c940c1fa0 con 0x7f0c9406f970 2023-06-10T19:02:20.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.310+0000 7f0c99676640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c94158a80 con 0x7f0c9406a570 2023-06-10T19:02:20.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.310+0000 7f0c99676640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c941598e0 con 0x7f0c941586b0 2023-06-10T19:02:20.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.310+0000 7f0c927fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c9406f970 0x7f0c94152ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:20.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.310+0000 7f0c927fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c9406f970 0x7f0c94152ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40846/0 (socket says 172.21.15.53:40846) 2023-06-10T19:02:20.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.310+0000 7f0c927fc640 1 -- 172.21.15.53:0/2828714155 learned_addr learned my addr 172.21.15.53:0/2828714155 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:20.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.310+0000 7f0c92ffd640 1 --2- 172.21.15.53:0/2828714155 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c9406a570 0x7f0c94152360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:20.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.310+0000 7f0c937fe640 1 --2- 172.21.15.53:0/2828714155 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0c941586b0 0x7f0c94153010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:20.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.310+0000 7f0c927fc640 1 -- 172.21.15.53:0/2828714155 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0c941586b0 msgr2=0x7f0c94153010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:20.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.310+0000 7f0c927fc640 1 --2- 172.21.15.53:0/2828714155 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0c941586b0 0x7f0c94153010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:20.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.310+0000 7f0c927fc640 1 -- 172.21.15.53:0/2828714155 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c9406a570 msgr2=0x7f0c94152360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:20.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.310+0000 7f0c927fc640 1 --2- 172.21.15.53:0/2828714155 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c9406a570 0x7f0c94152360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:20.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.310+0000 7f0c927fc640 1 -- 172.21.15.53:0/2828714155 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c8c009420 con 0x7f0c9406f970 2023-06-10T19:02:20.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.310+0000 7f0c92ffd640 1 --2- 172.21.15.53:0/2828714155 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c9406a570 0x7f0c94152360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:02:20.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.310+0000 7f0c937fe640 1 --2- 172.21.15.53:0/2828714155 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0c941586b0 0x7f0c94153010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:02:20.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.310+0000 7f0c927fc640 1 --2- 172.21.15.53:0/2828714155 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c9406f970 0x7f0c94152ad0 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f0c8800c520 tx=0x7f0c8800c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:20.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.310+0000 7f0c7b7fe640 1 -- 172.21.15.53:0/2828714155 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c880074e0 con 0x7f0c9406f970 2023-06-10T19:02:20.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.310+0000 7f0c7b7fe640 1 -- 172.21.15.53:0/2828714155 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c88007640 con 0x7f0c9406f970 2023-06-10T19:02:20.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.310+0000 7f0c7b7fe640 1 -- 172.21.15.53:0/2828714155 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c880049f0 con 0x7f0c9406f970 2023-06-10T19:02:20.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.310+0000 7f0c99676640 1 -- 172.21.15.53:0/2828714155 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c941528a0 con 0x7f0c9406f970 2023-06-10T19:02:20.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.310+0000 7f0c99676640 1 -- 172.21.15.53:0/2828714155 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c94159290 con 0x7f0c9406f970 2023-06-10T19:02:20.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.314+0000 7f0c99676640 1 -- 172.21.15.53:0/2828714155 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c9404d790 con 0x7f0c9406f970 2023-06-10T19:02:20.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.314+0000 7f0c7b7fe640 1 -- 172.21.15.53:0/2828714155 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0c88004b50 con 0x7f0c9406f970 2023-06-10T19:02:20.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.314+0000 7f0c7b7fe640 1 --2- 172.21.15.53:0/2828714155 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0c80066280 0x7f0c80068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:20.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.314+0000 7f0c7b7fe640 1 -- 172.21.15.53:0/2828714155 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0c88082f00 con 0x7f0c9406f970 2023-06-10T19:02:20.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.314+0000 7f0c92ffd640 1 --2- 172.21.15.53:0/2828714155 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0c80066280 0x7f0c80068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:20.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.314+0000 7f0c92ffd640 1 --2- 172.21.15.53:0/2828714155 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0c80066280 0x7f0c80068730 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f0c84007eb0 tx=0x7f0c84007400 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:20.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.318+0000 7f0c7b7fe640 1 -- 172.21.15.53:0/2828714155 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0c88050430 con 0x7f0c9406f970 2023-06-10T19:02:20.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.470+0000 7f0c99676640 1 -- 172.21.15.53:0/2828714155 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0c940c8640 con 0x7f0c9406f970 2023-06-10T19:02:20.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.474+0000 7f0c7b7fe640 1 -- 172.21.15.53:0/2828714155 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v94) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0c88018020 con 0x7f0c9406f970 2023-06-10T19:02:20.475 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-06-10T19:02:20.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.474+0000 7f0c99676640 1 -- 172.21.15.53:0/2828714155 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0c80066280 msgr2=0x7f0c80068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:20.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.474+0000 7f0c99676640 1 --2- 172.21.15.53:0/2828714155 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0c80066280 0x7f0c80068730 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f0c84007eb0 tx=0x7f0c84007400 comp rx=0 tx=0).stop 2023-06-10T19:02:20.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.474+0000 7f0c99676640 1 -- 172.21.15.53:0/2828714155 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c9406f970 msgr2=0x7f0c94152ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:20.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.474+0000 7f0c99676640 1 --2- 172.21.15.53:0/2828714155 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c9406f970 0x7f0c94152ad0 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f0c8800c520 tx=0x7f0c8800c9e0 comp rx=0 tx=0).stop 2023-06-10T19:02:20.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.474+0000 7f0c99676640 1 -- 172.21.15.53:0/2828714155 shutdown_connections 2023-06-10T19:02:20.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.474+0000 7f0c99676640 1 --2- 172.21.15.53:0/2828714155 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0c80066280 0x7f0c80068730 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:20.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.474+0000 7f0c99676640 1 --2- 172.21.15.53:0/2828714155 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0c941586b0 0x7f0c94153010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:20.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.474+0000 7f0c99676640 1 --2- 172.21.15.53:0/2828714155 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c9406f970 0x7f0c94152ad0 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:20.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.474+0000 7f0c99676640 1 --2- 172.21.15.53:0/2828714155 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c9406a570 0x7f0c94152360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:20.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.474+0000 7f0c99676640 1 -- 172.21.15.53:0/2828714155 >> 172.21.15.53:0/2828714155 conn(0x7f0c940cafc0 msgr2=0x7f0c94155620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:20.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.474+0000 7f0c99676640 1 -- 172.21.15.53:0/2828714155 shutdown_connections 2023-06-10T19:02:20.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.474+0000 7f0c99676640 1 -- 172.21.15.53:0/2828714155 wait complete. 2023-06-10T19:02:20.494 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-10T19:02:20.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.614+0000 7fb282e4b640 1 Processor -- start 2023-06-10T19:02:20.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.614+0000 7fb282e4b640 1 -- start start 2023-06-10T19:02:20.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.618+0000 7fb282e4b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb27c159450 0x7fb27c15d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:20.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.618+0000 7fb282e4b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb27c15d680 0x7fb27c0cec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:20.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.618+0000 7fb282e4b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb27c0cf180 0x7fb27c0cda20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:20.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.618+0000 7fb282e4b640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb27c0cf600 con 0x7fb27c0cf180 2023-06-10T19:02:20.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.618+0000 7fb282e4b640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb27c0cbac0 con 0x7fb27c159450 2023-06-10T19:02:20.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.618+0000 7fb282e4b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb27c15dc00 con 0x7fb27c15d680 2023-06-10T19:02:20.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.618+0000 7fb2813e8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb27c0cf180 0x7fb27c0cda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:20.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.618+0000 7fb2813e8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb27c0cf180 0x7fb27c0cda20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40862/0 (socket says 172.21.15.53:40862) 2023-06-10T19:02:20.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.618+0000 7fb2813e8640 1 -- 172.21.15.53:0/1325562616 learned_addr learned my addr 172.21.15.53:0/1325562616 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:20.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.618+0000 7fb273fff640 1 --2- 172.21.15.53:0/1325562616 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb27c15d680 0x7fb27c0cec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:20.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.618+0000 7fb280be7640 1 --2- 172.21.15.53:0/1325562616 >> v2:172.21.15.117:3300/0 conn(0x7fb27c159450 0x7fb27c15d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:20.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.618+0000 7fb2813e8640 1 -- 172.21.15.53:0/1325562616 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb27c15d680 msgr2=0x7fb27c0cec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:20.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.618+0000 7fb2813e8640 1 --2- 172.21.15.53:0/1325562616 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb27c15d680 0x7fb27c0cec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:20.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.618+0000 7fb2813e8640 1 -- 172.21.15.53:0/1325562616 >> v2:172.21.15.117:3300/0 conn(0x7fb27c159450 msgr2=0x7fb27c15d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:20.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.618+0000 7fb2813e8640 1 --2- 172.21.15.53:0/1325562616 >> v2:172.21.15.117:3300/0 conn(0x7fb27c159450 0x7fb27c15d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:20.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.618+0000 7fb2813e8640 1 -- 172.21.15.53:0/1325562616 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb27c15dee0 con 0x7fb27c0cf180 2023-06-10T19:02:20.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.618+0000 7fb280be7640 1 --2- 172.21.15.53:0/1325562616 >> v2:172.21.15.117:3300/0 conn(0x7fb27c159450 0x7fb27c15d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:02:20.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.622+0000 7fb2813e8640 1 --2- 172.21.15.53:0/1325562616 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb27c0cf180 0x7fb27c0cda20 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7fb27c0b29a0 tx=0x7fb27401c650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f81a91e7d05bb5b1 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:20.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.622+0000 7fb2737fe640 1 -- 172.21.15.53:0/1325562616 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2740a64a0 con 0x7fb27c0cf180 2023-06-10T19:02:20.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.622+0000 7fb2737fe640 1 -- 172.21.15.53:0/1325562616 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2740a6600 con 0x7fb27c0cf180 2023-06-10T19:02:20.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.622+0000 7fb2737fe640 1 -- 172.21.15.53:0/1325562616 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2740a6990 con 0x7fb27c0cf180 2023-06-10T19:02:20.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.622+0000 7fb282e4b640 1 -- 172.21.15.53:0/1325562616 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb27c0cf180 msgr2=0x7fb27c0cda20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:20.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.622+0000 7fb282e4b640 1 --2- 172.21.15.53:0/1325562616 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb27c0cf180 0x7fb27c0cda20 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7fb27c0b29a0 tx=0x7fb27401c650 comp rx=0 tx=0).stop 2023-06-10T19:02:20.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.622+0000 7fb282e4b640 1 -- 172.21.15.53:0/1325562616 shutdown_connections 2023-06-10T19:02:20.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.622+0000 7fb282e4b640 1 --2- 172.21.15.53:0/1325562616 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb27c0cf180 0x7fb27c0cda20 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:20.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.622+0000 7fb282e4b640 1 --2- 172.21.15.53:0/1325562616 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb27c15d680 0x7fb27c0cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:20.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.622+0000 7fb282e4b640 1 --2- 172.21.15.53:0/1325562616 >> v2:172.21.15.117:3300/0 conn(0x7fb27c159450 0x7fb27c15d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:20.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.622+0000 7fb282e4b640 1 -- 172.21.15.53:0/1325562616 >> 172.21.15.53:0/1325562616 conn(0x7fb27c06a0b0 msgr2=0x7fb27c06d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:20.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.622+0000 7fb282e4b640 1 -- 172.21.15.53:0/1325562616 shutdown_connections 2023-06-10T19:02:20.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.622+0000 7fb282e4b640 1 -- 172.21.15.53:0/1325562616 wait complete. 2023-06-10T19:02:20.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.622+0000 7fb282e4b640 1 Processor -- start 2023-06-10T19:02:20.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.622+0000 7fb282e4b640 1 -- start start 2023-06-10T19:02:20.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.622+0000 7fb282e4b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb27c0cf180 0x7fb27c163220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:20.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.622+0000 7fb282e4b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb27c159450 0x7fb27c150e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:20.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.622+0000 7fb282e4b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb27c15d680 0x7fb27c0af890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:20.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.622+0000 7fb282e4b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb27c06c510 con 0x7fb27c15d680 2023-06-10T19:02:20.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.622+0000 7fb282e4b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb27c06be90 con 0x7fb27c159450 2023-06-10T19:02:20.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.622+0000 7fb282e4b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb27c163d40 con 0x7fb27c0cf180 2023-06-10T19:02:20.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.622+0000 7fb2813e8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb27c15d680 0x7fb27c0af890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:20.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.622+0000 7fb2813e8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb27c15d680 0x7fb27c0af890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40872/0 (socket says 172.21.15.53:40872) 2023-06-10T19:02:20.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.622+0000 7fb2813e8640 1 -- 172.21.15.53:0/2187725719 learned_addr learned my addr 172.21.15.53:0/2187725719 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:20.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.622+0000 7fb280be7640 1 --2- 172.21.15.53:0/2187725719 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb27c0cf180 0x7fb27c163220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:20.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.622+0000 7fb273fff640 1 --2- 172.21.15.53:0/2187725719 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb27c159450 0x7fb27c150e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:20.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.622+0000 7fb2813e8640 1 -- 172.21.15.53:0/2187725719 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb27c0cf180 msgr2=0x7fb27c163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:20.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.622+0000 7fb2813e8640 1 --2- 172.21.15.53:0/2187725719 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb27c0cf180 0x7fb27c163220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:20.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.622+0000 7fb2813e8640 1 -- 172.21.15.53:0/2187725719 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb27c159450 msgr2=0x7fb27c150e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:20.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.622+0000 7fb2813e8640 1 --2- 172.21.15.53:0/2187725719 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb27c159450 0x7fb27c150e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:20.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.626+0000 7fb2813e8640 1 -- 172.21.15.53:0/2187725719 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb274009b30 con 0x7fb27c15d680 2023-06-10T19:02:20.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.626+0000 7fb280be7640 1 --2- 172.21.15.53:0/2187725719 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb27c0cf180 0x7fb27c163220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:02:20.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.626+0000 7fb273fff640 1 --2- 172.21.15.53:0/2187725719 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb27c159450 0x7fb27c150e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:02:20.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.626+0000 7fb2813e8640 1 --2- 172.21.15.53:0/2187725719 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb27c15d680 0x7fb27c0af890 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7fb27401ad00 tx=0x7fb2740193f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:20.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.626+0000 7fb2717fa640 1 -- 172.21.15.53:0/2187725719 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2740a64a0 con 0x7fb27c15d680 2023-06-10T19:02:20.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.626+0000 7fb2717fa640 1 -- 172.21.15.53:0/2187725719 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2740b5070 con 0x7fb27c15d680 2023-06-10T19:02:20.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.626+0000 7fb282e4b640 1 -- 172.21.15.53:0/2187725719 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb27c164020 con 0x7fb27c15d680 2023-06-10T19:02:20.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.626+0000 7fb2717fa640 1 -- 172.21.15.53:0/2187725719 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb274007000 con 0x7fb27c15d680 2023-06-10T19:02:20.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.626+0000 7fb282e4b640 1 -- 172.21.15.53:0/2187725719 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb27c163760 con 0x7fb27c15d680 2023-06-10T19:02:20.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.626+0000 7fb282e4b640 1 -- 172.21.15.53:0/2187725719 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb27c04d790 con 0x7fb27c15d680 2023-06-10T19:02:20.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.626+0000 7fb2717fa640 1 -- 172.21.15.53:0/2187725719 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb2740a78c0 con 0x7fb27c15d680 2023-06-10T19:02:20.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.626+0000 7fb2717fa640 1 --2- 172.21.15.53:0/2187725719 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb268066280 0x7fb268068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:20.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.626+0000 7fb2717fa640 1 -- 172.21.15.53:0/2187725719 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb27411e290 con 0x7fb27c15d680 2023-06-10T19:02:20.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.626+0000 7fb280be7640 1 --2- 172.21.15.53:0/2187725719 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb268066280 0x7fb268068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:20.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.626+0000 7fb280be7640 1 --2- 172.21.15.53:0/2187725719 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb268066280 0x7fb268068730 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fb27c06bcf0 tx=0x7fb278008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:20.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.630+0000 7fb2717fa640 1 -- 172.21.15.53:0/2187725719 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb2740eb700 con 0x7fb27c15d680 2023-06-10T19:02:20.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.798+0000 7fb282e4b640 1 -- 172.21.15.53:0/2187725719 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb27c06df70 con 0x7fb27c15d680 2023-06-10T19:02:20.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.802+0000 7fb2717fa640 1 -- 172.21.15.53:0/2187725719 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v94) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb2740eed20 con 0x7fb27c15d680 2023-06-10T19:02:20.803 INFO:teuthology.orchestra.run.smithi053.stderr:listed 0 entries 2023-06-10T19:02:20.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.802+0000 7fb282e4b640 1 -- 172.21.15.53:0/2187725719 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb268066280 msgr2=0x7fb268068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:20.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.802+0000 7fb282e4b640 1 --2- 172.21.15.53:0/2187725719 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb268066280 0x7fb268068730 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fb27c06bcf0 tx=0x7fb278008040 comp rx=0 tx=0).stop 2023-06-10T19:02:20.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.802+0000 7fb282e4b640 1 -- 172.21.15.53:0/2187725719 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb27c15d680 msgr2=0x7fb27c0af890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:20.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.802+0000 7fb282e4b640 1 --2- 172.21.15.53:0/2187725719 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb27c15d680 0x7fb27c0af890 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7fb27401ad00 tx=0x7fb2740193f0 comp rx=0 tx=0).stop 2023-06-10T19:02:20.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.802+0000 7fb282e4b640 1 -- 172.21.15.53:0/2187725719 shutdown_connections 2023-06-10T19:02:20.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.802+0000 7fb282e4b640 1 --2- 172.21.15.53:0/2187725719 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb268066280 0x7fb268068730 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:20.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.802+0000 7fb282e4b640 1 --2- 172.21.15.53:0/2187725719 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb27c15d680 0x7fb27c0af890 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:20.808 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.802+0000 7fb282e4b640 1 --2- 172.21.15.53:0/2187725719 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb27c159450 0x7fb27c150e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:20.808 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.802+0000 7fb282e4b640 1 --2- 172.21.15.53:0/2187725719 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb27c0cf180 0x7fb27c163220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:20.808 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.802+0000 7fb282e4b640 1 -- 172.21.15.53:0/2187725719 >> 172.21.15.53:0/2187725719 conn(0x7fb27c06a0b0 msgr2=0x7fb27c0b11c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:20.808 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.802+0000 7fb282e4b640 1 -- 172.21.15.53:0/2187725719 shutdown_connections 2023-06-10T19:02:20.809 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.802+0000 7fb282e4b640 1 -- 172.21.15.53:0/2187725719 wait complete. 2023-06-10T19:02:20.822 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T19:02:20.823 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:02:20.829 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:02:20.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.942+0000 7f8d4037d640 1 Processor -- start 2023-06-10T19:02:20.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.942+0000 7f8d4037d640 1 -- start start 2023-06-10T19:02:20.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.942+0000 7f8d4037d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d3806b2f0 0x7f8d3806f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:20.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.942+0000 7f8d4037d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8d38160170 0x7f8d38162550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:20.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.942+0000 7f8d4037d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d38158a90 con 0x7f8d380c8d00 2023-06-10T19:02:20.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.942+0000 7f8d4037d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d380705d0 con 0x7f8d38160170 2023-06-10T19:02:20.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.942+0000 7f8d4037d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d380cce10 con 0x7f8d3806b2f0 2023-06-10T19:02:20.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.942+0000 7f8d3d918640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f8d380c8d00 0x7f8d3806b6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60926/0 (socket says 172.21.15.53:60926) 2023-06-10T19:02:20.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.942+0000 7f8d3d918640 1 -- 172.21.15.53:0/2550933355 learned_addr learned my addr 172.21.15.53:0/2550933355 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:02:20.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.942+0000 7f8d3e91a640 1 --2- 172.21.15.53:0/2550933355 >> v2:172.21.15.117:3300/0 conn(0x7f8d38160170 0x7f8d38162550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:20.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.942+0000 7f8d3e119640 1 --2- 172.21.15.53:0/2550933355 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d3806b2f0 0x7f8d3806f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:20.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.942+0000 7f8d3d117640 1 -- 172.21.15.53:0/2550933355 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2674061859 0 0) 0x7f8d2c0014a0 con 0x7f8d380c8d00 2023-06-10T19:02:20.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.942+0000 7f8d3d117640 1 -- 172.21.15.53:0/2550933355 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d20003530 con 0x7f8d380c8d00 2023-06-10T19:02:20.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.946+0000 7f8d3d117640 1 -- 172.21.15.53:0/2550933355 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 665897905 0 0) 0x7f8d20003530 con 0x7f8d380c8d00 2023-06-10T19:02:20.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.946+0000 7f8d3d117640 1 -- 172.21.15.53:0/2550933355 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d3806b2f0 msgr2=0x7f8d3806f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:20.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.946+0000 7f8d3d117640 1 --2- 172.21.15.53:0/2550933355 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d3806b2f0 0x7f8d3806f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:20.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.946+0000 7f8d3d117640 1 -- 172.21.15.53:0/2550933355 >> v2:172.21.15.117:3300/0 conn(0x7f8d38160170 msgr2=0x7f8d38162550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:20.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.946+0000 7f8d3d117640 1 --2- 172.21.15.53:0/2550933355 >> v2:172.21.15.117:3300/0 conn(0x7f8d38160170 0x7f8d38162550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:20.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.946+0000 7f8d3d117640 1 -- 172.21.15.53:0/2550933355 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d3806f9c0 con 0x7f8d380c8d00 2023-06-10T19:02:20.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.946+0000 7f8d3d117640 1 -- 172.21.15.53:0/2550933355 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f8d2c001b90 con 0x7f8d380c8d00 2023-06-10T19:02:20.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.946+0000 7f8d3e119640 1 --2- 172.21.15.53:0/2550933355 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d3806b2f0 0x7f8d3806f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-10T19:02:20.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.946+0000 7f8d3d117640 1 -- 172.21.15.53:0/2550933355 >> v1:172.21.15.53:6789/0 conn(0x7f8d380c8d00 legacy=0x7f8d3806b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:20.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.946+0000 7f8d3d117640 1 --2- 172.21.15.53:0/2550933355 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d200039f0 0x7f8d20003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:20.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.946+0000 7f8d3d117640 1 --2- 172.21.15.53:0/2550933355 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d200047d0 0x7f8d20004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:20.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.946+0000 7f8d3d117640 1 --2- 172.21.15.53:0/2550933355 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d3806b2f0 0x7f8d20005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:20.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.946+0000 7f8d3d117640 1 -- 172.21.15.53:0/2550933355 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d380705d0 con 0x7f8d200047d0 2023-06-10T19:02:20.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.946+0000 7f8d3d117640 1 -- 172.21.15.53:0/2550933355 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d380cce10 con 0x7f8d200039f0 2023-06-10T19:02:20.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.946+0000 7f8d3d117640 1 -- 172.21.15.53:0/2550933355 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2000b9c0 con 0x7f8d3806b2f0 2023-06-10T19:02:20.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.946+0000 7f8d3e91a640 1 --2- 172.21.15.53:0/2550933355 >> v2:172.21.15.117:3300/0 conn(0x7f8d38160170 0x7f8d38162550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-10T19:02:20.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.946+0000 7f8d3d918640 1 --2- 172.21.15.53:0/2550933355 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d200047d0 0x7f8d20004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:20.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.946+0000 7f8d3e119640 1 --2- 172.21.15.53:0/2550933355 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d200039f0 0x7f8d20003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:20.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.946+0000 7f8d3e91a640 1 --2- 172.21.15.53:0/2550933355 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d3806b2f0 0x7f8d20005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:20.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.946+0000 7f8d3d918640 1 -- 172.21.15.53:0/2550933355 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d3806b2f0 msgr2=0x7f8d20005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:20.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.946+0000 7f8d3d918640 1 --2- 172.21.15.53:0/2550933355 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d3806b2f0 0x7f8d20005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:20.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.946+0000 7f8d3d918640 1 -- 172.21.15.53:0/2550933355 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d200039f0 msgr2=0x7f8d20003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:20.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.946+0000 7f8d3d918640 1 --2- 172.21.15.53:0/2550933355 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d200039f0 0x7f8d20003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:20.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.946+0000 7f8d3d918640 1 -- 172.21.15.53:0/2550933355 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d28009420 con 0x7f8d200047d0 2023-06-10T19:02:20.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.946+0000 7f8d3e91a640 1 --2- 172.21.15.53:0/2550933355 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d3806b2f0 0x7f8d20005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:02:20.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.946+0000 7f8d3e119640 1 --2- 172.21.15.53:0/2550933355 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d200039f0 0x7f8d20003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:02:20.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.946+0000 7f8d3d918640 1 --2- 172.21.15.53:0/2550933355 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d200047d0 0x7f8d20004c40 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c00a780 tx=0x7f8d2c01d280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c418ae085033bff2 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:20.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.946+0000 7f8d3d117640 1 -- 172.21.15.53:0/2550933355 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d2c0ad630 con 0x7f8d200047d0 2023-06-10T19:02:20.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.946+0000 7f8d3d117640 1 -- 172.21.15.53:0/2550933355 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d2c0a8070 con 0x7f8d200047d0 2023-06-10T19:02:20.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.946+0000 7f8d3d117640 1 -- 172.21.15.53:0/2550933355 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d2c0ad9f0 con 0x7f8d200047d0 2023-06-10T19:02:20.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.946+0000 7f8d4037d640 1 -- 172.21.15.53:0/2550933355 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d200047d0 msgr2=0x7f8d20004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:20.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.946+0000 7f8d4037d640 1 --2- 172.21.15.53:0/2550933355 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d200047d0 0x7f8d20004c40 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c00a780 tx=0x7f8d2c01d280 comp rx=0 tx=0).stop 2023-06-10T19:02:20.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.946+0000 7f8d3e91a640 1 -- 172.21.15.53:0/2550933355 reap_dead start 2023-06-10T19:02:20.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.946+0000 7f8d4037d640 1 -- 172.21.15.53:0/2550933355 shutdown_connections 2023-06-10T19:02:20.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.946+0000 7f8d4037d640 1 -- 172.21.15.53:0/2550933355 >> 172.21.15.53:0/2550933355 conn(0x7f8d3806a0d0 msgr2=0x7f8d380ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:20.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.950+0000 7f8d4037d640 1 -- 172.21.15.53:0/2550933355 shutdown_connections 2023-06-10T19:02:20.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.950+0000 7f8d4037d640 1 -- 172.21.15.53:0/2550933355 wait complete. 2023-06-10T19:02:20.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.950+0000 7f8d4037d640 1 Processor -- start 2023-06-10T19:02:20.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.950+0000 7f8d4037d640 1 -- start start 2023-06-10T19:02:20.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.950+0000 7f8d4037d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d200047d0 0x7f8d381ee870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:20.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.950+0000 7f8d4037d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d380c26f0 0x7f8d381f1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:20.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.950+0000 7f8d4037d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d3815a220 0x7f8d3815a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:20.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.950+0000 7f8d4037d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d380ac810 con 0x7f8d380c26f0 2023-06-10T19:02:20.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.950+0000 7f8d4037d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d381f2160 con 0x7f8d200047d0 2023-06-10T19:02:20.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.950+0000 7f8d4037d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d380abb90 con 0x7f8d3815a220 2023-06-10T19:02:20.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.950+0000 7f8d3d918640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d380c26f0 0x7f8d381f1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:20.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.950+0000 7f8d3d918640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d380c26f0 0x7f8d381f1c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40880/0 (socket says 172.21.15.53:40880) 2023-06-10T19:02:20.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.950+0000 7f8d3d918640 1 -- 172.21.15.53:0/2344239182 learned_addr learned my addr 172.21.15.53:0/2344239182 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:20.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.950+0000 7f8d3e91a640 1 --2- 172.21.15.53:0/2344239182 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d3815a220 0x7f8d3815a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:20.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.950+0000 7f8d3e119640 1 --2- 172.21.15.53:0/2344239182 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d200047d0 0x7f8d381ee870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:20.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.950+0000 7f8d3d918640 1 -- 172.21.15.53:0/2344239182 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d3815a220 msgr2=0x7f8d3815a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:20.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.950+0000 7f8d3d918640 1 --2- 172.21.15.53:0/2344239182 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d3815a220 0x7f8d3815a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:20.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.950+0000 7f8d3d918640 1 -- 172.21.15.53:0/2344239182 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d200047d0 msgr2=0x7f8d381ee870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:20.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.950+0000 7f8d3d918640 1 --2- 172.21.15.53:0/2344239182 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d200047d0 0x7f8d381ee870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:20.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.950+0000 7f8d3d918640 1 -- 172.21.15.53:0/2344239182 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d380abe70 con 0x7f8d380c26f0 2023-06-10T19:02:20.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.950+0000 7f8d3e91a640 1 --2- 172.21.15.53:0/2344239182 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d3815a220 0x7f8d3815a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:02:20.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.950+0000 7f8d3d918640 1 --2- 172.21.15.53:0/2344239182 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d380c26f0 0x7f8d381f1c20 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c000f90 tx=0x7f8d20005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:20.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.950+0000 7f8d36ffd640 1 -- 172.21.15.53:0/2344239182 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d2c004b70 con 0x7f8d380c26f0 2023-06-10T19:02:20.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.950+0000 7f8d36ffd640 1 -- 172.21.15.53:0/2344239182 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d2c004cd0 con 0x7f8d380c26f0 2023-06-10T19:02:20.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.950+0000 7f8d4037d640 1 -- 172.21.15.53:0/2344239182 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d380ac150 con 0x7f8d380c26f0 2023-06-10T19:02:20.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.950+0000 7f8d36ffd640 1 -- 172.21.15.53:0/2344239182 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d2c001ad0 con 0x7f8d380c26f0 2023-06-10T19:02:20.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.950+0000 7f8d4037d640 1 -- 172.21.15.53:0/2344239182 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d380ab860 con 0x7f8d380c26f0 2023-06-10T19:02:20.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.950+0000 7f8d4037d640 1 -- 172.21.15.53:0/2344239182 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d38070a60 con 0x7f8d380c26f0 2023-06-10T19:02:20.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.954+0000 7f8d36ffd640 1 -- 172.21.15.53:0/2344239182 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8d2c0aa030 con 0x7f8d380c26f0 2023-06-10T19:02:20.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.954+0000 7f8d36ffd640 1 --2- 172.21.15.53:0/2344239182 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8d240662b0 0x7f8d24068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:20.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.954+0000 7f8d36ffd640 1 -- 172.21.15.53:0/2344239182 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8d2c11dae0 con 0x7f8d380c26f0 2023-06-10T19:02:20.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.954+0000 7f8d3e119640 1 --2- 172.21.15.53:0/2344239182 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8d240662b0 0x7f8d24068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:20.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.954+0000 7f8d3e119640 1 --2- 172.21.15.53:0/2344239182 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8d240662b0 0x7f8d24068760 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f8d28006d50 tx=0x7f8d28008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:20.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:20.958+0000 7f8d36ffd640 1 -- 172.21.15.53:0/2344239182 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8d2c0eaff0 con 0x7f8d380c26f0 2023-06-10T19:02:21.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.114+0000 7f8d4037d640 1 -- 172.21.15.53:0/2344239182 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8d38158a90 con 0x7f8d380c26f0 2023-06-10T19:02:21.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.118+0000 7f8d36ffd640 1 -- 172.21.15.53:0/2344239182 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+18282 (secure 0 0 0) 0x7f8d38158a90 con 0x7f8d380c26f0 2023-06-10T19:02:21.121 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:02:21.122 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":94,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:02:03.646580+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-06-10T19:02:00.325404+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-06-10T19:02:01.620938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:02:21.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.118+0000 7f8d4037d640 1 -- 172.21.15.53:0/2344239182 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8d240662b0 msgr2=0x7f8d24068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:21.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.118+0000 7f8d4037d640 1 --2- 172.21.15.53:0/2344239182 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8d240662b0 0x7f8d24068760 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f8d28006d50 tx=0x7f8d28008040 comp rx=0 tx=0).stop 2023-06-10T19:02:21.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.118+0000 7f8d4037d640 1 -- 172.21.15.53:0/2344239182 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d380c26f0 msgr2=0x7f8d381f1c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:21.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.118+0000 7f8d4037d640 1 --2- 172.21.15.53:0/2344239182 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d380c26f0 0x7f8d381f1c20 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c000f90 tx=0x7f8d20005800 comp rx=0 tx=0).stop 2023-06-10T19:02:21.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.122+0000 7f8d4037d640 1 -- 172.21.15.53:0/2344239182 shutdown_connections 2023-06-10T19:02:21.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.122+0000 7f8d4037d640 1 --2- 172.21.15.53:0/2344239182 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8d240662b0 0x7f8d24068760 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:21.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.122+0000 7f8d4037d640 1 --2- 172.21.15.53:0/2344239182 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d3815a220 0x7f8d3815a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:21.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.122+0000 7f8d4037d640 1 --2- 172.21.15.53:0/2344239182 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d380c26f0 0x7f8d381f1c20 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:21.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.122+0000 7f8d4037d640 1 --2- 172.21.15.53:0/2344239182 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d200047d0 0x7f8d381ee870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:21.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.122+0000 7f8d4037d640 1 -- 172.21.15.53:0/2344239182 >> 172.21.15.53:0/2344239182 conn(0x7f8d3806a0d0 msgr2=0x7f8d380b2ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:21.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.122+0000 7f8d4037d640 1 -- 172.21.15.53:0/2344239182 shutdown_connections 2023-06-10T19:02:21.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.122+0000 7f8d4037d640 1 -- 172.21.15.53:0/2344239182 wait complete. 2023-06-10T19:02:21.139 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-10T18:52:33.633114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-10T18:52:39.171487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-10T19:02:00.325404+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '93', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2023-06-10T19:02:01.620938+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '94', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-10T19:02:21.140 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-10T19:02:21.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.254+0000 7f01562e3640 1 Processor -- start 2023-06-10T19:02:21.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.254+0000 7f01562e3640 1 -- start start 2023-06-10T19:02:21.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.254+0000 7f01562e3640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0150156180 0x7f01500cd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:21.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.254+0000 7f01562e3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f015015c070 0x7f015015c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:21.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.254+0000 7f01562e3640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f015015ca00 con 0x7f0150158a80 2023-06-10T19:02:21.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.254+0000 7f01562e3640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f015006b090 con 0x7f0150156180 2023-06-10T19:02:21.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.254+0000 7f01562e3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f015006efa0 con 0x7f015015c070 2023-06-10T19:02:21.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.254+0000 7f0154880640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f0150158a80 0x7f0150158ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60956/0 (socket says 172.21.15.53:60956) 2023-06-10T19:02:21.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.254+0000 7f0154880640 1 -- 172.21.15.53:0/141120536 learned_addr learned my addr 172.21.15.53:0/141120536 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:02:21.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.254+0000 7f014f7fe640 1 --2- 172.21.15.53:0/141120536 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f015015c070 0x7f015015c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:21.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.254+0000 7f014ffff640 1 --2- 172.21.15.53:0/141120536 >> v2:172.21.15.117:3300/0 conn(0x7f0150156180 0x7f01500cd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:21.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.254+0000 7f014effd640 1 -- 172.21.15.53:0/141120536 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1919494293 0 0) 0x7f01480014a0 con 0x7f0150158a80 2023-06-10T19:02:21.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.254+0000 7f014effd640 1 -- 172.21.15.53:0/141120536 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0138005740 con 0x7f0150158a80 2023-06-10T19:02:21.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.254+0000 7f014effd640 1 -- 172.21.15.53:0/141120536 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2282447903 0 0) 0x7f0138005740 con 0x7f0150158a80 2023-06-10T19:02:21.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.254+0000 7f014effd640 1 -- 172.21.15.53:0/141120536 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f015015c070 msgr2=0x7f015015c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:21.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.254+0000 7f014effd640 1 --2- 172.21.15.53:0/141120536 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f015015c070 0x7f015015c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:21.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.254+0000 7f014effd640 1 -- 172.21.15.53:0/141120536 >> v2:172.21.15.117:3300/0 conn(0x7f0150156180 msgr2=0x7f01500cd4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:21.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.254+0000 7f014effd640 1 --2- 172.21.15.53:0/141120536 >> v2:172.21.15.117:3300/0 conn(0x7f0150156180 0x7f01500cd4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:21.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.254+0000 7f014effd640 1 -- 172.21.15.53:0/141120536 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01500cc720 con 0x7f0150158a80 2023-06-10T19:02:21.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.254+0000 7f014effd640 1 -- 172.21.15.53:0/141120536 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f0148001b90 con 0x7f0150158a80 2023-06-10T19:02:21.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.254+0000 7f014effd640 1 -- 172.21.15.53:0/141120536 >> v1:172.21.15.53:6789/0 conn(0x7f0150158a80 legacy=0x7f0150158ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:21.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.254+0000 7f014effd640 1 --2- 172.21.15.53:0/141120536 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f015015c070 0x7f0138005b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:21.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.254+0000 7f014effd640 1 --2- 172.21.15.53:0/141120536 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0138006110 0x7f01380069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:21.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.254+0000 7f014effd640 1 --2- 172.21.15.53:0/141120536 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0138006f20 0x7f0138007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:21.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.254+0000 7f014effd640 1 -- 172.21.15.53:0/141120536 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f015006b090 con 0x7f0138006f20 2023-06-10T19:02:21.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.254+0000 7f014effd640 1 -- 172.21.15.53:0/141120536 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f015006efa0 con 0x7f0138006110 2023-06-10T19:02:21.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.254+0000 7f014effd640 1 -- 172.21.15.53:0/141120536 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f013800dba0 con 0x7f015015c070 2023-06-10T19:02:21.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.254+0000 7f0154880640 1 --2- 172.21.15.53:0/141120536 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0138006f20 0x7f0138007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:21.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.254+0000 7f014f7fe640 1 --2- 172.21.15.53:0/141120536 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0138006110 0x7f01380069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:21.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.254+0000 7f014ffff640 1 --2- 172.21.15.53:0/141120536 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f015015c070 0x7f0138005b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:21.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.254+0000 7f0154880640 1 -- 172.21.15.53:0/141120536 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f015015c070 msgr2=0x7f0138005b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:21.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.254+0000 7f0154880640 1 --2- 172.21.15.53:0/141120536 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f015015c070 0x7f0138005b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:21.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.254+0000 7f0154880640 1 -- 172.21.15.53:0/141120536 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0138006110 msgr2=0x7f01380069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:21.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.254+0000 7f0154880640 1 --2- 172.21.15.53:0/141120536 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0138006110 0x7f01380069e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:21.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.254+0000 7f0154880640 1 -- 172.21.15.53:0/141120536 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0138005740 con 0x7f0138006f20 2023-06-10T19:02:21.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.258+0000 7f0154880640 1 --2- 172.21.15.53:0/141120536 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0138006f20 0x7f0138007390 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f014800a840 tx=0x7f014801d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d32fec7e11e23f89 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:21.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.258+0000 7f014effd640 1 -- 172.21.15.53:0/141120536 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01480ad630 con 0x7f0138006f20 2023-06-10T19:02:21.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.258+0000 7f014effd640 1 -- 172.21.15.53:0/141120536 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01480a8070 con 0x7f0138006f20 2023-06-10T19:02:21.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.258+0000 7f014effd640 1 -- 172.21.15.53:0/141120536 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01480ada30 con 0x7f0138006f20 2023-06-10T19:02:21.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.258+0000 7f01562e3640 1 -- 172.21.15.53:0/141120536 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0138006f20 msgr2=0x7f0138007390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:21.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.258+0000 7f01562e3640 1 --2- 172.21.15.53:0/141120536 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0138006f20 0x7f0138007390 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f014800a840 tx=0x7f014801d340 comp rx=0 tx=0).stop 2023-06-10T19:02:21.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.258+0000 7f0154880640 1 -- 172.21.15.53:0/141120536 reap_dead start 2023-06-10T19:02:21.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.258+0000 7f01562e3640 1 -- 172.21.15.53:0/141120536 shutdown_connections 2023-06-10T19:02:21.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.258+0000 7f01562e3640 1 -- 172.21.15.53:0/141120536 >> 172.21.15.53:0/141120536 conn(0x7f015006a0e0 msgr2=0x7f01500cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:21.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.258+0000 7f01562e3640 1 -- 172.21.15.53:0/141120536 shutdown_connections 2023-06-10T19:02:21.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.258+0000 7f01562e3640 1 -- 172.21.15.53:0/141120536 wait complete. 2023-06-10T19:02:21.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.258+0000 7f01562e3640 1 Processor -- start 2023-06-10T19:02:21.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.258+0000 7f01562e3640 1 -- start start 2023-06-10T19:02:21.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.258+0000 7f01562e3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0150150770 0x7f01500b3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:21.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.258+0000 7f01562e3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0150151470 0x7f0150158e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:21.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.258+0000 7f01562e3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0150157660 0x7f0150157ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:21.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.258+0000 7f01562e3640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01500b3a90 con 0x7f0150157660 2023-06-10T19:02:21.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.258+0000 7f01562e3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0150158010 con 0x7f0150151470 2023-06-10T19:02:21.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.258+0000 7f01562e3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01500c5e80 con 0x7f0150150770 2023-06-10T19:02:21.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.258+0000 7f0154880640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0150157660 0x7f0150157ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:21.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.258+0000 7f0154880640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0150157660 0x7f0150157ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36866/0 (socket says 172.21.15.53:36866) 2023-06-10T19:02:21.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.258+0000 7f0154880640 1 -- 172.21.15.53:0/2780109085 learned_addr learned my addr 172.21.15.53:0/2780109085 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:21.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.258+0000 7f014f7fe640 1 --2- 172.21.15.53:0/2780109085 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0150151470 0x7f0150158e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:21.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.258+0000 7f014ffff640 1 --2- 172.21.15.53:0/2780109085 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0150150770 0x7f01500b3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:21.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.258+0000 7f0154880640 1 -- 172.21.15.53:0/2780109085 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0150150770 msgr2=0x7f01500b3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:21.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.258+0000 7f0154880640 1 --2- 172.21.15.53:0/2780109085 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0150150770 0x7f01500b3550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:21.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.258+0000 7f0154880640 1 -- 172.21.15.53:0/2780109085 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0150151470 msgr2=0x7f0150158e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:21.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.258+0000 7f0154880640 1 --2- 172.21.15.53:0/2780109085 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0150151470 0x7f0150158e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:21.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.258+0000 7f0154880640 1 -- 172.21.15.53:0/2780109085 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01500b0b10 con 0x7f0150157660 2023-06-10T19:02:21.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.258+0000 7f014ffff640 1 --2- 172.21.15.53:0/2780109085 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0150150770 0x7f01500b3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:02:21.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.262+0000 7f0154880640 1 --2- 172.21.15.53:0/2780109085 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0150157660 0x7f0150157ad0 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f014801dbe0 tx=0x7f0138007a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:21.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.262+0000 7f014cff9640 1 -- 172.21.15.53:0/2780109085 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0148001b50 con 0x7f0150157660 2023-06-10T19:02:21.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.262+0000 7f014cff9640 1 -- 172.21.15.53:0/2780109085 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01480014a0 con 0x7f0150157660 2023-06-10T19:02:21.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.262+0000 7f01562e3640 1 -- 172.21.15.53:0/2780109085 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01500b0df0 con 0x7f0150157660 2023-06-10T19:02:21.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.262+0000 7f014cff9640 1 -- 172.21.15.53:0/2780109085 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01480ad630 con 0x7f0150157660 2023-06-10T19:02:21.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.262+0000 7f01562e3640 1 -- 172.21.15.53:0/2780109085 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01500c6400 con 0x7f0150157660 2023-06-10T19:02:21.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.262+0000 7f01562e3640 1 -- 172.21.15.53:0/2780109085 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f015004d790 con 0x7f0150157660 2023-06-10T19:02:21.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.262+0000 7f014cff9640 1 -- 172.21.15.53:0/2780109085 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f01480aa030 con 0x7f0150157660 2023-06-10T19:02:21.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.262+0000 7f014cff9640 1 --2- 172.21.15.53:0/2780109085 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f013c066280 0x7f013c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:21.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.262+0000 7f014cff9640 1 -- 172.21.15.53:0/2780109085 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f014811ce30 con 0x7f0150157660 2023-06-10T19:02:21.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.262+0000 7f014ffff640 1 --2- 172.21.15.53:0/2780109085 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f013c066280 0x7f013c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:21.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.262+0000 7f014ffff640 1 --2- 172.21.15.53:0/2780109085 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f013c066280 0x7f013c068730 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f0140009a00 tx=0x7f0140008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:21.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.266+0000 7f014cff9640 1 -- 172.21.15.53:0/2780109085 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f01480ea2b0 con 0x7f0150157660 2023-06-10T19:02:21.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.414+0000 7f01562e3640 1 -- 172.21.15.53:0/2780109085 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f015015ca00 con 0x7f0150157660 2023-06-10T19:02:21.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.414+0000 7f014cff9640 1 -- 172.21.15.53:0/2780109085 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v94) v1 ==== 93+0+10 (secure 0 0 0) 0x7f015015ca00 con 0x7f0150157660 2023-06-10T19:02:21.419 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-06-10T19:02:21.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.418+0000 7f01562e3640 1 -- 172.21.15.53:0/2780109085 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f013c066280 msgr2=0x7f013c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:21.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.418+0000 7f01562e3640 1 --2- 172.21.15.53:0/2780109085 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f013c066280 0x7f013c068730 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f0140009a00 tx=0x7f0140008040 comp rx=0 tx=0).stop 2023-06-10T19:02:21.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.418+0000 7f01562e3640 1 -- 172.21.15.53:0/2780109085 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0150157660 msgr2=0x7f0150157ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:21.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.418+0000 7f01562e3640 1 --2- 172.21.15.53:0/2780109085 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0150157660 0x7f0150157ad0 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f014801dbe0 tx=0x7f0138007a10 comp rx=0 tx=0).stop 2023-06-10T19:02:21.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.418+0000 7f01562e3640 1 -- 172.21.15.53:0/2780109085 shutdown_connections 2023-06-10T19:02:21.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.418+0000 7f01562e3640 1 --2- 172.21.15.53:0/2780109085 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f013c066280 0x7f013c068730 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:21.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.418+0000 7f01562e3640 1 --2- 172.21.15.53:0/2780109085 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0150157660 0x7f0150157ad0 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:21.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.418+0000 7f01562e3640 1 --2- 172.21.15.53:0/2780109085 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0150151470 0x7f0150158e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:21.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.418+0000 7f01562e3640 1 --2- 172.21.15.53:0/2780109085 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0150150770 0x7f01500b3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:21.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.418+0000 7f01562e3640 1 -- 172.21.15.53:0/2780109085 >> 172.21.15.53:0/2780109085 conn(0x7f015006a0e0 msgr2=0x7f01500aeea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:21.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.418+0000 7f01562e3640 1 -- 172.21.15.53:0/2780109085 shutdown_connections 2023-06-10T19:02:21.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.418+0000 7f01562e3640 1 -- 172.21.15.53:0/2780109085 wait complete. 2023-06-10T19:02:21.436 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-10T19:02:21.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.562+0000 7f9962b76640 1 Processor -- start 2023-06-10T19:02:21.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.562+0000 7f9962b76640 1 -- start start 2023-06-10T19:02:21.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.562+0000 7f9962b76640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f995c159450 0x7f995c15d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:21.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.562+0000 7f9962b76640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f995c15d680 0x7f995c0cec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:21.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.562+0000 7f9962b76640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f995c0cf180 0x7f995c0cda20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:21.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.562+0000 7f9962b76640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f995c0cf600 con 0x7f995c0cf180 2023-06-10T19:02:21.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.562+0000 7f9962b76640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f995c0cbac0 con 0x7f995c15d680 2023-06-10T19:02:21.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.562+0000 7f9962b76640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f995c15dc00 con 0x7f995c159450 2023-06-10T19:02:21.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.562+0000 7f9961113640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f995c0cf180 0x7f995c0cda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:21.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.562+0000 7f9961113640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f995c0cf180 0x7f995c0cda20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36876/0 (socket says 172.21.15.53:36876) 2023-06-10T19:02:21.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.562+0000 7f9961113640 1 -- 172.21.15.53:0/4145164625 learned_addr learned my addr 172.21.15.53:0/4145164625 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:21.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.562+0000 7f9960912640 1 --2- 172.21.15.53:0/4145164625 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f995c159450 0x7f995c15d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:21.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.562+0000 7f995bfff640 1 --2- 172.21.15.53:0/4145164625 >> v2:172.21.15.117:3300/0 conn(0x7f995c15d680 0x7f995c0cec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:21.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.562+0000 7f9961113640 1 -- 172.21.15.53:0/4145164625 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f995c159450 msgr2=0x7f995c15d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:21.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.562+0000 7f9961113640 1 --2- 172.21.15.53:0/4145164625 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f995c159450 0x7f995c15d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:21.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.562+0000 7f9961113640 1 -- 172.21.15.53:0/4145164625 >> v2:172.21.15.117:3300/0 conn(0x7f995c15d680 msgr2=0x7f995c0cec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:21.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.562+0000 7f9961113640 1 --2- 172.21.15.53:0/4145164625 >> v2:172.21.15.117:3300/0 conn(0x7f995c15d680 0x7f995c0cec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:21.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.562+0000 7f9961113640 1 -- 172.21.15.53:0/4145164625 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f995c15dee0 con 0x7f995c0cf180 2023-06-10T19:02:21.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.562+0000 7f995bfff640 1 --2- 172.21.15.53:0/4145164625 >> v2:172.21.15.117:3300/0 conn(0x7f995c15d680 0x7f995c0cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:02:21.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.566+0000 7f9961113640 1 --2- 172.21.15.53:0/4145164625 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f995c0cf180 0x7f995c0cda20 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f995c0b29d0 tx=0x7f995401c650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=124f98e2063e2bc3 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:21.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.566+0000 7f995b7fe640 1 -- 172.21.15.53:0/4145164625 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99540a64a0 con 0x7f995c0cf180 2023-06-10T19:02:21.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.566+0000 7f995b7fe640 1 -- 172.21.15.53:0/4145164625 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99540a6600 con 0x7f995c0cf180 2023-06-10T19:02:21.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.566+0000 7f995b7fe640 1 -- 172.21.15.53:0/4145164625 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99540a6990 con 0x7f995c0cf180 2023-06-10T19:02:21.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.566+0000 7f9962b76640 1 -- 172.21.15.53:0/4145164625 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f995c0cf180 msgr2=0x7f995c0cda20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:21.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.566+0000 7f9962b76640 1 --2- 172.21.15.53:0/4145164625 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f995c0cf180 0x7f995c0cda20 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f995c0b29d0 tx=0x7f995401c650 comp rx=0 tx=0).stop 2023-06-10T19:02:21.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.566+0000 7f9962b76640 1 -- 172.21.15.53:0/4145164625 shutdown_connections 2023-06-10T19:02:21.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.566+0000 7f9962b76640 1 --2- 172.21.15.53:0/4145164625 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f995c0cf180 0x7f995c0cda20 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:21.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.566+0000 7f9962b76640 1 --2- 172.21.15.53:0/4145164625 >> v2:172.21.15.117:3300/0 conn(0x7f995c15d680 0x7f995c0cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:21.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.566+0000 7f9962b76640 1 --2- 172.21.15.53:0/4145164625 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f995c159450 0x7f995c15d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:21.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.566+0000 7f9962b76640 1 -- 172.21.15.53:0/4145164625 >> 172.21.15.53:0/4145164625 conn(0x7f995c06a090 msgr2=0x7f995c06d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:21.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.566+0000 7f9962b76640 1 -- 172.21.15.53:0/4145164625 shutdown_connections 2023-06-10T19:02:21.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.566+0000 7f9962b76640 1 -- 172.21.15.53:0/4145164625 wait complete. 2023-06-10T19:02:21.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.566+0000 7f9962b76640 1 Processor -- start 2023-06-10T19:02:21.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.566+0000 7f9962b76640 1 -- start start 2023-06-10T19:02:21.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.566+0000 7f9962b76640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f995c0cf180 0x7f995c163e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:21.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.566+0000 7f9962b76640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f995c159450 0x7f995c156a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:21.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.566+0000 7f9962b76640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f995c15d680 0x7f995c1584a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:21.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.566+0000 7f9962b76640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f995c158d60 con 0x7f995c0cf180 2023-06-10T19:02:21.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.566+0000 7f9962b76640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f995c140c90 con 0x7f995c15d680 2023-06-10T19:02:21.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.566+0000 7f9962b76640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f995c13fed0 con 0x7f995c159450 2023-06-10T19:02:21.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.566+0000 7f9960912640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f995c0cf180 0x7f995c163e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:21.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.566+0000 7f9960912640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f995c0cf180 0x7f995c163e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36878/0 (socket says 172.21.15.53:36878) 2023-06-10T19:02:21.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.566+0000 7f9960912640 1 -- 172.21.15.53:0/4055290604 learned_addr learned my addr 172.21.15.53:0/4055290604 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:21.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.566+0000 7f995bfff640 1 --2- 172.21.15.53:0/4055290604 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f995c159450 0x7f995c156a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:21.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.566+0000 7f9961113640 1 --2- 172.21.15.53:0/4055290604 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f995c15d680 0x7f995c1584a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:21.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.566+0000 7f9960912640 1 -- 172.21.15.53:0/4055290604 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f995c159450 msgr2=0x7f995c156a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:21.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.566+0000 7f9960912640 1 --2- 172.21.15.53:0/4055290604 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f995c159450 0x7f995c156a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:21.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.566+0000 7f9960912640 1 -- 172.21.15.53:0/4055290604 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f995c15d680 msgr2=0x7f995c1584a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:21.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.566+0000 7f9960912640 1 --2- 172.21.15.53:0/4055290604 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f995c15d680 0x7f995c1584a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:21.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.566+0000 7f9960912640 1 -- 172.21.15.53:0/4055290604 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9954009b30 con 0x7f995c0cf180 2023-06-10T19:02:21.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.566+0000 7f9960912640 1 --2- 172.21.15.53:0/4055290604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f995c0cf180 0x7f995c163e80 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f995000d620 tx=0x7f995000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:21.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.570+0000 7f99597fa640 1 -- 172.21.15.53:0/4055290604 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f995000b620 con 0x7f995c0cf180 2023-06-10T19:02:21.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.570+0000 7f99597fa640 1 -- 172.21.15.53:0/4055290604 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f995000b780 con 0x7f995c0cf180 2023-06-10T19:02:21.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.570+0000 7f99597fa640 1 -- 172.21.15.53:0/4055290604 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f995000bb10 con 0x7f995c0cf180 2023-06-10T19:02:21.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.570+0000 7f9962b76640 1 -- 172.21.15.53:0/4055290604 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f995c1401b0 con 0x7f995c0cf180 2023-06-10T19:02:21.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.570+0000 7f9962b76640 1 -- 172.21.15.53:0/4055290604 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f995c140770 con 0x7f995c0cf180 2023-06-10T19:02:21.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.570+0000 7f9962b76640 1 -- 172.21.15.53:0/4055290604 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f995c04d790 con 0x7f995c0cf180 2023-06-10T19:02:21.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.570+0000 7f99597fa640 1 -- 172.21.15.53:0/4055290604 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f995000bc70 con 0x7f995c0cf180 2023-06-10T19:02:21.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.570+0000 7f99597fa640 1 --2- 172.21.15.53:0/4055290604 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9940066280 0x7f9940068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:21.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.570+0000 7f99597fa640 1 -- 172.21.15.53:0/4055290604 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f99500840e0 con 0x7f995c0cf180 2023-06-10T19:02:21.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.570+0000 7f995bfff640 1 --2- 172.21.15.53:0/4055290604 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9940066280 0x7f9940068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:21.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.570+0000 7f995bfff640 1 --2- 172.21.15.53:0/4055290604 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9940066280 0x7f9940068730 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f995c06da50 tx=0x7f9948008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:21.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.574+0000 7f99597fa640 1 -- 172.21.15.53:0/4055290604 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9950051610 con 0x7f995c0cf180 2023-06-10T19:02:21.732 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.730+0000 7f9962b76640 1 -- 172.21.15.53:0/4055290604 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f995c06df70 con 0x7f995c0cf180 2023-06-10T19:02:21.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.730+0000 7f99597fa640 1 -- 172.21.15.53:0/4055290604 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v94) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9950007380 con 0x7f995c0cf180 2023-06-10T19:02:21.733 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-06-10T19:02:21.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.734+0000 7f9962b76640 1 -- 172.21.15.53:0/4055290604 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9940066280 msgr2=0x7f9940068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:21.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.734+0000 7f9962b76640 1 --2- 172.21.15.53:0/4055290604 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9940066280 0x7f9940068730 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f995c06da50 tx=0x7f9948008040 comp rx=0 tx=0).stop 2023-06-10T19:02:21.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.734+0000 7f9962b76640 1 -- 172.21.15.53:0/4055290604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f995c0cf180 msgr2=0x7f995c163e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:21.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.734+0000 7f9962b76640 1 --2- 172.21.15.53:0/4055290604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f995c0cf180 0x7f995c163e80 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f995000d620 tx=0x7f995000dae0 comp rx=0 tx=0).stop 2023-06-10T19:02:21.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.734+0000 7f9962b76640 1 -- 172.21.15.53:0/4055290604 shutdown_connections 2023-06-10T19:02:21.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.734+0000 7f9962b76640 1 --2- 172.21.15.53:0/4055290604 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9940066280 0x7f9940068730 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:21.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.734+0000 7f9962b76640 1 --2- 172.21.15.53:0/4055290604 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f995c15d680 0x7f995c1584a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:21.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.734+0000 7f9962b76640 1 --2- 172.21.15.53:0/4055290604 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f995c159450 0x7f995c156a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:21.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.734+0000 7f9962b76640 1 --2- 172.21.15.53:0/4055290604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f995c0cf180 0x7f995c163e80 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:21.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.734+0000 7f9962b76640 1 -- 172.21.15.53:0/4055290604 >> 172.21.15.53:0/4055290604 conn(0x7f995c06a090 msgr2=0x7f995c151d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:21.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.734+0000 7f9962b76640 1 -- 172.21.15.53:0/4055290604 shutdown_connections 2023-06-10T19:02:21.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.734+0000 7f9962b76640 1 -- 172.21.15.53:0/4055290604 wait complete. 2023-06-10T19:02:21.753 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-10T19:02:21.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.870+0000 7f1200038640 1 Processor -- start 2023-06-10T19:02:21.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.870+0000 7f1200038640 1 -- start start 2023-06-10T19:02:21.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.874+0000 7f1200038640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11f80c9fa0 0x7f11f806bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:21.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.874+0000 7f1200038640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f11f80af760 0x7f11f80afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:21.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.874+0000 7f1200038640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11f806b090 con 0x7f11f806c020 2023-06-10T19:02:21.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.874+0000 7f1200038640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11f80b0120 con 0x7f11f80af760 2023-06-10T19:02:21.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.874+0000 7f1200038640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11f80ca370 con 0x7f11f80c9fa0 2023-06-10T19:02:21.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.874+0000 7f11fddd4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11f80c9fa0 0x7f11f806bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:21.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.874+0000 7f11fe5d5640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f11f80af760 0x7f11f80afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:21.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.874+0000 7f11fddd4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11f80c9fa0 0x7f11f806bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.53:46102/0 (socket says 172.21.15.53:46102) 2023-06-10T19:02:21.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.874+0000 7f11fddd4640 1 -- 172.21.15.53:0/514125068 learned_addr learned my addr 172.21.15.53:0/514125068 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:21.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.874+0000 7f11fe5d5640 1 -- 172.21.15.53:0/514125068 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11f80c9fa0 msgr2=0x7f11f806bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:21.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.874+0000 7f11fe5d5640 1 --2- 172.21.15.53:0/514125068 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11f80c9fa0 0x7f11f806bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:21.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.874+0000 7f11fe5d5640 1 -- 172.21.15.53:0/514125068 >> v1:172.21.15.117:6789/0 conn(0x7f11f806c020 legacy=0x7f11f80c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:21.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.874+0000 7f11fe5d5640 1 -- 172.21.15.53:0/514125068 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11f8070d50 con 0x7f11f80af760 2023-06-10T19:02:21.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.878+0000 7f11fe5d5640 1 --2- 172.21.15.53:0/514125068 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11f80af760 0x7f11f80afbe0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f11f0009d90 tx=0x7f11f001c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f290293662c69833 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:21.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.878+0000 7f11fcdd2640 1 -- 172.21.15.53:0/514125068 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f00a5860 con 0x7f11f80af760 2023-06-10T19:02:21.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.878+0000 7f11fcdd2640 1 -- 172.21.15.53:0/514125068 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11f00a59c0 con 0x7f11f80af760 2023-06-10T19:02:21.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.878+0000 7f11fcdd2640 1 -- 172.21.15.53:0/514125068 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f00a5d50 con 0x7f11f80af760 2023-06-10T19:02:21.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.878+0000 7f1200038640 1 -- 172.21.15.53:0/514125068 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11f80af760 msgr2=0x7f11f80afbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:21.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.878+0000 7f1200038640 1 --2- 172.21.15.53:0/514125068 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11f80af760 0x7f11f80afbe0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f11f0009d90 tx=0x7f11f001c890 comp rx=0 tx=0).stop 2023-06-10T19:02:21.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.878+0000 7f1200038640 1 -- 172.21.15.53:0/514125068 shutdown_connections 2023-06-10T19:02:21.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.878+0000 7f1200038640 1 --2- 172.21.15.53:0/514125068 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11f80af760 0x7f11f80afbe0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:21.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.878+0000 7f1200038640 1 --2- 172.21.15.53:0/514125068 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11f80c9fa0 0x7f11f806bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:21.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.878+0000 7f1200038640 1 -- 172.21.15.53:0/514125068 >> 172.21.15.53:0/514125068 conn(0x7f11f806a0e0 msgr2=0x7f11f80cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:21.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.878+0000 7f1200038640 1 -- 172.21.15.53:0/514125068 shutdown_connections 2023-06-10T19:02:21.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.878+0000 7f1200038640 1 -- 172.21.15.53:0/514125068 wait complete. 2023-06-10T19:02:21.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.878+0000 7f1200038640 1 Processor -- start 2023-06-10T19:02:21.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.878+0000 7f1200038640 1 -- start start 2023-06-10T19:02:21.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.882+0000 7f1200038640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11f806c020 0x7f11f815b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:21.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.882+0000 7f1200038640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11f80af760 0x7f11f80cd460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:21.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.882+0000 7f1200038640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f11f80c9fa0 0x7f11f81424d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:21.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.882+0000 7f1200038640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f80cd070 con 0x7f11f80c9fa0 2023-06-10T19:02:21.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.882+0000 7f1200038640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f815aa70 con 0x7f11f806c020 2023-06-10T19:02:21.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.882+0000 7f1200038640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11f815ad50 con 0x7f11f80af760 2023-06-10T19:02:21.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.882+0000 7f11fe5d5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f11f80c9fa0 0x7f11f81424d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:21.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.882+0000 7f11fe5d5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f11f80c9fa0 0x7f11f81424d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36888/0 (socket says 172.21.15.53:36888) 2023-06-10T19:02:21.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.882+0000 7f11fe5d5640 1 -- 172.21.15.53:0/3940699661 learned_addr learned my addr 172.21.15.53:0/3940699661 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:21.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.882+0000 7f11fddd4640 1 --2- 172.21.15.53:0/3940699661 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11f806c020 0x7f11f815b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:21.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.882+0000 7f11fd5d3640 1 --2- 172.21.15.53:0/3940699661 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11f80af760 0x7f11f80cd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:21.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.882+0000 7f11fe5d5640 1 -- 172.21.15.53:0/3940699661 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11f80af760 msgr2=0x7f11f80cd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:21.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.882+0000 7f11fe5d5640 1 --2- 172.21.15.53:0/3940699661 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11f80af760 0x7f11f80cd460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:21.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.882+0000 7f11fe5d5640 1 -- 172.21.15.53:0/3940699661 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11f806c020 msgr2=0x7f11f815b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:21.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.882+0000 7f11fe5d5640 1 --2- 172.21.15.53:0/3940699661 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11f806c020 0x7f11f815b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:21.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.882+0000 7f11fe5d5640 1 -- 172.21.15.53:0/3940699661 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11f0009a70 con 0x7f11f80c9fa0 2023-06-10T19:02:21.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.882+0000 7f11fddd4640 1 --2- 172.21.15.53:0/3940699661 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11f806c020 0x7f11f815b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:02:21.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.882+0000 7f11fe5d5640 1 --2- 172.21.15.53:0/3940699661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f11f80c9fa0 0x7f11f81424d0 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f11f00b0040 tx=0x7f11f0019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:21.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.882+0000 7f11ee7fc640 1 -- 172.21.15.53:0/3940699661 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f00b9860 con 0x7f11f80c9fa0 2023-06-10T19:02:21.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.882+0000 7f11ee7fc640 1 -- 172.21.15.53:0/3940699661 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11f00b99c0 con 0x7f11f80c9fa0 2023-06-10T19:02:21.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.882+0000 7f11ee7fc640 1 -- 172.21.15.53:0/3940699661 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f00b9d70 con 0x7f11f80c9fa0 2023-06-10T19:02:21.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.882+0000 7f1200038640 1 -- 172.21.15.53:0/3940699661 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11f815b030 con 0x7f11f80c9fa0 2023-06-10T19:02:21.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.882+0000 7f1200038640 1 -- 172.21.15.53:0/3940699661 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11f8142a10 con 0x7f11f80c9fa0 2023-06-10T19:02:21.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.882+0000 7f1200038640 1 -- 172.21.15.53:0/3940699661 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11f804d790 con 0x7f11f80c9fa0 2023-06-10T19:02:21.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.882+0000 7f11ee7fc640 1 -- 172.21.15.53:0/3940699661 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f11f00ad440 con 0x7f11f80c9fa0 2023-06-10T19:02:21.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.882+0000 7f11ee7fc640 1 --2- 172.21.15.53:0/3940699661 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f11dc066280 0x7f11dc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:21.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.882+0000 7f11ee7fc640 1 -- 172.21.15.53:0/3940699661 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f11f011f4b0 con 0x7f11f80c9fa0 2023-06-10T19:02:21.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.882+0000 7f11fddd4640 1 --2- 172.21.15.53:0/3940699661 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f11dc066280 0x7f11dc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:21.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.886+0000 7f11fddd4640 1 --2- 172.21.15.53:0/3940699661 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f11dc066280 0x7f11dc068730 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f11f4009b00 tx=0x7f11f4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:21.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:21.886+0000 7f11ee7fc640 1 -- 172.21.15.53:0/3940699661 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f11f00ec9c0 con 0x7f11f80c9fa0 2023-06-10T19:02:22.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.038+0000 7f1200038640 1 -- 172.21.15.53:0/3940699661 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f11f815b4e0 con 0x7f11f80c9fa0 2023-06-10T19:02:22.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.042+0000 7f11ee7fc640 1 -- 172.21.15.53:0/3940699661 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v94) v1 ==== 104+0+11 (secure 0 0 0) 0x7f11f00effe0 con 0x7f11f80c9fa0 2023-06-10T19:02:22.046 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-06-10T19:02:22.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.046+0000 7f1200038640 1 -- 172.21.15.53:0/3940699661 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f11dc066280 msgr2=0x7f11dc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:22.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.046+0000 7f1200038640 1 --2- 172.21.15.53:0/3940699661 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f11dc066280 0x7f11dc068730 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f11f4009b00 tx=0x7f11f4008040 comp rx=0 tx=0).stop 2023-06-10T19:02:22.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.046+0000 7f1200038640 1 -- 172.21.15.53:0/3940699661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f11f80c9fa0 msgr2=0x7f11f81424d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:22.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.046+0000 7f1200038640 1 --2- 172.21.15.53:0/3940699661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f11f80c9fa0 0x7f11f81424d0 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f11f00b0040 tx=0x7f11f0019630 comp rx=0 tx=0).stop 2023-06-10T19:02:22.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.046+0000 7f1200038640 1 -- 172.21.15.53:0/3940699661 shutdown_connections 2023-06-10T19:02:22.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.046+0000 7f1200038640 1 --2- 172.21.15.53:0/3940699661 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f11dc066280 0x7f11dc068730 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:22.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.046+0000 7f1200038640 1 --2- 172.21.15.53:0/3940699661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f11f80c9fa0 0x7f11f81424d0 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:22.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.046+0000 7f1200038640 1 --2- 172.21.15.53:0/3940699661 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11f80af760 0x7f11f80cd460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:22.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.046+0000 7f1200038640 1 --2- 172.21.15.53:0/3940699661 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11f806c020 0x7f11f815b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:22.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.046+0000 7f1200038640 1 -- 172.21.15.53:0/3940699661 >> 172.21.15.53:0/3940699661 conn(0x7f11f806a0e0 msgr2=0x7f11f80c3770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:22.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.046+0000 7f1200038640 1 -- 172.21.15.53:0/3940699661 shutdown_connections 2023-06-10T19:02:22.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.046+0000 7f1200038640 1 -- 172.21.15.53:0/3940699661 wait complete. 2023-06-10T19:02:22.063 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-10T19:02:22.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.190+0000 7f268b68c640 1 Processor -- start 2023-06-10T19:02:22.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.190+0000 7f268b68c640 1 -- start start 2023-06-10T19:02:22.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.190+0000 7f268b68c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f268415c090 0x7f26840b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:22.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.190+0000 7f268b68c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26840b0b90 0x7f26840b7720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:22.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.190+0000 7f268b68c640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26840cc7c0 con 0x7f26840b7c60 2023-06-10T19:02:22.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.190+0000 7f268b68c640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26840b80e0 con 0x7f268415c090 2023-06-10T19:02:22.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.190+0000 7f268b68c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26840ccaa0 con 0x7f26840b0b90 2023-06-10T19:02:22.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.190+0000 7f2689428640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f268415c090 0x7f26840b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:22.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.190+0000 7f2689428640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f268415c090 0x7f26840b10c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36894/0 (socket says 172.21.15.53:36894) 2023-06-10T19:02:22.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.190+0000 7f2689428640 1 -- 172.21.15.53:0/4140311989 learned_addr learned my addr 172.21.15.53:0/4140311989 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:22.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.190+0000 7f2688c27640 1 --2- 172.21.15.53:0/4140311989 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26840b0b90 0x7f26840b7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:22.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.190+0000 7f2689428640 1 -- 172.21.15.53:0/4140311989 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26840b0b90 msgr2=0x7f26840b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:22.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.190+0000 7f2689428640 1 --2- 172.21.15.53:0/4140311989 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26840b0b90 0x7f26840b7720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:22.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.190+0000 7f2689428640 1 -- 172.21.15.53:0/4140311989 >> v1:172.21.15.117:6789/0 conn(0x7f26840b7c60 legacy=0x7f26840b3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:22.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.190+0000 7f2689428640 1 -- 172.21.15.53:0/4140311989 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26840ccd80 con 0x7f268415c090 2023-06-10T19:02:22.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.190+0000 7f2688c27640 1 --2- 172.21.15.53:0/4140311989 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26840b0b90 0x7f26840b7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:02:22.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.194+0000 7f2689428640 1 --2- 172.21.15.53:0/4140311989 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f268415c090 0x7f26840b10c0 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f2680009870 tx=0x7f268001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=481cd18c9790c8ae server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:22.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.194+0000 7f2677fff640 1 -- 172.21.15.53:0/4140311989 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26800ab600 con 0x7f268415c090 2023-06-10T19:02:22.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.194+0000 7f2677fff640 1 -- 172.21.15.53:0/4140311989 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26800a7050 con 0x7f268415c090 2023-06-10T19:02:22.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.194+0000 7f2677fff640 1 -- 172.21.15.53:0/4140311989 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26800ab980 con 0x7f268415c090 2023-06-10T19:02:22.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.194+0000 7f268b68c640 1 -- 172.21.15.53:0/4140311989 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f268415c090 msgr2=0x7f26840b10c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:22.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.194+0000 7f268b68c640 1 --2- 172.21.15.53:0/4140311989 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f268415c090 0x7f26840b10c0 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f2680009870 tx=0x7f268001c440 comp rx=0 tx=0).stop 2023-06-10T19:02:22.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.194+0000 7f268b68c640 1 -- 172.21.15.53:0/4140311989 shutdown_connections 2023-06-10T19:02:22.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.194+0000 7f268b68c640 1 --2- 172.21.15.53:0/4140311989 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26840b0b90 0x7f26840b7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:22.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.194+0000 7f268b68c640 1 --2- 172.21.15.53:0/4140311989 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f268415c090 0x7f26840b10c0 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:22.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.194+0000 7f268b68c640 1 -- 172.21.15.53:0/4140311989 >> 172.21.15.53:0/4140311989 conn(0x7f2684069e20 msgr2=0x7f268406a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:22.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.194+0000 7f268b68c640 1 -- 172.21.15.53:0/4140311989 shutdown_connections 2023-06-10T19:02:22.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.194+0000 7f268b68c640 1 -- 172.21.15.53:0/4140311989 wait complete. 2023-06-10T19:02:22.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.194+0000 7f268b68c640 1 Processor -- start 2023-06-10T19:02:22.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.194+0000 7f268b68c640 1 -- start start 2023-06-10T19:02:22.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.194+0000 7f268b68c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26840b0b90 0x7f268414f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:22.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.194+0000 7f268b68c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26840b7c60 0x7f2684154930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:22.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.194+0000 7f268b68c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f268415c090 0x7f26840c91a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:22.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.194+0000 7f268b68c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2684158000 con 0x7f268415c090 2023-06-10T19:02:22.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.194+0000 7f268b68c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2684154e70 con 0x7f26840b7c60 2023-06-10T19:02:22.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.194+0000 7f268b68c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26840cbdd0 con 0x7f26840b0b90 2023-06-10T19:02:22.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.198+0000 7f2689c29640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f268415c090 0x7f26840c91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:22.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.198+0000 7f2689c29640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f268415c090 0x7f26840c91a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36908/0 (socket says 172.21.15.53:36908) 2023-06-10T19:02:22.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.198+0000 7f2689c29640 1 -- 172.21.15.53:0/2367008098 learned_addr learned my addr 172.21.15.53:0/2367008098 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:22.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.198+0000 7f2689428640 1 --2- 172.21.15.53:0/2367008098 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26840b0b90 0x7f268414f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:22.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.198+0000 7f2688c27640 1 --2- 172.21.15.53:0/2367008098 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26840b7c60 0x7f2684154930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:22.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.198+0000 7f2689c29640 1 -- 172.21.15.53:0/2367008098 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26840b0b90 msgr2=0x7f268414f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:22.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.198+0000 7f2689c29640 1 --2- 172.21.15.53:0/2367008098 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26840b0b90 0x7f268414f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:22.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.198+0000 7f2689c29640 1 -- 172.21.15.53:0/2367008098 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26840b7c60 msgr2=0x7f2684154930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:22.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.198+0000 7f2689c29640 1 --2- 172.21.15.53:0/2367008098 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26840b7c60 0x7f2684154930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:22.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.198+0000 7f2689c29640 1 -- 172.21.15.53:0/2367008098 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26800094d0 con 0x7f268415c090 2023-06-10T19:02:22.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.198+0000 7f2689428640 1 --2- 172.21.15.53:0/2367008098 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26840b0b90 0x7f268414f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:02:22.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.198+0000 7f2689c29640 1 --2- 172.21.15.53:0/2367008098 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f268415c090 0x7f26840c91a0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f267c00c780 tx=0x7f267c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:22.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.198+0000 7f2675ffb640 1 -- 172.21.15.53:0/2367008098 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f267c004b70 con 0x7f268415c090 2023-06-10T19:02:22.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.198+0000 7f2675ffb640 1 -- 172.21.15.53:0/2367008098 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f267c00ce90 con 0x7f268415c090 2023-06-10T19:02:22.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.198+0000 7f268b68c640 1 -- 172.21.15.53:0/2367008098 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26841574e0 con 0x7f268415c090 2023-06-10T19:02:22.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.198+0000 7f2675ffb640 1 -- 172.21.15.53:0/2367008098 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f267c00a850 con 0x7f268415c090 2023-06-10T19:02:22.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.198+0000 7f268b68c640 1 -- 172.21.15.53:0/2367008098 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26840cbaa0 con 0x7f268415c090 2023-06-10T19:02:22.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.198+0000 7f268b68c640 1 -- 172.21.15.53:0/2367008098 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2684157320 con 0x7f268415c090 2023-06-10T19:02:22.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.198+0000 7f2675ffb640 1 -- 172.21.15.53:0/2367008098 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f267c00a9b0 con 0x7f268415c090 2023-06-10T19:02:22.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.198+0000 7f2675ffb640 1 --2- 172.21.15.53:0/2367008098 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2668066280 0x7f2668068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:22.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.198+0000 7f2675ffb640 1 -- 172.21.15.53:0/2367008098 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f267c083f20 con 0x7f268415c090 2023-06-10T19:02:22.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.198+0000 7f2689428640 1 --2- 172.21.15.53:0/2367008098 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2668066280 0x7f2668068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:22.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.198+0000 7f2689428640 1 --2- 172.21.15.53:0/2367008098 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2668066280 0x7f2668068730 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f26800ad000 tx=0x7f2680008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:22.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.202+0000 7f2675ffb640 1 -- 172.21.15.53:0/2367008098 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f267c054e30 con 0x7f268415c090 2023-06-10T19:02:22.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.358+0000 7f268b68c640 1 -- 172.21.15.53:0/2367008098 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f268404d790 con 0x7f268415c090 2023-06-10T19:02:22.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.358+0000 7f2675ffb640 1 -- 172.21.15.53:0/2367008098 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v94) v1 ==== 100+0+11 (secure 0 0 0) 0x7f267c0549c0 con 0x7f268415c090 2023-06-10T19:02:22.361 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-06-10T19:02:22.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.358+0000 7f268b68c640 1 -- 172.21.15.53:0/2367008098 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2668066280 msgr2=0x7f2668068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:22.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.358+0000 7f268b68c640 1 --2- 172.21.15.53:0/2367008098 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2668066280 0x7f2668068730 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f26800ad000 tx=0x7f2680008040 comp rx=0 tx=0).stop 2023-06-10T19:02:22.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.358+0000 7f268b68c640 1 -- 172.21.15.53:0/2367008098 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f268415c090 msgr2=0x7f26840c91a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:22.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.358+0000 7f268b68c640 1 --2- 172.21.15.53:0/2367008098 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f268415c090 0x7f26840c91a0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f267c00c780 tx=0x7f267c00cc40 comp rx=0 tx=0).stop 2023-06-10T19:02:22.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.358+0000 7f268b68c640 1 -- 172.21.15.53:0/2367008098 shutdown_connections 2023-06-10T19:02:22.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.358+0000 7f268b68c640 1 --2- 172.21.15.53:0/2367008098 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2668066280 0x7f2668068730 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:22.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.358+0000 7f268b68c640 1 --2- 172.21.15.53:0/2367008098 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f268415c090 0x7f26840c91a0 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:22.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.358+0000 7f268b68c640 1 --2- 172.21.15.53:0/2367008098 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26840b7c60 0x7f2684154930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:22.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.358+0000 7f268b68c640 1 --2- 172.21.15.53:0/2367008098 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26840b0b90 0x7f268414f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:22.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.358+0000 7f268b68c640 1 -- 172.21.15.53:0/2367008098 >> 172.21.15.53:0/2367008098 conn(0x7f2684069e20 msgr2=0x7f2684159210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:22.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.358+0000 7f268b68c640 1 -- 172.21.15.53:0/2367008098 shutdown_connections 2023-06-10T19:02:22.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.358+0000 7f268b68c640 1 -- 172.21.15.53:0/2367008098 wait complete. 2023-06-10T19:02:22.380 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-10T19:02:22.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.502+0000 7fde3f1d2640 1 Processor -- start 2023-06-10T19:02:22.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.502+0000 7fde3f1d2640 1 -- start start 2023-06-10T19:02:22.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.502+0000 7fde3f1d2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde38159450 0x7fde3815d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:22.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.502+0000 7fde3f1d2640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde380cbac0 con 0x7fde3815d680 2023-06-10T19:02:22.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.502+0000 7fde3f1d2640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde3815dc00 con 0x7fde380cf350 2023-06-10T19:02:22.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.502+0000 7fde3f1d2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde3815dee0 con 0x7fde38159450 2023-06-10T19:02:22.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.502+0000 7fde37fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fde3815d680 0x7fde380cec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60964/0 (socket says 172.21.15.53:60964) 2023-06-10T19:02:22.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.502+0000 7fde37fff640 1 -- 172.21.15.53:0/2932289118 learned_addr learned my addr 172.21.15.53:0/2932289118 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:02:22.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.502+0000 7fde3cf6e640 1 --2- 172.21.15.53:0/2932289118 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde38159450 0x7fde3815d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:22.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.502+0000 7fde377fe640 1 -- 172.21.15.53:0/2932289118 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2087494071 0 0) 0x7fde380cbac0 con 0x7fde3815d680 2023-06-10T19:02:22.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.502+0000 7fde377fe640 1 -- 172.21.15.53:0/2932289118 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde20003530 con 0x7fde3815d680 2023-06-10T19:02:22.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.506+0000 7fde377fe640 1 -- 172.21.15.53:0/2932289118 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2933397592 0 0) 0x7fde20003530 con 0x7fde3815d680 2023-06-10T19:02:22.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.506+0000 7fde377fe640 1 -- 172.21.15.53:0/2932289118 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde38159450 msgr2=0x7fde3815d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:22.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.506+0000 7fde377fe640 1 --2- 172.21.15.53:0/2932289118 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde38159450 0x7fde3815d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:22.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.506+0000 7fde377fe640 1 -- 172.21.15.53:0/2932289118 >> v1:172.21.15.117:6789/0 conn(0x7fde380cf350 legacy=0x7fde380cbf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:22.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.506+0000 7fde377fe640 1 -- 172.21.15.53:0/2932289118 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde380cb750 con 0x7fde3815d680 2023-06-10T19:02:22.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.506+0000 7fde377fe640 1 -- 172.21.15.53:0/2932289118 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fde2c001680 con 0x7fde3815d680 2023-06-10T19:02:22.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.506+0000 7fde377fe640 1 -- 172.21.15.53:0/2932289118 >> v1:172.21.15.53:6789/0 conn(0x7fde3815d680 legacy=0x7fde380cec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:22.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.506+0000 7fde377fe640 1 --2- 172.21.15.53:0/2932289118 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde200039b0 0x7fde20003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:22.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.506+0000 7fde377fe640 1 --2- 172.21.15.53:0/2932289118 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde38159450 0x7fde200047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:22.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.506+0000 7fde377fe640 1 --2- 172.21.15.53:0/2932289118 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde20004d10 0x7fde20005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:22.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.506+0000 7fde377fe640 1 -- 172.21.15.53:0/2932289118 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde3815dee0 con 0x7fde200039b0 2023-06-10T19:02:22.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.506+0000 7fde377fe640 1 -- 172.21.15.53:0/2932289118 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde2000baa0 con 0x7fde20004d10 2023-06-10T19:02:22.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.506+0000 7fde377fe640 1 -- 172.21.15.53:0/2932289118 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde2000bc60 con 0x7fde38159450 2023-06-10T19:02:22.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.506+0000 7fde3cf6e640 1 --2- 172.21.15.53:0/2932289118 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde200039b0 0x7fde20003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:22.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.506+0000 7fde37fff640 1 --2- 172.21.15.53:0/2932289118 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde38159450 0x7fde200047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:22.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.506+0000 7fde3cf6e640 1 -- 172.21.15.53:0/2932289118 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde38159450 msgr2=0x7fde200047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:22.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.506+0000 7fde3cf6e640 1 --2- 172.21.15.53:0/2932289118 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde38159450 0x7fde200047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:22.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.506+0000 7fde3cf6e640 1 -- 172.21.15.53:0/2932289118 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde20004d10 msgr2=0x7fde20005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:22.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.506+0000 7fde3cf6e640 1 --2- 172.21.15.53:0/2932289118 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde20004d10 0x7fde20005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:22.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.506+0000 7fde3cf6e640 1 -- 172.21.15.53:0/2932289118 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde20003530 con 0x7fde200039b0 2023-06-10T19:02:22.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.506+0000 7fde3cf6e640 1 --2- 172.21.15.53:0/2932289118 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde200039b0 0x7fde20003dc0 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7fde30009fc0 tx=0x7fde3001cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f5ed9021a786aa6 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:22.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.506+0000 7fde377fe640 1 -- 172.21.15.53:0/2932289118 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde300a5b00 con 0x7fde200039b0 2023-06-10T19:02:22.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.506+0000 7fde377fe640 1 -- 172.21.15.53:0/2932289118 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde3000f040 con 0x7fde200039b0 2023-06-10T19:02:22.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.506+0000 7fde377fe640 1 -- 172.21.15.53:0/2932289118 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde300a5ea0 con 0x7fde200039b0 2023-06-10T19:02:22.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.506+0000 7fde3f1d2640 1 -- 172.21.15.53:0/2932289118 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde200039b0 msgr2=0x7fde20003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:22.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.506+0000 7fde3f1d2640 1 --2- 172.21.15.53:0/2932289118 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde200039b0 0x7fde20003dc0 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7fde30009fc0 tx=0x7fde3001cc00 comp rx=0 tx=0).stop 2023-06-10T19:02:22.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.506+0000 7fde3d76f640 1 -- 172.21.15.53:0/2932289118 reap_dead start 2023-06-10T19:02:22.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.506+0000 7fde3f1d2640 1 -- 172.21.15.53:0/2932289118 shutdown_connections 2023-06-10T19:02:22.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.506+0000 7fde3f1d2640 1 -- 172.21.15.53:0/2932289118 >> 172.21.15.53:0/2932289118 conn(0x7fde3806a0b0 msgr2=0x7fde3806d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:22.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.506+0000 7fde3f1d2640 1 -- 172.21.15.53:0/2932289118 shutdown_connections 2023-06-10T19:02:22.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.506+0000 7fde3f1d2640 1 -- 172.21.15.53:0/2932289118 wait complete. 2023-06-10T19:02:22.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.510+0000 7fde3f1d2640 1 Processor -- start 2023-06-10T19:02:22.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.510+0000 7fde3f1d2640 1 -- start start 2023-06-10T19:02:22.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.510+0000 7fde3f1d2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde200039b0 0x7fde3815bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:22.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.510+0000 7fde3f1d2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde380a7880 0x7fde380a7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:22.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.510+0000 7fde3f1d2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde38156500 0x7fde38156970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:22.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.510+0000 7fde3f1d2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde38156eb0 con 0x7fde200039b0 2023-06-10T19:02:22.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.510+0000 7fde3f1d2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde380a8340 con 0x7fde38156500 2023-06-10T19:02:22.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.510+0000 7fde3f1d2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde380a8620 con 0x7fde380a7880 2023-06-10T19:02:22.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.510+0000 7fde3cf6e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde200039b0 0x7fde3815bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:22.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.510+0000 7fde3cf6e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde200039b0 0x7fde3815bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36928/0 (socket says 172.21.15.53:36928) 2023-06-10T19:02:22.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.510+0000 7fde3cf6e640 1 -- 172.21.15.53:0/3239616181 learned_addr learned my addr 172.21.15.53:0/3239616181 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:22.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.510+0000 7fde37fff640 1 --2- 172.21.15.53:0/3239616181 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde380a7880 0x7fde380a7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:22.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.510+0000 7fde3d76f640 1 --2- 172.21.15.53:0/3239616181 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde38156500 0x7fde38156970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:22.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.510+0000 7fde3cf6e640 1 -- 172.21.15.53:0/3239616181 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde380a7880 msgr2=0x7fde380a7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:22.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.510+0000 7fde3cf6e640 1 --2- 172.21.15.53:0/3239616181 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde380a7880 0x7fde380a7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:22.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.510+0000 7fde3cf6e640 1 -- 172.21.15.53:0/3239616181 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde38156500 msgr2=0x7fde38156970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:22.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.510+0000 7fde3cf6e640 1 --2- 172.21.15.53:0/3239616181 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde38156500 0x7fde38156970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:22.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.510+0000 7fde3cf6e640 1 -- 172.21.15.53:0/3239616181 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde380a8900 con 0x7fde200039b0 2023-06-10T19:02:22.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.510+0000 7fde3cf6e640 1 --2- 172.21.15.53:0/3239616181 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde200039b0 0x7fde3815bf50 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7fde300b0040 tx=0x7fde30009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:22.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.510+0000 7fde357fa640 1 -- 172.21.15.53:0/3239616181 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde300bd070 con 0x7fde200039b0 2023-06-10T19:02:22.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.510+0000 7fde357fa640 1 -- 172.21.15.53:0/3239616181 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde300039a0 con 0x7fde200039b0 2023-06-10T19:02:22.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.510+0000 7fde3f1d2640 1 -- 172.21.15.53:0/3239616181 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde380a8be0 con 0x7fde200039b0 2023-06-10T19:02:22.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.510+0000 7fde357fa640 1 -- 172.21.15.53:0/3239616181 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde30003d50 con 0x7fde200039b0 2023-06-10T19:02:22.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.510+0000 7fde3f1d2640 1 -- 172.21.15.53:0/3239616181 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde38157290 con 0x7fde200039b0 2023-06-10T19:02:22.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.510+0000 7fde3f1d2640 1 -- 172.21.15.53:0/3239616181 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde3804d790 con 0x7fde200039b0 2023-06-10T19:02:22.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.514+0000 7fde357fa640 1 -- 172.21.15.53:0/3239616181 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fde300b4040 con 0x7fde200039b0 2023-06-10T19:02:22.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.514+0000 7fde357fa640 1 --2- 172.21.15.53:0/3239616181 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fde24066280 0x7fde24068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:22.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.514+0000 7fde357fa640 1 -- 172.21.15.53:0/3239616181 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fde3011d880 con 0x7fde200039b0 2023-06-10T19:02:22.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.514+0000 7fde37fff640 1 --2- 172.21.15.53:0/3239616181 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fde24066280 0x7fde24068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:22.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.514+0000 7fde37fff640 1 --2- 172.21.15.53:0/3239616181 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fde24066280 0x7fde24068730 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fde2c000f70 tx=0x7fde2c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:22.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.518+0000 7fde357fa640 1 -- 172.21.15.53:0/3239616181 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fde300eae40 con 0x7fde200039b0 2023-06-10T19:02:22.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.686+0000 7fde3f1d2640 1 -- 172.21.15.53:0/3239616181 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fde3806df70 con 0x7fde200039b0 2023-06-10T19:02:22.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.686+0000 7fde357fa640 1 -- 172.21.15.53:0/3239616181 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v94) v1 ==== 80+0+0 (secure 0 0 0) 0x7fde300b2070 con 0x7fde200039b0 2023-06-10T19:02:22.691 INFO:teuthology.orchestra.run.smithi053.stderr:listed 0 entries 2023-06-10T19:02:22.693 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.690+0000 7fde3f1d2640 1 -- 172.21.15.53:0/3239616181 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fde24066280 msgr2=0x7fde24068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:22.693 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.690+0000 7fde3f1d2640 1 --2- 172.21.15.53:0/3239616181 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fde24066280 0x7fde24068730 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fde2c000f70 tx=0x7fde2c009040 comp rx=0 tx=0).stop 2023-06-10T19:02:22.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.690+0000 7fde3f1d2640 1 -- 172.21.15.53:0/3239616181 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde200039b0 msgr2=0x7fde3815bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:22.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.690+0000 7fde3f1d2640 1 --2- 172.21.15.53:0/3239616181 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde200039b0 0x7fde3815bf50 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7fde300b0040 tx=0x7fde30009750 comp rx=0 tx=0).stop 2023-06-10T19:02:22.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.690+0000 7fde3f1d2640 1 -- 172.21.15.53:0/3239616181 shutdown_connections 2023-06-10T19:02:22.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.690+0000 7fde3f1d2640 1 --2- 172.21.15.53:0/3239616181 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fde24066280 0x7fde24068730 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:22.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.690+0000 7fde3f1d2640 1 --2- 172.21.15.53:0/3239616181 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde38156500 0x7fde38156970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:22.695 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.690+0000 7fde3f1d2640 1 --2- 172.21.15.53:0/3239616181 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde380a7880 0x7fde380a7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:22.695 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.690+0000 7fde3f1d2640 1 --2- 172.21.15.53:0/3239616181 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde200039b0 0x7fde3815bf50 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:22.695 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.690+0000 7fde3f1d2640 1 -- 172.21.15.53:0/3239616181 >> 172.21.15.53:0/3239616181 conn(0x7fde3806a0b0 msgr2=0x7fde380b55c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:22.695 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.690+0000 7fde3f1d2640 1 -- 172.21.15.53:0/3239616181 shutdown_connections 2023-06-10T19:02:22.695 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:22.690+0000 7fde3f1d2640 1 -- 172.21.15.53:0/3239616181 wait complete. 2023-06-10T19:02:22.709 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi117.front.sepia.ceph.com... 2023-06-10T19:02:22.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:02:22.710 DEBUG:teuthology.orchestra.run.smithi117:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-06-10T19:02:22.723 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi117.stderr:ceph-fuse[44872]: fuse finished with error 0 and tester_r 0 2023-06-10T19:02:22.724 INFO:teuthology.orchestra.run:waiting for 300 2023-06-10T19:02:28.826 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi117.front.sepia.ceph.com 2023-06-10T19:02:28.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:02:28.827 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-06-10T19:02:28.835 DEBUG:teuthology.orchestra.run.smithi053:> adjust-ulimits daemon-helper kill python3 -c ' 2023-06-10T19:02:28.835 DEBUG:teuthology.orchestra.run.smithi053:> import os 2023-06-10T19:02:28.836 DEBUG:teuthology.orchestra.run.smithi053:> import time 2023-06-10T19:02:28.836 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:02:28.836 DEBUG:teuthology.orchestra.run.smithi053:> path = "/home/ubuntu/cephtest/mnt.0/subdir" 2023-06-10T19:02:28.837 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:02:28.837 DEBUG:teuthology.orchestra.run.smithi053:> print("Starting creation...") 2023-06-10T19:02:28.837 DEBUG:teuthology.orchestra.run.smithi053:> start = time.time() 2023-06-10T19:02:28.837 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:02:28.838 DEBUG:teuthology.orchestra.run.smithi053:> os.mkdir(path) 2023-06-10T19:02:28.838 DEBUG:teuthology.orchestra.run.smithi053:> dfd = os.open(path, os.O_DIRECTORY) 2023-06-10T19:02:28.839 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:02:28.839 DEBUG:teuthology.orchestra.run.smithi053:> fd = open(os.path.join(path, "childfile"), "w") 2023-06-10T19:02:28.839 DEBUG:teuthology.orchestra.run.smithi053:> print("Finished creation in {0}s".format(time.time() - start)) 2023-06-10T19:02:28.840 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:02:28.840 DEBUG:teuthology.orchestra.run.smithi053:> print("Starting fsync...") 2023-06-10T19:02:28.840 DEBUG:teuthology.orchestra.run.smithi053:> start = time.time() 2023-06-10T19:02:28.841 DEBUG:teuthology.orchestra.run.smithi053:> if True: 2023-06-10T19:02:28.841 DEBUG:teuthology.orchestra.run.smithi053:> os.fsync(dfd) 2023-06-10T19:02:28.841 DEBUG:teuthology.orchestra.run.smithi053:> else: 2023-06-10T19:02:28.841 DEBUG:teuthology.orchestra.run.smithi053:> os.fsync(fd) 2023-06-10T19:02:28.842 DEBUG:teuthology.orchestra.run.smithi053:> print("Finished fsync in {0}s".format(time.time() - start)) 2023-06-10T19:02:28.842 DEBUG:teuthology.orchestra.run.smithi053:> ' 2023-06-10T19:02:28.926 INFO:teuthology.orchestra.run.smithi053.stdout:Starting creation... 2023-06-10T19:02:28.927 INFO:teuthology.orchestra.run.smithi053.stdout:Finished creation in 0.011416912078857422s 2023-06-10T19:02:28.927 INFO:teuthology.orchestra.run.smithi053.stdout:Starting fsync... 2023-06-10T19:02:28.927 INFO:teuthology.orchestra.run.smithi053.stdout:Finished fsync in 0.003947734832763672s 2023-06-10T19:02:29.100 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-06-10T19:02:29.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:29.270+0000 7f21972b0640 1 Processor -- start 2023-06-10T19:02:29.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:29.270+0000 7f21972b0640 1 -- start start 2023-06-10T19:02:29.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:29.274+0000 7f21972b0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21900cb160 0x7f21900c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:29.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:29.274+0000 7f21972b0640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f21900c90a0 0x7f21900cc400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:29.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:29.274+0000 7f21972b0640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21900cdde0 con 0x7f2190158600 2023-06-10T19:02:29.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:29.274+0000 7f21972b0640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21901589d0 con 0x7f21900c90a0 2023-06-10T19:02:29.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:29.274+0000 7f21972b0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21900c9610 con 0x7f21900cb160 2023-06-10T19:02:29.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:29.274+0000 7f219504c640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f2190158600 0x7f21900caa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.53:45032/0 (socket says 172.21.15.53:45032) 2023-06-10T19:02:29.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:29.274+0000 7f219504c640 1 -- 172.21.15.53:0/2179266716 learned_addr learned my addr 172.21.15.53:0/2179266716 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:02:29.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:29.274+0000 7f219584d640 1 --2- 172.21.15.53:0/2179266716 >> v2:172.21.15.117:3300/0 conn(0x7f21900c90a0 0x7f21900cc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:29.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:29.274+0000 7f219484b640 1 --2- 172.21.15.53:0/2179266716 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21900cb160 0x7f21900c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:29.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:29.274+0000 7f2187fff640 1 -- 172.21.15.53:0/2179266716 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1256067247 0 0) 0x7f21900cdde0 con 0x7f2190158600 2023-06-10T19:02:29.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:29.274+0000 7f2187fff640 1 -- 172.21.15.53:0/2179266716 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f217c005740 con 0x7f2190158600 2023-06-10T19:02:29.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:29.274+0000 7f219584d640 1 -- 172.21.15.53:0/2179266716 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21900cb160 msgr2=0x7f21900c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:29.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:29.274+0000 7f219584d640 1 --2- 172.21.15.53:0/2179266716 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21900cb160 0x7f21900c8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:29.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:29.274+0000 7f219584d640 1 -- 172.21.15.53:0/2179266716 >> v1:172.21.15.117:6789/0 conn(0x7f2190158600 legacy=0x7f21900caa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:29.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:29.274+0000 7f219584d640 1 -- 172.21.15.53:0/2179266716 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21900711e0 con 0x7f21900c90a0 2023-06-10T19:02:29.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:29.274+0000 7f219484b640 1 --2- 172.21.15.53:0/2179266716 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21900cb160 0x7f21900c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-10T19:02:29.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:29.278+0000 7f219584d640 1 --2- 172.21.15.53:0/2179266716 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21900c90a0 0x7f21900cc400 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f2188009d90 tx=0x7f218801c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b14044b11fbd312b server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:29.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:29.278+0000 7f2187fff640 1 -- 172.21.15.53:0/2179266716 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21880a57f0 con 0x7f21900c90a0 2023-06-10T19:02:29.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:29.278+0000 7f2187fff640 1 -- 172.21.15.53:0/2179266716 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21880a5950 con 0x7f21900c90a0 2023-06-10T19:02:29.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:29.278+0000 7f2187fff640 1 -- 172.21.15.53:0/2179266716 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21880a5cc0 con 0x7f21900c90a0 2023-06-10T19:02:29.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:29.278+0000 7f21972b0640 1 -- 172.21.15.53:0/2179266716 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21900c90a0 msgr2=0x7f21900cc400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:29.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:29.278+0000 7f21972b0640 1 --2- 172.21.15.53:0/2179266716 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21900c90a0 0x7f21900cc400 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f2188009d90 tx=0x7f218801c950 comp rx=0 tx=0).stop 2023-06-10T19:02:29.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:29.278+0000 7f21972b0640 1 -- 172.21.15.53:0/2179266716 shutdown_connections 2023-06-10T19:02:29.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:29.278+0000 7f21972b0640 1 --2- 172.21.15.53:0/2179266716 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21900c90a0 0x7f21900cc400 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:29.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:29.278+0000 7f21972b0640 1 --2- 172.21.15.53:0/2179266716 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21900cb160 0x7f21900c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:29.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:29.278+0000 7f21972b0640 1 -- 172.21.15.53:0/2179266716 >> 172.21.15.53:0/2179266716 conn(0x7f219006d470 msgr2=0x7f219006d870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:29.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:29.278+0000 7f21972b0640 1 -- 172.21.15.53:0/2179266716 shutdown_connections 2023-06-10T19:02:29.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:29.278+0000 7f21972b0640 1 -- 172.21.15.53:0/2179266716 wait complete. 2023-06-10T19:02:29.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:29.278+0000 7f21972b0640 1 Processor -- start 2023-06-10T19:02:29.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:29.278+0000 7f21972b0640 1 -- start start 2023-06-10T19:02:29.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:29.278+0000 7f21972b0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21900c90a0 0x7f2190147110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:29.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:29.278+0000 7f21972b0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21900cb160 0x7f21901478d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:29.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:29.278+0000 7f21972b0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2190158600 0x7f21901536e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:29.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:29.278+0000 7f21972b0640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2190153250 con 0x7f2190158600 2023-06-10T19:02:29.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:29.278+0000 7f21972b0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2190152640 con 0x7f21900cb160 2023-06-10T19:02:29.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:29.278+0000 7f21972b0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2190152920 con 0x7f21900c90a0 2023-06-10T19:02:29.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:29.278+0000 7f219584d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2190158600 0x7f21901536e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:29.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:29.278+0000 7f219584d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2190158600 0x7f21901536e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36938/0 (socket says 172.21.15.53:36938) 2023-06-10T19:02:29.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:29.278+0000 7f219584d640 1 -- 172.21.15.53:0/2725819558 learned_addr learned my addr 172.21.15.53:0/2725819558 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:29.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:29.282+0000 7f219484b640 1 --2- 172.21.15.53:0/2725819558 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21900cb160 0x7f21901478d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:29.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:29.282+0000 7f219504c640 1 --2- 172.21.15.53:0/2725819558 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21900c90a0 0x7f2190147110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:29.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:29.282+0000 7f219584d640 1 -- 172.21.15.53:0/2725819558 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21900c90a0 msgr2=0x7f2190147110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:29.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:29.282+0000 7f219584d640 1 --2- 172.21.15.53:0/2725819558 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21900c90a0 0x7f2190147110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:29.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:29.282+0000 7f219584d640 1 -- 172.21.15.53:0/2725819558 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21900cb160 msgr2=0x7f21901478d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:29.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:29.282+0000 7f219584d640 1 --2- 172.21.15.53:0/2725819558 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21900cb160 0x7f21901478d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:29.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:29.282+0000 7f219584d640 1 -- 172.21.15.53:0/2725819558 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2180009420 con 0x7f2190158600 2023-06-10T19:02:29.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:29.282+0000 7f219484b640 1 --2- 172.21.15.53:0/2725819558 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21900cb160 0x7f21901478d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:02:29.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:29.282+0000 7f219584d640 1 --2- 172.21.15.53:0/2725819558 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2190158600 0x7f21901536e0 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f218801a580 tx=0x7f21880196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:29.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:29.282+0000 7f2185ffb640 1 -- 172.21.15.53:0/2725819558 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2188003ba0 con 0x7f2190158600 2023-06-10T19:02:29.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:29.282+0000 7f2185ffb640 1 -- 172.21.15.53:0/2725819558 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2188003d00 con 0x7f2190158600 2023-06-10T19:02:29.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:29.282+0000 7f21972b0640 1 -- 172.21.15.53:0/2725819558 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2188009a70 con 0x7f2190158600 2023-06-10T19:02:29.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:29.282+0000 7f2185ffb640 1 -- 172.21.15.53:0/2725819558 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2188004240 con 0x7f2190158600 2023-06-10T19:02:29.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:29.282+0000 7f21972b0640 1 -- 172.21.15.53:0/2725819558 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2190152ee0 con 0x7f2190158600 2023-06-10T19:02:29.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:29.282+0000 7f21972b0640 1 -- 172.21.15.53:0/2725819558 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21901533c0 con 0x7f2190158600 2023-06-10T19:02:29.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:29.282+0000 7f2185ffb640 1 -- 172.21.15.53:0/2725819558 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f21880b4070 con 0x7f2190158600 2023-06-10T19:02:29.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:29.282+0000 7f2185ffb640 1 --2- 172.21.15.53:0/2725819558 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2174066280 0x7f2174068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:29.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:29.282+0000 7f2185ffb640 1 -- 172.21.15.53:0/2725819558 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6178+0+0 (secure 0 0 0) 0x7f218811ea30 con 0x7f2190158600 2023-06-10T19:02:29.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:29.282+0000 7f219504c640 1 --2- 172.21.15.53:0/2725819558 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2174066280 0x7f2174068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:29.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:29.282+0000 7f219504c640 1 --2- 172.21.15.53:0/2725819558 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2174066280 0x7f2174068730 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f218c005890 tx=0x7f218c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:29.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:29.286+0000 7f2185ffb640 1 -- 172.21.15.53:0/2725819558 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f21880ebec0 con 0x7f2190158600 2023-06-10T19:02:29.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:29.478+0000 7f21972b0640 1 -- 172.21.15.53:0/2725819558 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f219004d790 con 0x7f2190158600 2023-06-10T19:02:30.081 INFO:tasks.ceph.mon.a.smithi053.stderr:2023-06-10T19:02:30.078+0000 7f74752c1640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-06-10T19:02:30.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.086+0000 7f2185ffb640 1 -- 172.21.15.53:0/2725819558 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v49) v1 ==== 161+0+0 (secure 0 0 0) 0x7f21880ef4e0 con 0x7f2190158600 2023-06-10T19:02:30.090 INFO:teuthology.orchestra.run.smithi053.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-06-10T19:02:30.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.090+0000 7f21972b0640 1 -- 172.21.15.53:0/2725819558 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2174066280 msgr2=0x7f2174068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:30.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.090+0000 7f21972b0640 1 --2- 172.21.15.53:0/2725819558 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2174066280 0x7f2174068730 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f218c005890 tx=0x7f218c009040 comp rx=0 tx=0).stop 2023-06-10T19:02:30.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.090+0000 7f21972b0640 1 -- 172.21.15.53:0/2725819558 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2190158600 msgr2=0x7f21901536e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:30.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.090+0000 7f21972b0640 1 --2- 172.21.15.53:0/2725819558 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2190158600 0x7f21901536e0 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f218801a580 tx=0x7f21880196f0 comp rx=0 tx=0).stop 2023-06-10T19:02:30.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.090+0000 7f21972b0640 1 -- 172.21.15.53:0/2725819558 shutdown_connections 2023-06-10T19:02:30.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.090+0000 7f21972b0640 1 --2- 172.21.15.53:0/2725819558 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2174066280 0x7f2174068730 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:30.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.090+0000 7f21972b0640 1 --2- 172.21.15.53:0/2725819558 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2190158600 0x7f21901536e0 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:30.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.090+0000 7f21972b0640 1 --2- 172.21.15.53:0/2725819558 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21900cb160 0x7f21901478d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:30.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.090+0000 7f21972b0640 1 --2- 172.21.15.53:0/2725819558 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21900c90a0 0x7f2190147110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:30.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.090+0000 7f21972b0640 1 -- 172.21.15.53:0/2725819558 >> 172.21.15.53:0/2725819558 conn(0x7f219006d470 msgr2=0x7f219006b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:30.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.090+0000 7f21972b0640 1 -- 172.21.15.53:0/2725819558 shutdown_connections 2023-06-10T19:02:30.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.090+0000 7f21972b0640 1 -- 172.21.15.53:0/2725819558 wait complete. 2023-06-10T19:02:30.097 INFO:tasks.ceph.mds.a.smithi053.stderr: -1748> 2023-06-10T19:02:08.255+0000 7fc48803b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-06-10T19:02:30.117 INFO:tasks.cephfs.mount:Killing connection on ubuntu@smithi053.front.sepia.ceph.com... 2023-06-10T19:02:30.117 INFO:tasks.cephfs.mount:Suspending the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-06-10T19:02:30.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:02:30.118 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link set brx.0 down 2023-06-10T19:02:30.133 INFO:tasks.cephfs.mount:Cleaning up killed connection on ubuntu@smithi053.front.sepia.ceph.com 2023-06-10T19:02:30.134 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T19:02:30.134 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:02:30.141 INFO:tasks.ceph.mds.a.smithi053.stdout:starting mds.a at 2023-06-10T19:02:30.147 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:02:30.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.298+0000 7fe026c5f640 1 Processor -- start 2023-06-10T19:02:30.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.298+0000 7fe026c5f640 1 -- start start 2023-06-10T19:02:30.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.302+0000 7fe026c5f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe0200c9840 0x7fe0200c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:30.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.302+0000 7fe026c5f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe02006b090 0x7fe02006b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:30.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.302+0000 7fe026c5f640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe020159b50 con 0x7fe020071060 2023-06-10T19:02:30.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.302+0000 7fe026c5f640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0200ca150 con 0x7fe02006b090 2023-06-10T19:02:30.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.302+0000 7fe026c5f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0200702a0 con 0x7fe0200c9840 2023-06-10T19:02:30.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.302+0000 7fe0251fc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe02006b090 0x7fe02006b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:30.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.302+0000 7fe01ffff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fe020071060 0x7fe0200af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60972/0 (socket says 172.21.15.53:60972) 2023-06-10T19:02:30.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.302+0000 7fe01ffff640 1 -- 172.21.15.53:0/3581032276 learned_addr learned my addr 172.21.15.53:0/3581032276 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:02:30.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.302+0000 7fe0249fb640 1 --2- 172.21.15.53:0/3581032276 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe0200c9840 0x7fe0200c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:30.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.302+0000 7fe0251fc640 1 -- 172.21.15.53:0/3581032276 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe0200c9840 msgr2=0x7fe0200c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:30.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.302+0000 7fe0251fc640 1 --2- 172.21.15.53:0/3581032276 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe0200c9840 0x7fe0200c9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:30.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.302+0000 7fe0251fc640 1 -- 172.21.15.53:0/3581032276 >> v1:172.21.15.53:6789/0 conn(0x7fe020071060 legacy=0x7fe0200af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:30.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.302+0000 7fe0251fc640 1 -- 172.21.15.53:0/3581032276 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe020070580 con 0x7fe02006b090 2023-06-10T19:02:30.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.302+0000 7fe0251fc640 1 --2- 172.21.15.53:0/3581032276 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe02006b090 0x7fe02006b530 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7fe018009d90 tx=0x7fe01801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dbea1af65d84ddd server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:30.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.302+0000 7fe01f7fe640 1 -- 172.21.15.53:0/3581032276 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0180a59e0 con 0x7fe02006b090 2023-06-10T19:02:30.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.302+0000 7fe01f7fe640 1 -- 172.21.15.53:0/3581032276 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0180a5b40 con 0x7fe02006b090 2023-06-10T19:02:30.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.302+0000 7fe01f7fe640 1 -- 172.21.15.53:0/3581032276 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0180ad440 con 0x7fe02006b090 2023-06-10T19:02:30.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.306+0000 7fe026c5f640 1 -- 172.21.15.53:0/3581032276 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe02006b090 msgr2=0x7fe02006b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:30.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.306+0000 7fe026c5f640 1 --2- 172.21.15.53:0/3581032276 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe02006b090 0x7fe02006b530 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7fe018009d90 tx=0x7fe01801c920 comp rx=0 tx=0).stop 2023-06-10T19:02:30.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.306+0000 7fe026c5f640 1 -- 172.21.15.53:0/3581032276 shutdown_connections 2023-06-10T19:02:30.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.306+0000 7fe026c5f640 1 --2- 172.21.15.53:0/3581032276 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe02006b090 0x7fe02006b530 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:30.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.306+0000 7fe026c5f640 1 --2- 172.21.15.53:0/3581032276 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe0200c9840 0x7fe0200c9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:30.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.306+0000 7fe026c5f640 1 -- 172.21.15.53:0/3581032276 >> 172.21.15.53:0/3581032276 conn(0x7fe02006a0d0 msgr2=0x7fe0200ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:30.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.306+0000 7fe026c5f640 1 -- 172.21.15.53:0/3581032276 shutdown_connections 2023-06-10T19:02:30.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.306+0000 7fe026c5f640 1 -- 172.21.15.53:0/3581032276 wait complete. 2023-06-10T19:02:30.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.306+0000 7fe026c5f640 1 Processor -- start 2023-06-10T19:02:30.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.306+0000 7fe026c5f640 1 -- start start 2023-06-10T19:02:30.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.306+0000 7fe026c5f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe02006b090 0x7fe0201467e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:30.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.306+0000 7fe026c5f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe020071060 0x7fe0201532a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:30.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.306+0000 7fe026c5f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe0200c9840 0x7fe0200adaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:30.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.306+0000 7fe026c5f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe020146d20 con 0x7fe02006b090 2023-06-10T19:02:30.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.306+0000 7fe026c5f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0200b2d40 con 0x7fe0200c9840 2023-06-10T19:02:30.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.306+0000 7fe026c5f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0200b3020 con 0x7fe020071060 2023-06-10T19:02:30.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.306+0000 7fe0249fb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe02006b090 0x7fe0201467e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:30.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.306+0000 7fe0249fb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe02006b090 0x7fe0201467e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36970/0 (socket says 172.21.15.53:36970) 2023-06-10T19:02:30.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.306+0000 7fe0249fb640 1 -- 172.21.15.53:0/2500017185 learned_addr learned my addr 172.21.15.53:0/2500017185 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:30.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.306+0000 7fe0251fc640 1 --2- 172.21.15.53:0/2500017185 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe0200c9840 0x7fe0200adaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:30.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.306+0000 7fe01ffff640 1 --2- 172.21.15.53:0/2500017185 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe020071060 0x7fe0201532a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:30.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.306+0000 7fe0249fb640 1 -- 172.21.15.53:0/2500017185 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe020071060 msgr2=0x7fe0201532a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:30.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.306+0000 7fe0249fb640 1 --2- 172.21.15.53:0/2500017185 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe020071060 0x7fe0201532a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:30.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.306+0000 7fe0249fb640 1 -- 172.21.15.53:0/2500017185 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe0200c9840 msgr2=0x7fe0200adaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:30.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.306+0000 7fe0249fb640 1 --2- 172.21.15.53:0/2500017185 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe0200c9840 0x7fe0200adaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:30.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.306+0000 7fe0249fb640 1 -- 172.21.15.53:0/2500017185 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe018009a70 con 0x7fe02006b090 2023-06-10T19:02:30.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.306+0000 7fe0251fc640 1 --2- 172.21.15.53:0/2500017185 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe0200c9840 0x7fe0200adaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:02:30.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.306+0000 7fe0249fb640 1 --2- 172.21.15.53:0/2500017185 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe02006b090 0x7fe0201467e0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7fe00800d5f0 tx=0x7fe00800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:30.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.306+0000 7fe01d7fa640 1 -- 172.21.15.53:0/2500017185 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0080125f0 con 0x7fe02006b090 2023-06-10T19:02:30.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.306+0000 7fe01d7fa640 1 -- 172.21.15.53:0/2500017185 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe008012750 con 0x7fe02006b090 2023-06-10T19:02:30.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.306+0000 7fe026c5f640 1 -- 172.21.15.53:0/2500017185 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0200b3300 con 0x7fe02006b090 2023-06-10T19:02:30.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.306+0000 7fe01d7fa640 1 -- 172.21.15.53:0/2500017185 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe008012ae0 con 0x7fe02006b090 2023-06-10T19:02:30.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.306+0000 7fe026c5f640 1 -- 172.21.15.53:0/2500017185 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0200b38c0 con 0x7fe02006b090 2023-06-10T19:02:30.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.310+0000 7fe026c5f640 1 -- 172.21.15.53:0/2500017185 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe02004d790 con 0x7fe02006b090 2023-06-10T19:02:30.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.310+0000 7fe01d7fa640 1 -- 172.21.15.53:0/2500017185 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe008012c40 con 0x7fe02006b090 2023-06-10T19:02:30.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.310+0000 7fe01d7fa640 1 --2- 172.21.15.53:0/2500017185 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe000066280 0x7fe000068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:30.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.310+0000 7fe01d7fa640 1 -- 172.21.15.53:0/2500017185 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6264+0+0 (secure 0 0 0) 0x7fe008084230 con 0x7fe02006b090 2023-06-10T19:02:30.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.310+0000 7fe01ffff640 1 --2- 172.21.15.53:0/2500017185 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe000066280 0x7fe000068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:30.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.310+0000 7fe01ffff640 1 --2- 172.21.15.53:0/2500017185 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe000066280 0x7fe000068730 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fe0201f5a50 tx=0x7fe010009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:30.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.314+0000 7fe01d7fa640 1 -- 172.21.15.53:0/2500017185 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe008051670 con 0x7fe02006b090 2023-06-10T19:02:30.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.474+0000 7fe026c5f640 1 -- 172.21.15.53:0/2500017185 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe0200c9f30 con 0x7fe02006b090 2023-06-10T19:02:30.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.474+0000 7fe01d7fa640 1 -- 172.21.15.53:0/2500017185 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) v1 ==== 74+0+18604 (secure 0 0 0) 0x7fe008007380 con 0x7fe02006b090 2023-06-10T19:02:30.479 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:02:30.479 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":97,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:02:29.481025+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-06-10T19:02:00.325404+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-06-10T19:02:01.620938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.8","mappings":[{"from":1,"to":2}]},{"pgid":"14.17","mappings":[{"from":1,"to":7}]},{"pgid":"14.2d","mappings":[{"from":1,"to":7}]},{"pgid":"14.3a","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.53:6833/1894654263":"2023-06-11T19:02:29.480972+0000","172.21.15.53:6832/1894654263":"2023-06-11T19:02:29.480972+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:02:30.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.478+0000 7fe026c5f640 1 -- 172.21.15.53:0/2500017185 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe000066280 msgr2=0x7fe000068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:30.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.478+0000 7fe026c5f640 1 --2- 172.21.15.53:0/2500017185 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe000066280 0x7fe000068730 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fe0201f5a50 tx=0x7fe010009040 comp rx=0 tx=0).stop 2023-06-10T19:02:30.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.478+0000 7fe026c5f640 1 -- 172.21.15.53:0/2500017185 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe02006b090 msgr2=0x7fe0201467e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:30.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.478+0000 7fe026c5f640 1 --2- 172.21.15.53:0/2500017185 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe02006b090 0x7fe0201467e0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7fe00800d5f0 tx=0x7fe00800dab0 comp rx=0 tx=0).stop 2023-06-10T19:02:30.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.478+0000 7fe026c5f640 1 -- 172.21.15.53:0/2500017185 shutdown_connections 2023-06-10T19:02:30.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.478+0000 7fe026c5f640 1 --2- 172.21.15.53:0/2500017185 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe000066280 0x7fe000068730 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:30.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.478+0000 7fe026c5f640 1 --2- 172.21.15.53:0/2500017185 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe0200c9840 0x7fe0200adaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:30.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.478+0000 7fe026c5f640 1 --2- 172.21.15.53:0/2500017185 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe020071060 0x7fe0201532a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:30.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.478+0000 7fe026c5f640 1 --2- 172.21.15.53:0/2500017185 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe02006b090 0x7fe0201467e0 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:30.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.478+0000 7fe026c5f640 1 -- 172.21.15.53:0/2500017185 >> 172.21.15.53:0/2500017185 conn(0x7fe02006a0d0 msgr2=0x7fe02014cb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:30.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.478+0000 7fe026c5f640 1 -- 172.21.15.53:0/2500017185 shutdown_connections 2023-06-10T19:02:30.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.478+0000 7fe026c5f640 1 -- 172.21.15.53:0/2500017185 wait complete. 2023-06-10T19:02:30.498 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-10T18:52:33.633114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-10T18:52:39.171487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-10T19:02:00.325404+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '93', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2023-06-10T19:02:01.620938+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '94', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-10T19:02:30.500 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-10T19:02:30.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.622+0000 7fc9e9707640 1 Processor -- start 2023-06-10T19:02:30.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.622+0000 7fc9e9707640 1 -- start start 2023-06-10T19:02:30.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.626+0000 7fc9e9707640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9e415c090 0x7fc9e40b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:30.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.626+0000 7fc9e9707640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc9e40b0b90 0x7fc9e40b7720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:30.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.626+0000 7fc9e9707640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc9e40b7c60 0x7fc9e40b3b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:30.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.626+0000 7fc9e9707640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9e40b80e0 con 0x7fc9e40b7c60 2023-06-10T19:02:30.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.626+0000 7fc9e9707640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9e40cc7c0 con 0x7fc9e40b0b90 2023-06-10T19:02:30.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.626+0000 7fc9e9707640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e40ccaa0 con 0x7fc9e415c090 2023-06-10T19:02:30.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.626+0000 7fc9e37fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc9e40b7c60 0x7fc9e40b3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:30.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.626+0000 7fc9e37fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc9e40b7c60 0x7fc9e40b3b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36976/0 (socket says 172.21.15.53:36976) 2023-06-10T19:02:30.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.626+0000 7fc9e37fe640 1 -- 172.21.15.53:0/2710569774 learned_addr learned my addr 172.21.15.53:0/2710569774 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:30.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.626+0000 7fc9e27fc640 1 --2- 172.21.15.53:0/2710569774 >> v2:172.21.15.117:3300/0 conn(0x7fc9e40b0b90 0x7fc9e40b7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:30.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.626+0000 7fc9e2ffd640 1 --2- 172.21.15.53:0/2710569774 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9e415c090 0x7fc9e40b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:30.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.626+0000 7fc9e37fe640 1 -- 172.21.15.53:0/2710569774 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9e415c090 msgr2=0x7fc9e40b10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:30.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.626+0000 7fc9e37fe640 1 --2- 172.21.15.53:0/2710569774 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9e415c090 0x7fc9e40b10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:30.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.626+0000 7fc9e37fe640 1 -- 172.21.15.53:0/2710569774 >> v2:172.21.15.117:3300/0 conn(0x7fc9e40b0b90 msgr2=0x7fc9e40b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:30.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.626+0000 7fc9e37fe640 1 --2- 172.21.15.53:0/2710569774 >> v2:172.21.15.117:3300/0 conn(0x7fc9e40b0b90 0x7fc9e40b7720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:30.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.626+0000 7fc9e37fe640 1 -- 172.21.15.53:0/2710569774 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9e40ccd80 con 0x7fc9e40b7c60 2023-06-10T19:02:30.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.626+0000 7fc9e37fe640 1 --2- 172.21.15.53:0/2710569774 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9e40b7c60 0x7fc9e40b3b50 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7fc9e406b390 tx=0x7fc9dc01c180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5c1d59dda5ab35d server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:30.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.626+0000 7fc9e1ffb640 1 -- 172.21.15.53:0/2710569774 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9dc0ab600 con 0x7fc9e40b7c60 2023-06-10T19:02:30.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.626+0000 7fc9e1ffb640 1 -- 172.21.15.53:0/2710569774 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9dc0a7050 con 0x7fc9e40b7c60 2023-06-10T19:02:30.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.626+0000 7fc9e1ffb640 1 -- 172.21.15.53:0/2710569774 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9dc0ab980 con 0x7fc9e40b7c60 2023-06-10T19:02:30.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.630+0000 7fc9e9707640 1 -- 172.21.15.53:0/2710569774 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9e40b7c60 msgr2=0x7fc9e40b3b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:30.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.630+0000 7fc9e9707640 1 --2- 172.21.15.53:0/2710569774 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9e40b7c60 0x7fc9e40b3b50 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7fc9e406b390 tx=0x7fc9dc01c180 comp rx=0 tx=0).stop 2023-06-10T19:02:30.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.630+0000 7fc9e9707640 1 -- 172.21.15.53:0/2710569774 shutdown_connections 2023-06-10T19:02:30.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.630+0000 7fc9e9707640 1 --2- 172.21.15.53:0/2710569774 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9e40b7c60 0x7fc9e40b3b50 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:30.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.630+0000 7fc9e9707640 1 --2- 172.21.15.53:0/2710569774 >> v2:172.21.15.117:3300/0 conn(0x7fc9e40b0b90 0x7fc9e40b7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:30.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.630+0000 7fc9e9707640 1 --2- 172.21.15.53:0/2710569774 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9e415c090 0x7fc9e40b10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:30.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.630+0000 7fc9e9707640 1 -- 172.21.15.53:0/2710569774 >> 172.21.15.53:0/2710569774 conn(0x7fc9e4069e20 msgr2=0x7fc9e406a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:30.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.630+0000 7fc9e9707640 1 -- 172.21.15.53:0/2710569774 shutdown_connections 2023-06-10T19:02:30.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.630+0000 7fc9e9707640 1 -- 172.21.15.53:0/2710569774 wait complete. 2023-06-10T19:02:30.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.630+0000 7fc9e9707640 1 Processor -- start 2023-06-10T19:02:30.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.630+0000 7fc9e9707640 1 -- start start 2023-06-10T19:02:30.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.630+0000 7fc9e9707640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9e40b0b90 0x7fc9e40b3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:30.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.630+0000 7fc9e9707640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9e40b7c60 0x7fc9e41513e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:30.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.630+0000 7fc9e9707640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9e415c090 0x7fc9e414d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:30.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.630+0000 7fc9e9707640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e41568f0 con 0x7fc9e40b7c60 2023-06-10T19:02:30.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.630+0000 7fc9e9707640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e4156bd0 con 0x7fc9e40b0b90 2023-06-10T19:02:30.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.630+0000 7fc9e9707640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e4156eb0 con 0x7fc9e415c090 2023-06-10T19:02:30.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.630+0000 7fc9e27fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9e40b7c60 0x7fc9e41513e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:30.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.630+0000 7fc9e27fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9e40b7c60 0x7fc9e41513e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36982/0 (socket says 172.21.15.53:36982) 2023-06-10T19:02:30.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.630+0000 7fc9e27fc640 1 -- 172.21.15.53:0/795741097 learned_addr learned my addr 172.21.15.53:0/795741097 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:30.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.630+0000 7fc9e37fe640 1 --2- 172.21.15.53:0/795741097 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9e415c090 0x7fc9e414d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:30.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.630+0000 7fc9e2ffd640 1 --2- 172.21.15.53:0/795741097 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9e40b0b90 0x7fc9e40b3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:30.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.630+0000 7fc9e27fc640 1 -- 172.21.15.53:0/795741097 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9e415c090 msgr2=0x7fc9e414d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:30.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.630+0000 7fc9e27fc640 1 --2- 172.21.15.53:0/795741097 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9e415c090 0x7fc9e414d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:30.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.630+0000 7fc9e27fc640 1 -- 172.21.15.53:0/795741097 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9e40b0b90 msgr2=0x7fc9e40b3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:30.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.630+0000 7fc9e27fc640 1 --2- 172.21.15.53:0/795741097 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9e40b0b90 0x7fc9e40b3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:30.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.630+0000 7fc9e27fc640 1 -- 172.21.15.53:0/795741097 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9dc0094d0 con 0x7fc9e40b7c60 2023-06-10T19:02:30.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.630+0000 7fc9e27fc640 1 --2- 172.21.15.53:0/795741097 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9e40b7c60 0x7fc9e41513e0 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7fc9d800d800 tx=0x7fc9d800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:30.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.630+0000 7fc9cb7fe640 1 -- 172.21.15.53:0/795741097 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d80096a0 con 0x7fc9e40b7c60 2023-06-10T19:02:30.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.630+0000 7fc9cb7fe640 1 -- 172.21.15.53:0/795741097 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9d8009800 con 0x7fc9e40b7c60 2023-06-10T19:02:30.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.630+0000 7fc9cb7fe640 1 -- 172.21.15.53:0/795741097 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d8009b70 con 0x7fc9e40b7c60 2023-06-10T19:02:30.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.630+0000 7fc9e9707640 1 -- 172.21.15.53:0/795741097 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9e4157190 con 0x7fc9e40b7c60 2023-06-10T19:02:30.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.630+0000 7fc9e9707640 1 -- 172.21.15.53:0/795741097 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9e4157750 con 0x7fc9e40b7c60 2023-06-10T19:02:30.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.634+0000 7fc9e9707640 1 -- 172.21.15.53:0/795741097 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9e404d790 con 0x7fc9e40b7c60 2023-06-10T19:02:30.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.634+0000 7fc9cb7fe640 1 -- 172.21.15.53:0/795741097 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc9d8009cd0 con 0x7fc9e40b7c60 2023-06-10T19:02:30.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.634+0000 7fc9cb7fe640 1 --2- 172.21.15.53:0/795741097 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc9d0066280 0x7fc9d0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:30.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.634+0000 7fc9cb7fe640 1 -- 172.21.15.53:0/795741097 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6264+0+0 (secure 0 0 0) 0x7fc9d8084580 con 0x7fc9e40b7c60 2023-06-10T19:02:30.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.634+0000 7fc9e2ffd640 1 --2- 172.21.15.53:0/795741097 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc9d0066280 0x7fc9d0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:30.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.634+0000 7fc9e2ffd640 1 --2- 172.21.15.53:0/795741097 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc9d0066280 0x7fc9d0068730 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fc9d4003fd0 tx=0x7fc9d40039a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:30.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.638+0000 7fc9cb7fe640 1 -- 172.21.15.53:0/795741097 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc9d8051930 con 0x7fc9e40b7c60 2023-06-10T19:02:30.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.790+0000 7fc9e9707640 1 -- 172.21.15.53:0/795741097 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc9e40b72f0 con 0x7fc9e40b7c60 2023-06-10T19:02:30.793 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.790+0000 7fc9cb7fe640 1 -- 172.21.15.53:0/795741097 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v97) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc9d8054f50 con 0x7fc9e40b7c60 2023-06-10T19:02:30.793 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-06-10T19:02:30.795 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.790+0000 7fc9e9707640 1 -- 172.21.15.53:0/795741097 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc9d0066280 msgr2=0x7fc9d0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:30.795 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.790+0000 7fc9e9707640 1 --2- 172.21.15.53:0/795741097 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc9d0066280 0x7fc9d0068730 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fc9d4003fd0 tx=0x7fc9d40039a0 comp rx=0 tx=0).stop 2023-06-10T19:02:30.795 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.790+0000 7fc9e9707640 1 -- 172.21.15.53:0/795741097 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9e40b7c60 msgr2=0x7fc9e41513e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:30.795 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.790+0000 7fc9e9707640 1 --2- 172.21.15.53:0/795741097 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9e40b7c60 0x7fc9e41513e0 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7fc9d800d800 tx=0x7fc9d800dcc0 comp rx=0 tx=0).stop 2023-06-10T19:02:30.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.790+0000 7fc9e9707640 1 -- 172.21.15.53:0/795741097 shutdown_connections 2023-06-10T19:02:30.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.790+0000 7fc9e9707640 1 --2- 172.21.15.53:0/795741097 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc9d0066280 0x7fc9d0068730 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:30.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.790+0000 7fc9e9707640 1 --2- 172.21.15.53:0/795741097 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9e415c090 0x7fc9e414d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:30.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.790+0000 7fc9e9707640 1 --2- 172.21.15.53:0/795741097 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9e40b7c60 0x7fc9e41513e0 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:30.797 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.790+0000 7fc9e9707640 1 --2- 172.21.15.53:0/795741097 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9e40b0b90 0x7fc9e40b3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:30.797 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.790+0000 7fc9e9707640 1 -- 172.21.15.53:0/795741097 >> 172.21.15.53:0/795741097 conn(0x7fc9e4069e20 msgr2=0x7fc9e40b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:30.798 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.790+0000 7fc9e9707640 1 -- 172.21.15.53:0/795741097 shutdown_connections 2023-06-10T19:02:30.798 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.790+0000 7fc9e9707640 1 -- 172.21.15.53:0/795741097 wait complete. 2023-06-10T19:02:30.812 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-10T19:02:30.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.938+0000 7f288df61640 1 Processor -- start 2023-06-10T19:02:30.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.938+0000 7f288df61640 1 -- start start 2023-06-10T19:02:30.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.938+0000 7f288df61640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f288815c090 0x7f28880b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:30.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.938+0000 7f288df61640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f28880b0b90 0x7f28880b7720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:30.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.938+0000 7f288df61640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28880cc7c0 con 0x7f28880b7c60 2023-06-10T19:02:30.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.938+0000 7f288df61640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28880b80e0 con 0x7f28880b0b90 2023-06-10T19:02:30.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.938+0000 7f288df61640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28880ccaa0 con 0x7f288815c090 2023-06-10T19:02:30.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.938+0000 7f2886ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f28880b0b90 0x7f28880b7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:30.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.938+0000 7f2886ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f28880b0b90 0x7f28880b7720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36996/0 (socket says 172.21.15.53:36996) 2023-06-10T19:02:30.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.938+0000 7f2886ffd640 1 -- 172.21.15.53:0/2167470598 learned_addr learned my addr 172.21.15.53:0/2167470598 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:30.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.938+0000 7f28877fe640 1 --2- 172.21.15.53:0/2167470598 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f288815c090 0x7f28880b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:30.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.938+0000 7f2886ffd640 1 -- 172.21.15.53:0/2167470598 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f288815c090 msgr2=0x7f28880b10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:30.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.938+0000 7f2886ffd640 1 --2- 172.21.15.53:0/2167470598 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f288815c090 0x7f28880b10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:30.944 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.938+0000 7f2886ffd640 1 -- 172.21.15.53:0/2167470598 >> v1:172.21.15.117:6789/0 conn(0x7f28880b7c60 legacy=0x7f28880b3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:30.944 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.938+0000 7f2886ffd640 1 -- 172.21.15.53:0/2167470598 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28880ccd80 con 0x7f28880b0b90 2023-06-10T19:02:30.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.942+0000 7f2886ffd640 1 --2- 172.21.15.53:0/2167470598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28880b0b90 0x7f28880b7720 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f287c009870 tx=0x7f287c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f2fc8b157842fa2 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:30.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.942+0000 7f28867fc640 1 -- 172.21.15.53:0/2167470598 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287c0ac600 con 0x7f28880b0b90 2023-06-10T19:02:30.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.942+0000 7f28867fc640 1 -- 172.21.15.53:0/2167470598 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f287c0a8050 con 0x7f28880b0b90 2023-06-10T19:02:30.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.942+0000 7f28867fc640 1 -- 172.21.15.53:0/2167470598 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287c0ac980 con 0x7f28880b0b90 2023-06-10T19:02:30.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.942+0000 7f288df61640 1 -- 172.21.15.53:0/2167470598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28880b0b90 msgr2=0x7f28880b7720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:30.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.942+0000 7f288df61640 1 --2- 172.21.15.53:0/2167470598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28880b0b90 0x7f28880b7720 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f287c009870 tx=0x7f287c01c480 comp rx=0 tx=0).stop 2023-06-10T19:02:30.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.942+0000 7f288df61640 1 -- 172.21.15.53:0/2167470598 shutdown_connections 2023-06-10T19:02:30.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.942+0000 7f288df61640 1 --2- 172.21.15.53:0/2167470598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28880b0b90 0x7f28880b7720 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:30.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.942+0000 7f288df61640 1 --2- 172.21.15.53:0/2167470598 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f288815c090 0x7f28880b10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:30.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.942+0000 7f288df61640 1 -- 172.21.15.53:0/2167470598 >> 172.21.15.53:0/2167470598 conn(0x7f2888069e20 msgr2=0x7f288806a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:30.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.942+0000 7f288df61640 1 -- 172.21.15.53:0/2167470598 shutdown_connections 2023-06-10T19:02:30.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.942+0000 7f288df61640 1 -- 172.21.15.53:0/2167470598 wait complete. 2023-06-10T19:02:30.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.942+0000 7f288df61640 1 Processor -- start 2023-06-10T19:02:30.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.942+0000 7f288df61640 1 -- start start 2023-06-10T19:02:30.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.942+0000 7f288df61640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28880b0b90 0x7f28880b24b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:30.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.942+0000 7f288df61640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28880b7c60 0x7f28880b29f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:30.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.942+0000 7f288df61640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f288815c090 0x7f2888158500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:30.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.942+0000 7f288df61640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2888157460 con 0x7f288815c090 2023-06-10T19:02:30.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.942+0000 7f288df61640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2888157740 con 0x7f28880b7c60 2023-06-10T19:02:30.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.942+0000 7f288df61640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2888157a20 con 0x7f28880b0b90 2023-06-10T19:02:30.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.942+0000 7f2887fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f288815c090 0x7f2888158500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:30.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.942+0000 7f2887fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f288815c090 0x7f2888158500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37000/0 (socket says 172.21.15.53:37000) 2023-06-10T19:02:30.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.942+0000 7f2887fff640 1 -- 172.21.15.53:0/463795297 learned_addr learned my addr 172.21.15.53:0/463795297 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:30.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.946+0000 7f28877fe640 1 --2- 172.21.15.53:0/463795297 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28880b0b90 0x7f28880b24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:30.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.946+0000 7f2886ffd640 1 --2- 172.21.15.53:0/463795297 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28880b7c60 0x7f28880b29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:30.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.946+0000 7f2887fff640 1 -- 172.21.15.53:0/463795297 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28880b0b90 msgr2=0x7f28880b24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:30.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.946+0000 7f2887fff640 1 --2- 172.21.15.53:0/463795297 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28880b0b90 0x7f28880b24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:30.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.946+0000 7f2887fff640 1 -- 172.21.15.53:0/463795297 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28880b7c60 msgr2=0x7f28880b29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:30.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.946+0000 7f2887fff640 1 --2- 172.21.15.53:0/463795297 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28880b7c60 0x7f28880b29f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:30.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.946+0000 7f2887fff640 1 -- 172.21.15.53:0/463795297 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f287c0094d0 con 0x7f288815c090 2023-06-10T19:02:30.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.946+0000 7f2887fff640 1 --2- 172.21.15.53:0/463795297 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f288815c090 0x7f2888158500 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f288000c770 tx=0x7f288000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:30.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.946+0000 7f286ffff640 1 -- 172.21.15.53:0/463795297 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2880003b80 con 0x7f288815c090 2023-06-10T19:02:30.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.946+0000 7f286ffff640 1 -- 172.21.15.53:0/463795297 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2880003ce0 con 0x7f288815c090 2023-06-10T19:02:30.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.946+0000 7f286ffff640 1 -- 172.21.15.53:0/463795297 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288000aa90 con 0x7f288815c090 2023-06-10T19:02:30.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.946+0000 7f288df61640 1 -- 172.21.15.53:0/463795297 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2888157d00 con 0x7f288815c090 2023-06-10T19:02:30.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.946+0000 7f288df61640 1 -- 172.21.15.53:0/463795297 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f288814b9d0 con 0x7f288815c090 2023-06-10T19:02:30.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.946+0000 7f288df61640 1 -- 172.21.15.53:0/463795297 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f288804d790 con 0x7f288815c090 2023-06-10T19:02:30.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.946+0000 7f286ffff640 1 -- 172.21.15.53:0/463795297 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f288000abf0 con 0x7f288815c090 2023-06-10T19:02:30.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.946+0000 7f286ffff640 1 --2- 172.21.15.53:0/463795297 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2874066280 0x7f2874068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:30.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.946+0000 7f286ffff640 1 -- 172.21.15.53:0/463795297 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6264+0+0 (secure 0 0 0) 0x7f2880083cb0 con 0x7f288815c090 2023-06-10T19:02:30.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.946+0000 7f28877fe640 1 --2- 172.21.15.53:0/463795297 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2874066280 0x7f2874068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:30.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.946+0000 7f28877fe640 1 --2- 172.21.15.53:0/463795297 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2874066280 0x7f2874068730 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f287800b930 tx=0x7f2878008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:30.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:30.950+0000 7f286ffff640 1 -- 172.21.15.53:0/463795297 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2880051060 con 0x7f288815c090 2023-06-10T19:02:31.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.106+0000 7f288df61640 1 -- 172.21.15.53:0/463795297 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f28881581b0 con 0x7f288815c090 2023-06-10T19:02:31.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.110+0000 7f286ffff640 1 -- 172.21.15.53:0/463795297 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v97) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2880054680 con 0x7f288815c090 2023-06-10T19:02:31.113 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-06-10T19:02:31.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.110+0000 7f288df61640 1 -- 172.21.15.53:0/463795297 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2874066280 msgr2=0x7f2874068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:31.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.110+0000 7f288df61640 1 --2- 172.21.15.53:0/463795297 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2874066280 0x7f2874068730 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f287800b930 tx=0x7f2878008040 comp rx=0 tx=0).stop 2023-06-10T19:02:31.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.110+0000 7f288df61640 1 -- 172.21.15.53:0/463795297 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f288815c090 msgr2=0x7f2888158500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:31.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.110+0000 7f288df61640 1 --2- 172.21.15.53:0/463795297 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f288815c090 0x7f2888158500 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f288000c770 tx=0x7f288000cc30 comp rx=0 tx=0).stop 2023-06-10T19:02:31.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.110+0000 7f288df61640 1 -- 172.21.15.53:0/463795297 shutdown_connections 2023-06-10T19:02:31.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.110+0000 7f288df61640 1 --2- 172.21.15.53:0/463795297 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2874066280 0x7f2874068730 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:31.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.110+0000 7f288df61640 1 --2- 172.21.15.53:0/463795297 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f288815c090 0x7f2888158500 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:31.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.110+0000 7f288df61640 1 --2- 172.21.15.53:0/463795297 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28880b7c60 0x7f28880b29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:31.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.110+0000 7f288df61640 1 --2- 172.21.15.53:0/463795297 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28880b0b90 0x7f28880b24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:31.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.110+0000 7f288df61640 1 -- 172.21.15.53:0/463795297 >> 172.21.15.53:0/463795297 conn(0x7f2888069e20 msgr2=0x7f288806a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:31.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.110+0000 7f288df61640 1 -- 172.21.15.53:0/463795297 shutdown_connections 2023-06-10T19:02:31.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.110+0000 7f288df61640 1 -- 172.21.15.53:0/463795297 wait complete. 2023-06-10T19:02:31.133 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-10T19:02:31.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.250+0000 7fb1287e0640 1 Processor -- start 2023-06-10T19:02:31.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.250+0000 7fb1287e0640 1 -- start start 2023-06-10T19:02:31.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.254+0000 7fb1287e0640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb1200c9fa0 0x7fb12006bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:31.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.254+0000 7fb1287e0640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb12006c020 0x7fb1200c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:31.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.254+0000 7fb1287e0640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb12006b090 con 0x7fb1200c87e0 2023-06-10T19:02:31.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.254+0000 7fb1287e0640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1200ca370 con 0x7fb12006c020 2023-06-10T19:02:31.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.254+0000 7fb1287e0640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb120070d50 con 0x7fb1200c9fa0 2023-06-10T19:02:31.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.254+0000 7fb125d7b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb12006c020 0x7fb1200c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:31.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.254+0000 7fb126d7d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fb1200c87e0 0x7fb1200af760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:36138/0 (socket says 172.21.15.53:36138) 2023-06-10T19:02:31.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.254+0000 7fb126d7d640 1 -- 172.21.15.53:0/1651620503 learned_addr learned my addr 172.21.15.53:0/1651620503 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:02:31.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.254+0000 7fb125d7b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb12006c020 0x7fb1200c82a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48312/0 (socket says 172.21.15.53:48312) 2023-06-10T19:02:31.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.254+0000 7fb125d7b640 1 -- 172.21.15.53:0/1651620503 >> v2:172.21.15.117:3300/0 conn(0x7fb1200c9fa0 msgr2=0x7fb12006bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:31.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.254+0000 7fb12657c640 1 --2- 172.21.15.53:0/1651620503 >> v2:172.21.15.117:3300/0 conn(0x7fb1200c9fa0 0x7fb12006bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:31.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.254+0000 7fb125d7b640 1 --2- 172.21.15.53:0/1651620503 >> v2:172.21.15.117:3300/0 conn(0x7fb1200c9fa0 0x7fb12006bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:31.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.254+0000 7fb12557a640 1 -- 172.21.15.53:0/1651620503 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3649944185 0 0) 0x7fb12006b090 con 0x7fb1200c87e0 2023-06-10T19:02:31.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.254+0000 7fb125d7b640 1 -- 172.21.15.53:0/1651620503 >> v1:172.21.15.53:6789/0 conn(0x7fb1200c87e0 legacy=0x7fb1200af760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:31.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.254+0000 7fb125d7b640 1 -- 172.21.15.53:0/1651620503 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb120071030 con 0x7fb12006c020 2023-06-10T19:02:31.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.254+0000 7fb12657c640 1 --2- 172.21.15.53:0/1651620503 >> v2:172.21.15.117:3300/0 conn(0x7fb1200c9fa0 0x7fb12006bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:02:31.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.254+0000 7fb125d7b640 1 --2- 172.21.15.53:0/1651620503 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb12006c020 0x7fb1200c82a0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7fb12006e9d0 tx=0x7fb11c01c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f55b52d8a7e6219 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:31.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.254+0000 7fb12557a640 1 -- 172.21.15.53:0/1651620503 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb11c0ab600 con 0x7fb12006c020 2023-06-10T19:02:31.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.254+0000 7fb12557a640 1 -- 172.21.15.53:0/1651620503 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb11c0a7050 con 0x7fb12006c020 2023-06-10T19:02:31.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.254+0000 7fb12557a640 1 -- 172.21.15.53:0/1651620503 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb11c0ab980 con 0x7fb12006c020 2023-06-10T19:02:31.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.254+0000 7fb1287e0640 1 -- 172.21.15.53:0/1651620503 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb12006c020 msgr2=0x7fb1200c82a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:31.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.254+0000 7fb1287e0640 1 --2- 172.21.15.53:0/1651620503 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb12006c020 0x7fb1200c82a0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7fb12006e9d0 tx=0x7fb11c01c3a0 comp rx=0 tx=0).stop 2023-06-10T19:02:31.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.254+0000 7fb1287e0640 1 -- 172.21.15.53:0/1651620503 shutdown_connections 2023-06-10T19:02:31.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.254+0000 7fb1287e0640 1 --2- 172.21.15.53:0/1651620503 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb12006c020 0x7fb1200c82a0 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:31.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.254+0000 7fb1287e0640 1 --2- 172.21.15.53:0/1651620503 >> v2:172.21.15.117:3300/0 conn(0x7fb1200c9fa0 0x7fb12006bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:31.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.254+0000 7fb1287e0640 1 -- 172.21.15.53:0/1651620503 >> 172.21.15.53:0/1651620503 conn(0x7fb12006a0e0 msgr2=0x7fb1200cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:31.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.258+0000 7fb1287e0640 1 -- 172.21.15.53:0/1651620503 shutdown_connections 2023-06-10T19:02:31.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.258+0000 7fb1287e0640 1 -- 172.21.15.53:0/1651620503 wait complete. 2023-06-10T19:02:31.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.258+0000 7fb1287e0640 1 Processor -- start 2023-06-10T19:02:31.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.258+0000 7fb1287e0640 1 -- start start 2023-06-10T19:02:31.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.258+0000 7fb1287e0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb12006c020 0x7fb120158650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:31.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.258+0000 7fb1287e0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1200c87e0 0x7fb120154740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:31.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.258+0000 7fb1287e0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb1200c9fa0 0x7fb120154c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:31.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.258+0000 7fb1287e0640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb120152ee0 con 0x7fb1200c9fa0 2023-06-10T19:02:31.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.258+0000 7fb1287e0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb120157e40 con 0x7fb1200c87e0 2023-06-10T19:02:31.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.258+0000 7fb1287e0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb12006c820 con 0x7fb12006c020 2023-06-10T19:02:31.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.258+0000 7fb126d7d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb1200c9fa0 0x7fb120154c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:31.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.258+0000 7fb126d7d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb1200c9fa0 0x7fb120154c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48324/0 (socket says 172.21.15.53:48324) 2023-06-10T19:02:31.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.258+0000 7fb126d7d640 1 -- 172.21.15.53:0/2199024527 learned_addr learned my addr 172.21.15.53:0/2199024527 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:31.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.258+0000 7fb12657c640 1 --2- 172.21.15.53:0/2199024527 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb12006c020 0x7fb120158650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:31.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.258+0000 7fb125d7b640 1 --2- 172.21.15.53:0/2199024527 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1200c87e0 0x7fb120154740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:31.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.258+0000 7fb126d7d640 1 -- 172.21.15.53:0/2199024527 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb12006c020 msgr2=0x7fb120158650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:31.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.258+0000 7fb126d7d640 1 --2- 172.21.15.53:0/2199024527 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb12006c020 0x7fb120158650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:31.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.258+0000 7fb126d7d640 1 -- 172.21.15.53:0/2199024527 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1200c87e0 msgr2=0x7fb120154740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:31.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.258+0000 7fb126d7d640 1 --2- 172.21.15.53:0/2199024527 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1200c87e0 0x7fb120154740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:31.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.258+0000 7fb126d7d640 1 -- 172.21.15.53:0/2199024527 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb11c009420 con 0x7fb1200c9fa0 2023-06-10T19:02:31.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.258+0000 7fb12657c640 1 --2- 172.21.15.53:0/2199024527 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb12006c020 0x7fb120158650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:02:31.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.258+0000 7fb125d7b640 1 --2- 172.21.15.53:0/2199024527 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1200c87e0 0x7fb120154740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:02:31.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.258+0000 7fb126d7d640 1 --2- 172.21.15.53:0/2199024527 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb1200c9fa0 0x7fb120154c80 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7fb11800c7a0 tx=0x7fb11800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:31.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.258+0000 7fb116ffd640 1 -- 172.21.15.53:0/2199024527 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb11800a640 con 0x7fb1200c9fa0 2023-06-10T19:02:31.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.258+0000 7fb116ffd640 1 -- 172.21.15.53:0/2199024527 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb11800a7a0 con 0x7fb1200c9fa0 2023-06-10T19:02:31.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.258+0000 7fb1287e0640 1 -- 172.21.15.53:0/2199024527 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1201429a0 con 0x7fb1200c9fa0 2023-06-10T19:02:31.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.258+0000 7fb116ffd640 1 -- 172.21.15.53:0/2199024527 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb11800abd0 con 0x7fb1200c9fa0 2023-06-10T19:02:31.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.258+0000 7fb1287e0640 1 -- 172.21.15.53:0/2199024527 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb12006c4d0 con 0x7fb1200c9fa0 2023-06-10T19:02:31.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.258+0000 7fb1287e0640 1 -- 172.21.15.53:0/2199024527 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb120142be0 con 0x7fb1200c9fa0 2023-06-10T19:02:31.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.262+0000 7fb116ffd640 1 -- 172.21.15.53:0/2199024527 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb11800ad30 con 0x7fb1200c9fa0 2023-06-10T19:02:31.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.262+0000 7fb116ffd640 1 --2- 172.21.15.53:0/2199024527 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb104066280 0x7fb104068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:31.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.262+0000 7fb116ffd640 1 -- 172.21.15.53:0/2199024527 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6264+0+0 (secure 0 0 0) 0x7fb118083570 con 0x7fb1200c9fa0 2023-06-10T19:02:31.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.262+0000 7fb12657c640 1 --2- 172.21.15.53:0/2199024527 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb104066280 0x7fb104068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:31.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.262+0000 7fb12657c640 1 --2- 172.21.15.53:0/2199024527 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb104066280 0x7fb104068730 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fb110008890 tx=0x7fb110008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:31.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.266+0000 7fb116ffd640 1 -- 172.21.15.53:0/2199024527 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb120142be0 con 0x7fb1200c9fa0 2023-06-10T19:02:31.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.418+0000 7fb1287e0640 1 -- 172.21.15.53:0/2199024527 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb1200b16e0 con 0x7fb1200c9fa0 2023-06-10T19:02:31.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.422+0000 7fb116ffd640 1 -- 172.21.15.53:0/2199024527 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v97) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb1200b16e0 con 0x7fb1200c9fa0 2023-06-10T19:02:31.425 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-06-10T19:02:31.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.422+0000 7fb1287e0640 1 -- 172.21.15.53:0/2199024527 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb104066280 msgr2=0x7fb104068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:31.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.422+0000 7fb1287e0640 1 --2- 172.21.15.53:0/2199024527 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb104066280 0x7fb104068730 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fb110008890 tx=0x7fb110008040 comp rx=0 tx=0).stop 2023-06-10T19:02:31.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.422+0000 7fb1287e0640 1 -- 172.21.15.53:0/2199024527 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb1200c9fa0 msgr2=0x7fb120154c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:31.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.422+0000 7fb1287e0640 1 --2- 172.21.15.53:0/2199024527 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb1200c9fa0 0x7fb120154c80 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7fb11800c7a0 tx=0x7fb11800cc60 comp rx=0 tx=0).stop 2023-06-10T19:02:31.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.422+0000 7fb1287e0640 1 -- 172.21.15.53:0/2199024527 shutdown_connections 2023-06-10T19:02:31.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.422+0000 7fb1287e0640 1 --2- 172.21.15.53:0/2199024527 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb104066280 0x7fb104068730 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:31.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.422+0000 7fb1287e0640 1 --2- 172.21.15.53:0/2199024527 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb1200c9fa0 0x7fb120154c80 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:31.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.422+0000 7fb1287e0640 1 --2- 172.21.15.53:0/2199024527 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1200c87e0 0x7fb120154740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:31.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.422+0000 7fb1287e0640 1 --2- 172.21.15.53:0/2199024527 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb12006c020 0x7fb120158650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:31.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.422+0000 7fb1287e0640 1 -- 172.21.15.53:0/2199024527 >> 172.21.15.53:0/2199024527 conn(0x7fb12006a0e0 msgr2=0x7fb120152440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:31.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.422+0000 7fb1287e0640 1 -- 172.21.15.53:0/2199024527 shutdown_connections 2023-06-10T19:02:31.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.422+0000 7fb1287e0640 1 -- 172.21.15.53:0/2199024527 wait complete. 2023-06-10T19:02:31.444 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-10T19:02:31.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.566+0000 7f4a75100640 1 Processor -- start 2023-06-10T19:02:31.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.566+0000 7f4a75100640 1 -- start start 2023-06-10T19:02:31.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.566+0000 7f4a75100640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a700c97d0 0x7f4a700cb820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:31.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.566+0000 7f4a75100640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a700ac910 con 0x7f4a7006c350 2023-06-10T19:02:31.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.566+0000 7f4a75100640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a700cbd60 con 0x7f4a700af760 2023-06-10T19:02:31.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.566+0000 7f4a75100640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a700ca5c0 con 0x7f4a700c97d0 2023-06-10T19:02:31.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.566+0000 7f4a6e59c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f4a7006c350 0x7f4a700ac200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:36144/0 (socket says 172.21.15.53:36144) 2023-06-10T19:02:31.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.566+0000 7f4a6e59c640 1 -- 172.21.15.53:0/1165603335 learned_addr learned my addr 172.21.15.53:0/1165603335 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:02:31.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.566+0000 7f4a6ed9d640 1 --2- 172.21.15.53:0/1165603335 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a700c97d0 0x7f4a700cb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:31.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.566+0000 7f4a6dd9b640 1 -- 172.21.15.53:0/1165603335 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2149310671 0 0) 0x7f4a700ac910 con 0x7f4a7006c350 2023-06-10T19:02:31.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.566+0000 7f4a6dd9b640 1 -- 172.21.15.53:0/1165603335 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a58003530 con 0x7f4a7006c350 2023-06-10T19:02:31.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.566+0000 7f4a6dd9b640 1 -- 172.21.15.53:0/1165603335 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4023344740 0 0) 0x7f4a680014a0 con 0x7f4a700af760 2023-06-10T19:02:31.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.566+0000 7f4a6dd9b640 1 -- 172.21.15.53:0/1165603335 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a700ac910 con 0x7f4a700af760 2023-06-10T19:02:31.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.566+0000 7f4a6dd9b640 1 -- 172.21.15.53:0/1165603335 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3479224386 0 0) 0x7f4a58003530 con 0x7f4a7006c350 2023-06-10T19:02:31.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.566+0000 7f4a6dd9b640 1 -- 172.21.15.53:0/1165603335 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a700c97d0 msgr2=0x7f4a700cb820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:31.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.566+0000 7f4a6dd9b640 1 --2- 172.21.15.53:0/1165603335 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a700c97d0 0x7f4a700cb820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:31.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.566+0000 7f4a6dd9b640 1 -- 172.21.15.53:0/1165603335 >> v1:172.21.15.117:6789/0 conn(0x7f4a700af760 legacy=0x7f4a7006b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:31.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.566+0000 7f4a6dd9b640 1 -- 172.21.15.53:0/1165603335 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a700abd70 con 0x7f4a7006c350 2023-06-10T19:02:31.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.566+0000 7f4a6dd9b640 1 -- 172.21.15.53:0/1165603335 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f4a64001600 con 0x7f4a7006c350 2023-06-10T19:02:31.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.566+0000 7f4a6dd9b640 1 -- 172.21.15.53:0/1165603335 >> v1:172.21.15.53:6789/0 conn(0x7f4a7006c350 legacy=0x7f4a700ac200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:31.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.566+0000 7f4a6dd9b640 1 --2- 172.21.15.53:0/1165603335 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a58003b40 0x7f4a58003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:31.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.566+0000 7f4a6dd9b640 1 --2- 172.21.15.53:0/1165603335 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a580047d0 0x7f4a58004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:31.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.566+0000 7f4a6dd9b640 1 --2- 172.21.15.53:0/1165603335 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a700c97d0 0x7f4a580052a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:31.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.566+0000 7f4a6dd9b640 1 -- 172.21.15.53:0/1165603335 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a700ca5c0 con 0x7f4a58003b40 2023-06-10T19:02:31.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.566+0000 7f4a6dd9b640 1 -- 172.21.15.53:0/1165603335 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5800bb70 con 0x7f4a580047d0 2023-06-10T19:02:31.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.566+0000 7f4a6dd9b640 1 -- 172.21.15.53:0/1165603335 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5800bd30 con 0x7f4a700c97d0 2023-06-10T19:02:31.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.566+0000 7f4a6ed9d640 1 --2- 172.21.15.53:0/1165603335 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a58003b40 0x7f4a58003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:31.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.566+0000 7f4a6e59c640 1 --2- 172.21.15.53:0/1165603335 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a580047d0 0x7f4a58004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:31.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.566+0000 7f4a6f59e640 1 --2- 172.21.15.53:0/1165603335 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a700c97d0 0x7f4a580052a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:31.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.566+0000 7f4a6ed9d640 1 -- 172.21.15.53:0/1165603335 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a700c97d0 msgr2=0x7f4a580052a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:31.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.566+0000 7f4a6ed9d640 1 --2- 172.21.15.53:0/1165603335 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a700c97d0 0x7f4a580052a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:31.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.566+0000 7f4a6ed9d640 1 -- 172.21.15.53:0/1165603335 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a580047d0 msgr2=0x7f4a58004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:31.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.566+0000 7f4a6ed9d640 1 --2- 172.21.15.53:0/1165603335 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a580047d0 0x7f4a58004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:31.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.566+0000 7f4a6ed9d640 1 -- 172.21.15.53:0/1165603335 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a58003530 con 0x7f4a58003b40 2023-06-10T19:02:31.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.566+0000 7f4a6f59e640 1 --2- 172.21.15.53:0/1165603335 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a700c97d0 0x7f4a580052a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:02:31.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.570+0000 7f4a6ed9d640 1 --2- 172.21.15.53:0/1165603335 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a58003b40 0x7f4a58003f30 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f4a60009ae0 tx=0x7f4a6001ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82a989f5069c9164 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:31.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.570+0000 7f4a6dd9b640 1 -- 172.21.15.53:0/1165603335 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a600a6430 con 0x7f4a58003b40 2023-06-10T19:02:31.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.570+0000 7f4a6dd9b640 1 -- 172.21.15.53:0/1165603335 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a600a6590 con 0x7f4a58003b40 2023-06-10T19:02:31.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.570+0000 7f4a6dd9b640 1 -- 172.21.15.53:0/1165603335 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a600a6940 con 0x7f4a58003b40 2023-06-10T19:02:31.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.570+0000 7f4a75100640 1 -- 172.21.15.53:0/1165603335 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a58003b40 msgr2=0x7f4a58003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:31.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.570+0000 7f4a75100640 1 --2- 172.21.15.53:0/1165603335 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a58003b40 0x7f4a58003f30 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f4a60009ae0 tx=0x7f4a6001ca50 comp rx=0 tx=0).stop 2023-06-10T19:02:31.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.570+0000 7f4a6f59e640 1 -- 172.21.15.53:0/1165603335 reap_dead start 2023-06-10T19:02:31.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.570+0000 7f4a75100640 1 -- 172.21.15.53:0/1165603335 shutdown_connections 2023-06-10T19:02:31.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.570+0000 7f4a75100640 1 -- 172.21.15.53:0/1165603335 >> 172.21.15.53:0/1165603335 conn(0x7f4a7006a0e0 msgr2=0x7f4a700cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:31.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.570+0000 7f4a75100640 1 -- 172.21.15.53:0/1165603335 shutdown_connections 2023-06-10T19:02:31.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.570+0000 7f4a75100640 1 -- 172.21.15.53:0/1165603335 wait complete. 2023-06-10T19:02:31.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.570+0000 7f4a75100640 1 Processor -- start 2023-06-10T19:02:31.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.570+0000 7f4a75100640 1 -- start start 2023-06-10T19:02:31.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.574+0000 7f4a75100640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a58003b40 0x7f4a700c3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:31.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.574+0000 7f4a75100640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a7015be40 0x7f4a7015e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:31.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.574+0000 7f4a75100640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a70154140 0x7f4a700c8710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:31.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.574+0000 7f4a75100640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a70153cb0 con 0x7f4a70154140 2023-06-10T19:02:31.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.574+0000 7f4a75100640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7015c6e0 con 0x7f4a58003b40 2023-06-10T19:02:31.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.574+0000 7f4a75100640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a70153680 con 0x7f4a7015be40 2023-06-10T19:02:31.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.574+0000 7f4a6f59e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a70154140 0x7f4a700c8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:31.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.574+0000 7f4a6f59e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a70154140 0x7f4a700c8710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48346/0 (socket says 172.21.15.53:48346) 2023-06-10T19:02:31.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.574+0000 7f4a6f59e640 1 -- 172.21.15.53:0/4210460205 learned_addr learned my addr 172.21.15.53:0/4210460205 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:31.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.574+0000 7f4a6e59c640 1 --2- 172.21.15.53:0/4210460205 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a7015be40 0x7f4a7015e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:31.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.574+0000 7f4a6ed9d640 1 --2- 172.21.15.53:0/4210460205 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a58003b40 0x7f4a700c3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:31.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.574+0000 7f4a6f59e640 1 -- 172.21.15.53:0/4210460205 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a7015be40 msgr2=0x7f4a7015e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:31.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.574+0000 7f4a6f59e640 1 --2- 172.21.15.53:0/4210460205 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a7015be40 0x7f4a7015e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:31.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.574+0000 7f4a6f59e640 1 -- 172.21.15.53:0/4210460205 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a58003b40 msgr2=0x7f4a700c3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:31.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.574+0000 7f4a6f59e640 1 --2- 172.21.15.53:0/4210460205 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a58003b40 0x7f4a700c3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:31.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.574+0000 7f4a6f59e640 1 -- 172.21.15.53:0/4210460205 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a7015c400 con 0x7f4a70154140 2023-06-10T19:02:31.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.574+0000 7f4a6f59e640 1 --2- 172.21.15.53:0/4210460205 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a70154140 0x7f4a700c8710 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f4a700cb7b0 tx=0x7f4a6800d7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:31.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.574+0000 7f4a577fe640 1 -- 172.21.15.53:0/4210460205 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6800b070 con 0x7f4a70154140 2023-06-10T19:02:31.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.574+0000 7f4a577fe640 1 -- 172.21.15.53:0/4210460205 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a68006b60 con 0x7f4a70154140 2023-06-10T19:02:31.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.574+0000 7f4a75100640 1 -- 172.21.15.53:0/4210460205 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a70153940 con 0x7f4a70154140 2023-06-10T19:02:31.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.574+0000 7f4a577fe640 1 -- 172.21.15.53:0/4210460205 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a68003980 con 0x7f4a70154140 2023-06-10T19:02:31.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.574+0000 7f4a75100640 1 -- 172.21.15.53:0/4210460205 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a7015ed00 con 0x7f4a70154140 2023-06-10T19:02:31.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.574+0000 7f4a75100640 1 -- 172.21.15.53:0/4210460205 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a7004d790 con 0x7f4a70154140 2023-06-10T19:02:31.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.574+0000 7f4a577fe640 1 -- 172.21.15.53:0/4210460205 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4a68003ae0 con 0x7f4a70154140 2023-06-10T19:02:31.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.574+0000 7f4a577fe640 1 --2- 172.21.15.53:0/4210460205 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4a5c0662b0 0x7f4a5c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:31.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.574+0000 7f4a577fe640 1 -- 172.21.15.53:0/4210460205 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6264+0+0 (secure 0 0 0) 0x7f4a680829c0 con 0x7f4a70154140 2023-06-10T19:02:31.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.574+0000 7f4a6ed9d640 1 --2- 172.21.15.53:0/4210460205 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4a5c0662b0 0x7f4a5c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:31.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.578+0000 7f4a6ed9d640 1 --2- 172.21.15.53:0/4210460205 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4a5c0662b0 0x7f4a5c068760 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f4a600ad000 tx=0x7f4a600b2040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:31.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.578+0000 7f4a577fe640 1 -- 172.21.15.53:0/4210460205 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4a6804fe00 con 0x7f4a70154140 2023-06-10T19:02:31.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.730+0000 7f4a75100640 1 -- 172.21.15.53:0/4210460205 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4a700cbd60 con 0x7f4a70154140 2023-06-10T19:02:31.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.730+0000 7f4a577fe640 1 -- 172.21.15.53:0/4210460205 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v97) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4a700cbd60 con 0x7f4a70154140 2023-06-10T19:02:31.736 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-06-10T19:02:31.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.734+0000 7f4a75100640 1 -- 172.21.15.53:0/4210460205 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4a5c0662b0 msgr2=0x7f4a5c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:31.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.734+0000 7f4a75100640 1 --2- 172.21.15.53:0/4210460205 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4a5c0662b0 0x7f4a5c068760 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f4a600ad000 tx=0x7f4a600b2040 comp rx=0 tx=0).stop 2023-06-10T19:02:31.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.734+0000 7f4a75100640 1 -- 172.21.15.53:0/4210460205 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a70154140 msgr2=0x7f4a700c8710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:31.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.734+0000 7f4a75100640 1 --2- 172.21.15.53:0/4210460205 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a70154140 0x7f4a700c8710 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f4a700cb7b0 tx=0x7f4a6800d7c0 comp rx=0 tx=0).stop 2023-06-10T19:02:31.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.734+0000 7f4a75100640 1 -- 172.21.15.53:0/4210460205 shutdown_connections 2023-06-10T19:02:31.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.734+0000 7f4a75100640 1 --2- 172.21.15.53:0/4210460205 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4a5c0662b0 0x7f4a5c068760 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:31.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.734+0000 7f4a75100640 1 --2- 172.21.15.53:0/4210460205 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a70154140 0x7f4a700c8710 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:31.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.734+0000 7f4a75100640 1 --2- 172.21.15.53:0/4210460205 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a7015be40 0x7f4a7015e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:31.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.734+0000 7f4a75100640 1 --2- 172.21.15.53:0/4210460205 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a58003b40 0x7f4a700c3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:31.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.734+0000 7f4a75100640 1 -- 172.21.15.53:0/4210460205 >> 172.21.15.53:0/4210460205 conn(0x7f4a7006a0e0 msgr2=0x7f4a700cd180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:31.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.734+0000 7f4a75100640 1 -- 172.21.15.53:0/4210460205 shutdown_connections 2023-06-10T19:02:31.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.734+0000 7f4a75100640 1 -- 172.21.15.53:0/4210460205 wait complete. 2023-06-10T19:02:31.754 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-10T19:02:31.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.874+0000 7ff16358a640 1 Processor -- start 2023-06-10T19:02:31.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.874+0000 7ff16358a640 1 -- start start 2023-06-10T19:02:31.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.874+0000 7ff16358a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff15c0b3ac0 0x7ff15c0b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:31.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.874+0000 7ff16358a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff15c0cc690 0x7ff15c0b43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:31.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.874+0000 7ff16358a640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff15c0ccde0 con 0x7ff15c0d1b00 2023-06-10T19:02:31.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.874+0000 7ff16358a640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff15c0ced00 con 0x7ff15c0b3ac0 2023-06-10T19:02:31.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.874+0000 7ff16358a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff15c0cfc10 con 0x7ff15c0cc690 2023-06-10T19:02:31.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.874+0000 7ff161326640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff15c0b3ac0 0x7ff15c0b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:31.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.874+0000 7ff160b25640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff15c0cc690 0x7ff15c0b43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:31.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.874+0000 7ff160b25640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff15c0cc690 0x7ff15c0b43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.53:57882/0 (socket says 172.21.15.53:57882) 2023-06-10T19:02:31.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.874+0000 7ff160b25640 1 -- 172.21.15.53:0/3605724702 learned_addr learned my addr 172.21.15.53:0/3605724702 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:31.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.874+0000 7ff161326640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff15c0b3ac0 0x7ff15c0b3e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.53:33156/0 (socket says 172.21.15.53:33156) 2023-06-10T19:02:31.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.874+0000 7ff160b25640 1 -- 172.21.15.53:0/3605724702 >> v2:172.21.15.117:3300/0 conn(0x7ff15c0b3ac0 msgr2=0x7ff15c0b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:31.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.874+0000 7ff160b25640 1 --2- 172.21.15.53:0/3605724702 >> v2:172.21.15.117:3300/0 conn(0x7ff15c0b3ac0 0x7ff15c0b3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:31.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.874+0000 7ff160b25640 1 -- 172.21.15.53:0/3605724702 >> v1:172.21.15.117:6789/0 conn(0x7ff15c0d1b00 legacy=0x7ff15c15f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:31.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.874+0000 7ff160b25640 1 -- 172.21.15.53:0/3605724702 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff15c0b4910 con 0x7ff15c0cc690 2023-06-10T19:02:31.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.874+0000 7ff161326640 1 --2- 172.21.15.53:0/3605724702 >> v2:172.21.15.117:3300/0 conn(0x7ff15c0b3ac0 0x7ff15c0b3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-10T19:02:31.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.878+0000 7ff160b25640 1 --2- 172.21.15.53:0/3605724702 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff15c0cc690 0x7ff15c0b43d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff14c009870 tx=0x7ff14c01c420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af9bc05676749dd3 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:31.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.878+0000 7ff153fff640 1 -- 172.21.15.53:0/3605724702 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff14c0ac640 con 0x7ff15c0cc690 2023-06-10T19:02:31.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.878+0000 7ff153fff640 1 -- 172.21.15.53:0/3605724702 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff14c0ac7a0 con 0x7ff15c0cc690 2023-06-10T19:02:31.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.878+0000 7ff153fff640 1 -- 172.21.15.53:0/3605724702 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff14c0acb30 con 0x7ff15c0cc690 2023-06-10T19:02:31.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.878+0000 7ff16358a640 1 -- 172.21.15.53:0/3605724702 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff15c0cc690 msgr2=0x7ff15c0b43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:31.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.878+0000 7ff16358a640 1 --2- 172.21.15.53:0/3605724702 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff15c0cc690 0x7ff15c0b43d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff14c009870 tx=0x7ff14c01c420 comp rx=0 tx=0).stop 2023-06-10T19:02:31.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.878+0000 7ff16358a640 1 -- 172.21.15.53:0/3605724702 shutdown_connections 2023-06-10T19:02:31.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.878+0000 7ff16358a640 1 --2- 172.21.15.53:0/3605724702 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff15c0cc690 0x7ff15c0b43d0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:31.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.878+0000 7ff16358a640 1 --2- 172.21.15.53:0/3605724702 >> v2:172.21.15.117:3300/0 conn(0x7ff15c0b3ac0 0x7ff15c0b3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:31.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.878+0000 7ff16358a640 1 -- 172.21.15.53:0/3605724702 >> 172.21.15.53:0/3605724702 conn(0x7ff15c069de0 msgr2=0x7ff15c06a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:31.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.878+0000 7ff16358a640 1 -- 172.21.15.53:0/3605724702 shutdown_connections 2023-06-10T19:02:31.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.878+0000 7ff16358a640 1 -- 172.21.15.53:0/3605724702 wait complete. 2023-06-10T19:02:31.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.878+0000 7ff16358a640 1 Processor -- start 2023-06-10T19:02:31.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.882+0000 7ff16358a640 1 -- start start 2023-06-10T19:02:31.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.882+0000 7ff16358a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff15c0b3ac0 0x7ff15c150670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:31.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.882+0000 7ff16358a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff15c0cc690 0x7ff15c15c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:31.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.882+0000 7ff16358a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff15c0d1b00 0x7ff15c14fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:31.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.882+0000 7ff16358a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff15c15d090 con 0x7ff15c0d1b00 2023-06-10T19:02:31.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.882+0000 7ff16358a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff15c154dc0 con 0x7ff15c0b3ac0 2023-06-10T19:02:31.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.882+0000 7ff16358a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff15c15cdf0 con 0x7ff15c0cc690 2023-06-10T19:02:31.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.882+0000 7ff161b27640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff15c0d1b00 0x7ff15c14fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:31.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.882+0000 7ff161b27640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff15c0d1b00 0x7ff15c14fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48350/0 (socket says 172.21.15.53:48350) 2023-06-10T19:02:31.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.882+0000 7ff161b27640 1 -- 172.21.15.53:0/1958640194 learned_addr learned my addr 172.21.15.53:0/1958640194 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:31.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.882+0000 7ff161326640 1 --2- 172.21.15.53:0/1958640194 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff15c0b3ac0 0x7ff15c150670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:31.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.882+0000 7ff160b25640 1 --2- 172.21.15.53:0/1958640194 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff15c0cc690 0x7ff15c15c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:31.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.882+0000 7ff161b27640 1 -- 172.21.15.53:0/1958640194 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff15c0cc690 msgr2=0x7ff15c15c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:31.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.882+0000 7ff161b27640 1 --2- 172.21.15.53:0/1958640194 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff15c0cc690 0x7ff15c15c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:31.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.882+0000 7ff161b27640 1 -- 172.21.15.53:0/1958640194 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff15c0b3ac0 msgr2=0x7ff15c150670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:31.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.882+0000 7ff161b27640 1 --2- 172.21.15.53:0/1958640194 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff15c0b3ac0 0x7ff15c150670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:31.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.882+0000 7ff161b27640 1 -- 172.21.15.53:0/1958640194 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff158009420 con 0x7ff15c0d1b00 2023-06-10T19:02:31.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.882+0000 7ff161b27640 1 --2- 172.21.15.53:0/1958640194 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff15c0d1b00 0x7ff15c14fa80 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7ff15400c730 tx=0x7ff15400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:31.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.882+0000 7ff151ffb640 1 -- 172.21.15.53:0/1958640194 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff154003b80 con 0x7ff15c0d1b00 2023-06-10T19:02:31.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.882+0000 7ff151ffb640 1 -- 172.21.15.53:0/1958640194 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff154003ce0 con 0x7ff15c0d1b00 2023-06-10T19:02:31.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.882+0000 7ff16358a640 1 -- 172.21.15.53:0/1958640194 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff14c0094d0 con 0x7ff15c0d1b00 2023-06-10T19:02:31.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.882+0000 7ff151ffb640 1 -- 172.21.15.53:0/1958640194 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff154005310 con 0x7ff15c0d1b00 2023-06-10T19:02:31.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.882+0000 7ff16358a640 1 -- 172.21.15.53:0/1958640194 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff15c155340 con 0x7ff15c0d1b00 2023-06-10T19:02:31.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.882+0000 7ff16358a640 1 -- 172.21.15.53:0/1958640194 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff15c04d790 con 0x7ff15c0d1b00 2023-06-10T19:02:31.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.882+0000 7ff151ffb640 1 -- 172.21.15.53:0/1958640194 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff154005680 con 0x7ff15c0d1b00 2023-06-10T19:02:31.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.882+0000 7ff151ffb640 1 --2- 172.21.15.53:0/1958640194 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff1400662b0 0x7ff140068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:31.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.882+0000 7ff151ffb640 1 -- 172.21.15.53:0/1958640194 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6264+0+0 (secure 0 0 0) 0x7ff154083ca0 con 0x7ff15c0d1b00 2023-06-10T19:02:31.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.882+0000 7ff161326640 1 --2- 172.21.15.53:0/1958640194 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff1400662b0 0x7ff140068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:31.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.886+0000 7ff161326640 1 --2- 172.21.15.53:0/1958640194 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff1400662b0 0x7ff140068760 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7ff158009cf0 tx=0x7ff158009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:31.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:31.886+0000 7ff151ffb640 1 -- 172.21.15.53:0/1958640194 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff154051050 con 0x7ff15c0d1b00 2023-06-10T19:02:32.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.054+0000 7ff16358a640 1 -- 172.21.15.53:0/1958640194 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff15c06ac70 con 0x7ff15c0d1b00 2023-06-10T19:02:32.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.054+0000 7ff151ffb640 1 -- 172.21.15.53:0/1958640194 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v97) v1 ==== 80+0+122 (secure 0 0 0) 0x7ff154054670 con 0x7ff15c0d1b00 2023-06-10T19:02:32.059 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:6833/1894654263 2023-06-11T19:02:29.480972+0000 2023-06-10T19:02:32.059 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:6832/1894654263 2023-06-11T19:02:29.480972+0000 2023-06-10T19:02:32.059 INFO:teuthology.orchestra.run.smithi053.stderr:listed 2 entries 2023-06-10T19:02:32.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.058+0000 7ff16358a640 1 -- 172.21.15.53:0/1958640194 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff1400662b0 msgr2=0x7ff140068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:32.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.058+0000 7ff16358a640 1 --2- 172.21.15.53:0/1958640194 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff1400662b0 0x7ff140068760 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7ff158009cf0 tx=0x7ff158009190 comp rx=0 tx=0).stop 2023-06-10T19:02:32.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.058+0000 7ff16358a640 1 -- 172.21.15.53:0/1958640194 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff15c0d1b00 msgr2=0x7ff15c14fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:32.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.058+0000 7ff16358a640 1 --2- 172.21.15.53:0/1958640194 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff15c0d1b00 0x7ff15c14fa80 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7ff15400c730 tx=0x7ff15400cbf0 comp rx=0 tx=0).stop 2023-06-10T19:02:32.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.058+0000 7ff16358a640 1 -- 172.21.15.53:0/1958640194 shutdown_connections 2023-06-10T19:02:32.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.058+0000 7ff16358a640 1 --2- 172.21.15.53:0/1958640194 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff1400662b0 0x7ff140068760 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:32.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.058+0000 7ff16358a640 1 --2- 172.21.15.53:0/1958640194 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff15c0d1b00 0x7ff15c14fa80 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:32.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.058+0000 7ff16358a640 1 --2- 172.21.15.53:0/1958640194 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff15c0cc690 0x7ff15c15c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:32.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.058+0000 7ff16358a640 1 --2- 172.21.15.53:0/1958640194 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff15c0b3ac0 0x7ff15c150670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:32.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.058+0000 7ff16358a640 1 -- 172.21.15.53:0/1958640194 >> 172.21.15.53:0/1958640194 conn(0x7ff15c069de0 msgr2=0x7ff15c15f3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:32.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.058+0000 7ff16358a640 1 -- 172.21.15.53:0/1958640194 shutdown_connections 2023-06-10T19:02:32.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.058+0000 7ff16358a640 1 -- 172.21.15.53:0/1958640194 wait complete. 2023-06-10T19:02:32.078 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T19:02:32.078 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:02:32.084 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:02:32.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.250+0000 7fdcbe339640 1 Processor -- start 2023-06-10T19:02:32.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.250+0000 7fdcbe339640 1 -- start start 2023-06-10T19:02:32.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.250+0000 7fdcbe339640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdcb80b3ac0 0x7fdcb80b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:32.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.250+0000 7fdcbe339640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fdcb80cc690 0x7fdcb815f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:32.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.250+0000 7fdcbe339640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcb80d0020 con 0x7fdcb80ccae0 2023-06-10T19:02:32.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.250+0000 7fdcbe339640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcb80b43d0 con 0x7fdcb80cc690 2023-06-10T19:02:32.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.250+0000 7fdcbe339640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb80cef40 con 0x7fdcb80b3ac0 2023-06-10T19:02:32.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.250+0000 7fdcb77fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fdcb80cc690 0x7fdcb815f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:32.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.250+0000 7fdcbc8d6640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fdcb80ccae0 0x7fdcb815f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:36146/0 (socket says 172.21.15.53:36146) 2023-06-10T19:02:32.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.250+0000 7fdcbc8d6640 1 -- 172.21.15.53:0/1773526112 learned_addr learned my addr 172.21.15.53:0/1773526112 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:02:32.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.250+0000 7fdcb7fff640 1 --2- 172.21.15.53:0/1773526112 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdcb80b3ac0 0x7fdcb80b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:32.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.250+0000 7fdcb77fe640 1 -- 172.21.15.53:0/1773526112 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdcb80b3ac0 msgr2=0x7fdcb80b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:32.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.250+0000 7fdcb77fe640 1 --2- 172.21.15.53:0/1773526112 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdcb80b3ac0 0x7fdcb80b3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:32.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.250+0000 7fdcb77fe640 1 -- 172.21.15.53:0/1773526112 >> v1:172.21.15.53:6789/0 conn(0x7fdcb80ccae0 legacy=0x7fdcb815f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:32.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.250+0000 7fdcb77fe640 1 -- 172.21.15.53:0/1773526112 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcb80cf220 con 0x7fdcb80cc690 2023-06-10T19:02:32.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.250+0000 7fdcb6ffd640 1 -- 172.21.15.53:0/1773526112 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3277586719 0 0) 0x7fdcb80d0020 con 0x7fdcb80ccae0 2023-06-10T19:02:32.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.250+0000 7fdcb7fff640 1 --2- 172.21.15.53:0/1773526112 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdcb80b3ac0 0x7fdcb80b3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:02:32.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.254+0000 7fdcb77fe640 1 --2- 172.21.15.53:0/1773526112 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdcb80cc690 0x7fdcb815f370 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7fdcac0097c0 tx=0x7fdcac01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7a01f020429c61f server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:32.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.254+0000 7fdcb6ffd640 1 -- 172.21.15.53:0/1773526112 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcac0ab650 con 0x7fdcb80cc690 2023-06-10T19:02:32.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.254+0000 7fdcb6ffd640 1 -- 172.21.15.53:0/1773526112 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcac0ab7b0 con 0x7fdcb80cc690 2023-06-10T19:02:32.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.254+0000 7fdcb6ffd640 1 -- 172.21.15.53:0/1773526112 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcac0abb40 con 0x7fdcb80cc690 2023-06-10T19:02:32.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.254+0000 7fdcbe339640 1 -- 172.21.15.53:0/1773526112 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdcb80cc690 msgr2=0x7fdcb815f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:32.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.254+0000 7fdcbe339640 1 --2- 172.21.15.53:0/1773526112 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdcb80cc690 0x7fdcb815f370 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7fdcac0097c0 tx=0x7fdcac01c450 comp rx=0 tx=0).stop 2023-06-10T19:02:32.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.254+0000 7fdcbe339640 1 -- 172.21.15.53:0/1773526112 shutdown_connections 2023-06-10T19:02:32.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.254+0000 7fdcbe339640 1 --2- 172.21.15.53:0/1773526112 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdcb80cc690 0x7fdcb815f370 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:32.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.254+0000 7fdcbe339640 1 --2- 172.21.15.53:0/1773526112 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdcb80b3ac0 0x7fdcb80b3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:32.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.254+0000 7fdcbe339640 1 -- 172.21.15.53:0/1773526112 >> 172.21.15.53:0/1773526112 conn(0x7fdcb8071790 msgr2=0x7fdcb8069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:32.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.254+0000 7fdcbe339640 1 -- 172.21.15.53:0/1773526112 shutdown_connections 2023-06-10T19:02:32.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.254+0000 7fdcbe339640 1 -- 172.21.15.53:0/1773526112 wait complete. 2023-06-10T19:02:32.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.254+0000 7fdcbe339640 1 Processor -- start 2023-06-10T19:02:32.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.254+0000 7fdcbe339640 1 -- start start 2023-06-10T19:02:32.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.254+0000 7fdcbe339640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdcb80b3ac0 0x7fdcb81526d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:32.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.254+0000 7fdcbe339640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdcb80cc690 0x7fdcb815c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:32.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.254+0000 7fdcbe339640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdcb80ccae0 0x7fdcb815dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:32.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.254+0000 7fdcbe339640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb8157670 con 0x7fdcb80ccae0 2023-06-10T19:02:32.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.254+0000 7fdcbe339640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb8152c10 con 0x7fdcb80b3ac0 2023-06-10T19:02:32.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.254+0000 7fdcbe339640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb815c670 con 0x7fdcb80cc690 2023-06-10T19:02:32.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.254+0000 7fdcbc8d6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdcb80ccae0 0x7fdcb815dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:32.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.254+0000 7fdcbc8d6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdcb80ccae0 0x7fdcb815dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48370/0 (socket says 172.21.15.53:48370) 2023-06-10T19:02:32.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.254+0000 7fdcbc8d6640 1 -- 172.21.15.53:0/2077488659 learned_addr learned my addr 172.21.15.53:0/2077488659 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:32.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.254+0000 7fdcb77fe640 1 --2- 172.21.15.53:0/2077488659 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdcb80cc690 0x7fdcb815c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:32.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.254+0000 7fdcb7fff640 1 --2- 172.21.15.53:0/2077488659 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdcb80b3ac0 0x7fdcb81526d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:32.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.254+0000 7fdcbc8d6640 1 -- 172.21.15.53:0/2077488659 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdcb80cc690 msgr2=0x7fdcb815c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:32.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.254+0000 7fdcbc8d6640 1 --2- 172.21.15.53:0/2077488659 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdcb80cc690 0x7fdcb815c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:32.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.258+0000 7fdcbc8d6640 1 -- 172.21.15.53:0/2077488659 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdcb80b3ac0 msgr2=0x7fdcb81526d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:32.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.258+0000 7fdcbc8d6640 1 --2- 172.21.15.53:0/2077488659 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdcb80b3ac0 0x7fdcb81526d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:32.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.258+0000 7fdcbc8d6640 1 -- 172.21.15.53:0/2077488659 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcac009420 con 0x7fdcb80ccae0 2023-06-10T19:02:32.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.258+0000 7fdcbc8d6640 1 --2- 172.21.15.53:0/2077488659 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdcb80ccae0 0x7fdcb815dae0 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7fdcb000c470 tx=0x7fdcb000c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:32.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.258+0000 7fdcb4ff9640 1 -- 172.21.15.53:0/2077488659 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb00074e0 con 0x7fdcb80ccae0 2023-06-10T19:02:32.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.258+0000 7fdcb4ff9640 1 -- 172.21.15.53:0/2077488659 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcb0007640 con 0x7fdcb80ccae0 2023-06-10T19:02:32.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.258+0000 7fdcbe339640 1 -- 172.21.15.53:0/2077488659 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcb815ebf0 con 0x7fdcb80ccae0 2023-06-10T19:02:32.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.258+0000 7fdcb4ff9640 1 -- 172.21.15.53:0/2077488659 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb0004a30 con 0x7fdcb80ccae0 2023-06-10T19:02:32.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.258+0000 7fdcbe339640 1 -- 172.21.15.53:0/2077488659 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcb815e400 con 0x7fdcb80ccae0 2023-06-10T19:02:32.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.258+0000 7fdcbe339640 1 -- 172.21.15.53:0/2077488659 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcb81577b0 con 0x7fdcb80ccae0 2023-06-10T19:02:32.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.258+0000 7fdcb4ff9640 1 -- 172.21.15.53:0/2077488659 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdcb0004b90 con 0x7fdcb80ccae0 2023-06-10T19:02:32.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.258+0000 7fdcb4ff9640 1 --2- 172.21.15.53:0/2077488659 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdca4066280 0x7fdca4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:32.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.258+0000 7fdcb4ff9640 1 -- 172.21.15.53:0/2077488659 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6264+0+0 (secure 0 0 0) 0x7fdcb0083000 con 0x7fdcb80ccae0 2023-06-10T19:02:32.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.258+0000 7fdcb7fff640 1 --2- 172.21.15.53:0/2077488659 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdca4066280 0x7fdca4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:32.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.258+0000 7fdcb7fff640 1 --2- 172.21.15.53:0/2077488659 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdca4066280 0x7fdca4068730 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fdca8007510 tx=0x7fdca80074a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:32.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.262+0000 7fdcb4ff9640 1 -- 172.21.15.53:0/2077488659 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdcb0050440 con 0x7fdcb80ccae0 2023-06-10T19:02:32.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.418+0000 7fdcbe339640 1 -- 172.21.15.53:0/2077488659 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdcb804d790 con 0x7fdcb80ccae0 2023-06-10T19:02:32.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.422+0000 7fdcb4ff9640 1 -- 172.21.15.53:0/2077488659 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) v1 ==== 74+0+18604 (secure 0 0 0) 0x7fdcb0018090 con 0x7fdcb80ccae0 2023-06-10T19:02:32.424 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:02:32.424 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":97,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:02:29.481025+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-06-10T19:02:00.325404+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-06-10T19:02:01.620938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.8","mappings":[{"from":1,"to":2}]},{"pgid":"14.17","mappings":[{"from":1,"to":7}]},{"pgid":"14.2d","mappings":[{"from":1,"to":7}]},{"pgid":"14.3a","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.53:6833/1894654263":"2023-06-11T19:02:29.480972+0000","172.21.15.53:6832/1894654263":"2023-06-11T19:02:29.480972+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:02:32.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.422+0000 7fdcbe339640 1 -- 172.21.15.53:0/2077488659 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdca4066280 msgr2=0x7fdca4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:32.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.422+0000 7fdcbe339640 1 --2- 172.21.15.53:0/2077488659 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdca4066280 0x7fdca4068730 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fdca8007510 tx=0x7fdca80074a0 comp rx=0 tx=0).stop 2023-06-10T19:02:32.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.422+0000 7fdcbe339640 1 -- 172.21.15.53:0/2077488659 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdcb80ccae0 msgr2=0x7fdcb815dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:32.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.422+0000 7fdcbe339640 1 --2- 172.21.15.53:0/2077488659 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdcb80ccae0 0x7fdcb815dae0 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7fdcb000c470 tx=0x7fdcb000c930 comp rx=0 tx=0).stop 2023-06-10T19:02:32.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.422+0000 7fdcbe339640 1 -- 172.21.15.53:0/2077488659 shutdown_connections 2023-06-10T19:02:32.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.422+0000 7fdcbe339640 1 --2- 172.21.15.53:0/2077488659 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdca4066280 0x7fdca4068730 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:32.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.422+0000 7fdcbe339640 1 --2- 172.21.15.53:0/2077488659 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdcb80ccae0 0x7fdcb815dae0 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:32.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.422+0000 7fdcbe339640 1 --2- 172.21.15.53:0/2077488659 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdcb80cc690 0x7fdcb815c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:32.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.422+0000 7fdcbe339640 1 --2- 172.21.15.53:0/2077488659 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdcb80b3ac0 0x7fdcb81526d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:32.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.422+0000 7fdcbe339640 1 -- 172.21.15.53:0/2077488659 >> 172.21.15.53:0/2077488659 conn(0x7fdcb8071790 msgr2=0x7fdcb80d2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:32.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.422+0000 7fdcbe339640 1 -- 172.21.15.53:0/2077488659 shutdown_connections 2023-06-10T19:02:32.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.422+0000 7fdcbe339640 1 -- 172.21.15.53:0/2077488659 wait complete. 2023-06-10T19:02:32.442 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-10T18:52:33.633114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-10T18:52:39.171487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-10T19:02:00.325404+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '93', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2023-06-10T19:02:01.620938+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '94', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-10T19:02:32.444 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-10T19:02:32.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.558+0000 7fb940562640 1 Processor -- start 2023-06-10T19:02:32.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.558+0000 7fb940562640 1 -- start start 2023-06-10T19:02:32.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.562+0000 7fb940562640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb9380b7e30 0x7fb9380b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:32.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.562+0000 7fb940562640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9380cc7c0 con 0x7fb9380b0b90 2023-06-10T19:02:32.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.562+0000 7fb940562640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9380ccaa0 con 0x7fb93815c090 2023-06-10T19:02:32.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.562+0000 7fb940562640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9380ccd80 con 0x7fb9380b7e30 2023-06-10T19:02:32.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.562+0000 7fb93eaff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fb9380b0b90 0x7fb9380d04d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:36162/0 (socket says 172.21.15.53:36162) 2023-06-10T19:02:32.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.562+0000 7fb93eaff640 1 -- 172.21.15.53:0/1146502413 learned_addr learned my addr 172.21.15.53:0/1146502413 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:02:32.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.562+0000 7fb93dafd640 1 --2- 172.21.15.53:0/1146502413 >> v2:172.21.15.117:3300/0 conn(0x7fb9380b7e30 0x7fb9380b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:32.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.562+0000 7fb93d2fc640 1 -- 172.21.15.53:0/1146502413 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4169777248 0 0) 0x7fb9380cc7c0 con 0x7fb9380b0b90 2023-06-10T19:02:32.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.562+0000 7fb93d2fc640 1 -- 172.21.15.53:0/1146502413 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb924003530 con 0x7fb9380b0b90 2023-06-10T19:02:32.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.562+0000 7fb93d2fc640 1 -- 172.21.15.53:0/1146502413 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3390434084 0 0) 0x7fb924003530 con 0x7fb9380b0b90 2023-06-10T19:02:32.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.562+0000 7fb93d2fc640 1 -- 172.21.15.53:0/1146502413 >> v2:172.21.15.117:3300/0 conn(0x7fb9380b7e30 msgr2=0x7fb9380b10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:32.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.562+0000 7fb93d2fc640 1 --2- 172.21.15.53:0/1146502413 >> v2:172.21.15.117:3300/0 conn(0x7fb9380b7e30 0x7fb9380b10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:32.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.562+0000 7fb93d2fc640 1 -- 172.21.15.53:0/1146502413 >> v1:172.21.15.117:6789/0 conn(0x7fb93815c090 legacy=0x7fb9380b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:32.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.562+0000 7fb93d2fc640 1 -- 172.21.15.53:0/1146502413 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9380cd060 con 0x7fb9380b0b90 2023-06-10T19:02:32.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.562+0000 7fb93d2fc640 1 -- 172.21.15.53:0/1146502413 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fb930001a00 con 0x7fb9380b0b90 2023-06-10T19:02:32.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.562+0000 7fb93d2fc640 1 -- 172.21.15.53:0/1146502413 >> v1:172.21.15.53:6789/0 conn(0x7fb9380b0b90 legacy=0x7fb9380d04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:32.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.562+0000 7fb93d2fc640 1 --2- 172.21.15.53:0/1146502413 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb924003980 0x7fb924003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:32.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.562+0000 7fb93d2fc640 1 --2- 172.21.15.53:0/1146502413 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9240047d0 0x7fb924004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:32.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.562+0000 7fb93d2fc640 1 --2- 172.21.15.53:0/1146502413 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9240052a0 0x7fb92400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:32.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.562+0000 7fb93d2fc640 1 -- 172.21.15.53:0/1146502413 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9380ccd80 con 0x7fb9240047d0 2023-06-10T19:02:32.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.562+0000 7fb93d2fc640 1 -- 172.21.15.53:0/1146502413 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb92400c160 con 0x7fb924003980 2023-06-10T19:02:32.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.562+0000 7fb93d2fc640 1 -- 172.21.15.53:0/1146502413 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb92400c320 con 0x7fb9240052a0 2023-06-10T19:02:32.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.562+0000 7fb93dafd640 1 --2- 172.21.15.53:0/1146502413 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9240047d0 0x7fb924004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:32.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.562+0000 7fb93e2fe640 1 --2- 172.21.15.53:0/1146502413 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb924003980 0x7fb924003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:32.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.562+0000 7fb93dafd640 1 -- 172.21.15.53:0/1146502413 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9240052a0 msgr2=0x7fb92400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:32.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.562+0000 7fb93dafd640 1 --2- 172.21.15.53:0/1146502413 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9240052a0 0x7fb92400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:32.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.562+0000 7fb93dafd640 1 -- 172.21.15.53:0/1146502413 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb924003980 msgr2=0x7fb924003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:32.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.562+0000 7fb93dafd640 1 --2- 172.21.15.53:0/1146502413 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb924003980 0x7fb924003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:32.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.562+0000 7fb93dafd640 1 -- 172.21.15.53:0/1146502413 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb924003530 con 0x7fb9240047d0 2023-06-10T19:02:32.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.562+0000 7fb93eaff640 1 -- 172.21.15.53:0/1146502413 reap_dead start 2023-06-10T19:02:32.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.562+0000 7fb93dafd640 1 --2- 172.21.15.53:0/1146502413 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9240047d0 0x7fb924004c40 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7fb92800ba30 tx=0x7fb92801c650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d6e25365ee41248 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:32.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.562+0000 7fb93d2fc640 1 -- 172.21.15.53:0/1146502413 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9280ac5f0 con 0x7fb9240047d0 2023-06-10T19:02:32.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.562+0000 7fb93d2fc640 1 -- 172.21.15.53:0/1146502413 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9280ac750 con 0x7fb9240047d0 2023-06-10T19:02:32.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.562+0000 7fb93d2fc640 1 -- 172.21.15.53:0/1146502413 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9280acb00 con 0x7fb9240047d0 2023-06-10T19:02:32.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.566+0000 7fb940562640 1 -- 172.21.15.53:0/1146502413 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9240047d0 msgr2=0x7fb924004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:32.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.566+0000 7fb940562640 1 --2- 172.21.15.53:0/1146502413 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9240047d0 0x7fb924004c40 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7fb92800ba30 tx=0x7fb92801c650 comp rx=0 tx=0).stop 2023-06-10T19:02:32.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.566+0000 7fb940562640 1 -- 172.21.15.53:0/1146502413 shutdown_connections 2023-06-10T19:02:32.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.566+0000 7fb940562640 1 --2- 172.21.15.53:0/1146502413 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9240047d0 0x7fb924004c40 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:32.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.566+0000 7fb940562640 1 -- 172.21.15.53:0/1146502413 >> 172.21.15.53:0/1146502413 conn(0x7fb938069e20 msgr2=0x7fb93806a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:32.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.566+0000 7fb940562640 1 -- 172.21.15.53:0/1146502413 shutdown_connections 2023-06-10T19:02:32.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.566+0000 7fb940562640 1 -- 172.21.15.53:0/1146502413 wait complete. 2023-06-10T19:02:32.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.566+0000 7fb940562640 1 Processor -- start 2023-06-10T19:02:32.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.566+0000 7fb940562640 1 -- start start 2023-06-10T19:02:32.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.566+0000 7fb940562640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb9240047d0 0x7fb93814b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:32.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.566+0000 7fb940562640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb93815a6a0 0x7fb93814acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:32.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.566+0000 7fb940562640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9380b6580 0x7fb9380b69f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:32.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.566+0000 7fb940562640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9380c69e0 con 0x7fb9380b6580 2023-06-10T19:02:32.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.566+0000 7fb940562640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb93814bdb0 con 0x7fb9240047d0 2023-06-10T19:02:32.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.566+0000 7fb940562640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9380b6f30 con 0x7fb93815a6a0 2023-06-10T19:02:32.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.566+0000 7fb93eaff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9380b6580 0x7fb9380b69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:32.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.566+0000 7fb93eaff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9380b6580 0x7fb9380b69f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48384/0 (socket says 172.21.15.53:48384) 2023-06-10T19:02:32.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.566+0000 7fb93eaff640 1 -- 172.21.15.53:0/1799952549 learned_addr learned my addr 172.21.15.53:0/1799952549 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:32.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.566+0000 7fb93e2fe640 1 --2- 172.21.15.53:0/1799952549 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb9240047d0 0x7fb93814b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:32.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.566+0000 7fb93dafd640 1 --2- 172.21.15.53:0/1799952549 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb93815a6a0 0x7fb93814acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:32.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.566+0000 7fb93eaff640 1 -- 172.21.15.53:0/1799952549 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb93815a6a0 msgr2=0x7fb93814acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:32.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.566+0000 7fb93eaff640 1 --2- 172.21.15.53:0/1799952549 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb93815a6a0 0x7fb93814acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:32.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.566+0000 7fb93eaff640 1 -- 172.21.15.53:0/1799952549 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb9240047d0 msgr2=0x7fb93814b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:32.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.566+0000 7fb93eaff640 1 --2- 172.21.15.53:0/1799952549 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb9240047d0 0x7fb93814b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:32.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.566+0000 7fb93eaff640 1 -- 172.21.15.53:0/1799952549 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9380c5d60 con 0x7fb9380b6580 2023-06-10T19:02:32.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.566+0000 7fb93e2fe640 1 --2- 172.21.15.53:0/1799952549 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb9240047d0 0x7fb93814b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:02:32.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.566+0000 7fb93dafd640 1 --2- 172.21.15.53:0/1799952549 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb93815a6a0 0x7fb93814acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:02:32.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.566+0000 7fb93eaff640 1 --2- 172.21.15.53:0/1799952549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9380b6580 0x7fb9380b69f0 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7fb93808b4a0 tx=0x7fb93000cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:32.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.566+0000 7fb92effd640 1 -- 172.21.15.53:0/1799952549 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb930004d70 con 0x7fb9380b6580 2023-06-10T19:02:32.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.566+0000 7fb92effd640 1 -- 172.21.15.53:0/1799952549 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb930007030 con 0x7fb9380b6580 2023-06-10T19:02:32.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.566+0000 7fb940562640 1 -- 172.21.15.53:0/1799952549 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9380c6040 con 0x7fb9380b6580 2023-06-10T19:02:32.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.566+0000 7fb92effd640 1 -- 172.21.15.53:0/1799952549 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9300073e0 con 0x7fb9380b6580 2023-06-10T19:02:32.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.566+0000 7fb940562640 1 -- 172.21.15.53:0/1799952549 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9380c6600 con 0x7fb9380b6580 2023-06-10T19:02:32.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.570+0000 7fb940562640 1 -- 172.21.15.53:0/1799952549 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb93815aa70 con 0x7fb9380b6580 2023-06-10T19:02:32.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.570+0000 7fb92effd640 1 -- 172.21.15.53:0/1799952549 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb930007540 con 0x7fb9380b6580 2023-06-10T19:02:32.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.570+0000 7fb92effd640 1 --2- 172.21.15.53:0/1799952549 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb91c066280 0x7fb91c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:32.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.570+0000 7fb92effd640 1 -- 172.21.15.53:0/1799952549 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6264+0+0 (secure 0 0 0) 0x7fb930082a70 con 0x7fb9380b6580 2023-06-10T19:02:32.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.570+0000 7fb93e2fe640 1 --2- 172.21.15.53:0/1799952549 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb91c066280 0x7fb91c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:32.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.570+0000 7fb93e2fe640 1 --2- 172.21.15.53:0/1799952549 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb91c066280 0x7fb91c068730 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fb9381f83f0 tx=0x7fb934009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:32.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.574+0000 7fb92effd640 1 -- 172.21.15.53:0/1799952549 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb93004fed0 con 0x7fb9380b6580 2023-06-10T19:02:32.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.722+0000 7fb940562640 1 -- 172.21.15.53:0/1799952549 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb9380b1770 con 0x7fb9380b6580 2023-06-10T19:02:32.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.722+0000 7fb92effd640 1 -- 172.21.15.53:0/1799952549 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v97) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb9300534f0 con 0x7fb9380b6580 2023-06-10T19:02:32.725 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-06-10T19:02:32.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.722+0000 7fb940562640 1 -- 172.21.15.53:0/1799952549 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb91c066280 msgr2=0x7fb91c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:32.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.722+0000 7fb940562640 1 --2- 172.21.15.53:0/1799952549 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb91c066280 0x7fb91c068730 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fb9381f83f0 tx=0x7fb934009040 comp rx=0 tx=0).stop 2023-06-10T19:02:32.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.722+0000 7fb940562640 1 -- 172.21.15.53:0/1799952549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9380b6580 msgr2=0x7fb9380b69f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:32.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.722+0000 7fb940562640 1 --2- 172.21.15.53:0/1799952549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9380b6580 0x7fb9380b69f0 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7fb93808b4a0 tx=0x7fb93000cab0 comp rx=0 tx=0).stop 2023-06-10T19:02:32.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.722+0000 7fb940562640 1 -- 172.21.15.53:0/1799952549 shutdown_connections 2023-06-10T19:02:32.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.722+0000 7fb940562640 1 --2- 172.21.15.53:0/1799952549 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb91c066280 0x7fb91c068730 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:32.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.722+0000 7fb940562640 1 --2- 172.21.15.53:0/1799952549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9380b6580 0x7fb9380b69f0 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:32.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.722+0000 7fb940562640 1 --2- 172.21.15.53:0/1799952549 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb93815a6a0 0x7fb93814acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:32.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.722+0000 7fb940562640 1 --2- 172.21.15.53:0/1799952549 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb9240047d0 0x7fb93814b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:32.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.722+0000 7fb940562640 1 -- 172.21.15.53:0/1799952549 >> 172.21.15.53:0/1799952549 conn(0x7fb938069e20 msgr2=0x7fb9380d2060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:32.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.722+0000 7fb940562640 1 -- 172.21.15.53:0/1799952549 shutdown_connections 2023-06-10T19:02:32.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.722+0000 7fb940562640 1 -- 172.21.15.53:0/1799952549 wait complete. 2023-06-10T19:02:32.742 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-10T19:02:32.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.866+0000 7f5787747640 1 Processor -- start 2023-06-10T19:02:32.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.866+0000 7f5787747640 1 -- start start 2023-06-10T19:02:32.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.866+0000 7f5787747640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f57800af760 0x7f57800afb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:32.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.866+0000 7f5787747640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f57800700e0 0x7f57800c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:32.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.866+0000 7f5787747640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57800b0070 con 0x7f578015dae0 2023-06-10T19:02:32.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.866+0000 7f5787747640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5780070910 con 0x7f57800700e0 2023-06-10T19:02:32.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.866+0000 7f5787747640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5780070bf0 con 0x7f57800af760 2023-06-10T19:02:32.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.866+0000 7f5784ce2640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f57800700e0 0x7f57800c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:32.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.866+0000 7f5784ce2640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f57800700e0 0x7f57800c82a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48390/0 (socket says 172.21.15.53:48390) 2023-06-10T19:02:32.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.866+0000 7f5785ce4640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f578015dae0 0x7f578006b650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:36172/0 (socket says 172.21.15.53:36172) 2023-06-10T19:02:32.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.866+0000 7f5784ce2640 1 -- 172.21.15.53:0/2928563856 learned_addr learned my addr 172.21.15.53:0/2928563856 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:32.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.866+0000 7f57854e3640 1 --2- 172.21.15.53:0/2928563856 >> v2:172.21.15.117:3300/0 conn(0x7f57800af760 0x7f57800afb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:32.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.866+0000 7f5784ce2640 1 -- 172.21.15.53:0/2928563856 >> v2:172.21.15.117:3300/0 conn(0x7f57800af760 msgr2=0x7f57800afb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:32.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.866+0000 7f5784ce2640 1 --2- 172.21.15.53:0/2928563856 >> v2:172.21.15.117:3300/0 conn(0x7f57800af760 0x7f57800afb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:32.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.866+0000 7f5784ce2640 1 -- 172.21.15.53:0/2928563856 >> v1:172.21.15.53:6789/0 conn(0x7f578015dae0 legacy=0x7f578006b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:32.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.866+0000 7f5784ce2640 1 -- 172.21.15.53:0/2928563856 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5780070ed0 con 0x7f57800700e0 2023-06-10T19:02:32.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.866+0000 7f5777fff640 1 -- 172.21.15.53:0/2928563856 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1030670844 0 0) 0x7f57800b0070 con 0x7f578015dae0 2023-06-10T19:02:32.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.870+0000 7f5784ce2640 1 --2- 172.21.15.53:0/2928563856 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57800700e0 0x7f57800c82a0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f578006e9d0 tx=0x7f577001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88a1468a05b95995 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:32.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.870+0000 7f5777fff640 1 -- 172.21.15.53:0/2928563856 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57700aa430 con 0x7f57800700e0 2023-06-10T19:02:32.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.870+0000 7f5777fff640 1 -- 172.21.15.53:0/2928563856 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57700aa590 con 0x7f57800700e0 2023-06-10T19:02:32.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.870+0000 7f5777fff640 1 -- 172.21.15.53:0/2928563856 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57700aa920 con 0x7f57800700e0 2023-06-10T19:02:32.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.870+0000 7f5787747640 1 -- 172.21.15.53:0/2928563856 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57800700e0 msgr2=0x7f57800c82a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:32.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.870+0000 7f5787747640 1 --2- 172.21.15.53:0/2928563856 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57800700e0 0x7f57800c82a0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f578006e9d0 tx=0x7f577001c4d0 comp rx=0 tx=0).stop 2023-06-10T19:02:32.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.870+0000 7f5787747640 1 -- 172.21.15.53:0/2928563856 shutdown_connections 2023-06-10T19:02:32.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.870+0000 7f5787747640 1 --2- 172.21.15.53:0/2928563856 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57800700e0 0x7f57800c82a0 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:32.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.870+0000 7f5787747640 1 --2- 172.21.15.53:0/2928563856 >> v2:172.21.15.117:3300/0 conn(0x7f57800af760 0x7f57800afb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:32.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.870+0000 7f5787747640 1 -- 172.21.15.53:0/2928563856 >> 172.21.15.53:0/2928563856 conn(0x7f578006a0e0 msgr2=0x7f57800cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:32.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.870+0000 7f5787747640 1 -- 172.21.15.53:0/2928563856 shutdown_connections 2023-06-10T19:02:32.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.870+0000 7f5787747640 1 -- 172.21.15.53:0/2928563856 wait complete. 2023-06-10T19:02:32.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.870+0000 7f5787747640 1 Processor -- start 2023-06-10T19:02:32.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.870+0000 7f5787747640 1 -- start start 2023-06-10T19:02:32.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.874+0000 7f5787747640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57800700e0 0x7f57800c43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:32.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.874+0000 7f5787747640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57800af760 0x7f5780153000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:32.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.874+0000 7f5787747640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f578015dae0 0x7f57801538a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:32.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.874+0000 7f5787747640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f578015e490 con 0x7f57800700e0 2023-06-10T19:02:32.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.874+0000 7f5787747640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f578015aea0 con 0x7f578015dae0 2023-06-10T19:02:32.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.874+0000 7f5787747640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f578015b180 con 0x7f57800af760 2023-06-10T19:02:32.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.874+0000 7f57854e3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57800700e0 0x7f57800c43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:32.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.874+0000 7f57854e3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57800700e0 0x7f57800c43a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48406/0 (socket says 172.21.15.53:48406) 2023-06-10T19:02:32.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.874+0000 7f57854e3640 1 -- 172.21.15.53:0/1535006132 learned_addr learned my addr 172.21.15.53:0/1535006132 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:32.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.874+0000 7f5785ce4640 1 --2- 172.21.15.53:0/1535006132 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f578015dae0 0x7f57801538a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:32.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.874+0000 7f5784ce2640 1 --2- 172.21.15.53:0/1535006132 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57800af760 0x7f5780153000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:32.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.874+0000 7f57854e3640 1 -- 172.21.15.53:0/1535006132 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57800af760 msgr2=0x7f5780153000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:32.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.874+0000 7f57854e3640 1 --2- 172.21.15.53:0/1535006132 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57800af760 0x7f5780153000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:32.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.874+0000 7f57854e3640 1 -- 172.21.15.53:0/1535006132 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f578015dae0 msgr2=0x7f57801538a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:32.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.874+0000 7f57854e3640 1 --2- 172.21.15.53:0/1535006132 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f578015dae0 0x7f57801538a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:32.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.874+0000 7f57854e3640 1 -- 172.21.15.53:0/1535006132 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57700094d0 con 0x7f57800700e0 2023-06-10T19:02:32.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.874+0000 7f5784ce2640 1 --2- 172.21.15.53:0/1535006132 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57800af760 0x7f5780153000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:02:32.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.874+0000 7f57854e3640 1 --2- 172.21.15.53:0/1535006132 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57800700e0 0x7f57800c43a0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f577c007e40 tx=0x7f577c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:32.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.874+0000 7f5775ffb640 1 -- 172.21.15.53:0/1535006132 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f577c014620 con 0x7f57800700e0 2023-06-10T19:02:32.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.874+0000 7f5775ffb640 1 -- 172.21.15.53:0/1535006132 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f577c00ee90 con 0x7f57800700e0 2023-06-10T19:02:32.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.874+0000 7f5787747640 1 -- 172.21.15.53:0/1535006132 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f578015b460 con 0x7f57800700e0 2023-06-10T19:02:32.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.874+0000 7f5775ffb640 1 -- 172.21.15.53:0/1535006132 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f577c0149c0 con 0x7f57800700e0 2023-06-10T19:02:32.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.874+0000 7f5787747640 1 -- 172.21.15.53:0/1535006132 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f578015ba20 con 0x7f57800700e0 2023-06-10T19:02:32.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.874+0000 7f5787747640 1 -- 172.21.15.53:0/1535006132 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f578004d790 con 0x7f57800700e0 2023-06-10T19:02:32.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.874+0000 7f5775ffb640 1 -- 172.21.15.53:0/1535006132 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f577c014b20 con 0x7f57800700e0 2023-06-10T19:02:32.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.874+0000 7f5775ffb640 1 --2- 172.21.15.53:0/1535006132 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5764066280 0x7f5764068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:32.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.874+0000 7f5775ffb640 1 -- 172.21.15.53:0/1535006132 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6264+0+0 (secure 0 0 0) 0x7f577c0855f0 con 0x7f57800700e0 2023-06-10T19:02:32.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.874+0000 7f5784ce2640 1 --2- 172.21.15.53:0/1535006132 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5764066280 0x7f5764068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:32.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.878+0000 7f5784ce2640 1 --2- 172.21.15.53:0/1535006132 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5764066280 0x7f5764068730 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f57700ae000 tx=0x7f57700a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:32.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:32.878+0000 7f5775ffb640 1 -- 172.21.15.53:0/1535006132 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f577c052a80 con 0x7f57800700e0 2023-06-10T19:02:33.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.038+0000 7f5787747640 1 -- 172.21.15.53:0/1535006132 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f57800c8330 con 0x7f57800700e0 2023-06-10T19:02:33.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.038+0000 7f5775ffb640 1 -- 172.21.15.53:0/1535006132 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v97) v1 ==== 92+0+10 (secure 0 0 0) 0x7f577c0560a0 con 0x7f57800700e0 2023-06-10T19:02:33.041 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-06-10T19:02:33.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.042+0000 7f5787747640 1 -- 172.21.15.53:0/1535006132 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5764066280 msgr2=0x7f5764068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:33.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.042+0000 7f5787747640 1 --2- 172.21.15.53:0/1535006132 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5764066280 0x7f5764068730 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f57700ae000 tx=0x7f57700a7000 comp rx=0 tx=0).stop 2023-06-10T19:02:33.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.042+0000 7f5787747640 1 -- 172.21.15.53:0/1535006132 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57800700e0 msgr2=0x7f57800c43a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:33.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.042+0000 7f5787747640 1 --2- 172.21.15.53:0/1535006132 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57800700e0 0x7f57800c43a0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f577c007e40 tx=0x7f577c00e4b0 comp rx=0 tx=0).stop 2023-06-10T19:02:33.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.042+0000 7f5787747640 1 -- 172.21.15.53:0/1535006132 shutdown_connections 2023-06-10T19:02:33.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.042+0000 7f5787747640 1 --2- 172.21.15.53:0/1535006132 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5764066280 0x7f5764068730 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:33.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.042+0000 7f5787747640 1 --2- 172.21.15.53:0/1535006132 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f578015dae0 0x7f57801538a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:33.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.042+0000 7f5787747640 1 --2- 172.21.15.53:0/1535006132 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57800af760 0x7f5780153000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:33.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.042+0000 7f5787747640 1 --2- 172.21.15.53:0/1535006132 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57800700e0 0x7f57800c43a0 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:33.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.042+0000 7f5787747640 1 -- 172.21.15.53:0/1535006132 >> 172.21.15.53:0/1535006132 conn(0x7f578006a0e0 msgr2=0x7f5780158dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:33.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.042+0000 7f5787747640 1 -- 172.21.15.53:0/1535006132 shutdown_connections 2023-06-10T19:02:33.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.042+0000 7f5787747640 1 -- 172.21.15.53:0/1535006132 wait complete. 2023-06-10T19:02:33.061 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-10T19:02:33.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.190+0000 7f800c7be640 1 Processor -- start 2023-06-10T19:02:33.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.190+0000 7f800c7be640 1 -- start start 2023-06-10T19:02:33.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.190+0000 7f800c7be640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f80040c82a0 0x7f80040c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:33.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.190+0000 7f800c7be640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f80040af760 0x7f80040afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:33.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.190+0000 7f800c7be640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f800406b090 con 0x7f80040c9fa0 2023-06-10T19:02:33.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.190+0000 7f800c7be640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80040b0120 con 0x7f80040c82a0 2023-06-10T19:02:33.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.190+0000 7f800c7be640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80040ca370 con 0x7f80040af760 2023-06-10T19:02:33.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.190+0000 7f800a55a640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f80040c9fa0 0x7f800406bae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:36180/0 (socket says 172.21.15.53:36180) 2023-06-10T19:02:33.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.190+0000 7f800a55a640 1 -- 172.21.15.53:0/2397090135 learned_addr learned my addr 172.21.15.53:0/2397090135 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:02:33.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.190+0000 7f8009d59640 1 --2- 172.21.15.53:0/2397090135 >> v2:172.21.15.53:3300/0 conn(0x7f80040c82a0 0x7f80040c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:33.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.190+0000 7f8009558640 1 -- 172.21.15.53:0/2397090135 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 851267583 0 0) 0x7f800406b090 con 0x7f80040c9fa0 2023-06-10T19:02:33.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.190+0000 7f800ad5b640 1 --2- 172.21.15.53:0/2397090135 >> v2:172.21.15.117:3300/0 conn(0x7f80040af760 0x7f80040afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:33.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.190+0000 7f8009558640 1 -- 172.21.15.53:0/2397090135 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ff0003530 con 0x7f80040c9fa0 2023-06-10T19:02:33.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.190+0000 7f8009d59640 1 -- 172.21.15.53:0/2397090135 >> v2:172.21.15.117:3300/0 conn(0x7f80040af760 msgr2=0x7f80040afbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:33.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.190+0000 7f8009d59640 1 --2- 172.21.15.53:0/2397090135 >> v2:172.21.15.117:3300/0 conn(0x7f80040af760 0x7f80040afbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:33.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.190+0000 7f8009d59640 1 -- 172.21.15.53:0/2397090135 >> v1:172.21.15.53:6789/0 conn(0x7f80040c9fa0 legacy=0x7f800406bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:33.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.190+0000 7f8009d59640 1 -- 172.21.15.53:0/2397090135 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8004070d50 con 0x7f80040c82a0 2023-06-10T19:02:33.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.190+0000 7f800ad5b640 1 --2- 172.21.15.53:0/2397090135 >> v2:172.21.15.117:3300/0 conn(0x7f80040af760 0x7f80040afbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:02:33.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.194+0000 7f8009d59640 1 --2- 172.21.15.53:0/2397090135 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80040c82a0 0x7f80040c86f0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f800406fc20 tx=0x7f7ff401c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deda620c2b503232 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:33.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.194+0000 7f8009558640 1 -- 172.21.15.53:0/2397090135 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff40ac600 con 0x7f80040c82a0 2023-06-10T19:02:33.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.194+0000 7f8009558640 1 -- 172.21.15.53:0/2397090135 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ff40a8050 con 0x7f80040c82a0 2023-06-10T19:02:33.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.194+0000 7f8009558640 1 -- 172.21.15.53:0/2397090135 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff40ac960 con 0x7f80040c82a0 2023-06-10T19:02:33.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.194+0000 7f800c7be640 1 -- 172.21.15.53:0/2397090135 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80040c82a0 msgr2=0x7f80040c86f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:33.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.194+0000 7f800c7be640 1 --2- 172.21.15.53:0/2397090135 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80040c82a0 0x7f80040c86f0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f800406fc20 tx=0x7f7ff401c3a0 comp rx=0 tx=0).stop 2023-06-10T19:02:33.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.194+0000 7f800c7be640 1 -- 172.21.15.53:0/2397090135 shutdown_connections 2023-06-10T19:02:33.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.194+0000 7f800c7be640 1 --2- 172.21.15.53:0/2397090135 >> v2:172.21.15.117:3300/0 conn(0x7f80040af760 0x7f80040afbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:33.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.194+0000 7f800c7be640 1 --2- 172.21.15.53:0/2397090135 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80040c82a0 0x7f80040c86f0 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:33.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.194+0000 7f800c7be640 1 -- 172.21.15.53:0/2397090135 >> 172.21.15.53:0/2397090135 conn(0x7f800406a0e0 msgr2=0x7f80040cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:33.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.194+0000 7f800c7be640 1 -- 172.21.15.53:0/2397090135 shutdown_connections 2023-06-10T19:02:33.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.194+0000 7f800c7be640 1 -- 172.21.15.53:0/2397090135 wait complete. 2023-06-10T19:02:33.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.198+0000 7f800c7be640 1 Processor -- start 2023-06-10T19:02:33.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.198+0000 7f800c7be640 1 -- start start 2023-06-10T19:02:33.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.198+0000 7f800c7be640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80040af760 0x7f800414e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:33.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.198+0000 7f800c7be640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f80040c82a0 0x7f8004158420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:33.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.198+0000 7f800c7be640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80040c9fa0 0x7f800414ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:33.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.198+0000 7f800c7be640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8004159770 con 0x7f80040af760 2023-06-10T19:02:33.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.198+0000 7f800c7be640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f800414e130 con 0x7f80040c9fa0 2023-06-10T19:02:33.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.198+0000 7f800c7be640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80041591b0 con 0x7f80040c82a0 2023-06-10T19:02:33.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.198+0000 7f800a55a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80040af760 0x7f800414e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:33.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.198+0000 7f800a55a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80040af760 0x7f800414e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48420/0 (socket says 172.21.15.53:48420) 2023-06-10T19:02:33.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.198+0000 7f800a55a640 1 -- 172.21.15.53:0/3984248637 learned_addr learned my addr 172.21.15.53:0/3984248637 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:33.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.198+0000 7f8009d59640 1 --2- 172.21.15.53:0/3984248637 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f80040c82a0 0x7f8004158420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:33.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.198+0000 7f800ad5b640 1 --2- 172.21.15.53:0/3984248637 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80040c9fa0 0x7f800414ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:33.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.198+0000 7f800a55a640 1 -- 172.21.15.53:0/3984248637 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f80040c82a0 msgr2=0x7f8004158420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:33.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.198+0000 7f800a55a640 1 --2- 172.21.15.53:0/3984248637 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f80040c82a0 0x7f8004158420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:33.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.198+0000 7f800a55a640 1 -- 172.21.15.53:0/3984248637 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80040c9fa0 msgr2=0x7f800414ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:33.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.198+0000 7f800a55a640 1 --2- 172.21.15.53:0/3984248637 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80040c9fa0 0x7f800414ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:33.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.198+0000 7f800a55a640 1 -- 172.21.15.53:0/3984248637 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ff4009420 con 0x7f80040af760 2023-06-10T19:02:33.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.198+0000 7f8009d59640 1 --2- 172.21.15.53:0/3984248637 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f80040c82a0 0x7f8004158420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:02:33.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.198+0000 7f800ad5b640 1 --2- 172.21.15.53:0/3984248637 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80040c9fa0 0x7f800414ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:02:33.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.198+0000 7f800a55a640 1 --2- 172.21.15.53:0/3984248637 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80040af760 0x7f800414e5c0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f800000c3c0 tx=0x7f800000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:33.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.198+0000 7f7ffaffd640 1 -- 172.21.15.53:0/3984248637 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8000005cf0 con 0x7f80040af760 2023-06-10T19:02:33.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.198+0000 7f7ffaffd640 1 -- 172.21.15.53:0/3984248637 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8000005e50 con 0x7f80040af760 2023-06-10T19:02:33.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.198+0000 7f7ffaffd640 1 -- 172.21.15.53:0/3984248637 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80000072f0 con 0x7f80040af760 2023-06-10T19:02:33.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.198+0000 7f800c7be640 1 -- 172.21.15.53:0/3984248637 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8004159490 con 0x7f80040af760 2023-06-10T19:02:33.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.198+0000 7f800c7be640 1 -- 172.21.15.53:0/3984248637 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f800414eb00 con 0x7f80040af760 2023-06-10T19:02:33.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.198+0000 7f800c7be640 1 -- 172.21.15.53:0/3984248637 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f800414dc20 con 0x7f80040af760 2023-06-10T19:02:33.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.198+0000 7f7ffaffd640 1 -- 172.21.15.53:0/3984248637 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8000007450 con 0x7f80040af760 2023-06-10T19:02:33.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.202+0000 7f7ffaffd640 1 --2- 172.21.15.53:0/3984248637 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7fe8066280 0x7f7fe8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:33.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.202+0000 7f7ffaffd640 1 -- 172.21.15.53:0/3984248637 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6264+0+0 (secure 0 0 0) 0x7f80000833d0 con 0x7f80040af760 2023-06-10T19:02:33.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.202+0000 7f8009d59640 1 --2- 172.21.15.53:0/3984248637 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7fe8066280 0x7f7fe8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:33.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.202+0000 7f8009d59640 1 --2- 172.21.15.53:0/3984248637 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7fe8066280 0x7f7fe8068730 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f7ff40ae000 tx=0x7f7ff4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:33.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.206+0000 7f7ffaffd640 1 -- 172.21.15.53:0/3984248637 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f800414dc20 con 0x7f80040af760 2023-06-10T19:02:33.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.358+0000 7f800c7be640 1 -- 172.21.15.53:0/3984248637 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f800414dc20 con 0x7f80040af760 2023-06-10T19:02:33.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.358+0000 7f7ffaffd640 1 -- 172.21.15.53:0/3984248637 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v97) v1 ==== 104+0+11 (secure 0 0 0) 0x7f800414dc20 con 0x7f80040af760 2023-06-10T19:02:33.362 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-06-10T19:02:33.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.362+0000 7f800c7be640 1 -- 172.21.15.53:0/3984248637 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7fe8066280 msgr2=0x7f7fe8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:33.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.362+0000 7f800c7be640 1 --2- 172.21.15.53:0/3984248637 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7fe8066280 0x7f7fe8068730 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f7ff40ae000 tx=0x7f7ff4008040 comp rx=0 tx=0).stop 2023-06-10T19:02:33.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.362+0000 7f800c7be640 1 -- 172.21.15.53:0/3984248637 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80040af760 msgr2=0x7f800414e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:33.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.362+0000 7f800c7be640 1 --2- 172.21.15.53:0/3984248637 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80040af760 0x7f800414e5c0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f800000c3c0 tx=0x7f800000c880 comp rx=0 tx=0).stop 2023-06-10T19:02:33.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.362+0000 7f800c7be640 1 -- 172.21.15.53:0/3984248637 shutdown_connections 2023-06-10T19:02:33.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.362+0000 7f800c7be640 1 --2- 172.21.15.53:0/3984248637 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7fe8066280 0x7f7fe8068730 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:33.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.362+0000 7f800c7be640 1 --2- 172.21.15.53:0/3984248637 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80040c9fa0 0x7f800414ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:33.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.362+0000 7f800c7be640 1 --2- 172.21.15.53:0/3984248637 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f80040c82a0 0x7f8004158420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:33.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.362+0000 7f800c7be640 1 --2- 172.21.15.53:0/3984248637 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80040af760 0x7f800414e5c0 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:33.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.362+0000 7f800c7be640 1 -- 172.21.15.53:0/3984248637 >> 172.21.15.53:0/3984248637 conn(0x7f800406a0e0 msgr2=0x7f80040b0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:33.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.362+0000 7f800c7be640 1 -- 172.21.15.53:0/3984248637 shutdown_connections 2023-06-10T19:02:33.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.362+0000 7f800c7be640 1 -- 172.21.15.53:0/3984248637 wait complete. 2023-06-10T19:02:33.381 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-10T19:02:33.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.510+0000 7f648d965640 1 Processor -- start 2023-06-10T19:02:33.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.510+0000 7f648d965640 1 -- start start 2023-06-10T19:02:33.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.510+0000 7f648d965640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f64880afe70 0x7f64880cb820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:33.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.510+0000 7f648d965640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64880ac910 con 0x7f648806c350 2023-06-10T19:02:33.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.510+0000 7f648d965640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64880cbd60 con 0x7f64880c97d0 2023-06-10T19:02:33.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.510+0000 7f648d965640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64880ca5c0 con 0x7f64880afe70 2023-06-10T19:02:33.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.510+0000 7f64877fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f64880afe70 0x7f64880cb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:33.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.510+0000 7f64867fc640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f648806c350 0x7f64880af760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:36194/0 (socket says 172.21.15.53:36194) 2023-06-10T19:02:33.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.510+0000 7f64867fc640 1 -- 172.21.15.53:0/3734294582 learned_addr learned my addr 172.21.15.53:0/3734294582 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:02:33.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.510+0000 7f64877fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f64880afe70 0x7f64880cb820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48434/0 (socket says 172.21.15.53:48434) 2023-06-10T19:02:33.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.510+0000 7f64877fe640 1 -- 172.21.15.53:0/3734294582 >> v1:172.21.15.117:6789/0 conn(0x7f64880c97d0 legacy=0x7f64880ac200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:33.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.510+0000 7f64877fe640 1 -- 172.21.15.53:0/3734294582 >> v1:172.21.15.53:6789/0 conn(0x7f648806c350 legacy=0x7f64880af760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:33.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.510+0000 7f64877fe640 1 -- 172.21.15.53:0/3734294582 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64880abd70 con 0x7f64880afe70 2023-06-10T19:02:33.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.510+0000 7f6485ffb640 1 -- 172.21.15.53:0/3734294582 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1046761454 0 0) 0x7f64880ac910 con 0x7f648806c350 2023-06-10T19:02:33.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.514+0000 7f64877fe640 1 --2- 172.21.15.53:0/3734294582 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64880afe70 0x7f64880cb820 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f64800097c0 tx=0x7f648001c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=487b3668807684a7 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:33.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.514+0000 7f6485ffb640 1 -- 172.21.15.53:0/3734294582 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64800ab600 con 0x7f64880afe70 2023-06-10T19:02:33.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.514+0000 7f6485ffb640 1 -- 172.21.15.53:0/3734294582 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64800a7050 con 0x7f64880afe70 2023-06-10T19:02:33.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.514+0000 7f6485ffb640 1 -- 172.21.15.53:0/3734294582 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64800ab980 con 0x7f64880afe70 2023-06-10T19:02:33.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.514+0000 7f648d965640 1 -- 172.21.15.53:0/3734294582 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64880afe70 msgr2=0x7f64880cb820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:33.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.514+0000 7f648d965640 1 --2- 172.21.15.53:0/3734294582 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64880afe70 0x7f64880cb820 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f64800097c0 tx=0x7f648001c360 comp rx=0 tx=0).stop 2023-06-10T19:02:33.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.514+0000 7f648d965640 1 -- 172.21.15.53:0/3734294582 shutdown_connections 2023-06-10T19:02:33.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.514+0000 7f648d965640 1 --2- 172.21.15.53:0/3734294582 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64880afe70 0x7f64880cb820 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:33.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.514+0000 7f648d965640 1 -- 172.21.15.53:0/3734294582 >> 172.21.15.53:0/3734294582 conn(0x7f648806a0e0 msgr2=0x7f64880cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:33.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.514+0000 7f648d965640 1 -- 172.21.15.53:0/3734294582 shutdown_connections 2023-06-10T19:02:33.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.514+0000 7f648d965640 1 -- 172.21.15.53:0/3734294582 wait complete. 2023-06-10T19:02:33.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.514+0000 7f648d965640 1 Processor -- start 2023-06-10T19:02:33.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.514+0000 7f648d965640 1 -- start start 2023-06-10T19:02:33.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.518+0000 7f648d965640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f648806c350 0x7f64880b3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:33.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.518+0000 7f648d965640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64880afe70 0x7f64880c39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:33.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.518+0000 7f648d965640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64880c97d0 0x7f6488151c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:33.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.518+0000 7f648d965640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64881561d0 con 0x7f64880c97d0 2023-06-10T19:02:33.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.518+0000 7f648d965640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64880b3b50 con 0x7f648806c350 2023-06-10T19:02:33.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.518+0000 7f648d965640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6488155550 con 0x7f64880afe70 2023-06-10T19:02:33.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.518+0000 7f64877fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64880c97d0 0x7f6488151c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:33.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.518+0000 7f64877fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64880c97d0 0x7f6488151c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48442/0 (socket says 172.21.15.53:48442) 2023-06-10T19:02:33.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.518+0000 7f64877fe640 1 -- 172.21.15.53:0/3776209018 learned_addr learned my addr 172.21.15.53:0/3776209018 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:33.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.518+0000 7f6486ffd640 1 --2- 172.21.15.53:0/3776209018 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f648806c350 0x7f64880b3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:33.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.518+0000 7f64867fc640 1 --2- 172.21.15.53:0/3776209018 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64880afe70 0x7f64880c39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:33.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.518+0000 7f64877fe640 1 -- 172.21.15.53:0/3776209018 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64880afe70 msgr2=0x7f64880c39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:33.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.518+0000 7f64877fe640 1 --2- 172.21.15.53:0/3776209018 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64880afe70 0x7f64880c39d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:33.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.518+0000 7f64877fe640 1 -- 172.21.15.53:0/3776209018 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f648806c350 msgr2=0x7f64880b3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:33.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.518+0000 7f64877fe640 1 --2- 172.21.15.53:0/3776209018 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f648806c350 0x7f64880b3610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:33.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.518+0000 7f64877fe640 1 -- 172.21.15.53:0/3776209018 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6480009420 con 0x7f64880c97d0 2023-06-10T19:02:33.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.518+0000 7f64867fc640 1 --2- 172.21.15.53:0/3776209018 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64880afe70 0x7f64880c39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:02:33.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.518+0000 7f64877fe640 1 --2- 172.21.15.53:0/3776209018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64880c97d0 0x7f6488151c30 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f648001c840 tx=0x7f6480019100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:33.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.518+0000 7f646ffff640 1 -- 172.21.15.53:0/3776209018 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6480004030 con 0x7f64880c97d0 2023-06-10T19:02:33.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.518+0000 7f646ffff640 1 -- 172.21.15.53:0/3776209018 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6480004190 con 0x7f64880c97d0 2023-06-10T19:02:33.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.518+0000 7f648d965640 1 -- 172.21.15.53:0/3776209018 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6488155830 con 0x7f64880c97d0 2023-06-10T19:02:33.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.518+0000 7f646ffff640 1 -- 172.21.15.53:0/3776209018 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6480004520 con 0x7f64880c97d0 2023-06-10T19:02:33.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.518+0000 7f648d965640 1 -- 172.21.15.53:0/3776209018 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6488155df0 con 0x7f64880c97d0 2023-06-10T19:02:33.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.518+0000 7f648d965640 1 -- 172.21.15.53:0/3776209018 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6488156310 con 0x7f64880c97d0 2023-06-10T19:02:33.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.518+0000 7f646ffff640 1 -- 172.21.15.53:0/3776209018 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f64800b2040 con 0x7f64880c97d0 2023-06-10T19:02:33.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.518+0000 7f646ffff640 1 --2- 172.21.15.53:0/3776209018 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6474066280 0x7f6474068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:33.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.518+0000 7f646ffff640 1 -- 172.21.15.53:0/3776209018 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6264+0+0 (secure 0 0 0) 0x7f648011dc10 con 0x7f64880c97d0 2023-06-10T19:02:33.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.518+0000 7f6486ffd640 1 --2- 172.21.15.53:0/3776209018 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6474066280 0x7f6474068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:33.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.522+0000 7f6486ffd640 1 --2- 172.21.15.53:0/3776209018 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6474066280 0x7f6474068730 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f64880afe40 tx=0x7f6478009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:33.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.522+0000 7f646ffff640 1 -- 172.21.15.53:0/3776209018 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6488156310 con 0x7f64880c97d0 2023-06-10T19:02:33.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.674+0000 7f648d965640 1 -- 172.21.15.53:0/3776209018 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6488156310 con 0x7f64880c97d0 2023-06-10T19:02:33.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.674+0000 7f646ffff640 1 -- 172.21.15.53:0/3776209018 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v97) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6488156310 con 0x7f64880c97d0 2023-06-10T19:02:33.676 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-06-10T19:02:33.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.674+0000 7f648d965640 1 -- 172.21.15.53:0/3776209018 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6474066280 msgr2=0x7f6474068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:33.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.674+0000 7f648d965640 1 --2- 172.21.15.53:0/3776209018 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6474066280 0x7f6474068730 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f64880afe40 tx=0x7f6478009040 comp rx=0 tx=0).stop 2023-06-10T19:02:33.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.674+0000 7f648d965640 1 -- 172.21.15.53:0/3776209018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64880c97d0 msgr2=0x7f6488151c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:33.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.674+0000 7f648d965640 1 --2- 172.21.15.53:0/3776209018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64880c97d0 0x7f6488151c30 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f648001c840 tx=0x7f6480019100 comp rx=0 tx=0).stop 2023-06-10T19:02:33.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.674+0000 7f648d965640 1 -- 172.21.15.53:0/3776209018 shutdown_connections 2023-06-10T19:02:33.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.674+0000 7f648d965640 1 --2- 172.21.15.53:0/3776209018 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6474066280 0x7f6474068730 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:33.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.674+0000 7f648d965640 1 --2- 172.21.15.53:0/3776209018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64880c97d0 0x7f6488151c30 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:33.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.674+0000 7f648d965640 1 --2- 172.21.15.53:0/3776209018 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64880afe70 0x7f64880c39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:33.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.674+0000 7f648d965640 1 --2- 172.21.15.53:0/3776209018 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f648806c350 0x7f64880b3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:33.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.674+0000 7f648d965640 1 -- 172.21.15.53:0/3776209018 >> 172.21.15.53:0/3776209018 conn(0x7f648806a0e0 msgr2=0x7f64880c8280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:33.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.674+0000 7f648d965640 1 -- 172.21.15.53:0/3776209018 shutdown_connections 2023-06-10T19:02:33.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.674+0000 7f648d965640 1 -- 172.21.15.53:0/3776209018 wait complete. 2023-06-10T19:02:33.694 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-10T19:02:33.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.814+0000 7f947a335640 1 Processor -- start 2023-06-10T19:02:33.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.814+0000 7f947a335640 1 -- start start 2023-06-10T19:02:33.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.814+0000 7f947a335640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f94741571a0 0x7f94740c9f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:33.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.814+0000 7f947a335640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9474071190 con 0x7f94740afee0 2023-06-10T19:02:33.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.814+0000 7f947a335640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94740ca440 con 0x7f9474070100 2023-06-10T19:02:33.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.814+0000 7f947a335640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9474070580 con 0x7f94741571a0 2023-06-10T19:02:33.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.814+0000 7f94788d2640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f94740afee0 0x7f94740c83f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:36210/0 (socket says 172.21.15.53:36210) 2023-06-10T19:02:33.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.814+0000 7f94788d2640 1 -- 172.21.15.53:0/68993722 learned_addr learned my addr 172.21.15.53:0/68993722 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:02:33.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.814+0000 7f9473fff640 1 --2- 172.21.15.53:0/68993722 >> v2:172.21.15.117:3300/0 conn(0x7f94741571a0 0x7f94740c9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:33.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.814+0000 7f9472ffd640 1 -- 172.21.15.53:0/68993722 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3746731680 0 0) 0x7f9474071190 con 0x7f94740afee0 2023-06-10T19:02:33.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.814+0000 7f9472ffd640 1 -- 172.21.15.53:0/68993722 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f945c003530 con 0x7f94740afee0 2023-06-10T19:02:33.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.814+0000 7f9472ffd640 1 -- 172.21.15.53:0/68993722 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3899053905 0 0) 0x7f945c003530 con 0x7f94740afee0 2023-06-10T19:02:33.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.814+0000 7f9472ffd640 1 -- 172.21.15.53:0/68993722 >> v2:172.21.15.117:3300/0 conn(0x7f94741571a0 msgr2=0x7f94740c9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:33.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.814+0000 7f9472ffd640 1 --2- 172.21.15.53:0/68993722 >> v2:172.21.15.117:3300/0 conn(0x7f94741571a0 0x7f94740c9f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:33.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.814+0000 7f9472ffd640 1 -- 172.21.15.53:0/68993722 >> v1:172.21.15.117:6789/0 conn(0x7f9474070100 legacy=0x7f94740af7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:33.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.814+0000 7f9472ffd640 1 -- 172.21.15.53:0/68993722 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9474070860 con 0x7f94740afee0 2023-06-10T19:02:33.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.814+0000 7f9472ffd640 1 -- 172.21.15.53:0/68993722 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f946c001a00 con 0x7f94740afee0 2023-06-10T19:02:33.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.814+0000 7f9472ffd640 1 -- 172.21.15.53:0/68993722 >> v1:172.21.15.53:6789/0 conn(0x7f94740afee0 legacy=0x7f94740c83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:33.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.814+0000 7f9472ffd640 1 --2- 172.21.15.53:0/68993722 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f945c003980 0x7f945c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:33.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.814+0000 7f9472ffd640 1 --2- 172.21.15.53:0/68993722 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f945c0047d0 0x7f945c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:33.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.814+0000 7f9472ffd640 1 --2- 172.21.15.53:0/68993722 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f945c005180 0x7f945c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:33.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.814+0000 7f9472ffd640 1 -- 172.21.15.53:0/68993722 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9474070580 con 0x7f945c0047d0 2023-06-10T19:02:33.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.814+0000 7f9472ffd640 1 -- 172.21.15.53:0/68993722 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f945c00c000 con 0x7f945c005180 2023-06-10T19:02:33.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.814+0000 7f9472ffd640 1 -- 172.21.15.53:0/68993722 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f945c00c1c0 con 0x7f945c003980 2023-06-10T19:02:33.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.818+0000 7f94737fe640 1 --2- 172.21.15.53:0/68993722 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f945c0047d0 0x7f945c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:33.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.818+0000 7f9473fff640 1 --2- 172.21.15.53:0/68993722 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f945c003980 0x7f945c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:33.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.818+0000 7f94788d2640 1 --2- 172.21.15.53:0/68993722 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f945c005180 0x7f945c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:33.824 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.818+0000 7f94737fe640 1 -- 172.21.15.53:0/68993722 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f945c003980 msgr2=0x7f945c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:33.824 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.818+0000 7f94737fe640 1 --2- 172.21.15.53:0/68993722 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f945c003980 0x7f945c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:33.824 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.818+0000 7f94737fe640 1 -- 172.21.15.53:0/68993722 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f945c005180 msgr2=0x7f945c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:33.824 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.818+0000 7f94737fe640 1 --2- 172.21.15.53:0/68993722 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f945c005180 0x7f945c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:33.824 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.818+0000 7f94788d2640 1 -- 172.21.15.53:0/68993722 reap_dead start 2023-06-10T19:02:33.824 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.818+0000 7f94737fe640 1 -- 172.21.15.53:0/68993722 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f945c003530 con 0x7f945c0047d0 2023-06-10T19:02:33.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.818+0000 7f94737fe640 1 --2- 172.21.15.53:0/68993722 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f945c0047d0 0x7f945c004c40 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f9468001750 tx=0x7f946801c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2509fde5d1d07e21 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:33.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.818+0000 7f9472ffd640 1 -- 172.21.15.53:0/68993722 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94680052d0 con 0x7f945c0047d0 2023-06-10T19:02:33.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.818+0000 7f9472ffd640 1 -- 172.21.15.53:0/68993722 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94680a7050 con 0x7f945c0047d0 2023-06-10T19:02:33.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.818+0000 7f9472ffd640 1 -- 172.21.15.53:0/68993722 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9468003600 con 0x7f945c0047d0 2023-06-10T19:02:33.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.818+0000 7f947a335640 1 -- 172.21.15.53:0/68993722 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f945c0047d0 msgr2=0x7f945c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:33.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.818+0000 7f947a335640 1 --2- 172.21.15.53:0/68993722 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f945c0047d0 0x7f945c004c40 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f9468001750 tx=0x7f946801c3a0 comp rx=0 tx=0).stop 2023-06-10T19:02:33.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.818+0000 7f947a335640 1 -- 172.21.15.53:0/68993722 shutdown_connections 2023-06-10T19:02:33.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.818+0000 7f947a335640 1 --2- 172.21.15.53:0/68993722 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f945c0047d0 0x7f945c004c40 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:33.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.818+0000 7f947a335640 1 -- 172.21.15.53:0/68993722 >> 172.21.15.53:0/68993722 conn(0x7f94740ce9e0 msgr2=0x7f94740ca7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:33.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.818+0000 7f947a335640 1 -- 172.21.15.53:0/68993722 shutdown_connections 2023-06-10T19:02:33.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.818+0000 7f947a335640 1 -- 172.21.15.53:0/68993722 wait complete. 2023-06-10T19:02:33.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.822+0000 7f947a335640 1 Processor -- start 2023-06-10T19:02:33.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.822+0000 7f947a335640 1 -- start start 2023-06-10T19:02:33.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.822+0000 7f947a335640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f945c0047d0 0x7f94741ee880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:33.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.822+0000 7f947a335640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94740b29c0 0x7f94740c6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:33.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.822+0000 7f947a335640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f947414fb80 0x7f9474150000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:33.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.822+0000 7f947a335640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94741eedc0 con 0x7f945c0047d0 2023-06-10T19:02:33.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.822+0000 7f947a335640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9474150540 con 0x7f947414fb80 2023-06-10T19:02:33.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.822+0000 7f947a335640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94740c6660 con 0x7f94740b29c0 2023-06-10T19:02:33.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.822+0000 7f9473fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f945c0047d0 0x7f94741ee880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:33.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.822+0000 7f9473fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f945c0047d0 0x7f94741ee880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48464/0 (socket says 172.21.15.53:48464) 2023-06-10T19:02:33.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.822+0000 7f9473fff640 1 -- 172.21.15.53:0/16347980 learned_addr learned my addr 172.21.15.53:0/16347980 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:33.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.822+0000 7f94788d2640 1 --2- 172.21.15.53:0/16347980 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f947414fb80 0x7f9474150000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:33.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.822+0000 7f94737fe640 1 --2- 172.21.15.53:0/16347980 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94740b29c0 0x7f94740c6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:33.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.822+0000 7f9473fff640 1 -- 172.21.15.53:0/16347980 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94740b29c0 msgr2=0x7f94740c6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:33.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.822+0000 7f9473fff640 1 --2- 172.21.15.53:0/16347980 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94740b29c0 0x7f94740c6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:33.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.822+0000 7f9473fff640 1 -- 172.21.15.53:0/16347980 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f947414fb80 msgr2=0x7f9474150000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:33.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.822+0000 7f9473fff640 1 --2- 172.21.15.53:0/16347980 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f947414fb80 0x7f9474150000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:33.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.822+0000 7f9473fff640 1 -- 172.21.15.53:0/16347980 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94740b3a20 con 0x7f945c0047d0 2023-06-10T19:02:33.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.822+0000 7f94737fe640 1 --2- 172.21.15.53:0/16347980 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94740b29c0 0x7f94740c6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:02:33.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.822+0000 7f9473fff640 1 --2- 172.21.15.53:0/16347980 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f945c0047d0 0x7f94741ee880 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f94640116d0 tx=0x7f9464011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:33.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.822+0000 7f9470ff9640 1 -- 172.21.15.53:0/16347980 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f946400f960 con 0x7f945c0047d0 2023-06-10T19:02:33.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.822+0000 7f9470ff9640 1 -- 172.21.15.53:0/16347980 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f946400fac0 con 0x7f945c0047d0 2023-06-10T19:02:33.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.822+0000 7f947a335640 1 -- 172.21.15.53:0/16347980 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94740b2330 con 0x7f945c0047d0 2023-06-10T19:02:33.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.822+0000 7f9470ff9640 1 -- 172.21.15.53:0/16347980 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f946400fe30 con 0x7f945c0047d0 2023-06-10T19:02:33.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.822+0000 7f947a335640 1 -- 172.21.15.53:0/16347980 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94740b3180 con 0x7f945c0047d0 2023-06-10T19:02:33.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.822+0000 7f947a335640 1 -- 172.21.15.53:0/16347980 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f947404d790 con 0x7f945c0047d0 2023-06-10T19:02:33.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.822+0000 7f9470ff9640 1 -- 172.21.15.53:0/16347980 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9464015460 con 0x7f945c0047d0 2023-06-10T19:02:33.832 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.826+0000 7f9470ff9640 1 --2- 172.21.15.53:0/16347980 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9460066280 0x7f9460068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:33.832 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.826+0000 7f9470ff9640 1 -- 172.21.15.53:0/16347980 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6264+0+0 (secure 0 0 0) 0x7f9464084700 con 0x7f945c0047d0 2023-06-10T19:02:33.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.826+0000 7f94737fe640 1 --2- 172.21.15.53:0/16347980 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9460066280 0x7f9460068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:33.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.826+0000 7f94737fe640 1 --2- 172.21.15.53:0/16347980 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9460066280 0x7f9460068730 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f94740ad780 tx=0x7f94680011a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:33.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.830+0000 7f9470ff9640 1 -- 172.21.15.53:0/16347980 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9464051bf0 con 0x7f945c0047d0 2023-06-10T19:02:33.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.994+0000 7f947a335640 1 -- 172.21.15.53:0/16347980 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f94740ccff0 con 0x7f945c0047d0 2023-06-10T19:02:33.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.994+0000 7f9470ff9640 1 -- 172.21.15.53:0/16347980 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v97) v1 ==== 80+0+122 (secure 0 0 0) 0x7f9464055210 con 0x7f945c0047d0 2023-06-10T19:02:33.998 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:6833/1894654263 2023-06-11T19:02:29.480972+0000 2023-06-10T19:02:33.998 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:6832/1894654263 2023-06-11T19:02:29.480972+0000 2023-06-10T19:02:33.998 INFO:teuthology.orchestra.run.smithi053.stderr:listed 2 entries 2023-06-10T19:02:34.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.998+0000 7f947a335640 1 -- 172.21.15.53:0/16347980 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9460066280 msgr2=0x7f9460068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:34.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.998+0000 7f947a335640 1 --2- 172.21.15.53:0/16347980 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9460066280 0x7f9460068730 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f94740ad780 tx=0x7f94680011a0 comp rx=0 tx=0).stop 2023-06-10T19:02:34.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.998+0000 7f947a335640 1 -- 172.21.15.53:0/16347980 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f945c0047d0 msgr2=0x7f94741ee880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:34.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.998+0000 7f947a335640 1 --2- 172.21.15.53:0/16347980 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f945c0047d0 0x7f94741ee880 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f94640116d0 tx=0x7f9464011b90 comp rx=0 tx=0).stop 2023-06-10T19:02:34.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.998+0000 7f947a335640 1 -- 172.21.15.53:0/16347980 shutdown_connections 2023-06-10T19:02:34.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.998+0000 7f947a335640 1 --2- 172.21.15.53:0/16347980 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9460066280 0x7f9460068730 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:34.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.998+0000 7f947a335640 1 --2- 172.21.15.53:0/16347980 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f947414fb80 0x7f9474150000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:34.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.998+0000 7f947a335640 1 --2- 172.21.15.53:0/16347980 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94740b29c0 0x7f94740c6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:34.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.998+0000 7f947a335640 1 --2- 172.21.15.53:0/16347980 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f945c0047d0 0x7f94741ee880 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:34.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.998+0000 7f947a335640 1 -- 172.21.15.53:0/16347980 >> 172.21.15.53:0/16347980 conn(0x7f94740ce9e0 msgr2=0x7f94740c8040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:34.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.998+0000 7f947a335640 1 -- 172.21.15.53:0/16347980 shutdown_connections 2023-06-10T19:02:34.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:33.998+0000 7f947a335640 1 -- 172.21.15.53:0/16347980 wait complete. 2023-06-10T19:02:34.016 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi053.front.sepia.ceph.com... 2023-06-10T19:02:34.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:02:34.017 DEBUG:teuthology.orchestra.run.smithi053:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-06-10T19:02:34.030 INFO:teuthology.orchestra.run:waiting for 300 2023-06-10T19:02:34.030 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi053.front.sepia.ceph.com 2023-06-10T19:02:34.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:02:34.031 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-06-10T19:02:34.076 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2023-06-10T19:02:34.243 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:34.242+0000 7fef5702e640 1 Processor -- start 2023-06-10T19:02:34.244 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:34.242+0000 7fef5702e640 1 -- start start 2023-06-10T19:02:34.244 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:34.242+0000 7fef5702e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fef500c9fa0 0x7fef5006bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:34.245 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:34.242+0000 7fef5702e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef500af760 0x7fef500afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:34.245 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:34.242+0000 7fef5702e640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef5006b090 con 0x7fef5006c020 2023-06-10T19:02:34.245 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:34.242+0000 7fef5702e640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef500b0120 con 0x7fef500c9fa0 2023-06-10T19:02:34.245 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:34.242+0000 7fef5702e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef500ca370 con 0x7fef500af760 2023-06-10T19:02:34.245 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:34.242+0000 7fef54dca640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fef500c9fa0 0x7fef5006bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:34.245 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:34.242+0000 7fef4ffff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fef5006c020 0x7fef500c82a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:36220/0 (socket says 172.21.15.53:36220) 2023-06-10T19:02:34.245 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:34.242+0000 7fef4ffff640 1 -- 172.21.15.53:0/3694887572 learned_addr learned my addr 172.21.15.53:0/3694887572 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:02:34.246 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:34.242+0000 7fef555cb640 1 --2- 172.21.15.53:0/3694887572 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef500af760 0x7fef500afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:34.246 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:34.242+0000 7fef54dca640 1 -- 172.21.15.53:0/3694887572 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef500af760 msgr2=0x7fef500afbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:34.246 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:34.242+0000 7fef54dca640 1 --2- 172.21.15.53:0/3694887572 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef500af760 0x7fef500afbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:34.247 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:34.242+0000 7fef54dca640 1 -- 172.21.15.53:0/3694887572 >> v1:172.21.15.53:6789/0 conn(0x7fef5006c020 legacy=0x7fef500c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:34.247 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:34.242+0000 7fef54dca640 1 -- 172.21.15.53:0/3694887572 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef50070d50 con 0x7fef500c9fa0 2023-06-10T19:02:34.247 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:34.242+0000 7fef4f7fe640 1 -- 172.21.15.53:0/3694887572 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2304427895 0 0) 0x7fef5006b090 con 0x7fef5006c020 2023-06-10T19:02:34.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:34.246+0000 7fef54dca640 1 --2- 172.21.15.53:0/3694887572 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef500c9fa0 0x7fef5006bae0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7fef440097c0 tx=0x7fef4401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=271423d99a2b54c1 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:34.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:34.246+0000 7fef4f7fe640 1 -- 172.21.15.53:0/3694887572 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef440ac620 con 0x7fef500c9fa0 2023-06-10T19:02:34.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:34.246+0000 7fef4f7fe640 1 -- 172.21.15.53:0/3694887572 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef440ac780 con 0x7fef500c9fa0 2023-06-10T19:02:34.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:34.246+0000 7fef4f7fe640 1 -- 172.21.15.53:0/3694887572 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef440acb10 con 0x7fef500c9fa0 2023-06-10T19:02:34.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:34.246+0000 7fef5702e640 1 -- 172.21.15.53:0/3694887572 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef500c9fa0 msgr2=0x7fef5006bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:34.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:34.246+0000 7fef5702e640 1 --2- 172.21.15.53:0/3694887572 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef500c9fa0 0x7fef5006bae0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7fef440097c0 tx=0x7fef4401c3c0 comp rx=0 tx=0).stop 2023-06-10T19:02:34.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:34.246+0000 7fef5702e640 1 -- 172.21.15.53:0/3694887572 shutdown_connections 2023-06-10T19:02:34.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:34.246+0000 7fef5702e640 1 --2- 172.21.15.53:0/3694887572 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef500af760 0x7fef500afbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:34.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:34.246+0000 7fef5702e640 1 --2- 172.21.15.53:0/3694887572 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef500c9fa0 0x7fef5006bae0 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:34.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:34.246+0000 7fef5702e640 1 -- 172.21.15.53:0/3694887572 >> 172.21.15.53:0/3694887572 conn(0x7fef5006a0e0 msgr2=0x7fef500cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:34.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:34.246+0000 7fef5702e640 1 -- 172.21.15.53:0/3694887572 shutdown_connections 2023-06-10T19:02:34.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:34.246+0000 7fef5702e640 1 -- 172.21.15.53:0/3694887572 wait complete. 2023-06-10T19:02:34.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:34.246+0000 7fef5702e640 1 Processor -- start 2023-06-10T19:02:34.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:34.246+0000 7fef5702e640 1 -- start start 2023-06-10T19:02:34.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:34.246+0000 7fef5702e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef5006c020 0x7fef50145850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:34.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:34.246+0000 7fef5702e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef500af760 0x7fef501634a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:34.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:34.246+0000 7fef5702e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef500c9fa0 0x7fef501449e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:34.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:34.246+0000 7fef5702e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef50143730 con 0x7fef500af760 2023-06-10T19:02:34.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:34.246+0000 7fef5702e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef500c1380 con 0x7fef5006c020 2023-06-10T19:02:34.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:34.246+0000 7fef5702e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef50145d90 con 0x7fef500c9fa0 2023-06-10T19:02:34.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:34.246+0000 7fef4ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef500af760 0x7fef501634a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:34.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:34.246+0000 7fef4ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef500af760 0x7fef501634a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48490/0 (socket says 172.21.15.53:48490) 2023-06-10T19:02:34.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:34.246+0000 7fef4ffff640 1 -- 172.21.15.53:0/2203848180 learned_addr learned my addr 172.21.15.53:0/2203848180 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:34.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:34.250+0000 7fef555cb640 1 --2- 172.21.15.53:0/2203848180 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef500c9fa0 0x7fef501449e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:34.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:34.250+0000 7fef54dca640 1 --2- 172.21.15.53:0/2203848180 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef5006c020 0x7fef50145850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:34.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:34.250+0000 7fef4ffff640 1 -- 172.21.15.53:0/2203848180 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef500c9fa0 msgr2=0x7fef501449e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:34.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:34.250+0000 7fef4ffff640 1 --2- 172.21.15.53:0/2203848180 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef500c9fa0 0x7fef501449e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:34.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:34.250+0000 7fef4ffff640 1 -- 172.21.15.53:0/2203848180 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef5006c020 msgr2=0x7fef50145850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:34.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:34.250+0000 7fef4ffff640 1 --2- 172.21.15.53:0/2203848180 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef5006c020 0x7fef50145850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:34.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:34.250+0000 7fef4ffff640 1 -- 172.21.15.53:0/2203848180 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef44009420 con 0x7fef500af760 2023-06-10T19:02:34.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:34.250+0000 7fef555cb640 1 --2- 172.21.15.53:0/2203848180 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef500c9fa0 0x7fef501449e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:02:34.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:34.250+0000 7fef54dca640 1 --2- 172.21.15.53:0/2203848180 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef5006c020 0x7fef50145850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:02:34.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:34.250+0000 7fef4ffff640 1 --2- 172.21.15.53:0/2203848180 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef500af760 0x7fef501634a0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7fef3c00c4b0 tx=0x7fef3c00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:34.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:34.250+0000 7fef4d7fa640 1 -- 172.21.15.53:0/2203848180 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef3c0074e0 con 0x7fef500af760 2023-06-10T19:02:34.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:34.250+0000 7fef4d7fa640 1 -- 172.21.15.53:0/2203848180 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef3c007660 con 0x7fef500af760 2023-06-10T19:02:34.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:34.250+0000 7fef4d7fa640 1 -- 172.21.15.53:0/2203848180 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef3c004a30 con 0x7fef500af760 2023-06-10T19:02:34.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:34.250+0000 7fef5702e640 1 -- 172.21.15.53:0/2203848180 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef50143940 con 0x7fef500af760 2023-06-10T19:02:34.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:34.250+0000 7fef5702e640 1 -- 172.21.15.53:0/2203848180 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef50143f00 con 0x7fef500af760 2023-06-10T19:02:34.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:34.250+0000 7fef5702e640 1 -- 172.21.15.53:0/2203848180 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef5004d790 con 0x7fef500af760 2023-06-10T19:02:34.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:34.250+0000 7fef4d7fa640 1 -- 172.21.15.53:0/2203848180 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fef3c004b90 con 0x7fef500af760 2023-06-10T19:02:34.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:34.250+0000 7fef4d7fa640 1 --2- 172.21.15.53:0/2203848180 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fef340662b0 0x7fef34068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:34.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:34.250+0000 7fef4d7fa640 1 -- 172.21.15.53:0/2203848180 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6264+0+0 (secure 0 0 0) 0x7fef3c082f60 con 0x7fef500af760 2023-06-10T19:02:34.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:34.250+0000 7fef54dca640 1 --2- 172.21.15.53:0/2203848180 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fef340662b0 0x7fef34068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:34.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:34.254+0000 7fef54dca640 1 --2- 172.21.15.53:0/2203848180 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fef340662b0 0x7fef34068760 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fef440ae000 tx=0x7fef440a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:34.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:34.254+0000 7fef4d7fa640 1 -- 172.21.15.53:0/2203848180 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fef3c050280 con 0x7fef500af760 2023-06-10T19:02:34.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:34.446+0000 7fef5702e640 1 -- 172.21.15.53:0/2203848180 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7fef500ce670 con 0x7fef500af760 2023-06-10T19:02:35.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.142+0000 7fef4d7fa640 1 -- 172.21.15.53:0/2203848180 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v51) v1 ==== 162+0+0 (secure 0 0 0) 0x7fef3c018070 con 0x7fef500af760 2023-06-10T19:02:35.145 INFO:teuthology.orchestra.run.smithi053.stderr:cephfs marked joinable; MDS may join as newly active. 2023-06-10T19:02:35.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.146+0000 7fef5702e640 1 -- 172.21.15.53:0/2203848180 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fef340662b0 msgr2=0x7fef34068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:35.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.146+0000 7fef5702e640 1 --2- 172.21.15.53:0/2203848180 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fef340662b0 0x7fef34068760 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fef440ae000 tx=0x7fef440a7000 comp rx=0 tx=0).stop 2023-06-10T19:02:35.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.146+0000 7fef5702e640 1 -- 172.21.15.53:0/2203848180 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef500af760 msgr2=0x7fef501634a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:35.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.146+0000 7fef5702e640 1 --2- 172.21.15.53:0/2203848180 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef500af760 0x7fef501634a0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7fef3c00c4b0 tx=0x7fef3c00c970 comp rx=0 tx=0).stop 2023-06-10T19:02:35.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.146+0000 7fef5702e640 1 -- 172.21.15.53:0/2203848180 shutdown_connections 2023-06-10T19:02:35.150 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.146+0000 7fef5702e640 1 --2- 172.21.15.53:0/2203848180 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fef340662b0 0x7fef34068760 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:35.150 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.146+0000 7fef5702e640 1 --2- 172.21.15.53:0/2203848180 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef500c9fa0 0x7fef501449e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:35.150 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.146+0000 7fef5702e640 1 --2- 172.21.15.53:0/2203848180 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef500af760 0x7fef501634a0 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:35.150 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.146+0000 7fef5702e640 1 --2- 172.21.15.53:0/2203848180 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef5006c020 0x7fef50145850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:35.150 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.146+0000 7fef5702e640 1 -- 172.21.15.53:0/2203848180 >> 172.21.15.53:0/2203848180 conn(0x7fef5006a0e0 msgr2=0x7fef500b2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:35.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.146+0000 7fef5702e640 1 -- 172.21.15.53:0/2203848180 shutdown_connections 2023-06-10T19:02:35.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.146+0000 7fef5702e640 1 -- 172.21.15.53:0/2203848180 wait complete. 2023-06-10T19:02:35.174 INFO:tasks.cephfs.test_client_recovery:Waiting for reconnect... 2023-06-10T19:02:35.175 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:02:35.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.290+0000 7fd585b89640 1 Processor -- start 2023-06-10T19:02:35.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.290+0000 7fd585b89640 1 -- start start 2023-06-10T19:02:35.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.294+0000 7fd585b89640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd5800af720 0x7fd580070e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:35.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.294+0000 7fd585b89640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5800afba0 con 0x7fd58006b090 2023-06-10T19:02:35.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.294+0000 7fd585b89640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5800b3760 con 0x7fd5800b3390 2023-06-10T19:02:35.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.294+0000 7fd585b89640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5800c82f0 con 0x7fd5800af720 2023-06-10T19:02:35.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.294+0000 7fd57effd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd5800af720 0x7fd580070e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:35.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.294+0000 7fd57ffff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fd58006b090 0x7fd5800c9800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:36224/0 (socket says 172.21.15.53:36224) 2023-06-10T19:02:35.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.294+0000 7fd57effd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd5800af720 0x7fd580070e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48496/0 (socket says 172.21.15.53:48496) 2023-06-10T19:02:35.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.294+0000 7fd57ffff640 1 -- 172.21.15.53:0/2281952209 learned_addr learned my addr 172.21.15.53:0/2281952209 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:02:35.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.294+0000 7fd57effd640 1 -- 172.21.15.53:0/2281952209 >> v1:172.21.15.117:6789/0 conn(0x7fd5800b3390 legacy=0x7fd5800c8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:35.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.294+0000 7fd57effd640 1 -- 172.21.15.53:0/2281952209 >> v1:172.21.15.53:6789/0 conn(0x7fd58006b090 legacy=0x7fd5800c9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:35.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.294+0000 7fd57e7fc640 1 -- 172.21.15.53:0/2281952209 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1060179036 0 0) 0x7fd5800afba0 con 0x7fd58006b090 2023-06-10T19:02:35.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.294+0000 7fd57effd640 1 -- 172.21.15.53:0/2281952209 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5800afe20 con 0x7fd5800af720 2023-06-10T19:02:35.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.294+0000 7fd57effd640 1 --2- 172.21.15.53:0/2281952209 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5800af720 0x7fd580070e30 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7fd5740097c0 tx=0x7fd57401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=214e0cbe9115d007 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:35.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.294+0000 7fd57e7fc640 1 -- 172.21.15.53:0/2281952209 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5740ab600 con 0x7fd5800af720 2023-06-10T19:02:35.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.294+0000 7fd57e7fc640 1 -- 172.21.15.53:0/2281952209 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5740a7050 con 0x7fd5800af720 2023-06-10T19:02:35.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.294+0000 7fd57e7fc640 1 -- 172.21.15.53:0/2281952209 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5740ab980 con 0x7fd5800af720 2023-06-10T19:02:35.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.294+0000 7fd585b89640 1 -- 172.21.15.53:0/2281952209 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5800af720 msgr2=0x7fd580070e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:35.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.294+0000 7fd585b89640 1 --2- 172.21.15.53:0/2281952209 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5800af720 0x7fd580070e30 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7fd5740097c0 tx=0x7fd57401c440 comp rx=0 tx=0).stop 2023-06-10T19:02:35.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.294+0000 7fd585b89640 1 -- 172.21.15.53:0/2281952209 shutdown_connections 2023-06-10T19:02:35.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.294+0000 7fd585b89640 1 --2- 172.21.15.53:0/2281952209 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5800af720 0x7fd580070e30 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:35.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.294+0000 7fd585b89640 1 -- 172.21.15.53:0/2281952209 >> 172.21.15.53:0/2281952209 conn(0x7fd58006a0d0 msgr2=0x7fd5800ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:35.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.294+0000 7fd585b89640 1 -- 172.21.15.53:0/2281952209 shutdown_connections 2023-06-10T19:02:35.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.294+0000 7fd585b89640 1 -- 172.21.15.53:0/2281952209 wait complete. 2023-06-10T19:02:35.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.298+0000 7fd585b89640 1 Processor -- start 2023-06-10T19:02:35.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.298+0000 7fd585b89640 1 -- start start 2023-06-10T19:02:35.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.298+0000 7fd585b89640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd58006b090 0x7fd58014e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:35.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.298+0000 7fd585b89640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5800af720 0x7fd580155d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:35.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.298+0000 7fd585b89640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5800b3390 0x7fd5800700c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:35.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.298+0000 7fd585b89640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd580157220 con 0x7fd5800b3390 2023-06-10T19:02:35.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.298+0000 7fd585b89640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5801576b0 con 0x7fd58006b090 2023-06-10T19:02:35.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.298+0000 7fd585b89640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd580156610 con 0x7fd5800af720 2023-06-10T19:02:35.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.298+0000 7fd57ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5800b3390 0x7fd5800700c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:35.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.298+0000 7fd57ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5800b3390 0x7fd5800700c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48508/0 (socket says 172.21.15.53:48508) 2023-06-10T19:02:35.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.298+0000 7fd57ffff640 1 -- 172.21.15.53:0/400579984 learned_addr learned my addr 172.21.15.53:0/400579984 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:35.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.298+0000 7fd57effd640 1 --2- 172.21.15.53:0/400579984 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5800af720 0x7fd580155d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:35.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.298+0000 7fd57f7fe640 1 --2- 172.21.15.53:0/400579984 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd58006b090 0x7fd58014e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:35.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.298+0000 7fd57ffff640 1 -- 172.21.15.53:0/400579984 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5800af720 msgr2=0x7fd580155d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:35.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.298+0000 7fd57ffff640 1 --2- 172.21.15.53:0/400579984 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5800af720 0x7fd580155d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:35.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.298+0000 7fd57ffff640 1 -- 172.21.15.53:0/400579984 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd58006b090 msgr2=0x7fd58014e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:35.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.298+0000 7fd57ffff640 1 --2- 172.21.15.53:0/400579984 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd58006b090 0x7fd58014e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:35.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.298+0000 7fd57ffff640 1 -- 172.21.15.53:0/400579984 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd574009420 con 0x7fd5800b3390 2023-06-10T19:02:35.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.298+0000 7fd57ffff640 1 --2- 172.21.15.53:0/400579984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5800b3390 0x7fd5800700c0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7fd57800c780 tx=0x7fd57800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:35.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.298+0000 7fd567fff640 1 -- 172.21.15.53:0/400579984 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd57800ce90 con 0x7fd5800b3390 2023-06-10T19:02:35.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.298+0000 7fd567fff640 1 -- 172.21.15.53:0/400579984 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd57800a640 con 0x7fd5800b3390 2023-06-10T19:02:35.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.298+0000 7fd567fff640 1 -- 172.21.15.53:0/400579984 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd57800a9d0 con 0x7fd5800b3390 2023-06-10T19:02:35.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.298+0000 7fd585b89640 1 -- 172.21.15.53:0/400579984 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5801568f0 con 0x7fd5800b3390 2023-06-10T19:02:35.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.298+0000 7fd585b89640 1 -- 172.21.15.53:0/400579984 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd580156eb0 con 0x7fd5800b3390 2023-06-10T19:02:35.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.298+0000 7fd585b89640 1 -- 172.21.15.53:0/400579984 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd580157390 con 0x7fd5800b3390 2023-06-10T19:02:35.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.302+0000 7fd567fff640 1 -- 172.21.15.53:0/400579984 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd57800ab30 con 0x7fd5800b3390 2023-06-10T19:02:35.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.302+0000 7fd567fff640 1 --2- 172.21.15.53:0/400579984 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd56c066280 0x7fd56c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:35.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.302+0000 7fd567fff640 1 -- 172.21.15.53:0/400579984 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6264+0+0 (secure 0 0 0) 0x7fd5780833f0 con 0x7fd5800b3390 2023-06-10T19:02:35.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.302+0000 7fd57f7fe640 1 --2- 172.21.15.53:0/400579984 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd56c066280 0x7fd56c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:35.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.302+0000 7fd57f7fe640 1 --2- 172.21.15.53:0/400579984 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd56c066280 0x7fd56c068730 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fd570003d60 tx=0x7fd570009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:35.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.306+0000 7fd567fff640 1 -- 172.21.15.53:0/400579984 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd578050700 con 0x7fd5800b3390 2023-06-10T19:02:35.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.482+0000 7fd585b89640 1 -- 172.21.15.53:0/400579984 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd58004d790 con 0x7fd5800b3390 2023-06-10T19:02:35.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.486+0000 7fd567fff640 1 -- 172.21.15.53:0/400579984 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+4680 (secure 0 0 0) 0x7fd578053d20 con 0x7fd5800b3390 2023-06-10T19:02:35.488 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:02:35.488 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":52,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1617157670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1617157670},{"type":"v1","addr":"172.21.15.117:6836","nonce":1617157670}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6113,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3414416090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":3414416090},{"type":"v1","addr":"172.21.15.117:6837","nonce":3414416090}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6718,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2533467097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2533467097},{"type":"v1","addr":"172.21.15.53:6835","nonce":2533467097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:02:02.642809+0000","modified":"2023-06-10T19:02:35.144297+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8127":{"gid":8127,"name":"a","rank":0,"incarnation":52,"state":"up:replay","state_seq":1,"addr":"172.21.15.53:6833/2984379521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2984379521},{"type":"v1","addr":"172.21.15.53:6833","nonce":2984379521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-06-10T19:02:35.488 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 52 2023-06-10T19:02:35.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.486+0000 7fd585b89640 1 -- 172.21.15.53:0/400579984 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd56c066280 msgr2=0x7fd56c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:35.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.486+0000 7fd585b89640 1 --2- 172.21.15.53:0/400579984 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd56c066280 0x7fd56c068730 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fd570003d60 tx=0x7fd570009040 comp rx=0 tx=0).stop 2023-06-10T19:02:35.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.486+0000 7fd585b89640 1 -- 172.21.15.53:0/400579984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5800b3390 msgr2=0x7fd5800700c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:35.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.486+0000 7fd585b89640 1 --2- 172.21.15.53:0/400579984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5800b3390 0x7fd5800700c0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7fd57800c780 tx=0x7fd57800cc40 comp rx=0 tx=0).stop 2023-06-10T19:02:35.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.486+0000 7fd585b89640 1 -- 172.21.15.53:0/400579984 shutdown_connections 2023-06-10T19:02:35.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.486+0000 7fd585b89640 1 --2- 172.21.15.53:0/400579984 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd56c066280 0x7fd56c068730 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:35.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.486+0000 7fd585b89640 1 --2- 172.21.15.53:0/400579984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5800b3390 0x7fd5800700c0 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:35.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.486+0000 7fd585b89640 1 --2- 172.21.15.53:0/400579984 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5800af720 0x7fd580155d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:35.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.486+0000 7fd585b89640 1 --2- 172.21.15.53:0/400579984 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd58006b090 0x7fd58014e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:35.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.486+0000 7fd585b89640 1 -- 172.21.15.53:0/400579984 >> 172.21.15.53:0/400579984 conn(0x7fd58006a0d0 msgr2=0x7fd5800ad700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:35.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.486+0000 7fd585b89640 1 -- 172.21.15.53:0/400579984 shutdown_connections 2023-06-10T19:02:35.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:35.486+0000 7fd585b89640 1 -- 172.21.15.53:0/400579984 wait complete. 2023-06-10T19:02:35.506 DEBUG:tasks.cephfs.filesystem:mapped states ['up:replay'] to None 2023-06-10T19:02:36.507 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:02:36.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.638+0000 7f926f6d2640 1 Processor -- start 2023-06-10T19:02:36.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.638+0000 7f926f6d2640 1 -- start start 2023-06-10T19:02:36.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.638+0000 7f926f6d2640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9268161180 0x7f9268163560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:36.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.638+0000 7f926f6d2640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9268158a90 con 0x7f926806b2f0 2023-06-10T19:02:36.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.638+0000 7f926f6d2640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f926806f780 con 0x7f92680c8d00 2023-06-10T19:02:36.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.638+0000 7f926f6d2640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92680705d0 con 0x7f9268161180 2023-06-10T19:02:36.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.638+0000 7f926d46e640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f926806b2f0 0x7f926806f070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:36240/0 (socket says 172.21.15.53:36240) 2023-06-10T19:02:36.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.638+0000 7f926d46e640 1 -- 172.21.15.53:0/3427158005 learned_addr learned my addr 172.21.15.53:0/3427158005 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:02:36.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.642+0000 7f926dc6f640 1 --2- 172.21.15.53:0/3427158005 >> v2:172.21.15.117:3300/0 conn(0x7f9268161180 0x7f9268163560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:36.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.642+0000 7f925ffff640 1 -- 172.21.15.53:0/3427158005 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 238916705 0 0) 0x7f92640014a0 con 0x7f926806b2f0 2023-06-10T19:02:36.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.642+0000 7f925ffff640 1 -- 172.21.15.53:0/3427158005 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9254003530 con 0x7f926806b2f0 2023-06-10T19:02:36.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.642+0000 7f925ffff640 1 -- 172.21.15.53:0/3427158005 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 354023024 0 0) 0x7f9254003530 con 0x7f926806b2f0 2023-06-10T19:02:36.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.642+0000 7f925ffff640 1 -- 172.21.15.53:0/3427158005 >> v2:172.21.15.117:3300/0 conn(0x7f9268161180 msgr2=0x7f9268163560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:36.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.642+0000 7f925ffff640 1 --2- 172.21.15.53:0/3427158005 >> v2:172.21.15.117:3300/0 conn(0x7f9268161180 0x7f9268163560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:36.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.642+0000 7f925ffff640 1 -- 172.21.15.53:0/3427158005 >> v1:172.21.15.117:6789/0 conn(0x7f92680c8d00 legacy=0x7f926806b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:36.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.642+0000 7f925ffff640 1 -- 172.21.15.53:0/3427158005 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92680cce10 con 0x7f926806b2f0 2023-06-10T19:02:36.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.642+0000 7f925ffff640 1 -- 172.21.15.53:0/3427158005 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f9264001b90 con 0x7f926806b2f0 2023-06-10T19:02:36.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.642+0000 7f925ffff640 1 -- 172.21.15.53:0/3427158005 >> v1:172.21.15.53:6789/0 conn(0x7f926806b2f0 legacy=0x7f926806f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:36.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.642+0000 7f925ffff640 1 --2- 172.21.15.53:0/3427158005 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92540039f0 0x7f9254003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:36.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.642+0000 7f925ffff640 1 --2- 172.21.15.53:0/3427158005 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92540047d0 0x7f9254004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:36.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.642+0000 7f925ffff640 1 --2- 172.21.15.53:0/3427158005 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9254005180 0x7f925400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:36.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.642+0000 7f925ffff640 1 -- 172.21.15.53:0/3427158005 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92680705d0 con 0x7f92540039f0 2023-06-10T19:02:36.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.642+0000 7f925ffff640 1 -- 172.21.15.53:0/3427158005 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f925400c070 con 0x7f9254005180 2023-06-10T19:02:36.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.642+0000 7f925ffff640 1 -- 172.21.15.53:0/3427158005 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f925400c230 con 0x7f92540047d0 2023-06-10T19:02:36.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.642+0000 7f926d46e640 1 --2- 172.21.15.53:0/3427158005 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92540039f0 0x7f9254003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:36.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.642+0000 7f926dc6f640 1 --2- 172.21.15.53:0/3427158005 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9254005180 0x7f925400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:36.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.642+0000 7f926cc6d640 1 --2- 172.21.15.53:0/3427158005 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92540047d0 0x7f9254004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:36.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.642+0000 7f926d46e640 1 -- 172.21.15.53:0/3427158005 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92540047d0 msgr2=0x7f9254004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:36.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.642+0000 7f926d46e640 1 --2- 172.21.15.53:0/3427158005 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92540047d0 0x7f9254004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:36.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.642+0000 7f926d46e640 1 -- 172.21.15.53:0/3427158005 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9254005180 msgr2=0x7f925400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:36.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.642+0000 7f926d46e640 1 --2- 172.21.15.53:0/3427158005 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9254005180 0x7f925400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:36.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.642+0000 7f926d46e640 1 -- 172.21.15.53:0/3427158005 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9254003530 con 0x7f92540039f0 2023-06-10T19:02:36.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.642+0000 7f926dc6f640 1 --2- 172.21.15.53:0/3427158005 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9254005180 0x7f925400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:02:36.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.642+0000 7f926cc6d640 1 --2- 172.21.15.53:0/3427158005 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92540047d0 0x7f9254004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:02:36.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.642+0000 7f926dc6f640 1 -- 172.21.15.53:0/3427158005 reap_dead start 2023-06-10T19:02:36.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.646+0000 7f926d46e640 1 --2- 172.21.15.53:0/3427158005 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92540039f0 0x7f9254003e00 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f926400a810 tx=0x7f926401fa80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d234ae01b848bab0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:36.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.646+0000 7f925ffff640 1 -- 172.21.15.53:0/3427158005 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92640aa6b0 con 0x7f92540039f0 2023-06-10T19:02:36.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.646+0000 7f925ffff640 1 -- 172.21.15.53:0/3427158005 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92640aa830 con 0x7f92540039f0 2023-06-10T19:02:36.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.646+0000 7f925ffff640 1 -- 172.21.15.53:0/3427158005 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92640aac20 con 0x7f92540039f0 2023-06-10T19:02:36.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.646+0000 7f926f6d2640 1 -- 172.21.15.53:0/3427158005 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92540039f0 msgr2=0x7f9254003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:36.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.646+0000 7f926f6d2640 1 --2- 172.21.15.53:0/3427158005 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92540039f0 0x7f9254003e00 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f926400a810 tx=0x7f926401fa80 comp rx=0 tx=0).stop 2023-06-10T19:02:36.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.646+0000 7f926f6d2640 1 -- 172.21.15.53:0/3427158005 shutdown_connections 2023-06-10T19:02:36.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.646+0000 7f926f6d2640 1 --2- 172.21.15.53:0/3427158005 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92540039f0 0x7f9254003e00 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:36.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.646+0000 7f926f6d2640 1 -- 172.21.15.53:0/3427158005 >> 172.21.15.53:0/3427158005 conn(0x7f926806a0d0 msgr2=0x7f92680ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:36.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.646+0000 7f926f6d2640 1 -- 172.21.15.53:0/3427158005 shutdown_connections 2023-06-10T19:02:36.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.646+0000 7f926f6d2640 1 -- 172.21.15.53:0/3427158005 wait complete. 2023-06-10T19:02:36.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.646+0000 7f926f6d2640 1 Processor -- start 2023-06-10T19:02:36.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.646+0000 7f926f6d2640 1 -- start start 2023-06-10T19:02:36.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.646+0000 7f926f6d2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92540039f0 0x7f92680ab860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:36.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.646+0000 7f926f6d2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9268148380 0x7f92680abda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:36.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.646+0000 7f926f6d2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f92681f0dc0 0x7f92680af790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:36.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.646+0000 7f926f6d2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92680c7dc0 con 0x7f92540039f0 2023-06-10T19:02:36.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.646+0000 7f926f6d2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92680ac420 con 0x7f92681f0dc0 2023-06-10T19:02:36.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.646+0000 7f926f6d2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92680ac700 con 0x7f9268148380 2023-06-10T19:02:36.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.646+0000 7f926d46e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92540039f0 0x7f92680ab860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:36.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.646+0000 7f926d46e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92540039f0 0x7f92680ab860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48518/0 (socket says 172.21.15.53:48518) 2023-06-10T19:02:36.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.646+0000 7f926d46e640 1 -- 172.21.15.53:0/1200209307 learned_addr learned my addr 172.21.15.53:0/1200209307 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:36.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.646+0000 7f926cc6d640 1 --2- 172.21.15.53:0/1200209307 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9268148380 0x7f92680abda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:36.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.646+0000 7f926dc6f640 1 --2- 172.21.15.53:0/1200209307 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f92681f0dc0 0x7f92680af790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:36.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.646+0000 7f926d46e640 1 -- 172.21.15.53:0/1200209307 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9268148380 msgr2=0x7f92680abda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:36.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.646+0000 7f926d46e640 1 --2- 172.21.15.53:0/1200209307 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9268148380 0x7f92680abda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:36.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.646+0000 7f926d46e640 1 -- 172.21.15.53:0/1200209307 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f92681f0dc0 msgr2=0x7f92680af790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:36.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.646+0000 7f926d46e640 1 --2- 172.21.15.53:0/1200209307 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f92681f0dc0 0x7f92680af790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:36.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.646+0000 7f926d46e640 1 -- 172.21.15.53:0/1200209307 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9268156c00 con 0x7f92540039f0 2023-06-10T19:02:36.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.646+0000 7f926d46e640 1 --2- 172.21.15.53:0/1200209307 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92540039f0 0x7f92680ab860 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f926401f8b0 tx=0x7f9254005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:36.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.650+0000 7f925dffb640 1 -- 172.21.15.53:0/1200209307 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92640aa4b0 con 0x7f92540039f0 2023-06-10T19:02:36.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.650+0000 7f925dffb640 1 -- 172.21.15.53:0/1200209307 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92640aa610 con 0x7f92540039f0 2023-06-10T19:02:36.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.650+0000 7f926f6d2640 1 -- 172.21.15.53:0/1200209307 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9268156ee0 con 0x7f92540039f0 2023-06-10T19:02:36.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.650+0000 7f925dffb640 1 -- 172.21.15.53:0/1200209307 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9264001b50 con 0x7f92540039f0 2023-06-10T19:02:36.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.650+0000 7f926f6d2640 1 -- 172.21.15.53:0/1200209307 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92680afcd0 con 0x7f92540039f0 2023-06-10T19:02:36.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.650+0000 7f926f6d2640 1 -- 172.21.15.53:0/1200209307 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92680ac870 con 0x7f92540039f0 2023-06-10T19:02:36.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.650+0000 7f925dffb640 1 -- 172.21.15.53:0/1200209307 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f92640aa9a0 con 0x7f92540039f0 2023-06-10T19:02:36.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.650+0000 7f925dffb640 1 --2- 172.21.15.53:0/1200209307 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f924c0662b0 0x7f924c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:36.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.650+0000 7f925dffb640 1 -- 172.21.15.53:0/1200209307 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6264+0+0 (secure 0 0 0) 0x7f9264121070 con 0x7f92540039f0 2023-06-10T19:02:36.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.650+0000 7f926cc6d640 1 --2- 172.21.15.53:0/1200209307 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f924c0662b0 0x7f924c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:36.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.650+0000 7f926cc6d640 1 --2- 172.21.15.53:0/1200209307 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f924c0662b0 0x7f924c068760 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f92680ce6a0 tx=0x7f9258009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:36.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.654+0000 7f925dffb640 1 -- 172.21.15.53:0/1200209307 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f92640ee420 con 0x7f92540039f0 2023-06-10T19:02:36.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.842+0000 7f926f6d2640 1 -- 172.21.15.53:0/1200209307 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9268158a90 con 0x7f92540039f0 2023-06-10T19:02:36.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.846+0000 7f925dffb640 1 -- 172.21.15.53:0/1200209307 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+4683 (secure 0 0 0) 0x7f9268158a90 con 0x7f92540039f0 2023-06-10T19:02:36.847 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:02:36.848 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1617157670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1617157670},{"type":"v1","addr":"172.21.15.117:6836","nonce":1617157670}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6113,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3414416090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":3414416090},{"type":"v1","addr":"172.21.15.117:6837","nonce":3414416090}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6718,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2533467097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2533467097},{"type":"v1","addr":"172.21.15.53:6835","nonce":2533467097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:02:02.642809+0000","modified":"2023-06-10T19:02:36.149418+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8127":{"gid":8127,"name":"a","rank":0,"incarnation":52,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.53:6833/2984379521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2984379521},{"type":"v1","addr":"172.21.15.53:6833","nonce":2984379521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-06-10T19:02:36.848 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 53 2023-06-10T19:02:36.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.846+0000 7f926f6d2640 1 -- 172.21.15.53:0/1200209307 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f924c0662b0 msgr2=0x7f924c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:36.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.846+0000 7f926f6d2640 1 --2- 172.21.15.53:0/1200209307 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f924c0662b0 0x7f924c068760 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f92680ce6a0 tx=0x7f9258009040 comp rx=0 tx=0).stop 2023-06-10T19:02:36.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.846+0000 7f926f6d2640 1 -- 172.21.15.53:0/1200209307 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92540039f0 msgr2=0x7f92680ab860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:36.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.846+0000 7f926f6d2640 1 --2- 172.21.15.53:0/1200209307 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92540039f0 0x7f92680ab860 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f926401f8b0 tx=0x7f9254005800 comp rx=0 tx=0).stop 2023-06-10T19:02:36.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.846+0000 7f926f6d2640 1 -- 172.21.15.53:0/1200209307 shutdown_connections 2023-06-10T19:02:36.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.846+0000 7f926f6d2640 1 --2- 172.21.15.53:0/1200209307 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f924c0662b0 0x7f924c068760 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:36.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.846+0000 7f926f6d2640 1 --2- 172.21.15.53:0/1200209307 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f92681f0dc0 0x7f92680af790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:36.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.846+0000 7f926f6d2640 1 --2- 172.21.15.53:0/1200209307 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9268148380 0x7f92680abda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:36.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.846+0000 7f926f6d2640 1 --2- 172.21.15.53:0/1200209307 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92540039f0 0x7f92680ab860 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:36.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.846+0000 7f926f6d2640 1 -- 172.21.15.53:0/1200209307 >> 172.21.15.53:0/1200209307 conn(0x7f926806a0d0 msgr2=0x7f926806f070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:36.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.846+0000 7f926f6d2640 1 -- 172.21.15.53:0/1200209307 shutdown_connections 2023-06-10T19:02:36.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.846+0000 7f926f6d2640 1 -- 172.21.15.53:0/1200209307 wait complete. 2023-06-10T19:02:36.867 DEBUG:tasks.cephfs.filesystem:mapped states ['up:reconnect'] to up:reconnect 2023-06-10T19:02:36.867 DEBUG:tasks.cephfs.filesystem:reached state 'up:reconnect' in 1.692638635635376s 2023-06-10T19:02:36.868 INFO:tasks.cephfs.test_client_recovery:Waiting for active... 2023-06-10T19:02:36.868 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:02:36.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.982+0000 7f78de3db640 1 Processor -- start 2023-06-10T19:02:36.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.982+0000 7f78de3db640 1 -- start start 2023-06-10T19:02:36.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.982+0000 7f78de3db640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78d8159690 0x7f78d8070950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:36.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.982+0000 7f78de3db640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78d80cb080 con 0x7f78d8159a60 2023-06-10T19:02:36.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.982+0000 7f78de3db640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78d80cb320 con 0x7f78d80b0f30 2023-06-10T19:02:36.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.982+0000 7f78de3db640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78d8070e90 con 0x7f78d8159690 2023-06-10T19:02:36.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.982+0000 7f78dc978640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f78d8159a60 0x7f78d80c2900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:36246/0 (socket says 172.21.15.53:36246) 2023-06-10T19:02:36.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.982+0000 7f78dc978640 1 -- 172.21.15.53:0/3918922611 learned_addr learned my addr 172.21.15.53:0/3918922611 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:02:36.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.982+0000 7f78d7fff640 1 --2- 172.21.15.53:0/3918922611 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78d8159690 0x7f78d8070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:36.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.982+0000 7f78d6ffd640 1 -- 172.21.15.53:0/3918922611 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2786474956 0 0) 0x7f78d80cb080 con 0x7f78d8159a60 2023-06-10T19:02:36.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.982+0000 7f78d6ffd640 1 -- 172.21.15.53:0/3918922611 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78c0003530 con 0x7f78d8159a60 2023-06-10T19:02:36.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.982+0000 7f78d6ffd640 1 -- 172.21.15.53:0/3918922611 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2472174789 0 0) 0x7f78c0003530 con 0x7f78d8159a60 2023-06-10T19:02:36.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.982+0000 7f78d6ffd640 1 -- 172.21.15.53:0/3918922611 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78d8159690 msgr2=0x7f78d8070950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:36.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.982+0000 7f78d6ffd640 1 --2- 172.21.15.53:0/3918922611 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78d8159690 0x7f78d8070950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:36.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.982+0000 7f78d6ffd640 1 -- 172.21.15.53:0/3918922611 >> v1:172.21.15.117:6789/0 conn(0x7f78d80b0f30 legacy=0x7f78d80cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:36.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.982+0000 7f78d6ffd640 1 -- 172.21.15.53:0/3918922611 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78d80cb600 con 0x7f78d8159a60 2023-06-10T19:02:36.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.982+0000 7f78d6ffd640 1 -- 172.21.15.53:0/3918922611 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f78d0001a00 con 0x7f78d8159a60 2023-06-10T19:02:36.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.982+0000 7f78d6ffd640 1 -- 172.21.15.53:0/3918922611 >> v1:172.21.15.53:6789/0 conn(0x7f78d8159a60 legacy=0x7f78d80c2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:36.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.982+0000 7f78d6ffd640 1 --2- 172.21.15.53:0/3918922611 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78d8159690 0x7f78c0003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:36.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.982+0000 7f78d6ffd640 1 --2- 172.21.15.53:0/3918922611 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78c0003fa0 0x7f78c00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:36.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.982+0000 7f78d6ffd640 1 --2- 172.21.15.53:0/3918922611 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f78c0004d10 0x7f78c0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:36.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.982+0000 7f78d6ffd640 1 -- 172.21.15.53:0/3918922611 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d8070e90 con 0x7f78c0004d10 2023-06-10T19:02:36.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.982+0000 7f78d6ffd640 1 -- 172.21.15.53:0/3918922611 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78c000bad0 con 0x7f78c0003fa0 2023-06-10T19:02:36.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.982+0000 7f78d6ffd640 1 -- 172.21.15.53:0/3918922611 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78c000bc90 con 0x7f78d8159690 2023-06-10T19:02:36.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.982+0000 7f78dc978640 1 --2- 172.21.15.53:0/3918922611 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f78c0004d10 0x7f78c0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:36.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.982+0000 7f78d7fff640 1 --2- 172.21.15.53:0/3918922611 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78d8159690 0x7f78c0003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:36.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.982+0000 7f78d77fe640 1 --2- 172.21.15.53:0/3918922611 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78c0003fa0 0x7f78c00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:36.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.982+0000 7f78dc978640 1 -- 172.21.15.53:0/3918922611 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78d8159690 msgr2=0x7f78c0003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:36.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.982+0000 7f78dc978640 1 --2- 172.21.15.53:0/3918922611 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78d8159690 0x7f78c0003a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:36.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.982+0000 7f78dc978640 1 -- 172.21.15.53:0/3918922611 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78c0003fa0 msgr2=0x7f78c00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:36.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.982+0000 7f78dc978640 1 --2- 172.21.15.53:0/3918922611 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78c0003fa0 0x7f78c00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:36.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.982+0000 7f78dc978640 1 -- 172.21.15.53:0/3918922611 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78c0003530 con 0x7f78c0004d10 2023-06-10T19:02:36.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.982+0000 7f78d7fff640 1 --2- 172.21.15.53:0/3918922611 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78d8159690 0x7f78c0003a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:02:36.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.986+0000 7f78d77fe640 1 --2- 172.21.15.53:0/3918922611 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78c0003fa0 0x7f78c00047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:02:36.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.986+0000 7f78dc978640 1 --2- 172.21.15.53:0/3918922611 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f78c0004d10 0x7f78c0005180 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f78d00013e0 tx=0x7f78d001d300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0b0f8082218dba server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:36.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.986+0000 7f78d6ffd640 1 -- 172.21.15.53:0/3918922611 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d00ad630 con 0x7f78c0004d10 2023-06-10T19:02:36.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.986+0000 7f78d6ffd640 1 -- 172.21.15.53:0/3918922611 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78d00a8070 con 0x7f78c0004d10 2023-06-10T19:02:36.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.986+0000 7f78d6ffd640 1 -- 172.21.15.53:0/3918922611 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d00ada50 con 0x7f78c0004d10 2023-06-10T19:02:36.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.986+0000 7f78de3db640 1 -- 172.21.15.53:0/3918922611 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f78c0004d10 msgr2=0x7f78c0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:36.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.986+0000 7f78de3db640 1 --2- 172.21.15.53:0/3918922611 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f78c0004d10 0x7f78c0005180 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f78d00013e0 tx=0x7f78d001d300 comp rx=0 tx=0).stop 2023-06-10T19:02:36.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.986+0000 7f78dc978640 1 -- 172.21.15.53:0/3918922611 reap_dead start 2023-06-10T19:02:36.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.986+0000 7f78de3db640 1 -- 172.21.15.53:0/3918922611 shutdown_connections 2023-06-10T19:02:36.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.986+0000 7f78de3db640 1 -- 172.21.15.53:0/3918922611 >> 172.21.15.53:0/3918922611 conn(0x7f78d806a560 msgr2=0x7f78d806a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:36.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.986+0000 7f78de3db640 1 -- 172.21.15.53:0/3918922611 shutdown_connections 2023-06-10T19:02:36.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.986+0000 7f78de3db640 1 -- 172.21.15.53:0/3918922611 wait complete. 2023-06-10T19:02:36.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.990+0000 7f78de3db640 1 Processor -- start 2023-06-10T19:02:36.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.990+0000 7f78de3db640 1 -- start start 2023-06-10T19:02:36.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.990+0000 7f78de3db640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78d814a610 0x7f78d80c6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:36.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.990+0000 7f78de3db640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f78d80c6aa0 0x7f78d8153fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:36.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.990+0000 7f78de3db640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78d8154520 0x7f78d81e3500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:36.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.990+0000 7f78de3db640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d814a9e0 con 0x7f78d80c6aa0 2023-06-10T19:02:36.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.990+0000 7f78de3db640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d8153b50 con 0x7f78d814a610 2023-06-10T19:02:36.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.990+0000 7f78de3db640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78d815ae90 con 0x7f78d8154520 2023-06-10T19:02:36.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.990+0000 7f78d77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f78d80c6aa0 0x7f78d8153fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:36.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.990+0000 7f78d77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f78d80c6aa0 0x7f78d8153fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48534/0 (socket says 172.21.15.53:48534) 2023-06-10T19:02:36.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.990+0000 7f78d77fe640 1 -- 172.21.15.53:0/4027047030 learned_addr learned my addr 172.21.15.53:0/4027047030 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:36.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.990+0000 7f78dc978640 1 --2- 172.21.15.53:0/4027047030 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78d8154520 0x7f78d81e3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:36.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.990+0000 7f78d77fe640 1 -- 172.21.15.53:0/4027047030 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78d8154520 msgr2=0x7f78d81e3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:36.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.990+0000 7f78d77fe640 1 --2- 172.21.15.53:0/4027047030 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78d8154520 0x7f78d81e3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:36.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.990+0000 7f78d77fe640 1 -- 172.21.15.53:0/4027047030 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78d814a610 msgr2=0x7f78d80c6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:37.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.990+0000 7f78d7fff640 1 --2- 172.21.15.53:0/4027047030 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78d814a610 0x7f78d80c6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:37.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.990+0000 7f78d77fe640 1 --2- 172.21.15.53:0/4027047030 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78d814a610 0x7f78d80c6560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:37.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.990+0000 7f78d77fe640 1 -- 172.21.15.53:0/4027047030 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78d8153220 con 0x7f78d80c6aa0 2023-06-10T19:02:37.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.990+0000 7f78dc978640 1 --2- 172.21.15.53:0/4027047030 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78d8154520 0x7f78d81e3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:02:37.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.990+0000 7f78d77fe640 1 --2- 172.21.15.53:0/4027047030 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f78d80c6aa0 0x7f78d8153fe0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f78cc00d500 tx=0x7f78cc00d9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:37.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.990+0000 7f78d4ff9640 1 -- 172.21.15.53:0/4027047030 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78cc005500 con 0x7f78d80c6aa0 2023-06-10T19:02:37.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.990+0000 7f78d4ff9640 1 -- 172.21.15.53:0/4027047030 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78cc003620 con 0x7f78d80c6aa0 2023-06-10T19:02:37.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.990+0000 7f78de3db640 1 -- 172.21.15.53:0/4027047030 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78d8153500 con 0x7f78d80c6aa0 2023-06-10T19:02:37.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.990+0000 7f78d4ff9640 1 -- 172.21.15.53:0/4027047030 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78cc0039d0 con 0x7f78d80c6aa0 2023-06-10T19:02:37.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.990+0000 7f78de3db640 1 -- 172.21.15.53:0/4027047030 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78d815bfc0 con 0x7f78d80c6aa0 2023-06-10T19:02:37.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.990+0000 7f78de3db640 1 -- 172.21.15.53:0/4027047030 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78d81548f0 con 0x7f78d80c6aa0 2023-06-10T19:02:37.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.990+0000 7f78d4ff9640 1 -- 172.21.15.53:0/4027047030 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f78cc003b30 con 0x7f78d80c6aa0 2023-06-10T19:02:37.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.990+0000 7f78d4ff9640 1 --2- 172.21.15.53:0/4027047030 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f78c4066280 0x7f78c4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:37.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.990+0000 7f78d4ff9640 1 -- 172.21.15.53:0/4027047030 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6264+0+0 (secure 0 0 0) 0x7f78cc0846f0 con 0x7f78d80c6aa0 2023-06-10T19:02:37.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.994+0000 7f78d7fff640 1 --2- 172.21.15.53:0/4027047030 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f78c4066280 0x7f78c4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:37.002 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.994+0000 7f78d7fff640 1 --2- 172.21.15.53:0/4027047030 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f78c4066280 0x7f78c4068730 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f78d8152e70 tx=0x7f78c8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:37.002 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:36.994+0000 7f78d4ff9640 1 -- 172.21.15.53:0/4027047030 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f78cc051c10 con 0x7f78d80c6aa0 2023-06-10T19:02:37.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:37.174+0000 7f78de3db640 1 -- 172.21.15.53:0/4027047030 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f78d806d420 con 0x7f78d80c6aa0 2023-06-10T19:02:37.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:37.178+0000 7f78d4ff9640 1 -- 172.21.15.53:0/4027047030 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+4683 (secure 0 0 0) 0x7f78cc055230 con 0x7f78d80c6aa0 2023-06-10T19:02:37.180 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:02:37.180 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1617157670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1617157670},{"type":"v1","addr":"172.21.15.117:6836","nonce":1617157670}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6113,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3414416090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":3414416090},{"type":"v1","addr":"172.21.15.117:6837","nonce":3414416090}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6718,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2533467097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2533467097},{"type":"v1","addr":"172.21.15.53:6835","nonce":2533467097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:02:02.642809+0000","modified":"2023-06-10T19:02:36.149418+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8127":{"gid":8127,"name":"a","rank":0,"incarnation":52,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.53:6833/2984379521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2984379521},{"type":"v1","addr":"172.21.15.53:6833","nonce":2984379521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-06-10T19:02:37.180 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 53 2023-06-10T19:02:37.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:37.178+0000 7f78de3db640 1 -- 172.21.15.53:0/4027047030 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f78c4066280 msgr2=0x7f78c4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:37.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:37.178+0000 7f78de3db640 1 --2- 172.21.15.53:0/4027047030 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f78c4066280 0x7f78c4068730 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f78d8152e70 tx=0x7f78c8008040 comp rx=0 tx=0).stop 2023-06-10T19:02:37.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:37.178+0000 7f78de3db640 1 -- 172.21.15.53:0/4027047030 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f78d80c6aa0 msgr2=0x7f78d8153fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:37.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:37.178+0000 7f78de3db640 1 --2- 172.21.15.53:0/4027047030 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f78d80c6aa0 0x7f78d8153fe0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f78cc00d500 tx=0x7f78cc00d9c0 comp rx=0 tx=0).stop 2023-06-10T19:02:37.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:37.178+0000 7f78de3db640 1 -- 172.21.15.53:0/4027047030 shutdown_connections 2023-06-10T19:02:37.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:37.178+0000 7f78de3db640 1 --2- 172.21.15.53:0/4027047030 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f78c4066280 0x7f78c4068730 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:37.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:37.178+0000 7f78de3db640 1 --2- 172.21.15.53:0/4027047030 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78d8154520 0x7f78d81e3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:37.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:37.178+0000 7f78de3db640 1 --2- 172.21.15.53:0/4027047030 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f78d80c6aa0 0x7f78d8153fe0 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:37.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:37.178+0000 7f78de3db640 1 --2- 172.21.15.53:0/4027047030 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78d814a610 0x7f78d80c6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:37.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:37.178+0000 7f78de3db640 1 -- 172.21.15.53:0/4027047030 >> 172.21.15.53:0/4027047030 conn(0x7f78d806a560 msgr2=0x7f78d80cf1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:37.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:37.178+0000 7f78de3db640 1 -- 172.21.15.53:0/4027047030 shutdown_connections 2023-06-10T19:02:37.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:37.178+0000 7f78de3db640 1 -- 172.21.15.53:0/4027047030 wait complete. 2023-06-10T19:02:37.197 DEBUG:tasks.cephfs.filesystem:mapped states ['up:reconnect'] to None 2023-06-10T19:02:37.631 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-10T19:02:37.634 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-10T19:02:38.198 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:02:38.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:38.330+0000 7f2d110dd640 1 Processor -- start 2023-06-10T19:02:38.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:38.330+0000 7f2d110dd640 1 -- start start 2023-06-10T19:02:38.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:38.330+0000 7f2d110dd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d0c06b2f0 0x7f2d0c06f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:38.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:38.330+0000 7f2d110dd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2d0c0c8d00 0x7f2d0c06b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:38.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:38.330+0000 7f2d110dd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2d0c06bc00 0x7f2d0c0cbe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:38.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:38.330+0000 7f2d110dd640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d0c158a90 con 0x7f2d0c0c8d00 2023-06-10T19:02:38.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:38.330+0000 7f2d110dd640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d0c0705d0 con 0x7f2d0c06bc00 2023-06-10T19:02:38.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:38.330+0000 7f2d110dd640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0c06f9c0 con 0x7f2d0c06b2f0 2023-06-10T19:02:38.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:38.330+0000 7f2d03fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2d0c0c8d00 0x7f2d0c06b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:38.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:38.330+0000 7f2d03fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2d0c0c8d00 0x7f2d0c06b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48546/0 (socket says 172.21.15.53:48546) 2023-06-10T19:02:38.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:38.330+0000 7f2d03fff640 1 -- 172.21.15.53:0/971024652 learned_addr learned my addr 172.21.15.53:0/971024652 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:38.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:38.330+0000 7f2d0b59e640 1 --2- 172.21.15.53:0/971024652 >> v2:172.21.15.117:3300/0 conn(0x7f2d0c06bc00 0x7f2d0c0cbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:38.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:38.330+0000 7f2d0ad9d640 1 --2- 172.21.15.53:0/971024652 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d0c06b2f0 0x7f2d0c06f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:38.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:38.330+0000 7f2d03fff640 1 -- 172.21.15.53:0/971024652 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d0c06b2f0 msgr2=0x7f2d0c06f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:38.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:38.330+0000 7f2d03fff640 1 --2- 172.21.15.53:0/971024652 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d0c06b2f0 0x7f2d0c06f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:38.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:38.330+0000 7f2d03fff640 1 -- 172.21.15.53:0/971024652 >> v2:172.21.15.117:3300/0 conn(0x7f2d0c06bc00 msgr2=0x7f2d0c0cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:38.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:38.330+0000 7f2d03fff640 1 --2- 172.21.15.53:0/971024652 >> v2:172.21.15.117:3300/0 conn(0x7f2d0c06bc00 0x7f2d0c0cbe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:38.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:38.330+0000 7f2d03fff640 1 -- 172.21.15.53:0/971024652 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d0c06fca0 con 0x7f2d0c0c8d00 2023-06-10T19:02:38.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:38.330+0000 7f2d0b59e640 1 --2- 172.21.15.53:0/971024652 >> v2:172.21.15.117:3300/0 conn(0x7f2d0c06bc00 0x7f2d0c0cbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:02:38.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:38.334+0000 7f2d03fff640 1 --2- 172.21.15.53:0/971024652 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d0c0c8d00 0x7f2d0c06b6c0 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f2cf4009870 tx=0x7f2cf401ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4a378ec1e2522d2 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:38.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:38.334+0000 7f2d0a59c640 1 -- 172.21.15.53:0/971024652 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf40a89b0 con 0x7f2d0c0c8d00 2023-06-10T19:02:38.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:38.334+0000 7f2d0a59c640 1 -- 172.21.15.53:0/971024652 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cf40a8b10 con 0x7f2d0c0c8d00 2023-06-10T19:02:38.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:38.334+0000 7f2d0a59c640 1 -- 172.21.15.53:0/971024652 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf40a8ea0 con 0x7f2d0c0c8d00 2023-06-10T19:02:38.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:38.334+0000 7f2d110dd640 1 -- 172.21.15.53:0/971024652 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d0c0c8d00 msgr2=0x7f2d0c06b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:38.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:38.334+0000 7f2d110dd640 1 --2- 172.21.15.53:0/971024652 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d0c0c8d00 0x7f2d0c06b6c0 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f2cf4009870 tx=0x7f2cf401ecf0 comp rx=0 tx=0).stop 2023-06-10T19:02:38.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:38.334+0000 7f2d110dd640 1 -- 172.21.15.53:0/971024652 shutdown_connections 2023-06-10T19:02:38.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:38.334+0000 7f2d110dd640 1 --2- 172.21.15.53:0/971024652 >> v2:172.21.15.117:3300/0 conn(0x7f2d0c06bc00 0x7f2d0c0cbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:38.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:38.334+0000 7f2d110dd640 1 --2- 172.21.15.53:0/971024652 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d0c0c8d00 0x7f2d0c06b6c0 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:38.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:38.334+0000 7f2d110dd640 1 --2- 172.21.15.53:0/971024652 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d0c06b2f0 0x7f2d0c06f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:38.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:38.334+0000 7f2d110dd640 1 -- 172.21.15.53:0/971024652 >> 172.21.15.53:0/971024652 conn(0x7f2d0c06a0d0 msgr2=0x7f2d0c0ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:38.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:38.334+0000 7f2d110dd640 1 -- 172.21.15.53:0/971024652 shutdown_connections 2023-06-10T19:02:38.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:38.334+0000 7f2d110dd640 1 -- 172.21.15.53:0/971024652 wait complete. 2023-06-10T19:02:38.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:38.334+0000 7f2d110dd640 1 Processor -- start 2023-06-10T19:02:38.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:38.334+0000 7f2d110dd640 1 -- start start 2023-06-10T19:02:38.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:38.334+0000 7f2d110dd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d0c06b2f0 0x7f2d0c1514e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:38.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:38.334+0000 7f2d110dd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d0c06bc00 0x7f2d0c152ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:38.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:38.334+0000 7f2d110dd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d0c0c8d00 0x7f2d0c153000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:38.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:38.334+0000 7f2d110dd640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0c1539d0 con 0x7f2d0c0c8d00 2023-06-10T19:02:38.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:38.334+0000 7f2d110dd640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0c1453b0 con 0x7f2d0c06b2f0 2023-06-10T19:02:38.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:38.334+0000 7f2d110dd640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0c144a80 con 0x7f2d0c06bc00 2023-06-10T19:02:38.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:38.338+0000 7f2d0b59e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d0c0c8d00 0x7f2d0c153000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:38.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:38.338+0000 7f2d0b59e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d0c0c8d00 0x7f2d0c153000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48550/0 (socket says 172.21.15.53:48550) 2023-06-10T19:02:38.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:38.338+0000 7f2d0b59e640 1 -- 172.21.15.53:0/2744859254 learned_addr learned my addr 172.21.15.53:0/2744859254 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:38.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:38.338+0000 7f2d0ad9d640 1 --2- 172.21.15.53:0/2744859254 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d0c06b2f0 0x7f2d0c1514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:38.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:38.338+0000 7f2d03fff640 1 --2- 172.21.15.53:0/2744859254 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d0c06bc00 0x7f2d0c152ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:38.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:38.338+0000 7f2d0b59e640 1 -- 172.21.15.53:0/2744859254 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d0c06bc00 msgr2=0x7f2d0c152ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:38.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:38.338+0000 7f2d0b59e640 1 --2- 172.21.15.53:0/2744859254 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d0c06bc00 0x7f2d0c152ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:38.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:38.338+0000 7f2d0b59e640 1 -- 172.21.15.53:0/2744859254 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d0c06b2f0 msgr2=0x7f2d0c1514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:38.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:38.338+0000 7f2d0b59e640 1 --2- 172.21.15.53:0/2744859254 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d0c06b2f0 0x7f2d0c1514e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:38.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:38.338+0000 7f2d0b59e640 1 -- 172.21.15.53:0/2744859254 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cf40094d0 con 0x7f2d0c0c8d00 2023-06-10T19:02:38.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:38.338+0000 7f2d0b59e640 1 --2- 172.21.15.53:0/2744859254 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d0c0c8d00 0x7f2d0c153000 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f2d04007df0 tx=0x7f2d0400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:38.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:38.338+0000 7f2d037fe640 1 -- 172.21.15.53:0/2744859254 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d040039a0 con 0x7f2d0c0c8d00 2023-06-10T19:02:38.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:38.338+0000 7f2d037fe640 1 -- 172.21.15.53:0/2744859254 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d0400f040 con 0x7f2d0c0c8d00 2023-06-10T19:02:38.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:38.338+0000 7f2d110dd640 1 -- 172.21.15.53:0/2744859254 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d0c144d60 con 0x7f2d0c0c8d00 2023-06-10T19:02:38.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:38.338+0000 7f2d037fe640 1 -- 172.21.15.53:0/2744859254 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d04003d40 con 0x7f2d0c0c8d00 2023-06-10T19:02:38.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:38.338+0000 7f2d110dd640 1 -- 172.21.15.53:0/2744859254 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d0c153540 con 0x7f2d0c0c8d00 2023-06-10T19:02:38.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:38.338+0000 7f2d110dd640 1 -- 172.21.15.53:0/2744859254 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d0c153790 con 0x7f2d0c0c8d00 2023-06-10T19:02:38.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:38.338+0000 7f2d037fe640 1 -- 172.21.15.53:0/2744859254 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2d04004030 con 0x7f2d0c0c8d00 2023-06-10T19:02:38.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:38.338+0000 7f2d037fe640 1 --2- 172.21.15.53:0/2744859254 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2cec066280 0x7f2cec068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:38.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:38.338+0000 7f2d037fe640 1 -- 172.21.15.53:0/2744859254 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6264+0+0 (secure 0 0 0) 0x7f2d040840b0 con 0x7f2d0c0c8d00 2023-06-10T19:02:38.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:38.338+0000 7f2d0ad9d640 1 --2- 172.21.15.53:0/2744859254 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2cec066280 0x7f2cec068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:38.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:38.338+0000 7f2d0ad9d640 1 --2- 172.21.15.53:0/2744859254 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2cec066280 0x7f2cec068730 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc00b990 tx=0x7f2cfc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:38.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:38.342+0000 7f2d037fe640 1 -- 172.21.15.53:0/2744859254 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2d0c153790 con 0x7f2d0c0c8d00 2023-06-10T19:02:38.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:38.530+0000 7f2d110dd640 1 -- 172.21.15.53:0/2744859254 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2d0c153790 con 0x7f2d0c0c8d00 2023-06-10T19:02:38.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:38.530+0000 7f2d037fe640 1 -- 172.21.15.53:0/2744859254 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+4683 (secure 0 0 0) 0x7f2d0c153790 con 0x7f2d0c0c8d00 2023-06-10T19:02:38.533 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:02:38.534 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1617157670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1617157670},{"type":"v1","addr":"172.21.15.117:6836","nonce":1617157670}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6113,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3414416090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":3414416090},{"type":"v1","addr":"172.21.15.117:6837","nonce":3414416090}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6718,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2533467097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2533467097},{"type":"v1","addr":"172.21.15.53:6835","nonce":2533467097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:02:02.642809+0000","modified":"2023-06-10T19:02:36.149418+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8127":{"gid":8127,"name":"a","rank":0,"incarnation":52,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.53:6833/2984379521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2984379521},{"type":"v1","addr":"172.21.15.53:6833","nonce":2984379521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-06-10T19:02:38.534 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 53 2023-06-10T19:02:38.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:38.530+0000 7f2d110dd640 1 -- 172.21.15.53:0/2744859254 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2cec066280 msgr2=0x7f2cec068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:38.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:38.530+0000 7f2d110dd640 1 --2- 172.21.15.53:0/2744859254 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2cec066280 0x7f2cec068730 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc00b990 tx=0x7f2cfc008040 comp rx=0 tx=0).stop 2023-06-10T19:02:38.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:38.530+0000 7f2d110dd640 1 -- 172.21.15.53:0/2744859254 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d0c0c8d00 msgr2=0x7f2d0c153000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:38.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:38.530+0000 7f2d110dd640 1 --2- 172.21.15.53:0/2744859254 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d0c0c8d00 0x7f2d0c153000 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f2d04007df0 tx=0x7f2d0400d4a0 comp rx=0 tx=0).stop 2023-06-10T19:02:38.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:38.534+0000 7f2d110dd640 1 -- 172.21.15.53:0/2744859254 shutdown_connections 2023-06-10T19:02:38.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:38.534+0000 7f2d110dd640 1 --2- 172.21.15.53:0/2744859254 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2cec066280 0x7f2cec068730 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:38.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:38.534+0000 7f2d110dd640 1 --2- 172.21.15.53:0/2744859254 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d0c0c8d00 0x7f2d0c153000 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:38.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:38.534+0000 7f2d110dd640 1 --2- 172.21.15.53:0/2744859254 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d0c06bc00 0x7f2d0c152ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:38.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:38.534+0000 7f2d110dd640 1 --2- 172.21.15.53:0/2744859254 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d0c06b2f0 0x7f2d0c1514e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:38.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:38.534+0000 7f2d110dd640 1 -- 172.21.15.53:0/2744859254 >> 172.21.15.53:0/2744859254 conn(0x7f2d0c06a0d0 msgr2=0x7f2d0c06c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:38.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:38.534+0000 7f2d110dd640 1 -- 172.21.15.53:0/2744859254 shutdown_connections 2023-06-10T19:02:38.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:38.534+0000 7f2d110dd640 1 -- 172.21.15.53:0/2744859254 wait complete. 2023-06-10T19:02:38.553 DEBUG:tasks.cephfs.filesystem:mapped states ['up:reconnect'] to None 2023-06-10T19:02:39.553 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:02:39.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:39.686+0000 7f49110e8640 1 Processor -- start 2023-06-10T19:02:39.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:39.686+0000 7f49110e8640 1 -- start start 2023-06-10T19:02:39.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:39.690+0000 7f49110e8640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f490c0b3390 0x7f490c0af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:39.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:39.690+0000 7f49110e8640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f490c070e30 0x7f490c0c8d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:39.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:39.690+0000 7f49110e8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f490c0c9240 0x7f490c06b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:39.693 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:39.690+0000 7f49110e8640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f490c0c82f0 con 0x7f490c0c9240 2023-06-10T19:02:39.693 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:39.690+0000 7f49110e8640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f490c0b3760 con 0x7f490c0b3390 2023-06-10T19:02:39.693 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:39.690+0000 7f49110e8640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f490c071280 con 0x7f490c070e30 2023-06-10T19:02:39.693 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:39.690+0000 7f490b59e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f490c0c9240 0x7f490c06b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:39.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:39.690+0000 7f490b59e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f490c0c9240 0x7f490c06b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48556/0 (socket says 172.21.15.53:48556) 2023-06-10T19:02:39.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:39.690+0000 7f490b59e640 1 -- 172.21.15.53:0/3587748614 learned_addr learned my addr 172.21.15.53:0/3587748614 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:39.695 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:39.690+0000 7f490a59c640 1 --2- 172.21.15.53:0/3587748614 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f490c070e30 0x7f490c0c8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:39.696 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:39.690+0000 7f490ad9d640 1 --2- 172.21.15.53:0/3587748614 >> v2:172.21.15.117:3300/0 conn(0x7f490c0b3390 0x7f490c0af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:39.696 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:39.690+0000 7f490b59e640 1 -- 172.21.15.53:0/3587748614 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f490c070e30 msgr2=0x7f490c0c8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:39.696 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:39.690+0000 7f490b59e640 1 --2- 172.21.15.53:0/3587748614 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f490c070e30 0x7f490c0c8d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:39.696 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:39.690+0000 7f490b59e640 1 -- 172.21.15.53:0/3587748614 >> v2:172.21.15.117:3300/0 conn(0x7f490c0b3390 msgr2=0x7f490c0af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:39.697 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:39.690+0000 7f490b59e640 1 --2- 172.21.15.53:0/3587748614 >> v2:172.21.15.117:3300/0 conn(0x7f490c0b3390 0x7f490c0af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:39.697 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:39.690+0000 7f490b59e640 1 -- 172.21.15.53:0/3587748614 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f490c0afe20 con 0x7f490c0c9240 2023-06-10T19:02:39.697 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:39.690+0000 7f490a59c640 1 --2- 172.21.15.53:0/3587748614 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f490c070e30 0x7f490c0c8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:02:39.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:39.694+0000 7f490b59e640 1 --2- 172.21.15.53:0/3587748614 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f490c0c9240 0x7f490c06b090 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f490c06ea70 tx=0x7f490401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3709617d359a2288 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:39.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:39.694+0000 7f4909d9b640 1 -- 172.21.15.53:0/3587748614 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49040a5760 con 0x7f490c0c9240 2023-06-10T19:02:39.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:39.694+0000 7f4909d9b640 1 -- 172.21.15.53:0/3587748614 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49040a58c0 con 0x7f490c0c9240 2023-06-10T19:02:39.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:39.694+0000 7f4909d9b640 1 -- 172.21.15.53:0/3587748614 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49040a5c50 con 0x7f490c0c9240 2023-06-10T19:02:39.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:39.694+0000 7f49110e8640 1 -- 172.21.15.53:0/3587748614 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f490c0c9240 msgr2=0x7f490c06b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:39.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:39.694+0000 7f49110e8640 1 --2- 172.21.15.53:0/3587748614 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f490c0c9240 0x7f490c06b090 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f490c06ea70 tx=0x7f490401c9d0 comp rx=0 tx=0).stop 2023-06-10T19:02:39.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:39.694+0000 7f49110e8640 1 -- 172.21.15.53:0/3587748614 shutdown_connections 2023-06-10T19:02:39.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:39.694+0000 7f49110e8640 1 --2- 172.21.15.53:0/3587748614 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f490c0c9240 0x7f490c06b090 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:39.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:39.694+0000 7f49110e8640 1 --2- 172.21.15.53:0/3587748614 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f490c070e30 0x7f490c0c8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:39.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:39.694+0000 7f49110e8640 1 --2- 172.21.15.53:0/3587748614 >> v2:172.21.15.117:3300/0 conn(0x7f490c0b3390 0x7f490c0af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:39.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:39.694+0000 7f49110e8640 1 -- 172.21.15.53:0/3587748614 >> 172.21.15.53:0/3587748614 conn(0x7f490c06a0d0 msgr2=0x7f490c0ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:39.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:39.694+0000 7f49110e8640 1 -- 172.21.15.53:0/3587748614 shutdown_connections 2023-06-10T19:02:39.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:39.694+0000 7f49110e8640 1 -- 172.21.15.53:0/3587748614 wait complete. 2023-06-10T19:02:39.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:39.694+0000 7f49110e8640 1 Processor -- start 2023-06-10T19:02:39.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:39.694+0000 7f49110e8640 1 -- start start 2023-06-10T19:02:39.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:39.694+0000 7f49110e8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f490c070e30 0x7f490c0ad700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:39.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:39.694+0000 7f49110e8640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f490c0b3390 0x7f490c1500c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:39.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:39.694+0000 7f49110e8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f490c0c9240 0x7f490c0c5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:39.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:39.694+0000 7f49110e8640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f490c0adf50 con 0x7f490c070e30 2023-06-10T19:02:39.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:39.694+0000 7f49110e8640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f490c0ae230 con 0x7f490c0c9240 2023-06-10T19:02:39.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:39.694+0000 7f49110e8640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f490c0ae510 con 0x7f490c0b3390 2023-06-10T19:02:39.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:39.694+0000 7f490ad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f490c070e30 0x7f490c0ad700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:39.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:39.694+0000 7f490ad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f490c070e30 0x7f490c0ad700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48558/0 (socket says 172.21.15.53:48558) 2023-06-10T19:02:39.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:39.694+0000 7f490ad9d640 1 -- 172.21.15.53:0/363865198 learned_addr learned my addr 172.21.15.53:0/363865198 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:39.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:39.694+0000 7f490b59e640 1 --2- 172.21.15.53:0/363865198 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f490c0c9240 0x7f490c0c5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:39.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:39.698+0000 7f490a59c640 1 --2- 172.21.15.53:0/363865198 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f490c0b3390 0x7f490c1500c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:39.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:39.698+0000 7f490ad9d640 1 -- 172.21.15.53:0/363865198 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f490c0b3390 msgr2=0x7f490c1500c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:39.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:39.698+0000 7f490ad9d640 1 --2- 172.21.15.53:0/363865198 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f490c0b3390 0x7f490c1500c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:39.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:39.698+0000 7f490ad9d640 1 -- 172.21.15.53:0/363865198 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f490c0c9240 msgr2=0x7f490c0c5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:39.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:39.698+0000 7f490ad9d640 1 --2- 172.21.15.53:0/363865198 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f490c0c9240 0x7f490c0c5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:39.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:39.698+0000 7f490ad9d640 1 -- 172.21.15.53:0/363865198 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4904009b30 con 0x7f490c070e30 2023-06-10T19:02:39.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:39.698+0000 7f490ad9d640 1 --2- 172.21.15.53:0/363865198 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f490c070e30 0x7f490c0ad700 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f48fc00e930 tx=0x7f48fc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:39.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:39.698+0000 7f48f37fe640 1 -- 172.21.15.53:0/363865198 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48fc009690 con 0x7f490c070e30 2023-06-10T19:02:39.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:39.698+0000 7f48f37fe640 1 -- 172.21.15.53:0/363865198 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48fc00ca00 con 0x7f490c070e30 2023-06-10T19:02:39.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:39.698+0000 7f49110e8640 1 -- 172.21.15.53:0/363865198 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f490c0ae7f0 con 0x7f490c070e30 2023-06-10T19:02:39.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:39.698+0000 7f48f37fe640 1 -- 172.21.15.53:0/363865198 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48fc00cd70 con 0x7f490c070e30 2023-06-10T19:02:39.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:39.698+0000 7f49110e8640 1 -- 172.21.15.53:0/363865198 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f490c0aeff0 con 0x7f490c070e30 2023-06-10T19:02:39.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:39.698+0000 7f49110e8640 1 -- 172.21.15.53:0/363865198 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f490c04d790 con 0x7f490c070e30 2023-06-10T19:02:39.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:39.698+0000 7f48f37fe640 1 -- 172.21.15.53:0/363865198 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f48fc013470 con 0x7f490c070e30 2023-06-10T19:02:39.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:39.698+0000 7f48f37fe640 1 --2- 172.21.15.53:0/363865198 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f48f80662b0 0x7f48f8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:39.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:39.698+0000 7f48f37fe640 1 -- 172.21.15.53:0/363865198 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6264+0+0 (secure 0 0 0) 0x7f48fc083ea0 con 0x7f490c070e30 2023-06-10T19:02:39.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:39.698+0000 7f490a59c640 1 --2- 172.21.15.53:0/363865198 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f48f80662b0 0x7f48f8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:39.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:39.702+0000 7f490a59c640 1 --2- 172.21.15.53:0/363865198 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f48f80662b0 0x7f48f8068760 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f490c152a00 tx=0x7f4900008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:39.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:39.702+0000 7f48f37fe640 1 -- 172.21.15.53:0/363865198 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f48fc051450 con 0x7f490c070e30 2023-06-10T19:02:39.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:39.886+0000 7f49110e8640 1 -- 172.21.15.53:0/363865198 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f490c0cb3f0 con 0x7f490c070e30 2023-06-10T19:02:39.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:39.890+0000 7f48f37fe640 1 -- 172.21.15.53:0/363865198 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+4683 (secure 0 0 0) 0x7f48fc017090 con 0x7f490c070e30 2023-06-10T19:02:39.892 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:02:39.893 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1617157670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1617157670},{"type":"v1","addr":"172.21.15.117:6836","nonce":1617157670}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6113,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3414416090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":3414416090},{"type":"v1","addr":"172.21.15.117:6837","nonce":3414416090}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6718,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2533467097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2533467097},{"type":"v1","addr":"172.21.15.53:6835","nonce":2533467097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:02:02.642809+0000","modified":"2023-06-10T19:02:36.149418+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8127":{"gid":8127,"name":"a","rank":0,"incarnation":52,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.53:6833/2984379521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2984379521},{"type":"v1","addr":"172.21.15.53:6833","nonce":2984379521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-06-10T19:02:39.894 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 53 2023-06-10T19:02:39.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:39.890+0000 7f49110e8640 1 -- 172.21.15.53:0/363865198 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f48f80662b0 msgr2=0x7f48f8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:39.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:39.890+0000 7f49110e8640 1 --2- 172.21.15.53:0/363865198 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f48f80662b0 0x7f48f8068760 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f490c152a00 tx=0x7f4900008040 comp rx=0 tx=0).stop 2023-06-10T19:02:39.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:39.890+0000 7f49110e8640 1 -- 172.21.15.53:0/363865198 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f490c070e30 msgr2=0x7f490c0ad700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:39.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:39.890+0000 7f49110e8640 1 --2- 172.21.15.53:0/363865198 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f490c070e30 0x7f490c0ad700 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f48fc00e930 tx=0x7f48fc00edf0 comp rx=0 tx=0).stop 2023-06-10T19:02:39.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:39.890+0000 7f49110e8640 1 -- 172.21.15.53:0/363865198 shutdown_connections 2023-06-10T19:02:39.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:39.890+0000 7f49110e8640 1 --2- 172.21.15.53:0/363865198 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f48f80662b0 0x7f48f8068760 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:39.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:39.890+0000 7f49110e8640 1 --2- 172.21.15.53:0/363865198 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f490c0c9240 0x7f490c0c5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:39.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:39.890+0000 7f49110e8640 1 --2- 172.21.15.53:0/363865198 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f490c0b3390 0x7f490c1500c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:39.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:39.890+0000 7f49110e8640 1 --2- 172.21.15.53:0/363865198 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f490c070e30 0x7f490c0ad700 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:39.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:39.890+0000 7f49110e8640 1 -- 172.21.15.53:0/363865198 >> 172.21.15.53:0/363865198 conn(0x7f490c06a0d0 msgr2=0x7f490c06baf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:39.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:39.890+0000 7f49110e8640 1 -- 172.21.15.53:0/363865198 shutdown_connections 2023-06-10T19:02:39.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:39.890+0000 7f49110e8640 1 -- 172.21.15.53:0/363865198 wait complete. 2023-06-10T19:02:39.909 DEBUG:tasks.cephfs.filesystem:mapped states ['up:reconnect'] to None 2023-06-10T19:02:40.911 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:02:41.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:41.042+0000 7ff46f593640 1 Processor -- start 2023-06-10T19:02:41.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:41.042+0000 7ff46f593640 1 -- start start 2023-06-10T19:02:41.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:41.042+0000 7ff46f593640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff46815fe00 0x7ff468163980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:41.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:41.042+0000 7ff46f593640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4680afe30 0x7ff4680c10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:41.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:41.042+0000 7ff46f593640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4681648e0 con 0x7ff4680cb870 2023-06-10T19:02:41.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:41.042+0000 7ff46f593640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff46806b2c0 con 0x7ff46815fe00 2023-06-10T19:02:41.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:41.042+0000 7ff46f593640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4680c1620 con 0x7ff4680afe30 2023-06-10T19:02:41.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:41.042+0000 7ff46db30640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4680afe30 0x7ff4680c10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:41.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:41.042+0000 7ff46d32f640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff46815fe00 0x7ff468163980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:41.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:41.042+0000 7ff46db30640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4680afe30 0x7ff4680c10e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.53:58112/0 (socket says 172.21.15.53:58112) 2023-06-10T19:02:41.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:41.042+0000 7ff46d32f640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff46815fe00 0x7ff468163980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.53:33388/0 (socket says 172.21.15.53:33388) 2023-06-10T19:02:41.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:41.042+0000 7ff46db30640 1 -- 172.21.15.53:0/2555361412 learned_addr learned my addr 172.21.15.53:0/2555361412 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:41.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:41.042+0000 7ff46cb2e640 1 --1- 172.21.15.53:0/2555361412 >> v1:172.21.15.117:6789/0 conn(0x7ff4680cb870 0x7ff4680af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.53:49920/0 (socket says 172.21.15.53:49920) 2023-06-10T19:02:41.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:41.042+0000 7ff46db30640 1 -- 172.21.15.53:0/2555361412 >> v2:172.21.15.117:3300/0 conn(0x7ff46815fe00 msgr2=0x7ff468163980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:41.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:41.042+0000 7ff46db30640 1 --2- 172.21.15.53:0/2555361412 >> v2:172.21.15.117:3300/0 conn(0x7ff46815fe00 0x7ff468163980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:41.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:41.042+0000 7ff46db30640 1 -- 172.21.15.53:0/2555361412 >> v1:172.21.15.117:6789/0 conn(0x7ff4680cb870 legacy=0x7ff4680af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:41.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:41.042+0000 7ff46db30640 1 -- 172.21.15.53:0/2555361412 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4680cbcc0 con 0x7ff4680afe30 2023-06-10T19:02:41.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:41.046+0000 7ff46db30640 1 --2- 172.21.15.53:0/2555361412 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4680afe30 0x7ff4680c10e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff460009e50 tx=0x7ff46001c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1af588256fdc4cc server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:41.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:41.046+0000 7ff467fff640 1 -- 172.21.15.53:0/2555361412 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4600a58a0 con 0x7ff4680afe30 2023-06-10T19:02:41.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:41.046+0000 7ff467fff640 1 -- 172.21.15.53:0/2555361412 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4600a5a00 con 0x7ff4680afe30 2023-06-10T19:02:41.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:41.046+0000 7ff467fff640 1 -- 172.21.15.53:0/2555361412 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4600a5d90 con 0x7ff4680afe30 2023-06-10T19:02:41.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:41.046+0000 7ff46f593640 1 -- 172.21.15.53:0/2555361412 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4680afe30 msgr2=0x7ff4680c10e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:41.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:41.046+0000 7ff46f593640 1 --2- 172.21.15.53:0/2555361412 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4680afe30 0x7ff4680c10e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff460009e50 tx=0x7ff46001c9e0 comp rx=0 tx=0).stop 2023-06-10T19:02:41.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:41.046+0000 7ff46f593640 1 -- 172.21.15.53:0/2555361412 shutdown_connections 2023-06-10T19:02:41.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:41.046+0000 7ff46f593640 1 --2- 172.21.15.53:0/2555361412 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4680afe30 0x7ff4680c10e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:41.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:41.046+0000 7ff46f593640 1 --2- 172.21.15.53:0/2555361412 >> v2:172.21.15.117:3300/0 conn(0x7ff46815fe00 0x7ff468163980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:41.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:41.046+0000 7ff46f593640 1 -- 172.21.15.53:0/2555361412 >> 172.21.15.53:0/2555361412 conn(0x7ff46806a0d0 msgr2=0x7ff4680ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:41.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:41.046+0000 7ff46f593640 1 -- 172.21.15.53:0/2555361412 shutdown_connections 2023-06-10T19:02:41.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:41.046+0000 7ff46f593640 1 -- 172.21.15.53:0/2555361412 wait complete. 2023-06-10T19:02:41.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:41.050+0000 7ff46f593640 1 Processor -- start 2023-06-10T19:02:41.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:41.050+0000 7ff46f593640 1 -- start start 2023-06-10T19:02:41.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:41.050+0000 7ff46f593640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4680afe30 0x7ff4681523f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:41.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:41.050+0000 7ff46f593640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4680cb870 0x7ff46815a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:41.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:41.050+0000 7ff46f593640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff46815fe00 0x7ff4680c1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:41.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:41.050+0000 7ff46f593640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff468152930 con 0x7ff4680afe30 2023-06-10T19:02:41.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:41.050+0000 7ff46f593640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4680af740 con 0x7ff46815fe00 2023-06-10T19:02:41.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:41.050+0000 7ff46f593640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4680aeb70 con 0x7ff4680cb870 2023-06-10T19:02:41.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:41.050+0000 7ff46d32f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4680afe30 0x7ff4681523f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:41.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:41.050+0000 7ff46d32f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4680afe30 0x7ff4681523f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48572/0 (socket says 172.21.15.53:48572) 2023-06-10T19:02:41.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:41.050+0000 7ff46d32f640 1 -- 172.21.15.53:0/989003279 learned_addr learned my addr 172.21.15.53:0/989003279 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:41.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:41.050+0000 7ff46cb2e640 1 --2- 172.21.15.53:0/989003279 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4680cb870 0x7ff46815a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:41.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:41.050+0000 7ff46db30640 1 --2- 172.21.15.53:0/989003279 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff46815fe00 0x7ff4680c1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:41.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:41.050+0000 7ff46d32f640 1 -- 172.21.15.53:0/989003279 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4680cb870 msgr2=0x7ff46815a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:41.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:41.050+0000 7ff46d32f640 1 --2- 172.21.15.53:0/989003279 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4680cb870 0x7ff46815a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:41.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:41.050+0000 7ff46d32f640 1 -- 172.21.15.53:0/989003279 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff46815fe00 msgr2=0x7ff4680c1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:41.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:41.050+0000 7ff46d32f640 1 --2- 172.21.15.53:0/989003279 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff46815fe00 0x7ff4680c1790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:41.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:41.050+0000 7ff46d32f640 1 -- 172.21.15.53:0/989003279 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff460009b30 con 0x7ff4680afe30 2023-06-10T19:02:41.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:41.050+0000 7ff46d32f640 1 --2- 172.21.15.53:0/989003279 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4680afe30 0x7ff4681523f0 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7ff45800e8a0 tx=0x7ff45800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:41.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:41.050+0000 7ff465ffb640 1 -- 172.21.15.53:0/989003279 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff458009510 con 0x7ff4680afe30 2023-06-10T19:02:41.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:41.050+0000 7ff465ffb640 1 -- 172.21.15.53:0/989003279 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff45800c940 con 0x7ff4680afe30 2023-06-10T19:02:41.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:41.050+0000 7ff465ffb640 1 -- 172.21.15.53:0/989003279 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff45800ccb0 con 0x7ff4680afe30 2023-06-10T19:02:41.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:41.050+0000 7ff46f593640 1 -- 172.21.15.53:0/989003279 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4680aee10 con 0x7ff4680afe30 2023-06-10T19:02:41.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:41.050+0000 7ff46f593640 1 -- 172.21.15.53:0/989003279 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4680af3d0 con 0x7ff4680afe30 2023-06-10T19:02:41.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:41.050+0000 7ff46f593640 1 -- 172.21.15.53:0/989003279 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff46804d790 con 0x7ff4680afe30 2023-06-10T19:02:41.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:41.050+0000 7ff465ffb640 1 -- 172.21.15.53:0/989003279 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff458013470 con 0x7ff4680afe30 2023-06-10T19:02:41.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:41.054+0000 7ff465ffb640 1 --2- 172.21.15.53:0/989003279 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff454066280 0x7ff454068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:41.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:41.054+0000 7ff465ffb640 1 -- 172.21.15.53:0/989003279 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6264+0+0 (secure 0 0 0) 0x7ff458084280 con 0x7ff4680afe30 2023-06-10T19:02:41.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:41.054+0000 7ff46cb2e640 1 --2- 172.21.15.53:0/989003279 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff454066280 0x7ff454068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:41.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:41.054+0000 7ff46cb2e640 1 --2- 172.21.15.53:0/989003279 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff454066280 0x7ff454068730 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7ff4681fb2f0 tx=0x7ff45c007c50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:41.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:41.058+0000 7ff465ffb640 1 -- 172.21.15.53:0/989003279 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff458051630 con 0x7ff4680afe30 2023-06-10T19:02:41.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:41.246+0000 7ff46f593640 1 -- 172.21.15.53:0/989003279 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff4680b0680 con 0x7ff4680afe30 2023-06-10T19:02:41.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:41.246+0000 7ff465ffb640 1 -- 172.21.15.53:0/989003279 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+4683 (secure 0 0 0) 0x7ff458054c50 con 0x7ff4680afe30 2023-06-10T19:02:41.249 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:02:41.249 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1617157670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1617157670},{"type":"v1","addr":"172.21.15.117:6836","nonce":1617157670}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6113,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3414416090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":3414416090},{"type":"v1","addr":"172.21.15.117:6837","nonce":3414416090}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6718,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2533467097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2533467097},{"type":"v1","addr":"172.21.15.53:6835","nonce":2533467097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:02:02.642809+0000","modified":"2023-06-10T19:02:36.149418+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8127":{"gid":8127,"name":"a","rank":0,"incarnation":52,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.53:6833/2984379521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2984379521},{"type":"v1","addr":"172.21.15.53:6833","nonce":2984379521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-06-10T19:02:41.249 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 53 2023-06-10T19:02:41.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:41.246+0000 7ff46f593640 1 -- 172.21.15.53:0/989003279 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff454066280 msgr2=0x7ff454068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:41.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:41.246+0000 7ff46f593640 1 --2- 172.21.15.53:0/989003279 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff454066280 0x7ff454068730 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7ff4681fb2f0 tx=0x7ff45c007c50 comp rx=0 tx=0).stop 2023-06-10T19:02:41.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:41.246+0000 7ff46f593640 1 -- 172.21.15.53:0/989003279 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4680afe30 msgr2=0x7ff4681523f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:41.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:41.246+0000 7ff46f593640 1 --2- 172.21.15.53:0/989003279 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4680afe30 0x7ff4681523f0 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7ff45800e8a0 tx=0x7ff45800eca0 comp rx=0 tx=0).stop 2023-06-10T19:02:41.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:41.246+0000 7ff46f593640 1 -- 172.21.15.53:0/989003279 shutdown_connections 2023-06-10T19:02:41.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:41.246+0000 7ff46f593640 1 --2- 172.21.15.53:0/989003279 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff454066280 0x7ff454068730 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:41.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:41.246+0000 7ff46f593640 1 --2- 172.21.15.53:0/989003279 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff46815fe00 0x7ff4680c1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:41.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:41.246+0000 7ff46f593640 1 --2- 172.21.15.53:0/989003279 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4680cb870 0x7ff46815a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:41.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:41.246+0000 7ff46f593640 1 --2- 172.21.15.53:0/989003279 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4680afe30 0x7ff4681523f0 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:41.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:41.246+0000 7ff46f593640 1 -- 172.21.15.53:0/989003279 >> 172.21.15.53:0/989003279 conn(0x7ff46806a0d0 msgr2=0x7ff4680ad540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:41.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:41.246+0000 7ff46f593640 1 -- 172.21.15.53:0/989003279 shutdown_connections 2023-06-10T19:02:41.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:41.246+0000 7ff46f593640 1 -- 172.21.15.53:0/989003279 wait complete. 2023-06-10T19:02:41.268 DEBUG:tasks.cephfs.filesystem:mapped states ['up:reconnect'] to None 2023-06-10T19:02:42.270 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:02:42.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:42.402+0000 7f093aa45640 1 Processor -- start 2023-06-10T19:02:42.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:42.402+0000 7f093aa45640 1 -- start start 2023-06-10T19:02:42.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:42.402+0000 7f093aa45640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f093415cc70 0x7f093406adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:42.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:42.402+0000 7f093aa45640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f093415d0d0 0x7f093415d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:42.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:42.402+0000 7f093aa45640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f093406b870 con 0x7f09340afb10 2023-06-10T19:02:42.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:42.402+0000 7f093aa45640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f093406bb50 con 0x7f093415cc70 2023-06-10T19:02:42.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:42.402+0000 7f093aa45640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f093415c470 con 0x7f093415d0d0 2023-06-10T19:02:42.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:42.402+0000 7f092bfff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f093415cc70 0x7f093406adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:42.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:42.402+0000 7f0938fe2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f093415d0d0 0x7f093415d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:42.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:42.402+0000 7f092bfff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f093415cc70 0x7f093406adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.53:53236/0 (socket says 172.21.15.53:53236) 2023-06-10T19:02:42.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:42.402+0000 7f092bfff640 1 -- 172.21.15.53:0/1832147652 learned_addr learned my addr 172.21.15.53:0/1832147652 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:42.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:42.402+0000 7f092bfff640 1 -- 172.21.15.53:0/1832147652 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f093415d0d0 msgr2=0x7f093415d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:42.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:42.402+0000 7f092bfff640 1 --2- 172.21.15.53:0/1832147652 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f093415d0d0 0x7f093415d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:42.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:42.402+0000 7f092bfff640 1 -- 172.21.15.53:0/1832147652 >> v1:172.21.15.117:6789/0 conn(0x7f09340afb10 legacy=0x7f09340afee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:42.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:42.402+0000 7f092bfff640 1 -- 172.21.15.53:0/1832147652 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f093415c750 con 0x7f093415cc70 2023-06-10T19:02:42.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:42.402+0000 7f0938fe2640 1 --2- 172.21.15.53:0/1832147652 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f093415d0d0 0x7f093415d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-10T19:02:42.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:42.406+0000 7f092bfff640 1 --2- 172.21.15.53:0/1832147652 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f093415cc70 0x7f093406adb0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f091c009870 tx=0x7f091c01ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce29867bd7d5b7ce server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:42.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:42.406+0000 7f09337fe640 1 -- 172.21.15.53:0/1832147652 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091c0a8a30 con 0x7f093415cc70 2023-06-10T19:02:42.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:42.406+0000 7f09337fe640 1 -- 172.21.15.53:0/1832147652 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f091c0a8b90 con 0x7f093415cc70 2023-06-10T19:02:42.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:42.406+0000 7f09337fe640 1 -- 172.21.15.53:0/1832147652 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091c0b0440 con 0x7f093415cc70 2023-06-10T19:02:42.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:42.406+0000 7f093aa45640 1 -- 172.21.15.53:0/1832147652 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f093415cc70 msgr2=0x7f093406adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:42.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:42.406+0000 7f093aa45640 1 --2- 172.21.15.53:0/1832147652 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f093415cc70 0x7f093406adb0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f091c009870 tx=0x7f091c01ed30 comp rx=0 tx=0).stop 2023-06-10T19:02:42.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:42.406+0000 7f093aa45640 1 -- 172.21.15.53:0/1832147652 shutdown_connections 2023-06-10T19:02:42.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:42.406+0000 7f093aa45640 1 --2- 172.21.15.53:0/1832147652 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f093415d0d0 0x7f093415d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:42.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:42.406+0000 7f093aa45640 1 --2- 172.21.15.53:0/1832147652 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f093415cc70 0x7f093406adb0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:42.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:42.406+0000 7f093aa45640 1 -- 172.21.15.53:0/1832147652 >> 172.21.15.53:0/1832147652 conn(0x7f09340cab10 msgr2=0x7f09340caf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:42.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:42.406+0000 7f093aa45640 1 -- 172.21.15.53:0/1832147652 shutdown_connections 2023-06-10T19:02:42.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:42.406+0000 7f093aa45640 1 -- 172.21.15.53:0/1832147652 wait complete. 2023-06-10T19:02:42.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:42.406+0000 7f093aa45640 1 Processor -- start 2023-06-10T19:02:42.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:42.406+0000 7f093aa45640 1 -- start start 2023-06-10T19:02:42.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:42.406+0000 7f093aa45640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09340afb10 0x7f0934157590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:42.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:42.406+0000 7f093aa45640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f093415cc70 0x7f0934159010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:42.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:42.406+0000 7f093aa45640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f093415d0d0 0x7f093415a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:42.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:42.406+0000 7f093aa45640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09340700c0 con 0x7f09340afb10 2023-06-10T19:02:42.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:42.406+0000 7f093aa45640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f093406f4f0 con 0x7f093415d0d0 2023-06-10T19:02:42.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:42.406+0000 7f093aa45640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f093406f790 con 0x7f093415cc70 2023-06-10T19:02:42.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:42.410+0000 7f0933fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09340afb10 0x7f0934157590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:42.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:42.410+0000 7f0933fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09340afb10 0x7f0934157590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52238/0 (socket says 172.21.15.53:52238) 2023-06-10T19:02:42.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:42.410+0000 7f0933fff640 1 -- 172.21.15.53:0/1356173821 learned_addr learned my addr 172.21.15.53:0/1356173821 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:42.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:42.410+0000 7f092bfff640 1 --2- 172.21.15.53:0/1356173821 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f093415cc70 0x7f0934159010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:42.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:42.410+0000 7f0938fe2640 1 --2- 172.21.15.53:0/1356173821 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f093415d0d0 0x7f093415a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:42.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:42.410+0000 7f0933fff640 1 -- 172.21.15.53:0/1356173821 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f093415cc70 msgr2=0x7f0934159010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:42.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:42.410+0000 7f0933fff640 1 --2- 172.21.15.53:0/1356173821 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f093415cc70 0x7f0934159010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:42.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:42.410+0000 7f0933fff640 1 -- 172.21.15.53:0/1356173821 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f093415d0d0 msgr2=0x7f093415a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:42.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:42.410+0000 7f0933fff640 1 --2- 172.21.15.53:0/1356173821 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f093415d0d0 0x7f093415a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:42.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:42.410+0000 7f0933fff640 1 -- 172.21.15.53:0/1356173821 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f092c009a70 con 0x7f09340afb10 2023-06-10T19:02:42.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:42.410+0000 7f0933fff640 1 --2- 172.21.15.53:0/1356173821 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09340afb10 0x7f0934157590 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f092400c3c0 tx=0x7f092400c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:42.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:42.410+0000 7f09317fa640 1 -- 172.21.15.53:0/1356173821 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09240052d0 con 0x7f09340afb10 2023-06-10T19:02:42.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:42.410+0000 7f09317fa640 1 -- 172.21.15.53:0/1356173821 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0924005430 con 0x7f09340afb10 2023-06-10T19:02:42.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:42.410+0000 7f093aa45640 1 -- 172.21.15.53:0/1356173821 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f091c0094d0 con 0x7f09340afb10 2023-06-10T19:02:42.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:42.410+0000 7f09317fa640 1 -- 172.21.15.53:0/1356173821 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0924003840 con 0x7f09340afb10 2023-06-10T19:02:42.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:42.410+0000 7f093aa45640 1 -- 172.21.15.53:0/1356173821 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f093406fd50 con 0x7f09340afb10 2023-06-10T19:02:42.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:42.410+0000 7f093aa45640 1 -- 172.21.15.53:0/1356173821 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f093404d790 con 0x7f09340afb10 2023-06-10T19:02:42.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:42.410+0000 7f09317fa640 1 -- 172.21.15.53:0/1356173821 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f09240039a0 con 0x7f09340afb10 2023-06-10T19:02:42.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:42.410+0000 7f09317fa640 1 --2- 172.21.15.53:0/1356173821 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0914066280 0x7f0914068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:42.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:42.410+0000 7f09317fa640 1 -- 172.21.15.53:0/1356173821 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6264+0+0 (secure 0 0 0) 0x7f0924083310 con 0x7f09340afb10 2023-06-10T19:02:42.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:42.410+0000 7f092bfff640 1 --2- 172.21.15.53:0/1356173821 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0914066280 0x7f0914068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:42.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:42.414+0000 7f092bfff640 1 --2- 172.21.15.53:0/1356173821 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0914066280 0x7f0914068730 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f091c0b2000 tx=0x7f091c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:42.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:42.414+0000 7f09317fa640 1 -- 172.21.15.53:0/1356173821 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0924050770 con 0x7f09340afb10 2023-06-10T19:02:42.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:42.602+0000 7f093aa45640 1 -- 172.21.15.53:0/1356173821 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f093406bf00 con 0x7f09340afb10 2023-06-10T19:02:42.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:42.606+0000 7f09317fa640 1 -- 172.21.15.53:0/1356173821 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+4683 (secure 0 0 0) 0x7f0924053d90 con 0x7f09340afb10 2023-06-10T19:02:42.608 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:02:42.608 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1617157670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1617157670},{"type":"v1","addr":"172.21.15.117:6836","nonce":1617157670}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6113,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3414416090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":3414416090},{"type":"v1","addr":"172.21.15.117:6837","nonce":3414416090}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6718,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2533467097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2533467097},{"type":"v1","addr":"172.21.15.53:6835","nonce":2533467097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:02:02.642809+0000","modified":"2023-06-10T19:02:36.149418+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8127":{"gid":8127,"name":"a","rank":0,"incarnation":52,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.53:6833/2984379521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2984379521},{"type":"v1","addr":"172.21.15.53:6833","nonce":2984379521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-06-10T19:02:42.608 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 53 2023-06-10T19:02:42.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:42.606+0000 7f093aa45640 1 -- 172.21.15.53:0/1356173821 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0914066280 msgr2=0x7f0914068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:42.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:42.606+0000 7f093aa45640 1 --2- 172.21.15.53:0/1356173821 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0914066280 0x7f0914068730 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f091c0b2000 tx=0x7f091c009040 comp rx=0 tx=0).stop 2023-06-10T19:02:42.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:42.606+0000 7f093aa45640 1 -- 172.21.15.53:0/1356173821 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09340afb10 msgr2=0x7f0934157590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:42.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:42.606+0000 7f093aa45640 1 --2- 172.21.15.53:0/1356173821 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09340afb10 0x7f0934157590 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f092400c3c0 tx=0x7f092400c7c0 comp rx=0 tx=0).stop 2023-06-10T19:02:42.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:42.606+0000 7f093aa45640 1 -- 172.21.15.53:0/1356173821 shutdown_connections 2023-06-10T19:02:42.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:42.606+0000 7f093aa45640 1 --2- 172.21.15.53:0/1356173821 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0914066280 0x7f0914068730 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:42.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:42.606+0000 7f093aa45640 1 --2- 172.21.15.53:0/1356173821 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f093415d0d0 0x7f093415a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:42.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:42.606+0000 7f093aa45640 1 --2- 172.21.15.53:0/1356173821 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f093415cc70 0x7f0934159010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:42.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:42.606+0000 7f093aa45640 1 --2- 172.21.15.53:0/1356173821 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09340afb10 0x7f0934157590 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:42.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:42.606+0000 7f093aa45640 1 -- 172.21.15.53:0/1356173821 >> 172.21.15.53:0/1356173821 conn(0x7f09340cab10 msgr2=0x7f09340caee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:42.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:42.606+0000 7f093aa45640 1 -- 172.21.15.53:0/1356173821 shutdown_connections 2023-06-10T19:02:42.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:42.606+0000 7f093aa45640 1 -- 172.21.15.53:0/1356173821 wait complete. 2023-06-10T19:02:42.627 DEBUG:tasks.cephfs.filesystem:mapped states ['up:reconnect'] to None 2023-06-10T19:02:43.628 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:02:43.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:43.762+0000 7f1394726640 1 Processor -- start 2023-06-10T19:02:43.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:43.762+0000 7f1394726640 1 -- start start 2023-06-10T19:02:43.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:43.762+0000 7f1394726640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f138c159450 0x7f138c15d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:43.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:43.762+0000 7f1394726640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f138c15d680 0x7f138c0cec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:43.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:43.762+0000 7f1394726640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f138c0cbac0 con 0x7f138c0cf180 2023-06-10T19:02:43.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:43.762+0000 7f1394726640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f138c0cf600 con 0x7f138c159450 2023-06-10T19:02:43.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:43.762+0000 7f1394726640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f138c15dc00 con 0x7f138c15d680 2023-06-10T19:02:43.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:43.762+0000 7f1391cc1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f138c15d680 0x7f138c0cec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:43.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:43.762+0000 7f13924c2640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f138c159450 0x7f138c15d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:43.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:43.762+0000 7f13924c2640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f138c159450 0x7f138c15d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.53:53266/0 (socket says 172.21.15.53:53266) 2023-06-10T19:02:43.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:43.762+0000 7f1392cc3640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f138c0cf180 0x7f138c0cda20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.53:58678/0 (socket says 172.21.15.53:58678) 2023-06-10T19:02:43.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:43.762+0000 7f1391cc1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f138c15d680 0x7f138c0cec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.53:59718/0 (socket says 172.21.15.53:59718) 2023-06-10T19:02:43.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:43.762+0000 7f13924c2640 1 -- 172.21.15.53:0/2973947381 learned_addr learned my addr 172.21.15.53:0/2973947381 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:43.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:43.762+0000 7f13924c2640 1 -- 172.21.15.53:0/2973947381 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f138c15d680 msgr2=0x7f138c0cec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:43.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:43.762+0000 7f13924c2640 1 --2- 172.21.15.53:0/2973947381 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f138c15d680 0x7f138c0cec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:43.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:43.762+0000 7f13924c2640 1 -- 172.21.15.53:0/2973947381 >> v1:172.21.15.117:6789/0 conn(0x7f138c0cf180 legacy=0x7f138c0cda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:43.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:43.762+0000 7f13924c2640 1 -- 172.21.15.53:0/2973947381 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f138c15dee0 con 0x7f138c159450 2023-06-10T19:02:43.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:43.762+0000 7f13914c0640 1 -- 172.21.15.53:0/2973947381 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2419722208 0 0) 0x7f138c0cbac0 con 0x7f138c0cf180 2023-06-10T19:02:43.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:43.762+0000 7f1391cc1640 1 --2- 172.21.15.53:0/2973947381 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f138c15d680 0x7f138c0cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-10T19:02:43.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:43.766+0000 7f13924c2640 1 --2- 172.21.15.53:0/2973947381 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f138c159450 0x7f138c15d140 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f1388009870 tx=0x7f138801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae5d014b7e8ec25e server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:43.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:43.766+0000 7f13914c0640 1 -- 172.21.15.53:0/2973947381 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13880ab640 con 0x7f138c159450 2023-06-10T19:02:43.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:43.766+0000 7f13914c0640 1 -- 172.21.15.53:0/2973947381 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13880a7070 con 0x7f138c159450 2023-06-10T19:02:43.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:43.766+0000 7f13914c0640 1 -- 172.21.15.53:0/2973947381 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13880ab9c0 con 0x7f138c159450 2023-06-10T19:02:43.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:43.766+0000 7f1394726640 1 -- 172.21.15.53:0/2973947381 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f138c159450 msgr2=0x7f138c15d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:43.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:43.766+0000 7f1394726640 1 --2- 172.21.15.53:0/2973947381 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f138c159450 0x7f138c15d140 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f1388009870 tx=0x7f138801c480 comp rx=0 tx=0).stop 2023-06-10T19:02:43.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:43.766+0000 7f1394726640 1 -- 172.21.15.53:0/2973947381 shutdown_connections 2023-06-10T19:02:43.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:43.766+0000 7f1394726640 1 --2- 172.21.15.53:0/2973947381 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f138c15d680 0x7f138c0cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:43.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:43.766+0000 7f1394726640 1 --2- 172.21.15.53:0/2973947381 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f138c159450 0x7f138c15d140 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:43.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:43.766+0000 7f1394726640 1 -- 172.21.15.53:0/2973947381 >> 172.21.15.53:0/2973947381 conn(0x7f138c06a090 msgr2=0x7f138c06d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:43.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:43.766+0000 7f1394726640 1 -- 172.21.15.53:0/2973947381 shutdown_connections 2023-06-10T19:02:43.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:43.766+0000 7f1394726640 1 -- 172.21.15.53:0/2973947381 wait complete. 2023-06-10T19:02:43.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:43.766+0000 7f1394726640 1 Processor -- start 2023-06-10T19:02:43.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:43.766+0000 7f1394726640 1 -- start start 2023-06-10T19:02:43.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:43.770+0000 7f1394726640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f138c0cf180 0x7f138c0b4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:43.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:43.770+0000 7f1394726640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f138c159450 0x7f138c0b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:43.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:43.770+0000 7f1394726640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f138c15d680 0x7f138c0c8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:43.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:43.770+0000 7f1394726640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f138c0b3d40 con 0x7f138c159450 2023-06-10T19:02:43.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:43.770+0000 7f1394726640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f138c0b56a0 con 0x7f138c15d680 2023-06-10T19:02:43.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:43.770+0000 7f1394726640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f138c0b3680 con 0x7f138c0cf180 2023-06-10T19:02:43.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:43.770+0000 7f1391cc1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f138c159450 0x7f138c0b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:43.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:43.770+0000 7f1391cc1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f138c159450 0x7f138c0b4e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52244/0 (socket says 172.21.15.53:52244) 2023-06-10T19:02:43.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:43.770+0000 7f1391cc1640 1 -- 172.21.15.53:0/3746852754 learned_addr learned my addr 172.21.15.53:0/3746852754 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:43.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:43.770+0000 7f13924c2640 1 --2- 172.21.15.53:0/3746852754 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f138c0cf180 0x7f138c0b4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:43.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:43.770+0000 7f1392cc3640 1 --2- 172.21.15.53:0/3746852754 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f138c15d680 0x7f138c0c8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:43.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:43.770+0000 7f1391cc1640 1 -- 172.21.15.53:0/3746852754 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f138c0cf180 msgr2=0x7f138c0b4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:43.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:43.770+0000 7f1391cc1640 1 --2- 172.21.15.53:0/3746852754 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f138c0cf180 0x7f138c0b4160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:43.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:43.770+0000 7f1391cc1640 1 -- 172.21.15.53:0/3746852754 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f138c15d680 msgr2=0x7f138c0c8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:43.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:43.770+0000 7f1391cc1640 1 --2- 172.21.15.53:0/3746852754 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f138c15d680 0x7f138c0c8e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:43.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:43.770+0000 7f1391cc1640 1 -- 172.21.15.53:0/3746852754 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f137c009420 con 0x7f138c159450 2023-06-10T19:02:43.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:43.770+0000 7f13924c2640 1 --2- 172.21.15.53:0/3746852754 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f138c0cf180 0x7f138c0b4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:02:43.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:43.770+0000 7f1392cc3640 1 --2- 172.21.15.53:0/3746852754 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f138c15d680 0x7f138c0c8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:02:43.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:43.770+0000 7f1391cc1640 1 --2- 172.21.15.53:0/3746852754 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f138c159450 0x7f138c0b4e10 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f137c00ebe0 tx=0x7f137c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:43.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:43.770+0000 7f1382ffd640 1 -- 172.21.15.53:0/3746852754 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f137c00eee0 con 0x7f138c159450 2023-06-10T19:02:43.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:43.770+0000 7f1382ffd640 1 -- 172.21.15.53:0/3746852754 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f137c00cc30 con 0x7f138c159450 2023-06-10T19:02:43.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:43.770+0000 7f1394726640 1 -- 172.21.15.53:0/3746852754 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13880094d0 con 0x7f138c159450 2023-06-10T19:02:43.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:43.770+0000 7f1382ffd640 1 -- 172.21.15.53:0/3746852754 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f137c013470 con 0x7f138c159450 2023-06-10T19:02:43.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:43.770+0000 7f1394726640 1 -- 172.21.15.53:0/3746852754 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f138c0b5980 con 0x7f138c159450 2023-06-10T19:02:43.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:43.770+0000 7f1394726640 1 -- 172.21.15.53:0/3746852754 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f138c0b3fb0 con 0x7f138c159450 2023-06-10T19:02:43.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:43.770+0000 7f1382ffd640 1 -- 172.21.15.53:0/3746852754 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f137c0135d0 con 0x7f138c159450 2023-06-10T19:02:43.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:43.770+0000 7f1382ffd640 1 --2- 172.21.15.53:0/3746852754 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1370066280 0x7f1370068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:43.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:43.770+0000 7f1382ffd640 1 -- 172.21.15.53:0/3746852754 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6264+0+0 (secure 0 0 0) 0x7f137c0840c0 con 0x7f138c159450 2023-06-10T19:02:43.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:43.774+0000 7f13924c2640 1 --2- 172.21.15.53:0/3746852754 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1370066280 0x7f1370068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:43.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:43.774+0000 7f13924c2640 1 --2- 172.21.15.53:0/3746852754 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1370066280 0x7f1370068730 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f13880af000 tx=0x7f13880a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:43.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:43.774+0000 7f1382ffd640 1 -- 172.21.15.53:0/3746852754 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f137c054f90 con 0x7f138c159450 2023-06-10T19:02:43.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:43.962+0000 7f1394726640 1 -- 172.21.15.53:0/3746852754 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f138c04d790 con 0x7f138c159450 2023-06-10T19:02:43.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:43.966+0000 7f1382ffd640 1 -- 172.21.15.53:0/3746852754 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+4683 (secure 0 0 0) 0x7f137c054b20 con 0x7f138c159450 2023-06-10T19:02:43.968 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:02:43.968 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1617157670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1617157670},{"type":"v1","addr":"172.21.15.117:6836","nonce":1617157670}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6113,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3414416090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":3414416090},{"type":"v1","addr":"172.21.15.117:6837","nonce":3414416090}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6718,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2533467097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2533467097},{"type":"v1","addr":"172.21.15.53:6835","nonce":2533467097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:02:02.642809+0000","modified":"2023-06-10T19:02:36.149418+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8127":{"gid":8127,"name":"a","rank":0,"incarnation":52,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.53:6833/2984379521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2984379521},{"type":"v1","addr":"172.21.15.53:6833","nonce":2984379521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-06-10T19:02:43.968 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 53 2023-06-10T19:02:43.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:43.966+0000 7f1394726640 1 -- 172.21.15.53:0/3746852754 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1370066280 msgr2=0x7f1370068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:43.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:43.966+0000 7f1394726640 1 --2- 172.21.15.53:0/3746852754 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1370066280 0x7f1370068730 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f13880af000 tx=0x7f13880a7000 comp rx=0 tx=0).stop 2023-06-10T19:02:43.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:43.966+0000 7f1394726640 1 -- 172.21.15.53:0/3746852754 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f138c159450 msgr2=0x7f138c0b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:43.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:43.966+0000 7f1394726640 1 --2- 172.21.15.53:0/3746852754 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f138c159450 0x7f138c0b4e10 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f137c00ebe0 tx=0x7f137c00c520 comp rx=0 tx=0).stop 2023-06-10T19:02:43.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:43.966+0000 7f1394726640 1 -- 172.21.15.53:0/3746852754 shutdown_connections 2023-06-10T19:02:43.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:43.966+0000 7f1394726640 1 --2- 172.21.15.53:0/3746852754 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1370066280 0x7f1370068730 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:43.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:43.966+0000 7f1394726640 1 --2- 172.21.15.53:0/3746852754 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f138c15d680 0x7f138c0c8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:43.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:43.966+0000 7f1394726640 1 --2- 172.21.15.53:0/3746852754 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f138c159450 0x7f138c0b4e10 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:43.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:43.966+0000 7f1394726640 1 --2- 172.21.15.53:0/3746852754 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f138c0cf180 0x7f138c0b4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:43.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:43.966+0000 7f1394726640 1 -- 172.21.15.53:0/3746852754 >> 172.21.15.53:0/3746852754 conn(0x7f138c06a090 msgr2=0x7f138c0b0ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:43.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:43.966+0000 7f1394726640 1 -- 172.21.15.53:0/3746852754 shutdown_connections 2023-06-10T19:02:43.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:43.966+0000 7f1394726640 1 -- 172.21.15.53:0/3746852754 wait complete. 2023-06-10T19:02:43.988 DEBUG:tasks.cephfs.filesystem:mapped states ['up:reconnect'] to None 2023-06-10T19:02:44.989 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:02:45.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.118+0000 7f71a472c640 1 Processor -- start 2023-06-10T19:02:45.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.122+0000 7f71a472c640 1 -- start start 2023-06-10T19:02:45.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.122+0000 7f71a472c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f719c0c9750 0x7f719c0aced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:45.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.122+0000 7f71a472c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f719c0afe30 0x7f719c0aba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:45.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.122+0000 7f71a472c640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f719c0ad410 con 0x7f719c0cb870 2023-06-10T19:02:45.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.122+0000 7f71a472c640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f719c0cd990 con 0x7f719c0afe30 2023-06-10T19:02:45.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.122+0000 7f71a472c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f719c1600d0 con 0x7f719c0c9750 2023-06-10T19:02:45.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.122+0000 7f71a1cc7640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f719c0cb870 0x7f719c0af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60008/0 (socket says 172.21.15.53:60008) 2023-06-10T19:02:45.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.122+0000 7f71a1cc7640 1 -- 172.21.15.53:0/2922080488 learned_addr learned my addr 172.21.15.53:0/2922080488 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:02:45.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.122+0000 7f71a2cc9640 1 --2- 172.21.15.53:0/2922080488 >> v2:172.21.15.117:3300/0 conn(0x7f719c0afe30 0x7f719c0aba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:45.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.122+0000 7f71a24c8640 1 --2- 172.21.15.53:0/2922080488 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f719c0c9750 0x7f719c0aced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:45.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.122+0000 7f71a14c6640 1 -- 172.21.15.53:0/2922080488 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2308728538 0 0) 0x7f719c0ad410 con 0x7f719c0cb870 2023-06-10T19:02:45.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.122+0000 7f71a14c6640 1 -- 172.21.15.53:0/2922080488 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7188003530 con 0x7f719c0cb870 2023-06-10T19:02:45.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.122+0000 7f71a14c6640 1 -- 172.21.15.53:0/2922080488 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1449918056 0 0) 0x7f7188003530 con 0x7f719c0cb870 2023-06-10T19:02:45.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.122+0000 7f71a14c6640 1 -- 172.21.15.53:0/2922080488 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f719c0c9750 msgr2=0x7f719c0aced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:45.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.122+0000 7f71a14c6640 1 --2- 172.21.15.53:0/2922080488 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f719c0c9750 0x7f719c0aced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:45.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.122+0000 7f71a14c6640 1 -- 172.21.15.53:0/2922080488 >> v2:172.21.15.117:3300/0 conn(0x7f719c0afe30 msgr2=0x7f719c0aba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:45.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.122+0000 7f71a14c6640 1 --2- 172.21.15.53:0/2922080488 >> v2:172.21.15.117:3300/0 conn(0x7f719c0afe30 0x7f719c0aba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:45.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.122+0000 7f71a14c6640 1 -- 172.21.15.53:0/2922080488 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f719c160370 con 0x7f719c0cb870 2023-06-10T19:02:45.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.122+0000 7f71a14c6640 1 -- 172.21.15.53:0/2922080488 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f7198001a00 con 0x7f719c0cb870 2023-06-10T19:02:45.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.122+0000 7f71a24c8640 1 --2- 172.21.15.53:0/2922080488 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f719c0c9750 0x7f719c0aced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:02:45.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.122+0000 7f71a14c6640 1 -- 172.21.15.53:0/2922080488 >> v1:172.21.15.53:6789/0 conn(0x7f719c0cb870 legacy=0x7f719c0af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:45.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.122+0000 7f71a14c6640 1 --2- 172.21.15.53:0/2922080488 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71880039f0 0x7f7188003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:45.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.122+0000 7f71a14c6640 1 --2- 172.21.15.53:0/2922080488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71880047d0 0x7f7188004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:45.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.122+0000 7f71a14c6640 1 --2- 172.21.15.53:0/2922080488 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f719c0c9750 0x7f7188005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:45.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.122+0000 7f71a14c6640 1 -- 172.21.15.53:0/2922080488 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f719c0cd990 con 0x7f71880047d0 2023-06-10T19:02:45.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.122+0000 7f71a14c6640 1 -- 172.21.15.53:0/2922080488 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f719c1600d0 con 0x7f71880039f0 2023-06-10T19:02:45.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.122+0000 7f71a14c6640 1 -- 172.21.15.53:0/2922080488 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f718800ba10 con 0x7f719c0c9750 2023-06-10T19:02:45.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.122+0000 7f71a1cc7640 1 --2- 172.21.15.53:0/2922080488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71880047d0 0x7f7188004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:45.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.122+0000 7f71a24c8640 1 --2- 172.21.15.53:0/2922080488 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71880039f0 0x7f7188003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:45.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.122+0000 7f71a1cc7640 1 -- 172.21.15.53:0/2922080488 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f719c0c9750 msgr2=0x7f7188005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:45.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.122+0000 7f71a1cc7640 1 --2- 172.21.15.53:0/2922080488 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f719c0c9750 0x7f7188005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:45.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.122+0000 7f71a1cc7640 1 -- 172.21.15.53:0/2922080488 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71880039f0 msgr2=0x7f7188003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:45.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.122+0000 7f71a1cc7640 1 --2- 172.21.15.53:0/2922080488 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71880039f0 0x7f7188003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:45.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.122+0000 7f71a1cc7640 1 -- 172.21.15.53:0/2922080488 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7188003530 con 0x7f71880047d0 2023-06-10T19:02:45.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.126+0000 7f71a1cc7640 1 --2- 172.21.15.53:0/2922080488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71880047d0 0x7f7188004c40 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f719800a790 tx=0x7f719801fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3659fde5c2f0d189 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:45.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.126+0000 7f71a14c6640 1 -- 172.21.15.53:0/2922080488 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71980ad640 con 0x7f71880047d0 2023-06-10T19:02:45.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.126+0000 7f71a14c6640 1 -- 172.21.15.53:0/2922080488 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71980ad7a0 con 0x7f71880047d0 2023-06-10T19:02:45.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.126+0000 7f71a14c6640 1 -- 172.21.15.53:0/2922080488 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71980adb90 con 0x7f71880047d0 2023-06-10T19:02:45.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.126+0000 7f71a472c640 1 -- 172.21.15.53:0/2922080488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71880047d0 msgr2=0x7f7188004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:45.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.126+0000 7f71a472c640 1 --2- 172.21.15.53:0/2922080488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71880047d0 0x7f7188004c40 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f719800a790 tx=0x7f719801fa00 comp rx=0 tx=0).stop 2023-06-10T19:02:45.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.126+0000 7f71a2cc9640 1 -- 172.21.15.53:0/2922080488 reap_dead start 2023-06-10T19:02:45.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.126+0000 7f71a472c640 1 -- 172.21.15.53:0/2922080488 shutdown_connections 2023-06-10T19:02:45.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.126+0000 7f71a472c640 1 -- 172.21.15.53:0/2922080488 >> 172.21.15.53:0/2922080488 conn(0x7f719c06a0d0 msgr2=0x7f719c0ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:45.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.126+0000 7f71a472c640 1 -- 172.21.15.53:0/2922080488 shutdown_connections 2023-06-10T19:02:45.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.126+0000 7f71a472c640 1 -- 172.21.15.53:0/2922080488 wait complete. 2023-06-10T19:02:45.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.126+0000 7f71a472c640 1 Processor -- start 2023-06-10T19:02:45.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.126+0000 7f71a472c640 1 -- start start 2023-06-10T19:02:45.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.126+0000 7f71a472c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f719c1f0c60 0x7f719c159c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:45.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.126+0000 7f71a472c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f719c0ae750 0x7f719c0aeba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:45.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.126+0000 7f71a472c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f719c0b0ad0 0x7f719c0b0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:45.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.126+0000 7f71a472c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f719c0af0e0 con 0x7f719c0b0ad0 2023-06-10T19:02:45.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.126+0000 7f71a472c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f719c15a140 con 0x7f719c0ae750 2023-06-10T19:02:45.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.126+0000 7f71a472c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f719c0c2140 con 0x7f719c1f0c60 2023-06-10T19:02:45.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.126+0000 7f71a2cc9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f719c0b0ad0 0x7f719c0b0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:45.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.126+0000 7f71a2cc9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f719c0b0ad0 0x7f719c0b0f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52262/0 (socket says 172.21.15.53:52262) 2023-06-10T19:02:45.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.126+0000 7f71a2cc9640 1 -- 172.21.15.53:0/1051110747 learned_addr learned my addr 172.21.15.53:0/1051110747 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:45.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.130+0000 7f71a1cc7640 1 --2- 172.21.15.53:0/1051110747 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f719c0ae750 0x7f719c0aeba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:45.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.130+0000 7f71a24c8640 1 --2- 172.21.15.53:0/1051110747 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f719c1f0c60 0x7f719c159c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:45.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.130+0000 7f71a2cc9640 1 -- 172.21.15.53:0/1051110747 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f719c1f0c60 msgr2=0x7f719c159c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:45.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.130+0000 7f71a2cc9640 1 --2- 172.21.15.53:0/1051110747 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f719c1f0c60 0x7f719c159c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:45.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.130+0000 7f71a2cc9640 1 -- 172.21.15.53:0/1051110747 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f719c0ae750 msgr2=0x7f719c0aeba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:45.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.130+0000 7f71a2cc9640 1 --2- 172.21.15.53:0/1051110747 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f719c0ae750 0x7f719c0aeba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:45.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.130+0000 7f71a2cc9640 1 -- 172.21.15.53:0/1051110747 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f719c1581b0 con 0x7f719c0b0ad0 2023-06-10T19:02:45.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.130+0000 7f71a2cc9640 1 --2- 172.21.15.53:0/1051110747 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f719c0b0ad0 0x7f719c0b0f40 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f719c15f480 tx=0x7f719400e830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:45.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.130+0000 7f718effd640 1 -- 172.21.15.53:0/1051110747 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f719400ed90 con 0x7f719c0b0ad0 2023-06-10T19:02:45.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.130+0000 7f718effd640 1 -- 172.21.15.53:0/1051110747 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7194013470 con 0x7f719c0b0ad0 2023-06-10T19:02:45.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.130+0000 7f71a472c640 1 -- 172.21.15.53:0/1051110747 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f719c158490 con 0x7f719c0b0ad0 2023-06-10T19:02:45.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.130+0000 7f718effd640 1 -- 172.21.15.53:0/1051110747 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7194013820 con 0x7f719c0b0ad0 2023-06-10T19:02:45.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.130+0000 7f71a472c640 1 -- 172.21.15.53:0/1051110747 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f719c158a50 con 0x7f719c0b0ad0 2023-06-10T19:02:45.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.130+0000 7f71a472c640 1 -- 172.21.15.53:0/1051110747 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f719c158c10 con 0x7f719c0b0ad0 2023-06-10T19:02:45.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.130+0000 7f718effd640 1 -- 172.21.15.53:0/1051110747 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7194013980 con 0x7f719c0b0ad0 2023-06-10T19:02:45.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.130+0000 7f718effd640 1 --2- 172.21.15.53:0/1051110747 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7180066280 0x7f7180068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:45.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.130+0000 7f718effd640 1 -- 172.21.15.53:0/1051110747 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6264+0+0 (secure 0 0 0) 0x7f7194082ee0 con 0x7f719c0b0ad0 2023-06-10T19:02:45.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.130+0000 7f71a24c8640 1 --2- 172.21.15.53:0/1051110747 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7180066280 0x7f7180068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:45.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.130+0000 7f71a24c8640 1 --2- 172.21.15.53:0/1051110747 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7180066280 0x7f7180068730 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f719000c640 tx=0x7f7190008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:45.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.134+0000 7f718effd640 1 -- 172.21.15.53:0/1051110747 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7194050200 con 0x7f719c0b0ad0 2023-06-10T19:02:45.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.322+0000 7f71a472c640 1 -- 172.21.15.53:0/1051110747 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f719c04d790 con 0x7f719c0b0ad0 2023-06-10T19:02:45.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.322+0000 7f718effd640 1 -- 172.21.15.53:0/1051110747 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+4683 (secure 0 0 0) 0x7f7194053820 con 0x7f719c0b0ad0 2023-06-10T19:02:45.326 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:02:45.326 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1617157670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1617157670},{"type":"v1","addr":"172.21.15.117:6836","nonce":1617157670}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6113,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3414416090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":3414416090},{"type":"v1","addr":"172.21.15.117:6837","nonce":3414416090}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6718,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2533467097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2533467097},{"type":"v1","addr":"172.21.15.53:6835","nonce":2533467097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:02:02.642809+0000","modified":"2023-06-10T19:02:36.149418+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8127":{"gid":8127,"name":"a","rank":0,"incarnation":52,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.53:6833/2984379521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2984379521},{"type":"v1","addr":"172.21.15.53:6833","nonce":2984379521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-06-10T19:02:45.326 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 53 2023-06-10T19:02:45.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.326+0000 7f71a472c640 1 -- 172.21.15.53:0/1051110747 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7180066280 msgr2=0x7f7180068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:45.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.326+0000 7f71a472c640 1 --2- 172.21.15.53:0/1051110747 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7180066280 0x7f7180068730 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f719000c640 tx=0x7f7190008040 comp rx=0 tx=0).stop 2023-06-10T19:02:45.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.326+0000 7f71a472c640 1 -- 172.21.15.53:0/1051110747 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f719c0b0ad0 msgr2=0x7f719c0b0f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:45.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.326+0000 7f71a472c640 1 --2- 172.21.15.53:0/1051110747 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f719c0b0ad0 0x7f719c0b0f40 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f719c15f480 tx=0x7f719400e830 comp rx=0 tx=0).stop 2023-06-10T19:02:45.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.326+0000 7f71a472c640 1 -- 172.21.15.53:0/1051110747 shutdown_connections 2023-06-10T19:02:45.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.326+0000 7f71a472c640 1 --2- 172.21.15.53:0/1051110747 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7180066280 0x7f7180068730 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:45.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.326+0000 7f71a472c640 1 --2- 172.21.15.53:0/1051110747 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f719c0b0ad0 0x7f719c0b0f40 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:45.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.326+0000 7f71a472c640 1 --2- 172.21.15.53:0/1051110747 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f719c0ae750 0x7f719c0aeba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:45.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.326+0000 7f71a472c640 1 --2- 172.21.15.53:0/1051110747 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f719c1f0c60 0x7f719c159c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:45.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.326+0000 7f71a472c640 1 -- 172.21.15.53:0/1051110747 >> 172.21.15.53:0/1051110747 conn(0x7f719c06a0d0 msgr2=0x7f719c15bec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:45.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.326+0000 7f71a472c640 1 -- 172.21.15.53:0/1051110747 shutdown_connections 2023-06-10T19:02:45.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:45.326+0000 7f71a472c640 1 -- 172.21.15.53:0/1051110747 wait complete. 2023-06-10T19:02:45.346 DEBUG:tasks.cephfs.filesystem:mapped states ['up:reconnect'] to None 2023-06-10T19:02:46.347 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:02:46.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.478+0000 7f5b89767640 1 Processor -- start 2023-06-10T19:02:46.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.478+0000 7f5b89767640 1 -- start start 2023-06-10T19:02:46.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.482+0000 7f5b89767640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b8415c7f0 0x7f5b8415f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:46.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.482+0000 7f5b89767640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b8415cc40 con 0x7f5b8415f860 2023-06-10T19:02:46.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.482+0000 7f5b89767640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b840af530 con 0x7f5b8406b780 2023-06-10T19:02:46.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.482+0000 7f5b89767640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8415c3d0 con 0x7f5b8415c7f0 2023-06-10T19:02:46.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.482+0000 7f5b837fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f5b8415f860 0x7f5b840ceb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60018/0 (socket says 172.21.15.53:60018) 2023-06-10T19:02:46.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.482+0000 7f5b837fe640 1 -- 172.21.15.53:0/1096002228 learned_addr learned my addr 172.21.15.53:0/1096002228 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:02:46.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.482+0000 7f5b827fc640 1 --2- 172.21.15.53:0/1096002228 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b8415c7f0 0x7f5b8415f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:46.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.482+0000 7f5b81ffb640 1 -- 172.21.15.53:0/1096002228 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3562403020 0 0) 0x7f5b8415cc40 con 0x7f5b8415f860 2023-06-10T19:02:46.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.482+0000 7f5b81ffb640 1 -- 172.21.15.53:0/1096002228 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b6c003530 con 0x7f5b8415f860 2023-06-10T19:02:46.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.482+0000 7f5b81ffb640 1 -- 172.21.15.53:0/1096002228 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 897515867 0 0) 0x7f5b840af530 con 0x7f5b8406b780 2023-06-10T19:02:46.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.482+0000 7f5b81ffb640 1 -- 172.21.15.53:0/1096002228 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b8415cc40 con 0x7f5b8406b780 2023-06-10T19:02:46.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.482+0000 7f5b81ffb640 1 -- 172.21.15.53:0/1096002228 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2409565101 0 0) 0x7f5b6c003530 con 0x7f5b8415f860 2023-06-10T19:02:46.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.482+0000 7f5b81ffb640 1 -- 172.21.15.53:0/1096002228 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b8415c7f0 msgr2=0x7f5b8415f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:46.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.482+0000 7f5b81ffb640 1 --2- 172.21.15.53:0/1096002228 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b8415c7f0 0x7f5b8415f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:46.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.482+0000 7f5b81ffb640 1 -- 172.21.15.53:0/1096002228 >> v1:172.21.15.117:6789/0 conn(0x7f5b8406b780 legacy=0x7f5b8406bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:46.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.482+0000 7f5b81ffb640 1 -- 172.21.15.53:0/1096002228 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b8415fd70 con 0x7f5b8415f860 2023-06-10T19:02:46.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.482+0000 7f5b81ffb640 1 -- 172.21.15.53:0/1096002228 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f5b7c001a00 con 0x7f5b8415f860 2023-06-10T19:02:46.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.482+0000 7f5b81ffb640 1 -- 172.21.15.53:0/1096002228 >> v1:172.21.15.53:6789/0 conn(0x7f5b8415f860 legacy=0x7f5b840ceb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:46.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.482+0000 7f5b81ffb640 1 --2- 172.21.15.53:0/1096002228 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b6c003bb0 0x7f5b6c003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:46.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.482+0000 7f5b81ffb640 1 --2- 172.21.15.53:0/1096002228 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b6c0047d0 0x7f5b6c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:46.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.482+0000 7f5b81ffb640 1 --2- 172.21.15.53:0/1096002228 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b8415c7f0 0x7f5b6c0051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:46.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.482+0000 7f5b81ffb640 1 -- 172.21.15.53:0/1096002228 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8415c3d0 con 0x7f5b6c003bb0 2023-06-10T19:02:46.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.482+0000 7f5b82ffd640 1 --2- 172.21.15.53:0/1096002228 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b6c003bb0 0x7f5b6c003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:46.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.482+0000 7f5b81ffb640 1 -- 172.21.15.53:0/1096002228 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6c00bb20 con 0x7f5b6c0047d0 2023-06-10T19:02:46.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.482+0000 7f5b81ffb640 1 -- 172.21.15.53:0/1096002228 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6c00bce0 con 0x7f5b8415c7f0 2023-06-10T19:02:46.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.482+0000 7f5b827fc640 1 --2- 172.21.15.53:0/1096002228 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b6c0047d0 0x7f5b6c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:46.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.482+0000 7f5b837fe640 1 --2- 172.21.15.53:0/1096002228 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b8415c7f0 0x7f5b6c0051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:46.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.482+0000 7f5b82ffd640 1 -- 172.21.15.53:0/1096002228 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b8415c7f0 msgr2=0x7f5b6c0051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:46.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.482+0000 7f5b82ffd640 1 --2- 172.21.15.53:0/1096002228 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b8415c7f0 0x7f5b6c0051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:46.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.482+0000 7f5b82ffd640 1 -- 172.21.15.53:0/1096002228 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b6c0047d0 msgr2=0x7f5b6c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:46.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.482+0000 7f5b82ffd640 1 --2- 172.21.15.53:0/1096002228 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b6c0047d0 0x7f5b6c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:46.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.482+0000 7f5b82ffd640 1 -- 172.21.15.53:0/1096002228 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b6c003530 con 0x7f5b6c003bb0 2023-06-10T19:02:46.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.482+0000 7f5b837fe640 1 --2- 172.21.15.53:0/1096002228 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b8415c7f0 0x7f5b6c0051e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:02:46.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.486+0000 7f5b82ffd640 1 --2- 172.21.15.53:0/1096002228 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b6c003bb0 0x7f5b6c003f80 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f5b740018d0 tx=0x7f5b840cfa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32954680023a982f server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:46.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.486+0000 7f5b81ffb640 1 -- 172.21.15.53:0/1096002228 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b740052d0 con 0x7f5b6c003bb0 2023-06-10T19:02:46.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.486+0000 7f5b81ffb640 1 -- 172.21.15.53:0/1096002228 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b74005450 con 0x7f5b6c003bb0 2023-06-10T19:02:46.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.486+0000 7f5b81ffb640 1 -- 172.21.15.53:0/1096002228 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b74003840 con 0x7f5b6c003bb0 2023-06-10T19:02:46.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.486+0000 7f5b89767640 1 -- 172.21.15.53:0/1096002228 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b6c003bb0 msgr2=0x7f5b6c003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:46.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.486+0000 7f5b89767640 1 --2- 172.21.15.53:0/1096002228 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b6c003bb0 0x7f5b6c003f80 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f5b740018d0 tx=0x7f5b840cfa40 comp rx=0 tx=0).stop 2023-06-10T19:02:46.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.486+0000 7f5b837fe640 1 -- 172.21.15.53:0/1096002228 reap_dead start 2023-06-10T19:02:46.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.486+0000 7f5b89767640 1 -- 172.21.15.53:0/1096002228 shutdown_connections 2023-06-10T19:02:46.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.486+0000 7f5b89767640 1 -- 172.21.15.53:0/1096002228 >> 172.21.15.53:0/1096002228 conn(0x7f5b8406a090 msgr2=0x7f5b8406d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:46.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.486+0000 7f5b89767640 1 -- 172.21.15.53:0/1096002228 shutdown_connections 2023-06-10T19:02:46.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.486+0000 7f5b89767640 1 -- 172.21.15.53:0/1096002228 wait complete. 2023-06-10T19:02:46.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.486+0000 7f5b89767640 1 Processor -- start 2023-06-10T19:02:46.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.486+0000 7f5b89767640 1 -- start start 2023-06-10T19:02:46.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.486+0000 7f5b89767640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b6c003bb0 0x7f5b840cae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:46.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.486+0000 7f5b89767640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b840c9260 0x7f5b841f79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:46.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.486+0000 7f5b89767640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b841f3450 0x7f5b841f38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:46.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.486+0000 7f5b89767640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b841578d0 con 0x7f5b6c003bb0 2023-06-10T19:02:46.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.486+0000 7f5b89767640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b84157bb0 con 0x7f5b841f3450 2023-06-10T19:02:46.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.486+0000 7f5b89767640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b84157e90 con 0x7f5b840c9260 2023-06-10T19:02:46.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.490+0000 7f5b82ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b6c003bb0 0x7f5b840cae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:46.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.490+0000 7f5b82ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b6c003bb0 0x7f5b840cae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52280/0 (socket says 172.21.15.53:52280) 2023-06-10T19:02:46.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.490+0000 7f5b82ffd640 1 -- 172.21.15.53:0/2224663698 learned_addr learned my addr 172.21.15.53:0/2224663698 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:46.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.490+0000 7f5b837fe640 1 --2- 172.21.15.53:0/2224663698 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b841f3450 0x7f5b841f38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:46.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.490+0000 7f5b827fc640 1 --2- 172.21.15.53:0/2224663698 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b840c9260 0x7f5b841f79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:46.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.490+0000 7f5b82ffd640 1 -- 172.21.15.53:0/2224663698 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b840c9260 msgr2=0x7f5b841f79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:46.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.490+0000 7f5b82ffd640 1 --2- 172.21.15.53:0/2224663698 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b840c9260 0x7f5b841f79b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:46.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.490+0000 7f5b82ffd640 1 -- 172.21.15.53:0/2224663698 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b841f3450 msgr2=0x7f5b841f38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:46.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.490+0000 7f5b82ffd640 1 --2- 172.21.15.53:0/2224663698 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b841f3450 0x7f5b841f38f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:46.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.490+0000 7f5b82ffd640 1 -- 172.21.15.53:0/2224663698 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b84158170 con 0x7f5b6c003bb0 2023-06-10T19:02:46.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.490+0000 7f5b82ffd640 1 --2- 172.21.15.53:0/2224663698 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b6c003bb0 0x7f5b840cae90 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f5b740018d0 tx=0x7f5b6c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:46.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.490+0000 7f5b6b7fe640 1 -- 172.21.15.53:0/2224663698 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b74003d00 con 0x7f5b6c003bb0 2023-06-10T19:02:46.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.490+0000 7f5b6b7fe640 1 -- 172.21.15.53:0/2224663698 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b740a6070 con 0x7f5b6c003bb0 2023-06-10T19:02:46.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.490+0000 7f5b89767640 1 -- 172.21.15.53:0/2224663698 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b84158450 con 0x7f5b6c003bb0 2023-06-10T19:02:46.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.490+0000 7f5b6b7fe640 1 -- 172.21.15.53:0/2224663698 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b740052f0 con 0x7f5b6c003bb0 2023-06-10T19:02:46.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.490+0000 7f5b89767640 1 -- 172.21.15.53:0/2224663698 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b84158970 con 0x7f5b6c003bb0 2023-06-10T19:02:46.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.490+0000 7f5b89767640 1 -- 172.21.15.53:0/2224663698 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b84158970 con 0x7f5b6c003bb0 2023-06-10T19:02:46.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.490+0000 7f5b6b7fe640 1 -- 172.21.15.53:0/2224663698 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5b740c2460 con 0x7f5b6c003bb0 2023-06-10T19:02:46.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.490+0000 7f5b6b7fe640 1 --2- 172.21.15.53:0/2224663698 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5b700662b0 0x7f5b70068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:46.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.490+0000 7f5b6b7fe640 1 -- 172.21.15.53:0/2224663698 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6264+0+0 (secure 0 0 0) 0x7f5b7411e180 con 0x7f5b6c003bb0 2023-06-10T19:02:46.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.490+0000 7f5b827fc640 1 --2- 172.21.15.53:0/2224663698 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5b700662b0 0x7f5b70068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:46.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.494+0000 7f5b827fc640 1 --2- 172.21.15.53:0/2224663698 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5b700662b0 0x7f5b70068760 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f5b840cd440 tx=0x7f5b78008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:46.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.494+0000 7f5b6b7fe640 1 -- 172.21.15.53:0/2224663698 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5b740eb5c0 con 0x7f5b6c003bb0 2023-06-10T19:02:46.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.682+0000 7f5b89767640 1 -- 172.21.15.53:0/2224663698 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5b84158970 con 0x7f5b6c003bb0 2023-06-10T19:02:46.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.682+0000 7f5b6b7fe640 1 -- 172.21.15.53:0/2224663698 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+4683 (secure 0 0 0) 0x7f5b74003e60 con 0x7f5b6c003bb0 2023-06-10T19:02:46.687 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:02:46.687 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1617157670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1617157670},{"type":"v1","addr":"172.21.15.117:6836","nonce":1617157670}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6113,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3414416090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":3414416090},{"type":"v1","addr":"172.21.15.117:6837","nonce":3414416090}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6718,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2533467097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2533467097},{"type":"v1","addr":"172.21.15.53:6835","nonce":2533467097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:02:02.642809+0000","modified":"2023-06-10T19:02:36.149418+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8127":{"gid":8127,"name":"a","rank":0,"incarnation":52,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.53:6833/2984379521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2984379521},{"type":"v1","addr":"172.21.15.53:6833","nonce":2984379521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-06-10T19:02:46.688 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 53 2023-06-10T19:02:46.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.686+0000 7f5b89767640 1 -- 172.21.15.53:0/2224663698 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5b700662b0 msgr2=0x7f5b70068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:46.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.686+0000 7f5b89767640 1 --2- 172.21.15.53:0/2224663698 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5b700662b0 0x7f5b70068760 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f5b840cd440 tx=0x7f5b78008040 comp rx=0 tx=0).stop 2023-06-10T19:02:46.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.686+0000 7f5b89767640 1 -- 172.21.15.53:0/2224663698 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b6c003bb0 msgr2=0x7f5b840cae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:46.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.686+0000 7f5b89767640 1 --2- 172.21.15.53:0/2224663698 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b6c003bb0 0x7f5b840cae90 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f5b740018d0 tx=0x7f5b6c005800 comp rx=0 tx=0).stop 2023-06-10T19:02:46.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.686+0000 7f5b89767640 1 -- 172.21.15.53:0/2224663698 shutdown_connections 2023-06-10T19:02:46.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.686+0000 7f5b89767640 1 --2- 172.21.15.53:0/2224663698 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5b700662b0 0x7f5b70068760 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:46.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.686+0000 7f5b89767640 1 --2- 172.21.15.53:0/2224663698 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b841f3450 0x7f5b841f38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:46.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.686+0000 7f5b89767640 1 --2- 172.21.15.53:0/2224663698 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5b840c9260 0x7f5b841f79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:46.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.686+0000 7f5b89767640 1 --2- 172.21.15.53:0/2224663698 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b6c003bb0 0x7f5b840cae90 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:46.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.686+0000 7f5b89767640 1 -- 172.21.15.53:0/2224663698 >> 172.21.15.53:0/2224663698 conn(0x7f5b8406a090 msgr2=0x7f5b84161de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:46.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.686+0000 7f5b89767640 1 -- 172.21.15.53:0/2224663698 shutdown_connections 2023-06-10T19:02:46.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:46.686+0000 7f5b89767640 1 -- 172.21.15.53:0/2224663698 wait complete. 2023-06-10T19:02:46.704 DEBUG:tasks.cephfs.filesystem:mapped states ['up:reconnect'] to None 2023-06-10T19:02:47.705 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:02:47.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:47.838+0000 7f14b06e4640 1 Processor -- start 2023-06-10T19:02:47.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:47.838+0000 7f14b06e4640 1 -- start start 2023-06-10T19:02:47.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:47.838+0000 7f14b06e4640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f14a806efc0 0x7f14a806bb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:47.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:47.838+0000 7f14b06e4640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14a80c9e50 con 0x7f14a80afe30 2023-06-10T19:02:47.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:47.842+0000 7f14b06e4640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14a80c82f0 con 0x7f14a8157e10 2023-06-10T19:02:47.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:47.842+0000 7f14b06e4640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14a806f390 con 0x7f14a806efc0 2023-06-10T19:02:47.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:47.842+0000 7f14adc7f640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f14a80afe30 0x7f14a815bc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60030/0 (socket says 172.21.15.53:60030) 2023-06-10T19:02:47.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:47.842+0000 7f14aec81640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f14a806efc0 0x7f14a806bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:47.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:47.842+0000 7f14adc7f640 1 -- 172.21.15.53:0/3967978317 learned_addr learned my addr 172.21.15.53:0/3967978317 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:02:47.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:47.842+0000 7f14aec81640 1 -- 172.21.15.53:0/3967978317 >> v1:172.21.15.117:6789/0 conn(0x7f14a8157e10 legacy=0x7f14a80af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:47.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:47.842+0000 7f14aec81640 1 -- 172.21.15.53:0/3967978317 >> v1:172.21.15.53:6789/0 conn(0x7f14a80afe30 legacy=0x7f14a815bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:47.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:47.842+0000 7f14aec81640 1 -- 172.21.15.53:0/3967978317 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a80ca080 con 0x7f14a806efc0 2023-06-10T19:02:47.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:47.842+0000 7f14aec81640 1 --2- 172.21.15.53:0/3967978317 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f14a806efc0 0x7f14a806bb30 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f14a0009d90 tx=0x7f14a001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57934bbdb0577f5a server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:47.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:47.842+0000 7f14ad47e640 1 -- 172.21.15.53:0/3967978317 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a00a59a0 con 0x7f14a806efc0 2023-06-10T19:02:47.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:47.842+0000 7f14ad47e640 1 -- 172.21.15.53:0/3967978317 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14a00a5b00 con 0x7f14a806efc0 2023-06-10T19:02:47.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:47.842+0000 7f14ad47e640 1 -- 172.21.15.53:0/3967978317 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a00a5e90 con 0x7f14a806efc0 2023-06-10T19:02:47.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:47.846+0000 7f14b06e4640 1 -- 172.21.15.53:0/3967978317 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f14a806efc0 msgr2=0x7f14a806bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:47.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:47.846+0000 7f14b06e4640 1 --2- 172.21.15.53:0/3967978317 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f14a806efc0 0x7f14a806bb30 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f14a0009d90 tx=0x7f14a001c8e0 comp rx=0 tx=0).stop 2023-06-10T19:02:47.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:47.846+0000 7f14b06e4640 1 -- 172.21.15.53:0/3967978317 shutdown_connections 2023-06-10T19:02:47.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:47.846+0000 7f14b06e4640 1 --2- 172.21.15.53:0/3967978317 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f14a806efc0 0x7f14a806bb30 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:47.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:47.846+0000 7f14b06e4640 1 -- 172.21.15.53:0/3967978317 >> 172.21.15.53:0/3967978317 conn(0x7f14a806a0d0 msgr2=0x7f14a80ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:47.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:47.846+0000 7f14b06e4640 1 -- 172.21.15.53:0/3967978317 shutdown_connections 2023-06-10T19:02:47.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:47.846+0000 7f14b06e4640 1 -- 172.21.15.53:0/3967978317 wait complete. 2023-06-10T19:02:47.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:47.846+0000 7f14b06e4640 1 Processor -- start 2023-06-10T19:02:47.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:47.846+0000 7f14b06e4640 1 -- start start 2023-06-10T19:02:47.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:47.846+0000 7f14b06e4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f14a806efc0 0x7f14a8158360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:47.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:47.846+0000 7f14b06e4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14a80afe30 0x7f14a8151960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:47.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:47.846+0000 7f14b06e4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14a8157e10 0x7f14a80c75f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:47.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:47.846+0000 7f14b06e4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14a80b32c0 con 0x7f14a806efc0 2023-06-10T19:02:47.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:47.846+0000 7f14b06e4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14a80b35a0 con 0x7f14a80afe30 2023-06-10T19:02:47.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:47.846+0000 7f14b06e4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14a80b3880 con 0x7f14a8157e10 2023-06-10T19:02:47.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:47.846+0000 7f14ae480640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f14a806efc0 0x7f14a8158360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:47.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:47.846+0000 7f14ae480640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f14a806efc0 0x7f14a8158360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52302/0 (socket says 172.21.15.53:52302) 2023-06-10T19:02:47.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:47.846+0000 7f14ae480640 1 -- 172.21.15.53:0/2889677322 learned_addr learned my addr 172.21.15.53:0/2889677322 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:47.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:47.846+0000 7f14aec81640 1 --2- 172.21.15.53:0/2889677322 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14a8157e10 0x7f14a80c75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:47.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:47.846+0000 7f14adc7f640 1 --2- 172.21.15.53:0/2889677322 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14a80afe30 0x7f14a8151960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:47.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:47.846+0000 7f14ae480640 1 -- 172.21.15.53:0/2889677322 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14a8157e10 msgr2=0x7f14a80c75f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:47.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:47.846+0000 7f14ae480640 1 --2- 172.21.15.53:0/2889677322 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14a8157e10 0x7f14a80c75f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:47.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:47.846+0000 7f14ae480640 1 -- 172.21.15.53:0/2889677322 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14a80afe30 msgr2=0x7f14a8151960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:47.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:47.846+0000 7f14ae480640 1 --2- 172.21.15.53:0/2889677322 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14a80afe30 0x7f14a8151960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:47.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:47.846+0000 7f14ae480640 1 -- 172.21.15.53:0/2889677322 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a0009a70 con 0x7f14a806efc0 2023-06-10T19:02:47.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:47.846+0000 7f14adc7f640 1 --2- 172.21.15.53:0/2889677322 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14a80afe30 0x7f14a8151960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:02:47.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:47.846+0000 7f14aec81640 1 --2- 172.21.15.53:0/2889677322 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14a8157e10 0x7f14a80c75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:02:47.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:47.846+0000 7f14ae480640 1 --2- 172.21.15.53:0/2889677322 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f14a806efc0 0x7f14a8158360 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f14a400b410 tx=0x7f14a400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:47.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:47.850+0000 7f149effd640 1 -- 172.21.15.53:0/2889677322 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a4004020 con 0x7f14a806efc0 2023-06-10T19:02:47.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:47.850+0000 7f149effd640 1 -- 172.21.15.53:0/2889677322 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14a4004180 con 0x7f14a806efc0 2023-06-10T19:02:47.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:47.850+0000 7f14b06e4640 1 -- 172.21.15.53:0/2889677322 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14a80acac0 con 0x7f14a806efc0 2023-06-10T19:02:47.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:47.850+0000 7f149effd640 1 -- 172.21.15.53:0/2889677322 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a4011630 con 0x7f14a806efc0 2023-06-10T19:02:47.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:47.850+0000 7f14b06e4640 1 -- 172.21.15.53:0/2889677322 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14a8151ea0 con 0x7f14a806efc0 2023-06-10T19:02:47.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:47.850+0000 7f14b06e4640 1 -- 172.21.15.53:0/2889677322 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14a80acd00 con 0x7f14a806efc0 2023-06-10T19:02:47.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:47.850+0000 7f149effd640 1 -- 172.21.15.53:0/2889677322 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f14a4011790 con 0x7f14a806efc0 2023-06-10T19:02:47.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:47.850+0000 7f149effd640 1 --2- 172.21.15.53:0/2889677322 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f148c066280 0x7f148c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:47.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:47.850+0000 7f149effd640 1 -- 172.21.15.53:0/2889677322 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6264+0+0 (secure 0 0 0) 0x7f14a4083ac0 con 0x7f14a806efc0 2023-06-10T19:02:47.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:47.850+0000 7f14adc7f640 1 --2- 172.21.15.53:0/2889677322 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f148c066280 0x7f148c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:47.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:47.850+0000 7f14adc7f640 1 --2- 172.21.15.53:0/2889677322 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f148c066280 0x7f148c068730 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f14a8164e10 tx=0x7f1498009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:47.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:47.858+0000 7f149effd640 1 -- 172.21.15.53:0/2889677322 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f14a80acd00 con 0x7f14a806efc0 2023-06-10T19:02:48.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:48.042+0000 7f14b06e4640 1 -- 172.21.15.53:0/2889677322 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f14a80acd00 con 0x7f14a806efc0 2023-06-10T19:02:48.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:48.042+0000 7f149effd640 1 -- 172.21.15.53:0/2889677322 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+4683 (secure 0 0 0) 0x7f14a80acd00 con 0x7f14a806efc0 2023-06-10T19:02:48.047 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:02:48.047 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1617157670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1617157670},{"type":"v1","addr":"172.21.15.117:6836","nonce":1617157670}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6113,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3414416090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":3414416090},{"type":"v1","addr":"172.21.15.117:6837","nonce":3414416090}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6718,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2533467097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2533467097},{"type":"v1","addr":"172.21.15.53:6835","nonce":2533467097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:02:02.642809+0000","modified":"2023-06-10T19:02:36.149418+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8127":{"gid":8127,"name":"a","rank":0,"incarnation":52,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.53:6833/2984379521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2984379521},{"type":"v1","addr":"172.21.15.53:6833","nonce":2984379521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-06-10T19:02:48.048 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 53 2023-06-10T19:02:48.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:48.046+0000 7f14b06e4640 1 -- 172.21.15.53:0/2889677322 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f148c066280 msgr2=0x7f148c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:48.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:48.046+0000 7f14b06e4640 1 --2- 172.21.15.53:0/2889677322 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f148c066280 0x7f148c068730 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f14a8164e10 tx=0x7f1498009040 comp rx=0 tx=0).stop 2023-06-10T19:02:48.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:48.046+0000 7f14b06e4640 1 -- 172.21.15.53:0/2889677322 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f14a806efc0 msgr2=0x7f14a8158360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:48.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:48.046+0000 7f14b06e4640 1 --2- 172.21.15.53:0/2889677322 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f14a806efc0 0x7f14a8158360 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f14a400b410 tx=0x7f14a400b8d0 comp rx=0 tx=0).stop 2023-06-10T19:02:48.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:48.046+0000 7f14b06e4640 1 -- 172.21.15.53:0/2889677322 shutdown_connections 2023-06-10T19:02:48.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:48.046+0000 7f14b06e4640 1 --2- 172.21.15.53:0/2889677322 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f148c066280 0x7f148c068730 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:48.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:48.046+0000 7f14b06e4640 1 --2- 172.21.15.53:0/2889677322 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14a8157e10 0x7f14a80c75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:48.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:48.046+0000 7f14b06e4640 1 --2- 172.21.15.53:0/2889677322 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14a80afe30 0x7f14a8151960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:48.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:48.046+0000 7f14b06e4640 1 --2- 172.21.15.53:0/2889677322 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f14a806efc0 0x7f14a8158360 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:48.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:48.046+0000 7f14b06e4640 1 -- 172.21.15.53:0/2889677322 >> 172.21.15.53:0/2889677322 conn(0x7f14a806a0d0 msgr2=0x7f14a815bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:48.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:48.046+0000 7f14b06e4640 1 -- 172.21.15.53:0/2889677322 shutdown_connections 2023-06-10T19:02:48.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:48.046+0000 7f14b06e4640 1 -- 172.21.15.53:0/2889677322 wait complete. 2023-06-10T19:02:48.065 DEBUG:tasks.cephfs.filesystem:mapped states ['up:reconnect'] to None 2023-06-10T19:02:49.066 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:02:49.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:49.198+0000 7f3866baf640 1 Processor -- start 2023-06-10T19:02:49.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:49.198+0000 7f3866baf640 1 -- start start 2023-06-10T19:02:49.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:49.198+0000 7f3866baf640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38600c9840 0x7f38600c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:49.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:49.198+0000 7f3866baf640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f386006b090 0x7f386006b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:49.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:49.198+0000 7f3866baf640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3860159b50 con 0x7f3860071060 2023-06-10T19:02:49.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:49.198+0000 7f3866baf640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38600ca150 con 0x7f386006b090 2023-06-10T19:02:49.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:49.198+0000 7f3866baf640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38600702a0 con 0x7f38600c9840 2023-06-10T19:02:49.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:49.198+0000 7f386514c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f386006b090 0x7f386006b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:49.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:49.198+0000 7f386514c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f386006b090 0x7f386006b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52312/0 (socket says 172.21.15.53:52312) 2023-06-10T19:02:49.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:49.198+0000 7f386514c640 1 -- 172.21.15.53:0/3383216333 learned_addr learned my addr 172.21.15.53:0/3383216333 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:49.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:49.198+0000 7f386514c640 1 -- 172.21.15.53:0/3383216333 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38600c9840 msgr2=0x7f38600c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:49.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:49.198+0000 7f386494b640 1 --2- 172.21.15.53:0/3383216333 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38600c9840 0x7f38600c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:49.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:49.198+0000 7f386514c640 1 --2- 172.21.15.53:0/3383216333 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38600c9840 0x7f38600c9c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:49.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:49.198+0000 7f386514c640 1 -- 172.21.15.53:0/3383216333 >> v1:172.21.15.117:6789/0 conn(0x7f3860071060 legacy=0x7f38600af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:49.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:49.198+0000 7f386514c640 1 -- 172.21.15.53:0/3383216333 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3860070580 con 0x7f386006b090 2023-06-10T19:02:49.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:49.202+0000 7f386514c640 1 --2- 172.21.15.53:0/3383216333 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f386006b090 0x7f386006b530 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f3858009e50 tx=0x7f385801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bfe806bd34acec6 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:49.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:49.202+0000 7f385f7fe640 1 -- 172.21.15.53:0/3383216333 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38580a5820 con 0x7f386006b090 2023-06-10T19:02:49.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:49.202+0000 7f385f7fe640 1 -- 172.21.15.53:0/3383216333 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38580a5980 con 0x7f386006b090 2023-06-10T19:02:49.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:49.202+0000 7f385f7fe640 1 -- 172.21.15.53:0/3383216333 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38580a5d10 con 0x7f386006b090 2023-06-10T19:02:49.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:49.202+0000 7f3866baf640 1 -- 172.21.15.53:0/3383216333 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f386006b090 msgr2=0x7f386006b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:49.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:49.202+0000 7f3866baf640 1 --2- 172.21.15.53:0/3383216333 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f386006b090 0x7f386006b530 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f3858009e50 tx=0x7f385801c9a0 comp rx=0 tx=0).stop 2023-06-10T19:02:49.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:49.202+0000 7f3866baf640 1 -- 172.21.15.53:0/3383216333 shutdown_connections 2023-06-10T19:02:49.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:49.202+0000 7f3866baf640 1 --2- 172.21.15.53:0/3383216333 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f386006b090 0x7f386006b530 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:49.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:49.202+0000 7f3866baf640 1 --2- 172.21.15.53:0/3383216333 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38600c9840 0x7f38600c9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:49.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:49.202+0000 7f3866baf640 1 -- 172.21.15.53:0/3383216333 >> 172.21.15.53:0/3383216333 conn(0x7f386006a0d0 msgr2=0x7f38600ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:49.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:49.202+0000 7f3866baf640 1 -- 172.21.15.53:0/3383216333 shutdown_connections 2023-06-10T19:02:49.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:49.202+0000 7f3866baf640 1 -- 172.21.15.53:0/3383216333 wait complete. 2023-06-10T19:02:49.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:49.202+0000 7f3866baf640 1 Processor -- start 2023-06-10T19:02:49.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:49.202+0000 7f3866baf640 1 -- start start 2023-06-10T19:02:49.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:49.202+0000 7f3866baf640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f386006b090 0x7f386014f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:49.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:49.202+0000 7f3866baf640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3860071060 0x7f38600b0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:49.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:49.202+0000 7f3866baf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38600c9840 0x7f38600b1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:49.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:49.202+0000 7f3866baf640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f386014fa10 con 0x7f38600c9840 2023-06-10T19:02:49.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:49.202+0000 7f3866baf640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f386015ce70 con 0x7f386006b090 2023-06-10T19:02:49.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:49.202+0000 7f3866baf640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f386015d110 con 0x7f3860071060 2023-06-10T19:02:49.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:49.202+0000 7f386514c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38600c9840 0x7f38600b1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:49.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:49.202+0000 7f386514c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38600c9840 0x7f38600b1440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52318/0 (socket says 172.21.15.53:52318) 2023-06-10T19:02:49.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:49.202+0000 7f386514c640 1 -- 172.21.15.53:0/2330337296 learned_addr learned my addr 172.21.15.53:0/2330337296 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:49.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:49.206+0000 7f386494b640 1 --2- 172.21.15.53:0/2330337296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f386006b090 0x7f386014f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:49.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:49.206+0000 7f386514c640 1 -- 172.21.15.53:0/2330337296 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3860071060 msgr2=0x7f38600b0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:49.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:49.206+0000 7f385ffff640 1 --2- 172.21.15.53:0/2330337296 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3860071060 0x7f38600b0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:49.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:49.206+0000 7f386514c640 1 --2- 172.21.15.53:0/2330337296 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3860071060 0x7f38600b0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:49.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:49.206+0000 7f386514c640 1 -- 172.21.15.53:0/2330337296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f386006b090 msgr2=0x7f386014f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:49.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:49.206+0000 7f386514c640 1 --2- 172.21.15.53:0/2330337296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f386006b090 0x7f386014f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:49.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:49.206+0000 7f386514c640 1 -- 172.21.15.53:0/2330337296 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3858009b30 con 0x7f38600c9840 2023-06-10T19:02:49.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:49.206+0000 7f385ffff640 1 --2- 172.21.15.53:0/2330337296 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3860071060 0x7f38600b0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:02:49.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:49.206+0000 7f386514c640 1 --2- 172.21.15.53:0/2330337296 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38600c9840 0x7f38600b1440 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f385801b050 tx=0x7f3858019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:49.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:49.206+0000 7f385d7fa640 1 -- 172.21.15.53:0/2330337296 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38580b8670 con 0x7f38600c9840 2023-06-10T19:02:49.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:49.206+0000 7f385d7fa640 1 -- 172.21.15.53:0/2330337296 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38580b87f0 con 0x7f38600c9840 2023-06-10T19:02:49.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:49.206+0000 7f3866baf640 1 -- 172.21.15.53:0/2330337296 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f386015d3f0 con 0x7f38600c9840 2023-06-10T19:02:49.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:49.206+0000 7f385d7fa640 1 -- 172.21.15.53:0/2330337296 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38580b8ba0 con 0x7f38600c9840 2023-06-10T19:02:49.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:49.206+0000 7f3866baf640 1 -- 172.21.15.53:0/2330337296 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f386015d9b0 con 0x7f38600c9840 2023-06-10T19:02:49.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:49.206+0000 7f3866baf640 1 -- 172.21.15.53:0/2330337296 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f386015dba0 con 0x7f38600c9840 2023-06-10T19:02:49.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:49.206+0000 7f385d7fa640 1 -- 172.21.15.53:0/2330337296 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f38580b8d00 con 0x7f38600c9840 2023-06-10T19:02:49.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:49.206+0000 7f385d7fa640 1 --2- 172.21.15.53:0/2330337296 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f384c066280 0x7f384c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:49.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:49.206+0000 7f385d7fa640 1 -- 172.21.15.53:0/2330337296 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6264+0+0 (secure 0 0 0) 0x7f385811f540 con 0x7f38600c9840 2023-06-10T19:02:49.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:49.206+0000 7f386494b640 1 --2- 172.21.15.53:0/2330337296 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f384c066280 0x7f384c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:49.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:49.206+0000 7f386494b640 1 --2- 172.21.15.53:0/2330337296 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f384c066280 0x7f384c068730 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f385000a8d0 tx=0x7f3850008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:49.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:49.210+0000 7f385d7fa640 1 -- 172.21.15.53:0/2330337296 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f38580ecb80 con 0x7f38600c9840 2023-06-10T19:02:49.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:49.394+0000 7f3866baf640 1 -- 172.21.15.53:0/2330337296 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f386015dba0 con 0x7f38600c9840 2023-06-10T19:02:49.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:49.398+0000 7f385d7fa640 1 -- 172.21.15.53:0/2330337296 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+4683 (secure 0 0 0) 0x7f38580f01a0 con 0x7f38600c9840 2023-06-10T19:02:49.400 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:02:49.401 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1617157670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1617157670},{"type":"v1","addr":"172.21.15.117:6836","nonce":1617157670}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6113,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3414416090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":3414416090},{"type":"v1","addr":"172.21.15.117:6837","nonce":3414416090}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6718,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2533467097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2533467097},{"type":"v1","addr":"172.21.15.53:6835","nonce":2533467097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:02:02.642809+0000","modified":"2023-06-10T19:02:36.149418+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8127":{"gid":8127,"name":"a","rank":0,"incarnation":52,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.53:6833/2984379521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2984379521},{"type":"v1","addr":"172.21.15.53:6833","nonce":2984379521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-06-10T19:02:49.402 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 53 2023-06-10T19:02:49.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:49.398+0000 7f3866baf640 1 -- 172.21.15.53:0/2330337296 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f384c066280 msgr2=0x7f384c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:49.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:49.398+0000 7f3866baf640 1 --2- 172.21.15.53:0/2330337296 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f384c066280 0x7f384c068730 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f385000a8d0 tx=0x7f3850008040 comp rx=0 tx=0).stop 2023-06-10T19:02:49.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:49.398+0000 7f3866baf640 1 -- 172.21.15.53:0/2330337296 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38600c9840 msgr2=0x7f38600b1440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:49.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:49.398+0000 7f3866baf640 1 --2- 172.21.15.53:0/2330337296 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38600c9840 0x7f38600b1440 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f385801b050 tx=0x7f3858019740 comp rx=0 tx=0).stop 2023-06-10T19:02:49.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:49.398+0000 7f3866baf640 1 -- 172.21.15.53:0/2330337296 shutdown_connections 2023-06-10T19:02:49.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:49.398+0000 7f3866baf640 1 --2- 172.21.15.53:0/2330337296 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f384c066280 0x7f384c068730 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:49.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:49.398+0000 7f3866baf640 1 --2- 172.21.15.53:0/2330337296 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38600c9840 0x7f38600b1440 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:49.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:49.398+0000 7f3866baf640 1 --2- 172.21.15.53:0/2330337296 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3860071060 0x7f38600b0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:49.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:49.398+0000 7f3866baf640 1 --2- 172.21.15.53:0/2330337296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f386006b090 0x7f386014f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:49.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:49.398+0000 7f3866baf640 1 -- 172.21.15.53:0/2330337296 >> 172.21.15.53:0/2330337296 conn(0x7f386006a0d0 msgr2=0x7f3860152d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:49.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:49.398+0000 7f3866baf640 1 -- 172.21.15.53:0/2330337296 shutdown_connections 2023-06-10T19:02:49.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:49.398+0000 7f3866baf640 1 -- 172.21.15.53:0/2330337296 wait complete. 2023-06-10T19:02:49.418 DEBUG:tasks.cephfs.filesystem:mapped states ['up:reconnect'] to None 2023-06-10T19:02:50.419 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:02:50.551 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:50.550+0000 7f92f8a05640 1 Processor -- start 2023-06-10T19:02:50.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:50.550+0000 7f92f8a05640 1 -- start start 2023-06-10T19:02:50.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:50.550+0000 7f92f8a05640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f92f4070f40 0x7f92f406bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:50.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:50.550+0000 7f92f8a05640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92f406c4c0 0x7f92f415c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:50.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:50.550+0000 7f92f8a05640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92f4070080 con 0x7f92f415c0b0 2023-06-10T19:02:50.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:50.550+0000 7f92f8a05640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92f40cc460 con 0x7f92f4070f40 2023-06-10T19:02:50.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:50.550+0000 7f92f8a05640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92f40705c0 con 0x7f92f406c4c0 2023-06-10T19:02:50.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:50.550+0000 7f92f1d9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f92f4070f40 0x7f92f406bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:50.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:50.550+0000 7f92f259c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f92f415c0b0 0x7f92f40cbd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60032/0 (socket says 172.21.15.53:60032) 2023-06-10T19:02:50.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:50.550+0000 7f92f259c640 1 -- 172.21.15.53:0/3330944010 learned_addr learned my addr 172.21.15.53:0/3330944010 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:02:50.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:50.550+0000 7f92f2d9d640 1 --2- 172.21.15.53:0/3330944010 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92f406c4c0 0x7f92f415c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:50.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:50.550+0000 7f92f1d9b640 1 -- 172.21.15.53:0/3330944010 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92f406c4c0 msgr2=0x7f92f415c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:50.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:50.550+0000 7f92f1d9b640 1 --2- 172.21.15.53:0/3330944010 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92f406c4c0 0x7f92f415c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:50.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:50.550+0000 7f92f1d9b640 1 -- 172.21.15.53:0/3330944010 >> v1:172.21.15.53:6789/0 conn(0x7f92f415c0b0 legacy=0x7f92f40cbd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:50.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:50.550+0000 7f92f159a640 1 -- 172.21.15.53:0/3330944010 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3195019989 0 0) 0x7f92f4070080 con 0x7f92f415c0b0 2023-06-10T19:02:50.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:50.550+0000 7f92f1d9b640 1 -- 172.21.15.53:0/3330944010 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92f40c8e30 con 0x7f92f4070f40 2023-06-10T19:02:50.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:50.554+0000 7f92f1d9b640 1 --2- 172.21.15.53:0/3330944010 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92f4070f40 0x7f92f406bf80 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f92e40097c0 tx=0x7f92e401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74a01e2725b86c25 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:50.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:50.554+0000 7f92f159a640 1 -- 172.21.15.53:0/3330944010 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e40ab600 con 0x7f92f4070f40 2023-06-10T19:02:50.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:50.554+0000 7f92f159a640 1 -- 172.21.15.53:0/3330944010 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92e40a7050 con 0x7f92f4070f40 2023-06-10T19:02:50.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:50.554+0000 7f92f159a640 1 -- 172.21.15.53:0/3330944010 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e40ab980 con 0x7f92f4070f40 2023-06-10T19:02:50.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:50.554+0000 7f92f8a05640 1 -- 172.21.15.53:0/3330944010 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92f4070f40 msgr2=0x7f92f406bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:50.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:50.554+0000 7f92f8a05640 1 --2- 172.21.15.53:0/3330944010 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92f4070f40 0x7f92f406bf80 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f92e40097c0 tx=0x7f92e401c450 comp rx=0 tx=0).stop 2023-06-10T19:02:50.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:50.554+0000 7f92f8a05640 1 -- 172.21.15.53:0/3330944010 shutdown_connections 2023-06-10T19:02:50.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:50.554+0000 7f92f8a05640 1 --2- 172.21.15.53:0/3330944010 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92f4070f40 0x7f92f406bf80 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:50.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:50.554+0000 7f92f8a05640 1 --2- 172.21.15.53:0/3330944010 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92f406c4c0 0x7f92f415c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:50.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:50.554+0000 7f92f8a05640 1 -- 172.21.15.53:0/3330944010 >> 172.21.15.53:0/3330944010 conn(0x7f92f406a0d0 msgr2=0x7f92f40ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:50.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:50.554+0000 7f92f8a05640 1 -- 172.21.15.53:0/3330944010 shutdown_connections 2023-06-10T19:02:50.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:50.554+0000 7f92f8a05640 1 -- 172.21.15.53:0/3330944010 wait complete. 2023-06-10T19:02:50.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:50.554+0000 7f92f8a05640 1 Processor -- start 2023-06-10T19:02:50.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:50.554+0000 7f92f8a05640 1 -- start start 2023-06-10T19:02:50.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:50.554+0000 7f92f8a05640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92f406c4c0 0x7f92f414e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:50.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:50.554+0000 7f92f8a05640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92f4070f40 0x7f92f40cce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:50.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:50.554+0000 7f92f8a05640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f92f415c0b0 0x7f92f413ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:50.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:50.554+0000 7f92f8a05640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92f40c7c70 con 0x7f92f406c4c0 2023-06-10T19:02:50.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:50.554+0000 7f92f8a05640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92f40c3890 con 0x7f92f415c0b0 2023-06-10T19:02:50.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:50.554+0000 7f92f8a05640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92f40c3b70 con 0x7f92f4070f40 2023-06-10T19:02:50.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:50.554+0000 7f92f259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92f406c4c0 0x7f92f414e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:50.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:50.554+0000 7f92f259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92f406c4c0 0x7f92f414e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52346/0 (socket says 172.21.15.53:52346) 2023-06-10T19:02:50.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:50.554+0000 7f92f259c640 1 -- 172.21.15.53:0/3388745170 learned_addr learned my addr 172.21.15.53:0/3388745170 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:50.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:50.558+0000 7f92f1d9b640 1 --2- 172.21.15.53:0/3388745170 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92f4070f40 0x7f92f40cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:50.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:50.558+0000 7f92f2d9d640 1 --2- 172.21.15.53:0/3388745170 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f92f415c0b0 0x7f92f413ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:50.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:50.558+0000 7f92f259c640 1 -- 172.21.15.53:0/3388745170 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92f4070f40 msgr2=0x7f92f40cce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:50.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:50.558+0000 7f92f259c640 1 --2- 172.21.15.53:0/3388745170 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92f4070f40 0x7f92f40cce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:50.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:50.558+0000 7f92f259c640 1 -- 172.21.15.53:0/3388745170 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f92f415c0b0 msgr2=0x7f92f413ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:50.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:50.558+0000 7f92f259c640 1 --2- 172.21.15.53:0/3388745170 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f92f415c0b0 0x7f92f413ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:50.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:50.558+0000 7f92f259c640 1 -- 172.21.15.53:0/3388745170 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92e4009420 con 0x7f92f406c4c0 2023-06-10T19:02:50.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:50.558+0000 7f92f259c640 1 --2- 172.21.15.53:0/3388745170 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92f406c4c0 0x7f92f414e0a0 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f92e800c480 tx=0x7f92e800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:50.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:50.558+0000 7f92e2ffd640 1 -- 172.21.15.53:0/3388745170 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e80074e0 con 0x7f92f406c4c0 2023-06-10T19:02:50.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:50.558+0000 7f92e2ffd640 1 -- 172.21.15.53:0/3388745170 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92e8007660 con 0x7f92f406c4c0 2023-06-10T19:02:50.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:50.558+0000 7f92f8a05640 1 -- 172.21.15.53:0/3388745170 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92f40c3e50 con 0x7f92f406c4c0 2023-06-10T19:02:50.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:50.558+0000 7f92e2ffd640 1 -- 172.21.15.53:0/3388745170 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e8004a30 con 0x7f92f406c4c0 2023-06-10T19:02:50.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:50.558+0000 7f92f8a05640 1 -- 172.21.15.53:0/3388745170 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92f40c4410 con 0x7f92f406c4c0 2023-06-10T19:02:50.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:50.558+0000 7f92f8a05640 1 -- 172.21.15.53:0/3388745170 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92f40c4630 con 0x7f92f406c4c0 2023-06-10T19:02:50.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:50.558+0000 7f92e2ffd640 1 -- 172.21.15.53:0/3388745170 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f92e8004b90 con 0x7f92f406c4c0 2023-06-10T19:02:50.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:50.558+0000 7f92e2ffd640 1 --2- 172.21.15.53:0/3388745170 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f92d4066280 0x7f92d4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:50.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:50.558+0000 7f92e2ffd640 1 -- 172.21.15.53:0/3388745170 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6264+0+0 (secure 0 0 0) 0x7f92e80832a0 con 0x7f92f406c4c0 2023-06-10T19:02:50.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:50.558+0000 7f92f1d9b640 1 --2- 172.21.15.53:0/3388745170 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f92d4066280 0x7f92d4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:50.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:50.558+0000 7f92f1d9b640 1 --2- 172.21.15.53:0/3388745170 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f92d4066280 0x7f92d4068730 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f92e40ad000 tx=0x7f92e4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:50.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:50.562+0000 7f92e2ffd640 1 -- 172.21.15.53:0/3388745170 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f92e8054170 con 0x7f92f406c4c0 2023-06-10T19:02:50.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:50.758+0000 7f92f8a05640 1 -- 172.21.15.53:0/3388745170 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f92f404d790 con 0x7f92f406c4c0 2023-06-10T19:02:50.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:50.758+0000 7f92e2ffd640 1 -- 172.21.15.53:0/3388745170 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+4683 (secure 0 0 0) 0x7f92e8053d00 con 0x7f92f406c4c0 2023-06-10T19:02:50.762 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:02:50.762 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1617157670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1617157670},{"type":"v1","addr":"172.21.15.117:6836","nonce":1617157670}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6113,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3414416090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":3414416090},{"type":"v1","addr":"172.21.15.117:6837","nonce":3414416090}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6718,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2533467097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2533467097},{"type":"v1","addr":"172.21.15.53:6835","nonce":2533467097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:02:02.642809+0000","modified":"2023-06-10T19:02:36.149418+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8127":{"gid":8127,"name":"a","rank":0,"incarnation":52,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.53:6833/2984379521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2984379521},{"type":"v1","addr":"172.21.15.53:6833","nonce":2984379521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-06-10T19:02:50.762 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 53 2023-06-10T19:02:50.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:50.762+0000 7f92f8a05640 1 -- 172.21.15.53:0/3388745170 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f92d4066280 msgr2=0x7f92d4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:50.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:50.762+0000 7f92f8a05640 1 --2- 172.21.15.53:0/3388745170 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f92d4066280 0x7f92d4068730 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f92e40ad000 tx=0x7f92e4008040 comp rx=0 tx=0).stop 2023-06-10T19:02:50.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:50.762+0000 7f92f8a05640 1 -- 172.21.15.53:0/3388745170 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92f406c4c0 msgr2=0x7f92f414e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:50.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:50.762+0000 7f92f8a05640 1 --2- 172.21.15.53:0/3388745170 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92f406c4c0 0x7f92f414e0a0 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f92e800c480 tx=0x7f92e800c940 comp rx=0 tx=0).stop 2023-06-10T19:02:50.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:50.762+0000 7f92f8a05640 1 -- 172.21.15.53:0/3388745170 shutdown_connections 2023-06-10T19:02:50.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:50.762+0000 7f92f8a05640 1 --2- 172.21.15.53:0/3388745170 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f92d4066280 0x7f92d4068730 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:50.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:50.762+0000 7f92f8a05640 1 --2- 172.21.15.53:0/3388745170 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f92f415c0b0 0x7f92f413ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:50.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:50.762+0000 7f92f8a05640 1 --2- 172.21.15.53:0/3388745170 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92f4070f40 0x7f92f40cce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:50.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:50.762+0000 7f92f8a05640 1 --2- 172.21.15.53:0/3388745170 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92f406c4c0 0x7f92f414e0a0 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:50.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:50.762+0000 7f92f8a05640 1 -- 172.21.15.53:0/3388745170 >> 172.21.15.53:0/3388745170 conn(0x7f92f406a0d0 msgr2=0x7f92f4154470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:50.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:50.762+0000 7f92f8a05640 1 -- 172.21.15.53:0/3388745170 shutdown_connections 2023-06-10T19:02:50.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:50.762+0000 7f92f8a05640 1 -- 172.21.15.53:0/3388745170 wait complete. 2023-06-10T19:02:50.781 DEBUG:tasks.cephfs.filesystem:mapped states ['up:reconnect'] to None 2023-06-10T19:02:51.782 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:02:51.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:51.914+0000 7f20ea910640 1 Processor -- start 2023-06-10T19:02:51.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:51.914+0000 7f20ea910640 1 -- start start 2023-06-10T19:02:51.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:51.914+0000 7f20ea910640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f20e415cdb0 0x7f20e40b30e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:51.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:51.914+0000 7f20ea910640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20e4071060 0x7f20e40b3620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:51.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:51.914+0000 7f20ea910640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20e406c620 con 0x7f20e40c9840 2023-06-10T19:02:51.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:51.914+0000 7f20ea910640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20e40702a0 con 0x7f20e415cdb0 2023-06-10T19:02:51.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:51.914+0000 7f20ea910640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20e4070580 con 0x7f20e4071060 2023-06-10T19:02:51.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:51.918+0000 7f20e8ead640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f20e40c9840 0x7f20e406b090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:58252/0 (socket says 172.21.15.53:58252) 2023-06-10T19:02:51.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:51.918+0000 7f20e8ead640 1 -- 172.21.15.53:0/2091935646 learned_addr learned my addr 172.21.15.53:0/2091935646 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:02:51.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:51.918+0000 7f20dbfff640 1 --2- 172.21.15.53:0/2091935646 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20e4071060 0x7f20e40b3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:51.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:51.918+0000 7f20e3fff640 1 --2- 172.21.15.53:0/2091935646 >> v2:172.21.15.117:3300/0 conn(0x7f20e415cdb0 0x7f20e40b30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:51.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:51.918+0000 7f20e37fe640 1 -- 172.21.15.53:0/2091935646 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4272183682 0 0) 0x7f20e406c620 con 0x7f20e40c9840 2023-06-10T19:02:51.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:51.918+0000 7f20e37fe640 1 -- 172.21.15.53:0/2091935646 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20d0003530 con 0x7f20e40c9840 2023-06-10T19:02:51.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:51.918+0000 7f20e37fe640 1 -- 172.21.15.53:0/2091935646 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1009976529 0 0) 0x7f20d0003530 con 0x7f20e40c9840 2023-06-10T19:02:51.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:51.918+0000 7f20e37fe640 1 -- 172.21.15.53:0/2091935646 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20e4071060 msgr2=0x7f20e40b3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:51.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:51.918+0000 7f20e37fe640 1 --2- 172.21.15.53:0/2091935646 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20e4071060 0x7f20e40b3620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:51.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:51.918+0000 7f20e37fe640 1 -- 172.21.15.53:0/2091935646 >> v2:172.21.15.117:3300/0 conn(0x7f20e415cdb0 msgr2=0x7f20e40b30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:51.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:51.918+0000 7f20e37fe640 1 --2- 172.21.15.53:0/2091935646 >> v2:172.21.15.117:3300/0 conn(0x7f20e415cdb0 0x7f20e40b30e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:51.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:51.918+0000 7f20e37fe640 1 -- 172.21.15.53:0/2091935646 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20e4070860 con 0x7f20e40c9840 2023-06-10T19:02:51.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:51.918+0000 7f20e37fe640 1 -- 172.21.15.53:0/2091935646 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f20dc001a00 con 0x7f20e40c9840 2023-06-10T19:02:51.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:51.918+0000 7f20e37fe640 1 -- 172.21.15.53:0/2091935646 >> v1:172.21.15.53:6789/0 conn(0x7f20e40c9840 legacy=0x7f20e406b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:51.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:51.918+0000 7f20e37fe640 1 --2- 172.21.15.53:0/2091935646 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20d00039f0 0x7f20d0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:51.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:51.918+0000 7f20e37fe640 1 --2- 172.21.15.53:0/2091935646 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20d00047d0 0x7f20d0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:51.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:51.918+0000 7f20e37fe640 1 --2- 172.21.15.53:0/2091935646 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20e4071060 0x7f20d0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:51.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:51.918+0000 7f20e37fe640 1 -- 172.21.15.53:0/2091935646 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e40702a0 con 0x7f20d00047d0 2023-06-10T19:02:51.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:51.918+0000 7f20e37fe640 1 -- 172.21.15.53:0/2091935646 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e4070580 con 0x7f20d00039f0 2023-06-10T19:02:51.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:51.918+0000 7f20e37fe640 1 -- 172.21.15.53:0/2091935646 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20d000b990 con 0x7f20e4071060 2023-06-10T19:02:51.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:51.918+0000 7f20dbfff640 1 --2- 172.21.15.53:0/2091935646 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20d00047d0 0x7f20d0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:51.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:51.918+0000 7f20e3fff640 1 --2- 172.21.15.53:0/2091935646 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20d00039f0 0x7f20d0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:51.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:51.918+0000 7f20e8ead640 1 --2- 172.21.15.53:0/2091935646 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20e4071060 0x7f20d0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:51.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:51.918+0000 7f20dbfff640 1 -- 172.21.15.53:0/2091935646 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20e4071060 msgr2=0x7f20d0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:51.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:51.918+0000 7f20dbfff640 1 --2- 172.21.15.53:0/2091935646 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20e4071060 0x7f20d0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:51.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:51.918+0000 7f20dbfff640 1 -- 172.21.15.53:0/2091935646 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20d00039f0 msgr2=0x7f20d0003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:51.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:51.918+0000 7f20dbfff640 1 --2- 172.21.15.53:0/2091935646 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20d00039f0 0x7f20d0003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:51.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:51.918+0000 7f20dbfff640 1 -- 172.21.15.53:0/2091935646 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20d0003530 con 0x7f20d00047d0 2023-06-10T19:02:51.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:51.918+0000 7f20dbfff640 1 --2- 172.21.15.53:0/2091935646 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20d00047d0 0x7f20d0004c40 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f20cc009ab0 tx=0x7f20cc01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eea778cb2f3c929d server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:51.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:51.918+0000 7f20e37fe640 1 -- 172.21.15.53:0/2091935646 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20cc0a5510 con 0x7f20d00047d0 2023-06-10T19:02:51.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:51.918+0000 7f20e37fe640 1 -- 172.21.15.53:0/2091935646 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20cc0a5670 con 0x7f20d00047d0 2023-06-10T19:02:51.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:51.918+0000 7f20e37fe640 1 -- 172.21.15.53:0/2091935646 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20cc0a5a20 con 0x7f20d00047d0 2023-06-10T19:02:51.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:51.922+0000 7f20ea910640 1 -- 172.21.15.53:0/2091935646 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20d00047d0 msgr2=0x7f20d0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:51.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:51.922+0000 7f20ea910640 1 --2- 172.21.15.53:0/2091935646 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20d00047d0 0x7f20d0004c40 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f20cc009ab0 tx=0x7f20cc01ca30 comp rx=0 tx=0).stop 2023-06-10T19:02:51.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:51.922+0000 7f20e8ead640 1 -- 172.21.15.53:0/2091935646 reap_dead start 2023-06-10T19:02:51.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:51.922+0000 7f20ea910640 1 -- 172.21.15.53:0/2091935646 shutdown_connections 2023-06-10T19:02:51.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:51.922+0000 7f20ea910640 1 -- 172.21.15.53:0/2091935646 >> 172.21.15.53:0/2091935646 conn(0x7f20e406a0d0 msgr2=0x7f20e40ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:51.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:51.922+0000 7f20ea910640 1 -- 172.21.15.53:0/2091935646 shutdown_connections 2023-06-10T19:02:51.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:51.922+0000 7f20ea910640 1 -- 172.21.15.53:0/2091935646 wait complete. 2023-06-10T19:02:51.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:51.922+0000 7f20ea910640 1 Processor -- start 2023-06-10T19:02:51.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:51.922+0000 7f20ea910640 1 -- start start 2023-06-10T19:02:51.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:51.922+0000 7f20ea910640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20d00047d0 0x7f20e413efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:51.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:51.922+0000 7f20ea910640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20e41569b0 0x7f20e41ef380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:51.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:51.922+0000 7f20ea910640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20e4153890 0x7f20e4153d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:51.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:51.922+0000 7f20ea910640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e4155700 con 0x7f20e41569b0 2023-06-10T19:02:51.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:51.922+0000 7f20ea910640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e4154240 con 0x7f20e4153890 2023-06-10T19:02:51.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:51.922+0000 7f20ea910640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20e4156520 con 0x7f20d00047d0 2023-06-10T19:02:51.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:51.922+0000 7f20dbfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20e41569b0 0x7f20e41ef380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:51.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:51.922+0000 7f20dbfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20e41569b0 0x7f20e41ef380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59508/0 (socket says 172.21.15.53:59508) 2023-06-10T19:02:51.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:51.922+0000 7f20dbfff640 1 -- 172.21.15.53:0/3307745462 learned_addr learned my addr 172.21.15.53:0/3307745462 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:51.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:51.922+0000 7f20e3fff640 1 --2- 172.21.15.53:0/3307745462 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20d00047d0 0x7f20e413efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:51.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:51.922+0000 7f20e8ead640 1 --2- 172.21.15.53:0/3307745462 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20e4153890 0x7f20e4153d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:51.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:51.922+0000 7f20dbfff640 1 -- 172.21.15.53:0/3307745462 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20d00047d0 msgr2=0x7f20e413efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:51.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:51.922+0000 7f20dbfff640 1 --2- 172.21.15.53:0/3307745462 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20d00047d0 0x7f20e413efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:51.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:51.922+0000 7f20dbfff640 1 -- 172.21.15.53:0/3307745462 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20e4153890 msgr2=0x7f20e4153d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:51.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:51.922+0000 7f20dbfff640 1 --2- 172.21.15.53:0/3307745462 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20e4153890 0x7f20e4153d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:51.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:51.922+0000 7f20dbfff640 1 -- 172.21.15.53:0/3307745462 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20e4155910 con 0x7f20e41569b0 2023-06-10T19:02:51.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:51.922+0000 7f20e3fff640 1 --2- 172.21.15.53:0/3307745462 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20d00047d0 0x7f20e413efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:02:51.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:51.922+0000 7f20e8ead640 1 --2- 172.21.15.53:0/3307745462 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20e4153890 0x7f20e4153d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:02:51.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:51.922+0000 7f20dbfff640 1 --2- 172.21.15.53:0/3307745462 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20e41569b0 0x7f20e41ef380 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f20cc01c860 tx=0x7f20d0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:51.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:51.922+0000 7f20e17fa640 1 -- 172.21.15.53:0/3307745462 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20cc004220 con 0x7f20e41569b0 2023-06-10T19:02:51.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:51.922+0000 7f20e17fa640 1 -- 172.21.15.53:0/3307745462 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20cc004380 con 0x7f20e41569b0 2023-06-10T19:02:51.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:51.922+0000 7f20ea910640 1 -- 172.21.15.53:0/3307745462 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20e4155bf0 con 0x7f20e41569b0 2023-06-10T19:02:51.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:51.922+0000 7f20e17fa640 1 -- 172.21.15.53:0/3307745462 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20cc005ba0 con 0x7f20e41569b0 2023-06-10T19:02:51.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:51.922+0000 7f20ea910640 1 -- 172.21.15.53:0/3307745462 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20e41561b0 con 0x7f20e41569b0 2023-06-10T19:02:51.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:51.926+0000 7f20ea910640 1 -- 172.21.15.53:0/3307745462 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20e404d790 con 0x7f20e41569b0 2023-06-10T19:02:51.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:51.926+0000 7f20e17fa640 1 -- 172.21.15.53:0/3307745462 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f20cc0b4040 con 0x7f20e41569b0 2023-06-10T19:02:51.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:51.926+0000 7f20e17fa640 1 --2- 172.21.15.53:0/3307745462 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f20c4066280 0x7f20c4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:51.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:51.926+0000 7f20e17fa640 1 -- 172.21.15.53:0/3307745462 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6264+0+0 (secure 0 0 0) 0x7f20cc11d8c0 con 0x7f20e41569b0 2023-06-10T19:02:51.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:51.926+0000 7f20e3fff640 1 --2- 172.21.15.53:0/3307745462 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f20c4066280 0x7f20c4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:51.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:51.926+0000 7f20e3fff640 1 --2- 172.21.15.53:0/3307745462 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f20c4066280 0x7f20c4068730 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f20d4009b50 tx=0x7f20d4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:51.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:51.930+0000 7f20e17fa640 1 -- 172.21.15.53:0/3307745462 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f20cc0eae50 con 0x7f20e41569b0 2023-06-10T19:02:52.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:52.118+0000 7f20ea910640 1 -- 172.21.15.53:0/3307745462 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f20e4072900 con 0x7f20e41569b0 2023-06-10T19:02:52.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:52.118+0000 7f20e17fa640 1 -- 172.21.15.53:0/3307745462 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+4683 (secure 0 0 0) 0x7f20cc0044f0 con 0x7f20e41569b0 2023-06-10T19:02:52.121 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:02:52.122 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1617157670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1617157670},{"type":"v1","addr":"172.21.15.117:6836","nonce":1617157670}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6113,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3414416090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":3414416090},{"type":"v1","addr":"172.21.15.117:6837","nonce":3414416090}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6718,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2533467097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2533467097},{"type":"v1","addr":"172.21.15.53:6835","nonce":2533467097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:02:02.642809+0000","modified":"2023-06-10T19:02:36.149418+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8127":{"gid":8127,"name":"a","rank":0,"incarnation":52,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.53:6833/2984379521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2984379521},{"type":"v1","addr":"172.21.15.53:6833","nonce":2984379521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-06-10T19:02:52.124 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 53 2023-06-10T19:02:52.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:52.118+0000 7f20ea910640 1 -- 172.21.15.53:0/3307745462 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f20c4066280 msgr2=0x7f20c4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:52.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:52.118+0000 7f20ea910640 1 --2- 172.21.15.53:0/3307745462 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f20c4066280 0x7f20c4068730 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f20d4009b50 tx=0x7f20d4008040 comp rx=0 tx=0).stop 2023-06-10T19:02:52.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:52.118+0000 7f20ea910640 1 -- 172.21.15.53:0/3307745462 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20e41569b0 msgr2=0x7f20e41ef380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:52.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:52.118+0000 7f20ea910640 1 --2- 172.21.15.53:0/3307745462 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20e41569b0 0x7f20e41ef380 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f20cc01c860 tx=0x7f20d0005800 comp rx=0 tx=0).stop 2023-06-10T19:02:52.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:52.118+0000 7f20ea910640 1 -- 172.21.15.53:0/3307745462 shutdown_connections 2023-06-10T19:02:52.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:52.118+0000 7f20ea910640 1 --2- 172.21.15.53:0/3307745462 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f20c4066280 0x7f20c4068730 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:52.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:52.118+0000 7f20ea910640 1 --2- 172.21.15.53:0/3307745462 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20e4153890 0x7f20e4153d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:52.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:52.118+0000 7f20ea910640 1 --2- 172.21.15.53:0/3307745462 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20e41569b0 0x7f20e41ef380 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:52.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:52.118+0000 7f20ea910640 1 --2- 172.21.15.53:0/3307745462 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20d00047d0 0x7f20e413efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:52.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:52.118+0000 7f20ea910640 1 -- 172.21.15.53:0/3307745462 >> 172.21.15.53:0/3307745462 conn(0x7f20e406a0d0 msgr2=0x7f20e40b0ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:52.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:52.118+0000 7f20ea910640 1 -- 172.21.15.53:0/3307745462 shutdown_connections 2023-06-10T19:02:52.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:52.118+0000 7f20ea910640 1 -- 172.21.15.53:0/3307745462 wait complete. 2023-06-10T19:02:52.139 DEBUG:tasks.cephfs.filesystem:mapped states ['up:reconnect'] to None 2023-06-10T19:02:53.141 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:02:53.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:53.274+0000 7fb0d425f640 1 Processor -- start 2023-06-10T19:02:53.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:53.274+0000 7fb0d425f640 1 -- start start 2023-06-10T19:02:53.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:53.274+0000 7fb0d425f640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb0cc06b2f0 0x7fb0cc06f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:53.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:53.274+0000 7fb0d425f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb0cc0c8d00 0x7fb0cc06b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:53.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:53.274+0000 7fb0d425f640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0cc158a90 con 0x7fb0cc06bc00 2023-06-10T19:02:53.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:53.274+0000 7fb0d425f640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0cc0705d0 con 0x7fb0cc0c8d00 2023-06-10T19:02:53.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:53.274+0000 7fb0d425f640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0cc06f9c0 con 0x7fb0cc06b2f0 2023-06-10T19:02:53.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:53.274+0000 7fb0d17fa640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb0cc0c8d00 0x7fb0cc06b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:53.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:53.274+0000 7fb0d17fa640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb0cc0c8d00 0x7fb0cc06b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59520/0 (socket says 172.21.15.53:59520) 2023-06-10T19:02:53.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:53.274+0000 7fb0d17fa640 1 -- 172.21.15.53:0/3407729843 learned_addr learned my addr 172.21.15.53:0/3407729843 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:53.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:53.274+0000 7fb0d1ffb640 1 --2- 172.21.15.53:0/3407729843 >> v2:172.21.15.117:3300/0 conn(0x7fb0cc06b2f0 0x7fb0cc06f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:53.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:53.274+0000 7fb0d17fa640 1 -- 172.21.15.53:0/3407729843 >> v2:172.21.15.117:3300/0 conn(0x7fb0cc06b2f0 msgr2=0x7fb0cc06f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:53.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:53.274+0000 7fb0d17fa640 1 --2- 172.21.15.53:0/3407729843 >> v2:172.21.15.117:3300/0 conn(0x7fb0cc06b2f0 0x7fb0cc06f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:53.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:53.274+0000 7fb0d17fa640 1 -- 172.21.15.53:0/3407729843 >> v1:172.21.15.117:6789/0 conn(0x7fb0cc06bc00 legacy=0x7fb0cc0cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:53.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:53.274+0000 7fb0d17fa640 1 -- 172.21.15.53:0/3407729843 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0cc06fca0 con 0x7fb0cc0c8d00 2023-06-10T19:02:53.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:53.278+0000 7fb0d17fa640 1 --2- 172.21.15.53:0/3407729843 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0cc0c8d00 0x7fb0cc06b6c0 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc071d80 tx=0x7fb0c801ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e96f9ea398754758 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:53.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:53.278+0000 7fb0d0ff9640 1 -- 172.21.15.53:0/3407729843 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c80a89b0 con 0x7fb0cc0c8d00 2023-06-10T19:02:53.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:53.278+0000 7fb0d0ff9640 1 -- 172.21.15.53:0/3407729843 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0c80a8b10 con 0x7fb0cc0c8d00 2023-06-10T19:02:53.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:53.278+0000 7fb0d0ff9640 1 -- 172.21.15.53:0/3407729843 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c80a8ea0 con 0x7fb0cc0c8d00 2023-06-10T19:02:53.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:53.278+0000 7fb0d425f640 1 -- 172.21.15.53:0/3407729843 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0cc0c8d00 msgr2=0x7fb0cc06b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:53.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:53.278+0000 7fb0d425f640 1 --2- 172.21.15.53:0/3407729843 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0cc0c8d00 0x7fb0cc06b6c0 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc071d80 tx=0x7fb0c801ecb0 comp rx=0 tx=0).stop 2023-06-10T19:02:53.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:53.278+0000 7fb0d425f640 1 -- 172.21.15.53:0/3407729843 shutdown_connections 2023-06-10T19:02:53.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:53.278+0000 7fb0d425f640 1 --2- 172.21.15.53:0/3407729843 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0cc0c8d00 0x7fb0cc06b6c0 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:53.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:53.278+0000 7fb0d425f640 1 --2- 172.21.15.53:0/3407729843 >> v2:172.21.15.117:3300/0 conn(0x7fb0cc06b2f0 0x7fb0cc06f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:53.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:53.278+0000 7fb0d425f640 1 -- 172.21.15.53:0/3407729843 >> 172.21.15.53:0/3407729843 conn(0x7fb0cc06a0d0 msgr2=0x7fb0cc0ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:53.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:53.278+0000 7fb0d425f640 1 -- 172.21.15.53:0/3407729843 shutdown_connections 2023-06-10T19:02:53.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:53.278+0000 7fb0d425f640 1 -- 172.21.15.53:0/3407729843 wait complete. 2023-06-10T19:02:53.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:53.278+0000 7fb0d425f640 1 Processor -- start 2023-06-10T19:02:53.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:53.278+0000 7fb0d425f640 1 -- start start 2023-06-10T19:02:53.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:53.278+0000 7fb0d425f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0cc06b2f0 0x7fb0cc15b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:53.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:53.278+0000 7fb0d425f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0cc06bc00 0x7fb0cc158c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:53.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:53.278+0000 7fb0d425f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0cc0c8d00 0x7fb0cc14f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:53.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:53.278+0000 7fb0d425f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0cc159330 con 0x7fb0cc0c8d00 2023-06-10T19:02:53.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:53.282+0000 7fb0d425f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0cc159610 con 0x7fb0cc06bc00 2023-06-10T19:02:53.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:53.282+0000 7fb0d425f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0cc1598f0 con 0x7fb0cc06b2f0 2023-06-10T19:02:53.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:53.282+0000 7fb0d27fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0cc0c8d00 0x7fb0cc14f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:53.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:53.282+0000 7fb0d27fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0cc0c8d00 0x7fb0cc14f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59534/0 (socket says 172.21.15.53:59534) 2023-06-10T19:02:53.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:53.282+0000 7fb0d27fc640 1 -- 172.21.15.53:0/3569088728 learned_addr learned my addr 172.21.15.53:0/3569088728 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:53.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:53.282+0000 7fb0d1ffb640 1 --2- 172.21.15.53:0/3569088728 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0cc06b2f0 0x7fb0cc15b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:53.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:53.282+0000 7fb0d17fa640 1 --2- 172.21.15.53:0/3569088728 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0cc06bc00 0x7fb0cc158c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:53.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:53.282+0000 7fb0d27fc640 1 -- 172.21.15.53:0/3569088728 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0cc06b2f0 msgr2=0x7fb0cc15b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:53.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:53.282+0000 7fb0d27fc640 1 --2- 172.21.15.53:0/3569088728 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0cc06b2f0 0x7fb0cc15b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:53.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:53.282+0000 7fb0d27fc640 1 -- 172.21.15.53:0/3569088728 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0cc06bc00 msgr2=0x7fb0cc158c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:53.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:53.282+0000 7fb0d27fc640 1 --2- 172.21.15.53:0/3569088728 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0cc06bc00 0x7fb0cc158c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:53.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:53.282+0000 7fb0d27fc640 1 -- 172.21.15.53:0/3569088728 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0c80094d0 con 0x7fb0cc0c8d00 2023-06-10T19:02:53.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:53.282+0000 7fb0d27fc640 1 --2- 172.21.15.53:0/3569088728 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0cc0c8d00 0x7fb0cc14f220 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7fb0c400c780 tx=0x7fb0c400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:53.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:53.282+0000 7fb0be7fc640 1 -- 172.21.15.53:0/3569088728 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c4004b70 con 0x7fb0cc0c8d00 2023-06-10T19:02:53.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:53.282+0000 7fb0be7fc640 1 -- 172.21.15.53:0/3569088728 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0c400ce90 con 0x7fb0cc0c8d00 2023-06-10T19:02:53.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:53.282+0000 7fb0d425f640 1 -- 172.21.15.53:0/3569088728 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0cc159bd0 con 0x7fb0cc0c8d00 2023-06-10T19:02:53.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:53.282+0000 7fb0be7fc640 1 -- 172.21.15.53:0/3569088728 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c400a850 con 0x7fb0cc0c8d00 2023-06-10T19:02:53.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:53.282+0000 7fb0d425f640 1 -- 172.21.15.53:0/3569088728 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0cc151de0 con 0x7fb0cc0c8d00 2023-06-10T19:02:53.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:53.282+0000 7fb0d425f640 1 -- 172.21.15.53:0/3569088728 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0cc04d790 con 0x7fb0cc0c8d00 2023-06-10T19:02:53.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:53.282+0000 7fb0be7fc640 1 -- 172.21.15.53:0/3569088728 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb0c400a9b0 con 0x7fb0cc0c8d00 2023-06-10T19:02:53.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:53.282+0000 7fb0be7fc640 1 --2- 172.21.15.53:0/3569088728 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb0b0066280 0x7fb0b0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:53.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:53.282+0000 7fb0be7fc640 1 -- 172.21.15.53:0/3569088728 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6264+0+0 (secure 0 0 0) 0x7fb0c4084250 con 0x7fb0cc0c8d00 2023-06-10T19:02:53.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:53.282+0000 7fb0d1ffb640 1 --2- 172.21.15.53:0/3569088728 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb0b0066280 0x7fb0b0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:53.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:53.286+0000 7fb0d1ffb640 1 --2- 172.21.15.53:0/3569088728 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb0b0066280 0x7fb0b0068730 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fb0c000b9d0 tx=0x7fb0c0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:53.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:53.286+0000 7fb0be7fc640 1 -- 172.21.15.53:0/3569088728 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb0c4055090 con 0x7fb0cc0c8d00 2023-06-10T19:02:53.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:53.466+0000 7fb0d425f640 1 -- 172.21.15.53:0/3569088728 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb0cc0cc7d0 con 0x7fb0cc0c8d00 2023-06-10T19:02:53.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:53.470+0000 7fb0be7fc640 1 -- 172.21.15.53:0/3569088728 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+4683 (secure 0 0 0) 0x7fb0c4054c20 con 0x7fb0cc0c8d00 2023-06-10T19:02:53.472 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:02:53.472 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1617157670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1617157670},{"type":"v1","addr":"172.21.15.117:6836","nonce":1617157670}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6113,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3414416090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":3414416090},{"type":"v1","addr":"172.21.15.117:6837","nonce":3414416090}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6718,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2533467097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2533467097},{"type":"v1","addr":"172.21.15.53:6835","nonce":2533467097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:02:02.642809+0000","modified":"2023-06-10T19:02:36.149418+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8127":{"gid":8127,"name":"a","rank":0,"incarnation":52,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.53:6833/2984379521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2984379521},{"type":"v1","addr":"172.21.15.53:6833","nonce":2984379521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-06-10T19:02:53.473 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 53 2023-06-10T19:02:53.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:53.470+0000 7fb0d425f640 1 -- 172.21.15.53:0/3569088728 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb0b0066280 msgr2=0x7fb0b0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:53.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:53.470+0000 7fb0d425f640 1 --2- 172.21.15.53:0/3569088728 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb0b0066280 0x7fb0b0068730 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fb0c000b9d0 tx=0x7fb0c0008040 comp rx=0 tx=0).stop 2023-06-10T19:02:53.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:53.470+0000 7fb0d425f640 1 -- 172.21.15.53:0/3569088728 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0cc0c8d00 msgr2=0x7fb0cc14f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:53.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:53.470+0000 7fb0d425f640 1 --2- 172.21.15.53:0/3569088728 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0cc0c8d00 0x7fb0cc14f220 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7fb0c400c780 tx=0x7fb0c400cc40 comp rx=0 tx=0).stop 2023-06-10T19:02:53.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:53.470+0000 7fb0d425f640 1 -- 172.21.15.53:0/3569088728 shutdown_connections 2023-06-10T19:02:53.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:53.470+0000 7fb0d425f640 1 --2- 172.21.15.53:0/3569088728 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb0b0066280 0x7fb0b0068730 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:53.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:53.470+0000 7fb0d425f640 1 --2- 172.21.15.53:0/3569088728 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0cc0c8d00 0x7fb0cc14f220 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:53.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:53.470+0000 7fb0d425f640 1 --2- 172.21.15.53:0/3569088728 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0cc06bc00 0x7fb0cc158c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:53.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:53.470+0000 7fb0d425f640 1 --2- 172.21.15.53:0/3569088728 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0cc06b2f0 0x7fb0cc15b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:53.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:53.470+0000 7fb0d425f640 1 -- 172.21.15.53:0/3569088728 >> 172.21.15.53:0/3569088728 conn(0x7fb0cc06a0d0 msgr2=0x7fb0cc0ae220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:53.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:53.470+0000 7fb0d425f640 1 -- 172.21.15.53:0/3569088728 shutdown_connections 2023-06-10T19:02:53.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:53.470+0000 7fb0d425f640 1 -- 172.21.15.53:0/3569088728 wait complete. 2023-06-10T19:02:53.489 DEBUG:tasks.cephfs.filesystem:mapped states ['up:reconnect'] to None 2023-06-10T19:02:54.490 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:02:54.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.618+0000 7ff0dadf1640 1 Processor -- start 2023-06-10T19:02:54.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.622+0000 7ff0dadf1640 1 -- start start 2023-06-10T19:02:54.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.622+0000 7ff0dadf1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0d4162640 0x7ff0d4164a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:54.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.622+0000 7ff0dadf1640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0d4159b50 con 0x7ff0d4071060 2023-06-10T19:02:54.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.622+0000 7ff0dadf1640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0d40702a0 con 0x7ff0d40c9840 2023-06-10T19:02:54.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.622+0000 7ff0dadf1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d4070580 con 0x7ff0d4162640 2023-06-10T19:02:54.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.622+0000 7ff0d3fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ff0d4071060 0x7ff0d40af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:58256/0 (socket says 172.21.15.53:58256) 2023-06-10T19:02:54.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.622+0000 7ff0d3fff640 1 -- 172.21.15.53:0/2056069969 learned_addr learned my addr 172.21.15.53:0/2056069969 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:02:54.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.622+0000 7ff0d37fe640 1 -- 172.21.15.53:0/2056069969 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 529090734 0 0) 0x7ff0d4159b50 con 0x7ff0d4071060 2023-06-10T19:02:54.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.622+0000 7ff0d938e640 1 --2- 172.21.15.53:0/2056069969 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0d4162640 0x7ff0d4164a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:54.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.622+0000 7ff0d37fe640 1 -- 172.21.15.53:0/2056069969 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0c0003530 con 0x7ff0d4071060 2023-06-10T19:02:54.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.622+0000 7ff0d37fe640 1 -- 172.21.15.53:0/2056069969 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3030699578 0 0) 0x7ff0c0003530 con 0x7ff0d4071060 2023-06-10T19:02:54.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.622+0000 7ff0d37fe640 1 -- 172.21.15.53:0/2056069969 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0d4162640 msgr2=0x7ff0d4164a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:54.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.622+0000 7ff0d37fe640 1 --2- 172.21.15.53:0/2056069969 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0d4162640 0x7ff0d4164a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:54.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.622+0000 7ff0d37fe640 1 -- 172.21.15.53:0/2056069969 >> v1:172.21.15.117:6789/0 conn(0x7ff0d40c9840 legacy=0x7ff0d40c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:54.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.622+0000 7ff0d37fe640 1 -- 172.21.15.53:0/2056069969 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d4070860 con 0x7ff0d4071060 2023-06-10T19:02:54.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.622+0000 7ff0d37fe640 1 -- 172.21.15.53:0/2056069969 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7ff0bc001a00 con 0x7ff0d4071060 2023-06-10T19:02:54.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.622+0000 7ff0d37fe640 1 -- 172.21.15.53:0/2056069969 >> v1:172.21.15.53:6789/0 conn(0x7ff0d4071060 legacy=0x7ff0d40af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:54.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.622+0000 7ff0d37fe640 1 --2- 172.21.15.53:0/2056069969 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0c0003a20 0x7ff0c0003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:54.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.622+0000 7ff0d37fe640 1 --2- 172.21.15.53:0/2056069969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff0c00047d0 0x7ff0c0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:54.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.622+0000 7ff0d37fe640 1 --2- 172.21.15.53:0/2056069969 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0d4162640 0x7ff0c0005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:54.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.622+0000 7ff0d37fe640 1 -- 172.21.15.53:0/2056069969 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d4070580 con 0x7ff0c00047d0 2023-06-10T19:02:54.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.622+0000 7ff0d37fe640 1 -- 172.21.15.53:0/2056069969 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c000bb50 con 0x7ff0c0003a20 2023-06-10T19:02:54.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.622+0000 7ff0d37fe640 1 -- 172.21.15.53:0/2056069969 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c000bd10 con 0x7ff0d4162640 2023-06-10T19:02:54.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.622+0000 7ff0d3fff640 1 --2- 172.21.15.53:0/2056069969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff0c00047d0 0x7ff0c0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:54.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.622+0000 7ff0d938e640 1 --2- 172.21.15.53:0/2056069969 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0d4162640 0x7ff0c0005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:54.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.622+0000 7ff0d8b8d640 1 --2- 172.21.15.53:0/2056069969 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0c0003a20 0x7ff0c0003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:54.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.622+0000 7ff0d3fff640 1 -- 172.21.15.53:0/2056069969 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0d4162640 msgr2=0x7ff0c0005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:54.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.622+0000 7ff0d3fff640 1 --2- 172.21.15.53:0/2056069969 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0d4162640 0x7ff0c0005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:54.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.622+0000 7ff0d3fff640 1 -- 172.21.15.53:0/2056069969 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0c0003a20 msgr2=0x7ff0c0003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:54.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.622+0000 7ff0d3fff640 1 --2- 172.21.15.53:0/2056069969 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0c0003a20 0x7ff0c0003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:54.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.622+0000 7ff0d3fff640 1 -- 172.21.15.53:0/2056069969 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0c0003530 con 0x7ff0c00047d0 2023-06-10T19:02:54.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.622+0000 7ff0d8b8d640 1 --2- 172.21.15.53:0/2056069969 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0c0003a20 0x7ff0c0003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:02:54.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.626+0000 7ff0d3fff640 1 --2- 172.21.15.53:0/2056069969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff0c00047d0 0x7ff0c0004c40 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7ff0d4071470 tx=0x7ff0bc01fa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed91abf9b7202871 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:54.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.626+0000 7ff0d37fe640 1 -- 172.21.15.53:0/2056069969 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0bc0aa670 con 0x7ff0c00047d0 2023-06-10T19:02:54.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.626+0000 7ff0d37fe640 1 -- 172.21.15.53:0/2056069969 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0bc0aa7d0 con 0x7ff0c00047d0 2023-06-10T19:02:54.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.626+0000 7ff0d37fe640 1 -- 172.21.15.53:0/2056069969 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0bc0aab60 con 0x7ff0c00047d0 2023-06-10T19:02:54.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.626+0000 7ff0dadf1640 1 -- 172.21.15.53:0/2056069969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff0c00047d0 msgr2=0x7ff0c0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:54.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.626+0000 7ff0dadf1640 1 --2- 172.21.15.53:0/2056069969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff0c00047d0 0x7ff0c0004c40 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7ff0d4071470 tx=0x7ff0bc01fa40 comp rx=0 tx=0).stop 2023-06-10T19:02:54.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.626+0000 7ff0d938e640 1 -- 172.21.15.53:0/2056069969 reap_dead start 2023-06-10T19:02:54.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.626+0000 7ff0dadf1640 1 -- 172.21.15.53:0/2056069969 shutdown_connections 2023-06-10T19:02:54.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.626+0000 7ff0dadf1640 1 -- 172.21.15.53:0/2056069969 >> 172.21.15.53:0/2056069969 conn(0x7ff0d406a0d0 msgr2=0x7ff0d40ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:54.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.626+0000 7ff0dadf1640 1 -- 172.21.15.53:0/2056069969 shutdown_connections 2023-06-10T19:02:54.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.626+0000 7ff0dadf1640 1 -- 172.21.15.53:0/2056069969 wait complete. 2023-06-10T19:02:54.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.626+0000 7ff0dadf1640 1 Processor -- start 2023-06-10T19:02:54.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.626+0000 7ff0dadf1640 1 -- start start 2023-06-10T19:02:54.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.626+0000 7ff0dadf1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0c00047d0 0x7ff0d40af960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:54.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.626+0000 7ff0dadf1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff0d40c40e0 0x7ff0d40c21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:54.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.626+0000 7ff0dadf1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0d40c6470 0x7ff0d40c68f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:54.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.626+0000 7ff0dadf1640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d40b39e0 con 0x7ff0d40c40e0 2023-06-10T19:02:54.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.626+0000 7ff0dadf1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d40b1630 con 0x7ff0d40c6470 2023-06-10T19:02:54.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.626+0000 7ff0dadf1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d40c6e30 con 0x7ff0c00047d0 2023-06-10T19:02:54.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.626+0000 7ff0d3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff0d40c40e0 0x7ff0d40c21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:54.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.626+0000 7ff0d3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff0d40c40e0 0x7ff0d40c21e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59562/0 (socket says 172.21.15.53:59562) 2023-06-10T19:02:54.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.626+0000 7ff0d3fff640 1 -- 172.21.15.53:0/3968861275 learned_addr learned my addr 172.21.15.53:0/3968861275 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:54.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.626+0000 7ff0d8b8d640 1 --2- 172.21.15.53:0/3968861275 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0c00047d0 0x7ff0d40af960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:54.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.626+0000 7ff0d938e640 1 --2- 172.21.15.53:0/3968861275 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0d40c6470 0x7ff0d40c68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:54.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.626+0000 7ff0d3fff640 1 -- 172.21.15.53:0/3968861275 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0c00047d0 msgr2=0x7ff0d40af960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:54.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.626+0000 7ff0d3fff640 1 --2- 172.21.15.53:0/3968861275 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0c00047d0 0x7ff0d40af960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:54.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.626+0000 7ff0d3fff640 1 -- 172.21.15.53:0/3968861275 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0d40c6470 msgr2=0x7ff0d40c68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:54.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.626+0000 7ff0d3fff640 1 --2- 172.21.15.53:0/3968861275 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0d40c6470 0x7ff0d40c68f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:54.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.626+0000 7ff0d3fff640 1 -- 172.21.15.53:0/3968861275 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d40b1300 con 0x7ff0d40c40e0 2023-06-10T19:02:54.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.626+0000 7ff0d3fff640 1 --2- 172.21.15.53:0/3968861275 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff0d40c40e0 0x7ff0d40c21e0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc01f870 tx=0x7ff0c0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:54.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.630+0000 7ff0d17fa640 1 -- 172.21.15.53:0/3968861275 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0bc0b9070 con 0x7ff0d40c40e0 2023-06-10T19:02:54.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.630+0000 7ff0d17fa640 1 -- 172.21.15.53:0/3968861275 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0bc0aa470 con 0x7ff0d40c40e0 2023-06-10T19:02:54.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.630+0000 7ff0dadf1640 1 -- 172.21.15.53:0/3968861275 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0d40c2b30 con 0x7ff0d40c40e0 2023-06-10T19:02:54.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.630+0000 7ff0d17fa640 1 -- 172.21.15.53:0/3968861275 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0bc0019e0 con 0x7ff0d40c40e0 2023-06-10T19:02:54.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.630+0000 7ff0dadf1640 1 -- 172.21.15.53:0/3968861275 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0d40c30f0 con 0x7ff0d40c40e0 2023-06-10T19:02:54.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.630+0000 7ff0dadf1640 1 -- 172.21.15.53:0/3968861275 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0d40b1770 con 0x7ff0d40c40e0 2023-06-10T19:02:54.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.630+0000 7ff0d17fa640 1 -- 172.21.15.53:0/3968861275 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff0bc0aa940 con 0x7ff0d40c40e0 2023-06-10T19:02:54.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.630+0000 7ff0d17fa640 1 --2- 172.21.15.53:0/3968861275 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff0b4066280 0x7ff0b4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:54.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.630+0000 7ff0d17fa640 1 -- 172.21.15.53:0/3968861275 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6264+0+0 (secure 0 0 0) 0x7ff0bc121b10 con 0x7ff0d40c40e0 2023-06-10T19:02:54.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.630+0000 7ff0d8b8d640 1 --2- 172.21.15.53:0/3968861275 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff0b4066280 0x7ff0b4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:54.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.630+0000 7ff0d8b8d640 1 --2- 172.21.15.53:0/3968861275 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff0b4066280 0x7ff0b4068730 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7ff0c4001760 tx=0x7ff0c4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:54.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.634+0000 7ff0d17fa640 1 -- 172.21.15.53:0/3968861275 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff0d40b1770 con 0x7ff0d40c40e0 2023-06-10T19:02:54.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.822+0000 7ff0dadf1640 1 -- 172.21.15.53:0/3968861275 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff0d40b1770 con 0x7ff0d40c40e0 2023-06-10T19:02:54.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.822+0000 7ff0d17fa640 1 -- 172.21.15.53:0/3968861275 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+4683 (secure 0 0 0) 0x7ff0d40b1770 con 0x7ff0d40c40e0 2023-06-10T19:02:54.826 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:02:54.826 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1617157670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1617157670},{"type":"v1","addr":"172.21.15.117:6836","nonce":1617157670}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6113,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3414416090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":3414416090},{"type":"v1","addr":"172.21.15.117:6837","nonce":3414416090}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6718,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2533467097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2533467097},{"type":"v1","addr":"172.21.15.53:6835","nonce":2533467097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:02:02.642809+0000","modified":"2023-06-10T19:02:36.149418+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8127":{"gid":8127,"name":"a","rank":0,"incarnation":52,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.53:6833/2984379521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2984379521},{"type":"v1","addr":"172.21.15.53:6833","nonce":2984379521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-06-10T19:02:54.827 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 53 2023-06-10T19:02:54.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.826+0000 7ff0dadf1640 1 -- 172.21.15.53:0/3968861275 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff0b4066280 msgr2=0x7ff0b4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:54.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.826+0000 7ff0dadf1640 1 --2- 172.21.15.53:0/3968861275 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff0b4066280 0x7ff0b4068730 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7ff0c4001760 tx=0x7ff0c4009040 comp rx=0 tx=0).stop 2023-06-10T19:02:54.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.826+0000 7ff0dadf1640 1 -- 172.21.15.53:0/3968861275 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff0d40c40e0 msgr2=0x7ff0d40c21e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:54.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.826+0000 7ff0dadf1640 1 --2- 172.21.15.53:0/3968861275 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff0d40c40e0 0x7ff0d40c21e0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc01f870 tx=0x7ff0c0005800 comp rx=0 tx=0).stop 2023-06-10T19:02:54.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.826+0000 7ff0dadf1640 1 -- 172.21.15.53:0/3968861275 shutdown_connections 2023-06-10T19:02:54.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.826+0000 7ff0dadf1640 1 --2- 172.21.15.53:0/3968861275 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff0b4066280 0x7ff0b4068730 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:54.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.826+0000 7ff0dadf1640 1 --2- 172.21.15.53:0/3968861275 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0d40c6470 0x7ff0d40c68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:54.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.826+0000 7ff0dadf1640 1 --2- 172.21.15.53:0/3968861275 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff0d40c40e0 0x7ff0d40c21e0 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:54.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.826+0000 7ff0dadf1640 1 --2- 172.21.15.53:0/3968861275 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0c00047d0 0x7ff0d40af960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:54.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.826+0000 7ff0dadf1640 1 -- 172.21.15.53:0/3968861275 >> 172.21.15.53:0/3968861275 conn(0x7ff0d406a0d0 msgr2=0x7ff0d40cdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:54.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.826+0000 7ff0dadf1640 1 -- 172.21.15.53:0/3968861275 shutdown_connections 2023-06-10T19:02:54.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:54.826+0000 7ff0dadf1640 1 -- 172.21.15.53:0/3968861275 wait complete. 2023-06-10T19:02:54.844 DEBUG:tasks.cephfs.filesystem:mapped states ['up:reconnect'] to None 2023-06-10T19:02:55.845 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:02:55.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:55.978+0000 7f246ec28640 1 Processor -- start 2023-06-10T19:02:55.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:55.978+0000 7f246ec28640 1 -- start start 2023-06-10T19:02:55.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:55.978+0000 7f246ec28640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2468162640 0x7f2468164a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:55.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:55.978+0000 7f246ec28640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2468159b50 con 0x7f2468071060 2023-06-10T19:02:55.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:55.978+0000 7f246ec28640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24680702a0 con 0x7f24680c9840 2023-06-10T19:02:55.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:55.978+0000 7f246ec28640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2468070580 con 0x7f2468162640 2023-06-10T19:02:55.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:55.978+0000 7f2467fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f2468071060 0x7f24680af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:58262/0 (socket says 172.21.15.53:58262) 2023-06-10T19:02:55.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:55.978+0000 7f2467fff640 1 -- 172.21.15.53:0/1398703492 learned_addr learned my addr 172.21.15.53:0/1398703492 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:02:55.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:55.978+0000 7f246d1c5640 1 --2- 172.21.15.53:0/1398703492 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2468162640 0x7f2468164a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:55.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:55.978+0000 7f24677fe640 1 -- 172.21.15.53:0/1398703492 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 638074583 0 0) 0x7f2468159b50 con 0x7f2468071060 2023-06-10T19:02:55.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:55.978+0000 7f24677fe640 1 -- 172.21.15.53:0/1398703492 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2458003530 con 0x7f2468071060 2023-06-10T19:02:55.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:55.978+0000 7f24677fe640 1 -- 172.21.15.53:0/1398703492 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2503140086 0 0) 0x7f24680702a0 con 0x7f24680c9840 2023-06-10T19:02:55.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:55.978+0000 7f24677fe640 1 -- 172.21.15.53:0/1398703492 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2468159b50 con 0x7f24680c9840 2023-06-10T19:02:55.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:55.978+0000 7f24677fe640 1 -- 172.21.15.53:0/1398703492 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1541840122 0 0) 0x7f2458003530 con 0x7f2468071060 2023-06-10T19:02:55.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:55.978+0000 7f24677fe640 1 -- 172.21.15.53:0/1398703492 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2468162640 msgr2=0x7f2468164a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:55.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:55.978+0000 7f24677fe640 1 --2- 172.21.15.53:0/1398703492 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2468162640 0x7f2468164a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:55.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:55.978+0000 7f24677fe640 1 -- 172.21.15.53:0/1398703492 >> v1:172.21.15.117:6789/0 conn(0x7f24680c9840 legacy=0x7f24680c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:55.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:55.978+0000 7f24677fe640 1 -- 172.21.15.53:0/1398703492 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2468070860 con 0x7f2468071060 2023-06-10T19:02:55.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:55.978+0000 7f24677fe640 1 -- 172.21.15.53:0/1398703492 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f2454001680 con 0x7f2468071060 2023-06-10T19:02:55.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:55.978+0000 7f24677fe640 1 -- 172.21.15.53:0/1398703492 >> v1:172.21.15.53:6789/0 conn(0x7f2468071060 legacy=0x7f24680af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:55.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:55.978+0000 7f24677fe640 1 --2- 172.21.15.53:0/1398703492 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2458003bb0 0x7f2458003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:55.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:55.978+0000 7f24677fe640 1 --2- 172.21.15.53:0/1398703492 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2468162640 0x7f24580047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:55.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:55.978+0000 7f24677fe640 1 --2- 172.21.15.53:0/1398703492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2458004d10 0x7f2458005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:55.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:55.978+0000 7f24677fe640 1 -- 172.21.15.53:0/1398703492 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2468070580 con 0x7f2458004d10 2023-06-10T19:02:55.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:55.978+0000 7f24677fe640 1 -- 172.21.15.53:0/1398703492 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f245800baa0 con 0x7f2458003bb0 2023-06-10T19:02:55.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:55.978+0000 7f24677fe640 1 -- 172.21.15.53:0/1398703492 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f245800bc60 con 0x7f2468162640 2023-06-10T19:02:55.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:55.978+0000 7f246d1c5640 1 --2- 172.21.15.53:0/1398703492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2458004d10 0x7f2458005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:55.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:55.978+0000 7f246c9c4640 1 --2- 172.21.15.53:0/1398703492 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2458003bb0 0x7f2458003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:55.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:55.978+0000 7f2467fff640 1 --2- 172.21.15.53:0/1398703492 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2468162640 0x7f24580047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:55.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:55.978+0000 7f246d1c5640 1 -- 172.21.15.53:0/1398703492 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2468162640 msgr2=0x7f24580047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:55.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:55.978+0000 7f246d1c5640 1 --2- 172.21.15.53:0/1398703492 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2468162640 0x7f24580047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:55.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:55.978+0000 7f246d1c5640 1 -- 172.21.15.53:0/1398703492 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2458003bb0 msgr2=0x7f2458003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:55.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:55.978+0000 7f246d1c5640 1 --2- 172.21.15.53:0/1398703492 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2458003bb0 0x7f2458003fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:55.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:55.978+0000 7f246d1c5640 1 -- 172.21.15.53:0/1398703492 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2458003530 con 0x7f2458004d10 2023-06-10T19:02:55.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:55.978+0000 7f2467fff640 1 --2- 172.21.15.53:0/1398703492 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2468162640 0x7f24580047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:02:55.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:55.982+0000 7f246d1c5640 1 --2- 172.21.15.53:0/1398703492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2458004d10 0x7f2458005180 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f246815e380 tx=0x7f246001c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73af7a543c5458d6 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:55.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:55.982+0000 7f24677fe640 1 -- 172.21.15.53:0/1398703492 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24600a59e0 con 0x7f2458004d10 2023-06-10T19:02:55.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:55.982+0000 7f24677fe640 1 -- 172.21.15.53:0/1398703492 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f246000f040 con 0x7f2458004d10 2023-06-10T19:02:55.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:55.982+0000 7f24677fe640 1 -- 172.21.15.53:0/1398703492 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24600a5d40 con 0x7f2458004d10 2023-06-10T19:02:55.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:55.982+0000 7f246ec28640 1 -- 172.21.15.53:0/1398703492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2458004d10 msgr2=0x7f2458005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:55.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:55.982+0000 7f246ec28640 1 --2- 172.21.15.53:0/1398703492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2458004d10 0x7f2458005180 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f246815e380 tx=0x7f246001c9e0 comp rx=0 tx=0).stop 2023-06-10T19:02:55.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:55.982+0000 7f246d1c5640 1 -- 172.21.15.53:0/1398703492 reap_dead start 2023-06-10T19:02:55.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:55.982+0000 7f246ec28640 1 -- 172.21.15.53:0/1398703492 shutdown_connections 2023-06-10T19:02:55.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:55.982+0000 7f246ec28640 1 -- 172.21.15.53:0/1398703492 >> 172.21.15.53:0/1398703492 conn(0x7f246806a0d0 msgr2=0x7f24680ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:55.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:55.982+0000 7f246ec28640 1 -- 172.21.15.53:0/1398703492 shutdown_connections 2023-06-10T19:02:55.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:55.982+0000 7f246ec28640 1 -- 172.21.15.53:0/1398703492 wait complete. 2023-06-10T19:02:55.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:55.982+0000 7f246ec28640 1 Processor -- start 2023-06-10T19:02:55.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:55.982+0000 7f246ec28640 1 -- start start 2023-06-10T19:02:55.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:55.986+0000 7f246ec28640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24680c5950 0x7f24680cd400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:55.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:55.986+0000 7f246ec28640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2468151490 0x7f24680cbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:55.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:55.986+0000 7f246ec28640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24680c5d20 0x7f24680b0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:55.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:55.986+0000 7f246ec28640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24680cc130 con 0x7f24680c5950 2023-06-10T19:02:55.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:55.986+0000 7f246ec28640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24680cc360 con 0x7f2468151490 2023-06-10T19:02:55.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:55.986+0000 7f246ec28640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24680cc640 con 0x7f24680c5d20 2023-06-10T19:02:55.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:55.986+0000 7f246c9c4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24680c5950 0x7f24680cd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:55.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:55.986+0000 7f246c9c4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24680c5950 0x7f24680cd400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59588/0 (socket says 172.21.15.53:59588) 2023-06-10T19:02:55.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:55.986+0000 7f246c9c4640 1 -- 172.21.15.53:0/3041523052 learned_addr learned my addr 172.21.15.53:0/3041523052 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:55.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:55.986+0000 7f246d1c5640 1 --2- 172.21.15.53:0/3041523052 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24680c5d20 0x7f24680b0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:55.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:55.986+0000 7f2467fff640 1 --2- 172.21.15.53:0/3041523052 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2468151490 0x7f24680cbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:55.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:55.986+0000 7f246c9c4640 1 -- 172.21.15.53:0/3041523052 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24680c5d20 msgr2=0x7f24680b0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:55.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:55.986+0000 7f246c9c4640 1 --2- 172.21.15.53:0/3041523052 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24680c5d20 0x7f24680b0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:55.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:55.986+0000 7f246c9c4640 1 -- 172.21.15.53:0/3041523052 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2468151490 msgr2=0x7f24680cbbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:55.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:55.986+0000 7f246c9c4640 1 --2- 172.21.15.53:0/3041523052 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2468151490 0x7f24680cbbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:55.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:55.986+0000 7f246c9c4640 1 -- 172.21.15.53:0/3041523052 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24680cc920 con 0x7f24680c5950 2023-06-10T19:02:55.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:55.986+0000 7f246c9c4640 1 --2- 172.21.15.53:0/3041523052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24680c5950 0x7f24680cd400 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f245c00e7b0 tx=0x7f245c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:55.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:55.986+0000 7f24657fa640 1 -- 172.21.15.53:0/3041523052 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f245c00ee60 con 0x7f24680c5950 2023-06-10T19:02:55.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:55.986+0000 7f24657fa640 1 -- 172.21.15.53:0/3041523052 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f245c0052e0 con 0x7f24680c5950 2023-06-10T19:02:55.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:55.986+0000 7f246ec28640 1 -- 172.21.15.53:0/3041523052 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24680ccc00 con 0x7f24680c5950 2023-06-10T19:02:55.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:55.986+0000 7f24657fa640 1 -- 172.21.15.53:0/3041523052 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f245c00c900 con 0x7f24680c5950 2023-06-10T19:02:55.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:55.986+0000 7f246ec28640 1 -- 172.21.15.53:0/3041523052 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24680b1010 con 0x7f24680c5950 2023-06-10T19:02:55.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:55.986+0000 7f246ec28640 1 -- 172.21.15.53:0/3041523052 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f246804d790 con 0x7f24680c5950 2023-06-10T19:02:55.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:55.986+0000 7f24657fa640 1 -- 172.21.15.53:0/3041523052 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f245c00ca60 con 0x7f24680c5950 2023-06-10T19:02:55.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:55.986+0000 7f24657fa640 1 --2- 172.21.15.53:0/3041523052 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f244c0662b0 0x7f244c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:55.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:55.986+0000 7f24657fa640 1 -- 172.21.15.53:0/3041523052 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6264+0+0 (secure 0 0 0) 0x7f245c0846d0 con 0x7f24680c5950 2023-06-10T19:02:55.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:55.986+0000 7f2467fff640 1 --2- 172.21.15.53:0/3041523052 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f244c0662b0 0x7f244c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:55.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:55.990+0000 7f2467fff640 1 --2- 172.21.15.53:0/3041523052 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f244c0662b0 0x7f244c068760 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f2468156b60 tx=0x7f2454001580 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:55.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:55.990+0000 7f24657fa640 1 -- 172.21.15.53:0/3041523052 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f245c051bf0 con 0x7f24680c5950 2023-06-10T19:02:56.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:56.182+0000 7f246ec28640 1 -- 172.21.15.53:0/3041523052 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f24680cd0b0 con 0x7f24680c5950 2023-06-10T19:02:56.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:56.182+0000 7f24657fa640 1 -- 172.21.15.53:0/3041523052 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+4683 (secure 0 0 0) 0x7f245c055210 con 0x7f24680c5950 2023-06-10T19:02:56.186 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:02:56.186 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1617157670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1617157670},{"type":"v1","addr":"172.21.15.117:6836","nonce":1617157670}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6113,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3414416090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":3414416090},{"type":"v1","addr":"172.21.15.117:6837","nonce":3414416090}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6718,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2533467097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2533467097},{"type":"v1","addr":"172.21.15.53:6835","nonce":2533467097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:02:02.642809+0000","modified":"2023-06-10T19:02:36.149418+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8127":{"gid":8127,"name":"a","rank":0,"incarnation":52,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.53:6833/2984379521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2984379521},{"type":"v1","addr":"172.21.15.53:6833","nonce":2984379521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-06-10T19:02:56.187 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 53 2023-06-10T19:02:56.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:56.186+0000 7f246ec28640 1 -- 172.21.15.53:0/3041523052 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f244c0662b0 msgr2=0x7f244c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:56.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:56.186+0000 7f246ec28640 1 --2- 172.21.15.53:0/3041523052 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f244c0662b0 0x7f244c068760 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f2468156b60 tx=0x7f2454001580 comp rx=0 tx=0).stop 2023-06-10T19:02:56.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:56.186+0000 7f246ec28640 1 -- 172.21.15.53:0/3041523052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24680c5950 msgr2=0x7f24680cd400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:56.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:56.186+0000 7f246ec28640 1 --2- 172.21.15.53:0/3041523052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24680c5950 0x7f24680cd400 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f245c00e7b0 tx=0x7f245c00ec70 comp rx=0 tx=0).stop 2023-06-10T19:02:56.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:56.186+0000 7f246ec28640 1 -- 172.21.15.53:0/3041523052 shutdown_connections 2023-06-10T19:02:56.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:56.186+0000 7f246ec28640 1 --2- 172.21.15.53:0/3041523052 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f244c0662b0 0x7f244c068760 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:56.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:56.186+0000 7f246ec28640 1 --2- 172.21.15.53:0/3041523052 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24680c5d20 0x7f24680b0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:56.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:56.186+0000 7f246ec28640 1 --2- 172.21.15.53:0/3041523052 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2468151490 0x7f24680cbbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:56.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:56.186+0000 7f246ec28640 1 --2- 172.21.15.53:0/3041523052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24680c5950 0x7f24680cd400 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:56.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:56.186+0000 7f246ec28640 1 -- 172.21.15.53:0/3041523052 >> 172.21.15.53:0/3041523052 conn(0x7f246806a0d0 msgr2=0x7f2468158e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:56.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:56.186+0000 7f246ec28640 1 -- 172.21.15.53:0/3041523052 shutdown_connections 2023-06-10T19:02:56.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:56.186+0000 7f246ec28640 1 -- 172.21.15.53:0/3041523052 wait complete. 2023-06-10T19:02:56.206 DEBUG:tasks.cephfs.filesystem:mapped states ['up:reconnect'] to None 2023-06-10T19:02:57.208 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:02:57.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:57.342+0000 7f02dd191640 1 Processor -- start 2023-06-10T19:02:57.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:57.342+0000 7f02dd191640 1 -- start start 2023-06-10T19:02:57.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:57.342+0000 7f02dd191640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f02d80c9840 0x7f02d80c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:57.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:57.342+0000 7f02dd191640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f02d806b090 0x7f02d806b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:57.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:57.342+0000 7f02dd191640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02d8159b50 con 0x7f02d8071060 2023-06-10T19:02:57.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:57.342+0000 7f02dd191640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02d80ca150 con 0x7f02d80c9840 2023-06-10T19:02:57.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:57.342+0000 7f02dd191640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02d80702a0 con 0x7f02d806b090 2023-06-10T19:02:57.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:57.342+0000 7f02d6d9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f02d80c9840 0x7f02d80c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:57.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:57.342+0000 7f02d6d9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f02d80c9840 0x7f02d80c9c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59598/0 (socket says 172.21.15.53:59598) 2023-06-10T19:02:57.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:57.342+0000 7f02d6d9d640 1 -- 172.21.15.53:0/3427968864 learned_addr learned my addr 172.21.15.53:0/3427968864 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:57.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:57.342+0000 7f02d759e640 1 --2- 172.21.15.53:0/3427968864 >> v2:172.21.15.117:3300/0 conn(0x7f02d806b090 0x7f02d806b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:57.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:57.342+0000 7f02d6d9d640 1 -- 172.21.15.53:0/3427968864 >> v2:172.21.15.117:3300/0 conn(0x7f02d806b090 msgr2=0x7f02d806b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:57.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:57.342+0000 7f02d6d9d640 1 --2- 172.21.15.53:0/3427968864 >> v2:172.21.15.117:3300/0 conn(0x7f02d806b090 0x7f02d806b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:57.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:57.342+0000 7f02d6d9d640 1 -- 172.21.15.53:0/3427968864 >> v1:172.21.15.117:6789/0 conn(0x7f02d8071060 legacy=0x7f02d80af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:57.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:57.342+0000 7f02d6d9d640 1 -- 172.21.15.53:0/3427968864 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02d8070580 con 0x7f02d80c9840 2023-06-10T19:02:57.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:57.342+0000 7f02d759e640 1 --2- 172.21.15.53:0/3427968864 >> v2:172.21.15.117:3300/0 conn(0x7f02d806b090 0x7f02d806b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:02:57.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:57.346+0000 7f02d6d9d640 1 --2- 172.21.15.53:0/3427968864 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02d80c9840 0x7f02d80c9c10 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f02d815e360 tx=0x7f02c801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd22c619777025a9 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:57.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:57.346+0000 7f02d659c640 1 -- 172.21.15.53:0/3427968864 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c80aa430 con 0x7f02d80c9840 2023-06-10T19:02:57.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:57.346+0000 7f02d659c640 1 -- 172.21.15.53:0/3427968864 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02c80aa590 con 0x7f02d80c9840 2023-06-10T19:02:57.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:57.346+0000 7f02d659c640 1 -- 172.21.15.53:0/3427968864 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c80aa920 con 0x7f02d80c9840 2023-06-10T19:02:57.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:57.346+0000 7f02dd191640 1 -- 172.21.15.53:0/3427968864 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02d80c9840 msgr2=0x7f02d80c9c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:57.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:57.346+0000 7f02dd191640 1 --2- 172.21.15.53:0/3427968864 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02d80c9840 0x7f02d80c9c10 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f02d815e360 tx=0x7f02c801c4d0 comp rx=0 tx=0).stop 2023-06-10T19:02:57.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:57.346+0000 7f02dd191640 1 -- 172.21.15.53:0/3427968864 shutdown_connections 2023-06-10T19:02:57.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:57.346+0000 7f02dd191640 1 --2- 172.21.15.53:0/3427968864 >> v2:172.21.15.117:3300/0 conn(0x7f02d806b090 0x7f02d806b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:57.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:57.346+0000 7f02dd191640 1 --2- 172.21.15.53:0/3427968864 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02d80c9840 0x7f02d80c9c10 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:57.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:57.346+0000 7f02dd191640 1 -- 172.21.15.53:0/3427968864 >> 172.21.15.53:0/3427968864 conn(0x7f02d806a0d0 msgr2=0x7f02d80ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:57.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:57.346+0000 7f02dd191640 1 -- 172.21.15.53:0/3427968864 shutdown_connections 2023-06-10T19:02:57.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:57.346+0000 7f02dd191640 1 -- 172.21.15.53:0/3427968864 wait complete. 2023-06-10T19:02:57.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:57.346+0000 7f02dd191640 1 Processor -- start 2023-06-10T19:02:57.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:57.346+0000 7f02dd191640 1 -- start start 2023-06-10T19:02:57.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:57.350+0000 7f02dd191640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02d806b090 0x7f02d8156860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:57.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:57.350+0000 7f02dd191640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02d8071060 0x7f02d8144fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:57.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:57.350+0000 7f02dd191640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02d80c9840 0x7f02d80b2940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:57.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:57.350+0000 7f02dd191640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02d80c2620 con 0x7f02d806b090 2023-06-10T19:02:57.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:57.350+0000 7f02dd191640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02d81517a0 con 0x7f02d80c9840 2023-06-10T19:02:57.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:57.350+0000 7f02dd191640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02d81511e0 con 0x7f02d8071060 2023-06-10T19:02:57.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:57.350+0000 7f02d6d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02d806b090 0x7f02d8156860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:57.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:57.350+0000 7f02d6d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02d806b090 0x7f02d8156860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59612/0 (socket says 172.21.15.53:59612) 2023-06-10T19:02:57.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:57.350+0000 7f02d6d9d640 1 -- 172.21.15.53:0/1386422949 learned_addr learned my addr 172.21.15.53:0/1386422949 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:57.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:57.350+0000 7f02d759e640 1 --2- 172.21.15.53:0/1386422949 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02d80c9840 0x7f02d80b2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:57.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:57.350+0000 7f02ce59c640 1 --2- 172.21.15.53:0/1386422949 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02d8071060 0x7f02d8144fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:57.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:57.350+0000 7f02d6d9d640 1 -- 172.21.15.53:0/1386422949 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02d8071060 msgr2=0x7f02d8144fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:57.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:57.350+0000 7f02d6d9d640 1 --2- 172.21.15.53:0/1386422949 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02d8071060 0x7f02d8144fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:57.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:57.350+0000 7f02d6d9d640 1 -- 172.21.15.53:0/1386422949 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02d80c9840 msgr2=0x7f02d80b2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:57.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:57.350+0000 7f02d6d9d640 1 --2- 172.21.15.53:0/1386422949 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02d80c9840 0x7f02d80b2940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:57.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:57.350+0000 7f02d6d9d640 1 -- 172.21.15.53:0/1386422949 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02c80094d0 con 0x7f02d806b090 2023-06-10T19:02:57.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:57.350+0000 7f02ce59c640 1 --2- 172.21.15.53:0/1386422949 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02d8071060 0x7f02d8144fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:02:57.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:57.350+0000 7f02d6d9d640 1 --2- 172.21.15.53:0/1386422949 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02d806b090 0x7f02d8156860 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f02c80ac040 tx=0x7f02c801ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:57.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:57.350+0000 7f02cffff640 1 -- 172.21.15.53:0/1386422949 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c80aa430 con 0x7f02d806b090 2023-06-10T19:02:57.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:57.350+0000 7f02cffff640 1 -- 172.21.15.53:0/1386422949 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02c80b3820 con 0x7f02d806b090 2023-06-10T19:02:57.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:57.350+0000 7f02dd191640 1 -- 172.21.15.53:0/1386422949 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02d81514c0 con 0x7f02d806b090 2023-06-10T19:02:57.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:57.350+0000 7f02cffff640 1 -- 172.21.15.53:0/1386422949 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c80b3bd0 con 0x7f02d806b090 2023-06-10T19:02:57.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:57.350+0000 7f02dd191640 1 -- 172.21.15.53:0/1386422949 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02d8156da0 con 0x7f02d806b090 2023-06-10T19:02:57.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:57.350+0000 7f02dd191640 1 -- 172.21.15.53:0/1386422949 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02d80c2760 con 0x7f02d806b090 2023-06-10T19:02:57.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:57.350+0000 7f02cffff640 1 -- 172.21.15.53:0/1386422949 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f02c80b3d30 con 0x7f02d806b090 2023-06-10T19:02:57.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:57.350+0000 7f02cffff640 1 --2- 172.21.15.53:0/1386422949 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f02b8066280 0x7f02b8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:57.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:57.350+0000 7f02cffff640 1 -- 172.21.15.53:0/1386422949 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6264+0+0 (secure 0 0 0) 0x7f02c811e7e0 con 0x7f02d806b090 2023-06-10T19:02:57.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:57.350+0000 7f02ce59c640 1 --2- 172.21.15.53:0/1386422949 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f02b8066280 0x7f02b8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:57.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:57.354+0000 7f02ce59c640 1 --2- 172.21.15.53:0/1386422949 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f02b8066280 0x7f02b8068730 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f02d80c8220 tx=0x7f02c0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:57.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:57.354+0000 7f02cffff640 1 -- 172.21.15.53:0/1386422949 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f02c80ebc20 con 0x7f02d806b090 2023-06-10T19:02:57.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:57.538+0000 7f02dd191640 1 -- 172.21.15.53:0/1386422949 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f02d804d790 con 0x7f02d806b090 2023-06-10T19:02:57.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:57.542+0000 7f02cffff640 1 -- 172.21.15.53:0/1386422949 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+4683 (secure 0 0 0) 0x7f02c80ef240 con 0x7f02d806b090 2023-06-10T19:02:57.544 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:02:57.544 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1617157670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1617157670},{"type":"v1","addr":"172.21.15.117:6836","nonce":1617157670}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6113,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3414416090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":3414416090},{"type":"v1","addr":"172.21.15.117:6837","nonce":3414416090}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6718,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2533467097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2533467097},{"type":"v1","addr":"172.21.15.53:6835","nonce":2533467097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:02:02.642809+0000","modified":"2023-06-10T19:02:36.149418+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8127":{"gid":8127,"name":"a","rank":0,"incarnation":52,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.53:6833/2984379521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2984379521},{"type":"v1","addr":"172.21.15.53:6833","nonce":2984379521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-06-10T19:02:57.544 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 53 2023-06-10T19:02:57.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:57.542+0000 7f02dd191640 1 -- 172.21.15.53:0/1386422949 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f02b8066280 msgr2=0x7f02b8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:57.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:57.542+0000 7f02dd191640 1 --2- 172.21.15.53:0/1386422949 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f02b8066280 0x7f02b8068730 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f02d80c8220 tx=0x7f02c0009040 comp rx=0 tx=0).stop 2023-06-10T19:02:57.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:57.542+0000 7f02dd191640 1 -- 172.21.15.53:0/1386422949 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02d806b090 msgr2=0x7f02d8156860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:57.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:57.542+0000 7f02dd191640 1 --2- 172.21.15.53:0/1386422949 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02d806b090 0x7f02d8156860 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f02c80ac040 tx=0x7f02c801ad10 comp rx=0 tx=0).stop 2023-06-10T19:02:57.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:57.542+0000 7f02dd191640 1 -- 172.21.15.53:0/1386422949 shutdown_connections 2023-06-10T19:02:57.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:57.542+0000 7f02dd191640 1 --2- 172.21.15.53:0/1386422949 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f02b8066280 0x7f02b8068730 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:57.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:57.542+0000 7f02dd191640 1 --2- 172.21.15.53:0/1386422949 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02d80c9840 0x7f02d80b2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:57.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:57.542+0000 7f02dd191640 1 --2- 172.21.15.53:0/1386422949 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02d8071060 0x7f02d8144fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:57.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:57.542+0000 7f02dd191640 1 --2- 172.21.15.53:0/1386422949 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02d806b090 0x7f02d8156860 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:57.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:57.542+0000 7f02dd191640 1 -- 172.21.15.53:0/1386422949 >> 172.21.15.53:0/1386422949 conn(0x7f02d806a0d0 msgr2=0x7f02d814ec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:57.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:57.542+0000 7f02dd191640 1 -- 172.21.15.53:0/1386422949 shutdown_connections 2023-06-10T19:02:57.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:57.542+0000 7f02dd191640 1 -- 172.21.15.53:0/1386422949 wait complete. 2023-06-10T19:02:57.564 DEBUG:tasks.cephfs.filesystem:mapped states ['up:reconnect'] to None 2023-06-10T19:02:58.565 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:02:58.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:58.702+0000 7f2bd78b5640 1 Processor -- start 2023-06-10T19:02:58.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:58.702+0000 7f2bd78b5640 1 -- start start 2023-06-10T19:02:58.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:58.702+0000 7f2bd78b5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2bd00ad730 0x7f2bd00713a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:58.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:58.702+0000 7f2bd78b5640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2bd00718e0 0x7f2bd0069450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:58.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:58.702+0000 7f2bd78b5640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bd0070f10 con 0x7f2bd0159630 2023-06-10T19:02:58.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:58.702+0000 7f2bd78b5640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bd015d970 con 0x7f2bd00718e0 2023-06-10T19:02:58.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:58.702+0000 7f2bd78b5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd015db60 con 0x7f2bd00ad730 2023-06-10T19:02:58.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:58.702+0000 7f2bd5e52640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2bd00718e0 0x7f2bd0069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:58.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:58.702+0000 7f2bd5651640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f2bd0159630 0x7f2bd015d260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:58278/0 (socket says 172.21.15.53:58278) 2023-06-10T19:02:58.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:58.702+0000 7f2bd5651640 1 -- 172.21.15.53:0/431745133 learned_addr learned my addr 172.21.15.53:0/431745133 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:02:58.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:58.702+0000 7f2bd4e50640 1 --2- 172.21.15.53:0/431745133 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2bd00ad730 0x7f2bd00713a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:58.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:58.702+0000 7f2bd5e52640 1 -- 172.21.15.53:0/431745133 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2bd00ad730 msgr2=0x7f2bd00713a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:02:58.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:58.702+0000 7f2bd5e52640 1 --2- 172.21.15.53:0/431745133 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2bd00ad730 0x7f2bd00713a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:58.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:58.702+0000 7f2bd5e52640 1 -- 172.21.15.53:0/431745133 >> v1:172.21.15.53:6789/0 conn(0x7f2bd0159630 legacy=0x7f2bd015d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:58.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:58.702+0000 7f2bc7fff640 1 -- 172.21.15.53:0/431745133 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3475238916 0 0) 0x7f2bd0070f10 con 0x7f2bd0159630 2023-06-10T19:02:58.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:58.702+0000 7f2bd5e52640 1 -- 172.21.15.53:0/431745133 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bd015de40 con 0x7f2bd00718e0 2023-06-10T19:02:58.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:58.706+0000 7f2bd5e52640 1 --2- 172.21.15.53:0/431745133 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bd00718e0 0x7f2bd0069450 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f2bc8009d90 tx=0x7f2bc801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e6519f885861959 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:58.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:58.706+0000 7f2bc7fff640 1 -- 172.21.15.53:0/431745133 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc80a58f0 con 0x7f2bd00718e0 2023-06-10T19:02:58.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:58.706+0000 7f2bc7fff640 1 -- 172.21.15.53:0/431745133 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bc80a5a50 con 0x7f2bd00718e0 2023-06-10T19:02:58.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:58.706+0000 7f2bc7fff640 1 -- 172.21.15.53:0/431745133 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc80a5de0 con 0x7f2bd00718e0 2023-06-10T19:02:58.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:58.706+0000 7f2bd78b5640 1 -- 172.21.15.53:0/431745133 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bd00718e0 msgr2=0x7f2bd0069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:58.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:58.706+0000 7f2bd78b5640 1 --2- 172.21.15.53:0/431745133 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bd00718e0 0x7f2bd0069450 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f2bc8009d90 tx=0x7f2bc801c920 comp rx=0 tx=0).stop 2023-06-10T19:02:58.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:58.706+0000 7f2bd78b5640 1 -- 172.21.15.53:0/431745133 shutdown_connections 2023-06-10T19:02:58.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:58.706+0000 7f2bd78b5640 1 --2- 172.21.15.53:0/431745133 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bd00718e0 0x7f2bd0069450 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:58.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:58.706+0000 7f2bd78b5640 1 --2- 172.21.15.53:0/431745133 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2bd00ad730 0x7f2bd00713a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:58.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:58.706+0000 7f2bd78b5640 1 -- 172.21.15.53:0/431745133 >> 172.21.15.53:0/431745133 conn(0x7f2bd00cafc0 msgr2=0x7f2bd00cb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:58.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:58.706+0000 7f2bd78b5640 1 -- 172.21.15.53:0/431745133 shutdown_connections 2023-06-10T19:02:58.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:58.706+0000 7f2bd78b5640 1 -- 172.21.15.53:0/431745133 wait complete. 2023-06-10T19:02:58.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:58.706+0000 7f2bd78b5640 1 Processor -- start 2023-06-10T19:02:58.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:58.706+0000 7f2bd78b5640 1 -- start start 2023-06-10T19:02:58.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:58.710+0000 7f2bd78b5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2bd00718e0 0x7f2bd0152c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:58.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:58.710+0000 7f2bd78b5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bd00ad730 0x7f2bd015c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:58.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:58.710+0000 7f2bd78b5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2bd0159630 0x7f2bd00c5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:58.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:58.710+0000 7f2bd78b5640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd0153f60 con 0x7f2bd00ad730 2023-06-10T19:02:58.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:58.710+0000 7f2bd78b5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd0154240 con 0x7f2bd0159630 2023-06-10T19:02:58.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:58.710+0000 7f2bd78b5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd0154520 con 0x7f2bd00718e0 2023-06-10T19:02:58.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:58.710+0000 7f2bd4e50640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bd00ad730 0x7f2bd015c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:58.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:58.710+0000 7f2bd4e50640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bd00ad730 0x7f2bd015c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59632/0 (socket says 172.21.15.53:59632) 2023-06-10T19:02:58.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:58.710+0000 7f2bd4e50640 1 -- 172.21.15.53:0/1654741918 learned_addr learned my addr 172.21.15.53:0/1654741918 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:02:58.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:58.710+0000 7f2bd5651640 1 --2- 172.21.15.53:0/1654741918 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2bd00718e0 0x7f2bd0152c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:58.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:58.710+0000 7f2bd5e52640 1 --2- 172.21.15.53:0/1654741918 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2bd0159630 0x7f2bd00c5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:58.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:58.710+0000 7f2bd4e50640 1 -- 172.21.15.53:0/1654741918 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2bd00718e0 msgr2=0x7f2bd0152c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:58.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:58.710+0000 7f2bd4e50640 1 --2- 172.21.15.53:0/1654741918 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2bd00718e0 0x7f2bd0152c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:58.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:58.710+0000 7f2bd4e50640 1 -- 172.21.15.53:0/1654741918 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2bd0159630 msgr2=0x7f2bd00c5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:58.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:58.710+0000 7f2bd4e50640 1 --2- 172.21.15.53:0/1654741918 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2bd0159630 0x7f2bd00c5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:58.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:58.710+0000 7f2bd4e50640 1 -- 172.21.15.53:0/1654741918 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bc8009a70 con 0x7f2bd00ad730 2023-06-10T19:02:58.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:58.710+0000 7f2bd5651640 1 --2- 172.21.15.53:0/1654741918 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2bd00718e0 0x7f2bd0152c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:02:58.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:58.710+0000 7f2bd4e50640 1 --2- 172.21.15.53:0/1654741918 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bd00ad730 0x7f2bd015c520 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f2bc000d800 tx=0x7f2bc000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:58.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:58.710+0000 7f2bc5ffb640 1 -- 172.21.15.53:0/1654741918 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc000b6c0 con 0x7f2bd00ad730 2023-06-10T19:02:58.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:58.710+0000 7f2bc5ffb640 1 -- 172.21.15.53:0/1654741918 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bc000b860 con 0x7f2bd00ad730 2023-06-10T19:02:58.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:58.710+0000 7f2bd78b5640 1 -- 172.21.15.53:0/1654741918 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bd0159e80 con 0x7f2bd00ad730 2023-06-10T19:02:58.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:58.710+0000 7f2bc5ffb640 1 -- 172.21.15.53:0/1654741918 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc000bc10 con 0x7f2bd00ad730 2023-06-10T19:02:58.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:58.710+0000 7f2bd78b5640 1 -- 172.21.15.53:0/1654741918 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bd0154b50 con 0x7f2bd00ad730 2023-06-10T19:02:58.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:58.710+0000 7f2bd78b5640 1 -- 172.21.15.53:0/1654741918 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bd00cbd00 con 0x7f2bd00ad730 2023-06-10T19:02:58.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:58.710+0000 7f2bc5ffb640 1 -- 172.21.15.53:0/1654741918 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2bc001e460 con 0x7f2bd00ad730 2023-06-10T19:02:58.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:58.710+0000 7f2bc5ffb640 1 --2- 172.21.15.53:0/1654741918 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2bb4066280 0x7f2bb4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:02:58.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:58.710+0000 7f2bc5ffb640 1 -- 172.21.15.53:0/1654741918 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6264+0+0 (secure 0 0 0) 0x7f2bc0084400 con 0x7f2bd00ad730 2023-06-10T19:02:58.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:58.710+0000 7f2bd5651640 1 --2- 172.21.15.53:0/1654741918 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2bb4066280 0x7f2bb4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:02:58.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:58.714+0000 7f2bd5651640 1 --2- 172.21.15.53:0/1654741918 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2bb4066280 0x7f2bb4068730 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc000f70 tx=0x7f2bcc007cd0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:02:58.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:58.714+0000 7f2bc5ffb640 1 -- 172.21.15.53:0/1654741918 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2bc00517a0 con 0x7f2bd00ad730 2023-06-10T19:02:58.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:58.902+0000 7f2bd78b5640 1 -- 172.21.15.53:0/1654741918 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2bd004d790 con 0x7f2bd00ad730 2023-06-10T19:02:58.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:58.902+0000 7f2bc5ffb640 1 -- 172.21.15.53:0/1654741918 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+4683 (secure 0 0 0) 0x7f2bc0054dc0 con 0x7f2bd00ad730 2023-06-10T19:02:58.908 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:02:58.908 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1617157670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1617157670},{"type":"v1","addr":"172.21.15.117:6836","nonce":1617157670}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6113,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3414416090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":3414416090},{"type":"v1","addr":"172.21.15.117:6837","nonce":3414416090}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6718,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2533467097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2533467097},{"type":"v1","addr":"172.21.15.53:6835","nonce":2533467097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:02:02.642809+0000","modified":"2023-06-10T19:02:36.149418+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8127":{"gid":8127,"name":"a","rank":0,"incarnation":52,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.53:6833/2984379521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2984379521},{"type":"v1","addr":"172.21.15.53:6833","nonce":2984379521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-06-10T19:02:58.910 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 53 2023-06-10T19:02:58.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:58.906+0000 7f2bd78b5640 1 -- 172.21.15.53:0/1654741918 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2bb4066280 msgr2=0x7f2bb4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:58.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:58.906+0000 7f2bd78b5640 1 --2- 172.21.15.53:0/1654741918 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2bb4066280 0x7f2bb4068730 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc000f70 tx=0x7f2bcc007cd0 comp rx=0 tx=0).stop 2023-06-10T19:02:58.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:58.906+0000 7f2bd78b5640 1 -- 172.21.15.53:0/1654741918 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bd00ad730 msgr2=0x7f2bd015c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:02:58.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:58.906+0000 7f2bd78b5640 1 --2- 172.21.15.53:0/1654741918 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bd00ad730 0x7f2bd015c520 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f2bc000d800 tx=0x7f2bc000dcc0 comp rx=0 tx=0).stop 2023-06-10T19:02:58.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:58.906+0000 7f2bd78b5640 1 -- 172.21.15.53:0/1654741918 shutdown_connections 2023-06-10T19:02:58.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:58.906+0000 7f2bd78b5640 1 --2- 172.21.15.53:0/1654741918 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2bb4066280 0x7f2bb4068730 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:58.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:58.906+0000 7f2bd78b5640 1 --2- 172.21.15.53:0/1654741918 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2bd0159630 0x7f2bd00c5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:58.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:58.906+0000 7f2bd78b5640 1 --2- 172.21.15.53:0/1654741918 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bd00ad730 0x7f2bd015c520 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:58.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:58.906+0000 7f2bd78b5640 1 --2- 172.21.15.53:0/1654741918 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2bd00718e0 0x7f2bd0152c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:02:58.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:58.906+0000 7f2bd78b5640 1 -- 172.21.15.53:0/1654741918 >> 172.21.15.53:0/1654741918 conn(0x7f2bd00cafc0 msgr2=0x7f2bd00cec20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:02:58.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:58.906+0000 7f2bd78b5640 1 -- 172.21.15.53:0/1654741918 shutdown_connections 2023-06-10T19:02:58.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:02:58.906+0000 7f2bd78b5640 1 -- 172.21.15.53:0/1654741918 wait complete. 2023-06-10T19:02:58.927 DEBUG:tasks.cephfs.filesystem:mapped states ['up:reconnect'] to None 2023-06-10T19:02:59.928 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:03:00.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:00.062+0000 7f0e2f3a5640 1 Processor -- start 2023-06-10T19:03:00.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:00.062+0000 7f0e2f3a5640 1 -- start start 2023-06-10T19:03:00.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:00.062+0000 7f0e2f3a5640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0e28162640 0x7f0e28164a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:00.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:00.062+0000 7f0e2f3a5640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e28159b50 con 0x7f0e28071060 2023-06-10T19:03:00.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:00.062+0000 7f0e2f3a5640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e280702a0 con 0x7f0e280c9840 2023-06-10T19:03:00.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:00.062+0000 7f0e2f3a5640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e28070580 con 0x7f0e28162640 2023-06-10T19:03:00.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:00.062+0000 7f0e2d942640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0e28162640 0x7f0e28164a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:00.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:00.062+0000 7f0e2c940640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f0e28071060 0x7f0e280af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:58282/0 (socket says 172.21.15.53:58282) 2023-06-10T19:03:00.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:00.062+0000 7f0e2c940640 1 -- 172.21.15.53:0/1932182953 learned_addr learned my addr 172.21.15.53:0/1932182953 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:03:00.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:00.062+0000 7f0e2d942640 1 -- 172.21.15.53:0/1932182953 >> v1:172.21.15.117:6789/0 conn(0x7f0e280c9840 legacy=0x7f0e280c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:00.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:00.062+0000 7f0e2d942640 1 -- 172.21.15.53:0/1932182953 >> v1:172.21.15.53:6789/0 conn(0x7f0e28071060 legacy=0x7f0e280af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:00.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:00.062+0000 7f0e2d942640 1 -- 172.21.15.53:0/1932182953 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e28070860 con 0x7f0e28162640 2023-06-10T19:03:00.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:00.066+0000 7f0e2d942640 1 --2- 172.21.15.53:0/1932182953 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e28162640 0x7f0e28164a20 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f0e20009d90 tx=0x7f0e2001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11724a0306e9416a server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:00.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:00.066+0000 7f0e1ffff640 1 -- 172.21.15.53:0/1932182953 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e200a5a00 con 0x7f0e28162640 2023-06-10T19:03:00.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:00.066+0000 7f0e1ffff640 1 -- 172.21.15.53:0/1932182953 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e200a5b60 con 0x7f0e28162640 2023-06-10T19:03:00.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:00.066+0000 7f0e1ffff640 1 -- 172.21.15.53:0/1932182953 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e200ad440 con 0x7f0e28162640 2023-06-10T19:03:00.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:00.066+0000 7f0e2f3a5640 1 -- 172.21.15.53:0/1932182953 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e28162640 msgr2=0x7f0e28164a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:00.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:00.066+0000 7f0e2f3a5640 1 --2- 172.21.15.53:0/1932182953 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e28162640 0x7f0e28164a20 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f0e20009d90 tx=0x7f0e2001c920 comp rx=0 tx=0).stop 2023-06-10T19:03:00.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:00.066+0000 7f0e2f3a5640 1 -- 172.21.15.53:0/1932182953 shutdown_connections 2023-06-10T19:03:00.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:00.066+0000 7f0e2f3a5640 1 --2- 172.21.15.53:0/1932182953 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e28162640 0x7f0e28164a20 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:00.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:00.066+0000 7f0e2f3a5640 1 -- 172.21.15.53:0/1932182953 >> 172.21.15.53:0/1932182953 conn(0x7f0e2806a0d0 msgr2=0x7f0e280ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:00.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:00.066+0000 7f0e2f3a5640 1 -- 172.21.15.53:0/1932182953 shutdown_connections 2023-06-10T19:03:00.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:00.066+0000 7f0e2f3a5640 1 -- 172.21.15.53:0/1932182953 wait complete. 2023-06-10T19:03:00.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:00.066+0000 7f0e2f3a5640 1 Processor -- start 2023-06-10T19:03:00.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:00.066+0000 7f0e2f3a5640 1 -- start start 2023-06-10T19:03:00.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:00.066+0000 7f0e2f3a5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e28071060 0x7f0e280b1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:00.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:00.066+0000 7f0e2f3a5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0e280c9840 0x7f0e280b3430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:00.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:00.066+0000 7f0e2f3a5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0e28162640 0x7f0e28152fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:00.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:00.066+0000 7f0e2f3a5640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e280b3970 con 0x7f0e28071060 2023-06-10T19:03:00.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:00.066+0000 7f0e2f3a5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e280b2390 con 0x7f0e28162640 2023-06-10T19:03:00.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:00.066+0000 7f0e2f3a5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e280b2670 con 0x7f0e280c9840 2023-06-10T19:03:00.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:00.066+0000 7f0e2d141640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e28071060 0x7f0e280b1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:00.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:00.066+0000 7f0e2d141640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e28071060 0x7f0e280b1db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59644/0 (socket says 172.21.15.53:59644) 2023-06-10T19:03:00.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:00.066+0000 7f0e2d141640 1 -- 172.21.15.53:0/445997591 learned_addr learned my addr 172.21.15.53:0/445997591 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:00.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:00.070+0000 7f0e2c940640 1 --2- 172.21.15.53:0/445997591 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0e280c9840 0x7f0e280b3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:00.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:00.070+0000 7f0e2d942640 1 --2- 172.21.15.53:0/445997591 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0e28162640 0x7f0e28152fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:00.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:00.070+0000 7f0e2d141640 1 -- 172.21.15.53:0/445997591 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0e280c9840 msgr2=0x7f0e280b3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:00.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:00.070+0000 7f0e2d141640 1 --2- 172.21.15.53:0/445997591 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0e280c9840 0x7f0e280b3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:00.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:00.070+0000 7f0e2d141640 1 -- 172.21.15.53:0/445997591 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0e28162640 msgr2=0x7f0e28152fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:00.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:00.070+0000 7f0e2d141640 1 --2- 172.21.15.53:0/445997591 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0e28162640 0x7f0e28152fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:00.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:00.070+0000 7f0e2d141640 1 -- 172.21.15.53:0/445997591 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e20009a70 con 0x7f0e28071060 2023-06-10T19:03:00.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:00.070+0000 7f0e2d141640 1 --2- 172.21.15.53:0/445997591 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e28071060 0x7f0e280b1db0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f0e2400c420 tx=0x7f0e2400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:00.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:00.070+0000 7f0e1dffb640 1 -- 172.21.15.53:0/445997591 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e240052d0 con 0x7f0e28071060 2023-06-10T19:03:00.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:00.070+0000 7f0e1dffb640 1 -- 172.21.15.53:0/445997591 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e24005430 con 0x7f0e28071060 2023-06-10T19:03:00.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:00.070+0000 7f0e2f3a5640 1 -- 172.21.15.53:0/445997591 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e280b2950 con 0x7f0e28071060 2023-06-10T19:03:00.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:00.070+0000 7f0e1dffb640 1 -- 172.21.15.53:0/445997591 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e24007260 con 0x7f0e28071060 2023-06-10T19:03:00.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:00.070+0000 7f0e2f3a5640 1 -- 172.21.15.53:0/445997591 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e280b2f10 con 0x7f0e28071060 2023-06-10T19:03:00.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:00.070+0000 7f0e2f3a5640 1 -- 172.21.15.53:0/445997591 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e2804d790 con 0x7f0e28071060 2023-06-10T19:03:00.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:00.070+0000 7f0e1dffb640 1 -- 172.21.15.53:0/445997591 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0e240073c0 con 0x7f0e28071060 2023-06-10T19:03:00.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:00.070+0000 7f0e1dffb640 1 --2- 172.21.15.53:0/445997591 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0e0c066280 0x7f0e0c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:00.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:00.070+0000 7f0e1dffb640 1 -- 172.21.15.53:0/445997591 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6264+0+0 (secure 0 0 0) 0x7f0e240830a0 con 0x7f0e28071060 2023-06-10T19:03:00.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:00.070+0000 7f0e2c940640 1 --2- 172.21.15.53:0/445997591 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0e0c066280 0x7f0e0c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:00.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:00.070+0000 7f0e2c940640 1 --2- 172.21.15.53:0/445997591 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0e0c066280 0x7f0e0c068730 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f0e280b1d10 tx=0x7f0e18009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:00.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:00.074+0000 7f0e1dffb640 1 -- 172.21.15.53:0/445997591 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0e24050590 con 0x7f0e28071060 2023-06-10T19:03:00.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:00.262+0000 7f0e2f3a5640 1 -- 172.21.15.53:0/445997591 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0e280ad4b0 con 0x7f0e28071060 2023-06-10T19:03:00.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:00.266+0000 7f0e1dffb640 1 -- 172.21.15.53:0/445997591 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+4683 (secure 0 0 0) 0x7f0e24053bb0 con 0x7f0e28071060 2023-06-10T19:03:00.268 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:03:00.268 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1617157670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1617157670},{"type":"v1","addr":"172.21.15.117:6836","nonce":1617157670}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6113,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3414416090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":3414416090},{"type":"v1","addr":"172.21.15.117:6837","nonce":3414416090}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6718,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2533467097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2533467097},{"type":"v1","addr":"172.21.15.53:6835","nonce":2533467097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:02:02.642809+0000","modified":"2023-06-10T19:02:36.149418+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8127":{"gid":8127,"name":"a","rank":0,"incarnation":52,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.53:6833/2984379521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2984379521},{"type":"v1","addr":"172.21.15.53:6833","nonce":2984379521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-06-10T19:03:00.269 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 53 2023-06-10T19:03:00.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:00.266+0000 7f0e2f3a5640 1 -- 172.21.15.53:0/445997591 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0e0c066280 msgr2=0x7f0e0c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:00.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:00.266+0000 7f0e2f3a5640 1 --2- 172.21.15.53:0/445997591 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0e0c066280 0x7f0e0c068730 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f0e280b1d10 tx=0x7f0e18009040 comp rx=0 tx=0).stop 2023-06-10T19:03:00.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:00.266+0000 7f0e2f3a5640 1 -- 172.21.15.53:0/445997591 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e28071060 msgr2=0x7f0e280b1db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:00.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:00.266+0000 7f0e2f3a5640 1 --2- 172.21.15.53:0/445997591 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e28071060 0x7f0e280b1db0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f0e2400c420 tx=0x7f0e2400c8e0 comp rx=0 tx=0).stop 2023-06-10T19:03:00.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:00.266+0000 7f0e2f3a5640 1 -- 172.21.15.53:0/445997591 shutdown_connections 2023-06-10T19:03:00.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:00.266+0000 7f0e2f3a5640 1 --2- 172.21.15.53:0/445997591 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0e0c066280 0x7f0e0c068730 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:00.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:00.266+0000 7f0e2f3a5640 1 --2- 172.21.15.53:0/445997591 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0e28162640 0x7f0e28152fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:00.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:00.266+0000 7f0e2f3a5640 1 --2- 172.21.15.53:0/445997591 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0e280c9840 0x7f0e280b3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:00.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:00.266+0000 7f0e2f3a5640 1 --2- 172.21.15.53:0/445997591 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e28071060 0x7f0e280b1db0 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:00.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:00.266+0000 7f0e2f3a5640 1 -- 172.21.15.53:0/445997591 >> 172.21.15.53:0/445997591 conn(0x7f0e2806a0d0 msgr2=0x7f0e280af550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:00.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:00.266+0000 7f0e2f3a5640 1 -- 172.21.15.53:0/445997591 shutdown_connections 2023-06-10T19:03:00.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:00.266+0000 7f0e2f3a5640 1 -- 172.21.15.53:0/445997591 wait complete. 2023-06-10T19:03:00.288 DEBUG:tasks.cephfs.filesystem:mapped states ['up:reconnect'] to None 2023-06-10T19:03:01.289 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:03:01.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:01.422+0000 7f8db557b640 1 Processor -- start 2023-06-10T19:03:01.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:01.422+0000 7f8db557b640 1 -- start start 2023-06-10T19:03:01.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:01.422+0000 7f8db557b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8db00c9840 0x7f8db00c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:01.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:01.422+0000 7f8db557b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8db006b090 0x7f8db006b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:01.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:01.422+0000 7f8db557b640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8db0159b50 con 0x7f8db0071060 2023-06-10T19:03:01.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:01.422+0000 7f8db557b640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8db00ca150 con 0x7f8db00c9840 2023-06-10T19:03:01.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:01.422+0000 7f8db557b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8db00702a0 con 0x7f8db006b090 2023-06-10T19:03:01.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:01.422+0000 7f8daeffd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8db00c9840 0x7f8db00c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:01.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:01.422+0000 7f8daf7fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8db006b090 0x7f8db006b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:01.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:01.422+0000 7f8daf7fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8db006b090 0x7f8db006b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.53:34154/0 (socket says 172.21.15.53:34154) 2023-06-10T19:03:01.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:01.422+0000 7f8daf7fe640 1 -- 172.21.15.53:0/2919602426 learned_addr learned my addr 172.21.15.53:0/2919602426 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:01.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:01.422+0000 7f8dadffb640 1 -- 172.21.15.53:0/2919602426 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 472981932 0 0) 0x7f8db0159b50 con 0x7f8db0071060 2023-06-10T19:03:01.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:01.422+0000 7f8dadffb640 1 -- 172.21.15.53:0/2919602426 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d98003530 con 0x7f8db0071060 2023-06-10T19:03:01.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:01.422+0000 7f8daf7fe640 1 -- 172.21.15.53:0/2919602426 >> v2:172.21.15.117:3300/0 conn(0x7f8db00c9840 msgr2=0x7f8db00c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:01.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:01.422+0000 7f8daf7fe640 1 --2- 172.21.15.53:0/2919602426 >> v2:172.21.15.117:3300/0 conn(0x7f8db00c9840 0x7f8db00c9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:01.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:01.422+0000 7f8daf7fe640 1 -- 172.21.15.53:0/2919602426 >> v1:172.21.15.117:6789/0 conn(0x7f8db0071060 legacy=0x7f8db00af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:01.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:01.422+0000 7f8daf7fe640 1 -- 172.21.15.53:0/2919602426 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8db0070580 con 0x7f8db006b090 2023-06-10T19:03:01.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:01.422+0000 7f8daeffd640 1 --2- 172.21.15.53:0/2919602426 >> v2:172.21.15.117:3300/0 conn(0x7f8db00c9840 0x7f8db00c9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-10T19:03:01.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:01.426+0000 7f8daf7fe640 1 --2- 172.21.15.53:0/2919602426 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8db006b090 0x7f8db006b530 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8da8009e50 tx=0x7f8da801c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46ebc443259653b6 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:01.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:01.426+0000 7f8dadffb640 1 -- 172.21.15.53:0/2919602426 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da80a58a0 con 0x7f8db006b090 2023-06-10T19:03:01.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:01.426+0000 7f8dadffb640 1 -- 172.21.15.53:0/2919602426 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8da80a5a00 con 0x7f8db006b090 2023-06-10T19:03:01.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:01.426+0000 7f8dadffb640 1 -- 172.21.15.53:0/2919602426 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da80a5d90 con 0x7f8db006b090 2023-06-10T19:03:01.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:01.426+0000 7f8db557b640 1 -- 172.21.15.53:0/2919602426 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8db006b090 msgr2=0x7f8db006b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:01.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:01.426+0000 7f8db557b640 1 --2- 172.21.15.53:0/2919602426 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8db006b090 0x7f8db006b530 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8da8009e50 tx=0x7f8da801c9e0 comp rx=0 tx=0).stop 2023-06-10T19:03:01.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:01.426+0000 7f8db557b640 1 -- 172.21.15.53:0/2919602426 shutdown_connections 2023-06-10T19:03:01.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:01.426+0000 7f8db557b640 1 --2- 172.21.15.53:0/2919602426 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8db006b090 0x7f8db006b530 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:01.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:01.426+0000 7f8db557b640 1 --2- 172.21.15.53:0/2919602426 >> v2:172.21.15.117:3300/0 conn(0x7f8db00c9840 0x7f8db00c9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:01.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:01.426+0000 7f8db557b640 1 -- 172.21.15.53:0/2919602426 >> 172.21.15.53:0/2919602426 conn(0x7f8db006a0d0 msgr2=0x7f8db00ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:01.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:01.426+0000 7f8db557b640 1 -- 172.21.15.53:0/2919602426 shutdown_connections 2023-06-10T19:03:01.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:01.426+0000 7f8db557b640 1 -- 172.21.15.53:0/2919602426 wait complete. 2023-06-10T19:03:01.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:01.426+0000 7f8db557b640 1 Processor -- start 2023-06-10T19:03:01.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:01.426+0000 7f8db557b640 1 -- start start 2023-06-10T19:03:01.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:01.430+0000 7f8db557b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8db006b090 0x7f8db00c4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:01.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:01.430+0000 7f8db557b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8db0071060 0x7f8db00c7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:01.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:01.430+0000 7f8db557b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8db00c9840 0x7f8db014a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:01.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:01.430+0000 7f8db557b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8db00c5350 con 0x7f8db006b090 2023-06-10T19:03:01.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:01.430+0000 7f8db557b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8db00c5630 con 0x7f8db0071060 2023-06-10T19:03:01.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:01.430+0000 7f8db557b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8db00c5910 con 0x7f8db00c9840 2023-06-10T19:03:01.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:01.430+0000 7f8daeffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8db006b090 0x7f8db00c4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:01.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:01.430+0000 7f8daeffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8db006b090 0x7f8db00c4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34104/0 (socket says 172.21.15.53:34104) 2023-06-10T19:03:01.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:01.430+0000 7f8daeffd640 1 -- 172.21.15.53:0/3151372368 learned_addr learned my addr 172.21.15.53:0/3151372368 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:01.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:01.430+0000 7f8dae7fc640 1 --2- 172.21.15.53:0/3151372368 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8db0071060 0x7f8db00c7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:01.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:01.430+0000 7f8daf7fe640 1 --2- 172.21.15.53:0/3151372368 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8db00c9840 0x7f8db014a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:01.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:01.430+0000 7f8daeffd640 1 -- 172.21.15.53:0/3151372368 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8db00c9840 msgr2=0x7f8db014a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:01.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:01.430+0000 7f8daeffd640 1 --2- 172.21.15.53:0/3151372368 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8db00c9840 0x7f8db014a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:01.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:01.430+0000 7f8daeffd640 1 -- 172.21.15.53:0/3151372368 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8db0071060 msgr2=0x7f8db00c7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:01.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:01.430+0000 7f8daeffd640 1 --2- 172.21.15.53:0/3151372368 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8db0071060 0x7f8db00c7820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:01.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:01.430+0000 7f8daeffd640 1 -- 172.21.15.53:0/3151372368 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8da0009420 con 0x7f8db006b090 2023-06-10T19:03:01.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:01.430+0000 7f8daf7fe640 1 --2- 172.21.15.53:0/3151372368 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8db00c9840 0x7f8db014a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:03:01.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:01.430+0000 7f8daeffd640 1 --2- 172.21.15.53:0/3151372368 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8db006b090 0x7f8db00c4d70 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f8da000e980 tx=0x7f8da000ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:01.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:01.430+0000 7f8d977fe640 1 -- 172.21.15.53:0/3151372368 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da000ca00 con 0x7f8db006b090 2023-06-10T19:03:01.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:01.430+0000 7f8d977fe640 1 -- 172.21.15.53:0/3151372368 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8da000cb60 con 0x7f8db006b090 2023-06-10T19:03:01.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:01.430+0000 7f8db557b640 1 -- 172.21.15.53:0/3151372368 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8da8009b30 con 0x7f8db006b090 2023-06-10T19:03:01.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:01.430+0000 7f8d977fe640 1 -- 172.21.15.53:0/3151372368 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da0013470 con 0x7f8db006b090 2023-06-10T19:03:01.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:01.430+0000 7f8db557b640 1 -- 172.21.15.53:0/3151372368 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8db00c5ed0 con 0x7f8db006b090 2023-06-10T19:03:01.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:01.430+0000 7f8db557b640 1 -- 172.21.15.53:0/3151372368 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8db004d790 con 0x7f8db006b090 2023-06-10T19:03:01.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:01.430+0000 7f8d977fe640 1 -- 172.21.15.53:0/3151372368 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8da00135d0 con 0x7f8db006b090 2023-06-10T19:03:01.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:01.430+0000 7f8d977fe640 1 --2- 172.21.15.53:0/3151372368 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8d9c066280 0x7f8d9c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:01.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:01.430+0000 7f8d977fe640 1 -- 172.21.15.53:0/3151372368 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6264+0+0 (secure 0 0 0) 0x7f8da0084430 con 0x7f8db006b090 2023-06-10T19:03:01.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:01.430+0000 7f8dae7fc640 1 --2- 172.21.15.53:0/3151372368 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8d9c066280 0x7f8d9c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:01.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:01.434+0000 7f8dae7fc640 1 --2- 172.21.15.53:0/3151372368 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8d9c066280 0x7f8d9c068730 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f8db014cc60 tx=0x7f8da4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:01.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:01.434+0000 7f8d977fe640 1 -- 172.21.15.53:0/3151372368 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8da00517e0 con 0x7f8db006b090 2023-06-10T19:03:01.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:01.622+0000 7f8db557b640 1 -- 172.21.15.53:0/3151372368 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8db00cb140 con 0x7f8db006b090 2023-06-10T19:03:01.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:01.622+0000 7f8d977fe640 1 -- 172.21.15.53:0/3151372368 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+4683 (secure 0 0 0) 0x7f8da0054e00 con 0x7f8db006b090 2023-06-10T19:03:01.627 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:03:01.627 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1617157670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1617157670},{"type":"v1","addr":"172.21.15.117:6836","nonce":1617157670}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6113,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3414416090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":3414416090},{"type":"v1","addr":"172.21.15.117:6837","nonce":3414416090}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6718,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2533467097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2533467097},{"type":"v1","addr":"172.21.15.53:6835","nonce":2533467097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:02:02.642809+0000","modified":"2023-06-10T19:02:36.149418+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8127":{"gid":8127,"name":"a","rank":0,"incarnation":52,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.53:6833/2984379521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2984379521},{"type":"v1","addr":"172.21.15.53:6833","nonce":2984379521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-06-10T19:03:01.628 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 53 2023-06-10T19:03:01.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:01.626+0000 7f8db557b640 1 -- 172.21.15.53:0/3151372368 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8d9c066280 msgr2=0x7f8d9c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:01.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:01.626+0000 7f8db557b640 1 --2- 172.21.15.53:0/3151372368 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8d9c066280 0x7f8d9c068730 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f8db014cc60 tx=0x7f8da4009040 comp rx=0 tx=0).stop 2023-06-10T19:03:01.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:01.626+0000 7f8db557b640 1 -- 172.21.15.53:0/3151372368 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8db006b090 msgr2=0x7f8db00c4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:01.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:01.626+0000 7f8db557b640 1 --2- 172.21.15.53:0/3151372368 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8db006b090 0x7f8db00c4d70 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f8da000e980 tx=0x7f8da000ee40 comp rx=0 tx=0).stop 2023-06-10T19:03:01.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:01.626+0000 7f8db557b640 1 -- 172.21.15.53:0/3151372368 shutdown_connections 2023-06-10T19:03:01.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:01.626+0000 7f8db557b640 1 --2- 172.21.15.53:0/3151372368 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8d9c066280 0x7f8d9c068730 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:01.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:01.626+0000 7f8db557b640 1 --2- 172.21.15.53:0/3151372368 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8db00c9840 0x7f8db014a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:01.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:01.626+0000 7f8db557b640 1 --2- 172.21.15.53:0/3151372368 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8db0071060 0x7f8db00c7820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:01.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:01.626+0000 7f8db557b640 1 --2- 172.21.15.53:0/3151372368 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8db006b090 0x7f8db00c4d70 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:01.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:01.626+0000 7f8db557b640 1 -- 172.21.15.53:0/3151372368 >> 172.21.15.53:0/3151372368 conn(0x7f8db006a0d0 msgr2=0x7f8db0157480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:01.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:01.626+0000 7f8db557b640 1 -- 172.21.15.53:0/3151372368 shutdown_connections 2023-06-10T19:03:01.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:01.626+0000 7f8db557b640 1 -- 172.21.15.53:0/3151372368 wait complete. 2023-06-10T19:03:01.646 DEBUG:tasks.cephfs.filesystem:mapped states ['up:reconnect'] to None 2023-06-10T19:03:02.648 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:03:02.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:02.778+0000 7f0c45fa6640 1 Processor -- start 2023-06-10T19:03:02.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:02.778+0000 7f0c45fa6640 1 -- start start 2023-06-10T19:03:02.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:02.782+0000 7f0c45fa6640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0c400c9840 0x7f0c400c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:02.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:02.782+0000 7f0c45fa6640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0c4006b090 0x7f0c4006b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:02.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:02.782+0000 7f0c45fa6640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c40159b50 con 0x7f0c40071060 2023-06-10T19:03:02.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:02.782+0000 7f0c45fa6640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c400ca150 con 0x7f0c4006b090 2023-06-10T19:03:02.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:02.782+0000 7f0c45fa6640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c400702a0 con 0x7f0c400c9840 2023-06-10T19:03:02.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:02.782+0000 7f0c3effd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f0c40071060 0x7f0c400af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41794/0 (socket says 172.21.15.53:41794) 2023-06-10T19:03:02.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:02.782+0000 7f0c3ffff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0c4006b090 0x7f0c4006b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:02.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:02.782+0000 7f0c3effd640 1 -- 172.21.15.53:0/1736858016 learned_addr learned my addr 172.21.15.53:0/1736858016 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:03:02.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:02.782+0000 7f0c3f7fe640 1 --2- 172.21.15.53:0/1736858016 >> v2:172.21.15.117:3300/0 conn(0x7f0c400c9840 0x7f0c400c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:02.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:02.782+0000 7f0c3ffff640 1 -- 172.21.15.53:0/1736858016 >> v2:172.21.15.117:3300/0 conn(0x7f0c400c9840 msgr2=0x7f0c400c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:02.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:02.782+0000 7f0c3ffff640 1 --2- 172.21.15.53:0/1736858016 >> v2:172.21.15.117:3300/0 conn(0x7f0c400c9840 0x7f0c400c9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:02.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:02.782+0000 7f0c3ffff640 1 -- 172.21.15.53:0/1736858016 >> v1:172.21.15.53:6789/0 conn(0x7f0c40071060 legacy=0x7f0c400af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:02.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:02.782+0000 7f0c3e7fc640 1 -- 172.21.15.53:0/1736858016 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 717420240 0 0) 0x7f0c40159b50 con 0x7f0c40071060 2023-06-10T19:03:02.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:02.782+0000 7f0c3ffff640 1 -- 172.21.15.53:0/1736858016 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c40070580 con 0x7f0c4006b090 2023-06-10T19:03:02.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:02.782+0000 7f0c3ffff640 1 --2- 172.21.15.53:0/1736858016 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c4006b090 0x7f0c4006b510 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7f0c40071d80 tx=0x7f0c3801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77187feb768c3efb server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:02.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:02.782+0000 7f0c3e7fc640 1 -- 172.21.15.53:0/1736858016 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c380a7070 con 0x7f0c4006b090 2023-06-10T19:03:02.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:02.786+0000 7f0c3e7fc640 1 -- 172.21.15.53:0/1736858016 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c380ab430 con 0x7f0c4006b090 2023-06-10T19:03:02.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:02.786+0000 7f0c3e7fc640 1 -- 172.21.15.53:0/1736858016 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c380ab7c0 con 0x7f0c4006b090 2023-06-10T19:03:02.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:02.786+0000 7f0c45fa6640 1 -- 172.21.15.53:0/1736858016 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c4006b090 msgr2=0x7f0c4006b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:02.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:02.786+0000 7f0c45fa6640 1 --2- 172.21.15.53:0/1736858016 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c4006b090 0x7f0c4006b510 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7f0c40071d80 tx=0x7f0c3801c430 comp rx=0 tx=0).stop 2023-06-10T19:03:02.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:02.786+0000 7f0c45fa6640 1 -- 172.21.15.53:0/1736858016 shutdown_connections 2023-06-10T19:03:02.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:02.786+0000 7f0c45fa6640 1 --2- 172.21.15.53:0/1736858016 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c4006b090 0x7f0c4006b510 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:02.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:02.786+0000 7f0c45fa6640 1 --2- 172.21.15.53:0/1736858016 >> v2:172.21.15.117:3300/0 conn(0x7f0c400c9840 0x7f0c400c9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:02.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:02.786+0000 7f0c45fa6640 1 -- 172.21.15.53:0/1736858016 >> 172.21.15.53:0/1736858016 conn(0x7f0c4006a0d0 msgr2=0x7f0c400ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:02.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:02.786+0000 7f0c45fa6640 1 -- 172.21.15.53:0/1736858016 shutdown_connections 2023-06-10T19:03:02.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:02.786+0000 7f0c45fa6640 1 -- 172.21.15.53:0/1736858016 wait complete. 2023-06-10T19:03:02.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:02.786+0000 7f0c45fa6640 1 Processor -- start 2023-06-10T19:03:02.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:02.786+0000 7f0c45fa6640 1 -- start start 2023-06-10T19:03:02.791 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:02.786+0000 7f0c45fa6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c4006b090 0x7f0c4014cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:02.791 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:02.786+0000 7f0c45fa6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0c40071060 0x7f0c400c17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:02.791 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:02.786+0000 7f0c45fa6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c400c9840 0x7f0c400c1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:02.791 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:02.786+0000 7f0c45fa6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c40158e10 con 0x7f0c400c9840 2023-06-10T19:03:02.791 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:02.786+0000 7f0c45fa6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c40158290 con 0x7f0c4006b090 2023-06-10T19:03:02.791 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:02.786+0000 7f0c45fa6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c40158570 con 0x7f0c40071060 2023-06-10T19:03:02.791 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:02.786+0000 7f0c3ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c400c9840 0x7f0c400c1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:02.791 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:02.786+0000 7f0c3ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c400c9840 0x7f0c400c1d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34124/0 (socket says 172.21.15.53:34124) 2023-06-10T19:03:02.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:02.786+0000 7f0c3ffff640 1 -- 172.21.15.53:0/447174105 learned_addr learned my addr 172.21.15.53:0/447174105 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:02.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:02.786+0000 7f0c3f7fe640 1 --2- 172.21.15.53:0/447174105 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c4006b090 0x7f0c4014cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:02.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:02.786+0000 7f0c3effd640 1 --2- 172.21.15.53:0/447174105 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0c40071060 0x7f0c400c17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:02.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:02.786+0000 7f0c3ffff640 1 -- 172.21.15.53:0/447174105 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0c40071060 msgr2=0x7f0c400c17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:02.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:02.786+0000 7f0c3ffff640 1 --2- 172.21.15.53:0/447174105 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0c40071060 0x7f0c400c17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:02.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:02.786+0000 7f0c3ffff640 1 -- 172.21.15.53:0/447174105 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c4006b090 msgr2=0x7f0c4014cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:02.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:02.786+0000 7f0c3ffff640 1 --2- 172.21.15.53:0/447174105 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c4006b090 0x7f0c4014cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:02.793 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:02.786+0000 7f0c3ffff640 1 -- 172.21.15.53:0/447174105 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c38009420 con 0x7f0c400c9840 2023-06-10T19:03:02.793 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:02.786+0000 7f0c3effd640 1 --2- 172.21.15.53:0/447174105 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0c40071060 0x7f0c400c17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:03:02.793 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:02.786+0000 7f0c3ffff640 1 --2- 172.21.15.53:0/447174105 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c400c9840 0x7f0c400c1d10 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f0c380ad040 tx=0x7f0c3801ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:02.794 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:02.786+0000 7f0c27fff640 1 -- 172.21.15.53:0/447174105 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c380b5810 con 0x7f0c400c9840 2023-06-10T19:03:02.794 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:02.786+0000 7f0c27fff640 1 -- 172.21.15.53:0/447174105 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c380b5990 con 0x7f0c400c9840 2023-06-10T19:03:02.794 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:02.786+0000 7f0c45fa6640 1 -- 172.21.15.53:0/447174105 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c40158850 con 0x7f0c400c9840 2023-06-10T19:03:02.794 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:02.786+0000 7f0c27fff640 1 -- 172.21.15.53:0/447174105 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c380b5d40 con 0x7f0c400c9840 2023-06-10T19:03:02.794 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:02.786+0000 7f0c45fa6640 1 -- 172.21.15.53:0/447174105 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c4014d1b0 con 0x7f0c400c9840 2023-06-10T19:03:02.795 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:02.790+0000 7f0c45fa6640 1 -- 172.21.15.53:0/447174105 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c4004d790 con 0x7f0c400c9840 2023-06-10T19:03:02.795 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:02.790+0000 7f0c27fff640 1 -- 172.21.15.53:0/447174105 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0c380c83e0 con 0x7f0c400c9840 2023-06-10T19:03:02.795 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:02.790+0000 7f0c27fff640 1 --2- 172.21.15.53:0/447174105 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0c2c066280 0x7f0c2c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:02.795 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:02.790+0000 7f0c27fff640 1 -- 172.21.15.53:0/447174105 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6264+0+0 (secure 0 0 0) 0x7f0c3811ee20 con 0x7f0c400c9840 2023-06-10T19:03:02.795 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:02.790+0000 7f0c3f7fe640 1 --2- 172.21.15.53:0/447174105 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0c2c066280 0x7f0c2c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:02.795 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:02.790+0000 7f0c3f7fe640 1 --2- 172.21.15.53:0/447174105 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0c2c066280 0x7f0c2c068730 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f0c3000b930 tx=0x7f0c30008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:02.797 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:02.794+0000 7f0c27fff640 1 -- 172.21.15.53:0/447174105 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0c380ec260 con 0x7f0c400c9840 2023-06-10T19:03:02.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:02.986+0000 7f0c45fa6640 1 -- 172.21.15.53:0/447174105 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0c400cb140 con 0x7f0c400c9840 2023-06-10T19:03:02.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:02.986+0000 7f0c27fff640 1 -- 172.21.15.53:0/447174105 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+4683 (secure 0 0 0) 0x7f0c380ef880 con 0x7f0c400c9840 2023-06-10T19:03:02.989 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:03:02.989 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1617157670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1617157670},{"type":"v1","addr":"172.21.15.117:6836","nonce":1617157670}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6113,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3414416090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":3414416090},{"type":"v1","addr":"172.21.15.117:6837","nonce":3414416090}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6718,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2533467097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2533467097},{"type":"v1","addr":"172.21.15.53:6835","nonce":2533467097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:02:02.642809+0000","modified":"2023-06-10T19:02:36.149418+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8127":{"gid":8127,"name":"a","rank":0,"incarnation":52,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.53:6833/2984379521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2984379521},{"type":"v1","addr":"172.21.15.53:6833","nonce":2984379521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-06-10T19:03:02.989 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 53 2023-06-10T19:03:02.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:02.986+0000 7f0c45fa6640 1 -- 172.21.15.53:0/447174105 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0c2c066280 msgr2=0x7f0c2c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:02.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:02.986+0000 7f0c45fa6640 1 --2- 172.21.15.53:0/447174105 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0c2c066280 0x7f0c2c068730 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f0c3000b930 tx=0x7f0c30008040 comp rx=0 tx=0).stop 2023-06-10T19:03:02.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:02.986+0000 7f0c45fa6640 1 -- 172.21.15.53:0/447174105 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c400c9840 msgr2=0x7f0c400c1d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:02.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:02.986+0000 7f0c45fa6640 1 --2- 172.21.15.53:0/447174105 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c400c9840 0x7f0c400c1d10 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f0c380ad040 tx=0x7f0c3801ac70 comp rx=0 tx=0).stop 2023-06-10T19:03:02.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:02.986+0000 7f0c45fa6640 1 -- 172.21.15.53:0/447174105 shutdown_connections 2023-06-10T19:03:02.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:02.986+0000 7f0c45fa6640 1 --2- 172.21.15.53:0/447174105 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0c2c066280 0x7f0c2c068730 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:02.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:02.986+0000 7f0c45fa6640 1 --2- 172.21.15.53:0/447174105 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c400c9840 0x7f0c400c1d10 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:02.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:02.986+0000 7f0c45fa6640 1 --2- 172.21.15.53:0/447174105 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0c40071060 0x7f0c400c17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:02.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:02.986+0000 7f0c45fa6640 1 --2- 172.21.15.53:0/447174105 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c4006b090 0x7f0c4014cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:02.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:02.986+0000 7f0c45fa6640 1 -- 172.21.15.53:0/447174105 >> 172.21.15.53:0/447174105 conn(0x7f0c4006a0d0 msgr2=0x7f0c400c82d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:02.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:02.990+0000 7f0c45fa6640 1 -- 172.21.15.53:0/447174105 shutdown_connections 2023-06-10T19:03:02.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:02.990+0000 7f0c45fa6640 1 -- 172.21.15.53:0/447174105 wait complete. 2023-06-10T19:03:03.007 DEBUG:tasks.cephfs.filesystem:mapped states ['up:reconnect'] to None 2023-06-10T19:03:04.008 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:03:04.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.138+0000 7f6ea6ca6640 1 Processor -- start 2023-06-10T19:03:04.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.138+0000 7f6ea6ca6640 1 -- start start 2023-06-10T19:03:04.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.142+0000 7f6ea6ca6640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6ea00c9840 0x7f6ea00c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:04.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.142+0000 7f6ea6ca6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ea0071060 0x7f6ea00af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:04.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.142+0000 7f6ea6ca6640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ea0159b50 con 0x7f6ea00afc60 2023-06-10T19:03:04.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.142+0000 7f6ea6ca6640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ea00ca150 con 0x7f6ea00c9840 2023-06-10T19:03:04.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.142+0000 7f6ea6ca6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea00702a0 con 0x7f6ea0071060 2023-06-10T19:03:04.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.142+0000 7f6ea5243640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f6ea00afc60 0x7f6ea015d2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41800/0 (socket says 172.21.15.53:41800) 2023-06-10T19:03:04.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.142+0000 7f6ea5243640 1 -- 172.21.15.53:0/3822680504 learned_addr learned my addr 172.21.15.53:0/3822680504 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:03:04.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.142+0000 7f6ea4a42640 1 --2- 172.21.15.53:0/3822680504 >> v2:172.21.15.117:3300/0 conn(0x7f6ea00c9840 0x7f6ea00c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:04.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.142+0000 7f6e9ffff640 1 --2- 172.21.15.53:0/3822680504 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ea0071060 0x7f6ea00af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:04.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.142+0000 7f6e9f7fe640 1 -- 172.21.15.53:0/3822680504 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 880717417 0 0) 0x7f6ea0159b50 con 0x7f6ea00afc60 2023-06-10T19:03:04.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.142+0000 7f6e9f7fe640 1 -- 172.21.15.53:0/3822680504 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e8c003530 con 0x7f6ea00afc60 2023-06-10T19:03:04.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.142+0000 7f6e9f7fe640 1 -- 172.21.15.53:0/3822680504 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3126598234 0 0) 0x7f6e8c003530 con 0x7f6ea00afc60 2023-06-10T19:03:04.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.142+0000 7f6e9f7fe640 1 -- 172.21.15.53:0/3822680504 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ea0071060 msgr2=0x7f6ea00af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:04.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.142+0000 7f6e9f7fe640 1 --2- 172.21.15.53:0/3822680504 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ea0071060 0x7f6ea00af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:04.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.142+0000 7f6e9f7fe640 1 -- 172.21.15.53:0/3822680504 >> v2:172.21.15.117:3300/0 conn(0x7f6ea00c9840 msgr2=0x7f6ea00c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:04.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.142+0000 7f6e9f7fe640 1 --2- 172.21.15.53:0/3822680504 >> v2:172.21.15.117:3300/0 conn(0x7f6ea00c9840 0x7f6ea00c9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:04.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.142+0000 7f6e9f7fe640 1 -- 172.21.15.53:0/3822680504 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ea0070580 con 0x7f6ea00afc60 2023-06-10T19:03:04.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.142+0000 7f6e9f7fe640 1 -- 172.21.15.53:0/3822680504 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f6e90001680 con 0x7f6ea00afc60 2023-06-10T19:03:04.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.142+0000 7f6e9f7fe640 1 -- 172.21.15.53:0/3822680504 >> v1:172.21.15.53:6789/0 conn(0x7f6ea00afc60 legacy=0x7f6ea015d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:04.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.142+0000 7f6e9f7fe640 1 --2- 172.21.15.53:0/3822680504 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6e8c0039f0 0x7f6e8c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:04.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.142+0000 7f6e9f7fe640 1 --2- 172.21.15.53:0/3822680504 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e8c0047d0 0x7f6e8c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:04.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.142+0000 7f6e9f7fe640 1 --2- 172.21.15.53:0/3822680504 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ea0071060 0x7f6e8c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:04.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.142+0000 7f6e9f7fe640 1 -- 172.21.15.53:0/3822680504 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea00ca150 con 0x7f6e8c0047d0 2023-06-10T19:03:04.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.142+0000 7f6e9f7fe640 1 -- 172.21.15.53:0/3822680504 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea00702a0 con 0x7f6e8c0039f0 2023-06-10T19:03:04.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.142+0000 7f6e9f7fe640 1 -- 172.21.15.53:0/3822680504 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8c00b990 con 0x7f6ea0071060 2023-06-10T19:03:04.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.142+0000 7f6e9ffff640 1 --2- 172.21.15.53:0/3822680504 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e8c0047d0 0x7f6e8c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:04.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.142+0000 7f6ea4a42640 1 --2- 172.21.15.53:0/3822680504 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6e8c0039f0 0x7f6e8c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:04.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.142+0000 7f6ea5243640 1 --2- 172.21.15.53:0/3822680504 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ea0071060 0x7f6e8c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:04.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.142+0000 7f6e9ffff640 1 -- 172.21.15.53:0/3822680504 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ea0071060 msgr2=0x7f6e8c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:04.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.142+0000 7f6e9ffff640 1 --2- 172.21.15.53:0/3822680504 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ea0071060 0x7f6e8c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:04.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.142+0000 7f6e9ffff640 1 -- 172.21.15.53:0/3822680504 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6e8c0039f0 msgr2=0x7f6e8c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:04.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.142+0000 7f6e9ffff640 1 --2- 172.21.15.53:0/3822680504 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6e8c0039f0 0x7f6e8c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:04.150 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.142+0000 7f6e9ffff640 1 -- 172.21.15.53:0/3822680504 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e8c003530 con 0x7f6e8c0047d0 2023-06-10T19:03:04.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.146+0000 7f6e9ffff640 1 --2- 172.21.15.53:0/3822680504 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e8c0047d0 0x7f6e8c004c40 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f6e88009ab0 tx=0x7f6e8801ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c40f92a8a48ff7ce server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:04.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.146+0000 7f6e9f7fe640 1 -- 172.21.15.53:0/3822680504 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e880a5510 con 0x7f6e8c0047d0 2023-06-10T19:03:04.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.146+0000 7f6e9f7fe640 1 -- 172.21.15.53:0/3822680504 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e880a5670 con 0x7f6e8c0047d0 2023-06-10T19:03:04.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.146+0000 7f6e9f7fe640 1 -- 172.21.15.53:0/3822680504 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e880a5a20 con 0x7f6e8c0047d0 2023-06-10T19:03:04.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.146+0000 7f6ea6ca6640 1 -- 172.21.15.53:0/3822680504 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e8c0047d0 msgr2=0x7f6e8c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:04.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.146+0000 7f6ea6ca6640 1 --2- 172.21.15.53:0/3822680504 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e8c0047d0 0x7f6e8c004c40 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f6e88009ab0 tx=0x7f6e8801ca30 comp rx=0 tx=0).stop 2023-06-10T19:03:04.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.146+0000 7f6ea5243640 1 -- 172.21.15.53:0/3822680504 reap_dead start 2023-06-10T19:03:04.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.146+0000 7f6ea6ca6640 1 -- 172.21.15.53:0/3822680504 shutdown_connections 2023-06-10T19:03:04.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.146+0000 7f6ea6ca6640 1 -- 172.21.15.53:0/3822680504 >> 172.21.15.53:0/3822680504 conn(0x7f6ea006a0d0 msgr2=0x7f6ea00ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:04.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.146+0000 7f6ea6ca6640 1 -- 172.21.15.53:0/3822680504 shutdown_connections 2023-06-10T19:03:04.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.146+0000 7f6ea6ca6640 1 -- 172.21.15.53:0/3822680504 wait complete. 2023-06-10T19:03:04.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.146+0000 7f6ea6ca6640 1 Processor -- start 2023-06-10T19:03:04.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.146+0000 7f6ea6ca6640 1 -- start start 2023-06-10T19:03:04.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.150+0000 7f6ea6ca6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6e8c0047d0 0x7f6ea01f4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:04.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.150+0000 7f6ea6ca6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ea01f53a0 0x7f6ea01f5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:04.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.150+0000 7f6ea6ca6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ea015c550 0x7f6ea015c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:04.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.150+0000 7f6ea6ca6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea00b2320 con 0x7f6ea01f53a0 2023-06-10T19:03:04.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.150+0000 7f6ea6ca6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea00b17a0 con 0x7f6e8c0047d0 2023-06-10T19:03:04.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.150+0000 7f6ea6ca6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea00b1a80 con 0x7f6ea015c550 2023-06-10T19:03:04.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.150+0000 7f6e9ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ea01f53a0 0x7f6ea01f5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:04.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.150+0000 7f6e9ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ea01f53a0 0x7f6ea01f5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34136/0 (socket says 172.21.15.53:34136) 2023-06-10T19:03:04.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.150+0000 7f6e9ffff640 1 -- 172.21.15.53:0/1683427139 learned_addr learned my addr 172.21.15.53:0/1683427139 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:04.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.150+0000 7f6ea4a42640 1 --2- 172.21.15.53:0/1683427139 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6e8c0047d0 0x7f6ea01f4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:04.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.150+0000 7f6ea5243640 1 --2- 172.21.15.53:0/1683427139 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ea015c550 0x7f6ea015c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:04.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.150+0000 7f6e9ffff640 1 -- 172.21.15.53:0/1683427139 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ea015c550 msgr2=0x7f6ea015c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:04.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.150+0000 7f6e9ffff640 1 --2- 172.21.15.53:0/1683427139 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ea015c550 0x7f6ea015c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:04.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.150+0000 7f6e9ffff640 1 -- 172.21.15.53:0/1683427139 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6e8c0047d0 msgr2=0x7f6ea01f4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:04.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.150+0000 7f6e9ffff640 1 --2- 172.21.15.53:0/1683427139 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6e8c0047d0 0x7f6ea01f4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:04.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.150+0000 7f6e9ffff640 1 -- 172.21.15.53:0/1683427139 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ea00b1d60 con 0x7f6ea01f53a0 2023-06-10T19:03:04.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.150+0000 7f6e9ffff640 1 --2- 172.21.15.53:0/1683427139 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ea01f53a0 0x7f6ea01f5810 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f6e88009ab0 tx=0x7f6e8c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:04.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.150+0000 7f6e9d7fa640 1 -- 172.21.15.53:0/1683427139 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e88004220 con 0x7f6ea01f53a0 2023-06-10T19:03:04.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.150+0000 7f6e9d7fa640 1 -- 172.21.15.53:0/1683427139 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e88004380 con 0x7f6ea01f53a0 2023-06-10T19:03:04.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.150+0000 7f6ea6ca6640 1 -- 172.21.15.53:0/1683427139 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ea00b2040 con 0x7f6ea01f53a0 2023-06-10T19:03:04.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.150+0000 7f6e9d7fa640 1 -- 172.21.15.53:0/1683427139 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e88003820 con 0x7f6ea01f53a0 2023-06-10T19:03:04.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.150+0000 7f6ea6ca6640 1 -- 172.21.15.53:0/1683427139 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ea015ae70 con 0x7f6ea01f53a0 2023-06-10T19:03:04.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.150+0000 7f6ea6ca6640 1 -- 172.21.15.53:0/1683427139 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ea004d790 con 0x7f6ea01f53a0 2023-06-10T19:03:04.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.150+0000 7f6e9d7fa640 1 -- 172.21.15.53:0/1683427139 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6e880b4040 con 0x7f6ea01f53a0 2023-06-10T19:03:04.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.150+0000 7f6e9d7fa640 1 --2- 172.21.15.53:0/1683427139 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6e80066280 0x7f6e80068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:04.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.150+0000 7f6e9d7fa640 1 -- 172.21.15.53:0/1683427139 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6264+0+0 (secure 0 0 0) 0x7f6e8811e370 con 0x7f6ea01f53a0 2023-06-10T19:03:04.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.150+0000 7f6ea4a42640 1 --2- 172.21.15.53:0/1683427139 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6e80066280 0x7f6e80068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:04.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.154+0000 7f6ea4a42640 1 --2- 172.21.15.53:0/1683427139 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6e80066280 0x7f6e80068730 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f6ea00af3f0 tx=0x7f6e9800b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:04.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.154+0000 7f6e9d7fa640 1 -- 172.21.15.53:0/1683427139 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6e880eb900 con 0x7f6ea01f53a0 2023-06-10T19:03:04.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.334+0000 7f6ea6ca6640 1 -- 172.21.15.53:0/1683427139 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6ea0155d90 con 0x7f6ea01f53a0 2023-06-10T19:03:04.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.334+0000 7f6e9d7fa640 1 -- 172.21.15.53:0/1683427139 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+4683 (secure 0 0 0) 0x7f6e880044f0 con 0x7f6ea01f53a0 2023-06-10T19:03:04.339 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:03:04.339 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1617157670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1617157670},{"type":"v1","addr":"172.21.15.117:6836","nonce":1617157670}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6113,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3414416090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":3414416090},{"type":"v1","addr":"172.21.15.117:6837","nonce":3414416090}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6718,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2533467097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2533467097},{"type":"v1","addr":"172.21.15.53:6835","nonce":2533467097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:02:02.642809+0000","modified":"2023-06-10T19:02:36.149418+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8127":{"gid":8127,"name":"a","rank":0,"incarnation":52,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.53:6833/2984379521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2984379521},{"type":"v1","addr":"172.21.15.53:6833","nonce":2984379521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-06-10T19:03:04.340 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 53 2023-06-10T19:03:04.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.338+0000 7f6ea6ca6640 1 -- 172.21.15.53:0/1683427139 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6e80066280 msgr2=0x7f6e80068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:04.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.338+0000 7f6ea6ca6640 1 --2- 172.21.15.53:0/1683427139 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6e80066280 0x7f6e80068730 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f6ea00af3f0 tx=0x7f6e9800b040 comp rx=0 tx=0).stop 2023-06-10T19:03:04.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.338+0000 7f6ea6ca6640 1 -- 172.21.15.53:0/1683427139 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ea01f53a0 msgr2=0x7f6ea01f5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:04.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.338+0000 7f6ea6ca6640 1 --2- 172.21.15.53:0/1683427139 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ea01f53a0 0x7f6ea01f5810 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f6e88009ab0 tx=0x7f6e8c005800 comp rx=0 tx=0).stop 2023-06-10T19:03:04.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.338+0000 7f6ea6ca6640 1 -- 172.21.15.53:0/1683427139 shutdown_connections 2023-06-10T19:03:04.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.338+0000 7f6ea6ca6640 1 --2- 172.21.15.53:0/1683427139 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6e80066280 0x7f6e80068730 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:04.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.338+0000 7f6ea6ca6640 1 --2- 172.21.15.53:0/1683427139 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ea015c550 0x7f6ea015c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:04.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.338+0000 7f6ea6ca6640 1 --2- 172.21.15.53:0/1683427139 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ea01f53a0 0x7f6ea01f5810 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:04.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.338+0000 7f6ea6ca6640 1 --2- 172.21.15.53:0/1683427139 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6e8c0047d0 0x7f6ea01f4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:04.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.338+0000 7f6ea6ca6640 1 -- 172.21.15.53:0/1683427139 >> 172.21.15.53:0/1683427139 conn(0x7f6ea006a0d0 msgr2=0x7f6ea0159d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:04.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.338+0000 7f6ea6ca6640 1 -- 172.21.15.53:0/1683427139 shutdown_connections 2023-06-10T19:03:04.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:04.338+0000 7f6ea6ca6640 1 -- 172.21.15.53:0/1683427139 wait complete. 2023-06-10T19:03:04.356 DEBUG:tasks.cephfs.filesystem:mapped states ['up:reconnect'] to None 2023-06-10T19:03:05.358 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:03:05.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:05.490+0000 7fe482ed0640 1 Processor -- start 2023-06-10T19:03:05.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:05.490+0000 7fe482ed0640 1 -- start start 2023-06-10T19:03:05.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:05.490+0000 7fe482ed0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe47c06b2f0 0x7fe47c06f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:05.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:05.490+0000 7fe482ed0640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe47c0c8d00 0x7fe47c06b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:05.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:05.490+0000 7fe482ed0640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe47c158a90 con 0x7fe47c06bc00 2023-06-10T19:03:05.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:05.490+0000 7fe482ed0640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe47c0705d0 con 0x7fe47c0c8d00 2023-06-10T19:03:05.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:05.490+0000 7fe482ed0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe47c06f9c0 con 0x7fe47c06b2f0 2023-06-10T19:03:05.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:05.490+0000 7fe47bfff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe47c0c8d00 0x7fe47c06b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:05.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:05.490+0000 7fe480c6c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe47c06b2f0 0x7fe47c06f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:05.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:05.490+0000 7fe48146d640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fe47c06bc00 0x7fe47c0cbe00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.53:50656/0 (socket says 172.21.15.53:50656) 2023-06-10T19:03:05.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:05.490+0000 7fe48146d640 1 -- 172.21.15.53:0/3317620463 learned_addr learned my addr 172.21.15.53:0/3317620463 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:03:05.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:05.490+0000 7fe47b7fe640 1 -- 172.21.15.53:0/3317620463 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1091132938 0 0) 0x7fe4740014a0 con 0x7fe47c06bc00 2023-06-10T19:03:05.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:05.490+0000 7fe47b7fe640 1 -- 172.21.15.53:0/3317620463 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe46c005740 con 0x7fe47c06bc00 2023-06-10T19:03:05.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:05.490+0000 7fe47bfff640 1 -- 172.21.15.53:0/3317620463 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe47c06b2f0 msgr2=0x7fe47c06f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:05.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:05.490+0000 7fe47bfff640 1 --2- 172.21.15.53:0/3317620463 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe47c06b2f0 0x7fe47c06f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:05.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:05.490+0000 7fe47bfff640 1 -- 172.21.15.53:0/3317620463 >> v1:172.21.15.117:6789/0 conn(0x7fe47c06bc00 legacy=0x7fe47c0cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:05.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:05.490+0000 7fe47bfff640 1 -- 172.21.15.53:0/3317620463 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe47c06fca0 con 0x7fe47c0c8d00 2023-06-10T19:03:05.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:05.490+0000 7fe480c6c640 1 --2- 172.21.15.53:0/3317620463 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe47c06b2f0 0x7fe47c06f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-10T19:03:05.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:05.494+0000 7fe47bfff640 1 --2- 172.21.15.53:0/3317620463 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe47c0c8d00 0x7fe47c06b6c0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fe4680097f0 tx=0x7fe46801ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4702994cdb33c50c server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:05.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:05.494+0000 7fe47b7fe640 1 -- 172.21.15.53:0/3317620463 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4680a8970 con 0x7fe47c0c8d00 2023-06-10T19:03:05.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:05.494+0000 7fe47b7fe640 1 -- 172.21.15.53:0/3317620463 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4680a8ad0 con 0x7fe47c0c8d00 2023-06-10T19:03:05.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:05.494+0000 7fe47b7fe640 1 -- 172.21.15.53:0/3317620463 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4680a8e40 con 0x7fe47c0c8d00 2023-06-10T19:03:05.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:05.494+0000 7fe482ed0640 1 -- 172.21.15.53:0/3317620463 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe47c0c8d00 msgr2=0x7fe47c06b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:05.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:05.494+0000 7fe482ed0640 1 --2- 172.21.15.53:0/3317620463 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe47c0c8d00 0x7fe47c06b6c0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fe4680097f0 tx=0x7fe46801ec70 comp rx=0 tx=0).stop 2023-06-10T19:03:05.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:05.494+0000 7fe482ed0640 1 -- 172.21.15.53:0/3317620463 shutdown_connections 2023-06-10T19:03:05.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:05.494+0000 7fe482ed0640 1 --2- 172.21.15.53:0/3317620463 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe47c0c8d00 0x7fe47c06b6c0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:05.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:05.494+0000 7fe482ed0640 1 --2- 172.21.15.53:0/3317620463 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe47c06b2f0 0x7fe47c06f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:05.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:05.494+0000 7fe482ed0640 1 -- 172.21.15.53:0/3317620463 >> 172.21.15.53:0/3317620463 conn(0x7fe47c06a0d0 msgr2=0x7fe47c0ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:05.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:05.494+0000 7fe482ed0640 1 -- 172.21.15.53:0/3317620463 shutdown_connections 2023-06-10T19:03:05.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:05.494+0000 7fe482ed0640 1 -- 172.21.15.53:0/3317620463 wait complete. 2023-06-10T19:03:05.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:05.498+0000 7fe482ed0640 1 Processor -- start 2023-06-10T19:03:05.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:05.498+0000 7fe482ed0640 1 -- start start 2023-06-10T19:03:05.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:05.498+0000 7fe482ed0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe47c06b2f0 0x7fe47c0c5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:05.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:05.498+0000 7fe482ed0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe47c06bc00 0x7fe47c0c4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:05.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:05.498+0000 7fe482ed0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe47c0c8d00 0x7fe47c155ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:05.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:05.498+0000 7fe482ed0640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe47c0c4960 con 0x7fe47c06b2f0 2023-06-10T19:03:05.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:05.498+0000 7fe482ed0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe47c158d60 con 0x7fe47c06bc00 2023-06-10T19:03:05.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:05.498+0000 7fe482ed0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe47c1599b0 con 0x7fe47c0c8d00 2023-06-10T19:03:05.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:05.498+0000 7fe480c6c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe47c06b2f0 0x7fe47c0c5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:05.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:05.498+0000 7fe480c6c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe47c06b2f0 0x7fe47c0c5ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34138/0 (socket says 172.21.15.53:34138) 2023-06-10T19:03:05.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:05.498+0000 7fe480c6c640 1 -- 172.21.15.53:0/1272285012 learned_addr learned my addr 172.21.15.53:0/1272285012 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:05.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:05.498+0000 7fe47bfff640 1 --2- 172.21.15.53:0/1272285012 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe47c06bc00 0x7fe47c0c4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:05.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:05.498+0000 7fe48146d640 1 --2- 172.21.15.53:0/1272285012 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe47c0c8d00 0x7fe47c155ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:05.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:05.498+0000 7fe480c6c640 1 -- 172.21.15.53:0/1272285012 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe47c0c8d00 msgr2=0x7fe47c155ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:05.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:05.498+0000 7fe480c6c640 1 --2- 172.21.15.53:0/1272285012 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe47c0c8d00 0x7fe47c155ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:05.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:05.498+0000 7fe480c6c640 1 -- 172.21.15.53:0/1272285012 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe47c06bc00 msgr2=0x7fe47c0c4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:05.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:05.498+0000 7fe480c6c640 1 --2- 172.21.15.53:0/1272285012 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe47c06bc00 0x7fe47c0c4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:05.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:05.498+0000 7fe480c6c640 1 -- 172.21.15.53:0/1272285012 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe470009420 con 0x7fe47c06b2f0 2023-06-10T19:03:05.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:05.498+0000 7fe480c6c640 1 --2- 172.21.15.53:0/1272285012 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe47c06b2f0 0x7fe47c0c5ef0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7fe47000ebe0 tx=0x7fe47000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:05.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:05.498+0000 7fe4797fa640 1 -- 172.21.15.53:0/1272285012 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe47000eee0 con 0x7fe47c06b2f0 2023-06-10T19:03:05.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:05.498+0000 7fe4797fa640 1 -- 172.21.15.53:0/1272285012 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe47000cc30 con 0x7fe47c06b2f0 2023-06-10T19:03:05.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:05.498+0000 7fe482ed0640 1 -- 172.21.15.53:0/1272285012 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe468009420 con 0x7fe47c06b2f0 2023-06-10T19:03:05.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:05.498+0000 7fe4797fa640 1 -- 172.21.15.53:0/1272285012 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe470013470 con 0x7fe47c06b2f0 2023-06-10T19:03:05.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:05.498+0000 7fe482ed0640 1 -- 172.21.15.53:0/1272285012 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe47c1592e0 con 0x7fe47c06b2f0 2023-06-10T19:03:05.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:05.498+0000 7fe482ed0640 1 -- 172.21.15.53:0/1272285012 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe47c04d790 con 0x7fe47c06b2f0 2023-06-10T19:03:05.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:05.502+0000 7fe4797fa640 1 -- 172.21.15.53:0/1272285012 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe4700135d0 con 0x7fe47c06b2f0 2023-06-10T19:03:05.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:05.502+0000 7fe4797fa640 1 --2- 172.21.15.53:0/1272285012 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe460066280 0x7fe460068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:05.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:05.502+0000 7fe4797fa640 1 -- 172.21.15.53:0/1272285012 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6264+0+0 (secure 0 0 0) 0x7fe470084060 con 0x7fe47c06b2f0 2023-06-10T19:03:05.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:05.502+0000 7fe47bfff640 1 --2- 172.21.15.53:0/1272285012 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe460066280 0x7fe460068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:05.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:05.502+0000 7fe47bfff640 1 --2- 172.21.15.53:0/1272285012 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe460066280 0x7fe460068730 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fe4680b2000 tx=0x7fe4680aa070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:05.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:05.506+0000 7fe4797fa640 1 -- 172.21.15.53:0/1272285012 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe470054f30 con 0x7fe47c06b2f0 2023-06-10T19:03:05.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:05.690+0000 7fe482ed0640 1 -- 172.21.15.53:0/1272285012 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe47c0cb290 con 0x7fe47c06b2f0 2023-06-10T19:03:05.695 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:05.694+0000 7fe4797fa640 1 -- 172.21.15.53:0/1272285012 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+4683 (secure 0 0 0) 0x7fe470054ac0 con 0x7fe47c06b2f0 2023-06-10T19:03:05.696 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:03:05.696 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1617157670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1617157670},{"type":"v1","addr":"172.21.15.117:6836","nonce":1617157670}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6113,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3414416090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":3414416090},{"type":"v1","addr":"172.21.15.117:6837","nonce":3414416090}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6718,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2533467097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2533467097},{"type":"v1","addr":"172.21.15.53:6835","nonce":2533467097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:02:02.642809+0000","modified":"2023-06-10T19:02:36.149418+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8127":{"gid":8127,"name":"a","rank":0,"incarnation":52,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.53:6833/2984379521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2984379521},{"type":"v1","addr":"172.21.15.53:6833","nonce":2984379521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-06-10T19:03:05.697 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 53 2023-06-10T19:03:05.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:05.694+0000 7fe482ed0640 1 -- 172.21.15.53:0/1272285012 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe460066280 msgr2=0x7fe460068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:05.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:05.694+0000 7fe482ed0640 1 --2- 172.21.15.53:0/1272285012 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe460066280 0x7fe460068730 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fe4680b2000 tx=0x7fe4680aa070 comp rx=0 tx=0).stop 2023-06-10T19:03:05.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:05.694+0000 7fe482ed0640 1 -- 172.21.15.53:0/1272285012 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe47c06b2f0 msgr2=0x7fe47c0c5ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:05.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:05.694+0000 7fe482ed0640 1 --2- 172.21.15.53:0/1272285012 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe47c06b2f0 0x7fe47c0c5ef0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7fe47000ebe0 tx=0x7fe47000c520 comp rx=0 tx=0).stop 2023-06-10T19:03:05.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:05.694+0000 7fe482ed0640 1 -- 172.21.15.53:0/1272285012 shutdown_connections 2023-06-10T19:03:05.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:05.694+0000 7fe482ed0640 1 --2- 172.21.15.53:0/1272285012 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe460066280 0x7fe460068730 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:05.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:05.694+0000 7fe482ed0640 1 --2- 172.21.15.53:0/1272285012 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe47c0c8d00 0x7fe47c155ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:05.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:05.694+0000 7fe482ed0640 1 --2- 172.21.15.53:0/1272285012 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe47c06bc00 0x7fe47c0c4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:05.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:05.694+0000 7fe482ed0640 1 --2- 172.21.15.53:0/1272285012 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe47c06b2f0 0x7fe47c0c5ef0 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:05.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:05.694+0000 7fe482ed0640 1 -- 172.21.15.53:0/1272285012 >> 172.21.15.53:0/1272285012 conn(0x7fe47c06a0d0 msgr2=0x7fe47c0cc930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:05.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:05.694+0000 7fe482ed0640 1 -- 172.21.15.53:0/1272285012 shutdown_connections 2023-06-10T19:03:05.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:05.694+0000 7fe482ed0640 1 -- 172.21.15.53:0/1272285012 wait complete. 2023-06-10T19:03:05.715 DEBUG:tasks.cephfs.filesystem:mapped states ['up:reconnect'] to None 2023-06-10T19:03:06.716 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:03:06.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:06.850+0000 7f6b1de7a640 1 Processor -- start 2023-06-10T19:03:06.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:06.850+0000 7f6b1de7a640 1 -- start start 2023-06-10T19:03:06.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:06.850+0000 7f6b1de7a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6b180b3ac0 0x7f6b180b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:06.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:06.850+0000 7f6b1de7a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b180cc690 0x7f6b1815f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:06.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:06.850+0000 7f6b1de7a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6b180ccae0 0x7f6b1815f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:06.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:06.850+0000 7f6b1de7a640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b180d0020 con 0x7f6b180b3ac0 2023-06-10T19:03:06.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:06.850+0000 7f6b1de7a640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b180b43d0 con 0x7f6b180ccae0 2023-06-10T19:03:06.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:06.850+0000 7f6b1de7a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b180cef40 con 0x7f6b180cc690 2023-06-10T19:03:06.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:06.850+0000 7f6b177fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6b180b3ac0 0x7f6b180b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:06.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:06.850+0000 7f6b177fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6b180b3ac0 0x7f6b180b3e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34152/0 (socket says 172.21.15.53:34152) 2023-06-10T19:03:06.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:06.850+0000 7f6b177fe640 1 -- 172.21.15.53:0/930401942 learned_addr learned my addr 172.21.15.53:0/930401942 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:06.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:06.850+0000 7f6b17fff640 1 --2- 172.21.15.53:0/930401942 >> v2:172.21.15.117:3300/0 conn(0x7f6b180ccae0 0x7f6b1815f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:06.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:06.850+0000 7f6b0ffff640 1 --2- 172.21.15.53:0/930401942 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b180cc690 0x7f6b1815f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:06.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:06.850+0000 7f6b177fe640 1 -- 172.21.15.53:0/930401942 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b180cc690 msgr2=0x7f6b1815f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:06.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:06.850+0000 7f6b177fe640 1 --2- 172.21.15.53:0/930401942 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b180cc690 0x7f6b1815f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:06.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:06.850+0000 7f6b177fe640 1 -- 172.21.15.53:0/930401942 >> v2:172.21.15.117:3300/0 conn(0x7f6b180ccae0 msgr2=0x7f6b1815f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:06.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:06.850+0000 7f6b177fe640 1 --2- 172.21.15.53:0/930401942 >> v2:172.21.15.117:3300/0 conn(0x7f6b180ccae0 0x7f6b1815f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:06.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:06.850+0000 7f6b177fe640 1 -- 172.21.15.53:0/930401942 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b180cf220 con 0x7f6b180b3ac0 2023-06-10T19:03:06.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:06.854+0000 7f6b177fe640 1 --2- 172.21.15.53:0/930401942 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b180b3ac0 0x7f6b180b3e90 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f6b180b14a0 tx=0x7f6b0801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c851a17e2d3f8663 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:06.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:06.854+0000 7f6b16ffd640 1 -- 172.21.15.53:0/930401942 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b080ac600 con 0x7f6b180b3ac0 2023-06-10T19:03:06.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:06.854+0000 7f6b16ffd640 1 -- 172.21.15.53:0/930401942 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b080a8050 con 0x7f6b180b3ac0 2023-06-10T19:03:06.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:06.854+0000 7f6b16ffd640 1 -- 172.21.15.53:0/930401942 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b080ac980 con 0x7f6b180b3ac0 2023-06-10T19:03:06.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:06.854+0000 7f6b1de7a640 1 -- 172.21.15.53:0/930401942 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b180b3ac0 msgr2=0x7f6b180b3e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:06.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:06.854+0000 7f6b1de7a640 1 --2- 172.21.15.53:0/930401942 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b180b3ac0 0x7f6b180b3e90 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f6b180b14a0 tx=0x7f6b0801c4d0 comp rx=0 tx=0).stop 2023-06-10T19:03:06.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:06.854+0000 7f6b1de7a640 1 -- 172.21.15.53:0/930401942 shutdown_connections 2023-06-10T19:03:06.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:06.854+0000 7f6b1de7a640 1 --2- 172.21.15.53:0/930401942 >> v2:172.21.15.117:3300/0 conn(0x7f6b180ccae0 0x7f6b1815f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:06.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:06.854+0000 7f6b1de7a640 1 --2- 172.21.15.53:0/930401942 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b180cc690 0x7f6b1815f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:06.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:06.854+0000 7f6b1de7a640 1 --2- 172.21.15.53:0/930401942 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b180b3ac0 0x7f6b180b3e90 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:06.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:06.854+0000 7f6b1de7a640 1 -- 172.21.15.53:0/930401942 >> 172.21.15.53:0/930401942 conn(0x7f6b18071790 msgr2=0x7f6b18069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:06.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:06.854+0000 7f6b1de7a640 1 -- 172.21.15.53:0/930401942 shutdown_connections 2023-06-10T19:03:06.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:06.854+0000 7f6b1de7a640 1 -- 172.21.15.53:0/930401942 wait complete. 2023-06-10T19:03:06.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:06.854+0000 7f6b1de7a640 1 Processor -- start 2023-06-10T19:03:06.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:06.854+0000 7f6b1de7a640 1 -- start start 2023-06-10T19:03:06.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:06.854+0000 7f6b1de7a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b180b3ac0 0x7f6b1815a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:06.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:06.854+0000 7f6b1de7a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b180cc690 0x7f6b18152a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:06.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:06.854+0000 7f6b1de7a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b180ccae0 0x7f6b1815dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:06.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:06.854+0000 7f6b1de7a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1815d780 con 0x7f6b180cc690 2023-06-10T19:03:06.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:06.854+0000 7f6b1de7a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1815b2f0 con 0x7f6b180ccae0 2023-06-10T19:03:06.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:06.854+0000 7f6b1de7a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1815b010 con 0x7f6b180b3ac0 2023-06-10T19:03:06.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:06.854+0000 7f6b0ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b180cc690 0x7f6b18152a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:06.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:06.854+0000 7f6b0ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b180cc690 0x7f6b18152a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34164/0 (socket says 172.21.15.53:34164) 2023-06-10T19:03:06.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:06.854+0000 7f6b0ffff640 1 -- 172.21.15.53:0/1413948577 learned_addr learned my addr 172.21.15.53:0/1413948577 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:06.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:06.854+0000 7f6b177fe640 1 --2- 172.21.15.53:0/1413948577 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b180b3ac0 0x7f6b1815a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:06.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:06.854+0000 7f6b17fff640 1 --2- 172.21.15.53:0/1413948577 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b180ccae0 0x7f6b1815dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:06.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:06.854+0000 7f6b0ffff640 1 -- 172.21.15.53:0/1413948577 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b180b3ac0 msgr2=0x7f6b1815a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:06.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:06.854+0000 7f6b0ffff640 1 --2- 172.21.15.53:0/1413948577 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b180b3ac0 0x7f6b1815a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:06.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:06.854+0000 7f6b0ffff640 1 -- 172.21.15.53:0/1413948577 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b180ccae0 msgr2=0x7f6b1815dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:06.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:06.854+0000 7f6b0ffff640 1 --2- 172.21.15.53:0/1413948577 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b180ccae0 0x7f6b1815dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:06.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:06.854+0000 7f6b0ffff640 1 -- 172.21.15.53:0/1413948577 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b080094d0 con 0x7f6b180cc690 2023-06-10T19:03:06.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:06.854+0000 7f6b0ffff640 1 --2- 172.21.15.53:0/1413948577 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b180cc690 0x7f6b18152a20 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f6b0000c7f0 tx=0x7f6b0000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:06.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:06.858+0000 7f6b14ff9640 1 -- 172.21.15.53:0/1413948577 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b00004220 con 0x7f6b180cc690 2023-06-10T19:03:06.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:06.858+0000 7f6b14ff9640 1 -- 172.21.15.53:0/1413948577 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b00004380 con 0x7f6b180cc690 2023-06-10T19:03:06.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:06.858+0000 7f6b14ff9640 1 -- 172.21.15.53:0/1413948577 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b00003860 con 0x7f6b180cc690 2023-06-10T19:03:06.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:06.858+0000 7f6b1de7a640 1 -- 172.21.15.53:0/1413948577 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b1815d0c0 con 0x7f6b180cc690 2023-06-10T19:03:06.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:06.858+0000 7f6b1de7a640 1 -- 172.21.15.53:0/1413948577 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b18152f60 con 0x7f6b180cc690 2023-06-10T19:03:06.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:06.858+0000 7f6b1de7a640 1 -- 172.21.15.53:0/1413948577 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b1815d8c0 con 0x7f6b180cc690 2023-06-10T19:03:06.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:06.858+0000 7f6b14ff9640 1 -- 172.21.15.53:0/1413948577 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6b00003bd0 con 0x7f6b180cc690 2023-06-10T19:03:06.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:06.858+0000 7f6b14ff9640 1 --2- 172.21.15.53:0/1413948577 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6af8066280 0x7f6af8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:06.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:06.858+0000 7f6b14ff9640 1 -- 172.21.15.53:0/1413948577 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6264+0+0 (secure 0 0 0) 0x7f6b00083e40 con 0x7f6b180cc690 2023-06-10T19:03:06.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:06.858+0000 7f6b177fe640 1 --2- 172.21.15.53:0/1413948577 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6af8066280 0x7f6af8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:06.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:06.858+0000 7f6b177fe640 1 --2- 172.21.15.53:0/1413948577 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6af8066280 0x7f6af8068730 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f6b080ae000 tx=0x7f6b08008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:06.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:06.862+0000 7f6b14ff9640 1 -- 172.21.15.53:0/1413948577 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6b1815d8c0 con 0x7f6b180cc690 2023-06-10T19:03:07.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:07.050+0000 7f6b1de7a640 1 -- 172.21.15.53:0/1413948577 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6b1815d8c0 con 0x7f6b180cc690 2023-06-10T19:03:07.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:07.050+0000 7f6b14ff9640 1 -- 172.21.15.53:0/1413948577 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+4683 (secure 0 0 0) 0x7f6b1815d8c0 con 0x7f6b180cc690 2023-06-10T19:03:07.053 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:03:07.053 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1617157670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1617157670},{"type":"v1","addr":"172.21.15.117:6836","nonce":1617157670}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6113,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3414416090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":3414416090},{"type":"v1","addr":"172.21.15.117:6837","nonce":3414416090}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6718,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2533467097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2533467097},{"type":"v1","addr":"172.21.15.53:6835","nonce":2533467097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:02:02.642809+0000","modified":"2023-06-10T19:02:36.149418+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8127":{"gid":8127,"name":"a","rank":0,"incarnation":52,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.53:6833/2984379521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2984379521},{"type":"v1","addr":"172.21.15.53:6833","nonce":2984379521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-06-10T19:03:07.054 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 53 2023-06-10T19:03:07.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:07.054+0000 7f6b1de7a640 1 -- 172.21.15.53:0/1413948577 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6af8066280 msgr2=0x7f6af8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:07.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:07.054+0000 7f6b1de7a640 1 --2- 172.21.15.53:0/1413948577 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6af8066280 0x7f6af8068730 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f6b080ae000 tx=0x7f6b08008040 comp rx=0 tx=0).stop 2023-06-10T19:03:07.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:07.054+0000 7f6b1de7a640 1 -- 172.21.15.53:0/1413948577 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b180cc690 msgr2=0x7f6b18152a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:07.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:07.054+0000 7f6b1de7a640 1 --2- 172.21.15.53:0/1413948577 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b180cc690 0x7f6b18152a20 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f6b0000c7f0 tx=0x7f6b0000ccb0 comp rx=0 tx=0).stop 2023-06-10T19:03:07.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:07.054+0000 7f6b1de7a640 1 -- 172.21.15.53:0/1413948577 shutdown_connections 2023-06-10T19:03:07.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:07.054+0000 7f6b1de7a640 1 --2- 172.21.15.53:0/1413948577 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6af8066280 0x7f6af8068730 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:07.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:07.054+0000 7f6b1de7a640 1 --2- 172.21.15.53:0/1413948577 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b180ccae0 0x7f6b1815dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:07.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:07.054+0000 7f6b1de7a640 1 --2- 172.21.15.53:0/1413948577 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b180cc690 0x7f6b18152a20 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:07.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:07.054+0000 7f6b1de7a640 1 --2- 172.21.15.53:0/1413948577 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b180b3ac0 0x7f6b1815a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:07.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:07.054+0000 7f6b1de7a640 1 -- 172.21.15.53:0/1413948577 >> 172.21.15.53:0/1413948577 conn(0x7f6b18071790 msgr2=0x7f6b180b6850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:07.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:07.054+0000 7f6b1de7a640 1 -- 172.21.15.53:0/1413948577 shutdown_connections 2023-06-10T19:03:07.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:07.054+0000 7f6b1de7a640 1 -- 172.21.15.53:0/1413948577 wait complete. 2023-06-10T19:03:07.074 DEBUG:tasks.cephfs.filesystem:mapped states ['up:reconnect'] to None 2023-06-10T19:03:07.685 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-10T19:03:07.688 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-10T19:03:08.075 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:03:08.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.206+0000 7fbc1f194640 1 Processor -- start 2023-06-10T19:03:08.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.206+0000 7fbc1f194640 1 -- start start 2023-06-10T19:03:08.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.206+0000 7fbc1f194640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc18070f80 0x7fbc180ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:08.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.206+0000 7fbc1f194640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc1815f2c0 con 0x7fbc180ce990 2023-06-10T19:03:08.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.206+0000 7fbc1f194640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc1815fdc0 con 0x7fbc1815eef0 2023-06-10T19:03:08.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.206+0000 7fbc1f194640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc181600a0 con 0x7fbc18070f80 2023-06-10T19:03:08.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.206+0000 7fbc1d731640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fbc180ce990 0x7fbc18069450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41814/0 (socket says 172.21.15.53:41814) 2023-06-10T19:03:08.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.206+0000 7fbc1d731640 1 -- 172.21.15.53:0/295086121 learned_addr learned my addr 172.21.15.53:0/295086121 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:03:08.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.206+0000 7fbc17fff640 1 --2- 172.21.15.53:0/295086121 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc18070f80 0x7fbc180ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:08.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.206+0000 7fbc177fe640 1 -- 172.21.15.53:0/295086121 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3506432680 0 0) 0x7fbc1815f2c0 con 0x7fbc180ce990 2023-06-10T19:03:08.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.206+0000 7fbc177fe640 1 -- 172.21.15.53:0/295086121 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc00003530 con 0x7fbc180ce990 2023-06-10T19:03:08.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.206+0000 7fbc177fe640 1 -- 172.21.15.53:0/295086121 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3553811877 0 0) 0x7fbc00003530 con 0x7fbc180ce990 2023-06-10T19:03:08.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.206+0000 7fbc177fe640 1 -- 172.21.15.53:0/295086121 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc18070f80 msgr2=0x7fbc180ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:08.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.206+0000 7fbc177fe640 1 --2- 172.21.15.53:0/295086121 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc18070f80 0x7fbc180ce450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:08.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.206+0000 7fbc177fe640 1 -- 172.21.15.53:0/295086121 >> v1:172.21.15.117:6789/0 conn(0x7fbc1815eef0 legacy=0x7fbc1815f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:08.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.206+0000 7fbc177fe640 1 -- 172.21.15.53:0/295086121 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc18160380 con 0x7fbc180ce990 2023-06-10T19:03:08.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.206+0000 7fbc177fe640 1 -- 172.21.15.53:0/295086121 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fbc10001a00 con 0x7fbc180ce990 2023-06-10T19:03:08.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.206+0000 7fbc177fe640 1 -- 172.21.15.53:0/295086121 >> v1:172.21.15.53:6789/0 conn(0x7fbc180ce990 legacy=0x7fbc18069450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:08.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.206+0000 7fbc177fe640 1 --2- 172.21.15.53:0/295086121 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc00003a20 0x7fbc00003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:08.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.206+0000 7fbc177fe640 1 --2- 172.21.15.53:0/295086121 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc000047d0 0x7fbc00004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:08.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.206+0000 7fbc177fe640 1 --2- 172.21.15.53:0/295086121 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc18070f80 0x7fbc00005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:08.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.206+0000 7fbc177fe640 1 -- 172.21.15.53:0/295086121 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc181600a0 con 0x7fbc00003a20 2023-06-10T19:03:08.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.206+0000 7fbc177fe640 1 -- 172.21.15.53:0/295086121 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc0000baa0 con 0x7fbc000047d0 2023-06-10T19:03:08.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.206+0000 7fbc177fe640 1 -- 172.21.15.53:0/295086121 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc0000bc60 con 0x7fbc18070f80 2023-06-10T19:03:08.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.206+0000 7fbc1cf30640 1 --2- 172.21.15.53:0/295086121 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc00003a20 0x7fbc00003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:08.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.206+0000 7fbc17fff640 1 --2- 172.21.15.53:0/295086121 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc000047d0 0x7fbc00004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:08.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.206+0000 7fbc1d731640 1 --2- 172.21.15.53:0/295086121 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc18070f80 0x7fbc00005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:08.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.206+0000 7fbc1cf30640 1 -- 172.21.15.53:0/295086121 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc18070f80 msgr2=0x7fbc00005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:08.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.206+0000 7fbc1cf30640 1 --2- 172.21.15.53:0/295086121 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc18070f80 0x7fbc00005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:08.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.206+0000 7fbc1cf30640 1 -- 172.21.15.53:0/295086121 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc000047d0 msgr2=0x7fbc00004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:08.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.206+0000 7fbc1cf30640 1 --2- 172.21.15.53:0/295086121 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc000047d0 0x7fbc00004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:08.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.206+0000 7fbc1cf30640 1 -- 172.21.15.53:0/295086121 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc00003530 con 0x7fbc00003a20 2023-06-10T19:03:08.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.206+0000 7fbc17fff640 1 --2- 172.21.15.53:0/295086121 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc000047d0 0x7fbc00004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:03:08.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.210+0000 7fbc1cf30640 1 --2- 172.21.15.53:0/295086121 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc00003a20 0x7fbc00003e30 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7fbc08001780 tx=0x7fbc0801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efdce722e025814b server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:08.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.210+0000 7fbc177fe640 1 -- 172.21.15.53:0/295086121 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc080052d0 con 0x7fbc00003a20 2023-06-10T19:03:08.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.210+0000 7fbc177fe640 1 -- 172.21.15.53:0/295086121 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc080a7050 con 0x7fbc00003a20 2023-06-10T19:03:08.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.210+0000 7fbc177fe640 1 -- 172.21.15.53:0/295086121 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc08003600 con 0x7fbc00003a20 2023-06-10T19:03:08.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.210+0000 7fbc1f194640 1 -- 172.21.15.53:0/295086121 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc00003a20 msgr2=0x7fbc00003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:08.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.210+0000 7fbc1f194640 1 --2- 172.21.15.53:0/295086121 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc00003a20 0x7fbc00003e30 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7fbc08001780 tx=0x7fbc0801c400 comp rx=0 tx=0).stop 2023-06-10T19:03:08.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.210+0000 7fbc1d731640 1 -- 172.21.15.53:0/295086121 reap_dead start 2023-06-10T19:03:08.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.210+0000 7fbc1f194640 1 -- 172.21.15.53:0/295086121 shutdown_connections 2023-06-10T19:03:08.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.210+0000 7fbc1f194640 1 -- 172.21.15.53:0/295086121 >> 172.21.15.53:0/295086121 conn(0x7fbc1806a560 msgr2=0x7fbc1806a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:08.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.210+0000 7fbc1f194640 1 -- 172.21.15.53:0/295086121 shutdown_connections 2023-06-10T19:03:08.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.210+0000 7fbc1f194640 1 -- 172.21.15.53:0/295086121 wait complete. 2023-06-10T19:03:08.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.214+0000 7fbc1f194640 1 Processor -- start 2023-06-10T19:03:08.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.214+0000 7fbc1f194640 1 -- start start 2023-06-10T19:03:08.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.214+0000 7fbc1f194640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc00003a20 0x7fbc180b25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:08.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.214+0000 7fbc1f194640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc180b1c50 0x7fbc18158660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:08.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.214+0000 7fbc1f194640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc1815dfa0 0x7fbc1815e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:08.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.214+0000 7fbc1f194640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc1815e960 con 0x7fbc1815dfa0 2023-06-10T19:03:08.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.214+0000 7fbc1f194640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc181612f0 con 0x7fbc180b1c50 2023-06-10T19:03:08.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.214+0000 7fbc1f194640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc181615d0 con 0x7fbc00003a20 2023-06-10T19:03:08.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.214+0000 7fbc1d731640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc1815dfa0 0x7fbc1815e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:08.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.214+0000 7fbc1d731640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc1815dfa0 0x7fbc1815e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34176/0 (socket says 172.21.15.53:34176) 2023-06-10T19:03:08.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.214+0000 7fbc1d731640 1 -- 172.21.15.53:0/4246507908 learned_addr learned my addr 172.21.15.53:0/4246507908 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:08.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.214+0000 7fbc17fff640 1 --2- 172.21.15.53:0/4246507908 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc180b1c50 0x7fbc18158660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:08.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.214+0000 7fbc1cf30640 1 --2- 172.21.15.53:0/4246507908 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc00003a20 0x7fbc180b25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:08.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.214+0000 7fbc1d731640 1 -- 172.21.15.53:0/4246507908 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc00003a20 msgr2=0x7fbc180b25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:08.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.214+0000 7fbc1d731640 1 --2- 172.21.15.53:0/4246507908 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc00003a20 0x7fbc180b25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:08.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.214+0000 7fbc1d731640 1 -- 172.21.15.53:0/4246507908 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc180b1c50 msgr2=0x7fbc18158660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:08.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.214+0000 7fbc1d731640 1 --2- 172.21.15.53:0/4246507908 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc180b1c50 0x7fbc18158660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:08.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.214+0000 7fbc1d731640 1 -- 172.21.15.53:0/4246507908 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc181618b0 con 0x7fbc1815dfa0 2023-06-10T19:03:08.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.214+0000 7fbc1d731640 1 --2- 172.21.15.53:0/4246507908 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc1815dfa0 0x7fbc1815e420 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7fbc00004750 tx=0x7fbc100077f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:08.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.214+0000 7fbc157fa640 1 -- 172.21.15.53:0/4246507908 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc100114f0 con 0x7fbc1815dfa0 2023-06-10T19:03:08.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.214+0000 7fbc157fa640 1 -- 172.21.15.53:0/4246507908 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc10011650 con 0x7fbc1815dfa0 2023-06-10T19:03:08.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.214+0000 7fbc1f194640 1 -- 172.21.15.53:0/4246507908 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc18161b90 con 0x7fbc1815dfa0 2023-06-10T19:03:08.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.214+0000 7fbc157fa640 1 -- 172.21.15.53:0/4246507908 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc10011a00 con 0x7fbc1815dfa0 2023-06-10T19:03:08.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.214+0000 7fbc1f194640 1 -- 172.21.15.53:0/4246507908 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc180b2b00 con 0x7fbc1815dfa0 2023-06-10T19:03:08.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.214+0000 7fbc1f194640 1 -- 172.21.15.53:0/4246507908 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc181620b0 con 0x7fbc1815dfa0 2023-06-10T19:03:08.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.214+0000 7fbc157fa640 1 -- 172.21.15.53:0/4246507908 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbc10011b60 con 0x7fbc1815dfa0 2023-06-10T19:03:08.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.214+0000 7fbc157fa640 1 --2- 172.21.15.53:0/4246507908 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbc04066280 0x7fbc04068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:08.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.214+0000 7fbc157fa640 1 -- 172.21.15.53:0/4246507908 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6264+0+0 (secure 0 0 0) 0x7fbc10083580 con 0x7fbc1815dfa0 2023-06-10T19:03:08.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.218+0000 7fbc1cf30640 1 --2- 172.21.15.53:0/4246507908 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbc04066280 0x7fbc04068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:08.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.218+0000 7fbc1cf30640 1 --2- 172.21.15.53:0/4246507908 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbc04066280 0x7fbc04068730 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fbc08001750 tx=0x7fbc080011a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:08.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.222+0000 7fbc157fa640 1 -- 172.21.15.53:0/4246507908 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbc181620b0 con 0x7fbc1815dfa0 2023-06-10T19:03:08.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.410+0000 7fbc1f194640 1 -- 172.21.15.53:0/4246507908 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbc181620b0 con 0x7fbc1815dfa0 2023-06-10T19:03:08.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.410+0000 7fbc157fa640 1 -- 172.21.15.53:0/4246507908 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+4683 (secure 0 0 0) 0x7fbc181620b0 con 0x7fbc1815dfa0 2023-06-10T19:03:08.413 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:03:08.413 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1617157670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1617157670},{"type":"v1","addr":"172.21.15.117:6836","nonce":1617157670}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6113,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3414416090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":3414416090},{"type":"v1","addr":"172.21.15.117:6837","nonce":3414416090}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6718,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2533467097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2533467097},{"type":"v1","addr":"172.21.15.53:6835","nonce":2533467097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:02:02.642809+0000","modified":"2023-06-10T19:02:36.149418+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8127":{"gid":8127,"name":"a","rank":0,"incarnation":52,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.53:6833/2984379521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2984379521},{"type":"v1","addr":"172.21.15.53:6833","nonce":2984379521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-06-10T19:03:08.413 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 53 2023-06-10T19:03:08.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.410+0000 7fbc1f194640 1 -- 172.21.15.53:0/4246507908 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbc04066280 msgr2=0x7fbc04068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:08.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.410+0000 7fbc1f194640 1 --2- 172.21.15.53:0/4246507908 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbc04066280 0x7fbc04068730 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fbc08001750 tx=0x7fbc080011a0 comp rx=0 tx=0).stop 2023-06-10T19:03:08.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.410+0000 7fbc1f194640 1 -- 172.21.15.53:0/4246507908 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc1815dfa0 msgr2=0x7fbc1815e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:08.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.410+0000 7fbc1f194640 1 --2- 172.21.15.53:0/4246507908 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc1815dfa0 0x7fbc1815e420 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7fbc00004750 tx=0x7fbc100077f0 comp rx=0 tx=0).stop 2023-06-10T19:03:08.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.410+0000 7fbc1f194640 1 -- 172.21.15.53:0/4246507908 shutdown_connections 2023-06-10T19:03:08.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.410+0000 7fbc1f194640 1 --2- 172.21.15.53:0/4246507908 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbc04066280 0x7fbc04068730 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:08.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.410+0000 7fbc1f194640 1 --2- 172.21.15.53:0/4246507908 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc1815dfa0 0x7fbc1815e420 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:08.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.410+0000 7fbc1f194640 1 --2- 172.21.15.53:0/4246507908 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc180b1c50 0x7fbc18158660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:08.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.410+0000 7fbc1f194640 1 --2- 172.21.15.53:0/4246507908 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbc00003a20 0x7fbc180b25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:08.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.410+0000 7fbc1f194640 1 -- 172.21.15.53:0/4246507908 >> 172.21.15.53:0/4246507908 conn(0x7fbc1806a560 msgr2=0x7fbc1815b550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:08.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.410+0000 7fbc1f194640 1 -- 172.21.15.53:0/4246507908 shutdown_connections 2023-06-10T19:03:08.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:08.410+0000 7fbc1f194640 1 -- 172.21.15.53:0/4246507908 wait complete. 2023-06-10T19:03:08.432 DEBUG:tasks.cephfs.filesystem:mapped states ['up:reconnect'] to None 2023-06-10T19:03:09.433 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:03:09.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:09.566+0000 7ff1dcec9640 1 Processor -- start 2023-06-10T19:03:09.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:09.566+0000 7ff1dcec9640 1 -- start start 2023-06-10T19:03:09.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:09.570+0000 7ff1dcec9640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff1d80ccae0 0x7ff1d80d0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:09.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:09.570+0000 7ff1dcec9640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1d80d0020 con 0x7ff1d80cc690 2023-06-10T19:03:09.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:09.570+0000 7ff1dcec9640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1d80cef40 con 0x7ff1d80b3ac0 2023-06-10T19:03:09.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:09.570+0000 7ff1dcec9640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1d80cf220 con 0x7ff1d80ccae0 2023-06-10T19:03:09.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:09.570+0000 7ff1d6d9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff1d80ccae0 0x7ff1d80d0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:09.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:09.570+0000 7ff1cdd9b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ff1d80cc690 0x7ff1d80d04b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41826/0 (socket says 172.21.15.53:41826) 2023-06-10T19:03:09.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:09.570+0000 7ff1cdd9b640 1 -- 172.21.15.53:0/4243655765 learned_addr learned my addr 172.21.15.53:0/4243655765 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:03:09.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:09.570+0000 7ff1d6d9d640 1 -- 172.21.15.53:0/4243655765 >> v1:172.21.15.117:6789/0 conn(0x7ff1d80b3ac0 legacy=0x7ff1d80b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:09.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:09.570+0000 7ff1d6d9d640 1 -- 172.21.15.53:0/4243655765 >> v1:172.21.15.53:6789/0 conn(0x7ff1d80cc690 legacy=0x7ff1d80d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:09.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:09.570+0000 7ff1d6d9d640 1 -- 172.21.15.53:0/4243655765 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1d80cf500 con 0x7ff1d80ccae0 2023-06-10T19:03:09.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:09.570+0000 7ff1d6d9d640 1 --2- 172.21.15.53:0/4243655765 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1d80ccae0 0x7ff1d80d0bc0 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7ff1d0009d90 tx=0x7ff1d001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e60a7205d7618430 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:09.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:09.570+0000 7ff1d5d9b640 1 -- 172.21.15.53:0/4243655765 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d00a5a00 con 0x7ff1d80ccae0 2023-06-10T19:03:09.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:09.570+0000 7ff1d5d9b640 1 -- 172.21.15.53:0/4243655765 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1d00a5b60 con 0x7ff1d80ccae0 2023-06-10T19:03:09.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:09.570+0000 7ff1d5d9b640 1 -- 172.21.15.53:0/4243655765 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d00ad440 con 0x7ff1d80ccae0 2023-06-10T19:03:09.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:09.574+0000 7ff1dcec9640 1 -- 172.21.15.53:0/4243655765 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1d80ccae0 msgr2=0x7ff1d80d0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:09.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:09.574+0000 7ff1dcec9640 1 --2- 172.21.15.53:0/4243655765 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1d80ccae0 0x7ff1d80d0bc0 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7ff1d0009d90 tx=0x7ff1d001c920 comp rx=0 tx=0).stop 2023-06-10T19:03:09.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:09.574+0000 7ff1dcec9640 1 -- 172.21.15.53:0/4243655765 shutdown_connections 2023-06-10T19:03:09.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:09.574+0000 7ff1dcec9640 1 --2- 172.21.15.53:0/4243655765 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1d80ccae0 0x7ff1d80d0bc0 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:09.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:09.574+0000 7ff1dcec9640 1 -- 172.21.15.53:0/4243655765 >> 172.21.15.53:0/4243655765 conn(0x7ff1d8071790 msgr2=0x7ff1d8069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:09.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:09.574+0000 7ff1dcec9640 1 -- 172.21.15.53:0/4243655765 shutdown_connections 2023-06-10T19:03:09.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:09.574+0000 7ff1dcec9640 1 -- 172.21.15.53:0/4243655765 wait complete. 2023-06-10T19:03:09.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:09.574+0000 7ff1dcec9640 1 Processor -- start 2023-06-10T19:03:09.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:09.574+0000 7ff1dcec9640 1 -- start start 2023-06-10T19:03:09.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:09.574+0000 7ff1dcec9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1d80b3ac0 0x7ff1d8153c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:09.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:09.574+0000 7ff1dcec9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1d80cc690 0x7ff1d8155a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:09.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:09.574+0000 7ff1dcec9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1d80ccae0 0x7ff1d80ca160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:09.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:09.574+0000 7ff1dcec9640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1d80c5bb0 con 0x7ff1d80b3ac0 2023-06-10T19:03:09.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:09.574+0000 7ff1dcec9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1d8156400 con 0x7ff1d80cc690 2023-06-10T19:03:09.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:09.574+0000 7ff1dcec9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1d81566e0 con 0x7ff1d80ccae0 2023-06-10T19:03:09.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:09.574+0000 7ff1d659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1d80b3ac0 0x7ff1d8153c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:09.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:09.574+0000 7ff1d659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1d80b3ac0 0x7ff1d8153c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34186/0 (socket says 172.21.15.53:34186) 2023-06-10T19:03:09.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:09.574+0000 7ff1d659c640 1 -- 172.21.15.53:0/3286447443 learned_addr learned my addr 172.21.15.53:0/3286447443 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:09.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:09.574+0000 7ff1cdd9b640 1 --2- 172.21.15.53:0/3286447443 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1d80cc690 0x7ff1d8155a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:09.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:09.574+0000 7ff1d6d9d640 1 --2- 172.21.15.53:0/3286447443 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1d80ccae0 0x7ff1d80ca160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:09.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:09.574+0000 7ff1d659c640 1 -- 172.21.15.53:0/3286447443 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1d80ccae0 msgr2=0x7ff1d80ca160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:09.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:09.574+0000 7ff1d659c640 1 --2- 172.21.15.53:0/3286447443 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1d80ccae0 0x7ff1d80ca160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:09.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:09.574+0000 7ff1d659c640 1 -- 172.21.15.53:0/3286447443 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1d80cc690 msgr2=0x7ff1d8155a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:09.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:09.574+0000 7ff1d659c640 1 --2- 172.21.15.53:0/3286447443 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1d80cc690 0x7ff1d8155a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:09.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:09.574+0000 7ff1d659c640 1 -- 172.21.15.53:0/3286447443 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1d0009a70 con 0x7ff1d80b3ac0 2023-06-10T19:03:09.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:09.574+0000 7ff1d6d9d640 1 --2- 172.21.15.53:0/3286447443 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1d80ccae0 0x7ff1d80ca160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:03:09.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:09.574+0000 7ff1cdd9b640 1 --2- 172.21.15.53:0/3286447443 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1d80cc690 0x7ff1d8155a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:03:09.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:09.574+0000 7ff1d659c640 1 --2- 172.21.15.53:0/3286447443 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1d80b3ac0 0x7ff1d8153c60 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7ff1c800c500 tx=0x7ff1c800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:09.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:09.578+0000 7ff1cf7fe640 1 -- 172.21.15.53:0/3286447443 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c8005220 con 0x7ff1d80b3ac0 2023-06-10T19:03:09.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:09.578+0000 7ff1cf7fe640 1 -- 172.21.15.53:0/3286447443 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1c8005380 con 0x7ff1d80b3ac0 2023-06-10T19:03:09.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:09.578+0000 7ff1dcec9640 1 -- 172.21.15.53:0/3286447443 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1d81569c0 con 0x7ff1d80b3ac0 2023-06-10T19:03:09.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:09.578+0000 7ff1cf7fe640 1 -- 172.21.15.53:0/3286447443 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c8007270 con 0x7ff1d80b3ac0 2023-06-10T19:03:09.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:09.578+0000 7ff1dcec9640 1 -- 172.21.15.53:0/3286447443 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1d81541a0 con 0x7ff1d80b3ac0 2023-06-10T19:03:09.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:09.578+0000 7ff1dcec9640 1 -- 172.21.15.53:0/3286447443 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1d804d790 con 0x7ff1d80b3ac0 2023-06-10T19:03:09.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:09.578+0000 7ff1cf7fe640 1 -- 172.21.15.53:0/3286447443 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff1c80073d0 con 0x7ff1d80b3ac0 2023-06-10T19:03:09.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:09.578+0000 7ff1cf7fe640 1 --2- 172.21.15.53:0/3286447443 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff1b8066280 0x7ff1b8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:09.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:09.578+0000 7ff1cf7fe640 1 -- 172.21.15.53:0/3286447443 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6264+0+0 (secure 0 0 0) 0x7ff1c8083800 con 0x7ff1d80b3ac0 2023-06-10T19:03:09.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:09.578+0000 7ff1cdd9b640 1 --2- 172.21.15.53:0/3286447443 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff1b8066280 0x7ff1b8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:09.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:09.578+0000 7ff1cdd9b640 1 --2- 172.21.15.53:0/3286447443 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff1b8066280 0x7ff1b8068730 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7ff1d80c8530 tx=0x7ff1c0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:09.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:09.582+0000 7ff1cf7fe640 1 -- 172.21.15.53:0/3286447443 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff1c8050b20 con 0x7ff1d80b3ac0 2023-06-10T19:03:09.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:09.774+0000 7ff1dcec9640 1 -- 172.21.15.53:0/3286447443 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff1d808a200 con 0x7ff1d80b3ac0 2023-06-10T19:03:09.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:09.774+0000 7ff1cf7fe640 1 -- 172.21.15.53:0/3286447443 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+4683 (secure 0 0 0) 0x7ff1c8054140 con 0x7ff1d80b3ac0 2023-06-10T19:03:09.776 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:03:09.777 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1617157670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1617157670},{"type":"v1","addr":"172.21.15.117:6836","nonce":1617157670}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6113,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3414416090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":3414416090},{"type":"v1","addr":"172.21.15.117:6837","nonce":3414416090}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6718,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2533467097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2533467097},{"type":"v1","addr":"172.21.15.53:6835","nonce":2533467097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:02:02.642809+0000","modified":"2023-06-10T19:02:36.149418+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8127":{"gid":8127,"name":"a","rank":0,"incarnation":52,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.53:6833/2984379521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2984379521},{"type":"v1","addr":"172.21.15.53:6833","nonce":2984379521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-06-10T19:03:09.777 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 53 2023-06-10T19:03:09.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:09.774+0000 7ff1dcec9640 1 -- 172.21.15.53:0/3286447443 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff1b8066280 msgr2=0x7ff1b8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:09.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:09.774+0000 7ff1dcec9640 1 --2- 172.21.15.53:0/3286447443 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff1b8066280 0x7ff1b8068730 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7ff1d80c8530 tx=0x7ff1c0009040 comp rx=0 tx=0).stop 2023-06-10T19:03:09.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:09.774+0000 7ff1dcec9640 1 -- 172.21.15.53:0/3286447443 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1d80b3ac0 msgr2=0x7ff1d8153c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:09.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:09.774+0000 7ff1dcec9640 1 --2- 172.21.15.53:0/3286447443 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1d80b3ac0 0x7ff1d8153c60 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7ff1c800c500 tx=0x7ff1c800c9c0 comp rx=0 tx=0).stop 2023-06-10T19:03:09.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:09.774+0000 7ff1dcec9640 1 -- 172.21.15.53:0/3286447443 shutdown_connections 2023-06-10T19:03:09.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:09.774+0000 7ff1dcec9640 1 --2- 172.21.15.53:0/3286447443 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff1b8066280 0x7ff1b8068730 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:09.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:09.774+0000 7ff1dcec9640 1 --2- 172.21.15.53:0/3286447443 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1d80ccae0 0x7ff1d80ca160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:09.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:09.774+0000 7ff1dcec9640 1 --2- 172.21.15.53:0/3286447443 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1d80cc690 0x7ff1d8155a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:09.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:09.774+0000 7ff1dcec9640 1 --2- 172.21.15.53:0/3286447443 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1d80b3ac0 0x7ff1d8153c60 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:09.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:09.774+0000 7ff1dcec9640 1 -- 172.21.15.53:0/3286447443 >> 172.21.15.53:0/3286447443 conn(0x7ff1d8071790 msgr2=0x7ff1d80d04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:09.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:09.774+0000 7ff1dcec9640 1 -- 172.21.15.53:0/3286447443 shutdown_connections 2023-06-10T19:03:09.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:09.774+0000 7ff1dcec9640 1 -- 172.21.15.53:0/3286447443 wait complete. 2023-06-10T19:03:09.795 DEBUG:tasks.cephfs.filesystem:mapped states ['up:reconnect'] to None 2023-06-10T19:03:10.796 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:03:10.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:10.930+0000 7f0798c20640 1 Processor -- start 2023-06-10T19:03:10.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:10.930+0000 7f0798c20640 1 -- start start 2023-06-10T19:03:10.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:10.930+0000 7f0798c20640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0794159630 0x7f079415d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:10.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:10.930+0000 7f0798c20640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f07940ad730 0x7f07940713a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:10.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:10.930+0000 7f0798c20640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0794070f10 con 0x7f07940718e0 2023-06-10T19:03:10.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:10.930+0000 7f0798c20640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f079415db60 con 0x7f07940ad730 2023-06-10T19:03:10.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:10.930+0000 7f0798c20640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f079415de40 con 0x7f0794159630 2023-06-10T19:03:10.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:10.930+0000 7f0791d9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f07940ad730 0x7f07940713a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:10.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:10.930+0000 7f0791d9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f07940ad730 0x7f07940713a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34196/0 (socket says 172.21.15.53:34196) 2023-06-10T19:03:10.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:10.930+0000 7f0792d9d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f07940718e0 0x7f0794069450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41842/0 (socket says 172.21.15.53:41842) 2023-06-10T19:03:10.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:10.930+0000 7f0791d9b640 1 -- 172.21.15.53:0/2444474196 learned_addr learned my addr 172.21.15.53:0/2444474196 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:10.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:10.930+0000 7f079259c640 1 --2- 172.21.15.53:0/2444474196 >> v2:172.21.15.117:3300/0 conn(0x7f0794159630 0x7f079415d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:10.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:10.930+0000 7f0791d9b640 1 -- 172.21.15.53:0/2444474196 >> v2:172.21.15.117:3300/0 conn(0x7f0794159630 msgr2=0x7f079415d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:10.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:10.930+0000 7f0791d9b640 1 --2- 172.21.15.53:0/2444474196 >> v2:172.21.15.117:3300/0 conn(0x7f0794159630 0x7f079415d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:10.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:10.930+0000 7f0791d9b640 1 -- 172.21.15.53:0/2444474196 >> v1:172.21.15.53:6789/0 conn(0x7f07940718e0 legacy=0x7f0794069450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:10.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:10.930+0000 7f0791d9b640 1 -- 172.21.15.53:0/2444474196 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f079415e120 con 0x7f07940ad730 2023-06-10T19:03:10.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:10.930+0000 7f079159a640 1 -- 172.21.15.53:0/2444474196 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4216445783 0 0) 0x7f0794070f10 con 0x7f07940718e0 2023-06-10T19:03:10.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:10.934+0000 7f0791d9b640 1 --2- 172.21.15.53:0/2444474196 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07940ad730 0x7f07940713a0 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f079406d680 tx=0x7f078801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22fd27482847da00 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:10.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:10.934+0000 7f079159a640 1 -- 172.21.15.53:0/2444474196 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07880ac640 con 0x7f07940ad730 2023-06-10T19:03:10.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:10.934+0000 7f079159a640 1 -- 172.21.15.53:0/2444474196 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07880ac7a0 con 0x7f07940ad730 2023-06-10T19:03:10.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:10.934+0000 7f079159a640 1 -- 172.21.15.53:0/2444474196 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07880acb30 con 0x7f07940ad730 2023-06-10T19:03:10.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:10.934+0000 7f0798c20640 1 -- 172.21.15.53:0/2444474196 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07940ad730 msgr2=0x7f07940713a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:10.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:10.934+0000 7f0798c20640 1 --2- 172.21.15.53:0/2444474196 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07940ad730 0x7f07940713a0 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f079406d680 tx=0x7f078801c4d0 comp rx=0 tx=0).stop 2023-06-10T19:03:10.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:10.934+0000 7f0798c20640 1 -- 172.21.15.53:0/2444474196 shutdown_connections 2023-06-10T19:03:10.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:10.934+0000 7f0798c20640 1 --2- 172.21.15.53:0/2444474196 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07940ad730 0x7f07940713a0 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:10.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:10.934+0000 7f0798c20640 1 --2- 172.21.15.53:0/2444474196 >> v2:172.21.15.117:3300/0 conn(0x7f0794159630 0x7f079415d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:10.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:10.934+0000 7f0798c20640 1 -- 172.21.15.53:0/2444474196 >> 172.21.15.53:0/2444474196 conn(0x7f07940cafc0 msgr2=0x7f07940cb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:10.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:10.934+0000 7f0798c20640 1 -- 172.21.15.53:0/2444474196 shutdown_connections 2023-06-10T19:03:10.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:10.934+0000 7f0798c20640 1 -- 172.21.15.53:0/2444474196 wait complete. 2023-06-10T19:03:10.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:10.934+0000 7f0798c20640 1 Processor -- start 2023-06-10T19:03:10.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:10.934+0000 7f0798c20640 1 -- start start 2023-06-10T19:03:10.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:10.938+0000 7f0798c20640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07940718e0 0x7f07941532a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:10.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:10.938+0000 7f0798c20640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07940ad730 0x7f0794149990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:10.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:10.938+0000 7f0798c20640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0794159630 0x7f07941482f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:10.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:10.938+0000 7f0798c20640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0794148830 con 0x7f07940ad730 2023-06-10T19:03:10.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:10.938+0000 7f0798c20640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07940c6650 con 0x7f07940718e0 2023-06-10T19:03:10.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:10.938+0000 7f0798c20640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0794148bd0 con 0x7f0794159630 2023-06-10T19:03:10.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:10.938+0000 7f0791d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07940ad730 0x7f0794149990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:10.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:10.938+0000 7f0791d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07940ad730 0x7f0794149990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34200/0 (socket says 172.21.15.53:34200) 2023-06-10T19:03:10.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:10.938+0000 7f0791d9b640 1 -- 172.21.15.53:0/1004622634 learned_addr learned my addr 172.21.15.53:0/1004622634 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:10.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:10.938+0000 7f079259c640 1 --2- 172.21.15.53:0/1004622634 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07940718e0 0x7f07941532a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:10.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:10.938+0000 7f0792d9d640 1 --2- 172.21.15.53:0/1004622634 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0794159630 0x7f07941482f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:10.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:10.938+0000 7f0791d9b640 1 -- 172.21.15.53:0/1004622634 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0794159630 msgr2=0x7f07941482f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:10.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:10.938+0000 7f0791d9b640 1 --2- 172.21.15.53:0/1004622634 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0794159630 0x7f07941482f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:10.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:10.938+0000 7f0791d9b640 1 -- 172.21.15.53:0/1004622634 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07940718e0 msgr2=0x7f07941532a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:10.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:10.938+0000 7f0791d9b640 1 --2- 172.21.15.53:0/1004622634 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07940718e0 0x7f07941532a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:10.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:10.938+0000 7f0791d9b640 1 -- 172.21.15.53:0/1004622634 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07880094d0 con 0x7f07940ad730 2023-06-10T19:03:10.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:10.938+0000 7f079259c640 1 --2- 172.21.15.53:0/1004622634 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07940718e0 0x7f07941532a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:03:10.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:10.938+0000 7f0791d9b640 1 --2- 172.21.15.53:0/1004622634 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07940ad730 0x7f0794149990 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f07880190e0 tx=0x7f0788019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:10.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:10.938+0000 7f0782ffd640 1 -- 172.21.15.53:0/1004622634 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07880b5640 con 0x7f07940ad730 2023-06-10T19:03:10.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:10.938+0000 7f0782ffd640 1 -- 172.21.15.53:0/1004622634 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07880b57a0 con 0x7f07940ad730 2023-06-10T19:03:10.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:10.938+0000 7f0798c20640 1 -- 172.21.15.53:0/1004622634 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0794148eb0 con 0x7f07940ad730 2023-06-10T19:03:10.944 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:10.938+0000 7f0782ffd640 1 -- 172.21.15.53:0/1004622634 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07880b5b10 con 0x7f07940ad730 2023-06-10T19:03:10.944 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:10.938+0000 7f0798c20640 1 -- 172.21.15.53:0/1004622634 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0794149470 con 0x7f07940ad730 2023-06-10T19:03:10.944 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:10.938+0000 7f0798c20640 1 -- 172.21.15.53:0/1004622634 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07940cbd00 con 0x7f07940ad730 2023-06-10T19:03:10.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:10.938+0000 7f0782ffd640 1 -- 172.21.15.53:0/1004622634 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f07880b3070 con 0x7f07940ad730 2023-06-10T19:03:10.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:10.938+0000 7f0782ffd640 1 --2- 172.21.15.53:0/1004622634 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0774066280 0x7f0774068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:10.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:10.938+0000 7f0782ffd640 1 -- 172.21.15.53:0/1004622634 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6264+0+0 (secure 0 0 0) 0x7f078811e0c0 con 0x7f07940ad730 2023-06-10T19:03:10.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:10.942+0000 7f079259c640 1 --2- 172.21.15.53:0/1004622634 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0774066280 0x7f0774068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:10.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:10.942+0000 7f079259c640 1 --2- 172.21.15.53:0/1004622634 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0774066280 0x7f0774068730 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f0784009a40 tx=0x7f0784008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:10.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:10.942+0000 7f0782ffd640 1 -- 172.21.15.53:0/1004622634 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f07880eb470 con 0x7f07940ad730 2023-06-10T19:03:11.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:11.122+0000 7f0798c20640 1 -- 172.21.15.53:0/1004622634 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0794149660 con 0x7f07940ad730 2023-06-10T19:03:11.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:11.122+0000 7f0782ffd640 1 -- 172.21.15.53:0/1004622634 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+4683 (secure 0 0 0) 0x7f07880eea90 con 0x7f07940ad730 2023-06-10T19:03:11.127 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:03:11.127 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1617157670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1617157670},{"type":"v1","addr":"172.21.15.117:6836","nonce":1617157670}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6113,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3414416090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":3414416090},{"type":"v1","addr":"172.21.15.117:6837","nonce":3414416090}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6718,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2533467097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2533467097},{"type":"v1","addr":"172.21.15.53:6835","nonce":2533467097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:02:02.642809+0000","modified":"2023-06-10T19:02:36.149418+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8127":{"gid":8127,"name":"a","rank":0,"incarnation":52,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.53:6833/2984379521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2984379521},{"type":"v1","addr":"172.21.15.53:6833","nonce":2984379521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-06-10T19:03:11.127 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 53 2023-06-10T19:03:11.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:11.126+0000 7f0798c20640 1 -- 172.21.15.53:0/1004622634 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0774066280 msgr2=0x7f0774068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:11.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:11.126+0000 7f0798c20640 1 --2- 172.21.15.53:0/1004622634 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0774066280 0x7f0774068730 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f0784009a40 tx=0x7f0784008040 comp rx=0 tx=0).stop 2023-06-10T19:03:11.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:11.126+0000 7f0798c20640 1 -- 172.21.15.53:0/1004622634 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07940ad730 msgr2=0x7f0794149990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:11.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:11.126+0000 7f0798c20640 1 --2- 172.21.15.53:0/1004622634 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07940ad730 0x7f0794149990 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f07880190e0 tx=0x7f0788019270 comp rx=0 tx=0).stop 2023-06-10T19:03:11.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:11.126+0000 7f0798c20640 1 -- 172.21.15.53:0/1004622634 shutdown_connections 2023-06-10T19:03:11.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:11.126+0000 7f0798c20640 1 --2- 172.21.15.53:0/1004622634 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0774066280 0x7f0774068730 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:11.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:11.126+0000 7f0798c20640 1 --2- 172.21.15.53:0/1004622634 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0794159630 0x7f07941482f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:11.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:11.126+0000 7f0798c20640 1 --2- 172.21.15.53:0/1004622634 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07940ad730 0x7f0794149990 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:11.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:11.126+0000 7f0798c20640 1 --2- 172.21.15.53:0/1004622634 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07940718e0 0x7f07941532a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:11.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:11.126+0000 7f0798c20640 1 -- 172.21.15.53:0/1004622634 >> 172.21.15.53:0/1004622634 conn(0x7f07940cafc0 msgr2=0x7f07940c93a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:11.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:11.126+0000 7f0798c20640 1 -- 172.21.15.53:0/1004622634 shutdown_connections 2023-06-10T19:03:11.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:11.126+0000 7f0798c20640 1 -- 172.21.15.53:0/1004622634 wait complete. 2023-06-10T19:03:11.145 DEBUG:tasks.cephfs.filesystem:mapped states ['up:reconnect'] to None 2023-06-10T19:03:12.146 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:03:12.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:12.278+0000 7f5b000f8640 1 Processor -- start 2023-06-10T19:03:12.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:12.278+0000 7f5b000f8640 1 -- start start 2023-06-10T19:03:12.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:12.278+0000 7f5b000f8640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5af80c9840 0x7f5af80c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:12.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:12.278+0000 7f5b000f8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5af8071060 0x7f5af80af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:12.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:12.278+0000 7f5b000f8640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5af8159b50 con 0x7f5af80afc60 2023-06-10T19:03:12.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:12.278+0000 7f5b000f8640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5af80ca150 con 0x7f5af8071060 2023-06-10T19:03:12.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:12.278+0000 7f5b000f8640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5af80702a0 con 0x7f5af80c9840 2023-06-10T19:03:12.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:12.278+0000 7f5afd693640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5af8071060 0x7f5af80af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:12.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:12.278+0000 7f5afd693640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5af8071060 0x7f5af80af720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57278/0 (socket says 172.21.15.53:57278) 2023-06-10T19:03:12.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:12.278+0000 7f5afd693640 1 -- 172.21.15.53:0/4077904576 learned_addr learned my addr 172.21.15.53:0/4077904576 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:12.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:12.278+0000 7f5afde94640 1 --2- 172.21.15.53:0/4077904576 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5af80c9840 0x7f5af80c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:12.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:12.278+0000 7f5afd693640 1 -- 172.21.15.53:0/4077904576 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5af80c9840 msgr2=0x7f5af80c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:12.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:12.278+0000 7f5afd693640 1 --2- 172.21.15.53:0/4077904576 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5af80c9840 0x7f5af80c9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:12.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:12.278+0000 7f5afd693640 1 -- 172.21.15.53:0/4077904576 >> v1:172.21.15.117:6789/0 conn(0x7f5af80afc60 legacy=0x7f5af815d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:12.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:12.278+0000 7f5afd693640 1 -- 172.21.15.53:0/4077904576 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af8070580 con 0x7f5af8071060 2023-06-10T19:03:12.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:12.278+0000 7f5afd693640 1 --2- 172.21.15.53:0/4077904576 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5af8071060 0x7f5af80af720 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7f5ae8009870 tx=0x7f5ae801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f5701f1752782e2 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:12.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:12.282+0000 7f5afce92640 1 -- 172.21.15.53:0/4077904576 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae80ac410 con 0x7f5af8071060 2023-06-10T19:03:12.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:12.282+0000 7f5afce92640 1 -- 172.21.15.53:0/4077904576 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ae80ac570 con 0x7f5af8071060 2023-06-10T19:03:12.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:12.282+0000 7f5afce92640 1 -- 172.21.15.53:0/4077904576 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae80ac900 con 0x7f5af8071060 2023-06-10T19:03:12.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:12.282+0000 7f5b000f8640 1 -- 172.21.15.53:0/4077904576 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5af8071060 msgr2=0x7f5af80af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:12.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:12.282+0000 7f5b000f8640 1 --2- 172.21.15.53:0/4077904576 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5af8071060 0x7f5af80af720 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7f5ae8009870 tx=0x7f5ae801c4d0 comp rx=0 tx=0).stop 2023-06-10T19:03:12.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:12.282+0000 7f5b000f8640 1 -- 172.21.15.53:0/4077904576 shutdown_connections 2023-06-10T19:03:12.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:12.282+0000 7f5b000f8640 1 --2- 172.21.15.53:0/4077904576 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5af8071060 0x7f5af80af720 unknown :-1 s=CLOSED pgs=1577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:12.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:12.282+0000 7f5b000f8640 1 --2- 172.21.15.53:0/4077904576 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5af80c9840 0x7f5af80c9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:12.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:12.282+0000 7f5b000f8640 1 -- 172.21.15.53:0/4077904576 >> 172.21.15.53:0/4077904576 conn(0x7f5af806a0d0 msgr2=0x7f5af80ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:12.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:12.282+0000 7f5b000f8640 1 -- 172.21.15.53:0/4077904576 shutdown_connections 2023-06-10T19:03:12.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:12.282+0000 7f5b000f8640 1 -- 172.21.15.53:0/4077904576 wait complete. 2023-06-10T19:03:12.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:12.282+0000 7f5b000f8640 1 Processor -- start 2023-06-10T19:03:12.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:12.282+0000 7f5b000f8640 1 -- start start 2023-06-10T19:03:12.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:12.282+0000 7f5b000f8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5af8071060 0x7f5af815cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:12.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:12.282+0000 7f5b000f8640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5af80afc60 0x7f5af80cd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:12.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:12.282+0000 7f5b000f8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5af80c9840 0x7f5af815ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:12.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:12.282+0000 7f5b000f8640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af8153bd0 con 0x7f5af80c9840 2023-06-10T19:03:12.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:12.282+0000 7f5b000f8640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af814b800 con 0x7f5af8071060 2023-06-10T19:03:12.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:12.282+0000 7f5b000f8640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5af80aca10 con 0x7f5af80afc60 2023-06-10T19:03:12.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:12.282+0000 7f5afe695640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5af80c9840 0x7f5af815ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:12.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:12.282+0000 7f5afe695640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5af80c9840 0x7f5af815ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57294/0 (socket says 172.21.15.53:57294) 2023-06-10T19:03:12.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:12.282+0000 7f5afe695640 1 -- 172.21.15.53:0/3639985920 learned_addr learned my addr 172.21.15.53:0/3639985920 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:12.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:12.282+0000 7f5afd693640 1 --2- 172.21.15.53:0/3639985920 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5af80afc60 0x7f5af80cd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:12.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:12.282+0000 7f5afde94640 1 --2- 172.21.15.53:0/3639985920 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5af8071060 0x7f5af815cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:12.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:12.282+0000 7f5afe695640 1 -- 172.21.15.53:0/3639985920 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5af80afc60 msgr2=0x7f5af80cd0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:12.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:12.282+0000 7f5afe695640 1 --2- 172.21.15.53:0/3639985920 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5af80afc60 0x7f5af80cd0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:12.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:12.282+0000 7f5afe695640 1 -- 172.21.15.53:0/3639985920 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5af8071060 msgr2=0x7f5af815cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:12.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:12.282+0000 7f5afe695640 1 --2- 172.21.15.53:0/3639985920 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5af8071060 0x7f5af815cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:12.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:12.282+0000 7f5afe695640 1 -- 172.21.15.53:0/3639985920 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ae80094d0 con 0x7f5af80c9840 2023-06-10T19:03:12.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:12.282+0000 7f5afe695640 1 --2- 172.21.15.53:0/3639985920 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5af80c9840 0x7f5af815ba40 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f5af000c780 tx=0x7f5af000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:12.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:12.282+0000 7f5aee7fc640 1 -- 172.21.15.53:0/3639985920 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af0004b70 con 0x7f5af80c9840 2023-06-10T19:03:12.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:12.282+0000 7f5aee7fc640 1 -- 172.21.15.53:0/3639985920 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5af000ce90 con 0x7f5af80c9840 2023-06-10T19:03:12.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:12.282+0000 7f5aee7fc640 1 -- 172.21.15.53:0/3639985920 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af000a850 con 0x7f5af80c9840 2023-06-10T19:03:12.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:12.282+0000 7f5b000f8640 1 -- 172.21.15.53:0/3639985920 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5af80accf0 con 0x7f5af80c9840 2023-06-10T19:03:12.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:12.286+0000 7f5b000f8640 1 -- 172.21.15.53:0/3639985920 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5af8153e20 con 0x7f5af80c9840 2023-06-10T19:03:12.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:12.286+0000 7f5b000f8640 1 -- 172.21.15.53:0/3639985920 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5af806c830 con 0x7f5af80c9840 2023-06-10T19:03:12.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:12.286+0000 7f5aee7fc640 1 -- 172.21.15.53:0/3639985920 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5af000a9b0 con 0x7f5af80c9840 2023-06-10T19:03:12.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:12.286+0000 7f5aee7fc640 1 --2- 172.21.15.53:0/3639985920 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5adc066280 0x7f5adc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:12.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:12.286+0000 7f5aee7fc640 1 -- 172.21.15.53:0/3639985920 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6264+0+0 (secure 0 0 0) 0x7f5af0083ed0 con 0x7f5af80c9840 2023-06-10T19:03:12.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:12.286+0000 7f5afde94640 1 --2- 172.21.15.53:0/3639985920 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5adc066280 0x7f5adc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:12.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:12.286+0000 7f5afde94640 1 --2- 172.21.15.53:0/3639985920 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5adc066280 0x7f5adc068730 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f5af400b930 tx=0x7f5af4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:12.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:12.290+0000 7f5aee7fc640 1 -- 172.21.15.53:0/3639985920 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5af0054da0 con 0x7f5af80c9840 2023-06-10T19:03:12.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:12.478+0000 7f5b000f8640 1 -- 172.21.15.53:0/3639985920 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5af8154010 con 0x7f5af80c9840 2023-06-10T19:03:12.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:12.478+0000 7f5aee7fc640 1 -- 172.21.15.53:0/3639985920 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+4683 (secure 0 0 0) 0x7f5af0054930 con 0x7f5af80c9840 2023-06-10T19:03:12.483 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:03:12.483 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1617157670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1617157670},{"type":"v1","addr":"172.21.15.117:6836","nonce":1617157670}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6113,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3414416090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":3414416090},{"type":"v1","addr":"172.21.15.117:6837","nonce":3414416090}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6718,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2533467097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2533467097},{"type":"v1","addr":"172.21.15.53:6835","nonce":2533467097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:02:02.642809+0000","modified":"2023-06-10T19:02:36.149418+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8127":{"gid":8127,"name":"a","rank":0,"incarnation":52,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.53:6833/2984379521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2984379521},{"type":"v1","addr":"172.21.15.53:6833","nonce":2984379521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-06-10T19:03:12.484 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 53 2023-06-10T19:03:12.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:12.482+0000 7f5b000f8640 1 -- 172.21.15.53:0/3639985920 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5adc066280 msgr2=0x7f5adc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:12.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:12.482+0000 7f5b000f8640 1 --2- 172.21.15.53:0/3639985920 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5adc066280 0x7f5adc068730 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f5af400b930 tx=0x7f5af4008040 comp rx=0 tx=0).stop 2023-06-10T19:03:12.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:12.482+0000 7f5b000f8640 1 -- 172.21.15.53:0/3639985920 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5af80c9840 msgr2=0x7f5af815ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:12.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:12.482+0000 7f5b000f8640 1 --2- 172.21.15.53:0/3639985920 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5af80c9840 0x7f5af815ba40 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f5af000c780 tx=0x7f5af000cc40 comp rx=0 tx=0).stop 2023-06-10T19:03:12.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:12.482+0000 7f5b000f8640 1 -- 172.21.15.53:0/3639985920 shutdown_connections 2023-06-10T19:03:12.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:12.482+0000 7f5b000f8640 1 --2- 172.21.15.53:0/3639985920 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5adc066280 0x7f5adc068730 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:12.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:12.482+0000 7f5b000f8640 1 --2- 172.21.15.53:0/3639985920 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5af80c9840 0x7f5af815ba40 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:12.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:12.482+0000 7f5b000f8640 1 --2- 172.21.15.53:0/3639985920 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5af80afc60 0x7f5af80cd0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:12.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:12.482+0000 7f5b000f8640 1 --2- 172.21.15.53:0/3639985920 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5af8071060 0x7f5af815cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:12.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:12.482+0000 7f5b000f8640 1 -- 172.21.15.53:0/3639985920 >> 172.21.15.53:0/3639985920 conn(0x7f5af806a0d0 msgr2=0x7f5af80ce370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:12.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:12.482+0000 7f5b000f8640 1 -- 172.21.15.53:0/3639985920 shutdown_connections 2023-06-10T19:03:12.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:12.482+0000 7f5b000f8640 1 -- 172.21.15.53:0/3639985920 wait complete. 2023-06-10T19:03:12.503 DEBUG:tasks.cephfs.filesystem:mapped states ['up:reconnect'] to None 2023-06-10T19:03:13.504 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:03:13.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.633+0000 7fa171a2b640 1 Processor -- start 2023-06-10T19:03:13.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.637+0000 7fa171a2b640 1 -- start start 2023-06-10T19:03:13.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.637+0000 7fa171a2b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa16c0b3ac0 0x7fa16c0b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:13.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.637+0000 7fa171a2b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa16c0cc690 0x7fa16c15f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:13.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.637+0000 7fa171a2b640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa16c0d0020 con 0x7fa16c0ccae0 2023-06-10T19:03:13.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.637+0000 7fa171a2b640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa16c0b43d0 con 0x7fa16c0cc690 2023-06-10T19:03:13.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.637+0000 7fa171a2b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa16c0cef40 con 0x7fa16c0b3ac0 2023-06-10T19:03:13.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.637+0000 7fa16b7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fa16c0ccae0 0x7fa16c15f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:45484/0 (socket says 172.21.15.53:45484) 2023-06-10T19:03:13.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.637+0000 7fa16b7fe640 1 -- 172.21.15.53:0/2843981010 learned_addr learned my addr 172.21.15.53:0/2843981010 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:03:13.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.637+0000 7fa16a7fc640 1 --2- 172.21.15.53:0/2843981010 >> v2:172.21.15.117:3300/0 conn(0x7fa16c0cc690 0x7fa16c15f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:13.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.637+0000 7fa16affd640 1 --2- 172.21.15.53:0/2843981010 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa16c0b3ac0 0x7fa16c0b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:13.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.637+0000 7fa169ffb640 1 -- 172.21.15.53:0/2843981010 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 855769217 0 0) 0x7fa16c0d0020 con 0x7fa16c0ccae0 2023-06-10T19:03:13.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.637+0000 7fa169ffb640 1 -- 172.21.15.53:0/2843981010 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa154003530 con 0x7fa16c0ccae0 2023-06-10T19:03:13.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.637+0000 7fa169ffb640 1 -- 172.21.15.53:0/2843981010 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 856144177 0 0) 0x7fa154003530 con 0x7fa16c0ccae0 2023-06-10T19:03:13.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.637+0000 7fa169ffb640 1 -- 172.21.15.53:0/2843981010 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa16c0b3ac0 msgr2=0x7fa16c0b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:13.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.637+0000 7fa169ffb640 1 --2- 172.21.15.53:0/2843981010 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa16c0b3ac0 0x7fa16c0b3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:13.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.637+0000 7fa169ffb640 1 -- 172.21.15.53:0/2843981010 >> v2:172.21.15.117:3300/0 conn(0x7fa16c0cc690 msgr2=0x7fa16c15f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:13.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.637+0000 7fa169ffb640 1 --2- 172.21.15.53:0/2843981010 >> v2:172.21.15.117:3300/0 conn(0x7fa16c0cc690 0x7fa16c15f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:13.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.637+0000 7fa169ffb640 1 -- 172.21.15.53:0/2843981010 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa16c0cf220 con 0x7fa16c0ccae0 2023-06-10T19:03:13.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.637+0000 7fa169ffb640 1 -- 172.21.15.53:0/2843981010 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fa164001a00 con 0x7fa16c0ccae0 2023-06-10T19:03:13.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.637+0000 7fa169ffb640 1 -- 172.21.15.53:0/2843981010 >> v1:172.21.15.53:6789/0 conn(0x7fa16c0ccae0 legacy=0x7fa16c15f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:13.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.637+0000 7fa169ffb640 1 --2- 172.21.15.53:0/2843981010 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa16c0b3ac0 0x7fa1540039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:13.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.637+0000 7fa169ffb640 1 --2- 172.21.15.53:0/2843981010 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa154003f70 0x7fa1540047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:13.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.637+0000 7fa169ffb640 1 --2- 172.21.15.53:0/2843981010 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa154004d10 0x7fa154005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:13.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.637+0000 7fa169ffb640 1 -- 172.21.15.53:0/2843981010 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa16c0b43d0 con 0x7fa154004d10 2023-06-10T19:03:13.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.637+0000 7fa169ffb640 1 -- 172.21.15.53:0/2843981010 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa16c0cef40 con 0x7fa154003f70 2023-06-10T19:03:13.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.637+0000 7fa169ffb640 1 -- 172.21.15.53:0/2843981010 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa15400b990 con 0x7fa16c0b3ac0 2023-06-10T19:03:13.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.637+0000 7fa16b7fe640 1 --2- 172.21.15.53:0/2843981010 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa154004d10 0x7fa154005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:13.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.637+0000 7fa16affd640 1 --2- 172.21.15.53:0/2843981010 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa16c0b3ac0 0x7fa1540039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:13.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.637+0000 7fa16a7fc640 1 --2- 172.21.15.53:0/2843981010 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa154003f70 0x7fa1540047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:13.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.637+0000 7fa16b7fe640 1 -- 172.21.15.53:0/2843981010 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa16c0b3ac0 msgr2=0x7fa1540039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:13.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.637+0000 7fa16b7fe640 1 --2- 172.21.15.53:0/2843981010 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa16c0b3ac0 0x7fa1540039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:13.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.637+0000 7fa16b7fe640 1 -- 172.21.15.53:0/2843981010 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa154003f70 msgr2=0x7fa1540047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:13.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.637+0000 7fa16b7fe640 1 --2- 172.21.15.53:0/2843981010 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa154003f70 0x7fa1540047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:13.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.637+0000 7fa16b7fe640 1 -- 172.21.15.53:0/2843981010 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa154003530 con 0x7fa154004d10 2023-06-10T19:03:13.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.637+0000 7fa16a7fc640 1 --2- 172.21.15.53:0/2843981010 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa154003f70 0x7fa1540047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:03:13.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.641+0000 7fa16b7fe640 1 --2- 172.21.15.53:0/2843981010 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa154004d10 0x7fa154005180 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7fa16400a8b0 tx=0x7fa16401d380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e58a56072406309c server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:13.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.641+0000 7fa169ffb640 1 -- 172.21.15.53:0/2843981010 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1640ad630 con 0x7fa154004d10 2023-06-10T19:03:13.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.641+0000 7fa169ffb640 1 -- 172.21.15.53:0/2843981010 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1640a8070 con 0x7fa154004d10 2023-06-10T19:03:13.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.641+0000 7fa169ffb640 1 -- 172.21.15.53:0/2843981010 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1640ada30 con 0x7fa154004d10 2023-06-10T19:03:13.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.641+0000 7fa171a2b640 1 -- 172.21.15.53:0/2843981010 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa154004d10 msgr2=0x7fa154005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:13.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.641+0000 7fa171a2b640 1 --2- 172.21.15.53:0/2843981010 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa154004d10 0x7fa154005180 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7fa16400a8b0 tx=0x7fa16401d380 comp rx=0 tx=0).stop 2023-06-10T19:03:13.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.641+0000 7fa16b7fe640 1 -- 172.21.15.53:0/2843981010 reap_dead start 2023-06-10T19:03:13.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.641+0000 7fa171a2b640 1 -- 172.21.15.53:0/2843981010 shutdown_connections 2023-06-10T19:03:13.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.641+0000 7fa171a2b640 1 -- 172.21.15.53:0/2843981010 >> 172.21.15.53:0/2843981010 conn(0x7fa16c071790 msgr2=0x7fa16c069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:13.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.641+0000 7fa171a2b640 1 -- 172.21.15.53:0/2843981010 shutdown_connections 2023-06-10T19:03:13.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.641+0000 7fa171a2b640 1 -- 172.21.15.53:0/2843981010 wait complete. 2023-06-10T19:03:13.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.641+0000 7fa171a2b640 1 Processor -- start 2023-06-10T19:03:13.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.641+0000 7fa171a2b640 1 -- start start 2023-06-10T19:03:13.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.641+0000 7fa171a2b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa154004d10 0x7fa16c15e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:13.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.641+0000 7fa171a2b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa16c150060 0x7fa16c0c95b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:13.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.641+0000 7fa171a2b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa16c0c9af0 0x7fa16c0b2730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:13.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.641+0000 7fa171a2b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa16c15ed30 con 0x7fa16c0c9af0 2023-06-10T19:03:13.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.641+0000 7fa171a2b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa16c0caca0 con 0x7fa154004d10 2023-06-10T19:03:13.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.641+0000 7fa171a2b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa16c15d470 con 0x7fa16c150060 2023-06-10T19:03:13.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.641+0000 7fa16b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa16c0c9af0 0x7fa16c0b2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:13.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.641+0000 7fa16b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa16c0c9af0 0x7fa16c0b2730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57318/0 (socket says 172.21.15.53:57318) 2023-06-10T19:03:13.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.641+0000 7fa16b7fe640 1 -- 172.21.15.53:0/2240955425 learned_addr learned my addr 172.21.15.53:0/2240955425 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:13.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.645+0000 7fa16a7fc640 1 --2- 172.21.15.53:0/2240955425 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa16c150060 0x7fa16c0c95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:13.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.645+0000 7fa16affd640 1 --2- 172.21.15.53:0/2240955425 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa154004d10 0x7fa16c15e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:13.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.645+0000 7fa16b7fe640 1 -- 172.21.15.53:0/2240955425 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa16c150060 msgr2=0x7fa16c0c95b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:13.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.645+0000 7fa16b7fe640 1 --2- 172.21.15.53:0/2240955425 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa16c150060 0x7fa16c0c95b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:13.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.645+0000 7fa16b7fe640 1 -- 172.21.15.53:0/2240955425 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa154004d10 msgr2=0x7fa16c15e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:13.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.645+0000 7fa16b7fe640 1 --2- 172.21.15.53:0/2240955425 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa154004d10 0x7fa16c15e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:13.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.645+0000 7fa16b7fe640 1 -- 172.21.15.53:0/2240955425 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa16c15d750 con 0x7fa16c0c9af0 2023-06-10T19:03:13.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.645+0000 7fa16b7fe640 1 --2- 172.21.15.53:0/2240955425 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa16c0c9af0 0x7fa16c0b2730 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7fa16400a8b0 tx=0x7fa154005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:13.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.645+0000 7fa153fff640 1 -- 172.21.15.53:0/2240955425 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1640017c0 con 0x7fa16c0c9af0 2023-06-10T19:03:13.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.645+0000 7fa153fff640 1 -- 172.21.15.53:0/2240955425 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa164001920 con 0x7fa16c0c9af0 2023-06-10T19:03:13.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.645+0000 7fa171a2b640 1 -- 172.21.15.53:0/2240955425 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa16c15da30 con 0x7fa16c0c9af0 2023-06-10T19:03:13.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.645+0000 7fa153fff640 1 -- 172.21.15.53:0/2240955425 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa164004d90 con 0x7fa16c0c9af0 2023-06-10T19:03:13.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.645+0000 7fa171a2b640 1 -- 172.21.15.53:0/2240955425 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa16c15dff0 con 0x7fa16c0c9af0 2023-06-10T19:03:13.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.645+0000 7fa171a2b640 1 -- 172.21.15.53:0/2240955425 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa16c04d790 con 0x7fa16c0c9af0 2023-06-10T19:03:13.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.645+0000 7fa153fff640 1 -- 172.21.15.53:0/2240955425 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa1640aa030 con 0x7fa16c0c9af0 2023-06-10T19:03:13.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.645+0000 7fa153fff640 1 --2- 172.21.15.53:0/2240955425 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa1580662b0 0x7fa158068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:13.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.645+0000 7fa153fff640 1 -- 172.21.15.53:0/2240955425 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6264+0+0 (secure 0 0 0) 0x7fa16411df20 con 0x7fa16c0c9af0 2023-06-10T19:03:13.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.645+0000 7fa16affd640 1 --2- 172.21.15.53:0/2240955425 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa1580662b0 0x7fa158068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:13.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.645+0000 7fa16affd640 1 --2- 172.21.15.53:0/2240955425 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa1580662b0 0x7fa158068760 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fa16c0b3320 tx=0x7fa15c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:13.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.649+0000 7fa153fff640 1 -- 172.21.15.53:0/2240955425 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa1640eb1a0 con 0x7fa16c0c9af0 2023-06-10T19:03:13.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.841+0000 7fa171a2b640 1 -- 172.21.15.53:0/2240955425 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa16c0b47e0 con 0x7fa16c0c9af0 2023-06-10T19:03:13.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.845+0000 7fa153fff640 1 -- 172.21.15.53:0/2240955425 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+4683 (secure 0 0 0) 0x7fa1640bc020 con 0x7fa16c0c9af0 2023-06-10T19:03:13.848 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:03:13.848 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1617157670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1617157670},{"type":"v1","addr":"172.21.15.117:6836","nonce":1617157670}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6113,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3414416090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":3414416090},{"type":"v1","addr":"172.21.15.117:6837","nonce":3414416090}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6718,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2533467097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2533467097},{"type":"v1","addr":"172.21.15.53:6835","nonce":2533467097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:02:02.642809+0000","modified":"2023-06-10T19:02:36.149418+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8127":{"gid":8127,"name":"a","rank":0,"incarnation":52,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.53:6833/2984379521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2984379521},{"type":"v1","addr":"172.21.15.53:6833","nonce":2984379521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-06-10T19:03:13.848 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 53 2023-06-10T19:03:13.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.845+0000 7fa171a2b640 1 -- 172.21.15.53:0/2240955425 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa1580662b0 msgr2=0x7fa158068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:13.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.845+0000 7fa171a2b640 1 --2- 172.21.15.53:0/2240955425 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa1580662b0 0x7fa158068760 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fa16c0b3320 tx=0x7fa15c008040 comp rx=0 tx=0).stop 2023-06-10T19:03:13.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.845+0000 7fa171a2b640 1 -- 172.21.15.53:0/2240955425 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa16c0c9af0 msgr2=0x7fa16c0b2730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:13.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.845+0000 7fa171a2b640 1 --2- 172.21.15.53:0/2240955425 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa16c0c9af0 0x7fa16c0b2730 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7fa16400a8b0 tx=0x7fa154005800 comp rx=0 tx=0).stop 2023-06-10T19:03:13.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.845+0000 7fa171a2b640 1 -- 172.21.15.53:0/2240955425 shutdown_connections 2023-06-10T19:03:13.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.845+0000 7fa171a2b640 1 --2- 172.21.15.53:0/2240955425 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa1580662b0 0x7fa158068760 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:13.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.845+0000 7fa171a2b640 1 --2- 172.21.15.53:0/2240955425 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa16c0c9af0 0x7fa16c0b2730 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:13.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.845+0000 7fa171a2b640 1 --2- 172.21.15.53:0/2240955425 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa16c150060 0x7fa16c0c95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:13.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.845+0000 7fa171a2b640 1 --2- 172.21.15.53:0/2240955425 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa154004d10 0x7fa16c15e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:13.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.845+0000 7fa171a2b640 1 -- 172.21.15.53:0/2240955425 >> 172.21.15.53:0/2240955425 conn(0x7fa16c071790 msgr2=0x7fa16c15f910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:13.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.845+0000 7fa171a2b640 1 -- 172.21.15.53:0/2240955425 shutdown_connections 2023-06-10T19:03:13.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:13.845+0000 7fa171a2b640 1 -- 172.21.15.53:0/2240955425 wait complete. 2023-06-10T19:03:13.867 DEBUG:tasks.cephfs.filesystem:mapped states ['up:reconnect'] to None 2023-06-10T19:03:14.869 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:03:15.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:15.001+0000 7f6b20af2640 1 Processor -- start 2023-06-10T19:03:15.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:15.001+0000 7f6b20af2640 1 -- start start 2023-06-10T19:03:15.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:15.001+0000 7f6b20af2640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6b1c0c9840 0x7f6b1c0c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:15.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:15.001+0000 7f6b20af2640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6b1c06b090 0x7f6b1c06b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:15.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:15.001+0000 7f6b20af2640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b1c159b50 con 0x7f6b1c071060 2023-06-10T19:03:15.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:15.001+0000 7f6b20af2640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b1c0ca150 con 0x7f6b1c06b090 2023-06-10T19:03:15.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:15.001+0000 7f6b20af2640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b1c0702a0 con 0x7f6b1c0c9840 2023-06-10T19:03:15.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:15.001+0000 7f6b1ad9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6b1c06b090 0x7f6b1c06b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:15.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:15.001+0000 7f6b19d9b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f6b1c071060 0x7f6b1c0af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:45500/0 (socket says 172.21.15.53:45500) 2023-06-10T19:03:15.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:15.001+0000 7f6b19d9b640 1 -- 172.21.15.53:0/3513295865 learned_addr learned my addr 172.21.15.53:0/3513295865 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:03:15.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:15.001+0000 7f6b1a59c640 1 --2- 172.21.15.53:0/3513295865 >> v2:172.21.15.117:3300/0 conn(0x7f6b1c0c9840 0x7f6b1c0c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:15.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:15.001+0000 7f6b1959a640 1 -- 172.21.15.53:0/3513295865 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2851647468 0 0) 0x7f6b1c159b50 con 0x7f6b1c071060 2023-06-10T19:03:15.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:15.001+0000 7f6b1959a640 1 -- 172.21.15.53:0/3513295865 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b04003530 con 0x7f6b1c071060 2023-06-10T19:03:15.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:15.001+0000 7f6b1ad9d640 1 -- 172.21.15.53:0/3513295865 >> v2:172.21.15.117:3300/0 conn(0x7f6b1c0c9840 msgr2=0x7f6b1c0c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:15.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:15.001+0000 7f6b1ad9d640 1 --2- 172.21.15.53:0/3513295865 >> v2:172.21.15.117:3300/0 conn(0x7f6b1c0c9840 0x7f6b1c0c9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:15.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:15.001+0000 7f6b1ad9d640 1 -- 172.21.15.53:0/3513295865 >> v1:172.21.15.53:6789/0 conn(0x7f6b1c071060 legacy=0x7f6b1c0af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:15.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:15.001+0000 7f6b1ad9d640 1 -- 172.21.15.53:0/3513295865 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b1c070580 con 0x7f6b1c06b090 2023-06-10T19:03:15.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:15.001+0000 7f6b1a59c640 1 --2- 172.21.15.53:0/3513295865 >> v2:172.21.15.117:3300/0 conn(0x7f6b1c0c9840 0x7f6b1c0c9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:03:15.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:15.005+0000 7f6b1ad9d640 1 --2- 172.21.15.53:0/3513295865 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b1c06b090 0x7f6b1c06b510 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c071d80 tx=0x7f6b1401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=684d19f81a951ceb server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:15.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:15.005+0000 7f6b1959a640 1 -- 172.21.15.53:0/3513295865 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b140a59a0 con 0x7f6b1c06b090 2023-06-10T19:03:15.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:15.005+0000 7f6b1959a640 1 -- 172.21.15.53:0/3513295865 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b140a5b00 con 0x7f6b1c06b090 2023-06-10T19:03:15.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:15.005+0000 7f6b1959a640 1 -- 172.21.15.53:0/3513295865 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b140a5e90 con 0x7f6b1c06b090 2023-06-10T19:03:15.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:15.005+0000 7f6b20af2640 1 -- 172.21.15.53:0/3513295865 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b1c06b090 msgr2=0x7f6b1c06b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:15.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:15.005+0000 7f6b20af2640 1 --2- 172.21.15.53:0/3513295865 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b1c06b090 0x7f6b1c06b510 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c071d80 tx=0x7f6b1401c8e0 comp rx=0 tx=0).stop 2023-06-10T19:03:15.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:15.005+0000 7f6b20af2640 1 -- 172.21.15.53:0/3513295865 shutdown_connections 2023-06-10T19:03:15.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:15.005+0000 7f6b20af2640 1 --2- 172.21.15.53:0/3513295865 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b1c06b090 0x7f6b1c06b510 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:15.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:15.005+0000 7f6b20af2640 1 --2- 172.21.15.53:0/3513295865 >> v2:172.21.15.117:3300/0 conn(0x7f6b1c0c9840 0x7f6b1c0c9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:15.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:15.005+0000 7f6b20af2640 1 -- 172.21.15.53:0/3513295865 >> 172.21.15.53:0/3513295865 conn(0x7f6b1c06a0d0 msgr2=0x7f6b1c0ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:15.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:15.005+0000 7f6b20af2640 1 -- 172.21.15.53:0/3513295865 shutdown_connections 2023-06-10T19:03:15.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:15.005+0000 7f6b20af2640 1 -- 172.21.15.53:0/3513295865 wait complete. 2023-06-10T19:03:15.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:15.005+0000 7f6b20af2640 1 Processor -- start 2023-06-10T19:03:15.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:15.005+0000 7f6b20af2640 1 -- start start 2023-06-10T19:03:15.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:15.005+0000 7f6b20af2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b1c06b090 0x7f6b1c14d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:15.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:15.005+0000 7f6b20af2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b1c071060 0x7f6b1c15d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:15.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:15.005+0000 7f6b20af2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b1c0c9840 0x7f6b1c0b2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:15.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:15.005+0000 7f6b20af2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1c0c2df0 con 0x7f6b1c071060 2023-06-10T19:03:15.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:15.005+0000 7f6b20af2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1c14d6d0 con 0x7f6b1c0c9840 2023-06-10T19:03:15.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:15.005+0000 7f6b20af2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1c0c21e0 con 0x7f6b1c06b090 2023-06-10T19:03:15.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:15.005+0000 7f6b19d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b1c071060 0x7f6b1c15d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:15.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:15.005+0000 7f6b19d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b1c071060 0x7f6b1c15d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57344/0 (socket says 172.21.15.53:57344) 2023-06-10T19:03:15.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:15.005+0000 7f6b19d9b640 1 -- 172.21.15.53:0/2136661163 learned_addr learned my addr 172.21.15.53:0/2136661163 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:15.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:15.005+0000 7f6b1ad9d640 1 --2- 172.21.15.53:0/2136661163 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b1c0c9840 0x7f6b1c0b2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:15.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:15.005+0000 7f6b1a59c640 1 --2- 172.21.15.53:0/2136661163 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b1c06b090 0x7f6b1c14d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:15.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:15.005+0000 7f6b19d9b640 1 -- 172.21.15.53:0/2136661163 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b1c06b090 msgr2=0x7f6b1c14d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:15.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:15.005+0000 7f6b19d9b640 1 --2- 172.21.15.53:0/2136661163 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b1c06b090 0x7f6b1c14d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:15.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:15.005+0000 7f6b19d9b640 1 -- 172.21.15.53:0/2136661163 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b1c0c9840 msgr2=0x7f6b1c0b2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:15.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:15.005+0000 7f6b19d9b640 1 --2- 172.21.15.53:0/2136661163 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b1c0c9840 0x7f6b1c0b2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:15.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:15.005+0000 7f6b19d9b640 1 -- 172.21.15.53:0/2136661163 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b14009a70 con 0x7f6b1c071060 2023-06-10T19:03:15.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:15.009+0000 7f6b19d9b640 1 --2- 172.21.15.53:0/2136661163 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b1c071060 0x7f6b1c15d800 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f6b10001ec0 tx=0x7f6b1000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:15.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:15.009+0000 7f6b0affd640 1 -- 172.21.15.53:0/2136661163 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b10005d50 con 0x7f6b1c071060 2023-06-10T19:03:15.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:15.009+0000 7f6b0affd640 1 -- 172.21.15.53:0/2136661163 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b10007070 con 0x7f6b1c071060 2023-06-10T19:03:15.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:15.009+0000 7f6b20af2640 1 -- 172.21.15.53:0/2136661163 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b1c0c24c0 con 0x7f6b1c071060 2023-06-10T19:03:15.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:15.009+0000 7f6b0affd640 1 -- 172.21.15.53:0/2136661163 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b10007420 con 0x7f6b1c071060 2023-06-10T19:03:15.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:15.009+0000 7f6b20af2640 1 -- 172.21.15.53:0/2136661163 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b1c0c2a80 con 0x7f6b1c071060 2023-06-10T19:03:15.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:15.009+0000 7f6b20af2640 1 -- 172.21.15.53:0/2136661163 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b1c0c2f60 con 0x7f6b1c071060 2023-06-10T19:03:15.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:15.009+0000 7f6b0affd640 1 -- 172.21.15.53:0/2136661163 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6b10007580 con 0x7f6b1c071060 2023-06-10T19:03:15.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:15.009+0000 7f6b0affd640 1 --2- 172.21.15.53:0/2136661163 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6afc0662b0 0x7f6afc068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:15.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:15.009+0000 7f6b0affd640 1 -- 172.21.15.53:0/2136661163 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6264+0+0 (secure 0 0 0) 0x7f6b10083380 con 0x7f6b1c071060 2023-06-10T19:03:15.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:15.009+0000 7f6b1a59c640 1 --2- 172.21.15.53:0/2136661163 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6afc0662b0 0x7f6afc068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:15.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:15.009+0000 7f6b1a59c640 1 --2- 172.21.15.53:0/2136661163 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6afc0662b0 0x7f6afc068760 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c00ba10 tx=0x7f6b0c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:15.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:15.013+0000 7f6b0affd640 1 -- 172.21.15.53:0/2136661163 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6b100507f0 con 0x7f6b1c071060 2023-06-10T19:03:15.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:15.205+0000 7f6b20af2640 1 -- 172.21.15.53:0/2136661163 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6b1c04d790 con 0x7f6b1c071060 2023-06-10T19:03:15.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:15.205+0000 7f6b0affd640 1 -- 172.21.15.53:0/2136661163 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+4683 (secure 0 0 0) 0x7f6b10053e10 con 0x7f6b1c071060 2023-06-10T19:03:15.209 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:03:15.209 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1617157670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1617157670},{"type":"v1","addr":"172.21.15.117:6836","nonce":1617157670}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6113,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3414416090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":3414416090},{"type":"v1","addr":"172.21.15.117:6837","nonce":3414416090}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6718,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2533467097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2533467097},{"type":"v1","addr":"172.21.15.53:6835","nonce":2533467097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:02:02.642809+0000","modified":"2023-06-10T19:02:36.149418+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8127":{"gid":8127,"name":"a","rank":0,"incarnation":52,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.53:6833/2984379521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2984379521},{"type":"v1","addr":"172.21.15.53:6833","nonce":2984379521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-06-10T19:03:15.210 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 53 2023-06-10T19:03:15.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:15.205+0000 7f6b20af2640 1 -- 172.21.15.53:0/2136661163 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6afc0662b0 msgr2=0x7f6afc068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:15.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:15.205+0000 7f6b20af2640 1 --2- 172.21.15.53:0/2136661163 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6afc0662b0 0x7f6afc068760 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c00ba10 tx=0x7f6b0c008040 comp rx=0 tx=0).stop 2023-06-10T19:03:15.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:15.205+0000 7f6b20af2640 1 -- 172.21.15.53:0/2136661163 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b1c071060 msgr2=0x7f6b1c15d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:15.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:15.205+0000 7f6b20af2640 1 --2- 172.21.15.53:0/2136661163 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b1c071060 0x7f6b1c15d800 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f6b10001ec0 tx=0x7f6b1000c960 comp rx=0 tx=0).stop 2023-06-10T19:03:15.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:15.209+0000 7f6b20af2640 1 -- 172.21.15.53:0/2136661163 shutdown_connections 2023-06-10T19:03:15.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:15.209+0000 7f6b20af2640 1 --2- 172.21.15.53:0/2136661163 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6afc0662b0 0x7f6afc068760 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:15.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:15.209+0000 7f6b20af2640 1 --2- 172.21.15.53:0/2136661163 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b1c0c9840 0x7f6b1c0b2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:15.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:15.209+0000 7f6b20af2640 1 --2- 172.21.15.53:0/2136661163 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b1c071060 0x7f6b1c15d800 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:15.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:15.209+0000 7f6b20af2640 1 --2- 172.21.15.53:0/2136661163 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b1c06b090 0x7f6b1c14d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:15.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:15.209+0000 7f6b20af2640 1 -- 172.21.15.53:0/2136661163 >> 172.21.15.53:0/2136661163 conn(0x7f6b1c06a0d0 msgr2=0x7f6b1c0c8720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:15.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:15.209+0000 7f6b20af2640 1 -- 172.21.15.53:0/2136661163 shutdown_connections 2023-06-10T19:03:15.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:15.209+0000 7f6b20af2640 1 -- 172.21.15.53:0/2136661163 wait complete. 2023-06-10T19:03:15.227 DEBUG:tasks.cephfs.filesystem:mapped states ['up:reconnect'] to None 2023-06-10T19:03:16.228 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:03:16.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.361+0000 7f61d1253640 1 Processor -- start 2023-06-10T19:03:16.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.361+0000 7f61d1253640 1 -- start start 2023-06-10T19:03:16.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.361+0000 7f61d1253640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f61cc0b3ac0 0x7f61cc0b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:16.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.361+0000 7f61d1253640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61cc0d14c0 0x7f61cc15fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:16.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.361+0000 7f61d1253640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61cc0d0020 con 0x7f61cc0cc690 2023-06-10T19:03:16.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.361+0000 7f61d1253640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61cc0b43d0 con 0x7f61cc0b3ac0 2023-06-10T19:03:16.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.361+0000 7f61d1253640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61cc0cef40 con 0x7f61cc0d14c0 2023-06-10T19:03:16.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.361+0000 7f61ca59c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f61cc0cc690 0x7f61cc15f370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:45514/0 (socket says 172.21.15.53:45514) 2023-06-10T19:03:16.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.361+0000 7f61ca59c640 1 -- 172.21.15.53:0/3419724002 learned_addr learned my addr 172.21.15.53:0/3419724002 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:03:16.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.361+0000 7f61cb59e640 1 --2- 172.21.15.53:0/3419724002 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61cc0d14c0 0x7f61cc15fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:16.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.361+0000 7f61cad9d640 1 --2- 172.21.15.53:0/3419724002 >> v2:172.21.15.117:3300/0 conn(0x7f61cc0b3ac0 0x7f61cc0b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:16.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.361+0000 7f61c9d9b640 1 -- 172.21.15.53:0/3419724002 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2296234590 0 0) 0x7f61cc0d0020 con 0x7f61cc0cc690 2023-06-10T19:03:16.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.361+0000 7f61c9d9b640 1 -- 172.21.15.53:0/3419724002 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61ac003530 con 0x7f61cc0cc690 2023-06-10T19:03:16.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.361+0000 7f61c9d9b640 1 -- 172.21.15.53:0/3419724002 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 358414757 0 0) 0x7f61ac003530 con 0x7f61cc0cc690 2023-06-10T19:03:16.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.361+0000 7f61c9d9b640 1 -- 172.21.15.53:0/3419724002 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61cc0d14c0 msgr2=0x7f61cc15fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:16.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.361+0000 7f61c9d9b640 1 --2- 172.21.15.53:0/3419724002 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61cc0d14c0 0x7f61cc15fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:16.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.361+0000 7f61c9d9b640 1 -- 172.21.15.53:0/3419724002 >> v2:172.21.15.117:3300/0 conn(0x7f61cc0b3ac0 msgr2=0x7f61cc0b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:16.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.361+0000 7f61c9d9b640 1 --2- 172.21.15.53:0/3419724002 >> v2:172.21.15.117:3300/0 conn(0x7f61cc0b3ac0 0x7f61cc0b3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:16.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.361+0000 7f61c9d9b640 1 -- 172.21.15.53:0/3419724002 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61cc0cf220 con 0x7f61cc0cc690 2023-06-10T19:03:16.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.361+0000 7f61c9d9b640 1 -- 172.21.15.53:0/3419724002 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f61b4001a00 con 0x7f61cc0cc690 2023-06-10T19:03:16.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.361+0000 7f61c9d9b640 1 -- 172.21.15.53:0/3419724002 >> v1:172.21.15.53:6789/0 conn(0x7f61cc0cc690 legacy=0x7f61cc15f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:16.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.361+0000 7f61c9d9b640 1 --2- 172.21.15.53:0/3419724002 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61cc0d14c0 0x7f61ac0039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:16.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.361+0000 7f61c9d9b640 1 --2- 172.21.15.53:0/3419724002 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61ac003f70 0x7f61ac0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:16.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.361+0000 7f61c9d9b640 1 --2- 172.21.15.53:0/3419724002 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61ac004d10 0x7f61ac005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:16.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.361+0000 7f61c9d9b640 1 -- 172.21.15.53:0/3419724002 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61cc0b43d0 con 0x7f61ac004d10 2023-06-10T19:03:16.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.361+0000 7f61c9d9b640 1 -- 172.21.15.53:0/3419724002 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61cc0cef40 con 0x7f61ac003f70 2023-06-10T19:03:16.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.361+0000 7f61c9d9b640 1 -- 172.21.15.53:0/3419724002 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61ac00b990 con 0x7f61cc0d14c0 2023-06-10T19:03:16.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.361+0000 7f61cb59e640 1 --2- 172.21.15.53:0/3419724002 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61ac004d10 0x7f61ac005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:16.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.361+0000 7f61cad9d640 1 --2- 172.21.15.53:0/3419724002 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61cc0d14c0 0x7f61ac0039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:16.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.361+0000 7f61ca59c640 1 --2- 172.21.15.53:0/3419724002 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61ac003f70 0x7f61ac0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:16.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.361+0000 7f61cb59e640 1 -- 172.21.15.53:0/3419724002 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61cc0d14c0 msgr2=0x7f61ac0039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:16.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.361+0000 7f61cb59e640 1 --2- 172.21.15.53:0/3419724002 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61cc0d14c0 0x7f61ac0039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:16.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.361+0000 7f61cb59e640 1 -- 172.21.15.53:0/3419724002 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61ac003f70 msgr2=0x7f61ac0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:16.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.361+0000 7f61cb59e640 1 --2- 172.21.15.53:0/3419724002 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61ac003f70 0x7f61ac0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:16.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.361+0000 7f61cb59e640 1 -- 172.21.15.53:0/3419724002 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61ac003530 con 0x7f61ac004d10 2023-06-10T19:03:16.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.365+0000 7f61cb59e640 1 --2- 172.21.15.53:0/3419724002 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61ac004d10 0x7f61ac005180 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f61c4009b10 tx=0x7f61c401ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=916125153c111962 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:16.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.365+0000 7f61c9d9b640 1 -- 172.21.15.53:0/3419724002 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c40a5640 con 0x7f61ac004d10 2023-06-10T19:03:16.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.365+0000 7f61c9d9b640 1 -- 172.21.15.53:0/3419724002 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61c40a57a0 con 0x7f61ac004d10 2023-06-10T19:03:16.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.365+0000 7f61c9d9b640 1 -- 172.21.15.53:0/3419724002 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c40a5b50 con 0x7f61ac004d10 2023-06-10T19:03:16.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.365+0000 7f61d1253640 1 -- 172.21.15.53:0/3419724002 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61ac004d10 msgr2=0x7f61ac005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:16.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.365+0000 7f61d1253640 1 --2- 172.21.15.53:0/3419724002 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61ac004d10 0x7f61ac005180 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f61c4009b10 tx=0x7f61c401ca50 comp rx=0 tx=0).stop 2023-06-10T19:03:16.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.365+0000 7f61cb59e640 1 -- 172.21.15.53:0/3419724002 reap_dead start 2023-06-10T19:03:16.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.365+0000 7f61d1253640 1 -- 172.21.15.53:0/3419724002 shutdown_connections 2023-06-10T19:03:16.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.365+0000 7f61d1253640 1 -- 172.21.15.53:0/3419724002 >> 172.21.15.53:0/3419724002 conn(0x7f61cc071790 msgr2=0x7f61cc069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:16.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.365+0000 7f61d1253640 1 -- 172.21.15.53:0/3419724002 shutdown_connections 2023-06-10T19:03:16.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.365+0000 7f61d1253640 1 -- 172.21.15.53:0/3419724002 wait complete. 2023-06-10T19:03:16.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.365+0000 7f61d1253640 1 Processor -- start 2023-06-10T19:03:16.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.365+0000 7f61d1253640 1 -- start start 2023-06-10T19:03:16.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.369+0000 7f61d1253640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61ac004d10 0x7f61cc0c8340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:16.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.369+0000 7f61d1253640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61cc0c8880 0x7f61cc14cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:16.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.369+0000 7f61d1253640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61cc14d480 0x7f61cc14d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:16.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.369+0000 7f61d1253640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61cc14aeb0 con 0x7f61cc14d480 2023-06-10T19:03:16.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.369+0000 7f61d1253640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61cc14e3c0 con 0x7f61cc0c8880 2023-06-10T19:03:16.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.369+0000 7f61d1253640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61cc14b710 con 0x7f61ac004d10 2023-06-10T19:03:16.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.369+0000 7f61cb59e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61cc14d480 0x7f61cc14d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:16.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.369+0000 7f61cb59e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61cc14d480 0x7f61cc14d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57376/0 (socket says 172.21.15.53:57376) 2023-06-10T19:03:16.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.369+0000 7f61cb59e640 1 -- 172.21.15.53:0/177129799 learned_addr learned my addr 172.21.15.53:0/177129799 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:16.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.369+0000 7f61ca59c640 1 --2- 172.21.15.53:0/177129799 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61cc0c8880 0x7f61cc14cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:16.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.369+0000 7f61cad9d640 1 --2- 172.21.15.53:0/177129799 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61ac004d10 0x7f61cc0c8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:16.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.369+0000 7f61cb59e640 1 -- 172.21.15.53:0/177129799 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61ac004d10 msgr2=0x7f61cc0c8340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:16.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.369+0000 7f61cb59e640 1 --2- 172.21.15.53:0/177129799 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61ac004d10 0x7f61cc0c8340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:16.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.369+0000 7f61cb59e640 1 -- 172.21.15.53:0/177129799 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61cc0c8880 msgr2=0x7f61cc14cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:16.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.369+0000 7f61cb59e640 1 --2- 172.21.15.53:0/177129799 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61cc0c8880 0x7f61cc14cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:16.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.369+0000 7f61cb59e640 1 -- 172.21.15.53:0/177129799 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61cc0c8cd0 con 0x7f61cc14d480 2023-06-10T19:03:16.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.369+0000 7f61cad9d640 1 --2- 172.21.15.53:0/177129799 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61ac004d10 0x7f61cc0c8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:03:16.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.369+0000 7f61cb59e640 1 --2- 172.21.15.53:0/177129799 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61cc14d480 0x7f61cc14d8f0 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f61c4009b10 tx=0x7f61ac005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:16.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.369+0000 7f61c37fe640 1 -- 172.21.15.53:0/177129799 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c40ba070 con 0x7f61cc14d480 2023-06-10T19:03:16.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.369+0000 7f61c37fe640 1 -- 172.21.15.53:0/177129799 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61c4004020 con 0x7f61cc14d480 2023-06-10T19:03:16.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.369+0000 7f61d1253640 1 -- 172.21.15.53:0/177129799 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61cc0cbc20 con 0x7f61cc14d480 2023-06-10T19:03:16.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.369+0000 7f61c37fe640 1 -- 172.21.15.53:0/177129799 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c40a5640 con 0x7f61cc14d480 2023-06-10T19:03:16.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.369+0000 7f61d1253640 1 -- 172.21.15.53:0/177129799 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61cc14b3a0 con 0x7f61cc14d480 2023-06-10T19:03:16.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.369+0000 7f61d1253640 1 -- 172.21.15.53:0/177129799 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61cc04d790 con 0x7f61cc14d480 2023-06-10T19:03:16.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.369+0000 7f61c37fe640 1 -- 172.21.15.53:0/177129799 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f61c40b4070 con 0x7f61cc14d480 2023-06-10T19:03:16.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.369+0000 7f61c37fe640 1 --2- 172.21.15.53:0/177129799 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f61b0066280 0x7f61b0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:16.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.369+0000 7f61c37fe640 1 -- 172.21.15.53:0/177129799 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6264+0+0 (secure 0 0 0) 0x7f61c411dcb0 con 0x7f61cc14d480 2023-06-10T19:03:16.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.369+0000 7f61cad9d640 1 --2- 172.21.15.53:0/177129799 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f61b0066280 0x7f61b0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:16.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.373+0000 7f61cad9d640 1 --2- 172.21.15.53:0/177129799 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f61b0066280 0x7f61b0068730 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f61bc009aa0 tx=0x7f61bc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:16.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.377+0000 7f61c37fe640 1 -- 172.21.15.53:0/177129799 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f61c40eaf40 con 0x7f61cc14d480 2023-06-10T19:03:16.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.565+0000 7f61d1253640 1 -- 172.21.15.53:0/177129799 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f61cc0b47e0 con 0x7f61cc14d480 2023-06-10T19:03:16.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.565+0000 7f61c37fe640 1 -- 172.21.15.53:0/177129799 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+4683 (secure 0 0 0) 0x7f61c40b2020 con 0x7f61cc14d480 2023-06-10T19:03:16.569 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:03:16.569 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1617157670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1617157670},{"type":"v1","addr":"172.21.15.117:6836","nonce":1617157670}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6113,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3414416090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":3414416090},{"type":"v1","addr":"172.21.15.117:6837","nonce":3414416090}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6718,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2533467097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2533467097},{"type":"v1","addr":"172.21.15.53:6835","nonce":2533467097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:02:02.642809+0000","modified":"2023-06-10T19:02:36.149418+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8127":{"gid":8127,"name":"a","rank":0,"incarnation":52,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.53:6833/2984379521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2984379521},{"type":"v1","addr":"172.21.15.53:6833","nonce":2984379521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-06-10T19:03:16.569 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 53 2023-06-10T19:03:16.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.565+0000 7f61d1253640 1 -- 172.21.15.53:0/177129799 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f61b0066280 msgr2=0x7f61b0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:16.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.565+0000 7f61d1253640 1 --2- 172.21.15.53:0/177129799 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f61b0066280 0x7f61b0068730 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f61bc009aa0 tx=0x7f61bc008040 comp rx=0 tx=0).stop 2023-06-10T19:03:16.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.565+0000 7f61d1253640 1 -- 172.21.15.53:0/177129799 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61cc14d480 msgr2=0x7f61cc14d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:16.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.565+0000 7f61d1253640 1 --2- 172.21.15.53:0/177129799 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61cc14d480 0x7f61cc14d8f0 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f61c4009b10 tx=0x7f61ac005800 comp rx=0 tx=0).stop 2023-06-10T19:03:16.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.565+0000 7f61d1253640 1 -- 172.21.15.53:0/177129799 shutdown_connections 2023-06-10T19:03:16.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.565+0000 7f61d1253640 1 --2- 172.21.15.53:0/177129799 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f61b0066280 0x7f61b0068730 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:16.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.565+0000 7f61d1253640 1 --2- 172.21.15.53:0/177129799 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61cc14d480 0x7f61cc14d8f0 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:16.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.565+0000 7f61d1253640 1 --2- 172.21.15.53:0/177129799 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61cc0c8880 0x7f61cc14cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:16.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.565+0000 7f61d1253640 1 --2- 172.21.15.53:0/177129799 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f61ac004d10 0x7f61cc0c8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:16.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.565+0000 7f61d1253640 1 -- 172.21.15.53:0/177129799 >> 172.21.15.53:0/177129799 conn(0x7f61cc071790 msgr2=0x7f61cc0b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:16.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.565+0000 7f61d1253640 1 -- 172.21.15.53:0/177129799 shutdown_connections 2023-06-10T19:03:16.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:16.569+0000 7f61d1253640 1 -- 172.21.15.53:0/177129799 wait complete. 2023-06-10T19:03:16.588 DEBUG:tasks.cephfs.filesystem:mapped states ['up:reconnect'] to None 2023-06-10T19:03:17.589 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:03:17.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.721+0000 7f36065e9640 1 Processor -- start 2023-06-10T19:03:17.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.721+0000 7f36065e9640 1 -- start start 2023-06-10T19:03:17.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.721+0000 7f36065e9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36000c9840 0x7f36000c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:17.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.721+0000 7f36065e9640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f360006b090 0x7f360006b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:17.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.721+0000 7f36065e9640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3600159b50 con 0x7f3600071060 2023-06-10T19:03:17.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.721+0000 7f36065e9640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36000ca150 con 0x7f360006b090 2023-06-10T19:03:17.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.721+0000 7f36065e9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36000702a0 con 0x7f36000c9840 2023-06-10T19:03:17.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.721+0000 7f35ff7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f3600071060 0x7f36000af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:45520/0 (socket says 172.21.15.53:45520) 2023-06-10T19:03:17.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.721+0000 7f35ff7fe640 1 -- 172.21.15.53:0/4208438282 learned_addr learned my addr 172.21.15.53:0/4208438282 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:03:17.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.721+0000 7f35fffff640 1 --2- 172.21.15.53:0/4208438282 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36000c9840 0x7f36000c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:17.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.721+0000 7f3604b86640 1 --2- 172.21.15.53:0/4208438282 >> v2:172.21.15.117:3300/0 conn(0x7f360006b090 0x7f360006b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:17.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.721+0000 7f35feffd640 1 -- 172.21.15.53:0/4208438282 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4041222755 0 0) 0x7f3600159b50 con 0x7f3600071060 2023-06-10T19:03:17.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.721+0000 7f35feffd640 1 -- 172.21.15.53:0/4208438282 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35e8003530 con 0x7f3600071060 2023-06-10T19:03:17.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.721+0000 7f35feffd640 1 -- 172.21.15.53:0/4208438282 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 305096531 0 0) 0x7f35e8003530 con 0x7f3600071060 2023-06-10T19:03:17.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.721+0000 7f35feffd640 1 -- 172.21.15.53:0/4208438282 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36000c9840 msgr2=0x7f36000c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:17.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.721+0000 7f35feffd640 1 --2- 172.21.15.53:0/4208438282 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36000c9840 0x7f36000c9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:17.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.721+0000 7f35feffd640 1 -- 172.21.15.53:0/4208438282 >> v2:172.21.15.117:3300/0 conn(0x7f360006b090 msgr2=0x7f360006b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:17.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.721+0000 7f35feffd640 1 --2- 172.21.15.53:0/4208438282 >> v2:172.21.15.117:3300/0 conn(0x7f360006b090 0x7f360006b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:17.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.721+0000 7f35feffd640 1 -- 172.21.15.53:0/4208438282 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3600070580 con 0x7f3600071060 2023-06-10T19:03:17.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.721+0000 7f35feffd640 1 -- 172.21.15.53:0/4208438282 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f35f4001680 con 0x7f3600071060 2023-06-10T19:03:17.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.721+0000 7f35fffff640 1 --2- 172.21.15.53:0/4208438282 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36000c9840 0x7f36000c9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-10T19:03:17.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.721+0000 7f35feffd640 1 -- 172.21.15.53:0/4208438282 >> v1:172.21.15.53:6789/0 conn(0x7f3600071060 legacy=0x7f36000af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:17.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.721+0000 7f35feffd640 1 --2- 172.21.15.53:0/4208438282 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35e80039f0 0x7f35e8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:17.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.721+0000 7f35feffd640 1 --2- 172.21.15.53:0/4208438282 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f35e80047d0 0x7f35e8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:17.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.721+0000 7f35feffd640 1 --2- 172.21.15.53:0/4208438282 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36000c9840 0x7f35e8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:17.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.721+0000 7f35feffd640 1 -- 172.21.15.53:0/4208438282 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36000ca150 con 0x7f35e80047d0 2023-06-10T19:03:17.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.721+0000 7f35feffd640 1 -- 172.21.15.53:0/4208438282 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36000702a0 con 0x7f35e80039f0 2023-06-10T19:03:17.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.721+0000 7f35feffd640 1 -- 172.21.15.53:0/4208438282 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35e800b990 con 0x7f36000c9840 2023-06-10T19:03:17.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.721+0000 7f35ff7fe640 1 --2- 172.21.15.53:0/4208438282 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f35e80047d0 0x7f35e8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:17.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.721+0000 7f35fffff640 1 --2- 172.21.15.53:0/4208438282 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35e80039f0 0x7f35e8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:17.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.721+0000 7f3604b86640 1 --2- 172.21.15.53:0/4208438282 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36000c9840 0x7f35e8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:17.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.721+0000 7f35ff7fe640 1 -- 172.21.15.53:0/4208438282 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36000c9840 msgr2=0x7f35e8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:17.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.721+0000 7f35ff7fe640 1 --2- 172.21.15.53:0/4208438282 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36000c9840 0x7f35e8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:17.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.721+0000 7f35ff7fe640 1 -- 172.21.15.53:0/4208438282 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35e80039f0 msgr2=0x7f35e8003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:17.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.721+0000 7f35ff7fe640 1 --2- 172.21.15.53:0/4208438282 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35e80039f0 0x7f35e8003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:17.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.721+0000 7f35ff7fe640 1 -- 172.21.15.53:0/4208438282 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35f0009a70 con 0x7f35e80047d0 2023-06-10T19:03:17.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.725+0000 7f35ff7fe640 1 --2- 172.21.15.53:0/4208438282 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f35e80047d0 0x7f35e8004c40 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f35f400c210 tx=0x7f35f401f390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a35064b058c5df95 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:17.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.725+0000 7f35feffd640 1 -- 172.21.15.53:0/4208438282 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f4005ae0 con 0x7f35e80047d0 2023-06-10T19:03:17.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.725+0000 7f35feffd640 1 -- 172.21.15.53:0/4208438282 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35f40ab070 con 0x7f35e80047d0 2023-06-10T19:03:17.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.725+0000 7f35feffd640 1 -- 172.21.15.53:0/4208438282 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f4005ea0 con 0x7f35e80047d0 2023-06-10T19:03:17.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.725+0000 7f36065e9640 1 -- 172.21.15.53:0/4208438282 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f35e80047d0 msgr2=0x7f35e8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:17.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.725+0000 7f36065e9640 1 --2- 172.21.15.53:0/4208438282 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f35e80047d0 0x7f35e8004c40 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f35f400c210 tx=0x7f35f401f390 comp rx=0 tx=0).stop 2023-06-10T19:03:17.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.725+0000 7f3604b86640 1 -- 172.21.15.53:0/4208438282 reap_dead start 2023-06-10T19:03:17.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.725+0000 7f36065e9640 1 -- 172.21.15.53:0/4208438282 shutdown_connections 2023-06-10T19:03:17.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.725+0000 7f36065e9640 1 -- 172.21.15.53:0/4208438282 >> 172.21.15.53:0/4208438282 conn(0x7f360006a0d0 msgr2=0x7f36000ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:17.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.725+0000 7f36065e9640 1 -- 172.21.15.53:0/4208438282 shutdown_connections 2023-06-10T19:03:17.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.725+0000 7f36065e9640 1 -- 172.21.15.53:0/4208438282 wait complete. 2023-06-10T19:03:17.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.725+0000 7f36065e9640 1 Processor -- start 2023-06-10T19:03:17.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.725+0000 7f36065e9640 1 -- start start 2023-06-10T19:03:17.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.729+0000 7f36065e9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3600149ca0 0x7f36000c62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:17.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.729+0000 7f36065e9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36001f37f0 0x7f36000b2d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:17.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.729+0000 7f36065e9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36000b3290 0x7f36000c4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:17.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.729+0000 7f36065e9640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36000b3730 con 0x7f36001f37f0 2023-06-10T19:03:17.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.729+0000 7f36065e9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36000c6970 con 0x7f3600149ca0 2023-06-10T19:03:17.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.729+0000 7f36065e9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36000c6c50 con 0x7f36000b3290 2023-06-10T19:03:17.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.729+0000 7f35ff7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36001f37f0 0x7f36000b2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:17.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.729+0000 7f35ff7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36001f37f0 0x7f36000b2d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57402/0 (socket says 172.21.15.53:57402) 2023-06-10T19:03:17.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.729+0000 7f35ff7fe640 1 -- 172.21.15.53:0/3643986759 learned_addr learned my addr 172.21.15.53:0/3643986759 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:17.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.729+0000 7f35fffff640 1 --2- 172.21.15.53:0/3643986759 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3600149ca0 0x7f36000c62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:17.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.729+0000 7f3604b86640 1 --2- 172.21.15.53:0/3643986759 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36000b3290 0x7f36000c4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:17.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.729+0000 7f35ff7fe640 1 -- 172.21.15.53:0/3643986759 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36000b3290 msgr2=0x7f36000c4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:17.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.729+0000 7f35ff7fe640 1 --2- 172.21.15.53:0/3643986759 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36000b3290 0x7f36000c4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:17.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.729+0000 7f35ff7fe640 1 -- 172.21.15.53:0/3643986759 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3600149ca0 msgr2=0x7f36000c62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:17.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.729+0000 7f35ff7fe640 1 --2- 172.21.15.53:0/3643986759 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3600149ca0 0x7f36000c62e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:17.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.729+0000 7f35ff7fe640 1 -- 172.21.15.53:0/3643986759 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36000c6f30 con 0x7f36001f37f0 2023-06-10T19:03:17.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.729+0000 7f3604b86640 1 --2- 172.21.15.53:0/3643986759 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36000b3290 0x7f36000c4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:03:17.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.729+0000 7f35ff7fe640 1 --2- 172.21.15.53:0/3643986759 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36001f37f0 0x7f36000b2d50 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f35f4000c10 tx=0x7f35e8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:17.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.729+0000 7f35fcff9640 1 -- 172.21.15.53:0/3643986759 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f40b6070 con 0x7f36001f37f0 2023-06-10T19:03:17.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.729+0000 7f35fcff9640 1 -- 172.21.15.53:0/3643986759 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35f4004970 con 0x7f36001f37f0 2023-06-10T19:03:17.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.729+0000 7f36065e9640 1 -- 172.21.15.53:0/3643986759 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36000c7210 con 0x7f36001f37f0 2023-06-10T19:03:17.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.729+0000 7f35fcff9640 1 -- 172.21.15.53:0/3643986759 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f4004ce0 con 0x7f36001f37f0 2023-06-10T19:03:17.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.729+0000 7f36065e9640 1 -- 172.21.15.53:0/3643986759 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36001f3c60 con 0x7f36001f37f0 2023-06-10T19:03:17.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.729+0000 7f36065e9640 1 -- 172.21.15.53:0/3643986759 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36000c7450 con 0x7f36001f37f0 2023-06-10T19:03:17.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.729+0000 7f35fcff9640 1 -- 172.21.15.53:0/3643986759 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f35f40ad020 con 0x7f36001f37f0 2023-06-10T19:03:17.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.729+0000 7f35fcff9640 1 --2- 172.21.15.53:0/3643986759 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f35ec066280 0x7f35ec068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:17.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.729+0000 7f35fcff9640 1 -- 172.21.15.53:0/3643986759 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6264+0+0 (secure 0 0 0) 0x7f35f4120910 con 0x7f36001f37f0 2023-06-10T19:03:17.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.729+0000 7f35fffff640 1 --2- 172.21.15.53:0/3643986759 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f35ec066280 0x7f35ec068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:17.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.733+0000 7f35fffff640 1 --2- 172.21.15.53:0/3643986759 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f35ec066280 0x7f35ec068730 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f36001f2ee0 tx=0x7f35f000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:17.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.733+0000 7f35fcff9640 1 -- 172.21.15.53:0/3643986759 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f36000c7450 con 0x7f36001f37f0 2023-06-10T19:03:17.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.921+0000 7f36065e9640 1 -- 172.21.15.53:0/3643986759 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f36000c6d90 con 0x7f36001f37f0 2023-06-10T19:03:18.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.921+0000 7f35fcff9640 1 -- 172.21.15.53:0/3643986759 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+4683 (secure 0 0 0) 0x7f36000c6d90 con 0x7f36001f37f0 2023-06-10T19:03:18.004 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:03:18.004 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1617157670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1617157670},{"type":"v1","addr":"172.21.15.117:6836","nonce":1617157670}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6113,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3414416090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":3414416090},{"type":"v1","addr":"172.21.15.117:6837","nonce":3414416090}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6718,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2533467097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2533467097},{"type":"v1","addr":"172.21.15.53:6835","nonce":2533467097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:02:02.642809+0000","modified":"2023-06-10T19:02:36.149418+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8127":{"gid":8127,"name":"a","rank":0,"incarnation":52,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.53:6833/2984379521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2984379521},{"type":"v1","addr":"172.21.15.53:6833","nonce":2984379521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-06-10T19:03:18.005 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 53 2023-06-10T19:03:18.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.925+0000 7f36065e9640 1 -- 172.21.15.53:0/3643986759 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f35ec066280 msgr2=0x7f35ec068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:18.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.925+0000 7f36065e9640 1 --2- 172.21.15.53:0/3643986759 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f35ec066280 0x7f35ec068730 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f36001f2ee0 tx=0x7f35f000b040 comp rx=0 tx=0).stop 2023-06-10T19:03:18.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.925+0000 7f36065e9640 1 -- 172.21.15.53:0/3643986759 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36001f37f0 msgr2=0x7f36000b2d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:18.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.925+0000 7f36065e9640 1 --2- 172.21.15.53:0/3643986759 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36001f37f0 0x7f36000b2d50 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f35f4000c10 tx=0x7f35e8005800 comp rx=0 tx=0).stop 2023-06-10T19:03:18.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.925+0000 7f36065e9640 1 -- 172.21.15.53:0/3643986759 shutdown_connections 2023-06-10T19:03:18.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.925+0000 7f36065e9640 1 --2- 172.21.15.53:0/3643986759 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f35ec066280 0x7f35ec068730 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:18.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.925+0000 7f36065e9640 1 --2- 172.21.15.53:0/3643986759 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36000b3290 0x7f36000c4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:18.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.925+0000 7f36065e9640 1 --2- 172.21.15.53:0/3643986759 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36001f37f0 0x7f36000b2d50 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:18.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.925+0000 7f36065e9640 1 --2- 172.21.15.53:0/3643986759 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3600149ca0 0x7f36000c62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:18.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.925+0000 7f36065e9640 1 -- 172.21.15.53:0/3643986759 >> 172.21.15.53:0/3643986759 conn(0x7f360006a0d0 msgr2=0x7f3600157ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:18.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.925+0000 7f36065e9640 1 -- 172.21.15.53:0/3643986759 shutdown_connections 2023-06-10T19:03:18.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:17.925+0000 7f36065e9640 1 -- 172.21.15.53:0/3643986759 wait complete. 2023-06-10T19:03:18.007 DEBUG:tasks.cephfs.filesystem:mapped states ['up:reconnect'] to None 2023-06-10T19:03:19.008 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:03:19.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:19.141+0000 7f88fa6cb640 1 Processor -- start 2023-06-10T19:03:19.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:19.141+0000 7f88fa6cb640 1 -- start start 2023-06-10T19:03:19.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:19.145+0000 7f88fa6cb640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f88f40b3ac0 0x7f88f40b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:19.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:19.145+0000 7f88fa6cb640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f88f40cc690 0x7f88f415f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:19.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:19.145+0000 7f88fa6cb640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88f40d0020 con 0x7f88f40ccae0 2023-06-10T19:03:19.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:19.145+0000 7f88fa6cb640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88f40b43d0 con 0x7f88f40cc690 2023-06-10T19:03:19.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:19.145+0000 7f88fa6cb640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88f40cef40 con 0x7f88f40b3ac0 2023-06-10T19:03:19.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:19.145+0000 7f88f8c68640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f88f40ccae0 0x7f88f415f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:45536/0 (socket says 172.21.15.53:45536) 2023-06-10T19:03:19.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:19.145+0000 7f88ebfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f88f40cc690 0x7f88f415f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:19.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:19.145+0000 7f88f8c68640 1 -- 172.21.15.53:0/3035503253 learned_addr learned my addr 172.21.15.53:0/3035503253 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:03:19.150 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:19.145+0000 7f88f3fff640 1 --2- 172.21.15.53:0/3035503253 >> v2:172.21.15.117:3300/0 conn(0x7f88f40b3ac0 0x7f88f40b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:19.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:19.145+0000 7f88f37fe640 1 -- 172.21.15.53:0/3035503253 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 86151988 0 0) 0x7f88f40d0020 con 0x7f88f40ccae0 2023-06-10T19:03:19.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:19.145+0000 7f88f37fe640 1 -- 172.21.15.53:0/3035503253 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88e0003530 con 0x7f88f40ccae0 2023-06-10T19:03:19.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:19.145+0000 7f88ebfff640 1 -- 172.21.15.53:0/3035503253 >> v2:172.21.15.117:3300/0 conn(0x7f88f40b3ac0 msgr2=0x7f88f40b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:19.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:19.145+0000 7f88ebfff640 1 --2- 172.21.15.53:0/3035503253 >> v2:172.21.15.117:3300/0 conn(0x7f88f40b3ac0 0x7f88f40b3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:19.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:19.145+0000 7f88ebfff640 1 -- 172.21.15.53:0/3035503253 >> v1:172.21.15.53:6789/0 conn(0x7f88f40ccae0 legacy=0x7f88f415f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:19.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:19.145+0000 7f88ebfff640 1 -- 172.21.15.53:0/3035503253 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88f40cf220 con 0x7f88f40cc690 2023-06-10T19:03:19.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:19.145+0000 7f88ebfff640 1 --2- 172.21.15.53:0/3035503253 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88f40cc690 0x7f88f415f370 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f88f40b4ba0 tx=0x7f88dc01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bb2c850be31218b server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:19.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:19.145+0000 7f88f37fe640 1 -- 172.21.15.53:0/3035503253 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88dc0ab600 con 0x7f88f40cc690 2023-06-10T19:03:19.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:19.145+0000 7f88f37fe640 1 -- 172.21.15.53:0/3035503253 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88dc0a7050 con 0x7f88f40cc690 2023-06-10T19:03:19.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:19.145+0000 7f88f37fe640 1 -- 172.21.15.53:0/3035503253 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88dc0ab960 con 0x7f88f40cc690 2023-06-10T19:03:19.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:19.145+0000 7f88fa6cb640 1 -- 172.21.15.53:0/3035503253 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88f40cc690 msgr2=0x7f88f415f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:19.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:19.145+0000 7f88fa6cb640 1 --2- 172.21.15.53:0/3035503253 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88f40cc690 0x7f88f415f370 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f88f40b4ba0 tx=0x7f88dc01c430 comp rx=0 tx=0).stop 2023-06-10T19:03:19.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:19.149+0000 7f88fa6cb640 1 -- 172.21.15.53:0/3035503253 shutdown_connections 2023-06-10T19:03:19.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:19.149+0000 7f88fa6cb640 1 --2- 172.21.15.53:0/3035503253 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88f40cc690 0x7f88f415f370 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:19.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:19.149+0000 7f88fa6cb640 1 --2- 172.21.15.53:0/3035503253 >> v2:172.21.15.117:3300/0 conn(0x7f88f40b3ac0 0x7f88f40b3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:19.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:19.149+0000 7f88fa6cb640 1 -- 172.21.15.53:0/3035503253 >> 172.21.15.53:0/3035503253 conn(0x7f88f4071790 msgr2=0x7f88f4069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:19.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:19.149+0000 7f88fa6cb640 1 -- 172.21.15.53:0/3035503253 shutdown_connections 2023-06-10T19:03:19.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:19.149+0000 7f88fa6cb640 1 -- 172.21.15.53:0/3035503253 wait complete. 2023-06-10T19:03:19.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:19.149+0000 7f88fa6cb640 1 Processor -- start 2023-06-10T19:03:19.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:19.149+0000 7f88fa6cb640 1 -- start start 2023-06-10T19:03:19.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:19.149+0000 7f88fa6cb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88f40b3ac0 0x7f88f4153c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:19.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:19.149+0000 7f88fa6cb640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88f40cc690 0x7f88f4159be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:19.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:19.149+0000 7f88fa6cb640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88f40ccae0 0x7f88f414e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:19.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:19.149+0000 7f88fa6cb640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f415a120 con 0x7f88f40b3ac0 2023-06-10T19:03:19.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:19.149+0000 7f88fa6cb640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f415a3e0 con 0x7f88f40cc690 2023-06-10T19:03:19.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:19.149+0000 7f88fa6cb640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88f415a6c0 con 0x7f88f40ccae0 2023-06-10T19:03:19.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:19.149+0000 7f88f3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88f40b3ac0 0x7f88f4153c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:19.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:19.149+0000 7f88f3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88f40b3ac0 0x7f88f4153c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57418/0 (socket says 172.21.15.53:57418) 2023-06-10T19:03:19.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:19.149+0000 7f88f3fff640 1 -- 172.21.15.53:0/3188401569 learned_addr learned my addr 172.21.15.53:0/3188401569 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:19.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:19.149+0000 7f88ebfff640 1 --2- 172.21.15.53:0/3188401569 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88f40cc690 0x7f88f4159be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:19.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:19.149+0000 7f88f8c68640 1 --2- 172.21.15.53:0/3188401569 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88f40ccae0 0x7f88f414e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:19.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:19.149+0000 7f88f3fff640 1 -- 172.21.15.53:0/3188401569 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88f40ccae0 msgr2=0x7f88f414e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:19.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:19.149+0000 7f88f3fff640 1 --2- 172.21.15.53:0/3188401569 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88f40ccae0 0x7f88f414e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:19.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:19.149+0000 7f88f3fff640 1 -- 172.21.15.53:0/3188401569 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88f40cc690 msgr2=0x7f88f4159be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:19.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:19.149+0000 7f88f3fff640 1 --2- 172.21.15.53:0/3188401569 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88f40cc690 0x7f88f4159be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:19.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:19.149+0000 7f88f3fff640 1 -- 172.21.15.53:0/3188401569 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88dc009420 con 0x7f88f40b3ac0 2023-06-10T19:03:19.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:19.149+0000 7f88f3fff640 1 --2- 172.21.15.53:0/3188401569 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88f40b3ac0 0x7f88f4153c00 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f88e400d5f0 tx=0x7f88e400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:19.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:19.149+0000 7f88f17fa640 1 -- 172.21.15.53:0/3188401569 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e40125f0 con 0x7f88f40b3ac0 2023-06-10T19:03:19.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:19.149+0000 7f88f17fa640 1 -- 172.21.15.53:0/3188401569 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88e4012750 con 0x7f88f40b3ac0 2023-06-10T19:03:19.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:19.149+0000 7f88fa6cb640 1 -- 172.21.15.53:0/3188401569 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88f415a9a0 con 0x7f88f40b3ac0 2023-06-10T19:03:19.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:19.149+0000 7f88f17fa640 1 -- 172.21.15.53:0/3188401569 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e4012ae0 con 0x7f88f40b3ac0 2023-06-10T19:03:19.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:19.149+0000 7f88fa6cb640 1 -- 172.21.15.53:0/3188401569 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88f415af60 con 0x7f88f40b3ac0 2023-06-10T19:03:19.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:19.149+0000 7f88fa6cb640 1 -- 172.21.15.53:0/3188401569 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88f404d790 con 0x7f88f40b3ac0 2023-06-10T19:03:19.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:19.153+0000 7f88f17fa640 1 -- 172.21.15.53:0/3188401569 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f88e4012c40 con 0x7f88f40b3ac0 2023-06-10T19:03:19.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:19.153+0000 7f88f17fa640 1 --2- 172.21.15.53:0/3188401569 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f88d4066280 0x7f88d4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:19.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:19.153+0000 7f88f17fa640 1 -- 172.21.15.53:0/3188401569 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6264+0+0 (secure 0 0 0) 0x7f88e4084330 con 0x7f88f40b3ac0 2023-06-10T19:03:19.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:19.153+0000 7f88ebfff640 1 --2- 172.21.15.53:0/3188401569 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f88d4066280 0x7f88d4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:19.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:19.153+0000 7f88ebfff640 1 --2- 172.21.15.53:0/3188401569 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f88d4066280 0x7f88d4068730 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f88f4160410 tx=0x7f88dc0a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:19.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:19.157+0000 7f88f17fa640 1 -- 172.21.15.53:0/3188401569 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f88e40516d0 con 0x7f88f40b3ac0 2023-06-10T19:03:19.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:19.345+0000 7f88fa6cb640 1 -- 172.21.15.53:0/3188401569 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f88f408a200 con 0x7f88f40b3ac0 2023-06-10T19:03:19.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:19.345+0000 7f88f17fa640 1 -- 172.21.15.53:0/3188401569 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+4683 (secure 0 0 0) 0x7f88e4054cf0 con 0x7f88f40b3ac0 2023-06-10T19:03:19.350 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:03:19.350 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1617157670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1617157670},{"type":"v1","addr":"172.21.15.117:6836","nonce":1617157670}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6113,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3414416090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":3414416090},{"type":"v1","addr":"172.21.15.117:6837","nonce":3414416090}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6718,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2533467097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2533467097},{"type":"v1","addr":"172.21.15.53:6835","nonce":2533467097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:02:02.642809+0000","modified":"2023-06-10T19:02:36.149418+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8127":{"gid":8127,"name":"a","rank":0,"incarnation":52,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.53:6833/2984379521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2984379521},{"type":"v1","addr":"172.21.15.53:6833","nonce":2984379521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-06-10T19:03:19.350 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 53 2023-06-10T19:03:19.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:19.349+0000 7f88fa6cb640 1 -- 172.21.15.53:0/3188401569 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f88d4066280 msgr2=0x7f88d4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:19.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:19.349+0000 7f88fa6cb640 1 --2- 172.21.15.53:0/3188401569 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f88d4066280 0x7f88d4068730 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f88f4160410 tx=0x7f88dc0a6000 comp rx=0 tx=0).stop 2023-06-10T19:03:19.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:19.349+0000 7f88fa6cb640 1 -- 172.21.15.53:0/3188401569 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88f40b3ac0 msgr2=0x7f88f4153c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:19.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:19.349+0000 7f88fa6cb640 1 --2- 172.21.15.53:0/3188401569 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88f40b3ac0 0x7f88f4153c00 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f88e400d5f0 tx=0x7f88e400dab0 comp rx=0 tx=0).stop 2023-06-10T19:03:19.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:19.349+0000 7f88fa6cb640 1 -- 172.21.15.53:0/3188401569 shutdown_connections 2023-06-10T19:03:19.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:19.349+0000 7f88fa6cb640 1 --2- 172.21.15.53:0/3188401569 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f88d4066280 0x7f88d4068730 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:19.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:19.349+0000 7f88fa6cb640 1 --2- 172.21.15.53:0/3188401569 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f88f40ccae0 0x7f88f414e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:19.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:19.349+0000 7f88fa6cb640 1 --2- 172.21.15.53:0/3188401569 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88f40cc690 0x7f88f4159be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:19.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:19.349+0000 7f88fa6cb640 1 --2- 172.21.15.53:0/3188401569 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88f40b3ac0 0x7f88f4153c00 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:19.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:19.349+0000 7f88fa6cb640 1 -- 172.21.15.53:0/3188401569 >> 172.21.15.53:0/3188401569 conn(0x7f88f4071790 msgr2=0x7f88f40b5880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:19.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:19.349+0000 7f88fa6cb640 1 -- 172.21.15.53:0/3188401569 shutdown_connections 2023-06-10T19:03:19.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:19.349+0000 7f88fa6cb640 1 -- 172.21.15.53:0/3188401569 wait complete. 2023-06-10T19:03:19.369 DEBUG:tasks.cephfs.filesystem:mapped states ['up:reconnect'] to None 2023-06-10T19:03:20.371 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:03:20.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:20.505+0000 7ff4a5383640 1 Processor -- start 2023-06-10T19:03:20.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:20.505+0000 7ff4a5383640 1 -- start start 2023-06-10T19:03:20.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:20.505+0000 7ff4a5383640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff4a0159690 0x7ff4a0070950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:20.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:20.505+0000 7ff4a5383640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff4a00b0f30 0x7ff4a00cbe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:20.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:20.505+0000 7ff4a5383640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4a00cb080 con 0x7ff4a0159a60 2023-06-10T19:03:20.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:20.505+0000 7ff4a5383640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4a0070e90 con 0x7ff4a00b0f30 2023-06-10T19:03:20.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:20.505+0000 7ff4a5383640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4a006d450 con 0x7ff4a0159690 2023-06-10T19:03:20.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:20.505+0000 7ff4967fc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff4a00b0f30 0x7ff4a00cbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:20.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:20.505+0000 7ff49f7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ff4a0159a60 0x7ff4a00c2900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:45548/0 (socket says 172.21.15.53:45548) 2023-06-10T19:03:20.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:20.505+0000 7ff49f7fe640 1 -- 172.21.15.53:0/2334023293 learned_addr learned my addr 172.21.15.53:0/2334023293 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:03:20.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:20.505+0000 7ff49effd640 1 --2- 172.21.15.53:0/2334023293 >> v2:172.21.15.117:3300/0 conn(0x7ff4a0159690 0x7ff4a0070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:20.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:20.505+0000 7ff4967fc640 1 -- 172.21.15.53:0/2334023293 >> v2:172.21.15.117:3300/0 conn(0x7ff4a0159690 msgr2=0x7ff4a0070950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:20.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:20.505+0000 7ff4967fc640 1 --2- 172.21.15.53:0/2334023293 >> v2:172.21.15.117:3300/0 conn(0x7ff4a0159690 0x7ff4a0070950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:20.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:20.505+0000 7ff4967fc640 1 -- 172.21.15.53:0/2334023293 >> v1:172.21.15.53:6789/0 conn(0x7ff4a0159a60 legacy=0x7ff4a00c2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:20.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:20.505+0000 7ff4967fc640 1 -- 172.21.15.53:0/2334023293 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4a00cb320 con 0x7ff4a00b0f30 2023-06-10T19:03:20.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:20.505+0000 7ff49e7fc640 1 -- 172.21.15.53:0/2334023293 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2685485850 0 0) 0x7ff4a00cb080 con 0x7ff4a0159a60 2023-06-10T19:03:20.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:20.509+0000 7ff4967fc640 1 --2- 172.21.15.53:0/2334023293 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4a00b0f30 0x7ff4a00cbe00 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7ff4a0071570 tx=0x7ff48801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5637a364e4b3493b server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:20.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:20.509+0000 7ff49e7fc640 1 -- 172.21.15.53:0/2334023293 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4880a7070 con 0x7ff4a00b0f30 2023-06-10T19:03:20.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:20.509+0000 7ff49e7fc640 1 -- 172.21.15.53:0/2334023293 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4880ab430 con 0x7ff4a00b0f30 2023-06-10T19:03:20.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:20.509+0000 7ff49e7fc640 1 -- 172.21.15.53:0/2334023293 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4880ab7c0 con 0x7ff4a00b0f30 2023-06-10T19:03:20.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:20.509+0000 7ff4a5383640 1 -- 172.21.15.53:0/2334023293 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4a00b0f30 msgr2=0x7ff4a00cbe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:20.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:20.509+0000 7ff4a5383640 1 --2- 172.21.15.53:0/2334023293 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4a00b0f30 0x7ff4a00cbe00 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7ff4a0071570 tx=0x7ff48801c430 comp rx=0 tx=0).stop 2023-06-10T19:03:20.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:20.509+0000 7ff4a5383640 1 -- 172.21.15.53:0/2334023293 shutdown_connections 2023-06-10T19:03:20.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:20.509+0000 7ff4a5383640 1 --2- 172.21.15.53:0/2334023293 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4a00b0f30 0x7ff4a00cbe00 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:20.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:20.509+0000 7ff4a5383640 1 --2- 172.21.15.53:0/2334023293 >> v2:172.21.15.117:3300/0 conn(0x7ff4a0159690 0x7ff4a0070950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:20.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:20.509+0000 7ff4a5383640 1 -- 172.21.15.53:0/2334023293 >> 172.21.15.53:0/2334023293 conn(0x7ff4a006a560 msgr2=0x7ff4a006a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:20.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:20.509+0000 7ff4a5383640 1 -- 172.21.15.53:0/2334023293 shutdown_connections 2023-06-10T19:03:20.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:20.509+0000 7ff4a5383640 1 -- 172.21.15.53:0/2334023293 wait complete. 2023-06-10T19:03:20.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:20.509+0000 7ff4a5383640 1 Processor -- start 2023-06-10T19:03:20.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:20.509+0000 7ff4a5383640 1 -- start start 2023-06-10T19:03:20.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:20.509+0000 7ff4a5383640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4a00b0f30 0x7ff4a0143b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:20.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:20.509+0000 7ff4a5383640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4a0159690 0x7ff4a01464a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:20.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:20.509+0000 7ff4a5383640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4a0159a60 0x7ff4a00c4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:20.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:20.509+0000 7ff4a5383640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a0144e30 con 0x7ff4a00b0f30 2023-06-10T19:03:20.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:20.509+0000 7ff4a5383640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a00c8710 con 0x7ff4a0159a60 2023-06-10T19:03:20.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:20.509+0000 7ff4a5383640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a00c89f0 con 0x7ff4a0159690 2023-06-10T19:03:20.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:20.509+0000 7ff49effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4a00b0f30 0x7ff4a0143b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:20.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:20.509+0000 7ff49effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4a00b0f30 0x7ff4a0143b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57438/0 (socket says 172.21.15.53:57438) 2023-06-10T19:03:20.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:20.509+0000 7ff49effd640 1 -- 172.21.15.53:0/3831852815 learned_addr learned my addr 172.21.15.53:0/3831852815 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:20.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:20.509+0000 7ff49effd640 1 -- 172.21.15.53:0/3831852815 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4a0159690 msgr2=0x7ff4a01464a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:20.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:20.509+0000 7ff49effd640 1 --2- 172.21.15.53:0/3831852815 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4a0159690 0x7ff4a01464a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:20.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:20.509+0000 7ff49effd640 1 -- 172.21.15.53:0/3831852815 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4a0159a60 msgr2=0x7ff4a00c4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:20.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:20.509+0000 7ff49effd640 1 --2- 172.21.15.53:0/3831852815 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4a0159a60 0x7ff4a00c4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:20.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:20.509+0000 7ff49effd640 1 -- 172.21.15.53:0/3831852815 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff488009420 con 0x7ff4a00b0f30 2023-06-10T19:03:20.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:20.509+0000 7ff49effd640 1 --2- 172.21.15.53:0/3831852815 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4a00b0f30 0x7ff4a0143b10 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7ff49000c7f0 tx=0x7ff49000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:20.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:20.509+0000 7ff497fff640 1 -- 172.21.15.53:0/3831852815 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff490004220 con 0x7ff4a00b0f30 2023-06-10T19:03:20.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:20.513+0000 7ff497fff640 1 -- 172.21.15.53:0/3831852815 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4900043a0 con 0x7ff4a00b0f30 2023-06-10T19:03:20.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:20.513+0000 7ff4a5383640 1 -- 172.21.15.53:0/3831852815 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4a00c8cd0 con 0x7ff4a00b0f30 2023-06-10T19:03:20.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:20.513+0000 7ff497fff640 1 -- 172.21.15.53:0/3831852815 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff490004510 con 0x7ff4a00b0f30 2023-06-10T19:03:20.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:20.513+0000 7ff4a5383640 1 -- 172.21.15.53:0/3831852815 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4a01469e0 con 0x7ff4a00b0f30 2023-06-10T19:03:20.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:20.513+0000 7ff4a5383640 1 -- 172.21.15.53:0/3831852815 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4a004d790 con 0x7ff4a00b0f30 2023-06-10T19:03:20.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:20.513+0000 7ff497fff640 1 -- 172.21.15.53:0/3831852815 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff490003a70 con 0x7ff4a00b0f30 2023-06-10T19:03:20.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:20.513+0000 7ff497fff640 1 --2- 172.21.15.53:0/3831852815 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff480066280 0x7ff480068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:20.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:20.513+0000 7ff497fff640 1 -- 172.21.15.53:0/3831852815 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6264+0+0 (secure 0 0 0) 0x7ff490084310 con 0x7ff4a00b0f30 2023-06-10T19:03:20.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:20.513+0000 7ff4967fc640 1 --2- 172.21.15.53:0/3831852815 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff480066280 0x7ff480068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:20.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:20.513+0000 7ff4967fc640 1 --2- 172.21.15.53:0/3831852815 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff480066280 0x7ff480068730 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7ff4880af000 tx=0x7ff488008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:20.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:20.517+0000 7ff497fff640 1 -- 172.21.15.53:0/3831852815 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff4900516a0 con 0x7ff4a00b0f30 2023-06-10T19:03:20.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:20.705+0000 7ff4a5383640 1 -- 172.21.15.53:0/3831852815 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff4a006a020 con 0x7ff4a00b0f30 2023-06-10T19:03:20.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:20.705+0000 7ff497fff640 1 -- 172.21.15.53:0/3831852815 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+4683 (secure 0 0 0) 0x7ff490054cc0 con 0x7ff4a00b0f30 2023-06-10T19:03:20.710 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:03:20.710 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1617157670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1617157670},{"type":"v1","addr":"172.21.15.117:6836","nonce":1617157670}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6113,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3414416090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":3414416090},{"type":"v1","addr":"172.21.15.117:6837","nonce":3414416090}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6718,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2533467097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2533467097},{"type":"v1","addr":"172.21.15.53:6835","nonce":2533467097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:02:02.642809+0000","modified":"2023-06-10T19:02:36.149418+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8127":{"gid":8127,"name":"a","rank":0,"incarnation":52,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.53:6833/2984379521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2984379521},{"type":"v1","addr":"172.21.15.53:6833","nonce":2984379521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-06-10T19:03:20.710 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 53 2023-06-10T19:03:20.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:20.709+0000 7ff4a5383640 1 -- 172.21.15.53:0/3831852815 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff480066280 msgr2=0x7ff480068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:20.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:20.709+0000 7ff4a5383640 1 --2- 172.21.15.53:0/3831852815 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff480066280 0x7ff480068730 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7ff4880af000 tx=0x7ff488008040 comp rx=0 tx=0).stop 2023-06-10T19:03:20.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:20.709+0000 7ff4a5383640 1 -- 172.21.15.53:0/3831852815 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4a00b0f30 msgr2=0x7ff4a0143b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:20.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:20.709+0000 7ff4a5383640 1 --2- 172.21.15.53:0/3831852815 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4a00b0f30 0x7ff4a0143b10 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7ff49000c7f0 tx=0x7ff49000ccb0 comp rx=0 tx=0).stop 2023-06-10T19:03:20.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:20.709+0000 7ff4a5383640 1 -- 172.21.15.53:0/3831852815 shutdown_connections 2023-06-10T19:03:20.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:20.709+0000 7ff4a5383640 1 --2- 172.21.15.53:0/3831852815 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff480066280 0x7ff480068730 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:20.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:20.709+0000 7ff4a5383640 1 --2- 172.21.15.53:0/3831852815 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4a0159a60 0x7ff4a00c4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:20.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:20.709+0000 7ff4a5383640 1 --2- 172.21.15.53:0/3831852815 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4a0159690 0x7ff4a01464a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:20.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:20.709+0000 7ff4a5383640 1 --2- 172.21.15.53:0/3831852815 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4a00b0f30 0x7ff4a0143b10 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:20.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:20.709+0000 7ff4a5383640 1 -- 172.21.15.53:0/3831852815 >> 172.21.15.53:0/3831852815 conn(0x7ff4a006a560 msgr2=0x7ff4a006cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:20.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:20.709+0000 7ff4a5383640 1 -- 172.21.15.53:0/3831852815 shutdown_connections 2023-06-10T19:03:20.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:20.709+0000 7ff4a5383640 1 -- 172.21.15.53:0/3831852815 wait complete. 2023-06-10T19:03:20.730 DEBUG:tasks.cephfs.filesystem:mapped states ['up:reconnect'] to None 2023-06-10T19:03:21.731 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:03:21.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:21.861+0000 7ff2ba7c3640 1 Processor -- start 2023-06-10T19:03:21.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:21.865+0000 7ff2ba7c3640 1 -- start start 2023-06-10T19:03:21.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:21.865+0000 7ff2ba7c3640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff2b40c8d00 0x7ff2b406b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:21.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:21.865+0000 7ff2ba7c3640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff2b406bc00 0x7ff2b4162180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:21.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:21.865+0000 7ff2ba7c3640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2b4158a90 con 0x7ff2b406b2f0 2023-06-10T19:03:21.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:21.865+0000 7ff2ba7c3640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2b406f780 con 0x7ff2b40c8d00 2023-06-10T19:03:21.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:21.865+0000 7ff2ba7c3640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2b40705d0 con 0x7ff2b406bc00 2023-06-10T19:03:21.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:21.865+0000 7ff2b3fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ff2b406b2f0 0x7ff2b406f070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:46486/0 (socket says 172.21.15.53:46486) 2023-06-10T19:03:21.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:21.865+0000 7ff2b3fff640 1 -- 172.21.15.53:0/1599142719 learned_addr learned my addr 172.21.15.53:0/1599142719 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:03:21.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:21.865+0000 7ff2b37fe640 1 --2- 172.21.15.53:0/1599142719 >> v2:172.21.15.53:3300/0 conn(0x7ff2b40c8d00 0x7ff2b406b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:21.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:21.865+0000 7ff2b2ffd640 1 -- 172.21.15.53:0/1599142719 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2945293253 0 0) 0x7ff29c001120 con 0x7ff2b406b2f0 2023-06-10T19:03:21.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:21.865+0000 7ff2b2ffd640 1 -- 172.21.15.53:0/1599142719 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2a0003530 con 0x7ff2b406b2f0 2023-06-10T19:03:21.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:21.865+0000 7ff2b8d60640 1 --2- 172.21.15.53:0/1599142719 >> v2:172.21.15.117:3300/0 conn(0x7ff2b406bc00 0x7ff2b4162180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:21.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:21.865+0000 7ff2b37fe640 1 -- 172.21.15.53:0/1599142719 >> v2:172.21.15.117:3300/0 conn(0x7ff2b406bc00 msgr2=0x7ff2b4162180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:21.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:21.865+0000 7ff2b37fe640 1 --2- 172.21.15.53:0/1599142719 >> v2:172.21.15.117:3300/0 conn(0x7ff2b406bc00 0x7ff2b4162180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:21.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:21.865+0000 7ff2b37fe640 1 -- 172.21.15.53:0/1599142719 >> v1:172.21.15.53:6789/0 conn(0x7ff2b406b2f0 legacy=0x7ff2b406f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:21.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:21.865+0000 7ff2b37fe640 1 -- 172.21.15.53:0/1599142719 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2b40cce10 con 0x7ff2b40c8d00 2023-06-10T19:03:21.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:21.865+0000 7ff2b37fe640 1 --2- 172.21.15.53:0/1599142719 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2b40c8d00 0x7ff2b406b6c0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7ff2b40c87f0 tx=0x7ff2a401ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=435a055e88c63480 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:21.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:21.869+0000 7ff2b2ffd640 1 -- 172.21.15.53:0/1599142719 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a40a8950 con 0x7ff2b40c8d00 2023-06-10T19:03:21.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:21.869+0000 7ff2b2ffd640 1 -- 172.21.15.53:0/1599142719 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2a40a8ab0 con 0x7ff2b40c8d00 2023-06-10T19:03:21.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:21.869+0000 7ff2b2ffd640 1 -- 172.21.15.53:0/1599142719 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a40a8e40 con 0x7ff2b40c8d00 2023-06-10T19:03:21.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:21.869+0000 7ff2ba7c3640 1 -- 172.21.15.53:0/1599142719 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2b40c8d00 msgr2=0x7ff2b406b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:21.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:21.869+0000 7ff2ba7c3640 1 --2- 172.21.15.53:0/1599142719 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2b40c8d00 0x7ff2b406b6c0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7ff2b40c87f0 tx=0x7ff2a401ec50 comp rx=0 tx=0).stop 2023-06-10T19:03:21.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:21.869+0000 7ff2ba7c3640 1 -- 172.21.15.53:0/1599142719 shutdown_connections 2023-06-10T19:03:21.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:21.869+0000 7ff2ba7c3640 1 --2- 172.21.15.53:0/1599142719 >> v2:172.21.15.117:3300/0 conn(0x7ff2b406bc00 0x7ff2b4162180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:21.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:21.869+0000 7ff2ba7c3640 1 --2- 172.21.15.53:0/1599142719 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2b40c8d00 0x7ff2b406b6c0 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:21.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:21.869+0000 7ff2ba7c3640 1 -- 172.21.15.53:0/1599142719 >> 172.21.15.53:0/1599142719 conn(0x7ff2b406a0d0 msgr2=0x7ff2b40ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:21.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:21.869+0000 7ff2ba7c3640 1 -- 172.21.15.53:0/1599142719 shutdown_connections 2023-06-10T19:03:21.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:21.869+0000 7ff2ba7c3640 1 -- 172.21.15.53:0/1599142719 wait complete. 2023-06-10T19:03:21.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:21.869+0000 7ff2ba7c3640 1 Processor -- start 2023-06-10T19:03:21.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:21.869+0000 7ff2ba7c3640 1 -- start start 2023-06-10T19:03:21.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:21.869+0000 7ff2ba7c3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff2b406b2f0 0x7ff2b40ac460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:21.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:21.869+0000 7ff2ba7c3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2b406bc00 0x7ff2b415b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:21.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:21.869+0000 7ff2ba7c3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2b40c8d00 0x7ff2b4154450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:21.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:21.869+0000 7ff2ba7c3640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b41552b0 con 0x7ff2b406bc00 2023-06-10T19:03:21.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:21.869+0000 7ff2ba7c3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b415a490 con 0x7ff2b40c8d00 2023-06-10T19:03:21.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:21.869+0000 7ff2ba7c3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b415a770 con 0x7ff2b406b2f0 2023-06-10T19:03:21.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:21.869+0000 7ff2b37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2b406bc00 0x7ff2b415b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:21.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:21.869+0000 7ff2b37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2b406bc00 0x7ff2b415b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48512/0 (socket says 172.21.15.53:48512) 2023-06-10T19:03:21.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:21.869+0000 7ff2b37fe640 1 -- 172.21.15.53:0/197045915 learned_addr learned my addr 172.21.15.53:0/197045915 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:21.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:21.869+0000 7ff2b3fff640 1 --2- 172.21.15.53:0/197045915 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff2b406b2f0 0x7ff2b40ac460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:21.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:21.869+0000 7ff2b8d60640 1 --2- 172.21.15.53:0/197045915 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2b40c8d00 0x7ff2b4154450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:21.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:21.869+0000 7ff2b37fe640 1 -- 172.21.15.53:0/197045915 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff2b406b2f0 msgr2=0x7ff2b40ac460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:21.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:21.869+0000 7ff2b37fe640 1 --2- 172.21.15.53:0/197045915 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff2b406b2f0 0x7ff2b40ac460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:21.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:21.869+0000 7ff2b37fe640 1 -- 172.21.15.53:0/197045915 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2b40c8d00 msgr2=0x7ff2b4154450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:21.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:21.869+0000 7ff2b37fe640 1 --2- 172.21.15.53:0/197045915 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2b40c8d00 0x7ff2b4154450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:21.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:21.869+0000 7ff2b37fe640 1 -- 172.21.15.53:0/197045915 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2a4009420 con 0x7ff2b406bc00 2023-06-10T19:03:21.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:21.869+0000 7ff2b8d60640 1 --2- 172.21.15.53:0/197045915 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2b40c8d00 0x7ff2b4154450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:03:21.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:21.869+0000 7ff2b37fe640 1 --2- 172.21.15.53:0/197045915 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2b406bc00 0x7ff2b415b530 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7ff2a401b860 tx=0x7ff2a401b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:21.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:21.869+0000 7ff2b0ff9640 1 -- 172.21.15.53:0/197045915 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a40b0dd0 con 0x7ff2b406bc00 2023-06-10T19:03:21.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:21.869+0000 7ff2b0ff9640 1 -- 172.21.15.53:0/197045915 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2a40bb440 con 0x7ff2b406bc00 2023-06-10T19:03:21.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:21.869+0000 7ff2ba7c3640 1 -- 172.21.15.53:0/197045915 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2b415aa50 con 0x7ff2b406bc00 2023-06-10T19:03:21.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:21.869+0000 7ff2b0ff9640 1 -- 172.21.15.53:0/197045915 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a40bb7b0 con 0x7ff2b406bc00 2023-06-10T19:03:21.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:21.873+0000 7ff2ba7c3640 1 -- 172.21.15.53:0/197045915 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2b415b010 con 0x7ff2b406bc00 2023-06-10T19:03:21.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:21.873+0000 7ff2ba7c3640 1 -- 172.21.15.53:0/197045915 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2b404d790 con 0x7ff2b406bc00 2023-06-10T19:03:21.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:21.873+0000 7ff2b0ff9640 1 -- 172.21.15.53:0/197045915 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff2a40b7040 con 0x7ff2b406bc00 2023-06-10T19:03:21.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:21.873+0000 7ff2b0ff9640 1 --2- 172.21.15.53:0/197045915 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff294066280 0x7ff294068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:21.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:21.873+0000 7ff2b0ff9640 1 -- 172.21.15.53:0/197045915 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6264+0+0 (secure 0 0 0) 0x7ff2a4121d20 con 0x7ff2b406bc00 2023-06-10T19:03:21.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:21.873+0000 7ff2b3fff640 1 --2- 172.21.15.53:0/197045915 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff294066280 0x7ff294068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:21.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:21.873+0000 7ff2b3fff640 1 --2- 172.21.15.53:0/197045915 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff294066280 0x7ff294068730 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7ff29c001280 tx=0x7ff29c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:21.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:21.877+0000 7ff2b0ff9640 1 -- 172.21.15.53:0/197045915 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff2a40ef1f0 con 0x7ff2b406bc00 2023-06-10T19:03:22.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:22.065+0000 7ff2ba7c3640 1 -- 172.21.15.53:0/197045915 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff2b4158750 con 0x7ff2b406bc00 2023-06-10T19:03:22.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:22.065+0000 7ff2b0ff9640 1 -- 172.21.15.53:0/197045915 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+4683 (secure 0 0 0) 0x7ff2a40f2810 con 0x7ff2b406bc00 2023-06-10T19:03:22.070 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:03:22.070 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1617157670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1617157670},{"type":"v1","addr":"172.21.15.117:6836","nonce":1617157670}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6113,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3414416090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":3414416090},{"type":"v1","addr":"172.21.15.117:6837","nonce":3414416090}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6718,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2533467097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2533467097},{"type":"v1","addr":"172.21.15.53:6835","nonce":2533467097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:02:02.642809+0000","modified":"2023-06-10T19:02:36.149418+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8127":{"gid":8127,"name":"a","rank":0,"incarnation":52,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.53:6833/2984379521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2984379521},{"type":"v1","addr":"172.21.15.53:6833","nonce":2984379521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-06-10T19:03:22.071 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 53 2023-06-10T19:03:22.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:22.069+0000 7ff2ba7c3640 1 -- 172.21.15.53:0/197045915 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff294066280 msgr2=0x7ff294068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:22.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:22.069+0000 7ff2ba7c3640 1 --2- 172.21.15.53:0/197045915 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff294066280 0x7ff294068730 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7ff29c001280 tx=0x7ff29c009040 comp rx=0 tx=0).stop 2023-06-10T19:03:22.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:22.069+0000 7ff2ba7c3640 1 -- 172.21.15.53:0/197045915 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2b406bc00 msgr2=0x7ff2b415b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:22.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:22.069+0000 7ff2ba7c3640 1 --2- 172.21.15.53:0/197045915 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2b406bc00 0x7ff2b415b530 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7ff2a401b860 tx=0x7ff2a401b9f0 comp rx=0 tx=0).stop 2023-06-10T19:03:22.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:22.069+0000 7ff2ba7c3640 1 -- 172.21.15.53:0/197045915 shutdown_connections 2023-06-10T19:03:22.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:22.069+0000 7ff2ba7c3640 1 --2- 172.21.15.53:0/197045915 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff294066280 0x7ff294068730 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:22.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:22.069+0000 7ff2ba7c3640 1 --2- 172.21.15.53:0/197045915 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2b40c8d00 0x7ff2b4154450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:22.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:22.069+0000 7ff2ba7c3640 1 --2- 172.21.15.53:0/197045915 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2b406bc00 0x7ff2b415b530 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:22.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:22.069+0000 7ff2ba7c3640 1 --2- 172.21.15.53:0/197045915 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff2b406b2f0 0x7ff2b40ac460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:22.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:22.069+0000 7ff2ba7c3640 1 -- 172.21.15.53:0/197045915 >> 172.21.15.53:0/197045915 conn(0x7ff2b406a0d0 msgr2=0x7ff2b40ab860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:22.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:22.069+0000 7ff2ba7c3640 1 -- 172.21.15.53:0/197045915 shutdown_connections 2023-06-10T19:03:22.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:22.069+0000 7ff2ba7c3640 1 -- 172.21.15.53:0/197045915 wait complete. 2023-06-10T19:03:22.089 DEBUG:tasks.cephfs.filesystem:mapped states ['up:reconnect'] to None 2023-06-10T19:03:23.091 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:03:23.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:23.225+0000 7efe6c0e4640 1 Processor -- start 2023-06-10T19:03:23.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:23.225+0000 7efe6c0e4640 1 -- start start 2023-06-10T19:03:23.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:23.225+0000 7efe6c0e4640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7efe64071060 0x7efe640af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:23.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:23.225+0000 7efe6c0e4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe640afc60 0x7efe6406b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:23.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:23.225+0000 7efe6c0e4640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe64159b50 con 0x7efe640c9840 2023-06-10T19:03:23.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:23.225+0000 7efe6c0e4640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe640702a0 con 0x7efe64071060 2023-06-10T19:03:23.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:23.225+0000 7efe6c0e4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe64070580 con 0x7efe640afc60 2023-06-10T19:03:23.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:23.225+0000 7efe6967f640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7efe64071060 0x7efe640af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:23.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:23.225+0000 7efe6a681640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe640afc60 0x7efe6406b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:23.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:23.225+0000 7efe69e80640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7efe640c9840 0x7efe640c9c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.53:43492/0 (socket says 172.21.15.53:43492) 2023-06-10T19:03:23.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:23.225+0000 7efe69e80640 1 -- 172.21.15.53:0/208923633 learned_addr learned my addr 172.21.15.53:0/208923633 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:03:23.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:23.225+0000 7efe6967f640 1 -- 172.21.15.53:0/208923633 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe640afc60 msgr2=0x7efe6406b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:23.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:23.225+0000 7efe6967f640 1 --2- 172.21.15.53:0/208923633 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe640afc60 0x7efe6406b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:23.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:23.225+0000 7efe6967f640 1 -- 172.21.15.53:0/208923633 >> v1:172.21.15.117:6789/0 conn(0x7efe640c9840 legacy=0x7efe640c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:23.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:23.225+0000 7efe6967f640 1 -- 172.21.15.53:0/208923633 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe64070860 con 0x7efe64071060 2023-06-10T19:03:23.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:23.225+0000 7efe6a681640 1 --2- 172.21.15.53:0/208923633 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe640afc60 0x7efe6406b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-10T19:03:23.232 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:23.229+0000 7efe6967f640 1 --2- 172.21.15.53:0/208923633 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe64071060 0x7efe640af720 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7efe540097c0 tx=0x7efe5401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7406ace47468a6cf server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:23.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:23.229+0000 7efe68e7e640 1 -- 172.21.15.53:0/208923633 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe540ab670 con 0x7efe64071060 2023-06-10T19:03:23.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:23.229+0000 7efe68e7e640 1 -- 172.21.15.53:0/208923633 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe540ab7d0 con 0x7efe64071060 2023-06-10T19:03:23.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:23.229+0000 7efe68e7e640 1 -- 172.21.15.53:0/208923633 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe540abb60 con 0x7efe64071060 2023-06-10T19:03:23.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:23.229+0000 7efe6c0e4640 1 -- 172.21.15.53:0/208923633 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe64071060 msgr2=0x7efe640af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:23.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:23.229+0000 7efe6c0e4640 1 --2- 172.21.15.53:0/208923633 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe64071060 0x7efe640af720 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7efe540097c0 tx=0x7efe5401c450 comp rx=0 tx=0).stop 2023-06-10T19:03:23.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:23.229+0000 7efe6c0e4640 1 -- 172.21.15.53:0/208923633 shutdown_connections 2023-06-10T19:03:23.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:23.229+0000 7efe6c0e4640 1 --2- 172.21.15.53:0/208923633 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe640afc60 0x7efe6406b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:23.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:23.229+0000 7efe6c0e4640 1 --2- 172.21.15.53:0/208923633 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe64071060 0x7efe640af720 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:23.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:23.229+0000 7efe6c0e4640 1 -- 172.21.15.53:0/208923633 >> 172.21.15.53:0/208923633 conn(0x7efe6406a0d0 msgr2=0x7efe640ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:23.235 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:23.229+0000 7efe6c0e4640 1 -- 172.21.15.53:0/208923633 shutdown_connections 2023-06-10T19:03:23.235 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:23.229+0000 7efe6c0e4640 1 -- 172.21.15.53:0/208923633 wait complete. 2023-06-10T19:03:23.235 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:23.233+0000 7efe6c0e4640 1 Processor -- start 2023-06-10T19:03:23.235 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:23.233+0000 7efe6c0e4640 1 -- start start 2023-06-10T19:03:23.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:23.233+0000 7efe6c0e4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe64071060 0x7efe640c2590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:23.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:23.233+0000 7efe6c0e4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe640afc60 0x7efe640c2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:23.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:23.233+0000 7efe6c0e4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe640c9840 0x7efe64157b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:23.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:23.233+0000 7efe6c0e4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe640c3350 con 0x7efe64071060 2023-06-10T19:03:23.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:23.233+0000 7efe6c0e4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe640c6650 con 0x7efe640afc60 2023-06-10T19:03:23.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:23.233+0000 7efe6c0e4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe640c17d0 con 0x7efe640c9840 2023-06-10T19:03:23.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:23.233+0000 7efe69e80640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe64071060 0x7efe640c2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:23.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:23.233+0000 7efe69e80640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe64071060 0x7efe640c2590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48516/0 (socket says 172.21.15.53:48516) 2023-06-10T19:03:23.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:23.233+0000 7efe69e80640 1 -- 172.21.15.53:0/963462887 learned_addr learned my addr 172.21.15.53:0/963462887 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:23.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:23.233+0000 7efe6a681640 1 --2- 172.21.15.53:0/963462887 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe640c9840 0x7efe64157b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:23.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:23.233+0000 7efe6967f640 1 --2- 172.21.15.53:0/963462887 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe640afc60 0x7efe640c2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:23.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:23.233+0000 7efe69e80640 1 -- 172.21.15.53:0/963462887 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe640c9840 msgr2=0x7efe64157b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:23.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:23.233+0000 7efe69e80640 1 --2- 172.21.15.53:0/963462887 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe640c9840 0x7efe64157b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:23.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:23.233+0000 7efe69e80640 1 -- 172.21.15.53:0/963462887 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe640afc60 msgr2=0x7efe640c2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:23.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:23.233+0000 7efe69e80640 1 --2- 172.21.15.53:0/963462887 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe640afc60 0x7efe640c2e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:23.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:23.233+0000 7efe69e80640 1 -- 172.21.15.53:0/963462887 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe5c009a70 con 0x7efe64071060 2023-06-10T19:03:23.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:23.233+0000 7efe69e80640 1 --2- 172.21.15.53:0/963462887 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe64071060 0x7efe640c2590 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7efe6000c400 tx=0x7efe6000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:23.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:23.233+0000 7efe5a7fc640 1 -- 172.21.15.53:0/963462887 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe60005cf0 con 0x7efe64071060 2023-06-10T19:03:23.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:23.233+0000 7efe5a7fc640 1 -- 172.21.15.53:0/963462887 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe60005e50 con 0x7efe64071060 2023-06-10T19:03:23.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:23.233+0000 7efe6c0e4640 1 -- 172.21.15.53:0/963462887 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe54009420 con 0x7efe64071060 2023-06-10T19:03:23.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:23.233+0000 7efe5a7fc640 1 -- 172.21.15.53:0/963462887 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe600072d0 con 0x7efe64071060 2023-06-10T19:03:23.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:23.233+0000 7efe6c0e4640 1 -- 172.21.15.53:0/963462887 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe640c1d90 con 0x7efe64071060 2023-06-10T19:03:23.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:23.233+0000 7efe6c0e4640 1 -- 172.21.15.53:0/963462887 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe6404d790 con 0x7efe64071060 2023-06-10T19:03:23.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:23.233+0000 7efe5a7fc640 1 -- 172.21.15.53:0/963462887 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7efe60007430 con 0x7efe64071060 2023-06-10T19:03:23.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:23.237+0000 7efe5a7fc640 1 --2- 172.21.15.53:0/963462887 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efe48066280 0x7efe48068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:23.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:23.237+0000 7efe5a7fc640 1 -- 172.21.15.53:0/963462887 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6264+0+0 (secure 0 0 0) 0x7efe60083360 con 0x7efe64071060 2023-06-10T19:03:23.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:23.237+0000 7efe6967f640 1 --2- 172.21.15.53:0/963462887 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efe48066280 0x7efe48068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:23.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:23.237+0000 7efe6967f640 1 --2- 172.21.15.53:0/963462887 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efe48066280 0x7efe48068730 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7efe540af000 tx=0x7efe540a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:23.243 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:23.241+0000 7efe5a7fc640 1 -- 172.21.15.53:0/963462887 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7efe60050740 con 0x7efe64071060 2023-06-10T19:03:23.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:23.425+0000 7efe6c0e4640 1 -- 172.21.15.53:0/963462887 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efe64153990 con 0x7efe64071060 2023-06-10T19:03:23.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:23.429+0000 7efe5a7fc640 1 -- 172.21.15.53:0/963462887 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+4683 (secure 0 0 0) 0x7efe60053d60 con 0x7efe64071060 2023-06-10T19:03:23.432 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:03:23.432 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1617157670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1617157670},{"type":"v1","addr":"172.21.15.117:6836","nonce":1617157670}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6113,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3414416090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":3414416090},{"type":"v1","addr":"172.21.15.117:6837","nonce":3414416090}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6718,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2533467097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2533467097},{"type":"v1","addr":"172.21.15.53:6835","nonce":2533467097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:02:02.642809+0000","modified":"2023-06-10T19:02:36.149418+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8127":{"gid":8127,"name":"a","rank":0,"incarnation":52,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.53:6833/2984379521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2984379521},{"type":"v1","addr":"172.21.15.53:6833","nonce":2984379521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-06-10T19:03:23.433 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 53 2023-06-10T19:03:23.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:23.429+0000 7efe6c0e4640 1 -- 172.21.15.53:0/963462887 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efe48066280 msgr2=0x7efe48068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:23.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:23.429+0000 7efe6c0e4640 1 --2- 172.21.15.53:0/963462887 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efe48066280 0x7efe48068730 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7efe540af000 tx=0x7efe540a7000 comp rx=0 tx=0).stop 2023-06-10T19:03:23.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:23.429+0000 7efe6c0e4640 1 -- 172.21.15.53:0/963462887 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe64071060 msgr2=0x7efe640c2590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:23.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:23.429+0000 7efe6c0e4640 1 --2- 172.21.15.53:0/963462887 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe64071060 0x7efe640c2590 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7efe6000c400 tx=0x7efe6000c8c0 comp rx=0 tx=0).stop 2023-06-10T19:03:23.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:23.429+0000 7efe6c0e4640 1 -- 172.21.15.53:0/963462887 shutdown_connections 2023-06-10T19:03:23.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:23.429+0000 7efe6c0e4640 1 --2- 172.21.15.53:0/963462887 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efe48066280 0x7efe48068730 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:23.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:23.429+0000 7efe6c0e4640 1 --2- 172.21.15.53:0/963462887 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe640c9840 0x7efe64157b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:23.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:23.429+0000 7efe6c0e4640 1 --2- 172.21.15.53:0/963462887 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe640afc60 0x7efe640c2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:23.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:23.429+0000 7efe6c0e4640 1 --2- 172.21.15.53:0/963462887 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe64071060 0x7efe640c2590 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:23.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:23.429+0000 7efe6c0e4640 1 -- 172.21.15.53:0/963462887 >> 172.21.15.53:0/963462887 conn(0x7efe6406a0d0 msgr2=0x7efe640ce4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:23.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:23.429+0000 7efe6c0e4640 1 -- 172.21.15.53:0/963462887 shutdown_connections 2023-06-10T19:03:23.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:23.429+0000 7efe6c0e4640 1 -- 172.21.15.53:0/963462887 wait complete. 2023-06-10T19:03:23.450 DEBUG:tasks.cephfs.filesystem:mapped states ['up:reconnect'] to None 2023-06-10T19:03:24.451 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:03:24.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.581+0000 7f6270550640 1 Processor -- start 2023-06-10T19:03:24.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.581+0000 7f6270550640 1 -- start start 2023-06-10T19:03:24.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.581+0000 7f6270550640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6268159690 0x7f6268070950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:24.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.581+0000 7f6270550640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62680cb080 con 0x7f62680b0f30 2023-06-10T19:03:24.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.581+0000 7f6270550640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62680cb320 con 0x7f6268159a60 2023-06-10T19:03:24.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.581+0000 7f6270550640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6268070e90 con 0x7f6268159690 2023-06-10T19:03:24.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.581+0000 7f626daeb640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f62680b0f30 0x7f62680cbe00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:46488/0 (socket says 172.21.15.53:46488) 2023-06-10T19:03:24.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.581+0000 7f626daeb640 1 -- 172.21.15.53:0/1636590230 learned_addr learned my addr 172.21.15.53:0/1636590230 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:03:24.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.581+0000 7f626e2ec640 1 --2- 172.21.15.53:0/1636590230 >> v2:172.21.15.117:3300/0 conn(0x7f6268159690 0x7f6268070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:24.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.581+0000 7f626d2ea640 1 -- 172.21.15.53:0/1636590230 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 76582530 0 0) 0x7f62680cb080 con 0x7f62680b0f30 2023-06-10T19:03:24.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.581+0000 7f626d2ea640 1 -- 172.21.15.53:0/1636590230 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6254003530 con 0x7f62680b0f30 2023-06-10T19:03:24.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.581+0000 7f626d2ea640 1 -- 172.21.15.53:0/1636590230 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 983962416 0 0) 0x7f6254003530 con 0x7f62680b0f30 2023-06-10T19:03:24.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.581+0000 7f626d2ea640 1 -- 172.21.15.53:0/1636590230 >> v2:172.21.15.117:3300/0 conn(0x7f6268159690 msgr2=0x7f6268070950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:24.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.581+0000 7f626d2ea640 1 --2- 172.21.15.53:0/1636590230 >> v2:172.21.15.117:3300/0 conn(0x7f6268159690 0x7f6268070950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:24.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.581+0000 7f626d2ea640 1 -- 172.21.15.53:0/1636590230 >> v1:172.21.15.117:6789/0 conn(0x7f6268159a60 legacy=0x7f62680c2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:24.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.581+0000 7f626d2ea640 1 -- 172.21.15.53:0/1636590230 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62680cb600 con 0x7f62680b0f30 2023-06-10T19:03:24.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.581+0000 7f626d2ea640 1 -- 172.21.15.53:0/1636590230 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f6258001680 con 0x7f62680b0f30 2023-06-10T19:03:24.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.581+0000 7f626d2ea640 1 -- 172.21.15.53:0/1636590230 >> v1:172.21.15.53:6789/0 conn(0x7f62680b0f30 legacy=0x7f62680cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:24.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.581+0000 7f626d2ea640 1 --2- 172.21.15.53:0/1636590230 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62540039f0 0x7f6254003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:24.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.581+0000 7f626d2ea640 1 --2- 172.21.15.53:0/1636590230 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62540047d0 0x7f6254004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:24.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.581+0000 7f626d2ea640 1 --2- 172.21.15.53:0/1636590230 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6254005180 0x7f625400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:24.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.581+0000 7f626d2ea640 1 -- 172.21.15.53:0/1636590230 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6268070e90 con 0x7f62540047d0 2023-06-10T19:03:24.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.581+0000 7f626d2ea640 1 -- 172.21.15.53:0/1636590230 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f625400c060 con 0x7f62540039f0 2023-06-10T19:03:24.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.581+0000 7f626d2ea640 1 -- 172.21.15.53:0/1636590230 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f625400c220 con 0x7f6254005180 2023-06-10T19:03:24.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.581+0000 7f626daeb640 1 --2- 172.21.15.53:0/1636590230 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62540047d0 0x7f6254004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:24.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.581+0000 7f626e2ec640 1 --2- 172.21.15.53:0/1636590230 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62540039f0 0x7f6254003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:24.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.581+0000 7f626eaed640 1 --2- 172.21.15.53:0/1636590230 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6254005180 0x7f625400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:24.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.581+0000 7f626daeb640 1 -- 172.21.15.53:0/1636590230 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6254005180 msgr2=0x7f625400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:24.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.581+0000 7f626daeb640 1 --2- 172.21.15.53:0/1636590230 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6254005180 0x7f625400b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:24.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.581+0000 7f626daeb640 1 -- 172.21.15.53:0/1636590230 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62540039f0 msgr2=0x7f6254003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:24.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.581+0000 7f626daeb640 1 --2- 172.21.15.53:0/1636590230 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62540039f0 0x7f6254003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:24.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.581+0000 7f626daeb640 1 -- 172.21.15.53:0/1636590230 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6254003530 con 0x7f62540047d0 2023-06-10T19:03:24.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.581+0000 7f626eaed640 1 -- 172.21.15.53:0/1636590230 reap_dead start 2023-06-10T19:03:24.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.585+0000 7f626daeb640 1 --2- 172.21.15.53:0/1636590230 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62540047d0 0x7f6254004c40 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f625800c240 tx=0x7f625801f3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be272707804ceee8 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:24.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.585+0000 7f626d2ea640 1 -- 172.21.15.53:0/1636590230 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6258005ae0 con 0x7f62540047d0 2023-06-10T19:03:24.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.585+0000 7f626d2ea640 1 -- 172.21.15.53:0/1636590230 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62580ab070 con 0x7f62540047d0 2023-06-10T19:03:24.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.585+0000 7f626d2ea640 1 -- 172.21.15.53:0/1636590230 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6258007070 con 0x7f62540047d0 2023-06-10T19:03:24.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.585+0000 7f6270550640 1 -- 172.21.15.53:0/1636590230 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62540047d0 msgr2=0x7f6254004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:24.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.585+0000 7f6270550640 1 --2- 172.21.15.53:0/1636590230 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62540047d0 0x7f6254004c40 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f625800c240 tx=0x7f625801f3b0 comp rx=0 tx=0).stop 2023-06-10T19:03:24.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.585+0000 7f6270550640 1 -- 172.21.15.53:0/1636590230 shutdown_connections 2023-06-10T19:03:24.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.585+0000 7f6270550640 1 --2- 172.21.15.53:0/1636590230 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62540047d0 0x7f6254004c40 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:24.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.585+0000 7f6270550640 1 -- 172.21.15.53:0/1636590230 >> 172.21.15.53:0/1636590230 conn(0x7f626806a560 msgr2=0x7f626806a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:24.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.585+0000 7f6270550640 1 -- 172.21.15.53:0/1636590230 shutdown_connections 2023-06-10T19:03:24.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.585+0000 7f6270550640 1 -- 172.21.15.53:0/1636590230 wait complete. 2023-06-10T19:03:24.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.585+0000 7f6270550640 1 Processor -- start 2023-06-10T19:03:24.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.585+0000 7f6270550640 1 -- start start 2023-06-10T19:03:24.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.585+0000 7f6270550640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62540047d0 0x7f62680c7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:24.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.585+0000 7f6270550640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62680c6b50 0x7f62681445b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:24.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.585+0000 7f6270550640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f626806a930 0x7f626806adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:24.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.585+0000 7f6270550640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f626806b2f0 con 0x7f62680c6b50 2023-06-10T19:03:24.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.585+0000 7f6270550640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62680c8ea0 con 0x7f626806a930 2023-06-10T19:03:24.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.589+0000 7f6270550640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62680c8220 con 0x7f62540047d0 2023-06-10T19:03:24.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.589+0000 7f626daeb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62680c6b50 0x7f62681445b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:24.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.589+0000 7f626daeb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62680c6b50 0x7f62681445b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48530/0 (socket says 172.21.15.53:48530) 2023-06-10T19:03:24.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.589+0000 7f626daeb640 1 -- 172.21.15.53:0/2710912331 learned_addr learned my addr 172.21.15.53:0/2710912331 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:24.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.589+0000 7f626e2ec640 1 --2- 172.21.15.53:0/2710912331 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62540047d0 0x7f62680c7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:24.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.589+0000 7f626eaed640 1 --2- 172.21.15.53:0/2710912331 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f626806a930 0x7f626806adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:24.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.589+0000 7f626daeb640 1 -- 172.21.15.53:0/2710912331 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62540047d0 msgr2=0x7f62680c7bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:24.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.589+0000 7f626daeb640 1 --2- 172.21.15.53:0/2710912331 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62540047d0 0x7f62680c7bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:24.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.589+0000 7f626daeb640 1 -- 172.21.15.53:0/2710912331 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f626806a930 msgr2=0x7f626806adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:24.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.589+0000 7f626daeb640 1 --2- 172.21.15.53:0/2710912331 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f626806a930 0x7f626806adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:24.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.589+0000 7f626daeb640 1 -- 172.21.15.53:0/2710912331 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62680c8500 con 0x7f62680c6b50 2023-06-10T19:03:24.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.589+0000 7f626daeb640 1 --2- 172.21.15.53:0/2710912331 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62680c6b50 0x7f62681445b0 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f625801f1e0 tx=0x7f6254005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:24.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.589+0000 7f625effd640 1 -- 172.21.15.53:0/2710912331 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6258001640 con 0x7f62680c6b50 2023-06-10T19:03:24.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.589+0000 7f625effd640 1 -- 172.21.15.53:0/2710912331 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6258007070 con 0x7f62680c6b50 2023-06-10T19:03:24.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.589+0000 7f625effd640 1 -- 172.21.15.53:0/2710912331 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6258007400 con 0x7f62680c6b50 2023-06-10T19:03:24.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.589+0000 7f6270550640 1 -- 172.21.15.53:0/2710912331 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62680c87e0 con 0x7f62680c6b50 2023-06-10T19:03:24.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.589+0000 7f6270550640 1 -- 172.21.15.53:0/2710912331 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6268144af0 con 0x7f62680c6b50 2023-06-10T19:03:24.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.589+0000 7f6270550640 1 -- 172.21.15.53:0/2710912331 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62680b4dc0 con 0x7f62680c6b50 2023-06-10T19:03:24.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.589+0000 7f625effd640 1 -- 172.21.15.53:0/2710912331 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f62580b9030 con 0x7f62680c6b50 2023-06-10T19:03:24.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.589+0000 7f625effd640 1 --2- 172.21.15.53:0/2710912331 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f624c0662b0 0x7f624c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:24.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.589+0000 7f625effd640 1 -- 172.21.15.53:0/2710912331 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6264+0+0 (secure 0 0 0) 0x7f62580b7070 con 0x7f62680c6b50 2023-06-10T19:03:24.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.589+0000 7f626e2ec640 1 --2- 172.21.15.53:0/2710912331 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f624c0662b0 0x7f624c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:24.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.589+0000 7f626e2ec640 1 --2- 172.21.15.53:0/2710912331 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f624c0662b0 0x7f624c068760 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f62640099f0 tx=0x7f6264008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:24.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.593+0000 7f625effd640 1 -- 172.21.15.53:0/2710912331 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f62580edfc0 con 0x7f62680c6b50 2023-06-10T19:03:24.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.777+0000 7f6270550640 1 -- 172.21.15.53:0/2710912331 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6268144e30 con 0x7f62680c6b50 2023-06-10T19:03:24.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.781+0000 7f625effd640 1 -- 172.21.15.53:0/2710912331 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+4683 (secure 0 0 0) 0x7f6268144e30 con 0x7f62680c6b50 2023-06-10T19:03:24.784 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:03:24.784 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1617157670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1617157670},{"type":"v1","addr":"172.21.15.117:6836","nonce":1617157670}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6113,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3414416090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":3414416090},{"type":"v1","addr":"172.21.15.117:6837","nonce":3414416090}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6718,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2533467097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2533467097},{"type":"v1","addr":"172.21.15.53:6835","nonce":2533467097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:02:02.642809+0000","modified":"2023-06-10T19:02:36.149418+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8127":{"gid":8127,"name":"a","rank":0,"incarnation":52,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.53:6833/2984379521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2984379521},{"type":"v1","addr":"172.21.15.53:6833","nonce":2984379521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-06-10T19:03:24.785 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 53 2023-06-10T19:03:24.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.781+0000 7f6270550640 1 -- 172.21.15.53:0/2710912331 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f624c0662b0 msgr2=0x7f624c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:24.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.781+0000 7f6270550640 1 --2- 172.21.15.53:0/2710912331 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f624c0662b0 0x7f624c068760 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f62640099f0 tx=0x7f6264008040 comp rx=0 tx=0).stop 2023-06-10T19:03:24.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.781+0000 7f6270550640 1 -- 172.21.15.53:0/2710912331 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62680c6b50 msgr2=0x7f62681445b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:24.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.781+0000 7f6270550640 1 --2- 172.21.15.53:0/2710912331 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62680c6b50 0x7f62681445b0 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f625801f1e0 tx=0x7f6254005800 comp rx=0 tx=0).stop 2023-06-10T19:03:24.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.781+0000 7f6270550640 1 -- 172.21.15.53:0/2710912331 shutdown_connections 2023-06-10T19:03:24.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.781+0000 7f6270550640 1 --2- 172.21.15.53:0/2710912331 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f624c0662b0 0x7f624c068760 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:24.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.781+0000 7f6270550640 1 --2- 172.21.15.53:0/2710912331 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f626806a930 0x7f626806adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:24.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.781+0000 7f6270550640 1 --2- 172.21.15.53:0/2710912331 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62680c6b50 0x7f62681445b0 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:24.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.781+0000 7f6270550640 1 --2- 172.21.15.53:0/2710912331 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f62540047d0 0x7f62680c7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:24.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.781+0000 7f6270550640 1 -- 172.21.15.53:0/2710912331 >> 172.21.15.53:0/2710912331 conn(0x7f626806a560 msgr2=0x7f6268156f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:24.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.781+0000 7f6270550640 1 -- 172.21.15.53:0/2710912331 shutdown_connections 2023-06-10T19:03:24.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:24.781+0000 7f6270550640 1 -- 172.21.15.53:0/2710912331 wait complete. 2023-06-10T19:03:24.804 DEBUG:tasks.cephfs.filesystem:mapped states ['up:reconnect'] to None 2023-06-10T19:03:25.806 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:03:25.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:25.937+0000 7f40ec79a640 1 Processor -- start 2023-06-10T19:03:25.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:25.937+0000 7f40ec79a640 1 -- start start 2023-06-10T19:03:25.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:25.937+0000 7f40ec79a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f40e40c9840 0x7f40e40c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:25.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:25.937+0000 7f40ec79a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f40e4071060 0x7f40e40af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:25.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:25.937+0000 7f40ec79a640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40e4159b50 con 0x7f40e40afc60 2023-06-10T19:03:25.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:25.937+0000 7f40ec79a640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40e40ca150 con 0x7f40e40c9840 2023-06-10T19:03:25.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:25.937+0000 7f40ec79a640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40e40702a0 con 0x7f40e4071060 2023-06-10T19:03:25.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:25.937+0000 7f40ea536640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f40e40c9840 0x7f40e40c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:25.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:25.937+0000 7f40ead37640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f40e40afc60 0x7f40e415d2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:46494/0 (socket says 172.21.15.53:46494) 2023-06-10T19:03:25.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:25.937+0000 7f40ead37640 1 -- 172.21.15.53:0/2085628972 learned_addr learned my addr 172.21.15.53:0/2085628972 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:03:25.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:25.937+0000 7f40e9d35640 1 --2- 172.21.15.53:0/2085628972 >> v2:172.21.15.117:3300/0 conn(0x7f40e4071060 0x7f40e40af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:25.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:25.937+0000 7f40ea536640 1 -- 172.21.15.53:0/2085628972 >> v2:172.21.15.117:3300/0 conn(0x7f40e4071060 msgr2=0x7f40e40af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:25.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:25.937+0000 7f40ea536640 1 --2- 172.21.15.53:0/2085628972 >> v2:172.21.15.117:3300/0 conn(0x7f40e4071060 0x7f40e40af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:25.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:25.937+0000 7f40ea536640 1 -- 172.21.15.53:0/2085628972 >> v1:172.21.15.53:6789/0 conn(0x7f40e40afc60 legacy=0x7f40e415d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:25.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:25.937+0000 7f40ea536640 1 -- 172.21.15.53:0/2085628972 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e4070580 con 0x7f40e40c9840 2023-06-10T19:03:25.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:25.937+0000 7f40e9534640 1 -- 172.21.15.53:0/2085628972 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2662315236 0 0) 0x7f40e4159b50 con 0x7f40e40afc60 2023-06-10T19:03:25.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:25.941+0000 7f40ea536640 1 --2- 172.21.15.53:0/2085628972 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40e40c9840 0x7f40e40c9c10 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f40e406e650 tx=0x7f40e001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14254a5267d009aa server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:25.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:25.941+0000 7f40e9534640 1 -- 172.21.15.53:0/2085628972 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e0004230 con 0x7f40e40c9840 2023-06-10T19:03:25.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:25.941+0000 7f40e9534640 1 -- 172.21.15.53:0/2085628972 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40e00a7050 con 0x7f40e40c9840 2023-06-10T19:03:25.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:25.941+0000 7f40e9534640 1 -- 172.21.15.53:0/2085628972 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e0003620 con 0x7f40e40c9840 2023-06-10T19:03:25.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:25.941+0000 7f40ec79a640 1 -- 172.21.15.53:0/2085628972 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40e40c9840 msgr2=0x7f40e40c9c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:25.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:25.941+0000 7f40ec79a640 1 --2- 172.21.15.53:0/2085628972 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40e40c9840 0x7f40e40c9c10 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f40e406e650 tx=0x7f40e001c430 comp rx=0 tx=0).stop 2023-06-10T19:03:25.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:25.941+0000 7f40ec79a640 1 -- 172.21.15.53:0/2085628972 shutdown_connections 2023-06-10T19:03:25.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:25.941+0000 7f40ec79a640 1 --2- 172.21.15.53:0/2085628972 >> v2:172.21.15.117:3300/0 conn(0x7f40e4071060 0x7f40e40af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:25.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:25.941+0000 7f40ec79a640 1 --2- 172.21.15.53:0/2085628972 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40e40c9840 0x7f40e40c9c10 unknown :-1 s=CLOSED pgs=1605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:25.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:25.941+0000 7f40ec79a640 1 -- 172.21.15.53:0/2085628972 >> 172.21.15.53:0/2085628972 conn(0x7f40e406a0d0 msgr2=0x7f40e40ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:25.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:25.941+0000 7f40ec79a640 1 -- 172.21.15.53:0/2085628972 shutdown_connections 2023-06-10T19:03:25.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:25.941+0000 7f40ec79a640 1 -- 172.21.15.53:0/2085628972 wait complete. 2023-06-10T19:03:25.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:25.941+0000 7f40ec79a640 1 Processor -- start 2023-06-10T19:03:25.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:25.941+0000 7f40ec79a640 1 -- start start 2023-06-10T19:03:25.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:25.941+0000 7f40ec79a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40e4071060 0x7f40e40c43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:25.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:25.941+0000 7f40ec79a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40e40afc60 0x7f40e40aed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:25.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:25.941+0000 7f40ec79a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40e40c9840 0x7f40e40b1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:25.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:25.941+0000 7f40ec79a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e40c2c70 con 0x7f40e4071060 2023-06-10T19:03:25.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:25.941+0000 7f40ec79a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e40c2f50 con 0x7f40e40c9840 2023-06-10T19:03:25.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:25.941+0000 7f40ec79a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40e40c3230 con 0x7f40e40afc60 2023-06-10T19:03:25.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:25.941+0000 7f40ea536640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40e4071060 0x7f40e40c43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:25.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:25.941+0000 7f40ea536640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40e4071060 0x7f40e40c43a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48560/0 (socket says 172.21.15.53:48560) 2023-06-10T19:03:25.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:25.941+0000 7f40ea536640 1 -- 172.21.15.53:0/1758322723 learned_addr learned my addr 172.21.15.53:0/1758322723 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:25.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:25.941+0000 7f40ead37640 1 --2- 172.21.15.53:0/1758322723 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40e40c9840 0x7f40e40b1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:25.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:25.941+0000 7f40e9d35640 1 --2- 172.21.15.53:0/1758322723 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40e40afc60 0x7f40e40aed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:25.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:25.941+0000 7f40ea536640 1 -- 172.21.15.53:0/1758322723 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40e40afc60 msgr2=0x7f40e40aed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:25.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:25.941+0000 7f40ea536640 1 --2- 172.21.15.53:0/1758322723 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40e40afc60 0x7f40e40aed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:25.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:25.941+0000 7f40ea536640 1 -- 172.21.15.53:0/1758322723 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40e40c9840 msgr2=0x7f40e40b1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:25.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:25.941+0000 7f40ea536640 1 --2- 172.21.15.53:0/1758322723 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40e40c9840 0x7f40e40b1b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:25.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:25.941+0000 7f40ea536640 1 -- 172.21.15.53:0/1758322723 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e0009420 con 0x7f40e4071060 2023-06-10T19:03:25.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:25.941+0000 7f40ead37640 1 --2- 172.21.15.53:0/1758322723 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40e40c9840 0x7f40e40b1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:03:25.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:25.945+0000 7f40ea536640 1 --2- 172.21.15.53:0/1758322723 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40e4071060 0x7f40e40c43a0 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f40e001a060 tx=0x7f40e00191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:25.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:25.945+0000 7f40daffd640 1 -- 172.21.15.53:0/1758322723 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e0003ab0 con 0x7f40e4071060 2023-06-10T19:03:25.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:25.945+0000 7f40daffd640 1 -- 172.21.15.53:0/1758322723 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40e0003c10 con 0x7f40e4071060 2023-06-10T19:03:25.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:25.945+0000 7f40ec79a640 1 -- 172.21.15.53:0/1758322723 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40e40c3510 con 0x7f40e4071060 2023-06-10T19:03:25.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:25.945+0000 7f40daffd640 1 -- 172.21.15.53:0/1758322723 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e00ab440 con 0x7f40e4071060 2023-06-10T19:03:25.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:25.945+0000 7f40ec79a640 1 -- 172.21.15.53:0/1758322723 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40e414e180 con 0x7f40e4071060 2023-06-10T19:03:25.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:25.945+0000 7f40ec79a640 1 -- 172.21.15.53:0/1758322723 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40e404d790 con 0x7f40e4071060 2023-06-10T19:03:25.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:25.945+0000 7f40daffd640 1 -- 172.21.15.53:0/1758322723 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f40e00b2050 con 0x7f40e4071060 2023-06-10T19:03:25.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:25.945+0000 7f40daffd640 1 --2- 172.21.15.53:0/1758322723 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f40c8066280 0x7f40c8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:25.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:25.945+0000 7f40daffd640 1 -- 172.21.15.53:0/1758322723 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f40e011e620 con 0x7f40e4071060 2023-06-10T19:03:25.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:25.945+0000 7f40e9d35640 1 --2- 172.21.15.53:0/1758322723 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f40c8066280 0x7f40c8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:25.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:25.945+0000 7f40e9d35640 1 --2- 172.21.15.53:0/1758322723 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f40c8066280 0x7f40c8068730 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f40e40adc20 tx=0x7f40d4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:25.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:25.949+0000 7f40daffd640 1 -- 172.21.15.53:0/1758322723 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f40e00eba10 con 0x7f40e4071060 2023-06-10T19:03:26.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:26.141+0000 7f40ec79a640 1 -- 172.21.15.53:0/1758322723 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f40e40cb140 con 0x7f40e4071060 2023-06-10T19:03:26.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:26.141+0000 7f40daffd640 1 -- 172.21.15.53:0/1758322723 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+4683 (secure 0 0 0) 0x7f40e00ef030 con 0x7f40e4071060 2023-06-10T19:03:26.145 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:03:26.146 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1617157670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1617157670},{"type":"v1","addr":"172.21.15.117:6836","nonce":1617157670}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6113,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3414416090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":3414416090},{"type":"v1","addr":"172.21.15.117:6837","nonce":3414416090}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6718,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2533467097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2533467097},{"type":"v1","addr":"172.21.15.53:6835","nonce":2533467097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:02:02.642809+0000","modified":"2023-06-10T19:02:36.149418+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8127":{"gid":8127,"name":"a","rank":0,"incarnation":52,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.53:6833/2984379521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2984379521},{"type":"v1","addr":"172.21.15.53:6833","nonce":2984379521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-06-10T19:03:26.146 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 53 2023-06-10T19:03:26.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:26.141+0000 7f40ec79a640 1 -- 172.21.15.53:0/1758322723 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f40c8066280 msgr2=0x7f40c8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:26.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:26.141+0000 7f40ec79a640 1 --2- 172.21.15.53:0/1758322723 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f40c8066280 0x7f40c8068730 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f40e40adc20 tx=0x7f40d4008040 comp rx=0 tx=0).stop 2023-06-10T19:03:26.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:26.141+0000 7f40ec79a640 1 -- 172.21.15.53:0/1758322723 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40e4071060 msgr2=0x7f40e40c43a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:26.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:26.141+0000 7f40ec79a640 1 --2- 172.21.15.53:0/1758322723 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40e4071060 0x7f40e40c43a0 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f40e001a060 tx=0x7f40e00191d0 comp rx=0 tx=0).stop 2023-06-10T19:03:26.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:26.145+0000 7f40ec79a640 1 -- 172.21.15.53:0/1758322723 shutdown_connections 2023-06-10T19:03:26.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:26.145+0000 7f40ec79a640 1 --2- 172.21.15.53:0/1758322723 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f40c8066280 0x7f40c8068730 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:26.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:26.145+0000 7f40ec79a640 1 --2- 172.21.15.53:0/1758322723 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40e40c9840 0x7f40e40b1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:26.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:26.145+0000 7f40ec79a640 1 --2- 172.21.15.53:0/1758322723 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40e40afc60 0x7f40e40aed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:26.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:26.145+0000 7f40ec79a640 1 --2- 172.21.15.53:0/1758322723 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40e4071060 0x7f40e40c43a0 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:26.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:26.145+0000 7f40ec79a640 1 -- 172.21.15.53:0/1758322723 >> 172.21.15.53:0/1758322723 conn(0x7f40e406a0d0 msgr2=0x7f40e40adc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:26.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:26.145+0000 7f40ec79a640 1 -- 172.21.15.53:0/1758322723 shutdown_connections 2023-06-10T19:03:26.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:26.145+0000 7f40ec79a640 1 -- 172.21.15.53:0/1758322723 wait complete. 2023-06-10T19:03:26.164 DEBUG:tasks.cephfs.filesystem:mapped states ['up:reconnect'] to None 2023-06-10T19:03:27.166 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:03:27.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.349+0000 7ff795ef4640 1 Processor -- start 2023-06-10T19:03:27.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.349+0000 7ff795ef4640 1 -- start start 2023-06-10T19:03:27.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.353+0000 7ff795ef4640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff7900cec40 0x7ff7900cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:27.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.353+0000 7ff795ef4640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff7900cbf50 0x7ff7900cc390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:27.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.353+0000 7ff795ef4640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7900cbac0 con 0x7ff790159450 2023-06-10T19:03:27.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.353+0000 7ff795ef4640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7900cf600 con 0x7ff7900cbf50 2023-06-10T19:03:27.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.353+0000 7ff795ef4640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff79015dc00 con 0x7ff7900cec40 2023-06-10T19:03:27.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.353+0000 7ff78effd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff7900cec40 0x7ff7900cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:27.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.353+0000 7ff78effd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff7900cec40 0x7ff7900cf0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.53:60116/0 (socket says 172.21.15.53:60116) 2023-06-10T19:03:27.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.353+0000 7ff78effd640 1 -- 172.21.15.53:0/2239134541 learned_addr learned my addr 172.21.15.53:0/2239134541 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:27.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.353+0000 7ff78ffff640 1 --2- 172.21.15.53:0/2239134541 >> v2:172.21.15.53:3300/0 conn(0x7ff7900cbf50 0x7ff7900cc390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:27.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.353+0000 7ff78f7fe640 1 --1- 172.21.15.53:0/2239134541 >> v1:172.21.15.117:6789/0 conn(0x7ff790159450 0x7ff79015d140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.53:43510/0 (socket says 172.21.15.53:43510) 2023-06-10T19:03:27.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.353+0000 7ff78effd640 1 -- 172.21.15.53:0/2239134541 >> v2:172.21.15.53:3300/0 conn(0x7ff7900cbf50 msgr2=0x7ff7900cc390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:27.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.353+0000 7ff78effd640 1 --2- 172.21.15.53:0/2239134541 >> v2:172.21.15.53:3300/0 conn(0x7ff7900cbf50 0x7ff7900cc390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:27.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.353+0000 7ff78effd640 1 -- 172.21.15.53:0/2239134541 >> v1:172.21.15.117:6789/0 conn(0x7ff790159450 legacy=0x7ff79015d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:27.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.353+0000 7ff78effd640 1 -- 172.21.15.53:0/2239134541 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff79015dee0 con 0x7ff7900cec40 2023-06-10T19:03:27.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.353+0000 7ff78e7fc640 1 -- 172.21.15.53:0/2239134541 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3800044800 0 0) 0x7ff7900cbac0 con 0x7ff790159450 2023-06-10T19:03:27.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.353+0000 7ff78effd640 1 --2- 172.21.15.53:0/2239134541 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7900cec40 0x7ff7900cf0c0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7ff79006df40 tx=0x7ff78401c4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e15b86847a4e2773 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:27.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.353+0000 7ff78e7fc640 1 -- 172.21.15.53:0/2239134541 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7840aa5f0 con 0x7ff7900cec40 2023-06-10T19:03:27.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.353+0000 7ff78e7fc640 1 -- 172.21.15.53:0/2239134541 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7840aa750 con 0x7ff7900cec40 2023-06-10T19:03:27.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.353+0000 7ff78e7fc640 1 -- 172.21.15.53:0/2239134541 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7840aaae0 con 0x7ff7900cec40 2023-06-10T19:03:27.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.357+0000 7ff795ef4640 1 -- 172.21.15.53:0/2239134541 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7900cec40 msgr2=0x7ff7900cf0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:27.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.357+0000 7ff795ef4640 1 --2- 172.21.15.53:0/2239134541 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7900cec40 0x7ff7900cf0c0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7ff79006df40 tx=0x7ff78401c4d0 comp rx=0 tx=0).stop 2023-06-10T19:03:27.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.357+0000 7ff795ef4640 1 -- 172.21.15.53:0/2239134541 shutdown_connections 2023-06-10T19:03:27.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.357+0000 7ff795ef4640 1 --2- 172.21.15.53:0/2239134541 >> v2:172.21.15.53:3300/0 conn(0x7ff7900cbf50 0x7ff7900cc390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:27.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.357+0000 7ff795ef4640 1 --2- 172.21.15.53:0/2239134541 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7900cec40 0x7ff7900cf0c0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:27.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.357+0000 7ff795ef4640 1 -- 172.21.15.53:0/2239134541 >> 172.21.15.53:0/2239134541 conn(0x7ff79006a090 msgr2=0x7ff79006d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:27.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.357+0000 7ff795ef4640 1 -- 172.21.15.53:0/2239134541 shutdown_connections 2023-06-10T19:03:27.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.357+0000 7ff795ef4640 1 -- 172.21.15.53:0/2239134541 wait complete. 2023-06-10T19:03:27.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.357+0000 7ff795ef4640 1 Processor -- start 2023-06-10T19:03:27.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.357+0000 7ff795ef4640 1 -- start start 2023-06-10T19:03:27.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.357+0000 7ff795ef4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7900cbf50 0x7ff790150d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:27.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.357+0000 7ff795ef4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff7900cec40 0x7ff790150050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:27.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.357+0000 7ff795ef4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff790159450 0x7ff79014f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:27.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.357+0000 7ff795ef4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff790150590 con 0x7ff7900cec40 2023-06-10T19:03:27.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.357+0000 7ff795ef4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7901513c0 con 0x7ff7900cbf50 2023-06-10T19:03:27.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.357+0000 7ff795ef4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7901516a0 con 0x7ff790159450 2023-06-10T19:03:27.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.357+0000 7ff78effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff7900cec40 0x7ff790150050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:27.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.357+0000 7ff78effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff7900cec40 0x7ff790150050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48568/0 (socket says 172.21.15.53:48568) 2023-06-10T19:03:27.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.357+0000 7ff78effd640 1 -- 172.21.15.53:0/309225267 learned_addr learned my addr 172.21.15.53:0/309225267 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:27.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.357+0000 7ff78f7fe640 1 --2- 172.21.15.53:0/309225267 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7900cbf50 0x7ff790150d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:27.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.357+0000 7ff78ffff640 1 --2- 172.21.15.53:0/309225267 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff790159450 0x7ff79014f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:27.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.357+0000 7ff78effd640 1 -- 172.21.15.53:0/309225267 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff790159450 msgr2=0x7ff79014f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:27.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.357+0000 7ff78effd640 1 --2- 172.21.15.53:0/309225267 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff790159450 0x7ff79014f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:27.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.357+0000 7ff78effd640 1 -- 172.21.15.53:0/309225267 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7900cbf50 msgr2=0x7ff790150d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:27.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.357+0000 7ff78effd640 1 --2- 172.21.15.53:0/309225267 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7900cbf50 0x7ff790150d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:27.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.357+0000 7ff78effd640 1 -- 172.21.15.53:0/309225267 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7840094d0 con 0x7ff7900cec40 2023-06-10T19:03:27.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.357+0000 7ff78ffff640 1 --2- 172.21.15.53:0/309225267 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff790159450 0x7ff79014f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:03:27.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.357+0000 7ff78effd640 1 --2- 172.21.15.53:0/309225267 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff7900cec40 0x7ff790150050 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7ff7840190e0 tx=0x7ff78401ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:27.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.357+0000 7ff777fff640 1 -- 172.21.15.53:0/309225267 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7840b3800 con 0x7ff7900cec40 2023-06-10T19:03:27.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.357+0000 7ff777fff640 1 -- 172.21.15.53:0/309225267 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7840b3960 con 0x7ff7900cec40 2023-06-10T19:03:27.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.357+0000 7ff795ef4640 1 -- 172.21.15.53:0/309225267 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff79015d9d0 con 0x7ff7900cec40 2023-06-10T19:03:27.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.357+0000 7ff777fff640 1 -- 172.21.15.53:0/309225267 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7840b3d10 con 0x7ff7900cec40 2023-06-10T19:03:27.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.357+0000 7ff795ef4640 1 -- 172.21.15.53:0/309225267 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff790151c60 con 0x7ff7900cec40 2023-06-10T19:03:27.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.361+0000 7ff795ef4640 1 -- 172.21.15.53:0/309225267 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff79004d790 con 0x7ff7900cec40 2023-06-10T19:03:27.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.361+0000 7ff777fff640 1 -- 172.21.15.53:0/309225267 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff7840c6390 con 0x7ff7900cec40 2023-06-10T19:03:27.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.361+0000 7ff777fff640 1 --2- 172.21.15.53:0/309225267 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff77c0662b0 0x7ff77c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:27.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.361+0000 7ff777fff640 1 -- 172.21.15.53:0/309225267 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6307+0+0 (secure 0 0 0) 0x7ff7840a7070 con 0x7ff7900cec40 2023-06-10T19:03:27.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.361+0000 7ff78f7fe640 1 --2- 172.21.15.53:0/309225267 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff77c0662b0 0x7ff77c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:27.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.361+0000 7ff78f7fe640 1 --2- 172.21.15.53:0/309225267 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff77c0662b0 0x7ff77c068760 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7ff780000f70 tx=0x7ff780007df0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:27.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.365+0000 7ff777fff640 1 -- 172.21.15.53:0/309225267 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff7840ebbc0 con 0x7ff7900cec40 2023-06-10T19:03:27.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.553+0000 7ff795ef4640 1 -- 172.21.15.53:0/309225267 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff7900ce810 con 0x7ff7900cec40 2023-06-10T19:03:27.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.557+0000 7ff777fff640 1 -- 172.21.15.53:0/309225267 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4681 (secure 0 0 0) 0x7ff7840ef1e0 con 0x7ff7900cec40 2023-06-10T19:03:27.560 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:03:27.560 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":55,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1617157670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1617157670},{"type":"v1","addr":"172.21.15.117:6836","nonce":1617157670}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6113,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3414416090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":3414416090},{"type":"v1","addr":"172.21.15.117:6837","nonce":3414416090}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6718,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2533467097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2533467097},{"type":"v1","addr":"172.21.15.53:6835","nonce":2533467097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:02:02.642809+0000","modified":"2023-06-10T19:03:27.208582+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8127":{"gid":8127,"name":"a","rank":0,"incarnation":52,"state":"up:active","state_seq":17,"addr":"172.21.15.53:6833/2984379521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2984379521},{"type":"v1","addr":"172.21.15.53:6833","nonce":2984379521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-06-10T19:03:27.560 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 55 2023-06-10T19:03:27.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.557+0000 7ff795ef4640 1 -- 172.21.15.53:0/309225267 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff77c0662b0 msgr2=0x7ff77c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:27.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.557+0000 7ff795ef4640 1 --2- 172.21.15.53:0/309225267 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff77c0662b0 0x7ff77c068760 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7ff780000f70 tx=0x7ff780007df0 comp rx=0 tx=0).stop 2023-06-10T19:03:27.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.557+0000 7ff795ef4640 1 -- 172.21.15.53:0/309225267 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff7900cec40 msgr2=0x7ff790150050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:27.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.557+0000 7ff795ef4640 1 --2- 172.21.15.53:0/309225267 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff7900cec40 0x7ff790150050 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7ff7840190e0 tx=0x7ff78401ad10 comp rx=0 tx=0).stop 2023-06-10T19:03:27.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.557+0000 7ff795ef4640 1 -- 172.21.15.53:0/309225267 shutdown_connections 2023-06-10T19:03:27.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.557+0000 7ff795ef4640 1 --2- 172.21.15.53:0/309225267 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff77c0662b0 0x7ff77c068760 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:27.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.557+0000 7ff795ef4640 1 --2- 172.21.15.53:0/309225267 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff790159450 0x7ff79014f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:27.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.557+0000 7ff795ef4640 1 --2- 172.21.15.53:0/309225267 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff7900cec40 0x7ff790150050 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:27.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.557+0000 7ff795ef4640 1 --2- 172.21.15.53:0/309225267 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7900cbf50 0x7ff790150d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:27.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.557+0000 7ff795ef4640 1 -- 172.21.15.53:0/309225267 >> 172.21.15.53:0/309225267 conn(0x7ff79006a090 msgr2=0x7ff7900b1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:27.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.557+0000 7ff795ef4640 1 -- 172.21.15.53:0/309225267 shutdown_connections 2023-06-10T19:03:27.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.557+0000 7ff795ef4640 1 -- 172.21.15.53:0/309225267 wait complete. 2023-06-10T19:03:27.580 DEBUG:tasks.cephfs.filesystem:mapped states ['up:active'] to up:active 2023-06-10T19:03:27.580 DEBUG:tasks.cephfs.filesystem:reached state 'up:active' in 50.712260007858276s 2023-06-10T19:03:27.580 INFO:tasks.cephfs.test_client_recovery:Reached active... 2023-06-10T19:03:27.581 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-10T19:03:27.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.693+0000 7f1fdd724640 1 Processor -- start 2023-06-10T19:03:27.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.693+0000 7f1fdd724640 1 -- start start 2023-06-10T19:03:27.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.697+0000 7f1fdd724640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1fd80ad730 0x7f1fd80713a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:27.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.697+0000 7f1fdd724640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fd8070f10 con 0x7f1fd8159630 2023-06-10T19:03:27.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.697+0000 7f1fdd724640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fd815db60 con 0x7f1fd80718e0 2023-06-10T19:03:27.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.697+0000 7f1fdd724640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd815d970 con 0x7f1fd80ad730 2023-06-10T19:03:27.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.697+0000 7f1fd6ffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f1fd8159630 0x7f1fd815d260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:46510/0 (socket says 172.21.15.53:46510) 2023-06-10T19:03:27.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.697+0000 7f1fd6ffd640 1 -- 172.21.15.53:0/1172120659 learned_addr learned my addr 172.21.15.53:0/1172120659 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:03:27.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.697+0000 7f1fd67fc640 1 --2- 172.21.15.53:0/1172120659 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1fd80ad730 0x7f1fd80713a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:27.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.697+0000 7f1fd5ffb640 1 -- 172.21.15.53:0/1172120659 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4146700484 0 0) 0x7f1fd8070f10 con 0x7f1fd8159630 2023-06-10T19:03:27.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.697+0000 7f1fd5ffb640 1 -- 172.21.15.53:0/1172120659 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1fc0003530 con 0x7f1fd8159630 2023-06-10T19:03:27.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.697+0000 7f1fd5ffb640 1 -- 172.21.15.53:0/1172120659 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1976079759 0 0) 0x7f1fc0003530 con 0x7f1fd8159630 2023-06-10T19:03:27.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.697+0000 7f1fd5ffb640 1 -- 172.21.15.53:0/1172120659 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1fd80ad730 msgr2=0x7f1fd80713a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:27.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.697+0000 7f1fd5ffb640 1 --2- 172.21.15.53:0/1172120659 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1fd80ad730 0x7f1fd80713a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:27.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.697+0000 7f1fd5ffb640 1 -- 172.21.15.53:0/1172120659 >> v1:172.21.15.117:6789/0 conn(0x7f1fd80718e0 legacy=0x7f1fd8069450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:27.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.697+0000 7f1fd5ffb640 1 -- 172.21.15.53:0/1172120659 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fd815de40 con 0x7f1fd8159630 2023-06-10T19:03:27.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.697+0000 7f1fd5ffb640 1 -- 172.21.15.53:0/1172120659 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f1fc8001a00 con 0x7f1fd8159630 2023-06-10T19:03:27.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.697+0000 7f1fd5ffb640 1 -- 172.21.15.53:0/1172120659 >> v1:172.21.15.53:6789/0 conn(0x7f1fd8159630 legacy=0x7f1fd815d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:27.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.697+0000 7f1fd5ffb640 1 --2- 172.21.15.53:0/1172120659 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1fd80ad730 0x7f1fc0003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:27.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.697+0000 7f1fd5ffb640 1 --2- 172.21.15.53:0/1172120659 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1fc0003f60 0x7f1fc00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:27.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.697+0000 7f1fd5ffb640 1 --2- 172.21.15.53:0/1172120659 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1fc0004d10 0x7f1fc0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:27.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.697+0000 7f1fd5ffb640 1 -- 172.21.15.53:0/1172120659 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc000ba40 con 0x7f1fc0003f60 2023-06-10T19:03:27.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.697+0000 7f1fd5ffb640 1 -- 172.21.15.53:0/1172120659 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc000bb80 con 0x7f1fc0004d10 2023-06-10T19:03:27.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.697+0000 7f1fd5ffb640 1 -- 172.21.15.53:0/1172120659 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc000bd40 con 0x7f1fd80ad730 2023-06-10T19:03:27.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.697+0000 7f1fd67fc640 1 --2- 172.21.15.53:0/1172120659 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1fc0003f60 0x7f1fc00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:27.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.697+0000 7f1fd6ffd640 1 --2- 172.21.15.53:0/1172120659 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1fd80ad730 0x7f1fc0003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:27.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.697+0000 7f1fd77fe640 1 --2- 172.21.15.53:0/1172120659 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1fc0004d10 0x7f1fc0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:27.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.697+0000 7f1fd67fc640 1 -- 172.21.15.53:0/1172120659 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1fd80ad730 msgr2=0x7f1fc0003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:27.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.697+0000 7f1fd67fc640 1 --2- 172.21.15.53:0/1172120659 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1fd80ad730 0x7f1fc0003a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:27.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.697+0000 7f1fd67fc640 1 -- 172.21.15.53:0/1172120659 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1fc0004d10 msgr2=0x7f1fc0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:27.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.697+0000 7f1fd67fc640 1 --2- 172.21.15.53:0/1172120659 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1fc0004d10 0x7f1fc0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:27.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.697+0000 7f1fd67fc640 1 -- 172.21.15.53:0/1172120659 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fc0003530 con 0x7f1fc0003f60 2023-06-10T19:03:27.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.701+0000 7f1fd67fc640 1 --2- 172.21.15.53:0/1172120659 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1fc0003f60 0x7f1fc00047d0 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc009ab0 tx=0x7f1fcc01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea9a486dc3acbaee server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:27.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.701+0000 7f1fd5ffb640 1 -- 172.21.15.53:0/1172120659 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc0a5620 con 0x7f1fc0003f60 2023-06-10T19:03:27.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.701+0000 7f1fd5ffb640 1 -- 172.21.15.53:0/1172120659 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fcc0a5780 con 0x7f1fc0003f60 2023-06-10T19:03:27.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.701+0000 7f1fd5ffb640 1 -- 172.21.15.53:0/1172120659 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc0a5b30 con 0x7f1fc0003f60 2023-06-10T19:03:27.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.701+0000 7f1fdd724640 1 -- 172.21.15.53:0/1172120659 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1fc0003f60 msgr2=0x7f1fc00047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:27.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.701+0000 7f1fdd724640 1 --2- 172.21.15.53:0/1172120659 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1fc0003f60 0x7f1fc00047d0 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc009ab0 tx=0x7f1fcc01ca30 comp rx=0 tx=0).stop 2023-06-10T19:03:27.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.701+0000 7f1fd77fe640 1 -- 172.21.15.53:0/1172120659 reap_dead start 2023-06-10T19:03:27.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.701+0000 7f1fdd724640 1 -- 172.21.15.53:0/1172120659 shutdown_connections 2023-06-10T19:03:27.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.701+0000 7f1fdd724640 1 -- 172.21.15.53:0/1172120659 >> 172.21.15.53:0/1172120659 conn(0x7f1fd80cafc0 msgr2=0x7f1fd80cb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:27.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.701+0000 7f1fdd724640 1 -- 172.21.15.53:0/1172120659 shutdown_connections 2023-06-10T19:03:27.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.701+0000 7f1fdd724640 1 -- 172.21.15.53:0/1172120659 wait complete. 2023-06-10T19:03:27.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.701+0000 7f1fdd724640 1 Processor -- start 2023-06-10T19:03:27.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.701+0000 7f1fdd724640 1 -- start start 2023-06-10T19:03:27.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.705+0000 7f1fdd724640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1fd8149f70 0x7f1fd80a7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:27.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.705+0000 7f1fdd724640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1fd80a7990 0x7f1fd8147570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:27.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.705+0000 7f1fdd724640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1fd8147ab0 0x7f1fd81f2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:27.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.705+0000 7f1fdd724640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd80a7e00 con 0x7f1fd80a7990 2023-06-10T19:03:27.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.705+0000 7f1fdd724640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd814a340 con 0x7f1fd8147ab0 2023-06-10T19:03:27.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.705+0000 7f1fdd724640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd81482a0 con 0x7f1fd8149f70 2023-06-10T19:03:27.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.705+0000 7f1fd67fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1fd80a7990 0x7f1fd8147570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:27.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.705+0000 7f1fd67fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1fd80a7990 0x7f1fd8147570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48576/0 (socket says 172.21.15.53:48576) 2023-06-10T19:03:27.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.705+0000 7f1fd67fc640 1 -- 172.21.15.53:0/895764956 learned_addr learned my addr 172.21.15.53:0/895764956 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:27.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.705+0000 7f1fd6ffd640 1 --2- 172.21.15.53:0/895764956 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1fd8149f70 0x7f1fd80a7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:27.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.705+0000 7f1fd77fe640 1 --2- 172.21.15.53:0/895764956 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1fd8147ab0 0x7f1fd81f2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:27.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.705+0000 7f1fd67fc640 1 -- 172.21.15.53:0/895764956 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1fd8149f70 msgr2=0x7f1fd80a7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:27.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.705+0000 7f1fd67fc640 1 --2- 172.21.15.53:0/895764956 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1fd8149f70 0x7f1fd80a7450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:27.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.705+0000 7f1fd67fc640 1 -- 172.21.15.53:0/895764956 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1fd8147ab0 msgr2=0x7f1fd81f2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:27.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.705+0000 7f1fd67fc640 1 --2- 172.21.15.53:0/895764956 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1fd8147ab0 0x7f1fd81f2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:27.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.705+0000 7f1fd67fc640 1 -- 172.21.15.53:0/895764956 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fd8148580 con 0x7f1fd80a7990 2023-06-10T19:03:27.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.705+0000 7f1fd77fe640 1 --2- 172.21.15.53:0/895764956 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1fd8147ab0 0x7f1fd81f2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:03:27.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.705+0000 7f1fd67fc640 1 --2- 172.21.15.53:0/895764956 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1fd80a7990 0x7f1fd8147570 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc0b0040 tx=0x7f1fcc0197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:27.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.705+0000 7f1fbf7fe640 1 -- 172.21.15.53:0/895764956 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc0a5620 con 0x7f1fd80a7990 2023-06-10T19:03:27.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.705+0000 7f1fbf7fe640 1 -- 172.21.15.53:0/895764956 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fcc0ad680 con 0x7f1fd80a7990 2023-06-10T19:03:27.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.705+0000 7f1fdd724640 1 -- 172.21.15.53:0/895764956 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fd8148860 con 0x7f1fd80a7990 2023-06-10T19:03:27.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.705+0000 7f1fbf7fe640 1 -- 172.21.15.53:0/895764956 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc0ada30 con 0x7f1fd80a7990 2023-06-10T19:03:27.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.705+0000 7f1fdd724640 1 -- 172.21.15.53:0/895764956 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fd8148e20 con 0x7f1fd80a7990 2023-06-10T19:03:27.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.705+0000 7f1fdd724640 1 -- 172.21.15.53:0/895764956 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fd80cbd00 con 0x7f1fd80a7990 2023-06-10T19:03:27.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.705+0000 7f1fbf7fe640 1 -- 172.21.15.53:0/895764956 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1fcc0b4040 con 0x7f1fd80a7990 2023-06-10T19:03:27.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.705+0000 7f1fbf7fe640 1 --2- 172.21.15.53:0/895764956 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1fc4066280 0x7f1fc4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:27.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.705+0000 7f1fbf7fe640 1 -- 172.21.15.53:0/895764956 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f1fcc11e7e0 con 0x7f1fd80a7990 2023-06-10T19:03:27.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.705+0000 7f1fd6ffd640 1 --2- 172.21.15.53:0/895764956 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1fc4066280 0x7f1fc4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:27.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.709+0000 7f1fd6ffd640 1 --2- 172.21.15.53:0/895764956 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1fc4066280 0x7f1fc4068730 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f1fc8002040 tx=0x7f1fc8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:27.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.709+0000 7f1fbf7fe640 1 -- 172.21.15.53:0/895764956 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1fcc0ebca0 con 0x7f1fd80a7990 2023-06-10T19:03:27.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.897+0000 7f1fdd724640 1 -- 172.21.15.53:0/895764956 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1fd80656e0 con 0x7f1fd80a7990 2023-06-10T19:03:27.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.897+0000 7f1fbf7fe640 1 -- 172.21.15.53:0/895764956 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v55) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1fcc0ef2c0 con 0x7f1fd80a7990 2023-06-10T19:03:27.903 INFO:teuthology.orchestra.run.smithi053.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-06-10T19:03:27.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.901+0000 7f1fdd724640 1 -- 172.21.15.53:0/895764956 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1fc4066280 msgr2=0x7f1fc4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:27.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.901+0000 7f1fdd724640 1 --2- 172.21.15.53:0/895764956 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1fc4066280 0x7f1fc4068730 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f1fc8002040 tx=0x7f1fc8009040 comp rx=0 tx=0).stop 2023-06-10T19:03:27.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.901+0000 7f1fdd724640 1 -- 172.21.15.53:0/895764956 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1fd80a7990 msgr2=0x7f1fd8147570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:27.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.901+0000 7f1fdd724640 1 --2- 172.21.15.53:0/895764956 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1fd80a7990 0x7f1fd8147570 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc0b0040 tx=0x7f1fcc0197d0 comp rx=0 tx=0).stop 2023-06-10T19:03:27.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.901+0000 7f1fdd724640 1 -- 172.21.15.53:0/895764956 shutdown_connections 2023-06-10T19:03:27.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.901+0000 7f1fdd724640 1 --2- 172.21.15.53:0/895764956 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1fc4066280 0x7f1fc4068730 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:27.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.901+0000 7f1fdd724640 1 --2- 172.21.15.53:0/895764956 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1fd8147ab0 0x7f1fd81f2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:27.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.901+0000 7f1fdd724640 1 --2- 172.21.15.53:0/895764956 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1fd80a7990 0x7f1fd8147570 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:27.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.901+0000 7f1fdd724640 1 --2- 172.21.15.53:0/895764956 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1fd8149f70 0x7f1fd80a7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:27.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.901+0000 7f1fdd724640 1 -- 172.21.15.53:0/895764956 >> 172.21.15.53:0/895764956 conn(0x7f1fd80cafc0 msgr2=0x7f1fd80cec20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:27.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.901+0000 7f1fdd724640 1 -- 172.21.15.53:0/895764956 shutdown_connections 2023-06-10T19:03:27.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:27.901+0000 7f1fdd724640 1 -- 172.21.15.53:0/895764956 wait complete. 2023-06-10T19:03:27.922 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-10T19:03:27.922 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-10T19:03:27.922 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi117.front.sepia.ceph.com 2023-06-10T19:03:27.923 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-06-10T19:03:27.923 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-06-10T19:03:27.923 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-10T19:03:27.923 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-10T19:03:27.924 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-10T19:03:27.924 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-06-10T19:03:27.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:03:27.925 DEBUG:teuthology.orchestra.run.smithi117:> ip addr 2023-06-10T19:03:27.931 INFO:teuthology.orchestra.run.smithi117.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-10T19:03:27.931 INFO:teuthology.orchestra.run.smithi117.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-10T19:03:27.932 INFO:teuthology.orchestra.run.smithi117.stdout: inet 127.0.0.1/8 scope host lo 2023-06-10T19:03:27.932 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:03:27.932 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 ::1/128 scope host 2023-06-10T19:03:27.932 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:03:27.932 INFO:teuthology.orchestra.run.smithi117.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T19:03:27.932 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8a brd ff:ff:ff:ff:ff:ff 2023-06-10T19:03:27.932 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f0 2023-06-10T19:03:27.933 INFO:teuthology.orchestra.run.smithi117.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T19:03:27.933 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8b brd ff:ff:ff:ff:ff:ff 2023-06-10T19:03:27.933 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f1 2023-06-10T19:03:27.933 INFO:teuthology.orchestra.run.smithi117.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T19:03:27.933 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:62 brd ff:ff:ff:ff:ff:ff 2023-06-10T19:03:27.933 INFO:teuthology.orchestra.run.smithi117.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-10T19:03:27.933 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:63 brd ff:ff:ff:ff:ff:ff 2023-06-10T19:03:27.934 INFO:teuthology.orchestra.run.smithi117.stdout: inet 172.21.15.117/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-06-10T19:03:27.934 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft 41841sec preferred_lft 41841sec 2023-06-10T19:03:27.934 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::ec4:7aff:fe8f:4463/64 scope link 2023-06-10T19:03:27.934 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:03:27.934 INFO:teuthology.orchestra.run.smithi117.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-06-10T19:03:27.934 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 02:42:f8:40:b2:dc brd ff:ff:ff:ff:ff:ff 2023-06-10T19:03:27.934 INFO:teuthology.orchestra.run.smithi117.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-06-10T19:03:27.934 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:03:27.935 INFO:teuthology.orchestra.run.smithi117.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-10T19:03:27.935 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-06-10T19:03:27.935 INFO:teuthology.orchestra.run.smithi117.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-06-10T19:03:27.935 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:03:27.935 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-06-10T19:03:27.935 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:03:27.935 INFO:teuthology.orchestra.run.smithi117.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-10T19:03:27.936 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-06-10T19:03:27.936 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-06-10T19:03:27.936 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:03:27.936 INFO:teuthology.orchestra.run.smithi117.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-10T19:03:27.936 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-06-10T19:03:27.936 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-06-10T19:03:27.936 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:03:27.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:03:27.937 DEBUG:teuthology.orchestra.run.smithi117:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-10T19:03:27.988 INFO:teuthology.orchestra.run.smithi117.stdout:1 2023-06-10T19:03:27.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:03:27.990 DEBUG:teuthology.orchestra.run.smithi117:> route 2023-06-10T19:03:28.038 INFO:teuthology.orchestra.run.smithi117.stdout:Kernel IP routing table 2023-06-10T19:03:28.038 INFO:teuthology.orchestra.run.smithi117.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-10T19:03:28.038 INFO:teuthology.orchestra.run.smithi117.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-06-10T19:03:28.038 INFO:teuthology.orchestra.run.smithi117.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-06-10T19:03:28.038 INFO:teuthology.orchestra.run.smithi117.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-06-10T19:03:28.038 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-06-10T19:03:28.039 INFO:teuthology.orchestra.run.smithi117.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-10T19:03:28.039 INFO:teuthology.orchestra.run.smithi117.stdout:ns2.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-10T19:03:28.039 INFO:teuthology.orchestra.run.smithi117.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-10T19:03:28.039 INFO:teuthology.orchestra.run.smithi117.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-10T19:03:28.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:03:28.040 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec bash -c ' 2023-06-10T19:03:28.041 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2023-06-10T19:03:28.041 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-06-10T19:03:28.041 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-06-10T19:03:28.041 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-06-10T19:03:28.042 DEBUG:teuthology.orchestra.run.smithi117:> ') 2023-06-10T19:03:28.120 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:03:28.121 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list 2023-06-10T19:03:28.172 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-06-10T19:03:28.172 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-06-10T19:03:28.172 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-06-10T19:03:28.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:03:28.173 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link set brx.0 up 2023-06-10T19:03:28.232 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-06-10T19:03:28.232 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-10T19:03:28.233 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-06-10T19:03:28.280 INFO:teuthology.orchestra.run.smithi117.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-06-10T19:03:28.280 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-10T19:03:28.281 DEBUG:teuthology.orchestra.run.smithi117:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-06-10T19:03:28.327 DEBUG:teuthology.orchestra.run.smithi117:> sudo modprobe fuse 2023-06-10T19:03:28.385 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T19:03:28.385 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T19:03:28.439 INFO:teuthology.orchestra.run.smithi117.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T19:03:28.440 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T19:03:28.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:03:28.442 DEBUG:teuthology.orchestra.run.smithi117:> ls /sys/fs/fuse/connections 2023-06-10T19:03:28.488 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-06-10T19:03:28.488 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-06-10T19:03:28.532 DEBUG:teuthology.orchestra.run.smithi117:> sudo modprobe fuse 2023-06-10T19:03:28.547 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T19:03:28.547 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T19:03:28.602 INFO:teuthology.orchestra.run.smithi117.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T19:03:28.603 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T19:03:28.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:03:28.605 DEBUG:teuthology.orchestra.run.smithi117:> ls /sys/fs/fuse/connections 2023-06-10T19:03:28.613 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi117.stderr:2023-06-10T19:03:28.608+0000 7f1c9d0e8580 -1 init, newargv = 0x55832e77af70 newargc=15 2023-06-10T19:03:28.614 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi117.stderr:ceph-fuse[44967]: starting ceph client 2023-06-10T19:03:28.621 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi117.stderr:ceph-fuse[44967]: starting fuse 2023-06-10T19:03:29.719 DEBUG:teuthology.orchestra.run.smithi117:> sudo modprobe fuse 2023-06-10T19:03:29.736 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T19:03:29.736 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T19:03:29.791 INFO:teuthology.orchestra.run.smithi117.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T19:03:29.792 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T19:03:29.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:03:29.794 DEBUG:teuthology.orchestra.run.smithi117:> ls /sys/fs/fuse/connections 2023-06-10T19:03:29.840 INFO:teuthology.orchestra.run.smithi117.stdout:45 2023-06-10T19:03:29.840 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-06-10T19:03:29.841 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-06-10T19:03:29.841 DEBUG:teuthology.orchestra.run.smithi117:> import glob 2023-06-10T19:03:29.841 DEBUG:teuthology.orchestra.run.smithi117:> import re 2023-06-10T19:03:29.842 DEBUG:teuthology.orchestra.run.smithi117:> import os 2023-06-10T19:03:29.842 DEBUG:teuthology.orchestra.run.smithi117:> import subprocess 2023-06-10T19:03:29.842 DEBUG:teuthology.orchestra.run.smithi117:> 2023-06-10T19:03:29.842 DEBUG:teuthology.orchestra.run.smithi117:> def _find_admin_socket(client_name): 2023-06-10T19:03:29.843 DEBUG:teuthology.orchestra.run.smithi117:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-06-10T19:03:29.843 DEBUG:teuthology.orchestra.run.smithi117:> files = glob.glob(asok_path) 2023-06-10T19:03:29.844 DEBUG:teuthology.orchestra.run.smithi117:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-06-10T19:03:29.844 DEBUG:teuthology.orchestra.run.smithi117:> 2023-06-10T19:03:29.844 DEBUG:teuthology.orchestra.run.smithi117:> # Given a non-glob path, it better be there 2023-06-10T19:03:29.845 DEBUG:teuthology.orchestra.run.smithi117:> if "*" not in asok_path: 2023-06-10T19:03:29.845 DEBUG:teuthology.orchestra.run.smithi117:> assert(len(files) == 1) 2023-06-10T19:03:29.845 DEBUG:teuthology.orchestra.run.smithi117:> return files[0] 2023-06-10T19:03:29.846 DEBUG:teuthology.orchestra.run.smithi117:> 2023-06-10T19:03:29.846 DEBUG:teuthology.orchestra.run.smithi117:> for f in files: 2023-06-10T19:03:29.847 DEBUG:teuthology.orchestra.run.smithi117:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-06-10T19:03:29.847 DEBUG:teuthology.orchestra.run.smithi117:> if os.path.exists("/proc/{0}".format(pid)): 2023-06-10T19:03:29.848 DEBUG:teuthology.orchestra.run.smithi117:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-06-10T19:03:29.849 DEBUG:teuthology.orchestra.run.smithi117:> contents = proc_f.read() 2023-06-10T19:03:29.850 DEBUG:teuthology.orchestra.run.smithi117:> if mountpoint in contents: 2023-06-10T19:03:29.851 DEBUG:teuthology.orchestra.run.smithi117:> return f 2023-06-10T19:03:29.851 DEBUG:teuthology.orchestra.run.smithi117:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-06-10T19:03:29.852 DEBUG:teuthology.orchestra.run.smithi117:> 2023-06-10T19:03:29.852 DEBUG:teuthology.orchestra.run.smithi117:> print(_find_admin_socket("client.1")) 2023-06-10T19:03:29.852 DEBUG:teuthology.orchestra.run.smithi117:> ' 2023-06-10T19:03:29.959 INFO:teuthology.orchestra.run.smithi117.stdout:/var/run/ceph/ceph-client.1.44967.asok 2023-06-10T19:03:30.142 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.44967.asok 2023-06-10T19:03:30.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:03:30.143 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.44967.asok status 2023-06-10T19:03:30.304 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2023-06-10T19:03:30.304 INFO:teuthology.orchestra.run.smithi117.stdout: "metadata": { 2023-06-10T19:03:30.304 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_sha1": "219d315c3a0b2075e570fb1964be2ad33fe7a9c8", 2023-06-10T19:03:30.304 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_version": "ceph version 18.0.0-4359-g219d315c (219d315c3a0b2075e570fb1964be2ad33fe7a9c8) reef (dev)", 2023-06-10T19:03:30.304 INFO:teuthology.orchestra.run.smithi117.stdout: "entity_id": "1", 2023-06-10T19:03:30.305 INFO:teuthology.orchestra.run.smithi117.stdout: "hostname": "smithi117", 2023-06-10T19:03:30.305 INFO:teuthology.orchestra.run.smithi117.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-06-10T19:03:30.305 INFO:teuthology.orchestra.run.smithi117.stdout: "pid": "44967", 2023-06-10T19:03:30.305 INFO:teuthology.orchestra.run.smithi117.stdout: "root": "/" 2023-06-10T19:03:30.305 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-06-10T19:03:30.305 INFO:teuthology.orchestra.run.smithi117.stdout: "dentry_count": 0, 2023-06-10T19:03:30.305 INFO:teuthology.orchestra.run.smithi117.stdout: "dentry_pinned_count": 0, 2023-06-10T19:03:30.305 INFO:teuthology.orchestra.run.smithi117.stdout: "id": 6431, 2023-06-10T19:03:30.306 INFO:teuthology.orchestra.run.smithi117.stdout: "inst": { 2023-06-10T19:03:30.306 INFO:teuthology.orchestra.run.smithi117.stdout: "name": { 2023-06-10T19:03:30.306 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "client", 2023-06-10T19:03:30.306 INFO:teuthology.orchestra.run.smithi117.stdout: "num": 6431 2023-06-10T19:03:30.306 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-06-10T19:03:30.306 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": { 2023-06-10T19:03:30.306 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "v1", 2023-06-10T19:03:30.307 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": "192.168.0.1:0", 2023-06-10T19:03:30.307 INFO:teuthology.orchestra.run.smithi117.stdout: "nonce": 2570976431 2023-06-10T19:03:30.307 INFO:teuthology.orchestra.run.smithi117.stdout: } 2023-06-10T19:03:30.307 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-06-10T19:03:30.307 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": { 2023-06-10T19:03:30.307 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "v1", 2023-06-10T19:03:30.307 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": "192.168.0.1:0", 2023-06-10T19:03:30.307 INFO:teuthology.orchestra.run.smithi117.stdout: "nonce": 2570976431 2023-06-10T19:03:30.308 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-06-10T19:03:30.308 INFO:teuthology.orchestra.run.smithi117.stdout: "inst_str": "client.6431 192.168.0.1:0/2570976431", 2023-06-10T19:03:30.308 INFO:teuthology.orchestra.run.smithi117.stdout: "addr_str": "192.168.0.1:0/2570976431", 2023-06-10T19:03:30.308 INFO:teuthology.orchestra.run.smithi117.stdout: "inode_count": 1, 2023-06-10T19:03:30.308 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_epoch": 55, 2023-06-10T19:03:30.308 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_epoch": 98, 2023-06-10T19:03:30.308 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_epoch_barrier": 0, 2023-06-10T19:03:30.308 INFO:teuthology.orchestra.run.smithi117.stdout: "blocklisted": false, 2023-06-10T19:03:30.309 INFO:teuthology.orchestra.run.smithi117.stdout: "fs_name": "cephfs" 2023-06-10T19:03:30.309 INFO:teuthology.orchestra.run.smithi117.stdout:} 2023-06-10T19:03:30.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:03:30.318 DEBUG:teuthology.orchestra.run.smithi117:> stat --file-system '--printf=%T 2023-06-10T19:03:30.319 DEBUG:teuthology.orchestra.run.smithi117:> ' -- /home/ubuntu/cephtest/mnt.1 2023-06-10T19:03:30.325 INFO:teuthology.orchestra.run.smithi117.stdout:fuseblk 2023-06-10T19:03:30.325 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-06-10T19:03:30.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:03:30.326 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-06-10T19:03:30.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:03:30.377 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest/mnt.1 && exec ls subdir/childfile) 2023-06-10T19:03:30.431 INFO:teuthology.orchestra.run.smithi117.stdout:subdir/childfile 2023-06-10T19:03:30.432 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-06-10T19:03:30.433 DEBUG:teuthology.orchestra.run.smithi053:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-06-10T19:03:30.489 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-06-10T19:03:30.533 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-06-10T19:03:30.533 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T19:03:30.534 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:03:30.539 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16345192k,nr_inodes=4086298,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276544k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=407 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276540k,nr_inodes=819135,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276544k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-06-10T19:03:30.540 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi053.front.sepia.ceph.com 2023-06-10T19:03:30.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:03:30.540 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-06-10T19:03:30.588 INFO:teuthology.orchestra.run.smithi053.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-06-10T19:03:30.589 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-10T19:03:30.589 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T19:03:30.590 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:03:30.596 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:03:30.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:30.761+0000 7fe45b19a640 1 Processor -- start 2023-06-10T19:03:30.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:30.761+0000 7fe45b19a640 1 -- start start 2023-06-10T19:03:30.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:30.765+0000 7fe45b19a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe454159450 0x7fe45415d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:30.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:30.765+0000 7fe45b19a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe45415d680 0x7fe4540cec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:30.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:30.765+0000 7fe45b19a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4540cf180 0x7fe4540cda20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:30.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:30.765+0000 7fe45b19a640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4540cf600 con 0x7fe45415d680 2023-06-10T19:03:30.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:30.765+0000 7fe45b19a640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4540cbac0 con 0x7fe454159450 2023-06-10T19:03:30.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:30.765+0000 7fe45b19a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe45415dc00 con 0x7fe4540cf180 2023-06-10T19:03:30.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:30.765+0000 7fe453fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe45415d680 0x7fe4540cec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:30.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:30.765+0000 7fe453fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe45415d680 0x7fe4540cec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48586/0 (socket says 172.21.15.53:48586) 2023-06-10T19:03:30.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:30.765+0000 7fe453fff640 1 -- 172.21.15.53:0/204668503 learned_addr learned my addr 172.21.15.53:0/204668503 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:30.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:30.765+0000 7fe459737640 1 --2- 172.21.15.53:0/204668503 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4540cf180 0x7fe4540cda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:30.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:30.765+0000 7fe458f36640 1 --2- 172.21.15.53:0/204668503 >> v2:172.21.15.117:3300/0 conn(0x7fe454159450 0x7fe45415d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:30.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:30.765+0000 7fe453fff640 1 -- 172.21.15.53:0/204668503 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4540cf180 msgr2=0x7fe4540cda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:30.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:30.765+0000 7fe453fff640 1 --2- 172.21.15.53:0/204668503 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4540cf180 0x7fe4540cda20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:30.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:30.765+0000 7fe453fff640 1 -- 172.21.15.53:0/204668503 >> v2:172.21.15.117:3300/0 conn(0x7fe454159450 msgr2=0x7fe45415d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:30.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:30.765+0000 7fe453fff640 1 --2- 172.21.15.53:0/204668503 >> v2:172.21.15.117:3300/0 conn(0x7fe454159450 0x7fe45415d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:30.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:30.765+0000 7fe453fff640 1 -- 172.21.15.53:0/204668503 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe45415dee0 con 0x7fe45415d680 2023-06-10T19:03:30.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:30.765+0000 7fe458f36640 1 --2- 172.21.15.53:0/204668503 >> v2:172.21.15.117:3300/0 conn(0x7fe454159450 0x7fe45415d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:03:30.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:30.765+0000 7fe453fff640 1 --2- 172.21.15.53:0/204668503 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe45415d680 0x7fe4540cec40 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7fe4540b29a0 tx=0x7fe44401c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=541e62d3dd5d70d server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:30.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:30.765+0000 7fe4537fe640 1 -- 172.21.15.53:0/204668503 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4440ab600 con 0x7fe45415d680 2023-06-10T19:03:30.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:30.765+0000 7fe4537fe640 1 -- 172.21.15.53:0/204668503 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4440a7050 con 0x7fe45415d680 2023-06-10T19:03:30.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:30.765+0000 7fe4537fe640 1 -- 172.21.15.53:0/204668503 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4440ab980 con 0x7fe45415d680 2023-06-10T19:03:30.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:30.769+0000 7fe45b19a640 1 -- 172.21.15.53:0/204668503 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe45415d680 msgr2=0x7fe4540cec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:30.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:30.769+0000 7fe45b19a640 1 --2- 172.21.15.53:0/204668503 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe45415d680 0x7fe4540cec40 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7fe4540b29a0 tx=0x7fe44401c210 comp rx=0 tx=0).stop 2023-06-10T19:03:30.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:30.769+0000 7fe45b19a640 1 -- 172.21.15.53:0/204668503 shutdown_connections 2023-06-10T19:03:30.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:30.769+0000 7fe45b19a640 1 --2- 172.21.15.53:0/204668503 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4540cf180 0x7fe4540cda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:30.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:30.769+0000 7fe45b19a640 1 --2- 172.21.15.53:0/204668503 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe45415d680 0x7fe4540cec40 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:30.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:30.769+0000 7fe45b19a640 1 --2- 172.21.15.53:0/204668503 >> v2:172.21.15.117:3300/0 conn(0x7fe454159450 0x7fe45415d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:30.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:30.769+0000 7fe45b19a640 1 -- 172.21.15.53:0/204668503 >> 172.21.15.53:0/204668503 conn(0x7fe45406a090 msgr2=0x7fe45406d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:30.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:30.769+0000 7fe45b19a640 1 -- 172.21.15.53:0/204668503 shutdown_connections 2023-06-10T19:03:30.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:30.769+0000 7fe45b19a640 1 -- 172.21.15.53:0/204668503 wait complete. 2023-06-10T19:03:30.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:30.769+0000 7fe45b19a640 1 Processor -- start 2023-06-10T19:03:30.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:30.769+0000 7fe45b19a640 1 -- start start 2023-06-10T19:03:30.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:30.769+0000 7fe45b19a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4540cf180 0x7fe4540c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:30.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:30.769+0000 7fe45b19a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe454159450 0x7fe4540c7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:30.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:30.769+0000 7fe45b19a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe45415d680 0x7fe4541508a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:30.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:30.769+0000 7fe45b19a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4540c7990 con 0x7fe454159450 2023-06-10T19:03:30.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:30.769+0000 7fe45b19a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe454159f10 con 0x7fe4540cf180 2023-06-10T19:03:30.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:30.769+0000 7fe45b19a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe45415a1f0 con 0x7fe45415d680 2023-06-10T19:03:30.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:30.769+0000 7fe453fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe454159450 0x7fe4540c7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:30.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:30.769+0000 7fe453fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe454159450 0x7fe4540c7450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48590/0 (socket says 172.21.15.53:48590) 2023-06-10T19:03:30.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:30.769+0000 7fe453fff640 1 -- 172.21.15.53:0/2951637925 learned_addr learned my addr 172.21.15.53:0/2951637925 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:30.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:30.769+0000 7fe459737640 1 --2- 172.21.15.53:0/2951637925 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe45415d680 0x7fe4541508a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:30.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:30.769+0000 7fe458f36640 1 --2- 172.21.15.53:0/2951637925 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4540cf180 0x7fe4540c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:30.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:30.769+0000 7fe453fff640 1 -- 172.21.15.53:0/2951637925 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe45415d680 msgr2=0x7fe4541508a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:30.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:30.769+0000 7fe453fff640 1 --2- 172.21.15.53:0/2951637925 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe45415d680 0x7fe4541508a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:30.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:30.769+0000 7fe453fff640 1 -- 172.21.15.53:0/2951637925 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4540cf180 msgr2=0x7fe4540c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:30.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:30.769+0000 7fe453fff640 1 --2- 172.21.15.53:0/2951637925 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4540cf180 0x7fe4540c9ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:30.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:30.769+0000 7fe453fff640 1 -- 172.21.15.53:0/2951637925 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4440094d0 con 0x7fe454159450 2023-06-10T19:03:30.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:30.773+0000 7fe453fff640 1 --2- 172.21.15.53:0/2951637925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe454159450 0x7fe4540c7450 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7fe4440ae040 tx=0x7fe444018fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:30.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:30.773+0000 7fe4517fa640 1 -- 172.21.15.53:0/2951637925 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4440acea0 con 0x7fe454159450 2023-06-10T19:03:30.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:30.773+0000 7fe4517fa640 1 -- 172.21.15.53:0/2951637925 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4440b6640 con 0x7fe454159450 2023-06-10T19:03:30.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:30.773+0000 7fe45b19a640 1 -- 172.21.15.53:0/2951637925 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe45415a4d0 con 0x7fe454159450 2023-06-10T19:03:30.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:30.773+0000 7fe4517fa640 1 -- 172.21.15.53:0/2951637925 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4440b69f0 con 0x7fe454159450 2023-06-10T19:03:30.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:30.773+0000 7fe45b19a640 1 -- 172.21.15.53:0/2951637925 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe45415aa90 con 0x7fe454159450 2023-06-10T19:03:30.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:30.773+0000 7fe45b19a640 1 -- 172.21.15.53:0/2951637925 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe45404d790 con 0x7fe454159450 2023-06-10T19:03:30.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:30.773+0000 7fe4517fa640 1 -- 172.21.15.53:0/2951637925 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe4440b2040 con 0x7fe454159450 2023-06-10T19:03:30.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:30.773+0000 7fe4517fa640 1 --2- 172.21.15.53:0/2951637925 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe440066280 0x7fe440068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:30.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:30.773+0000 7fe4517fa640 1 -- 172.21.15.53:0/2951637925 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6307+0+0 (secure 0 0 0) 0x7fe44411e150 con 0x7fe454159450 2023-06-10T19:03:30.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:30.773+0000 7fe458f36640 1 --2- 172.21.15.53:0/2951637925 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe440066280 0x7fe440068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:30.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:30.773+0000 7fe458f36640 1 --2- 172.21.15.53:0/2951637925 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe440066280 0x7fe440068730 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fe448006fd0 tx=0x7fe448008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:30.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:30.777+0000 7fe4517fa640 1 -- 172.21.15.53:0/2951637925 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe4440eb4d0 con 0x7fe454159450 2023-06-10T19:03:30.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:30.933+0000 7fe45b19a640 1 -- 172.21.15.53:0/2951637925 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe45415ac80 con 0x7fe454159450 2023-06-10T19:03:30.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:30.933+0000 7fe4517fa640 1 -- 172.21.15.53:0/2951637925 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) v1 ==== 74+0+18665 (secure 0 0 0) 0x7fe4440eeaf0 con 0x7fe454159450 2023-06-10T19:03:30.939 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:03:30.939 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":98,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:03:25.180996+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-06-10T19:02:00.325404+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-06-10T19:02:01.620938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.8","mappings":[{"from":1,"to":2}]},{"pgid":"14.17","mappings":[{"from":1,"to":7}]},{"pgid":"14.2d","mappings":[{"from":1,"to":7}]},{"pgid":"14.3a","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.0.1:0/3897417564":"2023-06-10T20:03:25.147615+0000","172.21.15.53:6833/1894654263":"2023-06-11T19:02:29.480972+0000","172.21.15.53:6832/1894654263":"2023-06-11T19:02:29.480972+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:03:30.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:30.937+0000 7fe45b19a640 1 -- 172.21.15.53:0/2951637925 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe440066280 msgr2=0x7fe440068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:30.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:30.937+0000 7fe45b19a640 1 --2- 172.21.15.53:0/2951637925 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe440066280 0x7fe440068730 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fe448006fd0 tx=0x7fe448008040 comp rx=0 tx=0).stop 2023-06-10T19:03:30.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:30.937+0000 7fe45b19a640 1 -- 172.21.15.53:0/2951637925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe454159450 msgr2=0x7fe4540c7450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:30.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:30.937+0000 7fe45b19a640 1 --2- 172.21.15.53:0/2951637925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe454159450 0x7fe4540c7450 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7fe4440ae040 tx=0x7fe444018fb0 comp rx=0 tx=0).stop 2023-06-10T19:03:30.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:30.937+0000 7fe45b19a640 1 -- 172.21.15.53:0/2951637925 shutdown_connections 2023-06-10T19:03:30.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:30.937+0000 7fe45b19a640 1 --2- 172.21.15.53:0/2951637925 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe440066280 0x7fe440068730 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:30.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:30.937+0000 7fe45b19a640 1 --2- 172.21.15.53:0/2951637925 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe45415d680 0x7fe4541508a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:30.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:30.937+0000 7fe45b19a640 1 --2- 172.21.15.53:0/2951637925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe454159450 0x7fe4540c7450 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:30.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:30.937+0000 7fe45b19a640 1 --2- 172.21.15.53:0/2951637925 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4540cf180 0x7fe4540c9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:30.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:30.937+0000 7fe45b19a640 1 -- 172.21.15.53:0/2951637925 >> 172.21.15.53:0/2951637925 conn(0x7fe45406a090 msgr2=0x7fe454151d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:30.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:30.937+0000 7fe45b19a640 1 -- 172.21.15.53:0/2951637925 shutdown_connections 2023-06-10T19:03:30.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:30.937+0000 7fe45b19a640 1 -- 172.21.15.53:0/2951637925 wait complete. 2023-06-10T19:03:30.958 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-10T18:52:33.633114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-10T18:52:39.171487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-10T19:02:00.325404+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '93', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2023-06-10T19:02:01.620938+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '94', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-10T19:03:30.959 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-10T19:03:31.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.089+0000 7f8212c91640 1 Processor -- start 2023-06-10T19:03:31.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.089+0000 7f8212c91640 1 -- start start 2023-06-10T19:03:31.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.089+0000 7f8212c91640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f820c1558e0 0x7f820c0c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:31.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.089+0000 7f8212c91640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f820c06c230 con 0x7f820c06b6e0 2023-06-10T19:03:31.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.089+0000 7f8212c91640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f820c06ca40 con 0x7f820c158f40 2023-06-10T19:03:31.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.089+0000 7f8212c91640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f820c155cb0 con 0x7f820c1558e0 2023-06-10T19:03:31.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.089+0000 7f8210a2d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f820c1558e0 0x7f820c0c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:31.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.089+0000 7f821122e640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f820c06b6e0 0x7f820c06bae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:46522/0 (socket says 172.21.15.53:46522) 2023-06-10T19:03:31.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.089+0000 7f821122e640 1 -- 172.21.15.53:0/2161987604 learned_addr learned my addr 172.21.15.53:0/2161987604 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:03:31.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.089+0000 7f8210a2d640 1 -- 172.21.15.53:0/2161987604 >> v1:172.21.15.117:6789/0 conn(0x7f820c158f40 legacy=0x7f820c0cb820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:31.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.089+0000 7f8210a2d640 1 -- 172.21.15.53:0/2161987604 >> v1:172.21.15.53:6789/0 conn(0x7f820c06b6e0 legacy=0x7f820c06bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:31.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.089+0000 7f8210a2d640 1 -- 172.21.15.53:0/2161987604 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f820c06c480 con 0x7f820c1558e0 2023-06-10T19:03:31.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.093+0000 7f8210a2d640 1 --2- 172.21.15.53:0/2161987604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f820c1558e0 0x7f820c0c82a0 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f82000097c0 tx=0x7f820001e540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbb6c458c952210f server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:31.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.093+0000 7f820b7fe640 1 -- 172.21.15.53:0/2161987604 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82000ac430 con 0x7f820c1558e0 2023-06-10T19:03:31.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.093+0000 7f820b7fe640 1 -- 172.21.15.53:0/2161987604 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82000ac590 con 0x7f820c1558e0 2023-06-10T19:03:31.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.093+0000 7f820b7fe640 1 -- 172.21.15.53:0/2161987604 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82000ac920 con 0x7f820c1558e0 2023-06-10T19:03:31.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.093+0000 7f8212c91640 1 -- 172.21.15.53:0/2161987604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f820c1558e0 msgr2=0x7f820c0c82a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:31.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.093+0000 7f8212c91640 1 --2- 172.21.15.53:0/2161987604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f820c1558e0 0x7f820c0c82a0 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f82000097c0 tx=0x7f820001e540 comp rx=0 tx=0).stop 2023-06-10T19:03:31.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.093+0000 7f8212c91640 1 -- 172.21.15.53:0/2161987604 shutdown_connections 2023-06-10T19:03:31.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.093+0000 7f8212c91640 1 --2- 172.21.15.53:0/2161987604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f820c1558e0 0x7f820c0c82a0 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:31.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.093+0000 7f8212c91640 1 -- 172.21.15.53:0/2161987604 >> 172.21.15.53:0/2161987604 conn(0x7f820c06a0e0 msgr2=0x7f820c0cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:31.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.093+0000 7f8212c91640 1 -- 172.21.15.53:0/2161987604 shutdown_connections 2023-06-10T19:03:31.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.093+0000 7f8212c91640 1 -- 172.21.15.53:0/2161987604 wait complete. 2023-06-10T19:03:31.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.093+0000 7f8212c91640 1 Processor -- start 2023-06-10T19:03:31.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.093+0000 7f8212c91640 1 -- start start 2023-06-10T19:03:31.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.093+0000 7f8212c91640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f820c06b6e0 0x7f820c14ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:31.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.093+0000 7f8212c91640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f820c1558e0 0x7f820c0c05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:31.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.093+0000 7f8212c91640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f820c158f40 0x7f820c15a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:31.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.093+0000 7f8212c91640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f820c148920 con 0x7f820c158f40 2023-06-10T19:03:31.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.093+0000 7f8212c91640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f820c147d10 con 0x7f820c1558e0 2023-06-10T19:03:31.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.093+0000 7f8212c91640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f820c147ff0 con 0x7f820c06b6e0 2023-06-10T19:03:31.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.093+0000 7f821122e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f820c158f40 0x7f820c15a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:31.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.093+0000 7f821122e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f820c158f40 0x7f820c15a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48614/0 (socket says 172.21.15.53:48614) 2023-06-10T19:03:31.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.093+0000 7f821122e640 1 -- 172.21.15.53:0/1945258277 learned_addr learned my addr 172.21.15.53:0/1945258277 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:31.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.093+0000 7f820bfff640 1 --2- 172.21.15.53:0/1945258277 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f820c1558e0 0x7f820c0c05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:31.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.093+0000 7f8210a2d640 1 --2- 172.21.15.53:0/1945258277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f820c06b6e0 0x7f820c14ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:31.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.093+0000 7f821122e640 1 -- 172.21.15.53:0/1945258277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f820c06b6e0 msgr2=0x7f820c14ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:31.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.093+0000 7f821122e640 1 --2- 172.21.15.53:0/1945258277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f820c06b6e0 0x7f820c14ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:31.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.093+0000 7f821122e640 1 -- 172.21.15.53:0/1945258277 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f820c1558e0 msgr2=0x7f820c0c05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:31.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.093+0000 7f821122e640 1 --2- 172.21.15.53:0/1945258277 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f820c1558e0 0x7f820c0c05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:31.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.093+0000 7f821122e640 1 -- 172.21.15.53:0/1945258277 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8200009420 con 0x7f820c158f40 2023-06-10T19:03:31.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.093+0000 7f8210a2d640 1 --2- 172.21.15.53:0/1945258277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f820c06b6e0 0x7f820c14ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:03:31.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.097+0000 7f821122e640 1 --2- 172.21.15.53:0/1945258277 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f820c158f40 0x7f820c15a680 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f820400ca80 tx=0x7f820400cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:31.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.097+0000 7f82097fa640 1 -- 172.21.15.53:0/1945258277 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820400ac30 con 0x7f820c158f40 2023-06-10T19:03:31.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.097+0000 7f82097fa640 1 -- 172.21.15.53:0/1945258277 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f820400ad90 con 0x7f820c158f40 2023-06-10T19:03:31.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.097+0000 7f8212c91640 1 -- 172.21.15.53:0/1945258277 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f820c0cc0b0 con 0x7f820c158f40 2023-06-10T19:03:31.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.097+0000 7f82097fa640 1 -- 172.21.15.53:0/1945258277 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8204012600 con 0x7f820c158f40 2023-06-10T19:03:31.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.097+0000 7f8212c91640 1 -- 172.21.15.53:0/1945258277 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f820c1485b0 con 0x7f820c158f40 2023-06-10T19:03:31.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.097+0000 7f8212c91640 1 -- 172.21.15.53:0/1945258277 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f820c148a90 con 0x7f820c158f40 2023-06-10T19:03:31.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.097+0000 7f82097fa640 1 -- 172.21.15.53:0/1945258277 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8204007070 con 0x7f820c158f40 2023-06-10T19:03:31.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.097+0000 7f82097fa640 1 --2- 172.21.15.53:0/1945258277 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f81f0066280 0x7f81f0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:31.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.097+0000 7f82097fa640 1 -- 172.21.15.53:0/1945258277 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f8204083bf0 con 0x7f820c158f40 2023-06-10T19:03:31.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.097+0000 7f8210a2d640 1 --2- 172.21.15.53:0/1945258277 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f81f0066280 0x7f81f0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:31.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.097+0000 7f8210a2d640 1 --2- 172.21.15.53:0/1945258277 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f81f0066280 0x7f81f0068730 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f82000b0000 tx=0x7f8200008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:31.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.101+0000 7f82097fa640 1 -- 172.21.15.53:0/1945258277 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8204051020 con 0x7f820c158f40 2023-06-10T19:03:31.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.257+0000 7f8212c91640 1 -- 172.21.15.53:0/1945258277 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f820c04d790 con 0x7f820c158f40 2023-06-10T19:03:31.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.257+0000 7f82097fa640 1 -- 172.21.15.53:0/1945258277 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v98) v1 ==== 93+0+10 (secure 0 0 0) 0x7f82040170a0 con 0x7f820c158f40 2023-06-10T19:03:31.261 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-06-10T19:03:31.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.257+0000 7f8212c91640 1 -- 172.21.15.53:0/1945258277 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f81f0066280 msgr2=0x7f81f0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:31.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.257+0000 7f8212c91640 1 --2- 172.21.15.53:0/1945258277 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f81f0066280 0x7f81f0068730 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f82000b0000 tx=0x7f8200008040 comp rx=0 tx=0).stop 2023-06-10T19:03:31.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.257+0000 7f8212c91640 1 -- 172.21.15.53:0/1945258277 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f820c158f40 msgr2=0x7f820c15a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:31.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.257+0000 7f8212c91640 1 --2- 172.21.15.53:0/1945258277 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f820c158f40 0x7f820c15a680 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f820400ca80 tx=0x7f820400cf40 comp rx=0 tx=0).stop 2023-06-10T19:03:31.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.257+0000 7f8212c91640 1 -- 172.21.15.53:0/1945258277 shutdown_connections 2023-06-10T19:03:31.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.257+0000 7f8212c91640 1 --2- 172.21.15.53:0/1945258277 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f81f0066280 0x7f81f0068730 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:31.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.257+0000 7f8212c91640 1 --2- 172.21.15.53:0/1945258277 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f820c158f40 0x7f820c15a680 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:31.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.257+0000 7f8212c91640 1 --2- 172.21.15.53:0/1945258277 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f820c1558e0 0x7f820c0c05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:31.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.257+0000 7f8212c91640 1 --2- 172.21.15.53:0/1945258277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f820c06b6e0 0x7f820c14ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:31.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.261+0000 7f8212c91640 1 -- 172.21.15.53:0/1945258277 >> 172.21.15.53:0/1945258277 conn(0x7f820c06a0e0 msgr2=0x7f820c0cc240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:31.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.261+0000 7f8212c91640 1 -- 172.21.15.53:0/1945258277 shutdown_connections 2023-06-10T19:03:31.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.261+0000 7f8212c91640 1 -- 172.21.15.53:0/1945258277 wait complete. 2023-06-10T19:03:31.280 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-10T19:03:31.395 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.393+0000 7f6b1cdb2640 1 Processor -- start 2023-06-10T19:03:31.395 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.393+0000 7f6b1cdb2640 1 -- start start 2023-06-10T19:03:31.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.393+0000 7f6b1cdb2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b1806c350 0x7f6b180cb820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:31.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.393+0000 7f6b1cdb2640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6b180af760 0x7f6b180afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:31.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.393+0000 7f6b1cdb2640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b180ac910 con 0x7f6b180c97d0 2023-06-10T19:03:31.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.393+0000 7f6b1cdb2640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b180ca5c0 con 0x7f6b180af760 2023-06-10T19:03:31.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.393+0000 7f6b1cdb2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b180b0120 con 0x7f6b1806c350 2023-06-10T19:03:31.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.393+0000 7f6b16d9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6b180af760 0x7f6b180afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:31.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.393+0000 7f6b1659c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f6b180c97d0 0x7f6b180ac200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56318/0 (socket says 172.21.15.53:56318) 2023-06-10T19:03:31.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.393+0000 7f6b1659c640 1 -- 172.21.15.53:0/1590293476 learned_addr learned my addr 172.21.15.53:0/1590293476 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:03:31.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.393+0000 7f6b0dd9b640 1 --2- 172.21.15.53:0/1590293476 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b1806c350 0x7f6b180cb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:31.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.393+0000 7f6b16d9d640 1 -- 172.21.15.53:0/1590293476 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b1806c350 msgr2=0x7f6b180cb820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:31.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.393+0000 7f6b16d9d640 1 --2- 172.21.15.53:0/1590293476 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b1806c350 0x7f6b180cb820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:31.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.393+0000 7f6b16d9d640 1 -- 172.21.15.53:0/1590293476 >> v1:172.21.15.53:6789/0 conn(0x7f6b180c97d0 legacy=0x7f6b180ac200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:31.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.393+0000 7f6b16d9d640 1 -- 172.21.15.53:0/1590293476 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b180cbd60 con 0x7f6b180af760 2023-06-10T19:03:31.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.393+0000 7f6b15d9b640 1 -- 172.21.15.53:0/1590293476 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1042248895 0 0) 0x7f6b180ac910 con 0x7f6b180c97d0 2023-06-10T19:03:31.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.393+0000 7f6b16d9d640 1 --2- 172.21.15.53:0/1590293476 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b180af760 0x7f6b180afbe0 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f6b10009d90 tx=0x7f6b1001c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a5291ec5c8a9084 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:31.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.393+0000 7f6b15d9b640 1 -- 172.21.15.53:0/1590293476 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b100a6700 con 0x7f6b180af760 2023-06-10T19:03:31.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.393+0000 7f6b15d9b640 1 -- 172.21.15.53:0/1590293476 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b100a6860 con 0x7f6b180af760 2023-06-10T19:03:31.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.393+0000 7f6b15d9b640 1 -- 172.21.15.53:0/1590293476 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b100a6bf0 con 0x7f6b180af760 2023-06-10T19:03:31.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.397+0000 7f6b1cdb2640 1 -- 172.21.15.53:0/1590293476 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b180af760 msgr2=0x7f6b180afbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:31.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.397+0000 7f6b1cdb2640 1 --2- 172.21.15.53:0/1590293476 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b180af760 0x7f6b180afbe0 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f6b10009d90 tx=0x7f6b1001c830 comp rx=0 tx=0).stop 2023-06-10T19:03:31.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.397+0000 7f6b1cdb2640 1 -- 172.21.15.53:0/1590293476 shutdown_connections 2023-06-10T19:03:31.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.397+0000 7f6b1cdb2640 1 --2- 172.21.15.53:0/1590293476 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b180af760 0x7f6b180afbe0 unknown :-1 s=CLOSED pgs=1617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:31.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.397+0000 7f6b1cdb2640 1 --2- 172.21.15.53:0/1590293476 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b1806c350 0x7f6b180cb820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:31.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.397+0000 7f6b1cdb2640 1 -- 172.21.15.53:0/1590293476 >> 172.21.15.53:0/1590293476 conn(0x7f6b1806a0e0 msgr2=0x7f6b180cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:31.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.397+0000 7f6b1cdb2640 1 -- 172.21.15.53:0/1590293476 shutdown_connections 2023-06-10T19:03:31.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.397+0000 7f6b1cdb2640 1 -- 172.21.15.53:0/1590293476 wait complete. 2023-06-10T19:03:31.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.397+0000 7f6b1cdb2640 1 Processor -- start 2023-06-10T19:03:31.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.397+0000 7f6b1cdb2640 1 -- start start 2023-06-10T19:03:31.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.397+0000 7f6b1cdb2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b1806c350 0x7f6b1814d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:31.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.397+0000 7f6b1cdb2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b180af760 0x7f6b1815a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:31.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.397+0000 7f6b1cdb2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b180c97d0 0x7f6b181538d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:31.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.397+0000 7f6b1cdb2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b181593a0 con 0x7f6b180c97d0 2023-06-10T19:03:31.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.397+0000 7f6b1cdb2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b18153440 con 0x7f6b180af760 2023-06-10T19:03:31.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.397+0000 7f6b1cdb2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b18158de0 con 0x7f6b1806c350 2023-06-10T19:03:31.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.397+0000 7f6b16d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b180c97d0 0x7f6b181538d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:31.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.397+0000 7f6b16d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b180c97d0 0x7f6b181538d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59772/0 (socket says 172.21.15.53:59772) 2023-06-10T19:03:31.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.397+0000 7f6b16d9d640 1 -- 172.21.15.53:0/60993019 learned_addr learned my addr 172.21.15.53:0/60993019 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:31.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.397+0000 7f6b16d9d640 1 -- 172.21.15.53:0/60993019 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b1806c350 msgr2=0x7f6b1814d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:31.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.397+0000 7f6b1659c640 1 --2- 172.21.15.53:0/60993019 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b1806c350 0x7f6b1814d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:31.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.397+0000 7f6b0dd9b640 1 --2- 172.21.15.53:0/60993019 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b180af760 0x7f6b1815a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:31.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.397+0000 7f6b16d9d640 1 --2- 172.21.15.53:0/60993019 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b1806c350 0x7f6b1814d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:31.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.397+0000 7f6b16d9d640 1 -- 172.21.15.53:0/60993019 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b180af760 msgr2=0x7f6b1815a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:31.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.397+0000 7f6b16d9d640 1 --2- 172.21.15.53:0/60993019 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b180af760 0x7f6b1815a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:31.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.397+0000 7f6b16d9d640 1 -- 172.21.15.53:0/60993019 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b10009a70 con 0x7f6b180c97d0 2023-06-10T19:03:31.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.397+0000 7f6b16d9d640 1 --2- 172.21.15.53:0/60993019 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b180c97d0 0x7f6b181538d0 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f6b1001aee0 tx=0x7f6b100195d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:31.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.397+0000 7f6b0f7fe640 1 -- 172.21.15.53:0/60993019 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b100bf070 con 0x7f6b180c97d0 2023-06-10T19:03:31.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.397+0000 7f6b0f7fe640 1 -- 172.21.15.53:0/60993019 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b100ba680 con 0x7f6b180c97d0 2023-06-10T19:03:31.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.397+0000 7f6b1cdb2640 1 -- 172.21.15.53:0/60993019 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b181590c0 con 0x7f6b180c97d0 2023-06-10T19:03:31.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.397+0000 7f6b0f7fe640 1 -- 172.21.15.53:0/60993019 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b100baa10 con 0x7f6b180c97d0 2023-06-10T19:03:31.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.397+0000 7f6b1cdb2640 1 -- 172.21.15.53:0/60993019 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b1814dac0 con 0x7f6b180c97d0 2023-06-10T19:03:31.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.397+0000 7f6b1cdb2640 1 -- 172.21.15.53:0/60993019 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b1804d790 con 0x7f6b180c97d0 2023-06-10T19:03:31.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.401+0000 7f6b0f7fe640 1 -- 172.21.15.53:0/60993019 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6b100bab70 con 0x7f6b180c97d0 2023-06-10T19:03:31.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.401+0000 7f6b0f7fe640 1 --2- 172.21.15.53:0/60993019 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6af8066280 0x7f6af8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:31.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.401+0000 7f6b0f7fe640 1 -- 172.21.15.53:0/60993019 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f6b100aa070 con 0x7f6b180c97d0 2023-06-10T19:03:31.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.401+0000 7f6b1659c640 1 --2- 172.21.15.53:0/60993019 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6af8066280 0x7f6af8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:31.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.401+0000 7f6b1659c640 1 --2- 172.21.15.53:0/60993019 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6af8066280 0x7f6af8068730 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f6b08000f70 tx=0x7f6b08009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:31.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.405+0000 7f6b0f7fe640 1 -- 172.21.15.53:0/60993019 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6b100ec250 con 0x7f6b180c97d0 2023-06-10T19:03:31.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.553+0000 7f6b1cdb2640 1 -- 172.21.15.53:0/60993019 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6b180cbd60 con 0x7f6b180c97d0 2023-06-10T19:03:31.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.553+0000 7f6b0f7fe640 1 -- 172.21.15.53:0/60993019 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v98) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6b180cbd60 con 0x7f6b180c97d0 2023-06-10T19:03:31.556 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-06-10T19:03:31.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.553+0000 7f6b1cdb2640 1 -- 172.21.15.53:0/60993019 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6af8066280 msgr2=0x7f6af8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:31.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.553+0000 7f6b1cdb2640 1 --2- 172.21.15.53:0/60993019 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6af8066280 0x7f6af8068730 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f6b08000f70 tx=0x7f6b08009040 comp rx=0 tx=0).stop 2023-06-10T19:03:31.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.553+0000 7f6b1cdb2640 1 -- 172.21.15.53:0/60993019 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b180c97d0 msgr2=0x7f6b181538d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:31.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.553+0000 7f6b1cdb2640 1 --2- 172.21.15.53:0/60993019 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b180c97d0 0x7f6b181538d0 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f6b1001aee0 tx=0x7f6b100195d0 comp rx=0 tx=0).stop 2023-06-10T19:03:31.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.553+0000 7f6b1cdb2640 1 -- 172.21.15.53:0/60993019 shutdown_connections 2023-06-10T19:03:31.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.553+0000 7f6b1cdb2640 1 --2- 172.21.15.53:0/60993019 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6af8066280 0x7f6af8068730 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:31.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.553+0000 7f6b1cdb2640 1 --2- 172.21.15.53:0/60993019 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b180c97d0 0x7f6b181538d0 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:31.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.553+0000 7f6b1cdb2640 1 --2- 172.21.15.53:0/60993019 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b180af760 0x7f6b1815a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:31.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.553+0000 7f6b1cdb2640 1 --2- 172.21.15.53:0/60993019 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b1806c350 0x7f6b1814d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:31.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.553+0000 7f6b1cdb2640 1 -- 172.21.15.53:0/60993019 >> 172.21.15.53:0/60993019 conn(0x7f6b1806a0e0 msgr2=0x7f6b180723f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:31.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.553+0000 7f6b1cdb2640 1 -- 172.21.15.53:0/60993019 shutdown_connections 2023-06-10T19:03:31.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.553+0000 7f6b1cdb2640 1 -- 172.21.15.53:0/60993019 wait complete. 2023-06-10T19:03:31.573 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-10T19:03:31.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.689+0000 7f425c812640 1 Processor -- start 2023-06-10T19:03:31.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.689+0000 7f425c812640 1 -- start start 2023-06-10T19:03:31.693 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.689+0000 7f425c812640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f425806eca0 0x7f425806f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:31.693 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.689+0000 7f425c812640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f42580af0e0 0x7f425815f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:31.693 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.689+0000 7f425c812640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f425815fc40 0x7f42581600c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:31.693 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.689+0000 7f425c812640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42580ccda0 con 0x7f425815fc40 2023-06-10T19:03:31.693 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.689+0000 7f425c812640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f425806f5b0 con 0x7f42580af0e0 2023-06-10T19:03:31.693 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.689+0000 7f425c812640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f425806a920 con 0x7f425806eca0 2023-06-10T19:03:31.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.689+0000 7f4256d9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f425815fc40 0x7f42581600c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:31.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.689+0000 7f4256d9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f425815fc40 0x7f42581600c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59776/0 (socket says 172.21.15.53:59776) 2023-06-10T19:03:31.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.689+0000 7f4256d9d640 1 -- 172.21.15.53:0/2010475668 learned_addr learned my addr 172.21.15.53:0/2010475668 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:31.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.689+0000 7f425659c640 1 --2- 172.21.15.53:0/2010475668 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f425806eca0 0x7f425806f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:31.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.689+0000 7f424ffff640 1 --2- 172.21.15.53:0/2010475668 >> v2:172.21.15.117:3300/0 conn(0x7f42580af0e0 0x7f425815f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:31.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.689+0000 7f4256d9d640 1 -- 172.21.15.53:0/2010475668 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f425806eca0 msgr2=0x7f425806f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:31.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.689+0000 7f4256d9d640 1 --2- 172.21.15.53:0/2010475668 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f425806eca0 0x7f425806f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:31.695 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.689+0000 7f4256d9d640 1 -- 172.21.15.53:0/2010475668 >> v2:172.21.15.117:3300/0 conn(0x7f42580af0e0 msgr2=0x7f425815f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:31.695 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.689+0000 7f4256d9d640 1 --2- 172.21.15.53:0/2010475668 >> v2:172.21.15.117:3300/0 conn(0x7f42580af0e0 0x7f425815f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:31.695 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.689+0000 7f4256d9d640 1 -- 172.21.15.53:0/2010475668 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f425806ac00 con 0x7f425815fc40 2023-06-10T19:03:31.695 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.689+0000 7f424ffff640 1 --2- 172.21.15.53:0/2010475668 >> v2:172.21.15.117:3300/0 conn(0x7f42580af0e0 0x7f425815f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:03:31.696 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.693+0000 7f4256d9d640 1 --2- 172.21.15.53:0/2010475668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f425815fc40 0x7f42581600c0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f42580d0ed0 tx=0x7f425001f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=220245ec7e70e20c server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:31.696 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.693+0000 7f4255d9b640 1 -- 172.21.15.53:0/2010475668 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42500af400 con 0x7f425815fc40 2023-06-10T19:03:31.696 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.693+0000 7f4255d9b640 1 -- 172.21.15.53:0/2010475668 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42500ab050 con 0x7f425815fc40 2023-06-10T19:03:31.696 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.693+0000 7f4255d9b640 1 -- 172.21.15.53:0/2010475668 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42500af780 con 0x7f425815fc40 2023-06-10T19:03:31.697 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.693+0000 7f425c812640 1 -- 172.21.15.53:0/2010475668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f425815fc40 msgr2=0x7f42581600c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:31.697 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.693+0000 7f425c812640 1 --2- 172.21.15.53:0/2010475668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f425815fc40 0x7f42581600c0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f42580d0ed0 tx=0x7f425001f1c0 comp rx=0 tx=0).stop 2023-06-10T19:03:31.697 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.693+0000 7f425c812640 1 -- 172.21.15.53:0/2010475668 shutdown_connections 2023-06-10T19:03:31.697 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.693+0000 7f425c812640 1 --2- 172.21.15.53:0/2010475668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f425815fc40 0x7f42581600c0 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:31.697 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.693+0000 7f425c812640 1 --2- 172.21.15.53:0/2010475668 >> v2:172.21.15.117:3300/0 conn(0x7f42580af0e0 0x7f425815f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:31.697 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.693+0000 7f425c812640 1 --2- 172.21.15.53:0/2010475668 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f425806eca0 0x7f425806f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:31.697 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.693+0000 7f425c812640 1 -- 172.21.15.53:0/2010475668 >> 172.21.15.53:0/2010475668 conn(0x7f425806a0e0 msgr2=0x7f425806d270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:31.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.693+0000 7f425c812640 1 -- 172.21.15.53:0/2010475668 shutdown_connections 2023-06-10T19:03:31.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.693+0000 7f425c812640 1 -- 172.21.15.53:0/2010475668 wait complete. 2023-06-10T19:03:31.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.693+0000 7f425c812640 1 Processor -- start 2023-06-10T19:03:31.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.693+0000 7f425c812640 1 -- start start 2023-06-10T19:03:31.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.693+0000 7f425c812640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f425806eca0 0x7f425815ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:31.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.693+0000 7f425c812640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42580af0e0 0x7f425815a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:31.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.693+0000 7f425c812640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f425815fc40 0x7f42580ac940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:31.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.693+0000 7f425c812640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f425815abd0 con 0x7f425815fc40 2023-06-10T19:03:31.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.693+0000 7f425c812640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f425815db10 con 0x7f425806eca0 2023-06-10T19:03:31.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.693+0000 7f425c812640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f425815ddf0 con 0x7f42580af0e0 2023-06-10T19:03:31.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.693+0000 7f4256d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f425815fc40 0x7f42580ac940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:31.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.693+0000 7f4256d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f425815fc40 0x7f42580ac940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59792/0 (socket says 172.21.15.53:59792) 2023-06-10T19:03:31.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.693+0000 7f4256d9d640 1 -- 172.21.15.53:0/2804485105 learned_addr learned my addr 172.21.15.53:0/2804485105 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:31.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.693+0000 7f425659c640 1 --2- 172.21.15.53:0/2804485105 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f425806eca0 0x7f425815ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:31.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.693+0000 7f424ffff640 1 --2- 172.21.15.53:0/2804485105 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42580af0e0 0x7f425815a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:31.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.693+0000 7f4256d9d640 1 -- 172.21.15.53:0/2804485105 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42580af0e0 msgr2=0x7f425815a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:31.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.693+0000 7f4256d9d640 1 --2- 172.21.15.53:0/2804485105 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42580af0e0 0x7f425815a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:31.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.693+0000 7f4256d9d640 1 -- 172.21.15.53:0/2804485105 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f425806eca0 msgr2=0x7f425815ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:31.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.693+0000 7f4256d9d640 1 --2- 172.21.15.53:0/2804485105 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f425806eca0 0x7f425815ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:31.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.693+0000 7f4256d9d640 1 -- 172.21.15.53:0/2804485105 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4250009b30 con 0x7f425815fc40 2023-06-10T19:03:31.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.693+0000 7f425659c640 1 --2- 172.21.15.53:0/2804485105 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f425806eca0 0x7f425815ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:03:31.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.693+0000 7f4256d9d640 1 --2- 172.21.15.53:0/2804485105 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f425815fc40 0x7f42580ac940 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f42500b2040 tx=0x7f425001bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:31.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.693+0000 7f424effd640 1 -- 172.21.15.53:0/2804485105 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42500afdc0 con 0x7f425815fc40 2023-06-10T19:03:31.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.693+0000 7f424effd640 1 -- 172.21.15.53:0/2804485105 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4250009510 con 0x7f425815fc40 2023-06-10T19:03:31.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.693+0000 7f425c812640 1 -- 172.21.15.53:0/2804485105 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f425815e0d0 con 0x7f425815fc40 2023-06-10T19:03:31.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.693+0000 7f424effd640 1 -- 172.21.15.53:0/2804485105 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42500b8640 con 0x7f425815fc40 2023-06-10T19:03:31.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.693+0000 7f425c812640 1 -- 172.21.15.53:0/2804485105 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f425815e690 con 0x7f425815fc40 2023-06-10T19:03:31.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.697+0000 7f425c812640 1 -- 172.21.15.53:0/2804485105 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42580cd140 con 0x7f425815fc40 2023-06-10T19:03:31.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.697+0000 7f424effd640 1 -- 172.21.15.53:0/2804485105 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f42500b6040 con 0x7f425815fc40 2023-06-10T19:03:31.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.697+0000 7f424effd640 1 --2- 172.21.15.53:0/2804485105 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4238066280 0x7f4238068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:31.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.697+0000 7f424effd640 1 -- 172.21.15.53:0/2804485105 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f4250121d70 con 0x7f425815fc40 2023-06-10T19:03:31.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.697+0000 7f425659c640 1 --2- 172.21.15.53:0/2804485105 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4238066280 0x7f4238068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:31.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.697+0000 7f425659c640 1 --2- 172.21.15.53:0/2804485105 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4238066280 0x7f4238068730 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f42480097a0 tx=0x7f4248008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:31.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.701+0000 7f424effd640 1 -- 172.21.15.53:0/2804485105 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f42500ef360 con 0x7f425815fc40 2023-06-10T19:03:31.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.845+0000 7f425c812640 1 -- 172.21.15.53:0/2804485105 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f42580b2d10 con 0x7f425815fc40 2023-06-10T19:03:31.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.845+0000 7f424effd640 1 -- 172.21.15.53:0/2804485105 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v98) v1 ==== 104+0+11 (secure 0 0 0) 0x7f42500b40a0 con 0x7f425815fc40 2023-06-10T19:03:31.851 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-06-10T19:03:31.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.849+0000 7f425c812640 1 -- 172.21.15.53:0/2804485105 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4238066280 msgr2=0x7f4238068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:31.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.849+0000 7f425c812640 1 --2- 172.21.15.53:0/2804485105 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4238066280 0x7f4238068730 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f42480097a0 tx=0x7f4248008040 comp rx=0 tx=0).stop 2023-06-10T19:03:31.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.849+0000 7f425c812640 1 -- 172.21.15.53:0/2804485105 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f425815fc40 msgr2=0x7f42580ac940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:31.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.849+0000 7f425c812640 1 --2- 172.21.15.53:0/2804485105 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f425815fc40 0x7f42580ac940 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f42500b2040 tx=0x7f425001bf60 comp rx=0 tx=0).stop 2023-06-10T19:03:31.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.849+0000 7f425c812640 1 -- 172.21.15.53:0/2804485105 shutdown_connections 2023-06-10T19:03:31.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.849+0000 7f425c812640 1 --2- 172.21.15.53:0/2804485105 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4238066280 0x7f4238068730 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:31.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.849+0000 7f425c812640 1 --2- 172.21.15.53:0/2804485105 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f425815fc40 0x7f42580ac940 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:31.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.849+0000 7f425c812640 1 --2- 172.21.15.53:0/2804485105 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42580af0e0 0x7f425815a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:31.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.849+0000 7f425c812640 1 --2- 172.21.15.53:0/2804485105 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f425806eca0 0x7f425815ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:31.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.849+0000 7f425c812640 1 -- 172.21.15.53:0/2804485105 >> 172.21.15.53:0/2804485105 conn(0x7f425806a0e0 msgr2=0x7f42580c60b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:31.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.849+0000 7f425c812640 1 -- 172.21.15.53:0/2804485105 shutdown_connections 2023-06-10T19:03:31.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.849+0000 7f425c812640 1 -- 172.21.15.53:0/2804485105 wait complete. 2023-06-10T19:03:31.868 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-10T19:03:31.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.989+0000 7f67877cc640 1 Processor -- start 2023-06-10T19:03:31.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.989+0000 7f67877cc640 1 -- start start 2023-06-10T19:03:31.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.993+0000 7f67877cc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f678015fc10 0x7f67800b0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:31.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.993+0000 7f67877cc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f678015ffe0 0x7f67800c9e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:31.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.993+0000 7f67877cc640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6780160990 con 0x7f67800ca350 2023-06-10T19:03:31.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.993+0000 7f67877cc640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6780160c70 con 0x7f678015ffe0 2023-06-10T19:03:31.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.993+0000 7f67877cc640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6780160f50 con 0x7f678015fc10 2023-06-10T19:03:31.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.993+0000 7f6784d67640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f678015ffe0 0x7f67800c9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:31.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.993+0000 7f6784d67640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f678015ffe0 0x7f67800c9e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59796/0 (socket says 172.21.15.53:59796) 2023-06-10T19:03:31.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.993+0000 7f6784d67640 1 -- 172.21.15.53:0/948790107 learned_addr learned my addr 172.21.15.53:0/948790107 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:31.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.993+0000 7f6785568640 1 --2- 172.21.15.53:0/948790107 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f678015fc10 0x7f67800b0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:31.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.993+0000 7f6784d67640 1 -- 172.21.15.53:0/948790107 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f678015fc10 msgr2=0x7f67800b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:31.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.993+0000 7f6784d67640 1 --2- 172.21.15.53:0/948790107 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f678015fc10 0x7f67800b0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:31.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.993+0000 7f6784d67640 1 -- 172.21.15.53:0/948790107 >> v1:172.21.15.117:6789/0 conn(0x7f67800ca350 legacy=0x7f67800ccea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:31.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.993+0000 7f6784d67640 1 -- 172.21.15.53:0/948790107 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67800c98f0 con 0x7f678015ffe0 2023-06-10T19:03:32.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.993+0000 7f6784d67640 1 --2- 172.21.15.53:0/948790107 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f678015ffe0 0x7f67800c9e10 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f6770009870 tx=0x7f677001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=447b4593e03de3fa server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:32.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.997+0000 7f6777fff640 1 -- 172.21.15.53:0/948790107 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67700aa640 con 0x7f678015ffe0 2023-06-10T19:03:32.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.997+0000 7f6777fff640 1 -- 172.21.15.53:0/948790107 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67700aa7a0 con 0x7f678015ffe0 2023-06-10T19:03:32.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.997+0000 7f6777fff640 1 -- 172.21.15.53:0/948790107 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67700aab30 con 0x7f678015ffe0 2023-06-10T19:03:32.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.997+0000 7f67877cc640 1 -- 172.21.15.53:0/948790107 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f678015ffe0 msgr2=0x7f67800c9e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:32.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.997+0000 7f67877cc640 1 --2- 172.21.15.53:0/948790107 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f678015ffe0 0x7f67800c9e10 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f6770009870 tx=0x7f677001c540 comp rx=0 tx=0).stop 2023-06-10T19:03:32.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.997+0000 7f67877cc640 1 -- 172.21.15.53:0/948790107 shutdown_connections 2023-06-10T19:03:32.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.997+0000 7f67877cc640 1 --2- 172.21.15.53:0/948790107 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f678015ffe0 0x7f67800c9e10 unknown :-1 s=CLOSED pgs=1621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:32.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.997+0000 7f67877cc640 1 --2- 172.21.15.53:0/948790107 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f678015fc10 0x7f67800b0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:32.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.997+0000 7f67877cc640 1 -- 172.21.15.53:0/948790107 >> 172.21.15.53:0/948790107 conn(0x7f678006a0e0 msgr2=0x7f67800cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:32.002 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.997+0000 7f67877cc640 1 -- 172.21.15.53:0/948790107 shutdown_connections 2023-06-10T19:03:32.002 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.997+0000 7f67877cc640 1 -- 172.21.15.53:0/948790107 wait complete. 2023-06-10T19:03:32.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.997+0000 7f67877cc640 1 Processor -- start 2023-06-10T19:03:32.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.997+0000 7f67877cc640 1 -- start start 2023-06-10T19:03:32.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.997+0000 7f67877cc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67800ca350 0x7f67800c1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:32.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.997+0000 7f67877cc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f678015fc10 0x7f67800c3280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:32.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.997+0000 7f67877cc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f678015ffe0 0x7f67800c37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:32.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.997+0000 7f67877cc640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67801586f0 con 0x7f678015ffe0 2023-06-10T19:03:32.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.997+0000 7f67877cc640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6780157910 con 0x7f678015fc10 2023-06-10T19:03:32.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.997+0000 7f67877cc640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6780157bf0 con 0x7f67800ca350 2023-06-10T19:03:32.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.997+0000 7f6785d69640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f678015ffe0 0x7f67800c37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:32.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.997+0000 7f6785d69640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f678015ffe0 0x7f67800c37c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59812/0 (socket says 172.21.15.53:59812) 2023-06-10T19:03:32.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.997+0000 7f6785d69640 1 -- 172.21.15.53:0/1443808796 learned_addr learned my addr 172.21.15.53:0/1443808796 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:32.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.997+0000 7f6785568640 1 --2- 172.21.15.53:0/1443808796 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67800ca350 0x7f67800c1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:32.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.997+0000 7f6784d67640 1 --2- 172.21.15.53:0/1443808796 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f678015fc10 0x7f67800c3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:32.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.997+0000 7f6785d69640 1 -- 172.21.15.53:0/1443808796 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67800ca350 msgr2=0x7f67800c1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:32.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.997+0000 7f6785d69640 1 --2- 172.21.15.53:0/1443808796 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67800ca350 0x7f67800c1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:32.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.997+0000 7f6785d69640 1 -- 172.21.15.53:0/1443808796 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f678015fc10 msgr2=0x7f67800c3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:32.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.997+0000 7f6785d69640 1 --2- 172.21.15.53:0/1443808796 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f678015fc10 0x7f67800c3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:32.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.997+0000 7f6785d69640 1 -- 172.21.15.53:0/1443808796 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67700094d0 con 0x7f678015ffe0 2023-06-10T19:03:32.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.997+0000 7f6785d69640 1 --2- 172.21.15.53:0/1443808796 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f678015ffe0 0x7f67800c37c0 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f677800c7a0 tx=0x7f677800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:32.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.997+0000 7f6775ffb640 1 -- 172.21.15.53:0/1443808796 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6778003b80 con 0x7f678015ffe0 2023-06-10T19:03:32.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.997+0000 7f6775ffb640 1 -- 172.21.15.53:0/1443808796 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6778003ce0 con 0x7f678015ffe0 2023-06-10T19:03:32.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.997+0000 7f6775ffb640 1 -- 172.21.15.53:0/1443808796 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677800aa30 con 0x7f678015ffe0 2023-06-10T19:03:32.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.997+0000 7f67877cc640 1 -- 172.21.15.53:0/1443808796 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6780157ed0 con 0x7f678015ffe0 2023-06-10T19:03:32.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:31.997+0000 7f67877cc640 1 -- 172.21.15.53:0/1443808796 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6780156940 con 0x7f678015ffe0 2023-06-10T19:03:32.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.001+0000 7f67877cc640 1 -- 172.21.15.53:0/1443808796 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f678004d790 con 0x7f678015ffe0 2023-06-10T19:03:32.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.001+0000 7f6775ffb640 1 -- 172.21.15.53:0/1443808796 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f677800ab90 con 0x7f678015ffe0 2023-06-10T19:03:32.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.001+0000 7f6775ffb640 1 --2- 172.21.15.53:0/1443808796 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f67640662b0 0x7f6764068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:32.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.001+0000 7f6775ffb640 1 -- 172.21.15.53:0/1443808796 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f6778083c60 con 0x7f678015ffe0 2023-06-10T19:03:32.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.001+0000 7f6785568640 1 --2- 172.21.15.53:0/1443808796 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f67640662b0 0x7f6764068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:32.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.001+0000 7f6785568640 1 --2- 172.21.15.53:0/1443808796 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f67640662b0 0x7f6764068760 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f677c009af0 tx=0x7f677c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:32.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.005+0000 7f6775ffb640 1 -- 172.21.15.53:0/1443808796 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6778050fe0 con 0x7f678015ffe0 2023-06-10T19:03:32.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.157+0000 7f67877cc640 1 -- 172.21.15.53:0/1443808796 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6780157a50 con 0x7f678015ffe0 2023-06-10T19:03:32.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.157+0000 7f6775ffb640 1 -- 172.21.15.53:0/1443808796 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v98) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6780157a50 con 0x7f678015ffe0 2023-06-10T19:03:32.163 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-06-10T19:03:32.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.161+0000 7f67877cc640 1 -- 172.21.15.53:0/1443808796 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f67640662b0 msgr2=0x7f6764068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:32.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.161+0000 7f67877cc640 1 --2- 172.21.15.53:0/1443808796 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f67640662b0 0x7f6764068760 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f677c009af0 tx=0x7f677c008040 comp rx=0 tx=0).stop 2023-06-10T19:03:32.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.161+0000 7f67877cc640 1 -- 172.21.15.53:0/1443808796 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f678015ffe0 msgr2=0x7f67800c37c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:32.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.161+0000 7f67877cc640 1 --2- 172.21.15.53:0/1443808796 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f678015ffe0 0x7f67800c37c0 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f677800c7a0 tx=0x7f677800cc60 comp rx=0 tx=0).stop 2023-06-10T19:03:32.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.161+0000 7f67877cc640 1 -- 172.21.15.53:0/1443808796 shutdown_connections 2023-06-10T19:03:32.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.161+0000 7f67877cc640 1 --2- 172.21.15.53:0/1443808796 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f67640662b0 0x7f6764068760 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:32.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.161+0000 7f67877cc640 1 --2- 172.21.15.53:0/1443808796 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f678015ffe0 0x7f67800c37c0 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:32.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.161+0000 7f67877cc640 1 --2- 172.21.15.53:0/1443808796 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f678015fc10 0x7f67800c3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:32.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.161+0000 7f67877cc640 1 --2- 172.21.15.53:0/1443808796 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67800ca350 0x7f67800c1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:32.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.161+0000 7f67877cc640 1 -- 172.21.15.53:0/1443808796 >> 172.21.15.53:0/1443808796 conn(0x7f678006a0e0 msgr2=0x7f678015c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:32.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.161+0000 7f67877cc640 1 -- 172.21.15.53:0/1443808796 shutdown_connections 2023-06-10T19:03:32.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.161+0000 7f67877cc640 1 -- 172.21.15.53:0/1443808796 wait complete. 2023-06-10T19:03:32.182 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-10T19:03:32.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.305+0000 7f548c7b5640 1 Processor -- start 2023-06-10T19:03:32.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.305+0000 7f548c7b5640 1 -- start start 2023-06-10T19:03:32.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.305+0000 7f548c7b5640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f54840afee0 0x7f54841645f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:32.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.305+0000 7f548c7b5640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5484071190 con 0x7f5484070100 2023-06-10T19:03:32.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.305+0000 7f548c7b5640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5484070580 con 0x7f54841571a0 2023-06-10T19:03:32.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.305+0000 7f548c7b5640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5484070860 con 0x7f54840afee0 2023-06-10T19:03:32.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.305+0000 7f5489d50640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f5484070100 0x7f54840af7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56332/0 (socket says 172.21.15.53:56332) 2023-06-10T19:03:32.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.305+0000 7f5489d50640 1 -- 172.21.15.53:0/533767135 learned_addr learned my addr 172.21.15.53:0/533767135 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:03:32.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.305+0000 7f548ad52640 1 --2- 172.21.15.53:0/533767135 >> v2:172.21.15.117:3300/0 conn(0x7f54840afee0 0x7f54841645f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:32.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.305+0000 7f548954f640 1 -- 172.21.15.53:0/533767135 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2117736820 0 0) 0x7f5484071190 con 0x7f5484070100 2023-06-10T19:03:32.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.305+0000 7f548954f640 1 -- 172.21.15.53:0/533767135 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5470003530 con 0x7f5484070100 2023-06-10T19:03:32.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.305+0000 7f548954f640 1 -- 172.21.15.53:0/533767135 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3064600414 0 0) 0x7f5470003530 con 0x7f5484070100 2023-06-10T19:03:32.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.305+0000 7f548954f640 1 -- 172.21.15.53:0/533767135 >> v2:172.21.15.117:3300/0 conn(0x7f54840afee0 msgr2=0x7f54841645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:32.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.305+0000 7f548954f640 1 --2- 172.21.15.53:0/533767135 >> v2:172.21.15.117:3300/0 conn(0x7f54840afee0 0x7f54841645f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:32.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.305+0000 7f548954f640 1 -- 172.21.15.53:0/533767135 >> v1:172.21.15.117:6789/0 conn(0x7f54841571a0 legacy=0x7f54840c9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:32.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.305+0000 7f548954f640 1 -- 172.21.15.53:0/533767135 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5484070b40 con 0x7f5484070100 2023-06-10T19:03:32.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.305+0000 7f548954f640 1 -- 172.21.15.53:0/533767135 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f5480001680 con 0x7f5484070100 2023-06-10T19:03:32.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.305+0000 7f548954f640 1 -- 172.21.15.53:0/533767135 >> v1:172.21.15.53:6789/0 conn(0x7f5484070100 legacy=0x7f54840af7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:32.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.305+0000 7f548954f640 1 --2- 172.21.15.53:0/533767135 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5470003980 0x7f5470003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:32.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.305+0000 7f548954f640 1 --2- 172.21.15.53:0/533767135 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54700047d0 0x7f5470004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:32.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.305+0000 7f548954f640 1 --2- 172.21.15.53:0/533767135 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5470005180 0x7f547000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:32.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.305+0000 7f548954f640 1 -- 172.21.15.53:0/533767135 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5484070860 con 0x7f5470003980 2023-06-10T19:03:32.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.305+0000 7f548954f640 1 -- 172.21.15.53:0/533767135 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f547000c000 con 0x7f5470005180 2023-06-10T19:03:32.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.305+0000 7f548954f640 1 -- 172.21.15.53:0/533767135 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f547000c1c0 con 0x7f54700047d0 2023-06-10T19:03:32.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.305+0000 7f548a551640 1 --2- 172.21.15.53:0/533767135 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5470003980 0x7f5470003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:32.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.305+0000 7f548ad52640 1 --2- 172.21.15.53:0/533767135 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5470005180 0x7f547000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:32.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.305+0000 7f5489d50640 1 --2- 172.21.15.53:0/533767135 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54700047d0 0x7f5470004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:32.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.305+0000 7f548a551640 1 -- 172.21.15.53:0/533767135 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54700047d0 msgr2=0x7f5470004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:32.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.305+0000 7f548a551640 1 --2- 172.21.15.53:0/533767135 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54700047d0 0x7f5470004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:32.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.305+0000 7f548a551640 1 -- 172.21.15.53:0/533767135 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5470005180 msgr2=0x7f547000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:32.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.305+0000 7f548a551640 1 --2- 172.21.15.53:0/533767135 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5470005180 0x7f547000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:32.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.305+0000 7f548ad52640 1 -- 172.21.15.53:0/533767135 reap_dead start 2023-06-10T19:03:32.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.305+0000 7f548a551640 1 -- 172.21.15.53:0/533767135 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5470003530 con 0x7f5470003980 2023-06-10T19:03:32.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.305+0000 7f5489d50640 1 --2- 172.21.15.53:0/533767135 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54700047d0 0x7f5470004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:03:32.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.309+0000 7f548a551640 1 --2- 172.21.15.53:0/533767135 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5470003980 0x7f5470003d90 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7f54740017b0 tx=0x7f547401c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed2922c39ab1dc6a server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:32.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.309+0000 7f548954f640 1 -- 172.21.15.53:0/533767135 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54740050d0 con 0x7f5470003980 2023-06-10T19:03:32.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.309+0000 7f548954f640 1 -- 172.21.15.53:0/533767135 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54740a7050 con 0x7f5470003980 2023-06-10T19:03:32.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.309+0000 7f548954f640 1 -- 172.21.15.53:0/533767135 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5474005470 con 0x7f5470003980 2023-06-10T19:03:32.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.309+0000 7f548c7b5640 1 -- 172.21.15.53:0/533767135 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5470003980 msgr2=0x7f5470003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:32.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.309+0000 7f548c7b5640 1 --2- 172.21.15.53:0/533767135 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5470003980 0x7f5470003d90 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7f54740017b0 tx=0x7f547401c390 comp rx=0 tx=0).stop 2023-06-10T19:03:32.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.309+0000 7f548c7b5640 1 -- 172.21.15.53:0/533767135 shutdown_connections 2023-06-10T19:03:32.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.309+0000 7f548c7b5640 1 --2- 172.21.15.53:0/533767135 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5470003980 0x7f5470003d90 unknown :-1 s=CLOSED pgs=1624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:32.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.309+0000 7f548c7b5640 1 -- 172.21.15.53:0/533767135 >> 172.21.15.53:0/533767135 conn(0x7f54840ce9e0 msgr2=0x7f54840ca7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:32.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.309+0000 7f548c7b5640 1 -- 172.21.15.53:0/533767135 shutdown_connections 2023-06-10T19:03:32.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.309+0000 7f548c7b5640 1 -- 172.21.15.53:0/533767135 wait complete. 2023-06-10T19:03:32.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.309+0000 7f548c7b5640 1 Processor -- start 2023-06-10T19:03:32.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.309+0000 7f548c7b5640 1 -- start start 2023-06-10T19:03:32.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.313+0000 7f548c7b5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5470003980 0x7f54840b0de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:32.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.313+0000 7f548c7b5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54841f6660 0x7f54840b2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:32.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.313+0000 7f548c7b5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f54840b3070 0x7f54840c0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:32.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.313+0000 7f548c7b5640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54840c5770 con 0x7f54840b3070 2023-06-10T19:03:32.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.313+0000 7f548c7b5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54840b3530 con 0x7f5470003980 2023-06-10T19:03:32.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.313+0000 7f548c7b5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54840b3810 con 0x7f54841f6660 2023-06-10T19:03:32.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.313+0000 7f548ad52640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f54840b3070 0x7f54840c0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:32.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.313+0000 7f548ad52640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f54840b3070 0x7f54840c0bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59838/0 (socket says 172.21.15.53:59838) 2023-06-10T19:03:32.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.313+0000 7f548ad52640 1 -- 172.21.15.53:0/945580624 learned_addr learned my addr 172.21.15.53:0/945580624 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:32.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.313+0000 7f548a551640 1 --2- 172.21.15.53:0/945580624 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5470003980 0x7f54840b0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:32.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.313+0000 7f5489d50640 1 --2- 172.21.15.53:0/945580624 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54841f6660 0x7f54840b2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:32.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.313+0000 7f548ad52640 1 -- 172.21.15.53:0/945580624 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54841f6660 msgr2=0x7f54840b2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:32.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.313+0000 7f548ad52640 1 --2- 172.21.15.53:0/945580624 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54841f6660 0x7f54840b2b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:32.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.313+0000 7f548ad52640 1 -- 172.21.15.53:0/945580624 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5470003980 msgr2=0x7f54840b0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:32.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.313+0000 7f548ad52640 1 --2- 172.21.15.53:0/945580624 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5470003980 0x7f54840b0de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:32.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.313+0000 7f548ad52640 1 -- 172.21.15.53:0/945580624 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54840b3af0 con 0x7f54840b3070 2023-06-10T19:03:32.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.313+0000 7f548ad52640 1 --2- 172.21.15.53:0/945580624 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f54840b3070 0x7f54840c0bf0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f548406ee00 tx=0x7f547c007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:32.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.313+0000 7f547affd640 1 -- 172.21.15.53:0/945580624 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f547c00e070 con 0x7f54840b3070 2023-06-10T19:03:32.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.313+0000 7f547affd640 1 -- 172.21.15.53:0/945580624 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f547c003c70 con 0x7f54840b3070 2023-06-10T19:03:32.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.313+0000 7f548c7b5640 1 -- 172.21.15.53:0/945580624 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54840c59c0 con 0x7f54840b3070 2023-06-10T19:03:32.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.313+0000 7f547affd640 1 -- 172.21.15.53:0/945580624 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f547c003e00 con 0x7f54840b3070 2023-06-10T19:03:32.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.313+0000 7f548c7b5640 1 -- 172.21.15.53:0/945580624 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54840b14f0 con 0x7f54840b3070 2023-06-10T19:03:32.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.313+0000 7f548c7b5640 1 -- 172.21.15.53:0/945580624 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54840c5c00 con 0x7f54840b3070 2023-06-10T19:03:32.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.313+0000 7f547affd640 1 -- 172.21.15.53:0/945580624 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f547c004030 con 0x7f54840b3070 2023-06-10T19:03:32.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.313+0000 7f547affd640 1 --2- 172.21.15.53:0/945580624 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5468066280 0x7f5468068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:32.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.313+0000 7f547affd640 1 -- 172.21.15.53:0/945580624 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f547c083ca0 con 0x7f54840b3070 2023-06-10T19:03:32.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.313+0000 7f548a551640 1 --2- 172.21.15.53:0/945580624 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5468066280 0x7f5468068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:32.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.317+0000 7f548a551640 1 --2- 172.21.15.53:0/945580624 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5468066280 0x7f5468068730 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f54740ac000 tx=0x7f54740011f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:32.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.317+0000 7f547affd640 1 -- 172.21.15.53:0/945580624 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f54840c5c00 con 0x7f54840b3070 2023-06-10T19:03:32.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.485+0000 7f548c7b5640 1 -- 172.21.15.53:0/945580624 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f548404d790 con 0x7f54840b3070 2023-06-10T19:03:32.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.485+0000 7f547affd640 1 -- 172.21.15.53:0/945580624 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 3 entries v98) v1 ==== 80+0+179 (secure 0 0 0) 0x7f547c054ab0 con 0x7f54840b3070 2023-06-10T19:03:32.489 INFO:teuthology.orchestra.run.smithi053.stdout:192.168.0.1:0/3897417564 2023-06-10T20:03:25.147615+0000 2023-06-10T19:03:32.489 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:6833/1894654263 2023-06-11T19:02:29.480972+0000 2023-06-10T19:03:32.490 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:6832/1894654263 2023-06-11T19:02:29.480972+0000 2023-06-10T19:03:32.490 INFO:teuthology.orchestra.run.smithi053.stderr:listed 3 entries 2023-06-10T19:03:32.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.485+0000 7f548c7b5640 1 -- 172.21.15.53:0/945580624 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5468066280 msgr2=0x7f5468068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:32.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.485+0000 7f548c7b5640 1 --2- 172.21.15.53:0/945580624 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5468066280 0x7f5468068730 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f54740ac000 tx=0x7f54740011f0 comp rx=0 tx=0).stop 2023-06-10T19:03:32.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.485+0000 7f548c7b5640 1 -- 172.21.15.53:0/945580624 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f54840b3070 msgr2=0x7f54840c0bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:32.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.485+0000 7f548c7b5640 1 --2- 172.21.15.53:0/945580624 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f54840b3070 0x7f54840c0bf0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f548406ee00 tx=0x7f547c007d90 comp rx=0 tx=0).stop 2023-06-10T19:03:32.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.485+0000 7f548c7b5640 1 -- 172.21.15.53:0/945580624 shutdown_connections 2023-06-10T19:03:32.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.485+0000 7f548c7b5640 1 --2- 172.21.15.53:0/945580624 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5468066280 0x7f5468068730 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:32.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.485+0000 7f548c7b5640 1 --2- 172.21.15.53:0/945580624 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f54840b3070 0x7f54840c0bf0 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:32.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.485+0000 7f548c7b5640 1 --2- 172.21.15.53:0/945580624 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54841f6660 0x7f54840b2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:32.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.485+0000 7f548c7b5640 1 --2- 172.21.15.53:0/945580624 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5470003980 0x7f54840b0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:32.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.485+0000 7f548c7b5640 1 -- 172.21.15.53:0/945580624 >> 172.21.15.53:0/945580624 conn(0x7f54840ce9e0 msgr2=0x7f54840cc7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:32.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.489+0000 7f548c7b5640 1 -- 172.21.15.53:0/945580624 shutdown_connections 2023-06-10T19:03:32.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.489+0000 7f548c7b5640 1 -- 172.21.15.53:0/945580624 wait complete. 2023-06-10T19:03:32.508 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi117.front.sepia.ceph.com... 2023-06-10T19:03:32.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:03:32.509 DEBUG:teuthology.orchestra.run.smithi117:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-06-10T19:03:32.523 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi117.stderr:ceph-fuse[44967]: fuse finished with error 0 and tester_r 0 2023-06-10T19:03:32.524 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi117.front.sepia.ceph.com 2023-06-10T19:03:32.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:03:32.525 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-06-10T19:03:32.605 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T19:03:32.606 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:03:32.611 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16345192k,nr_inodes=4086298,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276544k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=407 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276540k,nr_inodes=819135,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276544k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-06-10T19:03:32.612 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi053.front.sepia.ceph.com 2023-06-10T19:03:32.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:03:32.612 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-06-10T19:03:32.659 INFO:teuthology.orchestra.run.smithi053.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-06-10T19:03:32.660 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-10T19:03:32.661 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T19:03:32.661 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:03:32.667 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16342088k,nr_inodes=4085522,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275924k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18845 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275920k,nr_inodes=818980,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275924k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-06-10T19:03:32.667 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi117.front.sepia.ceph.com 2023-06-10T19:03:32.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:03:32.668 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-06-10T19:03:32.715 INFO:teuthology.orchestra.run.smithi117.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-06-10T19:03:32.716 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-10T19:03:32.717 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:03:32.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.849+0000 7fd52dd49640 1 Processor -- start 2023-06-10T19:03:32.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.849+0000 7fd52dd49640 1 -- start start 2023-06-10T19:03:32.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.849+0000 7fd52dd49640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd528071060 0x7fd5280af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:32.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.849+0000 7fd52dd49640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd5280afc60 0x7fd52806b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:32.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.849+0000 7fd52dd49640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd528159b50 con 0x7fd5280c9840 2023-06-10T19:03:32.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.849+0000 7fd52dd49640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5280702a0 con 0x7fd5280afc60 2023-06-10T19:03:32.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.849+0000 7fd52dd49640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd528070580 con 0x7fd528071060 2023-06-10T19:03:32.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.849+0000 7fd5277fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fd5280c9840 0x7fd5280c9c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56346/0 (socket says 172.21.15.53:56346) 2023-06-10T19:03:32.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.849+0000 7fd5277fe640 1 -- 172.21.15.53:0/2501023906 learned_addr learned my addr 172.21.15.53:0/2501023906 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:03:32.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.849+0000 7fd527fff640 1 --2- 172.21.15.53:0/2501023906 >> v2:172.21.15.53:3300/0 conn(0x7fd5280afc60 0x7fd52806b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:32.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.849+0000 7fd527fff640 1 -- 172.21.15.53:0/2501023906 >> v2:172.21.15.117:3300/0 conn(0x7fd528071060 msgr2=0x7fd5280af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:32.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.849+0000 7fd527fff640 1 --2- 172.21.15.53:0/2501023906 >> v2:172.21.15.117:3300/0 conn(0x7fd528071060 0x7fd5280af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:32.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.849+0000 7fd527fff640 1 -- 172.21.15.53:0/2501023906 >> v1:172.21.15.53:6789/0 conn(0x7fd5280c9840 legacy=0x7fd5280c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:32.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.849+0000 7fd526ffd640 1 -- 172.21.15.53:0/2501023906 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2828857083 0 0) 0x7fd528159b50 con 0x7fd5280c9840 2023-06-10T19:03:32.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.849+0000 7fd527fff640 1 -- 172.21.15.53:0/2501023906 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd528070860 con 0x7fd5280afc60 2023-06-10T19:03:32.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.849+0000 7fd527fff640 1 --2- 172.21.15.53:0/2501023906 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5280afc60 0x7fd52806b090 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7fd52806e650 tx=0x7fd52001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f239136d398d925 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:32.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.853+0000 7fd526ffd640 1 -- 172.21.15.53:0/2501023906 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5200a59c0 con 0x7fd5280afc60 2023-06-10T19:03:32.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.853+0000 7fd526ffd640 1 -- 172.21.15.53:0/2501023906 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5200a5b20 con 0x7fd5280afc60 2023-06-10T19:03:32.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.853+0000 7fd526ffd640 1 -- 172.21.15.53:0/2501023906 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5200ad440 con 0x7fd5280afc60 2023-06-10T19:03:32.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.853+0000 7fd52dd49640 1 -- 172.21.15.53:0/2501023906 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5280afc60 msgr2=0x7fd52806b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:32.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.853+0000 7fd52dd49640 1 --2- 172.21.15.53:0/2501023906 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5280afc60 0x7fd52806b090 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7fd52806e650 tx=0x7fd52001c8e0 comp rx=0 tx=0).stop 2023-06-10T19:03:32.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.853+0000 7fd52dd49640 1 -- 172.21.15.53:0/2501023906 shutdown_connections 2023-06-10T19:03:32.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.853+0000 7fd52dd49640 1 --2- 172.21.15.53:0/2501023906 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5280afc60 0x7fd52806b090 unknown :-1 s=CLOSED pgs=1627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:32.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.853+0000 7fd52dd49640 1 --2- 172.21.15.53:0/2501023906 >> v2:172.21.15.117:3300/0 conn(0x7fd528071060 0x7fd5280af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:32.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.853+0000 7fd52dd49640 1 -- 172.21.15.53:0/2501023906 >> 172.21.15.53:0/2501023906 conn(0x7fd52806a0d0 msgr2=0x7fd5280ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:32.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.853+0000 7fd52dd49640 1 -- 172.21.15.53:0/2501023906 shutdown_connections 2023-06-10T19:03:32.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.853+0000 7fd52dd49640 1 -- 172.21.15.53:0/2501023906 wait complete. 2023-06-10T19:03:32.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.853+0000 7fd52dd49640 1 Processor -- start 2023-06-10T19:03:32.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.853+0000 7fd52dd49640 1 -- start start 2023-06-10T19:03:32.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.853+0000 7fd52dd49640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd528071060 0x7fd5280aec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:32.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.853+0000 7fd52dd49640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5280afc60 0x7fd528154c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:32.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.853+0000 7fd52dd49640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5280c9840 0x7fd52814dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:32.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.853+0000 7fd52dd49640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd528164200 con 0x7fd528071060 2023-06-10T19:03:32.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.853+0000 7fd52dd49640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5280af140 con 0x7fd5280afc60 2023-06-10T19:03:32.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.853+0000 7fd52dd49640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5281635f0 con 0x7fd5280c9840 2023-06-10T19:03:32.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.853+0000 7fd5277fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd528071060 0x7fd5280aec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:32.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.853+0000 7fd5277fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd528071060 0x7fd5280aec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59858/0 (socket says 172.21.15.53:59858) 2023-06-10T19:03:32.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.853+0000 7fd5277fe640 1 -- 172.21.15.53:0/45898689 learned_addr learned my addr 172.21.15.53:0/45898689 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:32.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.853+0000 7fd5277fe640 1 -- 172.21.15.53:0/45898689 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5280c9840 msgr2=0x7fd52814dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:32.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.853+0000 7fd5277fe640 1 --2- 172.21.15.53:0/45898689 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5280c9840 0x7fd52814dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:32.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.853+0000 7fd5277fe640 1 -- 172.21.15.53:0/45898689 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5280afc60 msgr2=0x7fd528154c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:32.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.853+0000 7fd5277fe640 1 --2- 172.21.15.53:0/45898689 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5280afc60 0x7fd528154c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:32.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.853+0000 7fd5277fe640 1 -- 172.21.15.53:0/45898689 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd520009a70 con 0x7fd528071060 2023-06-10T19:03:32.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.853+0000 7fd5277fe640 1 --2- 172.21.15.53:0/45898689 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd528071060 0x7fd5280aec00 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7fd51800c480 tx=0x7fd51800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:32.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.853+0000 7fd524ff9640 1 -- 172.21.15.53:0/45898689 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5180074e0 con 0x7fd528071060 2023-06-10T19:03:32.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.853+0000 7fd524ff9640 1 -- 172.21.15.53:0/45898689 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd518007660 con 0x7fd528071060 2023-06-10T19:03:32.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.853+0000 7fd52dd49640 1 -- 172.21.15.53:0/45898689 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5281638d0 con 0x7fd528071060 2023-06-10T19:03:32.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.853+0000 7fd524ff9640 1 -- 172.21.15.53:0/45898689 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd518004a30 con 0x7fd528071060 2023-06-10T19:03:32.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.853+0000 7fd52dd49640 1 -- 172.21.15.53:0/45898689 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd528163e90 con 0x7fd528071060 2023-06-10T19:03:32.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.857+0000 7fd52dd49640 1 -- 172.21.15.53:0/45898689 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd52804d790 con 0x7fd528071060 2023-06-10T19:03:32.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.857+0000 7fd524ff9640 1 -- 172.21.15.53:0/45898689 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd518004b90 con 0x7fd528071060 2023-06-10T19:03:32.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.857+0000 7fd524ff9640 1 --2- 172.21.15.53:0/45898689 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd508066280 0x7fd508068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:32.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.857+0000 7fd524ff9640 1 -- 172.21.15.53:0/45898689 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6307+0+0 (secure 0 0 0) 0x7fd518083330 con 0x7fd528071060 2023-06-10T19:03:32.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.857+0000 7fd51ffff640 1 --2- 172.21.15.53:0/45898689 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd508066280 0x7fd508068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:32.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.857+0000 7fd51ffff640 1 --2- 172.21.15.53:0/45898689 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd508066280 0x7fd508068730 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fd5280c4ad0 tx=0x7fd510006ca0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:32.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:32.861+0000 7fd524ff9640 1 -- 172.21.15.53:0/45898689 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd5180541d0 con 0x7fd528071060 2023-06-10T19:03:33.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.041+0000 7fd52dd49640 1 -- 172.21.15.53:0/45898689 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd5280cb140 con 0x7fd528071060 2023-06-10T19:03:33.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.041+0000 7fd524ff9640 1 -- 172.21.15.53:0/45898689 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4681 (secure 0 0 0) 0x7fd518053d60 con 0x7fd528071060 2023-06-10T19:03:33.047 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:03:33.047 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":55,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1617157670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1617157670},{"type":"v1","addr":"172.21.15.117:6836","nonce":1617157670}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6113,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3414416090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":3414416090},{"type":"v1","addr":"172.21.15.117:6837","nonce":3414416090}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6718,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2533467097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2533467097},{"type":"v1","addr":"172.21.15.53:6835","nonce":2533467097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:02:02.642809+0000","modified":"2023-06-10T19:03:27.208582+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8127":{"gid":8127,"name":"a","rank":0,"incarnation":52,"state":"up:active","state_seq":17,"addr":"172.21.15.53:6833/2984379521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2984379521},{"type":"v1","addr":"172.21.15.53:6833","nonce":2984379521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-06-10T19:03:33.048 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 55 2023-06-10T19:03:33.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.045+0000 7fd52dd49640 1 -- 172.21.15.53:0/45898689 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd508066280 msgr2=0x7fd508068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:33.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.045+0000 7fd52dd49640 1 --2- 172.21.15.53:0/45898689 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd508066280 0x7fd508068730 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fd5280c4ad0 tx=0x7fd510006ca0 comp rx=0 tx=0).stop 2023-06-10T19:03:33.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.045+0000 7fd52dd49640 1 -- 172.21.15.53:0/45898689 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd528071060 msgr2=0x7fd5280aec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:33.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.045+0000 7fd52dd49640 1 --2- 172.21.15.53:0/45898689 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd528071060 0x7fd5280aec00 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7fd51800c480 tx=0x7fd51800c940 comp rx=0 tx=0).stop 2023-06-10T19:03:33.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.045+0000 7fd52dd49640 1 -- 172.21.15.53:0/45898689 shutdown_connections 2023-06-10T19:03:33.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.045+0000 7fd52dd49640 1 --2- 172.21.15.53:0/45898689 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd508066280 0x7fd508068730 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:33.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.045+0000 7fd52dd49640 1 --2- 172.21.15.53:0/45898689 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5280c9840 0x7fd52814dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:33.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.045+0000 7fd52dd49640 1 --2- 172.21.15.53:0/45898689 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5280afc60 0x7fd528154c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:33.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.045+0000 7fd52dd49640 1 --2- 172.21.15.53:0/45898689 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd528071060 0x7fd5280aec00 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:33.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.045+0000 7fd52dd49640 1 -- 172.21.15.53:0/45898689 >> 172.21.15.53:0/45898689 conn(0x7fd52806a0d0 msgr2=0x7fd5280c9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:33.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.045+0000 7fd52dd49640 1 -- 172.21.15.53:0/45898689 shutdown_connections 2023-06-10T19:03:33.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.045+0000 7fd52dd49640 1 -- 172.21.15.53:0/45898689 wait complete. 2023-06-10T19:03:33.066 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:03:33.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.185+0000 7fdb92e11640 1 Processor -- start 2023-06-10T19:03:33.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.185+0000 7fdb92e11640 1 -- start start 2023-06-10T19:03:33.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.185+0000 7fdb92e11640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb8c0afe30 0x7fdb8c06efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:33.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.185+0000 7fdb92e11640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fdb8c06bb30 0x7fdb8c0ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:33.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.185+0000 7fdb92e11640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb8c0c9e50 con 0x7fdb8c157e10 2023-06-10T19:03:33.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.185+0000 7fdb92e11640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb8c0cd520 con 0x7fdb8c06bb30 2023-06-10T19:03:33.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.185+0000 7fdb92e11640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb8c06bf70 con 0x7fdb8c0afe30 2023-06-10T19:03:33.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.185+0000 7fdb913ae640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fdb8c06bb30 0x7fdb8c0ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:33.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.185+0000 7fdb8bfff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb8c0afe30 0x7fdb8c06efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:33.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.185+0000 7fdb8bfff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb8c0afe30 0x7fdb8c06efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.53:33394/0 (socket says 172.21.15.53:33394) 2023-06-10T19:03:33.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.185+0000 7fdb913ae640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fdb8c06bb30 0x7fdb8c0ccfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.53:43852/0 (socket says 172.21.15.53:43852) 2023-06-10T19:03:33.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.185+0000 7fdb8bfff640 1 -- 172.21.15.53:0/203224661 learned_addr learned my addr 172.21.15.53:0/203224661 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:33.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.185+0000 7fdb8bfff640 1 -- 172.21.15.53:0/203224661 >> v2:172.21.15.117:3300/0 conn(0x7fdb8c06bb30 msgr2=0x7fdb8c0ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:33.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.185+0000 7fdb8bfff640 1 --2- 172.21.15.53:0/203224661 >> v2:172.21.15.117:3300/0 conn(0x7fdb8c06bb30 0x7fdb8c0ccfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:33.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.185+0000 7fdb8bfff640 1 -- 172.21.15.53:0/203224661 >> v1:172.21.15.117:6789/0 conn(0x7fdb8c157e10 legacy=0x7fdb8c0af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:33.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.185+0000 7fdb8bfff640 1 -- 172.21.15.53:0/203224661 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb8c0c82f0 con 0x7fdb8c0afe30 2023-06-10T19:03:33.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.185+0000 7fdb913ae640 1 --2- 172.21.15.53:0/203224661 >> v2:172.21.15.117:3300/0 conn(0x7fdb8c06bb30 0x7fdb8c0ccfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-10T19:03:33.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.189+0000 7fdb8bfff640 1 --2- 172.21.15.53:0/203224661 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb8c0afe30 0x7fdb8c06efc0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fdb8000aa10 tx=0x7fdb8001d850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e951905c2e76900e server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:33.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.189+0000 7fdb8b7fe640 1 -- 172.21.15.53:0/203224661 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb800a6880 con 0x7fdb8c0afe30 2023-06-10T19:03:33.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.189+0000 7fdb8b7fe640 1 -- 172.21.15.53:0/203224661 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb800a69e0 con 0x7fdb8c0afe30 2023-06-10T19:03:33.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.189+0000 7fdb8b7fe640 1 -- 172.21.15.53:0/203224661 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb800a6d70 con 0x7fdb8c0afe30 2023-06-10T19:03:33.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.189+0000 7fdb92e11640 1 -- 172.21.15.53:0/203224661 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb8c0afe30 msgr2=0x7fdb8c06efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:33.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.189+0000 7fdb92e11640 1 --2- 172.21.15.53:0/203224661 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb8c0afe30 0x7fdb8c06efc0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fdb8000aa10 tx=0x7fdb8001d850 comp rx=0 tx=0).stop 2023-06-10T19:03:33.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.189+0000 7fdb92e11640 1 -- 172.21.15.53:0/203224661 shutdown_connections 2023-06-10T19:03:33.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.189+0000 7fdb92e11640 1 --2- 172.21.15.53:0/203224661 >> v2:172.21.15.117:3300/0 conn(0x7fdb8c06bb30 0x7fdb8c0ccfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:33.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.189+0000 7fdb92e11640 1 --2- 172.21.15.53:0/203224661 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb8c0afe30 0x7fdb8c06efc0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:33.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.189+0000 7fdb92e11640 1 -- 172.21.15.53:0/203224661 >> 172.21.15.53:0/203224661 conn(0x7fdb8c06a0d0 msgr2=0x7fdb8c0ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:33.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.189+0000 7fdb92e11640 1 -- 172.21.15.53:0/203224661 shutdown_connections 2023-06-10T19:03:33.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.189+0000 7fdb92e11640 1 -- 172.21.15.53:0/203224661 wait complete. 2023-06-10T19:03:33.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.189+0000 7fdb92e11640 1 Processor -- start 2023-06-10T19:03:33.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.189+0000 7fdb92e11640 1 -- start start 2023-06-10T19:03:33.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.193+0000 7fdb92e11640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb8c06bb30 0x7fdb8c0c0e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:33.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.193+0000 7fdb92e11640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb8c0afe30 0x7fdb8c0c1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:33.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.193+0000 7fdb92e11640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb8c157e10 0x7fdb8c0c20e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:33.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.193+0000 7fdb92e11640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb8c0ad700 con 0x7fdb8c06bb30 2023-06-10T19:03:33.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.193+0000 7fdb92e11640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb8c0ac210 con 0x7fdb8c157e10 2023-06-10T19:03:33.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.193+0000 7fdb92e11640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb8c0b2a60 con 0x7fdb8c0afe30 2023-06-10T19:03:33.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.193+0000 7fdb90bad640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb8c06bb30 0x7fdb8c0c0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:33.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.193+0000 7fdb90bad640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb8c06bb30 0x7fdb8c0c0e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59866/0 (socket says 172.21.15.53:59866) 2023-06-10T19:03:33.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.193+0000 7fdb90bad640 1 -- 172.21.15.53:0/1877774509 learned_addr learned my addr 172.21.15.53:0/1877774509 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:33.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.193+0000 7fdb8bfff640 1 --2- 172.21.15.53:0/1877774509 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb8c0afe30 0x7fdb8c0c1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:33.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.193+0000 7fdb913ae640 1 --2- 172.21.15.53:0/1877774509 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb8c157e10 0x7fdb8c0c20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:33.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.193+0000 7fdb90bad640 1 -- 172.21.15.53:0/1877774509 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb8c0afe30 msgr2=0x7fdb8c0c1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:33.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.193+0000 7fdb90bad640 1 --2- 172.21.15.53:0/1877774509 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb8c0afe30 0x7fdb8c0c1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:33.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.193+0000 7fdb90bad640 1 -- 172.21.15.53:0/1877774509 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb8c157e10 msgr2=0x7fdb8c0c20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:33.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.193+0000 7fdb90bad640 1 --2- 172.21.15.53:0/1877774509 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb8c157e10 0x7fdb8c0c20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:33.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.193+0000 7fdb90bad640 1 -- 172.21.15.53:0/1877774509 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb84009a70 con 0x7fdb8c06bb30 2023-06-10T19:03:33.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.193+0000 7fdb90bad640 1 --2- 172.21.15.53:0/1877774509 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb8c06bb30 0x7fdb8c0c0e10 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c00c370 tx=0x7fdb7c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:33.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.193+0000 7fdb897fa640 1 -- 172.21.15.53:0/1877774509 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb7c0052d0 con 0x7fdb8c06bb30 2023-06-10T19:03:33.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.193+0000 7fdb897fa640 1 -- 172.21.15.53:0/1877774509 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb7c005430 con 0x7fdb8c06bb30 2023-06-10T19:03:33.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.193+0000 7fdb897fa640 1 -- 172.21.15.53:0/1877774509 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb7c007260 con 0x7fdb8c06bb30 2023-06-10T19:03:33.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.193+0000 7fdb92e11640 1 -- 172.21.15.53:0/1877774509 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb8000a670 con 0x7fdb8c06bb30 2023-06-10T19:03:33.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.193+0000 7fdb92e11640 1 -- 172.21.15.53:0/1877774509 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb8c0b3020 con 0x7fdb8c06bb30 2023-06-10T19:03:33.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.193+0000 7fdb92e11640 1 -- 172.21.15.53:0/1877774509 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb8c04d790 con 0x7fdb8c06bb30 2023-06-10T19:03:33.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.193+0000 7fdb897fa640 1 -- 172.21.15.53:0/1877774509 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdb7c0073c0 con 0x7fdb8c06bb30 2023-06-10T19:03:33.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.193+0000 7fdb897fa640 1 --2- 172.21.15.53:0/1877774509 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdb78066280 0x7fdb78068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:33.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.193+0000 7fdb897fa640 1 -- 172.21.15.53:0/1877774509 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6307+0+0 (secure 0 0 0) 0x7fdb7c0831f0 con 0x7fdb8c06bb30 2023-06-10T19:03:33.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.193+0000 7fdb8bfff640 1 --2- 172.21.15.53:0/1877774509 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdb78066280 0x7fdb78068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:33.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.197+0000 7fdb8bfff640 1 --2- 172.21.15.53:0/1877774509 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdb78066280 0x7fdb78068730 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fdb800b0000 tx=0x7fdb80008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:33.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.197+0000 7fdb897fa640 1 -- 172.21.15.53:0/1877774509 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdb7c050570 con 0x7fdb8c06bb30 2023-06-10T19:03:33.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.353+0000 7fdb92e11640 1 -- 172.21.15.53:0/1877774509 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdb8c0ad4b0 con 0x7fdb8c06bb30 2023-06-10T19:03:33.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.357+0000 7fdb897fa640 1 -- 172.21.15.53:0/1877774509 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) v1 ==== 74+0+18665 (secure 0 0 0) 0x7fdb7c053b90 con 0x7fdb8c06bb30 2023-06-10T19:03:33.361 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:03:33.361 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":98,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:03:25.180996+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-06-10T19:02:00.325404+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-06-10T19:02:01.620938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.8","mappings":[{"from":1,"to":2}]},{"pgid":"14.17","mappings":[{"from":1,"to":7}]},{"pgid":"14.2d","mappings":[{"from":1,"to":7}]},{"pgid":"14.3a","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.0.1:0/3897417564":"2023-06-10T20:03:25.147615+0000","172.21.15.53:6833/1894654263":"2023-06-11T19:02:29.480972+0000","172.21.15.53:6832/1894654263":"2023-06-11T19:02:29.480972+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:03:33.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.357+0000 7fdb92e11640 1 -- 172.21.15.53:0/1877774509 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdb78066280 msgr2=0x7fdb78068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:33.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.357+0000 7fdb92e11640 1 --2- 172.21.15.53:0/1877774509 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdb78066280 0x7fdb78068730 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fdb800b0000 tx=0x7fdb80008040 comp rx=0 tx=0).stop 2023-06-10T19:03:33.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.357+0000 7fdb92e11640 1 -- 172.21.15.53:0/1877774509 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb8c06bb30 msgr2=0x7fdb8c0c0e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:33.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.357+0000 7fdb92e11640 1 --2- 172.21.15.53:0/1877774509 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb8c06bb30 0x7fdb8c0c0e10 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c00c370 tx=0x7fdb7c00c830 comp rx=0 tx=0).stop 2023-06-10T19:03:33.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.357+0000 7fdb92e11640 1 -- 172.21.15.53:0/1877774509 shutdown_connections 2023-06-10T19:03:33.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.357+0000 7fdb92e11640 1 --2- 172.21.15.53:0/1877774509 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdb78066280 0x7fdb78068730 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:33.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.357+0000 7fdb92e11640 1 --2- 172.21.15.53:0/1877774509 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb8c157e10 0x7fdb8c0c20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:33.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.357+0000 7fdb92e11640 1 --2- 172.21.15.53:0/1877774509 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb8c0afe30 0x7fdb8c0c1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:33.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.357+0000 7fdb92e11640 1 --2- 172.21.15.53:0/1877774509 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb8c06bb30 0x7fdb8c0c0e10 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:33.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.357+0000 7fdb92e11640 1 -- 172.21.15.53:0/1877774509 >> 172.21.15.53:0/1877774509 conn(0x7fdb8c06a0d0 msgr2=0x7fdb8c156600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:33.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.357+0000 7fdb92e11640 1 -- 172.21.15.53:0/1877774509 shutdown_connections 2023-06-10T19:03:33.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.357+0000 7fdb92e11640 1 -- 172.21.15.53:0/1877774509 wait complete. 2023-06-10T19:03:33.380 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-10T18:52:33.633114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-10T18:52:39.171487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-10T19:02:00.325404+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '93', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2023-06-10T19:02:01.620938+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '94', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-10T19:03:33.381 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-10T19:03:33.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.505+0000 7fcc57594640 1 Processor -- start 2023-06-10T19:03:33.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.505+0000 7fcc57594640 1 -- start start 2023-06-10T19:03:33.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.505+0000 7fcc57594640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fcc500b0b90 0x7fcc500b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:33.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.505+0000 7fcc57594640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc500cc7c0 con 0x7fcc5015c090 2023-06-10T19:03:33.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.505+0000 7fcc57594640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc500ccaa0 con 0x7fcc500b7e30 2023-06-10T19:03:33.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.505+0000 7fcc57594640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc500ccd80 con 0x7fcc500b0b90 2023-06-10T19:03:33.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.505+0000 7fcc55330640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fcc5015c090 0x7fcc500b7720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56360/0 (socket says 172.21.15.53:56360) 2023-06-10T19:03:33.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.505+0000 7fcc55330640 1 -- 172.21.15.53:0/1438298279 learned_addr learned my addr 172.21.15.53:0/1438298279 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:03:33.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.505+0000 7fcc43fff640 1 -- 172.21.15.53:0/1438298279 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2639096412 0 0) 0x7fcc500cc7c0 con 0x7fcc5015c090 2023-06-10T19:03:33.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.505+0000 7fcc43fff640 1 -- 172.21.15.53:0/1438298279 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc3c003530 con 0x7fcc5015c090 2023-06-10T19:03:33.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.505+0000 7fcc55b31640 1 --2- 172.21.15.53:0/1438298279 >> v2:172.21.15.117:3300/0 conn(0x7fcc500b0b90 0x7fcc500b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:33.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.509+0000 7fcc43fff640 1 -- 172.21.15.53:0/1438298279 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2606286302 0 0) 0x7fcc3c003530 con 0x7fcc5015c090 2023-06-10T19:03:33.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.509+0000 7fcc43fff640 1 -- 172.21.15.53:0/1438298279 >> v2:172.21.15.117:3300/0 conn(0x7fcc500b0b90 msgr2=0x7fcc500b10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:33.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.509+0000 7fcc43fff640 1 --2- 172.21.15.53:0/1438298279 >> v2:172.21.15.117:3300/0 conn(0x7fcc500b0b90 0x7fcc500b10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:33.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.509+0000 7fcc43fff640 1 -- 172.21.15.53:0/1438298279 >> v1:172.21.15.117:6789/0 conn(0x7fcc500b7e30 legacy=0x7fcc500d04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:33.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.509+0000 7fcc43fff640 1 -- 172.21.15.53:0/1438298279 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc500cd060 con 0x7fcc5015c090 2023-06-10T19:03:33.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.509+0000 7fcc43fff640 1 -- 172.21.15.53:0/1438298279 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fcc44001680 con 0x7fcc5015c090 2023-06-10T19:03:33.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.509+0000 7fcc43fff640 1 -- 172.21.15.53:0/1438298279 >> v1:172.21.15.53:6789/0 conn(0x7fcc5015c090 legacy=0x7fcc500b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:33.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.509+0000 7fcc43fff640 1 --2- 172.21.15.53:0/1438298279 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcc3c003980 0x7fcc3c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:33.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.509+0000 7fcc43fff640 1 --2- 172.21.15.53:0/1438298279 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc3c0047d0 0x7fcc3c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:33.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.509+0000 7fcc43fff640 1 --2- 172.21.15.53:0/1438298279 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcc3c0052a0 0x7fcc3c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:33.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.509+0000 7fcc43fff640 1 -- 172.21.15.53:0/1438298279 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc500ccd80 con 0x7fcc3c0047d0 2023-06-10T19:03:33.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.509+0000 7fcc43fff640 1 -- 172.21.15.53:0/1438298279 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3c00c160 con 0x7fcc3c003980 2023-06-10T19:03:33.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.509+0000 7fcc43fff640 1 -- 172.21.15.53:0/1438298279 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3c00c320 con 0x7fcc3c0052a0 2023-06-10T19:03:33.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.509+0000 7fcc54b2f640 1 --2- 172.21.15.53:0/1438298279 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc3c0047d0 0x7fcc3c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:33.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.509+0000 7fcc55330640 1 --2- 172.21.15.53:0/1438298279 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcc3c003980 0x7fcc3c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:33.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.509+0000 7fcc55b31640 1 --2- 172.21.15.53:0/1438298279 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcc3c0052a0 0x7fcc3c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:33.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.509+0000 7fcc54b2f640 1 -- 172.21.15.53:0/1438298279 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcc3c0052a0 msgr2=0x7fcc3c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:33.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.509+0000 7fcc54b2f640 1 --2- 172.21.15.53:0/1438298279 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcc3c0052a0 0x7fcc3c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:33.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.509+0000 7fcc54b2f640 1 -- 172.21.15.53:0/1438298279 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcc3c003980 msgr2=0x7fcc3c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:33.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.509+0000 7fcc54b2f640 1 --2- 172.21.15.53:0/1438298279 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcc3c003980 0x7fcc3c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:33.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.509+0000 7fcc54b2f640 1 -- 172.21.15.53:0/1438298279 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc3c003530 con 0x7fcc3c0047d0 2023-06-10T19:03:33.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.509+0000 7fcc55b31640 1 -- 172.21.15.53:0/1438298279 reap_dead start 2023-06-10T19:03:33.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.509+0000 7fcc54b2f640 1 --2- 172.21.15.53:0/1438298279 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc3c0047d0 0x7fcc3c004c40 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c001780 tx=0x7fcc4c01c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fe8d3fafdc76bff server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:33.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.509+0000 7fcc43fff640 1 -- 172.21.15.53:0/1438298279 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc4c0052d0 con 0x7fcc3c0047d0 2023-06-10T19:03:33.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.509+0000 7fcc43fff640 1 -- 172.21.15.53:0/1438298279 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc4c0a7050 con 0x7fcc3c0047d0 2023-06-10T19:03:33.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.509+0000 7fcc43fff640 1 -- 172.21.15.53:0/1438298279 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc4c003600 con 0x7fcc3c0047d0 2023-06-10T19:03:33.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.509+0000 7fcc57594640 1 -- 172.21.15.53:0/1438298279 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc3c0047d0 msgr2=0x7fcc3c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:33.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.509+0000 7fcc57594640 1 --2- 172.21.15.53:0/1438298279 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc3c0047d0 0x7fcc3c004c40 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c001780 tx=0x7fcc4c01c3b0 comp rx=0 tx=0).stop 2023-06-10T19:03:33.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.509+0000 7fcc57594640 1 -- 172.21.15.53:0/1438298279 shutdown_connections 2023-06-10T19:03:33.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.509+0000 7fcc57594640 1 --2- 172.21.15.53:0/1438298279 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc3c0047d0 0x7fcc3c004c40 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:33.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.509+0000 7fcc57594640 1 -- 172.21.15.53:0/1438298279 >> 172.21.15.53:0/1438298279 conn(0x7fcc50069e20 msgr2=0x7fcc5006a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:33.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.509+0000 7fcc57594640 1 -- 172.21.15.53:0/1438298279 shutdown_connections 2023-06-10T19:03:33.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.509+0000 7fcc57594640 1 -- 172.21.15.53:0/1438298279 wait complete. 2023-06-10T19:03:33.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.513+0000 7fcc57594640 1 Processor -- start 2023-06-10T19:03:33.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.513+0000 7fcc57594640 1 -- start start 2023-06-10T19:03:33.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.513+0000 7fcc57594640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcc3c0047d0 0x7fcc5014e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:33.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.513+0000 7fcc57594640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc50153440 0x7fcc500c81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:33.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.513+0000 7fcc57594640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcc500c8710 0x7fcc500c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:33.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.513+0000 7fcc57594640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc500cabc0 con 0x7fcc50153440 2023-06-10T19:03:33.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.513+0000 7fcc57594640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc500c9bb0 con 0x7fcc500c8710 2023-06-10T19:03:33.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.513+0000 7fcc57594640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc500c9e00 con 0x7fcc3c0047d0 2023-06-10T19:03:33.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.513+0000 7fcc54b2f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc50153440 0x7fcc500c81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:33.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.513+0000 7fcc54b2f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc50153440 0x7fcc500c81d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59892/0 (socket says 172.21.15.53:59892) 2023-06-10T19:03:33.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.513+0000 7fcc54b2f640 1 -- 172.21.15.53:0/2617280233 learned_addr learned my addr 172.21.15.53:0/2617280233 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:33.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.513+0000 7fcc55b31640 1 --2- 172.21.15.53:0/2617280233 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcc500c8710 0x7fcc500c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:33.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.513+0000 7fcc55330640 1 --2- 172.21.15.53:0/2617280233 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcc3c0047d0 0x7fcc5014e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:33.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.513+0000 7fcc54b2f640 1 -- 172.21.15.53:0/2617280233 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcc3c0047d0 msgr2=0x7fcc5014e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:33.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.513+0000 7fcc54b2f640 1 --2- 172.21.15.53:0/2617280233 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcc3c0047d0 0x7fcc5014e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:33.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.513+0000 7fcc54b2f640 1 -- 172.21.15.53:0/2617280233 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcc500c8710 msgr2=0x7fcc500c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:33.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.513+0000 7fcc54b2f640 1 --2- 172.21.15.53:0/2617280233 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcc500c8710 0x7fcc500c5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:33.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.513+0000 7fcc54b2f640 1 -- 172.21.15.53:0/2617280233 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc500ca0e0 con 0x7fcc50153440 2023-06-10T19:03:33.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.513+0000 7fcc54b2f640 1 --2- 172.21.15.53:0/2617280233 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc50153440 0x7fcc500c81d0 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c005040 tx=0x7fcc3c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:33.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.513+0000 7fcc41ffb640 1 -- 172.21.15.53:0/2617280233 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc4c0071c0 con 0x7fcc50153440 2023-06-10T19:03:33.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.513+0000 7fcc41ffb640 1 -- 172.21.15.53:0/2617280233 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc4c007320 con 0x7fcc50153440 2023-06-10T19:03:33.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.513+0000 7fcc57594640 1 -- 172.21.15.53:0/2617280233 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc500ca3c0 con 0x7fcc50153440 2023-06-10T19:03:33.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.513+0000 7fcc41ffb640 1 -- 172.21.15.53:0/2617280233 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc4c007690 con 0x7fcc50153440 2023-06-10T19:03:33.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.513+0000 7fcc57594640 1 -- 172.21.15.53:0/2617280233 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc5014e7c0 con 0x7fcc50153440 2023-06-10T19:03:33.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.513+0000 7fcc57594640 1 -- 172.21.15.53:0/2617280233 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc5014e9b0 con 0x7fcc50153440 2023-06-10T19:03:33.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.517+0000 7fcc41ffb640 1 -- 172.21.15.53:0/2617280233 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcc4c0067e0 con 0x7fcc50153440 2023-06-10T19:03:33.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.517+0000 7fcc41ffb640 1 --2- 172.21.15.53:0/2617280233 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcc34066280 0x7fcc34068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:33.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.517+0000 7fcc41ffb640 1 -- 172.21.15.53:0/2617280233 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6307+0+0 (secure 0 0 0) 0x7fcc4c0a4e40 con 0x7fcc50153440 2023-06-10T19:03:33.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.517+0000 7fcc55330640 1 --2- 172.21.15.53:0/2617280233 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcc34066280 0x7fcc34068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:33.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.517+0000 7fcc55330640 1 --2- 172.21.15.53:0/2617280233 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcc34066280 0x7fcc34068730 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fcc44005a40 tx=0x7fcc44009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:33.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.521+0000 7fcc41ffb640 1 -- 172.21.15.53:0/2617280233 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcc4c0ef0a0 con 0x7fcc50153440 2023-06-10T19:03:33.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.673+0000 7fcc57594640 1 -- 172.21.15.53:0/2617280233 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcc500d2cb0 con 0x7fcc50153440 2023-06-10T19:03:33.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.673+0000 7fcc41ffb640 1 -- 172.21.15.53:0/2617280233 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v98) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcc4c0eec30 con 0x7fcc50153440 2023-06-10T19:03:33.679 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-06-10T19:03:33.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.677+0000 7fcc57594640 1 -- 172.21.15.53:0/2617280233 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcc34066280 msgr2=0x7fcc34068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:33.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.677+0000 7fcc57594640 1 --2- 172.21.15.53:0/2617280233 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcc34066280 0x7fcc34068730 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fcc44005a40 tx=0x7fcc44009040 comp rx=0 tx=0).stop 2023-06-10T19:03:33.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.677+0000 7fcc57594640 1 -- 172.21.15.53:0/2617280233 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc50153440 msgr2=0x7fcc500c81d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:33.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.677+0000 7fcc57594640 1 --2- 172.21.15.53:0/2617280233 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc50153440 0x7fcc500c81d0 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c005040 tx=0x7fcc3c005800 comp rx=0 tx=0).stop 2023-06-10T19:03:33.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.677+0000 7fcc57594640 1 -- 172.21.15.53:0/2617280233 shutdown_connections 2023-06-10T19:03:33.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.677+0000 7fcc57594640 1 --2- 172.21.15.53:0/2617280233 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcc34066280 0x7fcc34068730 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:33.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.677+0000 7fcc57594640 1 --2- 172.21.15.53:0/2617280233 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcc500c8710 0x7fcc500c5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:33.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.677+0000 7fcc57594640 1 --2- 172.21.15.53:0/2617280233 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc50153440 0x7fcc500c81d0 unknown :-1 s=CLOSED pgs=1632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:33.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.677+0000 7fcc57594640 1 --2- 172.21.15.53:0/2617280233 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcc3c0047d0 0x7fcc5014e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:33.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.677+0000 7fcc57594640 1 -- 172.21.15.53:0/2617280233 >> 172.21.15.53:0/2617280233 conn(0x7fcc50069e20 msgr2=0x7fcc500b4360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:33.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.677+0000 7fcc57594640 1 -- 172.21.15.53:0/2617280233 shutdown_connections 2023-06-10T19:03:33.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.677+0000 7fcc57594640 1 -- 172.21.15.53:0/2617280233 wait complete. 2023-06-10T19:03:33.698 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-10T19:03:33.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.821+0000 7f48edb04640 1 Processor -- start 2023-06-10T19:03:33.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.821+0000 7f48edb04640 1 -- start start 2023-06-10T19:03:33.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.825+0000 7f48edb04640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48e81558e0 0x7f48e80c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:33.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.825+0000 7f48edb04640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f48e8158f40 0x7f48e80cb820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:33.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.825+0000 7f48edb04640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48e806c230 con 0x7f48e80cbd60 2023-06-10T19:03:33.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.825+0000 7f48edb04640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48e806ca40 con 0x7f48e8158f40 2023-06-10T19:03:33.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.825+0000 7f48edb04640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48e8155cb0 con 0x7f48e81558e0 2023-06-10T19:03:33.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.825+0000 7f48dffff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f48e8158f40 0x7f48e80cb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:33.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.825+0000 7f48dffff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f48e8158f40 0x7f48e80cb820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59904/0 (socket says 172.21.15.53:59904) 2023-06-10T19:03:33.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.825+0000 7f48dffff640 1 -- 172.21.15.53:0/3556064214 learned_addr learned my addr 172.21.15.53:0/3556064214 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:33.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.825+0000 7f48e77fe640 1 --2- 172.21.15.53:0/3556064214 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48e81558e0 0x7f48e80c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:33.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.825+0000 7f48dffff640 1 -- 172.21.15.53:0/3556064214 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48e81558e0 msgr2=0x7f48e80c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:33.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.825+0000 7f48dffff640 1 --2- 172.21.15.53:0/3556064214 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48e81558e0 0x7f48e80c82a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:33.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.825+0000 7f48dffff640 1 -- 172.21.15.53:0/3556064214 >> v1:172.21.15.117:6789/0 conn(0x7f48e80cbd60 legacy=0x7f48e806b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:33.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.825+0000 7f48dffff640 1 -- 172.21.15.53:0/3556064214 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48e806c480 con 0x7f48e8158f40 2023-06-10T19:03:33.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.825+0000 7f48dffff640 1 --2- 172.21.15.53:0/3556064214 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48e8158f40 0x7f48e80cb820 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7f48d000bb10 tx=0x7f48d001ea80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=381034607f8097b server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:33.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.825+0000 7f48e6ffd640 1 -- 172.21.15.53:0/3556064214 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d00a7a90 con 0x7f48e8158f40 2023-06-10T19:03:33.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.829+0000 7f48e6ffd640 1 -- 172.21.15.53:0/3556064214 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d00a7bf0 con 0x7f48e8158f40 2023-06-10T19:03:33.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.829+0000 7f48e6ffd640 1 -- 172.21.15.53:0/3556064214 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d00af440 con 0x7f48e8158f40 2023-06-10T19:03:33.832 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.829+0000 7f48edb04640 1 -- 172.21.15.53:0/3556064214 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48e8158f40 msgr2=0x7f48e80cb820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:33.832 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.829+0000 7f48edb04640 1 --2- 172.21.15.53:0/3556064214 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48e8158f40 0x7f48e80cb820 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7f48d000bb10 tx=0x7f48d001ea80 comp rx=0 tx=0).stop 2023-06-10T19:03:33.832 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.829+0000 7f48edb04640 1 -- 172.21.15.53:0/3556064214 shutdown_connections 2023-06-10T19:03:33.832 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.829+0000 7f48edb04640 1 --2- 172.21.15.53:0/3556064214 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48e8158f40 0x7f48e80cb820 unknown :-1 s=CLOSED pgs=1633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:33.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.829+0000 7f48edb04640 1 --2- 172.21.15.53:0/3556064214 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48e81558e0 0x7f48e80c82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:33.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.829+0000 7f48edb04640 1 -- 172.21.15.53:0/3556064214 >> 172.21.15.53:0/3556064214 conn(0x7f48e806a0e0 msgr2=0x7f48e80cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:33.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.829+0000 7f48edb04640 1 -- 172.21.15.53:0/3556064214 shutdown_connections 2023-06-10T19:03:33.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.829+0000 7f48edb04640 1 -- 172.21.15.53:0/3556064214 wait complete. 2023-06-10T19:03:33.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.829+0000 7f48edb04640 1 Processor -- start 2023-06-10T19:03:33.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.829+0000 7f48edb04640 1 -- start start 2023-06-10T19:03:33.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.829+0000 7f48edb04640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48e80cbd60 0x7f48e80bdb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:33.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.829+0000 7f48edb04640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48e81558e0 0x7f48e814d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:33.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.829+0000 7f48edb04640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48e8158f40 0x7f48e814b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:33.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.829+0000 7f48edb04640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e814e310 con 0x7f48e81558e0 2023-06-10T19:03:33.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.829+0000 7f48edb04640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e806eff0 con 0x7f48e8158f40 2023-06-10T19:03:33.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.829+0000 7f48edb04640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48e806f2d0 con 0x7f48e80cbd60 2023-06-10T19:03:33.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.829+0000 7f48dffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48e81558e0 0x7f48e814d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:33.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.829+0000 7f48dffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48e81558e0 0x7f48e814d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59916/0 (socket says 172.21.15.53:59916) 2023-06-10T19:03:33.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.829+0000 7f48dffff640 1 -- 172.21.15.53:0/4029667894 learned_addr learned my addr 172.21.15.53:0/4029667894 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:33.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.829+0000 7f48e77fe640 1 --2- 172.21.15.53:0/4029667894 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48e80cbd60 0x7f48e80bdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:33.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.829+0000 7f48e7fff640 1 --2- 172.21.15.53:0/4029667894 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48e8158f40 0x7f48e814b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:33.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.829+0000 7f48dffff640 1 -- 172.21.15.53:0/4029667894 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48e80cbd60 msgr2=0x7f48e80bdb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:33.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.829+0000 7f48dffff640 1 --2- 172.21.15.53:0/4029667894 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48e80cbd60 0x7f48e80bdb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:33.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.829+0000 7f48dffff640 1 -- 172.21.15.53:0/4029667894 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48e8158f40 msgr2=0x7f48e814b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:33.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.829+0000 7f48dffff640 1 --2- 172.21.15.53:0/4029667894 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48e8158f40 0x7f48e814b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:33.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.829+0000 7f48dffff640 1 -- 172.21.15.53:0/4029667894 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48d000b770 con 0x7f48e81558e0 2023-06-10T19:03:33.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.829+0000 7f48e7fff640 1 --2- 172.21.15.53:0/4029667894 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48e8158f40 0x7f48e814b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:03:33.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.829+0000 7f48dffff640 1 --2- 172.21.15.53:0/4029667894 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48e81558e0 0x7f48e814d950 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f48d000b2c0 tx=0x7f48d001b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:33.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.829+0000 7f48e4ff9640 1 -- 172.21.15.53:0/4029667894 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d00ba640 con 0x7f48e81558e0 2023-06-10T19:03:33.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.829+0000 7f48e4ff9640 1 -- 172.21.15.53:0/4029667894 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d00ba7c0 con 0x7f48e81558e0 2023-06-10T19:03:33.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.829+0000 7f48e4ff9640 1 -- 172.21.15.53:0/4029667894 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d00bab70 con 0x7f48e81558e0 2023-06-10T19:03:33.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.829+0000 7f48edb04640 1 -- 172.21.15.53:0/4029667894 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48e806f5b0 con 0x7f48e81558e0 2023-06-10T19:03:33.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.833+0000 7f48edb04640 1 -- 172.21.15.53:0/4029667894 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48e80be3c0 con 0x7f48e81558e0 2023-06-10T19:03:33.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.833+0000 7f48edb04640 1 -- 172.21.15.53:0/4029667894 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48e804d790 con 0x7f48e81558e0 2023-06-10T19:03:33.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.833+0000 7f48e4ff9640 1 -- 172.21.15.53:0/4029667894 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f48d00b6040 con 0x7f48e81558e0 2023-06-10T19:03:33.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.833+0000 7f48e4ff9640 1 --2- 172.21.15.53:0/4029667894 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f48c8066280 0x7f48c8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:33.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.833+0000 7f48e4ff9640 1 -- 172.21.15.53:0/4029667894 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f48d0121810 con 0x7f48e81558e0 2023-06-10T19:03:33.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.833+0000 7f48e77fe640 1 --2- 172.21.15.53:0/4029667894 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f48c8066280 0x7f48c8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:33.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.833+0000 7f48e77fe640 1 --2- 172.21.15.53:0/4029667894 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f48c8066280 0x7f48c8068730 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f48d800a8d0 tx=0x7f48d8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:33.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.837+0000 7f48e4ff9640 1 -- 172.21.15.53:0/4029667894 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f48d00eee20 con 0x7f48e81558e0 2023-06-10T19:03:33.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.989+0000 7f48edb04640 1 -- 172.21.15.53:0/4029667894 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f48e806fa60 con 0x7f48e81558e0 2023-06-10T19:03:33.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.989+0000 7f48e4ff9640 1 -- 172.21.15.53:0/4029667894 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v98) v1 ==== 92+0+10 (secure 0 0 0) 0x7f48d00f2440 con 0x7f48e81558e0 2023-06-10T19:03:33.993 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-06-10T19:03:33.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.989+0000 7f48edb04640 1 -- 172.21.15.53:0/4029667894 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f48c8066280 msgr2=0x7f48c8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:33.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.989+0000 7f48edb04640 1 --2- 172.21.15.53:0/4029667894 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f48c8066280 0x7f48c8068730 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f48d800a8d0 tx=0x7f48d8008040 comp rx=0 tx=0).stop 2023-06-10T19:03:33.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.989+0000 7f48edb04640 1 -- 172.21.15.53:0/4029667894 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48e81558e0 msgr2=0x7f48e814d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:33.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.989+0000 7f48edb04640 1 --2- 172.21.15.53:0/4029667894 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48e81558e0 0x7f48e814d950 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f48d000b2c0 tx=0x7f48d001b820 comp rx=0 tx=0).stop 2023-06-10T19:03:33.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.989+0000 7f48edb04640 1 -- 172.21.15.53:0/4029667894 shutdown_connections 2023-06-10T19:03:33.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.989+0000 7f48edb04640 1 --2- 172.21.15.53:0/4029667894 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f48c8066280 0x7f48c8068730 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:33.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.989+0000 7f48edb04640 1 --2- 172.21.15.53:0/4029667894 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48e8158f40 0x7f48e814b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:33.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.993+0000 7f48edb04640 1 --2- 172.21.15.53:0/4029667894 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48e81558e0 0x7f48e814d950 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:33.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.993+0000 7f48edb04640 1 --2- 172.21.15.53:0/4029667894 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48e80cbd60 0x7f48e80bdb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:33.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.993+0000 7f48edb04640 1 -- 172.21.15.53:0/4029667894 >> 172.21.15.53:0/4029667894 conn(0x7f48e806a0e0 msgr2=0x7f48e814f560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:33.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.993+0000 7f48edb04640 1 -- 172.21.15.53:0/4029667894 shutdown_connections 2023-06-10T19:03:33.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:33.993+0000 7f48edb04640 1 -- 172.21.15.53:0/4029667894 wait complete. 2023-06-10T19:03:34.012 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-10T19:03:34.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.129+0000 7fb5abc1b640 1 Processor -- start 2023-06-10T19:03:34.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.129+0000 7fb5abc1b640 1 -- start start 2023-06-10T19:03:34.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.129+0000 7fb5abc1b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb5a4159630 0x7fb5a415d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:34.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.129+0000 7fb5abc1b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5a40ad730 0x7fb5a40713a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:34.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.129+0000 7fb5abc1b640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5a4070f10 con 0x7fb5a40718e0 2023-06-10T19:03:34.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.129+0000 7fb5abc1b640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5a415db60 con 0x7fb5a4159630 2023-06-10T19:03:34.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.129+0000 7fb5abc1b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a415de40 con 0x7fb5a40ad730 2023-06-10T19:03:34.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.129+0000 7fb5a99b7640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb5a4159630 0x7fb5a415d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:34.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.129+0000 7fb5a91b6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5a40ad730 0x7fb5a40713a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:34.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.129+0000 7fb5a91b6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5a40ad730 0x7fb5a40713a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.53:33460/0 (socket says 172.21.15.53:33460) 2023-06-10T19:03:34.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.129+0000 7fb5a99b7640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb5a4159630 0x7fb5a415d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.53:43904/0 (socket says 172.21.15.53:43904) 2023-06-10T19:03:34.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.129+0000 7fb5a91b6640 1 -- 172.21.15.53:0/261735998 learned_addr learned my addr 172.21.15.53:0/261735998 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:34.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.129+0000 7fb5a99b7640 1 -- 172.21.15.53:0/261735998 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5a40ad730 msgr2=0x7fb5a40713a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:34.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.129+0000 7fb5a99b7640 1 --2- 172.21.15.53:0/261735998 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5a40ad730 0x7fb5a40713a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:34.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.129+0000 7fb5a99b7640 1 -- 172.21.15.53:0/261735998 >> v1:172.21.15.117:6789/0 conn(0x7fb5a40718e0 legacy=0x7fb5a4069450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:34.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.129+0000 7fb5a99b7640 1 -- 172.21.15.53:0/261735998 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5a415e120 con 0x7fb5a4159630 2023-06-10T19:03:34.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.133+0000 7fb5a99b7640 1 --2- 172.21.15.53:0/261735998 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5a4159630 0x7fb5a415d260 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fb59c009d90 tx=0x7fb59c01c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57f2f90541ab2ce7 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:34.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.133+0000 7fb5a89b5640 1 -- 172.21.15.53:0/261735998 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb59c0a58f0 con 0x7fb5a4159630 2023-06-10T19:03:34.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.133+0000 7fb5a89b5640 1 -- 172.21.15.53:0/261735998 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb59c0a5a50 con 0x7fb5a4159630 2023-06-10T19:03:34.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.133+0000 7fb5a89b5640 1 -- 172.21.15.53:0/261735998 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb59c0a5de0 con 0x7fb5a4159630 2023-06-10T19:03:34.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.133+0000 7fb5abc1b640 1 -- 172.21.15.53:0/261735998 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5a4159630 msgr2=0x7fb5a415d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:34.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.133+0000 7fb5abc1b640 1 --2- 172.21.15.53:0/261735998 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5a4159630 0x7fb5a415d260 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fb59c009d90 tx=0x7fb59c01c920 comp rx=0 tx=0).stop 2023-06-10T19:03:34.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.133+0000 7fb5abc1b640 1 -- 172.21.15.53:0/261735998 shutdown_connections 2023-06-10T19:03:34.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.133+0000 7fb5abc1b640 1 --2- 172.21.15.53:0/261735998 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5a40ad730 0x7fb5a40713a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:34.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.133+0000 7fb5abc1b640 1 --2- 172.21.15.53:0/261735998 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5a4159630 0x7fb5a415d260 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:34.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.133+0000 7fb5abc1b640 1 -- 172.21.15.53:0/261735998 >> 172.21.15.53:0/261735998 conn(0x7fb5a40cafc0 msgr2=0x7fb5a40cb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:34.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.133+0000 7fb5abc1b640 1 -- 172.21.15.53:0/261735998 shutdown_connections 2023-06-10T19:03:34.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.133+0000 7fb5abc1b640 1 -- 172.21.15.53:0/261735998 wait complete. 2023-06-10T19:03:34.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.137+0000 7fb5abc1b640 1 Processor -- start 2023-06-10T19:03:34.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.137+0000 7fb5abc1b640 1 -- start start 2023-06-10T19:03:34.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.137+0000 7fb5abc1b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5a40718e0 0x7fb5a415ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:34.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.137+0000 7fb5abc1b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5a40ad730 0x7fb5a41509f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:34.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.137+0000 7fb5abc1b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5a4159630 0x7fb5a415bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:34.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.137+0000 7fb5abc1b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a41536f0 con 0x7fb5a4159630 2023-06-10T19:03:34.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.137+0000 7fb5abc1b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a41539d0 con 0x7fb5a40ad730 2023-06-10T19:03:34.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.137+0000 7fb5abc1b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a4153cb0 con 0x7fb5a40718e0 2023-06-10T19:03:34.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.137+0000 7fb5aa1b8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5a4159630 0x7fb5a415bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:34.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.137+0000 7fb5aa1b8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5a4159630 0x7fb5a415bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59918/0 (socket says 172.21.15.53:59918) 2023-06-10T19:03:34.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.137+0000 7fb5aa1b8640 1 -- 172.21.15.53:0/2788251277 learned_addr learned my addr 172.21.15.53:0/2788251277 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:34.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.137+0000 7fb5a91b6640 1 --2- 172.21.15.53:0/2788251277 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5a40ad730 0x7fb5a41509f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:34.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.137+0000 7fb5a99b7640 1 --2- 172.21.15.53:0/2788251277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5a40718e0 0x7fb5a415ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:34.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.137+0000 7fb5aa1b8640 1 -- 172.21.15.53:0/2788251277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5a40718e0 msgr2=0x7fb5a415ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:34.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.137+0000 7fb5aa1b8640 1 --2- 172.21.15.53:0/2788251277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5a40718e0 0x7fb5a415ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:34.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.137+0000 7fb5aa1b8640 1 -- 172.21.15.53:0/2788251277 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5a40ad730 msgr2=0x7fb5a41509f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:34.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.137+0000 7fb5aa1b8640 1 --2- 172.21.15.53:0/2788251277 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5a40ad730 0x7fb5a41509f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:34.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.137+0000 7fb5aa1b8640 1 -- 172.21.15.53:0/2788251277 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb59c009a70 con 0x7fb5a4159630 2023-06-10T19:03:34.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.137+0000 7fb5a91b6640 1 --2- 172.21.15.53:0/2788251277 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5a40ad730 0x7fb5a41509f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:03:34.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.137+0000 7fb5aa1b8640 1 --2- 172.21.15.53:0/2788251277 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5a4159630 0x7fb5a415bcf0 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7fb5a000c430 tx=0x7fb5a000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:34.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.137+0000 7fb5967fc640 1 -- 172.21.15.53:0/2788251277 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a0005220 con 0x7fb5a4159630 2023-06-10T19:03:34.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.137+0000 7fb5967fc640 1 -- 172.21.15.53:0/2788251277 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5a0005380 con 0x7fb5a4159630 2023-06-10T19:03:34.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.137+0000 7fb5abc1b640 1 -- 172.21.15.53:0/2788251277 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5a4153f90 con 0x7fb5a4159630 2023-06-10T19:03:34.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.137+0000 7fb5967fc640 1 -- 172.21.15.53:0/2788251277 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a0007270 con 0x7fb5a4159630 2023-06-10T19:03:34.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.137+0000 7fb5abc1b640 1 -- 172.21.15.53:0/2788251277 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5a4150f30 con 0x7fb5a4159630 2023-06-10T19:03:34.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.137+0000 7fb5abc1b640 1 -- 172.21.15.53:0/2788251277 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5a40cbd00 con 0x7fb5a4159630 2023-06-10T19:03:34.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.137+0000 7fb5967fc640 1 -- 172.21.15.53:0/2788251277 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb5a00073d0 con 0x7fb5a4159630 2023-06-10T19:03:34.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.141+0000 7fb5967fc640 1 --2- 172.21.15.53:0/2788251277 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb588066280 0x7fb588068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:34.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.141+0000 7fb5967fc640 1 -- 172.21.15.53:0/2788251277 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6307+0+0 (secure 0 0 0) 0x7fb5a00833a0 con 0x7fb5a4159630 2023-06-10T19:03:34.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.141+0000 7fb5a99b7640 1 --2- 172.21.15.53:0/2788251277 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb588066280 0x7fb588068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:34.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.141+0000 7fb5a99b7640 1 --2- 172.21.15.53:0/2788251277 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb588066280 0x7fb588068730 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fb59c0af000 tx=0x7fb59c0a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:34.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.145+0000 7fb5967fc640 1 -- 172.21.15.53:0/2788251277 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb5a0050790 con 0x7fb5a4159630 2023-06-10T19:03:34.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.297+0000 7fb5abc1b640 1 -- 172.21.15.53:0/2788251277 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb5a41f2480 con 0x7fb5a4159630 2023-06-10T19:03:34.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.297+0000 7fb5967fc640 1 -- 172.21.15.53:0/2788251277 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v98) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb5a41f2480 con 0x7fb5a4159630 2023-06-10T19:03:34.302 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-06-10T19:03:34.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.301+0000 7fb5abc1b640 1 -- 172.21.15.53:0/2788251277 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb588066280 msgr2=0x7fb588068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:34.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.301+0000 7fb5abc1b640 1 --2- 172.21.15.53:0/2788251277 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb588066280 0x7fb588068730 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fb59c0af000 tx=0x7fb59c0a7070 comp rx=0 tx=0).stop 2023-06-10T19:03:34.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.301+0000 7fb5abc1b640 1 -- 172.21.15.53:0/2788251277 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5a4159630 msgr2=0x7fb5a415bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:34.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.301+0000 7fb5abc1b640 1 --2- 172.21.15.53:0/2788251277 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5a4159630 0x7fb5a415bcf0 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7fb5a000c430 tx=0x7fb5a000c8f0 comp rx=0 tx=0).stop 2023-06-10T19:03:34.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.301+0000 7fb5abc1b640 1 -- 172.21.15.53:0/2788251277 shutdown_connections 2023-06-10T19:03:34.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.301+0000 7fb5abc1b640 1 --2- 172.21.15.53:0/2788251277 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb588066280 0x7fb588068730 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:34.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.301+0000 7fb5abc1b640 1 --2- 172.21.15.53:0/2788251277 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5a4159630 0x7fb5a415bcf0 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:34.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.301+0000 7fb5abc1b640 1 --2- 172.21.15.53:0/2788251277 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5a40ad730 0x7fb5a41509f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:34.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.301+0000 7fb5abc1b640 1 --2- 172.21.15.53:0/2788251277 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5a40718e0 0x7fb5a415ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:34.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.301+0000 7fb5abc1b640 1 -- 172.21.15.53:0/2788251277 >> 172.21.15.53:0/2788251277 conn(0x7fb5a40cafc0 msgr2=0x7fb5a4069450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:34.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.301+0000 7fb5abc1b640 1 -- 172.21.15.53:0/2788251277 shutdown_connections 2023-06-10T19:03:34.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.301+0000 7fb5abc1b640 1 -- 172.21.15.53:0/2788251277 wait complete. 2023-06-10T19:03:34.321 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-10T19:03:34.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.449+0000 7fbb90b3b640 1 Processor -- start 2023-06-10T19:03:34.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.449+0000 7fbb90b3b640 1 -- start start 2023-06-10T19:03:34.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.449+0000 7fbb90b3b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbb8c156180 0x7fbb8c0cd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:34.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.449+0000 7fbb90b3b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbb8c15c4c0 0x7fbb8c159190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:34.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.449+0000 7fbb90b3b640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb8c06b090 con 0x7fbb8c15c070 2023-06-10T19:03:34.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.449+0000 7fbb90b3b640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb8c06efa0 con 0x7fbb8c15c4c0 2023-06-10T19:03:34.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.449+0000 7fbb90b3b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8c0cc720 con 0x7fbb8c156180 2023-06-10T19:03:34.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.449+0000 7fbb8a59c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbb8c156180 0x7fbb8c0cd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:34.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.449+0000 7fbb8ad9d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbb8c15c4c0 0x7fbb8c159190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:34.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.449+0000 7fbb8a59c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbb8c156180 0x7fbb8c0cd4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.53:33476/0 (socket says 172.21.15.53:33476) 2023-06-10T19:03:34.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.449+0000 7fbb83fff640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fbb8c15c070 0x7fbb8c158a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.53:35980/0 (socket says 172.21.15.53:35980) 2023-06-10T19:03:34.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.449+0000 7fbb8ad9d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbb8c15c4c0 0x7fbb8c159190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.53:43918/0 (socket says 172.21.15.53:43918) 2023-06-10T19:03:34.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.449+0000 7fbb8a59c640 1 -- 172.21.15.53:0/3834216701 learned_addr learned my addr 172.21.15.53:0/3834216701 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:34.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.449+0000 7fbb8ad9d640 1 -- 172.21.15.53:0/3834216701 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbb8c156180 msgr2=0x7fbb8c0cd4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:34.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.449+0000 7fbb8ad9d640 1 --2- 172.21.15.53:0/3834216701 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbb8c156180 0x7fbb8c0cd4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:34.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.449+0000 7fbb8ad9d640 1 -- 172.21.15.53:0/3834216701 >> v1:172.21.15.117:6789/0 conn(0x7fbb8c15c070 legacy=0x7fbb8c158a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:34.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.449+0000 7fbb8ad9d640 1 -- 172.21.15.53:0/3834216701 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb8c0cc9a0 con 0x7fbb8c15c4c0 2023-06-10T19:03:34.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.449+0000 7fbb8a59c640 1 --2- 172.21.15.53:0/3834216701 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbb8c156180 0x7fbb8c0cd4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-10T19:03:34.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.453+0000 7fbb8ad9d640 1 --2- 172.21.15.53:0/3834216701 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb8c15c4c0 0x7fbb8c159190 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fbb84009d90 tx=0x7fbb8401c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1931f6c9d9f64cb server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:34.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.453+0000 7fbb89d9b640 1 -- 172.21.15.53:0/3834216701 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb840a5800 con 0x7fbb8c15c4c0 2023-06-10T19:03:34.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.453+0000 7fbb89d9b640 1 -- 172.21.15.53:0/3834216701 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb840a5960 con 0x7fbb8c15c4c0 2023-06-10T19:03:34.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.453+0000 7fbb89d9b640 1 -- 172.21.15.53:0/3834216701 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb840a5cf0 con 0x7fbb8c15c4c0 2023-06-10T19:03:34.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.453+0000 7fbb90b3b640 1 -- 172.21.15.53:0/3834216701 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb8c15c4c0 msgr2=0x7fbb8c159190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:34.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.453+0000 7fbb90b3b640 1 --2- 172.21.15.53:0/3834216701 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb8c15c4c0 0x7fbb8c159190 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fbb84009d90 tx=0x7fbb8401c950 comp rx=0 tx=0).stop 2023-06-10T19:03:34.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.453+0000 7fbb90b3b640 1 -- 172.21.15.53:0/3834216701 shutdown_connections 2023-06-10T19:03:34.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.453+0000 7fbb90b3b640 1 --2- 172.21.15.53:0/3834216701 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb8c15c4c0 0x7fbb8c159190 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:34.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.453+0000 7fbb90b3b640 1 --2- 172.21.15.53:0/3834216701 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbb8c156180 0x7fbb8c0cd4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:34.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.453+0000 7fbb90b3b640 1 -- 172.21.15.53:0/3834216701 >> 172.21.15.53:0/3834216701 conn(0x7fbb8c06a0e0 msgr2=0x7fbb8c0cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:34.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.453+0000 7fbb90b3b640 1 -- 172.21.15.53:0/3834216701 shutdown_connections 2023-06-10T19:03:34.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.453+0000 7fbb90b3b640 1 -- 172.21.15.53:0/3834216701 wait complete. 2023-06-10T19:03:34.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.453+0000 7fbb90b3b640 1 Processor -- start 2023-06-10T19:03:34.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.453+0000 7fbb90b3b640 1 -- start start 2023-06-10T19:03:34.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.453+0000 7fbb90b3b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbb8c156180 0x7fbb8c150ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:34.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.453+0000 7fbb90b3b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb8c15c070 0x7fbb8c1f7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:34.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.453+0000 7fbb90b3b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb8c15c4c0 0x7fbb8c1f81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:34.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.453+0000 7fbb90b3b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8c152110 con 0x7fbb8c15c070 2023-06-10T19:03:34.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.453+0000 7fbb90b3b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8c15ad70 con 0x7fbb8c15c4c0 2023-06-10T19:03:34.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.453+0000 7fbb90b3b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8c15b050 con 0x7fbb8c156180 2023-06-10T19:03:34.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.457+0000 7fbb83fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb8c15c070 0x7fbb8c1f7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:34.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.457+0000 7fbb83fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb8c15c070 0x7fbb8c1f7c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59932/0 (socket says 172.21.15.53:59932) 2023-06-10T19:03:34.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.457+0000 7fbb83fff640 1 -- 172.21.15.53:0/3655577858 learned_addr learned my addr 172.21.15.53:0/3655577858 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:34.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.457+0000 7fbb8a59c640 1 --2- 172.21.15.53:0/3655577858 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbb8c156180 0x7fbb8c150ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:34.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.457+0000 7fbb8ad9d640 1 --2- 172.21.15.53:0/3655577858 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb8c15c4c0 0x7fbb8c1f81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:34.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.457+0000 7fbb83fff640 1 -- 172.21.15.53:0/3655577858 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbb8c156180 msgr2=0x7fbb8c150ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:34.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.457+0000 7fbb83fff640 1 --2- 172.21.15.53:0/3655577858 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbb8c156180 0x7fbb8c150ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:34.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.457+0000 7fbb83fff640 1 -- 172.21.15.53:0/3655577858 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb8c15c4c0 msgr2=0x7fbb8c1f81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:34.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.457+0000 7fbb83fff640 1 --2- 172.21.15.53:0/3655577858 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb8c15c4c0 0x7fbb8c1f81b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:34.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.457+0000 7fbb83fff640 1 -- 172.21.15.53:0/3655577858 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb7c00b770 con 0x7fbb8c15c070 2023-06-10T19:03:34.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.457+0000 7fbb8a59c640 1 --2- 172.21.15.53:0/3655577858 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbb8c156180 0x7fbb8c150ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:03:34.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.457+0000 7fbb83fff640 1 --2- 172.21.15.53:0/3655577858 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb8c15c070 0x7fbb8c1f7c70 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7fbb7400c420 tx=0x7fbb7400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:34.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.457+0000 7fbb82ffd640 1 -- 172.21.15.53:0/3655577858 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb740074e0 con 0x7fbb8c15c070 2023-06-10T19:03:34.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.457+0000 7fbb82ffd640 1 -- 172.21.15.53:0/3655577858 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb74007640 con 0x7fbb8c15c070 2023-06-10T19:03:34.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.457+0000 7fbb82ffd640 1 -- 172.21.15.53:0/3655577858 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb74004a30 con 0x7fbb8c15c070 2023-06-10T19:03:34.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.457+0000 7fbb90b3b640 1 -- 172.21.15.53:0/3655577858 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb84009a70 con 0x7fbb8c15c070 2023-06-10T19:03:34.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.457+0000 7fbb90b3b640 1 -- 172.21.15.53:0/3655577858 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb8c15b610 con 0x7fbb8c15c070 2023-06-10T19:03:34.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.457+0000 7fbb90b3b640 1 -- 172.21.15.53:0/3655577858 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb8c15bb30 con 0x7fbb8c15c070 2023-06-10T19:03:34.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.457+0000 7fbb82ffd640 1 -- 172.21.15.53:0/3655577858 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbb74004b90 con 0x7fbb8c15c070 2023-06-10T19:03:34.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.457+0000 7fbb82ffd640 1 --2- 172.21.15.53:0/3655577858 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbb6c066280 0x7fbb6c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:34.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.457+0000 7fbb82ffd640 1 -- 172.21.15.53:0/3655577858 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6307+0+0 (secure 0 0 0) 0x7fbb74083880 con 0x7fbb8c15c070 2023-06-10T19:03:34.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.457+0000 7fbb8a59c640 1 --2- 172.21.15.53:0/3655577858 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbb6c066280 0x7fbb6c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:34.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.461+0000 7fbb8a59c640 1 --2- 172.21.15.53:0/3655577858 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbb6c066280 0x7fbb6c068730 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c00beb0 tx=0x7fbb7c00b450 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:34.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.461+0000 7fbb82ffd640 1 -- 172.21.15.53:0/3655577858 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbb8c15bb30 con 0x7fbb8c15c070 2023-06-10T19:03:34.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.617+0000 7fbb90b3b640 1 -- 172.21.15.53:0/3655577858 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbb8c15bb30 con 0x7fbb8c15c070 2023-06-10T19:03:34.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.617+0000 7fbb82ffd640 1 -- 172.21.15.53:0/3655577858 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v98) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbb8c15bb30 con 0x7fbb8c15c070 2023-06-10T19:03:34.620 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-06-10T19:03:34.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.617+0000 7fbb90b3b640 1 -- 172.21.15.53:0/3655577858 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbb6c066280 msgr2=0x7fbb6c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:34.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.617+0000 7fbb90b3b640 1 --2- 172.21.15.53:0/3655577858 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbb6c066280 0x7fbb6c068730 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c00beb0 tx=0x7fbb7c00b450 comp rx=0 tx=0).stop 2023-06-10T19:03:34.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.617+0000 7fbb90b3b640 1 -- 172.21.15.53:0/3655577858 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb8c15c070 msgr2=0x7fbb8c1f7c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:34.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.617+0000 7fbb90b3b640 1 --2- 172.21.15.53:0/3655577858 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb8c15c070 0x7fbb8c1f7c70 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7fbb7400c420 tx=0x7fbb7400c8e0 comp rx=0 tx=0).stop 2023-06-10T19:03:34.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.617+0000 7fbb90b3b640 1 -- 172.21.15.53:0/3655577858 shutdown_connections 2023-06-10T19:03:34.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.617+0000 7fbb90b3b640 1 --2- 172.21.15.53:0/3655577858 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbb6c066280 0x7fbb6c068730 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:34.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.617+0000 7fbb90b3b640 1 --2- 172.21.15.53:0/3655577858 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb8c15c4c0 0x7fbb8c1f81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:34.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.617+0000 7fbb90b3b640 1 --2- 172.21.15.53:0/3655577858 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb8c15c070 0x7fbb8c1f7c70 unknown :-1 s=CLOSED pgs=1636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:34.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.617+0000 7fbb90b3b640 1 --2- 172.21.15.53:0/3655577858 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbb8c156180 0x7fbb8c150ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:34.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.617+0000 7fbb90b3b640 1 -- 172.21.15.53:0/3655577858 >> 172.21.15.53:0/3655577858 conn(0x7fbb8c06a0e0 msgr2=0x7fbb8c158860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:34.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.617+0000 7fbb90b3b640 1 -- 172.21.15.53:0/3655577858 shutdown_connections 2023-06-10T19:03:34.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.617+0000 7fbb90b3b640 1 -- 172.21.15.53:0/3655577858 wait complete. 2023-06-10T19:03:34.639 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:03:34.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.757+0000 7f6b071da640 1 Processor -- start 2023-06-10T19:03:34.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.757+0000 7f6b071da640 1 -- start start 2023-06-10T19:03:34.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.761+0000 7f6b071da640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b000c9840 0x7f6b000c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:34.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.761+0000 7f6b071da640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b00159b50 con 0x7f6b0006b090 2023-06-10T19:03:34.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.761+0000 7f6b071da640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b000ca150 con 0x7f6b00071060 2023-06-10T19:03:34.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.761+0000 7f6b071da640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b000702a0 con 0x7f6b000c9840 2023-06-10T19:03:34.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.761+0000 7f6b05777640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f6b0006b090 0x7f6b0006b530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56370/0 (socket says 172.21.15.53:56370) 2023-06-10T19:03:34.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.761+0000 7f6b05777640 1 -- 172.21.15.53:0/2977443674 learned_addr learned my addr 172.21.15.53:0/2977443674 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:03:34.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.761+0000 7f6b04f76640 1 --2- 172.21.15.53:0/2977443674 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b000c9840 0x7f6b000c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:34.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.761+0000 7f6aff7fe640 1 -- 172.21.15.53:0/2977443674 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 602877539 0 0) 0x7f6b00159b50 con 0x7f6b0006b090 2023-06-10T19:03:34.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.761+0000 7f6aff7fe640 1 -- 172.21.15.53:0/2977443674 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6af0003530 con 0x7f6b0006b090 2023-06-10T19:03:34.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.761+0000 7f6aff7fe640 1 -- 172.21.15.53:0/2977443674 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3977023648 0 0) 0x7f6af0003530 con 0x7f6b0006b090 2023-06-10T19:03:34.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.761+0000 7f6aff7fe640 1 -- 172.21.15.53:0/2977443674 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b000c9840 msgr2=0x7f6b000c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:34.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.761+0000 7f6aff7fe640 1 --2- 172.21.15.53:0/2977443674 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b000c9840 0x7f6b000c9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:34.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.761+0000 7f6aff7fe640 1 -- 172.21.15.53:0/2977443674 >> v1:172.21.15.117:6789/0 conn(0x7f6b00071060 legacy=0x7f6b000af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:34.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.761+0000 7f6aff7fe640 1 -- 172.21.15.53:0/2977443674 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b00070580 con 0x7f6b0006b090 2023-06-10T19:03:34.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.761+0000 7f6aff7fe640 1 -- 172.21.15.53:0/2977443674 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f6af8001a00 con 0x7f6b0006b090 2023-06-10T19:03:34.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.761+0000 7f6aff7fe640 1 -- 172.21.15.53:0/2977443674 >> v1:172.21.15.53:6789/0 conn(0x7f6b0006b090 legacy=0x7f6b0006b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:34.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.761+0000 7f6aff7fe640 1 --2- 172.21.15.53:0/2977443674 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6af0003a20 0x7f6af0003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:34.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.761+0000 7f6aff7fe640 1 --2- 172.21.15.53:0/2977443674 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6af00047d0 0x7f6af0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:34.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.761+0000 7f6aff7fe640 1 --2- 172.21.15.53:0/2977443674 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b000c9840 0x7f6af0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:34.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.761+0000 7f6aff7fe640 1 -- 172.21.15.53:0/2977443674 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b000702a0 con 0x7f6af0003a20 2023-06-10T19:03:34.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.761+0000 7f6aff7fe640 1 -- 172.21.15.53:0/2977443674 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6af000ba70 con 0x7f6af00047d0 2023-06-10T19:03:34.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.761+0000 7f6aff7fe640 1 -- 172.21.15.53:0/2977443674 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6af000bc30 con 0x7f6b000c9840 2023-06-10T19:03:34.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.761+0000 7f6b04f76640 1 --2- 172.21.15.53:0/2977443674 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6af0003a20 0x7f6af0003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:34.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.761+0000 7f6afffff640 1 --2- 172.21.15.53:0/2977443674 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6af00047d0 0x7f6af0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:34.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.761+0000 7f6b05777640 1 --2- 172.21.15.53:0/2977443674 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b000c9840 0x7f6af0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:34.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.761+0000 7f6b04f76640 1 -- 172.21.15.53:0/2977443674 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b000c9840 msgr2=0x7f6af0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:34.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.761+0000 7f6b04f76640 1 --2- 172.21.15.53:0/2977443674 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b000c9840 0x7f6af0005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:34.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.761+0000 7f6b04f76640 1 -- 172.21.15.53:0/2977443674 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6af00047d0 msgr2=0x7f6af0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:34.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.761+0000 7f6b04f76640 1 --2- 172.21.15.53:0/2977443674 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6af00047d0 0x7f6af0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:34.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.761+0000 7f6b04f76640 1 -- 172.21.15.53:0/2977443674 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6af0003530 con 0x7f6af0003a20 2023-06-10T19:03:34.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.761+0000 7f6afffff640 1 --2- 172.21.15.53:0/2977443674 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6af00047d0 0x7f6af0004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:03:34.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.761+0000 7f6b04f76640 1 --2- 172.21.15.53:0/2977443674 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6af0003a20 0x7f6af0003e30 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f6af4009ae0 tx=0x7f6af401ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1bd39d4154ce660 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:34.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.761+0000 7f6aff7fe640 1 -- 172.21.15.53:0/2977443674 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af40a55f0 con 0x7f6af0003a20 2023-06-10T19:03:34.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.761+0000 7f6aff7fe640 1 -- 172.21.15.53:0/2977443674 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6af40a5750 con 0x7f6af0003a20 2023-06-10T19:03:34.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.761+0000 7f6aff7fe640 1 -- 172.21.15.53:0/2977443674 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af40a5b00 con 0x7f6af0003a20 2023-06-10T19:03:34.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.765+0000 7f6b071da640 1 -- 172.21.15.53:0/2977443674 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6af0003a20 msgr2=0x7f6af0003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:34.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.765+0000 7f6b071da640 1 --2- 172.21.15.53:0/2977443674 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6af0003a20 0x7f6af0003e30 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f6af4009ae0 tx=0x7f6af401ca20 comp rx=0 tx=0).stop 2023-06-10T19:03:34.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.765+0000 7f6b05777640 1 -- 172.21.15.53:0/2977443674 reap_dead start 2023-06-10T19:03:34.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.765+0000 7f6b071da640 1 -- 172.21.15.53:0/2977443674 shutdown_connections 2023-06-10T19:03:34.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.765+0000 7f6b071da640 1 -- 172.21.15.53:0/2977443674 >> 172.21.15.53:0/2977443674 conn(0x7f6b0006a0d0 msgr2=0x7f6b000ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:34.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.765+0000 7f6b071da640 1 -- 172.21.15.53:0/2977443674 shutdown_connections 2023-06-10T19:03:34.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.765+0000 7f6b071da640 1 -- 172.21.15.53:0/2977443674 wait complete. 2023-06-10T19:03:34.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.765+0000 7f6b071da640 1 Processor -- start 2023-06-10T19:03:34.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.765+0000 7f6b071da640 1 -- start start 2023-06-10T19:03:34.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.765+0000 7f6b071da640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b00148260 0x7f6b000b3380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:34.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.765+0000 7f6b071da640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b00148630 0x7f6b000c82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:34.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.765+0000 7f6b071da640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b00148b20 0x7f6b000c8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:34.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.765+0000 7f6b071da640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b000b2ac0 con 0x7f6b00148b20 2023-06-10T19:03:34.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.765+0000 7f6b071da640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b000b2f50 con 0x7f6b00148630 2023-06-10T19:03:34.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.765+0000 7f6b071da640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0014eac0 con 0x7f6b00148260 2023-06-10T19:03:34.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.765+0000 7f6b05777640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b00148b20 0x7f6b000c8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:34.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.765+0000 7f6b05777640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b00148b20 0x7f6b000c8810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59956/0 (socket says 172.21.15.53:59956) 2023-06-10T19:03:34.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.765+0000 7f6b05777640 1 -- 172.21.15.53:0/2837032534 learned_addr learned my addr 172.21.15.53:0/2837032534 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:34.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.765+0000 7f6b04f76640 1 --2- 172.21.15.53:0/2837032534 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b00148260 0x7f6b000b3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:34.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.765+0000 7f6afffff640 1 --2- 172.21.15.53:0/2837032534 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b00148630 0x7f6b000c82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:34.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.765+0000 7f6b05777640 1 -- 172.21.15.53:0/2837032534 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b00148260 msgr2=0x7f6b000b3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:34.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.765+0000 7f6b05777640 1 --2- 172.21.15.53:0/2837032534 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b00148260 0x7f6b000b3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:34.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.765+0000 7f6b05777640 1 -- 172.21.15.53:0/2837032534 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b00148630 msgr2=0x7f6b000c82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:34.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.765+0000 7f6b05777640 1 --2- 172.21.15.53:0/2837032534 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b00148630 0x7f6b000c82d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:34.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.765+0000 7f6b05777640 1 -- 172.21.15.53:0/2837032534 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b0014ed60 con 0x7f6b00148b20 2023-06-10T19:03:34.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.765+0000 7f6afffff640 1 --2- 172.21.15.53:0/2837032534 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b00148630 0x7f6b000c82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:03:34.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.765+0000 7f6b05777640 1 --2- 172.21.15.53:0/2837032534 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b00148b20 0x7f6b000c8810 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f6b000ad6d0 tx=0x7f6af800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:34.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.765+0000 7f6afd7fa640 1 -- 172.21.15.53:0/2837032534 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af8007440 con 0x7f6b00148b20 2023-06-10T19:03:34.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.765+0000 7f6afd7fa640 1 -- 172.21.15.53:0/2837032534 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6af80075e0 con 0x7f6b00148b20 2023-06-10T19:03:34.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.765+0000 7f6b071da640 1 -- 172.21.15.53:0/2837032534 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b000b2750 con 0x7f6b00148b20 2023-06-10T19:03:34.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.765+0000 7f6afd7fa640 1 -- 172.21.15.53:0/2837032534 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af8007990 con 0x7f6b00148b20 2023-06-10T19:03:34.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.765+0000 7f6b071da640 1 -- 172.21.15.53:0/2837032534 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b0014f040 con 0x7f6b00148b20 2023-06-10T19:03:34.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.769+0000 7f6b071da640 1 -- 172.21.15.53:0/2837032534 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b000b28e0 con 0x7f6b00148b20 2023-06-10T19:03:34.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.769+0000 7f6afd7fa640 1 -- 172.21.15.53:0/2837032534 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6af8014430 con 0x7f6b00148b20 2023-06-10T19:03:34.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.769+0000 7f6afd7fa640 1 --2- 172.21.15.53:0/2837032534 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6ae40662b0 0x7f6ae4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:34.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.769+0000 7f6afd7fa640 1 -- 172.21.15.53:0/2837032534 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f6af80838a0 con 0x7f6b00148b20 2023-06-10T19:03:34.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.769+0000 7f6b04f76640 1 --2- 172.21.15.53:0/2837032534 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6ae40662b0 0x7f6ae4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:34.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.769+0000 7f6b04f76640 1 --2- 172.21.15.53:0/2837032534 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6ae40662b0 0x7f6ae4068760 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f6af40af000 tx=0x7f6af4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:34.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.773+0000 7f6afd7fa640 1 -- 172.21.15.53:0/2837032534 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6af8050c20 con 0x7f6b00148b20 2023-06-10T19:03:34.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.961+0000 7f6b071da640 1 -- 172.21.15.53:0/2837032534 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6b0004d790 con 0x7f6b00148b20 2023-06-10T19:03:34.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.961+0000 7f6afd7fa640 1 -- 172.21.15.53:0/2837032534 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4681 (secure 0 0 0) 0x7f6af8054240 con 0x7f6b00148b20 2023-06-10T19:03:34.966 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:03:34.967 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":55,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1617157670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1617157670},{"type":"v1","addr":"172.21.15.117:6836","nonce":1617157670}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6113,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3414416090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":3414416090},{"type":"v1","addr":"172.21.15.117:6837","nonce":3414416090}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6718,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2533467097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2533467097},{"type":"v1","addr":"172.21.15.53:6835","nonce":2533467097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:02:02.642809+0000","modified":"2023-06-10T19:03:27.208582+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8127":{"gid":8127,"name":"a","rank":0,"incarnation":52,"state":"up:active","state_seq":17,"addr":"172.21.15.53:6833/2984379521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2984379521},{"type":"v1","addr":"172.21.15.53:6833","nonce":2984379521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-06-10T19:03:34.967 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 55 2023-06-10T19:03:34.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.965+0000 7f6b071da640 1 -- 172.21.15.53:0/2837032534 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6ae40662b0 msgr2=0x7f6ae4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:34.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.965+0000 7f6b071da640 1 --2- 172.21.15.53:0/2837032534 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6ae40662b0 0x7f6ae4068760 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f6af40af000 tx=0x7f6af4008040 comp rx=0 tx=0).stop 2023-06-10T19:03:34.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.965+0000 7f6b071da640 1 -- 172.21.15.53:0/2837032534 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b00148b20 msgr2=0x7f6b000c8810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:34.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.965+0000 7f6b071da640 1 --2- 172.21.15.53:0/2837032534 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b00148b20 0x7f6b000c8810 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f6b000ad6d0 tx=0x7f6af800dc10 comp rx=0 tx=0).stop 2023-06-10T19:03:34.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.965+0000 7f6b071da640 1 -- 172.21.15.53:0/2837032534 shutdown_connections 2023-06-10T19:03:34.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.965+0000 7f6b071da640 1 --2- 172.21.15.53:0/2837032534 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6ae40662b0 0x7f6ae4068760 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:34.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.965+0000 7f6b071da640 1 --2- 172.21.15.53:0/2837032534 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b00148b20 0x7f6b000c8810 unknown :-1 s=CLOSED pgs=1639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:34.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.965+0000 7f6b071da640 1 --2- 172.21.15.53:0/2837032534 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b00148630 0x7f6b000c82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:34.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.965+0000 7f6b071da640 1 --2- 172.21.15.53:0/2837032534 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b00148260 0x7f6b000b3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:34.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.965+0000 7f6b071da640 1 -- 172.21.15.53:0/2837032534 >> 172.21.15.53:0/2837032534 conn(0x7f6b0006a0d0 msgr2=0x7f6b0006b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:34.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.965+0000 7f6b071da640 1 -- 172.21.15.53:0/2837032534 shutdown_connections 2023-06-10T19:03:34.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:34.965+0000 7f6b071da640 1 -- 172.21.15.53:0/2837032534 wait complete. 2023-06-10T19:03:34.985 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:03:35.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.105+0000 7ff4b4fd5640 1 Processor -- start 2023-06-10T19:03:35.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.105+0000 7ff4b4fd5640 1 -- start start 2023-06-10T19:03:35.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.109+0000 7ff4b4fd5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4b0071060 0x7ff4b00af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:35.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.109+0000 7ff4b4fd5640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff4b00afc60 0x7ff4b006b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:35.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.109+0000 7ff4b4fd5640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4b0159b50 con 0x7ff4b00c9840 2023-06-10T19:03:35.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.109+0000 7ff4b4fd5640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4b00702a0 con 0x7ff4b00afc60 2023-06-10T19:03:35.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.109+0000 7ff4b4fd5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b0070580 con 0x7ff4b0071060 2023-06-10T19:03:35.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.109+0000 7ff4aed9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff4b00afc60 0x7ff4b006b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:35.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.109+0000 7ff4ae59c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ff4b00c9840 0x7ff4b00c9c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56376/0 (socket says 172.21.15.53:56376) 2023-06-10T19:03:35.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.109+0000 7ff4ae59c640 1 -- 172.21.15.53:0/3169895208 learned_addr learned my addr 172.21.15.53:0/3169895208 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:03:35.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.109+0000 7ff4aed9d640 1 -- 172.21.15.53:0/3169895208 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4b0071060 msgr2=0x7ff4b00af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:35.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.109+0000 7ff4add9b640 1 --2- 172.21.15.53:0/3169895208 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4b0071060 0x7ff4b00af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:35.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.109+0000 7ff4ad59a640 1 -- 172.21.15.53:0/3169895208 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2276077307 0 0) 0x7ff4b0159b50 con 0x7ff4b00c9840 2023-06-10T19:03:35.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.109+0000 7ff4aed9d640 1 --2- 172.21.15.53:0/3169895208 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4b0071060 0x7ff4b00af720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:35.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.109+0000 7ff4aed9d640 1 -- 172.21.15.53:0/3169895208 >> v1:172.21.15.53:6789/0 conn(0x7ff4b00c9840 legacy=0x7ff4b00c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:35.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.109+0000 7ff4aed9d640 1 -- 172.21.15.53:0/3169895208 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b0070860 con 0x7ff4b00afc60 2023-06-10T19:03:35.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.109+0000 7ff4aed9d640 1 --2- 172.21.15.53:0/3169895208 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4b00afc60 0x7ff4b006b090 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7ff4a80097c0 tx=0x7ff4a801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=417e0a8eedd74277 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:35.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.109+0000 7ff4ad59a640 1 -- 172.21.15.53:0/3169895208 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a80ab670 con 0x7ff4b00afc60 2023-06-10T19:03:35.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.109+0000 7ff4ad59a640 1 -- 172.21.15.53:0/3169895208 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4a80ab7d0 con 0x7ff4b00afc60 2023-06-10T19:03:35.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.109+0000 7ff4ad59a640 1 -- 172.21.15.53:0/3169895208 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a80abb60 con 0x7ff4b00afc60 2023-06-10T19:03:35.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.109+0000 7ff4b4fd5640 1 -- 172.21.15.53:0/3169895208 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4b00afc60 msgr2=0x7ff4b006b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:35.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.109+0000 7ff4b4fd5640 1 --2- 172.21.15.53:0/3169895208 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4b00afc60 0x7ff4b006b090 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7ff4a80097c0 tx=0x7ff4a801c450 comp rx=0 tx=0).stop 2023-06-10T19:03:35.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.109+0000 7ff4b4fd5640 1 -- 172.21.15.53:0/3169895208 shutdown_connections 2023-06-10T19:03:35.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.109+0000 7ff4b4fd5640 1 --2- 172.21.15.53:0/3169895208 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4b00afc60 0x7ff4b006b090 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:35.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.109+0000 7ff4b4fd5640 1 --2- 172.21.15.53:0/3169895208 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4b0071060 0x7ff4b00af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:35.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.109+0000 7ff4b4fd5640 1 -- 172.21.15.53:0/3169895208 >> 172.21.15.53:0/3169895208 conn(0x7ff4b006a0d0 msgr2=0x7ff4b00ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:35.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.109+0000 7ff4b4fd5640 1 -- 172.21.15.53:0/3169895208 shutdown_connections 2023-06-10T19:03:35.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.109+0000 7ff4b4fd5640 1 -- 172.21.15.53:0/3169895208 wait complete. 2023-06-10T19:03:35.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.113+0000 7ff4b4fd5640 1 Processor -- start 2023-06-10T19:03:35.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.113+0000 7ff4b4fd5640 1 -- start start 2023-06-10T19:03:35.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.113+0000 7ff4b4fd5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4b0071060 0x7ff4b00cb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:35.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.113+0000 7ff4b4fd5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4b00afc60 0x7ff4b00b0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:35.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.113+0000 7ff4b4fd5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4b00c9840 0x7ff4b00b1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:35.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.113+0000 7ff4b4fd5640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b00cbe90 con 0x7ff4b00afc60 2023-06-10T19:03:35.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.113+0000 7ff4b4fd5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b00cc170 con 0x7ff4b00c9840 2023-06-10T19:03:35.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.113+0000 7ff4b4fd5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b00cc450 con 0x7ff4b0071060 2023-06-10T19:03:35.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.113+0000 7ff4add9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4b00afc60 0x7ff4b00b0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:35.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.113+0000 7ff4add9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4b00afc60 0x7ff4b00b0ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59986/0 (socket says 172.21.15.53:59986) 2023-06-10T19:03:35.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.113+0000 7ff4add9b640 1 -- 172.21.15.53:0/878919201 learned_addr learned my addr 172.21.15.53:0/878919201 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:35.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.113+0000 7ff4aed9d640 1 --2- 172.21.15.53:0/878919201 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4b00c9840 0x7ff4b00b1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:35.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.113+0000 7ff4ae59c640 1 --2- 172.21.15.53:0/878919201 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4b0071060 0x7ff4b00cb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:35.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.113+0000 7ff4add9b640 1 -- 172.21.15.53:0/878919201 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4b0071060 msgr2=0x7ff4b00cb8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:35.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.113+0000 7ff4add9b640 1 --2- 172.21.15.53:0/878919201 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4b0071060 0x7ff4b00cb8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:35.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.113+0000 7ff4add9b640 1 -- 172.21.15.53:0/878919201 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4b00c9840 msgr2=0x7ff4b00b1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:35.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.113+0000 7ff4add9b640 1 --2- 172.21.15.53:0/878919201 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4b00c9840 0x7ff4b00b1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:35.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.113+0000 7ff4add9b640 1 -- 172.21.15.53:0/878919201 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4a8009420 con 0x7ff4b00afc60 2023-06-10T19:03:35.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.113+0000 7ff4add9b640 1 --2- 172.21.15.53:0/878919201 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4b00afc60 0x7ff4b00b0ef0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7ff4a000ce40 tx=0x7ff4a000a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:35.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.113+0000 7ff4a6ffd640 1 -- 172.21.15.53:0/878919201 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a0003ba0 con 0x7ff4b00afc60 2023-06-10T19:03:35.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.113+0000 7ff4a6ffd640 1 -- 172.21.15.53:0/878919201 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4a0003d00 con 0x7ff4b00afc60 2023-06-10T19:03:35.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.113+0000 7ff4b4fd5640 1 -- 172.21.15.53:0/878919201 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4b00cc730 con 0x7ff4b00afc60 2023-06-10T19:03:35.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.113+0000 7ff4a6ffd640 1 -- 172.21.15.53:0/878919201 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a0004260 con 0x7ff4b00afc60 2023-06-10T19:03:35.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.113+0000 7ff4b4fd5640 1 -- 172.21.15.53:0/878919201 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4b00c1510 con 0x7ff4b00afc60 2023-06-10T19:03:35.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.113+0000 7ff4b4fd5640 1 -- 172.21.15.53:0/878919201 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4b00ccc50 con 0x7ff4b00afc60 2023-06-10T19:03:35.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.117+0000 7ff4a6ffd640 1 -- 172.21.15.53:0/878919201 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff4a00043c0 con 0x7ff4b00afc60 2023-06-10T19:03:35.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.117+0000 7ff4a6ffd640 1 --2- 172.21.15.53:0/878919201 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff490066280 0x7ff490068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:35.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.117+0000 7ff4a6ffd640 1 -- 172.21.15.53:0/878919201 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6307+0+0 (secure 0 0 0) 0x7ff4a0012070 con 0x7ff4b00afc60 2023-06-10T19:03:35.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.117+0000 7ff4ae59c640 1 --2- 172.21.15.53:0/878919201 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff490066280 0x7ff490068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:35.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.117+0000 7ff4ae59c640 1 --2- 172.21.15.53:0/878919201 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff490066280 0x7ff490068730 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7ff498000f70 tx=0x7ff498007c10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:35.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.121+0000 7ff4a6ffd640 1 -- 172.21.15.53:0/878919201 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff4b00ccc50 con 0x7ff4b00afc60 2023-06-10T19:03:35.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.273+0000 7ff4b4fd5640 1 -- 172.21.15.53:0/878919201 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff4b00ccc50 con 0x7ff4b00afc60 2023-06-10T19:03:35.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.273+0000 7ff4a6ffd640 1 -- 172.21.15.53:0/878919201 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) v1 ==== 74+0+18665 (secure 0 0 0) 0x7ff4b00ccc50 con 0x7ff4b00afc60 2023-06-10T19:03:35.278 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:03:35.279 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":98,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:03:25.180996+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-06-10T19:02:00.325404+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-06-10T19:02:01.620938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.8","mappings":[{"from":1,"to":2}]},{"pgid":"14.17","mappings":[{"from":1,"to":7}]},{"pgid":"14.2d","mappings":[{"from":1,"to":7}]},{"pgid":"14.3a","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.0.1:0/3897417564":"2023-06-10T20:03:25.147615+0000","172.21.15.53:6833/1894654263":"2023-06-11T19:02:29.480972+0000","172.21.15.53:6832/1894654263":"2023-06-11T19:02:29.480972+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:03:35.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.277+0000 7ff4b4fd5640 1 -- 172.21.15.53:0/878919201 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff490066280 msgr2=0x7ff490068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:35.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.277+0000 7ff4b4fd5640 1 --2- 172.21.15.53:0/878919201 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff490066280 0x7ff490068730 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7ff498000f70 tx=0x7ff498007c10 comp rx=0 tx=0).stop 2023-06-10T19:03:35.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.277+0000 7ff4b4fd5640 1 -- 172.21.15.53:0/878919201 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4b00afc60 msgr2=0x7ff4b00b0ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:35.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.277+0000 7ff4b4fd5640 1 --2- 172.21.15.53:0/878919201 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4b00afc60 0x7ff4b00b0ef0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7ff4a000ce40 tx=0x7ff4a000a660 comp rx=0 tx=0).stop 2023-06-10T19:03:35.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.277+0000 7ff4b4fd5640 1 -- 172.21.15.53:0/878919201 shutdown_connections 2023-06-10T19:03:35.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.277+0000 7ff4b4fd5640 1 --2- 172.21.15.53:0/878919201 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff490066280 0x7ff490068730 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:35.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.277+0000 7ff4b4fd5640 1 --2- 172.21.15.53:0/878919201 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4b00c9840 0x7ff4b00b1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:35.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.277+0000 7ff4b4fd5640 1 --2- 172.21.15.53:0/878919201 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4b00afc60 0x7ff4b00b0ef0 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:35.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.277+0000 7ff4b4fd5640 1 --2- 172.21.15.53:0/878919201 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4b0071060 0x7ff4b00cb8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:35.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.277+0000 7ff4b4fd5640 1 -- 172.21.15.53:0/878919201 >> 172.21.15.53:0/878919201 conn(0x7ff4b006a0d0 msgr2=0x7ff4b0158d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:35.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.277+0000 7ff4b4fd5640 1 -- 172.21.15.53:0/878919201 shutdown_connections 2023-06-10T19:03:35.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.277+0000 7ff4b4fd5640 1 -- 172.21.15.53:0/878919201 wait complete. 2023-06-10T19:03:35.296 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-06-10T19:03:35.296 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:03:35.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.405+0000 7f99c88c4640 1 Processor -- start 2023-06-10T19:03:35.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.405+0000 7f99c88c4640 1 -- start start 2023-06-10T19:03:35.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.409+0000 7f99c88c4640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f99c406c400 0x7f99c4157fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:35.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.409+0000 7f99c88c4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99c406c7d0 0x7f99c4158520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:35.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.409+0000 7f99c88c4640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f99c40ccc90 0x7f99c40cd110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:35.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.409+0000 7f99c88c4640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99c415cee0 con 0x7f99c406c400 2023-06-10T19:03:35.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.409+0000 7f99c88c4640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99c4158a60 con 0x7f99c40ccc90 2023-06-10T19:03:35.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.409+0000 7f99c88c4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99c415c260 con 0x7f99c406c7d0 2023-06-10T19:03:35.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.409+0000 7f99c259c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f99c406c400 0x7f99c4157fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:35.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.409+0000 7f99c259c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f99c406c400 0x7f99c4157fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59992/0 (socket says 172.21.15.53:59992) 2023-06-10T19:03:35.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.409+0000 7f99c259c640 1 -- 172.21.15.53:0/2385420698 learned_addr learned my addr 172.21.15.53:0/2385420698 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:35.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.409+0000 7f99c2d9d640 1 --2- 172.21.15.53:0/2385420698 >> v2:172.21.15.117:3300/0 conn(0x7f99c40ccc90 0x7f99c40cd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:35.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.409+0000 7f99c1d9b640 1 --2- 172.21.15.53:0/2385420698 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99c406c7d0 0x7f99c4158520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:35.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.409+0000 7f99c259c640 1 -- 172.21.15.53:0/2385420698 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99c406c7d0 msgr2=0x7f99c4158520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:35.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.409+0000 7f99c259c640 1 --2- 172.21.15.53:0/2385420698 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99c406c7d0 0x7f99c4158520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:35.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.409+0000 7f99c259c640 1 -- 172.21.15.53:0/2385420698 >> v2:172.21.15.117:3300/0 conn(0x7f99c40ccc90 msgr2=0x7f99c40cd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:35.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.409+0000 7f99c259c640 1 --2- 172.21.15.53:0/2385420698 >> v2:172.21.15.117:3300/0 conn(0x7f99c40ccc90 0x7f99c40cd110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:35.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.409+0000 7f99c259c640 1 -- 172.21.15.53:0/2385420698 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99c415c540 con 0x7f99c406c400 2023-06-10T19:03:35.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.409+0000 7f99c2d9d640 1 --2- 172.21.15.53:0/2385420698 >> v2:172.21.15.117:3300/0 conn(0x7f99c40ccc90 0x7f99c40cd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:03:35.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.409+0000 7f99c259c640 1 --2- 172.21.15.53:0/2385420698 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99c406c400 0x7f99c4157fe0 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7f99c415c150 tx=0x7f99b401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24aeac457ca60584 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:35.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.409+0000 7f99c159a640 1 -- 172.21.15.53:0/2385420698 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b40ac640 con 0x7f99c406c400 2023-06-10T19:03:35.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.409+0000 7f99c159a640 1 -- 172.21.15.53:0/2385420698 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99b40ac7a0 con 0x7f99c406c400 2023-06-10T19:03:35.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.409+0000 7f99c159a640 1 -- 172.21.15.53:0/2385420698 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b40acb30 con 0x7f99c406c400 2023-06-10T19:03:35.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.409+0000 7f99c88c4640 1 -- 172.21.15.53:0/2385420698 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99c406c400 msgr2=0x7f99c4157fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:35.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.409+0000 7f99c88c4640 1 --2- 172.21.15.53:0/2385420698 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99c406c400 0x7f99c4157fe0 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7f99c415c150 tx=0x7f99b401c440 comp rx=0 tx=0).stop 2023-06-10T19:03:35.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.413+0000 7f99c88c4640 1 -- 172.21.15.53:0/2385420698 shutdown_connections 2023-06-10T19:03:35.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.413+0000 7f99c88c4640 1 --2- 172.21.15.53:0/2385420698 >> v2:172.21.15.117:3300/0 conn(0x7f99c40ccc90 0x7f99c40cd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:35.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.413+0000 7f99c88c4640 1 --2- 172.21.15.53:0/2385420698 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99c406c7d0 0x7f99c4158520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:35.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.413+0000 7f99c88c4640 1 --2- 172.21.15.53:0/2385420698 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99c406c400 0x7f99c4157fe0 unknown :-1 s=CLOSED pgs=1643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:35.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.413+0000 7f99c88c4640 1 -- 172.21.15.53:0/2385420698 >> 172.21.15.53:0/2385420698 conn(0x7f99c406a560 msgr2=0x7f99c406a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:35.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.413+0000 7f99c88c4640 1 -- 172.21.15.53:0/2385420698 shutdown_connections 2023-06-10T19:03:35.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.413+0000 7f99c88c4640 1 -- 172.21.15.53:0/2385420698 wait complete. 2023-06-10T19:03:35.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.413+0000 7f99c88c4640 1 Processor -- start 2023-06-10T19:03:35.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.413+0000 7f99c88c4640 1 -- start start 2023-06-10T19:03:35.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.413+0000 7f99c88c4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99c406c400 0x7f99c40c4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:35.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.413+0000 7f99c88c4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99c406c7d0 0x7f99c40c3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:35.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.413+0000 7f99c88c4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99c40ccc90 0x7f99c4157130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:35.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.413+0000 7f99c88c4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99c40c60a0 con 0x7f99c406c400 2023-06-10T19:03:35.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.413+0000 7f99c88c4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99c40b2c80 con 0x7f99c406c7d0 2023-06-10T19:03:35.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.413+0000 7f99c88c4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99c40b1be0 con 0x7f99c40ccc90 2023-06-10T19:03:35.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.413+0000 7f99c259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99c406c400 0x7f99c40c4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:35.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.413+0000 7f99c259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99c406c400 0x7f99c40c4630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60004/0 (socket says 172.21.15.53:60004) 2023-06-10T19:03:35.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.413+0000 7f99c259c640 1 -- 172.21.15.53:0/1179739732 learned_addr learned my addr 172.21.15.53:0/1179739732 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:35.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.413+0000 7f99c2d9d640 1 --2- 172.21.15.53:0/1179739732 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99c40ccc90 0x7f99c4157130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:35.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.413+0000 7f99c1d9b640 1 --2- 172.21.15.53:0/1179739732 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99c406c7d0 0x7f99c40c3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:35.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.413+0000 7f99c259c640 1 -- 172.21.15.53:0/1179739732 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99c40ccc90 msgr2=0x7f99c4157130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:35.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.413+0000 7f99c259c640 1 --2- 172.21.15.53:0/1179739732 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99c40ccc90 0x7f99c4157130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:35.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.413+0000 7f99c259c640 1 -- 172.21.15.53:0/1179739732 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99c406c7d0 msgr2=0x7f99c40c3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:35.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.413+0000 7f99c259c640 1 --2- 172.21.15.53:0/1179739732 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99c406c7d0 0x7f99c40c3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:35.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.413+0000 7f99c259c640 1 -- 172.21.15.53:0/1179739732 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b40094d0 con 0x7f99c406c400 2023-06-10T19:03:35.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.413+0000 7f99c2d9d640 1 --2- 172.21.15.53:0/1179739732 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99c40ccc90 0x7f99c4157130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:03:35.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.413+0000 7f99c259c640 1 --2- 172.21.15.53:0/1179739732 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99c406c400 0x7f99c40c4630 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7f99b40af040 tx=0x7f99b401ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:35.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.413+0000 7f99b2ffd640 1 -- 172.21.15.53:0/1179739732 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b40b7830 con 0x7f99c406c400 2023-06-10T19:03:35.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.413+0000 7f99b2ffd640 1 -- 172.21.15.53:0/1179739732 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99b40b7990 con 0x7f99c406c400 2023-06-10T19:03:35.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.413+0000 7f99c88c4640 1 -- 172.21.15.53:0/1179739732 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99c40b1ec0 con 0x7f99c406c400 2023-06-10T19:03:35.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.413+0000 7f99b2ffd640 1 -- 172.21.15.53:0/1179739732 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b40b7d20 con 0x7f99c406c400 2023-06-10T19:03:35.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.413+0000 7f99c88c4640 1 -- 172.21.15.53:0/1179739732 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99c40b2480 con 0x7f99c406c400 2023-06-10T19:03:35.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.417+0000 7f99c88c4640 1 -- 172.21.15.53:0/1179739732 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99c404d790 con 0x7f99c406c400 2023-06-10T19:03:35.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.417+0000 7f99b2ffd640 1 -- 172.21.15.53:0/1179739732 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f99b40b3040 con 0x7f99c406c400 2023-06-10T19:03:35.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.417+0000 7f99b2ffd640 1 --2- 172.21.15.53:0/1179739732 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f99a4066280 0x7f99a4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:35.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.417+0000 7f99b2ffd640 1 -- 172.21.15.53:0/1179739732 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f99b411e870 con 0x7f99c406c400 2023-06-10T19:03:35.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.417+0000 7f99c1d9b640 1 --2- 172.21.15.53:0/1179739732 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f99a4066280 0x7f99a4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:35.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.417+0000 7f99c1d9b640 1 --2- 172.21.15.53:0/1179739732 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f99a4066280 0x7f99a4068730 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f99c4143aa0 tx=0x7f99b8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:35.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.421+0000 7f99b2ffd640 1 -- 172.21.15.53:0/1179739732 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f99b40ebc80 con 0x7f99c406c400 2023-06-10T19:03:35.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.601+0000 7f99c88c4640 1 -- 172.21.15.53:0/1179739732 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f99c40b4d30 con 0x7f99c406c400 2023-06-10T19:03:35.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.601+0000 7f99b2ffd640 1 -- 172.21.15.53:0/1179739732 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4681 (secure 0 0 0) 0x7f99b40ef2a0 con 0x7f99c406c400 2023-06-10T19:03:35.605 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:03:35.605 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":55,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1617157670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1617157670},{"type":"v1","addr":"172.21.15.117:6836","nonce":1617157670}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6113,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3414416090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":3414416090},{"type":"v1","addr":"172.21.15.117:6837","nonce":3414416090}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6718,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2533467097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2533467097},{"type":"v1","addr":"172.21.15.53:6835","nonce":2533467097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:02:02.642809+0000","modified":"2023-06-10T19:03:27.208582+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8127":{"gid":8127,"name":"a","rank":0,"incarnation":52,"state":"up:active","state_seq":17,"addr":"172.21.15.53:6833/2984379521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2984379521},{"type":"v1","addr":"172.21.15.53:6833","nonce":2984379521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-06-10T19:03:35.606 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 55 2023-06-10T19:03:35.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.601+0000 7f99c88c4640 1 -- 172.21.15.53:0/1179739732 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f99a4066280 msgr2=0x7f99a4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:35.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.601+0000 7f99c88c4640 1 --2- 172.21.15.53:0/1179739732 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f99a4066280 0x7f99a4068730 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f99c4143aa0 tx=0x7f99b8008040 comp rx=0 tx=0).stop 2023-06-10T19:03:35.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.601+0000 7f99c88c4640 1 -- 172.21.15.53:0/1179739732 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99c406c400 msgr2=0x7f99c40c4630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:35.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.601+0000 7f99c88c4640 1 --2- 172.21.15.53:0/1179739732 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99c406c400 0x7f99c40c4630 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7f99b40af040 tx=0x7f99b401ac80 comp rx=0 tx=0).stop 2023-06-10T19:03:35.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.601+0000 7f99c88c4640 1 -- 172.21.15.53:0/1179739732 shutdown_connections 2023-06-10T19:03:35.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.601+0000 7f99c88c4640 1 --2- 172.21.15.53:0/1179739732 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f99a4066280 0x7f99a4068730 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:35.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.601+0000 7f99c88c4640 1 --2- 172.21.15.53:0/1179739732 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99c40ccc90 0x7f99c4157130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:35.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.601+0000 7f99c88c4640 1 --2- 172.21.15.53:0/1179739732 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99c406c7d0 0x7f99c40c3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:35.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.601+0000 7f99c88c4640 1 --2- 172.21.15.53:0/1179739732 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99c406c400 0x7f99c40c4630 unknown :-1 s=CLOSED pgs=1644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:35.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.601+0000 7f99c88c4640 1 -- 172.21.15.53:0/1179739732 >> 172.21.15.53:0/1179739732 conn(0x7f99c406a560 msgr2=0x7f99c40cb820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:35.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.601+0000 7f99c88c4640 1 -- 172.21.15.53:0/1179739732 shutdown_connections 2023-06-10T19:03:35.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.605+0000 7f99c88c4640 1 -- 172.21.15.53:0/1179739732 wait complete. 2023-06-10T19:03:35.622 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:03:35.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.741+0000 7f3924a61640 1 Processor -- start 2023-06-10T19:03:35.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.741+0000 7f3924a61640 1 -- start start 2023-06-10T19:03:35.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.741+0000 7f3924a61640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f392006b2f0 0x7f392006f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:35.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.741+0000 7f3924a61640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3920158a90 con 0x7f39200c8d00 2023-06-10T19:03:35.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.741+0000 7f3924a61640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39200705d0 con 0x7f3920160170 2023-06-10T19:03:35.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.741+0000 7f3924a61640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39200cce10 con 0x7f392006b2f0 2023-06-10T19:03:35.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.741+0000 7f391dd9b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f39200c8d00 0x7f392006b6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56382/0 (socket says 172.21.15.53:56382) 2023-06-10T19:03:35.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.741+0000 7f391dd9b640 1 -- 172.21.15.53:0/2463730341 learned_addr learned my addr 172.21.15.53:0/2463730341 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:03:35.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.741+0000 7f391e59c640 1 --2- 172.21.15.53:0/2463730341 >> v2:172.21.15.117:3300/0 conn(0x7f392006b2f0 0x7f392006f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:35.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.741+0000 7f391d59a640 1 -- 172.21.15.53:0/2463730341 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3775044103 0 0) 0x7f3914001120 con 0x7f39200c8d00 2023-06-10T19:03:35.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.741+0000 7f391d59a640 1 -- 172.21.15.53:0/2463730341 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3908003530 con 0x7f39200c8d00 2023-06-10T19:03:35.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.741+0000 7f391d59a640 1 -- 172.21.15.53:0/2463730341 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1932116110 0 0) 0x7f3908003530 con 0x7f39200c8d00 2023-06-10T19:03:35.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.741+0000 7f391d59a640 1 -- 172.21.15.53:0/2463730341 >> v2:172.21.15.117:3300/0 conn(0x7f392006b2f0 msgr2=0x7f392006f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:35.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.741+0000 7f391d59a640 1 --2- 172.21.15.53:0/2463730341 >> v2:172.21.15.117:3300/0 conn(0x7f392006b2f0 0x7f392006f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:35.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.741+0000 7f391d59a640 1 -- 172.21.15.53:0/2463730341 >> v1:172.21.15.117:6789/0 conn(0x7f3920160170 legacy=0x7f3920162550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:35.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.741+0000 7f391d59a640 1 -- 172.21.15.53:0/2463730341 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f392006f9c0 con 0x7f39200c8d00 2023-06-10T19:03:35.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.741+0000 7f391d59a640 1 -- 172.21.15.53:0/2463730341 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f3914001810 con 0x7f39200c8d00 2023-06-10T19:03:35.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.741+0000 7f391d59a640 1 -- 172.21.15.53:0/2463730341 >> v1:172.21.15.53:6789/0 conn(0x7f39200c8d00 legacy=0x7f392006b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:35.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.741+0000 7f391d59a640 1 --2- 172.21.15.53:0/2463730341 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f39080039f0 0x7f3908003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:35.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.741+0000 7f391d59a640 1 --2- 172.21.15.53:0/2463730341 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f39080047d0 0x7f3908004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:35.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.741+0000 7f391d59a640 1 --2- 172.21.15.53:0/2463730341 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3908005180 0x7f390800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:35.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.741+0000 7f391d59a640 1 -- 172.21.15.53:0/2463730341 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39200cce10 con 0x7f39080039f0 2023-06-10T19:03:35.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.741+0000 7f391d59a640 1 -- 172.21.15.53:0/2463730341 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f390800e280 con 0x7f3908005180 2023-06-10T19:03:35.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.741+0000 7f391d59a640 1 -- 172.21.15.53:0/2463730341 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f390800e440 con 0x7f39080047d0 2023-06-10T19:03:35.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.741+0000 7f391e59c640 1 --2- 172.21.15.53:0/2463730341 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f39080039f0 0x7f3908003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:35.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.741+0000 7f391dd9b640 1 --2- 172.21.15.53:0/2463730341 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f39080047d0 0x7f3908004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:35.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.741+0000 7f391ed9d640 1 --2- 172.21.15.53:0/2463730341 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3908005180 0x7f390800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:35.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.741+0000 7f391e59c640 1 -- 172.21.15.53:0/2463730341 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f39080047d0 msgr2=0x7f3908004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:35.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.741+0000 7f391e59c640 1 --2- 172.21.15.53:0/2463730341 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f39080047d0 0x7f3908004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:35.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.741+0000 7f391e59c640 1 -- 172.21.15.53:0/2463730341 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3908005180 msgr2=0x7f390800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:35.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.741+0000 7f391e59c640 1 --2- 172.21.15.53:0/2463730341 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3908005180 0x7f390800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:35.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.741+0000 7f391e59c640 1 -- 172.21.15.53:0/2463730341 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3908003530 con 0x7f39080039f0 2023-06-10T19:03:35.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.741+0000 7f391ed9d640 1 --2- 172.21.15.53:0/2463730341 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3908005180 0x7f390800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:03:35.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.741+0000 7f391ed9d640 1 -- 172.21.15.53:0/2463730341 reap_dead start 2023-06-10T19:03:35.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.745+0000 7f391e59c640 1 --2- 172.21.15.53:0/2463730341 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f39080039f0 0x7f3908003e00 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f3910009ae0 tx=0x7f391001ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e09d393361e10ca server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:35.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.745+0000 7f391d59a640 1 -- 172.21.15.53:0/2463730341 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39100a5640 con 0x7f39080039f0 2023-06-10T19:03:35.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.745+0000 7f391d59a640 1 -- 172.21.15.53:0/2463730341 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39100a57a0 con 0x7f39080039f0 2023-06-10T19:03:35.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.745+0000 7f391d59a640 1 -- 172.21.15.53:0/2463730341 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39100a5b50 con 0x7f39080039f0 2023-06-10T19:03:35.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.745+0000 7f3924a61640 1 -- 172.21.15.53:0/2463730341 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f39080039f0 msgr2=0x7f3908003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:35.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.745+0000 7f3924a61640 1 --2- 172.21.15.53:0/2463730341 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f39080039f0 0x7f3908003e00 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f3910009ae0 tx=0x7f391001ca50 comp rx=0 tx=0).stop 2023-06-10T19:03:35.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.745+0000 7f3924a61640 1 -- 172.21.15.53:0/2463730341 shutdown_connections 2023-06-10T19:03:35.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.745+0000 7f3924a61640 1 --2- 172.21.15.53:0/2463730341 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f39080039f0 0x7f3908003e00 unknown :-1 s=CLOSED pgs=1646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:35.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.745+0000 7f3924a61640 1 -- 172.21.15.53:0/2463730341 >> 172.21.15.53:0/2463730341 conn(0x7f392006a0d0 msgr2=0x7f39200ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:35.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.745+0000 7f3924a61640 1 -- 172.21.15.53:0/2463730341 shutdown_connections 2023-06-10T19:03:35.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.745+0000 7f3924a61640 1 -- 172.21.15.53:0/2463730341 wait complete. 2023-06-10T19:03:35.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.745+0000 7f3924a61640 1 Processor -- start 2023-06-10T19:03:35.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.745+0000 7f3924a61640 1 -- start start 2023-06-10T19:03:35.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.749+0000 7f3924a61640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f39080039f0 0x7f3920144090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:35.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.749+0000 7f3924a61640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f39200c1790 0x7f39201563c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:35.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.749+0000 7f3924a61640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39200c1c00 0x7f3920156900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:35.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.749+0000 7f3924a61640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3920152910 con 0x7f39080039f0 2023-06-10T19:03:35.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.749+0000 7f3924a61640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39200b1870 con 0x7f39200c1c00 2023-06-10T19:03:35.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.749+0000 7f3924a61640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39200b1b50 con 0x7f39200c1790 2023-06-10T19:03:35.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.749+0000 7f391e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f39080039f0 0x7f3920144090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:35.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.749+0000 7f391e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f39080039f0 0x7f3920144090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60018/0 (socket says 172.21.15.53:60018) 2023-06-10T19:03:35.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.749+0000 7f391e59c640 1 -- 172.21.15.53:0/1380127654 learned_addr learned my addr 172.21.15.53:0/1380127654 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:35.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.749+0000 7f391ed9d640 1 --2- 172.21.15.53:0/1380127654 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39200c1c00 0x7f3920156900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:35.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.749+0000 7f391dd9b640 1 --2- 172.21.15.53:0/1380127654 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f39200c1790 0x7f39201563c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:35.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.749+0000 7f391e59c640 1 -- 172.21.15.53:0/1380127654 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f39200c1790 msgr2=0x7f39201563c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:35.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.749+0000 7f391e59c640 1 --2- 172.21.15.53:0/1380127654 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f39200c1790 0x7f39201563c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:35.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.749+0000 7f391e59c640 1 -- 172.21.15.53:0/1380127654 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39200c1c00 msgr2=0x7f3920156900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:35.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.749+0000 7f391e59c640 1 --2- 172.21.15.53:0/1380127654 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39200c1c00 0x7f3920156900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:35.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.749+0000 7f391e59c640 1 -- 172.21.15.53:0/1380127654 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3920152530 con 0x7f39080039f0 2023-06-10T19:03:35.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.749+0000 7f391ed9d640 1 --2- 172.21.15.53:0/1380127654 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39200c1c00 0x7f3920156900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:03:35.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.749+0000 7f391e59c640 1 --2- 172.21.15.53:0/1380127654 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f39080039f0 0x7f3920144090 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f391001c880 tx=0x7f39100197f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:35.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.749+0000 7f390effd640 1 -- 172.21.15.53:0/1380127654 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3910004020 con 0x7f39080039f0 2023-06-10T19:03:35.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.749+0000 7f390effd640 1 -- 172.21.15.53:0/1380127654 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39100041a0 con 0x7f39080039f0 2023-06-10T19:03:35.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.749+0000 7f3924a61640 1 -- 172.21.15.53:0/1380127654 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39201445d0 con 0x7f39080039f0 2023-06-10T19:03:35.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.749+0000 7f390effd640 1 -- 172.21.15.53:0/1380127654 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3910003620 con 0x7f39080039f0 2023-06-10T19:03:35.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.749+0000 7f3924a61640 1 -- 172.21.15.53:0/1380127654 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3920152f00 con 0x7f39080039f0 2023-06-10T19:03:35.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.749+0000 7f3924a61640 1 -- 172.21.15.53:0/1380127654 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f392004d790 con 0x7f39080039f0 2023-06-10T19:03:35.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.749+0000 7f390effd640 1 -- 172.21.15.53:0/1380127654 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f39100b4070 con 0x7f39080039f0 2023-06-10T19:03:35.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.749+0000 7f390effd640 1 --2- 172.21.15.53:0/1380127654 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3900066280 0x7f3900068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:35.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.749+0000 7f390effd640 1 -- 172.21.15.53:0/1380127654 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6307+0+0 (secure 0 0 0) 0x7f391011e050 con 0x7f39080039f0 2023-06-10T19:03:35.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.749+0000 7f391dd9b640 1 --2- 172.21.15.53:0/1380127654 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3900066280 0x7f3900068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:35.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.753+0000 7f391dd9b640 1 --2- 172.21.15.53:0/1380127654 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3900066280 0x7f3900068730 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f3914001280 tx=0x7f39140012f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:35.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.753+0000 7f390effd640 1 -- 172.21.15.53:0/1380127654 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f39100eb510 con 0x7f39080039f0 2023-06-10T19:03:35.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.941+0000 7f3924a61640 1 -- 172.21.15.53:0/1380127654 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f39200b1d10 con 0x7f39080039f0 2023-06-10T19:03:35.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.941+0000 7f390effd640 1 -- 172.21.15.53:0/1380127654 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4681 (secure 0 0 0) 0x7f39100b2090 con 0x7f39080039f0 2023-06-10T19:03:35.948 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:03:35.948 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":55,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1617157670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1617157670},{"type":"v1","addr":"172.21.15.117:6836","nonce":1617157670}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6113,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3414416090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":3414416090},{"type":"v1","addr":"172.21.15.117:6837","nonce":3414416090}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6718,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2533467097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2533467097},{"type":"v1","addr":"172.21.15.53:6835","nonce":2533467097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:02:02.642809+0000","modified":"2023-06-10T19:03:27.208582+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8127":{"gid":8127,"name":"a","rank":0,"incarnation":52,"state":"up:active","state_seq":17,"addr":"172.21.15.53:6833/2984379521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2984379521},{"type":"v1","addr":"172.21.15.53:6833","nonce":2984379521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-06-10T19:03:35.949 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 55 2023-06-10T19:03:35.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.945+0000 7f3924a61640 1 -- 172.21.15.53:0/1380127654 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3900066280 msgr2=0x7f3900068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:35.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.945+0000 7f3924a61640 1 --2- 172.21.15.53:0/1380127654 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3900066280 0x7f3900068730 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f3914001280 tx=0x7f39140012f0 comp rx=0 tx=0).stop 2023-06-10T19:03:35.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.945+0000 7f3924a61640 1 -- 172.21.15.53:0/1380127654 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f39080039f0 msgr2=0x7f3920144090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:35.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.945+0000 7f3924a61640 1 --2- 172.21.15.53:0/1380127654 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f39080039f0 0x7f3920144090 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f391001c880 tx=0x7f39100197f0 comp rx=0 tx=0).stop 2023-06-10T19:03:35.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.945+0000 7f3924a61640 1 -- 172.21.15.53:0/1380127654 shutdown_connections 2023-06-10T19:03:35.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.945+0000 7f3924a61640 1 --2- 172.21.15.53:0/1380127654 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3900066280 0x7f3900068730 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:35.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.945+0000 7f3924a61640 1 --2- 172.21.15.53:0/1380127654 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39200c1c00 0x7f3920156900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:35.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.945+0000 7f3924a61640 1 --2- 172.21.15.53:0/1380127654 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f39200c1790 0x7f39201563c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:35.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.945+0000 7f3924a61640 1 --2- 172.21.15.53:0/1380127654 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f39080039f0 0x7f3920144090 unknown :-1 s=CLOSED pgs=1647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:35.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.945+0000 7f3924a61640 1 -- 172.21.15.53:0/1380127654 >> 172.21.15.53:0/1380127654 conn(0x7f392006a0d0 msgr2=0x7f39200ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:35.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.945+0000 7f3924a61640 1 -- 172.21.15.53:0/1380127654 shutdown_connections 2023-06-10T19:03:35.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:35.945+0000 7f3924a61640 1 -- 172.21.15.53:0/1380127654 wait complete. 2023-06-10T19:03:35.965 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:03:36.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.081+0000 7fc8bce6c640 1 Processor -- start 2023-06-10T19:03:36.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.081+0000 7fc8bce6c640 1 -- start start 2023-06-10T19:03:36.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.081+0000 7fc8bce6c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8b80ccae0 0x7fc8b80d0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:36.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.081+0000 7fc8bce6c640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8b80d0020 con 0x7fc8b80cc690 2023-06-10T19:03:36.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.081+0000 7fc8bce6c640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8b80cef40 con 0x7fc8b80b3ac0 2023-06-10T19:03:36.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.081+0000 7fc8bce6c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b80cf220 con 0x7fc8b80ccae0 2023-06-10T19:03:36.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.081+0000 7fc8b5d9b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fc8b80cc690 0x7fc8b80d04b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56386/0 (socket says 172.21.15.53:56386) 2023-06-10T19:03:36.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.081+0000 7fc8b5d9b640 1 -- 172.21.15.53:0/4029633578 learned_addr learned my addr 172.21.15.53:0/4029633578 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:03:36.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.081+0000 7fc8b6d9d640 1 --2- 172.21.15.53:0/4029633578 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8b80ccae0 0x7fc8b80d0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:36.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.081+0000 7fc8b559a640 1 -- 172.21.15.53:0/4029633578 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3636905237 0 0) 0x7fc8b80d0020 con 0x7fc8b80cc690 2023-06-10T19:03:36.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.081+0000 7fc8b559a640 1 -- 172.21.15.53:0/4029633578 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8a0003530 con 0x7fc8b80cc690 2023-06-10T19:03:36.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.081+0000 7fc8b559a640 1 -- 172.21.15.53:0/4029633578 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3471193202 0 0) 0x7fc8a0003530 con 0x7fc8b80cc690 2023-06-10T19:03:36.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.081+0000 7fc8b559a640 1 -- 172.21.15.53:0/4029633578 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8b80ccae0 msgr2=0x7fc8b80d0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:36.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.081+0000 7fc8b559a640 1 --2- 172.21.15.53:0/4029633578 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8b80ccae0 0x7fc8b80d0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:36.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.081+0000 7fc8b559a640 1 -- 172.21.15.53:0/4029633578 >> v1:172.21.15.117:6789/0 conn(0x7fc8b80b3ac0 legacy=0x7fc8b80b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:36.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.081+0000 7fc8b559a640 1 -- 172.21.15.53:0/4029633578 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8b80cf500 con 0x7fc8b80cc690 2023-06-10T19:03:36.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.081+0000 7fc8b559a640 1 -- 172.21.15.53:0/4029633578 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fc8ac001680 con 0x7fc8b80cc690 2023-06-10T19:03:36.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.081+0000 7fc8b559a640 1 -- 172.21.15.53:0/4029633578 >> v1:172.21.15.53:6789/0 conn(0x7fc8b80cc690 legacy=0x7fc8b80d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:36.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.081+0000 7fc8b559a640 1 --2- 172.21.15.53:0/4029633578 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8a0003a20 0x7fc8a0003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:36.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.081+0000 7fc8b559a640 1 --2- 172.21.15.53:0/4029633578 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8b80ccae0 0x7fc8a00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:36.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.081+0000 7fc8b559a640 1 --2- 172.21.15.53:0/4029633578 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8a0004d10 0x7fc8a0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:36.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.081+0000 7fc8b559a640 1 -- 172.21.15.53:0/4029633578 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b80cf220 con 0x7fc8a0004d10 2023-06-10T19:03:36.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.081+0000 7fc8b559a640 1 -- 172.21.15.53:0/4029633578 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a000baa0 con 0x7fc8a0003a20 2023-06-10T19:03:36.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.081+0000 7fc8b559a640 1 -- 172.21.15.53:0/4029633578 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a000bc60 con 0x7fc8b80ccae0 2023-06-10T19:03:36.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.081+0000 7fc8b6d9d640 1 --2- 172.21.15.53:0/4029633578 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8a0004d10 0x7fc8a0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:36.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.081+0000 7fc8b659c640 1 --2- 172.21.15.53:0/4029633578 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8a0003a20 0x7fc8a0003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:36.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.081+0000 7fc8b5d9b640 1 --2- 172.21.15.53:0/4029633578 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8b80ccae0 0x7fc8a00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:36.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.081+0000 7fc8b6d9d640 1 -- 172.21.15.53:0/4029633578 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8b80ccae0 msgr2=0x7fc8a00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:36.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.081+0000 7fc8b6d9d640 1 --2- 172.21.15.53:0/4029633578 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8b80ccae0 0x7fc8a00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:36.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.081+0000 7fc8b6d9d640 1 -- 172.21.15.53:0/4029633578 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8a0003a20 msgr2=0x7fc8a0003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:36.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.081+0000 7fc8b6d9d640 1 --2- 172.21.15.53:0/4029633578 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8a0003a20 0x7fc8a0003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:36.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.081+0000 7fc8b6d9d640 1 -- 172.21.15.53:0/4029633578 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8a0003530 con 0x7fc8a0004d10 2023-06-10T19:03:36.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.081+0000 7fc8b5d9b640 1 --2- 172.21.15.53:0/4029633578 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8b80ccae0 0x7fc8a00047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:03:36.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.085+0000 7fc8b6d9d640 1 --2- 172.21.15.53:0/4029633578 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8a0004d10 0x7fc8a0005180 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7fc8b0009fc0 tx=0x7fc8b001cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25bd047ba1ef2835 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:36.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.085+0000 7fc8b559a640 1 -- 172.21.15.53:0/4029633578 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b00a5c70 con 0x7fc8a0004d10 2023-06-10T19:03:36.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.085+0000 7fc8b559a640 1 -- 172.21.15.53:0/4029633578 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8b000f040 con 0x7fc8a0004d10 2023-06-10T19:03:36.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.085+0000 7fc8b559a640 1 -- 172.21.15.53:0/4029633578 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b00ad440 con 0x7fc8a0004d10 2023-06-10T19:03:36.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.085+0000 7fc8bce6c640 1 -- 172.21.15.53:0/4029633578 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8a0004d10 msgr2=0x7fc8a0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:36.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.085+0000 7fc8bce6c640 1 --2- 172.21.15.53:0/4029633578 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8a0004d10 0x7fc8a0005180 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7fc8b0009fc0 tx=0x7fc8b001cc60 comp rx=0 tx=0).stop 2023-06-10T19:03:36.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.085+0000 7fc8b6d9d640 1 -- 172.21.15.53:0/4029633578 reap_dead start 2023-06-10T19:03:36.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.085+0000 7fc8bce6c640 1 -- 172.21.15.53:0/4029633578 shutdown_connections 2023-06-10T19:03:36.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.085+0000 7fc8bce6c640 1 -- 172.21.15.53:0/4029633578 >> 172.21.15.53:0/4029633578 conn(0x7fc8b8071790 msgr2=0x7fc8b8069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:36.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.085+0000 7fc8bce6c640 1 -- 172.21.15.53:0/4029633578 shutdown_connections 2023-06-10T19:03:36.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.085+0000 7fc8bce6c640 1 -- 172.21.15.53:0/4029633578 wait complete. 2023-06-10T19:03:36.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.085+0000 7fc8bce6c640 1 Processor -- start 2023-06-10T19:03:36.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.085+0000 7fc8bce6c640 1 -- start start 2023-06-10T19:03:36.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.085+0000 7fc8bce6c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8a0004d10 0x7fc8b8158c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:36.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.085+0000 7fc8bce6c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8b80c9110 0x7fc8b80c9580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:36.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.085+0000 7fc8bce6c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8b815e2b0 0x7fc8b815e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:36.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.085+0000 7fc8bce6c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b815deb0 con 0x7fc8b815e2b0 2023-06-10T19:03:36.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.085+0000 7fc8bce6c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b815ec90 con 0x7fc8a0004d10 2023-06-10T19:03:36.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.085+0000 7fc8bce6c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b815cd90 con 0x7fc8b80c9110 2023-06-10T19:03:36.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.089+0000 7fc8b6d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8b815e2b0 0x7fc8b815e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:36.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.089+0000 7fc8b6d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8b815e2b0 0x7fc8b815e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60032/0 (socket says 172.21.15.53:60032) 2023-06-10T19:03:36.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.089+0000 7fc8b6d9d640 1 -- 172.21.15.53:0/1023407679 learned_addr learned my addr 172.21.15.53:0/1023407679 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:36.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.089+0000 7fc8b5d9b640 1 --2- 172.21.15.53:0/1023407679 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8b80c9110 0x7fc8b80c9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:36.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.089+0000 7fc8b659c640 1 --2- 172.21.15.53:0/1023407679 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8a0004d10 0x7fc8b8158c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:36.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.089+0000 7fc8b6d9d640 1 -- 172.21.15.53:0/1023407679 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8b80c9110 msgr2=0x7fc8b80c9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:36.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.089+0000 7fc8b6d9d640 1 --2- 172.21.15.53:0/1023407679 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8b80c9110 0x7fc8b80c9580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:36.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.089+0000 7fc8b6d9d640 1 -- 172.21.15.53:0/1023407679 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8a0004d10 msgr2=0x7fc8b8158c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:36.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.089+0000 7fc8b6d9d640 1 --2- 172.21.15.53:0/1023407679 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8a0004d10 0x7fc8b8158c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:36.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.089+0000 7fc8b6d9d640 1 -- 172.21.15.53:0/1023407679 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8b815d510 con 0x7fc8b815e2b0 2023-06-10T19:03:36.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.089+0000 7fc8b6d9d640 1 --2- 172.21.15.53:0/1023407679 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8b815e2b0 0x7fc8b815e750 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7fc8b00b0040 tx=0x7fc8b0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:36.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.089+0000 7fc8a6ffd640 1 -- 172.21.15.53:0/1023407679 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b00039a0 con 0x7fc8b815e2b0 2023-06-10T19:03:36.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.089+0000 7fc8a6ffd640 1 -- 172.21.15.53:0/1023407679 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8b0003b00 con 0x7fc8b815e2b0 2023-06-10T19:03:36.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.089+0000 7fc8bce6c640 1 -- 172.21.15.53:0/1023407679 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8b815d7f0 con 0x7fc8b815e2b0 2023-06-10T19:03:36.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.089+0000 7fc8a6ffd640 1 -- 172.21.15.53:0/1023407679 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b0003e90 con 0x7fc8b815e2b0 2023-06-10T19:03:36.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.089+0000 7fc8bce6c640 1 -- 172.21.15.53:0/1023407679 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8b81591d0 con 0x7fc8b815e2b0 2023-06-10T19:03:36.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.089+0000 7fc8bce6c640 1 -- 172.21.15.53:0/1023407679 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8b804d790 con 0x7fc8b815e2b0 2023-06-10T19:03:36.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.089+0000 7fc8a6ffd640 1 -- 172.21.15.53:0/1023407679 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc8b00b4040 con 0x7fc8b815e2b0 2023-06-10T19:03:36.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.089+0000 7fc8a6ffd640 1 --2- 172.21.15.53:0/1023407679 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc898066280 0x7fc898068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:36.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.089+0000 7fc8a6ffd640 1 -- 172.21.15.53:0/1023407679 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6307+0+0 (secure 0 0 0) 0x7fc8b011da40 con 0x7fc8b815e2b0 2023-06-10T19:03:36.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.089+0000 7fc8b659c640 1 --2- 172.21.15.53:0/1023407679 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc898066280 0x7fc898068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:36.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.089+0000 7fc8b659c640 1 --2- 172.21.15.53:0/1023407679 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc898066280 0x7fc898068730 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fc8a8000c10 tx=0x7fc8a8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:36.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.093+0000 7fc8a6ffd640 1 -- 172.21.15.53:0/1023407679 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc8b011fe60 con 0x7fc8b815e2b0 2023-06-10T19:03:36.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.245+0000 7fc8bce6c640 1 -- 172.21.15.53:0/1023407679 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc8b808a200 con 0x7fc8b815e2b0 2023-06-10T19:03:36.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.249+0000 7fc8a6ffd640 1 -- 172.21.15.53:0/1023407679 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) v1 ==== 74+0+18665 (secure 0 0 0) 0x7fc8b00eaf00 con 0x7fc8b815e2b0 2023-06-10T19:03:36.253 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:03:36.254 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":98,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:03:25.180996+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-06-10T19:02:00.325404+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-06-10T19:02:01.620938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.8","mappings":[{"from":1,"to":2}]},{"pgid":"14.17","mappings":[{"from":1,"to":7}]},{"pgid":"14.2d","mappings":[{"from":1,"to":7}]},{"pgid":"14.3a","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.0.1:0/3897417564":"2023-06-10T20:03:25.147615+0000","172.21.15.53:6833/1894654263":"2023-06-11T19:02:29.480972+0000","172.21.15.53:6832/1894654263":"2023-06-11T19:02:29.480972+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:03:36.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.249+0000 7fc8bce6c640 1 -- 172.21.15.53:0/1023407679 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc898066280 msgr2=0x7fc898068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:36.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.249+0000 7fc8bce6c640 1 --2- 172.21.15.53:0/1023407679 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc898066280 0x7fc898068730 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fc8a8000c10 tx=0x7fc8a8009040 comp rx=0 tx=0).stop 2023-06-10T19:03:36.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.253+0000 7fc8bce6c640 1 -- 172.21.15.53:0/1023407679 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8b815e2b0 msgr2=0x7fc8b815e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:36.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.253+0000 7fc8bce6c640 1 --2- 172.21.15.53:0/1023407679 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8b815e2b0 0x7fc8b815e750 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7fc8b00b0040 tx=0x7fc8b0009750 comp rx=0 tx=0).stop 2023-06-10T19:03:36.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.253+0000 7fc8bce6c640 1 -- 172.21.15.53:0/1023407679 shutdown_connections 2023-06-10T19:03:36.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.253+0000 7fc8bce6c640 1 --2- 172.21.15.53:0/1023407679 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc898066280 0x7fc898068730 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:36.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.253+0000 7fc8bce6c640 1 --2- 172.21.15.53:0/1023407679 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8b815e2b0 0x7fc8b815e750 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:36.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.253+0000 7fc8bce6c640 1 --2- 172.21.15.53:0/1023407679 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8b80c9110 0x7fc8b80c9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:36.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.253+0000 7fc8bce6c640 1 --2- 172.21.15.53:0/1023407679 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8a0004d10 0x7fc8b8158c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:36.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.253+0000 7fc8bce6c640 1 -- 172.21.15.53:0/1023407679 >> 172.21.15.53:0/1023407679 conn(0x7fc8b8071790 msgr2=0x7fc8b80b5100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:36.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.253+0000 7fc8bce6c640 1 -- 172.21.15.53:0/1023407679 shutdown_connections 2023-06-10T19:03:36.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.253+0000 7fc8bce6c640 1 -- 172.21.15.53:0/1023407679 wait complete. 2023-06-10T19:03:36.273 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-06-10T19:03:36.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.393+0000 7fcca897e640 1 Processor -- start 2023-06-10T19:03:36.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.393+0000 7fcca897e640 1 -- start start 2023-06-10T19:03:36.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.393+0000 7fcca897e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fcca4159450 0x7fcca415d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:36.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.393+0000 7fcca897e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcca415d680 0x7fcca40cec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:36.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.393+0000 7fcca897e640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcca40cbac0 con 0x7fcca40cf180 2023-06-10T19:03:36.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.393+0000 7fcca897e640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcca40cf600 con 0x7fcca4159450 2023-06-10T19:03:36.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.393+0000 7fcca897e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcca415dc00 con 0x7fcca415d680 2023-06-10T19:03:36.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.397+0000 7fcca259c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fcca4159450 0x7fcca415d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:36.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.397+0000 7fcca2d9d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fcca40cf180 0x7fcca40cda20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56394/0 (socket says 172.21.15.53:56394) 2023-06-10T19:03:36.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.397+0000 7fcca2d9d640 1 -- 172.21.15.53:0/2275414662 learned_addr learned my addr 172.21.15.53:0/2275414662 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:03:36.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.397+0000 7fcca1d9b640 1 --2- 172.21.15.53:0/2275414662 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcca415d680 0x7fcca40cec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:36.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.397+0000 7fcca259c640 1 -- 172.21.15.53:0/2275414662 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcca415d680 msgr2=0x7fcca40cec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:36.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.397+0000 7fcca259c640 1 --2- 172.21.15.53:0/2275414662 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcca415d680 0x7fcca40cec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:36.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.397+0000 7fcca259c640 1 -- 172.21.15.53:0/2275414662 >> v1:172.21.15.53:6789/0 conn(0x7fcca40cf180 legacy=0x7fcca40cda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:36.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.397+0000 7fcca259c640 1 -- 172.21.15.53:0/2275414662 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcca415dee0 con 0x7fcca4159450 2023-06-10T19:03:36.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.397+0000 7fcca159a640 1 -- 172.21.15.53:0/2275414662 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2588994075 0 0) 0x7fcca40cbac0 con 0x7fcca40cf180 2023-06-10T19:03:36.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.397+0000 7fcca259c640 1 --2- 172.21.15.53:0/2275414662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcca4159450 0x7fcca415d140 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7fcc940097c0 tx=0x7fcc9401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa781484b938364 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:36.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.397+0000 7fcca159a640 1 -- 172.21.15.53:0/2275414662 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc940ad680 con 0x7fcca4159450 2023-06-10T19:03:36.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.397+0000 7fcca159a640 1 -- 172.21.15.53:0/2275414662 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc940ad7e0 con 0x7fcca4159450 2023-06-10T19:03:36.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.397+0000 7fcca159a640 1 -- 172.21.15.53:0/2275414662 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc940adb70 con 0x7fcca4159450 2023-06-10T19:03:36.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.397+0000 7fcca897e640 1 -- 172.21.15.53:0/2275414662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcca4159450 msgr2=0x7fcca415d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:36.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.397+0000 7fcca897e640 1 --2- 172.21.15.53:0/2275414662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcca4159450 0x7fcca415d140 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7fcc940097c0 tx=0x7fcc9401c3c0 comp rx=0 tx=0).stop 2023-06-10T19:03:36.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.397+0000 7fcca897e640 1 -- 172.21.15.53:0/2275414662 shutdown_connections 2023-06-10T19:03:36.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.397+0000 7fcca897e640 1 --2- 172.21.15.53:0/2275414662 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcca415d680 0x7fcca40cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:36.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.397+0000 7fcca897e640 1 --2- 172.21.15.53:0/2275414662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcca4159450 0x7fcca415d140 unknown :-1 s=CLOSED pgs=1652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:36.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.397+0000 7fcca897e640 1 -- 172.21.15.53:0/2275414662 >> 172.21.15.53:0/2275414662 conn(0x7fcca406a0b0 msgr2=0x7fcca406d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:36.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.397+0000 7fcca897e640 1 -- 172.21.15.53:0/2275414662 shutdown_connections 2023-06-10T19:03:36.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.397+0000 7fcca897e640 1 -- 172.21.15.53:0/2275414662 wait complete. 2023-06-10T19:03:36.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.401+0000 7fcca897e640 1 Processor -- start 2023-06-10T19:03:36.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.401+0000 7fcca897e640 1 -- start start 2023-06-10T19:03:36.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.401+0000 7fcca897e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcca40cf180 0x7fcca4150670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:36.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.401+0000 7fcca897e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcca4159450 0x7fcca40b48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:36.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.401+0000 7fcca897e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcca415d680 0x7fcca40b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:36.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.401+0000 7fcca897e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca41569e0 con 0x7fcca415d680 2023-06-10T19:03:36.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.401+0000 7fcca897e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca4156700 con 0x7fcca40cf180 2023-06-10T19:03:36.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.401+0000 7fcca897e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcca4156e40 con 0x7fcca4159450 2023-06-10T19:03:36.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.401+0000 7fcca2d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcca415d680 0x7fcca40b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:36.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.401+0000 7fcca2d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcca415d680 0x7fcca40b4e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60054/0 (socket says 172.21.15.53:60054) 2023-06-10T19:03:36.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.401+0000 7fcca2d9d640 1 -- 172.21.15.53:0/2390605456 learned_addr learned my addr 172.21.15.53:0/2390605456 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:36.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.401+0000 7fcca259c640 1 --2- 172.21.15.53:0/2390605456 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcca40cf180 0x7fcca4150670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:36.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.401+0000 7fcca1d9b640 1 --2- 172.21.15.53:0/2390605456 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcca4159450 0x7fcca40b48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:36.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.401+0000 7fcca2d9d640 1 -- 172.21.15.53:0/2390605456 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcca4159450 msgr2=0x7fcca40b48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:36.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.401+0000 7fcca2d9d640 1 --2- 172.21.15.53:0/2390605456 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcca4159450 0x7fcca40b48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:36.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.401+0000 7fcca2d9d640 1 -- 172.21.15.53:0/2390605456 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcca40cf180 msgr2=0x7fcca4150670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:36.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.401+0000 7fcca2d9d640 1 --2- 172.21.15.53:0/2390605456 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcca40cf180 0x7fcca4150670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:36.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.401+0000 7fcca2d9d640 1 -- 172.21.15.53:0/2390605456 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc94009420 con 0x7fcca415d680 2023-06-10T19:03:36.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.401+0000 7fcca2d9d640 1 --2- 172.21.15.53:0/2390605456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcca415d680 0x7fcca40b4e10 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c00c780 tx=0x7fcc9c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:36.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.401+0000 7fcc92ffd640 1 -- 172.21.15.53:0/2390605456 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9c00ce90 con 0x7fcca415d680 2023-06-10T19:03:36.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.401+0000 7fcc92ffd640 1 -- 172.21.15.53:0/2390605456 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc9c00a640 con 0x7fcca415d680 2023-06-10T19:03:36.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.401+0000 7fcca897e640 1 -- 172.21.15.53:0/2390605456 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcca4157120 con 0x7fcca415d680 2023-06-10T19:03:36.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.401+0000 7fcc92ffd640 1 -- 172.21.15.53:0/2390605456 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9c00a9d0 con 0x7fcca415d680 2023-06-10T19:03:36.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.401+0000 7fcca897e640 1 -- 172.21.15.53:0/2390605456 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcca4156390 con 0x7fcca415d680 2023-06-10T19:03:36.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.401+0000 7fcca897e640 1 -- 172.21.15.53:0/2390605456 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcca404d790 con 0x7fcca415d680 2023-06-10T19:03:36.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.405+0000 7fcc92ffd640 1 -- 172.21.15.53:0/2390605456 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcc9c00ab30 con 0x7fcca415d680 2023-06-10T19:03:36.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.405+0000 7fcc92ffd640 1 --2- 172.21.15.53:0/2390605456 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcc84066280 0x7fcc84068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:36.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.405+0000 7fcc92ffd640 1 -- 172.21.15.53:0/2390605456 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6307+0+0 (secure 0 0 0) 0x7fcc9c083900 con 0x7fcca415d680 2023-06-10T19:03:36.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.405+0000 7fcca259c640 1 --2- 172.21.15.53:0/2390605456 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcc84066280 0x7fcc84068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:36.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.405+0000 7fcca259c640 1 --2- 172.21.15.53:0/2390605456 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcc84066280 0x7fcc84068730 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fcc940af000 tx=0x7fcc940a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:36.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.409+0000 7fcc92ffd640 1 -- 172.21.15.53:0/2390605456 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcc9c050cf0 con 0x7fcca415d680 2023-06-10T19:03:36.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:36.585+0000 7fcca897e640 1 -- 172.21.15.53:0/2390605456 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fcca406af70 con 0x7fcca415d680 2023-06-10T19:03:37.264 INFO:tasks.ceph.mon.a.smithi053.stderr:2023-06-10T19:03:37.261+0000 7f74752c1640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-06-10T19:03:37.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:37.269+0000 7fcc92ffd640 1 -- 172.21.15.53:0/2390605456 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v56) v1 ==== 161+0+0 (secure 0 0 0) 0x7fcc9c054310 con 0x7fcca415d680 2023-06-10T19:03:37.274 INFO:teuthology.orchestra.run.smithi053.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-06-10T19:03:37.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:37.273+0000 7fcca897e640 1 -- 172.21.15.53:0/2390605456 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcc84066280 msgr2=0x7fcc84068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:37.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:37.273+0000 7fcca897e640 1 --2- 172.21.15.53:0/2390605456 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcc84066280 0x7fcc84068730 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fcc940af000 tx=0x7fcc940a7000 comp rx=0 tx=0).stop 2023-06-10T19:03:37.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:37.273+0000 7fcca897e640 1 -- 172.21.15.53:0/2390605456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcca415d680 msgr2=0x7fcca40b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:37.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:37.273+0000 7fcca897e640 1 --2- 172.21.15.53:0/2390605456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcca415d680 0x7fcca40b4e10 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c00c780 tx=0x7fcc9c00cc40 comp rx=0 tx=0).stop 2023-06-10T19:03:37.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:37.273+0000 7fcca897e640 1 -- 172.21.15.53:0/2390605456 shutdown_connections 2023-06-10T19:03:37.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:37.273+0000 7fcca897e640 1 --2- 172.21.15.53:0/2390605456 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcc84066280 0x7fcc84068730 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:37.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:37.273+0000 7fcca897e640 1 --2- 172.21.15.53:0/2390605456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcca415d680 0x7fcca40b4e10 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:37.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:37.273+0000 7fcca897e640 1 --2- 172.21.15.53:0/2390605456 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcca4159450 0x7fcca40b48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:37.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:37.273+0000 7fcca897e640 1 --2- 172.21.15.53:0/2390605456 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcca40cf180 0x7fcca4150670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:37.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:37.273+0000 7fcca897e640 1 -- 172.21.15.53:0/2390605456 >> 172.21.15.53:0/2390605456 conn(0x7fcca406a0b0 msgr2=0x7fcca4155a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:37.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:37.273+0000 7fcca897e640 1 -- 172.21.15.53:0/2390605456 shutdown_connections 2023-06-10T19:03:37.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:37.273+0000 7fcca897e640 1 -- 172.21.15.53:0/2390605456 wait complete. 2023-06-10T19:03:37.299 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-06-10T19:03:37.330 INFO:tasks.ceph.mds.a.smithi053.stdout:starting mds.a at 2023-06-10T19:03:37.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:37.421+0000 7ffb12c1b640 1 Processor -- start 2023-06-10T19:03:37.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:37.421+0000 7ffb12c1b640 1 -- start start 2023-06-10T19:03:37.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:37.421+0000 7ffb12c1b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb0c0af760 0x7ffb0c0c9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:37.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:37.421+0000 7ffb12c1b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ffb0c0afb30 0x7ffb0c15dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:37.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:37.421+0000 7ffb12c1b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ffb0c070b80 0x7ffb0c06b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:37.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:37.421+0000 7ffb12c1b640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb0c0706f0 con 0x7ffb0c0afb30 2023-06-10T19:03:37.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:37.421+0000 7ffb12c1b640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb0c0700e0 con 0x7ffb0c070b80 2023-06-10T19:03:37.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:37.421+0000 7ffb12c1b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0c0c9e10 con 0x7ffb0c0af760 2023-06-10T19:03:37.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:37.421+0000 7ffb0bfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ffb0c0afb30 0x7ffb0c15dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:37.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:37.421+0000 7ffb0bfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ffb0c0afb30 0x7ffb0c15dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60088/0 (socket says 172.21.15.53:60088) 2023-06-10T19:03:37.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:37.421+0000 7ffb0bfff640 1 -- 172.21.15.53:0/2643718561 learned_addr learned my addr 172.21.15.53:0/2643718561 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:37.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:37.421+0000 7ffb111b8640 1 --2- 172.21.15.53:0/2643718561 >> v2:172.21.15.117:3300/0 conn(0x7ffb0c070b80 0x7ffb0c06b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:37.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:37.421+0000 7ffb0bfff640 1 -- 172.21.15.53:0/2643718561 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb0c0af760 msgr2=0x7ffb0c0c9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:37.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:37.421+0000 7ffb109b7640 1 --2- 172.21.15.53:0/2643718561 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb0c0af760 0x7ffb0c0c9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:37.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:37.421+0000 7ffb0bfff640 1 --2- 172.21.15.53:0/2643718561 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb0c0af760 0x7ffb0c0c9830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:37.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:37.421+0000 7ffb0bfff640 1 -- 172.21.15.53:0/2643718561 >> v2:172.21.15.117:3300/0 conn(0x7ffb0c070b80 msgr2=0x7ffb0c06b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:37.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:37.421+0000 7ffb0bfff640 1 --2- 172.21.15.53:0/2643718561 >> v2:172.21.15.117:3300/0 conn(0x7ffb0c070b80 0x7ffb0c06b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:37.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:37.421+0000 7ffb0bfff640 1 -- 172.21.15.53:0/2643718561 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb0c0ca0f0 con 0x7ffb0c0afb30 2023-06-10T19:03:37.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:37.425+0000 7ffb0bfff640 1 --2- 172.21.15.53:0/2643718561 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb0c0afb30 0x7ffb0c15dbd0 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c06e860 tx=0x7ffaf401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e502e7caaf775d14 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:37.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:37.425+0000 7ffb0b7fe640 1 -- 172.21.15.53:0/2643718561 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf40ac600 con 0x7ffb0c0afb30 2023-06-10T19:03:37.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:37.425+0000 7ffb0b7fe640 1 -- 172.21.15.53:0/2643718561 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaf40a8050 con 0x7ffb0c0afb30 2023-06-10T19:03:37.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:37.425+0000 7ffb0b7fe640 1 -- 172.21.15.53:0/2643718561 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf40ac980 con 0x7ffb0c0afb30 2023-06-10T19:03:37.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:37.425+0000 7ffb12c1b640 1 -- 172.21.15.53:0/2643718561 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb0c0afb30 msgr2=0x7ffb0c15dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:37.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:37.425+0000 7ffb12c1b640 1 --2- 172.21.15.53:0/2643718561 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb0c0afb30 0x7ffb0c15dbd0 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c06e860 tx=0x7ffaf401c4d0 comp rx=0 tx=0).stop 2023-06-10T19:03:37.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:37.425+0000 7ffb12c1b640 1 -- 172.21.15.53:0/2643718561 shutdown_connections 2023-06-10T19:03:37.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:37.425+0000 7ffb12c1b640 1 --2- 172.21.15.53:0/2643718561 >> v2:172.21.15.117:3300/0 conn(0x7ffb0c070b80 0x7ffb0c06b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:37.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:37.425+0000 7ffb12c1b640 1 --2- 172.21.15.53:0/2643718561 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb0c0afb30 0x7ffb0c15dbd0 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:37.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:37.425+0000 7ffb12c1b640 1 --2- 172.21.15.53:0/2643718561 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb0c0af760 0x7ffb0c0c9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:37.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:37.425+0000 7ffb12c1b640 1 -- 172.21.15.53:0/2643718561 >> 172.21.15.53:0/2643718561 conn(0x7ffb0c06a0e0 msgr2=0x7ffb0c0cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:37.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:37.425+0000 7ffb12c1b640 1 -- 172.21.15.53:0/2643718561 shutdown_connections 2023-06-10T19:03:37.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:37.425+0000 7ffb12c1b640 1 -- 172.21.15.53:0/2643718561 wait complete. 2023-06-10T19:03:37.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:37.425+0000 7ffb12c1b640 1 Processor -- start 2023-06-10T19:03:37.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:37.425+0000 7ffb12c1b640 1 -- start start 2023-06-10T19:03:37.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:37.429+0000 7ffb12c1b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb0c070b80 0x7ffb0c14bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:37.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:37.429+0000 7ffb12c1b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb0c0af760 0x7ffb0c0b1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:37.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:37.429+0000 7ffb12c1b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb0c0afb30 0x7ffb0c144800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:37.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:37.429+0000 7ffb12c1b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0c0b1570 con 0x7ffb0c0af760 2023-06-10T19:03:37.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:37.429+0000 7ffb12c1b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0c0b3940 con 0x7ffb0c0afb30 2023-06-10T19:03:37.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:37.429+0000 7ffb12c1b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0c144d40 con 0x7ffb0c070b80 2023-06-10T19:03:37.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:37.429+0000 7ffb0bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb0c0af760 0x7ffb0c0b1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:37.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:37.429+0000 7ffb0bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb0c0af760 0x7ffb0c0b1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60092/0 (socket says 172.21.15.53:60092) 2023-06-10T19:03:37.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:37.429+0000 7ffb0bfff640 1 -- 172.21.15.53:0/3791889322 learned_addr learned my addr 172.21.15.53:0/3791889322 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:37.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:37.429+0000 7ffb111b8640 1 --2- 172.21.15.53:0/3791889322 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb0c0afb30 0x7ffb0c144800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:37.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:37.429+0000 7ffb109b7640 1 --2- 172.21.15.53:0/3791889322 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb0c070b80 0x7ffb0c14bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:37.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:37.429+0000 7ffb0bfff640 1 -- 172.21.15.53:0/3791889322 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb0c070b80 msgr2=0x7ffb0c14bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:37.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:37.429+0000 7ffb0bfff640 1 --2- 172.21.15.53:0/3791889322 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb0c070b80 0x7ffb0c14bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:37.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:37.429+0000 7ffb0bfff640 1 -- 172.21.15.53:0/3791889322 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb0c0afb30 msgr2=0x7ffb0c144800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:37.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:37.429+0000 7ffb0bfff640 1 --2- 172.21.15.53:0/3791889322 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb0c0afb30 0x7ffb0c144800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:37.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:37.429+0000 7ffb0bfff640 1 -- 172.21.15.53:0/3791889322 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaf40094d0 con 0x7ffb0c0af760 2023-06-10T19:03:37.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:37.429+0000 7ffb111b8640 1 --2- 172.21.15.53:0/3791889322 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb0c0afb30 0x7ffb0c144800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:03:37.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:37.429+0000 7ffb0bfff640 1 --2- 172.21.15.53:0/3791889322 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb0c0af760 0x7ffb0c0b1a00 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7ffaf401cd70 tx=0x7ffaf4019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:37.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:37.429+0000 7ffb097fa640 1 -- 172.21.15.53:0/3791889322 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf40b7620 con 0x7ffb0c0af760 2023-06-10T19:03:37.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:37.429+0000 7ffb097fa640 1 -- 172.21.15.53:0/3791889322 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaf40b7780 con 0x7ffb0c0af760 2023-06-10T19:03:37.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:37.429+0000 7ffb12c1b640 1 -- 172.21.15.53:0/3791889322 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb0c0b0100 con 0x7ffb0c0af760 2023-06-10T19:03:37.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:37.429+0000 7ffb097fa640 1 -- 172.21.15.53:0/3791889322 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf40b7b30 con 0x7ffb0c0af760 2023-06-10T19:03:37.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:37.429+0000 7ffb12c1b640 1 -- 172.21.15.53:0/3791889322 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb0c0b0f20 con 0x7ffb0c0af760 2023-06-10T19:03:37.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:37.429+0000 7ffb12c1b640 1 -- 172.21.15.53:0/3791889322 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb0c04d790 con 0x7ffb0c0af760 2023-06-10T19:03:37.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:37.429+0000 7ffb097fa640 1 -- 172.21.15.53:0/3791889322 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ffaf40b3040 con 0x7ffb0c0af760 2023-06-10T19:03:37.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:37.429+0000 7ffb097fa640 1 --2- 172.21.15.53:0/3791889322 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ffaec066280 0x7ffaec068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:37.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:37.429+0000 7ffb097fa640 1 -- 172.21.15.53:0/3791889322 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6393+0+0 (secure 0 0 0) 0x7ffaf411e7a0 con 0x7ffb0c0af760 2023-06-10T19:03:37.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:37.429+0000 7ffb109b7640 1 --2- 172.21.15.53:0/3791889322 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ffaec066280 0x7ffaec068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:37.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:37.433+0000 7ffb109b7640 1 --2- 172.21.15.53:0/3791889322 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ffaec066280 0x7ffaec068730 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c14b0d0 tx=0x7ffafc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:37.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:37.433+0000 7ffb097fa640 1 -- 172.21.15.53:0/3791889322 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ffaf40ebc40 con 0x7ffb0c0af760 2023-06-10T19:03:37.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:37.621+0000 7ffb12c1b640 1 -- 172.21.15.53:0/3791889322 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ffb0c0ce560 con 0x7ffb0c0af760 2023-06-10T19:03:37.815 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-10T19:03:37.817 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-10T19:03:38.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:38.293+0000 7ffb097fa640 1 -- 172.21.15.53:0/3791889322 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v57) v1 ==== 104+0+0 (secure 0 0 0) 0x7ffaf40ef260 con 0x7ffb0c0af760 2023-06-10T19:03:38.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:38.297+0000 7ffb12c1b640 1 -- 172.21.15.53:0/3791889322 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ffaec066280 msgr2=0x7ffaec068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:38.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:38.297+0000 7ffb12c1b640 1 --2- 172.21.15.53:0/3791889322 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ffaec066280 0x7ffaec068730 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c14b0d0 tx=0x7ffafc008040 comp rx=0 tx=0).stop 2023-06-10T19:03:38.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:38.297+0000 7ffb12c1b640 1 -- 172.21.15.53:0/3791889322 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb0c0af760 msgr2=0x7ffb0c0b1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:38.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:38.297+0000 7ffb12c1b640 1 --2- 172.21.15.53:0/3791889322 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb0c0af760 0x7ffb0c0b1a00 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7ffaf401cd70 tx=0x7ffaf4019270 comp rx=0 tx=0).stop 2023-06-10T19:03:38.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:38.297+0000 7ffb12c1b640 1 -- 172.21.15.53:0/3791889322 shutdown_connections 2023-06-10T19:03:38.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:38.297+0000 7ffb12c1b640 1 --2- 172.21.15.53:0/3791889322 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ffaec066280 0x7ffaec068730 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:38.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:38.297+0000 7ffb12c1b640 1 --2- 172.21.15.53:0/3791889322 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb0c0afb30 0x7ffb0c144800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:38.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:38.297+0000 7ffb12c1b640 1 --2- 172.21.15.53:0/3791889322 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb0c0af760 0x7ffb0c0b1a00 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:38.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:38.297+0000 7ffb12c1b640 1 --2- 172.21.15.53:0/3791889322 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb0c070b80 0x7ffb0c14bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:38.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:38.297+0000 7ffb12c1b640 1 -- 172.21.15.53:0/3791889322 >> 172.21.15.53:0/3791889322 conn(0x7ffb0c06a0e0 msgr2=0x7ffb0c14f800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:38.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:38.297+0000 7ffb12c1b640 1 -- 172.21.15.53:0/3791889322 shutdown_connections 2023-06-10T19:03:38.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:38.297+0000 7ffb12c1b640 1 -- 172.21.15.53:0/3791889322 wait complete. 2023-06-10T19:03:38.323 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-06-10T19:03:38.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:38.449+0000 7f7ea0202640 1 Processor -- start 2023-06-10T19:03:38.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:38.449+0000 7f7ea0202640 1 -- start start 2023-06-10T19:03:38.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:38.453+0000 7f7ea0202640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7e980b24f0 0x7f7e980cec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:38.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:38.453+0000 7f7ea0202640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7e9815d8e0 0x7f7e980cf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:38.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:38.453+0000 7f7ea0202640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e98150b60 con 0x7f7e9815a8d0 2023-06-10T19:03:38.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:38.453+0000 7f7ea0202640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e9815e1a0 con 0x7f7e980b24f0 2023-06-10T19:03:38.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:38.453+0000 7f7ea0202640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e98159be0 con 0x7f7e9815d8e0 2023-06-10T19:03:38.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:38.453+0000 7f7e9df9e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7e980b24f0 0x7f7e980cec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:38.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:38.453+0000 7f7e9df9e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7e980b24f0 0x7f7e980cec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60102/0 (socket says 172.21.15.53:60102) 2023-06-10T19:03:38.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:38.453+0000 7f7e9df9e640 1 -- 172.21.15.53:0/963977437 learned_addr learned my addr 172.21.15.53:0/963977437 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:38.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:38.453+0000 7f7e9e79f640 1 --2- 172.21.15.53:0/963977437 >> v2:172.21.15.117:3300/0 conn(0x7f7e9815d8e0 0x7f7e980cf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:38.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:38.453+0000 7f7e9df9e640 1 -- 172.21.15.53:0/963977437 >> v2:172.21.15.117:3300/0 conn(0x7f7e9815d8e0 msgr2=0x7f7e980cf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:38.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:38.453+0000 7f7e9df9e640 1 --2- 172.21.15.53:0/963977437 >> v2:172.21.15.117:3300/0 conn(0x7f7e9815d8e0 0x7f7e980cf140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:38.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:38.453+0000 7f7e9df9e640 1 -- 172.21.15.53:0/963977437 >> v1:172.21.15.117:6789/0 conn(0x7f7e9815a8d0 legacy=0x7f7e9815d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:38.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:38.453+0000 7f7e9df9e640 1 -- 172.21.15.53:0/963977437 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e9815a440 con 0x7f7e980b24f0 2023-06-10T19:03:38.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:38.453+0000 7f7e9df9e640 1 --2- 172.21.15.53:0/963977437 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e980b24f0 0x7f7e980cec00 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f7e981577b0 tx=0x7f7e9401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3091e184b092b2eb server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:38.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:38.453+0000 7f7e9cf9c640 1 -- 172.21.15.53:0/963977437 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e940ab600 con 0x7f7e980b24f0 2023-06-10T19:03:38.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:38.453+0000 7f7e9cf9c640 1 -- 172.21.15.53:0/963977437 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e940a7050 con 0x7f7e980b24f0 2023-06-10T19:03:38.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:38.453+0000 7f7e9cf9c640 1 -- 172.21.15.53:0/963977437 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e940ab980 con 0x7f7e980b24f0 2023-06-10T19:03:38.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:38.457+0000 7f7ea0202640 1 -- 172.21.15.53:0/963977437 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e980b24f0 msgr2=0x7f7e980cec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:38.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:38.457+0000 7f7ea0202640 1 --2- 172.21.15.53:0/963977437 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e980b24f0 0x7f7e980cec00 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f7e981577b0 tx=0x7f7e9401c490 comp rx=0 tx=0).stop 2023-06-10T19:03:38.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:38.457+0000 7f7ea0202640 1 -- 172.21.15.53:0/963977437 shutdown_connections 2023-06-10T19:03:38.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:38.457+0000 7f7ea0202640 1 --2- 172.21.15.53:0/963977437 >> v2:172.21.15.117:3300/0 conn(0x7f7e9815d8e0 0x7f7e980cf140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:38.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:38.457+0000 7f7ea0202640 1 --2- 172.21.15.53:0/963977437 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e980b24f0 0x7f7e980cec00 unknown :-1 s=CLOSED pgs=1659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:38.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:38.457+0000 7f7ea0202640 1 -- 172.21.15.53:0/963977437 >> 172.21.15.53:0/963977437 conn(0x7f7e9806a080 msgr2=0x7f7e9806d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:38.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:38.457+0000 7f7ea0202640 1 -- 172.21.15.53:0/963977437 shutdown_connections 2023-06-10T19:03:38.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:38.457+0000 7f7ea0202640 1 -- 172.21.15.53:0/963977437 wait complete. 2023-06-10T19:03:38.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:38.457+0000 7f7ea0202640 1 Processor -- start 2023-06-10T19:03:38.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:38.457+0000 7f7ea0202640 1 -- start start 2023-06-10T19:03:38.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:38.457+0000 7f7ea0202640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e980b24f0 0x7f7e9815bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:38.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:38.457+0000 7f7ea0202640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e9815a8d0 0x7f7e9815c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:38.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:38.457+0000 7f7ea0202640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e9815d8e0 0x7f7e980c8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:38.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:38.457+0000 7f7ea0202640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e98148ef0 con 0x7f7e980b24f0 2023-06-10T19:03:38.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:38.457+0000 7f7ea0202640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e980c9fb0 con 0x7f7e9815a8d0 2023-06-10T19:03:38.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:38.457+0000 7f7ea0202640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e980c64e0 con 0x7f7e9815d8e0 2023-06-10T19:03:38.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:38.457+0000 7f7e9df9e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e980b24f0 0x7f7e9815bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:38.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:38.457+0000 7f7e9df9e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e980b24f0 0x7f7e9815bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60118/0 (socket says 172.21.15.53:60118) 2023-06-10T19:03:38.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:38.457+0000 7f7e9df9e640 1 -- 172.21.15.53:0/252376627 learned_addr learned my addr 172.21.15.53:0/252376627 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:38.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:38.457+0000 7f7e9e79f640 1 --2- 172.21.15.53:0/252376627 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e9815d8e0 0x7f7e980c8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:38.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:38.457+0000 7f7e9d79d640 1 --2- 172.21.15.53:0/252376627 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e9815a8d0 0x7f7e9815c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:38.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:38.457+0000 7f7e9df9e640 1 -- 172.21.15.53:0/252376627 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e9815d8e0 msgr2=0x7f7e980c8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:38.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:38.457+0000 7f7e9df9e640 1 --2- 172.21.15.53:0/252376627 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e9815d8e0 0x7f7e980c8ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:38.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:38.457+0000 7f7e9df9e640 1 -- 172.21.15.53:0/252376627 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e9815a8d0 msgr2=0x7f7e9815c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:38.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:38.457+0000 7f7e9df9e640 1 --2- 172.21.15.53:0/252376627 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e9815a8d0 0x7f7e9815c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:38.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:38.457+0000 7f7e9df9e640 1 -- 172.21.15.53:0/252376627 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e940094d0 con 0x7f7e980b24f0 2023-06-10T19:03:38.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:38.457+0000 7f7e9d79d640 1 --2- 172.21.15.53:0/252376627 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e9815a8d0 0x7f7e9815c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:03:38.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:38.457+0000 7f7e9df9e640 1 --2- 172.21.15.53:0/252376627 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e980b24f0 0x7f7e9815bfe0 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7f7e9401a0c0 tx=0x7f7e94019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:38.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:38.457+0000 7f7e8e7fc640 1 -- 172.21.15.53:0/252376627 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e940b37d0 con 0x7f7e980b24f0 2023-06-10T19:03:38.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:38.457+0000 7f7e8e7fc640 1 -- 172.21.15.53:0/252376627 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e940b3930 con 0x7f7e980b24f0 2023-06-10T19:03:38.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:38.457+0000 7f7ea0202640 1 -- 172.21.15.53:0/252376627 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e980c9cd0 con 0x7f7e980b24f0 2023-06-10T19:03:38.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:38.457+0000 7f7e8e7fc640 1 -- 172.21.15.53:0/252376627 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e940b3ca0 con 0x7f7e980b24f0 2023-06-10T19:03:38.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:38.457+0000 7f7ea0202640 1 -- 172.21.15.53:0/252376627 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e98148b10 con 0x7f7e980b24f0 2023-06-10T19:03:38.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:38.461+0000 7f7ea0202640 1 -- 172.21.15.53:0/252376627 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e9804d790 con 0x7f7e980b24f0 2023-06-10T19:03:38.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:38.461+0000 7f7e8e7fc640 1 -- 172.21.15.53:0/252376627 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7e940b2070 con 0x7f7e980b24f0 2023-06-10T19:03:38.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:38.461+0000 7f7e8e7fc640 1 --2- 172.21.15.53:0/252376627 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7e7c066280 0x7f7e7c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:38.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:38.461+0000 7f7e8e7fc640 1 -- 172.21.15.53:0/252376627 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6393+0+0 (secure 0 0 0) 0x7f7e9411e010 con 0x7f7e980b24f0 2023-06-10T19:03:38.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:38.461+0000 7f7e9d79d640 1 --2- 172.21.15.53:0/252376627 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7e7c066280 0x7f7e7c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:38.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:38.461+0000 7f7e9d79d640 1 --2- 172.21.15.53:0/252376627 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7e7c066280 0x7f7e7c068730 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f7e98159480 tx=0x7f7e88009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:38.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:38.465+0000 7f7e8e7fc640 1 -- 172.21.15.53:0/252376627 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7e940eb3d0 con 0x7f7e980b24f0 2023-06-10T19:03:38.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:38.617+0000 7f7ea0202640 1 -- 172.21.15.53:0/252376627 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7e98150b40 con 0x7f7e980b24f0 2023-06-10T19:03:39.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.361+0000 7f7e8e7fc640 1 -- 172.21.15.53:0/252376627 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v100) v1 ==== 181+0+0 (secure 0 0 0) 0x7f7e940b00d0 con 0x7f7e980b24f0 2023-06-10T19:03:39.367 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_metadata' removed 2023-06-10T19:03:39.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.369+0000 7f7ea0202640 1 -- 172.21.15.53:0/252376627 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7e7c066280 msgr2=0x7f7e7c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:39.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.369+0000 7f7ea0202640 1 --2- 172.21.15.53:0/252376627 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7e7c066280 0x7f7e7c068730 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f7e98159480 tx=0x7f7e88009040 comp rx=0 tx=0).stop 2023-06-10T19:03:39.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.369+0000 7f7ea0202640 1 -- 172.21.15.53:0/252376627 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e980b24f0 msgr2=0x7f7e9815bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:39.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.369+0000 7f7ea0202640 1 --2- 172.21.15.53:0/252376627 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e980b24f0 0x7f7e9815bfe0 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7f7e9401a0c0 tx=0x7f7e94019230 comp rx=0 tx=0).stop 2023-06-10T19:03:39.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.369+0000 7f7ea0202640 1 -- 172.21.15.53:0/252376627 shutdown_connections 2023-06-10T19:03:39.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.369+0000 7f7ea0202640 1 --2- 172.21.15.53:0/252376627 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7e7c066280 0x7f7e7c068730 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:39.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.369+0000 7f7ea0202640 1 --2- 172.21.15.53:0/252376627 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e9815d8e0 0x7f7e980c8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:39.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.369+0000 7f7ea0202640 1 --2- 172.21.15.53:0/252376627 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e9815a8d0 0x7f7e9815c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:39.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.369+0000 7f7ea0202640 1 --2- 172.21.15.53:0/252376627 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e980b24f0 0x7f7e9815bfe0 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:39.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.369+0000 7f7ea0202640 1 -- 172.21.15.53:0/252376627 >> 172.21.15.53:0/252376627 conn(0x7f7e9806a080 msgr2=0x7f7e980cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:39.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.369+0000 7f7ea0202640 1 -- 172.21.15.53:0/252376627 shutdown_connections 2023-06-10T19:03:39.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.369+0000 7f7ea0202640 1 -- 172.21.15.53:0/252376627 wait complete. 2023-06-10T19:03:39.396 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-06-10T19:03:39.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.525+0000 7f58b77d1640 1 Processor -- start 2023-06-10T19:03:39.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.525+0000 7f58b77d1640 1 -- start start 2023-06-10T19:03:39.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.525+0000 7f58b77d1640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f58b006b840 0x7f58b00cf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:39.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.525+0000 7f58b77d1640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58b00cf380 con 0x7f58b015f370 2023-06-10T19:03:39.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.525+0000 7f58b77d1640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58b0160260 con 0x7f58b015ba00 2023-06-10T19:03:39.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.525+0000 7f58b77d1640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58b00ceb40 con 0x7f58b006b840 2023-06-10T19:03:39.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.525+0000 7f58b5d6e640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f58b015f370 0x7f58b006a560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56410/0 (socket says 172.21.15.53:56410) 2023-06-10T19:03:39.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.525+0000 7f58b5d6e640 1 -- 172.21.15.53:0/1221447582 learned_addr learned my addr 172.21.15.53:0/1221447582 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:03:39.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.525+0000 7f58b556d640 1 --2- 172.21.15.53:0/1221447582 >> v2:172.21.15.117:3300/0 conn(0x7f58b006b840 0x7f58b00cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:39.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.525+0000 7f58a7fff640 1 -- 172.21.15.53:0/1221447582 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2160571637 0 0) 0x7f58b00cf380 con 0x7f58b015f370 2023-06-10T19:03:39.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.525+0000 7f58a7fff640 1 -- 172.21.15.53:0/1221447582 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f589c003530 con 0x7f58b015f370 2023-06-10T19:03:39.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.525+0000 7f58a7fff640 1 -- 172.21.15.53:0/1221447582 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2797625008 0 0) 0x7f589c003530 con 0x7f58b015f370 2023-06-10T19:03:39.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.525+0000 7f58a7fff640 1 -- 172.21.15.53:0/1221447582 >> v2:172.21.15.117:3300/0 conn(0x7f58b006b840 msgr2=0x7f58b00cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:39.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.525+0000 7f58a7fff640 1 --2- 172.21.15.53:0/1221447582 >> v2:172.21.15.117:3300/0 conn(0x7f58b006b840 0x7f58b00cf810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:39.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.525+0000 7f58a7fff640 1 -- 172.21.15.53:0/1221447582 >> v1:172.21.15.117:6789/0 conn(0x7f58b015ba00 legacy=0x7f58b006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:39.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.525+0000 7f58a7fff640 1 -- 172.21.15.53:0/1221447582 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58b015ff80 con 0x7f58b015f370 2023-06-10T19:03:39.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.525+0000 7f58b556d640 1 --2- 172.21.15.53:0/1221447582 >> v2:172.21.15.117:3300/0 conn(0x7f58b006b840 0x7f58b00cf810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:03:39.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.525+0000 7f58a7fff640 1 -- 172.21.15.53:0/1221447582 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f58a8001a00 con 0x7f58b015f370 2023-06-10T19:03:39.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.525+0000 7f58a7fff640 1 -- 172.21.15.53:0/1221447582 >> v1:172.21.15.53:6789/0 conn(0x7f58b015f370 legacy=0x7f58b006a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:39.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.525+0000 7f58a7fff640 1 --2- 172.21.15.53:0/1221447582 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f589c003980 0x7f589c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:39.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.525+0000 7f58a7fff640 1 --2- 172.21.15.53:0/1221447582 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f589c0047d0 0x7f589c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:39.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.525+0000 7f58a7fff640 1 --2- 172.21.15.53:0/1221447582 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f589c005180 0x7f589c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:39.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.525+0000 7f58a7fff640 1 -- 172.21.15.53:0/1221447582 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f589c00c0e0 con 0x7f589c003980 2023-06-10T19:03:39.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.525+0000 7f58a7fff640 1 -- 172.21.15.53:0/1221447582 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f589c00c250 con 0x7f589c005180 2023-06-10T19:03:39.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.525+0000 7f58a7fff640 1 -- 172.21.15.53:0/1221447582 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f589c00c410 con 0x7f589c0047d0 2023-06-10T19:03:39.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.525+0000 7f58b556d640 1 --2- 172.21.15.53:0/1221447582 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f589c003980 0x7f589c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:39.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.525+0000 7f58b5d6e640 1 --2- 172.21.15.53:0/1221447582 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f589c005180 0x7f589c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:39.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.525+0000 7f58b556d640 1 -- 172.21.15.53:0/1221447582 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f589c0047d0 msgr2=0x7f589c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:39.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.525+0000 7f58b556d640 1 --2- 172.21.15.53:0/1221447582 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f589c0047d0 0x7f589c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:39.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.525+0000 7f58b556d640 1 -- 172.21.15.53:0/1221447582 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f589c005180 msgr2=0x7f589c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:39.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.525+0000 7f58b556d640 1 --2- 172.21.15.53:0/1221447582 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f589c005180 0x7f589c00b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:39.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.525+0000 7f58b5d6e640 1 -- 172.21.15.53:0/1221447582 reap_dead start 2023-06-10T19:03:39.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.525+0000 7f58b556d640 1 -- 172.21.15.53:0/1221447582 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f589c003530 con 0x7f589c003980 2023-06-10T19:03:39.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.529+0000 7f58b556d640 1 --2- 172.21.15.53:0/1221447582 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f589c003980 0x7f589c003d90 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f58ac0098a0 tx=0x7f58ac01c570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbc4e9b58a87435a server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:39.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.529+0000 7f58a7fff640 1 -- 172.21.15.53:0/1221447582 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58ac0aa5f0 con 0x7f589c003980 2023-06-10T19:03:39.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.529+0000 7f58a7fff640 1 -- 172.21.15.53:0/1221447582 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58ac0aa750 con 0x7f589c003980 2023-06-10T19:03:39.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.529+0000 7f58a7fff640 1 -- 172.21.15.53:0/1221447582 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58ac0aaac0 con 0x7f589c003980 2023-06-10T19:03:39.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.529+0000 7f58b77d1640 1 -- 172.21.15.53:0/1221447582 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f589c003980 msgr2=0x7f589c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:39.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.529+0000 7f58b77d1640 1 --2- 172.21.15.53:0/1221447582 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f589c003980 0x7f589c003d90 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f58ac0098a0 tx=0x7f58ac01c570 comp rx=0 tx=0).stop 2023-06-10T19:03:39.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.529+0000 7f58b77d1640 1 -- 172.21.15.53:0/1221447582 shutdown_connections 2023-06-10T19:03:39.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.529+0000 7f58b77d1640 1 --2- 172.21.15.53:0/1221447582 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f589c003980 0x7f589c003d90 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:39.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.529+0000 7f58b77d1640 1 -- 172.21.15.53:0/1221447582 >> 172.21.15.53:0/1221447582 conn(0x7f58b006a0b0 msgr2=0x7f58b006d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:39.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.529+0000 7f58b77d1640 1 -- 172.21.15.53:0/1221447582 shutdown_connections 2023-06-10T19:03:39.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.529+0000 7f58b77d1640 1 -- 172.21.15.53:0/1221447582 wait complete. 2023-06-10T19:03:39.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.529+0000 7f58b77d1640 1 Processor -- start 2023-06-10T19:03:39.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.529+0000 7f58b77d1640 1 -- start start 2023-06-10T19:03:39.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.533+0000 7f58b77d1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f589c003980 0x7f58b0155760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:39.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.533+0000 7f58b77d1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58b01eb950 0x7f58b0158b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:39.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.533+0000 7f58b77d1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58b0156110 0x7f58b0159080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:39.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.533+0000 7f58b77d1640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58b0141f20 con 0x7f589c003980 2023-06-10T19:03:39.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.533+0000 7f58b77d1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58b01424e0 con 0x7f58b0156110 2023-06-10T19:03:39.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.533+0000 7f58b77d1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58b01ebdc0 con 0x7f58b01eb950 2023-06-10T19:03:39.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.533+0000 7f58b556d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f589c003980 0x7f58b0155760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:39.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.533+0000 7f58b556d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f589c003980 0x7f58b0155760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60138/0 (socket says 172.21.15.53:60138) 2023-06-10T19:03:39.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.533+0000 7f58b556d640 1 -- 172.21.15.53:0/538708966 learned_addr learned my addr 172.21.15.53:0/538708966 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:39.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.533+0000 7f58b556d640 1 -- 172.21.15.53:0/538708966 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58b01eb950 msgr2=0x7f58b0158b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:39.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.533+0000 7f58b4d6c640 1 --2- 172.21.15.53:0/538708966 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58b01eb950 0x7f58b0158b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:39.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.533+0000 7f58b5d6e640 1 --2- 172.21.15.53:0/538708966 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58b0156110 0x7f58b0159080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:39.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.533+0000 7f58b556d640 1 --2- 172.21.15.53:0/538708966 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58b01eb950 0x7f58b0158b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:39.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.533+0000 7f58b556d640 1 -- 172.21.15.53:0/538708966 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58b0156110 msgr2=0x7f58b0159080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:39.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.533+0000 7f58b556d640 1 --2- 172.21.15.53:0/538708966 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58b0156110 0x7f58b0159080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:39.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.533+0000 7f58b556d640 1 -- 172.21.15.53:0/538708966 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58b01ec0a0 con 0x7f589c003980 2023-06-10T19:03:39.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.533+0000 7f58b4d6c640 1 --2- 172.21.15.53:0/538708966 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58b01eb950 0x7f58b0158b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:03:39.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.533+0000 7f58b556d640 1 --2- 172.21.15.53:0/538708966 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f589c003980 0x7f58b0155760 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f58ac0ac040 tx=0x7f589c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:39.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.533+0000 7f58a5ffb640 1 -- 172.21.15.53:0/538708966 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58ac0aaa00 con 0x7f589c003980 2023-06-10T19:03:39.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.533+0000 7f58a5ffb640 1 -- 172.21.15.53:0/538708966 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58ac0aab60 con 0x7f589c003980 2023-06-10T19:03:39.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.533+0000 7f58b77d1640 1 -- 172.21.15.53:0/538708966 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58b0142170 con 0x7f589c003980 2023-06-10T19:03:39.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.533+0000 7f58a5ffb640 1 -- 172.21.15.53:0/538708966 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58ac0bc410 con 0x7f589c003980 2023-06-10T19:03:39.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.533+0000 7f58b77d1640 1 -- 172.21.15.53:0/538708966 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58b0155e70 con 0x7f589c003980 2023-06-10T19:03:39.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.533+0000 7f58b77d1640 1 -- 172.21.15.53:0/538708966 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58b004d790 con 0x7f589c003980 2023-06-10T19:03:39.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.533+0000 7f58a5ffb640 1 -- 172.21.15.53:0/538708966 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f58ac0b33f0 con 0x7f589c003980 2023-06-10T19:03:39.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.533+0000 7f58a5ffb640 1 --2- 172.21.15.53:0/538708966 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5894066280 0x7f5894068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:39.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.533+0000 7f58a5ffb640 1 -- 172.21.15.53:0/538708966 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5955+0+0 (secure 0 0 0) 0x7f58ac0a7070 con 0x7f589c003980 2023-06-10T19:03:39.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.533+0000 7f58b4d6c640 1 --2- 172.21.15.53:0/538708966 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5894066280 0x7f5894068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:39.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.537+0000 7f58b4d6c640 1 --2- 172.21.15.53:0/538708966 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5894066280 0x7f5894068730 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f58b015a680 tx=0x7f58a0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:39.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.537+0000 7f58a5ffb640 1 -- 172.21.15.53:0/538708966 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f58ac0eaec0 con 0x7f589c003980 2023-06-10T19:03:39.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:39.705+0000 7f58b77d1640 1 -- 172.21.15.53:0/538708966 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f58b0155e70 con 0x7f589c003980 2023-06-10T19:03:40.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.369+0000 7f58a5ffb640 1 -- 172.21.15.53:0/538708966 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v101) v1 ==== 169+0+0 (secure 0 0 0) 0x7f58b0155e70 con 0x7f589c003980 2023-06-10T19:03:40.373 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_data' removed 2023-06-10T19:03:40.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.373+0000 7f58b77d1640 1 -- 172.21.15.53:0/538708966 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5894066280 msgr2=0x7f5894068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:40.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.373+0000 7f58b77d1640 1 --2- 172.21.15.53:0/538708966 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5894066280 0x7f5894068730 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f58b015a680 tx=0x7f58a0009040 comp rx=0 tx=0).stop 2023-06-10T19:03:40.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.373+0000 7f58b77d1640 1 -- 172.21.15.53:0/538708966 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f589c003980 msgr2=0x7f58b0155760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:40.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.373+0000 7f58b77d1640 1 --2- 172.21.15.53:0/538708966 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f589c003980 0x7f58b0155760 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f58ac0ac040 tx=0x7f589c005800 comp rx=0 tx=0).stop 2023-06-10T19:03:40.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.373+0000 7f58b77d1640 1 -- 172.21.15.53:0/538708966 shutdown_connections 2023-06-10T19:03:40.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.373+0000 7f58b77d1640 1 --2- 172.21.15.53:0/538708966 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5894066280 0x7f5894068730 secure :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f58b015a680 tx=0x7f58a0009040 comp rx=0 tx=0).stop 2023-06-10T19:03:40.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.373+0000 7f58b77d1640 1 --2- 172.21.15.53:0/538708966 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58b0156110 0x7f58b0159080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:40.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.373+0000 7f58b77d1640 1 --2- 172.21.15.53:0/538708966 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58b01eb950 0x7f58b0158b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:40.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.373+0000 7f58b77d1640 1 --2- 172.21.15.53:0/538708966 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f589c003980 0x7f58b0155760 secure :-1 s=CLOSED pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f58ac0ac040 tx=0x7f589c005800 comp rx=0 tx=0).stop 2023-06-10T19:03:40.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.373+0000 7f58b77d1640 1 -- 172.21.15.53:0/538708966 >> 172.21.15.53:0/538708966 conn(0x7f58b006a0b0 msgr2=0x7f58b00c59b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:40.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.377+0000 7f58b77d1640 1 -- 172.21.15.53:0/538708966 shutdown_connections 2023-06-10T19:03:40.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.377+0000 7f58b77d1640 1 -- 172.21.15.53:0/538708966 wait complete. 2023-06-10T19:03:40.404 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-06-10T19:03:40.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.525+0000 7f711f834640 1 Processor -- start 2023-06-10T19:03:40.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.525+0000 7f711f834640 1 -- start start 2023-06-10T19:03:40.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.525+0000 7f711f834640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f71180ca920 0x7f7118166750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:40.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.525+0000 7f711f834640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f711815f1b0 con 0x7f71180b0710 2023-06-10T19:03:40.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.525+0000 7f711f834640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f711815bdd0 con 0x7f711815ede0 2023-06-10T19:03:40.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.525+0000 7f711f834640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7118156340 con 0x7f71180ca920 2023-06-10T19:03:40.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.525+0000 7f711cdcf640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f71180b0710 0x7f71180ca210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56416/0 (socket says 172.21.15.53:56416) 2023-06-10T19:03:40.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.525+0000 7f711cdcf640 1 -- 172.21.15.53:0/2369227934 learned_addr learned my addr 172.21.15.53:0/2369227934 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:03:40.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.525+0000 7f710ffff640 1 -- 172.21.15.53:0/2369227934 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2118101100 0 0) 0x7f7108001120 con 0x7f71180b0710 2023-06-10T19:03:40.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.525+0000 7f711ddd1640 1 --2- 172.21.15.53:0/2369227934 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f71180ca920 0x7f7118166750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:40.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.525+0000 7f710ffff640 1 -- 172.21.15.53:0/2369227934 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7104003530 con 0x7f71180b0710 2023-06-10T19:03:40.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.525+0000 7f710ffff640 1 -- 172.21.15.53:0/2369227934 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3945682804 0 0) 0x7f7104003530 con 0x7f71180b0710 2023-06-10T19:03:40.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.525+0000 7f710ffff640 1 -- 172.21.15.53:0/2369227934 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f71180ca920 msgr2=0x7f7118166750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:40.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.525+0000 7f710ffff640 1 --2- 172.21.15.53:0/2369227934 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f71180ca920 0x7f7118166750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:40.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.525+0000 7f710ffff640 1 -- 172.21.15.53:0/2369227934 >> v1:172.21.15.117:6789/0 conn(0x7f711815ede0 legacy=0x7f71180b0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:40.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.525+0000 7f710ffff640 1 -- 172.21.15.53:0/2369227934 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f711815c090 con 0x7f71180b0710 2023-06-10T19:03:40.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.525+0000 7f710ffff640 1 -- 172.21.15.53:0/2369227934 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f7108001810 con 0x7f71180b0710 2023-06-10T19:03:40.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.525+0000 7f710ffff640 1 -- 172.21.15.53:0/2369227934 >> v1:172.21.15.53:6789/0 conn(0x7f71180b0710 legacy=0x7f71180ca210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:40.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.525+0000 7f710ffff640 1 --2- 172.21.15.53:0/2369227934 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f71180ca920 0x7f71040039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:40.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.525+0000 7f710ffff640 1 --2- 172.21.15.53:0/2369227934 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7104003f30 0x7f71040047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:40.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.525+0000 7f710ffff640 1 --2- 172.21.15.53:0/2369227934 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7104004d10 0x7f7104005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:40.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.525+0000 7f710ffff640 1 -- 172.21.15.53:0/2369227934 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f710400ba40 con 0x7f7104004d10 2023-06-10T19:03:40.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.525+0000 7f710ffff640 1 -- 172.21.15.53:0/2369227934 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f710400bbb0 con 0x7f7104003f30 2023-06-10T19:03:40.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.525+0000 7f710ffff640 1 -- 172.21.15.53:0/2369227934 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f710400bd70 con 0x7f71180ca920 2023-06-10T19:03:40.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.525+0000 7f711ddd1640 1 --2- 172.21.15.53:0/2369227934 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7104004d10 0x7f7104005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:40.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.525+0000 7f711d5d0640 1 --2- 172.21.15.53:0/2369227934 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f71180ca920 0x7f71040039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:40.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.525+0000 7f711ddd1640 1 -- 172.21.15.53:0/2369227934 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f71180ca920 msgr2=0x7f71040039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:40.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.525+0000 7f711ddd1640 1 --2- 172.21.15.53:0/2369227934 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f71180ca920 0x7f71040039b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:40.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.525+0000 7f711ddd1640 1 -- 172.21.15.53:0/2369227934 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7104003f30 msgr2=0x7f71040047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:40.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.525+0000 7f711ddd1640 1 --2- 172.21.15.53:0/2369227934 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7104003f30 0x7f71040047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:40.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.525+0000 7f711ddd1640 1 -- 172.21.15.53:0/2369227934 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7104003530 con 0x7f7104004d10 2023-06-10T19:03:40.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.529+0000 7f711ddd1640 1 --2- 172.21.15.53:0/2369227934 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7104004d10 0x7f7104005180 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7f7110009ab0 tx=0x7f711001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d319bdfab1ab82ef server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:40.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.529+0000 7f710ffff640 1 -- 172.21.15.53:0/2369227934 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71100a5620 con 0x7f7104004d10 2023-06-10T19:03:40.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.529+0000 7f710ffff640 1 -- 172.21.15.53:0/2369227934 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71100a5780 con 0x7f7104004d10 2023-06-10T19:03:40.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.529+0000 7f710ffff640 1 -- 172.21.15.53:0/2369227934 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71100a5b30 con 0x7f7104004d10 2023-06-10T19:03:40.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.529+0000 7f711f834640 1 -- 172.21.15.53:0/2369227934 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7104004d10 msgr2=0x7f7104005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:40.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.529+0000 7f711f834640 1 --2- 172.21.15.53:0/2369227934 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7104004d10 0x7f7104005180 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7f7110009ab0 tx=0x7f711001ca30 comp rx=0 tx=0).stop 2023-06-10T19:03:40.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.529+0000 7f711ddd1640 1 -- 172.21.15.53:0/2369227934 reap_dead start 2023-06-10T19:03:40.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.529+0000 7f711f834640 1 -- 172.21.15.53:0/2369227934 shutdown_connections 2023-06-10T19:03:40.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.529+0000 7f711f834640 1 -- 172.21.15.53:0/2369227934 >> 172.21.15.53:0/2369227934 conn(0x7f71180cb000 msgr2=0x7f71180cb400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:40.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.529+0000 7f711f834640 1 -- 172.21.15.53:0/2369227934 shutdown_connections 2023-06-10T19:03:40.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.529+0000 7f711f834640 1 -- 172.21.15.53:0/2369227934 wait complete. 2023-06-10T19:03:40.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.533+0000 7f711f834640 1 Processor -- start 2023-06-10T19:03:40.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.533+0000 7f711f834640 1 -- start start 2023-06-10T19:03:40.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.533+0000 7f711f834640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7104004d10 0x7f71180c7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:40.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.533+0000 7f711f834640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7118150ca0 0x7f71181f4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:40.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.533+0000 7f711f834640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71181f5200 0x7f71180b14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:40.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.533+0000 7f711f834640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71181f56a0 con 0x7f7104004d10 2023-06-10T19:03:40.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.533+0000 7f711f834640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71180c5650 con 0x7f71181f5200 2023-06-10T19:03:40.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.533+0000 7f711f834640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71180ae7f0 con 0x7f7118150ca0 2023-06-10T19:03:40.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.533+0000 7f711d5d0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7104004d10 0x7f71180c7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:40.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.533+0000 7f711d5d0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7104004d10 0x7f71180c7c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60162/0 (socket says 172.21.15.53:60162) 2023-06-10T19:03:40.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.533+0000 7f711d5d0640 1 -- 172.21.15.53:0/4010403587 learned_addr learned my addr 172.21.15.53:0/4010403587 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:40.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.533+0000 7f711cdcf640 1 --2- 172.21.15.53:0/4010403587 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7118150ca0 0x7f71181f4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:40.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.533+0000 7f711d5d0640 1 -- 172.21.15.53:0/4010403587 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7118150ca0 msgr2=0x7f71181f4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:40.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.533+0000 7f711d5d0640 1 --2- 172.21.15.53:0/4010403587 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7118150ca0 0x7f71181f4cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:40.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.533+0000 7f711d5d0640 1 -- 172.21.15.53:0/4010403587 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71181f5200 msgr2=0x7f71180b14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:40.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.533+0000 7f711ddd1640 1 --2- 172.21.15.53:0/4010403587 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71181f5200 0x7f71180b14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:40.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.533+0000 7f711d5d0640 1 --2- 172.21.15.53:0/4010403587 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71181f5200 0x7f71180b14f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:40.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.533+0000 7f711d5d0640 1 -- 172.21.15.53:0/4010403587 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71180aead0 con 0x7f7104004d10 2023-06-10T19:03:40.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.533+0000 7f711d5d0640 1 --2- 172.21.15.53:0/4010403587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7104004d10 0x7f71180c7c70 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7f711400d900 tx=0x7f711400ddc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:40.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.533+0000 7f710dffb640 1 -- 172.21.15.53:0/4010403587 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7114003db0 con 0x7f7104004d10 2023-06-10T19:03:40.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.533+0000 7f710dffb640 1 -- 172.21.15.53:0/4010403587 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f711400b770 con 0x7f7104004d10 2023-06-10T19:03:40.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.533+0000 7f710dffb640 1 -- 172.21.15.53:0/4010403587 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711400bae0 con 0x7f7104004d10 2023-06-10T19:03:40.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.533+0000 7f711f834640 1 -- 172.21.15.53:0/4010403587 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71180aedb0 con 0x7f7104004d10 2023-06-10T19:03:40.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.533+0000 7f711f834640 1 -- 172.21.15.53:0/4010403587 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71180af370 con 0x7f7104004d10 2023-06-10T19:03:40.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.533+0000 7f711f834640 1 -- 172.21.15.53:0/4010403587 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f711804d790 con 0x7f7104004d10 2023-06-10T19:03:40.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.533+0000 7f710dffb640 1 -- 172.21.15.53:0/4010403587 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f711400bc40 con 0x7f7104004d10 2023-06-10T19:03:40.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.537+0000 7f710dffb640 1 --2- 172.21.15.53:0/4010403587 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f70fc066280 0x7f70fc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:40.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.537+0000 7f710dffb640 1 -- 172.21.15.53:0/4010403587 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5425+0+0 (secure 0 0 0) 0x7f7114083df0 con 0x7f7104004d10 2023-06-10T19:03:40.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.537+0000 7f711cdcf640 1 --2- 172.21.15.53:0/4010403587 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f70fc066280 0x7f70fc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:40.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.537+0000 7f711cdcf640 1 --2- 172.21.15.53:0/4010403587 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f70fc066280 0x7f70fc068730 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f7108001940 tx=0x7f7108009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:40.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.541+0000 7f710dffb640 1 -- 172.21.15.53:0/4010403587 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7114051450 con 0x7f7104004d10 2023-06-10T19:03:40.697 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.693+0000 7f711f834640 1 -- 172.21.15.53:0/4010403587 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f71180727c0 con 0x7f7104004d10 2023-06-10T19:03:40.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.701+0000 7f710dffb640 1 -- 172.21.15.53:0/4010403587 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7f7114054a70 con 0x7f7104004d10 2023-06-10T19:03:40.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.705+0000 7f711f834640 1 -- 172.21.15.53:0/4010403587 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f70fc066280 msgr2=0x7f70fc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:40.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.705+0000 7f711f834640 1 --2- 172.21.15.53:0/4010403587 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f70fc066280 0x7f70fc068730 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f7108001940 tx=0x7f7108009040 comp rx=0 tx=0).stop 2023-06-10T19:03:40.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.705+0000 7f711f834640 1 -- 172.21.15.53:0/4010403587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7104004d10 msgr2=0x7f71180c7c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:40.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.705+0000 7f711f834640 1 --2- 172.21.15.53:0/4010403587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7104004d10 0x7f71180c7c70 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7f711400d900 tx=0x7f711400ddc0 comp rx=0 tx=0).stop 2023-06-10T19:03:40.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.705+0000 7f711f834640 1 -- 172.21.15.53:0/4010403587 shutdown_connections 2023-06-10T19:03:40.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.705+0000 7f711f834640 1 --2- 172.21.15.53:0/4010403587 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f70fc066280 0x7f70fc068730 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:40.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.705+0000 7f711f834640 1 --2- 172.21.15.53:0/4010403587 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71181f5200 0x7f71180b14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:40.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.705+0000 7f711f834640 1 --2- 172.21.15.53:0/4010403587 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7118150ca0 0x7f71181f4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:40.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.705+0000 7f711f834640 1 --2- 172.21.15.53:0/4010403587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7104004d10 0x7f71180c7c70 unknown :-1 s=CLOSED pgs=1666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:40.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.705+0000 7f711f834640 1 -- 172.21.15.53:0/4010403587 >> 172.21.15.53:0/4010403587 conn(0x7f71180cb000 msgr2=0x7f71180ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:40.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.705+0000 7f711f834640 1 -- 172.21.15.53:0/4010403587 shutdown_connections 2023-06-10T19:03:40.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.705+0000 7f711f834640 1 -- 172.21.15.53:0/4010403587 wait complete. 2023-06-10T19:03:40.725 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_dir_fsync' 2023-06-10T19:03:40.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.845+0000 7f18ea4a3640 1 Processor -- start 2023-06-10T19:03:40.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.845+0000 7f18ea4a3640 1 -- start start 2023-06-10T19:03:40.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.845+0000 7f18ea4a3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18e406a570 0x7f18e4163570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:40.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.845+0000 7f18ea4a3640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18e40ccf20 con 0x7f18e41586b0 2023-06-10T19:03:40.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.845+0000 7f18ea4a3640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18e406aa70 con 0x7f18e415c950 2023-06-10T19:03:40.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.845+0000 7f18ea4a3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18e40cc4c0 con 0x7f18e406a570 2023-06-10T19:03:40.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.845+0000 7f18e3fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f18e41586b0 0x7f18e415c240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56426/0 (socket says 172.21.15.53:56426) 2023-06-10T19:03:40.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.845+0000 7f18e3fff640 1 -- 172.21.15.53:0/2700398651 learned_addr learned my addr 172.21.15.53:0/2700398651 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:03:40.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.849+0000 7f18e8a40640 1 --2- 172.21.15.53:0/2700398651 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18e406a570 0x7f18e4163570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:40.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.849+0000 7f18e37fe640 1 -- 172.21.15.53:0/2700398651 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1201116524 0 0) 0x7f18e40ccf20 con 0x7f18e41586b0 2023-06-10T19:03:40.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.849+0000 7f18e37fe640 1 -- 172.21.15.53:0/2700398651 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18d0003530 con 0x7f18e41586b0 2023-06-10T19:03:40.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.849+0000 7f18e37fe640 1 -- 172.21.15.53:0/2700398651 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 686651908 0 0) 0x7f18d0003530 con 0x7f18e41586b0 2023-06-10T19:03:40.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.849+0000 7f18e37fe640 1 -- 172.21.15.53:0/2700398651 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18e406a570 msgr2=0x7f18e4163570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:40.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.849+0000 7f18e37fe640 1 --2- 172.21.15.53:0/2700398651 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18e406a570 0x7f18e4163570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:40.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.849+0000 7f18e37fe640 1 -- 172.21.15.53:0/2700398651 >> v1:172.21.15.117:6789/0 conn(0x7f18e415c950 legacy=0x7f18e4069e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:40.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.849+0000 7f18e37fe640 1 -- 172.21.15.53:0/2700398651 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e40cc8d0 con 0x7f18e41586b0 2023-06-10T19:03:40.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.849+0000 7f18e37fe640 1 -- 172.21.15.53:0/2700398651 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f18d4001680 con 0x7f18e41586b0 2023-06-10T19:03:40.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.849+0000 7f18e37fe640 1 -- 172.21.15.53:0/2700398651 >> v1:172.21.15.53:6789/0 conn(0x7f18e41586b0 legacy=0x7f18e415c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:40.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.849+0000 7f18e37fe640 1 --2- 172.21.15.53:0/2700398651 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18d0003a20 0x7f18d0003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:40.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.849+0000 7f18e37fe640 1 --2- 172.21.15.53:0/2700398651 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18e406a570 0x7f18d00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:40.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.849+0000 7f18e37fe640 1 --2- 172.21.15.53:0/2700398651 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f18d0004d10 0x7f18d0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:40.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.849+0000 7f18e37fe640 1 -- 172.21.15.53:0/2700398651 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e40cc4c0 con 0x7f18d0004d10 2023-06-10T19:03:40.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.849+0000 7f18e37fe640 1 -- 172.21.15.53:0/2700398651 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d000bb00 con 0x7f18d0003a20 2023-06-10T19:03:40.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.849+0000 7f18e37fe640 1 -- 172.21.15.53:0/2700398651 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18d000bcc0 con 0x7f18e406a570 2023-06-10T19:03:40.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.849+0000 7f18e8a40640 1 --2- 172.21.15.53:0/2700398651 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f18d0004d10 0x7f18d0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:40.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.849+0000 7f18e3fff640 1 --2- 172.21.15.53:0/2700398651 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18d0003a20 0x7f18d0003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:40.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.849+0000 7f18dbfff640 1 --2- 172.21.15.53:0/2700398651 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18e406a570 0x7f18d00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:40.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.849+0000 7f18e8a40640 1 -- 172.21.15.53:0/2700398651 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18e406a570 msgr2=0x7f18d00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:40.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.849+0000 7f18e8a40640 1 --2- 172.21.15.53:0/2700398651 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18e406a570 0x7f18d00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:40.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.849+0000 7f18e8a40640 1 -- 172.21.15.53:0/2700398651 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18d0003a20 msgr2=0x7f18d0003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:40.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.849+0000 7f18e8a40640 1 --2- 172.21.15.53:0/2700398651 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18d0003a20 0x7f18d0003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:40.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.849+0000 7f18e8a40640 1 -- 172.21.15.53:0/2700398651 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d0003530 con 0x7f18d0004d10 2023-06-10T19:03:40.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.849+0000 7f18e8a40640 1 --2- 172.21.15.53:0/2700398651 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f18d0004d10 0x7f18d0005180 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7f18dc009fc0 tx=0x7f18dc01cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6be4926927290db server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:40.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.849+0000 7f18e37fe640 1 -- 172.21.15.53:0/2700398651 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18dc0a5c70 con 0x7f18d0004d10 2023-06-10T19:03:40.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.849+0000 7f18e37fe640 1 -- 172.21.15.53:0/2700398651 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18dc00f040 con 0x7f18d0004d10 2023-06-10T19:03:40.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.849+0000 7f18e37fe640 1 -- 172.21.15.53:0/2700398651 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18dc0ad440 con 0x7f18d0004d10 2023-06-10T19:03:40.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.849+0000 7f18ea4a3640 1 -- 172.21.15.53:0/2700398651 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f18d0004d10 msgr2=0x7f18d0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:40.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.849+0000 7f18ea4a3640 1 --2- 172.21.15.53:0/2700398651 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f18d0004d10 0x7f18d0005180 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7f18dc009fc0 tx=0x7f18dc01cc60 comp rx=0 tx=0).stop 2023-06-10T19:03:40.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.849+0000 7f18e8a40640 1 -- 172.21.15.53:0/2700398651 reap_dead start 2023-06-10T19:03:40.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.849+0000 7f18ea4a3640 1 -- 172.21.15.53:0/2700398651 shutdown_connections 2023-06-10T19:03:40.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.849+0000 7f18ea4a3640 1 -- 172.21.15.53:0/2700398651 >> 172.21.15.53:0/2700398651 conn(0x7f18e40cafc0 msgr2=0x7f18e40cb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:40.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.853+0000 7f18ea4a3640 1 -- 172.21.15.53:0/2700398651 shutdown_connections 2023-06-10T19:03:40.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.853+0000 7f18ea4a3640 1 -- 172.21.15.53:0/2700398651 wait complete. 2023-06-10T19:03:40.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.853+0000 7f18ea4a3640 1 Processor -- start 2023-06-10T19:03:40.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.853+0000 7f18ea4a3640 1 -- start start 2023-06-10T19:03:40.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.853+0000 7f18ea4a3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f18e40c49c0 0x7f18e41f3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:40.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.853+0000 7f18ea4a3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18e415a060 0x7f18e40c7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:40.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.853+0000 7f18ea4a3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18e40c7d90 0x7f18e40b0030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:40.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.853+0000 7f18ea4a3640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e40c8200 con 0x7f18e40c49c0 2023-06-10T19:03:40.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.853+0000 7f18ea4a3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e415a870 con 0x7f18e40c7d90 2023-06-10T19:03:40.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.853+0000 7f18ea4a3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18e415ab50 con 0x7f18e415a060 2023-06-10T19:03:40.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.853+0000 7f18e3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f18e40c49c0 0x7f18e41f3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:40.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.853+0000 7f18e3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f18e40c49c0 0x7f18e41f3240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60178/0 (socket says 172.21.15.53:60178) 2023-06-10T19:03:40.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.853+0000 7f18e3fff640 1 -- 172.21.15.53:0/2165125389 learned_addr learned my addr 172.21.15.53:0/2165125389 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:40.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.853+0000 7f18dbfff640 1 --2- 172.21.15.53:0/2165125389 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18e415a060 0x7f18e40c7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:40.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.853+0000 7f18e8a40640 1 --2- 172.21.15.53:0/2165125389 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18e40c7d90 0x7f18e40b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:40.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.853+0000 7f18e3fff640 1 -- 172.21.15.53:0/2165125389 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18e415a060 msgr2=0x7f18e40c7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:40.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.853+0000 7f18e3fff640 1 --2- 172.21.15.53:0/2165125389 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18e415a060 0x7f18e40c7850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:40.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.853+0000 7f18e3fff640 1 -- 172.21.15.53:0/2165125389 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18e40c7d90 msgr2=0x7f18e40b0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:40.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.853+0000 7f18e3fff640 1 --2- 172.21.15.53:0/2165125389 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18e40c7d90 0x7f18e40b0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:40.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.853+0000 7f18e3fff640 1 -- 172.21.15.53:0/2165125389 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e415ae30 con 0x7f18e40c49c0 2023-06-10T19:03:40.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.853+0000 7f18e8a40640 1 --2- 172.21.15.53:0/2165125389 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18e40c7d90 0x7f18e40b0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:03:40.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.853+0000 7f18e3fff640 1 --2- 172.21.15.53:0/2165125389 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f18e40c49c0 0x7f18e41f3240 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7f18d4007290 tx=0x7f18d4004f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:40.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.853+0000 7f18e17fa640 1 -- 172.21.15.53:0/2165125389 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d400f9c0 con 0x7f18e40c49c0 2023-06-10T19:03:40.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.853+0000 7f18e17fa640 1 -- 172.21.15.53:0/2165125389 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18d400fb20 con 0x7f18e40c49c0 2023-06-10T19:03:40.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.853+0000 7f18ea4a3640 1 -- 172.21.15.53:0/2165125389 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18e415b110 con 0x7f18e40c49c0 2023-06-10T19:03:40.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.853+0000 7f18e17fa640 1 -- 172.21.15.53:0/2165125389 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d400fed0 con 0x7f18e40c49c0 2023-06-10T19:03:40.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.853+0000 7f18ea4a3640 1 -- 172.21.15.53:0/2165125389 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18e415a4d0 con 0x7f18e40c49c0 2023-06-10T19:03:40.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.853+0000 7f18ea4a3640 1 -- 172.21.15.53:0/2165125389 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18e404d790 con 0x7f18e40c49c0 2023-06-10T19:03:40.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.857+0000 7f18e17fa640 1 -- 172.21.15.53:0/2165125389 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f18d401d460 con 0x7f18e40c49c0 2023-06-10T19:03:40.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.857+0000 7f18e17fa640 1 --2- 172.21.15.53:0/2165125389 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f18c4066280 0x7f18c4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:40.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.857+0000 7f18e17fa640 1 -- 172.21.15.53:0/2165125389 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5425+0+0 (secure 0 0 0) 0x7f18d4083e50 con 0x7f18e40c49c0 2023-06-10T19:03:40.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.857+0000 7f18dbfff640 1 --2- 172.21.15.53:0/2165125389 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f18c4066280 0x7f18c4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:40.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.857+0000 7f18dbfff640 1 --2- 172.21.15.53:0/2165125389 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f18c4066280 0x7f18c4068730 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f18e4155d70 tx=0x7f18cc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:40.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:40.861+0000 7f18e17fa640 1 -- 172.21.15.53:0/2165125389 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f18d40514a0 con 0x7f18e40c49c0 2023-06-10T19:03:41.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:41.073+0000 7f18ea4a3640 1 -- 172.21.15.53:0/2165125389 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_dir_fsync"]} v 0) v1 -- 0x7f18e40b44c0 con 0x7f18e40c49c0 2023-06-10T19:03:41.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:41.393+0000 7f18e17fa640 1 -- 172.21.15.53:0/2165125389 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_dir_fsync"]}]=0 v516) v1 ==== 146+0+0 (secure 0 0 0) 0x7f18d4054ac0 con 0x7f18e40c49c0 2023-06-10T19:03:41.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:41.397+0000 7f18ea4a3640 1 -- 172.21.15.53:0/2165125389 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f18c4066280 msgr2=0x7f18c4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:41.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:41.397+0000 7f18ea4a3640 1 --2- 172.21.15.53:0/2165125389 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f18c4066280 0x7f18c4068730 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f18e4155d70 tx=0x7f18cc009040 comp rx=0 tx=0).stop 2023-06-10T19:03:41.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:41.397+0000 7f18ea4a3640 1 -- 172.21.15.53:0/2165125389 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f18e40c49c0 msgr2=0x7f18e41f3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:41.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:41.397+0000 7f18ea4a3640 1 --2- 172.21.15.53:0/2165125389 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f18e40c49c0 0x7f18e41f3240 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7f18d4007290 tx=0x7f18d4004f90 comp rx=0 tx=0).stop 2023-06-10T19:03:41.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:41.397+0000 7f18ea4a3640 1 -- 172.21.15.53:0/2165125389 shutdown_connections 2023-06-10T19:03:41.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:41.397+0000 7f18ea4a3640 1 --2- 172.21.15.53:0/2165125389 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f18c4066280 0x7f18c4068730 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:41.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:41.397+0000 7f18ea4a3640 1 --2- 172.21.15.53:0/2165125389 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18e40c7d90 0x7f18e40b0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:41.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:41.397+0000 7f18ea4a3640 1 --2- 172.21.15.53:0/2165125389 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18e415a060 0x7f18e40c7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:41.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:41.397+0000 7f18ea4a3640 1 --2- 172.21.15.53:0/2165125389 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f18e40c49c0 0x7f18e41f3240 unknown :-1 s=CLOSED pgs=1669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:41.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:41.397+0000 7f18ea4a3640 1 -- 172.21.15.53:0/2165125389 >> 172.21.15.53:0/2165125389 conn(0x7f18e40cafc0 msgr2=0x7f18e4156f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:41.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:41.397+0000 7f18ea4a3640 1 -- 172.21.15.53:0/2165125389 shutdown_connections 2023-06-10T19:03:41.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:41.397+0000 7f18ea4a3640 1 -- 172.21.15.53:0/2165125389 wait complete. 2023-06-10T19:03:41.423 INFO:tasks.cephfs_test_runner:test_dir_fsync (tasks.cephfs.test_client_recovery.TestClientRecovery) ... ok 2023-06-10T19:03:41.423 INFO:tasks.cephfs_test_runner:Starting test: test_dont_mark_unresponsive_client_stale (tasks.cephfs.test_client_recovery.TestClientRecovery) 2023-06-10T19:03:41.424 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_dont_mark_unresponsive_client_stale' 2023-06-10T19:03:41.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:41.549+0000 7fc7fa316640 1 Processor -- start 2023-06-10T19:03:41.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:41.549+0000 7fc7fa316640 1 -- start start 2023-06-10T19:03:41.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:41.553+0000 7fc7fa316640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc7f40b3ac0 0x7fc7f40b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:41.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:41.553+0000 7fc7fa316640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc7f40d14c0 0x7fc7f415fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:41.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:41.553+0000 7fc7fa316640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7f40d0020 con 0x7fc7f40cc690 2023-06-10T19:03:41.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:41.553+0000 7fc7fa316640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7f40b43d0 con 0x7fc7f40b3ac0 2023-06-10T19:03:41.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:41.553+0000 7fc7fa316640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7f40cef40 con 0x7fc7f40d14c0 2023-06-10T19:03:41.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:41.553+0000 7fc7f3fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc7f40b3ac0 0x7fc7f40b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:41.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:41.553+0000 7fc7ebfff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fc7f40cc690 0x7fc7f415f370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60436/0 (socket says 172.21.15.53:60436) 2023-06-10T19:03:41.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:41.553+0000 7fc7ebfff640 1 -- 172.21.15.53:0/265212407 learned_addr learned my addr 172.21.15.53:0/265212407 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:03:41.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:41.553+0000 7fc7f88b3640 1 --2- 172.21.15.53:0/265212407 >> v2:172.21.15.117:3300/0 conn(0x7fc7f40d14c0 0x7fc7f415fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:41.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:41.553+0000 7fc7f37fe640 1 -- 172.21.15.53:0/265212407 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3397007758 0 0) 0x7fc7f40d0020 con 0x7fc7f40cc690 2023-06-10T19:03:41.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:41.553+0000 7fc7f37fe640 1 -- 172.21.15.53:0/265212407 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7e0003530 con 0x7fc7f40cc690 2023-06-10T19:03:41.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:41.553+0000 7fc7f3fff640 1 -- 172.21.15.53:0/265212407 >> v2:172.21.15.117:3300/0 conn(0x7fc7f40d14c0 msgr2=0x7fc7f415fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:41.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:41.553+0000 7fc7f3fff640 1 --2- 172.21.15.53:0/265212407 >> v2:172.21.15.117:3300/0 conn(0x7fc7f40d14c0 0x7fc7f415fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:41.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:41.553+0000 7fc7f3fff640 1 -- 172.21.15.53:0/265212407 >> v1:172.21.15.53:6789/0 conn(0x7fc7f40cc690 legacy=0x7fc7f415f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:41.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:41.553+0000 7fc7f3fff640 1 -- 172.21.15.53:0/265212407 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7f40cf220 con 0x7fc7f40b3ac0 2023-06-10T19:03:41.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:41.553+0000 7fc7f3fff640 1 --2- 172.21.15.53:0/265212407 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7f40b3ac0 0x7fc7f40b3e90 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7fc7f4160410 tx=0x7fc7e401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95cd072c37f23d91 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:41.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:41.557+0000 7fc7f37fe640 1 -- 172.21.15.53:0/265212407 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e40ab600 con 0x7fc7f40b3ac0 2023-06-10T19:03:41.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:41.557+0000 7fc7f37fe640 1 -- 172.21.15.53:0/265212407 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7e40a7050 con 0x7fc7f40b3ac0 2023-06-10T19:03:41.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:41.557+0000 7fc7f37fe640 1 -- 172.21.15.53:0/265212407 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e40ab980 con 0x7fc7f40b3ac0 2023-06-10T19:03:41.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:41.557+0000 7fc7fa316640 1 -- 172.21.15.53:0/265212407 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7f40b3ac0 msgr2=0x7fc7f40b3e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:41.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:41.557+0000 7fc7fa316640 1 --2- 172.21.15.53:0/265212407 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7f40b3ac0 0x7fc7f40b3e90 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7fc7f4160410 tx=0x7fc7e401c430 comp rx=0 tx=0).stop 2023-06-10T19:03:41.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:41.557+0000 7fc7fa316640 1 -- 172.21.15.53:0/265212407 shutdown_connections 2023-06-10T19:03:41.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:41.557+0000 7fc7fa316640 1 --2- 172.21.15.53:0/265212407 >> v2:172.21.15.117:3300/0 conn(0x7fc7f40d14c0 0x7fc7f415fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:41.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:41.557+0000 7fc7fa316640 1 --2- 172.21.15.53:0/265212407 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7f40b3ac0 0x7fc7f40b3e90 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:41.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:41.557+0000 7fc7fa316640 1 -- 172.21.15.53:0/265212407 >> 172.21.15.53:0/265212407 conn(0x7fc7f4071790 msgr2=0x7fc7f4069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:41.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:41.557+0000 7fc7fa316640 1 -- 172.21.15.53:0/265212407 shutdown_connections 2023-06-10T19:03:41.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:41.557+0000 7fc7fa316640 1 -- 172.21.15.53:0/265212407 wait complete. 2023-06-10T19:03:41.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:41.557+0000 7fc7fa316640 1 Processor -- start 2023-06-10T19:03:41.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:41.557+0000 7fc7fa316640 1 -- start start 2023-06-10T19:03:41.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:41.557+0000 7fc7fa316640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7f40b3ac0 0x7fc7f4152060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:41.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:41.557+0000 7fc7fa316640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7f40cc690 0x7fc7f40b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:41.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:41.557+0000 7fc7fa316640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7f40d14c0 0x7fc7f40caa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:41.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:41.557+0000 7fc7fa316640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f41525a0 con 0x7fc7f40cc690 2023-06-10T19:03:41.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:41.557+0000 7fc7fa316640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f40b23f0 con 0x7fc7f40d14c0 2023-06-10T19:03:41.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:41.557+0000 7fc7fa316640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f40b26d0 con 0x7fc7f40b3ac0 2023-06-10T19:03:41.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:41.557+0000 7fc7ebfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7f40cc690 0x7fc7f40b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:41.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:41.557+0000 7fc7ebfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7f40cc690 0x7fc7f40b1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56696/0 (socket says 172.21.15.53:56696) 2023-06-10T19:03:41.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:41.557+0000 7fc7ebfff640 1 -- 172.21.15.53:0/4095842861 learned_addr learned my addr 172.21.15.53:0/4095842861 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:41.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:41.557+0000 7fc7f88b3640 1 --2- 172.21.15.53:0/4095842861 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7f40d14c0 0x7fc7f40caa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:41.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:41.557+0000 7fc7f3fff640 1 --2- 172.21.15.53:0/4095842861 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7f40b3ac0 0x7fc7f4152060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:41.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:41.557+0000 7fc7ebfff640 1 -- 172.21.15.53:0/4095842861 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7f40b3ac0 msgr2=0x7fc7f4152060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:41.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:41.557+0000 7fc7ebfff640 1 --2- 172.21.15.53:0/4095842861 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7f40b3ac0 0x7fc7f4152060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:41.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:41.557+0000 7fc7ebfff640 1 -- 172.21.15.53:0/4095842861 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7f40d14c0 msgr2=0x7fc7f40caa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:41.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:41.557+0000 7fc7ebfff640 1 --2- 172.21.15.53:0/4095842861 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7f40d14c0 0x7fc7f40caa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:41.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:41.557+0000 7fc7ebfff640 1 -- 172.21.15.53:0/4095842861 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7e4009420 con 0x7fc7f40cc690 2023-06-10T19:03:41.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:41.557+0000 7fc7ebfff640 1 --2- 172.21.15.53:0/4095842861 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7f40cc690 0x7fc7f40b1bc0 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc00c4d0 tx=0x7fc7dc00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:41.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:41.557+0000 7fc7f17fa640 1 -- 172.21.15.53:0/4095842861 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc005cf0 con 0x7fc7f40cc690 2023-06-10T19:03:41.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:41.557+0000 7fc7f17fa640 1 -- 172.21.15.53:0/4095842861 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7dc005e50 con 0x7fc7f40cc690 2023-06-10T19:03:41.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:41.557+0000 7fc7f17fa640 1 -- 172.21.15.53:0/4095842861 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc007270 con 0x7fc7f40cc690 2023-06-10T19:03:41.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:41.557+0000 7fc7fa316640 1 -- 172.21.15.53:0/4095842861 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7f40b29b0 con 0x7fc7f40cc690 2023-06-10T19:03:41.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:41.557+0000 7fc7fa316640 1 -- 172.21.15.53:0/4095842861 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7f40b2f70 con 0x7fc7f40cc690 2023-06-10T19:03:41.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:41.561+0000 7fc7fa316640 1 -- 172.21.15.53:0/4095842861 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7f404d790 con 0x7fc7f40cc690 2023-06-10T19:03:41.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:41.561+0000 7fc7f17fa640 1 -- 172.21.15.53:0/4095842861 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc7dc0073d0 con 0x7fc7f40cc690 2023-06-10T19:03:41.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:41.561+0000 7fc7f17fa640 1 --2- 172.21.15.53:0/4095842861 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc7d4066280 0x7fc7d4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:41.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:41.561+0000 7fc7f17fa640 1 -- 172.21.15.53:0/4095842861 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5425+0+0 (secure 0 0 0) 0x7fc7dc083080 con 0x7fc7f40cc690 2023-06-10T19:03:41.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:41.561+0000 7fc7f3fff640 1 --2- 172.21.15.53:0/4095842861 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc7d4066280 0x7fc7d4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:41.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:41.561+0000 7fc7f3fff640 1 --2- 172.21.15.53:0/4095842861 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc7d4066280 0x7fc7d4068730 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fc7f408aa80 tx=0x7fc7e4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:41.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:41.565+0000 7fc7f17fa640 1 -- 172.21.15.53:0/4095842861 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc7dc0b3700 con 0x7fc7f40cc690 2023-06-10T19:03:41.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:41.773+0000 7fc7fa316640 1 -- 172.21.15.53:0/4095842861 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_dont_mark_unresponsive_client_stale"]} v 0) v1 -- 0x7fc7f408a200 con 0x7fc7f40cc690 2023-06-10T19:03:42.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.405+0000 7fc7f17fa640 1 -- 172.21.15.53:0/4095842861 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_dont_mark_unresponsive_client_stale"]}]=0 v517) v1 ==== 175+0+0 (secure 0 0 0) 0x7fc7dc0170f0 con 0x7fc7f40cc690 2023-06-10T19:03:42.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.409+0000 7fc7fa316640 1 -- 172.21.15.53:0/4095842861 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc7d4066280 msgr2=0x7fc7d4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:42.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.409+0000 7fc7fa316640 1 --2- 172.21.15.53:0/4095842861 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc7d4066280 0x7fc7d4068730 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fc7f408aa80 tx=0x7fc7e4008040 comp rx=0 tx=0).stop 2023-06-10T19:03:42.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.409+0000 7fc7fa316640 1 -- 172.21.15.53:0/4095842861 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7f40cc690 msgr2=0x7fc7f40b1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:42.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.409+0000 7fc7fa316640 1 --2- 172.21.15.53:0/4095842861 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7f40cc690 0x7fc7f40b1bc0 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc00c4d0 tx=0x7fc7dc00c990 comp rx=0 tx=0).stop 2023-06-10T19:03:42.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.409+0000 7fc7fa316640 1 -- 172.21.15.53:0/4095842861 shutdown_connections 2023-06-10T19:03:42.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.409+0000 7fc7fa316640 1 --2- 172.21.15.53:0/4095842861 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc7d4066280 0x7fc7d4068730 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:42.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.409+0000 7fc7fa316640 1 --2- 172.21.15.53:0/4095842861 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7f40d14c0 0x7fc7f40caa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:42.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.409+0000 7fc7fa316640 1 --2- 172.21.15.53:0/4095842861 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7f40cc690 0x7fc7f40b1bc0 unknown :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:42.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.409+0000 7fc7fa316640 1 --2- 172.21.15.53:0/4095842861 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7f40b3ac0 0x7fc7f4152060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:42.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.409+0000 7fc7fa316640 1 -- 172.21.15.53:0/4095842861 >> 172.21.15.53:0/4095842861 conn(0x7fc7f4071790 msgr2=0x7fc7f415fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:42.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.409+0000 7fc7fa316640 1 -- 172.21.15.53:0/4095842861 shutdown_connections 2023-06-10T19:03:42.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.409+0000 7fc7fa316640 1 -- 172.21.15.53:0/4095842861 wait complete. 2023-06-10T19:03:42.434 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-06-10T19:03:42.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.557+0000 7faae09b1640 1 Processor -- start 2023-06-10T19:03:42.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.557+0000 7faae09b1640 1 -- start start 2023-06-10T19:03:42.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.557+0000 7faae09b1640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7faadc0cc690 0x7faadc0d04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:42.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.557+0000 7faae09b1640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faadc0d0020 con 0x7faadc0ccae0 2023-06-10T19:03:42.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.557+0000 7faae09b1640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faadc0cef40 con 0x7faadc0b3ac0 2023-06-10T19:03:42.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.557+0000 7faae09b1640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faadc0cf220 con 0x7faadc0cc690 2023-06-10T19:03:42.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.557+0000 7faadad9d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7faadc0ccae0 0x7faadc0d09f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60442/0 (socket says 172.21.15.53:60442) 2023-06-10T19:03:42.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.557+0000 7faadad9d640 1 -- 172.21.15.53:0/2046393515 learned_addr learned my addr 172.21.15.53:0/2046393515 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:03:42.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.557+0000 7faad3fff640 1 --2- 172.21.15.53:0/2046393515 >> v2:172.21.15.117:3300/0 conn(0x7faadc0cc690 0x7faadc0d04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:42.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.557+0000 7faad9d9b640 1 -- 172.21.15.53:0/2046393515 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3811383197 0 0) 0x7faadc0d0020 con 0x7faadc0ccae0 2023-06-10T19:03:42.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.557+0000 7faad9d9b640 1 -- 172.21.15.53:0/2046393515 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faac8003530 con 0x7faadc0ccae0 2023-06-10T19:03:42.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.557+0000 7faad3fff640 1 -- 172.21.15.53:0/2046393515 >> v1:172.21.15.117:6789/0 conn(0x7faadc0b3ac0 legacy=0x7faadc0b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:42.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.557+0000 7faad3fff640 1 -- 172.21.15.53:0/2046393515 >> v1:172.21.15.53:6789/0 conn(0x7faadc0ccae0 legacy=0x7faadc0d09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:42.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.557+0000 7faad3fff640 1 -- 172.21.15.53:0/2046393515 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faadc0cf500 con 0x7faadc0cc690 2023-06-10T19:03:42.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.561+0000 7faad3fff640 1 --2- 172.21.15.53:0/2046393515 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faadc0cc690 0x7faadc0d04b0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7faac40097c0 tx=0x7faac401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2116a27ca5b152ba server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:42.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.561+0000 7faad9d9b640 1 -- 172.21.15.53:0/2046393515 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac40ad660 con 0x7faadc0cc690 2023-06-10T19:03:42.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.561+0000 7faad9d9b640 1 -- 172.21.15.53:0/2046393515 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faac40ad7c0 con 0x7faadc0cc690 2023-06-10T19:03:42.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.561+0000 7faad9d9b640 1 -- 172.21.15.53:0/2046393515 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac40adb30 con 0x7faadc0cc690 2023-06-10T19:03:42.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.561+0000 7faae09b1640 1 -- 172.21.15.53:0/2046393515 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faadc0cc690 msgr2=0x7faadc0d04b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:42.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.561+0000 7faae09b1640 1 --2- 172.21.15.53:0/2046393515 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faadc0cc690 0x7faadc0d04b0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7faac40097c0 tx=0x7faac401c450 comp rx=0 tx=0).stop 2023-06-10T19:03:42.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.561+0000 7faae09b1640 1 -- 172.21.15.53:0/2046393515 shutdown_connections 2023-06-10T19:03:42.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.561+0000 7faae09b1640 1 --2- 172.21.15.53:0/2046393515 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faadc0cc690 0x7faadc0d04b0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:42.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.561+0000 7faae09b1640 1 -- 172.21.15.53:0/2046393515 >> 172.21.15.53:0/2046393515 conn(0x7faadc071790 msgr2=0x7faadc069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:42.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.561+0000 7faae09b1640 1 -- 172.21.15.53:0/2046393515 shutdown_connections 2023-06-10T19:03:42.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.561+0000 7faae09b1640 1 -- 172.21.15.53:0/2046393515 wait complete. 2023-06-10T19:03:42.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.561+0000 7faae09b1640 1 Processor -- start 2023-06-10T19:03:42.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.561+0000 7faae09b1640 1 -- start start 2023-06-10T19:03:42.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.565+0000 7faae09b1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faadc0b3ac0 0x7faadc15b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:42.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.565+0000 7faae09b1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faadc0cc690 0x7faadc15c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:42.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.565+0000 7faae09b1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faadc0ccae0 0x7faadc153a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:42.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.565+0000 7faae09b1640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faadc15cd50 con 0x7faadc0ccae0 2023-06-10T19:03:42.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.565+0000 7faae09b1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faadc15cf80 con 0x7faadc0b3ac0 2023-06-10T19:03:42.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.565+0000 7faae09b1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faadc15d260 con 0x7faadc0cc690 2023-06-10T19:03:42.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.565+0000 7faadad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faadc0ccae0 0x7faadc153a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:42.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.565+0000 7faadad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faadc0ccae0 0x7faadc153a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56708/0 (socket says 172.21.15.53:56708) 2023-06-10T19:03:42.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.565+0000 7faadad9d640 1 -- 172.21.15.53:0/4236095315 learned_addr learned my addr 172.21.15.53:0/4236095315 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:42.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.565+0000 7faada59c640 1 --2- 172.21.15.53:0/4236095315 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faadc0b3ac0 0x7faadc15b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:42.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.565+0000 7faad3fff640 1 --2- 172.21.15.53:0/4236095315 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faadc0cc690 0x7faadc15c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:42.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.565+0000 7faadad9d640 1 -- 172.21.15.53:0/4236095315 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faadc0cc690 msgr2=0x7faadc15c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:42.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.565+0000 7faadad9d640 1 --2- 172.21.15.53:0/4236095315 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faadc0cc690 0x7faadc15c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:42.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.565+0000 7faadad9d640 1 -- 172.21.15.53:0/4236095315 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faadc0b3ac0 msgr2=0x7faadc15b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:42.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.565+0000 7faadad9d640 1 --2- 172.21.15.53:0/4236095315 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faadc0b3ac0 0x7faadc15b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:42.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.565+0000 7faadad9d640 1 -- 172.21.15.53:0/4236095315 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac4009420 con 0x7faadc0ccae0 2023-06-10T19:03:42.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.565+0000 7faada59c640 1 --2- 172.21.15.53:0/4236095315 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faadc0b3ac0 0x7faadc15b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:03:42.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.565+0000 7faadad9d640 1 --2- 172.21.15.53:0/4236095315 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faadc0ccae0 0x7faadc153a10 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7faad400caa0 tx=0x7faad400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:42.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.565+0000 7faad2ffd640 1 -- 172.21.15.53:0/4236095315 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad400ac00 con 0x7faadc0ccae0 2023-06-10T19:03:42.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.565+0000 7faad2ffd640 1 -- 172.21.15.53:0/4236095315 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faad400ad60 con 0x7faadc0ccae0 2023-06-10T19:03:42.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.565+0000 7faad2ffd640 1 -- 172.21.15.53:0/4236095315 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad4012620 con 0x7faadc0ccae0 2023-06-10T19:03:42.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.565+0000 7faae09b1640 1 -- 172.21.15.53:0/4236095315 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faadc15d540 con 0x7faadc0ccae0 2023-06-10T19:03:42.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.565+0000 7faae09b1640 1 -- 172.21.15.53:0/4236095315 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faadc15db00 con 0x7faadc0ccae0 2023-06-10T19:03:42.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.565+0000 7faae09b1640 1 -- 172.21.15.53:0/4236095315 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faadc04d790 con 0x7faadc0ccae0 2023-06-10T19:03:42.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.565+0000 7faad2ffd640 1 -- 172.21.15.53:0/4236095315 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7faad4007070 con 0x7faadc0ccae0 2023-06-10T19:03:42.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.569+0000 7faad2ffd640 1 --2- 172.21.15.53:0/4236095315 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7faabc066280 0x7faabc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:42.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.569+0000 7faad2ffd640 1 -- 172.21.15.53:0/4236095315 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5425+0+0 (secure 0 0 0) 0x7faad4083a70 con 0x7faadc0ccae0 2023-06-10T19:03:42.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.569+0000 7faada59c640 1 --2- 172.21.15.53:0/4236095315 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7faabc066280 0x7faabc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:42.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.569+0000 7faada59c640 1 --2- 172.21.15.53:0/4236095315 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7faabc066280 0x7faabc068730 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7faacc001710 tx=0x7faacc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:42.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.573+0000 7faad2ffd640 1 -- 172.21.15.53:0/4236095315 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7faad4051150 con 0x7faadc0ccae0 2023-06-10T19:03:42.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.721+0000 7faae09b1640 1 -- 172.21.15.53:0/4236095315 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7faadc0cf7d0 con 0x7faadc0ccae0 2023-06-10T19:03:42.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.725+0000 7faad2ffd640 1 -- 172.21.15.53:0/4236095315 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) v1 ==== 122+0+0 (secure 0 0 0) 0x7faad4017020 con 0x7faadc0ccae0 2023-06-10T19:03:42.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.729+0000 7faae09b1640 1 -- 172.21.15.53:0/4236095315 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7faabc066280 msgr2=0x7faabc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:42.732 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.729+0000 7faae09b1640 1 --2- 172.21.15.53:0/4236095315 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7faabc066280 0x7faabc068730 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7faacc001710 tx=0x7faacc009040 comp rx=0 tx=0).stop 2023-06-10T19:03:42.732 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.729+0000 7faae09b1640 1 -- 172.21.15.53:0/4236095315 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faadc0ccae0 msgr2=0x7faadc153a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:42.732 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.729+0000 7faae09b1640 1 --2- 172.21.15.53:0/4236095315 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faadc0ccae0 0x7faadc153a10 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7faad400caa0 tx=0x7faad400cf60 comp rx=0 tx=0).stop 2023-06-10T19:03:42.732 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.729+0000 7faae09b1640 1 -- 172.21.15.53:0/4236095315 shutdown_connections 2023-06-10T19:03:42.732 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.729+0000 7faae09b1640 1 --2- 172.21.15.53:0/4236095315 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7faabc066280 0x7faabc068730 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:42.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.729+0000 7faae09b1640 1 --2- 172.21.15.53:0/4236095315 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faadc0ccae0 0x7faadc153a10 unknown :-1 s=CLOSED pgs=1674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:42.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.729+0000 7faae09b1640 1 --2- 172.21.15.53:0/4236095315 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faadc0cc690 0x7faadc15c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:42.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.729+0000 7faae09b1640 1 --2- 172.21.15.53:0/4236095315 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faadc0b3ac0 0x7faadc15b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:42.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.729+0000 7faae09b1640 1 -- 172.21.15.53:0/4236095315 >> 172.21.15.53:0/4236095315 conn(0x7faadc071790 msgr2=0x7faadc0b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:42.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.729+0000 7faae09b1640 1 -- 172.21.15.53:0/4236095315 shutdown_connections 2023-06-10T19:03:42.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:42.729+0000 7faae09b1640 1 -- 172.21.15.53:0/4236095315 wait complete. 2023-06-10T19:03:42.747 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-06-10T19:03:42.748 DEBUG:teuthology.orchestra.run.smithi053:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-06-10T19:03:42.801 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-06-10T19:03:42.861 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-06-10T19:03:42.861 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T19:03:42.862 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:03:42.867 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16345192k,nr_inodes=4086298,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276544k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=407 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276540k,nr_inodes=819135,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276544k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-06-10T19:03:42.868 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T19:03:42.868 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:03:42.873 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16342088k,nr_inodes=4085522,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275924k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18845 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275920k,nr_inodes=818980,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275924k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-06-10T19:03:42.874 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T19:03:42.874 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:03:42.915 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16345192k,nr_inodes=4086298,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276544k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=407 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276540k,nr_inodes=819135,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276544k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-06-10T19:03:42.915 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T19:03:42.916 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:03:42.923 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16342088k,nr_inodes=4085522,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275924k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18845 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275920k,nr_inodes=818980,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275924k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-06-10T19:03:42.924 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-06-10T19:03:42.924 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:03:43.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.085+0000 7f6dda9e8640 1 Processor -- start 2023-06-10T19:03:43.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.085+0000 7f6dda9e8640 1 -- start start 2023-06-10T19:03:43.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.085+0000 7f6dda9e8640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6dd40c9840 0x7f6dd40c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:43.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.085+0000 7f6dda9e8640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6dd406b090 0x7f6dd406b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:43.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.085+0000 7f6dda9e8640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dd4159b50 con 0x7f6dd4071060 2023-06-10T19:03:43.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.085+0000 7f6dda9e8640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dd40ca150 con 0x7f6dd40c9840 2023-06-10T19:03:43.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.085+0000 7f6dda9e8640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd40702a0 con 0x7f6dd406b090 2023-06-10T19:03:43.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.085+0000 7f6dd37fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f6dd4071060 0x7f6dd40af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60450/0 (socket says 172.21.15.53:60450) 2023-06-10T19:03:43.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.085+0000 7f6dd37fe640 1 -- 172.21.15.53:0/4253439373 learned_addr learned my addr 172.21.15.53:0/4253439373 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:03:43.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.085+0000 7f6dd3fff640 1 --2- 172.21.15.53:0/4253439373 >> v2:172.21.15.117:3300/0 conn(0x7f6dd40c9840 0x7f6dd40c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:43.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.085+0000 7f6dd8f85640 1 --2- 172.21.15.53:0/4253439373 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6dd406b090 0x7f6dd406b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:43.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.085+0000 7f6dd2ffd640 1 -- 172.21.15.53:0/4253439373 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3389638470 0 0) 0x7f6dd4159b50 con 0x7f6dd4071060 2023-06-10T19:03:43.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.085+0000 7f6dd2ffd640 1 -- 172.21.15.53:0/4253439373 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6dc0003530 con 0x7f6dd4071060 2023-06-10T19:03:43.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.085+0000 7f6dd2ffd640 1 -- 172.21.15.53:0/4253439373 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3000366118 0 0) 0x7f6dc0003530 con 0x7f6dd4071060 2023-06-10T19:03:43.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.085+0000 7f6dd2ffd640 1 -- 172.21.15.53:0/4253439373 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6dd406b090 msgr2=0x7f6dd406b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:43.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.085+0000 7f6dd2ffd640 1 --2- 172.21.15.53:0/4253439373 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6dd406b090 0x7f6dd406b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:43.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.085+0000 7f6dd2ffd640 1 -- 172.21.15.53:0/4253439373 >> v2:172.21.15.117:3300/0 conn(0x7f6dd40c9840 msgr2=0x7f6dd40c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:43.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.085+0000 7f6dd2ffd640 1 --2- 172.21.15.53:0/4253439373 >> v2:172.21.15.117:3300/0 conn(0x7f6dd40c9840 0x7f6dd40c9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:43.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.085+0000 7f6dd2ffd640 1 -- 172.21.15.53:0/4253439373 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd4070580 con 0x7f6dd4071060 2023-06-10T19:03:43.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.085+0000 7f6dd2ffd640 1 -- 172.21.15.53:0/4253439373 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f6dbc001680 con 0x7f6dd4071060 2023-06-10T19:03:43.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.085+0000 7f6dd2ffd640 1 -- 172.21.15.53:0/4253439373 >> v1:172.21.15.53:6789/0 conn(0x7f6dd4071060 legacy=0x7f6dd40af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:43.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.085+0000 7f6dd2ffd640 1 --2- 172.21.15.53:0/4253439373 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6dd406b090 0x7f6dc00039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:43.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.085+0000 7f6dd2ffd640 1 --2- 172.21.15.53:0/4253439373 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6dc0003f70 0x7f6dc00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:43.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.085+0000 7f6dd2ffd640 1 --2- 172.21.15.53:0/4253439373 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6dc0004d10 0x7f6dc0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:43.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.085+0000 7f6dd2ffd640 1 -- 172.21.15.53:0/4253439373 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd40ca150 con 0x7f6dc0003f70 2023-06-10T19:03:43.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.085+0000 7f6dd2ffd640 1 -- 172.21.15.53:0/4253439373 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd40702a0 con 0x7f6dc0004d10 2023-06-10T19:03:43.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.085+0000 7f6dd2ffd640 1 -- 172.21.15.53:0/4253439373 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc000b990 con 0x7f6dd406b090 2023-06-10T19:03:43.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.085+0000 7f6dd37fe640 1 --2- 172.21.15.53:0/4253439373 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6dc0003f70 0x7f6dc00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:43.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.085+0000 7f6dd3fff640 1 --2- 172.21.15.53:0/4253439373 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6dd406b090 0x7f6dc00039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:43.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.085+0000 7f6dd8f85640 1 --2- 172.21.15.53:0/4253439373 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6dc0004d10 0x7f6dc0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:43.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.085+0000 7f6dd37fe640 1 -- 172.21.15.53:0/4253439373 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6dd406b090 msgr2=0x7f6dc00039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:43.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.085+0000 7f6dd37fe640 1 --2- 172.21.15.53:0/4253439373 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6dd406b090 0x7f6dc00039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:43.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.085+0000 7f6dd37fe640 1 -- 172.21.15.53:0/4253439373 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6dc0004d10 msgr2=0x7f6dc0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:43.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.085+0000 7f6dd37fe640 1 --2- 172.21.15.53:0/4253439373 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6dc0004d10 0x7f6dc0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:43.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.085+0000 7f6dd37fe640 1 -- 172.21.15.53:0/4253439373 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dc0003530 con 0x7f6dc0003f70 2023-06-10T19:03:43.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.085+0000 7f6dd8f85640 1 --2- 172.21.15.53:0/4253439373 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6dc0004d10 0x7f6dc0005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:03:43.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.089+0000 7f6dd37fe640 1 --2- 172.21.15.53:0/4253439373 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6dc0003f70 0x7f6dc00047d0 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc00c290 tx=0x7f6dbc01f3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1868dc9cb735bf6 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:43.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.089+0000 7f6dd2ffd640 1 -- 172.21.15.53:0/4253439373 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc005ae0 con 0x7f6dc0003f70 2023-06-10T19:03:43.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.089+0000 7f6dd2ffd640 1 -- 172.21.15.53:0/4253439373 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dbc0ab070 con 0x7f6dc0003f70 2023-06-10T19:03:43.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.089+0000 7f6dd2ffd640 1 -- 172.21.15.53:0/4253439373 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc005e80 con 0x7f6dc0003f70 2023-06-10T19:03:43.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.089+0000 7f6dda9e8640 1 -- 172.21.15.53:0/4253439373 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6dc0003f70 msgr2=0x7f6dc00047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:43.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.089+0000 7f6dda9e8640 1 --2- 172.21.15.53:0/4253439373 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6dc0003f70 0x7f6dc00047d0 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc00c290 tx=0x7f6dbc01f3f0 comp rx=0 tx=0).stop 2023-06-10T19:03:43.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.089+0000 7f6dd8f85640 1 -- 172.21.15.53:0/4253439373 reap_dead start 2023-06-10T19:03:43.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.089+0000 7f6dda9e8640 1 -- 172.21.15.53:0/4253439373 shutdown_connections 2023-06-10T19:03:43.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.089+0000 7f6dda9e8640 1 -- 172.21.15.53:0/4253439373 >> 172.21.15.53:0/4253439373 conn(0x7f6dd406a0d0 msgr2=0x7f6dd40ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:43.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.089+0000 7f6dda9e8640 1 -- 172.21.15.53:0/4253439373 shutdown_connections 2023-06-10T19:03:43.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.089+0000 7f6dda9e8640 1 -- 172.21.15.53:0/4253439373 wait complete. 2023-06-10T19:03:43.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.093+0000 7f6dda9e8640 1 Processor -- start 2023-06-10T19:03:43.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.093+0000 7f6dda9e8640 1 -- start start 2023-06-10T19:03:43.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.093+0000 7f6dda9e8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6dc0003f70 0x7f6dd4153d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:43.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.093+0000 7f6dda9e8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6dd40ac8b0 0x7f6dd40acd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:43.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.093+0000 7f6dda9e8640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6dd40c33a0 0x7f6dd40c3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:43.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.093+0000 7f6dda9e8640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd41f2040 con 0x7f6dc0003f70 2023-06-10T19:03:43.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.093+0000 7f6dda9e8640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd4154280 con 0x7f6dd40ac8b0 2023-06-10T19:03:43.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.093+0000 7f6dda9e8640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd40ad260 con 0x7f6dd40c33a0 2023-06-10T19:03:43.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.093+0000 7f6dd3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6dc0003f70 0x7f6dd4153d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:43.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.093+0000 7f6dd3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6dc0003f70 0x7f6dd4153d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56724/0 (socket says 172.21.15.53:56724) 2023-06-10T19:03:43.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.093+0000 7f6dd3fff640 1 -- 172.21.15.53:0/3925304915 learned_addr learned my addr 172.21.15.53:0/3925304915 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:43.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.093+0000 7f6dd8f85640 1 --2- 172.21.15.53:0/3925304915 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6dd40c33a0 0x7f6dd40c3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:43.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.093+0000 7f6dd37fe640 1 --2- 172.21.15.53:0/3925304915 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6dd40ac8b0 0x7f6dd40acd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:43.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.093+0000 7f6dd3fff640 1 -- 172.21.15.53:0/3925304915 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6dd40c33a0 msgr2=0x7f6dd40c3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:43.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.093+0000 7f6dd3fff640 1 --2- 172.21.15.53:0/3925304915 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6dd40c33a0 0x7f6dd40c3810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:43.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.093+0000 7f6dd3fff640 1 -- 172.21.15.53:0/3925304915 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6dd40ac8b0 msgr2=0x7f6dd40acd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:43.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.093+0000 7f6dd3fff640 1 --2- 172.21.15.53:0/3925304915 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6dd40ac8b0 0x7f6dd40acd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:43.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.093+0000 7f6dd3fff640 1 -- 172.21.15.53:0/3925304915 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd41f13c0 con 0x7f6dc0003f70 2023-06-10T19:03:43.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.093+0000 7f6dd3fff640 1 --2- 172.21.15.53:0/3925304915 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6dc0003f70 0x7f6dd4153d40 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7f6dc4011e60 tx=0x7f6dc400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:43.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.093+0000 7f6dd0ff9640 1 -- 172.21.15.53:0/3925304915 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc400e040 con 0x7f6dc0003f70 2023-06-10T19:03:43.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.093+0000 7f6dd0ff9640 1 -- 172.21.15.53:0/3925304915 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dc400f040 con 0x7f6dc0003f70 2023-06-10T19:03:43.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.093+0000 7f6dda9e8640 1 -- 172.21.15.53:0/3925304915 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dd41f16a0 con 0x7f6dc0003f70 2023-06-10T19:03:43.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.093+0000 7f6dd0ff9640 1 -- 172.21.15.53:0/3925304915 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc4015850 con 0x7f6dc0003f70 2023-06-10T19:03:43.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.093+0000 7f6dda9e8640 1 -- 172.21.15.53:0/3925304915 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dd41f1c60 con 0x7f6dc0003f70 2023-06-10T19:03:43.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.093+0000 7f6dda9e8640 1 -- 172.21.15.53:0/3925304915 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dd404d790 con 0x7f6dc0003f70 2023-06-10T19:03:43.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.093+0000 7f6dd0ff9640 1 -- 172.21.15.53:0/3925304915 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6dc40159b0 con 0x7f6dc0003f70 2023-06-10T19:03:43.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.093+0000 7f6dd0ff9640 1 --2- 172.21.15.53:0/3925304915 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6db4066280 0x7f6db4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:43.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.093+0000 7f6dd0ff9640 1 -- 172.21.15.53:0/3925304915 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5425+0+0 (secure 0 0 0) 0x7f6dc40848e0 con 0x7f6dc0003f70 2023-06-10T19:03:43.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.097+0000 7f6dd37fe640 1 --2- 172.21.15.53:0/3925304915 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6db4066280 0x7f6db4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:43.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.097+0000 7f6dd37fe640 1 --2- 172.21.15.53:0/3925304915 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6db4066280 0x7f6db4068730 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc0ae000 tx=0x7f6dbc001a10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:43.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.101+0000 7f6dd0ff9640 1 -- 172.21.15.53:0/3925304915 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6dc4051fd0 con 0x7f6dc0003f70 2023-06-10T19:03:43.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.289+0000 7f6dda9e8640 1 -- 172.21.15.53:0/3925304915 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6dd40cb140 con 0x7f6dc0003f70 2023-06-10T19:03:43.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.289+0000 7f6dd0ff9640 1 -- 172.21.15.53:0/3925304915 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+3535 (secure 0 0 0) 0x7f6dc40555f0 con 0x7f6dc0003f70 2023-06-10T19:03:43.292 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:03:43.293 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":57,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/1617157670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1617157670},{"type":"v1","addr":"172.21.15.117:6836","nonce":1617157670}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6113,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3414416090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":3414416090},{"type":"v1","addr":"172.21.15.117:6837","nonce":3414416090}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6718,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2533467097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2533467097},{"type":"v1","addr":"172.21.15.53:6835","nonce":2533467097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":8619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/3587108694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3587108694},{"type":"v1","addr":"172.21.15.53:6833","nonce":3587108694}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57}],"filesystems":[]} 2023-06-10T19:03:43.293 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 57 2023-06-10T19:03:43.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.289+0000 7f6dda9e8640 1 -- 172.21.15.53:0/3925304915 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6db4066280 msgr2=0x7f6db4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:43.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.289+0000 7f6dda9e8640 1 --2- 172.21.15.53:0/3925304915 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6db4066280 0x7f6db4068730 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc0ae000 tx=0x7f6dbc001a10 comp rx=0 tx=0).stop 2023-06-10T19:03:43.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.289+0000 7f6dda9e8640 1 -- 172.21.15.53:0/3925304915 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6dc0003f70 msgr2=0x7f6dd4153d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:43.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.289+0000 7f6dda9e8640 1 --2- 172.21.15.53:0/3925304915 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6dc0003f70 0x7f6dd4153d40 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7f6dc4011e60 tx=0x7f6dc400f580 comp rx=0 tx=0).stop 2023-06-10T19:03:43.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.289+0000 7f6dda9e8640 1 -- 172.21.15.53:0/3925304915 shutdown_connections 2023-06-10T19:03:43.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.289+0000 7f6dda9e8640 1 --2- 172.21.15.53:0/3925304915 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6db4066280 0x7f6db4068730 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:43.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.289+0000 7f6dda9e8640 1 --2- 172.21.15.53:0/3925304915 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6dd40c33a0 0x7f6dd40c3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:43.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.289+0000 7f6dda9e8640 1 --2- 172.21.15.53:0/3925304915 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6dd40ac8b0 0x7f6dd40acd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:43.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.289+0000 7f6dda9e8640 1 --2- 172.21.15.53:0/3925304915 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6dc0003f70 0x7f6dd4153d40 unknown :-1 s=CLOSED pgs=1677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:43.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.289+0000 7f6dda9e8640 1 -- 172.21.15.53:0/3925304915 >> 172.21.15.53:0/3925304915 conn(0x7f6dd406a0d0 msgr2=0x7f6dd40c82d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:43.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.293+0000 7f6dda9e8640 1 -- 172.21.15.53:0/3925304915 shutdown_connections 2023-06-10T19:03:43.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.293+0000 7f6dda9e8640 1 -- 172.21.15.53:0/3925304915 wait complete. 2023-06-10T19:03:43.313 INFO:tasks.ceph.mds.a:Restarting daemon 2023-06-10T19:03:43.313 INFO:tasks.ceph.mds.a:Stopping old one... 2023-06-10T19:03:43.313 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-06-10T19:03:43.313 INFO:teuthology.orchestra.run:waiting for 300 2023-06-10T19:03:43.314 INFO:tasks.ceph.mds.c:Restarting daemon 2023-06-10T19:03:43.314 INFO:tasks.ceph.mds.c:Stopping old one... 2023-06-10T19:03:43.314 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-06-10T19:03:43.314 INFO:teuthology.orchestra.run:waiting for 300 2023-06-10T19:03:43.315 INFO:tasks.ceph.mds.b:Restarting daemon 2023-06-10T19:03:43.315 INFO:tasks.ceph.mds.b:Stopping old one... 2023-06-10T19:03:43.315 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-06-10T19:03:43.315 INFO:teuthology.orchestra.run:waiting for 300 2023-06-10T19:03:43.315 INFO:tasks.ceph.mds.d:Restarting daemon 2023-06-10T19:03:43.316 INFO:tasks.ceph.mds.d:Stopping old one... 2023-06-10T19:03:43.316 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-06-10T19:03:43.316 INFO:teuthology.orchestra.run:waiting for 300 2023-06-10T19:03:43.323 INFO:tasks.ceph.mds.a:Stopped 2023-06-10T19:03:43.323 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-06-10T19:03:43.326 INFO:tasks.ceph.mds.c:Stopped 2023-06-10T19:03:43.326 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-06-10T19:03:43.329 INFO:tasks.ceph.mds.b:Stopped 2023-06-10T19:03:43.329 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-06-10T19:03:43.330 INFO:tasks.ceph.mds.d:Stopped 2023-06-10T19:03:43.331 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-06-10T19:03:43.368 INFO:tasks.ceph.mds.a:Started 2023-06-10T19:03:43.369 DEBUG:teuthology.parallel:result is None 2023-06-10T19:03:43.370 INFO:tasks.ceph.mds.c:Started 2023-06-10T19:03:43.371 DEBUG:teuthology.parallel:result is None 2023-06-10T19:03:43.372 INFO:tasks.ceph.mds.b:Started 2023-06-10T19:03:43.373 DEBUG:teuthology.parallel:result is None 2023-06-10T19:03:43.374 INFO:tasks.ceph.mds.d:Started 2023-06-10T19:03:43.375 DEBUG:teuthology.parallel:result is None 2023-06-10T19:03:43.376 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-06-10T19:03:43.433 INFO:tasks.ceph.mds.c.smithi053.stdout:starting mds.c at 2023-06-10T19:03:43.435 INFO:tasks.ceph.mds.a.smithi053.stdout:starting mds.a at 2023-06-10T19:03:43.445 INFO:tasks.ceph.mds.d.smithi117.stdout:starting mds.d at 2023-06-10T19:03:43.445 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2023-06-10T19:03:43.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.493+0000 7fb80f80e640 1 Processor -- start 2023-06-10T19:03:43.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.493+0000 7fb80f80e640 1 -- start start 2023-06-10T19:03:43.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.493+0000 7fb80f80e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb8080b3ac0 0x7fb8080b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:43.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.493+0000 7fb80f80e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8080cc690 0x7fb8080b43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:43.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.493+0000 7fb80f80e640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8080ccde0 con 0x7fb8080d1b00 2023-06-10T19:03:43.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.493+0000 7fb80f80e640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8080ced00 con 0x7fb8080b3ac0 2023-06-10T19:03:43.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.493+0000 7fb80f80e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8080cfc10 con 0x7fb8080cc690 2023-06-10T19:03:43.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.493+0000 7fb80d5aa640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb8080b3ac0 0x7fb8080b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:43.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.493+0000 7fb80ddab640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fb8080d1b00 0x7fb80815f3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60476/0 (socket says 172.21.15.53:60476) 2023-06-10T19:03:43.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.493+0000 7fb80ddab640 1 -- 172.21.15.53:0/1689427899 learned_addr learned my addr 172.21.15.53:0/1689427899 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:03:43.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.493+0000 7fb80cda9640 1 --2- 172.21.15.53:0/1689427899 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8080cc690 0x7fb8080b43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:43.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.493+0000 7fb80d5aa640 1 -- 172.21.15.53:0/1689427899 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8080cc690 msgr2=0x7fb8080b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:43.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.493+0000 7fb80d5aa640 1 --2- 172.21.15.53:0/1689427899 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8080cc690 0x7fb8080b43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:43.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.493+0000 7fb80d5aa640 1 -- 172.21.15.53:0/1689427899 >> v1:172.21.15.53:6789/0 conn(0x7fb8080d1b00 legacy=0x7fb80815f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:43.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.493+0000 7fb7fbfff640 1 -- 172.21.15.53:0/1689427899 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1820363200 0 0) 0x7fb8080ccde0 con 0x7fb8080d1b00 2023-06-10T19:03:43.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.493+0000 7fb80d5aa640 1 -- 172.21.15.53:0/1689427899 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8080b4910 con 0x7fb8080b3ac0 2023-06-10T19:03:43.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.497+0000 7fb80d5aa640 1 --2- 172.21.15.53:0/1689427899 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8080b3ac0 0x7fb8080b3e90 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc0097c0 tx=0x7fb7fc01c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d27c94be1823a151 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:43.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.497+0000 7fb7fbfff640 1 -- 172.21.15.53:0/1689427899 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7fc0ab600 con 0x7fb8080b3ac0 2023-06-10T19:03:43.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.497+0000 7fb7fbfff640 1 -- 172.21.15.53:0/1689427899 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7fc0a7050 con 0x7fb8080b3ac0 2023-06-10T19:03:43.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.497+0000 7fb7fbfff640 1 -- 172.21.15.53:0/1689427899 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7fc0ab980 con 0x7fb8080b3ac0 2023-06-10T19:03:43.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.497+0000 7fb80f80e640 1 -- 172.21.15.53:0/1689427899 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8080b3ac0 msgr2=0x7fb8080b3e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:43.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.497+0000 7fb80f80e640 1 --2- 172.21.15.53:0/1689427899 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8080b3ac0 0x7fb8080b3e90 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc0097c0 tx=0x7fb7fc01c360 comp rx=0 tx=0).stop 2023-06-10T19:03:43.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.497+0000 7fb80f80e640 1 -- 172.21.15.53:0/1689427899 shutdown_connections 2023-06-10T19:03:43.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.497+0000 7fb80f80e640 1 --2- 172.21.15.53:0/1689427899 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8080cc690 0x7fb8080b43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:43.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.497+0000 7fb80f80e640 1 --2- 172.21.15.53:0/1689427899 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8080b3ac0 0x7fb8080b3e90 unknown :-1 s=CLOSED pgs=1686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:43.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.497+0000 7fb80f80e640 1 -- 172.21.15.53:0/1689427899 >> 172.21.15.53:0/1689427899 conn(0x7fb808069de0 msgr2=0x7fb80806a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:43.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.497+0000 7fb80f80e640 1 -- 172.21.15.53:0/1689427899 shutdown_connections 2023-06-10T19:03:43.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.497+0000 7fb80f80e640 1 -- 172.21.15.53:0/1689427899 wait complete. 2023-06-10T19:03:43.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.497+0000 7fb80f80e640 1 Processor -- start 2023-06-10T19:03:43.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.497+0000 7fb80f80e640 1 -- start start 2023-06-10T19:03:43.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.497+0000 7fb80f80e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8080b3ac0 0x7fb808154ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:43.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.497+0000 7fb80f80e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8080cc690 0x7fb8080cbaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:43.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.497+0000 7fb80f80e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8080d1b00 0x7fb808153af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:43.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.497+0000 7fb80f80e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8080cc1b0 con 0x7fb8080b3ac0 2023-06-10T19:03:43.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.497+0000 7fb80f80e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb80815cf70 con 0x7fb8080d1b00 2023-06-10T19:03:43.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.497+0000 7fb80f80e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb80815d250 con 0x7fb8080cc690 2023-06-10T19:03:43.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.497+0000 7fb80d5aa640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8080b3ac0 0x7fb808154ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:43.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.497+0000 7fb80d5aa640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8080b3ac0 0x7fb808154ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56760/0 (socket says 172.21.15.53:56760) 2023-06-10T19:03:43.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.497+0000 7fb80d5aa640 1 -- 172.21.15.53:0/774536842 learned_addr learned my addr 172.21.15.53:0/774536842 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:43.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.497+0000 7fb80cda9640 1 --2- 172.21.15.53:0/774536842 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8080cc690 0x7fb8080cbaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:43.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.497+0000 7fb80ddab640 1 --2- 172.21.15.53:0/774536842 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8080d1b00 0x7fb808153af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:43.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.497+0000 7fb80d5aa640 1 -- 172.21.15.53:0/774536842 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8080cc690 msgr2=0x7fb8080cbaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:43.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.497+0000 7fb80d5aa640 1 --2- 172.21.15.53:0/774536842 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8080cc690 0x7fb8080cbaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:43.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.497+0000 7fb80d5aa640 1 -- 172.21.15.53:0/774536842 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8080d1b00 msgr2=0x7fb808153af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:43.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.497+0000 7fb80d5aa640 1 --2- 172.21.15.53:0/774536842 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8080d1b00 0x7fb808153af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:43.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.497+0000 7fb80d5aa640 1 -- 172.21.15.53:0/774536842 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7fc009420 con 0x7fb8080b3ac0 2023-06-10T19:03:43.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.497+0000 7fb80cda9640 1 --2- 172.21.15.53:0/774536842 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8080cc690 0x7fb8080cbaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:03:43.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.497+0000 7fb80d5aa640 1 --2- 172.21.15.53:0/774536842 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8080b3ac0 0x7fb808154ff0 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc019f90 tx=0x7fb7fc01aba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:43.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.497+0000 7fb7f9ffb640 1 -- 172.21.15.53:0/774536842 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7fc004230 con 0x7fb8080b3ac0 2023-06-10T19:03:43.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.497+0000 7fb7f9ffb640 1 -- 172.21.15.53:0/774536842 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7fc004390 con 0x7fb8080b3ac0 2023-06-10T19:03:43.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.497+0000 7fb80f80e640 1 -- 172.21.15.53:0/774536842 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb808154030 con 0x7fb8080b3ac0 2023-06-10T19:03:43.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.497+0000 7fb7f9ffb640 1 -- 172.21.15.53:0/774536842 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7fc003820 con 0x7fb8080b3ac0 2023-06-10T19:03:43.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.497+0000 7fb80f80e640 1 -- 172.21.15.53:0/774536842 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb80815eb40 con 0x7fb8080b3ac0 2023-06-10T19:03:43.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.501+0000 7fb80f80e640 1 -- 172.21.15.53:0/774536842 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb80804d790 con 0x7fb8080b3ac0 2023-06-10T19:03:43.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.501+0000 7fb7f9ffb640 1 -- 172.21.15.53:0/774536842 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb7fc003980 con 0x7fb8080b3ac0 2023-06-10T19:03:43.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.501+0000 7fb7f9ffb640 1 --2- 172.21.15.53:0/774536842 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb7ec066280 0x7fb7ec068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:43.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.501+0000 7fb7f9ffb640 1 -- 172.21.15.53:0/774536842 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5425+0+0 (secure 0 0 0) 0x7fb7fc11e1a0 con 0x7fb8080b3ac0 2023-06-10T19:03:43.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.501+0000 7fb80cda9640 1 --2- 172.21.15.53:0/774536842 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb7ec066280 0x7fb7ec068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:43.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.501+0000 7fb80cda9640 1 --2- 172.21.15.53:0/774536842 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb7ec066280 0x7fb7ec068730 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fb808155550 tx=0x7fb804008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:43.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.505+0000 7fb7f9ffb640 1 -- 172.21.15.53:0/774536842 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb7fc0eb920 con 0x7fb8080b3ac0 2023-06-10T19:03:43.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:43.673+0000 7fb80f80e640 1 -- 172.21.15.53:0/774536842 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fb80806ac70 con 0x7fb8080b3ac0 2023-06-10T19:03:44.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.493+0000 7fb7f9ffb640 1 -- 172.21.15.53:0/774536842 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v106) v1 ==== 97+0+0 (secure 0 0 0) 0x7fb7fc006e20 con 0x7fb8080b3ac0 2023-06-10T19:03:44.497 INFO:teuthology.orchestra.run.smithi053.stderr: removed all blocklist entries 2023-06-10T19:03:44.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.497+0000 7fb80f80e640 1 -- 172.21.15.53:0/774536842 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb7ec066280 msgr2=0x7fb7ec068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:44.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.497+0000 7fb80f80e640 1 --2- 172.21.15.53:0/774536842 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb7ec066280 0x7fb7ec068730 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fb808155550 tx=0x7fb804008040 comp rx=0 tx=0).stop 2023-06-10T19:03:44.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.497+0000 7fb80f80e640 1 -- 172.21.15.53:0/774536842 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8080b3ac0 msgr2=0x7fb808154ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:44.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.497+0000 7fb80f80e640 1 --2- 172.21.15.53:0/774536842 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8080b3ac0 0x7fb808154ff0 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc019f90 tx=0x7fb7fc01aba0 comp rx=0 tx=0).stop 2023-06-10T19:03:44.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.497+0000 7fb80f80e640 1 -- 172.21.15.53:0/774536842 shutdown_connections 2023-06-10T19:03:44.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.497+0000 7fb80f80e640 1 --2- 172.21.15.53:0/774536842 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb7ec066280 0x7fb7ec068730 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:44.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.497+0000 7fb80f80e640 1 --2- 172.21.15.53:0/774536842 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8080d1b00 0x7fb808153af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:44.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.497+0000 7fb80f80e640 1 --2- 172.21.15.53:0/774536842 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8080cc690 0x7fb8080cbaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:44.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.497+0000 7fb80f80e640 1 --2- 172.21.15.53:0/774536842 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8080b3ac0 0x7fb808154ff0 unknown :-1 s=CLOSED pgs=1687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:44.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.497+0000 7fb80f80e640 1 -- 172.21.15.53:0/774536842 >> 172.21.15.53:0/774536842 conn(0x7fb808069de0 msgr2=0x7fb8081582a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:44.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.497+0000 7fb80f80e640 1 -- 172.21.15.53:0/774536842 shutdown_connections 2023-06-10T19:03:44.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.497+0000 7fb80f80e640 1 -- 172.21.15.53:0/774536842 wait complete. 2023-06-10T19:03:44.525 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-06-10T19:03:44.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.649+0000 7f9485842640 1 Processor -- start 2023-06-10T19:03:44.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.649+0000 7f9485842640 1 -- start start 2023-06-10T19:03:44.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.653+0000 7f9485842640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f94800b3ac0 0x7f94800b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:44.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.653+0000 7f9485842640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94800d0020 con 0x7f94800cc690 2023-06-10T19:03:44.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.653+0000 7f9485842640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9480160190 con 0x7f94800d14c0 2023-06-10T19:03:44.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.653+0000 7f9485842640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94800b43d0 con 0x7f94800b3ac0 2023-06-10T19:03:44.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.653+0000 7f947effd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f94800b3ac0 0x7f94800b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:44.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.653+0000 7f947e7fc640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f94800cc690 0x7f948015f370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60478/0 (socket says 172.21.15.53:60478) 2023-06-10T19:03:44.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.653+0000 7f947e7fc640 1 -- 172.21.15.53:0/4176398699 learned_addr learned my addr 172.21.15.53:0/4176398699 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:03:44.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.653+0000 7f947effd640 1 -- 172.21.15.53:0/4176398699 >> v1:172.21.15.117:6789/0 conn(0x7f94800d14c0 legacy=0x7f948015fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:44.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.653+0000 7f947effd640 1 -- 172.21.15.53:0/4176398699 >> v1:172.21.15.53:6789/0 conn(0x7f94800cc690 legacy=0x7f948015f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:44.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.653+0000 7f947effd640 1 -- 172.21.15.53:0/4176398699 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94800cef40 con 0x7f94800b3ac0 2023-06-10T19:03:44.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.653+0000 7f947dffb640 1 -- 172.21.15.53:0/4176398699 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 653086940 0 0) 0x7f94800d0020 con 0x7f94800cc690 2023-06-10T19:03:44.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.653+0000 7f947effd640 1 --2- 172.21.15.53:0/4176398699 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f94800b3ac0 0x7f94800b3e90 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7f94700097c0 tx=0x7f947001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a07aa8d527dbfb2 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:44.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.657+0000 7f947dffb640 1 -- 172.21.15.53:0/4176398699 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94700ab600 con 0x7f94800b3ac0 2023-06-10T19:03:44.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.657+0000 7f947dffb640 1 -- 172.21.15.53:0/4176398699 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94700a7050 con 0x7f94800b3ac0 2023-06-10T19:03:44.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.657+0000 7f947dffb640 1 -- 172.21.15.53:0/4176398699 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94700ab980 con 0x7f94800b3ac0 2023-06-10T19:03:44.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.657+0000 7f9485842640 1 -- 172.21.15.53:0/4176398699 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f94800b3ac0 msgr2=0x7f94800b3e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:44.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.657+0000 7f9485842640 1 --2- 172.21.15.53:0/4176398699 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f94800b3ac0 0x7f94800b3e90 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7f94700097c0 tx=0x7f947001c410 comp rx=0 tx=0).stop 2023-06-10T19:03:44.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.657+0000 7f9485842640 1 -- 172.21.15.53:0/4176398699 shutdown_connections 2023-06-10T19:03:44.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.657+0000 7f9485842640 1 --2- 172.21.15.53:0/4176398699 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f94800b3ac0 0x7f94800b3e90 unknown :-1 s=CLOSED pgs=1689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:44.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.657+0000 7f9485842640 1 -- 172.21.15.53:0/4176398699 >> 172.21.15.53:0/4176398699 conn(0x7f9480071790 msgr2=0x7f9480069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:44.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.657+0000 7f9485842640 1 -- 172.21.15.53:0/4176398699 shutdown_connections 2023-06-10T19:03:44.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.657+0000 7f9485842640 1 -- 172.21.15.53:0/4176398699 wait complete. 2023-06-10T19:03:44.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.657+0000 7f9485842640 1 Processor -- start 2023-06-10T19:03:44.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.657+0000 7f9485842640 1 -- start start 2023-06-10T19:03:44.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.657+0000 7f9485842640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94800b3ac0 0x7f9480151510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:44.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.657+0000 7f9485842640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94800cc690 0x7f948014d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:44.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.657+0000 7f9485842640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f94800d14c0 0x7f9480153f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:44.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.657+0000 7f9485842640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9480151e40 con 0x7f94800d14c0 2023-06-10T19:03:44.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.657+0000 7f9485842640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9480152120 con 0x7f94800cc690 2023-06-10T19:03:44.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.657+0000 7f9485842640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9480152400 con 0x7f94800b3ac0 2023-06-10T19:03:44.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.657+0000 7f947f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f94800d14c0 0x7f9480153f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:44.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.657+0000 7f947f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f94800d14c0 0x7f9480153f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56778/0 (socket says 172.21.15.53:56778) 2023-06-10T19:03:44.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.657+0000 7f947f7fe640 1 -- 172.21.15.53:0/3329439981 learned_addr learned my addr 172.21.15.53:0/3329439981 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:44.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.657+0000 7f947e7fc640 1 --2- 172.21.15.53:0/3329439981 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94800cc690 0x7f948014d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:44.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.657+0000 7f947effd640 1 --2- 172.21.15.53:0/3329439981 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94800b3ac0 0x7f9480151510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:44.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.657+0000 7f947f7fe640 1 -- 172.21.15.53:0/3329439981 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94800b3ac0 msgr2=0x7f9480151510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:44.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.657+0000 7f947f7fe640 1 --2- 172.21.15.53:0/3329439981 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94800b3ac0 0x7f9480151510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:44.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.657+0000 7f947f7fe640 1 -- 172.21.15.53:0/3329439981 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94800cc690 msgr2=0x7f948014d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:44.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.657+0000 7f947f7fe640 1 --2- 172.21.15.53:0/3329439981 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94800cc690 0x7f948014d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:44.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.657+0000 7f947f7fe640 1 -- 172.21.15.53:0/3329439981 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9470009420 con 0x7f94800d14c0 2023-06-10T19:03:44.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.657+0000 7f947f7fe640 1 --2- 172.21.15.53:0/3329439981 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f94800d14c0 0x7f9480153f00 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7f947800b970 tx=0x7f947800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:44.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.661+0000 7f9467fff640 1 -- 172.21.15.53:0/3329439981 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f947800cb40 con 0x7f94800d14c0 2023-06-10T19:03:44.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.661+0000 7f9467fff640 1 -- 172.21.15.53:0/3329439981 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f947800cca0 con 0x7f94800d14c0 2023-06-10T19:03:44.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.661+0000 7f9485842640 1 -- 172.21.15.53:0/3329439981 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94801526e0 con 0x7f94800d14c0 2023-06-10T19:03:44.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.661+0000 7f9467fff640 1 -- 172.21.15.53:0/3329439981 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9478014680 con 0x7f94800d14c0 2023-06-10T19:03:44.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.661+0000 7f9485842640 1 -- 172.21.15.53:0/3329439981 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9480151a50 con 0x7f94800d14c0 2023-06-10T19:03:44.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.661+0000 7f9485842640 1 -- 172.21.15.53:0/3329439981 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f948004d790 con 0x7f94800d14c0 2023-06-10T19:03:44.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.661+0000 7f9467fff640 1 -- 172.21.15.53:0/3329439981 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f947801d3b0 con 0x7f94800d14c0 2023-06-10T19:03:44.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.661+0000 7f9467fff640 1 --2- 172.21.15.53:0/3329439981 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f946c066280 0x7f946c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:44.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.661+0000 7f9467fff640 1 -- 172.21.15.53:0/3329439981 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f9478083910 con 0x7f94800d14c0 2023-06-10T19:03:44.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.661+0000 7f947effd640 1 --2- 172.21.15.53:0/3329439981 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f946c066280 0x7f946c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:44.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.661+0000 7f947effd640 1 --2- 172.21.15.53:0/3329439981 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f946c066280 0x7f946c068730 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f94700ad000 tx=0x7f94700a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:44.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.665+0000 7f9467fff640 1 -- 172.21.15.53:0/3329439981 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9478051040 con 0x7f94800d14c0 2023-06-10T19:03:44.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.873+0000 7f9485842640 1 -- 172.21.15.53:0/3329439981 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f9480152b90 con 0x7f94800d14c0 2023-06-10T19:03:44.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.873+0000 7f9467fff640 1 -- 172.21.15.53:0/3329439981 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f9478054660 con 0x7f94800d14c0 2023-06-10T19:03:44.877 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:03:44.877 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-06-10T19:03:44.877 INFO:teuthology.orchestra.run.smithi053.stdout: "auth_dump": [ 2023-06-10T19:03:44.877 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:03:44.877 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.a", 2023-06-10T19:03:44.877 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkWqEQBhAAW+iEw0Gxfw744rsYc/tfTQ==", 2023-06-10T19:03:44.877 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:03:44.878 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T19:03:44.878 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2023-06-10T19:03:44.878 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2023-06-10T19:03:44.878 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:03:44.878 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:03:44.879 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:03:44.879 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:03:44.879 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.b", 2023-06-10T19:03:44.879 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkSu02FRAAFpo6NpcwDLZUt2Rgk/wm8w==", 2023-06-10T19:03:44.879 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:03:44.879 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T19:03:44.879 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2023-06-10T19:03:44.879 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2023-06-10T19:03:44.880 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:03:44.880 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:03:44.880 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:03:44.880 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:03:44.880 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.c", 2023-06-10T19:03:44.880 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRk19/ODhAAodfGGNLP7UbNhHySgaukrg==", 2023-06-10T19:03:44.880 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:03:44.881 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T19:03:44.881 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2023-06-10T19:03:44.881 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2023-06-10T19:03:44.881 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:03:44.881 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:03:44.881 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:03:44.881 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:03:44.881 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.d", 2023-06-10T19:03:44.882 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkogwkGxAAIavVKa8GtML1XQDEMwwokQ==", 2023-06-10T19:03:44.882 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:03:44.882 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T19:03:44.882 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2023-06-10T19:03:44.882 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2023-06-10T19:03:44.883 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:03:44.883 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:03:44.883 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:03:44.883 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:03:44.883 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.0", 2023-06-10T19:03:44.883 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA7xoRkoj1OMhAAYFc4W5kAlMBqY2yzeJZXQw==", 2023-06-10T19:03:44.884 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:03:44.884 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T19:03:44.884 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T19:03:44.884 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:03:44.884 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:03:44.884 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:03:44.884 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:03:44.885 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.1", 2023-06-10T19:03:44.885 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA+xoRk6FpDOBAALjxW3eaIh3Gu9b1rmMmqfw==", 2023-06-10T19:03:44.885 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:03:44.885 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T19:03:44.885 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T19:03:44.885 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:03:44.885 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:03:44.885 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:03:44.886 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:03:44.886 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.2", 2023-06-10T19:03:44.886 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBCxoRkaO2GBRAA0Xr5en+n5DxhZDg8kVswpQ==", 2023-06-10T19:03:44.886 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:03:44.886 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T19:03:44.886 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T19:03:44.886 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:03:44.886 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:03:44.887 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:03:44.887 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:03:44.887 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.3", 2023-06-10T19:03:44.887 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBFxoRkjfsBDhAAArYYrPnmXu5VcUMGVjQXZg==", 2023-06-10T19:03:44.887 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:03:44.887 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T19:03:44.887 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T19:03:44.888 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:03:44.888 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:03:44.888 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:03:44.888 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:03:44.888 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.4", 2023-06-10T19:03:44.889 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBLxoRkybumChAAdym/nl9bzyI71flvuy9Vtw==", 2023-06-10T19:03:44.889 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:03:44.889 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T19:03:44.889 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T19:03:44.889 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:03:44.889 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:03:44.890 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:03:44.890 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:03:44.890 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.5", 2023-06-10T19:03:44.890 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBOxoRkinSGIRAAwLbgYKI4NsbHKqGo9O4WuQ==", 2023-06-10T19:03:44.890 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:03:44.890 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T19:03:44.891 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T19:03:44.891 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:03:44.891 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:03:44.891 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:03:44.891 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:03:44.891 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.6", 2023-06-10T19:03:44.891 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBRxoRkj7VlKRAAs2ReBZ5iqtr17Nli9kUtGQ==", 2023-06-10T19:03:44.892 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:03:44.892 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T19:03:44.892 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T19:03:44.892 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:03:44.892 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:03:44.892 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:03:44.893 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:03:44.893 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.7", 2023-06-10T19:03:44.893 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBUxoRk48CnMhAASfbeuCo9jDuHQrYDQ8Vt3A==", 2023-06-10T19:03:44.893 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:03:44.893 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T19:03:44.893 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T19:03:44.893 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:03:44.893 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:03:44.894 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:03:44.894 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:03:44.894 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.0", 2023-06-10T19:03:44.894 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkgey1IBAAkNYrXMgUOnavBY/5uGyFrw==", 2023-06-10T19:03:44.894 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:03:44.894 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T19:03:44.894 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow r", 2023-06-10T19:03:44.895 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-06-10T19:03:44.895 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:03:44.895 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:03:44.895 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:03:44.895 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.1", 2023-06-10T19:03:44.895 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkBw+UKBAAuvT+vXmJLG5CvQVg5xItDQ==", 2023-06-10T19:03:44.895 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:03:44.895 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T19:03:44.896 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow r", 2023-06-10T19:03:44.896 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow rw", 2023-06-10T19:03:44.896 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rwx" 2023-06-10T19:03:44.896 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:03:44.896 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:03:44.896 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:03:44.896 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.2", 2023-06-10T19:03:44.896 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkewjeJRAA4pmIEVJ3Z7GKQFmA54CZ5Q==", 2023-06-10T19:03:44.897 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:03:44.897 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T19:03:44.897 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow r", 2023-06-10T19:03:44.897 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow rw", 2023-06-10T19:03:44.897 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rwx" 2023-06-10T19:03:44.897 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:03:44.897 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:03:44.897 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:03:44.898 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.3", 2023-06-10T19:03:44.898 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkHwCiLRAAWGt8UoWxGlG1Y1zSPbKUCg==", 2023-06-10T19:03:44.898 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:03:44.898 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T19:03:44.898 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow r", 2023-06-10T19:03:44.898 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow rw", 2023-06-10T19:03:44.898 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rwx" 2023-06-10T19:03:44.898 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:03:44.899 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:03:44.899 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:03:44.899 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.admin", 2023-06-10T19:03:44.899 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA5xoRkIVgrKBAABIxiaOPe9h5ne2y2l50aMg==", 2023-06-10T19:03:44.899 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:03:44.899 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow *", 2023-06-10T19:03:44.899 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2023-06-10T19:03:44.900 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2023-06-10T19:03:44.900 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:03:44.900 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:03:44.900 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:03:44.900 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:03:44.900 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mgr.x", 2023-06-10T19:03:44.900 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkzWG3AhAAh3NFYHAbp4fgn4FZeRRNuw==", 2023-06-10T19:03:44.901 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:03:44.901 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow *", 2023-06-10T19:03:44.901 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile mgr", 2023-06-10T19:03:44.901 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:03:44.901 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:03:44.901 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:03:44.901 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:03:44.902 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mgr.y", 2023-06-10T19:03:44.902 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA5xoRkBriKOxAA6G+T7Yp2rH7XV7z37lvMYQ==", 2023-06-10T19:03:44.902 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:03:44.902 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow *", 2023-06-10T19:03:44.902 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile mgr", 2023-06-10T19:03:44.902 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:03:44.902 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:03:44.902 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:03:44.903 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2023-06-10T19:03:44.903 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-06-10T19:03:44.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.873+0000 7f9485842640 1 -- 172.21.15.53:0/3329439981 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f946c066280 msgr2=0x7f946c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:44.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.873+0000 7f9485842640 1 --2- 172.21.15.53:0/3329439981 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f946c066280 0x7f946c068730 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f94700ad000 tx=0x7f94700a6000 comp rx=0 tx=0).stop 2023-06-10T19:03:44.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.873+0000 7f9485842640 1 -- 172.21.15.53:0/3329439981 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f94800d14c0 msgr2=0x7f9480153f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:44.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.873+0000 7f9485842640 1 --2- 172.21.15.53:0/3329439981 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f94800d14c0 0x7f9480153f00 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7f947800b970 tx=0x7f947800be30 comp rx=0 tx=0).stop 2023-06-10T19:03:44.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.873+0000 7f9485842640 1 -- 172.21.15.53:0/3329439981 shutdown_connections 2023-06-10T19:03:44.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.873+0000 7f9485842640 1 --2- 172.21.15.53:0/3329439981 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f946c066280 0x7f946c068730 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:44.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.873+0000 7f9485842640 1 --2- 172.21.15.53:0/3329439981 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f94800d14c0 0x7f9480153f00 unknown :-1 s=CLOSED pgs=1690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:44.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.873+0000 7f9485842640 1 --2- 172.21.15.53:0/3329439981 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94800cc690 0x7f948014d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:44.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.873+0000 7f9485842640 1 --2- 172.21.15.53:0/3329439981 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94800b3ac0 0x7f9480151510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:44.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.873+0000 7f9485842640 1 -- 172.21.15.53:0/3329439981 >> 172.21.15.53:0/3329439981 conn(0x7f9480071790 msgr2=0x7f94800ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:44.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.873+0000 7f9485842640 1 -- 172.21.15.53:0/3329439981 shutdown_connections 2023-06-10T19:03:44.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:44.873+0000 7f9485842640 1 -- 172.21.15.53:0/3329439981 wait complete. 2023-06-10T19:03:44.906 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:03:45.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.013+0000 7fa56dcd0640 1 Processor -- start 2023-06-10T19:03:45.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.013+0000 7fa56dcd0640 1 -- start start 2023-06-10T19:03:45.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.013+0000 7fa56dcd0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa568157e10 0x7fa56806efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:45.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.013+0000 7fa56dcd0640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa5680afe30 0x7fa5680ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:45.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.013+0000 7fa56dcd0640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5680c9e50 con 0x7fa56806bb30 2023-06-10T19:03:45.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.013+0000 7fa56dcd0640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5680cd520 con 0x7fa5680afe30 2023-06-10T19:03:45.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.013+0000 7fa56dcd0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5680c82f0 con 0x7fa568157e10 2023-06-10T19:03:45.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.013+0000 7fa566ffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fa56806bb30 0x7fa5680af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60484/0 (socket says 172.21.15.53:60484) 2023-06-10T19:03:45.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.013+0000 7fa566ffd640 1 -- 172.21.15.53:0/1088426864 learned_addr learned my addr 172.21.15.53:0/1088426864 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:03:45.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.013+0000 7fa5677fe640 1 --2- 172.21.15.53:0/1088426864 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa568157e10 0x7fa56806efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:45.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.013+0000 7fa567fff640 1 --2- 172.21.15.53:0/1088426864 >> v2:172.21.15.117:3300/0 conn(0x7fa5680afe30 0x7fa5680ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:45.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.013+0000 7fa5667fc640 1 -- 172.21.15.53:0/1088426864 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1265818635 0 0) 0x7fa5680c9e50 con 0x7fa56806bb30 2023-06-10T19:03:45.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.013+0000 7fa5667fc640 1 -- 172.21.15.53:0/1088426864 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa554003530 con 0x7fa56806bb30 2023-06-10T19:03:45.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.013+0000 7fa5667fc640 1 -- 172.21.15.53:0/1088426864 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2056237834 0 0) 0x7fa554003530 con 0x7fa56806bb30 2023-06-10T19:03:45.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.013+0000 7fa5667fc640 1 -- 172.21.15.53:0/1088426864 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa568157e10 msgr2=0x7fa56806efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:45.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.013+0000 7fa5667fc640 1 --2- 172.21.15.53:0/1088426864 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa568157e10 0x7fa56806efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:45.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.013+0000 7fa5667fc640 1 -- 172.21.15.53:0/1088426864 >> v2:172.21.15.117:3300/0 conn(0x7fa5680afe30 msgr2=0x7fa5680ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:45.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.013+0000 7fa5667fc640 1 --2- 172.21.15.53:0/1088426864 >> v2:172.21.15.117:3300/0 conn(0x7fa5680afe30 0x7fa5680ccfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:45.020 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.013+0000 7fa5667fc640 1 -- 172.21.15.53:0/1088426864 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa56806bf80 con 0x7fa56806bb30 2023-06-10T19:03:45.020 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.013+0000 7fa5667fc640 1 -- 172.21.15.53:0/1088426864 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fa550001a00 con 0x7fa56806bb30 2023-06-10T19:03:45.020 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.013+0000 7fa5667fc640 1 -- 172.21.15.53:0/1088426864 >> v1:172.21.15.53:6789/0 conn(0x7fa56806bb30 legacy=0x7fa5680af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:45.020 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.013+0000 7fa5667fc640 1 --2- 172.21.15.53:0/1088426864 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa568157e10 0x7fa5540039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:45.020 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.013+0000 7fa5667fc640 1 --2- 172.21.15.53:0/1088426864 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa554003f70 0x7fa5540047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:45.020 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.013+0000 7fa5667fc640 1 --2- 172.21.15.53:0/1088426864 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa554004d10 0x7fa554005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:45.020 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.013+0000 7fa5667fc640 1 -- 172.21.15.53:0/1088426864 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5680cd520 con 0x7fa554004d10 2023-06-10T19:03:45.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.013+0000 7fa5667fc640 1 -- 172.21.15.53:0/1088426864 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5680c82f0 con 0x7fa554003f70 2023-06-10T19:03:45.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.013+0000 7fa5667fc640 1 -- 172.21.15.53:0/1088426864 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa55400ba40 con 0x7fa568157e10 2023-06-10T19:03:45.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.013+0000 7fa567fff640 1 --2- 172.21.15.53:0/1088426864 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa554004d10 0x7fa554005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:45.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.013+0000 7fa566ffd640 1 --2- 172.21.15.53:0/1088426864 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa554003f70 0x7fa5540047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:45.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.013+0000 7fa567fff640 1 -- 172.21.15.53:0/1088426864 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa568157e10 msgr2=0x7fa5540039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:45.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.013+0000 7fa567fff640 1 --2- 172.21.15.53:0/1088426864 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa568157e10 0x7fa5540039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:45.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.013+0000 7fa567fff640 1 -- 172.21.15.53:0/1088426864 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa554003f70 msgr2=0x7fa5540047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:45.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.013+0000 7fa567fff640 1 --2- 172.21.15.53:0/1088426864 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa554003f70 0x7fa5540047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:45.022 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.013+0000 7fa567fff640 1 -- 172.21.15.53:0/1088426864 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa554003530 con 0x7fa554004d10 2023-06-10T19:03:45.024 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.017+0000 7fa567fff640 1 --2- 172.21.15.53:0/1088426864 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa554004d10 0x7fa554005180 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7fa5680cdc70 tx=0x7fa56001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88211216c5d3152e server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:45.024 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.017+0000 7fa5667fc640 1 -- 172.21.15.53:0/1088426864 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5600a5620 con 0x7fa554004d10 2023-06-10T19:03:45.024 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.017+0000 7fa5667fc640 1 -- 172.21.15.53:0/1088426864 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5600a5780 con 0x7fa554004d10 2023-06-10T19:03:45.024 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.017+0000 7fa5667fc640 1 -- 172.21.15.53:0/1088426864 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5600a5b30 con 0x7fa554004d10 2023-06-10T19:03:45.024 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.017+0000 7fa56dcd0640 1 -- 172.21.15.53:0/1088426864 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa554004d10 msgr2=0x7fa554005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:45.024 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.017+0000 7fa56dcd0640 1 --2- 172.21.15.53:0/1088426864 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa554004d10 0x7fa554005180 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7fa5680cdc70 tx=0x7fa56001ca30 comp rx=0 tx=0).stop 2023-06-10T19:03:45.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.017+0000 7fa567fff640 1 -- 172.21.15.53:0/1088426864 reap_dead start 2023-06-10T19:03:45.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.017+0000 7fa56dcd0640 1 -- 172.21.15.53:0/1088426864 shutdown_connections 2023-06-10T19:03:45.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.017+0000 7fa56dcd0640 1 -- 172.21.15.53:0/1088426864 >> 172.21.15.53:0/1088426864 conn(0x7fa56806a0d0 msgr2=0x7fa5680ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:45.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.017+0000 7fa56dcd0640 1 -- 172.21.15.53:0/1088426864 shutdown_connections 2023-06-10T19:03:45.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.017+0000 7fa56dcd0640 1 -- 172.21.15.53:0/1088426864 wait complete. 2023-06-10T19:03:45.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.017+0000 7fa56dcd0640 1 Processor -- start 2023-06-10T19:03:45.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.017+0000 7fa56dcd0640 1 -- start start 2023-06-10T19:03:45.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.017+0000 7fa56dcd0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa554004d10 0x7fa568145710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:45.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.017+0000 7fa56dcd0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa5680b0b40 0x7fa5680c3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:45.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.017+0000 7fa56dcd0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5680b33b0 0x7fa5680af060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:45.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.017+0000 7fa56dcd0640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5680b2f20 con 0x7fa5680b0b40 2023-06-10T19:03:45.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.017+0000 7fa56dcd0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa568145c50 con 0x7fa5680b33b0 2023-06-10T19:03:45.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.017+0000 7fa56dcd0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5680b2630 con 0x7fa554004d10 2023-06-10T19:03:45.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.017+0000 7fa566ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa5680b0b40 0x7fa5680c3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:45.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.017+0000 7fa566ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa5680b0b40 0x7fa5680c3b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56794/0 (socket says 172.21.15.53:56794) 2023-06-10T19:03:45.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.017+0000 7fa566ffd640 1 -- 172.21.15.53:0/1284262247 learned_addr learned my addr 172.21.15.53:0/1284262247 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:45.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.021+0000 7fa5677fe640 1 --2- 172.21.15.53:0/1284262247 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa554004d10 0x7fa568145710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:45.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.021+0000 7fa567fff640 1 --2- 172.21.15.53:0/1284262247 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5680b33b0 0x7fa5680af060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:45.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.021+0000 7fa566ffd640 1 -- 172.21.15.53:0/1284262247 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa554004d10 msgr2=0x7fa568145710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:45.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.021+0000 7fa566ffd640 1 --2- 172.21.15.53:0/1284262247 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa554004d10 0x7fa568145710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:45.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.021+0000 7fa566ffd640 1 -- 172.21.15.53:0/1284262247 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5680b33b0 msgr2=0x7fa5680af060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:45.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.021+0000 7fa566ffd640 1 --2- 172.21.15.53:0/1284262247 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5680b33b0 0x7fa5680af060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:45.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.021+0000 7fa566ffd640 1 -- 172.21.15.53:0/1284262247 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5680c4430 con 0x7fa5680b0b40 2023-06-10T19:03:45.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.021+0000 7fa566ffd640 1 --2- 172.21.15.53:0/1284262247 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa5680b0b40 0x7fa5680c3b30 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7fa550004c00 tx=0x7fa55000e4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:45.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.021+0000 7fa55ffff640 1 -- 172.21.15.53:0/1284262247 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa550010ea0 con 0x7fa5680b0b40 2023-06-10T19:03:45.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.021+0000 7fa55ffff640 1 -- 172.21.15.53:0/1284262247 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5500143a0 con 0x7fa5680b0b40 2023-06-10T19:03:45.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.021+0000 7fa55ffff640 1 -- 172.21.15.53:0/1284262247 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa550014710 con 0x7fa5680b0b40 2023-06-10T19:03:45.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.021+0000 7fa56dcd0640 1 -- 172.21.15.53:0/1284262247 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5680b28d0 con 0x7fa5680b0b40 2023-06-10T19:03:45.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.021+0000 7fa56dcd0640 1 -- 172.21.15.53:0/1284262247 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5680c4070 con 0x7fa5680b0b40 2023-06-10T19:03:45.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.021+0000 7fa56dcd0640 1 -- 172.21.15.53:0/1284262247 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa56804d790 con 0x7fa5680b0b40 2023-06-10T19:03:45.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.021+0000 7fa55ffff640 1 -- 172.21.15.53:0/1284262247 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa550014870 con 0x7fa5680b0b40 2023-06-10T19:03:45.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.021+0000 7fa55ffff640 1 --2- 172.21.15.53:0/1284262247 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa548066280 0x7fa548068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:45.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.021+0000 7fa55ffff640 1 -- 172.21.15.53:0/1284262247 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fa550086750 con 0x7fa5680b0b40 2023-06-10T19:03:45.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.021+0000 7fa5677fe640 1 --2- 172.21.15.53:0/1284262247 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa548066280 0x7fa548068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:45.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.021+0000 7fa5677fe640 1 --2- 172.21.15.53:0/1284262247 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa548066280 0x7fa548068730 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fa5580047c0 tx=0x7fa558008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:45.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.025+0000 7fa55ffff640 1 -- 172.21.15.53:0/1284262247 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa550053f20 con 0x7fa5680b0b40 2023-06-10T19:03:45.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.173+0000 7fa56dcd0640 1 -- 172.21.15.53:0/1284262247 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa5680b3060 con 0x7fa5680b0b40 2023-06-10T19:03:45.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.173+0000 7fa55ffff640 1 -- 172.21.15.53:0/1284262247 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v106) v1 ==== 74+0+14629 (secure 0 0 0) 0x7fa550057540 con 0x7fa5680b0b40 2023-06-10T19:03:45.178 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:03:45.178 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":106,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:03:44.481550+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:03:45.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.177+0000 7fa56dcd0640 1 -- 172.21.15.53:0/1284262247 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa548066280 msgr2=0x7fa548068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:45.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.177+0000 7fa56dcd0640 1 --2- 172.21.15.53:0/1284262247 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa548066280 0x7fa548068730 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fa5580047c0 tx=0x7fa558008040 comp rx=0 tx=0).stop 2023-06-10T19:03:45.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.177+0000 7fa56dcd0640 1 -- 172.21.15.53:0/1284262247 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa5680b0b40 msgr2=0x7fa5680c3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:45.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.177+0000 7fa56dcd0640 1 --2- 172.21.15.53:0/1284262247 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa5680b0b40 0x7fa5680c3b30 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7fa550004c00 tx=0x7fa55000e4d0 comp rx=0 tx=0).stop 2023-06-10T19:03:45.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.177+0000 7fa56dcd0640 1 -- 172.21.15.53:0/1284262247 shutdown_connections 2023-06-10T19:03:45.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.177+0000 7fa56dcd0640 1 --2- 172.21.15.53:0/1284262247 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa548066280 0x7fa548068730 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:45.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.177+0000 7fa56dcd0640 1 --2- 172.21.15.53:0/1284262247 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5680b33b0 0x7fa5680af060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:45.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.177+0000 7fa56dcd0640 1 --2- 172.21.15.53:0/1284262247 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa5680b0b40 0x7fa5680c3b30 unknown :-1 s=CLOSED pgs=1693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:45.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.177+0000 7fa56dcd0640 1 --2- 172.21.15.53:0/1284262247 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa554004d10 0x7fa568145710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:45.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.177+0000 7fa56dcd0640 1 -- 172.21.15.53:0/1284262247 >> 172.21.15.53:0/1284262247 conn(0x7fa56806a0d0 msgr2=0x7fa56806ffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:45.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.177+0000 7fa56dcd0640 1 -- 172.21.15.53:0/1284262247 shutdown_connections 2023-06-10T19:03:45.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.177+0000 7fa56dcd0640 1 -- 172.21.15.53:0/1284262247 wait complete. 2023-06-10T19:03:45.196 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-10T18:52:33.633114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-10T18:52:39.171487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-10T19:03:45.197 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-10T19:03:45.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.313+0000 7f63f674c640 1 Processor -- start 2023-06-10T19:03:45.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.313+0000 7f63f674c640 1 -- start start 2023-06-10T19:03:45.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.317+0000 7f63f674c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63f015c070 0x7f63f015c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:45.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.317+0000 7f63f674c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f63f006b800 0x7f63f006bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:45.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.317+0000 7f63f674c640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63f015ca00 con 0x7f63f0156180 2023-06-10T19:03:45.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.317+0000 7f63f674c640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63f006b090 con 0x7f63f006b800 2023-06-10T19:03:45.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.317+0000 7f63f674c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63f006efa0 con 0x7f63f015c070 2023-06-10T19:03:45.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.317+0000 7f63f4ce9640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f63f006b800 0x7f63f006bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:45.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.317+0000 7f63f4ce9640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f63f006b800 0x7f63f006bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.53:56474/0 (socket says 172.21.15.53:56474) 2023-06-10T19:03:45.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.317+0000 7f63f4ce9640 1 -- 172.21.15.53:0/3173909183 learned_addr learned my addr 172.21.15.53:0/3173909183 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:45.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.317+0000 7f63ef7fe640 1 --2- 172.21.15.53:0/3173909183 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63f015c070 0x7f63f015c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:45.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.317+0000 7f63f4ce9640 1 -- 172.21.15.53:0/3173909183 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63f015c070 msgr2=0x7f63f015c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:45.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.317+0000 7f63f4ce9640 1 --2- 172.21.15.53:0/3173909183 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63f015c070 0x7f63f015c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:45.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.317+0000 7f63f4ce9640 1 -- 172.21.15.53:0/3173909183 >> v1:172.21.15.117:6789/0 conn(0x7f63f0156180 legacy=0x7f63f00cd4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:45.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.317+0000 7f63f4ce9640 1 -- 172.21.15.53:0/3173909183 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63f00cc720 con 0x7f63f006b800 2023-06-10T19:03:45.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.317+0000 7f63ef7fe640 1 --2- 172.21.15.53:0/3173909183 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63f015c070 0x7f63f015c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-10T19:03:45.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.317+0000 7f63f4ce9640 1 --2- 172.21.15.53:0/3173909183 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63f006b800 0x7f63f006bc20 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f63e8009e50 tx=0x7f63e801ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7e52f5c6f7fd6a7 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:45.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.321+0000 7f63eeffd640 1 -- 172.21.15.53:0/3173909183 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e80a57d0 con 0x7f63f006b800 2023-06-10T19:03:45.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.321+0000 7f63eeffd640 1 -- 172.21.15.53:0/3173909183 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63e80a5930 con 0x7f63f006b800 2023-06-10T19:03:45.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.321+0000 7f63eeffd640 1 -- 172.21.15.53:0/3173909183 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e80a5cc0 con 0x7f63f006b800 2023-06-10T19:03:45.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.321+0000 7f63f674c640 1 -- 172.21.15.53:0/3173909183 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63f006b800 msgr2=0x7f63f006bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:45.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.321+0000 7f63f674c640 1 --2- 172.21.15.53:0/3173909183 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63f006b800 0x7f63f006bc20 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f63e8009e50 tx=0x7f63e801ca10 comp rx=0 tx=0).stop 2023-06-10T19:03:45.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.321+0000 7f63f674c640 1 -- 172.21.15.53:0/3173909183 shutdown_connections 2023-06-10T19:03:45.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.321+0000 7f63f674c640 1 --2- 172.21.15.53:0/3173909183 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63f006b800 0x7f63f006bc20 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:45.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.321+0000 7f63f674c640 1 --2- 172.21.15.53:0/3173909183 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63f015c070 0x7f63f015c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:45.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.321+0000 7f63f674c640 1 -- 172.21.15.53:0/3173909183 >> 172.21.15.53:0/3173909183 conn(0x7f63f006a0e0 msgr2=0x7f63f00cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:45.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.321+0000 7f63f674c640 1 -- 172.21.15.53:0/3173909183 shutdown_connections 2023-06-10T19:03:45.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.321+0000 7f63f674c640 1 -- 172.21.15.53:0/3173909183 wait complete. 2023-06-10T19:03:45.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.321+0000 7f63f674c640 1 Processor -- start 2023-06-10T19:03:45.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.321+0000 7f63f674c640 1 -- start start 2023-06-10T19:03:45.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.321+0000 7f63f674c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63f006b800 0x7f63f00c3270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:45.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.321+0000 7f63f674c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63f0156180 0x7f63f00705a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:45.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.321+0000 7f63f674c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63f015c070 0x7f63f00c1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:45.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.321+0000 7f63f674c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63f00c2de0 con 0x7f63f0156180 2023-06-10T19:03:45.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.321+0000 7f63f674c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63f00c21d0 con 0x7f63f006b800 2023-06-10T19:03:45.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.321+0000 7f63f674c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63f00c24b0 con 0x7f63f015c070 2023-06-10T19:03:45.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.325+0000 7f63ef7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63f0156180 0x7f63f00705a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:45.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.325+0000 7f63ef7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63f0156180 0x7f63f00705a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56810/0 (socket says 172.21.15.53:56810) 2023-06-10T19:03:45.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.325+0000 7f63ef7fe640 1 -- 172.21.15.53:0/2850310025 learned_addr learned my addr 172.21.15.53:0/2850310025 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:45.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.325+0000 7f63effff640 1 --2- 172.21.15.53:0/2850310025 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63f006b800 0x7f63f00c3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:45.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.325+0000 7f63f4ce9640 1 --2- 172.21.15.53:0/2850310025 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63f015c070 0x7f63f00c1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:45.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.325+0000 7f63ef7fe640 1 -- 172.21.15.53:0/2850310025 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63f015c070 msgr2=0x7f63f00c1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:45.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.325+0000 7f63ef7fe640 1 --2- 172.21.15.53:0/2850310025 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63f015c070 0x7f63f00c1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:45.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.325+0000 7f63ef7fe640 1 -- 172.21.15.53:0/2850310025 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63f006b800 msgr2=0x7f63f00c3270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:45.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.325+0000 7f63ef7fe640 1 --2- 172.21.15.53:0/2850310025 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63f006b800 0x7f63f00c3270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:45.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.325+0000 7f63ef7fe640 1 -- 172.21.15.53:0/2850310025 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e0009420 con 0x7f63f0156180 2023-06-10T19:03:45.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.325+0000 7f63f4ce9640 1 --2- 172.21.15.53:0/2850310025 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63f015c070 0x7f63f00c1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:03:45.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.325+0000 7f63ef7fe640 1 --2- 172.21.15.53:0/2850310025 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63f0156180 0x7f63f00705a0 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7f63e000e980 tx=0x7f63e000ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:45.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.325+0000 7f63ecff9640 1 -- 172.21.15.53:0/2850310025 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e000ca00 con 0x7f63f0156180 2023-06-10T19:03:45.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.325+0000 7f63ecff9640 1 -- 172.21.15.53:0/2850310025 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63e000cb60 con 0x7f63f0156180 2023-06-10T19:03:45.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.325+0000 7f63f674c640 1 -- 172.21.15.53:0/2850310025 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63e8009b30 con 0x7f63f0156180 2023-06-10T19:03:45.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.325+0000 7f63ecff9640 1 -- 172.21.15.53:0/2850310025 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e0013470 con 0x7f63f0156180 2023-06-10T19:03:45.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.325+0000 7f63f674c640 1 -- 172.21.15.53:0/2850310025 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63f00c2a70 con 0x7f63f0156180 2023-06-10T19:03:45.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.325+0000 7f63f674c640 1 -- 172.21.15.53:0/2850310025 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63f004d790 con 0x7f63f0156180 2023-06-10T19:03:45.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.325+0000 7f63ecff9640 1 -- 172.21.15.53:0/2850310025 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f63e00135d0 con 0x7f63f0156180 2023-06-10T19:03:45.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.325+0000 7f63ecff9640 1 --2- 172.21.15.53:0/2850310025 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f63dc0662b0 0x7f63dc068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:45.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.325+0000 7f63ecff9640 1 -- 172.21.15.53:0/2850310025 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f63e0083b30 con 0x7f63f0156180 2023-06-10T19:03:45.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.325+0000 7f63effff640 1 --2- 172.21.15.53:0/2850310025 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f63dc0662b0 0x7f63dc068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:45.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.325+0000 7f63effff640 1 --2- 172.21.15.53:0/2850310025 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f63dc0662b0 0x7f63dc068760 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f63e4007fd0 tx=0x7f63e4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:45.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.329+0000 7f63ecff9640 1 -- 172.21.15.53:0/2850310025 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f63e00513b0 con 0x7f63f0156180 2023-06-10T19:03:45.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.485+0000 7f63f674c640 1 -- 172.21.15.53:0/2850310025 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f63f01631e0 con 0x7f63f0156180 2023-06-10T19:03:45.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.485+0000 7f63ecff9640 1 -- 172.21.15.53:0/2850310025 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v106) v1 ==== 93+0+10 (secure 0 0 0) 0x7f63e00549d0 con 0x7f63f0156180 2023-06-10T19:03:45.489 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-06-10T19:03:45.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.489+0000 7f63f674c640 1 -- 172.21.15.53:0/2850310025 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f63dc0662b0 msgr2=0x7f63dc068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:45.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.489+0000 7f63f674c640 1 --2- 172.21.15.53:0/2850310025 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f63dc0662b0 0x7f63dc068760 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f63e4007fd0 tx=0x7f63e4009040 comp rx=0 tx=0).stop 2023-06-10T19:03:45.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.489+0000 7f63f674c640 1 -- 172.21.15.53:0/2850310025 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63f0156180 msgr2=0x7f63f00705a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:45.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.489+0000 7f63f674c640 1 --2- 172.21.15.53:0/2850310025 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63f0156180 0x7f63f00705a0 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7f63e000e980 tx=0x7f63e000ee40 comp rx=0 tx=0).stop 2023-06-10T19:03:45.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.489+0000 7f63f674c640 1 -- 172.21.15.53:0/2850310025 shutdown_connections 2023-06-10T19:03:45.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.489+0000 7f63f674c640 1 --2- 172.21.15.53:0/2850310025 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f63dc0662b0 0x7f63dc068760 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:45.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.489+0000 7f63f674c640 1 --2- 172.21.15.53:0/2850310025 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63f015c070 0x7f63f00c1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:45.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.489+0000 7f63f674c640 1 --2- 172.21.15.53:0/2850310025 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63f0156180 0x7f63f00705a0 unknown :-1 s=CLOSED pgs=1694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:45.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.489+0000 7f63f674c640 1 --2- 172.21.15.53:0/2850310025 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63f006b800 0x7f63f00c3270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:45.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.489+0000 7f63f674c640 1 -- 172.21.15.53:0/2850310025 >> 172.21.15.53:0/2850310025 conn(0x7f63f006a0e0 msgr2=0x7f63f0156c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:45.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.489+0000 7f63f674c640 1 -- 172.21.15.53:0/2850310025 shutdown_connections 2023-06-10T19:03:45.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.489+0000 7f63f674c640 1 -- 172.21.15.53:0/2850310025 wait complete. 2023-06-10T19:03:45.509 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-10T19:03:45.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.621+0000 7f5059741640 1 Processor -- start 2023-06-10T19:03:45.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.621+0000 7f5059741640 1 -- start start 2023-06-10T19:03:45.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.621+0000 7f5059741640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f505415c060 0x7f50540cc020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:45.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.621+0000 7f5059741640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5054070de0 0x7f505415c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:45.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.621+0000 7f5059741640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50540c8d50 con 0x7f505415c970 2023-06-10T19:03:45.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.621+0000 7f5059741640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50540c9030 con 0x7f505415c060 2023-06-10T19:03:45.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.621+0000 7f5059741640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5054070300 con 0x7f5054070de0 2023-06-10T19:03:45.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.621+0000 7f5052ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f505415c060 0x7f50540cc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:45.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.621+0000 7f5052ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f505415c060 0x7f50540cc020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56824/0 (socket says 172.21.15.53:56824) 2023-06-10T19:03:45.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.621+0000 7f5052ffd640 1 -- 172.21.15.53:0/1031025105 learned_addr learned my addr 172.21.15.53:0/1031025105 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:45.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.621+0000 7f50527fc640 1 --2- 172.21.15.53:0/1031025105 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5054070de0 0x7f505415c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:45.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.621+0000 7f5052ffd640 1 -- 172.21.15.53:0/1031025105 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5054070de0 msgr2=0x7f505415c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:45.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.621+0000 7f5052ffd640 1 --2- 172.21.15.53:0/1031025105 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5054070de0 0x7f505415c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:45.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.621+0000 7f5052ffd640 1 -- 172.21.15.53:0/1031025105 >> v1:172.21.15.117:6789/0 conn(0x7f505415c970 legacy=0x7f505406bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:45.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.621+0000 7f5052ffd640 1 -- 172.21.15.53:0/1031025105 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50540705e0 con 0x7f505415c060 2023-06-10T19:03:45.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.625+0000 7f5052ffd640 1 --2- 172.21.15.53:0/1031025105 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f505415c060 0x7f50540cc020 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7f5044009870 tx=0x7f504401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d4a795913a146aa server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:45.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.625+0000 7f5051ffb640 1 -- 172.21.15.53:0/1031025105 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50440ab600 con 0x7f505415c060 2023-06-10T19:03:45.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.625+0000 7f5051ffb640 1 -- 172.21.15.53:0/1031025105 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50440a7050 con 0x7f505415c060 2023-06-10T19:03:45.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.625+0000 7f5051ffb640 1 -- 172.21.15.53:0/1031025105 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50440ab980 con 0x7f505415c060 2023-06-10T19:03:45.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.625+0000 7f5059741640 1 -- 172.21.15.53:0/1031025105 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f505415c060 msgr2=0x7f50540cc020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:45.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.625+0000 7f5059741640 1 --2- 172.21.15.53:0/1031025105 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f505415c060 0x7f50540cc020 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7f5044009870 tx=0x7f504401c470 comp rx=0 tx=0).stop 2023-06-10T19:03:45.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.625+0000 7f5059741640 1 -- 172.21.15.53:0/1031025105 shutdown_connections 2023-06-10T19:03:45.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.625+0000 7f5059741640 1 --2- 172.21.15.53:0/1031025105 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5054070de0 0x7f505415c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:45.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.625+0000 7f5059741640 1 --2- 172.21.15.53:0/1031025105 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f505415c060 0x7f50540cc020 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:45.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.625+0000 7f5059741640 1 -- 172.21.15.53:0/1031025105 >> 172.21.15.53:0/1031025105 conn(0x7f505406a0e0 msgr2=0x7f50540cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:45.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.625+0000 7f5059741640 1 -- 172.21.15.53:0/1031025105 shutdown_connections 2023-06-10T19:03:45.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.625+0000 7f5059741640 1 -- 172.21.15.53:0/1031025105 wait complete. 2023-06-10T19:03:45.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.625+0000 7f5059741640 1 Processor -- start 2023-06-10T19:03:45.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.625+0000 7f5059741640 1 -- start start 2023-06-10T19:03:45.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.625+0000 7f5059741640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5054070de0 0x7f505414ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:45.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.625+0000 7f5059741640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f505415c060 0x7f50540c30f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:45.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.625+0000 7f5059741640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f505415c970 0x7f505414e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:45.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.629+0000 7f5059741640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f505414e2f0 con 0x7f505415c060 2023-06-10T19:03:45.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.629+0000 7f5059741640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50540b1300 con 0x7f5054070de0 2023-06-10T19:03:45.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.629+0000 7f5059741640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50540c3a60 con 0x7f505415c970 2023-06-10T19:03:45.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.629+0000 7f50527fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f505415c060 0x7f50540c30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:45.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.629+0000 7f50527fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f505415c060 0x7f50540c30f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56828/0 (socket says 172.21.15.53:56828) 2023-06-10T19:03:45.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.629+0000 7f50527fc640 1 -- 172.21.15.53:0/2455609595 learned_addr learned my addr 172.21.15.53:0/2455609595 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:45.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.629+0000 7f5052ffd640 1 --2- 172.21.15.53:0/2455609595 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5054070de0 0x7f505414ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:45.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.629+0000 7f50537fe640 1 --2- 172.21.15.53:0/2455609595 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f505415c970 0x7f505414e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:45.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.629+0000 7f50527fc640 1 -- 172.21.15.53:0/2455609595 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f505415c970 msgr2=0x7f505414e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:45.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.629+0000 7f50527fc640 1 --2- 172.21.15.53:0/2455609595 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f505415c970 0x7f505414e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:45.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.629+0000 7f50527fc640 1 -- 172.21.15.53:0/2455609595 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5054070de0 msgr2=0x7f505414ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:45.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.629+0000 7f50527fc640 1 --2- 172.21.15.53:0/2455609595 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5054070de0 0x7f505414ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:45.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.629+0000 7f50527fc640 1 -- 172.21.15.53:0/2455609595 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50440094d0 con 0x7f505415c060 2023-06-10T19:03:45.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.629+0000 7f50527fc640 1 --2- 172.21.15.53:0/2455609595 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f505415c060 0x7f50540c30f0 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7f504800c7f0 tx=0x7f504800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:45.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.629+0000 7f503b7fe640 1 -- 172.21.15.53:0/2455609595 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5048007820 con 0x7f505415c060 2023-06-10T19:03:45.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.629+0000 7f503b7fe640 1 -- 172.21.15.53:0/2455609595 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5048007980 con 0x7f505415c060 2023-06-10T19:03:45.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.629+0000 7f5059741640 1 -- 172.21.15.53:0/2455609595 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5054158950 con 0x7f505415c060 2023-06-10T19:03:45.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.629+0000 7f503b7fe640 1 -- 172.21.15.53:0/2455609595 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5048007d30 con 0x7f505415c060 2023-06-10T19:03:45.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.629+0000 7f5059741640 1 -- 172.21.15.53:0/2455609595 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50540b0f90 con 0x7f505415c060 2023-06-10T19:03:45.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.629+0000 7f5059741640 1 -- 172.21.15.53:0/2455609595 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50540b0b10 con 0x7f505415c060 2023-06-10T19:03:45.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.629+0000 7f503b7fe640 1 -- 172.21.15.53:0/2455609595 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5048024480 con 0x7f505415c060 2023-06-10T19:03:45.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.629+0000 7f503b7fe640 1 --2- 172.21.15.53:0/2455609595 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5040066280 0x7f5040068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:45.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.629+0000 7f503b7fe640 1 -- 172.21.15.53:0/2455609595 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f5048083d80 con 0x7f505415c060 2023-06-10T19:03:45.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.629+0000 7f5052ffd640 1 --2- 172.21.15.53:0/2455609595 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5040066280 0x7f5040068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:45.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.633+0000 7f5052ffd640 1 --2- 172.21.15.53:0/2455609595 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5040066280 0x7f5040068730 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f50540ceb60 tx=0x7f50440a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:45.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.633+0000 7f503b7fe640 1 -- 172.21.15.53:0/2455609595 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5048051770 con 0x7f505415c060 2023-06-10T19:03:45.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.781+0000 7f5059741640 1 -- 172.21.15.53:0/2455609595 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f50540b0b10 con 0x7f505415c060 2023-06-10T19:03:45.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.781+0000 7f503b7fe640 1 -- 172.21.15.53:0/2455609595 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v106) v1 ==== 92+0+10 (secure 0 0 0) 0x7f504801f020 con 0x7f505415c060 2023-06-10T19:03:45.787 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-06-10T19:03:45.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.785+0000 7f5059741640 1 -- 172.21.15.53:0/2455609595 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5040066280 msgr2=0x7f5040068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:45.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.785+0000 7f5059741640 1 --2- 172.21.15.53:0/2455609595 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5040066280 0x7f5040068730 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f50540ceb60 tx=0x7f50440a6000 comp rx=0 tx=0).stop 2023-06-10T19:03:45.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.785+0000 7f5059741640 1 -- 172.21.15.53:0/2455609595 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f505415c060 msgr2=0x7f50540c30f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:45.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.785+0000 7f5059741640 1 --2- 172.21.15.53:0/2455609595 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f505415c060 0x7f50540c30f0 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7f504800c7f0 tx=0x7f504800ccb0 comp rx=0 tx=0).stop 2023-06-10T19:03:45.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.785+0000 7f5059741640 1 -- 172.21.15.53:0/2455609595 shutdown_connections 2023-06-10T19:03:45.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.785+0000 7f5059741640 1 --2- 172.21.15.53:0/2455609595 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5040066280 0x7f5040068730 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:45.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.785+0000 7f5059741640 1 --2- 172.21.15.53:0/2455609595 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f505415c970 0x7f505414e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:45.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.785+0000 7f5059741640 1 --2- 172.21.15.53:0/2455609595 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f505415c060 0x7f50540c30f0 unknown :-1 s=CLOSED pgs=1696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:45.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.785+0000 7f5059741640 1 --2- 172.21.15.53:0/2455609595 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5054070de0 0x7f505414ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:45.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.785+0000 7f5059741640 1 -- 172.21.15.53:0/2455609595 >> 172.21.15.53:0/2455609595 conn(0x7f505406a0e0 msgr2=0x7f50540cc680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:45.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.785+0000 7f5059741640 1 -- 172.21.15.53:0/2455609595 shutdown_connections 2023-06-10T19:03:45.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.785+0000 7f5059741640 1 -- 172.21.15.53:0/2455609595 wait complete. 2023-06-10T19:03:45.805 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-06-10T19:03:45.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.913+0000 7fef7dd70640 1 Processor -- start 2023-06-10T19:03:45.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.913+0000 7fef7dd70640 1 -- start start 2023-06-10T19:03:45.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.913+0000 7fef7dd70640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef78159690 0x7fef78070950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:45.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.913+0000 7fef7dd70640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fef780b0f30 0x7fef780cbe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:45.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.913+0000 7fef7dd70640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fef78159a60 0x7fef780c2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:45.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.913+0000 7fef7dd70640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef78070e90 con 0x7fef780b0f30 2023-06-10T19:03:45.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.913+0000 7fef7dd70640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef7806d450 con 0x7fef78159a60 2023-06-10T19:03:45.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.913+0000 7fef7dd70640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef780cb080 con 0x7fef78159690 2023-06-10T19:03:45.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.913+0000 7fef76ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fef780b0f30 0x7fef780cbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:45.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.913+0000 7fef76ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fef780b0f30 0x7fef780cbe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56836/0 (socket says 172.21.15.53:56836) 2023-06-10T19:03:45.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.913+0000 7fef76ffd640 1 -- 172.21.15.53:0/2946222590 learned_addr learned my addr 172.21.15.53:0/2946222590 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:45.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.913+0000 7fef77fff640 1 --2- 172.21.15.53:0/2946222590 >> v2:172.21.15.117:3300/0 conn(0x7fef78159a60 0x7fef780c2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:45.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.913+0000 7fef777fe640 1 --2- 172.21.15.53:0/2946222590 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef78159690 0x7fef78070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:45.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.913+0000 7fef76ffd640 1 -- 172.21.15.53:0/2946222590 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef78159690 msgr2=0x7fef78070950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:45.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.913+0000 7fef76ffd640 1 --2- 172.21.15.53:0/2946222590 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef78159690 0x7fef78070950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:45.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.913+0000 7fef76ffd640 1 -- 172.21.15.53:0/2946222590 >> v2:172.21.15.117:3300/0 conn(0x7fef78159a60 msgr2=0x7fef780c2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:45.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.913+0000 7fef76ffd640 1 --2- 172.21.15.53:0/2946222590 >> v2:172.21.15.117:3300/0 conn(0x7fef78159a60 0x7fef780c2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:45.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.913+0000 7fef76ffd640 1 -- 172.21.15.53:0/2946222590 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef780cb320 con 0x7fef780b0f30 2023-06-10T19:03:45.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.917+0000 7fef76ffd640 1 --2- 172.21.15.53:0/2946222590 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef780b0f30 0x7fef780cbe00 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7fef780c2810 tx=0x7fef6c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c8d7fba0945757b server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:45.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.917+0000 7fef767fc640 1 -- 172.21.15.53:0/2946222590 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef6c0aa5f0 con 0x7fef780b0f30 2023-06-10T19:03:45.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.917+0000 7fef767fc640 1 -- 172.21.15.53:0/2946222590 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef6c0aa750 con 0x7fef780b0f30 2023-06-10T19:03:45.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.917+0000 7fef767fc640 1 -- 172.21.15.53:0/2946222590 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef6c0aaae0 con 0x7fef780b0f30 2023-06-10T19:03:45.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.917+0000 7fef7dd70640 1 -- 172.21.15.53:0/2946222590 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef780b0f30 msgr2=0x7fef780cbe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:45.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.917+0000 7fef7dd70640 1 --2- 172.21.15.53:0/2946222590 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef780b0f30 0x7fef780cbe00 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7fef780c2810 tx=0x7fef6c01c4d0 comp rx=0 tx=0).stop 2023-06-10T19:03:45.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.917+0000 7fef7dd70640 1 -- 172.21.15.53:0/2946222590 shutdown_connections 2023-06-10T19:03:45.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.917+0000 7fef7dd70640 1 --2- 172.21.15.53:0/2946222590 >> v2:172.21.15.117:3300/0 conn(0x7fef78159a60 0x7fef780c2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:45.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.917+0000 7fef7dd70640 1 --2- 172.21.15.53:0/2946222590 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef780b0f30 0x7fef780cbe00 unknown :-1 s=CLOSED pgs=1697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:45.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.917+0000 7fef7dd70640 1 --2- 172.21.15.53:0/2946222590 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef78159690 0x7fef78070950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:45.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.917+0000 7fef7dd70640 1 -- 172.21.15.53:0/2946222590 >> 172.21.15.53:0/2946222590 conn(0x7fef7806a560 msgr2=0x7fef7806a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:45.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.917+0000 7fef7dd70640 1 -- 172.21.15.53:0/2946222590 shutdown_connections 2023-06-10T19:03:45.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.917+0000 7fef7dd70640 1 -- 172.21.15.53:0/2946222590 wait complete. 2023-06-10T19:03:45.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.917+0000 7fef7dd70640 1 Processor -- start 2023-06-10T19:03:45.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.917+0000 7fef7dd70640 1 -- start start 2023-06-10T19:03:45.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.917+0000 7fef7dd70640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef780b0f30 0x7fef78155b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:45.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.917+0000 7fef7dd70640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef78159690 0x7fef781465d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:45.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.917+0000 7fef7dd70640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef78159a60 0x7fef7814f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:45.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.917+0000 7fef7dd70640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef78155710 con 0x7fef78159690 2023-06-10T19:03:45.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.917+0000 7fef7dd70640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef78156070 con 0x7fef780b0f30 2023-06-10T19:03:45.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.917+0000 7fef7dd70640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef78154a90 con 0x7fef78159a60 2023-06-10T19:03:45.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.917+0000 7fef76ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef78159690 0x7fef781465d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:45.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.917+0000 7fef76ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef78159690 0x7fef781465d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56840/0 (socket says 172.21.15.53:56840) 2023-06-10T19:03:45.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.917+0000 7fef76ffd640 1 -- 172.21.15.53:0/1746952614 learned_addr learned my addr 172.21.15.53:0/1746952614 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:45.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.917+0000 7fef777fe640 1 --2- 172.21.15.53:0/1746952614 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef780b0f30 0x7fef78155b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:45.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.917+0000 7fef77fff640 1 --2- 172.21.15.53:0/1746952614 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef78159a60 0x7fef7814f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:45.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.917+0000 7fef76ffd640 1 -- 172.21.15.53:0/1746952614 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef78159a60 msgr2=0x7fef7814f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:45.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.917+0000 7fef76ffd640 1 --2- 172.21.15.53:0/1746952614 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef78159a60 0x7fef7814f430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:45.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.917+0000 7fef76ffd640 1 -- 172.21.15.53:0/1746952614 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef780b0f30 msgr2=0x7fef78155b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:45.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.917+0000 7fef76ffd640 1 --2- 172.21.15.53:0/1746952614 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef780b0f30 0x7fef78155b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:45.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.917+0000 7fef76ffd640 1 -- 172.21.15.53:0/1746952614 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef6c0094d0 con 0x7fef78159690 2023-06-10T19:03:45.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.917+0000 7fef777fe640 1 --2- 172.21.15.53:0/1746952614 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef780b0f30 0x7fef78155b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:03:45.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.917+0000 7fef76ffd640 1 --2- 172.21.15.53:0/1746952614 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef78159690 0x7fef781465d0 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7fef6c0ac040 tx=0x7fef6c01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:45.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.917+0000 7fef5ffff640 1 -- 172.21.15.53:0/1746952614 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef6c0b3800 con 0x7fef78159690 2023-06-10T19:03:45.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.917+0000 7fef5ffff640 1 -- 172.21.15.53:0/1746952614 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef6c0b3960 con 0x7fef78159690 2023-06-10T19:03:45.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.917+0000 7fef5ffff640 1 -- 172.21.15.53:0/1746952614 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef6c0b3cf0 con 0x7fef78159690 2023-06-10T19:03:45.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.917+0000 7fef7dd70640 1 -- 172.21.15.53:0/1746952614 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef78154d70 con 0x7fef78159690 2023-06-10T19:03:45.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.917+0000 7fef7dd70640 1 -- 172.21.15.53:0/1746952614 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef78155330 con 0x7fef78159690 2023-06-10T19:03:45.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.921+0000 7fef7dd70640 1 -- 172.21.15.53:0/1746952614 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef780c2750 con 0x7fef78159690 2023-06-10T19:03:45.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.921+0000 7fef5ffff640 1 -- 172.21.15.53:0/1746952614 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fef6c0c73a0 con 0x7fef78159690 2023-06-10T19:03:45.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.921+0000 7fef5ffff640 1 --2- 172.21.15.53:0/1746952614 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fef64066280 0x7fef64068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:45.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.921+0000 7fef5ffff640 1 -- 172.21.15.53:0/1746952614 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fef6c0a7070 con 0x7fef78159690 2023-06-10T19:03:45.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.921+0000 7fef777fe640 1 --2- 172.21.15.53:0/1746952614 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fef64066280 0x7fef64068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:45.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.921+0000 7fef777fe640 1 --2- 172.21.15.53:0/1746952614 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fef64066280 0x7fef64068730 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fef68009840 tx=0x7fef68008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:45.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:45.925+0000 7fef5ffff640 1 -- 172.21.15.53:0/1746952614 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fef6c0ebc50 con 0x7fef78159690 2023-06-10T19:03:46.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:46.077+0000 7fef7dd70640 1 -- 172.21.15.53:0/1746952614 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fef7804d790 con 0x7fef78159690 2023-06-10T19:03:46.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:46.077+0000 7fef5ffff640 1 -- 172.21.15.53:0/1746952614 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v106) v1 ==== 84+0+126 (secure 0 0 0) 0x7fef6c0ef270 con 0x7fef78159690 2023-06-10T19:03:46.081 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:03:46.081 INFO:teuthology.orchestra.run.smithi053.stdout:[ 2023-06-10T19:03:46.081 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:03:46.081 INFO:teuthology.orchestra.run.smithi053.stdout: "poolnum": 1, 2023-06-10T19:03:46.082 INFO:teuthology.orchestra.run.smithi053.stdout: "poolname": ".mgr" 2023-06-10T19:03:46.082 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:03:46.082 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:03:46.082 INFO:teuthology.orchestra.run.smithi053.stdout: "poolnum": 2, 2023-06-10T19:03:46.082 INFO:teuthology.orchestra.run.smithi053.stdout: "poolname": "rbd" 2023-06-10T19:03:46.082 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:03:46.082 INFO:teuthology.orchestra.run.smithi053.stdout:] 2023-06-10T19:03:46.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:46.077+0000 7fef7dd70640 1 -- 172.21.15.53:0/1746952614 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fef64066280 msgr2=0x7fef64068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:46.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:46.077+0000 7fef7dd70640 1 --2- 172.21.15.53:0/1746952614 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fef64066280 0x7fef64068730 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fef68009840 tx=0x7fef68008040 comp rx=0 tx=0).stop 2023-06-10T19:03:46.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:46.077+0000 7fef7dd70640 1 -- 172.21.15.53:0/1746952614 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef78159690 msgr2=0x7fef781465d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:46.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:46.077+0000 7fef7dd70640 1 --2- 172.21.15.53:0/1746952614 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef78159690 0x7fef781465d0 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7fef6c0ac040 tx=0x7fef6c01ad10 comp rx=0 tx=0).stop 2023-06-10T19:03:46.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:46.077+0000 7fef7dd70640 1 -- 172.21.15.53:0/1746952614 shutdown_connections 2023-06-10T19:03:46.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:46.077+0000 7fef7dd70640 1 --2- 172.21.15.53:0/1746952614 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fef64066280 0x7fef64068730 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:46.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:46.077+0000 7fef7dd70640 1 --2- 172.21.15.53:0/1746952614 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef78159a60 0x7fef7814f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:46.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:46.077+0000 7fef7dd70640 1 --2- 172.21.15.53:0/1746952614 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef78159690 0x7fef781465d0 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:46.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:46.077+0000 7fef7dd70640 1 --2- 172.21.15.53:0/1746952614 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef780b0f30 0x7fef78155b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:46.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:46.077+0000 7fef7dd70640 1 -- 172.21.15.53:0/1746952614 >> 172.21.15.53:0/1746952614 conn(0x7fef7806a560 msgr2=0x7fef7806a930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:46.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:46.077+0000 7fef7dd70640 1 -- 172.21.15.53:0/1746952614 shutdown_connections 2023-06-10T19:03:46.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:46.077+0000 7fef7dd70640 1 -- 172.21.15.53:0/1746952614 wait complete. 2023-06-10T19:03:46.098 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-06-10T19:03:46.099 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-06-10T19:03:46.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:46.213+0000 7feeeb2a9640 1 Processor -- start 2023-06-10T19:03:46.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:46.213+0000 7feeeb2a9640 1 -- start start 2023-06-10T19:03:46.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:46.213+0000 7feeeb2a9640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7feee415b930 0x7feee415f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:46.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:46.213+0000 7feeeb2a9640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feee415bd00 con 0x7feee40cfc30 2023-06-10T19:03:46.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:46.213+0000 7feeeb2a9640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feee40cf020 con 0x7feee40b1490 2023-06-10T19:03:46.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:46.213+0000 7feeeb2a9640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feee40cf5e0 con 0x7feee415b930 2023-06-10T19:03:46.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:46.213+0000 7feee9045640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7feee415b930 0x7feee415f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:46.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:46.213+0000 7feee9846640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7feee40cfc30 0x7feee40d0090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60496/0 (socket says 172.21.15.53:60496) 2023-06-10T19:03:46.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:46.213+0000 7feee9846640 1 -- 172.21.15.53:0/3891665575 learned_addr learned my addr 172.21.15.53:0/3891665575 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:03:46.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:46.217+0000 7feee9045640 1 -- 172.21.15.53:0/3891665575 >> v1:172.21.15.117:6789/0 conn(0x7feee40b1490 legacy=0x7feee415f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:46.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:46.217+0000 7feee9045640 1 -- 172.21.15.53:0/3891665575 >> v1:172.21.15.53:6789/0 conn(0x7feee40cfc30 legacy=0x7feee40d0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:46.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:46.217+0000 7feee9045640 1 -- 172.21.15.53:0/3891665575 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feee40cf300 con 0x7feee415b930 2023-06-10T19:03:46.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:46.217+0000 7feedbfff640 1 -- 172.21.15.53:0/3891665575 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 72891191 0 0) 0x7feee415bd00 con 0x7feee40cfc30 2023-06-10T19:03:46.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:46.217+0000 7feee9045640 1 --2- 172.21.15.53:0/3891665575 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feee415b930 0x7feee415f400 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7feee00097c0 tx=0x7feee001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=596db7cafec56402 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:46.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:46.217+0000 7feedbfff640 1 -- 172.21.15.53:0/3891665575 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee00ab600 con 0x7feee415b930 2023-06-10T19:03:46.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:46.217+0000 7feedbfff640 1 -- 172.21.15.53:0/3891665575 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feee00a7050 con 0x7feee415b930 2023-06-10T19:03:46.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:46.217+0000 7feedbfff640 1 -- 172.21.15.53:0/3891665575 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee00ab980 con 0x7feee415b930 2023-06-10T19:03:46.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:46.217+0000 7feeeb2a9640 1 -- 172.21.15.53:0/3891665575 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feee415b930 msgr2=0x7feee415f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:46.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:46.217+0000 7feeeb2a9640 1 --2- 172.21.15.53:0/3891665575 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feee415b930 0x7feee415f400 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7feee00097c0 tx=0x7feee001c440 comp rx=0 tx=0).stop 2023-06-10T19:03:46.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:46.217+0000 7feeeb2a9640 1 -- 172.21.15.53:0/3891665575 shutdown_connections 2023-06-10T19:03:46.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:46.217+0000 7feeeb2a9640 1 --2- 172.21.15.53:0/3891665575 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feee415b930 0x7feee415f400 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:46.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:46.217+0000 7feeeb2a9640 1 -- 172.21.15.53:0/3891665575 >> 172.21.15.53:0/3891665575 conn(0x7feee4069d70 msgr2=0x7feee406a170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:46.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:46.217+0000 7feeeb2a9640 1 -- 172.21.15.53:0/3891665575 shutdown_connections 2023-06-10T19:03:46.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:46.217+0000 7feeeb2a9640 1 -- 172.21.15.53:0/3891665575 wait complete. 2023-06-10T19:03:46.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:46.221+0000 7feeeb2a9640 1 Processor -- start 2023-06-10T19:03:46.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:46.221+0000 7feeeb2a9640 1 -- start start 2023-06-10T19:03:46.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:46.221+0000 7feeeb2a9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feee40b1490 0x7feee415a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:46.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:46.221+0000 7feeeb2a9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feee40cfc30 0x7feee415d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:46.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:46.221+0000 7feeeb2a9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feee415b930 0x7feee40b2260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:46.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:46.221+0000 7feeeb2a9640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee40c9e10 con 0x7feee40cfc30 2023-06-10T19:03:46.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:46.221+0000 7feeeb2a9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee40c91d0 con 0x7feee40b1490 2023-06-10T19:03:46.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:46.221+0000 7feeeb2a9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feee415ae60 con 0x7feee415b930 2023-06-10T19:03:46.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:46.221+0000 7feee8844640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feee40cfc30 0x7feee415d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:46.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:46.221+0000 7feee8844640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feee40cfc30 0x7feee415d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56856/0 (socket says 172.21.15.53:56856) 2023-06-10T19:03:46.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:46.221+0000 7feee8844640 1 -- 172.21.15.53:0/3545007935 learned_addr learned my addr 172.21.15.53:0/3545007935 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:46.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:46.221+0000 7feee8844640 1 -- 172.21.15.53:0/3545007935 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feee415b930 msgr2=0x7feee40b2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:46.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:46.221+0000 7feee8844640 1 --2- 172.21.15.53:0/3545007935 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feee415b930 0x7feee40b2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:46.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:46.221+0000 7feee8844640 1 -- 172.21.15.53:0/3545007935 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feee40b1490 msgr2=0x7feee415a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:46.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:46.221+0000 7feee8844640 1 --2- 172.21.15.53:0/3545007935 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feee40b1490 0x7feee415a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:46.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:46.221+0000 7feee8844640 1 -- 172.21.15.53:0/3545007935 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feee0009420 con 0x7feee40cfc30 2023-06-10T19:03:46.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:46.221+0000 7feee8844640 1 --2- 172.21.15.53:0/3545007935 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feee40cfc30 0x7feee415d630 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7feed400b410 tx=0x7feed400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:46.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:46.221+0000 7feed9ffb640 1 -- 172.21.15.53:0/3545007935 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed4004020 con 0x7feee40cfc30 2023-06-10T19:03:46.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:46.221+0000 7feed9ffb640 1 -- 172.21.15.53:0/3545007935 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feed4004180 con 0x7feee40cfc30 2023-06-10T19:03:46.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:46.221+0000 7feeeb2a9640 1 -- 172.21.15.53:0/3545007935 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feee40c9470 con 0x7feee40cfc30 2023-06-10T19:03:46.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:46.221+0000 7feed9ffb640 1 -- 172.21.15.53:0/3545007935 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed4011630 con 0x7feee40cfc30 2023-06-10T19:03:46.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:46.221+0000 7feeeb2a9640 1 -- 172.21.15.53:0/3545007935 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feee40c9a30 con 0x7feee40cfc30 2023-06-10T19:03:46.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:46.221+0000 7feeeb2a9640 1 -- 172.21.15.53:0/3545007935 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feee40c9f50 con 0x7feee40cfc30 2023-06-10T19:03:46.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:46.221+0000 7feed9ffb640 1 -- 172.21.15.53:0/3545007935 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7feed4011790 con 0x7feee40cfc30 2023-06-10T19:03:46.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:46.221+0000 7feed9ffb640 1 --2- 172.21.15.53:0/3545007935 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7feec8066280 0x7feec8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:46.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:46.221+0000 7feed9ffb640 1 -- 172.21.15.53:0/3545007935 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5210+0+0 (secure 0 0 0) 0x7feed40836a0 con 0x7feee40cfc30 2023-06-10T19:03:46.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:46.225+0000 7feee9045640 1 --2- 172.21.15.53:0/3545007935 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7feec8066280 0x7feec8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:46.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:46.225+0000 7feee9045640 1 --2- 172.21.15.53:0/3545007935 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7feec8066280 0x7feec8068730 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7feee00ad000 tx=0x7feee0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:46.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:46.229+0000 7feed9ffb640 1 -- 172.21.15.53:0/3545007935 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7feee40c9f50 con 0x7feee40cfc30 2023-06-10T19:03:46.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:46.381+0000 7feeeb2a9640 1 -- 172.21.15.53:0/3545007935 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7feee40c9f50 con 0x7feee40cfc30 2023-06-10T19:03:47.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:47.025+0000 7feed9ffb640 1 -- 172.21.15.53:0/3545007935 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v107) v1 ==== 138+0+0 (secure 0 0 0) 0x7feee40c9f50 con 0x7feee40cfc30 2023-06-10T19:03:47.031 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_metadata' created 2023-06-10T19:03:47.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:47.029+0000 7feeeb2a9640 1 -- 172.21.15.53:0/3545007935 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7feec8066280 msgr2=0x7feec8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:47.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:47.029+0000 7feeeb2a9640 1 --2- 172.21.15.53:0/3545007935 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7feec8066280 0x7feec8068730 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7feee00ad000 tx=0x7feee0008040 comp rx=0 tx=0).stop 2023-06-10T19:03:47.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:47.029+0000 7feeeb2a9640 1 -- 172.21.15.53:0/3545007935 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feee40cfc30 msgr2=0x7feee415d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:47.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:47.029+0000 7feeeb2a9640 1 --2- 172.21.15.53:0/3545007935 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feee40cfc30 0x7feee415d630 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7feed400b410 tx=0x7feed400b8d0 comp rx=0 tx=0).stop 2023-06-10T19:03:47.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:47.029+0000 7feeeb2a9640 1 -- 172.21.15.53:0/3545007935 shutdown_connections 2023-06-10T19:03:47.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:47.029+0000 7feeeb2a9640 1 --2- 172.21.15.53:0/3545007935 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7feec8066280 0x7feec8068730 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:47.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:47.029+0000 7feeeb2a9640 1 --2- 172.21.15.53:0/3545007935 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feee415b930 0x7feee40b2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:47.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:47.029+0000 7feeeb2a9640 1 --2- 172.21.15.53:0/3545007935 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feee40cfc30 0x7feee415d630 unknown :-1 s=CLOSED pgs=1701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:47.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:47.029+0000 7feeeb2a9640 1 --2- 172.21.15.53:0/3545007935 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feee40b1490 0x7feee415a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:47.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:47.029+0000 7feeeb2a9640 1 -- 172.21.15.53:0/3545007935 >> 172.21.15.53:0/3545007935 conn(0x7feee4069d70 msgr2=0x7feee40d1f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:47.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:47.029+0000 7feeeb2a9640 1 -- 172.21.15.53:0/3545007935 shutdown_connections 2023-06-10T19:03:47.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:47.029+0000 7feeeb2a9640 1 -- 172.21.15.53:0/3545007935 wait complete. 2023-06-10T19:03:47.060 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-06-10T19:03:47.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:47.185+0000 7fb138d03640 1 Processor -- start 2023-06-10T19:03:47.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:47.185+0000 7fb138d03640 1 -- start start 2023-06-10T19:03:47.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:47.185+0000 7fb138d03640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb134158550 0x7fb1340c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:47.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:47.185+0000 7fb138d03640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb1340cd6a0 0x7fb1340cbe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:47.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:47.185+0000 7fb138d03640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1340cc3c0 con 0x7fb13415c160 2023-06-10T19:03:47.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:47.185+0000 7fb138d03640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1340c9450 con 0x7fb1340cd6a0 2023-06-10T19:03:47.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:47.185+0000 7fb138d03640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1340cc600 con 0x7fb134158550 2023-06-10T19:03:47.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:47.185+0000 7fb131d9b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb1340cd6a0 0x7fb1340cbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:47.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:47.185+0000 7fb132d9d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fb13415c160 0x7fb13406f000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60508/0 (socket says 172.21.15.53:60508) 2023-06-10T19:03:47.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:47.185+0000 7fb132d9d640 1 -- 172.21.15.53:0/334835138 learned_addr learned my addr 172.21.15.53:0/334835138 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:03:47.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:47.185+0000 7fb13259c640 1 --2- 172.21.15.53:0/334835138 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb134158550 0x7fb1340c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:47.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:47.185+0000 7fb13159a640 1 -- 172.21.15.53:0/334835138 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3283917997 0 0) 0x7fb124001120 con 0x7fb13415c160 2023-06-10T19:03:47.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:47.185+0000 7fb13159a640 1 -- 172.21.15.53:0/334835138 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb11c003530 con 0x7fb13415c160 2023-06-10T19:03:47.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:47.185+0000 7fb13259c640 1 -- 172.21.15.53:0/334835138 >> v2:172.21.15.117:3300/0 conn(0x7fb1340cd6a0 msgr2=0x7fb1340cbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:47.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:47.185+0000 7fb13259c640 1 --2- 172.21.15.53:0/334835138 >> v2:172.21.15.117:3300/0 conn(0x7fb1340cd6a0 0x7fb1340cbe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:47.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:47.185+0000 7fb13259c640 1 -- 172.21.15.53:0/334835138 >> v1:172.21.15.53:6789/0 conn(0x7fb13415c160 legacy=0x7fb13406f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:47.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:47.185+0000 7fb13259c640 1 -- 172.21.15.53:0/334835138 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1340cc8e0 con 0x7fb134158550 2023-06-10T19:03:47.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:47.189+0000 7fb13259c640 1 --2- 172.21.15.53:0/334835138 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb134158550 0x7fb1340c8f10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb12c009d90 tx=0x7fb12c01f130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8105c77540f4f29 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:47.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:47.189+0000 7fb13159a640 1 -- 172.21.15.53:0/334835138 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12c0af600 con 0x7fb134158550 2023-06-10T19:03:47.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:47.189+0000 7fb13159a640 1 -- 172.21.15.53:0/334835138 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb12c0ab050 con 0x7fb134158550 2023-06-10T19:03:47.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:47.189+0000 7fb13159a640 1 -- 172.21.15.53:0/334835138 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12c0af960 con 0x7fb134158550 2023-06-10T19:03:47.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:47.189+0000 7fb138d03640 1 -- 172.21.15.53:0/334835138 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb134158550 msgr2=0x7fb1340c8f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:47.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:47.189+0000 7fb138d03640 1 --2- 172.21.15.53:0/334835138 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb134158550 0x7fb1340c8f10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb12c009d90 tx=0x7fb12c01f130 comp rx=0 tx=0).stop 2023-06-10T19:03:47.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:47.189+0000 7fb138d03640 1 -- 172.21.15.53:0/334835138 shutdown_connections 2023-06-10T19:03:47.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:47.189+0000 7fb138d03640 1 --2- 172.21.15.53:0/334835138 >> v2:172.21.15.117:3300/0 conn(0x7fb1340cd6a0 0x7fb1340cbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:47.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:47.189+0000 7fb138d03640 1 --2- 172.21.15.53:0/334835138 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb134158550 0x7fb1340c8f10 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:47.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:47.189+0000 7fb138d03640 1 -- 172.21.15.53:0/334835138 >> 172.21.15.53:0/334835138 conn(0x7fb13406a0e0 msgr2=0x7fb1340ca810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:47.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:47.189+0000 7fb138d03640 1 -- 172.21.15.53:0/334835138 shutdown_connections 2023-06-10T19:03:47.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:47.189+0000 7fb138d03640 1 -- 172.21.15.53:0/334835138 wait complete. 2023-06-10T19:03:47.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:47.193+0000 7fb138d03640 1 Processor -- start 2023-06-10T19:03:47.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:47.193+0000 7fb138d03640 1 -- start start 2023-06-10T19:03:47.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:47.193+0000 7fb138d03640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb1340cd6a0 0x7fb134158920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:47.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:47.193+0000 7fb138d03640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb134158550 0x7fb1341523f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:47.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:47.193+0000 7fb138d03640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb13415c160 0x7fb13415a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:47.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:47.193+0000 7fb138d03640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1340c7d90 con 0x7fb134158550 2023-06-10T19:03:47.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:47.193+0000 7fb138d03640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb13415b9a0 con 0x7fb13415c160 2023-06-10T19:03:47.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:47.193+0000 7fb138d03640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb134158e60 con 0x7fb1340cd6a0 2023-06-10T19:03:47.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:47.193+0000 7fb131d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb134158550 0x7fb1341523f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:47.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:47.193+0000 7fb131d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb134158550 0x7fb1341523f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56860/0 (socket says 172.21.15.53:56860) 2023-06-10T19:03:47.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:47.193+0000 7fb131d9b640 1 -- 172.21.15.53:0/1711708712 learned_addr learned my addr 172.21.15.53:0/1711708712 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:47.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:47.193+0000 7fb13259c640 1 --2- 172.21.15.53:0/1711708712 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb1340cd6a0 0x7fb134158920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:47.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:47.193+0000 7fb131d9b640 1 -- 172.21.15.53:0/1711708712 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb1340cd6a0 msgr2=0x7fb134158920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:47.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:47.193+0000 7fb131d9b640 1 --2- 172.21.15.53:0/1711708712 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb1340cd6a0 0x7fb134158920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:47.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:47.193+0000 7fb132d9d640 1 --2- 172.21.15.53:0/1711708712 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb13415c160 0x7fb13415a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:47.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:47.193+0000 7fb131d9b640 1 -- 172.21.15.53:0/1711708712 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb13415c160 msgr2=0x7fb13415a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:47.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:47.193+0000 7fb131d9b640 1 --2- 172.21.15.53:0/1711708712 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb13415c160 0x7fb13415a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:47.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:47.193+0000 7fb131d9b640 1 -- 172.21.15.53:0/1711708712 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb12c009a70 con 0x7fb134158550 2023-06-10T19:03:47.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:47.193+0000 7fb131d9b640 1 --2- 172.21.15.53:0/1711708712 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb134158550 0x7fb1341523f0 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7fb12800e960 tx=0x7fb12800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:47.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:47.193+0000 7fb122ffd640 1 -- 172.21.15.53:0/1711708712 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb128009690 con 0x7fb134158550 2023-06-10T19:03:47.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:47.193+0000 7fb122ffd640 1 -- 172.21.15.53:0/1711708712 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb12800ca00 con 0x7fb134158550 2023-06-10T19:03:47.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:47.193+0000 7fb138d03640 1 -- 172.21.15.53:0/1711708712 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1340c77d0 con 0x7fb134158550 2023-06-10T19:03:47.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:47.193+0000 7fb122ffd640 1 -- 172.21.15.53:0/1711708712 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12800cd70 con 0x7fb134158550 2023-06-10T19:03:47.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:47.193+0000 7fb138d03640 1 -- 172.21.15.53:0/1711708712 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb13415b1a0 con 0x7fb134158550 2023-06-10T19:03:47.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:47.193+0000 7fb138d03640 1 -- 172.21.15.53:0/1711708712 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb13404d790 con 0x7fb134158550 2023-06-10T19:03:47.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:47.193+0000 7fb122ffd640 1 -- 172.21.15.53:0/1711708712 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb128013470 con 0x7fb134158550 2023-06-10T19:03:47.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:47.197+0000 7fb122ffd640 1 --2- 172.21.15.53:0/1711708712 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb114066280 0x7fb114068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:47.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:47.197+0000 7fb122ffd640 1 -- 172.21.15.53:0/1711708712 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5580+0+0 (secure 0 0 0) 0x7fb128083d40 con 0x7fb134158550 2023-06-10T19:03:47.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:47.197+0000 7fb13259c640 1 --2- 172.21.15.53:0/1711708712 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb114066280 0x7fb114068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:47.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:47.197+0000 7fb13259c640 1 --2- 172.21.15.53:0/1711708712 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb114066280 0x7fb114068730 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fb12c0b1000 tx=0x7fb12c0aa000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:47.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:47.201+0000 7fb122ffd640 1 -- 172.21.15.53:0/1711708712 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb1280513a0 con 0x7fb134158550 2023-06-10T19:03:47.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:47.353+0000 7fb138d03640 1 -- 172.21.15.53:0/1711708712 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fb1340cba30 con 0x7fb134158550 2023-06-10T19:03:48.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.033+0000 7fb122ffd640 1 -- 172.21.15.53:0/1711708712 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v108) v1 ==== 170+0+0 (secure 0 0 0) 0x7fb1280170d0 con 0x7fb134158550 2023-06-10T19:03:48.039 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_data' created 2023-06-10T19:03:48.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.041+0000 7fb138d03640 1 -- 172.21.15.53:0/1711708712 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb114066280 msgr2=0x7fb114068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:48.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.041+0000 7fb138d03640 1 --2- 172.21.15.53:0/1711708712 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb114066280 0x7fb114068730 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fb12c0b1000 tx=0x7fb12c0aa000 comp rx=0 tx=0).stop 2023-06-10T19:03:48.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.045+0000 7fb138d03640 1 -- 172.21.15.53:0/1711708712 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb134158550 msgr2=0x7fb1341523f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:48.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.045+0000 7fb138d03640 1 --2- 172.21.15.53:0/1711708712 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb134158550 0x7fb1341523f0 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7fb12800e960 tx=0x7fb12800ee20 comp rx=0 tx=0).stop 2023-06-10T19:03:48.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.045+0000 7fb138d03640 1 -- 172.21.15.53:0/1711708712 shutdown_connections 2023-06-10T19:03:48.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.045+0000 7fb138d03640 1 --2- 172.21.15.53:0/1711708712 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb114066280 0x7fb114068730 secure :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fb12c0b1000 tx=0x7fb12c0aa000 comp rx=0 tx=0).stop 2023-06-10T19:03:48.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.045+0000 7fb138d03640 1 --2- 172.21.15.53:0/1711708712 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb13415c160 0x7fb13415a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:48.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.045+0000 7fb138d03640 1 --2- 172.21.15.53:0/1711708712 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb134158550 0x7fb1341523f0 unknown :-1 s=CLOSED pgs=1703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:48.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.045+0000 7fb138d03640 1 --2- 172.21.15.53:0/1711708712 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb1340cd6a0 0x7fb134158920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:48.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.045+0000 7fb138d03640 1 -- 172.21.15.53:0/1711708712 >> 172.21.15.53:0/1711708712 conn(0x7fb13406a0e0 msgr2=0x7fb1340ac6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:48.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.053+0000 7fb138d03640 1 -- 172.21.15.53:0/1711708712 shutdown_connections 2023-06-10T19:03:48.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.053+0000 7fb138d03640 1 -- 172.21.15.53:0/1711708712 wait complete. 2023-06-10T19:03:48.087 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-06-10T19:03:48.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.213+0000 7f63ce538640 1 Processor -- start 2023-06-10T19:03:48.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.213+0000 7f63ce538640 1 -- start start 2023-06-10T19:03:48.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.213+0000 7f63ce538640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63c8159b20 0x7f63c80cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:48.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.213+0000 7f63ce538640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f63c80ce120 0x7f63c806f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:48.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.213+0000 7f63ce538640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63c80ce620 con 0x7f63c806eca0 2023-06-10T19:03:48.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.213+0000 7f63ce538640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63c80cbb30 con 0x7f63c80ce120 2023-06-10T19:03:48.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.213+0000 7f63ce538640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63c806f650 con 0x7f63c8159b20 2023-06-10T19:03:48.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.213+0000 7f63c77fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f63c806eca0 0x7f63c80cda10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60522/0 (socket says 172.21.15.53:60522) 2023-06-10T19:03:48.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.213+0000 7f63c77fe640 1 -- 172.21.15.53:0/3299640967 learned_addr learned my addr 172.21.15.53:0/3299640967 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:03:48.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.213+0000 7f63c7fff640 1 --2- 172.21.15.53:0/3299640967 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63c8159b20 0x7f63c80cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:48.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.213+0000 7f63ccad5640 1 --2- 172.21.15.53:0/3299640967 >> v2:172.21.15.117:3300/0 conn(0x7f63c80ce120 0x7f63c806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:48.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.213+0000 7f63c6ffd640 1 -- 172.21.15.53:0/3299640967 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 295705702 0 0) 0x7f63c80ce620 con 0x7f63c806eca0 2023-06-10T19:03:48.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.213+0000 7f63c6ffd640 1 -- 172.21.15.53:0/3299640967 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63b0003530 con 0x7f63c806eca0 2023-06-10T19:03:48.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.213+0000 7f63c6ffd640 1 -- 172.21.15.53:0/3299640967 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3677960944 0 0) 0x7f63b0003530 con 0x7f63c806eca0 2023-06-10T19:03:48.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.213+0000 7f63c6ffd640 1 -- 172.21.15.53:0/3299640967 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63c8159b20 msgr2=0x7f63c80cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:48.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.213+0000 7f63c6ffd640 1 --2- 172.21.15.53:0/3299640967 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63c8159b20 0x7f63c80cf6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:48.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.213+0000 7f63c6ffd640 1 -- 172.21.15.53:0/3299640967 >> v2:172.21.15.117:3300/0 conn(0x7f63c80ce120 msgr2=0x7f63c806f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:48.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.213+0000 7f63c6ffd640 1 --2- 172.21.15.53:0/3299640967 >> v2:172.21.15.117:3300/0 conn(0x7f63c80ce120 0x7f63c806f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:48.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.213+0000 7f63c6ffd640 1 -- 172.21.15.53:0/3299640967 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63c80ce900 con 0x7f63c806eca0 2023-06-10T19:03:48.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.213+0000 7f63c6ffd640 1 -- 172.21.15.53:0/3299640967 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f63bc001680 con 0x7f63c806eca0 2023-06-10T19:03:48.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.213+0000 7f63c6ffd640 1 -- 172.21.15.53:0/3299640967 >> v1:172.21.15.53:6789/0 conn(0x7f63c806eca0 legacy=0x7f63c80cda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:48.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.213+0000 7f63c6ffd640 1 --2- 172.21.15.53:0/3299640967 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63c8159b20 0x7f63b00039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:48.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.213+0000 7f63c6ffd640 1 --2- 172.21.15.53:0/3299640967 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63b0003f30 0x7f63b00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:48.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.213+0000 7f63c6ffd640 1 --2- 172.21.15.53:0/3299640967 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63b0004d10 0x7f63b0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:48.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.213+0000 7f63c6ffd640 1 -- 172.21.15.53:0/3299640967 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c80cbb30 con 0x7f63b0004d10 2023-06-10T19:03:48.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.213+0000 7f63c6ffd640 1 -- 172.21.15.53:0/3299640967 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c806f650 con 0x7f63b0003f30 2023-06-10T19:03:48.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.213+0000 7f63c6ffd640 1 -- 172.21.15.53:0/3299640967 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63b000b990 con 0x7f63c8159b20 2023-06-10T19:03:48.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.213+0000 7f63ccad5640 1 --2- 172.21.15.53:0/3299640967 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63b0004d10 0x7f63b0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:48.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.213+0000 7f63c77fe640 1 --2- 172.21.15.53:0/3299640967 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63b0003f30 0x7f63b00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:48.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.213+0000 7f63ccad5640 1 -- 172.21.15.53:0/3299640967 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63c8159b20 msgr2=0x7f63b00039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:48.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.213+0000 7f63ccad5640 1 --2- 172.21.15.53:0/3299640967 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63c8159b20 0x7f63b00039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:48.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.213+0000 7f63ccad5640 1 -- 172.21.15.53:0/3299640967 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63b0003f30 msgr2=0x7f63b00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:48.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.213+0000 7f63ccad5640 1 --2- 172.21.15.53:0/3299640967 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63b0003f30 0x7f63b00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:48.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.213+0000 7f63ccad5640 1 -- 172.21.15.53:0/3299640967 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63b0003530 con 0x7f63b0004d10 2023-06-10T19:03:48.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.217+0000 7f63ccad5640 1 --2- 172.21.15.53:0/3299640967 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63b0004d10 0x7f63b0005180 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f63c0009fc0 tx=0x7f63c001cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dad8481def940dc server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:48.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.217+0000 7f63c6ffd640 1 -- 172.21.15.53:0/3299640967 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c00a5cb0 con 0x7f63b0004d10 2023-06-10T19:03:48.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.217+0000 7f63c6ffd640 1 -- 172.21.15.53:0/3299640967 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63c000f040 con 0x7f63b0004d10 2023-06-10T19:03:48.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.217+0000 7f63c6ffd640 1 -- 172.21.15.53:0/3299640967 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c00ad680 con 0x7f63b0004d10 2023-06-10T19:03:48.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.217+0000 7f63ce538640 1 -- 172.21.15.53:0/3299640967 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63b0004d10 msgr2=0x7f63b0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:48.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.217+0000 7f63ce538640 1 --2- 172.21.15.53:0/3299640967 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63b0004d10 0x7f63b0005180 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f63c0009fc0 tx=0x7f63c001cca0 comp rx=0 tx=0).stop 2023-06-10T19:03:48.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.217+0000 7f63ccad5640 1 -- 172.21.15.53:0/3299640967 reap_dead start 2023-06-10T19:03:48.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.217+0000 7f63ce538640 1 -- 172.21.15.53:0/3299640967 shutdown_connections 2023-06-10T19:03:48.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.217+0000 7f63ce538640 1 -- 172.21.15.53:0/3299640967 >> 172.21.15.53:0/3299640967 conn(0x7f63c806a0e0 msgr2=0x7f63c806d270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:48.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.217+0000 7f63ce538640 1 -- 172.21.15.53:0/3299640967 shutdown_connections 2023-06-10T19:03:48.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.217+0000 7f63ce538640 1 -- 172.21.15.53:0/3299640967 wait complete. 2023-06-10T19:03:48.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.217+0000 7f63ce538640 1 Processor -- start 2023-06-10T19:03:48.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.217+0000 7f63ce538640 1 -- start start 2023-06-10T19:03:48.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.221+0000 7f63ce538640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63b0004d10 0x7f63c814bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:48.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.221+0000 7f63ce538640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63c815cc80 0x7f63c815a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:48.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.221+0000 7f63ce538640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63c8157db0 0x7f63c8158220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:48.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.221+0000 7f63ce538640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c814c510 con 0x7f63b0004d10 2023-06-10T19:03:48.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.221+0000 7f63ce538640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c8158760 con 0x7f63c8157db0 2023-06-10T19:03:48.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.221+0000 7f63ce538640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63c81f20d0 con 0x7f63c815cc80 2023-06-10T19:03:48.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.221+0000 7f63c7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63b0004d10 0x7f63c814bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:48.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.221+0000 7f63c7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63b0004d10 0x7f63c814bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56876/0 (socket says 172.21.15.53:56876) 2023-06-10T19:03:48.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.221+0000 7f63c7fff640 1 -- 172.21.15.53:0/1521983400 learned_addr learned my addr 172.21.15.53:0/1521983400 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:48.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.221+0000 7f63c77fe640 1 --2- 172.21.15.53:0/1521983400 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63c815cc80 0x7f63c815a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:48.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.221+0000 7f63ccad5640 1 --2- 172.21.15.53:0/1521983400 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63c8157db0 0x7f63c8158220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:48.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.221+0000 7f63c7fff640 1 -- 172.21.15.53:0/1521983400 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63c815cc80 msgr2=0x7f63c815a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:48.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.221+0000 7f63c7fff640 1 --2- 172.21.15.53:0/1521983400 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63c815cc80 0x7f63c815a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:48.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.221+0000 7f63c7fff640 1 -- 172.21.15.53:0/1521983400 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63c8157db0 msgr2=0x7f63c8158220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:48.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.221+0000 7f63c7fff640 1 --2- 172.21.15.53:0/1521983400 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63c8157db0 0x7f63c8158220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:48.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.221+0000 7f63c7fff640 1 -- 172.21.15.53:0/1521983400 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63c81f2c50 con 0x7f63b0004d10 2023-06-10T19:03:48.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.221+0000 7f63ccad5640 1 --2- 172.21.15.53:0/1521983400 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63c8157db0 0x7f63c8158220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:03:48.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.221+0000 7f63c7fff640 1 --2- 172.21.15.53:0/1521983400 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63b0004d10 0x7f63c814bfd0 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7f63b800e7f0 tx=0x7f63b800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:48.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.221+0000 7f63c4ff9640 1 -- 172.21.15.53:0/1521983400 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b800c8c0 con 0x7f63b0004d10 2023-06-10T19:03:48.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.221+0000 7f63c4ff9640 1 -- 172.21.15.53:0/1521983400 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63b800ca20 con 0x7f63b0004d10 2023-06-10T19:03:48.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.221+0000 7f63c4ff9640 1 -- 172.21.15.53:0/1521983400 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b800cdb0 con 0x7f63b0004d10 2023-06-10T19:03:48.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.221+0000 7f63ce538640 1 -- 172.21.15.53:0/1521983400 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63c81f2320 con 0x7f63b0004d10 2023-06-10T19:03:48.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.221+0000 7f63ce538640 1 -- 172.21.15.53:0/1521983400 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63c81f28e0 con 0x7f63b0004d10 2023-06-10T19:03:48.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.221+0000 7f63ce538640 1 -- 172.21.15.53:0/1521983400 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63c804d790 con 0x7f63b0004d10 2023-06-10T19:03:48.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.221+0000 7f63c4ff9640 1 -- 172.21.15.53:0/1521983400 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f63b8013470 con 0x7f63b0004d10 2023-06-10T19:03:48.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.221+0000 7f63c4ff9640 1 --2- 172.21.15.53:0/1521983400 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f63b4066280 0x7f63b4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:48.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.221+0000 7f63c4ff9640 1 -- 172.21.15.53:0/1521983400 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f63b8083d80 con 0x7f63b0004d10 2023-06-10T19:03:48.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.221+0000 7f63c77fe640 1 --2- 172.21.15.53:0/1521983400 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f63b4066280 0x7f63b4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:48.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.225+0000 7f63c77fe640 1 --2- 172.21.15.53:0/1521983400 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f63b4066280 0x7f63b4068730 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f63bc0019e0 tx=0x7f63bc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:48.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.229+0000 7f63c4ff9640 1 -- 172.21.15.53:0/1521983400 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f63b80511c0 con 0x7f63b0004d10 2023-06-10T19:03:48.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.413+0000 7f63ce538640 1 -- 172.21.15.53:0/1521983400 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f63c81f2a70 con 0x7f63b0004d10 2023-06-10T19:03:48.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.425+0000 7f63c4ff9640 1 -- 172.21.15.53:0/1521983400 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 15 and data pool 16 v59) v1 ==== 174+0+0 (secure 0 0 0) 0x7f63b80170c0 con 0x7f63b0004d10 2023-06-10T19:03:48.429 INFO:teuthology.orchestra.run.smithi053.stderr:new fs with metadata pool 15 and data pool 16 2023-06-10T19:03:48.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.437+0000 7f63ce538640 1 -- 172.21.15.53:0/1521983400 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f63b4066280 msgr2=0x7f63b4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:48.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.437+0000 7f63ce538640 1 --2- 172.21.15.53:0/1521983400 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f63b4066280 0x7f63b4068730 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f63bc0019e0 tx=0x7f63bc009040 comp rx=0 tx=0).stop 2023-06-10T19:03:48.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.437+0000 7f63ce538640 1 -- 172.21.15.53:0/1521983400 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63b0004d10 msgr2=0x7f63c814bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:48.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.437+0000 7f63ce538640 1 --2- 172.21.15.53:0/1521983400 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63b0004d10 0x7f63c814bfd0 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7f63b800e7f0 tx=0x7f63b800ecb0 comp rx=0 tx=0).stop 2023-06-10T19:03:48.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.441+0000 7f63ce538640 1 -- 172.21.15.53:0/1521983400 shutdown_connections 2023-06-10T19:03:48.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.441+0000 7f63ce538640 1 --2- 172.21.15.53:0/1521983400 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f63b4066280 0x7f63b4068730 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:48.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.441+0000 7f63ce538640 1 --2- 172.21.15.53:0/1521983400 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63c8157db0 0x7f63c8158220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:48.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.441+0000 7f63ce538640 1 --2- 172.21.15.53:0/1521983400 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63c815cc80 0x7f63c815a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:48.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.441+0000 7f63ce538640 1 --2- 172.21.15.53:0/1521983400 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63b0004d10 0x7f63c814bfd0 unknown :-1 s=CLOSED pgs=1706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:48.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.441+0000 7f63ce538640 1 -- 172.21.15.53:0/1521983400 >> 172.21.15.53:0/1521983400 conn(0x7f63c806a0e0 msgr2=0x7f63c80b2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:48.445 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.441+0000 7f63ce538640 1 -- 172.21.15.53:0/1521983400 shutdown_connections 2023-06-10T19:03:48.445 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.441+0000 7f63ce538640 1 -- 172.21.15.53:0/1521983400 wait complete. 2023-06-10T19:03:48.469 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:03:48.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.585+0000 7f82cdb14640 1 Processor -- start 2023-06-10T19:03:48.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.585+0000 7f82cdb14640 1 -- start start 2023-06-10T19:03:48.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.585+0000 7f82cdb14640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f82c80b3ac0 0x7f82c80b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:48.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.585+0000 7f82cdb14640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f82c80cc690 0x7f82c815f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:48.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.585+0000 7f82cdb14640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82c80d0020 con 0x7f82c80ccae0 2023-06-10T19:03:48.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.585+0000 7f82cdb14640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82c80b43d0 con 0x7f82c80b3ac0 2023-06-10T19:03:48.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.585+0000 7f82cdb14640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82c80cef40 con 0x7f82c80cc690 2023-06-10T19:03:48.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.585+0000 7f82c77fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f82c80b3ac0 0x7f82c80b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:48.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.585+0000 7f82c7fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f82c80ccae0 0x7f82c815f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60524/0 (socket says 172.21.15.53:60524) 2023-06-10T19:03:48.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.585+0000 7f82c7fff640 1 -- 172.21.15.53:0/1715782728 learned_addr learned my addr 172.21.15.53:0/1715782728 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:03:48.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.585+0000 7f82c6ffd640 1 --2- 172.21.15.53:0/1715782728 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f82c80cc690 0x7f82c815f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:48.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.585+0000 7f82c77fe640 1 -- 172.21.15.53:0/1715782728 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f82c80cc690 msgr2=0x7f82c815f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:48.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.585+0000 7f82c77fe640 1 --2- 172.21.15.53:0/1715782728 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f82c80cc690 0x7f82c815f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:48.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.585+0000 7f82c77fe640 1 -- 172.21.15.53:0/1715782728 >> v1:172.21.15.53:6789/0 conn(0x7f82c80ccae0 legacy=0x7f82c815f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:48.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.585+0000 7f82c67fc640 1 -- 172.21.15.53:0/1715782728 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4293097425 0 0) 0x7f82c80d0020 con 0x7f82c80ccae0 2023-06-10T19:03:48.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.585+0000 7f82c77fe640 1 -- 172.21.15.53:0/1715782728 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82c80cf220 con 0x7f82c80b3ac0 2023-06-10T19:03:48.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.585+0000 7f82c6ffd640 1 --2- 172.21.15.53:0/1715782728 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f82c80cc690 0x7f82c815f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:03:48.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.589+0000 7f82c77fe640 1 --2- 172.21.15.53:0/1715782728 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82c80b3ac0 0x7f82c80b3e90 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f82b80097c0 tx=0x7f82b801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=126fcb3f095251c6 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:48.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.589+0000 7f82c67fc640 1 -- 172.21.15.53:0/1715782728 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b80ab650 con 0x7f82c80b3ac0 2023-06-10T19:03:48.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.589+0000 7f82c67fc640 1 -- 172.21.15.53:0/1715782728 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82b80ab7b0 con 0x7f82c80b3ac0 2023-06-10T19:03:48.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.589+0000 7f82c67fc640 1 -- 172.21.15.53:0/1715782728 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b80abb40 con 0x7f82c80b3ac0 2023-06-10T19:03:48.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.589+0000 7f82cdb14640 1 -- 172.21.15.53:0/1715782728 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82c80b3ac0 msgr2=0x7f82c80b3e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:48.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.589+0000 7f82cdb14640 1 --2- 172.21.15.53:0/1715782728 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82c80b3ac0 0x7f82c80b3e90 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f82b80097c0 tx=0x7f82b801c450 comp rx=0 tx=0).stop 2023-06-10T19:03:48.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.589+0000 7f82cdb14640 1 -- 172.21.15.53:0/1715782728 shutdown_connections 2023-06-10T19:03:48.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.589+0000 7f82cdb14640 1 --2- 172.21.15.53:0/1715782728 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f82c80cc690 0x7f82c815f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:48.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.589+0000 7f82cdb14640 1 --2- 172.21.15.53:0/1715782728 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82c80b3ac0 0x7f82c80b3e90 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:48.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.589+0000 7f82cdb14640 1 -- 172.21.15.53:0/1715782728 >> 172.21.15.53:0/1715782728 conn(0x7f82c8071790 msgr2=0x7f82c8069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:48.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.589+0000 7f82cdb14640 1 -- 172.21.15.53:0/1715782728 shutdown_connections 2023-06-10T19:03:48.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.589+0000 7f82cdb14640 1 -- 172.21.15.53:0/1715782728 wait complete. 2023-06-10T19:03:48.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.589+0000 7f82cdb14640 1 Processor -- start 2023-06-10T19:03:48.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.589+0000 7f82cdb14640 1 -- start start 2023-06-10T19:03:48.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.589+0000 7f82cdb14640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f82c80b3ac0 0x7f82c814e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:48.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.589+0000 7f82cdb14640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82c80cc690 0x7f82c815e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:48.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.589+0000 7f82cdb14640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f82c80ccae0 0x7f82c80b2d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:48.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.589+0000 7f82cdb14640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82c81591a0 con 0x7f82c80cc690 2023-06-10T19:03:48.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.589+0000 7f82cdb14640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82c8159440 con 0x7f82c80b3ac0 2023-06-10T19:03:48.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.589+0000 7f82cdb14640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82c8159720 con 0x7f82c80ccae0 2023-06-10T19:03:48.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.589+0000 7f82c6ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82c80cc690 0x7f82c815e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:48.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.589+0000 7f82c6ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82c80cc690 0x7f82c815e2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56884/0 (socket says 172.21.15.53:56884) 2023-06-10T19:03:48.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.589+0000 7f82c6ffd640 1 -- 172.21.15.53:0/3067977926 learned_addr learned my addr 172.21.15.53:0/3067977926 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:48.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.589+0000 7f82c7fff640 1 --2- 172.21.15.53:0/3067977926 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f82c80ccae0 0x7f82c80b2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:48.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.589+0000 7f82c6ffd640 1 -- 172.21.15.53:0/3067977926 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f82c80ccae0 msgr2=0x7f82c80b2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:48.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.589+0000 7f82c6ffd640 1 --2- 172.21.15.53:0/3067977926 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f82c80ccae0 0x7f82c80b2d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:48.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.589+0000 7f82c77fe640 1 --2- 172.21.15.53:0/3067977926 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f82c80b3ac0 0x7f82c814e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:48.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.589+0000 7f82c6ffd640 1 -- 172.21.15.53:0/3067977926 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f82c80b3ac0 msgr2=0x7f82c814e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:48.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.589+0000 7f82c6ffd640 1 --2- 172.21.15.53:0/3067977926 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f82c80b3ac0 0x7f82c814e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:48.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.589+0000 7f82c6ffd640 1 -- 172.21.15.53:0/3067977926 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82b8009420 con 0x7f82c80cc690 2023-06-10T19:03:48.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.589+0000 7f82c7fff640 1 --2- 172.21.15.53:0/3067977926 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f82c80ccae0 0x7f82c80b2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:03:48.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.589+0000 7f82c6ffd640 1 --2- 172.21.15.53:0/3067977926 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82c80cc690 0x7f82c815e2d0 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f82bc00c7c0 tx=0x7f82bc00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:48.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.589+0000 7f82affff640 1 -- 172.21.15.53:0/3067977926 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82bc007a30 con 0x7f82c80cc690 2023-06-10T19:03:48.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.589+0000 7f82affff640 1 -- 172.21.15.53:0/3067977926 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82bc007b90 con 0x7f82c80cc690 2023-06-10T19:03:48.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.589+0000 7f82cdb14640 1 -- 172.21.15.53:0/3067977926 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82c8159a00 con 0x7f82c80cc690 2023-06-10T19:03:48.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.589+0000 7f82affff640 1 -- 172.21.15.53:0/3067977926 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82bc00ce70 con 0x7f82c80cc690 2023-06-10T19:03:48.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.593+0000 7f82cdb14640 1 -- 172.21.15.53:0/3067977926 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82c815d570 con 0x7f82c80cc690 2023-06-10T19:03:48.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.593+0000 7f82cdb14640 1 -- 172.21.15.53:0/3067977926 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82c804d790 con 0x7f82c80cc690 2023-06-10T19:03:48.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.593+0000 7f82affff640 1 -- 172.21.15.53:0/3067977926 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f82bc0113f0 con 0x7f82c80cc690 2023-06-10T19:03:48.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.593+0000 7f82affff640 1 --2- 172.21.15.53:0/3067977926 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f82b4066280 0x7f82b4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:48.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.593+0000 7f82affff640 1 -- 172.21.15.53:0/3067977926 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f82bc084ba0 con 0x7f82c80cc690 2023-06-10T19:03:48.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.593+0000 7f82c77fe640 1 --2- 172.21.15.53:0/3067977926 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f82b4066280 0x7f82b4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:48.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.593+0000 7f82c77fe640 1 --2- 172.21.15.53:0/3067977926 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f82b4066280 0x7f82b4068730 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f82b80af000 tx=0x7f82b8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:48.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.597+0000 7f82affff640 1 -- 172.21.15.53:0/3067977926 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f82bc0516c0 con 0x7f82c80cc690 2023-06-10T19:03:48.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.753+0000 7f82cdb14640 1 -- 172.21.15.53:0/3067977926 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f82c8159eb0 con 0x7f82c80cc690 2023-06-10T19:03:48.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.757+0000 7f82affff640 1 -- 172.21.15.53:0/3067977926 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v109) v1 ==== 74+0+18294 (secure 0 0 0) 0x7f82bc054ce0 con 0x7f82c80cc690 2023-06-10T19:03:48.762 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:03:48.762 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":109,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:03:48.419689+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-06-10T19:03:46.427131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-06-10T19:03:47.398979+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:03:48.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.761+0000 7f82cdb14640 1 -- 172.21.15.53:0/3067977926 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f82b4066280 msgr2=0x7f82b4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:48.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.761+0000 7f82cdb14640 1 --2- 172.21.15.53:0/3067977926 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f82b4066280 0x7f82b4068730 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f82b80af000 tx=0x7f82b8008040 comp rx=0 tx=0).stop 2023-06-10T19:03:48.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.761+0000 7f82cdb14640 1 -- 172.21.15.53:0/3067977926 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82c80cc690 msgr2=0x7f82c815e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:48.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.761+0000 7f82cdb14640 1 --2- 172.21.15.53:0/3067977926 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82c80cc690 0x7f82c815e2d0 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f82bc00c7c0 tx=0x7f82bc00cc80 comp rx=0 tx=0).stop 2023-06-10T19:03:48.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.761+0000 7f82cdb14640 1 -- 172.21.15.53:0/3067977926 shutdown_connections 2023-06-10T19:03:48.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.761+0000 7f82cdb14640 1 --2- 172.21.15.53:0/3067977926 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f82b4066280 0x7f82b4068730 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:48.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.761+0000 7f82cdb14640 1 --2- 172.21.15.53:0/3067977926 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f82c80ccae0 0x7f82c80b2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:48.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.761+0000 7f82cdb14640 1 --2- 172.21.15.53:0/3067977926 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82c80cc690 0x7f82c815e2d0 unknown :-1 s=CLOSED pgs=1709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:48.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.761+0000 7f82cdb14640 1 --2- 172.21.15.53:0/3067977926 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f82c80b3ac0 0x7f82c814e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:48.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.761+0000 7f82cdb14640 1 -- 172.21.15.53:0/3067977926 >> 172.21.15.53:0/3067977926 conn(0x7f82c8071790 msgr2=0x7f82c8154b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:48.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.761+0000 7f82cdb14640 1 -- 172.21.15.53:0/3067977926 shutdown_connections 2023-06-10T19:03:48.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.761+0000 7f82cdb14640 1 -- 172.21.15.53:0/3067977926 wait complete. 2023-06-10T19:03:48.781 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:03:48.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.901+0000 7f7fda053640 1 Processor -- start 2023-06-10T19:03:48.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.901+0000 7f7fda053640 1 -- start start 2023-06-10T19:03:48.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.905+0000 7f7fda053640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7fd40c9840 0x7f7fd40c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:48.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.905+0000 7f7fda053640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7fd406b090 0x7f7fd406b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:48.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.905+0000 7f7fda053640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fd4159b50 con 0x7f7fd4071060 2023-06-10T19:03:48.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.905+0000 7f7fda053640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fd40ca150 con 0x7f7fd406b090 2023-06-10T19:03:48.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.905+0000 7f7fda053640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd40702a0 con 0x7f7fd40c9840 2023-06-10T19:03:48.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.905+0000 7f7fd2ffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f7fd4071060 0x7f7fd40af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60536/0 (socket says 172.21.15.53:60536) 2023-06-10T19:03:48.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.905+0000 7f7fd2ffd640 1 -- 172.21.15.53:0/2215648869 learned_addr learned my addr 172.21.15.53:0/2215648869 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:03:48.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.905+0000 7f7fd3fff640 1 --2- 172.21.15.53:0/2215648869 >> v2:172.21.15.53:3300/0 conn(0x7f7fd406b090 0x7f7fd406b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:48.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.905+0000 7f7fd37fe640 1 --2- 172.21.15.53:0/2215648869 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7fd40c9840 0x7f7fd40c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:48.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.905+0000 7f7fd3fff640 1 -- 172.21.15.53:0/2215648869 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7fd40c9840 msgr2=0x7f7fd40c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:48.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.905+0000 7f7fd3fff640 1 --2- 172.21.15.53:0/2215648869 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7fd40c9840 0x7f7fd40c9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:48.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.905+0000 7f7fd3fff640 1 -- 172.21.15.53:0/2215648869 >> v1:172.21.15.53:6789/0 conn(0x7f7fd4071060 legacy=0x7f7fd40af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:48.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.905+0000 7f7fd3fff640 1 -- 172.21.15.53:0/2215648869 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fd4070580 con 0x7f7fd406b090 2023-06-10T19:03:48.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.905+0000 7f7fd3fff640 1 --2- 172.21.15.53:0/2215648869 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7fd406b090 0x7f7fd406b530 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc009d90 tx=0x7f7fcc01c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d344905927c41f server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:48.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.905+0000 7f7fd27fc640 1 -- 172.21.15.53:0/2215648869 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fcc0a5800 con 0x7f7fd406b090 2023-06-10T19:03:48.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.909+0000 7f7fd27fc640 1 -- 172.21.15.53:0/2215648869 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fcc0a5960 con 0x7f7fd406b090 2023-06-10T19:03:48.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.909+0000 7f7fd27fc640 1 -- 172.21.15.53:0/2215648869 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fcc0a5cf0 con 0x7f7fd406b090 2023-06-10T19:03:48.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.909+0000 7f7fda053640 1 -- 172.21.15.53:0/2215648869 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7fd406b090 msgr2=0x7f7fd406b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:48.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.909+0000 7f7fda053640 1 --2- 172.21.15.53:0/2215648869 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7fd406b090 0x7f7fd406b530 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc009d90 tx=0x7f7fcc01c7e0 comp rx=0 tx=0).stop 2023-06-10T19:03:48.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.909+0000 7f7fda053640 1 -- 172.21.15.53:0/2215648869 shutdown_connections 2023-06-10T19:03:48.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.909+0000 7f7fda053640 1 --2- 172.21.15.53:0/2215648869 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7fd406b090 0x7f7fd406b530 unknown :-1 s=CLOSED pgs=1711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:48.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.909+0000 7f7fda053640 1 --2- 172.21.15.53:0/2215648869 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7fd40c9840 0x7f7fd40c9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:48.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.909+0000 7f7fda053640 1 -- 172.21.15.53:0/2215648869 >> 172.21.15.53:0/2215648869 conn(0x7f7fd406a0d0 msgr2=0x7f7fd40ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:48.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.909+0000 7f7fda053640 1 -- 172.21.15.53:0/2215648869 shutdown_connections 2023-06-10T19:03:48.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.909+0000 7f7fda053640 1 -- 172.21.15.53:0/2215648869 wait complete. 2023-06-10T19:03:48.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.909+0000 7f7fda053640 1 Processor -- start 2023-06-10T19:03:48.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.909+0000 7f7fda053640 1 -- start start 2023-06-10T19:03:48.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.909+0000 7f7fda053640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7fd406b090 0x7f7fd414bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:48.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.909+0000 7f7fda053640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7fd4071060 0x7f7fd40b19e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:48.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.909+0000 7f7fda053640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7fd40c9840 0x7f7fd40b1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:48.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.909+0000 7f7fda053640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd4154500 con 0x7f7fd40c9840 2023-06-10T19:03:48.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.909+0000 7f7fda053640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd40b2460 con 0x7f7fd406b090 2023-06-10T19:03:48.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.909+0000 7f7fda053640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd40c31c0 con 0x7f7fd4071060 2023-06-10T19:03:48.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.909+0000 7f7fd3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7fd40c9840 0x7f7fd40b1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:48.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.909+0000 7f7fd3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7fd40c9840 0x7f7fd40b1f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56888/0 (socket says 172.21.15.53:56888) 2023-06-10T19:03:48.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.909+0000 7f7fd3fff640 1 -- 172.21.15.53:0/2755557730 learned_addr learned my addr 172.21.15.53:0/2755557730 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:48.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.909+0000 7f7fd2ffd640 1 --2- 172.21.15.53:0/2755557730 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7fd4071060 0x7f7fd40b19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:48.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.909+0000 7f7fd37fe640 1 --2- 172.21.15.53:0/2755557730 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7fd406b090 0x7f7fd414bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:48.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.909+0000 7f7fd3fff640 1 -- 172.21.15.53:0/2755557730 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7fd4071060 msgr2=0x7f7fd40b19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:48.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.909+0000 7f7fd3fff640 1 --2- 172.21.15.53:0/2755557730 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7fd4071060 0x7f7fd40b19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:48.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.909+0000 7f7fd3fff640 1 -- 172.21.15.53:0/2755557730 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7fd406b090 msgr2=0x7f7fd414bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:48.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.909+0000 7f7fd3fff640 1 --2- 172.21.15.53:0/2755557730 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7fd406b090 0x7f7fd414bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:48.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.909+0000 7f7fd3fff640 1 -- 172.21.15.53:0/2755557730 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fcc009a70 con 0x7f7fd40c9840 2023-06-10T19:03:48.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.909+0000 7f7fd2ffd640 1 --2- 172.21.15.53:0/2755557730 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7fd4071060 0x7f7fd40b19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:03:48.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.909+0000 7f7fd37fe640 1 --2- 172.21.15.53:0/2755557730 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7fd406b090 0x7f7fd414bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:03:48.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.909+0000 7f7fd3fff640 1 --2- 172.21.15.53:0/2755557730 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7fd40c9840 0x7f7fd40b1f20 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc009d90 tx=0x7f7fcc019580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:48.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.909+0000 7f7fbbfff640 1 -- 172.21.15.53:0/2755557730 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fcc007000 con 0x7f7fd40c9840 2023-06-10T19:03:48.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.909+0000 7f7fbbfff640 1 -- 172.21.15.53:0/2755557730 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fcc0aec90 con 0x7f7fd40c9840 2023-06-10T19:03:48.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.909+0000 7f7fda053640 1 -- 172.21.15.53:0/2755557730 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fd4153bd0 con 0x7f7fd40c9840 2023-06-10T19:03:48.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.909+0000 7f7fbbfff640 1 -- 172.21.15.53:0/2755557730 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fcc009450 con 0x7f7fd40c9840 2023-06-10T19:03:48.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.909+0000 7f7fda053640 1 -- 172.21.15.53:0/2755557730 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fd4154190 con 0x7f7fd40c9840 2023-06-10T19:03:48.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.913+0000 7f7fda053640 1 -- 172.21.15.53:0/2755557730 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fd41546b0 con 0x7f7fd40c9840 2023-06-10T19:03:48.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.913+0000 7f7fbbfff640 1 -- 172.21.15.53:0/2755557730 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7fcc0b4050 con 0x7f7fd40c9840 2023-06-10T19:03:48.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.913+0000 7f7fbbfff640 1 --2- 172.21.15.53:0/2755557730 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7fc0066280 0x7f7fc0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:48.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.913+0000 7f7fbbfff640 1 -- 172.21.15.53:0/2755557730 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7fcc11ee20 con 0x7f7fd40c9840 2023-06-10T19:03:48.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.913+0000 7f7fd37fe640 1 --2- 172.21.15.53:0/2755557730 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7fc0066280 0x7f7fc0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:48.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.913+0000 7f7fd37fe640 1 --2- 172.21.15.53:0/2755557730 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7fc0066280 0x7f7fc0068730 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f7fc4009840 tx=0x7f7fc4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:48.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:48.917+0000 7f7fbbfff640 1 -- 172.21.15.53:0/2755557730 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7fd41546b0 con 0x7f7fd40c9840 2023-06-10T19:03:49.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.073+0000 7f7fda053640 1 -- 172.21.15.53:0/2755557730 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7fd41546b0 con 0x7f7fd40c9840 2023-06-10T19:03:49.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.073+0000 7f7fbbfff640 1 -- 172.21.15.53:0/2755557730 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v109) v1 ==== 74+0+18294 (secure 0 0 0) 0x7f7fd41546b0 con 0x7f7fd40c9840 2023-06-10T19:03:49.079 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:03:49.079 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":109,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:03:48.419689+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-06-10T19:03:46.427131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-06-10T19:03:47.398979+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:03:49.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.077+0000 7f7fda053640 1 -- 172.21.15.53:0/2755557730 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7fc0066280 msgr2=0x7f7fc0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:49.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.077+0000 7f7fda053640 1 --2- 172.21.15.53:0/2755557730 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7fc0066280 0x7f7fc0068730 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f7fc4009840 tx=0x7f7fc4008040 comp rx=0 tx=0).stop 2023-06-10T19:03:49.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.077+0000 7f7fda053640 1 -- 172.21.15.53:0/2755557730 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7fd40c9840 msgr2=0x7f7fd40b1f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:49.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.077+0000 7f7fda053640 1 --2- 172.21.15.53:0/2755557730 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7fd40c9840 0x7f7fd40b1f20 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc009d90 tx=0x7f7fcc019580 comp rx=0 tx=0).stop 2023-06-10T19:03:49.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.077+0000 7f7fda053640 1 -- 172.21.15.53:0/2755557730 shutdown_connections 2023-06-10T19:03:49.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.077+0000 7f7fda053640 1 --2- 172.21.15.53:0/2755557730 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7fc0066280 0x7f7fc0068730 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:49.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.077+0000 7f7fda053640 1 --2- 172.21.15.53:0/2755557730 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7fd40c9840 0x7f7fd40b1f20 unknown :-1 s=CLOSED pgs=1712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:49.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.077+0000 7f7fda053640 1 --2- 172.21.15.53:0/2755557730 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7fd4071060 0x7f7fd40b19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:49.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.077+0000 7f7fda053640 1 --2- 172.21.15.53:0/2755557730 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7fd406b090 0x7f7fd414bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:49.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.077+0000 7f7fda053640 1 -- 172.21.15.53:0/2755557730 >> 172.21.15.53:0/2755557730 conn(0x7f7fd406a0d0 msgr2=0x7f7fd40c84f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:49.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.077+0000 7f7fda053640 1 -- 172.21.15.53:0/2755557730 shutdown_connections 2023-06-10T19:03:49.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.077+0000 7f7fda053640 1 -- 172.21.15.53:0/2755557730 wait complete. 2023-06-10T19:03:49.096 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-06-10T19:03:49.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.205+0000 7f38b1a0d640 1 Processor -- start 2023-06-10T19:03:49.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.205+0000 7f38b1a0d640 1 -- start start 2023-06-10T19:03:49.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.209+0000 7f38b1a0d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38ac0c9fa0 0x7f38ac06bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:49.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.209+0000 7f38b1a0d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f38ac06c020 0x7f38ac0c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:49.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.209+0000 7f38b1a0d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38ac06b090 con 0x7f38ac0c87e0 2023-06-10T19:03:49.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.209+0000 7f38b1a0d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38ac0ca370 con 0x7f38ac06c020 2023-06-10T19:03:49.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.209+0000 7f38b1a0d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38ac070d50 con 0x7f38ac0c9fa0 2023-06-10T19:03:49.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.209+0000 7f38aaffd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38ac0c9fa0 0x7f38ac06bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:49.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.209+0000 7f38a27fc640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f38ac06c020 0x7f38ac0c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:49.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.209+0000 7f38aaffd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38ac0c9fa0 0x7f38ac06bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.53:43658/0 (socket says 172.21.15.53:43658) 2023-06-10T19:03:49.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.209+0000 7f38aaffd640 1 -- 172.21.15.53:0/206399620 learned_addr learned my addr 172.21.15.53:0/206399620 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:49.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.209+0000 7f38a27fc640 1 -- 172.21.15.53:0/206399620 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38ac0c9fa0 msgr2=0x7f38ac06bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:49.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.209+0000 7f38a27fc640 1 --2- 172.21.15.53:0/206399620 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38ac0c9fa0 0x7f38ac06bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:49.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.209+0000 7f38a27fc640 1 -- 172.21.15.53:0/206399620 >> v1:172.21.15.117:6789/0 conn(0x7f38ac0c87e0 legacy=0x7f38ac0af760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:49.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.209+0000 7f38a27fc640 1 -- 172.21.15.53:0/206399620 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38ac071030 con 0x7f38ac06c020 2023-06-10T19:03:49.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.209+0000 7f38aaffd640 1 --2- 172.21.15.53:0/206399620 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38ac0c9fa0 0x7f38ac06bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-10T19:03:49.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.213+0000 7f38a27fc640 1 --2- 172.21.15.53:0/206399620 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38ac06c020 0x7f38ac0c82a0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f38940097c0 tx=0x7f389401c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbca77436391d86c server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:49.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.213+0000 7f38aa7fc640 1 -- 172.21.15.53:0/206399620 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38940ab600 con 0x7f38ac06c020 2023-06-10T19:03:49.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.213+0000 7f38aa7fc640 1 -- 172.21.15.53:0/206399620 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38940a7050 con 0x7f38ac06c020 2023-06-10T19:03:49.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.213+0000 7f38aa7fc640 1 -- 172.21.15.53:0/206399620 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38940ab980 con 0x7f38ac06c020 2023-06-10T19:03:49.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.213+0000 7f38b1a0d640 1 -- 172.21.15.53:0/206399620 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38ac06c020 msgr2=0x7f38ac0c82a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:49.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.213+0000 7f38b1a0d640 1 --2- 172.21.15.53:0/206399620 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38ac06c020 0x7f38ac0c82a0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f38940097c0 tx=0x7f389401c3c0 comp rx=0 tx=0).stop 2023-06-10T19:03:49.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.213+0000 7f38b1a0d640 1 -- 172.21.15.53:0/206399620 shutdown_connections 2023-06-10T19:03:49.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.213+0000 7f38b1a0d640 1 --2- 172.21.15.53:0/206399620 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38ac06c020 0x7f38ac0c82a0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:49.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.213+0000 7f38b1a0d640 1 --2- 172.21.15.53:0/206399620 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38ac0c9fa0 0x7f38ac06bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:49.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.213+0000 7f38b1a0d640 1 -- 172.21.15.53:0/206399620 >> 172.21.15.53:0/206399620 conn(0x7f38ac06a0e0 msgr2=0x7f38ac0cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:49.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.213+0000 7f38b1a0d640 1 -- 172.21.15.53:0/206399620 shutdown_connections 2023-06-10T19:03:49.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.213+0000 7f38b1a0d640 1 -- 172.21.15.53:0/206399620 wait complete. 2023-06-10T19:03:49.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.213+0000 7f38b1a0d640 1 Processor -- start 2023-06-10T19:03:49.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.213+0000 7f38b1a0d640 1 -- start start 2023-06-10T19:03:49.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.213+0000 7f38b1a0d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38ac06c020 0x7f38ac142680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:49.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.213+0000 7f38b1a0d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38ac0c87e0 0x7f38ac1548d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:49.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.213+0000 7f38b1a0d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38ac0c9fa0 0x7f38ac154e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:49.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.213+0000 7f38b1a0d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38ac14ff60 con 0x7f38ac06c020 2023-06-10T19:03:49.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.213+0000 7f38b1a0d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38ac0c1800 con 0x7f38ac0c87e0 2023-06-10T19:03:49.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.213+0000 7f38b1a0d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38ac0c1aa0 con 0x7f38ac0c9fa0 2023-06-10T19:03:49.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.213+0000 7f38aaffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38ac06c020 0x7f38ac142680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:49.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.213+0000 7f38aaffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38ac06c020 0x7f38ac142680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56898/0 (socket says 172.21.15.53:56898) 2023-06-10T19:03:49.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.213+0000 7f38aaffd640 1 -- 172.21.15.53:0/3420953935 learned_addr learned my addr 172.21.15.53:0/3420953935 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:49.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.213+0000 7f38a27fc640 1 --2- 172.21.15.53:0/3420953935 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38ac0c87e0 0x7f38ac1548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:49.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.213+0000 7f38ab7fe640 1 --2- 172.21.15.53:0/3420953935 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38ac0c9fa0 0x7f38ac154e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:49.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.213+0000 7f38aaffd640 1 -- 172.21.15.53:0/3420953935 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38ac0c9fa0 msgr2=0x7f38ac154e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:49.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.213+0000 7f38aaffd640 1 --2- 172.21.15.53:0/3420953935 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38ac0c9fa0 0x7f38ac154e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:49.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.213+0000 7f38aaffd640 1 -- 172.21.15.53:0/3420953935 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38ac0c87e0 msgr2=0x7f38ac1548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:49.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.213+0000 7f38aaffd640 1 --2- 172.21.15.53:0/3420953935 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38ac0c87e0 0x7f38ac1548d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:49.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.213+0000 7f38aaffd640 1 -- 172.21.15.53:0/3420953935 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f389c0094d0 con 0x7f38ac06c020 2023-06-10T19:03:49.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.213+0000 7f38ab7fe640 1 --2- 172.21.15.53:0/3420953935 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38ac0c9fa0 0x7f38ac154e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:03:49.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.213+0000 7f38aaffd640 1 --2- 172.21.15.53:0/3420953935 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38ac06c020 0x7f38ac142680 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f389c00e930 tx=0x7f389c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:49.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.213+0000 7f38a8ff9640 1 -- 172.21.15.53:0/3420953935 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f389c00ca00 con 0x7f38ac06c020 2023-06-10T19:03:49.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.213+0000 7f38a8ff9640 1 -- 172.21.15.53:0/3420953935 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f389c00cb60 con 0x7f38ac06c020 2023-06-10T19:03:49.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.217+0000 7f38b1a0d640 1 -- 172.21.15.53:0/3420953935 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3894009420 con 0x7f38ac06c020 2023-06-10T19:03:49.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.217+0000 7f38a8ff9640 1 -- 172.21.15.53:0/3420953935 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f389c013470 con 0x7f38ac06c020 2023-06-10T19:03:49.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.217+0000 7f38b1a0d640 1 -- 172.21.15.53:0/3420953935 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38ac1501b0 con 0x7f38ac06c020 2023-06-10T19:03:49.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.217+0000 7f38b1a0d640 1 -- 172.21.15.53:0/3420953935 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38ac04d790 con 0x7f38ac06c020 2023-06-10T19:03:49.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.217+0000 7f38a8ff9640 1 -- 172.21.15.53:0/3420953935 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f389c0135d0 con 0x7f38ac06c020 2023-06-10T19:03:49.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.217+0000 7f38a8ff9640 1 --2- 172.21.15.53:0/3420953935 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f388c066280 0x7f388c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:49.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.217+0000 7f38a8ff9640 1 -- 172.21.15.53:0/3420953935 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f389c083ef0 con 0x7f38ac06c020 2023-06-10T19:03:49.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.217+0000 7f38a27fc640 1 --2- 172.21.15.53:0/3420953935 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f388c066280 0x7f388c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:49.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.217+0000 7f38a27fc640 1 --2- 172.21.15.53:0/3420953935 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f388c066280 0x7f388c068730 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f38940ad000 tx=0x7f38940a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:49.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.221+0000 7f38a8ff9640 1 -- 172.21.15.53:0/3420953935 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f389c051420 con 0x7f38ac06c020 2023-06-10T19:03:49.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.409+0000 7f38b1a0d640 1 -- 172.21.15.53:0/3420953935 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f38ac0ce670 con 0x7f38ac06c020 2023-06-10T19:03:49.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.457+0000 7f38a8ff9640 1 -- 172.21.15.53:0/3420953935 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v60) v1 ==== 118+0+0 (secure 0 0 0) 0x7f389c054a40 con 0x7f38ac06c020 2023-06-10T19:03:49.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.457+0000 7f38b1a0d640 1 -- 172.21.15.53:0/3420953935 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f388c066280 msgr2=0x7f388c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:49.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.457+0000 7f38b1a0d640 1 --2- 172.21.15.53:0/3420953935 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f388c066280 0x7f388c068730 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f38940ad000 tx=0x7f38940a6000 comp rx=0 tx=0).stop 2023-06-10T19:03:49.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.457+0000 7f38b1a0d640 1 -- 172.21.15.53:0/3420953935 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38ac06c020 msgr2=0x7f38ac142680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:49.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.457+0000 7f38b1a0d640 1 --2- 172.21.15.53:0/3420953935 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38ac06c020 0x7f38ac142680 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f389c00e930 tx=0x7f389c00edf0 comp rx=0 tx=0).stop 2023-06-10T19:03:49.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.461+0000 7f38b1a0d640 1 -- 172.21.15.53:0/3420953935 shutdown_connections 2023-06-10T19:03:49.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.461+0000 7f38b1a0d640 1 --2- 172.21.15.53:0/3420953935 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f388c066280 0x7f388c068730 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:49.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.461+0000 7f38b1a0d640 1 --2- 172.21.15.53:0/3420953935 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38ac0c9fa0 0x7f38ac154e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:49.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.461+0000 7f38b1a0d640 1 --2- 172.21.15.53:0/3420953935 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38ac0c87e0 0x7f38ac1548d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:49.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.461+0000 7f38b1a0d640 1 --2- 172.21.15.53:0/3420953935 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38ac06c020 0x7f38ac142680 unknown :-1 s=CLOSED pgs=1713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:49.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.461+0000 7f38b1a0d640 1 -- 172.21.15.53:0/3420953935 >> 172.21.15.53:0/3420953935 conn(0x7f38ac06a0e0 msgr2=0x7f38ac0b3010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:49.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.461+0000 7f38b1a0d640 1 -- 172.21.15.53:0/3420953935 shutdown_connections 2023-06-10T19:03:49.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.461+0000 7f38b1a0d640 1 -- 172.21.15.53:0/3420953935 wait complete. 2023-06-10T19:03:49.481 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-06-10T19:03:49.481 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-06-10T19:03:49.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.609+0000 7f75861b5640 1 Processor -- start 2023-06-10T19:03:49.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.609+0000 7f75861b5640 1 -- start start 2023-06-10T19:03:49.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.609+0000 7f75861b5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7580159690 0x7f7580070950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:49.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.609+0000 7f75861b5640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f75800b0f30 0x7f75800cbe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:49.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.609+0000 7f75861b5640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75800cb080 con 0x7f7580159a60 2023-06-10T19:03:49.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.609+0000 7f75861b5640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7580070e90 con 0x7f75800b0f30 2023-06-10T19:03:49.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.609+0000 7f75861b5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f758006d450 con 0x7f7580159690 2023-06-10T19:03:49.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.609+0000 7f757effd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f75800b0f30 0x7f75800cbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:49.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.609+0000 7f757effd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f75800b0f30 0x7f75800cbe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56908/0 (socket says 172.21.15.53:56908) 2023-06-10T19:03:49.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.609+0000 7f757effd640 1 -- 172.21.15.53:0/335090107 learned_addr learned my addr 172.21.15.53:0/335090107 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:49.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.609+0000 7f757f7fe640 1 --2- 172.21.15.53:0/335090107 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7580159690 0x7f7580070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:49.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.609+0000 7f757effd640 1 -- 172.21.15.53:0/335090107 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7580159690 msgr2=0x7f7580070950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:49.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.609+0000 7f757effd640 1 --2- 172.21.15.53:0/335090107 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7580159690 0x7f7580070950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:49.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.609+0000 7f757effd640 1 -- 172.21.15.53:0/335090107 >> v1:172.21.15.53:6789/0 conn(0x7f7580159a60 legacy=0x7f75800c2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:49.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.609+0000 7f757effd640 1 -- 172.21.15.53:0/335090107 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75800cb320 con 0x7f75800b0f30 2023-06-10T19:03:49.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.613+0000 7f757effd640 1 --2- 172.21.15.53:0/335090107 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f75800b0f30 0x7f75800cbe00 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7f7574009870 tx=0x7f757401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b24dd719df953f9a server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:49.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.613+0000 7f757e7fc640 1 -- 172.21.15.53:0/335090107 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75740aa670 con 0x7f75800b0f30 2023-06-10T19:03:49.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.613+0000 7f757e7fc640 1 -- 172.21.15.53:0/335090107 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75740aa7d0 con 0x7f75800b0f30 2023-06-10T19:03:49.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.613+0000 7f757e7fc640 1 -- 172.21.15.53:0/335090107 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75740aab60 con 0x7f75800b0f30 2023-06-10T19:03:49.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.613+0000 7f75861b5640 1 -- 172.21.15.53:0/335090107 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f75800b0f30 msgr2=0x7f75800cbe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:49.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.613+0000 7f75861b5640 1 --2- 172.21.15.53:0/335090107 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f75800b0f30 0x7f75800cbe00 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7f7574009870 tx=0x7f757401c510 comp rx=0 tx=0).stop 2023-06-10T19:03:49.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.613+0000 7f75861b5640 1 -- 172.21.15.53:0/335090107 shutdown_connections 2023-06-10T19:03:49.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.613+0000 7f75861b5640 1 --2- 172.21.15.53:0/335090107 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f75800b0f30 0x7f75800cbe00 unknown :-1 s=CLOSED pgs=1715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:49.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.613+0000 7f75861b5640 1 --2- 172.21.15.53:0/335090107 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7580159690 0x7f7580070950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:49.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.613+0000 7f75861b5640 1 -- 172.21.15.53:0/335090107 >> 172.21.15.53:0/335090107 conn(0x7f758006a560 msgr2=0x7f758006a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:49.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.613+0000 7f75861b5640 1 -- 172.21.15.53:0/335090107 shutdown_connections 2023-06-10T19:03:49.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.613+0000 7f75861b5640 1 -- 172.21.15.53:0/335090107 wait complete. 2023-06-10T19:03:49.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.613+0000 7f75861b5640 1 Processor -- start 2023-06-10T19:03:49.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.613+0000 7f75861b5640 1 -- start start 2023-06-10T19:03:49.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.617+0000 7f75861b5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f75800b0f30 0x7f7580154d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:49.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.617+0000 7f75861b5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7580159690 0x7f75800af6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:49.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.617+0000 7f75861b5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7580159a60 0x7f75800afc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:49.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.617+0000 7f75861b5640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75801556f0 con 0x7f75800b0f30 2023-06-10T19:03:49.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.617+0000 7f75861b5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f758015aea0 con 0x7f7580159a60 2023-06-10T19:03:49.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.617+0000 7f75861b5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f758015b180 con 0x7f7580159690 2023-06-10T19:03:49.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.617+0000 7f757f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f75800b0f30 0x7f7580154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:49.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.617+0000 7f757f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f75800b0f30 0x7f7580154d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56912/0 (socket says 172.21.15.53:56912) 2023-06-10T19:03:49.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.617+0000 7f757f7fe640 1 -- 172.21.15.53:0/22849074 learned_addr learned my addr 172.21.15.53:0/22849074 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:49.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.617+0000 7f757effd640 1 --2- 172.21.15.53:0/22849074 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7580159690 0x7f75800af6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:49.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.617+0000 7f757ffff640 1 --2- 172.21.15.53:0/22849074 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7580159a60 0x7f75800afc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:49.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.617+0000 7f757f7fe640 1 -- 172.21.15.53:0/22849074 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7580159690 msgr2=0x7f75800af6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:49.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.617+0000 7f757f7fe640 1 --2- 172.21.15.53:0/22849074 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7580159690 0x7f75800af6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:49.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.617+0000 7f757f7fe640 1 -- 172.21.15.53:0/22849074 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7580159a60 msgr2=0x7f75800afc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:49.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.617+0000 7f757f7fe640 1 --2- 172.21.15.53:0/22849074 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7580159a60 0x7f75800afc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:49.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.617+0000 7f757f7fe640 1 -- 172.21.15.53:0/22849074 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75740094d0 con 0x7f75800b0f30 2023-06-10T19:03:49.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.617+0000 7f757effd640 1 --2- 172.21.15.53:0/22849074 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7580159690 0x7f75800af6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:03:49.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.617+0000 7f757f7fe640 1 --2- 172.21.15.53:0/22849074 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f75800b0f30 0x7f7580154d30 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f757000d800 tx=0x7f757000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:49.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.617+0000 7f7567fff640 1 -- 172.21.15.53:0/22849074 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757000b6c0 con 0x7f75800b0f30 2023-06-10T19:03:49.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.617+0000 7f7567fff640 1 -- 172.21.15.53:0/22849074 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f757000b820 con 0x7f75800b0f30 2023-06-10T19:03:49.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.617+0000 7f75861b5640 1 -- 172.21.15.53:0/22849074 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f758015b460 con 0x7f75800b0f30 2023-06-10T19:03:49.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.617+0000 7f7567fff640 1 -- 172.21.15.53:0/22849074 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757000bb90 con 0x7f75800b0f30 2023-06-10T19:03:49.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.617+0000 7f75861b5640 1 -- 172.21.15.53:0/22849074 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f758015ba20 con 0x7f75800b0f30 2023-06-10T19:03:49.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.617+0000 7f75861b5640 1 -- 172.21.15.53:0/22849074 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f758004d790 con 0x7f75800b0f30 2023-06-10T19:03:49.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.617+0000 7f7567fff640 1 -- 172.21.15.53:0/22849074 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f757000bcf0 con 0x7f75800b0f30 2023-06-10T19:03:49.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.617+0000 7f7567fff640 1 --2- 172.21.15.53:0/22849074 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f756c066280 0x7f756c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:49.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.617+0000 7f7567fff640 1 -- 172.21.15.53:0/22849074 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f75700842a0 con 0x7f75800b0f30 2023-06-10T19:03:49.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.617+0000 7f757effd640 1 --2- 172.21.15.53:0/22849074 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f756c066280 0x7f756c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:49.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.621+0000 7f757effd640 1 --2- 172.21.15.53:0/22849074 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f756c066280 0x7f756c068730 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f75740ae000 tx=0x7f75740a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:49.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.621+0000 7f7567fff640 1 -- 172.21.15.53:0/22849074 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f75700551b0 con 0x7f75800b0f30 2023-06-10T19:03:49.808 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:49.805+0000 7f75861b5640 1 -- 172.21.15.53:0/22849074 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f7580156a70 con 0x7f75800b0f30 2023-06-10T19:03:50.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.473+0000 7f7567fff640 1 -- 172.21.15.53:0/22849074 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v61) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7570054d40 con 0x7f75800b0f30 2023-06-10T19:03:50.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.477+0000 7f75861b5640 1 -- 172.21.15.53:0/22849074 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f756c066280 msgr2=0x7f756c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:50.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.477+0000 7f75861b5640 1 --2- 172.21.15.53:0/22849074 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f756c066280 0x7f756c068730 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f75740ae000 tx=0x7f75740a7000 comp rx=0 tx=0).stop 2023-06-10T19:03:50.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.477+0000 7f75861b5640 1 -- 172.21.15.53:0/22849074 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f75800b0f30 msgr2=0x7f7580154d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:50.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.477+0000 7f75861b5640 1 --2- 172.21.15.53:0/22849074 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f75800b0f30 0x7f7580154d30 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f757000d800 tx=0x7f757000dcc0 comp rx=0 tx=0).stop 2023-06-10T19:03:50.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.477+0000 7f75861b5640 1 -- 172.21.15.53:0/22849074 shutdown_connections 2023-06-10T19:03:50.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.477+0000 7f75861b5640 1 --2- 172.21.15.53:0/22849074 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f756c066280 0x7f756c068730 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:50.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.477+0000 7f75861b5640 1 --2- 172.21.15.53:0/22849074 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7580159a60 0x7f75800afc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:50.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.477+0000 7f75861b5640 1 --2- 172.21.15.53:0/22849074 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7580159690 0x7f75800af6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:50.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.477+0000 7f75861b5640 1 --2- 172.21.15.53:0/22849074 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f75800b0f30 0x7f7580154d30 unknown :-1 s=CLOSED pgs=1716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:50.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.477+0000 7f75861b5640 1 -- 172.21.15.53:0/22849074 >> 172.21.15.53:0/22849074 conn(0x7f758006a560 msgr2=0x7f75800701b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:50.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.477+0000 7f75861b5640 1 -- 172.21.15.53:0/22849074 shutdown_connections 2023-06-10T19:03:50.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.477+0000 7f75861b5640 1 -- 172.21.15.53:0/22849074 wait complete. 2023-06-10T19:03:50.503 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-06-10T19:03:50.504 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:03:50.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.629+0000 7f5744f17640 1 Processor -- start 2023-06-10T19:03:50.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.629+0000 7f5744f17640 1 -- start start 2023-06-10T19:03:50.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.629+0000 7f5744f17640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f574006b2f0 0x7f574006f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:50.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.629+0000 7f5744f17640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f57400c8d00 0x7f574006b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:50.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.629+0000 7f5744f17640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5740158a90 con 0x7f574006bc00 2023-06-10T19:03:50.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.629+0000 7f5744f17640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57400705d0 con 0x7f574006b2f0 2023-06-10T19:03:50.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.629+0000 7f5744f17640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f574006f9c0 con 0x7f57400c8d00 2023-06-10T19:03:50.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.629+0000 7f573e59c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f574006b2f0 0x7f574006f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:50.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.629+0000 7f573ed9d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f574006bc00 0x7f57400cbe00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60546/0 (socket says 172.21.15.53:60546) 2023-06-10T19:03:50.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.629+0000 7f573ed9d640 1 -- 172.21.15.53:0/460034131 learned_addr learned my addr 172.21.15.53:0/460034131 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:03:50.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.629+0000 7f573dd9b640 1 --2- 172.21.15.53:0/460034131 >> v2:172.21.15.117:3300/0 conn(0x7f57400c8d00 0x7f574006b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:50.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.629+0000 7f573e59c640 1 -- 172.21.15.53:0/460034131 >> v2:172.21.15.117:3300/0 conn(0x7f57400c8d00 msgr2=0x7f574006b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:50.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.629+0000 7f573e59c640 1 --2- 172.21.15.53:0/460034131 >> v2:172.21.15.117:3300/0 conn(0x7f57400c8d00 0x7f574006b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:50.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.629+0000 7f573e59c640 1 -- 172.21.15.53:0/460034131 >> v1:172.21.15.53:6789/0 conn(0x7f574006bc00 legacy=0x7f57400cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:50.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.633+0000 7f573d59a640 1 -- 172.21.15.53:0/460034131 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3510832807 0 0) 0x7f57380014a0 con 0x7f574006bc00 2023-06-10T19:03:50.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.633+0000 7f573e59c640 1 -- 172.21.15.53:0/460034131 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f574006fca0 con 0x7f574006b2f0 2023-06-10T19:03:50.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.633+0000 7f573e59c640 1 --2- 172.21.15.53:0/460034131 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f574006b2f0 0x7f574006f070 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7f574015c0b0 tx=0x7f573001ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18e66de19cd6c486 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:50.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.633+0000 7f573d59a640 1 -- 172.21.15.53:0/460034131 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57300a8950 con 0x7f574006b2f0 2023-06-10T19:03:50.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.633+0000 7f573d59a640 1 -- 172.21.15.53:0/460034131 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57300a8ab0 con 0x7f574006b2f0 2023-06-10T19:03:50.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.633+0000 7f573d59a640 1 -- 172.21.15.53:0/460034131 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57300a8e40 con 0x7f574006b2f0 2023-06-10T19:03:50.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.633+0000 7f5744f17640 1 -- 172.21.15.53:0/460034131 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f574006b2f0 msgr2=0x7f574006f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:50.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.633+0000 7f5744f17640 1 --2- 172.21.15.53:0/460034131 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f574006b2f0 0x7f574006f070 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7f574015c0b0 tx=0x7f573001ec50 comp rx=0 tx=0).stop 2023-06-10T19:03:50.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.633+0000 7f5744f17640 1 -- 172.21.15.53:0/460034131 shutdown_connections 2023-06-10T19:03:50.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.633+0000 7f5744f17640 1 --2- 172.21.15.53:0/460034131 >> v2:172.21.15.117:3300/0 conn(0x7f57400c8d00 0x7f574006b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:50.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.633+0000 7f5744f17640 1 --2- 172.21.15.53:0/460034131 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f574006b2f0 0x7f574006f070 unknown :-1 s=CLOSED pgs=1718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:50.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.633+0000 7f5744f17640 1 -- 172.21.15.53:0/460034131 >> 172.21.15.53:0/460034131 conn(0x7f574006a0d0 msgr2=0x7f57400ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:50.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.633+0000 7f5744f17640 1 -- 172.21.15.53:0/460034131 shutdown_connections 2023-06-10T19:03:50.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.633+0000 7f5744f17640 1 -- 172.21.15.53:0/460034131 wait complete. 2023-06-10T19:03:50.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.637+0000 7f5744f17640 1 Processor -- start 2023-06-10T19:03:50.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.637+0000 7f5744f17640 1 -- start start 2023-06-10T19:03:50.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.637+0000 7f5744f17640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f574006b2f0 0x7f57400b3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:50.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.637+0000 7f5744f17640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f574006bc00 0x7f5740150740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:50.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.637+0000 7f5744f17640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57400c8d00 0x7f57401574f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:50.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.637+0000 7f5744f17640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57400b0ad0 con 0x7f574006b2f0 2023-06-10T19:03:50.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.637+0000 7f5744f17640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57401502b0 con 0x7f57400c8d00 2023-06-10T19:03:50.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.637+0000 7f5744f17640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f574014fcd0 con 0x7f574006bc00 2023-06-10T19:03:50.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.637+0000 7f573e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f574006b2f0 0x7f57400b3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:50.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.637+0000 7f573e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f574006b2f0 0x7f57400b3420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56938/0 (socket says 172.21.15.53:56938) 2023-06-10T19:03:50.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.637+0000 7f573e59c640 1 -- 172.21.15.53:0/566412726 learned_addr learned my addr 172.21.15.53:0/566412726 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:50.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.637+0000 7f573dd9b640 1 --2- 172.21.15.53:0/566412726 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f574006bc00 0x7f5740150740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:50.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.637+0000 7f573e59c640 1 -- 172.21.15.53:0/566412726 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f574006bc00 msgr2=0x7f5740150740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:50.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.637+0000 7f573ed9d640 1 --2- 172.21.15.53:0/566412726 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57400c8d00 0x7f57401574f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:50.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.637+0000 7f573e59c640 1 --2- 172.21.15.53:0/566412726 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f574006bc00 0x7f5740150740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:50.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.637+0000 7f573e59c640 1 -- 172.21.15.53:0/566412726 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57400c8d00 msgr2=0x7f57401574f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:50.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.637+0000 7f573e59c640 1 --2- 172.21.15.53:0/566412726 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57400c8d00 0x7f57401574f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:50.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.637+0000 7f573e59c640 1 -- 172.21.15.53:0/566412726 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5730009420 con 0x7f574006b2f0 2023-06-10T19:03:50.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.637+0000 7f573e59c640 1 --2- 172.21.15.53:0/566412726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f574006b2f0 0x7f57400b3420 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7f573009b470 tx=0x7f573001d490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:50.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.637+0000 7f572effd640 1 -- 172.21.15.53:0/566412726 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57300a8950 con 0x7f574006b2f0 2023-06-10T19:03:50.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.637+0000 7f572effd640 1 -- 172.21.15.53:0/566412726 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5730004030 con 0x7f574006b2f0 2023-06-10T19:03:50.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.637+0000 7f572effd640 1 -- 172.21.15.53:0/566412726 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57300043c0 con 0x7f574006b2f0 2023-06-10T19:03:50.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.637+0000 7f5744f17640 1 -- 172.21.15.53:0/566412726 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57400b0d20 con 0x7f574006b2f0 2023-06-10T19:03:50.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.637+0000 7f5744f17640 1 -- 172.21.15.53:0/566412726 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57400b3960 con 0x7f574006b2f0 2023-06-10T19:03:50.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.637+0000 7f5744f17640 1 -- 172.21.15.53:0/566412726 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f574004d790 con 0x7f574006b2f0 2023-06-10T19:03:50.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.637+0000 7f572effd640 1 -- 172.21.15.53:0/566412726 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5730003620 con 0x7f574006b2f0 2023-06-10T19:03:50.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.637+0000 7f572effd640 1 --2- 172.21.15.53:0/566412726 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5720066280 0x7f5720068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:50.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.637+0000 7f572effd640 1 -- 172.21.15.53:0/566412726 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5730121a30 con 0x7f574006b2f0 2023-06-10T19:03:50.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.641+0000 7f573dd9b640 1 --2- 172.21.15.53:0/566412726 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5720066280 0x7f5720068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:50.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.641+0000 7f573dd9b640 1 --2- 172.21.15.53:0/566412726 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5720066280 0x7f5720068730 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f5740166380 tx=0x7f5734008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:50.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.641+0000 7f572effd640 1 -- 172.21.15.53:0/566412726 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f57300eeeb0 con 0x7f574006b2f0 2023-06-10T19:03:50.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.825+0000 7f5744f17640 1 -- 172.21.15.53:0/566412726 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f57400cc7d0 con 0x7f574006b2f0 2023-06-10T19:03:50.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.825+0000 7f572effd640 1 -- 172.21.15.53:0/566412726 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) v1 ==== 94+0+4673 (secure 0 0 0) 0x7f57300c2090 con 0x7f574006b2f0 2023-06-10T19:03:50.831 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:03:50.831 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":61,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6542,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/3258793373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3258793373},{"type":"v1","addr":"172.21.15.117:6836","nonce":3258793373}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":7363,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/585135979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":585135979},{"type":"v1","addr":"172.21.15.117:6837","nonce":585135979}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":8682,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/448704478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":448704478},{"type":"v1","addr":"172.21.15.53:6833","nonce":448704478}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:03:48.420425+0000","modified":"2023-06-10T19:03:50.457592+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8685},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8685":{"gid":8685,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/1149668719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":1149668719},{"type":"v1","addr":"172.21.15.53:6835","nonce":1149668719}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-06-10T19:03:50.831 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 61 2023-06-10T19:03:50.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.829+0000 7f5744f17640 1 -- 172.21.15.53:0/566412726 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5720066280 msgr2=0x7f5720068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:50.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.829+0000 7f5744f17640 1 --2- 172.21.15.53:0/566412726 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5720066280 0x7f5720068730 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f5740166380 tx=0x7f5734008040 comp rx=0 tx=0).stop 2023-06-10T19:03:50.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.829+0000 7f5744f17640 1 -- 172.21.15.53:0/566412726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f574006b2f0 msgr2=0x7f57400b3420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:50.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.829+0000 7f5744f17640 1 --2- 172.21.15.53:0/566412726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f574006b2f0 0x7f57400b3420 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7f573009b470 tx=0x7f573001d490 comp rx=0 tx=0).stop 2023-06-10T19:03:50.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.829+0000 7f5744f17640 1 -- 172.21.15.53:0/566412726 shutdown_connections 2023-06-10T19:03:50.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.829+0000 7f5744f17640 1 --2- 172.21.15.53:0/566412726 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5720066280 0x7f5720068730 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:50.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.829+0000 7f5744f17640 1 --2- 172.21.15.53:0/566412726 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57400c8d00 0x7f57401574f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:50.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.829+0000 7f5744f17640 1 --2- 172.21.15.53:0/566412726 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f574006bc00 0x7f5740150740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:50.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.829+0000 7f5744f17640 1 --2- 172.21.15.53:0/566412726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f574006b2f0 0x7f57400b3420 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:50.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.829+0000 7f5744f17640 1 -- 172.21.15.53:0/566412726 >> 172.21.15.53:0/566412726 conn(0x7f574006a0d0 msgr2=0x7f574006eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:50.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.829+0000 7f5744f17640 1 -- 172.21.15.53:0/566412726 shutdown_connections 2023-06-10T19:03:50.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.829+0000 7f5744f17640 1 -- 172.21.15.53:0/566412726 wait complete. 2023-06-10T19:03:50.848 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:03:50.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.969+0000 7f7e7b04d640 1 Processor -- start 2023-06-10T19:03:50.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.969+0000 7f7e7b04d640 1 -- start start 2023-06-10T19:03:50.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.969+0000 7f7e7b04d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e740affc0 0x7f7e740b0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:50.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.969+0000 7f7e7b04d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7e74070500 0x7f7e74070940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:50.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.969+0000 7f7e7b04d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e7406fa60 con 0x7f7e74157cf0 2023-06-10T19:03:50.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.969+0000 7f7e7b04d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e740cae00 con 0x7f7e74070500 2023-06-10T19:03:50.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.969+0000 7f7e7b04d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e740b0980 con 0x7f7e740affc0 2023-06-10T19:03:50.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.969+0000 7f7e795ea640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7e74070500 0x7f7e74070940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:50.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.969+0000 7f7e795ea640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7e74070500 0x7f7e74070940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56944/0 (socket says 172.21.15.53:56944) 2023-06-10T19:03:50.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.969+0000 7f7e795ea640 1 -- 172.21.15.53:0/561051085 learned_addr learned my addr 172.21.15.53:0/561051085 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:50.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.969+0000 7f7e73fff640 1 --2- 172.21.15.53:0/561051085 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e740affc0 0x7f7e740b0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:50.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.969+0000 7f7e795ea640 1 -- 172.21.15.53:0/561051085 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e740affc0 msgr2=0x7f7e740b0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:50.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.969+0000 7f7e795ea640 1 --2- 172.21.15.53:0/561051085 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e740affc0 0x7f7e740b0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:50.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.969+0000 7f7e795ea640 1 -- 172.21.15.53:0/561051085 >> v1:172.21.15.117:6789/0 conn(0x7f7e74157cf0 legacy=0x7f7e740ca6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:50.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.969+0000 7f7e795ea640 1 -- 172.21.15.53:0/561051085 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e7406a340 con 0x7f7e74070500 2023-06-10T19:03:50.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.969+0000 7f7e795ea640 1 --2- 172.21.15.53:0/561051085 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e74070500 0x7f7e74070940 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7f7e64009870 tx=0x7f7e6401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63c50aa7ab6a7980 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:50.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.973+0000 7f7e737fe640 1 -- 172.21.15.53:0/561051085 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e640aa620 con 0x7f7e74070500 2023-06-10T19:03:50.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.973+0000 7f7e737fe640 1 -- 172.21.15.53:0/561051085 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e640aa780 con 0x7f7e74070500 2023-06-10T19:03:50.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.973+0000 7f7e737fe640 1 -- 172.21.15.53:0/561051085 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e640aab10 con 0x7f7e74070500 2023-06-10T19:03:50.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.973+0000 7f7e7b04d640 1 -- 172.21.15.53:0/561051085 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e74070500 msgr2=0x7f7e74070940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:50.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.973+0000 7f7e7b04d640 1 --2- 172.21.15.53:0/561051085 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e74070500 0x7f7e74070940 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7f7e64009870 tx=0x7f7e6401c540 comp rx=0 tx=0).stop 2023-06-10T19:03:50.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.973+0000 7f7e7b04d640 1 -- 172.21.15.53:0/561051085 shutdown_connections 2023-06-10T19:03:50.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.973+0000 7f7e7b04d640 1 --2- 172.21.15.53:0/561051085 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e74070500 0x7f7e74070940 unknown :-1 s=CLOSED pgs=1720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:50.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.973+0000 7f7e7b04d640 1 --2- 172.21.15.53:0/561051085 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e740affc0 0x7f7e740b0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:50.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.973+0000 7f7e7b04d640 1 -- 172.21.15.53:0/561051085 >> 172.21.15.53:0/561051085 conn(0x7f7e740cafc0 msgr2=0x7f7e740cb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:50.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.973+0000 7f7e7b04d640 1 -- 172.21.15.53:0/561051085 shutdown_connections 2023-06-10T19:03:50.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.973+0000 7f7e7b04d640 1 -- 172.21.15.53:0/561051085 wait complete. 2023-06-10T19:03:50.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.973+0000 7f7e7b04d640 1 Processor -- start 2023-06-10T19:03:50.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.973+0000 7f7e7b04d640 1 -- start start 2023-06-10T19:03:50.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.973+0000 7f7e7b04d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e74070500 0x7f7e741469e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:50.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.973+0000 7f7e7b04d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e740affc0 0x7f7e74152310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:50.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.973+0000 7f7e7b04d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e74157cf0 0x7f7e74152850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:50.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.973+0000 7f7e7b04d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e740c7810 con 0x7f7e74157cf0 2023-06-10T19:03:50.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.973+0000 7f7e7b04d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e74146f20 con 0x7f7e740affc0 2023-06-10T19:03:50.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.973+0000 7f7e7b04d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7414f5e0 con 0x7f7e74070500 2023-06-10T19:03:50.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.973+0000 7f7e795ea640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e74157cf0 0x7f7e74152850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:50.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.973+0000 7f7e795ea640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e74157cf0 0x7f7e74152850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56950/0 (socket says 172.21.15.53:56950) 2023-06-10T19:03:50.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.973+0000 7f7e795ea640 1 -- 172.21.15.53:0/2777221970 learned_addr learned my addr 172.21.15.53:0/2777221970 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:50.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.973+0000 7f7e73fff640 1 --2- 172.21.15.53:0/2777221970 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e740affc0 0x7f7e74152310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:50.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.973+0000 7f7e78de9640 1 --2- 172.21.15.53:0/2777221970 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e74070500 0x7f7e741469e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:50.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.973+0000 7f7e795ea640 1 -- 172.21.15.53:0/2777221970 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e74070500 msgr2=0x7f7e741469e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:50.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.973+0000 7f7e795ea640 1 --2- 172.21.15.53:0/2777221970 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e74070500 0x7f7e741469e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:50.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.973+0000 7f7e795ea640 1 -- 172.21.15.53:0/2777221970 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e740affc0 msgr2=0x7f7e74152310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:50.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.973+0000 7f7e795ea640 1 --2- 172.21.15.53:0/2777221970 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e740affc0 0x7f7e74152310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:50.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.973+0000 7f7e795ea640 1 -- 172.21.15.53:0/2777221970 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e640094d0 con 0x7f7e74157cf0 2023-06-10T19:03:50.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.973+0000 7f7e795ea640 1 --2- 172.21.15.53:0/2777221970 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e74157cf0 0x7f7e74152850 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f7e6401ca20 tx=0x7f7e6401ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:50.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.973+0000 7f7e717fa640 1 -- 172.21.15.53:0/2777221970 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e640bd5f0 con 0x7f7e74157cf0 2023-06-10T19:03:50.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.973+0000 7f7e717fa640 1 -- 172.21.15.53:0/2777221970 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e640bd770 con 0x7f7e74157cf0 2023-06-10T19:03:50.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.973+0000 7f7e7b04d640 1 -- 172.21.15.53:0/2777221970 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e740c6c00 con 0x7f7e74157cf0 2023-06-10T19:03:50.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.973+0000 7f7e717fa640 1 -- 172.21.15.53:0/2777221970 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e640bdb20 con 0x7f7e74157cf0 2023-06-10T19:03:50.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.977+0000 7f7e7b04d640 1 -- 172.21.15.53:0/2777221970 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e740c71c0 con 0x7f7e74157cf0 2023-06-10T19:03:50.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.977+0000 7f7e7b04d640 1 -- 172.21.15.53:0/2777221970 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e7404d790 con 0x7f7e74157cf0 2023-06-10T19:03:50.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.977+0000 7f7e717fa640 1 -- 172.21.15.53:0/2777221970 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7e640b33f0 con 0x7f7e74157cf0 2023-06-10T19:03:50.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.977+0000 7f7e717fa640 1 --2- 172.21.15.53:0/2777221970 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7e60066280 0x7f7e60068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:50.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.977+0000 7f7e717fa640 1 -- 172.21.15.53:0/2777221970 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7e6411e8a0 con 0x7f7e74157cf0 2023-06-10T19:03:50.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.977+0000 7f7e78de9640 1 --2- 172.21.15.53:0/2777221970 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7e60066280 0x7f7e60068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:50.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.977+0000 7f7e78de9640 1 --2- 172.21.15.53:0/2777221970 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7e60066280 0x7f7e60068730 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c0012f0 tx=0x7f7e6c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:50.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:50.981+0000 7f7e717fa640 1 -- 172.21.15.53:0/2777221970 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7e640ebdd0 con 0x7f7e74157cf0 2023-06-10T19:03:51.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.137+0000 7f7e7b04d640 1 -- 172.21.15.53:0/2777221970 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7e740b44c0 con 0x7f7e74157cf0 2023-06-10T19:03:51.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.141+0000 7f7e717fa640 1 -- 172.21.15.53:0/2777221970 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v110) v1 ==== 74+0+18281 (secure 0 0 0) 0x7f7e640ef3f0 con 0x7f7e74157cf0 2023-06-10T19:03:51.145 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:03:51.145 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":110,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:03:49.423495+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-06-10T19:03:46.427131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-06-10T19:03:47.398979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:03:51.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.141+0000 7f7e7b04d640 1 -- 172.21.15.53:0/2777221970 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7e60066280 msgr2=0x7f7e60068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:51.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.141+0000 7f7e7b04d640 1 --2- 172.21.15.53:0/2777221970 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7e60066280 0x7f7e60068730 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c0012f0 tx=0x7f7e6c009040 comp rx=0 tx=0).stop 2023-06-10T19:03:51.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.145+0000 7f7e7b04d640 1 -- 172.21.15.53:0/2777221970 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e74157cf0 msgr2=0x7f7e74152850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:51.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.145+0000 7f7e7b04d640 1 --2- 172.21.15.53:0/2777221970 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e74157cf0 0x7f7e74152850 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f7e6401ca20 tx=0x7f7e6401ad80 comp rx=0 tx=0).stop 2023-06-10T19:03:51.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.145+0000 7f7e7b04d640 1 -- 172.21.15.53:0/2777221970 shutdown_connections 2023-06-10T19:03:51.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.145+0000 7f7e7b04d640 1 --2- 172.21.15.53:0/2777221970 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7e60066280 0x7f7e60068730 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:51.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.145+0000 7f7e7b04d640 1 --2- 172.21.15.53:0/2777221970 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e74157cf0 0x7f7e74152850 unknown :-1 s=CLOSED pgs=1721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:51.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.145+0000 7f7e7b04d640 1 --2- 172.21.15.53:0/2777221970 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e740affc0 0x7f7e74152310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:51.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.145+0000 7f7e7b04d640 1 --2- 172.21.15.53:0/2777221970 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e74070500 0x7f7e741469e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:51.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.145+0000 7f7e7b04d640 1 -- 172.21.15.53:0/2777221970 >> 172.21.15.53:0/2777221970 conn(0x7f7e740cafc0 msgr2=0x7f7e74071160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:51.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.145+0000 7f7e7b04d640 1 -- 172.21.15.53:0/2777221970 shutdown_connections 2023-06-10T19:03:51.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.145+0000 7f7e7b04d640 1 -- 172.21.15.53:0/2777221970 wait complete. 2023-06-10T19:03:51.164 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-06-10T19:03:51.165 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-10T19:03:51.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.285+0000 7f92fc007640 1 Processor -- start 2023-06-10T19:03:51.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.285+0000 7f92fc007640 1 -- start start 2023-06-10T19:03:51.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.285+0000 7f92fc007640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f92f4159630 0x7f92f415d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:51.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.285+0000 7f92fc007640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92f40ad730 0x7f92f40713a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:51.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.285+0000 7f92fc007640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92f4070f10 con 0x7f92f40718e0 2023-06-10T19:03:51.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.285+0000 7f92fc007640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92f415db60 con 0x7f92f4159630 2023-06-10T19:03:51.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.285+0000 7f92fc007640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92f415de40 con 0x7f92f40ad730 2023-06-10T19:03:51.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.285+0000 7f92fa5a4640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f92f40718e0 0x7f92f4069450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:59466/0 (socket says 172.21.15.53:59466) 2023-06-10T19:03:51.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.285+0000 7f92fa5a4640 1 -- 172.21.15.53:0/2637476413 learned_addr learned my addr 172.21.15.53:0/2637476413 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:03:51.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.285+0000 7f92f95a2640 1 --2- 172.21.15.53:0/2637476413 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92f40ad730 0x7f92f40713a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:51.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.285+0000 7f92f9da3640 1 --2- 172.21.15.53:0/2637476413 >> v2:172.21.15.117:3300/0 conn(0x7f92f4159630 0x7f92f415d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:51.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.285+0000 7f92f8da1640 1 -- 172.21.15.53:0/2637476413 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2265193475 0 0) 0x7f92f4070f10 con 0x7f92f40718e0 2023-06-10T19:03:51.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.285+0000 7f92f8da1640 1 -- 172.21.15.53:0/2637476413 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92e0003530 con 0x7f92f40718e0 2023-06-10T19:03:51.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.285+0000 7f92f8da1640 1 -- 172.21.15.53:0/2637476413 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2678080488 0 0) 0x7f92e0003530 con 0x7f92f40718e0 2023-06-10T19:03:51.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.285+0000 7f92f8da1640 1 -- 172.21.15.53:0/2637476413 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92f40ad730 msgr2=0x7f92f40713a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:51.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.285+0000 7f92f8da1640 1 --2- 172.21.15.53:0/2637476413 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92f40ad730 0x7f92f40713a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:51.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.285+0000 7f92f8da1640 1 -- 172.21.15.53:0/2637476413 >> v2:172.21.15.117:3300/0 conn(0x7f92f4159630 msgr2=0x7f92f415d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:51.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.285+0000 7f92f8da1640 1 --2- 172.21.15.53:0/2637476413 >> v2:172.21.15.117:3300/0 conn(0x7f92f4159630 0x7f92f415d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:51.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.285+0000 7f92f8da1640 1 -- 172.21.15.53:0/2637476413 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92f415e120 con 0x7f92f40718e0 2023-06-10T19:03:51.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.285+0000 7f92f8da1640 1 -- 172.21.15.53:0/2637476413 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f92ec001a00 con 0x7f92f40718e0 2023-06-10T19:03:51.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.285+0000 7f92f8da1640 1 -- 172.21.15.53:0/2637476413 >> v1:172.21.15.53:6789/0 conn(0x7f92f40718e0 legacy=0x7f92f4069450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:51.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.285+0000 7f92f8da1640 1 --2- 172.21.15.53:0/2637476413 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92e00039f0 0x7f92e0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:51.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.285+0000 7f92f8da1640 1 --2- 172.21.15.53:0/2637476413 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f92e00047d0 0x7f92e0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:51.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.285+0000 7f92f8da1640 1 --2- 172.21.15.53:0/2637476413 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92f40ad730 0x7f92e0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:51.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.285+0000 7f92f8da1640 1 -- 172.21.15.53:0/2637476413 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92f415db60 con 0x7f92e00039f0 2023-06-10T19:03:51.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.285+0000 7f92f8da1640 1 -- 172.21.15.53:0/2637476413 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92f415de40 con 0x7f92e00047d0 2023-06-10T19:03:51.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.285+0000 7f92f8da1640 1 -- 172.21.15.53:0/2637476413 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92e000b990 con 0x7f92f40ad730 2023-06-10T19:03:51.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.285+0000 7f92f9da3640 1 --2- 172.21.15.53:0/2637476413 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92e00039f0 0x7f92e0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:51.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.285+0000 7f92fa5a4640 1 --2- 172.21.15.53:0/2637476413 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92f40ad730 0x7f92e0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:51.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.285+0000 7f92f95a2640 1 --2- 172.21.15.53:0/2637476413 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f92e00047d0 0x7f92e0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:51.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.285+0000 7f92f9da3640 1 -- 172.21.15.53:0/2637476413 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92f40ad730 msgr2=0x7f92e0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:51.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.285+0000 7f92f9da3640 1 --2- 172.21.15.53:0/2637476413 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92f40ad730 0x7f92e0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:51.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.285+0000 7f92f9da3640 1 -- 172.21.15.53:0/2637476413 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f92e00047d0 msgr2=0x7f92e0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:51.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.285+0000 7f92f9da3640 1 --2- 172.21.15.53:0/2637476413 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f92e00047d0 0x7f92e0004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:51.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.285+0000 7f92f9da3640 1 -- 172.21.15.53:0/2637476413 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92e0003530 con 0x7f92e00039f0 2023-06-10T19:03:51.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.285+0000 7f92fa5a4640 1 --2- 172.21.15.53:0/2637476413 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92f40ad730 0x7f92e0005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:03:51.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.289+0000 7f92f9da3640 1 --2- 172.21.15.53:0/2637476413 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92e00039f0 0x7f92e0003e00 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7f92f0009ae0 tx=0x7f92f001ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d57fbe399547d49b server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:51.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.289+0000 7f92f8da1640 1 -- 172.21.15.53:0/2637476413 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f00a5540 con 0x7f92e00039f0 2023-06-10T19:03:51.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.289+0000 7f92f8da1640 1 -- 172.21.15.53:0/2637476413 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92f00a56a0 con 0x7f92e00039f0 2023-06-10T19:03:51.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.289+0000 7f92f8da1640 1 -- 172.21.15.53:0/2637476413 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f00a5a50 con 0x7f92e00039f0 2023-06-10T19:03:51.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.289+0000 7f92fc007640 1 -- 172.21.15.53:0/2637476413 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92e00039f0 msgr2=0x7f92e0003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:51.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.289+0000 7f92fc007640 1 --2- 172.21.15.53:0/2637476413 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92e00039f0 0x7f92e0003e00 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7f92f0009ae0 tx=0x7f92f001ca60 comp rx=0 tx=0).stop 2023-06-10T19:03:51.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.289+0000 7f92fa5a4640 1 -- 172.21.15.53:0/2637476413 reap_dead start 2023-06-10T19:03:51.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.289+0000 7f92fc007640 1 -- 172.21.15.53:0/2637476413 shutdown_connections 2023-06-10T19:03:51.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.289+0000 7f92fc007640 1 -- 172.21.15.53:0/2637476413 >> 172.21.15.53:0/2637476413 conn(0x7f92f40cafc0 msgr2=0x7f92f40cb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:51.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.289+0000 7f92fc007640 1 -- 172.21.15.53:0/2637476413 shutdown_connections 2023-06-10T19:03:51.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.289+0000 7f92fc007640 1 -- 172.21.15.53:0/2637476413 wait complete. 2023-06-10T19:03:51.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.289+0000 7f92fc007640 1 Processor -- start 2023-06-10T19:03:51.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.289+0000 7f92fc007640 1 -- start start 2023-06-10T19:03:51.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.293+0000 7f92fc007640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92e00039f0 0x7f92f4157fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:51.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.293+0000 7f92fc007640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92f4153cc0 0x7f92f415c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:51.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.293+0000 7f92fc007640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f92f415cc30 0x7f92f4152b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:51.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.293+0000 7f92fc007640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92f415d160 con 0x7f92e00039f0 2023-06-10T19:03:51.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.293+0000 7f92fc007640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92f4155960 con 0x7f92f415cc30 2023-06-10T19:03:51.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.293+0000 7f92fc007640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92f4155c40 con 0x7f92f4153cc0 2023-06-10T19:03:51.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.293+0000 7f92f9da3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92e00039f0 0x7f92f4157fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:51.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.293+0000 7f92f9da3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92e00039f0 0x7f92f4157fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34968/0 (socket says 172.21.15.53:34968) 2023-06-10T19:03:51.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.293+0000 7f92f9da3640 1 -- 172.21.15.53:0/629284851 learned_addr learned my addr 172.21.15.53:0/629284851 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:51.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.293+0000 7f92f95a2640 1 --2- 172.21.15.53:0/629284851 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92f4153cc0 0x7f92f415c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:51.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.293+0000 7f92fa5a4640 1 --2- 172.21.15.53:0/629284851 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f92f415cc30 0x7f92f4152b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:51.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.293+0000 7f92f9da3640 1 -- 172.21.15.53:0/629284851 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92f4153cc0 msgr2=0x7f92f415c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:51.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.293+0000 7f92f9da3640 1 --2- 172.21.15.53:0/629284851 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92f4153cc0 0x7f92f415c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:51.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.293+0000 7f92f9da3640 1 -- 172.21.15.53:0/629284851 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f92f415cc30 msgr2=0x7f92f4152b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:51.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.293+0000 7f92f9da3640 1 --2- 172.21.15.53:0/629284851 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f92f415cc30 0x7f92f4152b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:51.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.293+0000 7f92f9da3640 1 -- 172.21.15.53:0/629284851 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92f4155f20 con 0x7f92e00039f0 2023-06-10T19:03:51.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.293+0000 7f92f9da3640 1 --2- 172.21.15.53:0/629284851 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92e00039f0 0x7f92f4157fd0 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f92f0009ae0 tx=0x7f92e0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:51.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.293+0000 7f92ea7fc640 1 -- 172.21.15.53:0/629284851 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f00be070 con 0x7f92e00039f0 2023-06-10T19:03:51.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.293+0000 7f92ea7fc640 1 -- 172.21.15.53:0/629284851 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92f00a5e90 con 0x7f92e00039f0 2023-06-10T19:03:51.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.293+0000 7f92fc007640 1 -- 172.21.15.53:0/629284851 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92f415d440 con 0x7f92e00039f0 2023-06-10T19:03:51.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.293+0000 7f92ea7fc640 1 -- 172.21.15.53:0/629284851 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f0004020 con 0x7f92e00039f0 2023-06-10T19:03:51.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.293+0000 7f92fc007640 1 -- 172.21.15.53:0/629284851 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92f41586e0 con 0x7f92e00039f0 2023-06-10T19:03:51.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.293+0000 7f92fc007640 1 -- 172.21.15.53:0/629284851 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92f40cbd00 con 0x7f92e00039f0 2023-06-10T19:03:51.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.293+0000 7f92ea7fc640 1 -- 172.21.15.53:0/629284851 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f92f00b4040 con 0x7f92e00039f0 2023-06-10T19:03:51.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.293+0000 7f92ea7fc640 1 --2- 172.21.15.53:0/629284851 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f92d8066280 0x7f92d8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:51.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.293+0000 7f92ea7fc640 1 -- 172.21.15.53:0/629284851 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f92f011d520 con 0x7f92e00039f0 2023-06-10T19:03:51.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.293+0000 7f92f95a2640 1 --2- 172.21.15.53:0/629284851 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f92d8066280 0x7f92d8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:51.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.297+0000 7f92f95a2640 1 --2- 172.21.15.53:0/629284851 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f92d8066280 0x7f92d8068730 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f92f41f7b80 tx=0x7f92e4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:51.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.297+0000 7f92ea7fc640 1 -- 172.21.15.53:0/629284851 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f92f00eaa30 con 0x7f92e00039f0 2023-06-10T19:03:51.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.449+0000 7f92fc007640 1 -- 172.21.15.53:0/629284851 --> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f92f4069b60 con 0x7f92d8066280 2023-06-10T19:03:51.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.469+0000 7f92ea7fc640 1 -- 172.21.15.53:0/629284851 <== mgr.4105 v2:172.21.15.117:6832/3061986771 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+298377 (secure 0 0 0) 0x7f92e40128f0 con 0x7f92d8066280 2023-06-10T19:03:51.475 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:03:51.478 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-06-10T19:03:51.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.473+0000 7f92fc007640 1 -- 172.21.15.53:0/629284851 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f92d8066280 msgr2=0x7f92d8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:51.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.473+0000 7f92fc007640 1 --2- 172.21.15.53:0/629284851 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f92d8066280 0x7f92d8068730 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f92f41f7b80 tx=0x7f92e4008040 comp rx=0 tx=0).stop 2023-06-10T19:03:51.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.473+0000 7f92fc007640 1 -- 172.21.15.53:0/629284851 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92e00039f0 msgr2=0x7f92f4157fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:51.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.473+0000 7f92fc007640 1 --2- 172.21.15.53:0/629284851 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92e00039f0 0x7f92f4157fd0 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f92f0009ae0 tx=0x7f92e0005800 comp rx=0 tx=0).stop 2023-06-10T19:03:51.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.477+0000 7f92fc007640 1 -- 172.21.15.53:0/629284851 shutdown_connections 2023-06-10T19:03:51.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.477+0000 7f92fc007640 1 --2- 172.21.15.53:0/629284851 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f92d8066280 0x7f92d8068730 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:51.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.477+0000 7f92fc007640 1 --2- 172.21.15.53:0/629284851 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f92f415cc30 0x7f92f4152b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:51.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.477+0000 7f92fc007640 1 --2- 172.21.15.53:0/629284851 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92f4153cc0 0x7f92f415c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:51.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.477+0000 7f92fc007640 1 --2- 172.21.15.53:0/629284851 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92e00039f0 0x7f92f4157fd0 unknown :-1 s=CLOSED pgs=1724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:51.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.477+0000 7f92fc007640 1 -- 172.21.15.53:0/629284851 >> 172.21.15.53:0/629284851 conn(0x7f92f40cafc0 msgr2=0x7f92f40ae630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:51.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.477+0000 7f92fc007640 1 -- 172.21.15.53:0/629284851 shutdown_connections 2023-06-10T19:03:51.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.477+0000 7f92fc007640 1 -- 172.21.15.53:0/629284851 wait complete. 2023-06-10T19:03:51.497 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":442,"stamp":"2023-06-10T19:03:49.800821+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":29,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":259832,"kb_used_data":11448,"kb_used_omap":0,"kb_used_meta":248320,"kb_avail":754714888,"statfs":{"total":773094113280,"available":772828045312,"internally_reserved":0,"allocated":11722752,"data_stored":6012697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":254279680},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001223"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.039078+0000","last_change":"2023-06-10T19:03:47.039078+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.039078+0000","last_undegraded":"2023-06-10T19:03:47.039078+0000","last_fullsized":"2023-06-10T19:03:47.039078+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.043540+0000","last_change":"2023-06-10T19:03:47.043540+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.043540+0000","last_undegraded":"2023-06-10T19:03:47.043540+0000","last_fullsized":"2023-06-10T19:03:47.043540+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.029988+0000","last_change":"2023-06-10T19:03:47.029988+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.029988+0000","last_undegraded":"2023-06-10T19:03:47.029988+0000","last_fullsized":"2023-06-10T19:03:47.029988+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.040924+0000","last_change":"2023-06-10T19:03:47.040924+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.040924+0000","last_undegraded":"2023-06-10T19:03:47.040924+0000","last_fullsized":"2023-06-10T19:03:47.040924+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.043064+0000","last_change":"2023-06-10T19:03:47.043064+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.043064+0000","last_undegraded":"2023-06-10T19:03:47.043064+0000","last_fullsized":"2023-06-10T19:03:47.043064+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.032572+0000","last_change":"2023-06-10T19:03:47.032572+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.032572+0000","last_undegraded":"2023-06-10T19:03:47.032572+0000","last_fullsized":"2023-06-10T19:03:47.032572+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.029778+0000","last_change":"2023-06-10T19:03:47.029778+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.029778+0000","last_undegraded":"2023-06-10T19:03:47.029778+0000","last_fullsized":"2023-06-10T19:03:47.029778+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.039108+0000","last_change":"2023-06-10T19:03:47.039108+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.039108+0000","last_undegraded":"2023-06-10T19:03:47.039108+0000","last_fullsized":"2023-06-10T19:03:47.039108+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.031636+0000","last_change":"2023-06-10T19:03:47.031636+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.031636+0000","last_undegraded":"2023-06-10T19:03:47.031636+0000","last_fullsized":"2023-06-10T19:03:47.031636+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.032280+0000","last_change":"2023-06-10T19:03:47.032280+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.032280+0000","last_undegraded":"2023-06-10T19:03:47.032280+0000","last_fullsized":"2023-06-10T19:03:47.032280+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.044181+0000","last_change":"2023-06-10T19:03:47.044181+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.044181+0000","last_undegraded":"2023-06-10T19:03:47.044181+0000","last_fullsized":"2023-06-10T19:03:47.044181+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.037025+0000","last_change":"2023-06-10T19:03:47.037025+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.037025+0000","last_undegraded":"2023-06-10T19:03:47.037025+0000","last_fullsized":"2023-06-10T19:03:47.037025+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.040771+0000","last_change":"2023-06-10T19:03:47.040771+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.040771+0000","last_undegraded":"2023-06-10T19:03:47.040771+0000","last_fullsized":"2023-06-10T19:03:47.040771+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.039179+0000","last_change":"2023-06-10T19:03:47.039179+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.039179+0000","last_undegraded":"2023-06-10T19:03:47.039179+0000","last_fullsized":"2023-06-10T19:03:47.039179+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.043519+0000","last_change":"2023-06-10T19:03:47.043519+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.043519+0000","last_undegraded":"2023-06-10T19:03:47.043519+0000","last_fullsized":"2023-06-10T19:03:47.043519+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.029942+0000","last_change":"2023-06-10T19:03:47.029942+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.029942+0000","last_undegraded":"2023-06-10T19:03:47.029942+0000","last_fullsized":"2023-06-10T19:03:47.029942+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.041570+0000","last_change":"2023-06-10T19:03:47.041570+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.041570+0000","last_undegraded":"2023-06-10T19:03:47.041570+0000","last_fullsized":"2023-06-10T19:03:47.041570+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.031554+0000","last_change":"2023-06-10T19:03:47.031554+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.031554+0000","last_undegraded":"2023-06-10T19:03:47.031554+0000","last_fullsized":"2023-06-10T19:03:47.031554+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.037091+0000","last_change":"2023-06-10T19:03:47.037091+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.037091+0000","last_undegraded":"2023-06-10T19:03:47.037091+0000","last_fullsized":"2023-06-10T19:03:47.037091+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.041468+0000","last_change":"2023-06-10T19:03:47.041468+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.041468+0000","last_undegraded":"2023-06-10T19:03:47.041468+0000","last_fullsized":"2023-06-10T19:03:47.041468+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.029967+0000","last_change":"2023-06-10T19:03:47.029967+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.029967+0000","last_undegraded":"2023-06-10T19:03:47.029967+0000","last_fullsized":"2023-06-10T19:03:47.029967+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.043508+0000","last_change":"2023-06-10T19:03:47.043508+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.043508+0000","last_undegraded":"2023-06-10T19:03:47.043508+0000","last_fullsized":"2023-06-10T19:03:47.043508+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.036902+0000","last_change":"2023-06-10T19:03:47.036902+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.036902+0000","last_undegraded":"2023-06-10T19:03:47.036902+0000","last_fullsized":"2023-06-10T19:03:47.036902+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.043502+0000","last_change":"2023-06-10T19:03:47.043502+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.043502+0000","last_undegraded":"2023-06-10T19:03:47.043502+0000","last_fullsized":"2023-06-10T19:03:47.043502+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.044354+0000","last_change":"2023-06-10T19:03:47.044354+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.044354+0000","last_undegraded":"2023-06-10T19:03:47.044354+0000","last_fullsized":"2023-06-10T19:03:47.044354+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":324,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-06-10T19:03:47.045429+0000","last_change":"2023-06-10T18:52:34.951528+0000","last_active":"2023-06-10T19:03:47.045429+0000","last_peered":"2023-06-10T19:03:47.045429+0000","last_clean":"2023-06-10T19:03:47.045429+0000","last_became_active":"2023-06-10T18:52:34.949099+0000","last_became_peered":"2023-06-10T18:52:34.949099+0000","last_unstale":"2023-06-10T19:03:47.045429+0000","last_undegraded":"2023-06-10T19:03:47.045429+0000","last_fullsized":"2023-06-10T19:03:47.045429+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_clean_scrub_stamp":"2023-06-10T18:52:33.633295+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:00:35.924767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":176,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-06-10T19:03:47.033648+0000","last_change":"2023-06-10T18:52:40.506384+0000","last_active":"2023-06-10T19:03:47.033648+0000","last_peered":"2023-06-10T19:03:47.033648+0000","last_clean":"2023-06-10T19:03:47.033648+0000","last_became_active":"2023-06-10T18:52:40.505701+0000","last_became_peered":"2023-06-10T18:52:40.505701+0000","last_unstale":"2023-06-10T19:03:47.033648+0000","last_undegraded":"2023-06-10T19:03:47.033648+0000","last_fullsized":"2023-06-10T19:03:47.033648+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:05:06.232347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.043040+0000","last_change":"2023-06-10T19:03:47.043040+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.043040+0000","last_undegraded":"2023-06-10T19:03:47.043040+0000","last_fullsized":"2023-06-10T19:03:47.043040+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":168,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-06-10T19:03:47.045062+0000","last_change":"2023-06-10T18:52:40.512015+0000","last_active":"2023-06-10T19:03:47.045062+0000","last_peered":"2023-06-10T19:03:47.045062+0000","last_clean":"2023-06-10T19:03:47.045062+0000","last_became_active":"2023-06-10T18:52:40.511382+0000","last_became_peered":"2023-06-10T18:52:40.511382+0000","last_unstale":"2023-06-10T19:03:47.045062+0000","last_undegraded":"2023-06-10T19:03:47.045062+0000","last_fullsized":"2023-06-10T19:03:47.045062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:22:14.438906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.032337+0000","last_change":"2023-06-10T19:03:47.032337+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.032337+0000","last_undegraded":"2023-06-10T19:03:47.032337+0000","last_fullsized":"2023-06-10T19:03:47.032337+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":174,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-06-10T19:03:47.046617+0000","last_change":"2023-06-10T18:52:40.671725+0000","last_active":"2023-06-10T19:03:47.046617+0000","last_peered":"2023-06-10T19:03:47.046617+0000","last_clean":"2023-06-10T19:03:47.046617+0000","last_became_active":"2023-06-10T18:52:40.671442+0000","last_became_peered":"2023-06-10T18:52:40.671442+0000","last_unstale":"2023-06-10T19:03:47.046617+0000","last_undegraded":"2023-06-10T19:03:47.046617+0000","last_fullsized":"2023-06-10T19:03:47.046617+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:29:58.957321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.037047+0000","last_change":"2023-06-10T19:03:47.037047+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.037047+0000","last_undegraded":"2023-06-10T19:03:47.037047+0000","last_fullsized":"2023-06-10T19:03:47.037047+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":176,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-06-10T19:03:47.033990+0000","last_change":"2023-06-10T18:52:40.510258+0000","last_active":"2023-06-10T19:03:47.033990+0000","last_peered":"2023-06-10T19:03:47.033990+0000","last_clean":"2023-06-10T19:03:47.033990+0000","last_became_active":"2023-06-10T18:52:40.509560+0000","last_became_peered":"2023-06-10T18:52:40.509560+0000","last_unstale":"2023-06-10T19:03:47.033990+0000","last_undegraded":"2023-06-10T19:03:47.033990+0000","last_fullsized":"2023-06-10T19:03:47.033990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:17:30.476535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.038249+0000","last_change":"2023-06-10T19:03:47.038249+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.038249+0000","last_undegraded":"2023-06-10T19:03:47.038249+0000","last_fullsized":"2023-06-10T19:03:47.038249+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":162,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-06-10T19:03:47.042725+0000","last_change":"2023-06-10T18:52:40.672266+0000","last_active":"2023-06-10T19:03:47.042725+0000","last_peered":"2023-06-10T19:03:47.042725+0000","last_clean":"2023-06-10T19:03:47.042725+0000","last_became_active":"2023-06-10T18:52:40.671966+0000","last_became_peered":"2023-06-10T18:52:40.671966+0000","last_unstale":"2023-06-10T19:03:47.042725+0000","last_undegraded":"2023-06-10T19:03:47.042725+0000","last_fullsized":"2023-06-10T19:03:47.042725+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:56:43.883781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.044311+0000","last_change":"2023-06-10T19:03:47.044311+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.044311+0000","last_undegraded":"2023-06-10T19:03:47.044311+0000","last_fullsized":"2023-06-10T19:03:47.044311+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":168,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-06-10T19:03:47.045328+0000","last_change":"2023-06-10T18:52:40.671084+0000","last_active":"2023-06-10T19:03:47.045328+0000","last_peered":"2023-06-10T19:03:47.045328+0000","last_clean":"2023-06-10T19:03:47.045328+0000","last_became_active":"2023-06-10T18:52:40.670697+0000","last_became_peered":"2023-06-10T18:52:40.670697+0000","last_unstale":"2023-06-10T19:03:47.045328+0000","last_undegraded":"2023-06-10T19:03:47.045328+0000","last_fullsized":"2023-06-10T19:03:47.045328+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:33:42.833010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.043408+0000","last_change":"2023-06-10T19:03:47.043408+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.043408+0000","last_undegraded":"2023-06-10T19:03:47.043408+0000","last_fullsized":"2023-06-10T19:03:47.043408+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":162,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-06-10T19:03:47.042650+0000","last_change":"2023-06-10T18:52:40.514114+0000","last_active":"2023-06-10T19:03:47.042650+0000","last_peered":"2023-06-10T19:03:47.042650+0000","last_clean":"2023-06-10T19:03:47.042650+0000","last_became_active":"2023-06-10T18:52:40.513638+0000","last_became_peered":"2023-06-10T18:52:40.513638+0000","last_unstale":"2023-06-10T19:03:47.042650+0000","last_undegraded":"2023-06-10T19:03:47.042650+0000","last_fullsized":"2023-06-10T19:03:47.042650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:50:41.193183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.046167+0000","last_change":"2023-06-10T19:03:47.046167+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.046167+0000","last_undegraded":"2023-06-10T19:03:47.046167+0000","last_fullsized":"2023-06-10T19:03:47.046167+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":168,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-06-10T19:03:47.039351+0000","last_change":"2023-06-10T18:52:40.515396+0000","last_active":"2023-06-10T19:03:47.039351+0000","last_peered":"2023-06-10T19:03:47.039351+0000","last_clean":"2023-06-10T19:03:47.039351+0000","last_became_active":"2023-06-10T18:52:40.514663+0000","last_became_peered":"2023-06-10T18:52:40.514663+0000","last_unstale":"2023-06-10T19:03:47.039351+0000","last_undegraded":"2023-06-10T19:03:47.039351+0000","last_fullsized":"2023-06-10T19:03:47.039351+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:33:27.036737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574986,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32908,"kb_used_data":1860,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338932,"statfs":{"total":96636764160,"available":96603066368,"internally_reserved":0,"allocated":1904640,"data_stored":1190889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:02:54 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.95199999999999996,"15min":0.91000000000000003},"min":{"1min":0.64700000000000002,"5min":0.54700000000000004,"15min":0.434},"max":{"1min":1.198,"5min":1.327,"15min":1.6220000000000001},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.93899999999999995,"15min":0.92900000000000005},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.496},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.6870000000000001},"last":0.66700000000000004}]},{"osd":1,"last update":"Sat Jun 10 19:02:54 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.92600000000000005,"15min":0.92400000000000004},"min":{"1min":0.623,"5min":0.55100000000000005,"15min":0.53900000000000003},"max":{"1min":1.2350000000000001,"5min":1.262,"15min":1.377},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.97299999999999998,"15min":0.93999999999999995},"min":{"1min":0.68700000000000006,"5min":0.66300000000000003,"15min":0.504},"max":{"1min":1.161,"5min":1.234,"15min":1.5960000000000001},"last":0.57999999999999996}]},{"osd":2,"last update":"Sat Jun 10 19:02:54 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.85699999999999998,"15min":0.83999999999999997},"min":{"1min":0.57999999999999996,"5min":0.52100000000000002,"15min":0.47099999999999997},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.4059999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.91800000000000004,"15min":0.90300000000000002},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.50600000000000001},"max":{"1min":1.1839999999999999,"5min":1.448,"15min":1.448},"last":1.1240000000000001}]},{"osd":3,"last update":"Sat Jun 10 19:02:54 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.94399999999999995,"15min":0.92200000000000004},"min":{"1min":0.71199999999999997,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.2350000000000001,"5min":1.2370000000000001,"15min":1.502},"last":0.629},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.98999999999999999,"15min":0.94699999999999995},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.53800000000000003},"max":{"1min":1.276,"5min":1.284,"15min":1.2929999999999999},"last":1.0289999999999999}]},{"osd":4,"last update":"Sat Jun 10 19:02:54 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.82499999999999996,"15min":0.85399999999999998},"min":{"1min":0.58699999999999997,"5min":0.39500000000000002,"15min":0.32700000000000001},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.639},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.98499999999999999,"15min":0.97299999999999998},"min":{"1min":0.81999999999999995,"5min":0.434,"15min":0.40000000000000002},"max":{"1min":1.454,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.083}]},{"osd":5,"last update":"Sat Jun 10 19:02:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.002,"15min":1.014},"min":{"1min":0.70899999999999996,"5min":0.40500000000000003,"15min":0.38400000000000001},"max":{"1min":1.2809999999999999,"5min":1.395,"15min":1.806},"last":1.175},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.0489999999999999,"15min":1.042},"min":{"1min":0.745,"5min":0.505,"15min":0.46500000000000002},"max":{"1min":1.393,"5min":1.579,"15min":1.579},"last":0.94099999999999995}]},{"osd":6,"last update":"Sat Jun 10 19:02:54 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.0329999999999999,"15min":1.0089999999999999},"min":{"1min":0.73599999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.2909999999999999,"5min":1.391,"15min":1.718},"last":0.97799999999999998},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.1259999999999999,"15min":1.099},"min":{"1min":0.99399999999999999,"5min":0.48799999999999999,"15min":0.441},"max":{"1min":1.329,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":1.1539999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574987,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32340,"kb_used_data":1292,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339500,"statfs":{"total":96636764160,"available":96603648000,"internally_reserved":0,"allocated":1323008,"data_stored":606691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:02:46 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.873,"15min":0.84699999999999998},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.167,"5min":1.3129999999999999,"15min":1.498},"last":1.202},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.89400000000000002,"15min":0.86899999999999999},"min":{"1min":0.57199999999999995,"5min":0.46899999999999997,"15min":0.46100000000000002},"max":{"1min":1.167,"5min":1.496,"15min":1.496},"last":0.79500000000000004}]},{"osd":1,"last update":"Sat Jun 10 19:02:46 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.86499999999999999,"15min":0.86099999999999999},"min":{"1min":0.54900000000000004,"5min":0.502,"15min":0.48699999999999999},"max":{"1min":1.046,"5min":1.143,"15min":1.5229999999999999},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91700000000000004,"15min":0.88800000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.45300000000000001},"max":{"1min":1.258,"5min":1.258,"15min":1.778},"last":1.0209999999999999}]},{"osd":2,"last update":"Sat Jun 10 19:02:46 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.92500000000000004,"15min":0.88800000000000001},"min":{"1min":0.66200000000000003,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.2809999999999999,"5min":1.3240000000000001,"15min":1.3759999999999999},"last":0.87},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.89800000000000002,"15min":0.89000000000000001},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.22,"5min":1.2330000000000001,"15min":1.246},"last":1.0569999999999999}]},{"osd":3,"last update":"Sat Jun 10 19:02:46 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.93600000000000005,"15min":0.89700000000000002},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.52700000000000002},"max":{"1min":1.1659999999999999,"5min":1.222,"15min":1.7190000000000001},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.012,"5min":0.98999999999999999,"15min":0.99299999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.371,"5min":1.371,"15min":1.4370000000000001},"last":1.0920000000000001}]},{"osd":4,"last update":"Sat Jun 10 19:02:46 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.88500000000000001,"15min":0.92500000000000004},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.401,"5min":1.401,"15min":1.798},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.95499999999999996,"15min":0.99299999999999999},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.357,"5min":1.357,"15min":1.5489999999999999},"last":0.98599999999999999}]},{"osd":5,"last update":"Sat Jun 10 19:02:46 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.89700000000000002,"15min":0.93100000000000005},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.29,"5min":1.29,"15min":1.333},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.96599999999999997,"5min":1.0009999999999999,"15min":1.026},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.2230000000000001,"5min":1.2649999999999999,"15min":2.536},"last":0.90600000000000003}]},{"osd":7,"last update":"Sat Jun 10 19:02:46 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.0129999999999999,"15min":1.0329999999999999},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.57099999999999995},"max":{"1min":1.427,"5min":1.427,"15min":1.917},"last":1.1579999999999999},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.97899999999999998,"15min":1.028},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.5569999999999999},"last":0.84199999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574987,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32340,"kb_used_data":1292,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339500,"statfs":{"total":96636764160,"available":96603648000,"internally_reserved":0,"allocated":1323008,"data_stored":606691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.88400000000000001,"15min":0.86399999999999999},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.0800000000000001,"5min":1.2070000000000001,"15min":1.232},"last":1.02},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.93100000000000005,"15min":0.92000000000000004},"min":{"1min":0.70199999999999996,"5min":0.58999999999999997,"15min":0.49399999999999999},"max":{"1min":1.165,"5min":2.347,"15min":2.347},"last":0.94899999999999995}]},{"osd":1,"last update":"Sat Jun 10 19:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.95699999999999996,"15min":0.92000000000000004},"min":{"1min":0.63800000000000001,"5min":0.58799999999999997,"15min":0.52600000000000002},"max":{"1min":1.1599999999999999,"5min":7.0800000000000001,"15min":7.0800000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.94399999999999995,"5min":1.135,"15min":0.99099999999999999},"min":{"1min":0.58799999999999997,"5min":0.58399999999999996,"15min":0.53800000000000003},"max":{"1min":1.2689999999999999,"5min":15.845000000000001,"15min":15.845000000000001},"last":1.2689999999999999}]},{"osd":2,"last update":"Sat Jun 10 19:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.94099999999999995,"15min":0.88400000000000001},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.48299999999999998},"max":{"1min":1.319,"5min":5.0049999999999999,"15min":5.0049999999999999},"last":1.228},{"interface":"front","average":{"1min":0.89700000000000002,"5min":1.0109999999999999,"15min":0.94299999999999995},"min":{"1min":0.64900000000000002,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.0569999999999999,"5min":6.851,"15min":6.851},"last":0.78800000000000003}]},{"osd":3,"last update":"Sat Jun 10 19:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.96299999999999997,"15min":0.95299999999999996},"min":{"1min":0.71399999999999997,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.2010000000000001,"5min":2.544,"15min":2.544},"last":0.871},{"interface":"front","average":{"1min":0.95099999999999996,"5min":1.0109999999999999,"15min":1.008},"min":{"1min":0.68899999999999995,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.1739999999999999,"5min":3.0830000000000002,"15min":3.0830000000000002},"last":1.1559999999999999}]},{"osd":4,"last update":"Sat Jun 10 19:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.97799999999999998,"15min":0.96099999999999997},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.58099999999999996},"max":{"1min":1.2669999999999999,"5min":6.7290000000000001,"15min":6.7290000000000001},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.98299999999999998,"15min":1.014},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.61199999999999999},"max":{"1min":1.1200000000000001,"5min":1.341,"15min":1.575},"last":1.1200000000000001}]},{"osd":6,"last update":"Sat Jun 10 19:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.99099999999999999,"15min":1.0149999999999999},"min":{"1min":0.68100000000000005,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.232,"5min":1.3029999999999999,"15min":1.4330000000000001},"last":1.0680000000000001},{"interface":"front","average":{"1min":0.97699999999999998,"5min":1.105,"15min":1.0660000000000001},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.57899999999999996},"max":{"1min":1.194,"5min":6.923,"15min":6.923},"last":0.98499999999999999}]},{"osd":7,"last update":"Sat Jun 10 19:03:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.081,"15min":1.111},"min":{"1min":0.69899999999999995,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.2829999999999999,"5min":2.6080000000000001,"15min":2.6080000000000001},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.163,"15min":1.153},"min":{"1min":0.84499999999999997,"5min":0.67100000000000004,"15min":0.66200000000000003},"max":{"1min":1.365,"5min":5.4169999999999998,"15min":5.4169999999999998},"last":1.323}]}]},{"osd":4,"up_from":13,"seq":55834574986,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32328,"kb_used_data":1280,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339512,"statfs":{"total":96636764160,"available":96603660288,"internally_reserved":0,"allocated":1310720,"data_stored":600521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.88200000000000001,"15min":0.80900000000000005},"min":{"1min":0.52500000000000002,"5min":0.48599999999999999,"15min":0.45100000000000001},"max":{"1min":1.153,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.91100000000000003,"15min":0.90000000000000002},"min":{"1min":0.57099999999999995,"5min":0.49199999999999999,"15min":0.48899999999999999},"max":{"1min":1.202,"5min":1.288,"15min":3.7280000000000002},"last":0.82199999999999995}]},{"osd":1,"last update":"Sat Jun 10 19:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.92700000000000005,"15min":0.94399999999999995},"min":{"1min":0.62,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1970000000000001,"5min":1.254,"15min":3.3969999999999998},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.88300000000000001,"15min":0.85999999999999999},"min":{"1min":0.622,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.202,"5min":1.2110000000000001,"15min":2.496},"last":0.99399999999999999}]},{"osd":2,"last update":"Sat Jun 10 19:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.88900000000000001,"15min":0.88300000000000001},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.49299999999999999},"max":{"1min":1.236,"5min":1.3,"15min":1.522},"last":0.75},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.98799999999999999,"15min":0.998},"min":{"1min":0.73999999999999999,"5min":0.64400000000000002,"15min":0.55000000000000004},"max":{"1min":1.1719999999999999,"5min":1.2769999999999999,"15min":3.5750000000000002},"last":1.048}]},{"osd":3,"last update":"Sat Jun 10 19:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.92200000000000004,"15min":0.89800000000000002},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.53900000000000003},"max":{"1min":1.46,"5min":1.46,"15min":2.3809999999999998},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.97199999999999998,"15min":0.96299999999999997},"min":{"1min":0.63400000000000001,"5min":0.61499999999999999,"15min":0.54400000000000004},"max":{"1min":1.236,"5min":1.2370000000000001,"15min":1.6479999999999999},"last":0.91000000000000003}]},{"osd":5,"last update":"Sat Jun 10 19:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.92400000000000004,"15min":0.96899999999999997},"min":{"1min":0.65600000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.3260000000000001,"5min":1.3360000000000001,"15min":3.6539999999999999},"last":1.149},{"interface":"front","average":{"1min":0.873,"5min":0.91600000000000004,"15min":0.95699999999999996},"min":{"1min":0.624,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.26,"5min":1.3460000000000001,"15min":2.6720000000000002},"last":0.78400000000000003}]},{"osd":6,"last update":"Sat Jun 10 19:03:01 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":0.94499999999999995,"15min":0.98799999999999999},"min":{"1min":0.59699999999999998,"5min":0.58499999999999996,"15min":0.54900000000000004},"max":{"1min":1.21,"5min":1.3149999999999999,"15min":2.2639999999999998},"last":1.121},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.0329999999999999,"15min":1.0640000000000001},"min":{"1min":0.72799999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.3080000000000001,"5min":1.4059999999999999,"15min":3.4980000000000002},"last":1.2210000000000001}]},{"osd":7,"last update":"Sat Jun 10 19:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.98599999999999999,"15min":0.99299999999999999},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.41399999999999998},"max":{"1min":1.272,"5min":1.482,"15min":2.5910000000000002},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.077,"5min":1.0620000000000001,"15min":1.0680000000000001},"min":{"1min":0.76600000000000001,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.361,"5min":1.3740000000000001,"15min":1.4399999999999999},"last":1.194}]}]},{"osd":3,"up_from":13,"seq":55834574985,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32336,"kb_used_data":1288,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339504,"statfs":{"total":96636764160,"available":96603652096,"internally_reserved":0,"allocated":1318912,"data_stored":605672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.63700000000000001,"15min":0.60799999999999998},"min":{"1min":0.39900000000000002,"5min":0.28699999999999998,"15min":0.27900000000000003},"max":{"1min":0.79900000000000004,"5min":1.1539999999999999,"15min":1.169},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69499999999999995,"15min":0.66100000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.251},"max":{"1min":0.92400000000000004,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.36799999999999999}]},{"osd":1,"last update":"Sat Jun 10 19:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.68899999999999995,"15min":0.66700000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.27500000000000002},"max":{"1min":1.01,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.746,"15min":0.73599999999999999},"min":{"1min":0.439,"5min":0.373,"15min":0.318},"max":{"1min":1.0409999999999999,"5min":1.2569999999999999,"15min":1.411},"last":0.55300000000000005}]},{"osd":2,"last update":"Sat Jun 10 19:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.77900000000000003,"15min":0.77100000000000002},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.30299999999999999},"max":{"1min":1.2829999999999999,"5min":1.3899999999999999,"15min":1.9530000000000001},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80700000000000005,"15min":0.77700000000000002},"min":{"1min":0.46300000000000002,"5min":0.35299999999999998,"15min":0.29699999999999999},"max":{"1min":1.123,"5min":1.591,"15min":1.591},"last":0.65700000000000003}]},{"osd":4,"last update":"Sat Jun 10 19:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.97799999999999998,"15min":0.95899999999999996},"min":{"1min":0.623,"5min":0.623,"15min":0.41899999999999998},"max":{"1min":1.4239999999999999,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.995,"15min":0.98999999999999999},"min":{"1min":0.65600000000000003,"5min":0.61299999999999999,"15min":0.47999999999999998},"max":{"1min":1.3140000000000001,"5min":1.873,"15min":1.873},"last":0.68200000000000005}]},{"osd":5,"last update":"Sat Jun 10 19:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":1.0129999999999999,"15min":1.0249999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.5329999999999999,"5min":1.752,"15min":2.024},"last":0.60199999999999998},{"interface":"front","average":{"1min":1.026,"5min":1.0249999999999999,"15min":1.028},"min":{"1min":0.64400000000000002,"5min":0.60299999999999998,"15min":0.46899999999999997},"max":{"1min":1.5149999999999999,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.71299999999999997}]},{"osd":6,"last update":"Sat Jun 10 19:03:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.075,"15min":1.0620000000000001},"min":{"1min":0.63800000000000001,"5min":0.59299999999999997,"15min":0.55300000000000005},"max":{"1min":1.5620000000000001,"5min":1.786,"15min":1.8500000000000001},"last":0.79600000000000004},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.67900000000000005,"5min":0.61199999999999999,"15min":0.58799999999999997},"max":{"1min":1.3080000000000001,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.95299999999999996}]},{"osd":7,"last update":"Sat Jun 10 19:03:47 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.0900000000000001,"15min":1.1020000000000001},"min":{"1min":0.622,"5min":0.57999999999999996,"15min":0.56999999999999995},"max":{"1min":1.452,"5min":2.1150000000000002,"15min":2.1150000000000002},"last":0.90200000000000002},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.105,"15min":1.0940000000000001},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.61099999999999999},"max":{"1min":1.4630000000000001,"5min":1.9850000000000001,"15min":1.9850000000000001},"last":0.77000000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574986,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32340,"kb_used_data":1292,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339500,"statfs":{"total":96636764160,"available":96603648000,"internally_reserved":0,"allocated":1323008,"data_stored":606691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:02:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.627,"15min":0.60799999999999998},"min":{"1min":0.35199999999999998,"5min":0.31,"15min":0.27300000000000002},"max":{"1min":0.88200000000000001,"5min":1.095,"15min":1.1220000000000001},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.73699999999999999,"15min":0.72199999999999998},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.163,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.377}]},{"osd":1,"last update":"Sat Jun 10 19:02:52 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.67400000000000004,"15min":0.66400000000000003},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.94799999999999995,"5min":0.98299999999999998,"15min":1.1950000000000001},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.79500000000000004,"15min":0.74099999999999999},"min":{"1min":0.41999999999999998,"5min":0.36699999999999999,"15min":0.29499999999999998},"max":{"1min":1.2310000000000001,"5min":1.446,"15min":1.446},"last":0.34999999999999998}]},{"osd":3,"last update":"Sat Jun 10 19:02:52 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.80300000000000005,"15min":0.754},"min":{"1min":0.35599999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.133,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.80300000000000005,"15min":0.77300000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":1.181,"5min":1.181,"15min":1.3340000000000001},"last":0.44400000000000001}]},{"osd":4,"last update":"Sat Jun 10 19:02:52 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.94199999999999995,"15min":0.92600000000000005},"min":{"1min":0.68000000000000005,"5min":0.624,"15min":0.53400000000000003},"max":{"1min":1.258,"5min":1.258,"15min":1.3620000000000001},"last":0.52800000000000002},{"interface":"front","average":{"1min":1.044,"5min":1.0229999999999999,"15min":1.0269999999999999},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.57699999999999996},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.59299999999999997}]},{"osd":5,"last update":"Sat Jun 10 19:02:52 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.0209999999999999,"15min":1.0169999999999999},"min":{"1min":0.63300000000000001,"5min":0.61199999999999999,"15min":0.54100000000000004},"max":{"1min":1.337,"5min":1.5429999999999999,"15min":1.5700000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":1.052,"5min":1.02,"15min":1.0069999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.667},"last":0.74399999999999999}]},{"osd":6,"last update":"Sat Jun 10 19:02:52 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.0369999999999999,"15min":1.0429999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.391,"5min":1.4259999999999999,"15min":1.5900000000000001},"last":0.93000000000000005},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0600000000000001,"15min":1.046},"min":{"1min":0.624,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.486,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.83099999999999996}]},{"osd":7,"last update":"Sat Jun 10 19:02:52 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.117,"15min":1.103},"min":{"1min":0.64400000000000002,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.734,"5min":1.734,"15min":1.734},"last":0.73199999999999998},{"interface":"front","average":{"1min":1.21,"5min":1.125,"15min":1.107},"min":{"1min":0.64700000000000002,"5min":0.64100000000000001,"15min":0.59299999999999997},"max":{"1min":1.657,"5min":1.657,"15min":1.752},"last":0.78200000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574988,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32324,"kb_used_data":1276,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339516,"statfs":{"total":96636764160,"available":96603664384,"internally_reserved":0,"allocated":1306624,"data_stored":599502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:02:54 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.68999999999999995,"15min":0.67600000000000005},"min":{"1min":0.32100000000000001,"5min":0.28599999999999998,"15min":0.25800000000000001},"max":{"1min":1.026,"5min":1.119,"15min":1.288},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.76800000000000002,"15min":0.72699999999999998},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.694},"last":0.65700000000000003}]},{"osd":2,"last update":"Sat Jun 10 19:02:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.64000000000000001,"15min":0.63100000000000001},"min":{"1min":0.33100000000000002,"5min":0.308,"15min":0.249},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.21},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.629,"5min":0.74199999999999999,"15min":0.70199999999999996},"min":{"1min":0.32800000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.0629999999999999,"5min":1.194,"15min":1.415},"last":0.47299999999999998}]},{"osd":3,"last update":"Sat Jun 10 19:02:54 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.78600000000000003,"15min":0.77100000000000002},"min":{"1min":0.40200000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.0529999999999999,"5min":1.3049999999999999,"15min":1.6299999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.73999999999999999,"15min":0.74399999999999999},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.0409999999999999,"5min":1.2909999999999999,"15min":2.1749999999999998},"last":0.504}]},{"osd":4,"last update":"Sat Jun 10 19:02:54 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.86599999999999999,"15min":0.85399999999999998},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.53000000000000003},"max":{"1min":1.2070000000000001,"5min":1.343,"15min":1.4930000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.99199999999999999,"15min":1.048},"min":{"1min":0.47299999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.492,"5min":1.5129999999999999,"15min":5.8209999999999997},"last":1.05}]},{"osd":5,"last update":"Sat Jun 10 19:02:54 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.99099999999999999,"15min":1.0089999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.2709999999999999,"5min":1.6299999999999999,"15min":1.8620000000000001},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.97499999999999998,"15min":0.97799999999999998},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":3.089},"last":0.84099999999999997}]},{"osd":6,"last update":"Sat Jun 10 19:02:54 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":1.038,"15min":1.05},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.3640000000000001,"5min":1.6759999999999999,"15min":7.2599999999999998},"last":1.016},{"interface":"front","average":{"1min":0.93200000000000005,"5min":1.022,"15min":1.038},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":9.0069999999999997},"last":0.754}]},{"osd":7,"last update":"Sat Jun 10 19:02:54 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":1.0800000000000001,"15min":1.085},"min":{"1min":0.58799999999999997,"5min":0.495,"15min":0.495},"max":{"1min":1.431,"5min":1.573,"15min":2.105},"last":1.1160000000000001},{"interface":"front","average":{"1min":0.96699999999999997,"5min":1.087,"15min":1.081},"min":{"1min":0.60199999999999998,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.454,"5min":1.5620000000000001,"15min":2.2570000000000001},"last":1.0780000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574987,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32916,"kb_used_data":1868,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338924,"statfs":{"total":96636764160,"available":96603058176,"internally_reserved":0,"allocated":1912832,"data_stored":1196040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jun 10 19:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.65900000000000003,"15min":0.63},"min":{"1min":0.46300000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.98499999999999999,"5min":1.077,"15min":1.0780000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.82899999999999996,"15min":0.78800000000000003},"min":{"1min":0.49299999999999999,"5min":0.36299999999999999,"15min":0.34000000000000002},"max":{"1min":1.0309999999999999,"5min":1.2230000000000001,"15min":1.4059999999999999},"last":1.0289999999999999}]},{"osd":2,"last update":"Sat Jun 10 19:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.73299999999999998,"15min":0.71299999999999997},"min":{"1min":0.51100000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2829999999999999},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.67300000000000004,"15min":0.64800000000000002},"min":{"1min":0.46899999999999997,"5min":0.27600000000000002,"15min":0.245},"max":{"1min":0.83499999999999996,"5min":1.139,"15min":1.371},"last":0.60799999999999998}]},{"osd":3,"last update":"Sat Jun 10 19:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.38900000000000001,"5min":0.29499999999999998,"15min":0.28899999999999998},"max":{"1min":0.875,"5min":1.0860000000000001,"15min":1.226},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.871,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.42999999999999999,"5min":0.317,"15min":0.317},"max":{"1min":1.742,"5min":1.742,"15min":1.829},"last":0.85499999999999998}]},{"osd":4,"last update":"Sat Jun 10 19:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.92900000000000005,"15min":0.91600000000000004},"min":{"1min":0.72199999999999998,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.224,"5min":1.224,"15min":3.0209999999999999},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.0409999999999999,"15min":1.032},"min":{"1min":0.65300000000000002,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.8520000000000001,"5min":1.8520000000000001,"15min":1.9510000000000001},"last":1.1220000000000001}]},{"osd":5,"last update":"Sat Jun 10 19:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.93999999999999995,"15min":0.94599999999999995},"min":{"1min":0.67300000000000004,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.694},"last":0.80600000000000005},{"interface":"front","average":{"1min":1.044,"5min":1.012,"15min":1.0129999999999999},"min":{"1min":0.65200000000000002,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.78,"5min":1.78,"15min":4.5620000000000003},"last":0.998}]},{"osd":6,"last update":"Sat Jun 10 19:02:53 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.0800000000000001,"15min":1.0760000000000001},"min":{"1min":0.73899999999999999,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.5700000000000001,"5min":1.5980000000000001,"15min":3.5569999999999999},"last":1.083},{"interface":"front","average":{"1min":0.97499999999999998,"5min":1.004,"15min":1.0029999999999999},"min":{"1min":0.69699999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.883},"last":0.93300000000000005}]},{"osd":7,"last update":"Sat Jun 10 19:02:53 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.036,"15min":1.036},"min":{"1min":0.69199999999999995,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.512,"5min":1.512,"15min":1.5800000000000001},"last":1.056},{"interface":"front","average":{"1min":1.109,"5min":1.077,"15min":1.0609999999999999},"min":{"1min":0.78900000000000003,"5min":0.624,"15min":0.58699999999999997},"max":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.9830000000000001},"last":0.89600000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-10T19:03:51.504 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-10T19:03:51.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.665+0000 7f3e3d405640 1 Processor -- start 2023-06-10T19:03:51.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.665+0000 7f3e3d405640 1 -- start start 2023-06-10T19:03:51.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.665+0000 7f3e3d405640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3e380c9840 0x7f3e380c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:51.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.665+0000 7f3e3d405640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3e38071060 0x7f3e380af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:51.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.665+0000 7f3e3d405640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3e380afc60 0x7f3e3815d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:51.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.665+0000 7f3e3d405640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e38159b50 con 0x7f3e380afc60 2023-06-10T19:03:51.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.665+0000 7f3e3d405640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e380ca150 con 0x7f3e380c9840 2023-06-10T19:03:51.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.665+0000 7f3e3d405640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e380702a0 con 0x7f3e38071060 2023-06-10T19:03:51.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.665+0000 7f3e377fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3e380afc60 0x7f3e3815d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:51.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.665+0000 7f3e377fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3e380afc60 0x7f3e3815d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34978/0 (socket says 172.21.15.53:34978) 2023-06-10T19:03:51.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.665+0000 7f3e377fe640 1 -- 172.21.15.53:0/3159101894 learned_addr learned my addr 172.21.15.53:0/3159101894 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:51.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.665+0000 7f3e367fc640 1 --2- 172.21.15.53:0/3159101894 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3e38071060 0x7f3e380af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:51.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.665+0000 7f3e36ffd640 1 --2- 172.21.15.53:0/3159101894 >> v2:172.21.15.117:3300/0 conn(0x7f3e380c9840 0x7f3e380c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:51.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.665+0000 7f3e377fe640 1 -- 172.21.15.53:0/3159101894 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3e38071060 msgr2=0x7f3e380af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:51.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.665+0000 7f3e377fe640 1 --2- 172.21.15.53:0/3159101894 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3e38071060 0x7f3e380af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:51.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.665+0000 7f3e377fe640 1 -- 172.21.15.53:0/3159101894 >> v2:172.21.15.117:3300/0 conn(0x7f3e380c9840 msgr2=0x7f3e380c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:51.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.665+0000 7f3e377fe640 1 --2- 172.21.15.53:0/3159101894 >> v2:172.21.15.117:3300/0 conn(0x7f3e380c9840 0x7f3e380c9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:51.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.665+0000 7f3e377fe640 1 -- 172.21.15.53:0/3159101894 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e38070580 con 0x7f3e380afc60 2023-06-10T19:03:51.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.665+0000 7f3e36ffd640 1 --2- 172.21.15.53:0/3159101894 >> v2:172.21.15.117:3300/0 conn(0x7f3e380c9840 0x7f3e380c9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:03:51.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.669+0000 7f3e377fe640 1 --2- 172.21.15.53:0/3159101894 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e380afc60 0x7f3e3815d2c0 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7f3e38071d80 tx=0x7f3e3001c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9c90a11b4473d07 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:51.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.669+0000 7f3e35ffb640 1 -- 172.21.15.53:0/3159101894 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e300a5560 con 0x7f3e380afc60 2023-06-10T19:03:51.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.669+0000 7f3e35ffb640 1 -- 172.21.15.53:0/3159101894 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e300a56c0 con 0x7f3e380afc60 2023-06-10T19:03:51.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.669+0000 7f3e35ffb640 1 -- 172.21.15.53:0/3159101894 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e300a5a50 con 0x7f3e380afc60 2023-06-10T19:03:51.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.669+0000 7f3e3d405640 1 -- 172.21.15.53:0/3159101894 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e380afc60 msgr2=0x7f3e3815d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:51.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.669+0000 7f3e3d405640 1 --2- 172.21.15.53:0/3159101894 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e380afc60 0x7f3e3815d2c0 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7f3e38071d80 tx=0x7f3e3001c6e0 comp rx=0 tx=0).stop 2023-06-10T19:03:51.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.669+0000 7f3e3d405640 1 -- 172.21.15.53:0/3159101894 shutdown_connections 2023-06-10T19:03:51.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.669+0000 7f3e3d405640 1 --2- 172.21.15.53:0/3159101894 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e380afc60 0x7f3e3815d2c0 unknown :-1 s=CLOSED pgs=1725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:51.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.669+0000 7f3e3d405640 1 --2- 172.21.15.53:0/3159101894 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3e38071060 0x7f3e380af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:51.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.669+0000 7f3e3d405640 1 --2- 172.21.15.53:0/3159101894 >> v2:172.21.15.117:3300/0 conn(0x7f3e380c9840 0x7f3e380c9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:51.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.669+0000 7f3e3d405640 1 -- 172.21.15.53:0/3159101894 >> 172.21.15.53:0/3159101894 conn(0x7f3e3806a0d0 msgr2=0x7f3e380ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:51.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.669+0000 7f3e3d405640 1 -- 172.21.15.53:0/3159101894 shutdown_connections 2023-06-10T19:03:51.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.669+0000 7f3e3d405640 1 -- 172.21.15.53:0/3159101894 wait complete. 2023-06-10T19:03:51.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.669+0000 7f3e3d405640 1 Processor -- start 2023-06-10T19:03:51.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.669+0000 7f3e3d405640 1 -- start start 2023-06-10T19:03:51.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.669+0000 7f3e3d405640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e38071060 0x7f3e380c1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:51.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.669+0000 7f3e3d405640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3e380afc60 0x7f3e38151cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:51.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.669+0000 7f3e3d405640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3e380c9840 0x7f3e38151600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:51.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.669+0000 7f3e3d405640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e38151b40 con 0x7f3e38071060 2023-06-10T19:03:51.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.669+0000 7f3e3d405640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e380c7130 con 0x7f3e380c9840 2023-06-10T19:03:51.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.669+0000 7f3e3d405640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e380b1c50 con 0x7f3e380afc60 2023-06-10T19:03:51.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.669+0000 7f3e36ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e38071060 0x7f3e380c1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:51.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.669+0000 7f3e36ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e38071060 0x7f3e380c1c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34982/0 (socket says 172.21.15.53:34982) 2023-06-10T19:03:51.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.669+0000 7f3e36ffd640 1 -- 172.21.15.53:0/945726937 learned_addr learned my addr 172.21.15.53:0/945726937 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:51.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.669+0000 7f3e367fc640 1 --2- 172.21.15.53:0/945726937 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3e380afc60 0x7f3e38151cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:51.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.669+0000 7f3e377fe640 1 --2- 172.21.15.53:0/945726937 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3e380c9840 0x7f3e38151600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:51.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.669+0000 7f3e36ffd640 1 -- 172.21.15.53:0/945726937 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3e380afc60 msgr2=0x7f3e38151cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:51.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.669+0000 7f3e36ffd640 1 --2- 172.21.15.53:0/945726937 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3e380afc60 0x7f3e38151cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:51.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.669+0000 7f3e36ffd640 1 -- 172.21.15.53:0/945726937 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3e380c9840 msgr2=0x7f3e38151600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:51.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.669+0000 7f3e36ffd640 1 --2- 172.21.15.53:0/945726937 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3e380c9840 0x7f3e38151600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:51.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.669+0000 7f3e36ffd640 1 -- 172.21.15.53:0/945726937 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e30009b30 con 0x7f3e38071060 2023-06-10T19:03:51.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.669+0000 7f3e36ffd640 1 --2- 172.21.15.53:0/945726937 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e38071060 0x7f3e380c1c90 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c00c7f0 tx=0x7f3e2c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:51.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.673+0000 7f3e1f7fe640 1 -- 172.21.15.53:0/945726937 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2c007820 con 0x7f3e38071060 2023-06-10T19:03:51.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.673+0000 7f3e1f7fe640 1 -- 172.21.15.53:0/945726937 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e2c007980 con 0x7f3e38071060 2023-06-10T19:03:51.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.673+0000 7f3e3d405640 1 -- 172.21.15.53:0/945726937 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e380b1f30 con 0x7f3e38071060 2023-06-10T19:03:51.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.673+0000 7f3e1f7fe640 1 -- 172.21.15.53:0/945726937 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2c007d30 con 0x7f3e38071060 2023-06-10T19:03:51.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.673+0000 7f3e3d405640 1 -- 172.21.15.53:0/945726937 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e380b24f0 con 0x7f3e38071060 2023-06-10T19:03:51.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.673+0000 7f3e3d405640 1 -- 172.21.15.53:0/945726937 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e3806b010 con 0x7f3e38071060 2023-06-10T19:03:51.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.673+0000 7f3e1f7fe640 1 -- 172.21.15.53:0/945726937 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3e2c0113f0 con 0x7f3e38071060 2023-06-10T19:03:51.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.673+0000 7f3e1f7fe640 1 --2- 172.21.15.53:0/945726937 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3e24066280 0x7f3e24068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:51.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.673+0000 7f3e1f7fe640 1 -- 172.21.15.53:0/945726937 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3e2c083e80 con 0x7f3e38071060 2023-06-10T19:03:51.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.673+0000 7f3e367fc640 1 --2- 172.21.15.53:0/945726937 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3e24066280 0x7f3e24068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:51.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.673+0000 7f3e367fc640 1 --2- 172.21.15.53:0/945726937 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3e24066280 0x7f3e24068730 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f3e380b3af0 tx=0x7f3e28008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:51.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.677+0000 7f3e1f7fe640 1 -- 172.21.15.53:0/945726937 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3e2c051390 con 0x7f3e38071060 2023-06-10T19:03:51.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.825+0000 7f3e3d405640 1 -- 172.21.15.53:0/945726937 --> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3e3815aba0 con 0x7f3e24066280 2023-06-10T19:03:51.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.849+0000 7f3e1f7fe640 1 -- 172.21.15.53:0/945726937 <== mgr.4105 v2:172.21.15.117:6832/3061986771 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+298377 (secure 0 0 0) 0x7f3e2800b6d0 con 0x7f3e24066280 2023-06-10T19:03:51.856 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:03:51.857 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-06-10T19:03:51.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.853+0000 7f3e3d405640 1 -- 172.21.15.53:0/945726937 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3e24066280 msgr2=0x7f3e24068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:51.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.853+0000 7f3e3d405640 1 --2- 172.21.15.53:0/945726937 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3e24066280 0x7f3e24068730 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f3e380b3af0 tx=0x7f3e28008040 comp rx=0 tx=0).stop 2023-06-10T19:03:51.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.853+0000 7f3e3d405640 1 -- 172.21.15.53:0/945726937 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e38071060 msgr2=0x7f3e380c1c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:51.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.853+0000 7f3e3d405640 1 --2- 172.21.15.53:0/945726937 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e38071060 0x7f3e380c1c90 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c00c7f0 tx=0x7f3e2c00ccb0 comp rx=0 tx=0).stop 2023-06-10T19:03:51.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.853+0000 7f3e3d405640 1 -- 172.21.15.53:0/945726937 shutdown_connections 2023-06-10T19:03:51.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.853+0000 7f3e3d405640 1 --2- 172.21.15.53:0/945726937 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3e24066280 0x7f3e24068730 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:51.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.853+0000 7f3e3d405640 1 --2- 172.21.15.53:0/945726937 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3e380c9840 0x7f3e38151600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:51.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.853+0000 7f3e3d405640 1 --2- 172.21.15.53:0/945726937 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3e380afc60 0x7f3e38151cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:51.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.853+0000 7f3e3d405640 1 --2- 172.21.15.53:0/945726937 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e38071060 0x7f3e380c1c90 unknown :-1 s=CLOSED pgs=1726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:51.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.853+0000 7f3e3d405640 1 -- 172.21.15.53:0/945726937 >> 172.21.15.53:0/945726937 conn(0x7f3e3806a0d0 msgr2=0x7f3e38159c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:51.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.853+0000 7f3e3d405640 1 -- 172.21.15.53:0/945726937 shutdown_connections 2023-06-10T19:03:51.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:51.853+0000 7f3e3d405640 1 -- 172.21.15.53:0/945726937 wait complete. 2023-06-10T19:03:51.875 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":443,"stamp":"2023-06-10T19:03:51.801430+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":29,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":259832,"kb_used_data":11448,"kb_used_omap":0,"kb_used_meta":248320,"kb_avail":754714888,"statfs":{"total":773094113280,"available":772828045312,"internally_reserved":0,"allocated":11722752,"data_stored":6012697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":254279680},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.774191"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.039078+0000","last_change":"2023-06-10T19:03:47.039078+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.039078+0000","last_undegraded":"2023-06-10T19:03:47.039078+0000","last_fullsized":"2023-06-10T19:03:47.039078+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.043540+0000","last_change":"2023-06-10T19:03:47.043540+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.043540+0000","last_undegraded":"2023-06-10T19:03:47.043540+0000","last_fullsized":"2023-06-10T19:03:47.043540+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.029988+0000","last_change":"2023-06-10T19:03:47.029988+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.029988+0000","last_undegraded":"2023-06-10T19:03:47.029988+0000","last_fullsized":"2023-06-10T19:03:47.029988+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.040924+0000","last_change":"2023-06-10T19:03:47.040924+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.040924+0000","last_undegraded":"2023-06-10T19:03:47.040924+0000","last_fullsized":"2023-06-10T19:03:47.040924+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.043064+0000","last_change":"2023-06-10T19:03:47.043064+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.043064+0000","last_undegraded":"2023-06-10T19:03:47.043064+0000","last_fullsized":"2023-06-10T19:03:47.043064+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.032572+0000","last_change":"2023-06-10T19:03:47.032572+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.032572+0000","last_undegraded":"2023-06-10T19:03:47.032572+0000","last_fullsized":"2023-06-10T19:03:47.032572+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.029778+0000","last_change":"2023-06-10T19:03:47.029778+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.029778+0000","last_undegraded":"2023-06-10T19:03:47.029778+0000","last_fullsized":"2023-06-10T19:03:47.029778+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.039108+0000","last_change":"2023-06-10T19:03:47.039108+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.039108+0000","last_undegraded":"2023-06-10T19:03:47.039108+0000","last_fullsized":"2023-06-10T19:03:47.039108+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.031636+0000","last_change":"2023-06-10T19:03:47.031636+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.031636+0000","last_undegraded":"2023-06-10T19:03:47.031636+0000","last_fullsized":"2023-06-10T19:03:47.031636+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.032280+0000","last_change":"2023-06-10T19:03:47.032280+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.032280+0000","last_undegraded":"2023-06-10T19:03:47.032280+0000","last_fullsized":"2023-06-10T19:03:47.032280+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.044181+0000","last_change":"2023-06-10T19:03:47.044181+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.044181+0000","last_undegraded":"2023-06-10T19:03:47.044181+0000","last_fullsized":"2023-06-10T19:03:47.044181+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.037025+0000","last_change":"2023-06-10T19:03:47.037025+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.037025+0000","last_undegraded":"2023-06-10T19:03:47.037025+0000","last_fullsized":"2023-06-10T19:03:47.037025+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.040771+0000","last_change":"2023-06-10T19:03:47.040771+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.040771+0000","last_undegraded":"2023-06-10T19:03:47.040771+0000","last_fullsized":"2023-06-10T19:03:47.040771+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.039179+0000","last_change":"2023-06-10T19:03:47.039179+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.039179+0000","last_undegraded":"2023-06-10T19:03:47.039179+0000","last_fullsized":"2023-06-10T19:03:47.039179+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.043519+0000","last_change":"2023-06-10T19:03:47.043519+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.043519+0000","last_undegraded":"2023-06-10T19:03:47.043519+0000","last_fullsized":"2023-06-10T19:03:47.043519+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.029942+0000","last_change":"2023-06-10T19:03:47.029942+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.029942+0000","last_undegraded":"2023-06-10T19:03:47.029942+0000","last_fullsized":"2023-06-10T19:03:47.029942+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.041570+0000","last_change":"2023-06-10T19:03:47.041570+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.041570+0000","last_undegraded":"2023-06-10T19:03:47.041570+0000","last_fullsized":"2023-06-10T19:03:47.041570+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.031554+0000","last_change":"2023-06-10T19:03:47.031554+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.031554+0000","last_undegraded":"2023-06-10T19:03:47.031554+0000","last_fullsized":"2023-06-10T19:03:47.031554+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.037091+0000","last_change":"2023-06-10T19:03:47.037091+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.037091+0000","last_undegraded":"2023-06-10T19:03:47.037091+0000","last_fullsized":"2023-06-10T19:03:47.037091+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.041468+0000","last_change":"2023-06-10T19:03:47.041468+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.041468+0000","last_undegraded":"2023-06-10T19:03:47.041468+0000","last_fullsized":"2023-06-10T19:03:47.041468+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.029967+0000","last_change":"2023-06-10T19:03:47.029967+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.029967+0000","last_undegraded":"2023-06-10T19:03:47.029967+0000","last_fullsized":"2023-06-10T19:03:47.029967+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.043508+0000","last_change":"2023-06-10T19:03:47.043508+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.043508+0000","last_undegraded":"2023-06-10T19:03:47.043508+0000","last_fullsized":"2023-06-10T19:03:47.043508+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.036902+0000","last_change":"2023-06-10T19:03:47.036902+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.036902+0000","last_undegraded":"2023-06-10T19:03:47.036902+0000","last_fullsized":"2023-06-10T19:03:47.036902+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.043502+0000","last_change":"2023-06-10T19:03:47.043502+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.043502+0000","last_undegraded":"2023-06-10T19:03:47.043502+0000","last_fullsized":"2023-06-10T19:03:47.043502+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.044354+0000","last_change":"2023-06-10T19:03:47.044354+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.044354+0000","last_undegraded":"2023-06-10T19:03:47.044354+0000","last_fullsized":"2023-06-10T19:03:47.044354+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":324,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-06-10T19:03:47.045429+0000","last_change":"2023-06-10T18:52:34.951528+0000","last_active":"2023-06-10T19:03:47.045429+0000","last_peered":"2023-06-10T19:03:47.045429+0000","last_clean":"2023-06-10T19:03:47.045429+0000","last_became_active":"2023-06-10T18:52:34.949099+0000","last_became_peered":"2023-06-10T18:52:34.949099+0000","last_unstale":"2023-06-10T19:03:47.045429+0000","last_undegraded":"2023-06-10T19:03:47.045429+0000","last_fullsized":"2023-06-10T19:03:47.045429+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_clean_scrub_stamp":"2023-06-10T18:52:33.633295+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:00:35.924767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":176,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-06-10T19:03:47.033648+0000","last_change":"2023-06-10T18:52:40.506384+0000","last_active":"2023-06-10T19:03:47.033648+0000","last_peered":"2023-06-10T19:03:47.033648+0000","last_clean":"2023-06-10T19:03:47.033648+0000","last_became_active":"2023-06-10T18:52:40.505701+0000","last_became_peered":"2023-06-10T18:52:40.505701+0000","last_unstale":"2023-06-10T19:03:47.033648+0000","last_undegraded":"2023-06-10T19:03:47.033648+0000","last_fullsized":"2023-06-10T19:03:47.033648+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:05:06.232347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.043040+0000","last_change":"2023-06-10T19:03:47.043040+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.043040+0000","last_undegraded":"2023-06-10T19:03:47.043040+0000","last_fullsized":"2023-06-10T19:03:47.043040+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":168,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-06-10T19:03:47.045062+0000","last_change":"2023-06-10T18:52:40.512015+0000","last_active":"2023-06-10T19:03:47.045062+0000","last_peered":"2023-06-10T19:03:47.045062+0000","last_clean":"2023-06-10T19:03:47.045062+0000","last_became_active":"2023-06-10T18:52:40.511382+0000","last_became_peered":"2023-06-10T18:52:40.511382+0000","last_unstale":"2023-06-10T19:03:47.045062+0000","last_undegraded":"2023-06-10T19:03:47.045062+0000","last_fullsized":"2023-06-10T19:03:47.045062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:22:14.438906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.032337+0000","last_change":"2023-06-10T19:03:47.032337+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.032337+0000","last_undegraded":"2023-06-10T19:03:47.032337+0000","last_fullsized":"2023-06-10T19:03:47.032337+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":174,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-06-10T19:03:47.046617+0000","last_change":"2023-06-10T18:52:40.671725+0000","last_active":"2023-06-10T19:03:47.046617+0000","last_peered":"2023-06-10T19:03:47.046617+0000","last_clean":"2023-06-10T19:03:47.046617+0000","last_became_active":"2023-06-10T18:52:40.671442+0000","last_became_peered":"2023-06-10T18:52:40.671442+0000","last_unstale":"2023-06-10T19:03:47.046617+0000","last_undegraded":"2023-06-10T19:03:47.046617+0000","last_fullsized":"2023-06-10T19:03:47.046617+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:29:58.957321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.037047+0000","last_change":"2023-06-10T19:03:47.037047+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.037047+0000","last_undegraded":"2023-06-10T19:03:47.037047+0000","last_fullsized":"2023-06-10T19:03:47.037047+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":176,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-06-10T19:03:47.033990+0000","last_change":"2023-06-10T18:52:40.510258+0000","last_active":"2023-06-10T19:03:47.033990+0000","last_peered":"2023-06-10T19:03:47.033990+0000","last_clean":"2023-06-10T19:03:47.033990+0000","last_became_active":"2023-06-10T18:52:40.509560+0000","last_became_peered":"2023-06-10T18:52:40.509560+0000","last_unstale":"2023-06-10T19:03:47.033990+0000","last_undegraded":"2023-06-10T19:03:47.033990+0000","last_fullsized":"2023-06-10T19:03:47.033990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:17:30.476535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.038249+0000","last_change":"2023-06-10T19:03:47.038249+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.038249+0000","last_undegraded":"2023-06-10T19:03:47.038249+0000","last_fullsized":"2023-06-10T19:03:47.038249+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":162,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-06-10T19:03:47.042725+0000","last_change":"2023-06-10T18:52:40.672266+0000","last_active":"2023-06-10T19:03:47.042725+0000","last_peered":"2023-06-10T19:03:47.042725+0000","last_clean":"2023-06-10T19:03:47.042725+0000","last_became_active":"2023-06-10T18:52:40.671966+0000","last_became_peered":"2023-06-10T18:52:40.671966+0000","last_unstale":"2023-06-10T19:03:47.042725+0000","last_undegraded":"2023-06-10T19:03:47.042725+0000","last_fullsized":"2023-06-10T19:03:47.042725+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:56:43.883781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.044311+0000","last_change":"2023-06-10T19:03:47.044311+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.044311+0000","last_undegraded":"2023-06-10T19:03:47.044311+0000","last_fullsized":"2023-06-10T19:03:47.044311+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":168,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-06-10T19:03:47.045328+0000","last_change":"2023-06-10T18:52:40.671084+0000","last_active":"2023-06-10T19:03:47.045328+0000","last_peered":"2023-06-10T19:03:47.045328+0000","last_clean":"2023-06-10T19:03:47.045328+0000","last_became_active":"2023-06-10T18:52:40.670697+0000","last_became_peered":"2023-06-10T18:52:40.670697+0000","last_unstale":"2023-06-10T19:03:47.045328+0000","last_undegraded":"2023-06-10T19:03:47.045328+0000","last_fullsized":"2023-06-10T19:03:47.045328+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:33:42.833010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.043408+0000","last_change":"2023-06-10T19:03:47.043408+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.043408+0000","last_undegraded":"2023-06-10T19:03:47.043408+0000","last_fullsized":"2023-06-10T19:03:47.043408+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":162,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-06-10T19:03:47.042650+0000","last_change":"2023-06-10T18:52:40.514114+0000","last_active":"2023-06-10T19:03:47.042650+0000","last_peered":"2023-06-10T19:03:47.042650+0000","last_clean":"2023-06-10T19:03:47.042650+0000","last_became_active":"2023-06-10T18:52:40.513638+0000","last_became_peered":"2023-06-10T18:52:40.513638+0000","last_unstale":"2023-06-10T19:03:47.042650+0000","last_undegraded":"2023-06-10T19:03:47.042650+0000","last_fullsized":"2023-06-10T19:03:47.042650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:50:41.193183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.046167+0000","last_change":"2023-06-10T19:03:47.046167+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.046167+0000","last_undegraded":"2023-06-10T19:03:47.046167+0000","last_fullsized":"2023-06-10T19:03:47.046167+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":168,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-06-10T19:03:47.039351+0000","last_change":"2023-06-10T18:52:40.515396+0000","last_active":"2023-06-10T19:03:47.039351+0000","last_peered":"2023-06-10T19:03:47.039351+0000","last_clean":"2023-06-10T19:03:47.039351+0000","last_became_active":"2023-06-10T18:52:40.514663+0000","last_became_peered":"2023-06-10T18:52:40.514663+0000","last_unstale":"2023-06-10T19:03:47.039351+0000","last_undegraded":"2023-06-10T19:03:47.039351+0000","last_fullsized":"2023-06-10T19:03:47.039351+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:33:27.036737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574986,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32908,"kb_used_data":1860,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338932,"statfs":{"total":96636764160,"available":96603066368,"internally_reserved":0,"allocated":1904640,"data_stored":1190889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:02:54 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.95199999999999996,"15min":0.91000000000000003},"min":{"1min":0.64700000000000002,"5min":0.54700000000000004,"15min":0.434},"max":{"1min":1.198,"5min":1.327,"15min":1.6220000000000001},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.93899999999999995,"15min":0.92900000000000005},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.496},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.6870000000000001},"last":0.66700000000000004}]},{"osd":1,"last update":"Sat Jun 10 19:02:54 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.92600000000000005,"15min":0.92400000000000004},"min":{"1min":0.623,"5min":0.55100000000000005,"15min":0.53900000000000003},"max":{"1min":1.2350000000000001,"5min":1.262,"15min":1.377},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.97299999999999998,"15min":0.93999999999999995},"min":{"1min":0.68700000000000006,"5min":0.66300000000000003,"15min":0.504},"max":{"1min":1.161,"5min":1.234,"15min":1.5960000000000001},"last":0.57999999999999996}]},{"osd":2,"last update":"Sat Jun 10 19:02:54 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.85699999999999998,"15min":0.83999999999999997},"min":{"1min":0.57999999999999996,"5min":0.52100000000000002,"15min":0.47099999999999997},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.4059999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.91800000000000004,"15min":0.90300000000000002},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.50600000000000001},"max":{"1min":1.1839999999999999,"5min":1.448,"15min":1.448},"last":1.1240000000000001}]},{"osd":3,"last update":"Sat Jun 10 19:02:54 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.94399999999999995,"15min":0.92200000000000004},"min":{"1min":0.71199999999999997,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.2350000000000001,"5min":1.2370000000000001,"15min":1.502},"last":0.629},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.98999999999999999,"15min":0.94699999999999995},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.53800000000000003},"max":{"1min":1.276,"5min":1.284,"15min":1.2929999999999999},"last":1.0289999999999999}]},{"osd":4,"last update":"Sat Jun 10 19:02:54 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.82499999999999996,"15min":0.85399999999999998},"min":{"1min":0.58699999999999997,"5min":0.39500000000000002,"15min":0.32700000000000001},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.639},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.98499999999999999,"15min":0.97299999999999998},"min":{"1min":0.81999999999999995,"5min":0.434,"15min":0.40000000000000002},"max":{"1min":1.454,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.083}]},{"osd":5,"last update":"Sat Jun 10 19:02:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.002,"15min":1.014},"min":{"1min":0.70899999999999996,"5min":0.40500000000000003,"15min":0.38400000000000001},"max":{"1min":1.2809999999999999,"5min":1.395,"15min":1.806},"last":1.175},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.0489999999999999,"15min":1.042},"min":{"1min":0.745,"5min":0.505,"15min":0.46500000000000002},"max":{"1min":1.393,"5min":1.579,"15min":1.579},"last":0.94099999999999995}]},{"osd":6,"last update":"Sat Jun 10 19:02:54 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.0329999999999999,"15min":1.0089999999999999},"min":{"1min":0.73599999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.2909999999999999,"5min":1.391,"15min":1.718},"last":0.97799999999999998},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.1259999999999999,"15min":1.099},"min":{"1min":0.99399999999999999,"5min":0.48799999999999999,"15min":0.441},"max":{"1min":1.329,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":1.1539999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574987,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32340,"kb_used_data":1292,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339500,"statfs":{"total":96636764160,"available":96603648000,"internally_reserved":0,"allocated":1323008,"data_stored":606691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:02:46 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.873,"15min":0.84699999999999998},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.167,"5min":1.3129999999999999,"15min":1.498},"last":1.202},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.89400000000000002,"15min":0.86899999999999999},"min":{"1min":0.57199999999999995,"5min":0.46899999999999997,"15min":0.46100000000000002},"max":{"1min":1.167,"5min":1.496,"15min":1.496},"last":0.79500000000000004}]},{"osd":1,"last update":"Sat Jun 10 19:02:46 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.86499999999999999,"15min":0.86099999999999999},"min":{"1min":0.54900000000000004,"5min":0.502,"15min":0.48699999999999999},"max":{"1min":1.046,"5min":1.143,"15min":1.5229999999999999},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91700000000000004,"15min":0.88800000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.45300000000000001},"max":{"1min":1.258,"5min":1.258,"15min":1.778},"last":1.0209999999999999}]},{"osd":2,"last update":"Sat Jun 10 19:02:46 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.92500000000000004,"15min":0.88800000000000001},"min":{"1min":0.66200000000000003,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.2809999999999999,"5min":1.3240000000000001,"15min":1.3759999999999999},"last":0.87},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.89800000000000002,"15min":0.89000000000000001},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.22,"5min":1.2330000000000001,"15min":1.246},"last":1.0569999999999999}]},{"osd":3,"last update":"Sat Jun 10 19:02:46 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.93600000000000005,"15min":0.89700000000000002},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.52700000000000002},"max":{"1min":1.1659999999999999,"5min":1.222,"15min":1.7190000000000001},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.012,"5min":0.98999999999999999,"15min":0.99299999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.371,"5min":1.371,"15min":1.4370000000000001},"last":1.0920000000000001}]},{"osd":4,"last update":"Sat Jun 10 19:02:46 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.88500000000000001,"15min":0.92500000000000004},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.401,"5min":1.401,"15min":1.798},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.95499999999999996,"15min":0.99299999999999999},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.357,"5min":1.357,"15min":1.5489999999999999},"last":0.98599999999999999}]},{"osd":5,"last update":"Sat Jun 10 19:02:46 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.89700000000000002,"15min":0.93100000000000005},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.29,"5min":1.29,"15min":1.333},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.96599999999999997,"5min":1.0009999999999999,"15min":1.026},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.2230000000000001,"5min":1.2649999999999999,"15min":2.536},"last":0.90600000000000003}]},{"osd":7,"last update":"Sat Jun 10 19:02:46 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.0129999999999999,"15min":1.0329999999999999},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.57099999999999995},"max":{"1min":1.427,"5min":1.427,"15min":1.917},"last":1.1579999999999999},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.97899999999999998,"15min":1.028},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.5569999999999999},"last":0.84199999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574987,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32340,"kb_used_data":1292,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339500,"statfs":{"total":96636764160,"available":96603648000,"internally_reserved":0,"allocated":1323008,"data_stored":606691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.88400000000000001,"15min":0.86399999999999999},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.0800000000000001,"5min":1.2070000000000001,"15min":1.232},"last":1.02},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.93100000000000005,"15min":0.92000000000000004},"min":{"1min":0.70199999999999996,"5min":0.58999999999999997,"15min":0.49399999999999999},"max":{"1min":1.165,"5min":2.347,"15min":2.347},"last":0.94899999999999995}]},{"osd":1,"last update":"Sat Jun 10 19:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.95699999999999996,"15min":0.92000000000000004},"min":{"1min":0.63800000000000001,"5min":0.58799999999999997,"15min":0.52600000000000002},"max":{"1min":1.1599999999999999,"5min":7.0800000000000001,"15min":7.0800000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.94399999999999995,"5min":1.135,"15min":0.99099999999999999},"min":{"1min":0.58799999999999997,"5min":0.58399999999999996,"15min":0.53800000000000003},"max":{"1min":1.2689999999999999,"5min":15.845000000000001,"15min":15.845000000000001},"last":1.2689999999999999}]},{"osd":2,"last update":"Sat Jun 10 19:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.94099999999999995,"15min":0.88400000000000001},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.48299999999999998},"max":{"1min":1.319,"5min":5.0049999999999999,"15min":5.0049999999999999},"last":1.228},{"interface":"front","average":{"1min":0.89700000000000002,"5min":1.0109999999999999,"15min":0.94299999999999995},"min":{"1min":0.64900000000000002,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.0569999999999999,"5min":6.851,"15min":6.851},"last":0.78800000000000003}]},{"osd":3,"last update":"Sat Jun 10 19:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.96299999999999997,"15min":0.95299999999999996},"min":{"1min":0.71399999999999997,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.2010000000000001,"5min":2.544,"15min":2.544},"last":0.871},{"interface":"front","average":{"1min":0.95099999999999996,"5min":1.0109999999999999,"15min":1.008},"min":{"1min":0.68899999999999995,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.1739999999999999,"5min":3.0830000000000002,"15min":3.0830000000000002},"last":1.1559999999999999}]},{"osd":4,"last update":"Sat Jun 10 19:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.97799999999999998,"15min":0.96099999999999997},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.58099999999999996},"max":{"1min":1.2669999999999999,"5min":6.7290000000000001,"15min":6.7290000000000001},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.98299999999999998,"15min":1.014},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.61199999999999999},"max":{"1min":1.1200000000000001,"5min":1.341,"15min":1.575},"last":1.1200000000000001}]},{"osd":6,"last update":"Sat Jun 10 19:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.99099999999999999,"15min":1.0149999999999999},"min":{"1min":0.68100000000000005,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.232,"5min":1.3029999999999999,"15min":1.4330000000000001},"last":1.0680000000000001},{"interface":"front","average":{"1min":0.97699999999999998,"5min":1.105,"15min":1.0660000000000001},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.57899999999999996},"max":{"1min":1.194,"5min":6.923,"15min":6.923},"last":0.98499999999999999}]},{"osd":7,"last update":"Sat Jun 10 19:03:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.081,"15min":1.111},"min":{"1min":0.69899999999999995,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.2829999999999999,"5min":2.6080000000000001,"15min":2.6080000000000001},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.163,"15min":1.153},"min":{"1min":0.84499999999999997,"5min":0.67100000000000004,"15min":0.66200000000000003},"max":{"1min":1.365,"5min":5.4169999999999998,"15min":5.4169999999999998},"last":1.323}]}]},{"osd":4,"up_from":13,"seq":55834574986,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32328,"kb_used_data":1280,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339512,"statfs":{"total":96636764160,"available":96603660288,"internally_reserved":0,"allocated":1310720,"data_stored":600521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.88200000000000001,"15min":0.80900000000000005},"min":{"1min":0.52500000000000002,"5min":0.48599999999999999,"15min":0.45100000000000001},"max":{"1min":1.153,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.91100000000000003,"15min":0.90000000000000002},"min":{"1min":0.57099999999999995,"5min":0.49199999999999999,"15min":0.48899999999999999},"max":{"1min":1.202,"5min":1.288,"15min":3.7280000000000002},"last":0.82199999999999995}]},{"osd":1,"last update":"Sat Jun 10 19:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.92700000000000005,"15min":0.94399999999999995},"min":{"1min":0.62,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1970000000000001,"5min":1.254,"15min":3.3969999999999998},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.88300000000000001,"15min":0.85999999999999999},"min":{"1min":0.622,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.202,"5min":1.2110000000000001,"15min":2.496},"last":0.99399999999999999}]},{"osd":2,"last update":"Sat Jun 10 19:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.88900000000000001,"15min":0.88300000000000001},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.49299999999999999},"max":{"1min":1.236,"5min":1.3,"15min":1.522},"last":0.75},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.98799999999999999,"15min":0.998},"min":{"1min":0.73999999999999999,"5min":0.64400000000000002,"15min":0.55000000000000004},"max":{"1min":1.1719999999999999,"5min":1.2769999999999999,"15min":3.5750000000000002},"last":1.048}]},{"osd":3,"last update":"Sat Jun 10 19:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.92200000000000004,"15min":0.89800000000000002},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.53900000000000003},"max":{"1min":1.46,"5min":1.46,"15min":2.3809999999999998},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.97199999999999998,"15min":0.96299999999999997},"min":{"1min":0.63400000000000001,"5min":0.61499999999999999,"15min":0.54400000000000004},"max":{"1min":1.236,"5min":1.2370000000000001,"15min":1.6479999999999999},"last":0.91000000000000003}]},{"osd":5,"last update":"Sat Jun 10 19:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.92400000000000004,"15min":0.96899999999999997},"min":{"1min":0.65600000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.3260000000000001,"5min":1.3360000000000001,"15min":3.6539999999999999},"last":1.149},{"interface":"front","average":{"1min":0.873,"5min":0.91600000000000004,"15min":0.95699999999999996},"min":{"1min":0.624,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.26,"5min":1.3460000000000001,"15min":2.6720000000000002},"last":0.78400000000000003}]},{"osd":6,"last update":"Sat Jun 10 19:03:01 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":0.94499999999999995,"15min":0.98799999999999999},"min":{"1min":0.59699999999999998,"5min":0.58499999999999996,"15min":0.54900000000000004},"max":{"1min":1.21,"5min":1.3149999999999999,"15min":2.2639999999999998},"last":1.121},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.0329999999999999,"15min":1.0640000000000001},"min":{"1min":0.72799999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.3080000000000001,"5min":1.4059999999999999,"15min":3.4980000000000002},"last":1.2210000000000001}]},{"osd":7,"last update":"Sat Jun 10 19:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.98599999999999999,"15min":0.99299999999999999},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.41399999999999998},"max":{"1min":1.272,"5min":1.482,"15min":2.5910000000000002},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.077,"5min":1.0620000000000001,"15min":1.0680000000000001},"min":{"1min":0.76600000000000001,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.361,"5min":1.3740000000000001,"15min":1.4399999999999999},"last":1.194}]}]},{"osd":3,"up_from":13,"seq":55834574985,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32336,"kb_used_data":1288,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339504,"statfs":{"total":96636764160,"available":96603652096,"internally_reserved":0,"allocated":1318912,"data_stored":605672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.63700000000000001,"15min":0.60799999999999998},"min":{"1min":0.39900000000000002,"5min":0.28699999999999998,"15min":0.27900000000000003},"max":{"1min":0.79900000000000004,"5min":1.1539999999999999,"15min":1.169},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69499999999999995,"15min":0.66100000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.251},"max":{"1min":0.92400000000000004,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.36799999999999999}]},{"osd":1,"last update":"Sat Jun 10 19:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.68899999999999995,"15min":0.66700000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.27500000000000002},"max":{"1min":1.01,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.746,"15min":0.73599999999999999},"min":{"1min":0.439,"5min":0.373,"15min":0.318},"max":{"1min":1.0409999999999999,"5min":1.2569999999999999,"15min":1.411},"last":0.55300000000000005}]},{"osd":2,"last update":"Sat Jun 10 19:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.77900000000000003,"15min":0.77100000000000002},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.30299999999999999},"max":{"1min":1.2829999999999999,"5min":1.3899999999999999,"15min":1.9530000000000001},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80700000000000005,"15min":0.77700000000000002},"min":{"1min":0.46300000000000002,"5min":0.35299999999999998,"15min":0.29699999999999999},"max":{"1min":1.123,"5min":1.591,"15min":1.591},"last":0.65700000000000003}]},{"osd":4,"last update":"Sat Jun 10 19:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.97799999999999998,"15min":0.95899999999999996},"min":{"1min":0.623,"5min":0.623,"15min":0.41899999999999998},"max":{"1min":1.4239999999999999,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.995,"15min":0.98999999999999999},"min":{"1min":0.65600000000000003,"5min":0.61299999999999999,"15min":0.47999999999999998},"max":{"1min":1.3140000000000001,"5min":1.873,"15min":1.873},"last":0.68200000000000005}]},{"osd":5,"last update":"Sat Jun 10 19:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":1.0129999999999999,"15min":1.0249999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.5329999999999999,"5min":1.752,"15min":2.024},"last":0.60199999999999998},{"interface":"front","average":{"1min":1.026,"5min":1.0249999999999999,"15min":1.028},"min":{"1min":0.64400000000000002,"5min":0.60299999999999998,"15min":0.46899999999999997},"max":{"1min":1.5149999999999999,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.71299999999999997}]},{"osd":6,"last update":"Sat Jun 10 19:03:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.075,"15min":1.0620000000000001},"min":{"1min":0.63800000000000001,"5min":0.59299999999999997,"15min":0.55300000000000005},"max":{"1min":1.5620000000000001,"5min":1.786,"15min":1.8500000000000001},"last":0.79600000000000004},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.67900000000000005,"5min":0.61199999999999999,"15min":0.58799999999999997},"max":{"1min":1.3080000000000001,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.95299999999999996}]},{"osd":7,"last update":"Sat Jun 10 19:03:47 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.0900000000000001,"15min":1.1020000000000001},"min":{"1min":0.622,"5min":0.57999999999999996,"15min":0.56999999999999995},"max":{"1min":1.452,"5min":2.1150000000000002,"15min":2.1150000000000002},"last":0.90200000000000002},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.105,"15min":1.0940000000000001},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.61099999999999999},"max":{"1min":1.4630000000000001,"5min":1.9850000000000001,"15min":1.9850000000000001},"last":0.77000000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574986,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32340,"kb_used_data":1292,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339500,"statfs":{"total":96636764160,"available":96603648000,"internally_reserved":0,"allocated":1323008,"data_stored":606691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:02:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.627,"15min":0.60799999999999998},"min":{"1min":0.35199999999999998,"5min":0.31,"15min":0.27300000000000002},"max":{"1min":0.88200000000000001,"5min":1.095,"15min":1.1220000000000001},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.73699999999999999,"15min":0.72199999999999998},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.163,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.377}]},{"osd":1,"last update":"Sat Jun 10 19:02:52 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.67400000000000004,"15min":0.66400000000000003},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.94799999999999995,"5min":0.98299999999999998,"15min":1.1950000000000001},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.79500000000000004,"15min":0.74099999999999999},"min":{"1min":0.41999999999999998,"5min":0.36699999999999999,"15min":0.29499999999999998},"max":{"1min":1.2310000000000001,"5min":1.446,"15min":1.446},"last":0.34999999999999998}]},{"osd":3,"last update":"Sat Jun 10 19:02:52 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.80300000000000005,"15min":0.754},"min":{"1min":0.35599999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.133,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.80300000000000005,"15min":0.77300000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":1.181,"5min":1.181,"15min":1.3340000000000001},"last":0.44400000000000001}]},{"osd":4,"last update":"Sat Jun 10 19:02:52 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.94199999999999995,"15min":0.92600000000000005},"min":{"1min":0.68000000000000005,"5min":0.624,"15min":0.53400000000000003},"max":{"1min":1.258,"5min":1.258,"15min":1.3620000000000001},"last":0.52800000000000002},{"interface":"front","average":{"1min":1.044,"5min":1.0229999999999999,"15min":1.0269999999999999},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.57699999999999996},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.59299999999999997}]},{"osd":5,"last update":"Sat Jun 10 19:02:52 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.0209999999999999,"15min":1.0169999999999999},"min":{"1min":0.63300000000000001,"5min":0.61199999999999999,"15min":0.54100000000000004},"max":{"1min":1.337,"5min":1.5429999999999999,"15min":1.5700000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":1.052,"5min":1.02,"15min":1.0069999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.667},"last":0.74399999999999999}]},{"osd":6,"last update":"Sat Jun 10 19:02:52 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.0369999999999999,"15min":1.0429999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.391,"5min":1.4259999999999999,"15min":1.5900000000000001},"last":0.93000000000000005},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0600000000000001,"15min":1.046},"min":{"1min":0.624,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.486,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.83099999999999996}]},{"osd":7,"last update":"Sat Jun 10 19:02:52 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.117,"15min":1.103},"min":{"1min":0.64400000000000002,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.734,"5min":1.734,"15min":1.734},"last":0.73199999999999998},{"interface":"front","average":{"1min":1.21,"5min":1.125,"15min":1.107},"min":{"1min":0.64700000000000002,"5min":0.64100000000000001,"15min":0.59299999999999997},"max":{"1min":1.657,"5min":1.657,"15min":1.752},"last":0.78200000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574988,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32324,"kb_used_data":1276,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339516,"statfs":{"total":96636764160,"available":96603664384,"internally_reserved":0,"allocated":1306624,"data_stored":599502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:02:54 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.68999999999999995,"15min":0.67600000000000005},"min":{"1min":0.32100000000000001,"5min":0.28599999999999998,"15min":0.25800000000000001},"max":{"1min":1.026,"5min":1.119,"15min":1.288},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.76800000000000002,"15min":0.72699999999999998},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.694},"last":0.65700000000000003}]},{"osd":2,"last update":"Sat Jun 10 19:02:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.64000000000000001,"15min":0.63100000000000001},"min":{"1min":0.33100000000000002,"5min":0.308,"15min":0.249},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.21},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.629,"5min":0.74199999999999999,"15min":0.70199999999999996},"min":{"1min":0.32800000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.0629999999999999,"5min":1.194,"15min":1.415},"last":0.47299999999999998}]},{"osd":3,"last update":"Sat Jun 10 19:02:54 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.78600000000000003,"15min":0.77100000000000002},"min":{"1min":0.40200000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.0529999999999999,"5min":1.3049999999999999,"15min":1.6299999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.73999999999999999,"15min":0.74399999999999999},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.0409999999999999,"5min":1.2909999999999999,"15min":2.1749999999999998},"last":0.504}]},{"osd":4,"last update":"Sat Jun 10 19:02:54 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.86599999999999999,"15min":0.85399999999999998},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.53000000000000003},"max":{"1min":1.2070000000000001,"5min":1.343,"15min":1.4930000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.99199999999999999,"15min":1.048},"min":{"1min":0.47299999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.492,"5min":1.5129999999999999,"15min":5.8209999999999997},"last":1.05}]},{"osd":5,"last update":"Sat Jun 10 19:02:54 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.99099999999999999,"15min":1.0089999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.2709999999999999,"5min":1.6299999999999999,"15min":1.8620000000000001},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.97499999999999998,"15min":0.97799999999999998},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":3.089},"last":0.84099999999999997}]},{"osd":6,"last update":"Sat Jun 10 19:02:54 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":1.038,"15min":1.05},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.3640000000000001,"5min":1.6759999999999999,"15min":7.2599999999999998},"last":1.016},{"interface":"front","average":{"1min":0.93200000000000005,"5min":1.022,"15min":1.038},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":9.0069999999999997},"last":0.754}]},{"osd":7,"last update":"Sat Jun 10 19:02:54 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":1.0800000000000001,"15min":1.085},"min":{"1min":0.58799999999999997,"5min":0.495,"15min":0.495},"max":{"1min":1.431,"5min":1.573,"15min":2.105},"last":1.1160000000000001},{"interface":"front","average":{"1min":0.96699999999999997,"5min":1.087,"15min":1.081},"min":{"1min":0.60199999999999998,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.454,"5min":1.5620000000000001,"15min":2.2570000000000001},"last":1.0780000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574987,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32916,"kb_used_data":1868,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338924,"statfs":{"total":96636764160,"available":96603058176,"internally_reserved":0,"allocated":1912832,"data_stored":1196040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jun 10 19:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.65900000000000003,"15min":0.63},"min":{"1min":0.46300000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.98499999999999999,"5min":1.077,"15min":1.0780000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.82899999999999996,"15min":0.78800000000000003},"min":{"1min":0.49299999999999999,"5min":0.36299999999999999,"15min":0.34000000000000002},"max":{"1min":1.0309999999999999,"5min":1.2230000000000001,"15min":1.4059999999999999},"last":1.0289999999999999}]},{"osd":2,"last update":"Sat Jun 10 19:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.73299999999999998,"15min":0.71299999999999997},"min":{"1min":0.51100000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2829999999999999},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.67300000000000004,"15min":0.64800000000000002},"min":{"1min":0.46899999999999997,"5min":0.27600000000000002,"15min":0.245},"max":{"1min":0.83499999999999996,"5min":1.139,"15min":1.371},"last":0.60799999999999998}]},{"osd":3,"last update":"Sat Jun 10 19:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.38900000000000001,"5min":0.29499999999999998,"15min":0.28899999999999998},"max":{"1min":0.875,"5min":1.0860000000000001,"15min":1.226},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.871,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.42999999999999999,"5min":0.317,"15min":0.317},"max":{"1min":1.742,"5min":1.742,"15min":1.829},"last":0.85499999999999998}]},{"osd":4,"last update":"Sat Jun 10 19:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.92900000000000005,"15min":0.91600000000000004},"min":{"1min":0.72199999999999998,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.224,"5min":1.224,"15min":3.0209999999999999},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.0409999999999999,"15min":1.032},"min":{"1min":0.65300000000000002,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.8520000000000001,"5min":1.8520000000000001,"15min":1.9510000000000001},"last":1.1220000000000001}]},{"osd":5,"last update":"Sat Jun 10 19:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.93999999999999995,"15min":0.94599999999999995},"min":{"1min":0.67300000000000004,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.694},"last":0.80600000000000005},{"interface":"front","average":{"1min":1.044,"5min":1.012,"15min":1.0129999999999999},"min":{"1min":0.65200000000000002,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.78,"5min":1.78,"15min":4.5620000000000003},"last":0.998}]},{"osd":6,"last update":"Sat Jun 10 19:02:53 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.0800000000000001,"15min":1.0760000000000001},"min":{"1min":0.73899999999999999,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.5700000000000001,"5min":1.5980000000000001,"15min":3.5569999999999999},"last":1.083},{"interface":"front","average":{"1min":0.97499999999999998,"5min":1.004,"15min":1.0029999999999999},"min":{"1min":0.69699999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.883},"last":0.93300000000000005}]},{"osd":7,"last update":"Sat Jun 10 19:02:53 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.036,"15min":1.036},"min":{"1min":0.69199999999999995,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.512,"5min":1.512,"15min":1.5800000000000001},"last":1.056},{"interface":"front","average":{"1min":1.109,"5min":1.077,"15min":1.0609999999999999},"min":{"1min":0.78900000000000003,"5min":0.624,"15min":0.58699999999999997},"max":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.9830000000000001},"last":0.89600000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-10T19:03:51.881 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-10T19:03:52.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.041+0000 7f3780b60640 1 Processor -- start 2023-06-10T19:03:52.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.041+0000 7f3780b60640 1 -- start start 2023-06-10T19:03:52.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.041+0000 7f3780b60640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f377c15b870 0x7f377c06a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:52.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.041+0000 7f3780b60640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f377c06ae70 con 0x7f377c0b03f0 2023-06-10T19:03:52.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.041+0000 7f3780b60640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f377c0655c0 con 0x7f377c0affc0 2023-06-10T19:03:52.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.041+0000 7f3780b60640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f377c0cc110 con 0x7f377c15b870 2023-06-10T19:03:52.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.041+0000 7f377a59c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f377c15b870 0x7f377c06a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:52.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.041+0000 7f377ad9d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f377c0b03f0 0x7f377c069b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:59482/0 (socket says 172.21.15.53:59482) 2023-06-10T19:03:52.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.041+0000 7f377ad9d640 1 -- 172.21.15.53:0/3361681347 learned_addr learned my addr 172.21.15.53:0/3361681347 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:03:52.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.041+0000 7f377a59c640 1 -- 172.21.15.53:0/3361681347 >> v1:172.21.15.117:6789/0 conn(0x7f377c0affc0 legacy=0x7f377c069450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:52.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.041+0000 7f377a59c640 1 -- 172.21.15.53:0/3361681347 >> v1:172.21.15.53:6789/0 conn(0x7f377c0b03f0 legacy=0x7f377c069b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:52.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.041+0000 7f3779d9b640 1 -- 172.21.15.53:0/3361681347 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2887420568 0 0) 0x7f37740014a0 con 0x7f377c0b03f0 2023-06-10T19:03:52.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.041+0000 7f377a59c640 1 -- 172.21.15.53:0/3361681347 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f377c0cc3f0 con 0x7f377c15b870 2023-06-10T19:03:52.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.045+0000 7f377a59c640 1 --2- 172.21.15.53:0/3361681347 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f377c15b870 0x7f377c06a930 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f376c0097c0 tx=0x7f376c01c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b07d11a0042eba79 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:52.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.045+0000 7f3779d9b640 1 -- 172.21.15.53:0/3361681347 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376c0ad680 con 0x7f377c15b870 2023-06-10T19:03:52.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.045+0000 7f3779d9b640 1 -- 172.21.15.53:0/3361681347 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f376c0ad7e0 con 0x7f377c15b870 2023-06-10T19:03:52.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.045+0000 7f3779d9b640 1 -- 172.21.15.53:0/3361681347 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376c0adb70 con 0x7f377c15b870 2023-06-10T19:03:52.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.045+0000 7f3780b60640 1 -- 172.21.15.53:0/3361681347 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f377c15b870 msgr2=0x7f377c06a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:52.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.045+0000 7f3780b60640 1 --2- 172.21.15.53:0/3361681347 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f377c15b870 0x7f377c06a930 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f376c0097c0 tx=0x7f376c01c380 comp rx=0 tx=0).stop 2023-06-10T19:03:52.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.045+0000 7f3780b60640 1 -- 172.21.15.53:0/3361681347 shutdown_connections 2023-06-10T19:03:52.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.045+0000 7f3780b60640 1 --2- 172.21.15.53:0/3361681347 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f377c15b870 0x7f377c06a930 unknown :-1 s=CLOSED pgs=1728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:52.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.045+0000 7f3780b60640 1 -- 172.21.15.53:0/3361681347 >> 172.21.15.53:0/3361681347 conn(0x7f377c0cafc0 msgr2=0x7f377c0cb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:52.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.045+0000 7f3780b60640 1 -- 172.21.15.53:0/3361681347 shutdown_connections 2023-06-10T19:03:52.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.045+0000 7f3780b60640 1 -- 172.21.15.53:0/3361681347 wait complete. 2023-06-10T19:03:52.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.045+0000 7f3780b60640 1 Processor -- start 2023-06-10T19:03:52.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.045+0000 7f3780b60640 1 -- start start 2023-06-10T19:03:52.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.045+0000 7f3780b60640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f377c0affc0 0x7f377c159d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:52.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.045+0000 7f3780b60640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f377c0b03f0 0x7f377c0c7750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:52.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.045+0000 7f3780b60640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f377c15b870 0x7f377c154800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:52.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.045+0000 7f3780b60640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f377c0c24f0 con 0x7f377c0b03f0 2023-06-10T19:03:52.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.045+0000 7f3780b60640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f377c15a270 con 0x7f377c0affc0 2023-06-10T19:03:52.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.045+0000 7f3780b60640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f377c0c7c90 con 0x7f377c15b870 2023-06-10T19:03:52.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.049+0000 7f3773fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f377c0b03f0 0x7f377c0c7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:52.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.049+0000 7f3773fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f377c0b03f0 0x7f377c0c7750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:34988/0 (socket says 172.21.15.53:34988) 2023-06-10T19:03:52.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.049+0000 7f3773fff640 1 -- 172.21.15.53:0/2780018538 learned_addr learned my addr 172.21.15.53:0/2780018538 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:52.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.049+0000 7f377a59c640 1 --2- 172.21.15.53:0/2780018538 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f377c0affc0 0x7f377c159d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:52.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.049+0000 7f377ad9d640 1 --2- 172.21.15.53:0/2780018538 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f377c15b870 0x7f377c154800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:52.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.049+0000 7f3773fff640 1 -- 172.21.15.53:0/2780018538 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f377c15b870 msgr2=0x7f377c154800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:52.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.049+0000 7f3773fff640 1 --2- 172.21.15.53:0/2780018538 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f377c15b870 0x7f377c154800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:52.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.049+0000 7f3773fff640 1 -- 172.21.15.53:0/2780018538 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f377c0affc0 msgr2=0x7f377c159d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:52.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.049+0000 7f3773fff640 1 --2- 172.21.15.53:0/2780018538 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f377c0affc0 0x7f377c159d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:52.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.049+0000 7f3773fff640 1 -- 172.21.15.53:0/2780018538 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f376c009420 con 0x7f377c0b03f0 2023-06-10T19:03:52.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.049+0000 7f3773fff640 1 --2- 172.21.15.53:0/2780018538 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f377c0b03f0 0x7f377c0c7750 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7f376400b410 tx=0x7f376400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:52.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.049+0000 7f3772ffd640 1 -- 172.21.15.53:0/2780018538 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3764004020 con 0x7f377c0b03f0 2023-06-10T19:03:52.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.049+0000 7f3772ffd640 1 -- 172.21.15.53:0/2780018538 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3764004180 con 0x7f377c0b03f0 2023-06-10T19:03:52.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.049+0000 7f3780b60640 1 -- 172.21.15.53:0/2780018538 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f377c0c84a0 con 0x7f377c0b03f0 2023-06-10T19:03:52.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.049+0000 7f3772ffd640 1 -- 172.21.15.53:0/2780018538 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3764011630 con 0x7f377c0b03f0 2023-06-10T19:03:52.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.049+0000 7f3780b60640 1 -- 172.21.15.53:0/2780018538 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f377c0c81c0 con 0x7f377c0b03f0 2023-06-10T19:03:52.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.049+0000 7f3780b60640 1 -- 172.21.15.53:0/2780018538 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f377c04d790 con 0x7f377c0b03f0 2023-06-10T19:03:52.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.049+0000 7f3772ffd640 1 -- 172.21.15.53:0/2780018538 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3764011790 con 0x7f377c0b03f0 2023-06-10T19:03:52.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.049+0000 7f3772ffd640 1 --2- 172.21.15.53:0/2780018538 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f375c0662b0 0x7f375c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:52.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.049+0000 7f3772ffd640 1 -- 172.21.15.53:0/2780018538 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3764083a10 con 0x7f377c0b03f0 2023-06-10T19:03:52.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.049+0000 7f377a59c640 1 --2- 172.21.15.53:0/2780018538 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f375c0662b0 0x7f375c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:52.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.049+0000 7f377a59c640 1 --2- 172.21.15.53:0/2780018538 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f375c0662b0 0x7f375c068760 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f376c0af000 tx=0x7f376c0a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:52.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.053+0000 7f3772ffd640 1 -- 172.21.15.53:0/2780018538 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3764050e90 con 0x7f377c0b03f0 2023-06-10T19:03:52.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.205+0000 7f3780b60640 1 -- 172.21.15.53:0/2780018538 --> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f377c0cced0 con 0x7f375c0662b0 2023-06-10T19:03:52.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.229+0000 7f3772ffd640 1 -- 172.21.15.53:0/2780018538 <== mgr.4105 v2:172.21.15.117:6832/3061986771 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+298377 (secure 0 0 0) 0x7f376c0bd090 con 0x7f375c0662b0 2023-06-10T19:03:52.231 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:03:52.235 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-06-10T19:03:52.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.233+0000 7f3780b60640 1 -- 172.21.15.53:0/2780018538 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f375c0662b0 msgr2=0x7f375c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:52.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.233+0000 7f3780b60640 1 --2- 172.21.15.53:0/2780018538 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f375c0662b0 0x7f375c068760 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f376c0af000 tx=0x7f376c0a7000 comp rx=0 tx=0).stop 2023-06-10T19:03:52.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.233+0000 7f3780b60640 1 -- 172.21.15.53:0/2780018538 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f377c0b03f0 msgr2=0x7f377c0c7750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:52.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.233+0000 7f3780b60640 1 --2- 172.21.15.53:0/2780018538 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f377c0b03f0 0x7f377c0c7750 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7f376400b410 tx=0x7f376400b8d0 comp rx=0 tx=0).stop 2023-06-10T19:03:52.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.233+0000 7f3780b60640 1 -- 172.21.15.53:0/2780018538 shutdown_connections 2023-06-10T19:03:52.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.233+0000 7f3780b60640 1 --2- 172.21.15.53:0/2780018538 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f375c0662b0 0x7f375c068760 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:52.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.233+0000 7f3780b60640 1 --2- 172.21.15.53:0/2780018538 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f377c15b870 0x7f377c154800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:52.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.233+0000 7f3780b60640 1 --2- 172.21.15.53:0/2780018538 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f377c0b03f0 0x7f377c0c7750 unknown :-1 s=CLOSED pgs=1729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:52.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.233+0000 7f3780b60640 1 --2- 172.21.15.53:0/2780018538 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f377c0affc0 0x7f377c159d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:52.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.233+0000 7f3780b60640 1 -- 172.21.15.53:0/2780018538 >> 172.21.15.53:0/2780018538 conn(0x7f377c0cafc0 msgr2=0x7f377c0b2840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:52.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.233+0000 7f3780b60640 1 -- 172.21.15.53:0/2780018538 shutdown_connections 2023-06-10T19:03:52.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.233+0000 7f3780b60640 1 -- 172.21.15.53:0/2780018538 wait complete. 2023-06-10T19:03:52.255 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":443,"stamp":"2023-06-10T19:03:51.801430+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":29,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":259832,"kb_used_data":11448,"kb_used_omap":0,"kb_used_meta":248320,"kb_avail":754714888,"statfs":{"total":773094113280,"available":772828045312,"internally_reserved":0,"allocated":11722752,"data_stored":6012697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":254279680},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.774191"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.039078+0000","last_change":"2023-06-10T19:03:47.039078+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.039078+0000","last_undegraded":"2023-06-10T19:03:47.039078+0000","last_fullsized":"2023-06-10T19:03:47.039078+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.043540+0000","last_change":"2023-06-10T19:03:47.043540+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.043540+0000","last_undegraded":"2023-06-10T19:03:47.043540+0000","last_fullsized":"2023-06-10T19:03:47.043540+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.029988+0000","last_change":"2023-06-10T19:03:47.029988+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.029988+0000","last_undegraded":"2023-06-10T19:03:47.029988+0000","last_fullsized":"2023-06-10T19:03:47.029988+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.040924+0000","last_change":"2023-06-10T19:03:47.040924+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.040924+0000","last_undegraded":"2023-06-10T19:03:47.040924+0000","last_fullsized":"2023-06-10T19:03:47.040924+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.043064+0000","last_change":"2023-06-10T19:03:47.043064+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.043064+0000","last_undegraded":"2023-06-10T19:03:47.043064+0000","last_fullsized":"2023-06-10T19:03:47.043064+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.032572+0000","last_change":"2023-06-10T19:03:47.032572+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.032572+0000","last_undegraded":"2023-06-10T19:03:47.032572+0000","last_fullsized":"2023-06-10T19:03:47.032572+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.029778+0000","last_change":"2023-06-10T19:03:47.029778+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.029778+0000","last_undegraded":"2023-06-10T19:03:47.029778+0000","last_fullsized":"2023-06-10T19:03:47.029778+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.039108+0000","last_change":"2023-06-10T19:03:47.039108+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.039108+0000","last_undegraded":"2023-06-10T19:03:47.039108+0000","last_fullsized":"2023-06-10T19:03:47.039108+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.031636+0000","last_change":"2023-06-10T19:03:47.031636+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.031636+0000","last_undegraded":"2023-06-10T19:03:47.031636+0000","last_fullsized":"2023-06-10T19:03:47.031636+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.032280+0000","last_change":"2023-06-10T19:03:47.032280+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.032280+0000","last_undegraded":"2023-06-10T19:03:47.032280+0000","last_fullsized":"2023-06-10T19:03:47.032280+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.044181+0000","last_change":"2023-06-10T19:03:47.044181+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.044181+0000","last_undegraded":"2023-06-10T19:03:47.044181+0000","last_fullsized":"2023-06-10T19:03:47.044181+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.037025+0000","last_change":"2023-06-10T19:03:47.037025+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.037025+0000","last_undegraded":"2023-06-10T19:03:47.037025+0000","last_fullsized":"2023-06-10T19:03:47.037025+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.040771+0000","last_change":"2023-06-10T19:03:47.040771+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.040771+0000","last_undegraded":"2023-06-10T19:03:47.040771+0000","last_fullsized":"2023-06-10T19:03:47.040771+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.039179+0000","last_change":"2023-06-10T19:03:47.039179+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.039179+0000","last_undegraded":"2023-06-10T19:03:47.039179+0000","last_fullsized":"2023-06-10T19:03:47.039179+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.043519+0000","last_change":"2023-06-10T19:03:47.043519+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.043519+0000","last_undegraded":"2023-06-10T19:03:47.043519+0000","last_fullsized":"2023-06-10T19:03:47.043519+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.029942+0000","last_change":"2023-06-10T19:03:47.029942+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.029942+0000","last_undegraded":"2023-06-10T19:03:47.029942+0000","last_fullsized":"2023-06-10T19:03:47.029942+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.041570+0000","last_change":"2023-06-10T19:03:47.041570+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.041570+0000","last_undegraded":"2023-06-10T19:03:47.041570+0000","last_fullsized":"2023-06-10T19:03:47.041570+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.031554+0000","last_change":"2023-06-10T19:03:47.031554+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.031554+0000","last_undegraded":"2023-06-10T19:03:47.031554+0000","last_fullsized":"2023-06-10T19:03:47.031554+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.037091+0000","last_change":"2023-06-10T19:03:47.037091+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.037091+0000","last_undegraded":"2023-06-10T19:03:47.037091+0000","last_fullsized":"2023-06-10T19:03:47.037091+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.041468+0000","last_change":"2023-06-10T19:03:47.041468+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.041468+0000","last_undegraded":"2023-06-10T19:03:47.041468+0000","last_fullsized":"2023-06-10T19:03:47.041468+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.029967+0000","last_change":"2023-06-10T19:03:47.029967+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.029967+0000","last_undegraded":"2023-06-10T19:03:47.029967+0000","last_fullsized":"2023-06-10T19:03:47.029967+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.043508+0000","last_change":"2023-06-10T19:03:47.043508+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.043508+0000","last_undegraded":"2023-06-10T19:03:47.043508+0000","last_fullsized":"2023-06-10T19:03:47.043508+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.036902+0000","last_change":"2023-06-10T19:03:47.036902+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.036902+0000","last_undegraded":"2023-06-10T19:03:47.036902+0000","last_fullsized":"2023-06-10T19:03:47.036902+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.043502+0000","last_change":"2023-06-10T19:03:47.043502+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.043502+0000","last_undegraded":"2023-06-10T19:03:47.043502+0000","last_fullsized":"2023-06-10T19:03:47.043502+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.044354+0000","last_change":"2023-06-10T19:03:47.044354+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.044354+0000","last_undegraded":"2023-06-10T19:03:47.044354+0000","last_fullsized":"2023-06-10T19:03:47.044354+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":324,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-06-10T19:03:47.045429+0000","last_change":"2023-06-10T18:52:34.951528+0000","last_active":"2023-06-10T19:03:47.045429+0000","last_peered":"2023-06-10T19:03:47.045429+0000","last_clean":"2023-06-10T19:03:47.045429+0000","last_became_active":"2023-06-10T18:52:34.949099+0000","last_became_peered":"2023-06-10T18:52:34.949099+0000","last_unstale":"2023-06-10T19:03:47.045429+0000","last_undegraded":"2023-06-10T19:03:47.045429+0000","last_fullsized":"2023-06-10T19:03:47.045429+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_clean_scrub_stamp":"2023-06-10T18:52:33.633295+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:00:35.924767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":176,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-06-10T19:03:47.033648+0000","last_change":"2023-06-10T18:52:40.506384+0000","last_active":"2023-06-10T19:03:47.033648+0000","last_peered":"2023-06-10T19:03:47.033648+0000","last_clean":"2023-06-10T19:03:47.033648+0000","last_became_active":"2023-06-10T18:52:40.505701+0000","last_became_peered":"2023-06-10T18:52:40.505701+0000","last_unstale":"2023-06-10T19:03:47.033648+0000","last_undegraded":"2023-06-10T19:03:47.033648+0000","last_fullsized":"2023-06-10T19:03:47.033648+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:05:06.232347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.043040+0000","last_change":"2023-06-10T19:03:47.043040+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.043040+0000","last_undegraded":"2023-06-10T19:03:47.043040+0000","last_fullsized":"2023-06-10T19:03:47.043040+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":168,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-06-10T19:03:47.045062+0000","last_change":"2023-06-10T18:52:40.512015+0000","last_active":"2023-06-10T19:03:47.045062+0000","last_peered":"2023-06-10T19:03:47.045062+0000","last_clean":"2023-06-10T19:03:47.045062+0000","last_became_active":"2023-06-10T18:52:40.511382+0000","last_became_peered":"2023-06-10T18:52:40.511382+0000","last_unstale":"2023-06-10T19:03:47.045062+0000","last_undegraded":"2023-06-10T19:03:47.045062+0000","last_fullsized":"2023-06-10T19:03:47.045062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:22:14.438906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.032337+0000","last_change":"2023-06-10T19:03:47.032337+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.032337+0000","last_undegraded":"2023-06-10T19:03:47.032337+0000","last_fullsized":"2023-06-10T19:03:47.032337+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":174,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-06-10T19:03:47.046617+0000","last_change":"2023-06-10T18:52:40.671725+0000","last_active":"2023-06-10T19:03:47.046617+0000","last_peered":"2023-06-10T19:03:47.046617+0000","last_clean":"2023-06-10T19:03:47.046617+0000","last_became_active":"2023-06-10T18:52:40.671442+0000","last_became_peered":"2023-06-10T18:52:40.671442+0000","last_unstale":"2023-06-10T19:03:47.046617+0000","last_undegraded":"2023-06-10T19:03:47.046617+0000","last_fullsized":"2023-06-10T19:03:47.046617+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:29:58.957321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.037047+0000","last_change":"2023-06-10T19:03:47.037047+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.037047+0000","last_undegraded":"2023-06-10T19:03:47.037047+0000","last_fullsized":"2023-06-10T19:03:47.037047+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":176,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-06-10T19:03:47.033990+0000","last_change":"2023-06-10T18:52:40.510258+0000","last_active":"2023-06-10T19:03:47.033990+0000","last_peered":"2023-06-10T19:03:47.033990+0000","last_clean":"2023-06-10T19:03:47.033990+0000","last_became_active":"2023-06-10T18:52:40.509560+0000","last_became_peered":"2023-06-10T18:52:40.509560+0000","last_unstale":"2023-06-10T19:03:47.033990+0000","last_undegraded":"2023-06-10T19:03:47.033990+0000","last_fullsized":"2023-06-10T19:03:47.033990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:17:30.476535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.038249+0000","last_change":"2023-06-10T19:03:47.038249+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.038249+0000","last_undegraded":"2023-06-10T19:03:47.038249+0000","last_fullsized":"2023-06-10T19:03:47.038249+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":162,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-06-10T19:03:47.042725+0000","last_change":"2023-06-10T18:52:40.672266+0000","last_active":"2023-06-10T19:03:47.042725+0000","last_peered":"2023-06-10T19:03:47.042725+0000","last_clean":"2023-06-10T19:03:47.042725+0000","last_became_active":"2023-06-10T18:52:40.671966+0000","last_became_peered":"2023-06-10T18:52:40.671966+0000","last_unstale":"2023-06-10T19:03:47.042725+0000","last_undegraded":"2023-06-10T19:03:47.042725+0000","last_fullsized":"2023-06-10T19:03:47.042725+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:56:43.883781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.044311+0000","last_change":"2023-06-10T19:03:47.044311+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.044311+0000","last_undegraded":"2023-06-10T19:03:47.044311+0000","last_fullsized":"2023-06-10T19:03:47.044311+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":168,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-06-10T19:03:47.045328+0000","last_change":"2023-06-10T18:52:40.671084+0000","last_active":"2023-06-10T19:03:47.045328+0000","last_peered":"2023-06-10T19:03:47.045328+0000","last_clean":"2023-06-10T19:03:47.045328+0000","last_became_active":"2023-06-10T18:52:40.670697+0000","last_became_peered":"2023-06-10T18:52:40.670697+0000","last_unstale":"2023-06-10T19:03:47.045328+0000","last_undegraded":"2023-06-10T19:03:47.045328+0000","last_fullsized":"2023-06-10T19:03:47.045328+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:33:42.833010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.043408+0000","last_change":"2023-06-10T19:03:47.043408+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.043408+0000","last_undegraded":"2023-06-10T19:03:47.043408+0000","last_fullsized":"2023-06-10T19:03:47.043408+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":162,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-06-10T19:03:47.042650+0000","last_change":"2023-06-10T18:52:40.514114+0000","last_active":"2023-06-10T19:03:47.042650+0000","last_peered":"2023-06-10T19:03:47.042650+0000","last_clean":"2023-06-10T19:03:47.042650+0000","last_became_active":"2023-06-10T18:52:40.513638+0000","last_became_peered":"2023-06-10T18:52:40.513638+0000","last_unstale":"2023-06-10T19:03:47.042650+0000","last_undegraded":"2023-06-10T19:03:47.042650+0000","last_fullsized":"2023-06-10T19:03:47.042650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:50:41.193183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.046167+0000","last_change":"2023-06-10T19:03:47.046167+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.046167+0000","last_undegraded":"2023-06-10T19:03:47.046167+0000","last_fullsized":"2023-06-10T19:03:47.046167+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":168,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-06-10T19:03:47.039351+0000","last_change":"2023-06-10T18:52:40.515396+0000","last_active":"2023-06-10T19:03:47.039351+0000","last_peered":"2023-06-10T19:03:47.039351+0000","last_clean":"2023-06-10T19:03:47.039351+0000","last_became_active":"2023-06-10T18:52:40.514663+0000","last_became_peered":"2023-06-10T18:52:40.514663+0000","last_unstale":"2023-06-10T19:03:47.039351+0000","last_undegraded":"2023-06-10T19:03:47.039351+0000","last_fullsized":"2023-06-10T19:03:47.039351+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:33:27.036737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574986,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32908,"kb_used_data":1860,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338932,"statfs":{"total":96636764160,"available":96603066368,"internally_reserved":0,"allocated":1904640,"data_stored":1190889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:02:54 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.95199999999999996,"15min":0.91000000000000003},"min":{"1min":0.64700000000000002,"5min":0.54700000000000004,"15min":0.434},"max":{"1min":1.198,"5min":1.327,"15min":1.6220000000000001},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.93899999999999995,"15min":0.92900000000000005},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.496},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.6870000000000001},"last":0.66700000000000004}]},{"osd":1,"last update":"Sat Jun 10 19:02:54 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.92600000000000005,"15min":0.92400000000000004},"min":{"1min":0.623,"5min":0.55100000000000005,"15min":0.53900000000000003},"max":{"1min":1.2350000000000001,"5min":1.262,"15min":1.377},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.97299999999999998,"15min":0.93999999999999995},"min":{"1min":0.68700000000000006,"5min":0.66300000000000003,"15min":0.504},"max":{"1min":1.161,"5min":1.234,"15min":1.5960000000000001},"last":0.57999999999999996}]},{"osd":2,"last update":"Sat Jun 10 19:02:54 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.85699999999999998,"15min":0.83999999999999997},"min":{"1min":0.57999999999999996,"5min":0.52100000000000002,"15min":0.47099999999999997},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.4059999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.91800000000000004,"15min":0.90300000000000002},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.50600000000000001},"max":{"1min":1.1839999999999999,"5min":1.448,"15min":1.448},"last":1.1240000000000001}]},{"osd":3,"last update":"Sat Jun 10 19:02:54 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.94399999999999995,"15min":0.92200000000000004},"min":{"1min":0.71199999999999997,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.2350000000000001,"5min":1.2370000000000001,"15min":1.502},"last":0.629},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.98999999999999999,"15min":0.94699999999999995},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.53800000000000003},"max":{"1min":1.276,"5min":1.284,"15min":1.2929999999999999},"last":1.0289999999999999}]},{"osd":4,"last update":"Sat Jun 10 19:02:54 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.82499999999999996,"15min":0.85399999999999998},"min":{"1min":0.58699999999999997,"5min":0.39500000000000002,"15min":0.32700000000000001},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.639},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.98499999999999999,"15min":0.97299999999999998},"min":{"1min":0.81999999999999995,"5min":0.434,"15min":0.40000000000000002},"max":{"1min":1.454,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.083}]},{"osd":5,"last update":"Sat Jun 10 19:02:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.002,"15min":1.014},"min":{"1min":0.70899999999999996,"5min":0.40500000000000003,"15min":0.38400000000000001},"max":{"1min":1.2809999999999999,"5min":1.395,"15min":1.806},"last":1.175},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.0489999999999999,"15min":1.042},"min":{"1min":0.745,"5min":0.505,"15min":0.46500000000000002},"max":{"1min":1.393,"5min":1.579,"15min":1.579},"last":0.94099999999999995}]},{"osd":6,"last update":"Sat Jun 10 19:02:54 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.0329999999999999,"15min":1.0089999999999999},"min":{"1min":0.73599999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.2909999999999999,"5min":1.391,"15min":1.718},"last":0.97799999999999998},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.1259999999999999,"15min":1.099},"min":{"1min":0.99399999999999999,"5min":0.48799999999999999,"15min":0.441},"max":{"1min":1.329,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":1.1539999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574987,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32340,"kb_used_data":1292,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339500,"statfs":{"total":96636764160,"available":96603648000,"internally_reserved":0,"allocated":1323008,"data_stored":606691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:02:46 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.873,"15min":0.84699999999999998},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.167,"5min":1.3129999999999999,"15min":1.498},"last":1.202},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.89400000000000002,"15min":0.86899999999999999},"min":{"1min":0.57199999999999995,"5min":0.46899999999999997,"15min":0.46100000000000002},"max":{"1min":1.167,"5min":1.496,"15min":1.496},"last":0.79500000000000004}]},{"osd":1,"last update":"Sat Jun 10 19:02:46 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.86499999999999999,"15min":0.86099999999999999},"min":{"1min":0.54900000000000004,"5min":0.502,"15min":0.48699999999999999},"max":{"1min":1.046,"5min":1.143,"15min":1.5229999999999999},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91700000000000004,"15min":0.88800000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.45300000000000001},"max":{"1min":1.258,"5min":1.258,"15min":1.778},"last":1.0209999999999999}]},{"osd":2,"last update":"Sat Jun 10 19:02:46 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.92500000000000004,"15min":0.88800000000000001},"min":{"1min":0.66200000000000003,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.2809999999999999,"5min":1.3240000000000001,"15min":1.3759999999999999},"last":0.87},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.89800000000000002,"15min":0.89000000000000001},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.22,"5min":1.2330000000000001,"15min":1.246},"last":1.0569999999999999}]},{"osd":3,"last update":"Sat Jun 10 19:02:46 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.93600000000000005,"15min":0.89700000000000002},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.52700000000000002},"max":{"1min":1.1659999999999999,"5min":1.222,"15min":1.7190000000000001},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.012,"5min":0.98999999999999999,"15min":0.99299999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.371,"5min":1.371,"15min":1.4370000000000001},"last":1.0920000000000001}]},{"osd":4,"last update":"Sat Jun 10 19:02:46 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.88500000000000001,"15min":0.92500000000000004},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.401,"5min":1.401,"15min":1.798},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.95499999999999996,"15min":0.99299999999999999},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.357,"5min":1.357,"15min":1.5489999999999999},"last":0.98599999999999999}]},{"osd":5,"last update":"Sat Jun 10 19:02:46 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.89700000000000002,"15min":0.93100000000000005},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.29,"5min":1.29,"15min":1.333},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.96599999999999997,"5min":1.0009999999999999,"15min":1.026},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.2230000000000001,"5min":1.2649999999999999,"15min":2.536},"last":0.90600000000000003}]},{"osd":7,"last update":"Sat Jun 10 19:02:46 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.0129999999999999,"15min":1.0329999999999999},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.57099999999999995},"max":{"1min":1.427,"5min":1.427,"15min":1.917},"last":1.1579999999999999},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.97899999999999998,"15min":1.028},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.5569999999999999},"last":0.84199999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574987,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32340,"kb_used_data":1292,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339500,"statfs":{"total":96636764160,"available":96603648000,"internally_reserved":0,"allocated":1323008,"data_stored":606691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.88400000000000001,"15min":0.86399999999999999},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.0800000000000001,"5min":1.2070000000000001,"15min":1.232},"last":1.02},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.93100000000000005,"15min":0.92000000000000004},"min":{"1min":0.70199999999999996,"5min":0.58999999999999997,"15min":0.49399999999999999},"max":{"1min":1.165,"5min":2.347,"15min":2.347},"last":0.94899999999999995}]},{"osd":1,"last update":"Sat Jun 10 19:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.95699999999999996,"15min":0.92000000000000004},"min":{"1min":0.63800000000000001,"5min":0.58799999999999997,"15min":0.52600000000000002},"max":{"1min":1.1599999999999999,"5min":7.0800000000000001,"15min":7.0800000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.94399999999999995,"5min":1.135,"15min":0.99099999999999999},"min":{"1min":0.58799999999999997,"5min":0.58399999999999996,"15min":0.53800000000000003},"max":{"1min":1.2689999999999999,"5min":15.845000000000001,"15min":15.845000000000001},"last":1.2689999999999999}]},{"osd":2,"last update":"Sat Jun 10 19:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.94099999999999995,"15min":0.88400000000000001},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.48299999999999998},"max":{"1min":1.319,"5min":5.0049999999999999,"15min":5.0049999999999999},"last":1.228},{"interface":"front","average":{"1min":0.89700000000000002,"5min":1.0109999999999999,"15min":0.94299999999999995},"min":{"1min":0.64900000000000002,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.0569999999999999,"5min":6.851,"15min":6.851},"last":0.78800000000000003}]},{"osd":3,"last update":"Sat Jun 10 19:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.96299999999999997,"15min":0.95299999999999996},"min":{"1min":0.71399999999999997,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.2010000000000001,"5min":2.544,"15min":2.544},"last":0.871},{"interface":"front","average":{"1min":0.95099999999999996,"5min":1.0109999999999999,"15min":1.008},"min":{"1min":0.68899999999999995,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.1739999999999999,"5min":3.0830000000000002,"15min":3.0830000000000002},"last":1.1559999999999999}]},{"osd":4,"last update":"Sat Jun 10 19:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.97799999999999998,"15min":0.96099999999999997},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.58099999999999996},"max":{"1min":1.2669999999999999,"5min":6.7290000000000001,"15min":6.7290000000000001},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.98299999999999998,"15min":1.014},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.61199999999999999},"max":{"1min":1.1200000000000001,"5min":1.341,"15min":1.575},"last":1.1200000000000001}]},{"osd":6,"last update":"Sat Jun 10 19:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.99099999999999999,"15min":1.0149999999999999},"min":{"1min":0.68100000000000005,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.232,"5min":1.3029999999999999,"15min":1.4330000000000001},"last":1.0680000000000001},{"interface":"front","average":{"1min":0.97699999999999998,"5min":1.105,"15min":1.0660000000000001},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.57899999999999996},"max":{"1min":1.194,"5min":6.923,"15min":6.923},"last":0.98499999999999999}]},{"osd":7,"last update":"Sat Jun 10 19:03:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.081,"15min":1.111},"min":{"1min":0.69899999999999995,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.2829999999999999,"5min":2.6080000000000001,"15min":2.6080000000000001},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.163,"15min":1.153},"min":{"1min":0.84499999999999997,"5min":0.67100000000000004,"15min":0.66200000000000003},"max":{"1min":1.365,"5min":5.4169999999999998,"15min":5.4169999999999998},"last":1.323}]}]},{"osd":4,"up_from":13,"seq":55834574986,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32328,"kb_used_data":1280,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339512,"statfs":{"total":96636764160,"available":96603660288,"internally_reserved":0,"allocated":1310720,"data_stored":600521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.88200000000000001,"15min":0.80900000000000005},"min":{"1min":0.52500000000000002,"5min":0.48599999999999999,"15min":0.45100000000000001},"max":{"1min":1.153,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.91100000000000003,"15min":0.90000000000000002},"min":{"1min":0.57099999999999995,"5min":0.49199999999999999,"15min":0.48899999999999999},"max":{"1min":1.202,"5min":1.288,"15min":3.7280000000000002},"last":0.82199999999999995}]},{"osd":1,"last update":"Sat Jun 10 19:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.92700000000000005,"15min":0.94399999999999995},"min":{"1min":0.62,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1970000000000001,"5min":1.254,"15min":3.3969999999999998},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.88300000000000001,"15min":0.85999999999999999},"min":{"1min":0.622,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.202,"5min":1.2110000000000001,"15min":2.496},"last":0.99399999999999999}]},{"osd":2,"last update":"Sat Jun 10 19:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.88900000000000001,"15min":0.88300000000000001},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.49299999999999999},"max":{"1min":1.236,"5min":1.3,"15min":1.522},"last":0.75},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.98799999999999999,"15min":0.998},"min":{"1min":0.73999999999999999,"5min":0.64400000000000002,"15min":0.55000000000000004},"max":{"1min":1.1719999999999999,"5min":1.2769999999999999,"15min":3.5750000000000002},"last":1.048}]},{"osd":3,"last update":"Sat Jun 10 19:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.92200000000000004,"15min":0.89800000000000002},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.53900000000000003},"max":{"1min":1.46,"5min":1.46,"15min":2.3809999999999998},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.97199999999999998,"15min":0.96299999999999997},"min":{"1min":0.63400000000000001,"5min":0.61499999999999999,"15min":0.54400000000000004},"max":{"1min":1.236,"5min":1.2370000000000001,"15min":1.6479999999999999},"last":0.91000000000000003}]},{"osd":5,"last update":"Sat Jun 10 19:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.92400000000000004,"15min":0.96899999999999997},"min":{"1min":0.65600000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.3260000000000001,"5min":1.3360000000000001,"15min":3.6539999999999999},"last":1.149},{"interface":"front","average":{"1min":0.873,"5min":0.91600000000000004,"15min":0.95699999999999996},"min":{"1min":0.624,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.26,"5min":1.3460000000000001,"15min":2.6720000000000002},"last":0.78400000000000003}]},{"osd":6,"last update":"Sat Jun 10 19:03:01 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":0.94499999999999995,"15min":0.98799999999999999},"min":{"1min":0.59699999999999998,"5min":0.58499999999999996,"15min":0.54900000000000004},"max":{"1min":1.21,"5min":1.3149999999999999,"15min":2.2639999999999998},"last":1.121},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.0329999999999999,"15min":1.0640000000000001},"min":{"1min":0.72799999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.3080000000000001,"5min":1.4059999999999999,"15min":3.4980000000000002},"last":1.2210000000000001}]},{"osd":7,"last update":"Sat Jun 10 19:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.98599999999999999,"15min":0.99299999999999999},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.41399999999999998},"max":{"1min":1.272,"5min":1.482,"15min":2.5910000000000002},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.077,"5min":1.0620000000000001,"15min":1.0680000000000001},"min":{"1min":0.76600000000000001,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.361,"5min":1.3740000000000001,"15min":1.4399999999999999},"last":1.194}]}]},{"osd":3,"up_from":13,"seq":55834574985,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32336,"kb_used_data":1288,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339504,"statfs":{"total":96636764160,"available":96603652096,"internally_reserved":0,"allocated":1318912,"data_stored":605672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.63700000000000001,"15min":0.60799999999999998},"min":{"1min":0.39900000000000002,"5min":0.28699999999999998,"15min":0.27900000000000003},"max":{"1min":0.79900000000000004,"5min":1.1539999999999999,"15min":1.169},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69499999999999995,"15min":0.66100000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.251},"max":{"1min":0.92400000000000004,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.36799999999999999}]},{"osd":1,"last update":"Sat Jun 10 19:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.68899999999999995,"15min":0.66700000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.27500000000000002},"max":{"1min":1.01,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.746,"15min":0.73599999999999999},"min":{"1min":0.439,"5min":0.373,"15min":0.318},"max":{"1min":1.0409999999999999,"5min":1.2569999999999999,"15min":1.411},"last":0.55300000000000005}]},{"osd":2,"last update":"Sat Jun 10 19:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.77900000000000003,"15min":0.77100000000000002},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.30299999999999999},"max":{"1min":1.2829999999999999,"5min":1.3899999999999999,"15min":1.9530000000000001},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80700000000000005,"15min":0.77700000000000002},"min":{"1min":0.46300000000000002,"5min":0.35299999999999998,"15min":0.29699999999999999},"max":{"1min":1.123,"5min":1.591,"15min":1.591},"last":0.65700000000000003}]},{"osd":4,"last update":"Sat Jun 10 19:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.97799999999999998,"15min":0.95899999999999996},"min":{"1min":0.623,"5min":0.623,"15min":0.41899999999999998},"max":{"1min":1.4239999999999999,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.995,"15min":0.98999999999999999},"min":{"1min":0.65600000000000003,"5min":0.61299999999999999,"15min":0.47999999999999998},"max":{"1min":1.3140000000000001,"5min":1.873,"15min":1.873},"last":0.68200000000000005}]},{"osd":5,"last update":"Sat Jun 10 19:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":1.0129999999999999,"15min":1.0249999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.5329999999999999,"5min":1.752,"15min":2.024},"last":0.60199999999999998},{"interface":"front","average":{"1min":1.026,"5min":1.0249999999999999,"15min":1.028},"min":{"1min":0.64400000000000002,"5min":0.60299999999999998,"15min":0.46899999999999997},"max":{"1min":1.5149999999999999,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.71299999999999997}]},{"osd":6,"last update":"Sat Jun 10 19:03:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.075,"15min":1.0620000000000001},"min":{"1min":0.63800000000000001,"5min":0.59299999999999997,"15min":0.55300000000000005},"max":{"1min":1.5620000000000001,"5min":1.786,"15min":1.8500000000000001},"last":0.79600000000000004},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.67900000000000005,"5min":0.61199999999999999,"15min":0.58799999999999997},"max":{"1min":1.3080000000000001,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.95299999999999996}]},{"osd":7,"last update":"Sat Jun 10 19:03:47 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.0900000000000001,"15min":1.1020000000000001},"min":{"1min":0.622,"5min":0.57999999999999996,"15min":0.56999999999999995},"max":{"1min":1.452,"5min":2.1150000000000002,"15min":2.1150000000000002},"last":0.90200000000000002},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.105,"15min":1.0940000000000001},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.61099999999999999},"max":{"1min":1.4630000000000001,"5min":1.9850000000000001,"15min":1.9850000000000001},"last":0.77000000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574986,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32340,"kb_used_data":1292,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339500,"statfs":{"total":96636764160,"available":96603648000,"internally_reserved":0,"allocated":1323008,"data_stored":606691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:02:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.627,"15min":0.60799999999999998},"min":{"1min":0.35199999999999998,"5min":0.31,"15min":0.27300000000000002},"max":{"1min":0.88200000000000001,"5min":1.095,"15min":1.1220000000000001},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.73699999999999999,"15min":0.72199999999999998},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.163,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.377}]},{"osd":1,"last update":"Sat Jun 10 19:02:52 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.67400000000000004,"15min":0.66400000000000003},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.94799999999999995,"5min":0.98299999999999998,"15min":1.1950000000000001},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.79500000000000004,"15min":0.74099999999999999},"min":{"1min":0.41999999999999998,"5min":0.36699999999999999,"15min":0.29499999999999998},"max":{"1min":1.2310000000000001,"5min":1.446,"15min":1.446},"last":0.34999999999999998}]},{"osd":3,"last update":"Sat Jun 10 19:02:52 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.80300000000000005,"15min":0.754},"min":{"1min":0.35599999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.133,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.80300000000000005,"15min":0.77300000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":1.181,"5min":1.181,"15min":1.3340000000000001},"last":0.44400000000000001}]},{"osd":4,"last update":"Sat Jun 10 19:02:52 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.94199999999999995,"15min":0.92600000000000005},"min":{"1min":0.68000000000000005,"5min":0.624,"15min":0.53400000000000003},"max":{"1min":1.258,"5min":1.258,"15min":1.3620000000000001},"last":0.52800000000000002},{"interface":"front","average":{"1min":1.044,"5min":1.0229999999999999,"15min":1.0269999999999999},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.57699999999999996},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.59299999999999997}]},{"osd":5,"last update":"Sat Jun 10 19:02:52 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.0209999999999999,"15min":1.0169999999999999},"min":{"1min":0.63300000000000001,"5min":0.61199999999999999,"15min":0.54100000000000004},"max":{"1min":1.337,"5min":1.5429999999999999,"15min":1.5700000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":1.052,"5min":1.02,"15min":1.0069999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.667},"last":0.74399999999999999}]},{"osd":6,"last update":"Sat Jun 10 19:02:52 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.0369999999999999,"15min":1.0429999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.391,"5min":1.4259999999999999,"15min":1.5900000000000001},"last":0.93000000000000005},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0600000000000001,"15min":1.046},"min":{"1min":0.624,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.486,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.83099999999999996}]},{"osd":7,"last update":"Sat Jun 10 19:02:52 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.117,"15min":1.103},"min":{"1min":0.64400000000000002,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.734,"5min":1.734,"15min":1.734},"last":0.73199999999999998},{"interface":"front","average":{"1min":1.21,"5min":1.125,"15min":1.107},"min":{"1min":0.64700000000000002,"5min":0.64100000000000001,"15min":0.59299999999999997},"max":{"1min":1.657,"5min":1.657,"15min":1.752},"last":0.78200000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574988,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32324,"kb_used_data":1276,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339516,"statfs":{"total":96636764160,"available":96603664384,"internally_reserved":0,"allocated":1306624,"data_stored":599502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:02:54 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.68999999999999995,"15min":0.67600000000000005},"min":{"1min":0.32100000000000001,"5min":0.28599999999999998,"15min":0.25800000000000001},"max":{"1min":1.026,"5min":1.119,"15min":1.288},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.76800000000000002,"15min":0.72699999999999998},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.694},"last":0.65700000000000003}]},{"osd":2,"last update":"Sat Jun 10 19:02:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.64000000000000001,"15min":0.63100000000000001},"min":{"1min":0.33100000000000002,"5min":0.308,"15min":0.249},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.21},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.629,"5min":0.74199999999999999,"15min":0.70199999999999996},"min":{"1min":0.32800000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.0629999999999999,"5min":1.194,"15min":1.415},"last":0.47299999999999998}]},{"osd":3,"last update":"Sat Jun 10 19:02:54 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.78600000000000003,"15min":0.77100000000000002},"min":{"1min":0.40200000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.0529999999999999,"5min":1.3049999999999999,"15min":1.6299999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.73999999999999999,"15min":0.74399999999999999},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.0409999999999999,"5min":1.2909999999999999,"15min":2.1749999999999998},"last":0.504}]},{"osd":4,"last update":"Sat Jun 10 19:02:54 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.86599999999999999,"15min":0.85399999999999998},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.53000000000000003},"max":{"1min":1.2070000000000001,"5min":1.343,"15min":1.4930000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.99199999999999999,"15min":1.048},"min":{"1min":0.47299999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.492,"5min":1.5129999999999999,"15min":5.8209999999999997},"last":1.05}]},{"osd":5,"last update":"Sat Jun 10 19:02:54 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.99099999999999999,"15min":1.0089999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.2709999999999999,"5min":1.6299999999999999,"15min":1.8620000000000001},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.97499999999999998,"15min":0.97799999999999998},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":3.089},"last":0.84099999999999997}]},{"osd":6,"last update":"Sat Jun 10 19:02:54 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":1.038,"15min":1.05},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.3640000000000001,"5min":1.6759999999999999,"15min":7.2599999999999998},"last":1.016},{"interface":"front","average":{"1min":0.93200000000000005,"5min":1.022,"15min":1.038},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":9.0069999999999997},"last":0.754}]},{"osd":7,"last update":"Sat Jun 10 19:02:54 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":1.0800000000000001,"15min":1.085},"min":{"1min":0.58799999999999997,"5min":0.495,"15min":0.495},"max":{"1min":1.431,"5min":1.573,"15min":2.105},"last":1.1160000000000001},{"interface":"front","average":{"1min":0.96699999999999997,"5min":1.087,"15min":1.081},"min":{"1min":0.60199999999999998,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.454,"5min":1.5620000000000001,"15min":2.2570000000000001},"last":1.0780000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574987,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32916,"kb_used_data":1868,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338924,"statfs":{"total":96636764160,"available":96603058176,"internally_reserved":0,"allocated":1912832,"data_stored":1196040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jun 10 19:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.65900000000000003,"15min":0.63},"min":{"1min":0.46300000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.98499999999999999,"5min":1.077,"15min":1.0780000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.82899999999999996,"15min":0.78800000000000003},"min":{"1min":0.49299999999999999,"5min":0.36299999999999999,"15min":0.34000000000000002},"max":{"1min":1.0309999999999999,"5min":1.2230000000000001,"15min":1.4059999999999999},"last":1.0289999999999999}]},{"osd":2,"last update":"Sat Jun 10 19:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.73299999999999998,"15min":0.71299999999999997},"min":{"1min":0.51100000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2829999999999999},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.67300000000000004,"15min":0.64800000000000002},"min":{"1min":0.46899999999999997,"5min":0.27600000000000002,"15min":0.245},"max":{"1min":0.83499999999999996,"5min":1.139,"15min":1.371},"last":0.60799999999999998}]},{"osd":3,"last update":"Sat Jun 10 19:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.38900000000000001,"5min":0.29499999999999998,"15min":0.28899999999999998},"max":{"1min":0.875,"5min":1.0860000000000001,"15min":1.226},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.871,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.42999999999999999,"5min":0.317,"15min":0.317},"max":{"1min":1.742,"5min":1.742,"15min":1.829},"last":0.85499999999999998}]},{"osd":4,"last update":"Sat Jun 10 19:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.92900000000000005,"15min":0.91600000000000004},"min":{"1min":0.72199999999999998,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.224,"5min":1.224,"15min":3.0209999999999999},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.0409999999999999,"15min":1.032},"min":{"1min":0.65300000000000002,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.8520000000000001,"5min":1.8520000000000001,"15min":1.9510000000000001},"last":1.1220000000000001}]},{"osd":5,"last update":"Sat Jun 10 19:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.93999999999999995,"15min":0.94599999999999995},"min":{"1min":0.67300000000000004,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.694},"last":0.80600000000000005},{"interface":"front","average":{"1min":1.044,"5min":1.012,"15min":1.0129999999999999},"min":{"1min":0.65200000000000002,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.78,"5min":1.78,"15min":4.5620000000000003},"last":0.998}]},{"osd":6,"last update":"Sat Jun 10 19:02:53 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.0800000000000001,"15min":1.0760000000000001},"min":{"1min":0.73899999999999999,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.5700000000000001,"5min":1.5980000000000001,"15min":3.5569999999999999},"last":1.083},{"interface":"front","average":{"1min":0.97499999999999998,"5min":1.004,"15min":1.0029999999999999},"min":{"1min":0.69699999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.883},"last":0.93300000000000005}]},{"osd":7,"last update":"Sat Jun 10 19:02:53 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.036,"15min":1.036},"min":{"1min":0.69199999999999995,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.512,"5min":1.512,"15min":1.5800000000000001},"last":1.056},{"interface":"front","average":{"1min":1.109,"5min":1.077,"15min":1.0609999999999999},"min":{"1min":0.78900000000000003,"5min":0.624,"15min":0.58699999999999997},"max":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.9830000000000001},"last":0.89600000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-10T19:03:52.262 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3f is not active+clean 2023-06-10T19:03:52.262 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:03:48.022931+0000', 'last_change': '2023-06-10T19:03:48.022931+0000', 'last_active': '2023-06-10T19:03:48.022931+0000', 'last_peered': '2023-06-10T19:03:48.022931+0000', 'last_clean': '2023-06-10T19:03:48.022931+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:48.022931+0000', 'last_undegraded': '2023-06-10T19:03:48.022931+0000', 'last_fullsized': '2023-06-10T19:03:48.022931+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:03:52.263 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3e is not active+clean 2023-06-10T19:03:52.263 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:03:48.022931+0000', 'last_change': '2023-06-10T19:03:48.022931+0000', 'last_active': '2023-06-10T19:03:48.022931+0000', 'last_peered': '2023-06-10T19:03:48.022931+0000', 'last_clean': '2023-06-10T19:03:48.022931+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:48.022931+0000', 'last_undegraded': '2023-06-10T19:03:48.022931+0000', 'last_fullsized': '2023-06-10T19:03:48.022931+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:03:52.263 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3d is not active+clean 2023-06-10T19:03:52.264 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:03:48.022931+0000', 'last_change': '2023-06-10T19:03:48.022931+0000', 'last_active': '2023-06-10T19:03:48.022931+0000', 'last_peered': '2023-06-10T19:03:48.022931+0000', 'last_clean': '2023-06-10T19:03:48.022931+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:48.022931+0000', 'last_undegraded': '2023-06-10T19:03:48.022931+0000', 'last_fullsized': '2023-06-10T19:03:48.022931+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:03:52.264 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3c is not active+clean 2023-06-10T19:03:52.264 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:03:48.022931+0000', 'last_change': '2023-06-10T19:03:48.022931+0000', 'last_active': '2023-06-10T19:03:48.022931+0000', 'last_peered': '2023-06-10T19:03:48.022931+0000', 'last_clean': '2023-06-10T19:03:48.022931+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:48.022931+0000', 'last_undegraded': '2023-06-10T19:03:48.022931+0000', 'last_fullsized': '2023-06-10T19:03:48.022931+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:03:52.265 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3b is not active+clean 2023-06-10T19:03:52.265 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:03:48.022931+0000', 'last_change': '2023-06-10T19:03:48.022931+0000', 'last_active': '2023-06-10T19:03:48.022931+0000', 'last_peered': '2023-06-10T19:03:48.022931+0000', 'last_clean': '2023-06-10T19:03:48.022931+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:48.022931+0000', 'last_undegraded': '2023-06-10T19:03:48.022931+0000', 'last_fullsized': '2023-06-10T19:03:48.022931+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:03:52.265 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3a is not active+clean 2023-06-10T19:03:52.266 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:03:48.022931+0000', 'last_change': '2023-06-10T19:03:48.022931+0000', 'last_active': '2023-06-10T19:03:48.022931+0000', 'last_peered': '2023-06-10T19:03:48.022931+0000', 'last_clean': '2023-06-10T19:03:48.022931+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:48.022931+0000', 'last_undegraded': '2023-06-10T19:03:48.022931+0000', 'last_fullsized': '2023-06-10T19:03:48.022931+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:03:52.266 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.39 is not active+clean 2023-06-10T19:03:52.266 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:03:48.022931+0000', 'last_change': '2023-06-10T19:03:48.022931+0000', 'last_active': '2023-06-10T19:03:48.022931+0000', 'last_peered': '2023-06-10T19:03:48.022931+0000', 'last_clean': '2023-06-10T19:03:48.022931+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:48.022931+0000', 'last_undegraded': '2023-06-10T19:03:48.022931+0000', 'last_fullsized': '2023-06-10T19:03:48.022931+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:03:52.267 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.38 is not active+clean 2023-06-10T19:03:52.267 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:03:48.022931+0000', 'last_change': '2023-06-10T19:03:48.022931+0000', 'last_active': '2023-06-10T19:03:48.022931+0000', 'last_peered': '2023-06-10T19:03:48.022931+0000', 'last_clean': '2023-06-10T19:03:48.022931+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:48.022931+0000', 'last_undegraded': '2023-06-10T19:03:48.022931+0000', 'last_fullsized': '2023-06-10T19:03:48.022931+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:03:52.267 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.37 is not active+clean 2023-06-10T19:03:52.267 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:03:48.022931+0000', 'last_change': '2023-06-10T19:03:48.022931+0000', 'last_active': '2023-06-10T19:03:48.022931+0000', 'last_peered': '2023-06-10T19:03:48.022931+0000', 'last_clean': '2023-06-10T19:03:48.022931+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:48.022931+0000', 'last_undegraded': '2023-06-10T19:03:48.022931+0000', 'last_fullsized': '2023-06-10T19:03:48.022931+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:03:52.268 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.36 is not active+clean 2023-06-10T19:03:52.268 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:03:48.022931+0000', 'last_change': '2023-06-10T19:03:48.022931+0000', 'last_active': '2023-06-10T19:03:48.022931+0000', 'last_peered': '2023-06-10T19:03:48.022931+0000', 'last_clean': '2023-06-10T19:03:48.022931+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:48.022931+0000', 'last_undegraded': '2023-06-10T19:03:48.022931+0000', 'last_fullsized': '2023-06-10T19:03:48.022931+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:03:52.268 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.35 is not active+clean 2023-06-10T19:03:52.269 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:03:48.022931+0000', 'last_change': '2023-06-10T19:03:48.022931+0000', 'last_active': '2023-06-10T19:03:48.022931+0000', 'last_peered': '2023-06-10T19:03:48.022931+0000', 'last_clean': '2023-06-10T19:03:48.022931+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:48.022931+0000', 'last_undegraded': '2023-06-10T19:03:48.022931+0000', 'last_fullsized': '2023-06-10T19:03:48.022931+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:03:52.269 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.34 is not active+clean 2023-06-10T19:03:52.269 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:03:48.022931+0000', 'last_change': '2023-06-10T19:03:48.022931+0000', 'last_active': '2023-06-10T19:03:48.022931+0000', 'last_peered': '2023-06-10T19:03:48.022931+0000', 'last_clean': '2023-06-10T19:03:48.022931+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:48.022931+0000', 'last_undegraded': '2023-06-10T19:03:48.022931+0000', 'last_fullsized': '2023-06-10T19:03:48.022931+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:03:52.270 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.33 is not active+clean 2023-06-10T19:03:52.270 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:03:48.022931+0000', 'last_change': '2023-06-10T19:03:48.022931+0000', 'last_active': '2023-06-10T19:03:48.022931+0000', 'last_peered': '2023-06-10T19:03:48.022931+0000', 'last_clean': '2023-06-10T19:03:48.022931+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:48.022931+0000', 'last_undegraded': '2023-06-10T19:03:48.022931+0000', 'last_fullsized': '2023-06-10T19:03:48.022931+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:03:52.270 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.32 is not active+clean 2023-06-10T19:03:52.271 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:03:48.022931+0000', 'last_change': '2023-06-10T19:03:48.022931+0000', 'last_active': '2023-06-10T19:03:48.022931+0000', 'last_peered': '2023-06-10T19:03:48.022931+0000', 'last_clean': '2023-06-10T19:03:48.022931+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:48.022931+0000', 'last_undegraded': '2023-06-10T19:03:48.022931+0000', 'last_fullsized': '2023-06-10T19:03:48.022931+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:03:52.271 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.31 is not active+clean 2023-06-10T19:03:52.271 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:03:48.022931+0000', 'last_change': '2023-06-10T19:03:48.022931+0000', 'last_active': '2023-06-10T19:03:48.022931+0000', 'last_peered': '2023-06-10T19:03:48.022931+0000', 'last_clean': '2023-06-10T19:03:48.022931+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:48.022931+0000', 'last_undegraded': '2023-06-10T19:03:48.022931+0000', 'last_fullsized': '2023-06-10T19:03:48.022931+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:03:52.272 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.30 is not active+clean 2023-06-10T19:03:52.272 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:03:48.022931+0000', 'last_change': '2023-06-10T19:03:48.022931+0000', 'last_active': '2023-06-10T19:03:48.022931+0000', 'last_peered': '2023-06-10T19:03:48.022931+0000', 'last_clean': '2023-06-10T19:03:48.022931+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:48.022931+0000', 'last_undegraded': '2023-06-10T19:03:48.022931+0000', 'last_fullsized': '2023-06-10T19:03:48.022931+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:03:52.272 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2f is not active+clean 2023-06-10T19:03:52.273 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:03:48.022931+0000', 'last_change': '2023-06-10T19:03:48.022931+0000', 'last_active': '2023-06-10T19:03:48.022931+0000', 'last_peered': '2023-06-10T19:03:48.022931+0000', 'last_clean': '2023-06-10T19:03:48.022931+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:48.022931+0000', 'last_undegraded': '2023-06-10T19:03:48.022931+0000', 'last_fullsized': '2023-06-10T19:03:48.022931+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:03:52.273 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2e is not active+clean 2023-06-10T19:03:52.273 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:03:48.022931+0000', 'last_change': '2023-06-10T19:03:48.022931+0000', 'last_active': '2023-06-10T19:03:48.022931+0000', 'last_peered': '2023-06-10T19:03:48.022931+0000', 'last_clean': '2023-06-10T19:03:48.022931+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:48.022931+0000', 'last_undegraded': '2023-06-10T19:03:48.022931+0000', 'last_fullsized': '2023-06-10T19:03:48.022931+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:03:52.274 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2d is not active+clean 2023-06-10T19:03:52.274 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:03:48.022931+0000', 'last_change': '2023-06-10T19:03:48.022931+0000', 'last_active': '2023-06-10T19:03:48.022931+0000', 'last_peered': '2023-06-10T19:03:48.022931+0000', 'last_clean': '2023-06-10T19:03:48.022931+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:48.022931+0000', 'last_undegraded': '2023-06-10T19:03:48.022931+0000', 'last_fullsized': '2023-06-10T19:03:48.022931+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:03:52.274 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2c is not active+clean 2023-06-10T19:03:52.274 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:03:48.022931+0000', 'last_change': '2023-06-10T19:03:48.022931+0000', 'last_active': '2023-06-10T19:03:48.022931+0000', 'last_peered': '2023-06-10T19:03:48.022931+0000', 'last_clean': '2023-06-10T19:03:48.022931+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:48.022931+0000', 'last_undegraded': '2023-06-10T19:03:48.022931+0000', 'last_fullsized': '2023-06-10T19:03:48.022931+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:03:52.275 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2b is not active+clean 2023-06-10T19:03:52.275 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:03:48.022931+0000', 'last_change': '2023-06-10T19:03:48.022931+0000', 'last_active': '2023-06-10T19:03:48.022931+0000', 'last_peered': '2023-06-10T19:03:48.022931+0000', 'last_clean': '2023-06-10T19:03:48.022931+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:48.022931+0000', 'last_undegraded': '2023-06-10T19:03:48.022931+0000', 'last_fullsized': '2023-06-10T19:03:48.022931+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:03:52.275 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2a is not active+clean 2023-06-10T19:03:52.276 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:03:48.022931+0000', 'last_change': '2023-06-10T19:03:48.022931+0000', 'last_active': '2023-06-10T19:03:48.022931+0000', 'last_peered': '2023-06-10T19:03:48.022931+0000', 'last_clean': '2023-06-10T19:03:48.022931+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:48.022931+0000', 'last_undegraded': '2023-06-10T19:03:48.022931+0000', 'last_fullsized': '2023-06-10T19:03:48.022931+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:03:52.276 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.29 is not active+clean 2023-06-10T19:03:52.276 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:03:48.022931+0000', 'last_change': '2023-06-10T19:03:48.022931+0000', 'last_active': '2023-06-10T19:03:48.022931+0000', 'last_peered': '2023-06-10T19:03:48.022931+0000', 'last_clean': '2023-06-10T19:03:48.022931+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:48.022931+0000', 'last_undegraded': '2023-06-10T19:03:48.022931+0000', 'last_fullsized': '2023-06-10T19:03:48.022931+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:03:52.277 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.28 is not active+clean 2023-06-10T19:03:52.277 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:03:48.022931+0000', 'last_change': '2023-06-10T19:03:48.022931+0000', 'last_active': '2023-06-10T19:03:48.022931+0000', 'last_peered': '2023-06-10T19:03:48.022931+0000', 'last_clean': '2023-06-10T19:03:48.022931+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:48.022931+0000', 'last_undegraded': '2023-06-10T19:03:48.022931+0000', 'last_fullsized': '2023-06-10T19:03:48.022931+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:03:52.277 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.27 is not active+clean 2023-06-10T19:03:52.278 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:03:48.022931+0000', 'last_change': '2023-06-10T19:03:48.022931+0000', 'last_active': '2023-06-10T19:03:48.022931+0000', 'last_peered': '2023-06-10T19:03:48.022931+0000', 'last_clean': '2023-06-10T19:03:48.022931+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:48.022931+0000', 'last_undegraded': '2023-06-10T19:03:48.022931+0000', 'last_fullsized': '2023-06-10T19:03:48.022931+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:03:52.278 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.26 is not active+clean 2023-06-10T19:03:52.278 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:03:48.022931+0000', 'last_change': '2023-06-10T19:03:48.022931+0000', 'last_active': '2023-06-10T19:03:48.022931+0000', 'last_peered': '2023-06-10T19:03:48.022931+0000', 'last_clean': '2023-06-10T19:03:48.022931+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:48.022931+0000', 'last_undegraded': '2023-06-10T19:03:48.022931+0000', 'last_fullsized': '2023-06-10T19:03:48.022931+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:03:52.279 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.25 is not active+clean 2023-06-10T19:03:52.279 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:03:48.022931+0000', 'last_change': '2023-06-10T19:03:48.022931+0000', 'last_active': '2023-06-10T19:03:48.022931+0000', 'last_peered': '2023-06-10T19:03:48.022931+0000', 'last_clean': '2023-06-10T19:03:48.022931+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:48.022931+0000', 'last_undegraded': '2023-06-10T19:03:48.022931+0000', 'last_fullsized': '2023-06-10T19:03:48.022931+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:03:52.279 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.24 is not active+clean 2023-06-10T19:03:52.279 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:03:48.022931+0000', 'last_change': '2023-06-10T19:03:48.022931+0000', 'last_active': '2023-06-10T19:03:48.022931+0000', 'last_peered': '2023-06-10T19:03:48.022931+0000', 'last_clean': '2023-06-10T19:03:48.022931+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:48.022931+0000', 'last_undegraded': '2023-06-10T19:03:48.022931+0000', 'last_fullsized': '2023-06-10T19:03:48.022931+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:03:52.280 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.23 is not active+clean 2023-06-10T19:03:52.280 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:03:48.022931+0000', 'last_change': '2023-06-10T19:03:48.022931+0000', 'last_active': '2023-06-10T19:03:48.022931+0000', 'last_peered': '2023-06-10T19:03:48.022931+0000', 'last_clean': '2023-06-10T19:03:48.022931+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:48.022931+0000', 'last_undegraded': '2023-06-10T19:03:48.022931+0000', 'last_fullsized': '2023-06-10T19:03:48.022931+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:03:52.280 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.22 is not active+clean 2023-06-10T19:03:52.281 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:03:48.022931+0000', 'last_change': '2023-06-10T19:03:48.022931+0000', 'last_active': '2023-06-10T19:03:48.022931+0000', 'last_peered': '2023-06-10T19:03:48.022931+0000', 'last_clean': '2023-06-10T19:03:48.022931+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:48.022931+0000', 'last_undegraded': '2023-06-10T19:03:48.022931+0000', 'last_fullsized': '2023-06-10T19:03:48.022931+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:03:52.281 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.21 is not active+clean 2023-06-10T19:03:52.281 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:03:48.022931+0000', 'last_change': '2023-06-10T19:03:48.022931+0000', 'last_active': '2023-06-10T19:03:48.022931+0000', 'last_peered': '2023-06-10T19:03:48.022931+0000', 'last_clean': '2023-06-10T19:03:48.022931+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:48.022931+0000', 'last_undegraded': '2023-06-10T19:03:48.022931+0000', 'last_fullsized': '2023-06-10T19:03:48.022931+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:03:52.282 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.20 is not active+clean 2023-06-10T19:03:52.282 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:03:48.022931+0000', 'last_change': '2023-06-10T19:03:48.022931+0000', 'last_active': '2023-06-10T19:03:48.022931+0000', 'last_peered': '2023-06-10T19:03:48.022931+0000', 'last_clean': '2023-06-10T19:03:48.022931+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:48.022931+0000', 'last_undegraded': '2023-06-10T19:03:48.022931+0000', 'last_fullsized': '2023-06-10T19:03:48.022931+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:03:52.282 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.0 is not active+clean 2023-06-10T19:03:52.283 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:03:48.022931+0000', 'last_change': '2023-06-10T19:03:48.022931+0000', 'last_active': '2023-06-10T19:03:48.022931+0000', 'last_peered': '2023-06-10T19:03:48.022931+0000', 'last_clean': '2023-06-10T19:03:48.022931+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:48.022931+0000', 'last_undegraded': '2023-06-10T19:03:48.022931+0000', 'last_fullsized': '2023-06-10T19:03:48.022931+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:03:52.283 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1f is not active+clean 2023-06-10T19:03:52.283 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2023-06-10T19:03:47.039078+0000', 'last_change': '2023-06-10T19:03:47.039078+0000', 'last_active': '2023-06-10T19:03:47.019320+0000', 'last_peered': '2023-06-10T19:03:47.019320+0000', 'last_clean': '2023-06-10T19:03:47.019320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:47.039078+0000', 'last_undegraded': '2023-06-10T19:03:47.039078+0000', 'last_fullsized': '2023-06-10T19:03:47.039078+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-06-10T19:03:52.284 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1 is not active+clean 2023-06-10T19:03:52.284 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:03:48.022931+0000', 'last_change': '2023-06-10T19:03:48.022931+0000', 'last_active': '2023-06-10T19:03:48.022931+0000', 'last_peered': '2023-06-10T19:03:48.022931+0000', 'last_clean': '2023-06-10T19:03:48.022931+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:48.022931+0000', 'last_undegraded': '2023-06-10T19:03:48.022931+0000', 'last_fullsized': '2023-06-10T19:03:48.022931+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:03:52.284 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1e is not active+clean 2023-06-10T19:03:52.284 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2023-06-10T19:03:47.043540+0000', 'last_change': '2023-06-10T19:03:47.043540+0000', 'last_active': '2023-06-10T19:03:47.019320+0000', 'last_peered': '2023-06-10T19:03:47.019320+0000', 'last_clean': '2023-06-10T19:03:47.019320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:47.043540+0000', 'last_undegraded': '2023-06-10T19:03:47.043540+0000', 'last_fullsized': '2023-06-10T19:03:47.043540+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-06-10T19:03:52.285 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2 is not active+clean 2023-06-10T19:03:52.285 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:03:48.022931+0000', 'last_change': '2023-06-10T19:03:48.022931+0000', 'last_active': '2023-06-10T19:03:48.022931+0000', 'last_peered': '2023-06-10T19:03:48.022931+0000', 'last_clean': '2023-06-10T19:03:48.022931+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:48.022931+0000', 'last_undegraded': '2023-06-10T19:03:48.022931+0000', 'last_fullsized': '2023-06-10T19:03:48.022931+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:03:52.285 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1d is not active+clean 2023-06-10T19:03:52.286 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2023-06-10T19:03:47.029988+0000', 'last_change': '2023-06-10T19:03:47.029988+0000', 'last_active': '2023-06-10T19:03:47.019320+0000', 'last_peered': '2023-06-10T19:03:47.019320+0000', 'last_clean': '2023-06-10T19:03:47.019320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:47.029988+0000', 'last_undegraded': '2023-06-10T19:03:47.029988+0000', 'last_fullsized': '2023-06-10T19:03:47.029988+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-06-10T19:03:52.286 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3 is not active+clean 2023-06-10T19:03:52.286 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:03:48.022931+0000', 'last_change': '2023-06-10T19:03:48.022931+0000', 'last_active': '2023-06-10T19:03:48.022931+0000', 'last_peered': '2023-06-10T19:03:48.022931+0000', 'last_clean': '2023-06-10T19:03:48.022931+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:48.022931+0000', 'last_undegraded': '2023-06-10T19:03:48.022931+0000', 'last_fullsized': '2023-06-10T19:03:48.022931+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:03:52.287 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1c is not active+clean 2023-06-10T19:03:52.287 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2023-06-10T19:03:47.040924+0000', 'last_change': '2023-06-10T19:03:47.040924+0000', 'last_active': '2023-06-10T19:03:47.019320+0000', 'last_peered': '2023-06-10T19:03:47.019320+0000', 'last_clean': '2023-06-10T19:03:47.019320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:47.040924+0000', 'last_undegraded': '2023-06-10T19:03:47.040924+0000', 'last_fullsized': '2023-06-10T19:03:47.040924+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-06-10T19:03:52.287 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.4 is not active+clean 2023-06-10T19:03:52.288 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:03:48.022931+0000', 'last_change': '2023-06-10T19:03:48.022931+0000', 'last_active': '2023-06-10T19:03:48.022931+0000', 'last_peered': '2023-06-10T19:03:48.022931+0000', 'last_clean': '2023-06-10T19:03:48.022931+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:48.022931+0000', 'last_undegraded': '2023-06-10T19:03:48.022931+0000', 'last_fullsized': '2023-06-10T19:03:48.022931+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:03:52.288 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1b is not active+clean 2023-06-10T19:03:52.288 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2023-06-10T19:03:47.043064+0000', 'last_change': '2023-06-10T19:03:47.043064+0000', 'last_active': '2023-06-10T19:03:47.019320+0000', 'last_peered': '2023-06-10T19:03:47.019320+0000', 'last_clean': '2023-06-10T19:03:47.019320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:47.043064+0000', 'last_undegraded': '2023-06-10T19:03:47.043064+0000', 'last_fullsized': '2023-06-10T19:03:47.043064+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-06-10T19:03:52.289 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.5 is not active+clean 2023-06-10T19:03:52.289 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:03:48.022931+0000', 'last_change': '2023-06-10T19:03:48.022931+0000', 'last_active': '2023-06-10T19:03:48.022931+0000', 'last_peered': '2023-06-10T19:03:48.022931+0000', 'last_clean': '2023-06-10T19:03:48.022931+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:48.022931+0000', 'last_undegraded': '2023-06-10T19:03:48.022931+0000', 'last_fullsized': '2023-06-10T19:03:48.022931+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:03:52.289 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1a is not active+clean 2023-06-10T19:03:52.289 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2023-06-10T19:03:47.032572+0000', 'last_change': '2023-06-10T19:03:47.032572+0000', 'last_active': '2023-06-10T19:03:47.019320+0000', 'last_peered': '2023-06-10T19:03:47.019320+0000', 'last_clean': '2023-06-10T19:03:47.019320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:47.032572+0000', 'last_undegraded': '2023-06-10T19:03:47.032572+0000', 'last_fullsized': '2023-06-10T19:03:47.032572+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-06-10T19:03:52.290 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.6 is not active+clean 2023-06-10T19:03:52.290 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:03:48.022931+0000', 'last_change': '2023-06-10T19:03:48.022931+0000', 'last_active': '2023-06-10T19:03:48.022931+0000', 'last_peered': '2023-06-10T19:03:48.022931+0000', 'last_clean': '2023-06-10T19:03:48.022931+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:48.022931+0000', 'last_undegraded': '2023-06-10T19:03:48.022931+0000', 'last_fullsized': '2023-06-10T19:03:48.022931+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:03:52.290 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.19 is not active+clean 2023-06-10T19:03:52.291 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2023-06-10T19:03:47.029778+0000', 'last_change': '2023-06-10T19:03:47.029778+0000', 'last_active': '2023-06-10T19:03:47.019320+0000', 'last_peered': '2023-06-10T19:03:47.019320+0000', 'last_clean': '2023-06-10T19:03:47.019320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:47.029778+0000', 'last_undegraded': '2023-06-10T19:03:47.029778+0000', 'last_fullsized': '2023-06-10T19:03:47.029778+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-06-10T19:03:52.291 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.7 is not active+clean 2023-06-10T19:03:52.291 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:03:48.022931+0000', 'last_change': '2023-06-10T19:03:48.022931+0000', 'last_active': '2023-06-10T19:03:48.022931+0000', 'last_peered': '2023-06-10T19:03:48.022931+0000', 'last_clean': '2023-06-10T19:03:48.022931+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:48.022931+0000', 'last_undegraded': '2023-06-10T19:03:48.022931+0000', 'last_fullsized': '2023-06-10T19:03:48.022931+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:03:52.292 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.18 is not active+clean 2023-06-10T19:03:52.292 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2023-06-10T19:03:47.039108+0000', 'last_change': '2023-06-10T19:03:47.039108+0000', 'last_active': '2023-06-10T19:03:47.019320+0000', 'last_peered': '2023-06-10T19:03:47.019320+0000', 'last_clean': '2023-06-10T19:03:47.019320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:47.039108+0000', 'last_undegraded': '2023-06-10T19:03:47.039108+0000', 'last_fullsized': '2023-06-10T19:03:47.039108+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-06-10T19:03:52.292 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.8 is not active+clean 2023-06-10T19:03:52.293 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:03:48.022931+0000', 'last_change': '2023-06-10T19:03:48.022931+0000', 'last_active': '2023-06-10T19:03:48.022931+0000', 'last_peered': '2023-06-10T19:03:48.022931+0000', 'last_clean': '2023-06-10T19:03:48.022931+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:48.022931+0000', 'last_undegraded': '2023-06-10T19:03:48.022931+0000', 'last_fullsized': '2023-06-10T19:03:48.022931+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:03:52.293 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.17 is not active+clean 2023-06-10T19:03:52.293 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2023-06-10T19:03:47.031636+0000', 'last_change': '2023-06-10T19:03:47.031636+0000', 'last_active': '2023-06-10T19:03:47.019320+0000', 'last_peered': '2023-06-10T19:03:47.019320+0000', 'last_clean': '2023-06-10T19:03:47.019320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:47.031636+0000', 'last_undegraded': '2023-06-10T19:03:47.031636+0000', 'last_fullsized': '2023-06-10T19:03:47.031636+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-06-10T19:03:52.294 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.9 is not active+clean 2023-06-10T19:03:52.294 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:03:48.022931+0000', 'last_change': '2023-06-10T19:03:48.022931+0000', 'last_active': '2023-06-10T19:03:48.022931+0000', 'last_peered': '2023-06-10T19:03:48.022931+0000', 'last_clean': '2023-06-10T19:03:48.022931+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:48.022931+0000', 'last_undegraded': '2023-06-10T19:03:48.022931+0000', 'last_fullsized': '2023-06-10T19:03:48.022931+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:03:52.294 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.16 is not active+clean 2023-06-10T19:03:52.295 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2023-06-10T19:03:47.032280+0000', 'last_change': '2023-06-10T19:03:47.032280+0000', 'last_active': '2023-06-10T19:03:47.019320+0000', 'last_peered': '2023-06-10T19:03:47.019320+0000', 'last_clean': '2023-06-10T19:03:47.019320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:47.032280+0000', 'last_undegraded': '2023-06-10T19:03:47.032280+0000', 'last_fullsized': '2023-06-10T19:03:47.032280+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-06-10T19:03:52.295 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.a is not active+clean 2023-06-10T19:03:52.295 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:03:48.022931+0000', 'last_change': '2023-06-10T19:03:48.022931+0000', 'last_active': '2023-06-10T19:03:48.022931+0000', 'last_peered': '2023-06-10T19:03:48.022931+0000', 'last_clean': '2023-06-10T19:03:48.022931+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:48.022931+0000', 'last_undegraded': '2023-06-10T19:03:48.022931+0000', 'last_fullsized': '2023-06-10T19:03:48.022931+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:03:52.296 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.15 is not active+clean 2023-06-10T19:03:52.296 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2023-06-10T19:03:47.044181+0000', 'last_change': '2023-06-10T19:03:47.044181+0000', 'last_active': '2023-06-10T19:03:47.019320+0000', 'last_peered': '2023-06-10T19:03:47.019320+0000', 'last_clean': '2023-06-10T19:03:47.019320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:47.044181+0000', 'last_undegraded': '2023-06-10T19:03:47.044181+0000', 'last_fullsized': '2023-06-10T19:03:47.044181+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-06-10T19:03:52.296 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.b is not active+clean 2023-06-10T19:03:52.297 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:03:48.022931+0000', 'last_change': '2023-06-10T19:03:48.022931+0000', 'last_active': '2023-06-10T19:03:48.022931+0000', 'last_peered': '2023-06-10T19:03:48.022931+0000', 'last_clean': '2023-06-10T19:03:48.022931+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:48.022931+0000', 'last_undegraded': '2023-06-10T19:03:48.022931+0000', 'last_fullsized': '2023-06-10T19:03:48.022931+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:03:52.297 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.14 is not active+clean 2023-06-10T19:03:52.297 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2023-06-10T19:03:47.037025+0000', 'last_change': '2023-06-10T19:03:47.037025+0000', 'last_active': '2023-06-10T19:03:47.019320+0000', 'last_peered': '2023-06-10T19:03:47.019320+0000', 'last_clean': '2023-06-10T19:03:47.019320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:47.037025+0000', 'last_undegraded': '2023-06-10T19:03:47.037025+0000', 'last_fullsized': '2023-06-10T19:03:47.037025+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-06-10T19:03:52.298 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.c is not active+clean 2023-06-10T19:03:52.298 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:03:48.022931+0000', 'last_change': '2023-06-10T19:03:48.022931+0000', 'last_active': '2023-06-10T19:03:48.022931+0000', 'last_peered': '2023-06-10T19:03:48.022931+0000', 'last_clean': '2023-06-10T19:03:48.022931+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:48.022931+0000', 'last_undegraded': '2023-06-10T19:03:48.022931+0000', 'last_fullsized': '2023-06-10T19:03:48.022931+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:03:52.298 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.13 is not active+clean 2023-06-10T19:03:52.298 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2023-06-10T19:03:47.040771+0000', 'last_change': '2023-06-10T19:03:47.040771+0000', 'last_active': '2023-06-10T19:03:47.019320+0000', 'last_peered': '2023-06-10T19:03:47.019320+0000', 'last_clean': '2023-06-10T19:03:47.019320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:47.040771+0000', 'last_undegraded': '2023-06-10T19:03:47.040771+0000', 'last_fullsized': '2023-06-10T19:03:47.040771+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-06-10T19:03:52.299 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.d is not active+clean 2023-06-10T19:03:52.299 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:03:48.022931+0000', 'last_change': '2023-06-10T19:03:48.022931+0000', 'last_active': '2023-06-10T19:03:48.022931+0000', 'last_peered': '2023-06-10T19:03:48.022931+0000', 'last_clean': '2023-06-10T19:03:48.022931+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:48.022931+0000', 'last_undegraded': '2023-06-10T19:03:48.022931+0000', 'last_fullsized': '2023-06-10T19:03:48.022931+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:03:52.300 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.12 is not active+clean 2023-06-10T19:03:52.300 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2023-06-10T19:03:47.039179+0000', 'last_change': '2023-06-10T19:03:47.039179+0000', 'last_active': '2023-06-10T19:03:47.019320+0000', 'last_peered': '2023-06-10T19:03:47.019320+0000', 'last_clean': '2023-06-10T19:03:47.019320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:47.039179+0000', 'last_undegraded': '2023-06-10T19:03:47.039179+0000', 'last_fullsized': '2023-06-10T19:03:47.039179+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-06-10T19:03:52.300 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.e is not active+clean 2023-06-10T19:03:52.300 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:03:48.022931+0000', 'last_change': '2023-06-10T19:03:48.022931+0000', 'last_active': '2023-06-10T19:03:48.022931+0000', 'last_peered': '2023-06-10T19:03:48.022931+0000', 'last_clean': '2023-06-10T19:03:48.022931+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:48.022931+0000', 'last_undegraded': '2023-06-10T19:03:48.022931+0000', 'last_fullsized': '2023-06-10T19:03:48.022931+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:03:52.301 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.11 is not active+clean 2023-06-10T19:03:52.301 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2023-06-10T19:03:47.043519+0000', 'last_change': '2023-06-10T19:03:47.043519+0000', 'last_active': '2023-06-10T19:03:47.019320+0000', 'last_peered': '2023-06-10T19:03:47.019320+0000', 'last_clean': '2023-06-10T19:03:47.019320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:47.043519+0000', 'last_undegraded': '2023-06-10T19:03:47.043519+0000', 'last_fullsized': '2023-06-10T19:03:47.043519+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-06-10T19:03:52.301 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.f is not active+clean 2023-06-10T19:03:52.302 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:03:48.022931+0000', 'last_change': '2023-06-10T19:03:48.022931+0000', 'last_active': '2023-06-10T19:03:48.022931+0000', 'last_peered': '2023-06-10T19:03:48.022931+0000', 'last_clean': '2023-06-10T19:03:48.022931+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:48.022931+0000', 'last_undegraded': '2023-06-10T19:03:48.022931+0000', 'last_fullsized': '2023-06-10T19:03:48.022931+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:03:52.302 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.10 is not active+clean 2023-06-10T19:03:52.303 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2023-06-10T19:03:47.029942+0000', 'last_change': '2023-06-10T19:03:47.029942+0000', 'last_active': '2023-06-10T19:03:47.019320+0000', 'last_peered': '2023-06-10T19:03:47.019320+0000', 'last_clean': '2023-06-10T19:03:47.019320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:47.029942+0000', 'last_undegraded': '2023-06-10T19:03:47.029942+0000', 'last_fullsized': '2023-06-10T19:03:47.029942+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-06-10T19:03:52.303 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.18 is not active+clean 2023-06-10T19:03:52.303 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:03:48.022931+0000', 'last_change': '2023-06-10T19:03:48.022931+0000', 'last_active': '2023-06-10T19:03:48.022931+0000', 'last_peered': '2023-06-10T19:03:48.022931+0000', 'last_clean': '2023-06-10T19:03:48.022931+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:48.022931+0000', 'last_undegraded': '2023-06-10T19:03:48.022931+0000', 'last_fullsized': '2023-06-10T19:03:48.022931+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:03:52.304 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.7 is not active+clean 2023-06-10T19:03:52.304 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2023-06-10T19:03:47.041570+0000', 'last_change': '2023-06-10T19:03:47.041570+0000', 'last_active': '2023-06-10T19:03:47.019320+0000', 'last_peered': '2023-06-10T19:03:47.019320+0000', 'last_clean': '2023-06-10T19:03:47.019320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:47.041570+0000', 'last_undegraded': '2023-06-10T19:03:47.041570+0000', 'last_fullsized': '2023-06-10T19:03:47.041570+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-06-10T19:03:52.304 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.19 is not active+clean 2023-06-10T19:03:52.305 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:03:48.022931+0000', 'last_change': '2023-06-10T19:03:48.022931+0000', 'last_active': '2023-06-10T19:03:48.022931+0000', 'last_peered': '2023-06-10T19:03:48.022931+0000', 'last_clean': '2023-06-10T19:03:48.022931+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:48.022931+0000', 'last_undegraded': '2023-06-10T19:03:48.022931+0000', 'last_fullsized': '2023-06-10T19:03:48.022931+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:03:52.305 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.6 is not active+clean 2023-06-10T19:03:52.305 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2023-06-10T19:03:47.031554+0000', 'last_change': '2023-06-10T19:03:47.031554+0000', 'last_active': '2023-06-10T19:03:47.019320+0000', 'last_peered': '2023-06-10T19:03:47.019320+0000', 'last_clean': '2023-06-10T19:03:47.019320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:47.031554+0000', 'last_undegraded': '2023-06-10T19:03:47.031554+0000', 'last_fullsized': '2023-06-10T19:03:47.031554+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-06-10T19:03:52.305 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1a is not active+clean 2023-06-10T19:03:52.306 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:03:48.022931+0000', 'last_change': '2023-06-10T19:03:48.022931+0000', 'last_active': '2023-06-10T19:03:48.022931+0000', 'last_peered': '2023-06-10T19:03:48.022931+0000', 'last_clean': '2023-06-10T19:03:48.022931+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:48.022931+0000', 'last_undegraded': '2023-06-10T19:03:48.022931+0000', 'last_fullsized': '2023-06-10T19:03:48.022931+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:03:52.306 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.5 is not active+clean 2023-06-10T19:03:52.306 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2023-06-10T19:03:47.037091+0000', 'last_change': '2023-06-10T19:03:47.037091+0000', 'last_active': '2023-06-10T19:03:47.019320+0000', 'last_peered': '2023-06-10T19:03:47.019320+0000', 'last_clean': '2023-06-10T19:03:47.019320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:47.037091+0000', 'last_undegraded': '2023-06-10T19:03:47.037091+0000', 'last_fullsized': '2023-06-10T19:03:47.037091+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-06-10T19:03:52.307 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1b is not active+clean 2023-06-10T19:03:52.307 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:03:48.022931+0000', 'last_change': '2023-06-10T19:03:48.022931+0000', 'last_active': '2023-06-10T19:03:48.022931+0000', 'last_peered': '2023-06-10T19:03:48.022931+0000', 'last_clean': '2023-06-10T19:03:48.022931+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:48.022931+0000', 'last_undegraded': '2023-06-10T19:03:48.022931+0000', 'last_fullsized': '2023-06-10T19:03:48.022931+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:03:52.307 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.4 is not active+clean 2023-06-10T19:03:52.308 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2023-06-10T19:03:47.041468+0000', 'last_change': '2023-06-10T19:03:47.041468+0000', 'last_active': '2023-06-10T19:03:47.019320+0000', 'last_peered': '2023-06-10T19:03:47.019320+0000', 'last_clean': '2023-06-10T19:03:47.019320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:47.041468+0000', 'last_undegraded': '2023-06-10T19:03:47.041468+0000', 'last_fullsized': '2023-06-10T19:03:47.041468+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-06-10T19:03:52.308 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1c is not active+clean 2023-06-10T19:03:52.308 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:03:48.022931+0000', 'last_change': '2023-06-10T19:03:48.022931+0000', 'last_active': '2023-06-10T19:03:48.022931+0000', 'last_peered': '2023-06-10T19:03:48.022931+0000', 'last_clean': '2023-06-10T19:03:48.022931+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:48.022931+0000', 'last_undegraded': '2023-06-10T19:03:48.022931+0000', 'last_fullsized': '2023-06-10T19:03:48.022931+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:03:52.309 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3 is not active+clean 2023-06-10T19:03:52.309 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2023-06-10T19:03:47.029967+0000', 'last_change': '2023-06-10T19:03:47.029967+0000', 'last_active': '2023-06-10T19:03:47.019320+0000', 'last_peered': '2023-06-10T19:03:47.019320+0000', 'last_clean': '2023-06-10T19:03:47.019320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:47.029967+0000', 'last_undegraded': '2023-06-10T19:03:47.029967+0000', 'last_fullsized': '2023-06-10T19:03:47.029967+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-06-10T19:03:52.309 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1d is not active+clean 2023-06-10T19:03:52.310 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:03:48.022931+0000', 'last_change': '2023-06-10T19:03:48.022931+0000', 'last_active': '2023-06-10T19:03:48.022931+0000', 'last_peered': '2023-06-10T19:03:48.022931+0000', 'last_clean': '2023-06-10T19:03:48.022931+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:48.022931+0000', 'last_undegraded': '2023-06-10T19:03:48.022931+0000', 'last_fullsized': '2023-06-10T19:03:48.022931+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:03:52.310 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2 is not active+clean 2023-06-10T19:03:52.310 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2023-06-10T19:03:47.043508+0000', 'last_change': '2023-06-10T19:03:47.043508+0000', 'last_active': '2023-06-10T19:03:47.019320+0000', 'last_peered': '2023-06-10T19:03:47.019320+0000', 'last_clean': '2023-06-10T19:03:47.019320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:47.043508+0000', 'last_undegraded': '2023-06-10T19:03:47.043508+0000', 'last_fullsized': '2023-06-10T19:03:47.043508+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-06-10T19:03:52.311 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1e is not active+clean 2023-06-10T19:03:52.311 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:03:48.022931+0000', 'last_change': '2023-06-10T19:03:48.022931+0000', 'last_active': '2023-06-10T19:03:48.022931+0000', 'last_peered': '2023-06-10T19:03:48.022931+0000', 'last_clean': '2023-06-10T19:03:48.022931+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:48.022931+0000', 'last_undegraded': '2023-06-10T19:03:48.022931+0000', 'last_fullsized': '2023-06-10T19:03:48.022931+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:03:52.311 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1 is not active+clean 2023-06-10T19:03:52.311 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2023-06-10T19:03:47.036902+0000', 'last_change': '2023-06-10T19:03:47.036902+0000', 'last_active': '2023-06-10T19:03:47.019320+0000', 'last_peered': '2023-06-10T19:03:47.019320+0000', 'last_clean': '2023-06-10T19:03:47.019320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:47.036902+0000', 'last_undegraded': '2023-06-10T19:03:47.036902+0000', 'last_fullsized': '2023-06-10T19:03:47.036902+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-06-10T19:03:52.312 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1f is not active+clean 2023-06-10T19:03:52.312 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:03:48.022931+0000', 'last_change': '2023-06-10T19:03:48.022931+0000', 'last_active': '2023-06-10T19:03:48.022931+0000', 'last_peered': '2023-06-10T19:03:48.022931+0000', 'last_clean': '2023-06-10T19:03:48.022931+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:48.022931+0000', 'last_undegraded': '2023-06-10T19:03:48.022931+0000', 'last_fullsized': '2023-06-10T19:03:48.022931+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:03:52.312 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.0 is not active+clean 2023-06-10T19:03:52.313 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2023-06-10T19:03:47.043502+0000', 'last_change': '2023-06-10T19:03:47.043502+0000', 'last_active': '2023-06-10T19:03:47.019320+0000', 'last_peered': '2023-06-10T19:03:47.019320+0000', 'last_clean': '2023-06-10T19:03:47.019320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:47.043502+0000', 'last_undegraded': '2023-06-10T19:03:47.043502+0000', 'last_fullsized': '2023-06-10T19:03:47.043502+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-06-10T19:03:52.313 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.11 is not active+clean 2023-06-10T19:03:52.313 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:03:48.022931+0000', 'last_change': '2023-06-10T19:03:48.022931+0000', 'last_active': '2023-06-10T19:03:48.022931+0000', 'last_peered': '2023-06-10T19:03:48.022931+0000', 'last_clean': '2023-06-10T19:03:48.022931+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:48.022931+0000', 'last_undegraded': '2023-06-10T19:03:48.022931+0000', 'last_fullsized': '2023-06-10T19:03:48.022931+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:03:52.314 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.e is not active+clean 2023-06-10T19:03:52.314 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2023-06-10T19:03:47.044354+0000', 'last_change': '2023-06-10T19:03:47.044354+0000', 'last_active': '2023-06-10T19:03:47.019320+0000', 'last_peered': '2023-06-10T19:03:47.019320+0000', 'last_clean': '2023-06-10T19:03:47.019320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:47.044354+0000', 'last_undegraded': '2023-06-10T19:03:47.044354+0000', 'last_fullsized': '2023-06-10T19:03:47.044354+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-06-10T19:03:52.314 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.12 is not active+clean 2023-06-10T19:03:52.315 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:03:48.022931+0000', 'last_change': '2023-06-10T19:03:48.022931+0000', 'last_active': '2023-06-10T19:03:48.022931+0000', 'last_peered': '2023-06-10T19:03:48.022931+0000', 'last_clean': '2023-06-10T19:03:48.022931+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:48.022931+0000', 'last_undegraded': '2023-06-10T19:03:48.022931+0000', 'last_fullsized': '2023-06-10T19:03:48.022931+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:03:52.315 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.d is not active+clean 2023-06-10T19:03:52.315 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2023-06-10T19:03:47.043040+0000', 'last_change': '2023-06-10T19:03:47.043040+0000', 'last_active': '2023-06-10T19:03:47.019320+0000', 'last_peered': '2023-06-10T19:03:47.019320+0000', 'last_clean': '2023-06-10T19:03:47.019320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:47.043040+0000', 'last_undegraded': '2023-06-10T19:03:47.043040+0000', 'last_fullsized': '2023-06-10T19:03:47.043040+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-06-10T19:03:52.316 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.13 is not active+clean 2023-06-10T19:03:52.316 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:03:48.022931+0000', 'last_change': '2023-06-10T19:03:48.022931+0000', 'last_active': '2023-06-10T19:03:48.022931+0000', 'last_peered': '2023-06-10T19:03:48.022931+0000', 'last_clean': '2023-06-10T19:03:48.022931+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:48.022931+0000', 'last_undegraded': '2023-06-10T19:03:48.022931+0000', 'last_fullsized': '2023-06-10T19:03:48.022931+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:03:52.316 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.c is not active+clean 2023-06-10T19:03:52.316 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2023-06-10T19:03:47.032337+0000', 'last_change': '2023-06-10T19:03:47.032337+0000', 'last_active': '2023-06-10T19:03:47.019320+0000', 'last_peered': '2023-06-10T19:03:47.019320+0000', 'last_clean': '2023-06-10T19:03:47.019320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:47.032337+0000', 'last_undegraded': '2023-06-10T19:03:47.032337+0000', 'last_fullsized': '2023-06-10T19:03:47.032337+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-06-10T19:03:52.317 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.10 is not active+clean 2023-06-10T19:03:52.317 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:03:48.022931+0000', 'last_change': '2023-06-10T19:03:48.022931+0000', 'last_active': '2023-06-10T19:03:48.022931+0000', 'last_peered': '2023-06-10T19:03:48.022931+0000', 'last_clean': '2023-06-10T19:03:48.022931+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:48.022931+0000', 'last_undegraded': '2023-06-10T19:03:48.022931+0000', 'last_fullsized': '2023-06-10T19:03:48.022931+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:03:52.317 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.f is not active+clean 2023-06-10T19:03:52.318 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2023-06-10T19:03:47.037047+0000', 'last_change': '2023-06-10T19:03:47.037047+0000', 'last_active': '2023-06-10T19:03:47.019320+0000', 'last_peered': '2023-06-10T19:03:47.019320+0000', 'last_clean': '2023-06-10T19:03:47.019320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:47.037047+0000', 'last_undegraded': '2023-06-10T19:03:47.037047+0000', 'last_fullsized': '2023-06-10T19:03:47.037047+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-06-10T19:03:52.318 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.16 is not active+clean 2023-06-10T19:03:52.318 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:03:48.022931+0000', 'last_change': '2023-06-10T19:03:48.022931+0000', 'last_active': '2023-06-10T19:03:48.022931+0000', 'last_peered': '2023-06-10T19:03:48.022931+0000', 'last_clean': '2023-06-10T19:03:48.022931+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:48.022931+0000', 'last_undegraded': '2023-06-10T19:03:48.022931+0000', 'last_fullsized': '2023-06-10T19:03:48.022931+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:03:52.319 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.9 is not active+clean 2023-06-10T19:03:52.319 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2023-06-10T19:03:47.038249+0000', 'last_change': '2023-06-10T19:03:47.038249+0000', 'last_active': '2023-06-10T19:03:47.019320+0000', 'last_peered': '2023-06-10T19:03:47.019320+0000', 'last_clean': '2023-06-10T19:03:47.019320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:47.038249+0000', 'last_undegraded': '2023-06-10T19:03:47.038249+0000', 'last_fullsized': '2023-06-10T19:03:47.038249+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-06-10T19:03:52.319 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.17 is not active+clean 2023-06-10T19:03:52.320 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:03:48.022931+0000', 'last_change': '2023-06-10T19:03:48.022931+0000', 'last_active': '2023-06-10T19:03:48.022931+0000', 'last_peered': '2023-06-10T19:03:48.022931+0000', 'last_clean': '2023-06-10T19:03:48.022931+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:48.022931+0000', 'last_undegraded': '2023-06-10T19:03:48.022931+0000', 'last_fullsized': '2023-06-10T19:03:48.022931+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:03:52.320 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.8 is not active+clean 2023-06-10T19:03:52.320 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2023-06-10T19:03:47.044311+0000', 'last_change': '2023-06-10T19:03:47.044311+0000', 'last_active': '2023-06-10T19:03:47.019320+0000', 'last_peered': '2023-06-10T19:03:47.019320+0000', 'last_clean': '2023-06-10T19:03:47.019320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:47.044311+0000', 'last_undegraded': '2023-06-10T19:03:47.044311+0000', 'last_fullsized': '2023-06-10T19:03:47.044311+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-06-10T19:03:52.321 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.14 is not active+clean 2023-06-10T19:03:52.321 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:03:48.022931+0000', 'last_change': '2023-06-10T19:03:48.022931+0000', 'last_active': '2023-06-10T19:03:48.022931+0000', 'last_peered': '2023-06-10T19:03:48.022931+0000', 'last_clean': '2023-06-10T19:03:48.022931+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:48.022931+0000', 'last_undegraded': '2023-06-10T19:03:48.022931+0000', 'last_fullsized': '2023-06-10T19:03:48.022931+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:03:52.321 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.b is not active+clean 2023-06-10T19:03:52.321 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2023-06-10T19:03:47.043408+0000', 'last_change': '2023-06-10T19:03:47.043408+0000', 'last_active': '2023-06-10T19:03:47.019320+0000', 'last_peered': '2023-06-10T19:03:47.019320+0000', 'last_clean': '2023-06-10T19:03:47.019320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:47.043408+0000', 'last_undegraded': '2023-06-10T19:03:47.043408+0000', 'last_fullsized': '2023-06-10T19:03:47.043408+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-06-10T19:03:52.322 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.15 is not active+clean 2023-06-10T19:03:52.322 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:03:48.022931+0000', 'last_change': '2023-06-10T19:03:48.022931+0000', 'last_active': '2023-06-10T19:03:48.022931+0000', 'last_peered': '2023-06-10T19:03:48.022931+0000', 'last_clean': '2023-06-10T19:03:48.022931+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:48.022931+0000', 'last_undegraded': '2023-06-10T19:03:48.022931+0000', 'last_fullsized': '2023-06-10T19:03:48.022931+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:48.022931+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:03:52.322 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.a is not active+clean 2023-06-10T19:03:52.323 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2023-06-10T19:03:47.046167+0000', 'last_change': '2023-06-10T19:03:47.046167+0000', 'last_active': '2023-06-10T19:03:47.019320+0000', 'last_peered': '2023-06-10T19:03:47.019320+0000', 'last_clean': '2023-06-10T19:03:47.019320+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:03:47.046167+0000', 'last_undegraded': '2023-06-10T19:03:47.046167+0000', 'last_fullsized': '2023-06-10T19:03:47.046167+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'last_clean_scrub_stamp': '2023-06-10T19:03:47.019320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-06-10T19:03:52.323 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-06-10T19:03:52.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.457+0000 7fd5b50bd640 1 Processor -- start 2023-06-10T19:03:52.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.457+0000 7fd5b50bd640 1 -- start start 2023-06-10T19:03:52.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.461+0000 7fd5b50bd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd5b00cec40 0x7fd5b00cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:52.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.461+0000 7fd5b50bd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5b00cbf50 0x7fd5b00cc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:52.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.461+0000 7fd5b50bd640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5b00cbac0 con 0x7fd5b0159450 2023-06-10T19:03:52.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.461+0000 7fd5b50bd640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5b00cf600 con 0x7fd5b00cec40 2023-06-10T19:03:52.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.461+0000 7fd5b50bd640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b015dc00 con 0x7fd5b00cbf50 2023-06-10T19:03:52.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.461+0000 7fd5ae59c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd5b00cec40 0x7fd5b00cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:52.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.461+0000 7fd5ae59c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd5b00cec40 0x7fd5b00cf0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35004/0 (socket says 172.21.15.53:35004) 2023-06-10T19:03:52.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.461+0000 7fd5ae59c640 1 -- 172.21.15.53:0/3790811011 learned_addr learned my addr 172.21.15.53:0/3790811011 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:52.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.461+0000 7fd5af59e640 1 --2- 172.21.15.53:0/3790811011 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5b00cbf50 0x7fd5b00cc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:52.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.461+0000 7fd5ae59c640 1 -- 172.21.15.53:0/3790811011 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5b00cbf50 msgr2=0x7fd5b00cc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:52.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.461+0000 7fd5ae59c640 1 --2- 172.21.15.53:0/3790811011 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5b00cbf50 0x7fd5b00cc3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:52.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.461+0000 7fd5ae59c640 1 -- 172.21.15.53:0/3790811011 >> v1:172.21.15.117:6789/0 conn(0x7fd5b0159450 legacy=0x7fd5b015d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:52.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.461+0000 7fd5ae59c640 1 -- 172.21.15.53:0/3790811011 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5b015dee0 con 0x7fd5b00cec40 2023-06-10T19:03:52.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.461+0000 7fd5af59e640 1 --2- 172.21.15.53:0/3790811011 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5b00cbf50 0x7fd5b00cc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:03:52.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.465+0000 7fd5ae59c640 1 --2- 172.21.15.53:0/3790811011 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5b00cec40 0x7fd5b00cf0c0 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7fd598009870 tx=0x7fd59801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fff216125d49b185 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:52.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.465+0000 7fd5add9b640 1 -- 172.21.15.53:0/3790811011 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5980aa430 con 0x7fd5b00cec40 2023-06-10T19:03:52.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.465+0000 7fd5add9b640 1 -- 172.21.15.53:0/3790811011 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5980aa590 con 0x7fd5b00cec40 2023-06-10T19:03:52.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.465+0000 7fd5add9b640 1 -- 172.21.15.53:0/3790811011 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5980aa920 con 0x7fd5b00cec40 2023-06-10T19:03:52.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.465+0000 7fd5b50bd640 1 -- 172.21.15.53:0/3790811011 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5b00cec40 msgr2=0x7fd5b00cf0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:52.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.465+0000 7fd5b50bd640 1 --2- 172.21.15.53:0/3790811011 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5b00cec40 0x7fd5b00cf0c0 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7fd598009870 tx=0x7fd59801c510 comp rx=0 tx=0).stop 2023-06-10T19:03:52.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.465+0000 7fd5b50bd640 1 -- 172.21.15.53:0/3790811011 shutdown_connections 2023-06-10T19:03:52.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.465+0000 7fd5b50bd640 1 --2- 172.21.15.53:0/3790811011 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5b00cbf50 0x7fd5b00cc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:52.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.465+0000 7fd5b50bd640 1 --2- 172.21.15.53:0/3790811011 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5b00cec40 0x7fd5b00cf0c0 unknown :-1 s=CLOSED pgs=1730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:52.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.465+0000 7fd5b50bd640 1 -- 172.21.15.53:0/3790811011 >> 172.21.15.53:0/3790811011 conn(0x7fd5b006a090 msgr2=0x7fd5b006d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:52.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.465+0000 7fd5b50bd640 1 -- 172.21.15.53:0/3790811011 shutdown_connections 2023-06-10T19:03:52.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.465+0000 7fd5b50bd640 1 -- 172.21.15.53:0/3790811011 wait complete. 2023-06-10T19:03:52.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.465+0000 7fd5b50bd640 1 Processor -- start 2023-06-10T19:03:52.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.465+0000 7fd5b50bd640 1 -- start start 2023-06-10T19:03:52.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.465+0000 7fd5b50bd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5b00cbf50 0x7fd5b00b2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:52.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.465+0000 7fd5b50bd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5b00cec40 0x7fd5b0152b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:52.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.465+0000 7fd5b50bd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5b0159450 0x7fd5b0153090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:52.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.465+0000 7fd5b50bd640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b00b3580 con 0x7fd5b00cbf50 2023-06-10T19:03:52.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.465+0000 7fd5b50bd640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b00b3860 con 0x7fd5b0159450 2023-06-10T19:03:52.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.465+0000 7fd5b50bd640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b00b3b40 con 0x7fd5b00cec40 2023-06-10T19:03:52.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.465+0000 7fd5aed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5b00cbf50 0x7fd5b00b2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:52.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.465+0000 7fd5aed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5b00cbf50 0x7fd5b00b2c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35006/0 (socket says 172.21.15.53:35006) 2023-06-10T19:03:52.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.465+0000 7fd5aed9d640 1 -- 172.21.15.53:0/2475472192 learned_addr learned my addr 172.21.15.53:0/2475472192 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:52.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.465+0000 7fd5ae59c640 1 --2- 172.21.15.53:0/2475472192 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5b00cec40 0x7fd5b0152b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:52.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.465+0000 7fd5af59e640 1 --2- 172.21.15.53:0/2475472192 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5b0159450 0x7fd5b0153090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:52.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.465+0000 7fd5aed9d640 1 -- 172.21.15.53:0/2475472192 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5b00cec40 msgr2=0x7fd5b0152b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:52.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.465+0000 7fd5aed9d640 1 --2- 172.21.15.53:0/2475472192 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5b00cec40 0x7fd5b0152b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:52.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.465+0000 7fd5aed9d640 1 -- 172.21.15.53:0/2475472192 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5b0159450 msgr2=0x7fd5b0153090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:52.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.465+0000 7fd5aed9d640 1 --2- 172.21.15.53:0/2475472192 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5b0159450 0x7fd5b0153090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:52.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.469+0000 7fd5aed9d640 1 -- 172.21.15.53:0/2475472192 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5980094d0 con 0x7fd5b00cbf50 2023-06-10T19:03:52.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.469+0000 7fd5aed9d640 1 --2- 172.21.15.53:0/2475472192 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5b00cbf50 0x7fd5b00b2c80 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7fd5a800c7f0 tx=0x7fd5a800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:52.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.469+0000 7fd5a77fe640 1 -- 172.21.15.53:0/2475472192 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a8003b80 con 0x7fd5b00cbf50 2023-06-10T19:03:52.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.469+0000 7fd5a77fe640 1 -- 172.21.15.53:0/2475472192 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5a8003ce0 con 0x7fd5b00cbf50 2023-06-10T19:03:52.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.469+0000 7fd5b50bd640 1 -- 172.21.15.53:0/2475472192 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5b015d9d0 con 0x7fd5b00cbf50 2023-06-10T19:03:52.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.469+0000 7fd5a77fe640 1 -- 172.21.15.53:0/2475472192 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a800aa90 con 0x7fd5b00cbf50 2023-06-10T19:03:52.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.469+0000 7fd5b50bd640 1 -- 172.21.15.53:0/2475472192 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5b00b4100 con 0x7fd5b00cbf50 2023-06-10T19:03:52.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.469+0000 7fd5b50bd640 1 -- 172.21.15.53:0/2475472192 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5b00b42f0 con 0x7fd5b00cbf50 2023-06-10T19:03:52.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.469+0000 7fd5a77fe640 1 -- 172.21.15.53:0/2475472192 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd5a800abf0 con 0x7fd5b00cbf50 2023-06-10T19:03:52.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.469+0000 7fd5a77fe640 1 --2- 172.21.15.53:0/2475472192 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd590066280 0x7fd590068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:52.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.469+0000 7fd5a77fe640 1 -- 172.21.15.53:0/2475472192 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd5a8083c50 con 0x7fd5b00cbf50 2023-06-10T19:03:52.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.469+0000 7fd5ae59c640 1 --2- 172.21.15.53:0/2475472192 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd590066280 0x7fd590068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:52.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.469+0000 7fd5ae59c640 1 --2- 172.21.15.53:0/2475472192 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd590066280 0x7fd590068730 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fd5980ae000 tx=0x7fd5980a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:52.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.473+0000 7fd5a77fe640 1 -- 172.21.15.53:0/2475472192 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd5a8089020 con 0x7fd5b00cbf50 2023-06-10T19:03:52.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.689+0000 7fd5b50bd640 1 -- 172.21.15.53:0/2475472192 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fd5b015d820 con 0x7fd5b00cbf50 2023-06-10T19:03:52.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.689+0000 7fd5a77fe640 1 -- 172.21.15.53:0/2475472192 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1111 (secure 0 0 0) 0x7fd5a80510d0 con 0x7fd5b00cbf50 2023-06-10T19:03:52.692 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:03:52.692 INFO:teuthology.orchestra.run.smithi053.stdout:{"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":691,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":110,"num_osds":8,"num_up_osds":8,"osd_up_since":1686423152,"num_in_osds":8,"osd_in_since":1686423143,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":9}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":266067968,"bytes_avail":772828045312,"bytes_total":773094113280,"unknown_pgs_ratio":0.60952383279800415,"inactive_pgs_ratio":0.30476191639900208},"fsmap":{"epoch":61,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"a","status":"up:active","gid":8685}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":13,"modified":"2023-06-10T19:03:37.797507+0000","services":{}},"progress_events":{}} 2023-06-10T19:03:52.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.689+0000 7fd5b50bd640 1 -- 172.21.15.53:0/2475472192 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd590066280 msgr2=0x7fd590068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:52.695 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.689+0000 7fd5b50bd640 1 --2- 172.21.15.53:0/2475472192 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd590066280 0x7fd590068730 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fd5980ae000 tx=0x7fd5980a7000 comp rx=0 tx=0).stop 2023-06-10T19:03:52.695 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.689+0000 7fd5b50bd640 1 -- 172.21.15.53:0/2475472192 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5b00cbf50 msgr2=0x7fd5b00b2c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:52.695 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.689+0000 7fd5b50bd640 1 --2- 172.21.15.53:0/2475472192 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5b00cbf50 0x7fd5b00b2c80 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7fd5a800c7f0 tx=0x7fd5a800ccb0 comp rx=0 tx=0).stop 2023-06-10T19:03:52.695 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.689+0000 7fd5b50bd640 1 -- 172.21.15.53:0/2475472192 shutdown_connections 2023-06-10T19:03:52.695 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.689+0000 7fd5b50bd640 1 --2- 172.21.15.53:0/2475472192 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd590066280 0x7fd590068730 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:52.695 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.689+0000 7fd5b50bd640 1 --2- 172.21.15.53:0/2475472192 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5b0159450 0x7fd5b0153090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:52.695 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.689+0000 7fd5b50bd640 1 --2- 172.21.15.53:0/2475472192 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5b00cec40 0x7fd5b0152b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:52.696 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.689+0000 7fd5b50bd640 1 --2- 172.21.15.53:0/2475472192 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5b00cbf50 0x7fd5b00b2c80 unknown :-1 s=CLOSED pgs=1731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:52.696 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.689+0000 7fd5b50bd640 1 -- 172.21.15.53:0/2475472192 >> 172.21.15.53:0/2475472192 conn(0x7fd5b006a090 msgr2=0x7fd5b00b1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:52.696 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.689+0000 7fd5b50bd640 1 -- 172.21.15.53:0/2475472192 shutdown_connections 2023-06-10T19:03:52.696 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.689+0000 7fd5b50bd640 1 -- 172.21.15.53:0/2475472192 wait complete. 2023-06-10T19:03:52.712 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-06-10T19:03:52.713 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-10T19:03:52.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.837+0000 7ff80c6a7640 1 Processor -- start 2023-06-10T19:03:52.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.837+0000 7ff80c6a7640 1 -- start start 2023-06-10T19:03:52.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.837+0000 7ff80c6a7640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff80406b2f0 0x7ff80406f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:52.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.837+0000 7ff80c6a7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff804160170 0x7ff804162550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:52.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.837+0000 7ff80c6a7640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff804158a90 con 0x7ff8040c8d00 2023-06-10T19:03:52.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.837+0000 7ff80c6a7640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8040705d0 con 0x7ff804160170 2023-06-10T19:03:52.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.837+0000 7ff80c6a7640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8040cce10 con 0x7ff80406b2f0 2023-06-10T19:03:52.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.837+0000 7ff80ac44640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff804160170 0x7ff804162550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:52.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.837+0000 7ff80ac44640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff804160170 0x7ff804162550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35020/0 (socket says 172.21.15.53:35020) 2023-06-10T19:03:52.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.837+0000 7ff809c42640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ff8040c8d00 0x7ff80406b6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:59486/0 (socket says 172.21.15.53:59486) 2023-06-10T19:03:52.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.837+0000 7ff80ac44640 1 -- 172.21.15.53:0/1476731743 learned_addr learned my addr 172.21.15.53:0/1476731743 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:52.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.837+0000 7ff80a443640 1 --2- 172.21.15.53:0/1476731743 >> v2:172.21.15.117:3300/0 conn(0x7ff80406b2f0 0x7ff80406f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:52.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.837+0000 7ff80ac44640 1 -- 172.21.15.53:0/1476731743 >> v2:172.21.15.117:3300/0 conn(0x7ff80406b2f0 msgr2=0x7ff80406f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:52.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.837+0000 7ff80ac44640 1 --2- 172.21.15.53:0/1476731743 >> v2:172.21.15.117:3300/0 conn(0x7ff80406b2f0 0x7ff80406f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:52.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.837+0000 7ff80ac44640 1 -- 172.21.15.53:0/1476731743 >> v1:172.21.15.53:6789/0 conn(0x7ff8040c8d00 legacy=0x7ff80406b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:52.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.837+0000 7ff80ac44640 1 -- 172.21.15.53:0/1476731743 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff80406f9c0 con 0x7ff804160170 2023-06-10T19:03:52.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.837+0000 7ff809441640 1 -- 172.21.15.53:0/1476731743 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2612695132 0 0) 0x7ff7f8001120 con 0x7ff8040c8d00 2023-06-10T19:03:52.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.841+0000 7ff80ac44640 1 --2- 172.21.15.53:0/1476731743 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff804160170 0x7ff804162550 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7ff804071d80 tx=0x7ff7f401ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4edf63571cc97d server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:52.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.841+0000 7ff809441640 1 -- 172.21.15.53:0/1476731743 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f40a89f0 con 0x7ff804160170 2023-06-10T19:03:52.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.841+0000 7ff809441640 1 -- 172.21.15.53:0/1476731743 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7f40a8b50 con 0x7ff804160170 2023-06-10T19:03:52.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.841+0000 7ff809441640 1 -- 172.21.15.53:0/1476731743 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f40b0440 con 0x7ff804160170 2023-06-10T19:03:52.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.841+0000 7ff80c6a7640 1 -- 172.21.15.53:0/1476731743 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff804160170 msgr2=0x7ff804162550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:52.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.841+0000 7ff80c6a7640 1 --2- 172.21.15.53:0/1476731743 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff804160170 0x7ff804162550 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7ff804071d80 tx=0x7ff7f401ecf0 comp rx=0 tx=0).stop 2023-06-10T19:03:52.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.841+0000 7ff80c6a7640 1 -- 172.21.15.53:0/1476731743 shutdown_connections 2023-06-10T19:03:52.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.841+0000 7ff80c6a7640 1 --2- 172.21.15.53:0/1476731743 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff804160170 0x7ff804162550 unknown :-1 s=CLOSED pgs=1733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:52.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.841+0000 7ff80c6a7640 1 --2- 172.21.15.53:0/1476731743 >> v2:172.21.15.117:3300/0 conn(0x7ff80406b2f0 0x7ff80406f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:52.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.841+0000 7ff80c6a7640 1 -- 172.21.15.53:0/1476731743 >> 172.21.15.53:0/1476731743 conn(0x7ff80406a0d0 msgr2=0x7ff8040ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:52.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.841+0000 7ff80c6a7640 1 -- 172.21.15.53:0/1476731743 shutdown_connections 2023-06-10T19:03:52.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.841+0000 7ff80c6a7640 1 -- 172.21.15.53:0/1476731743 wait complete. 2023-06-10T19:03:52.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.845+0000 7ff80c6a7640 1 Processor -- start 2023-06-10T19:03:52.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.845+0000 7ff80c6a7640 1 -- start start 2023-06-10T19:03:52.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.845+0000 7ff80c6a7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff80406b2f0 0x7ff8040c5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:52.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.845+0000 7ff80c6a7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8040c8d00 0x7ff8041f2260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:52.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.845+0000 7ff80c6a7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff804160170 0x7ff8040c7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:52.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.845+0000 7ff80c6a7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8040c5a60 con 0x7ff80406b2f0 2023-06-10T19:03:52.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.845+0000 7ff80c6a7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8040c7270 con 0x7ff8040c8d00 2023-06-10T19:03:52.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.845+0000 7ff80c6a7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8041f27a0 con 0x7ff804160170 2023-06-10T19:03:52.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.845+0000 7ff80a443640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff80406b2f0 0x7ff8040c5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:52.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.845+0000 7ff80a443640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff80406b2f0 0x7ff8040c5520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35030/0 (socket says 172.21.15.53:35030) 2023-06-10T19:03:52.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.845+0000 7ff80a443640 1 -- 172.21.15.53:0/2525249104 learned_addr learned my addr 172.21.15.53:0/2525249104 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:52.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.845+0000 7ff809c42640 1 --2- 172.21.15.53:0/2525249104 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8040c8d00 0x7ff8041f2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:52.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.845+0000 7ff80ac44640 1 --2- 172.21.15.53:0/2525249104 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff804160170 0x7ff8040c7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:52.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.845+0000 7ff80a443640 1 -- 172.21.15.53:0/2525249104 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff804160170 msgr2=0x7ff8040c7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:52.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.845+0000 7ff80a443640 1 --2- 172.21.15.53:0/2525249104 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff804160170 0x7ff8040c7700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:52.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.845+0000 7ff80a443640 1 -- 172.21.15.53:0/2525249104 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8040c8d00 msgr2=0x7ff8041f2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:52.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.845+0000 7ff80a443640 1 --2- 172.21.15.53:0/2525249104 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8040c8d00 0x7ff8041f2260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:52.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.845+0000 7ff80a443640 1 -- 172.21.15.53:0/2525249104 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7f40094d0 con 0x7ff80406b2f0 2023-06-10T19:03:52.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.845+0000 7ff80a443640 1 --2- 172.21.15.53:0/2525249104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff80406b2f0 0x7ff8040c5520 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc007ef0 tx=0x7ff7fc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:52.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.845+0000 7ff802ffd640 1 -- 172.21.15.53:0/2525249104 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7fc014620 con 0x7ff80406b2f0 2023-06-10T19:03:52.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.845+0000 7ff802ffd640 1 -- 172.21.15.53:0/2525249104 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7fc014780 con 0x7ff80406b2f0 2023-06-10T19:03:52.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.845+0000 7ff80c6a7640 1 -- 172.21.15.53:0/2525249104 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8041f2a40 con 0x7ff80406b2f0 2023-06-10T19:03:52.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.845+0000 7ff802ffd640 1 -- 172.21.15.53:0/2525249104 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7fc014b30 con 0x7ff80406b2f0 2023-06-10T19:03:52.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.845+0000 7ff80c6a7640 1 -- 172.21.15.53:0/2525249104 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8041f3000 con 0x7ff80406b2f0 2023-06-10T19:03:52.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.845+0000 7ff80c6a7640 1 -- 172.21.15.53:0/2525249104 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff80404d790 con 0x7ff80406b2f0 2023-06-10T19:03:52.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.845+0000 7ff802ffd640 1 -- 172.21.15.53:0/2525249104 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff7fc014c90 con 0x7ff80406b2f0 2023-06-10T19:03:52.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.845+0000 7ff802ffd640 1 --2- 172.21.15.53:0/2525249104 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff7f0066280 0x7ff7f0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:52.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.845+0000 7ff802ffd640 1 -- 172.21.15.53:0/2525249104 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff7fc0847f0 con 0x7ff80406b2f0 2023-06-10T19:03:52.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.849+0000 7ff809c42640 1 --2- 172.21.15.53:0/2525249104 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff7f0066280 0x7ff7f0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:52.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.849+0000 7ff809c42640 1 --2- 172.21.15.53:0/2525249104 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff7f0066280 0x7ff7f0068730 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7ff804152a20 tx=0x7ff7f80079c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:52.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:52.849+0000 7ff802ffd640 1 -- 172.21.15.53:0/2525249104 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff7fc051bd0 con 0x7ff80406b2f0 2023-06-10T19:03:53.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:53.001+0000 7ff80c6a7640 1 -- 172.21.15.53:0/2525249104 --> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff80406ff80 con 0x7ff7f0066280 2023-06-10T19:03:53.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:53.025+0000 7ff802ffd640 1 -- 172.21.15.53:0/2525249104 <== mgr.4105 v2:172.21.15.117:6832/3061986771 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+298377 (secure 0 0 0) 0x7ff7f8001450 con 0x7ff7f0066280 2023-06-10T19:03:53.029 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:03:53.033 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-06-10T19:03:53.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:53.029+0000 7ff80c6a7640 1 -- 172.21.15.53:0/2525249104 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff7f0066280 msgr2=0x7ff7f0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:53.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:53.029+0000 7ff80c6a7640 1 --2- 172.21.15.53:0/2525249104 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff7f0066280 0x7ff7f0068730 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7ff804152a20 tx=0x7ff7f80079c0 comp rx=0 tx=0).stop 2023-06-10T19:03:53.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:53.029+0000 7ff80c6a7640 1 -- 172.21.15.53:0/2525249104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff80406b2f0 msgr2=0x7ff8040c5520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:53.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:53.029+0000 7ff80c6a7640 1 --2- 172.21.15.53:0/2525249104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff80406b2f0 0x7ff8040c5520 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc007ef0 tx=0x7ff7fc00e4b0 comp rx=0 tx=0).stop 2023-06-10T19:03:53.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:53.029+0000 7ff80c6a7640 1 -- 172.21.15.53:0/2525249104 shutdown_connections 2023-06-10T19:03:53.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:53.029+0000 7ff80c6a7640 1 --2- 172.21.15.53:0/2525249104 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff7f0066280 0x7ff7f0068730 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:53.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:53.029+0000 7ff80c6a7640 1 --2- 172.21.15.53:0/2525249104 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff804160170 0x7ff8040c7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:53.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:53.029+0000 7ff80c6a7640 1 --2- 172.21.15.53:0/2525249104 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8040c8d00 0x7ff8041f2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:53.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:53.029+0000 7ff80c6a7640 1 --2- 172.21.15.53:0/2525249104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff80406b2f0 0x7ff8040c5520 unknown :-1 s=CLOSED pgs=1734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:53.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:53.029+0000 7ff80c6a7640 1 -- 172.21.15.53:0/2525249104 >> 172.21.15.53:0/2525249104 conn(0x7ff80406a0d0 msgr2=0x7ff8040b3180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:53.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:53.029+0000 7ff80c6a7640 1 -- 172.21.15.53:0/2525249104 shutdown_connections 2023-06-10T19:03:53.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:53.029+0000 7ff80c6a7640 1 -- 172.21.15.53:0/2525249104 wait complete. 2023-06-10T19:03:53.051 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":443,"stamp":"2023-06-10T19:03:51.801430+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":29,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":259832,"kb_used_data":11448,"kb_used_omap":0,"kb_used_meta":248320,"kb_avail":754714888,"statfs":{"total":773094113280,"available":772828045312,"internally_reserved":0,"allocated":11722752,"data_stored":6012697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":254279680},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.774191"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.039078+0000","last_change":"2023-06-10T19:03:47.039078+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.039078+0000","last_undegraded":"2023-06-10T19:03:47.039078+0000","last_fullsized":"2023-06-10T19:03:47.039078+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.043540+0000","last_change":"2023-06-10T19:03:47.043540+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.043540+0000","last_undegraded":"2023-06-10T19:03:47.043540+0000","last_fullsized":"2023-06-10T19:03:47.043540+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.029988+0000","last_change":"2023-06-10T19:03:47.029988+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.029988+0000","last_undegraded":"2023-06-10T19:03:47.029988+0000","last_fullsized":"2023-06-10T19:03:47.029988+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.040924+0000","last_change":"2023-06-10T19:03:47.040924+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.040924+0000","last_undegraded":"2023-06-10T19:03:47.040924+0000","last_fullsized":"2023-06-10T19:03:47.040924+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.043064+0000","last_change":"2023-06-10T19:03:47.043064+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.043064+0000","last_undegraded":"2023-06-10T19:03:47.043064+0000","last_fullsized":"2023-06-10T19:03:47.043064+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.032572+0000","last_change":"2023-06-10T19:03:47.032572+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.032572+0000","last_undegraded":"2023-06-10T19:03:47.032572+0000","last_fullsized":"2023-06-10T19:03:47.032572+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.029778+0000","last_change":"2023-06-10T19:03:47.029778+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.029778+0000","last_undegraded":"2023-06-10T19:03:47.029778+0000","last_fullsized":"2023-06-10T19:03:47.029778+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.039108+0000","last_change":"2023-06-10T19:03:47.039108+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.039108+0000","last_undegraded":"2023-06-10T19:03:47.039108+0000","last_fullsized":"2023-06-10T19:03:47.039108+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.031636+0000","last_change":"2023-06-10T19:03:47.031636+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.031636+0000","last_undegraded":"2023-06-10T19:03:47.031636+0000","last_fullsized":"2023-06-10T19:03:47.031636+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.032280+0000","last_change":"2023-06-10T19:03:47.032280+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.032280+0000","last_undegraded":"2023-06-10T19:03:47.032280+0000","last_fullsized":"2023-06-10T19:03:47.032280+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.044181+0000","last_change":"2023-06-10T19:03:47.044181+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.044181+0000","last_undegraded":"2023-06-10T19:03:47.044181+0000","last_fullsized":"2023-06-10T19:03:47.044181+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.037025+0000","last_change":"2023-06-10T19:03:47.037025+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.037025+0000","last_undegraded":"2023-06-10T19:03:47.037025+0000","last_fullsized":"2023-06-10T19:03:47.037025+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.040771+0000","last_change":"2023-06-10T19:03:47.040771+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.040771+0000","last_undegraded":"2023-06-10T19:03:47.040771+0000","last_fullsized":"2023-06-10T19:03:47.040771+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.039179+0000","last_change":"2023-06-10T19:03:47.039179+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.039179+0000","last_undegraded":"2023-06-10T19:03:47.039179+0000","last_fullsized":"2023-06-10T19:03:47.039179+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.043519+0000","last_change":"2023-06-10T19:03:47.043519+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.043519+0000","last_undegraded":"2023-06-10T19:03:47.043519+0000","last_fullsized":"2023-06-10T19:03:47.043519+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.029942+0000","last_change":"2023-06-10T19:03:47.029942+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.029942+0000","last_undegraded":"2023-06-10T19:03:47.029942+0000","last_fullsized":"2023-06-10T19:03:47.029942+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.041570+0000","last_change":"2023-06-10T19:03:47.041570+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.041570+0000","last_undegraded":"2023-06-10T19:03:47.041570+0000","last_fullsized":"2023-06-10T19:03:47.041570+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.031554+0000","last_change":"2023-06-10T19:03:47.031554+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.031554+0000","last_undegraded":"2023-06-10T19:03:47.031554+0000","last_fullsized":"2023-06-10T19:03:47.031554+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.037091+0000","last_change":"2023-06-10T19:03:47.037091+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.037091+0000","last_undegraded":"2023-06-10T19:03:47.037091+0000","last_fullsized":"2023-06-10T19:03:47.037091+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.041468+0000","last_change":"2023-06-10T19:03:47.041468+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.041468+0000","last_undegraded":"2023-06-10T19:03:47.041468+0000","last_fullsized":"2023-06-10T19:03:47.041468+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.029967+0000","last_change":"2023-06-10T19:03:47.029967+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.029967+0000","last_undegraded":"2023-06-10T19:03:47.029967+0000","last_fullsized":"2023-06-10T19:03:47.029967+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.043508+0000","last_change":"2023-06-10T19:03:47.043508+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.043508+0000","last_undegraded":"2023-06-10T19:03:47.043508+0000","last_fullsized":"2023-06-10T19:03:47.043508+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.036902+0000","last_change":"2023-06-10T19:03:47.036902+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.036902+0000","last_undegraded":"2023-06-10T19:03:47.036902+0000","last_fullsized":"2023-06-10T19:03:47.036902+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.043502+0000","last_change":"2023-06-10T19:03:47.043502+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.043502+0000","last_undegraded":"2023-06-10T19:03:47.043502+0000","last_fullsized":"2023-06-10T19:03:47.043502+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.044354+0000","last_change":"2023-06-10T19:03:47.044354+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.044354+0000","last_undegraded":"2023-06-10T19:03:47.044354+0000","last_fullsized":"2023-06-10T19:03:47.044354+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":324,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-06-10T19:03:47.045429+0000","last_change":"2023-06-10T18:52:34.951528+0000","last_active":"2023-06-10T19:03:47.045429+0000","last_peered":"2023-06-10T19:03:47.045429+0000","last_clean":"2023-06-10T19:03:47.045429+0000","last_became_active":"2023-06-10T18:52:34.949099+0000","last_became_peered":"2023-06-10T18:52:34.949099+0000","last_unstale":"2023-06-10T19:03:47.045429+0000","last_undegraded":"2023-06-10T19:03:47.045429+0000","last_fullsized":"2023-06-10T19:03:47.045429+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_clean_scrub_stamp":"2023-06-10T18:52:33.633295+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:00:35.924767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":176,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-06-10T19:03:47.033648+0000","last_change":"2023-06-10T18:52:40.506384+0000","last_active":"2023-06-10T19:03:47.033648+0000","last_peered":"2023-06-10T19:03:47.033648+0000","last_clean":"2023-06-10T19:03:47.033648+0000","last_became_active":"2023-06-10T18:52:40.505701+0000","last_became_peered":"2023-06-10T18:52:40.505701+0000","last_unstale":"2023-06-10T19:03:47.033648+0000","last_undegraded":"2023-06-10T19:03:47.033648+0000","last_fullsized":"2023-06-10T19:03:47.033648+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:05:06.232347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.043040+0000","last_change":"2023-06-10T19:03:47.043040+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.043040+0000","last_undegraded":"2023-06-10T19:03:47.043040+0000","last_fullsized":"2023-06-10T19:03:47.043040+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":168,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-06-10T19:03:47.045062+0000","last_change":"2023-06-10T18:52:40.512015+0000","last_active":"2023-06-10T19:03:47.045062+0000","last_peered":"2023-06-10T19:03:47.045062+0000","last_clean":"2023-06-10T19:03:47.045062+0000","last_became_active":"2023-06-10T18:52:40.511382+0000","last_became_peered":"2023-06-10T18:52:40.511382+0000","last_unstale":"2023-06-10T19:03:47.045062+0000","last_undegraded":"2023-06-10T19:03:47.045062+0000","last_fullsized":"2023-06-10T19:03:47.045062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:22:14.438906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.032337+0000","last_change":"2023-06-10T19:03:47.032337+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.032337+0000","last_undegraded":"2023-06-10T19:03:47.032337+0000","last_fullsized":"2023-06-10T19:03:47.032337+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":174,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-06-10T19:03:47.046617+0000","last_change":"2023-06-10T18:52:40.671725+0000","last_active":"2023-06-10T19:03:47.046617+0000","last_peered":"2023-06-10T19:03:47.046617+0000","last_clean":"2023-06-10T19:03:47.046617+0000","last_became_active":"2023-06-10T18:52:40.671442+0000","last_became_peered":"2023-06-10T18:52:40.671442+0000","last_unstale":"2023-06-10T19:03:47.046617+0000","last_undegraded":"2023-06-10T19:03:47.046617+0000","last_fullsized":"2023-06-10T19:03:47.046617+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:29:58.957321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.037047+0000","last_change":"2023-06-10T19:03:47.037047+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.037047+0000","last_undegraded":"2023-06-10T19:03:47.037047+0000","last_fullsized":"2023-06-10T19:03:47.037047+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":176,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-06-10T19:03:47.033990+0000","last_change":"2023-06-10T18:52:40.510258+0000","last_active":"2023-06-10T19:03:47.033990+0000","last_peered":"2023-06-10T19:03:47.033990+0000","last_clean":"2023-06-10T19:03:47.033990+0000","last_became_active":"2023-06-10T18:52:40.509560+0000","last_became_peered":"2023-06-10T18:52:40.509560+0000","last_unstale":"2023-06-10T19:03:47.033990+0000","last_undegraded":"2023-06-10T19:03:47.033990+0000","last_fullsized":"2023-06-10T19:03:47.033990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:17:30.476535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.038249+0000","last_change":"2023-06-10T19:03:47.038249+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.038249+0000","last_undegraded":"2023-06-10T19:03:47.038249+0000","last_fullsized":"2023-06-10T19:03:47.038249+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":162,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-06-10T19:03:47.042725+0000","last_change":"2023-06-10T18:52:40.672266+0000","last_active":"2023-06-10T19:03:47.042725+0000","last_peered":"2023-06-10T19:03:47.042725+0000","last_clean":"2023-06-10T19:03:47.042725+0000","last_became_active":"2023-06-10T18:52:40.671966+0000","last_became_peered":"2023-06-10T18:52:40.671966+0000","last_unstale":"2023-06-10T19:03:47.042725+0000","last_undegraded":"2023-06-10T19:03:47.042725+0000","last_fullsized":"2023-06-10T19:03:47.042725+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:56:43.883781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.044311+0000","last_change":"2023-06-10T19:03:47.044311+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.044311+0000","last_undegraded":"2023-06-10T19:03:47.044311+0000","last_fullsized":"2023-06-10T19:03:47.044311+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":168,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-06-10T19:03:47.045328+0000","last_change":"2023-06-10T18:52:40.671084+0000","last_active":"2023-06-10T19:03:47.045328+0000","last_peered":"2023-06-10T19:03:47.045328+0000","last_clean":"2023-06-10T19:03:47.045328+0000","last_became_active":"2023-06-10T18:52:40.670697+0000","last_became_peered":"2023-06-10T18:52:40.670697+0000","last_unstale":"2023-06-10T19:03:47.045328+0000","last_undegraded":"2023-06-10T19:03:47.045328+0000","last_fullsized":"2023-06-10T19:03:47.045328+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:33:42.833010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.043408+0000","last_change":"2023-06-10T19:03:47.043408+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.043408+0000","last_undegraded":"2023-06-10T19:03:47.043408+0000","last_fullsized":"2023-06-10T19:03:47.043408+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":162,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-06-10T19:03:47.042650+0000","last_change":"2023-06-10T18:52:40.514114+0000","last_active":"2023-06-10T19:03:47.042650+0000","last_peered":"2023-06-10T19:03:47.042650+0000","last_clean":"2023-06-10T19:03:47.042650+0000","last_became_active":"2023-06-10T18:52:40.513638+0000","last_became_peered":"2023-06-10T18:52:40.513638+0000","last_unstale":"2023-06-10T19:03:47.042650+0000","last_undegraded":"2023-06-10T19:03:47.042650+0000","last_fullsized":"2023-06-10T19:03:47.042650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:50:41.193183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:03:48.022931+0000","last_change":"2023-06-10T19:03:48.022931+0000","last_active":"2023-06-10T19:03:48.022931+0000","last_peered":"2023-06-10T19:03:48.022931+0000","last_clean":"2023-06-10T19:03:48.022931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:48.022931+0000","last_undegraded":"2023-06-10T19:03:48.022931+0000","last_fullsized":"2023-06-10T19:03:48.022931+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2023-06-10T19:03:47.046167+0000","last_change":"2023-06-10T19:03:47.046167+0000","last_active":"2023-06-10T19:03:47.019320+0000","last_peered":"2023-06-10T19:03:47.019320+0000","last_clean":"2023-06-10T19:03:47.019320+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:03:47.046167+0000","last_undegraded":"2023-06-10T19:03:47.046167+0000","last_fullsized":"2023-06-10T19:03:47.046167+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":168,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-06-10T19:03:47.039351+0000","last_change":"2023-06-10T18:52:40.515396+0000","last_active":"2023-06-10T19:03:47.039351+0000","last_peered":"2023-06-10T19:03:47.039351+0000","last_clean":"2023-06-10T19:03:47.039351+0000","last_became_active":"2023-06-10T18:52:40.514663+0000","last_became_peered":"2023-06-10T18:52:40.514663+0000","last_unstale":"2023-06-10T19:03:47.039351+0000","last_undegraded":"2023-06-10T19:03:47.039351+0000","last_fullsized":"2023-06-10T19:03:47.039351+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:33:27.036737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574986,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32908,"kb_used_data":1860,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338932,"statfs":{"total":96636764160,"available":96603066368,"internally_reserved":0,"allocated":1904640,"data_stored":1190889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:02:54 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.95199999999999996,"15min":0.91000000000000003},"min":{"1min":0.64700000000000002,"5min":0.54700000000000004,"15min":0.434},"max":{"1min":1.198,"5min":1.327,"15min":1.6220000000000001},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.93899999999999995,"15min":0.92900000000000005},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.496},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.6870000000000001},"last":0.66700000000000004}]},{"osd":1,"last update":"Sat Jun 10 19:02:54 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.92600000000000005,"15min":0.92400000000000004},"min":{"1min":0.623,"5min":0.55100000000000005,"15min":0.53900000000000003},"max":{"1min":1.2350000000000001,"5min":1.262,"15min":1.377},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.97299999999999998,"15min":0.93999999999999995},"min":{"1min":0.68700000000000006,"5min":0.66300000000000003,"15min":0.504},"max":{"1min":1.161,"5min":1.234,"15min":1.5960000000000001},"last":0.57999999999999996}]},{"osd":2,"last update":"Sat Jun 10 19:02:54 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.85699999999999998,"15min":0.83999999999999997},"min":{"1min":0.57999999999999996,"5min":0.52100000000000002,"15min":0.47099999999999997},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.4059999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.91800000000000004,"15min":0.90300000000000002},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.50600000000000001},"max":{"1min":1.1839999999999999,"5min":1.448,"15min":1.448},"last":1.1240000000000001}]},{"osd":3,"last update":"Sat Jun 10 19:02:54 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.94399999999999995,"15min":0.92200000000000004},"min":{"1min":0.71199999999999997,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.2350000000000001,"5min":1.2370000000000001,"15min":1.502},"last":0.629},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.98999999999999999,"15min":0.94699999999999995},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.53800000000000003},"max":{"1min":1.276,"5min":1.284,"15min":1.2929999999999999},"last":1.0289999999999999}]},{"osd":4,"last update":"Sat Jun 10 19:02:54 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.82499999999999996,"15min":0.85399999999999998},"min":{"1min":0.58699999999999997,"5min":0.39500000000000002,"15min":0.32700000000000001},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.639},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.98499999999999999,"15min":0.97299999999999998},"min":{"1min":0.81999999999999995,"5min":0.434,"15min":0.40000000000000002},"max":{"1min":1.454,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.083}]},{"osd":5,"last update":"Sat Jun 10 19:02:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.002,"15min":1.014},"min":{"1min":0.70899999999999996,"5min":0.40500000000000003,"15min":0.38400000000000001},"max":{"1min":1.2809999999999999,"5min":1.395,"15min":1.806},"last":1.175},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.0489999999999999,"15min":1.042},"min":{"1min":0.745,"5min":0.505,"15min":0.46500000000000002},"max":{"1min":1.393,"5min":1.579,"15min":1.579},"last":0.94099999999999995}]},{"osd":6,"last update":"Sat Jun 10 19:02:54 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.0329999999999999,"15min":1.0089999999999999},"min":{"1min":0.73599999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.2909999999999999,"5min":1.391,"15min":1.718},"last":0.97799999999999998},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.1259999999999999,"15min":1.099},"min":{"1min":0.99399999999999999,"5min":0.48799999999999999,"15min":0.441},"max":{"1min":1.329,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":1.1539999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574987,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32340,"kb_used_data":1292,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339500,"statfs":{"total":96636764160,"available":96603648000,"internally_reserved":0,"allocated":1323008,"data_stored":606691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:02:46 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.873,"15min":0.84699999999999998},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.167,"5min":1.3129999999999999,"15min":1.498},"last":1.202},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.89400000000000002,"15min":0.86899999999999999},"min":{"1min":0.57199999999999995,"5min":0.46899999999999997,"15min":0.46100000000000002},"max":{"1min":1.167,"5min":1.496,"15min":1.496},"last":0.79500000000000004}]},{"osd":1,"last update":"Sat Jun 10 19:02:46 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.86499999999999999,"15min":0.86099999999999999},"min":{"1min":0.54900000000000004,"5min":0.502,"15min":0.48699999999999999},"max":{"1min":1.046,"5min":1.143,"15min":1.5229999999999999},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91700000000000004,"15min":0.88800000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.45300000000000001},"max":{"1min":1.258,"5min":1.258,"15min":1.778},"last":1.0209999999999999}]},{"osd":2,"last update":"Sat Jun 10 19:02:46 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.92500000000000004,"15min":0.88800000000000001},"min":{"1min":0.66200000000000003,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.2809999999999999,"5min":1.3240000000000001,"15min":1.3759999999999999},"last":0.87},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.89800000000000002,"15min":0.89000000000000001},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.22,"5min":1.2330000000000001,"15min":1.246},"last":1.0569999999999999}]},{"osd":3,"last update":"Sat Jun 10 19:02:46 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.93600000000000005,"15min":0.89700000000000002},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.52700000000000002},"max":{"1min":1.1659999999999999,"5min":1.222,"15min":1.7190000000000001},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.012,"5min":0.98999999999999999,"15min":0.99299999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.371,"5min":1.371,"15min":1.4370000000000001},"last":1.0920000000000001}]},{"osd":4,"last update":"Sat Jun 10 19:02:46 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.88500000000000001,"15min":0.92500000000000004},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.401,"5min":1.401,"15min":1.798},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.95499999999999996,"15min":0.99299999999999999},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.357,"5min":1.357,"15min":1.5489999999999999},"last":0.98599999999999999}]},{"osd":5,"last update":"Sat Jun 10 19:02:46 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.89700000000000002,"15min":0.93100000000000005},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.29,"5min":1.29,"15min":1.333},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.96599999999999997,"5min":1.0009999999999999,"15min":1.026},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.2230000000000001,"5min":1.2649999999999999,"15min":2.536},"last":0.90600000000000003}]},{"osd":7,"last update":"Sat Jun 10 19:02:46 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.0129999999999999,"15min":1.0329999999999999},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.57099999999999995},"max":{"1min":1.427,"5min":1.427,"15min":1.917},"last":1.1579999999999999},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.97899999999999998,"15min":1.028},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.5569999999999999},"last":0.84199999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574987,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32340,"kb_used_data":1292,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339500,"statfs":{"total":96636764160,"available":96603648000,"internally_reserved":0,"allocated":1323008,"data_stored":606691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.88400000000000001,"15min":0.86399999999999999},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.0800000000000001,"5min":1.2070000000000001,"15min":1.232},"last":1.02},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.93100000000000005,"15min":0.92000000000000004},"min":{"1min":0.70199999999999996,"5min":0.58999999999999997,"15min":0.49399999999999999},"max":{"1min":1.165,"5min":2.347,"15min":2.347},"last":0.94899999999999995}]},{"osd":1,"last update":"Sat Jun 10 19:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.95699999999999996,"15min":0.92000000000000004},"min":{"1min":0.63800000000000001,"5min":0.58799999999999997,"15min":0.52600000000000002},"max":{"1min":1.1599999999999999,"5min":7.0800000000000001,"15min":7.0800000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.94399999999999995,"5min":1.135,"15min":0.99099999999999999},"min":{"1min":0.58799999999999997,"5min":0.58399999999999996,"15min":0.53800000000000003},"max":{"1min":1.2689999999999999,"5min":15.845000000000001,"15min":15.845000000000001},"last":1.2689999999999999}]},{"osd":2,"last update":"Sat Jun 10 19:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.94099999999999995,"15min":0.88400000000000001},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.48299999999999998},"max":{"1min":1.319,"5min":5.0049999999999999,"15min":5.0049999999999999},"last":1.228},{"interface":"front","average":{"1min":0.89700000000000002,"5min":1.0109999999999999,"15min":0.94299999999999995},"min":{"1min":0.64900000000000002,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.0569999999999999,"5min":6.851,"15min":6.851},"last":0.78800000000000003}]},{"osd":3,"last update":"Sat Jun 10 19:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.96299999999999997,"15min":0.95299999999999996},"min":{"1min":0.71399999999999997,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.2010000000000001,"5min":2.544,"15min":2.544},"last":0.871},{"interface":"front","average":{"1min":0.95099999999999996,"5min":1.0109999999999999,"15min":1.008},"min":{"1min":0.68899999999999995,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.1739999999999999,"5min":3.0830000000000002,"15min":3.0830000000000002},"last":1.1559999999999999}]},{"osd":4,"last update":"Sat Jun 10 19:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.97799999999999998,"15min":0.96099999999999997},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.58099999999999996},"max":{"1min":1.2669999999999999,"5min":6.7290000000000001,"15min":6.7290000000000001},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.98299999999999998,"15min":1.014},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.61199999999999999},"max":{"1min":1.1200000000000001,"5min":1.341,"15min":1.575},"last":1.1200000000000001}]},{"osd":6,"last update":"Sat Jun 10 19:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.99099999999999999,"15min":1.0149999999999999},"min":{"1min":0.68100000000000005,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.232,"5min":1.3029999999999999,"15min":1.4330000000000001},"last":1.0680000000000001},{"interface":"front","average":{"1min":0.97699999999999998,"5min":1.105,"15min":1.0660000000000001},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.57899999999999996},"max":{"1min":1.194,"5min":6.923,"15min":6.923},"last":0.98499999999999999}]},{"osd":7,"last update":"Sat Jun 10 19:03:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.081,"15min":1.111},"min":{"1min":0.69899999999999995,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.2829999999999999,"5min":2.6080000000000001,"15min":2.6080000000000001},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.163,"15min":1.153},"min":{"1min":0.84499999999999997,"5min":0.67100000000000004,"15min":0.66200000000000003},"max":{"1min":1.365,"5min":5.4169999999999998,"15min":5.4169999999999998},"last":1.323}]}]},{"osd":4,"up_from":13,"seq":55834574986,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32328,"kb_used_data":1280,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339512,"statfs":{"total":96636764160,"available":96603660288,"internally_reserved":0,"allocated":1310720,"data_stored":600521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.88200000000000001,"15min":0.80900000000000005},"min":{"1min":0.52500000000000002,"5min":0.48599999999999999,"15min":0.45100000000000001},"max":{"1min":1.153,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.91100000000000003,"15min":0.90000000000000002},"min":{"1min":0.57099999999999995,"5min":0.49199999999999999,"15min":0.48899999999999999},"max":{"1min":1.202,"5min":1.288,"15min":3.7280000000000002},"last":0.82199999999999995}]},{"osd":1,"last update":"Sat Jun 10 19:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.92700000000000005,"15min":0.94399999999999995},"min":{"1min":0.62,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1970000000000001,"5min":1.254,"15min":3.3969999999999998},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.88300000000000001,"15min":0.85999999999999999},"min":{"1min":0.622,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.202,"5min":1.2110000000000001,"15min":2.496},"last":0.99399999999999999}]},{"osd":2,"last update":"Sat Jun 10 19:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.88900000000000001,"15min":0.88300000000000001},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.49299999999999999},"max":{"1min":1.236,"5min":1.3,"15min":1.522},"last":0.75},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.98799999999999999,"15min":0.998},"min":{"1min":0.73999999999999999,"5min":0.64400000000000002,"15min":0.55000000000000004},"max":{"1min":1.1719999999999999,"5min":1.2769999999999999,"15min":3.5750000000000002},"last":1.048}]},{"osd":3,"last update":"Sat Jun 10 19:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.92200000000000004,"15min":0.89800000000000002},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.53900000000000003},"max":{"1min":1.46,"5min":1.46,"15min":2.3809999999999998},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.97199999999999998,"15min":0.96299999999999997},"min":{"1min":0.63400000000000001,"5min":0.61499999999999999,"15min":0.54400000000000004},"max":{"1min":1.236,"5min":1.2370000000000001,"15min":1.6479999999999999},"last":0.91000000000000003}]},{"osd":5,"last update":"Sat Jun 10 19:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.92400000000000004,"15min":0.96899999999999997},"min":{"1min":0.65600000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.3260000000000001,"5min":1.3360000000000001,"15min":3.6539999999999999},"last":1.149},{"interface":"front","average":{"1min":0.873,"5min":0.91600000000000004,"15min":0.95699999999999996},"min":{"1min":0.624,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.26,"5min":1.3460000000000001,"15min":2.6720000000000002},"last":0.78400000000000003}]},{"osd":6,"last update":"Sat Jun 10 19:03:01 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":0.94499999999999995,"15min":0.98799999999999999},"min":{"1min":0.59699999999999998,"5min":0.58499999999999996,"15min":0.54900000000000004},"max":{"1min":1.21,"5min":1.3149999999999999,"15min":2.2639999999999998},"last":1.121},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.0329999999999999,"15min":1.0640000000000001},"min":{"1min":0.72799999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.3080000000000001,"5min":1.4059999999999999,"15min":3.4980000000000002},"last":1.2210000000000001}]},{"osd":7,"last update":"Sat Jun 10 19:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.98599999999999999,"15min":0.99299999999999999},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.41399999999999998},"max":{"1min":1.272,"5min":1.482,"15min":2.5910000000000002},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.077,"5min":1.0620000000000001,"15min":1.0680000000000001},"min":{"1min":0.76600000000000001,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.361,"5min":1.3740000000000001,"15min":1.4399999999999999},"last":1.194}]}]},{"osd":3,"up_from":13,"seq":55834574985,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32336,"kb_used_data":1288,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339504,"statfs":{"total":96636764160,"available":96603652096,"internally_reserved":0,"allocated":1318912,"data_stored":605672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.63700000000000001,"15min":0.60799999999999998},"min":{"1min":0.39900000000000002,"5min":0.28699999999999998,"15min":0.27900000000000003},"max":{"1min":0.79900000000000004,"5min":1.1539999999999999,"15min":1.169},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69499999999999995,"15min":0.66100000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.251},"max":{"1min":0.92400000000000004,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.36799999999999999}]},{"osd":1,"last update":"Sat Jun 10 19:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.68899999999999995,"15min":0.66700000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.27500000000000002},"max":{"1min":1.01,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.746,"15min":0.73599999999999999},"min":{"1min":0.439,"5min":0.373,"15min":0.318},"max":{"1min":1.0409999999999999,"5min":1.2569999999999999,"15min":1.411},"last":0.55300000000000005}]},{"osd":2,"last update":"Sat Jun 10 19:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.77900000000000003,"15min":0.77100000000000002},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.30299999999999999},"max":{"1min":1.2829999999999999,"5min":1.3899999999999999,"15min":1.9530000000000001},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80700000000000005,"15min":0.77700000000000002},"min":{"1min":0.46300000000000002,"5min":0.35299999999999998,"15min":0.29699999999999999},"max":{"1min":1.123,"5min":1.591,"15min":1.591},"last":0.65700000000000003}]},{"osd":4,"last update":"Sat Jun 10 19:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.97799999999999998,"15min":0.95899999999999996},"min":{"1min":0.623,"5min":0.623,"15min":0.41899999999999998},"max":{"1min":1.4239999999999999,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.995,"15min":0.98999999999999999},"min":{"1min":0.65600000000000003,"5min":0.61299999999999999,"15min":0.47999999999999998},"max":{"1min":1.3140000000000001,"5min":1.873,"15min":1.873},"last":0.68200000000000005}]},{"osd":5,"last update":"Sat Jun 10 19:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":1.0129999999999999,"15min":1.0249999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.5329999999999999,"5min":1.752,"15min":2.024},"last":0.60199999999999998},{"interface":"front","average":{"1min":1.026,"5min":1.0249999999999999,"15min":1.028},"min":{"1min":0.64400000000000002,"5min":0.60299999999999998,"15min":0.46899999999999997},"max":{"1min":1.5149999999999999,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.71299999999999997}]},{"osd":6,"last update":"Sat Jun 10 19:03:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.075,"15min":1.0620000000000001},"min":{"1min":0.63800000000000001,"5min":0.59299999999999997,"15min":0.55300000000000005},"max":{"1min":1.5620000000000001,"5min":1.786,"15min":1.8500000000000001},"last":0.79600000000000004},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.67900000000000005,"5min":0.61199999999999999,"15min":0.58799999999999997},"max":{"1min":1.3080000000000001,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.95299999999999996}]},{"osd":7,"last update":"Sat Jun 10 19:03:47 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.0900000000000001,"15min":1.1020000000000001},"min":{"1min":0.622,"5min":0.57999999999999996,"15min":0.56999999999999995},"max":{"1min":1.452,"5min":2.1150000000000002,"15min":2.1150000000000002},"last":0.90200000000000002},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.105,"15min":1.0940000000000001},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.61099999999999999},"max":{"1min":1.4630000000000001,"5min":1.9850000000000001,"15min":1.9850000000000001},"last":0.77000000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574986,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32340,"kb_used_data":1292,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339500,"statfs":{"total":96636764160,"available":96603648000,"internally_reserved":0,"allocated":1323008,"data_stored":606691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:02:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.627,"15min":0.60799999999999998},"min":{"1min":0.35199999999999998,"5min":0.31,"15min":0.27300000000000002},"max":{"1min":0.88200000000000001,"5min":1.095,"15min":1.1220000000000001},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.73699999999999999,"15min":0.72199999999999998},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.163,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.377}]},{"osd":1,"last update":"Sat Jun 10 19:02:52 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.67400000000000004,"15min":0.66400000000000003},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.94799999999999995,"5min":0.98299999999999998,"15min":1.1950000000000001},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.79500000000000004,"15min":0.74099999999999999},"min":{"1min":0.41999999999999998,"5min":0.36699999999999999,"15min":0.29499999999999998},"max":{"1min":1.2310000000000001,"5min":1.446,"15min":1.446},"last":0.34999999999999998}]},{"osd":3,"last update":"Sat Jun 10 19:02:52 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.80300000000000005,"15min":0.754},"min":{"1min":0.35599999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.133,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.80300000000000005,"15min":0.77300000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":1.181,"5min":1.181,"15min":1.3340000000000001},"last":0.44400000000000001}]},{"osd":4,"last update":"Sat Jun 10 19:02:52 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.94199999999999995,"15min":0.92600000000000005},"min":{"1min":0.68000000000000005,"5min":0.624,"15min":0.53400000000000003},"max":{"1min":1.258,"5min":1.258,"15min":1.3620000000000001},"last":0.52800000000000002},{"interface":"front","average":{"1min":1.044,"5min":1.0229999999999999,"15min":1.0269999999999999},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.57699999999999996},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.59299999999999997}]},{"osd":5,"last update":"Sat Jun 10 19:02:52 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.0209999999999999,"15min":1.0169999999999999},"min":{"1min":0.63300000000000001,"5min":0.61199999999999999,"15min":0.54100000000000004},"max":{"1min":1.337,"5min":1.5429999999999999,"15min":1.5700000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":1.052,"5min":1.02,"15min":1.0069999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.667},"last":0.74399999999999999}]},{"osd":6,"last update":"Sat Jun 10 19:02:52 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.0369999999999999,"15min":1.0429999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.391,"5min":1.4259999999999999,"15min":1.5900000000000001},"last":0.93000000000000005},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0600000000000001,"15min":1.046},"min":{"1min":0.624,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.486,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.83099999999999996}]},{"osd":7,"last update":"Sat Jun 10 19:02:52 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.117,"15min":1.103},"min":{"1min":0.64400000000000002,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.734,"5min":1.734,"15min":1.734},"last":0.73199999999999998},{"interface":"front","average":{"1min":1.21,"5min":1.125,"15min":1.107},"min":{"1min":0.64700000000000002,"5min":0.64100000000000001,"15min":0.59299999999999997},"max":{"1min":1.657,"5min":1.657,"15min":1.752},"last":0.78200000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574988,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32324,"kb_used_data":1276,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339516,"statfs":{"total":96636764160,"available":96603664384,"internally_reserved":0,"allocated":1306624,"data_stored":599502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:02:54 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.68999999999999995,"15min":0.67600000000000005},"min":{"1min":0.32100000000000001,"5min":0.28599999999999998,"15min":0.25800000000000001},"max":{"1min":1.026,"5min":1.119,"15min":1.288},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.76800000000000002,"15min":0.72699999999999998},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.694},"last":0.65700000000000003}]},{"osd":2,"last update":"Sat Jun 10 19:02:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.64000000000000001,"15min":0.63100000000000001},"min":{"1min":0.33100000000000002,"5min":0.308,"15min":0.249},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.21},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.629,"5min":0.74199999999999999,"15min":0.70199999999999996},"min":{"1min":0.32800000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.0629999999999999,"5min":1.194,"15min":1.415},"last":0.47299999999999998}]},{"osd":3,"last update":"Sat Jun 10 19:02:54 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.78600000000000003,"15min":0.77100000000000002},"min":{"1min":0.40200000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.0529999999999999,"5min":1.3049999999999999,"15min":1.6299999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.73999999999999999,"15min":0.74399999999999999},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.0409999999999999,"5min":1.2909999999999999,"15min":2.1749999999999998},"last":0.504}]},{"osd":4,"last update":"Sat Jun 10 19:02:54 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.86599999999999999,"15min":0.85399999999999998},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.53000000000000003},"max":{"1min":1.2070000000000001,"5min":1.343,"15min":1.4930000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.99199999999999999,"15min":1.048},"min":{"1min":0.47299999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.492,"5min":1.5129999999999999,"15min":5.8209999999999997},"last":1.05}]},{"osd":5,"last update":"Sat Jun 10 19:02:54 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.99099999999999999,"15min":1.0089999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.2709999999999999,"5min":1.6299999999999999,"15min":1.8620000000000001},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.97499999999999998,"15min":0.97799999999999998},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":3.089},"last":0.84099999999999997}]},{"osd":6,"last update":"Sat Jun 10 19:02:54 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":1.038,"15min":1.05},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.3640000000000001,"5min":1.6759999999999999,"15min":7.2599999999999998},"last":1.016},{"interface":"front","average":{"1min":0.93200000000000005,"5min":1.022,"15min":1.038},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":9.0069999999999997},"last":0.754}]},{"osd":7,"last update":"Sat Jun 10 19:02:54 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":1.0800000000000001,"15min":1.085},"min":{"1min":0.58799999999999997,"5min":0.495,"15min":0.495},"max":{"1min":1.431,"5min":1.573,"15min":2.105},"last":1.1160000000000001},{"interface":"front","average":{"1min":0.96699999999999997,"5min":1.087,"15min":1.081},"min":{"1min":0.60199999999999998,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.454,"5min":1.5620000000000001,"15min":2.2570000000000001},"last":1.0780000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574987,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32916,"kb_used_data":1868,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338924,"statfs":{"total":96636764160,"available":96603058176,"internally_reserved":0,"allocated":1912832,"data_stored":1196040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jun 10 19:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.65900000000000003,"15min":0.63},"min":{"1min":0.46300000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.98499999999999999,"5min":1.077,"15min":1.0780000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.82899999999999996,"15min":0.78800000000000003},"min":{"1min":0.49299999999999999,"5min":0.36299999999999999,"15min":0.34000000000000002},"max":{"1min":1.0309999999999999,"5min":1.2230000000000001,"15min":1.4059999999999999},"last":1.0289999999999999}]},{"osd":2,"last update":"Sat Jun 10 19:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.73299999999999998,"15min":0.71299999999999997},"min":{"1min":0.51100000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2829999999999999},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.67300000000000004,"15min":0.64800000000000002},"min":{"1min":0.46899999999999997,"5min":0.27600000000000002,"15min":0.245},"max":{"1min":0.83499999999999996,"5min":1.139,"15min":1.371},"last":0.60799999999999998}]},{"osd":3,"last update":"Sat Jun 10 19:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.38900000000000001,"5min":0.29499999999999998,"15min":0.28899999999999998},"max":{"1min":0.875,"5min":1.0860000000000001,"15min":1.226},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.871,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.42999999999999999,"5min":0.317,"15min":0.317},"max":{"1min":1.742,"5min":1.742,"15min":1.829},"last":0.85499999999999998}]},{"osd":4,"last update":"Sat Jun 10 19:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.92900000000000005,"15min":0.91600000000000004},"min":{"1min":0.72199999999999998,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.224,"5min":1.224,"15min":3.0209999999999999},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.0409999999999999,"15min":1.032},"min":{"1min":0.65300000000000002,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.8520000000000001,"5min":1.8520000000000001,"15min":1.9510000000000001},"last":1.1220000000000001}]},{"osd":5,"last update":"Sat Jun 10 19:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.93999999999999995,"15min":0.94599999999999995},"min":{"1min":0.67300000000000004,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.694},"last":0.80600000000000005},{"interface":"front","average":{"1min":1.044,"5min":1.012,"15min":1.0129999999999999},"min":{"1min":0.65200000000000002,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.78,"5min":1.78,"15min":4.5620000000000003},"last":0.998}]},{"osd":6,"last update":"Sat Jun 10 19:02:53 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.0800000000000001,"15min":1.0760000000000001},"min":{"1min":0.73899999999999999,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.5700000000000001,"5min":1.5980000000000001,"15min":3.5569999999999999},"last":1.083},{"interface":"front","average":{"1min":0.97499999999999998,"5min":1.004,"15min":1.0029999999999999},"min":{"1min":0.69699999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.883},"last":0.93300000000000005}]},{"osd":7,"last update":"Sat Jun 10 19:02:53 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.036,"15min":1.036},"min":{"1min":0.69199999999999995,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.512,"5min":1.512,"15min":1.5800000000000001},"last":1.056},{"interface":"front","average":{"1min":1.109,"5min":1.077,"15min":1.0609999999999999},"min":{"1min":0.78900000000000003,"5min":0.624,"15min":0.58699999999999997},"max":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.9830000000000001},"last":0.89600000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-10T19:03:54.431 INFO:tasks.ceph.mds.a.smithi053.stderr:2023-06-10T19:03:54.429+0000 7f906e896640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-06-10T19:03:56.058 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-10T19:03:56.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.185+0000 7fc6fcb6d640 1 Processor -- start 2023-06-10T19:03:56.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.185+0000 7fc6fcb6d640 1 -- start start 2023-06-10T19:03:56.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.185+0000 7fc6fcb6d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc6f80ceb20 0x7fc6f80cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:56.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.185+0000 7fc6fcb6d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6f815cc40 con 0x7fc6f806b780 2023-06-10T19:03:56.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.185+0000 7fc6fcb6d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6f80af530 con 0x7fc6f815c7f0 2023-06-10T19:03:56.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.185+0000 7fc6fcb6d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6f815c3d0 con 0x7fc6f80ceb20 2023-06-10T19:03:56.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.185+0000 7fc6f659c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fc6f806b780 0x7fc6f806bb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:59490/0 (socket says 172.21.15.53:59490) 2023-06-10T19:03:56.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.185+0000 7fc6f659c640 1 -- 172.21.15.53:0/3821295262 learned_addr learned my addr 172.21.15.53:0/3821295262 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:03:56.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.185+0000 7fc6f6d9d640 1 --2- 172.21.15.53:0/3821295262 >> v2:172.21.15.117:3300/0 conn(0x7fc6f80ceb20 0x7fc6f80cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:56.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.185+0000 7fc6f559a640 1 -- 172.21.15.53:0/3821295262 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3629732582 0 0) 0x7fc6f815cc40 con 0x7fc6f806b780 2023-06-10T19:03:56.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.185+0000 7fc6f559a640 1 -- 172.21.15.53:0/3821295262 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6e4003530 con 0x7fc6f806b780 2023-06-10T19:03:56.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.185+0000 7fc6f559a640 1 -- 172.21.15.53:0/3821295262 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3719689274 0 0) 0x7fc6e4003530 con 0x7fc6f806b780 2023-06-10T19:03:56.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.185+0000 7fc6f559a640 1 -- 172.21.15.53:0/3821295262 >> v2:172.21.15.117:3300/0 conn(0x7fc6f80ceb20 msgr2=0x7fc6f80cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:56.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.185+0000 7fc6f559a640 1 --2- 172.21.15.53:0/3821295262 >> v2:172.21.15.117:3300/0 conn(0x7fc6f80ceb20 0x7fc6f80cefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:56.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.185+0000 7fc6f559a640 1 -- 172.21.15.53:0/3821295262 >> v1:172.21.15.117:6789/0 conn(0x7fc6f815c7f0 legacy=0x7fc6f815f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:56.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.185+0000 7fc6f559a640 1 -- 172.21.15.53:0/3821295262 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6f815fd70 con 0x7fc6f806b780 2023-06-10T19:03:56.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.185+0000 7fc6f559a640 1 -- 172.21.15.53:0/3821295262 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fc6e8001680 con 0x7fc6f806b780 2023-06-10T19:03:56.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.185+0000 7fc6f559a640 1 -- 172.21.15.53:0/3821295262 >> v1:172.21.15.53:6789/0 conn(0x7fc6f806b780 legacy=0x7fc6f806bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:56.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.185+0000 7fc6f559a640 1 --2- 172.21.15.53:0/3821295262 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6e40039f0 0x7fc6e4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:56.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.185+0000 7fc6f559a640 1 --2- 172.21.15.53:0/3821295262 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6e40047d0 0x7fc6e4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:56.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.185+0000 7fc6f559a640 1 --2- 172.21.15.53:0/3821295262 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6e40051d0 0x7fc6e400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:56.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.185+0000 7fc6f559a640 1 -- 172.21.15.53:0/3821295262 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f815c3d0 con 0x7fc6e40047d0 2023-06-10T19:03:56.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.185+0000 7fc6f559a640 1 -- 172.21.15.53:0/3821295262 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e400c110 con 0x7fc6e40039f0 2023-06-10T19:03:56.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.185+0000 7fc6f559a640 1 -- 172.21.15.53:0/3821295262 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e400c2d0 con 0x7fc6e40051d0 2023-06-10T19:03:56.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.185+0000 7fc6f5d9b640 1 --2- 172.21.15.53:0/3821295262 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6e40047d0 0x7fc6e4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:56.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.185+0000 7fc6f659c640 1 --2- 172.21.15.53:0/3821295262 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6e40039f0 0x7fc6e4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:56.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.185+0000 7fc6f6d9d640 1 --2- 172.21.15.53:0/3821295262 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6e40051d0 0x7fc6e400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:56.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.185+0000 7fc6f5d9b640 1 -- 172.21.15.53:0/3821295262 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6e40051d0 msgr2=0x7fc6e400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:56.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.185+0000 7fc6f5d9b640 1 --2- 172.21.15.53:0/3821295262 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6e40051d0 0x7fc6e400b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:56.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.185+0000 7fc6f5d9b640 1 -- 172.21.15.53:0/3821295262 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6e40039f0 msgr2=0x7fc6e4003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:56.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.185+0000 7fc6f5d9b640 1 --2- 172.21.15.53:0/3821295262 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6e40039f0 0x7fc6e4003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:56.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.185+0000 7fc6f5d9b640 1 -- 172.21.15.53:0/3821295262 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6e4003530 con 0x7fc6e40047d0 2023-06-10T19:03:56.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.185+0000 7fc6f6d9d640 1 -- 172.21.15.53:0/3821295262 reap_dead start 2023-06-10T19:03:56.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.189+0000 7fc6f5d9b640 1 --2- 172.21.15.53:0/3821295262 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6e40047d0 0x7fc6e4004c40 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0001e40 tx=0x7fc6e001c720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b39b574c68b6b87 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:56.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.189+0000 7fc6f559a640 1 -- 172.21.15.53:0/3821295262 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e0003b80 con 0x7fc6e40047d0 2023-06-10T19:03:56.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.189+0000 7fc6f559a640 1 -- 172.21.15.53:0/3821295262 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6e0003ce0 con 0x7fc6e40047d0 2023-06-10T19:03:56.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.189+0000 7fc6f559a640 1 -- 172.21.15.53:0/3821295262 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e0005310 con 0x7fc6e40047d0 2023-06-10T19:03:56.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.189+0000 7fc6fcb6d640 1 -- 172.21.15.53:0/3821295262 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6e40047d0 msgr2=0x7fc6e4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:56.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.189+0000 7fc6fcb6d640 1 --2- 172.21.15.53:0/3821295262 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6e40047d0 0x7fc6e4004c40 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0001e40 tx=0x7fc6e001c720 comp rx=0 tx=0).stop 2023-06-10T19:03:56.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.189+0000 7fc6fcb6d640 1 -- 172.21.15.53:0/3821295262 shutdown_connections 2023-06-10T19:03:56.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.189+0000 7fc6fcb6d640 1 --2- 172.21.15.53:0/3821295262 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6e40047d0 0x7fc6e4004c40 unknown :-1 s=CLOSED pgs=1736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:56.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.189+0000 7fc6fcb6d640 1 -- 172.21.15.53:0/3821295262 >> 172.21.15.53:0/3821295262 conn(0x7fc6f806a090 msgr2=0x7fc6f806d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:56.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.189+0000 7fc6fcb6d640 1 -- 172.21.15.53:0/3821295262 shutdown_connections 2023-06-10T19:03:56.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.189+0000 7fc6fcb6d640 1 -- 172.21.15.53:0/3821295262 wait complete. 2023-06-10T19:03:56.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.189+0000 7fc6fcb6d640 1 Processor -- start 2023-06-10T19:03:56.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.189+0000 7fc6fcb6d640 1 -- start start 2023-06-10T19:03:56.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.193+0000 7fc6fcb6d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6e40047d0 0x7fc6f80c97a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:56.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.193+0000 7fc6fcb6d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6f80c9ce0 0x7fc6f80b3790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:56.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.193+0000 7fc6fcb6d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6f80c6f20 0x7fc6f80b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:56.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.193+0000 7fc6fcb6d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f80b5c00 con 0x7fc6f80c6f20 2023-06-10T19:03:56.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.193+0000 7fc6fcb6d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f815df00 con 0x7fc6f80c9ce0 2023-06-10T19:03:56.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.193+0000 7fc6fcb6d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f80ac310 con 0x7fc6e40047d0 2023-06-10T19:03:56.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.193+0000 7fc6f6d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6f80c6f20 0x7fc6f80b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:56.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.193+0000 7fc6f6d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6f80c6f20 0x7fc6f80b3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35052/0 (socket says 172.21.15.53:35052) 2023-06-10T19:03:56.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.193+0000 7fc6f6d9d640 1 -- 172.21.15.53:0/3164638582 learned_addr learned my addr 172.21.15.53:0/3164638582 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:56.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.193+0000 7fc6f5d9b640 1 --2- 172.21.15.53:0/3164638582 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6f80c9ce0 0x7fc6f80b3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:56.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.193+0000 7fc6f659c640 1 --2- 172.21.15.53:0/3164638582 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6e40047d0 0x7fc6f80c97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:56.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.193+0000 7fc6f6d9d640 1 -- 172.21.15.53:0/3164638582 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6e40047d0 msgr2=0x7fc6f80c97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:56.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.193+0000 7fc6f6d9d640 1 --2- 172.21.15.53:0/3164638582 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6e40047d0 0x7fc6f80c97a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:56.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.193+0000 7fc6f6d9d640 1 -- 172.21.15.53:0/3164638582 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6f80c9ce0 msgr2=0x7fc6f80b3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:56.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.193+0000 7fc6f6d9d640 1 --2- 172.21.15.53:0/3164638582 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6f80c9ce0 0x7fc6f80b3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:56.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.193+0000 7fc6f6d9d640 1 -- 172.21.15.53:0/3164638582 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6f80ae330 con 0x7fc6f80c6f20 2023-06-10T19:03:56.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.193+0000 7fc6f5d9b640 1 --2- 172.21.15.53:0/3164638582 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6f80c9ce0 0x7fc6f80b3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:03:56.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.193+0000 7fc6f6d9d640 1 --2- 172.21.15.53:0/3164638582 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6f80c6f20 0x7fc6f80b3cd0 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7fc6f80b2950 tx=0x7fc6f00107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:56.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.193+0000 7fc6eeffd640 1 -- 172.21.15.53:0/3164638582 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f00143f0 con 0x7fc6f80c6f20 2023-06-10T19:03:56.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.193+0000 7fc6eeffd640 1 -- 172.21.15.53:0/3164638582 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6f0014550 con 0x7fc6f80c6f20 2023-06-10T19:03:56.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.193+0000 7fc6fcb6d640 1 -- 172.21.15.53:0/3164638582 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6f815e1a0 con 0x7fc6f80c6f20 2023-06-10T19:03:56.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.193+0000 7fc6eeffd640 1 -- 172.21.15.53:0/3164638582 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f0014900 con 0x7fc6f80c6f20 2023-06-10T19:03:56.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.193+0000 7fc6fcb6d640 1 -- 172.21.15.53:0/3164638582 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6f815e480 con 0x7fc6f80c6f20 2023-06-10T19:03:56.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.193+0000 7fc6fcb6d640 1 -- 172.21.15.53:0/3164638582 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6f804d790 con 0x7fc6f80c6f20 2023-06-10T19:03:56.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.193+0000 7fc6eeffd640 1 -- 172.21.15.53:0/3164638582 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc6f0014a60 con 0x7fc6f80c6f20 2023-06-10T19:03:56.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.193+0000 7fc6eeffd640 1 --2- 172.21.15.53:0/3164638582 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc6d80662d0 0x7fc6d8068780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:56.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.193+0000 7fc6eeffd640 1 -- 172.21.15.53:0/3164638582 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc6f0083100 con 0x7fc6f80c6f20 2023-06-10T19:03:56.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.193+0000 7fc6f659c640 1 --2- 172.21.15.53:0/3164638582 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc6d80662d0 0x7fc6d8068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:56.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.197+0000 7fc6f659c640 1 --2- 172.21.15.53:0/3164638582 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc6d80662d0 0x7fc6d8068780 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fc6e8001060 tx=0x7fc6e8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:56.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.197+0000 7fc6eeffd640 1 -- 172.21.15.53:0/3164638582 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc6f0050560 con 0x7fc6f80c6f20 2023-06-10T19:03:56.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.349+0000 7fc6fcb6d640 1 -- 172.21.15.53:0/3164638582 --> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc6f815bc30 con 0x7fc6d80662d0 2023-06-10T19:03:56.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.373+0000 7fc6eeffd640 1 -- 172.21.15.53:0/3164638582 <== mgr.4105 v2:172.21.15.117:6832/3061986771 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310749 (secure 0 0 0) 0x7fc6e80107d0 con 0x7fc6d80662d0 2023-06-10T19:03:56.379 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:03:56.382 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-06-10T19:03:56.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.377+0000 7fc6fcb6d640 1 -- 172.21.15.53:0/3164638582 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc6d80662d0 msgr2=0x7fc6d8068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:56.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.377+0000 7fc6fcb6d640 1 --2- 172.21.15.53:0/3164638582 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc6d80662d0 0x7fc6d8068780 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fc6e8001060 tx=0x7fc6e8009040 comp rx=0 tx=0).stop 2023-06-10T19:03:56.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.377+0000 7fc6fcb6d640 1 -- 172.21.15.53:0/3164638582 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6f80c6f20 msgr2=0x7fc6f80b3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:56.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.377+0000 7fc6fcb6d640 1 --2- 172.21.15.53:0/3164638582 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6f80c6f20 0x7fc6f80b3cd0 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7fc6f80b2950 tx=0x7fc6f00107a0 comp rx=0 tx=0).stop 2023-06-10T19:03:56.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.377+0000 7fc6fcb6d640 1 -- 172.21.15.53:0/3164638582 shutdown_connections 2023-06-10T19:03:56.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.377+0000 7fc6fcb6d640 1 --2- 172.21.15.53:0/3164638582 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc6d80662d0 0x7fc6d8068780 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:56.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.377+0000 7fc6fcb6d640 1 --2- 172.21.15.53:0/3164638582 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6f80c6f20 0x7fc6f80b3cd0 unknown :-1 s=CLOSED pgs=1737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:56.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.377+0000 7fc6fcb6d640 1 --2- 172.21.15.53:0/3164638582 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6f80c9ce0 0x7fc6f80b3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:56.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.377+0000 7fc6fcb6d640 1 --2- 172.21.15.53:0/3164638582 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6e40047d0 0x7fc6f80c97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:56.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.377+0000 7fc6fcb6d640 1 -- 172.21.15.53:0/3164638582 >> 172.21.15.53:0/3164638582 conn(0x7fc6f806a090 msgr2=0x7fc6f80aeaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:56.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.377+0000 7fc6fcb6d640 1 -- 172.21.15.53:0/3164638582 shutdown_connections 2023-06-10T19:03:56.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.377+0000 7fc6fcb6d640 1 -- 172.21.15.53:0/3164638582 wait complete. 2023-06-10T19:03:56.399 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":445,"stamp":"2023-06-10T19:03:55.803006+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":178,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":260220,"kb_used_data":11836,"kb_used_omap":0,"kb_used_meta":248320,"kb_avail":754714500,"statfs":{"total":773094113280,"available":772827648000,"internally_reserved":0,"allocated":12120064,"data_stored":6199203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":254279680},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":62,"apply_latency_ms":62,"commit_latency_ns":62000000,"apply_latency_ns":62000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.771970"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.505408+0000","last_change":"2023-06-10T19:03:48.439785+0000","last_active":"2023-06-10T19:03:49.505408+0000","last_peered":"2023-06-10T19:03:49.505408+0000","last_clean":"2023-06-10T19:03:49.505408+0000","last_became_active":"2023-06-10T19:03:48.439502+0000","last_became_peered":"2023-06-10T19:03:48.439502+0000","last_unstale":"2023-06-10T19:03:49.505408+0000","last_undegraded":"2023-06-10T19:03:49.505408+0000","last_fullsized":"2023-06-10T19:03:49.505408+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:16:14.780436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.508884+0000","last_change":"2023-06-10T19:03:48.483789+0000","last_active":"2023-06-10T19:03:49.508884+0000","last_peered":"2023-06-10T19:03:49.508884+0000","last_clean":"2023-06-10T19:03:49.508884+0000","last_became_active":"2023-06-10T19:03:48.482923+0000","last_became_peered":"2023-06-10T19:03:48.482923+0000","last_unstale":"2023-06-10T19:03:49.508884+0000","last_undegraded":"2023-06-10T19:03:49.508884+0000","last_fullsized":"2023-06-10T19:03:49.508884+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:22:05.165586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.505357+0000","last_change":"2023-06-10T19:03:48.490124+0000","last_active":"2023-06-10T19:03:49.505357+0000","last_peered":"2023-06-10T19:03:49.505357+0000","last_clean":"2023-06-10T19:03:49.505357+0000","last_became_active":"2023-06-10T19:03:48.489913+0000","last_became_peered":"2023-06-10T19:03:48.489913+0000","last_unstale":"2023-06-10T19:03:49.505357+0000","last_undegraded":"2023-06-10T19:03:49.505357+0000","last_fullsized":"2023-06-10T19:03:49.505357+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:07:52.431870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.505336+0000","last_change":"2023-06-10T19:03:48.450191+0000","last_active":"2023-06-10T19:03:49.505336+0000","last_peered":"2023-06-10T19:03:49.505336+0000","last_clean":"2023-06-10T19:03:49.505336+0000","last_became_active":"2023-06-10T19:03:48.449669+0000","last_became_peered":"2023-06-10T19:03:48.449669+0000","last_unstale":"2023-06-10T19:03:49.505336+0000","last_undegraded":"2023-06-10T19:03:49.505336+0000","last_fullsized":"2023-06-10T19:03:49.505336+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:13:06.324164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.507521+0000","last_change":"2023-06-10T19:03:48.461588+0000","last_active":"2023-06-10T19:03:49.507521+0000","last_peered":"2023-06-10T19:03:49.507521+0000","last_clean":"2023-06-10T19:03:49.507521+0000","last_became_active":"2023-06-10T19:03:48.461312+0000","last_became_peered":"2023-06-10T19:03:48.461312+0000","last_unstale":"2023-06-10T19:03:49.507521+0000","last_undegraded":"2023-06-10T19:03:49.507521+0000","last_fullsized":"2023-06-10T19:03:49.507521+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:51:10.503764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.508094+0000","last_change":"2023-06-10T19:03:48.480658+0000","last_active":"2023-06-10T19:03:49.508094+0000","last_peered":"2023-06-10T19:03:49.508094+0000","last_clean":"2023-06-10T19:03:49.508094+0000","last_became_active":"2023-06-10T19:03:48.479805+0000","last_became_peered":"2023-06-10T19:03:48.479805+0000","last_unstale":"2023-06-10T19:03:49.508094+0000","last_undegraded":"2023-06-10T19:03:49.508094+0000","last_fullsized":"2023-06-10T19:03:49.508094+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:42:39.346064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.507619+0000","last_change":"2023-06-10T19:03:48.481637+0000","last_active":"2023-06-10T19:03:49.507619+0000","last_peered":"2023-06-10T19:03:49.507619+0000","last_clean":"2023-06-10T19:03:49.507619+0000","last_became_active":"2023-06-10T19:03:48.480945+0000","last_became_peered":"2023-06-10T19:03:48.480945+0000","last_unstale":"2023-06-10T19:03:49.507619+0000","last_undegraded":"2023-06-10T19:03:49.507619+0000","last_fullsized":"2023-06-10T19:03:49.507619+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:12:51.211405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.429300+0000","last_change":"2023-06-10T19:03:48.452905+0000","last_active":"2023-06-10T19:03:49.429300+0000","last_peered":"2023-06-10T19:03:49.429300+0000","last_clean":"2023-06-10T19:03:49.429300+0000","last_became_active":"2023-06-10T19:03:48.452530+0000","last_became_peered":"2023-06-10T19:03:48.452530+0000","last_unstale":"2023-06-10T19:03:49.429300+0000","last_undegraded":"2023-06-10T19:03:49.429300+0000","last_fullsized":"2023-06-10T19:03:49.429300+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:27:24.825402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.508121+0000","last_change":"2023-06-10T19:03:48.480789+0000","last_active":"2023-06-10T19:03:49.508121+0000","last_peered":"2023-06-10T19:03:49.508121+0000","last_clean":"2023-06-10T19:03:49.508121+0000","last_became_active":"2023-06-10T19:03:48.479825+0000","last_became_peered":"2023-06-10T19:03:48.479825+0000","last_unstale":"2023-06-10T19:03:49.508121+0000","last_undegraded":"2023-06-10T19:03:49.508121+0000","last_fullsized":"2023-06-10T19:03:49.508121+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:46:55.665129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.507834+0000","last_change":"2023-06-10T19:03:48.492249+0000","last_active":"2023-06-10T19:03:49.507834+0000","last_peered":"2023-06-10T19:03:49.507834+0000","last_clean":"2023-06-10T19:03:49.507834+0000","last_became_active":"2023-06-10T19:03:48.491920+0000","last_became_peered":"2023-06-10T19:03:48.491920+0000","last_unstale":"2023-06-10T19:03:49.507834+0000","last_undegraded":"2023-06-10T19:03:49.507834+0000","last_fullsized":"2023-06-10T19:03:49.507834+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:15:29.793540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.438039+0000","last_change":"2023-06-10T19:03:48.490088+0000","last_active":"2023-06-10T19:03:49.438039+0000","last_peered":"2023-06-10T19:03:49.438039+0000","last_clean":"2023-06-10T19:03:49.438039+0000","last_became_active":"2023-06-10T19:03:48.485016+0000","last_became_peered":"2023-06-10T19:03:48.485016+0000","last_unstale":"2023-06-10T19:03:49.438039+0000","last_undegraded":"2023-06-10T19:03:49.438039+0000","last_fullsized":"2023-06-10T19:03:49.438039+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:03:03.036014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.437229+0000","last_change":"2023-06-10T19:03:48.448003+0000","last_active":"2023-06-10T19:03:49.437229+0000","last_peered":"2023-06-10T19:03:49.437229+0000","last_clean":"2023-06-10T19:03:49.437229+0000","last_became_active":"2023-06-10T19:03:48.447245+0000","last_became_peered":"2023-06-10T19:03:48.447245+0000","last_unstale":"2023-06-10T19:03:49.437229+0000","last_undegraded":"2023-06-10T19:03:49.437229+0000","last_fullsized":"2023-06-10T19:03:49.437229+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:47:05.636577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.505045+0000","last_change":"2023-06-10T19:03:48.496977+0000","last_active":"2023-06-10T19:03:49.505045+0000","last_peered":"2023-06-10T19:03:49.505045+0000","last_clean":"2023-06-10T19:03:49.505045+0000","last_became_active":"2023-06-10T19:03:48.496606+0000","last_became_peered":"2023-06-10T19:03:48.496606+0000","last_unstale":"2023-06-10T19:03:49.505045+0000","last_undegraded":"2023-06-10T19:03:49.505045+0000","last_fullsized":"2023-06-10T19:03:49.505045+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:01:43.470626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.507198+0000","last_change":"2023-06-10T19:03:48.475862+0000","last_active":"2023-06-10T19:03:49.507198+0000","last_peered":"2023-06-10T19:03:49.507198+0000","last_clean":"2023-06-10T19:03:49.507198+0000","last_became_active":"2023-06-10T19:03:48.475232+0000","last_became_peered":"2023-06-10T19:03:48.475232+0000","last_unstale":"2023-06-10T19:03:49.507198+0000","last_undegraded":"2023-06-10T19:03:49.507198+0000","last_fullsized":"2023-06-10T19:03:49.507198+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:50:32.661830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.507442+0000","last_change":"2023-06-10T19:03:48.486391+0000","last_active":"2023-06-10T19:03:49.507442+0000","last_peered":"2023-06-10T19:03:49.507442+0000","last_clean":"2023-06-10T19:03:49.507442+0000","last_became_active":"2023-06-10T19:03:48.485837+0000","last_became_peered":"2023-06-10T19:03:48.485837+0000","last_unstale":"2023-06-10T19:03:49.507442+0000","last_undegraded":"2023-06-10T19:03:49.507442+0000","last_fullsized":"2023-06-10T19:03:49.507442+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:46:22.432177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.506920+0000","last_change":"2023-06-10T19:03:48.476371+0000","last_active":"2023-06-10T19:03:49.506920+0000","last_peered":"2023-06-10T19:03:49.506920+0000","last_clean":"2023-06-10T19:03:49.506920+0000","last_became_active":"2023-06-10T19:03:48.475578+0000","last_became_peered":"2023-06-10T19:03:48.475578+0000","last_unstale":"2023-06-10T19:03:49.506920+0000","last_undegraded":"2023-06-10T19:03:49.506920+0000","last_fullsized":"2023-06-10T19:03:49.506920+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:30:26.707783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.505587+0000","last_change":"2023-06-10T19:03:48.494733+0000","last_active":"2023-06-10T19:03:49.505587+0000","last_peered":"2023-06-10T19:03:49.505587+0000","last_clean":"2023-06-10T19:03:49.505587+0000","last_became_active":"2023-06-10T19:03:48.494443+0000","last_became_peered":"2023-06-10T19:03:48.494443+0000","last_unstale":"2023-06-10T19:03:49.505587+0000","last_undegraded":"2023-06-10T19:03:49.505587+0000","last_fullsized":"2023-06-10T19:03:49.505587+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:08:25.542624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.508954+0000","last_change":"2023-06-10T19:03:48.480769+0000","last_active":"2023-06-10T19:03:49.508954+0000","last_peered":"2023-06-10T19:03:49.508954+0000","last_clean":"2023-06-10T19:03:49.508954+0000","last_became_active":"2023-06-10T19:03:48.480095+0000","last_became_peered":"2023-06-10T19:03:48.480095+0000","last_unstale":"2023-06-10T19:03:49.508954+0000","last_undegraded":"2023-06-10T19:03:49.508954+0000","last_fullsized":"2023-06-10T19:03:49.508954+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:34:12.032132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.505539+0000","last_change":"2023-06-10T19:03:48.482462+0000","last_active":"2023-06-10T19:03:49.505539+0000","last_peered":"2023-06-10T19:03:49.505539+0000","last_clean":"2023-06-10T19:03:49.505539+0000","last_became_active":"2023-06-10T19:03:48.482143+0000","last_became_peered":"2023-06-10T19:03:48.482143+0000","last_unstale":"2023-06-10T19:03:49.505539+0000","last_undegraded":"2023-06-10T19:03:49.505539+0000","last_fullsized":"2023-06-10T19:03:49.505539+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:28:39.024624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.437568+0000","last_change":"2023-06-10T19:03:48.472501+0000","last_active":"2023-06-10T19:03:49.437568+0000","last_peered":"2023-06-10T19:03:49.437568+0000","last_clean":"2023-06-10T19:03:49.437568+0000","last_became_active":"2023-06-10T19:03:48.471779+0000","last_became_peered":"2023-06-10T19:03:48.471779+0000","last_unstale":"2023-06-10T19:03:49.437568+0000","last_undegraded":"2023-06-10T19:03:49.437568+0000","last_fullsized":"2023-06-10T19:03:49.437568+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:55:36.700176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.429665+0000","last_change":"2023-06-10T19:03:48.495039+0000","last_active":"2023-06-10T19:03:49.429665+0000","last_peered":"2023-06-10T19:03:49.429665+0000","last_clean":"2023-06-10T19:03:49.429665+0000","last_became_active":"2023-06-10T19:03:48.494622+0000","last_became_peered":"2023-06-10T19:03:48.494622+0000","last_unstale":"2023-06-10T19:03:49.429665+0000","last_undegraded":"2023-06-10T19:03:49.429665+0000","last_fullsized":"2023-06-10T19:03:49.429665+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:25:23.788150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.507477+0000","last_change":"2023-06-10T19:03:48.484484+0000","last_active":"2023-06-10T19:03:49.507477+0000","last_peered":"2023-06-10T19:03:49.507477+0000","last_clean":"2023-06-10T19:03:49.507477+0000","last_became_active":"2023-06-10T19:03:48.484288+0000","last_became_peered":"2023-06-10T19:03:48.484288+0000","last_unstale":"2023-06-10T19:03:49.507477+0000","last_undegraded":"2023-06-10T19:03:49.507477+0000","last_fullsized":"2023-06-10T19:03:49.507477+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:03:23.198934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.505094+0000","last_change":"2023-06-10T19:03:48.486509+0000","last_active":"2023-06-10T19:03:49.505094+0000","last_peered":"2023-06-10T19:03:49.505094+0000","last_clean":"2023-06-10T19:03:49.505094+0000","last_became_active":"2023-06-10T19:03:48.486219+0000","last_became_peered":"2023-06-10T19:03:48.486219+0000","last_unstale":"2023-06-10T19:03:49.505094+0000","last_undegraded":"2023-06-10T19:03:49.505094+0000","last_fullsized":"2023-06-10T19:03:49.505094+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:01:49.741272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.507359+0000","last_change":"2023-06-10T19:03:48.451074+0000","last_active":"2023-06-10T19:03:49.507359+0000","last_peered":"2023-06-10T19:03:49.507359+0000","last_clean":"2023-06-10T19:03:49.507359+0000","last_became_active":"2023-06-10T19:03:48.450778+0000","last_became_peered":"2023-06-10T19:03:48.450778+0000","last_unstale":"2023-06-10T19:03:49.507359+0000","last_undegraded":"2023-06-10T19:03:49.507359+0000","last_fullsized":"2023-06-10T19:03:49.507359+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:11:16.915319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.438162+0000","last_change":"2023-06-10T19:03:48.495579+0000","last_active":"2023-06-10T19:03:49.438162+0000","last_peered":"2023-06-10T19:03:49.438162+0000","last_clean":"2023-06-10T19:03:49.438162+0000","last_became_active":"2023-06-10T19:03:48.495074+0000","last_became_peered":"2023-06-10T19:03:48.495074+0000","last_unstale":"2023-06-10T19:03:49.438162+0000","last_undegraded":"2023-06-10T19:03:49.438162+0000","last_fullsized":"2023-06-10T19:03:49.438162+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:40:04.795387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.437810+0000","last_change":"2023-06-10T19:03:48.482428+0000","last_active":"2023-06-10T19:03:49.437810+0000","last_peered":"2023-06-10T19:03:49.437810+0000","last_clean":"2023-06-10T19:03:49.437810+0000","last_became_active":"2023-06-10T19:03:48.481860+0000","last_became_peered":"2023-06-10T19:03:48.481860+0000","last_unstale":"2023-06-10T19:03:49.437810+0000","last_undegraded":"2023-06-10T19:03:49.437810+0000","last_fullsized":"2023-06-10T19:03:49.437810+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:31:08.062693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.438086+0000","last_change":"2023-06-10T19:03:48.485385+0000","last_active":"2023-06-10T19:03:49.438086+0000","last_peered":"2023-06-10T19:03:49.438086+0000","last_clean":"2023-06-10T19:03:49.438086+0000","last_became_active":"2023-06-10T19:03:48.484195+0000","last_became_peered":"2023-06-10T19:03:48.484195+0000","last_unstale":"2023-06-10T19:03:49.438086+0000","last_undegraded":"2023-06-10T19:03:49.438086+0000","last_fullsized":"2023-06-10T19:03:49.438086+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:48:29.786201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.508648+0000","last_change":"2023-06-10T19:03:48.486209+0000","last_active":"2023-06-10T19:03:49.508648+0000","last_peered":"2023-06-10T19:03:49.508648+0000","last_clean":"2023-06-10T19:03:49.508648+0000","last_became_active":"2023-06-10T19:03:48.485601+0000","last_became_peered":"2023-06-10T19:03:48.485601+0000","last_unstale":"2023-06-10T19:03:49.508648+0000","last_undegraded":"2023-06-10T19:03:49.508648+0000","last_fullsized":"2023-06-10T19:03:49.508648+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:32:23.304341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.430245+0000","last_change":"2023-06-10T19:03:48.449180+0000","last_active":"2023-06-10T19:03:49.430245+0000","last_peered":"2023-06-10T19:03:49.430245+0000","last_clean":"2023-06-10T19:03:49.430245+0000","last_became_active":"2023-06-10T19:03:48.447832+0000","last_became_peered":"2023-06-10T19:03:48.447832+0000","last_unstale":"2023-06-10T19:03:49.430245+0000","last_undegraded":"2023-06-10T19:03:49.430245+0000","last_fullsized":"2023-06-10T19:03:49.430245+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:29:04.146544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.435822+0000","last_change":"2023-06-10T19:03:48.487542+0000","last_active":"2023-06-10T19:03:49.435822+0000","last_peered":"2023-06-10T19:03:49.435822+0000","last_clean":"2023-06-10T19:03:49.435822+0000","last_became_active":"2023-06-10T19:03:48.486984+0000","last_became_peered":"2023-06-10T19:03:48.486984+0000","last_unstale":"2023-06-10T19:03:49.435822+0000","last_undegraded":"2023-06-10T19:03:49.435822+0000","last_fullsized":"2023-06-10T19:03:49.435822+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:24:57.806348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.508536+0000","last_change":"2023-06-10T19:03:48.481401+0000","last_active":"2023-06-10T19:03:49.508536+0000","last_peered":"2023-06-10T19:03:49.508536+0000","last_clean":"2023-06-10T19:03:49.508536+0000","last_became_active":"2023-06-10T19:03:48.480863+0000","last_became_peered":"2023-06-10T19:03:48.480863+0000","last_unstale":"2023-06-10T19:03:49.508536+0000","last_undegraded":"2023-06-10T19:03:49.508536+0000","last_fullsized":"2023-06-10T19:03:49.508536+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:12:53.772915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.429332+0000","last_change":"2023-06-10T19:03:48.465106+0000","last_active":"2023-06-10T19:03:49.429332+0000","last_peered":"2023-06-10T19:03:49.429332+0000","last_clean":"2023-06-10T19:03:49.429332+0000","last_became_active":"2023-06-10T19:03:48.464817+0000","last_became_peered":"2023-06-10T19:03:48.464817+0000","last_unstale":"2023-06-10T19:03:49.429332+0000","last_undegraded":"2023-06-10T19:03:49.429332+0000","last_fullsized":"2023-06-10T19:03:49.429332+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:22:19.573965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.506351+0000","last_change":"2023-06-10T19:03:48.480206+0000","last_active":"2023-06-10T19:03:49.506351+0000","last_peered":"2023-06-10T19:03:49.506351+0000","last_clean":"2023-06-10T19:03:49.506351+0000","last_became_active":"2023-06-10T19:03:48.479871+0000","last_became_peered":"2023-06-10T19:03:48.479871+0000","last_unstale":"2023-06-10T19:03:49.506351+0000","last_undegraded":"2023-06-10T19:03:49.506351+0000","last_fullsized":"2023-06-10T19:03:49.506351+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:28:21.577086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"109'4","reported_seq":17,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.505684+0000","last_change":"2023-06-10T19:03:48.074076+0000","last_active":"2023-06-10T19:03:49.505684+0000","last_peered":"2023-06-10T19:03:49.505684+0000","last_clean":"2023-06-10T19:03:49.505684+0000","last_became_active":"2023-06-10T19:03:48.073677+0000","last_became_peered":"2023-06-10T19:03:48.073677+0000","last_unstale":"2023-06-10T19:03:49.505684+0000","last_undegraded":"2023-06-10T19:03:49.505684+0000","last_fullsized":"2023-06-10T19:03:49.505684+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:44:34.581215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.429292+0000","last_change":"2023-06-10T19:03:48.453287+0000","last_active":"2023-06-10T19:03:49.429292+0000","last_peered":"2023-06-10T19:03:49.429292+0000","last_clean":"2023-06-10T19:03:49.429292+0000","last_became_active":"2023-06-10T19:03:48.452826+0000","last_became_peered":"2023-06-10T19:03:48.452826+0000","last_unstale":"2023-06-10T19:03:49.429292+0000","last_undegraded":"2023-06-10T19:03:49.429292+0000","last_fullsized":"2023-06-10T19:03:49.429292+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:57:53.212396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"109'1","reported_seq":14,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.430070+0000","last_change":"2023-06-10T19:03:48.065806+0000","last_active":"2023-06-10T19:03:49.430070+0000","last_peered":"2023-06-10T19:03:49.430070+0000","last_clean":"2023-06-10T19:03:49.430070+0000","last_became_active":"2023-06-10T19:03:48.061253+0000","last_became_peered":"2023-06-10T19:03:48.061253+0000","last_unstale":"2023-06-10T19:03:49.430070+0000","last_undegraded":"2023-06-10T19:03:49.430070+0000","last_fullsized":"2023-06-10T19:03:49.430070+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:47:43.487053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.436125+0000","last_change":"2023-06-10T19:03:48.453907+0000","last_active":"2023-06-10T19:03:49.436125+0000","last_peered":"2023-06-10T19:03:49.436125+0000","last_clean":"2023-06-10T19:03:49.436125+0000","last_became_active":"2023-06-10T19:03:48.453216+0000","last_became_peered":"2023-06-10T19:03:48.453216+0000","last_unstale":"2023-06-10T19:03:49.436125+0000","last_undegraded":"2023-06-10T19:03:49.436125+0000","last_fullsized":"2023-06-10T19:03:49.436125+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:43:24.588008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"109'2","reported_seq":15,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.437125+0000","last_change":"2023-06-10T19:03:48.077619+0000","last_active":"2023-06-10T19:03:49.437125+0000","last_peered":"2023-06-10T19:03:49.437125+0000","last_clean":"2023-06-10T19:03:49.437125+0000","last_became_active":"2023-06-10T19:03:48.076814+0000","last_became_peered":"2023-06-10T19:03:48.076814+0000","last_unstale":"2023-06-10T19:03:49.437125+0000","last_undegraded":"2023-06-10T19:03:49.437125+0000","last_fullsized":"2023-06-10T19:03:49.437125+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:19:27.318539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.436503+0000","last_change":"2023-06-10T19:03:48.486892+0000","last_active":"2023-06-10T19:03:49.436503+0000","last_peered":"2023-06-10T19:03:49.436503+0000","last_clean":"2023-06-10T19:03:49.436503+0000","last_became_active":"2023-06-10T19:03:48.484409+0000","last_became_peered":"2023-06-10T19:03:48.484409+0000","last_unstale":"2023-06-10T19:03:49.436503+0000","last_undegraded":"2023-06-10T19:03:49.436503+0000","last_fullsized":"2023-06-10T19:03:49.436503+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:03:23.198934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"109'2","reported_seq":15,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.507782+0000","last_change":"2023-06-10T19:03:48.070443+0000","last_active":"2023-06-10T19:03:49.507782+0000","last_peered":"2023-06-10T19:03:49.507782+0000","last_clean":"2023-06-10T19:03:49.507782+0000","last_became_active":"2023-06-10T19:03:48.069811+0000","last_became_peered":"2023-06-10T19:03:48.069811+0000","last_unstale":"2023-06-10T19:03:49.507782+0000","last_undegraded":"2023-06-10T19:03:49.507782+0000","last_fullsized":"2023-06-10T19:03:49.507782+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:35:54.273687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.505411+0000","last_change":"2023-06-10T19:03:48.447746+0000","last_active":"2023-06-10T19:03:49.505411+0000","last_peered":"2023-06-10T19:03:49.505411+0000","last_clean":"2023-06-10T19:03:49.505411+0000","last_became_active":"2023-06-10T19:03:48.447358+0000","last_became_peered":"2023-06-10T19:03:48.447358+0000","last_unstale":"2023-06-10T19:03:49.505411+0000","last_undegraded":"2023-06-10T19:03:49.505411+0000","last_fullsized":"2023-06-10T19:03:49.505411+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:02:22.364462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"109'1","reported_seq":14,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.507488+0000","last_change":"2023-06-10T19:03:48.069757+0000","last_active":"2023-06-10T19:03:49.507488+0000","last_peered":"2023-06-10T19:03:49.507488+0000","last_clean":"2023-06-10T19:03:49.507488+0000","last_became_active":"2023-06-10T19:03:48.068926+0000","last_became_peered":"2023-06-10T19:03:48.068926+0000","last_unstale":"2023-06-10T19:03:49.507488+0000","last_undegraded":"2023-06-10T19:03:49.507488+0000","last_fullsized":"2023-06-10T19:03:49.507488+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:49:54.604724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.505897+0000","last_change":"2023-06-10T19:03:48.482413+0000","last_active":"2023-06-10T19:03:49.505897+0000","last_peered":"2023-06-10T19:03:49.505897+0000","last_clean":"2023-06-10T19:03:49.505897+0000","last_became_active":"2023-06-10T19:03:48.482086+0000","last_became_peered":"2023-06-10T19:03:48.482086+0000","last_unstale":"2023-06-10T19:03:49.505897+0000","last_undegraded":"2023-06-10T19:03:49.505897+0000","last_fullsized":"2023-06-10T19:03:49.505897+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:48:11.996530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"109'1","reported_seq":14,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.435959+0000","last_change":"2023-06-10T19:03:48.061967+0000","last_active":"2023-06-10T19:03:49.435959+0000","last_peered":"2023-06-10T19:03:49.435959+0000","last_clean":"2023-06-10T19:03:49.435959+0000","last_became_active":"2023-06-10T19:03:48.061249+0000","last_became_peered":"2023-06-10T19:03:48.061249+0000","last_unstale":"2023-06-10T19:03:49.435959+0000","last_undegraded":"2023-06-10T19:03:49.435959+0000","last_fullsized":"2023-06-10T19:03:49.435959+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:10:08.461431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.509065+0000","last_change":"2023-06-10T19:03:48.487236+0000","last_active":"2023-06-10T19:03:49.509065+0000","last_peered":"2023-06-10T19:03:49.509065+0000","last_clean":"2023-06-10T19:03:49.509065+0000","last_became_active":"2023-06-10T19:03:48.486719+0000","last_became_peered":"2023-06-10T19:03:48.486719+0000","last_unstale":"2023-06-10T19:03:49.509065+0000","last_undegraded":"2023-06-10T19:03:49.509065+0000","last_fullsized":"2023-06-10T19:03:49.509065+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:43:01.366123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.436408+0000","last_change":"2023-06-10T19:03:48.078777+0000","last_active":"2023-06-10T19:03:49.436408+0000","last_peered":"2023-06-10T19:03:49.436408+0000","last_clean":"2023-06-10T19:03:49.436408+0000","last_became_active":"2023-06-10T19:03:48.077974+0000","last_became_peered":"2023-06-10T19:03:48.077974+0000","last_unstale":"2023-06-10T19:03:49.436408+0000","last_undegraded":"2023-06-10T19:03:49.436408+0000","last_fullsized":"2023-06-10T19:03:49.436408+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:54:23.242085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.505628+0000","last_change":"2023-06-10T19:03:48.447498+0000","last_active":"2023-06-10T19:03:49.505628+0000","last_peered":"2023-06-10T19:03:49.505628+0000","last_clean":"2023-06-10T19:03:49.505628+0000","last_became_active":"2023-06-10T19:03:48.446822+0000","last_became_peered":"2023-06-10T19:03:48.446822+0000","last_unstale":"2023-06-10T19:03:49.505628+0000","last_undegraded":"2023-06-10T19:03:49.505628+0000","last_fullsized":"2023-06-10T19:03:49.505628+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:57:04.272395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.504805+0000","last_change":"2023-06-10T19:03:48.060321+0000","last_active":"2023-06-10T19:03:49.504805+0000","last_peered":"2023-06-10T19:03:49.504805+0000","last_clean":"2023-06-10T19:03:49.504805+0000","last_became_active":"2023-06-10T19:03:48.059996+0000","last_became_peered":"2023-06-10T19:03:48.059996+0000","last_unstale":"2023-06-10T19:03:49.504805+0000","last_undegraded":"2023-06-10T19:03:49.504805+0000","last_fullsized":"2023-06-10T19:03:49.504805+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:46:55.826501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.506263+0000","last_change":"2023-06-10T19:03:48.480109+0000","last_active":"2023-06-10T19:03:49.506263+0000","last_peered":"2023-06-10T19:03:49.506263+0000","last_clean":"2023-06-10T19:03:49.506263+0000","last_became_active":"2023-06-10T19:03:48.479769+0000","last_became_peered":"2023-06-10T19:03:48.479769+0000","last_unstale":"2023-06-10T19:03:49.506263+0000","last_undegraded":"2023-06-10T19:03:49.506263+0000","last_fullsized":"2023-06-10T19:03:49.506263+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:31:37.691913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.438069+0000","last_change":"2023-06-10T19:03:48.081468+0000","last_active":"2023-06-10T19:03:49.438069+0000","last_peered":"2023-06-10T19:03:49.438069+0000","last_clean":"2023-06-10T19:03:49.438069+0000","last_became_active":"2023-06-10T19:03:48.080839+0000","last_became_peered":"2023-06-10T19:03:48.080839+0000","last_unstale":"2023-06-10T19:03:49.438069+0000","last_undegraded":"2023-06-10T19:03:49.438069+0000","last_fullsized":"2023-06-10T19:03:49.438069+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:18:53.514538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.507474+0000","last_change":"2023-06-10T19:03:48.446951+0000","last_active":"2023-06-10T19:03:49.507474+0000","last_peered":"2023-06-10T19:03:49.507474+0000","last_clean":"2023-06-10T19:03:49.507474+0000","last_became_active":"2023-06-10T19:03:48.446420+0000","last_became_peered":"2023-06-10T19:03:48.446420+0000","last_unstale":"2023-06-10T19:03:49.507474+0000","last_undegraded":"2023-06-10T19:03:49.507474+0000","last_fullsized":"2023-06-10T19:03:49.507474+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:45:23.671584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.504868+0000","last_change":"2023-06-10T19:03:48.068645+0000","last_active":"2023-06-10T19:03:49.504868+0000","last_peered":"2023-06-10T19:03:49.504868+0000","last_clean":"2023-06-10T19:03:49.504868+0000","last_became_active":"2023-06-10T19:03:48.068309+0000","last_became_peered":"2023-06-10T19:03:48.068309+0000","last_unstale":"2023-06-10T19:03:49.504868+0000","last_undegraded":"2023-06-10T19:03:49.504868+0000","last_fullsized":"2023-06-10T19:03:49.504868+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:32:14.688745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.429929+0000","last_change":"2023-06-10T19:03:48.453148+0000","last_active":"2023-06-10T19:03:49.429929+0000","last_peered":"2023-06-10T19:03:49.429929+0000","last_clean":"2023-06-10T19:03:49.429929+0000","last_became_active":"2023-06-10T19:03:48.452260+0000","last_became_peered":"2023-06-10T19:03:48.452260+0000","last_unstale":"2023-06-10T19:03:49.429929+0000","last_undegraded":"2023-06-10T19:03:49.429929+0000","last_fullsized":"2023-06-10T19:03:49.429929+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:59:41.083185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"109'3","reported_seq":16,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.507415+0000","last_change":"2023-06-10T19:03:48.058484+0000","last_active":"2023-06-10T19:03:49.507415+0000","last_peered":"2023-06-10T19:03:49.507415+0000","last_clean":"2023-06-10T19:03:49.507415+0000","last_became_active":"2023-06-10T19:03:48.057737+0000","last_became_peered":"2023-06-10T19:03:48.057737+0000","last_unstale":"2023-06-10T19:03:49.507415+0000","last_undegraded":"2023-06-10T19:03:49.507415+0000","last_fullsized":"2023-06-10T19:03:49.507415+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:47:10.845805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.507706+0000","last_change":"2023-06-10T19:03:48.451096+0000","last_active":"2023-06-10T19:03:49.507706+0000","last_peered":"2023-06-10T19:03:49.507706+0000","last_clean":"2023-06-10T19:03:49.507706+0000","last_became_active":"2023-06-10T19:03:48.450787+0000","last_became_peered":"2023-06-10T19:03:48.450787+0000","last_unstale":"2023-06-10T19:03:49.507706+0000","last_undegraded":"2023-06-10T19:03:49.507706+0000","last_fullsized":"2023-06-10T19:03:49.507706+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:03:03.036014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"109'6","reported_seq":19,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.508577+0000","last_change":"2023-06-10T19:03:48.073534+0000","last_active":"2023-06-10T19:03:49.508577+0000","last_peered":"2023-06-10T19:03:49.508577+0000","last_clean":"2023-06-10T19:03:49.508577+0000","last_became_active":"2023-06-10T19:03:48.072717+0000","last_became_peered":"2023-06-10T19:03:48.072717+0000","last_unstale":"2023-06-10T19:03:49.508577+0000","last_undegraded":"2023-06-10T19:03:49.508577+0000","last_fullsized":"2023-06-10T19:03:49.508577+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:37:38.980587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.437198+0000","last_change":"2023-06-10T19:03:48.485254+0000","last_active":"2023-06-10T19:03:49.437198+0000","last_peered":"2023-06-10T19:03:49.437198+0000","last_clean":"2023-06-10T19:03:49.437198+0000","last_became_active":"2023-06-10T19:03:48.484686+0000","last_became_peered":"2023-06-10T19:03:48.484686+0000","last_unstale":"2023-06-10T19:03:49.437198+0000","last_undegraded":"2023-06-10T19:03:49.437198+0000","last_fullsized":"2023-06-10T19:03:49.437198+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:50:28.067860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"109'2","reported_seq":15,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.507805+0000","last_change":"2023-06-10T19:03:48.067399+0000","last_active":"2023-06-10T19:03:49.507805+0000","last_peered":"2023-06-10T19:03:49.507805+0000","last_clean":"2023-06-10T19:03:49.507805+0000","last_became_active":"2023-06-10T19:03:48.066893+0000","last_became_peered":"2023-06-10T19:03:48.066893+0000","last_unstale":"2023-06-10T19:03:49.507805+0000","last_undegraded":"2023-06-10T19:03:49.507805+0000","last_fullsized":"2023-06-10T19:03:49.507805+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:13:19.784263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.508399+0000","last_change":"2023-06-10T19:03:48.480363+0000","last_active":"2023-06-10T19:03:49.508399+0000","last_peered":"2023-06-10T19:03:49.508399+0000","last_clean":"2023-06-10T19:03:49.508399+0000","last_became_active":"2023-06-10T19:03:48.479748+0000","last_became_peered":"2023-06-10T19:03:48.479748+0000","last_unstale":"2023-06-10T19:03:49.508399+0000","last_undegraded":"2023-06-10T19:03:49.508399+0000","last_fullsized":"2023-06-10T19:03:49.508399+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:04:08.399153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.505792+0000","last_change":"2023-06-10T19:03:48.059502+0000","last_active":"2023-06-10T19:03:49.505792+0000","last_peered":"2023-06-10T19:03:49.505792+0000","last_clean":"2023-06-10T19:03:49.505792+0000","last_became_active":"2023-06-10T19:03:48.059114+0000","last_became_peered":"2023-06-10T19:03:48.059114+0000","last_unstale":"2023-06-10T19:03:49.505792+0000","last_undegraded":"2023-06-10T19:03:49.505792+0000","last_fullsized":"2023-06-10T19:03:49.505792+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:25:16.072409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.430000+0000","last_change":"2023-06-10T19:03:48.450061+0000","last_active":"2023-06-10T19:03:49.430000+0000","last_peered":"2023-06-10T19:03:49.430000+0000","last_clean":"2023-06-10T19:03:49.430000+0000","last_became_active":"2023-06-10T19:03:48.449750+0000","last_became_peered":"2023-06-10T19:03:48.449750+0000","last_unstale":"2023-06-10T19:03:49.430000+0000","last_undegraded":"2023-06-10T19:03:49.430000+0000","last_fullsized":"2023-06-10T19:03:49.430000+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:54:51.981177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.429390+0000","last_change":"2023-06-10T19:03:48.066326+0000","last_active":"2023-06-10T19:03:49.429390+0000","last_peered":"2023-06-10T19:03:49.429390+0000","last_clean":"2023-06-10T19:03:49.429390+0000","last_became_active":"2023-06-10T19:03:48.063080+0000","last_became_peered":"2023-06-10T19:03:48.063080+0000","last_unstale":"2023-06-10T19:03:49.429390+0000","last_undegraded":"2023-06-10T19:03:49.429390+0000","last_fullsized":"2023-06-10T19:03:49.429390+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:20:44.072431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.505760+0000","last_change":"2023-06-10T19:03:48.489246+0000","last_active":"2023-06-10T19:03:49.505760+0000","last_peered":"2023-06-10T19:03:49.505760+0000","last_clean":"2023-06-10T19:03:49.505760+0000","last_became_active":"2023-06-10T19:03:48.488948+0000","last_became_peered":"2023-06-10T19:03:48.488948+0000","last_unstale":"2023-06-10T19:03:49.505760+0000","last_undegraded":"2023-06-10T19:03:49.505760+0000","last_fullsized":"2023-06-10T19:03:49.505760+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:25:52.317138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"109'8","reported_seq":21,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.435260+0000","last_change":"2023-06-10T19:03:48.078786+0000","last_active":"2023-06-10T19:03:49.435260+0000","last_peered":"2023-06-10T19:03:49.435260+0000","last_clean":"2023-06-10T19:03:49.435260+0000","last_became_active":"2023-06-10T19:03:48.077102+0000","last_became_peered":"2023-06-10T19:03:48.077102+0000","last_unstale":"2023-06-10T19:03:49.435260+0000","last_undegraded":"2023-06-10T19:03:49.435260+0000","last_fullsized":"2023-06-10T19:03:49.435260+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:41:55.092400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.506168+0000","last_change":"2023-06-10T19:03:48.436987+0000","last_active":"2023-06-10T19:03:49.506168+0000","last_peered":"2023-06-10T19:03:49.506168+0000","last_clean":"2023-06-10T19:03:49.506168+0000","last_became_active":"2023-06-10T19:03:48.436578+0000","last_became_peered":"2023-06-10T19:03:48.436578+0000","last_unstale":"2023-06-10T19:03:49.506168+0000","last_undegraded":"2023-06-10T19:03:49.506168+0000","last_fullsized":"2023-06-10T19:03:49.506168+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:36:10.548253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"109'2","reported_seq":15,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.507611+0000","last_change":"2023-06-10T19:03:48.062951+0000","last_active":"2023-06-10T19:03:49.507611+0000","last_peered":"2023-06-10T19:03:49.507611+0000","last_clean":"2023-06-10T19:03:49.507611+0000","last_became_active":"2023-06-10T19:03:48.062672+0000","last_became_peered":"2023-06-10T19:03:48.062672+0000","last_unstale":"2023-06-10T19:03:49.507611+0000","last_undegraded":"2023-06-10T19:03:49.507611+0000","last_fullsized":"2023-06-10T19:03:49.507611+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:31:49.864748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.435278+0000","last_change":"2023-06-10T19:03:48.449019+0000","last_active":"2023-06-10T19:03:49.435278+0000","last_peered":"2023-06-10T19:03:49.435278+0000","last_clean":"2023-06-10T19:03:49.435278+0000","last_became_active":"2023-06-10T19:03:48.448151+0000","last_became_peered":"2023-06-10T19:03:48.448151+0000","last_unstale":"2023-06-10T19:03:49.435278+0000","last_undegraded":"2023-06-10T19:03:49.435278+0000","last_fullsized":"2023-06-10T19:03:49.435278+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:27:43.912374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.505036+0000","last_change":"2023-06-10T19:03:48.076317+0000","last_active":"2023-06-10T19:03:49.505036+0000","last_peered":"2023-06-10T19:03:49.505036+0000","last_clean":"2023-06-10T19:03:49.505036+0000","last_became_active":"2023-06-10T19:03:48.075936+0000","last_became_peered":"2023-06-10T19:03:48.075936+0000","last_unstale":"2023-06-10T19:03:49.505036+0000","last_undegraded":"2023-06-10T19:03:49.505036+0000","last_fullsized":"2023-06-10T19:03:49.505036+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:15:39.551590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.505712+0000","last_change":"2023-06-10T19:03:48.481654+0000","last_active":"2023-06-10T19:03:49.505712+0000","last_peered":"2023-06-10T19:03:49.505712+0000","last_clean":"2023-06-10T19:03:49.505712+0000","last_became_active":"2023-06-10T19:03:48.481375+0000","last_became_peered":"2023-06-10T19:03:48.481375+0000","last_unstale":"2023-06-10T19:03:49.505712+0000","last_undegraded":"2023-06-10T19:03:49.505712+0000","last_fullsized":"2023-06-10T19:03:49.505712+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:38:42.012771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.508456+0000","last_change":"2023-06-10T19:03:48.075408+0000","last_active":"2023-06-10T19:03:49.508456+0000","last_peered":"2023-06-10T19:03:49.508456+0000","last_clean":"2023-06-10T19:03:49.508456+0000","last_became_active":"2023-06-10T19:03:48.074716+0000","last_became_peered":"2023-06-10T19:03:48.074716+0000","last_unstale":"2023-06-10T19:03:49.508456+0000","last_undegraded":"2023-06-10T19:03:49.508456+0000","last_fullsized":"2023-06-10T19:03:49.508456+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:04:09.823322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.436071+0000","last_change":"2023-06-10T19:03:48.487350+0000","last_active":"2023-06-10T19:03:49.436071+0000","last_peered":"2023-06-10T19:03:49.436071+0000","last_clean":"2023-06-10T19:03:49.436071+0000","last_became_active":"2023-06-10T19:03:48.486155+0000","last_became_peered":"2023-06-10T19:03:48.486155+0000","last_unstale":"2023-06-10T19:03:49.436071+0000","last_undegraded":"2023-06-10T19:03:49.436071+0000","last_fullsized":"2023-06-10T19:03:49.436071+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:11:16.915319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.507741+0000","last_change":"2023-06-10T19:03:48.078794+0000","last_active":"2023-06-10T19:03:49.507741+0000","last_peered":"2023-06-10T19:03:49.507741+0000","last_clean":"2023-06-10T19:03:49.507741+0000","last_became_active":"2023-06-10T19:03:48.078264+0000","last_became_peered":"2023-06-10T19:03:48.078264+0000","last_unstale":"2023-06-10T19:03:49.507741+0000","last_undegraded":"2023-06-10T19:03:49.507741+0000","last_fullsized":"2023-06-10T19:03:49.507741+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:48:28.782590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.429574+0000","last_change":"2023-06-10T19:03:48.449349+0000","last_active":"2023-06-10T19:03:49.429574+0000","last_peered":"2023-06-10T19:03:49.429574+0000","last_clean":"2023-06-10T19:03:49.429574+0000","last_became_active":"2023-06-10T19:03:48.449057+0000","last_became_peered":"2023-06-10T19:03:48.449057+0000","last_unstale":"2023-06-10T19:03:49.429574+0000","last_undegraded":"2023-06-10T19:03:49.429574+0000","last_fullsized":"2023-06-10T19:03:49.429574+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:42:44.434000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.436093+0000","last_change":"2023-06-10T19:03:48.069002+0000","last_active":"2023-06-10T19:03:49.436093+0000","last_peered":"2023-06-10T19:03:49.436093+0000","last_clean":"2023-06-10T19:03:49.436093+0000","last_became_active":"2023-06-10T19:03:48.068221+0000","last_became_peered":"2023-06-10T19:03:48.068221+0000","last_unstale":"2023-06-10T19:03:49.436093+0000","last_undegraded":"2023-06-10T19:03:49.436093+0000","last_fullsized":"2023-06-10T19:03:49.436093+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:50:18.359250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.429733+0000","last_change":"2023-06-10T19:03:48.453016+0000","last_active":"2023-06-10T19:03:49.429733+0000","last_peered":"2023-06-10T19:03:49.429733+0000","last_clean":"2023-06-10T19:03:49.429733+0000","last_became_active":"2023-06-10T19:03:48.452678+0000","last_became_peered":"2023-06-10T19:03:48.452678+0000","last_unstale":"2023-06-10T19:03:49.429733+0000","last_undegraded":"2023-06-10T19:03:49.429733+0000","last_fullsized":"2023-06-10T19:03:49.429733+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:19:00.970807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.429701+0000","last_change":"2023-06-10T19:03:48.061022+0000","last_active":"2023-06-10T19:03:49.429701+0000","last_peered":"2023-06-10T19:03:49.429701+0000","last_clean":"2023-06-10T19:03:49.429701+0000","last_became_active":"2023-06-10T19:03:48.058316+0000","last_became_peered":"2023-06-10T19:03:48.058316+0000","last_unstale":"2023-06-10T19:03:49.429701+0000","last_undegraded":"2023-06-10T19:03:49.429701+0000","last_fullsized":"2023-06-10T19:03:49.429701+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:50:26.620312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.508213+0000","last_change":"2023-06-10T19:03:48.491333+0000","last_active":"2023-06-10T19:03:49.508213+0000","last_peered":"2023-06-10T19:03:49.508213+0000","last_clean":"2023-06-10T19:03:49.508213+0000","last_became_active":"2023-06-10T19:03:48.490517+0000","last_became_peered":"2023-06-10T19:03:48.490517+0000","last_unstale":"2023-06-10T19:03:49.508213+0000","last_undegraded":"2023-06-10T19:03:49.508213+0000","last_fullsized":"2023-06-10T19:03:49.508213+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:19:30.572379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.508322+0000","last_change":"2023-06-10T19:03:48.061406+0000","last_active":"2023-06-10T19:03:49.508322+0000","last_peered":"2023-06-10T19:03:49.508322+0000","last_clean":"2023-06-10T19:03:49.508322+0000","last_became_active":"2023-06-10T19:03:48.060656+0000","last_became_peered":"2023-06-10T19:03:48.060656+0000","last_unstale":"2023-06-10T19:03:49.508322+0000","last_undegraded":"2023-06-10T19:03:49.508322+0000","last_fullsized":"2023-06-10T19:03:49.508322+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:30:41.805045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.439096+0000","last_change":"2023-06-10T19:03:48.488499+0000","last_active":"2023-06-10T19:03:49.439096+0000","last_peered":"2023-06-10T19:03:49.439096+0000","last_clean":"2023-06-10T19:03:49.439096+0000","last_became_active":"2023-06-10T19:03:48.487998+0000","last_became_peered":"2023-06-10T19:03:48.487998+0000","last_unstale":"2023-06-10T19:03:49.439096+0000","last_undegraded":"2023-06-10T19:03:49.439096+0000","last_fullsized":"2023-06-10T19:03:49.439096+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:35:55.277297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.430277+0000","last_change":"2023-06-10T19:03:48.066649+0000","last_active":"2023-06-10T19:03:49.430277+0000","last_peered":"2023-06-10T19:03:49.430277+0000","last_clean":"2023-06-10T19:03:49.430277+0000","last_became_active":"2023-06-10T19:03:48.065666+0000","last_became_peered":"2023-06-10T19:03:48.065666+0000","last_unstale":"2023-06-10T19:03:49.430277+0000","last_undegraded":"2023-06-10T19:03:49.430277+0000","last_fullsized":"2023-06-10T19:03:49.430277+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:24:41.133238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.435697+0000","last_change":"2023-06-10T19:03:48.485313+0000","last_active":"2023-06-10T19:03:49.435697+0000","last_peered":"2023-06-10T19:03:49.435697+0000","last_clean":"2023-06-10T19:03:49.435697+0000","last_became_active":"2023-06-10T19:03:48.484409+0000","last_became_peered":"2023-06-10T19:03:48.484409+0000","last_unstale":"2023-06-10T19:03:49.435697+0000","last_undegraded":"2023-06-10T19:03:49.435697+0000","last_fullsized":"2023-06-10T19:03:49.435697+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:24:10.847411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"109'2","reported_seq":15,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.429846+0000","last_change":"2023-06-10T19:03:48.062509+0000","last_active":"2023-06-10T19:03:49.429846+0000","last_peered":"2023-06-10T19:03:49.429846+0000","last_clean":"2023-06-10T19:03:49.429846+0000","last_became_active":"2023-06-10T19:03:48.061626+0000","last_became_peered":"2023-06-10T19:03:48.061626+0000","last_unstale":"2023-06-10T19:03:49.429846+0000","last_undegraded":"2023-06-10T19:03:49.429846+0000","last_fullsized":"2023-06-10T19:03:49.429846+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:15:16.644878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":330,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.507149+0000","last_change":"2023-06-10T18:52:34.951528+0000","last_active":"2023-06-10T19:03:49.507149+0000","last_peered":"2023-06-10T19:03:49.507149+0000","last_clean":"2023-06-10T19:03:49.507149+0000","last_became_active":"2023-06-10T18:52:34.949099+0000","last_became_peered":"2023-06-10T18:52:34.949099+0000","last_unstale":"2023-06-10T19:03:49.507149+0000","last_undegraded":"2023-06-10T19:03:49.507149+0000","last_fullsized":"2023-06-10T19:03:49.507149+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_clean_scrub_stamp":"2023-06-10T18:52:33.633295+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:51:39.741748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":182,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.436696+0000","last_change":"2023-06-10T18:52:40.506384+0000","last_active":"2023-06-10T19:03:49.436696+0000","last_peered":"2023-06-10T19:03:49.436696+0000","last_clean":"2023-06-10T19:03:49.436696+0000","last_became_active":"2023-06-10T18:52:40.505701+0000","last_became_peered":"2023-06-10T18:52:40.505701+0000","last_unstale":"2023-06-10T19:03:49.436696+0000","last_undegraded":"2023-06-10T19:03:49.436696+0000","last_fullsized":"2023-06-10T19:03:49.436696+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:40:01.955675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.508114+0000","last_change":"2023-06-10T19:03:48.450059+0000","last_active":"2023-06-10T19:03:49.508114+0000","last_peered":"2023-06-10T19:03:49.508114+0000","last_clean":"2023-06-10T19:03:49.508114+0000","last_became_active":"2023-06-10T19:03:48.443821+0000","last_became_peered":"2023-06-10T19:03:48.443821+0000","last_unstale":"2023-06-10T19:03:49.508114+0000","last_undegraded":"2023-06-10T19:03:49.508114+0000","last_fullsized":"2023-06-10T19:03:49.508114+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:47:45.201225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"109'1","reported_seq":14,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.508097+0000","last_change":"2023-06-10T19:03:48.060710+0000","last_active":"2023-06-10T19:03:49.508097+0000","last_peered":"2023-06-10T19:03:49.508097+0000","last_clean":"2023-06-10T19:03:49.508097+0000","last_became_active":"2023-06-10T19:03:48.059956+0000","last_became_peered":"2023-06-10T19:03:48.059956+0000","last_unstale":"2023-06-10T19:03:49.508097+0000","last_undegraded":"2023-06-10T19:03:49.508097+0000","last_fullsized":"2023-06-10T19:03:49.508097+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:38:19.615021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":174,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.506764+0000","last_change":"2023-06-10T18:52:40.512015+0000","last_active":"2023-06-10T19:03:49.506764+0000","last_peered":"2023-06-10T19:03:49.506764+0000","last_clean":"2023-06-10T19:03:49.506764+0000","last_became_active":"2023-06-10T18:52:40.511382+0000","last_became_peered":"2023-06-10T18:52:40.511382+0000","last_unstale":"2023-06-10T19:03:49.506764+0000","last_undegraded":"2023-06-10T19:03:49.506764+0000","last_fullsized":"2023-06-10T19:03:49.506764+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:12:40.512430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.507550+0000","last_change":"2023-06-10T19:03:48.477805+0000","last_active":"2023-06-10T19:03:49.507550+0000","last_peered":"2023-06-10T19:03:49.507550+0000","last_clean":"2023-06-10T19:03:49.507550+0000","last_became_active":"2023-06-10T19:03:48.477545+0000","last_became_peered":"2023-06-10T19:03:48.477545+0000","last_unstale":"2023-06-10T19:03:49.507550+0000","last_undegraded":"2023-06-10T19:03:49.507550+0000","last_fullsized":"2023-06-10T19:03:49.507550+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:50:28.067860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.437480+0000","last_change":"2023-06-10T19:03:48.067579+0000","last_active":"2023-06-10T19:03:49.437480+0000","last_peered":"2023-06-10T19:03:49.437480+0000","last_clean":"2023-06-10T19:03:49.437480+0000","last_became_active":"2023-06-10T19:03:48.066785+0000","last_became_peered":"2023-06-10T19:03:48.066785+0000","last_unstale":"2023-06-10T19:03:49.437480+0000","last_undegraded":"2023-06-10T19:03:49.437480+0000","last_fullsized":"2023-06-10T19:03:49.437480+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:31:49.864748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":180,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.429526+0000","last_change":"2023-06-10T18:52:40.671725+0000","last_active":"2023-06-10T19:03:49.429526+0000","last_peered":"2023-06-10T19:03:49.429526+0000","last_clean":"2023-06-10T19:03:49.429526+0000","last_became_active":"2023-06-10T18:52:40.671442+0000","last_became_peered":"2023-06-10T18:52:40.671442+0000","last_unstale":"2023-06-10T19:03:49.429526+0000","last_undegraded":"2023-06-10T19:03:49.429526+0000","last_fullsized":"2023-06-10T19:03:49.429526+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:58:03.695938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.429713+0000","last_change":"2023-06-10T19:03:48.438028+0000","last_active":"2023-06-10T19:03:49.429713+0000","last_peered":"2023-06-10T19:03:49.429713+0000","last_clean":"2023-06-10T19:03:49.429713+0000","last_became_active":"2023-06-10T19:03:48.437730+0000","last_became_peered":"2023-06-10T19:03:48.437730+0000","last_unstale":"2023-06-10T19:03:49.429713+0000","last_undegraded":"2023-06-10T19:03:49.429713+0000","last_fullsized":"2023-06-10T19:03:49.429713+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:13:00.410218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"109'1","reported_seq":14,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.508371+0000","last_change":"2023-06-10T19:03:48.079114+0000","last_active":"2023-06-10T19:03:49.508371+0000","last_peered":"2023-06-10T19:03:49.508371+0000","last_clean":"2023-06-10T19:03:49.508371+0000","last_became_active":"2023-06-10T19:03:48.078444+0000","last_became_peered":"2023-06-10T19:03:48.078444+0000","last_unstale":"2023-06-10T19:03:49.508371+0000","last_undegraded":"2023-06-10T19:03:49.508371+0000","last_fullsized":"2023-06-10T19:03:49.508371+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:43:48.766756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":182,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.436272+0000","last_change":"2023-06-10T18:52:40.510258+0000","last_active":"2023-06-10T19:03:49.436272+0000","last_peered":"2023-06-10T19:03:49.436272+0000","last_clean":"2023-06-10T19:03:49.436272+0000","last_became_active":"2023-06-10T18:52:40.509560+0000","last_became_peered":"2023-06-10T18:52:40.509560+0000","last_unstale":"2023-06-10T19:03:49.436272+0000","last_undegraded":"2023-06-10T19:03:49.436272+0000","last_fullsized":"2023-06-10T19:03:49.436272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:34:15.123495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.505503+0000","last_change":"2023-06-10T19:03:48.492369+0000","last_active":"2023-06-10T19:03:49.505503+0000","last_peered":"2023-06-10T19:03:49.505503+0000","last_clean":"2023-06-10T19:03:49.505503+0000","last_became_active":"2023-06-10T19:03:48.492035+0000","last_became_peered":"2023-06-10T19:03:48.492035+0000","last_unstale":"2023-06-10T19:03:49.505503+0000","last_undegraded":"2023-06-10T19:03:49.505503+0000","last_fullsized":"2023-06-10T19:03:49.505503+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:53:06.160322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.507956+0000","last_change":"2023-06-10T19:03:48.071240+0000","last_active":"2023-06-10T19:03:49.507956+0000","last_peered":"2023-06-10T19:03:49.507956+0000","last_clean":"2023-06-10T19:03:49.507956+0000","last_became_active":"2023-06-10T19:03:48.070481+0000","last_became_peered":"2023-06-10T19:03:48.070481+0000","last_unstale":"2023-06-10T19:03:49.507956+0000","last_undegraded":"2023-06-10T19:03:49.507956+0000","last_fullsized":"2023-06-10T19:03:49.507956+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:06:07.099604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":168,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.507896+0000","last_change":"2023-06-10T18:52:40.672266+0000","last_active":"2023-06-10T19:03:49.507896+0000","last_peered":"2023-06-10T19:03:49.507896+0000","last_clean":"2023-06-10T19:03:49.507896+0000","last_became_active":"2023-06-10T18:52:40.671966+0000","last_became_peered":"2023-06-10T18:52:40.671966+0000","last_unstale":"2023-06-10T19:03:49.507896+0000","last_undegraded":"2023-06-10T19:03:49.507896+0000","last_fullsized":"2023-06-10T19:03:49.507896+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:35:39.370826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.430542+0000","last_change":"2023-06-10T19:03:48.452602+0000","last_active":"2023-06-10T19:03:49.430542+0000","last_peered":"2023-06-10T19:03:49.430542+0000","last_clean":"2023-06-10T19:03:49.430542+0000","last_became_active":"2023-06-10T19:03:48.452291+0000","last_became_peered":"2023-06-10T19:03:48.452291+0000","last_unstale":"2023-06-10T19:03:49.430542+0000","last_undegraded":"2023-06-10T19:03:49.430542+0000","last_fullsized":"2023-06-10T19:03:49.430542+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:03:54.757738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.429946+0000","last_change":"2023-06-10T19:03:48.068579+0000","last_active":"2023-06-10T19:03:49.429946+0000","last_peered":"2023-06-10T19:03:49.429946+0000","last_clean":"2023-06-10T19:03:49.429946+0000","last_became_active":"2023-06-10T19:03:48.065911+0000","last_became_peered":"2023-06-10T19:03:48.065911+0000","last_unstale":"2023-06-10T19:03:49.429946+0000","last_undegraded":"2023-06-10T19:03:49.429946+0000","last_fullsized":"2023-06-10T19:03:49.429946+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:45:21.584633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":174,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.507778+0000","last_change":"2023-06-10T18:52:40.671084+0000","last_active":"2023-06-10T19:03:49.507778+0000","last_peered":"2023-06-10T19:03:49.507778+0000","last_clean":"2023-06-10T19:03:49.507778+0000","last_became_active":"2023-06-10T18:52:40.670697+0000","last_became_peered":"2023-06-10T18:52:40.670697+0000","last_unstale":"2023-06-10T19:03:49.507778+0000","last_undegraded":"2023-06-10T19:03:49.507778+0000","last_fullsized":"2023-06-10T19:03:49.507778+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:18:21.910852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.506619+0000","last_change":"2023-06-10T19:03:48.438530+0000","last_active":"2023-06-10T19:03:49.506619+0000","last_peered":"2023-06-10T19:03:49.506619+0000","last_clean":"2023-06-10T19:03:49.506619+0000","last_became_active":"2023-06-10T19:03:48.438251+0000","last_became_peered":"2023-06-10T19:03:48.438251+0000","last_unstale":"2023-06-10T19:03:49.506619+0000","last_undegraded":"2023-06-10T19:03:49.506619+0000","last_fullsized":"2023-06-10T19:03:49.506619+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:59:04.545336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"109'2","reported_seq":15,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.430313+0000","last_change":"2023-06-10T19:03:48.053779+0000","last_active":"2023-06-10T19:03:49.430313+0000","last_peered":"2023-06-10T19:03:49.430313+0000","last_clean":"2023-06-10T19:03:49.430313+0000","last_became_active":"2023-06-10T19:03:48.053467+0000","last_became_peered":"2023-06-10T19:03:48.053467+0000","last_unstale":"2023-06-10T19:03:49.430313+0000","last_undegraded":"2023-06-10T19:03:49.430313+0000","last_fullsized":"2023-06-10T19:03:49.430313+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:22:54.761528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":168,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.507894+0000","last_change":"2023-06-10T18:52:40.514114+0000","last_active":"2023-06-10T19:03:49.507894+0000","last_peered":"2023-06-10T19:03:49.507894+0000","last_clean":"2023-06-10T19:03:49.507894+0000","last_became_active":"2023-06-10T18:52:40.513638+0000","last_became_peered":"2023-06-10T18:52:40.513638+0000","last_unstale":"2023-06-10T19:03:49.507894+0000","last_undegraded":"2023-06-10T19:03:49.507894+0000","last_fullsized":"2023-06-10T19:03:49.507894+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:29:24.248881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":11,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.505718+0000","last_change":"2023-06-10T19:03:48.449339+0000","last_active":"2023-06-10T19:03:49.505718+0000","last_peered":"2023-06-10T19:03:49.505718+0000","last_clean":"2023-06-10T19:03:49.505718+0000","last_became_active":"2023-06-10T19:03:48.449048+0000","last_became_peered":"2023-06-10T19:03:48.449048+0000","last_unstale":"2023-06-10T19:03:49.505718+0000","last_undegraded":"2023-06-10T19:03:49.505718+0000","last_fullsized":"2023-06-10T19:03:49.505718+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:48.022931+0000","last_clean_scrub_stamp":"2023-06-10T19:03:48.022931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:35:06.148326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.429284+0000","last_change":"2023-06-10T19:03:48.061340+0000","last_active":"2023-06-10T19:03:49.429284+0000","last_peered":"2023-06-10T19:03:49.429284+0000","last_clean":"2023-06-10T19:03:49.429284+0000","last_became_active":"2023-06-10T19:03:48.058437+0000","last_became_peered":"2023-06-10T19:03:48.058437+0000","last_unstale":"2023-06-10T19:03:49.429284+0000","last_undegraded":"2023-06-10T19:03:49.429284+0000","last_fullsized":"2023-06-10T19:03:49.429284+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:03:47.019320+0000","last_clean_scrub_stamp":"2023-06-10T19:03:47.019320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:12:07.965810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":174,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-06-10T19:03:49.508719+0000","last_change":"2023-06-10T18:52:40.515396+0000","last_active":"2023-06-10T19:03:49.508719+0000","last_peered":"2023-06-10T19:03:49.508719+0000","last_clean":"2023-06-10T19:03:49.508719+0000","last_became_active":"2023-06-10T18:52:40.514663+0000","last_became_peered":"2023-06-10T18:52:40.514663+0000","last_unstale":"2023-06-10T19:03:49.508719+0000","last_undegraded":"2023-06-10T19:03:49.508719+0000","last_fullsized":"2023-06-10T19:03:49.508719+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:17:35.846081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574987,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32964,"kb_used_data":1916,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338876,"statfs":{"total":96636764160,"available":96603009024,"internally_reserved":0,"allocated":1961984,"data_stored":1217628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:02:54 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.95199999999999996,"15min":0.91000000000000003},"min":{"1min":0.64700000000000002,"5min":0.54700000000000004,"15min":0.434},"max":{"1min":1.198,"5min":1.327,"15min":1.6220000000000001},"last":0.99299999999999999},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.93899999999999995,"15min":0.92900000000000005},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.496},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.6870000000000001},"last":0.96999999999999997}]},{"osd":1,"last update":"Sat Jun 10 19:02:54 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.92600000000000005,"15min":0.92400000000000004},"min":{"1min":0.623,"5min":0.55100000000000005,"15min":0.53900000000000003},"max":{"1min":1.2350000000000001,"5min":1.262,"15min":1.377},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.97299999999999998,"15min":0.93999999999999995},"min":{"1min":0.68700000000000006,"5min":0.66300000000000003,"15min":0.504},"max":{"1min":1.161,"5min":1.234,"15min":1.5960000000000001},"last":0.86399999999999999}]},{"osd":2,"last update":"Sat Jun 10 19:02:54 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.85699999999999998,"15min":0.83999999999999997},"min":{"1min":0.57999999999999996,"5min":0.52100000000000002,"15min":0.47099999999999997},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.4059999999999999},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.91800000000000004,"15min":0.90300000000000002},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.50600000000000001},"max":{"1min":1.1839999999999999,"5min":1.448,"15min":1.448},"last":0.81599999999999995}]},{"osd":3,"last update":"Sat Jun 10 19:02:54 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.94399999999999995,"15min":0.92200000000000004},"min":{"1min":0.71199999999999997,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.2350000000000001,"5min":1.2370000000000001,"15min":1.502},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.98999999999999999,"15min":0.94699999999999995},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.53800000000000003},"max":{"1min":1.276,"5min":1.284,"15min":1.2929999999999999},"last":1.0620000000000001}]},{"osd":4,"last update":"Sat Jun 10 19:02:54 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.82499999999999996,"15min":0.85399999999999998},"min":{"1min":0.58699999999999997,"5min":0.39500000000000002,"15min":0.32700000000000001},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.639},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.98499999999999999,"15min":0.97299999999999998},"min":{"1min":0.81999999999999995,"5min":0.434,"15min":0.40000000000000002},"max":{"1min":1.454,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.0349999999999999}]},{"osd":5,"last update":"Sat Jun 10 19:02:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.002,"15min":1.014},"min":{"1min":0.70899999999999996,"5min":0.40500000000000003,"15min":0.38400000000000001},"max":{"1min":1.2809999999999999,"5min":1.395,"15min":1.806},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.0489999999999999,"15min":1.042},"min":{"1min":0.745,"5min":0.505,"15min":0.46500000000000002},"max":{"1min":1.393,"5min":1.579,"15min":1.579},"last":0.89700000000000002}]},{"osd":6,"last update":"Sat Jun 10 19:02:54 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.0329999999999999,"15min":1.0089999999999999},"min":{"1min":0.73599999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.2909999999999999,"5min":1.391,"15min":1.718},"last":1.0169999999999999},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.1259999999999999,"15min":1.099},"min":{"1min":0.99399999999999999,"5min":0.48799999999999999,"15min":0.441},"max":{"1min":1.329,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":1.085}]}]},{"osd":6,"up_from":13,"seq":55834574988,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32396,"kb_used_data":1348,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339444,"statfs":{"total":96636764160,"available":96603590656,"internally_reserved":0,"allocated":1380352,"data_stored":629268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:03:48 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.84699999999999998,"15min":0.85199999999999998},"min":{"1min":0.51300000000000001,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.202,"5min":1.202,"15min":1.498},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.87,"15min":0.871},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.1339999999999999,"5min":1.2250000000000001,"15min":1.496},"last":0.89600000000000002}]},{"osd":1,"last update":"Sat Jun 10 19:03:48 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.86099999999999999,"15min":0.86399999999999999},"min":{"1min":0.73999999999999999,"5min":0.502,"15min":0.48699999999999999},"max":{"1min":1.0369999999999999,"5min":1.143,"15min":1.5229999999999999},"last":1.077},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.90700000000000003,"15min":0.88900000000000001},"min":{"1min":0.56000000000000005,"5min":0.48699999999999999,"15min":0.45300000000000001},"max":{"1min":1.159,"5min":1.258,"15min":1.778},"last":1.101}]},{"osd":2,"last update":"Sat Jun 10 19:03:48 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.91400000000000003,"15min":0.89100000000000001},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.1559999999999999,"5min":1.2809999999999999,"15min":1.3759999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.89100000000000001,"15min":0.89000000000000001},"min":{"1min":0.67700000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.151,"5min":1.2330000000000001,"15min":1.246},"last":0.93200000000000005}]},{"osd":3,"last update":"Sat Jun 10 19:03:48 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.92400000000000004,"15min":0.90300000000000002},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.52700000000000002},"max":{"1min":1.238,"5min":1.238,"15min":1.7190000000000001},"last":1.161},{"interface":"front","average":{"1min":1.008,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.256,"5min":1.371,"15min":1.4370000000000001},"last":0.747}]},{"osd":4,"last update":"Sat Jun 10 19:03:48 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.89000000000000001,"15min":0.92200000000000004},"min":{"1min":0.62,"5min":0.373,"15min":0.373},"max":{"1min":1.1739999999999999,"5min":1.401,"15min":1.798},"last":0.99299999999999999},{"interface":"front","average":{"1min":1.0409999999999999,"5min":0.98599999999999999,"15min":0.99399999999999999},"min":{"1min":0.746,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.3009999999999999,"5min":1.357,"15min":1.5489999999999999},"last":1.028}]},{"osd":5,"last update":"Sat Jun 10 19:03:48 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.90100000000000002,"15min":0.92700000000000005},"min":{"1min":0.71999999999999997,"5min":0.442,"15min":0.442},"max":{"1min":1.0960000000000001,"5min":1.29,"15min":1.333},"last":1.137},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.008,"15min":1.0249999999999999},"min":{"1min":0.64100000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.2569999999999999,"5min":1.2649999999999999,"15min":2.536},"last":1.2030000000000001}]},{"osd":7,"last update":"Sat Jun 10 19:03:48 2023","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.0329999999999999,"15min":1.0369999999999999},"min":{"1min":0.79100000000000004,"5min":0.58599999999999997,"15min":0.57099999999999995},"max":{"1min":1.879,"5min":1.879,"15min":1.917},"last":0.83499999999999996},{"interface":"front","average":{"1min":1.0109999999999999,"5min":0.99199999999999999,"15min":1.024},"min":{"1min":0.71299999999999997,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.1459999999999999,"5min":1.4850000000000001,"15min":1.5569999999999999},"last":1.1759999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574988,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32376,"kb_used_data":1328,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339464,"statfs":{"total":96636764160,"available":96603611136,"internally_reserved":0,"allocated":1359872,"data_stored":627100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.88400000000000001,"15min":0.86399999999999999},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.0800000000000001,"5min":1.2070000000000001,"15min":1.232},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.93100000000000005,"15min":0.92000000000000004},"min":{"1min":0.70199999999999996,"5min":0.58999999999999997,"15min":0.49399999999999999},"max":{"1min":1.165,"5min":2.347,"15min":2.347},"last":0.64600000000000002}]},{"osd":1,"last update":"Sat Jun 10 19:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.95699999999999996,"15min":0.92000000000000004},"min":{"1min":0.63800000000000001,"5min":0.58799999999999997,"15min":0.52600000000000002},"max":{"1min":1.1599999999999999,"5min":7.0800000000000001,"15min":7.0800000000000001},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.94399999999999995,"5min":1.135,"15min":0.99099999999999999},"min":{"1min":0.58799999999999997,"5min":0.58399999999999996,"15min":0.53800000000000003},"max":{"1min":1.2689999999999999,"5min":15.845000000000001,"15min":15.845000000000001},"last":0.56499999999999995}]},{"osd":2,"last update":"Sat Jun 10 19:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.94099999999999995,"15min":0.88400000000000001},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.48299999999999998},"max":{"1min":1.319,"5min":5.0049999999999999,"15min":5.0049999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.89700000000000002,"5min":1.0109999999999999,"15min":0.94299999999999995},"min":{"1min":0.64900000000000002,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.0569999999999999,"5min":6.851,"15min":6.851},"last":0.60699999999999998}]},{"osd":3,"last update":"Sat Jun 10 19:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.96299999999999997,"15min":0.95299999999999996},"min":{"1min":0.71399999999999997,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.2010000000000001,"5min":2.544,"15min":2.544},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.95099999999999996,"5min":1.0109999999999999,"15min":1.008},"min":{"1min":0.68899999999999995,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.1739999999999999,"5min":3.0830000000000002,"15min":3.0830000000000002},"last":0.91100000000000003}]},{"osd":4,"last update":"Sat Jun 10 19:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.97799999999999998,"15min":0.96099999999999997},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.58099999999999996},"max":{"1min":1.2669999999999999,"5min":6.7290000000000001,"15min":6.7290000000000001},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.98299999999999998,"15min":1.014},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.61199999999999999},"max":{"1min":1.1200000000000001,"5min":1.341,"15min":1.575},"last":0.97499999999999998}]},{"osd":6,"last update":"Sat Jun 10 19:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.99099999999999999,"15min":1.0149999999999999},"min":{"1min":0.68100000000000005,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.232,"5min":1.3029999999999999,"15min":1.4330000000000001},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.97699999999999998,"5min":1.105,"15min":1.0660000000000001},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.57899999999999996},"max":{"1min":1.194,"5min":6.923,"15min":6.923},"last":0.94399999999999995}]},{"osd":7,"last update":"Sat Jun 10 19:03:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.081,"15min":1.111},"min":{"1min":0.69899999999999995,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.2829999999999999,"5min":2.6080000000000001,"15min":2.6080000000000001},"last":0.88200000000000001},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.163,"15min":1.153},"min":{"1min":0.84499999999999997,"5min":0.67100000000000004,"15min":0.66200000000000003},"max":{"1min":1.365,"5min":5.4169999999999998,"15min":5.4169999999999998},"last":1.0669999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574987,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32384,"kb_used_data":1336,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339456,"statfs":{"total":96636764160,"available":96603602944,"internally_reserved":0,"allocated":1368064,"data_stored":627192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.88200000000000001,"15min":0.80900000000000005},"min":{"1min":0.52500000000000002,"5min":0.48599999999999999,"15min":0.45100000000000001},"max":{"1min":1.153,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.504},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.91100000000000003,"15min":0.90000000000000002},"min":{"1min":0.57099999999999995,"5min":0.49199999999999999,"15min":0.48899999999999999},"max":{"1min":1.202,"5min":1.288,"15min":3.7280000000000002},"last":0.91900000000000004}]},{"osd":1,"last update":"Sat Jun 10 19:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.92700000000000005,"15min":0.94399999999999995},"min":{"1min":0.62,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1970000000000001,"5min":1.254,"15min":3.3969999999999998},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.88300000000000001,"15min":0.85999999999999999},"min":{"1min":0.622,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.202,"5min":1.2110000000000001,"15min":2.496},"last":0.56200000000000006}]},{"osd":2,"last update":"Sat Jun 10 19:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.88900000000000001,"15min":0.88300000000000001},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.49299999999999999},"max":{"1min":1.236,"5min":1.3,"15min":1.522},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.98799999999999999,"15min":0.998},"min":{"1min":0.73999999999999999,"5min":0.64400000000000002,"15min":0.55000000000000004},"max":{"1min":1.1719999999999999,"5min":1.2769999999999999,"15min":3.5750000000000002},"last":0.77300000000000002}]},{"osd":3,"last update":"Sat Jun 10 19:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.92200000000000004,"15min":0.89800000000000002},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.53900000000000003},"max":{"1min":1.46,"5min":1.46,"15min":2.3809999999999998},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.97199999999999998,"15min":0.96299999999999997},"min":{"1min":0.63400000000000001,"5min":0.61499999999999999,"15min":0.54400000000000004},"max":{"1min":1.236,"5min":1.2370000000000001,"15min":1.6479999999999999},"last":0.73899999999999999}]},{"osd":5,"last update":"Sat Jun 10 19:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.92400000000000004,"15min":0.96899999999999997},"min":{"1min":0.65600000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.3260000000000001,"5min":1.3360000000000001,"15min":3.6539999999999999},"last":1.0229999999999999},{"interface":"front","average":{"1min":0.873,"5min":0.91600000000000004,"15min":0.95699999999999996},"min":{"1min":0.624,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.26,"5min":1.3460000000000001,"15min":2.6720000000000002},"last":0.94799999999999995}]},{"osd":6,"last update":"Sat Jun 10 19:03:01 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":0.94499999999999995,"15min":0.98799999999999999},"min":{"1min":0.59699999999999998,"5min":0.58499999999999996,"15min":0.54900000000000004},"max":{"1min":1.21,"5min":1.3149999999999999,"15min":2.2639999999999998},"last":0.88700000000000001},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.0329999999999999,"15min":1.0640000000000001},"min":{"1min":0.72799999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.3080000000000001,"5min":1.4059999999999999,"15min":3.4980000000000002},"last":0.97699999999999998}]},{"osd":7,"last update":"Sat Jun 10 19:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.98599999999999999,"15min":0.99299999999999999},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.41399999999999998},"max":{"1min":1.272,"5min":1.482,"15min":2.5910000000000002},"last":0.998},{"interface":"front","average":{"1min":1.077,"5min":1.0620000000000001,"15min":1.0680000000000001},"min":{"1min":0.76600000000000001,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.361,"5min":1.3740000000000001,"15min":1.4399999999999999},"last":0.81399999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574986,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32376,"kb_used_data":1328,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339464,"statfs":{"total":96636764160,"available":96603611136,"internally_reserved":0,"allocated":1359872,"data_stored":626663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.63700000000000001,"15min":0.60799999999999998},"min":{"1min":0.39900000000000002,"5min":0.28699999999999998,"15min":0.27900000000000003},"max":{"1min":0.79900000000000004,"5min":1.1539999999999999,"15min":1.169},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69499999999999995,"15min":0.66100000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.251},"max":{"1min":0.92400000000000004,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.36799999999999999}]},{"osd":1,"last update":"Sat Jun 10 19:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.68899999999999995,"15min":0.66700000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.27500000000000002},"max":{"1min":1.01,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.746,"15min":0.73599999999999999},"min":{"1min":0.439,"5min":0.373,"15min":0.318},"max":{"1min":1.0409999999999999,"5min":1.2569999999999999,"15min":1.411},"last":0.55300000000000005}]},{"osd":2,"last update":"Sat Jun 10 19:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.77900000000000003,"15min":0.77100000000000002},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.30299999999999999},"max":{"1min":1.2829999999999999,"5min":1.3899999999999999,"15min":1.9530000000000001},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80700000000000005,"15min":0.77700000000000002},"min":{"1min":0.46300000000000002,"5min":0.35299999999999998,"15min":0.29699999999999999},"max":{"1min":1.123,"5min":1.591,"15min":1.591},"last":0.65700000000000003}]},{"osd":4,"last update":"Sat Jun 10 19:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.97799999999999998,"15min":0.95899999999999996},"min":{"1min":0.623,"5min":0.623,"15min":0.41899999999999998},"max":{"1min":1.4239999999999999,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.995,"15min":0.98999999999999999},"min":{"1min":0.65600000000000003,"5min":0.61299999999999999,"15min":0.47999999999999998},"max":{"1min":1.3140000000000001,"5min":1.873,"15min":1.873},"last":0.68200000000000005}]},{"osd":5,"last update":"Sat Jun 10 19:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":1.0129999999999999,"15min":1.0249999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.5329999999999999,"5min":1.752,"15min":2.024},"last":0.60199999999999998},{"interface":"front","average":{"1min":1.026,"5min":1.0249999999999999,"15min":1.028},"min":{"1min":0.64400000000000002,"5min":0.60299999999999998,"15min":0.46899999999999997},"max":{"1min":1.5149999999999999,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.71299999999999997}]},{"osd":6,"last update":"Sat Jun 10 19:03:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.075,"15min":1.0620000000000001},"min":{"1min":0.63800000000000001,"5min":0.59299999999999997,"15min":0.55300000000000005},"max":{"1min":1.5620000000000001,"5min":1.786,"15min":1.8500000000000001},"last":0.79600000000000004},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.67900000000000005,"5min":0.61199999999999999,"15min":0.58799999999999997},"max":{"1min":1.3080000000000001,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.95299999999999996}]},{"osd":7,"last update":"Sat Jun 10 19:03:47 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.0900000000000001,"15min":1.1020000000000001},"min":{"1min":0.622,"5min":0.57999999999999996,"15min":0.56999999999999995},"max":{"1min":1.452,"5min":2.1150000000000002,"15min":2.1150000000000002},"last":0.90200000000000002},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.105,"15min":1.0940000000000001},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.61099999999999999},"max":{"1min":1.4630000000000001,"5min":1.9850000000000001,"15min":1.9850000000000001},"last":0.77000000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574987,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32380,"kb_used_data":1332,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339460,"statfs":{"total":96636764160,"available":96603607040,"internally_reserved":0,"allocated":1363968,"data_stored":627134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:02:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.627,"15min":0.60799999999999998},"min":{"1min":0.35199999999999998,"5min":0.31,"15min":0.27300000000000002},"max":{"1min":0.88200000000000001,"5min":1.095,"15min":1.1220000000000001},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.73699999999999999,"15min":0.72199999999999998},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.163,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.46700000000000003}]},{"osd":1,"last update":"Sat Jun 10 19:02:52 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.67400000000000004,"15min":0.66400000000000003},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.94799999999999995,"5min":0.98299999999999998,"15min":1.1950000000000001},"last":0.502},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.79500000000000004,"15min":0.74099999999999999},"min":{"1min":0.41999999999999998,"5min":0.36699999999999999,"15min":0.29499999999999998},"max":{"1min":1.2310000000000001,"5min":1.446,"15min":1.446},"last":0.56000000000000005}]},{"osd":3,"last update":"Sat Jun 10 19:02:52 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.80300000000000005,"15min":0.754},"min":{"1min":0.35599999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.133,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.80300000000000005,"15min":0.77300000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":1.181,"5min":1.181,"15min":1.3340000000000001},"last":0.60899999999999999}]},{"osd":4,"last update":"Sat Jun 10 19:02:52 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.94199999999999995,"15min":0.92600000000000005},"min":{"1min":0.68000000000000005,"5min":0.624,"15min":0.53400000000000003},"max":{"1min":1.258,"5min":1.258,"15min":1.3620000000000001},"last":0.90200000000000002},{"interface":"front","average":{"1min":1.044,"5min":1.0229999999999999,"15min":1.0269999999999999},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.57699999999999996},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.63500000000000001}]},{"osd":5,"last update":"Sat Jun 10 19:02:52 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.0209999999999999,"15min":1.0169999999999999},"min":{"1min":0.63300000000000001,"5min":0.61199999999999999,"15min":0.54100000000000004},"max":{"1min":1.337,"5min":1.5429999999999999,"15min":1.5700000000000001},"last":0.84199999999999997},{"interface":"front","average":{"1min":1.052,"5min":1.02,"15min":1.0069999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.667},"last":0.67200000000000004}]},{"osd":6,"last update":"Sat Jun 10 19:02:52 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.0369999999999999,"15min":1.0429999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.391,"5min":1.4259999999999999,"15min":1.5900000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0600000000000001,"15min":1.046},"min":{"1min":0.624,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.486,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.86199999999999999}]},{"osd":7,"last update":"Sat Jun 10 19:02:52 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.117,"15min":1.103},"min":{"1min":0.64400000000000002,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.734,"5min":1.734,"15min":1.734},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.21,"5min":1.125,"15min":1.107},"min":{"1min":0.64700000000000002,"5min":0.64100000000000001,"15min":0.59299999999999997},"max":{"1min":1.657,"5min":1.657,"15min":1.752},"last":0.78700000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574989,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32376,"kb_used_data":1328,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339464,"statfs":{"total":96636764160,"available":96603611136,"internally_reserved":0,"allocated":1359872,"data_stored":626115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:02:54 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.68999999999999995,"15min":0.67600000000000005},"min":{"1min":0.32100000000000001,"5min":0.28599999999999998,"15min":0.25800000000000001},"max":{"1min":1.026,"5min":1.119,"15min":1.288},"last":0.497},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.76800000000000002,"15min":0.72699999999999998},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.694},"last":0.42699999999999999}]},{"osd":2,"last update":"Sat Jun 10 19:02:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.64000000000000001,"15min":0.63100000000000001},"min":{"1min":0.33100000000000002,"5min":0.308,"15min":0.249},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.21},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.629,"5min":0.74199999999999999,"15min":0.70199999999999996},"min":{"1min":0.32800000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.0629999999999999,"5min":1.194,"15min":1.415},"last":0.38400000000000001}]},{"osd":3,"last update":"Sat Jun 10 19:02:54 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.78600000000000003,"15min":0.77100000000000002},"min":{"1min":0.40200000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.0529999999999999,"5min":1.3049999999999999,"15min":1.6299999999999999},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.73999999999999999,"15min":0.74399999999999999},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.0409999999999999,"5min":1.2909999999999999,"15min":2.1749999999999998},"last":0.47599999999999998}]},{"osd":4,"last update":"Sat Jun 10 19:02:54 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.86599999999999999,"15min":0.85399999999999998},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.53000000000000003},"max":{"1min":1.2070000000000001,"5min":1.343,"15min":1.4930000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.99199999999999999,"15min":1.048},"min":{"1min":0.47299999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.492,"5min":1.5129999999999999,"15min":5.8209999999999997},"last":0.877}]},{"osd":5,"last update":"Sat Jun 10 19:02:54 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.99099999999999999,"15min":1.0089999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.2709999999999999,"5min":1.6299999999999999,"15min":1.8620000000000001},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.97499999999999998,"15min":0.97799999999999998},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":3.089},"last":0.80900000000000005}]},{"osd":6,"last update":"Sat Jun 10 19:02:54 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":1.038,"15min":1.05},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.3640000000000001,"5min":1.6759999999999999,"15min":7.2599999999999998},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.93200000000000005,"5min":1.022,"15min":1.038},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":9.0069999999999997},"last":0.70399999999999996}]},{"osd":7,"last update":"Sat Jun 10 19:02:54 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":1.0800000000000001,"15min":1.085},"min":{"1min":0.58799999999999997,"5min":0.495,"15min":0.495},"max":{"1min":1.431,"5min":1.573,"15min":2.105},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.96699999999999997,"5min":1.087,"15min":1.081},"min":{"1min":0.60199999999999998,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.454,"5min":1.5620000000000001,"15min":2.2570000000000001},"last":0.67800000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574988,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32968,"kb_used_data":1920,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338872,"statfs":{"total":96636764160,"available":96603004928,"internally_reserved":0,"allocated":1966080,"data_stored":1218103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jun 10 19:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.65900000000000003,"15min":0.63},"min":{"1min":0.46300000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.98499999999999999,"5min":1.077,"15min":1.0780000000000001},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.82899999999999996,"15min":0.78800000000000003},"min":{"1min":0.49299999999999999,"5min":0.36299999999999999,"15min":0.34000000000000002},"max":{"1min":1.0309999999999999,"5min":1.2230000000000001,"15min":1.4059999999999999},"last":0.376}]},{"osd":2,"last update":"Sat Jun 10 19:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.73299999999999998,"15min":0.71299999999999997},"min":{"1min":0.51100000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2829999999999999},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.67300000000000004,"15min":0.64800000000000002},"min":{"1min":0.46899999999999997,"5min":0.27600000000000002,"15min":0.245},"max":{"1min":0.83499999999999996,"5min":1.139,"15min":1.371},"last":0.41199999999999998}]},{"osd":3,"last update":"Sat Jun 10 19:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.38900000000000001,"5min":0.29499999999999998,"15min":0.28899999999999998},"max":{"1min":0.875,"5min":1.0860000000000001,"15min":1.226},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.871,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.42999999999999999,"5min":0.317,"15min":0.317},"max":{"1min":1.742,"5min":1.742,"15min":1.829},"last":0.48599999999999999}]},{"osd":4,"last update":"Sat Jun 10 19:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.92900000000000005,"15min":0.91600000000000004},"min":{"1min":0.72199999999999998,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.224,"5min":1.224,"15min":3.0209999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.0409999999999999,"15min":1.032},"min":{"1min":0.65300000000000002,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.8520000000000001,"5min":1.8520000000000001,"15min":1.9510000000000001},"last":0.61699999999999999}]},{"osd":5,"last update":"Sat Jun 10 19:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.93999999999999995,"15min":0.94599999999999995},"min":{"1min":0.67300000000000004,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.694},"last":0.67500000000000004},{"interface":"front","average":{"1min":1.044,"5min":1.012,"15min":1.0129999999999999},"min":{"1min":0.65200000000000002,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.78,"5min":1.78,"15min":4.5620000000000003},"last":0.83399999999999996}]},{"osd":6,"last update":"Sat Jun 10 19:02:53 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.0800000000000001,"15min":1.0760000000000001},"min":{"1min":0.73899999999999999,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.5700000000000001,"5min":1.5980000000000001,"15min":3.5569999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.97499999999999998,"5min":1.004,"15min":1.0029999999999999},"min":{"1min":0.69699999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.883},"last":0.84999999999999998}]},{"osd":7,"last update":"Sat Jun 10 19:02:53 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.036,"15min":1.036},"min":{"1min":0.69199999999999995,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.512,"5min":1.512,"15min":1.5800000000000001},"last":0.88400000000000001},{"interface":"front","average":{"1min":1.109,"5min":1.077,"15min":1.0609999999999999},"min":{"1min":0.78900000000000003,"5min":0.624,"15min":0.58699999999999997},"max":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.9830000000000001},"last":0.72499999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-10T19:03:56.406 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-06-10T19:03:56.407 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-06-10T19:03:56.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.565+0000 7f38c7d16640 1 Processor -- start 2023-06-10T19:03:56.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.565+0000 7f38c7d16640 1 -- start start 2023-06-10T19:03:56.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.565+0000 7f38c7d16640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f38c01582f0 0x7f38c00af810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:56.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.565+0000 7f38c7d16640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38c00b0170 con 0x7f38c00afd50 2023-06-10T19:03:56.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.565+0000 7f38c7d16640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38c01592b0 con 0x7f38c0158ee0 2023-06-10T19:03:56.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.565+0000 7f38c7d16640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38c0155da0 con 0x7f38c01582f0 2023-06-10T19:03:56.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.565+0000 7f38c62b3640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f38c00afd50 0x7f38c015bb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:59500/0 (socket says 172.21.15.53:59500) 2023-06-10T19:03:56.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.565+0000 7f38c62b3640 1 -- 172.21.15.53:0/346547138 learned_addr learned my addr 172.21.15.53:0/346547138 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:03:56.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.569+0000 7f38c52b1640 1 --2- 172.21.15.53:0/346547138 >> v2:172.21.15.117:3300/0 conn(0x7f38c01582f0 0x7f38c00af810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:56.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.569+0000 7f38c4ab0640 1 -- 172.21.15.53:0/346547138 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3258517551 0 0) 0x7f38c00b0170 con 0x7f38c00afd50 2023-06-10T19:03:56.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.569+0000 7f38c4ab0640 1 -- 172.21.15.53:0/346547138 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38ac003530 con 0x7f38c00afd50 2023-06-10T19:03:56.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.569+0000 7f38c4ab0640 1 -- 172.21.15.53:0/346547138 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1672570196 0 0) 0x7f38ac003530 con 0x7f38c00afd50 2023-06-10T19:03:56.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.569+0000 7f38c4ab0640 1 -- 172.21.15.53:0/346547138 >> v2:172.21.15.117:3300/0 conn(0x7f38c01582f0 msgr2=0x7f38c00af810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:56.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.569+0000 7f38c4ab0640 1 --2- 172.21.15.53:0/346547138 >> v2:172.21.15.117:3300/0 conn(0x7f38c01582f0 0x7f38c00af810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:56.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.569+0000 7f38c4ab0640 1 -- 172.21.15.53:0/346547138 >> v1:172.21.15.117:6789/0 conn(0x7f38c0158ee0 legacy=0x7f38c00c83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:56.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.569+0000 7f38c4ab0640 1 -- 172.21.15.53:0/346547138 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38c0158740 con 0x7f38c00afd50 2023-06-10T19:03:56.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.569+0000 7f38c4ab0640 1 -- 172.21.15.53:0/346547138 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f38b8001680 con 0x7f38c00afd50 2023-06-10T19:03:56.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.569+0000 7f38c4ab0640 1 -- 172.21.15.53:0/346547138 >> v1:172.21.15.53:6789/0 conn(0x7f38c00afd50 legacy=0x7f38c015bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:56.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.569+0000 7f38c4ab0640 1 --2- 172.21.15.53:0/346547138 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38ac003980 0x7f38ac003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:56.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.569+0000 7f38c4ab0640 1 --2- 172.21.15.53:0/346547138 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38ac0047d0 0x7f38ac004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:56.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.569+0000 7f38c4ab0640 1 --2- 172.21.15.53:0/346547138 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38ac005180 0x7f38ac00caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:56.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.569+0000 7f38c4ab0640 1 -- 172.21.15.53:0/346547138 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c0155da0 con 0x7f38ac0047d0 2023-06-10T19:03:56.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.569+0000 7f38c4ab0640 1 -- 172.21.15.53:0/346547138 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38ac005b70 con 0x7f38ac005180 2023-06-10T19:03:56.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.569+0000 7f38c4ab0640 1 -- 172.21.15.53:0/346547138 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38ac005ce0 con 0x7f38ac003980 2023-06-10T19:03:56.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.569+0000 7f38c52b1640 1 --2- 172.21.15.53:0/346547138 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38ac0047d0 0x7f38ac004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:56.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.569+0000 7f38c5ab2640 1 --2- 172.21.15.53:0/346547138 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38ac003980 0x7f38ac003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:56.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.569+0000 7f38c62b3640 1 --2- 172.21.15.53:0/346547138 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38ac005180 0x7f38ac00caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:56.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.569+0000 7f38c52b1640 1 -- 172.21.15.53:0/346547138 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38ac003980 msgr2=0x7f38ac003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:56.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.569+0000 7f38c52b1640 1 --2- 172.21.15.53:0/346547138 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38ac003980 0x7f38ac003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:56.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.569+0000 7f38c52b1640 1 -- 172.21.15.53:0/346547138 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38ac005180 msgr2=0x7f38ac00caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:56.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.569+0000 7f38c52b1640 1 --2- 172.21.15.53:0/346547138 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38ac005180 0x7f38ac00caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:56.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.569+0000 7f38c52b1640 1 -- 172.21.15.53:0/346547138 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38ac003530 con 0x7f38ac0047d0 2023-06-10T19:03:56.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.569+0000 7f38c62b3640 1 -- 172.21.15.53:0/346547138 reap_dead start 2023-06-10T19:03:56.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.569+0000 7f38c52b1640 1 --2- 172.21.15.53:0/346547138 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38ac0047d0 0x7f38ac004c40 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7f38b0009ae0 tx=0x7f38b001ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce8f0b8f68472a59 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:56.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.569+0000 7f38c4ab0640 1 -- 172.21.15.53:0/346547138 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b00a6460 con 0x7f38ac0047d0 2023-06-10T19:03:56.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.569+0000 7f38c4ab0640 1 -- 172.21.15.53:0/346547138 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38b00a65c0 con 0x7f38ac0047d0 2023-06-10T19:03:56.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.569+0000 7f38c4ab0640 1 -- 172.21.15.53:0/346547138 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b00a6970 con 0x7f38ac0047d0 2023-06-10T19:03:56.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.569+0000 7f38c7d16640 1 -- 172.21.15.53:0/346547138 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38ac0047d0 msgr2=0x7f38ac004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:56.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.569+0000 7f38c7d16640 1 --2- 172.21.15.53:0/346547138 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38ac0047d0 0x7f38ac004c40 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7f38b0009ae0 tx=0x7f38b001ca20 comp rx=0 tx=0).stop 2023-06-10T19:03:56.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.569+0000 7f38c7d16640 1 -- 172.21.15.53:0/346547138 shutdown_connections 2023-06-10T19:03:56.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.569+0000 7f38c7d16640 1 --2- 172.21.15.53:0/346547138 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38ac0047d0 0x7f38ac004c40 unknown :-1 s=CLOSED pgs=1739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:56.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.569+0000 7f38c7d16640 1 -- 172.21.15.53:0/346547138 >> 172.21.15.53:0/346547138 conn(0x7f38c006a0e0 msgr2=0x7f38c00ca810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:56.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.569+0000 7f38c7d16640 1 -- 172.21.15.53:0/346547138 shutdown_connections 2023-06-10T19:03:56.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.569+0000 7f38c7d16640 1 -- 172.21.15.53:0/346547138 wait complete. 2023-06-10T19:03:56.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.573+0000 7f38c7d16640 1 Processor -- start 2023-06-10T19:03:56.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.573+0000 7f38c7d16640 1 -- start start 2023-06-10T19:03:56.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.573+0000 7f38c7d16640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38ac0047d0 0x7f38c014c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:56.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.573+0000 7f38c7d16640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38c00aea10 0x7f38c00aee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:56.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.573+0000 7f38c7d16640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38c01f4a40 0x7f38c01f4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:56.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.573+0000 7f38c7d16640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c01509f0 con 0x7f38c01f4a40 2023-06-10T19:03:56.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.573+0000 7f38c7d16640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c014c610 con 0x7f38c00aea10 2023-06-10T19:03:56.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.573+0000 7f38c7d16640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38c00af3c0 con 0x7f38ac0047d0 2023-06-10T19:03:56.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.573+0000 7f38c62b3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38c01f4a40 0x7f38c01f4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:56.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.573+0000 7f38c5ab2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38ac0047d0 0x7f38c014c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:56.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.573+0000 7f38c52b1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38c00aea10 0x7f38c00aee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:56.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.573+0000 7f38c62b3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38c01f4a40 0x7f38c01f4eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35076/0 (socket says 172.21.15.53:35076) 2023-06-10T19:03:56.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.573+0000 7f38c62b3640 1 -- 172.21.15.53:0/88878891 learned_addr learned my addr 172.21.15.53:0/88878891 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:56.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.573+0000 7f38c62b3640 1 -- 172.21.15.53:0/88878891 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38ac0047d0 msgr2=0x7f38c014c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:56.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.573+0000 7f38c62b3640 1 --2- 172.21.15.53:0/88878891 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38ac0047d0 0x7f38c014c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:56.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.573+0000 7f38c62b3640 1 -- 172.21.15.53:0/88878891 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38c00aea10 msgr2=0x7f38c00aee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:56.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.573+0000 7f38c62b3640 1 --2- 172.21.15.53:0/88878891 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38c00aea10 0x7f38c00aee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:56.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.573+0000 7f38c62b3640 1 -- 172.21.15.53:0/88878891 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38c01f57a0 con 0x7f38c01f4a40 2023-06-10T19:03:56.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.573+0000 7f38c62b3640 1 --2- 172.21.15.53:0/88878891 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38c01f4a40 0x7f38c01f4eb0 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7f38c00c8370 tx=0x7f38b800e7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:56.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.573+0000 7f38b67fc640 1 -- 172.21.15.53:0/88878891 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b800ec00 con 0x7f38c01f4a40 2023-06-10T19:03:56.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.573+0000 7f38b67fc640 1 -- 172.21.15.53:0/88878891 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38b800ed60 con 0x7f38c01f4a40 2023-06-10T19:03:56.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.573+0000 7f38c7d16640 1 -- 172.21.15.53:0/88878891 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38c0150050 con 0x7f38c01f4a40 2023-06-10T19:03:56.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.573+0000 7f38b67fc640 1 -- 172.21.15.53:0/88878891 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b8014670 con 0x7f38c01f4a40 2023-06-10T19:03:56.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.573+0000 7f38c7d16640 1 -- 172.21.15.53:0/88878891 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38c0150610 con 0x7f38c01f4a40 2023-06-10T19:03:56.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.573+0000 7f38c7d16640 1 -- 172.21.15.53:0/88878891 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38c0158160 con 0x7f38c01f4a40 2023-06-10T19:03:56.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.577+0000 7f38b67fc640 1 -- 172.21.15.53:0/88878891 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f38b80147d0 con 0x7f38c01f4a40 2023-06-10T19:03:56.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.577+0000 7f38b67fc640 1 --2- 172.21.15.53:0/88878891 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f38a4066280 0x7f38a4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:56.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.577+0000 7f38b67fc640 1 -- 172.21.15.53:0/88878891 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f38b8082a70 con 0x7f38c01f4a40 2023-06-10T19:03:56.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.577+0000 7f38c5ab2640 1 --2- 172.21.15.53:0/88878891 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f38a4066280 0x7f38a4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:56.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.577+0000 7f38c5ab2640 1 --2- 172.21.15.53:0/88878891 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f38a4066280 0x7f38a4068730 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f38c00ad810 tx=0x7f38bc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:56.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.581+0000 7f38b67fc640 1 -- 172.21.15.53:0/88878891 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f38b804ffa0 con 0x7f38c01f4a40 2023-06-10T19:03:56.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.789+0000 7f38c7d16640 1 -- 172.21.15.53:0/88878891 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f38c006aff0 con 0x7f38c01f4a40 2023-06-10T19:03:56.799 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.793+0000 7f38b67fc640 1 -- 172.21.15.53:0/88878891 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) v1 ==== 190+0+0 (secure 0 0 0) 0x7f38c006aff0 con 0x7f38c01f4a40 2023-06-10T19:03:56.799 INFO:teuthology.orchestra.run.smithi053.stderr:updated caps for client.0 2023-06-10T19:03:56.801 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.797+0000 7f38c7d16640 1 -- 172.21.15.53:0/88878891 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f38a4066280 msgr2=0x7f38a4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:56.802 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.797+0000 7f38c7d16640 1 --2- 172.21.15.53:0/88878891 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f38a4066280 0x7f38a4068730 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f38c00ad810 tx=0x7f38bc009040 comp rx=0 tx=0).stop 2023-06-10T19:03:56.802 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.797+0000 7f38c7d16640 1 -- 172.21.15.53:0/88878891 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38c01f4a40 msgr2=0x7f38c01f4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:56.802 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.797+0000 7f38c7d16640 1 --2- 172.21.15.53:0/88878891 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38c01f4a40 0x7f38c01f4eb0 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7f38c00c8370 tx=0x7f38b800e7c0 comp rx=0 tx=0).stop 2023-06-10T19:03:56.802 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.797+0000 7f38c7d16640 1 -- 172.21.15.53:0/88878891 shutdown_connections 2023-06-10T19:03:56.802 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.797+0000 7f38c7d16640 1 --2- 172.21.15.53:0/88878891 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f38a4066280 0x7f38a4068730 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:56.802 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.797+0000 7f38c7d16640 1 --2- 172.21.15.53:0/88878891 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38c01f4a40 0x7f38c01f4eb0 unknown :-1 s=CLOSED pgs=1740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:56.802 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.797+0000 7f38c7d16640 1 --2- 172.21.15.53:0/88878891 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38c00aea10 0x7f38c00aee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:56.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.797+0000 7f38c7d16640 1 --2- 172.21.15.53:0/88878891 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38ac0047d0 0x7f38c014c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:56.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.797+0000 7f38c7d16640 1 -- 172.21.15.53:0/88878891 >> 172.21.15.53:0/88878891 conn(0x7f38c006a0e0 msgr2=0x7f38c00cd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:56.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.797+0000 7f38c7d16640 1 -- 172.21.15.53:0/88878891 shutdown_connections 2023-06-10T19:03:56.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.797+0000 7f38c7d16640 1 -- 172.21.15.53:0/88878891 wait complete. 2023-06-10T19:03:56.818 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:03:56.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.933+0000 7ff90f001640 1 Processor -- start 2023-06-10T19:03:56.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.933+0000 7ff90f001640 1 -- start start 2023-06-10T19:03:56.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.937+0000 7ff90f001640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9080afe30 0x7ff90806efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:56.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.937+0000 7ff90f001640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff90806bb30 0x7ff9080ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:56.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.937+0000 7ff90f001640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9080c9e50 con 0x7ff908157e10 2023-06-10T19:03:56.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.937+0000 7ff90f001640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9080cd520 con 0x7ff90806bb30 2023-06-10T19:03:56.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.937+0000 7ff90f001640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff90806bf70 con 0x7ff9080afe30 2023-06-10T19:03:56.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.937+0000 7ff90d59e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff90806bb30 0x7ff9080ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:56.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.937+0000 7ff90d59e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff90806bb30 0x7ff9080ccfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35082/0 (socket says 172.21.15.53:35082) 2023-06-10T19:03:56.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.937+0000 7ff90d59e640 1 -- 172.21.15.53:0/896916998 learned_addr learned my addr 172.21.15.53:0/896916998 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:56.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.937+0000 7ff907fff640 1 --2- 172.21.15.53:0/896916998 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9080afe30 0x7ff90806efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:56.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.937+0000 7ff90d59e640 1 -- 172.21.15.53:0/896916998 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9080afe30 msgr2=0x7ff90806efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:56.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.937+0000 7ff90d59e640 1 --2- 172.21.15.53:0/896916998 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9080afe30 0x7ff90806efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:56.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.937+0000 7ff90d59e640 1 -- 172.21.15.53:0/896916998 >> v1:172.21.15.117:6789/0 conn(0x7ff908157e10 legacy=0x7ff9080af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:56.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.937+0000 7ff90d59e640 1 -- 172.21.15.53:0/896916998 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9080c82f0 con 0x7ff90806bb30 2023-06-10T19:03:56.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.937+0000 7ff907fff640 1 --2- 172.21.15.53:0/896916998 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9080afe30 0x7ff90806efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:03:56.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.937+0000 7ff90d59e640 1 --2- 172.21.15.53:0/896916998 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff90806bb30 0x7ff9080ccfe0 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7ff900009e50 tx=0x7ff90001c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65f948768a254699 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:56.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.937+0000 7ff9077fe640 1 -- 172.21.15.53:0/896916998 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9000a5810 con 0x7ff90806bb30 2023-06-10T19:03:56.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.937+0000 7ff9077fe640 1 -- 172.21.15.53:0/896916998 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9000a5970 con 0x7ff90806bb30 2023-06-10T19:03:56.944 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.937+0000 7ff9077fe640 1 -- 172.21.15.53:0/896916998 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9000a5d00 con 0x7ff90806bb30 2023-06-10T19:03:56.944 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.941+0000 7ff90f001640 1 -- 172.21.15.53:0/896916998 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff90806bb30 msgr2=0x7ff9080ccfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:56.944 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.941+0000 7ff90f001640 1 --2- 172.21.15.53:0/896916998 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff90806bb30 0x7ff9080ccfe0 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7ff900009e50 tx=0x7ff90001c950 comp rx=0 tx=0).stop 2023-06-10T19:03:56.944 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.941+0000 7ff90f001640 1 -- 172.21.15.53:0/896916998 shutdown_connections 2023-06-10T19:03:56.944 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.941+0000 7ff90f001640 1 --2- 172.21.15.53:0/896916998 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff90806bb30 0x7ff9080ccfe0 unknown :-1 s=CLOSED pgs=1741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:56.944 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.941+0000 7ff90f001640 1 --2- 172.21.15.53:0/896916998 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9080afe30 0x7ff90806efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:56.944 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.941+0000 7ff90f001640 1 -- 172.21.15.53:0/896916998 >> 172.21.15.53:0/896916998 conn(0x7ff90806a0d0 msgr2=0x7ff9080ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:56.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.941+0000 7ff90f001640 1 -- 172.21.15.53:0/896916998 shutdown_connections 2023-06-10T19:03:56.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.941+0000 7ff90f001640 1 -- 172.21.15.53:0/896916998 wait complete. 2023-06-10T19:03:56.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.941+0000 7ff90f001640 1 Processor -- start 2023-06-10T19:03:56.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.941+0000 7ff90f001640 1 -- start start 2023-06-10T19:03:56.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.941+0000 7ff90f001640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff90806bb30 0x7ff9080c5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:56.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.941+0000 7ff90f001640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9080afe30 0x7ff9080c76b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:56.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.941+0000 7ff90f001640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff908157e10 0x7ff9081502e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:56.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.941+0000 7ff90f001640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9080c70e0 con 0x7ff90806bb30 2023-06-10T19:03:56.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.941+0000 7ff90f001640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9080c64d0 con 0x7ff9080afe30 2023-06-10T19:03:56.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.941+0000 7ff90f001640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9080c67b0 con 0x7ff908157e10 2023-06-10T19:03:56.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.941+0000 7ff90cd9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff90806bb30 0x7ff9080c5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:56.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.941+0000 7ff90cd9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff90806bb30 0x7ff9080c5ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35086/0 (socket says 172.21.15.53:35086) 2023-06-10T19:03:56.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.941+0000 7ff90cd9d640 1 -- 172.21.15.53:0/687385958 learned_addr learned my addr 172.21.15.53:0/687385958 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:56.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.941+0000 7ff90d59e640 1 --2- 172.21.15.53:0/687385958 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff908157e10 0x7ff9081502e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:56.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.941+0000 7ff907fff640 1 --2- 172.21.15.53:0/687385958 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9080afe30 0x7ff9080c76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:56.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.941+0000 7ff90cd9d640 1 -- 172.21.15.53:0/687385958 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff908157e10 msgr2=0x7ff9081502e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:56.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.941+0000 7ff90cd9d640 1 --2- 172.21.15.53:0/687385958 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff908157e10 0x7ff9081502e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:56.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.941+0000 7ff90cd9d640 1 -- 172.21.15.53:0/687385958 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9080afe30 msgr2=0x7ff9080c76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:56.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.941+0000 7ff90cd9d640 1 --2- 172.21.15.53:0/687385958 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9080afe30 0x7ff9080c76b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:56.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.941+0000 7ff90cd9d640 1 -- 172.21.15.53:0/687385958 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff900009b30 con 0x7ff90806bb30 2023-06-10T19:03:56.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.941+0000 7ff90cd9d640 1 --2- 172.21.15.53:0/687385958 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff90806bb30 0x7ff9080c5ef0 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7ff8f800c500 tx=0x7ff8f800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:56.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.941+0000 7ff9057fa640 1 -- 172.21.15.53:0/687385958 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f8005220 con 0x7ff90806bb30 2023-06-10T19:03:56.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.941+0000 7ff9057fa640 1 -- 172.21.15.53:0/687385958 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8f8005380 con 0x7ff90806bb30 2023-06-10T19:03:56.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.941+0000 7ff90f001640 1 -- 172.21.15.53:0/687385958 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9080c6a90 con 0x7ff90806bb30 2023-06-10T19:03:56.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.941+0000 7ff9057fa640 1 -- 172.21.15.53:0/687385958 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f8007270 con 0x7ff90806bb30 2023-06-10T19:03:56.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.941+0000 7ff90f001640 1 -- 172.21.15.53:0/687385958 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9080c7bf0 con 0x7ff90806bb30 2023-06-10T19:03:56.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.945+0000 7ff90f001640 1 -- 172.21.15.53:0/687385958 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff90804d790 con 0x7ff90806bb30 2023-06-10T19:03:56.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.945+0000 7ff9057fa640 1 -- 172.21.15.53:0/687385958 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff8f80073d0 con 0x7ff90806bb30 2023-06-10T19:03:56.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.945+0000 7ff9057fa640 1 --2- 172.21.15.53:0/687385958 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff8f4066280 0x7ff8f4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:56.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.945+0000 7ff9057fa640 1 -- 172.21.15.53:0/687385958 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff8f8083500 con 0x7ff90806bb30 2023-06-10T19:03:56.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.945+0000 7ff907fff640 1 --2- 172.21.15.53:0/687385958 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff8f4066280 0x7ff8f4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:56.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.945+0000 7ff907fff640 1 --2- 172.21.15.53:0/687385958 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff8f4066280 0x7ff8f4068730 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7ff9080cd070 tx=0x7ff8fc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:56.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:56.949+0000 7ff9057fa640 1 -- 172.21.15.53:0/687385958 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff8f8050a40 con 0x7ff90806bb30 2023-06-10T19:03:57.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.129+0000 7ff90f001640 1 -- 172.21.15.53:0/687385958 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff908157740 con 0x7ff90806bb30 2023-06-10T19:03:57.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.133+0000 7ff9057fa640 1 -- 172.21.15.53:0/687385958 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) v1 ==== 94+0+4673 (secure 0 0 0) 0x7ff8f8054060 con 0x7ff90806bb30 2023-06-10T19:03:57.136 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:03:57.136 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":61,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6542,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/3258793373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3258793373},{"type":"v1","addr":"172.21.15.117:6836","nonce":3258793373}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":7363,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/585135979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":585135979},{"type":"v1","addr":"172.21.15.117:6837","nonce":585135979}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":8682,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/448704478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":448704478},{"type":"v1","addr":"172.21.15.53:6833","nonce":448704478}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:03:48.420425+0000","modified":"2023-06-10T19:03:50.457592+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8685},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8685":{"gid":8685,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/1149668719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":1149668719},{"type":"v1","addr":"172.21.15.53:6835","nonce":1149668719}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-06-10T19:03:57.136 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 61 2023-06-10T19:03:57.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.133+0000 7ff90f001640 1 -- 172.21.15.53:0/687385958 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff8f4066280 msgr2=0x7ff8f4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:57.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.133+0000 7ff90f001640 1 --2- 172.21.15.53:0/687385958 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff8f4066280 0x7ff8f4068730 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7ff9080cd070 tx=0x7ff8fc008040 comp rx=0 tx=0).stop 2023-06-10T19:03:57.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.133+0000 7ff90f001640 1 -- 172.21.15.53:0/687385958 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff90806bb30 msgr2=0x7ff9080c5ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:57.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.133+0000 7ff90f001640 1 --2- 172.21.15.53:0/687385958 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff90806bb30 0x7ff9080c5ef0 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7ff8f800c500 tx=0x7ff8f800c9c0 comp rx=0 tx=0).stop 2023-06-10T19:03:57.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.133+0000 7ff90f001640 1 -- 172.21.15.53:0/687385958 shutdown_connections 2023-06-10T19:03:57.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.133+0000 7ff90f001640 1 --2- 172.21.15.53:0/687385958 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff8f4066280 0x7ff8f4068730 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:57.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.133+0000 7ff90f001640 1 --2- 172.21.15.53:0/687385958 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff908157e10 0x7ff9081502e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:57.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.133+0000 7ff90f001640 1 --2- 172.21.15.53:0/687385958 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9080afe30 0x7ff9080c76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:57.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.133+0000 7ff90f001640 1 --2- 172.21.15.53:0/687385958 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff90806bb30 0x7ff9080c5ef0 unknown :-1 s=CLOSED pgs=1742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:57.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.133+0000 7ff90f001640 1 -- 172.21.15.53:0/687385958 >> 172.21.15.53:0/687385958 conn(0x7ff90806a0d0 msgr2=0x7ff9080cc560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:57.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.133+0000 7ff90f001640 1 -- 172.21.15.53:0/687385958 shutdown_connections 2023-06-10T19:03:57.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.133+0000 7ff90f001640 1 -- 172.21.15.53:0/687385958 wait complete. 2023-06-10T19:03:57.555 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 61, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-06-10T19:03:48.420425+0000', 'modified': '2023-06-10T19:03:50.457592+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8685}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8685': {'gid': 8685, 'name': 'a', 'rank': 0, 'incarnation': 59, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.53:6835/1149668719', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.53:6834', 'nonce': 1149668719}, {'type': 'v1', 'addr': '172.21.15.53:6835', 'nonce': 1149668719}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-06-10T19:03:57.556 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-06-10T19:03:57.556 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-06-10T19:03:57.693 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.689+0000 7fa267807640 1 Processor -- start 2023-06-10T19:03:57.693 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.689+0000 7fa267807640 1 -- start start 2023-06-10T19:03:57.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.689+0000 7fa267807640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa260152bb0 0x7fa2600c8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:57.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.689+0000 7fa267807640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa26015c210 0x7fa26015c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:57.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.689+0000 7fa267807640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa260158c20 0x7fa260159040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:57.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.689+0000 7fa267807640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2600c8850 con 0x7fa260158c20 2023-06-10T19:03:57.695 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.689+0000 7fa267807640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2600cc8f0 con 0x7fa260152bb0 2023-06-10T19:03:57.695 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.689+0000 7fa267807640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa26015cb80 con 0x7fa26015c210 2023-06-10T19:03:57.695 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.689+0000 7fa265da4640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa260158c20 0x7fa260159040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:57.695 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.689+0000 7fa265da4640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa260158c20 0x7fa260159040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35094/0 (socket says 172.21.15.53:35094) 2023-06-10T19:03:57.695 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.689+0000 7fa265da4640 1 -- 172.21.15.53:0/1277677988 learned_addr learned my addr 172.21.15.53:0/1277677988 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:57.695 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.689+0000 7fa2655a3640 1 --2- 172.21.15.53:0/1277677988 >> v2:172.21.15.117:3300/0 conn(0x7fa260152bb0 0x7fa2600c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:57.695 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.689+0000 7fa264da2640 1 --2- 172.21.15.53:0/1277677988 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa26015c210 0x7fa26015c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:57.696 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.689+0000 7fa265da4640 1 -- 172.21.15.53:0/1277677988 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa26015c210 msgr2=0x7fa26015c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:57.696 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.689+0000 7fa265da4640 1 --2- 172.21.15.53:0/1277677988 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa26015c210 0x7fa26015c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:57.696 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.689+0000 7fa265da4640 1 -- 172.21.15.53:0/1277677988 >> v2:172.21.15.117:3300/0 conn(0x7fa260152bb0 msgr2=0x7fa2600c8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:57.696 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.689+0000 7fa265da4640 1 --2- 172.21.15.53:0/1277677988 >> v2:172.21.15.117:3300/0 conn(0x7fa260152bb0 0x7fa2600c8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:57.696 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.689+0000 7fa265da4640 1 -- 172.21.15.53:0/1277677988 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2600c8b90 con 0x7fa260158c20 2023-06-10T19:03:57.696 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.689+0000 7fa264da2640 1 --2- 172.21.15.53:0/1277677988 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa26015c210 0x7fa26015c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:03:57.697 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.693+0000 7fa265da4640 1 --2- 172.21.15.53:0/1277677988 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa260158c20 0x7fa260159040 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7fa26006ee00 tx=0x7fa25801f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b297b785c2c7631e server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:57.697 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.693+0000 7fa257fff640 1 -- 172.21.15.53:0/1277677988 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2580af400 con 0x7fa260158c20 2023-06-10T19:03:57.697 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.693+0000 7fa257fff640 1 -- 172.21.15.53:0/1277677988 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2580ab050 con 0x7fa260158c20 2023-06-10T19:03:57.697 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.693+0000 7fa257fff640 1 -- 172.21.15.53:0/1277677988 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2580af780 con 0x7fa260158c20 2023-06-10T19:03:57.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.693+0000 7fa267807640 1 -- 172.21.15.53:0/1277677988 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa260158c20 msgr2=0x7fa260159040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:57.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.693+0000 7fa267807640 1 --2- 172.21.15.53:0/1277677988 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa260158c20 0x7fa260159040 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7fa26006ee00 tx=0x7fa25801f1c0 comp rx=0 tx=0).stop 2023-06-10T19:03:57.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.693+0000 7fa267807640 1 -- 172.21.15.53:0/1277677988 shutdown_connections 2023-06-10T19:03:57.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.693+0000 7fa267807640 1 --2- 172.21.15.53:0/1277677988 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa260158c20 0x7fa260159040 unknown :-1 s=CLOSED pgs=1743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:57.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.693+0000 7fa267807640 1 --2- 172.21.15.53:0/1277677988 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa26015c210 0x7fa26015c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:57.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.693+0000 7fa267807640 1 --2- 172.21.15.53:0/1277677988 >> v2:172.21.15.117:3300/0 conn(0x7fa260152bb0 0x7fa2600c8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:57.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.693+0000 7fa267807640 1 -- 172.21.15.53:0/1277677988 >> 172.21.15.53:0/1277677988 conn(0x7fa2600ce9e0 msgr2=0x7fa2600ca7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:57.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.693+0000 7fa267807640 1 -- 172.21.15.53:0/1277677988 shutdown_connections 2023-06-10T19:03:57.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.693+0000 7fa267807640 1 -- 172.21.15.53:0/1277677988 wait complete. 2023-06-10T19:03:57.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.693+0000 7fa267807640 1 Processor -- start 2023-06-10T19:03:57.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.693+0000 7fa267807640 1 -- start start 2023-06-10T19:03:57.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.697+0000 7fa267807640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa260152bb0 0x7fa2600c17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:57.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.697+0000 7fa267807640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa260158c20 0x7fa2600c3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:57.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.697+0000 7fa267807640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa26015c210 0x7fa2600c3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:57.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.697+0000 7fa267807640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2600c20f0 con 0x7fa260152bb0 2023-06-10T19:03:57.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.697+0000 7fa267807640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2600c23d0 con 0x7fa26015c210 2023-06-10T19:03:57.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.697+0000 7fa267807640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2600c26b0 con 0x7fa260158c20 2023-06-10T19:03:57.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.697+0000 7fa2655a3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa260152bb0 0x7fa2600c17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:57.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.697+0000 7fa2655a3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa260152bb0 0x7fa2600c17f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35098/0 (socket says 172.21.15.53:35098) 2023-06-10T19:03:57.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.697+0000 7fa2655a3640 1 -- 172.21.15.53:0/2733813598 learned_addr learned my addr 172.21.15.53:0/2733813598 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:57.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.697+0000 7fa264da2640 1 --2- 172.21.15.53:0/2733813598 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa260158c20 0x7fa2600c3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:57.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.697+0000 7fa2655a3640 1 -- 172.21.15.53:0/2733813598 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa260158c20 msgr2=0x7fa2600c3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:57.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.697+0000 7fa2655a3640 1 --2- 172.21.15.53:0/2733813598 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa260158c20 0x7fa2600c3870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:57.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.697+0000 7fa2655a3640 1 -- 172.21.15.53:0/2733813598 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa26015c210 msgr2=0x7fa2600c3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:57.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.697+0000 7fa2655a3640 1 --2- 172.21.15.53:0/2733813598 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa26015c210 0x7fa2600c3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:57.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.697+0000 7fa2655a3640 1 -- 172.21.15.53:0/2733813598 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa258009b30 con 0x7fa260152bb0 2023-06-10T19:03:57.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.697+0000 7fa2655a3640 1 --2- 172.21.15.53:0/2733813598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa260152bb0 0x7fa2600c17f0 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7fa25c00d800 tx=0x7fa25c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:57.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.697+0000 7fa255ffb640 1 -- 172.21.15.53:0/2733813598 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa25c0096a0 con 0x7fa260152bb0 2023-06-10T19:03:57.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.697+0000 7fa255ffb640 1 -- 172.21.15.53:0/2733813598 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa25c009800 con 0x7fa260152bb0 2023-06-10T19:03:57.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.697+0000 7fa255ffb640 1 -- 172.21.15.53:0/2733813598 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa25c009b70 con 0x7fa260152bb0 2023-06-10T19:03:57.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.697+0000 7fa267807640 1 -- 172.21.15.53:0/2733813598 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2600c2990 con 0x7fa260152bb0 2023-06-10T19:03:57.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.697+0000 7fa267807640 1 -- 172.21.15.53:0/2733813598 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2601506c0 con 0x7fa260152bb0 2023-06-10T19:03:57.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.697+0000 7fa255ffb640 1 -- 172.21.15.53:0/2733813598 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa25c009cd0 con 0x7fa260152bb0 2023-06-10T19:03:57.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.697+0000 7fa255ffb640 1 --2- 172.21.15.53:0/2733813598 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa244066280 0x7fa244068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:57.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.701+0000 7fa255ffb640 1 -- 172.21.15.53:0/2733813598 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa25c084400 con 0x7fa260152bb0 2023-06-10T19:03:57.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.701+0000 7fa264da2640 1 --2- 172.21.15.53:0/2733813598 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa244066280 0x7fa244068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:57.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.701+0000 7fa26a923000 1 Processor -- start 2023-06-10T19:03:57.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.701+0000 7fa26a923000 1 -- start start 2023-06-10T19:03:57.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.701+0000 7fa264da2640 1 --2- 172.21.15.53:0/2733813598 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa244066280 0x7fa244068730 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fa2600b3ca0 tx=0x7fa250008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:57.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.701+0000 7fa26a923000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e767090740 0x55e767090b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:57.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.701+0000 7fa26a923000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e767091050 0x55e767046840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:57.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.701+0000 7fa26a923000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e767046d80 0x55e767047150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:57.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.701+0000 7fa26a923000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e766f0eac0 con 0x55e767091050 2023-06-10T19:03:57.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.701+0000 7fa26a923000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e766e48840 con 0x55e767046d80 2023-06-10T19:03:57.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.701+0000 7fa26a923000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e766e9c2e0 con 0x55e767090740 2023-06-10T19:03:57.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.701+0000 7fa264da2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e767091050 0x55e767046840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:57.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.701+0000 7fa264da2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e767091050 0x55e767046840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35108/0 (socket says 172.21.15.53:35108) 2023-06-10T19:03:57.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.701+0000 7fa264da2640 1 -- 172.21.15.53:0/3657988098 learned_addr learned my addr 172.21.15.53:0/3657988098 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:57.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.701+0000 7fa2655a3640 1 --2- 172.21.15.53:0/3657988098 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e767090740 0x55e767090b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:57.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.701+0000 7fa265da4640 1 --2- 172.21.15.53:0/3657988098 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e767046d80 0x55e767047150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:57.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.701+0000 7fa264da2640 1 -- 172.21.15.53:0/3657988098 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e767090740 msgr2=0x55e767090b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:57.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.701+0000 7fa264da2640 1 --2- 172.21.15.53:0/3657988098 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e767090740 0x55e767090b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:57.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.701+0000 7fa264da2640 1 -- 172.21.15.53:0/3657988098 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e767046d80 msgr2=0x55e767047150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:57.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.701+0000 7fa264da2640 1 --2- 172.21.15.53:0/3657988098 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e767046d80 0x55e767047150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:57.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.701+0000 7fa264da2640 1 -- 172.21.15.53:0/3657988098 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e766b91890 con 0x55e767091050 2023-06-10T19:03:57.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.701+0000 7fa264da2640 1 --2- 172.21.15.53:0/3657988098 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e767091050 0x55e767046840 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7fa250009170 tx=0x7fa250011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64163ed2d0958f41 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:57.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.701+0000 7fa242ffd640 1 -- 172.21.15.53:0/3657988098 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa250015ea0 con 0x55e767091050 2023-06-10T19:03:57.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.701+0000 7fa242ffd640 1 -- 172.21.15.53:0/3657988098 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa25000e660 con 0x55e767091050 2023-06-10T19:03:57.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.701+0000 7fa242ffd640 1 -- 172.21.15.53:0/3657988098 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa25000e9d0 con 0x55e767091050 2023-06-10T19:03:57.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.701+0000 7fa26a923000 1 -- 172.21.15.53:0/3657988098 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e767091050 msgr2=0x55e767046840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:57.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.701+0000 7fa26a923000 1 --2- 172.21.15.53:0/3657988098 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e767091050 0x55e767046840 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7fa250009170 tx=0x7fa250011000 comp rx=0 tx=0).stop 2023-06-10T19:03:57.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.701+0000 7fa26a923000 1 -- 172.21.15.53:0/3657988098 shutdown_connections 2023-06-10T19:03:57.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.701+0000 7fa26a923000 1 --2- 172.21.15.53:0/3657988098 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e767046d80 0x55e767047150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:57.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.701+0000 7fa26a923000 1 --2- 172.21.15.53:0/3657988098 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e767091050 0x55e767046840 unknown :-1 s=CLOSED pgs=1745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:57.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.701+0000 7fa26a923000 1 --2- 172.21.15.53:0/3657988098 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e767090740 0x55e767090b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:57.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.701+0000 7fa26a923000 1 -- 172.21.15.53:0/3657988098 >> 172.21.15.53:0/3657988098 conn(0x55e76703e800 msgr2=0x55e76704d800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:57.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.701+0000 7fa26a923000 1 -- 172.21.15.53:0/3657988098 shutdown_connections 2023-06-10T19:03:57.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.701+0000 7fa26a923000 1 -- 172.21.15.53:0/3657988098 wait complete. 2023-06-10T19:03:57.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.701+0000 7fa26a923000 1 -- start start 2023-06-10T19:03:57.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.701+0000 7fa26a923000 1 Processor -- start 2023-06-10T19:03:57.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.705+0000 7fa26a923000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e767046d80 0x55e76704c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:57.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.705+0000 7fa26a923000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e767090740 0x55e76704c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:57.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.705+0000 7fa26a923000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e767091050 0x55e7670520e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:57.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.705+0000 7fa26a923000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e766e95380 con 0x55e767046d80 2023-06-10T19:03:57.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.705+0000 7fa26a923000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e766e51ae0 con 0x55e767091050 2023-06-10T19:03:57.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.705+0000 7fa26a923000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e766e51780 con 0x55e767090740 2023-06-10T19:03:57.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.705+0000 7fa26a923000 10 client.0 _ll_register_callbacks cb 0x55e767032e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-10T19:03:57.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.705+0000 7fa2655a3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e767046d80 0x55e76704c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:57.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.705+0000 7fa2655a3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e767046d80 0x55e76704c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35120/0 (socket says 172.21.15.53:35120) 2023-06-10T19:03:57.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.705+0000 7fa2655a3640 1 -- 172.21.15.53:0/2904397536 learned_addr learned my addr 172.21.15.53:0/2904397536 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:57.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.705+0000 7fa264da2640 1 --2- 172.21.15.53:0/2904397536 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e767090740 0x55e76704c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:57.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.705+0000 7fa265da4640 1 --2- 172.21.15.53:0/2904397536 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e767091050 0x55e7670520e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:57.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.705+0000 7fa2655a3640 1 -- 172.21.15.53:0/2904397536 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e767090740 msgr2=0x55e76704c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:57.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.705+0000 7fa2655a3640 1 --2- 172.21.15.53:0/2904397536 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e767090740 0x55e76704c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:57.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.705+0000 7fa2655a3640 1 -- 172.21.15.53:0/2904397536 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e767091050 msgr2=0x55e7670520e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:57.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.705+0000 7fa2655a3640 1 --2- 172.21.15.53:0/2904397536 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e767091050 0x55e7670520e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:57.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.705+0000 7fa2655a3640 1 -- 172.21.15.53:0/2904397536 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa250015460 con 0x55e767046d80 2023-06-10T19:03:57.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.705+0000 7fa2655a3640 1 --2- 172.21.15.53:0/2904397536 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e767046d80 0x55e76704c430 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7fa25c009490 tx=0x7fa25c059710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8117087f1a03c1ab server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:57.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.705+0000 7fa23bfff640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-06-10T19:03:57.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.705+0000 7fa23bfff640 1 -- 172.21.15.53:0/2904397536 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa25c0840b0 con 0x55e767046d80 2023-06-10T19:03:57.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.705+0000 7fa26a923000 1 -- 172.21.15.53:0/2904397536 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e766e5ca20 con 0x55e767046d80 2023-06-10T19:03:57.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.705+0000 7fa23bfff640 1 -- 172.21.15.53:0/2904397536 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(110..110 src has 1..110) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa25c084210 con 0x55e767046d80 2023-06-10T19:03:57.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.705+0000 7fa23bfff640 1 -- 172.21.15.53:0/2904397536 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa25c059150 con 0x55e767046d80 2023-06-10T19:03:57.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.705+0000 7fa26a923000 10 client.8865 fetch_fsmap learned FSMap version 61 2023-06-10T19:03:57.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.705+0000 7fa26a923000 1 -- 172.21.15.53:0/2904397536 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=2+}) v3 -- 0x55e766e59d10 con 0x55e767046d80 2023-06-10T19:03:57.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.705+0000 7fa23bfff640 1 -- 172.21.15.53:0/2904397536 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e766e5ca20 con 0x55e767046d80 2023-06-10T19:03:57.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.705+0000 7fa23bfff640 1 -- 172.21.15.53:0/2904397536 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 61) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fa25c011a20 con 0x55e767046d80 2023-06-10T19:03:57.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.705+0000 7fa26a923000 10 client.8865 fetch_fsmap finished waiting for FSMap version 61 2023-06-10T19:03:57.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.705+0000 7fa26a923000 10 client.8865 resolve_mds: resolved name 'a' to daemon mds.a 2023-06-10T19:03:57.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.705+0000 7fa26a923000 20 client.8865 populate_metadata read hostname 'smithi053' 2023-06-10T19:03:57.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.705+0000 7fa26a923000 1 --2- 172.21.15.53:0/2904397536 >> [v2:172.21.15.53:6834/1149668719,v1:172.21.15.53:6835/1149668719] conn(0x55e76709f7b0 0x55e7670a1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:57.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.705+0000 7fa26a923000 4 client.8865 mds_command: new command op to 8685 tid=0[{"prefix": "get_command_descriptions"}] 2023-06-10T19:03:57.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.705+0000 7fa26a923000 1 -- 172.21.15.53:0/2904397536 --> [v2:172.21.15.53:6834/1149668719,v1:172.21.15.53:6835/1149668719] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e766ec4710 con 0x55e76709f7b0 2023-06-10T19:03:57.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.705+0000 7fa264da2640 1 --2- 172.21.15.53:0/2904397536 >> [v2:172.21.15.53:6834/1149668719,v1:172.21.15.53:6835/1149668719] conn(0x55e76709f7b0 0x55e7670a1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:57.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.705+0000 7fa264da2640 1 --2- 172.21.15.53:0/2904397536 >> [v2:172.21.15.53:6834/1149668719,v1:172.21.15.53:6835/1149668719] conn(0x55e76709f7b0 0x55e7670a1b90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ef5ac9daa5b2e45 server_cookie=71efd8162ae97579 in_seq=0 out_seq=0 2023-06-10T19:03:57.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.705+0000 7fa23bfff640 10 client.8865 ms_handle_connect on v2:172.21.15.53:6834/1149668719 2023-06-10T19:03:57.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.705+0000 7fa23bfff640 1 -- 172.21.15.53:0/2904397536 <== mds.0 v2:172.21.15.53:6834/1149668719 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55e766ec4710 con 0x55e76709f7b0 2023-06-10T19:03:57.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.705+0000 7fa23bfff640 10 client.8865 handle_command_reply: tid=0 2023-06-10T19:03:57.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.705+0000 7fa26a923000 1 client.8865 shutdown 2023-06-10T19:03:57.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.705+0000 7fa26a923000 1 -- 172.21.15.53:0/2904397536 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e767046d80 msgr2=0x55e76704c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:57.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.705+0000 7fa26a923000 1 --2- 172.21.15.53:0/2904397536 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e767046d80 0x55e76704c430 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7fa25c009490 tx=0x7fa25c059710 comp rx=0 tx=0).stop 2023-06-10T19:03:57.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.705+0000 7fa26a923000 1 -- 172.21.15.53:0/2904397536 shutdown_connections 2023-06-10T19:03:57.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.705+0000 7fa26a923000 1 --2- 172.21.15.53:0/2904397536 >> [v2:172.21.15.53:6834/1149668719,v1:172.21.15.53:6835/1149668719] conn(0x55e76709f7b0 0x55e7670a1b90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:57.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.705+0000 7fa26a923000 1 --2- 172.21.15.53:0/2904397536 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e767091050 0x55e7670520e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:57.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.705+0000 7fa26a923000 1 --2- 172.21.15.53:0/2904397536 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e767090740 0x55e76704c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:57.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.705+0000 7fa23bfff640 0 client.8865 ms_handle_reset on v2:172.21.15.53:6834/1149668719 2023-06-10T19:03:57.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.705+0000 7fa26a923000 1 --2- 172.21.15.53:0/2904397536 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e767046d80 0x55e76704c430 unknown :-1 s=CLOSED pgs=1746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:57.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.705+0000 7fa26a923000 1 -- 172.21.15.53:0/2904397536 >> 172.21.15.53:0/2904397536 conn(0x55e76703e800 msgr2=0x55e767045830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:57.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.705+0000 7fa26a923000 1 -- 172.21.15.53:0/2904397536 shutdown_connections 2023-06-10T19:03:57.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.705+0000 7fa26a923000 1 -- 172.21.15.53:0/2904397536 wait complete. 2023-06-10T19:03:57.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.705+0000 7fa26a923000 20 client.8865 trim_cache size 0 max 16384 2023-06-10T19:03:57.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.721+0000 7fa26a923000 1 Processor -- start 2023-06-10T19:03:57.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.721+0000 7fa26a923000 1 -- start start 2023-06-10T19:03:57.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.721+0000 7fa26a923000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e767046d80 0x55e767046520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:57.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.721+0000 7fa26a923000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e767090740 0x55e767044fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:57.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.721+0000 7fa26a923000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e767091050 0x55e7670454e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:57.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.721+0000 7fa26a923000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e766b52940 con 0x55e767046d80 2023-06-10T19:03:57.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.721+0000 7fa26a923000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e766e8f680 con 0x55e767090740 2023-06-10T19:03:57.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.721+0000 7fa26a923000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e7670a41f0 con 0x55e767091050 2023-06-10T19:03:57.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.721+0000 7fa2655a3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e767046d80 0x55e767046520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:57.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.721+0000 7fa2655a3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e767046d80 0x55e767046520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35134/0 (socket says 172.21.15.53:35134) 2023-06-10T19:03:57.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.721+0000 7fa2655a3640 1 -- 172.21.15.53:0/1417515470 learned_addr learned my addr 172.21.15.53:0/1417515470 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:57.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.721+0000 7fa265da4640 1 --2- 172.21.15.53:0/1417515470 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e767091050 0x55e7670454e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:57.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.721+0000 7fa2655a3640 1 -- 172.21.15.53:0/1417515470 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e767091050 msgr2=0x55e7670454e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:57.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.721+0000 7fa2655a3640 1 --2- 172.21.15.53:0/1417515470 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e767091050 0x55e7670454e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:57.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.721+0000 7fa264da2640 1 --2- 172.21.15.53:0/1417515470 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e767090740 0x55e767044fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:57.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.721+0000 7fa2655a3640 1 -- 172.21.15.53:0/1417515470 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e767090740 msgr2=0x55e767044fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:57.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.721+0000 7fa2655a3640 1 --2- 172.21.15.53:0/1417515470 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e767090740 0x55e767044fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:57.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.725+0000 7fa2655a3640 1 -- 172.21.15.53:0/1417515470 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e766e3ffa0 con 0x55e767046d80 2023-06-10T19:03:57.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.725+0000 7fa2655a3640 1 --2- 172.21.15.53:0/1417515470 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e767046d80 0x55e767046520 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7fa25c055560 tx=0x7fa25c01f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c90ba87b14a96cd server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:57.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.725+0000 7fa2437fe640 1 -- 172.21.15.53:0/1417515470 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa25c055110 con 0x55e767046d80 2023-06-10T19:03:57.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.725+0000 7fa2437fe640 1 -- 172.21.15.53:0/1417515470 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa25c054f30 con 0x55e767046d80 2023-06-10T19:03:57.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.725+0000 7fa2437fe640 1 -- 172.21.15.53:0/1417515470 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa25c059150 con 0x55e767046d80 2023-06-10T19:03:57.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.725+0000 7fa26a923000 1 -- 172.21.15.53:0/1417515470 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e767046d80 msgr2=0x55e767046520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:57.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.725+0000 7fa26a923000 1 --2- 172.21.15.53:0/1417515470 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e767046d80 0x55e767046520 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7fa25c055560 tx=0x7fa25c01f000 comp rx=0 tx=0).stop 2023-06-10T19:03:57.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.725+0000 7fa26a923000 1 -- 172.21.15.53:0/1417515470 shutdown_connections 2023-06-10T19:03:57.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.725+0000 7fa26a923000 1 --2- 172.21.15.53:0/1417515470 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e767091050 0x55e7670454e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:57.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.725+0000 7fa26a923000 1 --2- 172.21.15.53:0/1417515470 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e767090740 0x55e767044fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:57.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.725+0000 7fa26a923000 1 --2- 172.21.15.53:0/1417515470 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e767046d80 0x55e767046520 unknown :-1 s=CLOSED pgs=1747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:57.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.725+0000 7fa26a923000 1 -- 172.21.15.53:0/1417515470 >> 172.21.15.53:0/1417515470 conn(0x55e76703e800 msgr2=0x55e76704c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:57.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.725+0000 7fa26a923000 1 -- 172.21.15.53:0/1417515470 shutdown_connections 2023-06-10T19:03:57.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.725+0000 7fa26a923000 1 -- 172.21.15.53:0/1417515470 wait complete. 2023-06-10T19:03:57.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.725+0000 7fa26a923000 1 -- start start 2023-06-10T19:03:57.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.725+0000 7fa26a923000 1 Processor -- start 2023-06-10T19:03:57.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.725+0000 7fa26a923000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e767046d80 0x55e7670ee040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:57.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.725+0000 7fa26a923000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e767090740 0x55e7670ee580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:57.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.725+0000 7fa26a923000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e767091050 0x55e7670a22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:57.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.725+0000 7fa26a923000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e766e9d570 con 0x55e767046d80 2023-06-10T19:03:57.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.725+0000 7fa26a923000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e766e61340 con 0x55e767090740 2023-06-10T19:03:57.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.725+0000 7fa26a923000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e766ed8ad0 con 0x55e767091050 2023-06-10T19:03:57.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.725+0000 7fa26a923000 10 client.0 _ll_register_callbacks cb 0x55e766e597f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-10T19:03:57.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.725+0000 7fa2655a3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e767046d80 0x55e7670ee040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:57.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.725+0000 7fa2655a3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e767046d80 0x55e7670ee040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35138/0 (socket says 172.21.15.53:35138) 2023-06-10T19:03:57.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.725+0000 7fa2655a3640 1 -- 172.21.15.53:0/3967088317 learned_addr learned my addr 172.21.15.53:0/3967088317 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:57.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.725+0000 7fa265da4640 1 --2- 172.21.15.53:0/3967088317 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e767091050 0x55e7670a22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:57.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.725+0000 7fa2655a3640 1 -- 172.21.15.53:0/3967088317 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e767091050 msgr2=0x55e7670a22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:57.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.725+0000 7fa264da2640 1 --2- 172.21.15.53:0/3967088317 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e767090740 0x55e7670ee580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:57.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.725+0000 7fa2655a3640 1 --2- 172.21.15.53:0/3967088317 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e767091050 0x55e7670a22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:57.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.725+0000 7fa2655a3640 1 -- 172.21.15.53:0/3967088317 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e767090740 msgr2=0x55e7670ee580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:57.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.725+0000 7fa2655a3640 1 --2- 172.21.15.53:0/3967088317 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e767090740 0x55e7670ee580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:57.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.725+0000 7fa2655a3640 1 -- 172.21.15.53:0/3967088317 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e766e59d10 con 0x55e767046d80 2023-06-10T19:03:57.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.725+0000 7fa265da4640 1 --2- 172.21.15.53:0/3967088317 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e767091050 0x55e7670a22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:03:57.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.725+0000 7fa2655a3640 1 --2- 172.21.15.53:0/3967088317 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e767046d80 0x55e7670ee040 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7fa25c0550a0 tx=0x7fa25c082730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1021a828e2c7e90d server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:57.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.725+0000 7fa23bfff640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-06-10T19:03:57.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.725+0000 7fa23bfff640 1 -- 172.21.15.53:0/3967088317 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa25c059350 con 0x55e767046d80 2023-06-10T19:03:57.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.725+0000 7fa23bfff640 1 -- 172.21.15.53:0/3967088317 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(110..110 src has 1..110) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa25c05d920 con 0x55e767046d80 2023-06-10T19:03:57.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.725+0000 7fa26a923000 1 -- 172.21.15.53:0/3967088317 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e766e93cd0 con 0x55e767046d80 2023-06-10T19:03:57.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.725+0000 7fa23bfff640 1 -- 172.21.15.53:0/3967088317 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa25c0514d0 con 0x55e767046d80 2023-06-10T19:03:57.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.725+0000 7fa26a923000 10 client.8871 fetch_fsmap learned FSMap version 61 2023-06-10T19:03:57.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.725+0000 7fa26a923000 1 -- 172.21.15.53:0/3967088317 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=2+}) v3 -- 0x55e766b91cc0 con 0x55e767046d80 2023-06-10T19:03:57.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.725+0000 7fa23bfff640 1 -- 172.21.15.53:0/3967088317 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e766e93cd0 con 0x55e767046d80 2023-06-10T19:03:57.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.725+0000 7fa23bfff640 1 -- 172.21.15.53:0/3967088317 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 61) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fa25c079020 con 0x55e767046d80 2023-06-10T19:03:57.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.725+0000 7fa26a923000 10 client.8871 fetch_fsmap finished waiting for FSMap version 61 2023-06-10T19:03:57.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.725+0000 7fa26a923000 10 client.8871 resolve_mds: resolved name 'a' to daemon mds.a 2023-06-10T19:03:57.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.725+0000 7fa26a923000 20 client.8871 populate_metadata read hostname 'smithi053' 2023-06-10T19:03:57.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.725+0000 7fa26a923000 1 --2- 172.21.15.53:0/3967088317 >> [v2:172.21.15.53:6834/1149668719,v1:172.21.15.53:6835/1149668719] conn(0x55e7670a2c30 0x55e7670a3000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:57.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.725+0000 7fa26a923000 4 client.8871 mds_command: new command op to 8685 tid=0[{"prefix": "status"}] 2023-06-10T19:03:57.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.725+0000 7fa26a923000 1 -- 172.21.15.53:0/3967088317 --> [v2:172.21.15.53:6834/1149668719,v1:172.21.15.53:6835/1149668719] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e766e8e360 con 0x55e7670a2c30 2023-06-10T19:03:57.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.725+0000 7fa264da2640 1 --2- 172.21.15.53:0/3967088317 >> [v2:172.21.15.53:6834/1149668719,v1:172.21.15.53:6835/1149668719] conn(0x55e7670a2c30 0x55e7670a3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:57.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.729+0000 7fa23bfff640 10 client.8871 ms_handle_connect on v2:172.21.15.53:6834/1149668719 2023-06-10T19:03:57.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.729+0000 7fa264da2640 1 --2- 172.21.15.53:0/3967088317 >> [v2:172.21.15.53:6834/1149668719,v1:172.21.15.53:6835/1149668719] conn(0x55e7670a2c30 0x55e7670a3000 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3dcab24215d05168 server_cookie=791983968fb7d177 in_seq=0 out_seq=0 2023-06-10T19:03:57.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.729+0000 7fa23bfff640 1 -- 172.21.15.53:0/3967088317 <== mds.0 v2:172.21.15.53:6834/1149668719 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x55e766e8e360 con 0x55e7670a2c30 2023-06-10T19:03:57.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.729+0000 7fa23bfff640 10 client.8871 handle_command_reply: tid=0 2023-06-10T19:03:57.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.729+0000 7fa26a923000 1 client.8871 shutdown 2023-06-10T19:03:57.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.729+0000 7fa26a923000 1 -- 172.21.15.53:0/3967088317 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e767046d80 msgr2=0x55e7670ee040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:57.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.729+0000 7fa26a923000 1 --2- 172.21.15.53:0/3967088317 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e767046d80 0x55e7670ee040 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7fa25c0550a0 tx=0x7fa25c082730 comp rx=0 tx=0).stop 2023-06-10T19:03:57.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.729+0000 7fa26a923000 1 -- 172.21.15.53:0/3967088317 shutdown_connections 2023-06-10T19:03:57.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.729+0000 7fa26a923000 1 --2- 172.21.15.53:0/3967088317 >> [v2:172.21.15.53:6834/1149668719,v1:172.21.15.53:6835/1149668719] conn(0x55e7670a2c30 0x55e7670a3000 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:57.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.729+0000 7fa26a923000 1 --2- 172.21.15.53:0/3967088317 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55e767091050 0x55e7670a22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:57.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.729+0000 7fa23bfff640 0 client.8871 ms_handle_reset on v2:172.21.15.53:6834/1149668719 2023-06-10T19:03:57.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.729+0000 7fa26a923000 1 --2- 172.21.15.53:0/3967088317 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e767090740 0x55e7670ee580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:57.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.729+0000 7fa26a923000 1 --2- 172.21.15.53:0/3967088317 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e767046d80 0x55e7670ee040 unknown :-1 s=CLOSED pgs=1748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:57.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.729+0000 7fa26a923000 1 -- 172.21.15.53:0/3967088317 >> 172.21.15.53:0/3967088317 conn(0x55e76703e800 msgr2=0x55e76708f030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:57.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.729+0000 7fa26a923000 1 -- 172.21.15.53:0/3967088317 shutdown_connections 2023-06-10T19:03:57.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.729+0000 7fa26a923000 1 -- 172.21.15.53:0/3967088317 wait complete. 2023-06-10T19:03:57.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.729+0000 7fa26a923000 20 client.8871 trim_cache size 0 max 16384 2023-06-10T19:03:57.742 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-06-10T19:03:57.742 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_fsid": "c8c64bed-c406-4936-93f9-d16335f1067d", 2023-06-10T19:03:57.742 INFO:teuthology.orchestra.run.smithi053.stdout: "whoami": 0, 2023-06-10T19:03:57.743 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 8685, 2023-06-10T19:03:57.743 INFO:teuthology.orchestra.run.smithi053.stdout: "want_state": "up:active", 2023-06-10T19:03:57.743 INFO:teuthology.orchestra.run.smithi053.stdout: "state": "up:active", 2023-06-10T19:03:57.743 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs", 2023-06-10T19:03:57.743 INFO:teuthology.orchestra.run.smithi053.stdout: "rank_uptime": 9.3075972920000005, 2023-06-10T19:03:57.743 INFO:teuthology.orchestra.run.smithi053.stdout: "mdsmap_epoch": 61, 2023-06-10T19:03:57.743 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch": 110, 2023-06-10T19:03:57.744 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch_barrier": 110, 2023-06-10T19:03:57.744 INFO:teuthology.orchestra.run.smithi053.stdout: "uptime": 14.295004219000001 2023-06-10T19:03:57.744 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-06-10T19:03:57.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.729+0000 7fa267807640 1 -- 172.21.15.53:0/2733813598 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa244066280 msgr2=0x7fa244068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:57.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.729+0000 7fa267807640 1 --2- 172.21.15.53:0/2733813598 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa244066280 0x7fa244068730 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fa2600b3ca0 tx=0x7fa250008040 comp rx=0 tx=0).stop 2023-06-10T19:03:57.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.729+0000 7fa267807640 1 -- 172.21.15.53:0/2733813598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa260152bb0 msgr2=0x7fa2600c17f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:57.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.729+0000 7fa267807640 1 --2- 172.21.15.53:0/2733813598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa260152bb0 0x7fa2600c17f0 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7fa25c00d800 tx=0x7fa25c00dcc0 comp rx=0 tx=0).stop 2023-06-10T19:03:57.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.729+0000 7fa267807640 1 -- 172.21.15.53:0/2733813598 shutdown_connections 2023-06-10T19:03:57.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.729+0000 7fa267807640 1 --2- 172.21.15.53:0/2733813598 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa244066280 0x7fa244068730 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:57.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.729+0000 7fa267807640 1 --2- 172.21.15.53:0/2733813598 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa26015c210 0x7fa2600c3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:57.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.729+0000 7fa267807640 1 --2- 172.21.15.53:0/2733813598 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa260158c20 0x7fa2600c3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:57.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.729+0000 7fa267807640 1 --2- 172.21.15.53:0/2733813598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa260152bb0 0x7fa2600c17f0 unknown :-1 s=CLOSED pgs=1744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:57.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.729+0000 7fa267807640 1 -- 172.21.15.53:0/2733813598 >> 172.21.15.53:0/2733813598 conn(0x7fa2600ce9e0 msgr2=0x7fa260152190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:57.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.729+0000 7fa267807640 1 -- 172.21.15.53:0/2733813598 shutdown_connections 2023-06-10T19:03:57.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.729+0000 7fa267807640 1 -- 172.21.15.53:0/2733813598 wait complete. 2023-06-10T19:03:57.748 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-10T19:03:57.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.857+0000 7f57370a1640 1 Processor -- start 2023-06-10T19:03:57.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.857+0000 7f57370a1640 1 -- start start 2023-06-10T19:03:57.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.861+0000 7f57370a1640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5730159690 0x7f5730070950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:57.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.861+0000 7f57370a1640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5730159a60 0x7f57300c2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:57.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.861+0000 7f57370a1640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57300cb080 con 0x7f57300b0f30 2023-06-10T19:03:57.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.861+0000 7f57370a1640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5730070e90 con 0x7f5730159690 2023-06-10T19:03:57.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.861+0000 7f57370a1640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f573006d450 con 0x7f5730159a60 2023-06-10T19:03:57.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.861+0000 7f5734e3d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5730159690 0x7f5730070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:57.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.861+0000 7f572ffff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f57300b0f30 0x7f57300cbe00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:59504/0 (socket says 172.21.15.53:59504) 2023-06-10T19:03:57.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.861+0000 7f5734e3d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5730159690 0x7f5730070950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35142/0 (socket says 172.21.15.53:35142) 2023-06-10T19:03:57.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.861+0000 7f572ffff640 1 -- 172.21.15.53:0/2288512266 learned_addr learned my addr 172.21.15.53:0/2288512266 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:03:57.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.861+0000 7f573563e640 1 --2- 172.21.15.53:0/2288512266 >> v2:172.21.15.117:3300/0 conn(0x7f5730159a60 0x7f57300c2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:57.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.861+0000 7f5734e3d640 1 -- 172.21.15.53:0/2288512266 >> v2:172.21.15.117:3300/0 conn(0x7f5730159a60 msgr2=0x7f57300c2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:03:57.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.861+0000 7f5734e3d640 1 --2- 172.21.15.53:0/2288512266 >> v2:172.21.15.117:3300/0 conn(0x7f5730159a60 0x7f57300c2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:57.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.861+0000 7f5734e3d640 1 -- 172.21.15.53:0/2288512266 >> v1:172.21.15.53:6789/0 conn(0x7f57300b0f30 legacy=0x7f57300cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:57.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.861+0000 7f572f7fe640 1 -- 172.21.15.53:0/2288512266 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3760641552 0 0) 0x7f57300cb080 con 0x7f57300b0f30 2023-06-10T19:03:57.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.861+0000 7f5734e3d640 1 -- 172.21.15.53:0/2288512266 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57300cb320 con 0x7f5730159690 2023-06-10T19:03:57.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.861+0000 7f573563e640 1 --2- 172.21.15.53:0/2288512266 >> v2:172.21.15.117:3300/0 conn(0x7f5730159a60 0x7f57300c2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:03:57.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.861+0000 7f5734e3d640 1 --2- 172.21.15.53:0/2288512266 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5730159690 0x7f5730070950 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7f5730070160 tx=0x7f572001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9d61edc29b34196 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:57.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.861+0000 7f572f7fe640 1 -- 172.21.15.53:0/2288512266 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57200a58b0 con 0x7f5730159690 2023-06-10T19:03:57.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.861+0000 7f572f7fe640 1 -- 172.21.15.53:0/2288512266 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57200a5a10 con 0x7f5730159690 2023-06-10T19:03:57.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.861+0000 7f572f7fe640 1 -- 172.21.15.53:0/2288512266 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57200a5da0 con 0x7f5730159690 2023-06-10T19:03:57.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.865+0000 7f57370a1640 1 -- 172.21.15.53:0/2288512266 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5730159690 msgr2=0x7f5730070950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:57.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.865+0000 7f57370a1640 1 --2- 172.21.15.53:0/2288512266 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5730159690 0x7f5730070950 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7f5730070160 tx=0x7f572001c8e0 comp rx=0 tx=0).stop 2023-06-10T19:03:57.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.865+0000 7f57370a1640 1 -- 172.21.15.53:0/2288512266 shutdown_connections 2023-06-10T19:03:57.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.865+0000 7f57370a1640 1 --2- 172.21.15.53:0/2288512266 >> v2:172.21.15.117:3300/0 conn(0x7f5730159a60 0x7f57300c2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:57.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.865+0000 7f57370a1640 1 --2- 172.21.15.53:0/2288512266 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5730159690 0x7f5730070950 unknown :-1 s=CLOSED pgs=1750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:57.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.865+0000 7f57370a1640 1 -- 172.21.15.53:0/2288512266 >> 172.21.15.53:0/2288512266 conn(0x7f573006a560 msgr2=0x7f573006a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:57.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.865+0000 7f57370a1640 1 -- 172.21.15.53:0/2288512266 shutdown_connections 2023-06-10T19:03:57.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.865+0000 7f57370a1640 1 -- 172.21.15.53:0/2288512266 wait complete. 2023-06-10T19:03:57.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.865+0000 7f57370a1640 1 Processor -- start 2023-06-10T19:03:57.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.865+0000 7f57370a1640 1 -- start start 2023-06-10T19:03:57.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.865+0000 7f57370a1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57300b0f30 0x7f573015c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:57.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.865+0000 7f57370a1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5730159690 0x7f573014c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:57.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.865+0000 7f57370a1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5730159a60 0x7f573014c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:57.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.865+0000 7f57370a1640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57300c8d10 con 0x7f57300b0f30 2023-06-10T19:03:57.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.865+0000 7f57370a1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57301475f0 con 0x7f5730159a60 2023-06-10T19:03:57.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.865+0000 7f57370a1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57300c7f50 con 0x7f5730159690 2023-06-10T19:03:57.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.865+0000 7f5734e3d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57300b0f30 0x7f573015c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:57.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.865+0000 7f5734e3d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57300b0f30 0x7f573015c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35148/0 (socket says 172.21.15.53:35148) 2023-06-10T19:03:57.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.865+0000 7f5734e3d640 1 -- 172.21.15.53:0/3836602039 learned_addr learned my addr 172.21.15.53:0/3836602039 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:03:57.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.865+0000 7f573563e640 1 --2- 172.21.15.53:0/3836602039 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5730159a60 0x7f573014c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:57.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.865+0000 7f572ffff640 1 --2- 172.21.15.53:0/3836602039 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5730159690 0x7f573014c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:57.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.865+0000 7f5734e3d640 1 -- 172.21.15.53:0/3836602039 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5730159690 msgr2=0x7f573014c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:57.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.865+0000 7f5734e3d640 1 --2- 172.21.15.53:0/3836602039 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5730159690 0x7f573014c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:57.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.865+0000 7f5734e3d640 1 -- 172.21.15.53:0/3836602039 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5730159a60 msgr2=0x7f573014c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:57.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.865+0000 7f5734e3d640 1 --2- 172.21.15.53:0/3836602039 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5730159a60 0x7f573014c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:57.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.865+0000 7f5734e3d640 1 -- 172.21.15.53:0/3836602039 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5720009a70 con 0x7f57300b0f30 2023-06-10T19:03:57.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.865+0000 7f573563e640 1 --2- 172.21.15.53:0/3836602039 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5730159a60 0x7f573014c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:03:57.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.865+0000 7f5734e3d640 1 --2- 172.21.15.53:0/3836602039 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57300b0f30 0x7f573015c7c0 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7f572001cdc0 tx=0x7f5720019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:57.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.869+0000 7f572d7fa640 1 -- 172.21.15.53:0/3836602039 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5720003ba0 con 0x7f57300b0f30 2023-06-10T19:03:57.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.869+0000 7f572d7fa640 1 -- 172.21.15.53:0/3836602039 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5720003d00 con 0x7f57300b0f30 2023-06-10T19:03:57.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.869+0000 7f57370a1640 1 -- 172.21.15.53:0/3836602039 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57300c8230 con 0x7f57300b0f30 2023-06-10T19:03:57.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.869+0000 7f572d7fa640 1 -- 172.21.15.53:0/3836602039 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57200ad870 con 0x7f57300b0f30 2023-06-10T19:03:57.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.869+0000 7f57370a1640 1 -- 172.21.15.53:0/3836602039 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57300c87f0 con 0x7f57300b0f30 2023-06-10T19:03:57.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.869+0000 7f57370a1640 1 -- 172.21.15.53:0/3836602039 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f573004d790 con 0x7f57300b0f30 2023-06-10T19:03:57.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.869+0000 7f572d7fa640 1 -- 172.21.15.53:0/3836602039 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f57200ad9d0 con 0x7f57300b0f30 2023-06-10T19:03:57.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.869+0000 7f572d7fa640 1 --2- 172.21.15.53:0/3836602039 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f571c066280 0x7f571c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:03:57.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.869+0000 7f572d7fa640 1 -- 172.21.15.53:0/3836602039 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f572011f2c0 con 0x7f57300b0f30 2023-06-10T19:03:57.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.869+0000 7f572ffff640 1 --2- 172.21.15.53:0/3836602039 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f571c066280 0x7f571c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:03:57.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.869+0000 7f572ffff640 1 --2- 172.21.15.53:0/3836602039 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f571c066280 0x7f571c068730 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f57300cf920 tx=0x7f5724009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:03:57.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:57.873+0000 7f572d7fa640 1 -- 172.21.15.53:0/3836602039 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f57200ec730 con 0x7f57300b0f30 2023-06-10T19:03:58.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:58.057+0000 7f57370a1640 1 -- 172.21.15.53:0/3836602039 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f573006ce70 con 0x7f57300b0f30 2023-06-10T19:03:58.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:58.057+0000 7f572d7fa640 1 -- 172.21.15.53:0/3836602039 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v61) v1 ==== 53+0+73 (secure 0 0 0) 0x7f57200efd50 con 0x7f57300b0f30 2023-06-10T19:03:58.061 INFO:teuthology.orchestra.run.smithi053.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-06-10T19:03:58.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:58.057+0000 7f57370a1640 1 -- 172.21.15.53:0/3836602039 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f571c066280 msgr2=0x7f571c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:58.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:58.057+0000 7f57370a1640 1 --2- 172.21.15.53:0/3836602039 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f571c066280 0x7f571c068730 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f57300cf920 tx=0x7f5724009040 comp rx=0 tx=0).stop 2023-06-10T19:03:58.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:58.057+0000 7f57370a1640 1 -- 172.21.15.53:0/3836602039 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57300b0f30 msgr2=0x7f573015c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:03:58.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:58.057+0000 7f57370a1640 1 --2- 172.21.15.53:0/3836602039 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57300b0f30 0x7f573015c7c0 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7f572001cdc0 tx=0x7f5720019680 comp rx=0 tx=0).stop 2023-06-10T19:03:58.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:58.057+0000 7f57370a1640 1 -- 172.21.15.53:0/3836602039 shutdown_connections 2023-06-10T19:03:58.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:58.057+0000 7f57370a1640 1 --2- 172.21.15.53:0/3836602039 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f571c066280 0x7f571c068730 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:58.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:58.057+0000 7f57370a1640 1 --2- 172.21.15.53:0/3836602039 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5730159a60 0x7f573014c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:58.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:58.057+0000 7f57370a1640 1 --2- 172.21.15.53:0/3836602039 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5730159690 0x7f573014c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:58.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:58.057+0000 7f57370a1640 1 --2- 172.21.15.53:0/3836602039 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57300b0f30 0x7f573015c7c0 unknown :-1 s=CLOSED pgs=1751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:03:58.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:58.057+0000 7f57370a1640 1 -- 172.21.15.53:0/3836602039 >> 172.21.15.53:0/3836602039 conn(0x7f573006a560 msgr2=0x7f57300ced90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:03:58.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:58.057+0000 7f57370a1640 1 -- 172.21.15.53:0/3836602039 shutdown_connections 2023-06-10T19:03:58.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:03:58.057+0000 7f57370a1640 1 -- 172.21.15.53:0/3836602039 wait complete. 2023-06-10T19:03:58.078 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-10T19:03:58.079 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-10T19:03:58.079 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi053.front.sepia.ceph.com 2023-06-10T19:03:58.079 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-06-10T19:03:58.079 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-06-10T19:03:58.080 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-10T19:03:58.080 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-10T19:03:58.080 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-10T19:03:58.081 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-06-10T19:03:58.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:03:58.081 DEBUG:teuthology.orchestra.run.smithi053:> ip addr 2023-06-10T19:03:58.087 INFO:teuthology.orchestra.run.smithi053.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-10T19:03:58.087 INFO:teuthology.orchestra.run.smithi053.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-10T19:03:58.087 INFO:teuthology.orchestra.run.smithi053.stdout: inet 127.0.0.1/8 scope host lo 2023-06-10T19:03:58.088 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:03:58.088 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 ::1/128 scope host 2023-06-10T19:03:58.088 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:03:58.088 INFO:teuthology.orchestra.run.smithi053.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T19:03:58.088 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:da brd ff:ff:ff:ff:ff:ff 2023-06-10T19:03:58.088 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f0 2023-06-10T19:03:58.089 INFO:teuthology.orchestra.run.smithi053.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T19:03:58.089 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:db brd ff:ff:ff:ff:ff:ff 2023-06-10T19:03:58.089 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f1 2023-06-10T19:03:58.089 INFO:teuthology.orchestra.run.smithi053.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-10T19:03:58.089 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:18 brd ff:ff:ff:ff:ff:ff 2023-06-10T19:03:58.089 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f0 2023-06-10T19:03:58.089 INFO:teuthology.orchestra.run.smithi053.stdout: inet 172.21.15.53/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-06-10T19:03:58.090 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft 41811sec preferred_lft 41811sec 2023-06-10T19:03:58.090 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::ae1f:6bff:fef8:3718/64 scope link 2023-06-10T19:03:58.090 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:03:58.090 INFO:teuthology.orchestra.run.smithi053.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T19:03:58.090 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:19 brd ff:ff:ff:ff:ff:ff 2023-06-10T19:03:58.090 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f1 2023-06-10T19:03:58.090 INFO:teuthology.orchestra.run.smithi053.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-06-10T19:03:58.091 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 02:42:49:3d:ee:1e brd ff:ff:ff:ff:ff:ff 2023-06-10T19:03:58.091 INFO:teuthology.orchestra.run.smithi053.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-06-10T19:03:58.091 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:03:58.091 INFO:teuthology.orchestra.run.smithi053.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-10T19:03:58.091 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-06-10T19:03:58.091 INFO:teuthology.orchestra.run.smithi053.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-06-10T19:03:58.091 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:03:58.092 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-06-10T19:03:58.092 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:03:58.092 INFO:teuthology.orchestra.run.smithi053.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state DOWN group default qlen 1000 2023-06-10T19:03:58.092 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-06-10T19:03:58.092 INFO:teuthology.orchestra.run.smithi053.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-10T19:03:58.092 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-06-10T19:03:58.093 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-06-10T19:03:58.093 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:03:58.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:03:58.093 DEBUG:teuthology.orchestra.run.smithi053:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-10T19:03:58.146 INFO:teuthology.orchestra.run.smithi053.stdout:1 2023-06-10T19:03:58.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:03:58.148 DEBUG:teuthology.orchestra.run.smithi053:> route 2023-06-10T19:03:58.197 INFO:teuthology.orchestra.run.smithi053.stdout:Kernel IP routing table 2023-06-10T19:03:58.197 INFO:teuthology.orchestra.run.smithi053.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-10T19:03:58.197 INFO:teuthology.orchestra.run.smithi053.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-06-10T19:03:58.198 INFO:teuthology.orchestra.run.smithi053.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-06-10T19:03:58.198 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-06-10T19:03:58.198 INFO:teuthology.orchestra.run.smithi053.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-10T19:03:58.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:03:58.199 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec bash -c ' 2023-06-10T19:03:58.200 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2023-06-10T19:03:58.200 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-06-10T19:03:58.200 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-06-10T19:03:58.201 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-06-10T19:03:58.201 DEBUG:teuthology.orchestra.run.smithi053:> ') 2023-06-10T19:03:58.270 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:03:58.271 DEBUG:teuthology.orchestra.run.smithi053:> ip netns list 2023-06-10T19:03:58.320 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-06-10T19:03:58.320 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-06-10T19:03:58.320 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-06-10T19:03:58.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:03:58.321 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link set brx.0 up 2023-06-10T19:03:58.377 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-06-10T19:03:58.377 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-10T19:03:58.378 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-06-10T19:03:58.425 INFO:teuthology.orchestra.run.smithi053.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-06-10T19:03:58.425 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-10T19:03:58.426 DEBUG:teuthology.orchestra.run.smithi053:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-06-10T19:03:58.471 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2023-06-10T19:03:58.529 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T19:03:58.530 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T19:03:58.583 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T19:03:58.585 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T19:03:58.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:03:58.586 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2023-06-10T19:03:58.631 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-06-10T19:03:58.632 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-06-10T19:03:58.676 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2023-06-10T19:03:58.691 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T19:03:58.692 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T19:03:58.750 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T19:03:58.750 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T19:03:58.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:03:58.752 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2023-06-10T19:03:59.469 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:2023-06-10T19:03:59.465+0000 7f7c9011a580 -1 init, newargv = 0x55b87b20d000 newargc=15 2023-06-10T19:03:59.469 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[61053]: starting ceph client 2023-06-10T19:03:59.476 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[61053]: starting fuse 2023-06-10T19:03:59.900 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2023-06-10T19:03:59.917 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T19:03:59.918 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T19:03:59.972 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T19:03:59.973 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T19:03:59.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:03:59.975 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2023-06-10T19:04:00.021 INFO:teuthology.orchestra.run.smithi053.stdout:45 2023-06-10T19:04:00.021 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-06-10T19:04:00.022 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-06-10T19:04:00.023 DEBUG:teuthology.orchestra.run.smithi053:> import glob 2023-06-10T19:04:00.023 DEBUG:teuthology.orchestra.run.smithi053:> import re 2023-06-10T19:04:00.024 DEBUG:teuthology.orchestra.run.smithi053:> import os 2023-06-10T19:04:00.025 DEBUG:teuthology.orchestra.run.smithi053:> import subprocess 2023-06-10T19:04:00.025 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:04:00.025 DEBUG:teuthology.orchestra.run.smithi053:> def _find_admin_socket(client_name): 2023-06-10T19:04:00.026 DEBUG:teuthology.orchestra.run.smithi053:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-06-10T19:04:00.026 DEBUG:teuthology.orchestra.run.smithi053:> files = glob.glob(asok_path) 2023-06-10T19:04:00.026 DEBUG:teuthology.orchestra.run.smithi053:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-06-10T19:04:00.026 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:04:00.027 DEBUG:teuthology.orchestra.run.smithi053:> # Given a non-glob path, it better be there 2023-06-10T19:04:00.027 DEBUG:teuthology.orchestra.run.smithi053:> if "*" not in asok_path: 2023-06-10T19:04:00.027 DEBUG:teuthology.orchestra.run.smithi053:> assert(len(files) == 1) 2023-06-10T19:04:00.028 DEBUG:teuthology.orchestra.run.smithi053:> return files[0] 2023-06-10T19:04:00.029 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:04:00.030 DEBUG:teuthology.orchestra.run.smithi053:> for f in files: 2023-06-10T19:04:00.030 DEBUG:teuthology.orchestra.run.smithi053:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-06-10T19:04:00.031 DEBUG:teuthology.orchestra.run.smithi053:> if os.path.exists("/proc/{0}".format(pid)): 2023-06-10T19:04:00.031 DEBUG:teuthology.orchestra.run.smithi053:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-06-10T19:04:00.032 DEBUG:teuthology.orchestra.run.smithi053:> contents = proc_f.read() 2023-06-10T19:04:00.032 DEBUG:teuthology.orchestra.run.smithi053:> if mountpoint in contents: 2023-06-10T19:04:00.033 DEBUG:teuthology.orchestra.run.smithi053:> return f 2023-06-10T19:04:00.033 DEBUG:teuthology.orchestra.run.smithi053:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-06-10T19:04:00.034 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:04:00.034 DEBUG:teuthology.orchestra.run.smithi053:> print(_find_admin_socket("client.0")) 2023-06-10T19:04:00.034 DEBUG:teuthology.orchestra.run.smithi053:> ' 2023-06-10T19:04:00.146 INFO:teuthology.orchestra.run.smithi053.stdout:/var/run/ceph/ceph-client.0.61053.asok 2023-06-10T19:04:00.328 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.61053.asok 2023-06-10T19:04:00.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:04:00.329 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.61053.asok status 2023-06-10T19:04:00.492 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-06-10T19:04:00.492 INFO:teuthology.orchestra.run.smithi053.stdout: "metadata": { 2023-06-10T19:04:00.493 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_sha1": "219d315c3a0b2075e570fb1964be2ad33fe7a9c8", 2023-06-10T19:04:00.493 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_version": "ceph version 18.0.0-4359-g219d315c (219d315c3a0b2075e570fb1964be2ad33fe7a9c8) reef (dev)", 2023-06-10T19:04:00.493 INFO:teuthology.orchestra.run.smithi053.stdout: "entity_id": "0", 2023-06-10T19:04:00.493 INFO:teuthology.orchestra.run.smithi053.stdout: "hostname": "smithi053", 2023-06-10T19:04:00.493 INFO:teuthology.orchestra.run.smithi053.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-06-10T19:04:00.494 INFO:teuthology.orchestra.run.smithi053.stdout: "pid": "61053", 2023-06-10T19:04:00.494 INFO:teuthology.orchestra.run.smithi053.stdout: "root": "/" 2023-06-10T19:04:00.494 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:04:00.494 INFO:teuthology.orchestra.run.smithi053.stdout: "dentry_count": 0, 2023-06-10T19:04:00.494 INFO:teuthology.orchestra.run.smithi053.stdout: "dentry_pinned_count": 0, 2023-06-10T19:04:00.494 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 8886, 2023-06-10T19:04:00.494 INFO:teuthology.orchestra.run.smithi053.stdout: "inst": { 2023-06-10T19:04:00.495 INFO:teuthology.orchestra.run.smithi053.stdout: "name": { 2023-06-10T19:04:00.495 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "client", 2023-06-10T19:04:00.495 INFO:teuthology.orchestra.run.smithi053.stdout: "num": 8886 2023-06-10T19:04:00.495 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:04:00.495 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": { 2023-06-10T19:04:00.495 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2023-06-10T19:04:00.495 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "192.168.0.1:0", 2023-06-10T19:04:00.495 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 3878814772 2023-06-10T19:04:00.496 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:04:00.496 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:04:00.496 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": { 2023-06-10T19:04:00.496 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2023-06-10T19:04:00.496 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "192.168.0.1:0", 2023-06-10T19:04:00.496 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 3878814772 2023-06-10T19:04:00.496 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:04:00.496 INFO:teuthology.orchestra.run.smithi053.stdout: "inst_str": "client.8886 192.168.0.1:0/3878814772", 2023-06-10T19:04:00.497 INFO:teuthology.orchestra.run.smithi053.stdout: "addr_str": "192.168.0.1:0/3878814772", 2023-06-10T19:04:00.497 INFO:teuthology.orchestra.run.smithi053.stdout: "inode_count": 1, 2023-06-10T19:04:00.497 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_epoch": 61, 2023-06-10T19:04:00.497 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_epoch": 110, 2023-06-10T19:04:00.497 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_epoch_barrier": 0, 2023-06-10T19:04:00.497 INFO:teuthology.orchestra.run.smithi053.stdout: "blocklisted": false, 2023-06-10T19:04:00.497 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs" 2023-06-10T19:04:00.497 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-06-10T19:04:00.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:04:00.506 DEBUG:teuthology.orchestra.run.smithi053:> stat --file-system '--printf=%T 2023-06-10T19:04:00.507 DEBUG:teuthology.orchestra.run.smithi053:> ' -- /home/ubuntu/cephtest/mnt.0 2023-06-10T19:04:00.512 INFO:teuthology.orchestra.run.smithi053.stdout:fuseblk 2023-06-10T19:04:00.513 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-06-10T19:04:00.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:04:00.513 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-06-10T19:04:00.568 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-10T19:04:00.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:00.733+0000 7f114638b640 1 Processor -- start 2023-06-10T19:04:00.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:00.733+0000 7f114638b640 1 -- start start 2023-06-10T19:04:00.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:00.733+0000 7f114638b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1140159450 0x7f114015d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:00.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:00.733+0000 7f114638b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f114015d680 0x7f11400cec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:00.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:00.733+0000 7f114638b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f11400cf180 0x7f11400cda20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:00.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:00.733+0000 7f114638b640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11400cf600 con 0x7f114015d680 2023-06-10T19:04:00.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:00.733+0000 7f114638b640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11400cbac0 con 0x7f11400cf180 2023-06-10T19:04:00.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:00.733+0000 7f114638b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f114015dc00 con 0x7f1140159450 2023-06-10T19:04:00.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:00.733+0000 7f113f7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f114015d680 0x7f11400cec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:00.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:00.733+0000 7f113f7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f114015d680 0x7f11400cec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35150/0 (socket says 172.21.15.53:35150) 2023-06-10T19:04:00.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:00.733+0000 7f113f7fe640 1 -- 172.21.15.53:0/438970266 learned_addr learned my addr 172.21.15.53:0/438970266 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:04:00.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:00.737+0000 7f113ffff640 1 --2- 172.21.15.53:0/438970266 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1140159450 0x7f114015d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:00.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:00.737+0000 7f1144928640 1 --2- 172.21.15.53:0/438970266 >> v2:172.21.15.117:3300/0 conn(0x7f11400cf180 0x7f11400cda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:00.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:00.737+0000 7f113f7fe640 1 -- 172.21.15.53:0/438970266 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1140159450 msgr2=0x7f114015d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:04:00.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:00.737+0000 7f113f7fe640 1 --2- 172.21.15.53:0/438970266 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1140159450 0x7f114015d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:00.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:00.737+0000 7f113f7fe640 1 -- 172.21.15.53:0/438970266 >> v2:172.21.15.117:3300/0 conn(0x7f11400cf180 msgr2=0x7f11400cda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:04:00.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:00.737+0000 7f113f7fe640 1 --2- 172.21.15.53:0/438970266 >> v2:172.21.15.117:3300/0 conn(0x7f11400cf180 0x7f11400cda20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:00.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:00.737+0000 7f113f7fe640 1 -- 172.21.15.53:0/438970266 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f114015dee0 con 0x7f114015d680 2023-06-10T19:04:00.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:00.737+0000 7f1144928640 1 --2- 172.21.15.53:0/438970266 >> v2:172.21.15.117:3300/0 conn(0x7f11400cf180 0x7f11400cda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:04:00.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:00.737+0000 7f113f7fe640 1 --2- 172.21.15.53:0/438970266 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f114015d680 0x7f11400cec40 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7f114006fd30 tx=0x7f113401c180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcb731708b444ee8 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:00.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:00.737+0000 7f113effd640 1 -- 172.21.15.53:0/438970266 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11340ab600 con 0x7f114015d680 2023-06-10T19:04:00.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:00.737+0000 7f113effd640 1 -- 172.21.15.53:0/438970266 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11340a7050 con 0x7f114015d680 2023-06-10T19:04:00.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:00.737+0000 7f113effd640 1 -- 172.21.15.53:0/438970266 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11340ab980 con 0x7f114015d680 2023-06-10T19:04:00.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:00.737+0000 7f114638b640 1 -- 172.21.15.53:0/438970266 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f114015d680 msgr2=0x7f11400cec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:00.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:00.737+0000 7f114638b640 1 --2- 172.21.15.53:0/438970266 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f114015d680 0x7f11400cec40 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7f114006fd30 tx=0x7f113401c180 comp rx=0 tx=0).stop 2023-06-10T19:04:00.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:00.737+0000 7f114638b640 1 -- 172.21.15.53:0/438970266 shutdown_connections 2023-06-10T19:04:00.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:00.737+0000 7f114638b640 1 --2- 172.21.15.53:0/438970266 >> v2:172.21.15.117:3300/0 conn(0x7f11400cf180 0x7f11400cda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:00.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:00.737+0000 7f114638b640 1 --2- 172.21.15.53:0/438970266 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f114015d680 0x7f11400cec40 unknown :-1 s=CLOSED pgs=1754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:00.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:00.737+0000 7f114638b640 1 --2- 172.21.15.53:0/438970266 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1140159450 0x7f114015d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:00.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:00.737+0000 7f114638b640 1 -- 172.21.15.53:0/438970266 >> 172.21.15.53:0/438970266 conn(0x7f114006a090 msgr2=0x7f114006d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:04:00.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:00.737+0000 7f114638b640 1 -- 172.21.15.53:0/438970266 shutdown_connections 2023-06-10T19:04:00.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:00.737+0000 7f114638b640 1 -- 172.21.15.53:0/438970266 wait complete. 2023-06-10T19:04:00.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:00.741+0000 7f114638b640 1 Processor -- start 2023-06-10T19:04:00.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:00.741+0000 7f114638b640 1 -- start start 2023-06-10T19:04:00.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:00.741+0000 7f114638b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11400cf180 0x7f1140153e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:00.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:00.741+0000 7f114638b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1140159450 0x7f114014f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:00.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:00.741+0000 7f114638b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f114015d680 0x7f114014fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:00.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:00.741+0000 7f114638b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11400c6f20 con 0x7f114015d680 2023-06-10T19:04:00.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:00.741+0000 7f114638b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11401535e0 con 0x7f11400cf180 2023-06-10T19:04:00.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:00.741+0000 7f114638b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11400c71c0 con 0x7f1140159450 2023-06-10T19:04:00.747 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:00.741+0000 7f1144928640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f114015d680 0x7f114014fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:00.747 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:00.741+0000 7f1144928640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f114015d680 0x7f114014fef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35154/0 (socket says 172.21.15.53:35154) 2023-06-10T19:04:00.747 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:00.741+0000 7f1144928640 1 -- 172.21.15.53:0/3787643182 learned_addr learned my addr 172.21.15.53:0/3787643182 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:04:00.747 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:00.741+0000 7f113ffff640 1 --2- 172.21.15.53:0/3787643182 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11400cf180 0x7f1140153e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:00.747 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:00.741+0000 7f113f7fe640 1 --2- 172.21.15.53:0/3787643182 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1140159450 0x7f114014f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:00.747 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:00.741+0000 7f1144928640 1 -- 172.21.15.53:0/3787643182 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1140159450 msgr2=0x7f114014f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:00.747 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:00.741+0000 7f1144928640 1 --2- 172.21.15.53:0/3787643182 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1140159450 0x7f114014f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:00.747 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:00.741+0000 7f1144928640 1 -- 172.21.15.53:0/3787643182 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11400cf180 msgr2=0x7f1140153e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:00.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:00.741+0000 7f1144928640 1 --2- 172.21.15.53:0/3787643182 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11400cf180 0x7f1140153e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:00.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:00.741+0000 7f1144928640 1 -- 172.21.15.53:0/3787643182 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11340094d0 con 0x7f114015d680 2023-06-10T19:04:00.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:00.741+0000 7f113f7fe640 1 --2- 172.21.15.53:0/3787643182 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1140159450 0x7f114014f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:04:00.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:00.741+0000 7f1144928640 1 --2- 172.21.15.53:0/3787643182 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f114015d680 0x7f114014fef0 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7f113800cd50 tx=0x7f113800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:00.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:00.741+0000 7f113cff9640 1 -- 172.21.15.53:0/3787643182 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113800f680 con 0x7f114015d680 2023-06-10T19:04:00.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:00.741+0000 7f113cff9640 1 -- 172.21.15.53:0/3787643182 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f113800f800 con 0x7f114015d680 2023-06-10T19:04:00.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:00.741+0000 7f114638b640 1 -- 172.21.15.53:0/3787643182 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11400c74a0 con 0x7f114015d680 2023-06-10T19:04:00.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:00.741+0000 7f113cff9640 1 -- 172.21.15.53:0/3787643182 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113800fbb0 con 0x7f114015d680 2023-06-10T19:04:00.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:00.741+0000 7f114638b640 1 -- 172.21.15.53:0/3787643182 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1140150430 con 0x7f114015d680 2023-06-10T19:04:00.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:00.741+0000 7f114638b640 1 -- 172.21.15.53:0/3787643182 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f114004d790 con 0x7f114015d680 2023-06-10T19:04:00.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:00.745+0000 7f113cff9640 1 -- 172.21.15.53:0/3787643182 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f113800b040 con 0x7f114015d680 2023-06-10T19:04:00.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:00.745+0000 7f113cff9640 1 --2- 172.21.15.53:0/3787643182 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f112c0662b0 0x7f112c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:00.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:00.745+0000 7f113cff9640 1 -- 172.21.15.53:0/3787643182 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1138084670 con 0x7f114015d680 2023-06-10T19:04:00.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:00.745+0000 7f113ffff640 1 --2- 172.21.15.53:0/3787643182 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f112c0662b0 0x7f112c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:00.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:00.745+0000 7f113ffff640 1 --2- 172.21.15.53:0/3787643182 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f112c0662b0 0x7f112c068760 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f113000d8d0 tx=0x7f1130008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:00.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:00.749+0000 7f113cff9640 1 -- 172.21.15.53:0/3787643182 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1138051b80 con 0x7f114015d680 2023-06-10T19:04:00.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:00.937+0000 7f114638b640 1 -- 172.21.15.53:0/3787643182 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f11400c7950 con 0x7f114015d680 2023-06-10T19:04:00.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:00.937+0000 7f113cff9640 1 -- 172.21.15.53:0/3787643182 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v61) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1138082e60 con 0x7f114015d680 2023-06-10T19:04:00.942 INFO:teuthology.orchestra.run.smithi053.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-06-10T19:04:00.944 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:00.941+0000 7f114638b640 1 -- 172.21.15.53:0/3787643182 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f112c0662b0 msgr2=0x7f112c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:00.944 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:00.941+0000 7f114638b640 1 --2- 172.21.15.53:0/3787643182 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f112c0662b0 0x7f112c068760 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f113000d8d0 tx=0x7f1130008040 comp rx=0 tx=0).stop 2023-06-10T19:04:00.944 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:00.941+0000 7f114638b640 1 -- 172.21.15.53:0/3787643182 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f114015d680 msgr2=0x7f114014fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:00.944 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:00.941+0000 7f114638b640 1 --2- 172.21.15.53:0/3787643182 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f114015d680 0x7f114014fef0 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7f113800cd50 tx=0x7f113800a650 comp rx=0 tx=0).stop 2023-06-10T19:04:00.944 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:00.941+0000 7f114638b640 1 -- 172.21.15.53:0/3787643182 shutdown_connections 2023-06-10T19:04:00.944 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:00.941+0000 7f114638b640 1 --2- 172.21.15.53:0/3787643182 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f112c0662b0 0x7f112c068760 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:00.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:00.941+0000 7f114638b640 1 --2- 172.21.15.53:0/3787643182 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f114015d680 0x7f114014fef0 unknown :-1 s=CLOSED pgs=1755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:00.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:00.941+0000 7f114638b640 1 --2- 172.21.15.53:0/3787643182 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1140159450 0x7f114014f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:00.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:00.941+0000 7f114638b640 1 --2- 172.21.15.53:0/3787643182 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11400cf180 0x7f1140153e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:00.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:00.941+0000 7f114638b640 1 -- 172.21.15.53:0/3787643182 >> 172.21.15.53:0/3787643182 conn(0x7f114006a090 msgr2=0x7f11400b1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:04:00.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:00.941+0000 7f114638b640 1 -- 172.21.15.53:0/3787643182 shutdown_connections 2023-06-10T19:04:00.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:00.941+0000 7f114638b640 1 -- 172.21.15.53:0/3787643182 wait complete. 2023-06-10T19:04:00.960 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-10T19:04:00.961 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-10T19:04:00.961 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi117.front.sepia.ceph.com 2023-06-10T19:04:00.961 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-06-10T19:04:00.962 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-06-10T19:04:00.962 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-10T19:04:00.962 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-10T19:04:00.962 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-10T19:04:00.963 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-06-10T19:04:00.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:04:00.963 DEBUG:teuthology.orchestra.run.smithi117:> ip addr 2023-06-10T19:04:00.970 INFO:teuthology.orchestra.run.smithi117.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-10T19:04:00.970 INFO:teuthology.orchestra.run.smithi117.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-10T19:04:00.970 INFO:teuthology.orchestra.run.smithi117.stdout: inet 127.0.0.1/8 scope host lo 2023-06-10T19:04:00.971 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:04:00.971 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 ::1/128 scope host 2023-06-10T19:04:00.971 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:04:00.971 INFO:teuthology.orchestra.run.smithi117.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T19:04:00.971 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8a brd ff:ff:ff:ff:ff:ff 2023-06-10T19:04:00.971 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f0 2023-06-10T19:04:00.971 INFO:teuthology.orchestra.run.smithi117.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T19:04:00.972 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8b brd ff:ff:ff:ff:ff:ff 2023-06-10T19:04:00.972 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f1 2023-06-10T19:04:00.972 INFO:teuthology.orchestra.run.smithi117.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T19:04:00.972 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:62 brd ff:ff:ff:ff:ff:ff 2023-06-10T19:04:00.972 INFO:teuthology.orchestra.run.smithi117.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-10T19:04:00.972 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:63 brd ff:ff:ff:ff:ff:ff 2023-06-10T19:04:00.972 INFO:teuthology.orchestra.run.smithi117.stdout: inet 172.21.15.117/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-06-10T19:04:00.973 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft 41808sec preferred_lft 41808sec 2023-06-10T19:04:00.973 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::ec4:7aff:fe8f:4463/64 scope link 2023-06-10T19:04:00.973 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:04:00.973 INFO:teuthology.orchestra.run.smithi117.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-06-10T19:04:00.973 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 02:42:f8:40:b2:dc brd ff:ff:ff:ff:ff:ff 2023-06-10T19:04:00.973 INFO:teuthology.orchestra.run.smithi117.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-06-10T19:04:00.973 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:04:00.973 INFO:teuthology.orchestra.run.smithi117.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-10T19:04:00.974 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-06-10T19:04:00.974 INFO:teuthology.orchestra.run.smithi117.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-06-10T19:04:00.974 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:04:00.974 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-06-10T19:04:00.974 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:04:00.974 INFO:teuthology.orchestra.run.smithi117.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-10T19:04:00.974 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-06-10T19:04:00.974 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-06-10T19:04:00.975 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:04:00.975 INFO:teuthology.orchestra.run.smithi117.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-10T19:04:00.975 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-06-10T19:04:00.975 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-06-10T19:04:00.975 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:04:00.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:04:00.976 DEBUG:teuthology.orchestra.run.smithi117:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-10T19:04:01.024 INFO:teuthology.orchestra.run.smithi117.stdout:1 2023-06-10T19:04:01.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:04:01.026 DEBUG:teuthology.orchestra.run.smithi117:> route 2023-06-10T19:04:01.073 INFO:teuthology.orchestra.run.smithi117.stdout:Kernel IP routing table 2023-06-10T19:04:01.074 INFO:teuthology.orchestra.run.smithi117.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-10T19:04:01.074 INFO:teuthology.orchestra.run.smithi117.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-06-10T19:04:01.074 INFO:teuthology.orchestra.run.smithi117.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-06-10T19:04:01.074 INFO:teuthology.orchestra.run.smithi117.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-06-10T19:04:01.074 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-06-10T19:04:01.074 INFO:teuthology.orchestra.run.smithi117.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-10T19:04:01.074 INFO:teuthology.orchestra.run.smithi117.stdout:ns2.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-10T19:04:01.075 INFO:teuthology.orchestra.run.smithi117.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-10T19:04:01.075 INFO:teuthology.orchestra.run.smithi117.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-10T19:04:01.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:04:01.075 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec bash -c ' 2023-06-10T19:04:01.076 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2023-06-10T19:04:01.076 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-06-10T19:04:01.076 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-06-10T19:04:01.077 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-06-10T19:04:01.077 DEBUG:teuthology.orchestra.run.smithi117:> ') 2023-06-10T19:04:01.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:04:01.149 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list 2023-06-10T19:04:01.196 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-06-10T19:04:01.196 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-06-10T19:04:01.196 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-06-10T19:04:01.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:04:01.197 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link set brx.0 up 2023-06-10T19:04:01.252 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-06-10T19:04:01.252 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-10T19:04:01.253 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-06-10T19:04:01.299 INFO:teuthology.orchestra.run.smithi117.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-06-10T19:04:01.300 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-10T19:04:01.300 DEBUG:teuthology.orchestra.run.smithi117:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-06-10T19:04:01.346 DEBUG:teuthology.orchestra.run.smithi117:> sudo modprobe fuse 2023-06-10T19:04:01.408 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T19:04:01.409 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T19:04:01.463 INFO:teuthology.orchestra.run.smithi117.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T19:04:01.464 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T19:04:01.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:04:01.465 DEBUG:teuthology.orchestra.run.smithi117:> ls /sys/fs/fuse/connections 2023-06-10T19:04:01.512 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-06-10T19:04:01.512 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-06-10T19:04:01.556 DEBUG:teuthology.orchestra.run.smithi117:> sudo modprobe fuse 2023-06-10T19:04:01.570 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T19:04:01.570 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T19:04:01.621 INFO:teuthology.orchestra.run.smithi117.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T19:04:01.622 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T19:04:01.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:04:01.623 DEBUG:teuthology.orchestra.run.smithi117:> ls /sys/fs/fuse/connections 2023-06-10T19:04:01.637 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi117.stderr:2023-06-10T19:04:01.632+0000 7f00ea615580 -1 init, newargv = 0x55635ad35c00 newargc=15 2023-06-10T19:04:01.637 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi117.stderr:ceph-fuse[45121]: starting ceph client 2023-06-10T19:04:01.645 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi117.stderr:ceph-fuse[45121]: starting fuse 2023-06-10T19:04:02.743 DEBUG:teuthology.orchestra.run.smithi117:> sudo modprobe fuse 2023-06-10T19:04:02.758 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T19:04:02.758 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T19:04:02.815 INFO:teuthology.orchestra.run.smithi117.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T19:04:02.816 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T19:04:02.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:04:02.817 DEBUG:teuthology.orchestra.run.smithi117:> ls /sys/fs/fuse/connections 2023-06-10T19:04:02.864 INFO:teuthology.orchestra.run.smithi117.stdout:45 2023-06-10T19:04:02.864 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-06-10T19:04:02.865 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-06-10T19:04:02.865 DEBUG:teuthology.orchestra.run.smithi117:> import glob 2023-06-10T19:04:02.865 DEBUG:teuthology.orchestra.run.smithi117:> import re 2023-06-10T19:04:02.865 DEBUG:teuthology.orchestra.run.smithi117:> import os 2023-06-10T19:04:02.866 DEBUG:teuthology.orchestra.run.smithi117:> import subprocess 2023-06-10T19:04:02.867 DEBUG:teuthology.orchestra.run.smithi117:> 2023-06-10T19:04:02.867 DEBUG:teuthology.orchestra.run.smithi117:> def _find_admin_socket(client_name): 2023-06-10T19:04:02.867 DEBUG:teuthology.orchestra.run.smithi117:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-06-10T19:04:02.868 DEBUG:teuthology.orchestra.run.smithi117:> files = glob.glob(asok_path) 2023-06-10T19:04:02.868 DEBUG:teuthology.orchestra.run.smithi117:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-06-10T19:04:02.868 DEBUG:teuthology.orchestra.run.smithi117:> 2023-06-10T19:04:02.869 DEBUG:teuthology.orchestra.run.smithi117:> # Given a non-glob path, it better be there 2023-06-10T19:04:02.869 DEBUG:teuthology.orchestra.run.smithi117:> if "*" not in asok_path: 2023-06-10T19:04:02.869 DEBUG:teuthology.orchestra.run.smithi117:> assert(len(files) == 1) 2023-06-10T19:04:02.870 DEBUG:teuthology.orchestra.run.smithi117:> return files[0] 2023-06-10T19:04:02.870 DEBUG:teuthology.orchestra.run.smithi117:> 2023-06-10T19:04:02.870 DEBUG:teuthology.orchestra.run.smithi117:> for f in files: 2023-06-10T19:04:02.871 DEBUG:teuthology.orchestra.run.smithi117:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-06-10T19:04:02.871 DEBUG:teuthology.orchestra.run.smithi117:> if os.path.exists("/proc/{0}".format(pid)): 2023-06-10T19:04:02.871 DEBUG:teuthology.orchestra.run.smithi117:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-06-10T19:04:02.872 DEBUG:teuthology.orchestra.run.smithi117:> contents = proc_f.read() 2023-06-10T19:04:02.872 DEBUG:teuthology.orchestra.run.smithi117:> if mountpoint in contents: 2023-06-10T19:04:02.872 DEBUG:teuthology.orchestra.run.smithi117:> return f 2023-06-10T19:04:02.873 DEBUG:teuthology.orchestra.run.smithi117:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-06-10T19:04:02.873 DEBUG:teuthology.orchestra.run.smithi117:> 2023-06-10T19:04:02.873 DEBUG:teuthology.orchestra.run.smithi117:> print(_find_admin_socket("client.1")) 2023-06-10T19:04:02.874 DEBUG:teuthology.orchestra.run.smithi117:> ' 2023-06-10T19:04:02.984 INFO:teuthology.orchestra.run.smithi117.stdout:/var/run/ceph/ceph-client.1.45121.asok 2023-06-10T19:04:03.167 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.45121.asok 2023-06-10T19:04:03.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:04:03.168 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.45121.asok status 2023-06-10T19:04:03.328 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2023-06-10T19:04:03.328 INFO:teuthology.orchestra.run.smithi117.stdout: "metadata": { 2023-06-10T19:04:03.328 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_sha1": "219d315c3a0b2075e570fb1964be2ad33fe7a9c8", 2023-06-10T19:04:03.328 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_version": "ceph version 18.0.0-4359-g219d315c (219d315c3a0b2075e570fb1964be2ad33fe7a9c8) reef (dev)", 2023-06-10T19:04:03.329 INFO:teuthology.orchestra.run.smithi117.stdout: "entity_id": "1", 2023-06-10T19:04:03.329 INFO:teuthology.orchestra.run.smithi117.stdout: "hostname": "smithi117", 2023-06-10T19:04:03.329 INFO:teuthology.orchestra.run.smithi117.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-06-10T19:04:03.329 INFO:teuthology.orchestra.run.smithi117.stdout: "pid": "45121", 2023-06-10T19:04:03.329 INFO:teuthology.orchestra.run.smithi117.stdout: "root": "/" 2023-06-10T19:04:03.329 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-06-10T19:04:03.329 INFO:teuthology.orchestra.run.smithi117.stdout: "dentry_count": 0, 2023-06-10T19:04:03.330 INFO:teuthology.orchestra.run.smithi117.stdout: "dentry_pinned_count": 0, 2023-06-10T19:04:03.330 INFO:teuthology.orchestra.run.smithi117.stdout: "id": 6662, 2023-06-10T19:04:03.330 INFO:teuthology.orchestra.run.smithi117.stdout: "inst": { 2023-06-10T19:04:03.330 INFO:teuthology.orchestra.run.smithi117.stdout: "name": { 2023-06-10T19:04:03.330 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "client", 2023-06-10T19:04:03.330 INFO:teuthology.orchestra.run.smithi117.stdout: "num": 6662 2023-06-10T19:04:03.330 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-06-10T19:04:03.330 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": { 2023-06-10T19:04:03.331 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "v1", 2023-06-10T19:04:03.331 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": "192.168.0.1:0", 2023-06-10T19:04:03.331 INFO:teuthology.orchestra.run.smithi117.stdout: "nonce": 2195391759 2023-06-10T19:04:03.331 INFO:teuthology.orchestra.run.smithi117.stdout: } 2023-06-10T19:04:03.331 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-06-10T19:04:03.331 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": { 2023-06-10T19:04:03.331 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "v1", 2023-06-10T19:04:03.331 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": "192.168.0.1:0", 2023-06-10T19:04:03.332 INFO:teuthology.orchestra.run.smithi117.stdout: "nonce": 2195391759 2023-06-10T19:04:03.332 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-06-10T19:04:03.332 INFO:teuthology.orchestra.run.smithi117.stdout: "inst_str": "client.6662 192.168.0.1:0/2195391759", 2023-06-10T19:04:03.332 INFO:teuthology.orchestra.run.smithi117.stdout: "addr_str": "192.168.0.1:0/2195391759", 2023-06-10T19:04:03.332 INFO:teuthology.orchestra.run.smithi117.stdout: "inode_count": 1, 2023-06-10T19:04:03.332 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_epoch": 61, 2023-06-10T19:04:03.332 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_epoch": 110, 2023-06-10T19:04:03.333 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_epoch_barrier": 0, 2023-06-10T19:04:03.333 INFO:teuthology.orchestra.run.smithi117.stdout: "blocklisted": false, 2023-06-10T19:04:03.333 INFO:teuthology.orchestra.run.smithi117.stdout: "fs_name": "cephfs" 2023-06-10T19:04:03.333 INFO:teuthology.orchestra.run.smithi117.stdout:} 2023-06-10T19:04:03.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:04:03.343 DEBUG:teuthology.orchestra.run.smithi117:> stat --file-system '--printf=%T 2023-06-10T19:04:03.343 DEBUG:teuthology.orchestra.run.smithi117:> ' -- /home/ubuntu/cephtest/mnt.1 2023-06-10T19:04:03.348 INFO:teuthology.orchestra.run.smithi117.stdout:fuseblk 2023-06-10T19:04:03.349 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-06-10T19:04:03.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:04:03.349 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-06-10T19:04:03.402 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config get mds_reconnect_timeout 2023-06-10T19:04:03.549 INFO:teuthology.orchestra.run.smithi053.stdout:{"mds_reconnect_timeout":"45.000000"} 2023-06-10T19:04:03.550 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_reconnect_timeout": "45.000000" } 2023-06-10T19:04:03.550 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config get ms_max_backoff 2023-06-10T19:04:03.688 INFO:teuthology.orchestra.run.smithi053.stdout:{"ms_max_backoff":"15.000000"} 2023-06-10T19:04:03.689 DEBUG:tasks.cephfs.filesystem:_json_asok output { "ms_max_backoff": "15.000000" } 2023-06-10T19:04:03.689 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-06-10T19:04:03.690 DEBUG:teuthology.orchestra.run.smithi053:> import glob 2023-06-10T19:04:03.690 DEBUG:teuthology.orchestra.run.smithi053:> import re 2023-06-10T19:04:03.690 DEBUG:teuthology.orchestra.run.smithi053:> import os 2023-06-10T19:04:03.690 DEBUG:teuthology.orchestra.run.smithi053:> import subprocess 2023-06-10T19:04:03.691 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:04:03.691 DEBUG:teuthology.orchestra.run.smithi053:> def _find_admin_socket(client_name): 2023-06-10T19:04:03.691 DEBUG:teuthology.orchestra.run.smithi053:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-06-10T19:04:03.692 DEBUG:teuthology.orchestra.run.smithi053:> files = glob.glob(asok_path) 2023-06-10T19:04:03.692 DEBUG:teuthology.orchestra.run.smithi053:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-06-10T19:04:03.692 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:04:03.692 DEBUG:teuthology.orchestra.run.smithi053:> # Given a non-glob path, it better be there 2023-06-10T19:04:03.693 DEBUG:teuthology.orchestra.run.smithi053:> if "*" not in asok_path: 2023-06-10T19:04:03.693 DEBUG:teuthology.orchestra.run.smithi053:> assert(len(files) == 1) 2023-06-10T19:04:03.693 DEBUG:teuthology.orchestra.run.smithi053:> return files[0] 2023-06-10T19:04:03.694 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:04:03.694 DEBUG:teuthology.orchestra.run.smithi053:> for f in files: 2023-06-10T19:04:03.694 DEBUG:teuthology.orchestra.run.smithi053:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-06-10T19:04:03.694 DEBUG:teuthology.orchestra.run.smithi053:> if os.path.exists("/proc/{0}".format(pid)): 2023-06-10T19:04:03.695 DEBUG:teuthology.orchestra.run.smithi053:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-06-10T19:04:03.695 DEBUG:teuthology.orchestra.run.smithi053:> contents = proc_f.read() 2023-06-10T19:04:03.695 DEBUG:teuthology.orchestra.run.smithi053:> if mountpoint in contents: 2023-06-10T19:04:03.695 DEBUG:teuthology.orchestra.run.smithi053:> return f 2023-06-10T19:04:03.696 DEBUG:teuthology.orchestra.run.smithi053:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-06-10T19:04:03.696 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:04:03.696 DEBUG:teuthology.orchestra.run.smithi053:> print(_find_admin_socket("client.0")) 2023-06-10T19:04:03.697 DEBUG:teuthology.orchestra.run.smithi053:> ' 2023-06-10T19:04:03.774 INFO:teuthology.orchestra.run.smithi053.stdout:/var/run/ceph/ceph-client.0.61053.asok 2023-06-10T19:04:03.955 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.61053.asok 2023-06-10T19:04:03.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:04:03.956 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.61053.asok mds_sessions 2023-06-10T19:04:04.116 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-06-10T19:04:04.116 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 8886, 2023-06-10T19:04:04.116 INFO:teuthology.orchestra.run.smithi053.stdout: "inst": { 2023-06-10T19:04:04.116 INFO:teuthology.orchestra.run.smithi053.stdout: "name": { 2023-06-10T19:04:04.116 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "client", 2023-06-10T19:04:04.117 INFO:teuthology.orchestra.run.smithi053.stdout: "num": 8886 2023-06-10T19:04:04.117 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:04:04.117 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": { 2023-06-10T19:04:04.117 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2023-06-10T19:04:04.117 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "192.168.0.1:0", 2023-06-10T19:04:04.117 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 3878814772 2023-06-10T19:04:04.117 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:04:04.118 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:04:04.118 INFO:teuthology.orchestra.run.smithi053.stdout: "inst_str": "client.8886 v1:192.168.0.1:0/3878814772", 2023-06-10T19:04:04.118 INFO:teuthology.orchestra.run.smithi053.stdout: "addr_str": "v1:192.168.0.1:0/3878814772", 2023-06-10T19:04:04.118 INFO:teuthology.orchestra.run.smithi053.stdout: "sessions": [ 2023-06-10T19:04:04.118 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:04:04.118 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": 0, 2023-06-10T19:04:04.118 INFO:teuthology.orchestra.run.smithi053.stdout: "addrs": { 2023-06-10T19:04:04.118 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2023-06-10T19:04:04.119 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:04:04.119 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2023-06-10T19:04:04.119 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.53:6834", 2023-06-10T19:04:04.119 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 1149668719 2023-06-10T19:04:04.119 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:04:04.119 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:04:04.119 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2023-06-10T19:04:04.119 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.53:6835", 2023-06-10T19:04:04.120 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 1149668719 2023-06-10T19:04:04.120 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:04:04.120 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2023-06-10T19:04:04.120 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:04:04.120 INFO:teuthology.orchestra.run.smithi053.stdout: "seq": 0, 2023-06-10T19:04:04.120 INFO:teuthology.orchestra.run.smithi053.stdout: "cap_gen": 0, 2023-06-10T19:04:04.120 INFO:teuthology.orchestra.run.smithi053.stdout: "cap_ttl": "2023-06-10T19:05:00.471943+0000", 2023-06-10T19:04:04.121 INFO:teuthology.orchestra.run.smithi053.stdout: "last_cap_renew_request": "2023-06-10T19:04:00.471943+0000", 2023-06-10T19:04:04.121 INFO:teuthology.orchestra.run.smithi053.stdout: "cap_renew_seq": 2, 2023-06-10T19:04:04.121 INFO:teuthology.orchestra.run.smithi053.stdout: "num_caps": 1, 2023-06-10T19:04:04.121 INFO:teuthology.orchestra.run.smithi053.stdout: "state": "open" 2023-06-10T19:04:04.121 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:04:04.121 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2023-06-10T19:04:04.121 INFO:teuthology.orchestra.run.smithi053.stdout: "mdsmap_epoch": 61 2023-06-10T19:04:04.121 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-06-10T19:04:04.130 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 30 2023-06-10T19:04:04.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:04.257+0000 7fc33a580640 1 Processor -- start 2023-06-10T19:04:04.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:04.257+0000 7fc33a580640 1 -- start start 2023-06-10T19:04:04.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:04.257+0000 7fc33a580640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc3340b7e30 0x7fc3340b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:04.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:04.257+0000 7fc33a580640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3340cc7c0 con 0x7fc3340b0b90 2023-06-10T19:04:04.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:04.257+0000 7fc33a580640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3340ccaa0 con 0x7fc33415c090 2023-06-10T19:04:04.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:04.257+0000 7fc33a580640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3340ccd80 con 0x7fc3340b7e30 2023-06-10T19:04:04.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:04.257+0000 7fc338b1d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fc3340b0b90 0x7fc3340d04d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:55752/0 (socket says 172.21.15.53:55752) 2023-06-10T19:04:04.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:04.257+0000 7fc338b1d640 1 -- 172.21.15.53:0/3109860799 learned_addr learned my addr 172.21.15.53:0/3109860799 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:04:04.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:04.257+0000 7fc32bfff640 1 --2- 172.21.15.53:0/3109860799 >> v2:172.21.15.117:3300/0 conn(0x7fc3340b7e30 0x7fc3340b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:04.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:04.257+0000 7fc3337fe640 1 -- 172.21.15.53:0/3109860799 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1298041136 0 0) 0x7fc3340cc7c0 con 0x7fc3340b0b90 2023-06-10T19:04:04.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:04.257+0000 7fc3337fe640 1 -- 172.21.15.53:0/3109860799 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc320003530 con 0x7fc3340b0b90 2023-06-10T19:04:04.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:04.257+0000 7fc32bfff640 1 -- 172.21.15.53:0/3109860799 >> v1:172.21.15.117:6789/0 conn(0x7fc33415c090 legacy=0x7fc3340b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:04.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:04.257+0000 7fc32bfff640 1 -- 172.21.15.53:0/3109860799 >> v1:172.21.15.53:6789/0 conn(0x7fc3340b0b90 legacy=0x7fc3340d04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:04.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:04.257+0000 7fc32bfff640 1 -- 172.21.15.53:0/3109860799 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3340cd060 con 0x7fc3340b7e30 2023-06-10T19:04:04.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:04.261+0000 7fc32bfff640 1 --2- 172.21.15.53:0/3109860799 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3340b7e30 0x7fc3340b10c0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fc31c0097c0 tx=0x7fc31c01c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4528282b8a63d8f server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:04.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:04.261+0000 7fc3337fe640 1 -- 172.21.15.53:0/3109860799 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31c0ab600 con 0x7fc3340b7e30 2023-06-10T19:04:04.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:04.261+0000 7fc3337fe640 1 -- 172.21.15.53:0/3109860799 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc31c0a7050 con 0x7fc3340b7e30 2023-06-10T19:04:04.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:04.261+0000 7fc3337fe640 1 -- 172.21.15.53:0/3109860799 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31c0ab980 con 0x7fc3340b7e30 2023-06-10T19:04:04.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:04.261+0000 7fc33a580640 1 -- 172.21.15.53:0/3109860799 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3340b7e30 msgr2=0x7fc3340b10c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:04.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:04.261+0000 7fc33a580640 1 --2- 172.21.15.53:0/3109860799 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3340b7e30 0x7fc3340b10c0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fc31c0097c0 tx=0x7fc31c01c3c0 comp rx=0 tx=0).stop 2023-06-10T19:04:04.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:04.261+0000 7fc33a580640 1 -- 172.21.15.53:0/3109860799 shutdown_connections 2023-06-10T19:04:04.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:04.261+0000 7fc33a580640 1 --2- 172.21.15.53:0/3109860799 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3340b7e30 0x7fc3340b10c0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:04.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:04.261+0000 7fc33a580640 1 -- 172.21.15.53:0/3109860799 >> 172.21.15.53:0/3109860799 conn(0x7fc334069e20 msgr2=0x7fc33406a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:04:04.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:04.261+0000 7fc33a580640 1 -- 172.21.15.53:0/3109860799 shutdown_connections 2023-06-10T19:04:04.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:04.261+0000 7fc33a580640 1 -- 172.21.15.53:0/3109860799 wait complete. 2023-06-10T19:04:04.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:04.261+0000 7fc33a580640 1 Processor -- start 2023-06-10T19:04:04.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:04.261+0000 7fc33a580640 1 -- start start 2023-06-10T19:04:04.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:04.265+0000 7fc33a580640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3340b0b90 0x7fc334158fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:04.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:04.265+0000 7fc33a580640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3340b7e30 0x7fc3340c49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:04.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:04.265+0000 7fc33a580640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc33415c090 0x7fc334157190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:04.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:04.265+0000 7fc33a580640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3340c4f10 con 0x7fc3340b7e30 2023-06-10T19:04:04.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:04.265+0000 7fc33a580640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc334158b10 con 0x7fc33415c090 2023-06-10T19:04:04.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:04.265+0000 7fc33a580640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc334157f00 con 0x7fc3340b0b90 2023-06-10T19:04:04.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:04.265+0000 7fc32bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3340b7e30 0x7fc3340c49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:04.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:04.265+0000 7fc32bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3340b7e30 0x7fc3340c49d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:32942/0 (socket says 172.21.15.53:32942) 2023-06-10T19:04:04.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:04.265+0000 7fc32bfff640 1 -- 172.21.15.53:0/3647371963 learned_addr learned my addr 172.21.15.53:0/3647371963 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:04:04.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:04.265+0000 7fc333fff640 1 --2- 172.21.15.53:0/3647371963 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3340b0b90 0x7fc334158fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:04.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:04.265+0000 7fc338b1d640 1 --2- 172.21.15.53:0/3647371963 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc33415c090 0x7fc334157190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:04.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:04.265+0000 7fc32bfff640 1 -- 172.21.15.53:0/3647371963 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3340b0b90 msgr2=0x7fc334158fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:04.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:04.265+0000 7fc32bfff640 1 --2- 172.21.15.53:0/3647371963 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3340b0b90 0x7fc334158fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:04.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:04.265+0000 7fc32bfff640 1 -- 172.21.15.53:0/3647371963 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc33415c090 msgr2=0x7fc334157190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:04.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:04.265+0000 7fc32bfff640 1 --2- 172.21.15.53:0/3647371963 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc33415c090 0x7fc334157190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:04.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:04.265+0000 7fc32bfff640 1 -- 172.21.15.53:0/3647371963 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc31c009420 con 0x7fc3340b7e30 2023-06-10T19:04:04.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:04.265+0000 7fc333fff640 1 --2- 172.21.15.53:0/3647371963 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3340b0b90 0x7fc334158fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:04:04.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:04.265+0000 7fc338b1d640 1 --2- 172.21.15.53:0/3647371963 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc33415c090 0x7fc334157190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:04:04.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:04.265+0000 7fc32bfff640 1 --2- 172.21.15.53:0/3647371963 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3340b7e30 0x7fc3340c49d0 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7fc31c0ae040 tx=0x7fc31c019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:04.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:04.265+0000 7fc3317fa640 1 -- 172.21.15.53:0/3647371963 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31c0b4430 con 0x7fc3340b7e30 2023-06-10T19:04:04.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:04.265+0000 7fc3317fa640 1 -- 172.21.15.53:0/3647371963 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc31c0b4590 con 0x7fc3340b7e30 2023-06-10T19:04:04.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:04.265+0000 7fc33a580640 1 -- 172.21.15.53:0/3647371963 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3341581e0 con 0x7fc3340b7e30 2023-06-10T19:04:04.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:04.265+0000 7fc3317fa640 1 -- 172.21.15.53:0/3647371963 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31c0b4940 con 0x7fc3340b7e30 2023-06-10T19:04:04.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:04.265+0000 7fc33a580640 1 -- 172.21.15.53:0/3647371963 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3341587a0 con 0x7fc3340b7e30 2023-06-10T19:04:04.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:04.265+0000 7fc33a580640 1 -- 172.21.15.53:0/3647371963 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc33404d790 con 0x7fc3340b7e30 2023-06-10T19:04:04.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:04.265+0000 7fc3317fa640 1 -- 172.21.15.53:0/3647371963 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc31c0b2040 con 0x7fc3340b7e30 2023-06-10T19:04:04.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:04.265+0000 7fc3317fa640 1 --2- 172.21.15.53:0/3647371963 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc3140662b0 0x7fc314068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:04.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:04.265+0000 7fc3317fa640 1 -- 172.21.15.53:0/3647371963 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc31c11dc00 con 0x7fc3340b7e30 2023-06-10T19:04:04.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:04.265+0000 7fc333fff640 1 --2- 172.21.15.53:0/3647371963 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc3140662b0 0x7fc314068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:04.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:04.269+0000 7fc333fff640 1 --2- 172.21.15.53:0/3647371963 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc3140662b0 0x7fc314068760 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fc324000f70 tx=0x7fc324009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:04.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:04.269+0000 7fc3317fa640 1 -- 172.21.15.53:0/3647371963 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc31c124080 con 0x7fc3340b7e30 2023-06-10T19:04:04.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:04.465+0000 7fc33a580640 1 -- 172.21.15.53:0/3647371963 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "30"} v 0) v1 -- 0x7fc3340b7ab0 con 0x7fc3340b7e30 2023-06-10T19:04:05.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:05.109+0000 7fc3317fa640 1 -- 172.21.15.53:0/3647371963 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "30"}]=0 v62) v1 ==== 114+0+0 (secure 0 0 0) 0x7fc31c0eb090 con 0x7fc3340b7e30 2023-06-10T19:04:05.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:05.113+0000 7fc33a580640 1 -- 172.21.15.53:0/3647371963 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc3140662b0 msgr2=0x7fc314068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:05.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:05.113+0000 7fc33a580640 1 --2- 172.21.15.53:0/3647371963 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc3140662b0 0x7fc314068760 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fc324000f70 tx=0x7fc324009040 comp rx=0 tx=0).stop 2023-06-10T19:04:05.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:05.113+0000 7fc33a580640 1 -- 172.21.15.53:0/3647371963 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3340b7e30 msgr2=0x7fc3340c49d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:05.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:05.113+0000 7fc33a580640 1 --2- 172.21.15.53:0/3647371963 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3340b7e30 0x7fc3340c49d0 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7fc31c0ae040 tx=0x7fc31c019160 comp rx=0 tx=0).stop 2023-06-10T19:04:05.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:05.113+0000 7fc33a580640 1 -- 172.21.15.53:0/3647371963 shutdown_connections 2023-06-10T19:04:05.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:05.113+0000 7fc33a580640 1 --2- 172.21.15.53:0/3647371963 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc3140662b0 0x7fc314068760 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:05.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:05.113+0000 7fc33a580640 1 --2- 172.21.15.53:0/3647371963 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc33415c090 0x7fc334157190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:05.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:05.113+0000 7fc33a580640 1 --2- 172.21.15.53:0/3647371963 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3340b7e30 0x7fc3340c49d0 unknown :-1 s=CLOSED pgs=1757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:05.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:05.113+0000 7fc33a580640 1 --2- 172.21.15.53:0/3647371963 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3340b0b90 0x7fc334158fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:05.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:05.113+0000 7fc33a580640 1 -- 172.21.15.53:0/3647371963 >> 172.21.15.53:0/3647371963 conn(0x7fc334069e20 msgr2=0x7fc3341568f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:04:05.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:05.113+0000 7fc33a580640 1 -- 172.21.15.53:0/3647371963 shutdown_connections 2023-06-10T19:04:05.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:05.113+0000 7fc33a580640 1 -- 172.21.15.53:0/3647371963 wait complete. 2023-06-10T19:04:05.137 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_autoclose 50 2023-06-10T19:04:05.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:05.269+0000 7fa7b13ac640 1 Processor -- start 2023-06-10T19:04:05.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:05.269+0000 7fa7b13ac640 1 -- start start 2023-06-10T19:04:05.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:05.269+0000 7fa7b13ac640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa7ac06b780 0x7fa7ac15c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:05.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:05.269+0000 7fa7b13ac640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7ac06bb50 0x7fa7ac15f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:05.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:05.269+0000 7fa7b13ac640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7ac0af530 con 0x7fa7ac15f860 2023-06-10T19:04:05.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:05.269+0000 7fa7b13ac640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7ac15c3d0 con 0x7fa7ac06b780 2023-06-10T19:04:05.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:05.269+0000 7fa7b13ac640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ac15fd70 con 0x7fa7ac06bb50 2023-06-10T19:04:05.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:05.269+0000 7fa7aa7fc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7ac06bb50 0x7fa7ac15f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:05.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:05.269+0000 7fa7aaffd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa7ac06b780 0x7fa7ac15c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:05.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:05.269+0000 7fa7aa7fc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7ac06bb50 0x7fa7ac15f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.53:46320/0 (socket says 172.21.15.53:46320) 2023-06-10T19:04:05.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:05.269+0000 7fa7aaffd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa7ac06b780 0x7fa7ac15c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.53:34068/0 (socket says 172.21.15.53:34068) 2023-06-10T19:04:05.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:05.269+0000 7fa7aa7fc640 1 -- 172.21.15.53:0/2019331662 learned_addr learned my addr 172.21.15.53:0/2019331662 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:04:05.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:05.269+0000 7fa7aa7fc640 1 -- 172.21.15.53:0/2019331662 >> v2:172.21.15.117:3300/0 conn(0x7fa7ac06b780 msgr2=0x7fa7ac15c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:04:05.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:05.269+0000 7fa7aa7fc640 1 --2- 172.21.15.53:0/2019331662 >> v2:172.21.15.117:3300/0 conn(0x7fa7ac06b780 0x7fa7ac15c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:05.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:05.269+0000 7fa7aa7fc640 1 -- 172.21.15.53:0/2019331662 >> v1:172.21.15.117:6789/0 conn(0x7fa7ac15f860 legacy=0x7fa7ac0ceb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:05.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:05.269+0000 7fa7aa7fc640 1 -- 172.21.15.53:0/2019331662 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7ac160050 con 0x7fa7ac06bb50 2023-06-10T19:04:05.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:05.273+0000 7fa7aa7fc640 1 --2- 172.21.15.53:0/2019331662 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7ac06bb50 0x7fa7ac15f320 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa794009e50 tx=0x7fa79401c980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=287990fe6856d1e2 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:05.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:05.273+0000 7fa7a9ffb640 1 -- 172.21.15.53:0/2019331662 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7940a5770 con 0x7fa7ac06bb50 2023-06-10T19:04:05.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:05.273+0000 7fa7a9ffb640 1 -- 172.21.15.53:0/2019331662 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7940a58d0 con 0x7fa7ac06bb50 2023-06-10T19:04:05.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:05.273+0000 7fa7a9ffb640 1 -- 172.21.15.53:0/2019331662 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7940a5c60 con 0x7fa7ac06bb50 2023-06-10T19:04:05.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:05.273+0000 7fa7b13ac640 1 -- 172.21.15.53:0/2019331662 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7ac06bb50 msgr2=0x7fa7ac15f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:05.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:05.273+0000 7fa7b13ac640 1 --2- 172.21.15.53:0/2019331662 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7ac06bb50 0x7fa7ac15f320 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa794009e50 tx=0x7fa79401c980 comp rx=0 tx=0).stop 2023-06-10T19:04:05.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:05.273+0000 7fa7b13ac640 1 -- 172.21.15.53:0/2019331662 shutdown_connections 2023-06-10T19:04:05.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:05.273+0000 7fa7b13ac640 1 --2- 172.21.15.53:0/2019331662 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7ac06bb50 0x7fa7ac15f320 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:05.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:05.273+0000 7fa7b13ac640 1 --2- 172.21.15.53:0/2019331662 >> v2:172.21.15.117:3300/0 conn(0x7fa7ac06b780 0x7fa7ac15c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:05.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:05.273+0000 7fa7b13ac640 1 -- 172.21.15.53:0/2019331662 >> 172.21.15.53:0/2019331662 conn(0x7fa7ac06a090 msgr2=0x7fa7ac06d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:04:05.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:05.273+0000 7fa7b13ac640 1 -- 172.21.15.53:0/2019331662 shutdown_connections 2023-06-10T19:04:05.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:05.273+0000 7fa7b13ac640 1 -- 172.21.15.53:0/2019331662 wait complete. 2023-06-10T19:04:05.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:05.277+0000 7fa7b13ac640 1 Processor -- start 2023-06-10T19:04:05.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:05.277+0000 7fa7b13ac640 1 -- start start 2023-06-10T19:04:05.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:05.277+0000 7fa7b13ac640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7ac06b780 0x7fa7ac152290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:05.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:05.277+0000 7fa7b13ac640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7ac06bb50 0x7fa7ac0cb730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:05.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:05.277+0000 7fa7b13ac640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa7ac15f860 0x7fa7ac0cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:05.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:05.277+0000 7fa7b13ac640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ac0ca7d0 con 0x7fa7ac06b780 2023-06-10T19:04:05.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:05.277+0000 7fa7b13ac640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ac154290 con 0x7fa7ac15f860 2023-06-10T19:04:05.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:05.277+0000 7fa7b13ac640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ac1527d0 con 0x7fa7ac06bb50 2023-06-10T19:04:05.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:05.277+0000 7fa7aaffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7ac06b780 0x7fa7ac152290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:05.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:05.277+0000 7fa7aaffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7ac06b780 0x7fa7ac152290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:32948/0 (socket says 172.21.15.53:32948) 2023-06-10T19:04:05.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:05.277+0000 7fa7aaffd640 1 -- 172.21.15.53:0/1134061889 learned_addr learned my addr 172.21.15.53:0/1134061889 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:04:05.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:05.277+0000 7fa7ab7fe640 1 --2- 172.21.15.53:0/1134061889 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa7ac15f860 0x7fa7ac0cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:05.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:05.277+0000 7fa7aa7fc640 1 --2- 172.21.15.53:0/1134061889 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7ac06bb50 0x7fa7ac0cb730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:05.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:05.277+0000 7fa7aaffd640 1 -- 172.21.15.53:0/1134061889 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7ac06bb50 msgr2=0x7fa7ac0cb730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:05.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:05.277+0000 7fa7aaffd640 1 --2- 172.21.15.53:0/1134061889 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7ac06bb50 0x7fa7ac0cb730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:05.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:05.277+0000 7fa7aaffd640 1 -- 172.21.15.53:0/1134061889 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa7ac15f860 msgr2=0x7fa7ac0cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:05.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:05.277+0000 7fa7aaffd640 1 --2- 172.21.15.53:0/1134061889 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa7ac15f860 0x7fa7ac0cabf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:05.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:05.277+0000 7fa7aaffd640 1 -- 172.21.15.53:0/1134061889 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa794009b30 con 0x7fa7ac06b780 2023-06-10T19:04:05.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:05.277+0000 7fa7aaffd640 1 --2- 172.21.15.53:0/1134061889 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7ac06b780 0x7fa7ac152290 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7fa79c00e870 tx=0x7fa79c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:05.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:05.277+0000 7fa7a37fe640 1 -- 172.21.15.53:0/1134061889 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79c009510 con 0x7fa7ac06b780 2023-06-10T19:04:05.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:05.277+0000 7fa7a37fe640 1 -- 172.21.15.53:0/1134061889 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa79c00eec0 con 0x7fa7ac06b780 2023-06-10T19:04:05.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:05.277+0000 7fa7a37fe640 1 -- 172.21.15.53:0/1134061889 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79c00cb40 con 0x7fa7ac06b780 2023-06-10T19:04:05.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:05.277+0000 7fa7b13ac640 1 -- 172.21.15.53:0/1134061889 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7ac06c120 con 0x7fa7ac06b780 2023-06-10T19:04:05.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:05.277+0000 7fa7b13ac640 1 -- 172.21.15.53:0/1134061889 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7ac0ca480 con 0x7fa7ac06b780 2023-06-10T19:04:05.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:05.277+0000 7fa7b13ac640 1 -- 172.21.15.53:0/1134061889 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7ac04d790 con 0x7fa7ac06b780 2023-06-10T19:04:05.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:05.281+0000 7fa7a37fe640 1 -- 172.21.15.53:0/1134061889 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa79c00cca0 con 0x7fa7ac06b780 2023-06-10T19:04:05.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:05.281+0000 7fa7a37fe640 1 --2- 172.21.15.53:0/1134061889 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa790066280 0x7fa790068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:05.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:05.281+0000 7fa7a37fe640 1 -- 172.21.15.53:0/1134061889 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa79c083d40 con 0x7fa7ac06b780 2023-06-10T19:04:05.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:05.281+0000 7fa7aa7fc640 1 --2- 172.21.15.53:0/1134061889 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa790066280 0x7fa790068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:05.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:05.281+0000 7fa7aa7fc640 1 --2- 172.21.15.53:0/1134061889 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa790066280 0x7fa790068730 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fa7940ae000 tx=0x7fa794004ac0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:05.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:05.285+0000 7fa7a37fe640 1 -- 172.21.15.53:0/1134061889 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa79c051300 con 0x7fa7ac06b780 2023-06-10T19:04:05.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:05.473+0000 7fa7b13ac640 1 -- 172.21.15.53:0/1134061889 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_autoclose", "val": "50"} v 0) v1 -- 0x7fa7ac166490 con 0x7fa7ac06b780 2023-06-10T19:04:06.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.121+0000 7fa7a37fe640 1 -- 172.21.15.53:0/1134061889 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_autoclose", "val": "50"}]=0 v63) v1 ==== 116+0+0 (secure 0 0 0) 0x7fa79c0170b0 con 0x7fa7ac06b780 2023-06-10T19:04:06.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.125+0000 7fa7b13ac640 1 -- 172.21.15.53:0/1134061889 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa790066280 msgr2=0x7fa790068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:06.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.125+0000 7fa7b13ac640 1 --2- 172.21.15.53:0/1134061889 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa790066280 0x7fa790068730 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fa7940ae000 tx=0x7fa794004ac0 comp rx=0 tx=0).stop 2023-06-10T19:04:06.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.125+0000 7fa7b13ac640 1 -- 172.21.15.53:0/1134061889 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7ac06b780 msgr2=0x7fa7ac152290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:06.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.125+0000 7fa7b13ac640 1 --2- 172.21.15.53:0/1134061889 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7ac06b780 0x7fa7ac152290 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7fa79c00e870 tx=0x7fa79c00ec70 comp rx=0 tx=0).stop 2023-06-10T19:04:06.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.125+0000 7fa7b13ac640 1 -- 172.21.15.53:0/1134061889 shutdown_connections 2023-06-10T19:04:06.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.125+0000 7fa7b13ac640 1 --2- 172.21.15.53:0/1134061889 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa790066280 0x7fa790068730 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:06.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.125+0000 7fa7b13ac640 1 --2- 172.21.15.53:0/1134061889 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa7ac15f860 0x7fa7ac0cabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:06.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.125+0000 7fa7b13ac640 1 --2- 172.21.15.53:0/1134061889 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7ac06bb50 0x7fa7ac0cb730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:06.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.125+0000 7fa7b13ac640 1 --2- 172.21.15.53:0/1134061889 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7ac06b780 0x7fa7ac152290 unknown :-1 s=CLOSED pgs=1758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:06.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.125+0000 7fa7b13ac640 1 -- 172.21.15.53:0/1134061889 >> 172.21.15.53:0/1134061889 conn(0x7fa7ac06a090 msgr2=0x7fa7ac0afd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:04:06.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.125+0000 7fa7b13ac640 1 -- 172.21.15.53:0/1134061889 shutdown_connections 2023-06-10T19:04:06.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.125+0000 7fa7b13ac640 1 -- 172.21.15.53:0/1134061889 wait complete. 2023-06-10T19:04:06.148 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:04:06.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.273+0000 7ff5092bb640 1 Processor -- start 2023-06-10T19:04:06.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.273+0000 7ff5092bb640 1 -- start start 2023-06-10T19:04:06.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.273+0000 7ff5092bb640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff50415c7f0 0x7ff50415f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:06.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.273+0000 7ff5092bb640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff50415f860 0x7ff5040ceb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:06.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.273+0000 7ff5092bb640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff50415cc40 con 0x7ff50406b780 2023-06-10T19:04:06.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.273+0000 7ff5092bb640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff50415c3d0 con 0x7ff50415f860 2023-06-10T19:04:06.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.273+0000 7ff5092bb640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5040af530 con 0x7ff50415c7f0 2023-06-10T19:04:06.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.273+0000 7ff502ffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ff50406b780 0x7ff50406bb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:55756/0 (socket says 172.21.15.53:55756) 2023-06-10T19:04:06.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.273+0000 7ff502ffd640 1 -- 172.21.15.53:0/1481834225 learned_addr learned my addr 172.21.15.53:0/1481834225 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:04:06.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.273+0000 7ff5037fe640 1 --2- 172.21.15.53:0/1481834225 >> v2:172.21.15.53:3300/0 conn(0x7ff50415f860 0x7ff5040ceb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:06.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.273+0000 7ff4fbfff640 1 --2- 172.21.15.53:0/1481834225 >> v2:172.21.15.117:3300/0 conn(0x7ff50415c7f0 0x7ff50415f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:06.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.273+0000 7ff5037fe640 1 -- 172.21.15.53:0/1481834225 >> v2:172.21.15.117:3300/0 conn(0x7ff50415c7f0 msgr2=0x7ff50415f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:04:06.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.273+0000 7ff5037fe640 1 --2- 172.21.15.53:0/1481834225 >> v2:172.21.15.117:3300/0 conn(0x7ff50415c7f0 0x7ff50415f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:06.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.273+0000 7ff5037fe640 1 -- 172.21.15.53:0/1481834225 >> v1:172.21.15.53:6789/0 conn(0x7ff50406b780 legacy=0x7ff50406bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:06.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.273+0000 7ff5037fe640 1 -- 172.21.15.53:0/1481834225 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff50415fd70 con 0x7ff50415f860 2023-06-10T19:04:06.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.277+0000 7ff5037fe640 1 --2- 172.21.15.53:0/1481834225 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff50415f860 0x7ff5040ceb20 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7ff5040cdad0 tx=0x7ff4fc01c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a4078c5b471aee server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:06.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.277+0000 7ff5027fc640 1 -- 172.21.15.53:0/1481834225 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4fc0a5940 con 0x7ff50415f860 2023-06-10T19:04:06.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.277+0000 7ff5027fc640 1 -- 172.21.15.53:0/1481834225 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4fc0a5aa0 con 0x7ff50415f860 2023-06-10T19:04:06.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.277+0000 7ff5027fc640 1 -- 172.21.15.53:0/1481834225 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4fc0a5e30 con 0x7ff50415f860 2023-06-10T19:04:06.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.277+0000 7ff5092bb640 1 -- 172.21.15.53:0/1481834225 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff50415f860 msgr2=0x7ff5040ceb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:06.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.277+0000 7ff5092bb640 1 --2- 172.21.15.53:0/1481834225 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff50415f860 0x7ff5040ceb20 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7ff5040cdad0 tx=0x7ff4fc01c880 comp rx=0 tx=0).stop 2023-06-10T19:04:06.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.277+0000 7ff5092bb640 1 -- 172.21.15.53:0/1481834225 shutdown_connections 2023-06-10T19:04:06.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.277+0000 7ff5092bb640 1 --2- 172.21.15.53:0/1481834225 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff50415f860 0x7ff5040ceb20 unknown :-1 s=CLOSED pgs=1760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:06.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.277+0000 7ff5092bb640 1 --2- 172.21.15.53:0/1481834225 >> v2:172.21.15.117:3300/0 conn(0x7ff50415c7f0 0x7ff50415f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:06.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.277+0000 7ff5092bb640 1 -- 172.21.15.53:0/1481834225 >> 172.21.15.53:0/1481834225 conn(0x7ff50406a090 msgr2=0x7ff50406d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:04:06.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.277+0000 7ff5092bb640 1 -- 172.21.15.53:0/1481834225 shutdown_connections 2023-06-10T19:04:06.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.277+0000 7ff5092bb640 1 -- 172.21.15.53:0/1481834225 wait complete. 2023-06-10T19:04:06.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.277+0000 7ff5092bb640 1 Processor -- start 2023-06-10T19:04:06.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.277+0000 7ff5092bb640 1 -- start start 2023-06-10T19:04:06.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.281+0000 7ff5092bb640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff50406b780 0x7ff504152af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:06.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.281+0000 7ff5092bb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff50415c7f0 0x7ff50415e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:06.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.281+0000 7ff5092bb640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff50415f860 0x7ff50415e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:06.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.281+0000 7ff5092bb640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff504153030 con 0x7ff50415c7f0 2023-06-10T19:04:06.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.281+0000 7ff5092bb640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5041412c0 con 0x7ff50415f860 2023-06-10T19:04:06.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.281+0000 7ff5092bb640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5041415a0 con 0x7ff50406b780 2023-06-10T19:04:06.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.281+0000 7ff4fbfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff50415c7f0 0x7ff50415e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:06.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.281+0000 7ff4fbfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff50415c7f0 0x7ff50415e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:32954/0 (socket says 172.21.15.53:32954) 2023-06-10T19:04:06.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.281+0000 7ff4fbfff640 1 -- 172.21.15.53:0/424950882 learned_addr learned my addr 172.21.15.53:0/424950882 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:04:06.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.281+0000 7ff502ffd640 1 --2- 172.21.15.53:0/424950882 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff50406b780 0x7ff504152af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:06.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.281+0000 7ff5037fe640 1 --2- 172.21.15.53:0/424950882 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff50415f860 0x7ff50415e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:06.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.281+0000 7ff4fbfff640 1 -- 172.21.15.53:0/424950882 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff50406b780 msgr2=0x7ff504152af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:06.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.281+0000 7ff4fbfff640 1 --2- 172.21.15.53:0/424950882 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff50406b780 0x7ff504152af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:06.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.281+0000 7ff4fbfff640 1 -- 172.21.15.53:0/424950882 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff50415f860 msgr2=0x7ff50415e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:06.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.281+0000 7ff4fbfff640 1 --2- 172.21.15.53:0/424950882 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff50415f860 0x7ff50415e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:06.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.281+0000 7ff4fbfff640 1 -- 172.21.15.53:0/424950882 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4fc009a70 con 0x7ff50415c7f0 2023-06-10T19:04:06.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.281+0000 7ff4fbfff640 1 --2- 172.21.15.53:0/424950882 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff50415c7f0 0x7ff50415e000 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec00d5f0 tx=0x7ff4ec00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:06.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.281+0000 7ff4fb7fe640 1 -- 172.21.15.53:0/424950882 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ec0125f0 con 0x7ff50415c7f0 2023-06-10T19:04:06.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.281+0000 7ff4fb7fe640 1 -- 172.21.15.53:0/424950882 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4ec012750 con 0x7ff50415c7f0 2023-06-10T19:04:06.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.281+0000 7ff5092bb640 1 -- 172.21.15.53:0/424950882 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff504141880 con 0x7ff50415c7f0 2023-06-10T19:04:06.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.281+0000 7ff4fb7fe640 1 -- 172.21.15.53:0/424950882 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ec012ae0 con 0x7ff50415c7f0 2023-06-10T19:04:06.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.281+0000 7ff5092bb640 1 -- 172.21.15.53:0/424950882 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff504141e40 con 0x7ff50415c7f0 2023-06-10T19:04:06.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.281+0000 7ff5092bb640 1 -- 172.21.15.53:0/424950882 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff504142000 con 0x7ff50415c7f0 2023-06-10T19:04:06.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.281+0000 7ff4fb7fe640 1 -- 172.21.15.53:0/424950882 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff4ec012c40 con 0x7ff50415c7f0 2023-06-10T19:04:06.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.281+0000 7ff4fb7fe640 1 --2- 172.21.15.53:0/424950882 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff4e4066280 0x7ff4e4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:06.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.281+0000 7ff4fb7fe640 1 -- 172.21.15.53:0/424950882 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff4ec084290 con 0x7ff50415c7f0 2023-06-10T19:04:06.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.281+0000 7ff502ffd640 1 --2- 172.21.15.53:0/424950882 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff4e4066280 0x7ff4e4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:06.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.285+0000 7ff502ffd640 1 --2- 172.21.15.53:0/424950882 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff4e4066280 0x7ff4e4068730 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7ff4f4005890 tx=0x7ff4f4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:06.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.285+0000 7ff4fb7fe640 1 -- 172.21.15.53:0/424950882 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff4ec051670 con 0x7ff50415c7f0 2023-06-10T19:04:06.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.481+0000 7ff5092bb640 1 -- 172.21.15.53:0/424950882 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff50404d790 con 0x7ff50415c7f0 2023-06-10T19:04:06.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.481+0000 7ff4fb7fe640 1 -- 172.21.15.53:0/424950882 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4672 (secure 0 0 0) 0x7ff4ec007380 con 0x7ff50415c7f0 2023-06-10T19:04:06.486 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:04:06.486 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":63,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6542,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/3258793373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3258793373},{"type":"v1","addr":"172.21.15.117:6836","nonce":3258793373}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":7363,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/585135979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":585135979},{"type":"v1","addr":"172.21.15.117:6837","nonce":585135979}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":8682,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/448704478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":448704478},{"type":"v1","addr":"172.21.15.53:6833","nonce":448704478}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:03:48.420425+0000","modified":"2023-06-10T19:04:06.109236+0000","tableserver":0,"root":0,"session_timeout":30,"session_autoclose":50,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8685},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8685":{"gid":8685,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/1149668719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":1149668719},{"type":"v1","addr":"172.21.15.53:6835","nonce":1149668719}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-06-10T19:04:06.487 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 63 2023-06-10T19:04:06.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.485+0000 7ff5092bb640 1 -- 172.21.15.53:0/424950882 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff4e4066280 msgr2=0x7ff4e4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:06.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.485+0000 7ff5092bb640 1 --2- 172.21.15.53:0/424950882 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff4e4066280 0x7ff4e4068730 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7ff4f4005890 tx=0x7ff4f4009040 comp rx=0 tx=0).stop 2023-06-10T19:04:06.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.485+0000 7ff5092bb640 1 -- 172.21.15.53:0/424950882 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff50415c7f0 msgr2=0x7ff50415e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:06.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.485+0000 7ff5092bb640 1 --2- 172.21.15.53:0/424950882 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff50415c7f0 0x7ff50415e000 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec00d5f0 tx=0x7ff4ec00dab0 comp rx=0 tx=0).stop 2023-06-10T19:04:06.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.485+0000 7ff5092bb640 1 -- 172.21.15.53:0/424950882 shutdown_connections 2023-06-10T19:04:06.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.485+0000 7ff5092bb640 1 --2- 172.21.15.53:0/424950882 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff4e4066280 0x7ff4e4068730 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:06.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.485+0000 7ff5092bb640 1 --2- 172.21.15.53:0/424950882 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff50415f860 0x7ff50415e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:06.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.485+0000 7ff5092bb640 1 --2- 172.21.15.53:0/424950882 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff50415c7f0 0x7ff50415e000 unknown :-1 s=CLOSED pgs=1761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:06.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.485+0000 7ff5092bb640 1 --2- 172.21.15.53:0/424950882 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff50406b780 0x7ff504152af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:06.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.485+0000 7ff5092bb640 1 -- 172.21.15.53:0/424950882 >> 172.21.15.53:0/424950882 conn(0x7ff50406a090 msgr2=0x7ff5040aeb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:04:06.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.485+0000 7ff5092bb640 1 -- 172.21.15.53:0/424950882 shutdown_connections 2023-06-10T19:04:06.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:06.485+0000 7ff5092bb640 1 -- 172.21.15.53:0/424950882 wait complete. 2023-06-10T19:04:06.506 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2023-06-10T19:04:06.637 INFO:teuthology.orchestra.run.smithi053.stdout:[{"id":6662,"entity":{"name":{"type":"client","num":6662},"addr":{"type":"any","addr":"192.168.0.1:0","nonce":2195391759}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":0,"uptime":4.9839176849999998,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":0.98855988831689512,"halflife":300},"cap_acquisition":{"value":0,"halflife":10},"last_trim_completed_requests_tid":1,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.6662 192.168.0.1:0/2195391759","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x00000000000fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"219d315c3a0b2075e570fb1964be2ad33fe7a9c8","ceph_version":"ceph version 18.0.0-4359-g219d315c (219d315c3a0b2075e570fb1964be2ad33fe7a9c8) reef (dev)","entity_id":"1","hostname":"smithi117","mount_point":"/home/ubuntu/cephtest/mnt.1","pid":"45121","root":"/"}},{"id":8886,"entity":{"name":{"type":"client","num":8886},"addr":{"type":"any","addr":"192.168.0.1:0","nonce":3878814772}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":1,"uptime":7.1518816899999997,"requests_in_flight":0,"num_completed_requests":1,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":0.98362051321118815,"halflife":300},"cap_acquisition":{"value":0,"halflife":10},"last_trim_completed_requests_tid":2,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.8886 192.168.0.1:0/3878814772","completed_requests":[{"tid":2,"created_ino":"0x0"}],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x00000000000fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"219d315c3a0b2075e570fb1964be2ad33fe7a9c8","ceph_version":"ceph version 18.0.0-4359-g219d315c (219d315c3a0b2075e570fb1964be2ad33fe7a9c8) reef (dev)","entity_id":"0","hostname":"smithi053","mount_point":"/home/ubuntu/cephtest/mnt.0","pid":"61053","root":"/"}}] 2023-06-10T19:04:06.638 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 10, "value": 0 }, "client_metadata": { "ceph_sha1": "219d315c3a0b2075e570fb1964be2ad33fe7a9c8", "ceph_version": "ceph version 18.0.0-4359-g219d315c (219d315c3a0b2075e570fb1964be2ad33fe7a9c8) reef (dev)", "client_features": { "feature_bits": "0x00000000000fffff" }, "entity_id": "1", "hostname": "smithi117", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "mount_point": "/home/ubuntu/cephtest/mnt.1", "pid": "45121", "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 2195391759, "type": "any" }, "name": { "num": 6662, "type": "client" } }, "id": 6662, "inst": "client.6662 192.168.0.1:0/2195391759", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 1, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 0, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 0.9885598883168951 }, "state": "open", "uptime": 4.983917685 }, { "cap_acquisition": { "halflife": 10, "value": 0 }, "client_metadata": { "ceph_sha1": "219d315c3a0b2075e570fb1964be2ad33fe7a9c8", "ceph_version": "ceph version 18.0.0-4359-g219d315c (219d315c3a0b2075e570fb1964be2ad33fe7a9c8) reef (dev)", "client_features": { "feature_bits": "0x00000000000fffff" }, "entity_id": "0", "hostname": "smithi053", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "mount_point": "/home/ubuntu/cephtest/mnt.0", "pid": "61053", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 2 } ], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 3878814772, "type": "any" }, "name": { "num": 8886, "type": "client" } }, "id": 8886, "inst": "client.8886 192.168.0.1:0/3878814772", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 2, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 1, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 1, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 0.9836205132111882 }, "state": "open", "uptime": 7.15188169 } ] 2023-06-10T19:04:06.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:04:06.639 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir dir) 2023-06-10T19:04:06.653 DEBUG:teuthology.orchestra.run.smithi053:> sudo kill -sigstop 61053 2023-06-10T19:04:07.918 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-10T19:04:07.921 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-10T19:04:37.964 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-10T19:04:37.968 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-10T19:04:38.718 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:04:38.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:38.844+0000 7fd37f892640 1 Processor -- start 2023-06-10T19:04:38.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:38.844+0000 7fd37f892640 1 -- start start 2023-06-10T19:04:38.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:38.848+0000 7fd37f892640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd3780c9840 0x7fd3780c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:38.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:38.848+0000 7fd37f892640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd378071060 0x7fd3780af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:38.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:38.848+0000 7fd37f892640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd3780afc60 0x7fd37815d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:38.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:38.848+0000 7fd37f892640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd378159b50 con 0x7fd3780c9840 2023-06-10T19:04:38.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:38.848+0000 7fd37f892640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3780ca150 con 0x7fd3780afc60 2023-06-10T19:04:38.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:38.848+0000 7fd37f892640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3780702a0 con 0x7fd378071060 2023-06-10T19:04:38.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:38.848+0000 7fd37d62e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd3780c9840 0x7fd3780c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:38.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:38.848+0000 7fd37d62e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd3780c9840 0x7fd3780c9c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38066/0 (socket says 172.21.15.53:38066) 2023-06-10T19:04:38.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:38.848+0000 7fd37d62e640 1 -- 172.21.15.53:0/2813159196 learned_addr learned my addr 172.21.15.53:0/2813159196 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:04:38.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:38.848+0000 7fd37ce2d640 1 --2- 172.21.15.53:0/2813159196 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd378071060 0x7fd3780af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:38.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:38.848+0000 7fd37de2f640 1 --2- 172.21.15.53:0/2813159196 >> v2:172.21.15.117:3300/0 conn(0x7fd3780afc60 0x7fd37815d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:38.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:38.848+0000 7fd37d62e640 1 -- 172.21.15.53:0/2813159196 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd378071060 msgr2=0x7fd3780af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:04:38.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:38.848+0000 7fd37d62e640 1 --2- 172.21.15.53:0/2813159196 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd378071060 0x7fd3780af720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:38.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:38.848+0000 7fd37d62e640 1 -- 172.21.15.53:0/2813159196 >> v2:172.21.15.117:3300/0 conn(0x7fd3780afc60 msgr2=0x7fd37815d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:04:38.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:38.848+0000 7fd37d62e640 1 --2- 172.21.15.53:0/2813159196 >> v2:172.21.15.117:3300/0 conn(0x7fd3780afc60 0x7fd37815d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:38.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:38.848+0000 7fd37d62e640 1 -- 172.21.15.53:0/2813159196 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd378070580 con 0x7fd3780c9840 2023-06-10T19:04:38.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:38.852+0000 7fd37d62e640 1 --2- 172.21.15.53:0/2813159196 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3780c9840 0x7fd3780c9c10 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7fd37806ef50 tx=0x7fd37401c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f6795cc559abd8b server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:38.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:38.852+0000 7fd36ffff640 1 -- 172.21.15.53:0/2813159196 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3740ab600 con 0x7fd3780c9840 2023-06-10T19:04:38.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:38.852+0000 7fd36ffff640 1 -- 172.21.15.53:0/2813159196 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3740a7050 con 0x7fd3780c9840 2023-06-10T19:04:38.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:38.852+0000 7fd36ffff640 1 -- 172.21.15.53:0/2813159196 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3740ab980 con 0x7fd3780c9840 2023-06-10T19:04:38.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:38.852+0000 7fd37f892640 1 -- 172.21.15.53:0/2813159196 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3780c9840 msgr2=0x7fd3780c9c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:38.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:38.852+0000 7fd37f892640 1 --2- 172.21.15.53:0/2813159196 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3780c9840 0x7fd3780c9c10 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7fd37806ef50 tx=0x7fd37401c210 comp rx=0 tx=0).stop 2023-06-10T19:04:38.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:38.852+0000 7fd37f892640 1 -- 172.21.15.53:0/2813159196 shutdown_connections 2023-06-10T19:04:38.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:38.852+0000 7fd37f892640 1 --2- 172.21.15.53:0/2813159196 >> v2:172.21.15.117:3300/0 conn(0x7fd3780afc60 0x7fd37815d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:38.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:38.852+0000 7fd37f892640 1 --2- 172.21.15.53:0/2813159196 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd378071060 0x7fd3780af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:38.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:38.852+0000 7fd37f892640 1 --2- 172.21.15.53:0/2813159196 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3780c9840 0x7fd3780c9c10 unknown :-1 s=CLOSED pgs=1762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:38.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:38.852+0000 7fd37f892640 1 -- 172.21.15.53:0/2813159196 >> 172.21.15.53:0/2813159196 conn(0x7fd37806a0d0 msgr2=0x7fd3780ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:04:38.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:38.852+0000 7fd37f892640 1 -- 172.21.15.53:0/2813159196 shutdown_connections 2023-06-10T19:04:38.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:38.852+0000 7fd37f892640 1 -- 172.21.15.53:0/2813159196 wait complete. 2023-06-10T19:04:38.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:38.852+0000 7fd37f892640 1 Processor -- start 2023-06-10T19:04:38.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:38.852+0000 7fd37f892640 1 -- start start 2023-06-10T19:04:38.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:38.856+0000 7fd37f892640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd378071060 0x7fd3781512e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:38.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:38.856+0000 7fd37f892640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3780afc60 0x7fd37813da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:38.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:38.856+0000 7fd37f892640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3780c9840 0x7fd378151b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:38.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:38.856+0000 7fd37f892640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3781550b0 con 0x7fd3780afc60 2023-06-10T19:04:38.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:38.856+0000 7fd37f892640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd378155390 con 0x7fd378071060 2023-06-10T19:04:38.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:38.856+0000 7fd37f892640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd378155670 con 0x7fd3780c9840 2023-06-10T19:04:38.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:38.856+0000 7fd37ce2d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3780afc60 0x7fd37813da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:38.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:38.856+0000 7fd37ce2d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3780afc60 0x7fd37813da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38072/0 (socket says 172.21.15.53:38072) 2023-06-10T19:04:38.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:38.856+0000 7fd37ce2d640 1 -- 172.21.15.53:0/741785517 learned_addr learned my addr 172.21.15.53:0/741785517 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:04:38.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:38.856+0000 7fd37de2f640 1 --2- 172.21.15.53:0/741785517 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3780c9840 0x7fd378151b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:38.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:38.856+0000 7fd37d62e640 1 --2- 172.21.15.53:0/741785517 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd378071060 0x7fd3781512e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:38.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:38.856+0000 7fd37ce2d640 1 -- 172.21.15.53:0/741785517 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3780c9840 msgr2=0x7fd378151b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:38.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:38.856+0000 7fd37ce2d640 1 --2- 172.21.15.53:0/741785517 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3780c9840 0x7fd378151b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:38.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:38.856+0000 7fd37ce2d640 1 -- 172.21.15.53:0/741785517 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd378071060 msgr2=0x7fd3781512e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:38.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:38.856+0000 7fd37ce2d640 1 --2- 172.21.15.53:0/741785517 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd378071060 0x7fd3781512e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:38.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:38.856+0000 7fd37ce2d640 1 -- 172.21.15.53:0/741785517 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3740094d0 con 0x7fd3780afc60 2023-06-10T19:04:38.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:38.856+0000 7fd37ce2d640 1 --2- 172.21.15.53:0/741785517 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3780afc60 0x7fd37813da80 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7fd36800c7f0 tx=0x7fd36800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:38.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:38.856+0000 7fd36dffb640 1 -- 172.21.15.53:0/741785517 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd368007820 con 0x7fd3780afc60 2023-06-10T19:04:38.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:38.856+0000 7fd36dffb640 1 -- 172.21.15.53:0/741785517 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd368007980 con 0x7fd3780afc60 2023-06-10T19:04:38.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:38.856+0000 7fd37f892640 1 -- 172.21.15.53:0/741785517 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd378155950 con 0x7fd3780afc60 2023-06-10T19:04:38.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:38.856+0000 7fd36dffb640 1 -- 172.21.15.53:0/741785517 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd368007d10 con 0x7fd3780afc60 2023-06-10T19:04:38.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:38.856+0000 7fd37f892640 1 -- 172.21.15.53:0/741785517 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd378151820 con 0x7fd3780afc60 2023-06-10T19:04:38.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:38.856+0000 7fd37f892640 1 -- 172.21.15.53:0/741785517 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd37806b010 con 0x7fd3780afc60 2023-06-10T19:04:38.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:38.856+0000 7fd36dffb640 1 -- 172.21.15.53:0/741785517 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd3680113f0 con 0x7fd3780afc60 2023-06-10T19:04:38.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:38.856+0000 7fd36dffb640 1 --2- 172.21.15.53:0/741785517 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd35c0662b0 0x7fd35c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:38.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:38.856+0000 7fd36dffb640 1 -- 172.21.15.53:0/741785517 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6149+0+0 (secure 0 0 0) 0x7fd3680840c0 con 0x7fd3780afc60 2023-06-10T19:04:38.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:38.856+0000 7fd37d62e640 1 --2- 172.21.15.53:0/741785517 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd35c0662b0 0x7fd35c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:38.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:38.860+0000 7fd37d62e640 1 --2- 172.21.15.53:0/741785517 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd35c0662b0 0x7fd35c068760 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fd3740ad000 tx=0x7fd374008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:38.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:38.864+0000 7fd36dffb640 1 -- 172.21.15.53:0/741785517 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd368051450 con 0x7fd3780afc60 2023-06-10T19:04:39.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:39.052+0000 7fd37f892640 1 -- 172.21.15.53:0/741785517 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd37804d790 con 0x7fd3780afc60 2023-06-10T19:04:39.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:39.052+0000 7fd36dffb640 1 -- 172.21.15.53:0/741785517 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4672 (secure 0 0 0) 0x7fd36801f090 con 0x7fd3780afc60 2023-06-10T19:04:39.057 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:04:39.057 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":63,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6542,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/3258793373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3258793373},{"type":"v1","addr":"172.21.15.117:6836","nonce":3258793373}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":7363,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/585135979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":585135979},{"type":"v1","addr":"172.21.15.117:6837","nonce":585135979}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":8682,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/448704478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":448704478},{"type":"v1","addr":"172.21.15.53:6833","nonce":448704478}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:03:48.420425+0000","modified":"2023-06-10T19:04:06.109236+0000","tableserver":0,"root":0,"session_timeout":30,"session_autoclose":50,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8685},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8685":{"gid":8685,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/1149668719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":1149668719},{"type":"v1","addr":"172.21.15.53:6835","nonce":1149668719}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-06-10T19:04:39.058 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 63 2023-06-10T19:04:39.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:39.056+0000 7fd37f892640 1 -- 172.21.15.53:0/741785517 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd35c0662b0 msgr2=0x7fd35c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:39.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:39.056+0000 7fd37f892640 1 --2- 172.21.15.53:0/741785517 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd35c0662b0 0x7fd35c068760 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fd3740ad000 tx=0x7fd374008040 comp rx=0 tx=0).stop 2023-06-10T19:04:39.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:39.056+0000 7fd37f892640 1 -- 172.21.15.53:0/741785517 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3780afc60 msgr2=0x7fd37813da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:39.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:39.056+0000 7fd37f892640 1 --2- 172.21.15.53:0/741785517 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3780afc60 0x7fd37813da80 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7fd36800c7f0 tx=0x7fd36800ccb0 comp rx=0 tx=0).stop 2023-06-10T19:04:39.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:39.056+0000 7fd37f892640 1 -- 172.21.15.53:0/741785517 shutdown_connections 2023-06-10T19:04:39.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:39.056+0000 7fd37f892640 1 --2- 172.21.15.53:0/741785517 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd35c0662b0 0x7fd35c068760 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:39.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:39.056+0000 7fd37f892640 1 --2- 172.21.15.53:0/741785517 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3780c9840 0x7fd378151b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:39.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:39.056+0000 7fd37f892640 1 --2- 172.21.15.53:0/741785517 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3780afc60 0x7fd37813da80 unknown :-1 s=CLOSED pgs=1763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:39.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:39.056+0000 7fd37f892640 1 --2- 172.21.15.53:0/741785517 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd378071060 0x7fd3781512e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:39.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:39.056+0000 7fd37f892640 1 -- 172.21.15.53:0/741785517 >> 172.21.15.53:0/741785517 conn(0x7fd37806a0d0 msgr2=0x7fd3780b2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:04:39.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:39.056+0000 7fd37f892640 1 -- 172.21.15.53:0/741785517 shutdown_connections 2023-06-10T19:04:39.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:39.056+0000 7fd37f892640 1 -- 172.21.15.53:0/741785517 wait complete. 2023-06-10T19:04:39.076 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2023-06-10T19:04:39.219 INFO:teuthology.orchestra.run.smithi053.stdout:[{"id":6662,"entity":{"name":{"type":"client","num":6662},"addr":{"type":"any","addr":"192.168.0.1:0","nonce":2195391759}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":0,"uptime":37.563393728000001,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":2.771950078895403,"halflife":300},"cap_acquisition":{"value":0,"halflife":10},"last_trim_completed_requests_tid":1,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.6662 192.168.0.1:0/2195391759","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x00000000000fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"219d315c3a0b2075e570fb1964be2ad33fe7a9c8","ceph_version":"ceph version 18.0.0-4359-g219d315c (219d315c3a0b2075e570fb1964be2ad33fe7a9c8) reef (dev)","entity_id":"1","hostname":"smithi117","mount_point":"/home/ubuntu/cephtest/mnt.1","pid":"45121","root":"/"}},{"id":8886,"entity":{"name":{"type":"client","num":8886},"addr":{"type":"any","addr":"192.168.0.1:0","nonce":3878814772}},"state":"open","num_leases":0,"num_caps":2,"request_load_avg":2,"uptime":39.731357733000003,"requests_in_flight":0,"num_completed_requests":1,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":3.6949262274406851,"halflife":300},"cap_acquisition":{"value":0,"halflife":10},"last_trim_completed_requests_tid":4,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.8886 192.168.0.1:0/3878814772","completed_requests":[{"tid":4,"created_ino":"0x10000000000"}],"prealloc_inos":[{"start":"0x10000000001","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000000fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"219d315c3a0b2075e570fb1964be2ad33fe7a9c8","ceph_version":"ceph version 18.0.0-4359-g219d315c (219d315c3a0b2075e570fb1964be2ad33fe7a9c8) reef (dev)","entity_id":"0","hostname":"smithi053","mount_point":"/home/ubuntu/cephtest/mnt.0","pid":"61053","root":"/"}}] 2023-06-10T19:04:39.220 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 10, "value": 0 }, "client_metadata": { "ceph_sha1": "219d315c3a0b2075e570fb1964be2ad33fe7a9c8", "ceph_version": "ceph version 18.0.0-4359-g219d315c (219d315c3a0b2075e570fb1964be2ad33fe7a9c8) reef (dev)", "client_features": { "feature_bits": "0x00000000000fffff" }, "entity_id": "1", "hostname": "smithi117", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "mount_point": "/home/ubuntu/cephtest/mnt.1", "pid": "45121", "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 2195391759, "type": "any" }, "name": { "num": 6662, "type": "client" } }, "id": 6662, "inst": "client.6662 192.168.0.1:0/2195391759", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 1, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 0, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 2.771950078895403 }, "state": "open", "uptime": 37.563393728 }, { "cap_acquisition": { "halflife": 10, "value": 0 }, "client_metadata": { "ceph_sha1": "219d315c3a0b2075e570fb1964be2ad33fe7a9c8", "ceph_version": "ceph version 18.0.0-4359-g219d315c (219d315c3a0b2075e570fb1964be2ad33fe7a9c8) reef (dev)", "client_features": { "feature_bits": "0x00000000000fffff" }, "entity_id": "0", "hostname": "smithi053", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "mount_point": "/home/ubuntu/cephtest/mnt.0", "pid": "61053", "root": "/" }, "completed_requests": [ { "created_ino": "0x10000000000", "tid": 4 } ], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 3878814772, "type": "any" }, "name": { "num": 8886, "type": "client" } }, "id": 8886, "inst": "client.8886 192.168.0.1:0/3878814772", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 4, "num_caps": 2, "num_completed_flushes": 0, "num_completed_requests": 1, "num_leases": 0, "prealloc_inos": [ { "length": 1000, "start": "0x10000000001" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 2, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 3.694926227440685 }, "state": "open", "uptime": 39.731357733 } ] 2023-06-10T19:04:39.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:04:39.222 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest/mnt.1 && exec stat dir) 2023-06-10T19:04:44.285 INFO:teuthology.orchestra.run.smithi117.stdout: File: dir 2023-06-10T19:04:44.285 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 0 Blocks: 1 IO Block: 4096 directory 2023-06-10T19:04:44.285 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 2dh/45d Inode: 1099511627776 Links: 2 2023-06-10T19:04:44.285 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0775/drwxrwxr-x) Uid: ( 1000/ ubuntu) Gid: ( 1271/ ubuntu) 2023-06-10T19:04:44.286 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2023-06-10 19:04:06.646520499 +0000 2023-06-10T19:04:44.286 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2023-06-10 19:04:06.646520499 +0000 2023-06-10T19:04:44.286 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2023-06-10 19:04:06.646520499 +0000 2023-06-10T19:04:44.286 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: - 2023-06-10T19:04:44.287 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:04:44.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.416+0000 7fde63b63640 1 Processor -- start 2023-06-10T19:04:44.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.416+0000 7fde63b63640 1 -- start start 2023-06-10T19:04:44.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.416+0000 7fde63b63640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fde5c06b2f0 0x7fde5c06f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:44.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.416+0000 7fde63b63640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde5c0c8d00 0x7fde5c06b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:44.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.416+0000 7fde63b63640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde5c158a90 con 0x7fde5c06bc00 2023-06-10T19:04:44.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.416+0000 7fde63b63640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde5c0705d0 con 0x7fde5c06b2f0 2023-06-10T19:04:44.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.416+0000 7fde63b63640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde5c06f9c0 con 0x7fde5c0c8d00 2023-06-10T19:04:44.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.416+0000 7fde62100640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fde5c06bc00 0x7fde5c0cbe00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:51542/0 (socket says 172.21.15.53:51542) 2023-06-10T19:04:44.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.416+0000 7fde62100640 1 -- 172.21.15.53:0/4169636290 learned_addr learned my addr 172.21.15.53:0/4169636290 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:04:44.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.416+0000 7fde618ff640 1 --2- 172.21.15.53:0/4169636290 >> v2:172.21.15.117:3300/0 conn(0x7fde5c06b2f0 0x7fde5c06f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:44.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.416+0000 7fde610fe640 1 --2- 172.21.15.53:0/4169636290 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde5c0c8d00 0x7fde5c06b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:44.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.416+0000 7fde608fd640 1 -- 172.21.15.53:0/4169636290 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3527368101 0 0) 0x7fde540014a0 con 0x7fde5c06bc00 2023-06-10T19:04:44.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.416+0000 7fde608fd640 1 -- 172.21.15.53:0/4169636290 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde48003530 con 0x7fde5c06bc00 2023-06-10T19:04:44.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.416+0000 7fde608fd640 1 -- 172.21.15.53:0/4169636290 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2472155379 0 0) 0x7fde48003530 con 0x7fde5c06bc00 2023-06-10T19:04:44.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.416+0000 7fde608fd640 1 -- 172.21.15.53:0/4169636290 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde5c0c8d00 msgr2=0x7fde5c06b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:04:44.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.416+0000 7fde608fd640 1 --2- 172.21.15.53:0/4169636290 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde5c0c8d00 0x7fde5c06b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:44.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.416+0000 7fde608fd640 1 -- 172.21.15.53:0/4169636290 >> v2:172.21.15.117:3300/0 conn(0x7fde5c06b2f0 msgr2=0x7fde5c06f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:04:44.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.416+0000 7fde608fd640 1 --2- 172.21.15.53:0/4169636290 >> v2:172.21.15.117:3300/0 conn(0x7fde5c06b2f0 0x7fde5c06f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:44.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.416+0000 7fde608fd640 1 -- 172.21.15.53:0/4169636290 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde5c06fca0 con 0x7fde5c06bc00 2023-06-10T19:04:44.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.416+0000 7fde608fd640 1 -- 172.21.15.53:0/4169636290 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fde54001b90 con 0x7fde5c06bc00 2023-06-10T19:04:44.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.416+0000 7fde608fd640 1 -- 172.21.15.53:0/4169636290 >> v1:172.21.15.53:6789/0 conn(0x7fde5c06bc00 legacy=0x7fde5c0cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:44.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.416+0000 7fde608fd640 1 --2- 172.21.15.53:0/4169636290 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde5c0c8d00 0x7fde480039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:44.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.416+0000 7fde608fd640 1 --2- 172.21.15.53:0/4169636290 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde48003f70 0x7fde480047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:44.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.416+0000 7fde608fd640 1 --2- 172.21.15.53:0/4169636290 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde48004d10 0x7fde48005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:44.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.416+0000 7fde608fd640 1 -- 172.21.15.53:0/4169636290 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde5c0705d0 con 0x7fde48004d10 2023-06-10T19:04:44.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.416+0000 7fde608fd640 1 -- 172.21.15.53:0/4169636290 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde5c06f9c0 con 0x7fde48003f70 2023-06-10T19:04:44.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.416+0000 7fde608fd640 1 -- 172.21.15.53:0/4169636290 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde4800ba10 con 0x7fde5c0c8d00 2023-06-10T19:04:44.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.416+0000 7fde618ff640 1 --2- 172.21.15.53:0/4169636290 >> v2:172.21.15.117:3300/0 conn(0x7fde5c06b2f0 0x7fde5c06f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-10T19:04:44.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.416+0000 7fde62100640 1 --2- 172.21.15.53:0/4169636290 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde48004d10 0x7fde48005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:44.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.416+0000 7fde62100640 1 -- 172.21.15.53:0/4169636290 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde5c0c8d00 msgr2=0x7fde480039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:04:44.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.416+0000 7fde62100640 1 --2- 172.21.15.53:0/4169636290 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde5c0c8d00 0x7fde480039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:44.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.416+0000 7fde62100640 1 -- 172.21.15.53:0/4169636290 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde48003f70 msgr2=0x7fde480047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:04:44.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.416+0000 7fde62100640 1 --2- 172.21.15.53:0/4169636290 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde48003f70 0x7fde480047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:44.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.416+0000 7fde62100640 1 -- 172.21.15.53:0/4169636290 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde48003530 con 0x7fde48004d10 2023-06-10T19:04:44.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.420+0000 7fde62100640 1 --2- 172.21.15.53:0/4169636290 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde48004d10 0x7fde48005180 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7fde5400a830 tx=0x7fde5401d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9da8b79ae8bc961 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:44.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.420+0000 7fde608fd640 1 -- 172.21.15.53:0/4169636290 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde540ad630 con 0x7fde48004d10 2023-06-10T19:04:44.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.420+0000 7fde608fd640 1 -- 172.21.15.53:0/4169636290 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde540a8070 con 0x7fde48004d10 2023-06-10T19:04:44.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.420+0000 7fde608fd640 1 -- 172.21.15.53:0/4169636290 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde540ada10 con 0x7fde48004d10 2023-06-10T19:04:44.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.420+0000 7fde63b63640 1 -- 172.21.15.53:0/4169636290 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde48004d10 msgr2=0x7fde48005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:44.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.420+0000 7fde63b63640 1 --2- 172.21.15.53:0/4169636290 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde48004d10 0x7fde48005180 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7fde5400a830 tx=0x7fde5401d340 comp rx=0 tx=0).stop 2023-06-10T19:04:44.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.420+0000 7fde62100640 1 -- 172.21.15.53:0/4169636290 reap_dead start 2023-06-10T19:04:44.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.420+0000 7fde63b63640 1 -- 172.21.15.53:0/4169636290 shutdown_connections 2023-06-10T19:04:44.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.420+0000 7fde63b63640 1 -- 172.21.15.53:0/4169636290 >> 172.21.15.53:0/4169636290 conn(0x7fde5c06a0d0 msgr2=0x7fde5c0ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:04:44.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.420+0000 7fde63b63640 1 -- 172.21.15.53:0/4169636290 shutdown_connections 2023-06-10T19:04:44.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.420+0000 7fde63b63640 1 -- 172.21.15.53:0/4169636290 wait complete. 2023-06-10T19:04:44.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.420+0000 7fde63b63640 1 Processor -- start 2023-06-10T19:04:44.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.420+0000 7fde63b63640 1 -- start start 2023-06-10T19:04:44.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.424+0000 7fde63b63640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde5c146000 0x7fde5c1463d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:44.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.424+0000 7fde63b63640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde5c0af120 0x7fde5c146910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:44.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.424+0000 7fde63b63640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde5c144110 0x7fde5c1445b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:44.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.424+0000 7fde63b63640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde5c142580 con 0x7fde5c0af120 2023-06-10T19:04:44.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.424+0000 7fde63b63640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde5c142820 con 0x7fde5c144110 2023-06-10T19:04:44.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.424+0000 7fde63b63640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde5c142b00 con 0x7fde5c146000 2023-06-10T19:04:44.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.424+0000 7fde610fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde5c0af120 0x7fde5c146910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:44.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.424+0000 7fde610fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde5c0af120 0x7fde5c146910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53422/0 (socket says 172.21.15.53:53422) 2023-06-10T19:04:44.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.424+0000 7fde610fe640 1 -- 172.21.15.53:0/685330140 learned_addr learned my addr 172.21.15.53:0/685330140 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:04:44.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.424+0000 7fde618ff640 1 --2- 172.21.15.53:0/685330140 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde5c146000 0x7fde5c1463d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:44.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.424+0000 7fde62100640 1 --2- 172.21.15.53:0/685330140 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde5c144110 0x7fde5c1445b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:44.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.424+0000 7fde610fe640 1 -- 172.21.15.53:0/685330140 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde5c146000 msgr2=0x7fde5c1463d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:44.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.424+0000 7fde610fe640 1 --2- 172.21.15.53:0/685330140 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde5c146000 0x7fde5c1463d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:44.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.424+0000 7fde610fe640 1 -- 172.21.15.53:0/685330140 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde5c144110 msgr2=0x7fde5c1445b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:44.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.424+0000 7fde610fe640 1 --2- 172.21.15.53:0/685330140 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde5c144110 0x7fde5c1445b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:44.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.424+0000 7fde610fe640 1 -- 172.21.15.53:0/685330140 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde5c142de0 con 0x7fde5c0af120 2023-06-10T19:04:44.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.424+0000 7fde610fe640 1 --2- 172.21.15.53:0/685330140 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde5c0af120 0x7fde5c146910 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7fde4c00e7c0 tx=0x7fde4c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:44.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.424+0000 7fde527fc640 1 -- 172.21.15.53:0/685330140 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4c00eed0 con 0x7fde5c0af120 2023-06-10T19:04:44.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.424+0000 7fde527fc640 1 -- 172.21.15.53:0/685330140 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde4c00c8c0 con 0x7fde5c0af120 2023-06-10T19:04:44.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.424+0000 7fde527fc640 1 -- 172.21.15.53:0/685330140 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4c00cc70 con 0x7fde5c0af120 2023-06-10T19:04:44.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.424+0000 7fde63b63640 1 -- 172.21.15.53:0/685330140 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde5c1430c0 con 0x7fde5c0af120 2023-06-10T19:04:44.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.424+0000 7fde63b63640 1 -- 172.21.15.53:0/685330140 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde5c144af0 con 0x7fde5c0af120 2023-06-10T19:04:44.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.424+0000 7fde63b63640 1 -- 172.21.15.53:0/685330140 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde5c148390 con 0x7fde5c0af120 2023-06-10T19:04:44.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.424+0000 7fde527fc640 1 -- 172.21.15.53:0/685330140 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fde4c013470 con 0x7fde5c0af120 2023-06-10T19:04:44.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.428+0000 7fde527fc640 1 --2- 172.21.15.53:0/685330140 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fde40066280 0x7fde40068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:44.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.428+0000 7fde527fc640 1 -- 172.21.15.53:0/685330140 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6192+0+0 (secure 0 0 0) 0x7fde4c083de0 con 0x7fde5c0af120 2023-06-10T19:04:44.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.428+0000 7fde618ff640 1 --2- 172.21.15.53:0/685330140 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fde40066280 0x7fde40068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:44.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.428+0000 7fde618ff640 1 --2- 172.21.15.53:0/685330140 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fde40066280 0x7fde40068730 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fde580093f0 tx=0x7fde580095b0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:44.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.432+0000 7fde527fc640 1 -- 172.21.15.53:0/685330140 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fde4c0512a0 con 0x7fde5c0af120 2023-06-10T19:04:44.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.624+0000 7fde63b63640 1 -- 172.21.15.53:0/685330140 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fde5c04d790 con 0x7fde5c0af120 2023-06-10T19:04:44.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.624+0000 7fde527fc640 1 -- 172.21.15.53:0/685330140 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4672 (secure 0 0 0) 0x7fde4c0548c0 con 0x7fde5c0af120 2023-06-10T19:04:44.629 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:04:44.629 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":63,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6542,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/3258793373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3258793373},{"type":"v1","addr":"172.21.15.117:6836","nonce":3258793373}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":7363,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/585135979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":585135979},{"type":"v1","addr":"172.21.15.117:6837","nonce":585135979}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":8682,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/448704478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":448704478},{"type":"v1","addr":"172.21.15.53:6833","nonce":448704478}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:03:48.420425+0000","modified":"2023-06-10T19:04:06.109236+0000","tableserver":0,"root":0,"session_timeout":30,"session_autoclose":50,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8685},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8685":{"gid":8685,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/1149668719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":1149668719},{"type":"v1","addr":"172.21.15.53:6835","nonce":1149668719}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-06-10T19:04:44.630 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 63 2023-06-10T19:04:44.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.628+0000 7fde63b63640 1 -- 172.21.15.53:0/685330140 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fde40066280 msgr2=0x7fde40068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:44.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.628+0000 7fde63b63640 1 --2- 172.21.15.53:0/685330140 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fde40066280 0x7fde40068730 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fde580093f0 tx=0x7fde580095b0 comp rx=0 tx=0).stop 2023-06-10T19:04:44.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.628+0000 7fde63b63640 1 -- 172.21.15.53:0/685330140 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde5c0af120 msgr2=0x7fde5c146910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:44.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.628+0000 7fde63b63640 1 --2- 172.21.15.53:0/685330140 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde5c0af120 0x7fde5c146910 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7fde4c00e7c0 tx=0x7fde4c00ec80 comp rx=0 tx=0).stop 2023-06-10T19:04:44.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.628+0000 7fde63b63640 1 -- 172.21.15.53:0/685330140 shutdown_connections 2023-06-10T19:04:44.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.628+0000 7fde63b63640 1 --2- 172.21.15.53:0/685330140 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fde40066280 0x7fde40068730 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:44.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.628+0000 7fde63b63640 1 --2- 172.21.15.53:0/685330140 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde5c144110 0x7fde5c1445b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:44.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.628+0000 7fde63b63640 1 --2- 172.21.15.53:0/685330140 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde5c0af120 0x7fde5c146910 unknown :-1 s=CLOSED pgs=1766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:44.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.628+0000 7fde63b63640 1 --2- 172.21.15.53:0/685330140 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde5c146000 0x7fde5c1463d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:44.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.628+0000 7fde63b63640 1 -- 172.21.15.53:0/685330140 >> 172.21.15.53:0/685330140 conn(0x7fde5c06a0d0 msgr2=0x7fde5c0ca5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:04:44.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.628+0000 7fde63b63640 1 -- 172.21.15.53:0/685330140 shutdown_connections 2023-06-10T19:04:44.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:44.628+0000 7fde63b63640 1 -- 172.21.15.53:0/685330140 wait complete. 2023-06-10T19:04:44.648 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2023-06-10T19:04:44.789 INFO:teuthology.orchestra.run.smithi053.stdout:[{"id":6662,"entity":{"name":{"type":"client","num":6662},"addr":{"type":"any","addr":"192.168.0.1:0","nonce":2195391759}},"state":"open","num_leases":0,"num_caps":2,"request_load_avg":2,"uptime":43.131306498000001,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":3.7353915513305971,"halflife":300},"cap_acquisition":{"value":0,"halflife":10},"last_trim_completed_requests_tid":3,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.6662 192.168.0.1:0/2195391759","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x00000000000fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"219d315c3a0b2075e570fb1964be2ad33fe7a9c8","ceph_version":"ceph version 18.0.0-4359-g219d315c (219d315c3a0b2075e570fb1964be2ad33fe7a9c8) reef (dev)","entity_id":"1","hostname":"smithi117","mount_point":"/home/ubuntu/cephtest/mnt.1","pid":"45121","root":"/"}}] 2023-06-10T19:04:44.789 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 10, "value": 0 }, "client_metadata": { "ceph_sha1": "219d315c3a0b2075e570fb1964be2ad33fe7a9c8", "ceph_version": "ceph version 18.0.0-4359-g219d315c (219d315c3a0b2075e570fb1964be2ad33fe7a9c8) reef (dev)", "client_features": { "feature_bits": "0x00000000000fffff" }, "entity_id": "1", "hostname": "smithi117", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "mount_point": "/home/ubuntu/cephtest/mnt.1", "pid": "45121", "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 2195391759, "type": "any" }, "name": { "num": 6662, "type": "client" } }, "id": 6662, "inst": "client.6662 192.168.0.1:0/2195391759", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 3, "num_caps": 2, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 2, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 3.735391551330597 }, "state": "open", "uptime": 43.131306498 } ] 2023-06-10T19:04:44.790 DEBUG:teuthology.orchestra.run.smithi053:> sudo kill -sigcont 61053 2023-06-10T19:04:44.804 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-06-10T19:04:44.805 DEBUG:teuthology.orchestra.run.smithi053:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-06-10T19:04:44.806 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:2023-06-10T19:04:44.800+0000 7f7c757fa640 -1 client.8886 I was blocklisted at osd epoch 113 2023-06-10T19:04:44.864 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-06-10T19:04:44.912 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-06-10T19:04:44.913 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T19:04:44.913 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:04:44.918 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:04:45.091 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.088+0000 7f27b4a61640 1 Processor -- start 2023-06-10T19:04:45.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.088+0000 7f27b4a61640 1 -- start start 2023-06-10T19:04:45.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.088+0000 7f27b4a61640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f27b0069450 0x7f27b0069850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:45.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.088+0000 7f27b4a61640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27b0069d90 con 0x7f27b0070f80 2023-06-10T19:04:45.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.088+0000 7f27b4a61640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27b015f2c0 con 0x7f27b015eef0 2023-06-10T19:04:45.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.088+0000 7f27b4a61640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27b015fdc0 con 0x7f27b0069450 2023-06-10T19:04:45.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.088+0000 7f27aed9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f27b0069450 0x7f27b0069850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:45.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.088+0000 7f27aed9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f27b0069450 0x7f27b0069850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53438/0 (socket says 172.21.15.53:53438) 2023-06-10T19:04:45.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.088+0000 7f27aed9d640 1 -- 172.21.15.53:0/4002685100 learned_addr learned my addr 172.21.15.53:0/4002685100 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:04:45.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.088+0000 7f27aed9d640 1 -- 172.21.15.53:0/4002685100 >> v1:172.21.15.117:6789/0 conn(0x7f27b015eef0 legacy=0x7f27b015f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:04:45.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.088+0000 7f27aed9d640 1 -- 172.21.15.53:0/4002685100 >> v1:172.21.15.53:6789/0 conn(0x7f27b0070f80 legacy=0x7f27b00ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:45.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.088+0000 7f27ad59a640 1 -- 172.21.15.53:0/4002685100 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2217706744 0 0) 0x7f27b0069d90 con 0x7f27b0070f80 2023-06-10T19:04:45.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.088+0000 7f27aed9d640 1 -- 172.21.15.53:0/4002685100 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27b01600a0 con 0x7f27b0069450 2023-06-10T19:04:45.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.092+0000 7f27aed9d640 1 --2- 172.21.15.53:0/4002685100 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27b0069450 0x7f27b0069850 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7f27a8009e50 tx=0x7f27a801c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77318d434f9e2285 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:45.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.092+0000 7f27ad59a640 1 -- 172.21.15.53:0/4002685100 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27a80a5690 con 0x7f27b0069450 2023-06-10T19:04:45.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.092+0000 7f27ad59a640 1 -- 172.21.15.53:0/4002685100 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27a80a57f0 con 0x7f27b0069450 2023-06-10T19:04:45.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.092+0000 7f27ad59a640 1 -- 172.21.15.53:0/4002685100 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27a80a5b80 con 0x7f27b0069450 2023-06-10T19:04:45.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.092+0000 7f27b4a61640 1 -- 172.21.15.53:0/4002685100 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27b0069450 msgr2=0x7f27b0069850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:45.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.092+0000 7f27b4a61640 1 --2- 172.21.15.53:0/4002685100 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27b0069450 0x7f27b0069850 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7f27a8009e50 tx=0x7f27a801c9d0 comp rx=0 tx=0).stop 2023-06-10T19:04:45.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.092+0000 7f27b4a61640 1 -- 172.21.15.53:0/4002685100 shutdown_connections 2023-06-10T19:04:45.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.092+0000 7f27b4a61640 1 --2- 172.21.15.53:0/4002685100 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27b0069450 0x7f27b0069850 unknown :-1 s=CLOSED pgs=1769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:45.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.092+0000 7f27b4a61640 1 -- 172.21.15.53:0/4002685100 >> 172.21.15.53:0/4002685100 conn(0x7f27b006a560 msgr2=0x7f27b006a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:04:45.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.092+0000 7f27b4a61640 1 -- 172.21.15.53:0/4002685100 shutdown_connections 2023-06-10T19:04:45.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.092+0000 7f27b4a61640 1 -- 172.21.15.53:0/4002685100 wait complete. 2023-06-10T19:04:45.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.092+0000 7f27b4a61640 1 Processor -- start 2023-06-10T19:04:45.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.092+0000 7f27b4a61640 1 -- start start 2023-06-10T19:04:45.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.092+0000 7f27b4a61640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27b0069450 0x7f27b014be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:45.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.092+0000 7f27b4a61640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27b0070f80 0x7f27b00c6de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:45.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.092+0000 7f27b4a61640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27b015eef0 0x7f27b00c7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:45.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.092+0000 7f27b4a61640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27b00c57e0 con 0x7f27b0069450 2023-06-10T19:04:45.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.092+0000 7f27b4a61640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27b00c5220 con 0x7f27b015eef0 2023-06-10T19:04:45.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.092+0000 7f27b4a61640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27b00c5500 con 0x7f27b0070f80 2023-06-10T19:04:45.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.092+0000 7f27ae59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27b0069450 0x7f27b014be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:45.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.092+0000 7f27ae59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27b0069450 0x7f27b014be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53446/0 (socket says 172.21.15.53:53446) 2023-06-10T19:04:45.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.092+0000 7f27ae59c640 1 -- 172.21.15.53:0/2784596867 learned_addr learned my addr 172.21.15.53:0/2784596867 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:04:45.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.092+0000 7f27aed9d640 1 --2- 172.21.15.53:0/2784596867 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27b015eef0 0x7f27b00c7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:45.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.092+0000 7f27ae59c640 1 -- 172.21.15.53:0/2784596867 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27b0070f80 msgr2=0x7f27b00c6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:45.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.092+0000 7f27ae59c640 1 --2- 172.21.15.53:0/2784596867 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27b0070f80 0x7f27b00c6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:45.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.092+0000 7f27ae59c640 1 -- 172.21.15.53:0/2784596867 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27b015eef0 msgr2=0x7f27b00c7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:45.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.092+0000 7f27ae59c640 1 --2- 172.21.15.53:0/2784596867 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27b015eef0 0x7f27b00c7320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:45.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.092+0000 7f27ae59c640 1 -- 172.21.15.53:0/2784596867 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27a8009b30 con 0x7f27b0069450 2023-06-10T19:04:45.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.092+0000 7f27ae59c640 1 --2- 172.21.15.53:0/2784596867 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27b0069450 0x7f27b014be20 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f27a000c450 tx=0x7f27a000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:45.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.096+0000 7f27a6ffd640 1 -- 172.21.15.53:0/2784596867 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27a0012830 con 0x7f27b0069450 2023-06-10T19:04:45.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.096+0000 7f27a6ffd640 1 -- 172.21.15.53:0/2784596867 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27a00129b0 con 0x7f27b0069450 2023-06-10T19:04:45.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.096+0000 7f27b4a61640 1 -- 172.21.15.53:0/2784596867 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27b00c2a80 con 0x7f27b0069450 2023-06-10T19:04:45.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.096+0000 7f27a6ffd640 1 -- 172.21.15.53:0/2784596867 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27a0012d60 con 0x7f27b0069450 2023-06-10T19:04:45.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.096+0000 7f27b4a61640 1 -- 172.21.15.53:0/2784596867 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27b00c8af0 con 0x7f27b0069450 2023-06-10T19:04:45.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.096+0000 7f27b4a61640 1 -- 172.21.15.53:0/2784596867 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27b00c28e0 con 0x7f27b0069450 2023-06-10T19:04:45.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.096+0000 7f27a6ffd640 1 -- 172.21.15.53:0/2784596867 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f27a001c460 con 0x7f27b0069450 2023-06-10T19:04:45.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.096+0000 7f27a6ffd640 1 --2- 172.21.15.53:0/2784596867 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2798066280 0x7f2798068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:45.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.096+0000 7f27a6ffd640 1 -- 172.21.15.53:0/2784596867 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6192+0+0 (secure 0 0 0) 0x7f27a0083bb0 con 0x7f27b0069450 2023-06-10T19:04:45.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.096+0000 7f27add9b640 1 --2- 172.21.15.53:0/2784596867 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2798066280 0x7f2798068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:45.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.096+0000 7f27add9b640 1 --2- 172.21.15.53:0/2784596867 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2798066280 0x7f2798068730 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f279c007fd0 tx=0x7f279c007920 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:45.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.100+0000 7f27a6ffd640 1 -- 172.21.15.53:0/2784596867 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f27b00c28e0 con 0x7f27b0069450 2023-06-10T19:04:45.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.256+0000 7f27b4a61640 1 -- 172.21.15.53:0/2784596867 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f27b00c28e0 con 0x7f27b0069450 2023-06-10T19:04:45.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.256+0000 7f27a6ffd640 1 -- 172.21.15.53:0/2784596867 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) v1 ==== 74+0+18486 (secure 0 0 0) 0x7f27b00c28e0 con 0x7f27b0069450 2023-06-10T19:04:45.263 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:04:45.263 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":113,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:04:44.261377+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-06-10T19:03:46.427131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-06-10T19:03:47.398979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.d","mappings":[{"from":6,"to":7}]},{"pgid":"16.13","mappings":[{"from":1,"to":4}]},{"pgid":"16.1e","mappings":[{"from":5,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.0.1:0/3878814772":"2023-06-10T20:04:43.440652+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:04:45.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.260+0000 7f27b4a61640 1 -- 172.21.15.53:0/2784596867 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2798066280 msgr2=0x7f2798068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:45.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.260+0000 7f27b4a61640 1 --2- 172.21.15.53:0/2784596867 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2798066280 0x7f2798068730 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f279c007fd0 tx=0x7f279c007920 comp rx=0 tx=0).stop 2023-06-10T19:04:45.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.260+0000 7f27b4a61640 1 -- 172.21.15.53:0/2784596867 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27b0069450 msgr2=0x7f27b014be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:45.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.260+0000 7f27b4a61640 1 --2- 172.21.15.53:0/2784596867 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27b0069450 0x7f27b014be20 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f27a000c450 tx=0x7f27a000c910 comp rx=0 tx=0).stop 2023-06-10T19:04:45.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.260+0000 7f27b4a61640 1 -- 172.21.15.53:0/2784596867 shutdown_connections 2023-06-10T19:04:45.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.260+0000 7f27b4a61640 1 --2- 172.21.15.53:0/2784596867 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2798066280 0x7f2798068730 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:45.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.260+0000 7f27b4a61640 1 --2- 172.21.15.53:0/2784596867 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27b015eef0 0x7f27b00c7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:45.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.260+0000 7f27b4a61640 1 --2- 172.21.15.53:0/2784596867 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27b0070f80 0x7f27b00c6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:45.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.260+0000 7f27b4a61640 1 --2- 172.21.15.53:0/2784596867 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27b0069450 0x7f27b014be20 unknown :-1 s=CLOSED pgs=1770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:45.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.260+0000 7f27b4a61640 1 -- 172.21.15.53:0/2784596867 >> 172.21.15.53:0/2784596867 conn(0x7f27b006a560 msgr2=0x7f27b01599d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:04:45.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.260+0000 7f27b4a61640 1 -- 172.21.15.53:0/2784596867 shutdown_connections 2023-06-10T19:04:45.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.260+0000 7f27b4a61640 1 -- 172.21.15.53:0/2784596867 wait complete. 2023-06-10T19:04:45.283 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-10T18:52:33.633114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-10T18:52:39.171487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-10T19:03:46.427131+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '109', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2023-06-10T19:03:47.398979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '110', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-10T19:04:45.284 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-10T19:04:45.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.408+0000 7f926f5e7640 1 Processor -- start 2023-06-10T19:04:45.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.408+0000 7f926f5e7640 1 -- start start 2023-06-10T19:04:45.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.408+0000 7f926f5e7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f926815c090 0x7f92680b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:45.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.408+0000 7f926f5e7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f92680b0b90 0x7f92680b7720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:45.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.408+0000 7f926f5e7640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f92680b7c60 0x7f92680b3b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:45.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.408+0000 7f926f5e7640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92680b80e0 con 0x7f92680b0b90 2023-06-10T19:04:45.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.408+0000 7f926f5e7640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92680cc7c0 con 0x7f92680b7c60 2023-06-10T19:04:45.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.408+0000 7f926f5e7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92680ccaa0 con 0x7f926815c090 2023-06-10T19:04:45.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.408+0000 7f926cb82640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f92680b0b90 0x7f92680b7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:45.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.408+0000 7f926cb82640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f92680b0b90 0x7f92680b7720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53460/0 (socket says 172.21.15.53:53460) 2023-06-10T19:04:45.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.408+0000 7f926cb82640 1 -- 172.21.15.53:0/431054863 learned_addr learned my addr 172.21.15.53:0/431054863 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:04:45.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.408+0000 7f926db84640 1 --2- 172.21.15.53:0/431054863 >> v2:172.21.15.117:3300/0 conn(0x7f92680b7c60 0x7f92680b3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:45.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.408+0000 7f926d383640 1 --2- 172.21.15.53:0/431054863 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f926815c090 0x7f92680b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:45.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.408+0000 7f926cb82640 1 -- 172.21.15.53:0/431054863 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f926815c090 msgr2=0x7f92680b10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:04:45.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.408+0000 7f926cb82640 1 --2- 172.21.15.53:0/431054863 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f926815c090 0x7f92680b10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:45.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.408+0000 7f926cb82640 1 -- 172.21.15.53:0/431054863 >> v2:172.21.15.117:3300/0 conn(0x7f92680b7c60 msgr2=0x7f92680b3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:04:45.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.408+0000 7f926cb82640 1 --2- 172.21.15.53:0/431054863 >> v2:172.21.15.117:3300/0 conn(0x7f92680b7c60 0x7f92680b3b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:45.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.408+0000 7f926cb82640 1 -- 172.21.15.53:0/431054863 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92680ccd80 con 0x7f92680b0b90 2023-06-10T19:04:45.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.408+0000 7f926db84640 1 --2- 172.21.15.53:0/431054863 >> v2:172.21.15.117:3300/0 conn(0x7f92680b7c60 0x7f92680b3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:04:45.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.408+0000 7f926d383640 1 --2- 172.21.15.53:0/431054863 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f926815c090 0x7f92680b10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:04:45.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.412+0000 7f926cb82640 1 --2- 172.21.15.53:0/431054863 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92680b0b90 0x7f92680b7720 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f92680cc6a0 tx=0x7f926401c180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcbbdda7f0be7d78 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:45.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.412+0000 7f925bfff640 1 -- 172.21.15.53:0/431054863 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92640ab600 con 0x7f92680b0b90 2023-06-10T19:04:45.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.412+0000 7f925bfff640 1 -- 172.21.15.53:0/431054863 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92640a7050 con 0x7f92680b0b90 2023-06-10T19:04:45.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.412+0000 7f925bfff640 1 -- 172.21.15.53:0/431054863 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92640ab980 con 0x7f92680b0b90 2023-06-10T19:04:45.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.412+0000 7f926f5e7640 1 -- 172.21.15.53:0/431054863 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92680b0b90 msgr2=0x7f92680b7720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:45.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.412+0000 7f926f5e7640 1 --2- 172.21.15.53:0/431054863 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92680b0b90 0x7f92680b7720 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f92680cc6a0 tx=0x7f926401c180 comp rx=0 tx=0).stop 2023-06-10T19:04:45.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.412+0000 7f926f5e7640 1 -- 172.21.15.53:0/431054863 shutdown_connections 2023-06-10T19:04:45.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.412+0000 7f926f5e7640 1 --2- 172.21.15.53:0/431054863 >> v2:172.21.15.117:3300/0 conn(0x7f92680b7c60 0x7f92680b3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:45.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.412+0000 7f926f5e7640 1 --2- 172.21.15.53:0/431054863 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92680b0b90 0x7f92680b7720 unknown :-1 s=CLOSED pgs=1771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:45.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.412+0000 7f926f5e7640 1 --2- 172.21.15.53:0/431054863 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f926815c090 0x7f92680b10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:45.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.412+0000 7f926f5e7640 1 -- 172.21.15.53:0/431054863 >> 172.21.15.53:0/431054863 conn(0x7f9268069e20 msgr2=0x7f926806a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:04:45.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.412+0000 7f926f5e7640 1 -- 172.21.15.53:0/431054863 shutdown_connections 2023-06-10T19:04:45.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.412+0000 7f926f5e7640 1 -- 172.21.15.53:0/431054863 wait complete. 2023-06-10T19:04:45.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.412+0000 7f926f5e7640 1 Processor -- start 2023-06-10T19:04:45.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.412+0000 7f926f5e7640 1 -- start start 2023-06-10T19:04:45.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.412+0000 7f926f5e7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92680b0b90 0x7f9268148d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:45.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.412+0000 7f926f5e7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92680b7c60 0x7f92681494d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:45.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.412+0000 7f926f5e7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f926815c090 0x7f926814ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:45.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.412+0000 7f926f5e7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f926814e310 con 0x7f92680b0b90 2023-06-10T19:04:45.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.412+0000 7f926f5e7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f926814d700 con 0x7f926815c090 2023-06-10T19:04:45.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.412+0000 7f926f5e7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f926814d9e0 con 0x7f92680b7c60 2023-06-10T19:04:45.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.416+0000 7f926d383640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92680b0b90 0x7f9268148d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:45.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.416+0000 7f926d383640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92680b0b90 0x7f9268148d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53474/0 (socket says 172.21.15.53:53474) 2023-06-10T19:04:45.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.416+0000 7f926d383640 1 -- 172.21.15.53:0/2008518633 learned_addr learned my addr 172.21.15.53:0/2008518633 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:04:45.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.416+0000 7f926db84640 1 --2- 172.21.15.53:0/2008518633 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f926815c090 0x7f926814ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:45.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.416+0000 7f926cb82640 1 --2- 172.21.15.53:0/2008518633 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92680b7c60 0x7f92681494d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:45.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.416+0000 7f926d383640 1 -- 172.21.15.53:0/2008518633 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92680b7c60 msgr2=0x7f92681494d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:45.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.416+0000 7f926d383640 1 --2- 172.21.15.53:0/2008518633 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92680b7c60 0x7f92681494d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:45.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.416+0000 7f926d383640 1 -- 172.21.15.53:0/2008518633 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f926815c090 msgr2=0x7f926814ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:45.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.416+0000 7f926d383640 1 --2- 172.21.15.53:0/2008518633 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f926815c090 0x7f926814ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:45.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.416+0000 7f926d383640 1 -- 172.21.15.53:0/2008518633 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92640094d0 con 0x7f92680b0b90 2023-06-10T19:04:45.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.416+0000 7f926cb82640 1 --2- 172.21.15.53:0/2008518633 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92680b7c60 0x7f92681494d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:04:45.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.416+0000 7f926d383640 1 --2- 172.21.15.53:0/2008518633 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92680b0b90 0x7f9268148d30 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7f925c00c7f0 tx=0x7f925c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:45.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.416+0000 7f9259ffb640 1 -- 172.21.15.53:0/2008518633 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925c007820 con 0x7f92680b0b90 2023-06-10T19:04:45.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.416+0000 7f9259ffb640 1 -- 172.21.15.53:0/2008518633 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f925c007980 con 0x7f92680b0b90 2023-06-10T19:04:45.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.416+0000 7f926f5e7640 1 -- 172.21.15.53:0/2008518633 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f926814dcc0 con 0x7f92680b0b90 2023-06-10T19:04:45.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.416+0000 7f9259ffb640 1 -- 172.21.15.53:0/2008518633 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925c007d30 con 0x7f92680b0b90 2023-06-10T19:04:45.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.416+0000 7f926f5e7640 1 -- 172.21.15.53:0/2008518633 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9268149270 con 0x7f92680b0b90 2023-06-10T19:04:45.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.416+0000 7f926f5e7640 1 -- 172.21.15.53:0/2008518633 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f926804d790 con 0x7f92680b0b90 2023-06-10T19:04:45.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.416+0000 7f9259ffb640 1 -- 172.21.15.53:0/2008518633 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f925c0113f0 con 0x7f92680b0b90 2023-06-10T19:04:45.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.416+0000 7f9259ffb640 1 --2- 172.21.15.53:0/2008518633 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f924c0662b0 0x7f924c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:45.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.416+0000 7f9259ffb640 1 -- 172.21.15.53:0/2008518633 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6192+0+0 (secure 0 0 0) 0x7f925c083f70 con 0x7f92680b0b90 2023-06-10T19:04:45.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.416+0000 7f926cb82640 1 --2- 172.21.15.53:0/2008518633 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f924c0662b0 0x7f924c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:45.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.420+0000 7f926cb82640 1 --2- 172.21.15.53:0/2008518633 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f924c0662b0 0x7f924c068760 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f92640ad000 tx=0x7f92640a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:45.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.420+0000 7f9259ffb640 1 -- 172.21.15.53:0/2008518633 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f925c0b4700 con 0x7f92680b0b90 2023-06-10T19:04:45.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.576+0000 7f926f5e7640 1 -- 172.21.15.53:0/2008518633 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f92680b72f0 con 0x7f92680b0b90 2023-06-10T19:04:45.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.576+0000 7f9259ffb640 1 -- 172.21.15.53:0/2008518633 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v113) v1 ==== 93+0+10 (secure 0 0 0) 0x7f925c01f0a0 con 0x7f92680b0b90 2023-06-10T19:04:45.580 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-06-10T19:04:45.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.576+0000 7f926f5e7640 1 -- 172.21.15.53:0/2008518633 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f924c0662b0 msgr2=0x7f924c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:45.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.576+0000 7f926f5e7640 1 --2- 172.21.15.53:0/2008518633 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f924c0662b0 0x7f924c068760 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f92640ad000 tx=0x7f92640a6000 comp rx=0 tx=0).stop 2023-06-10T19:04:45.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.576+0000 7f926f5e7640 1 -- 172.21.15.53:0/2008518633 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92680b0b90 msgr2=0x7f9268148d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:45.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.576+0000 7f926f5e7640 1 --2- 172.21.15.53:0/2008518633 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92680b0b90 0x7f9268148d30 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7f925c00c7f0 tx=0x7f925c00ccb0 comp rx=0 tx=0).stop 2023-06-10T19:04:45.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.576+0000 7f926f5e7640 1 -- 172.21.15.53:0/2008518633 shutdown_connections 2023-06-10T19:04:45.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.576+0000 7f926f5e7640 1 --2- 172.21.15.53:0/2008518633 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f924c0662b0 0x7f924c068760 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:45.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.576+0000 7f926f5e7640 1 --2- 172.21.15.53:0/2008518633 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f926815c090 0x7f926814ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:45.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.576+0000 7f926f5e7640 1 --2- 172.21.15.53:0/2008518633 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f92680b7c60 0x7f92681494d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:45.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.576+0000 7f926f5e7640 1 --2- 172.21.15.53:0/2008518633 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f92680b0b90 0x7f9268148d30 unknown :-1 s=CLOSED pgs=1772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:45.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.576+0000 7f926f5e7640 1 -- 172.21.15.53:0/2008518633 >> 172.21.15.53:0/2008518633 conn(0x7f9268069e20 msgr2=0x7f92680b6850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:04:45.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.576+0000 7f926f5e7640 1 -- 172.21.15.53:0/2008518633 shutdown_connections 2023-06-10T19:04:45.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.576+0000 7f926f5e7640 1 -- 172.21.15.53:0/2008518633 wait complete. 2023-06-10T19:04:45.600 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-10T19:04:45.732 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.728+0000 7f5ef1f78640 1 Processor -- start 2023-06-10T19:04:45.732 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.728+0000 7f5ef1f78640 1 -- start start 2023-06-10T19:04:45.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.728+0000 7f5ef1f78640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5eec0c97d0 0x7f5eec0cb820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:45.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.728+0000 7f5ef1f78640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5eec06c350 0x7f5eec0ac200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:45.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.728+0000 7f5ef1f78640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5eec0cbd60 con 0x7f5eec0af760 2023-06-10T19:04:45.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.728+0000 7f5ef1f78640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5eec0ca5c0 con 0x7f5eec06c350 2023-06-10T19:04:45.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.728+0000 7f5ef1f78640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eec0abd70 con 0x7f5eec0c97d0 2023-06-10T19:04:45.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.728+0000 7f5eebfff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f5eec0af760 0x7f5eec06b090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:51556/0 (socket says 172.21.15.53:51556) 2023-06-10T19:04:45.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.728+0000 7f5eebfff640 1 -- 172.21.15.53:0/4228939722 learned_addr learned my addr 172.21.15.53:0/4228939722 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:04:45.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.728+0000 7f5eeb7fe640 1 --2- 172.21.15.53:0/4228939722 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5eec0c97d0 0x7f5eec0cb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:45.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.728+0000 7f5eeaffd640 1 --2- 172.21.15.53:0/4228939722 >> v2:172.21.15.117:3300/0 conn(0x7f5eec06c350 0x7f5eec0ac200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:45.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.728+0000 7f5eea7fc640 1 -- 172.21.15.53:0/4228939722 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3479520333 0 0) 0x7f5ee40014a0 con 0x7f5eec0af760 2023-06-10T19:04:45.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.728+0000 7f5eea7fc640 1 -- 172.21.15.53:0/4228939722 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ed4003530 con 0x7f5eec0af760 2023-06-10T19:04:45.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.728+0000 7f5eea7fc640 1 -- 172.21.15.53:0/4228939722 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4065380656 0 0) 0x7f5ed4003530 con 0x7f5eec0af760 2023-06-10T19:04:45.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.728+0000 7f5eea7fc640 1 -- 172.21.15.53:0/4228939722 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5eec0c97d0 msgr2=0x7f5eec0cb820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:04:45.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.728+0000 7f5eea7fc640 1 --2- 172.21.15.53:0/4228939722 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5eec0c97d0 0x7f5eec0cb820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:45.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.728+0000 7f5eea7fc640 1 -- 172.21.15.53:0/4228939722 >> v2:172.21.15.117:3300/0 conn(0x7f5eec06c350 msgr2=0x7f5eec0ac200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:04:45.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.728+0000 7f5eea7fc640 1 --2- 172.21.15.53:0/4228939722 >> v2:172.21.15.117:3300/0 conn(0x7f5eec06c350 0x7f5eec0ac200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:45.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.728+0000 7f5eea7fc640 1 -- 172.21.15.53:0/4228939722 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eec0c9ba0 con 0x7f5eec0af760 2023-06-10T19:04:45.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.728+0000 7f5eea7fc640 1 -- 172.21.15.53:0/4228939722 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f5ee4001b90 con 0x7f5eec0af760 2023-06-10T19:04:45.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.728+0000 7f5eea7fc640 1 -- 172.21.15.53:0/4228939722 >> v1:172.21.15.53:6789/0 conn(0x7f5eec0af760 legacy=0x7f5eec06b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:45.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.728+0000 7f5eea7fc640 1 --2- 172.21.15.53:0/4228939722 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ed4003980 0x7f5ed4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:45.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.728+0000 7f5eea7fc640 1 --2- 172.21.15.53:0/4228939722 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5eec0c97d0 0x7f5ed40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:45.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.728+0000 7f5eea7fc640 1 --2- 172.21.15.53:0/4228939722 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ed4004d10 0x7f5ed4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:45.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.728+0000 7f5eea7fc640 1 -- 172.21.15.53:0/4228939722 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eec0ca5c0 con 0x7f5ed4003980 2023-06-10T19:04:45.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.728+0000 7f5eea7fc640 1 -- 172.21.15.53:0/4228939722 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eec0abd70 con 0x7f5ed4004d10 2023-06-10T19:04:45.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.728+0000 7f5eea7fc640 1 -- 172.21.15.53:0/4228939722 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed400ba10 con 0x7f5eec0c97d0 2023-06-10T19:04:45.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.728+0000 7f5eeb7fe640 1 --2- 172.21.15.53:0/4228939722 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ed4003980 0x7f5ed4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:45.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.728+0000 7f5eeaffd640 1 --2- 172.21.15.53:0/4228939722 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5eec0c97d0 0x7f5ed40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:45.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.728+0000 7f5eeb7fe640 1 -- 172.21.15.53:0/4228939722 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5eec0c97d0 msgr2=0x7f5ed40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:04:45.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.728+0000 7f5eeb7fe640 1 --2- 172.21.15.53:0/4228939722 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5eec0c97d0 0x7f5ed40047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:45.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.728+0000 7f5eeb7fe640 1 -- 172.21.15.53:0/4228939722 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ed4004d10 msgr2=0x7f5ed4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:04:45.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.728+0000 7f5eeb7fe640 1 --2- 172.21.15.53:0/4228939722 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ed4004d10 0x7f5ed4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:45.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.728+0000 7f5eeb7fe640 1 -- 172.21.15.53:0/4228939722 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed4003530 con 0x7f5ed4003980 2023-06-10T19:04:45.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.732+0000 7f5eeb7fe640 1 --2- 172.21.15.53:0/4228939722 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ed4003980 0x7f5ed4003d90 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7f5edc009ae0 tx=0x7f5edc01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=967e4e4c2295ebe1 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:45.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.732+0000 7f5eea7fc640 1 -- 172.21.15.53:0/4228939722 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5edc0a6430 con 0x7f5ed4003980 2023-06-10T19:04:45.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.732+0000 7f5eea7fc640 1 -- 172.21.15.53:0/4228939722 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5edc0a6590 con 0x7f5ed4003980 2023-06-10T19:04:45.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.732+0000 7f5eea7fc640 1 -- 172.21.15.53:0/4228939722 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5edc0a6940 con 0x7f5ed4003980 2023-06-10T19:04:45.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.732+0000 7f5ef1f78640 1 -- 172.21.15.53:0/4228939722 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ed4003980 msgr2=0x7f5ed4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:45.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.732+0000 7f5ef1f78640 1 --2- 172.21.15.53:0/4228939722 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ed4003980 0x7f5ed4003d90 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7f5edc009ae0 tx=0x7f5edc01ca50 comp rx=0 tx=0).stop 2023-06-10T19:04:45.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.732+0000 7f5eebfff640 1 -- 172.21.15.53:0/4228939722 reap_dead start 2023-06-10T19:04:45.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.732+0000 7f5ef1f78640 1 -- 172.21.15.53:0/4228939722 shutdown_connections 2023-06-10T19:04:45.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.732+0000 7f5ef1f78640 1 -- 172.21.15.53:0/4228939722 >> 172.21.15.53:0/4228939722 conn(0x7f5eec06a0e0 msgr2=0x7f5eec0cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:04:45.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.732+0000 7f5ef1f78640 1 -- 172.21.15.53:0/4228939722 shutdown_connections 2023-06-10T19:04:45.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.732+0000 7f5ef1f78640 1 -- 172.21.15.53:0/4228939722 wait complete. 2023-06-10T19:04:45.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.732+0000 7f5ef1f78640 1 Processor -- start 2023-06-10T19:04:45.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.732+0000 7f5ef1f78640 1 -- start start 2023-06-10T19:04:45.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.736+0000 7f5ef1f78640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ed4003980 0x7f5eec163a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:45.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.736+0000 7f5ef1f78640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5eec15d820 0x7f5eec164270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:45.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.736+0000 7f5ef1f78640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5eec1647b0 0x7f5eec15a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:45.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.736+0000 7f5ef1f78640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eec15d390 con 0x7f5eec15d820 2023-06-10T19:04:45.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.736+0000 7f5ef1f78640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eec164cc0 con 0x7f5eec1647b0 2023-06-10T19:04:45.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.736+0000 7f5ef1f78640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eec15cd40 con 0x7f5ed4003980 2023-06-10T19:04:45.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.736+0000 7f5eeaffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5eec15d820 0x7f5eec164270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:45.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.736+0000 7f5eeaffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5eec15d820 0x7f5eec164270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53496/0 (socket says 172.21.15.53:53496) 2023-06-10T19:04:45.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.736+0000 7f5eeaffd640 1 -- 172.21.15.53:0/1924031513 learned_addr learned my addr 172.21.15.53:0/1924031513 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:04:45.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.736+0000 7f5eeb7fe640 1 --2- 172.21.15.53:0/1924031513 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ed4003980 0x7f5eec163a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:45.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.736+0000 7f5eebfff640 1 --2- 172.21.15.53:0/1924031513 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5eec1647b0 0x7f5eec15a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:45.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.736+0000 7f5eeaffd640 1 -- 172.21.15.53:0/1924031513 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ed4003980 msgr2=0x7f5eec163a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:45.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.736+0000 7f5eeaffd640 1 --2- 172.21.15.53:0/1924031513 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ed4003980 0x7f5eec163a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:45.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.736+0000 7f5eeaffd640 1 -- 172.21.15.53:0/1924031513 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5eec1647b0 msgr2=0x7f5eec15a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:45.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.736+0000 7f5eeaffd640 1 --2- 172.21.15.53:0/1924031513 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5eec1647b0 0x7f5eec15a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:45.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.736+0000 7f5eeaffd640 1 -- 172.21.15.53:0/1924031513 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eec15d020 con 0x7f5eec15d820 2023-06-10T19:04:45.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.736+0000 7f5eebfff640 1 --2- 172.21.15.53:0/1924031513 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5eec1647b0 0x7f5eec15a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:04:45.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.736+0000 7f5eeaffd640 1 --2- 172.21.15.53:0/1924031513 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5eec15d820 0x7f5eec164270 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7f5ee0010900 tx=0x7f5ee0010dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:45.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.736+0000 7f5ed3fff640 1 -- 172.21.15.53:0/1924031513 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee00096b0 con 0x7f5eec15d820 2023-06-10T19:04:45.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.736+0000 7f5ed3fff640 1 -- 172.21.15.53:0/1924031513 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ee000ec20 con 0x7f5eec15d820 2023-06-10T19:04:45.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.736+0000 7f5ed3fff640 1 -- 172.21.15.53:0/1924031513 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee001c400 con 0x7f5eec15d820 2023-06-10T19:04:45.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.736+0000 7f5ef1f78640 1 -- 172.21.15.53:0/1924031513 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5eec163fb0 con 0x7f5eec15d820 2023-06-10T19:04:45.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.736+0000 7f5ef1f78640 1 -- 172.21.15.53:0/1924031513 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5eec165170 con 0x7f5eec15d820 2023-06-10T19:04:45.747 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.736+0000 7f5ef1f78640 1 -- 172.21.15.53:0/1924031513 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5eec15cba0 con 0x7f5eec15d820 2023-06-10T19:04:45.747 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.736+0000 7f5ed3fff640 1 -- 172.21.15.53:0/1924031513 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5ee001c560 con 0x7f5eec15d820 2023-06-10T19:04:45.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.736+0000 7f5ed3fff640 1 --2- 172.21.15.53:0/1924031513 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5ed8066280 0x7f5ed8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:45.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.736+0000 7f5ed3fff640 1 -- 172.21.15.53:0/1924031513 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6192+0+0 (secure 0 0 0) 0x7f5ee0084190 con 0x7f5eec15d820 2023-06-10T19:04:45.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.740+0000 7f5eeb7fe640 1 --2- 172.21.15.53:0/1924031513 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5ed8066280 0x7f5ed8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:45.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.740+0000 7f5eeb7fe640 1 --2- 172.21.15.53:0/1924031513 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5ed8066280 0x7f5ed8068730 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f5edc009ae0 tx=0x7f5edc0046d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:45.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.740+0000 7f5ed3fff640 1 -- 172.21.15.53:0/1924031513 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5eec15cba0 con 0x7f5eec15d820 2023-06-10T19:04:45.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.888+0000 7f5ef1f78640 1 -- 172.21.15.53:0/1924031513 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5eec165170 con 0x7f5eec15d820 2023-06-10T19:04:45.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.888+0000 7f5ed3fff640 1 -- 172.21.15.53:0/1924031513 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v113) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5eec165170 con 0x7f5eec15d820 2023-06-10T19:04:45.895 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-06-10T19:04:45.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.892+0000 7f5ef1f78640 1 -- 172.21.15.53:0/1924031513 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5ed8066280 msgr2=0x7f5ed8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:45.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.892+0000 7f5ef1f78640 1 --2- 172.21.15.53:0/1924031513 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5ed8066280 0x7f5ed8068730 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f5edc009ae0 tx=0x7f5edc0046d0 comp rx=0 tx=0).stop 2023-06-10T19:04:45.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.892+0000 7f5ef1f78640 1 -- 172.21.15.53:0/1924031513 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5eec15d820 msgr2=0x7f5eec164270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:45.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.892+0000 7f5ef1f78640 1 --2- 172.21.15.53:0/1924031513 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5eec15d820 0x7f5eec164270 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7f5ee0010900 tx=0x7f5ee0010dc0 comp rx=0 tx=0).stop 2023-06-10T19:04:45.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.892+0000 7f5ef1f78640 1 -- 172.21.15.53:0/1924031513 shutdown_connections 2023-06-10T19:04:45.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.892+0000 7f5ef1f78640 1 --2- 172.21.15.53:0/1924031513 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5ed8066280 0x7f5ed8068730 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:45.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.892+0000 7f5ef1f78640 1 --2- 172.21.15.53:0/1924031513 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5eec1647b0 0x7f5eec15a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:45.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.892+0000 7f5ef1f78640 1 --2- 172.21.15.53:0/1924031513 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5eec15d820 0x7f5eec164270 unknown :-1 s=CLOSED pgs=1775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:45.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.892+0000 7f5ef1f78640 1 --2- 172.21.15.53:0/1924031513 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ed4003980 0x7f5eec163a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:45.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.892+0000 7f5ef1f78640 1 -- 172.21.15.53:0/1924031513 >> 172.21.15.53:0/1924031513 conn(0x7f5eec06a0e0 msgr2=0x7f5eec15f350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:04:45.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.892+0000 7f5ef1f78640 1 -- 172.21.15.53:0/1924031513 shutdown_connections 2023-06-10T19:04:45.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:45.892+0000 7f5ef1f78640 1 -- 172.21.15.53:0/1924031513 wait complete. 2023-06-10T19:04:45.913 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-10T19:04:46.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.024+0000 7f2670af7640 1 Processor -- start 2023-06-10T19:04:46.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.024+0000 7f2670af7640 1 -- start start 2023-06-10T19:04:46.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.024+0000 7f2670af7640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f266c0c9fa0 0x7f266c06bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:46.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.024+0000 7f2670af7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f266c0af760 0x7f266c0afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:46.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.024+0000 7f2670af7640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f266c06b090 con 0x7f266c06c020 2023-06-10T19:04:46.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.024+0000 7f2670af7640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f266c0b0120 con 0x7f266c0c9fa0 2023-06-10T19:04:46.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.024+0000 7f2670af7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f266c0ca370 con 0x7f266c0af760 2023-06-10T19:04:46.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.024+0000 7f266ad9d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f266c0af760 0x7f266c0afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:46.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.024+0000 7f266a59c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f266c0c9fa0 0x7f266c06bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:46.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.024+0000 7f2669d9b640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f266c06c020 0x7f266c0c82a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.53:46038/0 (socket says 172.21.15.53:46038) 2023-06-10T19:04:46.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.024+0000 7f2669d9b640 1 -- 172.21.15.53:0/3869092369 learned_addr learned my addr 172.21.15.53:0/3869092369 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:04:46.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.024+0000 7f266a59c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f266c0c9fa0 0x7f266c06bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.53:52802/0 (socket says 172.21.15.53:52802) 2023-06-10T19:04:46.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.024+0000 7f266a59c640 1 -- 172.21.15.53:0/3869092369 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f266c0af760 msgr2=0x7f266c0afbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:04:46.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.024+0000 7f266a59c640 1 --2- 172.21.15.53:0/3869092369 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f266c0af760 0x7f266c0afbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:46.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.024+0000 7f266a59c640 1 -- 172.21.15.53:0/3869092369 >> v1:172.21.15.117:6789/0 conn(0x7f266c06c020 legacy=0x7f266c0c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:46.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.024+0000 7f266a59c640 1 -- 172.21.15.53:0/3869092369 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f266c070d50 con 0x7f266c0c9fa0 2023-06-10T19:04:46.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.028+0000 7f266a59c640 1 --2- 172.21.15.53:0/3869092369 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f266c0c9fa0 0x7f266c06bae0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f265c0097c0 tx=0x7f265c01c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91ad93eb6ee0a58c server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:46.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.028+0000 7f266959a640 1 -- 172.21.15.53:0/3869092369 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f265c0ab600 con 0x7f266c0c9fa0 2023-06-10T19:04:46.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.028+0000 7f266959a640 1 -- 172.21.15.53:0/3869092369 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f265c0a7050 con 0x7f266c0c9fa0 2023-06-10T19:04:46.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.028+0000 7f266959a640 1 -- 172.21.15.53:0/3869092369 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f265c0ab980 con 0x7f266c0c9fa0 2023-06-10T19:04:46.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.028+0000 7f2670af7640 1 -- 172.21.15.53:0/3869092369 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f266c0c9fa0 msgr2=0x7f266c06bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:46.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.028+0000 7f2670af7640 1 --2- 172.21.15.53:0/3869092369 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f266c0c9fa0 0x7f266c06bae0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f265c0097c0 tx=0x7f265c01c3c0 comp rx=0 tx=0).stop 2023-06-10T19:04:46.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.028+0000 7f2670af7640 1 -- 172.21.15.53:0/3869092369 shutdown_connections 2023-06-10T19:04:46.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.028+0000 7f2670af7640 1 --2- 172.21.15.53:0/3869092369 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f266c0af760 0x7f266c0afbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:46.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.028+0000 7f2670af7640 1 --2- 172.21.15.53:0/3869092369 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f266c0c9fa0 0x7f266c06bae0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:46.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.028+0000 7f2670af7640 1 -- 172.21.15.53:0/3869092369 >> 172.21.15.53:0/3869092369 conn(0x7f266c06a0e0 msgr2=0x7f266c0cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:04:46.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.028+0000 7f2670af7640 1 -- 172.21.15.53:0/3869092369 shutdown_connections 2023-06-10T19:04:46.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.028+0000 7f2670af7640 1 -- 172.21.15.53:0/3869092369 wait complete. 2023-06-10T19:04:46.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.028+0000 7f2670af7640 1 Processor -- start 2023-06-10T19:04:46.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.028+0000 7f2670af7640 1 -- start start 2023-06-10T19:04:46.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.028+0000 7f2670af7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f266c06c020 0x7f266c150530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:46.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.028+0000 7f2670af7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f266c0af760 0x7f266c0b0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:46.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.028+0000 7f2670af7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f266c0c9fa0 0x7f266c142790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:46.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.028+0000 7f2670af7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f266c14d9e0 con 0x7f266c0af760 2023-06-10T19:04:46.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.028+0000 7f2670af7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f266c0c2400 con 0x7f266c0c9fa0 2023-06-10T19:04:46.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.028+0000 7f2670af7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f266c14e800 con 0x7f266c06c020 2023-06-10T19:04:46.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.028+0000 7f2669d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f266c0af760 0x7f266c0b0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:46.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.028+0000 7f2669d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f266c0af760 0x7f266c0b0b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53504/0 (socket says 172.21.15.53:53504) 2023-06-10T19:04:46.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.028+0000 7f2669d9b640 1 -- 172.21.15.53:0/1747565119 learned_addr learned my addr 172.21.15.53:0/1747565119 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:04:46.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.028+0000 7f266a59c640 1 --2- 172.21.15.53:0/1747565119 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f266c06c020 0x7f266c150530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:46.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.032+0000 7f266ad9d640 1 --2- 172.21.15.53:0/1747565119 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f266c0c9fa0 0x7f266c142790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:46.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.032+0000 7f2669d9b640 1 -- 172.21.15.53:0/1747565119 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f266c06c020 msgr2=0x7f266c150530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:46.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.032+0000 7f2669d9b640 1 --2- 172.21.15.53:0/1747565119 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f266c06c020 0x7f266c150530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:46.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.032+0000 7f2669d9b640 1 -- 172.21.15.53:0/1747565119 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f266c0c9fa0 msgr2=0x7f266c142790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:46.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.032+0000 7f2669d9b640 1 --2- 172.21.15.53:0/1747565119 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f266c0c9fa0 0x7f266c142790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:46.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.032+0000 7f2669d9b640 1 -- 172.21.15.53:0/1747565119 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f265c009420 con 0x7f266c0af760 2023-06-10T19:04:46.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.032+0000 7f266a59c640 1 --2- 172.21.15.53:0/1747565119 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f266c06c020 0x7f266c150530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:04:46.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.032+0000 7f2669d9b640 1 --2- 172.21.15.53:0/1747565119 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f266c0af760 0x7f266c0b0b10 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7f266000cbc0 tx=0x7f266000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:46.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.032+0000 7f265affd640 1 -- 172.21.15.53:0/1747565119 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266000aca0 con 0x7f266c0af760 2023-06-10T19:04:46.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.032+0000 7f265affd640 1 -- 172.21.15.53:0/1747565119 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f266000ae00 con 0x7f266c0af760 2023-06-10T19:04:46.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.032+0000 7f2670af7640 1 -- 172.21.15.53:0/1747565119 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f266c14dbf0 con 0x7f266c0af760 2023-06-10T19:04:46.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.032+0000 7f265affd640 1 -- 172.21.15.53:0/1747565119 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2660012600 con 0x7f266c0af760 2023-06-10T19:04:46.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.032+0000 7f2670af7640 1 -- 172.21.15.53:0/1747565119 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f266c14e1b0 con 0x7f266c0af760 2023-06-10T19:04:46.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.032+0000 7f2670af7640 1 -- 172.21.15.53:0/1747565119 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f266c04d790 con 0x7f266c0af760 2023-06-10T19:04:46.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.032+0000 7f265affd640 1 -- 172.21.15.53:0/1747565119 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2660007070 con 0x7f266c0af760 2023-06-10T19:04:46.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.032+0000 7f265affd640 1 --2- 172.21.15.53:0/1747565119 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f264c066280 0x7f264c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:46.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.032+0000 7f265affd640 1 -- 172.21.15.53:0/1747565119 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6192+0+0 (secure 0 0 0) 0x7f2660083c40 con 0x7f266c0af760 2023-06-10T19:04:46.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.032+0000 7f266a59c640 1 --2- 172.21.15.53:0/1747565119 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f264c066280 0x7f264c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:46.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.032+0000 7f266a59c640 1 --2- 172.21.15.53:0/1747565119 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f264c066280 0x7f264c068730 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f265c0ad000 tx=0x7f265c0a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:46.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.036+0000 7f265affd640 1 -- 172.21.15.53:0/1747565119 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f26600510f0 con 0x7f266c0af760 2023-06-10T19:04:46.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.188+0000 7f2670af7640 1 -- 172.21.15.53:0/1747565119 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f266c0ce670 con 0x7f266c0af760 2023-06-10T19:04:46.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.188+0000 7f265affd640 1 -- 172.21.15.53:0/1747565119 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v113) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2660017020 con 0x7f266c0af760 2023-06-10T19:04:46.193 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-06-10T19:04:46.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.192+0000 7f2670af7640 1 -- 172.21.15.53:0/1747565119 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f264c066280 msgr2=0x7f264c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:46.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.192+0000 7f2670af7640 1 --2- 172.21.15.53:0/1747565119 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f264c066280 0x7f264c068730 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f265c0ad000 tx=0x7f265c0a6000 comp rx=0 tx=0).stop 2023-06-10T19:04:46.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.192+0000 7f2670af7640 1 -- 172.21.15.53:0/1747565119 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f266c0af760 msgr2=0x7f266c0b0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:46.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.192+0000 7f2670af7640 1 --2- 172.21.15.53:0/1747565119 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f266c0af760 0x7f266c0b0b10 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7f266000cbc0 tx=0x7f266000a060 comp rx=0 tx=0).stop 2023-06-10T19:04:46.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.192+0000 7f2670af7640 1 -- 172.21.15.53:0/1747565119 shutdown_connections 2023-06-10T19:04:46.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.192+0000 7f2670af7640 1 --2- 172.21.15.53:0/1747565119 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f264c066280 0x7f264c068730 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:46.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.192+0000 7f2670af7640 1 --2- 172.21.15.53:0/1747565119 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f266c0c9fa0 0x7f266c142790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:46.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.192+0000 7f2670af7640 1 --2- 172.21.15.53:0/1747565119 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f266c0af760 0x7f266c0b0b10 unknown :-1 s=CLOSED pgs=1776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:46.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.192+0000 7f2670af7640 1 --2- 172.21.15.53:0/1747565119 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f266c06c020 0x7f266c150530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:46.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.192+0000 7f2670af7640 1 -- 172.21.15.53:0/1747565119 >> 172.21.15.53:0/1747565119 conn(0x7f266c06a0e0 msgr2=0x7f266c0ab860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:04:46.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.192+0000 7f2670af7640 1 -- 172.21.15.53:0/1747565119 shutdown_connections 2023-06-10T19:04:46.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.192+0000 7f2670af7640 1 -- 172.21.15.53:0/1747565119 wait complete. 2023-06-10T19:04:46.211 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-10T19:04:46.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.340+0000 7f6e182a2640 1 Processor -- start 2023-06-10T19:04:46.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.340+0000 7f6e182a2640 1 -- start start 2023-06-10T19:04:46.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.340+0000 7f6e182a2640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6e100afe70 0x7f6e100c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:46.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.340+0000 7f6e182a2640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e1006b090 con 0x7f6e100c9fa0 2023-06-10T19:04:46.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.340+0000 7f6e182a2640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e100ca370 con 0x7f6e100c82a0 2023-06-10T19:04:46.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.340+0000 7f6e182a2640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e10070d50 con 0x7f6e100afe70 2023-06-10T19:04:46.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.340+0000 7f6e1603e640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f6e100c9fa0 0x7f6e1006bae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:51572/0 (socket says 172.21.15.53:51572) 2023-06-10T19:04:46.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.340+0000 7f6e1603e640 1 -- 172.21.15.53:0/4225247122 learned_addr learned my addr 172.21.15.53:0/4225247122 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:04:46.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.340+0000 7f6e1683f640 1 --2- 172.21.15.53:0/4225247122 >> v2:172.21.15.117:3300/0 conn(0x7f6e100afe70 0x7f6e100c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:46.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.340+0000 7f6e1503c640 1 -- 172.21.15.53:0/4225247122 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4288135201 0 0) 0x7f6e1006b090 con 0x7f6e100c9fa0 2023-06-10T19:04:46.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.340+0000 7f6e1503c640 1 -- 172.21.15.53:0/4225247122 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6dfc003530 con 0x7f6e100c9fa0 2023-06-10T19:04:46.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.340+0000 7f6e1503c640 1 -- 172.21.15.53:0/4225247122 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1432330180 0 0) 0x7f6dfc003530 con 0x7f6e100c9fa0 2023-06-10T19:04:46.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.340+0000 7f6e1503c640 1 -- 172.21.15.53:0/4225247122 >> v2:172.21.15.117:3300/0 conn(0x7f6e100afe70 msgr2=0x7f6e100c86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:04:46.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.340+0000 7f6e1503c640 1 --2- 172.21.15.53:0/4225247122 >> v2:172.21.15.117:3300/0 conn(0x7f6e100afe70 0x7f6e100c86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:46.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.340+0000 7f6e1503c640 1 -- 172.21.15.53:0/4225247122 >> v1:172.21.15.117:6789/0 conn(0x7f6e100c82a0 legacy=0x7f6e100af760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:46.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.340+0000 7f6e1503c640 1 -- 172.21.15.53:0/4225247122 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e10071030 con 0x7f6e100c9fa0 2023-06-10T19:04:46.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.340+0000 7f6e1503c640 1 -- 172.21.15.53:0/4225247122 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f6e0c001680 con 0x7f6e100c9fa0 2023-06-10T19:04:46.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.340+0000 7f6e1503c640 1 -- 172.21.15.53:0/4225247122 >> v1:172.21.15.53:6789/0 conn(0x7f6e100c9fa0 legacy=0x7f6e1006bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:46.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.340+0000 7f6e1503c640 1 --2- 172.21.15.53:0/4225247122 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6dfc003980 0x7f6dfc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:46.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.340+0000 7f6e1503c640 1 --2- 172.21.15.53:0/4225247122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6dfc0047d0 0x7f6dfc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:46.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.340+0000 7f6e1503c640 1 --2- 172.21.15.53:0/4225247122 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6dfc005180 0x7f6dfc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:46.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.340+0000 7f6e1503c640 1 -- 172.21.15.53:0/4225247122 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e10070d50 con 0x7f6dfc0047d0 2023-06-10T19:04:46.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.340+0000 7f6e1503c640 1 -- 172.21.15.53:0/4225247122 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dfc00c090 con 0x7f6dfc003980 2023-06-10T19:04:46.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.340+0000 7f6e1503c640 1 -- 172.21.15.53:0/4225247122 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dfc00c250 con 0x7f6dfc005180 2023-06-10T19:04:46.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.340+0000 7f6e1583d640 1 --2- 172.21.15.53:0/4225247122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6dfc0047d0 0x7f6dfc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:46.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.340+0000 7f6e1603e640 1 --2- 172.21.15.53:0/4225247122 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6dfc003980 0x7f6dfc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:46.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.340+0000 7f6e1683f640 1 --2- 172.21.15.53:0/4225247122 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6dfc005180 0x7f6dfc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:46.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.340+0000 7f6e1583d640 1 -- 172.21.15.53:0/4225247122 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6dfc005180 msgr2=0x7f6dfc00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:04:46.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.340+0000 7f6e1583d640 1 --2- 172.21.15.53:0/4225247122 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6dfc005180 0x7f6dfc00b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:46.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.340+0000 7f6e1583d640 1 -- 172.21.15.53:0/4225247122 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6dfc003980 msgr2=0x7f6dfc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:04:46.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.340+0000 7f6e1583d640 1 --2- 172.21.15.53:0/4225247122 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6dfc003980 0x7f6dfc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:46.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.340+0000 7f6e1583d640 1 -- 172.21.15.53:0/4225247122 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dfc003530 con 0x7f6dfc0047d0 2023-06-10T19:04:46.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.340+0000 7f6e1683f640 1 -- 172.21.15.53:0/4225247122 reap_dead start 2023-06-10T19:04:46.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.344+0000 7f6e1583d640 1 --2- 172.21.15.53:0/4225247122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6dfc0047d0 0x7f6dfc004c40 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7f6e00001780 tx=0x7f6e0001c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e27cebb164c1549 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:46.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.344+0000 7f6e1503c640 1 -- 172.21.15.53:0/4225247122 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e000052d0 con 0x7f6dfc0047d0 2023-06-10T19:04:46.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.344+0000 7f6e1503c640 1 -- 172.21.15.53:0/4225247122 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e000a7050 con 0x7f6dfc0047d0 2023-06-10T19:04:46.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.344+0000 7f6e1503c640 1 -- 172.21.15.53:0/4225247122 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e00003600 con 0x7f6dfc0047d0 2023-06-10T19:04:46.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.344+0000 7f6e182a2640 1 -- 172.21.15.53:0/4225247122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6dfc0047d0 msgr2=0x7f6dfc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:46.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.344+0000 7f6e182a2640 1 --2- 172.21.15.53:0/4225247122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6dfc0047d0 0x7f6dfc004c40 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7f6e00001780 tx=0x7f6e0001c3b0 comp rx=0 tx=0).stop 2023-06-10T19:04:46.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.344+0000 7f6e182a2640 1 -- 172.21.15.53:0/4225247122 shutdown_connections 2023-06-10T19:04:46.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.344+0000 7f6e182a2640 1 --2- 172.21.15.53:0/4225247122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6dfc0047d0 0x7f6dfc004c40 unknown :-1 s=CLOSED pgs=1778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:46.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.344+0000 7f6e182a2640 1 -- 172.21.15.53:0/4225247122 >> 172.21.15.53:0/4225247122 conn(0x7f6e1006a0e0 msgr2=0x7f6e100cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:04:46.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.344+0000 7f6e182a2640 1 -- 172.21.15.53:0/4225247122 shutdown_connections 2023-06-10T19:04:46.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.344+0000 7f6e182a2640 1 -- 172.21.15.53:0/4225247122 wait complete. 2023-06-10T19:04:46.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.344+0000 7f6e182a2640 1 Processor -- start 2023-06-10T19:04:46.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.344+0000 7f6e182a2640 1 -- start start 2023-06-10T19:04:46.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.344+0000 7f6e182a2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6dfc0047d0 0x7f6e100c4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:46.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.344+0000 7f6e182a2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6e101f46e0 0x7f6e10155b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:46.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.344+0000 7f6e182a2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e100cd150 0x7f6e1015d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:46.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.344+0000 7f6e182a2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e100cb820 con 0x7f6e100cd150 2023-06-10T19:04:46.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.344+0000 7f6e182a2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e101f4c80 con 0x7f6dfc0047d0 2023-06-10T19:04:46.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.344+0000 7f6e182a2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e101f4f60 con 0x7f6e101f46e0 2023-06-10T19:04:46.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.344+0000 7f6e1683f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e100cd150 0x7f6e1015d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:46.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.344+0000 7f6e1683f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e100cd150 0x7f6e1015d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53518/0 (socket says 172.21.15.53:53518) 2023-06-10T19:04:46.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.344+0000 7f6e1683f640 1 -- 172.21.15.53:0/1895716349 learned_addr learned my addr 172.21.15.53:0/1895716349 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:04:46.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.344+0000 7f6e1603e640 1 --2- 172.21.15.53:0/1895716349 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6dfc0047d0 0x7f6e100c4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:46.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.344+0000 7f6e1583d640 1 --2- 172.21.15.53:0/1895716349 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6e101f46e0 0x7f6e10155b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:46.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.348+0000 7f6e1683f640 1 -- 172.21.15.53:0/1895716349 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6e101f46e0 msgr2=0x7f6e10155b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:46.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.348+0000 7f6e1683f640 1 --2- 172.21.15.53:0/1895716349 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6e101f46e0 0x7f6e10155b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:46.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.348+0000 7f6e1683f640 1 -- 172.21.15.53:0/1895716349 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6dfc0047d0 msgr2=0x7f6e100c4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:46.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.348+0000 7f6e1683f640 1 --2- 172.21.15.53:0/1895716349 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6dfc0047d0 0x7f6e100c4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:46.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.348+0000 7f6e1683f640 1 -- 172.21.15.53:0/1895716349 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e101f5240 con 0x7f6e100cd150 2023-06-10T19:04:46.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.348+0000 7f6e1603e640 1 --2- 172.21.15.53:0/1895716349 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6dfc0047d0 0x7f6e100c4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:04:46.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.348+0000 7f6e1683f640 1 --2- 172.21.15.53:0/1895716349 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e100cd150 0x7f6e1015d1d0 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f6e1006d4d0 tx=0x7f6e0800f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:46.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.348+0000 7f6e06ffd640 1 -- 172.21.15.53:0/1895716349 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e0800f910 con 0x7f6e100cd150 2023-06-10T19:04:46.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.348+0000 7f6e06ffd640 1 -- 172.21.15.53:0/1895716349 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e0800fa90 con 0x7f6e100cd150 2023-06-10T19:04:46.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.348+0000 7f6e06ffd640 1 -- 172.21.15.53:0/1895716349 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e0800fe40 con 0x7f6e100cd150 2023-06-10T19:04:46.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.348+0000 7f6e182a2640 1 -- 172.21.15.53:0/1895716349 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e101f5520 con 0x7f6e100cd150 2023-06-10T19:04:46.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.348+0000 7f6e182a2640 1 -- 172.21.15.53:0/1895716349 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e10156250 con 0x7f6e100cd150 2023-06-10T19:04:46.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.348+0000 7f6e182a2640 1 -- 172.21.15.53:0/1895716349 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e100cb990 con 0x7f6e100cd150 2023-06-10T19:04:46.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.348+0000 7f6e06ffd640 1 -- 172.21.15.53:0/1895716349 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6e08016420 con 0x7f6e100cd150 2023-06-10T19:04:46.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.348+0000 7f6e06ffd640 1 --2- 172.21.15.53:0/1895716349 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6df40662b0 0x7f6df4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:46.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.348+0000 7f6e06ffd640 1 -- 172.21.15.53:0/1895716349 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6192+0+0 (secure 0 0 0) 0x7f6e08084370 con 0x7f6e100cd150 2023-06-10T19:04:46.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.348+0000 7f6e1603e640 1 --2- 172.21.15.53:0/1895716349 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6df40662b0 0x7f6df4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:46.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.348+0000 7f6e1603e640 1 --2- 172.21.15.53:0/1895716349 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6df40662b0 0x7f6df4068760 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c001060 tx=0x7f6e0c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:46.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.352+0000 7f6e06ffd640 1 -- 172.21.15.53:0/1895716349 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6e100cb990 con 0x7f6e100cd150 2023-06-10T19:04:46.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.500+0000 7f6e182a2640 1 -- 172.21.15.53:0/1895716349 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6e101f5710 con 0x7f6e100cd150 2023-06-10T19:04:46.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.500+0000 7f6e06ffd640 1 -- 172.21.15.53:0/1895716349 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v113) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6e08055290 con 0x7f6e100cd150 2023-06-10T19:04:46.505 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-06-10T19:04:46.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.504+0000 7f6e182a2640 1 -- 172.21.15.53:0/1895716349 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6df40662b0 msgr2=0x7f6df4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:46.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.504+0000 7f6e182a2640 1 --2- 172.21.15.53:0/1895716349 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6df40662b0 0x7f6df4068760 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c001060 tx=0x7f6e0c009040 comp rx=0 tx=0).stop 2023-06-10T19:04:46.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.504+0000 7f6e182a2640 1 -- 172.21.15.53:0/1895716349 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e100cd150 msgr2=0x7f6e1015d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:46.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.504+0000 7f6e182a2640 1 --2- 172.21.15.53:0/1895716349 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e100cd150 0x7f6e1015d1d0 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f6e1006d4d0 tx=0x7f6e0800f150 comp rx=0 tx=0).stop 2023-06-10T19:04:46.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.504+0000 7f6e182a2640 1 -- 172.21.15.53:0/1895716349 shutdown_connections 2023-06-10T19:04:46.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.504+0000 7f6e182a2640 1 --2- 172.21.15.53:0/1895716349 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6df40662b0 0x7f6df4068760 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:46.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.504+0000 7f6e182a2640 1 --2- 172.21.15.53:0/1895716349 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e100cd150 0x7f6e1015d1d0 unknown :-1 s=CLOSED pgs=1779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:46.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.504+0000 7f6e182a2640 1 --2- 172.21.15.53:0/1895716349 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6e101f46e0 0x7f6e10155b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:46.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.504+0000 7f6e182a2640 1 --2- 172.21.15.53:0/1895716349 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6dfc0047d0 0x7f6e100c4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:46.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.504+0000 7f6e182a2640 1 -- 172.21.15.53:0/1895716349 >> 172.21.15.53:0/1895716349 conn(0x7f6e1006a0e0 msgr2=0x7f6e100700a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:04:46.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.504+0000 7f6e182a2640 1 -- 172.21.15.53:0/1895716349 shutdown_connections 2023-06-10T19:04:46.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.504+0000 7f6e182a2640 1 -- 172.21.15.53:0/1895716349 wait complete. 2023-06-10T19:04:46.522 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-10T19:04:46.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.640+0000 7ff5ab599640 1 Processor -- start 2023-06-10T19:04:46.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.640+0000 7ff5ab599640 1 -- start start 2023-06-10T19:04:46.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.640+0000 7ff5ab599640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff5a40aca00 0x7ff5a40ac320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:46.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.640+0000 7ff5ab599640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5a40ad0e0 con 0x7ff5a40afee0 2023-06-10T19:04:46.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.640+0000 7ff5ab599640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5a40ace40 con 0x7ff5a415b870 2023-06-10T19:04:46.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.640+0000 7ff5ab599640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a40ccd40 con 0x7ff5a40aca00 2023-06-10T19:04:46.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.640+0000 7ff5a8b34640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ff5a40afee0 0x7ff5a40c8760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:51586/0 (socket says 172.21.15.53:51586) 2023-06-10T19:04:46.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.640+0000 7ff5a8b34640 1 -- 172.21.15.53:0/226005323 learned_addr learned my addr 172.21.15.53:0/226005323 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:04:46.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.640+0000 7ff5a9b36640 1 --2- 172.21.15.53:0/226005323 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff5a40aca00 0x7ff5a40ac320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:46.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.640+0000 7ff59bfff640 1 -- 172.21.15.53:0/226005323 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4025240097 0 0) 0x7ff5a40ad0e0 con 0x7ff5a40afee0 2023-06-10T19:04:46.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.640+0000 7ff59bfff640 1 -- 172.21.15.53:0/226005323 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff590003530 con 0x7ff5a40afee0 2023-06-10T19:04:46.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.640+0000 7ff59bfff640 1 -- 172.21.15.53:0/226005323 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1456574949 0 0) 0x7ff590003530 con 0x7ff5a40afee0 2023-06-10T19:04:46.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.640+0000 7ff59bfff640 1 -- 172.21.15.53:0/226005323 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff5a40aca00 msgr2=0x7ff5a40ac320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:04:46.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.640+0000 7ff59bfff640 1 --2- 172.21.15.53:0/226005323 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff5a40aca00 0x7ff5a40ac320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:46.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.640+0000 7ff59bfff640 1 -- 172.21.15.53:0/226005323 >> v1:172.21.15.117:6789/0 conn(0x7ff5a415b870 legacy=0x7ff5a40af7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:46.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.640+0000 7ff59bfff640 1 -- 172.21.15.53:0/226005323 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a40cd400 con 0x7ff5a40afee0 2023-06-10T19:04:46.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.640+0000 7ff59bfff640 1 -- 172.21.15.53:0/226005323 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7ff594001680 con 0x7ff5a40afee0 2023-06-10T19:04:46.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.640+0000 7ff59bfff640 1 -- 172.21.15.53:0/226005323 >> v1:172.21.15.53:6789/0 conn(0x7ff5a40afee0 legacy=0x7ff5a40c8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:46.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.640+0000 7ff59bfff640 1 --2- 172.21.15.53:0/226005323 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff5900039b0 0x7ff590003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:46.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.640+0000 7ff59bfff640 1 --2- 172.21.15.53:0/226005323 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff5a40aca00 0x7ff5900047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:46.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.640+0000 7ff59bfff640 1 --2- 172.21.15.53:0/226005323 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff590004d10 0x7ff590005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:46.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.640+0000 7ff59bfff640 1 -- 172.21.15.53:0/226005323 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff59000ba40 con 0x7ff5900039b0 2023-06-10T19:04:46.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.640+0000 7ff59bfff640 1 -- 172.21.15.53:0/226005323 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff59000bb80 con 0x7ff590004d10 2023-06-10T19:04:46.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.640+0000 7ff59bfff640 1 -- 172.21.15.53:0/226005323 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff59000bd10 con 0x7ff5a40aca00 2023-06-10T19:04:46.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.640+0000 7ff5a9335640 1 --2- 172.21.15.53:0/226005323 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff5900039b0 0x7ff590003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:46.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.640+0000 7ff5a8b34640 1 --2- 172.21.15.53:0/226005323 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff5a40aca00 0x7ff5900047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:46.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.640+0000 7ff5a9335640 1 -- 172.21.15.53:0/226005323 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff5a40aca00 msgr2=0x7ff5900047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:04:46.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.640+0000 7ff5a9335640 1 --2- 172.21.15.53:0/226005323 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff5a40aca00 0x7ff5900047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:46.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.640+0000 7ff5a9335640 1 -- 172.21.15.53:0/226005323 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff590004d10 msgr2=0x7ff590005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:04:46.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.640+0000 7ff5a9335640 1 --2- 172.21.15.53:0/226005323 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff590004d10 0x7ff590005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:46.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.640+0000 7ff5a9335640 1 -- 172.21.15.53:0/226005323 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff590003530 con 0x7ff5900039b0 2023-06-10T19:04:46.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.644+0000 7ff5a9335640 1 --2- 172.21.15.53:0/226005323 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff5900039b0 0x7ff590003dc0 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7ff5a0001eb0 tx=0x7ff5a001c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9172ebe6d9f1c683 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:46.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.644+0000 7ff59bfff640 1 -- 172.21.15.53:0/226005323 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a0003bd0 con 0x7ff5900039b0 2023-06-10T19:04:46.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.644+0000 7ff59bfff640 1 -- 172.21.15.53:0/226005323 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a0003d30 con 0x7ff5900039b0 2023-06-10T19:04:46.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.644+0000 7ff59bfff640 1 -- 172.21.15.53:0/226005323 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a0003ea0 con 0x7ff5900039b0 2023-06-10T19:04:46.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.644+0000 7ff5ab599640 1 -- 172.21.15.53:0/226005323 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff5900039b0 msgr2=0x7ff590003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:46.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.644+0000 7ff5ab599640 1 --2- 172.21.15.53:0/226005323 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff5900039b0 0x7ff590003dc0 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7ff5a0001eb0 tx=0x7ff5a001c760 comp rx=0 tx=0).stop 2023-06-10T19:04:46.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.644+0000 7ff5a9b36640 1 -- 172.21.15.53:0/226005323 reap_dead start 2023-06-10T19:04:46.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.644+0000 7ff5ab599640 1 -- 172.21.15.53:0/226005323 shutdown_connections 2023-06-10T19:04:46.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.644+0000 7ff5ab599640 1 -- 172.21.15.53:0/226005323 >> 172.21.15.53:0/226005323 conn(0x7ff5a40ce9e0 msgr2=0x7ff5a40ca7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:04:46.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.644+0000 7ff5ab599640 1 -- 172.21.15.53:0/226005323 shutdown_connections 2023-06-10T19:04:46.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.644+0000 7ff5ab599640 1 -- 172.21.15.53:0/226005323 wait complete. 2023-06-10T19:04:46.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.644+0000 7ff5ab599640 1 Processor -- start 2023-06-10T19:04:46.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.644+0000 7ff5ab599640 1 -- start start 2023-06-10T19:04:46.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.648+0000 7ff5ab599640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff5900039b0 0x7ff5a4151180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:46.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.648+0000 7ff5ab599640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff5a4154a20 0x7ff5a40c3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:46.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.648+0000 7ff5ab599640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff5a4070040 0x7ff5a40704b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:46.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.648+0000 7ff5ab599640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a4156710 con 0x7ff5a4070040 2023-06-10T19:04:46.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.648+0000 7ff5ab599640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a40709f0 con 0x7ff5900039b0 2023-06-10T19:04:46.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.648+0000 7ff5ab599640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a41516c0 con 0x7ff5a4154a20 2023-06-10T19:04:46.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.648+0000 7ff5a9b36640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff5a4070040 0x7ff5a40704b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:46.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.648+0000 7ff5a9b36640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff5a4070040 0x7ff5a40704b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53532/0 (socket says 172.21.15.53:53532) 2023-06-10T19:04:46.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.648+0000 7ff5a9b36640 1 -- 172.21.15.53:0/2989290609 learned_addr learned my addr 172.21.15.53:0/2989290609 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:04:46.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.648+0000 7ff5a9335640 1 --2- 172.21.15.53:0/2989290609 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff5900039b0 0x7ff5a4151180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:46.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.648+0000 7ff5a8b34640 1 --2- 172.21.15.53:0/2989290609 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff5a4154a20 0x7ff5a40c3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:46.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.648+0000 7ff5a9b36640 1 -- 172.21.15.53:0/2989290609 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff5a4154a20 msgr2=0x7ff5a40c3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:46.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.648+0000 7ff5a9b36640 1 --2- 172.21.15.53:0/2989290609 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff5a4154a20 0x7ff5a40c3550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:46.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.648+0000 7ff5a9b36640 1 -- 172.21.15.53:0/2989290609 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff5900039b0 msgr2=0x7ff5a4151180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:46.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.648+0000 7ff5a9b36640 1 --2- 172.21.15.53:0/2989290609 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff5900039b0 0x7ff5a4151180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:46.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.648+0000 7ff5a9b36640 1 -- 172.21.15.53:0/2989290609 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a40c3dd0 con 0x7ff5a4070040 2023-06-10T19:04:46.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.648+0000 7ff5a9b36640 1 --2- 172.21.15.53:0/2989290609 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff5a4070040 0x7ff5a40704b0 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7ff5a406a510 tx=0x7ff59c00e830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:46.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.648+0000 7ff599ffb640 1 -- 172.21.15.53:0/2989290609 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59c00ecd0 con 0x7ff5a4070040 2023-06-10T19:04:46.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.648+0000 7ff599ffb640 1 -- 172.21.15.53:0/2989290609 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff59c00ee50 con 0x7ff5a4070040 2023-06-10T19:04:46.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.648+0000 7ff5ab599640 1 -- 172.21.15.53:0/2989290609 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5a40c40b0 con 0x7ff5a4070040 2023-06-10T19:04:46.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.648+0000 7ff599ffb640 1 -- 172.21.15.53:0/2989290609 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59c0136b0 con 0x7ff5a4070040 2023-06-10T19:04:46.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.648+0000 7ff5ab599640 1 -- 172.21.15.53:0/2989290609 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5a4156330 con 0x7ff5a4070040 2023-06-10T19:04:46.660 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.648+0000 7ff5ab599640 1 -- 172.21.15.53:0/2989290609 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5a4156850 con 0x7ff5a4070040 2023-06-10T19:04:46.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.648+0000 7ff599ffb640 1 -- 172.21.15.53:0/2989290609 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff59c013810 con 0x7ff5a4070040 2023-06-10T19:04:46.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.648+0000 7ff599ffb640 1 --2- 172.21.15.53:0/2989290609 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff5880662b0 0x7ff588068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:46.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.648+0000 7ff599ffb640 1 -- 172.21.15.53:0/2989290609 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6192+0+0 (secure 0 0 0) 0x7ff59c0830c0 con 0x7ff5a4070040 2023-06-10T19:04:46.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.648+0000 7ff5a9335640 1 --2- 172.21.15.53:0/2989290609 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff5880662b0 0x7ff588068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:46.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.652+0000 7ff5a9335640 1 --2- 172.21.15.53:0/2989290609 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff5880662b0 0x7ff588068760 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7ff5a0005000 tx=0x7ff5a0001570 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:46.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.652+0000 7ff599ffb640 1 -- 172.21.15.53:0/2989290609 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff5a4156850 con 0x7ff5a4070040 2023-06-10T19:04:46.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.812+0000 7ff5ab599640 1 -- 172.21.15.53:0/2989290609 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff5a4156850 con 0x7ff5a4070040 2023-06-10T19:04:46.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.812+0000 7ff599ffb640 1 -- 172.21.15.53:0/2989290609 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 1 entries v113) v1 ==== 80+0+57 (secure 0 0 0) 0x7ff5a4156850 con 0x7ff5a4070040 2023-06-10T19:04:46.817 INFO:teuthology.orchestra.run.smithi053.stdout:192.168.0.1:0/3878814772 2023-06-10T20:04:43.440652+0000 2023-06-10T19:04:46.818 INFO:teuthology.orchestra.run.smithi053.stderr:listed 1 entries 2023-06-10T19:04:46.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.812+0000 7ff5ab599640 1 -- 172.21.15.53:0/2989290609 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff5880662b0 msgr2=0x7ff588068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:46.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.812+0000 7ff5ab599640 1 --2- 172.21.15.53:0/2989290609 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff5880662b0 0x7ff588068760 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7ff5a0005000 tx=0x7ff5a0001570 comp rx=0 tx=0).stop 2023-06-10T19:04:46.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.812+0000 7ff5ab599640 1 -- 172.21.15.53:0/2989290609 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff5a4070040 msgr2=0x7ff5a40704b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:46.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.812+0000 7ff5ab599640 1 --2- 172.21.15.53:0/2989290609 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff5a4070040 0x7ff5a40704b0 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7ff5a406a510 tx=0x7ff59c00e830 comp rx=0 tx=0).stop 2023-06-10T19:04:46.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.812+0000 7ff5ab599640 1 -- 172.21.15.53:0/2989290609 shutdown_connections 2023-06-10T19:04:46.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.812+0000 7ff5ab599640 1 --2- 172.21.15.53:0/2989290609 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff5880662b0 0x7ff588068760 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:46.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.812+0000 7ff5ab599640 1 --2- 172.21.15.53:0/2989290609 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff5a4070040 0x7ff5a40704b0 unknown :-1 s=CLOSED pgs=1782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:46.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.812+0000 7ff5ab599640 1 --2- 172.21.15.53:0/2989290609 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff5a4154a20 0x7ff5a40c3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:46.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.812+0000 7ff5ab599640 1 --2- 172.21.15.53:0/2989290609 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff5900039b0 0x7ff5a4151180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:46.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.812+0000 7ff5ab599640 1 -- 172.21.15.53:0/2989290609 >> 172.21.15.53:0/2989290609 conn(0x7ff5a40ce9e0 msgr2=0x7ff5a41524f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:04:46.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.812+0000 7ff5ab599640 1 -- 172.21.15.53:0/2989290609 shutdown_connections 2023-06-10T19:04:46.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:46.812+0000 7ff5ab599640 1 -- 172.21.15.53:0/2989290609 wait complete. 2023-06-10T19:04:46.835 DEBUG:tasks.cephfs.mount:Force/lazy unmounting on client.0 2023-06-10T19:04:46.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:04:46.836 DEBUG:teuthology.orchestra.run.smithi053:> sudo umount --lazy --force /home/ubuntu/cephtest/mnt.0 2023-06-10T19:04:46.850 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[61053]: fuse finished with error 0 and tester_r 0 2023-06-10T19:04:46.851 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi053.front.sepia.ceph.com 2023-06-10T19:04:46.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:04:46.852 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-06-10T19:04:47.016 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T19:04:47.017 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:04:47.023 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:04:47.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.184+0000 7f84d1488640 1 Processor -- start 2023-06-10T19:04:47.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.184+0000 7f84d1488640 1 -- start start 2023-06-10T19:04:47.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.184+0000 7f84d1488640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f84cc162640 0x7f84cc164a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:47.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.184+0000 7f84d1488640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84cc159b50 con 0x7f84cc0c9840 2023-06-10T19:04:47.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.184+0000 7f84d1488640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84cc0702a0 con 0x7f84cc071060 2023-06-10T19:04:47.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.184+0000 7f84d1488640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84cc070580 con 0x7f84cc162640 2023-06-10T19:04:47.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.188+0000 7f84caffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f84cc0c9840 0x7f84cc0c9c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:51598/0 (socket says 172.21.15.53:51598) 2023-06-10T19:04:47.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.188+0000 7f84caffd640 1 -- 172.21.15.53:0/2162941666 learned_addr learned my addr 172.21.15.53:0/2162941666 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:04:47.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.188+0000 7f84cb7fe640 1 --2- 172.21.15.53:0/2162941666 >> v2:172.21.15.117:3300/0 conn(0x7f84cc162640 0x7f84cc164a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:47.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.188+0000 7f84ca7fc640 1 -- 172.21.15.53:0/2162941666 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1661589425 0 0) 0x7f84cc159b50 con 0x7f84cc0c9840 2023-06-10T19:04:47.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.188+0000 7f84ca7fc640 1 -- 172.21.15.53:0/2162941666 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84b8003530 con 0x7f84cc0c9840 2023-06-10T19:04:47.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.188+0000 7f84ca7fc640 1 -- 172.21.15.53:0/2162941666 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2799608550 0 0) 0x7f84b8003530 con 0x7f84cc0c9840 2023-06-10T19:04:47.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.188+0000 7f84ca7fc640 1 -- 172.21.15.53:0/2162941666 >> v2:172.21.15.117:3300/0 conn(0x7f84cc162640 msgr2=0x7f84cc164a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:04:47.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.188+0000 7f84ca7fc640 1 --2- 172.21.15.53:0/2162941666 >> v2:172.21.15.117:3300/0 conn(0x7f84cc162640 0x7f84cc164a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:47.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.188+0000 7f84ca7fc640 1 -- 172.21.15.53:0/2162941666 >> v1:172.21.15.117:6789/0 conn(0x7f84cc071060 legacy=0x7f84cc0af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:47.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.188+0000 7f84ca7fc640 1 -- 172.21.15.53:0/2162941666 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84cc070860 con 0x7f84cc0c9840 2023-06-10T19:04:47.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.188+0000 7f84ca7fc640 1 -- 172.21.15.53:0/2162941666 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f84bc001680 con 0x7f84cc0c9840 2023-06-10T19:04:47.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.188+0000 7f84ca7fc640 1 -- 172.21.15.53:0/2162941666 >> v1:172.21.15.53:6789/0 conn(0x7f84cc0c9840 legacy=0x7f84cc0c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:47.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.188+0000 7f84ca7fc640 1 --2- 172.21.15.53:0/2162941666 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84b80039f0 0x7f84b8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:47.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.188+0000 7f84ca7fc640 1 --2- 172.21.15.53:0/2162941666 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f84b80047d0 0x7f84b8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:47.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.188+0000 7f84ca7fc640 1 --2- 172.21.15.53:0/2162941666 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84b8005180 0x7f84b800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:47.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.188+0000 7f84ca7fc640 1 -- 172.21.15.53:0/2162941666 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84cc070580 con 0x7f84b8005180 2023-06-10T19:04:47.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.188+0000 7f84ca7fc640 1 -- 172.21.15.53:0/2162941666 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b800c060 con 0x7f84b80039f0 2023-06-10T19:04:47.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.188+0000 7f84ca7fc640 1 -- 172.21.15.53:0/2162941666 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84b800c220 con 0x7f84b80047d0 2023-06-10T19:04:47.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.188+0000 7f84cb7fe640 1 --2- 172.21.15.53:0/2162941666 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84b8005180 0x7f84b800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:47.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.188+0000 7f84caffd640 1 --2- 172.21.15.53:0/2162941666 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84b80039f0 0x7f84b8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:47.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.188+0000 7f84c27fc640 1 --2- 172.21.15.53:0/2162941666 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f84b80047d0 0x7f84b8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:47.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.188+0000 7f84cb7fe640 1 -- 172.21.15.53:0/2162941666 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f84b80047d0 msgr2=0x7f84b8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:04:47.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.188+0000 7f84cb7fe640 1 --2- 172.21.15.53:0/2162941666 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f84b80047d0 0x7f84b8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:47.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.188+0000 7f84cb7fe640 1 -- 172.21.15.53:0/2162941666 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84b80039f0 msgr2=0x7f84b8003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:04:47.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.188+0000 7f84cb7fe640 1 --2- 172.21.15.53:0/2162941666 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84b80039f0 0x7f84b8003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:47.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.188+0000 7f84cb7fe640 1 -- 172.21.15.53:0/2162941666 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b8003530 con 0x7f84b8005180 2023-06-10T19:04:47.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.188+0000 7f84caffd640 1 --2- 172.21.15.53:0/2162941666 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84b80039f0 0x7f84b8003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:04:47.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.188+0000 7f84cb7fe640 1 -- 172.21.15.53:0/2162941666 reap_dead start 2023-06-10T19:04:47.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.188+0000 7f84cb7fe640 1 --2- 172.21.15.53:0/2162941666 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84b8005180 0x7f84b800b990 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7f84cc06e7e0 tx=0x7f84c401cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71525f0d68751ee3 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:47.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.188+0000 7f84ca7fc640 1 -- 172.21.15.53:0/2162941666 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c40a5c50 con 0x7f84b8005180 2023-06-10T19:04:47.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.188+0000 7f84ca7fc640 1 -- 172.21.15.53:0/2162941666 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84c400f040 con 0x7f84b8005180 2023-06-10T19:04:47.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.188+0000 7f84ca7fc640 1 -- 172.21.15.53:0/2162941666 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c40ad440 con 0x7f84b8005180 2023-06-10T19:04:47.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.188+0000 7f84d1488640 1 -- 172.21.15.53:0/2162941666 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84b8005180 msgr2=0x7f84b800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:47.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.188+0000 7f84d1488640 1 --2- 172.21.15.53:0/2162941666 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84b8005180 0x7f84b800b990 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7f84cc06e7e0 tx=0x7f84c401cc40 comp rx=0 tx=0).stop 2023-06-10T19:04:47.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.192+0000 7f84d1488640 1 -- 172.21.15.53:0/2162941666 shutdown_connections 2023-06-10T19:04:47.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.192+0000 7f84d1488640 1 --2- 172.21.15.53:0/2162941666 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84b8005180 0x7f84b800b990 unknown :-1 s=CLOSED pgs=1784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:47.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.192+0000 7f84d1488640 1 -- 172.21.15.53:0/2162941666 >> 172.21.15.53:0/2162941666 conn(0x7f84cc06a0d0 msgr2=0x7f84cc0ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:04:47.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.192+0000 7f84d1488640 1 -- 172.21.15.53:0/2162941666 shutdown_connections 2023-06-10T19:04:47.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.192+0000 7f84d1488640 1 -- 172.21.15.53:0/2162941666 wait complete. 2023-06-10T19:04:47.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.192+0000 7f84d1488640 1 Processor -- start 2023-06-10T19:04:47.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.192+0000 7f84d1488640 1 -- start start 2023-06-10T19:04:47.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.192+0000 7f84d1488640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84b8005180 0x7f84cc0ccc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:47.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.192+0000 7f84d1488640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f84cc0ac380 0x7f84cc0cc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:47.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.192+0000 7f84d1488640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84cc1f0d40 0x7f84cc157e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:47.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.192+0000 7f84d1488640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84cc0cd870 con 0x7f84b8005180 2023-06-10T19:04:47.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.192+0000 7f84d1488640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84cc0cc6e0 con 0x7f84cc1f0d40 2023-06-10T19:04:47.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.192+0000 7f84d1488640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84cc0cd2b0 con 0x7f84cc0ac380 2023-06-10T19:04:47.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.192+0000 7f84caffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84b8005180 0x7f84cc0ccc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:47.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.192+0000 7f84caffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84b8005180 0x7f84cc0ccc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53546/0 (socket says 172.21.15.53:53546) 2023-06-10T19:04:47.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.192+0000 7f84caffd640 1 -- 172.21.15.53:0/2334285224 learned_addr learned my addr 172.21.15.53:0/2334285224 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:04:47.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.192+0000 7f84cb7fe640 1 --2- 172.21.15.53:0/2334285224 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84cc1f0d40 0x7f84cc157e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:47.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.192+0000 7f84c27fc640 1 --2- 172.21.15.53:0/2334285224 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f84cc0ac380 0x7f84cc0cc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:47.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.192+0000 7f84caffd640 1 -- 172.21.15.53:0/2334285224 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f84cc0ac380 msgr2=0x7f84cc0cc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:47.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.192+0000 7f84caffd640 1 --2- 172.21.15.53:0/2334285224 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f84cc0ac380 0x7f84cc0cc1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:47.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.192+0000 7f84caffd640 1 -- 172.21.15.53:0/2334285224 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84cc1f0d40 msgr2=0x7f84cc157e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:47.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.192+0000 7f84caffd640 1 --2- 172.21.15.53:0/2334285224 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84cc1f0d40 0x7f84cc157e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:47.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.192+0000 7f84caffd640 1 -- 172.21.15.53:0/2334285224 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84cc0cd590 con 0x7f84b8005180 2023-06-10T19:04:47.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.192+0000 7f84cb7fe640 1 --2- 172.21.15.53:0/2334285224 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84cc1f0d40 0x7f84cc157e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:04:47.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.192+0000 7f84caffd640 1 --2- 172.21.15.53:0/2334285224 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84b8005180 0x7f84cc0ccc40 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7f84bc0018f0 tx=0x7f84bc00ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:47.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.192+0000 7f84c3fff640 1 -- 172.21.15.53:0/2334285224 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84bc00ee60 con 0x7f84b8005180 2023-06-10T19:04:47.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.192+0000 7f84c3fff640 1 -- 172.21.15.53:0/2334285224 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84bc00c840 con 0x7f84b8005180 2023-06-10T19:04:47.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.192+0000 7f84d1488640 1 -- 172.21.15.53:0/2334285224 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84cc0cb9a0 con 0x7f84b8005180 2023-06-10T19:04:47.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.192+0000 7f84c3fff640 1 -- 172.21.15.53:0/2334285224 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84bc00cbb0 con 0x7f84b8005180 2023-06-10T19:04:47.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.192+0000 7f84d1488640 1 -- 172.21.15.53:0/2334285224 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84cc0ac7f0 con 0x7f84b8005180 2023-06-10T19:04:47.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.192+0000 7f84d1488640 1 -- 172.21.15.53:0/2334285224 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84cc04d790 con 0x7f84b8005180 2023-06-10T19:04:47.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.196+0000 7f84c3fff640 1 -- 172.21.15.53:0/2334285224 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f84bc00cd10 con 0x7f84b8005180 2023-06-10T19:04:47.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.196+0000 7f84c3fff640 1 --2- 172.21.15.53:0/2334285224 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f84ac0662b0 0x7f84ac068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:47.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.196+0000 7f84c3fff640 1 -- 172.21.15.53:0/2334285224 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6192+0+0 (secure 0 0 0) 0x7f84bc083c40 con 0x7f84b8005180 2023-06-10T19:04:47.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.196+0000 7f84c27fc640 1 --2- 172.21.15.53:0/2334285224 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f84ac0662b0 0x7f84ac068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:47.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.196+0000 7f84c27fc640 1 --2- 172.21.15.53:0/2334285224 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f84ac0662b0 0x7f84ac068760 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f84b4000c10 tx=0x7f84b4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:47.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.200+0000 7f84c3fff640 1 -- 172.21.15.53:0/2334285224 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f84bc051050 con 0x7f84b8005180 2023-06-10T19:04:47.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.348+0000 7f84d1488640 1 -- 172.21.15.53:0/2334285224 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f84cc0cb140 con 0x7f84b8005180 2023-06-10T19:04:47.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.352+0000 7f84c3fff640 1 -- 172.21.15.53:0/2334285224 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) v1 ==== 74+0+18486 (secure 0 0 0) 0x7f84bc054670 con 0x7f84b8005180 2023-06-10T19:04:47.356 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:04:47.357 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":113,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:04:44.261377+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-06-10T19:03:46.427131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-06-10T19:03:47.398979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.d","mappings":[{"from":6,"to":7}]},{"pgid":"16.13","mappings":[{"from":1,"to":4}]},{"pgid":"16.1e","mappings":[{"from":5,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.0.1:0/3878814772":"2023-06-10T20:04:43.440652+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:04:47.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.352+0000 7f84d1488640 1 -- 172.21.15.53:0/2334285224 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f84ac0662b0 msgr2=0x7f84ac068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:47.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.352+0000 7f84d1488640 1 --2- 172.21.15.53:0/2334285224 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f84ac0662b0 0x7f84ac068760 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f84b4000c10 tx=0x7f84b4009040 comp rx=0 tx=0).stop 2023-06-10T19:04:47.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.352+0000 7f84d1488640 1 -- 172.21.15.53:0/2334285224 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84b8005180 msgr2=0x7f84cc0ccc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:47.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.352+0000 7f84d1488640 1 --2- 172.21.15.53:0/2334285224 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84b8005180 0x7f84cc0ccc40 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7f84bc0018f0 tx=0x7f84bc00ec10 comp rx=0 tx=0).stop 2023-06-10T19:04:47.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.352+0000 7f84d1488640 1 -- 172.21.15.53:0/2334285224 shutdown_connections 2023-06-10T19:04:47.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.352+0000 7f84d1488640 1 --2- 172.21.15.53:0/2334285224 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f84ac0662b0 0x7f84ac068760 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:47.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.352+0000 7f84d1488640 1 --2- 172.21.15.53:0/2334285224 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84cc1f0d40 0x7f84cc157e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:47.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.352+0000 7f84d1488640 1 --2- 172.21.15.53:0/2334285224 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f84cc0ac380 0x7f84cc0cc1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:47.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.352+0000 7f84d1488640 1 --2- 172.21.15.53:0/2334285224 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84b8005180 0x7f84cc0ccc40 unknown :-1 s=CLOSED pgs=1785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:47.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.352+0000 7f84d1488640 1 -- 172.21.15.53:0/2334285224 >> 172.21.15.53:0/2334285224 conn(0x7f84cc06a0d0 msgr2=0x7f84cc0ad700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:04:47.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.352+0000 7f84d1488640 1 -- 172.21.15.53:0/2334285224 shutdown_connections 2023-06-10T19:04:47.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.352+0000 7f84d1488640 1 -- 172.21.15.53:0/2334285224 wait complete. 2023-06-10T19:04:47.374 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-10T18:52:33.633114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-10T18:52:39.171487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-10T19:03:46.427131+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '109', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2023-06-10T19:03:47.398979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '110', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-10T19:04:47.375 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-10T19:04:47.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.496+0000 7f8892e10640 1 Processor -- start 2023-06-10T19:04:47.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.496+0000 7f8892e10640 1 -- start start 2023-06-10T19:04:47.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.496+0000 7f8892e10640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f888c0af760 0x7f888c0c9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:47.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.496+0000 7f8892e10640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f888c0afb30 0x7f888c15dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:47.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.496+0000 7f8892e10640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f888c070b80 0x7f888c06b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:47.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.496+0000 7f8892e10640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f888c0706f0 con 0x7f888c070b80 2023-06-10T19:04:47.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.496+0000 7f8892e10640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f888c0700e0 con 0x7f888c0afb30 2023-06-10T19:04:47.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.496+0000 7f8892e10640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f888c0c9e10 con 0x7f888c0af760 2023-06-10T19:04:47.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.496+0000 7f88913ad640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f888c070b80 0x7f888c06b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:47.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.496+0000 7f88913ad640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f888c070b80 0x7f888c06b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53556/0 (socket says 172.21.15.53:53556) 2023-06-10T19:04:47.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.496+0000 7f88913ad640 1 -- 172.21.15.53:0/816038742 learned_addr learned my addr 172.21.15.53:0/816038742 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:04:47.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.496+0000 7f888bfff640 1 --2- 172.21.15.53:0/816038742 >> v2:172.21.15.117:3300/0 conn(0x7f888c0afb30 0x7f888c15dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:47.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.496+0000 7f8890bac640 1 --2- 172.21.15.53:0/816038742 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f888c0af760 0x7f888c0c9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:47.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.496+0000 7f88913ad640 1 -- 172.21.15.53:0/816038742 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f888c0af760 msgr2=0x7f888c0c9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:04:47.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.496+0000 7f88913ad640 1 --2- 172.21.15.53:0/816038742 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f888c0af760 0x7f888c0c9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:47.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.496+0000 7f88913ad640 1 -- 172.21.15.53:0/816038742 >> v2:172.21.15.117:3300/0 conn(0x7f888c0afb30 msgr2=0x7f888c15dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:04:47.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.496+0000 7f88913ad640 1 --2- 172.21.15.53:0/816038742 >> v2:172.21.15.117:3300/0 conn(0x7f888c0afb30 0x7f888c15dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:47.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.496+0000 7f88913ad640 1 -- 172.21.15.53:0/816038742 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f888c0ca0f0 con 0x7f888c070b80 2023-06-10T19:04:47.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.496+0000 7f888bfff640 1 --2- 172.21.15.53:0/816038742 >> v2:172.21.15.117:3300/0 conn(0x7f888c0afb30 0x7f888c15dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:04:47.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.496+0000 7f8890bac640 1 --2- 172.21.15.53:0/816038742 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f888c0af760 0x7f888c0c9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:04:47.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.500+0000 7f88913ad640 1 --2- 172.21.15.53:0/816038742 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f888c070b80 0x7f888c06b090 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7f888c06e620 tx=0x7f888401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7066158d3a8b1d4b server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:47.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.500+0000 7f888b7fe640 1 -- 172.21.15.53:0/816038742 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88840a5800 con 0x7f888c070b80 2023-06-10T19:04:47.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.500+0000 7f888b7fe640 1 -- 172.21.15.53:0/816038742 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88840a5960 con 0x7f888c070b80 2023-06-10T19:04:47.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.500+0000 7f888b7fe640 1 -- 172.21.15.53:0/816038742 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88840a5cf0 con 0x7f888c070b80 2023-06-10T19:04:47.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.500+0000 7f8892e10640 1 -- 172.21.15.53:0/816038742 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f888c070b80 msgr2=0x7f888c06b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:47.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.500+0000 7f8892e10640 1 --2- 172.21.15.53:0/816038742 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f888c070b80 0x7f888c06b090 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7f888c06e620 tx=0x7f888401c9a0 comp rx=0 tx=0).stop 2023-06-10T19:04:47.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.500+0000 7f8892e10640 1 -- 172.21.15.53:0/816038742 shutdown_connections 2023-06-10T19:04:47.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.500+0000 7f8892e10640 1 --2- 172.21.15.53:0/816038742 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f888c070b80 0x7f888c06b090 unknown :-1 s=CLOSED pgs=1786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:47.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.500+0000 7f8892e10640 1 --2- 172.21.15.53:0/816038742 >> v2:172.21.15.117:3300/0 conn(0x7f888c0afb30 0x7f888c15dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:47.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.500+0000 7f8892e10640 1 --2- 172.21.15.53:0/816038742 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f888c0af760 0x7f888c0c9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:47.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.500+0000 7f8892e10640 1 -- 172.21.15.53:0/816038742 >> 172.21.15.53:0/816038742 conn(0x7f888c06a0e0 msgr2=0x7f888c0cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:04:47.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.500+0000 7f8892e10640 1 -- 172.21.15.53:0/816038742 shutdown_connections 2023-06-10T19:04:47.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.500+0000 7f8892e10640 1 -- 172.21.15.53:0/816038742 wait complete. 2023-06-10T19:04:47.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.500+0000 7f8892e10640 1 Processor -- start 2023-06-10T19:04:47.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.500+0000 7f8892e10640 1 -- start start 2023-06-10T19:04:47.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.500+0000 7f8892e10640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f888c070b80 0x7f888c0c2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:47.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.500+0000 7f8892e10640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f888c0af760 0x7f888c153fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:47.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.500+0000 7f8892e10640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f888c0afb30 0x7f888c0c3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:47.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.500+0000 7f8892e10640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f888c0c1ec0 con 0x7f888c070b80 2023-06-10T19:04:47.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.500+0000 7f8892e10640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f888c0c1900 con 0x7f888c0afb30 2023-06-10T19:04:47.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.500+0000 7f8892e10640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f888c0c1be0 con 0x7f888c0af760 2023-06-10T19:04:47.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.500+0000 7f8890bac640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f888c070b80 0x7f888c0c2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:47.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.500+0000 7f8890bac640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f888c070b80 0x7f888c0c2100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53572/0 (socket says 172.21.15.53:53572) 2023-06-10T19:04:47.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.500+0000 7f8890bac640 1 -- 172.21.15.53:0/3853687300 learned_addr learned my addr 172.21.15.53:0/3853687300 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:04:47.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.500+0000 7f88913ad640 1 --2- 172.21.15.53:0/3853687300 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f888c0afb30 0x7f888c0c3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:47.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.500+0000 7f888bfff640 1 --2- 172.21.15.53:0/3853687300 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f888c0af760 0x7f888c153fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:47.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.504+0000 7f8890bac640 1 -- 172.21.15.53:0/3853687300 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f888c0af760 msgr2=0x7f888c153fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:47.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.504+0000 7f8890bac640 1 --2- 172.21.15.53:0/3853687300 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f888c0af760 0x7f888c153fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:47.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.504+0000 7f8890bac640 1 -- 172.21.15.53:0/3853687300 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f888c0afb30 msgr2=0x7f888c0c3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:47.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.504+0000 7f8890bac640 1 --2- 172.21.15.53:0/3853687300 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f888c0afb30 0x7f888c0c3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:47.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.504+0000 7f8890bac640 1 -- 172.21.15.53:0/3853687300 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8884009b30 con 0x7f888c070b80 2023-06-10T19:04:47.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.504+0000 7f8890bac640 1 --2- 172.21.15.53:0/3853687300 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f888c070b80 0x7f888c0c2100 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7f887c00c7c0 tx=0x7f887c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:47.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.504+0000 7f88897fa640 1 -- 172.21.15.53:0/3853687300 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f887c007a30 con 0x7f888c070b80 2023-06-10T19:04:47.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.504+0000 7f88897fa640 1 -- 172.21.15.53:0/3853687300 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f887c007b90 con 0x7f888c070b80 2023-06-10T19:04:47.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.504+0000 7f8892e10640 1 -- 172.21.15.53:0/3853687300 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f888c0b17b0 con 0x7f888c070b80 2023-06-10T19:04:47.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.504+0000 7f88897fa640 1 -- 172.21.15.53:0/3853687300 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f887c00ce70 con 0x7f888c070b80 2023-06-10T19:04:47.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.504+0000 7f8892e10640 1 -- 172.21.15.53:0/3853687300 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f888c0c2640 con 0x7f888c070b80 2023-06-10T19:04:47.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.504+0000 7f8892e10640 1 -- 172.21.15.53:0/3853687300 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f888c04d790 con 0x7f888c070b80 2023-06-10T19:04:47.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.504+0000 7f88897fa640 1 -- 172.21.15.53:0/3853687300 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f887c0113f0 con 0x7f888c070b80 2023-06-10T19:04:47.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.504+0000 7f88897fa640 1 --2- 172.21.15.53:0/3853687300 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f88780662b0 0x7f8878068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:47.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.504+0000 7f88897fa640 1 -- 172.21.15.53:0/3853687300 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6192+0+0 (secure 0 0 0) 0x7f887c083f30 con 0x7f888c070b80 2023-06-10T19:04:47.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.504+0000 7f888bfff640 1 --2- 172.21.15.53:0/3853687300 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f88780662b0 0x7f8878068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:47.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.504+0000 7f888bfff640 1 --2- 172.21.15.53:0/3853687300 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f88780662b0 0x7f8878068760 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f888c164570 tx=0x7f8880008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:47.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.508+0000 7f88897fa640 1 -- 172.21.15.53:0/3853687300 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f887c0512d0 con 0x7f888c070b80 2023-06-10T19:04:47.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.660+0000 7f8892e10640 1 -- 172.21.15.53:0/3853687300 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f888c0ce560 con 0x7f888c070b80 2023-06-10T19:04:47.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.664+0000 7f88897fa640 1 -- 172.21.15.53:0/3853687300 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v113) v1 ==== 93+0+10 (secure 0 0 0) 0x7f887c0548f0 con 0x7f888c070b80 2023-06-10T19:04:47.668 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-06-10T19:04:47.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.664+0000 7f8892e10640 1 -- 172.21.15.53:0/3853687300 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f88780662b0 msgr2=0x7f8878068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:47.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.664+0000 7f8892e10640 1 --2- 172.21.15.53:0/3853687300 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f88780662b0 0x7f8878068760 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f888c164570 tx=0x7f8880008040 comp rx=0 tx=0).stop 2023-06-10T19:04:47.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.664+0000 7f8892e10640 1 -- 172.21.15.53:0/3853687300 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f888c070b80 msgr2=0x7f888c0c2100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:47.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.664+0000 7f8892e10640 1 --2- 172.21.15.53:0/3853687300 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f888c070b80 0x7f888c0c2100 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7f887c00c7c0 tx=0x7f887c00cc80 comp rx=0 tx=0).stop 2023-06-10T19:04:47.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.664+0000 7f8892e10640 1 -- 172.21.15.53:0/3853687300 shutdown_connections 2023-06-10T19:04:47.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.664+0000 7f8892e10640 1 --2- 172.21.15.53:0/3853687300 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f88780662b0 0x7f8878068760 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:47.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.664+0000 7f8892e10640 1 --2- 172.21.15.53:0/3853687300 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f888c0afb30 0x7f888c0c3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:47.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.664+0000 7f8892e10640 1 --2- 172.21.15.53:0/3853687300 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f888c0af760 0x7f888c153fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:47.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.664+0000 7f8892e10640 1 --2- 172.21.15.53:0/3853687300 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f888c070b80 0x7f888c0c2100 unknown :-1 s=CLOSED pgs=1787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:47.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.664+0000 7f8892e10640 1 -- 172.21.15.53:0/3853687300 >> 172.21.15.53:0/3853687300 conn(0x7f888c06a0e0 msgr2=0x7f888c15d340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:04:47.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.664+0000 7f8892e10640 1 -- 172.21.15.53:0/3853687300 shutdown_connections 2023-06-10T19:04:47.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.664+0000 7f8892e10640 1 -- 172.21.15.53:0/3853687300 wait complete. 2023-06-10T19:04:47.687 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-10T19:04:47.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.804+0000 7fe6e70e8640 1 Processor -- start 2023-06-10T19:04:47.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.804+0000 7fe6e70e8640 1 -- start start 2023-06-10T19:04:47.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.804+0000 7fe6e70e8640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe6e00b7e30 0x7fe6e00b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:47.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.804+0000 7fe6e70e8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe6e00b0b90 0x7fe6e00d04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:47.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.804+0000 7fe6e70e8640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6e00cc7c0 con 0x7fe6e015c090 2023-06-10T19:04:47.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.804+0000 7fe6e70e8640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6e00ccaa0 con 0x7fe6e00b0b90 2023-06-10T19:04:47.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.804+0000 7fe6e70e8640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6e00ccd80 con 0x7fe6e00b7e30 2023-06-10T19:04:47.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.804+0000 7fe6e5685640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe6e00b0b90 0x7fe6e00d04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:47.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.808+0000 7fe6e5685640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe6e00b0b90 0x7fe6e00d04d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53578/0 (socket says 172.21.15.53:53578) 2023-06-10T19:04:47.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.808+0000 7fe6e5685640 1 -- 172.21.15.53:0/3304227522 learned_addr learned my addr 172.21.15.53:0/3304227522 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:04:47.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.808+0000 7fe6dffff640 1 --2- 172.21.15.53:0/3304227522 >> v2:172.21.15.117:3300/0 conn(0x7fe6e00b7e30 0x7fe6e00b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:47.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.808+0000 7fe6e5685640 1 -- 172.21.15.53:0/3304227522 >> v2:172.21.15.117:3300/0 conn(0x7fe6e00b7e30 msgr2=0x7fe6e00b10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:04:47.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.808+0000 7fe6e5685640 1 --2- 172.21.15.53:0/3304227522 >> v2:172.21.15.117:3300/0 conn(0x7fe6e00b7e30 0x7fe6e00b10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:47.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.808+0000 7fe6e5685640 1 -- 172.21.15.53:0/3304227522 >> v1:172.21.15.117:6789/0 conn(0x7fe6e015c090 legacy=0x7fe6e00b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:04:47.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.808+0000 7fe6e5685640 1 -- 172.21.15.53:0/3304227522 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e00cd060 con 0x7fe6e00b0b90 2023-06-10T19:04:47.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.808+0000 7fe6e5685640 1 --2- 172.21.15.53:0/3304227522 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6e00b0b90 0x7fe6e00d04d0 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7fe6e00b4c30 tx=0x7fe6d801c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4f3f0f742d566e9 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:47.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.808+0000 7fe6df7fe640 1 -- 172.21.15.53:0/3304227522 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d80a56f0 con 0x7fe6e00b0b90 2023-06-10T19:04:47.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.808+0000 7fe6df7fe640 1 -- 172.21.15.53:0/3304227522 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6d80a5850 con 0x7fe6e00b0b90 2023-06-10T19:04:47.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.808+0000 7fe6df7fe640 1 -- 172.21.15.53:0/3304227522 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d80a5be0 con 0x7fe6e00b0b90 2023-06-10T19:04:47.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.812+0000 7fe6e70e8640 1 -- 172.21.15.53:0/3304227522 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6e00b0b90 msgr2=0x7fe6e00d04d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:47.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.812+0000 7fe6e70e8640 1 --2- 172.21.15.53:0/3304227522 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6e00b0b90 0x7fe6e00d04d0 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7fe6e00b4c30 tx=0x7fe6d801c8d0 comp rx=0 tx=0).stop 2023-06-10T19:04:47.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.812+0000 7fe6e70e8640 1 -- 172.21.15.53:0/3304227522 shutdown_connections 2023-06-10T19:04:47.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.812+0000 7fe6e70e8640 1 --2- 172.21.15.53:0/3304227522 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6e00b0b90 0x7fe6e00d04d0 unknown :-1 s=CLOSED pgs=1788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:47.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.812+0000 7fe6e70e8640 1 --2- 172.21.15.53:0/3304227522 >> v2:172.21.15.117:3300/0 conn(0x7fe6e00b7e30 0x7fe6e00b10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:47.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.812+0000 7fe6e70e8640 1 -- 172.21.15.53:0/3304227522 >> 172.21.15.53:0/3304227522 conn(0x7fe6e0069e20 msgr2=0x7fe6e006a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:04:47.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.812+0000 7fe6e70e8640 1 -- 172.21.15.53:0/3304227522 shutdown_connections 2023-06-10T19:04:47.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.812+0000 7fe6e70e8640 1 -- 172.21.15.53:0/3304227522 wait complete. 2023-06-10T19:04:47.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.812+0000 7fe6e70e8640 1 Processor -- start 2023-06-10T19:04:47.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.812+0000 7fe6e70e8640 1 -- start start 2023-06-10T19:04:47.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.812+0000 7fe6e70e8640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6e00b0b90 0x7fe6e0152900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:47.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.812+0000 7fe6e70e8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6e00b7e30 0x7fe6e014dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:47.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.812+0000 7fe6e70e8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6e015c090 0x7fe6e014e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:47.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.812+0000 7fe6e70e8640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e01507b0 con 0x7fe6e00b7e30 2023-06-10T19:04:47.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.812+0000 7fe6e70e8640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e00c9be0 con 0x7fe6e015c090 2023-06-10T19:04:47.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.812+0000 7fe6e70e8640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e014e770 con 0x7fe6e00b0b90 2023-06-10T19:04:47.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.812+0000 7fe6dffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6e00b7e30 0x7fe6e014dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:47.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.812+0000 7fe6dffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6e00b7e30 0x7fe6e014dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53594/0 (socket says 172.21.15.53:53594) 2023-06-10T19:04:47.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.812+0000 7fe6dffff640 1 -- 172.21.15.53:0/1740434620 learned_addr learned my addr 172.21.15.53:0/1740434620 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:04:47.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.812+0000 7fe6e4e84640 1 --2- 172.21.15.53:0/1740434620 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6e00b0b90 0x7fe6e0152900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:47.824 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.812+0000 7fe6e5685640 1 --2- 172.21.15.53:0/1740434620 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6e015c090 0x7fe6e014e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:47.824 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.812+0000 7fe6dffff640 1 -- 172.21.15.53:0/1740434620 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6e00b0b90 msgr2=0x7fe6e0152900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:47.824 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.812+0000 7fe6dffff640 1 --2- 172.21.15.53:0/1740434620 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6e00b0b90 0x7fe6e0152900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:47.824 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.812+0000 7fe6dffff640 1 -- 172.21.15.53:0/1740434620 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6e015c090 msgr2=0x7fe6e014e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:47.824 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.812+0000 7fe6dffff640 1 --2- 172.21.15.53:0/1740434620 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6e015c090 0x7fe6e014e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:47.824 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.812+0000 7fe6dffff640 1 -- 172.21.15.53:0/1740434620 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6d8009b30 con 0x7fe6e00b7e30 2023-06-10T19:04:47.824 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.812+0000 7fe6e5685640 1 --2- 172.21.15.53:0/1740434620 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6e015c090 0x7fe6e014e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:04:47.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.812+0000 7fe6dffff640 1 --2- 172.21.15.53:0/1740434620 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6e00b7e30 0x7fe6e014dbc0 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7fe6d400d800 tx=0x7fe6d400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:47.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.812+0000 7fe6dd7fa640 1 -- 172.21.15.53:0/1740434620 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d400b6c0 con 0x7fe6e00b7e30 2023-06-10T19:04:47.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.812+0000 7fe6dd7fa640 1 -- 172.21.15.53:0/1740434620 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6d400b820 con 0x7fe6e00b7e30 2023-06-10T19:04:47.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.812+0000 7fe6dd7fa640 1 -- 172.21.15.53:0/1740434620 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d400bb90 con 0x7fe6e00b7e30 2023-06-10T19:04:47.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.812+0000 7fe6e70e8640 1 -- 172.21.15.53:0/1740434620 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6e014ea50 con 0x7fe6e00b7e30 2023-06-10T19:04:47.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.812+0000 7fe6e70e8640 1 -- 172.21.15.53:0/1740434620 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6e014f010 con 0x7fe6e00b7e30 2023-06-10T19:04:47.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.816+0000 7fe6e70e8640 1 -- 172.21.15.53:0/1740434620 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6e00c9a40 con 0x7fe6e00b7e30 2023-06-10T19:04:47.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.816+0000 7fe6dd7fa640 1 -- 172.21.15.53:0/1740434620 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe6d400bcf0 con 0x7fe6e00b7e30 2023-06-10T19:04:47.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.816+0000 7fe6dd7fa640 1 --2- 172.21.15.53:0/1740434620 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe6cc066280 0x7fe6cc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:47.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.816+0000 7fe6dd7fa640 1 -- 172.21.15.53:0/1740434620 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6192+0+0 (secure 0 0 0) 0x7fe6d40843c0 con 0x7fe6e00b7e30 2023-06-10T19:04:47.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.816+0000 7fe6e4e84640 1 --2- 172.21.15.53:0/1740434620 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe6cc066280 0x7fe6cc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:47.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.816+0000 7fe6e4e84640 1 --2- 172.21.15.53:0/1740434620 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe6cc066280 0x7fe6cc068730 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fe6d000b810 tx=0x7fe6d0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:47.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.820+0000 7fe6dd7fa640 1 -- 172.21.15.53:0/1740434620 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe6e00c9a40 con 0x7fe6e00b7e30 2023-06-10T19:04:47.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.976+0000 7fe6e70e8640 1 -- 172.21.15.53:0/1740434620 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe6e00c9a40 con 0x7fe6e00b7e30 2023-06-10T19:04:47.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.976+0000 7fe6dd7fa640 1 -- 172.21.15.53:0/1740434620 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v113) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe6e00c9a40 con 0x7fe6e00b7e30 2023-06-10T19:04:47.980 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-06-10T19:04:47.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.976+0000 7fe6e70e8640 1 -- 172.21.15.53:0/1740434620 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe6cc066280 msgr2=0x7fe6cc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:47.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.976+0000 7fe6e70e8640 1 --2- 172.21.15.53:0/1740434620 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe6cc066280 0x7fe6cc068730 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fe6d000b810 tx=0x7fe6d0008040 comp rx=0 tx=0).stop 2023-06-10T19:04:47.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.976+0000 7fe6e70e8640 1 -- 172.21.15.53:0/1740434620 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6e00b7e30 msgr2=0x7fe6e014dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:47.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.976+0000 7fe6e70e8640 1 --2- 172.21.15.53:0/1740434620 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6e00b7e30 0x7fe6e014dbc0 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7fe6d400d800 tx=0x7fe6d400dcc0 comp rx=0 tx=0).stop 2023-06-10T19:04:47.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.976+0000 7fe6e70e8640 1 -- 172.21.15.53:0/1740434620 shutdown_connections 2023-06-10T19:04:47.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.976+0000 7fe6e70e8640 1 --2- 172.21.15.53:0/1740434620 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe6cc066280 0x7fe6cc068730 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:47.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.976+0000 7fe6e70e8640 1 --2- 172.21.15.53:0/1740434620 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6e015c090 0x7fe6e014e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:47.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.976+0000 7fe6e70e8640 1 --2- 172.21.15.53:0/1740434620 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6e00b7e30 0x7fe6e014dbc0 unknown :-1 s=CLOSED pgs=1789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:47.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.976+0000 7fe6e70e8640 1 --2- 172.21.15.53:0/1740434620 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6e00b0b90 0x7fe6e0152900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:47.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.976+0000 7fe6e70e8640 1 -- 172.21.15.53:0/1740434620 >> 172.21.15.53:0/1740434620 conn(0x7fe6e0069e20 msgr2=0x7fe6e015a6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:04:47.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.976+0000 7fe6e70e8640 1 -- 172.21.15.53:0/1740434620 shutdown_connections 2023-06-10T19:04:47.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:47.976+0000 7fe6e70e8640 1 -- 172.21.15.53:0/1740434620 wait complete. 2023-06-10T19:04:48.000 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-10T19:04:48.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.112+0000 7f2da135c640 1 Processor -- start 2023-06-10T19:04:48.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.112+0000 7f2da135c640 1 -- start start 2023-06-10T19:04:48.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.116+0000 7f2da135c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2d9c15fc10 0x7f2d9c0b0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:48.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.116+0000 7f2da135c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2d9c15ffe0 0x7f2d9c0c9e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:48.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.116+0000 7f2da135c640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d9c160990 con 0x7f2d9c0ca350 2023-06-10T19:04:48.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.116+0000 7f2da135c640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d9c160c70 con 0x7f2d9c15fc10 2023-06-10T19:04:48.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.116+0000 7f2da135c640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d9c160f50 con 0x7f2d9c15ffe0 2023-06-10T19:04:48.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.116+0000 7f2d9affd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2d9c15fc10 0x7f2d9c0b0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:48.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.116+0000 7f2d9b7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f2d9c0ca350 0x7f2d9c0ccea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:51612/0 (socket says 172.21.15.53:51612) 2023-06-10T19:04:48.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.116+0000 7f2d9b7fe640 1 -- 172.21.15.53:0/1964366077 learned_addr learned my addr 172.21.15.53:0/1964366077 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:04:48.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.116+0000 7f2d93fff640 1 --2- 172.21.15.53:0/1964366077 >> v2:172.21.15.117:3300/0 conn(0x7f2d9c15ffe0 0x7f2d9c0c9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:48.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.116+0000 7f2d9affd640 1 -- 172.21.15.53:0/1964366077 >> v2:172.21.15.117:3300/0 conn(0x7f2d9c15ffe0 msgr2=0x7f2d9c0c9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:04:48.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.116+0000 7f2d9affd640 1 --2- 172.21.15.53:0/1964366077 >> v2:172.21.15.117:3300/0 conn(0x7f2d9c15ffe0 0x7f2d9c0c9e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:48.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.116+0000 7f2d9affd640 1 -- 172.21.15.53:0/1964366077 >> v1:172.21.15.53:6789/0 conn(0x7f2d9c0ca350 legacy=0x7f2d9c0ccea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:48.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.116+0000 7f2d9affd640 1 -- 172.21.15.53:0/1964366077 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d9c0c98f0 con 0x7f2d9c15fc10 2023-06-10T19:04:48.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.116+0000 7f2d9affd640 1 --2- 172.21.15.53:0/1964366077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d9c15fc10 0x7f2d9c0b0170 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c06e8e0 tx=0x7f2d8c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=571114ac68859f45 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:48.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.116+0000 7f2d9a7fc640 1 -- 172.21.15.53:0/1964366077 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8c0ab600 con 0x7f2d9c15fc10 2023-06-10T19:04:48.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.116+0000 7f2d9a7fc640 1 -- 172.21.15.53:0/1964366077 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d8c0ab760 con 0x7f2d9c15fc10 2023-06-10T19:04:48.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.116+0000 7f2d9a7fc640 1 -- 172.21.15.53:0/1964366077 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8c0abaf0 con 0x7f2d9c15fc10 2023-06-10T19:04:48.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.116+0000 7f2da135c640 1 -- 172.21.15.53:0/1964366077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d9c15fc10 msgr2=0x7f2d9c0b0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:48.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.116+0000 7f2da135c640 1 --2- 172.21.15.53:0/1964366077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d9c15fc10 0x7f2d9c0b0170 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c06e8e0 tx=0x7f2d8c01c460 comp rx=0 tx=0).stop 2023-06-10T19:04:48.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.116+0000 7f2da135c640 1 -- 172.21.15.53:0/1964366077 shutdown_connections 2023-06-10T19:04:48.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.116+0000 7f2da135c640 1 --2- 172.21.15.53:0/1964366077 >> v2:172.21.15.117:3300/0 conn(0x7f2d9c15ffe0 0x7f2d9c0c9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:48.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.116+0000 7f2da135c640 1 --2- 172.21.15.53:0/1964366077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d9c15fc10 0x7f2d9c0b0170 unknown :-1 s=CLOSED pgs=1791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:48.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.116+0000 7f2da135c640 1 -- 172.21.15.53:0/1964366077 >> 172.21.15.53:0/1964366077 conn(0x7f2d9c06a0e0 msgr2=0x7f2d9c0cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:04:48.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.116+0000 7f2da135c640 1 -- 172.21.15.53:0/1964366077 shutdown_connections 2023-06-10T19:04:48.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.116+0000 7f2da135c640 1 -- 172.21.15.53:0/1964366077 wait complete. 2023-06-10T19:04:48.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.120+0000 7f2da135c640 1 Processor -- start 2023-06-10T19:04:48.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.120+0000 7f2da135c640 1 -- start start 2023-06-10T19:04:48.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.120+0000 7f2da135c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d9c0ca350 0x7f2d9c0ccec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:48.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.120+0000 7f2da135c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d9c15fc10 0x7f2d9c14e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:48.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.120+0000 7f2da135c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d9c15ffe0 0x7f2d9c150d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:48.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.120+0000 7f2da135c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9c15dd20 con 0x7f2d9c0ca350 2023-06-10T19:04:48.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.120+0000 7f2da135c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9c14ef10 con 0x7f2d9c15ffe0 2023-06-10T19:04:48.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.120+0000 7f2da135c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9c14e9d0 con 0x7f2d9c15fc10 2023-06-10T19:04:48.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.120+0000 7f2d9affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d9c0ca350 0x7f2d9c0ccec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:48.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.120+0000 7f2d9affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d9c0ca350 0x7f2d9c0ccec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53618/0 (socket says 172.21.15.53:53618) 2023-06-10T19:04:48.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.120+0000 7f2d9affd640 1 -- 172.21.15.53:0/2692434444 learned_addr learned my addr 172.21.15.53:0/2692434444 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:04:48.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.120+0000 7f2d93fff640 1 --2- 172.21.15.53:0/2692434444 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d9c15fc10 0x7f2d9c14e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:48.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.120+0000 7f2d9b7fe640 1 --2- 172.21.15.53:0/2692434444 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d9c15ffe0 0x7f2d9c150d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:48.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.120+0000 7f2d9affd640 1 -- 172.21.15.53:0/2692434444 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d9c15fc10 msgr2=0x7f2d9c14e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:48.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.120+0000 7f2d9affd640 1 --2- 172.21.15.53:0/2692434444 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d9c15fc10 0x7f2d9c14e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:48.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.120+0000 7f2d9affd640 1 -- 172.21.15.53:0/2692434444 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d9c15ffe0 msgr2=0x7f2d9c150d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:48.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.120+0000 7f2d9affd640 1 --2- 172.21.15.53:0/2692434444 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d9c15ffe0 0x7f2d9c150d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:48.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.120+0000 7f2d9affd640 1 -- 172.21.15.53:0/2692434444 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d8c009420 con 0x7f2d9c0ca350 2023-06-10T19:04:48.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.120+0000 7f2d9b7fe640 1 --2- 172.21.15.53:0/2692434444 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d9c15ffe0 0x7f2d9c150d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:04:48.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.120+0000 7f2d9affd640 1 --2- 172.21.15.53:0/2692434444 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d9c0ca350 0x7f2d9c0ccec0 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c019070 tx=0x7f2d8c01aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:48.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.120+0000 7f2d937fe640 1 -- 172.21.15.53:0/2692434444 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8c0b5810 con 0x7f2d9c0ca350 2023-06-10T19:04:48.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.120+0000 7f2d937fe640 1 -- 172.21.15.53:0/2692434444 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d8c0b5970 con 0x7f2d9c0ca350 2023-06-10T19:04:48.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.120+0000 7f2d937fe640 1 -- 172.21.15.53:0/2692434444 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8c0b5d20 con 0x7f2d9c0ca350 2023-06-10T19:04:48.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.120+0000 7f2da135c640 1 -- 172.21.15.53:0/2692434444 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d9c15f0e0 con 0x7f2d9c0ca350 2023-06-10T19:04:48.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.120+0000 7f2da135c640 1 -- 172.21.15.53:0/2692434444 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d9c15f6a0 con 0x7f2d9c0ca350 2023-06-10T19:04:48.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.120+0000 7f2da135c640 1 -- 172.21.15.53:0/2692434444 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d9c04d790 con 0x7f2d9c0ca350 2023-06-10T19:04:48.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.120+0000 7f2d937fe640 1 -- 172.21.15.53:0/2692434444 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2d8c0bf410 con 0x7f2d9c0ca350 2023-06-10T19:04:48.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.124+0000 7f2d937fe640 1 --2- 172.21.15.53:0/2692434444 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2d7c066280 0x7f2d7c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:48.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.124+0000 7f2d937fe640 1 -- 172.21.15.53:0/2692434444 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6192+0+0 (secure 0 0 0) 0x7f2d8c11e740 con 0x7f2d9c0ca350 2023-06-10T19:04:48.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.124+0000 7f2d93fff640 1 --2- 172.21.15.53:0/2692434444 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2d7c066280 0x7f2d7c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:48.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.124+0000 7f2d93fff640 1 --2- 172.21.15.53:0/2692434444 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2d7c066280 0x7f2d7c068730 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c158a10 tx=0x7f2d84008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:48.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.128+0000 7f2d937fe640 1 -- 172.21.15.53:0/2692434444 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2d8c0ebbd0 con 0x7f2d9c0ca350 2023-06-10T19:04:48.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.272+0000 7f2da135c640 1 -- 172.21.15.53:0/2692434444 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2d9c0ce8f0 con 0x7f2d9c0ca350 2023-06-10T19:04:48.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.272+0000 7f2d937fe640 1 -- 172.21.15.53:0/2692434444 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v113) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2d8c0ab5c0 con 0x7f2d9c0ca350 2023-06-10T19:04:48.277 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-06-10T19:04:48.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.276+0000 7f2da135c640 1 -- 172.21.15.53:0/2692434444 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2d7c066280 msgr2=0x7f2d7c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:48.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.276+0000 7f2da135c640 1 --2- 172.21.15.53:0/2692434444 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2d7c066280 0x7f2d7c068730 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c158a10 tx=0x7f2d84008040 comp rx=0 tx=0).stop 2023-06-10T19:04:48.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.276+0000 7f2da135c640 1 -- 172.21.15.53:0/2692434444 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d9c0ca350 msgr2=0x7f2d9c0ccec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:48.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.276+0000 7f2da135c640 1 --2- 172.21.15.53:0/2692434444 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d9c0ca350 0x7f2d9c0ccec0 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c019070 tx=0x7f2d8c01aca0 comp rx=0 tx=0).stop 2023-06-10T19:04:48.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.276+0000 7f2da135c640 1 -- 172.21.15.53:0/2692434444 shutdown_connections 2023-06-10T19:04:48.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.276+0000 7f2da135c640 1 --2- 172.21.15.53:0/2692434444 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2d7c066280 0x7f2d7c068730 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:48.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.276+0000 7f2da135c640 1 --2- 172.21.15.53:0/2692434444 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d9c15ffe0 0x7f2d9c150d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:48.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.276+0000 7f2da135c640 1 --2- 172.21.15.53:0/2692434444 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d9c15fc10 0x7f2d9c14e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:48.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.276+0000 7f2da135c640 1 --2- 172.21.15.53:0/2692434444 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d9c0ca350 0x7f2d9c0ccec0 unknown :-1 s=CLOSED pgs=1792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:48.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.276+0000 7f2da135c640 1 -- 172.21.15.53:0/2692434444 >> 172.21.15.53:0/2692434444 conn(0x7f2d9c06a0e0 msgr2=0x7f2d9c0706e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:04:48.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.276+0000 7f2da135c640 1 -- 172.21.15.53:0/2692434444 shutdown_connections 2023-06-10T19:04:48.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.276+0000 7f2da135c640 1 -- 172.21.15.53:0/2692434444 wait complete. 2023-06-10T19:04:48.295 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-10T19:04:48.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.404+0000 7fab1f299640 1 Processor -- start 2023-06-10T19:04:48.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.408+0000 7fab1f299640 1 -- start start 2023-06-10T19:04:48.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.408+0000 7fab1f299640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fab180c9fa0 0x7fab1806bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:48.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.408+0000 7fab1f299640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab1806c020 0x7fab180c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:48.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.408+0000 7fab1f299640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fab180c87e0 0x7fab180af760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:48.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.408+0000 7fab1f299640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab1806b090 con 0x7fab180c9fa0 2023-06-10T19:04:48.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.408+0000 7fab1f299640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab180ca370 con 0x7fab180c87e0 2023-06-10T19:04:48.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.408+0000 7fab1f299640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab18070d50 con 0x7fab1806c020 2023-06-10T19:04:48.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.408+0000 7fab1d035640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fab180c9fa0 0x7fab1806bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:48.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.408+0000 7fab1d035640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fab180c9fa0 0x7fab1806bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53620/0 (socket says 172.21.15.53:53620) 2023-06-10T19:04:48.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.408+0000 7fab1d035640 1 -- 172.21.15.53:0/3383559204 learned_addr learned my addr 172.21.15.53:0/3383559204 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:04:48.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.408+0000 7fab1c834640 1 --2- 172.21.15.53:0/3383559204 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab1806c020 0x7fab180c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:48.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.408+0000 7fab1d836640 1 --2- 172.21.15.53:0/3383559204 >> v2:172.21.15.117:3300/0 conn(0x7fab180c87e0 0x7fab180af760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:48.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.408+0000 7fab1d035640 1 -- 172.21.15.53:0/3383559204 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab1806c020 msgr2=0x7fab180c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:04:48.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.408+0000 7fab1d035640 1 --2- 172.21.15.53:0/3383559204 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab1806c020 0x7fab180c82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:48.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.408+0000 7fab1d035640 1 -- 172.21.15.53:0/3383559204 >> v2:172.21.15.117:3300/0 conn(0x7fab180c87e0 msgr2=0x7fab180af760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:04:48.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.408+0000 7fab1d035640 1 --2- 172.21.15.53:0/3383559204 >> v2:172.21.15.117:3300/0 conn(0x7fab180c87e0 0x7fab180af760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:48.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.408+0000 7fab1d035640 1 -- 172.21.15.53:0/3383559204 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab18071030 con 0x7fab180c9fa0 2023-06-10T19:04:48.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.408+0000 7fab1c834640 1 --2- 172.21.15.53:0/3383559204 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab1806c020 0x7fab180c82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:04:48.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.408+0000 7fab1d836640 1 --2- 172.21.15.53:0/3383559204 >> v2:172.21.15.117:3300/0 conn(0x7fab180c87e0 0x7fab180af760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:04:48.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.412+0000 7fab1d035640 1 --2- 172.21.15.53:0/3383559204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab180c9fa0 0x7fab1806bae0 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7fab180c81a0 tx=0x7fab0801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f6c362d75025a21 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:48.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.412+0000 7fab0ffff640 1 -- 172.21.15.53:0/3383559204 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab080ac640 con 0x7fab180c9fa0 2023-06-10T19:04:48.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.412+0000 7fab0ffff640 1 -- 172.21.15.53:0/3383559204 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab080ac7a0 con 0x7fab180c9fa0 2023-06-10T19:04:48.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.412+0000 7fab0ffff640 1 -- 172.21.15.53:0/3383559204 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab080acb30 con 0x7fab180c9fa0 2023-06-10T19:04:48.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.412+0000 7fab1f299640 1 -- 172.21.15.53:0/3383559204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab180c9fa0 msgr2=0x7fab1806bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:48.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.412+0000 7fab1f299640 1 --2- 172.21.15.53:0/3383559204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab180c9fa0 0x7fab1806bae0 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7fab180c81a0 tx=0x7fab0801c440 comp rx=0 tx=0).stop 2023-06-10T19:04:48.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.412+0000 7fab1f299640 1 -- 172.21.15.53:0/3383559204 shutdown_connections 2023-06-10T19:04:48.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.412+0000 7fab1f299640 1 --2- 172.21.15.53:0/3383559204 >> v2:172.21.15.117:3300/0 conn(0x7fab180c87e0 0x7fab180af760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:48.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.412+0000 7fab1f299640 1 --2- 172.21.15.53:0/3383559204 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab1806c020 0x7fab180c82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:48.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.412+0000 7fab1f299640 1 --2- 172.21.15.53:0/3383559204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab180c9fa0 0x7fab1806bae0 unknown :-1 s=CLOSED pgs=1793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:48.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.412+0000 7fab1f299640 1 -- 172.21.15.53:0/3383559204 >> 172.21.15.53:0/3383559204 conn(0x7fab1806a0e0 msgr2=0x7fab180cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:04:48.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.412+0000 7fab1f299640 1 -- 172.21.15.53:0/3383559204 shutdown_connections 2023-06-10T19:04:48.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.412+0000 7fab1f299640 1 -- 172.21.15.53:0/3383559204 wait complete. 2023-06-10T19:04:48.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.412+0000 7fab1f299640 1 Processor -- start 2023-06-10T19:04:48.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.412+0000 7fab1f299640 1 -- start start 2023-06-10T19:04:48.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.412+0000 7fab1f299640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab1806c020 0x7fab181589d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:48.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.412+0000 7fab1f299640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab180c87e0 0x7fab18162c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:48.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.412+0000 7fab1f299640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab180c9fa0 0x7fab180c6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:48.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.412+0000 7fab1f299640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab18158f10 con 0x7fab1806c020 2023-06-10T19:04:48.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.412+0000 7fab1f299640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab1815f5b0 con 0x7fab180c9fa0 2023-06-10T19:04:48.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.412+0000 7fab1f299640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab18157c10 con 0x7fab180c87e0 2023-06-10T19:04:48.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.412+0000 7fab1d035640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab1806c020 0x7fab181589d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:48.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.412+0000 7fab1d035640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab1806c020 0x7fab181589d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53624/0 (socket says 172.21.15.53:53624) 2023-06-10T19:04:48.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.412+0000 7fab1d035640 1 -- 172.21.15.53:0/2609521001 learned_addr learned my addr 172.21.15.53:0/2609521001 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:04:48.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.416+0000 7fab1d035640 1 -- 172.21.15.53:0/2609521001 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab180c87e0 msgr2=0x7fab18162c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:48.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.416+0000 7fab1d035640 1 --2- 172.21.15.53:0/2609521001 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab180c87e0 0x7fab18162c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:48.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.416+0000 7fab1d035640 1 -- 172.21.15.53:0/2609521001 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab180c9fa0 msgr2=0x7fab180c6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:48.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.416+0000 7fab1d035640 1 --2- 172.21.15.53:0/2609521001 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab180c9fa0 0x7fab180c6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:48.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.416+0000 7fab1d035640 1 -- 172.21.15.53:0/2609521001 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab080094d0 con 0x7fab1806c020 2023-06-10T19:04:48.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.416+0000 7fab1d035640 1 --2- 172.21.15.53:0/2609521001 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab1806c020 0x7fab181589d0 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7fab080af040 tx=0x7fab080191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:48.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.416+0000 7fab0dffb640 1 -- 172.21.15.53:0/2609521001 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab080b5850 con 0x7fab1806c020 2023-06-10T19:04:48.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.416+0000 7fab0dffb640 1 -- 172.21.15.53:0/2609521001 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab080b59d0 con 0x7fab1806c020 2023-06-10T19:04:48.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.416+0000 7fab1f299640 1 -- 172.21.15.53:0/2609521001 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab18157ef0 con 0x7fab1806c020 2023-06-10T19:04:48.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.416+0000 7fab0dffb640 1 -- 172.21.15.53:0/2609521001 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab080b5d80 con 0x7fab1806c020 2023-06-10T19:04:48.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.416+0000 7fab1f299640 1 -- 172.21.15.53:0/2609521001 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab181584b0 con 0x7fab1806c020 2023-06-10T19:04:48.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.416+0000 7fab1f299640 1 -- 172.21.15.53:0/2609521001 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab18157d50 con 0x7fab1806c020 2023-06-10T19:04:48.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.416+0000 7fab0dffb640 1 -- 172.21.15.53:0/2609521001 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fab080b3070 con 0x7fab1806c020 2023-06-10T19:04:48.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.416+0000 7fab0dffb640 1 --2- 172.21.15.53:0/2609521001 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7faafc066280 0x7faafc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:48.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.416+0000 7fab0dffb640 1 -- 172.21.15.53:0/2609521001 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6192+0+0 (secure 0 0 0) 0x7fab0811e2c0 con 0x7fab1806c020 2023-06-10T19:04:48.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.416+0000 7fab1c834640 1 --2- 172.21.15.53:0/2609521001 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7faafc066280 0x7faafc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:48.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.416+0000 7fab1c834640 1 --2- 172.21.15.53:0/2609521001 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7faafc066280 0x7faafc068730 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fab18143930 tx=0x7fab14008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:48.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.420+0000 7fab0dffb640 1 -- 172.21.15.53:0/2609521001 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fab080eb6c0 con 0x7fab1806c020 2023-06-10T19:04:48.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.568+0000 7fab1f299640 1 -- 172.21.15.53:0/2609521001 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fab18157d50 con 0x7fab1806c020 2023-06-10T19:04:48.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.568+0000 7fab0dffb640 1 -- 172.21.15.53:0/2609521001 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v113) v1 ==== 100+0+11 (secure 0 0 0) 0x7fab18157d50 con 0x7fab1806c020 2023-06-10T19:04:48.573 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-06-10T19:04:48.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.568+0000 7fab1f299640 1 -- 172.21.15.53:0/2609521001 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7faafc066280 msgr2=0x7faafc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:48.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.568+0000 7fab1f299640 1 --2- 172.21.15.53:0/2609521001 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7faafc066280 0x7faafc068730 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fab18143930 tx=0x7fab14008040 comp rx=0 tx=0).stop 2023-06-10T19:04:48.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.568+0000 7fab1f299640 1 -- 172.21.15.53:0/2609521001 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab1806c020 msgr2=0x7fab181589d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:48.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.568+0000 7fab1f299640 1 --2- 172.21.15.53:0/2609521001 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab1806c020 0x7fab181589d0 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7fab080af040 tx=0x7fab080191e0 comp rx=0 tx=0).stop 2023-06-10T19:04:48.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.568+0000 7fab1f299640 1 -- 172.21.15.53:0/2609521001 shutdown_connections 2023-06-10T19:04:48.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.568+0000 7fab1f299640 1 --2- 172.21.15.53:0/2609521001 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7faafc066280 0x7faafc068730 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:48.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.568+0000 7fab1f299640 1 --2- 172.21.15.53:0/2609521001 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab180c9fa0 0x7fab180c6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:48.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.568+0000 7fab1f299640 1 --2- 172.21.15.53:0/2609521001 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fab180c87e0 0x7fab18162c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:48.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.568+0000 7fab1f299640 1 --2- 172.21.15.53:0/2609521001 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab1806c020 0x7fab181589d0 unknown :-1 s=CLOSED pgs=1794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:48.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.568+0000 7fab1f299640 1 -- 172.21.15.53:0/2609521001 >> 172.21.15.53:0/2609521001 conn(0x7fab1806a0e0 msgr2=0x7fab180b30e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:04:48.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.568+0000 7fab1f299640 1 -- 172.21.15.53:0/2609521001 shutdown_connections 2023-06-10T19:04:48.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.568+0000 7fab1f299640 1 -- 172.21.15.53:0/2609521001 wait complete. 2023-06-10T19:04:48.590 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-10T19:04:48.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.704+0000 7fccac5d7640 1 Processor -- start 2023-06-10T19:04:48.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.704+0000 7fccac5d7640 1 -- start start 2023-06-10T19:04:48.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.704+0000 7fccac5d7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcca41571a0 0x7fcca40c9f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:48.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.704+0000 7fccac5d7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fcca4070100 0x7fcca40af7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:48.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.704+0000 7fccac5d7640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcca40b0160 con 0x7fcca40afd10 2023-06-10T19:04:48.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.704+0000 7fccac5d7640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcca4071190 con 0x7fcca4070100 2023-06-10T19:04:48.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.704+0000 7fccac5d7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcca40ca440 con 0x7fcca41571a0 2023-06-10T19:04:48.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.704+0000 7fcca9b72640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fcca4070100 0x7fcca40af7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:48.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.704+0000 7fccaab74640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fcca40afd10 0x7fcca415d260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:51616/0 (socket says 172.21.15.53:51616) 2023-06-10T19:04:48.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.704+0000 7fccaab74640 1 -- 172.21.15.53:0/1022349255 learned_addr learned my addr 172.21.15.53:0/1022349255 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:04:48.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.704+0000 7fccaa373640 1 --2- 172.21.15.53:0/1022349255 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcca41571a0 0x7fcca40c9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:48.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.704+0000 7fcca9b72640 1 -- 172.21.15.53:0/1022349255 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcca41571a0 msgr2=0x7fcca40c9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:04:48.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.704+0000 7fcca9b72640 1 --2- 172.21.15.53:0/1022349255 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcca41571a0 0x7fcca40c9f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:48.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.704+0000 7fcca9b72640 1 -- 172.21.15.53:0/1022349255 >> v1:172.21.15.53:6789/0 conn(0x7fcca40afd10 legacy=0x7fcca415d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:48.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.704+0000 7fcca9b72640 1 -- 172.21.15.53:0/1022349255 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcca4070580 con 0x7fcca4070100 2023-06-10T19:04:48.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.704+0000 7fcca9371640 1 -- 172.21.15.53:0/1022349255 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2722088419 0 0) 0x7fcc9c0014a0 con 0x7fcca40afd10 2023-06-10T19:04:48.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.708+0000 7fcca9b72640 1 --2- 172.21.15.53:0/1022349255 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcca4070100 0x7fcca40af7d0 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7fcc940097c0 tx=0x7fcc9401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d95db3fa4832a55d server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:48.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.708+0000 7fcca9371640 1 -- 172.21.15.53:0/1022349255 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc940ab650 con 0x7fcca4070100 2023-06-10T19:04:48.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.708+0000 7fcca9371640 1 -- 172.21.15.53:0/1022349255 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc940ab7b0 con 0x7fcca4070100 2023-06-10T19:04:48.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.708+0000 7fcca9371640 1 -- 172.21.15.53:0/1022349255 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc940abb40 con 0x7fcca4070100 2023-06-10T19:04:48.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.708+0000 7fccac5d7640 1 -- 172.21.15.53:0/1022349255 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcca4070100 msgr2=0x7fcca40af7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:48.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.708+0000 7fccac5d7640 1 --2- 172.21.15.53:0/1022349255 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcca4070100 0x7fcca40af7d0 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7fcc940097c0 tx=0x7fcc9401c450 comp rx=0 tx=0).stop 2023-06-10T19:04:48.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.708+0000 7fccac5d7640 1 -- 172.21.15.53:0/1022349255 shutdown_connections 2023-06-10T19:04:48.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.708+0000 7fccac5d7640 1 --2- 172.21.15.53:0/1022349255 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcca4070100 0x7fcca40af7d0 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:48.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.708+0000 7fccac5d7640 1 --2- 172.21.15.53:0/1022349255 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcca41571a0 0x7fcca40c9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:48.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.708+0000 7fccac5d7640 1 -- 172.21.15.53:0/1022349255 >> 172.21.15.53:0/1022349255 conn(0x7fcca40ce9e0 msgr2=0x7fcca40ca7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:04:48.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.708+0000 7fccac5d7640 1 -- 172.21.15.53:0/1022349255 shutdown_connections 2023-06-10T19:04:48.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.708+0000 7fccac5d7640 1 -- 172.21.15.53:0/1022349255 wait complete. 2023-06-10T19:04:48.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.708+0000 7fccac5d7640 1 Processor -- start 2023-06-10T19:04:48.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.708+0000 7fccac5d7640 1 -- start start 2023-06-10T19:04:48.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.712+0000 7fccac5d7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcca40afd10 0x7fcca40b15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:48.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.712+0000 7fccac5d7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcca41571a0 0x7fcca41557b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:48.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.712+0000 7fccac5d7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcca41f73e0 0x7fcca40c1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:48.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.712+0000 7fccac5d7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca40c3c40 con 0x7fcca40afd10 2023-06-10T19:04:48.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.712+0000 7fccac5d7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca40b1b20 con 0x7fcca41f73e0 2023-06-10T19:04:48.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.712+0000 7fccac5d7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcca41f79a0 con 0x7fcca41571a0 2023-06-10T19:04:48.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.712+0000 7fccaa373640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcca40afd10 0x7fcca40b15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:48.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.712+0000 7fccaa373640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcca40afd10 0x7fcca40b15e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53640/0 (socket says 172.21.15.53:53640) 2023-06-10T19:04:48.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.712+0000 7fccaa373640 1 -- 172.21.15.53:0/4125505990 learned_addr learned my addr 172.21.15.53:0/4125505990 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:04:48.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.712+0000 7fcca9b72640 1 --2- 172.21.15.53:0/4125505990 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcca41571a0 0x7fcca41557b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:48.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.712+0000 7fccaab74640 1 --2- 172.21.15.53:0/4125505990 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcca41f73e0 0x7fcca40c1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:48.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.712+0000 7fccaa373640 1 -- 172.21.15.53:0/4125505990 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcca41571a0 msgr2=0x7fcca41557b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:48.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.712+0000 7fccaa373640 1 --2- 172.21.15.53:0/4125505990 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcca41571a0 0x7fcca41557b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:48.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.712+0000 7fccaa373640 1 -- 172.21.15.53:0/4125505990 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcca41f73e0 msgr2=0x7fcca40c1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:48.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.712+0000 7fccaa373640 1 --2- 172.21.15.53:0/4125505990 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcca41f73e0 0x7fcca40c1eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:48.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.712+0000 7fccaa373640 1 -- 172.21.15.53:0/4125505990 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc94009420 con 0x7fcca40afd10 2023-06-10T19:04:48.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.712+0000 7fccaa373640 1 --2- 172.21.15.53:0/4125505990 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcca40afd10 0x7fcca40b15e0 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7fcca000d7d0 tx=0x7fcca000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:48.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.712+0000 7fcc9affd640 1 -- 172.21.15.53:0/4125505990 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca000b6c0 con 0x7fcca40afd10 2023-06-10T19:04:48.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.712+0000 7fcc9affd640 1 -- 172.21.15.53:0/4125505990 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcca000b820 con 0x7fcca40afd10 2023-06-10T19:04:48.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.712+0000 7fccac5d7640 1 -- 172.21.15.53:0/4125505990 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcca41f7c80 con 0x7fcca40afd10 2023-06-10T19:04:48.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.712+0000 7fcc9affd640 1 -- 172.21.15.53:0/4125505990 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca000bbd0 con 0x7fcca40afd10 2023-06-10T19:04:48.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.712+0000 7fccac5d7640 1 -- 172.21.15.53:0/4125505990 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcca4155cf0 con 0x7fcca40afd10 2023-06-10T19:04:48.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.712+0000 7fccac5d7640 1 -- 172.21.15.53:0/4125505990 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcca40c39a0 con 0x7fcca40afd10 2023-06-10T19:04:48.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.712+0000 7fcc9affd640 1 -- 172.21.15.53:0/4125505990 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcca000bd30 con 0x7fcca40afd10 2023-06-10T19:04:48.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.712+0000 7fcc9affd640 1 --2- 172.21.15.53:0/4125505990 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcc88066280 0x7fcc88068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:48.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.712+0000 7fcc9affd640 1 -- 172.21.15.53:0/4125505990 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6192+0+0 (secure 0 0 0) 0x7fcca0084210 con 0x7fcca40afd10 2023-06-10T19:04:48.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.712+0000 7fcca9b72640 1 --2- 172.21.15.53:0/4125505990 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcc88066280 0x7fcc88068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:48.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.712+0000 7fcca9b72640 1 --2- 172.21.15.53:0/4125505990 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcc88066280 0x7fcc88068730 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fcc940af000 tx=0x7fcc94008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:48.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.716+0000 7fcc9affd640 1 -- 172.21.15.53:0/4125505990 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcca40c39a0 con 0x7fcca40afd10 2023-06-10T19:04:48.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.880+0000 7fccac5d7640 1 -- 172.21.15.53:0/4125505990 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fcca40c39a0 con 0x7fcca40afd10 2023-06-10T19:04:48.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.884+0000 7fcc9affd640 1 -- 172.21.15.53:0/4125505990 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 1 entries v113) v1 ==== 80+0+57 (secure 0 0 0) 0x7fcca40c39a0 con 0x7fcca40afd10 2023-06-10T19:04:48.888 INFO:teuthology.orchestra.run.smithi053.stdout:192.168.0.1:0/3878814772 2023-06-10T20:04:43.440652+0000 2023-06-10T19:04:48.888 INFO:teuthology.orchestra.run.smithi053.stderr:listed 1 entries 2023-06-10T19:04:48.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.884+0000 7fccac5d7640 1 -- 172.21.15.53:0/4125505990 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcc88066280 msgr2=0x7fcc88068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:48.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.884+0000 7fccac5d7640 1 --2- 172.21.15.53:0/4125505990 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcc88066280 0x7fcc88068730 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fcc940af000 tx=0x7fcc94008040 comp rx=0 tx=0).stop 2023-06-10T19:04:48.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.884+0000 7fccac5d7640 1 -- 172.21.15.53:0/4125505990 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcca40afd10 msgr2=0x7fcca40b15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:48.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.884+0000 7fccac5d7640 1 --2- 172.21.15.53:0/4125505990 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcca40afd10 0x7fcca40b15e0 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7fcca000d7d0 tx=0x7fcca000dc90 comp rx=0 tx=0).stop 2023-06-10T19:04:48.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.884+0000 7fccac5d7640 1 -- 172.21.15.53:0/4125505990 shutdown_connections 2023-06-10T19:04:48.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.884+0000 7fccac5d7640 1 --2- 172.21.15.53:0/4125505990 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcc88066280 0x7fcc88068730 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:48.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.884+0000 7fccac5d7640 1 --2- 172.21.15.53:0/4125505990 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcca41f73e0 0x7fcca40c1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:48.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.884+0000 7fccac5d7640 1 --2- 172.21.15.53:0/4125505990 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcca41571a0 0x7fcca41557b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:48.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.884+0000 7fccac5d7640 1 --2- 172.21.15.53:0/4125505990 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcca40afd10 0x7fcca40b15e0 unknown :-1 s=CLOSED pgs=1797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:48.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.884+0000 7fccac5d7640 1 -- 172.21.15.53:0/4125505990 >> 172.21.15.53:0/4125505990 conn(0x7fcca40ce9e0 msgr2=0x7fcca4156080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:04:48.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.884+0000 7fccac5d7640 1 -- 172.21.15.53:0/4125505990 shutdown_connections 2023-06-10T19:04:48.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:48.884+0000 7fccac5d7640 1 -- 172.21.15.53:0/4125505990 wait complete. 2023-06-10T19:04:48.907 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi117.front.sepia.ceph.com... 2023-06-10T19:04:48.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:04:48.908 DEBUG:teuthology.orchestra.run.smithi117:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-06-10T19:04:48.922 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi117.stderr:ceph-fuse[45121]: fuse finished with error 0 and tester_r 0 2023-06-10T19:04:48.923 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi117.front.sepia.ceph.com 2023-06-10T19:04:48.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:04:48.924 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-06-10T19:04:49.091 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T19:04:49.091 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:04:49.097 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16345192k,nr_inodes=4086298,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276544k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=407 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276540k,nr_inodes=819135,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276544k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-06-10T19:04:49.098 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi053.front.sepia.ceph.com 2023-06-10T19:04:49.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:04:49.099 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-06-10T19:04:49.143 INFO:teuthology.orchestra.run.smithi053.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-06-10T19:04:49.144 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-10T19:04:49.145 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T19:04:49.145 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:04:49.151 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16342088k,nr_inodes=4085522,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275924k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18845 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275920k,nr_inodes=818980,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275924k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-06-10T19:04:49.152 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi117.front.sepia.ceph.com 2023-06-10T19:04:49.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:04:49.152 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-06-10T19:04:49.199 INFO:teuthology.orchestra.run.smithi117.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-06-10T19:04:49.200 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-10T19:04:49.201 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:04:49.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.328+0000 7f6440158640 1 Processor -- start 2023-06-10T19:04:49.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.328+0000 7f6440158640 1 -- start start 2023-06-10T19:04:49.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.332+0000 7f6440158640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f64380c9750 0x7f64380aced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:49.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.332+0000 7f6440158640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f64380cb870 0x7f64380af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:49.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.332+0000 7f6440158640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64380b00a0 con 0x7f64380afc60 2023-06-10T19:04:49.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.332+0000 7f6440158640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64380cd990 con 0x7f64380c9750 2023-06-10T19:04:49.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.332+0000 7f6440158640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64380ad410 con 0x7f64380cb870 2023-06-10T19:04:49.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.332+0000 7f643def4640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f64380c9750 0x7f64380aced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:49.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.332+0000 7f643def4640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f64380c9750 0x7f64380aced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53650/0 (socket says 172.21.15.53:53650) 2023-06-10T19:04:49.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.332+0000 7f643def4640 1 -- 172.21.15.53:0/4155056425 learned_addr learned my addr 172.21.15.53:0/4155056425 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:04:49.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.332+0000 7f643d6f3640 1 --2- 172.21.15.53:0/4155056425 >> v2:172.21.15.117:3300/0 conn(0x7f64380cb870 0x7f64380af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:49.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.332+0000 7f643def4640 1 -- 172.21.15.53:0/4155056425 >> v2:172.21.15.117:3300/0 conn(0x7f64380cb870 msgr2=0x7f64380af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:04:49.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.332+0000 7f643def4640 1 --2- 172.21.15.53:0/4155056425 >> v2:172.21.15.117:3300/0 conn(0x7f64380cb870 0x7f64380af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:49.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.332+0000 7f643def4640 1 -- 172.21.15.53:0/4155056425 >> v1:172.21.15.117:6789/0 conn(0x7f64380afc60 legacy=0x7f643815bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:04:49.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.332+0000 7f643def4640 1 -- 172.21.15.53:0/4155056425 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64381600d0 con 0x7f64380c9750 2023-06-10T19:04:49.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.336+0000 7f643def4640 1 --2- 172.21.15.53:0/4155056425 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64380c9750 0x7f64380aced0 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7f643815d0a0 tx=0x7f643401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=566c644072a35b64 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:49.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.336+0000 7f643cef2640 1 -- 172.21.15.53:0/4155056425 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64340ac600 con 0x7f64380c9750 2023-06-10T19:04:49.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.336+0000 7f643cef2640 1 -- 172.21.15.53:0/4155056425 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64340a8050 con 0x7f64380c9750 2023-06-10T19:04:49.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.336+0000 7f643cef2640 1 -- 172.21.15.53:0/4155056425 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64340ac980 con 0x7f64380c9750 2023-06-10T19:04:49.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.336+0000 7f6440158640 1 -- 172.21.15.53:0/4155056425 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64380c9750 msgr2=0x7f64380aced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:49.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.336+0000 7f6440158640 1 --2- 172.21.15.53:0/4155056425 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64380c9750 0x7f64380aced0 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7f643815d0a0 tx=0x7f643401c490 comp rx=0 tx=0).stop 2023-06-10T19:04:49.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.336+0000 7f6440158640 1 -- 172.21.15.53:0/4155056425 shutdown_connections 2023-06-10T19:04:49.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.336+0000 7f6440158640 1 --2- 172.21.15.53:0/4155056425 >> v2:172.21.15.117:3300/0 conn(0x7f64380cb870 0x7f64380af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:49.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.336+0000 7f6440158640 1 --2- 172.21.15.53:0/4155056425 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64380c9750 0x7f64380aced0 unknown :-1 s=CLOSED pgs=1798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:49.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.336+0000 7f6440158640 1 -- 172.21.15.53:0/4155056425 >> 172.21.15.53:0/4155056425 conn(0x7f643806a0d0 msgr2=0x7f64380ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:04:49.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.336+0000 7f6440158640 1 -- 172.21.15.53:0/4155056425 shutdown_connections 2023-06-10T19:04:49.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.336+0000 7f6440158640 1 -- 172.21.15.53:0/4155056425 wait complete. 2023-06-10T19:04:49.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.336+0000 7f6440158640 1 Processor -- start 2023-06-10T19:04:49.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.336+0000 7f6440158640 1 -- start start 2023-06-10T19:04:49.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.336+0000 7f6440158640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64380afc60 0x7f6438156e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:49.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.336+0000 7f6440158640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64380c9750 0x7f64380aba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:49.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.336+0000 7f6440158640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64380cb870 0x7f643814e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:49.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.336+0000 7f6440158640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64380ac3d0 con 0x7f64380afc60 2023-06-10T19:04:49.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.336+0000 7f6440158640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6438157b10 con 0x7f64380c9750 2023-06-10T19:04:49.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.336+0000 7f6440158640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6438153ac0 con 0x7f64380cb870 2023-06-10T19:04:49.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.336+0000 7f643def4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64380afc60 0x7f6438156e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:49.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.336+0000 7f643d6f3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64380c9750 0x7f64380aba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:49.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.336+0000 7f643d6f3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64380c9750 0x7f64380aba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.53:52918/0 (socket says 172.21.15.53:52918) 2023-06-10T19:04:49.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.336+0000 7f643d6f3640 1 -- 172.21.15.53:0/3294986052 learned_addr learned my addr 172.21.15.53:0/3294986052 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:04:49.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.336+0000 7f643def4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64380afc60 0x7f6438156e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53656/0 (socket says 172.21.15.53:53656) 2023-06-10T19:04:49.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.336+0000 7f643e6f5640 1 --2- 172.21.15.53:0/3294986052 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64380cb870 0x7f643814e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:49.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.340+0000 7f643def4640 1 -- 172.21.15.53:0/3294986052 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64380cb870 msgr2=0x7f643814e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:49.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.340+0000 7f643def4640 1 --2- 172.21.15.53:0/3294986052 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64380cb870 0x7f643814e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:49.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.340+0000 7f643def4640 1 -- 172.21.15.53:0/3294986052 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64380c9750 msgr2=0x7f64380aba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:49.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.340+0000 7f643def4640 1 --2- 172.21.15.53:0/3294986052 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64380c9750 0x7f64380aba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:49.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.340+0000 7f643def4640 1 -- 172.21.15.53:0/3294986052 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64340094d0 con 0x7f64380afc60 2023-06-10T19:04:49.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.340+0000 7f643def4640 1 --2- 172.21.15.53:0/3294986052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64380afc60 0x7f6438156e70 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7f64340ac000 tx=0x7f643401acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:49.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.340+0000 7f642e7fc640 1 -- 172.21.15.53:0/3294986052 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64340acea0 con 0x7f64380afc60 2023-06-10T19:04:49.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.340+0000 7f642e7fc640 1 -- 172.21.15.53:0/3294986052 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64340b7420 con 0x7f64380afc60 2023-06-10T19:04:49.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.340+0000 7f6440158640 1 -- 172.21.15.53:0/3294986052 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6438157550 con 0x7f64380afc60 2023-06-10T19:04:49.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.340+0000 7f642e7fc640 1 -- 172.21.15.53:0/3294986052 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64340b77d0 con 0x7f64380afc60 2023-06-10T19:04:49.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.340+0000 7f6440158640 1 -- 172.21.15.53:0/3294986052 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6438153d60 con 0x7f64380afc60 2023-06-10T19:04:49.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.340+0000 7f6440158640 1 -- 172.21.15.53:0/3294986052 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6438153920 con 0x7f64380afc60 2023-06-10T19:04:49.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.340+0000 7f642e7fc640 1 -- 172.21.15.53:0/3294986052 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f64340b3040 con 0x7f64380afc60 2023-06-10T19:04:49.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.340+0000 7f642e7fc640 1 --2- 172.21.15.53:0/3294986052 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f641c066280 0x7f641c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:49.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.340+0000 7f642e7fc640 1 -- 172.21.15.53:0/3294986052 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6192+0+0 (secure 0 0 0) 0x7f643411dc30 con 0x7f64380afc60 2023-06-10T19:04:49.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.340+0000 7f643d6f3640 1 --2- 172.21.15.53:0/3294986052 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f641c066280 0x7f641c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:49.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.340+0000 7f643d6f3640 1 --2- 172.21.15.53:0/3294986052 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f641c066280 0x7f641c068730 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f64380af790 tx=0x7f6428008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:49.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.344+0000 7f642e7fc640 1 -- 172.21.15.53:0/3294986052 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6438153920 con 0x7f64380afc60 2023-06-10T19:04:49.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.536+0000 7f6440158640 1 -- 172.21.15.53:0/3294986052 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6438153920 con 0x7f64380afc60 2023-06-10T19:04:49.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.536+0000 7f642e7fc640 1 -- 172.21.15.53:0/3294986052 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4672 (secure 0 0 0) 0x7f6438153920 con 0x7f64380afc60 2023-06-10T19:04:49.541 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:04:49.542 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":63,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6542,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/3258793373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3258793373},{"type":"v1","addr":"172.21.15.117:6836","nonce":3258793373}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":7363,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/585135979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":585135979},{"type":"v1","addr":"172.21.15.117:6837","nonce":585135979}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":8682,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/448704478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":448704478},{"type":"v1","addr":"172.21.15.53:6833","nonce":448704478}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:03:48.420425+0000","modified":"2023-06-10T19:04:06.109236+0000","tableserver":0,"root":0,"session_timeout":30,"session_autoclose":50,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8685},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8685":{"gid":8685,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/1149668719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":1149668719},{"type":"v1","addr":"172.21.15.53:6835","nonce":1149668719}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-06-10T19:04:49.543 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 63 2023-06-10T19:04:49.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.536+0000 7f6440158640 1 -- 172.21.15.53:0/3294986052 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f641c066280 msgr2=0x7f641c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:49.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.536+0000 7f6440158640 1 --2- 172.21.15.53:0/3294986052 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f641c066280 0x7f641c068730 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f64380af790 tx=0x7f6428008040 comp rx=0 tx=0).stop 2023-06-10T19:04:49.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.536+0000 7f6440158640 1 -- 172.21.15.53:0/3294986052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64380afc60 msgr2=0x7f6438156e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:49.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.536+0000 7f6440158640 1 --2- 172.21.15.53:0/3294986052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64380afc60 0x7f6438156e70 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7f64340ac000 tx=0x7f643401acd0 comp rx=0 tx=0).stop 2023-06-10T19:04:49.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.536+0000 7f6440158640 1 -- 172.21.15.53:0/3294986052 shutdown_connections 2023-06-10T19:04:49.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.536+0000 7f6440158640 1 --2- 172.21.15.53:0/3294986052 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f641c066280 0x7f641c068730 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:49.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.536+0000 7f6440158640 1 --2- 172.21.15.53:0/3294986052 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64380cb870 0x7f643814e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:49.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.536+0000 7f6440158640 1 --2- 172.21.15.53:0/3294986052 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64380c9750 0x7f64380aba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:49.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.536+0000 7f6440158640 1 --2- 172.21.15.53:0/3294986052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64380afc60 0x7f6438156e70 unknown :-1 s=CLOSED pgs=1799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:49.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.536+0000 7f6440158640 1 -- 172.21.15.53:0/3294986052 >> 172.21.15.53:0/3294986052 conn(0x7f643806a0d0 msgr2=0x7f64380c8bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:04:49.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.536+0000 7f6440158640 1 -- 172.21.15.53:0/3294986052 shutdown_connections 2023-06-10T19:04:49.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.536+0000 7f6440158640 1 -- 172.21.15.53:0/3294986052 wait complete. 2023-06-10T19:04:49.560 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:04:49.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.672+0000 7f6c50d20640 1 Processor -- start 2023-06-10T19:04:49.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.672+0000 7f6c50d20640 1 -- start start 2023-06-10T19:04:49.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.676+0000 7f6c50d20640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6c4c0c9750 0x7f6c4c0aced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:49.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.676+0000 7f6c50d20640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6c4c0cb870 0x7f6c4c0af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:49.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.676+0000 7f6c50d20640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c4c0ad410 con 0x7f6c4c0afc60 2023-06-10T19:04:49.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.676+0000 7f6c50d20640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c4c0cd990 con 0x7f6c4c0c9750 2023-06-10T19:04:49.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.676+0000 7f6c50d20640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4c0b00e0 con 0x7f6c4c0cb870 2023-06-10T19:04:49.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.676+0000 7f6c4a59c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6c4c0c9750 0x7f6c4c0aced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:49.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.676+0000 7f6c49d9b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6c4c0cb870 0x7f6c4c0af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:49.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.676+0000 7f6c4ad9d640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f6c4c0afc60 0x7f6c4c15bec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.53:46098/0 (socket says 172.21.15.53:46098) 2023-06-10T19:04:49.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.676+0000 7f6c4ad9d640 1 -- 172.21.15.53:0/3801324876 learned_addr learned my addr 172.21.15.53:0/3801324876 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:04:49.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.676+0000 7f6c49d9b640 1 -- 172.21.15.53:0/3801324876 >> v2:172.21.15.117:3300/0 conn(0x7f6c4c0c9750 msgr2=0x7f6c4c0aced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:04:49.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.676+0000 7f6c49d9b640 1 --2- 172.21.15.53:0/3801324876 >> v2:172.21.15.117:3300/0 conn(0x7f6c4c0c9750 0x7f6c4c0aced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:49.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.676+0000 7f6c49d9b640 1 -- 172.21.15.53:0/3801324876 >> v1:172.21.15.117:6789/0 conn(0x7f6c4c0afc60 legacy=0x7f6c4c15bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:49.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.676+0000 7f6c49d9b640 1 -- 172.21.15.53:0/3801324876 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c4c1600d0 con 0x7f6c4c0cb870 2023-06-10T19:04:49.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.680+0000 7f6c49d9b640 1 --2- 172.21.15.53:0/3801324876 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6c4c0cb870 0x7f6c4c0af720 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c0097c0 tx=0x7f6c3c01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66dc1259d902cc1f server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:49.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.680+0000 7f6c4959a640 1 -- 172.21.15.53:0/3801324876 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c3c0ab650 con 0x7f6c4c0cb870 2023-06-10T19:04:49.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.680+0000 7f6c4959a640 1 -- 172.21.15.53:0/3801324876 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c3c0ab7b0 con 0x7f6c4c0cb870 2023-06-10T19:04:49.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.680+0000 7f6c4959a640 1 -- 172.21.15.53:0/3801324876 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c3c0abb40 con 0x7f6c4c0cb870 2023-06-10T19:04:49.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.680+0000 7f6c50d20640 1 -- 172.21.15.53:0/3801324876 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6c4c0cb870 msgr2=0x7f6c4c0af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:49.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.680+0000 7f6c50d20640 1 --2- 172.21.15.53:0/3801324876 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6c4c0cb870 0x7f6c4c0af720 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c0097c0 tx=0x7f6c3c01c450 comp rx=0 tx=0).stop 2023-06-10T19:04:49.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.680+0000 7f6c50d20640 1 -- 172.21.15.53:0/3801324876 shutdown_connections 2023-06-10T19:04:49.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.680+0000 7f6c50d20640 1 --2- 172.21.15.53:0/3801324876 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6c4c0cb870 0x7f6c4c0af720 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:49.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.680+0000 7f6c50d20640 1 --2- 172.21.15.53:0/3801324876 >> v2:172.21.15.117:3300/0 conn(0x7f6c4c0c9750 0x7f6c4c0aced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:49.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.680+0000 7f6c50d20640 1 -- 172.21.15.53:0/3801324876 >> 172.21.15.53:0/3801324876 conn(0x7f6c4c06a0d0 msgr2=0x7f6c4c0ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:04:49.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.680+0000 7f6c50d20640 1 -- 172.21.15.53:0/3801324876 shutdown_connections 2023-06-10T19:04:49.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.680+0000 7f6c50d20640 1 -- 172.21.15.53:0/3801324876 wait complete. 2023-06-10T19:04:49.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.680+0000 7f6c50d20640 1 Processor -- start 2023-06-10T19:04:49.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.680+0000 7f6c50d20640 1 -- start start 2023-06-10T19:04:49.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.680+0000 7f6c50d20640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6c4c0afc60 0x7f6c4c1571f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:49.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.680+0000 7f6c50d20640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c4c0c9750 0x7f6c4c1557b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:49.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.680+0000 7f6c50d20640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c4c0cb870 0x7f6c4c070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:49.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.680+0000 7f6c50d20640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4c1541b0 con 0x7f6c4c0c9750 2023-06-10T19:04:49.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.680+0000 7f6c50d20640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4c153910 con 0x7f6c4c0cb870 2023-06-10T19:04:49.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.680+0000 7f6c50d20640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4c157820 con 0x7f6c4c0afc60 2023-06-10T19:04:49.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.680+0000 7f6c49d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c4c0c9750 0x7f6c4c1557b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:49.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.680+0000 7f6c4a59c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6c4c0afc60 0x7f6c4c1571f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:49.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.684+0000 7f6c4a59c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6c4c0afc60 0x7f6c4c1571f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.53:43536/0 (socket says 172.21.15.53:43536) 2023-06-10T19:04:49.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.684+0000 7f6c4a59c640 1 -- 172.21.15.53:0/3025240698 learned_addr learned my addr 172.21.15.53:0/3025240698 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:04:49.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.684+0000 7f6c49d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c4c0c9750 0x7f6c4c1557b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53670/0 (socket says 172.21.15.53:53670) 2023-06-10T19:04:49.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.684+0000 7f6c4ad9d640 1 --2- 172.21.15.53:0/3025240698 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c4c0cb870 0x7f6c4c070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:49.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.684+0000 7f6c49d9b640 1 -- 172.21.15.53:0/3025240698 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6c4c0afc60 msgr2=0x7f6c4c1571f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:49.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.684+0000 7f6c49d9b640 1 --2- 172.21.15.53:0/3025240698 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6c4c0afc60 0x7f6c4c1571f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:49.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.684+0000 7f6c49d9b640 1 -- 172.21.15.53:0/3025240698 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c4c0cb870 msgr2=0x7f6c4c070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:49.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.684+0000 7f6c49d9b640 1 --2- 172.21.15.53:0/3025240698 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c4c0cb870 0x7f6c4c070450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:49.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.684+0000 7f6c49d9b640 1 -- 172.21.15.53:0/3025240698 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c3c009420 con 0x7f6c4c0c9750 2023-06-10T19:04:49.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.684+0000 7f6c49d9b640 1 --2- 172.21.15.53:0/3025240698 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c4c0c9750 0x7f6c4c1557b0 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c0ac000 tx=0x7f6c3c01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:49.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.684+0000 7f6c3affd640 1 -- 172.21.15.53:0/3025240698 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c3c0ab650 con 0x7f6c4c0c9750 2023-06-10T19:04:49.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.684+0000 7f6c3affd640 1 -- 172.21.15.53:0/3025240698 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c3c0bf410 con 0x7f6c4c0c9750 2023-06-10T19:04:49.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.684+0000 7f6c50d20640 1 -- 172.21.15.53:0/3025240698 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c4c153b60 con 0x7f6c4c0c9750 2023-06-10T19:04:49.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.684+0000 7f6c3affd640 1 -- 172.21.15.53:0/3025240698 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c3c0bf7c0 con 0x7f6c4c0c9750 2023-06-10T19:04:49.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.684+0000 7f6c50d20640 1 -- 172.21.15.53:0/3025240698 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c4c155cf0 con 0x7f6c4c0c9750 2023-06-10T19:04:49.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.684+0000 7f6c50d20640 1 -- 172.21.15.53:0/3025240698 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c4c04d790 con 0x7f6c4c0c9750 2023-06-10T19:04:49.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.684+0000 7f6c3affd640 1 -- 172.21.15.53:0/3025240698 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6c3c0bf920 con 0x7f6c4c0c9750 2023-06-10T19:04:49.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.684+0000 7f6c3affd640 1 --2- 172.21.15.53:0/3025240698 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6c2c066280 0x7f6c2c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:49.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.684+0000 7f6c3affd640 1 -- 172.21.15.53:0/3025240698 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6192+0+0 (secure 0 0 0) 0x7f6c3c11e630 con 0x7f6c4c0c9750 2023-06-10T19:04:49.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.684+0000 7f6c4a59c640 1 --2- 172.21.15.53:0/3025240698 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6c2c066280 0x7f6c2c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:49.693 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.688+0000 7f6c4a59c640 1 --2- 172.21.15.53:0/3025240698 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6c2c066280 0x7f6c2c068730 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f6c40009b80 tx=0x7f6c40009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:49.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.688+0000 7f6c3affd640 1 -- 172.21.15.53:0/3025240698 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6c3c0ebaf0 con 0x7f6c4c0c9750 2023-06-10T19:04:49.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.840+0000 7f6c50d20640 1 -- 172.21.15.53:0/3025240698 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6c4c0b0680 con 0x7f6c4c0c9750 2023-06-10T19:04:49.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.844+0000 7f6c3affd640 1 -- 172.21.15.53:0/3025240698 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) v1 ==== 74+0+18486 (secure 0 0 0) 0x7f6c3c0ef110 con 0x7f6c4c0c9750 2023-06-10T19:04:49.849 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:04:49.849 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":113,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:04:44.261377+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-06-10T19:03:46.427131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-06-10T19:03:47.398979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.d","mappings":[{"from":6,"to":7}]},{"pgid":"16.13","mappings":[{"from":1,"to":4}]},{"pgid":"16.1e","mappings":[{"from":5,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.0.1:0/3878814772":"2023-06-10T20:04:43.440652+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:04:49.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.844+0000 7f6c50d20640 1 -- 172.21.15.53:0/3025240698 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6c2c066280 msgr2=0x7f6c2c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:49.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.844+0000 7f6c50d20640 1 --2- 172.21.15.53:0/3025240698 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6c2c066280 0x7f6c2c068730 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f6c40009b80 tx=0x7f6c40009190 comp rx=0 tx=0).stop 2023-06-10T19:04:49.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.844+0000 7f6c50d20640 1 -- 172.21.15.53:0/3025240698 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c4c0c9750 msgr2=0x7f6c4c1557b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:49.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.844+0000 7f6c50d20640 1 --2- 172.21.15.53:0/3025240698 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c4c0c9750 0x7f6c4c1557b0 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c0ac000 tx=0x7f6c3c01ac90 comp rx=0 tx=0).stop 2023-06-10T19:04:49.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.844+0000 7f6c50d20640 1 -- 172.21.15.53:0/3025240698 shutdown_connections 2023-06-10T19:04:49.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.844+0000 7f6c50d20640 1 --2- 172.21.15.53:0/3025240698 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6c2c066280 0x7f6c2c068730 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:49.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.844+0000 7f6c50d20640 1 --2- 172.21.15.53:0/3025240698 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c4c0cb870 0x7f6c4c070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:49.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.844+0000 7f6c50d20640 1 --2- 172.21.15.53:0/3025240698 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c4c0c9750 0x7f6c4c1557b0 unknown :-1 s=CLOSED pgs=1800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:49.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.844+0000 7f6c50d20640 1 --2- 172.21.15.53:0/3025240698 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6c4c0afc60 0x7f6c4c1571f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:49.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.844+0000 7f6c50d20640 1 -- 172.21.15.53:0/3025240698 >> 172.21.15.53:0/3025240698 conn(0x7f6c4c06a0d0 msgr2=0x7f6c4c15f4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:04:49.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.844+0000 7f6c50d20640 1 -- 172.21.15.53:0/3025240698 shutdown_connections 2023-06-10T19:04:49.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.844+0000 7f6c50d20640 1 -- 172.21.15.53:0/3025240698 wait complete. 2023-06-10T19:04:49.867 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-10T18:52:33.633114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-10T18:52:39.171487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-10T19:03:46.427131+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '109', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2023-06-10T19:03:47.398979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '110', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-10T19:04:49.868 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-10T19:04:49.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.980+0000 7f0db81d4640 1 Processor -- start 2023-06-10T19:04:49.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.980+0000 7f0db81d4640 1 -- start start 2023-06-10T19:04:49.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.980+0000 7f0db81d4640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0db015c090 0x7f0db00b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:49.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.980+0000 7f0db81d4640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0db00b7e30 0x7f0db00d04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:49.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.980+0000 7f0db81d4640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0db00cc7c0 con 0x7f0db00b0b90 2023-06-10T19:04:49.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.980+0000 7f0db81d4640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0db00ccaa0 con 0x7f0db00b7e30 2023-06-10T19:04:49.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.980+0000 7f0db81d4640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0db00ccd80 con 0x7f0db015c090 2023-06-10T19:04:49.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.980+0000 7f0db6771640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0db00b7e30 0x7f0db00d04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:49.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.980+0000 7f0db6771640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0db00b7e30 0x7f0db00d04d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53676/0 (socket says 172.21.15.53:53676) 2023-06-10T19:04:49.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.980+0000 7f0db576f640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f0db00b0b90 0x7f0db00b7720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:51626/0 (socket says 172.21.15.53:51626) 2023-06-10T19:04:49.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.980+0000 7f0db6771640 1 -- 172.21.15.53:0/1640921250 learned_addr learned my addr 172.21.15.53:0/1640921250 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:04:49.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.980+0000 7f0db5f70640 1 --2- 172.21.15.53:0/1640921250 >> v2:172.21.15.117:3300/0 conn(0x7f0db015c090 0x7f0db00b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:49.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.980+0000 7f0db6771640 1 -- 172.21.15.53:0/1640921250 >> v2:172.21.15.117:3300/0 conn(0x7f0db015c090 msgr2=0x7f0db00b10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:04:49.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.980+0000 7f0db6771640 1 --2- 172.21.15.53:0/1640921250 >> v2:172.21.15.117:3300/0 conn(0x7f0db015c090 0x7f0db00b10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:49.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.980+0000 7f0db6771640 1 -- 172.21.15.53:0/1640921250 >> v1:172.21.15.53:6789/0 conn(0x7f0db00b0b90 legacy=0x7f0db00b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:49.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.980+0000 7f0db6771640 1 -- 172.21.15.53:0/1640921250 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db00cd060 con 0x7f0db00b7e30 2023-06-10T19:04:49.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.980+0000 7f0db4f6e640 1 -- 172.21.15.53:0/1640921250 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1204566285 0 0) 0x7f0db00cc7c0 con 0x7f0db00b0b90 2023-06-10T19:04:49.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.980+0000 7f0db5f70640 1 --2- 172.21.15.53:0/1640921250 >> v2:172.21.15.117:3300/0 conn(0x7f0db015c090 0x7f0db00b10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:04:49.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.984+0000 7f0db6771640 1 --2- 172.21.15.53:0/1640921250 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0db00b7e30 0x7f0db00d04d0 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7f0db008a080 tx=0x7f0da801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcc391e7a434b3e1 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:49.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.984+0000 7f0db4f6e640 1 -- 172.21.15.53:0/1640921250 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da80a5730 con 0x7f0db00b7e30 2023-06-10T19:04:49.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.984+0000 7f0db4f6e640 1 -- 172.21.15.53:0/1640921250 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0da80a5890 con 0x7f0db00b7e30 2023-06-10T19:04:49.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.984+0000 7f0db4f6e640 1 -- 172.21.15.53:0/1640921250 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da80a5c20 con 0x7f0db00b7e30 2023-06-10T19:04:49.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.984+0000 7f0db81d4640 1 -- 172.21.15.53:0/1640921250 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0db00b7e30 msgr2=0x7f0db00d04d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:49.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.984+0000 7f0db81d4640 1 --2- 172.21.15.53:0/1640921250 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0db00b7e30 0x7f0db00d04d0 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7f0db008a080 tx=0x7f0da801c910 comp rx=0 tx=0).stop 2023-06-10T19:04:49.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.984+0000 7f0db81d4640 1 -- 172.21.15.53:0/1640921250 shutdown_connections 2023-06-10T19:04:49.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.984+0000 7f0db81d4640 1 --2- 172.21.15.53:0/1640921250 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0db00b7e30 0x7f0db00d04d0 unknown :-1 s=CLOSED pgs=1802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:49.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.984+0000 7f0db81d4640 1 --2- 172.21.15.53:0/1640921250 >> v2:172.21.15.117:3300/0 conn(0x7f0db015c090 0x7f0db00b10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:49.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.984+0000 7f0db81d4640 1 -- 172.21.15.53:0/1640921250 >> 172.21.15.53:0/1640921250 conn(0x7f0db0069e20 msgr2=0x7f0db006a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:04:49.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.984+0000 7f0db81d4640 1 -- 172.21.15.53:0/1640921250 shutdown_connections 2023-06-10T19:04:49.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.984+0000 7f0db81d4640 1 -- 172.21.15.53:0/1640921250 wait complete. 2023-06-10T19:04:49.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.984+0000 7f0db81d4640 1 Processor -- start 2023-06-10T19:04:49.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.984+0000 7f0db81d4640 1 -- start start 2023-06-10T19:04:49.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.984+0000 7f0db81d4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0db00b0b90 0x7f0db01465a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:49.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.984+0000 7f0db81d4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0db00b7e30 0x7f0db0158060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:49.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.984+0000 7f0db81d4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0db015c090 0x7f0db00ce8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:49.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.984+0000 7f0db81d4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db00c35a0 con 0x7f0db00b7e30 2023-06-10T19:04:49.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.984+0000 7f0db81d4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db0146ae0 con 0x7f0db00b0b90 2023-06-10T19:04:49.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.984+0000 7f0db81d4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0db00c3780 con 0x7f0db015c090 2023-06-10T19:04:49.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.984+0000 7f0db576f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0db00b7e30 0x7f0db0158060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:49.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.984+0000 7f0db576f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0db00b7e30 0x7f0db0158060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53690/0 (socket says 172.21.15.53:53690) 2023-06-10T19:04:49.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.984+0000 7f0db576f640 1 -- 172.21.15.53:0/2629490984 learned_addr learned my addr 172.21.15.53:0/2629490984 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:04:49.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.984+0000 7f0db6771640 1 --2- 172.21.15.53:0/2629490984 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0db015c090 0x7f0db00ce8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:49.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.984+0000 7f0db576f640 1 -- 172.21.15.53:0/2629490984 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0db015c090 msgr2=0x7f0db00ce8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:49.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.984+0000 7f0db576f640 1 --2- 172.21.15.53:0/2629490984 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0db015c090 0x7f0db00ce8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:49.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.984+0000 7f0db576f640 1 -- 172.21.15.53:0/2629490984 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0db00b0b90 msgr2=0x7f0db01465a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:49.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.984+0000 7f0db576f640 1 --2- 172.21.15.53:0/2629490984 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0db00b0b90 0x7f0db01465a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:49.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.984+0000 7f0db576f640 1 -- 172.21.15.53:0/2629490984 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0da8009b30 con 0x7f0db00b7e30 2023-06-10T19:04:49.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.984+0000 7f0db576f640 1 --2- 172.21.15.53:0/2629490984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0db00b7e30 0x7f0db0158060 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f0da000c480 tx=0x7f0da000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:49.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.984+0000 7f0da67fc640 1 -- 172.21.15.53:0/2629490984 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da0007480 con 0x7f0db00b7e30 2023-06-10T19:04:49.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.984+0000 7f0da67fc640 1 -- 172.21.15.53:0/2629490984 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0da0007600 con 0x7f0db00b7e30 2023-06-10T19:04:49.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.984+0000 7f0db81d4640 1 -- 172.21.15.53:0/2629490984 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0db00c3a60 con 0x7f0db00b7e30 2023-06-10T19:04:49.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.984+0000 7f0da67fc640 1 -- 172.21.15.53:0/2629490984 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da0004a30 con 0x7f0db00b7e30 2023-06-10T19:04:49.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.988+0000 7f0db81d4640 1 -- 172.21.15.53:0/2629490984 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0db00c4020 con 0x7f0db00b7e30 2023-06-10T19:04:49.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.988+0000 7f0db81d4640 1 -- 172.21.15.53:0/2629490984 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0db004d790 con 0x7f0db00b7e30 2023-06-10T19:04:49.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.988+0000 7f0da67fc640 1 -- 172.21.15.53:0/2629490984 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0da0004b90 con 0x7f0db00b7e30 2023-06-10T19:04:49.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.988+0000 7f0da67fc640 1 --2- 172.21.15.53:0/2629490984 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0d940662b0 0x7f0d94068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:49.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.988+0000 7f0da67fc640 1 -- 172.21.15.53:0/2629490984 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6192+0+0 (secure 0 0 0) 0x7f0da0082e90 con 0x7f0db00b7e30 2023-06-10T19:04:49.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.988+0000 7f0db5f70640 1 --2- 172.21.15.53:0/2629490984 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0d940662b0 0x7f0d94068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:49.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.988+0000 7f0db5f70640 1 --2- 172.21.15.53:0/2629490984 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0d940662b0 0x7f0d94068760 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f0db0156260 tx=0x7f0dac008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:49.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:49.992+0000 7f0da67fc640 1 -- 172.21.15.53:0/2629490984 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0da0050320 con 0x7f0db00b7e30 2023-06-10T19:04:50.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.144+0000 7f0db81d4640 1 -- 172.21.15.53:0/2629490984 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0db00b72f0 con 0x7f0db00b7e30 2023-06-10T19:04:50.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.144+0000 7f0da67fc640 1 -- 172.21.15.53:0/2629490984 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v113) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0da00180a0 con 0x7f0db00b7e30 2023-06-10T19:04:50.149 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-06-10T19:04:50.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.148+0000 7f0db81d4640 1 -- 172.21.15.53:0/2629490984 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0d940662b0 msgr2=0x7f0d94068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:50.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.148+0000 7f0db81d4640 1 --2- 172.21.15.53:0/2629490984 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0d940662b0 0x7f0d94068760 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f0db0156260 tx=0x7f0dac008040 comp rx=0 tx=0).stop 2023-06-10T19:04:50.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.148+0000 7f0db81d4640 1 -- 172.21.15.53:0/2629490984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0db00b7e30 msgr2=0x7f0db0158060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:50.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.148+0000 7f0db81d4640 1 --2- 172.21.15.53:0/2629490984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0db00b7e30 0x7f0db0158060 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f0da000c480 tx=0x7f0da000c940 comp rx=0 tx=0).stop 2023-06-10T19:04:50.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.148+0000 7f0db81d4640 1 -- 172.21.15.53:0/2629490984 shutdown_connections 2023-06-10T19:04:50.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.148+0000 7f0db81d4640 1 --2- 172.21.15.53:0/2629490984 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0d940662b0 0x7f0d94068760 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:50.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.148+0000 7f0db81d4640 1 --2- 172.21.15.53:0/2629490984 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0db015c090 0x7f0db00ce8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:50.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.148+0000 7f0db81d4640 1 --2- 172.21.15.53:0/2629490984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0db00b7e30 0x7f0db0158060 unknown :-1 s=CLOSED pgs=1803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:50.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.148+0000 7f0db81d4640 1 --2- 172.21.15.53:0/2629490984 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0db00b0b90 0x7f0db01465a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:50.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.148+0000 7f0db81d4640 1 -- 172.21.15.53:0/2629490984 >> 172.21.15.53:0/2629490984 conn(0x7f0db0069e20 msgr2=0x7f0db01568f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:04:50.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.148+0000 7f0db81d4640 1 -- 172.21.15.53:0/2629490984 shutdown_connections 2023-06-10T19:04:50.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.148+0000 7f0db81d4640 1 -- 172.21.15.53:0/2629490984 wait complete. 2023-06-10T19:04:50.168 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-10T19:04:50.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.292+0000 7f51024a2640 1 Processor -- start 2023-06-10T19:04:50.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.292+0000 7f51024a2640 1 -- start start 2023-06-10T19:04:50.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.292+0000 7f51024a2640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f50fc0b0f30 0x7f50fc070950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:50.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.292+0000 7f51024a2640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f50fc159a60 0x7f50fc0c2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:50.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.292+0000 7f51024a2640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50fc0cb080 con 0x7f50fc159690 2023-06-10T19:04:50.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.292+0000 7f51024a2640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50fc070e90 con 0x7f50fc159a60 2023-06-10T19:04:50.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.292+0000 7f51024a2640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50fc06d450 con 0x7f50fc0b0f30 2023-06-10T19:04:50.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.292+0000 7f5100a3f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f50fc159a60 0x7f50fc0c2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:50.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.292+0000 7f5100a3f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f50fc159a60 0x7f50fc0c2900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53702/0 (socket says 172.21.15.53:53702) 2023-06-10T19:04:50.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.292+0000 7f5100a3f640 1 -- 172.21.15.53:0/534335555 learned_addr learned my addr 172.21.15.53:0/534335555 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:04:50.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.292+0000 7f50fb7fe640 1 --2- 172.21.15.53:0/534335555 >> v2:172.21.15.117:3300/0 conn(0x7f50fc0b0f30 0x7f50fc070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:50.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.292+0000 7f5100a3f640 1 -- 172.21.15.53:0/534335555 >> v2:172.21.15.117:3300/0 conn(0x7f50fc0b0f30 msgr2=0x7f50fc070950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:04:50.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.292+0000 7f5100a3f640 1 --2- 172.21.15.53:0/534335555 >> v2:172.21.15.117:3300/0 conn(0x7f50fc0b0f30 0x7f50fc070950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:50.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.292+0000 7f5100a3f640 1 -- 172.21.15.53:0/534335555 >> v1:172.21.15.117:6789/0 conn(0x7f50fc159690 legacy=0x7f50fc0cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:04:50.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.292+0000 7f5100a3f640 1 -- 172.21.15.53:0/534335555 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50fc0cb320 con 0x7f50fc159a60 2023-06-10T19:04:50.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.296+0000 7f5100a3f640 1 --2- 172.21.15.53:0/534335555 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50fc159a60 0x7f50fc0c2900 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7f50fc0cec80 tx=0x7f50f401c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6deaa2a7571073e9 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:50.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.296+0000 7f50faffd640 1 -- 172.21.15.53:0/534335555 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f40a5730 con 0x7f50fc159a60 2023-06-10T19:04:50.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.296+0000 7f50faffd640 1 -- 172.21.15.53:0/534335555 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50f40a5890 con 0x7f50fc159a60 2023-06-10T19:04:50.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.296+0000 7f50faffd640 1 -- 172.21.15.53:0/534335555 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f40a5c20 con 0x7f50fc159a60 2023-06-10T19:04:50.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.296+0000 7f51024a2640 1 -- 172.21.15.53:0/534335555 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50fc159a60 msgr2=0x7f50fc0c2900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:50.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.296+0000 7f51024a2640 1 --2- 172.21.15.53:0/534335555 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50fc159a60 0x7f50fc0c2900 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7f50fc0cec80 tx=0x7f50f401c960 comp rx=0 tx=0).stop 2023-06-10T19:04:50.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.296+0000 7f51024a2640 1 -- 172.21.15.53:0/534335555 shutdown_connections 2023-06-10T19:04:50.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.296+0000 7f51024a2640 1 --2- 172.21.15.53:0/534335555 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50fc159a60 0x7f50fc0c2900 unknown :-1 s=CLOSED pgs=1804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:50.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.296+0000 7f51024a2640 1 --2- 172.21.15.53:0/534335555 >> v2:172.21.15.117:3300/0 conn(0x7f50fc0b0f30 0x7f50fc070950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:50.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.296+0000 7f51024a2640 1 -- 172.21.15.53:0/534335555 >> 172.21.15.53:0/534335555 conn(0x7f50fc06a560 msgr2=0x7f50fc06a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:04:50.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.296+0000 7f51024a2640 1 -- 172.21.15.53:0/534335555 shutdown_connections 2023-06-10T19:04:50.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.296+0000 7f51024a2640 1 -- 172.21.15.53:0/534335555 wait complete. 2023-06-10T19:04:50.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.296+0000 7f51024a2640 1 Processor -- start 2023-06-10T19:04:50.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.296+0000 7f51024a2640 1 -- start start 2023-06-10T19:04:50.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.300+0000 7f51024a2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50fc0b0f30 0x7f50fc14f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:50.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.300+0000 7f51024a2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50fc159690 0x7f50fc154f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:50.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.300+0000 7f51024a2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50fc159a60 0x7f50fc0c7d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:50.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.300+0000 7f51024a2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50fc0c4790 con 0x7f50fc0b0f30 2023-06-10T19:04:50.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.300+0000 7f51024a2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50fc0c44b0 con 0x7f50fc159690 2023-06-10T19:04:50.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.300+0000 7f51024a2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50fc0c5fb0 con 0x7f50fc159a60 2023-06-10T19:04:50.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.300+0000 7f50fbfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50fc0b0f30 0x7f50fc14f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:50.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.300+0000 7f50fbfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50fc0b0f30 0x7f50fc14f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53712/0 (socket says 172.21.15.53:53712) 2023-06-10T19:04:50.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.300+0000 7f50fbfff640 1 -- 172.21.15.53:0/4142970408 learned_addr learned my addr 172.21.15.53:0/4142970408 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:04:50.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.300+0000 7f50fb7fe640 1 --2- 172.21.15.53:0/4142970408 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50fc159690 0x7f50fc154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:50.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.300+0000 7f5100a3f640 1 --2- 172.21.15.53:0/4142970408 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50fc159a60 0x7f50fc0c7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:50.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.300+0000 7f50fbfff640 1 -- 172.21.15.53:0/4142970408 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50fc159a60 msgr2=0x7f50fc0c7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:50.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.300+0000 7f50fbfff640 1 --2- 172.21.15.53:0/4142970408 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50fc159a60 0x7f50fc0c7d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:50.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.300+0000 7f50fbfff640 1 -- 172.21.15.53:0/4142970408 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50fc159690 msgr2=0x7f50fc154f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:50.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.300+0000 7f50fbfff640 1 --2- 172.21.15.53:0/4142970408 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50fc159690 0x7f50fc154f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:50.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.300+0000 7f50fbfff640 1 -- 172.21.15.53:0/4142970408 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50f4009b30 con 0x7f50fc0b0f30 2023-06-10T19:04:50.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.300+0000 7f5100a3f640 1 --2- 172.21.15.53:0/4142970408 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50fc159a60 0x7f50fc0c7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:04:50.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.300+0000 7f50fbfff640 1 --2- 172.21.15.53:0/4142970408 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50fc0b0f30 0x7f50fc14f130 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7f50ec00c450 tx=0x7f50ec00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:50.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.300+0000 7f50f8ff9640 1 -- 172.21.15.53:0/4142970408 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50ec012830 con 0x7f50fc0b0f30 2023-06-10T19:04:50.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.300+0000 7f50f8ff9640 1 -- 172.21.15.53:0/4142970408 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50ec0129b0 con 0x7f50fc0b0f30 2023-06-10T19:04:50.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.300+0000 7f51024a2640 1 -- 172.21.15.53:0/4142970408 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50fc0c6290 con 0x7f50fc0b0f30 2023-06-10T19:04:50.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.300+0000 7f50f8ff9640 1 -- 172.21.15.53:0/4142970408 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50ec012d60 con 0x7f50fc0b0f30 2023-06-10T19:04:50.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.300+0000 7f51024a2640 1 -- 172.21.15.53:0/4142970408 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50fc0c8450 con 0x7f50fc0b0f30 2023-06-10T19:04:50.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.300+0000 7f51024a2640 1 -- 172.21.15.53:0/4142970408 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50fc0b4dc0 con 0x7f50fc0b0f30 2023-06-10T19:04:50.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.300+0000 7f50f8ff9640 1 -- 172.21.15.53:0/4142970408 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f50ec01c460 con 0x7f50fc0b0f30 2023-06-10T19:04:50.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.300+0000 7f50f8ff9640 1 --2- 172.21.15.53:0/4142970408 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f50e8066280 0x7f50e8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:50.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.300+0000 7f50f8ff9640 1 -- 172.21.15.53:0/4142970408 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6192+0+0 (secure 0 0 0) 0x7f50ec083b90 con 0x7f50fc0b0f30 2023-06-10T19:04:50.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.300+0000 7f50fb7fe640 1 --2- 172.21.15.53:0/4142970408 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f50e8066280 0x7f50e8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:50.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.304+0000 7f50fb7fe640 1 --2- 172.21.15.53:0/4142970408 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f50e8066280 0x7f50e8068730 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f50fc0c4bc0 tx=0x7f50f0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:50.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.308+0000 7f50f8ff9640 1 -- 172.21.15.53:0/4142970408 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f50ec051020 con 0x7f50fc0b0f30 2023-06-10T19:04:50.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.468+0000 7f51024a2640 1 -- 172.21.15.53:0/4142970408 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f50fc04d790 con 0x7f50fc0b0f30 2023-06-10T19:04:50.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.468+0000 7f50f8ff9640 1 -- 172.21.15.53:0/4142970408 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v113) v1 ==== 92+0+10 (secure 0 0 0) 0x7f50ec054640 con 0x7f50fc0b0f30 2023-06-10T19:04:50.472 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-06-10T19:04:50.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.468+0000 7f51024a2640 1 -- 172.21.15.53:0/4142970408 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f50e8066280 msgr2=0x7f50e8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:50.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.468+0000 7f51024a2640 1 --2- 172.21.15.53:0/4142970408 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f50e8066280 0x7f50e8068730 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f50fc0c4bc0 tx=0x7f50f0008040 comp rx=0 tx=0).stop 2023-06-10T19:04:50.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.468+0000 7f51024a2640 1 -- 172.21.15.53:0/4142970408 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50fc0b0f30 msgr2=0x7f50fc14f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:50.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.468+0000 7f51024a2640 1 --2- 172.21.15.53:0/4142970408 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50fc0b0f30 0x7f50fc14f130 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7f50ec00c450 tx=0x7f50ec00c910 comp rx=0 tx=0).stop 2023-06-10T19:04:50.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.468+0000 7f51024a2640 1 -- 172.21.15.53:0/4142970408 shutdown_connections 2023-06-10T19:04:50.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.468+0000 7f51024a2640 1 --2- 172.21.15.53:0/4142970408 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f50e8066280 0x7f50e8068730 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:50.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.468+0000 7f51024a2640 1 --2- 172.21.15.53:0/4142970408 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50fc159a60 0x7f50fc0c7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:50.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.468+0000 7f51024a2640 1 --2- 172.21.15.53:0/4142970408 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50fc159690 0x7f50fc154f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:50.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.468+0000 7f51024a2640 1 --2- 172.21.15.53:0/4142970408 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50fc0b0f30 0x7f50fc14f130 unknown :-1 s=CLOSED pgs=1805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:50.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.468+0000 7f51024a2640 1 -- 172.21.15.53:0/4142970408 >> 172.21.15.53:0/4142970408 conn(0x7f50fc06a560 msgr2=0x7f50fc06a930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:04:50.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.468+0000 7f51024a2640 1 -- 172.21.15.53:0/4142970408 shutdown_connections 2023-06-10T19:04:50.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.468+0000 7f51024a2640 1 -- 172.21.15.53:0/4142970408 wait complete. 2023-06-10T19:04:50.493 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-10T19:04:50.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.616+0000 7fca4a6ab640 1 Processor -- start 2023-06-10T19:04:50.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.616+0000 7fca4a6ab640 1 -- start start 2023-06-10T19:04:50.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.616+0000 7fca4a6ab640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fca440c82a0 0x7fca440c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:50.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.616+0000 7fca4a6ab640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fca440af760 0x7fca440afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:50.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.616+0000 7fca4a6ab640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca4406b090 con 0x7fca440c9fa0 2023-06-10T19:04:50.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.616+0000 7fca4a6ab640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca440b0120 con 0x7fca440af760 2023-06-10T19:04:50.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.616+0000 7fca4a6ab640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca440ca370 con 0x7fca440c82a0 2023-06-10T19:04:50.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.620+0000 7fca43fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fca440c9fa0 0x7fca4406bae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:51628/0 (socket says 172.21.15.53:51628) 2023-06-10T19:04:50.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.620+0000 7fca43fff640 1 -- 172.21.15.53:0/3151329271 learned_addr learned my addr 172.21.15.53:0/3151329271 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:04:50.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.620+0000 7fca437fe640 1 --2- 172.21.15.53:0/3151329271 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fca440c82a0 0x7fca440c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:50.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.620+0000 7fca48c48640 1 --2- 172.21.15.53:0/3151329271 >> v2:172.21.15.117:3300/0 conn(0x7fca440af760 0x7fca440afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:50.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.620+0000 7fca42ffd640 1 -- 172.21.15.53:0/3151329271 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2356633679 0 0) 0x7fca4406b090 con 0x7fca440c9fa0 2023-06-10T19:04:50.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.620+0000 7fca42ffd640 1 -- 172.21.15.53:0/3151329271 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca30003530 con 0x7fca440c9fa0 2023-06-10T19:04:50.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.620+0000 7fca42ffd640 1 -- 172.21.15.53:0/3151329271 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 539541128 0 0) 0x7fca30003530 con 0x7fca440c9fa0 2023-06-10T19:04:50.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.620+0000 7fca42ffd640 1 -- 172.21.15.53:0/3151329271 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fca440c82a0 msgr2=0x7fca440c86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:04:50.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.620+0000 7fca42ffd640 1 --2- 172.21.15.53:0/3151329271 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fca440c82a0 0x7fca440c86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:50.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.620+0000 7fca42ffd640 1 -- 172.21.15.53:0/3151329271 >> v2:172.21.15.117:3300/0 conn(0x7fca440af760 msgr2=0x7fca440afbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:04:50.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.620+0000 7fca42ffd640 1 --2- 172.21.15.53:0/3151329271 >> v2:172.21.15.117:3300/0 conn(0x7fca440af760 0x7fca440afbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:50.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.620+0000 7fca42ffd640 1 -- 172.21.15.53:0/3151329271 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca44070d50 con 0x7fca440c9fa0 2023-06-10T19:04:50.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.620+0000 7fca42ffd640 1 -- 172.21.15.53:0/3151329271 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fca34001680 con 0x7fca440c9fa0 2023-06-10T19:04:50.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.620+0000 7fca42ffd640 1 -- 172.21.15.53:0/3151329271 >> v1:172.21.15.53:6789/0 conn(0x7fca440c9fa0 legacy=0x7fca4406bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:50.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.620+0000 7fca42ffd640 1 --2- 172.21.15.53:0/3151329271 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca30003980 0x7fca30003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:50.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.620+0000 7fca42ffd640 1 --2- 172.21.15.53:0/3151329271 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fca440c82a0 0x7fca300047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:50.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.620+0000 7fca42ffd640 1 --2- 172.21.15.53:0/3151329271 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca30004d10 0x7fca30005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:50.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.620+0000 7fca42ffd640 1 -- 172.21.15.53:0/3151329271 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca440b0120 con 0x7fca30004d10 2023-06-10T19:04:50.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.620+0000 7fca42ffd640 1 -- 172.21.15.53:0/3151329271 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca440ca370 con 0x7fca30003980 2023-06-10T19:04:50.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.620+0000 7fca42ffd640 1 -- 172.21.15.53:0/3151329271 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca3000b990 con 0x7fca440c82a0 2023-06-10T19:04:50.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.620+0000 7fca48c48640 1 --2- 172.21.15.53:0/3151329271 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca30004d10 0x7fca30005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:50.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.620+0000 7fca43fff640 1 --2- 172.21.15.53:0/3151329271 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca30003980 0x7fca30003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:50.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.620+0000 7fca48c48640 1 -- 172.21.15.53:0/3151329271 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fca440c82a0 msgr2=0x7fca300047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:04:50.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.620+0000 7fca48c48640 1 --2- 172.21.15.53:0/3151329271 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fca440c82a0 0x7fca300047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:50.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.620+0000 7fca48c48640 1 -- 172.21.15.53:0/3151329271 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca30003980 msgr2=0x7fca30003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:04:50.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.620+0000 7fca48c48640 1 --2- 172.21.15.53:0/3151329271 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca30003980 0x7fca30003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:50.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.620+0000 7fca48c48640 1 -- 172.21.15.53:0/3151329271 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca30003530 con 0x7fca30004d10 2023-06-10T19:04:50.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.620+0000 7fca48c48640 1 --2- 172.21.15.53:0/3151329271 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca30004d10 0x7fca30005180 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7fca3c009ae0 tx=0x7fca3c01ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83df3637d746655a server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:50.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.620+0000 7fca42ffd640 1 -- 172.21.15.53:0/3151329271 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3c0a5570 con 0x7fca30004d10 2023-06-10T19:04:50.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.620+0000 7fca42ffd640 1 -- 172.21.15.53:0/3151329271 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca3c0a56d0 con 0x7fca30004d10 2023-06-10T19:04:50.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.620+0000 7fca42ffd640 1 -- 172.21.15.53:0/3151329271 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3c0a5a80 con 0x7fca30004d10 2023-06-10T19:04:50.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.624+0000 7fca4a6ab640 1 -- 172.21.15.53:0/3151329271 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca30004d10 msgr2=0x7fca30005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:50.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.624+0000 7fca4a6ab640 1 --2- 172.21.15.53:0/3151329271 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca30004d10 0x7fca30005180 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7fca3c009ae0 tx=0x7fca3c01ca90 comp rx=0 tx=0).stop 2023-06-10T19:04:50.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.624+0000 7fca48c48640 1 -- 172.21.15.53:0/3151329271 reap_dead start 2023-06-10T19:04:50.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.624+0000 7fca4a6ab640 1 -- 172.21.15.53:0/3151329271 shutdown_connections 2023-06-10T19:04:50.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.624+0000 7fca4a6ab640 1 -- 172.21.15.53:0/3151329271 >> 172.21.15.53:0/3151329271 conn(0x7fca4406a0e0 msgr2=0x7fca440cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:04:50.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.624+0000 7fca4a6ab640 1 -- 172.21.15.53:0/3151329271 shutdown_connections 2023-06-10T19:04:50.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.624+0000 7fca4a6ab640 1 -- 172.21.15.53:0/3151329271 wait complete. 2023-06-10T19:04:50.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.624+0000 7fca4a6ab640 1 Processor -- start 2023-06-10T19:04:50.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.624+0000 7fca4a6ab640 1 -- start start 2023-06-10T19:04:50.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.624+0000 7fca4a6ab640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca440c7150 0x7fca441f2e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:50.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.624+0000 7fca4a6ab640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fca440a7450 0x7fca44158a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:50.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.624+0000 7fca4a6ab640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca440c7520 0x7fca44158f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:50.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.624+0000 7fca4a6ab640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca441f05f0 con 0x7fca440c7150 2023-06-10T19:04:50.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.624+0000 7fca4a6ab640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca440a8520 con 0x7fca440c7520 2023-06-10T19:04:50.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.624+0000 7fca4a6ab640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca441f0000 con 0x7fca440a7450 2023-06-10T19:04:50.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.624+0000 7fca43fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca440c7150 0x7fca441f2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:50.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.624+0000 7fca43fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca440c7150 0x7fca441f2e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53724/0 (socket says 172.21.15.53:53724) 2023-06-10T19:04:50.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.624+0000 7fca43fff640 1 -- 172.21.15.53:0/3485284899 learned_addr learned my addr 172.21.15.53:0/3485284899 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:04:50.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.624+0000 7fca48c48640 1 --2- 172.21.15.53:0/3485284899 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca440c7520 0x7fca44158f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:50.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.624+0000 7fca437fe640 1 --2- 172.21.15.53:0/3485284899 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fca440a7450 0x7fca44158a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:50.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.624+0000 7fca43fff640 1 -- 172.21.15.53:0/3485284899 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fca440a7450 msgr2=0x7fca44158a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:50.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.624+0000 7fca43fff640 1 --2- 172.21.15.53:0/3485284899 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fca440a7450 0x7fca44158a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:50.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.624+0000 7fca43fff640 1 -- 172.21.15.53:0/3485284899 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca440c7520 msgr2=0x7fca44158f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:50.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.624+0000 7fca43fff640 1 --2- 172.21.15.53:0/3485284899 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca440c7520 0x7fca44158f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:50.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.624+0000 7fca43fff640 1 -- 172.21.15.53:0/3485284899 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca441f3380 con 0x7fca440c7150 2023-06-10T19:04:50.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.624+0000 7fca437fe640 1 --2- 172.21.15.53:0/3485284899 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fca440a7450 0x7fca44158a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:04:50.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.624+0000 7fca43fff640 1 --2- 172.21.15.53:0/3485284899 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca440c7150 0x7fca441f2e40 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7fca34001210 tx=0x7fca34011e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:50.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.624+0000 7fca40ff9640 1 -- 172.21.15.53:0/3485284899 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3400fce0 con 0x7fca440c7150 2023-06-10T19:04:50.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.624+0000 7fca40ff9640 1 -- 172.21.15.53:0/3485284899 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca3400fe60 con 0x7fca440c7150 2023-06-10T19:04:50.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.624+0000 7fca4a6ab640 1 -- 172.21.15.53:0/3485284899 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca440a7f60 con 0x7fca440c7150 2023-06-10T19:04:50.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.624+0000 7fca40ff9640 1 -- 172.21.15.53:0/3485284899 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca34015650 con 0x7fca440c7150 2023-06-10T19:04:50.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.624+0000 7fca4a6ab640 1 -- 172.21.15.53:0/3485284899 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca441f0210 con 0x7fca440c7150 2023-06-10T19:04:50.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.628+0000 7fca4a6ab640 1 -- 172.21.15.53:0/3485284899 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca4404d790 con 0x7fca440c7150 2023-06-10T19:04:50.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.628+0000 7fca40ff9640 1 -- 172.21.15.53:0/3485284899 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fca340157b0 con 0x7fca440c7150 2023-06-10T19:04:50.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.628+0000 7fca40ff9640 1 --2- 172.21.15.53:0/3485284899 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fca24066280 0x7fca24068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:50.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.628+0000 7fca40ff9640 1 -- 172.21.15.53:0/3485284899 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6192+0+0 (secure 0 0 0) 0x7fca34087130 con 0x7fca440c7150 2023-06-10T19:04:50.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.628+0000 7fca437fe640 1 --2- 172.21.15.53:0/3485284899 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fca24066280 0x7fca24068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:50.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.628+0000 7fca437fe640 1 --2- 172.21.15.53:0/3485284899 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fca24066280 0x7fca24068730 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fca2c004b40 tx=0x7fca2c00d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:50.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.632+0000 7fca40ff9640 1 -- 172.21.15.53:0/3485284899 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fca340545c0 con 0x7fca440c7150 2023-06-10T19:04:50.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.780+0000 7fca4a6ab640 1 -- 172.21.15.53:0/3485284899 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fca440ce670 con 0x7fca440c7150 2023-06-10T19:04:50.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.780+0000 7fca40ff9640 1 -- 172.21.15.53:0/3485284899 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v113) v1 ==== 104+0+11 (secure 0 0 0) 0x7fca34057be0 con 0x7fca440c7150 2023-06-10T19:04:50.785 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-06-10T19:04:50.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.780+0000 7fca4a6ab640 1 -- 172.21.15.53:0/3485284899 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fca24066280 msgr2=0x7fca24068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:50.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.784+0000 7fca4a6ab640 1 --2- 172.21.15.53:0/3485284899 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fca24066280 0x7fca24068730 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fca2c004b40 tx=0x7fca2c00d040 comp rx=0 tx=0).stop 2023-06-10T19:04:50.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.784+0000 7fca4a6ab640 1 -- 172.21.15.53:0/3485284899 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca440c7150 msgr2=0x7fca441f2e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:50.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.784+0000 7fca4a6ab640 1 --2- 172.21.15.53:0/3485284899 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca440c7150 0x7fca441f2e40 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7fca34001210 tx=0x7fca34011e00 comp rx=0 tx=0).stop 2023-06-10T19:04:50.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.784+0000 7fca4a6ab640 1 -- 172.21.15.53:0/3485284899 shutdown_connections 2023-06-10T19:04:50.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.784+0000 7fca4a6ab640 1 --2- 172.21.15.53:0/3485284899 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fca24066280 0x7fca24068730 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:50.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.784+0000 7fca4a6ab640 1 --2- 172.21.15.53:0/3485284899 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca440c7520 0x7fca44158f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:50.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.784+0000 7fca4a6ab640 1 --2- 172.21.15.53:0/3485284899 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fca440a7450 0x7fca44158a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:50.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.784+0000 7fca4a6ab640 1 --2- 172.21.15.53:0/3485284899 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca440c7150 0x7fca441f2e40 unknown :-1 s=CLOSED pgs=1808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:50.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.784+0000 7fca4a6ab640 1 -- 172.21.15.53:0/3485284899 >> 172.21.15.53:0/3485284899 conn(0x7fca4406a0e0 msgr2=0x7fca440aeb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:04:50.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.784+0000 7fca4a6ab640 1 -- 172.21.15.53:0/3485284899 shutdown_connections 2023-06-10T19:04:50.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.784+0000 7fca4a6ab640 1 -- 172.21.15.53:0/3485284899 wait complete. 2023-06-10T19:04:50.803 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-10T19:04:50.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.932+0000 7f99f2e6c640 1 Processor -- start 2023-06-10T19:04:50.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.932+0000 7f99f2e6c640 1 -- start start 2023-06-10T19:04:50.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.936+0000 7f99f2e6c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99ec0c82a0 0x7f99ec0c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:50.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.936+0000 7f99f2e6c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f99ec0af760 0x7f99ec0afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:50.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.936+0000 7f99f2e6c640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99ec06b090 con 0x7f99ec0c9fa0 2023-06-10T19:04:50.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.936+0000 7f99f2e6c640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99ec0b0120 con 0x7f99ec0af760 2023-06-10T19:04:50.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.936+0000 7f99f2e6c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99ec0ca370 con 0x7f99ec0c82a0 2023-06-10T19:04:50.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.936+0000 7f99f0c08640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f99ec0c9fa0 0x7f99ec06bae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:51638/0 (socket says 172.21.15.53:51638) 2023-06-10T19:04:50.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.936+0000 7f99f0c08640 1 -- 172.21.15.53:0/545330033 learned_addr learned my addr 172.21.15.53:0/545330033 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:04:50.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.936+0000 7f99ebfff640 1 --2- 172.21.15.53:0/545330033 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99ec0c82a0 0x7f99ec0c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:50.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.936+0000 7f99eb7fe640 1 -- 172.21.15.53:0/545330033 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 794154102 0 0) 0x7f99ec06b090 con 0x7f99ec0c9fa0 2023-06-10T19:04:50.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.936+0000 7f99eb7fe640 1 -- 172.21.15.53:0/545330033 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99dc003530 con 0x7f99ec0c9fa0 2023-06-10T19:04:50.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.936+0000 7f99f1409640 1 --2- 172.21.15.53:0/545330033 >> v2:172.21.15.117:3300/0 conn(0x7f99ec0af760 0x7f99ec0afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:50.944 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.936+0000 7f99eb7fe640 1 -- 172.21.15.53:0/545330033 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2141791624 0 0) 0x7f99dc003530 con 0x7f99ec0c9fa0 2023-06-10T19:04:50.944 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.936+0000 7f99eb7fe640 1 -- 172.21.15.53:0/545330033 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99ec0c82a0 msgr2=0x7f99ec0c86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:04:50.944 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.936+0000 7f99eb7fe640 1 --2- 172.21.15.53:0/545330033 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99ec0c82a0 0x7f99ec0c86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:50.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.936+0000 7f99eb7fe640 1 -- 172.21.15.53:0/545330033 >> v2:172.21.15.117:3300/0 conn(0x7f99ec0af760 msgr2=0x7f99ec0afbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:04:50.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.936+0000 7f99eb7fe640 1 --2- 172.21.15.53:0/545330033 >> v2:172.21.15.117:3300/0 conn(0x7f99ec0af760 0x7f99ec0afbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:50.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.936+0000 7f99eb7fe640 1 -- 172.21.15.53:0/545330033 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99ec070d50 con 0x7f99ec0c9fa0 2023-06-10T19:04:50.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.936+0000 7f99eb7fe640 1 -- 172.21.15.53:0/545330033 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f99e0001680 con 0x7f99ec0c9fa0 2023-06-10T19:04:50.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.936+0000 7f99eb7fe640 1 -- 172.21.15.53:0/545330033 >> v1:172.21.15.53:6789/0 conn(0x7f99ec0c9fa0 legacy=0x7f99ec06bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:50.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.936+0000 7f99eb7fe640 1 --2- 172.21.15.53:0/545330033 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99dc003980 0x7f99dc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:50.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.936+0000 7f99eb7fe640 1 --2- 172.21.15.53:0/545330033 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99ec0c82a0 0x7f99dc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:50.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.936+0000 7f99eb7fe640 1 --2- 172.21.15.53:0/545330033 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99dc004d10 0x7f99dc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:50.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.936+0000 7f99eb7fe640 1 -- 172.21.15.53:0/545330033 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99ec0b0120 con 0x7f99dc003980 2023-06-10T19:04:50.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.936+0000 7f99eb7fe640 1 -- 172.21.15.53:0/545330033 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99ec0ca370 con 0x7f99dc004d10 2023-06-10T19:04:50.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.936+0000 7f99eb7fe640 1 -- 172.21.15.53:0/545330033 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99dc00b990 con 0x7f99ec0c82a0 2023-06-10T19:04:50.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.936+0000 7f99f0c08640 1 --2- 172.21.15.53:0/545330033 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99dc003980 0x7f99dc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:50.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.936+0000 7f99ebfff640 1 --2- 172.21.15.53:0/545330033 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99ec0c82a0 0x7f99dc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:50.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.936+0000 7f99f1409640 1 --2- 172.21.15.53:0/545330033 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99dc004d10 0x7f99dc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:50.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.936+0000 7f99f0c08640 1 -- 172.21.15.53:0/545330033 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99ec0c82a0 msgr2=0x7f99dc0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:04:50.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.936+0000 7f99f0c08640 1 --2- 172.21.15.53:0/545330033 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99ec0c82a0 0x7f99dc0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:50.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.936+0000 7f99f0c08640 1 -- 172.21.15.53:0/545330033 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99dc004d10 msgr2=0x7f99dc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:04:50.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.936+0000 7f99f0c08640 1 --2- 172.21.15.53:0/545330033 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99dc004d10 0x7f99dc005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:50.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.936+0000 7f99f0c08640 1 -- 172.21.15.53:0/545330033 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99dc003530 con 0x7f99dc003980 2023-06-10T19:04:50.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.936+0000 7f99f1409640 1 --2- 172.21.15.53:0/545330033 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99dc004d10 0x7f99dc005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:04:50.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.936+0000 7f99f0c08640 1 --2- 172.21.15.53:0/545330033 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99dc003980 0x7f99dc003d90 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7f99e000c240 tx=0x7f99e001cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25bd4438429f0a32 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:50.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.940+0000 7f99eb7fe640 1 -- 172.21.15.53:0/545330033 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e00a5910 con 0x7f99dc003980 2023-06-10T19:04:50.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.940+0000 7f99eb7fe640 1 -- 172.21.15.53:0/545330033 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99e00a5a70 con 0x7f99dc003980 2023-06-10T19:04:50.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.940+0000 7f99eb7fe640 1 -- 172.21.15.53:0/545330033 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e00a5e40 con 0x7f99dc003980 2023-06-10T19:04:50.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.940+0000 7f99f2e6c640 1 -- 172.21.15.53:0/545330033 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99dc003980 msgr2=0x7f99dc003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:50.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.940+0000 7f99f2e6c640 1 --2- 172.21.15.53:0/545330033 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99dc003980 0x7f99dc003d90 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7f99e000c240 tx=0x7f99e001cc30 comp rx=0 tx=0).stop 2023-06-10T19:04:50.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.940+0000 7f99f1409640 1 -- 172.21.15.53:0/545330033 reap_dead start 2023-06-10T19:04:50.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.940+0000 7f99f2e6c640 1 -- 172.21.15.53:0/545330033 shutdown_connections 2023-06-10T19:04:50.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.940+0000 7f99f2e6c640 1 -- 172.21.15.53:0/545330033 >> 172.21.15.53:0/545330033 conn(0x7f99ec06a0e0 msgr2=0x7f99ec0cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:04:50.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.940+0000 7f99f2e6c640 1 -- 172.21.15.53:0/545330033 shutdown_connections 2023-06-10T19:04:50.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.940+0000 7f99f2e6c640 1 -- 172.21.15.53:0/545330033 wait complete. 2023-06-10T19:04:50.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.940+0000 7f99f2e6c640 1 Processor -- start 2023-06-10T19:04:50.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.940+0000 7f99f2e6c640 1 -- start start 2023-06-10T19:04:50.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.940+0000 7f99f2e6c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99ec154200 0x7f99ec155db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:50.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.940+0000 7f99f2e6c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99ec0aec40 0x7f99ec0c5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:50.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.940+0000 7f99f2e6c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99ec0c6680 0x7f99ec0c6b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:50.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.940+0000 7f99f2e6c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99ec0c7060 con 0x7f99ec0c6680 2023-06-10T19:04:50.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.940+0000 7f99f2e6c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99ec0af490 con 0x7f99ec0aec40 2023-06-10T19:04:50.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.940+0000 7f99f2e6c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99ec0c5a40 con 0x7f99ec154200 2023-06-10T19:04:50.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.940+0000 7f99f1409640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99ec0c6680 0x7f99ec0c6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:50.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.940+0000 7f99f1409640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99ec0c6680 0x7f99ec0c6b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:53750/0 (socket says 172.21.15.53:53750) 2023-06-10T19:04:50.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.940+0000 7f99f1409640 1 -- 172.21.15.53:0/3241769356 learned_addr learned my addr 172.21.15.53:0/3241769356 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:04:50.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.940+0000 7f99ebfff640 1 --2- 172.21.15.53:0/3241769356 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99ec0aec40 0x7f99ec0c5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:50.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.940+0000 7f99f0c08640 1 --2- 172.21.15.53:0/3241769356 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99ec154200 0x7f99ec155db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:50.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.940+0000 7f99f1409640 1 -- 172.21.15.53:0/3241769356 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99ec154200 msgr2=0x7f99ec155db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:50.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.940+0000 7f99f1409640 1 --2- 172.21.15.53:0/3241769356 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99ec154200 0x7f99ec155db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:50.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.940+0000 7f99f1409640 1 -- 172.21.15.53:0/3241769356 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99ec0aec40 msgr2=0x7f99ec0c5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:50.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.940+0000 7f99f1409640 1 --2- 172.21.15.53:0/3241769356 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99ec0aec40 0x7f99ec0c5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:50.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.940+0000 7f99f1409640 1 -- 172.21.15.53:0/3241769356 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99ec0c4e30 con 0x7f99ec0c6680 2023-06-10T19:04:50.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.940+0000 7f99f1409640 1 --2- 172.21.15.53:0/3241769356 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99ec0c6680 0x7f99ec0c6b20 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7f99ec0cdc20 tx=0x7f99e400f0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:50.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.940+0000 7f99e97fa640 1 -- 172.21.15.53:0/3241769356 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e400f7b0 con 0x7f99ec0c6680 2023-06-10T19:04:50.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.940+0000 7f99e97fa640 1 -- 172.21.15.53:0/3241769356 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99e4011040 con 0x7f99ec0c6680 2023-06-10T19:04:50.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.940+0000 7f99f2e6c640 1 -- 172.21.15.53:0/3241769356 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99ec0c5110 con 0x7f99ec0c6680 2023-06-10T19:04:50.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.940+0000 7f99e97fa640 1 -- 172.21.15.53:0/3241769356 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e400fb30 con 0x7f99ec0c6680 2023-06-10T19:04:50.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.940+0000 7f99f2e6c640 1 -- 172.21.15.53:0/3241769356 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99ec0c56d0 con 0x7f99ec0c6680 2023-06-10T19:04:50.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.944+0000 7f99f2e6c640 1 -- 172.21.15.53:0/3241769356 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99ec0c5bb0 con 0x7f99ec0c6680 2023-06-10T19:04:50.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.944+0000 7f99e97fa640 1 -- 172.21.15.53:0/3241769356 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f99e400fc90 con 0x7f99ec0c6680 2023-06-10T19:04:50.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.944+0000 7f99e97fa640 1 --2- 172.21.15.53:0/3241769356 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f99d00662b0 0x7f99d0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:50.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.944+0000 7f99e97fa640 1 -- 172.21.15.53:0/3241769356 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6192+0+0 (secure 0 0 0) 0x7f99e4083870 con 0x7f99ec0c6680 2023-06-10T19:04:50.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.944+0000 7f99f0c08640 1 --2- 172.21.15.53:0/3241769356 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f99d00662b0 0x7f99d0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:50.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.944+0000 7f99f0c08640 1 --2- 172.21.15.53:0/3241769356 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f99d00662b0 0x7f99d0068760 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f99e00aa000 tx=0x7f99e0001a80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:50.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:50.948+0000 7f99e97fa640 1 -- 172.21.15.53:0/3241769356 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f99e4050bf0 con 0x7f99ec0c6680 2023-06-10T19:04:51.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.100+0000 7f99f2e6c640 1 -- 172.21.15.53:0/3241769356 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f99ec04d790 con 0x7f99ec0c6680 2023-06-10T19:04:51.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.100+0000 7f99e97fa640 1 -- 172.21.15.53:0/3241769356 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v113) v1 ==== 100+0+11 (secure 0 0 0) 0x7f99e4054210 con 0x7f99ec0c6680 2023-06-10T19:04:51.106 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-06-10T19:04:51.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.104+0000 7f99f2e6c640 1 -- 172.21.15.53:0/3241769356 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f99d00662b0 msgr2=0x7f99d0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:51.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.104+0000 7f99f2e6c640 1 --2- 172.21.15.53:0/3241769356 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f99d00662b0 0x7f99d0068760 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f99e00aa000 tx=0x7f99e0001a80 comp rx=0 tx=0).stop 2023-06-10T19:04:51.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.104+0000 7f99f2e6c640 1 -- 172.21.15.53:0/3241769356 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99ec0c6680 msgr2=0x7f99ec0c6b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:51.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.104+0000 7f99f2e6c640 1 --2- 172.21.15.53:0/3241769356 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99ec0c6680 0x7f99ec0c6b20 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7f99ec0cdc20 tx=0x7f99e400f0d0 comp rx=0 tx=0).stop 2023-06-10T19:04:51.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.104+0000 7f99f2e6c640 1 -- 172.21.15.53:0/3241769356 shutdown_connections 2023-06-10T19:04:51.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.104+0000 7f99f2e6c640 1 --2- 172.21.15.53:0/3241769356 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f99d00662b0 0x7f99d0068760 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:51.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.104+0000 7f99f2e6c640 1 --2- 172.21.15.53:0/3241769356 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99ec0c6680 0x7f99ec0c6b20 unknown :-1 s=CLOSED pgs=1811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:51.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.104+0000 7f99f2e6c640 1 --2- 172.21.15.53:0/3241769356 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99ec0aec40 0x7f99ec0c5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:51.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.104+0000 7f99f2e6c640 1 --2- 172.21.15.53:0/3241769356 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99ec154200 0x7f99ec155db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:51.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.104+0000 7f99f2e6c640 1 -- 172.21.15.53:0/3241769356 >> 172.21.15.53:0/3241769356 conn(0x7f99ec06a0e0 msgr2=0x7f99ec0b1380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:04:51.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.104+0000 7f99f2e6c640 1 -- 172.21.15.53:0/3241769356 shutdown_connections 2023-06-10T19:04:51.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.104+0000 7f99f2e6c640 1 -- 172.21.15.53:0/3241769356 wait complete. 2023-06-10T19:04:51.126 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:04:51.247 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.240+0000 7f6be2dc1640 1 Processor -- start 2023-06-10T19:04:51.247 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.244+0000 7f6be2dc1640 1 -- start start 2023-06-10T19:04:51.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.244+0000 7f6be2dc1640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6bdc0b3ac0 0x7f6bdc0b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:51.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.244+0000 7f6be2dc1640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6bdc0cc690 0x7f6bdc15f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:51.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.244+0000 7f6be2dc1640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bdc0d0020 con 0x7f6bdc0ccae0 2023-06-10T19:04:51.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.244+0000 7f6be2dc1640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bdc0b43d0 con 0x7f6bdc0cc690 2023-06-10T19:04:51.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.244+0000 7f6be2dc1640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bdc0cef40 con 0x7f6bdc0b3ac0 2023-06-10T19:04:51.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.244+0000 7f6bdbfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6bdc0cc690 0x7f6bdc15f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:51.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.244+0000 7f6bdbfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6bdc0cc690 0x7f6bdc15f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37648/0 (socket says 172.21.15.53:37648) 2023-06-10T19:04:51.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.244+0000 7f6bdbfff640 1 -- 172.21.15.53:0/2317329120 learned_addr learned my addr 172.21.15.53:0/2317329120 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:04:51.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.244+0000 7f6be0b5d640 1 --2- 172.21.15.53:0/2317329120 >> v2:172.21.15.117:3300/0 conn(0x7f6bdc0b3ac0 0x7f6bdc0b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:51.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.244+0000 7f6bdbfff640 1 -- 172.21.15.53:0/2317329120 >> v2:172.21.15.117:3300/0 conn(0x7f6bdc0b3ac0 msgr2=0x7f6bdc0b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:04:51.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.244+0000 7f6bdbfff640 1 --2- 172.21.15.53:0/2317329120 >> v2:172.21.15.117:3300/0 conn(0x7f6bdc0b3ac0 0x7f6bdc0b3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:51.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.244+0000 7f6bdbfff640 1 -- 172.21.15.53:0/2317329120 >> v1:172.21.15.117:6789/0 conn(0x7f6bdc0ccae0 legacy=0x7f6bdc15f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:04:51.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.244+0000 7f6bdbfff640 1 -- 172.21.15.53:0/2317329120 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bdc0cf220 con 0x7f6bdc0cc690 2023-06-10T19:04:51.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.248+0000 7f6bdbfff640 1 --2- 172.21.15.53:0/2317329120 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6bdc0cc690 0x7f6bdc15f370 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc0b4ba0 tx=0x7f6bc801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3107d16bac6d412a server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:51.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.248+0000 7f6bdb7fe640 1 -- 172.21.15.53:0/2317329120 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc80aa5f0 con 0x7f6bdc0cc690 2023-06-10T19:04:51.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.248+0000 7f6bdb7fe640 1 -- 172.21.15.53:0/2317329120 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bc80aa750 con 0x7f6bdc0cc690 2023-06-10T19:04:51.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.248+0000 7f6bdb7fe640 1 -- 172.21.15.53:0/2317329120 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc80aaae0 con 0x7f6bdc0cc690 2023-06-10T19:04:51.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.248+0000 7f6be2dc1640 1 -- 172.21.15.53:0/2317329120 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6bdc0cc690 msgr2=0x7f6bdc15f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:51.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.248+0000 7f6be2dc1640 1 --2- 172.21.15.53:0/2317329120 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6bdc0cc690 0x7f6bdc15f370 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc0b4ba0 tx=0x7f6bc801c490 comp rx=0 tx=0).stop 2023-06-10T19:04:51.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.248+0000 7f6be2dc1640 1 -- 172.21.15.53:0/2317329120 shutdown_connections 2023-06-10T19:04:51.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.248+0000 7f6be2dc1640 1 --2- 172.21.15.53:0/2317329120 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6bdc0cc690 0x7f6bdc15f370 unknown :-1 s=CLOSED pgs=1812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:51.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.248+0000 7f6be2dc1640 1 --2- 172.21.15.53:0/2317329120 >> v2:172.21.15.117:3300/0 conn(0x7f6bdc0b3ac0 0x7f6bdc0b3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:51.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.248+0000 7f6be2dc1640 1 -- 172.21.15.53:0/2317329120 >> 172.21.15.53:0/2317329120 conn(0x7f6bdc071790 msgr2=0x7f6bdc069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:04:51.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.248+0000 7f6be2dc1640 1 -- 172.21.15.53:0/2317329120 shutdown_connections 2023-06-10T19:04:51.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.248+0000 7f6be2dc1640 1 -- 172.21.15.53:0/2317329120 wait complete. 2023-06-10T19:04:51.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.248+0000 7f6be2dc1640 1 Processor -- start 2023-06-10T19:04:51.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.248+0000 7f6be2dc1640 1 -- start start 2023-06-10T19:04:51.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.248+0000 7f6be2dc1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6bdc0b3ac0 0x7f6bdc0b16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:51.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.248+0000 7f6be2dc1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6bdc0cc690 0x7f6bdc14c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:51.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.248+0000 7f6be2dc1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6bdc0ccae0 0x7f6bdc15a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:51.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.248+0000 7f6be2dc1640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bdc14c560 con 0x7f6bdc0b3ac0 2023-06-10T19:04:51.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.248+0000 7f6be2dc1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bdc1530c0 con 0x7f6bdc0cc690 2023-06-10T19:04:51.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.248+0000 7f6be2dc1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bdc1590f0 con 0x7f6bdc0ccae0 2023-06-10T19:04:51.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.248+0000 7f6be0b5d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6bdc0b3ac0 0x7f6bdc0b16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:51.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.248+0000 7f6be0b5d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6bdc0b3ac0 0x7f6bdc0b16e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37656/0 (socket says 172.21.15.53:37656) 2023-06-10T19:04:51.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.248+0000 7f6be0b5d640 1 -- 172.21.15.53:0/2228818043 learned_addr learned my addr 172.21.15.53:0/2228818043 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:04:51.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.248+0000 7f6be135e640 1 --2- 172.21.15.53:0/2228818043 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6bdc0ccae0 0x7f6bdc15a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:51.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.248+0000 7f6bdbfff640 1 --2- 172.21.15.53:0/2228818043 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6bdc0cc690 0x7f6bdc14c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:51.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.248+0000 7f6be0b5d640 1 -- 172.21.15.53:0/2228818043 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6bdc0ccae0 msgr2=0x7f6bdc15a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:51.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.248+0000 7f6be0b5d640 1 --2- 172.21.15.53:0/2228818043 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6bdc0ccae0 0x7f6bdc15a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:51.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.248+0000 7f6be0b5d640 1 -- 172.21.15.53:0/2228818043 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6bdc0cc690 msgr2=0x7f6bdc14c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:51.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.248+0000 7f6be0b5d640 1 --2- 172.21.15.53:0/2228818043 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6bdc0cc690 0x7f6bdc14c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:51.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.248+0000 7f6be0b5d640 1 -- 172.21.15.53:0/2228818043 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc80094d0 con 0x7f6bdc0b3ac0 2023-06-10T19:04:51.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.248+0000 7f6be0b5d640 1 --2- 172.21.15.53:0/2228818043 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6bdc0b3ac0 0x7f6bdc0b16e0 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7f6bd000d620 tx=0x7f6bd000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:51.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.252+0000 7f6bd97fa640 1 -- 172.21.15.53:0/2228818043 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd000b620 con 0x7f6bdc0b3ac0 2023-06-10T19:04:51.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.252+0000 7f6bd97fa640 1 -- 172.21.15.53:0/2228818043 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bd000b780 con 0x7f6bdc0b3ac0 2023-06-10T19:04:51.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.252+0000 7f6be2dc1640 1 -- 172.21.15.53:0/2228818043 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bdc0c7890 con 0x7f6bdc0b3ac0 2023-06-10T19:04:51.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.252+0000 7f6bd97fa640 1 -- 172.21.15.53:0/2228818043 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd000bb30 con 0x7f6bdc0b3ac0 2023-06-10T19:04:51.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.252+0000 7f6be2dc1640 1 -- 172.21.15.53:0/2228818043 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bdc0c7e50 con 0x7f6bdc0b3ac0 2023-06-10T19:04:51.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.252+0000 7f6be2dc1640 1 -- 172.21.15.53:0/2228818043 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bdc0c8040 con 0x7f6bdc0b3ac0 2023-06-10T19:04:51.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.252+0000 7f6bd97fa640 1 -- 172.21.15.53:0/2228818043 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6bd000bc90 con 0x7f6bdc0b3ac0 2023-06-10T19:04:51.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.252+0000 7f6bd97fa640 1 --2- 172.21.15.53:0/2228818043 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6bc0066280 0x7f6bc0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:51.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.252+0000 7f6bd97fa640 1 -- 172.21.15.53:0/2228818043 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6192+0+0 (secure 0 0 0) 0x7f6bd0084330 con 0x7f6bdc0b3ac0 2023-06-10T19:04:51.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.252+0000 7f6bdbfff640 1 --2- 172.21.15.53:0/2228818043 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6bc0066280 0x7f6bc0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:51.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.252+0000 7f6bdbfff640 1 --2- 172.21.15.53:0/2228818043 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6bc0066280 0x7f6bc0068730 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f6bc80ae000 tx=0x7f6bc80a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:51.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.256+0000 7f6bd97fa640 1 -- 172.21.15.53:0/2228818043 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6bd00516a0 con 0x7f6bdc0b3ac0 2023-06-10T19:04:51.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.444+0000 7f6be2dc1640 1 -- 172.21.15.53:0/2228818043 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6bdc04d790 con 0x7f6bdc0b3ac0 2023-06-10T19:04:51.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.444+0000 7f6bd97fa640 1 -- 172.21.15.53:0/2228818043 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4672 (secure 0 0 0) 0x7f6bd0007380 con 0x7f6bdc0b3ac0 2023-06-10T19:04:51.451 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:04:51.451 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":63,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6542,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/3258793373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3258793373},{"type":"v1","addr":"172.21.15.117:6836","nonce":3258793373}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":7363,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/585135979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":585135979},{"type":"v1","addr":"172.21.15.117:6837","nonce":585135979}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":8682,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/448704478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":448704478},{"type":"v1","addr":"172.21.15.53:6833","nonce":448704478}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:03:48.420425+0000","modified":"2023-06-10T19:04:06.109236+0000","tableserver":0,"root":0,"session_timeout":30,"session_autoclose":50,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8685},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8685":{"gid":8685,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/1149668719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":1149668719},{"type":"v1","addr":"172.21.15.53:6835","nonce":1149668719}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-06-10T19:04:51.452 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 63 2023-06-10T19:04:51.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.448+0000 7f6be2dc1640 1 -- 172.21.15.53:0/2228818043 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6bc0066280 msgr2=0x7f6bc0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:51.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.448+0000 7f6be2dc1640 1 --2- 172.21.15.53:0/2228818043 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6bc0066280 0x7f6bc0068730 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f6bc80ae000 tx=0x7f6bc80a7000 comp rx=0 tx=0).stop 2023-06-10T19:04:51.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.448+0000 7f6be2dc1640 1 -- 172.21.15.53:0/2228818043 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6bdc0b3ac0 msgr2=0x7f6bdc0b16e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:51.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.448+0000 7f6be2dc1640 1 --2- 172.21.15.53:0/2228818043 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6bdc0b3ac0 0x7f6bdc0b16e0 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7f6bd000d620 tx=0x7f6bd000dae0 comp rx=0 tx=0).stop 2023-06-10T19:04:51.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.448+0000 7f6be2dc1640 1 -- 172.21.15.53:0/2228818043 shutdown_connections 2023-06-10T19:04:51.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.448+0000 7f6be2dc1640 1 --2- 172.21.15.53:0/2228818043 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6bc0066280 0x7f6bc0068730 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:51.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.448+0000 7f6be2dc1640 1 --2- 172.21.15.53:0/2228818043 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6bdc0ccae0 0x7f6bdc15a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:51.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.448+0000 7f6be2dc1640 1 --2- 172.21.15.53:0/2228818043 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6bdc0cc690 0x7f6bdc14c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:51.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.448+0000 7f6be2dc1640 1 --2- 172.21.15.53:0/2228818043 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6bdc0b3ac0 0x7f6bdc0b16e0 unknown :-1 s=CLOSED pgs=1813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:51.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.448+0000 7f6be2dc1640 1 -- 172.21.15.53:0/2228818043 >> 172.21.15.53:0/2228818043 conn(0x7f6bdc071790 msgr2=0x7f6bdc0b6330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:04:51.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.448+0000 7f6be2dc1640 1 -- 172.21.15.53:0/2228818043 shutdown_connections 2023-06-10T19:04:51.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.448+0000 7f6be2dc1640 1 -- 172.21.15.53:0/2228818043 wait complete. 2023-06-10T19:04:51.470 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:04:51.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.584+0000 7fd4e5c57640 1 Processor -- start 2023-06-10T19:04:51.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.584+0000 7fd4e5c57640 1 -- start start 2023-06-10T19:04:51.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.584+0000 7fd4e5c57640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd4e00b3ac0 0x7fd4e00b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:51.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.584+0000 7fd4e5c57640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4e00cc690 0x7fd4e015f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:51.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.584+0000 7fd4e5c57640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4e00d0020 con 0x7fd4e00ccae0 2023-06-10T19:04:51.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.584+0000 7fd4e5c57640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4e00b43d0 con 0x7fd4e00b3ac0 2023-06-10T19:04:51.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.584+0000 7fd4e5c57640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e00cef40 con 0x7fd4e00cc690 2023-06-10T19:04:51.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.584+0000 7fd4deffd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4e00cc690 0x7fd4e015f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:51.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.584+0000 7fd4deffd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4e00cc690 0x7fd4e015f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.53:57418/0 (socket says 172.21.15.53:57418) 2023-06-10T19:04:51.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.584+0000 7fd4deffd640 1 -- 172.21.15.53:0/2480703031 learned_addr learned my addr 172.21.15.53:0/2480703031 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:04:51.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.584+0000 7fd4dffff640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fd4e00ccae0 0x7fd4e015f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.53:46460/0 (socket says 172.21.15.53:46460) 2023-06-10T19:04:51.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.584+0000 7fd4df7fe640 1 --2- 172.21.15.53:0/2480703031 >> v2:172.21.15.117:3300/0 conn(0x7fd4e00b3ac0 0x7fd4e00b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:51.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.584+0000 7fd4deffd640 1 -- 172.21.15.53:0/2480703031 >> v2:172.21.15.117:3300/0 conn(0x7fd4e00b3ac0 msgr2=0x7fd4e00b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:04:51.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.584+0000 7fd4deffd640 1 --2- 172.21.15.53:0/2480703031 >> v2:172.21.15.117:3300/0 conn(0x7fd4e00b3ac0 0x7fd4e00b3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:51.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.584+0000 7fd4de7fc640 1 -- 172.21.15.53:0/2480703031 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3005754027 0 0) 0x7fd4e00d0020 con 0x7fd4e00ccae0 2023-06-10T19:04:51.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.584+0000 7fd4deffd640 1 -- 172.21.15.53:0/2480703031 >> v1:172.21.15.117:6789/0 conn(0x7fd4e00ccae0 legacy=0x7fd4e015f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:51.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.584+0000 7fd4deffd640 1 -- 172.21.15.53:0/2480703031 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4e00cf220 con 0x7fd4e00cc690 2023-06-10T19:04:51.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.588+0000 7fd4deffd640 1 --2- 172.21.15.53:0/2480703031 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4e00cc690 0x7fd4e015f370 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd4d4009870 tx=0x7fd4d401c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27c1b0bb9b6f806 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:51.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.588+0000 7fd4de7fc640 1 -- 172.21.15.53:0/2480703031 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d40aa670 con 0x7fd4e00cc690 2023-06-10T19:04:51.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.588+0000 7fd4de7fc640 1 -- 172.21.15.53:0/2480703031 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4d40aa7d0 con 0x7fd4e00cc690 2023-06-10T19:04:51.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.588+0000 7fd4de7fc640 1 -- 172.21.15.53:0/2480703031 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d40aab60 con 0x7fd4e00cc690 2023-06-10T19:04:51.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.588+0000 7fd4e5c57640 1 -- 172.21.15.53:0/2480703031 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4e00cc690 msgr2=0x7fd4e015f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:51.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.588+0000 7fd4e5c57640 1 --2- 172.21.15.53:0/2480703031 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4e00cc690 0x7fd4e015f370 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd4d4009870 tx=0x7fd4d401c510 comp rx=0 tx=0).stop 2023-06-10T19:04:51.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.588+0000 7fd4e5c57640 1 -- 172.21.15.53:0/2480703031 shutdown_connections 2023-06-10T19:04:51.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.588+0000 7fd4e5c57640 1 --2- 172.21.15.53:0/2480703031 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4e00cc690 0x7fd4e015f370 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:51.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.588+0000 7fd4e5c57640 1 --2- 172.21.15.53:0/2480703031 >> v2:172.21.15.117:3300/0 conn(0x7fd4e00b3ac0 0x7fd4e00b3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:51.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.588+0000 7fd4e5c57640 1 -- 172.21.15.53:0/2480703031 >> 172.21.15.53:0/2480703031 conn(0x7fd4e0071790 msgr2=0x7fd4e0069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:04:51.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.588+0000 7fd4e5c57640 1 -- 172.21.15.53:0/2480703031 shutdown_connections 2023-06-10T19:04:51.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.588+0000 7fd4e5c57640 1 -- 172.21.15.53:0/2480703031 wait complete. 2023-06-10T19:04:51.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.588+0000 7fd4e5c57640 1 Processor -- start 2023-06-10T19:04:51.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.588+0000 7fd4e5c57640 1 -- start start 2023-06-10T19:04:51.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.588+0000 7fd4e5c57640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4e00b3ac0 0x7fd4e00c58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:51.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.588+0000 7fd4e5c57640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4e00cc690 0x7fd4e0155140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:51.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.588+0000 7fd4e5c57640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4e00ccae0 0x7fd4e0155680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:51.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.588+0000 7fd4e5c57640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e015cc20 con 0x7fd4e00cc690 2023-06-10T19:04:51.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.588+0000 7fd4e5c57640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e00c80c0 con 0x7fd4e00ccae0 2023-06-10T19:04:51.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.588+0000 7fd4e5c57640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e00b6ec0 con 0x7fd4e00b3ac0 2023-06-10T19:04:51.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.588+0000 7fd4deffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4e00cc690 0x7fd4e0155140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:51.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.588+0000 7fd4deffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4e00cc690 0x7fd4e0155140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37666/0 (socket says 172.21.15.53:37666) 2023-06-10T19:04:51.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.588+0000 7fd4deffd640 1 -- 172.21.15.53:0/1449273724 learned_addr learned my addr 172.21.15.53:0/1449273724 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:04:51.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.588+0000 7fd4df7fe640 1 --2- 172.21.15.53:0/1449273724 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4e00b3ac0 0x7fd4e00c58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:51.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.588+0000 7fd4dffff640 1 --2- 172.21.15.53:0/1449273724 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4e00ccae0 0x7fd4e0155680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:51.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.588+0000 7fd4deffd640 1 -- 172.21.15.53:0/1449273724 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4e00b3ac0 msgr2=0x7fd4e00c58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:51.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.588+0000 7fd4deffd640 1 --2- 172.21.15.53:0/1449273724 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4e00b3ac0 0x7fd4e00c58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:51.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.588+0000 7fd4deffd640 1 -- 172.21.15.53:0/1449273724 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4e00ccae0 msgr2=0x7fd4e0155680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:51.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.588+0000 7fd4deffd640 1 --2- 172.21.15.53:0/1449273724 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4e00ccae0 0x7fd4e0155680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:51.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.588+0000 7fd4deffd640 1 -- 172.21.15.53:0/1449273724 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4d40094d0 con 0x7fd4e00cc690 2023-06-10T19:04:51.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.592+0000 7fd4deffd640 1 --2- 172.21.15.53:0/1449273724 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4e00cc690 0x7fd4e0155140 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7fd4d40ac040 tx=0x7fd4d401ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:51.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.592+0000 7fd4c7fff640 1 -- 172.21.15.53:0/1449273724 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d40aad50 con 0x7fd4e00cc690 2023-06-10T19:04:51.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.592+0000 7fd4c7fff640 1 -- 172.21.15.53:0/1449273724 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4d40b7070 con 0x7fd4e00cc690 2023-06-10T19:04:51.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.592+0000 7fd4e5c57640 1 -- 172.21.15.53:0/1449273724 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4e00c5fa0 con 0x7fd4e00cc690 2023-06-10T19:04:51.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.592+0000 7fd4c7fff640 1 -- 172.21.15.53:0/1449273724 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d4004220 con 0x7fd4e00cc690 2023-06-10T19:04:51.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.592+0000 7fd4e5c57640 1 -- 172.21.15.53:0/1449273724 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4e00c6560 con 0x7fd4e00cc690 2023-06-10T19:04:51.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.592+0000 7fd4e5c57640 1 -- 172.21.15.53:0/1449273724 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4e015c980 con 0x7fd4e00cc690 2023-06-10T19:04:51.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.592+0000 7fd4c7fff640 1 -- 172.21.15.53:0/1449273724 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd4d4004380 con 0x7fd4e00cc690 2023-06-10T19:04:51.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.592+0000 7fd4c7fff640 1 --2- 172.21.15.53:0/1449273724 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd4cc066280 0x7fd4cc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:51.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.592+0000 7fd4c7fff640 1 -- 172.21.15.53:0/1449273724 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6192+0+0 (secure 0 0 0) 0x7fd4d411e1f0 con 0x7fd4e00cc690 2023-06-10T19:04:51.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.592+0000 7fd4df7fe640 1 --2- 172.21.15.53:0/1449273724 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd4cc066280 0x7fd4cc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:51.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.592+0000 7fd4df7fe640 1 --2- 172.21.15.53:0/1449273724 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd4cc066280 0x7fd4cc068730 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fd4d0009b60 tx=0x7fd4d0009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:51.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.596+0000 7fd4c7fff640 1 -- 172.21.15.53:0/1449273724 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd4e015c980 con 0x7fd4e00cc690 2023-06-10T19:04:51.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.744+0000 7fd4e5c57640 1 -- 172.21.15.53:0/1449273724 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd4e015c980 con 0x7fd4e00cc690 2023-06-10T19:04:51.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.748+0000 7fd4c7fff640 1 -- 172.21.15.53:0/1449273724 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) v1 ==== 74+0+18486 (secure 0 0 0) 0x7fd4e015c980 con 0x7fd4e00cc690 2023-06-10T19:04:51.752 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:04:51.752 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":113,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:04:44.261377+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-06-10T19:03:46.427131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-06-10T19:03:47.398979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.d","mappings":[{"from":6,"to":7}]},{"pgid":"16.13","mappings":[{"from":1,"to":4}]},{"pgid":"16.1e","mappings":[{"from":5,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.0.1:0/3878814772":"2023-06-10T20:04:43.440652+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:04:51.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.748+0000 7fd4e5c57640 1 -- 172.21.15.53:0/1449273724 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd4cc066280 msgr2=0x7fd4cc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:51.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.748+0000 7fd4e5c57640 1 --2- 172.21.15.53:0/1449273724 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd4cc066280 0x7fd4cc068730 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fd4d0009b60 tx=0x7fd4d0009190 comp rx=0 tx=0).stop 2023-06-10T19:04:51.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.748+0000 7fd4e5c57640 1 -- 172.21.15.53:0/1449273724 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4e00cc690 msgr2=0x7fd4e0155140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:51.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.748+0000 7fd4e5c57640 1 --2- 172.21.15.53:0/1449273724 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4e00cc690 0x7fd4e0155140 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7fd4d40ac040 tx=0x7fd4d401ad50 comp rx=0 tx=0).stop 2023-06-10T19:04:51.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.748+0000 7fd4e5c57640 1 -- 172.21.15.53:0/1449273724 shutdown_connections 2023-06-10T19:04:51.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.748+0000 7fd4e5c57640 1 --2- 172.21.15.53:0/1449273724 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd4cc066280 0x7fd4cc068730 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:51.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.748+0000 7fd4e5c57640 1 --2- 172.21.15.53:0/1449273724 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4e00ccae0 0x7fd4e0155680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:51.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.748+0000 7fd4e5c57640 1 --2- 172.21.15.53:0/1449273724 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4e00cc690 0x7fd4e0155140 unknown :-1 s=CLOSED pgs=1814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:51.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.748+0000 7fd4e5c57640 1 --2- 172.21.15.53:0/1449273724 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4e00b3ac0 0x7fd4e00c58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:51.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.748+0000 7fd4e5c57640 1 -- 172.21.15.53:0/1449273724 >> 172.21.15.53:0/1449273724 conn(0x7fd4e0071790 msgr2=0x7fd4e00d1fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:04:51.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.748+0000 7fd4e5c57640 1 -- 172.21.15.53:0/1449273724 shutdown_connections 2023-06-10T19:04:51.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.748+0000 7fd4e5c57640 1 -- 172.21.15.53:0/1449273724 wait complete. 2023-06-10T19:04:51.769 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-06-10T19:04:51.770 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:04:51.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.888+0000 7fe292624640 1 Processor -- start 2023-06-10T19:04:51.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.888+0000 7fe292624640 1 -- start start 2023-06-10T19:04:51.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.888+0000 7fe292624640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe28c0c9840 0x7fe28c0c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:51.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.888+0000 7fe292624640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe28c06b090 0x7fe28c06b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:51.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.888+0000 7fe292624640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe28c159b50 con 0x7fe28c071060 2023-06-10T19:04:51.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.888+0000 7fe292624640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe28c0ca150 con 0x7fe28c0c9840 2023-06-10T19:04:51.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.888+0000 7fe292624640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe28c0702a0 con 0x7fe28c06b090 2023-06-10T19:04:51.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.888+0000 7fe28bfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe28c0c9840 0x7fe28c0c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:51.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.888+0000 7fe28bfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe28c0c9840 0x7fe28c0c9c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37678/0 (socket says 172.21.15.53:37678) 2023-06-10T19:04:51.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.888+0000 7fe28bfff640 1 -- 172.21.15.53:0/275388540 learned_addr learned my addr 172.21.15.53:0/275388540 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:04:51.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.888+0000 7fe290bc1640 1 --2- 172.21.15.53:0/275388540 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe28c06b090 0x7fe28c06b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:51.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.888+0000 7fe28bfff640 1 -- 172.21.15.53:0/275388540 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe28c06b090 msgr2=0x7fe28c06b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:04:51.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.888+0000 7fe28bfff640 1 --2- 172.21.15.53:0/275388540 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe28c06b090 0x7fe28c06b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:51.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.888+0000 7fe28bfff640 1 -- 172.21.15.53:0/275388540 >> v1:172.21.15.117:6789/0 conn(0x7fe28c071060 legacy=0x7fe28c0af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:04:51.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.888+0000 7fe28bfff640 1 -- 172.21.15.53:0/275388540 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe28c070580 con 0x7fe28c0c9840 2023-06-10T19:04:51.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.892+0000 7fe28bfff640 1 --2- 172.21.15.53:0/275388540 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe28c0c9840 0x7fe28c0c9c10 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7fe27c009870 tx=0x7fe27c01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c14a6a66f412726 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:51.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.892+0000 7fe28affd640 1 -- 172.21.15.53:0/275388540 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27c0aa670 con 0x7fe28c0c9840 2023-06-10T19:04:51.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.892+0000 7fe28affd640 1 -- 172.21.15.53:0/275388540 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe27c0aa7d0 con 0x7fe28c0c9840 2023-06-10T19:04:51.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.892+0000 7fe28affd640 1 -- 172.21.15.53:0/275388540 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27c0aab60 con 0x7fe28c0c9840 2023-06-10T19:04:51.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.892+0000 7fe292624640 1 -- 172.21.15.53:0/275388540 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe28c0c9840 msgr2=0x7fe28c0c9c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:51.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.892+0000 7fe292624640 1 --2- 172.21.15.53:0/275388540 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe28c0c9840 0x7fe28c0c9c10 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7fe27c009870 tx=0x7fe27c01c510 comp rx=0 tx=0).stop 2023-06-10T19:04:51.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.892+0000 7fe292624640 1 -- 172.21.15.53:0/275388540 shutdown_connections 2023-06-10T19:04:51.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.892+0000 7fe292624640 1 --2- 172.21.15.53:0/275388540 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe28c06b090 0x7fe28c06b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:51.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.892+0000 7fe292624640 1 --2- 172.21.15.53:0/275388540 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe28c0c9840 0x7fe28c0c9c10 unknown :-1 s=CLOSED pgs=1815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:51.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.892+0000 7fe292624640 1 -- 172.21.15.53:0/275388540 >> 172.21.15.53:0/275388540 conn(0x7fe28c06a0d0 msgr2=0x7fe28c0ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:04:51.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.892+0000 7fe292624640 1 -- 172.21.15.53:0/275388540 shutdown_connections 2023-06-10T19:04:51.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.892+0000 7fe292624640 1 -- 172.21.15.53:0/275388540 wait complete. 2023-06-10T19:04:51.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.892+0000 7fe292624640 1 Processor -- start 2023-06-10T19:04:51.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.892+0000 7fe292624640 1 -- start start 2023-06-10T19:04:51.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.892+0000 7fe292624640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe28c06b090 0x7fe28c1542a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:51.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.892+0000 7fe292624640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe28c071060 0x7fe28c1547e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:51.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.892+0000 7fe292624640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe28c0c9840 0x7fe28c153110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:51.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.892+0000 7fe292624640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe28c15cd30 con 0x7fe28c071060 2023-06-10T19:04:51.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.892+0000 7fe292624640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe28c15c0b0 con 0x7fe28c0c9840 2023-06-10T19:04:51.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.892+0000 7fe292624640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe28c15c390 con 0x7fe28c06b090 2023-06-10T19:04:51.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.892+0000 7fe28b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe28c071060 0x7fe28c1547e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:51.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.892+0000 7fe28b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe28c071060 0x7fe28c1547e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37692/0 (socket says 172.21.15.53:37692) 2023-06-10T19:04:51.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.892+0000 7fe28b7fe640 1 -- 172.21.15.53:0/3746922124 learned_addr learned my addr 172.21.15.53:0/3746922124 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:04:51.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.896+0000 7fe28bfff640 1 --2- 172.21.15.53:0/3746922124 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe28c06b090 0x7fe28c1542a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:51.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.896+0000 7fe290bc1640 1 --2- 172.21.15.53:0/3746922124 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe28c0c9840 0x7fe28c153110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:51.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.896+0000 7fe28b7fe640 1 -- 172.21.15.53:0/3746922124 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe28c06b090 msgr2=0x7fe28c1542a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:51.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.896+0000 7fe28b7fe640 1 --2- 172.21.15.53:0/3746922124 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe28c06b090 0x7fe28c1542a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:51.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.896+0000 7fe28b7fe640 1 -- 172.21.15.53:0/3746922124 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe28c0c9840 msgr2=0x7fe28c153110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:51.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.896+0000 7fe28b7fe640 1 --2- 172.21.15.53:0/3746922124 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe28c0c9840 0x7fe28c153110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:51.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.896+0000 7fe28b7fe640 1 -- 172.21.15.53:0/3746922124 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe27c0094d0 con 0x7fe28c071060 2023-06-10T19:04:51.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.896+0000 7fe290bc1640 1 --2- 172.21.15.53:0/3746922124 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe28c0c9840 0x7fe28c153110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:04:51.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.896+0000 7fe28b7fe640 1 --2- 172.21.15.53:0/3746922124 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe28c071060 0x7fe28c1547e0 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7fe28000c7c0 tx=0x7fe28000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:51.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.896+0000 7fe288ff9640 1 -- 172.21.15.53:0/3746922124 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe280003b80 con 0x7fe28c071060 2023-06-10T19:04:51.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.896+0000 7fe288ff9640 1 -- 172.21.15.53:0/3746922124 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe280003ce0 con 0x7fe28c071060 2023-06-10T19:04:51.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.896+0000 7fe292624640 1 -- 172.21.15.53:0/3746922124 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe28c15c670 con 0x7fe28c071060 2023-06-10T19:04:51.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.896+0000 7fe288ff9640 1 -- 172.21.15.53:0/3746922124 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe28000aa90 con 0x7fe28c071060 2023-06-10T19:04:51.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.896+0000 7fe292624640 1 -- 172.21.15.53:0/3746922124 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe28c14e700 con 0x7fe28c071060 2023-06-10T19:04:51.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.896+0000 7fe292624640 1 -- 172.21.15.53:0/3746922124 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe28c04d790 con 0x7fe28c071060 2023-06-10T19:04:51.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.896+0000 7fe288ff9640 1 -- 172.21.15.53:0/3746922124 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe28000abf0 con 0x7fe28c071060 2023-06-10T19:04:51.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.896+0000 7fe288ff9640 1 --2- 172.21.15.53:0/3746922124 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe278066280 0x7fe278068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:51.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.896+0000 7fe288ff9640 1 -- 172.21.15.53:0/3746922124 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6192+0+0 (secure 0 0 0) 0x7fe280083bb0 con 0x7fe28c071060 2023-06-10T19:04:51.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.896+0000 7fe28bfff640 1 --2- 172.21.15.53:0/3746922124 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe278066280 0x7fe278068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:51.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.896+0000 7fe28bfff640 1 --2- 172.21.15.53:0/3746922124 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe278066280 0x7fe278068730 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fe27c0ae000 tx=0x7fe27c0a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:51.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:51.900+0000 7fe288ff9640 1 -- 172.21.15.53:0/3746922124 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe280051040 con 0x7fe28c071060 2023-06-10T19:04:52.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.088+0000 7fe292624640 1 -- 172.21.15.53:0/3746922124 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe28c0ad5b0 con 0x7fe28c071060 2023-06-10T19:04:52.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.092+0000 7fe288ff9640 1 -- 172.21.15.53:0/3746922124 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4672 (secure 0 0 0) 0x7fe280054660 con 0x7fe28c071060 2023-06-10T19:04:52.095 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:04:52.095 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":63,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6542,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/3258793373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3258793373},{"type":"v1","addr":"172.21.15.117:6836","nonce":3258793373}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":7363,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/585135979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":585135979},{"type":"v1","addr":"172.21.15.117:6837","nonce":585135979}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":8682,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/448704478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":448704478},{"type":"v1","addr":"172.21.15.53:6833","nonce":448704478}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:03:48.420425+0000","modified":"2023-06-10T19:04:06.109236+0000","tableserver":0,"root":0,"session_timeout":30,"session_autoclose":50,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8685},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8685":{"gid":8685,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/1149668719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":1149668719},{"type":"v1","addr":"172.21.15.53:6835","nonce":1149668719}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-06-10T19:04:52.096 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 63 2023-06-10T19:04:52.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.092+0000 7fe292624640 1 -- 172.21.15.53:0/3746922124 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe278066280 msgr2=0x7fe278068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:52.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.092+0000 7fe292624640 1 --2- 172.21.15.53:0/3746922124 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe278066280 0x7fe278068730 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fe27c0ae000 tx=0x7fe27c0a7000 comp rx=0 tx=0).stop 2023-06-10T19:04:52.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.092+0000 7fe292624640 1 -- 172.21.15.53:0/3746922124 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe28c071060 msgr2=0x7fe28c1547e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:52.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.092+0000 7fe292624640 1 --2- 172.21.15.53:0/3746922124 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe28c071060 0x7fe28c1547e0 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7fe28000c7c0 tx=0x7fe28000cc80 comp rx=0 tx=0).stop 2023-06-10T19:04:52.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.092+0000 7fe292624640 1 -- 172.21.15.53:0/3746922124 shutdown_connections 2023-06-10T19:04:52.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.092+0000 7fe292624640 1 --2- 172.21.15.53:0/3746922124 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe278066280 0x7fe278068730 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:52.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.092+0000 7fe292624640 1 --2- 172.21.15.53:0/3746922124 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe28c0c9840 0x7fe28c153110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:52.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.092+0000 7fe292624640 1 --2- 172.21.15.53:0/3746922124 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe28c071060 0x7fe28c1547e0 unknown :-1 s=CLOSED pgs=1816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:52.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.092+0000 7fe292624640 1 --2- 172.21.15.53:0/3746922124 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe28c06b090 0x7fe28c1542a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:52.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.092+0000 7fe292624640 1 -- 172.21.15.53:0/3746922124 >> 172.21.15.53:0/3746922124 conn(0x7fe28c06a0d0 msgr2=0x7fe28c1586d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:04:52.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.092+0000 7fe292624640 1 -- 172.21.15.53:0/3746922124 shutdown_connections 2023-06-10T19:04:52.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.092+0000 7fe292624640 1 -- 172.21.15.53:0/3746922124 wait complete. 2023-06-10T19:04:52.119 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:04:52.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.236+0000 7f9ccc6dd640 1 Processor -- start 2023-06-10T19:04:52.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.236+0000 7f9ccc6dd640 1 -- start start 2023-06-10T19:04:52.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.236+0000 7f9ccc6dd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9cc4071060 0x7f9cc40af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:52.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.236+0000 7f9ccc6dd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9cc40afc60 0x7f9cc406b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:52.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.236+0000 7f9ccc6dd640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cc4159b50 con 0x7f9cc40c9840 2023-06-10T19:04:52.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.236+0000 7f9ccc6dd640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cc40702a0 con 0x7f9cc4071060 2023-06-10T19:04:52.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.236+0000 7f9ccc6dd640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc4070580 con 0x7f9cc40afc60 2023-06-10T19:04:52.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.236+0000 7f9cc9c78640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9cc4071060 0x7f9cc40af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:52.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.236+0000 7f9cc9c78640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9cc4071060 0x7f9cc40af720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37696/0 (socket says 172.21.15.53:37696) 2023-06-10T19:04:52.243 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.236+0000 7f9cc9c78640 1 -- 172.21.15.53:0/3475618089 learned_addr learned my addr 172.21.15.53:0/3475618089 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:04:52.243 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.236+0000 7f9ccac7a640 1 --2- 172.21.15.53:0/3475618089 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9cc40afc60 0x7f9cc406b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:52.243 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.236+0000 7f9cc9c78640 1 -- 172.21.15.53:0/3475618089 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9cc40afc60 msgr2=0x7f9cc406b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:04:52.243 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.236+0000 7f9cc9c78640 1 --2- 172.21.15.53:0/3475618089 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9cc40afc60 0x7f9cc406b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:52.244 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.236+0000 7f9cc9c78640 1 -- 172.21.15.53:0/3475618089 >> v1:172.21.15.53:6789/0 conn(0x7f9cc40c9840 legacy=0x7f9cc40c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:52.244 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.236+0000 7f9cc9c78640 1 -- 172.21.15.53:0/3475618089 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cc4070860 con 0x7f9cc4071060 2023-06-10T19:04:52.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.240+0000 7f9cc9c78640 1 --2- 172.21.15.53:0/3475618089 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9cc4071060 0x7f9cc40af720 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7f9cb4009870 tx=0x7f9cb401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89aaf468467e36d1 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:52.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.240+0000 7f9cc9477640 1 -- 172.21.15.53:0/3475618089 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb40a95f0 con 0x7f9cc4071060 2023-06-10T19:04:52.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.240+0000 7f9cc9477640 1 -- 172.21.15.53:0/3475618089 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cb40a9750 con 0x7f9cc4071060 2023-06-10T19:04:52.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.240+0000 7f9cc9477640 1 -- 172.21.15.53:0/3475618089 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb40a9ae0 con 0x7f9cc4071060 2023-06-10T19:04:52.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.240+0000 7f9ccc6dd640 1 -- 172.21.15.53:0/3475618089 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9cc4071060 msgr2=0x7f9cc40af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:52.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.240+0000 7f9ccc6dd640 1 --2- 172.21.15.53:0/3475618089 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9cc4071060 0x7f9cc40af720 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7f9cb4009870 tx=0x7f9cb401c510 comp rx=0 tx=0).stop 2023-06-10T19:04:52.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.240+0000 7f9ccc6dd640 1 -- 172.21.15.53:0/3475618089 shutdown_connections 2023-06-10T19:04:52.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.240+0000 7f9ccc6dd640 1 --2- 172.21.15.53:0/3475618089 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9cc4071060 0x7f9cc40af720 unknown :-1 s=CLOSED pgs=1818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:52.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.240+0000 7f9ccc6dd640 1 --2- 172.21.15.53:0/3475618089 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9cc40afc60 0x7f9cc406b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:52.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.240+0000 7f9ccc6dd640 1 -- 172.21.15.53:0/3475618089 >> 172.21.15.53:0/3475618089 conn(0x7f9cc406a0d0 msgr2=0x7f9cc40ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:04:52.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.240+0000 7f9ccc6dd640 1 -- 172.21.15.53:0/3475618089 shutdown_connections 2023-06-10T19:04:52.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.240+0000 7f9ccc6dd640 1 -- 172.21.15.53:0/3475618089 wait complete. 2023-06-10T19:04:52.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.240+0000 7f9ccc6dd640 1 Processor -- start 2023-06-10T19:04:52.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.240+0000 7f9ccc6dd640 1 -- start start 2023-06-10T19:04:52.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.240+0000 7f9ccc6dd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9cc4071060 0x7f9cc40c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:52.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.240+0000 7f9ccc6dd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9cc40afc60 0x7f9cc40b0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:52.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.240+0000 7f9ccc6dd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9cc40c9840 0x7f9cc40b1010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:52.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.240+0000 7f9ccc6dd640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc40c2b30 con 0x7f9cc4071060 2023-06-10T19:04:52.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.240+0000 7f9ccc6dd640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc40c2e10 con 0x7f9cc40c9840 2023-06-10T19:04:52.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.240+0000 7f9ccc6dd640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc40c30f0 con 0x7f9cc40afc60 2023-06-10T19:04:52.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.240+0000 7f9cca479640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9cc4071060 0x7f9cc40c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:52.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.240+0000 7f9cca479640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9cc4071060 0x7f9cc40c3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37700/0 (socket says 172.21.15.53:37700) 2023-06-10T19:04:52.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.240+0000 7f9cca479640 1 -- 172.21.15.53:0/3600242196 learned_addr learned my addr 172.21.15.53:0/3600242196 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:04:52.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.240+0000 7f9cc9c78640 1 --2- 172.21.15.53:0/3600242196 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9cc40afc60 0x7f9cc40b0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:52.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.240+0000 7f9cca479640 1 -- 172.21.15.53:0/3600242196 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9cc40afc60 msgr2=0x7f9cc40b0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:52.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.240+0000 7f9cca479640 1 --2- 172.21.15.53:0/3600242196 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9cc40afc60 0x7f9cc40b0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:52.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.240+0000 7f9ccac7a640 1 --2- 172.21.15.53:0/3600242196 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9cc40c9840 0x7f9cc40b1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:52.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.240+0000 7f9cca479640 1 -- 172.21.15.53:0/3600242196 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9cc40c9840 msgr2=0x7f9cc40b1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:52.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.240+0000 7f9cca479640 1 --2- 172.21.15.53:0/3600242196 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9cc40c9840 0x7f9cc40b1010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:52.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.240+0000 7f9cca479640 1 -- 172.21.15.53:0/3600242196 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cb40094d0 con 0x7f9cc4071060 2023-06-10T19:04:52.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.240+0000 7f9cc9c78640 1 --2- 172.21.15.53:0/3600242196 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9cc40afc60 0x7f9cc40b0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:04:52.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.240+0000 7f9cca479640 1 --2- 172.21.15.53:0/3600242196 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9cc4071060 0x7f9cc40c3bd0 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7f9cc000c3c0 tx=0x7f9cc000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:52.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.244+0000 7f9cbaffd640 1 -- 172.21.15.53:0/3600242196 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc00052d0 con 0x7f9cc4071060 2023-06-10T19:04:52.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.244+0000 7f9cbaffd640 1 -- 172.21.15.53:0/3600242196 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cc0005430 con 0x7f9cc4071060 2023-06-10T19:04:52.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.244+0000 7f9ccc6dd640 1 -- 172.21.15.53:0/3600242196 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cc40c33d0 con 0x7f9cc4071060 2023-06-10T19:04:52.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.244+0000 7f9cbaffd640 1 -- 172.21.15.53:0/3600242196 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc0003840 con 0x7f9cc4071060 2023-06-10T19:04:52.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.244+0000 7f9ccc6dd640 1 -- 172.21.15.53:0/3600242196 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cc40c4110 con 0x7f9cc4071060 2023-06-10T19:04:52.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.244+0000 7f9ccc6dd640 1 -- 172.21.15.53:0/3600242196 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cc404d790 con 0x7f9cc4071060 2023-06-10T19:04:52.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.244+0000 7f9cbaffd640 1 -- 172.21.15.53:0/3600242196 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9cc00039a0 con 0x7f9cc4071060 2023-06-10T19:04:52.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.244+0000 7f9cbaffd640 1 --2- 172.21.15.53:0/3600242196 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9ca80662b0 0x7f9ca8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:52.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.244+0000 7f9cbaffd640 1 -- 172.21.15.53:0/3600242196 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6192+0+0 (secure 0 0 0) 0x7f9cc0083290 con 0x7f9cc4071060 2023-06-10T19:04:52.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.244+0000 7f9cc9c78640 1 --2- 172.21.15.53:0/3600242196 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9ca80662b0 0x7f9ca8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:52.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.244+0000 7f9cc9c78640 1 --2- 172.21.15.53:0/3600242196 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9ca80662b0 0x7f9ca8068760 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f9cb40ae000 tx=0x7f9cb40b3040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:52.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.248+0000 7f9cbaffd640 1 -- 172.21.15.53:0/3600242196 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9cc00506a0 con 0x7f9cc4071060 2023-06-10T19:04:52.445 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.440+0000 7f9ccc6dd640 1 -- 172.21.15.53:0/3600242196 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9cc4071b60 con 0x7f9cc4071060 2023-06-10T19:04:52.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.440+0000 7f9cbaffd640 1 -- 172.21.15.53:0/3600242196 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4672 (secure 0 0 0) 0x7f9cc0053cc0 con 0x7f9cc4071060 2023-06-10T19:04:52.446 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:04:52.447 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":63,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6542,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/3258793373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3258793373},{"type":"v1","addr":"172.21.15.117:6836","nonce":3258793373}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":7363,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/585135979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":585135979},{"type":"v1","addr":"172.21.15.117:6837","nonce":585135979}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":8682,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/448704478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":448704478},{"type":"v1","addr":"172.21.15.53:6833","nonce":448704478}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:03:48.420425+0000","modified":"2023-06-10T19:04:06.109236+0000","tableserver":0,"root":0,"session_timeout":30,"session_autoclose":50,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8685},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8685":{"gid":8685,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/1149668719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":1149668719},{"type":"v1","addr":"172.21.15.53:6835","nonce":1149668719}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-06-10T19:04:52.447 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 63 2023-06-10T19:04:52.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.444+0000 7f9ccc6dd640 1 -- 172.21.15.53:0/3600242196 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9ca80662b0 msgr2=0x7f9ca8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:52.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.444+0000 7f9ccc6dd640 1 --2- 172.21.15.53:0/3600242196 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9ca80662b0 0x7f9ca8068760 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f9cb40ae000 tx=0x7f9cb40b3040 comp rx=0 tx=0).stop 2023-06-10T19:04:52.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.444+0000 7f9ccc6dd640 1 -- 172.21.15.53:0/3600242196 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9cc4071060 msgr2=0x7f9cc40c3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:52.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.444+0000 7f9ccc6dd640 1 --2- 172.21.15.53:0/3600242196 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9cc4071060 0x7f9cc40c3bd0 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7f9cc000c3c0 tx=0x7f9cc000c880 comp rx=0 tx=0).stop 2023-06-10T19:04:52.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.444+0000 7f9ccc6dd640 1 -- 172.21.15.53:0/3600242196 shutdown_connections 2023-06-10T19:04:52.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.444+0000 7f9ccc6dd640 1 --2- 172.21.15.53:0/3600242196 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9ca80662b0 0x7f9ca8068760 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:52.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.444+0000 7f9ccc6dd640 1 --2- 172.21.15.53:0/3600242196 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9cc40c9840 0x7f9cc40b1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:52.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.444+0000 7f9ccc6dd640 1 --2- 172.21.15.53:0/3600242196 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9cc40afc60 0x7f9cc40b0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:52.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.444+0000 7f9ccc6dd640 1 --2- 172.21.15.53:0/3600242196 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9cc4071060 0x7f9cc40c3bd0 unknown :-1 s=CLOSED pgs=1819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:52.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.444+0000 7f9ccc6dd640 1 -- 172.21.15.53:0/3600242196 >> 172.21.15.53:0/3600242196 conn(0x7f9cc406a0d0 msgr2=0x7f9cc40c8b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:04:52.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.444+0000 7f9ccc6dd640 1 -- 172.21.15.53:0/3600242196 shutdown_connections 2023-06-10T19:04:52.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.444+0000 7f9ccc6dd640 1 -- 172.21.15.53:0/3600242196 wait complete. 2023-06-10T19:04:52.467 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:04:52.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.580+0000 7f2b9ea1e640 1 Processor -- start 2023-06-10T19:04:52.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.580+0000 7f2b9ea1e640 1 -- start start 2023-06-10T19:04:52.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.580+0000 7f2b9ea1e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b9815fe00 0x7f2b98163980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:52.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.580+0000 7f2b9ea1e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2b980cb870 0x7f2b980c10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:52.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.580+0000 7f2b9ea1e640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b981648e0 con 0x7f2b980af720 2023-06-10T19:04:52.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.580+0000 7f2b9ea1e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b9806b2c0 con 0x7f2b980cb870 2023-06-10T19:04:52.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.580+0000 7f2b9ea1e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b980c1620 con 0x7f2b9815fe00 2023-06-10T19:04:52.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.580+0000 7f2b9cfbb640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f2b980af720 0x7f2b9806b750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:40886/0 (socket says 172.21.15.53:40886) 2023-06-10T19:04:52.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.580+0000 7f2b9cfbb640 1 -- 172.21.15.53:0/1028657388 learned_addr learned my addr 172.21.15.53:0/1028657388 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:04:52.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.580+0000 7f2b97fff640 1 --2- 172.21.15.53:0/1028657388 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b9815fe00 0x7f2b98163980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:52.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.580+0000 7f2b977fe640 1 --2- 172.21.15.53:0/1028657388 >> v2:172.21.15.117:3300/0 conn(0x7f2b980cb870 0x7f2b980c10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:52.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.580+0000 7f2b96ffd640 1 -- 172.21.15.53:0/1028657388 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2502502671 0 0) 0x7f2b981648e0 con 0x7f2b980af720 2023-06-10T19:04:52.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.580+0000 7f2b96ffd640 1 -- 172.21.15.53:0/1028657388 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b78003530 con 0x7f2b980af720 2023-06-10T19:04:52.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.580+0000 7f2b96ffd640 1 -- 172.21.15.53:0/1028657388 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3379423939 0 0) 0x7f2b78003530 con 0x7f2b980af720 2023-06-10T19:04:52.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.580+0000 7f2b96ffd640 1 -- 172.21.15.53:0/1028657388 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b9815fe00 msgr2=0x7f2b98163980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:04:52.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.580+0000 7f2b96ffd640 1 --2- 172.21.15.53:0/1028657388 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b9815fe00 0x7f2b98163980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:52.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.580+0000 7f2b96ffd640 1 -- 172.21.15.53:0/1028657388 >> v2:172.21.15.117:3300/0 conn(0x7f2b980cb870 msgr2=0x7f2b980c10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:04:52.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.580+0000 7f2b96ffd640 1 --2- 172.21.15.53:0/1028657388 >> v2:172.21.15.117:3300/0 conn(0x7f2b980cb870 0x7f2b980c10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:52.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.580+0000 7f2b96ffd640 1 -- 172.21.15.53:0/1028657388 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b980cbcc0 con 0x7f2b980af720 2023-06-10T19:04:52.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.580+0000 7f2b96ffd640 1 -- 172.21.15.53:0/1028657388 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f2b90001680 con 0x7f2b980af720 2023-06-10T19:04:52.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.580+0000 7f2b96ffd640 1 -- 172.21.15.53:0/1028657388 >> v1:172.21.15.53:6789/0 conn(0x7f2b980af720 legacy=0x7f2b9806b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:52.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.580+0000 7f2b96ffd640 1 --2- 172.21.15.53:0/1028657388 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b780039f0 0x7f2b78003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:52.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.580+0000 7f2b96ffd640 1 --2- 172.21.15.53:0/1028657388 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b780047d0 0x7f2b78004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:52.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.580+0000 7f2b96ffd640 1 --2- 172.21.15.53:0/1028657388 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b9815fe00 0x7f2b78005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:52.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.580+0000 7f2b96ffd640 1 -- 172.21.15.53:0/1028657388 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b9806b2c0 con 0x7f2b780047d0 2023-06-10T19:04:52.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.580+0000 7f2b96ffd640 1 -- 172.21.15.53:0/1028657388 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b980c1620 con 0x7f2b780039f0 2023-06-10T19:04:52.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.580+0000 7f2b96ffd640 1 -- 172.21.15.53:0/1028657388 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7800b990 con 0x7f2b9815fe00 2023-06-10T19:04:52.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.580+0000 7f2b977fe640 1 --2- 172.21.15.53:0/1028657388 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b780047d0 0x7f2b78004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:52.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.580+0000 7f2b97fff640 1 --2- 172.21.15.53:0/1028657388 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b780039f0 0x7f2b78003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:52.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.580+0000 7f2b9cfbb640 1 --2- 172.21.15.53:0/1028657388 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b9815fe00 0x7f2b78005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:52.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.580+0000 7f2b977fe640 1 -- 172.21.15.53:0/1028657388 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b9815fe00 msgr2=0x7f2b78005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:04:52.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.580+0000 7f2b977fe640 1 --2- 172.21.15.53:0/1028657388 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b9815fe00 0x7f2b78005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:52.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.580+0000 7f2b977fe640 1 -- 172.21.15.53:0/1028657388 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b780039f0 msgr2=0x7f2b78003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:04:52.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.580+0000 7f2b977fe640 1 --2- 172.21.15.53:0/1028657388 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b780039f0 0x7f2b78003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:52.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.580+0000 7f2b977fe640 1 -- 172.21.15.53:0/1028657388 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b78003530 con 0x7f2b780047d0 2023-06-10T19:04:52.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.580+0000 7f2b97fff640 1 --2- 172.21.15.53:0/1028657388 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b780039f0 0x7f2b78003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:04:52.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.584+0000 7f2b977fe640 1 --2- 172.21.15.53:0/1028657388 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b780047d0 0x7f2b78004c40 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7f2b80009fc0 tx=0x7f2b8001cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f478dd628452bd6 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:52.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.584+0000 7f2b96ffd640 1 -- 172.21.15.53:0/1028657388 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b800a5ba0 con 0x7f2b780047d0 2023-06-10T19:04:52.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.584+0000 7f2b96ffd640 1 -- 172.21.15.53:0/1028657388 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b8000f040 con 0x7f2b780047d0 2023-06-10T19:04:52.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.584+0000 7f2b96ffd640 1 -- 172.21.15.53:0/1028657388 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b800ad440 con 0x7f2b780047d0 2023-06-10T19:04:52.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.584+0000 7f2b9ea1e640 1 -- 172.21.15.53:0/1028657388 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b780047d0 msgr2=0x7f2b78004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:52.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.584+0000 7f2b9ea1e640 1 --2- 172.21.15.53:0/1028657388 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b780047d0 0x7f2b78004c40 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7f2b80009fc0 tx=0x7f2b8001cca0 comp rx=0 tx=0).stop 2023-06-10T19:04:52.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.584+0000 7f2b9cfbb640 1 -- 172.21.15.53:0/1028657388 reap_dead start 2023-06-10T19:04:52.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.584+0000 7f2b9ea1e640 1 -- 172.21.15.53:0/1028657388 shutdown_connections 2023-06-10T19:04:52.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.584+0000 7f2b9ea1e640 1 -- 172.21.15.53:0/1028657388 >> 172.21.15.53:0/1028657388 conn(0x7f2b9806a0d0 msgr2=0x7f2b980ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:04:52.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.584+0000 7f2b9ea1e640 1 -- 172.21.15.53:0/1028657388 shutdown_connections 2023-06-10T19:04:52.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.584+0000 7f2b9ea1e640 1 -- 172.21.15.53:0/1028657388 wait complete. 2023-06-10T19:04:52.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.584+0000 7f2b9ea1e640 1 Processor -- start 2023-06-10T19:04:52.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.584+0000 7f2b9ea1e640 1 -- start start 2023-06-10T19:04:52.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.584+0000 7f2b9ea1e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b780047d0 0x7f2b98158a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:52.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.584+0000 7f2b9ea1e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b981f8980 0x7f2b981f8df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:52.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.584+0000 7f2b9ea1e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b981624a0 0x7f2b98162910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:52.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.584+0000 7f2b9ea1e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b98162e50 con 0x7f2b981f8980 2023-06-10T19:04:52.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.584+0000 7f2b9ea1e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b981601d0 con 0x7f2b981624a0 2023-06-10T19:04:52.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.584+0000 7f2b9ea1e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b98160790 con 0x7f2b780047d0 2023-06-10T19:04:52.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.588+0000 7f2b977fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b981f8980 0x7f2b981f8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:52.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.588+0000 7f2b977fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b981f8980 0x7f2b981f8df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37724/0 (socket says 172.21.15.53:37724) 2023-06-10T19:04:52.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.588+0000 7f2b977fe640 1 -- 172.21.15.53:0/1238734420 learned_addr learned my addr 172.21.15.53:0/1238734420 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:04:52.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.588+0000 7f2b97fff640 1 --2- 172.21.15.53:0/1238734420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b780047d0 0x7f2b98158a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:52.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.588+0000 7f2b9cfbb640 1 --2- 172.21.15.53:0/1238734420 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b981624a0 0x7f2b98162910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:52.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.588+0000 7f2b977fe640 1 -- 172.21.15.53:0/1238734420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b780047d0 msgr2=0x7f2b98158a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:52.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.588+0000 7f2b977fe640 1 --2- 172.21.15.53:0/1238734420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b780047d0 0x7f2b98158a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:52.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.588+0000 7f2b977fe640 1 -- 172.21.15.53:0/1238734420 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b981624a0 msgr2=0x7f2b98162910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:52.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.588+0000 7f2b977fe640 1 --2- 172.21.15.53:0/1238734420 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b981624a0 0x7f2b98162910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:52.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.588+0000 7f2b977fe640 1 -- 172.21.15.53:0/1238734420 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b98158f80 con 0x7f2b981f8980 2023-06-10T19:04:52.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.588+0000 7f2b9cfbb640 1 --2- 172.21.15.53:0/1238734420 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b981624a0 0x7f2b98162910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:04:52.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.588+0000 7f2b977fe640 1 --2- 172.21.15.53:0/1238734420 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b981f8980 0x7f2b981f8df0 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7f2b8001d180 tx=0x7f2b80009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:52.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.588+0000 7f2b94ff9640 1 -- 172.21.15.53:0/1238734420 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b800adbb0 con 0x7f2b981f8980 2023-06-10T19:04:52.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.588+0000 7f2b94ff9640 1 -- 172.21.15.53:0/1238734420 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b800add10 con 0x7f2b981f8980 2023-06-10T19:04:52.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.588+0000 7f2b94ff9640 1 -- 172.21.15.53:0/1238734420 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b80003ba0 con 0x7f2b981f8980 2023-06-10T19:04:52.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.588+0000 7f2b9ea1e640 1 -- 172.21.15.53:0/1238734420 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b980c1dd0 con 0x7f2b981f8980 2023-06-10T19:04:52.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.588+0000 7f2b9ea1e640 1 -- 172.21.15.53:0/1238734420 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b981f9740 con 0x7f2b981f8980 2023-06-10T19:04:52.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.588+0000 7f2b9ea1e640 1 -- 172.21.15.53:0/1238734420 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b9804d790 con 0x7f2b981f8980 2023-06-10T19:04:52.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.588+0000 7f2b94ff9640 1 -- 172.21.15.53:0/1238734420 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2b800b4040 con 0x7f2b981f8980 2023-06-10T19:04:52.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.588+0000 7f2b94ff9640 1 --2- 172.21.15.53:0/1238734420 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2b7c066280 0x7f2b7c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:52.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.588+0000 7f2b94ff9640 1 -- 172.21.15.53:0/1238734420 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6192+0+0 (secure 0 0 0) 0x7f2b8011e830 con 0x7f2b981f8980 2023-06-10T19:04:52.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.588+0000 7f2b97fff640 1 --2- 172.21.15.53:0/1238734420 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2b7c066280 0x7f2b7c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:52.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.592+0000 7f2b97fff640 1 --2- 172.21.15.53:0/1238734420 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2b7c066280 0x7f2b7c068730 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f2b88009a80 tx=0x7f2b88008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:52.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.592+0000 7f2b94ff9640 1 -- 172.21.15.53:0/1238734420 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2b800ebd70 con 0x7f2b981f8980 2023-06-10T19:04:52.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.748+0000 7f2b9ea1e640 1 -- 172.21.15.53:0/1238734420 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2b981608d0 con 0x7f2b981f8980 2023-06-10T19:04:52.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.748+0000 7f2b94ff9640 1 -- 172.21.15.53:0/1238734420 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) v1 ==== 74+0+18486 (secure 0 0 0) 0x7f2b800ef390 con 0x7f2b981f8980 2023-06-10T19:04:52.755 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:04:52.755 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":113,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:04:44.261377+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-06-10T19:03:46.427131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-06-10T19:03:47.398979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.d","mappings":[{"from":6,"to":7}]},{"pgid":"16.13","mappings":[{"from":1,"to":4}]},{"pgid":"16.1e","mappings":[{"from":5,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.0.1:0/3878814772":"2023-06-10T20:04:43.440652+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:04:52.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.752+0000 7f2b9ea1e640 1 -- 172.21.15.53:0/1238734420 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2b7c066280 msgr2=0x7f2b7c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:52.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.752+0000 7f2b9ea1e640 1 --2- 172.21.15.53:0/1238734420 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2b7c066280 0x7f2b7c068730 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f2b88009a80 tx=0x7f2b88008040 comp rx=0 tx=0).stop 2023-06-10T19:04:52.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.752+0000 7f2b9ea1e640 1 -- 172.21.15.53:0/1238734420 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b981f8980 msgr2=0x7f2b981f8df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:52.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.752+0000 7f2b9ea1e640 1 --2- 172.21.15.53:0/1238734420 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b981f8980 0x7f2b981f8df0 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7f2b8001d180 tx=0x7f2b80009750 comp rx=0 tx=0).stop 2023-06-10T19:04:52.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.752+0000 7f2b9ea1e640 1 -- 172.21.15.53:0/1238734420 shutdown_connections 2023-06-10T19:04:52.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.752+0000 7f2b9ea1e640 1 --2- 172.21.15.53:0/1238734420 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2b7c066280 0x7f2b7c068730 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:52.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.752+0000 7f2b9ea1e640 1 --2- 172.21.15.53:0/1238734420 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b981624a0 0x7f2b98162910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:52.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.752+0000 7f2b9ea1e640 1 --2- 172.21.15.53:0/1238734420 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2b981f8980 0x7f2b981f8df0 unknown :-1 s=CLOSED pgs=1822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:52.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.752+0000 7f2b9ea1e640 1 --2- 172.21.15.53:0/1238734420 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2b780047d0 0x7f2b98158a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:52.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.752+0000 7f2b9ea1e640 1 -- 172.21.15.53:0/1238734420 >> 172.21.15.53:0/1238734420 conn(0x7f2b9806a0d0 msgr2=0x7f2b980ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:04:52.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.752+0000 7f2b9ea1e640 1 -- 172.21.15.53:0/1238734420 shutdown_connections 2023-06-10T19:04:52.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.752+0000 7f2b9ea1e640 1 -- 172.21.15.53:0/1238734420 wait complete. 2023-06-10T19:04:52.777 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-06-10T19:04:52.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.900+0000 7fe70a7c9640 1 Processor -- start 2023-06-10T19:04:52.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.900+0000 7fe70a7c9640 1 -- start start 2023-06-10T19:04:52.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.900+0000 7fe70a7c9640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe7041571a0 0x7fe7040c9f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:52.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.900+0000 7fe70a7c9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe7040afee0 0x7fe7040c83f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:52.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.900+0000 7fe70a7c9640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe704071190 con 0x7fe704070100 2023-06-10T19:04:52.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.900+0000 7fe70a7c9640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7040ca440 con 0x7fe7041571a0 2023-06-10T19:04:52.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.900+0000 7fe70a7c9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe704070580 con 0x7fe7040afee0 2023-06-10T19:04:52.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.900+0000 7fe703fff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe7041571a0 0x7fe7040c9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:52.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.900+0000 7fe708d66640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe7040afee0 0x7fe7040c83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:52.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.900+0000 7fe703fff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe7041571a0 0x7fe7040c9f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.53:48958/0 (socket says 172.21.15.53:48958) 2023-06-10T19:04:52.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.900+0000 7fe7037fe640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fe704070100 0x7fe7040af7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.53:46468/0 (socket says 172.21.15.53:46468) 2023-06-10T19:04:52.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.900+0000 7fe703fff640 1 -- 172.21.15.53:0/3484751984 learned_addr learned my addr 172.21.15.53:0/3484751984 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:04:52.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.900+0000 7fe708d66640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe7040afee0 0x7fe7040c83f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.53:57508/0 (socket says 172.21.15.53:57508) 2023-06-10T19:04:52.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.900+0000 7fe703fff640 1 -- 172.21.15.53:0/3484751984 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe7040afee0 msgr2=0x7fe7040c83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:04:52.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.900+0000 7fe703fff640 1 --2- 172.21.15.53:0/3484751984 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe7040afee0 0x7fe7040c83f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:52.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.900+0000 7fe703fff640 1 -- 172.21.15.53:0/3484751984 >> v1:172.21.15.117:6789/0 conn(0x7fe704070100 legacy=0x7fe7040af7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:52.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.900+0000 7fe703fff640 1 -- 172.21.15.53:0/3484751984 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe704070860 con 0x7fe7041571a0 2023-06-10T19:04:52.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.900+0000 7fe708d66640 1 --2- 172.21.15.53:0/3484751984 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe7040afee0 0x7fe7040c83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-10T19:04:52.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.904+0000 7fe703fff640 1 --2- 172.21.15.53:0/3484751984 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe7041571a0 0x7fe7040c9f00 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec006fd0 tx=0x7fe6ec01c4f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99ed748901483409 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:52.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.904+0000 7fe702ffd640 1 -- 172.21.15.53:0/3484751984 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6ec0aa650 con 0x7fe7041571a0 2023-06-10T19:04:52.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.904+0000 7fe702ffd640 1 -- 172.21.15.53:0/3484751984 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6ec0aa7b0 con 0x7fe7041571a0 2023-06-10T19:04:52.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.904+0000 7fe702ffd640 1 -- 172.21.15.53:0/3484751984 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6ec0aab40 con 0x7fe7041571a0 2023-06-10T19:04:52.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.904+0000 7fe70a7c9640 1 -- 172.21.15.53:0/3484751984 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe7041571a0 msgr2=0x7fe7040c9f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:52.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.904+0000 7fe70a7c9640 1 --2- 172.21.15.53:0/3484751984 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe7041571a0 0x7fe7040c9f00 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec006fd0 tx=0x7fe6ec01c4f0 comp rx=0 tx=0).stop 2023-06-10T19:04:52.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.904+0000 7fe70a7c9640 1 -- 172.21.15.53:0/3484751984 shutdown_connections 2023-06-10T19:04:52.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.904+0000 7fe70a7c9640 1 --2- 172.21.15.53:0/3484751984 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe7040afee0 0x7fe7040c83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:52.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.904+0000 7fe70a7c9640 1 --2- 172.21.15.53:0/3484751984 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe7041571a0 0x7fe7040c9f00 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:52.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.904+0000 7fe70a7c9640 1 -- 172.21.15.53:0/3484751984 >> 172.21.15.53:0/3484751984 conn(0x7fe7040ce9e0 msgr2=0x7fe7040ca7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:04:52.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.904+0000 7fe70a7c9640 1 -- 172.21.15.53:0/3484751984 shutdown_connections 2023-06-10T19:04:52.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.904+0000 7fe70a7c9640 1 -- 172.21.15.53:0/3484751984 wait complete. 2023-06-10T19:04:52.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.908+0000 7fe70a7c9640 1 Processor -- start 2023-06-10T19:04:52.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.908+0000 7fe70a7c9640 1 -- start start 2023-06-10T19:04:52.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.908+0000 7fe70a7c9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe7040afee0 0x7fe7040b0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:52.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.908+0000 7fe70a7c9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7041571a0 0x7fe704148b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:52.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.908+0000 7fe70a7c9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe704149050 0x7fe70414c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:52.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.908+0000 7fe70a7c9640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe70415c800 con 0x7fe7041571a0 2023-06-10T19:04:52.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.908+0000 7fe70a7c9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe70415ca10 con 0x7fe7040afee0 2023-06-10T19:04:52.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.908+0000 7fe70a7c9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe70415ccf0 con 0x7fe704149050 2023-06-10T19:04:52.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.908+0000 7fe7037fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7041571a0 0x7fe704148b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:52.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.908+0000 7fe7037fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7041571a0 0x7fe704148b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37728/0 (socket says 172.21.15.53:37728) 2023-06-10T19:04:52.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.908+0000 7fe7037fe640 1 -- 172.21.15.53:0/657176053 learned_addr learned my addr 172.21.15.53:0/657176053 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:04:52.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.908+0000 7fe708d66640 1 --2- 172.21.15.53:0/657176053 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe704149050 0x7fe70414c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:52.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.908+0000 7fe703fff640 1 --2- 172.21.15.53:0/657176053 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe7040afee0 0x7fe7040b0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:52.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.908+0000 7fe7037fe640 1 -- 172.21.15.53:0/657176053 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe704149050 msgr2=0x7fe70414c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:52.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.908+0000 7fe7037fe640 1 --2- 172.21.15.53:0/657176053 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe704149050 0x7fe70414c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:52.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.908+0000 7fe7037fe640 1 -- 172.21.15.53:0/657176053 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe7040afee0 msgr2=0x7fe7040b0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:52.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.908+0000 7fe7037fe640 1 --2- 172.21.15.53:0/657176053 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe7040afee0 0x7fe7040b0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:52.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.908+0000 7fe7037fe640 1 -- 172.21.15.53:0/657176053 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6fc009a70 con 0x7fe7041571a0 2023-06-10T19:04:52.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.908+0000 7fe708d66640 1 --2- 172.21.15.53:0/657176053 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe704149050 0x7fe70414c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:04:52.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.908+0000 7fe703fff640 1 --2- 172.21.15.53:0/657176053 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe7040afee0 0x7fe7040b0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:04:52.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.908+0000 7fe7037fe640 1 --2- 172.21.15.53:0/657176053 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7041571a0 0x7fe704148b10 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7fe6f400c430 tx=0x7fe6f400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:52.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.908+0000 7fe700ff9640 1 -- 172.21.15.53:0/657176053 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f40074e0 con 0x7fe7041571a0 2023-06-10T19:04:52.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.908+0000 7fe700ff9640 1 -- 172.21.15.53:0/657176053 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6f4007640 con 0x7fe7041571a0 2023-06-10T19:04:52.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.908+0000 7fe70a7c9640 1 -- 172.21.15.53:0/657176053 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6ec009480 con 0x7fe7041571a0 2023-06-10T19:04:52.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.908+0000 7fe700ff9640 1 -- 172.21.15.53:0/657176053 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f4004a30 con 0x7fe7041571a0 2023-06-10T19:04:52.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.908+0000 7fe70a7c9640 1 -- 172.21.15.53:0/657176053 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe70415d2b0 con 0x7fe7041571a0 2023-06-10T19:04:52.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.908+0000 7fe70a7c9640 1 -- 172.21.15.53:0/657176053 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe70404d790 con 0x7fe7041571a0 2023-06-10T19:04:52.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.912+0000 7fe700ff9640 1 -- 172.21.15.53:0/657176053 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe6f4004b90 con 0x7fe7041571a0 2023-06-10T19:04:52.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.912+0000 7fe700ff9640 1 --2- 172.21.15.53:0/657176053 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe6e40662b0 0x7fe6e4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:52.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.912+0000 7fe700ff9640 1 -- 172.21.15.53:0/657176053 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6192+0+0 (secure 0 0 0) 0x7fe6f40837c0 con 0x7fe7041571a0 2023-06-10T19:04:52.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.912+0000 7fe703fff640 1 --2- 172.21.15.53:0/657176053 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe6e40662b0 0x7fe6e4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:52.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.912+0000 7fe703fff640 1 --2- 172.21.15.53:0/657176053 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe6e40662b0 0x7fe6e4068760 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec0ae000 tx=0x7fe6ec009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:52.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:52.916+0000 7fe700ff9640 1 -- 172.21.15.53:0/657176053 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe6f4050bc0 con 0x7fe7041571a0 2023-06-10T19:04:53.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:53.100+0000 7fe70a7c9640 1 -- 172.21.15.53:0/657176053 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fe7041643d0 con 0x7fe7041571a0 2023-06-10T19:04:53.327 INFO:tasks.ceph.mon.a.smithi053.stderr:2023-06-10T19:04:53.324+0000 7f74752c1640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-06-10T19:04:53.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:53.332+0000 7fe700ff9640 1 -- 172.21.15.53:0/657176053 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v64) v1 ==== 161+0+0 (secure 0 0 0) 0x7fe6f40541e0 con 0x7fe7041571a0 2023-06-10T19:04:53.335 INFO:teuthology.orchestra.run.smithi053.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-06-10T19:04:53.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:53.336+0000 7fe70a7c9640 1 -- 172.21.15.53:0/657176053 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe6e40662b0 msgr2=0x7fe6e4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:53.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:53.336+0000 7fe70a7c9640 1 --2- 172.21.15.53:0/657176053 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe6e40662b0 0x7fe6e4068760 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec0ae000 tx=0x7fe6ec009040 comp rx=0 tx=0).stop 2023-06-10T19:04:53.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:53.336+0000 7fe70a7c9640 1 -- 172.21.15.53:0/657176053 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7041571a0 msgr2=0x7fe704148b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:53.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:53.336+0000 7fe70a7c9640 1 --2- 172.21.15.53:0/657176053 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7041571a0 0x7fe704148b10 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7fe6f400c430 tx=0x7fe6f400c8f0 comp rx=0 tx=0).stop 2023-06-10T19:04:53.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:53.336+0000 7fe70a7c9640 1 -- 172.21.15.53:0/657176053 shutdown_connections 2023-06-10T19:04:53.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:53.336+0000 7fe70a7c9640 1 --2- 172.21.15.53:0/657176053 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe6e40662b0 0x7fe6e4068760 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:53.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:53.336+0000 7fe70a7c9640 1 --2- 172.21.15.53:0/657176053 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe704149050 0x7fe70414c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:53.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:53.336+0000 7fe70a7c9640 1 --2- 172.21.15.53:0/657176053 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7041571a0 0x7fe704148b10 unknown :-1 s=CLOSED pgs=1823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:53.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:53.336+0000 7fe70a7c9640 1 --2- 172.21.15.53:0/657176053 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe7040afee0 0x7fe7040b0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:53.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:53.336+0000 7fe70a7c9640 1 -- 172.21.15.53:0/657176053 >> 172.21.15.53:0/657176053 conn(0x7fe7040ce9e0 msgr2=0x7fe70414f770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:04:53.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:53.336+0000 7fe70a7c9640 1 -- 172.21.15.53:0/657176053 shutdown_connections 2023-06-10T19:04:53.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:53.336+0000 7fe70a7c9640 1 -- 172.21.15.53:0/657176053 wait complete. 2023-06-10T19:04:53.342 INFO:tasks.ceph.mds.a.smithi053.stderr: -3246> 2023-06-10T19:03:54.429+0000 7f906e896640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-06-10T19:04:53.361 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-06-10T19:04:53.388 INFO:tasks.ceph.mds.a.smithi053.stdout:starting mds.a at 2023-06-10T19:04:53.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:53.488+0000 7f2da3095640 1 Processor -- start 2023-06-10T19:04:53.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:53.488+0000 7f2da3095640 1 -- start start 2023-06-10T19:04:53.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:53.492+0000 7f2da3095640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2d9c15eef0 0x7f2d9c070f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:53.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:53.492+0000 7f2da3095640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d9c15f2c0 con 0x7f2d9c069450 2023-06-10T19:04:53.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:53.492+0000 7f2da3095640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d9c15fdc0 con 0x7f2d9c15f570 2023-06-10T19:04:53.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:53.492+0000 7f2da3095640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d9c1600a0 con 0x7f2d9c15eef0 2023-06-10T19:04:53.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:53.492+0000 7f2da0e31640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2d9c15eef0 0x7f2d9c070f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:53.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:53.492+0000 7f2da1632640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f2d9c069450 0x7f2d9c069850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:40890/0 (socket says 172.21.15.53:40890) 2023-06-10T19:04:53.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:53.492+0000 7f2da1632640 1 -- 172.21.15.53:0/4094802440 learned_addr learned my addr 172.21.15.53:0/4094802440 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:04:53.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:53.492+0000 7f2da0e31640 1 -- 172.21.15.53:0/4094802440 >> v1:172.21.15.117:6789/0 conn(0x7f2d9c15f570 legacy=0x7f2d9c0ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:53.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:53.492+0000 7f2da0e31640 1 -- 172.21.15.53:0/4094802440 >> v1:172.21.15.53:6789/0 conn(0x7f2d9c069450 legacy=0x7f2d9c069850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:53.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:53.492+0000 7f2da0e31640 1 -- 172.21.15.53:0/4094802440 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d9c160380 con 0x7f2d9c15eef0 2023-06-10T19:04:53.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:53.492+0000 7f2d9b7fe640 1 -- 172.21.15.53:0/4094802440 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3976244598 0 0) 0x7f2d9c15f2c0 con 0x7f2d9c069450 2023-06-10T19:04:53.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:53.492+0000 7f2da0e31640 1 --2- 172.21.15.53:0/4094802440 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d9c15eef0 0x7f2d9c070f80 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c0097c0 tx=0x7f2d8c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a84c5ca1397be35c server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:53.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:53.492+0000 7f2d9b7fe640 1 -- 172.21.15.53:0/4094802440 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8c004230 con 0x7f2d9c15eef0 2023-06-10T19:04:53.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:53.492+0000 7f2d9b7fe640 1 -- 172.21.15.53:0/4094802440 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d8c0a7050 con 0x7f2d9c15eef0 2023-06-10T19:04:53.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:53.492+0000 7f2d9b7fe640 1 -- 172.21.15.53:0/4094802440 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8c003620 con 0x7f2d9c15eef0 2023-06-10T19:04:53.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:53.496+0000 7f2da3095640 1 -- 172.21.15.53:0/4094802440 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d9c15eef0 msgr2=0x7f2d9c070f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:53.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:53.496+0000 7f2da3095640 1 --2- 172.21.15.53:0/4094802440 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d9c15eef0 0x7f2d9c070f80 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c0097c0 tx=0x7f2d8c01c480 comp rx=0 tx=0).stop 2023-06-10T19:04:53.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:53.496+0000 7f2da3095640 1 -- 172.21.15.53:0/4094802440 shutdown_connections 2023-06-10T19:04:53.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:53.496+0000 7f2da3095640 1 --2- 172.21.15.53:0/4094802440 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d9c15eef0 0x7f2d9c070f80 unknown :-1 s=CLOSED pgs=1827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:53.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:53.496+0000 7f2da3095640 1 -- 172.21.15.53:0/4094802440 >> 172.21.15.53:0/4094802440 conn(0x7f2d9c06a560 msgr2=0x7f2d9c06a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:04:53.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:53.496+0000 7f2da3095640 1 -- 172.21.15.53:0/4094802440 shutdown_connections 2023-06-10T19:04:53.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:53.496+0000 7f2da3095640 1 -- 172.21.15.53:0/4094802440 wait complete. 2023-06-10T19:04:53.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:53.496+0000 7f2da3095640 1 Processor -- start 2023-06-10T19:04:53.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:53.496+0000 7f2da3095640 1 -- start start 2023-06-10T19:04:53.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:53.496+0000 7f2da3095640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d9c069450 0x7f2d9c155780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:53.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:53.496+0000 7f2da3095640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d9c15eef0 0x7f2d9c1598b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:53.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:53.496+0000 7f2da3095640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d9c15f570 0x7f2d9c159df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:53.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:53.496+0000 7f2da3095640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9c0c51d0 con 0x7f2d9c15f570 2023-06-10T19:04:53.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:53.496+0000 7f2da3095640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9c0b2830 con 0x7f2d9c15eef0 2023-06-10T19:04:53.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:53.496+0000 7f2da3095640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9c0b2b10 con 0x7f2d9c069450 2023-06-10T19:04:53.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:53.496+0000 7f2da1632640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d9c15f570 0x7f2d9c159df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:53.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:53.496+0000 7f2da1632640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d9c15f570 0x7f2d9c159df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37758/0 (socket says 172.21.15.53:37758) 2023-06-10T19:04:53.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:53.496+0000 7f2da1632640 1 -- 172.21.15.53:0/4154584226 learned_addr learned my addr 172.21.15.53:0/4154584226 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:04:53.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:53.496+0000 7f2da0e31640 1 --2- 172.21.15.53:0/4154584226 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d9c069450 0x7f2d9c155780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:53.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:53.496+0000 7f2d9bfff640 1 --2- 172.21.15.53:0/4154584226 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d9c15eef0 0x7f2d9c1598b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:53.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:53.496+0000 7f2da1632640 1 -- 172.21.15.53:0/4154584226 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d9c069450 msgr2=0x7f2d9c155780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:53.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:53.496+0000 7f2da1632640 1 --2- 172.21.15.53:0/4154584226 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d9c069450 0x7f2d9c155780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:53.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:53.496+0000 7f2da1632640 1 -- 172.21.15.53:0/4154584226 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d9c15eef0 msgr2=0x7f2d9c1598b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:53.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:53.496+0000 7f2da1632640 1 --2- 172.21.15.53:0/4154584226 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d9c15eef0 0x7f2d9c1598b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:53.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:53.496+0000 7f2da1632640 1 -- 172.21.15.53:0/4154584226 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d8c009420 con 0x7f2d9c15f570 2023-06-10T19:04:53.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:53.496+0000 7f2da1632640 1 --2- 172.21.15.53:0/4154584226 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d9c15f570 0x7f2d9c159df0 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7f2d9400c780 tx=0x7f2d9400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:53.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:53.496+0000 7f2d997fa640 1 -- 172.21.15.53:0/4154584226 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d9400ce90 con 0x7f2d9c15f570 2023-06-10T19:04:53.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:53.496+0000 7f2d997fa640 1 -- 172.21.15.53:0/4154584226 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d9400a640 con 0x7f2d9c15f570 2023-06-10T19:04:53.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:53.496+0000 7f2da3095640 1 -- 172.21.15.53:0/4154584226 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d9c0b2df0 con 0x7f2d9c15f570 2023-06-10T19:04:53.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:53.496+0000 7f2d997fa640 1 -- 172.21.15.53:0/4154584226 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d9400a9d0 con 0x7f2d9c15f570 2023-06-10T19:04:53.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:53.496+0000 7f2da3095640 1 -- 172.21.15.53:0/4154584226 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d9c1f4750 con 0x7f2d9c15f570 2023-06-10T19:04:53.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:53.500+0000 7f2da3095640 1 -- 172.21.15.53:0/4154584226 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d9c1f4d30 con 0x7f2d9c15f570 2023-06-10T19:04:53.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:53.500+0000 7f2d997fa640 1 -- 172.21.15.53:0/4154584226 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2d9400ab30 con 0x7f2d9c15f570 2023-06-10T19:04:53.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:53.500+0000 7f2d997fa640 1 --2- 172.21.15.53:0/4154584226 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2d88066280 0x7f2d88068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:53.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:53.500+0000 7f2d997fa640 1 -- 172.21.15.53:0/4154584226 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6278+0+0 (secure 0 0 0) 0x7f2d940834f0 con 0x7f2d9c15f570 2023-06-10T19:04:53.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:53.500+0000 7f2da0e31640 1 --2- 172.21.15.53:0/4154584226 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2d88066280 0x7f2d88068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:53.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:53.500+0000 7f2da0e31640 1 --2- 172.21.15.53:0/4154584226 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2d88066280 0x7f2d88068730 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c0ad000 tx=0x7f2d8c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:53.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:53.504+0000 7f2d997fa640 1 -- 172.21.15.53:0/4154584226 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2d94050870 con 0x7f2d9c15f570 2023-06-10T19:04:53.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:53.688+0000 7f2da3095640 1 -- 172.21.15.53:0/4154584226 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f2d9c1f4d30 con 0x7f2d9c15f570 2023-06-10T19:04:54.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.344+0000 7f2d997fa640 1 -- 172.21.15.53:0/4154584226 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v65) v1 ==== 104+0+0 (secure 0 0 0) 0x7f2d9c1f4d30 con 0x7f2d9c15f570 2023-06-10T19:04:54.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.348+0000 7f2da3095640 1 -- 172.21.15.53:0/4154584226 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2d88066280 msgr2=0x7f2d88068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:54.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.348+0000 7f2da3095640 1 --2- 172.21.15.53:0/4154584226 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2d88066280 0x7f2d88068730 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c0ad000 tx=0x7f2d8c008040 comp rx=0 tx=0).stop 2023-06-10T19:04:54.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.348+0000 7f2da3095640 1 -- 172.21.15.53:0/4154584226 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d9c15f570 msgr2=0x7f2d9c159df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:54.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.348+0000 7f2da3095640 1 --2- 172.21.15.53:0/4154584226 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d9c15f570 0x7f2d9c159df0 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7f2d9400c780 tx=0x7f2d9400cc40 comp rx=0 tx=0).stop 2023-06-10T19:04:54.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.348+0000 7f2da3095640 1 -- 172.21.15.53:0/4154584226 shutdown_connections 2023-06-10T19:04:54.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.348+0000 7f2da3095640 1 --2- 172.21.15.53:0/4154584226 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2d88066280 0x7f2d88068730 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:54.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.348+0000 7f2da3095640 1 --2- 172.21.15.53:0/4154584226 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d9c15f570 0x7f2d9c159df0 unknown :-1 s=CLOSED pgs=1828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:54.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.348+0000 7f2da3095640 1 --2- 172.21.15.53:0/4154584226 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d9c15eef0 0x7f2d9c1598b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:54.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.348+0000 7f2da3095640 1 --2- 172.21.15.53:0/4154584226 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d9c069450 0x7f2d9c155780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:54.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.348+0000 7f2da3095640 1 -- 172.21.15.53:0/4154584226 >> 172.21.15.53:0/4154584226 conn(0x7f2d9c06a560 msgr2=0x7f2d9c0c61b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:04:54.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.348+0000 7f2da3095640 1 -- 172.21.15.53:0/4154584226 shutdown_connections 2023-06-10T19:04:54.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.348+0000 7f2da3095640 1 -- 172.21.15.53:0/4154584226 wait complete. 2023-06-10T19:04:54.675 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-06-10T19:04:54.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.848+0000 7f693de9a640 1 Processor -- start 2023-06-10T19:04:54.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.848+0000 7f693de9a640 1 -- start start 2023-06-10T19:04:54.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.852+0000 7f693de9a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f69380aff40 0x7f6938164560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:54.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.852+0000 7f693de9a640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6938159d10 con 0x7f6938159940 2023-06-10T19:04:54.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.852+0000 7f693de9a640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f693806b100 con 0x7f69380ca220 2023-06-10T19:04:54.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.852+0000 7f693de9a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f693806bc80 con 0x7f69380aff40 2023-06-10T19:04:54.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.852+0000 7f69377fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f6938159940 0x7f69380c9b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:40896/0 (socket says 172.21.15.53:40896) 2023-06-10T19:04:54.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.852+0000 7f69377fe640 1 -- 172.21.15.53:0/2570870078 learned_addr learned my addr 172.21.15.53:0/2570870078 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:04:54.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.852+0000 7f6937fff640 1 --2- 172.21.15.53:0/2570870078 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f69380aff40 0x7f6938164560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:54.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.852+0000 7f69367fc640 1 -- 172.21.15.53:0/2570870078 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3368347105 0 0) 0x7f6938159d10 con 0x7f6938159940 2023-06-10T19:04:54.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.852+0000 7f69367fc640 1 -- 172.21.15.53:0/2570870078 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6920003530 con 0x7f6938159940 2023-06-10T19:04:54.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.852+0000 7f69367fc640 1 -- 172.21.15.53:0/2570870078 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1554770035 0 0) 0x7f6920003530 con 0x7f6938159940 2023-06-10T19:04:54.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.852+0000 7f69367fc640 1 -- 172.21.15.53:0/2570870078 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f69380aff40 msgr2=0x7f6938164560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:04:54.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.852+0000 7f69367fc640 1 --2- 172.21.15.53:0/2570870078 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f69380aff40 0x7f6938164560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:54.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.852+0000 7f69367fc640 1 -- 172.21.15.53:0/2570870078 >> v1:172.21.15.117:6789/0 conn(0x7f69380ca220 legacy=0x7f69380af830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:54.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.852+0000 7f69367fc640 1 -- 172.21.15.53:0/2570870078 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f693806c110 con 0x7f6938159940 2023-06-10T19:04:54.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.852+0000 7f69367fc640 1 -- 172.21.15.53:0/2570870078 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f6928001680 con 0x7f6938159940 2023-06-10T19:04:54.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.852+0000 7f69367fc640 1 -- 172.21.15.53:0/2570870078 >> v1:172.21.15.53:6789/0 conn(0x7f6938159940 legacy=0x7f69380c9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:54.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.852+0000 7f69367fc640 1 --2- 172.21.15.53:0/2570870078 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f69380aff40 0x7f69200039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:54.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.852+0000 7f69367fc640 1 --2- 172.21.15.53:0/2570870078 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6920003f30 0x7f69200047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:54.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.852+0000 7f69367fc640 1 --2- 172.21.15.53:0/2570870078 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6920004d10 0x7f6920005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:54.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.852+0000 7f69367fc640 1 -- 172.21.15.53:0/2570870078 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f693806bc80 con 0x7f6920004d10 2023-06-10T19:04:54.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.852+0000 7f69367fc640 1 -- 172.21.15.53:0/2570870078 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f692000bb20 con 0x7f6920003f30 2023-06-10T19:04:54.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.852+0000 7f69367fc640 1 -- 172.21.15.53:0/2570870078 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f692000bce0 con 0x7f69380aff40 2023-06-10T19:04:54.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.852+0000 7f6937fff640 1 --2- 172.21.15.53:0/2570870078 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6920004d10 0x7f6920005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:54.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.852+0000 7f69377fe640 1 --2- 172.21.15.53:0/2570870078 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f69380aff40 0x7f69200039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:54.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.852+0000 7f6936ffd640 1 --2- 172.21.15.53:0/2570870078 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6920003f30 0x7f69200047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:54.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.852+0000 7f6937fff640 1 -- 172.21.15.53:0/2570870078 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f69380aff40 msgr2=0x7f69200039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:04:54.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.852+0000 7f6937fff640 1 --2- 172.21.15.53:0/2570870078 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f69380aff40 0x7f69200039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:54.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.852+0000 7f6937fff640 1 -- 172.21.15.53:0/2570870078 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6920003f30 msgr2=0x7f69200047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:04:54.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.852+0000 7f6937fff640 1 --2- 172.21.15.53:0/2570870078 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6920003f30 0x7f69200047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:54.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.852+0000 7f6937fff640 1 -- 172.21.15.53:0/2570870078 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6920003530 con 0x7f6920004d10 2023-06-10T19:04:54.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.852+0000 7f6937fff640 1 --2- 172.21.15.53:0/2570870078 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6920004d10 0x7f6920005180 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7f6930009f70 tx=0x7f693001cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db1e1b293e9d87bf server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:54.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.852+0000 7f69367fc640 1 -- 172.21.15.53:0/2570870078 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69300a5bc0 con 0x7f6920004d10 2023-06-10T19:04:54.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.856+0000 7f69367fc640 1 -- 172.21.15.53:0/2570870078 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f693000f040 con 0x7f6920004d10 2023-06-10T19:04:54.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.856+0000 7f69367fc640 1 -- 172.21.15.53:0/2570870078 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69300ad440 con 0x7f6920004d10 2023-06-10T19:04:54.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.856+0000 7f693de9a640 1 -- 172.21.15.53:0/2570870078 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6920004d10 msgr2=0x7f6920005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:54.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.856+0000 7f693de9a640 1 --2- 172.21.15.53:0/2570870078 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6920004d10 0x7f6920005180 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7f6930009f70 tx=0x7f693001cc00 comp rx=0 tx=0).stop 2023-06-10T19:04:54.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.856+0000 7f6937fff640 1 -- 172.21.15.53:0/2570870078 reap_dead start 2023-06-10T19:04:54.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.856+0000 7f693de9a640 1 -- 172.21.15.53:0/2570870078 shutdown_connections 2023-06-10T19:04:54.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.856+0000 7f693de9a640 1 -- 172.21.15.53:0/2570870078 >> 172.21.15.53:0/2570870078 conn(0x7f69380ca830 msgr2=0x7f69380cac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:04:54.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.856+0000 7f693de9a640 1 -- 172.21.15.53:0/2570870078 shutdown_connections 2023-06-10T19:04:54.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.856+0000 7f693de9a640 1 -- 172.21.15.53:0/2570870078 wait complete. 2023-06-10T19:04:54.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.856+0000 7f693de9a640 1 Processor -- start 2023-06-10T19:04:54.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.856+0000 7f693de9a640 1 -- start start 2023-06-10T19:04:54.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.856+0000 7f693de9a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6938149b80 0x7f693815a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:54.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.856+0000 7f693de9a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6938149f50 0x7f693815a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:54.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.856+0000 7f693de9a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f693814cf30 0x7f693814d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:54.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.856+0000 7f693de9a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69381579d0 con 0x7f693814cf30 2023-06-10T19:04:54.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.856+0000 7f693de9a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f693814acf0 con 0x7f6938149f50 2023-06-10T19:04:54.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.856+0000 7f693de9a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f693814b870 con 0x7f6938149b80 2023-06-10T19:04:54.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.856+0000 7f6937fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f693814cf30 0x7f693814d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:54.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.856+0000 7f6937fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f693814cf30 0x7f693814d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37774/0 (socket says 172.21.15.53:37774) 2023-06-10T19:04:54.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.856+0000 7f6937fff640 1 -- 172.21.15.53:0/161336735 learned_addr learned my addr 172.21.15.53:0/161336735 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:04:54.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.856+0000 7f69377fe640 1 --2- 172.21.15.53:0/161336735 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6938149b80 0x7f693815a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:54.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.856+0000 7f6936ffd640 1 --2- 172.21.15.53:0/161336735 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6938149f50 0x7f693815a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:54.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.856+0000 7f6937fff640 1 -- 172.21.15.53:0/161336735 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6938149b80 msgr2=0x7f693815a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:54.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.856+0000 7f6937fff640 1 --2- 172.21.15.53:0/161336735 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6938149b80 0x7f693815a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:54.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.856+0000 7f6937fff640 1 -- 172.21.15.53:0/161336735 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6938149f50 msgr2=0x7f693815a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:54.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.856+0000 7f6937fff640 1 --2- 172.21.15.53:0/161336735 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6938149f50 0x7f693815a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:54.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.856+0000 7f6937fff640 1 -- 172.21.15.53:0/161336735 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f693814af40 con 0x7f693814cf30 2023-06-10T19:04:54.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.856+0000 7f69377fe640 1 --2- 172.21.15.53:0/161336735 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6938149b80 0x7f693815a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:04:54.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.856+0000 7f6937fff640 1 --2- 172.21.15.53:0/161336735 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f693814cf30 0x7f693814d3d0 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7f6930002240 tx=0x7f6930009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:54.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.856+0000 7f691ffff640 1 -- 172.21.15.53:0/161336735 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69300bd070 con 0x7f693814cf30 2023-06-10T19:04:54.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.856+0000 7f691ffff640 1 -- 172.21.15.53:0/161336735 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69300ad880 con 0x7f693814cf30 2023-06-10T19:04:54.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.856+0000 7f693de9a640 1 -- 172.21.15.53:0/161336735 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f693814b220 con 0x7f693814cf30 2023-06-10T19:04:54.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.856+0000 7f691ffff640 1 -- 172.21.15.53:0/161336735 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6930009490 con 0x7f693814cf30 2023-06-10T19:04:54.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.856+0000 7f693de9a640 1 -- 172.21.15.53:0/161336735 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f693814d910 con 0x7f693814cf30 2023-06-10T19:04:54.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.860+0000 7f693de9a640 1 -- 172.21.15.53:0/161336735 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f693804d790 con 0x7f693814cf30 2023-06-10T19:04:54.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.860+0000 7f691ffff640 1 -- 172.21.15.53:0/161336735 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f69300b4040 con 0x7f693814cf30 2023-06-10T19:04:54.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.860+0000 7f691ffff640 1 --2- 172.21.15.53:0/161336735 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f69240662b0 0x7f6924068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:54.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.860+0000 7f691ffff640 1 -- 172.21.15.53:0/161336735 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6278+0+0 (secure 0 0 0) 0x7f693011e150 con 0x7f693814cf30 2023-06-10T19:04:54.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.860+0000 7f69377fe640 1 --2- 172.21.15.53:0/161336735 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f69240662b0 0x7f6924068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:54.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.860+0000 7f69377fe640 1 --2- 172.21.15.53:0/161336735 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f69240662b0 0x7f6924068760 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f6928001060 tx=0x7f6928009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:54.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:54.864+0000 7f691ffff640 1 -- 172.21.15.53:0/161336735 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f69300eb4f0 con 0x7f693814cf30 2023-06-10T19:04:55.022 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:55.016+0000 7f693de9a640 1 -- 172.21.15.53:0/161336735 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f693814b9b0 con 0x7f693814cf30 2023-06-10T19:04:55.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:55.420+0000 7f691ffff640 1 -- 172.21.15.53:0/161336735 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v115) v1 ==== 181+0+0 (secure 0 0 0) 0x7f69300eeb10 con 0x7f693814cf30 2023-06-10T19:04:55.427 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_metadata' removed 2023-06-10T19:04:55.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:55.424+0000 7f693de9a640 1 -- 172.21.15.53:0/161336735 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f69240662b0 msgr2=0x7f6924068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:55.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:55.424+0000 7f693de9a640 1 --2- 172.21.15.53:0/161336735 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f69240662b0 0x7f6924068760 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f6928001060 tx=0x7f6928009040 comp rx=0 tx=0).stop 2023-06-10T19:04:55.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:55.424+0000 7f693de9a640 1 -- 172.21.15.53:0/161336735 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f693814cf30 msgr2=0x7f693814d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:55.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:55.424+0000 7f693de9a640 1 --2- 172.21.15.53:0/161336735 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f693814cf30 0x7f693814d3d0 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7f6930002240 tx=0x7f6930009750 comp rx=0 tx=0).stop 2023-06-10T19:04:55.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:55.428+0000 7f693de9a640 1 -- 172.21.15.53:0/161336735 shutdown_connections 2023-06-10T19:04:55.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:55.428+0000 7f693de9a640 1 --2- 172.21.15.53:0/161336735 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f69240662b0 0x7f6924068760 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:55.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:55.428+0000 7f693de9a640 1 --2- 172.21.15.53:0/161336735 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f693814cf30 0x7f693814d3d0 unknown :-1 s=CLOSED pgs=1831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:55.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:55.428+0000 7f693de9a640 1 --2- 172.21.15.53:0/161336735 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6938149f50 0x7f693815a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:55.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:55.428+0000 7f693de9a640 1 --2- 172.21.15.53:0/161336735 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6938149b80 0x7f693815a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:55.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:55.428+0000 7f693de9a640 1 -- 172.21.15.53:0/161336735 >> 172.21.15.53:0/161336735 conn(0x7f69380ca830 msgr2=0x7f6938158710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:04:55.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:55.428+0000 7f693de9a640 1 -- 172.21.15.53:0/161336735 shutdown_connections 2023-06-10T19:04:55.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:55.428+0000 7f693de9a640 1 -- 172.21.15.53:0/161336735 wait complete. 2023-06-10T19:04:55.459 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-06-10T19:04:55.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:55.596+0000 7f98b4bef640 1 Processor -- start 2023-06-10T19:04:55.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:55.596+0000 7f98b4bef640 1 -- start start 2023-06-10T19:04:55.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:55.596+0000 7f98b4bef640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f98b015d0b0 0x7f98b00c8e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:55.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:55.596+0000 7f98b4bef640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f98b0158bc0 0x7f98b00cbe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:55.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:55.596+0000 7f98b4bef640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98b0159120 con 0x7f98b006c210 2023-06-10T19:04:55.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:55.596+0000 7f98b4bef640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98b0159400 con 0x7f98b015d0b0 2023-06-10T19:04:55.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:55.596+0000 7f98b4bef640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98b01596e0 con 0x7f98b0158bc0 2023-06-10T19:04:55.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:55.596+0000 7f98add9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f98b015d0b0 0x7f98b00c8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:55.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:55.596+0000 7f98add9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f98b015d0b0 0x7f98b00c8e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37784/0 (socket says 172.21.15.53:37784) 2023-06-10T19:04:55.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:55.596+0000 7f98add9b640 1 -- 172.21.15.53:0/1808776910 learned_addr learned my addr 172.21.15.53:0/1808776910 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:04:55.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:55.596+0000 7f98aed9d640 1 --2- 172.21.15.53:0/1808776910 >> v2:172.21.15.117:3300/0 conn(0x7f98b0158bc0 0x7f98b00cbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:55.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:55.596+0000 7f98add9b640 1 -- 172.21.15.53:0/1808776910 >> v2:172.21.15.117:3300/0 conn(0x7f98b0158bc0 msgr2=0x7f98b00cbe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:04:55.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:55.596+0000 7f98add9b640 1 --2- 172.21.15.53:0/1808776910 >> v2:172.21.15.117:3300/0 conn(0x7f98b0158bc0 0x7f98b00cbe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:55.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:55.596+0000 7f98add9b640 1 -- 172.21.15.53:0/1808776910 >> v1:172.21.15.117:6789/0 conn(0x7f98b006c210 legacy=0x7f98b006c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:04:55.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:55.596+0000 7f98add9b640 1 -- 172.21.15.53:0/1808776910 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98b01599c0 con 0x7f98b015d0b0 2023-06-10T19:04:55.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:55.600+0000 7f98add9b640 1 --2- 172.21.15.53:0/1808776910 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98b015d0b0 0x7f98b00c8e10 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7f98b006eb80 tx=0x7f98a401c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=191964ae3fdcc157 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:55.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:55.600+0000 7f98ad59a640 1 -- 172.21.15.53:0/1808776910 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a40aa640 con 0x7f98b015d0b0 2023-06-10T19:04:55.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:55.600+0000 7f98ad59a640 1 -- 172.21.15.53:0/1808776910 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98a40aa7a0 con 0x7f98b015d0b0 2023-06-10T19:04:55.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:55.600+0000 7f98ad59a640 1 -- 172.21.15.53:0/1808776910 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a40aab30 con 0x7f98b015d0b0 2023-06-10T19:04:55.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:55.600+0000 7f98b4bef640 1 -- 172.21.15.53:0/1808776910 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98b015d0b0 msgr2=0x7f98b00c8e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:55.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:55.600+0000 7f98b4bef640 1 --2- 172.21.15.53:0/1808776910 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98b015d0b0 0x7f98b00c8e10 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7f98b006eb80 tx=0x7f98a401c4c0 comp rx=0 tx=0).stop 2023-06-10T19:04:55.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:55.600+0000 7f98b4bef640 1 -- 172.21.15.53:0/1808776910 shutdown_connections 2023-06-10T19:04:55.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:55.600+0000 7f98b4bef640 1 --2- 172.21.15.53:0/1808776910 >> v2:172.21.15.117:3300/0 conn(0x7f98b0158bc0 0x7f98b00cbe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:55.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:55.600+0000 7f98b4bef640 1 --2- 172.21.15.53:0/1808776910 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98b015d0b0 0x7f98b00c8e10 unknown :-1 s=CLOSED pgs=1832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:55.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:55.600+0000 7f98b4bef640 1 -- 172.21.15.53:0/1808776910 >> 172.21.15.53:0/1808776910 conn(0x7f98b00ca830 msgr2=0x7f98b00cac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:04:55.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:55.600+0000 7f98b4bef640 1 -- 172.21.15.53:0/1808776910 shutdown_connections 2023-06-10T19:04:55.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:55.600+0000 7f98b4bef640 1 -- 172.21.15.53:0/1808776910 wait complete. 2023-06-10T19:04:55.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:55.600+0000 7f98b4bef640 1 Processor -- start 2023-06-10T19:04:55.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:55.600+0000 7f98b4bef640 1 -- start start 2023-06-10T19:04:55.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:55.600+0000 7f98b4bef640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98b006c210 0x7f98b00c18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:55.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:55.600+0000 7f98b4bef640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98b0158bc0 0x7f98b00afea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:55.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:55.600+0000 7f98b4bef640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98b015d0b0 0x7f98b00ae920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:55.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:55.600+0000 7f98b4bef640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98b00b03e0 con 0x7f98b015d0b0 2023-06-10T19:04:55.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:55.600+0000 7f98b4bef640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98b00aee60 con 0x7f98b0158bc0 2023-06-10T19:04:55.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:55.600+0000 7f98b4bef640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98b00adb60 con 0x7f98b006c210 2023-06-10T19:04:55.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:55.600+0000 7f98aed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98b015d0b0 0x7f98b00ae920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:55.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:55.600+0000 7f98aed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98b015d0b0 0x7f98b00ae920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37796/0 (socket says 172.21.15.53:37796) 2023-06-10T19:04:55.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:55.600+0000 7f98aed9d640 1 -- 172.21.15.53:0/4245314296 learned_addr learned my addr 172.21.15.53:0/4245314296 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:04:55.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:55.600+0000 7f98ae59c640 1 --2- 172.21.15.53:0/4245314296 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98b006c210 0x7f98b00c18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:55.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:55.600+0000 7f98add9b640 1 --2- 172.21.15.53:0/4245314296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98b0158bc0 0x7f98b00afea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:55.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:55.600+0000 7f98aed9d640 1 -- 172.21.15.53:0/4245314296 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98b006c210 msgr2=0x7f98b00c18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:55.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:55.600+0000 7f98aed9d640 1 --2- 172.21.15.53:0/4245314296 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98b006c210 0x7f98b00c18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:55.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:55.600+0000 7f98aed9d640 1 -- 172.21.15.53:0/4245314296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98b0158bc0 msgr2=0x7f98b00afea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:55.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:55.600+0000 7f98aed9d640 1 --2- 172.21.15.53:0/4245314296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98b0158bc0 0x7f98b00afea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:55.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:55.600+0000 7f98aed9d640 1 -- 172.21.15.53:0/4245314296 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98a40094d0 con 0x7f98b015d0b0 2023-06-10T19:04:55.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:55.600+0000 7f98add9b640 1 --2- 172.21.15.53:0/4245314296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98b0158bc0 0x7f98b00afea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:04:55.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:55.600+0000 7f98aed9d640 1 --2- 172.21.15.53:0/4245314296 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98b015d0b0 0x7f98b00ae920 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7f98a800d800 tx=0x7f98a800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:55.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:55.600+0000 7f989effd640 1 -- 172.21.15.53:0/4245314296 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a800b6c0 con 0x7f98b015d0b0 2023-06-10T19:04:55.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:55.600+0000 7f989effd640 1 -- 172.21.15.53:0/4245314296 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98a800b820 con 0x7f98b015d0b0 2023-06-10T19:04:55.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:55.600+0000 7f98b4bef640 1 -- 172.21.15.53:0/4245314296 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98b00ade40 con 0x7f98b015d0b0 2023-06-10T19:04:55.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:55.600+0000 7f989effd640 1 -- 172.21.15.53:0/4245314296 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a800bbd0 con 0x7f98b015d0b0 2023-06-10T19:04:55.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:55.604+0000 7f98b4bef640 1 -- 172.21.15.53:0/4245314296 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98b00ae400 con 0x7f98b015d0b0 2023-06-10T19:04:55.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:55.604+0000 7f98b4bef640 1 -- 172.21.15.53:0/4245314296 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98b0157620 con 0x7f98b015d0b0 2023-06-10T19:04:55.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:55.604+0000 7f989effd640 1 -- 172.21.15.53:0/4245314296 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f98a800bd30 con 0x7f98b015d0b0 2023-06-10T19:04:55.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:55.604+0000 7f989effd640 1 --2- 172.21.15.53:0/4245314296 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f98900662b0 0x7f9890068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:55.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:55.604+0000 7f989effd640 1 -- 172.21.15.53:0/4245314296 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5840+0+0 (secure 0 0 0) 0x7f98a8084100 con 0x7f98b015d0b0 2023-06-10T19:04:55.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:55.604+0000 7f98ae59c640 1 --2- 172.21.15.53:0/4245314296 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f98900662b0 0x7f9890068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:55.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:55.604+0000 7f98ae59c640 1 --2- 172.21.15.53:0/4245314296 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f98900662b0 0x7f9890068760 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f98a0009f20 tx=0x7f98a00094d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:55.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:55.608+0000 7f989effd640 1 -- 172.21.15.53:0/4245314296 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f98a80516f0 con 0x7f98b015d0b0 2023-06-10T19:04:55.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:55.760+0000 7f98b4bef640 1 -- 172.21.15.53:0/4245314296 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f98b00ae5f0 con 0x7f98b015d0b0 2023-06-10T19:04:56.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.436+0000 7f989effd640 1 -- 172.21.15.53:0/4245314296 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v116) v1 ==== 169+0+0 (secure 0 0 0) 0x7f98a8054d10 con 0x7f98b015d0b0 2023-06-10T19:04:56.451 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_data' removed 2023-06-10T19:04:56.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.452+0000 7f98b4bef640 1 -- 172.21.15.53:0/4245314296 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f98900662b0 msgr2=0x7f9890068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:56.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.452+0000 7f98b4bef640 1 --2- 172.21.15.53:0/4245314296 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f98900662b0 0x7f9890068760 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f98a0009f20 tx=0x7f98a00094d0 comp rx=0 tx=0).stop 2023-06-10T19:04:56.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.452+0000 7f98b4bef640 1 -- 172.21.15.53:0/4245314296 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98b015d0b0 msgr2=0x7f98b00ae920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:56.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.452+0000 7f98b4bef640 1 --2- 172.21.15.53:0/4245314296 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98b015d0b0 0x7f98b00ae920 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7f98a800d800 tx=0x7f98a800dcc0 comp rx=0 tx=0).stop 2023-06-10T19:04:56.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.452+0000 7f98b4bef640 1 -- 172.21.15.53:0/4245314296 shutdown_connections 2023-06-10T19:04:56.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.452+0000 7f98b4bef640 1 --2- 172.21.15.53:0/4245314296 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f98900662b0 0x7f9890068760 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:56.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.452+0000 7f98b4bef640 1 --2- 172.21.15.53:0/4245314296 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98b015d0b0 0x7f98b00ae920 unknown :-1 s=CLOSED pgs=1833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:56.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.452+0000 7f98b4bef640 1 --2- 172.21.15.53:0/4245314296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98b0158bc0 0x7f98b00afea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:56.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.452+0000 7f98b4bef640 1 --2- 172.21.15.53:0/4245314296 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98b006c210 0x7f98b00c18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:56.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.452+0000 7f98b4bef640 1 -- 172.21.15.53:0/4245314296 >> 172.21.15.53:0/4245314296 conn(0x7f98b00ca830 msgr2=0x7f98b0159ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:04:56.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.452+0000 7f98b4bef640 1 -- 172.21.15.53:0/4245314296 shutdown_connections 2023-06-10T19:04:56.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.456+0000 7f98b4bef640 1 -- 172.21.15.53:0/4245314296 wait complete. 2023-06-10T19:04:56.486 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-06-10T19:04:56.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.612+0000 7fa8e91a1640 1 Processor -- start 2023-06-10T19:04:56.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.612+0000 7fa8e91a1640 1 -- start start 2023-06-10T19:04:56.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.612+0000 7fa8e91a1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa8e406eca0 0x7fa8e406f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:56.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.612+0000 7fa8e91a1640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa8e40af0e0 0x7fa8e415f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:56.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.612+0000 7fa8e91a1640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8e40ccda0 con 0x7fa8e415fc40 2023-06-10T19:04:56.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.612+0000 7fa8e91a1640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8e406f5b0 con 0x7fa8e40af0e0 2023-06-10T19:04:56.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.612+0000 7fa8e91a1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e406a920 con 0x7fa8e406eca0 2023-06-10T19:04:56.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.612+0000 7fa8dbfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa8e40af0e0 0x7fa8e415f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:56.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.612+0000 7fa8dbfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa8e40af0e0 0x7fa8e415f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37812/0 (socket says 172.21.15.53:37812) 2023-06-10T19:04:56.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.612+0000 7fa8e359e640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fa8e415fc40 0x7fa8e40ced80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:40906/0 (socket says 172.21.15.53:40906) 2023-06-10T19:04:56.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.612+0000 7fa8dbfff640 1 -- 172.21.15.53:0/1400203969 learned_addr learned my addr 172.21.15.53:0/1400203969 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:04:56.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.612+0000 7fa8e2d9d640 1 --2- 172.21.15.53:0/1400203969 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa8e406eca0 0x7fa8e406f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:56.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.612+0000 7fa8dbfff640 1 -- 172.21.15.53:0/1400203969 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa8e406eca0 msgr2=0x7fa8e406f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:04:56.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.612+0000 7fa8dbfff640 1 --2- 172.21.15.53:0/1400203969 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa8e406eca0 0x7fa8e406f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:56.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.612+0000 7fa8dbfff640 1 -- 172.21.15.53:0/1400203969 >> v1:172.21.15.53:6789/0 conn(0x7fa8e415fc40 legacy=0x7fa8e40ced80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:56.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.612+0000 7fa8dbfff640 1 -- 172.21.15.53:0/1400203969 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8e406ac00 con 0x7fa8e40af0e0 2023-06-10T19:04:56.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.616+0000 7fa8dbfff640 1 --2- 172.21.15.53:0/1400203969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8e40af0e0 0x7fa8e415f700 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc009870 tx=0x7fa8cc01ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92dab8565f8feeaf server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:56.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.616+0000 7fa8e259c640 1 -- 172.21.15.53:0/1400203969 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8cc0a8a30 con 0x7fa8e40af0e0 2023-06-10T19:04:56.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.616+0000 7fa8e259c640 1 -- 172.21.15.53:0/1400203969 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8cc0a8b90 con 0x7fa8e40af0e0 2023-06-10T19:04:56.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.616+0000 7fa8e259c640 1 -- 172.21.15.53:0/1400203969 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8cc0b0440 con 0x7fa8e40af0e0 2023-06-10T19:04:56.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.616+0000 7fa8e91a1640 1 -- 172.21.15.53:0/1400203969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8e40af0e0 msgr2=0x7fa8e415f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:56.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.616+0000 7fa8e91a1640 1 --2- 172.21.15.53:0/1400203969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8e40af0e0 0x7fa8e415f700 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc009870 tx=0x7fa8cc01ed30 comp rx=0 tx=0).stop 2023-06-10T19:04:56.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.616+0000 7fa8e91a1640 1 -- 172.21.15.53:0/1400203969 shutdown_connections 2023-06-10T19:04:56.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.616+0000 7fa8e91a1640 1 --2- 172.21.15.53:0/1400203969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8e40af0e0 0x7fa8e415f700 unknown :-1 s=CLOSED pgs=1835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:56.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.616+0000 7fa8e91a1640 1 --2- 172.21.15.53:0/1400203969 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa8e406eca0 0x7fa8e406f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:56.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.616+0000 7fa8e91a1640 1 -- 172.21.15.53:0/1400203969 >> 172.21.15.53:0/1400203969 conn(0x7fa8e406a0e0 msgr2=0x7fa8e406d270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:04:56.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.616+0000 7fa8e91a1640 1 -- 172.21.15.53:0/1400203969 shutdown_connections 2023-06-10T19:04:56.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.616+0000 7fa8e91a1640 1 -- 172.21.15.53:0/1400203969 wait complete. 2023-06-10T19:04:56.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.616+0000 7fa8e91a1640 1 Processor -- start 2023-06-10T19:04:56.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.616+0000 7fa8e91a1640 1 -- start start 2023-06-10T19:04:56.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.616+0000 7fa8e91a1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa8e406eca0 0x7fa8e40b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:56.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.616+0000 7fa8e91a1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa8e40af0e0 0x7fa8e40b3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:56.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.616+0000 7fa8e91a1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8e415fc40 0x7fa8e40b19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:56.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.616+0000 7fa8e91a1640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e40b4530 con 0x7fa8e415fc40 2023-06-10T19:04:56.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.616+0000 7fa8e91a1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e40b1f30 con 0x7fa8e40af0e0 2023-06-10T19:04:56.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.616+0000 7fa8e91a1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e40b21b0 con 0x7fa8e406eca0 2023-06-10T19:04:56.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.616+0000 7fa8e359e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8e415fc40 0x7fa8e40b19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:56.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.616+0000 7fa8e359e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8e415fc40 0x7fa8e40b19f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37828/0 (socket says 172.21.15.53:37828) 2023-06-10T19:04:56.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.616+0000 7fa8e359e640 1 -- 172.21.15.53:0/3487081110 learned_addr learned my addr 172.21.15.53:0/3487081110 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:04:56.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.616+0000 7fa8e2d9d640 1 --2- 172.21.15.53:0/3487081110 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa8e406eca0 0x7fa8e40b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:56.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.616+0000 7fa8dbfff640 1 --2- 172.21.15.53:0/3487081110 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa8e40af0e0 0x7fa8e40b3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:56.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.616+0000 7fa8e359e640 1 -- 172.21.15.53:0/3487081110 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa8e406eca0 msgr2=0x7fa8e40b4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:56.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.616+0000 7fa8e359e640 1 --2- 172.21.15.53:0/3487081110 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa8e406eca0 0x7fa8e40b4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:56.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.616+0000 7fa8e359e640 1 -- 172.21.15.53:0/3487081110 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa8e40af0e0 msgr2=0x7fa8e40b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:56.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.616+0000 7fa8e359e640 1 --2- 172.21.15.53:0/3487081110 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa8e40af0e0 0x7fa8e40b3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:56.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.616+0000 7fa8e359e640 1 -- 172.21.15.53:0/3487081110 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8cc0094d0 con 0x7fa8e415fc40 2023-06-10T19:04:56.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.616+0000 7fa8e359e640 1 --2- 172.21.15.53:0/3487081110 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8e415fc40 0x7fa8e40b19f0 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc00c700 tx=0x7fa8dc00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:56.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.620+0000 7fa8db7fe640 1 -- 172.21.15.53:0/3487081110 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8dc00ce10 con 0x7fa8e415fc40 2023-06-10T19:04:56.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.620+0000 7fa8db7fe640 1 -- 172.21.15.53:0/3487081110 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8dc00a640 con 0x7fa8e415fc40 2023-06-10T19:04:56.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.620+0000 7fa8db7fe640 1 -- 172.21.15.53:0/3487081110 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8dc00a9b0 con 0x7fa8e415fc40 2023-06-10T19:04:56.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.620+0000 7fa8e91a1640 1 -- 172.21.15.53:0/3487081110 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8e40b2490 con 0x7fa8e415fc40 2023-06-10T19:04:56.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.620+0000 7fa8e91a1640 1 -- 172.21.15.53:0/3487081110 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8e40b37f0 con 0x7fa8e415fc40 2023-06-10T19:04:56.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.620+0000 7fa8e91a1640 1 -- 172.21.15.53:0/3487081110 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8e404d790 con 0x7fa8e415fc40 2023-06-10T19:04:56.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.620+0000 7fa8db7fe640 1 -- 172.21.15.53:0/3487081110 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa8dc00ab10 con 0x7fa8e415fc40 2023-06-10T19:04:56.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.620+0000 7fa8db7fe640 1 --2- 172.21.15.53:0/3487081110 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa8c4066280 0x7fa8c4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:56.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.620+0000 7fa8db7fe640 1 -- 172.21.15.53:0/3487081110 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fa8dc083160 con 0x7fa8e415fc40 2023-06-10T19:04:56.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.620+0000 7fa8e2d9d640 1 --2- 172.21.15.53:0/3487081110 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa8c4066280 0x7fa8c4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:56.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.620+0000 7fa8e2d9d640 1 --2- 172.21.15.53:0/3487081110 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa8c4066280 0x7fa8c4068730 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fa8d400b9d0 tx=0x7fa8d4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:56.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.624+0000 7fa8db7fe640 1 -- 172.21.15.53:0/3487081110 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa8dc0543f0 con 0x7fa8e415fc40 2023-06-10T19:04:56.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.776+0000 7fa8e91a1640 1 -- 172.21.15.53:0/3487081110 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fa8e40c6240 con 0x7fa8e415fc40 2023-06-10T19:04:56.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.784+0000 7fa8db7fe640 1 -- 172.21.15.53:0/3487081110 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa8dc053f80 con 0x7fa8e415fc40 2023-06-10T19:04:56.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.784+0000 7fa8e91a1640 1 -- 172.21.15.53:0/3487081110 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa8c4066280 msgr2=0x7fa8c4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:56.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.784+0000 7fa8e91a1640 1 --2- 172.21.15.53:0/3487081110 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa8c4066280 0x7fa8c4068730 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fa8d400b9d0 tx=0x7fa8d4008040 comp rx=0 tx=0).stop 2023-06-10T19:04:56.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.784+0000 7fa8e91a1640 1 -- 172.21.15.53:0/3487081110 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8e415fc40 msgr2=0x7fa8e40b19f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:56.791 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.784+0000 7fa8e91a1640 1 --2- 172.21.15.53:0/3487081110 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8e415fc40 0x7fa8e40b19f0 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc00c700 tx=0x7fa8dc00cbc0 comp rx=0 tx=0).stop 2023-06-10T19:04:56.791 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.784+0000 7fa8e91a1640 1 -- 172.21.15.53:0/3487081110 shutdown_connections 2023-06-10T19:04:56.791 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.784+0000 7fa8e91a1640 1 --2- 172.21.15.53:0/3487081110 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa8c4066280 0x7fa8c4068730 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:56.791 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.784+0000 7fa8e91a1640 1 --2- 172.21.15.53:0/3487081110 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8e415fc40 0x7fa8e40b19f0 unknown :-1 s=CLOSED pgs=1836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:56.791 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.784+0000 7fa8e91a1640 1 --2- 172.21.15.53:0/3487081110 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa8e40af0e0 0x7fa8e40b3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:56.791 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.784+0000 7fa8e91a1640 1 --2- 172.21.15.53:0/3487081110 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa8e406eca0 0x7fa8e40b4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:56.791 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.784+0000 7fa8e91a1640 1 -- 172.21.15.53:0/3487081110 >> 172.21.15.53:0/3487081110 conn(0x7fa8e406a0e0 msgr2=0x7fa8e406d270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:04:56.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.784+0000 7fa8e91a1640 1 -- 172.21.15.53:0/3487081110 shutdown_connections 2023-06-10T19:04:56.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.784+0000 7fa8e91a1640 1 -- 172.21.15.53:0/3487081110 wait complete. 2023-06-10T19:04:56.808 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_dont_mark_unresponsive_client_stale' 2023-06-10T19:04:56.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.920+0000 7fd7e225b640 1 Processor -- start 2023-06-10T19:04:56.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.920+0000 7fd7e225b640 1 -- start start 2023-06-10T19:04:56.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.924+0000 7fd7e225b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd7dc0c9750 0x7fd7dc0aced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:56.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.924+0000 7fd7e225b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd7dc0afe30 0x7fd7dc0aba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:56.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.924+0000 7fd7e225b640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7dc0ad410 con 0x7fd7dc0cb870 2023-06-10T19:04:56.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.924+0000 7fd7e225b640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7dc0cd990 con 0x7fd7dc0afe30 2023-06-10T19:04:56.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.924+0000 7fd7e225b640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7dc1600d0 con 0x7fd7dc0c9750 2023-06-10T19:04:56.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.924+0000 7fd7dbfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd7dc0afe30 0x7fd7dc0aba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:56.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.924+0000 7fd7daffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fd7dc0cb870 0x7fd7dc0af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:40920/0 (socket says 172.21.15.53:40920) 2023-06-10T19:04:56.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.924+0000 7fd7daffd640 1 -- 172.21.15.53:0/2380489868 learned_addr learned my addr 172.21.15.53:0/2380489868 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:04:56.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.924+0000 7fd7da7fc640 1 -- 172.21.15.53:0/2380489868 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3770504280 0 0) 0x7fd7dc0ad410 con 0x7fd7dc0cb870 2023-06-10T19:04:56.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.924+0000 7fd7db7fe640 1 --2- 172.21.15.53:0/2380489868 >> v2:172.21.15.117:3300/0 conn(0x7fd7dc0c9750 0x7fd7dc0aced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:56.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.924+0000 7fd7da7fc640 1 -- 172.21.15.53:0/2380489868 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7c4003530 con 0x7fd7dc0cb870 2023-06-10T19:04:56.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.924+0000 7fd7dbfff640 1 -- 172.21.15.53:0/2380489868 >> v2:172.21.15.117:3300/0 conn(0x7fd7dc0c9750 msgr2=0x7fd7dc0aced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:04:56.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.924+0000 7fd7dbfff640 1 --2- 172.21.15.53:0/2380489868 >> v2:172.21.15.117:3300/0 conn(0x7fd7dc0c9750 0x7fd7dc0aced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:56.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.924+0000 7fd7dbfff640 1 -- 172.21.15.53:0/2380489868 >> v1:172.21.15.53:6789/0 conn(0x7fd7dc0cb870 legacy=0x7fd7dc0af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:56.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.924+0000 7fd7dbfff640 1 -- 172.21.15.53:0/2380489868 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7dc160370 con 0x7fd7dc0afe30 2023-06-10T19:04:56.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.928+0000 7fd7dbfff640 1 --2- 172.21.15.53:0/2380489868 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7dc0afe30 0x7fd7dc0aba10 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc06e690 tx=0x7fd7d401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22ed00c2dfe666d8 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:56.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.928+0000 7fd7da7fc640 1 -- 172.21.15.53:0/2380489868 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d40a59f0 con 0x7fd7dc0afe30 2023-06-10T19:04:56.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.928+0000 7fd7da7fc640 1 -- 172.21.15.53:0/2380489868 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7d40a5b50 con 0x7fd7dc0afe30 2023-06-10T19:04:56.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.928+0000 7fd7da7fc640 1 -- 172.21.15.53:0/2380489868 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d40ad440 con 0x7fd7dc0afe30 2023-06-10T19:04:56.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.928+0000 7fd7e225b640 1 -- 172.21.15.53:0/2380489868 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7dc0afe30 msgr2=0x7fd7dc0aba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:56.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.928+0000 7fd7e225b640 1 --2- 172.21.15.53:0/2380489868 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7dc0afe30 0x7fd7dc0aba10 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc06e690 tx=0x7fd7d401c910 comp rx=0 tx=0).stop 2023-06-10T19:04:56.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.928+0000 7fd7e225b640 1 -- 172.21.15.53:0/2380489868 shutdown_connections 2023-06-10T19:04:56.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.928+0000 7fd7e225b640 1 --2- 172.21.15.53:0/2380489868 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7dc0afe30 0x7fd7dc0aba10 unknown :-1 s=CLOSED pgs=1838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:56.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.928+0000 7fd7e225b640 1 --2- 172.21.15.53:0/2380489868 >> v2:172.21.15.117:3300/0 conn(0x7fd7dc0c9750 0x7fd7dc0aced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:56.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.928+0000 7fd7e225b640 1 -- 172.21.15.53:0/2380489868 >> 172.21.15.53:0/2380489868 conn(0x7fd7dc06a0d0 msgr2=0x7fd7dc0ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:04:56.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.928+0000 7fd7e225b640 1 -- 172.21.15.53:0/2380489868 shutdown_connections 2023-06-10T19:04:56.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.928+0000 7fd7e225b640 1 -- 172.21.15.53:0/2380489868 wait complete. 2023-06-10T19:04:56.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.928+0000 7fd7e225b640 1 Processor -- start 2023-06-10T19:04:56.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.928+0000 7fd7e225b640 1 -- start start 2023-06-10T19:04:56.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.928+0000 7fd7e225b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7dc0afe30 0x7fd7dc153d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:56.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.928+0000 7fd7e225b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7dc0c9750 0x7fd7dc14bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:56.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.928+0000 7fd7e225b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7dc0cb870 0x7fd7dc0aec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:56.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.928+0000 7fd7e225b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7dc153550 con 0x7fd7dc0afe30 2023-06-10T19:04:56.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.928+0000 7fd7e225b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7dc159fb0 con 0x7fd7dc0c9750 2023-06-10T19:04:56.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.928+0000 7fd7e225b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7dc1525c0 con 0x7fd7dc0cb870 2023-06-10T19:04:56.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.928+0000 7fd7db7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7dc0afe30 0x7fd7dc153d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:56.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.928+0000 7fd7db7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7dc0afe30 0x7fd7dc153d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37838/0 (socket says 172.21.15.53:37838) 2023-06-10T19:04:56.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.928+0000 7fd7db7fe640 1 -- 172.21.15.53:0/2487903157 learned_addr learned my addr 172.21.15.53:0/2487903157 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:04:56.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.928+0000 7fd7daffd640 1 --2- 172.21.15.53:0/2487903157 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7dc0c9750 0x7fd7dc14bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:56.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.928+0000 7fd7dbfff640 1 --2- 172.21.15.53:0/2487903157 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7dc0cb870 0x7fd7dc0aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:56.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.928+0000 7fd7db7fe640 1 -- 172.21.15.53:0/2487903157 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7dc0cb870 msgr2=0x7fd7dc0aec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:56.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.928+0000 7fd7db7fe640 1 --2- 172.21.15.53:0/2487903157 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7dc0cb870 0x7fd7dc0aec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:56.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.928+0000 7fd7db7fe640 1 -- 172.21.15.53:0/2487903157 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7dc0c9750 msgr2=0x7fd7dc14bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:56.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.928+0000 7fd7db7fe640 1 --2- 172.21.15.53:0/2487903157 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7dc0c9750 0x7fd7dc14bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:56.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.928+0000 7fd7db7fe640 1 -- 172.21.15.53:0/2487903157 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7d4009a70 con 0x7fd7dc0afe30 2023-06-10T19:04:56.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.928+0000 7fd7db7fe640 1 --2- 172.21.15.53:0/2487903157 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7dc0afe30 0x7fd7dc153d80 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7fd7d000d830 tx=0x7fd7d000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:56.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.928+0000 7fd7c3fff640 1 -- 172.21.15.53:0/2487903157 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d000b6c0 con 0x7fd7dc0afe30 2023-06-10T19:04:56.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.928+0000 7fd7c3fff640 1 -- 172.21.15.53:0/2487903157 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7d000b820 con 0x7fd7dc0afe30 2023-06-10T19:04:56.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.928+0000 7fd7e225b640 1 -- 172.21.15.53:0/2487903157 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7dc1528a0 con 0x7fd7dc0afe30 2023-06-10T19:04:56.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.928+0000 7fd7c3fff640 1 -- 172.21.15.53:0/2487903157 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d000bb90 con 0x7fd7dc0afe30 2023-06-10T19:04:56.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.932+0000 7fd7e225b640 1 -- 172.21.15.53:0/2487903157 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7dc152e60 con 0x7fd7dc0afe30 2023-06-10T19:04:56.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.932+0000 7fd7e225b640 1 -- 172.21.15.53:0/2487903157 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7dc04d790 con 0x7fd7dc0afe30 2023-06-10T19:04:56.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.932+0000 7fd7c3fff640 1 -- 172.21.15.53:0/2487903157 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd7d001e460 con 0x7fd7dc0afe30 2023-06-10T19:04:56.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.932+0000 7fd7c3fff640 1 --2- 172.21.15.53:0/2487903157 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd7c80662b0 0x7fd7c8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:56.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.932+0000 7fd7c3fff640 1 -- 172.21.15.53:0/2487903157 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fd7d0084260 con 0x7fd7dc0afe30 2023-06-10T19:04:56.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.932+0000 7fd7daffd640 1 --2- 172.21.15.53:0/2487903157 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd7c80662b0 0x7fd7c8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:56.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.932+0000 7fd7daffd640 1 --2- 172.21.15.53:0/2487903157 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd7c80662b0 0x7fd7c8068760 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc151f60 tx=0x7fd7cc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:56.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:56.936+0000 7fd7c3fff640 1 -- 172.21.15.53:0/2487903157 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd7d00519b0 con 0x7fd7dc0afe30 2023-06-10T19:04:57.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.148+0000 7fd7e225b640 1 -- 172.21.15.53:0/2487903157 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_dont_mark_unresponsive_client_stale"]} v 0) v1 -- 0x7fd7dc0b0680 con 0x7fd7dc0afe30 2023-06-10T19:04:57.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.432+0000 7fd7c3fff640 1 -- 172.21.15.53:0/2487903157 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_dont_mark_unresponsive_client_stale"]}]=0 v571) v1 ==== 172+0+0 (secure 0 0 0) 0x7fd7d0054fd0 con 0x7fd7dc0afe30 2023-06-10T19:04:57.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.436+0000 7fd7e225b640 1 -- 172.21.15.53:0/2487903157 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd7c80662b0 msgr2=0x7fd7c8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:57.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.436+0000 7fd7e225b640 1 --2- 172.21.15.53:0/2487903157 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd7c80662b0 0x7fd7c8068760 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc151f60 tx=0x7fd7cc009040 comp rx=0 tx=0).stop 2023-06-10T19:04:57.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.436+0000 7fd7e225b640 1 -- 172.21.15.53:0/2487903157 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7dc0afe30 msgr2=0x7fd7dc153d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:57.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.436+0000 7fd7e225b640 1 --2- 172.21.15.53:0/2487903157 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7dc0afe30 0x7fd7dc153d80 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7fd7d000d830 tx=0x7fd7d000dcf0 comp rx=0 tx=0).stop 2023-06-10T19:04:57.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.436+0000 7fd7e225b640 1 -- 172.21.15.53:0/2487903157 shutdown_connections 2023-06-10T19:04:57.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.436+0000 7fd7e225b640 1 --2- 172.21.15.53:0/2487903157 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd7c80662b0 0x7fd7c8068760 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:57.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.436+0000 7fd7e225b640 1 --2- 172.21.15.53:0/2487903157 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd7dc0cb870 0x7fd7dc0aec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:57.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.436+0000 7fd7e225b640 1 --2- 172.21.15.53:0/2487903157 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7dc0c9750 0x7fd7dc14bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:57.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.436+0000 7fd7e225b640 1 --2- 172.21.15.53:0/2487903157 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7dc0afe30 0x7fd7dc153d80 unknown :-1 s=CLOSED pgs=1839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:57.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.436+0000 7fd7e225b640 1 -- 172.21.15.53:0/2487903157 >> 172.21.15.53:0/2487903157 conn(0x7fd7dc06a0d0 msgr2=0x7fd7dc15e380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:04:57.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.436+0000 7fd7e225b640 1 -- 172.21.15.53:0/2487903157 shutdown_connections 2023-06-10T19:04:57.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.436+0000 7fd7e225b640 1 -- 172.21.15.53:0/2487903157 wait complete. 2023-06-10T19:04:57.461 INFO:tasks.cephfs_test_runner:test_dont_mark_unresponsive_client_stale (tasks.cephfs.test_client_recovery.TestClientRecovery) ... ok 2023-06-10T19:04:57.462 INFO:tasks.cephfs_test_runner:Starting test: test_evicted_caps (tasks.cephfs.test_client_recovery.TestClientRecovery) 2023-06-10T19:04:57.462 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_evicted_caps' 2023-06-10T19:04:57.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.596+0000 7f4c4a940640 1 Processor -- start 2023-06-10T19:04:57.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.596+0000 7f4c4a940640 1 -- start start 2023-06-10T19:04:57.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.596+0000 7f4c4a940640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4c440ccae0 0x7f4c440d0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:57.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.596+0000 7f4c4a940640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c440d0020 con 0x7f4c440cc690 2023-06-10T19:04:57.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.596+0000 7f4c4a940640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c440cef40 con 0x7f4c440b3ac0 2023-06-10T19:04:57.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.596+0000 7f4c4a940640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c440cf220 con 0x7f4c440ccae0 2023-06-10T19:04:57.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.596+0000 7f4c3b7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f4c440cc690 0x7f4c440d04b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:40934/0 (socket says 172.21.15.53:40934) 2023-06-10T19:04:57.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.596+0000 7f4c3b7fe640 1 -- 172.21.15.53:0/2155715394 learned_addr learned my addr 172.21.15.53:0/2155715394 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:04:57.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.596+0000 7f4c437fe640 1 -- 172.21.15.53:0/2155715394 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3387899702 0 0) 0x7f4c440d0020 con 0x7f4c440cc690 2023-06-10T19:04:57.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.596+0000 7f4c437fe640 1 -- 172.21.15.53:0/2155715394 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c24003530 con 0x7f4c440cc690 2023-06-10T19:04:57.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.596+0000 7f4c48edd640 1 --2- 172.21.15.53:0/2155715394 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4c440ccae0 0x7f4c440d0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:57.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.596+0000 7f4c437fe640 1 -- 172.21.15.53:0/2155715394 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2534545819 0 0) 0x7f4c24003530 con 0x7f4c440cc690 2023-06-10T19:04:57.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.596+0000 7f4c437fe640 1 -- 172.21.15.53:0/2155715394 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4c440ccae0 msgr2=0x7f4c440d0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:04:57.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.596+0000 7f4c437fe640 1 --2- 172.21.15.53:0/2155715394 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4c440ccae0 0x7f4c440d0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:57.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.596+0000 7f4c437fe640 1 -- 172.21.15.53:0/2155715394 >> v1:172.21.15.117:6789/0 conn(0x7f4c440b3ac0 legacy=0x7f4c440b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:57.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.596+0000 7f4c437fe640 1 -- 172.21.15.53:0/2155715394 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c440cf500 con 0x7f4c440cc690 2023-06-10T19:04:57.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.596+0000 7f4c437fe640 1 -- 172.21.15.53:0/2155715394 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f4c2c001680 con 0x7f4c440cc690 2023-06-10T19:04:57.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.596+0000 7f4c48edd640 1 --2- 172.21.15.53:0/2155715394 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4c440ccae0 0x7f4c440d0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:04:57.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.596+0000 7f4c437fe640 1 -- 172.21.15.53:0/2155715394 >> v1:172.21.15.53:6789/0 conn(0x7f4c440cc690 legacy=0x7f4c440d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:57.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.596+0000 7f4c437fe640 1 --2- 172.21.15.53:0/2155715394 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4c440ccae0 0x7f4c24003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:57.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.596+0000 7f4c437fe640 1 --2- 172.21.15.53:0/2155715394 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c24004010 0x7f4c240047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:57.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.596+0000 7f4c437fe640 1 --2- 172.21.15.53:0/2155715394 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c24004d10 0x7f4c24005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:57.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.596+0000 7f4c437fe640 1 -- 172.21.15.53:0/2155715394 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c440cf220 con 0x7f4c24004010 2023-06-10T19:04:57.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.596+0000 7f4c437fe640 1 -- 172.21.15.53:0/2155715394 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2400bb50 con 0x7f4c24004d10 2023-06-10T19:04:57.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.596+0000 7f4c437fe640 1 -- 172.21.15.53:0/2155715394 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2400bd10 con 0x7f4c440ccae0 2023-06-10T19:04:57.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.596+0000 7f4c3b7fe640 1 --2- 172.21.15.53:0/2155715394 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c24004010 0x7f4c240047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:57.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.596+0000 7f4c48edd640 1 --2- 172.21.15.53:0/2155715394 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c24004d10 0x7f4c24005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:57.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.596+0000 7f4c43fff640 1 --2- 172.21.15.53:0/2155715394 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4c440ccae0 0x7f4c24003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:57.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.596+0000 7f4c3b7fe640 1 -- 172.21.15.53:0/2155715394 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4c440ccae0 msgr2=0x7f4c24003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:04:57.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.596+0000 7f4c3b7fe640 1 --2- 172.21.15.53:0/2155715394 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4c440ccae0 0x7f4c24003a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:57.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.596+0000 7f4c3b7fe640 1 -- 172.21.15.53:0/2155715394 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c24004d10 msgr2=0x7f4c24005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:04:57.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.596+0000 7f4c3b7fe640 1 --2- 172.21.15.53:0/2155715394 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c24004d10 0x7f4c24005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:57.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.596+0000 7f4c3b7fe640 1 -- 172.21.15.53:0/2155715394 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c24003530 con 0x7f4c24004010 2023-06-10T19:04:57.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.600+0000 7f4c3b7fe640 1 --2- 172.21.15.53:0/2155715394 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c24004010 0x7f4c240047d0 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c00c240 tx=0x7f4c2c01f3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa162b9d82bcefaf server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:57.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.600+0000 7f4c437fe640 1 -- 172.21.15.53:0/2155715394 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c2c005ae0 con 0x7f4c24004010 2023-06-10T19:04:57.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.600+0000 7f4c437fe640 1 -- 172.21.15.53:0/2155715394 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c2c0ab070 con 0x7f4c24004010 2023-06-10T19:04:57.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.600+0000 7f4c437fe640 1 -- 172.21.15.53:0/2155715394 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c2c007070 con 0x7f4c24004010 2023-06-10T19:04:57.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.600+0000 7f4c4a940640 1 -- 172.21.15.53:0/2155715394 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c24004010 msgr2=0x7f4c240047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:57.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.600+0000 7f4c4a940640 1 --2- 172.21.15.53:0/2155715394 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c24004010 0x7f4c240047d0 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c00c240 tx=0x7f4c2c01f3b0 comp rx=0 tx=0).stop 2023-06-10T19:04:57.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.600+0000 7f4c48edd640 1 -- 172.21.15.53:0/2155715394 reap_dead start 2023-06-10T19:04:57.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.600+0000 7f4c4a940640 1 -- 172.21.15.53:0/2155715394 shutdown_connections 2023-06-10T19:04:57.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.600+0000 7f4c4a940640 1 -- 172.21.15.53:0/2155715394 >> 172.21.15.53:0/2155715394 conn(0x7f4c44071790 msgr2=0x7f4c44069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:04:57.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.600+0000 7f4c4a940640 1 -- 172.21.15.53:0/2155715394 shutdown_connections 2023-06-10T19:04:57.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.600+0000 7f4c4a940640 1 -- 172.21.15.53:0/2155715394 wait complete. 2023-06-10T19:04:57.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.600+0000 7f4c4a940640 1 Processor -- start 2023-06-10T19:04:57.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.600+0000 7f4c4a940640 1 -- start start 2023-06-10T19:04:57.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.604+0000 7f4c4a940640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4c44157a70 0x7f4c441e3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:57.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.604+0000 7f4c4a940640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c44158310 0x7f4c440cb990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:57.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.604+0000 7f4c4a940640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c440cbed0 0x7f4c440c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:57.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.604+0000 7f4c4a940640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c440c6ba0 con 0x7f4c440cbed0 2023-06-10T19:04:57.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.604+0000 7f4c4a940640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c440c6e80 con 0x7f4c44158310 2023-06-10T19:04:57.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.604+0000 7f4c4a940640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c440c7160 con 0x7f4c44157a70 2023-06-10T19:04:57.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.604+0000 7f4c48edd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c440cbed0 0x7f4c440c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:57.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.604+0000 7f4c48edd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c440cbed0 0x7f4c440c9a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37848/0 (socket says 172.21.15.53:37848) 2023-06-10T19:04:57.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.604+0000 7f4c48edd640 1 -- 172.21.15.53:0/1676311871 learned_addr learned my addr 172.21.15.53:0/1676311871 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:04:57.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.604+0000 7f4c43fff640 1 --2- 172.21.15.53:0/1676311871 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4c44157a70 0x7f4c441e3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:57.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.604+0000 7f4c3b7fe640 1 --2- 172.21.15.53:0/1676311871 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c44158310 0x7f4c440cb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:57.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.604+0000 7f4c48edd640 1 -- 172.21.15.53:0/1676311871 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4c44157a70 msgr2=0x7f4c441e3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:57.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.604+0000 7f4c48edd640 1 --2- 172.21.15.53:0/1676311871 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4c44157a70 0x7f4c441e3dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:57.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.604+0000 7f4c48edd640 1 -- 172.21.15.53:0/1676311871 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c44158310 msgr2=0x7f4c440cb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:57.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.604+0000 7f4c48edd640 1 --2- 172.21.15.53:0/1676311871 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c44158310 0x7f4c440cb990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:57.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.604+0000 7f4c48edd640 1 -- 172.21.15.53:0/1676311871 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c440c7440 con 0x7f4c440cbed0 2023-06-10T19:04:57.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.604+0000 7f4c3b7fe640 1 --2- 172.21.15.53:0/1676311871 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c44158310 0x7f4c440cb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:04:57.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.604+0000 7f4c48edd640 1 --2- 172.21.15.53:0/1676311871 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c440cbed0 0x7f4c440c9a00 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7f4c440b4c30 tx=0x7f4c3c0043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:57.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.604+0000 7f4c417fa640 1 -- 172.21.15.53:0/1676311871 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3c014610 con 0x7f4c440cbed0 2023-06-10T19:04:57.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.604+0000 7f4c417fa640 1 -- 172.21.15.53:0/1676311871 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c3c00f050 con 0x7f4c440cbed0 2023-06-10T19:04:57.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.604+0000 7f4c4a940640 1 -- 172.21.15.53:0/1676311871 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c440c7720 con 0x7f4c440cbed0 2023-06-10T19:04:57.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.604+0000 7f4c417fa640 1 -- 172.21.15.53:0/1676311871 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3c014990 con 0x7f4c440cbed0 2023-06-10T19:04:57.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.604+0000 7f4c4a940640 1 -- 172.21.15.53:0/1676311871 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c44158010 con 0x7f4c440cbed0 2023-06-10T19:04:57.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.604+0000 7f4c4a940640 1 -- 172.21.15.53:0/1676311871 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c440c7910 con 0x7f4c440cbed0 2023-06-10T19:04:57.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.604+0000 7f4c417fa640 1 -- 172.21.15.53:0/1676311871 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4c3c014af0 con 0x7f4c440cbed0 2023-06-10T19:04:57.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.604+0000 7f4c417fa640 1 --2- 172.21.15.53:0/1676311871 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4c280662b0 0x7f4c28068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:57.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.604+0000 7f4c417fa640 1 -- 172.21.15.53:0/1676311871 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f4c3c083780 con 0x7f4c440cbed0 2023-06-10T19:04:57.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.604+0000 7f4c43fff640 1 --2- 172.21.15.53:0/1676311871 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4c280662b0 0x7f4c28068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:57.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.608+0000 7f4c43fff640 1 --2- 172.21.15.53:0/1676311871 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4c280662b0 0x7f4c28068760 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f4c34007fd0 tx=0x7f4c34009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:57.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.608+0000 7f4c417fa640 1 -- 172.21.15.53:0/1676311871 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4c3c050f60 con 0x7f4c440cbed0 2023-06-10T19:04:57.824 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:57.820+0000 7f4c4a940640 1 -- 172.21.15.53:0/1676311871 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_evicted_caps"]} v 0) v1 -- 0x7f4c4404d790 con 0x7f4c440cbed0 2023-06-10T19:04:58.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.444+0000 7f4c417fa640 1 -- 172.21.15.53:0/1676311871 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_evicted_caps"]}]=0 v572) v1 ==== 152+0+0 (secure 0 0 0) 0x7f4c3c054580 con 0x7f4c440cbed0 2023-06-10T19:04:58.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.448+0000 7f4c4a940640 1 -- 172.21.15.53:0/1676311871 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4c280662b0 msgr2=0x7f4c28068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:58.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.448+0000 7f4c4a940640 1 --2- 172.21.15.53:0/1676311871 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4c280662b0 0x7f4c28068760 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f4c34007fd0 tx=0x7f4c34009040 comp rx=0 tx=0).stop 2023-06-10T19:04:58.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.448+0000 7f4c4a940640 1 -- 172.21.15.53:0/1676311871 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c440cbed0 msgr2=0x7f4c440c9a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:58.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.448+0000 7f4c4a940640 1 --2- 172.21.15.53:0/1676311871 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c440cbed0 0x7f4c440c9a00 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7f4c440b4c30 tx=0x7f4c3c0043b0 comp rx=0 tx=0).stop 2023-06-10T19:04:58.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.448+0000 7f4c4a940640 1 -- 172.21.15.53:0/1676311871 shutdown_connections 2023-06-10T19:04:58.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.448+0000 7f4c4a940640 1 --2- 172.21.15.53:0/1676311871 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4c280662b0 0x7f4c28068760 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:58.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.448+0000 7f4c4a940640 1 --2- 172.21.15.53:0/1676311871 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c440cbed0 0x7f4c440c9a00 unknown :-1 s=CLOSED pgs=1842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:58.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.448+0000 7f4c4a940640 1 --2- 172.21.15.53:0/1676311871 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c44158310 0x7f4c440cb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:58.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.448+0000 7f4c4a940640 1 --2- 172.21.15.53:0/1676311871 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4c44157a70 0x7f4c441e3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:58.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.448+0000 7f4c4a940640 1 -- 172.21.15.53:0/1676311871 >> 172.21.15.53:0/1676311871 conn(0x7f4c44071790 msgr2=0x7f4c440b24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:04:58.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.448+0000 7f4c4a940640 1 -- 172.21.15.53:0/1676311871 shutdown_connections 2023-06-10T19:04:58.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.448+0000 7f4c4a940640 1 -- 172.21.15.53:0/1676311871 wait complete. 2023-06-10T19:04:58.476 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-06-10T19:04:58.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.612+0000 7fdb04770640 1 Processor -- start 2023-06-10T19:04:58.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.612+0000 7fdb04770640 1 -- start start 2023-06-10T19:04:58.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.612+0000 7fdb04770640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fdafc15eef0 0x7fdafc070f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:58.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.612+0000 7fdb04770640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fdafc069450 0x7fdafc069850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:58.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.612+0000 7fdb04770640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdafc069d90 con 0x7fdafc15f570 2023-06-10T19:04:58.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.612+0000 7fdb04770640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdafc15f2c0 con 0x7fdafc069450 2023-06-10T19:04:58.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.612+0000 7fdb04770640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdafc15fdc0 con 0x7fdafc15eef0 2023-06-10T19:04:58.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.612+0000 7fdb02d0d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fdafc069450 0x7fdafc069850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:58.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.612+0000 7fdb02d0d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fdafc069450 0x7fdafc069850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37852/0 (socket says 172.21.15.53:37852) 2023-06-10T19:04:58.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.612+0000 7fdb02d0d640 1 -- 172.21.15.53:0/459792933 learned_addr learned my addr 172.21.15.53:0/459792933 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:04:58.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.612+0000 7fdb0250c640 1 --2- 172.21.15.53:0/459792933 >> v2:172.21.15.117:3300/0 conn(0x7fdafc15eef0 0x7fdafc070f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:58.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.612+0000 7fdb02d0d640 1 -- 172.21.15.53:0/459792933 >> v2:172.21.15.117:3300/0 conn(0x7fdafc15eef0 msgr2=0x7fdafc070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:04:58.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.612+0000 7fdb02d0d640 1 --2- 172.21.15.53:0/459792933 >> v2:172.21.15.117:3300/0 conn(0x7fdafc15eef0 0x7fdafc070f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:58.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.612+0000 7fdb02d0d640 1 -- 172.21.15.53:0/459792933 >> v1:172.21.15.117:6789/0 conn(0x7fdafc15f570 legacy=0x7fdafc0ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:04:58.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.612+0000 7fdb02d0d640 1 -- 172.21.15.53:0/459792933 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdafc1600a0 con 0x7fdafc069450 2023-06-10T19:04:58.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.616+0000 7fdb02d0d640 1 --2- 172.21.15.53:0/459792933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdafc069450 0x7fdafc069850 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7fdafc06b4f0 tx=0x7fdaf401c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eed01e5187c12c0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:58.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.616+0000 7fdb0150a640 1 -- 172.21.15.53:0/459792933 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf40a5740 con 0x7fdafc069450 2023-06-10T19:04:58.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.616+0000 7fdb0150a640 1 -- 172.21.15.53:0/459792933 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaf40a58a0 con 0x7fdafc069450 2023-06-10T19:04:58.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.616+0000 7fdb0150a640 1 -- 172.21.15.53:0/459792933 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf40a5c30 con 0x7fdafc069450 2023-06-10T19:04:58.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.616+0000 7fdb04770640 1 -- 172.21.15.53:0/459792933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdafc069450 msgr2=0x7fdafc069850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:58.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.616+0000 7fdb04770640 1 --2- 172.21.15.53:0/459792933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdafc069450 0x7fdafc069850 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7fdafc06b4f0 tx=0x7fdaf401c990 comp rx=0 tx=0).stop 2023-06-10T19:04:58.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.616+0000 7fdb04770640 1 -- 172.21.15.53:0/459792933 shutdown_connections 2023-06-10T19:04:58.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.616+0000 7fdb04770640 1 --2- 172.21.15.53:0/459792933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdafc069450 0x7fdafc069850 unknown :-1 s=CLOSED pgs=1843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:58.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.616+0000 7fdb04770640 1 --2- 172.21.15.53:0/459792933 >> v2:172.21.15.117:3300/0 conn(0x7fdafc15eef0 0x7fdafc070f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:58.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.616+0000 7fdb04770640 1 -- 172.21.15.53:0/459792933 >> 172.21.15.53:0/459792933 conn(0x7fdafc06a560 msgr2=0x7fdafc06a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:04:58.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.616+0000 7fdb04770640 1 -- 172.21.15.53:0/459792933 shutdown_connections 2023-06-10T19:04:58.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.616+0000 7fdb04770640 1 -- 172.21.15.53:0/459792933 wait complete. 2023-06-10T19:04:58.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.616+0000 7fdb04770640 1 Processor -- start 2023-06-10T19:04:58.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.616+0000 7fdb04770640 1 -- start start 2023-06-10T19:04:58.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.616+0000 7fdb04770640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdafc069450 0x7fdafc1563c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:58.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.616+0000 7fdb04770640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdafc15eef0 0x7fdafc154b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:58.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.616+0000 7fdb04770640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdafc15f570 0x7fdafc14a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:58.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.616+0000 7fdb04770640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdafc0c7ff0 con 0x7fdafc15f570 2023-06-10T19:04:58.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.616+0000 7fdb04770640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdafc156900 con 0x7fdafc069450 2023-06-10T19:04:58.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.616+0000 7fdb04770640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdafc155080 con 0x7fdafc15eef0 2023-06-10T19:04:58.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.616+0000 7fdb02d0d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdafc15f570 0x7fdafc14a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:58.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.616+0000 7fdb02d0d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdafc15f570 0x7fdafc14a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37856/0 (socket says 172.21.15.53:37856) 2023-06-10T19:04:58.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.616+0000 7fdb02d0d640 1 -- 172.21.15.53:0/3707439629 learned_addr learned my addr 172.21.15.53:0/3707439629 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:04:58.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.616+0000 7fdb01d0b640 1 --2- 172.21.15.53:0/3707439629 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdafc15eef0 0x7fdafc154b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:58.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.616+0000 7fdb0250c640 1 --2- 172.21.15.53:0/3707439629 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdafc069450 0x7fdafc1563c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:58.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.620+0000 7fdb02d0d640 1 -- 172.21.15.53:0/3707439629 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdafc15eef0 msgr2=0x7fdafc154b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:58.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.620+0000 7fdb02d0d640 1 --2- 172.21.15.53:0/3707439629 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdafc15eef0 0x7fdafc154b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:58.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.620+0000 7fdb02d0d640 1 -- 172.21.15.53:0/3707439629 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdafc069450 msgr2=0x7fdafc1563c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:58.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.620+0000 7fdb02d0d640 1 --2- 172.21.15.53:0/3707439629 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdafc069450 0x7fdafc1563c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:58.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.620+0000 7fdb02d0d640 1 -- 172.21.15.53:0/3707439629 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaf4009b30 con 0x7fdafc15f570 2023-06-10T19:04:58.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.620+0000 7fdb0250c640 1 --2- 172.21.15.53:0/3707439629 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdafc069450 0x7fdafc1563c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:04:58.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.620+0000 7fdb02d0d640 1 --2- 172.21.15.53:0/3707439629 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdafc15f570 0x7fdafc14a410 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7fdaf40af040 tx=0x7fdaf4019730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:58.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.620+0000 7fdaf2ffd640 1 -- 172.21.15.53:0/3707439629 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf40b8670 con 0x7fdafc15f570 2023-06-10T19:04:58.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.620+0000 7fdaf2ffd640 1 -- 172.21.15.53:0/3707439629 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaf40b87d0 con 0x7fdafc15f570 2023-06-10T19:04:58.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.620+0000 7fdb04770640 1 -- 172.21.15.53:0/3707439629 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdafc155320 con 0x7fdafc15f570 2023-06-10T19:04:58.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.620+0000 7fdaf2ffd640 1 -- 172.21.15.53:0/3707439629 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf40b8b80 con 0x7fdafc15f570 2023-06-10T19:04:58.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.620+0000 7fdb04770640 1 -- 172.21.15.53:0/3707439629 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdafc1558e0 con 0x7fdafc15f570 2023-06-10T19:04:58.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.620+0000 7fdb04770640 1 -- 172.21.15.53:0/3707439629 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdafc04d790 con 0x7fdafc15f570 2023-06-10T19:04:58.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.620+0000 7fdaf2ffd640 1 -- 172.21.15.53:0/3707439629 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdaf40b8ce0 con 0x7fdafc15f570 2023-06-10T19:04:58.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.620+0000 7fdaf2ffd640 1 --2- 172.21.15.53:0/3707439629 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdae0066280 0x7fdae0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:58.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.620+0000 7fdaf2ffd640 1 -- 172.21.15.53:0/3707439629 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fdaf411f180 con 0x7fdafc15f570 2023-06-10T19:04:58.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.620+0000 7fdb0250c640 1 --2- 172.21.15.53:0/3707439629 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdae0066280 0x7fdae0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:58.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.620+0000 7fdb0250c640 1 --2- 172.21.15.53:0/3707439629 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdae0066280 0x7fdae0068730 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fdafc15dfd0 tx=0x7fdaf8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:58.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.624+0000 7fdaf2ffd640 1 -- 172.21.15.53:0/3707439629 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdaf40eca10 con 0x7fdafc15f570 2023-06-10T19:04:58.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.780+0000 7fdb04770640 1 -- 172.21.15.53:0/3707439629 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fdafc04d790 con 0x7fdafc15f570 2023-06-10T19:04:58.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.788+0000 7fdaf2ffd640 1 -- 172.21.15.53:0/3707439629 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7fdaf40f0030 con 0x7fdafc15f570 2023-06-10T19:04:58.794 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.788+0000 7fdb04770640 1 -- 172.21.15.53:0/3707439629 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdae0066280 msgr2=0x7fdae0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:58.794 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.788+0000 7fdb04770640 1 --2- 172.21.15.53:0/3707439629 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdae0066280 0x7fdae0068730 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fdafc15dfd0 tx=0x7fdaf8008040 comp rx=0 tx=0).stop 2023-06-10T19:04:58.794 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.788+0000 7fdb04770640 1 -- 172.21.15.53:0/3707439629 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdafc15f570 msgr2=0x7fdafc14a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:58.795 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.788+0000 7fdb04770640 1 --2- 172.21.15.53:0/3707439629 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdafc15f570 0x7fdafc14a410 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7fdaf40af040 tx=0x7fdaf4019730 comp rx=0 tx=0).stop 2023-06-10T19:04:58.795 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.788+0000 7fdb04770640 1 -- 172.21.15.53:0/3707439629 shutdown_connections 2023-06-10T19:04:58.795 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.788+0000 7fdb04770640 1 --2- 172.21.15.53:0/3707439629 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdae0066280 0x7fdae0068730 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:58.795 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.788+0000 7fdb04770640 1 --2- 172.21.15.53:0/3707439629 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdafc15f570 0x7fdafc14a410 unknown :-1 s=CLOSED pgs=1844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:58.795 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.788+0000 7fdb04770640 1 --2- 172.21.15.53:0/3707439629 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdafc15eef0 0x7fdafc154b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:58.795 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.788+0000 7fdb04770640 1 --2- 172.21.15.53:0/3707439629 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdafc069450 0x7fdafc1563c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:58.795 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.788+0000 7fdb04770640 1 -- 172.21.15.53:0/3707439629 >> 172.21.15.53:0/3707439629 conn(0x7fdafc06a560 msgr2=0x7fdafc0ced70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:04:58.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.788+0000 7fdb04770640 1 -- 172.21.15.53:0/3707439629 shutdown_connections 2023-06-10T19:04:58.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:58.788+0000 7fdb04770640 1 -- 172.21.15.53:0/3707439629 wait complete. 2023-06-10T19:04:58.813 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-06-10T19:04:58.813 DEBUG:teuthology.orchestra.run.smithi053:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-06-10T19:04:58.853 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-06-10T19:04:58.916 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-06-10T19:04:58.916 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T19:04:58.917 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:04:58.924 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16345192k,nr_inodes=4086298,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276544k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=407 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276540k,nr_inodes=819135,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276544k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-06-10T19:04:58.924 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T19:04:58.925 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:04:58.931 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16342088k,nr_inodes=4085522,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275924k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18845 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275920k,nr_inodes=818980,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275924k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-06-10T19:04:58.931 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T19:04:58.932 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:04:58.974 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16345192k,nr_inodes=4086298,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276544k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=407 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276540k,nr_inodes=819135,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276544k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-06-10T19:04:58.974 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T19:04:58.976 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:04:58.985 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16342088k,nr_inodes=4085522,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275924k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18845 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275920k,nr_inodes=818980,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275924k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-06-10T19:04:58.985 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-06-10T19:04:58.986 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:04:59.154 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.148+0000 7f782e50a640 1 Processor -- start 2023-06-10T19:04:59.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.148+0000 7f782e50a640 1 -- start start 2023-06-10T19:04:59.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.152+0000 7f782e50a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f78280b3ac0 0x7f78280b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:59.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.152+0000 7f782e50a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f78280d14c0 0x7f782815fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:59.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.152+0000 7f782e50a640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78280d0020 con 0x7f78280cc690 2023-06-10T19:04:59.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.152+0000 7f782e50a640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78280b43d0 con 0x7f78280b3ac0 2023-06-10T19:04:59.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.152+0000 7f782e50a640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78280cef40 con 0x7f78280d14c0 2023-06-10T19:04:59.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.152+0000 7f7827fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f78280b3ac0 0x7f78280b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:59.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.152+0000 7f7827fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f78280b3ac0 0x7f78280b3e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37860/0 (socket says 172.21.15.53:37860) 2023-06-10T19:04:59.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.152+0000 7f7827fff640 1 -- 172.21.15.53:0/28171178 learned_addr learned my addr 172.21.15.53:0/28171178 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:04:59.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.152+0000 7f78277fe640 1 --1- 172.21.15.53:0/28171178 >> v1:172.21.15.53:6789/0 conn(0x7f78280cc690 0x7f782815f370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:40944/0 (socket says 172.21.15.53:40944) 2023-06-10T19:04:59.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.152+0000 7f782caa7640 1 --2- 172.21.15.53:0/28171178 >> v2:172.21.15.117:3300/0 conn(0x7f78280d14c0 0x7f782815fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:59.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.152+0000 7f7827fff640 1 -- 172.21.15.53:0/28171178 >> v2:172.21.15.117:3300/0 conn(0x7f78280d14c0 msgr2=0x7f782815fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:04:59.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.152+0000 7f7827fff640 1 --2- 172.21.15.53:0/28171178 >> v2:172.21.15.117:3300/0 conn(0x7f78280d14c0 0x7f782815fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:59.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.152+0000 7f7827fff640 1 -- 172.21.15.53:0/28171178 >> v1:172.21.15.53:6789/0 conn(0x7f78280cc690 legacy=0x7f782815f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:59.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.152+0000 7f7826ffd640 1 -- 172.21.15.53:0/28171178 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 590901442 0 0) 0x7f78280d0020 con 0x7f78280cc690 2023-06-10T19:04:59.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.152+0000 7f7827fff640 1 -- 172.21.15.53:0/28171178 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78280cf220 con 0x7f78280b3ac0 2023-06-10T19:04:59.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.152+0000 7f7827fff640 1 --2- 172.21.15.53:0/28171178 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f78280b3ac0 0x7f78280b3e90 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7f7828160410 tx=0x7f781001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a15eb96f1e4819cd server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:59.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.152+0000 7f7826ffd640 1 -- 172.21.15.53:0/28171178 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78100ac640 con 0x7f78280b3ac0 2023-06-10T19:04:59.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.152+0000 7f7826ffd640 1 -- 172.21.15.53:0/28171178 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78100ac7a0 con 0x7f78280b3ac0 2023-06-10T19:04:59.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.152+0000 7f7826ffd640 1 -- 172.21.15.53:0/28171178 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78100acb30 con 0x7f78280b3ac0 2023-06-10T19:04:59.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.156+0000 7f782e50a640 1 -- 172.21.15.53:0/28171178 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f78280b3ac0 msgr2=0x7f78280b3e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:59.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.156+0000 7f782e50a640 1 --2- 172.21.15.53:0/28171178 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f78280b3ac0 0x7f78280b3e90 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7f7828160410 tx=0x7f781001c4d0 comp rx=0 tx=0).stop 2023-06-10T19:04:59.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.156+0000 7f782e50a640 1 -- 172.21.15.53:0/28171178 shutdown_connections 2023-06-10T19:04:59.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.156+0000 7f782e50a640 1 --2- 172.21.15.53:0/28171178 >> v2:172.21.15.117:3300/0 conn(0x7f78280d14c0 0x7f782815fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:59.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.156+0000 7f782e50a640 1 --2- 172.21.15.53:0/28171178 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f78280b3ac0 0x7f78280b3e90 unknown :-1 s=CLOSED pgs=1846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:59.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.156+0000 7f782e50a640 1 -- 172.21.15.53:0/28171178 >> 172.21.15.53:0/28171178 conn(0x7f7828071790 msgr2=0x7f7828069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:04:59.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.156+0000 7f782e50a640 1 -- 172.21.15.53:0/28171178 shutdown_connections 2023-06-10T19:04:59.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.156+0000 7f782e50a640 1 -- 172.21.15.53:0/28171178 wait complete. 2023-06-10T19:04:59.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.156+0000 7f782e50a640 1 Processor -- start 2023-06-10T19:04:59.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.156+0000 7f782e50a640 1 -- start start 2023-06-10T19:04:59.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.156+0000 7f782e50a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78280b3ac0 0x7f7828152180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:59.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.156+0000 7f782e50a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f78280cc690 0x7f78280cba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:59.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.156+0000 7f782e50a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78280d14c0 0x7f78280b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:59.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.156+0000 7f782e50a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78280c5e40 con 0x7f78280cc690 2023-06-10T19:04:59.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.156+0000 7f782e50a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78281526c0 con 0x7f78280d14c0 2023-06-10T19:04:59.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.156+0000 7f782e50a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78280cbfc0 con 0x7f78280b3ac0 2023-06-10T19:04:59.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.156+0000 7f78277fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f78280cc690 0x7f78280cba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:59.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.156+0000 7f78277fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f78280cc690 0x7f78280cba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37872/0 (socket says 172.21.15.53:37872) 2023-06-10T19:04:59.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.156+0000 7f78277fe640 1 -- 172.21.15.53:0/3115631826 learned_addr learned my addr 172.21.15.53:0/3115631826 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:04:59.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.156+0000 7f78277fe640 1 -- 172.21.15.53:0/3115631826 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78280b3ac0 msgr2=0x7f7828152180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:59.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.156+0000 7f7827fff640 1 --2- 172.21.15.53:0/3115631826 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78280b3ac0 0x7f7828152180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:59.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.156+0000 7f78277fe640 1 --2- 172.21.15.53:0/3115631826 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78280b3ac0 0x7f7828152180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:59.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.156+0000 7f782caa7640 1 --2- 172.21.15.53:0/3115631826 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78280d14c0 0x7f78280b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:59.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.156+0000 7f78277fe640 1 -- 172.21.15.53:0/3115631826 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78280d14c0 msgr2=0x7f78280b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:59.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.156+0000 7f78277fe640 1 --2- 172.21.15.53:0/3115631826 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78280d14c0 0x7f78280b1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:59.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.156+0000 7f78277fe640 1 -- 172.21.15.53:0/3115631826 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78100094d0 con 0x7f78280cc690 2023-06-10T19:04:59.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.156+0000 7f78277fe640 1 --2- 172.21.15.53:0/3115631826 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f78280cc690 0x7f78280cba80 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7f7818001570 tx=0x7f781800cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:59.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.156+0000 7f7824ff9640 1 -- 172.21.15.53:0/3115631826 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781800a640 con 0x7f78280cc690 2023-06-10T19:04:59.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.156+0000 7f7824ff9640 1 -- 172.21.15.53:0/3115631826 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f781800a7c0 con 0x7f78280cc690 2023-06-10T19:04:59.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.156+0000 7f782e50a640 1 -- 172.21.15.53:0/3115631826 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78280b2cb0 con 0x7f78280cc690 2023-06-10T19:04:59.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.156+0000 7f7824ff9640 1 -- 172.21.15.53:0/3115631826 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781800ab70 con 0x7f78280cc690 2023-06-10T19:04:59.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.156+0000 7f782e50a640 1 -- 172.21.15.53:0/3115631826 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78280c8120 con 0x7f78280cc690 2023-06-10T19:04:59.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.160+0000 7f782e50a640 1 -- 172.21.15.53:0/3115631826 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f782804d790 con 0x7f78280cc690 2023-06-10T19:04:59.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.160+0000 7f7824ff9640 1 -- 172.21.15.53:0/3115631826 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f781800acd0 con 0x7f78280cc690 2023-06-10T19:04:59.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.160+0000 7f7824ff9640 1 --2- 172.21.15.53:0/3115631826 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7808066280 0x7f7808068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:59.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.160+0000 7f7824ff9640 1 -- 172.21.15.53:0/3115631826 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f7818083010 con 0x7f78280cc690 2023-06-10T19:04:59.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.160+0000 7f7827fff640 1 --2- 172.21.15.53:0/3115631826 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7808066280 0x7f7808068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:59.175 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.160+0000 7f7827fff640 1 --2- 172.21.15.53:0/3115631826 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7808066280 0x7f7808068730 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f78100ae000 tx=0x7f7810008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:59.175 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.164+0000 7f7824ff9640 1 -- 172.21.15.53:0/3115631826 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f78180507f0 con 0x7f78280cc690 2023-06-10T19:04:59.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.348+0000 7f782e50a640 1 -- 172.21.15.53:0/3115631826 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f782808a200 con 0x7f78280cc690 2023-06-10T19:04:59.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.352+0000 7f7824ff9640 1 -- 172.21.15.53:0/3115631826 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+3529 (secure 0 0 0) 0x7f7818053e10 con 0x7f78280cc690 2023-06-10T19:04:59.356 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:04:59.356 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":65,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6542,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6836/3258793373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3258793373},{"type":"v1","addr":"172.21.15.117:6836","nonce":3258793373}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":7363,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/585135979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6835","nonce":585135979},{"type":"v1","addr":"172.21.15.117:6837","nonce":585135979}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":8682,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/448704478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":448704478},{"type":"v1","addr":"172.21.15.53:6833","nonce":448704478}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":9075,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2183443719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2183443719},{"type":"v1","addr":"172.21.15.53:6835","nonce":2183443719}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[]} 2023-06-10T19:04:59.356 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 65 2023-06-10T19:04:59.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.352+0000 7f782e50a640 1 -- 172.21.15.53:0/3115631826 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7808066280 msgr2=0x7f7808068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:59.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.352+0000 7f782e50a640 1 --2- 172.21.15.53:0/3115631826 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7808066280 0x7f7808068730 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f78100ae000 tx=0x7f7810008040 comp rx=0 tx=0).stop 2023-06-10T19:04:59.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.352+0000 7f782e50a640 1 -- 172.21.15.53:0/3115631826 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f78280cc690 msgr2=0x7f78280cba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:59.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.352+0000 7f782e50a640 1 --2- 172.21.15.53:0/3115631826 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f78280cc690 0x7f78280cba80 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7f7818001570 tx=0x7f781800cd20 comp rx=0 tx=0).stop 2023-06-10T19:04:59.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.352+0000 7f782e50a640 1 -- 172.21.15.53:0/3115631826 shutdown_connections 2023-06-10T19:04:59.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.352+0000 7f782e50a640 1 --2- 172.21.15.53:0/3115631826 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7808066280 0x7f7808068730 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:59.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.352+0000 7f782e50a640 1 --2- 172.21.15.53:0/3115631826 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78280d14c0 0x7f78280b1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:59.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.352+0000 7f782e50a640 1 --2- 172.21.15.53:0/3115631826 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f78280cc690 0x7f78280cba80 unknown :-1 s=CLOSED pgs=1847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:59.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.352+0000 7f782e50a640 1 --2- 172.21.15.53:0/3115631826 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f78280b3ac0 0x7f7828152180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:59.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.352+0000 7f782e50a640 1 -- 172.21.15.53:0/3115631826 >> 172.21.15.53:0/3115631826 conn(0x7f7828071790 msgr2=0x7f78280b67c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:04:59.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.352+0000 7f782e50a640 1 -- 172.21.15.53:0/3115631826 shutdown_connections 2023-06-10T19:04:59.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.352+0000 7f782e50a640 1 -- 172.21.15.53:0/3115631826 wait complete. 2023-06-10T19:04:59.374 INFO:tasks.ceph.mds.a:Restarting daemon 2023-06-10T19:04:59.375 INFO:tasks.ceph.mds.a:Stopping old one... 2023-06-10T19:04:59.376 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-06-10T19:04:59.376 INFO:teuthology.orchestra.run:waiting for 300 2023-06-10T19:04:59.376 INFO:tasks.ceph.mds.c:Restarting daemon 2023-06-10T19:04:59.376 INFO:tasks.ceph.mds.c:Stopping old one... 2023-06-10T19:04:59.377 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-06-10T19:04:59.377 INFO:teuthology.orchestra.run:waiting for 300 2023-06-10T19:04:59.377 INFO:tasks.ceph.mds.b:Restarting daemon 2023-06-10T19:04:59.378 INFO:tasks.ceph.mds.b:Stopping old one... 2023-06-10T19:04:59.378 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-06-10T19:04:59.378 INFO:teuthology.orchestra.run:waiting for 300 2023-06-10T19:04:59.378 INFO:tasks.ceph.mds.d:Restarting daemon 2023-06-10T19:04:59.378 INFO:tasks.ceph.mds.d:Stopping old one... 2023-06-10T19:04:59.379 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-06-10T19:04:59.379 INFO:teuthology.orchestra.run:waiting for 300 2023-06-10T19:04:59.387 INFO:tasks.ceph.mds.a:Stopped 2023-06-10T19:04:59.388 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-06-10T19:04:59.389 INFO:tasks.ceph.mds.c:Stopped 2023-06-10T19:04:59.390 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-06-10T19:04:59.392 INFO:tasks.ceph.mds.d:Stopped 2023-06-10T19:04:59.392 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-06-10T19:04:59.393 INFO:tasks.ceph.mds.b:Stopped 2023-06-10T19:04:59.394 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-06-10T19:04:59.438 INFO:tasks.ceph.mds.a:Started 2023-06-10T19:04:59.438 DEBUG:teuthology.parallel:result is None 2023-06-10T19:04:59.440 INFO:tasks.ceph.mds.c:Started 2023-06-10T19:04:59.440 INFO:tasks.ceph.mds.d:Started 2023-06-10T19:04:59.441 DEBUG:teuthology.parallel:result is None 2023-06-10T19:04:59.441 DEBUG:teuthology.parallel:result is None 2023-06-10T19:04:59.442 INFO:tasks.ceph.mds.b:Started 2023-06-10T19:04:59.442 DEBUG:teuthology.parallel:result is None 2023-06-10T19:04:59.443 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-06-10T19:04:59.495 INFO:tasks.ceph.mds.a.smithi053.stdout:starting mds.a at 2023-06-10T19:04:59.497 INFO:tasks.ceph.mds.c.smithi053.stdout:starting mds.c at 2023-06-10T19:04:59.510 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2023-06-10T19:04:59.516 INFO:tasks.ceph.mds.d.smithi117.stdout:starting mds.d at 2023-06-10T19:04:59.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.552+0000 7f9d1d7eb640 1 Processor -- start 2023-06-10T19:04:59.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.552+0000 7f9d1d7eb640 1 -- start start 2023-06-10T19:04:59.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.552+0000 7f9d1d7eb640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d180cf0c0 0x7f9d180cc660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:59.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.552+0000 7f9d1d7eb640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d180cbac0 con 0x7f9d18159450 2023-06-10T19:04:59.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.552+0000 7f9d1d7eb640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d180cf540 con 0x7f9d180cec40 2023-06-10T19:04:59.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.552+0000 7f9d1d7eb640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d1815dc00 con 0x7f9d180cf0c0 2023-06-10T19:04:59.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.552+0000 7f9d16ffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f9d18159450 0x7f9d1815d140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:40976/0 (socket says 172.21.15.53:40976) 2023-06-10T19:04:59.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.552+0000 7f9d16ffd640 1 -- 172.21.15.53:0/3571602312 learned_addr learned my addr 172.21.15.53:0/3571602312 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:04:59.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.552+0000 7f9d177fe640 1 --2- 172.21.15.53:0/3571602312 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d180cf0c0 0x7f9d180cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:59.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.552+0000 7f9d15ffb640 1 -- 172.21.15.53:0/3571602312 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 889398595 0 0) 0x7f9d180cbac0 con 0x7f9d18159450 2023-06-10T19:04:59.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.552+0000 7f9d15ffb640 1 -- 172.21.15.53:0/3571602312 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d04003530 con 0x7f9d18159450 2023-06-10T19:04:59.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.552+0000 7f9d15ffb640 1 -- 172.21.15.53:0/3571602312 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3230984969 0 0) 0x7f9d04003530 con 0x7f9d18159450 2023-06-10T19:04:59.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.552+0000 7f9d15ffb640 1 -- 172.21.15.53:0/3571602312 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d180cf0c0 msgr2=0x7f9d180cc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:04:59.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.552+0000 7f9d15ffb640 1 --2- 172.21.15.53:0/3571602312 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d180cf0c0 0x7f9d180cc660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:59.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.552+0000 7f9d15ffb640 1 -- 172.21.15.53:0/3571602312 >> v1:172.21.15.117:6789/0 conn(0x7f9d180cec40 legacy=0x7f9d180cbf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:59.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.552+0000 7f9d15ffb640 1 -- 172.21.15.53:0/3571602312 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d1815dee0 con 0x7f9d18159450 2023-06-10T19:04:59.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.552+0000 7f9d15ffb640 1 -- 172.21.15.53:0/3571602312 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f9d10001680 con 0x7f9d18159450 2023-06-10T19:04:59.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.552+0000 7f9d15ffb640 1 -- 172.21.15.53:0/3571602312 >> v1:172.21.15.53:6789/0 conn(0x7f9d18159450 legacy=0x7f9d1815d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:59.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.552+0000 7f9d15ffb640 1 --2- 172.21.15.53:0/3571602312 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d040039b0 0x7f9d04003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:59.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.552+0000 7f9d15ffb640 1 --2- 172.21.15.53:0/3571602312 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d04004350 0x7f9d04004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:59.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.552+0000 7f9d15ffb640 1 --2- 172.21.15.53:0/3571602312 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d180cf0c0 0x7f9d04005070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:59.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.552+0000 7f9d15ffb640 1 -- 172.21.15.53:0/3571602312 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d1815dc00 con 0x7f9d040039b0 2023-06-10T19:04:59.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.552+0000 7f9d15ffb640 1 -- 172.21.15.53:0/3571602312 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d0400b990 con 0x7f9d04004350 2023-06-10T19:04:59.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.552+0000 7f9d15ffb640 1 -- 172.21.15.53:0/3571602312 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d0400bb20 con 0x7f9d180cf0c0 2023-06-10T19:04:59.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.552+0000 7f9d16ffd640 1 --2- 172.21.15.53:0/3571602312 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d040039b0 0x7f9d04003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:59.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.552+0000 7f9d177fe640 1 --2- 172.21.15.53:0/3571602312 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d180cf0c0 0x7f9d04005070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:59.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.552+0000 7f9d167fc640 1 --2- 172.21.15.53:0/3571602312 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d04004350 0x7f9d04004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:59.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.552+0000 7f9d16ffd640 1 -- 172.21.15.53:0/3571602312 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d180cf0c0 msgr2=0x7f9d04005070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:04:59.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.552+0000 7f9d16ffd640 1 --2- 172.21.15.53:0/3571602312 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d180cf0c0 0x7f9d04005070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:59.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.552+0000 7f9d16ffd640 1 -- 172.21.15.53:0/3571602312 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d04004350 msgr2=0x7f9d04004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:04:59.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.552+0000 7f9d16ffd640 1 --2- 172.21.15.53:0/3571602312 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d04004350 0x7f9d04004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:59.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.552+0000 7f9d16ffd640 1 -- 172.21.15.53:0/3571602312 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d04003530 con 0x7f9d040039b0 2023-06-10T19:04:59.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.552+0000 7f9d167fc640 1 --2- 172.21.15.53:0/3571602312 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d04004350 0x7f9d04004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:04:59.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.556+0000 7f9d16ffd640 1 --2- 172.21.15.53:0/3571602312 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d040039b0 0x7f9d04003d80 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7f9d1000c210 tx=0x7f9d1001cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef5cc0252726415b server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:59.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.556+0000 7f9d15ffb640 1 -- 172.21.15.53:0/3571602312 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d10005ae0 con 0x7f9d040039b0 2023-06-10T19:04:59.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.556+0000 7f9d15ffb640 1 -- 172.21.15.53:0/3571602312 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d10005c60 con 0x7f9d040039b0 2023-06-10T19:04:59.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.556+0000 7f9d15ffb640 1 -- 172.21.15.53:0/3571602312 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d100a58d0 con 0x7f9d040039b0 2023-06-10T19:04:59.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.556+0000 7f9d1d7eb640 1 -- 172.21.15.53:0/3571602312 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d040039b0 msgr2=0x7f9d04003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:59.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.556+0000 7f9d1d7eb640 1 --2- 172.21.15.53:0/3571602312 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d040039b0 0x7f9d04003d80 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7f9d1000c210 tx=0x7f9d1001cc30 comp rx=0 tx=0).stop 2023-06-10T19:04:59.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.556+0000 7f9d177fe640 1 -- 172.21.15.53:0/3571602312 reap_dead start 2023-06-10T19:04:59.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.556+0000 7f9d1d7eb640 1 -- 172.21.15.53:0/3571602312 shutdown_connections 2023-06-10T19:04:59.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.556+0000 7f9d1d7eb640 1 -- 172.21.15.53:0/3571602312 >> 172.21.15.53:0/3571602312 conn(0x7f9d1806a0b0 msgr2=0x7f9d1806d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:04:59.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.556+0000 7f9d1d7eb640 1 -- 172.21.15.53:0/3571602312 shutdown_connections 2023-06-10T19:04:59.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.556+0000 7f9d1d7eb640 1 -- 172.21.15.53:0/3571602312 wait complete. 2023-06-10T19:04:59.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.556+0000 7f9d1d7eb640 1 Processor -- start 2023-06-10T19:04:59.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.556+0000 7f9d1d7eb640 1 -- start start 2023-06-10T19:04:59.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.556+0000 7f9d1d7eb640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d040039b0 0x7f9d1814ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:59.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.556+0000 7f9d1d7eb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d18153610 0x7f9d18154530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:59.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.556+0000 7f9d1d7eb640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d18153a80 0x7f9d18154a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:59.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.556+0000 7f9d1d7eb640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d181f1e10 con 0x7f9d18153610 2023-06-10T19:04:59.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.556+0000 7f9d1d7eb640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d181f20f0 con 0x7f9d18153a80 2023-06-10T19:04:59.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.556+0000 7f9d1d7eb640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d181f23d0 con 0x7f9d040039b0 2023-06-10T19:04:59.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.556+0000 7f9d167fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d18153610 0x7f9d18154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:59.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.556+0000 7f9d167fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d18153610 0x7f9d18154530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37924/0 (socket says 172.21.15.53:37924) 2023-06-10T19:04:59.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.556+0000 7f9d167fc640 1 -- 172.21.15.53:0/3053825557 learned_addr learned my addr 172.21.15.53:0/3053825557 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:04:59.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.556+0000 7f9d16ffd640 1 --2- 172.21.15.53:0/3053825557 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d040039b0 0x7f9d1814ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:59.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.556+0000 7f9d177fe640 1 --2- 172.21.15.53:0/3053825557 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d18153a80 0x7f9d18154a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:59.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.556+0000 7f9d167fc640 1 -- 172.21.15.53:0/3053825557 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d040039b0 msgr2=0x7f9d1814ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:59.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.556+0000 7f9d167fc640 1 --2- 172.21.15.53:0/3053825557 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d040039b0 0x7f9d1814ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:59.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.556+0000 7f9d167fc640 1 -- 172.21.15.53:0/3053825557 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d18153a80 msgr2=0x7f9d18154a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:04:59.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.556+0000 7f9d167fc640 1 --2- 172.21.15.53:0/3053825557 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d18153a80 0x7f9d18154a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:04:59.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.556+0000 7f9d167fc640 1 -- 172.21.15.53:0/3053825557 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d1815d9d0 con 0x7f9d18153610 2023-06-10T19:04:59.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.556+0000 7f9d167fc640 1 --2- 172.21.15.53:0/3053825557 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d18153610 0x7f9d18154530 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7f9d0000e5d0 tx=0x7f9d0000ea90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:59.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.560+0000 7f9d0f7fe640 1 -- 172.21.15.53:0/3053825557 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d000052e0 con 0x7f9d18153610 2023-06-10T19:04:59.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.560+0000 7f9d0f7fe640 1 -- 172.21.15.53:0/3053825557 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d00005440 con 0x7f9d18153610 2023-06-10T19:04:59.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.560+0000 7f9d0f7fe640 1 -- 172.21.15.53:0/3053825557 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d00003840 con 0x7f9d18153610 2023-06-10T19:04:59.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.560+0000 7f9d1d7eb640 1 -- 172.21.15.53:0/3053825557 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d181f26b0 con 0x7f9d18153610 2023-06-10T19:04:59.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.560+0000 7f9d1d7eb640 1 -- 172.21.15.53:0/3053825557 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d18159820 con 0x7f9d18153610 2023-06-10T19:04:59.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.560+0000 7f9d1d7eb640 1 -- 172.21.15.53:0/3053825557 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d1804d790 con 0x7f9d18153610 2023-06-10T19:04:59.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.560+0000 7f9d0f7fe640 1 -- 172.21.15.53:0/3053825557 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9d000039a0 con 0x7f9d18153610 2023-06-10T19:04:59.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.560+0000 7f9d0f7fe640 1 --2- 172.21.15.53:0/3053825557 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9cf8066280 0x7f9cf8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:04:59.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.560+0000 7f9d0f7fe640 1 -- 172.21.15.53:0/3053825557 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f9d000837f0 con 0x7f9d18153610 2023-06-10T19:04:59.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.560+0000 7f9d16ffd640 1 --2- 172.21.15.53:0/3053825557 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9cf8066280 0x7f9cf8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:04:59.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.560+0000 7f9d16ffd640 1 --2- 172.21.15.53:0/3053825557 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9cf8066280 0x7f9cf8068730 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f9d100ab000 tx=0x7f9d100a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:04:59.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.564+0000 7f9d0f7fe640 1 -- 172.21.15.53:0/3053825557 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9d00050f60 con 0x7f9d18153610 2023-06-10T19:04:59.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:04:59.732+0000 7f9d1d7eb640 1 -- 172.21.15.53:0/3053825557 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f9d181f2b60 con 0x7f9d18153610 2023-06-10T19:05:00.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.548+0000 7f9d0f7fe640 1 -- 172.21.15.53:0/3053825557 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v121) v1 ==== 97+0+0 (secure 0 0 0) 0x7f9d00054580 con 0x7f9d18153610 2023-06-10T19:05:00.552 INFO:teuthology.orchestra.run.smithi053.stderr: removed all blocklist entries 2023-06-10T19:05:00.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.552+0000 7f9d1d7eb640 1 -- 172.21.15.53:0/3053825557 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9cf8066280 msgr2=0x7f9cf8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:00.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.552+0000 7f9d1d7eb640 1 --2- 172.21.15.53:0/3053825557 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9cf8066280 0x7f9cf8068730 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f9d100ab000 tx=0x7f9d100a7070 comp rx=0 tx=0).stop 2023-06-10T19:05:00.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.552+0000 7f9d1d7eb640 1 -- 172.21.15.53:0/3053825557 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d18153610 msgr2=0x7f9d18154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:00.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.552+0000 7f9d1d7eb640 1 --2- 172.21.15.53:0/3053825557 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d18153610 0x7f9d18154530 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7f9d0000e5d0 tx=0x7f9d0000ea90 comp rx=0 tx=0).stop 2023-06-10T19:05:00.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.552+0000 7f9d1d7eb640 1 -- 172.21.15.53:0/3053825557 shutdown_connections 2023-06-10T19:05:00.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.552+0000 7f9d1d7eb640 1 --2- 172.21.15.53:0/3053825557 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9cf8066280 0x7f9cf8068730 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:00.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.552+0000 7f9d1d7eb640 1 --2- 172.21.15.53:0/3053825557 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d18153a80 0x7f9d18154a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:00.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.552+0000 7f9d1d7eb640 1 --2- 172.21.15.53:0/3053825557 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d18153610 0x7f9d18154530 unknown :-1 s=CLOSED pgs=1857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:00.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.552+0000 7f9d1d7eb640 1 --2- 172.21.15.53:0/3053825557 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d040039b0 0x7f9d1814ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:00.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.552+0000 7f9d1d7eb640 1 -- 172.21.15.53:0/3053825557 >> 172.21.15.53:0/3053825557 conn(0x7f9d1806a0b0 msgr2=0x7f9d180b2c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:00.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.552+0000 7f9d1d7eb640 1 -- 172.21.15.53:0/3053825557 shutdown_connections 2023-06-10T19:05:00.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.552+0000 7f9d1d7eb640 1 -- 172.21.15.53:0/3053825557 wait complete. 2023-06-10T19:05:00.577 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-06-10T19:05:00.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.700+0000 7f5fe3ed2640 1 Processor -- start 2023-06-10T19:05:00.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.700+0000 7f5fe3ed2640 1 -- start start 2023-06-10T19:05:00.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.700+0000 7f5fe3ed2640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5fdc159450 0x7f5fdc15d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:00.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.700+0000 7f5fe3ed2640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5fdc15d680 0x7f5fdc0cec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:00.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.700+0000 7f5fe3ed2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fdc0cf180 0x7f5fdc0cda20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:00.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.700+0000 7f5fe3ed2640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fdc0cf600 con 0x7f5fdc15d680 2023-06-10T19:05:00.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.700+0000 7f5fe3ed2640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fdc0cbac0 con 0x7f5fdc159450 2023-06-10T19:05:00.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.700+0000 7f5fe3ed2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fdc15dc00 con 0x7f5fdc0cf180 2023-06-10T19:05:00.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.700+0000 7f5fe146d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5fdc15d680 0x7f5fdc0cec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:00.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.700+0000 7f5fe146d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5fdc15d680 0x7f5fdc0cec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37932/0 (socket says 172.21.15.53:37932) 2023-06-10T19:05:00.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.700+0000 7f5fe146d640 1 -- 172.21.15.53:0/856315572 learned_addr learned my addr 172.21.15.53:0/856315572 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:00.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.700+0000 7f5fe246f640 1 --2- 172.21.15.53:0/856315572 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fdc0cf180 0x7f5fdc0cda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:00.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.700+0000 7f5fe146d640 1 -- 172.21.15.53:0/856315572 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fdc0cf180 msgr2=0x7f5fdc0cda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:00.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.700+0000 7f5fe1c6e640 1 --2- 172.21.15.53:0/856315572 >> v2:172.21.15.117:3300/0 conn(0x7f5fdc159450 0x7f5fdc15d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:00.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.700+0000 7f5fe146d640 1 --2- 172.21.15.53:0/856315572 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fdc0cf180 0x7f5fdc0cda20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:00.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.700+0000 7f5fe146d640 1 -- 172.21.15.53:0/856315572 >> v2:172.21.15.117:3300/0 conn(0x7f5fdc159450 msgr2=0x7f5fdc15d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:00.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.700+0000 7f5fe146d640 1 --2- 172.21.15.53:0/856315572 >> v2:172.21.15.117:3300/0 conn(0x7f5fdc159450 0x7f5fdc15d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:00.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.700+0000 7f5fe146d640 1 -- 172.21.15.53:0/856315572 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fdc15dee0 con 0x7f5fdc15d680 2023-06-10T19:05:00.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.700+0000 7f5fe1c6e640 1 --2- 172.21.15.53:0/856315572 >> v2:172.21.15.117:3300/0 conn(0x7f5fdc159450 0x7f5fdc15d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:05:00.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.704+0000 7f5fe146d640 1 --2- 172.21.15.53:0/856315572 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5fdc15d680 0x7f5fdc0cec40 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc0b29a0 tx=0x7f5fd001c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a8d888c39c9cb6a server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:00.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.704+0000 7f5fe0c6c640 1 -- 172.21.15.53:0/856315572 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd00ab600 con 0x7f5fdc15d680 2023-06-10T19:05:00.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.704+0000 7f5fe0c6c640 1 -- 172.21.15.53:0/856315572 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fd00a7050 con 0x7f5fdc15d680 2023-06-10T19:05:00.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.704+0000 7f5fe0c6c640 1 -- 172.21.15.53:0/856315572 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd00ab980 con 0x7f5fdc15d680 2023-06-10T19:05:00.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.704+0000 7f5fe3ed2640 1 -- 172.21.15.53:0/856315572 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5fdc15d680 msgr2=0x7f5fdc0cec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:00.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.704+0000 7f5fe3ed2640 1 --2- 172.21.15.53:0/856315572 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5fdc15d680 0x7f5fdc0cec40 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc0b29a0 tx=0x7f5fd001c210 comp rx=0 tx=0).stop 2023-06-10T19:05:00.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.704+0000 7f5fe3ed2640 1 -- 172.21.15.53:0/856315572 shutdown_connections 2023-06-10T19:05:00.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.704+0000 7f5fe3ed2640 1 --2- 172.21.15.53:0/856315572 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fdc0cf180 0x7f5fdc0cda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:00.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.704+0000 7f5fe3ed2640 1 --2- 172.21.15.53:0/856315572 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5fdc15d680 0x7f5fdc0cec40 unknown :-1 s=CLOSED pgs=1858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:00.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.704+0000 7f5fe3ed2640 1 --2- 172.21.15.53:0/856315572 >> v2:172.21.15.117:3300/0 conn(0x7f5fdc159450 0x7f5fdc15d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:00.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.704+0000 7f5fe3ed2640 1 -- 172.21.15.53:0/856315572 >> 172.21.15.53:0/856315572 conn(0x7f5fdc06a090 msgr2=0x7f5fdc06d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:00.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.704+0000 7f5fe3ed2640 1 -- 172.21.15.53:0/856315572 shutdown_connections 2023-06-10T19:05:00.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.704+0000 7f5fe3ed2640 1 -- 172.21.15.53:0/856315572 wait complete. 2023-06-10T19:05:00.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.704+0000 7f5fe3ed2640 1 Processor -- start 2023-06-10T19:05:00.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.704+0000 7f5fe3ed2640 1 -- start start 2023-06-10T19:05:00.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.704+0000 7f5fe3ed2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fdc0cf180 0x7f5fdc0b39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:00.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.704+0000 7f5fe3ed2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5fdc159450 0x7f5fdc0c9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:00.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.704+0000 7f5fe3ed2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fdc15d680 0x7f5fdc1f3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:00.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.704+0000 7f5fe3ed2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fdc0c9ba0 con 0x7f5fdc159450 2023-06-10T19:05:00.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.704+0000 7f5fe3ed2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fdc155130 con 0x7f5fdc0cf180 2023-06-10T19:05:00.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.704+0000 7f5fe3ed2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fdc1f47c0 con 0x7f5fdc15d680 2023-06-10T19:05:00.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.704+0000 7f5fe146d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5fdc159450 0x7f5fdc0c9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:00.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.704+0000 7f5fe146d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5fdc159450 0x7f5fdc0c9660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37934/0 (socket says 172.21.15.53:37934) 2023-06-10T19:05:00.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.704+0000 7f5fe146d640 1 -- 172.21.15.53:0/366089122 learned_addr learned my addr 172.21.15.53:0/366089122 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:00.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.704+0000 7f5fe246f640 1 --2- 172.21.15.53:0/366089122 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fdc15d680 0x7f5fdc1f3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:00.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.704+0000 7f5fe146d640 1 -- 172.21.15.53:0/366089122 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fdc15d680 msgr2=0x7f5fdc1f3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:00.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.704+0000 7f5fe1c6e640 1 --2- 172.21.15.53:0/366089122 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fdc0cf180 0x7f5fdc0b39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:00.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.704+0000 7f5fe146d640 1 --2- 172.21.15.53:0/366089122 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fdc15d680 0x7f5fdc1f3ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:00.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.704+0000 7f5fe146d640 1 -- 172.21.15.53:0/366089122 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fdc0cf180 msgr2=0x7f5fdc0b39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:00.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.704+0000 7f5fe146d640 1 --2- 172.21.15.53:0/366089122 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fdc0cf180 0x7f5fdc0b39c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:00.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.704+0000 7f5fe146d640 1 -- 172.21.15.53:0/366089122 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fd00094d0 con 0x7f5fdc159450 2023-06-10T19:05:00.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.704+0000 7f5fe146d640 1 --2- 172.21.15.53:0/366089122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5fdc159450 0x7f5fdc0c9660 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 crypto rx=0x7f5fd001cab0 tx=0x7f5fd0018fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:00.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.708+0000 7f5fce7fc640 1 -- 172.21.15.53:0/366089122 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd00ba070 con 0x7f5fdc159450 2023-06-10T19:05:00.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.708+0000 7f5fce7fc640 1 -- 172.21.15.53:0/366089122 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fd00b5710 con 0x7f5fdc159450 2023-06-10T19:05:00.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.708+0000 7f5fce7fc640 1 -- 172.21.15.53:0/366089122 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd00b5a80 con 0x7f5fdc159450 2023-06-10T19:05:00.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.708+0000 7f5fe3ed2640 1 -- 172.21.15.53:0/366089122 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fdc1f4aa0 con 0x7f5fdc159450 2023-06-10T19:05:00.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.708+0000 7f5fe3ed2640 1 -- 172.21.15.53:0/366089122 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fdc1553f0 con 0x7f5fdc159450 2023-06-10T19:05:00.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.708+0000 7f5fce7fc640 1 -- 172.21.15.53:0/366089122 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5fd00b5be0 con 0x7f5fdc159450 2023-06-10T19:05:00.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.708+0000 7f5fe3ed2640 1 -- 172.21.15.53:0/366089122 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fdc04d790 con 0x7f5fdc159450 2023-06-10T19:05:00.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.708+0000 7f5fce7fc640 1 --2- 172.21.15.53:0/366089122 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5fc0066280 0x7f5fc0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:00.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.708+0000 7f5fce7fc640 1 -- 172.21.15.53:0/366089122 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f5fd011de20 con 0x7f5fdc159450 2023-06-10T19:05:00.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.708+0000 7f5fe1c6e640 1 --2- 172.21.15.53:0/366089122 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5fc0066280 0x7f5fc0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:00.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.708+0000 7f5fe1c6e640 1 --2- 172.21.15.53:0/366089122 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5fc0066280 0x7f5fc0068730 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f5fd800b7e0 tx=0x7f5fd8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:00.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.712+0000 7f5fce7fc640 1 -- 172.21.15.53:0/366089122 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5fd00eb4d0 con 0x7f5fdc159450 2023-06-10T19:05:00.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.920+0000 7f5fe3ed2640 1 -- 172.21.15.53:0/366089122 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f5fdc06df70 con 0x7f5fdc159450 2023-06-10T19:05:00.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.920+0000 7f5fce7fc640 1 -- 172.21.15.53:0/366089122 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v18) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f5fd00eeaf0 con 0x7f5fdc159450 2023-06-10T19:05:00.926 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:05:00.927 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-06-10T19:05:00.927 INFO:teuthology.orchestra.run.smithi053.stdout: "auth_dump": [ 2023-06-10T19:05:00.927 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:05:00.927 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.a", 2023-06-10T19:05:00.927 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkWqEQBhAAW+iEw0Gxfw744rsYc/tfTQ==", 2023-06-10T19:05:00.927 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:05:00.927 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T19:05:00.928 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2023-06-10T19:05:00.928 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2023-06-10T19:05:00.928 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:05:00.928 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:05:00.928 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:05:00.928 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:05:00.929 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.b", 2023-06-10T19:05:00.929 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkSu02FRAAFpo6NpcwDLZUt2Rgk/wm8w==", 2023-06-10T19:05:00.929 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:05:00.929 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T19:05:00.929 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2023-06-10T19:05:00.929 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2023-06-10T19:05:00.929 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:05:00.929 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:05:00.930 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:05:00.930 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:05:00.930 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.c", 2023-06-10T19:05:00.930 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRk19/ODhAAodfGGNLP7UbNhHySgaukrg==", 2023-06-10T19:05:00.930 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:05:00.930 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T19:05:00.930 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2023-06-10T19:05:00.931 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2023-06-10T19:05:00.931 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:05:00.931 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:05:00.931 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:05:00.931 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:05:00.931 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.d", 2023-06-10T19:05:00.931 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkogwkGxAAIavVKa8GtML1XQDEMwwokQ==", 2023-06-10T19:05:00.931 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:05:00.932 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T19:05:00.932 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2023-06-10T19:05:00.932 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2023-06-10T19:05:00.932 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:05:00.932 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:05:00.932 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:05:00.932 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:05:00.933 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.0", 2023-06-10T19:05:00.933 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA7xoRkoj1OMhAAYFc4W5kAlMBqY2yzeJZXQw==", 2023-06-10T19:05:00.933 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:05:00.933 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T19:05:00.933 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T19:05:00.933 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:05:00.933 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:05:00.933 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:05:00.934 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:05:00.934 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.1", 2023-06-10T19:05:00.934 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA+xoRk6FpDOBAALjxW3eaIh3Gu9b1rmMmqfw==", 2023-06-10T19:05:00.934 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:05:00.934 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T19:05:00.934 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T19:05:00.935 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:05:00.935 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:05:00.935 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:05:00.935 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:05:00.935 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.2", 2023-06-10T19:05:00.935 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBCxoRkaO2GBRAA0Xr5en+n5DxhZDg8kVswpQ==", 2023-06-10T19:05:00.935 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:05:00.936 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T19:05:00.936 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T19:05:00.936 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:05:00.936 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:05:00.936 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:05:00.936 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:05:00.936 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.3", 2023-06-10T19:05:00.936 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBFxoRkjfsBDhAAArYYrPnmXu5VcUMGVjQXZg==", 2023-06-10T19:05:00.937 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:05:00.937 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T19:05:00.937 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T19:05:00.937 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:05:00.937 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:05:00.937 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:05:00.937 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:05:00.937 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.4", 2023-06-10T19:05:00.938 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBLxoRkybumChAAdym/nl9bzyI71flvuy9Vtw==", 2023-06-10T19:05:00.938 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:05:00.938 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T19:05:00.938 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T19:05:00.938 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:05:00.938 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:05:00.938 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:05:00.938 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:05:00.939 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.5", 2023-06-10T19:05:00.939 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBOxoRkinSGIRAAwLbgYKI4NsbHKqGo9O4WuQ==", 2023-06-10T19:05:00.939 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:05:00.939 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T19:05:00.939 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T19:05:00.939 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:05:00.939 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:05:00.939 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:05:00.940 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:05:00.940 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.6", 2023-06-10T19:05:00.940 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBRxoRkj7VlKRAAs2ReBZ5iqtr17Nli9kUtGQ==", 2023-06-10T19:05:00.940 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:05:00.940 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T19:05:00.940 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T19:05:00.940 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:05:00.941 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:05:00.941 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:05:00.941 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:05:00.941 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.7", 2023-06-10T19:05:00.941 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBUxoRk48CnMhAASfbeuCo9jDuHQrYDQ8Vt3A==", 2023-06-10T19:05:00.941 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:05:00.941 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T19:05:00.941 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T19:05:00.942 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:05:00.942 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:05:00.942 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:05:00.942 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:05:00.942 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.0", 2023-06-10T19:05:00.942 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkgey1IBAAkNYrXMgUOnavBY/5uGyFrw==", 2023-06-10T19:05:00.942 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:05:00.943 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T19:05:00.943 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow r", 2023-06-10T19:05:00.943 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-06-10T19:05:00.943 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:05:00.943 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:05:00.943 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:05:00.943 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.1", 2023-06-10T19:05:00.944 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkBw+UKBAAuvT+vXmJLG5CvQVg5xItDQ==", 2023-06-10T19:05:00.944 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:05:00.944 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T19:05:00.944 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow r", 2023-06-10T19:05:00.944 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow rw", 2023-06-10T19:05:00.944 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rwx" 2023-06-10T19:05:00.945 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:05:00.945 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:05:00.945 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:05:00.945 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.2", 2023-06-10T19:05:00.945 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkewjeJRAA4pmIEVJ3Z7GKQFmA54CZ5Q==", 2023-06-10T19:05:00.945 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:05:00.945 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T19:05:00.946 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow r", 2023-06-10T19:05:00.946 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow rw", 2023-06-10T19:05:00.946 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rwx" 2023-06-10T19:05:00.946 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:05:00.946 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:05:00.946 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:05:00.946 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.3", 2023-06-10T19:05:00.947 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkHwCiLRAAWGt8UoWxGlG1Y1zSPbKUCg==", 2023-06-10T19:05:00.947 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:05:00.947 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T19:05:00.947 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow r", 2023-06-10T19:05:00.947 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow rw", 2023-06-10T19:05:00.947 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rwx" 2023-06-10T19:05:00.947 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:05:00.948 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:05:00.948 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:05:00.948 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.admin", 2023-06-10T19:05:00.948 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA5xoRkIVgrKBAABIxiaOPe9h5ne2y2l50aMg==", 2023-06-10T19:05:00.948 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:05:00.948 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow *", 2023-06-10T19:05:00.949 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2023-06-10T19:05:00.949 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2023-06-10T19:05:00.949 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:05:00.949 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:05:00.949 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:05:00.949 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:05:00.950 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mgr.x", 2023-06-10T19:05:00.950 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkzWG3AhAAh3NFYHAbp4fgn4FZeRRNuw==", 2023-06-10T19:05:00.950 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:05:00.950 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow *", 2023-06-10T19:05:00.950 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile mgr", 2023-06-10T19:05:00.950 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:05:00.951 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:05:00.951 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:05:00.951 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:05:00.951 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mgr.y", 2023-06-10T19:05:00.951 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA5xoRkBriKOxAA6G+T7Yp2rH7XV7z37lvMYQ==", 2023-06-10T19:05:00.951 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:05:00.952 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow *", 2023-06-10T19:05:00.952 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile mgr", 2023-06-10T19:05:00.952 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:05:00.952 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:05:00.952 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:05:00.953 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2023-06-10T19:05:00.953 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-06-10T19:05:00.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.924+0000 7f5fe3ed2640 1 -- 172.21.15.53:0/366089122 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5fc0066280 msgr2=0x7f5fc0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:00.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.924+0000 7f5fe3ed2640 1 --2- 172.21.15.53:0/366089122 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5fc0066280 0x7f5fc0068730 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f5fd800b7e0 tx=0x7f5fd8008040 comp rx=0 tx=0).stop 2023-06-10T19:05:00.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.924+0000 7f5fe3ed2640 1 -- 172.21.15.53:0/366089122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5fdc159450 msgr2=0x7f5fdc0c9660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:00.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.924+0000 7f5fe3ed2640 1 --2- 172.21.15.53:0/366089122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5fdc159450 0x7f5fdc0c9660 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 crypto rx=0x7f5fd001cab0 tx=0x7f5fd0018fb0 comp rx=0 tx=0).stop 2023-06-10T19:05:00.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.924+0000 7f5fe3ed2640 1 -- 172.21.15.53:0/366089122 shutdown_connections 2023-06-10T19:05:00.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.924+0000 7f5fe3ed2640 1 --2- 172.21.15.53:0/366089122 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5fc0066280 0x7f5fc0068730 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:00.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.924+0000 7f5fe3ed2640 1 --2- 172.21.15.53:0/366089122 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5fdc15d680 0x7f5fdc1f3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:00.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.924+0000 7f5fe3ed2640 1 --2- 172.21.15.53:0/366089122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5fdc159450 0x7f5fdc0c9660 unknown :-1 s=CLOSED pgs=1859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:00.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.924+0000 7f5fe3ed2640 1 --2- 172.21.15.53:0/366089122 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fdc0cf180 0x7f5fdc0b39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:00.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.924+0000 7f5fe3ed2640 1 -- 172.21.15.53:0/366089122 >> 172.21.15.53:0/366089122 conn(0x7f5fdc06a090 msgr2=0x7f5fdc06bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:00.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.924+0000 7f5fe3ed2640 1 -- 172.21.15.53:0/366089122 shutdown_connections 2023-06-10T19:05:00.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:00.924+0000 7f5fe3ed2640 1 -- 172.21.15.53:0/366089122 wait complete. 2023-06-10T19:05:00.956 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:05:01.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.080+0000 7fdecb310640 1 Processor -- start 2023-06-10T19:05:01.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.080+0000 7fdecb310640 1 -- start start 2023-06-10T19:05:01.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.080+0000 7fdecb310640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fdec4162640 0x7fdec4164a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:01.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.080+0000 7fdecb310640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdec4159b50 con 0x7fdec4071060 2023-06-10T19:05:01.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.080+0000 7fdecb310640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdec40702a0 con 0x7fdec40c9840 2023-06-10T19:05:01.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.080+0000 7fdecb310640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdec4070580 con 0x7fdec4162640 2023-06-10T19:05:01.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.080+0000 7fdec88ab640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fdec4071060 0x7fdec40af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:40990/0 (socket says 172.21.15.53:40990) 2023-06-10T19:05:01.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.080+0000 7fdec88ab640 1 -- 172.21.15.53:0/3290494569 learned_addr learned my addr 172.21.15.53:0/3290494569 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:05:01.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.080+0000 7fdec98ad640 1 --2- 172.21.15.53:0/3290494569 >> v2:172.21.15.117:3300/0 conn(0x7fdec4162640 0x7fdec4164a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:01.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.080+0000 7fdebbfff640 1 -- 172.21.15.53:0/3290494569 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3577792097 0 0) 0x7fdec4159b50 con 0x7fdec4071060 2023-06-10T19:05:01.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.080+0000 7fdebbfff640 1 -- 172.21.15.53:0/3290494569 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdeb0003530 con 0x7fdec4071060 2023-06-10T19:05:01.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.080+0000 7fdebbfff640 1 -- 172.21.15.53:0/3290494569 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3992115729 0 0) 0x7fdeb0003530 con 0x7fdec4071060 2023-06-10T19:05:01.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.080+0000 7fdebbfff640 1 -- 172.21.15.53:0/3290494569 >> v2:172.21.15.117:3300/0 conn(0x7fdec4162640 msgr2=0x7fdec4164a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:01.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.080+0000 7fdebbfff640 1 --2- 172.21.15.53:0/3290494569 >> v2:172.21.15.117:3300/0 conn(0x7fdec4162640 0x7fdec4164a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:01.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.080+0000 7fdebbfff640 1 -- 172.21.15.53:0/3290494569 >> v1:172.21.15.117:6789/0 conn(0x7fdec40c9840 legacy=0x7fdec40c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:01.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.080+0000 7fdebbfff640 1 -- 172.21.15.53:0/3290494569 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdec4070860 con 0x7fdec4071060 2023-06-10T19:05:01.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.080+0000 7fdebbfff640 1 -- 172.21.15.53:0/3290494569 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fdeb4001680 con 0x7fdec4071060 2023-06-10T19:05:01.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.080+0000 7fdebbfff640 1 -- 172.21.15.53:0/3290494569 >> v1:172.21.15.53:6789/0 conn(0x7fdec4071060 legacy=0x7fdec40af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:01.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.080+0000 7fdebbfff640 1 --2- 172.21.15.53:0/3290494569 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdeb00039f0 0x7fdeb0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:01.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.080+0000 7fdebbfff640 1 --2- 172.21.15.53:0/3290494569 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdeb00047d0 0x7fdeb0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:01.088 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.080+0000 7fdebbfff640 1 --2- 172.21.15.53:0/3290494569 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdeb0005180 0x7fdeb000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:01.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.080+0000 7fdebbfff640 1 -- 172.21.15.53:0/3290494569 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec4070580 con 0x7fdeb0005180 2023-06-10T19:05:01.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.080+0000 7fdebbfff640 1 -- 172.21.15.53:0/3290494569 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb000c060 con 0x7fdeb00047d0 2023-06-10T19:05:01.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.080+0000 7fdebbfff640 1 -- 172.21.15.53:0/3290494569 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb000c220 con 0x7fdeb00039f0 2023-06-10T19:05:01.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.080+0000 7fdec98ad640 1 --2- 172.21.15.53:0/3290494569 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdeb0005180 0x7fdeb000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:01.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.080+0000 7fdec88ab640 1 --2- 172.21.15.53:0/3290494569 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdeb00047d0 0x7fdeb0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:01.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.080+0000 7fdec90ac640 1 --2- 172.21.15.53:0/3290494569 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdeb00039f0 0x7fdeb0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:01.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.080+0000 7fdec98ad640 1 -- 172.21.15.53:0/3290494569 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdeb00039f0 msgr2=0x7fdeb0003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:01.089 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.080+0000 7fdec98ad640 1 --2- 172.21.15.53:0/3290494569 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdeb00039f0 0x7fdeb0003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:01.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.080+0000 7fdec98ad640 1 -- 172.21.15.53:0/3290494569 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdeb00047d0 msgr2=0x7fdeb0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:01.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.080+0000 7fdec98ad640 1 --2- 172.21.15.53:0/3290494569 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdeb00047d0 0x7fdeb0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:01.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.080+0000 7fdec98ad640 1 -- 172.21.15.53:0/3290494569 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeb0003530 con 0x7fdeb0005180 2023-06-10T19:05:01.090 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.080+0000 7fdec90ac640 1 --2- 172.21.15.53:0/3290494569 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdeb00039f0 0x7fdeb0003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:05:01.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.084+0000 7fdec98ad640 1 -- 172.21.15.53:0/3290494569 reap_dead start 2023-06-10T19:05:01.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.084+0000 7fdec98ad640 1 --2- 172.21.15.53:0/3290494569 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdeb0005180 0x7fdeb000b990 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7fdec406e7e0 tx=0x7fdebc01cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5405c839bf22eb8d server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:01.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.084+0000 7fdebbfff640 1 -- 172.21.15.53:0/3290494569 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdebc0a5c50 con 0x7fdeb0005180 2023-06-10T19:05:01.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.084+0000 7fdebbfff640 1 -- 172.21.15.53:0/3290494569 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdebc00f040 con 0x7fdeb0005180 2023-06-10T19:05:01.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.084+0000 7fdebbfff640 1 -- 172.21.15.53:0/3290494569 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdebc0ad440 con 0x7fdeb0005180 2023-06-10T19:05:01.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.084+0000 7fdecb310640 1 -- 172.21.15.53:0/3290494569 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdeb0005180 msgr2=0x7fdeb000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:01.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.084+0000 7fdecb310640 1 --2- 172.21.15.53:0/3290494569 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdeb0005180 0x7fdeb000b990 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7fdec406e7e0 tx=0x7fdebc01cc40 comp rx=0 tx=0).stop 2023-06-10T19:05:01.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.084+0000 7fdecb310640 1 -- 172.21.15.53:0/3290494569 shutdown_connections 2023-06-10T19:05:01.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.084+0000 7fdecb310640 1 --2- 172.21.15.53:0/3290494569 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdeb0005180 0x7fdeb000b990 unknown :-1 s=CLOSED pgs=1861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:01.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.084+0000 7fdecb310640 1 -- 172.21.15.53:0/3290494569 >> 172.21.15.53:0/3290494569 conn(0x7fdec406a0d0 msgr2=0x7fdec40ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:01.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.084+0000 7fdecb310640 1 -- 172.21.15.53:0/3290494569 shutdown_connections 2023-06-10T19:05:01.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.084+0000 7fdecb310640 1 -- 172.21.15.53:0/3290494569 wait complete. 2023-06-10T19:05:01.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.084+0000 7fdecb310640 1 Processor -- start 2023-06-10T19:05:01.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.084+0000 7fdecb310640 1 -- start start 2023-06-10T19:05:01.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.088+0000 7fdecb310640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdeb0005180 0x7fdec40ca5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:01.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.088+0000 7fdecb310640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdec4150c70 0x7fdec415c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:01.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.088+0000 7fdecb310640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdec415c840 0x7fdec40b0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:01.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.088+0000 7fdecb310640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec414c1a0 con 0x7fdeb0005180 2023-06-10T19:05:01.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.088+0000 7fdecb310640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec4151450 con 0x7fdec4150c70 2023-06-10T19:05:01.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.088+0000 7fdecb310640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdec415b860 con 0x7fdec415c840 2023-06-10T19:05:01.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.088+0000 7fdec90ac640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdeb0005180 0x7fdec40ca5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:01.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.088+0000 7fdec90ac640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdeb0005180 0x7fdec40ca5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37956/0 (socket says 172.21.15.53:37956) 2023-06-10T19:05:01.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.088+0000 7fdec90ac640 1 -- 172.21.15.53:0/3256671362 learned_addr learned my addr 172.21.15.53:0/3256671362 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:01.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.088+0000 7fdec88ab640 1 --2- 172.21.15.53:0/3256671362 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdec4150c70 0x7fdec415c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:01.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.088+0000 7fdec98ad640 1 --2- 172.21.15.53:0/3256671362 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdec415c840 0x7fdec40b0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:01.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.088+0000 7fdec90ac640 1 -- 172.21.15.53:0/3256671362 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdec415c840 msgr2=0x7fdec40b0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:01.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.088+0000 7fdec90ac640 1 --2- 172.21.15.53:0/3256671362 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdec415c840 0x7fdec40b0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:01.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.088+0000 7fdec90ac640 1 -- 172.21.15.53:0/3256671362 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdec4150c70 msgr2=0x7fdec415c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:01.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.088+0000 7fdec90ac640 1 --2- 172.21.15.53:0/3256671362 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdec4150c70 0x7fdec415c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:01.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.088+0000 7fdec90ac640 1 -- 172.21.15.53:0/3256671362 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdec4151170 con 0x7fdeb0005180 2023-06-10T19:05:01.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.088+0000 7fdec90ac640 1 --2- 172.21.15.53:0/3256671362 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdeb0005180 0x7fdec40ca5d0 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7fdec000d540 tx=0x7fdec000da00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:01.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.088+0000 7fdeb9ffb640 1 -- 172.21.15.53:0/3256671362 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec0005480 con 0x7fdeb0005180 2023-06-10T19:05:01.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.088+0000 7fdeb9ffb640 1 -- 172.21.15.53:0/3256671362 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdec0003620 con 0x7fdeb0005180 2023-06-10T19:05:01.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.088+0000 7fdeb9ffb640 1 -- 172.21.15.53:0/3256671362 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec00039f0 con 0x7fdeb0005180 2023-06-10T19:05:01.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.088+0000 7fdecb310640 1 -- 172.21.15.53:0/3256671362 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdec415bb00 con 0x7fdeb0005180 2023-06-10T19:05:01.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.088+0000 7fdecb310640 1 -- 172.21.15.53:0/3256671362 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdec40cab10 con 0x7fdeb0005180 2023-06-10T19:05:01.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.088+0000 7fdecb310640 1 -- 172.21.15.53:0/3256671362 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdec404d790 con 0x7fdeb0005180 2023-06-10T19:05:01.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.088+0000 7fdeb9ffb640 1 -- 172.21.15.53:0/3256671362 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdec0003b50 con 0x7fdeb0005180 2023-06-10T19:05:01.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.088+0000 7fdeb9ffb640 1 --2- 172.21.15.53:0/3256671362 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdea8066280 0x7fdea8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:01.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.088+0000 7fdeb9ffb640 1 -- 172.21.15.53:0/3256671362 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fdec0083900 con 0x7fdeb0005180 2023-06-10T19:05:01.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.092+0000 7fdec88ab640 1 --2- 172.21.15.53:0/3256671362 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdea8066280 0x7fdea8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:01.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.092+0000 7fdec88ab640 1 --2- 172.21.15.53:0/3256671362 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdea8066280 0x7fdea8068730 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fdec41510a0 tx=0x7fdeb4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:01.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.096+0000 7fdeb9ffb640 1 -- 172.21.15.53:0/3256671362 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdec00510c0 con 0x7fdeb0005180 2023-06-10T19:05:01.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.244+0000 7fdecb310640 1 -- 172.21.15.53:0/3256671362 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdec40ad4b0 con 0x7fdeb0005180 2023-06-10T19:05:01.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.248+0000 7fdeb9ffb640 1 -- 172.21.15.53:0/3256671362 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v121) v1 ==== 74+0+14637 (secure 0 0 0) 0x7fdec0001240 con 0x7fdeb0005180 2023-06-10T19:05:01.251 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:05:01.252 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":121,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:05:00.542942+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:05:01.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.248+0000 7fdecb310640 1 -- 172.21.15.53:0/3256671362 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdea8066280 msgr2=0x7fdea8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:01.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.248+0000 7fdecb310640 1 --2- 172.21.15.53:0/3256671362 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdea8066280 0x7fdea8068730 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fdec41510a0 tx=0x7fdeb4009040 comp rx=0 tx=0).stop 2023-06-10T19:05:01.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.248+0000 7fdecb310640 1 -- 172.21.15.53:0/3256671362 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdeb0005180 msgr2=0x7fdec40ca5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:01.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.248+0000 7fdecb310640 1 --2- 172.21.15.53:0/3256671362 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdeb0005180 0x7fdec40ca5d0 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7fdec000d540 tx=0x7fdec000da00 comp rx=0 tx=0).stop 2023-06-10T19:05:01.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.248+0000 7fdecb310640 1 -- 172.21.15.53:0/3256671362 shutdown_connections 2023-06-10T19:05:01.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.248+0000 7fdecb310640 1 --2- 172.21.15.53:0/3256671362 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdea8066280 0x7fdea8068730 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:01.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.248+0000 7fdecb310640 1 --2- 172.21.15.53:0/3256671362 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdec415c840 0x7fdec40b0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:01.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.248+0000 7fdecb310640 1 --2- 172.21.15.53:0/3256671362 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdec4150c70 0x7fdec415c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:01.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.248+0000 7fdecb310640 1 --2- 172.21.15.53:0/3256671362 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdeb0005180 0x7fdec40ca5d0 unknown :-1 s=CLOSED pgs=1862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:01.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.248+0000 7fdecb310640 1 -- 172.21.15.53:0/3256671362 >> 172.21.15.53:0/3256671362 conn(0x7fdec406a0d0 msgr2=0x7fdec4156a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:01.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.248+0000 7fdecb310640 1 -- 172.21.15.53:0/3256671362 shutdown_connections 2023-06-10T19:05:01.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.248+0000 7fdecb310640 1 -- 172.21.15.53:0/3256671362 wait complete. 2023-06-10T19:05:01.271 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-10T18:52:33.633114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-10T18:52:39.171487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-10T19:05:01.272 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-10T19:05:01.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.388+0000 7f202d44c640 1 Processor -- start 2023-06-10T19:05:01.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.388+0000 7f202d44c640 1 -- start start 2023-06-10T19:05:01.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.388+0000 7f202d44c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f202815eef0 0x7f2028070f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:01.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.388+0000 7f202d44c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f202815f570 0x7f20280ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:01.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.388+0000 7f202d44c640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f202815f2c0 con 0x7f20280ce990 2023-06-10T19:05:01.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.388+0000 7f202d44c640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f202815fdc0 con 0x7f202815f570 2023-06-10T19:05:01.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.388+0000 7f202d44c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20281600a0 con 0x7f202815eef0 2023-06-10T19:05:01.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.388+0000 7f20267fc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f202815f570 0x7f20280ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:01.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.388+0000 7f20267fc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f202815f570 0x7f20280ce450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59978/0 (socket says 172.21.15.53:59978) 2023-06-10T19:05:01.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.388+0000 7f20267fc640 1 -- 172.21.15.53:0/3122694399 learned_addr learned my addr 172.21.15.53:0/3122694399 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:01.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.388+0000 7f2026ffd640 1 --2- 172.21.15.53:0/3122694399 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f202815eef0 0x7f2028070f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:01.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.388+0000 7f20267fc640 1 -- 172.21.15.53:0/3122694399 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f202815eef0 msgr2=0x7f2028070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:01.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.388+0000 7f20267fc640 1 --2- 172.21.15.53:0/3122694399 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f202815eef0 0x7f2028070f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:01.395 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.388+0000 7f20267fc640 1 -- 172.21.15.53:0/3122694399 >> v1:172.21.15.117:6789/0 conn(0x7f20280ce990 legacy=0x7f2028069450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:01.395 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.388+0000 7f20267fc640 1 -- 172.21.15.53:0/3122694399 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2028160380 con 0x7f202815f570 2023-06-10T19:05:01.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.392+0000 7f20267fc640 1 --2- 172.21.15.53:0/3122694399 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f202815f570 0x7f20280ce450 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7f201c009870 tx=0x7f201c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44cdb59a276599b0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:01.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.392+0000 7f2025ffb640 1 -- 172.21.15.53:0/3122694399 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201c0ac630 con 0x7f202815f570 2023-06-10T19:05:01.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.392+0000 7f2025ffb640 1 -- 172.21.15.53:0/3122694399 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f201c0ac790 con 0x7f202815f570 2023-06-10T19:05:01.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.392+0000 7f2025ffb640 1 -- 172.21.15.53:0/3122694399 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201c0acb20 con 0x7f202815f570 2023-06-10T19:05:01.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.392+0000 7f202d44c640 1 -- 172.21.15.53:0/3122694399 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f202815f570 msgr2=0x7f20280ce450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:01.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.392+0000 7f202d44c640 1 --2- 172.21.15.53:0/3122694399 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f202815f570 0x7f20280ce450 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7f201c009870 tx=0x7f201c01c500 comp rx=0 tx=0).stop 2023-06-10T19:05:01.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.392+0000 7f202d44c640 1 -- 172.21.15.53:0/3122694399 shutdown_connections 2023-06-10T19:05:01.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.392+0000 7f202d44c640 1 --2- 172.21.15.53:0/3122694399 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f202815f570 0x7f20280ce450 unknown :-1 s=CLOSED pgs=1863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:01.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.392+0000 7f202d44c640 1 --2- 172.21.15.53:0/3122694399 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f202815eef0 0x7f2028070f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:01.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.392+0000 7f202d44c640 1 -- 172.21.15.53:0/3122694399 >> 172.21.15.53:0/3122694399 conn(0x7f202806a560 msgr2=0x7f202806a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:01.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.392+0000 7f202d44c640 1 -- 172.21.15.53:0/3122694399 shutdown_connections 2023-06-10T19:05:01.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.392+0000 7f202d44c640 1 -- 172.21.15.53:0/3122694399 wait complete. 2023-06-10T19:05:01.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.392+0000 7f202d44c640 1 Processor -- start 2023-06-10T19:05:01.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.392+0000 7f202d44c640 1 -- start start 2023-06-10T19:05:01.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.396+0000 7f202d44c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20280ce990 0x7f20280c4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:01.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.396+0000 7f202d44c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f202815eef0 0x7f202815b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:01.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.396+0000 7f202d44c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f202815f570 0x7f2028154300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:01.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.396+0000 7f202d44c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f202815b800 con 0x7f202815eef0 2023-06-10T19:05:01.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.396+0000 7f202d44c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20280c4a30 con 0x7f202815f570 2023-06-10T19:05:01.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.396+0000 7f202d44c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20280b3440 con 0x7f20280ce990 2023-06-10T19:05:01.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.396+0000 7f20267fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f202815eef0 0x7f202815b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:01.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.396+0000 7f20267fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f202815eef0 0x7f202815b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59988/0 (socket says 172.21.15.53:59988) 2023-06-10T19:05:01.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.396+0000 7f20267fc640 1 -- 172.21.15.53:0/442821176 learned_addr learned my addr 172.21.15.53:0/442821176 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:01.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.396+0000 7f2026ffd640 1 --2- 172.21.15.53:0/442821176 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20280ce990 0x7f20280c4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:01.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.396+0000 7f20267fc640 1 -- 172.21.15.53:0/442821176 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20280ce990 msgr2=0x7f20280c4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:01.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.396+0000 7f20267fc640 1 --2- 172.21.15.53:0/442821176 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20280ce990 0x7f20280c4ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:01.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.396+0000 7f20277fe640 1 --2- 172.21.15.53:0/442821176 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f202815f570 0x7f2028154300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:01.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.396+0000 7f20267fc640 1 -- 172.21.15.53:0/442821176 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f202815f570 msgr2=0x7f2028154300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:01.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.396+0000 7f20267fc640 1 --2- 172.21.15.53:0/442821176 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f202815f570 0x7f2028154300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:01.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.396+0000 7f20267fc640 1 -- 172.21.15.53:0/442821176 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f201c0094d0 con 0x7f202815eef0 2023-06-10T19:05:01.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.396+0000 7f20267fc640 1 --2- 172.21.15.53:0/442821176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f202815eef0 0x7f202815b2c0 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 crypto rx=0x7f201c01abb0 tx=0x7f201c0192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:01.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.396+0000 7f200f7fe640 1 -- 172.21.15.53:0/442821176 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201c0bd070 con 0x7f202815eef0 2023-06-10T19:05:01.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.396+0000 7f200f7fe640 1 -- 172.21.15.53:0/442821176 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f201c0b8660 con 0x7f202815eef0 2023-06-10T19:05:01.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.396+0000 7f200f7fe640 1 -- 172.21.15.53:0/442821176 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201c0b89f0 con 0x7f202815eef0 2023-06-10T19:05:01.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.396+0000 7f202d44c640 1 -- 172.21.15.53:0/442821176 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20280b3160 con 0x7f202815eef0 2023-06-10T19:05:01.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.396+0000 7f202d44c640 1 -- 172.21.15.53:0/442821176 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20280c46c0 con 0x7f202815eef0 2023-06-10T19:05:01.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.396+0000 7f202d44c640 1 -- 172.21.15.53:0/442821176 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f202804d790 con 0x7f202815eef0 2023-06-10T19:05:01.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.396+0000 7f200f7fe640 1 -- 172.21.15.53:0/442821176 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f201c0b8b50 con 0x7f202815eef0 2023-06-10T19:05:01.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.396+0000 7f200f7fe640 1 --2- 172.21.15.53:0/442821176 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2014066280 0x7f2014068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:01.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.396+0000 7f200f7fe640 1 -- 172.21.15.53:0/442821176 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f201c11dc10 con 0x7f202815eef0 2023-06-10T19:05:01.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.396+0000 7f2026ffd640 1 --2- 172.21.15.53:0/442821176 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2014066280 0x7f2014068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:01.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.400+0000 7f2026ffd640 1 --2- 172.21.15.53:0/442821176 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2014066280 0x7f2014068730 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f2028071490 tx=0x7f2018008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:01.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.400+0000 7f200f7fe640 1 -- 172.21.15.53:0/442821176 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f201c0eb3c0 con 0x7f202815eef0 2023-06-10T19:05:01.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.556+0000 7f202d44c640 1 -- 172.21.15.53:0/442821176 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f20280c4b70 con 0x7f202815eef0 2023-06-10T19:05:01.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.556+0000 7f200f7fe640 1 -- 172.21.15.53:0/442821176 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v121) v1 ==== 93+0+10 (secure 0 0 0) 0x7f201c0a8020 con 0x7f202815eef0 2023-06-10T19:05:01.561 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-06-10T19:05:01.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.560+0000 7f202d44c640 1 -- 172.21.15.53:0/442821176 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2014066280 msgr2=0x7f2014068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:01.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.560+0000 7f202d44c640 1 --2- 172.21.15.53:0/442821176 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2014066280 0x7f2014068730 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f2028071490 tx=0x7f2018008040 comp rx=0 tx=0).stop 2023-06-10T19:05:01.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.560+0000 7f202d44c640 1 -- 172.21.15.53:0/442821176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f202815eef0 msgr2=0x7f202815b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:01.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.560+0000 7f202d44c640 1 --2- 172.21.15.53:0/442821176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f202815eef0 0x7f202815b2c0 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 crypto rx=0x7f201c01abb0 tx=0x7f201c0192a0 comp rx=0 tx=0).stop 2023-06-10T19:05:01.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.560+0000 7f202d44c640 1 -- 172.21.15.53:0/442821176 shutdown_connections 2023-06-10T19:05:01.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.560+0000 7f202d44c640 1 --2- 172.21.15.53:0/442821176 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2014066280 0x7f2014068730 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:01.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.560+0000 7f202d44c640 1 --2- 172.21.15.53:0/442821176 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f202815f570 0x7f2028154300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:01.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.560+0000 7f202d44c640 1 --2- 172.21.15.53:0/442821176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f202815eef0 0x7f202815b2c0 unknown :-1 s=CLOSED pgs=1864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:01.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.560+0000 7f202d44c640 1 --2- 172.21.15.53:0/442821176 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f20280ce990 0x7f20280c4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:01.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.560+0000 7f202d44c640 1 -- 172.21.15.53:0/442821176 >> 172.21.15.53:0/442821176 conn(0x7f202806a560 msgr2=0x7f202806a930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:01.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.560+0000 7f202d44c640 1 -- 172.21.15.53:0/442821176 shutdown_connections 2023-06-10T19:05:01.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.560+0000 7f202d44c640 1 -- 172.21.15.53:0/442821176 wait complete. 2023-06-10T19:05:01.581 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-10T19:05:01.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.704+0000 7f55cf69e640 1 Processor -- start 2023-06-10T19:05:01.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.708+0000 7f55cf69e640 1 -- start start 2023-06-10T19:05:01.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.708+0000 7f55cf69e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55c81558e0 0x7f55c80c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:01.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.708+0000 7f55cf69e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f55c806b6e0 0x7f55c806bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:01.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.708+0000 7f55cf69e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55c806c060 con 0x7f55c8158f40 2023-06-10T19:05:01.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.708+0000 7f55cf69e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55c806c230 con 0x7f55c806b6e0 2023-06-10T19:05:01.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.708+0000 7f55cf69e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55c806ca40 con 0x7f55c81558e0 2023-06-10T19:05:01.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.708+0000 7f55cdc3b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f55c806b6e0 0x7f55c806bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:01.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.708+0000 7f55cd43a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55c81558e0 0x7f55c80c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:01.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.708+0000 7f55ccc39640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f55c8158f40 0x7f55c80cb820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.53:51904/0 (socket says 172.21.15.53:51904) 2023-06-10T19:05:01.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.708+0000 7f55ccc39640 1 -- 172.21.15.53:0/2930039495 learned_addr learned my addr 172.21.15.53:0/2930039495 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:05:01.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.708+0000 7f55cd43a640 1 -- 172.21.15.53:0/2930039495 >> v2:172.21.15.117:3300/0 conn(0x7f55c806b6e0 msgr2=0x7f55c806bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:01.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.708+0000 7f55cd43a640 1 --2- 172.21.15.53:0/2930039495 >> v2:172.21.15.117:3300/0 conn(0x7f55c806b6e0 0x7f55c806bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:01.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.708+0000 7f55cd43a640 1 -- 172.21.15.53:0/2930039495 >> v1:172.21.15.117:6789/0 conn(0x7f55c8158f40 legacy=0x7f55c80cb820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:01.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.708+0000 7f55cd43a640 1 -- 172.21.15.53:0/2930039495 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55c8155cb0 con 0x7f55c81558e0 2023-06-10T19:05:01.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.708+0000 7f55cdc3b640 1 --2- 172.21.15.53:0/2930039495 >> v2:172.21.15.117:3300/0 conn(0x7f55c806b6e0 0x7f55c806bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-10T19:05:01.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.712+0000 7f55cd43a640 1 --2- 172.21.15.53:0/2930039495 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55c81558e0 0x7f55c80c82a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f55b80097c0 tx=0x7f55b801c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=240f5a47c7a35774 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:01.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.712+0000 7f55c7fff640 1 -- 172.21.15.53:0/2930039495 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b80ab600 con 0x7f55c81558e0 2023-06-10T19:05:01.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.712+0000 7f55c7fff640 1 -- 172.21.15.53:0/2930039495 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55b80a7050 con 0x7f55c81558e0 2023-06-10T19:05:01.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.712+0000 7f55c7fff640 1 -- 172.21.15.53:0/2930039495 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b80ab980 con 0x7f55c81558e0 2023-06-10T19:05:01.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.712+0000 7f55cf69e640 1 -- 172.21.15.53:0/2930039495 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55c81558e0 msgr2=0x7f55c80c82a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:01.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.712+0000 7f55cf69e640 1 --2- 172.21.15.53:0/2930039495 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55c81558e0 0x7f55c80c82a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f55b80097c0 tx=0x7f55b801c330 comp rx=0 tx=0).stop 2023-06-10T19:05:01.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.712+0000 7f55cf69e640 1 -- 172.21.15.53:0/2930039495 shutdown_connections 2023-06-10T19:05:01.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.712+0000 7f55cf69e640 1 --2- 172.21.15.53:0/2930039495 >> v2:172.21.15.117:3300/0 conn(0x7f55c806b6e0 0x7f55c806bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:01.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.712+0000 7f55cf69e640 1 --2- 172.21.15.53:0/2930039495 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55c81558e0 0x7f55c80c82a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:01.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.712+0000 7f55cf69e640 1 -- 172.21.15.53:0/2930039495 >> 172.21.15.53:0/2930039495 conn(0x7f55c806a0e0 msgr2=0x7f55c80cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:01.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.712+0000 7f55cf69e640 1 -- 172.21.15.53:0/2930039495 shutdown_connections 2023-06-10T19:05:01.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.712+0000 7f55cf69e640 1 -- 172.21.15.53:0/2930039495 wait complete. 2023-06-10T19:05:01.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.712+0000 7f55cf69e640 1 Processor -- start 2023-06-10T19:05:01.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.712+0000 7f55cf69e640 1 -- start start 2023-06-10T19:05:01.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.712+0000 7f55cf69e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55c806b6e0 0x7f55c8153c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:01.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.712+0000 7f55cf69e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55c81558e0 0x7f55c8162520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:01.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.712+0000 7f55cf69e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f55c8158f40 0x7f55c81522c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:01.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.712+0000 7f55cf69e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c806f4b0 con 0x7f55c81558e0 2023-06-10T19:05:01.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.712+0000 7f55cf69e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c8162a60 con 0x7f55c8158f40 2023-06-10T19:05:01.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.712+0000 7f55cf69e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55c8154240 con 0x7f55c806b6e0 2023-06-10T19:05:01.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.712+0000 7f55ccc39640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55c81558e0 0x7f55c8162520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:01.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.712+0000 7f55ccc39640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55c81558e0 0x7f55c8162520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59998/0 (socket says 172.21.15.53:59998) 2023-06-10T19:05:01.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.712+0000 7f55ccc39640 1 -- 172.21.15.53:0/707741080 learned_addr learned my addr 172.21.15.53:0/707741080 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:01.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.712+0000 7f55cd43a640 1 --2- 172.21.15.53:0/707741080 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55c806b6e0 0x7f55c8153c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:01.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.712+0000 7f55cdc3b640 1 --2- 172.21.15.53:0/707741080 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f55c8158f40 0x7f55c81522c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:01.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.716+0000 7f55ccc39640 1 -- 172.21.15.53:0/707741080 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55c806b6e0 msgr2=0x7f55c8153c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:01.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.716+0000 7f55ccc39640 1 --2- 172.21.15.53:0/707741080 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55c806b6e0 0x7f55c8153c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:01.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.716+0000 7f55ccc39640 1 -- 172.21.15.53:0/707741080 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f55c8158f40 msgr2=0x7f55c81522c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:01.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.716+0000 7f55ccc39640 1 --2- 172.21.15.53:0/707741080 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f55c8158f40 0x7f55c81522c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:01.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.716+0000 7f55ccc39640 1 -- 172.21.15.53:0/707741080 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55c0009a70 con 0x7f55c81558e0 2023-06-10T19:05:01.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.716+0000 7f55cdc3b640 1 --2- 172.21.15.53:0/707741080 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f55c8158f40 0x7f55c81522c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:05:01.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.716+0000 7f55ccc39640 1 --2- 172.21.15.53:0/707741080 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55c81558e0 0x7f55c8162520 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7f55bc00c400 tx=0x7f55bc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:01.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.716+0000 7f55c5ffb640 1 -- 172.21.15.53:0/707741080 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55bc005cf0 con 0x7f55c81558e0 2023-06-10T19:05:01.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.716+0000 7f55c5ffb640 1 -- 172.21.15.53:0/707741080 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55bc005e50 con 0x7f55c81558e0 2023-06-10T19:05:01.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.716+0000 7f55cf69e640 1 -- 172.21.15.53:0/707741080 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55b8009420 con 0x7f55c81558e0 2023-06-10T19:05:01.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.716+0000 7f55c5ffb640 1 -- 172.21.15.53:0/707741080 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55bc0072d0 con 0x7f55c81558e0 2023-06-10T19:05:01.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.716+0000 7f55cf69e640 1 -- 172.21.15.53:0/707741080 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55c8154800 con 0x7f55c81558e0 2023-06-10T19:05:01.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.716+0000 7f55cf69e640 1 -- 172.21.15.53:0/707741080 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55c806f5f0 con 0x7f55c81558e0 2023-06-10T19:05:01.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.716+0000 7f55c5ffb640 1 -- 172.21.15.53:0/707741080 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f55bc007430 con 0x7f55c81558e0 2023-06-10T19:05:01.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.716+0000 7f55c5ffb640 1 --2- 172.21.15.53:0/707741080 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f55b4066280 0x7f55b4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:01.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.716+0000 7f55c5ffb640 1 -- 172.21.15.53:0/707741080 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f55bc082e80 con 0x7f55c81558e0 2023-06-10T19:05:01.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.716+0000 7f55cd43a640 1 --2- 172.21.15.53:0/707741080 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f55b4066280 0x7f55b4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:01.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.716+0000 7f55cd43a640 1 --2- 172.21.15.53:0/707741080 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f55b4066280 0x7f55b4068730 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f55b80ad000 tx=0x7f55b80a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:01.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.720+0000 7f55c5ffb640 1 -- 172.21.15.53:0/707741080 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f55c806f5f0 con 0x7f55c81558e0 2023-06-10T19:05:01.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.876+0000 7f55cf69e640 1 -- 172.21.15.53:0/707741080 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f55c806f5f0 con 0x7f55c81558e0 2023-06-10T19:05:01.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.880+0000 7f55c5ffb640 1 -- 172.21.15.53:0/707741080 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v121) v1 ==== 92+0+10 (secure 0 0 0) 0x7f55bc017020 con 0x7f55c81558e0 2023-06-10T19:05:01.884 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-06-10T19:05:01.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.880+0000 7f55cf69e640 1 -- 172.21.15.53:0/707741080 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f55b4066280 msgr2=0x7f55b4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:01.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.880+0000 7f55cf69e640 1 --2- 172.21.15.53:0/707741080 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f55b4066280 0x7f55b4068730 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f55b80ad000 tx=0x7f55b80a6000 comp rx=0 tx=0).stop 2023-06-10T19:05:01.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.880+0000 7f55cf69e640 1 -- 172.21.15.53:0/707741080 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55c81558e0 msgr2=0x7f55c8162520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:01.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.880+0000 7f55cf69e640 1 --2- 172.21.15.53:0/707741080 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55c81558e0 0x7f55c8162520 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7f55bc00c400 tx=0x7f55bc00c8c0 comp rx=0 tx=0).stop 2023-06-10T19:05:01.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.880+0000 7f55cf69e640 1 -- 172.21.15.53:0/707741080 shutdown_connections 2023-06-10T19:05:01.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.880+0000 7f55cf69e640 1 --2- 172.21.15.53:0/707741080 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f55b4066280 0x7f55b4068730 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:01.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.880+0000 7f55cf69e640 1 --2- 172.21.15.53:0/707741080 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f55c8158f40 0x7f55c81522c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:01.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.880+0000 7f55cf69e640 1 --2- 172.21.15.53:0/707741080 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55c81558e0 0x7f55c8162520 unknown :-1 s=CLOSED pgs=1865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:01.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.880+0000 7f55cf69e640 1 --2- 172.21.15.53:0/707741080 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f55c806b6e0 0x7f55c8153c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:01.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.880+0000 7f55cf69e640 1 -- 172.21.15.53:0/707741080 >> 172.21.15.53:0/707741080 conn(0x7f55c806a0e0 msgr2=0x7f55c8158700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:01.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.880+0000 7f55cf69e640 1 -- 172.21.15.53:0/707741080 shutdown_connections 2023-06-10T19:05:01.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:01.880+0000 7f55cf69e640 1 -- 172.21.15.53:0/707741080 wait complete. 2023-06-10T19:05:01.903 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-06-10T19:05:02.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.024+0000 7f7e3e48c640 1 Processor -- start 2023-06-10T19:05:02.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.024+0000 7f7e3e48c640 1 -- start start 2023-06-10T19:05:02.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.028+0000 7f7e3e48c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e3815cdb0 0x7f7e380b30e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:02.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.028+0000 7f7e3e48c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7e38071060 0x7f7e380b3620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:02.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.028+0000 7f7e3e48c640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e3806c620 con 0x7f7e380c9840 2023-06-10T19:05:02.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.028+0000 7f7e3e48c640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e380702a0 con 0x7f7e38071060 2023-06-10T19:05:02.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.028+0000 7f7e3e48c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e38070580 con 0x7f7e3815cdb0 2023-06-10T19:05:02.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.028+0000 7f7e377fe640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7e38071060 0x7f7e380b3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:02.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.028+0000 7f7e3ca29640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f7e380c9840 0x7f7e3806b090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.53:51916/0 (socket says 172.21.15.53:51916) 2023-06-10T19:05:02.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.028+0000 7f7e377fe640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7e38071060 0x7f7e380b3620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.53:39052/0 (socket says 172.21.15.53:39052) 2023-06-10T19:05:02.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.028+0000 7f7e37fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e3815cdb0 0x7f7e380b30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:02.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.028+0000 7f7e377fe640 1 -- 172.21.15.53:0/521661719 learned_addr learned my addr 172.21.15.53:0/521661719 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:02.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.028+0000 7f7e377fe640 1 -- 172.21.15.53:0/521661719 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e3815cdb0 msgr2=0x7f7e380b30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:02.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.028+0000 7f7e377fe640 1 --2- 172.21.15.53:0/521661719 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e3815cdb0 0x7f7e380b30e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:02.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.028+0000 7f7e377fe640 1 -- 172.21.15.53:0/521661719 >> v1:172.21.15.117:6789/0 conn(0x7f7e380c9840 legacy=0x7f7e3806b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:02.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.028+0000 7f7e377fe640 1 -- 172.21.15.53:0/521661719 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e38070860 con 0x7f7e38071060 2023-06-10T19:05:02.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.028+0000 7f7e377fe640 1 --2- 172.21.15.53:0/521661719 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e38071060 0x7f7e380b3620 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c009870 tx=0x7f7e2c01c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94942761c2fcec47 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:02.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.028+0000 7f7e36ffd640 1 -- 172.21.15.53:0/521661719 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e2c0ab670 con 0x7f7e38071060 2023-06-10T19:05:02.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.028+0000 7f7e36ffd640 1 -- 172.21.15.53:0/521661719 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e2c0ab7d0 con 0x7f7e38071060 2023-06-10T19:05:02.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.028+0000 7f7e36ffd640 1 -- 172.21.15.53:0/521661719 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e2c0abb60 con 0x7f7e38071060 2023-06-10T19:05:02.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.032+0000 7f7e3e48c640 1 -- 172.21.15.53:0/521661719 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e38071060 msgr2=0x7f7e380b3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:02.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.032+0000 7f7e3e48c640 1 --2- 172.21.15.53:0/521661719 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e38071060 0x7f7e380b3620 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c009870 tx=0x7f7e2c01c510 comp rx=0 tx=0).stop 2023-06-10T19:05:02.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.032+0000 7f7e3e48c640 1 -- 172.21.15.53:0/521661719 shutdown_connections 2023-06-10T19:05:02.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.032+0000 7f7e3e48c640 1 --2- 172.21.15.53:0/521661719 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e38071060 0x7f7e380b3620 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:02.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.032+0000 7f7e3e48c640 1 --2- 172.21.15.53:0/521661719 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e3815cdb0 0x7f7e380b30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:02.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.032+0000 7f7e3e48c640 1 -- 172.21.15.53:0/521661719 >> 172.21.15.53:0/521661719 conn(0x7f7e3806a0d0 msgr2=0x7f7e380ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:02.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.032+0000 7f7e3e48c640 1 -- 172.21.15.53:0/521661719 shutdown_connections 2023-06-10T19:05:02.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.032+0000 7f7e3e48c640 1 -- 172.21.15.53:0/521661719 wait complete. 2023-06-10T19:05:02.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.032+0000 7f7e3e48c640 1 Processor -- start 2023-06-10T19:05:02.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.032+0000 7f7e3e48c640 1 -- start start 2023-06-10T19:05:02.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.032+0000 7f7e3e48c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e38071060 0x7f7e3813bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:02.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.032+0000 7f7e3e48c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e380c9840 0x7f7e3814f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:02.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.032+0000 7f7e3e48c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e3815cdb0 0x7f7e3814d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:02.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.032+0000 7f7e3e48c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e380c2ad0 con 0x7f7e3815cdb0 2023-06-10T19:05:02.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.032+0000 7f7e3e48c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e380c2d90 con 0x7f7e38071060 2023-06-10T19:05:02.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.032+0000 7f7e3e48c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e380c3070 con 0x7f7e380c9840 2023-06-10T19:05:02.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.032+0000 7f7e3ca29640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e3815cdb0 0x7f7e3814d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:02.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.032+0000 7f7e3ca29640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e3815cdb0 0x7f7e3814d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60010/0 (socket says 172.21.15.53:60010) 2023-06-10T19:05:02.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.032+0000 7f7e3ca29640 1 -- 172.21.15.53:0/1611899604 learned_addr learned my addr 172.21.15.53:0/1611899604 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:02.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.032+0000 7f7e377fe640 1 --2- 172.21.15.53:0/1611899604 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e380c9840 0x7f7e3814f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:02.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.032+0000 7f7e37fff640 1 --2- 172.21.15.53:0/1611899604 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e38071060 0x7f7e3813bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:02.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.032+0000 7f7e3ca29640 1 -- 172.21.15.53:0/1611899604 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e380c9840 msgr2=0x7f7e3814f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:02.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.032+0000 7f7e3ca29640 1 --2- 172.21.15.53:0/1611899604 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e380c9840 0x7f7e3814f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:02.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.032+0000 7f7e3ca29640 1 -- 172.21.15.53:0/1611899604 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e38071060 msgr2=0x7f7e3813bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:02.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.032+0000 7f7e3ca29640 1 --2- 172.21.15.53:0/1611899604 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e38071060 0x7f7e3813bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:02.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.032+0000 7f7e3ca29640 1 -- 172.21.15.53:0/1611899604 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e2c0094d0 con 0x7f7e3815cdb0 2023-06-10T19:05:02.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.032+0000 7f7e37fff640 1 --2- 172.21.15.53:0/1611899604 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e38071060 0x7f7e3813bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:05:02.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.032+0000 7f7e3ca29640 1 --2- 172.21.15.53:0/1611899604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e3815cdb0 0x7f7e3814d180 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7f7e3000c7a0 tx=0x7f7e3000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:02.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.032+0000 7f7e34ff9640 1 -- 172.21.15.53:0/1611899604 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e3000a640 con 0x7f7e3815cdb0 2023-06-10T19:05:02.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.032+0000 7f7e34ff9640 1 -- 172.21.15.53:0/1611899604 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e3000a7a0 con 0x7f7e3815cdb0 2023-06-10T19:05:02.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.032+0000 7f7e3e48c640 1 -- 172.21.15.53:0/1611899604 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e380c3350 con 0x7f7e3815cdb0 2023-06-10T19:05:02.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.032+0000 7f7e34ff9640 1 -- 172.21.15.53:0/1611899604 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e3000ab10 con 0x7f7e3815cdb0 2023-06-10T19:05:02.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.032+0000 7f7e3e48c640 1 -- 172.21.15.53:0/1611899604 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e380c3910 con 0x7f7e3815cdb0 2023-06-10T19:05:02.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.036+0000 7f7e3e48c640 1 -- 172.21.15.53:0/1611899604 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e3804d790 con 0x7f7e3815cdb0 2023-06-10T19:05:02.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.036+0000 7f7e34ff9640 1 -- 172.21.15.53:0/1611899604 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7e3000ac70 con 0x7f7e3815cdb0 2023-06-10T19:05:02.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.036+0000 7f7e34ff9640 1 --2- 172.21.15.53:0/1611899604 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7e24066280 0x7f7e24068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:02.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.036+0000 7f7e34ff9640 1 -- 172.21.15.53:0/1611899604 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f7e300831f0 con 0x7f7e3815cdb0 2023-06-10T19:05:02.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.036+0000 7f7e37fff640 1 --2- 172.21.15.53:0/1611899604 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7e24066280 0x7f7e24068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:02.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.036+0000 7f7e37fff640 1 --2- 172.21.15.53:0/1611899604 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7e24066280 0x7f7e24068730 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f7e3806b410 tx=0x7f7e28008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:02.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.040+0000 7f7e34ff9640 1 -- 172.21.15.53:0/1611899604 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7e300509f0 con 0x7f7e3815cdb0 2023-06-10T19:05:02.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.196+0000 7f7e3e48c640 1 -- 172.21.15.53:0/1611899604 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f7e3806f440 con 0x7f7e3815cdb0 2023-06-10T19:05:02.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.200+0000 7f7e34ff9640 1 -- 172.21.15.53:0/1611899604 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v121) v1 ==== 84+0+126 (secure 0 0 0) 0x7f7e30054010 con 0x7f7e3815cdb0 2023-06-10T19:05:02.203 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:05:02.204 INFO:teuthology.orchestra.run.smithi053.stdout:[ 2023-06-10T19:05:02.204 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:05:02.204 INFO:teuthology.orchestra.run.smithi053.stdout: "poolnum": 1, 2023-06-10T19:05:02.204 INFO:teuthology.orchestra.run.smithi053.stdout: "poolname": ".mgr" 2023-06-10T19:05:02.204 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:05:02.204 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:05:02.205 INFO:teuthology.orchestra.run.smithi053.stdout: "poolnum": 2, 2023-06-10T19:05:02.205 INFO:teuthology.orchestra.run.smithi053.stdout: "poolname": "rbd" 2023-06-10T19:05:02.205 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:05:02.205 INFO:teuthology.orchestra.run.smithi053.stdout:] 2023-06-10T19:05:02.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.200+0000 7f7e3e48c640 1 -- 172.21.15.53:0/1611899604 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7e24066280 msgr2=0x7f7e24068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:02.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.200+0000 7f7e3e48c640 1 --2- 172.21.15.53:0/1611899604 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7e24066280 0x7f7e24068730 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f7e3806b410 tx=0x7f7e28008040 comp rx=0 tx=0).stop 2023-06-10T19:05:02.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.200+0000 7f7e3e48c640 1 -- 172.21.15.53:0/1611899604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e3815cdb0 msgr2=0x7f7e3814d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:02.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.200+0000 7f7e3e48c640 1 --2- 172.21.15.53:0/1611899604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e3815cdb0 0x7f7e3814d180 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7f7e3000c7a0 tx=0x7f7e3000cc60 comp rx=0 tx=0).stop 2023-06-10T19:05:02.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.200+0000 7f7e3e48c640 1 -- 172.21.15.53:0/1611899604 shutdown_connections 2023-06-10T19:05:02.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.200+0000 7f7e3e48c640 1 --2- 172.21.15.53:0/1611899604 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7e24066280 0x7f7e24068730 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:02.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.200+0000 7f7e3e48c640 1 --2- 172.21.15.53:0/1611899604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e3815cdb0 0x7f7e3814d180 unknown :-1 s=CLOSED pgs=1866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:02.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.200+0000 7f7e3e48c640 1 --2- 172.21.15.53:0/1611899604 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7e380c9840 0x7f7e3814f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:02.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.200+0000 7f7e3e48c640 1 --2- 172.21.15.53:0/1611899604 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e38071060 0x7f7e3813bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:02.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.200+0000 7f7e3e48c640 1 -- 172.21.15.53:0/1611899604 >> 172.21.15.53:0/1611899604 conn(0x7f7e3806a0d0 msgr2=0x7f7e38157590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:02.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.200+0000 7f7e3e48c640 1 -- 172.21.15.53:0/1611899604 shutdown_connections 2023-06-10T19:05:02.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.200+0000 7f7e3e48c640 1 -- 172.21.15.53:0/1611899604 wait complete. 2023-06-10T19:05:02.222 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-06-10T19:05:02.223 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-06-10T19:05:02.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.348+0000 7fbbe19d7640 1 Processor -- start 2023-06-10T19:05:02.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.348+0000 7fbbe19d7640 1 -- start start 2023-06-10T19:05:02.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.348+0000 7fbbe19d7640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbbdc159760 0x7fbbdc0cec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:02.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.348+0000 7fbbe19d7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbbdc0cf1a0 0x7fbbdc0cbf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:02.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.348+0000 7fbbe19d7640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbdc0cf5f0 con 0x7fbbdc159390 2023-06-10T19:05:02.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.348+0000 7fbbe19d7640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbdc15e1b0 con 0x7fbbdc0cf1a0 2023-06-10T19:05:02.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.348+0000 7fbbe19d7640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbdc0cb460 con 0x7fbbdc159760 2023-06-10T19:05:02.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.348+0000 7fbbdaffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fbbdc159390 0x7fbbdc15d1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:35536/0 (socket says 172.21.15.53:35536) 2023-06-10T19:05:02.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.348+0000 7fbbdaffd640 1 -- 172.21.15.53:0/275856865 learned_addr learned my addr 172.21.15.53:0/275856865 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:05:02.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.348+0000 7fbbdb7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbbdc0cf1a0 0x7fbbdc0cbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:02.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.348+0000 7fbbda7fc640 1 --2- 172.21.15.53:0/275856865 >> v2:172.21.15.117:3300/0 conn(0x7fbbdc159760 0x7fbbdc0cec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:02.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.348+0000 7fbbdb7fe640 1 -- 172.21.15.53:0/275856865 >> v2:172.21.15.117:3300/0 conn(0x7fbbdc159760 msgr2=0x7fbbdc0cec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:02.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.348+0000 7fbbdb7fe640 1 --2- 172.21.15.53:0/275856865 >> v2:172.21.15.117:3300/0 conn(0x7fbbdc159760 0x7fbbdc0cec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:02.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.348+0000 7fbbdb7fe640 1 -- 172.21.15.53:0/275856865 >> v1:172.21.15.53:6789/0 conn(0x7fbbdc159390 legacy=0x7fbbdc15d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:02.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.348+0000 7fbbdb7fe640 1 -- 172.21.15.53:0/275856865 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbdc15dbf0 con 0x7fbbdc0cf1a0 2023-06-10T19:05:02.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.348+0000 7fbbd9ffb640 1 -- 172.21.15.53:0/275856865 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3761313667 0 0) 0x7fbbcc001120 con 0x7fbbdc159390 2023-06-10T19:05:02.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.352+0000 7fbbdb7fe640 1 --2- 172.21.15.53:0/275856865 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbbdc0cf1a0 0x7fbbdc0cbf00 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc067010 tx=0x7fbbd401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be0c667ac80960b0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:02.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.352+0000 7fbbd9ffb640 1 -- 172.21.15.53:0/275856865 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd40a59a0 con 0x7fbbdc0cf1a0 2023-06-10T19:05:02.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.352+0000 7fbbd9ffb640 1 -- 172.21.15.53:0/275856865 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbd40a5b00 con 0x7fbbdc0cf1a0 2023-06-10T19:05:02.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.352+0000 7fbbd9ffb640 1 -- 172.21.15.53:0/275856865 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd40a5e90 con 0x7fbbdc0cf1a0 2023-06-10T19:05:02.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.352+0000 7fbbe19d7640 1 -- 172.21.15.53:0/275856865 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbbdc0cf1a0 msgr2=0x7fbbdc0cbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:02.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.352+0000 7fbbe19d7640 1 --2- 172.21.15.53:0/275856865 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbbdc0cf1a0 0x7fbbdc0cbf00 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc067010 tx=0x7fbbd401c8e0 comp rx=0 tx=0).stop 2023-06-10T19:05:02.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.352+0000 7fbbe19d7640 1 -- 172.21.15.53:0/275856865 shutdown_connections 2023-06-10T19:05:02.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.352+0000 7fbbe19d7640 1 --2- 172.21.15.53:0/275856865 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbbdc0cf1a0 0x7fbbdc0cbf00 unknown :-1 s=CLOSED pgs=1868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:02.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.352+0000 7fbbe19d7640 1 --2- 172.21.15.53:0/275856865 >> v2:172.21.15.117:3300/0 conn(0x7fbbdc159760 0x7fbbdc0cec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:02.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.352+0000 7fbbe19d7640 1 -- 172.21.15.53:0/275856865 >> 172.21.15.53:0/275856865 conn(0x7fbbdc06a0b0 msgr2=0x7fbbdc06d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:02.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.352+0000 7fbbe19d7640 1 -- 172.21.15.53:0/275856865 shutdown_connections 2023-06-10T19:05:02.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.352+0000 7fbbe19d7640 1 -- 172.21.15.53:0/275856865 wait complete. 2023-06-10T19:05:02.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.352+0000 7fbbe19d7640 1 Processor -- start 2023-06-10T19:05:02.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.352+0000 7fbbe19d7640 1 -- start start 2023-06-10T19:05:02.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.352+0000 7fbbe19d7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbbdc0cf1a0 0x7fbbdc155da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:02.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.352+0000 7fbbe19d7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbbdc159390 0x7fbbdc14bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:02.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.356+0000 7fbbe19d7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbbdc159760 0x7fbbdc0afcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:02.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.356+0000 7fbbe19d7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbdc14c890 con 0x7fbbdc159760 2023-06-10T19:05:02.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.356+0000 7fbbe19d7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbdc1562e0 con 0x7fbbdc159390 2023-06-10T19:05:02.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.356+0000 7fbbe19d7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbdc1565b0 con 0x7fbbdc0cf1a0 2023-06-10T19:05:02.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.356+0000 7fbbdb7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbbdc159760 0x7fbbdc0afcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:02.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.356+0000 7fbbdb7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbbdc159760 0x7fbbdc0afcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60036/0 (socket says 172.21.15.53:60036) 2023-06-10T19:05:02.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.356+0000 7fbbdb7fe640 1 -- 172.21.15.53:0/3344896666 learned_addr learned my addr 172.21.15.53:0/3344896666 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:02.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.356+0000 7fbbdaffd640 1 --2- 172.21.15.53:0/3344896666 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbbdc0cf1a0 0x7fbbdc155da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:02.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.356+0000 7fbbda7fc640 1 --2- 172.21.15.53:0/3344896666 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbbdc159390 0x7fbbdc14bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:02.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.356+0000 7fbbdb7fe640 1 -- 172.21.15.53:0/3344896666 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbbdc0cf1a0 msgr2=0x7fbbdc155da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:02.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.356+0000 7fbbdb7fe640 1 --2- 172.21.15.53:0/3344896666 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbbdc0cf1a0 0x7fbbdc155da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:02.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.356+0000 7fbbdb7fe640 1 -- 172.21.15.53:0/3344896666 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbbdc159390 msgr2=0x7fbbdc14bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:02.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.356+0000 7fbbdb7fe640 1 --2- 172.21.15.53:0/3344896666 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbbdc159390 0x7fbbdc14bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:02.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.356+0000 7fbbdb7fe640 1 -- 172.21.15.53:0/3344896666 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd4009a70 con 0x7fbbdc159760 2023-06-10T19:05:02.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.356+0000 7fbbdb7fe640 1 --2- 172.21.15.53:0/3344896666 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbbdc159760 0x7fbbdc0afcc0 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7fbbd40b0040 tx=0x7fbbd4019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:02.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.356+0000 7fbbc3fff640 1 -- 172.21.15.53:0/3344896666 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd40ade20 con 0x7fbbdc159760 2023-06-10T19:05:02.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.356+0000 7fbbc3fff640 1 -- 172.21.15.53:0/3344896666 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbd4009450 con 0x7fbbdc159760 2023-06-10T19:05:02.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.356+0000 7fbbe19d7640 1 -- 172.21.15.53:0/3344896666 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbdc156890 con 0x7fbbdc159760 2023-06-10T19:05:02.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.356+0000 7fbbc3fff640 1 -- 172.21.15.53:0/3344896666 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd40b9690 con 0x7fbbdc159760 2023-06-10T19:05:02.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.356+0000 7fbbe19d7640 1 -- 172.21.15.53:0/3344896666 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbdc14c520 con 0x7fbbdc159760 2023-06-10T19:05:02.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.356+0000 7fbbe19d7640 1 -- 172.21.15.53:0/3344896666 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbdc14ca40 con 0x7fbbdc159760 2023-06-10T19:05:02.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.356+0000 7fbbc3fff640 1 -- 172.21.15.53:0/3344896666 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbbd40039a0 con 0x7fbbdc159760 2023-06-10T19:05:02.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.356+0000 7fbbc3fff640 1 --2- 172.21.15.53:0/3344896666 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbbc80662b0 0x7fbbc8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:02.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.356+0000 7fbbc3fff640 1 -- 172.21.15.53:0/3344896666 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fbbd411eed0 con 0x7fbbdc159760 2023-06-10T19:05:02.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.356+0000 7fbbdaffd640 1 --2- 172.21.15.53:0/3344896666 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbbc80662b0 0x7fbbc8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:02.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.360+0000 7fbbdaffd640 1 --2- 172.21.15.53:0/3344896666 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbbc80662b0 0x7fbbc8068760 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc007fd0 tx=0x7fbbcc0079c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:02.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.360+0000 7fbbc3fff640 1 -- 172.21.15.53:0/3344896666 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbbdc14ca40 con 0x7fbbdc159760 2023-06-10T19:05:02.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:02.516+0000 7fbbe19d7640 1 -- 172.21.15.53:0/3344896666 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fbbdc04d790 con 0x7fbbdc159760 2023-06-10T19:05:03.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:03.480+0000 7fbbc3fff640 1 -- 172.21.15.53:0/3344896666 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v122) v1 ==== 138+0+0 (secure 0 0 0) 0x7fbbd40bd020 con 0x7fbbdc159760 2023-06-10T19:05:03.487 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_metadata' created 2023-06-10T19:05:03.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:03.488+0000 7fbbe19d7640 1 -- 172.21.15.53:0/3344896666 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbbc80662b0 msgr2=0x7fbbc8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:03.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:03.488+0000 7fbbe19d7640 1 --2- 172.21.15.53:0/3344896666 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbbc80662b0 0x7fbbc8068760 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc007fd0 tx=0x7fbbcc0079c0 comp rx=0 tx=0).stop 2023-06-10T19:05:03.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:03.488+0000 7fbbe19d7640 1 -- 172.21.15.53:0/3344896666 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbbdc159760 msgr2=0x7fbbdc0afcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:03.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:03.488+0000 7fbbe19d7640 1 --2- 172.21.15.53:0/3344896666 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbbdc159760 0x7fbbdc0afcc0 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7fbbd40b0040 tx=0x7fbbd4019680 comp rx=0 tx=0).stop 2023-06-10T19:05:03.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:03.488+0000 7fbbe19d7640 1 -- 172.21.15.53:0/3344896666 shutdown_connections 2023-06-10T19:05:03.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:03.488+0000 7fbbe19d7640 1 --2- 172.21.15.53:0/3344896666 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbbc80662b0 0x7fbbc8068760 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:03.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:03.488+0000 7fbbe19d7640 1 --2- 172.21.15.53:0/3344896666 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbbdc159760 0x7fbbdc0afcc0 unknown :-1 s=CLOSED pgs=1869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:03.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:03.488+0000 7fbbe19d7640 1 --2- 172.21.15.53:0/3344896666 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbbdc159390 0x7fbbdc14bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:03.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:03.488+0000 7fbbe19d7640 1 --2- 172.21.15.53:0/3344896666 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbbdc0cf1a0 0x7fbbdc155da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:03.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:03.488+0000 7fbbe19d7640 1 -- 172.21.15.53:0/3344896666 >> 172.21.15.53:0/3344896666 conn(0x7fbbdc06a0b0 msgr2=0x7fbbdc0b0c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:03.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:03.488+0000 7fbbe19d7640 1 -- 172.21.15.53:0/3344896666 shutdown_connections 2023-06-10T19:05:03.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:03.488+0000 7fbbe19d7640 1 -- 172.21.15.53:0/3344896666 wait complete. 2023-06-10T19:05:03.517 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-06-10T19:05:03.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:03.648+0000 7f12104c3640 1 Processor -- start 2023-06-10T19:05:03.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:03.648+0000 7f12104c3640 1 -- start start 2023-06-10T19:05:03.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:03.648+0000 7f12104c3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f12081582f0 0x7f12080af810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:03.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:03.648+0000 7f12104c3640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f12080afd50 0x7f120815bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:03.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:03.648+0000 7f12104c3640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12081592b0 con 0x7f1208158ee0 2023-06-10T19:05:03.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:03.648+0000 7f12104c3640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1208155da0 con 0x7f12080afd50 2023-06-10T19:05:03.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:03.648+0000 7f12104c3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12080b01d0 con 0x7f12081582f0 2023-06-10T19:05:03.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:03.648+0000 7f120ea60640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f12080afd50 0x7f120815bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:03.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:03.648+0000 7f120e25f640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f1208158ee0 0x7f12080c83e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.53:51930/0 (socket says 172.21.15.53:51930) 2023-06-10T19:05:03.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:03.648+0000 7f120e25f640 1 -- 172.21.15.53:0/3704508072 learned_addr learned my addr 172.21.15.53:0/3704508072 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:05:03.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:03.648+0000 7f120da5e640 1 --2- 172.21.15.53:0/3704508072 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f12081582f0 0x7f12080af810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:03.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:03.648+0000 7f120ea60640 1 -- 172.21.15.53:0/3704508072 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f12081582f0 msgr2=0x7f12080af810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:03.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:03.648+0000 7f120ea60640 1 --2- 172.21.15.53:0/3704508072 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f12081582f0 0x7f12080af810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:03.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:03.648+0000 7f120ea60640 1 -- 172.21.15.53:0/3704508072 >> v1:172.21.15.117:6789/0 conn(0x7f1208158ee0 legacy=0x7f12080c83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:03.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:03.648+0000 7f120ea60640 1 -- 172.21.15.53:0/3704508072 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1208158740 con 0x7f12080afd50 2023-06-10T19:05:03.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:03.648+0000 7f120da5e640 1 --2- 172.21.15.53:0/3704508072 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f12081582f0 0x7f12080af810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-10T19:05:03.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:03.652+0000 7f120ea60640 1 --2- 172.21.15.53:0/3704508072 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f12080afd50 0x7f120815bb20 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f12000097c0 tx=0x7f120001c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=271a2de0b30bcfcd server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:03.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:03.652+0000 7f120d25d640 1 -- 172.21.15.53:0/3704508072 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12000ac630 con 0x7f12080afd50 2023-06-10T19:05:03.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:03.652+0000 7f120d25d640 1 -- 172.21.15.53:0/3704508072 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12000ac790 con 0x7f12080afd50 2023-06-10T19:05:03.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:03.652+0000 7f120d25d640 1 -- 172.21.15.53:0/3704508072 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12000acb20 con 0x7f12080afd50 2023-06-10T19:05:03.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:03.652+0000 7f12104c3640 1 -- 172.21.15.53:0/3704508072 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f12080afd50 msgr2=0x7f120815bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:03.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:03.652+0000 7f12104c3640 1 --2- 172.21.15.53:0/3704508072 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f12080afd50 0x7f120815bb20 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f12000097c0 tx=0x7f120001c450 comp rx=0 tx=0).stop 2023-06-10T19:05:03.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:03.652+0000 7f12104c3640 1 -- 172.21.15.53:0/3704508072 shutdown_connections 2023-06-10T19:05:03.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:03.652+0000 7f12104c3640 1 --2- 172.21.15.53:0/3704508072 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f12080afd50 0x7f120815bb20 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:03.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:03.652+0000 7f12104c3640 1 --2- 172.21.15.53:0/3704508072 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f12081582f0 0x7f12080af810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:03.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:03.652+0000 7f12104c3640 1 -- 172.21.15.53:0/3704508072 >> 172.21.15.53:0/3704508072 conn(0x7f120806a0e0 msgr2=0x7f12080ca810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:03.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:03.652+0000 7f12104c3640 1 -- 172.21.15.53:0/3704508072 shutdown_connections 2023-06-10T19:05:03.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:03.652+0000 7f12104c3640 1 -- 172.21.15.53:0/3704508072 wait complete. 2023-06-10T19:05:03.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:03.652+0000 7f12104c3640 1 Processor -- start 2023-06-10T19:05:03.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:03.652+0000 7f12104c3640 1 -- start start 2023-06-10T19:05:03.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:03.656+0000 7f12104c3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f12080afd50 0x7f1208147ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:03.660 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:03.656+0000 7f12104c3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f12081582f0 0x7f1208163ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:03.660 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:03.656+0000 7f12104c3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1208158ee0 0x7f1208149550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:03.660 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:03.656+0000 7f12104c3640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12080abf20 con 0x7f12081582f0 2023-06-10T19:05:03.660 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:03.656+0000 7f12104c3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f120814fd00 con 0x7f12080afd50 2023-06-10T19:05:03.660 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:03.656+0000 7f12104c3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f120814ffe0 con 0x7f1208158ee0 2023-06-10T19:05:03.660 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:03.656+0000 7f120da5e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f12081582f0 0x7f1208163ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:03.660 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:03.656+0000 7f120da5e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f12081582f0 0x7f1208163ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60040/0 (socket says 172.21.15.53:60040) 2023-06-10T19:05:03.660 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:03.656+0000 7f120da5e640 1 -- 172.21.15.53:0/2637058796 learned_addr learned my addr 172.21.15.53:0/2637058796 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:03.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:03.656+0000 7f120ea60640 1 --2- 172.21.15.53:0/2637058796 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1208158ee0 0x7f1208149550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:03.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:03.656+0000 7f120e25f640 1 --2- 172.21.15.53:0/2637058796 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f12080afd50 0x7f1208147ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:03.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:03.656+0000 7f120da5e640 1 -- 172.21.15.53:0/2637058796 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1208158ee0 msgr2=0x7f1208149550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:03.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:03.656+0000 7f120da5e640 1 --2- 172.21.15.53:0/2637058796 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1208158ee0 0x7f1208149550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:03.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:03.656+0000 7f120da5e640 1 -- 172.21.15.53:0/2637058796 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f12080afd50 msgr2=0x7f1208147ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:03.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:03.656+0000 7f120da5e640 1 --2- 172.21.15.53:0/2637058796 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f12080afd50 0x7f1208147ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:03.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:03.656+0000 7f120da5e640 1 -- 172.21.15.53:0/2637058796 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11fc009a70 con 0x7f12081582f0 2023-06-10T19:05:03.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:03.656+0000 7f120ea60640 1 --2- 172.21.15.53:0/2637058796 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1208158ee0 0x7f1208149550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:05:03.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:03.656+0000 7f120da5e640 1 --2- 172.21.15.53:0/2637058796 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f12081582f0 0x7f1208163ee0 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7f11fc00efc0 tx=0x7f11fc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:03.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:03.656+0000 7f1206ffd640 1 -- 172.21.15.53:0/2637058796 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11fc014680 con 0x7f12081582f0 2023-06-10T19:05:03.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:03.656+0000 7f1206ffd640 1 -- 172.21.15.53:0/2637058796 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11fc00f040 con 0x7f12081582f0 2023-06-10T19:05:03.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:03.656+0000 7f1206ffd640 1 -- 172.21.15.53:0/2637058796 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11fc014a00 con 0x7f12081582f0 2023-06-10T19:05:03.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:03.656+0000 7f12104c3640 1 -- 172.21.15.53:0/2637058796 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1200009420 con 0x7f12081582f0 2023-06-10T19:05:03.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:03.656+0000 7f12104c3640 1 -- 172.21.15.53:0/2637058796 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12080abb40 con 0x7f12081582f0 2023-06-10T19:05:03.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:03.656+0000 7f12104c3640 1 -- 172.21.15.53:0/2637058796 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f120804d790 con 0x7f12081582f0 2023-06-10T19:05:03.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:03.656+0000 7f1206ffd640 1 -- 172.21.15.53:0/2637058796 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f11fc014b60 con 0x7f12081582f0 2023-06-10T19:05:03.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:03.656+0000 7f1206ffd640 1 --2- 172.21.15.53:0/2637058796 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f11ec066280 0x7f11ec068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:03.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:03.660+0000 7f1206ffd640 1 -- 172.21.15.53:0/2637058796 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f11fc084ae0 con 0x7f12081582f0 2023-06-10T19:05:03.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:03.660+0000 7f120e25f640 1 --2- 172.21.15.53:0/2637058796 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f11ec066280 0x7f11ec068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:03.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:03.660+0000 7f120e25f640 1 --2- 172.21.15.53:0/2637058796 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f11ec066280 0x7f11ec068730 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f11f4005890 tx=0x7f11f4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:03.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:03.664+0000 7f1206ffd640 1 -- 172.21.15.53:0/2637058796 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f11fc0521d0 con 0x7f12081582f0 2023-06-10T19:05:03.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:03.816+0000 7f12104c3640 1 -- 172.21.15.53:0/2637058796 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f120806b950 con 0x7f12081582f0 2023-06-10T19:05:04.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.500+0000 7f1206ffd640 1 -- 172.21.15.53:0/2637058796 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v123) v1 ==== 170+0+0 (secure 0 0 0) 0x7f11fc0557f0 con 0x7f12081582f0 2023-06-10T19:05:04.505 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_data' created 2023-06-10T19:05:04.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.512+0000 7f12104c3640 1 -- 172.21.15.53:0/2637058796 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f11ec066280 msgr2=0x7f11ec068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:04.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.512+0000 7f12104c3640 1 --2- 172.21.15.53:0/2637058796 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f11ec066280 0x7f11ec068730 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f11f4005890 tx=0x7f11f4009040 comp rx=0 tx=0).stop 2023-06-10T19:05:04.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.512+0000 7f12104c3640 1 -- 172.21.15.53:0/2637058796 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f12081582f0 msgr2=0x7f1208163ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:04.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.512+0000 7f12104c3640 1 --2- 172.21.15.53:0/2637058796 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f12081582f0 0x7f1208163ee0 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7f11fc00efc0 tx=0x7f11fc00c490 comp rx=0 tx=0).stop 2023-06-10T19:05:04.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.516+0000 7f12104c3640 1 -- 172.21.15.53:0/2637058796 shutdown_connections 2023-06-10T19:05:04.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.516+0000 7f12104c3640 1 --2- 172.21.15.53:0/2637058796 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f11ec066280 0x7f11ec068730 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:04.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.516+0000 7f12104c3640 1 --2- 172.21.15.53:0/2637058796 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1208158ee0 0x7f1208149550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:04.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.516+0000 7f12104c3640 1 --2- 172.21.15.53:0/2637058796 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f12081582f0 0x7f1208163ee0 unknown :-1 s=CLOSED pgs=1870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:04.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.516+0000 7f12104c3640 1 --2- 172.21.15.53:0/2637058796 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f12080afd50 0x7f1208147ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:04.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.516+0000 7f12104c3640 1 -- 172.21.15.53:0/2637058796 >> 172.21.15.53:0/2637058796 conn(0x7f120806a0e0 msgr2=0x7f12081505e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:04.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.516+0000 7f12104c3640 1 -- 172.21.15.53:0/2637058796 shutdown_connections 2023-06-10T19:05:04.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.516+0000 7f12104c3640 1 -- 172.21.15.53:0/2637058796 wait complete. 2023-06-10T19:05:04.552 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-06-10T19:05:04.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.668+0000 7f64cac4e640 1 Processor -- start 2023-06-10T19:05:04.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.668+0000 7f64cac4e640 1 -- start start 2023-06-10T19:05:04.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.672+0000 7f64cac4e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64c40c82a0 0x7f64c40c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:04.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.672+0000 7f64cac4e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f64c40af760 0x7f64c40afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:04.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.672+0000 7f64cac4e640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64c406b090 con 0x7f64c40c9fa0 2023-06-10T19:05:04.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.672+0000 7f64cac4e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64c40b0120 con 0x7f64c40af760 2023-06-10T19:05:04.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.672+0000 7f64cac4e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64c40ca370 con 0x7f64c40c82a0 2023-06-10T19:05:04.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.672+0000 7f64c89ea640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f64c40c9fa0 0x7f64c406bae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:35550/0 (socket says 172.21.15.53:35550) 2023-06-10T19:05:04.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.672+0000 7f64c89ea640 1 -- 172.21.15.53:0/1068906061 learned_addr learned my addr 172.21.15.53:0/1068906061 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:05:04.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.672+0000 7f64c3fff640 1 --2- 172.21.15.53:0/1068906061 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64c40c82a0 0x7f64c40c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:04.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.672+0000 7f64c91eb640 1 --2- 172.21.15.53:0/1068906061 >> v2:172.21.15.117:3300/0 conn(0x7f64c40af760 0x7f64c40afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:04.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.672+0000 7f64c37fe640 1 -- 172.21.15.53:0/1068906061 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 842611185 0 0) 0x7f64c406b090 con 0x7f64c40c9fa0 2023-06-10T19:05:04.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.672+0000 7f64c37fe640 1 -- 172.21.15.53:0/1068906061 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64b0003530 con 0x7f64c40c9fa0 2023-06-10T19:05:04.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.672+0000 7f64c37fe640 1 -- 172.21.15.53:0/1068906061 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1669744121 0 0) 0x7f64b0003530 con 0x7f64c40c9fa0 2023-06-10T19:05:04.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.672+0000 7f64c37fe640 1 -- 172.21.15.53:0/1068906061 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64c40c82a0 msgr2=0x7f64c40c86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:04.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.672+0000 7f64c37fe640 1 --2- 172.21.15.53:0/1068906061 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64c40c82a0 0x7f64c40c86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:04.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.672+0000 7f64c37fe640 1 -- 172.21.15.53:0/1068906061 >> v2:172.21.15.117:3300/0 conn(0x7f64c40af760 msgr2=0x7f64c40afbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:04.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.672+0000 7f64c37fe640 1 --2- 172.21.15.53:0/1068906061 >> v2:172.21.15.117:3300/0 conn(0x7f64c40af760 0x7f64c40afbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:04.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.672+0000 7f64c37fe640 1 -- 172.21.15.53:0/1068906061 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64c4070d50 con 0x7f64c40c9fa0 2023-06-10T19:05:04.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.672+0000 7f64c37fe640 1 -- 172.21.15.53:0/1068906061 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f64bc001a00 con 0x7f64c40c9fa0 2023-06-10T19:05:04.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.672+0000 7f64c37fe640 1 -- 172.21.15.53:0/1068906061 >> v1:172.21.15.53:6789/0 conn(0x7f64c40c9fa0 legacy=0x7f64c406bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:04.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.672+0000 7f64c37fe640 1 --2- 172.21.15.53:0/1068906061 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64c40c82a0 0x7f64b0003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:04.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.672+0000 7f64c37fe640 1 --2- 172.21.15.53:0/1068906061 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64b0003f00 0x7f64b00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:04.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.672+0000 7f64c37fe640 1 --2- 172.21.15.53:0/1068906061 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64b0004d10 0x7f64b0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:04.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.672+0000 7f64c37fe640 1 -- 172.21.15.53:0/1068906061 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64c40b0120 con 0x7f64b0004d10 2023-06-10T19:05:04.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.672+0000 7f64c37fe640 1 -- 172.21.15.53:0/1068906061 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64c40ca370 con 0x7f64b0003f00 2023-06-10T19:05:04.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.672+0000 7f64c37fe640 1 -- 172.21.15.53:0/1068906061 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64b000b9c0 con 0x7f64c40c82a0 2023-06-10T19:05:04.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.672+0000 7f64c91eb640 1 --2- 172.21.15.53:0/1068906061 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64b0004d10 0x7f64b0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:04.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.672+0000 7f64c89ea640 1 --2- 172.21.15.53:0/1068906061 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64c40c82a0 0x7f64b0003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:04.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.672+0000 7f64c3fff640 1 --2- 172.21.15.53:0/1068906061 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64b0003f00 0x7f64b00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:04.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.672+0000 7f64c91eb640 1 -- 172.21.15.53:0/1068906061 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64c40c82a0 msgr2=0x7f64b0003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:04.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.672+0000 7f64c91eb640 1 --2- 172.21.15.53:0/1068906061 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64c40c82a0 0x7f64b0003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:04.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.672+0000 7f64c91eb640 1 -- 172.21.15.53:0/1068906061 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64b0003f00 msgr2=0x7f64b00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:04.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.672+0000 7f64c91eb640 1 --2- 172.21.15.53:0/1068906061 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64b0003f00 0x7f64b00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:04.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.672+0000 7f64c91eb640 1 -- 172.21.15.53:0/1068906061 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64b0003530 con 0x7f64b0004d10 2023-06-10T19:05:04.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.676+0000 7f64c91eb640 1 --2- 172.21.15.53:0/1068906061 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64b0004d10 0x7f64b0005180 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7f64b4009ae0 tx=0x7f64b401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2396e42a8094ed9 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:04.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.676+0000 7f64c37fe640 1 -- 172.21.15.53:0/1068906061 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b40a5570 con 0x7f64b0004d10 2023-06-10T19:05:04.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.676+0000 7f64c37fe640 1 -- 172.21.15.53:0/1068906061 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64b40a56d0 con 0x7f64b0004d10 2023-06-10T19:05:04.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.676+0000 7f64c37fe640 1 -- 172.21.15.53:0/1068906061 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b40a5a80 con 0x7f64b0004d10 2023-06-10T19:05:04.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.676+0000 7f64cac4e640 1 -- 172.21.15.53:0/1068906061 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64b0004d10 msgr2=0x7f64b0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:04.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.676+0000 7f64cac4e640 1 --2- 172.21.15.53:0/1068906061 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64b0004d10 0x7f64b0005180 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7f64b4009ae0 tx=0x7f64b401ca30 comp rx=0 tx=0).stop 2023-06-10T19:05:04.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.676+0000 7f64c91eb640 1 -- 172.21.15.53:0/1068906061 reap_dead start 2023-06-10T19:05:04.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.676+0000 7f64cac4e640 1 -- 172.21.15.53:0/1068906061 shutdown_connections 2023-06-10T19:05:04.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.676+0000 7f64cac4e640 1 -- 172.21.15.53:0/1068906061 >> 172.21.15.53:0/1068906061 conn(0x7f64c406a0e0 msgr2=0x7f64c40cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:04.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.676+0000 7f64cac4e640 1 -- 172.21.15.53:0/1068906061 shutdown_connections 2023-06-10T19:05:04.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.676+0000 7f64cac4e640 1 -- 172.21.15.53:0/1068906061 wait complete. 2023-06-10T19:05:04.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.676+0000 7f64cac4e640 1 Processor -- start 2023-06-10T19:05:04.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.676+0000 7f64cac4e640 1 -- start start 2023-06-10T19:05:04.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.676+0000 7f64cac4e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64c41f0570 0x7f64c40c6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:04.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.676+0000 7f64cac4e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64c41f0940 0x7f64c40c7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:04.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.676+0000 7f64cac4e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64c40ac270 0x7f64c40ac6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:04.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.676+0000 7f64cac4e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64c40acf30 con 0x7f64c40ac270 2023-06-10T19:05:04.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.676+0000 7f64cac4e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64c40ad210 con 0x7f64c41f0940 2023-06-10T19:05:04.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.676+0000 7f64cac4e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64c40ad4f0 con 0x7f64c41f0570 2023-06-10T19:05:04.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.676+0000 7f64c91eb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64c40ac270 0x7f64c40ac6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:04.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.676+0000 7f64c91eb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64c40ac270 0x7f64c40ac6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60066/0 (socket says 172.21.15.53:60066) 2023-06-10T19:05:04.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.676+0000 7f64c91eb640 1 -- 172.21.15.53:0/2757474253 learned_addr learned my addr 172.21.15.53:0/2757474253 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:04.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.676+0000 7f64c89ea640 1 --2- 172.21.15.53:0/2757474253 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64c41f0570 0x7f64c40c6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:04.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.676+0000 7f64c3fff640 1 --2- 172.21.15.53:0/2757474253 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64c41f0940 0x7f64c40c7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:04.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.676+0000 7f64c91eb640 1 -- 172.21.15.53:0/2757474253 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64c41f0570 msgr2=0x7f64c40c6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:04.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.676+0000 7f64c91eb640 1 --2- 172.21.15.53:0/2757474253 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64c41f0570 0x7f64c40c6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:04.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.676+0000 7f64c91eb640 1 -- 172.21.15.53:0/2757474253 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64c41f0940 msgr2=0x7f64c40c7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:04.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.676+0000 7f64c91eb640 1 --2- 172.21.15.53:0/2757474253 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64c41f0940 0x7f64c40c7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:04.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.676+0000 7f64c91eb640 1 -- 172.21.15.53:0/2757474253 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64c40cb820 con 0x7f64c40ac270 2023-06-10T19:05:04.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.676+0000 7f64c91eb640 1 --2- 172.21.15.53:0/2757474253 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64c40ac270 0x7f64c40ac6e0 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7f64b40b0040 tx=0x7f64b0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:04.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.680+0000 7f64c17fa640 1 -- 172.21.15.53:0/2757474253 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b40bb070 con 0x7f64c40ac270 2023-06-10T19:05:04.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.680+0000 7f64c17fa640 1 -- 172.21.15.53:0/2757474253 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64b4004020 con 0x7f64c40ac270 2023-06-10T19:05:04.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.680+0000 7f64cac4e640 1 -- 172.21.15.53:0/2757474253 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64c40cbb00 con 0x7f64c40ac270 2023-06-10T19:05:04.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.680+0000 7f64c17fa640 1 -- 172.21.15.53:0/2757474253 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b40a5570 con 0x7f64c40ac270 2023-06-10T19:05:04.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.680+0000 7f64cac4e640 1 -- 172.21.15.53:0/2757474253 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64c41f43b0 con 0x7f64c40ac270 2023-06-10T19:05:04.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.680+0000 7f64cac4e640 1 -- 172.21.15.53:0/2757474253 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64c40ad070 con 0x7f64c40ac270 2023-06-10T19:05:04.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.680+0000 7f64c17fa640 1 -- 172.21.15.53:0/2757474253 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f64b40b4040 con 0x7f64c40ac270 2023-06-10T19:05:04.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.680+0000 7f64c17fa640 1 --2- 172.21.15.53:0/2757474253 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f64a4066280 0x7f64a4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:04.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.680+0000 7f64c17fa640 1 -- 172.21.15.53:0/2757474253 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f64b411cfa0 con 0x7f64c40ac270 2023-06-10T19:05:04.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.680+0000 7f64c89ea640 1 --2- 172.21.15.53:0/2757474253 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f64a4066280 0x7f64a4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:04.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.680+0000 7f64c89ea640 1 --2- 172.21.15.53:0/2757474253 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f64a4066280 0x7f64a4068730 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f64bc000f90 tx=0x7f64bc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:04.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.684+0000 7f64c17fa640 1 -- 172.21.15.53:0/2757474253 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f64c40ad070 con 0x7f64c40ac270 2023-06-10T19:05:04.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.872+0000 7f64cac4e640 1 -- 172.21.15.53:0/2757474253 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f64c40ad350 con 0x7f64c40ac270 2023-06-10T19:05:04.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.888+0000 7f64c17fa640 1 -- 172.21.15.53:0/2757474253 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 17 and data pool 18 v67) v1 ==== 174+0+0 (secure 0 0 0) 0x7f64c40ad350 con 0x7f64c40ac270 2023-06-10T19:05:04.895 INFO:teuthology.orchestra.run.smithi053.stderr:new fs with metadata pool 17 and data pool 18 2023-06-10T19:05:04.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.900+0000 7f64cac4e640 1 -- 172.21.15.53:0/2757474253 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f64a4066280 msgr2=0x7f64a4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:04.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.900+0000 7f64cac4e640 1 --2- 172.21.15.53:0/2757474253 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f64a4066280 0x7f64a4068730 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f64bc000f90 tx=0x7f64bc009040 comp rx=0 tx=0).stop 2023-06-10T19:05:04.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.900+0000 7f64cac4e640 1 -- 172.21.15.53:0/2757474253 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64c40ac270 msgr2=0x7f64c40ac6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:04.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.900+0000 7f64cac4e640 1 --2- 172.21.15.53:0/2757474253 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64c40ac270 0x7f64c40ac6e0 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7f64b40b0040 tx=0x7f64b0005800 comp rx=0 tx=0).stop 2023-06-10T19:05:04.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.912+0000 7f64cac4e640 1 -- 172.21.15.53:0/2757474253 shutdown_connections 2023-06-10T19:05:04.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.912+0000 7f64cac4e640 1 --2- 172.21.15.53:0/2757474253 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f64a4066280 0x7f64a4068730 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:04.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.912+0000 7f64cac4e640 1 --2- 172.21.15.53:0/2757474253 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64c40ac270 0x7f64c40ac6e0 unknown :-1 s=CLOSED pgs=1873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:04.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.912+0000 7f64cac4e640 1 --2- 172.21.15.53:0/2757474253 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64c41f0940 0x7f64c40c7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:04.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.912+0000 7f64cac4e640 1 --2- 172.21.15.53:0/2757474253 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64c41f0570 0x7f64c40c6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:04.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.912+0000 7f64cac4e640 1 -- 172.21.15.53:0/2757474253 >> 172.21.15.53:0/2757474253 conn(0x7f64c406a0e0 msgr2=0x7f64c40aefd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:04.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.912+0000 7f64cac4e640 1 -- 172.21.15.53:0/2757474253 shutdown_connections 2023-06-10T19:05:04.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:04.912+0000 7f64cac4e640 1 -- 172.21.15.53:0/2757474253 wait complete. 2023-06-10T19:05:04.941 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:05:05.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.052+0000 7f57a1731640 1 Processor -- start 2023-06-10T19:05:05.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.052+0000 7f57a1731640 1 -- start start 2023-06-10T19:05:05.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.056+0000 7f57a1731640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f579c0cd760 0x7f579c0cbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:05.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.056+0000 7f57a1731640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f579c0cc6c0 con 0x7f579c15ba70 2023-06-10T19:05:05.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.056+0000 7f57a1731640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f579c0cc9a0 con 0x7f579c15c810 2023-06-10T19:05:05.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.056+0000 7f57a1731640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f579c0cdb30 con 0x7f579c0cd760 2023-06-10T19:05:05.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.056+0000 7f579affd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f579c15ba70 0x7f579c15c100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:35566/0 (socket says 172.21.15.53:35566) 2023-06-10T19:05:05.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.056+0000 7f579affd640 1 -- 172.21.15.53:0/480082730 learned_addr learned my addr 172.21.15.53:0/480082730 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:05:05.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.056+0000 7f579b7fe640 1 --2- 172.21.15.53:0/480082730 >> v2:172.21.15.53:3300/0 conn(0x7f579c0cd760 0x7f579c0cbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:05.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.056+0000 7f5799ffb640 1 -- 172.21.15.53:0/480082730 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3759795471 0 0) 0x7f579c0cc6c0 con 0x7f579c15ba70 2023-06-10T19:05:05.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.056+0000 7f5799ffb640 1 -- 172.21.15.53:0/480082730 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5784003530 con 0x7f579c15ba70 2023-06-10T19:05:05.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.056+0000 7f579b7fe640 1 -- 172.21.15.53:0/480082730 >> v1:172.21.15.117:6789/0 conn(0x7f579c15c810 legacy=0x7f579c06efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:05.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.056+0000 7f579b7fe640 1 -- 172.21.15.53:0/480082730 >> v1:172.21.15.53:6789/0 conn(0x7f579c15ba70 legacy=0x7f579c15c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:05.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.056+0000 7f579b7fe640 1 -- 172.21.15.53:0/480082730 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f579c0ccc80 con 0x7f579c0cd760 2023-06-10T19:05:05.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.060+0000 7f579b7fe640 1 --2- 172.21.15.53:0/480082730 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f579c0cd760 0x7f579c0cbfc0 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7f578c0097c0 tx=0x7f578c01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a1c052e82c0f96f server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:05.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.060+0000 7f5799ffb640 1 -- 172.21.15.53:0/480082730 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f578c0ab5f0 con 0x7f579c0cd760 2023-06-10T19:05:05.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.060+0000 7f5799ffb640 1 -- 172.21.15.53:0/480082730 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f578c0ab750 con 0x7f579c0cd760 2023-06-10T19:05:05.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.060+0000 7f5799ffb640 1 -- 172.21.15.53:0/480082730 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f578c0abac0 con 0x7f579c0cd760 2023-06-10T19:05:05.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.060+0000 7f57a1731640 1 -- 172.21.15.53:0/480082730 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f579c0cd760 msgr2=0x7f579c0cbfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:05.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.060+0000 7f57a1731640 1 --2- 172.21.15.53:0/480082730 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f579c0cd760 0x7f579c0cbfc0 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7f578c0097c0 tx=0x7f578c01c3f0 comp rx=0 tx=0).stop 2023-06-10T19:05:05.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.060+0000 7f57a1731640 1 -- 172.21.15.53:0/480082730 shutdown_connections 2023-06-10T19:05:05.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.060+0000 7f57a1731640 1 --2- 172.21.15.53:0/480082730 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f579c0cd760 0x7f579c0cbfc0 unknown :-1 s=CLOSED pgs=1875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:05.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.060+0000 7f57a1731640 1 -- 172.21.15.53:0/480082730 >> 172.21.15.53:0/480082730 conn(0x7f579c06a0d0 msgr2=0x7f579c0ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:05.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.060+0000 7f57a1731640 1 -- 172.21.15.53:0/480082730 shutdown_connections 2023-06-10T19:05:05.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.060+0000 7f57a1731640 1 -- 172.21.15.53:0/480082730 wait complete. 2023-06-10T19:05:05.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.060+0000 7f57a1731640 1 Processor -- start 2023-06-10T19:05:05.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.060+0000 7f57a1731640 1 -- start start 2023-06-10T19:05:05.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.060+0000 7f57a1731640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f579c0cd760 0x7f579c158730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:05.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.060+0000 7f57a1731640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f579c15ba70 0x7f579c154c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:05.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.060+0000 7f57a1731640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f579c15c810 0x7f579c0c39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:05.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.060+0000 7f57a1731640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f579c14e2d0 con 0x7f579c15c810 2023-06-10T19:05:05.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.060+0000 7f57a1731640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f579c158c70 con 0x7f579c0cd760 2023-06-10T19:05:05.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.060+0000 7f57a1731640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f579c157690 con 0x7f579c15ba70 2023-06-10T19:05:05.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.060+0000 7f579b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f579c15c810 0x7f579c0c39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:05.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.060+0000 7f579b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f579c15c810 0x7f579c0c39b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60084/0 (socket says 172.21.15.53:60084) 2023-06-10T19:05:05.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.060+0000 7f579b7fe640 1 -- 172.21.15.53:0/796094738 learned_addr learned my addr 172.21.15.53:0/796094738 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:05.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.060+0000 7f579affd640 1 --2- 172.21.15.53:0/796094738 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f579c0cd760 0x7f579c158730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:05.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.060+0000 7f579a7fc640 1 --2- 172.21.15.53:0/796094738 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f579c15ba70 0x7f579c154c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:05.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.060+0000 7f579b7fe640 1 -- 172.21.15.53:0/796094738 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f579c15ba70 msgr2=0x7f579c154c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:05.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.060+0000 7f579b7fe640 1 --2- 172.21.15.53:0/796094738 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f579c15ba70 0x7f579c154c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:05.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.060+0000 7f579b7fe640 1 -- 172.21.15.53:0/796094738 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f579c0cd760 msgr2=0x7f579c158730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:05.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.060+0000 7f579b7fe640 1 --2- 172.21.15.53:0/796094738 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f579c0cd760 0x7f579c158730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:05.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.060+0000 7f579b7fe640 1 -- 172.21.15.53:0/796094738 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f578c009420 con 0x7f579c15c810 2023-06-10T19:05:05.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.060+0000 7f579b7fe640 1 --2- 172.21.15.53:0/796094738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f579c15c810 0x7f579c0c39b0 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7f578c0ad040 tx=0x7f578c01ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:05.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.064+0000 7f57837fe640 1 -- 172.21.15.53:0/796094738 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f578c004230 con 0x7f579c15c810 2023-06-10T19:05:05.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.064+0000 7f57837fe640 1 -- 172.21.15.53:0/796094738 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f578c0b9070 con 0x7f579c15c810 2023-06-10T19:05:05.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.064+0000 7f57a1731640 1 -- 172.21.15.53:0/796094738 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f579c157970 con 0x7f579c15c810 2023-06-10T19:05:05.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.064+0000 7f57837fe640 1 -- 172.21.15.53:0/796094738 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f578c003620 con 0x7f579c15c810 2023-06-10T19:05:05.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.064+0000 7f57a1731640 1 -- 172.21.15.53:0/796094738 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f579c157f30 con 0x7f579c15c810 2023-06-10T19:05:05.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.064+0000 7f57a1731640 1 -- 172.21.15.53:0/796094738 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f579c0ca040 con 0x7f579c15c810 2023-06-10T19:05:05.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.064+0000 7f57837fe640 1 -- 172.21.15.53:0/796094738 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f578c003780 con 0x7f579c15c810 2023-06-10T19:05:05.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.064+0000 7f57837fe640 1 --2- 172.21.15.53:0/796094738 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5788066280 0x7f5788068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:05.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.064+0000 7f57837fe640 1 -- 172.21.15.53:0/796094738 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f578c0bb070 con 0x7f579c15c810 2023-06-10T19:05:05.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.064+0000 7f579affd640 1 --2- 172.21.15.53:0/796094738 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5788066280 0x7f5788068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:05.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.064+0000 7f579affd640 1 --2- 172.21.15.53:0/796094738 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5788066280 0x7f5788068730 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f5794001570 tx=0x7f5794009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:05.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.068+0000 7f57837fe640 1 -- 172.21.15.53:0/796094738 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f578c0ebbf0 con 0x7f579c15c810 2023-06-10T19:05:05.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.216+0000 7f57a1731640 1 -- 172.21.15.53:0/796094738 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f579c04d790 con 0x7f579c15c810 2023-06-10T19:05:05.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.220+0000 7f57837fe640 1 -- 172.21.15.53:0/796094738 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v124) v1 ==== 74+0+18362 (secure 0 0 0) 0x7f578c0ef210 con 0x7f579c15c810 2023-06-10T19:05:05.225 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:05:05.225 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":124,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:05:04.878017+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-06-10T19:05:02.560833+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-06-10T19:05:03.863586+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:05:05.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.224+0000 7f57a1731640 1 -- 172.21.15.53:0/796094738 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5788066280 msgr2=0x7f5788068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:05.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.224+0000 7f57a1731640 1 --2- 172.21.15.53:0/796094738 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5788066280 0x7f5788068730 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f5794001570 tx=0x7f5794009040 comp rx=0 tx=0).stop 2023-06-10T19:05:05.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.224+0000 7f57a1731640 1 -- 172.21.15.53:0/796094738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f579c15c810 msgr2=0x7f579c0c39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:05.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.224+0000 7f57a1731640 1 --2- 172.21.15.53:0/796094738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f579c15c810 0x7f579c0c39b0 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7f578c0ad040 tx=0x7f578c01ac30 comp rx=0 tx=0).stop 2023-06-10T19:05:05.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.224+0000 7f57a1731640 1 -- 172.21.15.53:0/796094738 shutdown_connections 2023-06-10T19:05:05.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.224+0000 7f57a1731640 1 --2- 172.21.15.53:0/796094738 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5788066280 0x7f5788068730 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:05.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.224+0000 7f57a1731640 1 --2- 172.21.15.53:0/796094738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f579c15c810 0x7f579c0c39b0 unknown :-1 s=CLOSED pgs=1876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:05.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.224+0000 7f57a1731640 1 --2- 172.21.15.53:0/796094738 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f579c15ba70 0x7f579c154c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:05.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.224+0000 7f57a1731640 1 --2- 172.21.15.53:0/796094738 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f579c0cd760 0x7f579c158730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:05.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.224+0000 7f57a1731640 1 -- 172.21.15.53:0/796094738 >> 172.21.15.53:0/796094738 conn(0x7f579c06a0d0 msgr2=0x7f579c0c82b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:05.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.224+0000 7f57a1731640 1 -- 172.21.15.53:0/796094738 shutdown_connections 2023-06-10T19:05:05.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.224+0000 7f57a1731640 1 -- 172.21.15.53:0/796094738 wait complete. 2023-06-10T19:05:05.243 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:05:05.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.364+0000 7f5068843640 1 Processor -- start 2023-06-10T19:05:05.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.364+0000 7f5068843640 1 -- start start 2023-06-10T19:05:05.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.364+0000 7f5068843640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f506406b2f0 0x7f506406f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:05.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.364+0000 7f5068843640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f50640c8d00 0x7f506406b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:05.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.364+0000 7f5068843640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f506406bc00 0x7f50640cbe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:05.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.364+0000 7f5068843640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5064158a90 con 0x7f50640c8d00 2023-06-10T19:05:05.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.364+0000 7f5068843640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50640705d0 con 0x7f506406b2f0 2023-06-10T19:05:05.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.364+0000 7f5068843640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f506406f9c0 con 0x7f506406bc00 2023-06-10T19:05:05.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.364+0000 7f5061d9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f50640c8d00 0x7f506406b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:05.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.364+0000 7f5061d9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f50640c8d00 0x7f506406b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60086/0 (socket says 172.21.15.53:60086) 2023-06-10T19:05:05.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.364+0000 7f5061d9b640 1 -- 172.21.15.53:0/127206341 learned_addr learned my addr 172.21.15.53:0/127206341 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:05.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.364+0000 7f5062d9d640 1 --2- 172.21.15.53:0/127206341 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f506406bc00 0x7f50640cbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:05.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.364+0000 7f506259c640 1 --2- 172.21.15.53:0/127206341 >> v2:172.21.15.117:3300/0 conn(0x7f506406b2f0 0x7f506406f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:05.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.364+0000 7f5061d9b640 1 -- 172.21.15.53:0/127206341 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f506406bc00 msgr2=0x7f50640cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:05.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.364+0000 7f5061d9b640 1 --2- 172.21.15.53:0/127206341 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f506406bc00 0x7f50640cbe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:05.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.364+0000 7f5061d9b640 1 -- 172.21.15.53:0/127206341 >> v2:172.21.15.117:3300/0 conn(0x7f506406b2f0 msgr2=0x7f506406f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:05.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.364+0000 7f5061d9b640 1 --2- 172.21.15.53:0/127206341 >> v2:172.21.15.117:3300/0 conn(0x7f506406b2f0 0x7f506406f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:05.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.364+0000 7f5061d9b640 1 -- 172.21.15.53:0/127206341 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f506406fca0 con 0x7f50640c8d00 2023-06-10T19:05:05.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.368+0000 7f5061d9b640 1 --2- 172.21.15.53:0/127206341 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50640c8d00 0x7f506406b6c0 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7f5064071d80 tx=0x7f505801ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e81f6a1b2c84ce7 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:05.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.368+0000 7f506159a640 1 -- 172.21.15.53:0/127206341 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50580a89b0 con 0x7f50640c8d00 2023-06-10T19:05:05.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.368+0000 7f506159a640 1 -- 172.21.15.53:0/127206341 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50580a8b10 con 0x7f50640c8d00 2023-06-10T19:05:05.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.368+0000 7f506159a640 1 -- 172.21.15.53:0/127206341 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50580a8ea0 con 0x7f50640c8d00 2023-06-10T19:05:05.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.368+0000 7f5068843640 1 -- 172.21.15.53:0/127206341 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50640c8d00 msgr2=0x7f506406b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:05.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.368+0000 7f5068843640 1 --2- 172.21.15.53:0/127206341 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50640c8d00 0x7f506406b6c0 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7f5064071d80 tx=0x7f505801ecf0 comp rx=0 tx=0).stop 2023-06-10T19:05:05.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.368+0000 7f5068843640 1 -- 172.21.15.53:0/127206341 shutdown_connections 2023-06-10T19:05:05.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.368+0000 7f5068843640 1 --2- 172.21.15.53:0/127206341 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f506406bc00 0x7f50640cbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:05.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.368+0000 7f5068843640 1 --2- 172.21.15.53:0/127206341 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50640c8d00 0x7f506406b6c0 unknown :-1 s=CLOSED pgs=1877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:05.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.368+0000 7f5068843640 1 --2- 172.21.15.53:0/127206341 >> v2:172.21.15.117:3300/0 conn(0x7f506406b2f0 0x7f506406f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:05.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.368+0000 7f5068843640 1 -- 172.21.15.53:0/127206341 >> 172.21.15.53:0/127206341 conn(0x7f506406a0d0 msgr2=0x7f50640ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:05.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.368+0000 7f5068843640 1 -- 172.21.15.53:0/127206341 shutdown_connections 2023-06-10T19:05:05.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.368+0000 7f5068843640 1 -- 172.21.15.53:0/127206341 wait complete. 2023-06-10T19:05:05.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.368+0000 7f5068843640 1 Processor -- start 2023-06-10T19:05:05.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.368+0000 7f5068843640 1 -- start start 2023-06-10T19:05:05.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.368+0000 7f5068843640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f506406b2f0 0x7f50641efd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:05.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.368+0000 7f5068843640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f506406bc00 0x7f50641f1a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:05.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.368+0000 7f5068843640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50640c8d00 0x7f50641ef610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:05.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.368+0000 7f5068843640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50641f1f50 con 0x7f506406bc00 2023-06-10T19:05:05.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.368+0000 7f5068843640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50641efb50 con 0x7f506406b2f0 2023-06-10T19:05:05.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.368+0000 7f5068843640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5064158fd0 con 0x7f50640c8d00 2023-06-10T19:05:05.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.368+0000 7f5061d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f506406bc00 0x7f50641f1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:05.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.368+0000 7f5061d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f506406bc00 0x7f50641f1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60092/0 (socket says 172.21.15.53:60092) 2023-06-10T19:05:05.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.368+0000 7f5061d9b640 1 -- 172.21.15.53:0/3266217285 learned_addr learned my addr 172.21.15.53:0/3266217285 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:05.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.368+0000 7f5062d9d640 1 --2- 172.21.15.53:0/3266217285 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50640c8d00 0x7f50641ef610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:05.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.368+0000 7f506259c640 1 --2- 172.21.15.53:0/3266217285 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f506406b2f0 0x7f50641efd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:05.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.368+0000 7f5061d9b640 1 -- 172.21.15.53:0/3266217285 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50640c8d00 msgr2=0x7f50641ef610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:05.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.368+0000 7f5061d9b640 1 --2- 172.21.15.53:0/3266217285 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50640c8d00 0x7f50641ef610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:05.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.368+0000 7f5061d9b640 1 -- 172.21.15.53:0/3266217285 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f506406b2f0 msgr2=0x7f50641efd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:05.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.368+0000 7f5061d9b640 1 --2- 172.21.15.53:0/3266217285 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f506406b2f0 0x7f50641efd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:05.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.368+0000 7f5061d9b640 1 -- 172.21.15.53:0/3266217285 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50580094d0 con 0x7f506406bc00 2023-06-10T19:05:05.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.372+0000 7f5061d9b640 1 --2- 172.21.15.53:0/3266217285 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f506406bc00 0x7f50641f1a10 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 crypto rx=0x7f50580b3040 tx=0x7f505801ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:05.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.372+0000 7f5052ffd640 1 -- 172.21.15.53:0/3266217285 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50580b9620 con 0x7f506406bc00 2023-06-10T19:05:05.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.372+0000 7f5052ffd640 1 -- 172.21.15.53:0/3266217285 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50580b9780 con 0x7f506406bc00 2023-06-10T19:05:05.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.372+0000 7f5052ffd640 1 -- 172.21.15.53:0/3266217285 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50580b9b30 con 0x7f506406bc00 2023-06-10T19:05:05.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.372+0000 7f5068843640 1 -- 172.21.15.53:0/3266217285 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50641592b0 con 0x7f506406bc00 2023-06-10T19:05:05.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.372+0000 7f5068843640 1 -- 172.21.15.53:0/3266217285 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5064159870 con 0x7f506406bc00 2023-06-10T19:05:05.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.372+0000 7f5068843640 1 -- 172.21.15.53:0/3266217285 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f506404d790 con 0x7f506406bc00 2023-06-10T19:05:05.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.372+0000 7f5052ffd640 1 -- 172.21.15.53:0/3266217285 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f50580b7070 con 0x7f506406bc00 2023-06-10T19:05:05.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.372+0000 7f5052ffd640 1 --2- 172.21.15.53:0/3266217285 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5044066280 0x7f5044068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:05.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.372+0000 7f5052ffd640 1 -- 172.21.15.53:0/3266217285 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5058122530 con 0x7f506406bc00 2023-06-10T19:05:05.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.372+0000 7f506259c640 1 --2- 172.21.15.53:0/3266217285 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5044066280 0x7f5044068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:05.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.372+0000 7f506259c640 1 --2- 172.21.15.53:0/3266217285 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5044066280 0x7f5044068730 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f50540045f0 tx=0x7f5054008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:05.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.376+0000 7f5052ffd640 1 -- 172.21.15.53:0/3266217285 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f50580efbd0 con 0x7f506406bc00 2023-06-10T19:05:05.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.532+0000 7f5068843640 1 -- 172.21.15.53:0/3266217285 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f50640c84a0 con 0x7f506406bc00 2023-06-10T19:05:05.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.532+0000 7f5052ffd640 1 -- 172.21.15.53:0/3266217285 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v124) v1 ==== 74+0+18362 (secure 0 0 0) 0x7f50580f31f0 con 0x7f506406bc00 2023-06-10T19:05:05.538 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:05:05.538 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":124,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:05:04.878017+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-06-10T19:05:02.560833+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-06-10T19:05:03.863586+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:05:05.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.536+0000 7f5068843640 1 -- 172.21.15.53:0/3266217285 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5044066280 msgr2=0x7f5044068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:05.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.536+0000 7f5068843640 1 --2- 172.21.15.53:0/3266217285 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5044066280 0x7f5044068730 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f50540045f0 tx=0x7f5054008040 comp rx=0 tx=0).stop 2023-06-10T19:05:05.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.536+0000 7f5068843640 1 -- 172.21.15.53:0/3266217285 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f506406bc00 msgr2=0x7f50641f1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:05.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.536+0000 7f5068843640 1 --2- 172.21.15.53:0/3266217285 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f506406bc00 0x7f50641f1a10 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 crypto rx=0x7f50580b3040 tx=0x7f505801ba90 comp rx=0 tx=0).stop 2023-06-10T19:05:05.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.536+0000 7f5068843640 1 -- 172.21.15.53:0/3266217285 shutdown_connections 2023-06-10T19:05:05.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.536+0000 7f5068843640 1 --2- 172.21.15.53:0/3266217285 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5044066280 0x7f5044068730 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:05.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.536+0000 7f5068843640 1 --2- 172.21.15.53:0/3266217285 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50640c8d00 0x7f50641ef610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:05.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.536+0000 7f5068843640 1 --2- 172.21.15.53:0/3266217285 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f506406bc00 0x7f50641f1a10 unknown :-1 s=CLOSED pgs=1878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:05.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.536+0000 7f5068843640 1 --2- 172.21.15.53:0/3266217285 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f506406b2f0 0x7f50641efd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:05.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.536+0000 7f5068843640 1 -- 172.21.15.53:0/3266217285 >> 172.21.15.53:0/3266217285 conn(0x7f506406a0d0 msgr2=0x7f50640b3170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:05.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.536+0000 7f5068843640 1 -- 172.21.15.53:0/3266217285 shutdown_connections 2023-06-10T19:05:05.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.536+0000 7f5068843640 1 -- 172.21.15.53:0/3266217285 wait complete. 2023-06-10T19:05:05.558 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-06-10T19:05:05.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.676+0000 7f8d571be640 1 Processor -- start 2023-06-10T19:05:05.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.676+0000 7f8d571be640 1 -- start start 2023-06-10T19:05:05.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.676+0000 7f8d571be640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8d500b7e30 0x7f8d500b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:05.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.676+0000 7f8d571be640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d500cc7c0 con 0x7f8d5015c090 2023-06-10T19:05:05.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.676+0000 7f8d571be640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d500ccaa0 con 0x7f8d500b0b90 2023-06-10T19:05:05.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.676+0000 7f8d571be640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d500ccd80 con 0x7f8d500b7e30 2023-06-10T19:05:05.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.676+0000 7f8d54f5a640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f8d5015c090 0x7f8d500b7720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:35582/0 (socket says 172.21.15.53:35582) 2023-06-10T19:05:05.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.676+0000 7f8d54f5a640 1 -- 172.21.15.53:0/1449871585 learned_addr learned my addr 172.21.15.53:0/1449871585 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:05:05.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.676+0000 7f8d4ffff640 1 --2- 172.21.15.53:0/1449871585 >> v2:172.21.15.117:3300/0 conn(0x7f8d500b7e30 0x7f8d500b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:05.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.676+0000 7f8d4f7fe640 1 -- 172.21.15.53:0/1449871585 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 942771241 0 0) 0x7f8d500cc7c0 con 0x7f8d5015c090 2023-06-10T19:05:05.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.676+0000 7f8d4f7fe640 1 -- 172.21.15.53:0/1449871585 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d38003530 con 0x7f8d5015c090 2023-06-10T19:05:05.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.676+0000 7f8d4f7fe640 1 -- 172.21.15.53:0/1449871585 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2481226847 0 0) 0x7f8d38003530 con 0x7f8d5015c090 2023-06-10T19:05:05.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.676+0000 7f8d4f7fe640 1 -- 172.21.15.53:0/1449871585 >> v2:172.21.15.117:3300/0 conn(0x7f8d500b7e30 msgr2=0x7f8d500b10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:05.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.676+0000 7f8d4f7fe640 1 --2- 172.21.15.53:0/1449871585 >> v2:172.21.15.117:3300/0 conn(0x7f8d500b7e30 0x7f8d500b10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:05.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.676+0000 7f8d4f7fe640 1 -- 172.21.15.53:0/1449871585 >> v1:172.21.15.117:6789/0 conn(0x7f8d500b0b90 legacy=0x7f8d500d04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:05.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.676+0000 7f8d4f7fe640 1 -- 172.21.15.53:0/1449871585 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d500cd060 con 0x7f8d5015c090 2023-06-10T19:05:05.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.676+0000 7f8d4f7fe640 1 -- 172.21.15.53:0/1449871585 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f8d40001680 con 0x7f8d5015c090 2023-06-10T19:05:05.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.676+0000 7f8d4f7fe640 1 -- 172.21.15.53:0/1449871585 >> v1:172.21.15.53:6789/0 conn(0x7f8d5015c090 legacy=0x7f8d500b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:05.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.676+0000 7f8d4f7fe640 1 --2- 172.21.15.53:0/1449871585 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d38003980 0x7f8d38003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:05.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.676+0000 7f8d4f7fe640 1 --2- 172.21.15.53:0/1449871585 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d380047d0 0x7f8d38004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:05.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.676+0000 7f8d4f7fe640 1 --2- 172.21.15.53:0/1449871585 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d38005180 0x7f8d3800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:05.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.676+0000 7f8d4f7fe640 1 -- 172.21.15.53:0/1449871585 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d500ccd80 con 0x7f8d380047d0 2023-06-10T19:05:05.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.676+0000 7f8d4f7fe640 1 -- 172.21.15.53:0/1449871585 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3800c090 con 0x7f8d38005180 2023-06-10T19:05:05.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.676+0000 7f8d4f7fe640 1 -- 172.21.15.53:0/1449871585 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3800c250 con 0x7f8d38003980 2023-06-10T19:05:05.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.676+0000 7f8d4ffff640 1 --2- 172.21.15.53:0/1449871585 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d380047d0 0x7f8d38004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:05.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.676+0000 7f8d5575b640 1 --2- 172.21.15.53:0/1449871585 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d38005180 0x7f8d3800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:05.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.676+0000 7f8d54f5a640 1 --2- 172.21.15.53:0/1449871585 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d38003980 0x7f8d38003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:05.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.676+0000 7f8d4ffff640 1 -- 172.21.15.53:0/1449871585 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d38003980 msgr2=0x7f8d38003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:05.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.676+0000 7f8d4ffff640 1 --2- 172.21.15.53:0/1449871585 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d38003980 0x7f8d38003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:05.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.676+0000 7f8d4ffff640 1 -- 172.21.15.53:0/1449871585 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d38005180 msgr2=0x7f8d3800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:05.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.676+0000 7f8d4ffff640 1 --2- 172.21.15.53:0/1449871585 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d38005180 0x7f8d3800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:05.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.676+0000 7f8d4ffff640 1 -- 172.21.15.53:0/1449871585 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d38003530 con 0x7f8d380047d0 2023-06-10T19:05:05.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.676+0000 7f8d5575b640 1 --2- 172.21.15.53:0/1449871585 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d38005180 0x7f8d3800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:05:05.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.676+0000 7f8d54f5a640 1 --2- 172.21.15.53:0/1449871585 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d38003980 0x7f8d38003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:05:05.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.676+0000 7f8d5575b640 1 -- 172.21.15.53:0/1449871585 reap_dead start 2023-06-10T19:05:05.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.680+0000 7f8d4ffff640 1 --2- 172.21.15.53:0/1449871585 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d380047d0 0x7f8d38004c40 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7f8d44009ae0 tx=0x7f8d4401ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73b93e52be723bf1 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:05.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.680+0000 7f8d4f7fe640 1 -- 172.21.15.53:0/1449871585 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d440a6510 con 0x7f8d380047d0 2023-06-10T19:05:05.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.680+0000 7f8d4f7fe640 1 -- 172.21.15.53:0/1449871585 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d440a6670 con 0x7f8d380047d0 2023-06-10T19:05:05.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.680+0000 7f8d4f7fe640 1 -- 172.21.15.53:0/1449871585 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d440a6a20 con 0x7f8d380047d0 2023-06-10T19:05:05.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.680+0000 7f8d571be640 1 -- 172.21.15.53:0/1449871585 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d380047d0 msgr2=0x7f8d38004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:05.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.680+0000 7f8d571be640 1 --2- 172.21.15.53:0/1449871585 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d380047d0 0x7f8d38004c40 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7f8d44009ae0 tx=0x7f8d4401ca20 comp rx=0 tx=0).stop 2023-06-10T19:05:05.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.680+0000 7f8d571be640 1 -- 172.21.15.53:0/1449871585 shutdown_connections 2023-06-10T19:05:05.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.680+0000 7f8d571be640 1 --2- 172.21.15.53:0/1449871585 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d380047d0 0x7f8d38004c40 unknown :-1 s=CLOSED pgs=1880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:05.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.680+0000 7f8d571be640 1 -- 172.21.15.53:0/1449871585 >> 172.21.15.53:0/1449871585 conn(0x7f8d50069e20 msgr2=0x7f8d5006a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:05.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.680+0000 7f8d571be640 1 -- 172.21.15.53:0/1449871585 shutdown_connections 2023-06-10T19:05:05.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.680+0000 7f8d571be640 1 -- 172.21.15.53:0/1449871585 wait complete. 2023-06-10T19:05:05.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.680+0000 7f8d571be640 1 Processor -- start 2023-06-10T19:05:05.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.684+0000 7f8d571be640 1 -- start start 2023-06-10T19:05:05.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.684+0000 7f8d571be640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d380047d0 0x7f8d50158b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:05.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.684+0000 7f8d571be640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d501590b0 0x7f8d501551a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:05.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.684+0000 7f8d571be640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d500c87b0 0x7f8d501556e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:05.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.684+0000 7f8d571be640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d500c80e0 con 0x7f8d500c87b0 2023-06-10T19:05:05.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.684+0000 7f8d571be640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d500c9340 con 0x7f8d501590b0 2023-06-10T19:05:05.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.684+0000 7f8d571be640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d500c7840 con 0x7f8d380047d0 2023-06-10T19:05:05.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.684+0000 7f8d5575b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d500c87b0 0x7f8d501556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:05.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.684+0000 7f8d5575b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d500c87b0 0x7f8d501556e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60118/0 (socket says 172.21.15.53:60118) 2023-06-10T19:05:05.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.684+0000 7f8d5575b640 1 -- 172.21.15.53:0/1699236539 learned_addr learned my addr 172.21.15.53:0/1699236539 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:05.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.684+0000 7f8d54f5a640 1 --2- 172.21.15.53:0/1699236539 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d380047d0 0x7f8d50158b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:05.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.684+0000 7f8d4ffff640 1 --2- 172.21.15.53:0/1699236539 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d501590b0 0x7f8d501551a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:05.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.684+0000 7f8d5575b640 1 -- 172.21.15.53:0/1699236539 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d380047d0 msgr2=0x7f8d50158b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:05.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.684+0000 7f8d5575b640 1 --2- 172.21.15.53:0/1699236539 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d380047d0 0x7f8d50158b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:05.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.684+0000 7f8d5575b640 1 -- 172.21.15.53:0/1699236539 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d501590b0 msgr2=0x7f8d501551a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:05.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.684+0000 7f8d5575b640 1 --2- 172.21.15.53:0/1699236539 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d501590b0 0x7f8d501551a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:05.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.684+0000 7f8d5575b640 1 -- 172.21.15.53:0/1699236539 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d500c7b20 con 0x7f8d500c87b0 2023-06-10T19:05:05.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.684+0000 7f8d5575b640 1 --2- 172.21.15.53:0/1699236539 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d500c87b0 0x7f8d501556e0 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7f8d5008b310 tx=0x7f8d4800d830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:05.693 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.684+0000 7f8d4d7fa640 1 -- 172.21.15.53:0/1699236539 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d4800b070 con 0x7f8d500c87b0 2023-06-10T19:05:05.693 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.684+0000 7f8d4d7fa640 1 -- 172.21.15.53:0/1699236539 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d48003980 con 0x7f8d500c87b0 2023-06-10T19:05:05.693 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.684+0000 7f8d4d7fa640 1 -- 172.21.15.53:0/1699236539 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d48003d30 con 0x7f8d500c87b0 2023-06-10T19:05:05.693 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.684+0000 7f8d571be640 1 -- 172.21.15.53:0/1699236539 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d500c7e00 con 0x7f8d500c87b0 2023-06-10T19:05:05.693 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.684+0000 7f8d571be640 1 -- 172.21.15.53:0/1699236539 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d5014d590 con 0x7f8d500c87b0 2023-06-10T19:05:05.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.684+0000 7f8d571be640 1 -- 172.21.15.53:0/1699236539 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d500c91a0 con 0x7f8d500c87b0 2023-06-10T19:05:05.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.684+0000 7f8d4d7fa640 1 -- 172.21.15.53:0/1699236539 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8d48005070 con 0x7f8d500c87b0 2023-06-10T19:05:05.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.688+0000 7f8d4d7fa640 1 --2- 172.21.15.53:0/1699236539 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8d3c066280 0x7f8d3c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:05.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.688+0000 7f8d4d7fa640 1 -- 172.21.15.53:0/1699236539 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8d48082fe0 con 0x7f8d500c87b0 2023-06-10T19:05:05.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.688+0000 7f8d54f5a640 1 --2- 172.21.15.53:0/1699236539 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8d3c066280 0x7f8d3c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:05.695 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.688+0000 7f8d54f5a640 1 --2- 172.21.15.53:0/1699236539 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8d3c066280 0x7f8d3c068730 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f8d40001ec0 tx=0x7f8d40009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:05.695 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.692+0000 7f8d4d7fa640 1 -- 172.21.15.53:0/1699236539 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8d500c91a0 con 0x7f8d500c87b0 2023-06-10T19:05:05.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.876+0000 7f8d571be640 1 -- 172.21.15.53:0/1699236539 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f8d500c91a0 con 0x7f8d500c87b0 2023-06-10T19:05:05.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.884+0000 7f8d4d7fa640 1 -- 172.21.15.53:0/1699236539 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v68) v1 ==== 118+0+0 (secure 0 0 0) 0x7f8d500c91a0 con 0x7f8d500c87b0 2023-06-10T19:05:05.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.888+0000 7f8d571be640 1 -- 172.21.15.53:0/1699236539 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8d3c066280 msgr2=0x7f8d3c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:05.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.888+0000 7f8d571be640 1 --2- 172.21.15.53:0/1699236539 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8d3c066280 0x7f8d3c068730 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f8d40001ec0 tx=0x7f8d40009040 comp rx=0 tx=0).stop 2023-06-10T19:05:05.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.888+0000 7f8d571be640 1 -- 172.21.15.53:0/1699236539 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d500c87b0 msgr2=0x7f8d501556e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:05.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.888+0000 7f8d571be640 1 --2- 172.21.15.53:0/1699236539 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d500c87b0 0x7f8d501556e0 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7f8d5008b310 tx=0x7f8d4800d830 comp rx=0 tx=0).stop 2023-06-10T19:05:05.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.888+0000 7f8d571be640 1 -- 172.21.15.53:0/1699236539 shutdown_connections 2023-06-10T19:05:05.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.888+0000 7f8d571be640 1 --2- 172.21.15.53:0/1699236539 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8d3c066280 0x7f8d3c068730 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:05.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.888+0000 7f8d571be640 1 --2- 172.21.15.53:0/1699236539 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d500c87b0 0x7f8d501556e0 unknown :-1 s=CLOSED pgs=1881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:05.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.888+0000 7f8d571be640 1 --2- 172.21.15.53:0/1699236539 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d501590b0 0x7f8d501551a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:05.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.888+0000 7f8d571be640 1 --2- 172.21.15.53:0/1699236539 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d380047d0 0x7f8d50158b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:05.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.888+0000 7f8d571be640 1 -- 172.21.15.53:0/1699236539 >> 172.21.15.53:0/1699236539 conn(0x7f8d50069e20 msgr2=0x7f8d500ce940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:05.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.888+0000 7f8d571be640 1 -- 172.21.15.53:0/1699236539 shutdown_connections 2023-06-10T19:05:05.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:05.888+0000 7f8d571be640 1 -- 172.21.15.53:0/1699236539 wait complete. 2023-06-10T19:05:05.909 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-06-10T19:05:05.909 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-06-10T19:05:06.023 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:06.020+0000 7f98049c2640 1 Processor -- start 2023-06-10T19:05:06.023 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:06.020+0000 7f98049c2640 1 -- start start 2023-06-10T19:05:06.024 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:06.020+0000 7f98049c2640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f98000c9fa0 0x7f980006bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:06.024 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:06.020+0000 7f98049c2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f980006c020 0x7f98000c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:06.024 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:06.020+0000 7f98049c2640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f980006b090 con 0x7f98000c87e0 2023-06-10T19:05:06.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:06.020+0000 7f98049c2640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98000ca370 con 0x7f98000c9fa0 2023-06-10T19:05:06.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:06.020+0000 7f98049c2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9800070d50 con 0x7f980006c020 2023-06-10T19:05:06.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:06.020+0000 7f97f7fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f980006c020 0x7f98000c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:06.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:06.020+0000 7f97fe59c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f98000c9fa0 0x7f980006bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:06.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:06.020+0000 7f97fe59c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f98000c9fa0 0x7f980006bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.53:39218/0 (socket says 172.21.15.53:39218) 2023-06-10T19:05:06.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:06.020+0000 7f97f7fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f980006c020 0x7f98000c82a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.53:52010/0 (socket says 172.21.15.53:52010) 2023-06-10T19:05:06.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:06.020+0000 7f97fe59c640 1 -- 172.21.15.53:0/1835117016 learned_addr learned my addr 172.21.15.53:0/1835117016 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:06.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:06.020+0000 7f97fed9d640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f98000c87e0 0x7f98000af760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.53:51958/0 (socket says 172.21.15.53:51958) 2023-06-10T19:05:06.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:06.020+0000 7f97f7fff640 1 -- 172.21.15.53:0/1835117016 >> v2:172.21.15.117:3300/0 conn(0x7f98000c9fa0 msgr2=0x7f980006bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:06.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:06.020+0000 7f97f7fff640 1 --2- 172.21.15.53:0/1835117016 >> v2:172.21.15.117:3300/0 conn(0x7f98000c9fa0 0x7f980006bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:06.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:06.020+0000 7f97f7fff640 1 -- 172.21.15.53:0/1835117016 >> v1:172.21.15.117:6789/0 conn(0x7f98000c87e0 legacy=0x7f98000af760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:06.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:06.020+0000 7f97f7fff640 1 -- 172.21.15.53:0/1835117016 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9800071030 con 0x7f980006c020 2023-06-10T19:05:06.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:06.020+0000 7f97fe59c640 1 --2- 172.21.15.53:0/1835117016 >> v2:172.21.15.117:3300/0 conn(0x7f98000c9fa0 0x7f980006bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-10T19:05:06.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:06.024+0000 7f97f7fff640 1 --2- 172.21.15.53:0/1835117016 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f980006c020 0x7f98000c82a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f97e80097c0 tx=0x7f97e801c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d553edcb1cf508fd server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:06.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:06.024+0000 7f97fdd9b640 1 -- 172.21.15.53:0/1835117016 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e80ab600 con 0x7f980006c020 2023-06-10T19:05:06.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:06.024+0000 7f97fdd9b640 1 -- 172.21.15.53:0/1835117016 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97e80a7050 con 0x7f980006c020 2023-06-10T19:05:06.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:06.024+0000 7f97fdd9b640 1 -- 172.21.15.53:0/1835117016 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e80ab980 con 0x7f980006c020 2023-06-10T19:05:06.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:06.024+0000 7f98049c2640 1 -- 172.21.15.53:0/1835117016 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f980006c020 msgr2=0x7f98000c82a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:06.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:06.024+0000 7f98049c2640 1 --2- 172.21.15.53:0/1835117016 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f980006c020 0x7f98000c82a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f97e80097c0 tx=0x7f97e801c3c0 comp rx=0 tx=0).stop 2023-06-10T19:05:06.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:06.024+0000 7f98049c2640 1 -- 172.21.15.53:0/1835117016 shutdown_connections 2023-06-10T19:05:06.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:06.024+0000 7f98049c2640 1 --2- 172.21.15.53:0/1835117016 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f980006c020 0x7f98000c82a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:06.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:06.024+0000 7f98049c2640 1 --2- 172.21.15.53:0/1835117016 >> v2:172.21.15.117:3300/0 conn(0x7f98000c9fa0 0x7f980006bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:06.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:06.024+0000 7f98049c2640 1 -- 172.21.15.53:0/1835117016 >> 172.21.15.53:0/1835117016 conn(0x7f980006a0e0 msgr2=0x7f98000cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:06.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:06.024+0000 7f98049c2640 1 -- 172.21.15.53:0/1835117016 shutdown_connections 2023-06-10T19:05:06.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:06.024+0000 7f98049c2640 1 -- 172.21.15.53:0/1835117016 wait complete. 2023-06-10T19:05:06.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:06.024+0000 7f98049c2640 1 Processor -- start 2023-06-10T19:05:06.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:06.024+0000 7f98049c2640 1 -- start start 2023-06-10T19:05:06.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:06.024+0000 7f98049c2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f980006c020 0x7f9800159020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:06.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:06.024+0000 7f98049c2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98000c87e0 0x7f98000af950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:06.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:06.024+0000 7f98049c2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98000c9fa0 0x7f980014e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:06.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:06.024+0000 7f98049c2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9800159790 con 0x7f98000c87e0 2023-06-10T19:05:06.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:06.028+0000 7f98049c2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98000c6340 con 0x7f98000c9fa0 2023-06-10T19:05:06.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:06.028+0000 7f98049c2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9800142880 con 0x7f980006c020 2023-06-10T19:05:06.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:06.028+0000 7f97f7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98000c87e0 0x7f98000af950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:06.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:06.028+0000 7f97f7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98000c87e0 0x7f98000af950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60132/0 (socket says 172.21.15.53:60132) 2023-06-10T19:05:06.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:06.028+0000 7f97f7fff640 1 -- 172.21.15.53:0/3975058154 learned_addr learned my addr 172.21.15.53:0/3975058154 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:06.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:06.028+0000 7f97fe59c640 1 --2- 172.21.15.53:0/3975058154 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f980006c020 0x7f9800159020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:06.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:06.028+0000 7f97fed9d640 1 --2- 172.21.15.53:0/3975058154 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98000c9fa0 0x7f980014e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:06.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:06.028+0000 7f97f7fff640 1 -- 172.21.15.53:0/3975058154 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f980006c020 msgr2=0x7f9800159020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:06.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:06.028+0000 7f97f7fff640 1 --2- 172.21.15.53:0/3975058154 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f980006c020 0x7f9800159020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:06.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:06.028+0000 7f97f7fff640 1 -- 172.21.15.53:0/3975058154 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98000c9fa0 msgr2=0x7f980014e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:06.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:06.028+0000 7f97f7fff640 1 --2- 172.21.15.53:0/3975058154 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98000c9fa0 0x7f980014e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:06.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:06.028+0000 7f97f7fff640 1 -- 172.21.15.53:0/3975058154 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f00094d0 con 0x7f98000c87e0 2023-06-10T19:05:06.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:06.028+0000 7f97f7fff640 1 --2- 172.21.15.53:0/3975058154 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98000c87e0 0x7f98000af950 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7f97e80097c0 tx=0x7f97e8019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:06.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:06.028+0000 7f97f6ffd640 1 -- 172.21.15.53:0/3975058154 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e80b4430 con 0x7f98000c87e0 2023-06-10T19:05:06.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:06.028+0000 7f97f6ffd640 1 -- 172.21.15.53:0/3975058154 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97e80b4590 con 0x7f98000c87e0 2023-06-10T19:05:06.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:06.028+0000 7f98049c2640 1 -- 172.21.15.53:0/3975058154 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97e8009420 con 0x7f98000c87e0 2023-06-10T19:05:06.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:06.028+0000 7f97f6ffd640 1 -- 172.21.15.53:0/3975058154 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e80b4940 con 0x7f98000c87e0 2023-06-10T19:05:06.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:06.028+0000 7f98049c2640 1 -- 172.21.15.53:0/3975058154 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9800159560 con 0x7f98000c87e0 2023-06-10T19:05:06.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:06.028+0000 7f98049c2640 1 -- 172.21.15.53:0/3975058154 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98000c6480 con 0x7f98000c87e0 2023-06-10T19:05:06.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:06.028+0000 7f97f6ffd640 1 -- 172.21.15.53:0/3975058154 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f97e80b2040 con 0x7f98000c87e0 2023-06-10T19:05:06.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:06.028+0000 7f97f6ffd640 1 --2- 172.21.15.53:0/3975058154 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f97e0066280 0x7f97e0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:06.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:06.028+0000 7f97f6ffd640 1 -- 172.21.15.53:0/3975058154 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f97e811dcc0 con 0x7f98000c87e0 2023-06-10T19:05:06.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:06.028+0000 7f97fe59c640 1 --2- 172.21.15.53:0/3975058154 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f97e0066280 0x7f97e0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:06.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:06.028+0000 7f97fe59c640 1 --2- 172.21.15.53:0/3975058154 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f97e0066280 0x7f97e0068730 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f98000b1f80 tx=0x7f97f0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:06.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:06.032+0000 7f97f6ffd640 1 -- 172.21.15.53:0/3975058154 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f98000c6480 con 0x7f98000c87e0 2023-06-10T19:05:06.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:06.216+0000 7f98049c2640 1 -- 172.21.15.53:0/3975058154 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f98000c6480 con 0x7f98000c87e0 2023-06-10T19:05:07.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.056+0000 7f97f6ffd640 1 -- 172.21.15.53:0/3975058154 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v69) v1 ==== 122+0+0 (secure 0 0 0) 0x7f98000c6480 con 0x7f98000c87e0 2023-06-10T19:05:07.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.060+0000 7f98049c2640 1 -- 172.21.15.53:0/3975058154 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f97e0066280 msgr2=0x7f97e0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:07.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.060+0000 7f98049c2640 1 --2- 172.21.15.53:0/3975058154 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f97e0066280 0x7f97e0068730 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f98000b1f80 tx=0x7f97f0008040 comp rx=0 tx=0).stop 2023-06-10T19:05:07.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.060+0000 7f98049c2640 1 -- 172.21.15.53:0/3975058154 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98000c87e0 msgr2=0x7f98000af950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:07.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.060+0000 7f98049c2640 1 --2- 172.21.15.53:0/3975058154 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98000c87e0 0x7f98000af950 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7f97e80097c0 tx=0x7f97e8019160 comp rx=0 tx=0).stop 2023-06-10T19:05:07.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.060+0000 7f98049c2640 1 -- 172.21.15.53:0/3975058154 shutdown_connections 2023-06-10T19:05:07.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.060+0000 7f98049c2640 1 --2- 172.21.15.53:0/3975058154 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f97e0066280 0x7f97e0068730 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:07.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.060+0000 7f98049c2640 1 --2- 172.21.15.53:0/3975058154 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98000c9fa0 0x7f980014e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:07.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.060+0000 7f98049c2640 1 --2- 172.21.15.53:0/3975058154 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98000c87e0 0x7f98000af950 unknown :-1 s=CLOSED pgs=1882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:07.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.060+0000 7f98049c2640 1 --2- 172.21.15.53:0/3975058154 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f980006c020 0x7f9800159020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:07.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.060+0000 7f98049c2640 1 -- 172.21.15.53:0/3975058154 >> 172.21.15.53:0/3975058154 conn(0x7f980006a0e0 msgr2=0x7f98000cb9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:07.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.060+0000 7f98049c2640 1 -- 172.21.15.53:0/3975058154 shutdown_connections 2023-06-10T19:05:07.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.060+0000 7f98049c2640 1 -- 172.21.15.53:0/3975058154 wait complete. 2023-06-10T19:05:07.086 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-06-10T19:05:07.086 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:05:07.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.204+0000 7fbb1005d640 1 Processor -- start 2023-06-10T19:05:07.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.204+0000 7fbb1005d640 1 -- start start 2023-06-10T19:05:07.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.204+0000 7fbb1005d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbb0806b2f0 0x7fbb0806f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:07.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.204+0000 7fbb1005d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbb08160170 0x7fbb08162550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:07.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.204+0000 7fbb1005d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb08158a90 con 0x7fbb080c8d00 2023-06-10T19:05:07.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.204+0000 7fbb1005d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb080705d0 con 0x7fbb08160170 2023-06-10T19:05:07.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.204+0000 7fbb1005d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb080cce10 con 0x7fbb0806b2f0 2023-06-10T19:05:07.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.204+0000 7fbb0e5fa640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbb08160170 0x7fbb08162550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:07.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.204+0000 7fbb0e5fa640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbb08160170 0x7fbb08162550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60134/0 (socket says 172.21.15.53:60134) 2023-06-10T19:05:07.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.204+0000 7fbb0e5fa640 1 -- 172.21.15.53:0/517958630 learned_addr learned my addr 172.21.15.53:0/517958630 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:07.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.204+0000 7fbb0ddf9640 1 --2- 172.21.15.53:0/517958630 >> v2:172.21.15.117:3300/0 conn(0x7fbb0806b2f0 0x7fbb0806f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:07.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.204+0000 7fbb0e5fa640 1 -- 172.21.15.53:0/517958630 >> v2:172.21.15.117:3300/0 conn(0x7fbb0806b2f0 msgr2=0x7fbb0806f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:07.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.204+0000 7fbb0e5fa640 1 --2- 172.21.15.53:0/517958630 >> v2:172.21.15.117:3300/0 conn(0x7fbb0806b2f0 0x7fbb0806f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:07.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.204+0000 7fbb0e5fa640 1 -- 172.21.15.53:0/517958630 >> v1:172.21.15.117:6789/0 conn(0x7fbb080c8d00 legacy=0x7fbb0806b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:07.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.204+0000 7fbb0e5fa640 1 -- 172.21.15.53:0/517958630 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb0806f9c0 con 0x7fbb08160170 2023-06-10T19:05:07.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.208+0000 7fbb0e5fa640 1 --2- 172.21.15.53:0/517958630 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb08160170 0x7fbb08162550 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7fbb08071d80 tx=0x7fbb0001f180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecd1d033d2349016 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:07.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.208+0000 7fbb0cdf7640 1 -- 172.21.15.53:0/517958630 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb000af400 con 0x7fbb08160170 2023-06-10T19:05:07.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.208+0000 7fbb0cdf7640 1 -- 172.21.15.53:0/517958630 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb000ab050 con 0x7fbb08160170 2023-06-10T19:05:07.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.208+0000 7fbb0cdf7640 1 -- 172.21.15.53:0/517958630 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb000af780 con 0x7fbb08160170 2023-06-10T19:05:07.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.208+0000 7fbb1005d640 1 -- 172.21.15.53:0/517958630 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb08160170 msgr2=0x7fbb08162550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:07.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.208+0000 7fbb1005d640 1 --2- 172.21.15.53:0/517958630 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb08160170 0x7fbb08162550 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7fbb08071d80 tx=0x7fbb0001f180 comp rx=0 tx=0).stop 2023-06-10T19:05:07.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.208+0000 7fbb1005d640 1 -- 172.21.15.53:0/517958630 shutdown_connections 2023-06-10T19:05:07.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.208+0000 7fbb1005d640 1 --2- 172.21.15.53:0/517958630 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb08160170 0x7fbb08162550 unknown :-1 s=CLOSED pgs=1883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:07.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.208+0000 7fbb1005d640 1 --2- 172.21.15.53:0/517958630 >> v2:172.21.15.117:3300/0 conn(0x7fbb0806b2f0 0x7fbb0806f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:07.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.208+0000 7fbb1005d640 1 -- 172.21.15.53:0/517958630 >> 172.21.15.53:0/517958630 conn(0x7fbb0806a0d0 msgr2=0x7fbb080ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:07.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.208+0000 7fbb1005d640 1 -- 172.21.15.53:0/517958630 shutdown_connections 2023-06-10T19:05:07.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.208+0000 7fbb1005d640 1 -- 172.21.15.53:0/517958630 wait complete. 2023-06-10T19:05:07.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.208+0000 7fbb1005d640 1 Processor -- start 2023-06-10T19:05:07.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.208+0000 7fbb1005d640 1 -- start start 2023-06-10T19:05:07.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.212+0000 7fbb1005d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb0806b2f0 0x7fbb0814ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:07.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.212+0000 7fbb1005d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbb080c8d00 0x7fbb080c3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:07.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.212+0000 7fbb1005d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb08160170 0x7fbb08162d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:07.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.212+0000 7fbb1005d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb080b11e0 con 0x7fbb0806b2f0 2023-06-10T19:05:07.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.212+0000 7fbb1005d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb080c4510 con 0x7fbb08160170 2023-06-10T19:05:07.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.212+0000 7fbb1005d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0814f040 con 0x7fbb080c8d00 2023-06-10T19:05:07.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.212+0000 7fbb0ddf9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb0806b2f0 0x7fbb0814ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:07.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.212+0000 7fbb0ddf9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb0806b2f0 0x7fbb0814ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60136/0 (socket says 172.21.15.53:60136) 2023-06-10T19:05:07.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.212+0000 7fbb0ddf9640 1 -- 172.21.15.53:0/2300426452 learned_addr learned my addr 172.21.15.53:0/2300426452 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:07.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.212+0000 7fbb0d5f8640 1 --2- 172.21.15.53:0/2300426452 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbb080c8d00 0x7fbb080c3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:07.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.212+0000 7fbb0ddf9640 1 -- 172.21.15.53:0/2300426452 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbb080c8d00 msgr2=0x7fbb080c3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:07.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.212+0000 7fbb0e5fa640 1 --2- 172.21.15.53:0/2300426452 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb08160170 0x7fbb08162d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:07.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.212+0000 7fbb0ddf9640 1 --2- 172.21.15.53:0/2300426452 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbb080c8d00 0x7fbb080c3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:07.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.212+0000 7fbb0ddf9640 1 -- 172.21.15.53:0/2300426452 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb08160170 msgr2=0x7fbb08162d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:07.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.212+0000 7fbb0ddf9640 1 --2- 172.21.15.53:0/2300426452 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb08160170 0x7fbb08162d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:07.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.212+0000 7fbb0ddf9640 1 -- 172.21.15.53:0/2300426452 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb00009b30 con 0x7fbb0806b2f0 2023-06-10T19:05:07.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.212+0000 7fbb0d5f8640 1 --2- 172.21.15.53:0/2300426452 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbb080c8d00 0x7fbb080c3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:05:07.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.212+0000 7fbb0ddf9640 1 --2- 172.21.15.53:0/2300426452 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb0806b2f0 0x7fbb0814ea00 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7fbb0400d800 tx=0x7fbb0400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:07.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.212+0000 7fbafe7fc640 1 -- 172.21.15.53:0/2300426452 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0400b6c0 con 0x7fbb0806b2f0 2023-06-10T19:05:07.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.212+0000 7fbafe7fc640 1 -- 172.21.15.53:0/2300426452 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb0400b820 con 0x7fbb0806b2f0 2023-06-10T19:05:07.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.212+0000 7fbafe7fc640 1 -- 172.21.15.53:0/2300426452 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0400bb90 con 0x7fbb0806b2f0 2023-06-10T19:05:07.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.212+0000 7fbb1005d640 1 -- 172.21.15.53:0/2300426452 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb0814f320 con 0x7fbb0806b2f0 2023-06-10T19:05:07.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.212+0000 7fbb1005d640 1 -- 172.21.15.53:0/2300426452 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb0814f8e0 con 0x7fbb0806b2f0 2023-06-10T19:05:07.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.212+0000 7fbb1005d640 1 -- 172.21.15.53:0/2300426452 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb0804d790 con 0x7fbb0806b2f0 2023-06-10T19:05:07.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.212+0000 7fbafe7fc640 1 -- 172.21.15.53:0/2300426452 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbb0400bcf0 con 0x7fbb0806b2f0 2023-06-10T19:05:07.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.212+0000 7fbafe7fc640 1 --2- 172.21.15.53:0/2300426452 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbaec066280 0x7fbaec068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:07.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.212+0000 7fbafe7fc640 1 -- 172.21.15.53:0/2300426452 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbb040842d0 con 0x7fbb0806b2f0 2023-06-10T19:05:07.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.216+0000 7fbb0d5f8640 1 --2- 172.21.15.53:0/2300426452 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbaec066280 0x7fbaec068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:07.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.216+0000 7fbb0d5f8640 1 --2- 172.21.15.53:0/2300426452 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbaec066280 0x7fbaec068730 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fbb081504e0 tx=0x7fbaf8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:07.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.220+0000 7fbafe7fc640 1 -- 172.21.15.53:0/2300426452 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbb04055270 con 0x7fbb0806b2f0 2023-06-10T19:05:07.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.404+0000 7fbb1005d640 1 -- 172.21.15.53:0/2300426452 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbb0806f3d0 con 0x7fbb0806b2f0 2023-06-10T19:05:07.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.408+0000 7fbafe7fc640 1 -- 172.21.15.53:0/2300426452 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) v1 ==== 94+0+4676 (secure 0 0 0) 0x7fbb04054e00 con 0x7fbb0806b2f0 2023-06-10T19:05:07.412 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:05:07.412 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":69,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7684,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/618082531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":618082531},{"type":"v1","addr":"172.21.15.117:6835","nonce":618082531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":7687,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3984577716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":3984577716},{"type":"v1","addr":"172.21.15.117:6837","nonce":3984577716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":9144,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/3202804884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3202804884},{"type":"v1","addr":"172.21.15.53:6833","nonce":3202804884}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:05:04.878347+0000","modified":"2023-06-10T19:05:07.051606+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9147},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9147":{"gid":9147,"name":"c","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/3233917972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":3233917972},{"type":"v1","addr":"172.21.15.53:6835","nonce":3233917972}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-06-10T19:05:07.412 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 69 2023-06-10T19:05:07.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.408+0000 7fbb1005d640 1 -- 172.21.15.53:0/2300426452 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbaec066280 msgr2=0x7fbaec068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:07.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.408+0000 7fbb1005d640 1 --2- 172.21.15.53:0/2300426452 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbaec066280 0x7fbaec068730 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fbb081504e0 tx=0x7fbaf8009040 comp rx=0 tx=0).stop 2023-06-10T19:05:07.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.408+0000 7fbb1005d640 1 -- 172.21.15.53:0/2300426452 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb0806b2f0 msgr2=0x7fbb0814ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:07.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.408+0000 7fbb1005d640 1 --2- 172.21.15.53:0/2300426452 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb0806b2f0 0x7fbb0814ea00 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7fbb0400d800 tx=0x7fbb0400dcc0 comp rx=0 tx=0).stop 2023-06-10T19:05:07.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.408+0000 7fbb1005d640 1 -- 172.21.15.53:0/2300426452 shutdown_connections 2023-06-10T19:05:07.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.408+0000 7fbb1005d640 1 --2- 172.21.15.53:0/2300426452 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbaec066280 0x7fbaec068730 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:07.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.408+0000 7fbb1005d640 1 --2- 172.21.15.53:0/2300426452 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb08160170 0x7fbb08162d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:07.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.408+0000 7fbb1005d640 1 --2- 172.21.15.53:0/2300426452 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbb080c8d00 0x7fbb080c3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:07.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.408+0000 7fbb1005d640 1 --2- 172.21.15.53:0/2300426452 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb0806b2f0 0x7fbb0814ea00 unknown :-1 s=CLOSED pgs=1884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:07.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.408+0000 7fbb1005d640 1 -- 172.21.15.53:0/2300426452 >> 172.21.15.53:0/2300426452 conn(0x7fbb0806a0d0 msgr2=0x7fbb0806c1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:07.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.408+0000 7fbb1005d640 1 -- 172.21.15.53:0/2300426452 shutdown_connections 2023-06-10T19:05:07.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.408+0000 7fbb1005d640 1 -- 172.21.15.53:0/2300426452 wait complete. 2023-06-10T19:05:07.429 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:05:07.551 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.544+0000 7f1cd1644640 1 Processor -- start 2023-06-10T19:05:07.551 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.544+0000 7f1cd1644640 1 -- start start 2023-06-10T19:05:07.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.548+0000 7f1cd1644640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ccc071060 0x7f1ccc0af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:07.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.548+0000 7f1cd1644640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1ccc0afc60 0x7f1ccc06b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:07.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.548+0000 7f1cd1644640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ccc159b50 con 0x7f1ccc0c9840 2023-06-10T19:05:07.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.548+0000 7f1cd1644640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ccc0702a0 con 0x7f1ccc0afc60 2023-06-10T19:05:07.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.548+0000 7f1cd1644640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ccc070580 con 0x7f1ccc071060 2023-06-10T19:05:07.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.548+0000 7f1cc3fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ccc071060 0x7f1ccc0af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:07.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.548+0000 7f1ccb7fe640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1ccc0afc60 0x7f1ccc06b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:07.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.548+0000 7f1cc3fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ccc071060 0x7f1ccc0af720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.53:52036/0 (socket says 172.21.15.53:52036) 2023-06-10T19:05:07.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.548+0000 7f1cc3fff640 1 -- 172.21.15.53:0/2844125907 learned_addr learned my addr 172.21.15.53:0/2844125907 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:07.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.548+0000 7f1cc3fff640 1 -- 172.21.15.53:0/2844125907 >> v2:172.21.15.117:3300/0 conn(0x7f1ccc0afc60 msgr2=0x7f1ccc06b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:07.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.548+0000 7f1cc3fff640 1 --2- 172.21.15.53:0/2844125907 >> v2:172.21.15.117:3300/0 conn(0x7f1ccc0afc60 0x7f1ccc06b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:07.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.548+0000 7f1cc3fff640 1 -- 172.21.15.53:0/2844125907 >> v1:172.21.15.117:6789/0 conn(0x7f1ccc0c9840 legacy=0x7f1ccc0c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:07.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.548+0000 7f1cc3fff640 1 -- 172.21.15.53:0/2844125907 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ccc070860 con 0x7f1ccc071060 2023-06-10T19:05:07.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.552+0000 7f1cc3fff640 1 --2- 172.21.15.53:0/2844125907 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ccc071060 0x7f1ccc0af720 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1cb4009870 tx=0x7f1cb401c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9968bad26fe22140 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:07.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.552+0000 7f1cca7fc640 1 -- 172.21.15.53:0/2844125907 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb40a95f0 con 0x7f1ccc071060 2023-06-10T19:05:07.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.552+0000 7f1cca7fc640 1 -- 172.21.15.53:0/2844125907 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cb40a9750 con 0x7f1ccc071060 2023-06-10T19:05:07.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.552+0000 7f1cca7fc640 1 -- 172.21.15.53:0/2844125907 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb40a9ae0 con 0x7f1ccc071060 2023-06-10T19:05:07.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.552+0000 7f1cd1644640 1 -- 172.21.15.53:0/2844125907 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ccc071060 msgr2=0x7f1ccc0af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:07.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.552+0000 7f1cd1644640 1 --2- 172.21.15.53:0/2844125907 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ccc071060 0x7f1ccc0af720 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1cb4009870 tx=0x7f1cb401c510 comp rx=0 tx=0).stop 2023-06-10T19:05:07.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.552+0000 7f1cd1644640 1 -- 172.21.15.53:0/2844125907 shutdown_connections 2023-06-10T19:05:07.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.552+0000 7f1cd1644640 1 --2- 172.21.15.53:0/2844125907 >> v2:172.21.15.117:3300/0 conn(0x7f1ccc0afc60 0x7f1ccc06b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:07.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.552+0000 7f1cd1644640 1 --2- 172.21.15.53:0/2844125907 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ccc071060 0x7f1ccc0af720 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:07.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.552+0000 7f1cd1644640 1 -- 172.21.15.53:0/2844125907 >> 172.21.15.53:0/2844125907 conn(0x7f1ccc06a0d0 msgr2=0x7f1ccc0ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:07.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.552+0000 7f1cd1644640 1 -- 172.21.15.53:0/2844125907 shutdown_connections 2023-06-10T19:05:07.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.552+0000 7f1cd1644640 1 -- 172.21.15.53:0/2844125907 wait complete. 2023-06-10T19:05:07.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.552+0000 7f1cd1644640 1 Processor -- start 2023-06-10T19:05:07.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.552+0000 7f1cd1644640 1 -- start start 2023-06-10T19:05:07.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.552+0000 7f1cd1644640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ccc071060 0x7f1ccc0c5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:07.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.556+0000 7f1cd1644640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ccc0afc60 0x7f1ccc0c5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:07.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.556+0000 7f1cd1644640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ccc0c9840 0x7f1ccc1477f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:07.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.556+0000 7f1cd1644640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ccc14bd50 con 0x7f1ccc071060 2023-06-10T19:05:07.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.556+0000 7f1cd1644640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ccc14acb0 con 0x7f1ccc0afc60 2023-06-10T19:05:07.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.556+0000 7f1cd1644640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ccc14af90 con 0x7f1ccc0c9840 2023-06-10T19:05:07.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.556+0000 7f1ccaffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ccc071060 0x7f1ccc0c5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:07.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.556+0000 7f1ccaffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ccc071060 0x7f1ccc0c5200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60148/0 (socket says 172.21.15.53:60148) 2023-06-10T19:05:07.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.556+0000 7f1ccaffd640 1 -- 172.21.15.53:0/498841032 learned_addr learned my addr 172.21.15.53:0/498841032 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:07.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.556+0000 7f1cc3fff640 1 --2- 172.21.15.53:0/498841032 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ccc0afc60 0x7f1ccc0c5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:07.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.556+0000 7f1ccb7fe640 1 --2- 172.21.15.53:0/498841032 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ccc0c9840 0x7f1ccc1477f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:07.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.556+0000 7f1ccaffd640 1 -- 172.21.15.53:0/498841032 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ccc0c9840 msgr2=0x7f1ccc1477f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:07.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.556+0000 7f1ccaffd640 1 --2- 172.21.15.53:0/498841032 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ccc0c9840 0x7f1ccc1477f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:07.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.556+0000 7f1ccaffd640 1 -- 172.21.15.53:0/498841032 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ccc0afc60 msgr2=0x7f1ccc0c5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:07.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.556+0000 7f1ccaffd640 1 --2- 172.21.15.53:0/498841032 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ccc0afc60 0x7f1ccc0c5740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:07.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.556+0000 7f1ccaffd640 1 -- 172.21.15.53:0/498841032 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cb40094d0 con 0x7f1ccc071060 2023-06-10T19:05:07.562 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.556+0000 7f1ccaffd640 1 --2- 172.21.15.53:0/498841032 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ccc071060 0x7f1ccc0c5200 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc00c370 tx=0x7f1cbc00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:07.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.556+0000 7f1cc37fe640 1 -- 172.21.15.53:0/498841032 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cbc0052d0 con 0x7f1ccc071060 2023-06-10T19:05:07.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.556+0000 7f1cc37fe640 1 -- 172.21.15.53:0/498841032 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cbc005430 con 0x7f1ccc071060 2023-06-10T19:05:07.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.556+0000 7f1cd1644640 1 -- 172.21.15.53:0/498841032 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ccc14b270 con 0x7f1ccc071060 2023-06-10T19:05:07.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.556+0000 7f1cc37fe640 1 -- 172.21.15.53:0/498841032 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cbc007260 con 0x7f1ccc071060 2023-06-10T19:05:07.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.556+0000 7f1cd1644640 1 -- 172.21.15.53:0/498841032 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ccc14b830 con 0x7f1ccc071060 2023-06-10T19:05:07.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.556+0000 7f1cd1644640 1 -- 172.21.15.53:0/498841032 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ccc04d790 con 0x7f1ccc071060 2023-06-10T19:05:07.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.556+0000 7f1cc37fe640 1 -- 172.21.15.53:0/498841032 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1cbc0073c0 con 0x7f1ccc071060 2023-06-10T19:05:07.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.556+0000 7f1cc37fe640 1 --2- 172.21.15.53:0/498841032 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1cac066280 0x7f1cac068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:07.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.556+0000 7f1cc37fe640 1 -- 172.21.15.53:0/498841032 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1cbc082fb0 con 0x7f1ccc071060 2023-06-10T19:05:07.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.556+0000 7f1cc3fff640 1 --2- 172.21.15.53:0/498841032 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1cac066280 0x7f1cac068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:07.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.560+0000 7f1cc3fff640 1 --2- 172.21.15.53:0/498841032 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1cac066280 0x7f1cac068730 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f1cb40ae000 tx=0x7f1cb40b3040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:07.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.564+0000 7f1cc37fe640 1 -- 172.21.15.53:0/498841032 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1cbc0b3700 con 0x7f1ccc071060 2023-06-10T19:05:07.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.716+0000 7f1cd1644640 1 -- 172.21.15.53:0/498841032 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1ccc0cb140 con 0x7f1ccc071060 2023-06-10T19:05:07.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.720+0000 7f1cc37fe640 1 -- 172.21.15.53:0/498841032 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v125) v1 ==== 74+0+18349 (secure 0 0 0) 0x7f1cbc050570 con 0x7f1ccc071060 2023-06-10T19:05:07.725 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:05:07.725 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":125,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:05:05.882387+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-06-10T19:05:02.560833+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-06-10T19:05:03.863586+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:05:07.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.720+0000 7f1cd1644640 1 -- 172.21.15.53:0/498841032 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1cac066280 msgr2=0x7f1cac068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:07.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.720+0000 7f1cd1644640 1 --2- 172.21.15.53:0/498841032 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1cac066280 0x7f1cac068730 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f1cb40ae000 tx=0x7f1cb40b3040 comp rx=0 tx=0).stop 2023-06-10T19:05:07.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.720+0000 7f1cd1644640 1 -- 172.21.15.53:0/498841032 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ccc071060 msgr2=0x7f1ccc0c5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:07.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.720+0000 7f1cd1644640 1 --2- 172.21.15.53:0/498841032 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ccc071060 0x7f1ccc0c5200 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc00c370 tx=0x7f1cbc00c830 comp rx=0 tx=0).stop 2023-06-10T19:05:07.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.720+0000 7f1cd1644640 1 -- 172.21.15.53:0/498841032 shutdown_connections 2023-06-10T19:05:07.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.720+0000 7f1cd1644640 1 --2- 172.21.15.53:0/498841032 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1cac066280 0x7f1cac068730 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:07.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.720+0000 7f1cd1644640 1 --2- 172.21.15.53:0/498841032 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ccc0c9840 0x7f1ccc1477f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:07.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.720+0000 7f1cd1644640 1 --2- 172.21.15.53:0/498841032 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ccc0afc60 0x7f1ccc0c5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:07.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.720+0000 7f1cd1644640 1 --2- 172.21.15.53:0/498841032 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ccc071060 0x7f1ccc0c5200 unknown :-1 s=CLOSED pgs=1885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:07.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.720+0000 7f1cd1644640 1 -- 172.21.15.53:0/498841032 >> 172.21.15.53:0/498841032 conn(0x7f1ccc06a0d0 msgr2=0x7f1ccc0ad700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:07.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.720+0000 7f1cd1644640 1 -- 172.21.15.53:0/498841032 shutdown_connections 2023-06-10T19:05:07.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.724+0000 7f1cd1644640 1 -- 172.21.15.53:0/498841032 wait complete. 2023-06-10T19:05:07.744 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-06-10T19:05:07.744 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-10T19:05:07.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.856+0000 7fa56355d640 1 Processor -- start 2023-06-10T19:05:07.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.856+0000 7fa56355d640 1 -- start start 2023-06-10T19:05:07.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.860+0000 7fa56355d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa55c0cc690 0x7fa55c0d04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:07.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.860+0000 7fa56355d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa55c0ccae0 0x7fa55c0d09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:07.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.860+0000 7fa56355d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa55c0d0020 con 0x7fa55c0b3ac0 2023-06-10T19:05:07.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.860+0000 7fa56355d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa55c0cef40 con 0x7fa55c0ccae0 2023-06-10T19:05:07.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.860+0000 7fa56355d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa55c0cf220 con 0x7fa55c0cc690 2023-06-10T19:05:07.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.860+0000 7fa5612f9640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fa55c0b3ac0 0x7fa55c0b3e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:35598/0 (socket says 172.21.15.53:35598) 2023-06-10T19:05:07.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.860+0000 7fa5612f9640 1 -- 172.21.15.53:0/442188445 learned_addr learned my addr 172.21.15.53:0/442188445 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:05:07.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.860+0000 7fa560af8640 1 --2- 172.21.15.53:0/442188445 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa55c0cc690 0x7fa55c0d04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:07.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.860+0000 7fa561afa640 1 --2- 172.21.15.53:0/442188445 >> v2:172.21.15.117:3300/0 conn(0x7fa55c0ccae0 0x7fa55c0d09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:07.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.860+0000 7fa553fff640 1 -- 172.21.15.53:0/442188445 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1560492232 0 0) 0x7fa55c0d0020 con 0x7fa55c0b3ac0 2023-06-10T19:05:07.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.860+0000 7fa553fff640 1 -- 172.21.15.53:0/442188445 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa548003530 con 0x7fa55c0b3ac0 2023-06-10T19:05:07.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.860+0000 7fa553fff640 1 -- 172.21.15.53:0/442188445 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 863243070 0 0) 0x7fa548003530 con 0x7fa55c0b3ac0 2023-06-10T19:05:07.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.860+0000 7fa553fff640 1 -- 172.21.15.53:0/442188445 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa55c0cc690 msgr2=0x7fa55c0d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:07.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.860+0000 7fa553fff640 1 --2- 172.21.15.53:0/442188445 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa55c0cc690 0x7fa55c0d04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:07.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.860+0000 7fa553fff640 1 -- 172.21.15.53:0/442188445 >> v2:172.21.15.117:3300/0 conn(0x7fa55c0ccae0 msgr2=0x7fa55c0d09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:07.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.860+0000 7fa553fff640 1 --2- 172.21.15.53:0/442188445 >> v2:172.21.15.117:3300/0 conn(0x7fa55c0ccae0 0x7fa55c0d09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:07.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.860+0000 7fa553fff640 1 -- 172.21.15.53:0/442188445 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa55c0cf500 con 0x7fa55c0b3ac0 2023-06-10T19:05:07.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.860+0000 7fa553fff640 1 -- 172.21.15.53:0/442188445 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fa558001680 con 0x7fa55c0b3ac0 2023-06-10T19:05:07.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.860+0000 7fa553fff640 1 -- 172.21.15.53:0/442188445 >> v1:172.21.15.53:6789/0 conn(0x7fa55c0b3ac0 legacy=0x7fa55c0b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:07.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.860+0000 7fa553fff640 1 --2- 172.21.15.53:0/442188445 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa55c0cc690 0x7fa5480039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:07.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.860+0000 7fa553fff640 1 --2- 172.21.15.53:0/442188445 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa548003f70 0x7fa5480047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:07.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.860+0000 7fa553fff640 1 --2- 172.21.15.53:0/442188445 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa548004d10 0x7fa548005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:07.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.860+0000 7fa553fff640 1 -- 172.21.15.53:0/442188445 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa55c0cef40 con 0x7fa548003f70 2023-06-10T19:05:07.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.860+0000 7fa553fff640 1 -- 172.21.15.53:0/442188445 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa55c0cf220 con 0x7fa548004d10 2023-06-10T19:05:07.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.860+0000 7fa553fff640 1 -- 172.21.15.53:0/442188445 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa54800b990 con 0x7fa55c0cc690 2023-06-10T19:05:07.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.860+0000 7fa560af8640 1 --2- 172.21.15.53:0/442188445 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa548003f70 0x7fa5480047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:07.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.860+0000 7fa5612f9640 1 --2- 172.21.15.53:0/442188445 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa55c0cc690 0x7fa5480039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:07.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.860+0000 7fa561afa640 1 --2- 172.21.15.53:0/442188445 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa548004d10 0x7fa548005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:07.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.860+0000 7fa560af8640 1 -- 172.21.15.53:0/442188445 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa55c0cc690 msgr2=0x7fa5480039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:07.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.860+0000 7fa560af8640 1 --2- 172.21.15.53:0/442188445 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa55c0cc690 0x7fa5480039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:07.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.860+0000 7fa560af8640 1 -- 172.21.15.53:0/442188445 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa548004d10 msgr2=0x7fa548005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:07.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.860+0000 7fa560af8640 1 --2- 172.21.15.53:0/442188445 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa548004d10 0x7fa548005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:07.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.860+0000 7fa560af8640 1 -- 172.21.15.53:0/442188445 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa548003530 con 0x7fa548003f70 2023-06-10T19:05:07.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.864+0000 7fa560af8640 1 --2- 172.21.15.53:0/442188445 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa548003f70 0x7fa5480047d0 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7fa54c009b10 tx=0x7fa54c01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=257835e758557381 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:07.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.864+0000 7fa553fff640 1 -- 172.21.15.53:0/442188445 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54c0a5530 con 0x7fa548003f70 2023-06-10T19:05:07.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.864+0000 7fa553fff640 1 -- 172.21.15.53:0/442188445 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa54c0a5690 con 0x7fa548003f70 2023-06-10T19:05:07.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.864+0000 7fa553fff640 1 -- 172.21.15.53:0/442188445 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54c0a5a40 con 0x7fa548003f70 2023-06-10T19:05:07.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.864+0000 7fa56355d640 1 -- 172.21.15.53:0/442188445 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa548003f70 msgr2=0x7fa5480047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:07.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.864+0000 7fa56355d640 1 --2- 172.21.15.53:0/442188445 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa548003f70 0x7fa5480047d0 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7fa54c009b10 tx=0x7fa54c01ca50 comp rx=0 tx=0).stop 2023-06-10T19:05:07.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.864+0000 7fa561afa640 1 -- 172.21.15.53:0/442188445 reap_dead start 2023-06-10T19:05:07.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.864+0000 7fa56355d640 1 -- 172.21.15.53:0/442188445 shutdown_connections 2023-06-10T19:05:07.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.864+0000 7fa56355d640 1 -- 172.21.15.53:0/442188445 >> 172.21.15.53:0/442188445 conn(0x7fa55c071790 msgr2=0x7fa55c069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:07.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.864+0000 7fa56355d640 1 -- 172.21.15.53:0/442188445 shutdown_connections 2023-06-10T19:05:07.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.864+0000 7fa56355d640 1 -- 172.21.15.53:0/442188445 wait complete. 2023-06-10T19:05:07.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.864+0000 7fa56355d640 1 Processor -- start 2023-06-10T19:05:07.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.864+0000 7fa56355d640 1 -- start start 2023-06-10T19:05:07.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.864+0000 7fa56355d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa548003f70 0x7fa55c156a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:07.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.864+0000 7fa56355d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa55c1f1660 0x7fa55c0c5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:07.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.864+0000 7fa56355d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa55c0c60b0 0x7fa55c158150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:07.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.864+0000 7fa56355d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa55c156fa0 con 0x7fa548003f70 2023-06-10T19:05:07.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.864+0000 7fa56355d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa55c15e0a0 con 0x7fa55c0c60b0 2023-06-10T19:05:07.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.864+0000 7fa56355d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa55c15e960 con 0x7fa55c1f1660 2023-06-10T19:05:07.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.864+0000 7fa5612f9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa548003f70 0x7fa55c156a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:07.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.864+0000 7fa5612f9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa548003f70 0x7fa55c156a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60152/0 (socket says 172.21.15.53:60152) 2023-06-10T19:05:07.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.864+0000 7fa5612f9640 1 -- 172.21.15.53:0/572786234 learned_addr learned my addr 172.21.15.53:0/572786234 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:07.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.864+0000 7fa561afa640 1 --2- 172.21.15.53:0/572786234 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa55c0c60b0 0x7fa55c158150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:07.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.864+0000 7fa560af8640 1 --2- 172.21.15.53:0/572786234 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa55c1f1660 0x7fa55c0c5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:07.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.864+0000 7fa5612f9640 1 -- 172.21.15.53:0/572786234 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa55c1f1660 msgr2=0x7fa55c0c5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:07.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.864+0000 7fa5612f9640 1 --2- 172.21.15.53:0/572786234 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa55c1f1660 0x7fa55c0c5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:07.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.864+0000 7fa5612f9640 1 -- 172.21.15.53:0/572786234 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa55c0c60b0 msgr2=0x7fa55c158150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:07.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.864+0000 7fa5612f9640 1 --2- 172.21.15.53:0/572786234 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa55c0c60b0 0x7fa55c158150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:07.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.864+0000 7fa5612f9640 1 -- 172.21.15.53:0/572786234 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa55c1f2520 con 0x7fa548003f70 2023-06-10T19:05:07.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.864+0000 7fa560af8640 1 --2- 172.21.15.53:0/572786234 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa55c1f1660 0x7fa55c0c5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:05:07.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.864+0000 7fa5612f9640 1 --2- 172.21.15.53:0/572786234 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa548003f70 0x7fa55c156a60 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7fa558011820 tx=0x7fa558011ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:07.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.868+0000 7fa551ffb640 1 -- 172.21.15.53:0/572786234 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55800fb60 con 0x7fa548003f70 2023-06-10T19:05:07.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.868+0000 7fa551ffb640 1 -- 172.21.15.53:0/572786234 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa55800fcc0 con 0x7fa548003f70 2023-06-10T19:05:07.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.868+0000 7fa56355d640 1 -- 172.21.15.53:0/572786234 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa55c1f2800 con 0x7fa548003f70 2023-06-10T19:05:07.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.868+0000 7fa551ffb640 1 -- 172.21.15.53:0/572786234 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa558015650 con 0x7fa548003f70 2023-06-10T19:05:07.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.868+0000 7fa56355d640 1 -- 172.21.15.53:0/572786234 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa55c1f2dc0 con 0x7fa548003f70 2023-06-10T19:05:07.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.868+0000 7fa56355d640 1 -- 172.21.15.53:0/572786234 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa55c04d790 con 0x7fa548003f70 2023-06-10T19:05:07.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.868+0000 7fa551ffb640 1 -- 172.21.15.53:0/572786234 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa5580157b0 con 0x7fa548003f70 2023-06-10T19:05:07.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.868+0000 7fa551ffb640 1 --2- 172.21.15.53:0/572786234 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa540066280 0x7fa540068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:07.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.868+0000 7fa551ffb640 1 -- 172.21.15.53:0/572786234 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa5580870b0 con 0x7fa548003f70 2023-06-10T19:05:07.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.868+0000 7fa560af8640 1 --2- 172.21.15.53:0/572786234 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa540066280 0x7fa540068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:07.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.868+0000 7fa560af8640 1 --2- 172.21.15.53:0/572786234 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa540066280 0x7fa540068730 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fa54c0af000 tx=0x7fa54c0046d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:07.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:07.872+0000 7fa551ffb640 1 -- 172.21.15.53:0/572786234 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa558054530 con 0x7fa548003f70 2023-06-10T19:05:08.011 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-10T19:05:08.014 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-10T19:05:08.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.024+0000 7fa56355d640 1 -- 172.21.15.53:0/572786234 --> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa55c0cfcb0 con 0x7fa540066280 2023-06-10T19:05:08.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.036+0000 7fa551ffb640 1 -- 172.21.15.53:0/572786234 <== mgr.4105 v2:172.21.15.117:6832/3061986771 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310134 (secure 0 0 0) 0x7fa54c0a5800 con 0x7fa540066280 2023-06-10T19:05:08.044 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:05:08.045 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-06-10T19:05:08.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.040+0000 7fa56355d640 1 -- 172.21.15.53:0/572786234 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa540066280 msgr2=0x7fa540068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:08.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.040+0000 7fa56355d640 1 --2- 172.21.15.53:0/572786234 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa540066280 0x7fa540068730 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fa54c0af000 tx=0x7fa54c0046d0 comp rx=0 tx=0).stop 2023-06-10T19:05:08.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.040+0000 7fa56355d640 1 -- 172.21.15.53:0/572786234 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa548003f70 msgr2=0x7fa55c156a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:08.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.040+0000 7fa56355d640 1 --2- 172.21.15.53:0/572786234 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa548003f70 0x7fa55c156a60 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7fa558011820 tx=0x7fa558011ce0 comp rx=0 tx=0).stop 2023-06-10T19:05:08.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.040+0000 7fa56355d640 1 -- 172.21.15.53:0/572786234 shutdown_connections 2023-06-10T19:05:08.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.040+0000 7fa56355d640 1 --2- 172.21.15.53:0/572786234 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa540066280 0x7fa540068730 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:08.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.040+0000 7fa56355d640 1 --2- 172.21.15.53:0/572786234 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa55c0c60b0 0x7fa55c158150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:08.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.040+0000 7fa56355d640 1 --2- 172.21.15.53:0/572786234 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa55c1f1660 0x7fa55c0c5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:08.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.040+0000 7fa56355d640 1 --2- 172.21.15.53:0/572786234 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa548003f70 0x7fa55c156a60 unknown :-1 s=CLOSED pgs=1888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:08.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.040+0000 7fa56355d640 1 -- 172.21.15.53:0/572786234 >> 172.21.15.53:0/572786234 conn(0x7fa55c071790 msgr2=0x7fa55c0b6830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:08.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.040+0000 7fa56355d640 1 -- 172.21.15.53:0/572786234 shutdown_connections 2023-06-10T19:05:08.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.040+0000 7fa56355d640 1 -- 172.21.15.53:0/572786234 wait complete. 2023-06-10T19:05:08.062 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":496,"stamp":"2023-06-10T19:05:07.828318+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":120,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":269916,"kb_used_data":13340,"kb_used_omap":0,"kb_used_meta":256512,"kb_avail":754704804,"statfs":{"total":773094113280,"available":772817719296,"internally_reserved":0,"allocated":13660160,"data_stored":6942371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":262668288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":56,"apply_latency_ms":56,"commit_latency_ns":56000000,"apply_latency_ns":56000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.343329"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:05.903700+0000","last_change":"2023-06-10T19:05:04.896591+0000","last_active":"2023-06-10T19:05:05.903700+0000","last_peered":"2023-06-10T19:05:05.903700+0000","last_clean":"2023-06-10T19:05:05.903700+0000","last_became_active":"2023-06-10T19:05:04.895587+0000","last_became_peered":"2023-06-10T19:05:04.895587+0000","last_unstale":"2023-06-10T19:05:05.903700+0000","last_undegraded":"2023-06-10T19:05:05.903700+0000","last_fullsized":"2023-06-10T19:05:05.903700+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:07:01.013738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.329374+0000","last_change":"2023-06-10T19:05:04.949482+0000","last_active":"2023-06-10T19:05:06.329374+0000","last_peered":"2023-06-10T19:05:06.329374+0000","last_clean":"2023-06-10T19:05:06.329374+0000","last_became_active":"2023-06-10T19:05:04.949128+0000","last_became_peered":"2023-06-10T19:05:04.949128+0000","last_unstale":"2023-06-10T19:05:06.329374+0000","last_undegraded":"2023-06-10T19:05:06.329374+0000","last_fullsized":"2023-06-10T19:05:06.329374+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:29:41.921077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.329471+0000","last_change":"2023-06-10T19:05:04.937061+0000","last_active":"2023-06-10T19:05:06.329471+0000","last_peered":"2023-06-10T19:05:06.329471+0000","last_clean":"2023-06-10T19:05:06.329471+0000","last_became_active":"2023-06-10T19:05:04.936760+0000","last_became_peered":"2023-06-10T19:05:04.936760+0000","last_unstale":"2023-06-10T19:05:06.329471+0000","last_undegraded":"2023-06-10T19:05:06.329471+0000","last_fullsized":"2023-06-10T19:05:06.329471+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:48:56.236233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.330050+0000","last_change":"2023-06-10T19:05:04.951289+0000","last_active":"2023-06-10T19:05:06.330050+0000","last_peered":"2023-06-10T19:05:06.330050+0000","last_clean":"2023-06-10T19:05:06.330050+0000","last_became_active":"2023-06-10T19:05:04.950541+0000","last_became_peered":"2023-06-10T19:05:04.950541+0000","last_unstale":"2023-06-10T19:05:06.330050+0000","last_undegraded":"2023-06-10T19:05:06.330050+0000","last_fullsized":"2023-06-10T19:05:06.330050+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:15:20.539316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:05.903006+0000","last_change":"2023-06-10T19:05:04.919037+0000","last_active":"2023-06-10T19:05:05.903006+0000","last_peered":"2023-06-10T19:05:05.903006+0000","last_clean":"2023-06-10T19:05:05.903006+0000","last_became_active":"2023-06-10T19:05:04.918273+0000","last_became_peered":"2023-06-10T19:05:04.918273+0000","last_unstale":"2023-06-10T19:05:05.903006+0000","last_undegraded":"2023-06-10T19:05:05.903006+0000","last_fullsized":"2023-06-10T19:05:05.903006+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:09:17.733733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:05.895844+0000","last_change":"2023-06-10T19:05:04.911695+0000","last_active":"2023-06-10T19:05:05.895844+0000","last_peered":"2023-06-10T19:05:05.895844+0000","last_clean":"2023-06-10T19:05:05.895844+0000","last_became_active":"2023-06-10T19:05:04.911147+0000","last_became_peered":"2023-06-10T19:05:04.911147+0000","last_unstale":"2023-06-10T19:05:05.895844+0000","last_undegraded":"2023-06-10T19:05:05.895844+0000","last_fullsized":"2023-06-10T19:05:05.895844+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:46:10.116702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:05.895242+0000","last_change":"2023-06-10T19:05:04.949268+0000","last_active":"2023-06-10T19:05:05.895242+0000","last_peered":"2023-06-10T19:05:05.895242+0000","last_clean":"2023-06-10T19:05:05.895242+0000","last_became_active":"2023-06-10T19:05:04.948981+0000","last_became_peered":"2023-06-10T19:05:04.948981+0000","last_unstale":"2023-06-10T19:05:05.895242+0000","last_undegraded":"2023-06-10T19:05:05.895242+0000","last_fullsized":"2023-06-10T19:05:05.895242+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:57:58.445340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.328330+0000","last_change":"2023-06-10T19:05:04.932394+0000","last_active":"2023-06-10T19:05:06.328330+0000","last_peered":"2023-06-10T19:05:06.328330+0000","last_clean":"2023-06-10T19:05:06.328330+0000","last_became_active":"2023-06-10T19:05:04.932077+0000","last_became_peered":"2023-06-10T19:05:04.932077+0000","last_unstale":"2023-06-10T19:05:06.328330+0000","last_undegraded":"2023-06-10T19:05:06.328330+0000","last_fullsized":"2023-06-10T19:05:06.328330+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:20:51.932148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.331150+0000","last_change":"2023-06-10T19:05:04.953949+0000","last_active":"2023-06-10T19:05:06.331150+0000","last_peered":"2023-06-10T19:05:06.331150+0000","last_clean":"2023-06-10T19:05:06.331150+0000","last_became_active":"2023-06-10T19:05:04.951300+0000","last_became_peered":"2023-06-10T19:05:04.951300+0000","last_unstale":"2023-06-10T19:05:06.331150+0000","last_undegraded":"2023-06-10T19:05:06.331150+0000","last_fullsized":"2023-06-10T19:05:06.331150+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:05:52.858691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.331715+0000","last_change":"2023-06-10T19:05:04.905572+0000","last_active":"2023-06-10T19:05:06.331715+0000","last_peered":"2023-06-10T19:05:06.331715+0000","last_clean":"2023-06-10T19:05:06.331715+0000","last_became_active":"2023-06-10T19:05:04.905259+0000","last_became_peered":"2023-06-10T19:05:04.905259+0000","last_unstale":"2023-06-10T19:05:06.331715+0000","last_undegraded":"2023-06-10T19:05:06.331715+0000","last_fullsized":"2023-06-10T19:05:06.331715+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:07:55.397266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:05.903531+0000","last_change":"2023-06-10T19:05:04.945264+0000","last_active":"2023-06-10T19:05:05.903531+0000","last_peered":"2023-06-10T19:05:05.903531+0000","last_clean":"2023-06-10T19:05:05.903531+0000","last_became_active":"2023-06-10T19:05:04.944533+0000","last_became_peered":"2023-06-10T19:05:04.944533+0000","last_unstale":"2023-06-10T19:05:05.903531+0000","last_undegraded":"2023-06-10T19:05:05.903531+0000","last_fullsized":"2023-06-10T19:05:05.903531+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:27:28.528097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:05.895768+0000","last_change":"2023-06-10T19:05:04.921844+0000","last_active":"2023-06-10T19:05:05.895768+0000","last_peered":"2023-06-10T19:05:05.895768+0000","last_clean":"2023-06-10T19:05:05.895768+0000","last_became_active":"2023-06-10T19:05:04.921396+0000","last_became_peered":"2023-06-10T19:05:04.921396+0000","last_unstale":"2023-06-10T19:05:05.895768+0000","last_undegraded":"2023-06-10T19:05:05.895768+0000","last_fullsized":"2023-06-10T19:05:05.895768+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:38:10.586306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.331337+0000","last_change":"2023-06-10T19:05:04.936509+0000","last_active":"2023-06-10T19:05:06.331337+0000","last_peered":"2023-06-10T19:05:06.331337+0000","last_clean":"2023-06-10T19:05:06.331337+0000","last_became_active":"2023-06-10T19:05:04.936168+0000","last_became_peered":"2023-06-10T19:05:04.936168+0000","last_unstale":"2023-06-10T19:05:06.331337+0000","last_undegraded":"2023-06-10T19:05:06.331337+0000","last_fullsized":"2023-06-10T19:05:06.331337+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:03:29.229444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.329425+0000","last_change":"2023-06-10T19:05:04.934311+0000","last_active":"2023-06-10T19:05:06.329425+0000","last_peered":"2023-06-10T19:05:06.329425+0000","last_clean":"2023-06-10T19:05:06.329425+0000","last_became_active":"2023-06-10T19:05:04.934083+0000","last_became_peered":"2023-06-10T19:05:04.934083+0000","last_unstale":"2023-06-10T19:05:06.329425+0000","last_undegraded":"2023-06-10T19:05:06.329425+0000","last_fullsized":"2023-06-10T19:05:06.329425+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:37:58.983109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:05.900716+0000","last_change":"2023-06-10T19:05:04.932147+0000","last_active":"2023-06-10T19:05:05.900716+0000","last_peered":"2023-06-10T19:05:05.900716+0000","last_clean":"2023-06-10T19:05:05.900716+0000","last_became_active":"2023-06-10T19:05:04.931323+0000","last_became_peered":"2023-06-10T19:05:04.931323+0000","last_unstale":"2023-06-10T19:05:05.900716+0000","last_undegraded":"2023-06-10T19:05:05.900716+0000","last_fullsized":"2023-06-10T19:05:05.900716+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:39:17.376928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:05.895182+0000","last_change":"2023-06-10T19:05:04.910119+0000","last_active":"2023-06-10T19:05:05.895182+0000","last_peered":"2023-06-10T19:05:05.895182+0000","last_clean":"2023-06-10T19:05:05.895182+0000","last_became_active":"2023-06-10T19:05:04.909622+0000","last_became_peered":"2023-06-10T19:05:04.909622+0000","last_unstale":"2023-06-10T19:05:05.895182+0000","last_undegraded":"2023-06-10T19:05:05.895182+0000","last_fullsized":"2023-06-10T19:05:05.895182+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:14:33.713196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.331835+0000","last_change":"2023-06-10T19:05:04.943819+0000","last_active":"2023-06-10T19:05:06.331835+0000","last_peered":"2023-06-10T19:05:06.331835+0000","last_clean":"2023-06-10T19:05:06.331835+0000","last_became_active":"2023-06-10T19:05:04.943477+0000","last_became_peered":"2023-06-10T19:05:04.943477+0000","last_unstale":"2023-06-10T19:05:06.331835+0000","last_undegraded":"2023-06-10T19:05:06.331835+0000","last_fullsized":"2023-06-10T19:05:06.331835+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:23:36.570169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.329645+0000","last_change":"2023-06-10T19:05:04.949392+0000","last_active":"2023-06-10T19:05:06.329645+0000","last_peered":"2023-06-10T19:05:06.329645+0000","last_clean":"2023-06-10T19:05:06.329645+0000","last_became_active":"2023-06-10T19:05:04.949087+0000","last_became_peered":"2023-06-10T19:05:04.949087+0000","last_unstale":"2023-06-10T19:05:06.329645+0000","last_undegraded":"2023-06-10T19:05:06.329645+0000","last_fullsized":"2023-06-10T19:05:06.329645+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:13:00.888112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:05.901068+0000","last_change":"2023-06-10T19:05:04.951804+0000","last_active":"2023-06-10T19:05:05.901068+0000","last_peered":"2023-06-10T19:05:05.901068+0000","last_clean":"2023-06-10T19:05:05.901068+0000","last_became_active":"2023-06-10T19:05:04.951149+0000","last_became_peered":"2023-06-10T19:05:04.951149+0000","last_unstale":"2023-06-10T19:05:05.901068+0000","last_undegraded":"2023-06-10T19:05:05.901068+0000","last_fullsized":"2023-06-10T19:05:05.901068+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:48:28.308531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.327341+0000","last_change":"2023-06-10T19:05:04.905874+0000","last_active":"2023-06-10T19:05:06.327341+0000","last_peered":"2023-06-10T19:05:06.327341+0000","last_clean":"2023-06-10T19:05:06.327341+0000","last_became_active":"2023-06-10T19:05:04.905565+0000","last_became_peered":"2023-06-10T19:05:04.905565+0000","last_unstale":"2023-06-10T19:05:06.327341+0000","last_undegraded":"2023-06-10T19:05:06.327341+0000","last_fullsized":"2023-06-10T19:05:06.327341+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:40:48.377702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.330001+0000","last_change":"2023-06-10T19:05:04.950808+0000","last_active":"2023-06-10T19:05:06.330001+0000","last_peered":"2023-06-10T19:05:06.330001+0000","last_clean":"2023-06-10T19:05:06.330001+0000","last_became_active":"2023-06-10T19:05:04.950354+0000","last_became_peered":"2023-06-10T19:05:04.950354+0000","last_unstale":"2023-06-10T19:05:06.330001+0000","last_undegraded":"2023-06-10T19:05:06.330001+0000","last_fullsized":"2023-06-10T19:05:06.330001+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:51:42.574350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:05.903017+0000","last_change":"2023-06-10T19:05:04.913882+0000","last_active":"2023-06-10T19:05:05.903017+0000","last_peered":"2023-06-10T19:05:05.903017+0000","last_clean":"2023-06-10T19:05:05.903017+0000","last_became_active":"2023-06-10T19:05:04.913114+0000","last_became_peered":"2023-06-10T19:05:04.913114+0000","last_unstale":"2023-06-10T19:05:05.903017+0000","last_undegraded":"2023-06-10T19:05:05.903017+0000","last_fullsized":"2023-06-10T19:05:05.903017+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:19:19.506886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.330193+0000","last_change":"2023-06-10T19:05:04.953671+0000","last_active":"2023-06-10T19:05:06.330193+0000","last_peered":"2023-06-10T19:05:06.330193+0000","last_clean":"2023-06-10T19:05:06.330193+0000","last_became_active":"2023-06-10T19:05:04.953000+0000","last_became_peered":"2023-06-10T19:05:04.953000+0000","last_unstale":"2023-06-10T19:05:06.330193+0000","last_undegraded":"2023-06-10T19:05:06.330193+0000","last_fullsized":"2023-06-10T19:05:06.330193+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:18:59.129858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.328976+0000","last_change":"2023-06-10T19:05:04.944524+0000","last_active":"2023-06-10T19:05:06.328976+0000","last_peered":"2023-06-10T19:05:06.328976+0000","last_clean":"2023-06-10T19:05:06.328976+0000","last_became_active":"2023-06-10T19:05:04.942705+0000","last_became_peered":"2023-06-10T19:05:04.942705+0000","last_unstale":"2023-06-10T19:05:06.328976+0000","last_undegraded":"2023-06-10T19:05:06.328976+0000","last_fullsized":"2023-06-10T19:05:06.328976+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:30:14.500942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.331899+0000","last_change":"2023-06-10T19:05:04.944042+0000","last_active":"2023-06-10T19:05:06.331899+0000","last_peered":"2023-06-10T19:05:06.331899+0000","last_clean":"2023-06-10T19:05:06.331899+0000","last_became_active":"2023-06-10T19:05:04.943425+0000","last_became_peered":"2023-06-10T19:05:04.943425+0000","last_unstale":"2023-06-10T19:05:06.331899+0000","last_undegraded":"2023-06-10T19:05:06.331899+0000","last_fullsized":"2023-06-10T19:05:06.331899+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:23:36.570169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.327583+0000","last_change":"2023-06-10T19:05:04.892024+0000","last_active":"2023-06-10T19:05:06.327583+0000","last_peered":"2023-06-10T19:05:06.327583+0000","last_clean":"2023-06-10T19:05:06.327583+0000","last_became_active":"2023-06-10T19:05:04.891778+0000","last_became_peered":"2023-06-10T19:05:04.891778+0000","last_unstale":"2023-06-10T19:05:06.327583+0000","last_undegraded":"2023-06-10T19:05:06.327583+0000","last_fullsized":"2023-06-10T19:05:06.327583+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:35:47.511061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:05.901366+0000","last_change":"2023-06-10T19:05:04.952353+0000","last_active":"2023-06-10T19:05:05.901366+0000","last_peered":"2023-06-10T19:05:05.901366+0000","last_clean":"2023-06-10T19:05:05.901366+0000","last_became_active":"2023-06-10T19:05:04.951678+0000","last_became_peered":"2023-06-10T19:05:04.951678+0000","last_unstale":"2023-06-10T19:05:05.901366+0000","last_undegraded":"2023-06-10T19:05:05.901366+0000","last_fullsized":"2023-06-10T19:05:05.901366+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:30:46.918056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:05.895943+0000","last_change":"2023-06-10T19:05:04.944222+0000","last_active":"2023-06-10T19:05:05.895943+0000","last_peered":"2023-06-10T19:05:05.895943+0000","last_clean":"2023-06-10T19:05:05.895943+0000","last_became_active":"2023-06-10T19:05:04.943939+0000","last_became_peered":"2023-06-10T19:05:04.943939+0000","last_unstale":"2023-06-10T19:05:05.895943+0000","last_undegraded":"2023-06-10T19:05:05.895943+0000","last_fullsized":"2023-06-10T19:05:05.895943+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:58:45.365001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.327736+0000","last_change":"2023-06-10T19:05:04.901519+0000","last_active":"2023-06-10T19:05:06.327736+0000","last_peered":"2023-06-10T19:05:06.327736+0000","last_clean":"2023-06-10T19:05:06.327736+0000","last_became_active":"2023-06-10T19:05:04.899362+0000","last_became_peered":"2023-06-10T19:05:04.899362+0000","last_unstale":"2023-06-10T19:05:06.327736+0000","last_undegraded":"2023-06-10T19:05:06.327736+0000","last_fullsized":"2023-06-10T19:05:06.327736+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:27:28.422611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.329776+0000","last_change":"2023-06-10T19:05:04.914260+0000","last_active":"2023-06-10T19:05:06.329776+0000","last_peered":"2023-06-10T19:05:06.329776+0000","last_clean":"2023-06-10T19:05:06.329776+0000","last_became_active":"2023-06-10T19:05:04.913964+0000","last_became_peered":"2023-06-10T19:05:04.913964+0000","last_unstale":"2023-06-10T19:05:06.329776+0000","last_undegraded":"2023-06-10T19:05:06.329776+0000","last_fullsized":"2023-06-10T19:05:06.329776+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:32:16.784415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.329386+0000","last_change":"2023-06-10T19:05:04.928470+0000","last_active":"2023-06-10T19:05:06.329386+0000","last_peered":"2023-06-10T19:05:06.329386+0000","last_clean":"2023-06-10T19:05:06.329386+0000","last_became_active":"2023-06-10T19:05:04.927666+0000","last_became_peered":"2023-06-10T19:05:04.927666+0000","last_unstale":"2023-06-10T19:05:06.329386+0000","last_undegraded":"2023-06-10T19:05:06.329386+0000","last_fullsized":"2023-06-10T19:05:06.329386+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:29:18.338259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.329001+0000","last_change":"2023-06-10T19:05:04.942794+0000","last_active":"2023-06-10T19:05:06.329001+0000","last_peered":"2023-06-10T19:05:06.329001+0000","last_clean":"2023-06-10T19:05:06.329001+0000","last_became_active":"2023-06-10T19:05:04.940627+0000","last_became_peered":"2023-06-10T19:05:04.940627+0000","last_unstale":"2023-06-10T19:05:06.329001+0000","last_undegraded":"2023-06-10T19:05:06.329001+0000","last_fullsized":"2023-06-10T19:05:06.329001+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:49:51.070715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.331869+0000","last_change":"2023-06-10T19:05:04.905581+0000","last_active":"2023-06-10T19:05:06.331869+0000","last_peered":"2023-06-10T19:05:06.331869+0000","last_clean":"2023-06-10T19:05:06.331869+0000","last_became_active":"2023-06-10T19:05:04.905168+0000","last_became_peered":"2023-06-10T19:05:04.905168+0000","last_unstale":"2023-06-10T19:05:06.331869+0000","last_undegraded":"2023-06-10T19:05:06.331869+0000","last_fullsized":"2023-06-10T19:05:06.331869+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:50:37.357501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"124'4","reported_seq":17,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:05.900736+0000","last_change":"2023-06-10T19:05:04.550549+0000","last_active":"2023-06-10T19:05:05.900736+0000","last_peered":"2023-06-10T19:05:05.900736+0000","last_clean":"2023-06-10T19:05:05.900736+0000","last_became_active":"2023-06-10T19:05:04.549987+0000","last_became_peered":"2023-06-10T19:05:04.549987+0000","last_unstale":"2023-06-10T19:05:05.900736+0000","last_undegraded":"2023-06-10T19:05:05.900736+0000","last_fullsized":"2023-06-10T19:05:05.900736+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_clean_scrub_stamp":"2023-06-10T19:05:03.469282+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:04:09.577735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:05.896209+0000","last_change":"2023-06-10T19:05:04.911774+0000","last_active":"2023-06-10T19:05:05.896209+0000","last_peered":"2023-06-10T19:05:05.896209+0000","last_clean":"2023-06-10T19:05:05.896209+0000","last_became_active":"2023-06-10T19:05:04.911068+0000","last_became_peered":"2023-06-10T19:05:04.911068+0000","last_unstale":"2023-06-10T19:05:05.896209+0000","last_undegraded":"2023-06-10T19:05:05.896209+0000","last_fullsized":"2023-06-10T19:05:05.896209+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:32:00.287790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"124'1","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.332068+0000","last_change":"2023-06-10T19:05:04.526627+0000","last_active":"2023-06-10T19:05:06.332068+0000","last_peered":"2023-06-10T19:05:06.332068+0000","last_clean":"2023-06-10T19:05:06.332068+0000","last_became_active":"2023-06-10T19:05:04.525988+0000","last_became_peered":"2023-06-10T19:05:04.525988+0000","last_unstale":"2023-06-10T19:05:06.332068+0000","last_undegraded":"2023-06-10T19:05:06.332068+0000","last_fullsized":"2023-06-10T19:05:06.332068+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_clean_scrub_stamp":"2023-06-10T19:05:03.469282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:07:29.080750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.331392+0000","last_change":"2023-06-10T19:05:04.928328+0000","last_active":"2023-06-10T19:05:06.331392+0000","last_peered":"2023-06-10T19:05:06.331392+0000","last_clean":"2023-06-10T19:05:06.331392+0000","last_became_active":"2023-06-10T19:05:04.927714+0000","last_became_peered":"2023-06-10T19:05:04.927714+0000","last_unstale":"2023-06-10T19:05:06.331392+0000","last_undegraded":"2023-06-10T19:05:06.331392+0000","last_fullsized":"2023-06-10T19:05:06.331392+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:24:46.918015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"124'2","reported_seq":15,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.330881+0000","last_change":"2023-06-10T19:05:04.547263+0000","last_active":"2023-06-10T19:05:06.330881+0000","last_peered":"2023-06-10T19:05:06.330881+0000","last_clean":"2023-06-10T19:05:06.330881+0000","last_became_active":"2023-06-10T19:05:04.546573+0000","last_became_peered":"2023-06-10T19:05:04.546573+0000","last_unstale":"2023-06-10T19:05:06.330881+0000","last_undegraded":"2023-06-10T19:05:06.330881+0000","last_fullsized":"2023-06-10T19:05:06.330881+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_clean_scrub_stamp":"2023-06-10T19:05:03.469282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:06:15.650971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.331324+0000","last_change":"2023-06-10T19:05:04.951090+0000","last_active":"2023-06-10T19:05:06.331324+0000","last_peered":"2023-06-10T19:05:06.331324+0000","last_clean":"2023-06-10T19:05:06.331324+0000","last_became_active":"2023-06-10T19:05:04.950647+0000","last_became_peered":"2023-06-10T19:05:04.950647+0000","last_unstale":"2023-06-10T19:05:06.331324+0000","last_undegraded":"2023-06-10T19:05:06.331324+0000","last_fullsized":"2023-06-10T19:05:06.331324+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:33:02.324869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"124'2","reported_seq":15,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.332283+0000","last_change":"2023-06-10T19:05:04.523993+0000","last_active":"2023-06-10T19:05:06.332283+0000","last_peered":"2023-06-10T19:05:06.332283+0000","last_clean":"2023-06-10T19:05:06.332283+0000","last_became_active":"2023-06-10T19:05:04.523626+0000","last_became_peered":"2023-06-10T19:05:04.523626+0000","last_unstale":"2023-06-10T19:05:06.332283+0000","last_undegraded":"2023-06-10T19:05:06.332283+0000","last_fullsized":"2023-06-10T19:05:06.332283+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_clean_scrub_stamp":"2023-06-10T19:05:03.469282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:40:01.543517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.331109+0000","last_change":"2023-06-10T19:05:04.930356+0000","last_active":"2023-06-10T19:05:06.331109+0000","last_peered":"2023-06-10T19:05:06.331109+0000","last_clean":"2023-06-10T19:05:06.331109+0000","last_became_active":"2023-06-10T19:05:04.929983+0000","last_became_peered":"2023-06-10T19:05:04.929983+0000","last_unstale":"2023-06-10T19:05:06.331109+0000","last_undegraded":"2023-06-10T19:05:06.331109+0000","last_fullsized":"2023-06-10T19:05:06.331109+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:01:01.691704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"124'1","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:05.903242+0000","last_change":"2023-06-10T19:05:04.543332+0000","last_active":"2023-06-10T19:05:05.903242+0000","last_peered":"2023-06-10T19:05:05.903242+0000","last_clean":"2023-06-10T19:05:05.903242+0000","last_became_active":"2023-06-10T19:05:04.542579+0000","last_became_peered":"2023-06-10T19:05:04.542579+0000","last_unstale":"2023-06-10T19:05:05.903242+0000","last_undegraded":"2023-06-10T19:05:05.903242+0000","last_fullsized":"2023-06-10T19:05:05.903242+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_clean_scrub_stamp":"2023-06-10T19:05:03.469282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:09:59.567791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:05.902680+0000","last_change":"2023-06-10T19:05:04.932883+0000","last_active":"2023-06-10T19:05:05.902680+0000","last_peered":"2023-06-10T19:05:05.902680+0000","last_clean":"2023-06-10T19:05:05.902680+0000","last_became_active":"2023-06-10T19:05:04.932095+0000","last_became_peered":"2023-06-10T19:05:04.932095+0000","last_unstale":"2023-06-10T19:05:05.902680+0000","last_undegraded":"2023-06-10T19:05:05.902680+0000","last_fullsized":"2023-06-10T19:05:05.902680+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:33:57.704804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"124'1","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:05.896057+0000","last_change":"2023-06-10T19:05:04.517319+0000","last_active":"2023-06-10T19:05:05.896057+0000","last_peered":"2023-06-10T19:05:05.896057+0000","last_clean":"2023-06-10T19:05:05.896057+0000","last_became_active":"2023-06-10T19:05:04.517019+0000","last_became_peered":"2023-06-10T19:05:04.517019+0000","last_unstale":"2023-06-10T19:05:05.896057+0000","last_undegraded":"2023-06-10T19:05:05.896057+0000","last_fullsized":"2023-06-10T19:05:05.896057+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_clean_scrub_stamp":"2023-06-10T19:05:03.469282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:49:50.057951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.329976+0000","last_change":"2023-06-10T19:05:04.911827+0000","last_active":"2023-06-10T19:05:06.329976+0000","last_peered":"2023-06-10T19:05:06.329976+0000","last_clean":"2023-06-10T19:05:06.329976+0000","last_became_active":"2023-06-10T19:05:04.910748+0000","last_became_peered":"2023-06-10T19:05:04.910748+0000","last_unstale":"2023-06-10T19:05:06.329976+0000","last_undegraded":"2023-06-10T19:05:06.329976+0000","last_fullsized":"2023-06-10T19:05:06.329976+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:47:37.969139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":13,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.329795+0000","last_change":"2023-06-10T19:05:04.535051+0000","last_active":"2023-06-10T19:05:06.329795+0000","last_peered":"2023-06-10T19:05:06.329795+0000","last_clean":"2023-06-10T19:05:06.329795+0000","last_became_active":"2023-06-10T19:05:04.534225+0000","last_became_peered":"2023-06-10T19:05:04.534225+0000","last_unstale":"2023-06-10T19:05:06.329795+0000","last_undegraded":"2023-06-10T19:05:06.329795+0000","last_fullsized":"2023-06-10T19:05:06.329795+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_clean_scrub_stamp":"2023-06-10T19:05:03.469282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:31:59.275026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.331706+0000","last_change":"2023-06-10T19:05:04.903797+0000","last_active":"2023-06-10T19:05:06.331706+0000","last_peered":"2023-06-10T19:05:06.331706+0000","last_clean":"2023-06-10T19:05:06.331706+0000","last_became_active":"2023-06-10T19:05:04.903152+0000","last_became_peered":"2023-06-10T19:05:04.903152+0000","last_unstale":"2023-06-10T19:05:06.331706+0000","last_undegraded":"2023-06-10T19:05:06.331706+0000","last_fullsized":"2023-06-10T19:05:06.331706+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:24:46.918015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":13,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:05.895323+0000","last_change":"2023-06-10T19:05:04.526425+0000","last_active":"2023-06-10T19:05:05.895323+0000","last_peered":"2023-06-10T19:05:05.895323+0000","last_clean":"2023-06-10T19:05:05.895323+0000","last_became_active":"2023-06-10T19:05:04.525717+0000","last_became_peered":"2023-06-10T19:05:04.525717+0000","last_unstale":"2023-06-10T19:05:05.895323+0000","last_undegraded":"2023-06-10T19:05:05.895323+0000","last_fullsized":"2023-06-10T19:05:05.895323+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_clean_scrub_stamp":"2023-06-10T19:05:03.469282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:08:27.711924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.330568+0000","last_change":"2023-06-10T19:05:04.942732+0000","last_active":"2023-06-10T19:05:06.330568+0000","last_peered":"2023-06-10T19:05:06.330568+0000","last_clean":"2023-06-10T19:05:06.330568+0000","last_became_active":"2023-06-10T19:05:04.940731+0000","last_became_peered":"2023-06-10T19:05:04.940731+0000","last_unstale":"2023-06-10T19:05:06.330568+0000","last_undegraded":"2023-06-10T19:05:06.330568+0000","last_fullsized":"2023-06-10T19:05:06.330568+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:01:01.691704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"124'1","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.332053+0000","last_change":"2023-06-10T19:05:04.531331+0000","last_active":"2023-06-10T19:05:06.332053+0000","last_peered":"2023-06-10T19:05:06.332053+0000","last_clean":"2023-06-10T19:05:06.332053+0000","last_became_active":"2023-06-10T19:05:04.530905+0000","last_became_peered":"2023-06-10T19:05:04.530905+0000","last_unstale":"2023-06-10T19:05:06.332053+0000","last_undegraded":"2023-06-10T19:05:06.332053+0000","last_fullsized":"2023-06-10T19:05:06.332053+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_clean_scrub_stamp":"2023-06-10T19:05:03.469282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:45:47.788672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:05.903121+0000","last_change":"2023-06-10T19:05:04.914298+0000","last_active":"2023-06-10T19:05:05.903121+0000","last_peered":"2023-06-10T19:05:05.903121+0000","last_clean":"2023-06-10T19:05:05.903121+0000","last_became_active":"2023-06-10T19:05:04.913371+0000","last_became_peered":"2023-06-10T19:05:04.913371+0000","last_unstale":"2023-06-10T19:05:05.903121+0000","last_undegraded":"2023-06-10T19:05:05.903121+0000","last_fullsized":"2023-06-10T19:05:05.903121+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:21:39.960825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"124'2","reported_seq":15,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.327858+0000","last_change":"2023-06-10T19:05:04.528752+0000","last_active":"2023-06-10T19:05:06.327858+0000","last_peered":"2023-06-10T19:05:06.327858+0000","last_clean":"2023-06-10T19:05:06.327858+0000","last_became_active":"2023-06-10T19:05:04.528294+0000","last_became_peered":"2023-06-10T19:05:04.528294+0000","last_unstale":"2023-06-10T19:05:06.327858+0000","last_undegraded":"2023-06-10T19:05:06.327858+0000","last_fullsized":"2023-06-10T19:05:06.327858+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_clean_scrub_stamp":"2023-06-10T19:05:03.469282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:07:43.395736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:05.896142+0000","last_change":"2023-06-10T19:05:04.931481+0000","last_active":"2023-06-10T19:05:05.896142+0000","last_peered":"2023-06-10T19:05:05.896142+0000","last_clean":"2023-06-10T19:05:05.896142+0000","last_became_active":"2023-06-10T19:05:04.931180+0000","last_became_peered":"2023-06-10T19:05:04.931180+0000","last_unstale":"2023-06-10T19:05:05.896142+0000","last_undegraded":"2023-06-10T19:05:05.896142+0000","last_fullsized":"2023-06-10T19:05:05.896142+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:29:18.338259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"124'1","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.331224+0000","last_change":"2023-06-10T19:05:04.547409+0000","last_active":"2023-06-10T19:05:06.331224+0000","last_peered":"2023-06-10T19:05:06.331224+0000","last_clean":"2023-06-10T19:05:06.331224+0000","last_became_active":"2023-06-10T19:05:04.546691+0000","last_became_peered":"2023-06-10T19:05:04.546691+0000","last_unstale":"2023-06-10T19:05:06.331224+0000","last_undegraded":"2023-06-10T19:05:06.331224+0000","last_fullsized":"2023-06-10T19:05:06.331224+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_clean_scrub_stamp":"2023-06-10T19:05:03.469282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:08:43.073504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.332100+0000","last_change":"2023-06-10T19:05:04.950920+0000","last_active":"2023-06-10T19:05:06.332100+0000","last_peered":"2023-06-10T19:05:06.332100+0000","last_clean":"2023-06-10T19:05:06.332100+0000","last_became_active":"2023-06-10T19:05:04.950220+0000","last_became_peered":"2023-06-10T19:05:04.950220+0000","last_unstale":"2023-06-10T19:05:06.332100+0000","last_undegraded":"2023-06-10T19:05:06.332100+0000","last_fullsized":"2023-06-10T19:05:06.332100+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:58:08.595183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":13,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.330213+0000","last_change":"2023-06-10T19:05:04.548077+0000","last_active":"2023-06-10T19:05:06.330213+0000","last_peered":"2023-06-10T19:05:06.330213+0000","last_clean":"2023-06-10T19:05:06.330213+0000","last_became_active":"2023-06-10T19:05:04.547147+0000","last_became_peered":"2023-06-10T19:05:04.547147+0000","last_unstale":"2023-06-10T19:05:06.330213+0000","last_undegraded":"2023-06-10T19:05:06.330213+0000","last_fullsized":"2023-06-10T19:05:06.330213+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_clean_scrub_stamp":"2023-06-10T19:05:03.469282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:37:38.156875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:05.895181+0000","last_change":"2023-06-10T19:05:04.937359+0000","last_active":"2023-06-10T19:05:05.895181+0000","last_peered":"2023-06-10T19:05:05.895181+0000","last_clean":"2023-06-10T19:05:05.895181+0000","last_became_active":"2023-06-10T19:05:04.936954+0000","last_became_peered":"2023-06-10T19:05:04.936954+0000","last_unstale":"2023-06-10T19:05:05.895181+0000","last_undegraded":"2023-06-10T19:05:05.895181+0000","last_fullsized":"2023-06-10T19:05:05.895181+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:21:50.651914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"124'2","reported_seq":15,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:05.895593+0000","last_change":"2023-06-10T19:05:04.544232+0000","last_active":"2023-06-10T19:05:05.895593+0000","last_peered":"2023-06-10T19:05:05.895593+0000","last_clean":"2023-06-10T19:05:05.895593+0000","last_became_active":"2023-06-10T19:05:04.543696+0000","last_became_peered":"2023-06-10T19:05:04.543696+0000","last_unstale":"2023-06-10T19:05:05.895593+0000","last_undegraded":"2023-06-10T19:05:05.895593+0000","last_fullsized":"2023-06-10T19:05:05.895593+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_clean_scrub_stamp":"2023-06-10T19:05:03.469282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:39:12.050252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.328431+0000","last_change":"2023-06-10T19:05:04.943240+0000","last_active":"2023-06-10T19:05:06.328431+0000","last_peered":"2023-06-10T19:05:06.328431+0000","last_clean":"2023-06-10T19:05:06.328431+0000","last_became_active":"2023-06-10T19:05:04.942874+0000","last_became_peered":"2023-06-10T19:05:04.942874+0000","last_unstale":"2023-06-10T19:05:06.328431+0000","last_undegraded":"2023-06-10T19:05:06.328431+0000","last_fullsized":"2023-06-10T19:05:06.328431+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:04:52.272158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":13,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.330096+0000","last_change":"2023-06-10T19:05:04.550407+0000","last_active":"2023-06-10T19:05:06.330096+0000","last_peered":"2023-06-10T19:05:06.330096+0000","last_clean":"2023-06-10T19:05:06.330096+0000","last_became_active":"2023-06-10T19:05:04.549785+0000","last_became_peered":"2023-06-10T19:05:04.549785+0000","last_unstale":"2023-06-10T19:05:06.330096+0000","last_undegraded":"2023-06-10T19:05:06.330096+0000","last_fullsized":"2023-06-10T19:05:06.330096+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_clean_scrub_stamp":"2023-06-10T19:05:03.469282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:12:29.992745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.330338+0000","last_change":"2023-06-10T19:05:04.934457+0000","last_active":"2023-06-10T19:05:06.330338+0000","last_peered":"2023-06-10T19:05:06.330338+0000","last_clean":"2023-06-10T19:05:06.330338+0000","last_became_active":"2023-06-10T19:05:04.934120+0000","last_became_peered":"2023-06-10T19:05:04.934120+0000","last_unstale":"2023-06-10T19:05:06.330338+0000","last_undegraded":"2023-06-10T19:05:06.330338+0000","last_fullsized":"2023-06-10T19:05:06.330338+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:02:59.813450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":13,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.328866+0000","last_change":"2023-06-10T19:05:04.527075+0000","last_active":"2023-06-10T19:05:06.328866+0000","last_peered":"2023-06-10T19:05:06.328866+0000","last_clean":"2023-06-10T19:05:06.328866+0000","last_became_active":"2023-06-10T19:05:04.526750+0000","last_became_peered":"2023-06-10T19:05:04.526750+0000","last_unstale":"2023-06-10T19:05:06.328866+0000","last_undegraded":"2023-06-10T19:05:06.328866+0000","last_fullsized":"2023-06-10T19:05:06.328866+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_clean_scrub_stamp":"2023-06-10T19:05:03.469282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:13:03.567675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.330527+0000","last_change":"2023-06-10T19:05:04.936865+0000","last_active":"2023-06-10T19:05:06.330527+0000","last_peered":"2023-06-10T19:05:06.330527+0000","last_clean":"2023-06-10T19:05:06.330527+0000","last_became_active":"2023-06-10T19:05:04.936105+0000","last_became_peered":"2023-06-10T19:05:04.936105+0000","last_unstale":"2023-06-10T19:05:06.330527+0000","last_undegraded":"2023-06-10T19:05:06.330527+0000","last_fullsized":"2023-06-10T19:05:06.330527+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:32:56.155624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":13,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.328975+0000","last_change":"2023-06-10T19:05:04.549689+0000","last_active":"2023-06-10T19:05:06.328975+0000","last_peered":"2023-06-10T19:05:06.328975+0000","last_clean":"2023-06-10T19:05:06.328975+0000","last_became_active":"2023-06-10T19:05:04.546518+0000","last_became_peered":"2023-06-10T19:05:04.546518+0000","last_unstale":"2023-06-10T19:05:06.328975+0000","last_undegraded":"2023-06-10T19:05:06.328975+0000","last_fullsized":"2023-06-10T19:05:06.328975+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_clean_scrub_stamp":"2023-06-10T19:05:03.469282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:44:44.355202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:05.895906+0000","last_change":"2023-06-10T19:05:04.911941+0000","last_active":"2023-06-10T19:05:05.895906+0000","last_peered":"2023-06-10T19:05:05.895906+0000","last_clean":"2023-06-10T19:05:05.895906+0000","last_became_active":"2023-06-10T19:05:04.911513+0000","last_became_peered":"2023-06-10T19:05:04.911513+0000","last_unstale":"2023-06-10T19:05:05.895906+0000","last_undegraded":"2023-06-10T19:05:05.895906+0000","last_fullsized":"2023-06-10T19:05:05.895906+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:43:05.118849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"124'2","reported_seq":15,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:05.896047+0000","last_change":"2023-06-10T19:05:04.523989+0000","last_active":"2023-06-10T19:05:05.896047+0000","last_peered":"2023-06-10T19:05:05.896047+0000","last_clean":"2023-06-10T19:05:05.896047+0000","last_became_active":"2023-06-10T19:05:04.523687+0000","last_became_peered":"2023-06-10T19:05:04.523687+0000","last_unstale":"2023-06-10T19:05:05.896047+0000","last_undegraded":"2023-06-10T19:05:05.896047+0000","last_fullsized":"2023-06-10T19:05:05.896047+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_clean_scrub_stamp":"2023-06-10T19:05:03.469282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:30:13.488177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.331551+0000","last_change":"2023-06-10T19:05:04.930752+0000","last_active":"2023-06-10T19:05:06.331551+0000","last_peered":"2023-06-10T19:05:06.331551+0000","last_clean":"2023-06-10T19:05:06.331551+0000","last_became_active":"2023-06-10T19:05:04.930297+0000","last_became_peered":"2023-06-10T19:05:04.930297+0000","last_unstale":"2023-06-10T19:05:06.331551+0000","last_undegraded":"2023-06-10T19:05:06.331551+0000","last_fullsized":"2023-06-10T19:05:06.331551+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:38:51.147875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":13,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:05.901854+0000","last_change":"2023-06-10T19:05:04.532191+0000","last_active":"2023-06-10T19:05:05.901854+0000","last_peered":"2023-06-10T19:05:05.901854+0000","last_clean":"2023-06-10T19:05:05.901854+0000","last_became_active":"2023-06-10T19:05:04.531066+0000","last_became_peered":"2023-06-10T19:05:04.531066+0000","last_unstale":"2023-06-10T19:05:05.901854+0000","last_undegraded":"2023-06-10T19:05:05.901854+0000","last_fullsized":"2023-06-10T19:05:05.901854+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_clean_scrub_stamp":"2023-06-10T19:05:03.469282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:20:46.018729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.331032+0000","last_change":"2023-06-10T19:05:04.953124+0000","last_active":"2023-06-10T19:05:06.331032+0000","last_peered":"2023-06-10T19:05:06.331032+0000","last_clean":"2023-06-10T19:05:06.331032+0000","last_became_active":"2023-06-10T19:05:04.951541+0000","last_became_peered":"2023-06-10T19:05:04.951541+0000","last_unstale":"2023-06-10T19:05:06.331032+0000","last_undegraded":"2023-06-10T19:05:06.331032+0000","last_fullsized":"2023-06-10T19:05:06.331032+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:20:05.156375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":13,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:05.901576+0000","last_change":"2023-06-10T19:05:04.531900+0000","last_active":"2023-06-10T19:05:05.901576+0000","last_peered":"2023-06-10T19:05:05.901576+0000","last_clean":"2023-06-10T19:05:05.901576+0000","last_became_active":"2023-06-10T19:05:04.530994+0000","last_became_peered":"2023-06-10T19:05:04.530994+0000","last_unstale":"2023-06-10T19:05:05.901576+0000","last_undegraded":"2023-06-10T19:05:05.901576+0000","last_fullsized":"2023-06-10T19:05:05.901576+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_clean_scrub_stamp":"2023-06-10T19:05:03.469282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:39:36.064983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.328704+0000","last_change":"2023-06-10T19:05:04.947519+0000","last_active":"2023-06-10T19:05:06.328704+0000","last_peered":"2023-06-10T19:05:06.328704+0000","last_clean":"2023-06-10T19:05:06.328704+0000","last_became_active":"2023-06-10T19:05:04.947148+0000","last_became_peered":"2023-06-10T19:05:04.947148+0000","last_unstale":"2023-06-10T19:05:06.328704+0000","last_undegraded":"2023-06-10T19:05:06.328704+0000","last_fullsized":"2023-06-10T19:05:06.328704+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:35:02.524165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":13,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:05.896016+0000","last_change":"2023-06-10T19:05:04.524534+0000","last_active":"2023-06-10T19:05:05.896016+0000","last_peered":"2023-06-10T19:05:05.896016+0000","last_clean":"2023-06-10T19:05:05.896016+0000","last_became_active":"2023-06-10T19:05:04.524254+0000","last_became_peered":"2023-06-10T19:05:04.524254+0000","last_unstale":"2023-06-10T19:05:05.896016+0000","last_undegraded":"2023-06-10T19:05:05.896016+0000","last_fullsized":"2023-06-10T19:05:05.896016+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_clean_scrub_stamp":"2023-06-10T19:05:03.469282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:59:51.951802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:05.895334+0000","last_change":"2023-06-10T19:05:04.914589+0000","last_active":"2023-06-10T19:05:05.895334+0000","last_peered":"2023-06-10T19:05:05.895334+0000","last_clean":"2023-06-10T19:05:05.895334+0000","last_became_active":"2023-06-10T19:05:04.914128+0000","last_became_peered":"2023-06-10T19:05:04.914128+0000","last_unstale":"2023-06-10T19:05:05.895334+0000","last_undegraded":"2023-06-10T19:05:05.895334+0000","last_fullsized":"2023-06-10T19:05:05.895334+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:33:18.357059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":13,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:05.903381+0000","last_change":"2023-06-10T19:05:04.526879+0000","last_active":"2023-06-10T19:05:05.903381+0000","last_peered":"2023-06-10T19:05:05.903381+0000","last_clean":"2023-06-10T19:05:05.903381+0000","last_became_active":"2023-06-10T19:05:04.526192+0000","last_became_peered":"2023-06-10T19:05:04.526192+0000","last_unstale":"2023-06-10T19:05:05.903381+0000","last_undegraded":"2023-06-10T19:05:05.903381+0000","last_fullsized":"2023-06-10T19:05:05.903381+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_clean_scrub_stamp":"2023-06-10T19:05:03.469282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:37:26.398183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.328651+0000","last_change":"2023-06-10T19:05:04.932420+0000","last_active":"2023-06-10T19:05:06.328651+0000","last_peered":"2023-06-10T19:05:06.328651+0000","last_clean":"2023-06-10T19:05:06.328651+0000","last_became_active":"2023-06-10T19:05:04.932143+0000","last_became_peered":"2023-06-10T19:05:04.932143+0000","last_unstale":"2023-06-10T19:05:06.328651+0000","last_undegraded":"2023-06-10T19:05:06.328651+0000","last_fullsized":"2023-06-10T19:05:06.328651+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:56:45.424999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":13,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:05.903154+0000","last_change":"2023-06-10T19:05:04.525116+0000","last_active":"2023-06-10T19:05:05.903154+0000","last_peered":"2023-06-10T19:05:05.903154+0000","last_clean":"2023-06-10T19:05:05.903154+0000","last_became_active":"2023-06-10T19:05:04.524364+0000","last_became_peered":"2023-06-10T19:05:04.524364+0000","last_unstale":"2023-06-10T19:05:05.903154+0000","last_undegraded":"2023-06-10T19:05:05.903154+0000","last_fullsized":"2023-06-10T19:05:05.903154+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_clean_scrub_stamp":"2023-06-10T19:05:03.469282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:27:39.725221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.329762+0000","last_change":"2023-06-10T19:05:04.952981+0000","last_active":"2023-06-10T19:05:06.329762+0000","last_peered":"2023-06-10T19:05:06.329762+0000","last_clean":"2023-06-10T19:05:06.329762+0000","last_became_active":"2023-06-10T19:05:04.950008+0000","last_became_peered":"2023-06-10T19:05:04.950008+0000","last_unstale":"2023-06-10T19:05:06.329762+0000","last_undegraded":"2023-06-10T19:05:06.329762+0000","last_fullsized":"2023-06-10T19:05:06.329762+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:47:15.740474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":13,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:05.895619+0000","last_change":"2023-06-10T19:05:04.526354+0000","last_active":"2023-06-10T19:05:05.895619+0000","last_peered":"2023-06-10T19:05:05.895619+0000","last_clean":"2023-06-10T19:05:05.895619+0000","last_became_active":"2023-06-10T19:05:04.526034+0000","last_became_peered":"2023-06-10T19:05:04.526034+0000","last_unstale":"2023-06-10T19:05:05.895619+0000","last_undegraded":"2023-06-10T19:05:05.895619+0000","last_fullsized":"2023-06-10T19:05:05.895619+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_clean_scrub_stamp":"2023-06-10T19:05:03.469282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:38:29.611144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.332052+0000","last_change":"2023-06-10T19:05:04.933510+0000","last_active":"2023-06-10T19:05:06.332052+0000","last_peered":"2023-06-10T19:05:06.332052+0000","last_clean":"2023-06-10T19:05:06.332052+0000","last_became_active":"2023-06-10T19:05:04.933109+0000","last_became_peered":"2023-06-10T19:05:04.933109+0000","last_unstale":"2023-06-10T19:05:06.332052+0000","last_undegraded":"2023-06-10T19:05:06.332052+0000","last_fullsized":"2023-06-10T19:05:06.332052+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:58:08.595183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":13,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.329066+0000","last_change":"2023-06-10T19:05:04.548959+0000","last_active":"2023-06-10T19:05:06.329066+0000","last_peered":"2023-06-10T19:05:06.329066+0000","last_clean":"2023-06-10T19:05:06.329066+0000","last_became_active":"2023-06-10T19:05:04.548200+0000","last_became_peered":"2023-06-10T19:05:04.548200+0000","last_unstale":"2023-06-10T19:05:06.329066+0000","last_undegraded":"2023-06-10T19:05:06.329066+0000","last_fullsized":"2023-06-10T19:05:06.329066+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_clean_scrub_stamp":"2023-06-10T19:05:03.469282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:43:33.961979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.330310+0000","last_change":"2023-06-10T19:05:04.954383+0000","last_active":"2023-06-10T19:05:06.330310+0000","last_peered":"2023-06-10T19:05:06.330310+0000","last_clean":"2023-06-10T19:05:06.330310+0000","last_became_active":"2023-06-10T19:05:04.951260+0000","last_became_peered":"2023-06-10T19:05:04.951260+0000","last_unstale":"2023-06-10T19:05:06.330310+0000","last_undegraded":"2023-06-10T19:05:06.330310+0000","last_fullsized":"2023-06-10T19:05:06.330310+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:30:36.697854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"124'8","reported_seq":21,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.328432+0000","last_change":"2023-06-10T19:05:04.543681+0000","last_active":"2023-06-10T19:05:06.328432+0000","last_peered":"2023-06-10T19:05:06.328432+0000","last_clean":"2023-06-10T19:05:06.328432+0000","last_became_active":"2023-06-10T19:05:04.543398+0000","last_became_peered":"2023-06-10T19:05:04.543398+0000","last_unstale":"2023-06-10T19:05:06.328432+0000","last_undegraded":"2023-06-10T19:05:06.328432+0000","last_fullsized":"2023-06-10T19:05:06.328432+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_clean_scrub_stamp":"2023-06-10T19:05:03.469282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:02:03.902484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":355,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.329344+0000","last_change":"2023-06-10T18:52:34.951528+0000","last_active":"2023-06-10T19:05:06.329344+0000","last_peered":"2023-06-10T19:05:06.329344+0000","last_clean":"2023-06-10T19:05:06.329344+0000","last_became_active":"2023-06-10T18:52:34.949099+0000","last_became_peered":"2023-06-10T18:52:34.949099+0000","last_unstale":"2023-06-10T19:05:06.329344+0000","last_undegraded":"2023-06-10T19:05:06.329344+0000","last_fullsized":"2023-06-10T19:05:06.329344+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_clean_scrub_stamp":"2023-06-10T18:52:33.633295+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:52:40.202841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":208,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.330602+0000","last_change":"2023-06-10T18:52:40.506384+0000","last_active":"2023-06-10T19:05:06.330602+0000","last_peered":"2023-06-10T19:05:06.330602+0000","last_clean":"2023-06-10T19:05:06.330602+0000","last_became_active":"2023-06-10T18:52:40.505701+0000","last_became_peered":"2023-06-10T18:52:40.505701+0000","last_unstale":"2023-06-10T19:05:06.330602+0000","last_undegraded":"2023-06-10T19:05:06.330602+0000","last_fullsized":"2023-06-10T19:05:06.330602+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:41:58.693046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:05.900721+0000","last_change":"2023-06-10T19:05:04.918187+0000","last_active":"2023-06-10T19:05:05.900721+0000","last_peered":"2023-06-10T19:05:05.900721+0000","last_clean":"2023-06-10T19:05:05.900721+0000","last_became_active":"2023-06-10T19:05:04.917296+0000","last_became_peered":"2023-06-10T19:05:04.917296+0000","last_unstale":"2023-06-10T19:05:05.900721+0000","last_undegraded":"2023-06-10T19:05:05.900721+0000","last_fullsized":"2023-06-10T19:05:05.900721+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:51:49.120945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"124'2","reported_seq":15,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.329531+0000","last_change":"2023-06-10T19:05:04.543831+0000","last_active":"2023-06-10T19:05:06.329531+0000","last_peered":"2023-06-10T19:05:06.329531+0000","last_clean":"2023-06-10T19:05:06.329531+0000","last_became_active":"2023-06-10T19:05:04.543463+0000","last_became_peered":"2023-06-10T19:05:04.543463+0000","last_unstale":"2023-06-10T19:05:06.329531+0000","last_undegraded":"2023-06-10T19:05:06.329531+0000","last_fullsized":"2023-06-10T19:05:06.329531+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_clean_scrub_stamp":"2023-06-10T19:05:03.469282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:23:49.155296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":199,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.329144+0000","last_change":"2023-06-10T18:52:40.512015+0000","last_active":"2023-06-10T19:05:06.329144+0000","last_peered":"2023-06-10T19:05:06.329144+0000","last_clean":"2023-06-10T19:05:06.329144+0000","last_became_active":"2023-06-10T18:52:40.511382+0000","last_became_peered":"2023-06-10T18:52:40.511382+0000","last_unstale":"2023-06-10T19:05:06.329144+0000","last_undegraded":"2023-06-10T19:05:06.329144+0000","last_fullsized":"2023-06-10T19:05:06.329144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:17:37.399196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.331247+0000","last_change":"2023-06-10T19:05:04.930552+0000","last_active":"2023-06-10T19:05:06.331247+0000","last_peered":"2023-06-10T19:05:06.331247+0000","last_clean":"2023-06-10T19:05:06.331247+0000","last_became_active":"2023-06-10T19:05:04.930006+0000","last_became_peered":"2023-06-10T19:05:04.930006+0000","last_unstale":"2023-06-10T19:05:06.331247+0000","last_undegraded":"2023-06-10T19:05:06.331247+0000","last_fullsized":"2023-06-10T19:05:06.331247+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:54:23.700250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":13,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.330448+0000","last_change":"2023-06-10T19:05:04.523006+0000","last_active":"2023-06-10T19:05:06.330448+0000","last_peered":"2023-06-10T19:05:06.330448+0000","last_clean":"2023-06-10T19:05:06.330448+0000","last_became_active":"2023-06-10T19:05:04.522688+0000","last_became_peered":"2023-06-10T19:05:04.522688+0000","last_unstale":"2023-06-10T19:05:06.330448+0000","last_undegraded":"2023-06-10T19:05:06.330448+0000","last_fullsized":"2023-06-10T19:05:06.330448+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_clean_scrub_stamp":"2023-06-10T19:05:03.469282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:21:56.991537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":210,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.327297+0000","last_change":"2023-06-10T18:52:40.671725+0000","last_active":"2023-06-10T19:05:06.327297+0000","last_peered":"2023-06-10T19:05:06.327297+0000","last_clean":"2023-06-10T19:05:06.327297+0000","last_became_active":"2023-06-10T18:52:40.671442+0000","last_became_peered":"2023-06-10T18:52:40.671442+0000","last_unstale":"2023-06-10T19:05:06.327297+0000","last_undegraded":"2023-06-10T19:05:06.327297+0000","last_fullsized":"2023-06-10T19:05:06.327297+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:27:16.555869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.327239+0000","last_change":"2023-06-10T19:05:04.895399+0000","last_active":"2023-06-10T19:05:06.327239+0000","last_peered":"2023-06-10T19:05:06.327239+0000","last_clean":"2023-06-10T19:05:06.327239+0000","last_became_active":"2023-06-10T19:05:04.895092+0000","last_became_peered":"2023-06-10T19:05:04.895092+0000","last_unstale":"2023-06-10T19:05:06.327239+0000","last_undegraded":"2023-06-10T19:05:06.327239+0000","last_fullsized":"2023-06-10T19:05:06.327239+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:48:25.030248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":13,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.328657+0000","last_change":"2023-06-10T19:05:04.542766+0000","last_active":"2023-06-10T19:05:06.328657+0000","last_peered":"2023-06-10T19:05:06.328657+0000","last_clean":"2023-06-10T19:05:06.328657+0000","last_became_active":"2023-06-10T19:05:04.542381+0000","last_became_peered":"2023-06-10T19:05:04.542381+0000","last_unstale":"2023-06-10T19:05:06.328657+0000","last_undegraded":"2023-06-10T19:05:06.328657+0000","last_fullsized":"2023-06-10T19:05:06.328657+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_clean_scrub_stamp":"2023-06-10T19:05:03.469282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:55:55.485770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":208,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.330041+0000","last_change":"2023-06-10T18:52:40.510258+0000","last_active":"2023-06-10T19:05:06.330041+0000","last_peered":"2023-06-10T19:05:06.330041+0000","last_clean":"2023-06-10T19:05:06.330041+0000","last_became_active":"2023-06-10T18:52:40.509560+0000","last_became_peered":"2023-06-10T18:52:40.509560+0000","last_unstale":"2023-06-10T19:05:06.330041+0000","last_undegraded":"2023-06-10T19:05:06.330041+0000","last_fullsized":"2023-06-10T19:05:06.330041+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:33:51.668225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:05.900562+0000","last_change":"2023-06-10T19:05:04.950948+0000","last_active":"2023-06-10T19:05:05.900562+0000","last_peered":"2023-06-10T19:05:05.900562+0000","last_clean":"2023-06-10T19:05:05.900562+0000","last_became_active":"2023-06-10T19:05:04.950236+0000","last_became_peered":"2023-06-10T19:05:04.950236+0000","last_unstale":"2023-06-10T19:05:05.900562+0000","last_undegraded":"2023-06-10T19:05:05.900562+0000","last_fullsized":"2023-06-10T19:05:05.900562+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:31:43.166898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":13,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:05.901045+0000","last_change":"2023-06-10T19:05:04.532086+0000","last_active":"2023-06-10T19:05:05.901045+0000","last_peered":"2023-06-10T19:05:05.901045+0000","last_clean":"2023-06-10T19:05:05.901045+0000","last_became_active":"2023-06-10T19:05:04.531080+0000","last_became_peered":"2023-06-10T19:05:04.531080+0000","last_unstale":"2023-06-10T19:05:05.901045+0000","last_undegraded":"2023-06-10T19:05:05.901045+0000","last_fullsized":"2023-06-10T19:05:05.901045+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_clean_scrub_stamp":"2023-06-10T19:05:03.469282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:47:37.878528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":194,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.332347+0000","last_change":"2023-06-10T18:52:40.672266+0000","last_active":"2023-06-10T19:05:06.332347+0000","last_peered":"2023-06-10T19:05:06.332347+0000","last_clean":"2023-06-10T19:05:06.332347+0000","last_became_active":"2023-06-10T18:52:40.671966+0000","last_became_peered":"2023-06-10T18:52:40.671966+0000","last_unstale":"2023-06-10T19:05:06.332347+0000","last_undegraded":"2023-06-10T19:05:06.332347+0000","last_fullsized":"2023-06-10T19:05:06.332347+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:11:51.256178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.331028+0000","last_change":"2023-06-10T19:05:04.942822+0000","last_active":"2023-06-10T19:05:06.331028+0000","last_peered":"2023-06-10T19:05:06.331028+0000","last_clean":"2023-06-10T19:05:06.331028+0000","last_became_active":"2023-06-10T19:05:04.940684+0000","last_became_peered":"2023-06-10T19:05:04.940684+0000","last_unstale":"2023-06-10T19:05:06.331028+0000","last_undegraded":"2023-06-10T19:05:06.331028+0000","last_fullsized":"2023-06-10T19:05:06.331028+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:03:29.229444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":13,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.331604+0000","last_change":"2023-06-10T19:05:04.529417+0000","last_active":"2023-06-10T19:05:06.331604+0000","last_peered":"2023-06-10T19:05:06.331604+0000","last_clean":"2023-06-10T19:05:06.331604+0000","last_became_active":"2023-06-10T19:05:04.528602+0000","last_became_peered":"2023-06-10T19:05:04.528602+0000","last_unstale":"2023-06-10T19:05:06.331604+0000","last_undegraded":"2023-06-10T19:05:06.331604+0000","last_fullsized":"2023-06-10T19:05:06.331604+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_clean_scrub_stamp":"2023-06-10T19:05:03.469282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:07:54.384502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":198,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.331433+0000","last_change":"2023-06-10T18:52:40.671084+0000","last_active":"2023-06-10T19:05:06.331433+0000","last_peered":"2023-06-10T19:05:06.331433+0000","last_clean":"2023-06-10T19:05:06.331433+0000","last_became_active":"2023-06-10T18:52:40.670697+0000","last_became_peered":"2023-06-10T18:52:40.670697+0000","last_unstale":"2023-06-10T19:05:06.331433+0000","last_undegraded":"2023-06-10T19:05:06.331433+0000","last_fullsized":"2023-06-10T19:05:06.331433+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:53:09.330856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.329920+0000","last_change":"2023-06-10T19:05:04.934797+0000","last_active":"2023-06-10T19:05:06.329920+0000","last_peered":"2023-06-10T19:05:06.329920+0000","last_clean":"2023-06-10T19:05:06.329920+0000","last_became_active":"2023-06-10T19:05:04.934549+0000","last_became_peered":"2023-06-10T19:05:04.934549+0000","last_unstale":"2023-06-10T19:05:06.329920+0000","last_undegraded":"2023-06-10T19:05:06.329920+0000","last_fullsized":"2023-06-10T19:05:06.329920+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:59:34.063716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"124'3","reported_seq":16,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.331197+0000","last_change":"2023-06-10T19:05:04.544815+0000","last_active":"2023-06-10T19:05:06.331197+0000","last_peered":"2023-06-10T19:05:06.331197+0000","last_clean":"2023-06-10T19:05:06.331197+0000","last_became_active":"2023-06-10T19:05:04.544127+0000","last_became_peered":"2023-06-10T19:05:04.544127+0000","last_unstale":"2023-06-10T19:05:06.331197+0000","last_undegraded":"2023-06-10T19:05:06.331197+0000","last_fullsized":"2023-06-10T19:05:06.331197+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_clean_scrub_stamp":"2023-06-10T19:05:03.469282+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:38:50.135110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":194,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.332194+0000","last_change":"2023-06-10T18:52:40.514114+0000","last_active":"2023-06-10T19:05:06.332194+0000","last_peered":"2023-06-10T19:05:06.332194+0000","last_clean":"2023-06-10T19:05:06.332194+0000","last_became_active":"2023-06-10T18:52:40.513638+0000","last_became_peered":"2023-06-10T18:52:40.513638+0000","last_unstale":"2023-06-10T19:05:06.332194+0000","last_undegraded":"2023-06-10T19:05:06.332194+0000","last_fullsized":"2023-06-10T19:05:06.332194+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:35:34.283698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.331953+0000","last_change":"2023-06-10T19:05:04.944000+0000","last_active":"2023-06-10T19:05:06.331953+0000","last_peered":"2023-06-10T19:05:06.331953+0000","last_clean":"2023-06-10T19:05:06.331953+0000","last_became_active":"2023-06-10T19:05:04.943389+0000","last_became_peered":"2023-06-10T19:05:04.943389+0000","last_unstale":"2023-06-10T19:05:06.331953+0000","last_undegraded":"2023-06-10T19:05:06.331953+0000","last_fullsized":"2023-06-10T19:05:06.331953+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:50:37.357501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"124'6","reported_seq":19,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.328838+0000","last_change":"2023-06-10T19:05:04.542922+0000","last_active":"2023-06-10T19:05:06.328838+0000","last_peered":"2023-06-10T19:05:06.328838+0000","last_clean":"2023-06-10T19:05:06.328838+0000","last_became_active":"2023-06-10T19:05:04.542490+0000","last_became_peered":"2023-06-10T19:05:04.542490+0000","last_unstale":"2023-06-10T19:05:06.328838+0000","last_undegraded":"2023-06-10T19:05:06.328838+0000","last_fullsized":"2023-06-10T19:05:06.328838+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_clean_scrub_stamp":"2023-06-10T19:05:03.469282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:09:17.507411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":200,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:05.901244+0000","last_change":"2023-06-10T18:52:40.515396+0000","last_active":"2023-06-10T19:05:05.901244+0000","last_peered":"2023-06-10T19:05:05.901244+0000","last_clean":"2023-06-10T19:05:05.901244+0000","last_became_active":"2023-06-10T18:52:40.514663+0000","last_became_peered":"2023-06-10T18:52:40.514663+0000","last_unstale":"2023-06-10T19:05:05.901244+0000","last_undegraded":"2023-06-10T19:05:05.901244+0000","last_fullsized":"2023-06-10T19:05:05.901244+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:38:47.060246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575002,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33160,"kb_used_data":2112,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338680,"statfs":{"total":96636764160,"available":96602808320,"internally_reserved":0,"allocated":2162688,"data_stored":1311140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:05:00 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.93999999999999995,"15min":0.91800000000000004},"min":{"1min":0.53600000000000003,"5min":0.49399999999999999,"15min":0.434},"max":{"1min":1.351,"5min":1.351,"15min":1.6220000000000001},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.92000000000000004,"15min":0.92700000000000005},"min":{"1min":0.59599999999999997,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.153,"5min":1.2909999999999999,"15min":1.6870000000000001},"last":1.163}]},{"osd":1,"last update":"Sat Jun 10 19:05:00 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.90700000000000003,"15min":0.91900000000000004},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1759999999999999,"5min":1.238,"15min":1.377},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.92900000000000005,"15min":0.94099999999999995},"min":{"1min":0.60399999999999998,"5min":0.51300000000000001,"15min":0.504},"max":{"1min":1.214,"5min":1.238,"15min":1.5960000000000001},"last":0.95599999999999996}]},{"osd":2,"last update":"Sat Jun 10 19:05:00 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.86399999999999999,"15min":0.84799999999999998},"min":{"1min":0.58599999999999997,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.26,"5min":1.26,"15min":1.4059999999999999},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.91900000000000004,"15min":0.90200000000000002},"min":{"1min":0.70799999999999996,"5min":0.54100000000000004,"15min":0.50600000000000001},"max":{"1min":1.3100000000000001,"5min":1.448,"15min":1.448},"last":0.77300000000000002}]},{"osd":3,"last update":"Sat Jun 10 19:05:00 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.90300000000000002,"15min":0.91500000000000004},"min":{"1min":0.68300000000000005,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.1539999999999999,"5min":1.2370000000000001,"15min":1.502},"last":1.137},{"interface":"front","average":{"1min":1.0489999999999999,"5min":0.97799999999999998,"15min":0.95499999999999996},"min":{"1min":0.85599999999999998,"5min":0.432,"15min":0.432},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.84799999999999998}]},{"osd":4,"last update":"Sat Jun 10 19:05:00 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.82099999999999995,"15min":0.84899999999999998},"min":{"1min":0.64500000000000002,"5min":0.307,"15min":0.307},"max":{"1min":1.145,"5min":1.2210000000000001,"15min":1.639},"last":1.113},{"interface":"front","average":{"1min":0.998,"5min":0.96499999999999997,"15min":0.96599999999999997},"min":{"1min":0.70999999999999996,"5min":0.41199999999999998,"15min":0.40000000000000002},"max":{"1min":1.218,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.274}]},{"osd":5,"last update":"Sat Jun 10 19:05:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1,"15min":1.0089999999999999},"min":{"1min":0.72899999999999998,"5min":0.40500000000000003,"15min":0.38400000000000001},"max":{"1min":1.3100000000000001,"5min":1.379,"15min":1.806},"last":1.0629999999999999},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0269999999999999,"15min":1.034},"min":{"1min":0.67500000000000004,"5min":0.48499999999999999,"15min":0.46500000000000002},"max":{"1min":1.3,"5min":1.579,"15min":1.579},"last":1.194}]},{"osd":6,"last update":"Sat Jun 10 19:05:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.006,"15min":1.0069999999999999},"min":{"1min":0.70399999999999996,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.274,"5min":1.391,"15min":1.718},"last":1.3149999999999999},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.0940000000000001,"15min":1.0940000000000001},"min":{"1min":0.91000000000000003,"5min":0.48799999999999999,"15min":0.441},"max":{"1min":1.5129999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":1.234}]}]},{"osd":6,"up_from":13,"seq":55834575003,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32568,"kb_used_data":1520,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339272,"statfs":{"total":96636764160,"available":96603414528,"internally_reserved":0,"allocated":1556480,"data_stored":720578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:04:50 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.84499999999999997,"15min":0.85799999999999998},"min":{"1min":0.64600000000000002,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.498},"last":0.75},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.87,"15min":0.876},"min":{"1min":0.63100000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.175,"5min":1.2250000000000001,"15min":1.496},"last":1.137}]},{"osd":1,"last update":"Sat Jun 10 19:04:50 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.86299999999999999,"15min":0.86699999999999999},"min":{"1min":0.51500000000000001,"5min":0.502,"15min":0.48699999999999999},"max":{"1min":1.163,"5min":1.163,"15min":1.5229999999999999},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.90100000000000002,"15min":0.89600000000000002},"min":{"1min":0.61599999999999999,"5min":0.48699999999999999,"15min":0.45300000000000001},"max":{"1min":1.204,"5min":1.258,"15min":1.778},"last":0.92300000000000004}]},{"osd":2,"last update":"Sat Jun 10 19:04:50 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.92600000000000005,"15min":0.89800000000000002},"min":{"1min":0.55200000000000005,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.224,"5min":1.2809999999999999,"15min":1.3759999999999999},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.88,"15min":0.88800000000000001},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.145,"5min":1.2330000000000001,"15min":1.246},"last":0.79800000000000004}]},{"osd":3,"last update":"Sat Jun 10 19:04:50 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.92500000000000004,"15min":0.91100000000000003},"min":{"1min":0.72199999999999998,"5min":0.55100000000000005,"15min":0.52700000000000002},"max":{"1min":1.161,"5min":1.238,"15min":1.7190000000000001},"last":1.0269999999999999},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.97499999999999998,"15min":0.98999999999999999},"min":{"1min":0.68100000000000005,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.22,"5min":1.371,"15min":1.4370000000000001},"last":1.198}]},{"osd":4,"last update":"Sat Jun 10 19:04:50 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.89300000000000002,"15min":0.91600000000000004},"min":{"1min":0.45900000000000002,"5min":0.373,"15min":0.373},"max":{"1min":1.167,"5min":1.401,"15min":1.798},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.98099999999999998,"15min":0.98799999999999999},"min":{"1min":0.52800000000000002,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.2669999999999999,"5min":1.357,"15min":1.5489999999999999},"last":1.071}]},{"osd":5,"last update":"Sat Jun 10 19:04:50 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.90300000000000002,"15min":0.92100000000000004},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.163,"5min":1.29,"15min":1.333},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.98299999999999998,"5min":1.004,"15min":1.022},"min":{"1min":0.50700000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.296,"5min":1.296,"15min":2.536},"last":1.1000000000000001}]},{"osd":7,"last update":"Sat Jun 10 19:04:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.0429999999999999,"15min":1.0349999999999999},"min":{"1min":0.59199999999999997,"5min":0.58599999999999997,"15min":0.57099999999999995},"max":{"1min":1.3029999999999999,"5min":1.879,"15min":1.917},"last":0.996},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.98599999999999999,"15min":1.0169999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.258,"5min":1.4850000000000001,"15min":1.5569999999999999},"last":0.88800000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575003,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32572,"kb_used_data":1524,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339268,"statfs":{"total":96636764160,"available":96603410432,"internally_reserved":0,"allocated":1560576,"data_stored":720156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.875,"15min":0.86799999999999999},"min":{"1min":0.65400000000000003,"5min":0.499,"15min":0.499},"max":{"1min":1.083,"5min":1.2070000000000001,"15min":1.232},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.94399999999999995,"15min":0.92000000000000004},"min":{"1min":0.64600000000000002,"5min":0.58999999999999997,"15min":0.49399999999999999},"max":{"1min":1.2370000000000001,"5min":2.347,"15min":2.347},"last":1.212}]},{"osd":1,"last update":"Sat Jun 10 19:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.95399999999999996,"15min":0.92100000000000004},"min":{"1min":0.67400000000000004,"5min":0.58799999999999997,"15min":0.52600000000000002},"max":{"1min":1.2450000000000001,"5min":7.0800000000000001,"15min":7.0800000000000001},"last":1.0780000000000001},{"interface":"front","average":{"1min":0.88500000000000001,"5min":1.1319999999999999,"15min":0.98799999999999999},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.53800000000000003},"max":{"1min":1.1240000000000001,"5min":15.845000000000001,"15min":15.845000000000001},"last":0.91100000000000003}]},{"osd":2,"last update":"Sat Jun 10 19:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.94799999999999995,"15min":0.89200000000000002},"min":{"1min":0.60799999999999998,"5min":0.54300000000000004,"15min":0.48299999999999998},"max":{"1min":1.2410000000000001,"5min":5.0049999999999999,"15min":5.0049999999999999},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.996,"15min":0.94299999999999995},"min":{"1min":0.60699999999999998,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.127,"5min":6.851,"15min":6.851},"last":1.236}]},{"osd":3,"last update":"Sat Jun 10 19:04:49 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":0.97799999999999998,"15min":0.95699999999999996},"min":{"1min":0.69899999999999995,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1910000000000001,"5min":2.544,"15min":2.544},"last":1.1419999999999999},{"interface":"front","average":{"1min":0.99099999999999999,"5min":1.0009999999999999,"15min":1.004},"min":{"1min":0.78200000000000003,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.272,"5min":3.0830000000000002,"15min":3.0830000000000002},"last":0.995}]},{"osd":4,"last update":"Sat Jun 10 19:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.98499999999999999,"15min":0.95599999999999996},"min":{"1min":0.68500000000000005,"5min":0.64000000000000001,"15min":0.58099999999999996},"max":{"1min":1.238,"5min":6.7290000000000001,"15min":6.7290000000000001},"last":1.171},{"interface":"front","average":{"1min":0.873,"5min":0.96699999999999997,"15min":1},"min":{"1min":0.67800000000000005,"5min":0.64900000000000002,"15min":0.61199999999999999},"max":{"1min":1.1060000000000001,"5min":1.341,"15min":1.575},"last":1.0409999999999999}]},{"osd":6,"last update":"Sat Jun 10 19:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.96599999999999997,"15min":1},"min":{"1min":0.60499999999999998,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.159,"5min":1.3029999999999999,"15min":1.4330000000000001},"last":1.113},{"interface":"front","average":{"1min":1.018,"5min":1.097,"15min":1.0609999999999999},"min":{"1min":0.81699999999999995,"5min":0.71999999999999997,"15min":0.57899999999999996},"max":{"1min":1.341,"5min":6.923,"15min":6.923},"last":0.96099999999999997}]},{"osd":7,"last update":"Sat Jun 10 19:04:49 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.083,"15min":1.101},"min":{"1min":0.82199999999999995,"5min":0.68400000000000005,"15min":0.66200000000000003},"max":{"1min":1.234,"5min":2.6080000000000001,"15min":2.6080000000000001},"last":1.194},{"interface":"front","average":{"1min":1.081,"5min":1.165,"15min":1.145},"min":{"1min":0.72499999999999998,"5min":0.67100000000000004,"15min":0.66200000000000003},"max":{"1min":1.4730000000000001,"5min":5.4169999999999998,"15min":5.4169999999999998},"last":1.2729999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575002,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32576,"kb_used_data":1528,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339264,"statfs":{"total":96636764160,"available":96603406336,"internally_reserved":0,"allocated":1564672,"data_stored":721560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.84999999999999998,"15min":0.82299999999999995},"min":{"1min":0.52800000000000002,"5min":0.45400000000000001,"15min":0.45100000000000001},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":1.25},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.88500000000000001,"15min":0.90400000000000003},"min":{"1min":0.67200000000000004,"5min":0.49199999999999999,"15min":0.48899999999999999},"max":{"1min":1.196,"5min":1.3979999999999999,"15min":3.7280000000000002},"last":1.032}]},{"osd":1,"last update":"Sat Jun 10 19:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.91300000000000003,"15min":0.94099999999999995},"min":{"1min":0.49199999999999999,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":3.3969999999999998},"last":1.3600000000000001},{"interface":"front","average":{"1min":0.878,"5min":0.83699999999999997,"15min":0.85999999999999999},"min":{"1min":0.58399999999999996,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":2.496},"last":1.1339999999999999}]},{"osd":2,"last update":"Sat Jun 10 19:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.873,"15min":0.88300000000000001},"min":{"1min":0.53400000000000003,"5min":0.52200000000000002,"15min":0.49299999999999999},"max":{"1min":1.143,"5min":1.3,"15min":1.522},"last":1.087},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.96699999999999997,"15min":0.99199999999999999},"min":{"1min":0.70899999999999996,"5min":0.64400000000000002,"15min":0.55000000000000004},"max":{"1min":1.169,"5min":1.2649999999999999,"15min":3.5750000000000002},"last":0.70899999999999996}]},{"osd":3,"last update":"Sat Jun 10 19:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.90400000000000003,"15min":0.89900000000000002},"min":{"1min":0.628,"5min":0.56200000000000006,"15min":0.53900000000000003},"max":{"1min":1.28,"5min":1.46,"15min":2.3809999999999998},"last":1.28},{"interface":"front","average":{"1min":1.028,"5min":0.95699999999999996,"15min":0.96499999999999997},"min":{"1min":0.71899999999999997,"5min":0.61499999999999999,"15min":0.54400000000000004},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.6479999999999999},"last":1.4279999999999999}]},{"osd":5,"last update":"Sat Jun 10 19:05:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":0.94499999999999995,"15min":0.96599999999999997},"min":{"1min":0.70399999999999996,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.236,"5min":1.3360000000000001,"15min":3.6539999999999999},"last":1.2070000000000001},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.92500000000000004,"15min":0.95099999999999996},"min":{"1min":0.65800000000000003,"5min":0.495,"15min":0.495},"max":{"1min":1.2250000000000001,"5min":1.26,"15min":2.6720000000000002},"last":0.93899999999999995}]},{"osd":6,"last update":"Sat Jun 10 19:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.97499999999999998,"15min":0.98099999999999998},"min":{"1min":0.60399999999999998,"5min":0.58499999999999996,"15min":0.54900000000000004},"max":{"1min":1.413,"5min":1.413,"15min":2.2639999999999998},"last":0.66300000000000003},{"interface":"front","average":{"1min":1.131,"5min":1.0649999999999999,"15min":1.071},"min":{"1min":0.753,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":3.4980000000000002},"last":1.4670000000000001}]},{"osd":7,"last update":"Sat Jun 10 19:05:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.0189999999999999,"15min":0.999},"min":{"1min":0.79100000000000004,"5min":0.63800000000000001,"15min":0.41399999999999998},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":2.5910000000000002},"last":1.3919999999999999},{"interface":"front","average":{"1min":1.105,"5min":1.0780000000000001,"15min":1.0720000000000001},"min":{"1min":0.79900000000000004,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.3420000000000001,"5min":1.4279999999999999,"15min":1.4399999999999999},"last":0.877}]}]},{"osd":3,"up_from":13,"seq":55834575001,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32576,"kb_used_data":1528,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339264,"statfs":{"total":96636764160,"available":96603406336,"internally_reserved":0,"allocated":1564672,"data_stored":720575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.623,"15min":0.61199999999999999},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.94299999999999995,"5min":1.1539999999999999,"15min":1.169},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.67500000000000004,"15min":0.66600000000000004},"min":{"1min":0.30599999999999999,"5min":0.30299999999999999,"15min":0.251},"max":{"1min":0.97799999999999998,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.68600000000000005}]},{"osd":1,"last update":"Sat Jun 10 19:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.69599999999999995,"15min":0.67800000000000005},"min":{"1min":0.39900000000000002,"5min":0.33000000000000002,"15min":0.27500000000000002},"max":{"1min":1.01,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.72999999999999998,"15min":0.73599999999999999},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.318},"max":{"1min":0.99299999999999999,"5min":1.2569999999999999,"15min":1.411},"last":0.59299999999999997}]},{"osd":2,"last update":"Sat Jun 10 19:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.76300000000000001,"15min":0.77300000000000002},"min":{"1min":0.439,"5min":0.39300000000000002,"15min":0.30299999999999999},"max":{"1min":1.0269999999999999,"5min":1.3899999999999999,"15min":1.9530000000000001},"last":0.873},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.80000000000000004,"15min":0.78500000000000003},"min":{"1min":0.36599999999999999,"5min":0.35299999999999998,"15min":0.29699999999999999},"max":{"1min":1.141,"5min":1.591,"15min":1.591},"last":0.82699999999999996}]},{"osd":4,"last update":"Sat Jun 10 19:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.96999999999999997,"15min":0.95799999999999996},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.41899999999999998},"max":{"1min":1.2969999999999999,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.0489999999999999,"5min":0.995,"15min":0.99399999999999999},"min":{"1min":0.72099999999999997,"5min":0.61299999999999999,"15min":0.47999999999999998},"max":{"1min":1.4330000000000001,"5min":1.873,"15min":1.873},"last":1.0229999999999999}]},{"osd":5,"last update":"Sat Jun 10 19:04:48 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.0089999999999999,"15min":1.024},"min":{"1min":0.71099999999999997,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.536,"5min":1.752,"15min":2.024},"last":0.93100000000000005},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.02,"15min":1.0289999999999999},"min":{"1min":0.64800000000000002,"5min":0.60299999999999998,"15min":0.46899999999999997},"max":{"1min":1.3759999999999999,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":1.099}]},{"osd":6,"last update":"Sat Jun 10 19:04:48 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0569999999999999,"15min":1.0609999999999999},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.55300000000000005},"max":{"1min":1.49,"5min":1.786,"15min":1.8500000000000001},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.68899999999999995,"5min":0.61199999999999999,"15min":0.58799999999999997},"max":{"1min":1.395,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.99199999999999999}]},{"osd":7,"last update":"Sat Jun 10 19:04:48 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.0800000000000001,"15min":1.0980000000000001},"min":{"1min":0.58199999999999996,"5min":0.57999999999999996,"15min":0.56999999999999995},"max":{"1min":1.5720000000000001,"5min":2.1150000000000002,"15min":2.1150000000000002},"last":1.0529999999999999},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.79400000000000004,"5min":0.65500000000000003,"15min":0.61099999999999999},"max":{"1min":1.6779999999999999,"5min":1.9850000000000001,"15min":1.9850000000000001},"last":1.0740000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575002,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32564,"kb_used_data":1516,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339276,"statfs":{"total":96636764160,"available":96603418624,"internally_reserved":0,"allocated":1552384,"data_stored":719996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:04:59 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.621,"15min":0.61299999999999999},"min":{"1min":0.33700000000000002,"5min":0.31,"15min":0.27300000000000002},"max":{"1min":0.98799999999999999,"5min":1.095,"15min":1.1220000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.71699999999999997,"15min":0.72199999999999998},"min":{"1min":0.34999999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.59299999999999997}]},{"osd":1,"last update":"Sat Jun 10 19:04:59 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.65900000000000003,"15min":0.66600000000000004},"min":{"1min":0.39600000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.1950000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.745,"15min":0.748},"min":{"1min":0.375,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.1799999999999999,"5min":1.446,"15min":1.446},"last":0.77600000000000002}]},{"osd":3,"last update":"Sat Jun 10 19:04:59 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.78200000000000003,"15min":0.76900000000000002},"min":{"1min":0.45700000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.127,"5min":1.1899999999999999,"15min":1.2350000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.75800000000000001,"15min":0.77200000000000002},"min":{"1min":0.41799999999999998,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":1.032,"5min":1.181,"15min":1.3340000000000001},"last":0.74099999999999999}]},{"osd":4,"last update":"Sat Jun 10 19:04:59 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.90800000000000003,"15min":0.92500000000000004},"min":{"1min":0.67600000000000005,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.337,"5min":1.337,"15min":1.3620000000000001},"last":3.996},{"interface":"front","average":{"1min":1.044,"5min":0.996,"15min":1.0169999999999999},"min":{"1min":0.59699999999999998,"5min":0.496,"15min":0.496},"max":{"1min":1.3149999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":1.0049999999999999}]},{"osd":5,"last update":"Sat Jun 10 19:04:59 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":0.997,"15min":1.0129999999999999},"min":{"1min":0.63400000000000001,"5min":0.55900000000000005,"15min":0.54100000000000004},"max":{"1min":1.3129999999999999,"5min":1.5429999999999999,"15min":1.5700000000000001},"last":6.569},{"interface":"front","average":{"1min":1.105,"5min":1.01,"15min":1.014},"min":{"1min":0.753,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.5309999999999999,"5min":1.5609999999999999,"15min":1.667},"last":6.6349999999999998}]},{"osd":6,"last update":"Sat Jun 10 19:04:59 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.03,"15min":1.044},"min":{"1min":0.77800000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.5900000000000001},"last":4.5640000000000001},{"interface":"front","average":{"1min":1.054,"5min":1.0309999999999999,"15min":1.0449999999999999},"min":{"1min":0.58499999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.341,"5min":1.486,"15min":1.6499999999999999},"last":1.766}]},{"osd":7,"last update":"Sat Jun 10 19:04:59 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.097,"15min":1.1000000000000001},"min":{"1min":0.70499999999999996,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.339,"5min":1.734,"15min":1.734},"last":12.138},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.101,"15min":1.109},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.48,"5min":1.657,"15min":1.752},"last":1.248}]}]},{"osd":1,"up_from":13,"seq":55834575004,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36660,"kb_used_data":1516,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335180,"statfs":{"total":96636764160,"available":96599224320,"internally_reserved":0,"allocated":1552384,"data_stored":718999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:04:59 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65800000000000003,"15min":0.67500000000000004},"min":{"1min":0.36399999999999999,"5min":0.28599999999999998,"15min":0.25800000000000001},"max":{"1min":1.048,"5min":1.111,"15min":1.288},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.72899999999999998,"15min":0.73999999999999999},"min":{"1min":0.35399999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.105,"5min":1.1859999999999999,"15min":1.694},"last":0.91400000000000003}]},{"osd":2,"last update":"Sat Jun 10 19:04:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.63400000000000001,"15min":0.63800000000000001},"min":{"1min":0.38200000000000001,"5min":0.308,"15min":0.249},"max":{"1min":0.84099999999999997,"5min":1.0900000000000001,"15min":1.21},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.70499999999999996,"15min":0.71399999999999997},"min":{"1min":0.433,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.415},"last":0.78500000000000003}]},{"osd":3,"last update":"Sat Jun 10 19:04:59 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.75900000000000001,"15min":0.77900000000000003},"min":{"1min":0.34000000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.034,"5min":1.1679999999999999,"15min":1.6299999999999999},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.754,"5min":0.70599999999999996,"15min":0.74099999999999999},"min":{"1min":0.45900000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.998,"5min":1.2909999999999999,"15min":2.1749999999999998},"last":0.73999999999999999}]},{"osd":4,"last update":"Sat Jun 10 19:04:59 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.85799999999999998,"15min":0.86199999999999999},"min":{"1min":0.627,"5min":0.56399999999999995,"15min":0.53000000000000003},"max":{"1min":1.196,"5min":1.343,"15min":1.4930000000000001},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.96099999999999997,"15min":1.038},"min":{"1min":0.63900000000000001,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.2010000000000001,"5min":1.492,"15min":5.8209999999999997},"last":1.3340000000000001}]},{"osd":5,"last update":"Sat Jun 10 19:04:59 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.97399999999999998,"15min":1.0029999999999999},"min":{"1min":0.66800000000000004,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.244,"5min":1.6299999999999999,"15min":1.8620000000000001},"last":1.1539999999999999},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.94999999999999996,"15min":0.97599999999999998},"min":{"1min":0.59999999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.2809999999999999,"5min":1.3220000000000001,"15min":3.089},"last":0.95299999999999996}]},{"osd":6,"last update":"Sat Jun 10 19:04:59 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.999,"15min":1.0489999999999999},"min":{"1min":0.71699999999999997,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.145,"5min":1.6759999999999999,"15min":7.2599999999999998},"last":1.2130000000000001},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.98999999999999999,"15min":1.0349999999999999},"min":{"1min":0.72899999999999998,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.341,"5min":1.6000000000000001,"15min":9.0069999999999997},"last":1.0389999999999999}]},{"osd":7,"last update":"Sat Jun 10 19:04:59 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.05,"15min":1.0820000000000001},"min":{"1min":0.69999999999999996,"5min":0.495,"15min":0.495},"max":{"1min":1.4339999999999999,"5min":1.494,"15min":2.105},"last":1.3999999999999999},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.046,"15min":1.0820000000000001},"min":{"1min":0.75700000000000001,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.4670000000000001,"5min":1.5620000000000001,"15min":2.2570000000000001},"last":1.3080000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575003,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37240,"kb_used_data":2096,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334600,"statfs":{"total":96636764160,"available":96598630400,"internally_reserved":0,"allocated":2146304,"data_stored":1309367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jun 10 19:04:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.61699999999999999,"15min":0.63},"min":{"1min":0.34100000000000003,"5min":0.248,"15min":0.248},"max":{"1min":1.042,"5min":1.127,"15min":1.127},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.78800000000000003,"15min":0.79800000000000004},"min":{"1min":0.38,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.093,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.47899999999999998}]},{"osd":2,"last update":"Sat Jun 10 19:04:58 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.71999999999999997,"15min":0.71599999999999997},"min":{"1min":0.38100000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.1970000000000001,"5min":1.2010000000000001,"15min":1.2829999999999999},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.64100000000000001,"15min":0.65300000000000002},"min":{"1min":0.28699999999999998,"5min":0.27600000000000002,"15min":0.245},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.371},"last":0.30199999999999999}]},{"osd":3,"last update":"Sat Jun 10 19:04:58 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.66000000000000003,"15min":0.68400000000000005},"min":{"1min":0.40100000000000002,"5min":0.29499999999999998,"15min":0.28899999999999998},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.226},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.80400000000000005,"15min":0.82399999999999995},"min":{"1min":0.435,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.321,"5min":1.742,"15min":1.829},"last":0.504}]},{"osd":4,"last update":"Sat Jun 10 19:04:58 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.90700000000000003,"15min":0.92000000000000004},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.1619999999999999,"5min":1.7250000000000001,"15min":3.0209999999999999},"last":0.65600000000000003},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.012,"15min":1.0289999999999999},"min":{"1min":0.69199999999999995,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.2270000000000001,"5min":1.873,"15min":1.9510000000000001},"last":0.58799999999999997}]},{"osd":5,"last update":"Sat Jun 10 19:04:58 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.91900000000000004,"15min":0.93999999999999995},"min":{"1min":0.624,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.206,"5min":1.3109999999999999,"15min":1.694},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.97799999999999998,"15min":1.008},"min":{"1min":0.71699999999999997,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.2749999999999999,"5min":1.78,"15min":4.5620000000000003},"last":0.60399999999999998}]},{"osd":6,"last update":"Sat Jun 10 19:04:58 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.042,"15min":1.077},"min":{"1min":0.58699999999999997,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.395,"5min":1.7909999999999999,"15min":3.5569999999999999},"last":0.628},{"interface":"front","average":{"1min":1.0109999999999999,"5min":0.98799999999999999,"15min":1.002},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.3049999999999999,"5min":1.6319999999999999,"15min":1.883},"last":0.71099999999999997}]},{"osd":7,"last update":"Sat Jun 10 19:04:58 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.0129999999999999,"15min":1.032},"min":{"1min":0.57299999999999995,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.2250000000000001,"5min":1.512,"15min":1.5800000000000001},"last":0.61799999999999999},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.036,"15min":1.0580000000000001},"min":{"1min":0.80600000000000005,"5min":0.624,"15min":0.58699999999999997},"max":{"1min":1.298,"5min":1.6619999999999999,"15min":1.9830000000000001},"last":0.67700000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-10T19:05:08.070 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-10T19:05:08.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.224+0000 7f262cb44640 1 Processor -- start 2023-06-10T19:05:08.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.224+0000 7f262cb44640 1 -- start start 2023-06-10T19:05:08.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.224+0000 7f262cb44640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f26280c9840 0x7f26280c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:08.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.224+0000 7f262cb44640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2628071060 0x7f26280af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:08.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.224+0000 7f262cb44640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f26280afc60 0x7f262815d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:08.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.224+0000 7f262cb44640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2628159b50 con 0x7f26280afc60 2023-06-10T19:05:08.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.224+0000 7f262cb44640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26280ca150 con 0x7f26280c9840 2023-06-10T19:05:08.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.224+0000 7f262cb44640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26280702a0 con 0x7f2628071060 2023-06-10T19:05:08.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.224+0000 7f2626d9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f26280afc60 0x7f262815d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:08.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.224+0000 7f2626d9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f26280afc60 0x7f262815d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60160/0 (socket says 172.21.15.53:60160) 2023-06-10T19:05:08.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.224+0000 7f2626d9d640 1 -- 172.21.15.53:0/2570267010 learned_addr learned my addr 172.21.15.53:0/2570267010 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:08.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.224+0000 7f262659c640 1 --2- 172.21.15.53:0/2570267010 >> v2:172.21.15.117:3300/0 conn(0x7f26280c9840 0x7f26280c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:08.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.224+0000 7f2625d9b640 1 --2- 172.21.15.53:0/2570267010 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2628071060 0x7f26280af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:08.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.224+0000 7f2626d9d640 1 -- 172.21.15.53:0/2570267010 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2628071060 msgr2=0x7f26280af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:08.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.224+0000 7f2626d9d640 1 --2- 172.21.15.53:0/2570267010 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2628071060 0x7f26280af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:08.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.224+0000 7f2626d9d640 1 -- 172.21.15.53:0/2570267010 >> v2:172.21.15.117:3300/0 conn(0x7f26280c9840 msgr2=0x7f26280c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:08.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.224+0000 7f2626d9d640 1 --2- 172.21.15.53:0/2570267010 >> v2:172.21.15.117:3300/0 conn(0x7f26280c9840 0x7f26280c9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:08.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.224+0000 7f2626d9d640 1 -- 172.21.15.53:0/2570267010 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2628070580 con 0x7f26280afc60 2023-06-10T19:05:08.232 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.228+0000 7f2626d9d640 1 --2- 172.21.15.53:0/2570267010 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f26280afc60 0x7f262815d2c0 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7f2628071d80 tx=0x7f262001c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73317f662081c3e3 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:08.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.228+0000 7f262559a640 1 -- 172.21.15.53:0/2570267010 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26200a5560 con 0x7f26280afc60 2023-06-10T19:05:08.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.228+0000 7f262559a640 1 -- 172.21.15.53:0/2570267010 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26200a56c0 con 0x7f26280afc60 2023-06-10T19:05:08.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.228+0000 7f262559a640 1 -- 172.21.15.53:0/2570267010 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26200a5a50 con 0x7f26280afc60 2023-06-10T19:05:08.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.228+0000 7f262cb44640 1 -- 172.21.15.53:0/2570267010 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f26280afc60 msgr2=0x7f262815d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:08.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.228+0000 7f262cb44640 1 --2- 172.21.15.53:0/2570267010 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f26280afc60 0x7f262815d2c0 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7f2628071d80 tx=0x7f262001c6e0 comp rx=0 tx=0).stop 2023-06-10T19:05:08.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.228+0000 7f262cb44640 1 -- 172.21.15.53:0/2570267010 shutdown_connections 2023-06-10T19:05:08.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.228+0000 7f262cb44640 1 --2- 172.21.15.53:0/2570267010 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f26280afc60 0x7f262815d2c0 unknown :-1 s=CLOSED pgs=1889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:08.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.228+0000 7f262cb44640 1 --2- 172.21.15.53:0/2570267010 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2628071060 0x7f26280af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:08.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.228+0000 7f262cb44640 1 --2- 172.21.15.53:0/2570267010 >> v2:172.21.15.117:3300/0 conn(0x7f26280c9840 0x7f26280c9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:08.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.228+0000 7f262cb44640 1 -- 172.21.15.53:0/2570267010 >> 172.21.15.53:0/2570267010 conn(0x7f262806a0d0 msgr2=0x7f26280ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:08.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.228+0000 7f262cb44640 1 -- 172.21.15.53:0/2570267010 shutdown_connections 2023-06-10T19:05:08.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.228+0000 7f262cb44640 1 -- 172.21.15.53:0/2570267010 wait complete. 2023-06-10T19:05:08.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.228+0000 7f262cb44640 1 Processor -- start 2023-06-10T19:05:08.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.228+0000 7f262cb44640 1 -- start start 2023-06-10T19:05:08.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.228+0000 7f262cb44640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2628071060 0x7f262815ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:08.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.228+0000 7f262cb44640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26280afc60 0x7f26280adef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:08.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.228+0000 7f262cb44640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26280c9840 0x7f26280ae430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:08.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.228+0000 7f262cb44640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f262815c2d0 con 0x7f2628071060 2023-06-10T19:05:08.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.228+0000 7f262cb44640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f262815b650 con 0x7f26280c9840 2023-06-10T19:05:08.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.228+0000 7f262cb44640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f262815b930 con 0x7f26280afc60 2023-06-10T19:05:08.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.228+0000 7f262659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2628071060 0x7f262815ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:08.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.228+0000 7f262659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2628071060 0x7f262815ad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60164/0 (socket says 172.21.15.53:60164) 2023-06-10T19:05:08.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.228+0000 7f262659c640 1 -- 172.21.15.53:0/3569679330 learned_addr learned my addr 172.21.15.53:0/3569679330 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:08.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.228+0000 7f2625d9b640 1 --2- 172.21.15.53:0/3569679330 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26280afc60 0x7f26280adef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:08.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.228+0000 7f2626d9d640 1 --2- 172.21.15.53:0/3569679330 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26280c9840 0x7f26280ae430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:08.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.232+0000 7f262659c640 1 -- 172.21.15.53:0/3569679330 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26280afc60 msgr2=0x7f26280adef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:08.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.232+0000 7f262659c640 1 --2- 172.21.15.53:0/3569679330 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26280afc60 0x7f26280adef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:08.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.232+0000 7f262659c640 1 -- 172.21.15.53:0/3569679330 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26280c9840 msgr2=0x7f26280ae430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:08.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.232+0000 7f262659c640 1 --2- 172.21.15.53:0/3569679330 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26280c9840 0x7f26280ae430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:08.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.232+0000 7f262659c640 1 -- 172.21.15.53:0/3569679330 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2620009b30 con 0x7f2628071060 2023-06-10T19:05:08.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.232+0000 7f2625d9b640 1 --2- 172.21.15.53:0/3569679330 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26280afc60 0x7f26280adef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:05:08.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.232+0000 7f2626d9d640 1 --2- 172.21.15.53:0/3569679330 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26280c9840 0x7f26280ae430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:05:08.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.232+0000 7f262659c640 1 --2- 172.21.15.53:0/3569679330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2628071060 0x7f262815ad20 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7f261800d5f0 tx=0x7f261800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:08.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.232+0000 7f2616ffd640 1 -- 172.21.15.53:0/3569679330 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26180125f0 con 0x7f2628071060 2023-06-10T19:05:08.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.232+0000 7f2616ffd640 1 -- 172.21.15.53:0/3569679330 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2618012750 con 0x7f2628071060 2023-06-10T19:05:08.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.232+0000 7f262cb44640 1 -- 172.21.15.53:0/3569679330 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f262815bc10 con 0x7f2628071060 2023-06-10T19:05:08.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.232+0000 7f2616ffd640 1 -- 172.21.15.53:0/3569679330 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2618012ae0 con 0x7f2628071060 2023-06-10T19:05:08.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.232+0000 7f262cb44640 1 -- 172.21.15.53:0/3569679330 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f262815b260 con 0x7f2628071060 2023-06-10T19:05:08.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.232+0000 7f262cb44640 1 -- 172.21.15.53:0/3569679330 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f262806b010 con 0x7f2628071060 2023-06-10T19:05:08.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.232+0000 7f2616ffd640 1 -- 172.21.15.53:0/3569679330 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2618012c40 con 0x7f2628071060 2023-06-10T19:05:08.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.232+0000 7f2616ffd640 1 --2- 172.21.15.53:0/3569679330 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2608066280 0x7f2608068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:08.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.232+0000 7f2616ffd640 1 -- 172.21.15.53:0/3569679330 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2618084220 con 0x7f2628071060 2023-06-10T19:05:08.243 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.232+0000 7f2625d9b640 1 --2- 172.21.15.53:0/3569679330 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2608066280 0x7f2608068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:08.243 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.232+0000 7f2625d9b640 1 --2- 172.21.15.53:0/3569679330 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2608066280 0x7f2608068730 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f262813e960 tx=0x7f261c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:08.244 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.236+0000 7f2616ffd640 1 -- 172.21.15.53:0/3569679330 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f26180516a0 con 0x7f2628071060 2023-06-10T19:05:08.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.388+0000 7f262cb44640 1 -- 172.21.15.53:0/3569679330 --> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f262815aba0 con 0x7f2608066280 2023-06-10T19:05:08.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.412+0000 7f2616ffd640 1 -- 172.21.15.53:0/3569679330 <== mgr.4105 v2:172.21.15.117:6832/3061986771 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310134 (secure 0 0 0) 0x7f261c009d70 con 0x7f2608066280 2023-06-10T19:05:08.416 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:05:08.419 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-06-10T19:05:08.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.416+0000 7f262cb44640 1 -- 172.21.15.53:0/3569679330 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2608066280 msgr2=0x7f2608068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:08.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.416+0000 7f262cb44640 1 --2- 172.21.15.53:0/3569679330 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2608066280 0x7f2608068730 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f262813e960 tx=0x7f261c008040 comp rx=0 tx=0).stop 2023-06-10T19:05:08.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.416+0000 7f262cb44640 1 -- 172.21.15.53:0/3569679330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2628071060 msgr2=0x7f262815ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:08.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.416+0000 7f262cb44640 1 --2- 172.21.15.53:0/3569679330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2628071060 0x7f262815ad20 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7f261800d5f0 tx=0x7f261800dab0 comp rx=0 tx=0).stop 2023-06-10T19:05:08.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.416+0000 7f262cb44640 1 -- 172.21.15.53:0/3569679330 shutdown_connections 2023-06-10T19:05:08.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.416+0000 7f262cb44640 1 --2- 172.21.15.53:0/3569679330 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2608066280 0x7f2608068730 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:08.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.416+0000 7f262cb44640 1 --2- 172.21.15.53:0/3569679330 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26280c9840 0x7f26280ae430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:08.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.416+0000 7f262cb44640 1 --2- 172.21.15.53:0/3569679330 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f26280afc60 0x7f26280adef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:08.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.416+0000 7f262cb44640 1 --2- 172.21.15.53:0/3569679330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2628071060 0x7f262815ad20 secure :-1 s=CLOSED pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7f261800d5f0 tx=0x7f261800dab0 comp rx=0 tx=0).stop 2023-06-10T19:05:08.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.416+0000 7f262cb44640 1 -- 172.21.15.53:0/3569679330 >> 172.21.15.53:0/3569679330 conn(0x7f262806a0d0 msgr2=0x7f2628159c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:08.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.416+0000 7f262cb44640 1 -- 172.21.15.53:0/3569679330 shutdown_connections 2023-06-10T19:05:08.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.416+0000 7f262cb44640 1 -- 172.21.15.53:0/3569679330 wait complete. 2023-06-10T19:05:08.437 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":496,"stamp":"2023-06-10T19:05:07.828318+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":120,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":269916,"kb_used_data":13340,"kb_used_omap":0,"kb_used_meta":256512,"kb_avail":754704804,"statfs":{"total":773094113280,"available":772817719296,"internally_reserved":0,"allocated":13660160,"data_stored":6942371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":262668288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":56,"apply_latency_ms":56,"commit_latency_ns":56000000,"apply_latency_ns":56000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.343329"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:05.903700+0000","last_change":"2023-06-10T19:05:04.896591+0000","last_active":"2023-06-10T19:05:05.903700+0000","last_peered":"2023-06-10T19:05:05.903700+0000","last_clean":"2023-06-10T19:05:05.903700+0000","last_became_active":"2023-06-10T19:05:04.895587+0000","last_became_peered":"2023-06-10T19:05:04.895587+0000","last_unstale":"2023-06-10T19:05:05.903700+0000","last_undegraded":"2023-06-10T19:05:05.903700+0000","last_fullsized":"2023-06-10T19:05:05.903700+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:07:01.013738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.329374+0000","last_change":"2023-06-10T19:05:04.949482+0000","last_active":"2023-06-10T19:05:06.329374+0000","last_peered":"2023-06-10T19:05:06.329374+0000","last_clean":"2023-06-10T19:05:06.329374+0000","last_became_active":"2023-06-10T19:05:04.949128+0000","last_became_peered":"2023-06-10T19:05:04.949128+0000","last_unstale":"2023-06-10T19:05:06.329374+0000","last_undegraded":"2023-06-10T19:05:06.329374+0000","last_fullsized":"2023-06-10T19:05:06.329374+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:29:41.921077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.329471+0000","last_change":"2023-06-10T19:05:04.937061+0000","last_active":"2023-06-10T19:05:06.329471+0000","last_peered":"2023-06-10T19:05:06.329471+0000","last_clean":"2023-06-10T19:05:06.329471+0000","last_became_active":"2023-06-10T19:05:04.936760+0000","last_became_peered":"2023-06-10T19:05:04.936760+0000","last_unstale":"2023-06-10T19:05:06.329471+0000","last_undegraded":"2023-06-10T19:05:06.329471+0000","last_fullsized":"2023-06-10T19:05:06.329471+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:48:56.236233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.330050+0000","last_change":"2023-06-10T19:05:04.951289+0000","last_active":"2023-06-10T19:05:06.330050+0000","last_peered":"2023-06-10T19:05:06.330050+0000","last_clean":"2023-06-10T19:05:06.330050+0000","last_became_active":"2023-06-10T19:05:04.950541+0000","last_became_peered":"2023-06-10T19:05:04.950541+0000","last_unstale":"2023-06-10T19:05:06.330050+0000","last_undegraded":"2023-06-10T19:05:06.330050+0000","last_fullsized":"2023-06-10T19:05:06.330050+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:15:20.539316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:05.903006+0000","last_change":"2023-06-10T19:05:04.919037+0000","last_active":"2023-06-10T19:05:05.903006+0000","last_peered":"2023-06-10T19:05:05.903006+0000","last_clean":"2023-06-10T19:05:05.903006+0000","last_became_active":"2023-06-10T19:05:04.918273+0000","last_became_peered":"2023-06-10T19:05:04.918273+0000","last_unstale":"2023-06-10T19:05:05.903006+0000","last_undegraded":"2023-06-10T19:05:05.903006+0000","last_fullsized":"2023-06-10T19:05:05.903006+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:09:17.733733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:05.895844+0000","last_change":"2023-06-10T19:05:04.911695+0000","last_active":"2023-06-10T19:05:05.895844+0000","last_peered":"2023-06-10T19:05:05.895844+0000","last_clean":"2023-06-10T19:05:05.895844+0000","last_became_active":"2023-06-10T19:05:04.911147+0000","last_became_peered":"2023-06-10T19:05:04.911147+0000","last_unstale":"2023-06-10T19:05:05.895844+0000","last_undegraded":"2023-06-10T19:05:05.895844+0000","last_fullsized":"2023-06-10T19:05:05.895844+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:46:10.116702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:05.895242+0000","last_change":"2023-06-10T19:05:04.949268+0000","last_active":"2023-06-10T19:05:05.895242+0000","last_peered":"2023-06-10T19:05:05.895242+0000","last_clean":"2023-06-10T19:05:05.895242+0000","last_became_active":"2023-06-10T19:05:04.948981+0000","last_became_peered":"2023-06-10T19:05:04.948981+0000","last_unstale":"2023-06-10T19:05:05.895242+0000","last_undegraded":"2023-06-10T19:05:05.895242+0000","last_fullsized":"2023-06-10T19:05:05.895242+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:57:58.445340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.328330+0000","last_change":"2023-06-10T19:05:04.932394+0000","last_active":"2023-06-10T19:05:06.328330+0000","last_peered":"2023-06-10T19:05:06.328330+0000","last_clean":"2023-06-10T19:05:06.328330+0000","last_became_active":"2023-06-10T19:05:04.932077+0000","last_became_peered":"2023-06-10T19:05:04.932077+0000","last_unstale":"2023-06-10T19:05:06.328330+0000","last_undegraded":"2023-06-10T19:05:06.328330+0000","last_fullsized":"2023-06-10T19:05:06.328330+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:20:51.932148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.331150+0000","last_change":"2023-06-10T19:05:04.953949+0000","last_active":"2023-06-10T19:05:06.331150+0000","last_peered":"2023-06-10T19:05:06.331150+0000","last_clean":"2023-06-10T19:05:06.331150+0000","last_became_active":"2023-06-10T19:05:04.951300+0000","last_became_peered":"2023-06-10T19:05:04.951300+0000","last_unstale":"2023-06-10T19:05:06.331150+0000","last_undegraded":"2023-06-10T19:05:06.331150+0000","last_fullsized":"2023-06-10T19:05:06.331150+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:05:52.858691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.331715+0000","last_change":"2023-06-10T19:05:04.905572+0000","last_active":"2023-06-10T19:05:06.331715+0000","last_peered":"2023-06-10T19:05:06.331715+0000","last_clean":"2023-06-10T19:05:06.331715+0000","last_became_active":"2023-06-10T19:05:04.905259+0000","last_became_peered":"2023-06-10T19:05:04.905259+0000","last_unstale":"2023-06-10T19:05:06.331715+0000","last_undegraded":"2023-06-10T19:05:06.331715+0000","last_fullsized":"2023-06-10T19:05:06.331715+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:07:55.397266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:05.903531+0000","last_change":"2023-06-10T19:05:04.945264+0000","last_active":"2023-06-10T19:05:05.903531+0000","last_peered":"2023-06-10T19:05:05.903531+0000","last_clean":"2023-06-10T19:05:05.903531+0000","last_became_active":"2023-06-10T19:05:04.944533+0000","last_became_peered":"2023-06-10T19:05:04.944533+0000","last_unstale":"2023-06-10T19:05:05.903531+0000","last_undegraded":"2023-06-10T19:05:05.903531+0000","last_fullsized":"2023-06-10T19:05:05.903531+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:27:28.528097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:05.895768+0000","last_change":"2023-06-10T19:05:04.921844+0000","last_active":"2023-06-10T19:05:05.895768+0000","last_peered":"2023-06-10T19:05:05.895768+0000","last_clean":"2023-06-10T19:05:05.895768+0000","last_became_active":"2023-06-10T19:05:04.921396+0000","last_became_peered":"2023-06-10T19:05:04.921396+0000","last_unstale":"2023-06-10T19:05:05.895768+0000","last_undegraded":"2023-06-10T19:05:05.895768+0000","last_fullsized":"2023-06-10T19:05:05.895768+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:38:10.586306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.331337+0000","last_change":"2023-06-10T19:05:04.936509+0000","last_active":"2023-06-10T19:05:06.331337+0000","last_peered":"2023-06-10T19:05:06.331337+0000","last_clean":"2023-06-10T19:05:06.331337+0000","last_became_active":"2023-06-10T19:05:04.936168+0000","last_became_peered":"2023-06-10T19:05:04.936168+0000","last_unstale":"2023-06-10T19:05:06.331337+0000","last_undegraded":"2023-06-10T19:05:06.331337+0000","last_fullsized":"2023-06-10T19:05:06.331337+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:03:29.229444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.329425+0000","last_change":"2023-06-10T19:05:04.934311+0000","last_active":"2023-06-10T19:05:06.329425+0000","last_peered":"2023-06-10T19:05:06.329425+0000","last_clean":"2023-06-10T19:05:06.329425+0000","last_became_active":"2023-06-10T19:05:04.934083+0000","last_became_peered":"2023-06-10T19:05:04.934083+0000","last_unstale":"2023-06-10T19:05:06.329425+0000","last_undegraded":"2023-06-10T19:05:06.329425+0000","last_fullsized":"2023-06-10T19:05:06.329425+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:37:58.983109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:05.900716+0000","last_change":"2023-06-10T19:05:04.932147+0000","last_active":"2023-06-10T19:05:05.900716+0000","last_peered":"2023-06-10T19:05:05.900716+0000","last_clean":"2023-06-10T19:05:05.900716+0000","last_became_active":"2023-06-10T19:05:04.931323+0000","last_became_peered":"2023-06-10T19:05:04.931323+0000","last_unstale":"2023-06-10T19:05:05.900716+0000","last_undegraded":"2023-06-10T19:05:05.900716+0000","last_fullsized":"2023-06-10T19:05:05.900716+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:39:17.376928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:05.895182+0000","last_change":"2023-06-10T19:05:04.910119+0000","last_active":"2023-06-10T19:05:05.895182+0000","last_peered":"2023-06-10T19:05:05.895182+0000","last_clean":"2023-06-10T19:05:05.895182+0000","last_became_active":"2023-06-10T19:05:04.909622+0000","last_became_peered":"2023-06-10T19:05:04.909622+0000","last_unstale":"2023-06-10T19:05:05.895182+0000","last_undegraded":"2023-06-10T19:05:05.895182+0000","last_fullsized":"2023-06-10T19:05:05.895182+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:14:33.713196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.331835+0000","last_change":"2023-06-10T19:05:04.943819+0000","last_active":"2023-06-10T19:05:06.331835+0000","last_peered":"2023-06-10T19:05:06.331835+0000","last_clean":"2023-06-10T19:05:06.331835+0000","last_became_active":"2023-06-10T19:05:04.943477+0000","last_became_peered":"2023-06-10T19:05:04.943477+0000","last_unstale":"2023-06-10T19:05:06.331835+0000","last_undegraded":"2023-06-10T19:05:06.331835+0000","last_fullsized":"2023-06-10T19:05:06.331835+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:23:36.570169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.329645+0000","last_change":"2023-06-10T19:05:04.949392+0000","last_active":"2023-06-10T19:05:06.329645+0000","last_peered":"2023-06-10T19:05:06.329645+0000","last_clean":"2023-06-10T19:05:06.329645+0000","last_became_active":"2023-06-10T19:05:04.949087+0000","last_became_peered":"2023-06-10T19:05:04.949087+0000","last_unstale":"2023-06-10T19:05:06.329645+0000","last_undegraded":"2023-06-10T19:05:06.329645+0000","last_fullsized":"2023-06-10T19:05:06.329645+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:13:00.888112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:05.901068+0000","last_change":"2023-06-10T19:05:04.951804+0000","last_active":"2023-06-10T19:05:05.901068+0000","last_peered":"2023-06-10T19:05:05.901068+0000","last_clean":"2023-06-10T19:05:05.901068+0000","last_became_active":"2023-06-10T19:05:04.951149+0000","last_became_peered":"2023-06-10T19:05:04.951149+0000","last_unstale":"2023-06-10T19:05:05.901068+0000","last_undegraded":"2023-06-10T19:05:05.901068+0000","last_fullsized":"2023-06-10T19:05:05.901068+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:48:28.308531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.327341+0000","last_change":"2023-06-10T19:05:04.905874+0000","last_active":"2023-06-10T19:05:06.327341+0000","last_peered":"2023-06-10T19:05:06.327341+0000","last_clean":"2023-06-10T19:05:06.327341+0000","last_became_active":"2023-06-10T19:05:04.905565+0000","last_became_peered":"2023-06-10T19:05:04.905565+0000","last_unstale":"2023-06-10T19:05:06.327341+0000","last_undegraded":"2023-06-10T19:05:06.327341+0000","last_fullsized":"2023-06-10T19:05:06.327341+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:40:48.377702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.330001+0000","last_change":"2023-06-10T19:05:04.950808+0000","last_active":"2023-06-10T19:05:06.330001+0000","last_peered":"2023-06-10T19:05:06.330001+0000","last_clean":"2023-06-10T19:05:06.330001+0000","last_became_active":"2023-06-10T19:05:04.950354+0000","last_became_peered":"2023-06-10T19:05:04.950354+0000","last_unstale":"2023-06-10T19:05:06.330001+0000","last_undegraded":"2023-06-10T19:05:06.330001+0000","last_fullsized":"2023-06-10T19:05:06.330001+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:51:42.574350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:05.903017+0000","last_change":"2023-06-10T19:05:04.913882+0000","last_active":"2023-06-10T19:05:05.903017+0000","last_peered":"2023-06-10T19:05:05.903017+0000","last_clean":"2023-06-10T19:05:05.903017+0000","last_became_active":"2023-06-10T19:05:04.913114+0000","last_became_peered":"2023-06-10T19:05:04.913114+0000","last_unstale":"2023-06-10T19:05:05.903017+0000","last_undegraded":"2023-06-10T19:05:05.903017+0000","last_fullsized":"2023-06-10T19:05:05.903017+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:19:19.506886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.330193+0000","last_change":"2023-06-10T19:05:04.953671+0000","last_active":"2023-06-10T19:05:06.330193+0000","last_peered":"2023-06-10T19:05:06.330193+0000","last_clean":"2023-06-10T19:05:06.330193+0000","last_became_active":"2023-06-10T19:05:04.953000+0000","last_became_peered":"2023-06-10T19:05:04.953000+0000","last_unstale":"2023-06-10T19:05:06.330193+0000","last_undegraded":"2023-06-10T19:05:06.330193+0000","last_fullsized":"2023-06-10T19:05:06.330193+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:18:59.129858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.328976+0000","last_change":"2023-06-10T19:05:04.944524+0000","last_active":"2023-06-10T19:05:06.328976+0000","last_peered":"2023-06-10T19:05:06.328976+0000","last_clean":"2023-06-10T19:05:06.328976+0000","last_became_active":"2023-06-10T19:05:04.942705+0000","last_became_peered":"2023-06-10T19:05:04.942705+0000","last_unstale":"2023-06-10T19:05:06.328976+0000","last_undegraded":"2023-06-10T19:05:06.328976+0000","last_fullsized":"2023-06-10T19:05:06.328976+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:30:14.500942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.331899+0000","last_change":"2023-06-10T19:05:04.944042+0000","last_active":"2023-06-10T19:05:06.331899+0000","last_peered":"2023-06-10T19:05:06.331899+0000","last_clean":"2023-06-10T19:05:06.331899+0000","last_became_active":"2023-06-10T19:05:04.943425+0000","last_became_peered":"2023-06-10T19:05:04.943425+0000","last_unstale":"2023-06-10T19:05:06.331899+0000","last_undegraded":"2023-06-10T19:05:06.331899+0000","last_fullsized":"2023-06-10T19:05:06.331899+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:23:36.570169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.327583+0000","last_change":"2023-06-10T19:05:04.892024+0000","last_active":"2023-06-10T19:05:06.327583+0000","last_peered":"2023-06-10T19:05:06.327583+0000","last_clean":"2023-06-10T19:05:06.327583+0000","last_became_active":"2023-06-10T19:05:04.891778+0000","last_became_peered":"2023-06-10T19:05:04.891778+0000","last_unstale":"2023-06-10T19:05:06.327583+0000","last_undegraded":"2023-06-10T19:05:06.327583+0000","last_fullsized":"2023-06-10T19:05:06.327583+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:35:47.511061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:05.901366+0000","last_change":"2023-06-10T19:05:04.952353+0000","last_active":"2023-06-10T19:05:05.901366+0000","last_peered":"2023-06-10T19:05:05.901366+0000","last_clean":"2023-06-10T19:05:05.901366+0000","last_became_active":"2023-06-10T19:05:04.951678+0000","last_became_peered":"2023-06-10T19:05:04.951678+0000","last_unstale":"2023-06-10T19:05:05.901366+0000","last_undegraded":"2023-06-10T19:05:05.901366+0000","last_fullsized":"2023-06-10T19:05:05.901366+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:30:46.918056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:05.895943+0000","last_change":"2023-06-10T19:05:04.944222+0000","last_active":"2023-06-10T19:05:05.895943+0000","last_peered":"2023-06-10T19:05:05.895943+0000","last_clean":"2023-06-10T19:05:05.895943+0000","last_became_active":"2023-06-10T19:05:04.943939+0000","last_became_peered":"2023-06-10T19:05:04.943939+0000","last_unstale":"2023-06-10T19:05:05.895943+0000","last_undegraded":"2023-06-10T19:05:05.895943+0000","last_fullsized":"2023-06-10T19:05:05.895943+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:58:45.365001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.327736+0000","last_change":"2023-06-10T19:05:04.901519+0000","last_active":"2023-06-10T19:05:06.327736+0000","last_peered":"2023-06-10T19:05:06.327736+0000","last_clean":"2023-06-10T19:05:06.327736+0000","last_became_active":"2023-06-10T19:05:04.899362+0000","last_became_peered":"2023-06-10T19:05:04.899362+0000","last_unstale":"2023-06-10T19:05:06.327736+0000","last_undegraded":"2023-06-10T19:05:06.327736+0000","last_fullsized":"2023-06-10T19:05:06.327736+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:27:28.422611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.329776+0000","last_change":"2023-06-10T19:05:04.914260+0000","last_active":"2023-06-10T19:05:06.329776+0000","last_peered":"2023-06-10T19:05:06.329776+0000","last_clean":"2023-06-10T19:05:06.329776+0000","last_became_active":"2023-06-10T19:05:04.913964+0000","last_became_peered":"2023-06-10T19:05:04.913964+0000","last_unstale":"2023-06-10T19:05:06.329776+0000","last_undegraded":"2023-06-10T19:05:06.329776+0000","last_fullsized":"2023-06-10T19:05:06.329776+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:32:16.784415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.329386+0000","last_change":"2023-06-10T19:05:04.928470+0000","last_active":"2023-06-10T19:05:06.329386+0000","last_peered":"2023-06-10T19:05:06.329386+0000","last_clean":"2023-06-10T19:05:06.329386+0000","last_became_active":"2023-06-10T19:05:04.927666+0000","last_became_peered":"2023-06-10T19:05:04.927666+0000","last_unstale":"2023-06-10T19:05:06.329386+0000","last_undegraded":"2023-06-10T19:05:06.329386+0000","last_fullsized":"2023-06-10T19:05:06.329386+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:29:18.338259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.329001+0000","last_change":"2023-06-10T19:05:04.942794+0000","last_active":"2023-06-10T19:05:06.329001+0000","last_peered":"2023-06-10T19:05:06.329001+0000","last_clean":"2023-06-10T19:05:06.329001+0000","last_became_active":"2023-06-10T19:05:04.940627+0000","last_became_peered":"2023-06-10T19:05:04.940627+0000","last_unstale":"2023-06-10T19:05:06.329001+0000","last_undegraded":"2023-06-10T19:05:06.329001+0000","last_fullsized":"2023-06-10T19:05:06.329001+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:49:51.070715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.331869+0000","last_change":"2023-06-10T19:05:04.905581+0000","last_active":"2023-06-10T19:05:06.331869+0000","last_peered":"2023-06-10T19:05:06.331869+0000","last_clean":"2023-06-10T19:05:06.331869+0000","last_became_active":"2023-06-10T19:05:04.905168+0000","last_became_peered":"2023-06-10T19:05:04.905168+0000","last_unstale":"2023-06-10T19:05:06.331869+0000","last_undegraded":"2023-06-10T19:05:06.331869+0000","last_fullsized":"2023-06-10T19:05:06.331869+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:50:37.357501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"124'4","reported_seq":17,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:05.900736+0000","last_change":"2023-06-10T19:05:04.550549+0000","last_active":"2023-06-10T19:05:05.900736+0000","last_peered":"2023-06-10T19:05:05.900736+0000","last_clean":"2023-06-10T19:05:05.900736+0000","last_became_active":"2023-06-10T19:05:04.549987+0000","last_became_peered":"2023-06-10T19:05:04.549987+0000","last_unstale":"2023-06-10T19:05:05.900736+0000","last_undegraded":"2023-06-10T19:05:05.900736+0000","last_fullsized":"2023-06-10T19:05:05.900736+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_clean_scrub_stamp":"2023-06-10T19:05:03.469282+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:04:09.577735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:05.896209+0000","last_change":"2023-06-10T19:05:04.911774+0000","last_active":"2023-06-10T19:05:05.896209+0000","last_peered":"2023-06-10T19:05:05.896209+0000","last_clean":"2023-06-10T19:05:05.896209+0000","last_became_active":"2023-06-10T19:05:04.911068+0000","last_became_peered":"2023-06-10T19:05:04.911068+0000","last_unstale":"2023-06-10T19:05:05.896209+0000","last_undegraded":"2023-06-10T19:05:05.896209+0000","last_fullsized":"2023-06-10T19:05:05.896209+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:32:00.287790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"124'1","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.332068+0000","last_change":"2023-06-10T19:05:04.526627+0000","last_active":"2023-06-10T19:05:06.332068+0000","last_peered":"2023-06-10T19:05:06.332068+0000","last_clean":"2023-06-10T19:05:06.332068+0000","last_became_active":"2023-06-10T19:05:04.525988+0000","last_became_peered":"2023-06-10T19:05:04.525988+0000","last_unstale":"2023-06-10T19:05:06.332068+0000","last_undegraded":"2023-06-10T19:05:06.332068+0000","last_fullsized":"2023-06-10T19:05:06.332068+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_clean_scrub_stamp":"2023-06-10T19:05:03.469282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:07:29.080750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.331392+0000","last_change":"2023-06-10T19:05:04.928328+0000","last_active":"2023-06-10T19:05:06.331392+0000","last_peered":"2023-06-10T19:05:06.331392+0000","last_clean":"2023-06-10T19:05:06.331392+0000","last_became_active":"2023-06-10T19:05:04.927714+0000","last_became_peered":"2023-06-10T19:05:04.927714+0000","last_unstale":"2023-06-10T19:05:06.331392+0000","last_undegraded":"2023-06-10T19:05:06.331392+0000","last_fullsized":"2023-06-10T19:05:06.331392+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:24:46.918015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"124'2","reported_seq":15,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.330881+0000","last_change":"2023-06-10T19:05:04.547263+0000","last_active":"2023-06-10T19:05:06.330881+0000","last_peered":"2023-06-10T19:05:06.330881+0000","last_clean":"2023-06-10T19:05:06.330881+0000","last_became_active":"2023-06-10T19:05:04.546573+0000","last_became_peered":"2023-06-10T19:05:04.546573+0000","last_unstale":"2023-06-10T19:05:06.330881+0000","last_undegraded":"2023-06-10T19:05:06.330881+0000","last_fullsized":"2023-06-10T19:05:06.330881+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_clean_scrub_stamp":"2023-06-10T19:05:03.469282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:06:15.650971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.331324+0000","last_change":"2023-06-10T19:05:04.951090+0000","last_active":"2023-06-10T19:05:06.331324+0000","last_peered":"2023-06-10T19:05:06.331324+0000","last_clean":"2023-06-10T19:05:06.331324+0000","last_became_active":"2023-06-10T19:05:04.950647+0000","last_became_peered":"2023-06-10T19:05:04.950647+0000","last_unstale":"2023-06-10T19:05:06.331324+0000","last_undegraded":"2023-06-10T19:05:06.331324+0000","last_fullsized":"2023-06-10T19:05:06.331324+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:33:02.324869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"124'2","reported_seq":15,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.332283+0000","last_change":"2023-06-10T19:05:04.523993+0000","last_active":"2023-06-10T19:05:06.332283+0000","last_peered":"2023-06-10T19:05:06.332283+0000","last_clean":"2023-06-10T19:05:06.332283+0000","last_became_active":"2023-06-10T19:05:04.523626+0000","last_became_peered":"2023-06-10T19:05:04.523626+0000","last_unstale":"2023-06-10T19:05:06.332283+0000","last_undegraded":"2023-06-10T19:05:06.332283+0000","last_fullsized":"2023-06-10T19:05:06.332283+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_clean_scrub_stamp":"2023-06-10T19:05:03.469282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:40:01.543517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.331109+0000","last_change":"2023-06-10T19:05:04.930356+0000","last_active":"2023-06-10T19:05:06.331109+0000","last_peered":"2023-06-10T19:05:06.331109+0000","last_clean":"2023-06-10T19:05:06.331109+0000","last_became_active":"2023-06-10T19:05:04.929983+0000","last_became_peered":"2023-06-10T19:05:04.929983+0000","last_unstale":"2023-06-10T19:05:06.331109+0000","last_undegraded":"2023-06-10T19:05:06.331109+0000","last_fullsized":"2023-06-10T19:05:06.331109+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:01:01.691704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"124'1","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:05.903242+0000","last_change":"2023-06-10T19:05:04.543332+0000","last_active":"2023-06-10T19:05:05.903242+0000","last_peered":"2023-06-10T19:05:05.903242+0000","last_clean":"2023-06-10T19:05:05.903242+0000","last_became_active":"2023-06-10T19:05:04.542579+0000","last_became_peered":"2023-06-10T19:05:04.542579+0000","last_unstale":"2023-06-10T19:05:05.903242+0000","last_undegraded":"2023-06-10T19:05:05.903242+0000","last_fullsized":"2023-06-10T19:05:05.903242+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_clean_scrub_stamp":"2023-06-10T19:05:03.469282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:09:59.567791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:05.902680+0000","last_change":"2023-06-10T19:05:04.932883+0000","last_active":"2023-06-10T19:05:05.902680+0000","last_peered":"2023-06-10T19:05:05.902680+0000","last_clean":"2023-06-10T19:05:05.902680+0000","last_became_active":"2023-06-10T19:05:04.932095+0000","last_became_peered":"2023-06-10T19:05:04.932095+0000","last_unstale":"2023-06-10T19:05:05.902680+0000","last_undegraded":"2023-06-10T19:05:05.902680+0000","last_fullsized":"2023-06-10T19:05:05.902680+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:33:57.704804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"124'1","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:05.896057+0000","last_change":"2023-06-10T19:05:04.517319+0000","last_active":"2023-06-10T19:05:05.896057+0000","last_peered":"2023-06-10T19:05:05.896057+0000","last_clean":"2023-06-10T19:05:05.896057+0000","last_became_active":"2023-06-10T19:05:04.517019+0000","last_became_peered":"2023-06-10T19:05:04.517019+0000","last_unstale":"2023-06-10T19:05:05.896057+0000","last_undegraded":"2023-06-10T19:05:05.896057+0000","last_fullsized":"2023-06-10T19:05:05.896057+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_clean_scrub_stamp":"2023-06-10T19:05:03.469282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:49:50.057951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.329976+0000","last_change":"2023-06-10T19:05:04.911827+0000","last_active":"2023-06-10T19:05:06.329976+0000","last_peered":"2023-06-10T19:05:06.329976+0000","last_clean":"2023-06-10T19:05:06.329976+0000","last_became_active":"2023-06-10T19:05:04.910748+0000","last_became_peered":"2023-06-10T19:05:04.910748+0000","last_unstale":"2023-06-10T19:05:06.329976+0000","last_undegraded":"2023-06-10T19:05:06.329976+0000","last_fullsized":"2023-06-10T19:05:06.329976+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:47:37.969139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":13,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.329795+0000","last_change":"2023-06-10T19:05:04.535051+0000","last_active":"2023-06-10T19:05:06.329795+0000","last_peered":"2023-06-10T19:05:06.329795+0000","last_clean":"2023-06-10T19:05:06.329795+0000","last_became_active":"2023-06-10T19:05:04.534225+0000","last_became_peered":"2023-06-10T19:05:04.534225+0000","last_unstale":"2023-06-10T19:05:06.329795+0000","last_undegraded":"2023-06-10T19:05:06.329795+0000","last_fullsized":"2023-06-10T19:05:06.329795+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_clean_scrub_stamp":"2023-06-10T19:05:03.469282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:31:59.275026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.331706+0000","last_change":"2023-06-10T19:05:04.903797+0000","last_active":"2023-06-10T19:05:06.331706+0000","last_peered":"2023-06-10T19:05:06.331706+0000","last_clean":"2023-06-10T19:05:06.331706+0000","last_became_active":"2023-06-10T19:05:04.903152+0000","last_became_peered":"2023-06-10T19:05:04.903152+0000","last_unstale":"2023-06-10T19:05:06.331706+0000","last_undegraded":"2023-06-10T19:05:06.331706+0000","last_fullsized":"2023-06-10T19:05:06.331706+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:24:46.918015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":13,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:05.895323+0000","last_change":"2023-06-10T19:05:04.526425+0000","last_active":"2023-06-10T19:05:05.895323+0000","last_peered":"2023-06-10T19:05:05.895323+0000","last_clean":"2023-06-10T19:05:05.895323+0000","last_became_active":"2023-06-10T19:05:04.525717+0000","last_became_peered":"2023-06-10T19:05:04.525717+0000","last_unstale":"2023-06-10T19:05:05.895323+0000","last_undegraded":"2023-06-10T19:05:05.895323+0000","last_fullsized":"2023-06-10T19:05:05.895323+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_clean_scrub_stamp":"2023-06-10T19:05:03.469282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:08:27.711924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.330568+0000","last_change":"2023-06-10T19:05:04.942732+0000","last_active":"2023-06-10T19:05:06.330568+0000","last_peered":"2023-06-10T19:05:06.330568+0000","last_clean":"2023-06-10T19:05:06.330568+0000","last_became_active":"2023-06-10T19:05:04.940731+0000","last_became_peered":"2023-06-10T19:05:04.940731+0000","last_unstale":"2023-06-10T19:05:06.330568+0000","last_undegraded":"2023-06-10T19:05:06.330568+0000","last_fullsized":"2023-06-10T19:05:06.330568+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:01:01.691704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"124'1","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.332053+0000","last_change":"2023-06-10T19:05:04.531331+0000","last_active":"2023-06-10T19:05:06.332053+0000","last_peered":"2023-06-10T19:05:06.332053+0000","last_clean":"2023-06-10T19:05:06.332053+0000","last_became_active":"2023-06-10T19:05:04.530905+0000","last_became_peered":"2023-06-10T19:05:04.530905+0000","last_unstale":"2023-06-10T19:05:06.332053+0000","last_undegraded":"2023-06-10T19:05:06.332053+0000","last_fullsized":"2023-06-10T19:05:06.332053+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_clean_scrub_stamp":"2023-06-10T19:05:03.469282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:45:47.788672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:05.903121+0000","last_change":"2023-06-10T19:05:04.914298+0000","last_active":"2023-06-10T19:05:05.903121+0000","last_peered":"2023-06-10T19:05:05.903121+0000","last_clean":"2023-06-10T19:05:05.903121+0000","last_became_active":"2023-06-10T19:05:04.913371+0000","last_became_peered":"2023-06-10T19:05:04.913371+0000","last_unstale":"2023-06-10T19:05:05.903121+0000","last_undegraded":"2023-06-10T19:05:05.903121+0000","last_fullsized":"2023-06-10T19:05:05.903121+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:21:39.960825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"124'2","reported_seq":15,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.327858+0000","last_change":"2023-06-10T19:05:04.528752+0000","last_active":"2023-06-10T19:05:06.327858+0000","last_peered":"2023-06-10T19:05:06.327858+0000","last_clean":"2023-06-10T19:05:06.327858+0000","last_became_active":"2023-06-10T19:05:04.528294+0000","last_became_peered":"2023-06-10T19:05:04.528294+0000","last_unstale":"2023-06-10T19:05:06.327858+0000","last_undegraded":"2023-06-10T19:05:06.327858+0000","last_fullsized":"2023-06-10T19:05:06.327858+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_clean_scrub_stamp":"2023-06-10T19:05:03.469282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:07:43.395736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:05.896142+0000","last_change":"2023-06-10T19:05:04.931481+0000","last_active":"2023-06-10T19:05:05.896142+0000","last_peered":"2023-06-10T19:05:05.896142+0000","last_clean":"2023-06-10T19:05:05.896142+0000","last_became_active":"2023-06-10T19:05:04.931180+0000","last_became_peered":"2023-06-10T19:05:04.931180+0000","last_unstale":"2023-06-10T19:05:05.896142+0000","last_undegraded":"2023-06-10T19:05:05.896142+0000","last_fullsized":"2023-06-10T19:05:05.896142+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:29:18.338259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"124'1","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.331224+0000","last_change":"2023-06-10T19:05:04.547409+0000","last_active":"2023-06-10T19:05:06.331224+0000","last_peered":"2023-06-10T19:05:06.331224+0000","last_clean":"2023-06-10T19:05:06.331224+0000","last_became_active":"2023-06-10T19:05:04.546691+0000","last_became_peered":"2023-06-10T19:05:04.546691+0000","last_unstale":"2023-06-10T19:05:06.331224+0000","last_undegraded":"2023-06-10T19:05:06.331224+0000","last_fullsized":"2023-06-10T19:05:06.331224+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_clean_scrub_stamp":"2023-06-10T19:05:03.469282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:08:43.073504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.332100+0000","last_change":"2023-06-10T19:05:04.950920+0000","last_active":"2023-06-10T19:05:06.332100+0000","last_peered":"2023-06-10T19:05:06.332100+0000","last_clean":"2023-06-10T19:05:06.332100+0000","last_became_active":"2023-06-10T19:05:04.950220+0000","last_became_peered":"2023-06-10T19:05:04.950220+0000","last_unstale":"2023-06-10T19:05:06.332100+0000","last_undegraded":"2023-06-10T19:05:06.332100+0000","last_fullsized":"2023-06-10T19:05:06.332100+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:58:08.595183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":13,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.330213+0000","last_change":"2023-06-10T19:05:04.548077+0000","last_active":"2023-06-10T19:05:06.330213+0000","last_peered":"2023-06-10T19:05:06.330213+0000","last_clean":"2023-06-10T19:05:06.330213+0000","last_became_active":"2023-06-10T19:05:04.547147+0000","last_became_peered":"2023-06-10T19:05:04.547147+0000","last_unstale":"2023-06-10T19:05:06.330213+0000","last_undegraded":"2023-06-10T19:05:06.330213+0000","last_fullsized":"2023-06-10T19:05:06.330213+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_clean_scrub_stamp":"2023-06-10T19:05:03.469282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:37:38.156875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:05.895181+0000","last_change":"2023-06-10T19:05:04.937359+0000","last_active":"2023-06-10T19:05:05.895181+0000","last_peered":"2023-06-10T19:05:05.895181+0000","last_clean":"2023-06-10T19:05:05.895181+0000","last_became_active":"2023-06-10T19:05:04.936954+0000","last_became_peered":"2023-06-10T19:05:04.936954+0000","last_unstale":"2023-06-10T19:05:05.895181+0000","last_undegraded":"2023-06-10T19:05:05.895181+0000","last_fullsized":"2023-06-10T19:05:05.895181+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:21:50.651914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"124'2","reported_seq":15,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:05.895593+0000","last_change":"2023-06-10T19:05:04.544232+0000","last_active":"2023-06-10T19:05:05.895593+0000","last_peered":"2023-06-10T19:05:05.895593+0000","last_clean":"2023-06-10T19:05:05.895593+0000","last_became_active":"2023-06-10T19:05:04.543696+0000","last_became_peered":"2023-06-10T19:05:04.543696+0000","last_unstale":"2023-06-10T19:05:05.895593+0000","last_undegraded":"2023-06-10T19:05:05.895593+0000","last_fullsized":"2023-06-10T19:05:05.895593+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_clean_scrub_stamp":"2023-06-10T19:05:03.469282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:39:12.050252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.328431+0000","last_change":"2023-06-10T19:05:04.943240+0000","last_active":"2023-06-10T19:05:06.328431+0000","last_peered":"2023-06-10T19:05:06.328431+0000","last_clean":"2023-06-10T19:05:06.328431+0000","last_became_active":"2023-06-10T19:05:04.942874+0000","last_became_peered":"2023-06-10T19:05:04.942874+0000","last_unstale":"2023-06-10T19:05:06.328431+0000","last_undegraded":"2023-06-10T19:05:06.328431+0000","last_fullsized":"2023-06-10T19:05:06.328431+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:04:52.272158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":13,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.330096+0000","last_change":"2023-06-10T19:05:04.550407+0000","last_active":"2023-06-10T19:05:06.330096+0000","last_peered":"2023-06-10T19:05:06.330096+0000","last_clean":"2023-06-10T19:05:06.330096+0000","last_became_active":"2023-06-10T19:05:04.549785+0000","last_became_peered":"2023-06-10T19:05:04.549785+0000","last_unstale":"2023-06-10T19:05:06.330096+0000","last_undegraded":"2023-06-10T19:05:06.330096+0000","last_fullsized":"2023-06-10T19:05:06.330096+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_clean_scrub_stamp":"2023-06-10T19:05:03.469282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:12:29.992745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.330338+0000","last_change":"2023-06-10T19:05:04.934457+0000","last_active":"2023-06-10T19:05:06.330338+0000","last_peered":"2023-06-10T19:05:06.330338+0000","last_clean":"2023-06-10T19:05:06.330338+0000","last_became_active":"2023-06-10T19:05:04.934120+0000","last_became_peered":"2023-06-10T19:05:04.934120+0000","last_unstale":"2023-06-10T19:05:06.330338+0000","last_undegraded":"2023-06-10T19:05:06.330338+0000","last_fullsized":"2023-06-10T19:05:06.330338+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:02:59.813450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":13,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.328866+0000","last_change":"2023-06-10T19:05:04.527075+0000","last_active":"2023-06-10T19:05:06.328866+0000","last_peered":"2023-06-10T19:05:06.328866+0000","last_clean":"2023-06-10T19:05:06.328866+0000","last_became_active":"2023-06-10T19:05:04.526750+0000","last_became_peered":"2023-06-10T19:05:04.526750+0000","last_unstale":"2023-06-10T19:05:06.328866+0000","last_undegraded":"2023-06-10T19:05:06.328866+0000","last_fullsized":"2023-06-10T19:05:06.328866+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_clean_scrub_stamp":"2023-06-10T19:05:03.469282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:13:03.567675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.330527+0000","last_change":"2023-06-10T19:05:04.936865+0000","last_active":"2023-06-10T19:05:06.330527+0000","last_peered":"2023-06-10T19:05:06.330527+0000","last_clean":"2023-06-10T19:05:06.330527+0000","last_became_active":"2023-06-10T19:05:04.936105+0000","last_became_peered":"2023-06-10T19:05:04.936105+0000","last_unstale":"2023-06-10T19:05:06.330527+0000","last_undegraded":"2023-06-10T19:05:06.330527+0000","last_fullsized":"2023-06-10T19:05:06.330527+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:32:56.155624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":13,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.328975+0000","last_change":"2023-06-10T19:05:04.549689+0000","last_active":"2023-06-10T19:05:06.328975+0000","last_peered":"2023-06-10T19:05:06.328975+0000","last_clean":"2023-06-10T19:05:06.328975+0000","last_became_active":"2023-06-10T19:05:04.546518+0000","last_became_peered":"2023-06-10T19:05:04.546518+0000","last_unstale":"2023-06-10T19:05:06.328975+0000","last_undegraded":"2023-06-10T19:05:06.328975+0000","last_fullsized":"2023-06-10T19:05:06.328975+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_clean_scrub_stamp":"2023-06-10T19:05:03.469282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:44:44.355202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:05.895906+0000","last_change":"2023-06-10T19:05:04.911941+0000","last_active":"2023-06-10T19:05:05.895906+0000","last_peered":"2023-06-10T19:05:05.895906+0000","last_clean":"2023-06-10T19:05:05.895906+0000","last_became_active":"2023-06-10T19:05:04.911513+0000","last_became_peered":"2023-06-10T19:05:04.911513+0000","last_unstale":"2023-06-10T19:05:05.895906+0000","last_undegraded":"2023-06-10T19:05:05.895906+0000","last_fullsized":"2023-06-10T19:05:05.895906+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:43:05.118849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"124'2","reported_seq":15,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:05.896047+0000","last_change":"2023-06-10T19:05:04.523989+0000","last_active":"2023-06-10T19:05:05.896047+0000","last_peered":"2023-06-10T19:05:05.896047+0000","last_clean":"2023-06-10T19:05:05.896047+0000","last_became_active":"2023-06-10T19:05:04.523687+0000","last_became_peered":"2023-06-10T19:05:04.523687+0000","last_unstale":"2023-06-10T19:05:05.896047+0000","last_undegraded":"2023-06-10T19:05:05.896047+0000","last_fullsized":"2023-06-10T19:05:05.896047+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_clean_scrub_stamp":"2023-06-10T19:05:03.469282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:30:13.488177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.331551+0000","last_change":"2023-06-10T19:05:04.930752+0000","last_active":"2023-06-10T19:05:06.331551+0000","last_peered":"2023-06-10T19:05:06.331551+0000","last_clean":"2023-06-10T19:05:06.331551+0000","last_became_active":"2023-06-10T19:05:04.930297+0000","last_became_peered":"2023-06-10T19:05:04.930297+0000","last_unstale":"2023-06-10T19:05:06.331551+0000","last_undegraded":"2023-06-10T19:05:06.331551+0000","last_fullsized":"2023-06-10T19:05:06.331551+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:38:51.147875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":13,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:05.901854+0000","last_change":"2023-06-10T19:05:04.532191+0000","last_active":"2023-06-10T19:05:05.901854+0000","last_peered":"2023-06-10T19:05:05.901854+0000","last_clean":"2023-06-10T19:05:05.901854+0000","last_became_active":"2023-06-10T19:05:04.531066+0000","last_became_peered":"2023-06-10T19:05:04.531066+0000","last_unstale":"2023-06-10T19:05:05.901854+0000","last_undegraded":"2023-06-10T19:05:05.901854+0000","last_fullsized":"2023-06-10T19:05:05.901854+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_clean_scrub_stamp":"2023-06-10T19:05:03.469282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:20:46.018729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.331032+0000","last_change":"2023-06-10T19:05:04.953124+0000","last_active":"2023-06-10T19:05:06.331032+0000","last_peered":"2023-06-10T19:05:06.331032+0000","last_clean":"2023-06-10T19:05:06.331032+0000","last_became_active":"2023-06-10T19:05:04.951541+0000","last_became_peered":"2023-06-10T19:05:04.951541+0000","last_unstale":"2023-06-10T19:05:06.331032+0000","last_undegraded":"2023-06-10T19:05:06.331032+0000","last_fullsized":"2023-06-10T19:05:06.331032+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:20:05.156375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":13,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:05.901576+0000","last_change":"2023-06-10T19:05:04.531900+0000","last_active":"2023-06-10T19:05:05.901576+0000","last_peered":"2023-06-10T19:05:05.901576+0000","last_clean":"2023-06-10T19:05:05.901576+0000","last_became_active":"2023-06-10T19:05:04.530994+0000","last_became_peered":"2023-06-10T19:05:04.530994+0000","last_unstale":"2023-06-10T19:05:05.901576+0000","last_undegraded":"2023-06-10T19:05:05.901576+0000","last_fullsized":"2023-06-10T19:05:05.901576+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_clean_scrub_stamp":"2023-06-10T19:05:03.469282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:39:36.064983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.328704+0000","last_change":"2023-06-10T19:05:04.947519+0000","last_active":"2023-06-10T19:05:06.328704+0000","last_peered":"2023-06-10T19:05:06.328704+0000","last_clean":"2023-06-10T19:05:06.328704+0000","last_became_active":"2023-06-10T19:05:04.947148+0000","last_became_peered":"2023-06-10T19:05:04.947148+0000","last_unstale":"2023-06-10T19:05:06.328704+0000","last_undegraded":"2023-06-10T19:05:06.328704+0000","last_fullsized":"2023-06-10T19:05:06.328704+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:35:02.524165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":13,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:05.896016+0000","last_change":"2023-06-10T19:05:04.524534+0000","last_active":"2023-06-10T19:05:05.896016+0000","last_peered":"2023-06-10T19:05:05.896016+0000","last_clean":"2023-06-10T19:05:05.896016+0000","last_became_active":"2023-06-10T19:05:04.524254+0000","last_became_peered":"2023-06-10T19:05:04.524254+0000","last_unstale":"2023-06-10T19:05:05.896016+0000","last_undegraded":"2023-06-10T19:05:05.896016+0000","last_fullsized":"2023-06-10T19:05:05.896016+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_clean_scrub_stamp":"2023-06-10T19:05:03.469282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:59:51.951802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:05.895334+0000","last_change":"2023-06-10T19:05:04.914589+0000","last_active":"2023-06-10T19:05:05.895334+0000","last_peered":"2023-06-10T19:05:05.895334+0000","last_clean":"2023-06-10T19:05:05.895334+0000","last_became_active":"2023-06-10T19:05:04.914128+0000","last_became_peered":"2023-06-10T19:05:04.914128+0000","last_unstale":"2023-06-10T19:05:05.895334+0000","last_undegraded":"2023-06-10T19:05:05.895334+0000","last_fullsized":"2023-06-10T19:05:05.895334+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:33:18.357059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":13,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:05.903381+0000","last_change":"2023-06-10T19:05:04.526879+0000","last_active":"2023-06-10T19:05:05.903381+0000","last_peered":"2023-06-10T19:05:05.903381+0000","last_clean":"2023-06-10T19:05:05.903381+0000","last_became_active":"2023-06-10T19:05:04.526192+0000","last_became_peered":"2023-06-10T19:05:04.526192+0000","last_unstale":"2023-06-10T19:05:05.903381+0000","last_undegraded":"2023-06-10T19:05:05.903381+0000","last_fullsized":"2023-06-10T19:05:05.903381+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_clean_scrub_stamp":"2023-06-10T19:05:03.469282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:37:26.398183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.328651+0000","last_change":"2023-06-10T19:05:04.932420+0000","last_active":"2023-06-10T19:05:06.328651+0000","last_peered":"2023-06-10T19:05:06.328651+0000","last_clean":"2023-06-10T19:05:06.328651+0000","last_became_active":"2023-06-10T19:05:04.932143+0000","last_became_peered":"2023-06-10T19:05:04.932143+0000","last_unstale":"2023-06-10T19:05:06.328651+0000","last_undegraded":"2023-06-10T19:05:06.328651+0000","last_fullsized":"2023-06-10T19:05:06.328651+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:56:45.424999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":13,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:05.903154+0000","last_change":"2023-06-10T19:05:04.525116+0000","last_active":"2023-06-10T19:05:05.903154+0000","last_peered":"2023-06-10T19:05:05.903154+0000","last_clean":"2023-06-10T19:05:05.903154+0000","last_became_active":"2023-06-10T19:05:04.524364+0000","last_became_peered":"2023-06-10T19:05:04.524364+0000","last_unstale":"2023-06-10T19:05:05.903154+0000","last_undegraded":"2023-06-10T19:05:05.903154+0000","last_fullsized":"2023-06-10T19:05:05.903154+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_clean_scrub_stamp":"2023-06-10T19:05:03.469282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:27:39.725221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.329762+0000","last_change":"2023-06-10T19:05:04.952981+0000","last_active":"2023-06-10T19:05:06.329762+0000","last_peered":"2023-06-10T19:05:06.329762+0000","last_clean":"2023-06-10T19:05:06.329762+0000","last_became_active":"2023-06-10T19:05:04.950008+0000","last_became_peered":"2023-06-10T19:05:04.950008+0000","last_unstale":"2023-06-10T19:05:06.329762+0000","last_undegraded":"2023-06-10T19:05:06.329762+0000","last_fullsized":"2023-06-10T19:05:06.329762+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:47:15.740474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":13,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:05.895619+0000","last_change":"2023-06-10T19:05:04.526354+0000","last_active":"2023-06-10T19:05:05.895619+0000","last_peered":"2023-06-10T19:05:05.895619+0000","last_clean":"2023-06-10T19:05:05.895619+0000","last_became_active":"2023-06-10T19:05:04.526034+0000","last_became_peered":"2023-06-10T19:05:04.526034+0000","last_unstale":"2023-06-10T19:05:05.895619+0000","last_undegraded":"2023-06-10T19:05:05.895619+0000","last_fullsized":"2023-06-10T19:05:05.895619+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_clean_scrub_stamp":"2023-06-10T19:05:03.469282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:38:29.611144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.332052+0000","last_change":"2023-06-10T19:05:04.933510+0000","last_active":"2023-06-10T19:05:06.332052+0000","last_peered":"2023-06-10T19:05:06.332052+0000","last_clean":"2023-06-10T19:05:06.332052+0000","last_became_active":"2023-06-10T19:05:04.933109+0000","last_became_peered":"2023-06-10T19:05:04.933109+0000","last_unstale":"2023-06-10T19:05:06.332052+0000","last_undegraded":"2023-06-10T19:05:06.332052+0000","last_fullsized":"2023-06-10T19:05:06.332052+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:58:08.595183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":13,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.329066+0000","last_change":"2023-06-10T19:05:04.548959+0000","last_active":"2023-06-10T19:05:06.329066+0000","last_peered":"2023-06-10T19:05:06.329066+0000","last_clean":"2023-06-10T19:05:06.329066+0000","last_became_active":"2023-06-10T19:05:04.548200+0000","last_became_peered":"2023-06-10T19:05:04.548200+0000","last_unstale":"2023-06-10T19:05:06.329066+0000","last_undegraded":"2023-06-10T19:05:06.329066+0000","last_fullsized":"2023-06-10T19:05:06.329066+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_clean_scrub_stamp":"2023-06-10T19:05:03.469282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:43:33.961979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.330310+0000","last_change":"2023-06-10T19:05:04.954383+0000","last_active":"2023-06-10T19:05:06.330310+0000","last_peered":"2023-06-10T19:05:06.330310+0000","last_clean":"2023-06-10T19:05:06.330310+0000","last_became_active":"2023-06-10T19:05:04.951260+0000","last_became_peered":"2023-06-10T19:05:04.951260+0000","last_unstale":"2023-06-10T19:05:06.330310+0000","last_undegraded":"2023-06-10T19:05:06.330310+0000","last_fullsized":"2023-06-10T19:05:06.330310+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:30:36.697854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"124'8","reported_seq":21,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.328432+0000","last_change":"2023-06-10T19:05:04.543681+0000","last_active":"2023-06-10T19:05:06.328432+0000","last_peered":"2023-06-10T19:05:06.328432+0000","last_clean":"2023-06-10T19:05:06.328432+0000","last_became_active":"2023-06-10T19:05:04.543398+0000","last_became_peered":"2023-06-10T19:05:04.543398+0000","last_unstale":"2023-06-10T19:05:06.328432+0000","last_undegraded":"2023-06-10T19:05:06.328432+0000","last_fullsized":"2023-06-10T19:05:06.328432+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_clean_scrub_stamp":"2023-06-10T19:05:03.469282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:02:03.902484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":355,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.329344+0000","last_change":"2023-06-10T18:52:34.951528+0000","last_active":"2023-06-10T19:05:06.329344+0000","last_peered":"2023-06-10T19:05:06.329344+0000","last_clean":"2023-06-10T19:05:06.329344+0000","last_became_active":"2023-06-10T18:52:34.949099+0000","last_became_peered":"2023-06-10T18:52:34.949099+0000","last_unstale":"2023-06-10T19:05:06.329344+0000","last_undegraded":"2023-06-10T19:05:06.329344+0000","last_fullsized":"2023-06-10T19:05:06.329344+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_clean_scrub_stamp":"2023-06-10T18:52:33.633295+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:52:40.202841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":208,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.330602+0000","last_change":"2023-06-10T18:52:40.506384+0000","last_active":"2023-06-10T19:05:06.330602+0000","last_peered":"2023-06-10T19:05:06.330602+0000","last_clean":"2023-06-10T19:05:06.330602+0000","last_became_active":"2023-06-10T18:52:40.505701+0000","last_became_peered":"2023-06-10T18:52:40.505701+0000","last_unstale":"2023-06-10T19:05:06.330602+0000","last_undegraded":"2023-06-10T19:05:06.330602+0000","last_fullsized":"2023-06-10T19:05:06.330602+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:41:58.693046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:05.900721+0000","last_change":"2023-06-10T19:05:04.918187+0000","last_active":"2023-06-10T19:05:05.900721+0000","last_peered":"2023-06-10T19:05:05.900721+0000","last_clean":"2023-06-10T19:05:05.900721+0000","last_became_active":"2023-06-10T19:05:04.917296+0000","last_became_peered":"2023-06-10T19:05:04.917296+0000","last_unstale":"2023-06-10T19:05:05.900721+0000","last_undegraded":"2023-06-10T19:05:05.900721+0000","last_fullsized":"2023-06-10T19:05:05.900721+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:51:49.120945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"124'2","reported_seq":15,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.329531+0000","last_change":"2023-06-10T19:05:04.543831+0000","last_active":"2023-06-10T19:05:06.329531+0000","last_peered":"2023-06-10T19:05:06.329531+0000","last_clean":"2023-06-10T19:05:06.329531+0000","last_became_active":"2023-06-10T19:05:04.543463+0000","last_became_peered":"2023-06-10T19:05:04.543463+0000","last_unstale":"2023-06-10T19:05:06.329531+0000","last_undegraded":"2023-06-10T19:05:06.329531+0000","last_fullsized":"2023-06-10T19:05:06.329531+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_clean_scrub_stamp":"2023-06-10T19:05:03.469282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:23:49.155296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":199,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.329144+0000","last_change":"2023-06-10T18:52:40.512015+0000","last_active":"2023-06-10T19:05:06.329144+0000","last_peered":"2023-06-10T19:05:06.329144+0000","last_clean":"2023-06-10T19:05:06.329144+0000","last_became_active":"2023-06-10T18:52:40.511382+0000","last_became_peered":"2023-06-10T18:52:40.511382+0000","last_unstale":"2023-06-10T19:05:06.329144+0000","last_undegraded":"2023-06-10T19:05:06.329144+0000","last_fullsized":"2023-06-10T19:05:06.329144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:17:37.399196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.331247+0000","last_change":"2023-06-10T19:05:04.930552+0000","last_active":"2023-06-10T19:05:06.331247+0000","last_peered":"2023-06-10T19:05:06.331247+0000","last_clean":"2023-06-10T19:05:06.331247+0000","last_became_active":"2023-06-10T19:05:04.930006+0000","last_became_peered":"2023-06-10T19:05:04.930006+0000","last_unstale":"2023-06-10T19:05:06.331247+0000","last_undegraded":"2023-06-10T19:05:06.331247+0000","last_fullsized":"2023-06-10T19:05:06.331247+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:54:23.700250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":13,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.330448+0000","last_change":"2023-06-10T19:05:04.523006+0000","last_active":"2023-06-10T19:05:06.330448+0000","last_peered":"2023-06-10T19:05:06.330448+0000","last_clean":"2023-06-10T19:05:06.330448+0000","last_became_active":"2023-06-10T19:05:04.522688+0000","last_became_peered":"2023-06-10T19:05:04.522688+0000","last_unstale":"2023-06-10T19:05:06.330448+0000","last_undegraded":"2023-06-10T19:05:06.330448+0000","last_fullsized":"2023-06-10T19:05:06.330448+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_clean_scrub_stamp":"2023-06-10T19:05:03.469282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:21:56.991537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":210,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.327297+0000","last_change":"2023-06-10T18:52:40.671725+0000","last_active":"2023-06-10T19:05:06.327297+0000","last_peered":"2023-06-10T19:05:06.327297+0000","last_clean":"2023-06-10T19:05:06.327297+0000","last_became_active":"2023-06-10T18:52:40.671442+0000","last_became_peered":"2023-06-10T18:52:40.671442+0000","last_unstale":"2023-06-10T19:05:06.327297+0000","last_undegraded":"2023-06-10T19:05:06.327297+0000","last_fullsized":"2023-06-10T19:05:06.327297+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:27:16.555869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.327239+0000","last_change":"2023-06-10T19:05:04.895399+0000","last_active":"2023-06-10T19:05:06.327239+0000","last_peered":"2023-06-10T19:05:06.327239+0000","last_clean":"2023-06-10T19:05:06.327239+0000","last_became_active":"2023-06-10T19:05:04.895092+0000","last_became_peered":"2023-06-10T19:05:04.895092+0000","last_unstale":"2023-06-10T19:05:06.327239+0000","last_undegraded":"2023-06-10T19:05:06.327239+0000","last_fullsized":"2023-06-10T19:05:06.327239+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:48:25.030248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":13,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.328657+0000","last_change":"2023-06-10T19:05:04.542766+0000","last_active":"2023-06-10T19:05:06.328657+0000","last_peered":"2023-06-10T19:05:06.328657+0000","last_clean":"2023-06-10T19:05:06.328657+0000","last_became_active":"2023-06-10T19:05:04.542381+0000","last_became_peered":"2023-06-10T19:05:04.542381+0000","last_unstale":"2023-06-10T19:05:06.328657+0000","last_undegraded":"2023-06-10T19:05:06.328657+0000","last_fullsized":"2023-06-10T19:05:06.328657+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_clean_scrub_stamp":"2023-06-10T19:05:03.469282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:55:55.485770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":208,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.330041+0000","last_change":"2023-06-10T18:52:40.510258+0000","last_active":"2023-06-10T19:05:06.330041+0000","last_peered":"2023-06-10T19:05:06.330041+0000","last_clean":"2023-06-10T19:05:06.330041+0000","last_became_active":"2023-06-10T18:52:40.509560+0000","last_became_peered":"2023-06-10T18:52:40.509560+0000","last_unstale":"2023-06-10T19:05:06.330041+0000","last_undegraded":"2023-06-10T19:05:06.330041+0000","last_fullsized":"2023-06-10T19:05:06.330041+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:33:51.668225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:05.900562+0000","last_change":"2023-06-10T19:05:04.950948+0000","last_active":"2023-06-10T19:05:05.900562+0000","last_peered":"2023-06-10T19:05:05.900562+0000","last_clean":"2023-06-10T19:05:05.900562+0000","last_became_active":"2023-06-10T19:05:04.950236+0000","last_became_peered":"2023-06-10T19:05:04.950236+0000","last_unstale":"2023-06-10T19:05:05.900562+0000","last_undegraded":"2023-06-10T19:05:05.900562+0000","last_fullsized":"2023-06-10T19:05:05.900562+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:31:43.166898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":13,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:05.901045+0000","last_change":"2023-06-10T19:05:04.532086+0000","last_active":"2023-06-10T19:05:05.901045+0000","last_peered":"2023-06-10T19:05:05.901045+0000","last_clean":"2023-06-10T19:05:05.901045+0000","last_became_active":"2023-06-10T19:05:04.531080+0000","last_became_peered":"2023-06-10T19:05:04.531080+0000","last_unstale":"2023-06-10T19:05:05.901045+0000","last_undegraded":"2023-06-10T19:05:05.901045+0000","last_fullsized":"2023-06-10T19:05:05.901045+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_clean_scrub_stamp":"2023-06-10T19:05:03.469282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:47:37.878528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":194,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.332347+0000","last_change":"2023-06-10T18:52:40.672266+0000","last_active":"2023-06-10T19:05:06.332347+0000","last_peered":"2023-06-10T19:05:06.332347+0000","last_clean":"2023-06-10T19:05:06.332347+0000","last_became_active":"2023-06-10T18:52:40.671966+0000","last_became_peered":"2023-06-10T18:52:40.671966+0000","last_unstale":"2023-06-10T19:05:06.332347+0000","last_undegraded":"2023-06-10T19:05:06.332347+0000","last_fullsized":"2023-06-10T19:05:06.332347+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:11:51.256178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.331028+0000","last_change":"2023-06-10T19:05:04.942822+0000","last_active":"2023-06-10T19:05:06.331028+0000","last_peered":"2023-06-10T19:05:06.331028+0000","last_clean":"2023-06-10T19:05:06.331028+0000","last_became_active":"2023-06-10T19:05:04.940684+0000","last_became_peered":"2023-06-10T19:05:04.940684+0000","last_unstale":"2023-06-10T19:05:06.331028+0000","last_undegraded":"2023-06-10T19:05:06.331028+0000","last_fullsized":"2023-06-10T19:05:06.331028+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:03:29.229444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":13,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.331604+0000","last_change":"2023-06-10T19:05:04.529417+0000","last_active":"2023-06-10T19:05:06.331604+0000","last_peered":"2023-06-10T19:05:06.331604+0000","last_clean":"2023-06-10T19:05:06.331604+0000","last_became_active":"2023-06-10T19:05:04.528602+0000","last_became_peered":"2023-06-10T19:05:04.528602+0000","last_unstale":"2023-06-10T19:05:06.331604+0000","last_undegraded":"2023-06-10T19:05:06.331604+0000","last_fullsized":"2023-06-10T19:05:06.331604+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_clean_scrub_stamp":"2023-06-10T19:05:03.469282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:07:54.384502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":198,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.331433+0000","last_change":"2023-06-10T18:52:40.671084+0000","last_active":"2023-06-10T19:05:06.331433+0000","last_peered":"2023-06-10T19:05:06.331433+0000","last_clean":"2023-06-10T19:05:06.331433+0000","last_became_active":"2023-06-10T18:52:40.670697+0000","last_became_peered":"2023-06-10T18:52:40.670697+0000","last_unstale":"2023-06-10T19:05:06.331433+0000","last_undegraded":"2023-06-10T19:05:06.331433+0000","last_fullsized":"2023-06-10T19:05:06.331433+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:53:09.330856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.329920+0000","last_change":"2023-06-10T19:05:04.934797+0000","last_active":"2023-06-10T19:05:06.329920+0000","last_peered":"2023-06-10T19:05:06.329920+0000","last_clean":"2023-06-10T19:05:06.329920+0000","last_became_active":"2023-06-10T19:05:04.934549+0000","last_became_peered":"2023-06-10T19:05:04.934549+0000","last_unstale":"2023-06-10T19:05:06.329920+0000","last_undegraded":"2023-06-10T19:05:06.329920+0000","last_fullsized":"2023-06-10T19:05:06.329920+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:59:34.063716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"124'3","reported_seq":16,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.331197+0000","last_change":"2023-06-10T19:05:04.544815+0000","last_active":"2023-06-10T19:05:06.331197+0000","last_peered":"2023-06-10T19:05:06.331197+0000","last_clean":"2023-06-10T19:05:06.331197+0000","last_became_active":"2023-06-10T19:05:04.544127+0000","last_became_peered":"2023-06-10T19:05:04.544127+0000","last_unstale":"2023-06-10T19:05:06.331197+0000","last_undegraded":"2023-06-10T19:05:06.331197+0000","last_fullsized":"2023-06-10T19:05:06.331197+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_clean_scrub_stamp":"2023-06-10T19:05:03.469282+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:38:50.135110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":194,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.332194+0000","last_change":"2023-06-10T18:52:40.514114+0000","last_active":"2023-06-10T19:05:06.332194+0000","last_peered":"2023-06-10T19:05:06.332194+0000","last_clean":"2023-06-10T19:05:06.332194+0000","last_became_active":"2023-06-10T18:52:40.513638+0000","last_became_peered":"2023-06-10T18:52:40.513638+0000","last_unstale":"2023-06-10T19:05:06.332194+0000","last_undegraded":"2023-06-10T19:05:06.332194+0000","last_fullsized":"2023-06-10T19:05:06.332194+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:35:34.283698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.331953+0000","last_change":"2023-06-10T19:05:04.944000+0000","last_active":"2023-06-10T19:05:06.331953+0000","last_peered":"2023-06-10T19:05:06.331953+0000","last_clean":"2023-06-10T19:05:06.331953+0000","last_became_active":"2023-06-10T19:05:04.943389+0000","last_became_peered":"2023-06-10T19:05:04.943389+0000","last_unstale":"2023-06-10T19:05:06.331953+0000","last_undegraded":"2023-06-10T19:05:06.331953+0000","last_fullsized":"2023-06-10T19:05:06.331953+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:04.482046+0000","last_clean_scrub_stamp":"2023-06-10T19:05:04.482046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:50:37.357501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"124'6","reported_seq":19,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:06.328838+0000","last_change":"2023-06-10T19:05:04.542922+0000","last_active":"2023-06-10T19:05:06.328838+0000","last_peered":"2023-06-10T19:05:06.328838+0000","last_clean":"2023-06-10T19:05:06.328838+0000","last_became_active":"2023-06-10T19:05:04.542490+0000","last_became_peered":"2023-06-10T19:05:04.542490+0000","last_unstale":"2023-06-10T19:05:06.328838+0000","last_undegraded":"2023-06-10T19:05:06.328838+0000","last_fullsized":"2023-06-10T19:05:06.328838+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:03.469282+0000","last_clean_scrub_stamp":"2023-06-10T19:05:03.469282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:09:17.507411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":200,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-06-10T19:05:05.901244+0000","last_change":"2023-06-10T18:52:40.515396+0000","last_active":"2023-06-10T19:05:05.901244+0000","last_peered":"2023-06-10T19:05:05.901244+0000","last_clean":"2023-06-10T19:05:05.901244+0000","last_became_active":"2023-06-10T18:52:40.514663+0000","last_became_peered":"2023-06-10T18:52:40.514663+0000","last_unstale":"2023-06-10T19:05:05.901244+0000","last_undegraded":"2023-06-10T19:05:05.901244+0000","last_fullsized":"2023-06-10T19:05:05.901244+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:38:47.060246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575002,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33160,"kb_used_data":2112,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338680,"statfs":{"total":96636764160,"available":96602808320,"internally_reserved":0,"allocated":2162688,"data_stored":1311140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:05:00 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.93999999999999995,"15min":0.91800000000000004},"min":{"1min":0.53600000000000003,"5min":0.49399999999999999,"15min":0.434},"max":{"1min":1.351,"5min":1.351,"15min":1.6220000000000001},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.92000000000000004,"15min":0.92700000000000005},"min":{"1min":0.59599999999999997,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.153,"5min":1.2909999999999999,"15min":1.6870000000000001},"last":1.163}]},{"osd":1,"last update":"Sat Jun 10 19:05:00 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.90700000000000003,"15min":0.91900000000000004},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1759999999999999,"5min":1.238,"15min":1.377},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.92900000000000005,"15min":0.94099999999999995},"min":{"1min":0.60399999999999998,"5min":0.51300000000000001,"15min":0.504},"max":{"1min":1.214,"5min":1.238,"15min":1.5960000000000001},"last":0.95599999999999996}]},{"osd":2,"last update":"Sat Jun 10 19:05:00 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.86399999999999999,"15min":0.84799999999999998},"min":{"1min":0.58599999999999997,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.26,"5min":1.26,"15min":1.4059999999999999},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.91900000000000004,"15min":0.90200000000000002},"min":{"1min":0.70799999999999996,"5min":0.54100000000000004,"15min":0.50600000000000001},"max":{"1min":1.3100000000000001,"5min":1.448,"15min":1.448},"last":0.77300000000000002}]},{"osd":3,"last update":"Sat Jun 10 19:05:00 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.90300000000000002,"15min":0.91500000000000004},"min":{"1min":0.68300000000000005,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.1539999999999999,"5min":1.2370000000000001,"15min":1.502},"last":1.137},{"interface":"front","average":{"1min":1.0489999999999999,"5min":0.97799999999999998,"15min":0.95499999999999996},"min":{"1min":0.85599999999999998,"5min":0.432,"15min":0.432},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.84799999999999998}]},{"osd":4,"last update":"Sat Jun 10 19:05:00 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.82099999999999995,"15min":0.84899999999999998},"min":{"1min":0.64500000000000002,"5min":0.307,"15min":0.307},"max":{"1min":1.145,"5min":1.2210000000000001,"15min":1.639},"last":1.113},{"interface":"front","average":{"1min":0.998,"5min":0.96499999999999997,"15min":0.96599999999999997},"min":{"1min":0.70999999999999996,"5min":0.41199999999999998,"15min":0.40000000000000002},"max":{"1min":1.218,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.274}]},{"osd":5,"last update":"Sat Jun 10 19:05:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1,"15min":1.0089999999999999},"min":{"1min":0.72899999999999998,"5min":0.40500000000000003,"15min":0.38400000000000001},"max":{"1min":1.3100000000000001,"5min":1.379,"15min":1.806},"last":1.0629999999999999},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0269999999999999,"15min":1.034},"min":{"1min":0.67500000000000004,"5min":0.48499999999999999,"15min":0.46500000000000002},"max":{"1min":1.3,"5min":1.579,"15min":1.579},"last":1.194}]},{"osd":6,"last update":"Sat Jun 10 19:05:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.006,"15min":1.0069999999999999},"min":{"1min":0.70399999999999996,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.274,"5min":1.391,"15min":1.718},"last":1.3149999999999999},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.0940000000000001,"15min":1.0940000000000001},"min":{"1min":0.91000000000000003,"5min":0.48799999999999999,"15min":0.441},"max":{"1min":1.5129999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":1.234}]}]},{"osd":6,"up_from":13,"seq":55834575003,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32568,"kb_used_data":1520,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339272,"statfs":{"total":96636764160,"available":96603414528,"internally_reserved":0,"allocated":1556480,"data_stored":720578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:04:50 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.84499999999999997,"15min":0.85799999999999998},"min":{"1min":0.64600000000000002,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.498},"last":0.75},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.87,"15min":0.876},"min":{"1min":0.63100000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.175,"5min":1.2250000000000001,"15min":1.496},"last":1.137}]},{"osd":1,"last update":"Sat Jun 10 19:04:50 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.86299999999999999,"15min":0.86699999999999999},"min":{"1min":0.51500000000000001,"5min":0.502,"15min":0.48699999999999999},"max":{"1min":1.163,"5min":1.163,"15min":1.5229999999999999},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.90100000000000002,"15min":0.89600000000000002},"min":{"1min":0.61599999999999999,"5min":0.48699999999999999,"15min":0.45300000000000001},"max":{"1min":1.204,"5min":1.258,"15min":1.778},"last":0.92300000000000004}]},{"osd":2,"last update":"Sat Jun 10 19:04:50 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.92600000000000005,"15min":0.89800000000000002},"min":{"1min":0.55200000000000005,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.224,"5min":1.2809999999999999,"15min":1.3759999999999999},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.88,"15min":0.88800000000000001},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.145,"5min":1.2330000000000001,"15min":1.246},"last":0.79800000000000004}]},{"osd":3,"last update":"Sat Jun 10 19:04:50 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.92500000000000004,"15min":0.91100000000000003},"min":{"1min":0.72199999999999998,"5min":0.55100000000000005,"15min":0.52700000000000002},"max":{"1min":1.161,"5min":1.238,"15min":1.7190000000000001},"last":1.0269999999999999},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.97499999999999998,"15min":0.98999999999999999},"min":{"1min":0.68100000000000005,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.22,"5min":1.371,"15min":1.4370000000000001},"last":1.198}]},{"osd":4,"last update":"Sat Jun 10 19:04:50 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.89300000000000002,"15min":0.91600000000000004},"min":{"1min":0.45900000000000002,"5min":0.373,"15min":0.373},"max":{"1min":1.167,"5min":1.401,"15min":1.798},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.98099999999999998,"15min":0.98799999999999999},"min":{"1min":0.52800000000000002,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.2669999999999999,"5min":1.357,"15min":1.5489999999999999},"last":1.071}]},{"osd":5,"last update":"Sat Jun 10 19:04:50 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.90300000000000002,"15min":0.92100000000000004},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.163,"5min":1.29,"15min":1.333},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.98299999999999998,"5min":1.004,"15min":1.022},"min":{"1min":0.50700000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.296,"5min":1.296,"15min":2.536},"last":1.1000000000000001}]},{"osd":7,"last update":"Sat Jun 10 19:04:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.0429999999999999,"15min":1.0349999999999999},"min":{"1min":0.59199999999999997,"5min":0.58599999999999997,"15min":0.57099999999999995},"max":{"1min":1.3029999999999999,"5min":1.879,"15min":1.917},"last":0.996},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.98599999999999999,"15min":1.0169999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.258,"5min":1.4850000000000001,"15min":1.5569999999999999},"last":0.88800000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575003,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32572,"kb_used_data":1524,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339268,"statfs":{"total":96636764160,"available":96603410432,"internally_reserved":0,"allocated":1560576,"data_stored":720156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.875,"15min":0.86799999999999999},"min":{"1min":0.65400000000000003,"5min":0.499,"15min":0.499},"max":{"1min":1.083,"5min":1.2070000000000001,"15min":1.232},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.94399999999999995,"15min":0.92000000000000004},"min":{"1min":0.64600000000000002,"5min":0.58999999999999997,"15min":0.49399999999999999},"max":{"1min":1.2370000000000001,"5min":2.347,"15min":2.347},"last":1.212}]},{"osd":1,"last update":"Sat Jun 10 19:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.95399999999999996,"15min":0.92100000000000004},"min":{"1min":0.67400000000000004,"5min":0.58799999999999997,"15min":0.52600000000000002},"max":{"1min":1.2450000000000001,"5min":7.0800000000000001,"15min":7.0800000000000001},"last":1.0780000000000001},{"interface":"front","average":{"1min":0.88500000000000001,"5min":1.1319999999999999,"15min":0.98799999999999999},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.53800000000000003},"max":{"1min":1.1240000000000001,"5min":15.845000000000001,"15min":15.845000000000001},"last":0.91100000000000003}]},{"osd":2,"last update":"Sat Jun 10 19:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.94799999999999995,"15min":0.89200000000000002},"min":{"1min":0.60799999999999998,"5min":0.54300000000000004,"15min":0.48299999999999998},"max":{"1min":1.2410000000000001,"5min":5.0049999999999999,"15min":5.0049999999999999},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.996,"15min":0.94299999999999995},"min":{"1min":0.60699999999999998,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.127,"5min":6.851,"15min":6.851},"last":1.236}]},{"osd":3,"last update":"Sat Jun 10 19:04:49 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":0.97799999999999998,"15min":0.95699999999999996},"min":{"1min":0.69899999999999995,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1910000000000001,"5min":2.544,"15min":2.544},"last":1.1419999999999999},{"interface":"front","average":{"1min":0.99099999999999999,"5min":1.0009999999999999,"15min":1.004},"min":{"1min":0.78200000000000003,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.272,"5min":3.0830000000000002,"15min":3.0830000000000002},"last":0.995}]},{"osd":4,"last update":"Sat Jun 10 19:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.98499999999999999,"15min":0.95599999999999996},"min":{"1min":0.68500000000000005,"5min":0.64000000000000001,"15min":0.58099999999999996},"max":{"1min":1.238,"5min":6.7290000000000001,"15min":6.7290000000000001},"last":1.171},{"interface":"front","average":{"1min":0.873,"5min":0.96699999999999997,"15min":1},"min":{"1min":0.67800000000000005,"5min":0.64900000000000002,"15min":0.61199999999999999},"max":{"1min":1.1060000000000001,"5min":1.341,"15min":1.575},"last":1.0409999999999999}]},{"osd":6,"last update":"Sat Jun 10 19:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.96599999999999997,"15min":1},"min":{"1min":0.60499999999999998,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.159,"5min":1.3029999999999999,"15min":1.4330000000000001},"last":1.113},{"interface":"front","average":{"1min":1.018,"5min":1.097,"15min":1.0609999999999999},"min":{"1min":0.81699999999999995,"5min":0.71999999999999997,"15min":0.57899999999999996},"max":{"1min":1.341,"5min":6.923,"15min":6.923},"last":0.96099999999999997}]},{"osd":7,"last update":"Sat Jun 10 19:04:49 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.083,"15min":1.101},"min":{"1min":0.82199999999999995,"5min":0.68400000000000005,"15min":0.66200000000000003},"max":{"1min":1.234,"5min":2.6080000000000001,"15min":2.6080000000000001},"last":1.194},{"interface":"front","average":{"1min":1.081,"5min":1.165,"15min":1.145},"min":{"1min":0.72499999999999998,"5min":0.67100000000000004,"15min":0.66200000000000003},"max":{"1min":1.4730000000000001,"5min":5.4169999999999998,"15min":5.4169999999999998},"last":1.2729999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575002,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32576,"kb_used_data":1528,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339264,"statfs":{"total":96636764160,"available":96603406336,"internally_reserved":0,"allocated":1564672,"data_stored":721560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.84999999999999998,"15min":0.82299999999999995},"min":{"1min":0.52800000000000002,"5min":0.45400000000000001,"15min":0.45100000000000001},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":1.25},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.88500000000000001,"15min":0.90400000000000003},"min":{"1min":0.67200000000000004,"5min":0.49199999999999999,"15min":0.48899999999999999},"max":{"1min":1.196,"5min":1.3979999999999999,"15min":3.7280000000000002},"last":1.032}]},{"osd":1,"last update":"Sat Jun 10 19:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.91300000000000003,"15min":0.94099999999999995},"min":{"1min":0.49199999999999999,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":3.3969999999999998},"last":1.3600000000000001},{"interface":"front","average":{"1min":0.878,"5min":0.83699999999999997,"15min":0.85999999999999999},"min":{"1min":0.58399999999999996,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":2.496},"last":1.1339999999999999}]},{"osd":2,"last update":"Sat Jun 10 19:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.873,"15min":0.88300000000000001},"min":{"1min":0.53400000000000003,"5min":0.52200000000000002,"15min":0.49299999999999999},"max":{"1min":1.143,"5min":1.3,"15min":1.522},"last":1.087},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.96699999999999997,"15min":0.99199999999999999},"min":{"1min":0.70899999999999996,"5min":0.64400000000000002,"15min":0.55000000000000004},"max":{"1min":1.169,"5min":1.2649999999999999,"15min":3.5750000000000002},"last":0.70899999999999996}]},{"osd":3,"last update":"Sat Jun 10 19:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.90400000000000003,"15min":0.89900000000000002},"min":{"1min":0.628,"5min":0.56200000000000006,"15min":0.53900000000000003},"max":{"1min":1.28,"5min":1.46,"15min":2.3809999999999998},"last":1.28},{"interface":"front","average":{"1min":1.028,"5min":0.95699999999999996,"15min":0.96499999999999997},"min":{"1min":0.71899999999999997,"5min":0.61499999999999999,"15min":0.54400000000000004},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.6479999999999999},"last":1.4279999999999999}]},{"osd":5,"last update":"Sat Jun 10 19:05:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":0.94499999999999995,"15min":0.96599999999999997},"min":{"1min":0.70399999999999996,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.236,"5min":1.3360000000000001,"15min":3.6539999999999999},"last":1.2070000000000001},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.92500000000000004,"15min":0.95099999999999996},"min":{"1min":0.65800000000000003,"5min":0.495,"15min":0.495},"max":{"1min":1.2250000000000001,"5min":1.26,"15min":2.6720000000000002},"last":0.93899999999999995}]},{"osd":6,"last update":"Sat Jun 10 19:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.97499999999999998,"15min":0.98099999999999998},"min":{"1min":0.60399999999999998,"5min":0.58499999999999996,"15min":0.54900000000000004},"max":{"1min":1.413,"5min":1.413,"15min":2.2639999999999998},"last":0.66300000000000003},{"interface":"front","average":{"1min":1.131,"5min":1.0649999999999999,"15min":1.071},"min":{"1min":0.753,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":3.4980000000000002},"last":1.4670000000000001}]},{"osd":7,"last update":"Sat Jun 10 19:05:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.0189999999999999,"15min":0.999},"min":{"1min":0.79100000000000004,"5min":0.63800000000000001,"15min":0.41399999999999998},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":2.5910000000000002},"last":1.3919999999999999},{"interface":"front","average":{"1min":1.105,"5min":1.0780000000000001,"15min":1.0720000000000001},"min":{"1min":0.79900000000000004,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.3420000000000001,"5min":1.4279999999999999,"15min":1.4399999999999999},"last":0.877}]}]},{"osd":3,"up_from":13,"seq":55834575001,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32576,"kb_used_data":1528,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339264,"statfs":{"total":96636764160,"available":96603406336,"internally_reserved":0,"allocated":1564672,"data_stored":720575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.623,"15min":0.61199999999999999},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.94299999999999995,"5min":1.1539999999999999,"15min":1.169},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.67500000000000004,"15min":0.66600000000000004},"min":{"1min":0.30599999999999999,"5min":0.30299999999999999,"15min":0.251},"max":{"1min":0.97799999999999998,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.68600000000000005}]},{"osd":1,"last update":"Sat Jun 10 19:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.69599999999999995,"15min":0.67800000000000005},"min":{"1min":0.39900000000000002,"5min":0.33000000000000002,"15min":0.27500000000000002},"max":{"1min":1.01,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.72999999999999998,"15min":0.73599999999999999},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.318},"max":{"1min":0.99299999999999999,"5min":1.2569999999999999,"15min":1.411},"last":0.59299999999999997}]},{"osd":2,"last update":"Sat Jun 10 19:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.76300000000000001,"15min":0.77300000000000002},"min":{"1min":0.439,"5min":0.39300000000000002,"15min":0.30299999999999999},"max":{"1min":1.0269999999999999,"5min":1.3899999999999999,"15min":1.9530000000000001},"last":0.873},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.80000000000000004,"15min":0.78500000000000003},"min":{"1min":0.36599999999999999,"5min":0.35299999999999998,"15min":0.29699999999999999},"max":{"1min":1.141,"5min":1.591,"15min":1.591},"last":0.82699999999999996}]},{"osd":4,"last update":"Sat Jun 10 19:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.96999999999999997,"15min":0.95799999999999996},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.41899999999999998},"max":{"1min":1.2969999999999999,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.0489999999999999,"5min":0.995,"15min":0.99399999999999999},"min":{"1min":0.72099999999999997,"5min":0.61299999999999999,"15min":0.47999999999999998},"max":{"1min":1.4330000000000001,"5min":1.873,"15min":1.873},"last":1.0229999999999999}]},{"osd":5,"last update":"Sat Jun 10 19:04:48 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.0089999999999999,"15min":1.024},"min":{"1min":0.71099999999999997,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.536,"5min":1.752,"15min":2.024},"last":0.93100000000000005},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.02,"15min":1.0289999999999999},"min":{"1min":0.64800000000000002,"5min":0.60299999999999998,"15min":0.46899999999999997},"max":{"1min":1.3759999999999999,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":1.099}]},{"osd":6,"last update":"Sat Jun 10 19:04:48 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0569999999999999,"15min":1.0609999999999999},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.55300000000000005},"max":{"1min":1.49,"5min":1.786,"15min":1.8500000000000001},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.68899999999999995,"5min":0.61199999999999999,"15min":0.58799999999999997},"max":{"1min":1.395,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.99199999999999999}]},{"osd":7,"last update":"Sat Jun 10 19:04:48 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.0800000000000001,"15min":1.0980000000000001},"min":{"1min":0.58199999999999996,"5min":0.57999999999999996,"15min":0.56999999999999995},"max":{"1min":1.5720000000000001,"5min":2.1150000000000002,"15min":2.1150000000000002},"last":1.0529999999999999},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.79400000000000004,"5min":0.65500000000000003,"15min":0.61099999999999999},"max":{"1min":1.6779999999999999,"5min":1.9850000000000001,"15min":1.9850000000000001},"last":1.0740000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575002,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32564,"kb_used_data":1516,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339276,"statfs":{"total":96636764160,"available":96603418624,"internally_reserved":0,"allocated":1552384,"data_stored":719996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:04:59 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.621,"15min":0.61299999999999999},"min":{"1min":0.33700000000000002,"5min":0.31,"15min":0.27300000000000002},"max":{"1min":0.98799999999999999,"5min":1.095,"15min":1.1220000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.71699999999999997,"15min":0.72199999999999998},"min":{"1min":0.34999999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.59299999999999997}]},{"osd":1,"last update":"Sat Jun 10 19:04:59 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.65900000000000003,"15min":0.66600000000000004},"min":{"1min":0.39600000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.1950000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.745,"15min":0.748},"min":{"1min":0.375,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.1799999999999999,"5min":1.446,"15min":1.446},"last":0.77600000000000002}]},{"osd":3,"last update":"Sat Jun 10 19:04:59 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.78200000000000003,"15min":0.76900000000000002},"min":{"1min":0.45700000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.127,"5min":1.1899999999999999,"15min":1.2350000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.75800000000000001,"15min":0.77200000000000002},"min":{"1min":0.41799999999999998,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":1.032,"5min":1.181,"15min":1.3340000000000001},"last":0.74099999999999999}]},{"osd":4,"last update":"Sat Jun 10 19:04:59 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.90800000000000003,"15min":0.92500000000000004},"min":{"1min":0.67600000000000005,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.337,"5min":1.337,"15min":1.3620000000000001},"last":3.996},{"interface":"front","average":{"1min":1.044,"5min":0.996,"15min":1.0169999999999999},"min":{"1min":0.59699999999999998,"5min":0.496,"15min":0.496},"max":{"1min":1.3149999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":1.0049999999999999}]},{"osd":5,"last update":"Sat Jun 10 19:04:59 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":0.997,"15min":1.0129999999999999},"min":{"1min":0.63400000000000001,"5min":0.55900000000000005,"15min":0.54100000000000004},"max":{"1min":1.3129999999999999,"5min":1.5429999999999999,"15min":1.5700000000000001},"last":6.569},{"interface":"front","average":{"1min":1.105,"5min":1.01,"15min":1.014},"min":{"1min":0.753,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.5309999999999999,"5min":1.5609999999999999,"15min":1.667},"last":6.6349999999999998}]},{"osd":6,"last update":"Sat Jun 10 19:04:59 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.03,"15min":1.044},"min":{"1min":0.77800000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.5900000000000001},"last":4.5640000000000001},{"interface":"front","average":{"1min":1.054,"5min":1.0309999999999999,"15min":1.0449999999999999},"min":{"1min":0.58499999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.341,"5min":1.486,"15min":1.6499999999999999},"last":1.766}]},{"osd":7,"last update":"Sat Jun 10 19:04:59 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.097,"15min":1.1000000000000001},"min":{"1min":0.70499999999999996,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.339,"5min":1.734,"15min":1.734},"last":12.138},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.101,"15min":1.109},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.48,"5min":1.657,"15min":1.752},"last":1.248}]}]},{"osd":1,"up_from":13,"seq":55834575004,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36660,"kb_used_data":1516,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335180,"statfs":{"total":96636764160,"available":96599224320,"internally_reserved":0,"allocated":1552384,"data_stored":718999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:04:59 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65800000000000003,"15min":0.67500000000000004},"min":{"1min":0.36399999999999999,"5min":0.28599999999999998,"15min":0.25800000000000001},"max":{"1min":1.048,"5min":1.111,"15min":1.288},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.72899999999999998,"15min":0.73999999999999999},"min":{"1min":0.35399999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.105,"5min":1.1859999999999999,"15min":1.694},"last":0.91400000000000003}]},{"osd":2,"last update":"Sat Jun 10 19:04:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.63400000000000001,"15min":0.63800000000000001},"min":{"1min":0.38200000000000001,"5min":0.308,"15min":0.249},"max":{"1min":0.84099999999999997,"5min":1.0900000000000001,"15min":1.21},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.70499999999999996,"15min":0.71399999999999997},"min":{"1min":0.433,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.415},"last":0.78500000000000003}]},{"osd":3,"last update":"Sat Jun 10 19:04:59 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.75900000000000001,"15min":0.77900000000000003},"min":{"1min":0.34000000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.034,"5min":1.1679999999999999,"15min":1.6299999999999999},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.754,"5min":0.70599999999999996,"15min":0.74099999999999999},"min":{"1min":0.45900000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.998,"5min":1.2909999999999999,"15min":2.1749999999999998},"last":0.73999999999999999}]},{"osd":4,"last update":"Sat Jun 10 19:04:59 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.85799999999999998,"15min":0.86199999999999999},"min":{"1min":0.627,"5min":0.56399999999999995,"15min":0.53000000000000003},"max":{"1min":1.196,"5min":1.343,"15min":1.4930000000000001},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.96099999999999997,"15min":1.038},"min":{"1min":0.63900000000000001,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.2010000000000001,"5min":1.492,"15min":5.8209999999999997},"last":1.3340000000000001}]},{"osd":5,"last update":"Sat Jun 10 19:04:59 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.97399999999999998,"15min":1.0029999999999999},"min":{"1min":0.66800000000000004,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.244,"5min":1.6299999999999999,"15min":1.8620000000000001},"last":1.1539999999999999},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.94999999999999996,"15min":0.97599999999999998},"min":{"1min":0.59999999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.2809999999999999,"5min":1.3220000000000001,"15min":3.089},"last":0.95299999999999996}]},{"osd":6,"last update":"Sat Jun 10 19:04:59 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.999,"15min":1.0489999999999999},"min":{"1min":0.71699999999999997,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.145,"5min":1.6759999999999999,"15min":7.2599999999999998},"last":1.2130000000000001},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.98999999999999999,"15min":1.0349999999999999},"min":{"1min":0.72899999999999998,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.341,"5min":1.6000000000000001,"15min":9.0069999999999997},"last":1.0389999999999999}]},{"osd":7,"last update":"Sat Jun 10 19:04:59 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.05,"15min":1.0820000000000001},"min":{"1min":0.69999999999999996,"5min":0.495,"15min":0.495},"max":{"1min":1.4339999999999999,"5min":1.494,"15min":2.105},"last":1.3999999999999999},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.046,"15min":1.0820000000000001},"min":{"1min":0.75700000000000001,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.4670000000000001,"5min":1.5620000000000001,"15min":2.2570000000000001},"last":1.3080000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575003,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37240,"kb_used_data":2096,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334600,"statfs":{"total":96636764160,"available":96598630400,"internally_reserved":0,"allocated":2146304,"data_stored":1309367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jun 10 19:04:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.61699999999999999,"15min":0.63},"min":{"1min":0.34100000000000003,"5min":0.248,"15min":0.248},"max":{"1min":1.042,"5min":1.127,"15min":1.127},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.78800000000000003,"15min":0.79800000000000004},"min":{"1min":0.38,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.093,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.47899999999999998}]},{"osd":2,"last update":"Sat Jun 10 19:04:58 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.71999999999999997,"15min":0.71599999999999997},"min":{"1min":0.38100000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.1970000000000001,"5min":1.2010000000000001,"15min":1.2829999999999999},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.64100000000000001,"15min":0.65300000000000002},"min":{"1min":0.28699999999999998,"5min":0.27600000000000002,"15min":0.245},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.371},"last":0.30199999999999999}]},{"osd":3,"last update":"Sat Jun 10 19:04:58 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.66000000000000003,"15min":0.68400000000000005},"min":{"1min":0.40100000000000002,"5min":0.29499999999999998,"15min":0.28899999999999998},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.226},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.80400000000000005,"15min":0.82399999999999995},"min":{"1min":0.435,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.321,"5min":1.742,"15min":1.829},"last":0.504}]},{"osd":4,"last update":"Sat Jun 10 19:04:58 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.90700000000000003,"15min":0.92000000000000004},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.1619999999999999,"5min":1.7250000000000001,"15min":3.0209999999999999},"last":0.65600000000000003},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.012,"15min":1.0289999999999999},"min":{"1min":0.69199999999999995,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.2270000000000001,"5min":1.873,"15min":1.9510000000000001},"last":0.58799999999999997}]},{"osd":5,"last update":"Sat Jun 10 19:04:58 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.91900000000000004,"15min":0.93999999999999995},"min":{"1min":0.624,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.206,"5min":1.3109999999999999,"15min":1.694},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.97799999999999998,"15min":1.008},"min":{"1min":0.71699999999999997,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.2749999999999999,"5min":1.78,"15min":4.5620000000000003},"last":0.60399999999999998}]},{"osd":6,"last update":"Sat Jun 10 19:04:58 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.042,"15min":1.077},"min":{"1min":0.58699999999999997,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.395,"5min":1.7909999999999999,"15min":3.5569999999999999},"last":0.628},{"interface":"front","average":{"1min":1.0109999999999999,"5min":0.98799999999999999,"15min":1.002},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.3049999999999999,"5min":1.6319999999999999,"15min":1.883},"last":0.71099999999999997}]},{"osd":7,"last update":"Sat Jun 10 19:04:58 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.0129999999999999,"15min":1.032},"min":{"1min":0.57299999999999995,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.2250000000000001,"5min":1.512,"15min":1.5800000000000001},"last":0.61799999999999999},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.036,"15min":1.0580000000000001},"min":{"1min":0.80600000000000005,"5min":0.624,"15min":0.58699999999999997},"max":{"1min":1.298,"5min":1.6619999999999999,"15min":1.9830000000000001},"last":0.67700000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-10T19:05:08.445 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-06-10T19:05:08.445 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-06-10T19:05:08.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.612+0000 7f6ce2c4f640 1 Processor -- start 2023-06-10T19:05:08.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.612+0000 7f6ce2c4f640 1 -- start start 2023-06-10T19:05:08.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.612+0000 7f6ce2c4f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6cdc159390 0x7f6cdc15d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:08.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.612+0000 7f6ce2c4f640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6cdc15d6e0 0x7f6cdc0cec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:08.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.612+0000 7f6ce2c4f640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cdc0cb460 con 0x7f6cdc159760 2023-06-10T19:05:08.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.612+0000 7f6ce2c4f640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cdc15e1b0 con 0x7f6cdc15d6e0 2023-06-10T19:05:08.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.612+0000 7f6ce2c4f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cdc15dbf0 con 0x7f6cdc159390 2023-06-10T19:05:08.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.616+0000 7f6ce09eb640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6cdc159390 0x7f6cdc15d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:08.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.616+0000 7f6ce11ec640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f6cdc159760 0x7f6cdc0cda40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.53:51968/0 (socket says 172.21.15.53:51968) 2023-06-10T19:05:08.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.616+0000 7f6ce11ec640 1 -- 172.21.15.53:0/2307194153 learned_addr learned my addr 172.21.15.53:0/2307194153 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:05:08.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.616+0000 7f6cdbfff640 1 --2- 172.21.15.53:0/2307194153 >> v2:172.21.15.117:3300/0 conn(0x7f6cdc15d6e0 0x7f6cdc0cec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:08.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.616+0000 7f6ce09eb640 1 -- 172.21.15.53:0/2307194153 >> v2:172.21.15.117:3300/0 conn(0x7f6cdc15d6e0 msgr2=0x7f6cdc0cec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:08.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.616+0000 7f6ce09eb640 1 --2- 172.21.15.53:0/2307194153 >> v2:172.21.15.117:3300/0 conn(0x7f6cdc15d6e0 0x7f6cdc0cec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:08.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.616+0000 7f6ce09eb640 1 -- 172.21.15.53:0/2307194153 >> v1:172.21.15.117:6789/0 conn(0x7f6cdc159760 legacy=0x7f6cdc0cda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:08.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.616+0000 7f6ce09eb640 1 -- 172.21.15.53:0/2307194153 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cdc15ded0 con 0x7f6cdc159390 2023-06-10T19:05:08.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.616+0000 7f6cdbfff640 1 --2- 172.21.15.53:0/2307194153 >> v2:172.21.15.117:3300/0 conn(0x7f6cdc15d6e0 0x7f6cdc0cec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-10T19:05:08.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.616+0000 7f6ce09eb640 1 --2- 172.21.15.53:0/2307194153 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6cdc159390 0x7f6cdc15d1a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc0097c0 tx=0x7f6ccc01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d82ebf26e957a483 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:08.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.616+0000 7f6cdb7fe640 1 -- 172.21.15.53:0/2307194153 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ccc0ab650 con 0x7f6cdc159390 2023-06-10T19:05:08.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.616+0000 7f6cdb7fe640 1 -- 172.21.15.53:0/2307194153 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ccc0ab7b0 con 0x7f6cdc159390 2023-06-10T19:05:08.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.616+0000 7f6cdb7fe640 1 -- 172.21.15.53:0/2307194153 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ccc0abb40 con 0x7f6cdc159390 2023-06-10T19:05:08.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.620+0000 7f6ce2c4f640 1 -- 172.21.15.53:0/2307194153 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6cdc159390 msgr2=0x7f6cdc15d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:08.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.620+0000 7f6ce2c4f640 1 --2- 172.21.15.53:0/2307194153 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6cdc159390 0x7f6cdc15d1a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc0097c0 tx=0x7f6ccc01c450 comp rx=0 tx=0).stop 2023-06-10T19:05:08.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.620+0000 7f6ce2c4f640 1 -- 172.21.15.53:0/2307194153 shutdown_connections 2023-06-10T19:05:08.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.620+0000 7f6ce2c4f640 1 --2- 172.21.15.53:0/2307194153 >> v2:172.21.15.117:3300/0 conn(0x7f6cdc15d6e0 0x7f6cdc0cec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:08.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.620+0000 7f6ce2c4f640 1 --2- 172.21.15.53:0/2307194153 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6cdc159390 0x7f6cdc15d1a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:08.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.620+0000 7f6ce2c4f640 1 -- 172.21.15.53:0/2307194153 >> 172.21.15.53:0/2307194153 conn(0x7f6cdc06a090 msgr2=0x7f6cdc06d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:08.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.620+0000 7f6ce2c4f640 1 -- 172.21.15.53:0/2307194153 shutdown_connections 2023-06-10T19:05:08.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.620+0000 7f6ce2c4f640 1 -- 172.21.15.53:0/2307194153 wait complete. 2023-06-10T19:05:08.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.620+0000 7f6ce2c4f640 1 Processor -- start 2023-06-10T19:05:08.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.620+0000 7f6ce2c4f640 1 -- start start 2023-06-10T19:05:08.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.620+0000 7f6ce2c4f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6cdc159390 0x7f6cdc0c7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:08.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.620+0000 7f6ce2c4f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6cdc159760 0x7f6cdc0c8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:08.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.620+0000 7f6ce2c4f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6cdc15d6e0 0x7f6cdc06baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:08.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.620+0000 7f6ce2c4f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cdc0c78e0 con 0x7f6cdc159390 2023-06-10T19:05:08.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.620+0000 7f6ce2c4f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cdc0c9630 con 0x7f6cdc159760 2023-06-10T19:05:08.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.620+0000 7f6ce2c4f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cdc0c6f40 con 0x7f6cdc15d6e0 2023-06-10T19:05:08.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.620+0000 7f6ce09eb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6cdc159390 0x7f6cdc0c7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:08.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.620+0000 7f6ce09eb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6cdc159390 0x7f6cdc0c7d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60178/0 (socket says 172.21.15.53:60178) 2023-06-10T19:05:08.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.620+0000 7f6ce09eb640 1 -- 172.21.15.53:0/3244204836 learned_addr learned my addr 172.21.15.53:0/3244204836 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:08.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.620+0000 7f6ce11ec640 1 --2- 172.21.15.53:0/3244204836 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6cdc15d6e0 0x7f6cdc06baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:08.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.620+0000 7f6cdbfff640 1 --2- 172.21.15.53:0/3244204836 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6cdc159760 0x7f6cdc0c8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:08.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.620+0000 7f6ce09eb640 1 -- 172.21.15.53:0/3244204836 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6cdc15d6e0 msgr2=0x7f6cdc06baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:08.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.620+0000 7f6ce09eb640 1 --2- 172.21.15.53:0/3244204836 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6cdc15d6e0 0x7f6cdc06baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:08.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.620+0000 7f6ce09eb640 1 -- 172.21.15.53:0/3244204836 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6cdc159760 msgr2=0x7f6cdc0c8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:08.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.620+0000 7f6ce09eb640 1 --2- 172.21.15.53:0/3244204836 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6cdc159760 0x7f6cdc0c8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:08.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.620+0000 7f6ce09eb640 1 -- 172.21.15.53:0/3244204836 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cd0009420 con 0x7f6cdc159390 2023-06-10T19:05:08.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.620+0000 7f6ce09eb640 1 --2- 172.21.15.53:0/3244204836 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6cdc159390 0x7f6cdc0c7d00 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc01a080 tx=0x7f6ccc01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:08.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.620+0000 7f6cd97fa640 1 -- 172.21.15.53:0/3244204836 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ccc0b5810 con 0x7f6cdc159390 2023-06-10T19:05:08.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.620+0000 7f6cd97fa640 1 -- 172.21.15.53:0/3244204836 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ccc0b5970 con 0x7f6cdc159390 2023-06-10T19:05:08.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.620+0000 7f6cd97fa640 1 -- 172.21.15.53:0/3244204836 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ccc0b5d00 con 0x7f6cdc159390 2023-06-10T19:05:08.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.620+0000 7f6ce2c4f640 1 -- 172.21.15.53:0/3244204836 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ccc009420 con 0x7f6cdc159390 2023-06-10T19:05:08.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.624+0000 7f6ce2c4f640 1 -- 172.21.15.53:0/3244204836 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cdc0c7500 con 0x7f6cdc159390 2023-06-10T19:05:08.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.624+0000 7f6ce2c4f640 1 -- 172.21.15.53:0/3244204836 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cdc0c7a20 con 0x7f6cdc159390 2023-06-10T19:05:08.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.624+0000 7f6cd97fa640 1 -- 172.21.15.53:0/3244204836 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6ccc0c83a0 con 0x7f6cdc159390 2023-06-10T19:05:08.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.624+0000 7f6cd97fa640 1 --2- 172.21.15.53:0/3244204836 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6cc8066280 0x7f6cc8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:08.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.624+0000 7f6cd97fa640 1 -- 172.21.15.53:0/3244204836 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6ccc11ec90 con 0x7f6cdc159390 2023-06-10T19:05:08.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.624+0000 7f6cdbfff640 1 --2- 172.21.15.53:0/3244204836 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6cc8066280 0x7f6cc8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:08.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.624+0000 7f6cdbfff640 1 --2- 172.21.15.53:0/3244204836 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6cc8066280 0x7f6cc8068730 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc06fe30 tx=0x7f6cd0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:08.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.628+0000 7f6cd97fa640 1 -- 172.21.15.53:0/3244204836 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6ccc0ec2c0 con 0x7f6cdc159390 2023-06-10T19:05:08.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.828+0000 7f6ce2c4f640 1 -- 172.21.15.53:0/3244204836 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f6cdc04d790 con 0x7f6cdc159390 2023-06-10T19:05:08.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.840+0000 7f6cd97fa640 1 -- 172.21.15.53:0/3244204836 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v19) v1 ==== 190+0+0 (secure 0 0 0) 0x7f6ccc0c4020 con 0x7f6cdc159390 2023-06-10T19:05:08.843 INFO:teuthology.orchestra.run.smithi053.stderr:updated caps for client.0 2023-06-10T19:05:08.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.840+0000 7f6ce2c4f640 1 -- 172.21.15.53:0/3244204836 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6cc8066280 msgr2=0x7f6cc8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:08.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.840+0000 7f6ce2c4f640 1 --2- 172.21.15.53:0/3244204836 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6cc8066280 0x7f6cc8068730 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc06fe30 tx=0x7f6cd0008040 comp rx=0 tx=0).stop 2023-06-10T19:05:08.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.840+0000 7f6ce2c4f640 1 -- 172.21.15.53:0/3244204836 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6cdc159390 msgr2=0x7f6cdc0c7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:08.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.840+0000 7f6ce2c4f640 1 --2- 172.21.15.53:0/3244204836 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6cdc159390 0x7f6cdc0c7d00 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc01a080 tx=0x7f6ccc01ac90 comp rx=0 tx=0).stop 2023-06-10T19:05:08.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.840+0000 7f6ce2c4f640 1 -- 172.21.15.53:0/3244204836 shutdown_connections 2023-06-10T19:05:08.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.840+0000 7f6ce2c4f640 1 --2- 172.21.15.53:0/3244204836 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6cc8066280 0x7f6cc8068730 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:08.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.840+0000 7f6ce2c4f640 1 --2- 172.21.15.53:0/3244204836 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6cdc15d6e0 0x7f6cdc06baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:08.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.840+0000 7f6ce2c4f640 1 --2- 172.21.15.53:0/3244204836 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6cdc159760 0x7f6cdc0c8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:08.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.840+0000 7f6ce2c4f640 1 --2- 172.21.15.53:0/3244204836 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6cdc159390 0x7f6cdc0c7d00 unknown :-1 s=CLOSED pgs=1891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:08.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.840+0000 7f6ce2c4f640 1 -- 172.21.15.53:0/3244204836 >> 172.21.15.53:0/3244204836 conn(0x7f6cdc06a090 msgr2=0x7f6cdc0b2ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:08.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.840+0000 7f6ce2c4f640 1 -- 172.21.15.53:0/3244204836 shutdown_connections 2023-06-10T19:05:08.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.840+0000 7f6ce2c4f640 1 -- 172.21.15.53:0/3244204836 wait complete. 2023-06-10T19:05:08.861 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:05:08.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.972+0000 7f5e68477640 1 Processor -- start 2023-06-10T19:05:08.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.972+0000 7f5e68477640 1 -- start start 2023-06-10T19:05:08.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.972+0000 7f5e68477640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5e600b06d0 0x7f5e6006a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:08.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.972+0000 7f5e68477640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e6006ae70 con 0x7f5e6015b870 2023-06-10T19:05:08.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.972+0000 7f5e68477640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e600655c0 con 0x7f5e6015f450 2023-06-10T19:05:08.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.972+0000 7f5e68477640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e600cc110 con 0x7f5e600b06d0 2023-06-10T19:05:08.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.972+0000 7f5e66213640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f5e6015b870 0x7f5e600affc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:35614/0 (socket says 172.21.15.53:35614) 2023-06-10T19:05:08.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.972+0000 7f5e66213640 1 -- 172.21.15.53:0/4200803977 learned_addr learned my addr 172.21.15.53:0/4200803977 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:05:08.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.972+0000 7f5e65a12640 1 --2- 172.21.15.53:0/4200803977 >> v2:172.21.15.117:3300/0 conn(0x7f5e600b06d0 0x7f5e6006a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:08.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.972+0000 7f5e65211640 1 -- 172.21.15.53:0/4200803977 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4177042989 0 0) 0x7f5e580014a0 con 0x7f5e6015b870 2023-06-10T19:05:08.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.972+0000 7f5e65211640 1 -- 172.21.15.53:0/4200803977 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e4c003530 con 0x7f5e6015b870 2023-06-10T19:05:08.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.972+0000 7f5e65211640 1 -- 172.21.15.53:0/4200803977 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 198110315 0 0) 0x7f5e4c003530 con 0x7f5e6015b870 2023-06-10T19:05:08.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.972+0000 7f5e65211640 1 -- 172.21.15.53:0/4200803977 >> v2:172.21.15.117:3300/0 conn(0x7f5e600b06d0 msgr2=0x7f5e6006a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:08.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.972+0000 7f5e65211640 1 --2- 172.21.15.53:0/4200803977 >> v2:172.21.15.117:3300/0 conn(0x7f5e600b06d0 0x7f5e6006a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:08.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.972+0000 7f5e65211640 1 -- 172.21.15.53:0/4200803977 >> v1:172.21.15.117:6789/0 conn(0x7f5e6015f450 legacy=0x7f5e6015f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:08.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.972+0000 7f5e65211640 1 -- 172.21.15.53:0/4200803977 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e600cc3f0 con 0x7f5e6015b870 2023-06-10T19:05:08.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.972+0000 7f5e65211640 1 -- 172.21.15.53:0/4200803977 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f5e58001b90 con 0x7f5e6015b870 2023-06-10T19:05:08.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.972+0000 7f5e65211640 1 -- 172.21.15.53:0/4200803977 >> v1:172.21.15.53:6789/0 conn(0x7f5e6015b870 legacy=0x7f5e600affc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:08.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.972+0000 7f5e65211640 1 --2- 172.21.15.53:0/4200803977 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e4c0039f0 0x7f5e4c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:08.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.972+0000 7f5e65211640 1 --2- 172.21.15.53:0/4200803977 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e4c0047d0 0x7f5e4c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:08.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.972+0000 7f5e65211640 1 --2- 172.21.15.53:0/4200803977 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e4c0052a0 0x7f5e4c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:08.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.972+0000 7f5e65211640 1 -- 172.21.15.53:0/4200803977 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e600cc110 con 0x7f5e4c0052a0 2023-06-10T19:05:08.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.972+0000 7f5e65211640 1 -- 172.21.15.53:0/4200803977 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4c00c1b0 con 0x7f5e4c0047d0 2023-06-10T19:05:08.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.972+0000 7f5e65211640 1 -- 172.21.15.53:0/4200803977 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4c00c370 con 0x7f5e4c0039f0 2023-06-10T19:05:08.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.972+0000 7f5e66a14640 1 --2- 172.21.15.53:0/4200803977 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e4c0052a0 0x7f5e4c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:08.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.972+0000 7f5e65a12640 1 --2- 172.21.15.53:0/4200803977 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e4c0047d0 0x7f5e4c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:08.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.972+0000 7f5e66213640 1 --2- 172.21.15.53:0/4200803977 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e4c0039f0 0x7f5e4c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:08.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.972+0000 7f5e66a14640 1 -- 172.21.15.53:0/4200803977 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e4c0039f0 msgr2=0x7f5e4c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:08.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.972+0000 7f5e66a14640 1 --2- 172.21.15.53:0/4200803977 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e4c0039f0 0x7f5e4c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:08.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.972+0000 7f5e66a14640 1 -- 172.21.15.53:0/4200803977 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e4c0047d0 msgr2=0x7f5e4c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:08.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.972+0000 7f5e66a14640 1 --2- 172.21.15.53:0/4200803977 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e4c0047d0 0x7f5e4c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:08.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.972+0000 7f5e66a14640 1 -- 172.21.15.53:0/4200803977 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e4c003530 con 0x7f5e4c0052a0 2023-06-10T19:05:08.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.972+0000 7f5e66213640 1 --2- 172.21.15.53:0/4200803977 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e4c0039f0 0x7f5e4c003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:05:08.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.976+0000 7f5e66a14640 1 -- 172.21.15.53:0/4200803977 reap_dead start 2023-06-10T19:05:08.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.976+0000 7f5e66a14640 1 --2- 172.21.15.53:0/4200803977 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e4c0052a0 0x7f5e4c00b990 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c001780 tx=0x7f5e5c01c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cc6192d3025eed2 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:08.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.976+0000 7f5e65211640 1 -- 172.21.15.53:0/4200803977 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e5c0052d0 con 0x7f5e4c0052a0 2023-06-10T19:05:08.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.976+0000 7f5e65211640 1 -- 172.21.15.53:0/4200803977 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e5c0a7050 con 0x7f5e4c0052a0 2023-06-10T19:05:08.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.976+0000 7f5e65211640 1 -- 172.21.15.53:0/4200803977 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e5c003600 con 0x7f5e4c0052a0 2023-06-10T19:05:08.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.976+0000 7f5e68477640 1 -- 172.21.15.53:0/4200803977 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e4c0052a0 msgr2=0x7f5e4c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:08.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.976+0000 7f5e68477640 1 --2- 172.21.15.53:0/4200803977 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e4c0052a0 0x7f5e4c00b990 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c001780 tx=0x7f5e5c01c3d0 comp rx=0 tx=0).stop 2023-06-10T19:05:08.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.976+0000 7f5e68477640 1 -- 172.21.15.53:0/4200803977 shutdown_connections 2023-06-10T19:05:08.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.976+0000 7f5e68477640 1 --2- 172.21.15.53:0/4200803977 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e4c0052a0 0x7f5e4c00b990 unknown :-1 s=CLOSED pgs=1893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:08.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.976+0000 7f5e68477640 1 -- 172.21.15.53:0/4200803977 >> 172.21.15.53:0/4200803977 conn(0x7f5e600cafc0 msgr2=0x7f5e600cb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:08.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.976+0000 7f5e68477640 1 -- 172.21.15.53:0/4200803977 shutdown_connections 2023-06-10T19:05:08.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.976+0000 7f5e68477640 1 -- 172.21.15.53:0/4200803977 wait complete. 2023-06-10T19:05:08.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.976+0000 7f5e68477640 1 Processor -- start 2023-06-10T19:05:08.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.976+0000 7f5e68477640 1 -- start start 2023-06-10T19:05:08.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.980+0000 7f5e68477640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e4c0052a0 0x7f5e6015e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:08.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.980+0000 7f5e68477640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e600afbf0 0x7f5e601f7e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:08.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.980+0000 7f5e68477640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e601f8370 0x7f5e601f8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:08.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.980+0000 7f5e68477640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6015cdf0 con 0x7f5e600afbf0 2023-06-10T19:05:08.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.980+0000 7f5e68477640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6014ff40 con 0x7f5e601f8370 2023-06-10T19:05:08.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.980+0000 7f5e68477640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e60150970 con 0x7f5e4c0052a0 2023-06-10T19:05:08.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.980+0000 7f5e65a12640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e600afbf0 0x7f5e601f7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:08.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.980+0000 7f5e65a12640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e600afbf0 0x7f5e601f7e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60200/0 (socket says 172.21.15.53:60200) 2023-06-10T19:05:08.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.980+0000 7f5e65a12640 1 -- 172.21.15.53:0/1018807859 learned_addr learned my addr 172.21.15.53:0/1018807859 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:08.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.980+0000 7f5e66213640 1 --2- 172.21.15.53:0/1018807859 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e4c0052a0 0x7f5e6015e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:08.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.980+0000 7f5e66a14640 1 --2- 172.21.15.53:0/1018807859 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e601f8370 0x7f5e601f8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:08.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.980+0000 7f5e65a12640 1 -- 172.21.15.53:0/1018807859 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e4c0052a0 msgr2=0x7f5e6015e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:08.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.980+0000 7f5e65a12640 1 --2- 172.21.15.53:0/1018807859 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e4c0052a0 0x7f5e6015e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:08.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.980+0000 7f5e65a12640 1 -- 172.21.15.53:0/1018807859 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e601f8370 msgr2=0x7f5e601f8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:08.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.980+0000 7f5e65a12640 1 --2- 172.21.15.53:0/1018807859 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e601f8370 0x7f5e601f8810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:08.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.980+0000 7f5e65a12640 1 -- 172.21.15.53:0/1018807859 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e60150130 con 0x7f5e600afbf0 2023-06-10T19:05:08.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.980+0000 7f5e66213640 1 --2- 172.21.15.53:0/1018807859 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e4c0052a0 0x7f5e6015e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:05:08.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.980+0000 7f5e66a14640 1 --2- 172.21.15.53:0/1018807859 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e601f8370 0x7f5e601f8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:05:08.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.980+0000 7f5e65a12640 1 --2- 172.21.15.53:0/1018807859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e600afbf0 0x7f5e601f7e30 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7f5e500115f0 tx=0x7f5e50011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:08.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.980+0000 7f5e56ffd640 1 -- 172.21.15.53:0/1018807859 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e50004220 con 0x7f5e600afbf0 2023-06-10T19:05:08.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.980+0000 7f5e56ffd640 1 -- 172.21.15.53:0/1018807859 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e50004380 con 0x7f5e600afbf0 2023-06-10T19:05:08.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.980+0000 7f5e68477640 1 -- 172.21.15.53:0/1018807859 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e600af200 con 0x7f5e600afbf0 2023-06-10T19:05:08.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.980+0000 7f5e56ffd640 1 -- 172.21.15.53:0/1018807859 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e50015870 con 0x7f5e600afbf0 2023-06-10T19:05:08.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.980+0000 7f5e68477640 1 -- 172.21.15.53:0/1018807859 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e600b1390 con 0x7f5e600afbf0 2023-06-10T19:05:08.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.980+0000 7f5e68477640 1 -- 172.21.15.53:0/1018807859 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e60150b00 con 0x7f5e600afbf0 2023-06-10T19:05:08.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.980+0000 7f5e56ffd640 1 -- 172.21.15.53:0/1018807859 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5e500159d0 con 0x7f5e600afbf0 2023-06-10T19:05:08.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.980+0000 7f5e56ffd640 1 --2- 172.21.15.53:0/1018807859 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5e44066280 0x7f5e44068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:08.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.980+0000 7f5e56ffd640 1 -- 172.21.15.53:0/1018807859 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5e50083d00 con 0x7f5e600afbf0 2023-06-10T19:05:08.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.980+0000 7f5e66213640 1 --2- 172.21.15.53:0/1018807859 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5e44066280 0x7f5e44068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:08.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.984+0000 7f5e66213640 1 --2- 172.21.15.53:0/1018807859 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5e44066280 0x7f5e44068730 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f5e58002240 tx=0x7f5e58009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:08.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:08.984+0000 7f5e56ffd640 1 -- 172.21.15.53:0/1018807859 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5e50051210 con 0x7f5e600afbf0 2023-06-10T19:05:09.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.164+0000 7f5e68477640 1 -- 172.21.15.53:0/1018807859 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5e6004d790 con 0x7f5e600afbf0 2023-06-10T19:05:09.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.168+0000 7f5e56ffd640 1 -- 172.21.15.53:0/1018807859 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) v1 ==== 94+0+4676 (secure 0 0 0) 0x7f5e50022090 con 0x7f5e600afbf0 2023-06-10T19:05:09.171 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:05:09.172 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":69,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7684,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/618082531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":618082531},{"type":"v1","addr":"172.21.15.117:6835","nonce":618082531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":7687,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3984577716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":3984577716},{"type":"v1","addr":"172.21.15.117:6837","nonce":3984577716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":9144,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/3202804884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3202804884},{"type":"v1","addr":"172.21.15.53:6833","nonce":3202804884}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:05:04.878347+0000","modified":"2023-06-10T19:05:07.051606+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9147},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9147":{"gid":9147,"name":"c","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/3233917972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":3233917972},{"type":"v1","addr":"172.21.15.53:6835","nonce":3233917972}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-06-10T19:05:09.172 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 69 2023-06-10T19:05:09.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.168+0000 7f5e68477640 1 -- 172.21.15.53:0/1018807859 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5e44066280 msgr2=0x7f5e44068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:09.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.168+0000 7f5e68477640 1 --2- 172.21.15.53:0/1018807859 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5e44066280 0x7f5e44068730 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f5e58002240 tx=0x7f5e58009040 comp rx=0 tx=0).stop 2023-06-10T19:05:09.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.168+0000 7f5e68477640 1 -- 172.21.15.53:0/1018807859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e600afbf0 msgr2=0x7f5e601f7e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:09.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.168+0000 7f5e68477640 1 --2- 172.21.15.53:0/1018807859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e600afbf0 0x7f5e601f7e30 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7f5e500115f0 tx=0x7f5e50011ab0 comp rx=0 tx=0).stop 2023-06-10T19:05:09.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.168+0000 7f5e68477640 1 -- 172.21.15.53:0/1018807859 shutdown_connections 2023-06-10T19:05:09.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.168+0000 7f5e68477640 1 --2- 172.21.15.53:0/1018807859 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5e44066280 0x7f5e44068730 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:09.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.168+0000 7f5e68477640 1 --2- 172.21.15.53:0/1018807859 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e601f8370 0x7f5e601f8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:09.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.168+0000 7f5e68477640 1 --2- 172.21.15.53:0/1018807859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5e600afbf0 0x7f5e601f7e30 unknown :-1 s=CLOSED pgs=1894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:09.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.168+0000 7f5e68477640 1 --2- 172.21.15.53:0/1018807859 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5e4c0052a0 0x7f5e6015e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:09.175 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.168+0000 7f5e68477640 1 -- 172.21.15.53:0/1018807859 >> 172.21.15.53:0/1018807859 conn(0x7f5e600cafc0 msgr2=0x7f5e6006f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:09.175 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.168+0000 7f5e68477640 1 -- 172.21.15.53:0/1018807859 shutdown_connections 2023-06-10T19:05:09.175 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.168+0000 7f5e68477640 1 -- 172.21.15.53:0/1018807859 wait complete. 2023-06-10T19:05:09.591 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 69, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-06-10T19:05:04.878347+0000', 'modified': '2023-06-10T19:05:07.051606+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9147}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9147': {'gid': 9147, 'name': 'c', 'rank': 0, 'incarnation': 67, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.53:6835/3233917972', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.53:6834', 'nonce': 3233917972}, {'type': 'v1', 'addr': '172.21.15.53:6835', 'nonce': 3233917972}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-06-10T19:05:09.592 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-06-10T19:05:09.592 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-06-10T19:05:09.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.724+0000 7f4288043640 1 Processor -- start 2023-06-10T19:05:09.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.724+0000 7f4288043640 1 -- start start 2023-06-10T19:05:09.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.724+0000 7f4288043640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4280152bb0 0x7f42800c8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:09.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.724+0000 7f4288043640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f428006b9c0 0x7f428015c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:09.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.724+0000 7f4288043640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f428015cbb0 con 0x7f428015c210 2023-06-10T19:05:09.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.724+0000 7f4288043640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42800c8850 con 0x7f4280152bb0 2023-06-10T19:05:09.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.724+0000 7f4288043640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42800cc8f0 con 0x7f428006b9c0 2023-06-10T19:05:09.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.724+0000 7f42855de640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f428015c210 0x7f4280158c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:35618/0 (socket says 172.21.15.53:35618) 2023-06-10T19:05:09.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.724+0000 7f42855de640 1 -- 172.21.15.53:0/3533629769 learned_addr learned my addr 172.21.15.53:0/3533629769 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:05:09.732 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.724+0000 7f4285ddf640 1 --2- 172.21.15.53:0/3533629769 >> v2:172.21.15.117:3300/0 conn(0x7f4280152bb0 0x7f42800c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:09.732 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.724+0000 7f42865e0640 1 --2- 172.21.15.53:0/3533629769 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f428006b9c0 0x7f428015c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:09.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.724+0000 7f4284ddd640 1 -- 172.21.15.53:0/3533629769 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3585860238 0 0) 0x7f428015cbb0 con 0x7f428015c210 2023-06-10T19:05:09.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.724+0000 7f4284ddd640 1 -- 172.21.15.53:0/3533629769 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f426c003530 con 0x7f428015c210 2023-06-10T19:05:09.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.724+0000 7f4284ddd640 1 -- 172.21.15.53:0/3533629769 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1589237599 0 0) 0x7f426c003530 con 0x7f428015c210 2023-06-10T19:05:09.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.728+0000 7f4284ddd640 1 -- 172.21.15.53:0/3533629769 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f428006b9c0 msgr2=0x7f428015c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:09.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.728+0000 7f4284ddd640 1 --2- 172.21.15.53:0/3533629769 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f428006b9c0 0x7f428015c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:09.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.728+0000 7f4284ddd640 1 -- 172.21.15.53:0/3533629769 >> v2:172.21.15.117:3300/0 conn(0x7f4280152bb0 msgr2=0x7f42800c8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:09.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.728+0000 7f4284ddd640 1 --2- 172.21.15.53:0/3533629769 >> v2:172.21.15.117:3300/0 conn(0x7f4280152bb0 0x7f42800c8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:09.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.728+0000 7f4284ddd640 1 -- 172.21.15.53:0/3533629769 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42800c8b90 con 0x7f428015c210 2023-06-10T19:05:09.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.728+0000 7f4284ddd640 1 -- 172.21.15.53:0/3533629769 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f4270001680 con 0x7f428015c210 2023-06-10T19:05:09.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.728+0000 7f4284ddd640 1 -- 172.21.15.53:0/3533629769 >> v1:172.21.15.53:6789/0 conn(0x7f428015c210 legacy=0x7f4280158c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:09.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.728+0000 7f4284ddd640 1 --2- 172.21.15.53:0/3533629769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f426c003980 0x7f426c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:09.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.728+0000 7f4284ddd640 1 --2- 172.21.15.53:0/3533629769 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f428006b9c0 0x7f426c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:09.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.728+0000 7f4284ddd640 1 --2- 172.21.15.53:0/3533629769 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f426c004d10 0x7f426c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:09.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.728+0000 7f4284ddd640 1 -- 172.21.15.53:0/3533629769 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42800c8850 con 0x7f426c003980 2023-06-10T19:05:09.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.728+0000 7f4284ddd640 1 -- 172.21.15.53:0/3533629769 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42800cc8f0 con 0x7f426c004d10 2023-06-10T19:05:09.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.728+0000 7f4284ddd640 1 -- 172.21.15.53:0/3533629769 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f426c00b990 con 0x7f428006b9c0 2023-06-10T19:05:09.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.728+0000 7f4285ddf640 1 --2- 172.21.15.53:0/3533629769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f426c003980 0x7f426c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:09.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.728+0000 7f42855de640 1 --2- 172.21.15.53:0/3533629769 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f428006b9c0 0x7f426c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:09.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.728+0000 7f42865e0640 1 --2- 172.21.15.53:0/3533629769 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f426c004d10 0x7f426c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:09.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.728+0000 7f4285ddf640 1 -- 172.21.15.53:0/3533629769 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f428006b9c0 msgr2=0x7f426c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:09.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.728+0000 7f4285ddf640 1 --2- 172.21.15.53:0/3533629769 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f428006b9c0 0x7f426c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:09.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.728+0000 7f4285ddf640 1 -- 172.21.15.53:0/3533629769 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f426c004d10 msgr2=0x7f426c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:09.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.728+0000 7f4285ddf640 1 --2- 172.21.15.53:0/3533629769 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f426c004d10 0x7f426c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:09.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.728+0000 7f4285ddf640 1 -- 172.21.15.53:0/3533629769 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f426c003530 con 0x7f426c003980 2023-06-10T19:05:09.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.728+0000 7f42865e0640 1 --2- 172.21.15.53:0/3533629769 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f426c004d10 0x7f426c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:05:09.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.728+0000 7f4285ddf640 1 --2- 172.21.15.53:0/3533629769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f426c003980 0x7f426c003d90 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 crypto rx=0x7f427c009650 tx=0x7f427c01ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9058742efd3c10e server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:09.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.728+0000 7f4284ddd640 1 -- 172.21.15.53:0/3533629769 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427c0059a0 con 0x7f426c003980 2023-06-10T19:05:09.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.728+0000 7f4284ddd640 1 -- 172.21.15.53:0/3533629769 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f427c005b00 con 0x7f426c003980 2023-06-10T19:05:09.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.728+0000 7f4284ddd640 1 -- 172.21.15.53:0/3533629769 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427c0a7770 con 0x7f426c003980 2023-06-10T19:05:09.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.728+0000 7f4288043640 1 -- 172.21.15.53:0/3533629769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f426c003980 msgr2=0x7f426c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:09.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.728+0000 7f4288043640 1 --2- 172.21.15.53:0/3533629769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f426c003980 0x7f426c003d90 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 crypto rx=0x7f427c009650 tx=0x7f427c01ec20 comp rx=0 tx=0).stop 2023-06-10T19:05:09.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.728+0000 7f42865e0640 1 -- 172.21.15.53:0/3533629769 reap_dead start 2023-06-10T19:05:09.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.728+0000 7f4288043640 1 -- 172.21.15.53:0/3533629769 shutdown_connections 2023-06-10T19:05:09.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.728+0000 7f4288043640 1 -- 172.21.15.53:0/3533629769 >> 172.21.15.53:0/3533629769 conn(0x7f42800ce9e0 msgr2=0x7f42800ca7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:09.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.728+0000 7f4288043640 1 -- 172.21.15.53:0/3533629769 shutdown_connections 2023-06-10T19:05:09.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.728+0000 7f4288043640 1 -- 172.21.15.53:0/3533629769 wait complete. 2023-06-10T19:05:09.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.732+0000 7f4288043640 1 Processor -- start 2023-06-10T19:05:09.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.732+0000 7f4288043640 1 -- start start 2023-06-10T19:05:09.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.732+0000 7f4288043640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f426c003980 0x7f42801508c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:09.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.732+0000 7f4288043640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42800c6a30 0x7f42800b2d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:09.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.732+0000 7f4288043640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42800c6ea0 0x7f42800b3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:09.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.732+0000 7f4288043640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42800c5f10 con 0x7f42800c6ea0 2023-06-10T19:05:09.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.732+0000 7f4288043640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42800c5c30 con 0x7f426c003980 2023-06-10T19:05:09.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.732+0000 7f4288043640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42800a75f0 con 0x7f42800c6a30 2023-06-10T19:05:09.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.732+0000 7f42865e0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42800c6ea0 0x7f42800b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:09.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.732+0000 7f42865e0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42800c6ea0 0x7f42800b3290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60220/0 (socket says 172.21.15.53:60220) 2023-06-10T19:05:09.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.732+0000 7f42865e0640 1 -- 172.21.15.53:0/3938417542 learned_addr learned my addr 172.21.15.53:0/3938417542 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:09.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.732+0000 7f4285ddf640 1 --2- 172.21.15.53:0/3938417542 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f426c003980 0x7f42801508c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:09.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.732+0000 7f42855de640 1 --2- 172.21.15.53:0/3938417542 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42800c6a30 0x7f42800b2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:09.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.732+0000 7f42865e0640 1 -- 172.21.15.53:0/3938417542 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42800c6a30 msgr2=0x7f42800b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:09.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.732+0000 7f42865e0640 1 --2- 172.21.15.53:0/3938417542 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42800c6a30 0x7f42800b2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:09.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.732+0000 7f42865e0640 1 -- 172.21.15.53:0/3938417542 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f426c003980 msgr2=0x7f42801508c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:09.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.732+0000 7f42865e0640 1 --2- 172.21.15.53:0/3938417542 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f426c003980 0x7f42801508c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:09.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.732+0000 7f42865e0640 1 -- 172.21.15.53:0/3938417542 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42800a78d0 con 0x7f42800c6ea0 2023-06-10T19:05:09.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.732+0000 7f42855de640 1 --2- 172.21.15.53:0/3938417542 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42800c6a30 0x7f42800b2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:05:09.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.732+0000 7f42865e0640 1 --2- 172.21.15.53:0/3938417542 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42800c6ea0 0x7f42800b3290 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 crypto rx=0x7f42800ad760 tx=0x7f4278007f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:09.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.732+0000 7f42767fc640 1 -- 172.21.15.53:0/3938417542 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4278014760 con 0x7f42800c6ea0 2023-06-10T19:05:09.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.732+0000 7f42767fc640 1 -- 172.21.15.53:0/3938417542 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4278011040 con 0x7f42800c6ea0 2023-06-10T19:05:09.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.732+0000 7f42767fc640 1 -- 172.21.15.53:0/3938417542 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4278014b20 con 0x7f42800c6ea0 2023-06-10T19:05:09.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.732+0000 7f4288043640 1 -- 172.21.15.53:0/3938417542 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42800a7bb0 con 0x7f42800c6ea0 2023-06-10T19:05:09.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.732+0000 7f4288043640 1 -- 172.21.15.53:0/3938417542 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42800c5080 con 0x7f42800c6ea0 2023-06-10T19:05:09.747 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.732+0000 7f42767fc640 1 -- 172.21.15.53:0/3938417542 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4278014c80 con 0x7f42800c6ea0 2023-06-10T19:05:09.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.736+0000 7f42767fc640 1 --2- 172.21.15.53:0/3938417542 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4264066280 0x7f4264068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:09.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.736+0000 7f42767fc640 1 -- 172.21.15.53:0/3938417542 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4278083850 con 0x7f42800c6ea0 2023-06-10T19:05:09.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.736+0000 7f4285ddf640 1 --2- 172.21.15.53:0/3938417542 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4264066280 0x7f4264068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:09.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.736+0000 7f428b15f000 1 Processor -- start 2023-06-10T19:05:09.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.736+0000 7f428b15f000 1 -- start start 2023-06-10T19:05:09.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.736+0000 7f4285ddf640 1 --2- 172.21.15.53:0/3938417542 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4264066280 0x7f4264068730 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f427c0b0000 tx=0x7f427c0046d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:09.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.736+0000 7f428b15f000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562ac10a3740 0x562ac10a3b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:09.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.736+0000 7f428b15f000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ac10a4050 0x562ac1059840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:09.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.736+0000 7f428b15f000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562ac1059d80 0x562ac105a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:09.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.736+0000 7f428b15f000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ac0f21ac0 con 0x562ac10a4050 2023-06-10T19:05:09.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.736+0000 7f428b15f000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ac0e5b840 con 0x562ac1059d80 2023-06-10T19:05:09.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.736+0000 7f428b15f000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x562ac0eaf2e0 con 0x562ac10a3740 2023-06-10T19:05:09.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.736+0000 7f42855de640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ac10a4050 0x562ac1059840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:09.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.736+0000 7f42855de640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ac10a4050 0x562ac1059840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60222/0 (socket says 172.21.15.53:60222) 2023-06-10T19:05:09.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.736+0000 7f42855de640 1 -- 172.21.15.53:0/2148023354 learned_addr learned my addr 172.21.15.53:0/2148023354 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:09.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.736+0000 7f4285ddf640 1 --2- 172.21.15.53:0/2148023354 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562ac10a3740 0x562ac10a3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:09.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.736+0000 7f42865e0640 1 --2- 172.21.15.53:0/2148023354 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562ac1059d80 0x562ac105a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:09.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.736+0000 7f42855de640 1 -- 172.21.15.53:0/2148023354 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562ac10a3740 msgr2=0x562ac10a3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:09.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.736+0000 7f42855de640 1 --2- 172.21.15.53:0/2148023354 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562ac10a3740 0x562ac10a3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:09.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.736+0000 7f42855de640 1 -- 172.21.15.53:0/2148023354 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562ac1059d80 msgr2=0x562ac105a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:09.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.736+0000 7f42855de640 1 --2- 172.21.15.53:0/2148023354 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562ac1059d80 0x562ac105a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:09.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.736+0000 7f42855de640 1 -- 172.21.15.53:0/2148023354 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562ac0ba4890 con 0x562ac10a4050 2023-06-10T19:05:09.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.736+0000 7f42865e0640 1 --2- 172.21.15.53:0/2148023354 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562ac1059d80 0x562ac105a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:05:09.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.736+0000 7f42855de640 1 --2- 172.21.15.53:0/2148023354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ac10a4050 0x562ac1059840 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 crypto rx=0x7f4270000fc0 tx=0x7f4270005680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64a0bbe956a03bd0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:09.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.736+0000 7f42637fe640 1 -- 172.21.15.53:0/2148023354 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4270012b00 con 0x562ac10a4050 2023-06-10T19:05:09.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.736+0000 7f42637fe640 1 -- 172.21.15.53:0/2148023354 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4270012c60 con 0x562ac10a4050 2023-06-10T19:05:09.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.736+0000 7f42637fe640 1 -- 172.21.15.53:0/2148023354 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42700153e0 con 0x562ac10a4050 2023-06-10T19:05:09.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.736+0000 7f428b15f000 1 -- 172.21.15.53:0/2148023354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ac10a4050 msgr2=0x562ac1059840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:09.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.736+0000 7f428b15f000 1 --2- 172.21.15.53:0/2148023354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ac10a4050 0x562ac1059840 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 crypto rx=0x7f4270000fc0 tx=0x7f4270005680 comp rx=0 tx=0).stop 2023-06-10T19:05:09.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.736+0000 7f428b15f000 1 -- 172.21.15.53:0/2148023354 shutdown_connections 2023-06-10T19:05:09.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.736+0000 7f428b15f000 1 --2- 172.21.15.53:0/2148023354 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562ac1059d80 0x562ac105a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:09.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.736+0000 7f428b15f000 1 --2- 172.21.15.53:0/2148023354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ac10a4050 0x562ac1059840 unknown :-1 s=CLOSED pgs=1898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:09.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.736+0000 7f428b15f000 1 --2- 172.21.15.53:0/2148023354 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562ac10a3740 0x562ac10a3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:09.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.736+0000 7f428b15f000 1 -- 172.21.15.53:0/2148023354 >> 172.21.15.53:0/2148023354 conn(0x562ac1051800 msgr2=0x562ac1060800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:09.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.736+0000 7f428b15f000 1 -- 172.21.15.53:0/2148023354 shutdown_connections 2023-06-10T19:05:09.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.736+0000 7f428b15f000 1 -- 172.21.15.53:0/2148023354 wait complete. 2023-06-10T19:05:09.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.740+0000 7f428b15f000 1 -- start start 2023-06-10T19:05:09.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.740+0000 7f428b15f000 1 Processor -- start 2023-06-10T19:05:09.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.740+0000 7f428b15f000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562ac1059d80 0x562ac105f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:09.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.740+0000 7f428b15f000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ac10a3740 0x562ac105f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:09.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.740+0000 7f428b15f000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562ac10a4050 0x562ac10650e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:09.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.740+0000 7f428b15f000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ac0ea8380 con 0x562ac10a3740 2023-06-10T19:05:09.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.740+0000 7f428b15f000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ac0e64ae0 con 0x562ac1059d80 2023-06-10T19:05:09.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.740+0000 7f428b15f000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x562ac0e64780 con 0x562ac10a4050 2023-06-10T19:05:09.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.740+0000 7f428b15f000 10 client.0 _ll_register_callbacks cb 0x562ac1045e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-10T19:05:09.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.740+0000 7f42855de640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ac10a3740 0x562ac105f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:09.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.740+0000 7f42855de640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ac10a3740 0x562ac105f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60226/0 (socket says 172.21.15.53:60226) 2023-06-10T19:05:09.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.740+0000 7f42855de640 1 -- 172.21.15.53:0/1939502881 learned_addr learned my addr 172.21.15.53:0/1939502881 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:09.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.740+0000 7f4285ddf640 1 --2- 172.21.15.53:0/1939502881 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562ac1059d80 0x562ac105f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:09.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.740+0000 7f42865e0640 1 --2- 172.21.15.53:0/1939502881 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562ac10a4050 0x562ac10650e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:09.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.740+0000 7f42855de640 1 -- 172.21.15.53:0/1939502881 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562ac10a4050 msgr2=0x562ac10650e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:09.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.740+0000 7f42855de640 1 --2- 172.21.15.53:0/1939502881 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562ac10a4050 0x562ac10650e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:09.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.740+0000 7f42855de640 1 -- 172.21.15.53:0/1939502881 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562ac1059d80 msgr2=0x562ac105f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:09.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.740+0000 7f42855de640 1 --2- 172.21.15.53:0/1939502881 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562ac1059d80 0x562ac105f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:09.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.740+0000 7f42855de640 1 -- 172.21.15.53:0/1939502881 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42800c8b90 con 0x562ac10a3740 2023-06-10T19:05:09.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.740+0000 7f4285ddf640 1 --2- 172.21.15.53:0/1939502881 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562ac1059d80 0x562ac105f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:05:09.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.740+0000 7f42855de640 1 --2- 172.21.15.53:0/1939502881 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ac10a3740 0x562ac105f970 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 crypto rx=0x7f427001a040 tx=0x7f4270001a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=390f48d550b10c0b server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:09.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.740+0000 7f4260ff9640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-06-10T19:05:09.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.740+0000 7f4260ff9640 1 -- 172.21.15.53:0/1939502881 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4270016850 con 0x562ac10a3740 2023-06-10T19:05:09.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.740+0000 7f4260ff9640 1 -- 172.21.15.53:0/1939502881 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(125..125 src has 1..125) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f42700169b0 con 0x562ac10a3740 2023-06-10T19:05:09.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.740+0000 7f428b15f000 1 -- 172.21.15.53:0/1939502881 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562ac0e6fa20 con 0x562ac10a3740 2023-06-10T19:05:09.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.740+0000 7f4260ff9640 1 -- 172.21.15.53:0/1939502881 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4270016bd0 con 0x562ac10a3740 2023-06-10T19:05:09.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.740+0000 7f428b15f000 10 client.9276 fetch_fsmap learned FSMap version 69 2023-06-10T19:05:09.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.740+0000 7f428b15f000 1 -- 172.21.15.53:0/1939502881 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=2+}) v3 -- 0x562ac0e6cd10 con 0x562ac10a3740 2023-06-10T19:05:09.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.740+0000 7f4260ff9640 1 -- 172.21.15.53:0/1939502881 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562ac0e6fa20 con 0x562ac10a3740 2023-06-10T19:05:09.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.740+0000 7f4260ff9640 1 -- 172.21.15.53:0/1939502881 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 69) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f427002a060 con 0x562ac10a3740 2023-06-10T19:05:09.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.740+0000 7f428b15f000 10 client.9276 fetch_fsmap finished waiting for FSMap version 69 2023-06-10T19:05:09.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.740+0000 7f428b15f000 10 client.9276 resolve_mds: resolved name 'c' to daemon mds.c 2023-06-10T19:05:09.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.740+0000 7f428b15f000 20 client.9276 populate_metadata read hostname 'smithi053' 2023-06-10T19:05:09.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.740+0000 7f428b15f000 1 --2- 172.21.15.53:0/1939502881 >> [v2:172.21.15.53:6834/3233917972,v1:172.21.15.53:6835/3233917972] conn(0x562ac10b27b0 0x562ac10b4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:09.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.740+0000 7f428b15f000 4 client.9276 mds_command: new command op to 9147 tid=0[{"prefix": "get_command_descriptions"}] 2023-06-10T19:05:09.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.740+0000 7f428b15f000 1 -- 172.21.15.53:0/1939502881 --> [v2:172.21.15.53:6834/3233917972,v1:172.21.15.53:6835/3233917972] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562ac0ed7710 con 0x562ac10b27b0 2023-06-10T19:05:09.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.740+0000 7f4285ddf640 1 --2- 172.21.15.53:0/1939502881 >> [v2:172.21.15.53:6834/3233917972,v1:172.21.15.53:6835/3233917972] conn(0x562ac10b27b0 0x562ac10b4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:09.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.740+0000 7f4260ff9640 10 client.9276 ms_handle_connect on v2:172.21.15.53:6834/3233917972 2023-06-10T19:05:09.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.740+0000 7f4285ddf640 1 --2- 172.21.15.53:0/1939502881 >> [v2:172.21.15.53:6834/3233917972,v1:172.21.15.53:6835/3233917972] conn(0x562ac10b27b0 0x562ac10b4b90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8f0a6d37af234b6 server_cookie=ce2cea99150b7f33 in_seq=0 out_seq=0 2023-06-10T19:05:09.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.740+0000 7f4260ff9640 1 -- 172.21.15.53:0/1939502881 <== mds.0 v2:172.21.15.53:6834/3233917972 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x562ac0ed7710 con 0x562ac10b27b0 2023-06-10T19:05:09.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.740+0000 7f4260ff9640 10 client.9276 handle_command_reply: tid=0 2023-06-10T19:05:09.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.740+0000 7f428b15f000 1 client.9276 shutdown 2023-06-10T19:05:09.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.740+0000 7f428b15f000 1 -- 172.21.15.53:0/1939502881 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ac10a3740 msgr2=0x562ac105f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:09.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.740+0000 7f428b15f000 1 --2- 172.21.15.53:0/1939502881 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ac10a3740 0x562ac105f970 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 crypto rx=0x7f427001a040 tx=0x7f4270001a10 comp rx=0 tx=0).stop 2023-06-10T19:05:09.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.740+0000 7f428b15f000 1 -- 172.21.15.53:0/1939502881 shutdown_connections 2023-06-10T19:05:09.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.740+0000 7f428b15f000 1 --2- 172.21.15.53:0/1939502881 >> [v2:172.21.15.53:6834/3233917972,v1:172.21.15.53:6835/3233917972] conn(0x562ac10b27b0 0x562ac10b4b90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:09.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.740+0000 7f428b15f000 1 --2- 172.21.15.53:0/1939502881 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562ac10a4050 0x562ac10650e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:09.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.740+0000 7f428b15f000 1 --2- 172.21.15.53:0/1939502881 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ac10a3740 0x562ac105f970 unknown :-1 s=CLOSED pgs=1899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:09.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.740+0000 7f428b15f000 1 --2- 172.21.15.53:0/1939502881 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562ac1059d80 0x562ac105f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:09.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.740+0000 7f4260ff9640 0 client.9276 ms_handle_reset on v2:172.21.15.53:6834/3233917972 2023-06-10T19:05:09.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.740+0000 7f428b15f000 1 -- 172.21.15.53:0/1939502881 >> 172.21.15.53:0/1939502881 conn(0x562ac1051800 msgr2=0x562ac1058830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:09.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.740+0000 7f428b15f000 1 -- 172.21.15.53:0/1939502881 shutdown_connections 2023-06-10T19:05:09.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.740+0000 7f428b15f000 1 -- 172.21.15.53:0/1939502881 wait complete. 2023-06-10T19:05:09.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.740+0000 7f428b15f000 20 client.9276 trim_cache size 0 max 16384 2023-06-10T19:05:09.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.756+0000 7f428b15f000 1 Processor -- start 2023-06-10T19:05:09.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.756+0000 7f428b15f000 1 -- start start 2023-06-10T19:05:09.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.756+0000 7f428b15f000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ac1059d80 0x562ac10593d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:09.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.756+0000 7f428b15f000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562ac10a3740 0x562ac10a2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:09.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.756+0000 7f428b15f000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562ac10a4050 0x562ac10a2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:09.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.760+0000 7f428b15f000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ac0b65940 con 0x562ac1059d80 2023-06-10T19:05:09.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.760+0000 7f428b15f000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ac0ea8c30 con 0x562ac10a3740 2023-06-10T19:05:09.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.760+0000 7f428b15f000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x562ac0e6a540 con 0x562ac10a4050 2023-06-10T19:05:09.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.760+0000 7f4285ddf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ac1059d80 0x562ac10593d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:09.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.760+0000 7f4285ddf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ac1059d80 0x562ac10593d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60242/0 (socket says 172.21.15.53:60242) 2023-06-10T19:05:09.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.760+0000 7f4285ddf640 1 -- 172.21.15.53:0/3297763538 learned_addr learned my addr 172.21.15.53:0/3297763538 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:09.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.760+0000 7f4285ddf640 1 -- 172.21.15.53:0/3297763538 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562ac10a4050 msgr2=0x562ac10a2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:09.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.760+0000 7f4285ddf640 1 --2- 172.21.15.53:0/3297763538 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562ac10a4050 0x562ac10a2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:09.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.760+0000 7f4285ddf640 1 -- 172.21.15.53:0/3297763538 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562ac10a3740 msgr2=0x562ac10a2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:09.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.760+0000 7f4285ddf640 1 --2- 172.21.15.53:0/3297763538 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562ac10a3740 0x562ac10a2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:09.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.760+0000 7f4285ddf640 1 -- 172.21.15.53:0/3297763538 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562ac0e52fa0 con 0x562ac1059d80 2023-06-10T19:05:09.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.760+0000 7f4285ddf640 1 --2- 172.21.15.53:0/3297763538 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ac1059d80 0x562ac10593d0 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7f427c01ec60 tx=0x7f427c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8e2ad1bb01ecd0e server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:09.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.760+0000 7f4263fff640 1 -- 172.21.15.53:0/3297763538 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427c0a7c80 con 0x562ac1059d80 2023-06-10T19:05:09.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.760+0000 7f4263fff640 1 -- 172.21.15.53:0/3297763538 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f427c0a7de0 con 0x562ac1059d80 2023-06-10T19:05:09.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.760+0000 7f4263fff640 1 -- 172.21.15.53:0/3297763538 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427c0cd520 con 0x562ac1059d80 2023-06-10T19:05:09.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.760+0000 7f428b15f000 1 -- 172.21.15.53:0/3297763538 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ac1059d80 msgr2=0x562ac10593d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:09.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.760+0000 7f428b15f000 1 --2- 172.21.15.53:0/3297763538 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ac1059d80 0x562ac10593d0 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7f427c01ec60 tx=0x7f427c004740 comp rx=0 tx=0).stop 2023-06-10T19:05:09.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.760+0000 7f428b15f000 1 -- 172.21.15.53:0/3297763538 shutdown_connections 2023-06-10T19:05:09.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.760+0000 7f428b15f000 1 --2- 172.21.15.53:0/3297763538 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562ac10a4050 0x562ac10a2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:09.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.760+0000 7f428b15f000 1 --2- 172.21.15.53:0/3297763538 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562ac10a3740 0x562ac10a2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:09.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.760+0000 7f428b15f000 1 --2- 172.21.15.53:0/3297763538 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ac1059d80 0x562ac10593d0 unknown :-1 s=CLOSED pgs=1900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:09.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.760+0000 7f428b15f000 1 -- 172.21.15.53:0/3297763538 >> 172.21.15.53:0/3297763538 conn(0x562ac1051800 msgr2=0x562ac10a2060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:09.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.760+0000 7f428b15f000 1 -- 172.21.15.53:0/3297763538 shutdown_connections 2023-06-10T19:05:09.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.760+0000 7f428b15f000 1 -- 172.21.15.53:0/3297763538 wait complete. 2023-06-10T19:05:09.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.760+0000 7f428b15f000 1 -- start start 2023-06-10T19:05:09.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.760+0000 7f428b15f000 1 Processor -- start 2023-06-10T19:05:09.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.760+0000 7f428b15f000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562ac1059d80 0x562ac1100f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:09.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.760+0000 7f428b15f000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562ac10a3740 0x562ac1101450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:09.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.760+0000 7f428b15f000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ac10a4050 0x562ac10b5350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:09.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.760+0000 7f428b15f000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ac0ea3cf0 con 0x562ac10a4050 2023-06-10T19:05:09.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.760+0000 7f428b15f000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ac105fd60 con 0x562ac10a3740 2023-06-10T19:05:09.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.760+0000 7f428b15f000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x562ac0e702f0 con 0x562ac1059d80 2023-06-10T19:05:09.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.760+0000 7f428b15f000 10 client.0 _ll_register_callbacks cb 0x562ac0e6c7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-10T19:05:09.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.760+0000 7f42865e0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ac10a4050 0x562ac10b5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:09.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.760+0000 7f42865e0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ac10a4050 0x562ac10b5350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60246/0 (socket says 172.21.15.53:60246) 2023-06-10T19:05:09.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.760+0000 7f42865e0640 1 -- 172.21.15.53:0/830446398 learned_addr learned my addr 172.21.15.53:0/830446398 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:09.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.764+0000 7f4285ddf640 1 --2- 172.21.15.53:0/830446398 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562ac1059d80 0x562ac1100f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:09.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.764+0000 7f42855de640 1 --2- 172.21.15.53:0/830446398 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562ac10a3740 0x562ac1101450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:09.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.764+0000 7f42865e0640 1 -- 172.21.15.53:0/830446398 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562ac1059d80 msgr2=0x562ac1100f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:09.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.764+0000 7f42865e0640 1 --2- 172.21.15.53:0/830446398 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562ac1059d80 0x562ac1100f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:09.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.764+0000 7f42865e0640 1 -- 172.21.15.53:0/830446398 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562ac10a3740 msgr2=0x562ac1101450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:09.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.764+0000 7f42865e0640 1 --2- 172.21.15.53:0/830446398 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562ac10a3740 0x562ac1101450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:09.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.764+0000 7f42865e0640 1 -- 172.21.15.53:0/830446398 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f426c003530 con 0x562ac10a4050 2023-06-10T19:05:09.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.764+0000 7f42865e0640 1 --2- 172.21.15.53:0/830446398 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ac10a4050 0x562ac10b5350 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 crypto rx=0x7f427805c840 tx=0x7f4278058aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d999c72b976244c4 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:09.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.764+0000 7f4260ff9640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-06-10T19:05:09.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.764+0000 7f4260ff9640 1 -- 172.21.15.53:0/830446398 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427806c070 con 0x562ac10a4050 2023-06-10T19:05:09.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.764+0000 7f4260ff9640 1 -- 172.21.15.53:0/830446398 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(125..125 src has 1..125) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4278052e80 con 0x562ac10a4050 2023-06-10T19:05:09.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.764+0000 7f428b15f000 1 -- 172.21.15.53:0/830446398 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562ac0ea6cd0 con 0x562ac10a4050 2023-06-10T19:05:09.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.764+0000 7f4260ff9640 1 -- 172.21.15.53:0/830446398 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4278054120 con 0x562ac10a4050 2023-06-10T19:05:09.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.764+0000 7f428b15f000 10 client.9282 fetch_fsmap learned FSMap version 69 2023-06-10T19:05:09.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.764+0000 7f428b15f000 1 -- 172.21.15.53:0/830446398 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=2+}) v3 -- 0x562ac0ba4cc0 con 0x562ac10a4050 2023-06-10T19:05:09.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.764+0000 7f4260ff9640 1 -- 172.21.15.53:0/830446398 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562ac0ea6cd0 con 0x562ac10a4050 2023-06-10T19:05:09.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.764+0000 7f4260ff9640 1 -- 172.21.15.53:0/830446398 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 69) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f4278005d20 con 0x562ac10a4050 2023-06-10T19:05:09.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.764+0000 7f428b15f000 10 client.9282 fetch_fsmap finished waiting for FSMap version 69 2023-06-10T19:05:09.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.764+0000 7f428b15f000 10 client.9282 resolve_mds: resolved name 'c' to daemon mds.c 2023-06-10T19:05:09.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.764+0000 7f428b15f000 20 client.9282 populate_metadata read hostname 'smithi053' 2023-06-10T19:05:09.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.764+0000 7f428b15f000 1 --2- 172.21.15.53:0/830446398 >> [v2:172.21.15.53:6834/3233917972,v1:172.21.15.53:6835/3233917972] conn(0x562ac1107de0 0x562ac110a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:09.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.764+0000 7f428b15f000 4 client.9282 mds_command: new command op to 9147 tid=0[{"prefix": "status"}] 2023-06-10T19:05:09.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.764+0000 7f428b15f000 1 -- 172.21.15.53:0/830446398 --> [v2:172.21.15.53:6834/3233917972,v1:172.21.15.53:6835/3233917972] -- command(tid 0: {"prefix": "status"}) v1 -- 0x562ac0ea1360 con 0x562ac1107de0 2023-06-10T19:05:09.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.764+0000 7f4285ddf640 1 --2- 172.21.15.53:0/830446398 >> [v2:172.21.15.53:6834/3233917972,v1:172.21.15.53:6835/3233917972] conn(0x562ac1107de0 0x562ac110a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:09.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.764+0000 7f4285ddf640 1 --2- 172.21.15.53:0/830446398 >> [v2:172.21.15.53:6834/3233917972,v1:172.21.15.53:6835/3233917972] conn(0x562ac1107de0 0x562ac110a1c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eaef27bfca7c3ef9 server_cookie=84709282e385749d in_seq=0 out_seq=0 2023-06-10T19:05:09.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.764+0000 7f4260ff9640 10 client.9282 ms_handle_connect on v2:172.21.15.53:6834/3233917972 2023-06-10T19:05:09.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.764+0000 7f4260ff9640 1 -- 172.21.15.53:0/830446398 <== mds.0 v2:172.21.15.53:6834/3233917972 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x562ac0ea1360 con 0x562ac1107de0 2023-06-10T19:05:09.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.764+0000 7f4260ff9640 10 client.9282 handle_command_reply: tid=0 2023-06-10T19:05:09.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.764+0000 7f428b15f000 1 client.9282 shutdown 2023-06-10T19:05:09.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.764+0000 7f428b15f000 1 -- 172.21.15.53:0/830446398 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ac10a4050 msgr2=0x562ac10b5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:09.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.764+0000 7f428b15f000 1 --2- 172.21.15.53:0/830446398 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ac10a4050 0x562ac10b5350 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 crypto rx=0x7f427805c840 tx=0x7f4278058aa0 comp rx=0 tx=0).stop 2023-06-10T19:05:09.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.764+0000 7f428b15f000 1 -- 172.21.15.53:0/830446398 shutdown_connections 2023-06-10T19:05:09.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.764+0000 7f428b15f000 1 --2- 172.21.15.53:0/830446398 >> [v2:172.21.15.53:6834/3233917972,v1:172.21.15.53:6835/3233917972] conn(0x562ac1107de0 0x562ac110a1c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:09.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.764+0000 7f428b15f000 1 --2- 172.21.15.53:0/830446398 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ac10a4050 0x562ac10b5350 unknown :-1 s=CLOSED pgs=1901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:09.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.764+0000 7f428b15f000 1 --2- 172.21.15.53:0/830446398 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562ac10a3740 0x562ac1101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:09.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.764+0000 7f4260ff9640 0 client.9282 ms_handle_reset on v2:172.21.15.53:6834/3233917972 2023-06-10T19:05:09.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.764+0000 7f428b15f000 1 --2- 172.21.15.53:0/830446398 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x562ac1059d80 0x562ac1100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:09.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.764+0000 7f428b15f000 1 -- 172.21.15.53:0/830446398 >> 172.21.15.53:0/830446398 conn(0x562ac1051800 msgr2=0x562ac105f650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:09.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.764+0000 7f428b15f000 1 -- 172.21.15.53:0/830446398 shutdown_connections 2023-06-10T19:05:09.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.764+0000 7f428b15f000 1 -- 172.21.15.53:0/830446398 wait complete. 2023-06-10T19:05:09.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.764+0000 7f428b15f000 20 client.9282 trim_cache size 0 max 16384 2023-06-10T19:05:09.781 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-06-10T19:05:09.781 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_fsid": "c8c64bed-c406-4936-93f9-d16335f1067d", 2023-06-10T19:05:09.781 INFO:teuthology.orchestra.run.smithi053.stdout: "whoami": 0, 2023-06-10T19:05:09.781 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 9147, 2023-06-10T19:05:09.781 INFO:teuthology.orchestra.run.smithi053.stdout: "want_state": "up:active", 2023-06-10T19:05:09.781 INFO:teuthology.orchestra.run.smithi053.stdout: "state": "up:active", 2023-06-10T19:05:09.782 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs", 2023-06-10T19:05:09.782 INFO:teuthology.orchestra.run.smithi053.stdout: "rank_uptime": 4.8863509289999998, 2023-06-10T19:05:09.782 INFO:teuthology.orchestra.run.smithi053.stdout: "mdsmap_epoch": 69, 2023-06-10T19:05:09.782 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch": 125, 2023-06-10T19:05:09.782 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch_barrier": 125, 2023-06-10T19:05:09.782 INFO:teuthology.orchestra.run.smithi053.stdout: "uptime": 10.269201008 2023-06-10T19:05:09.782 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-06-10T19:05:09.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.764+0000 7f4288043640 1 -- 172.21.15.53:0/3938417542 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4264066280 msgr2=0x7f4264068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:09.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.764+0000 7f4288043640 1 --2- 172.21.15.53:0/3938417542 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4264066280 0x7f4264068730 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f427c0b0000 tx=0x7f427c0046d0 comp rx=0 tx=0).stop 2023-06-10T19:05:09.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.764+0000 7f4288043640 1 -- 172.21.15.53:0/3938417542 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42800c6ea0 msgr2=0x7f42800b3290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:09.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.764+0000 7f4288043640 1 --2- 172.21.15.53:0/3938417542 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42800c6ea0 0x7f42800b3290 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 crypto rx=0x7f42800ad760 tx=0x7f4278007f00 comp rx=0 tx=0).stop 2023-06-10T19:05:09.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.764+0000 7f4288043640 1 -- 172.21.15.53:0/3938417542 shutdown_connections 2023-06-10T19:05:09.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.764+0000 7f4288043640 1 --2- 172.21.15.53:0/3938417542 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4264066280 0x7f4264068730 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:09.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.764+0000 7f4288043640 1 --2- 172.21.15.53:0/3938417542 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42800c6ea0 0x7f42800b3290 unknown :-1 s=CLOSED pgs=1897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:09.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.764+0000 7f4288043640 1 --2- 172.21.15.53:0/3938417542 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42800c6a30 0x7f42800b2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:09.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.764+0000 7f4288043640 1 --2- 172.21.15.53:0/3938417542 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f426c003980 0x7f42801508c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:09.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.764+0000 7f4288043640 1 -- 172.21.15.53:0/3938417542 >> 172.21.15.53:0/3938417542 conn(0x7f42800ce9e0 msgr2=0x7f42800aeca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:09.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.764+0000 7f4288043640 1 -- 172.21.15.53:0/3938417542 shutdown_connections 2023-06-10T19:05:09.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.764+0000 7f4288043640 1 -- 172.21.15.53:0/3938417542 wait complete. 2023-06-10T19:05:09.786 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-10T19:05:09.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.892+0000 7efd00a2c640 1 Processor -- start 2023-06-10T19:05:09.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.892+0000 7efd00a2c640 1 -- start start 2023-06-10T19:05:09.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.892+0000 7efd00a2c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7efcfc0cc690 0x7efcfc0d04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:09.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.892+0000 7efd00a2c640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcfc0d0020 con 0x7efcfc0b3ac0 2023-06-10T19:05:09.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.892+0000 7efd00a2c640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcfc0cef40 con 0x7efcfc0ccae0 2023-06-10T19:05:09.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.892+0000 7efd00a2c640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcfc0cf220 con 0x7efcfc0cc690 2023-06-10T19:05:09.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.892+0000 7efcfa59c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7efcfc0b3ac0 0x7efcfc0b3e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:35634/0 (socket says 172.21.15.53:35634) 2023-06-10T19:05:09.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.892+0000 7efcfa59c640 1 -- 172.21.15.53:0/1382736610 learned_addr learned my addr 172.21.15.53:0/1382736610 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:05:09.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.892+0000 7efcf9d9b640 1 --2- 172.21.15.53:0/1382736610 >> v2:172.21.15.53:3300/0 conn(0x7efcfc0cc690 0x7efcfc0d04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:09.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.892+0000 7efcf959a640 1 -- 172.21.15.53:0/1382736610 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2456922289 0 0) 0x7efcfc0d0020 con 0x7efcfc0b3ac0 2023-06-10T19:05:09.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.892+0000 7efcf959a640 1 -- 172.21.15.53:0/1382736610 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efce4003530 con 0x7efcfc0b3ac0 2023-06-10T19:05:09.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.892+0000 7efcf9d9b640 1 -- 172.21.15.53:0/1382736610 >> v1:172.21.15.117:6789/0 conn(0x7efcfc0ccae0 legacy=0x7efcfc0d09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:09.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.892+0000 7efcf959a640 1 -- 172.21.15.53:0/1382736610 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4081437887 0 0) 0x7efce4003530 con 0x7efcfc0b3ac0 2023-06-10T19:05:09.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.892+0000 7efcf9d9b640 1 -- 172.21.15.53:0/1382736610 >> v1:172.21.15.53:6789/0 conn(0x7efcfc0b3ac0 legacy=0x7efcfc0b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:09.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.892+0000 7efcf9d9b640 1 -- 172.21.15.53:0/1382736610 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcfc0cf500 con 0x7efcfc0cc690 2023-06-10T19:05:09.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.896+0000 7efcf9d9b640 1 --2- 172.21.15.53:0/1382736610 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efcfc0cc690 0x7efcfc0d04b0 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7efcf0009d90 tx=0x7efcf001c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f735bb50f4666820 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:09.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.896+0000 7efcf959a640 1 -- 172.21.15.53:0/1382736610 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcec001680 con 0x7efcfc0cc690 2023-06-10T19:05:09.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.896+0000 7efcf959a640 1 -- 172.21.15.53:0/1382736610 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcf00a5590 con 0x7efcfc0cc690 2023-06-10T19:05:09.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.896+0000 7efcf959a640 1 -- 172.21.15.53:0/1382736610 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf00a5900 con 0x7efcfc0cc690 2023-06-10T19:05:09.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.896+0000 7efd00a2c640 1 -- 172.21.15.53:0/1382736610 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efcfc0cc690 msgr2=0x7efcfc0d04b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:09.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.896+0000 7efd00a2c640 1 --2- 172.21.15.53:0/1382736610 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efcfc0cc690 0x7efcfc0d04b0 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7efcf0009d90 tx=0x7efcf001c840 comp rx=0 tx=0).stop 2023-06-10T19:05:09.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.896+0000 7efd00a2c640 1 -- 172.21.15.53:0/1382736610 shutdown_connections 2023-06-10T19:05:09.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.896+0000 7efd00a2c640 1 --2- 172.21.15.53:0/1382736610 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efcfc0cc690 0x7efcfc0d04b0 unknown :-1 s=CLOSED pgs=1903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:09.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.896+0000 7efd00a2c640 1 -- 172.21.15.53:0/1382736610 >> 172.21.15.53:0/1382736610 conn(0x7efcfc071790 msgr2=0x7efcfc069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:09.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.896+0000 7efd00a2c640 1 -- 172.21.15.53:0/1382736610 shutdown_connections 2023-06-10T19:05:09.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.896+0000 7efd00a2c640 1 -- 172.21.15.53:0/1382736610 wait complete. 2023-06-10T19:05:09.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.896+0000 7efd00a2c640 1 Processor -- start 2023-06-10T19:05:09.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.896+0000 7efd00a2c640 1 -- start start 2023-06-10T19:05:09.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.896+0000 7efd00a2c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcfc0b3ac0 0x7efcfc14a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:09.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.896+0000 7efd00a2c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efcfc0cc690 0x7efcfc0c7750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:09.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.896+0000 7efd00a2c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efcfc0ccae0 0x7efcfc0c7c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:09.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.896+0000 7efd00a2c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcfc0c6670 con 0x7efcfc0cc690 2023-06-10T19:05:09.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.896+0000 7efd00a2c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcfc0c6950 con 0x7efcfc0b3ac0 2023-06-10T19:05:09.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.896+0000 7efd00a2c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcfc0c6c30 con 0x7efcfc0ccae0 2023-06-10T19:05:09.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.896+0000 7efcf9d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efcfc0cc690 0x7efcfc0c7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:09.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.896+0000 7efcf9d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efcfc0cc690 0x7efcfc0c7750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60258/0 (socket says 172.21.15.53:60258) 2023-06-10T19:05:09.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.896+0000 7efcf9d9b640 1 -- 172.21.15.53:0/3002739333 learned_addr learned my addr 172.21.15.53:0/3002739333 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:09.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.896+0000 7efcfa59c640 1 --2- 172.21.15.53:0/3002739333 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcfc0b3ac0 0x7efcfc14a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:09.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.896+0000 7efcfad9d640 1 --2- 172.21.15.53:0/3002739333 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efcfc0ccae0 0x7efcfc0c7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:09.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.896+0000 7efcf9d9b640 1 -- 172.21.15.53:0/3002739333 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efcfc0ccae0 msgr2=0x7efcfc0c7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:09.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.896+0000 7efcf9d9b640 1 --2- 172.21.15.53:0/3002739333 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efcfc0ccae0 0x7efcfc0c7c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:09.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.896+0000 7efcf9d9b640 1 -- 172.21.15.53:0/3002739333 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcfc0b3ac0 msgr2=0x7efcfc14a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:09.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.896+0000 7efcf9d9b640 1 --2- 172.21.15.53:0/3002739333 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcfc0b3ac0 0x7efcfc14a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:09.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.896+0000 7efcf9d9b640 1 -- 172.21.15.53:0/3002739333 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf0009a70 con 0x7efcfc0cc690 2023-06-10T19:05:09.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.896+0000 7efcfa59c640 1 --2- 172.21.15.53:0/3002739333 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcfc0b3ac0 0x7efcfc14a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:05:09.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.896+0000 7efcf9d9b640 1 --2- 172.21.15.53:0/3002739333 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efcfc0cc690 0x7efcfc0c7750 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7efcf0019450 tx=0x7efcfc0d1910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:09.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.900+0000 7efceaffd640 1 -- 172.21.15.53:0/3002739333 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf00ad850 con 0x7efcfc0cc690 2023-06-10T19:05:09.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.900+0000 7efceaffd640 1 -- 172.21.15.53:0/3002739333 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcf00a5e90 con 0x7efcfc0cc690 2023-06-10T19:05:09.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.900+0000 7efd00a2c640 1 -- 172.21.15.53:0/3002739333 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcfc0c6f10 con 0x7efcfc0cc690 2023-06-10T19:05:09.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.900+0000 7efceaffd640 1 -- 172.21.15.53:0/3002739333 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf00adbd0 con 0x7efcfc0cc690 2023-06-10T19:05:09.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.900+0000 7efd00a2c640 1 -- 172.21.15.53:0/3002739333 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcfc14a540 con 0x7efcfc0cc690 2023-06-10T19:05:09.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.900+0000 7efd00a2c640 1 -- 172.21.15.53:0/3002739333 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcfc152960 con 0x7efcfc0cc690 2023-06-10T19:05:09.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.900+0000 7efceaffd640 1 -- 172.21.15.53:0/3002739333 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7efcf00b4050 con 0x7efcfc0cc690 2023-06-10T19:05:09.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.900+0000 7efceaffd640 1 --2- 172.21.15.53:0/3002739333 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efcdc066280 0x7efcdc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:09.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.900+0000 7efceaffd640 1 -- 172.21.15.53:0/3002739333 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efcf011ebd0 con 0x7efcfc0cc690 2023-06-10T19:05:09.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.900+0000 7efcfa59c640 1 --2- 172.21.15.53:0/3002739333 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efcdc066280 0x7efcdc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:09.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.900+0000 7efcfa59c640 1 --2- 172.21.15.53:0/3002739333 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efcdc066280 0x7efcdc068730 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7efcec0011f0 tx=0x7efcec009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:09.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:09.904+0000 7efceaffd640 1 -- 172.21.15.53:0/3002739333 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7efcfc152960 con 0x7efcfc0cc690 2023-06-10T19:05:10.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:10.092+0000 7efd00a2c640 1 -- 172.21.15.53:0/3002739333 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7efcfc152960 con 0x7efcfc0cc690 2023-06-10T19:05:10.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:10.092+0000 7efceaffd640 1 -- 172.21.15.53:0/3002739333 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v69) v1 ==== 53+0+73 (secure 0 0 0) 0x7efcfc152960 con 0x7efcfc0cc690 2023-06-10T19:05:10.096 INFO:teuthology.orchestra.run.smithi053.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-06-10T19:05:10.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:10.092+0000 7efd00a2c640 1 -- 172.21.15.53:0/3002739333 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efcdc066280 msgr2=0x7efcdc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:10.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:10.092+0000 7efd00a2c640 1 --2- 172.21.15.53:0/3002739333 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efcdc066280 0x7efcdc068730 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7efcec0011f0 tx=0x7efcec009040 comp rx=0 tx=0).stop 2023-06-10T19:05:10.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:10.092+0000 7efd00a2c640 1 -- 172.21.15.53:0/3002739333 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efcfc0cc690 msgr2=0x7efcfc0c7750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:10.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:10.092+0000 7efd00a2c640 1 --2- 172.21.15.53:0/3002739333 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efcfc0cc690 0x7efcfc0c7750 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7efcf0019450 tx=0x7efcfc0d1910 comp rx=0 tx=0).stop 2023-06-10T19:05:10.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:10.092+0000 7efd00a2c640 1 -- 172.21.15.53:0/3002739333 shutdown_connections 2023-06-10T19:05:10.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:10.092+0000 7efd00a2c640 1 --2- 172.21.15.53:0/3002739333 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efcdc066280 0x7efcdc068730 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:10.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:10.092+0000 7efd00a2c640 1 --2- 172.21.15.53:0/3002739333 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efcfc0ccae0 0x7efcfc0c7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:10.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:10.092+0000 7efd00a2c640 1 --2- 172.21.15.53:0/3002739333 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efcfc0cc690 0x7efcfc0c7750 unknown :-1 s=CLOSED pgs=1904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:10.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:10.092+0000 7efd00a2c640 1 --2- 172.21.15.53:0/3002739333 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcfc0b3ac0 0x7efcfc14a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:10.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:10.092+0000 7efd00a2c640 1 -- 172.21.15.53:0/3002739333 >> 172.21.15.53:0/3002739333 conn(0x7efcfc071790 msgr2=0x7efcfc0b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:10.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:10.092+0000 7efd00a2c640 1 -- 172.21.15.53:0/3002739333 shutdown_connections 2023-06-10T19:05:10.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:10.092+0000 7efd00a2c640 1 -- 172.21.15.53:0/3002739333 wait complete. 2023-06-10T19:05:10.113 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-10T19:05:10.114 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-10T19:05:10.114 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi053.front.sepia.ceph.com 2023-06-10T19:05:10.114 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-06-10T19:05:10.115 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-06-10T19:05:10.115 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-10T19:05:10.115 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-10T19:05:10.115 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-10T19:05:10.116 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-06-10T19:05:10.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:05:10.117 DEBUG:teuthology.orchestra.run.smithi053:> ip addr 2023-06-10T19:05:10.123 INFO:teuthology.orchestra.run.smithi053.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-10T19:05:10.123 INFO:teuthology.orchestra.run.smithi053.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-10T19:05:10.123 INFO:teuthology.orchestra.run.smithi053.stdout: inet 127.0.0.1/8 scope host lo 2023-06-10T19:05:10.123 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:05:10.124 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 ::1/128 scope host 2023-06-10T19:05:10.124 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:05:10.124 INFO:teuthology.orchestra.run.smithi053.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T19:05:10.124 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:da brd ff:ff:ff:ff:ff:ff 2023-06-10T19:05:10.124 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f0 2023-06-10T19:05:10.124 INFO:teuthology.orchestra.run.smithi053.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T19:05:10.125 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:db brd ff:ff:ff:ff:ff:ff 2023-06-10T19:05:10.125 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f1 2023-06-10T19:05:10.125 INFO:teuthology.orchestra.run.smithi053.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-10T19:05:10.125 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:18 brd ff:ff:ff:ff:ff:ff 2023-06-10T19:05:10.125 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f0 2023-06-10T19:05:10.125 INFO:teuthology.orchestra.run.smithi053.stdout: inet 172.21.15.53/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-06-10T19:05:10.126 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft 41739sec preferred_lft 41739sec 2023-06-10T19:05:10.126 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::ae1f:6bff:fef8:3718/64 scope link 2023-06-10T19:05:10.126 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:05:10.126 INFO:teuthology.orchestra.run.smithi053.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T19:05:10.126 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:19 brd ff:ff:ff:ff:ff:ff 2023-06-10T19:05:10.126 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f1 2023-06-10T19:05:10.126 INFO:teuthology.orchestra.run.smithi053.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-06-10T19:05:10.127 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 02:42:49:3d:ee:1e brd ff:ff:ff:ff:ff:ff 2023-06-10T19:05:10.127 INFO:teuthology.orchestra.run.smithi053.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-06-10T19:05:10.127 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:05:10.127 INFO:teuthology.orchestra.run.smithi053.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-10T19:05:10.127 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-06-10T19:05:10.127 INFO:teuthology.orchestra.run.smithi053.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-06-10T19:05:10.127 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:05:10.128 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-06-10T19:05:10.128 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:05:10.128 INFO:teuthology.orchestra.run.smithi053.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-10T19:05:10.128 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-06-10T19:05:10.128 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-06-10T19:05:10.128 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:05:10.129 INFO:teuthology.orchestra.run.smithi053.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-10T19:05:10.129 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-06-10T19:05:10.129 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-06-10T19:05:10.129 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:05:10.129 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:05:10.130 DEBUG:teuthology.orchestra.run.smithi053:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-10T19:05:10.177 INFO:teuthology.orchestra.run.smithi053.stdout:1 2023-06-10T19:05:10.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:05:10.178 DEBUG:teuthology.orchestra.run.smithi053:> route 2023-06-10T19:05:10.224 INFO:teuthology.orchestra.run.smithi053.stdout:Kernel IP routing table 2023-06-10T19:05:10.224 INFO:teuthology.orchestra.run.smithi053.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-10T19:05:10.224 INFO:teuthology.orchestra.run.smithi053.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-06-10T19:05:10.224 INFO:teuthology.orchestra.run.smithi053.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-06-10T19:05:10.225 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-06-10T19:05:10.225 INFO:teuthology.orchestra.run.smithi053.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-10T19:05:10.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:05:10.225 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec bash -c ' 2023-06-10T19:05:10.226 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2023-06-10T19:05:10.226 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-06-10T19:05:10.226 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-06-10T19:05:10.227 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-06-10T19:05:10.227 DEBUG:teuthology.orchestra.run.smithi053:> ') 2023-06-10T19:05:10.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:05:10.303 DEBUG:teuthology.orchestra.run.smithi053:> ip netns list 2023-06-10T19:05:10.351 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-06-10T19:05:10.352 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-06-10T19:05:10.352 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-06-10T19:05:10.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:05:10.353 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link set brx.0 up 2023-06-10T19:05:10.407 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-06-10T19:05:10.408 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-10T19:05:10.408 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-06-10T19:05:10.456 INFO:teuthology.orchestra.run.smithi053.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-06-10T19:05:10.456 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-10T19:05:10.457 DEBUG:teuthology.orchestra.run.smithi053:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-06-10T19:05:10.470 INFO:tasks.ceph.mds.c.smithi053.stderr:2023-06-10T19:05:10.464+0000 7fbd7cdc7640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-06-10T19:05:10.474 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2023-06-10T19:05:10.529 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T19:05:10.529 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T19:05:10.583 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T19:05:10.584 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T19:05:10.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:05:10.585 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2023-06-10T19:05:10.632 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-06-10T19:05:10.633 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-06-10T19:05:10.676 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2023-06-10T19:05:10.689 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T19:05:10.690 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T19:05:10.741 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T19:05:10.742 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T19:05:10.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:05:10.743 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2023-06-10T19:05:10.756 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:2023-06-10T19:05:10.752+0000 7f8c789e4580 -1 init, newargv = 0x55cd9fb68f70 newargc=15 2023-06-10T19:05:10.756 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[62837]: starting ceph client 2023-06-10T19:05:10.762 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[62837]: starting fuse 2023-06-10T19:05:11.862 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2023-06-10T19:05:11.878 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T19:05:11.879 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T19:05:11.935 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T19:05:11.936 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T19:05:11.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:05:11.937 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2023-06-10T19:05:11.984 INFO:teuthology.orchestra.run.smithi053.stdout:45 2023-06-10T19:05:11.984 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-06-10T19:05:11.984 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-06-10T19:05:11.985 DEBUG:teuthology.orchestra.run.smithi053:> import glob 2023-06-10T19:05:11.985 DEBUG:teuthology.orchestra.run.smithi053:> import re 2023-06-10T19:05:11.985 DEBUG:teuthology.orchestra.run.smithi053:> import os 2023-06-10T19:05:11.986 DEBUG:teuthology.orchestra.run.smithi053:> import subprocess 2023-06-10T19:05:11.986 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:05:11.986 DEBUG:teuthology.orchestra.run.smithi053:> def _find_admin_socket(client_name): 2023-06-10T19:05:11.987 DEBUG:teuthology.orchestra.run.smithi053:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-06-10T19:05:11.987 DEBUG:teuthology.orchestra.run.smithi053:> files = glob.glob(asok_path) 2023-06-10T19:05:11.987 DEBUG:teuthology.orchestra.run.smithi053:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-06-10T19:05:11.988 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:05:11.988 DEBUG:teuthology.orchestra.run.smithi053:> # Given a non-glob path, it better be there 2023-06-10T19:05:11.988 DEBUG:teuthology.orchestra.run.smithi053:> if "*" not in asok_path: 2023-06-10T19:05:11.989 DEBUG:teuthology.orchestra.run.smithi053:> assert(len(files) == 1) 2023-06-10T19:05:11.989 DEBUG:teuthology.orchestra.run.smithi053:> return files[0] 2023-06-10T19:05:11.989 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:05:11.990 DEBUG:teuthology.orchestra.run.smithi053:> for f in files: 2023-06-10T19:05:11.990 DEBUG:teuthology.orchestra.run.smithi053:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-06-10T19:05:11.990 DEBUG:teuthology.orchestra.run.smithi053:> if os.path.exists("/proc/{0}".format(pid)): 2023-06-10T19:05:11.991 DEBUG:teuthology.orchestra.run.smithi053:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-06-10T19:05:11.991 DEBUG:teuthology.orchestra.run.smithi053:> contents = proc_f.read() 2023-06-10T19:05:11.991 DEBUG:teuthology.orchestra.run.smithi053:> if mountpoint in contents: 2023-06-10T19:05:11.992 DEBUG:teuthology.orchestra.run.smithi053:> return f 2023-06-10T19:05:11.992 DEBUG:teuthology.orchestra.run.smithi053:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-06-10T19:05:11.992 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:05:11.993 DEBUG:teuthology.orchestra.run.smithi053:> print(_find_admin_socket("client.0")) 2023-06-10T19:05:11.993 DEBUG:teuthology.orchestra.run.smithi053:> ' 2023-06-10T19:05:12.108 INFO:teuthology.orchestra.run.smithi053.stdout:/var/run/ceph/ceph-client.0.62837.asok 2023-06-10T19:05:12.290 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.62837.asok 2023-06-10T19:05:12.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:05:12.291 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.62837.asok status 2023-06-10T19:05:12.449 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-06-10T19:05:12.449 INFO:teuthology.orchestra.run.smithi053.stdout: "metadata": { 2023-06-10T19:05:12.449 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_sha1": "219d315c3a0b2075e570fb1964be2ad33fe7a9c8", 2023-06-10T19:05:12.449 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_version": "ceph version 18.0.0-4359-g219d315c (219d315c3a0b2075e570fb1964be2ad33fe7a9c8) reef (dev)", 2023-06-10T19:05:12.449 INFO:teuthology.orchestra.run.smithi053.stdout: "entity_id": "0", 2023-06-10T19:05:12.450 INFO:teuthology.orchestra.run.smithi053.stdout: "hostname": "smithi053", 2023-06-10T19:05:12.450 INFO:teuthology.orchestra.run.smithi053.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-06-10T19:05:12.450 INFO:teuthology.orchestra.run.smithi053.stdout: "pid": "62837", 2023-06-10T19:05:12.450 INFO:teuthology.orchestra.run.smithi053.stdout: "root": "/" 2023-06-10T19:05:12.450 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:05:12.450 INFO:teuthology.orchestra.run.smithi053.stdout: "dentry_count": 0, 2023-06-10T19:05:12.451 INFO:teuthology.orchestra.run.smithi053.stdout: "dentry_pinned_count": 0, 2023-06-10T19:05:12.451 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 9300, 2023-06-10T19:05:12.451 INFO:teuthology.orchestra.run.smithi053.stdout: "inst": { 2023-06-10T19:05:12.451 INFO:teuthology.orchestra.run.smithi053.stdout: "name": { 2023-06-10T19:05:12.451 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "client", 2023-06-10T19:05:12.451 INFO:teuthology.orchestra.run.smithi053.stdout: "num": 9300 2023-06-10T19:05:12.451 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:05:12.452 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": { 2023-06-10T19:05:12.452 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2023-06-10T19:05:12.452 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "192.168.0.1:0", 2023-06-10T19:05:12.452 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 935434380 2023-06-10T19:05:12.452 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:05:12.452 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:05:12.452 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": { 2023-06-10T19:05:12.453 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2023-06-10T19:05:12.453 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "192.168.0.1:0", 2023-06-10T19:05:12.453 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 935434380 2023-06-10T19:05:12.453 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:05:12.453 INFO:teuthology.orchestra.run.smithi053.stdout: "inst_str": "client.9300 192.168.0.1:0/935434380", 2023-06-10T19:05:12.453 INFO:teuthology.orchestra.run.smithi053.stdout: "addr_str": "192.168.0.1:0/935434380", 2023-06-10T19:05:12.453 INFO:teuthology.orchestra.run.smithi053.stdout: "inode_count": 1, 2023-06-10T19:05:12.454 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_epoch": 69, 2023-06-10T19:05:12.454 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_epoch": 125, 2023-06-10T19:05:12.454 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_epoch_barrier": 0, 2023-06-10T19:05:12.454 INFO:teuthology.orchestra.run.smithi053.stdout: "blocklisted": false, 2023-06-10T19:05:12.454 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs" 2023-06-10T19:05:12.454 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-06-10T19:05:12.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:05:12.463 DEBUG:teuthology.orchestra.run.smithi053:> stat --file-system '--printf=%T 2023-06-10T19:05:12.464 DEBUG:teuthology.orchestra.run.smithi053:> ' -- /home/ubuntu/cephtest/mnt.0 2023-06-10T19:05:12.471 INFO:teuthology.orchestra.run.smithi053.stdout:fuseblk 2023-06-10T19:05:12.472 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-06-10T19:05:12.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:05:12.472 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-06-10T19:05:12.529 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-10T19:05:12.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:12.696+0000 7f57bf823640 1 Processor -- start 2023-06-10T19:05:12.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:12.696+0000 7f57bf823640 1 -- start start 2023-06-10T19:05:12.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:12.696+0000 7f57bf823640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f57b80b3ac0 0x7f57b80b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:12.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:12.696+0000 7f57bf823640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f57b80cc690 0x7f57b815f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:12.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:12.696+0000 7f57bf823640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57b80d0020 con 0x7f57b80ccae0 2023-06-10T19:05:12.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:12.696+0000 7f57bf823640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57b80b43d0 con 0x7f57b80cc690 2023-06-10T19:05:12.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:12.696+0000 7f57bf823640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57b80cef40 con 0x7f57b80b3ac0 2023-06-10T19:05:12.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:12.696+0000 7f57bcdbe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f57b80cc690 0x7f57b815f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:12.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:12.696+0000 7f57bcdbe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f57b80cc690 0x7f57b815f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46040/0 (socket says 172.21.15.53:46040) 2023-06-10T19:05:12.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:12.696+0000 7f57bcdbe640 1 -- 172.21.15.53:0/2368116347 learned_addr learned my addr 172.21.15.53:0/2368116347 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:12.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:12.696+0000 7f57bd5bf640 1 --2- 172.21.15.53:0/2368116347 >> v2:172.21.15.117:3300/0 conn(0x7f57b80b3ac0 0x7f57b80b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:12.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:12.696+0000 7f57bcdbe640 1 -- 172.21.15.53:0/2368116347 >> v2:172.21.15.117:3300/0 conn(0x7f57b80b3ac0 msgr2=0x7f57b80b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:12.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:12.696+0000 7f57bcdbe640 1 --2- 172.21.15.53:0/2368116347 >> v2:172.21.15.117:3300/0 conn(0x7f57b80b3ac0 0x7f57b80b3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:12.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:12.696+0000 7f57bcdbe640 1 -- 172.21.15.53:0/2368116347 >> v1:172.21.15.117:6789/0 conn(0x7f57b80ccae0 legacy=0x7f57b815f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:12.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:12.696+0000 7f57bcdbe640 1 -- 172.21.15.53:0/2368116347 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b80cf220 con 0x7f57b80cc690 2023-06-10T19:05:12.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:12.700+0000 7f57bcdbe640 1 --2- 172.21.15.53:0/2368116347 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57b80cc690 0x7f57b815f370 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 crypto rx=0x7f57b80b4ba0 tx=0x7f57a801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d579564c4c3f8313 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:12.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:12.700+0000 7f57affff640 1 -- 172.21.15.53:0/2368116347 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a80ac640 con 0x7f57b80cc690 2023-06-10T19:05:12.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:12.700+0000 7f57affff640 1 -- 172.21.15.53:0/2368116347 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57a80ac7a0 con 0x7f57b80cc690 2023-06-10T19:05:12.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:12.700+0000 7f57affff640 1 -- 172.21.15.53:0/2368116347 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a80acb30 con 0x7f57b80cc690 2023-06-10T19:05:12.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:12.700+0000 7f57bf823640 1 -- 172.21.15.53:0/2368116347 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57b80cc690 msgr2=0x7f57b815f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:12.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:12.700+0000 7f57bf823640 1 --2- 172.21.15.53:0/2368116347 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57b80cc690 0x7f57b815f370 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 crypto rx=0x7f57b80b4ba0 tx=0x7f57a801c4d0 comp rx=0 tx=0).stop 2023-06-10T19:05:12.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:12.700+0000 7f57bf823640 1 -- 172.21.15.53:0/2368116347 shutdown_connections 2023-06-10T19:05:12.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:12.700+0000 7f57bf823640 1 --2- 172.21.15.53:0/2368116347 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57b80cc690 0x7f57b815f370 unknown :-1 s=CLOSED pgs=1908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:12.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:12.700+0000 7f57bf823640 1 --2- 172.21.15.53:0/2368116347 >> v2:172.21.15.117:3300/0 conn(0x7f57b80b3ac0 0x7f57b80b3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:12.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:12.700+0000 7f57bf823640 1 -- 172.21.15.53:0/2368116347 >> 172.21.15.53:0/2368116347 conn(0x7f57b8071790 msgr2=0x7f57b8069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:12.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:12.700+0000 7f57bf823640 1 -- 172.21.15.53:0/2368116347 shutdown_connections 2023-06-10T19:05:12.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:12.700+0000 7f57bf823640 1 -- 172.21.15.53:0/2368116347 wait complete. 2023-06-10T19:05:12.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:12.700+0000 7f57bf823640 1 Processor -- start 2023-06-10T19:05:12.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:12.700+0000 7f57bf823640 1 -- start start 2023-06-10T19:05:12.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:12.700+0000 7f57bf823640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57b80b3ac0 0x7f57b8150870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:12.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:12.700+0000 7f57bf823640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57b80cc690 0x7f57b815e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:12.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:12.700+0000 7f57bf823640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57b80ccae0 0x7f57b80b5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:12.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:12.700+0000 7f57bf823640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b8159b80 con 0x7f57b80b3ac0 2023-06-10T19:05:12.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:12.700+0000 7f57bf823640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b8150db0 con 0x7f57b80cc690 2023-06-10T19:05:12.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:12.700+0000 7f57bf823640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57b815ecb0 con 0x7f57b80ccae0 2023-06-10T19:05:12.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:12.700+0000 7f57bd5bf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57b80b3ac0 0x7f57b8150870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:12.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:12.700+0000 7f57bd5bf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57b80b3ac0 0x7f57b8150870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46048/0 (socket says 172.21.15.53:46048) 2023-06-10T19:05:12.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:12.700+0000 7f57bd5bf640 1 -- 172.21.15.53:0/2579875833 learned_addr learned my addr 172.21.15.53:0/2579875833 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:12.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:12.700+0000 7f57bddc0640 1 --2- 172.21.15.53:0/2579875833 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57b80ccae0 0x7f57b80b5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:12.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:12.704+0000 7f57bcdbe640 1 --2- 172.21.15.53:0/2579875833 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57b80cc690 0x7f57b815e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:12.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:12.704+0000 7f57bd5bf640 1 -- 172.21.15.53:0/2579875833 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57b80ccae0 msgr2=0x7f57b80b5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:12.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:12.704+0000 7f57bd5bf640 1 --2- 172.21.15.53:0/2579875833 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57b80ccae0 0x7f57b80b5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:12.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:12.704+0000 7f57bd5bf640 1 -- 172.21.15.53:0/2579875833 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57b80cc690 msgr2=0x7f57b815e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:12.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:12.704+0000 7f57bd5bf640 1 --2- 172.21.15.53:0/2579875833 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57b80cc690 0x7f57b815e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:12.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:12.704+0000 7f57bd5bf640 1 -- 172.21.15.53:0/2579875833 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57a80094d0 con 0x7f57b80b3ac0 2023-06-10T19:05:12.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:12.704+0000 7f57bd5bf640 1 --2- 172.21.15.53:0/2579875833 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57b80b3ac0 0x7f57b8150870 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7f57b400d620 tx=0x7f57b400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:12.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:12.704+0000 7f57adffb640 1 -- 172.21.15.53:0/2579875833 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b400b620 con 0x7f57b80b3ac0 2023-06-10T19:05:12.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:12.704+0000 7f57adffb640 1 -- 172.21.15.53:0/2579875833 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57b400b780 con 0x7f57b80b3ac0 2023-06-10T19:05:12.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:12.704+0000 7f57bf823640 1 -- 172.21.15.53:0/2579875833 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57b8159290 con 0x7f57b80b3ac0 2023-06-10T19:05:12.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:12.704+0000 7f57adffb640 1 -- 172.21.15.53:0/2579875833 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b400bb10 con 0x7f57b80b3ac0 2023-06-10T19:05:12.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:12.704+0000 7f57bf823640 1 -- 172.21.15.53:0/2579875833 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57b8159810 con 0x7f57b80b3ac0 2023-06-10T19:05:12.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:12.704+0000 7f57bf823640 1 -- 172.21.15.53:0/2579875833 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57b804d790 con 0x7f57b80b3ac0 2023-06-10T19:05:12.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:12.704+0000 7f57adffb640 1 -- 172.21.15.53:0/2579875833 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f57b400bc70 con 0x7f57b80b3ac0 2023-06-10T19:05:12.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:12.704+0000 7f57adffb640 1 --2- 172.21.15.53:0/2579875833 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f579c066280 0x7f579c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:12.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:12.704+0000 7f57adffb640 1 -- 172.21.15.53:0/2579875833 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f57b4084260 con 0x7f57b80b3ac0 2023-06-10T19:05:12.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:12.704+0000 7f57bcdbe640 1 --2- 172.21.15.53:0/2579875833 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f579c066280 0x7f579c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:12.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:12.704+0000 7f57bcdbe640 1 --2- 172.21.15.53:0/2579875833 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f579c066280 0x7f579c068730 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f57a80ae000 tx=0x7f57a80a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:12.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:12.708+0000 7f57adffb640 1 -- 172.21.15.53:0/2579875833 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f57b40516e0 con 0x7f57b80b3ac0 2023-06-10T19:05:12.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:12.900+0000 7f57bf823640 1 -- 172.21.15.53:0/2579875833 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f57b808a200 con 0x7f57b80b3ac0 2023-06-10T19:05:12.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:12.900+0000 7f57adffb640 1 -- 172.21.15.53:0/2579875833 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v69) v1 ==== 53+0+73 (secure 0 0 0) 0x7f57b4007380 con 0x7f57b80b3ac0 2023-06-10T19:05:12.905 INFO:teuthology.orchestra.run.smithi053.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-06-10T19:05:12.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:12.900+0000 7f57bf823640 1 -- 172.21.15.53:0/2579875833 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f579c066280 msgr2=0x7f579c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:12.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:12.900+0000 7f57bf823640 1 --2- 172.21.15.53:0/2579875833 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f579c066280 0x7f579c068730 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f57a80ae000 tx=0x7f57a80a7000 comp rx=0 tx=0).stop 2023-06-10T19:05:12.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:12.900+0000 7f57bf823640 1 -- 172.21.15.53:0/2579875833 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57b80b3ac0 msgr2=0x7f57b8150870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:12.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:12.900+0000 7f57bf823640 1 --2- 172.21.15.53:0/2579875833 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57b80b3ac0 0x7f57b8150870 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7f57b400d620 tx=0x7f57b400dae0 comp rx=0 tx=0).stop 2023-06-10T19:05:12.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:12.900+0000 7f57bf823640 1 -- 172.21.15.53:0/2579875833 shutdown_connections 2023-06-10T19:05:12.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:12.900+0000 7f57bf823640 1 --2- 172.21.15.53:0/2579875833 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f579c066280 0x7f579c068730 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:12.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:12.900+0000 7f57bf823640 1 --2- 172.21.15.53:0/2579875833 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57b80ccae0 0x7f57b80b5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:12.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:12.900+0000 7f57bf823640 1 --2- 172.21.15.53:0/2579875833 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57b80cc690 0x7f57b815e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:12.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:12.900+0000 7f57bf823640 1 --2- 172.21.15.53:0/2579875833 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57b80b3ac0 0x7f57b8150870 unknown :-1 s=CLOSED pgs=1909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:12.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:12.900+0000 7f57bf823640 1 -- 172.21.15.53:0/2579875833 >> 172.21.15.53:0/2579875833 conn(0x7f57b8071790 msgr2=0x7f57b815fc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:12.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:12.900+0000 7f57bf823640 1 -- 172.21.15.53:0/2579875833 shutdown_connections 2023-06-10T19:05:12.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:12.900+0000 7f57bf823640 1 -- 172.21.15.53:0/2579875833 wait complete. 2023-06-10T19:05:12.924 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-10T19:05:12.925 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-10T19:05:12.925 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi117.front.sepia.ceph.com 2023-06-10T19:05:12.926 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-06-10T19:05:12.926 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-06-10T19:05:12.927 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-10T19:05:12.927 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-10T19:05:12.928 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-10T19:05:12.928 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-06-10T19:05:12.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:05:12.930 DEBUG:teuthology.orchestra.run.smithi117:> ip addr 2023-06-10T19:05:12.937 INFO:teuthology.orchestra.run.smithi117.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-10T19:05:12.937 INFO:teuthology.orchestra.run.smithi117.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-10T19:05:12.938 INFO:teuthology.orchestra.run.smithi117.stdout: inet 127.0.0.1/8 scope host lo 2023-06-10T19:05:12.938 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:05:12.938 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 ::1/128 scope host 2023-06-10T19:05:12.939 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:05:12.939 INFO:teuthology.orchestra.run.smithi117.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T19:05:12.939 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8a brd ff:ff:ff:ff:ff:ff 2023-06-10T19:05:12.939 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f0 2023-06-10T19:05:12.940 INFO:teuthology.orchestra.run.smithi117.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T19:05:12.940 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8b brd ff:ff:ff:ff:ff:ff 2023-06-10T19:05:12.940 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f1 2023-06-10T19:05:12.940 INFO:teuthology.orchestra.run.smithi117.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T19:05:12.941 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:62 brd ff:ff:ff:ff:ff:ff 2023-06-10T19:05:12.941 INFO:teuthology.orchestra.run.smithi117.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-10T19:05:12.941 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:63 brd ff:ff:ff:ff:ff:ff 2023-06-10T19:05:12.942 INFO:teuthology.orchestra.run.smithi117.stdout: inet 172.21.15.117/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-06-10T19:05:12.942 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft 41736sec preferred_lft 41736sec 2023-06-10T19:05:12.942 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::ec4:7aff:fe8f:4463/64 scope link 2023-06-10T19:05:12.942 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:05:12.943 INFO:teuthology.orchestra.run.smithi117.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-06-10T19:05:12.943 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 02:42:f8:40:b2:dc brd ff:ff:ff:ff:ff:ff 2023-06-10T19:05:12.943 INFO:teuthology.orchestra.run.smithi117.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-06-10T19:05:12.943 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:05:12.944 INFO:teuthology.orchestra.run.smithi117.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-10T19:05:12.944 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-06-10T19:05:12.944 INFO:teuthology.orchestra.run.smithi117.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-06-10T19:05:12.944 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:05:12.944 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-06-10T19:05:12.945 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:05:12.945 INFO:teuthology.orchestra.run.smithi117.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-10T19:05:12.945 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-06-10T19:05:12.945 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-06-10T19:05:12.945 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:05:12.945 INFO:teuthology.orchestra.run.smithi117.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-10T19:05:12.945 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-06-10T19:05:12.945 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-06-10T19:05:12.946 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:05:12.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:05:12.946 DEBUG:teuthology.orchestra.run.smithi117:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-10T19:05:12.990 INFO:teuthology.orchestra.run.smithi117.stdout:1 2023-06-10T19:05:12.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:05:12.992 DEBUG:teuthology.orchestra.run.smithi117:> route 2023-06-10T19:05:13.040 INFO:teuthology.orchestra.run.smithi117.stdout:Kernel IP routing table 2023-06-10T19:05:13.041 INFO:teuthology.orchestra.run.smithi117.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-10T19:05:13.041 INFO:teuthology.orchestra.run.smithi117.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-06-10T19:05:13.041 INFO:teuthology.orchestra.run.smithi117.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-06-10T19:05:13.041 INFO:teuthology.orchestra.run.smithi117.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-06-10T19:05:13.041 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-06-10T19:05:13.041 INFO:teuthology.orchestra.run.smithi117.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-10T19:05:13.041 INFO:teuthology.orchestra.run.smithi117.stdout:ns2.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-10T19:05:13.042 INFO:teuthology.orchestra.run.smithi117.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-10T19:05:13.042 INFO:teuthology.orchestra.run.smithi117.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-10T19:05:13.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:05:13.042 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec bash -c ' 2023-06-10T19:05:13.043 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2023-06-10T19:05:13.043 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-06-10T19:05:13.043 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-06-10T19:05:13.044 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-06-10T19:05:13.044 DEBUG:teuthology.orchestra.run.smithi117:> ') 2023-06-10T19:05:13.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:05:13.118 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list 2023-06-10T19:05:13.163 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-06-10T19:05:13.163 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-06-10T19:05:13.164 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-06-10T19:05:13.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:05:13.164 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link set brx.0 up 2023-06-10T19:05:13.216 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-06-10T19:05:13.217 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-10T19:05:13.217 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-06-10T19:05:13.262 INFO:teuthology.orchestra.run.smithi117.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-06-10T19:05:13.262 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-10T19:05:13.263 DEBUG:teuthology.orchestra.run.smithi117:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-06-10T19:05:13.310 DEBUG:teuthology.orchestra.run.smithi117:> sudo modprobe fuse 2023-06-10T19:05:13.368 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T19:05:13.369 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T19:05:13.422 INFO:teuthology.orchestra.run.smithi117.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T19:05:13.423 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T19:05:13.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:05:13.424 DEBUG:teuthology.orchestra.run.smithi117:> ls /sys/fs/fuse/connections 2023-06-10T19:05:13.471 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-06-10T19:05:13.471 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-06-10T19:05:13.516 DEBUG:teuthology.orchestra.run.smithi117:> sudo modprobe fuse 2023-06-10T19:05:13.531 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T19:05:13.531 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T19:05:13.585 INFO:teuthology.orchestra.run.smithi117.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T19:05:13.586 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T19:05:13.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:05:13.587 DEBUG:teuthology.orchestra.run.smithi117:> ls /sys/fs/fuse/connections 2023-06-10T19:05:13.591 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi117.stderr:2023-06-10T19:05:13.587+0000 7f0374cf2580 -1 init, newargv = 0x562d29c91290 newargc=15 2023-06-10T19:05:13.591 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi117.stderr:ceph-fuse[45285]: starting ceph client 2023-06-10T19:05:13.599 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi117.stderr:ceph-fuse[45285]: starting fuse 2023-06-10T19:05:14.696 DEBUG:teuthology.orchestra.run.smithi117:> sudo modprobe fuse 2023-06-10T19:05:14.712 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T19:05:14.713 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T19:05:14.770 INFO:teuthology.orchestra.run.smithi117.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T19:05:14.771 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T19:05:14.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:05:14.772 DEBUG:teuthology.orchestra.run.smithi117:> ls /sys/fs/fuse/connections 2023-06-10T19:05:14.819 INFO:teuthology.orchestra.run.smithi117.stdout:45 2023-06-10T19:05:14.819 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-06-10T19:05:14.820 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-06-10T19:05:14.820 DEBUG:teuthology.orchestra.run.smithi117:> import glob 2023-06-10T19:05:14.821 DEBUG:teuthology.orchestra.run.smithi117:> import re 2023-06-10T19:05:14.821 DEBUG:teuthology.orchestra.run.smithi117:> import os 2023-06-10T19:05:14.821 DEBUG:teuthology.orchestra.run.smithi117:> import subprocess 2023-06-10T19:05:14.822 DEBUG:teuthology.orchestra.run.smithi117:> 2023-06-10T19:05:14.822 DEBUG:teuthology.orchestra.run.smithi117:> def _find_admin_socket(client_name): 2023-06-10T19:05:14.822 DEBUG:teuthology.orchestra.run.smithi117:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-06-10T19:05:14.822 DEBUG:teuthology.orchestra.run.smithi117:> files = glob.glob(asok_path) 2023-06-10T19:05:14.823 DEBUG:teuthology.orchestra.run.smithi117:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-06-10T19:05:14.823 DEBUG:teuthology.orchestra.run.smithi117:> 2023-06-10T19:05:14.823 DEBUG:teuthology.orchestra.run.smithi117:> # Given a non-glob path, it better be there 2023-06-10T19:05:14.824 DEBUG:teuthology.orchestra.run.smithi117:> if "*" not in asok_path: 2023-06-10T19:05:14.824 DEBUG:teuthology.orchestra.run.smithi117:> assert(len(files) == 1) 2023-06-10T19:05:14.824 DEBUG:teuthology.orchestra.run.smithi117:> return files[0] 2023-06-10T19:05:14.824 DEBUG:teuthology.orchestra.run.smithi117:> 2023-06-10T19:05:14.825 DEBUG:teuthology.orchestra.run.smithi117:> for f in files: 2023-06-10T19:05:14.825 DEBUG:teuthology.orchestra.run.smithi117:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-06-10T19:05:14.826 DEBUG:teuthology.orchestra.run.smithi117:> if os.path.exists("/proc/{0}".format(pid)): 2023-06-10T19:05:14.826 DEBUG:teuthology.orchestra.run.smithi117:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-06-10T19:05:14.826 DEBUG:teuthology.orchestra.run.smithi117:> contents = proc_f.read() 2023-06-10T19:05:14.827 DEBUG:teuthology.orchestra.run.smithi117:> if mountpoint in contents: 2023-06-10T19:05:14.827 DEBUG:teuthology.orchestra.run.smithi117:> return f 2023-06-10T19:05:14.827 DEBUG:teuthology.orchestra.run.smithi117:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-06-10T19:05:14.827 DEBUG:teuthology.orchestra.run.smithi117:> 2023-06-10T19:05:14.828 DEBUG:teuthology.orchestra.run.smithi117:> print(_find_admin_socket("client.1")) 2023-06-10T19:05:14.828 DEBUG:teuthology.orchestra.run.smithi117:> ' 2023-06-10T19:05:14.939 INFO:teuthology.orchestra.run.smithi117.stdout:/var/run/ceph/ceph-client.1.45285.asok 2023-06-10T19:05:15.121 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.45285.asok 2023-06-10T19:05:15.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:05:15.122 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.45285.asok status 2023-06-10T19:05:15.275 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2023-06-10T19:05:15.276 INFO:teuthology.orchestra.run.smithi117.stdout: "metadata": { 2023-06-10T19:05:15.276 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_sha1": "219d315c3a0b2075e570fb1964be2ad33fe7a9c8", 2023-06-10T19:05:15.276 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_version": "ceph version 18.0.0-4359-g219d315c (219d315c3a0b2075e570fb1964be2ad33fe7a9c8) reef (dev)", 2023-06-10T19:05:15.276 INFO:teuthology.orchestra.run.smithi117.stdout: "entity_id": "1", 2023-06-10T19:05:15.276 INFO:teuthology.orchestra.run.smithi117.stdout: "hostname": "smithi117", 2023-06-10T19:05:15.277 INFO:teuthology.orchestra.run.smithi117.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-06-10T19:05:15.277 INFO:teuthology.orchestra.run.smithi117.stdout: "pid": "45285", 2023-06-10T19:05:15.277 INFO:teuthology.orchestra.run.smithi117.stdout: "root": "/" 2023-06-10T19:05:15.277 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-06-10T19:05:15.277 INFO:teuthology.orchestra.run.smithi117.stdout: "dentry_count": 0, 2023-06-10T19:05:15.278 INFO:teuthology.orchestra.run.smithi117.stdout: "dentry_pinned_count": 0, 2023-06-10T19:05:15.278 INFO:teuthology.orchestra.run.smithi117.stdout: "id": 6905, 2023-06-10T19:05:15.278 INFO:teuthology.orchestra.run.smithi117.stdout: "inst": { 2023-06-10T19:05:15.278 INFO:teuthology.orchestra.run.smithi117.stdout: "name": { 2023-06-10T19:05:15.278 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "client", 2023-06-10T19:05:15.279 INFO:teuthology.orchestra.run.smithi117.stdout: "num": 6905 2023-06-10T19:05:15.279 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-06-10T19:05:15.279 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": { 2023-06-10T19:05:15.279 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "v1", 2023-06-10T19:05:15.279 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": "192.168.0.1:0", 2023-06-10T19:05:15.280 INFO:teuthology.orchestra.run.smithi117.stdout: "nonce": 2466742883 2023-06-10T19:05:15.280 INFO:teuthology.orchestra.run.smithi117.stdout: } 2023-06-10T19:05:15.280 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-06-10T19:05:15.280 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": { 2023-06-10T19:05:15.280 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "v1", 2023-06-10T19:05:15.280 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": "192.168.0.1:0", 2023-06-10T19:05:15.281 INFO:teuthology.orchestra.run.smithi117.stdout: "nonce": 2466742883 2023-06-10T19:05:15.281 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-06-10T19:05:15.281 INFO:teuthology.orchestra.run.smithi117.stdout: "inst_str": "client.6905 192.168.0.1:0/2466742883", 2023-06-10T19:05:15.281 INFO:teuthology.orchestra.run.smithi117.stdout: "addr_str": "192.168.0.1:0/2466742883", 2023-06-10T19:05:15.281 INFO:teuthology.orchestra.run.smithi117.stdout: "inode_count": 1, 2023-06-10T19:05:15.281 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_epoch": 69, 2023-06-10T19:05:15.281 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_epoch": 125, 2023-06-10T19:05:15.281 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_epoch_barrier": 0, 2023-06-10T19:05:15.282 INFO:teuthology.orchestra.run.smithi117.stdout: "blocklisted": false, 2023-06-10T19:05:15.282 INFO:teuthology.orchestra.run.smithi117.stdout: "fs_name": "cephfs" 2023-06-10T19:05:15.282 INFO:teuthology.orchestra.run.smithi117.stdout:} 2023-06-10T19:05:15.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:05:15.289 DEBUG:teuthology.orchestra.run.smithi117:> stat --file-system '--printf=%T 2023-06-10T19:05:15.289 DEBUG:teuthology.orchestra.run.smithi117:> ' -- /home/ubuntu/cephtest/mnt.1 2023-06-10T19:05:15.296 INFO:teuthology.orchestra.run.smithi117.stdout:fuseblk 2023-06-10T19:05:15.296 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-06-10T19:05:15.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:05:15.297 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-06-10T19:05:15.349 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config get mds_reconnect_timeout 2023-06-10T19:05:15.495 INFO:teuthology.orchestra.run.smithi053.stdout:{"mds_reconnect_timeout":"45.000000"} 2023-06-10T19:05:15.495 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_reconnect_timeout": "45.000000" } 2023-06-10T19:05:15.496 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config get ms_max_backoff 2023-06-10T19:05:15.626 INFO:teuthology.orchestra.run.smithi053.stdout:{"ms_max_backoff":"15.000000"} 2023-06-10T19:05:15.627 DEBUG:tasks.cephfs.filesystem:_json_asok output { "ms_max_backoff": "15.000000" } 2023-06-10T19:05:15.627 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:05:15.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:15.747+0000 7f235d746640 1 Processor -- start 2023-06-10T19:05:15.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:15.747+0000 7f235d746640 1 -- start start 2023-06-10T19:05:15.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:15.751+0000 7f235d746640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f235806b2f0 0x7f235806f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:15.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:15.751+0000 7f235d746640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f23580c8d00 0x7f235806b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:15.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:15.751+0000 7f235d746640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f235806bc00 0x7f23580cbe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:15.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:15.751+0000 7f235d746640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2358158a90 con 0x7f23580c8d00 2023-06-10T19:05:15.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:15.751+0000 7f235d746640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23580705d0 con 0x7f235806b2f0 2023-06-10T19:05:15.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:15.751+0000 7f235d746640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f235806f9c0 con 0x7f235806bc00 2023-06-10T19:05:15.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:15.751+0000 7f23567fc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f23580c8d00 0x7f235806b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:15.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:15.751+0000 7f23567fc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f23580c8d00 0x7f235806b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46058/0 (socket says 172.21.15.53:46058) 2023-06-10T19:05:15.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:15.751+0000 7f23567fc640 1 -- 172.21.15.53:0/3264209304 learned_addr learned my addr 172.21.15.53:0/3264209304 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:15.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:15.751+0000 7f23577fe640 1 --2- 172.21.15.53:0/3264209304 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f235806bc00 0x7f23580cbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:15.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:15.751+0000 7f2356ffd640 1 --2- 172.21.15.53:0/3264209304 >> v2:172.21.15.117:3300/0 conn(0x7f235806b2f0 0x7f235806f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:15.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:15.751+0000 7f23567fc640 1 -- 172.21.15.53:0/3264209304 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f235806bc00 msgr2=0x7f23580cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:15.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:15.751+0000 7f23567fc640 1 --2- 172.21.15.53:0/3264209304 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f235806bc00 0x7f23580cbe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:15.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:15.751+0000 7f23567fc640 1 -- 172.21.15.53:0/3264209304 >> v2:172.21.15.117:3300/0 conn(0x7f235806b2f0 msgr2=0x7f235806f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:15.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:15.751+0000 7f23567fc640 1 --2- 172.21.15.53:0/3264209304 >> v2:172.21.15.117:3300/0 conn(0x7f235806b2f0 0x7f235806f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:15.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:15.751+0000 7f23567fc640 1 -- 172.21.15.53:0/3264209304 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f235806fca0 con 0x7f23580c8d00 2023-06-10T19:05:15.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:15.751+0000 7f23577fe640 1 --2- 172.21.15.53:0/3264209304 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f235806bc00 0x7f23580cbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:05:15.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:15.751+0000 7f2356ffd640 1 --2- 172.21.15.53:0/3264209304 >> v2:172.21.15.117:3300/0 conn(0x7f235806b2f0 0x7f235806f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:05:15.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:15.751+0000 7f23567fc640 1 --2- 172.21.15.53:0/3264209304 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f23580c8d00 0x7f235806b6c0 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7f2358071d80 tx=0x7f234001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e2523e0d81934ac server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:15.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:15.751+0000 7f2355ffb640 1 -- 172.21.15.53:0/3264209304 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23400a89b0 con 0x7f23580c8d00 2023-06-10T19:05:15.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:15.751+0000 7f2355ffb640 1 -- 172.21.15.53:0/3264209304 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23400a8b10 con 0x7f23580c8d00 2023-06-10T19:05:15.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:15.751+0000 7f2355ffb640 1 -- 172.21.15.53:0/3264209304 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23400a8ea0 con 0x7f23580c8d00 2023-06-10T19:05:15.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:15.751+0000 7f235d746640 1 -- 172.21.15.53:0/3264209304 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f23580c8d00 msgr2=0x7f235806b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:15.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:15.751+0000 7f235d746640 1 --2- 172.21.15.53:0/3264209304 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f23580c8d00 0x7f235806b6c0 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7f2358071d80 tx=0x7f234001ecf0 comp rx=0 tx=0).stop 2023-06-10T19:05:15.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:15.751+0000 7f235d746640 1 -- 172.21.15.53:0/3264209304 shutdown_connections 2023-06-10T19:05:15.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:15.751+0000 7f235d746640 1 --2- 172.21.15.53:0/3264209304 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f235806bc00 0x7f23580cbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:15.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:15.751+0000 7f235d746640 1 --2- 172.21.15.53:0/3264209304 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f23580c8d00 0x7f235806b6c0 unknown :-1 s=CLOSED pgs=1911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:15.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:15.751+0000 7f235d746640 1 --2- 172.21.15.53:0/3264209304 >> v2:172.21.15.117:3300/0 conn(0x7f235806b2f0 0x7f235806f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:15.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:15.751+0000 7f235d746640 1 -- 172.21.15.53:0/3264209304 >> 172.21.15.53:0/3264209304 conn(0x7f235806a0d0 msgr2=0x7f23580ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:15.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:15.751+0000 7f235d746640 1 -- 172.21.15.53:0/3264209304 shutdown_connections 2023-06-10T19:05:15.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:15.751+0000 7f235d746640 1 -- 172.21.15.53:0/3264209304 wait complete. 2023-06-10T19:05:15.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:15.755+0000 7f235d746640 1 Processor -- start 2023-06-10T19:05:15.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:15.755+0000 7f235d746640 1 -- start start 2023-06-10T19:05:15.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:15.755+0000 7f235d746640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f235806b2f0 0x7f23581577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:15.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:15.755+0000 7f235d746640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f235806bc00 0x7f23580c6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:15.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:15.755+0000 7f235d746640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23580c8d00 0x7f23580c37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:15.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:15.755+0000 7f235d746640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23580c76b0 con 0x7f235806bc00 2023-06-10T19:05:15.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:15.755+0000 7f235d746640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23580c7b40 con 0x7f23580c8d00 2023-06-10T19:05:15.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:15.755+0000 7f235d746640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23580c67d0 con 0x7f235806b2f0 2023-06-10T19:05:15.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:15.755+0000 7f23567fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f235806bc00 0x7f23580c6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:15.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:15.755+0000 7f23567fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f235806bc00 0x7f23580c6290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46068/0 (socket says 172.21.15.53:46068) 2023-06-10T19:05:15.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:15.755+0000 7f23567fc640 1 -- 172.21.15.53:0/1131434694 learned_addr learned my addr 172.21.15.53:0/1131434694 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:15.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:15.755+0000 7f2356ffd640 1 --2- 172.21.15.53:0/1131434694 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f235806b2f0 0x7f23581577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:15.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:15.755+0000 7f23567fc640 1 -- 172.21.15.53:0/1131434694 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f235806b2f0 msgr2=0x7f23581577f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:15.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:15.755+0000 7f23567fc640 1 --2- 172.21.15.53:0/1131434694 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f235806b2f0 0x7f23581577f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:15.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:15.755+0000 7f23567fc640 1 -- 172.21.15.53:0/1131434694 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23580c8d00 msgr2=0x7f23580c37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:15.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:15.755+0000 7f23567fc640 1 --2- 172.21.15.53:0/1131434694 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23580c8d00 0x7f23580c37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:15.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:15.755+0000 7f23567fc640 1 -- 172.21.15.53:0/1131434694 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23400094d0 con 0x7f235806bc00 2023-06-10T19:05:15.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:15.755+0000 7f2356ffd640 1 --2- 172.21.15.53:0/1131434694 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f235806b2f0 0x7f23581577f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:05:15.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:15.755+0000 7f23567fc640 1 --2- 172.21.15.53:0/1131434694 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f235806bc00 0x7f23580c6290 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 crypto rx=0x7f23400b3040 tx=0x7f234001ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:15.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:15.755+0000 7f234f7fe640 1 -- 172.21.15.53:0/1131434694 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23400b9620 con 0x7f235806bc00 2023-06-10T19:05:15.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:15.755+0000 7f234f7fe640 1 -- 172.21.15.53:0/1131434694 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23400b97a0 con 0x7f235806bc00 2023-06-10T19:05:15.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:15.755+0000 7f235d746640 1 -- 172.21.15.53:0/1131434694 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23580c6aa0 con 0x7f235806bc00 2023-06-10T19:05:15.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:15.755+0000 7f234f7fe640 1 -- 172.21.15.53:0/1131434694 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23400b9b50 con 0x7f235806bc00 2023-06-10T19:05:15.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:15.755+0000 7f235d746640 1 -- 172.21.15.53:0/1131434694 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23580c7060 con 0x7f235806bc00 2023-06-10T19:05:15.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:15.755+0000 7f235d746640 1 -- 172.21.15.53:0/1131434694 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23580c7820 con 0x7f235806bc00 2023-06-10T19:05:15.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:15.759+0000 7f234f7fe640 1 -- 172.21.15.53:0/1131434694 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f23400b7070 con 0x7f235806bc00 2023-06-10T19:05:15.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:15.759+0000 7f234f7fe640 1 --2- 172.21.15.53:0/1131434694 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f23380662b0 0x7f2338068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:15.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:15.759+0000 7f234f7fe640 1 -- 172.21.15.53:0/1131434694 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2340121d90 con 0x7f235806bc00 2023-06-10T19:05:15.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:15.759+0000 7f2356ffd640 1 --2- 172.21.15.53:0/1131434694 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f23380662b0 0x7f2338068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:15.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:15.759+0000 7f2356ffd640 1 --2- 172.21.15.53:0/1131434694 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f23380662b0 0x7f2338068760 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f235815b5f0 tx=0x7f2348008470 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:15.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:15.763+0000 7f234f7fe640 1 -- 172.21.15.53:0/1131434694 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f23400ef210 con 0x7f235806bc00 2023-06-10T19:05:15.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:15.947+0000 7f235d746640 1 -- 172.21.15.53:0/1131434694 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f235804d790 con 0x7f235806bc00 2023-06-10T19:05:15.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:15.951+0000 7f234f7fe640 1 -- 172.21.15.53:0/1131434694 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) v1 ==== 94+0+4676 (secure 0 0 0) 0x7f23400b5090 con 0x7f235806bc00 2023-06-10T19:05:15.956 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:05:15.956 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":69,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7684,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/618082531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":618082531},{"type":"v1","addr":"172.21.15.117:6835","nonce":618082531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":7687,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3984577716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":3984577716},{"type":"v1","addr":"172.21.15.117:6837","nonce":3984577716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":9144,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/3202804884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3202804884},{"type":"v1","addr":"172.21.15.53:6833","nonce":3202804884}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:05:04.878347+0000","modified":"2023-06-10T19:05:07.051606+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9147},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9147":{"gid":9147,"name":"c","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/3233917972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":3233917972},{"type":"v1","addr":"172.21.15.53:6835","nonce":3233917972}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-06-10T19:05:15.957 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 69 2023-06-10T19:05:15.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:15.951+0000 7f235d746640 1 -- 172.21.15.53:0/1131434694 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f23380662b0 msgr2=0x7f2338068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:15.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:15.951+0000 7f235d746640 1 --2- 172.21.15.53:0/1131434694 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f23380662b0 0x7f2338068760 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f235815b5f0 tx=0x7f2348008470 comp rx=0 tx=0).stop 2023-06-10T19:05:15.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:15.951+0000 7f235d746640 1 -- 172.21.15.53:0/1131434694 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f235806bc00 msgr2=0x7f23580c6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:15.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:15.951+0000 7f235d746640 1 --2- 172.21.15.53:0/1131434694 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f235806bc00 0x7f23580c6290 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 crypto rx=0x7f23400b3040 tx=0x7f234001ba90 comp rx=0 tx=0).stop 2023-06-10T19:05:15.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:15.951+0000 7f235d746640 1 -- 172.21.15.53:0/1131434694 shutdown_connections 2023-06-10T19:05:15.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:15.951+0000 7f235d746640 1 --2- 172.21.15.53:0/1131434694 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f23380662b0 0x7f2338068760 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:15.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:15.951+0000 7f235d746640 1 --2- 172.21.15.53:0/1131434694 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23580c8d00 0x7f23580c37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:15.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:15.951+0000 7f235d746640 1 --2- 172.21.15.53:0/1131434694 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f235806bc00 0x7f23580c6290 unknown :-1 s=CLOSED pgs=1912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:15.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:15.951+0000 7f235d746640 1 --2- 172.21.15.53:0/1131434694 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f235806b2f0 0x7f23581577f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:15.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:15.951+0000 7f235d746640 1 -- 172.21.15.53:0/1131434694 >> 172.21.15.53:0/1131434694 conn(0x7f235806a0d0 msgr2=0x7f23580b3260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:15.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:15.951+0000 7f235d746640 1 -- 172.21.15.53:0/1131434694 shutdown_connections 2023-06-10T19:05:15.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:15.951+0000 7f235d746640 1 -- 172.21.15.53:0/1131434694 wait complete. 2023-06-10T19:05:15.975 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T19:05:15.976 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:05:15.981 DEBUG:teuthology.orchestra.run.smithi053:> adjust-ulimits daemon-helper kill python3 -c ' 2023-06-10T19:05:15.982 DEBUG:teuthology.orchestra.run.smithi053:> import time 2023-06-10T19:05:15.982 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:05:15.982 DEBUG:teuthology.orchestra.run.smithi053:> with open("/home/ubuntu/cephtest/mnt.0/background_file", '"'"'w'"'"') as f: 2023-06-10T19:05:15.982 DEBUG:teuthology.orchestra.run.smithi053:> f.write("content") 2023-06-10T19:05:15.983 DEBUG:teuthology.orchestra.run.smithi053:> f.flush() 2023-06-10T19:05:15.983 DEBUG:teuthology.orchestra.run.smithi053:> while True: 2023-06-10T19:05:15.983 DEBUG:teuthology.orchestra.run.smithi053:> time.sleep(1) 2023-06-10T19:05:15.983 DEBUG:teuthology.orchestra.run.smithi053:> ' 2023-06-10T19:05:16.024 DEBUG:teuthology.orchestra.run.smithi053:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/background_file 2023-06-10T19:05:16.031 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-10T19:05:16.032 INFO:teuthology.orchestra.run.smithi053.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0/background_file': No such file or directory 2023-06-10T19:05:17.033 DEBUG:teuthology.orchestra.run.smithi053:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/background_file 2023-06-10T19:05:17.040 INFO:teuthology.orchestra.run.smithi053.stdout:7 2023-06-10T19:05:17.041 INFO:tasks.cephfs.mount:File background_file became visible with size 7 from 0 after 1s 2023-06-10T19:05:17.042 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-06-10T19:05:17.042 DEBUG:teuthology.orchestra.run.smithi053:> import glob 2023-06-10T19:05:17.042 DEBUG:teuthology.orchestra.run.smithi053:> import re 2023-06-10T19:05:17.043 DEBUG:teuthology.orchestra.run.smithi053:> import os 2023-06-10T19:05:17.043 DEBUG:teuthology.orchestra.run.smithi053:> import subprocess 2023-06-10T19:05:17.043 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:05:17.044 DEBUG:teuthology.orchestra.run.smithi053:> def _find_admin_socket(client_name): 2023-06-10T19:05:17.044 DEBUG:teuthology.orchestra.run.smithi053:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-06-10T19:05:17.044 DEBUG:teuthology.orchestra.run.smithi053:> files = glob.glob(asok_path) 2023-06-10T19:05:17.044 DEBUG:teuthology.orchestra.run.smithi053:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-06-10T19:05:17.045 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:05:17.045 DEBUG:teuthology.orchestra.run.smithi053:> # Given a non-glob path, it better be there 2023-06-10T19:05:17.045 DEBUG:teuthology.orchestra.run.smithi053:> if "*" not in asok_path: 2023-06-10T19:05:17.046 DEBUG:teuthology.orchestra.run.smithi053:> assert(len(files) == 1) 2023-06-10T19:05:17.046 DEBUG:teuthology.orchestra.run.smithi053:> return files[0] 2023-06-10T19:05:17.046 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:05:17.046 DEBUG:teuthology.orchestra.run.smithi053:> for f in files: 2023-06-10T19:05:17.047 DEBUG:teuthology.orchestra.run.smithi053:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-06-10T19:05:17.047 DEBUG:teuthology.orchestra.run.smithi053:> if os.path.exists("/proc/{0}".format(pid)): 2023-06-10T19:05:17.047 DEBUG:teuthology.orchestra.run.smithi053:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-06-10T19:05:17.048 DEBUG:teuthology.orchestra.run.smithi053:> contents = proc_f.read() 2023-06-10T19:05:17.048 DEBUG:teuthology.orchestra.run.smithi053:> if mountpoint in contents: 2023-06-10T19:05:17.048 DEBUG:teuthology.orchestra.run.smithi053:> return f 2023-06-10T19:05:17.049 DEBUG:teuthology.orchestra.run.smithi053:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-06-10T19:05:17.049 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:05:17.049 DEBUG:teuthology.orchestra.run.smithi053:> print(_find_admin_socket("client.0")) 2023-06-10T19:05:17.049 DEBUG:teuthology.orchestra.run.smithi053:> ' 2023-06-10T19:05:17.164 INFO:teuthology.orchestra.run.smithi053.stdout:/var/run/ceph/ceph-client.0.62837.asok 2023-06-10T19:05:17.346 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.62837.asok 2023-06-10T19:05:17.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:05:17.347 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.62837.asok mds_sessions 2023-06-10T19:05:17.504 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-06-10T19:05:17.504 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 9300, 2023-06-10T19:05:17.505 INFO:teuthology.orchestra.run.smithi053.stdout: "inst": { 2023-06-10T19:05:17.505 INFO:teuthology.orchestra.run.smithi053.stdout: "name": { 2023-06-10T19:05:17.505 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "client", 2023-06-10T19:05:17.505 INFO:teuthology.orchestra.run.smithi053.stdout: "num": 9300 2023-06-10T19:05:17.505 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:05:17.505 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": { 2023-06-10T19:05:17.505 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2023-06-10T19:05:17.506 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "192.168.0.1:0", 2023-06-10T19:05:17.506 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 935434380 2023-06-10T19:05:17.506 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:05:17.506 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:05:17.506 INFO:teuthology.orchestra.run.smithi053.stdout: "inst_str": "client.9300 v1:192.168.0.1:0/935434380", 2023-06-10T19:05:17.506 INFO:teuthology.orchestra.run.smithi053.stdout: "addr_str": "v1:192.168.0.1:0/935434380", 2023-06-10T19:05:17.506 INFO:teuthology.orchestra.run.smithi053.stdout: "sessions": [ 2023-06-10T19:05:17.506 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:05:17.507 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": 0, 2023-06-10T19:05:17.507 INFO:teuthology.orchestra.run.smithi053.stdout: "addrs": { 2023-06-10T19:05:17.507 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2023-06-10T19:05:17.507 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:05:17.507 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2023-06-10T19:05:17.507 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.53:6834", 2023-06-10T19:05:17.507 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 3233917972 2023-06-10T19:05:17.507 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:05:17.508 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:05:17.508 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2023-06-10T19:05:17.508 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.53:6835", 2023-06-10T19:05:17.508 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 3233917972 2023-06-10T19:05:17.508 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:05:17.508 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2023-06-10T19:05:17.508 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:05:17.509 INFO:teuthology.orchestra.run.smithi053.stdout: "seq": 0, 2023-06-10T19:05:17.509 INFO:teuthology.orchestra.run.smithi053.stdout: "cap_gen": 0, 2023-06-10T19:05:17.509 INFO:teuthology.orchestra.run.smithi053.stdout: "cap_ttl": "2023-06-10T19:06:11.758327+0000", 2023-06-10T19:05:17.509 INFO:teuthology.orchestra.run.smithi053.stdout: "last_cap_renew_request": "2023-06-10T19:05:11.758327+0000", 2023-06-10T19:05:17.509 INFO:teuthology.orchestra.run.smithi053.stdout: "cap_renew_seq": 2, 2023-06-10T19:05:17.509 INFO:teuthology.orchestra.run.smithi053.stdout: "num_caps": 2, 2023-06-10T19:05:17.509 INFO:teuthology.orchestra.run.smithi053.stdout: "state": "open" 2023-06-10T19:05:17.509 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:05:17.510 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2023-06-10T19:05:17.510 INFO:teuthology.orchestra.run.smithi053.stdout: "mdsmap_epoch": 69 2023-06-10T19:05:17.510 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-06-10T19:05:17.518 DEBUG:teuthology.orchestra.run.smithi117:> stat /home/ubuntu/cephtest/mnt.1/background_file 2023-06-10T19:05:17.535 INFO:teuthology.orchestra.run.smithi117.stdout: File: /home/ubuntu/cephtest/mnt.1/background_file 2023-06-10T19:05:17.535 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 1 IO Block: 4194304 regular file 2023-06-10T19:05:17.536 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 2dh/45d Inode: 1099511627776 Links: 1 2023-06-10T19:05:17.536 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0664/-rw-rw-r--) Uid: ( 1000/ ubuntu) Gid: ( 1271/ ubuntu) 2023-06-10T19:05:17.536 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2023-06-10 19:05:16.086267892 +0000 2023-06-10T19:05:17.536 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2023-06-10 19:05:16.098608552 +0000 2023-06-10T19:05:17.536 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2023-06-10 19:05:16.098608552 +0000 2023-06-10T19:05:17.536 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: - 2023-06-10T19:05:17.536 INFO:tasks.cephfs.mount:File background_file became visible from 1 after 0s 2023-06-10T19:05:17.537 INFO:tasks.cephfs.mount:Suspending the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-06-10T19:05:17.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:05:17.537 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link set brx.0 down 2023-06-10T19:05:22.553 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T19:05:22.553 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:05:22.561 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits daemon-helper kill python3 -c ' 2023-06-10T19:05:22.561 DEBUG:teuthology.orchestra.run.smithi117:> import os 2023-06-10T19:05:22.562 DEBUG:teuthology.orchestra.run.smithi117:> import time 2023-06-10T19:05:22.562 DEBUG:teuthology.orchestra.run.smithi117:> 2023-06-10T19:05:22.562 DEBUG:teuthology.orchestra.run.smithi117:> fd = os.open("/home/ubuntu/cephtest/mnt.1/background_file", os.O_RDWR | os.O_CREAT, 0o644) 2023-06-10T19:05:22.563 DEBUG:teuthology.orchestra.run.smithi117:> try: 2023-06-10T19:05:22.563 DEBUG:teuthology.orchestra.run.smithi117:> while True: 2023-06-10T19:05:22.563 DEBUG:teuthology.orchestra.run.smithi117:> os.write(fd, b'"'"'content'"'"') 2023-06-10T19:05:22.564 DEBUG:teuthology.orchestra.run.smithi117:> time.sleep(1) 2023-06-10T19:05:22.564 DEBUG:teuthology.orchestra.run.smithi117:> if not False: 2023-06-10T19:05:22.564 DEBUG:teuthology.orchestra.run.smithi117:> break 2023-06-10T19:05:22.565 DEBUG:teuthology.orchestra.run.smithi117:> except IOError as e: 2023-06-10T19:05:22.565 DEBUG:teuthology.orchestra.run.smithi117:> pass 2023-06-10T19:05:22.565 DEBUG:teuthology.orchestra.run.smithi117:> os.close(fd) 2023-06-10T19:05:22.566 DEBUG:teuthology.orchestra.run.smithi117:> ' 2023-06-10T19:05:27.705 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:05:27.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:27.827+0000 7faa378c5640 1 Processor -- start 2023-06-10T19:05:27.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:27.827+0000 7faa378c5640 1 -- start start 2023-06-10T19:05:27.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:27.831+0000 7faa378c5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faa300b3ac0 0x7faa300b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:27.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:27.831+0000 7faa378c5640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7faa300d14c0 0x7faa3015fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:27.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:27.831+0000 7faa378c5640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa300d0020 con 0x7faa300cc690 2023-06-10T19:05:27.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:27.831+0000 7faa378c5640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa300b43d0 con 0x7faa300d14c0 2023-06-10T19:05:27.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:27.831+0000 7faa378c5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa300cef40 con 0x7faa300b3ac0 2023-06-10T19:05:27.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:27.831+0000 7faa35e62640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7faa300d14c0 0x7faa3015fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:27.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:27.831+0000 7faa34e60640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7faa300cc690 0x7faa3015f370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52578/0 (socket says 172.21.15.53:52578) 2023-06-10T19:05:27.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:27.831+0000 7faa35e62640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7faa300d14c0 0x7faa3015fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51454/0 (socket says 172.21.15.53:51454) 2023-06-10T19:05:27.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:27.831+0000 7faa34e60640 1 -- 172.21.15.53:0/1709112744 learned_addr learned my addr 172.21.15.53:0/1709112744 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:05:27.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:27.831+0000 7faa35661640 1 --2- 172.21.15.53:0/1709112744 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faa300b3ac0 0x7faa300b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:27.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:27.831+0000 7faa35e62640 1 -- 172.21.15.53:0/1709112744 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faa300b3ac0 msgr2=0x7faa300b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:27.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:27.831+0000 7faa35e62640 1 --2- 172.21.15.53:0/1709112744 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faa300b3ac0 0x7faa300b3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:27.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:27.831+0000 7faa35e62640 1 -- 172.21.15.53:0/1709112744 >> v1:172.21.15.53:6789/0 conn(0x7faa300cc690 legacy=0x7faa3015f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:27.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:27.831+0000 7faa35e62640 1 -- 172.21.15.53:0/1709112744 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa300cf220 con 0x7faa300d14c0 2023-06-10T19:05:27.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:27.831+0000 7faa35e62640 1 --2- 172.21.15.53:0/1709112744 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa300d14c0 0x7faa3015fa80 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7faa28009d90 tx=0x7faa2801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=696e12214d19d4ed server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:27.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:27.831+0000 7faa27fff640 1 -- 172.21.15.53:0/1709112744 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa280a58f0 con 0x7faa300d14c0 2023-06-10T19:05:27.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:27.831+0000 7faa27fff640 1 -- 172.21.15.53:0/1709112744 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa280a5a50 con 0x7faa300d14c0 2023-06-10T19:05:27.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:27.831+0000 7faa27fff640 1 -- 172.21.15.53:0/1709112744 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa280a5de0 con 0x7faa300d14c0 2023-06-10T19:05:27.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:27.831+0000 7faa378c5640 1 -- 172.21.15.53:0/1709112744 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa300d14c0 msgr2=0x7faa3015fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:27.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:27.835+0000 7faa378c5640 1 --2- 172.21.15.53:0/1709112744 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa300d14c0 0x7faa3015fa80 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7faa28009d90 tx=0x7faa2801c920 comp rx=0 tx=0).stop 2023-06-10T19:05:27.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:27.835+0000 7faa378c5640 1 -- 172.21.15.53:0/1709112744 shutdown_connections 2023-06-10T19:05:27.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:27.835+0000 7faa378c5640 1 --2- 172.21.15.53:0/1709112744 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa300d14c0 0x7faa3015fa80 unknown :-1 s=CLOSED pgs=1914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:27.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:27.835+0000 7faa378c5640 1 --2- 172.21.15.53:0/1709112744 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faa300b3ac0 0x7faa300b3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:27.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:27.835+0000 7faa378c5640 1 -- 172.21.15.53:0/1709112744 >> 172.21.15.53:0/1709112744 conn(0x7faa30071790 msgr2=0x7faa30069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:27.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:27.835+0000 7faa378c5640 1 -- 172.21.15.53:0/1709112744 shutdown_connections 2023-06-10T19:05:27.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:27.835+0000 7faa378c5640 1 -- 172.21.15.53:0/1709112744 wait complete. 2023-06-10T19:05:27.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:27.835+0000 7faa378c5640 1 Processor -- start 2023-06-10T19:05:27.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:27.835+0000 7faa378c5640 1 -- start start 2023-06-10T19:05:27.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:27.835+0000 7faa378c5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa300b3ac0 0x7faa30157720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:27.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:27.835+0000 7faa378c5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faa300cc690 0x7faa30069de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:27.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:27.835+0000 7faa378c5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa300d14c0 0x7faa300d1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:27.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:27.835+0000 7faa378c5640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa30157c60 con 0x7faa300d14c0 2023-06-10T19:05:27.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:27.835+0000 7faa378c5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa300cb2e0 con 0x7faa300b3ac0 2023-06-10T19:05:27.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:27.835+0000 7faa378c5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa30158390 con 0x7faa300cc690 2023-06-10T19:05:27.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:27.835+0000 7faa35e62640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa300d14c0 0x7faa300d1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:27.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:27.835+0000 7faa35e62640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa300d14c0 0x7faa300d1fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51458/0 (socket says 172.21.15.53:51458) 2023-06-10T19:05:27.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:27.835+0000 7faa35e62640 1 -- 172.21.15.53:0/185857628 learned_addr learned my addr 172.21.15.53:0/185857628 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:27.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:27.835+0000 7faa34e60640 1 --2- 172.21.15.53:0/185857628 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faa300cc690 0x7faa30069de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:27.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:27.835+0000 7faa35e62640 1 -- 172.21.15.53:0/185857628 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faa300cc690 msgr2=0x7faa30069de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:27.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:27.835+0000 7faa35e62640 1 --2- 172.21.15.53:0/185857628 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faa300cc690 0x7faa30069de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:27.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:27.835+0000 7faa35e62640 1 -- 172.21.15.53:0/185857628 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa300b3ac0 msgr2=0x7faa30157720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:27.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:27.835+0000 7faa35e62640 1 --2- 172.21.15.53:0/185857628 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa300b3ac0 0x7faa30157720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:27.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:27.835+0000 7faa35e62640 1 -- 172.21.15.53:0/185857628 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa28009a70 con 0x7faa300d14c0 2023-06-10T19:05:27.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:27.835+0000 7faa35e62640 1 --2- 172.21.15.53:0/185857628 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa300d14c0 0x7faa300d1fd0 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 crypto rx=0x7faa2801afd0 tx=0x7faa280196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:27.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:27.835+0000 7faa25ffb640 1 -- 172.21.15.53:0/185857628 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa280b9860 con 0x7faa300d14c0 2023-06-10T19:05:27.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:27.835+0000 7faa25ffb640 1 -- 172.21.15.53:0/185857628 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa280b99c0 con 0x7faa300d14c0 2023-06-10T19:05:27.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:27.835+0000 7faa378c5640 1 -- 172.21.15.53:0/185857628 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa300cb530 con 0x7faa300d14c0 2023-06-10T19:05:27.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:27.835+0000 7faa25ffb640 1 -- 172.21.15.53:0/185857628 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa280b9d50 con 0x7faa300d14c0 2023-06-10T19:05:27.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:27.835+0000 7faa378c5640 1 -- 172.21.15.53:0/185857628 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa300cbaf0 con 0x7faa300d14c0 2023-06-10T19:05:27.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:27.835+0000 7faa378c5640 1 -- 172.21.15.53:0/185857628 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa3004d790 con 0x7faa300d14c0 2023-06-10T19:05:27.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:27.839+0000 7faa25ffb640 1 -- 172.21.15.53:0/185857628 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7faa280c4460 con 0x7faa300d14c0 2023-06-10T19:05:27.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:27.839+0000 7faa25ffb640 1 --2- 172.21.15.53:0/185857628 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7faa14066280 0x7faa14068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:27.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:27.839+0000 7faa25ffb640 1 -- 172.21.15.53:0/185857628 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6062+0+0 (secure 0 0 0) 0x7faa2811f140 con 0x7faa300d14c0 2023-06-10T19:05:27.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:27.839+0000 7faa35661640 1 --2- 172.21.15.53:0/185857628 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7faa14066280 0x7faa14068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:27.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:27.839+0000 7faa35661640 1 --2- 172.21.15.53:0/185857628 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7faa14066280 0x7faa14068730 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7faa200098f0 tx=0x7faa20008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:27.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:27.843+0000 7faa25ffb640 1 -- 172.21.15.53:0/185857628 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7faa280ec520 con 0x7faa300d14c0 2023-06-10T19:05:28.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:28.031+0000 7faa378c5640 1 -- 172.21.15.53:0/185857628 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faa3008a200 con 0x7faa300d14c0 2023-06-10T19:05:28.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:28.035+0000 7faa25ffb640 1 -- 172.21.15.53:0/185857628 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) v1 ==== 94+0+4676 (secure 0 0 0) 0x7faa280efb40 con 0x7faa300d14c0 2023-06-10T19:05:28.039 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:05:28.039 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":69,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7684,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/618082531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":618082531},{"type":"v1","addr":"172.21.15.117:6835","nonce":618082531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":7687,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3984577716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":3984577716},{"type":"v1","addr":"172.21.15.117:6837","nonce":3984577716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":9144,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/3202804884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3202804884},{"type":"v1","addr":"172.21.15.53:6833","nonce":3202804884}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:05:04.878347+0000","modified":"2023-06-10T19:05:07.051606+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9147},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9147":{"gid":9147,"name":"c","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/3233917972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":3233917972},{"type":"v1","addr":"172.21.15.53:6835","nonce":3233917972}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-06-10T19:05:28.040 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 69 2023-06-10T19:05:28.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:28.035+0000 7faa378c5640 1 -- 172.21.15.53:0/185857628 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7faa14066280 msgr2=0x7faa14068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:28.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:28.035+0000 7faa378c5640 1 --2- 172.21.15.53:0/185857628 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7faa14066280 0x7faa14068730 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7faa200098f0 tx=0x7faa20008040 comp rx=0 tx=0).stop 2023-06-10T19:05:28.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:28.035+0000 7faa378c5640 1 -- 172.21.15.53:0/185857628 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa300d14c0 msgr2=0x7faa300d1fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:28.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:28.035+0000 7faa378c5640 1 --2- 172.21.15.53:0/185857628 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa300d14c0 0x7faa300d1fd0 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 crypto rx=0x7faa2801afd0 tx=0x7faa280196c0 comp rx=0 tx=0).stop 2023-06-10T19:05:28.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:28.035+0000 7faa378c5640 1 -- 172.21.15.53:0/185857628 shutdown_connections 2023-06-10T19:05:28.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:28.035+0000 7faa378c5640 1 --2- 172.21.15.53:0/185857628 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7faa14066280 0x7faa14068730 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:28.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:28.035+0000 7faa378c5640 1 --2- 172.21.15.53:0/185857628 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa300d14c0 0x7faa300d1fd0 unknown :-1 s=CLOSED pgs=1915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:28.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:28.035+0000 7faa378c5640 1 --2- 172.21.15.53:0/185857628 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faa300cc690 0x7faa30069de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:28.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:28.035+0000 7faa378c5640 1 --2- 172.21.15.53:0/185857628 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa300b3ac0 0x7faa30157720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:28.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:28.035+0000 7faa378c5640 1 -- 172.21.15.53:0/185857628 >> 172.21.15.53:0/185857628 conn(0x7faa30071790 msgr2=0x7faa300b2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:28.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:28.035+0000 7faa378c5640 1 -- 172.21.15.53:0/185857628 shutdown_connections 2023-06-10T19:05:28.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:28.035+0000 7faa378c5640 1 -- 172.21.15.53:0/185857628 wait complete. 2023-06-10T19:05:28.057 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session evict 9300 2023-06-10T19:05:29.194 DEBUG:tasks.cephfs.filesystem:_json_asok output empty 2023-06-10T19:05:30.671 INFO:tasks.cephfs.test_client_recovery:cap_waiter waited 1.476503610610962s 2023-06-10T19:05:30.671 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-06-10T19:05:30.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:05:30.672 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link set brx.0 up 2023-06-10T19:05:30.740 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-06-10T19:05:30.741 DEBUG:teuthology.orchestra.run.smithi053:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-06-10T19:05:30.824 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-06-10T19:05:30.868 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-06-10T19:05:30.868 INFO:tasks.cephfs.mount:Terminating background process 2023-06-10T19:05:30.869 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T19:05:30.869 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:05:30.874 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:05:31.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.051+0000 7f5840ceb640 1 Processor -- start 2023-06-10T19:05:31.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.051+0000 7f5840ceb640 1 -- start start 2023-06-10T19:05:31.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.051+0000 7f5840ceb640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f583c0ceb20 0x7f583c0cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:31.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.051+0000 7f5840ceb640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f583c15cc40 con 0x7f583c15c7f0 2023-06-10T19:05:31.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.051+0000 7f5840ceb640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f583c0af530 con 0x7f583c06b780 2023-06-10T19:05:31.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.051+0000 7f5840ceb640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f583c15c3d0 con 0x7f583c0ceb20 2023-06-10T19:05:31.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.051+0000 7f5839d9b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f583c15c7f0 0x7f583c15f320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52590/0 (socket says 172.21.15.53:52590) 2023-06-10T19:05:31.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.051+0000 7f5839d9b640 1 -- 172.21.15.53:0/4268510963 learned_addr learned my addr 172.21.15.53:0/4268510963 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:05:31.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.051+0000 7f583ad9d640 1 --2- 172.21.15.53:0/4268510963 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f583c0ceb20 0x7f583c0cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:31.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.051+0000 7f583959a640 1 -- 172.21.15.53:0/4268510963 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 839116159 0 0) 0x7f583c15cc40 con 0x7f583c15c7f0 2023-06-10T19:05:31.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.051+0000 7f583959a640 1 -- 172.21.15.53:0/4268510963 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5828003530 con 0x7f583c15c7f0 2023-06-10T19:05:31.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.051+0000 7f583959a640 1 -- 172.21.15.53:0/4268510963 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2711224780 0 0) 0x7f5828003530 con 0x7f583c15c7f0 2023-06-10T19:05:31.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.051+0000 7f583ad9d640 1 -- 172.21.15.53:0/4268510963 >> v1:172.21.15.117:6789/0 conn(0x7f583c06b780 legacy=0x7f583c06bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:31.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.051+0000 7f583ad9d640 1 -- 172.21.15.53:0/4268510963 >> v1:172.21.15.53:6789/0 conn(0x7f583c15c7f0 legacy=0x7f583c15f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:31.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.051+0000 7f583ad9d640 1 -- 172.21.15.53:0/4268510963 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f583c15fd70 con 0x7f583c0ceb20 2023-06-10T19:05:31.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.055+0000 7f583ad9d640 1 --2- 172.21.15.53:0/4268510963 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f583c0ceb20 0x7f583c0cefa0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f58340097f0 tx=0x7f583401c350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f7ffba938c7f477 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:31.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.055+0000 7f583959a640 1 -- 172.21.15.53:0/4268510963 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5824001680 con 0x7f583c0ceb20 2023-06-10T19:05:31.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.055+0000 7f583959a640 1 -- 172.21.15.53:0/4268510963 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58340a7050 con 0x7f583c0ceb20 2023-06-10T19:05:31.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.055+0000 7f583959a640 1 -- 172.21.15.53:0/4268510963 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58340ab600 con 0x7f583c0ceb20 2023-06-10T19:05:31.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.055+0000 7f5840ceb640 1 -- 172.21.15.53:0/4268510963 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f583c0ceb20 msgr2=0x7f583c0cefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:31.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.055+0000 7f5840ceb640 1 --2- 172.21.15.53:0/4268510963 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f583c0ceb20 0x7f583c0cefa0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f58340097f0 tx=0x7f583401c350 comp rx=0 tx=0).stop 2023-06-10T19:05:31.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.055+0000 7f5840ceb640 1 -- 172.21.15.53:0/4268510963 shutdown_connections 2023-06-10T19:05:31.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.055+0000 7f5840ceb640 1 --2- 172.21.15.53:0/4268510963 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f583c0ceb20 0x7f583c0cefa0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:31.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.055+0000 7f5840ceb640 1 -- 172.21.15.53:0/4268510963 >> 172.21.15.53:0/4268510963 conn(0x7f583c06a090 msgr2=0x7f583c06d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:31.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.055+0000 7f5840ceb640 1 -- 172.21.15.53:0/4268510963 shutdown_connections 2023-06-10T19:05:31.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.055+0000 7f5840ceb640 1 -- 172.21.15.53:0/4268510963 wait complete. 2023-06-10T19:05:31.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.055+0000 7f5840ceb640 1 Processor -- start 2023-06-10T19:05:31.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.055+0000 7f5840ceb640 1 -- start start 2023-06-10T19:05:31.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.055+0000 7f5840ceb640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f583c06b780 0x7f583c15a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:31.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.055+0000 7f5840ceb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f583c0ceb20 0x7f583c153730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:31.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.055+0000 7f5840ceb640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f583c15c7f0 0x7f583c15e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:31.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.055+0000 7f5840ceb640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f583c158bd0 con 0x7f583c0ceb20 2023-06-10T19:05:31.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.055+0000 7f5840ceb640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f583c158eb0 con 0x7f583c15c7f0 2023-06-10T19:05:31.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.055+0000 7f5840ceb640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f583c159190 con 0x7f583c06b780 2023-06-10T19:05:31.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.055+0000 7f5839d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f583c0ceb20 0x7f583c153730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:31.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.055+0000 7f5839d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f583c0ceb20 0x7f583c153730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51468/0 (socket says 172.21.15.53:51468) 2023-06-10T19:05:31.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.055+0000 7f5839d9b640 1 -- 172.21.15.53:0/1005506102 learned_addr learned my addr 172.21.15.53:0/1005506102 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:31.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.059+0000 7f583ad9d640 1 --2- 172.21.15.53:0/1005506102 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f583c15c7f0 0x7f583c15e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:31.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.059+0000 7f583a59c640 1 --2- 172.21.15.53:0/1005506102 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f583c06b780 0x7f583c15a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:31.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.059+0000 7f5839d9b640 1 -- 172.21.15.53:0/1005506102 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f583c06b780 msgr2=0x7f583c15a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:31.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.059+0000 7f5839d9b640 1 --2- 172.21.15.53:0/1005506102 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f583c06b780 0x7f583c15a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:31.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.059+0000 7f5839d9b640 1 -- 172.21.15.53:0/1005506102 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f583c15c7f0 msgr2=0x7f583c15e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:31.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.059+0000 7f5839d9b640 1 --2- 172.21.15.53:0/1005506102 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f583c15c7f0 0x7f583c15e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:31.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.059+0000 7f5839d9b640 1 -- 172.21.15.53:0/1005506102 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5834009420 con 0x7f583c0ceb20 2023-06-10T19:05:31.069 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:2023-06-10T19:05:31.059+0000 7f8c5dffb640 -1 client.9300 I was blocklisted at osd epoch 126 2023-06-10T19:05:31.069 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:2023-06-10T19:05:31.059+0000 7f8c5dffb640 -1 client.9300 remove_session_caps still has dirty data on 0x10000000000.head(faked_ino=0 nref=7 ll_ref=2 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100664 size=7/4194304 nlink=1 btime=2023-06-10T19:05:16.086267+0000 mtime=2023-06-10T19:05:16.098608+0000 ctime=2023-06-10T19:05:16.098608+0000 change_attr=1 caps=- objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 7] parents=0x1.head["background_file"] 0x7f8c580093e0) 2023-06-10T19:05:31.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.059+0000 7f5839d9b640 1 --2- 172.21.15.53:0/1005506102 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f583c0ceb20 0x7f583c153730 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7f58240011f0 tx=0x7f582400cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:31.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.059+0000 7f5832ffd640 1 -- 172.21.15.53:0/1005506102 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5824005ae0 con 0x7f583c0ceb20 2023-06-10T19:05:31.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.059+0000 7f5832ffd640 1 -- 172.21.15.53:0/1005506102 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5824005c60 con 0x7f583c0ceb20 2023-06-10T19:05:31.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.059+0000 7f5840ceb640 1 -- 172.21.15.53:0/1005506102 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f583c159470 con 0x7f583c0ceb20 2023-06-10T19:05:31.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.059+0000 7f5832ffd640 1 -- 172.21.15.53:0/1005506102 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58240072b0 con 0x7f583c0ceb20 2023-06-10T19:05:31.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.059+0000 7f5840ceb640 1 -- 172.21.15.53:0/1005506102 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f583c159a30 con 0x7f583c0ceb20 2023-06-10T19:05:31.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.059+0000 7f5840ceb640 1 -- 172.21.15.53:0/1005506102 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f583c0b39e0 con 0x7f583c0ceb20 2023-06-10T19:05:31.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.059+0000 7f5832ffd640 1 -- 172.21.15.53:0/1005506102 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5824007410 con 0x7f583c0ceb20 2023-06-10T19:05:31.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.059+0000 7f5832ffd640 1 --2- 172.21.15.53:0/1005506102 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f581c066280 0x7f581c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:31.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.059+0000 7f5832ffd640 1 -- 172.21.15.53:0/1005506102 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6105+0+0 (secure 0 0 0) 0x7f58240834f0 con 0x7f583c0ceb20 2023-06-10T19:05:31.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.059+0000 7f583a59c640 1 --2- 172.21.15.53:0/1005506102 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f581c066280 0x7f581c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:31.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.059+0000 7f583a59c640 1 --2- 172.21.15.53:0/1005506102 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f581c066280 0x7f581c068730 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f582c0012f0 tx=0x7f582c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:31.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.063+0000 7f5832ffd640 1 -- 172.21.15.53:0/1005506102 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f58240508a0 con 0x7f583c0ceb20 2023-06-10T19:05:31.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.219+0000 7f5840ceb640 1 -- 172.21.15.53:0/1005506102 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f583c04d790 con 0x7f583c0ceb20 2023-06-10T19:05:31.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.223+0000 7f5832ffd640 1 -- 172.21.15.53:0/1005506102 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v126) v1 ==== 74+0+18408 (secure 0 0 0) 0x7f5824053ec0 con 0x7f583c0ceb20 2023-06-10T19:05:31.228 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:05:31.228 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":126,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:05:29.141776+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-06-10T19:05:02.560833+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-06-10T19:05:03.863586+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.0.1:0/935434380":"2023-06-10T20:05:28.182850+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:05:31.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.223+0000 7f5840ceb640 1 -- 172.21.15.53:0/1005506102 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f581c066280 msgr2=0x7f581c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:31.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.223+0000 7f5840ceb640 1 --2- 172.21.15.53:0/1005506102 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f581c066280 0x7f581c068730 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f582c0012f0 tx=0x7f582c009040 comp rx=0 tx=0).stop 2023-06-10T19:05:31.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.223+0000 7f5840ceb640 1 -- 172.21.15.53:0/1005506102 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f583c0ceb20 msgr2=0x7f583c153730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:31.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.223+0000 7f5840ceb640 1 --2- 172.21.15.53:0/1005506102 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f583c0ceb20 0x7f583c153730 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7f58240011f0 tx=0x7f582400cb90 comp rx=0 tx=0).stop 2023-06-10T19:05:31.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.223+0000 7f5840ceb640 1 -- 172.21.15.53:0/1005506102 shutdown_connections 2023-06-10T19:05:31.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.223+0000 7f5840ceb640 1 --2- 172.21.15.53:0/1005506102 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f581c066280 0x7f581c068730 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:31.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.223+0000 7f5840ceb640 1 --2- 172.21.15.53:0/1005506102 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f583c15c7f0 0x7f583c15e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:31.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.223+0000 7f5840ceb640 1 --2- 172.21.15.53:0/1005506102 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f583c0ceb20 0x7f583c153730 unknown :-1 s=CLOSED pgs=1917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:31.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.223+0000 7f5840ceb640 1 --2- 172.21.15.53:0/1005506102 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f583c06b780 0x7f583c15a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:31.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.223+0000 7f5840ceb640 1 -- 172.21.15.53:0/1005506102 >> 172.21.15.53:0/1005506102 conn(0x7f583c06a090 msgr2=0x7f583c15b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:31.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.223+0000 7f5840ceb640 1 -- 172.21.15.53:0/1005506102 shutdown_connections 2023-06-10T19:05:31.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.223+0000 7f5840ceb640 1 -- 172.21.15.53:0/1005506102 wait complete. 2023-06-10T19:05:31.247 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-10T18:52:33.633114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-10T18:52:39.171487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-10T19:05:02.560833+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '124', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2023-06-10T19:05:03.863586+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '125', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-10T19:05:31.248 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-10T19:05:31.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.375+0000 7f50343cb640 1 Processor -- start 2023-06-10T19:05:31.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.375+0000 7f50343cb640 1 -- start start 2023-06-10T19:05:31.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.375+0000 7f50343cb640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f502c15c060 0x7f502c0cc020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:31.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.375+0000 7f50343cb640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f502c070de0 0x7f502c15c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:31.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.375+0000 7f50343cb640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f502c0c8d50 con 0x7f502c15c970 2023-06-10T19:05:31.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.375+0000 7f50343cb640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f502c0c9030 con 0x7f502c070de0 2023-06-10T19:05:31.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.375+0000 7f50343cb640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f502c070300 con 0x7f502c15c060 2023-06-10T19:05:31.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.375+0000 7f5031966640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f502c070de0 0x7f502c15c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:31.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.375+0000 7f5032968640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f502c15c970 0x7f502c06bd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60246/0 (socket says 172.21.15.53:60246) 2023-06-10T19:05:31.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.375+0000 7f5032968640 1 -- 172.21.15.53:0/902913526 learned_addr learned my addr 172.21.15.53:0/902913526 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:05:31.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.375+0000 7f5032167640 1 --2- 172.21.15.53:0/902913526 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f502c15c060 0x7f502c0cc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:31.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.375+0000 7f5031966640 1 -- 172.21.15.53:0/902913526 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f502c15c060 msgr2=0x7f502c0cc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:31.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.375+0000 7f5031966640 1 --2- 172.21.15.53:0/902913526 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f502c15c060 0x7f502c0cc020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:31.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.375+0000 7f5031966640 1 -- 172.21.15.53:0/902913526 >> v1:172.21.15.53:6789/0 conn(0x7f502c15c970 legacy=0x7f502c06bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:31.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.375+0000 7f5031165640 1 -- 172.21.15.53:0/902913526 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1271738584 0 0) 0x7f502c0c8d50 con 0x7f502c15c970 2023-06-10T19:05:31.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.375+0000 7f5031966640 1 -- 172.21.15.53:0/902913526 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f502c0705e0 con 0x7f502c070de0 2023-06-10T19:05:31.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.379+0000 7f5031966640 1 --2- 172.21.15.53:0/902913526 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f502c070de0 0x7f502c15c430 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 crypto rx=0x7f501c0097c0 tx=0x7f501c01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f828ddd4a557ef42 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:31.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.379+0000 7f5031165640 1 -- 172.21.15.53:0/902913526 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501c0ab600 con 0x7f502c070de0 2023-06-10T19:05:31.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.379+0000 7f5031165640 1 -- 172.21.15.53:0/902913526 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f501c0a7050 con 0x7f502c070de0 2023-06-10T19:05:31.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.379+0000 7f5031165640 1 -- 172.21.15.53:0/902913526 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501c0ab980 con 0x7f502c070de0 2023-06-10T19:05:31.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.379+0000 7f50343cb640 1 -- 172.21.15.53:0/902913526 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f502c070de0 msgr2=0x7f502c15c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:31.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.379+0000 7f50343cb640 1 --2- 172.21.15.53:0/902913526 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f502c070de0 0x7f502c15c430 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 crypto rx=0x7f501c0097c0 tx=0x7f501c01c3f0 comp rx=0 tx=0).stop 2023-06-10T19:05:31.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.379+0000 7f50343cb640 1 -- 172.21.15.53:0/902913526 shutdown_connections 2023-06-10T19:05:31.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.379+0000 7f50343cb640 1 --2- 172.21.15.53:0/902913526 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f502c070de0 0x7f502c15c430 unknown :-1 s=CLOSED pgs=1919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:31.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.379+0000 7f50343cb640 1 --2- 172.21.15.53:0/902913526 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f502c15c060 0x7f502c0cc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:31.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.379+0000 7f50343cb640 1 -- 172.21.15.53:0/902913526 >> 172.21.15.53:0/902913526 conn(0x7f502c06a0e0 msgr2=0x7f502c0cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:31.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.379+0000 7f50343cb640 1 -- 172.21.15.53:0/902913526 shutdown_connections 2023-06-10T19:05:31.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.379+0000 7f50343cb640 1 -- 172.21.15.53:0/902913526 wait complete. 2023-06-10T19:05:31.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.379+0000 7f50343cb640 1 Processor -- start 2023-06-10T19:05:31.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.379+0000 7f50343cb640 1 -- start start 2023-06-10T19:05:31.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.379+0000 7f50343cb640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f502c070de0 0x7f502c159ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:31.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.379+0000 7f50343cb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f502c15c060 0x7f502c14f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:31.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.379+0000 7f50343cb640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f502c15c970 0x7f502c147d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:31.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.379+0000 7f50343cb640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f502c15a400 con 0x7f502c15c060 2023-06-10T19:05:31.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.379+0000 7f50343cb640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f502c15a6e0 con 0x7f502c15c970 2023-06-10T19:05:31.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.379+0000 7f50343cb640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f502c15a9c0 con 0x7f502c070de0 2023-06-10T19:05:31.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.379+0000 7f5031966640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f502c15c060 0x7f502c14f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:31.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.379+0000 7f5031966640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f502c15c060 0x7f502c14f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57948/0 (socket says 172.21.15.53:57948) 2023-06-10T19:05:31.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.379+0000 7f5031966640 1 -- 172.21.15.53:0/2515627400 learned_addr learned my addr 172.21.15.53:0/2515627400 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:31.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.379+0000 7f5032167640 1 --2- 172.21.15.53:0/2515627400 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f502c070de0 0x7f502c159ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:31.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.379+0000 7f5032968640 1 --2- 172.21.15.53:0/2515627400 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f502c15c970 0x7f502c147d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:31.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.379+0000 7f5031966640 1 -- 172.21.15.53:0/2515627400 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f502c070de0 msgr2=0x7f502c159ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:31.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.379+0000 7f5031966640 1 --2- 172.21.15.53:0/2515627400 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f502c070de0 0x7f502c159ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:31.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.379+0000 7f5031966640 1 -- 172.21.15.53:0/2515627400 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f502c15c970 msgr2=0x7f502c147d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:31.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.379+0000 7f5031966640 1 --2- 172.21.15.53:0/2515627400 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f502c15c970 0x7f502c147d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:31.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.379+0000 7f5031966640 1 -- 172.21.15.53:0/2515627400 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f501c009420 con 0x7f502c15c060 2023-06-10T19:05:31.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.379+0000 7f5032167640 1 --2- 172.21.15.53:0/2515627400 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f502c070de0 0x7f502c159ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:05:31.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.383+0000 7f5032968640 1 --2- 172.21.15.53:0/2515627400 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f502c15c970 0x7f502c147d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:05:31.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.383+0000 7f5031966640 1 --2- 172.21.15.53:0/2515627400 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f502c15c060 0x7f502c14f730 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7f501c01a020 tx=0x7f501c019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:31.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.383+0000 7f5022ffd640 1 -- 172.21.15.53:0/2515627400 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501c006e20 con 0x7f502c15c060 2023-06-10T19:05:31.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.383+0000 7f5022ffd640 1 -- 172.21.15.53:0/2515627400 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f501c004020 con 0x7f502c15c060 2023-06-10T19:05:31.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.383+0000 7f50343cb640 1 -- 172.21.15.53:0/2515627400 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f502c158950 con 0x7f502c15c060 2023-06-10T19:05:31.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.383+0000 7f5022ffd640 1 -- 172.21.15.53:0/2515627400 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501c004390 con 0x7f502c15c060 2023-06-10T19:05:31.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.383+0000 7f50343cb640 1 -- 172.21.15.53:0/2515627400 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f502c15af80 con 0x7f502c15c060 2023-06-10T19:05:31.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.383+0000 7f50343cb640 1 -- 172.21.15.53:0/2515627400 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f502c15b170 con 0x7f502c15c060 2023-06-10T19:05:31.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.383+0000 7f5022ffd640 1 -- 172.21.15.53:0/2515627400 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f501c0b2040 con 0x7f502c15c060 2023-06-10T19:05:31.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.383+0000 7f5022ffd640 1 --2- 172.21.15.53:0/2515627400 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5010066280 0x7f5010068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:31.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.383+0000 7f5022ffd640 1 -- 172.21.15.53:0/2515627400 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6105+0+0 (secure 0 0 0) 0x7f501c11d230 con 0x7f502c15c060 2023-06-10T19:05:31.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.383+0000 7f5032167640 1 --2- 172.21.15.53:0/2515627400 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5010066280 0x7f5010068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:31.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.383+0000 7f5032167640 1 --2- 172.21.15.53:0/2515627400 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5010066280 0x7f5010068730 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f5028009a40 tx=0x7f5028008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:31.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.387+0000 7f5022ffd640 1 -- 172.21.15.53:0/2515627400 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f501c0ea7c0 con 0x7f502c15c060 2023-06-10T19:05:31.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.543+0000 7f50343cb640 1 -- 172.21.15.53:0/2515627400 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f502c04d790 con 0x7f502c15c060 2023-06-10T19:05:31.550 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.543+0000 7f5022ffd640 1 -- 172.21.15.53:0/2515627400 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v126) v1 ==== 93+0+10 (secure 0 0 0) 0x7f501c0044f0 con 0x7f502c15c060 2023-06-10T19:05:31.551 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-06-10T19:05:31.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.547+0000 7f50343cb640 1 -- 172.21.15.53:0/2515627400 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5010066280 msgr2=0x7f5010068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:31.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.547+0000 7f50343cb640 1 --2- 172.21.15.53:0/2515627400 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5010066280 0x7f5010068730 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f5028009a40 tx=0x7f5028008040 comp rx=0 tx=0).stop 2023-06-10T19:05:31.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.547+0000 7f50343cb640 1 -- 172.21.15.53:0/2515627400 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f502c15c060 msgr2=0x7f502c14f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:31.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.547+0000 7f50343cb640 1 --2- 172.21.15.53:0/2515627400 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f502c15c060 0x7f502c14f730 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7f501c01a020 tx=0x7f501c019190 comp rx=0 tx=0).stop 2023-06-10T19:05:31.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.547+0000 7f50343cb640 1 -- 172.21.15.53:0/2515627400 shutdown_connections 2023-06-10T19:05:31.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.547+0000 7f50343cb640 1 --2- 172.21.15.53:0/2515627400 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5010066280 0x7f5010068730 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:31.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.547+0000 7f50343cb640 1 --2- 172.21.15.53:0/2515627400 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f502c15c970 0x7f502c147d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:31.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.547+0000 7f50343cb640 1 --2- 172.21.15.53:0/2515627400 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f502c15c060 0x7f502c14f730 unknown :-1 s=CLOSED pgs=1920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:31.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.547+0000 7f50343cb640 1 --2- 172.21.15.53:0/2515627400 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f502c070de0 0x7f502c159ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:31.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.547+0000 7f50343cb640 1 -- 172.21.15.53:0/2515627400 >> 172.21.15.53:0/2515627400 conn(0x7f502c06a0e0 msgr2=0x7f502c1572f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:31.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.547+0000 7f50343cb640 1 -- 172.21.15.53:0/2515627400 shutdown_connections 2023-06-10T19:05:31.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.547+0000 7f50343cb640 1 -- 172.21.15.53:0/2515627400 wait complete. 2023-06-10T19:05:31.570 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-10T19:05:31.695 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.687+0000 7fc92b379640 1 Processor -- start 2023-06-10T19:05:31.695 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.691+0000 7fc92b379640 1 -- start start 2023-06-10T19:05:31.697 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.691+0000 7fc92b379640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc92415bf80 0x7fc9240b4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:31.697 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.691+0000 7fc92b379640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc9240cc870 0x7fc9240cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:31.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.691+0000 7fc92b379640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9240cff50 con 0x7fc9240b14f0 2023-06-10T19:05:31.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.691+0000 7fc92b379640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9240cd230 con 0x7fc9240cc870 2023-06-10T19:05:31.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.691+0000 7fc92b379640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9240cef70 con 0x7fc92415bf80 2023-06-10T19:05:31.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.691+0000 7fc929916640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc9240cc870 0x7fc9240cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:31.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.691+0000 7fc928914640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fc9240b14f0 0x7fc9240ce860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60250/0 (socket says 172.21.15.53:60250) 2023-06-10T19:05:31.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.691+0000 7fc928914640 1 -- 172.21.15.53:0/382809044 learned_addr learned my addr 172.21.15.53:0/382809044 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:05:31.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.691+0000 7fc929115640 1 --2- 172.21.15.53:0/382809044 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc92415bf80 0x7fc9240b4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:31.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.691+0000 7fc929916640 1 -- 172.21.15.53:0/382809044 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc92415bf80 msgr2=0x7fc9240b4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:31.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.691+0000 7fc929916640 1 --2- 172.21.15.53:0/382809044 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc92415bf80 0x7fc9240b4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:31.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.691+0000 7fc929916640 1 -- 172.21.15.53:0/382809044 >> v1:172.21.15.53:6789/0 conn(0x7fc9240b14f0 legacy=0x7fc9240ce860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:31.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.691+0000 7fc929916640 1 -- 172.21.15.53:0/382809044 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9240cf240 con 0x7fc9240cc870 2023-06-10T19:05:31.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.691+0000 7fc923fff640 1 -- 172.21.15.53:0/382809044 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 409168975 0 0) 0x7fc9240cff50 con 0x7fc9240b14f0 2023-06-10T19:05:31.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.695+0000 7fc929916640 1 --2- 172.21.15.53:0/382809044 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9240cc870 0x7fc9240cccf0 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 crypto rx=0x7fc9140097c0 tx=0x7fc91401ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9a5ebebd1b365f6 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:31.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.695+0000 7fc923fff640 1 -- 172.21.15.53:0/382809044 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9140a8970 con 0x7fc9240cc870 2023-06-10T19:05:31.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.695+0000 7fc923fff640 1 -- 172.21.15.53:0/382809044 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9140a8ad0 con 0x7fc9240cc870 2023-06-10T19:05:31.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.695+0000 7fc923fff640 1 -- 172.21.15.53:0/382809044 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9140a8e60 con 0x7fc9240cc870 2023-06-10T19:05:31.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.695+0000 7fc92b379640 1 -- 172.21.15.53:0/382809044 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9240cc870 msgr2=0x7fc9240cccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:31.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.695+0000 7fc92b379640 1 --2- 172.21.15.53:0/382809044 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9240cc870 0x7fc9240cccf0 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 crypto rx=0x7fc9140097c0 tx=0x7fc91401ec70 comp rx=0 tx=0).stop 2023-06-10T19:05:31.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.695+0000 7fc92b379640 1 -- 172.21.15.53:0/382809044 shutdown_connections 2023-06-10T19:05:31.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.695+0000 7fc92b379640 1 --2- 172.21.15.53:0/382809044 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9240cc870 0x7fc9240cccf0 unknown :-1 s=CLOSED pgs=1922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:31.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.695+0000 7fc92b379640 1 --2- 172.21.15.53:0/382809044 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc92415bf80 0x7fc9240b4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:31.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.695+0000 7fc92b379640 1 -- 172.21.15.53:0/382809044 >> 172.21.15.53:0/382809044 conn(0x7fc924069e20 msgr2=0x7fc92406a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:31.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.695+0000 7fc92b379640 1 -- 172.21.15.53:0/382809044 shutdown_connections 2023-06-10T19:05:31.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.695+0000 7fc92b379640 1 -- 172.21.15.53:0/382809044 wait complete. 2023-06-10T19:05:31.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.695+0000 7fc92b379640 1 Processor -- start 2023-06-10T19:05:31.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.695+0000 7fc92b379640 1 -- start start 2023-06-10T19:05:31.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.695+0000 7fc92b379640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9240b14f0 0x7fc9241557e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:31.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.695+0000 7fc92b379640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9240cc870 0x7fc9240b5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:31.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.695+0000 7fc92b379640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc92415bf80 0x7fc92415c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:31.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.695+0000 7fc92b379640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9241520d0 con 0x7fc92415bf80 2023-06-10T19:05:31.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.695+0000 7fc92b379640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc92415f4d0 con 0x7fc9240cc870 2023-06-10T19:05:31.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.695+0000 7fc92b379640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc92415ec30 con 0x7fc9240b14f0 2023-06-10T19:05:31.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.695+0000 7fc929916640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc92415bf80 0x7fc92415c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:31.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.695+0000 7fc929115640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9240b14f0 0x7fc9241557e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:31.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.695+0000 7fc929916640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc92415bf80 0x7fc92415c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57972/0 (socket says 172.21.15.53:57972) 2023-06-10T19:05:31.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.695+0000 7fc929916640 1 -- 172.21.15.53:0/3691812386 learned_addr learned my addr 172.21.15.53:0/3691812386 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:31.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.695+0000 7fc928914640 1 --2- 172.21.15.53:0/3691812386 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9240cc870 0x7fc9240b5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:31.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.699+0000 7fc929916640 1 -- 172.21.15.53:0/3691812386 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9240b14f0 msgr2=0x7fc9241557e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:31.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.699+0000 7fc929916640 1 --2- 172.21.15.53:0/3691812386 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9240b14f0 0x7fc9241557e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:31.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.699+0000 7fc929916640 1 -- 172.21.15.53:0/3691812386 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9240cc870 msgr2=0x7fc9240b5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:31.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.699+0000 7fc929916640 1 --2- 172.21.15.53:0/3691812386 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9240cc870 0x7fc9240b5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:31.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.699+0000 7fc929916640 1 -- 172.21.15.53:0/3691812386 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc914009420 con 0x7fc92415bf80 2023-06-10T19:05:31.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.699+0000 7fc929916640 1 --2- 172.21.15.53:0/3691812386 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc92415bf80 0x7fc92415c6b0 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 crypto rx=0x7fc91401c8a0 tx=0x7fc91401d4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:31.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.699+0000 7fc921ffb640 1 -- 172.21.15.53:0/3691812386 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9140b1e00 con 0x7fc92415bf80 2023-06-10T19:05:31.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.699+0000 7fc921ffb640 1 -- 172.21.15.53:0/3691812386 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc914006e20 con 0x7fc92415bf80 2023-06-10T19:05:31.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.699+0000 7fc92b379640 1 -- 172.21.15.53:0/3691812386 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc92415ef10 con 0x7fc92415bf80 2023-06-10T19:05:31.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.699+0000 7fc921ffb640 1 -- 172.21.15.53:0/3691812386 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc914004230 con 0x7fc92415bf80 2023-06-10T19:05:31.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.699+0000 7fc92b379640 1 -- 172.21.15.53:0/3691812386 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9240b1bd0 con 0x7fc92415bf80 2023-06-10T19:05:31.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.699+0000 7fc92b379640 1 -- 172.21.15.53:0/3691812386 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9240b1dc0 con 0x7fc92415bf80 2023-06-10T19:05:31.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.699+0000 7fc921ffb640 1 -- 172.21.15.53:0/3691812386 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc914004390 con 0x7fc92415bf80 2023-06-10T19:05:31.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.699+0000 7fc921ffb640 1 --2- 172.21.15.53:0/3691812386 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc910066280 0x7fc910068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:31.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.699+0000 7fc921ffb640 1 -- 172.21.15.53:0/3691812386 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6105+0+0 (secure 0 0 0) 0x7fc9141220b0 con 0x7fc92415bf80 2023-06-10T19:05:31.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.699+0000 7fc929115640 1 --2- 172.21.15.53:0/3691812386 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc910066280 0x7fc910068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:31.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.703+0000 7fc929115640 1 --2- 172.21.15.53:0/3691812386 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc910066280 0x7fc910068730 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fc91c0113e0 tx=0x7fc91c00b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:31.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.703+0000 7fc921ffb640 1 -- 172.21.15.53:0/3691812386 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc9140ef7b0 con 0x7fc92415bf80 2023-06-10T19:05:31.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.859+0000 7fc92b379640 1 -- 172.21.15.53:0/3691812386 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc92404d790 con 0x7fc92415bf80 2023-06-10T19:05:31.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.859+0000 7fc921ffb640 1 -- 172.21.15.53:0/3691812386 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v126) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc9140f2dd0 con 0x7fc92415bf80 2023-06-10T19:05:31.865 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-06-10T19:05:31.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.859+0000 7fc92b379640 1 -- 172.21.15.53:0/3691812386 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc910066280 msgr2=0x7fc910068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:31.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.859+0000 7fc92b379640 1 --2- 172.21.15.53:0/3691812386 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc910066280 0x7fc910068730 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fc91c0113e0 tx=0x7fc91c00b040 comp rx=0 tx=0).stop 2023-06-10T19:05:31.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.859+0000 7fc92b379640 1 -- 172.21.15.53:0/3691812386 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc92415bf80 msgr2=0x7fc92415c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:31.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.859+0000 7fc92b379640 1 --2- 172.21.15.53:0/3691812386 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc92415bf80 0x7fc92415c6b0 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 crypto rx=0x7fc91401c8a0 tx=0x7fc91401d4b0 comp rx=0 tx=0).stop 2023-06-10T19:05:31.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.859+0000 7fc92b379640 1 -- 172.21.15.53:0/3691812386 shutdown_connections 2023-06-10T19:05:31.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.859+0000 7fc92b379640 1 --2- 172.21.15.53:0/3691812386 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc910066280 0x7fc910068730 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:31.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.859+0000 7fc92b379640 1 --2- 172.21.15.53:0/3691812386 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc92415bf80 0x7fc92415c6b0 unknown :-1 s=CLOSED pgs=1923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:31.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.859+0000 7fc92b379640 1 --2- 172.21.15.53:0/3691812386 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9240cc870 0x7fc9240b5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:31.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.859+0000 7fc92b379640 1 --2- 172.21.15.53:0/3691812386 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9240b14f0 0x7fc9241557e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:31.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.859+0000 7fc92b379640 1 -- 172.21.15.53:0/3691812386 >> 172.21.15.53:0/3691812386 conn(0x7fc924069e20 msgr2=0x7fc9240c91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:31.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.859+0000 7fc92b379640 1 -- 172.21.15.53:0/3691812386 shutdown_connections 2023-06-10T19:05:31.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:31.859+0000 7fc92b379640 1 -- 172.21.15.53:0/3691812386 wait complete. 2023-06-10T19:05:31.884 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-10T19:05:32.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.003+0000 7f4e717b7640 1 Processor -- start 2023-06-10T19:05:32.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.003+0000 7f4e717b7640 1 -- start start 2023-06-10T19:05:32.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.003+0000 7f4e717b7640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4e6c070de0 0x7f4e6c15cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:32.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.003+0000 7f4e717b7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e6c0cc020 0x7f4e6c06bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:32.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.003+0000 7f4e717b7640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e6c0c8d50 con 0x7f4e6c15c060 2023-06-10T19:05:32.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.003+0000 7f4e717b7640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e6c0c9030 con 0x7f4e6c070de0 2023-06-10T19:05:32.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.003+0000 7f4e717b7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6c070300 con 0x7f4e6c0cc020 2023-06-10T19:05:32.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.003+0000 7f4e6a7fc640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4e6c070de0 0x7f4e6c15cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:32.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.003+0000 7f4e6b7fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e6c0cc020 0x7f4e6c06bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:32.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.003+0000 7f4e6affd640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f4e6c15c060 0x7f4e6c15c430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.53:48186/0 (socket says 172.21.15.53:48186) 2023-06-10T19:05:32.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.003+0000 7f4e6a7fc640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4e6c070de0 0x7f4e6c15cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.53:57518/0 (socket says 172.21.15.53:57518) 2023-06-10T19:05:32.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.003+0000 7f4e6affd640 1 -- 172.21.15.53:0/3434727932 learned_addr learned my addr 172.21.15.53:0/3434727932 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:05:32.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.003+0000 7f4e6b7fe640 1 -- 172.21.15.53:0/3434727932 >> v2:172.21.15.117:3300/0 conn(0x7f4e6c070de0 msgr2=0x7f4e6c15cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:32.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.003+0000 7f4e6b7fe640 1 --2- 172.21.15.53:0/3434727932 >> v2:172.21.15.117:3300/0 conn(0x7f4e6c070de0 0x7f4e6c15cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:32.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.003+0000 7f4e6b7fe640 1 -- 172.21.15.53:0/3434727932 >> v1:172.21.15.117:6789/0 conn(0x7f4e6c15c060 legacy=0x7f4e6c15c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:32.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.003+0000 7f4e6b7fe640 1 -- 172.21.15.53:0/3434727932 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e6c0705e0 con 0x7f4e6c0cc020 2023-06-10T19:05:32.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.007+0000 7f4e6b7fe640 1 --2- 172.21.15.53:0/3434727932 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e6c0cc020 0x7f4e6c06bd80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c0097c0 tx=0x7f4e5c01c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b3081caee722c49 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:32.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.007+0000 7f4e69ffb640 1 -- 172.21.15.53:0/3434727932 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c0ab600 con 0x7f4e6c0cc020 2023-06-10T19:05:32.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.007+0000 7f4e69ffb640 1 -- 172.21.15.53:0/3434727932 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e5c0a7050 con 0x7f4e6c0cc020 2023-06-10T19:05:32.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.007+0000 7f4e69ffb640 1 -- 172.21.15.53:0/3434727932 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c0ab980 con 0x7f4e6c0cc020 2023-06-10T19:05:32.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.007+0000 7f4e717b7640 1 -- 172.21.15.53:0/3434727932 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e6c0cc020 msgr2=0x7f4e6c06bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:32.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.007+0000 7f4e717b7640 1 --2- 172.21.15.53:0/3434727932 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e6c0cc020 0x7f4e6c06bd80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c0097c0 tx=0x7f4e5c01c3c0 comp rx=0 tx=0).stop 2023-06-10T19:05:32.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.007+0000 7f4e717b7640 1 -- 172.21.15.53:0/3434727932 shutdown_connections 2023-06-10T19:05:32.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.007+0000 7f4e717b7640 1 --2- 172.21.15.53:0/3434727932 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e6c0cc020 0x7f4e6c06bd80 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:32.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.007+0000 7f4e717b7640 1 --2- 172.21.15.53:0/3434727932 >> v2:172.21.15.117:3300/0 conn(0x7f4e6c070de0 0x7f4e6c15cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:32.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.007+0000 7f4e717b7640 1 -- 172.21.15.53:0/3434727932 >> 172.21.15.53:0/3434727932 conn(0x7f4e6c06a0e0 msgr2=0x7f4e6c0cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:32.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.007+0000 7f4e717b7640 1 -- 172.21.15.53:0/3434727932 shutdown_connections 2023-06-10T19:05:32.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.007+0000 7f4e717b7640 1 -- 172.21.15.53:0/3434727932 wait complete. 2023-06-10T19:05:32.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.007+0000 7f4e717b7640 1 Processor -- start 2023-06-10T19:05:32.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.007+0000 7f4e717b7640 1 -- start start 2023-06-10T19:05:32.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.011+0000 7f4e717b7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e6c070de0 0x7f4e6c0c19e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:32.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.011+0000 7f4e717b7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e6c0cc020 0x7f4e6c152da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:32.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.011+0000 7f4e717b7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e6c15c060 0x7f4e6c14f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:32.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.011+0000 7f4e717b7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6c14fc90 con 0x7f4e6c070de0 2023-06-10T19:05:32.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.011+0000 7f4e717b7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6c14ff70 con 0x7f4e6c15c060 2023-06-10T19:05:32.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.011+0000 7f4e717b7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6c1525a0 con 0x7f4e6c0cc020 2023-06-10T19:05:32.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.011+0000 7f4e6affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e6c070de0 0x7f4e6c0c19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:32.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.011+0000 7f4e6affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e6c070de0 0x7f4e6c0c19e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57988/0 (socket says 172.21.15.53:57988) 2023-06-10T19:05:32.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.011+0000 7f4e6affd640 1 -- 172.21.15.53:0/431313875 learned_addr learned my addr 172.21.15.53:0/431313875 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:32.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.011+0000 7f4e6a7fc640 1 --2- 172.21.15.53:0/431313875 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e6c0cc020 0x7f4e6c152da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:32.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.011+0000 7f4e6b7fe640 1 --2- 172.21.15.53:0/431313875 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e6c15c060 0x7f4e6c14f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:32.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.011+0000 7f4e6affd640 1 -- 172.21.15.53:0/431313875 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e6c0cc020 msgr2=0x7f4e6c152da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:32.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.011+0000 7f4e6affd640 1 --2- 172.21.15.53:0/431313875 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e6c0cc020 0x7f4e6c152da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:32.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.011+0000 7f4e6affd640 1 -- 172.21.15.53:0/431313875 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e6c15c060 msgr2=0x7f4e6c14f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:32.020 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.011+0000 7f4e6affd640 1 --2- 172.21.15.53:0/431313875 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e6c15c060 0x7f4e6c14f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:32.020 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.011+0000 7f4e6affd640 1 -- 172.21.15.53:0/431313875 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e5c009420 con 0x7f4e6c070de0 2023-06-10T19:05:32.020 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.011+0000 7f4e6affd640 1 --2- 172.21.15.53:0/431313875 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e6c070de0 0x7f4e6c0c19e0 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7f4e6400c370 tx=0x7f4e6400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:32.020 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.011+0000 7f4e637fe640 1 -- 172.21.15.53:0/431313875 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e64005cf0 con 0x7f4e6c070de0 2023-06-10T19:05:32.020 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.011+0000 7f4e637fe640 1 -- 172.21.15.53:0/431313875 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e64005e50 con 0x7f4e6c070de0 2023-06-10T19:05:32.020 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.011+0000 7f4e717b7640 1 -- 172.21.15.53:0/431313875 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e6c152880 con 0x7f4e6c070de0 2023-06-10T19:05:32.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.011+0000 7f4e637fe640 1 -- 172.21.15.53:0/431313875 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e640072f0 con 0x7f4e6c070de0 2023-06-10T19:05:32.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.011+0000 7f4e717b7640 1 -- 172.21.15.53:0/431313875 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e6c0c1f20 con 0x7f4e6c070de0 2023-06-10T19:05:32.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.011+0000 7f4e717b7640 1 -- 172.21.15.53:0/431313875 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e6c152400 con 0x7f4e6c070de0 2023-06-10T19:05:32.022 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.011+0000 7f4e637fe640 1 -- 172.21.15.53:0/431313875 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4e64007450 con 0x7f4e6c070de0 2023-06-10T19:05:32.022 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.011+0000 7f4e637fe640 1 --2- 172.21.15.53:0/431313875 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4e500662b0 0x7f4e50068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:32.022 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.011+0000 7f4e637fe640 1 -- 172.21.15.53:0/431313875 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6105+0+0 (secure 0 0 0) 0x7f4e64083260 con 0x7f4e6c070de0 2023-06-10T19:05:32.022 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.011+0000 7f4e6a7fc640 1 --2- 172.21.15.53:0/431313875 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4e500662b0 0x7f4e50068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:32.022 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.015+0000 7f4e6a7fc640 1 --2- 172.21.15.53:0/431313875 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4e500662b0 0x7f4e50068760 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c150370 tx=0x7f4e5400b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:32.022 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.015+0000 7f4e637fe640 1 -- 172.21.15.53:0/431313875 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4e6c152400 con 0x7f4e6c070de0 2023-06-10T19:05:32.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.171+0000 7f4e717b7640 1 -- 172.21.15.53:0/431313875 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4e6c152400 con 0x7f4e6c070de0 2023-06-10T19:05:32.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.171+0000 7f4e637fe640 1 -- 172.21.15.53:0/431313875 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v126) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4e6c152400 con 0x7f4e6c070de0 2023-06-10T19:05:32.179 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-06-10T19:05:32.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.175+0000 7f4e717b7640 1 -- 172.21.15.53:0/431313875 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4e500662b0 msgr2=0x7f4e50068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:32.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.175+0000 7f4e717b7640 1 --2- 172.21.15.53:0/431313875 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4e500662b0 0x7f4e50068760 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c150370 tx=0x7f4e5400b040 comp rx=0 tx=0).stop 2023-06-10T19:05:32.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.175+0000 7f4e717b7640 1 -- 172.21.15.53:0/431313875 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e6c070de0 msgr2=0x7f4e6c0c19e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:32.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.175+0000 7f4e717b7640 1 --2- 172.21.15.53:0/431313875 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e6c070de0 0x7f4e6c0c19e0 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7f4e6400c370 tx=0x7f4e6400c830 comp rx=0 tx=0).stop 2023-06-10T19:05:32.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.175+0000 7f4e717b7640 1 -- 172.21.15.53:0/431313875 shutdown_connections 2023-06-10T19:05:32.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.175+0000 7f4e717b7640 1 --2- 172.21.15.53:0/431313875 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4e500662b0 0x7f4e50068760 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:32.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.175+0000 7f4e717b7640 1 --2- 172.21.15.53:0/431313875 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e6c15c060 0x7f4e6c14f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:32.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.175+0000 7f4e717b7640 1 --2- 172.21.15.53:0/431313875 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4e6c0cc020 0x7f4e6c152da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:32.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.175+0000 7f4e717b7640 1 --2- 172.21.15.53:0/431313875 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e6c070de0 0x7f4e6c0c19e0 unknown :-1 s=CLOSED pgs=1924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:32.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.175+0000 7f4e717b7640 1 -- 172.21.15.53:0/431313875 >> 172.21.15.53:0/431313875 conn(0x7f4e6c06a0e0 msgr2=0x7f4e6c0ad5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:32.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.175+0000 7f4e717b7640 1 -- 172.21.15.53:0/431313875 shutdown_connections 2023-06-10T19:05:32.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.175+0000 7f4e717b7640 1 -- 172.21.15.53:0/431313875 wait complete. 2023-06-10T19:05:32.198 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-10T19:05:32.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.323+0000 7f131a803640 1 Processor -- start 2023-06-10T19:05:32.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.323+0000 7f131a803640 1 -- start start 2023-06-10T19:05:32.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.323+0000 7f131a803640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13141558e0 0x7f13140c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:32.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.323+0000 7f131a803640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1314158f40 0x7f13140cb820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:32.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.323+0000 7f131a803640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f13140cbd60 0x7f131406b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:32.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.323+0000 7f131a803640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f131406c230 con 0x7f1314158f40 2023-06-10T19:05:32.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.323+0000 7f131a803640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f131406ca40 con 0x7f13140cbd60 2023-06-10T19:05:32.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.323+0000 7f131a803640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1314155cb0 con 0x7f13141558e0 2023-06-10T19:05:32.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.323+0000 7f13137fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1314158f40 0x7f13140cb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:32.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.323+0000 7f13137fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1314158f40 0x7f13140cb820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58000/0 (socket says 172.21.15.53:58000) 2023-06-10T19:05:32.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.323+0000 7f13137fe640 1 -- 172.21.15.53:0/1470868808 learned_addr learned my addr 172.21.15.53:0/1470868808 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:32.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.323+0000 7f1313fff640 1 --2- 172.21.15.53:0/1470868808 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13141558e0 0x7f13140c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:32.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.323+0000 7f1318da0640 1 --2- 172.21.15.53:0/1470868808 >> v2:172.21.15.117:3300/0 conn(0x7f13140cbd60 0x7f131406b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:32.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.323+0000 7f13137fe640 1 -- 172.21.15.53:0/1470868808 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13141558e0 msgr2=0x7f13140c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:32.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.323+0000 7f13137fe640 1 --2- 172.21.15.53:0/1470868808 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13141558e0 0x7f13140c82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:32.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.323+0000 7f13137fe640 1 -- 172.21.15.53:0/1470868808 >> v2:172.21.15.117:3300/0 conn(0x7f13140cbd60 msgr2=0x7f131406b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:32.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.323+0000 7f13137fe640 1 --2- 172.21.15.53:0/1470868808 >> v2:172.21.15.117:3300/0 conn(0x7f13140cbd60 0x7f131406b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:32.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.323+0000 7f13137fe640 1 -- 172.21.15.53:0/1470868808 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f131406c480 con 0x7f1314158f40 2023-06-10T19:05:32.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.323+0000 7f1318da0640 1 --2- 172.21.15.53:0/1470868808 >> v2:172.21.15.117:3300/0 conn(0x7f13140cbd60 0x7f131406b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:05:32.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.327+0000 7f13137fe640 1 --2- 172.21.15.53:0/1470868808 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1314158f40 0x7f13140cb820 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 crypto rx=0x7f131406eda0 tx=0x7f130801c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a4ab9011646c2f9 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:32.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.327+0000 7f1312ffd640 1 -- 172.21.15.53:0/1470868808 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13080ab600 con 0x7f1314158f40 2023-06-10T19:05:32.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.327+0000 7f1312ffd640 1 -- 172.21.15.53:0/1470868808 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13080a7050 con 0x7f1314158f40 2023-06-10T19:05:32.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.327+0000 7f1312ffd640 1 -- 172.21.15.53:0/1470868808 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13080ab980 con 0x7f1314158f40 2023-06-10T19:05:32.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.327+0000 7f131a803640 1 -- 172.21.15.53:0/1470868808 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1314158f40 msgr2=0x7f13140cb820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:32.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.327+0000 7f131a803640 1 --2- 172.21.15.53:0/1470868808 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1314158f40 0x7f13140cb820 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 crypto rx=0x7f131406eda0 tx=0x7f130801c3b0 comp rx=0 tx=0).stop 2023-06-10T19:05:32.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.327+0000 7f131a803640 1 -- 172.21.15.53:0/1470868808 shutdown_connections 2023-06-10T19:05:32.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.327+0000 7f131a803640 1 --2- 172.21.15.53:0/1470868808 >> v2:172.21.15.117:3300/0 conn(0x7f13140cbd60 0x7f131406b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:32.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.327+0000 7f131a803640 1 --2- 172.21.15.53:0/1470868808 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1314158f40 0x7f13140cb820 unknown :-1 s=CLOSED pgs=1925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:32.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.327+0000 7f131a803640 1 --2- 172.21.15.53:0/1470868808 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13141558e0 0x7f13140c82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:32.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.327+0000 7f131a803640 1 -- 172.21.15.53:0/1470868808 >> 172.21.15.53:0/1470868808 conn(0x7f131406a0e0 msgr2=0x7f13140cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:32.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.327+0000 7f131a803640 1 -- 172.21.15.53:0/1470868808 shutdown_connections 2023-06-10T19:05:32.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.327+0000 7f131a803640 1 -- 172.21.15.53:0/1470868808 wait complete. 2023-06-10T19:05:32.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.327+0000 7f131a803640 1 Processor -- start 2023-06-10T19:05:32.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.327+0000 7f131a803640 1 -- start start 2023-06-10T19:05:32.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.327+0000 7f131a803640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13140cbd60 0x7f131406eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:32.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.327+0000 7f131a803640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13141558e0 0x7f13140c0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:32.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.327+0000 7f131a803640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1314158f40 0x7f1314160df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:32.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.327+0000 7f131a803640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1314162ca0 con 0x7f13141558e0 2023-06-10T19:05:32.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.327+0000 7f131a803640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1314150e10 con 0x7f1314158f40 2023-06-10T19:05:32.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.327+0000 7f131a803640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1314162720 con 0x7f13140cbd60 2023-06-10T19:05:32.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.327+0000 7f13137fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13141558e0 0x7f13140c0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:32.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.327+0000 7f13137fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13141558e0 0x7f13140c0ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58012/0 (socket says 172.21.15.53:58012) 2023-06-10T19:05:32.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.327+0000 7f13137fe640 1 -- 172.21.15.53:0/4288503285 learned_addr learned my addr 172.21.15.53:0/4288503285 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:32.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.331+0000 7f1313fff640 1 --2- 172.21.15.53:0/4288503285 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13140cbd60 0x7f131406eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:32.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.331+0000 7f13137fe640 1 -- 172.21.15.53:0/4288503285 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13140cbd60 msgr2=0x7f131406eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:32.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.331+0000 7f13137fe640 1 --2- 172.21.15.53:0/4288503285 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13140cbd60 0x7f131406eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:32.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.331+0000 7f1318da0640 1 --2- 172.21.15.53:0/4288503285 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1314158f40 0x7f1314160df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:32.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.331+0000 7f13137fe640 1 -- 172.21.15.53:0/4288503285 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1314158f40 msgr2=0x7f1314160df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:32.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.331+0000 7f13137fe640 1 --2- 172.21.15.53:0/4288503285 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1314158f40 0x7f1314160df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:32.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.331+0000 7f13137fe640 1 -- 172.21.15.53:0/4288503285 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13080094d0 con 0x7f13141558e0 2023-06-10T19:05:32.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.331+0000 7f13137fe640 1 --2- 172.21.15.53:0/4288503285 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13141558e0 0x7f13140c0ef0 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 crypto rx=0x7f13080ae040 tx=0x7f1308019150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:32.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.331+0000 7f1310ff9640 1 -- 172.21.15.53:0/4288503285 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13080b6620 con 0x7f13141558e0 2023-06-10T19:05:32.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.331+0000 7f1310ff9640 1 -- 172.21.15.53:0/4288503285 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13080a4e90 con 0x7f13141558e0 2023-06-10T19:05:32.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.331+0000 7f1310ff9640 1 -- 172.21.15.53:0/4288503285 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13080b69c0 con 0x7f13141558e0 2023-06-10T19:05:32.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.331+0000 7f131a803640 1 -- 172.21.15.53:0/4288503285 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13141629c0 con 0x7f13141558e0 2023-06-10T19:05:32.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.331+0000 7f131a803640 1 -- 172.21.15.53:0/4288503285 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1314070d20 con 0x7f13141558e0 2023-06-10T19:05:32.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.331+0000 7f131a803640 1 -- 172.21.15.53:0/4288503285 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1314150be0 con 0x7f13141558e0 2023-06-10T19:05:32.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.331+0000 7f1310ff9640 1 -- 172.21.15.53:0/4288503285 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f13080b2040 con 0x7f13141558e0 2023-06-10T19:05:32.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.331+0000 7f1310ff9640 1 --2- 172.21.15.53:0/4288503285 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f13000662b0 0x7f1300068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:32.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.331+0000 7f1310ff9640 1 -- 172.21.15.53:0/4288503285 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6105+0+0 (secure 0 0 0) 0x7f130811dfd0 con 0x7f13141558e0 2023-06-10T19:05:32.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.331+0000 7f1313fff640 1 --2- 172.21.15.53:0/4288503285 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f13000662b0 0x7f1300068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:32.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.335+0000 7f1313fff640 1 --2- 172.21.15.53:0/4288503285 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f13000662b0 0x7f1300068760 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f130400b9d0 tx=0x7f1304008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:32.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.335+0000 7f1310ff9640 1 -- 172.21.15.53:0/4288503285 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1314150be0 con 0x7f13141558e0 2023-06-10T19:05:32.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.491+0000 7f131a803640 1 -- 172.21.15.53:0/4288503285 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1314150be0 con 0x7f13141558e0 2023-06-10T19:05:32.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.491+0000 7f1310ff9640 1 -- 172.21.15.53:0/4288503285 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v126) v1 ==== 100+0+11 (secure 0 0 0) 0x7f13080b0020 con 0x7f13141558e0 2023-06-10T19:05:32.497 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-06-10T19:05:32.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.491+0000 7f131a803640 1 -- 172.21.15.53:0/4288503285 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f13000662b0 msgr2=0x7f1300068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:32.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.491+0000 7f131a803640 1 --2- 172.21.15.53:0/4288503285 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f13000662b0 0x7f1300068760 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f130400b9d0 tx=0x7f1304008040 comp rx=0 tx=0).stop 2023-06-10T19:05:32.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.491+0000 7f131a803640 1 -- 172.21.15.53:0/4288503285 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13141558e0 msgr2=0x7f13140c0ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:32.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.491+0000 7f131a803640 1 --2- 172.21.15.53:0/4288503285 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13141558e0 0x7f13140c0ef0 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 crypto rx=0x7f13080ae040 tx=0x7f1308019150 comp rx=0 tx=0).stop 2023-06-10T19:05:32.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.491+0000 7f131a803640 1 -- 172.21.15.53:0/4288503285 shutdown_connections 2023-06-10T19:05:32.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.491+0000 7f131a803640 1 --2- 172.21.15.53:0/4288503285 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f13000662b0 0x7f1300068760 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:32.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.491+0000 7f131a803640 1 --2- 172.21.15.53:0/4288503285 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1314158f40 0x7f1314160df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:32.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.491+0000 7f131a803640 1 --2- 172.21.15.53:0/4288503285 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13141558e0 0x7f13140c0ef0 unknown :-1 s=CLOSED pgs=1926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:32.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.491+0000 7f131a803640 1 --2- 172.21.15.53:0/4288503285 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f13140cbd60 0x7f131406eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:32.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.491+0000 7f131a803640 1 -- 172.21.15.53:0/4288503285 >> 172.21.15.53:0/4288503285 conn(0x7f131406a0e0 msgr2=0x7f13140cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:32.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.495+0000 7f131a803640 1 -- 172.21.15.53:0/4288503285 shutdown_connections 2023-06-10T19:05:32.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.495+0000 7f131a803640 1 -- 172.21.15.53:0/4288503285 wait complete. 2023-06-10T19:05:32.517 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-10T19:05:32.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.631+0000 7ff385f22640 1 Processor -- start 2023-06-10T19:05:32.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.631+0000 7ff385f22640 1 -- start start 2023-06-10T19:05:32.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.631+0000 7ff385f22640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff38015c920 0x7ff3800c8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:32.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.631+0000 7ff385f22640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff38006a9b0 0x7ff38006adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:32.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.631+0000 7ff385f22640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3800c8850 con 0x7ff380152bb0 2023-06-10T19:05:32.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.631+0000 7ff385f22640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3800cc8f0 con 0x7ff38006a9b0 2023-06-10T19:05:32.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.631+0000 7ff385f22640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3800c8b90 con 0x7ff38015c920 2023-06-10T19:05:32.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.631+0000 7ff37f7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ff380152bb0 0x7ff38015c210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60258/0 (socket says 172.21.15.53:60258) 2023-06-10T19:05:32.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.631+0000 7ff37f7fe640 1 -- 172.21.15.53:0/3144340833 learned_addr learned my addr 172.21.15.53:0/3144340833 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:05:32.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.631+0000 7ff37effd640 1 --2- 172.21.15.53:0/3144340833 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff38015c920 0x7ff3800c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:32.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.631+0000 7ff37ffff640 1 --2- 172.21.15.53:0/3144340833 >> v2:172.21.15.117:3300/0 conn(0x7ff38006a9b0 0x7ff38006adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:32.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.631+0000 7ff37e7fc640 1 -- 172.21.15.53:0/3144340833 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1142091716 0 0) 0x7ff378001620 con 0x7ff380152bb0 2023-06-10T19:05:32.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.631+0000 7ff37e7fc640 1 -- 172.21.15.53:0/3144340833 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff36c003530 con 0x7ff380152bb0 2023-06-10T19:05:32.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.631+0000 7ff37e7fc640 1 -- 172.21.15.53:0/3144340833 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4286285752 0 0) 0x7ff36c003530 con 0x7ff380152bb0 2023-06-10T19:05:32.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.631+0000 7ff37e7fc640 1 -- 172.21.15.53:0/3144340833 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff38015c920 msgr2=0x7ff3800c8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:32.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.631+0000 7ff37e7fc640 1 --2- 172.21.15.53:0/3144340833 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff38015c920 0x7ff3800c8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:32.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.631+0000 7ff37e7fc640 1 -- 172.21.15.53:0/3144340833 >> v2:172.21.15.117:3300/0 conn(0x7ff38006a9b0 msgr2=0x7ff38006adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:32.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.631+0000 7ff37e7fc640 1 --2- 172.21.15.53:0/3144340833 >> v2:172.21.15.117:3300/0 conn(0x7ff38006a9b0 0x7ff38006adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:32.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.631+0000 7ff37e7fc640 1 -- 172.21.15.53:0/3144340833 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3800c8e70 con 0x7ff380152bb0 2023-06-10T19:05:32.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.631+0000 7ff37e7fc640 1 -- 172.21.15.53:0/3144340833 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7ff378001d10 con 0x7ff380152bb0 2023-06-10T19:05:32.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.631+0000 7ff37e7fc640 1 -- 172.21.15.53:0/3144340833 >> v1:172.21.15.53:6789/0 conn(0x7ff380152bb0 legacy=0x7ff38015c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:32.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.631+0000 7ff37e7fc640 1 --2- 172.21.15.53:0/3144340833 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff38015c920 0x7ff36c003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:32.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.631+0000 7ff37e7fc640 1 --2- 172.21.15.53:0/3144340833 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff36c003f00 0x7ff36c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:32.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.631+0000 7ff37e7fc640 1 --2- 172.21.15.53:0/3144340833 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff36c004d10 0x7ff36c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:32.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.631+0000 7ff37e7fc640 1 -- 172.21.15.53:0/3144340833 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3800cc8f0 con 0x7ff36c003f00 2023-06-10T19:05:32.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.631+0000 7ff37e7fc640 1 -- 172.21.15.53:0/3144340833 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3800c8b90 con 0x7ff36c004d10 2023-06-10T19:05:32.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.631+0000 7ff37e7fc640 1 -- 172.21.15.53:0/3144340833 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff36c00b9c0 con 0x7ff38015c920 2023-06-10T19:05:32.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.631+0000 7ff37effd640 1 --2- 172.21.15.53:0/3144340833 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff36c003f00 0x7ff36c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:32.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.631+0000 7ff37f7fe640 1 --2- 172.21.15.53:0/3144340833 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff38015c920 0x7ff36c003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:32.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.635+0000 7ff37ffff640 1 --2- 172.21.15.53:0/3144340833 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff36c004d10 0x7ff36c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:32.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.635+0000 7ff37effd640 1 -- 172.21.15.53:0/3144340833 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff38015c920 msgr2=0x7ff36c003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:32.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.635+0000 7ff37effd640 1 --2- 172.21.15.53:0/3144340833 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff38015c920 0x7ff36c003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:32.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.635+0000 7ff37effd640 1 -- 172.21.15.53:0/3144340833 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff36c004d10 msgr2=0x7ff36c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:32.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.635+0000 7ff37effd640 1 --2- 172.21.15.53:0/3144340833 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff36c004d10 0x7ff36c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:32.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.635+0000 7ff37effd640 1 -- 172.21.15.53:0/3144340833 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff36c003530 con 0x7ff36c003f00 2023-06-10T19:05:32.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.635+0000 7ff37f7fe640 1 --2- 172.21.15.53:0/3144340833 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff38015c920 0x7ff36c003980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:05:32.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.635+0000 7ff37effd640 1 --2- 172.21.15.53:0/3144340833 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff36c003f00 0x7ff36c0047d0 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 crypto rx=0x7ff368009ab0 tx=0x7ff36801ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c66fb7168702218 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:32.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.635+0000 7ff37e7fc640 1 -- 172.21.15.53:0/3144340833 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3680a5620 con 0x7ff36c003f00 2023-06-10T19:05:32.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.635+0000 7ff37e7fc640 1 -- 172.21.15.53:0/3144340833 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3680a5780 con 0x7ff36c003f00 2023-06-10T19:05:32.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.635+0000 7ff37e7fc640 1 -- 172.21.15.53:0/3144340833 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3680a5b30 con 0x7ff36c003f00 2023-06-10T19:05:32.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.635+0000 7ff385f22640 1 -- 172.21.15.53:0/3144340833 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff36c003f00 msgr2=0x7ff36c0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:32.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.635+0000 7ff385f22640 1 --2- 172.21.15.53:0/3144340833 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff36c003f00 0x7ff36c0047d0 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 crypto rx=0x7ff368009ab0 tx=0x7ff36801ca30 comp rx=0 tx=0).stop 2023-06-10T19:05:32.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.635+0000 7ff37ffff640 1 -- 172.21.15.53:0/3144340833 reap_dead start 2023-06-10T19:05:32.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.635+0000 7ff385f22640 1 -- 172.21.15.53:0/3144340833 shutdown_connections 2023-06-10T19:05:32.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.635+0000 7ff385f22640 1 -- 172.21.15.53:0/3144340833 >> 172.21.15.53:0/3144340833 conn(0x7ff3800ce9e0 msgr2=0x7ff3800ca7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:32.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.635+0000 7ff385f22640 1 -- 172.21.15.53:0/3144340833 shutdown_connections 2023-06-10T19:05:32.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.635+0000 7ff385f22640 1 -- 172.21.15.53:0/3144340833 wait complete. 2023-06-10T19:05:32.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.639+0000 7ff385f22640 1 Processor -- start 2023-06-10T19:05:32.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.639+0000 7ff385f22640 1 -- start start 2023-06-10T19:05:32.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.639+0000 7ff385f22640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff36c003f00 0x7ff38014ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:32.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.639+0000 7ff385f22640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff38014d230 0x7ff3800c6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:32.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.639+0000 7ff385f22640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff3800c6e50 0x7ff3800c72d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:32.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.639+0000 7ff385f22640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3800c7810 con 0x7ff38014d230 2023-06-10T19:05:32.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.639+0000 7ff385f22640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3800c7c20 con 0x7ff3800c6e50 2023-06-10T19:05:32.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.639+0000 7ff385f22640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3800ac310 con 0x7ff36c003f00 2023-06-10T19:05:32.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.639+0000 7ff37effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff38014d230 0x7ff3800c6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:32.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.639+0000 7ff37effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff38014d230 0x7ff3800c6910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58024/0 (socket says 172.21.15.53:58024) 2023-06-10T19:05:32.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.639+0000 7ff37effd640 1 -- 172.21.15.53:0/3903161130 learned_addr learned my addr 172.21.15.53:0/3903161130 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:32.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.639+0000 7ff37f7fe640 1 --2- 172.21.15.53:0/3903161130 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff36c003f00 0x7ff38014ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:32.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.639+0000 7ff37ffff640 1 --2- 172.21.15.53:0/3903161130 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff3800c6e50 0x7ff3800c72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:32.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.639+0000 7ff37effd640 1 -- 172.21.15.53:0/3903161130 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff36c003f00 msgr2=0x7ff38014ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:32.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.639+0000 7ff37effd640 1 --2- 172.21.15.53:0/3903161130 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff36c003f00 0x7ff38014ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:32.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.639+0000 7ff37effd640 1 -- 172.21.15.53:0/3903161130 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff3800c6e50 msgr2=0x7ff3800c72d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:32.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.639+0000 7ff37effd640 1 --2- 172.21.15.53:0/3903161130 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff3800c6e50 0x7ff3800c72d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:32.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.639+0000 7ff37effd640 1 -- 172.21.15.53:0/3903161130 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3800ac5f0 con 0x7ff38014d230 2023-06-10T19:05:32.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.639+0000 7ff37f7fe640 1 --2- 172.21.15.53:0/3903161130 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff36c003f00 0x7ff38014ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:05:32.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.639+0000 7ff37effd640 1 --2- 172.21.15.53:0/3903161130 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff38014d230 0x7ff3800c6910 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 crypto rx=0x7ff368009ab0 tx=0x7ff36c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:32.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.639+0000 7ff377fff640 1 -- 172.21.15.53:0/3903161130 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff368004220 con 0x7ff38014d230 2023-06-10T19:05:32.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.639+0000 7ff377fff640 1 -- 172.21.15.53:0/3903161130 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff368004380 con 0x7ff38014d230 2023-06-10T19:05:32.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.639+0000 7ff385f22640 1 -- 172.21.15.53:0/3903161130 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3800ac8d0 con 0x7ff38014d230 2023-06-10T19:05:32.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.639+0000 7ff377fff640 1 -- 172.21.15.53:0/3903161130 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3680ad850 con 0x7ff38014d230 2023-06-10T19:05:32.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.639+0000 7ff385f22640 1 -- 172.21.15.53:0/3903161130 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3800ad0d0 con 0x7ff38014d230 2023-06-10T19:05:32.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.639+0000 7ff385f22640 1 -- 172.21.15.53:0/3903161130 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff38004d790 con 0x7ff38014d230 2023-06-10T19:05:32.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.639+0000 7ff377fff640 1 -- 172.21.15.53:0/3903161130 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff3680b4040 con 0x7ff38014d230 2023-06-10T19:05:32.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.643+0000 7ff377fff640 1 --2- 172.21.15.53:0/3903161130 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff360066280 0x7ff360068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:32.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.643+0000 7ff377fff640 1 -- 172.21.15.53:0/3903161130 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6105+0+0 (secure 0 0 0) 0x7ff36811e1f0 con 0x7ff38014d230 2023-06-10T19:05:32.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.643+0000 7ff37f7fe640 1 --2- 172.21.15.53:0/3903161130 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff360066280 0x7ff360068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:32.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.643+0000 7ff37f7fe640 1 --2- 172.21.15.53:0/3903161130 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff360066280 0x7ff360068730 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7ff378007fd0 tx=0x7ff378009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:32.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.647+0000 7ff377fff640 1 -- 172.21.15.53:0/3903161130 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff3680eb780 con 0x7ff38014d230 2023-06-10T19:05:32.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.807+0000 7ff385f22640 1 -- 172.21.15.53:0/3903161130 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff3800b3cd0 con 0x7ff38014d230 2023-06-10T19:05:32.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.811+0000 7ff377fff640 1 -- 172.21.15.53:0/3903161130 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 1 entries v126) v1 ==== 80+0+56 (secure 0 0 0) 0x7ff3680eeda0 con 0x7ff38014d230 2023-06-10T19:05:32.815 INFO:teuthology.orchestra.run.smithi053.stdout:192.168.0.1:0/935434380 2023-06-10T20:05:28.182850+0000 2023-06-10T19:05:32.815 INFO:teuthology.orchestra.run.smithi053.stderr:listed 1 entries 2023-06-10T19:05:32.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.811+0000 7ff385f22640 1 -- 172.21.15.53:0/3903161130 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff360066280 msgr2=0x7ff360068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:32.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.811+0000 7ff385f22640 1 --2- 172.21.15.53:0/3903161130 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff360066280 0x7ff360068730 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7ff378007fd0 tx=0x7ff378009040 comp rx=0 tx=0).stop 2023-06-10T19:05:32.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.811+0000 7ff385f22640 1 -- 172.21.15.53:0/3903161130 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff38014d230 msgr2=0x7ff3800c6910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:32.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.811+0000 7ff385f22640 1 --2- 172.21.15.53:0/3903161130 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff38014d230 0x7ff3800c6910 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 crypto rx=0x7ff368009ab0 tx=0x7ff36c005800 comp rx=0 tx=0).stop 2023-06-10T19:05:32.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.811+0000 7ff385f22640 1 -- 172.21.15.53:0/3903161130 shutdown_connections 2023-06-10T19:05:32.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.811+0000 7ff385f22640 1 --2- 172.21.15.53:0/3903161130 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff360066280 0x7ff360068730 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:32.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.811+0000 7ff385f22640 1 --2- 172.21.15.53:0/3903161130 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff3800c6e50 0x7ff3800c72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:32.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.811+0000 7ff385f22640 1 --2- 172.21.15.53:0/3903161130 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff38014d230 0x7ff3800c6910 unknown :-1 s=CLOSED pgs=1929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:32.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.811+0000 7ff385f22640 1 --2- 172.21.15.53:0/3903161130 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff36c003f00 0x7ff38014ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:32.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.811+0000 7ff385f22640 1 -- 172.21.15.53:0/3903161130 >> 172.21.15.53:0/3903161130 conn(0x7ff3800ce9e0 msgr2=0x7ff3800c3e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:32.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.811+0000 7ff385f22640 1 -- 172.21.15.53:0/3903161130 shutdown_connections 2023-06-10T19:05:32.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:32.811+0000 7ff385f22640 1 -- 172.21.15.53:0/3903161130 wait complete. 2023-06-10T19:05:32.833 DEBUG:tasks.cephfs.mount:Force/lazy unmounting on client.0 2023-06-10T19:05:32.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:05:32.834 DEBUG:teuthology.orchestra.run.smithi053:> sudo umount --lazy --force /home/ubuntu/cephtest/mnt.0 2023-06-10T19:05:32.847 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[62837]: fuse finished with error 0 and tester_r 0 2023-06-10T19:05:32.848 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi053.front.sepia.ceph.com 2023-06-10T19:05:32.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:05:32.849 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-06-10T19:05:32.982 INFO:tasks.cephfs.mount:Terminating background process 2023-06-10T19:05:32.983 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T19:05:32.983 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:05:32.990 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:05:33.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.111+0000 7f745506f640 1 Processor -- start 2023-06-10T19:05:33.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.111+0000 7f745506f640 1 -- start start 2023-06-10T19:05:33.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.115+0000 7f745506f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f74500b3ac0 0x7f74500b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:33.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.115+0000 7f745506f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f74500cc690 0x7f745015f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:33.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.115+0000 7f745506f640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74500d0020 con 0x7f74500ccae0 2023-06-10T19:05:33.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.115+0000 7f745506f640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74500b43d0 con 0x7f74500cc690 2023-06-10T19:05:33.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.115+0000 7f745506f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74500cef40 con 0x7f74500b3ac0 2023-06-10T19:05:33.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.115+0000 7f744e59c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f74500cc690 0x7f745015f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:33.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.115+0000 7f744e59c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f74500cc690 0x7f745015f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58040/0 (socket says 172.21.15.53:58040) 2023-06-10T19:05:33.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.115+0000 7f744e59c640 1 -- 172.21.15.53:0/246412933 learned_addr learned my addr 172.21.15.53:0/246412933 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:33.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.115+0000 7f744f59e640 1 --1- 172.21.15.53:0/246412933 >> v1:172.21.15.53:6789/0 conn(0x7f74500ccae0 0x7f745015f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60268/0 (socket says 172.21.15.53:60268) 2023-06-10T19:05:33.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.115+0000 7f744ed9d640 1 --2- 172.21.15.53:0/246412933 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f74500b3ac0 0x7f74500b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:33.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.115+0000 7f744e59c640 1 -- 172.21.15.53:0/246412933 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f74500b3ac0 msgr2=0x7f74500b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:33.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.115+0000 7f744e59c640 1 --2- 172.21.15.53:0/246412933 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f74500b3ac0 0x7f74500b3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:33.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.115+0000 7f744e59c640 1 -- 172.21.15.53:0/246412933 >> v1:172.21.15.53:6789/0 conn(0x7f74500ccae0 legacy=0x7f745015f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:33.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.115+0000 7f744dd9b640 1 -- 172.21.15.53:0/246412933 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3223904844 0 0) 0x7f74500d0020 con 0x7f74500ccae0 2023-06-10T19:05:33.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.115+0000 7f744e59c640 1 -- 172.21.15.53:0/246412933 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74500cf220 con 0x7f74500cc690 2023-06-10T19:05:33.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.115+0000 7f744e59c640 1 --2- 172.21.15.53:0/246412933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74500cc690 0x7f745015f370 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7f7444009870 tx=0x7f744401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54f23b5e8267e28c server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:33.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.115+0000 7f744dd9b640 1 -- 172.21.15.53:0/246412933 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74440aa670 con 0x7f74500cc690 2023-06-10T19:05:33.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.115+0000 7f744dd9b640 1 -- 172.21.15.53:0/246412933 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74440aa7d0 con 0x7f74500cc690 2023-06-10T19:05:33.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.115+0000 7f744dd9b640 1 -- 172.21.15.53:0/246412933 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74440aab60 con 0x7f74500cc690 2023-06-10T19:05:33.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.119+0000 7f745506f640 1 -- 172.21.15.53:0/246412933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74500cc690 msgr2=0x7f745015f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:33.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.119+0000 7f745506f640 1 --2- 172.21.15.53:0/246412933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74500cc690 0x7f745015f370 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7f7444009870 tx=0x7f744401c510 comp rx=0 tx=0).stop 2023-06-10T19:05:33.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.119+0000 7f745506f640 1 -- 172.21.15.53:0/246412933 shutdown_connections 2023-06-10T19:05:33.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.119+0000 7f745506f640 1 --2- 172.21.15.53:0/246412933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74500cc690 0x7f745015f370 unknown :-1 s=CLOSED pgs=1931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:33.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.119+0000 7f745506f640 1 --2- 172.21.15.53:0/246412933 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f74500b3ac0 0x7f74500b3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:33.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.119+0000 7f745506f640 1 -- 172.21.15.53:0/246412933 >> 172.21.15.53:0/246412933 conn(0x7f7450071790 msgr2=0x7f7450069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:33.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.119+0000 7f745506f640 1 -- 172.21.15.53:0/246412933 shutdown_connections 2023-06-10T19:05:33.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.119+0000 7f745506f640 1 -- 172.21.15.53:0/246412933 wait complete. 2023-06-10T19:05:33.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.119+0000 7f745506f640 1 Processor -- start 2023-06-10T19:05:33.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.119+0000 7f745506f640 1 -- start start 2023-06-10T19:05:33.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.119+0000 7f745506f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74500b3ac0 0x7f74500cad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:33.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.119+0000 7f745506f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f74500cc690 0x7f74500b69f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:33.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.119+0000 7f745506f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f74500ccae0 0x7f74500b2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:33.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.119+0000 7f745506f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74500b6f30 con 0x7f74500b3ac0 2023-06-10T19:05:33.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.119+0000 7f745506f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74500cb690 con 0x7f74500ccae0 2023-06-10T19:05:33.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.119+0000 7f745506f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74500cb3b0 con 0x7f74500cc690 2023-06-10T19:05:33.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.119+0000 7f744ed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74500b3ac0 0x7f74500cad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:33.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.119+0000 7f744ed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74500b3ac0 0x7f74500cad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58056/0 (socket says 172.21.15.53:58056) 2023-06-10T19:05:33.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.119+0000 7f744ed9d640 1 -- 172.21.15.53:0/2359775733 learned_addr learned my addr 172.21.15.53:0/2359775733 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:33.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.119+0000 7f744e59c640 1 --2- 172.21.15.53:0/2359775733 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f74500cc690 0x7f74500b69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:33.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.119+0000 7f744f59e640 1 --2- 172.21.15.53:0/2359775733 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f74500ccae0 0x7f74500b2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:33.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.119+0000 7f744ed9d640 1 -- 172.21.15.53:0/2359775733 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f74500cc690 msgr2=0x7f74500b69f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:33.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.119+0000 7f744ed9d640 1 --2- 172.21.15.53:0/2359775733 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f74500cc690 0x7f74500b69f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:33.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.119+0000 7f744ed9d640 1 -- 172.21.15.53:0/2359775733 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f74500ccae0 msgr2=0x7f74500b2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:33.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.119+0000 7f744ed9d640 1 --2- 172.21.15.53:0/2359775733 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f74500ccae0 0x7f74500b2900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:33.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.119+0000 7f744ed9d640 1 -- 172.21.15.53:0/2359775733 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74440094d0 con 0x7f74500b3ac0 2023-06-10T19:05:33.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.119+0000 7f744e59c640 1 --2- 172.21.15.53:0/2359775733 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f74500cc690 0x7f74500b69f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:05:33.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.119+0000 7f744ed9d640 1 --2- 172.21.15.53:0/2359775733 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74500b3ac0 0x7f74500cad40 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 crypto rx=0x7f744000d800 tx=0x7f744000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:33.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.119+0000 7f74377fe640 1 -- 172.21.15.53:0/2359775733 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744000b6c0 con 0x7f74500b3ac0 2023-06-10T19:05:33.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.119+0000 7f74377fe640 1 -- 172.21.15.53:0/2359775733 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f744000b820 con 0x7f74500b3ac0 2023-06-10T19:05:33.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.119+0000 7f745506f640 1 -- 172.21.15.53:0/2359775733 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f745015c400 con 0x7f74500b3ac0 2023-06-10T19:05:33.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.119+0000 7f74377fe640 1 -- 172.21.15.53:0/2359775733 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744000bb90 con 0x7f74500b3ac0 2023-06-10T19:05:33.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.119+0000 7f745506f640 1 -- 172.21.15.53:0/2359775733 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f745015c9c0 con 0x7f74500b3ac0 2023-06-10T19:05:33.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.123+0000 7f745506f640 1 -- 172.21.15.53:0/2359775733 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f745004d790 con 0x7f74500b3ac0 2023-06-10T19:05:33.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.123+0000 7f74377fe640 1 -- 172.21.15.53:0/2359775733 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f744000bcf0 con 0x7f74500b3ac0 2023-06-10T19:05:33.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.123+0000 7f74377fe640 1 --2- 172.21.15.53:0/2359775733 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f743c0662b0 0x7f743c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:33.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.123+0000 7f74377fe640 1 -- 172.21.15.53:0/2359775733 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6105+0+0 (secure 0 0 0) 0x7f7440084da0 con 0x7f74500b3ac0 2023-06-10T19:05:33.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.123+0000 7f744e59c640 1 --2- 172.21.15.53:0/2359775733 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f743c0662b0 0x7f743c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:33.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.123+0000 7f744e59c640 1 --2- 172.21.15.53:0/2359775733 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f743c0662b0 0x7f743c068760 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f74440ae000 tx=0x7f74440a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:33.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.127+0000 7f74377fe640 1 -- 172.21.15.53:0/2359775733 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7440055cf0 con 0x7f74500b3ac0 2023-06-10T19:05:33.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.279+0000 7f745506f640 1 -- 172.21.15.53:0/2359775733 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f745015c0b0 con 0x7f74500b3ac0 2023-06-10T19:05:33.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.283+0000 7f74377fe640 1 -- 172.21.15.53:0/2359775733 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v126) v1 ==== 74+0+18408 (secure 0 0 0) 0x7f7440055880 con 0x7f74500b3ac0 2023-06-10T19:05:33.289 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:05:33.289 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":126,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:05:29.141776+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-06-10T19:05:02.560833+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-06-10T19:05:03.863586+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.0.1:0/935434380":"2023-06-10T20:05:28.182850+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:05:33.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.283+0000 7f745506f640 1 -- 172.21.15.53:0/2359775733 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f743c0662b0 msgr2=0x7f743c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:33.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.283+0000 7f745506f640 1 --2- 172.21.15.53:0/2359775733 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f743c0662b0 0x7f743c068760 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f74440ae000 tx=0x7f74440a7000 comp rx=0 tx=0).stop 2023-06-10T19:05:33.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.283+0000 7f745506f640 1 -- 172.21.15.53:0/2359775733 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74500b3ac0 msgr2=0x7f74500cad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:33.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.283+0000 7f745506f640 1 --2- 172.21.15.53:0/2359775733 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74500b3ac0 0x7f74500cad40 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 crypto rx=0x7f744000d800 tx=0x7f744000dcc0 comp rx=0 tx=0).stop 2023-06-10T19:05:33.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.287+0000 7f745506f640 1 -- 172.21.15.53:0/2359775733 shutdown_connections 2023-06-10T19:05:33.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.287+0000 7f745506f640 1 --2- 172.21.15.53:0/2359775733 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f743c0662b0 0x7f743c068760 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:33.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.287+0000 7f745506f640 1 --2- 172.21.15.53:0/2359775733 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f74500ccae0 0x7f74500b2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:33.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.287+0000 7f745506f640 1 --2- 172.21.15.53:0/2359775733 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f74500cc690 0x7f74500b69f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:33.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.287+0000 7f745506f640 1 --2- 172.21.15.53:0/2359775733 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74500b3ac0 0x7f74500cad40 unknown :-1 s=CLOSED pgs=1932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:33.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.287+0000 7f745506f640 1 -- 172.21.15.53:0/2359775733 >> 172.21.15.53:0/2359775733 conn(0x7f7450071790 msgr2=0x7f74500d2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:33.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.287+0000 7f745506f640 1 -- 172.21.15.53:0/2359775733 shutdown_connections 2023-06-10T19:05:33.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.287+0000 7f745506f640 1 -- 172.21.15.53:0/2359775733 wait complete. 2023-06-10T19:05:33.308 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-10T18:52:33.633114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-10T18:52:39.171487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-10T19:05:02.560833+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '124', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2023-06-10T19:05:03.863586+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '125', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-10T19:05:33.309 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-10T19:05:33.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.423+0000 7f6709814640 1 Processor -- start 2023-06-10T19:05:33.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.423+0000 7f6709814640 1 -- start start 2023-06-10T19:05:33.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.427+0000 7f6709814640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f670415c060 0x7f67040cc020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:33.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.427+0000 7f6709814640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6704070de0 0x7f670415c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:33.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.427+0000 7f6709814640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67040c8d50 con 0x7f670415c970 2023-06-10T19:05:33.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.427+0000 7f6709814640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67040c9030 con 0x7f670415c060 2023-06-10T19:05:33.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.427+0000 7f6709814640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6704070300 con 0x7f6704070de0 2023-06-10T19:05:33.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.427+0000 7f6702ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f670415c060 0x7f67040cc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:33.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.427+0000 7f6702ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f670415c060 0x7f67040cc020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58066/0 (socket says 172.21.15.53:58066) 2023-06-10T19:05:33.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.427+0000 7f6702ffd640 1 -- 172.21.15.53:0/1922190134 learned_addr learned my addr 172.21.15.53:0/1922190134 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:33.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.427+0000 7f67027fc640 1 --2- 172.21.15.53:0/1922190134 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6704070de0 0x7f670415c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:33.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.427+0000 7f6702ffd640 1 -- 172.21.15.53:0/1922190134 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6704070de0 msgr2=0x7f670415c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:33.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.427+0000 7f6702ffd640 1 --2- 172.21.15.53:0/1922190134 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6704070de0 0x7f670415c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:33.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.427+0000 7f6702ffd640 1 -- 172.21.15.53:0/1922190134 >> v1:172.21.15.117:6789/0 conn(0x7f670415c970 legacy=0x7f670406bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:33.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.427+0000 7f6702ffd640 1 -- 172.21.15.53:0/1922190134 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67040705e0 con 0x7f670415c060 2023-06-10T19:05:33.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.427+0000 7f67027fc640 1 --2- 172.21.15.53:0/1922190134 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6704070de0 0x7f670415c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:05:33.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.427+0000 7f6702ffd640 1 --2- 172.21.15.53:0/1922190134 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f670415c060 0x7f67040cc020 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7f66fc009e50 tx=0x7f66fc01c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f87997260b81f3fe server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:33.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.431+0000 7f6701ffb640 1 -- 172.21.15.53:0/1922190134 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66fc0a5750 con 0x7f670415c060 2023-06-10T19:05:33.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.431+0000 7f6701ffb640 1 -- 172.21.15.53:0/1922190134 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66fc0a58b0 con 0x7f670415c060 2023-06-10T19:05:33.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.431+0000 7f6701ffb640 1 -- 172.21.15.53:0/1922190134 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66fc0a5c40 con 0x7f670415c060 2023-06-10T19:05:33.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.431+0000 7f6709814640 1 -- 172.21.15.53:0/1922190134 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f670415c060 msgr2=0x7f67040cc020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:33.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.431+0000 7f6709814640 1 --2- 172.21.15.53:0/1922190134 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f670415c060 0x7f67040cc020 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7f66fc009e50 tx=0x7f66fc01c980 comp rx=0 tx=0).stop 2023-06-10T19:05:33.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.431+0000 7f6709814640 1 -- 172.21.15.53:0/1922190134 shutdown_connections 2023-06-10T19:05:33.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.431+0000 7f6709814640 1 --2- 172.21.15.53:0/1922190134 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6704070de0 0x7f670415c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:33.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.431+0000 7f6709814640 1 --2- 172.21.15.53:0/1922190134 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f670415c060 0x7f67040cc020 unknown :-1 s=CLOSED pgs=1933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:33.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.431+0000 7f6709814640 1 -- 172.21.15.53:0/1922190134 >> 172.21.15.53:0/1922190134 conn(0x7f670406a0e0 msgr2=0x7f67040cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:33.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.431+0000 7f6709814640 1 -- 172.21.15.53:0/1922190134 shutdown_connections 2023-06-10T19:05:33.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.431+0000 7f6709814640 1 -- 172.21.15.53:0/1922190134 wait complete. 2023-06-10T19:05:33.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.431+0000 7f6709814640 1 Processor -- start 2023-06-10T19:05:33.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.431+0000 7f6709814640 1 -- start start 2023-06-10T19:05:33.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.431+0000 7f6709814640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6704070de0 0x7f67040ac470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:33.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.431+0000 7f6709814640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f670415c060 0x7f6704152650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:33.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.431+0000 7f6709814640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f670415c970 0x7f670413f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:33.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.431+0000 7f6709814640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67040ac9b0 con 0x7f670415c970 2023-06-10T19:05:33.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.431+0000 7f6709814640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67041407a0 con 0x7f670415c060 2023-06-10T19:05:33.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.431+0000 7f6709814640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67040c7b00 con 0x7f6704070de0 2023-06-10T19:05:33.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.431+0000 7f67037fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f670415c970 0x7f670413f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:33.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.431+0000 7f67037fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f670415c970 0x7f670413f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58072/0 (socket says 172.21.15.53:58072) 2023-06-10T19:05:33.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.431+0000 7f67037fe640 1 -- 172.21.15.53:0/4171937066 learned_addr learned my addr 172.21.15.53:0/4171937066 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:33.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.431+0000 7f67027fc640 1 --2- 172.21.15.53:0/4171937066 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f670415c060 0x7f6704152650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:33.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.431+0000 7f6702ffd640 1 --2- 172.21.15.53:0/4171937066 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6704070de0 0x7f67040ac470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:33.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.431+0000 7f67037fe640 1 -- 172.21.15.53:0/4171937066 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6704070de0 msgr2=0x7f67040ac470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:33.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.431+0000 7f67037fe640 1 --2- 172.21.15.53:0/4171937066 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6704070de0 0x7f67040ac470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:33.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.431+0000 7f67037fe640 1 -- 172.21.15.53:0/4171937066 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f670415c060 msgr2=0x7f6704152650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:33.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.431+0000 7f67037fe640 1 --2- 172.21.15.53:0/4171937066 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f670415c060 0x7f6704152650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:33.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.431+0000 7f67037fe640 1 -- 172.21.15.53:0/4171937066 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66fc009b30 con 0x7f670415c970 2023-06-10T19:05:33.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.431+0000 7f67037fe640 1 --2- 172.21.15.53:0/4171937066 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f670415c970 0x7f670413f820 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7f66f400c340 tx=0x7f66f400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:33.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.431+0000 7f66ebfff640 1 -- 172.21.15.53:0/4171937066 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f4005220 con 0x7f670415c970 2023-06-10T19:05:33.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.431+0000 7f66ebfff640 1 -- 172.21.15.53:0/4171937066 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66f4005380 con 0x7f670415c970 2023-06-10T19:05:33.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.431+0000 7f6709814640 1 -- 172.21.15.53:0/4171937066 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6704158950 con 0x7f670415c970 2023-06-10T19:05:33.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.431+0000 7f66ebfff640 1 -- 172.21.15.53:0/4171937066 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f4007270 con 0x7f670415c970 2023-06-10T19:05:33.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.431+0000 7f6709814640 1 -- 172.21.15.53:0/4171937066 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67040ab990 con 0x7f670415c970 2023-06-10T19:05:33.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.435+0000 7f6709814640 1 -- 172.21.15.53:0/4171937066 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f670404d790 con 0x7f670415c970 2023-06-10T19:05:33.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.435+0000 7f66ebfff640 1 -- 172.21.15.53:0/4171937066 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f66f40073d0 con 0x7f670415c970 2023-06-10T19:05:33.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.435+0000 7f66ebfff640 1 --2- 172.21.15.53:0/4171937066 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f66f0066280 0x7f66f0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:33.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.435+0000 7f66ebfff640 1 -- 172.21.15.53:0/4171937066 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6105+0+0 (secure 0 0 0) 0x7f66f40831e0 con 0x7f670415c970 2023-06-10T19:05:33.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.435+0000 7f6702ffd640 1 --2- 172.21.15.53:0/4171937066 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f66f0066280 0x7f66f0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:33.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.435+0000 7f6702ffd640 1 --2- 172.21.15.53:0/4171937066 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f66f0066280 0x7f66f0068730 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f66fc0ae000 tx=0x7f66fc0a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:33.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.439+0000 7f66ebfff640 1 -- 172.21.15.53:0/4171937066 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f66f40506c0 con 0x7f670415c970 2023-06-10T19:05:33.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.595+0000 7f6709814640 1 -- 172.21.15.53:0/4171937066 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f67040cb280 con 0x7f670415c970 2023-06-10T19:05:33.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.595+0000 7f66ebfff640 1 -- 172.21.15.53:0/4171937066 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v126) v1 ==== 93+0+10 (secure 0 0 0) 0x7f66f4053ce0 con 0x7f670415c970 2023-06-10T19:05:33.601 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-06-10T19:05:33.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.599+0000 7f6709814640 1 -- 172.21.15.53:0/4171937066 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f66f0066280 msgr2=0x7f66f0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:33.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.599+0000 7f6709814640 1 --2- 172.21.15.53:0/4171937066 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f66f0066280 0x7f66f0068730 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f66fc0ae000 tx=0x7f66fc0a7070 comp rx=0 tx=0).stop 2023-06-10T19:05:33.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.599+0000 7f6709814640 1 -- 172.21.15.53:0/4171937066 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f670415c970 msgr2=0x7f670413f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:33.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.599+0000 7f6709814640 1 --2- 172.21.15.53:0/4171937066 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f670415c970 0x7f670413f820 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7f66f400c340 tx=0x7f66f400c800 comp rx=0 tx=0).stop 2023-06-10T19:05:33.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.599+0000 7f6709814640 1 -- 172.21.15.53:0/4171937066 shutdown_connections 2023-06-10T19:05:33.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.599+0000 7f6709814640 1 --2- 172.21.15.53:0/4171937066 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f66f0066280 0x7f66f0068730 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:33.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.599+0000 7f6709814640 1 --2- 172.21.15.53:0/4171937066 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f670415c970 0x7f670413f820 unknown :-1 s=CLOSED pgs=1934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:33.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.599+0000 7f6709814640 1 --2- 172.21.15.53:0/4171937066 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f670415c060 0x7f6704152650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:33.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.599+0000 7f6709814640 1 --2- 172.21.15.53:0/4171937066 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6704070de0 0x7f67040ac470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:33.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.599+0000 7f6709814640 1 -- 172.21.15.53:0/4171937066 >> 172.21.15.53:0/4171937066 conn(0x7f670406a0e0 msgr2=0x7f67040cc7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:33.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.599+0000 7f6709814640 1 -- 172.21.15.53:0/4171937066 shutdown_connections 2023-06-10T19:05:33.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.599+0000 7f6709814640 1 -- 172.21.15.53:0/4171937066 wait complete. 2023-06-10T19:05:33.620 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-10T19:05:33.747 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.743+0000 7f28c9be8640 1 Processor -- start 2023-06-10T19:05:33.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.743+0000 7f28c9be8640 1 -- start start 2023-06-10T19:05:33.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.743+0000 7f28c9be8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f28c4070de0 0x7f28c415cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:33.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.743+0000 7f28c9be8640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28c40c8d50 con 0x7f28c40cc020 2023-06-10T19:05:33.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.743+0000 7f28c9be8640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28c40c9030 con 0x7f28c415c060 2023-06-10T19:05:33.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.743+0000 7f28c9be8640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28c4070300 con 0x7f28c4070de0 2023-06-10T19:05:33.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.743+0000 7f28c2ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f28c4070de0 0x7f28c415cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:33.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.743+0000 7f28c2ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f28c4070de0 0x7f28c415cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58080/0 (socket says 172.21.15.53:58080) 2023-06-10T19:05:33.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.743+0000 7f28c2ffd640 1 -- 172.21.15.53:0/3533950407 learned_addr learned my addr 172.21.15.53:0/3533950407 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:33.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.743+0000 7f28c2ffd640 1 -- 172.21.15.53:0/3533950407 >> v1:172.21.15.117:6789/0 conn(0x7f28c415c060 legacy=0x7f28c415c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:33.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.743+0000 7f28c2ffd640 1 -- 172.21.15.53:0/3533950407 >> v1:172.21.15.53:6789/0 conn(0x7f28c40cc020 legacy=0x7f28c406bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:33.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.743+0000 7f28c2ffd640 1 -- 172.21.15.53:0/3533950407 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28c40705e0 con 0x7f28c4070de0 2023-06-10T19:05:33.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.747+0000 7f28c2ffd640 1 --2- 172.21.15.53:0/3533950407 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28c4070de0 0x7f28c415cb40 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 crypto rx=0x7f28b8009870 tx=0x7f28b801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d714eab9602c333b server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:33.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.747+0000 7f28c27fc640 1 -- 172.21.15.53:0/3533950407 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b80ab600 con 0x7f28c4070de0 2023-06-10T19:05:33.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.747+0000 7f28c27fc640 1 -- 172.21.15.53:0/3533950407 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28b80ab760 con 0x7f28c4070de0 2023-06-10T19:05:33.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.747+0000 7f28c27fc640 1 -- 172.21.15.53:0/3533950407 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b80abaf0 con 0x7f28c4070de0 2023-06-10T19:05:33.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.747+0000 7f28c9be8640 1 -- 172.21.15.53:0/3533950407 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28c4070de0 msgr2=0x7f28c415cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:33.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.747+0000 7f28c9be8640 1 --2- 172.21.15.53:0/3533950407 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28c4070de0 0x7f28c415cb40 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 crypto rx=0x7f28b8009870 tx=0x7f28b801c470 comp rx=0 tx=0).stop 2023-06-10T19:05:33.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.747+0000 7f28c9be8640 1 -- 172.21.15.53:0/3533950407 shutdown_connections 2023-06-10T19:05:33.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.747+0000 7f28c9be8640 1 --2- 172.21.15.53:0/3533950407 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28c4070de0 0x7f28c415cb40 secure :-1 s=CLOSED pgs=1936 cs=0 l=1 rev1=1 crypto rx=0x7f28b8009870 tx=0x7f28b801c470 comp rx=0 tx=0).stop 2023-06-10T19:05:33.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.747+0000 7f28c9be8640 1 -- 172.21.15.53:0/3533950407 >> 172.21.15.53:0/3533950407 conn(0x7f28c406a0e0 msgr2=0x7f28c40cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:33.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.747+0000 7f28c9be8640 1 -- 172.21.15.53:0/3533950407 shutdown_connections 2023-06-10T19:05:33.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.747+0000 7f28c9be8640 1 -- 172.21.15.53:0/3533950407 wait complete. 2023-06-10T19:05:33.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.747+0000 7f28c9be8640 1 Processor -- start 2023-06-10T19:05:33.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.747+0000 7f28c9be8640 1 -- start start 2023-06-10T19:05:33.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.747+0000 7f28c9be8640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28c40cc020 0x7f28c414c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:33.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.747+0000 7f28c9be8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28c415c060 0x7f28c414d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:33.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.747+0000 7f28c9be8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28c414c7f0 0x7f28c414cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:33.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.747+0000 7f28c9be8640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c414e130 con 0x7f28c415c060 2023-06-10T19:05:33.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.747+0000 7f28c9be8640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c40b37d0 con 0x7f28c414c7f0 2023-06-10T19:05:33.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.747+0000 7f28c9be8640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28c414c620 con 0x7f28c40cc020 2023-06-10T19:05:33.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.747+0000 7f28c2ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28c415c060 0x7f28c414d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:33.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.747+0000 7f28c2ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28c415c060 0x7f28c414d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58094/0 (socket says 172.21.15.53:58094) 2023-06-10T19:05:33.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.747+0000 7f28c2ffd640 1 -- 172.21.15.53:0/1220681194 learned_addr learned my addr 172.21.15.53:0/1220681194 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:33.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.747+0000 7f28c37fe640 1 --2- 172.21.15.53:0/1220681194 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28c40cc020 0x7f28c414c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:33.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.747+0000 7f28c3fff640 1 --2- 172.21.15.53:0/1220681194 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28c414c7f0 0x7f28c414cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:33.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.747+0000 7f28c2ffd640 1 -- 172.21.15.53:0/1220681194 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28c40cc020 msgr2=0x7f28c414c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:33.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.747+0000 7f28c2ffd640 1 --2- 172.21.15.53:0/1220681194 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28c40cc020 0x7f28c414c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:33.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.747+0000 7f28c2ffd640 1 -- 172.21.15.53:0/1220681194 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28c414c7f0 msgr2=0x7f28c414cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:33.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.747+0000 7f28c2ffd640 1 --2- 172.21.15.53:0/1220681194 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28c414c7f0 0x7f28c414cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:33.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.747+0000 7f28c2ffd640 1 -- 172.21.15.53:0/1220681194 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28b80094d0 con 0x7f28c415c060 2023-06-10T19:05:33.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.747+0000 7f28c3fff640 1 --2- 172.21.15.53:0/1220681194 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28c414c7f0 0x7f28c414cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:05:33.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.751+0000 7f28c2ffd640 1 --2- 172.21.15.53:0/1220681194 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28c415c060 0x7f28c414d870 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 crypto rx=0x7f28b801c950 tx=0x7f28b801acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:33.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.751+0000 7f28abfff640 1 -- 172.21.15.53:0/1220681194 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b80b4800 con 0x7f28c415c060 2023-06-10T19:05:33.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.751+0000 7f28abfff640 1 -- 172.21.15.53:0/1220681194 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28b80b4960 con 0x7f28c415c060 2023-06-10T19:05:33.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.751+0000 7f28c9be8640 1 -- 172.21.15.53:0/1220681194 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28c40b2ea0 con 0x7f28c415c060 2023-06-10T19:05:33.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.751+0000 7f28abfff640 1 -- 172.21.15.53:0/1220681194 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b80b4d10 con 0x7f28c415c060 2023-06-10T19:05:33.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.751+0000 7f28c9be8640 1 -- 172.21.15.53:0/1220681194 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28c40b3460 con 0x7f28c415c060 2023-06-10T19:05:33.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.751+0000 7f28c9be8640 1 -- 172.21.15.53:0/1220681194 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28c40b3980 con 0x7f28c415c060 2023-06-10T19:05:33.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.751+0000 7f28abfff640 1 -- 172.21.15.53:0/1220681194 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f28b80b3380 con 0x7f28c415c060 2023-06-10T19:05:33.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.751+0000 7f28abfff640 1 --2- 172.21.15.53:0/1220681194 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f28b0066280 0x7f28b0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:33.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.751+0000 7f28abfff640 1 -- 172.21.15.53:0/1220681194 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6105+0+0 (secure 0 0 0) 0x7f28b811dbf0 con 0x7f28c415c060 2023-06-10T19:05:33.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.751+0000 7f28c37fe640 1 --2- 172.21.15.53:0/1220681194 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f28b0066280 0x7f28b0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:33.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.751+0000 7f28c37fe640 1 --2- 172.21.15.53:0/1220681194 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f28b0066280 0x7f28b0068730 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f28c40c8b40 tx=0x7f28b4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:33.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.755+0000 7f28abfff640 1 -- 172.21.15.53:0/1220681194 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f28c40b3980 con 0x7f28c415c060 2023-06-10T19:05:33.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.907+0000 7f28c9be8640 1 -- 172.21.15.53:0/1220681194 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f28c40b3980 con 0x7f28c415c060 2023-06-10T19:05:33.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.911+0000 7f28abfff640 1 -- 172.21.15.53:0/1220681194 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v126) v1 ==== 92+0+10 (secure 0 0 0) 0x7f28c40b3980 con 0x7f28c415c060 2023-06-10T19:05:33.915 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-06-10T19:05:33.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.911+0000 7f28c9be8640 1 -- 172.21.15.53:0/1220681194 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f28b0066280 msgr2=0x7f28b0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:33.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.911+0000 7f28c9be8640 1 --2- 172.21.15.53:0/1220681194 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f28b0066280 0x7f28b0068730 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f28c40c8b40 tx=0x7f28b4008040 comp rx=0 tx=0).stop 2023-06-10T19:05:33.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.911+0000 7f28c9be8640 1 -- 172.21.15.53:0/1220681194 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28c415c060 msgr2=0x7f28c414d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:33.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.911+0000 7f28c9be8640 1 --2- 172.21.15.53:0/1220681194 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28c415c060 0x7f28c414d870 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 crypto rx=0x7f28b801c950 tx=0x7f28b801acb0 comp rx=0 tx=0).stop 2023-06-10T19:05:33.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.911+0000 7f28c9be8640 1 -- 172.21.15.53:0/1220681194 shutdown_connections 2023-06-10T19:05:33.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.911+0000 7f28c9be8640 1 --2- 172.21.15.53:0/1220681194 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f28b0066280 0x7f28b0068730 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:33.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.911+0000 7f28c9be8640 1 --2- 172.21.15.53:0/1220681194 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28c414c7f0 0x7f28c414cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:33.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.911+0000 7f28c9be8640 1 --2- 172.21.15.53:0/1220681194 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28c415c060 0x7f28c414d870 unknown :-1 s=CLOSED pgs=1937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:33.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.911+0000 7f28c9be8640 1 --2- 172.21.15.53:0/1220681194 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28c40cc020 0x7f28c414c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:33.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.911+0000 7f28c9be8640 1 -- 172.21.15.53:0/1220681194 >> 172.21.15.53:0/1220681194 conn(0x7f28c406a0e0 msgr2=0x7f28c4150e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:33.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.911+0000 7f28c9be8640 1 -- 172.21.15.53:0/1220681194 shutdown_connections 2023-06-10T19:05:33.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:33.911+0000 7f28c9be8640 1 -- 172.21.15.53:0/1220681194 wait complete. 2023-06-10T19:05:33.935 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-10T19:05:34.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.051+0000 7f1823ef2640 1 Processor -- start 2023-06-10T19:05:34.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.051+0000 7f1823ef2640 1 -- start start 2023-06-10T19:05:34.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.051+0000 7f1823ef2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f181c0c9fa0 0x7f181c06bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:34.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.051+0000 7f1823ef2640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f181c06c020 0x7f181c0c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:34.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.051+0000 7f1823ef2640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f181c06b090 con 0x7f181c0c87e0 2023-06-10T19:05:34.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.051+0000 7f1823ef2640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f181c0ca370 con 0x7f181c06c020 2023-06-10T19:05:34.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.051+0000 7f1823ef2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f181c070d50 con 0x7f181c0c9fa0 2023-06-10T19:05:34.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.051+0000 7f182148d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f181c06c020 0x7f181c0c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:34.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.051+0000 7f182148d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f181c06c020 0x7f181c0c82a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58108/0 (socket says 172.21.15.53:58108) 2023-06-10T19:05:34.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.051+0000 7f182148d640 1 -- 172.21.15.53:0/1617336881 learned_addr learned my addr 172.21.15.53:0/1617336881 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:34.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.051+0000 7f1821c8e640 1 --2- 172.21.15.53:0/1617336881 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f181c0c9fa0 0x7f181c06bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:34.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.051+0000 7f182148d640 1 -- 172.21.15.53:0/1617336881 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f181c0c9fa0 msgr2=0x7f181c06bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:34.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.051+0000 7f182148d640 1 --2- 172.21.15.53:0/1617336881 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f181c0c9fa0 0x7f181c06bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:34.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.051+0000 7f182148d640 1 -- 172.21.15.53:0/1617336881 >> v1:172.21.15.117:6789/0 conn(0x7f181c0c87e0 legacy=0x7f181c0af760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:34.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.051+0000 7f182148d640 1 -- 172.21.15.53:0/1617336881 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f181c071030 con 0x7f181c06c020 2023-06-10T19:05:34.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.055+0000 7f182148d640 1 --2- 172.21.15.53:0/1617336881 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f181c06c020 0x7f181c0c82a0 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 crypto rx=0x7f1818009870 tx=0x7f181801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fd36930e1f1e40e server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:34.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.055+0000 7f1820c8c640 1 -- 172.21.15.53:0/1617336881 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18180ab600 con 0x7f181c06c020 2023-06-10T19:05:34.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.055+0000 7f1820c8c640 1 -- 172.21.15.53:0/1617336881 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18180ab760 con 0x7f181c06c020 2023-06-10T19:05:34.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.055+0000 7f1820c8c640 1 -- 172.21.15.53:0/1617336881 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18180abaf0 con 0x7f181c06c020 2023-06-10T19:05:34.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.055+0000 7f1823ef2640 1 -- 172.21.15.53:0/1617336881 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f181c06c020 msgr2=0x7f181c0c82a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:34.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.055+0000 7f1823ef2640 1 --2- 172.21.15.53:0/1617336881 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f181c06c020 0x7f181c0c82a0 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 crypto rx=0x7f1818009870 tx=0x7f181801c440 comp rx=0 tx=0).stop 2023-06-10T19:05:34.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.055+0000 7f1823ef2640 1 -- 172.21.15.53:0/1617336881 shutdown_connections 2023-06-10T19:05:34.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.055+0000 7f1823ef2640 1 --2- 172.21.15.53:0/1617336881 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f181c06c020 0x7f181c0c82a0 unknown :-1 s=CLOSED pgs=1938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:34.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.055+0000 7f1823ef2640 1 --2- 172.21.15.53:0/1617336881 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f181c0c9fa0 0x7f181c06bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:34.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.055+0000 7f1823ef2640 1 -- 172.21.15.53:0/1617336881 >> 172.21.15.53:0/1617336881 conn(0x7f181c06a0e0 msgr2=0x7f181c0cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:34.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.055+0000 7f1823ef2640 1 -- 172.21.15.53:0/1617336881 shutdown_connections 2023-06-10T19:05:34.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.055+0000 7f1823ef2640 1 -- 172.21.15.53:0/1617336881 wait complete. 2023-06-10T19:05:34.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.055+0000 7f1823ef2640 1 Processor -- start 2023-06-10T19:05:34.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.055+0000 7f1823ef2640 1 -- start start 2023-06-10T19:05:34.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.055+0000 7f1823ef2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f181c06c020 0x7f181c0c3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:34.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.055+0000 7f1823ef2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f181c0c87e0 0x7f181c151250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:34.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.055+0000 7f1823ef2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f181c0c9fa0 0x7f181c151790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:34.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.055+0000 7f1823ef2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f181c0c46e0 con 0x7f181c06c020 2023-06-10T19:05:34.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.055+0000 7f1823ef2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f181c0cd560 con 0x7f181c0c9fa0 2023-06-10T19:05:34.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.055+0000 7f1823ef2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f181c0ab860 con 0x7f181c0c87e0 2023-06-10T19:05:34.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.055+0000 7f1821c8e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f181c06c020 0x7f181c0c3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:34.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.055+0000 7f1821c8e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f181c06c020 0x7f181c0c3ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58112/0 (socket says 172.21.15.53:58112) 2023-06-10T19:05:34.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.055+0000 7f1821c8e640 1 -- 172.21.15.53:0/1046770737 learned_addr learned my addr 172.21.15.53:0/1046770737 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:34.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.055+0000 7f182148d640 1 --2- 172.21.15.53:0/1046770737 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f181c0c87e0 0x7f181c151250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:34.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.055+0000 7f182248f640 1 --2- 172.21.15.53:0/1046770737 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f181c0c9fa0 0x7f181c151790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:34.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.055+0000 7f1821c8e640 1 -- 172.21.15.53:0/1046770737 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f181c0c87e0 msgr2=0x7f181c151250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:34.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.055+0000 7f1821c8e640 1 --2- 172.21.15.53:0/1046770737 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f181c0c87e0 0x7f181c151250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:34.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.055+0000 7f1821c8e640 1 -- 172.21.15.53:0/1046770737 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f181c0c9fa0 msgr2=0x7f181c151790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:34.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.055+0000 7f1821c8e640 1 --2- 172.21.15.53:0/1046770737 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f181c0c9fa0 0x7f181c151790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:34.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.055+0000 7f1821c8e640 1 -- 172.21.15.53:0/1046770737 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18180094d0 con 0x7f181c06c020 2023-06-10T19:05:34.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.059+0000 7f1821c8e640 1 --2- 172.21.15.53:0/1046770737 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f181c06c020 0x7f181c0c3ad0 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 crypto rx=0x7f181000d5f0 tx=0x7f181000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:34.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.059+0000 7f180e7fc640 1 -- 172.21.15.53:0/1046770737 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18100125f0 con 0x7f181c06c020 2023-06-10T19:05:34.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.059+0000 7f180e7fc640 1 -- 172.21.15.53:0/1046770737 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1810012750 con 0x7f181c06c020 2023-06-10T19:05:34.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.059+0000 7f1823ef2640 1 -- 172.21.15.53:0/1046770737 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f181c0abb40 con 0x7f181c06c020 2023-06-10T19:05:34.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.059+0000 7f180e7fc640 1 -- 172.21.15.53:0/1046770737 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1810012ae0 con 0x7f181c06c020 2023-06-10T19:05:34.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.059+0000 7f1823ef2640 1 -- 172.21.15.53:0/1046770737 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f181c0ac100 con 0x7f181c06c020 2023-06-10T19:05:34.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.059+0000 7f1823ef2640 1 -- 172.21.15.53:0/1046770737 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f181c0ac2c0 con 0x7f181c06c020 2023-06-10T19:05:34.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.059+0000 7f180e7fc640 1 -- 172.21.15.53:0/1046770737 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1810012c40 con 0x7f181c06c020 2023-06-10T19:05:34.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.059+0000 7f180e7fc640 1 --2- 172.21.15.53:0/1046770737 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1800066280 0x7f1800068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:34.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.059+0000 7f180e7fc640 1 -- 172.21.15.53:0/1046770737 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6105+0+0 (secure 0 0 0) 0x7f1810084200 con 0x7f181c06c020 2023-06-10T19:05:34.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.059+0000 7f182148d640 1 --2- 172.21.15.53:0/1046770737 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1800066280 0x7f1800068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:34.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.059+0000 7f182148d640 1 --2- 172.21.15.53:0/1046770737 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1800066280 0x7f1800068730 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f18180af000 tx=0x7f18180a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:34.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.063+0000 7f180e7fc640 1 -- 172.21.15.53:0/1046770737 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f18100516e0 con 0x7f181c06c020 2023-06-10T19:05:34.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.223+0000 7f1823ef2640 1 -- 172.21.15.53:0/1046770737 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f181c04d790 con 0x7f181c06c020 2023-06-10T19:05:34.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.223+0000 7f180e7fc640 1 -- 172.21.15.53:0/1046770737 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v126) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1810054d00 con 0x7f181c06c020 2023-06-10T19:05:34.229 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-06-10T19:05:34.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.227+0000 7f1823ef2640 1 -- 172.21.15.53:0/1046770737 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1800066280 msgr2=0x7f1800068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:34.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.227+0000 7f1823ef2640 1 --2- 172.21.15.53:0/1046770737 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1800066280 0x7f1800068730 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f18180af000 tx=0x7f18180a7000 comp rx=0 tx=0).stop 2023-06-10T19:05:34.232 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.227+0000 7f1823ef2640 1 -- 172.21.15.53:0/1046770737 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f181c06c020 msgr2=0x7f181c0c3ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:34.232 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.227+0000 7f1823ef2640 1 --2- 172.21.15.53:0/1046770737 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f181c06c020 0x7f181c0c3ad0 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 crypto rx=0x7f181000d5f0 tx=0x7f181000dab0 comp rx=0 tx=0).stop 2023-06-10T19:05:34.232 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.227+0000 7f1823ef2640 1 -- 172.21.15.53:0/1046770737 shutdown_connections 2023-06-10T19:05:34.232 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.227+0000 7f1823ef2640 1 --2- 172.21.15.53:0/1046770737 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1800066280 0x7f1800068730 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:34.232 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.227+0000 7f1823ef2640 1 --2- 172.21.15.53:0/1046770737 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f181c0c9fa0 0x7f181c151790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:34.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.227+0000 7f1823ef2640 1 --2- 172.21.15.53:0/1046770737 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f181c0c87e0 0x7f181c151250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:34.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.227+0000 7f1823ef2640 1 --2- 172.21.15.53:0/1046770737 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f181c06c020 0x7f181c0c3ad0 unknown :-1 s=CLOSED pgs=1939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:34.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.227+0000 7f1823ef2640 1 -- 172.21.15.53:0/1046770737 >> 172.21.15.53:0/1046770737 conn(0x7f181c06a0e0 msgr2=0x7f181c0ae690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:34.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.227+0000 7f1823ef2640 1 -- 172.21.15.53:0/1046770737 shutdown_connections 2023-06-10T19:05:34.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.227+0000 7f1823ef2640 1 -- 172.21.15.53:0/1046770737 wait complete. 2023-06-10T19:05:34.249 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-10T19:05:34.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.363+0000 7f99cc252640 1 Processor -- start 2023-06-10T19:05:34.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.363+0000 7f99cc252640 1 -- start start 2023-06-10T19:05:34.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.363+0000 7f99cc252640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f99c4159450 0x7f99c415d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:34.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.363+0000 7f99cc252640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99c415d680 0x7f99c40cec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:34.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.363+0000 7f99cc252640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99c40cbac0 con 0x7f99c40cf180 2023-06-10T19:05:34.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.363+0000 7f99cc252640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99c40cf600 con 0x7f99c4159450 2023-06-10T19:05:34.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.363+0000 7f99cc252640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99c415dc00 con 0x7f99c415d680 2023-06-10T19:05:34.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.363+0000 7f99c9fee640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f99c4159450 0x7f99c415d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:34.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.363+0000 7f99ca7ef640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f99c40cf180 0x7f99c40cda20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60292/0 (socket says 172.21.15.53:60292) 2023-06-10T19:05:34.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.363+0000 7f99ca7ef640 1 -- 172.21.15.53:0/2479557699 learned_addr learned my addr 172.21.15.53:0/2479557699 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:05:34.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.363+0000 7f99c97ed640 1 --2- 172.21.15.53:0/2479557699 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99c415d680 0x7f99c40cec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:34.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.363+0000 7f99c9fee640 1 -- 172.21.15.53:0/2479557699 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99c415d680 msgr2=0x7f99c40cec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:34.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.363+0000 7f99c9fee640 1 --2- 172.21.15.53:0/2479557699 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99c415d680 0x7f99c40cec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:34.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.363+0000 7f99c9fee640 1 -- 172.21.15.53:0/2479557699 >> v1:172.21.15.53:6789/0 conn(0x7f99c40cf180 legacy=0x7f99c40cda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:34.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.363+0000 7f99c9fee640 1 -- 172.21.15.53:0/2479557699 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99c415dee0 con 0x7f99c4159450 2023-06-10T19:05:34.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.363+0000 7f99c8fec640 1 -- 172.21.15.53:0/2479557699 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 956940486 0 0) 0x7f99c40cbac0 con 0x7f99c40cf180 2023-06-10T19:05:34.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.367+0000 7f99c9fee640 1 --2- 172.21.15.53:0/2479557699 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99c4159450 0x7f99c415d140 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 crypto rx=0x7f99bc009d90 tx=0x7f99bc01c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7d2fad6795c056f server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:34.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.367+0000 7f99c8fec640 1 -- 172.21.15.53:0/2479557699 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99bc0a5910 con 0x7f99c4159450 2023-06-10T19:05:34.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.367+0000 7f99c8fec640 1 -- 172.21.15.53:0/2479557699 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99bc0a5a70 con 0x7f99c4159450 2023-06-10T19:05:34.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.367+0000 7f99c8fec640 1 -- 172.21.15.53:0/2479557699 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99bc0a5e00 con 0x7f99c4159450 2023-06-10T19:05:34.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.367+0000 7f99cc252640 1 -- 172.21.15.53:0/2479557699 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99c4159450 msgr2=0x7f99c415d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:34.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.367+0000 7f99cc252640 1 --2- 172.21.15.53:0/2479557699 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99c4159450 0x7f99c415d140 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 crypto rx=0x7f99bc009d90 tx=0x7f99bc01c890 comp rx=0 tx=0).stop 2023-06-10T19:05:34.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.367+0000 7f99cc252640 1 -- 172.21.15.53:0/2479557699 shutdown_connections 2023-06-10T19:05:34.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.367+0000 7f99cc252640 1 --2- 172.21.15.53:0/2479557699 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99c415d680 0x7f99c40cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:34.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.367+0000 7f99cc252640 1 --2- 172.21.15.53:0/2479557699 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99c4159450 0x7f99c415d140 unknown :-1 s=CLOSED pgs=1941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:34.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.367+0000 7f99cc252640 1 -- 172.21.15.53:0/2479557699 >> 172.21.15.53:0/2479557699 conn(0x7f99c406a090 msgr2=0x7f99c406d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:34.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.367+0000 7f99cc252640 1 -- 172.21.15.53:0/2479557699 shutdown_connections 2023-06-10T19:05:34.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.367+0000 7f99cc252640 1 -- 172.21.15.53:0/2479557699 wait complete. 2023-06-10T19:05:34.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.367+0000 7f99cc252640 1 Processor -- start 2023-06-10T19:05:34.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.367+0000 7f99cc252640 1 -- start start 2023-06-10T19:05:34.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.367+0000 7f99cc252640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99c40cf180 0x7f99c414d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:34.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.367+0000 7f99cc252640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99c4159450 0x7f99c4154060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:34.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.367+0000 7f99cc252640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99c415d680 0x7f99c41545a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:34.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.367+0000 7f99cc252640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99c4157630 con 0x7f99c4159450 2023-06-10T19:05:34.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.367+0000 7f99cc252640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99c414f650 con 0x7f99c40cf180 2023-06-10T19:05:34.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.367+0000 7f99cc252640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99c4156590 con 0x7f99c415d680 2023-06-10T19:05:34.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.367+0000 7f99c97ed640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99c4159450 0x7f99c4154060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:34.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.367+0000 7f99c97ed640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99c4159450 0x7f99c4154060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58124/0 (socket says 172.21.15.53:58124) 2023-06-10T19:05:34.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.367+0000 7f99c97ed640 1 -- 172.21.15.53:0/3693651228 learned_addr learned my addr 172.21.15.53:0/3693651228 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:34.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.367+0000 7f99c97ed640 1 -- 172.21.15.53:0/3693651228 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99c415d680 msgr2=0x7f99c41545a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:34.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.367+0000 7f99c9fee640 1 --2- 172.21.15.53:0/3693651228 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99c40cf180 0x7f99c414d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:34.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.367+0000 7f99ca7ef640 1 --2- 172.21.15.53:0/3693651228 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99c415d680 0x7f99c41545a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:34.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.367+0000 7f99c97ed640 1 --2- 172.21.15.53:0/3693651228 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99c415d680 0x7f99c41545a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:34.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.367+0000 7f99c97ed640 1 -- 172.21.15.53:0/3693651228 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99c40cf180 msgr2=0x7f99c414d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:34.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.367+0000 7f99c97ed640 1 --2- 172.21.15.53:0/3693651228 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99c40cf180 0x7f99c414d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:34.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.367+0000 7f99c97ed640 1 -- 172.21.15.53:0/3693651228 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99bc009a70 con 0x7f99c4159450 2023-06-10T19:05:34.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.367+0000 7f99ca7ef640 1 --2- 172.21.15.53:0/3693651228 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99c415d680 0x7f99c41545a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:05:34.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.367+0000 7f99c97ed640 1 --2- 172.21.15.53:0/3693651228 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99c4159450 0x7f99c4154060 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 crypto rx=0x7f99c000d5f0 tx=0x7f99c000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:34.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.371+0000 7f99ba7fc640 1 -- 172.21.15.53:0/3693651228 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c00125f0 con 0x7f99c4159450 2023-06-10T19:05:34.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.371+0000 7f99ba7fc640 1 -- 172.21.15.53:0/3693651228 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99c0012750 con 0x7f99c4159450 2023-06-10T19:05:34.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.371+0000 7f99cc252640 1 -- 172.21.15.53:0/3693651228 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99c4156870 con 0x7f99c4159450 2023-06-10T19:05:34.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.371+0000 7f99ba7fc640 1 -- 172.21.15.53:0/3693651228 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c0012ae0 con 0x7f99c4159450 2023-06-10T19:05:34.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.371+0000 7f99cc252640 1 -- 172.21.15.53:0/3693651228 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99c4156e30 con 0x7f99c4159450 2023-06-10T19:05:34.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.371+0000 7f99cc252640 1 -- 172.21.15.53:0/3693651228 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99c404d790 con 0x7f99c4159450 2023-06-10T19:05:34.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.371+0000 7f99ba7fc640 1 -- 172.21.15.53:0/3693651228 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f99c0012c40 con 0x7f99c4159450 2023-06-10T19:05:34.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.371+0000 7f99ba7fc640 1 --2- 172.21.15.53:0/3693651228 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f99b00662b0 0x7f99b0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:34.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.371+0000 7f99ba7fc640 1 -- 172.21.15.53:0/3693651228 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6105+0+0 (secure 0 0 0) 0x7f99c0084290 con 0x7f99c4159450 2023-06-10T19:05:34.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.371+0000 7f99c9fee640 1 --2- 172.21.15.53:0/3693651228 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f99b00662b0 0x7f99b0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:34.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.371+0000 7f99c9fee640 1 --2- 172.21.15.53:0/3693651228 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f99b00662b0 0x7f99b0068760 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f99bc0af000 tx=0x7f99bc0a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:34.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.375+0000 7f99ba7fc640 1 -- 172.21.15.53:0/3693651228 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f99c0051650 con 0x7f99c4159450 2023-06-10T19:05:34.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.531+0000 7f99cc252640 1 -- 172.21.15.53:0/3693651228 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f99c406df70 con 0x7f99c4159450 2023-06-10T19:05:34.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.531+0000 7f99ba7fc640 1 -- 172.21.15.53:0/3693651228 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v126) v1 ==== 100+0+11 (secure 0 0 0) 0x7f99c0007380 con 0x7f99c4159450 2023-06-10T19:05:34.536 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-06-10T19:05:34.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.531+0000 7f99cc252640 1 -- 172.21.15.53:0/3693651228 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f99b00662b0 msgr2=0x7f99b0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:34.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.531+0000 7f99cc252640 1 --2- 172.21.15.53:0/3693651228 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f99b00662b0 0x7f99b0068760 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f99bc0af000 tx=0x7f99bc0a7070 comp rx=0 tx=0).stop 2023-06-10T19:05:34.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.531+0000 7f99cc252640 1 -- 172.21.15.53:0/3693651228 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99c4159450 msgr2=0x7f99c4154060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:34.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.531+0000 7f99cc252640 1 --2- 172.21.15.53:0/3693651228 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99c4159450 0x7f99c4154060 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 crypto rx=0x7f99c000d5f0 tx=0x7f99c000dab0 comp rx=0 tx=0).stop 2023-06-10T19:05:34.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.531+0000 7f99cc252640 1 -- 172.21.15.53:0/3693651228 shutdown_connections 2023-06-10T19:05:34.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.531+0000 7f99cc252640 1 --2- 172.21.15.53:0/3693651228 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f99b00662b0 0x7f99b0068760 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:34.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.531+0000 7f99cc252640 1 --2- 172.21.15.53:0/3693651228 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99c415d680 0x7f99c41545a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:34.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.531+0000 7f99cc252640 1 --2- 172.21.15.53:0/3693651228 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99c4159450 0x7f99c4154060 unknown :-1 s=CLOSED pgs=1942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:34.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.531+0000 7f99cc252640 1 --2- 172.21.15.53:0/3693651228 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99c40cf180 0x7f99c414d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:34.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.531+0000 7f99cc252640 1 -- 172.21.15.53:0/3693651228 >> 172.21.15.53:0/3693651228 conn(0x7f99c406a090 msgr2=0x7f99c40cd420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:34.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.531+0000 7f99cc252640 1 -- 172.21.15.53:0/3693651228 shutdown_connections 2023-06-10T19:05:34.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.531+0000 7f99cc252640 1 -- 172.21.15.53:0/3693651228 wait complete. 2023-06-10T19:05:34.553 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-10T19:05:34.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.663+0000 7fa70b064640 1 Processor -- start 2023-06-10T19:05:34.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.663+0000 7fa70b064640 1 -- start start 2023-06-10T19:05:34.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.663+0000 7fa70b064640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa704152bb0 0x7fa7040c8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:34.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.663+0000 7fa70b064640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa70415c210 0x7fa70415c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:34.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.663+0000 7fa70b064640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7040c8850 con 0x7fa704158c20 2023-06-10T19:05:34.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.663+0000 7fa70b064640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7040cc8f0 con 0x7fa70415c210 2023-06-10T19:05:34.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.663+0000 7fa70b064640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa70415cb80 con 0x7fa704152bb0 2023-06-10T19:05:34.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.663+0000 7fa709601640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fa704158c20 0x7fa704159040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60296/0 (socket says 172.21.15.53:60296) 2023-06-10T19:05:34.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.663+0000 7fa709601640 1 -- 172.21.15.53:0/1400939511 learned_addr learned my addr 172.21.15.53:0/1400939511 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:05:34.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.663+0000 7fa708e00640 1 --2- 172.21.15.53:0/1400939511 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa704152bb0 0x7fa7040c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:34.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.663+0000 7fa703fff640 1 --2- 172.21.15.53:0/1400939511 >> v2:172.21.15.117:3300/0 conn(0x7fa70415c210 0x7fa70415c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:34.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.663+0000 7fa7037fe640 1 -- 172.21.15.53:0/1400939511 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1748789241 0 0) 0x7fa6fc0014a0 con 0x7fa704158c20 2023-06-10T19:05:34.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.663+0000 7fa7037fe640 1 -- 172.21.15.53:0/1400939511 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6ec003530 con 0x7fa704158c20 2023-06-10T19:05:34.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.663+0000 7fa7037fe640 1 -- 172.21.15.53:0/1400939511 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3466161286 0 0) 0x7fa6ec003530 con 0x7fa704158c20 2023-06-10T19:05:34.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.663+0000 7fa7037fe640 1 -- 172.21.15.53:0/1400939511 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa704152bb0 msgr2=0x7fa7040c8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:34.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.663+0000 7fa7037fe640 1 --2- 172.21.15.53:0/1400939511 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa704152bb0 0x7fa7040c8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:34.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.663+0000 7fa7037fe640 1 -- 172.21.15.53:0/1400939511 >> v2:172.21.15.117:3300/0 conn(0x7fa70415c210 msgr2=0x7fa70415c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:34.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.663+0000 7fa7037fe640 1 --2- 172.21.15.53:0/1400939511 >> v2:172.21.15.117:3300/0 conn(0x7fa70415c210 0x7fa70415c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:34.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.663+0000 7fa7037fe640 1 -- 172.21.15.53:0/1400939511 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7040c8b90 con 0x7fa704158c20 2023-06-10T19:05:34.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.663+0000 7fa7037fe640 1 -- 172.21.15.53:0/1400939511 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fa6fc001b90 con 0x7fa704158c20 2023-06-10T19:05:34.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.663+0000 7fa7037fe640 1 -- 172.21.15.53:0/1400939511 >> v1:172.21.15.53:6789/0 conn(0x7fa704158c20 legacy=0x7fa704159040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:34.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.663+0000 7fa7037fe640 1 --2- 172.21.15.53:0/1400939511 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa704152bb0 0x7fa6ec003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:34.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.663+0000 7fa7037fe640 1 --2- 172.21.15.53:0/1400939511 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6ec003f00 0x7fa6ec0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:34.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.663+0000 7fa7037fe640 1 --2- 172.21.15.53:0/1400939511 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6ec004d10 0x7fa6ec005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:34.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.663+0000 7fa7037fe640 1 -- 172.21.15.53:0/1400939511 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7040cc8f0 con 0x7fa6ec004d10 2023-06-10T19:05:34.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.663+0000 7fa7037fe640 1 -- 172.21.15.53:0/1400939511 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa70415cb80 con 0x7fa6ec003f00 2023-06-10T19:05:34.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.663+0000 7fa7037fe640 1 -- 172.21.15.53:0/1400939511 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6ec00b9c0 con 0x7fa704152bb0 2023-06-10T19:05:34.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.663+0000 7fa709601640 1 --2- 172.21.15.53:0/1400939511 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6ec004d10 0x7fa6ec005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:34.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.663+0000 7fa703fff640 1 --2- 172.21.15.53:0/1400939511 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6ec003f00 0x7fa6ec0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:34.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.663+0000 7fa709601640 1 -- 172.21.15.53:0/1400939511 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa704152bb0 msgr2=0x7fa6ec003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:34.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.663+0000 7fa709601640 1 --2- 172.21.15.53:0/1400939511 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa704152bb0 0x7fa6ec003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:34.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.663+0000 7fa709601640 1 -- 172.21.15.53:0/1400939511 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6ec003f00 msgr2=0x7fa6ec0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:34.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.663+0000 7fa709601640 1 --2- 172.21.15.53:0/1400939511 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6ec003f00 0x7fa6ec0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:34.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.663+0000 7fa709601640 1 -- 172.21.15.53:0/1400939511 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6ec003530 con 0x7fa6ec004d10 2023-06-10T19:05:34.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.667+0000 7fa709601640 1 --2- 172.21.15.53:0/1400939511 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6ec004d10 0x7fa6ec005180 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc00a830 tx=0x7fa6fc01d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=579e5f795ea42618 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:34.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.667+0000 7fa7037fe640 1 -- 172.21.15.53:0/1400939511 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6fc0ad630 con 0x7fa6ec004d10 2023-06-10T19:05:34.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.667+0000 7fa7037fe640 1 -- 172.21.15.53:0/1400939511 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6fc0a8070 con 0x7fa6ec004d10 2023-06-10T19:05:34.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.667+0000 7fa7037fe640 1 -- 172.21.15.53:0/1400939511 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6fc0ad9d0 con 0x7fa6ec004d10 2023-06-10T19:05:34.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.667+0000 7fa70b064640 1 -- 172.21.15.53:0/1400939511 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6ec004d10 msgr2=0x7fa6ec005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:34.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.667+0000 7fa70b064640 1 --2- 172.21.15.53:0/1400939511 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6ec004d10 0x7fa6ec005180 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc00a830 tx=0x7fa6fc01d340 comp rx=0 tx=0).stop 2023-06-10T19:05:34.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.667+0000 7fa709601640 1 -- 172.21.15.53:0/1400939511 reap_dead start 2023-06-10T19:05:34.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.667+0000 7fa70b064640 1 -- 172.21.15.53:0/1400939511 shutdown_connections 2023-06-10T19:05:34.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.667+0000 7fa70b064640 1 -- 172.21.15.53:0/1400939511 >> 172.21.15.53:0/1400939511 conn(0x7fa7040ce9e0 msgr2=0x7fa7040ca7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:34.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.667+0000 7fa70b064640 1 -- 172.21.15.53:0/1400939511 shutdown_connections 2023-06-10T19:05:34.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.667+0000 7fa70b064640 1 -- 172.21.15.53:0/1400939511 wait complete. 2023-06-10T19:05:34.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.667+0000 7fa70b064640 1 Processor -- start 2023-06-10T19:05:34.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.667+0000 7fa70b064640 1 -- start start 2023-06-10T19:05:34.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.667+0000 7fa70b064640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa704152320 0x7fa7040c7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:34.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.667+0000 7fa70b064640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7040c7a60 0x7fa7040ad7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:34.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.667+0000 7fa70b064640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa7040adcf0 0x7fa7040b1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:34.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.667+0000 7fa70b064640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7040ae160 con 0x7fa7040c7a60 2023-06-10T19:05:34.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.667+0000 7fa70b064640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7040c1b90 con 0x7fa7040adcf0 2023-06-10T19:05:34.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.667+0000 7fa70b064640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7040c1e70 con 0x7fa704152320 2023-06-10T19:05:34.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.667+0000 7fa703fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7040c7a60 0x7fa7040ad7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:34.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.667+0000 7fa703fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7040c7a60 0x7fa7040ad7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58148/0 (socket says 172.21.15.53:58148) 2023-06-10T19:05:34.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.667+0000 7fa703fff640 1 -- 172.21.15.53:0/3432288605 learned_addr learned my addr 172.21.15.53:0/3432288605 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:34.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.671+0000 7fa703fff640 1 -- 172.21.15.53:0/3432288605 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa704152320 msgr2=0x7fa7040c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:34.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.671+0000 7fa703fff640 1 --2- 172.21.15.53:0/3432288605 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa704152320 0x7fa7040c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:34.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.671+0000 7fa703fff640 1 -- 172.21.15.53:0/3432288605 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa7040adcf0 msgr2=0x7fa7040b1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:34.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.671+0000 7fa703fff640 1 --2- 172.21.15.53:0/3432288605 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa7040adcf0 0x7fa7040b1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:34.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.671+0000 7fa703fff640 1 -- 172.21.15.53:0/3432288605 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7040c2150 con 0x7fa7040c7a60 2023-06-10T19:05:34.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.671+0000 7fa703fff640 1 --2- 172.21.15.53:0/3432288605 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7040c7a60 0x7fa7040ad7b0 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 crypto rx=0x7fa6f8011660 tx=0x7fa6f8011b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:34.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.671+0000 7fa7017fa640 1 -- 172.21.15.53:0/3432288605 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f800f940 con 0x7fa7040c7a60 2023-06-10T19:05:34.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.671+0000 7fa7017fa640 1 -- 172.21.15.53:0/3432288605 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6f800faa0 con 0x7fa7040c7a60 2023-06-10T19:05:34.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.671+0000 7fa7017fa640 1 -- 172.21.15.53:0/3432288605 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f800fe10 con 0x7fa7040c7a60 2023-06-10T19:05:34.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.671+0000 7fa70b064640 1 -- 172.21.15.53:0/3432288605 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7040c2430 con 0x7fa7040c7a60 2023-06-10T19:05:34.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.671+0000 7fa70b064640 1 -- 172.21.15.53:0/3432288605 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7041526f0 con 0x7fa7040c7a60 2023-06-10T19:05:34.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.671+0000 7fa70b064640 1 -- 172.21.15.53:0/3432288605 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa70404d790 con 0x7fa7040c7a60 2023-06-10T19:05:34.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.671+0000 7fa7017fa640 1 -- 172.21.15.53:0/3432288605 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa6f8015460 con 0x7fa7040c7a60 2023-06-10T19:05:34.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.671+0000 7fa7017fa640 1 --2- 172.21.15.53:0/3432288605 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa6f0066280 0x7fa6f0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:34.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.671+0000 7fa7017fa640 1 -- 172.21.15.53:0/3432288605 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6105+0+0 (secure 0 0 0) 0x7fa6f8084200 con 0x7fa7040c7a60 2023-06-10T19:05:34.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.671+0000 7fa708e00640 1 --2- 172.21.15.53:0/3432288605 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa6f0066280 0x7fa6f0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:34.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.671+0000 7fa708e00640 1 --2- 172.21.15.53:0/3432288605 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa6f0066280 0x7fa6f0068730 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fa6f40099d0 tx=0x7fa6f4004740 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:34.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.675+0000 7fa7017fa640 1 -- 172.21.15.53:0/3432288605 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa6f80516f0 con 0x7fa7040c7a60 2023-06-10T19:05:34.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.835+0000 7fa70b064640 1 -- 172.21.15.53:0/3432288605 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa7040b3cd0 con 0x7fa7040c7a60 2023-06-10T19:05:34.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.835+0000 7fa7017fa640 1 -- 172.21.15.53:0/3432288605 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 1 entries v126) v1 ==== 80+0+56 (secure 0 0 0) 0x7fa6f8054d10 con 0x7fa7040c7a60 2023-06-10T19:05:34.843 INFO:teuthology.orchestra.run.smithi053.stdout:192.168.0.1:0/935434380 2023-06-10T20:05:28.182850+0000 2023-06-10T19:05:34.844 INFO:teuthology.orchestra.run.smithi053.stderr:listed 1 entries 2023-06-10T19:05:34.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.839+0000 7fa70b064640 1 -- 172.21.15.53:0/3432288605 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa6f0066280 msgr2=0x7fa6f0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:34.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.839+0000 7fa70b064640 1 --2- 172.21.15.53:0/3432288605 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa6f0066280 0x7fa6f0068730 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fa6f40099d0 tx=0x7fa6f4004740 comp rx=0 tx=0).stop 2023-06-10T19:05:34.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.839+0000 7fa70b064640 1 -- 172.21.15.53:0/3432288605 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7040c7a60 msgr2=0x7fa7040ad7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:34.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.839+0000 7fa70b064640 1 --2- 172.21.15.53:0/3432288605 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7040c7a60 0x7fa7040ad7b0 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 crypto rx=0x7fa6f8011660 tx=0x7fa6f8011b20 comp rx=0 tx=0).stop 2023-06-10T19:05:34.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.839+0000 7fa70b064640 1 -- 172.21.15.53:0/3432288605 shutdown_connections 2023-06-10T19:05:34.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.839+0000 7fa70b064640 1 --2- 172.21.15.53:0/3432288605 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa6f0066280 0x7fa6f0068730 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:34.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.839+0000 7fa70b064640 1 --2- 172.21.15.53:0/3432288605 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa7040adcf0 0x7fa7040b1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:34.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.839+0000 7fa70b064640 1 --2- 172.21.15.53:0/3432288605 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7040c7a60 0x7fa7040ad7b0 unknown :-1 s=CLOSED pgs=1945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:34.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.839+0000 7fa70b064640 1 --2- 172.21.15.53:0/3432288605 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa704152320 0x7fa7040c7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:34.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.839+0000 7fa70b064640 1 -- 172.21.15.53:0/3432288605 >> 172.21.15.53:0/3432288605 conn(0x7fa7040ce9e0 msgr2=0x7fa7040ca7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:34.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.839+0000 7fa70b064640 1 -- 172.21.15.53:0/3432288605 shutdown_connections 2023-06-10T19:05:34.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:34.839+0000 7fa70b064640 1 -- 172.21.15.53:0/3432288605 wait complete. 2023-06-10T19:05:34.859 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi117.front.sepia.ceph.com... 2023-06-10T19:05:34.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:05:34.859 DEBUG:teuthology.orchestra.run.smithi117:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-06-10T19:05:34.873 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi117.stderr:ceph-fuse[45285]: fuse finished with error 0 and tester_r 0 2023-06-10T19:05:34.875 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi117.front.sepia.ceph.com 2023-06-10T19:05:34.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:05:34.875 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-06-10T19:05:35.015 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T19:05:35.016 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:05:35.022 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16345192k,nr_inodes=4086298,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276544k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=407 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276540k,nr_inodes=819135,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276544k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-06-10T19:05:35.022 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi053.front.sepia.ceph.com 2023-06-10T19:05:35.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:05:35.023 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-06-10T19:05:35.067 INFO:teuthology.orchestra.run.smithi053.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-06-10T19:05:35.068 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-10T19:05:35.069 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T19:05:35.069 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:05:35.075 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16342088k,nr_inodes=4085522,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275924k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18845 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275920k,nr_inodes=818980,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275924k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-06-10T19:05:35.075 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi117.front.sepia.ceph.com 2023-06-10T19:05:35.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:05:35.076 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-06-10T19:05:35.123 INFO:teuthology.orchestra.run.smithi117.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-06-10T19:05:35.124 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-10T19:05:35.125 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:05:35.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.247+0000 7f19fd640640 1 Processor -- start 2023-06-10T19:05:35.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.247+0000 7f19fd640640 1 -- start start 2023-06-10T19:05:35.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.251+0000 7f19fd640640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f19f80c9840 0x7f19f80c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:35.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.251+0000 7f19fd640640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19f806b090 0x7f19f806b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:35.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.251+0000 7f19fd640640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19f8159b50 con 0x7f19f8071060 2023-06-10T19:05:35.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.251+0000 7f19fd640640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19f80ca150 con 0x7f19f80c9840 2023-06-10T19:05:35.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.251+0000 7f19fd640640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19f80702a0 con 0x7f19f806b090 2023-06-10T19:05:35.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.251+0000 7f19f6ffd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f19f80c9840 0x7f19f80c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:35.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.251+0000 7f19f77fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19f806b090 0x7f19f806b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:35.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.251+0000 7f19f67fc640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f19f8071060 0x7f19f80af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.53:48230/0 (socket says 172.21.15.53:48230) 2023-06-10T19:05:35.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.251+0000 7f19f67fc640 1 -- 172.21.15.53:0/2246190302 learned_addr learned my addr 172.21.15.53:0/2246190302 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:05:35.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.251+0000 7f19f77fe640 1 -- 172.21.15.53:0/2246190302 >> v2:172.21.15.117:3300/0 conn(0x7f19f80c9840 msgr2=0x7f19f80c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:35.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.251+0000 7f19f77fe640 1 --2- 172.21.15.53:0/2246190302 >> v2:172.21.15.117:3300/0 conn(0x7f19f80c9840 0x7f19f80c9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:35.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.251+0000 7f19f77fe640 1 -- 172.21.15.53:0/2246190302 >> v1:172.21.15.117:6789/0 conn(0x7f19f8071060 legacy=0x7f19f80af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:35.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.251+0000 7f19f77fe640 1 -- 172.21.15.53:0/2246190302 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19f8070580 con 0x7f19f806b090 2023-06-10T19:05:35.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.255+0000 7f19f77fe640 1 --2- 172.21.15.53:0/2246190302 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19f806b090 0x7f19f806b530 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f19f0009d90 tx=0x7f19f001c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14235a546971b03c server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:35.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.255+0000 7f19f5ffb640 1 -- 172.21.15.53:0/2246190302 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f00a59e0 con 0x7f19f806b090 2023-06-10T19:05:35.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.255+0000 7f19f5ffb640 1 -- 172.21.15.53:0/2246190302 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19f00a5b40 con 0x7f19f806b090 2023-06-10T19:05:35.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.255+0000 7f19f5ffb640 1 -- 172.21.15.53:0/2246190302 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f00ad440 con 0x7f19f806b090 2023-06-10T19:05:35.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.255+0000 7f19fd640640 1 -- 172.21.15.53:0/2246190302 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19f806b090 msgr2=0x7f19f806b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:35.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.255+0000 7f19fd640640 1 --2- 172.21.15.53:0/2246190302 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19f806b090 0x7f19f806b530 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f19f0009d90 tx=0x7f19f001c920 comp rx=0 tx=0).stop 2023-06-10T19:05:35.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.255+0000 7f19fd640640 1 -- 172.21.15.53:0/2246190302 shutdown_connections 2023-06-10T19:05:35.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.255+0000 7f19fd640640 1 --2- 172.21.15.53:0/2246190302 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19f806b090 0x7f19f806b530 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:35.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.255+0000 7f19fd640640 1 --2- 172.21.15.53:0/2246190302 >> v2:172.21.15.117:3300/0 conn(0x7f19f80c9840 0x7f19f80c9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:35.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.255+0000 7f19fd640640 1 -- 172.21.15.53:0/2246190302 >> 172.21.15.53:0/2246190302 conn(0x7f19f806a0d0 msgr2=0x7f19f80ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:35.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.255+0000 7f19fd640640 1 -- 172.21.15.53:0/2246190302 shutdown_connections 2023-06-10T19:05:35.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.255+0000 7f19fd640640 1 -- 172.21.15.53:0/2246190302 wait complete. 2023-06-10T19:05:35.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.255+0000 7f19fd640640 1 Processor -- start 2023-06-10T19:05:35.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.255+0000 7f19fd640640 1 -- start start 2023-06-10T19:05:35.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.259+0000 7f19fd640640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19f806b090 0x7f19f814d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:35.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.259+0000 7f19fd640640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f19f8071060 0x7f19f80b0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:35.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.259+0000 7f19fd640640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19f80c9840 0x7f19f80b1010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:35.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.259+0000 7f19fd640640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f80b2250 con 0x7f19f8071060 2023-06-10T19:05:35.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.259+0000 7f19fd640640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f814d760 con 0x7f19f806b090 2023-06-10T19:05:35.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.259+0000 7f19fd640640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19f80c7540 con 0x7f19f80c9840 2023-06-10T19:05:35.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.259+0000 7f19f67fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f19f8071060 0x7f19f80b0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:35.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.259+0000 7f19f67fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f19f8071060 0x7f19f80b0ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58150/0 (socket says 172.21.15.53:58150) 2023-06-10T19:05:35.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.259+0000 7f19f67fc640 1 -- 172.21.15.53:0/3264151863 learned_addr learned my addr 172.21.15.53:0/3264151863 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:35.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.259+0000 7f19f77fe640 1 --2- 172.21.15.53:0/3264151863 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19f80c9840 0x7f19f80b1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:35.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.259+0000 7f19f6ffd640 1 --2- 172.21.15.53:0/3264151863 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19f806b090 0x7f19f814d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:35.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.259+0000 7f19f67fc640 1 -- 172.21.15.53:0/3264151863 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19f80c9840 msgr2=0x7f19f80b1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:35.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.259+0000 7f19f67fc640 1 --2- 172.21.15.53:0/3264151863 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19f80c9840 0x7f19f80b1010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:35.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.259+0000 7f19f67fc640 1 -- 172.21.15.53:0/3264151863 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19f806b090 msgr2=0x7f19f814d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:35.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.259+0000 7f19f67fc640 1 --2- 172.21.15.53:0/3264151863 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19f806b090 0x7f19f814d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:35.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.259+0000 7f19f67fc640 1 -- 172.21.15.53:0/3264151863 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19f0009a70 con 0x7f19f8071060 2023-06-10T19:05:35.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.259+0000 7f19f77fe640 1 --2- 172.21.15.53:0/3264151863 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19f80c9840 0x7f19f80b1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:05:35.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.259+0000 7f19f6ffd640 1 --2- 172.21.15.53:0/3264151863 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19f806b090 0x7f19f814d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:05:35.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.259+0000 7f19f67fc640 1 --2- 172.21.15.53:0/3264151863 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f19f8071060 0x7f19f80b0ad0 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 crypto rx=0x7f19ec00c4d0 tx=0x7f19ec00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:35.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.259+0000 7f19df7fe640 1 -- 172.21.15.53:0/3264151863 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19ec005cf0 con 0x7f19f8071060 2023-06-10T19:05:35.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.259+0000 7f19df7fe640 1 -- 172.21.15.53:0/3264151863 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19ec005e50 con 0x7f19f8071060 2023-06-10T19:05:35.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.259+0000 7f19df7fe640 1 -- 172.21.15.53:0/3264151863 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19ec007270 con 0x7f19f8071060 2023-06-10T19:05:35.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.259+0000 7f19fd640640 1 -- 172.21.15.53:0/3264151863 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19f80b1640 con 0x7f19f8071060 2023-06-10T19:05:35.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.259+0000 7f19fd640640 1 -- 172.21.15.53:0/3264151863 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19f80b1c00 con 0x7f19f8071060 2023-06-10T19:05:35.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.259+0000 7f19fd640640 1 -- 172.21.15.53:0/3264151863 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19f804d790 con 0x7f19f8071060 2023-06-10T19:05:35.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.259+0000 7f19df7fe640 1 -- 172.21.15.53:0/3264151863 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f19ec0073d0 con 0x7f19f8071060 2023-06-10T19:05:35.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.259+0000 7f19df7fe640 1 --2- 172.21.15.53:0/3264151863 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f19e4066280 0x7f19e4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:35.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.259+0000 7f19df7fe640 1 -- 172.21.15.53:0/3264151863 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6105+0+0 (secure 0 0 0) 0x7f19ec083140 con 0x7f19f8071060 2023-06-10T19:05:35.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.259+0000 7f19f6ffd640 1 --2- 172.21.15.53:0/3264151863 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f19e4066280 0x7f19e4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:35.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.263+0000 7f19f6ffd640 1 --2- 172.21.15.53:0/3264151863 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f19e4066280 0x7f19e4068730 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f19e8009b10 tx=0x7f19e8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:35.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.263+0000 7f19df7fe640 1 -- 172.21.15.53:0/3264151863 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f19ec050650 con 0x7f19f8071060 2023-06-10T19:05:35.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.447+0000 7f19fd640640 1 -- 172.21.15.53:0/3264151863 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f19f80cb140 con 0x7f19f8071060 2023-06-10T19:05:35.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.447+0000 7f19df7fe640 1 -- 172.21.15.53:0/3264151863 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) v1 ==== 94+0+4676 (secure 0 0 0) 0x7f19ec053c70 con 0x7f19f8071060 2023-06-10T19:05:35.453 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:05:35.454 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":69,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7684,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/618082531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":618082531},{"type":"v1","addr":"172.21.15.117:6835","nonce":618082531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":7687,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3984577716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":3984577716},{"type":"v1","addr":"172.21.15.117:6837","nonce":3984577716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":9144,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/3202804884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3202804884},{"type":"v1","addr":"172.21.15.53:6833","nonce":3202804884}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:05:04.878347+0000","modified":"2023-06-10T19:05:07.051606+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9147},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9147":{"gid":9147,"name":"c","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/3233917972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":3233917972},{"type":"v1","addr":"172.21.15.53:6835","nonce":3233917972}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-06-10T19:05:35.454 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 69 2023-06-10T19:05:35.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.451+0000 7f19fd640640 1 -- 172.21.15.53:0/3264151863 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f19e4066280 msgr2=0x7f19e4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:35.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.451+0000 7f19fd640640 1 --2- 172.21.15.53:0/3264151863 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f19e4066280 0x7f19e4068730 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f19e8009b10 tx=0x7f19e8008040 comp rx=0 tx=0).stop 2023-06-10T19:05:35.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.451+0000 7f19fd640640 1 -- 172.21.15.53:0/3264151863 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f19f8071060 msgr2=0x7f19f80b0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:35.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.451+0000 7f19fd640640 1 --2- 172.21.15.53:0/3264151863 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f19f8071060 0x7f19f80b0ad0 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 crypto rx=0x7f19ec00c4d0 tx=0x7f19ec00c990 comp rx=0 tx=0).stop 2023-06-10T19:05:35.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.451+0000 7f19fd640640 1 -- 172.21.15.53:0/3264151863 shutdown_connections 2023-06-10T19:05:35.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.451+0000 7f19fd640640 1 --2- 172.21.15.53:0/3264151863 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f19e4066280 0x7f19e4068730 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:35.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.451+0000 7f19fd640640 1 --2- 172.21.15.53:0/3264151863 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19f80c9840 0x7f19f80b1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:35.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.451+0000 7f19fd640640 1 --2- 172.21.15.53:0/3264151863 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f19f8071060 0x7f19f80b0ad0 unknown :-1 s=CLOSED pgs=1946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:35.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.451+0000 7f19fd640640 1 --2- 172.21.15.53:0/3264151863 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19f806b090 0x7f19f814d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:35.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.451+0000 7f19fd640640 1 -- 172.21.15.53:0/3264151863 >> 172.21.15.53:0/3264151863 conn(0x7f19f806a0d0 msgr2=0x7f19f8157480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:35.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.451+0000 7f19fd640640 1 -- 172.21.15.53:0/3264151863 shutdown_connections 2023-06-10T19:05:35.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.451+0000 7f19fd640640 1 -- 172.21.15.53:0/3264151863 wait complete. 2023-06-10T19:05:35.472 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:05:35.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.579+0000 7f6bcf011640 1 Processor -- start 2023-06-10T19:05:35.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.579+0000 7f6bcf011640 1 -- start start 2023-06-10T19:05:35.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.579+0000 7f6bcf011640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6bc80cec40 0x7f6bc80cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:35.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.579+0000 7f6bcf011640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6bc80cbf50 0x7f6bc80cc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:35.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.579+0000 7f6bcf011640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bc80cbac0 con 0x7f6bc8159450 2023-06-10T19:05:35.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.579+0000 7f6bcf011640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bc80cf600 con 0x7f6bc80cec40 2023-06-10T19:05:35.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.579+0000 7f6bcf011640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc815dc00 con 0x7f6bc80cbf50 2023-06-10T19:05:35.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.583+0000 7f6bc7fff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6bc80cec40 0x7f6bc80cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:35.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.583+0000 7f6bcd5ae640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6bc80cbf50 0x7f6bc80cc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:35.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.583+0000 7f6bccdad640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f6bc8159450 0x7f6bc815d140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.53:48246/0 (socket says 172.21.15.53:48246) 2023-06-10T19:05:35.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.583+0000 7f6bccdad640 1 -- 172.21.15.53:0/838953044 learned_addr learned my addr 172.21.15.53:0/838953044 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:05:35.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.583+0000 7f6bcd5ae640 1 -- 172.21.15.53:0/838953044 >> v2:172.21.15.117:3300/0 conn(0x7f6bc80cec40 msgr2=0x7f6bc80cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:35.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.583+0000 7f6bcd5ae640 1 --2- 172.21.15.53:0/838953044 >> v2:172.21.15.117:3300/0 conn(0x7f6bc80cec40 0x7f6bc80cf0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:35.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.583+0000 7f6bcd5ae640 1 -- 172.21.15.53:0/838953044 >> v1:172.21.15.117:6789/0 conn(0x7f6bc8159450 legacy=0x7f6bc815d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:35.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.583+0000 7f6bcd5ae640 1 -- 172.21.15.53:0/838953044 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc815dee0 con 0x7f6bc80cbf50 2023-06-10T19:05:35.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.583+0000 7f6bc7fff640 1 --2- 172.21.15.53:0/838953044 >> v2:172.21.15.117:3300/0 conn(0x7f6bc80cec40 0x7f6bc80cf0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-10T19:05:35.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.583+0000 7f6bcd5ae640 1 --2- 172.21.15.53:0/838953044 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6bc80cbf50 0x7f6bc80cc3d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6bb80097c0 tx=0x7f6bb801c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=219feeb30f613e88 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:35.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.583+0000 7f6bc77fe640 1 -- 172.21.15.53:0/838953044 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb80ab610 con 0x7f6bc80cbf50 2023-06-10T19:05:35.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.583+0000 7f6bc77fe640 1 -- 172.21.15.53:0/838953044 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bb80ab770 con 0x7f6bc80cbf50 2023-06-10T19:05:35.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.583+0000 7f6bc77fe640 1 -- 172.21.15.53:0/838953044 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb80abb00 con 0x7f6bc80cbf50 2023-06-10T19:05:35.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.583+0000 7f6bcf011640 1 -- 172.21.15.53:0/838953044 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6bc80cbf50 msgr2=0x7f6bc80cc3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:35.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.583+0000 7f6bcf011640 1 --2- 172.21.15.53:0/838953044 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6bc80cbf50 0x7f6bc80cc3d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6bb80097c0 tx=0x7f6bb801c450 comp rx=0 tx=0).stop 2023-06-10T19:05:35.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.583+0000 7f6bcf011640 1 -- 172.21.15.53:0/838953044 shutdown_connections 2023-06-10T19:05:35.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.583+0000 7f6bcf011640 1 --2- 172.21.15.53:0/838953044 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6bc80cbf50 0x7f6bc80cc3d0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:35.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.583+0000 7f6bcf011640 1 --2- 172.21.15.53:0/838953044 >> v2:172.21.15.117:3300/0 conn(0x7f6bc80cec40 0x7f6bc80cf0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:35.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.583+0000 7f6bcf011640 1 -- 172.21.15.53:0/838953044 >> 172.21.15.53:0/838953044 conn(0x7f6bc806a090 msgr2=0x7f6bc806d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:35.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.587+0000 7f6bcf011640 1 -- 172.21.15.53:0/838953044 shutdown_connections 2023-06-10T19:05:35.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.587+0000 7f6bcf011640 1 -- 172.21.15.53:0/838953044 wait complete. 2023-06-10T19:05:35.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.587+0000 7f6bcf011640 1 Processor -- start 2023-06-10T19:05:35.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.587+0000 7f6bcf011640 1 -- start start 2023-06-10T19:05:35.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.587+0000 7f6bcf011640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6bc80cbf50 0x7f6bc814e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:35.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.587+0000 7f6bcf011640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6bc80cec40 0x7f6bc8155910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:35.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.587+0000 7f6bcf011640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6bc8159450 0x7f6bc80b3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:35.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.587+0000 7f6bcf011640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc8151110 con 0x7f6bc80cec40 2023-06-10T19:05:35.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.587+0000 7f6bcf011640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc814ecc0 con 0x7f6bc8159450 2023-06-10T19:05:35.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.587+0000 7f6bcf011640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc8156240 con 0x7f6bc80cbf50 2023-06-10T19:05:35.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.587+0000 7f6bc7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6bc80cec40 0x7f6bc8155910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:35.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.587+0000 7f6bc7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6bc80cec40 0x7f6bc8155910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58156/0 (socket says 172.21.15.53:58156) 2023-06-10T19:05:35.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.587+0000 7f6bc7fff640 1 -- 172.21.15.53:0/521275203 learned_addr learned my addr 172.21.15.53:0/521275203 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:35.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.587+0000 7f6bccdad640 1 --2- 172.21.15.53:0/521275203 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6bc80cbf50 0x7f6bc814e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:35.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.587+0000 7f6bcd5ae640 1 --2- 172.21.15.53:0/521275203 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6bc8159450 0x7f6bc80b3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:35.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.587+0000 7f6bc7fff640 1 -- 172.21.15.53:0/521275203 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6bc80cbf50 msgr2=0x7f6bc814e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:35.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.587+0000 7f6bc7fff640 1 --2- 172.21.15.53:0/521275203 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6bc80cbf50 0x7f6bc814e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:35.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.587+0000 7f6bc7fff640 1 -- 172.21.15.53:0/521275203 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6bc8159450 msgr2=0x7f6bc80b3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:35.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.587+0000 7f6bc7fff640 1 --2- 172.21.15.53:0/521275203 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6bc8159450 0x7f6bc80b3f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:35.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.587+0000 7f6bc7fff640 1 -- 172.21.15.53:0/521275203 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb4009a70 con 0x7f6bc80cec40 2023-06-10T19:05:35.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.587+0000 7f6bc7fff640 1 --2- 172.21.15.53:0/521275203 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6bc80cec40 0x7f6bc8155910 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 crypto rx=0x7f6bb400efc0 tx=0x7f6bb400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:35.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.587+0000 7f6bc57fa640 1 -- 172.21.15.53:0/521275203 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb4014680 con 0x7f6bc80cec40 2023-06-10T19:05:35.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.587+0000 7f6bc57fa640 1 -- 172.21.15.53:0/521275203 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bb400f040 con 0x7f6bc80cec40 2023-06-10T19:05:35.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.587+0000 7f6bcf011640 1 -- 172.21.15.53:0/521275203 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bb8009420 con 0x7f6bc80cec40 2023-06-10T19:05:35.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.587+0000 7f6bc57fa640 1 -- 172.21.15.53:0/521275203 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb4014a00 con 0x7f6bc80cec40 2023-06-10T19:05:35.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.587+0000 7f6bcf011640 1 -- 172.21.15.53:0/521275203 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bc815d9d0 con 0x7f6bc80cec40 2023-06-10T19:05:35.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.587+0000 7f6bcf011640 1 -- 172.21.15.53:0/521275203 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bc804d790 con 0x7f6bc80cec40 2023-06-10T19:05:35.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.591+0000 7f6bc57fa640 1 -- 172.21.15.53:0/521275203 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6bb4014b60 con 0x7f6bc80cec40 2023-06-10T19:05:35.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.591+0000 7f6bc57fa640 1 --2- 172.21.15.53:0/521275203 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6bb0066280 0x7f6bb0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:35.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.591+0000 7f6bc57fa640 1 -- 172.21.15.53:0/521275203 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6105+0+0 (secure 0 0 0) 0x7f6bb4084cf0 con 0x7f6bc80cec40 2023-06-10T19:05:35.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.591+0000 7f6bccdad640 1 --2- 172.21.15.53:0/521275203 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6bb0066280 0x7f6bb0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:35.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.591+0000 7f6bccdad640 1 --2- 172.21.15.53:0/521275203 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6bb0066280 0x7f6bb0068730 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f6bc0000f70 tx=0x7f6bc0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:35.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.595+0000 7f6bc57fa640 1 -- 172.21.15.53:0/521275203 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6bb4089070 con 0x7f6bc80cec40 2023-06-10T19:05:35.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.747+0000 7f6bcf011640 1 -- 172.21.15.53:0/521275203 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6bc806df70 con 0x7f6bc80cec40 2023-06-10T19:05:35.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.747+0000 7f6bc57fa640 1 -- 172.21.15.53:0/521275203 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v126) v1 ==== 74+0+18408 (secure 0 0 0) 0x7f6bb40521d0 con 0x7f6bc80cec40 2023-06-10T19:05:35.755 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:05:35.755 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":126,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:05:29.141776+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-06-10T19:05:02.560833+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-06-10T19:05:03.863586+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.0.1:0/935434380":"2023-06-10T20:05:28.182850+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:05:35.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.751+0000 7f6bcf011640 1 -- 172.21.15.53:0/521275203 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6bb0066280 msgr2=0x7f6bb0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:35.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.751+0000 7f6bcf011640 1 --2- 172.21.15.53:0/521275203 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6bb0066280 0x7f6bb0068730 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f6bc0000f70 tx=0x7f6bc0009040 comp rx=0 tx=0).stop 2023-06-10T19:05:35.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.751+0000 7f6bcf011640 1 -- 172.21.15.53:0/521275203 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6bc80cec40 msgr2=0x7f6bc8155910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:35.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.751+0000 7f6bcf011640 1 --2- 172.21.15.53:0/521275203 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6bc80cec40 0x7f6bc8155910 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 crypto rx=0x7f6bb400efc0 tx=0x7f6bb400c490 comp rx=0 tx=0).stop 2023-06-10T19:05:35.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.751+0000 7f6bcf011640 1 -- 172.21.15.53:0/521275203 shutdown_connections 2023-06-10T19:05:35.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.751+0000 7f6bcf011640 1 --2- 172.21.15.53:0/521275203 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6bb0066280 0x7f6bb0068730 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:35.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.751+0000 7f6bcf011640 1 --2- 172.21.15.53:0/521275203 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6bc8159450 0x7f6bc80b3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:35.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.751+0000 7f6bcf011640 1 --2- 172.21.15.53:0/521275203 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6bc80cec40 0x7f6bc8155910 unknown :-1 s=CLOSED pgs=1947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:35.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.751+0000 7f6bcf011640 1 --2- 172.21.15.53:0/521275203 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6bc80cbf50 0x7f6bc814e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:35.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.751+0000 7f6bcf011640 1 -- 172.21.15.53:0/521275203 >> 172.21.15.53:0/521275203 conn(0x7f6bc806a090 msgr2=0x7f6bc80b10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:35.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.751+0000 7f6bcf011640 1 -- 172.21.15.53:0/521275203 shutdown_connections 2023-06-10T19:05:35.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.751+0000 7f6bcf011640 1 -- 172.21.15.53:0/521275203 wait complete. 2023-06-10T19:05:35.774 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-10T18:52:33.633114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-10T18:52:39.171487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-10T19:05:02.560833+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '124', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2023-06-10T19:05:03.863586+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '125', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-10T19:05:35.775 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-10T19:05:35.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.895+0000 7f19ec03a640 1 Processor -- start 2023-06-10T19:05:35.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.895+0000 7f19ec03a640 1 -- start start 2023-06-10T19:05:35.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.895+0000 7f19ec03a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f19e415c090 0x7f19e40b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:35.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.895+0000 7f19ec03a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f19e40b7e30 0x7f19e40d04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:35.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.895+0000 7f19ec03a640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19e40cc7c0 con 0x7f19e40b0b90 2023-06-10T19:05:35.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.895+0000 7f19ec03a640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19e40ccaa0 con 0x7f19e40b7e30 2023-06-10T19:05:35.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.895+0000 7f19ec03a640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19e40ccd80 con 0x7f19e415c090 2023-06-10T19:05:35.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.895+0000 7f19e95d5640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f19e40b0b90 0x7f19e40b7720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60310/0 (socket says 172.21.15.53:60310) 2023-06-10T19:05:35.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.895+0000 7f19e95d5640 1 -- 172.21.15.53:0/3168649680 learned_addr learned my addr 172.21.15.53:0/3168649680 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:05:35.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.895+0000 7f19ea5d7640 1 --2- 172.21.15.53:0/3168649680 >> v2:172.21.15.53:3300/0 conn(0x7f19e40b7e30 0x7f19e40d04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:35.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.895+0000 7f19e9dd6640 1 --2- 172.21.15.53:0/3168649680 >> v2:172.21.15.117:3300/0 conn(0x7f19e415c090 0x7f19e40b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:35.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.895+0000 7f19e8dd4640 1 -- 172.21.15.53:0/3168649680 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2312638705 0 0) 0x7f19e40cc7c0 con 0x7f19e40b0b90 2023-06-10T19:05:35.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.895+0000 7f19e8dd4640 1 -- 172.21.15.53:0/3168649680 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19d0003530 con 0x7f19e40b0b90 2023-06-10T19:05:35.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.895+0000 7f19ea5d7640 1 -- 172.21.15.53:0/3168649680 >> v2:172.21.15.117:3300/0 conn(0x7f19e415c090 msgr2=0x7f19e40b10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:35.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.895+0000 7f19ea5d7640 1 --2- 172.21.15.53:0/3168649680 >> v2:172.21.15.117:3300/0 conn(0x7f19e415c090 0x7f19e40b10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:35.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.895+0000 7f19ea5d7640 1 -- 172.21.15.53:0/3168649680 >> v1:172.21.15.53:6789/0 conn(0x7f19e40b0b90 legacy=0x7f19e40b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:35.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.895+0000 7f19e8dd4640 1 -- 172.21.15.53:0/3168649680 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1442897942 0 0) 0x7f19d0003530 con 0x7f19e40b0b90 2023-06-10T19:05:35.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.895+0000 7f19ea5d7640 1 -- 172.21.15.53:0/3168649680 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19e40cd060 con 0x7f19e40b7e30 2023-06-10T19:05:35.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.899+0000 7f19ea5d7640 1 --2- 172.21.15.53:0/3168649680 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f19e40b7e30 0x7f19e40d04d0 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 crypto rx=0x7f19e408a080 tx=0x7f19dc01c770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26e2568f8fb91f2a server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:35.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.899+0000 7f19e8dd4640 1 -- 172.21.15.53:0/3168649680 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d40016a0 con 0x7f19e40b7e30 2023-06-10T19:05:35.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.899+0000 7f19e8dd4640 1 -- 172.21.15.53:0/3168649680 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19dc0a5510 con 0x7f19e40b7e30 2023-06-10T19:05:35.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.899+0000 7f19e8dd4640 1 -- 172.21.15.53:0/3168649680 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19dc0a58a0 con 0x7f19e40b7e30 2023-06-10T19:05:35.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.899+0000 7f19ec03a640 1 -- 172.21.15.53:0/3168649680 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f19e40b7e30 msgr2=0x7f19e40d04d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:35.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.899+0000 7f19ec03a640 1 --2- 172.21.15.53:0/3168649680 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f19e40b7e30 0x7f19e40d04d0 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 crypto rx=0x7f19e408a080 tx=0x7f19dc01c770 comp rx=0 tx=0).stop 2023-06-10T19:05:35.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.899+0000 7f19ec03a640 1 -- 172.21.15.53:0/3168649680 shutdown_connections 2023-06-10T19:05:35.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.899+0000 7f19ec03a640 1 --2- 172.21.15.53:0/3168649680 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f19e40b7e30 0x7f19e40d04d0 unknown :-1 s=CLOSED pgs=1949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:35.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.899+0000 7f19ec03a640 1 --2- 172.21.15.53:0/3168649680 >> v2:172.21.15.117:3300/0 conn(0x7f19e415c090 0x7f19e40b10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:35.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.899+0000 7f19ec03a640 1 -- 172.21.15.53:0/3168649680 >> 172.21.15.53:0/3168649680 conn(0x7f19e4069e20 msgr2=0x7f19e406a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:35.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.899+0000 7f19ec03a640 1 -- 172.21.15.53:0/3168649680 shutdown_connections 2023-06-10T19:05:35.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.899+0000 7f19ec03a640 1 -- 172.21.15.53:0/3168649680 wait complete. 2023-06-10T19:05:35.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.899+0000 7f19ec03a640 1 Processor -- start 2023-06-10T19:05:35.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.899+0000 7f19ec03a640 1 -- start start 2023-06-10T19:05:35.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.899+0000 7f19ec03a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19e40b0b90 0x7f19e4146730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:35.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.899+0000 7f19ec03a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19e40b7e30 0x7f19e40ce8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:35.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.899+0000 7f19ec03a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f19e415c090 0x7f19e40cee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:35.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.899+0000 7f19ec03a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19e4151c50 con 0x7f19e415c090 2023-06-10T19:05:35.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.899+0000 7f19ec03a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19e4151f30 con 0x7f19e40b0b90 2023-06-10T19:05:35.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.899+0000 7f19ec03a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19e4152210 con 0x7f19e40b7e30 2023-06-10T19:05:35.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.899+0000 7f19ea5d7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f19e415c090 0x7f19e40cee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:35.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.899+0000 7f19ea5d7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f19e415c090 0x7f19e40cee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58186/0 (socket says 172.21.15.53:58186) 2023-06-10T19:05:35.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.899+0000 7f19ea5d7640 1 -- 172.21.15.53:0/718862331 learned_addr learned my addr 172.21.15.53:0/718862331 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:35.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.899+0000 7f19e9dd6640 1 --2- 172.21.15.53:0/718862331 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19e40b0b90 0x7f19e4146730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:35.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.899+0000 7f19e95d5640 1 --2- 172.21.15.53:0/718862331 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19e40b7e30 0x7f19e40ce8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:35.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.899+0000 7f19ea5d7640 1 -- 172.21.15.53:0/718862331 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19e40b7e30 msgr2=0x7f19e40ce8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:35.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.899+0000 7f19ea5d7640 1 --2- 172.21.15.53:0/718862331 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19e40b7e30 0x7f19e40ce8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:35.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.899+0000 7f19ea5d7640 1 -- 172.21.15.53:0/718862331 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19e40b0b90 msgr2=0x7f19e4146730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:35.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.899+0000 7f19ea5d7640 1 --2- 172.21.15.53:0/718862331 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19e40b0b90 0x7f19e4146730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:35.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.899+0000 7f19ea5d7640 1 -- 172.21.15.53:0/718862331 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19dc009a70 con 0x7f19e415c090 2023-06-10T19:05:35.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.899+0000 7f19ea5d7640 1 --2- 172.21.15.53:0/718862331 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f19e415c090 0x7f19e40cee10 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 crypto rx=0x7f19dc01a3a0 tx=0x7f19dc019510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:35.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.903+0000 7f19da7fc640 1 -- 172.21.15.53:0/718862331 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19dc0b9650 con 0x7f19e415c090 2023-06-10T19:05:35.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.903+0000 7f19da7fc640 1 -- 172.21.15.53:0/718862331 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19dc0b97b0 con 0x7f19e415c090 2023-06-10T19:05:35.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.903+0000 7f19ec03a640 1 -- 172.21.15.53:0/718862331 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19e41524f0 con 0x7f19e415c090 2023-06-10T19:05:35.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.903+0000 7f19da7fc640 1 -- 172.21.15.53:0/718862331 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19dc0b9b60 con 0x7f19e415c090 2023-06-10T19:05:35.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.903+0000 7f19ec03a640 1 -- 172.21.15.53:0/718862331 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19e4150fd0 con 0x7f19e415c090 2023-06-10T19:05:35.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.903+0000 7f19ec03a640 1 -- 172.21.15.53:0/718862331 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19e404d790 con 0x7f19e415c090 2023-06-10T19:05:35.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.903+0000 7f19da7fc640 1 -- 172.21.15.53:0/718862331 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f19dc0b9cc0 con 0x7f19e415c090 2023-06-10T19:05:35.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.903+0000 7f19da7fc640 1 --2- 172.21.15.53:0/718862331 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f19c8066280 0x7f19c8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:35.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.903+0000 7f19da7fc640 1 -- 172.21.15.53:0/718862331 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6105+0+0 (secure 0 0 0) 0x7f19dc11eea0 con 0x7f19e415c090 2023-06-10T19:05:35.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.903+0000 7f19e9dd6640 1 --2- 172.21.15.53:0/718862331 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f19c8066280 0x7f19c8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:35.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.903+0000 7f19e9dd6640 1 --2- 172.21.15.53:0/718862331 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f19c8066280 0x7f19c8068730 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f19e0009a50 tx=0x7f19e0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:35.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:35.907+0000 7f19da7fc640 1 -- 172.21.15.53:0/718862331 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f19dc0ec410 con 0x7f19e415c090 2023-06-10T19:05:36.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.059+0000 7f19ec03a640 1 -- 172.21.15.53:0/718862331 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f19e40b72f0 con 0x7f19e415c090 2023-06-10T19:05:36.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.063+0000 7f19da7fc640 1 -- 172.21.15.53:0/718862331 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v126) v1 ==== 93+0+10 (secure 0 0 0) 0x7f19dc0b2020 con 0x7f19e415c090 2023-06-10T19:05:36.067 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-06-10T19:05:36.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.063+0000 7f19ec03a640 1 -- 172.21.15.53:0/718862331 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f19c8066280 msgr2=0x7f19c8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:36.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.063+0000 7f19ec03a640 1 --2- 172.21.15.53:0/718862331 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f19c8066280 0x7f19c8068730 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f19e0009a50 tx=0x7f19e0008040 comp rx=0 tx=0).stop 2023-06-10T19:05:36.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.063+0000 7f19ec03a640 1 -- 172.21.15.53:0/718862331 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f19e415c090 msgr2=0x7f19e40cee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:36.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.063+0000 7f19ec03a640 1 --2- 172.21.15.53:0/718862331 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f19e415c090 0x7f19e40cee10 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 crypto rx=0x7f19dc01a3a0 tx=0x7f19dc019510 comp rx=0 tx=0).stop 2023-06-10T19:05:36.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.063+0000 7f19ec03a640 1 -- 172.21.15.53:0/718862331 shutdown_connections 2023-06-10T19:05:36.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.063+0000 7f19ec03a640 1 --2- 172.21.15.53:0/718862331 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f19c8066280 0x7f19c8068730 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:36.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.063+0000 7f19ec03a640 1 --2- 172.21.15.53:0/718862331 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f19e415c090 0x7f19e40cee10 unknown :-1 s=CLOSED pgs=1950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:36.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.063+0000 7f19ec03a640 1 --2- 172.21.15.53:0/718862331 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19e40b7e30 0x7f19e40ce8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:36.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.063+0000 7f19ec03a640 1 --2- 172.21.15.53:0/718862331 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19e40b0b90 0x7f19e4146730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:36.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.063+0000 7f19ec03a640 1 -- 172.21.15.53:0/718862331 >> 172.21.15.53:0/718862331 conn(0x7f19e4069e20 msgr2=0x7f19e415a6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:36.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.063+0000 7f19ec03a640 1 -- 172.21.15.53:0/718862331 shutdown_connections 2023-06-10T19:05:36.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.063+0000 7f19ec03a640 1 -- 172.21.15.53:0/718862331 wait complete. 2023-06-10T19:05:36.087 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-10T19:05:36.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.203+0000 7fe5fd733640 1 Processor -- start 2023-06-10T19:05:36.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.203+0000 7fe5fd733640 1 -- start start 2023-06-10T19:05:36.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.203+0000 7fe5fd733640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5f80b06d0 0x7fe5f806a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:36.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.203+0000 7fe5fd733640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5f806ae70 con 0x7fe5f815f450 2023-06-10T19:05:36.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.203+0000 7fe5fd733640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5f80655c0 con 0x7fe5f815b870 2023-06-10T19:05:36.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.203+0000 7fe5fd733640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f80cc110 con 0x7fe5f80b06d0 2023-06-10T19:05:36.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.203+0000 7fe5f77fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fe5f815f450 0x7fe5f815f8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60316/0 (socket says 172.21.15.53:60316) 2023-06-10T19:05:36.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.203+0000 7fe5f77fe640 1 -- 172.21.15.53:0/1187720697 learned_addr learned my addr 172.21.15.53:0/1187720697 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:05:36.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.203+0000 7fe5f67fc640 1 --2- 172.21.15.53:0/1187720697 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5f80b06d0 0x7fe5f806a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:36.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.203+0000 7fe5f67fc640 1 -- 172.21.15.53:0/1187720697 >> v1:172.21.15.117:6789/0 conn(0x7fe5f815b870 legacy=0x7fe5f80affc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:36.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.203+0000 7fe5f67fc640 1 -- 172.21.15.53:0/1187720697 >> v1:172.21.15.53:6789/0 conn(0x7fe5f815f450 legacy=0x7fe5f815f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:36.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.203+0000 7fe5f67fc640 1 -- 172.21.15.53:0/1187720697 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5f80cc3f0 con 0x7fe5f80b06d0 2023-06-10T19:05:36.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.207+0000 7fe5f67fc640 1 --2- 172.21.15.53:0/1187720697 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5f80b06d0 0x7fe5f806a930 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec0097f0 tx=0x7fe5ec01c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=241883d1fa8b3907 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:36.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.207+0000 7fe5f5ffb640 1 -- 172.21.15.53:0/1187720697 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5ec0ab600 con 0x7fe5f80b06d0 2023-06-10T19:05:36.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.211+0000 7fe5f5ffb640 1 -- 172.21.15.53:0/1187720697 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5ec0a7050 con 0x7fe5f80b06d0 2023-06-10T19:05:36.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.211+0000 7fe5f5ffb640 1 -- 172.21.15.53:0/1187720697 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5ec0ab980 con 0x7fe5f80b06d0 2023-06-10T19:05:36.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.211+0000 7fe5fd733640 1 -- 172.21.15.53:0/1187720697 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5f80b06d0 msgr2=0x7fe5f806a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:36.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.211+0000 7fe5fd733640 1 --2- 172.21.15.53:0/1187720697 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5f80b06d0 0x7fe5f806a930 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec0097f0 tx=0x7fe5ec01c370 comp rx=0 tx=0).stop 2023-06-10T19:05:36.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.211+0000 7fe5fd733640 1 -- 172.21.15.53:0/1187720697 shutdown_connections 2023-06-10T19:05:36.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.211+0000 7fe5fd733640 1 --2- 172.21.15.53:0/1187720697 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5f80b06d0 0x7fe5f806a930 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:36.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.211+0000 7fe5fd733640 1 -- 172.21.15.53:0/1187720697 >> 172.21.15.53:0/1187720697 conn(0x7fe5f80cafc0 msgr2=0x7fe5f80cb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:36.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.211+0000 7fe5fd733640 1 -- 172.21.15.53:0/1187720697 shutdown_connections 2023-06-10T19:05:36.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.211+0000 7fe5fd733640 1 -- 172.21.15.53:0/1187720697 wait complete. 2023-06-10T19:05:36.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.211+0000 7fe5fd733640 1 Processor -- start 2023-06-10T19:05:36.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.211+0000 7fe5fd733640 1 -- start start 2023-06-10T19:05:36.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.211+0000 7fe5fd733640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5f80b06d0 0x7fe5f806fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:36.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.211+0000 7fe5fd733640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe5f815b870 0x7fe5f814f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:36.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.211+0000 7fe5fd733640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5f815f450 0x7fe5f814f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:36.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.211+0000 7fe5fd733640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f80c4550 con 0x7fe5f815b870 2023-06-10T19:05:36.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.211+0000 7fe5fd733640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f80c4b00 con 0x7fe5f815f450 2023-06-10T19:05:36.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.211+0000 7fe5fd733640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f80c4de0 con 0x7fe5f80b06d0 2023-06-10T19:05:36.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.211+0000 7fe5f67fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe5f815b870 0x7fe5f814f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:36.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.211+0000 7fe5f6ffd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5f80b06d0 0x7fe5f806fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:36.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.211+0000 7fe5f6ffd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5f80b06d0 0x7fe5f806fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.53:44716/0 (socket says 172.21.15.53:44716) 2023-06-10T19:05:36.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.211+0000 7fe5f6ffd640 1 -- 172.21.15.53:0/3056263931 learned_addr learned my addr 172.21.15.53:0/3056263931 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:36.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.211+0000 7fe5f67fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe5f815b870 0x7fe5f814f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58198/0 (socket says 172.21.15.53:58198) 2023-06-10T19:05:36.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.211+0000 7fe5f77fe640 1 --2- 172.21.15.53:0/3056263931 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5f815f450 0x7fe5f814f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:36.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.211+0000 7fe5f67fc640 1 -- 172.21.15.53:0/3056263931 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5f80b06d0 msgr2=0x7fe5f806fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:36.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.211+0000 7fe5f67fc640 1 --2- 172.21.15.53:0/3056263931 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5f80b06d0 0x7fe5f806fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:36.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.211+0000 7fe5f67fc640 1 -- 172.21.15.53:0/3056263931 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5f815f450 msgr2=0x7fe5f814f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:36.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.211+0000 7fe5f67fc640 1 --2- 172.21.15.53:0/3056263931 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5f815f450 0x7fe5f814f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:36.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.211+0000 7fe5f67fc640 1 -- 172.21.15.53:0/3056263931 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5ec009420 con 0x7fe5f815b870 2023-06-10T19:05:36.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.211+0000 7fe5f67fc640 1 --2- 172.21.15.53:0/3056263931 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe5f815b870 0x7fe5f814f3c0 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec0ab000 tx=0x7fe5ec019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:36.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.211+0000 7fe5df7fe640 1 -- 172.21.15.53:0/3056263931 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5ec0b4840 con 0x7fe5f815b870 2023-06-10T19:05:36.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.211+0000 7fe5df7fe640 1 -- 172.21.15.53:0/3056263931 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5ec0b49a0 con 0x7fe5f815b870 2023-06-10T19:05:36.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.211+0000 7fe5fd733640 1 -- 172.21.15.53:0/3056263931 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5f815e830 con 0x7fe5f815b870 2023-06-10T19:05:36.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.211+0000 7fe5df7fe640 1 -- 172.21.15.53:0/3056263931 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5ec0b4d50 con 0x7fe5f815b870 2023-06-10T19:05:36.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.211+0000 7fe5fd733640 1 -- 172.21.15.53:0/3056263931 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5f8070020 con 0x7fe5f815b870 2023-06-10T19:05:36.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.215+0000 7fe5fd733640 1 -- 172.21.15.53:0/3056263931 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5f804d790 con 0x7fe5f815b870 2023-06-10T19:05:36.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.215+0000 7fe5df7fe640 1 -- 172.21.15.53:0/3056263931 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe5ec0b2040 con 0x7fe5f815b870 2023-06-10T19:05:36.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.215+0000 7fe5df7fe640 1 --2- 172.21.15.53:0/3056263931 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe5e4066280 0x7fe5e4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:36.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.215+0000 7fe5df7fe640 1 -- 172.21.15.53:0/3056263931 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6105+0+0 (secure 0 0 0) 0x7fe5ec11de90 con 0x7fe5f815b870 2023-06-10T19:05:36.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.215+0000 7fe5f6ffd640 1 --2- 172.21.15.53:0/3056263931 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe5e4066280 0x7fe5e4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:36.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.215+0000 7fe5f6ffd640 1 --2- 172.21.15.53:0/3056263931 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe5e4066280 0x7fe5e4068730 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fe5f0007fd0 tx=0x7fe5f0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:36.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.219+0000 7fe5df7fe640 1 -- 172.21.15.53:0/3056263931 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe5ec0eb420 con 0x7fe5f815b870 2023-06-10T19:05:36.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.367+0000 7fe5fd733640 1 -- 172.21.15.53:0/3056263931 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe5f815ece0 con 0x7fe5f815b870 2023-06-10T19:05:36.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.367+0000 7fe5df7fe640 1 -- 172.21.15.53:0/3056263931 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v126) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe5ec0b00a0 con 0x7fe5f815b870 2023-06-10T19:05:36.373 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-06-10T19:05:36.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.371+0000 7fe5fd733640 1 -- 172.21.15.53:0/3056263931 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe5e4066280 msgr2=0x7fe5e4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:36.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.371+0000 7fe5fd733640 1 --2- 172.21.15.53:0/3056263931 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe5e4066280 0x7fe5e4068730 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fe5f0007fd0 tx=0x7fe5f0009040 comp rx=0 tx=0).stop 2023-06-10T19:05:36.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.371+0000 7fe5fd733640 1 -- 172.21.15.53:0/3056263931 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe5f815b870 msgr2=0x7fe5f814f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:36.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.371+0000 7fe5fd733640 1 --2- 172.21.15.53:0/3056263931 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe5f815b870 0x7fe5f814f3c0 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec0ab000 tx=0x7fe5ec019110 comp rx=0 tx=0).stop 2023-06-10T19:05:36.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.371+0000 7fe5fd733640 1 -- 172.21.15.53:0/3056263931 shutdown_connections 2023-06-10T19:05:36.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.371+0000 7fe5fd733640 1 --2- 172.21.15.53:0/3056263931 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe5e4066280 0x7fe5e4068730 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:36.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.371+0000 7fe5fd733640 1 --2- 172.21.15.53:0/3056263931 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5f815f450 0x7fe5f814f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:36.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.371+0000 7fe5fd733640 1 --2- 172.21.15.53:0/3056263931 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe5f815b870 0x7fe5f814f3c0 unknown :-1 s=CLOSED pgs=1952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:36.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.371+0000 7fe5fd733640 1 --2- 172.21.15.53:0/3056263931 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5f80b06d0 0x7fe5f806fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:36.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.371+0000 7fe5fd733640 1 -- 172.21.15.53:0/3056263931 >> 172.21.15.53:0/3056263931 conn(0x7fe5f80cafc0 msgr2=0x7fe5f80affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:36.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.371+0000 7fe5fd733640 1 -- 172.21.15.53:0/3056263931 shutdown_connections 2023-06-10T19:05:36.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.371+0000 7fe5fd733640 1 -- 172.21.15.53:0/3056263931 wait complete. 2023-06-10T19:05:36.391 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-10T19:05:36.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.499+0000 7fc0716ae640 1 Processor -- start 2023-06-10T19:05:36.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.499+0000 7fc0716ae640 1 -- start start 2023-06-10T19:05:36.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.503+0000 7fc0716ae640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc06c0cf0c0 0x7fc06c0cc660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:36.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.503+0000 7fc0716ae640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc06c0cbac0 con 0x7fc06c0cec40 2023-06-10T19:05:36.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.503+0000 7fc0716ae640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc06c15dc00 con 0x7fc06c159450 2023-06-10T19:05:36.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.503+0000 7fc0716ae640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc06c15dee0 con 0x7fc06c0cf0c0 2023-06-10T19:05:36.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.503+0000 7fc063fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fc06c0cec40 0x7fc06c0cbf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60320/0 (socket says 172.21.15.53:60320) 2023-06-10T19:05:36.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.503+0000 7fc06b7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc06c0cf0c0 0x7fc06c0cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:36.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.503+0000 7fc063fff640 1 -- 172.21.15.53:0/3772200502 learned_addr learned my addr 172.21.15.53:0/3772200502 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:05:36.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.503+0000 7fc06b7fe640 1 -- 172.21.15.53:0/3772200502 >> v1:172.21.15.117:6789/0 conn(0x7fc06c159450 legacy=0x7fc06c15d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:36.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.503+0000 7fc06b7fe640 1 -- 172.21.15.53:0/3772200502 >> v1:172.21.15.53:6789/0 conn(0x7fc06c0cec40 legacy=0x7fc06c0cbf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:36.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.503+0000 7fc06a7fc640 1 -- 172.21.15.53:0/3772200502 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1249611906 0 0) 0x7fc06c0cbac0 con 0x7fc06c0cec40 2023-06-10T19:05:36.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.503+0000 7fc06b7fe640 1 -- 172.21.15.53:0/3772200502 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc06c0cb750 con 0x7fc06c0cf0c0 2023-06-10T19:05:36.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.503+0000 7fc06b7fe640 1 --2- 172.21.15.53:0/3772200502 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc06c0cf0c0 0x7fc06c0cc660 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 crypto rx=0x7fc064009d90 tx=0x7fc06401c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3611655307e17dc0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:36.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.503+0000 7fc06a7fc640 1 -- 172.21.15.53:0/3772200502 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0640a5970 con 0x7fc06c0cf0c0 2023-06-10T19:05:36.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.503+0000 7fc06a7fc640 1 -- 172.21.15.53:0/3772200502 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0640a5ad0 con 0x7fc06c0cf0c0 2023-06-10T19:05:36.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.503+0000 7fc06a7fc640 1 -- 172.21.15.53:0/3772200502 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0640a5e60 con 0x7fc06c0cf0c0 2023-06-10T19:05:36.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.507+0000 7fc0716ae640 1 -- 172.21.15.53:0/3772200502 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc06c0cf0c0 msgr2=0x7fc06c0cc660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:36.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.507+0000 7fc0716ae640 1 --2- 172.21.15.53:0/3772200502 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc06c0cf0c0 0x7fc06c0cc660 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 crypto rx=0x7fc064009d90 tx=0x7fc06401c8f0 comp rx=0 tx=0).stop 2023-06-10T19:05:36.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.507+0000 7fc0716ae640 1 -- 172.21.15.53:0/3772200502 shutdown_connections 2023-06-10T19:05:36.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.507+0000 7fc0716ae640 1 --2- 172.21.15.53:0/3772200502 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc06c0cf0c0 0x7fc06c0cc660 unknown :-1 s=CLOSED pgs=1954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:36.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.507+0000 7fc0716ae640 1 -- 172.21.15.53:0/3772200502 >> 172.21.15.53:0/3772200502 conn(0x7fc06c06a090 msgr2=0x7fc06c06d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:36.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.507+0000 7fc0716ae640 1 -- 172.21.15.53:0/3772200502 shutdown_connections 2023-06-10T19:05:36.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.507+0000 7fc0716ae640 1 -- 172.21.15.53:0/3772200502 wait complete. 2023-06-10T19:05:36.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.507+0000 7fc0716ae640 1 Processor -- start 2023-06-10T19:05:36.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.507+0000 7fc0716ae640 1 -- start start 2023-06-10T19:05:36.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.507+0000 7fc0716ae640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc06c0cec40 0x7fc06c163c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:36.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.507+0000 7fc0716ae640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc06c0cf0c0 0x7fc06c152830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:36.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.507+0000 7fc0716ae640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc06c159450 0x7fc06c0cbf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:36.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.507+0000 7fc0716ae640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc06c162b60 con 0x7fc06c0cec40 2023-06-10T19:05:36.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.507+0000 7fc0716ae640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc06c162e40 con 0x7fc06c159450 2023-06-10T19:05:36.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.507+0000 7fc0716ae640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc06c163120 con 0x7fc06c0cf0c0 2023-06-10T19:05:36.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.507+0000 7fc06affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc06c0cec40 0x7fc06c163c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:36.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.507+0000 7fc06affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc06c0cec40 0x7fc06c163c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58224/0 (socket says 172.21.15.53:58224) 2023-06-10T19:05:36.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.507+0000 7fc06affd640 1 -- 172.21.15.53:0/317758970 learned_addr learned my addr 172.21.15.53:0/317758970 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:36.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.507+0000 7fc06b7fe640 1 --2- 172.21.15.53:0/317758970 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc06c159450 0x7fc06c0cbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:36.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.507+0000 7fc06affd640 1 -- 172.21.15.53:0/317758970 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc06c0cf0c0 msgr2=0x7fc06c152830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:36.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.507+0000 7fc063fff640 1 --2- 172.21.15.53:0/317758970 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc06c0cf0c0 0x7fc06c152830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:36.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.507+0000 7fc06affd640 1 --2- 172.21.15.53:0/317758970 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc06c0cf0c0 0x7fc06c152830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:36.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.507+0000 7fc06affd640 1 -- 172.21.15.53:0/317758970 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc06c159450 msgr2=0x7fc06c0cbf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:36.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.507+0000 7fc06affd640 1 --2- 172.21.15.53:0/317758970 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc06c159450 0x7fc06c0cbf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:36.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.507+0000 7fc06affd640 1 -- 172.21.15.53:0/317758970 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc064009a70 con 0x7fc06c0cec40 2023-06-10T19:05:36.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.507+0000 7fc06affd640 1 --2- 172.21.15.53:0/317758970 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc06c0cec40 0x7fc06c163c00 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 crypto rx=0x7fc05c00c3c0 tx=0x7fc05c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:36.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.507+0000 7fc0637fe640 1 -- 172.21.15.53:0/317758970 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05c0052d0 con 0x7fc06c0cec40 2023-06-10T19:05:36.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.507+0000 7fc0637fe640 1 -- 172.21.15.53:0/317758970 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc05c005430 con 0x7fc06c0cec40 2023-06-10T19:05:36.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.507+0000 7fc0637fe640 1 -- 172.21.15.53:0/317758970 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05c003840 con 0x7fc06c0cec40 2023-06-10T19:05:36.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.507+0000 7fc0716ae640 1 -- 172.21.15.53:0/317758970 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc06c15d9d0 con 0x7fc06c0cec40 2023-06-10T19:05:36.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.507+0000 7fc0716ae640 1 -- 172.21.15.53:0/317758970 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc06c1636e0 con 0x7fc06c0cec40 2023-06-10T19:05:36.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.511+0000 7fc0716ae640 1 -- 172.21.15.53:0/317758970 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc06c04d790 con 0x7fc06c0cec40 2023-06-10T19:05:36.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.511+0000 7fc0637fe640 1 -- 172.21.15.53:0/317758970 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc05c0039a0 con 0x7fc06c0cec40 2023-06-10T19:05:36.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.511+0000 7fc0637fe640 1 --2- 172.21.15.53:0/317758970 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc04c066280 0x7fc04c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:36.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.511+0000 7fc0637fe640 1 -- 172.21.15.53:0/317758970 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6105+0+0 (secure 0 0 0) 0x7fc05c0833d0 con 0x7fc06c0cec40 2023-06-10T19:05:36.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.511+0000 7fc063fff640 1 --2- 172.21.15.53:0/317758970 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc04c066280 0x7fc04c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:36.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.511+0000 7fc063fff640 1 --2- 172.21.15.53:0/317758970 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc04c066280 0x7fc04c068730 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fc06c06bd00 tx=0x7fc054009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:36.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.515+0000 7fc0637fe640 1 -- 172.21.15.53:0/317758970 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc05c0506f0 con 0x7fc06c0cec40 2023-06-10T19:05:36.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.667+0000 7fc0716ae640 1 -- 172.21.15.53:0/317758970 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc06c1652c0 con 0x7fc06c0cec40 2023-06-10T19:05:36.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.667+0000 7fc0637fe640 1 -- 172.21.15.53:0/317758970 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v126) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc05c053d10 con 0x7fc06c0cec40 2023-06-10T19:05:36.676 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-06-10T19:05:36.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.671+0000 7fc0716ae640 1 -- 172.21.15.53:0/317758970 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc04c066280 msgr2=0x7fc04c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:36.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.671+0000 7fc0716ae640 1 --2- 172.21.15.53:0/317758970 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc04c066280 0x7fc04c068730 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fc06c06bd00 tx=0x7fc054009040 comp rx=0 tx=0).stop 2023-06-10T19:05:36.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.671+0000 7fc0716ae640 1 -- 172.21.15.53:0/317758970 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc06c0cec40 msgr2=0x7fc06c163c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:36.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.671+0000 7fc0716ae640 1 --2- 172.21.15.53:0/317758970 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc06c0cec40 0x7fc06c163c00 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 crypto rx=0x7fc05c00c3c0 tx=0x7fc05c00c880 comp rx=0 tx=0).stop 2023-06-10T19:05:36.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.671+0000 7fc0716ae640 1 -- 172.21.15.53:0/317758970 shutdown_connections 2023-06-10T19:05:36.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.671+0000 7fc0716ae640 1 --2- 172.21.15.53:0/317758970 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc04c066280 0x7fc04c068730 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:36.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.671+0000 7fc0716ae640 1 --2- 172.21.15.53:0/317758970 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc06c159450 0x7fc06c0cbf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:36.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.671+0000 7fc0716ae640 1 --2- 172.21.15.53:0/317758970 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc06c0cf0c0 0x7fc06c152830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:36.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.671+0000 7fc0716ae640 1 --2- 172.21.15.53:0/317758970 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc06c0cec40 0x7fc06c163c00 unknown :-1 s=CLOSED pgs=1955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:36.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.671+0000 7fc0716ae640 1 -- 172.21.15.53:0/317758970 >> 172.21.15.53:0/317758970 conn(0x7fc06c06a090 msgr2=0x7fc06c06d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:36.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.671+0000 7fc0716ae640 1 -- 172.21.15.53:0/317758970 shutdown_connections 2023-06-10T19:05:36.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.671+0000 7fc0716ae640 1 -- 172.21.15.53:0/317758970 wait complete. 2023-06-10T19:05:36.692 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-10T19:05:36.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.807+0000 7fa7c9f3a640 1 Processor -- start 2023-06-10T19:05:36.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.811+0000 7fa7c9f3a640 1 -- start start 2023-06-10T19:05:36.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.811+0000 7fa7c9f3a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa7c4070de0 0x7fa7c415cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:36.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.811+0000 7fa7c9f3a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7c40cc020 0x7fa7c406bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:36.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.811+0000 7fa7c9f3a640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7c40c8d50 con 0x7fa7c415c060 2023-06-10T19:05:36.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.811+0000 7fa7c9f3a640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7c40c9030 con 0x7fa7c4070de0 2023-06-10T19:05:36.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.811+0000 7fa7c9f3a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c4070300 con 0x7fa7c40cc020 2023-06-10T19:05:36.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.811+0000 7fa7c3fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7c40cc020 0x7fa7c406bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:36.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.811+0000 7fa7c2ffd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa7c4070de0 0x7fa7c415cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:36.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.811+0000 7fa7c3fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7c40cc020 0x7fa7c406bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.53:44726/0 (socket says 172.21.15.53:44726) 2023-06-10T19:05:36.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.811+0000 7fa7c3fff640 1 -- 172.21.15.53:0/747135247 learned_addr learned my addr 172.21.15.53:0/747135247 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:36.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.811+0000 7fa7c3fff640 1 -- 172.21.15.53:0/747135247 >> v2:172.21.15.117:3300/0 conn(0x7fa7c4070de0 msgr2=0x7fa7c415cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:36.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.811+0000 7fa7c3fff640 1 --2- 172.21.15.53:0/747135247 >> v2:172.21.15.117:3300/0 conn(0x7fa7c4070de0 0x7fa7c415cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:36.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.811+0000 7fa7c3fff640 1 -- 172.21.15.53:0/747135247 >> v1:172.21.15.117:6789/0 conn(0x7fa7c415c060 legacy=0x7fa7c415c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:36.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.811+0000 7fa7c3fff640 1 -- 172.21.15.53:0/747135247 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7c40705e0 con 0x7fa7c40cc020 2023-06-10T19:05:36.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.815+0000 7fa7c3fff640 1 --2- 172.21.15.53:0/747135247 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7c40cc020 0x7fa7c406bd80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc00d150 tx=0x7fa7bc01eb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f186a5d7b7dffab server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:36.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.815+0000 7fa7c27fc640 1 -- 172.21.15.53:0/747135247 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7bc00b2d0 con 0x7fa7c40cc020 2023-06-10T19:05:36.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.815+0000 7fa7c27fc640 1 -- 172.21.15.53:0/747135247 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7bc00b430 con 0x7fa7c40cc020 2023-06-10T19:05:36.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.815+0000 7fa7c27fc640 1 -- 172.21.15.53:0/747135247 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7bc0a7b50 con 0x7fa7c40cc020 2023-06-10T19:05:36.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.815+0000 7fa7c9f3a640 1 -- 172.21.15.53:0/747135247 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7c40cc020 msgr2=0x7fa7c406bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:36.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.815+0000 7fa7c9f3a640 1 --2- 172.21.15.53:0/747135247 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7c40cc020 0x7fa7c406bd80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc00d150 tx=0x7fa7bc01eb50 comp rx=0 tx=0).stop 2023-06-10T19:05:36.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.815+0000 7fa7c9f3a640 1 -- 172.21.15.53:0/747135247 shutdown_connections 2023-06-10T19:05:36.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.815+0000 7fa7c9f3a640 1 --2- 172.21.15.53:0/747135247 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7c40cc020 0x7fa7c406bd80 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:36.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.815+0000 7fa7c9f3a640 1 --2- 172.21.15.53:0/747135247 >> v2:172.21.15.117:3300/0 conn(0x7fa7c4070de0 0x7fa7c415cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:36.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.815+0000 7fa7c9f3a640 1 -- 172.21.15.53:0/747135247 >> 172.21.15.53:0/747135247 conn(0x7fa7c406a0e0 msgr2=0x7fa7c40cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:36.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.815+0000 7fa7c9f3a640 1 -- 172.21.15.53:0/747135247 shutdown_connections 2023-06-10T19:05:36.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.815+0000 7fa7c9f3a640 1 -- 172.21.15.53:0/747135247 wait complete. 2023-06-10T19:05:36.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.815+0000 7fa7c9f3a640 1 Processor -- start 2023-06-10T19:05:36.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.815+0000 7fa7c9f3a640 1 -- start start 2023-06-10T19:05:36.824 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.819+0000 7fa7c9f3a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7c4070de0 0x7fa7c414b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:36.824 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.819+0000 7fa7c9f3a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7c40cc020 0x7fa7c40b2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:36.824 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.819+0000 7fa7c9f3a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa7c415c060 0x7fa7c40c5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:36.824 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.819+0000 7fa7c9f3a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c40b3a10 con 0x7fa7c4070de0 2023-06-10T19:05:36.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.819+0000 7fa7c9f3a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c40b3730 con 0x7fa7c415c060 2023-06-10T19:05:36.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.819+0000 7fa7c9f3a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c40b1650 con 0x7fa7c40cc020 2023-06-10T19:05:36.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.819+0000 7fa7c37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7c4070de0 0x7fa7c414b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:36.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.819+0000 7fa7c37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7c4070de0 0x7fa7c414b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58240/0 (socket says 172.21.15.53:58240) 2023-06-10T19:05:36.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.819+0000 7fa7c37fe640 1 -- 172.21.15.53:0/1849715857 learned_addr learned my addr 172.21.15.53:0/1849715857 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:36.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.819+0000 7fa7c2ffd640 1 --2- 172.21.15.53:0/1849715857 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7c40cc020 0x7fa7c40b2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:36.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.819+0000 7fa7c3fff640 1 --2- 172.21.15.53:0/1849715857 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa7c415c060 0x7fa7c40c5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:36.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.819+0000 7fa7c37fe640 1 -- 172.21.15.53:0/1849715857 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7c40cc020 msgr2=0x7fa7c40b2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:36.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.819+0000 7fa7c37fe640 1 --2- 172.21.15.53:0/1849715857 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7c40cc020 0x7fa7c40b2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:36.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.819+0000 7fa7c37fe640 1 -- 172.21.15.53:0/1849715857 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa7c415c060 msgr2=0x7fa7c40c5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:36.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.819+0000 7fa7c37fe640 1 --2- 172.21.15.53:0/1849715857 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa7c415c060 0x7fa7c40c5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:36.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.819+0000 7fa7c37fe640 1 -- 172.21.15.53:0/1849715857 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7bc00bd40 con 0x7fa7c4070de0 2023-06-10T19:05:36.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.819+0000 7fa7c3fff640 1 --2- 172.21.15.53:0/1849715857 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa7c415c060 0x7fa7c40c5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:05:36.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.819+0000 7fa7c37fe640 1 --2- 172.21.15.53:0/1849715857 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7c4070de0 0x7fa7c414b790 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 crypto rx=0x7fa7b400c420 tx=0x7fa7b400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:36.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.819+0000 7fa7abfff640 1 -- 172.21.15.53:0/1849715857 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b40052d0 con 0x7fa7c4070de0 2023-06-10T19:05:36.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.819+0000 7fa7abfff640 1 -- 172.21.15.53:0/1849715857 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7b4005430 con 0x7fa7c4070de0 2023-06-10T19:05:36.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.819+0000 7fa7abfff640 1 -- 172.21.15.53:0/1849715857 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b4007260 con 0x7fa7c4070de0 2023-06-10T19:05:36.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.819+0000 7fa7c9f3a640 1 -- 172.21.15.53:0/1849715857 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7c40b1930 con 0x7fa7c4070de0 2023-06-10T19:05:36.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.819+0000 7fa7c9f3a640 1 -- 172.21.15.53:0/1849715857 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7c40c2a50 con 0x7fa7c4070de0 2023-06-10T19:05:36.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.819+0000 7fa7c9f3a640 1 -- 172.21.15.53:0/1849715857 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7c404d790 con 0x7fa7c4070de0 2023-06-10T19:05:36.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.819+0000 7fa7abfff640 1 -- 172.21.15.53:0/1849715857 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa7b40073c0 con 0x7fa7c4070de0 2023-06-10T19:05:36.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.819+0000 7fa7abfff640 1 --2- 172.21.15.53:0/1849715857 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa7b0066280 0x7fa7b0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:36.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.819+0000 7fa7abfff640 1 -- 172.21.15.53:0/1849715857 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6105+0+0 (secure 0 0 0) 0x7fa7b40830d0 con 0x7fa7c4070de0 2023-06-10T19:05:36.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.819+0000 7fa7c2ffd640 1 --2- 172.21.15.53:0/1849715857 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa7b0066280 0x7fa7b0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:36.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.823+0000 7fa7c2ffd640 1 --2- 172.21.15.53:0/1849715857 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa7b0066280 0x7fa7b0068730 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fa7c415bf60 tx=0x7fa7b8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:36.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.823+0000 7fa7abfff640 1 -- 172.21.15.53:0/1849715857 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa7b40505b0 con 0x7fa7c4070de0 2023-06-10T19:05:36.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.983+0000 7fa7c9f3a640 1 -- 172.21.15.53:0/1849715857 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa7c40b3c60 con 0x7fa7c4070de0 2023-06-10T19:05:36.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.983+0000 7fa7abfff640 1 -- 172.21.15.53:0/1849715857 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v126) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa7b4053bd0 con 0x7fa7c4070de0 2023-06-10T19:05:36.988 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-06-10T19:05:36.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.983+0000 7fa7c9f3a640 1 -- 172.21.15.53:0/1849715857 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa7b0066280 msgr2=0x7fa7b0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:36.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.983+0000 7fa7c9f3a640 1 --2- 172.21.15.53:0/1849715857 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa7b0066280 0x7fa7b0068730 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fa7c415bf60 tx=0x7fa7b8008040 comp rx=0 tx=0).stop 2023-06-10T19:05:36.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.983+0000 7fa7c9f3a640 1 -- 172.21.15.53:0/1849715857 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7c4070de0 msgr2=0x7fa7c414b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:36.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.983+0000 7fa7c9f3a640 1 --2- 172.21.15.53:0/1849715857 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7c4070de0 0x7fa7c414b790 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 crypto rx=0x7fa7b400c420 tx=0x7fa7b400c8e0 comp rx=0 tx=0).stop 2023-06-10T19:05:36.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.983+0000 7fa7c9f3a640 1 -- 172.21.15.53:0/1849715857 shutdown_connections 2023-06-10T19:05:36.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.983+0000 7fa7c9f3a640 1 --2- 172.21.15.53:0/1849715857 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa7b0066280 0x7fa7b0068730 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:36.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.983+0000 7fa7c9f3a640 1 --2- 172.21.15.53:0/1849715857 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa7c415c060 0x7fa7c40c5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:36.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.983+0000 7fa7c9f3a640 1 --2- 172.21.15.53:0/1849715857 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa7c40cc020 0x7fa7c40b2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:36.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.983+0000 7fa7c9f3a640 1 --2- 172.21.15.53:0/1849715857 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7c4070de0 0x7fa7c414b790 unknown :-1 s=CLOSED pgs=1956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:36.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.983+0000 7fa7c9f3a640 1 -- 172.21.15.53:0/1849715857 >> 172.21.15.53:0/1849715857 conn(0x7fa7c406a0e0 msgr2=0x7fa7c41563a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:36.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.983+0000 7fa7c9f3a640 1 -- 172.21.15.53:0/1849715857 shutdown_connections 2023-06-10T19:05:36.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:36.983+0000 7fa7c9f3a640 1 -- 172.21.15.53:0/1849715857 wait complete. 2023-06-10T19:05:37.008 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:05:37.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.123+0000 7ffa8b467640 1 Processor -- start 2023-06-10T19:05:37.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.127+0000 7ffa8b467640 1 -- start start 2023-06-10T19:05:37.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.127+0000 7ffa8b467640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa8415b870 0x7ffa8406a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:37.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.127+0000 7ffa8b467640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ffa840b03f0 0x7ffa84069b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:37.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.127+0000 7ffa8b467640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa8406ae70 con 0x7ffa840affc0 2023-06-10T19:05:37.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.127+0000 7ffa8b467640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa840655c0 con 0x7ffa840b03f0 2023-06-10T19:05:37.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.127+0000 7ffa8b467640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa840cc110 con 0x7ffa8415b870 2023-06-10T19:05:37.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.127+0000 7ffa89a04640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ffa840b03f0 0x7ffa84069b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:37.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.127+0000 7ffa88a02640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7ffa840affc0 0x7ffa84069450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.53:48272/0 (socket says 172.21.15.53:48272) 2023-06-10T19:05:37.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.127+0000 7ffa89a04640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ffa840b03f0 0x7ffa84069b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.53:57742/0 (socket says 172.21.15.53:57742) 2023-06-10T19:05:37.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.127+0000 7ffa88a02640 1 -- 172.21.15.53:0/2394932898 learned_addr learned my addr 172.21.15.53:0/2394932898 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:05:37.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.127+0000 7ffa89203640 1 --2- 172.21.15.53:0/2394932898 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa8415b870 0x7ffa8406a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:37.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.127+0000 7ffa89203640 1 -- 172.21.15.53:0/2394932898 >> v2:172.21.15.117:3300/0 conn(0x7ffa840b03f0 msgr2=0x7ffa84069b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:37.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.127+0000 7ffa89203640 1 --2- 172.21.15.53:0/2394932898 >> v2:172.21.15.117:3300/0 conn(0x7ffa840b03f0 0x7ffa84069b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:37.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.127+0000 7ffa89203640 1 -- 172.21.15.53:0/2394932898 >> v1:172.21.15.117:6789/0 conn(0x7ffa840affc0 legacy=0x7ffa84069450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:37.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.127+0000 7ffa89203640 1 -- 172.21.15.53:0/2394932898 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa840cc3f0 con 0x7ffa8415b870 2023-06-10T19:05:37.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.131+0000 7ffa89203640 1 --2- 172.21.15.53:0/2394932898 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa8415b870 0x7ffa8406a930 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c009d90 tx=0x7ffa7c01c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=692b183c73ddab1c server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:37.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.131+0000 7ffa7bfff640 1 -- 172.21.15.53:0/2394932898 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c0a5850 con 0x7ffa8415b870 2023-06-10T19:05:37.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.131+0000 7ffa7bfff640 1 -- 172.21.15.53:0/2394932898 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa7c0a59b0 con 0x7ffa8415b870 2023-06-10T19:05:37.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.131+0000 7ffa7bfff640 1 -- 172.21.15.53:0/2394932898 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c0a5d40 con 0x7ffa8415b870 2023-06-10T19:05:37.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.131+0000 7ffa8b467640 1 -- 172.21.15.53:0/2394932898 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa8415b870 msgr2=0x7ffa8406a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:37.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.131+0000 7ffa8b467640 1 --2- 172.21.15.53:0/2394932898 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa8415b870 0x7ffa8406a930 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c009d90 tx=0x7ffa7c01c890 comp rx=0 tx=0).stop 2023-06-10T19:05:37.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.131+0000 7ffa8b467640 1 -- 172.21.15.53:0/2394932898 shutdown_connections 2023-06-10T19:05:37.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.131+0000 7ffa8b467640 1 --2- 172.21.15.53:0/2394932898 >> v2:172.21.15.117:3300/0 conn(0x7ffa840b03f0 0x7ffa84069b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:37.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.131+0000 7ffa8b467640 1 --2- 172.21.15.53:0/2394932898 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa8415b870 0x7ffa8406a930 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:37.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.131+0000 7ffa8b467640 1 -- 172.21.15.53:0/2394932898 >> 172.21.15.53:0/2394932898 conn(0x7ffa840cafc0 msgr2=0x7ffa840cb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:37.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.131+0000 7ffa8b467640 1 -- 172.21.15.53:0/2394932898 shutdown_connections 2023-06-10T19:05:37.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.131+0000 7ffa8b467640 1 -- 172.21.15.53:0/2394932898 wait complete. 2023-06-10T19:05:37.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.131+0000 7ffa8b467640 1 Processor -- start 2023-06-10T19:05:37.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.131+0000 7ffa8b467640 1 -- start start 2023-06-10T19:05:37.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.131+0000 7ffa8b467640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa840affc0 0x7ffa84152ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:37.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.131+0000 7ffa8b467640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa840b03f0 0x7ffa84149530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:37.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.135+0000 7ffa8b467640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa8415b870 0x7ffa84154b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:37.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.135+0000 7ffa8b467640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8414be60 con 0x7ffa8415b870 2023-06-10T19:05:37.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.135+0000 7ffa8b467640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa840c84f0 con 0x7ffa840affc0 2023-06-10T19:05:37.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.135+0000 7ffa8b467640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa84149a70 con 0x7ffa840b03f0 2023-06-10T19:05:37.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.135+0000 7ffa89a04640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa8415b870 0x7ffa84154b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:37.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.135+0000 7ffa89a04640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa8415b870 0x7ffa84154b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58250/0 (socket says 172.21.15.53:58250) 2023-06-10T19:05:37.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.135+0000 7ffa89a04640 1 -- 172.21.15.53:0/3258943896 learned_addr learned my addr 172.21.15.53:0/3258943896 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:37.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.135+0000 7ffa88a02640 1 --2- 172.21.15.53:0/3258943896 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa840b03f0 0x7ffa84149530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:37.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.135+0000 7ffa89203640 1 --2- 172.21.15.53:0/3258943896 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa840affc0 0x7ffa84152ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:37.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.135+0000 7ffa89a04640 1 -- 172.21.15.53:0/3258943896 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa840b03f0 msgr2=0x7ffa84149530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:37.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.135+0000 7ffa89a04640 1 --2- 172.21.15.53:0/3258943896 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa840b03f0 0x7ffa84149530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:37.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.135+0000 7ffa89a04640 1 -- 172.21.15.53:0/3258943896 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa840affc0 msgr2=0x7ffa84152ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:37.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.135+0000 7ffa89a04640 1 --2- 172.21.15.53:0/3258943896 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa840affc0 0x7ffa84152ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:37.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.135+0000 7ffa89a04640 1 -- 172.21.15.53:0/3258943896 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa7c009a70 con 0x7ffa8415b870 2023-06-10T19:05:37.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.135+0000 7ffa89203640 1 --2- 172.21.15.53:0/3258943896 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa840affc0 0x7ffa84152ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:05:37.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.135+0000 7ffa89a04640 1 --2- 172.21.15.53:0/3258943896 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa8415b870 0x7ffa84154b00 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 crypto rx=0x7ffa8000e7f0 tx=0x7ffa8000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:37.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.135+0000 7ffa79ffb640 1 -- 172.21.15.53:0/3258943896 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa80009530 con 0x7ffa8415b870 2023-06-10T19:05:37.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.135+0000 7ffa79ffb640 1 -- 172.21.15.53:0/3258943896 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa8000eea0 con 0x7ffa8415b870 2023-06-10T19:05:37.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.135+0000 7ffa8b467640 1 -- 172.21.15.53:0/3258943896 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa8414c330 con 0x7ffa8415b870 2023-06-10T19:05:37.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.135+0000 7ffa79ffb640 1 -- 172.21.15.53:0/3258943896 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa8000cb60 con 0x7ffa8415b870 2023-06-10T19:05:37.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.135+0000 7ffa8b467640 1 -- 172.21.15.53:0/3258943896 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa84154300 con 0x7ffa8415b870 2023-06-10T19:05:37.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.135+0000 7ffa8b467640 1 -- 172.21.15.53:0/3258943896 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa8404d790 con 0x7ffa8415b870 2023-06-10T19:05:37.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.135+0000 7ffa79ffb640 1 -- 172.21.15.53:0/3258943896 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ffa8000ccc0 con 0x7ffa8415b870 2023-06-10T19:05:37.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.135+0000 7ffa79ffb640 1 --2- 172.21.15.53:0/3258943896 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ffa68066280 0x7ffa68068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:37.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.135+0000 7ffa79ffb640 1 -- 172.21.15.53:0/3258943896 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6105+0+0 (secure 0 0 0) 0x7ffa80083e90 con 0x7ffa8415b870 2023-06-10T19:05:37.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.135+0000 7ffa89203640 1 --2- 172.21.15.53:0/3258943896 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ffa68066280 0x7ffa68068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:37.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.139+0000 7ffa89203640 1 --2- 172.21.15.53:0/3258943896 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ffa68066280 0x7ffa68068730 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c0af000 tx=0x7ffa7c0a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:37.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.139+0000 7ffa79ffb640 1 -- 172.21.15.53:0/3258943896 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ffa800512e0 con 0x7ffa8415b870 2023-06-10T19:05:37.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.327+0000 7ffa8b467640 1 -- 172.21.15.53:0/3258943896 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffa840b44c0 con 0x7ffa8415b870 2023-06-10T19:05:37.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.331+0000 7ffa79ffb640 1 -- 172.21.15.53:0/3258943896 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) v1 ==== 94+0+4676 (secure 0 0 0) 0x7ffa80017090 con 0x7ffa8415b870 2023-06-10T19:05:37.336 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:05:37.336 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":69,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7684,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/618082531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":618082531},{"type":"v1","addr":"172.21.15.117:6835","nonce":618082531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":7687,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3984577716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":3984577716},{"type":"v1","addr":"172.21.15.117:6837","nonce":3984577716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":9144,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/3202804884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3202804884},{"type":"v1","addr":"172.21.15.53:6833","nonce":3202804884}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:05:04.878347+0000","modified":"2023-06-10T19:05:07.051606+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9147},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9147":{"gid":9147,"name":"c","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/3233917972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":3233917972},{"type":"v1","addr":"172.21.15.53:6835","nonce":3233917972}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-06-10T19:05:37.338 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 69 2023-06-10T19:05:37.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.331+0000 7ffa8b467640 1 -- 172.21.15.53:0/3258943896 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ffa68066280 msgr2=0x7ffa68068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:37.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.331+0000 7ffa8b467640 1 --2- 172.21.15.53:0/3258943896 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ffa68066280 0x7ffa68068730 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c0af000 tx=0x7ffa7c0a7070 comp rx=0 tx=0).stop 2023-06-10T19:05:37.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.331+0000 7ffa8b467640 1 -- 172.21.15.53:0/3258943896 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa8415b870 msgr2=0x7ffa84154b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:37.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.331+0000 7ffa8b467640 1 --2- 172.21.15.53:0/3258943896 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa8415b870 0x7ffa84154b00 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 crypto rx=0x7ffa8000e7f0 tx=0x7ffa8000ecb0 comp rx=0 tx=0).stop 2023-06-10T19:05:37.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.331+0000 7ffa8b467640 1 -- 172.21.15.53:0/3258943896 shutdown_connections 2023-06-10T19:05:37.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.331+0000 7ffa8b467640 1 --2- 172.21.15.53:0/3258943896 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ffa68066280 0x7ffa68068730 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:37.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.331+0000 7ffa8b467640 1 --2- 172.21.15.53:0/3258943896 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa8415b870 0x7ffa84154b00 unknown :-1 s=CLOSED pgs=1957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:37.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.331+0000 7ffa8b467640 1 --2- 172.21.15.53:0/3258943896 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa840b03f0 0x7ffa84149530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:37.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.331+0000 7ffa8b467640 1 --2- 172.21.15.53:0/3258943896 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa840affc0 0x7ffa84152ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:37.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.331+0000 7ffa8b467640 1 -- 172.21.15.53:0/3258943896 >> 172.21.15.53:0/3258943896 conn(0x7ffa840cafc0 msgr2=0x7ffa841539a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:37.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.331+0000 7ffa8b467640 1 -- 172.21.15.53:0/3258943896 shutdown_connections 2023-06-10T19:05:37.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.331+0000 7ffa8b467640 1 -- 172.21.15.53:0/3258943896 wait complete. 2023-06-10T19:05:37.354 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:05:37.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.463+0000 7ff9434fa640 1 Processor -- start 2023-06-10T19:05:37.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.463+0000 7ff9434fa640 1 -- start start 2023-06-10T19:05:37.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.467+0000 7ff9434fa640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff93c0c8d00 0x7ff93c06b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:37.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.467+0000 7ff9434fa640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff93c158a90 con 0x7ff93c06bc00 2023-06-10T19:05:37.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.467+0000 7ff9434fa640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff93c06f780 con 0x7ff93c06b2f0 2023-06-10T19:05:37.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.467+0000 7ff9434fa640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff93c0705d0 con 0x7ff93c0c8d00 2023-06-10T19:05:37.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.467+0000 7ff941a97640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ff93c06bc00 0x7ff93c162180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60336/0 (socket says 172.21.15.53:60336) 2023-06-10T19:05:37.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.467+0000 7ff941a97640 1 -- 172.21.15.53:0/4243743161 learned_addr learned my addr 172.21.15.53:0/4243743161 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:05:37.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.467+0000 7ff933fff640 1 -- 172.21.15.53:0/4243743161 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 480005012 0 0) 0x7ff9340014a0 con 0x7ff93c06bc00 2023-06-10T19:05:37.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.467+0000 7ff940a95640 1 --2- 172.21.15.53:0/4243743161 >> v2:172.21.15.117:3300/0 conn(0x7ff93c0c8d00 0x7ff93c06b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:37.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.467+0000 7ff933fff640 1 -- 172.21.15.53:0/4243743161 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff928005740 con 0x7ff93c06bc00 2023-06-10T19:05:37.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.467+0000 7ff933fff640 1 -- 172.21.15.53:0/4243743161 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1422431823 0 0) 0x7ff928005740 con 0x7ff93c06bc00 2023-06-10T19:05:37.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.467+0000 7ff933fff640 1 -- 172.21.15.53:0/4243743161 >> v2:172.21.15.117:3300/0 conn(0x7ff93c0c8d00 msgr2=0x7ff93c06b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:37.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.467+0000 7ff933fff640 1 --2- 172.21.15.53:0/4243743161 >> v2:172.21.15.117:3300/0 conn(0x7ff93c0c8d00 0x7ff93c06b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:37.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.467+0000 7ff933fff640 1 -- 172.21.15.53:0/4243743161 >> v1:172.21.15.117:6789/0 conn(0x7ff93c06b2f0 legacy=0x7ff93c06f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:37.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.467+0000 7ff933fff640 1 -- 172.21.15.53:0/4243743161 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff93c0cce10 con 0x7ff93c06bc00 2023-06-10T19:05:37.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.467+0000 7ff933fff640 1 -- 172.21.15.53:0/4243743161 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7ff934001b90 con 0x7ff93c06bc00 2023-06-10T19:05:37.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.467+0000 7ff933fff640 1 -- 172.21.15.53:0/4243743161 >> v1:172.21.15.53:6789/0 conn(0x7ff93c06bc00 legacy=0x7ff93c162180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:37.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.467+0000 7ff933fff640 1 --2- 172.21.15.53:0/4243743161 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff928005c00 0x7ff928006010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:37.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.467+0000 7ff933fff640 1 --2- 172.21.15.53:0/4243743161 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9280069e0 0x7ff928006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:37.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.467+0000 7ff933fff640 1 --2- 172.21.15.53:0/4243743161 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff928007390 0x7ff92800dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:37.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.467+0000 7ff933fff640 1 -- 172.21.15.53:0/4243743161 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff93c0705d0 con 0x7ff928005c00 2023-06-10T19:05:37.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.467+0000 7ff933fff640 1 -- 172.21.15.53:0/4243743161 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff92800e280 con 0x7ff928007390 2023-06-10T19:05:37.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.467+0000 7ff933fff640 1 -- 172.21.15.53:0/4243743161 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff92800e440 con 0x7ff9280069e0 2023-06-10T19:05:37.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.467+0000 7ff941296640 1 --2- 172.21.15.53:0/4243743161 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff928005c00 0x7ff928006010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:37.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.467+0000 7ff941a97640 1 --2- 172.21.15.53:0/4243743161 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff928007390 0x7ff92800dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:37.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.467+0000 7ff940a95640 1 --2- 172.21.15.53:0/4243743161 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9280069e0 0x7ff928006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:37.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.467+0000 7ff941296640 1 -- 172.21.15.53:0/4243743161 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9280069e0 msgr2=0x7ff928006e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:37.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.467+0000 7ff941296640 1 --2- 172.21.15.53:0/4243743161 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff9280069e0 0x7ff928006e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:37.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.467+0000 7ff941296640 1 -- 172.21.15.53:0/4243743161 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff928007390 msgr2=0x7ff92800dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:37.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.467+0000 7ff941296640 1 --2- 172.21.15.53:0/4243743161 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff928007390 0x7ff92800dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:37.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.467+0000 7ff941296640 1 -- 172.21.15.53:0/4243743161 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff928005740 con 0x7ff928005c00 2023-06-10T19:05:37.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.467+0000 7ff941a97640 1 --2- 172.21.15.53:0/4243743161 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff928007390 0x7ff92800dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:05:37.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.467+0000 7ff941a97640 1 -- 172.21.15.53:0/4243743161 reap_dead start 2023-06-10T19:05:37.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.471+0000 7ff941296640 1 --2- 172.21.15.53:0/4243743161 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff928005c00 0x7ff928006010 secure :-1 s=READY pgs=1959 cs=0 l=1 rev1=1 crypto rx=0x7ff9380015e0 tx=0x7ff93801c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c28438c06345ff83 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:37.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.471+0000 7ff933fff640 1 -- 172.21.15.53:0/4243743161 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9380052d0 con 0x7ff928005c00 2023-06-10T19:05:37.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.471+0000 7ff933fff640 1 -- 172.21.15.53:0/4243743161 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9380a7050 con 0x7ff928005c00 2023-06-10T19:05:37.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.471+0000 7ff933fff640 1 -- 172.21.15.53:0/4243743161 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff938003600 con 0x7ff928005c00 2023-06-10T19:05:37.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.471+0000 7ff9434fa640 1 -- 172.21.15.53:0/4243743161 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff928005c00 msgr2=0x7ff928006010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:37.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.471+0000 7ff9434fa640 1 --2- 172.21.15.53:0/4243743161 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff928005c00 0x7ff928006010 secure :-1 s=READY pgs=1959 cs=0 l=1 rev1=1 crypto rx=0x7ff9380015e0 tx=0x7ff93801c240 comp rx=0 tx=0).stop 2023-06-10T19:05:37.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.471+0000 7ff9434fa640 1 -- 172.21.15.53:0/4243743161 shutdown_connections 2023-06-10T19:05:37.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.471+0000 7ff9434fa640 1 --2- 172.21.15.53:0/4243743161 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff928005c00 0x7ff928006010 unknown :-1 s=CLOSED pgs=1959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:37.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.471+0000 7ff9434fa640 1 -- 172.21.15.53:0/4243743161 >> 172.21.15.53:0/4243743161 conn(0x7ff93c06a0d0 msgr2=0x7ff93c0ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:37.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.471+0000 7ff9434fa640 1 -- 172.21.15.53:0/4243743161 shutdown_connections 2023-06-10T19:05:37.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.471+0000 7ff9434fa640 1 -- 172.21.15.53:0/4243743161 wait complete. 2023-06-10T19:05:37.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.471+0000 7ff9434fa640 1 Processor -- start 2023-06-10T19:05:37.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.471+0000 7ff9434fa640 1 -- start start 2023-06-10T19:05:37.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.471+0000 7ff9434fa640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff928005c00 0x7ff93c0b1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:37.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.471+0000 7ff9434fa640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff93c159db0 0x7ff93c0b3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:37.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.471+0000 7ff9434fa640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff93c1f0600 0x7ff93c0ae090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:37.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.471+0000 7ff9434fa640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff93c1538d0 con 0x7ff93c1f0600 2023-06-10T19:05:37.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.471+0000 7ff9434fa640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff93c1f1be0 con 0x7ff93c159db0 2023-06-10T19:05:37.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.471+0000 7ff9434fa640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff93c0b3960 con 0x7ff928005c00 2023-06-10T19:05:37.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.471+0000 7ff941a97640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff93c1f0600 0x7ff93c0ae090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:37.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.471+0000 7ff941a97640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff93c1f0600 0x7ff93c0ae090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58254/0 (socket says 172.21.15.53:58254) 2023-06-10T19:05:37.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.471+0000 7ff941a97640 1 -- 172.21.15.53:0/887146756 learned_addr learned my addr 172.21.15.53:0/887146756 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:37.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.471+0000 7ff940a95640 1 --2- 172.21.15.53:0/887146756 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff93c159db0 0x7ff93c0b3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:37.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.471+0000 7ff941296640 1 --2- 172.21.15.53:0/887146756 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff928005c00 0x7ff93c0b1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:37.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.471+0000 7ff941a97640 1 -- 172.21.15.53:0/887146756 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff928005c00 msgr2=0x7ff93c0b1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:37.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.471+0000 7ff941a97640 1 --2- 172.21.15.53:0/887146756 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff928005c00 0x7ff93c0b1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:37.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.471+0000 7ff941a97640 1 -- 172.21.15.53:0/887146756 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff93c159db0 msgr2=0x7ff93c0b3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:37.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.471+0000 7ff941a97640 1 --2- 172.21.15.53:0/887146756 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff93c159db0 0x7ff93c0b3420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:37.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.471+0000 7ff941a97640 1 -- 172.21.15.53:0/887146756 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff93c1f0fd0 con 0x7ff93c1f0600 2023-06-10T19:05:37.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.471+0000 7ff941296640 1 --2- 172.21.15.53:0/887146756 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff928005c00 0x7ff93c0b1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:05:37.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.471+0000 7ff941a97640 1 --2- 172.21.15.53:0/887146756 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff93c1f0600 0x7ff93c0ae090 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 crypto rx=0x7ff934000f90 tx=0x7ff9340107e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:37.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.471+0000 7ff931ffb640 1 -- 172.21.15.53:0/887146756 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff934015400 con 0x7ff93c1f0600 2023-06-10T19:05:37.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.471+0000 7ff931ffb640 1 -- 172.21.15.53:0/887146756 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff934015560 con 0x7ff93c1f0600 2023-06-10T19:05:37.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.471+0000 7ff931ffb640 1 -- 172.21.15.53:0/887146756 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9340158d0 con 0x7ff93c1f0600 2023-06-10T19:05:37.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.471+0000 7ff9434fa640 1 -- 172.21.15.53:0/887146756 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff93c1f12b0 con 0x7ff93c1f0600 2023-06-10T19:05:37.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.471+0000 7ff9434fa640 1 -- 172.21.15.53:0/887146756 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff93c1f1870 con 0x7ff93c1f0600 2023-06-10T19:05:37.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.475+0000 7ff9434fa640 1 -- 172.21.15.53:0/887146756 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff93c04d790 con 0x7ff93c1f0600 2023-06-10T19:05:37.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.475+0000 7ff931ffb640 1 -- 172.21.15.53:0/887146756 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff93401d360 con 0x7ff93c1f0600 2023-06-10T19:05:37.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.475+0000 7ff931ffb640 1 --2- 172.21.15.53:0/887146756 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff920066280 0x7ff920068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:37.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.475+0000 7ff931ffb640 1 -- 172.21.15.53:0/887146756 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6105+0+0 (secure 0 0 0) 0x7ff934085b20 con 0x7ff93c1f0600 2023-06-10T19:05:37.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.475+0000 7ff941296640 1 --2- 172.21.15.53:0/887146756 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff920066280 0x7ff920068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:37.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.475+0000 7ff941296640 1 --2- 172.21.15.53:0/887146756 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff920066280 0x7ff920068730 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7ff9380015b0 tx=0x7ff9380011a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:37.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.479+0000 7ff931ffb640 1 -- 172.21.15.53:0/887146756 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff934052f70 con 0x7ff93c1f0600 2023-06-10T19:05:37.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.627+0000 7ff9434fa640 1 -- 172.21.15.53:0/887146756 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff93c159c10 con 0x7ff93c1f0600 2023-06-10T19:05:37.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.631+0000 7ff931ffb640 1 -- 172.21.15.53:0/887146756 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v126) v1 ==== 74+0+18408 (secure 0 0 0) 0x7ff93c159c10 con 0x7ff93c1f0600 2023-06-10T19:05:37.637 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:05:37.638 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":126,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:05:29.141776+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-06-10T19:05:02.560833+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-06-10T19:05:03.863586+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.0.1:0/935434380":"2023-06-10T20:05:28.182850+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:05:37.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.631+0000 7ff9434fa640 1 -- 172.21.15.53:0/887146756 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff920066280 msgr2=0x7ff920068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:37.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.631+0000 7ff9434fa640 1 --2- 172.21.15.53:0/887146756 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff920066280 0x7ff920068730 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7ff9380015b0 tx=0x7ff9380011a0 comp rx=0 tx=0).stop 2023-06-10T19:05:37.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.631+0000 7ff9434fa640 1 -- 172.21.15.53:0/887146756 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff93c1f0600 msgr2=0x7ff93c0ae090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:37.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.631+0000 7ff9434fa640 1 --2- 172.21.15.53:0/887146756 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff93c1f0600 0x7ff93c0ae090 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 crypto rx=0x7ff934000f90 tx=0x7ff9340107e0 comp rx=0 tx=0).stop 2023-06-10T19:05:37.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.631+0000 7ff9434fa640 1 -- 172.21.15.53:0/887146756 shutdown_connections 2023-06-10T19:05:37.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.631+0000 7ff9434fa640 1 --2- 172.21.15.53:0/887146756 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff920066280 0x7ff920068730 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:37.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.631+0000 7ff9434fa640 1 --2- 172.21.15.53:0/887146756 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff93c1f0600 0x7ff93c0ae090 unknown :-1 s=CLOSED pgs=1960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:37.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.631+0000 7ff9434fa640 1 --2- 172.21.15.53:0/887146756 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff93c159db0 0x7ff93c0b3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:37.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.631+0000 7ff9434fa640 1 --2- 172.21.15.53:0/887146756 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff928005c00 0x7ff93c0b1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:37.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.631+0000 7ff9434fa640 1 -- 172.21.15.53:0/887146756 >> 172.21.15.53:0/887146756 conn(0x7ff93c06a0d0 msgr2=0x7ff93c0ce6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:37.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.631+0000 7ff9434fa640 1 -- 172.21.15.53:0/887146756 shutdown_connections 2023-06-10T19:05:37.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.635+0000 7ff9434fa640 1 -- 172.21.15.53:0/887146756 wait complete. 2023-06-10T19:05:37.654 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-06-10T19:05:37.655 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:05:37.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.771+0000 7ffb59e67640 1 Processor -- start 2023-06-10T19:05:37.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.771+0000 7ffb59e67640 1 -- start start 2023-06-10T19:05:37.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.775+0000 7ffb59e67640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ffb540b3ac0 0x7ffb540b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:37.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.775+0000 7ffb59e67640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb540d14c0 0x7ffb5415fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:37.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.775+0000 7ffb59e67640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb540d0020 con 0x7ffb540cc690 2023-06-10T19:05:37.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.775+0000 7ffb59e67640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb540b43d0 con 0x7ffb540b3ac0 2023-06-10T19:05:37.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.775+0000 7ffb59e67640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb540cef40 con 0x7ffb540d14c0 2023-06-10T19:05:37.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.775+0000 7ffb537fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ffb540b3ac0 0x7ffb540b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:37.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.775+0000 7ffb52ffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ffb540cc690 0x7ffb5415f370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60340/0 (socket says 172.21.15.53:60340) 2023-06-10T19:05:37.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.775+0000 7ffb52ffd640 1 -- 172.21.15.53:0/2258165187 learned_addr learned my addr 172.21.15.53:0/2258165187 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:05:37.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.775+0000 7ffb53fff640 1 --2- 172.21.15.53:0/2258165187 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb540d14c0 0x7ffb5415fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:37.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.775+0000 7ffb537fe640 1 -- 172.21.15.53:0/2258165187 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb540d14c0 msgr2=0x7ffb5415fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:37.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.775+0000 7ffb537fe640 1 --2- 172.21.15.53:0/2258165187 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb540d14c0 0x7ffb5415fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:37.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.775+0000 7ffb537fe640 1 -- 172.21.15.53:0/2258165187 >> v1:172.21.15.53:6789/0 conn(0x7ffb540cc690 legacy=0x7ffb5415f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:37.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.775+0000 7ffb537fe640 1 -- 172.21.15.53:0/2258165187 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb540cf220 con 0x7ffb540b3ac0 2023-06-10T19:05:37.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.775+0000 7ffb527fc640 1 -- 172.21.15.53:0/2258165187 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 797638724 0 0) 0x7ffb540d0020 con 0x7ffb540cc690 2023-06-10T19:05:37.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.775+0000 7ffb53fff640 1 --2- 172.21.15.53:0/2258165187 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb540d14c0 0x7ffb5415fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:05:37.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.775+0000 7ffb537fe640 1 --2- 172.21.15.53:0/2258165187 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb540b3ac0 0x7ffb540b3e90 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 crypto rx=0x7ffb44009d90 tx=0x7ffb4401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c79bb2c05f7d48bc server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:37.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.775+0000 7ffb527fc640 1 -- 172.21.15.53:0/2258165187 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb440a58f0 con 0x7ffb540b3ac0 2023-06-10T19:05:37.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.775+0000 7ffb527fc640 1 -- 172.21.15.53:0/2258165187 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb440a5a50 con 0x7ffb540b3ac0 2023-06-10T19:05:37.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.775+0000 7ffb527fc640 1 -- 172.21.15.53:0/2258165187 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb440a5de0 con 0x7ffb540b3ac0 2023-06-10T19:05:37.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.779+0000 7ffb59e67640 1 -- 172.21.15.53:0/2258165187 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb540b3ac0 msgr2=0x7ffb540b3e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:37.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.779+0000 7ffb59e67640 1 --2- 172.21.15.53:0/2258165187 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb540b3ac0 0x7ffb540b3e90 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 crypto rx=0x7ffb44009d90 tx=0x7ffb4401c920 comp rx=0 tx=0).stop 2023-06-10T19:05:37.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.779+0000 7ffb59e67640 1 -- 172.21.15.53:0/2258165187 shutdown_connections 2023-06-10T19:05:37.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.779+0000 7ffb59e67640 1 --2- 172.21.15.53:0/2258165187 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb540d14c0 0x7ffb5415fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:37.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.779+0000 7ffb59e67640 1 --2- 172.21.15.53:0/2258165187 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb540b3ac0 0x7ffb540b3e90 unknown :-1 s=CLOSED pgs=1962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:37.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.779+0000 7ffb59e67640 1 -- 172.21.15.53:0/2258165187 >> 172.21.15.53:0/2258165187 conn(0x7ffb54071790 msgr2=0x7ffb54069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:37.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.779+0000 7ffb59e67640 1 -- 172.21.15.53:0/2258165187 shutdown_connections 2023-06-10T19:05:37.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.779+0000 7ffb59e67640 1 -- 172.21.15.53:0/2258165187 wait complete. 2023-06-10T19:05:37.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.779+0000 7ffb59e67640 1 Processor -- start 2023-06-10T19:05:37.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.779+0000 7ffb59e67640 1 -- start start 2023-06-10T19:05:37.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.779+0000 7ffb59e67640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb540b3ac0 0x7ffb5414e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:37.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.779+0000 7ffb59e67640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb540cc690 0x7ffb540c7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:37.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.779+0000 7ffb59e67640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb540d14c0 0x7ffb5415a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:37.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.779+0000 7ffb59e67640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb540c7c70 con 0x7ffb540b3ac0 2023-06-10T19:05:37.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.779+0000 7ffb59e67640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb540c6970 con 0x7ffb540d14c0 2023-06-10T19:05:37.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.779+0000 7ffb59e67640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb540c6c50 con 0x7ffb540cc690 2023-06-10T19:05:37.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.779+0000 7ffb537fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb540b3ac0 0x7ffb5414e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:37.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.779+0000 7ffb537fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb540b3ac0 0x7ffb5414e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58284/0 (socket says 172.21.15.53:58284) 2023-06-10T19:05:37.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.779+0000 7ffb537fe640 1 -- 172.21.15.53:0/499912787 learned_addr learned my addr 172.21.15.53:0/499912787 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:37.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.779+0000 7ffb537fe640 1 -- 172.21.15.53:0/499912787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb540cc690 msgr2=0x7ffb540c7730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:37.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.779+0000 7ffb537fe640 1 --2- 172.21.15.53:0/499912787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb540cc690 0x7ffb540c7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:37.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.779+0000 7ffb537fe640 1 -- 172.21.15.53:0/499912787 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb540d14c0 msgr2=0x7ffb5415a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:37.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.779+0000 7ffb537fe640 1 --2- 172.21.15.53:0/499912787 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb540d14c0 0x7ffb5415a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:37.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.779+0000 7ffb537fe640 1 -- 172.21.15.53:0/499912787 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb44009a70 con 0x7ffb540b3ac0 2023-06-10T19:05:37.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.779+0000 7ffb537fe640 1 --2- 172.21.15.53:0/499912787 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb540b3ac0 0x7ffb5414e260 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 crypto rx=0x7ffb440b0040 tx=0x7ffb440196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:37.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.779+0000 7ffb3bfff640 1 -- 172.21.15.53:0/499912787 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb440ad910 con 0x7ffb540b3ac0 2023-06-10T19:05:37.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.779+0000 7ffb3bfff640 1 -- 172.21.15.53:0/499912787 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb440ada70 con 0x7ffb540b3ac0 2023-06-10T19:05:37.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.779+0000 7ffb59e67640 1 -- 172.21.15.53:0/499912787 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb540c6f30 con 0x7ffb540b3ac0 2023-06-10T19:05:37.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.779+0000 7ffb3bfff640 1 -- 172.21.15.53:0/499912787 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb440ade20 con 0x7ffb540b3ac0 2023-06-10T19:05:37.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.779+0000 7ffb59e67640 1 -- 172.21.15.53:0/499912787 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb5415ac40 con 0x7ffb540b3ac0 2023-06-10T19:05:37.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.783+0000 7ffb59e67640 1 -- 172.21.15.53:0/499912787 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb540c7450 con 0x7ffb540b3ac0 2023-06-10T19:05:37.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.783+0000 7ffb3bfff640 1 -- 172.21.15.53:0/499912787 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ffb440b4050 con 0x7ffb540b3ac0 2023-06-10T19:05:37.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.783+0000 7ffb3bfff640 1 --2- 172.21.15.53:0/499912787 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ffb40066280 0x7ffb40068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:37.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.783+0000 7ffb3bfff640 1 -- 172.21.15.53:0/499912787 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6105+0+0 (secure 0 0 0) 0x7ffb4411ed80 con 0x7ffb540b3ac0 2023-06-10T19:05:37.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.783+0000 7ffb52ffd640 1 --2- 172.21.15.53:0/499912787 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ffb40066280 0x7ffb40068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:37.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.783+0000 7ffb52ffd640 1 --2- 172.21.15.53:0/499912787 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ffb40066280 0x7ffb40068730 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7ffb480011f0 tx=0x7ffb48007930 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:37.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.787+0000 7ffb3bfff640 1 -- 172.21.15.53:0/499912787 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ffb540c7450 con 0x7ffb540b3ac0 2023-06-10T19:05:37.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.979+0000 7ffb59e67640 1 -- 172.21.15.53:0/499912787 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffb540c7450 con 0x7ffb540b3ac0 2023-06-10T19:05:37.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.979+0000 7ffb3bfff640 1 -- 172.21.15.53:0/499912787 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) v1 ==== 94+0+4676 (secure 0 0 0) 0x7ffb440c7090 con 0x7ffb540b3ac0 2023-06-10T19:05:37.984 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:05:37.985 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":69,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7684,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/618082531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":618082531},{"type":"v1","addr":"172.21.15.117:6835","nonce":618082531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":7687,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3984577716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":3984577716},{"type":"v1","addr":"172.21.15.117:6837","nonce":3984577716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":9144,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/3202804884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3202804884},{"type":"v1","addr":"172.21.15.53:6833","nonce":3202804884}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:05:04.878347+0000","modified":"2023-06-10T19:05:07.051606+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9147},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9147":{"gid":9147,"name":"c","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/3233917972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":3233917972},{"type":"v1","addr":"172.21.15.53:6835","nonce":3233917972}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-06-10T19:05:37.985 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 69 2023-06-10T19:05:37.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.979+0000 7ffb59e67640 1 -- 172.21.15.53:0/499912787 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ffb40066280 msgr2=0x7ffb40068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:37.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.979+0000 7ffb59e67640 1 --2- 172.21.15.53:0/499912787 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ffb40066280 0x7ffb40068730 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7ffb480011f0 tx=0x7ffb48007930 comp rx=0 tx=0).stop 2023-06-10T19:05:37.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.979+0000 7ffb59e67640 1 -- 172.21.15.53:0/499912787 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb540b3ac0 msgr2=0x7ffb5414e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:37.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.979+0000 7ffb59e67640 1 --2- 172.21.15.53:0/499912787 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb540b3ac0 0x7ffb5414e260 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 crypto rx=0x7ffb440b0040 tx=0x7ffb440196c0 comp rx=0 tx=0).stop 2023-06-10T19:05:37.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.983+0000 7ffb59e67640 1 -- 172.21.15.53:0/499912787 shutdown_connections 2023-06-10T19:05:37.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.983+0000 7ffb59e67640 1 --2- 172.21.15.53:0/499912787 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ffb40066280 0x7ffb40068730 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:37.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.983+0000 7ffb59e67640 1 --2- 172.21.15.53:0/499912787 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb540d14c0 0x7ffb5415a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:37.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.983+0000 7ffb59e67640 1 --2- 172.21.15.53:0/499912787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffb540cc690 0x7ffb540c7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:37.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.983+0000 7ffb59e67640 1 --2- 172.21.15.53:0/499912787 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffb540b3ac0 0x7ffb5414e260 unknown :-1 s=CLOSED pgs=1963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:37.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.983+0000 7ffb59e67640 1 -- 172.21.15.53:0/499912787 >> 172.21.15.53:0/499912787 conn(0x7ffb54071790 msgr2=0x7ffb54157ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:37.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.983+0000 7ffb59e67640 1 -- 172.21.15.53:0/499912787 shutdown_connections 2023-06-10T19:05:37.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:37.983+0000 7ffb59e67640 1 -- 172.21.15.53:0/499912787 wait complete. 2023-06-10T19:05:38.004 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:05:38.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.123+0000 7f8d81a80640 1 Processor -- start 2023-06-10T19:05:38.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.123+0000 7f8d81a80640 1 -- start start 2023-06-10T19:05:38.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.123+0000 7f8d81a80640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8d7c06b780 0x7f8d7c15c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:38.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.123+0000 7f8d81a80640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d7c06bb50 0x7f8d7c15f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:38.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.123+0000 7f8d81a80640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d7c0af530 con 0x7f8d7c15f860 2023-06-10T19:05:38.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.123+0000 7f8d81a80640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d7c15c3d0 con 0x7f8d7c06b780 2023-06-10T19:05:38.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.123+0000 7f8d81a80640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7c15fd70 con 0x7f8d7c06bb50 2023-06-10T19:05:38.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.123+0000 7f8d7b7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8d7c06b780 0x7f8d7c15c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:38.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.123+0000 7f8d7b7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8d7c06b780 0x7f8d7c15c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58298/0 (socket says 172.21.15.53:58298) 2023-06-10T19:05:38.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.123+0000 7f8d7b7fe640 1 -- 172.21.15.53:0/1570344627 learned_addr learned my addr 172.21.15.53:0/1570344627 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:38.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.123+0000 7f8d7affd640 1 --2- 172.21.15.53:0/1570344627 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d7c06bb50 0x7f8d7c15f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:38.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.123+0000 7f8d7b7fe640 1 -- 172.21.15.53:0/1570344627 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d7c06bb50 msgr2=0x7f8d7c15f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:38.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.123+0000 7f8d7b7fe640 1 --2- 172.21.15.53:0/1570344627 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d7c06bb50 0x7f8d7c15f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:38.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.123+0000 7f8d7b7fe640 1 -- 172.21.15.53:0/1570344627 >> v1:172.21.15.117:6789/0 conn(0x7f8d7c15f860 legacy=0x7f8d7c0ceb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:38.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.123+0000 7f8d7b7fe640 1 -- 172.21.15.53:0/1570344627 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d7c160050 con 0x7f8d7c06b780 2023-06-10T19:05:38.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.127+0000 7f8d7b7fe640 1 --2- 172.21.15.53:0/1570344627 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d7c06b780 0x7f8d7c15c7f0 secure :-1 s=READY pgs=1964 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c009870 tx=0x7f8d6c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fae79147864b68ab server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:38.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.127+0000 7f8d7a7fc640 1 -- 172.21.15.53:0/1570344627 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d6c0ad660 con 0x7f8d7c06b780 2023-06-10T19:05:38.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.127+0000 7f8d7a7fc640 1 -- 172.21.15.53:0/1570344627 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d6c0ad7c0 con 0x7f8d7c06b780 2023-06-10T19:05:38.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.127+0000 7f8d7a7fc640 1 -- 172.21.15.53:0/1570344627 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d6c0adb50 con 0x7f8d7c06b780 2023-06-10T19:05:38.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.127+0000 7f8d81a80640 1 -- 172.21.15.53:0/1570344627 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d7c06b780 msgr2=0x7f8d7c15c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:38.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.127+0000 7f8d81a80640 1 --2- 172.21.15.53:0/1570344627 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d7c06b780 0x7f8d7c15c7f0 secure :-1 s=READY pgs=1964 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c009870 tx=0x7f8d6c01c470 comp rx=0 tx=0).stop 2023-06-10T19:05:38.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.127+0000 7f8d81a80640 1 -- 172.21.15.53:0/1570344627 shutdown_connections 2023-06-10T19:05:38.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.127+0000 7f8d81a80640 1 --2- 172.21.15.53:0/1570344627 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d7c06bb50 0x7f8d7c15f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:38.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.127+0000 7f8d81a80640 1 --2- 172.21.15.53:0/1570344627 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d7c06b780 0x7f8d7c15c7f0 unknown :-1 s=CLOSED pgs=1964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:38.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.127+0000 7f8d81a80640 1 -- 172.21.15.53:0/1570344627 >> 172.21.15.53:0/1570344627 conn(0x7f8d7c06a090 msgr2=0x7f8d7c06d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:38.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.127+0000 7f8d81a80640 1 -- 172.21.15.53:0/1570344627 shutdown_connections 2023-06-10T19:05:38.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.127+0000 7f8d81a80640 1 -- 172.21.15.53:0/1570344627 wait complete. 2023-06-10T19:05:38.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.127+0000 7f8d81a80640 1 Processor -- start 2023-06-10T19:05:38.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.127+0000 7f8d81a80640 1 -- start start 2023-06-10T19:05:38.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.127+0000 7f8d81a80640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d7c06b780 0x7f8d7c0cb680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:38.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.127+0000 7f8d81a80640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d7c06bb50 0x7f8d7c0caeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:38.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.127+0000 7f8d81a80640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d7c15f860 0x7f8d7c0b4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:38.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.127+0000 7f8d81a80640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7c0b2d20 con 0x7f8d7c06b780 2023-06-10T19:05:38.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.127+0000 7f8d81a80640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7c0cb3f0 con 0x7f8d7c06bb50 2023-06-10T19:05:38.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.127+0000 7f8d81a80640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7c0cbc60 con 0x7f8d7c15f860 2023-06-10T19:05:38.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.127+0000 7f8d7b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d7c06b780 0x7f8d7c0cb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:38.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.127+0000 7f8d7b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d7c06b780 0x7f8d7c0cb680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58314/0 (socket says 172.21.15.53:58314) 2023-06-10T19:05:38.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.127+0000 7f8d7b7fe640 1 -- 172.21.15.53:0/1234284082 learned_addr learned my addr 172.21.15.53:0/1234284082 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:38.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.131+0000 7f8d7affd640 1 --2- 172.21.15.53:0/1234284082 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d7c06bb50 0x7f8d7c0caeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:38.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.131+0000 7f8d7bfff640 1 --2- 172.21.15.53:0/1234284082 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d7c15f860 0x7f8d7c0b4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:38.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.131+0000 7f8d7b7fe640 1 -- 172.21.15.53:0/1234284082 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d7c15f860 msgr2=0x7f8d7c0b4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:38.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.131+0000 7f8d7b7fe640 1 --2- 172.21.15.53:0/1234284082 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d7c15f860 0x7f8d7c0b4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:38.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.131+0000 7f8d7b7fe640 1 -- 172.21.15.53:0/1234284082 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d7c06bb50 msgr2=0x7f8d7c0caeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:38.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.131+0000 7f8d7b7fe640 1 --2- 172.21.15.53:0/1234284082 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d7c06bb50 0x7f8d7c0caeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:38.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.131+0000 7f8d7b7fe640 1 -- 172.21.15.53:0/1234284082 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d6c0094d0 con 0x7f8d7c06b780 2023-06-10T19:05:38.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.131+0000 7f8d7bfff640 1 --2- 172.21.15.53:0/1234284082 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d7c15f860 0x7f8d7c0b4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:05:38.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.131+0000 7f8d7affd640 1 --2- 172.21.15.53:0/1234284082 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d7c06bb50 0x7f8d7c0caeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:05:38.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.131+0000 7f8d7b7fe640 1 --2- 172.21.15.53:0/1234284082 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d7c06b780 0x7f8d7c0cb680 secure :-1 s=READY pgs=1965 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c0097c0 tx=0x7f8d6c019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:38.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.131+0000 7f8d63fff640 1 -- 172.21.15.53:0/1234284082 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d6c0b8830 con 0x7f8d7c06b780 2023-06-10T19:05:38.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.131+0000 7f8d63fff640 1 -- 172.21.15.53:0/1234284082 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d6c0b8990 con 0x7f8d7c06b780 2023-06-10T19:05:38.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.131+0000 7f8d81a80640 1 -- 172.21.15.53:0/1234284082 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d7c0cbf40 con 0x7f8d7c06b780 2023-06-10T19:05:38.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.131+0000 7f8d63fff640 1 -- 172.21.15.53:0/1234284082 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d6c0b8d40 con 0x7f8d7c06b780 2023-06-10T19:05:38.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.131+0000 7f8d81a80640 1 -- 172.21.15.53:0/1234284082 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d7c0cc500 con 0x7f8d7c06b780 2023-06-10T19:05:38.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.131+0000 7f8d81a80640 1 -- 172.21.15.53:0/1234284082 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d7c04d790 con 0x7f8d7c06b780 2023-06-10T19:05:38.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.131+0000 7f8d63fff640 1 -- 172.21.15.53:0/1234284082 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8d6c0b4040 con 0x7f8d7c06b780 2023-06-10T19:05:38.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.131+0000 7f8d63fff640 1 --2- 172.21.15.53:0/1234284082 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8d68066280 0x7f8d68068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:38.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.131+0000 7f8d63fff640 1 -- 172.21.15.53:0/1234284082 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6105+0+0 (secure 0 0 0) 0x7f8d6c11e4f0 con 0x7f8d7c06b780 2023-06-10T19:05:38.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.131+0000 7f8d7affd640 1 --2- 172.21.15.53:0/1234284082 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8d68066280 0x7f8d68068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:38.140 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.131+0000 7f8d7affd640 1 --2- 172.21.15.53:0/1234284082 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8d68066280 0x7f8d68068730 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f8d70006fd0 tx=0x7f8d70008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:38.141 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.135+0000 7f8d63fff640 1 -- 172.21.15.53:0/1234284082 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8d6c0eba60 con 0x7f8d7c06b780 2023-06-10T19:05:38.147 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-10T19:05:38.150 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-10T19:05:38.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.327+0000 7f8d81a80640 1 -- 172.21.15.53:0/1234284082 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8d7c154020 con 0x7f8d7c06b780 2023-06-10T19:05:38.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.327+0000 7f8d63fff640 1 -- 172.21.15.53:0/1234284082 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) v1 ==== 94+0+4676 (secure 0 0 0) 0x7f8d6c0ef080 con 0x7f8d7c06b780 2023-06-10T19:05:38.332 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:05:38.332 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":69,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7684,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/618082531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":618082531},{"type":"v1","addr":"172.21.15.117:6835","nonce":618082531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":7687,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3984577716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":3984577716},{"type":"v1","addr":"172.21.15.117:6837","nonce":3984577716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":9144,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/3202804884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3202804884},{"type":"v1","addr":"172.21.15.53:6833","nonce":3202804884}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:05:04.878347+0000","modified":"2023-06-10T19:05:07.051606+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9147},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9147":{"gid":9147,"name":"c","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/3233917972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":3233917972},{"type":"v1","addr":"172.21.15.53:6835","nonce":3233917972}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-06-10T19:05:38.333 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 69 2023-06-10T19:05:38.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.327+0000 7f8d81a80640 1 -- 172.21.15.53:0/1234284082 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8d68066280 msgr2=0x7f8d68068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:38.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.327+0000 7f8d81a80640 1 --2- 172.21.15.53:0/1234284082 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8d68066280 0x7f8d68068730 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f8d70006fd0 tx=0x7f8d70008040 comp rx=0 tx=0).stop 2023-06-10T19:05:38.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.327+0000 7f8d81a80640 1 -- 172.21.15.53:0/1234284082 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d7c06b780 msgr2=0x7f8d7c0cb680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:38.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.327+0000 7f8d81a80640 1 --2- 172.21.15.53:0/1234284082 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d7c06b780 0x7f8d7c0cb680 secure :-1 s=READY pgs=1965 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c0097c0 tx=0x7f8d6c019210 comp rx=0 tx=0).stop 2023-06-10T19:05:38.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.327+0000 7f8d81a80640 1 -- 172.21.15.53:0/1234284082 shutdown_connections 2023-06-10T19:05:38.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.327+0000 7f8d81a80640 1 --2- 172.21.15.53:0/1234284082 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8d68066280 0x7f8d68068730 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:38.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.327+0000 7f8d81a80640 1 --2- 172.21.15.53:0/1234284082 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d7c15f860 0x7f8d7c0b4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:38.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.327+0000 7f8d81a80640 1 --2- 172.21.15.53:0/1234284082 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d7c06bb50 0x7f8d7c0caeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:38.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.327+0000 7f8d81a80640 1 --2- 172.21.15.53:0/1234284082 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d7c06b780 0x7f8d7c0cb680 unknown :-1 s=CLOSED pgs=1965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:38.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.327+0000 7f8d81a80640 1 -- 172.21.15.53:0/1234284082 >> 172.21.15.53:0/1234284082 conn(0x7f8d7c06a090 msgr2=0x7f8d7c06d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:38.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.327+0000 7f8d81a80640 1 -- 172.21.15.53:0/1234284082 shutdown_connections 2023-06-10T19:05:38.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.327+0000 7f8d81a80640 1 -- 172.21.15.53:0/1234284082 wait complete. 2023-06-10T19:05:38.350 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:05:38.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.463+0000 7f903ee00640 1 Processor -- start 2023-06-10T19:05:38.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.463+0000 7f903ee00640 1 -- start start 2023-06-10T19:05:38.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.467+0000 7f903ee00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90380c8d00 0x7f903806b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:38.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.467+0000 7f903ee00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f903806bc00 0x7f9038162180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:38.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.467+0000 7f903ee00640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9038158a90 con 0x7f903806b2f0 2023-06-10T19:05:38.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.467+0000 7f903ee00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f903806f780 con 0x7f903806bc00 2023-06-10T19:05:38.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.467+0000 7f903ee00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90380705d0 con 0x7f90380c8d00 2023-06-10T19:05:38.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.467+0000 7f903cb9c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f903806b2f0 0x7f903806f070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60356/0 (socket says 172.21.15.53:60356) 2023-06-10T19:05:38.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.467+0000 7f903cb9c640 1 -- 172.21.15.53:0/1146899633 learned_addr learned my addr 172.21.15.53:0/1146899633 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:05:38.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.467+0000 7f9037fff640 1 --2- 172.21.15.53:0/1146899633 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90380c8d00 0x7f903806b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:38.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.467+0000 7f903d39d640 1 --2- 172.21.15.53:0/1146899633 >> v2:172.21.15.117:3300/0 conn(0x7f903806bc00 0x7f9038162180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:38.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.467+0000 7f90377fe640 1 -- 172.21.15.53:0/1146899633 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2191825799 0 0) 0x7f9028001120 con 0x7f903806b2f0 2023-06-10T19:05:38.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.467+0000 7f90377fe640 1 -- 172.21.15.53:0/1146899633 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9020003530 con 0x7f903806b2f0 2023-06-10T19:05:38.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.467+0000 7f90377fe640 1 -- 172.21.15.53:0/1146899633 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1588202870 0 0) 0x7f9020003530 con 0x7f903806b2f0 2023-06-10T19:05:38.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.467+0000 7f90377fe640 1 -- 172.21.15.53:0/1146899633 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90380c8d00 msgr2=0x7f903806b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:38.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.467+0000 7f90377fe640 1 --2- 172.21.15.53:0/1146899633 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90380c8d00 0x7f903806b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:38.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.467+0000 7f90377fe640 1 -- 172.21.15.53:0/1146899633 >> v2:172.21.15.117:3300/0 conn(0x7f903806bc00 msgr2=0x7f9038162180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:38.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.467+0000 7f90377fe640 1 --2- 172.21.15.53:0/1146899633 >> v2:172.21.15.117:3300/0 conn(0x7f903806bc00 0x7f9038162180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:38.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.467+0000 7f90377fe640 1 -- 172.21.15.53:0/1146899633 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90380cce10 con 0x7f903806b2f0 2023-06-10T19:05:38.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.467+0000 7f90377fe640 1 -- 172.21.15.53:0/1146899633 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f9028001810 con 0x7f903806b2f0 2023-06-10T19:05:38.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.467+0000 7f90377fe640 1 -- 172.21.15.53:0/1146899633 >> v1:172.21.15.53:6789/0 conn(0x7f903806b2f0 legacy=0x7f903806f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:38.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.467+0000 7f90377fe640 1 --2- 172.21.15.53:0/1146899633 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90200039f0 0x7f9020003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:38.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.467+0000 7f90377fe640 1 --2- 172.21.15.53:0/1146899633 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90200047d0 0x7f9020004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:38.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.467+0000 7f90377fe640 1 --2- 172.21.15.53:0/1146899633 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90380c8d00 0x7f9020005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:38.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.467+0000 7f90377fe640 1 -- 172.21.15.53:0/1146899633 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f903806f780 con 0x7f90200039f0 2023-06-10T19:05:38.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.467+0000 7f90377fe640 1 -- 172.21.15.53:0/1146899633 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90380705d0 con 0x7f90200047d0 2023-06-10T19:05:38.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.467+0000 7f90377fe640 1 -- 172.21.15.53:0/1146899633 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f902000b9c0 con 0x7f90380c8d00 2023-06-10T19:05:38.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.467+0000 7f903cb9c640 1 --2- 172.21.15.53:0/1146899633 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90200039f0 0x7f9020003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:38.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.467+0000 7f9037fff640 1 --2- 172.21.15.53:0/1146899633 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90200047d0 0x7f9020004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:38.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.467+0000 7f903d39d640 1 --2- 172.21.15.53:0/1146899633 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90380c8d00 0x7f9020005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:38.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.467+0000 7f903cb9c640 1 -- 172.21.15.53:0/1146899633 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90380c8d00 msgr2=0x7f9020005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:38.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.467+0000 7f903cb9c640 1 --2- 172.21.15.53:0/1146899633 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90380c8d00 0x7f9020005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:38.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.467+0000 7f903cb9c640 1 -- 172.21.15.53:0/1146899633 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90200047d0 msgr2=0x7f9020004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:38.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.467+0000 7f903cb9c640 1 --2- 172.21.15.53:0/1146899633 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90200047d0 0x7f9020004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:38.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.467+0000 7f903cb9c640 1 -- 172.21.15.53:0/1146899633 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9020003530 con 0x7f90200039f0 2023-06-10T19:05:38.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.471+0000 7f903cb9c640 1 --2- 172.21.15.53:0/1146899633 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90200039f0 0x7f9020003e00 secure :-1 s=READY pgs=1967 cs=0 l=1 rev1=1 crypto rx=0x7f902800c240 tx=0x7f902801f350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cff8e64bfbcedbc9 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:38.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.471+0000 7f90377fe640 1 -- 172.21.15.53:0/1146899633 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9028005ae0 con 0x7f90200039f0 2023-06-10T19:05:38.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.471+0000 7f90377fe640 1 -- 172.21.15.53:0/1146899633 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90280ab070 con 0x7f90200039f0 2023-06-10T19:05:38.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.471+0000 7f90377fe640 1 -- 172.21.15.53:0/1146899633 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9028005ea0 con 0x7f90200039f0 2023-06-10T19:05:38.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.471+0000 7f903ee00640 1 -- 172.21.15.53:0/1146899633 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90200039f0 msgr2=0x7f9020003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:38.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.471+0000 7f903ee00640 1 --2- 172.21.15.53:0/1146899633 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90200039f0 0x7f9020003e00 secure :-1 s=READY pgs=1967 cs=0 l=1 rev1=1 crypto rx=0x7f902800c240 tx=0x7f902801f350 comp rx=0 tx=0).stop 2023-06-10T19:05:38.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.471+0000 7f903d39d640 1 -- 172.21.15.53:0/1146899633 reap_dead start 2023-06-10T19:05:38.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.471+0000 7f903ee00640 1 -- 172.21.15.53:0/1146899633 shutdown_connections 2023-06-10T19:05:38.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.471+0000 7f903ee00640 1 -- 172.21.15.53:0/1146899633 >> 172.21.15.53:0/1146899633 conn(0x7f903806a0d0 msgr2=0x7f90380ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:38.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.471+0000 7f903ee00640 1 -- 172.21.15.53:0/1146899633 shutdown_connections 2023-06-10T19:05:38.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.471+0000 7f903ee00640 1 -- 172.21.15.53:0/1146899633 wait complete. 2023-06-10T19:05:38.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.471+0000 7f903ee00640 1 Processor -- start 2023-06-10T19:05:38.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.471+0000 7f903ee00640 1 -- start start 2023-06-10T19:05:38.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.471+0000 7f903ee00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90200039f0 0x7f90381572a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:38.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.471+0000 7f903ee00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90380ac8b0 0x7f90380acd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:38.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.471+0000 7f903ee00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90380c1500 0x7f90380c1970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:38.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.471+0000 7f903ee00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90380ad260 con 0x7f90380ac8b0 2023-06-10T19:05:38.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.471+0000 7f903ee00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90380c1eb0 con 0x7f90380c1500 2023-06-10T19:05:38.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.471+0000 7f903ee00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9038158c30 con 0x7f90200039f0 2023-06-10T19:05:38.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.471+0000 7f9037fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90380ac8b0 0x7f90380acd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:38.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.471+0000 7f9037fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90380ac8b0 0x7f90380acd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58332/0 (socket says 172.21.15.53:58332) 2023-06-10T19:05:38.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.471+0000 7f9037fff640 1 -- 172.21.15.53:0/4070471885 learned_addr learned my addr 172.21.15.53:0/4070471885 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:38.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.471+0000 7f903cb9c640 1 --2- 172.21.15.53:0/4070471885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90200039f0 0x7f90381572a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:38.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.471+0000 7f903d39d640 1 --2- 172.21.15.53:0/4070471885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90380c1500 0x7f90380c1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:38.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.471+0000 7f9037fff640 1 -- 172.21.15.53:0/4070471885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90200039f0 msgr2=0x7f90381572a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:38.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.471+0000 7f9037fff640 1 --2- 172.21.15.53:0/4070471885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90200039f0 0x7f90381572a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:38.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.471+0000 7f9037fff640 1 -- 172.21.15.53:0/4070471885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90380c1500 msgr2=0x7f90380c1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:38.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.471+0000 7f9037fff640 1 --2- 172.21.15.53:0/4070471885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90380c1500 0x7f90380c1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:38.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.475+0000 7f9037fff640 1 -- 172.21.15.53:0/4070471885 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90381f46d0 con 0x7f90380ac8b0 2023-06-10T19:05:38.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.475+0000 7f903d39d640 1 --2- 172.21.15.53:0/4070471885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90380c1500 0x7f90380c1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:05:38.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.475+0000 7f9037fff640 1 --2- 172.21.15.53:0/4070471885 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90380ac8b0 0x7f90380acd20 secure :-1 s=READY pgs=1968 cs=0 l=1 rev1=1 crypto rx=0x7f902c011590 tx=0x7f902c011a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:38.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.475+0000 7f90357fa640 1 -- 172.21.15.53:0/4070471885 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f902c015930 con 0x7f90380ac8b0 2023-06-10T19:05:38.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.475+0000 7f90357fa640 1 -- 172.21.15.53:0/4070471885 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f902c015a90 con 0x7f90380ac8b0 2023-06-10T19:05:38.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.475+0000 7f903ee00640 1 -- 172.21.15.53:0/4070471885 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90380c20e0 con 0x7f90380ac8b0 2023-06-10T19:05:38.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.475+0000 7f90357fa640 1 -- 172.21.15.53:0/4070471885 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f902c015e20 con 0x7f90380ac8b0 2023-06-10T19:05:38.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.475+0000 7f903ee00640 1 -- 172.21.15.53:0/4070471885 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9038158e80 con 0x7f90380ac8b0 2023-06-10T19:05:38.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.475+0000 7f903ee00640 1 -- 172.21.15.53:0/4070471885 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f903804d790 con 0x7f90380ac8b0 2023-06-10T19:05:38.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.475+0000 7f90357fa640 1 -- 172.21.15.53:0/4070471885 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f902c00f460 con 0x7f90380ac8b0 2023-06-10T19:05:38.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.475+0000 7f90357fa640 1 --2- 172.21.15.53:0/4070471885 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f90240662b0 0x7f9024068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:38.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.475+0000 7f90357fa640 1 -- 172.21.15.53:0/4070471885 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6105+0+0 (secure 0 0 0) 0x7f902c084610 con 0x7f90380ac8b0 2023-06-10T19:05:38.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.475+0000 7f903cb9c640 1 --2- 172.21.15.53:0/4070471885 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f90240662b0 0x7f9024068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:38.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.475+0000 7f903cb9c640 1 --2- 172.21.15.53:0/4070471885 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f90240662b0 0x7f9024068760 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f90280af000 tx=0x7f90280aa000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:38.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.479+0000 7f90357fa640 1 -- 172.21.15.53:0/4070471885 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f902c0519c0 con 0x7f90380ac8b0 2023-06-10T19:05:38.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.635+0000 7f903ee00640 1 -- 172.21.15.53:0/4070471885 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f90380701c0 con 0x7f90380ac8b0 2023-06-10T19:05:38.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.635+0000 7f90357fa640 1 -- 172.21.15.53:0/4070471885 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v126) v1 ==== 74+0+18408 (secure 0 0 0) 0x7f902c054fe0 con 0x7f90380ac8b0 2023-06-10T19:05:38.641 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:05:38.641 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":126,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:05:29.141776+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-06-10T19:05:02.560833+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-06-10T19:05:03.863586+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.0.1:0/935434380":"2023-06-10T20:05:28.182850+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:05:38.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.639+0000 7f903ee00640 1 -- 172.21.15.53:0/4070471885 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f90240662b0 msgr2=0x7f9024068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:38.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.639+0000 7f903ee00640 1 --2- 172.21.15.53:0/4070471885 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f90240662b0 0x7f9024068760 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f90280af000 tx=0x7f90280aa000 comp rx=0 tx=0).stop 2023-06-10T19:05:38.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.639+0000 7f903ee00640 1 -- 172.21.15.53:0/4070471885 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90380ac8b0 msgr2=0x7f90380acd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:38.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.639+0000 7f903ee00640 1 --2- 172.21.15.53:0/4070471885 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90380ac8b0 0x7f90380acd20 secure :-1 s=READY pgs=1968 cs=0 l=1 rev1=1 crypto rx=0x7f902c011590 tx=0x7f902c011a50 comp rx=0 tx=0).stop 2023-06-10T19:05:38.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.639+0000 7f903ee00640 1 -- 172.21.15.53:0/4070471885 shutdown_connections 2023-06-10T19:05:38.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.639+0000 7f903ee00640 1 --2- 172.21.15.53:0/4070471885 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f90240662b0 0x7f9024068760 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:38.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.639+0000 7f903ee00640 1 --2- 172.21.15.53:0/4070471885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90380c1500 0x7f90380c1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:38.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.639+0000 7f903ee00640 1 --2- 172.21.15.53:0/4070471885 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f90380ac8b0 0x7f90380acd20 unknown :-1 s=CLOSED pgs=1968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:38.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.639+0000 7f903ee00640 1 --2- 172.21.15.53:0/4070471885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90200039f0 0x7f90381572a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:38.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.639+0000 7f903ee00640 1 -- 172.21.15.53:0/4070471885 >> 172.21.15.53:0/4070471885 conn(0x7f903806a0d0 msgr2=0x7f903806eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:38.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.639+0000 7f903ee00640 1 -- 172.21.15.53:0/4070471885 shutdown_connections 2023-06-10T19:05:38.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.639+0000 7f903ee00640 1 -- 172.21.15.53:0/4070471885 wait complete. 2023-06-10T19:05:38.661 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-06-10T19:05:38.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.783+0000 7fc8b0f9f640 1 Processor -- start 2023-06-10T19:05:38.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.783+0000 7fc8b0f9f640 1 -- start start 2023-06-10T19:05:38.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.783+0000 7fc8b0f9f640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc8ac1571a0 0x7fc8ac0c9f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:38.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.783+0000 7fc8b0f9f640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8ac071190 con 0x7fc8ac070100 2023-06-10T19:05:38.791 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.783+0000 7fc8b0f9f640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8ac0ca440 con 0x7fc8ac0afee0 2023-06-10T19:05:38.791 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.783+0000 7fc8b0f9f640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8ac070580 con 0x7fc8ac1571a0 2023-06-10T19:05:38.791 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.783+0000 7fc8a1d9b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fc8ac070100 0x7fc8ac0af7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60364/0 (socket says 172.21.15.53:60364) 2023-06-10T19:05:38.791 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.783+0000 7fc8a1d9b640 1 -- 172.21.15.53:0/4174130943 learned_addr learned my addr 172.21.15.53:0/4174130943 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:05:38.791 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.783+0000 7fc8aa59c640 1 --2- 172.21.15.53:0/4174130943 >> v2:172.21.15.117:3300/0 conn(0x7fc8ac1571a0 0x7fc8ac0c9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:38.791 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.783+0000 7fc8a9d9b640 1 -- 172.21.15.53:0/4174130943 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 84262931 0 0) 0x7fc8ac071190 con 0x7fc8ac070100 2023-06-10T19:05:38.791 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.783+0000 7fc8a9d9b640 1 -- 172.21.15.53:0/4174130943 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc898003530 con 0x7fc8ac070100 2023-06-10T19:05:38.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.783+0000 7fc8a9d9b640 1 -- 172.21.15.53:0/4174130943 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1438301501 0 0) 0x7fc8ac0ca440 con 0x7fc8ac0afee0 2023-06-10T19:05:38.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.783+0000 7fc8a9d9b640 1 -- 172.21.15.53:0/4174130943 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8ac071190 con 0x7fc8ac0afee0 2023-06-10T19:05:38.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.783+0000 7fc8a9d9b640 1 -- 172.21.15.53:0/4174130943 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 399778914 0 0) 0x7fc898003530 con 0x7fc8ac070100 2023-06-10T19:05:38.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.783+0000 7fc8aa59c640 1 -- 172.21.15.53:0/4174130943 >> v1:172.21.15.117:6789/0 conn(0x7fc8ac0afee0 legacy=0x7fc8ac0c83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:38.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.787+0000 7fc8aa59c640 1 -- 172.21.15.53:0/4174130943 >> v1:172.21.15.53:6789/0 conn(0x7fc8ac070100 legacy=0x7fc8ac0af7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:38.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.787+0000 7fc8aa59c640 1 -- 172.21.15.53:0/4174130943 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8ac070860 con 0x7fc8ac1571a0 2023-06-10T19:05:38.793 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.787+0000 7fc8aa59c640 1 --2- 172.21.15.53:0/4174130943 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8ac1571a0 0x7fc8ac0c9f00 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fc89c0097a0 tx=0x7fc89c01c350 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e612f7a13636b5ac server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:38.793 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.787+0000 7fc8a9d9b640 1 -- 172.21.15.53:0/4174130943 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc894001680 con 0x7fc8ac1571a0 2023-06-10T19:05:38.793 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.787+0000 7fc8a9d9b640 1 -- 172.21.15.53:0/4174130943 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc89c0a7050 con 0x7fc8ac1571a0 2023-06-10T19:05:38.793 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.787+0000 7fc8a9d9b640 1 -- 172.21.15.53:0/4174130943 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc89c0ab600 con 0x7fc8ac1571a0 2023-06-10T19:05:38.794 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.787+0000 7fc8b0f9f640 1 -- 172.21.15.53:0/4174130943 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8ac1571a0 msgr2=0x7fc8ac0c9f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:38.794 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.787+0000 7fc8b0f9f640 1 --2- 172.21.15.53:0/4174130943 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8ac1571a0 0x7fc8ac0c9f00 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fc89c0097a0 tx=0x7fc89c01c350 comp rx=0 tx=0).stop 2023-06-10T19:05:38.794 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.787+0000 7fc8b0f9f640 1 -- 172.21.15.53:0/4174130943 shutdown_connections 2023-06-10T19:05:38.795 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.787+0000 7fc8b0f9f640 1 --2- 172.21.15.53:0/4174130943 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8ac1571a0 0x7fc8ac0c9f00 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:38.795 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.787+0000 7fc8b0f9f640 1 -- 172.21.15.53:0/4174130943 >> 172.21.15.53:0/4174130943 conn(0x7fc8ac0ce9e0 msgr2=0x7fc8ac0ca7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:38.795 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.787+0000 7fc8b0f9f640 1 -- 172.21.15.53:0/4174130943 shutdown_connections 2023-06-10T19:05:38.795 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.787+0000 7fc8b0f9f640 1 -- 172.21.15.53:0/4174130943 wait complete. 2023-06-10T19:05:38.797 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.791+0000 7fc8b0f9f640 1 Processor -- start 2023-06-10T19:05:38.797 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.791+0000 7fc8b0f9f640 1 -- start start 2023-06-10T19:05:38.797 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.791+0000 7fc8b0f9f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8ac0afee0 0x7fc8ac0abb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:38.797 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.791+0000 7fc8b0f9f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8ac1571a0 0x7fc8ac0ac040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:38.797 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.791+0000 7fc8b0f9f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8ac154190 0x7fc8ac154610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:38.797 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.791+0000 7fc8b0f9f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8ac1f3b10 con 0x7fc8ac154190 2023-06-10T19:05:38.797 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.791+0000 7fc8b0f9f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8ac06ae00 con 0x7fc8ac1571a0 2023-06-10T19:05:38.798 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.791+0000 7fc8b0f9f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8ac0ac870 con 0x7fc8ac0afee0 2023-06-10T19:05:38.798 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.791+0000 7fc8aad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8ac154190 0x7fc8ac154610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:38.798 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.791+0000 7fc8aad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8ac154190 0x7fc8ac154610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58344/0 (socket says 172.21.15.53:58344) 2023-06-10T19:05:38.798 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.791+0000 7fc8aad9d640 1 -- 172.21.15.53:0/511795140 learned_addr learned my addr 172.21.15.53:0/511795140 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:38.798 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.791+0000 7fc8a1d9b640 1 --2- 172.21.15.53:0/511795140 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8ac1571a0 0x7fc8ac0ac040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:38.798 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.791+0000 7fc8aa59c640 1 --2- 172.21.15.53:0/511795140 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8ac0afee0 0x7fc8ac0abb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:38.798 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.791+0000 7fc8aad9d640 1 -- 172.21.15.53:0/511795140 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8ac0afee0 msgr2=0x7fc8ac0abb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:38.799 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.791+0000 7fc8aad9d640 1 --2- 172.21.15.53:0/511795140 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8ac0afee0 0x7fc8ac0abb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:38.799 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.791+0000 7fc8aad9d640 1 -- 172.21.15.53:0/511795140 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8ac1571a0 msgr2=0x7fc8ac0ac040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:38.799 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.791+0000 7fc8aad9d640 1 --2- 172.21.15.53:0/511795140 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8ac1571a0 0x7fc8ac0ac040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:38.799 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.791+0000 7fc8aad9d640 1 -- 172.21.15.53:0/511795140 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc89c0093b0 con 0x7fc8ac154190 2023-06-10T19:05:38.799 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.791+0000 7fc8aad9d640 1 --2- 172.21.15.53:0/511795140 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8ac154190 0x7fc8ac154610 secure :-1 s=READY pgs=1970 cs=0 l=1 rev1=1 crypto rx=0x7fc8a400c760 tx=0x7fc8a400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:38.799 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.791+0000 7fc8a37fe640 1 -- 172.21.15.53:0/511795140 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a4003b80 con 0x7fc8ac154190 2023-06-10T19:05:38.799 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.791+0000 7fc8a37fe640 1 -- 172.21.15.53:0/511795140 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8a4003d00 con 0x7fc8ac154190 2023-06-10T19:05:38.799 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.791+0000 7fc8b0f9f640 1 -- 172.21.15.53:0/511795140 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8ac0acb50 con 0x7fc8ac154190 2023-06-10T19:05:38.800 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.791+0000 7fc8a37fe640 1 -- 172.21.15.53:0/511795140 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a400aa90 con 0x7fc8ac154190 2023-06-10T19:05:38.800 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.791+0000 7fc8b0f9f640 1 -- 172.21.15.53:0/511795140 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8ac0ad110 con 0x7fc8ac154190 2023-06-10T19:05:38.800 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.791+0000 7fc8b0f9f640 1 -- 172.21.15.53:0/511795140 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8ac06af90 con 0x7fc8ac154190 2023-06-10T19:05:38.801 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.791+0000 7fc8a37fe640 1 -- 172.21.15.53:0/511795140 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc8a400abf0 con 0x7fc8ac154190 2023-06-10T19:05:38.801 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.795+0000 7fc8a37fe640 1 --2- 172.21.15.53:0/511795140 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc88c066280 0x7fc88c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:38.801 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.795+0000 7fc8a37fe640 1 -- 172.21.15.53:0/511795140 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6105+0+0 (secure 0 0 0) 0x7fc8a4083c90 con 0x7fc8ac154190 2023-06-10T19:05:38.801 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.795+0000 7fc8aa59c640 1 --2- 172.21.15.53:0/511795140 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc88c066280 0x7fc88c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:38.801 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.795+0000 7fc8aa59c640 1 --2- 172.21.15.53:0/511795140 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc88c066280 0x7fc88c068730 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fc89c0ad000 tx=0x7fc89c0a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:38.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.799+0000 7fc8a37fe640 1 -- 172.21.15.53:0/511795140 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc8a4051050 con 0x7fc8ac154190 2023-06-10T19:05:38.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:38.979+0000 7fc8b0f9f640 1 -- 172.21.15.53:0/511795140 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fc8ac04d790 con 0x7fc8ac154190 2023-06-10T19:05:39.220 INFO:tasks.ceph.mon.a.smithi053.stderr:2023-06-10T19:05:39.219+0000 7f74752c1640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-06-10T19:05:39.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:39.223+0000 7fc8a37fe640 1 -- 172.21.15.53:0/511795140 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v70) v1 ==== 161+0+0 (secure 0 0 0) 0x7fc8a4054670 con 0x7fc8ac154190 2023-06-10T19:05:39.229 INFO:teuthology.orchestra.run.smithi053.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-06-10T19:05:39.232 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:39.227+0000 7fc8b0f9f640 1 -- 172.21.15.53:0/511795140 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc88c066280 msgr2=0x7fc88c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:39.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:39.227+0000 7fc8b0f9f640 1 --2- 172.21.15.53:0/511795140 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc88c066280 0x7fc88c068730 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fc89c0ad000 tx=0x7fc89c0a6000 comp rx=0 tx=0).stop 2023-06-10T19:05:39.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:39.227+0000 7fc8b0f9f640 1 -- 172.21.15.53:0/511795140 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8ac154190 msgr2=0x7fc8ac154610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:39.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:39.227+0000 7fc8b0f9f640 1 --2- 172.21.15.53:0/511795140 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8ac154190 0x7fc8ac154610 secure :-1 s=READY pgs=1970 cs=0 l=1 rev1=1 crypto rx=0x7fc8a400c760 tx=0x7fc8a400cc20 comp rx=0 tx=0).stop 2023-06-10T19:05:39.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:39.227+0000 7fc8b0f9f640 1 -- 172.21.15.53:0/511795140 shutdown_connections 2023-06-10T19:05:39.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:39.227+0000 7fc8b0f9f640 1 --2- 172.21.15.53:0/511795140 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc88c066280 0x7fc88c068730 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:39.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:39.227+0000 7fc8b0f9f640 1 --2- 172.21.15.53:0/511795140 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8ac154190 0x7fc8ac154610 unknown :-1 s=CLOSED pgs=1970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:39.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:39.227+0000 7fc8b0f9f640 1 --2- 172.21.15.53:0/511795140 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8ac1571a0 0x7fc8ac0ac040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:39.235 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:39.227+0000 7fc8b0f9f640 1 --2- 172.21.15.53:0/511795140 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8ac0afee0 0x7fc8ac0abb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:39.235 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:39.227+0000 7fc8b0f9f640 1 -- 172.21.15.53:0/511795140 >> 172.21.15.53:0/511795140 conn(0x7fc8ac0ce9e0 msgr2=0x7fc8ac1583d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:39.235 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:39.227+0000 7fc8b0f9f640 1 -- 172.21.15.53:0/511795140 shutdown_connections 2023-06-10T19:05:39.235 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:39.227+0000 7fc8b0f9f640 1 -- 172.21.15.53:0/511795140 wait complete. 2023-06-10T19:05:39.236 INFO:tasks.ceph.mds.c.smithi053.stderr: -3011> 2023-06-10T19:05:10.464+0000 7fbd7cdc7640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-06-10T19:05:39.251 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-06-10T19:05:39.279 INFO:tasks.ceph.mds.c.smithi053.stdout:starting mds.c at 2023-06-10T19:05:39.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:39.371+0000 7ff1b6676640 1 Processor -- start 2023-06-10T19:05:39.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:39.371+0000 7ff1b6676640 1 -- start start 2023-06-10T19:05:39.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:39.371+0000 7ff1b6676640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1b006c350 0x7ff1b00cb820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:39.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:39.371+0000 7ff1b6676640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff1b00af760 0x7ff1b00afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:39.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:39.371+0000 7ff1b6676640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1b00ac910 con 0x7ff1b00c97d0 2023-06-10T19:05:39.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:39.371+0000 7ff1b6676640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1b00ca5c0 con 0x7ff1b00af760 2023-06-10T19:05:39.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:39.371+0000 7ff1b6676640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b00b0120 con 0x7ff1b006c350 2023-06-10T19:05:39.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:39.371+0000 7ff1b4c13640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff1b00af760 0x7ff1b00afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:39.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:39.371+0000 7ff1affff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ff1b00c97d0 0x7ff1b00ac200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60366/0 (socket says 172.21.15.53:60366) 2023-06-10T19:05:39.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:39.371+0000 7ff1b4c13640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff1b00af760 0x7ff1b00afbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58370/0 (socket says 172.21.15.53:58370) 2023-06-10T19:05:39.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:39.371+0000 7ff1affff640 1 -- 172.21.15.53:0/1174564494 learned_addr learned my addr 172.21.15.53:0/1174564494 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:05:39.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:39.371+0000 7ff1af7fe640 1 --2- 172.21.15.53:0/1174564494 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1b006c350 0x7ff1b00cb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:39.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:39.375+0000 7ff1b4c13640 1 -- 172.21.15.53:0/1174564494 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1b006c350 msgr2=0x7ff1b00cb820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:39.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:39.375+0000 7ff1b4c13640 1 --2- 172.21.15.53:0/1174564494 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1b006c350 0x7ff1b00cb820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:39.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:39.375+0000 7ff1b4c13640 1 -- 172.21.15.53:0/1174564494 >> v1:172.21.15.53:6789/0 conn(0x7ff1b00c97d0 legacy=0x7ff1b00ac200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:39.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:39.375+0000 7ff1b4c13640 1 -- 172.21.15.53:0/1174564494 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1b00cbd60 con 0x7ff1b00af760 2023-06-10T19:05:39.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:39.375+0000 7ff1aeffd640 1 -- 172.21.15.53:0/1174564494 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3663037581 0 0) 0x7ff1b00ac910 con 0x7ff1b00c97d0 2023-06-10T19:05:39.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:39.375+0000 7ff1b4c13640 1 --2- 172.21.15.53:0/1174564494 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1b00af760 0x7ff1b00afbe0 secure :-1 s=READY pgs=1974 cs=0 l=1 rev1=1 crypto rx=0x7ff1a0009d90 tx=0x7ff1a001c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=222b0147e2169b83 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:39.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:39.375+0000 7ff1aeffd640 1 -- 172.21.15.53:0/1174564494 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a00a6700 con 0x7ff1b00af760 2023-06-10T19:05:39.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:39.375+0000 7ff1aeffd640 1 -- 172.21.15.53:0/1174564494 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1a00a6860 con 0x7ff1b00af760 2023-06-10T19:05:39.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:39.375+0000 7ff1aeffd640 1 -- 172.21.15.53:0/1174564494 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a00a6bf0 con 0x7ff1b00af760 2023-06-10T19:05:39.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:39.375+0000 7ff1b6676640 1 -- 172.21.15.53:0/1174564494 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1b00af760 msgr2=0x7ff1b00afbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:39.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:39.375+0000 7ff1b6676640 1 --2- 172.21.15.53:0/1174564494 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1b00af760 0x7ff1b00afbe0 secure :-1 s=READY pgs=1974 cs=0 l=1 rev1=1 crypto rx=0x7ff1a0009d90 tx=0x7ff1a001c830 comp rx=0 tx=0).stop 2023-06-10T19:05:39.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:39.375+0000 7ff1b6676640 1 -- 172.21.15.53:0/1174564494 shutdown_connections 2023-06-10T19:05:39.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:39.375+0000 7ff1b6676640 1 --2- 172.21.15.53:0/1174564494 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1b00af760 0x7ff1b00afbe0 unknown :-1 s=CLOSED pgs=1974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:39.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:39.375+0000 7ff1b6676640 1 --2- 172.21.15.53:0/1174564494 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1b006c350 0x7ff1b00cb820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:39.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:39.375+0000 7ff1b6676640 1 -- 172.21.15.53:0/1174564494 >> 172.21.15.53:0/1174564494 conn(0x7ff1b006a0e0 msgr2=0x7ff1b00cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:39.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:39.375+0000 7ff1b6676640 1 -- 172.21.15.53:0/1174564494 shutdown_connections 2023-06-10T19:05:39.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:39.375+0000 7ff1b6676640 1 -- 172.21.15.53:0/1174564494 wait complete. 2023-06-10T19:05:39.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:39.379+0000 7ff1b6676640 1 Processor -- start 2023-06-10T19:05:39.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:39.379+0000 7ff1b6676640 1 -- start start 2023-06-10T19:05:39.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:39.379+0000 7ff1b6676640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1b006c350 0x7ff1b014d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:39.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:39.379+0000 7ff1b6676640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1b00af760 0x7ff1b015a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:39.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:39.379+0000 7ff1b6676640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1b00c97d0 0x7ff1b01538d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:39.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:39.379+0000 7ff1b6676640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b01593a0 con 0x7ff1b00af760 2023-06-10T19:05:39.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:39.379+0000 7ff1b6676640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b0153440 con 0x7ff1b00c97d0 2023-06-10T19:05:39.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:39.379+0000 7ff1b6676640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b0158de0 con 0x7ff1b006c350 2023-06-10T19:05:39.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:39.379+0000 7ff1af7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1b00af760 0x7ff1b015a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:39.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:39.379+0000 7ff1af7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1b00af760 0x7ff1b015a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58372/0 (socket says 172.21.15.53:58372) 2023-06-10T19:05:39.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:39.379+0000 7ff1af7fe640 1 -- 172.21.15.53:0/1213903654 learned_addr learned my addr 172.21.15.53:0/1213903654 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:39.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:39.379+0000 7ff1affff640 1 --2- 172.21.15.53:0/1213903654 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1b006c350 0x7ff1b014d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:39.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:39.379+0000 7ff1b4c13640 1 --2- 172.21.15.53:0/1213903654 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1b00c97d0 0x7ff1b01538d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:39.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:39.379+0000 7ff1af7fe640 1 -- 172.21.15.53:0/1213903654 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1b006c350 msgr2=0x7ff1b014d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:39.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:39.379+0000 7ff1af7fe640 1 --2- 172.21.15.53:0/1213903654 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1b006c350 0x7ff1b014d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:39.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:39.379+0000 7ff1af7fe640 1 -- 172.21.15.53:0/1213903654 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1b00c97d0 msgr2=0x7ff1b01538d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:39.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:39.379+0000 7ff1af7fe640 1 --2- 172.21.15.53:0/1213903654 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1b00c97d0 0x7ff1b01538d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:39.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:39.379+0000 7ff1af7fe640 1 -- 172.21.15.53:0/1213903654 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1a0009a70 con 0x7ff1b00af760 2023-06-10T19:05:39.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:39.379+0000 7ff1affff640 1 --2- 172.21.15.53:0/1213903654 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1b006c350 0x7ff1b014d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:05:39.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:39.379+0000 7ff1af7fe640 1 --2- 172.21.15.53:0/1213903654 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1b00af760 0x7ff1b015a7c0 secure :-1 s=READY pgs=1975 cs=0 l=1 rev1=1 crypto rx=0x7ff19800d5f0 tx=0x7ff19800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:39.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:39.379+0000 7ff1acff9640 1 -- 172.21.15.53:0/1213903654 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1980125f0 con 0x7ff1b00af760 2023-06-10T19:05:39.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:39.379+0000 7ff1acff9640 1 -- 172.21.15.53:0/1213903654 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff198012750 con 0x7ff1b00af760 2023-06-10T19:05:39.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:39.379+0000 7ff1b6676640 1 -- 172.21.15.53:0/1213903654 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1b01590c0 con 0x7ff1b00af760 2023-06-10T19:05:39.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:39.379+0000 7ff1acff9640 1 -- 172.21.15.53:0/1213903654 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff198012ae0 con 0x7ff1b00af760 2023-06-10T19:05:39.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:39.379+0000 7ff1b6676640 1 -- 172.21.15.53:0/1213903654 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1b014dac0 con 0x7ff1b00af760 2023-06-10T19:05:39.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:39.379+0000 7ff1b6676640 1 -- 172.21.15.53:0/1213903654 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1b004d790 con 0x7ff1b00af760 2023-06-10T19:05:39.395 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:39.379+0000 7ff1acff9640 1 -- 172.21.15.53:0/1213903654 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff198012c40 con 0x7ff1b00af760 2023-06-10T19:05:39.395 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:39.379+0000 7ff1acff9640 1 --2- 172.21.15.53:0/1213903654 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff190066280 0x7ff190068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:39.395 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:39.379+0000 7ff1acff9640 1 -- 172.21.15.53:0/1213903654 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6191+0+0 (secure 0 0 0) 0x7ff1980842c0 con 0x7ff1b00af760 2023-06-10T19:05:39.395 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:39.383+0000 7ff1affff640 1 --2- 172.21.15.53:0/1213903654 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff190066280 0x7ff190068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:39.395 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:39.383+0000 7ff1affff640 1 --2- 172.21.15.53:0/1213903654 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff190066280 0x7ff190068730 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7ff1a8007fd0 tx=0x7ff1a8007c20 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:39.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:39.387+0000 7ff1acff9640 1 -- 172.21.15.53:0/1213903654 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff1980516c0 con 0x7ff1b00af760 2023-06-10T19:05:39.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:39.579+0000 7ff1b6676640 1 -- 172.21.15.53:0/1213903654 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff1b0153580 con 0x7ff1b00af760 2023-06-10T19:05:40.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:40.235+0000 7ff1acff9640 1 -- 172.21.15.53:0/1213903654 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v71) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff198054ce0 con 0x7ff1b00af760 2023-06-10T19:05:40.244 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:40.239+0000 7ff1b6676640 1 -- 172.21.15.53:0/1213903654 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff190066280 msgr2=0x7ff190068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:40.245 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:40.239+0000 7ff1b6676640 1 --2- 172.21.15.53:0/1213903654 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff190066280 0x7ff190068730 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7ff1a8007fd0 tx=0x7ff1a8007c20 comp rx=0 tx=0).stop 2023-06-10T19:05:40.245 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:40.239+0000 7ff1b6676640 1 -- 172.21.15.53:0/1213903654 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1b00af760 msgr2=0x7ff1b015a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:40.245 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:40.239+0000 7ff1b6676640 1 --2- 172.21.15.53:0/1213903654 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1b00af760 0x7ff1b015a7c0 secure :-1 s=READY pgs=1975 cs=0 l=1 rev1=1 crypto rx=0x7ff19800d5f0 tx=0x7ff19800dab0 comp rx=0 tx=0).stop 2023-06-10T19:05:40.245 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:40.239+0000 7ff1b6676640 1 -- 172.21.15.53:0/1213903654 shutdown_connections 2023-06-10T19:05:40.245 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:40.239+0000 7ff1b6676640 1 --2- 172.21.15.53:0/1213903654 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff190066280 0x7ff190068730 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:40.246 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:40.239+0000 7ff1b6676640 1 --2- 172.21.15.53:0/1213903654 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1b00c97d0 0x7ff1b01538d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:40.246 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:40.239+0000 7ff1b6676640 1 --2- 172.21.15.53:0/1213903654 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff1b00af760 0x7ff1b015a7c0 unknown :-1 s=CLOSED pgs=1975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:40.246 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:40.239+0000 7ff1b6676640 1 --2- 172.21.15.53:0/1213903654 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff1b006c350 0x7ff1b014d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:40.246 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:40.239+0000 7ff1b6676640 1 -- 172.21.15.53:0/1213903654 >> 172.21.15.53:0/1213903654 conn(0x7ff1b006a0e0 msgr2=0x7ff1b00723f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:40.246 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:40.239+0000 7ff1b6676640 1 -- 172.21.15.53:0/1213903654 shutdown_connections 2023-06-10T19:05:40.246 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:40.239+0000 7ff1b6676640 1 -- 172.21.15.53:0/1213903654 wait complete. 2023-06-10T19:05:40.266 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-06-10T19:05:40.445 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:40.439+0000 7f77c4345640 1 Processor -- start 2023-06-10T19:05:40.445 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:40.439+0000 7f77c4345640 1 -- start start 2023-06-10T19:05:40.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:40.439+0000 7f77c4345640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f77bc15d0b0 0x7f77bc0c8e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:40.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:40.439+0000 7f77c4345640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f77bc158bc0 0x7f77bc0cbe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:40.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:40.439+0000 7f77c4345640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77bc159120 con 0x7f77bc06c210 2023-06-10T19:05:40.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:40.439+0000 7f77c4345640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77bc159400 con 0x7f77bc158bc0 2023-06-10T19:05:40.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:40.439+0000 7f77c4345640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77bc1596e0 con 0x7f77bc15d0b0 2023-06-10T19:05:40.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:40.439+0000 7f77c28e2640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f77bc158bc0 0x7f77bc0cbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:40.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:40.439+0000 7f77c28e2640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f77bc158bc0 0x7f77bc0cbe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58386/0 (socket says 172.21.15.53:58386) 2023-06-10T19:05:40.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:40.439+0000 7f77c28e2640 1 -- 172.21.15.53:0/3898768213 learned_addr learned my addr 172.21.15.53:0/3898768213 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:40.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:40.439+0000 7f77c18e0640 1 --2- 172.21.15.53:0/3898768213 >> v2:172.21.15.117:3300/0 conn(0x7f77bc15d0b0 0x7f77bc0c8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:40.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:40.439+0000 7f77c28e2640 1 -- 172.21.15.53:0/3898768213 >> v2:172.21.15.117:3300/0 conn(0x7f77bc15d0b0 msgr2=0x7f77bc0c8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:40.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:40.443+0000 7f77c28e2640 1 --2- 172.21.15.53:0/3898768213 >> v2:172.21.15.117:3300/0 conn(0x7f77bc15d0b0 0x7f77bc0c8e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:40.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:40.443+0000 7f77c28e2640 1 -- 172.21.15.53:0/3898768213 >> v1:172.21.15.117:6789/0 conn(0x7f77bc06c210 legacy=0x7f77bc06c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:40.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:40.443+0000 7f77c28e2640 1 -- 172.21.15.53:0/3898768213 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77bc1599c0 con 0x7f77bc158bc0 2023-06-10T19:05:40.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:40.443+0000 7f77c18e0640 1 --2- 172.21.15.53:0/3898768213 >> v2:172.21.15.117:3300/0 conn(0x7f77bc15d0b0 0x7f77bc0c8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:05:40.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:40.447+0000 7f77c28e2640 1 --2- 172.21.15.53:0/3898768213 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f77bc158bc0 0x7f77bc0cbe20 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 crypto rx=0x7f77bc0b0930 tx=0x7f77b401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4f1037ca27784df server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:40.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:40.447+0000 7f77c10df640 1 -- 172.21.15.53:0/3898768213 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b40a58b0 con 0x7f77bc158bc0 2023-06-10T19:05:40.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:40.447+0000 7f77c10df640 1 -- 172.21.15.53:0/3898768213 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77b40a5a10 con 0x7f77bc158bc0 2023-06-10T19:05:40.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:40.447+0000 7f77c10df640 1 -- 172.21.15.53:0/3898768213 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b40a5da0 con 0x7f77bc158bc0 2023-06-10T19:05:40.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:40.447+0000 7f77c4345640 1 -- 172.21.15.53:0/3898768213 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f77bc158bc0 msgr2=0x7f77bc0cbe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:40.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:40.447+0000 7f77c4345640 1 --2- 172.21.15.53:0/3898768213 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f77bc158bc0 0x7f77bc0cbe20 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 crypto rx=0x7f77bc0b0930 tx=0x7f77b401c9d0 comp rx=0 tx=0).stop 2023-06-10T19:05:40.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:40.447+0000 7f77c4345640 1 -- 172.21.15.53:0/3898768213 shutdown_connections 2023-06-10T19:05:40.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:40.447+0000 7f77c4345640 1 --2- 172.21.15.53:0/3898768213 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f77bc158bc0 0x7f77bc0cbe20 unknown :-1 s=CLOSED pgs=1976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:40.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:40.447+0000 7f77c4345640 1 --2- 172.21.15.53:0/3898768213 >> v2:172.21.15.117:3300/0 conn(0x7f77bc15d0b0 0x7f77bc0c8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:40.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:40.447+0000 7f77c4345640 1 -- 172.21.15.53:0/3898768213 >> 172.21.15.53:0/3898768213 conn(0x7f77bc0ca830 msgr2=0x7f77bc0cac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:40.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:40.447+0000 7f77c4345640 1 -- 172.21.15.53:0/3898768213 shutdown_connections 2023-06-10T19:05:40.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:40.447+0000 7f77c4345640 1 -- 172.21.15.53:0/3898768213 wait complete. 2023-06-10T19:05:40.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:40.447+0000 7f77c4345640 1 Processor -- start 2023-06-10T19:05:40.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:40.447+0000 7f77c4345640 1 -- start start 2023-06-10T19:05:40.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:40.451+0000 7f77c4345640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77bc06c210 0x7f77bc14d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:40.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:40.451+0000 7f77c4345640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f77bc158bc0 0x7f77bc155110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:40.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:40.451+0000 7f77c4345640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77bc15d0b0 0x7f77bc155650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:40.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:40.451+0000 7f77c4345640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77bc153870 con 0x7f77bc158bc0 2023-06-10T19:05:40.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:40.451+0000 7f77c4345640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77bc153b50 con 0x7f77bc15d0b0 2023-06-10T19:05:40.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:40.451+0000 7f77c4345640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77bc153e30 con 0x7f77bc06c210 2023-06-10T19:05:40.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:40.451+0000 7f77c18e0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f77bc158bc0 0x7f77bc155110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:40.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:40.451+0000 7f77c18e0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f77bc158bc0 0x7f77bc155110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58396/0 (socket says 172.21.15.53:58396) 2023-06-10T19:05:40.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:40.451+0000 7f77c18e0640 1 -- 172.21.15.53:0/3333083666 learned_addr learned my addr 172.21.15.53:0/3333083666 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:40.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:40.451+0000 7f77c20e1640 1 --2- 172.21.15.53:0/3333083666 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77bc06c210 0x7f77bc14d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:40.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:40.451+0000 7f77c28e2640 1 --2- 172.21.15.53:0/3333083666 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77bc15d0b0 0x7f77bc155650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:40.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:40.451+0000 7f77c18e0640 1 -- 172.21.15.53:0/3333083666 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77bc06c210 msgr2=0x7f77bc14d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:40.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:40.451+0000 7f77c18e0640 1 --2- 172.21.15.53:0/3333083666 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77bc06c210 0x7f77bc14d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:40.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:40.451+0000 7f77c18e0640 1 -- 172.21.15.53:0/3333083666 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77bc15d0b0 msgr2=0x7f77bc155650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:40.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:40.451+0000 7f77c18e0640 1 --2- 172.21.15.53:0/3333083666 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77bc15d0b0 0x7f77bc155650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:40.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:40.451+0000 7f77c18e0640 1 -- 172.21.15.53:0/3333083666 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77b4009b30 con 0x7f77bc158bc0 2023-06-10T19:05:40.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:40.451+0000 7f77c18e0640 1 --2- 172.21.15.53:0/3333083666 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f77bc158bc0 0x7f77bc155110 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 crypto rx=0x7f77ac00e810 tx=0x7f77ac00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:40.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:40.451+0000 7f77b2ffd640 1 -- 172.21.15.53:0/3333083666 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77ac00c8d0 con 0x7f77bc158bc0 2023-06-10T19:05:40.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:40.451+0000 7f77b2ffd640 1 -- 172.21.15.53:0/3333083666 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77ac00ca30 con 0x7f77bc158bc0 2023-06-10T19:05:40.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:40.451+0000 7f77b2ffd640 1 -- 172.21.15.53:0/3333083666 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77ac00cdc0 con 0x7f77bc158bc0 2023-06-10T19:05:40.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:40.451+0000 7f77c4345640 1 -- 172.21.15.53:0/3333083666 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77bc154110 con 0x7f77bc158bc0 2023-06-10T19:05:40.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:40.451+0000 7f77c4345640 1 -- 172.21.15.53:0/3333083666 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77bc152c40 con 0x7f77bc158bc0 2023-06-10T19:05:40.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:40.451+0000 7f77c4345640 1 -- 172.21.15.53:0/3333083666 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77bc04d790 con 0x7f77bc158bc0 2023-06-10T19:05:40.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:40.451+0000 7f77b2ffd640 1 -- 172.21.15.53:0/3333083666 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f77ac013410 con 0x7f77bc158bc0 2023-06-10T19:05:40.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:40.451+0000 7f77b2ffd640 1 --2- 172.21.15.53:0/3333083666 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f77a0066280 0x7f77a0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:40.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:40.451+0000 7f77b2ffd640 1 -- 172.21.15.53:0/3333083666 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6191+0+0 (secure 0 0 0) 0x7f77ac083ba0 con 0x7f77bc158bc0 2023-06-10T19:05:40.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:40.451+0000 7f77c20e1640 1 --2- 172.21.15.53:0/3333083666 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f77a0066280 0x7f77a0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:40.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:40.455+0000 7f77c20e1640 1 --2- 172.21.15.53:0/3333083666 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f77a0066280 0x7f77a0068730 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f77b8000f70 tx=0x7f77b8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:40.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:40.455+0000 7f77b2ffd640 1 -- 172.21.15.53:0/3333083666 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f77ac050fa0 con 0x7f77bc158bc0 2023-06-10T19:05:40.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:40.623+0000 7f77c4345640 1 -- 172.21.15.53:0/3333083666 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f77bc0b0770 con 0x7f77bc158bc0 2023-06-10T19:05:41.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.319+0000 7f77b2ffd640 1 -- 172.21.15.53:0/3333083666 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v128) v1 ==== 181+0+0 (secure 0 0 0) 0x7f77ac009480 con 0x7f77bc158bc0 2023-06-10T19:05:41.327 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_metadata' removed 2023-06-10T19:05:41.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.323+0000 7f77c4345640 1 -- 172.21.15.53:0/3333083666 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f77a0066280 msgr2=0x7f77a0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:41.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.323+0000 7f77c4345640 1 --2- 172.21.15.53:0/3333083666 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f77a0066280 0x7f77a0068730 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f77b8000f70 tx=0x7f77b8009040 comp rx=0 tx=0).stop 2023-06-10T19:05:41.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.323+0000 7f77c4345640 1 -- 172.21.15.53:0/3333083666 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f77bc158bc0 msgr2=0x7f77bc155110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:41.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.323+0000 7f77c4345640 1 --2- 172.21.15.53:0/3333083666 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f77bc158bc0 0x7f77bc155110 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 crypto rx=0x7f77ac00e810 tx=0x7f77ac00ecd0 comp rx=0 tx=0).stop 2023-06-10T19:05:41.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.327+0000 7f77c4345640 1 -- 172.21.15.53:0/3333083666 shutdown_connections 2023-06-10T19:05:41.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.327+0000 7f77c4345640 1 --2- 172.21.15.53:0/3333083666 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f77a0066280 0x7f77a0068730 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:41.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.327+0000 7f77c4345640 1 --2- 172.21.15.53:0/3333083666 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77bc15d0b0 0x7f77bc155650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:41.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.327+0000 7f77c4345640 1 --2- 172.21.15.53:0/3333083666 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f77bc158bc0 0x7f77bc155110 unknown :-1 s=CLOSED pgs=1977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:41.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.327+0000 7f77c4345640 1 --2- 172.21.15.53:0/3333083666 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77bc06c210 0x7f77bc14d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:41.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.327+0000 7f77c4345640 1 -- 172.21.15.53:0/3333083666 >> 172.21.15.53:0/3333083666 conn(0x7f77bc0ca830 msgr2=0x7f77bc0c7fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:41.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.327+0000 7f77c4345640 1 -- 172.21.15.53:0/3333083666 shutdown_connections 2023-06-10T19:05:41.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.327+0000 7f77c4345640 1 -- 172.21.15.53:0/3333083666 wait complete. 2023-06-10T19:05:41.358 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-06-10T19:05:41.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.487+0000 7f0ac5c43640 1 Processor -- start 2023-06-10T19:05:41.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.487+0000 7f0ac5c43640 1 -- start start 2023-06-10T19:05:41.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.487+0000 7f0ac5c43640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0ac015b930 0x7f0ac015f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:41.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.487+0000 7f0ac5c43640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0ac00cfc30 0x7f0ac00d00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:41.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.487+0000 7f0ac5c43640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ac015bd00 con 0x7f0ac00b1490 2023-06-10T19:05:41.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.487+0000 7f0ac5c43640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ac00cf5e0 con 0x7f0ac015b930 2023-06-10T19:05:41.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.487+0000 7f0ac5c43640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac00cf020 con 0x7f0ac00cfc30 2023-06-10T19:05:41.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.487+0000 7f0abeffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f0ac00b1490 0x7f0ac015f940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:43762/0 (socket says 172.21.15.53:43762) 2023-06-10T19:05:41.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.487+0000 7f0abeffd640 1 -- 172.21.15.53:0/888688446 learned_addr learned my addr 172.21.15.53:0/888688446 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:05:41.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.487+0000 7f0abf7fe640 1 --2- 172.21.15.53:0/888688446 >> v2:172.21.15.117:3300/0 conn(0x7f0ac015b930 0x7f0ac015f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:41.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.487+0000 7f0abffff640 1 --2- 172.21.15.53:0/888688446 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0ac00cfc30 0x7f0ac00d00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:41.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.487+0000 7f0abe7fc640 1 -- 172.21.15.53:0/888688446 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3402411147 0 0) 0x7f0ac015bd00 con 0x7f0ac00b1490 2023-06-10T19:05:41.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.487+0000 7f0abe7fc640 1 -- 172.21.15.53:0/888688446 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0aac003530 con 0x7f0ac00b1490 2023-06-10T19:05:41.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.487+0000 7f0abe7fc640 1 -- 172.21.15.53:0/888688446 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2048424623 0 0) 0x7f0aac003530 con 0x7f0ac00b1490 2023-06-10T19:05:41.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.487+0000 7f0abe7fc640 1 -- 172.21.15.53:0/888688446 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0ac00cfc30 msgr2=0x7f0ac00d00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:41.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.487+0000 7f0abe7fc640 1 --2- 172.21.15.53:0/888688446 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0ac00cfc30 0x7f0ac00d00d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:41.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.487+0000 7f0abe7fc640 1 -- 172.21.15.53:0/888688446 >> v2:172.21.15.117:3300/0 conn(0x7f0ac015b930 msgr2=0x7f0ac015f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:41.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.487+0000 7f0abe7fc640 1 --2- 172.21.15.53:0/888688446 >> v2:172.21.15.117:3300/0 conn(0x7f0ac015b930 0x7f0ac015f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:41.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.487+0000 7f0abe7fc640 1 -- 172.21.15.53:0/888688446 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ac00cf300 con 0x7f0ac00b1490 2023-06-10T19:05:41.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.487+0000 7f0abe7fc640 1 -- 172.21.15.53:0/888688446 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f0aa8001680 con 0x7f0ac00b1490 2023-06-10T19:05:41.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.487+0000 7f0abe7fc640 1 -- 172.21.15.53:0/888688446 >> v1:172.21.15.53:6789/0 conn(0x7f0ac00b1490 legacy=0x7f0ac015f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:41.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.487+0000 7f0abe7fc640 1 --2- 172.21.15.53:0/888688446 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0aac003980 0x7f0aac003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:41.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.487+0000 7f0abe7fc640 1 --2- 172.21.15.53:0/888688446 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0aac0043b0 0x7f0aac004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:41.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.487+0000 7f0abe7fc640 1 --2- 172.21.15.53:0/888688446 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0ac00cfc30 0x7f0aac004f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:41.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.487+0000 7f0abe7fc640 1 -- 172.21.15.53:0/888688446 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac00cf5e0 con 0x7f0aac0043b0 2023-06-10T19:05:41.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.487+0000 7f0abe7fc640 1 -- 172.21.15.53:0/888688446 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac00cf020 con 0x7f0aac003980 2023-06-10T19:05:41.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.491+0000 7f0abe7fc640 1 -- 172.21.15.53:0/888688446 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aac00b990 con 0x7f0ac00cfc30 2023-06-10T19:05:41.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.491+0000 7f0abeffd640 1 --2- 172.21.15.53:0/888688446 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0aac0043b0 0x7f0aac004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:41.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.491+0000 7f0abf7fe640 1 --2- 172.21.15.53:0/888688446 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0aac003980 0x7f0aac003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:41.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.491+0000 7f0abffff640 1 --2- 172.21.15.53:0/888688446 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0ac00cfc30 0x7f0aac004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:41.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.491+0000 7f0abeffd640 1 -- 172.21.15.53:0/888688446 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0ac00cfc30 msgr2=0x7f0aac004f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:41.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.491+0000 7f0abeffd640 1 --2- 172.21.15.53:0/888688446 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0ac00cfc30 0x7f0aac004f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:41.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.491+0000 7f0abeffd640 1 -- 172.21.15.53:0/888688446 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0aac003980 msgr2=0x7f0aac003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:41.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.491+0000 7f0abeffd640 1 --2- 172.21.15.53:0/888688446 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0aac003980 0x7f0aac003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:41.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.491+0000 7f0abeffd640 1 -- 172.21.15.53:0/888688446 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aac003530 con 0x7f0aac0043b0 2023-06-10T19:05:41.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.491+0000 7f0abf7fe640 1 --2- 172.21.15.53:0/888688446 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0aac003980 0x7f0aac003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:05:41.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.491+0000 7f0abeffd640 1 --2- 172.21.15.53:0/888688446 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0aac0043b0 0x7f0aac004870 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 crypto rx=0x7f0aa800c290 tx=0x7f0aa801f430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6a9eff3e2ec5327 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:41.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.491+0000 7f0abe7fc640 1 -- 172.21.15.53:0/888688446 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa8005ae0 con 0x7f0aac0043b0 2023-06-10T19:05:41.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.491+0000 7f0abe7fc640 1 -- 172.21.15.53:0/888688446 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aa80ab070 con 0x7f0aac0043b0 2023-06-10T19:05:41.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.491+0000 7f0abe7fc640 1 -- 172.21.15.53:0/888688446 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa8005e80 con 0x7f0aac0043b0 2023-06-10T19:05:41.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.491+0000 7f0ac5c43640 1 -- 172.21.15.53:0/888688446 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0aac0043b0 msgr2=0x7f0aac004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:41.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.491+0000 7f0ac5c43640 1 --2- 172.21.15.53:0/888688446 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0aac0043b0 0x7f0aac004870 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 crypto rx=0x7f0aa800c290 tx=0x7f0aa801f430 comp rx=0 tx=0).stop 2023-06-10T19:05:41.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.491+0000 7f0abffff640 1 -- 172.21.15.53:0/888688446 reap_dead start 2023-06-10T19:05:41.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.491+0000 7f0ac5c43640 1 -- 172.21.15.53:0/888688446 shutdown_connections 2023-06-10T19:05:41.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.491+0000 7f0ac5c43640 1 -- 172.21.15.53:0/888688446 >> 172.21.15.53:0/888688446 conn(0x7f0ac0069d70 msgr2=0x7f0ac006a170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:41.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.495+0000 7f0ac5c43640 1 -- 172.21.15.53:0/888688446 shutdown_connections 2023-06-10T19:05:41.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.495+0000 7f0ac5c43640 1 -- 172.21.15.53:0/888688446 wait complete. 2023-06-10T19:05:41.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.495+0000 7f0ac5c43640 1 Processor -- start 2023-06-10T19:05:41.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.495+0000 7f0ac5c43640 1 -- start start 2023-06-10T19:05:41.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.495+0000 7f0ac5c43640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0aac0043b0 0x7f0ac0148430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:41.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.495+0000 7f0ac5c43640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ac00c73e0 0x7f0ac00c7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:41.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.495+0000 7f0ac5c43640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0ac0155030 0x7f0ac01554a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:41.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.495+0000 7f0ac5c43640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac01559e0 con 0x7f0aac0043b0 2023-06-10T19:05:41.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.495+0000 7f0ac5c43640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac015c1a0 con 0x7f0ac00c73e0 2023-06-10T19:05:41.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.495+0000 7f0ac5c43640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac00c8460 con 0x7f0ac0155030 2023-06-10T19:05:41.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.495+0000 7f0abf7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0aac0043b0 0x7f0ac0148430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:41.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.495+0000 7f0abf7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0aac0043b0 0x7f0ac0148430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57264/0 (socket says 172.21.15.53:57264) 2023-06-10T19:05:41.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.495+0000 7f0abf7fe640 1 -- 172.21.15.53:0/31740165 learned_addr learned my addr 172.21.15.53:0/31740165 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:41.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.495+0000 7f0abffff640 1 --2- 172.21.15.53:0/31740165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0ac0155030 0x7f0ac01554a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:41.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.495+0000 7f0abeffd640 1 --2- 172.21.15.53:0/31740165 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ac00c73e0 0x7f0ac00c7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:41.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.495+0000 7f0abf7fe640 1 -- 172.21.15.53:0/31740165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0ac0155030 msgr2=0x7f0ac01554a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:41.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.495+0000 7f0abf7fe640 1 --2- 172.21.15.53:0/31740165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0ac0155030 0x7f0ac01554a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:41.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.495+0000 7f0abf7fe640 1 -- 172.21.15.53:0/31740165 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ac00c73e0 msgr2=0x7f0ac00c7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:41.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.495+0000 7f0abf7fe640 1 --2- 172.21.15.53:0/31740165 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ac00c73e0 0x7f0ac00c7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:41.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.495+0000 7f0abf7fe640 1 -- 172.21.15.53:0/31740165 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ac0148970 con 0x7f0aac0043b0 2023-06-10T19:05:41.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.495+0000 7f0abffff640 1 --2- 172.21.15.53:0/31740165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0ac0155030 0x7f0ac01554a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:05:41.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.495+0000 7f0abf7fe640 1 --2- 172.21.15.53:0/31740165 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0aac0043b0 0x7f0ac0148430 secure :-1 s=READY pgs=1980 cs=0 l=1 rev1=1 crypto rx=0x7f0ab0007f30 tx=0x7f0ab0010650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:41.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.495+0000 7f0ab7fff640 1 -- 172.21.15.53:0/31740165 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab000e050 con 0x7f0aac0043b0 2023-06-10T19:05:41.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.495+0000 7f0ab7fff640 1 -- 172.21.15.53:0/31740165 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ab000f040 con 0x7f0aac0043b0 2023-06-10T19:05:41.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.495+0000 7f0ac5c43640 1 -- 172.21.15.53:0/31740165 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ac00c7ea0 con 0x7f0aac0043b0 2023-06-10T19:05:41.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.495+0000 7f0ab7fff640 1 -- 172.21.15.53:0/31740165 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab0003bc0 con 0x7f0aac0043b0 2023-06-10T19:05:41.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.495+0000 7f0ac5c43640 1 -- 172.21.15.53:0/31740165 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ac015be30 con 0x7f0aac0043b0 2023-06-10T19:05:41.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.495+0000 7f0ac5c43640 1 -- 172.21.15.53:0/31740165 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ac00d2dc0 con 0x7f0aac0043b0 2023-06-10T19:05:41.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.499+0000 7f0ab7fff640 1 -- 172.21.15.53:0/31740165 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0ab0003d20 con 0x7f0aac0043b0 2023-06-10T19:05:41.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.499+0000 7f0ab7fff640 1 --2- 172.21.15.53:0/31740165 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0aa0066280 0x7f0aa0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:41.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.499+0000 7f0ab7fff640 1 -- 172.21.15.53:0/31740165 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5753+0+0 (secure 0 0 0) 0x7f0ab00849e0 con 0x7f0aac0043b0 2023-06-10T19:05:41.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.499+0000 7f0abeffd640 1 --2- 172.21.15.53:0/31740165 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0aa0066280 0x7f0aa0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:41.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.499+0000 7f0abeffd640 1 --2- 172.21.15.53:0/31740165 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0aa0066280 0x7f0aa0068730 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f0aa80ae000 tx=0x7f0aa8001a10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:41.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.503+0000 7f0ab7fff640 1 -- 172.21.15.53:0/31740165 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0ab0051f80 con 0x7f0aac0043b0 2023-06-10T19:05:41.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:41.655+0000 7f0ac5c43640 1 -- 172.21.15.53:0/31740165 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0ac00cc800 con 0x7f0aac0043b0 2023-06-10T19:05:42.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.319+0000 7f0ab7fff640 1 -- 172.21.15.53:0/31740165 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v129) v1 ==== 169+0+0 (secure 0 0 0) 0x7f0ab00555a0 con 0x7f0aac0043b0 2023-06-10T19:05:42.326 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_data' removed 2023-06-10T19:05:42.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.323+0000 7f0ac5c43640 1 -- 172.21.15.53:0/31740165 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0aa0066280 msgr2=0x7f0aa0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:42.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.323+0000 7f0ac5c43640 1 --2- 172.21.15.53:0/31740165 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0aa0066280 0x7f0aa0068730 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f0aa80ae000 tx=0x7f0aa8001a10 comp rx=0 tx=0).stop 2023-06-10T19:05:42.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.323+0000 7f0ac5c43640 1 -- 172.21.15.53:0/31740165 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0aac0043b0 msgr2=0x7f0ac0148430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:42.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.323+0000 7f0ac5c43640 1 --2- 172.21.15.53:0/31740165 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0aac0043b0 0x7f0ac0148430 secure :-1 s=READY pgs=1980 cs=0 l=1 rev1=1 crypto rx=0x7f0ab0007f30 tx=0x7f0ab0010650 comp rx=0 tx=0).stop 2023-06-10T19:05:42.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.323+0000 7f0ac5c43640 1 -- 172.21.15.53:0/31740165 shutdown_connections 2023-06-10T19:05:42.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.323+0000 7f0ac5c43640 1 --2- 172.21.15.53:0/31740165 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0aa0066280 0x7f0aa0068730 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:42.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.323+0000 7f0ac5c43640 1 --2- 172.21.15.53:0/31740165 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0ac0155030 0x7f0ac01554a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:42.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.323+0000 7f0ac5c43640 1 --2- 172.21.15.53:0/31740165 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ac00c73e0 0x7f0ac00c7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:42.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.323+0000 7f0ac5c43640 1 --2- 172.21.15.53:0/31740165 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0aac0043b0 0x7f0ac0148430 unknown :-1 s=CLOSED pgs=1980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:42.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.323+0000 7f0ac5c43640 1 -- 172.21.15.53:0/31740165 >> 172.21.15.53:0/31740165 conn(0x7f0ac0069d70 msgr2=0x7f0ac00b6ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:42.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.323+0000 7f0ac5c43640 1 -- 172.21.15.53:0/31740165 shutdown_connections 2023-06-10T19:05:42.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.323+0000 7f0ac5c43640 1 -- 172.21.15.53:0/31740165 wait complete. 2023-06-10T19:05:42.354 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-06-10T19:05:42.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.475+0000 7ff45ab57640 1 Processor -- start 2023-06-10T19:05:42.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.475+0000 7ff45ab57640 1 -- start start 2023-06-10T19:05:42.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.475+0000 7ff45ab57640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4540b0b90 0x7ff4540b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:42.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.475+0000 7ff45ab57640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4540cc7c0 con 0x7ff45415c090 2023-06-10T19:05:42.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.475+0000 7ff45ab57640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4540ccaa0 con 0x7ff4540b7e30 2023-06-10T19:05:42.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.475+0000 7ff45ab57640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4540ccd80 con 0x7ff4540b0b90 2023-06-10T19:05:42.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.475+0000 7ff4588f3640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ff45415c090 0x7ff4540b7720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:43772/0 (socket says 172.21.15.53:43772) 2023-06-10T19:05:42.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.475+0000 7ff4588f3640 1 -- 172.21.15.53:0/1048208294 learned_addr learned my addr 172.21.15.53:0/1048208294 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:05:42.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.475+0000 7ff4590f4640 1 --2- 172.21.15.53:0/1048208294 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4540b0b90 0x7ff4540b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:42.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.475+0000 7ff4537fe640 1 -- 172.21.15.53:0/1048208294 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1698162840 0 0) 0x7ff4540cc7c0 con 0x7ff45415c090 2023-06-10T19:05:42.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.475+0000 7ff4537fe640 1 -- 172.21.15.53:0/1048208294 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff444003530 con 0x7ff45415c090 2023-06-10T19:05:42.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.475+0000 7ff4537fe640 1 -- 172.21.15.53:0/1048208294 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 807297502 0 0) 0x7ff444003530 con 0x7ff45415c090 2023-06-10T19:05:42.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.475+0000 7ff4537fe640 1 -- 172.21.15.53:0/1048208294 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4540b0b90 msgr2=0x7ff4540b10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:42.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.475+0000 7ff4537fe640 1 --2- 172.21.15.53:0/1048208294 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4540b0b90 0x7ff4540b10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:42.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.475+0000 7ff4537fe640 1 -- 172.21.15.53:0/1048208294 >> v1:172.21.15.117:6789/0 conn(0x7ff4540b7e30 legacy=0x7ff4540d04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:42.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.475+0000 7ff4537fe640 1 -- 172.21.15.53:0/1048208294 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4540cd060 con 0x7ff45415c090 2023-06-10T19:05:42.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.475+0000 7ff4537fe640 1 -- 172.21.15.53:0/1048208294 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7ff4480016a0 con 0x7ff45415c090 2023-06-10T19:05:42.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.475+0000 7ff4537fe640 1 -- 172.21.15.53:0/1048208294 >> v1:172.21.15.53:6789/0 conn(0x7ff45415c090 legacy=0x7ff4540b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:42.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.475+0000 7ff4537fe640 1 --2- 172.21.15.53:0/1048208294 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4440039b0 0x7ff444003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:42.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.475+0000 7ff4537fe640 1 --2- 172.21.15.53:0/1048208294 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4440047d0 0x7ff444004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:42.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.475+0000 7ff4537fe640 1 --2- 172.21.15.53:0/1048208294 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4540b0b90 0x7ff4440051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:42.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.475+0000 7ff4537fe640 1 -- 172.21.15.53:0/1048208294 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4540ccd80 con 0x7ff4440047d0 2023-06-10T19:05:42.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.475+0000 7ff4537fe640 1 -- 172.21.15.53:0/1048208294 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff44400ba90 con 0x7ff4440039b0 2023-06-10T19:05:42.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.475+0000 7ff4537fe640 1 -- 172.21.15.53:0/1048208294 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff44400bc50 con 0x7ff4540b0b90 2023-06-10T19:05:42.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.475+0000 7ff453fff640 1 --2- 172.21.15.53:0/1048208294 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4440047d0 0x7ff444004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:42.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.475+0000 7ff4590f4640 1 --2- 172.21.15.53:0/1048208294 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4540b0b90 0x7ff4440051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:42.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.475+0000 7ff4588f3640 1 --2- 172.21.15.53:0/1048208294 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4440039b0 0x7ff444003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:42.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.475+0000 7ff453fff640 1 -- 172.21.15.53:0/1048208294 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4540b0b90 msgr2=0x7ff4440051a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:42.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.475+0000 7ff453fff640 1 --2- 172.21.15.53:0/1048208294 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4540b0b90 0x7ff4440051a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:42.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.475+0000 7ff453fff640 1 -- 172.21.15.53:0/1048208294 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4440039b0 msgr2=0x7ff444003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:42.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.475+0000 7ff453fff640 1 --2- 172.21.15.53:0/1048208294 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4440039b0 0x7ff444003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:42.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.475+0000 7ff453fff640 1 -- 172.21.15.53:0/1048208294 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff444003530 con 0x7ff4440047d0 2023-06-10T19:05:42.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.475+0000 7ff4588f3640 1 --2- 172.21.15.53:0/1048208294 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4440039b0 0x7ff444003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:05:42.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.479+0000 7ff453fff640 1 --2- 172.21.15.53:0/1048208294 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4440047d0 0x7ff444004c40 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 crypto rx=0x7ff440001780 tx=0x7ff44001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd175b531c7eefca server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:42.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.479+0000 7ff4537fe640 1 -- 172.21.15.53:0/1048208294 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4400052d0 con 0x7ff4440047d0 2023-06-10T19:05:42.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.479+0000 7ff4537fe640 1 -- 172.21.15.53:0/1048208294 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4400a7050 con 0x7ff4440047d0 2023-06-10T19:05:42.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.479+0000 7ff4537fe640 1 -- 172.21.15.53:0/1048208294 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff440003600 con 0x7ff4440047d0 2023-06-10T19:05:42.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.479+0000 7ff45ab57640 1 -- 172.21.15.53:0/1048208294 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4440047d0 msgr2=0x7ff444004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:42.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.479+0000 7ff45ab57640 1 --2- 172.21.15.53:0/1048208294 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4440047d0 0x7ff444004c40 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 crypto rx=0x7ff440001780 tx=0x7ff44001c3d0 comp rx=0 tx=0).stop 2023-06-10T19:05:42.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.479+0000 7ff4590f4640 1 -- 172.21.15.53:0/1048208294 reap_dead start 2023-06-10T19:05:42.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.479+0000 7ff45ab57640 1 -- 172.21.15.53:0/1048208294 shutdown_connections 2023-06-10T19:05:42.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.479+0000 7ff45ab57640 1 -- 172.21.15.53:0/1048208294 >> 172.21.15.53:0/1048208294 conn(0x7ff454069e20 msgr2=0x7ff45406a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:42.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.479+0000 7ff45ab57640 1 -- 172.21.15.53:0/1048208294 shutdown_connections 2023-06-10T19:05:42.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.479+0000 7ff45ab57640 1 -- 172.21.15.53:0/1048208294 wait complete. 2023-06-10T19:05:42.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.479+0000 7ff45ab57640 1 Processor -- start 2023-06-10T19:05:42.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.479+0000 7ff45ab57640 1 -- start start 2023-06-10T19:05:42.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.479+0000 7ff45ab57640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4440047d0 0x7ff45414df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:42.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.479+0000 7ff45ab57640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff454150050 0x7ff4540c9a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:42.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.479+0000 7ff45ab57640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4541504c0 0x7ff454157a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:42.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.479+0000 7ff45ab57640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff45414eae0 con 0x7ff4440047d0 2023-06-10T19:05:42.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.479+0000 7ff45ab57640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff45414f870 con 0x7ff454150050 2023-06-10T19:05:42.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.479+0000 7ff45ab57640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4540cbaf0 con 0x7ff4541504c0 2023-06-10T19:05:42.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.483+0000 7ff4588f3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4440047d0 0x7ff45414df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:42.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.483+0000 7ff4588f3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4440047d0 0x7ff45414df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57294/0 (socket says 172.21.15.53:57294) 2023-06-10T19:05:42.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.483+0000 7ff4588f3640 1 -- 172.21.15.53:0/4112277030 learned_addr learned my addr 172.21.15.53:0/4112277030 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:42.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.483+0000 7ff4590f4640 1 --2- 172.21.15.53:0/4112277030 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4541504c0 0x7ff454157a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:42.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.483+0000 7ff453fff640 1 --2- 172.21.15.53:0/4112277030 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff454150050 0x7ff4540c9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:42.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.483+0000 7ff4588f3640 1 -- 172.21.15.53:0/4112277030 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4541504c0 msgr2=0x7ff454157a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:42.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.483+0000 7ff4588f3640 1 --2- 172.21.15.53:0/4112277030 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4541504c0 0x7ff454157a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:42.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.483+0000 7ff4588f3640 1 -- 172.21.15.53:0/4112277030 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff454150050 msgr2=0x7ff4540c9a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:42.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.483+0000 7ff4588f3640 1 --2- 172.21.15.53:0/4112277030 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff454150050 0x7ff4540c9a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:42.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.483+0000 7ff4588f3640 1 -- 172.21.15.53:0/4112277030 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4540cbdd0 con 0x7ff4440047d0 2023-06-10T19:05:42.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.483+0000 7ff4590f4640 1 --2- 172.21.15.53:0/4112277030 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4541504c0 0x7ff454157a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:05:42.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.483+0000 7ff4588f3640 1 --2- 172.21.15.53:0/4112277030 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4440047d0 0x7ff45414df40 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 crypto rx=0x7ff44800d810 tx=0x7ff44800dcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:42.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.483+0000 7ff4517fa640 1 -- 172.21.15.53:0/4112277030 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4480074e0 con 0x7ff4440047d0 2023-06-10T19:05:42.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.483+0000 7ff4517fa640 1 -- 172.21.15.53:0/4112277030 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff448007640 con 0x7ff4440047d0 2023-06-10T19:05:42.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.483+0000 7ff45ab57640 1 -- 172.21.15.53:0/4112277030 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff45414fb30 con 0x7ff4440047d0 2023-06-10T19:05:42.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.483+0000 7ff4517fa640 1 -- 172.21.15.53:0/4112277030 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff448004a30 con 0x7ff4440047d0 2023-06-10T19:05:42.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.483+0000 7ff45ab57640 1 -- 172.21.15.53:0/4112277030 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4540cb710 con 0x7ff4440047d0 2023-06-10T19:05:42.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.483+0000 7ff45ab57640 1 -- 172.21.15.53:0/4112277030 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff45414f6c0 con 0x7ff4440047d0 2023-06-10T19:05:42.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.483+0000 7ff4517fa640 1 -- 172.21.15.53:0/4112277030 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff448004b90 con 0x7ff4440047d0 2023-06-10T19:05:42.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.483+0000 7ff4517fa640 1 --2- 172.21.15.53:0/4112277030 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff4380662b0 0x7ff438068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:42.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.483+0000 7ff4517fa640 1 -- 172.21.15.53:0/4112277030 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5339+0+0 (secure 0 0 0) 0x7ff448083390 con 0x7ff4440047d0 2023-06-10T19:05:42.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.483+0000 7ff453fff640 1 --2- 172.21.15.53:0/4112277030 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff4380662b0 0x7ff438068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:42.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.487+0000 7ff453fff640 1 --2- 172.21.15.53:0/4112277030 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff4380662b0 0x7ff438068760 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7ff440001750 tx=0x7ff4400011a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:42.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.487+0000 7ff4517fa640 1 -- 172.21.15.53:0/4112277030 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff448050ae0 con 0x7ff4440047d0 2023-06-10T19:05:42.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.643+0000 7ff45ab57640 1 -- 172.21.15.53:0/4112277030 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7ff45404d790 con 0x7ff4440047d0 2023-06-10T19:05:42.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.651+0000 7ff4517fa640 1 -- 172.21.15.53:0/4112277030 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v23) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff448054100 con 0x7ff4440047d0 2023-06-10T19:05:42.660 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.655+0000 7ff45ab57640 1 -- 172.21.15.53:0/4112277030 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff4380662b0 msgr2=0x7ff438068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:42.660 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.655+0000 7ff45ab57640 1 --2- 172.21.15.53:0/4112277030 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff4380662b0 0x7ff438068760 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7ff440001750 tx=0x7ff4400011a0 comp rx=0 tx=0).stop 2023-06-10T19:05:42.660 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.655+0000 7ff45ab57640 1 -- 172.21.15.53:0/4112277030 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4440047d0 msgr2=0x7ff45414df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:42.660 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.655+0000 7ff45ab57640 1 --2- 172.21.15.53:0/4112277030 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4440047d0 0x7ff45414df40 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 crypto rx=0x7ff44800d810 tx=0x7ff44800dcd0 comp rx=0 tx=0).stop 2023-06-10T19:05:42.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.655+0000 7ff45ab57640 1 -- 172.21.15.53:0/4112277030 shutdown_connections 2023-06-10T19:05:42.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.655+0000 7ff45ab57640 1 --2- 172.21.15.53:0/4112277030 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff4380662b0 0x7ff438068760 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:42.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.655+0000 7ff45ab57640 1 --2- 172.21.15.53:0/4112277030 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4541504c0 0x7ff454157a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:42.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.655+0000 7ff45ab57640 1 --2- 172.21.15.53:0/4112277030 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff454150050 0x7ff4540c9a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:42.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.655+0000 7ff45ab57640 1 --2- 172.21.15.53:0/4112277030 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff4440047d0 0x7ff45414df40 unknown :-1 s=CLOSED pgs=1983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:42.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.655+0000 7ff45ab57640 1 -- 172.21.15.53:0/4112277030 >> 172.21.15.53:0/4112277030 conn(0x7ff454069e20 msgr2=0x7ff454157120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:42.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.655+0000 7ff45ab57640 1 -- 172.21.15.53:0/4112277030 shutdown_connections 2023-06-10T19:05:42.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.655+0000 7ff45ab57640 1 -- 172.21.15.53:0/4112277030 wait complete. 2023-06-10T19:05:42.677 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_evicted_caps' 2023-06-10T19:05:42.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.803+0000 7fe9a4eb7640 1 Processor -- start 2023-06-10T19:05:42.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.803+0000 7fe9a4eb7640 1 -- start start 2023-06-10T19:05:42.808 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.803+0000 7fe9a4eb7640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe9a015fda0 0x7fe9a00cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:42.809 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.803+0000 7fe9a4eb7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe9a0163880 0x7fe9a00d0150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:42.809 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.803+0000 7fe9a4eb7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9a006a9c0 0x7fe9a00b3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:42.809 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.803+0000 7fe9a4eb7640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9a0160170 con 0x7fe9a0163880 2023-06-10T19:05:42.809 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.803+0000 7fe9a4eb7640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9a0163e20 con 0x7fe9a015fda0 2023-06-10T19:05:42.809 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.803+0000 7fe9a4eb7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a0164100 con 0x7fe9a006a9c0 2023-06-10T19:05:42.809 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.803+0000 7fe997fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe9a0163880 0x7fe9a00d0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:42.809 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.803+0000 7fe997fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe9a0163880 0x7fe9a00d0150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57304/0 (socket says 172.21.15.53:57304) 2023-06-10T19:05:42.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.803+0000 7fe997fff640 1 -- 172.21.15.53:0/134275683 learned_addr learned my addr 172.21.15.53:0/134275683 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:42.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.803+0000 7fe99e59c640 1 --2- 172.21.15.53:0/134275683 >> v2:172.21.15.117:3300/0 conn(0x7fe9a015fda0 0x7fe9a00cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:42.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.803+0000 7fe99ed9d640 1 --2- 172.21.15.53:0/134275683 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9a006a9c0 0x7fe9a00b3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:42.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.803+0000 7fe997fff640 1 -- 172.21.15.53:0/134275683 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9a006a9c0 msgr2=0x7fe9a00b3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:42.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.803+0000 7fe997fff640 1 --2- 172.21.15.53:0/134275683 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9a006a9c0 0x7fe9a00b3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:42.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.803+0000 7fe997fff640 1 -- 172.21.15.53:0/134275683 >> v2:172.21.15.117:3300/0 conn(0x7fe9a015fda0 msgr2=0x7fe9a00cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:42.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.803+0000 7fe997fff640 1 --2- 172.21.15.53:0/134275683 >> v2:172.21.15.117:3300/0 conn(0x7fe9a015fda0 0x7fe9a00cfc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:42.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.803+0000 7fe997fff640 1 -- 172.21.15.53:0/134275683 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9a01643e0 con 0x7fe9a0163880 2023-06-10T19:05:42.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.807+0000 7fe997fff640 1 --2- 172.21.15.53:0/134275683 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9a0163880 0x7fe9a00d0150 secure :-1 s=READY pgs=1984 cs=0 l=1 rev1=1 crypto rx=0x7fe9a00b4bd0 tx=0x7fe99001c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a63e25d0db53577b server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:42.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.807+0000 7fe99dd9b640 1 -- 172.21.15.53:0/134275683 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9900ab600 con 0x7fe9a0163880 2023-06-10T19:05:42.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.807+0000 7fe99dd9b640 1 -- 172.21.15.53:0/134275683 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9900a7050 con 0x7fe9a0163880 2023-06-10T19:05:42.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.807+0000 7fe99dd9b640 1 -- 172.21.15.53:0/134275683 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9900ab980 con 0x7fe9a0163880 2023-06-10T19:05:42.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.807+0000 7fe9a4eb7640 1 -- 172.21.15.53:0/134275683 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9a0163880 msgr2=0x7fe9a00d0150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:42.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.807+0000 7fe9a4eb7640 1 --2- 172.21.15.53:0/134275683 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9a0163880 0x7fe9a00d0150 secure :-1 s=READY pgs=1984 cs=0 l=1 rev1=1 crypto rx=0x7fe9a00b4bd0 tx=0x7fe99001c210 comp rx=0 tx=0).stop 2023-06-10T19:05:42.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.807+0000 7fe9a4eb7640 1 -- 172.21.15.53:0/134275683 shutdown_connections 2023-06-10T19:05:42.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.807+0000 7fe9a4eb7640 1 --2- 172.21.15.53:0/134275683 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9a006a9c0 0x7fe9a00b3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:42.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.807+0000 7fe9a4eb7640 1 --2- 172.21.15.53:0/134275683 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9a0163880 0x7fe9a00d0150 unknown :-1 s=CLOSED pgs=1984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:42.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.807+0000 7fe9a4eb7640 1 --2- 172.21.15.53:0/134275683 >> v2:172.21.15.117:3300/0 conn(0x7fe9a015fda0 0x7fe9a00cfc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:42.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.807+0000 7fe9a4eb7640 1 -- 172.21.15.53:0/134275683 >> 172.21.15.53:0/134275683 conn(0x7fe9a0071790 msgr2=0x7fe9a0069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:42.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.807+0000 7fe9a4eb7640 1 -- 172.21.15.53:0/134275683 shutdown_connections 2023-06-10T19:05:42.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.807+0000 7fe9a4eb7640 1 -- 172.21.15.53:0/134275683 wait complete. 2023-06-10T19:05:42.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.807+0000 7fe9a4eb7640 1 Processor -- start 2023-06-10T19:05:42.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.807+0000 7fe9a4eb7640 1 -- start start 2023-06-10T19:05:42.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.807+0000 7fe9a4eb7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9a006a9c0 0x7fe9a015bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:42.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.807+0000 7fe9a4eb7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9a015fda0 0x7fe9a014ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:42.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.807+0000 7fe9a4eb7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe9a0163880 0x7fe9a01fbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:42.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.807+0000 7fe9a4eb7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a015b530 con 0x7fe9a015fda0 2023-06-10T19:05:42.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.807+0000 7fe9a4eb7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a015b810 con 0x7fe9a0163880 2023-06-10T19:05:42.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.807+0000 7fe9a4eb7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a0161620 con 0x7fe9a006a9c0 2023-06-10T19:05:42.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.807+0000 7fe997fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9a015fda0 0x7fe9a014ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:42.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.807+0000 7fe997fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9a015fda0 0x7fe9a014ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57306/0 (socket says 172.21.15.53:57306) 2023-06-10T19:05:42.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.807+0000 7fe997fff640 1 -- 172.21.15.53:0/1045693017 learned_addr learned my addr 172.21.15.53:0/1045693017 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:42.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.807+0000 7fe997fff640 1 -- 172.21.15.53:0/1045693017 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9a006a9c0 msgr2=0x7fe9a015bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:42.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.807+0000 7fe99e59c640 1 --2- 172.21.15.53:0/1045693017 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9a006a9c0 0x7fe9a015bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:42.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.807+0000 7fe99ed9d640 1 --2- 172.21.15.53:0/1045693017 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe9a0163880 0x7fe9a01fbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:42.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.807+0000 7fe997fff640 1 --2- 172.21.15.53:0/1045693017 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9a006a9c0 0x7fe9a015bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:42.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.807+0000 7fe997fff640 1 -- 172.21.15.53:0/1045693017 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe9a0163880 msgr2=0x7fe9a01fbcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:42.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.807+0000 7fe997fff640 1 --2- 172.21.15.53:0/1045693017 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe9a0163880 0x7fe9a01fbcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:42.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.807+0000 7fe997fff640 1 -- 172.21.15.53:0/1045693017 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9900094d0 con 0x7fe9a015fda0 2023-06-10T19:05:42.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.811+0000 7fe997fff640 1 --2- 172.21.15.53:0/1045693017 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9a015fda0 0x7fe9a014ce90 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 crypto rx=0x7fe9900ae040 tx=0x7fe990018fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:42.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.811+0000 7fe996ffd640 1 -- 172.21.15.53:0/1045693017 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9900bc070 con 0x7fe9a015fda0 2023-06-10T19:05:42.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.811+0000 7fe996ffd640 1 -- 172.21.15.53:0/1045693017 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9900ace80 con 0x7fe9a015fda0 2023-06-10T19:05:42.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.811+0000 7fe996ffd640 1 -- 172.21.15.53:0/1045693017 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9900b6660 con 0x7fe9a015fda0 2023-06-10T19:05:42.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.811+0000 7fe9a4eb7640 1 -- 172.21.15.53:0/1045693017 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9a0161900 con 0x7fe9a015fda0 2023-06-10T19:05:42.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.811+0000 7fe9a4eb7640 1 -- 172.21.15.53:0/1045693017 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9a00c9110 con 0x7fe9a015fda0 2023-06-10T19:05:42.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.811+0000 7fe9a4eb7640 1 -- 172.21.15.53:0/1045693017 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9a004d790 con 0x7fe9a015fda0 2023-06-10T19:05:42.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.811+0000 7fe996ffd640 1 -- 172.21.15.53:0/1045693017 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe9900b2040 con 0x7fe9a015fda0 2023-06-10T19:05:42.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.811+0000 7fe996ffd640 1 --2- 172.21.15.53:0/1045693017 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe980066280 0x7fe980068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:42.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.811+0000 7fe996ffd640 1 -- 172.21.15.53:0/1045693017 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fe99011e020 con 0x7fe9a015fda0 2023-06-10T19:05:42.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.811+0000 7fe99e59c640 1 --2- 172.21.15.53:0/1045693017 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe980066280 0x7fe980068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:42.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.811+0000 7fe99e59c640 1 --2- 172.21.15.53:0/1045693017 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe980066280 0x7fe980068730 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fe988009790 tx=0x7fe988008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:42.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:42.815+0000 7fe996ffd640 1 -- 172.21.15.53:0/1045693017 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe9900eb970 con 0x7fe9a015fda0 2023-06-10T19:05:43.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.023+0000 7fe9a4eb7640 1 -- 172.21.15.53:0/1045693017 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_evicted_caps"]} v 0) v1 -- 0x7fe9a0161db0 con 0x7fe9a015fda0 2023-06-10T19:05:43.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.339+0000 7fe996ffd640 1 -- 172.21.15.53:0/1045693017 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_evicted_caps"]}]=0 v609) v1 ==== 149+0+0 (secure 0 0 0) 0x7fe9900eef90 con 0x7fe9a015fda0 2023-06-10T19:05:43.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.343+0000 7fe9a4eb7640 1 -- 172.21.15.53:0/1045693017 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe980066280 msgr2=0x7fe980068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:43.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.343+0000 7fe9a4eb7640 1 --2- 172.21.15.53:0/1045693017 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe980066280 0x7fe980068730 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fe988009790 tx=0x7fe988008040 comp rx=0 tx=0).stop 2023-06-10T19:05:43.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.343+0000 7fe9a4eb7640 1 -- 172.21.15.53:0/1045693017 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9a015fda0 msgr2=0x7fe9a014ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:43.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.343+0000 7fe9a4eb7640 1 --2- 172.21.15.53:0/1045693017 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9a015fda0 0x7fe9a014ce90 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 crypto rx=0x7fe9900ae040 tx=0x7fe990018fb0 comp rx=0 tx=0).stop 2023-06-10T19:05:43.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.343+0000 7fe9a4eb7640 1 -- 172.21.15.53:0/1045693017 shutdown_connections 2023-06-10T19:05:43.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.343+0000 7fe9a4eb7640 1 --2- 172.21.15.53:0/1045693017 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe980066280 0x7fe980068730 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:43.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.343+0000 7fe9a4eb7640 1 --2- 172.21.15.53:0/1045693017 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe9a0163880 0x7fe9a01fbcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:43.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.343+0000 7fe9a4eb7640 1 --2- 172.21.15.53:0/1045693017 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9a015fda0 0x7fe9a014ce90 unknown :-1 s=CLOSED pgs=1985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:43.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.343+0000 7fe9a4eb7640 1 --2- 172.21.15.53:0/1045693017 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9a006a9c0 0x7fe9a015bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:43.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.343+0000 7fe9a4eb7640 1 -- 172.21.15.53:0/1045693017 >> 172.21.15.53:0/1045693017 conn(0x7fe9a0071790 msgr2=0x7fe9a00b31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:43.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.343+0000 7fe9a4eb7640 1 -- 172.21.15.53:0/1045693017 shutdown_connections 2023-06-10T19:05:43.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.343+0000 7fe9a4eb7640 1 -- 172.21.15.53:0/1045693017 wait complete. 2023-06-10T19:05:43.371 INFO:tasks.cephfs_test_runner:test_evicted_caps (tasks.cephfs.test_client_recovery.TestClientRecovery) ... ok 2023-06-10T19:05:43.372 INFO:tasks.cephfs_test_runner:Starting test: test_filelock (tasks.cephfs.test_client_recovery.TestClientRecovery) 2023-06-10T19:05:43.372 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_filelock' 2023-06-10T19:05:43.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.495+0000 7fa49cc42640 1 Processor -- start 2023-06-10T19:05:43.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.495+0000 7fa49cc42640 1 -- start start 2023-06-10T19:05:43.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.495+0000 7fa49cc42640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa498162640 0x7fa498164a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:43.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.495+0000 7fa49cc42640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa498159b50 con 0x7fa498071060 2023-06-10T19:05:43.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.495+0000 7fa49cc42640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4980702a0 con 0x7fa4980c9840 2023-06-10T19:05:43.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.495+0000 7fa49cc42640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa498070580 con 0x7fa498162640 2023-06-10T19:05:43.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.499+0000 7fa495d9b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fa498071060 0x7fa4980af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:43782/0 (socket says 172.21.15.53:43782) 2023-06-10T19:05:43.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.499+0000 7fa495d9b640 1 -- 172.21.15.53:0/620782818 learned_addr learned my addr 172.21.15.53:0/620782818 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:05:43.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.499+0000 7fa496d9d640 1 --2- 172.21.15.53:0/620782818 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa498162640 0x7fa498164a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:43.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.499+0000 7fa49559a640 1 -- 172.21.15.53:0/620782818 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 49874873 0 0) 0x7fa498159b50 con 0x7fa498071060 2023-06-10T19:05:43.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.499+0000 7fa49559a640 1 -- 172.21.15.53:0/620782818 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa480003530 con 0x7fa498071060 2023-06-10T19:05:43.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.499+0000 7fa49559a640 1 -- 172.21.15.53:0/620782818 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2875129448 0 0) 0x7fa480003530 con 0x7fa498071060 2023-06-10T19:05:43.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.499+0000 7fa49559a640 1 -- 172.21.15.53:0/620782818 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa498162640 msgr2=0x7fa498164a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:43.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.499+0000 7fa49559a640 1 --2- 172.21.15.53:0/620782818 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa498162640 0x7fa498164a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:43.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.499+0000 7fa49559a640 1 -- 172.21.15.53:0/620782818 >> v1:172.21.15.117:6789/0 conn(0x7fa4980c9840 legacy=0x7fa4980c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:43.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.499+0000 7fa49559a640 1 -- 172.21.15.53:0/620782818 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa498070860 con 0x7fa498071060 2023-06-10T19:05:43.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.499+0000 7fa49559a640 1 -- 172.21.15.53:0/620782818 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fa48c001680 con 0x7fa498071060 2023-06-10T19:05:43.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.499+0000 7fa49559a640 1 -- 172.21.15.53:0/620782818 >> v1:172.21.15.53:6789/0 conn(0x7fa498071060 legacy=0x7fa4980af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:43.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.499+0000 7fa49559a640 1 --2- 172.21.15.53:0/620782818 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa498162640 0x7fa480003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:43.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.499+0000 7fa49559a640 1 --2- 172.21.15.53:0/620782818 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa480003fa0 0x7fa4800047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:43.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.499+0000 7fa49559a640 1 --2- 172.21.15.53:0/620782818 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa480004d10 0x7fa480005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:43.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.499+0000 7fa49559a640 1 -- 172.21.15.53:0/620782818 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa498070580 con 0x7fa480004d10 2023-06-10T19:05:43.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.499+0000 7fa49559a640 1 -- 172.21.15.53:0/620782818 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa48000bad0 con 0x7fa480003fa0 2023-06-10T19:05:43.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.499+0000 7fa49559a640 1 -- 172.21.15.53:0/620782818 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa48000bc90 con 0x7fa498162640 2023-06-10T19:05:43.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.499+0000 7fa496d9d640 1 --2- 172.21.15.53:0/620782818 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa480004d10 0x7fa480005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:43.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.499+0000 7fa495d9b640 1 --2- 172.21.15.53:0/620782818 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa480003fa0 0x7fa4800047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:43.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.499+0000 7fa49659c640 1 --2- 172.21.15.53:0/620782818 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa498162640 0x7fa480003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:43.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.499+0000 7fa496d9d640 1 -- 172.21.15.53:0/620782818 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa498162640 msgr2=0x7fa480003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:43.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.499+0000 7fa496d9d640 1 --2- 172.21.15.53:0/620782818 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa498162640 0x7fa480003a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:43.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.499+0000 7fa496d9d640 1 -- 172.21.15.53:0/620782818 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa480003fa0 msgr2=0x7fa4800047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:43.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.499+0000 7fa496d9d640 1 --2- 172.21.15.53:0/620782818 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa480003fa0 0x7fa4800047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:43.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.499+0000 7fa496d9d640 1 -- 172.21.15.53:0/620782818 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa480003530 con 0x7fa480004d10 2023-06-10T19:05:43.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.499+0000 7fa49659c640 1 --2- 172.21.15.53:0/620782818 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa498162640 0x7fa480003a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:05:43.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.499+0000 7fa495d9b640 1 --2- 172.21.15.53:0/620782818 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa480003fa0 0x7fa4800047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:05:43.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.499+0000 7fa496d9d640 1 --2- 172.21.15.53:0/620782818 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa480004d10 0x7fa480005180 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 crypto rx=0x7fa49815e380 tx=0x7fa49001cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2626eb0ef1c5ced server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:43.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.499+0000 7fa49559a640 1 -- 172.21.15.53:0/620782818 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4900a5bd0 con 0x7fa480004d10 2023-06-10T19:05:43.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.499+0000 7fa49559a640 1 -- 172.21.15.53:0/620782818 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa49000f040 con 0x7fa480004d10 2023-06-10T19:05:43.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.499+0000 7fa49559a640 1 -- 172.21.15.53:0/620782818 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4900ad440 con 0x7fa480004d10 2023-06-10T19:05:43.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.503+0000 7fa49cc42640 1 -- 172.21.15.53:0/620782818 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa480004d10 msgr2=0x7fa480005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:43.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.503+0000 7fa49cc42640 1 --2- 172.21.15.53:0/620782818 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa480004d10 0x7fa480005180 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 crypto rx=0x7fa49815e380 tx=0x7fa49001cbc0 comp rx=0 tx=0).stop 2023-06-10T19:05:43.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.503+0000 7fa496d9d640 1 -- 172.21.15.53:0/620782818 reap_dead start 2023-06-10T19:05:43.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.503+0000 7fa49cc42640 1 -- 172.21.15.53:0/620782818 shutdown_connections 2023-06-10T19:05:43.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.503+0000 7fa49cc42640 1 -- 172.21.15.53:0/620782818 >> 172.21.15.53:0/620782818 conn(0x7fa49806a0d0 msgr2=0x7fa4980ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:43.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.503+0000 7fa49cc42640 1 -- 172.21.15.53:0/620782818 shutdown_connections 2023-06-10T19:05:43.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.503+0000 7fa49cc42640 1 -- 172.21.15.53:0/620782818 wait complete. 2023-06-10T19:05:43.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.503+0000 7fa49cc42640 1 Processor -- start 2023-06-10T19:05:43.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.503+0000 7fa49cc42640 1 -- start start 2023-06-10T19:05:43.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.503+0000 7fa49cc42640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa480004d10 0x7fa4980c7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:43.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.503+0000 7fa49cc42640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa498150570 0x7fa4980c42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:43.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.503+0000 7fa49cc42640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa498155fa0 0x7fa498156410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:43.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.503+0000 7fa49cc42640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa498156950 con 0x7fa498150570 2023-06-10T19:05:43.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.503+0000 7fa49cc42640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4980c7580 con 0x7fa498155fa0 2023-06-10T19:05:43.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.503+0000 7fa49cc42640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4980c66d0 con 0x7fa480004d10 2023-06-10T19:05:43.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.503+0000 7fa495d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa498150570 0x7fa4980c42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:43.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.503+0000 7fa495d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa498150570 0x7fa4980c42a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57332/0 (socket says 172.21.15.53:57332) 2023-06-10T19:05:43.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.503+0000 7fa495d9b640 1 -- 172.21.15.53:0/1400110923 learned_addr learned my addr 172.21.15.53:0/1400110923 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:43.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.503+0000 7fa49659c640 1 --2- 172.21.15.53:0/1400110923 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa480004d10 0x7fa4980c7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:43.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.503+0000 7fa496d9d640 1 --2- 172.21.15.53:0/1400110923 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa498155fa0 0x7fa498156410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:43.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.503+0000 7fa495d9b640 1 -- 172.21.15.53:0/1400110923 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa480004d10 msgr2=0x7fa4980c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:43.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.503+0000 7fa495d9b640 1 --2- 172.21.15.53:0/1400110923 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa480004d10 0x7fa4980c7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:43.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.503+0000 7fa495d9b640 1 -- 172.21.15.53:0/1400110923 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa498155fa0 msgr2=0x7fa498156410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:43.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.503+0000 7fa495d9b640 1 --2- 172.21.15.53:0/1400110923 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa498155fa0 0x7fa498156410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:43.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.503+0000 7fa495d9b640 1 -- 172.21.15.53:0/1400110923 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4980c6970 con 0x7fa498150570 2023-06-10T19:05:43.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.503+0000 7fa495d9b640 1 --2- 172.21.15.53:0/1400110923 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa498150570 0x7fa4980c42a0 secure :-1 s=READY pgs=1988 cs=0 l=1 rev1=1 crypto rx=0x7fa48c00d8b0 tx=0x7fa48c00dd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:43.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.503+0000 7fa486ffd640 1 -- 172.21.15.53:0/1400110923 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa48c0074e0 con 0x7fa498150570 2023-06-10T19:05:43.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.503+0000 7fa486ffd640 1 -- 172.21.15.53:0/1400110923 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa48c007640 con 0x7fa498150570 2023-06-10T19:05:43.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.503+0000 7fa49cc42640 1 -- 172.21.15.53:0/1400110923 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4980c6c50 con 0x7fa498150570 2023-06-10T19:05:43.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.503+0000 7fa486ffd640 1 -- 172.21.15.53:0/1400110923 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa48c0049f0 con 0x7fa498150570 2023-06-10T19:05:43.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.503+0000 7fa49cc42640 1 -- 172.21.15.53:0/1400110923 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4980c7210 con 0x7fa498150570 2023-06-10T19:05:43.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.507+0000 7fa49cc42640 1 -- 172.21.15.53:0/1400110923 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4980c73d0 con 0x7fa498150570 2023-06-10T19:05:43.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.507+0000 7fa486ffd640 1 -- 172.21.15.53:0/1400110923 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa48c004b50 con 0x7fa498150570 2023-06-10T19:05:43.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.507+0000 7fa486ffd640 1 --2- 172.21.15.53:0/1400110923 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa478066280 0x7fa478068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:43.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.507+0000 7fa486ffd640 1 -- 172.21.15.53:0/1400110923 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fa48c0837a0 con 0x7fa498150570 2023-06-10T19:05:43.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.507+0000 7fa49659c640 1 --2- 172.21.15.53:0/1400110923 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa478066280 0x7fa478068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:43.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.507+0000 7fa49659c640 1 --2- 172.21.15.53:0/1400110923 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa478066280 0x7fa478068730 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fa488001760 tx=0x7fa488009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:43.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.511+0000 7fa486ffd640 1 -- 172.21.15.53:0/1400110923 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa48c054a60 con 0x7fa498150570 2023-06-10T19:05:43.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:43.711+0000 7fa49cc42640 1 -- 172.21.15.53:0/1400110923 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_filelock"]} v 0) v1 -- 0x7fa49804d790 con 0x7fa498150570 2023-06-10T19:05:44.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.351+0000 7fa486ffd640 1 -- 172.21.15.53:0/1400110923 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_filelock"]}]=0 v610) v1 ==== 148+0+0 (secure 0 0 0) 0x7fa48c019020 con 0x7fa498150570 2023-06-10T19:05:44.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.355+0000 7fa49cc42640 1 -- 172.21.15.53:0/1400110923 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa478066280 msgr2=0x7fa478068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:44.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.355+0000 7fa49cc42640 1 --2- 172.21.15.53:0/1400110923 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa478066280 0x7fa478068730 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fa488001760 tx=0x7fa488009040 comp rx=0 tx=0).stop 2023-06-10T19:05:44.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.355+0000 7fa49cc42640 1 -- 172.21.15.53:0/1400110923 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa498150570 msgr2=0x7fa4980c42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:44.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.355+0000 7fa49cc42640 1 --2- 172.21.15.53:0/1400110923 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa498150570 0x7fa4980c42a0 secure :-1 s=READY pgs=1988 cs=0 l=1 rev1=1 crypto rx=0x7fa48c00d8b0 tx=0x7fa48c00dd70 comp rx=0 tx=0).stop 2023-06-10T19:05:44.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.355+0000 7fa49cc42640 1 -- 172.21.15.53:0/1400110923 shutdown_connections 2023-06-10T19:05:44.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.355+0000 7fa49cc42640 1 --2- 172.21.15.53:0/1400110923 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa478066280 0x7fa478068730 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:44.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.355+0000 7fa49cc42640 1 --2- 172.21.15.53:0/1400110923 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa498155fa0 0x7fa498156410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:44.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.355+0000 7fa49cc42640 1 --2- 172.21.15.53:0/1400110923 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa498150570 0x7fa4980c42a0 unknown :-1 s=CLOSED pgs=1988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:44.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.355+0000 7fa49cc42640 1 --2- 172.21.15.53:0/1400110923 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa480004d10 0x7fa4980c7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:44.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.355+0000 7fa49cc42640 1 -- 172.21.15.53:0/1400110923 >> 172.21.15.53:0/1400110923 conn(0x7fa49806a0d0 msgr2=0x7fa498158c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:44.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.355+0000 7fa49cc42640 1 -- 172.21.15.53:0/1400110923 shutdown_connections 2023-06-10T19:05:44.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.355+0000 7fa49cc42640 1 -- 172.21.15.53:0/1400110923 wait complete. 2023-06-10T19:05:44.383 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-06-10T19:05:44.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.511+0000 7fe75d3ec640 1 Processor -- start 2023-06-10T19:05:44.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.511+0000 7fe75d3ec640 1 -- start start 2023-06-10T19:05:44.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.511+0000 7fe75d3ec640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe758159450 0x7fe75815d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:44.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.511+0000 7fe75d3ec640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe7580cf350 0x7fe7580cbf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:44.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.511+0000 7fe75d3ec640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7580cbac0 con 0x7fe75815d680 2023-06-10T19:05:44.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.511+0000 7fe75d3ec640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe75815dc00 con 0x7fe7580cf350 2023-06-10T19:05:44.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.511+0000 7fe75d3ec640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe75815dee0 con 0x7fe758159450 2023-06-10T19:05:44.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.511+0000 7fe7577fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe7580cf350 0x7fe7580cbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:44.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.511+0000 7fe7577fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe7580cf350 0x7fe7580cbf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57346/0 (socket says 172.21.15.53:57346) 2023-06-10T19:05:44.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.511+0000 7fe7577fe640 1 -- 172.21.15.53:0/4272859012 learned_addr learned my addr 172.21.15.53:0/4272859012 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:44.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.511+0000 7fe756ffd640 1 --2- 172.21.15.53:0/4272859012 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe758159450 0x7fe75815d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:44.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.511+0000 7fe7577fe640 1 -- 172.21.15.53:0/4272859012 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe758159450 msgr2=0x7fe75815d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:44.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.511+0000 7fe7577fe640 1 --2- 172.21.15.53:0/4272859012 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe758159450 0x7fe75815d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:44.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.511+0000 7fe7577fe640 1 -- 172.21.15.53:0/4272859012 >> v1:172.21.15.117:6789/0 conn(0x7fe75815d680 legacy=0x7fe7580cec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:44.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.511+0000 7fe7577fe640 1 -- 172.21.15.53:0/4272859012 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7580cb750 con 0x7fe7580cf350 2023-06-10T19:05:44.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.515+0000 7fe7577fe640 1 --2- 172.21.15.53:0/4272859012 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7580cf350 0x7fe7580cbf50 secure :-1 s=READY pgs=1989 cs=0 l=1 rev1=1 crypto rx=0x7fe750009e50 tx=0x7fe75001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9329296f1a1c2994 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:44.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.515+0000 7fe755ffb640 1 -- 172.21.15.53:0/4272859012 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7500a5780 con 0x7fe7580cf350 2023-06-10T19:05:44.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.515+0000 7fe755ffb640 1 -- 172.21.15.53:0/4272859012 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7500a58e0 con 0x7fe7580cf350 2023-06-10T19:05:44.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.515+0000 7fe755ffb640 1 -- 172.21.15.53:0/4272859012 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7500a5c70 con 0x7fe7580cf350 2023-06-10T19:05:44.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.515+0000 7fe75d3ec640 1 -- 172.21.15.53:0/4272859012 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7580cf350 msgr2=0x7fe7580cbf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:44.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.515+0000 7fe75d3ec640 1 --2- 172.21.15.53:0/4272859012 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7580cf350 0x7fe7580cbf50 secure :-1 s=READY pgs=1989 cs=0 l=1 rev1=1 crypto rx=0x7fe750009e50 tx=0x7fe75001c8e0 comp rx=0 tx=0).stop 2023-06-10T19:05:44.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.515+0000 7fe75d3ec640 1 -- 172.21.15.53:0/4272859012 shutdown_connections 2023-06-10T19:05:44.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.515+0000 7fe75d3ec640 1 --2- 172.21.15.53:0/4272859012 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7580cf350 0x7fe7580cbf50 unknown :-1 s=CLOSED pgs=1989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:44.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.515+0000 7fe75d3ec640 1 --2- 172.21.15.53:0/4272859012 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe758159450 0x7fe75815d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:44.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.515+0000 7fe75d3ec640 1 -- 172.21.15.53:0/4272859012 >> 172.21.15.53:0/4272859012 conn(0x7fe75806a090 msgr2=0x7fe75806d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:44.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.515+0000 7fe75d3ec640 1 -- 172.21.15.53:0/4272859012 shutdown_connections 2023-06-10T19:05:44.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.515+0000 7fe75d3ec640 1 -- 172.21.15.53:0/4272859012 wait complete. 2023-06-10T19:05:44.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.515+0000 7fe75d3ec640 1 Processor -- start 2023-06-10T19:05:44.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.515+0000 7fe75d3ec640 1 -- start start 2023-06-10T19:05:44.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.515+0000 7fe75d3ec640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe7580cf350 0x7fe7580c5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:44.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.515+0000 7fe75d3ec640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe758159450 0x7fe7581545f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:44.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.515+0000 7fe75d3ec640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe75815d680 0x7fe7580c8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:44.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.515+0000 7fe75d3ec640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7580c6f20 con 0x7fe75815d680 2023-06-10T19:05:44.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.515+0000 7fe75d3ec640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7580c71c0 con 0x7fe7580cf350 2023-06-10T19:05:44.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.515+0000 7fe75d3ec640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7580c74a0 con 0x7fe758159450 2023-06-10T19:05:44.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.515+0000 7fe7577fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe75815d680 0x7fe7580c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:44.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.515+0000 7fe7577fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe75815d680 0x7fe7580c8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57360/0 (socket says 172.21.15.53:57360) 2023-06-10T19:05:44.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.515+0000 7fe7577fe640 1 -- 172.21.15.53:0/2837348620 learned_addr learned my addr 172.21.15.53:0/2837348620 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:44.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.515+0000 7fe756ffd640 1 --2- 172.21.15.53:0/2837348620 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe7580cf350 0x7fe7580c5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:44.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.515+0000 7fe7567fc640 1 --2- 172.21.15.53:0/2837348620 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe758159450 0x7fe7581545f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:44.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.515+0000 7fe7577fe640 1 -- 172.21.15.53:0/2837348620 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe758159450 msgr2=0x7fe7581545f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:44.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.515+0000 7fe7577fe640 1 --2- 172.21.15.53:0/2837348620 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe758159450 0x7fe7581545f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:44.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.515+0000 7fe7577fe640 1 -- 172.21.15.53:0/2837348620 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe7580cf350 msgr2=0x7fe7580c5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:44.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.515+0000 7fe7577fe640 1 --2- 172.21.15.53:0/2837348620 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe7580cf350 0x7fe7580c5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:44.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.515+0000 7fe7577fe640 1 -- 172.21.15.53:0/2837348620 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe750009b30 con 0x7fe75815d680 2023-06-10T19:05:44.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.515+0000 7fe756ffd640 1 --2- 172.21.15.53:0/2837348620 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe7580cf350 0x7fe7580c5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:05:44.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.515+0000 7fe7577fe640 1 --2- 172.21.15.53:0/2837348620 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe75815d680 0x7fe7580c8260 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 crypto rx=0x7fe7500af040 tx=0x7fe7500196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:44.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.515+0000 7fe73f7fe640 1 -- 172.21.15.53:0/2837348620 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7500b8670 con 0x7fe75815d680 2023-06-10T19:05:44.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.519+0000 7fe73f7fe640 1 -- 172.21.15.53:0/2837348620 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7500b87d0 con 0x7fe75815d680 2023-06-10T19:05:44.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.519+0000 7fe75d3ec640 1 -- 172.21.15.53:0/2837348620 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7580c7780 con 0x7fe75815d680 2023-06-10T19:05:44.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.519+0000 7fe73f7fe640 1 -- 172.21.15.53:0/2837348620 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7500b8b60 con 0x7fe75815d680 2023-06-10T19:05:44.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.519+0000 7fe75d3ec640 1 -- 172.21.15.53:0/2837348620 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7580c7d40 con 0x7fe75815d680 2023-06-10T19:05:44.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.519+0000 7fe75d3ec640 1 -- 172.21.15.53:0/2837348620 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe75804d790 con 0x7fe75815d680 2023-06-10T19:05:44.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.519+0000 7fe73f7fe640 1 -- 172.21.15.53:0/2837348620 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe7500b8cc0 con 0x7fe75815d680 2023-06-10T19:05:44.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.519+0000 7fe73f7fe640 1 --2- 172.21.15.53:0/2837348620 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe744066280 0x7fe744068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:44.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.519+0000 7fe73f7fe640 1 -- 172.21.15.53:0/2837348620 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fe75011f030 con 0x7fe75815d680 2023-06-10T19:05:44.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.519+0000 7fe756ffd640 1 --2- 172.21.15.53:0/2837348620 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe744066280 0x7fe744068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:44.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.519+0000 7fe756ffd640 1 --2- 172.21.15.53:0/2837348620 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe744066280 0x7fe744068730 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fe748009840 tx=0x7fe748008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:44.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.523+0000 7fe73f7fe640 1 -- 172.21.15.53:0/2837348620 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe7500ec780 con 0x7fe75815d680 2023-06-10T19:05:44.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.675+0000 7fe75d3ec640 1 -- 172.21.15.53:0/2837348620 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fe7580c7f30 con 0x7fe75815d680 2023-06-10T19:05:44.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.683+0000 7fe73f7fe640 1 -- 172.21.15.53:0/2837348620 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v24)=0 v24) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe7500efda0 con 0x7fe75815d680 2023-06-10T19:05:44.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.687+0000 7fe75d3ec640 1 -- 172.21.15.53:0/2837348620 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe744066280 msgr2=0x7fe744068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:44.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.687+0000 7fe75d3ec640 1 --2- 172.21.15.53:0/2837348620 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe744066280 0x7fe744068730 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fe748009840 tx=0x7fe748008040 comp rx=0 tx=0).stop 2023-06-10T19:05:44.693 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.687+0000 7fe75d3ec640 1 -- 172.21.15.53:0/2837348620 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe75815d680 msgr2=0x7fe7580c8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:44.693 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.687+0000 7fe75d3ec640 1 --2- 172.21.15.53:0/2837348620 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe75815d680 0x7fe7580c8260 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 crypto rx=0x7fe7500af040 tx=0x7fe7500196e0 comp rx=0 tx=0).stop 2023-06-10T19:05:44.693 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.687+0000 7fe75d3ec640 1 -- 172.21.15.53:0/2837348620 shutdown_connections 2023-06-10T19:05:44.693 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.687+0000 7fe75d3ec640 1 --2- 172.21.15.53:0/2837348620 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe744066280 0x7fe744068730 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:44.693 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.687+0000 7fe75d3ec640 1 --2- 172.21.15.53:0/2837348620 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe75815d680 0x7fe7580c8260 unknown :-1 s=CLOSED pgs=1990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:44.693 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.687+0000 7fe75d3ec640 1 --2- 172.21.15.53:0/2837348620 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe758159450 0x7fe7581545f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:44.693 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.687+0000 7fe75d3ec640 1 --2- 172.21.15.53:0/2837348620 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe7580cf350 0x7fe7580c5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:44.693 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.687+0000 7fe75d3ec640 1 -- 172.21.15.53:0/2837348620 >> 172.21.15.53:0/2837348620 conn(0x7fe75806a090 msgr2=0x7fe7580b1e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:44.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.687+0000 7fe75d3ec640 1 -- 172.21.15.53:0/2837348620 shutdown_connections 2023-06-10T19:05:44.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:44.687+0000 7fe75d3ec640 1 -- 172.21.15.53:0/2837348620 wait complete. 2023-06-10T19:05:44.708 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-06-10T19:05:44.708 DEBUG:teuthology.orchestra.run.smithi053:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-06-10T19:05:44.748 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-06-10T19:05:44.808 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-06-10T19:05:44.809 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T19:05:44.810 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:05:44.816 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16345192k,nr_inodes=4086298,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276544k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=407 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276540k,nr_inodes=819135,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276544k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-06-10T19:05:44.817 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T19:05:44.818 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:05:44.825 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16342088k,nr_inodes=4085522,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275924k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18845 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275920k,nr_inodes=818980,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275924k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-06-10T19:05:44.825 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T19:05:44.826 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:05:44.864 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16345192k,nr_inodes=4086298,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276544k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=407 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276540k,nr_inodes=819135,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276544k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-06-10T19:05:44.865 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T19:05:44.865 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:05:44.870 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16342088k,nr_inodes=4085522,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275924k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18845 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275920k,nr_inodes=818980,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275924k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-06-10T19:05:44.871 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-06-10T19:05:44.871 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:05:45.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.031+0000 7fba87d41640 1 Processor -- start 2023-06-10T19:05:45.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.031+0000 7fba87d41640 1 -- start start 2023-06-10T19:05:45.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.035+0000 7fba87d41640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fba80157cf0 0x7fba800ca6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:45.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.035+0000 7fba87d41640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fba800affc0 0x7fba800b0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:45.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.035+0000 7fba87d41640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba8006fa60 con 0x7fba8015b8e0 2023-06-10T19:05:45.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.035+0000 7fba87d41640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba800b0980 con 0x7fba80157cf0 2023-06-10T19:05:45.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.035+0000 7fba87d41640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba8006a340 con 0x7fba800affc0 2023-06-10T19:05:45.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.035+0000 7fba85add640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fba80157cf0 0x7fba800ca6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:45.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.035+0000 7fba85add640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fba80157cf0 0x7fba800ca6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57364/0 (socket says 172.21.15.53:57364) 2023-06-10T19:05:45.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.035+0000 7fba85add640 1 -- 172.21.15.53:0/3723156470 learned_addr learned my addr 172.21.15.53:0/3723156470 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:45.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.035+0000 7fba852dc640 1 --2- 172.21.15.53:0/3723156470 >> v2:172.21.15.117:3300/0 conn(0x7fba800affc0 0x7fba800b0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:45.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.035+0000 7fba85add640 1 -- 172.21.15.53:0/3723156470 >> v2:172.21.15.117:3300/0 conn(0x7fba800affc0 msgr2=0x7fba800b0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:45.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.035+0000 7fba85add640 1 --2- 172.21.15.53:0/3723156470 >> v2:172.21.15.117:3300/0 conn(0x7fba800affc0 0x7fba800b0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:45.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.035+0000 7fba85add640 1 -- 172.21.15.53:0/3723156470 >> v1:172.21.15.117:6789/0 conn(0x7fba8015b8e0 legacy=0x7fba8015bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:45.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.035+0000 7fba85add640 1 -- 172.21.15.53:0/3723156470 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba800c9250 con 0x7fba80157cf0 2023-06-10T19:05:45.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.035+0000 7fba85add640 1 --2- 172.21.15.53:0/3723156470 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba80157cf0 0x7fba800ca6f0 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 crypto rx=0x7fba800cbb20 tx=0x7fba7c01e7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3bb00292526d2fe server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:45.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.039+0000 7fba84adb640 1 -- 172.21.15.53:0/3723156470 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7c0a78c0 con 0x7fba80157cf0 2023-06-10T19:05:45.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.039+0000 7fba84adb640 1 -- 172.21.15.53:0/3723156470 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba7c0a7a20 con 0x7fba80157cf0 2023-06-10T19:05:45.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.039+0000 7fba84adb640 1 -- 172.21.15.53:0/3723156470 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7c0a7db0 con 0x7fba80157cf0 2023-06-10T19:05:45.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.039+0000 7fba87d41640 1 -- 172.21.15.53:0/3723156470 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba80157cf0 msgr2=0x7fba800ca6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:45.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.039+0000 7fba87d41640 1 --2- 172.21.15.53:0/3723156470 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba80157cf0 0x7fba800ca6f0 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 crypto rx=0x7fba800cbb20 tx=0x7fba7c01e7f0 comp rx=0 tx=0).stop 2023-06-10T19:05:45.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.039+0000 7fba87d41640 1 -- 172.21.15.53:0/3723156470 shutdown_connections 2023-06-10T19:05:45.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.039+0000 7fba87d41640 1 --2- 172.21.15.53:0/3723156470 >> v2:172.21.15.117:3300/0 conn(0x7fba800affc0 0x7fba800b0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:45.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.039+0000 7fba87d41640 1 --2- 172.21.15.53:0/3723156470 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba80157cf0 0x7fba800ca6f0 unknown :-1 s=CLOSED pgs=1991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:45.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.039+0000 7fba87d41640 1 -- 172.21.15.53:0/3723156470 >> 172.21.15.53:0/3723156470 conn(0x7fba800cafc0 msgr2=0x7fba800cb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:45.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.039+0000 7fba87d41640 1 -- 172.21.15.53:0/3723156470 shutdown_connections 2023-06-10T19:05:45.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.039+0000 7fba87d41640 1 -- 172.21.15.53:0/3723156470 wait complete. 2023-06-10T19:05:45.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.039+0000 7fba87d41640 1 Processor -- start 2023-06-10T19:05:45.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.039+0000 7fba87d41640 1 -- start start 2023-06-10T19:05:45.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.039+0000 7fba87d41640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba800affc0 0x7fba800c5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:45.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.039+0000 7fba87d41640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba80157cf0 0x7fba80144910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:45.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.039+0000 7fba87d41640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba8015b8e0 0x7fba801580c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:45.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.039+0000 7fba87d41640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba80159710 con 0x7fba800affc0 2023-06-10T19:05:45.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.039+0000 7fba87d41640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba80158c30 con 0x7fba80157cf0 2023-06-10T19:05:45.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.039+0000 7fba87d41640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba80158f10 con 0x7fba8015b8e0 2023-06-10T19:05:45.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.039+0000 7fba85add640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba800affc0 0x7fba800c5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:45.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.039+0000 7fba85add640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba800affc0 0x7fba800c5610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57376/0 (socket says 172.21.15.53:57376) 2023-06-10T19:05:45.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.039+0000 7fba85add640 1 -- 172.21.15.53:0/63584203 learned_addr learned my addr 172.21.15.53:0/63584203 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:45.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.039+0000 7fba852dc640 1 --2- 172.21.15.53:0/63584203 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba80157cf0 0x7fba80144910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:45.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.039+0000 7fba85add640 1 -- 172.21.15.53:0/63584203 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba8015b8e0 msgr2=0x7fba801580c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:45.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.039+0000 7fba862de640 1 --2- 172.21.15.53:0/63584203 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba8015b8e0 0x7fba801580c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:45.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.039+0000 7fba85add640 1 --2- 172.21.15.53:0/63584203 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba8015b8e0 0x7fba801580c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:45.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.039+0000 7fba85add640 1 -- 172.21.15.53:0/63584203 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba80157cf0 msgr2=0x7fba80144910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:45.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.039+0000 7fba85add640 1 --2- 172.21.15.53:0/63584203 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba80157cf0 0x7fba80144910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:45.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.039+0000 7fba85add640 1 -- 172.21.15.53:0/63584203 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba7c0094d0 con 0x7fba800affc0 2023-06-10T19:05:45.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.039+0000 7fba852dc640 1 --2- 172.21.15.53:0/63584203 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba80157cf0 0x7fba80144910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:05:45.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.039+0000 7fba85add640 1 --2- 172.21.15.53:0/63584203 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba800affc0 0x7fba800c5610 secure :-1 s=READY pgs=1992 cs=0 l=1 rev1=1 crypto rx=0x7fba7c01b400 tx=0x7fba7c01b590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:45.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.039+0000 7fba767fc640 1 -- 172.21.15.53:0/63584203 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7c0af950 con 0x7fba800affc0 2023-06-10T19:05:45.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.039+0000 7fba767fc640 1 -- 172.21.15.53:0/63584203 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba7c0afab0 con 0x7fba800affc0 2023-06-10T19:05:45.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.039+0000 7fba87d41640 1 -- 172.21.15.53:0/63584203 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba800cadb0 con 0x7fba800affc0 2023-06-10T19:05:45.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.039+0000 7fba767fc640 1 -- 172.21.15.53:0/63584203 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7c0afe60 con 0x7fba800affc0 2023-06-10T19:05:45.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.039+0000 7fba87d41640 1 -- 172.21.15.53:0/63584203 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba80159c40 con 0x7fba800affc0 2023-06-10T19:05:45.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.043+0000 7fba87d41640 1 -- 172.21.15.53:0/63584203 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba8006a480 con 0x7fba800affc0 2023-06-10T19:05:45.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.043+0000 7fba767fc640 1 -- 172.21.15.53:0/63584203 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fba7c0b8410 con 0x7fba800affc0 2023-06-10T19:05:45.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.043+0000 7fba767fc640 1 --2- 172.21.15.53:0/63584203 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fba64066280 0x7fba64068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:45.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.043+0000 7fba767fc640 1 -- 172.21.15.53:0/63584203 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fba7c11df50 con 0x7fba800affc0 2023-06-10T19:05:45.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.043+0000 7fba852dc640 1 --2- 172.21.15.53:0/63584203 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fba64066280 0x7fba64068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:45.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.043+0000 7fba852dc640 1 --2- 172.21.15.53:0/63584203 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fba64066280 0x7fba64068730 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fba801f82a0 tx=0x7fba70008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:45.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.047+0000 7fba767fc640 1 -- 172.21.15.53:0/63584203 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fba7c0eb730 con 0x7fba800affc0 2023-06-10T19:05:45.244 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.239+0000 7fba87d41640 1 -- 172.21.15.53:0/63584203 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fba8004d790 con 0x7fba800affc0 2023-06-10T19:05:45.246 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.239+0000 7fba767fc640 1 -- 172.21.15.53:0/63584203 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) v1 ==== 94+0+3532 (secure 0 0 0) 0x7fba7c0bdde0 con 0x7fba800affc0 2023-06-10T19:05:45.246 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:05:45.246 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":71,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7684,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/618082531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":618082531},{"type":"v1","addr":"172.21.15.117:6835","nonce":618082531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":7687,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3984577716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":3984577716},{"type":"v1","addr":"172.21.15.117:6837","nonce":3984577716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":9144,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/3202804884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3202804884},{"type":"v1","addr":"172.21.15.53:6833","nonce":3202804884}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":9480,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/3909614353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":3909614353},{"type":"v1","addr":"172.21.15.53:6835","nonce":3909614353}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71}],"filesystems":[]} 2023-06-10T19:05:45.246 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 71 2023-06-10T19:05:45.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.243+0000 7fba87d41640 1 -- 172.21.15.53:0/63584203 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fba64066280 msgr2=0x7fba64068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:45.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.243+0000 7fba87d41640 1 --2- 172.21.15.53:0/63584203 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fba64066280 0x7fba64068730 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fba801f82a0 tx=0x7fba70008040 comp rx=0 tx=0).stop 2023-06-10T19:05:45.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.243+0000 7fba87d41640 1 -- 172.21.15.53:0/63584203 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba800affc0 msgr2=0x7fba800c5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:45.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.243+0000 7fba87d41640 1 --2- 172.21.15.53:0/63584203 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba800affc0 0x7fba800c5610 secure :-1 s=READY pgs=1992 cs=0 l=1 rev1=1 crypto rx=0x7fba7c01b400 tx=0x7fba7c01b590 comp rx=0 tx=0).stop 2023-06-10T19:05:45.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.243+0000 7fba87d41640 1 -- 172.21.15.53:0/63584203 shutdown_connections 2023-06-10T19:05:45.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.243+0000 7fba87d41640 1 --2- 172.21.15.53:0/63584203 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fba64066280 0x7fba64068730 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:45.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.243+0000 7fba87d41640 1 --2- 172.21.15.53:0/63584203 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba8015b8e0 0x7fba801580c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:45.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.243+0000 7fba87d41640 1 --2- 172.21.15.53:0/63584203 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba80157cf0 0x7fba80144910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:45.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.243+0000 7fba87d41640 1 --2- 172.21.15.53:0/63584203 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba800affc0 0x7fba800c5610 unknown :-1 s=CLOSED pgs=1992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:45.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.243+0000 7fba87d41640 1 -- 172.21.15.53:0/63584203 >> 172.21.15.53:0/63584203 conn(0x7fba800cafc0 msgr2=0x7fba801624f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:45.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.243+0000 7fba87d41640 1 -- 172.21.15.53:0/63584203 shutdown_connections 2023-06-10T19:05:45.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.243+0000 7fba87d41640 1 -- 172.21.15.53:0/63584203 wait complete. 2023-06-10T19:05:45.265 INFO:tasks.ceph.mds.a:Restarting daemon 2023-06-10T19:05:45.266 INFO:tasks.ceph.mds.a:Stopping old one... 2023-06-10T19:05:45.266 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-06-10T19:05:45.266 INFO:teuthology.orchestra.run:waiting for 300 2023-06-10T19:05:45.267 INFO:tasks.ceph.mds.c:Restarting daemon 2023-06-10T19:05:45.267 INFO:tasks.ceph.mds.c:Stopping old one... 2023-06-10T19:05:45.267 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-06-10T19:05:45.267 INFO:teuthology.orchestra.run:waiting for 300 2023-06-10T19:05:45.267 INFO:tasks.ceph.mds.b:Restarting daemon 2023-06-10T19:05:45.268 INFO:tasks.ceph.mds.b:Stopping old one... 2023-06-10T19:05:45.268 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-06-10T19:05:45.268 INFO:teuthology.orchestra.run:waiting for 300 2023-06-10T19:05:45.268 INFO:tasks.ceph.mds.d:Restarting daemon 2023-06-10T19:05:45.268 INFO:tasks.ceph.mds.d:Stopping old one... 2023-06-10T19:05:45.269 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-06-10T19:05:45.269 INFO:teuthology.orchestra.run:waiting for 300 2023-06-10T19:05:45.276 INFO:tasks.ceph.mds.a:Stopped 2023-06-10T19:05:45.277 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-06-10T19:05:45.278 INFO:tasks.ceph.mds.c:Stopped 2023-06-10T19:05:45.279 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-06-10T19:05:45.281 INFO:tasks.ceph.mds.d:Stopped 2023-06-10T19:05:45.281 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-06-10T19:05:45.287 INFO:tasks.ceph.mds.b:Stopped 2023-06-10T19:05:45.287 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-06-10T19:05:45.327 INFO:tasks.ceph.mds.a:Started 2023-06-10T19:05:45.328 DEBUG:teuthology.parallel:result is None 2023-06-10T19:05:45.329 INFO:tasks.ceph.mds.c:Started 2023-06-10T19:05:45.329 DEBUG:teuthology.parallel:result is None 2023-06-10T19:05:45.335 INFO:tasks.ceph.mds.d:Started 2023-06-10T19:05:45.336 DEBUG:teuthology.parallel:result is None 2023-06-10T19:05:45.337 INFO:tasks.ceph.mds.b:Started 2023-06-10T19:05:45.338 DEBUG:teuthology.parallel:result is None 2023-06-10T19:05:45.338 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-06-10T19:05:45.389 INFO:tasks.ceph.mds.c.smithi053.stdout:starting mds.c at 2023-06-10T19:05:45.396 INFO:tasks.ceph.mds.a.smithi053.stdout:starting mds.a at 2023-06-10T19:05:45.403 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2023-06-10T19:05:45.404 INFO:tasks.ceph.mds.d.smithi117.stdout:starting mds.d at 2023-06-10T19:05:45.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.455+0000 7f286619f640 1 Processor -- start 2023-06-10T19:05:45.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.455+0000 7f286619f640 1 -- start start 2023-06-10T19:05:45.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.455+0000 7f286619f640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f28600b3ac0 0x7f28600b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:45.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.455+0000 7f286619f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f28600cc690 0x7f28600b43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:45.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.455+0000 7f286619f640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28600ccde0 con 0x7f28600d1b00 2023-06-10T19:05:45.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.455+0000 7f286619f640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28600ced00 con 0x7f28600cc690 2023-06-10T19:05:45.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.455+0000 7f286619f640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28600cfc10 con 0x7f28600b3ac0 2023-06-10T19:05:45.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.455+0000 7f285f7fe640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f28600b3ac0 0x7f28600b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:45.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.455+0000 7f285f7fe640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f28600b3ac0 0x7f28600b3e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.53:41586/0 (socket says 172.21.15.53:41586) 2023-06-10T19:05:45.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.455+0000 7f285f7fe640 1 -- 172.21.15.53:0/3695749350 learned_addr learned my addr 172.21.15.53:0/3695749350 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:45.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.455+0000 7f285effd640 1 --2- 172.21.15.53:0/3695749350 >> v2:172.21.15.53:3300/0 conn(0x7f28600cc690 0x7f28600b43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:45.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.455+0000 7f285ffff640 1 --1- 172.21.15.53:0/3695749350 >> v1:172.21.15.53:6789/0 conn(0x7f28600d1b00 0x7f286015f3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:43814/0 (socket says 172.21.15.53:43814) 2023-06-10T19:05:45.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.455+0000 7f285f7fe640 1 -- 172.21.15.53:0/3695749350 >> v2:172.21.15.53:3300/0 conn(0x7f28600cc690 msgr2=0x7f28600b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:45.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.455+0000 7f285f7fe640 1 --2- 172.21.15.53:0/3695749350 >> v2:172.21.15.53:3300/0 conn(0x7f28600cc690 0x7f28600b43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:45.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.455+0000 7f285f7fe640 1 -- 172.21.15.53:0/3695749350 >> v1:172.21.15.53:6789/0 conn(0x7f28600d1b00 legacy=0x7f286015f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:45.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.455+0000 7f285f7fe640 1 -- 172.21.15.53:0/3695749350 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28600b4910 con 0x7f28600b3ac0 2023-06-10T19:05:45.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.455+0000 7f285f7fe640 1 --2- 172.21.15.53:0/3695749350 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28600b3ac0 0x7f28600b3e90 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f28600b4bd0 tx=0x7f285001c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c73e2aece7f30c5f server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:45.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.455+0000 7f285e7fc640 1 -- 172.21.15.53:0/3695749350 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28500ab600 con 0x7f28600b3ac0 2023-06-10T19:05:45.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.455+0000 7f285e7fc640 1 -- 172.21.15.53:0/3695749350 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28500a7050 con 0x7f28600b3ac0 2023-06-10T19:05:45.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.455+0000 7f285e7fc640 1 -- 172.21.15.53:0/3695749350 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28500ab980 con 0x7f28600b3ac0 2023-06-10T19:05:45.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.459+0000 7f286619f640 1 -- 172.21.15.53:0/3695749350 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28600b3ac0 msgr2=0x7f28600b3e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:45.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.459+0000 7f286619f640 1 --2- 172.21.15.53:0/3695749350 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28600b3ac0 0x7f28600b3e90 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f28600b4bd0 tx=0x7f285001c3e0 comp rx=0 tx=0).stop 2023-06-10T19:05:45.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.459+0000 7f286619f640 1 -- 172.21.15.53:0/3695749350 shutdown_connections 2023-06-10T19:05:45.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.459+0000 7f286619f640 1 --2- 172.21.15.53:0/3695749350 >> v2:172.21.15.53:3300/0 conn(0x7f28600cc690 0x7f28600b43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:45.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.459+0000 7f286619f640 1 --2- 172.21.15.53:0/3695749350 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28600b3ac0 0x7f28600b3e90 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:45.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.459+0000 7f286619f640 1 -- 172.21.15.53:0/3695749350 >> 172.21.15.53:0/3695749350 conn(0x7f2860069de0 msgr2=0x7f286006a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:45.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.459+0000 7f286619f640 1 -- 172.21.15.53:0/3695749350 shutdown_connections 2023-06-10T19:05:45.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.459+0000 7f286619f640 1 -- 172.21.15.53:0/3695749350 wait complete. 2023-06-10T19:05:45.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.459+0000 7f286619f640 1 Processor -- start 2023-06-10T19:05:45.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.459+0000 7f286619f640 1 -- start start 2023-06-10T19:05:45.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.459+0000 7f286619f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28600b3ac0 0x7f28600ca810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:45.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.459+0000 7f286619f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28600cc690 0x7f2860159990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:45.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.459+0000 7f286619f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28600d1b00 0x7f2860159ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:45.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.459+0000 7f286619f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28600c7800 con 0x7f28600d1b00 2023-06-10T19:05:45.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.459+0000 7f286619f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28600c7ac0 con 0x7f28600cc690 2023-06-10T19:05:45.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.459+0000 7f286619f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28600c7da0 con 0x7f28600b3ac0 2023-06-10T19:05:45.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.459+0000 7f285effd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28600cc690 0x7f2860159990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:45.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.459+0000 7f285ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28600d1b00 0x7f2860159ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:45.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.459+0000 7f285f7fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28600b3ac0 0x7f28600ca810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:45.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.459+0000 7f285effd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28600cc690 0x7f2860159990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.53:41594/0 (socket says 172.21.15.53:41594) 2023-06-10T19:05:45.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.459+0000 7f285effd640 1 -- 172.21.15.53:0/1675810586 learned_addr learned my addr 172.21.15.53:0/1675810586 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:45.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.459+0000 7f285effd640 1 -- 172.21.15.53:0/1675810586 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28600b3ac0 msgr2=0x7f28600ca810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:45.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.459+0000 7f285effd640 1 --2- 172.21.15.53:0/1675810586 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28600b3ac0 0x7f28600ca810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:45.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.459+0000 7f285effd640 1 -- 172.21.15.53:0/1675810586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28600d1b00 msgr2=0x7f2860159ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:45.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.459+0000 7f285effd640 1 --2- 172.21.15.53:0/1675810586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28600d1b00 0x7f2860159ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:45.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.459+0000 7f285effd640 1 -- 172.21.15.53:0/1675810586 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28500094d0 con 0x7f28600cc690 2023-06-10T19:05:45.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.459+0000 7f285effd640 1 --2- 172.21.15.53:0/1675810586 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28600cc690 0x7f2860159990 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f285400e930 tx=0x7f285400edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:45.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.459+0000 7f2847fff640 1 -- 172.21.15.53:0/1675810586 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2854009690 con 0x7f28600cc690 2023-06-10T19:05:45.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.459+0000 7f286619f640 1 -- 172.21.15.53:0/1675810586 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28600c8080 con 0x7f28600cc690 2023-06-10T19:05:45.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.459+0000 7f2847fff640 1 -- 172.21.15.53:0/1675810586 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f285400ca00 con 0x7f28600cc690 2023-06-10T19:05:45.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.459+0000 7f2847fff640 1 -- 172.21.15.53:0/1675810586 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f285400cd70 con 0x7f28600cc690 2023-06-10T19:05:45.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.459+0000 7f286619f640 1 -- 172.21.15.53:0/1675810586 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28600c8880 con 0x7f28600cc690 2023-06-10T19:05:45.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.463+0000 7f286619f640 1 -- 172.21.15.53:0/1675810586 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28600c8b60 con 0x7f28600cc690 2023-06-10T19:05:45.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.463+0000 7f2847fff640 1 -- 172.21.15.53:0/1675810586 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2854013470 con 0x7f28600cc690 2023-06-10T19:05:45.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.463+0000 7f2847fff640 1 --2- 172.21.15.53:0/1675810586 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f284c066280 0x7f284c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:45.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.463+0000 7f2847fff640 1 -- 172.21.15.53:0/1675810586 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f2854083c80 con 0x7f28600cc690 2023-06-10T19:05:45.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.463+0000 7f285f7fe640 1 --2- 172.21.15.53:0/1675810586 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f284c066280 0x7f284c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:45.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.463+0000 7f285f7fe640 1 --2- 172.21.15.53:0/1675810586 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f284c066280 0x7f284c068730 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f28500ad000 tx=0x7f2850008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:45.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.471+0000 7f2847fff640 1 -- 172.21.15.53:0/1675810586 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f28600c8b60 con 0x7f28600cc690 2023-06-10T19:05:45.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:45.635+0000 7f286619f640 1 -- 172.21.15.53:0/1675810586 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f28600c8b60 con 0x7f28600cc690 2023-06-10T19:05:46.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.447+0000 7f2847fff640 1 -- 172.21.15.53:0/1675810586 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v134) v1 ==== 97+0+0 (secure 0 0 0) 0x7f28600c8b60 con 0x7f28600cc690 2023-06-10T19:05:46.454 INFO:teuthology.orchestra.run.smithi053.stderr: removed all blocklist entries 2023-06-10T19:05:46.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.451+0000 7f286619f640 1 -- 172.21.15.53:0/1675810586 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f284c066280 msgr2=0x7f284c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:46.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.451+0000 7f286619f640 1 --2- 172.21.15.53:0/1675810586 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f284c066280 0x7f284c068730 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f28500ad000 tx=0x7f2850008040 comp rx=0 tx=0).stop 2023-06-10T19:05:46.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.451+0000 7f286619f640 1 -- 172.21.15.53:0/1675810586 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28600cc690 msgr2=0x7f2860159990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:46.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.451+0000 7f286619f640 1 --2- 172.21.15.53:0/1675810586 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28600cc690 0x7f2860159990 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f285400e930 tx=0x7f285400edf0 comp rx=0 tx=0).stop 2023-06-10T19:05:46.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.451+0000 7f286619f640 1 -- 172.21.15.53:0/1675810586 shutdown_connections 2023-06-10T19:05:46.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.451+0000 7f286619f640 1 --2- 172.21.15.53:0/1675810586 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f284c066280 0x7f284c068730 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:46.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.451+0000 7f286619f640 1 --2- 172.21.15.53:0/1675810586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f28600d1b00 0x7f2860159ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:46.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.451+0000 7f286619f640 1 --2- 172.21.15.53:0/1675810586 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28600cc690 0x7f2860159990 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:46.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.451+0000 7f286619f640 1 --2- 172.21.15.53:0/1675810586 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28600b3ac0 0x7f28600ca810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:46.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.451+0000 7f286619f640 1 -- 172.21.15.53:0/1675810586 >> 172.21.15.53:0/1675810586 conn(0x7f2860069de0 msgr2=0x7f28600b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:46.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.451+0000 7f286619f640 1 -- 172.21.15.53:0/1675810586 shutdown_connections 2023-06-10T19:05:46.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.451+0000 7f286619f640 1 -- 172.21.15.53:0/1675810586 wait complete. 2023-06-10T19:05:46.479 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-06-10T19:05:46.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.599+0000 7fb0a6f29640 1 Processor -- start 2023-06-10T19:05:46.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.603+0000 7fb0a6f29640 1 -- start start 2023-06-10T19:05:46.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.603+0000 7fb0a6f29640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0a0157e10 0x7fb0a006efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:46.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.603+0000 7fb0a6f29640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb0a00afe30 0x7fb0a00ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:46.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.603+0000 7fb0a6f29640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0a00c9e50 con 0x7fb0a006bb30 2023-06-10T19:05:46.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.603+0000 7fb0a6f29640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0a00cd520 con 0x7fb0a00afe30 2023-06-10T19:05:46.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.603+0000 7fb0a6f29640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a00c82f0 con 0x7fb0a0157e10 2023-06-10T19:05:46.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.603+0000 7fb0a54c6640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb0a00afe30 0x7fb0a00ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:46.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.603+0000 7fb09ffff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fb0a006bb30 0x7fb0a00af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:43830/0 (socket says 172.21.15.53:43830) 2023-06-10T19:05:46.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.603+0000 7fb09ffff640 1 -- 172.21.15.53:0/3828037107 learned_addr learned my addr 172.21.15.53:0/3828037107 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:05:46.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.603+0000 7fb0a4cc5640 1 --2- 172.21.15.53:0/3828037107 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0a0157e10 0x7fb0a006efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:46.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.603+0000 7fb0a54c6640 1 -- 172.21.15.53:0/3828037107 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0a0157e10 msgr2=0x7fb0a006efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:46.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.603+0000 7fb0a54c6640 1 --2- 172.21.15.53:0/3828037107 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0a0157e10 0x7fb0a006efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:46.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.603+0000 7fb0a54c6640 1 -- 172.21.15.53:0/3828037107 >> v1:172.21.15.53:6789/0 conn(0x7fb0a006bb30 legacy=0x7fb0a00af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:46.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.603+0000 7fb0a54c6640 1 -- 172.21.15.53:0/3828037107 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0a006bf80 con 0x7fb0a00afe30 2023-06-10T19:05:46.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.607+0000 7fb0a54c6640 1 --2- 172.21.15.53:0/3828037107 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0a00afe30 0x7fb0a00ccfe0 secure :-1 s=READY pgs=2002 cs=0 l=1 rev1=1 crypto rx=0x7fb098009d90 tx=0x7fb09801c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16dcbfb591e9a411 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:46.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.607+0000 7fb09f7fe640 1 -- 172.21.15.53:0/3828037107 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0980a58d0 con 0x7fb0a00afe30 2023-06-10T19:05:46.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.607+0000 7fb09f7fe640 1 -- 172.21.15.53:0/3828037107 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0980a5a30 con 0x7fb0a00afe30 2023-06-10T19:05:46.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.607+0000 7fb09f7fe640 1 -- 172.21.15.53:0/3828037107 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0980a5dc0 con 0x7fb0a00afe30 2023-06-10T19:05:46.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.607+0000 7fb0a6f29640 1 -- 172.21.15.53:0/3828037107 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0a00afe30 msgr2=0x7fb0a00ccfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:46.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.607+0000 7fb0a6f29640 1 --2- 172.21.15.53:0/3828037107 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0a00afe30 0x7fb0a00ccfe0 secure :-1 s=READY pgs=2002 cs=0 l=1 rev1=1 crypto rx=0x7fb098009d90 tx=0x7fb09801c890 comp rx=0 tx=0).stop 2023-06-10T19:05:46.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.607+0000 7fb0a6f29640 1 -- 172.21.15.53:0/3828037107 shutdown_connections 2023-06-10T19:05:46.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.607+0000 7fb0a6f29640 1 --2- 172.21.15.53:0/3828037107 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0a00afe30 0x7fb0a00ccfe0 unknown :-1 s=CLOSED pgs=2002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:46.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.607+0000 7fb0a6f29640 1 --2- 172.21.15.53:0/3828037107 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0a0157e10 0x7fb0a006efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:46.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.607+0000 7fb0a6f29640 1 -- 172.21.15.53:0/3828037107 >> 172.21.15.53:0/3828037107 conn(0x7fb0a006a0d0 msgr2=0x7fb0a00ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:46.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.607+0000 7fb0a6f29640 1 -- 172.21.15.53:0/3828037107 shutdown_connections 2023-06-10T19:05:46.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.607+0000 7fb0a6f29640 1 -- 172.21.15.53:0/3828037107 wait complete. 2023-06-10T19:05:46.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.607+0000 7fb0a6f29640 1 Processor -- start 2023-06-10T19:05:46.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.607+0000 7fb0a6f29640 1 -- start start 2023-06-10T19:05:46.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.607+0000 7fb0a6f29640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0a006bb30 0x7fb0a014bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:46.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.607+0000 7fb0a6f29640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0a00afe30 0x7fb0a014c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:46.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.607+0000 7fb0a6f29640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0a0157e10 0x7fb0a00b0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:46.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.607+0000 7fb0a6f29640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a01586d0 con 0x7fb0a0157e10 2023-06-10T19:05:46.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.607+0000 7fb0a6f29640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a014d0d0 con 0x7fb0a006bb30 2023-06-10T19:05:46.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.607+0000 7fb0a6f29640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a014d3b0 con 0x7fb0a00afe30 2023-06-10T19:05:46.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.607+0000 7fb0a54c6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0a0157e10 0x7fb0a00b0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:46.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.607+0000 7fb0a54c6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0a0157e10 0x7fb0a00b0ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57446/0 (socket says 172.21.15.53:57446) 2023-06-10T19:05:46.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.607+0000 7fb0a54c6640 1 -- 172.21.15.53:0/210597800 learned_addr learned my addr 172.21.15.53:0/210597800 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:46.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.607+0000 7fb0a4cc5640 1 --2- 172.21.15.53:0/210597800 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0a006bb30 0x7fb0a014bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:46.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.611+0000 7fb09ffff640 1 --2- 172.21.15.53:0/210597800 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0a00afe30 0x7fb0a014c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:46.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.611+0000 7fb0a54c6640 1 -- 172.21.15.53:0/210597800 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0a00afe30 msgr2=0x7fb0a014c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:46.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.611+0000 7fb0a54c6640 1 --2- 172.21.15.53:0/210597800 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0a00afe30 0x7fb0a014c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:46.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.611+0000 7fb0a54c6640 1 -- 172.21.15.53:0/210597800 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0a006bb30 msgr2=0x7fb0a014bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:46.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.611+0000 7fb0a54c6640 1 --2- 172.21.15.53:0/210597800 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0a006bb30 0x7fb0a014bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:46.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.611+0000 7fb0a54c6640 1 -- 172.21.15.53:0/210597800 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb098009a70 con 0x7fb0a0157e10 2023-06-10T19:05:46.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.611+0000 7fb09ffff640 1 --2- 172.21.15.53:0/210597800 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0a00afe30 0x7fb0a014c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:05:46.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.611+0000 7fb0a54c6640 1 --2- 172.21.15.53:0/210597800 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0a0157e10 0x7fb0a00b0ad0 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 crypto rx=0x7fb0980b0040 tx=0x7fb098019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:46.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.611+0000 7fb09d7fa640 1 -- 172.21.15.53:0/210597800 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0980b9860 con 0x7fb0a0157e10 2023-06-10T19:05:46.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.611+0000 7fb09d7fa640 1 -- 172.21.15.53:0/210597800 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0980b99c0 con 0x7fb0a0157e10 2023-06-10T19:05:46.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.611+0000 7fb09d7fa640 1 -- 172.21.15.53:0/210597800 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0980b9d70 con 0x7fb0a0157e10 2023-06-10T19:05:46.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.611+0000 7fb0a6f29640 1 -- 172.21.15.53:0/210597800 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0a014d690 con 0x7fb0a0157e10 2023-06-10T19:05:46.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.611+0000 7fb0a6f29640 1 -- 172.21.15.53:0/210597800 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0a0151990 con 0x7fb0a0157e10 2023-06-10T19:05:46.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.611+0000 7fb0a6f29640 1 -- 172.21.15.53:0/210597800 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0a0158840 con 0x7fb0a0157e10 2023-06-10T19:05:46.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.611+0000 7fb09d7fa640 1 -- 172.21.15.53:0/210597800 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb0980ad440 con 0x7fb0a0157e10 2023-06-10T19:05:46.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.611+0000 7fb09d7fa640 1 --2- 172.21.15.53:0/210597800 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb08c066280 0x7fb08c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:46.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.611+0000 7fb09d7fa640 1 -- 172.21.15.53:0/210597800 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fb09811ee50 con 0x7fb0a0157e10 2023-06-10T19:05:46.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.611+0000 7fb0a4cc5640 1 --2- 172.21.15.53:0/210597800 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb08c066280 0x7fb08c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:46.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.615+0000 7fb0a4cc5640 1 --2- 172.21.15.53:0/210597800 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb08c066280 0x7fb08c068730 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fb09400b930 tx=0x7fb094008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:46.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.619+0000 7fb09d7fa640 1 -- 172.21.15.53:0/210597800 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb0980ec740 con 0x7fb0a0157e10 2023-06-10T19:05:46.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.831+0000 7fb0a6f29640 1 -- 172.21.15.53:0/210597800 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fb0a004d790 con 0x7fb0a0157e10 2023-06-10T19:05:46.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.831+0000 7fb09d7fa640 1 -- 172.21.15.53:0/210597800 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v19) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fb0980efd60 con 0x7fb0a0157e10 2023-06-10T19:05:46.838 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:05:46.838 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-06-10T19:05:46.838 INFO:teuthology.orchestra.run.smithi053.stdout: "auth_dump": [ 2023-06-10T19:05:46.838 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:05:46.839 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.a", 2023-06-10T19:05:46.839 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkWqEQBhAAW+iEw0Gxfw744rsYc/tfTQ==", 2023-06-10T19:05:46.839 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:05:46.839 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T19:05:46.839 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2023-06-10T19:05:46.839 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2023-06-10T19:05:46.839 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:05:46.839 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:05:46.840 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:05:46.840 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:05:46.840 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.b", 2023-06-10T19:05:46.840 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkSu02FRAAFpo6NpcwDLZUt2Rgk/wm8w==", 2023-06-10T19:05:46.840 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:05:46.840 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T19:05:46.840 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2023-06-10T19:05:46.841 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2023-06-10T19:05:46.841 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:05:46.841 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:05:46.841 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:05:46.841 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:05:46.841 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.c", 2023-06-10T19:05:46.841 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRk19/ODhAAodfGGNLP7UbNhHySgaukrg==", 2023-06-10T19:05:46.841 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:05:46.842 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T19:05:46.842 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2023-06-10T19:05:46.842 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2023-06-10T19:05:46.842 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:05:46.842 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:05:46.842 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:05:46.843 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:05:46.843 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.d", 2023-06-10T19:05:46.843 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkogwkGxAAIavVKa8GtML1XQDEMwwokQ==", 2023-06-10T19:05:46.843 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:05:46.843 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T19:05:46.843 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2023-06-10T19:05:46.843 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2023-06-10T19:05:46.844 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:05:46.844 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:05:46.844 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:05:46.844 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:05:46.845 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.0", 2023-06-10T19:05:46.845 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA7xoRkoj1OMhAAYFc4W5kAlMBqY2yzeJZXQw==", 2023-06-10T19:05:46.845 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:05:46.845 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T19:05:46.845 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T19:05:46.845 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:05:46.845 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:05:46.845 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:05:46.846 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:05:46.846 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.1", 2023-06-10T19:05:46.846 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA+xoRk6FpDOBAALjxW3eaIh3Gu9b1rmMmqfw==", 2023-06-10T19:05:46.846 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:05:46.846 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T19:05:46.846 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T19:05:46.846 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:05:46.846 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:05:46.847 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:05:46.847 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:05:46.847 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.2", 2023-06-10T19:05:46.847 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBCxoRkaO2GBRAA0Xr5en+n5DxhZDg8kVswpQ==", 2023-06-10T19:05:46.847 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:05:46.847 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T19:05:46.847 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T19:05:46.848 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:05:46.848 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:05:46.848 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:05:46.848 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:05:46.848 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.3", 2023-06-10T19:05:46.848 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBFxoRkjfsBDhAAArYYrPnmXu5VcUMGVjQXZg==", 2023-06-10T19:05:46.848 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:05:46.848 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T19:05:46.849 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T19:05:46.849 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:05:46.849 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:05:46.849 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:05:46.849 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:05:46.849 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.4", 2023-06-10T19:05:46.849 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBLxoRkybumChAAdym/nl9bzyI71flvuy9Vtw==", 2023-06-10T19:05:46.849 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:05:46.850 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T19:05:46.850 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T19:05:46.850 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:05:46.850 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:05:46.850 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:05:46.850 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:05:46.850 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.5", 2023-06-10T19:05:46.850 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBOxoRkinSGIRAAwLbgYKI4NsbHKqGo9O4WuQ==", 2023-06-10T19:05:46.851 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:05:46.851 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T19:05:46.851 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T19:05:46.851 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:05:46.851 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:05:46.851 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:05:46.851 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:05:46.851 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.6", 2023-06-10T19:05:46.852 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBRxoRkj7VlKRAAs2ReBZ5iqtr17Nli9kUtGQ==", 2023-06-10T19:05:46.852 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:05:46.852 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T19:05:46.852 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T19:05:46.852 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:05:46.853 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:05:46.853 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:05:46.853 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:05:46.853 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.7", 2023-06-10T19:05:46.853 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBUxoRk48CnMhAASfbeuCo9jDuHQrYDQ8Vt3A==", 2023-06-10T19:05:46.853 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:05:46.853 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T19:05:46.853 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T19:05:46.854 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:05:46.854 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:05:46.854 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:05:46.854 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:05:46.854 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.0", 2023-06-10T19:05:46.854 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkgey1IBAAkNYrXMgUOnavBY/5uGyFrw==", 2023-06-10T19:05:46.854 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:05:46.855 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T19:05:46.855 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow r", 2023-06-10T19:05:46.855 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-06-10T19:05:46.855 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:05:46.855 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:05:46.855 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:05:46.855 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.1", 2023-06-10T19:05:46.855 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkBw+UKBAAuvT+vXmJLG5CvQVg5xItDQ==", 2023-06-10T19:05:46.856 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:05:46.856 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T19:05:46.856 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow r", 2023-06-10T19:05:46.856 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow rw", 2023-06-10T19:05:46.856 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rwx" 2023-06-10T19:05:46.856 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:05:46.856 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:05:46.856 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:05:46.857 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.2", 2023-06-10T19:05:46.857 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkewjeJRAA4pmIEVJ3Z7GKQFmA54CZ5Q==", 2023-06-10T19:05:46.857 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:05:46.857 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T19:05:46.857 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow r", 2023-06-10T19:05:46.857 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow rw", 2023-06-10T19:05:46.857 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rwx" 2023-06-10T19:05:46.858 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:05:46.858 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:05:46.858 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:05:46.858 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.3", 2023-06-10T19:05:46.858 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkHwCiLRAAWGt8UoWxGlG1Y1zSPbKUCg==", 2023-06-10T19:05:46.858 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:05:46.858 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T19:05:46.858 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow r", 2023-06-10T19:05:46.859 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow rw", 2023-06-10T19:05:46.859 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rwx" 2023-06-10T19:05:46.859 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:05:46.859 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:05:46.859 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:05:46.859 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.admin", 2023-06-10T19:05:46.859 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA5xoRkIVgrKBAABIxiaOPe9h5ne2y2l50aMg==", 2023-06-10T19:05:46.859 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:05:46.860 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow *", 2023-06-10T19:05:46.860 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2023-06-10T19:05:46.860 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2023-06-10T19:05:46.860 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:05:46.861 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:05:46.861 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:05:46.861 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:05:46.861 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mgr.x", 2023-06-10T19:05:46.861 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkzWG3AhAAh3NFYHAbp4fgn4FZeRRNuw==", 2023-06-10T19:05:46.861 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:05:46.861 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow *", 2023-06-10T19:05:46.861 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile mgr", 2023-06-10T19:05:46.862 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:05:46.862 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:05:46.862 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:05:46.862 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:05:46.862 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mgr.y", 2023-06-10T19:05:46.862 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA5xoRkBriKOxAA6G+T7Yp2rH7XV7z37lvMYQ==", 2023-06-10T19:05:46.862 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:05:46.863 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow *", 2023-06-10T19:05:46.863 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile mgr", 2023-06-10T19:05:46.863 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:05:46.863 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:05:46.863 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:05:46.863 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2023-06-10T19:05:46.863 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-06-10T19:05:46.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.835+0000 7fb0a6f29640 1 -- 172.21.15.53:0/210597800 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb08c066280 msgr2=0x7fb08c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:46.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.835+0000 7fb0a6f29640 1 --2- 172.21.15.53:0/210597800 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb08c066280 0x7fb08c068730 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fb09400b930 tx=0x7fb094008040 comp rx=0 tx=0).stop 2023-06-10T19:05:46.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.835+0000 7fb0a6f29640 1 -- 172.21.15.53:0/210597800 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0a0157e10 msgr2=0x7fb0a00b0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:46.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.835+0000 7fb0a6f29640 1 --2- 172.21.15.53:0/210597800 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0a0157e10 0x7fb0a00b0ad0 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 crypto rx=0x7fb0980b0040 tx=0x7fb098019630 comp rx=0 tx=0).stop 2023-06-10T19:05:46.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.835+0000 7fb0a6f29640 1 -- 172.21.15.53:0/210597800 shutdown_connections 2023-06-10T19:05:46.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.835+0000 7fb0a6f29640 1 --2- 172.21.15.53:0/210597800 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb08c066280 0x7fb08c068730 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:46.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.835+0000 7fb0a6f29640 1 --2- 172.21.15.53:0/210597800 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0a0157e10 0x7fb0a00b0ad0 unknown :-1 s=CLOSED pgs=2003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:46.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.835+0000 7fb0a6f29640 1 --2- 172.21.15.53:0/210597800 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0a00afe30 0x7fb0a014c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:46.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.835+0000 7fb0a6f29640 1 --2- 172.21.15.53:0/210597800 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0a006bb30 0x7fb0a014bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:46.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.835+0000 7fb0a6f29640 1 -- 172.21.15.53:0/210597800 >> 172.21.15.53:0/210597800 conn(0x7fb0a006a0d0 msgr2=0x7fb0a00af050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:46.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.835+0000 7fb0a6f29640 1 -- 172.21.15.53:0/210597800 shutdown_connections 2023-06-10T19:05:46.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.835+0000 7fb0a6f29640 1 -- 172.21.15.53:0/210597800 wait complete. 2023-06-10T19:05:46.868 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:05:46.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.991+0000 7ff2102c6640 1 Processor -- start 2023-06-10T19:05:46.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.991+0000 7ff2102c6640 1 -- start start 2023-06-10T19:05:46.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.991+0000 7ff2102c6640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff2080cc690 0x7ff2080d04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:46.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.991+0000 7ff2102c6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff2080ccae0 0x7ff2080d09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:46.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.991+0000 7ff2102c6640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2080d0020 con 0x7ff2080b3ac0 2023-06-10T19:05:46.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.991+0000 7ff2102c6640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2080cef40 con 0x7ff2080cc690 2023-06-10T19:05:46.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.991+0000 7ff2102c6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2080cf220 con 0x7ff2080ccae0 2023-06-10T19:05:46.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.991+0000 7ff20d861640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff2080cc690 0x7ff2080d04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:46.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.991+0000 7ff20d861640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff2080cc690 0x7ff2080d04b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57460/0 (socket says 172.21.15.53:57460) 2023-06-10T19:05:46.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.991+0000 7ff20d861640 1 -- 172.21.15.53:0/2134088256 learned_addr learned my addr 172.21.15.53:0/2134088256 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:46.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.991+0000 7ff20e863640 1 --2- 172.21.15.53:0/2134088256 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff2080ccae0 0x7ff2080d09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:46.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.991+0000 7ff20d861640 1 -- 172.21.15.53:0/2134088256 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff2080ccae0 msgr2=0x7ff2080d09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:46.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.991+0000 7ff20d861640 1 --2- 172.21.15.53:0/2134088256 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff2080ccae0 0x7ff2080d09f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:46.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.991+0000 7ff20d861640 1 -- 172.21.15.53:0/2134088256 >> v1:172.21.15.117:6789/0 conn(0x7ff2080b3ac0 legacy=0x7ff2080b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:46.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.991+0000 7ff20d861640 1 -- 172.21.15.53:0/2134088256 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2080cf500 con 0x7ff2080cc690 2023-06-10T19:05:46.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.995+0000 7ff20d861640 1 --2- 172.21.15.53:0/2134088256 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2080cc690 0x7ff2080d04b0 secure :-1 s=READY pgs=2004 cs=0 l=1 rev1=1 crypto rx=0x7ff1f8009870 tx=0x7ff1f801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4013be842033e67b server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:47.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.995+0000 7ff20d060640 1 -- 172.21.15.53:0/2134088256 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f80ac600 con 0x7ff2080cc690 2023-06-10T19:05:47.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.995+0000 7ff20d060640 1 -- 172.21.15.53:0/2134088256 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1f80a8050 con 0x7ff2080cc690 2023-06-10T19:05:47.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.995+0000 7ff20d060640 1 -- 172.21.15.53:0/2134088256 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f80ac980 con 0x7ff2080cc690 2023-06-10T19:05:47.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.995+0000 7ff2102c6640 1 -- 172.21.15.53:0/2134088256 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2080cc690 msgr2=0x7ff2080d04b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:47.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.995+0000 7ff2102c6640 1 --2- 172.21.15.53:0/2134088256 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2080cc690 0x7ff2080d04b0 secure :-1 s=READY pgs=2004 cs=0 l=1 rev1=1 crypto rx=0x7ff1f8009870 tx=0x7ff1f801c4d0 comp rx=0 tx=0).stop 2023-06-10T19:05:47.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.995+0000 7ff2102c6640 1 -- 172.21.15.53:0/2134088256 shutdown_connections 2023-06-10T19:05:47.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.995+0000 7ff2102c6640 1 --2- 172.21.15.53:0/2134088256 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff2080ccae0 0x7ff2080d09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:47.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.995+0000 7ff2102c6640 1 --2- 172.21.15.53:0/2134088256 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2080cc690 0x7ff2080d04b0 unknown :-1 s=CLOSED pgs=2004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:47.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.995+0000 7ff2102c6640 1 -- 172.21.15.53:0/2134088256 >> 172.21.15.53:0/2134088256 conn(0x7ff208071790 msgr2=0x7ff208069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:47.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.995+0000 7ff2102c6640 1 -- 172.21.15.53:0/2134088256 shutdown_connections 2023-06-10T19:05:47.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.995+0000 7ff2102c6640 1 -- 172.21.15.53:0/2134088256 wait complete. 2023-06-10T19:05:47.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.995+0000 7ff2102c6640 1 Processor -- start 2023-06-10T19:05:47.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.995+0000 7ff2102c6640 1 -- start start 2023-06-10T19:05:47.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.995+0000 7ff2102c6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2080b3ac0 0x7ff2081521a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:47.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.995+0000 7ff2102c6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2080cc690 0x7ff2080b2820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:47.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.995+0000 7ff2102c6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff2080ccae0 0x7ff20815be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:47.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.995+0000 7ff2102c6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff208153e40 con 0x7ff2080cc690 2023-06-10T19:05:47.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.995+0000 7ff2102c6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2081526e0 con 0x7ff2080b3ac0 2023-06-10T19:05:47.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.995+0000 7ff2102c6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff208153250 con 0x7ff2080ccae0 2023-06-10T19:05:47.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.995+0000 7ff20d861640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2080cc690 0x7ff2080b2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:47.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.995+0000 7ff20d861640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2080cc690 0x7ff2080b2820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57462/0 (socket says 172.21.15.53:57462) 2023-06-10T19:05:47.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.995+0000 7ff20d861640 1 -- 172.21.15.53:0/1527855872 learned_addr learned my addr 172.21.15.53:0/1527855872 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:47.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.995+0000 7ff20e863640 1 --2- 172.21.15.53:0/1527855872 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff2080ccae0 0x7ff20815be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:47.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.995+0000 7ff20e062640 1 --2- 172.21.15.53:0/1527855872 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2080b3ac0 0x7ff2081521a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:47.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.995+0000 7ff20d861640 1 -- 172.21.15.53:0/1527855872 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff2080ccae0 msgr2=0x7ff20815be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:47.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.995+0000 7ff20d861640 1 --2- 172.21.15.53:0/1527855872 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff2080ccae0 0x7ff20815be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:47.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.995+0000 7ff20d861640 1 -- 172.21.15.53:0/1527855872 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2080b3ac0 msgr2=0x7ff2081521a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:47.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.995+0000 7ff20d861640 1 --2- 172.21.15.53:0/1527855872 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2080b3ac0 0x7ff2081521a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:47.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.995+0000 7ff20d861640 1 -- 172.21.15.53:0/1527855872 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1f80094d0 con 0x7ff2080cc690 2023-06-10T19:05:47.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.995+0000 7ff20d861640 1 --2- 172.21.15.53:0/1527855872 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2080cc690 0x7ff2080b2820 secure :-1 s=READY pgs=2005 cs=0 l=1 rev1=1 crypto rx=0x7ff1f80097c0 tx=0x7ff1f801ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:47.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.995+0000 7ff1feffd640 1 -- 172.21.15.53:0/1527855872 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f80b7860 con 0x7ff2080cc690 2023-06-10T19:05:47.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.999+0000 7ff1feffd640 1 -- 172.21.15.53:0/1527855872 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1f80b79c0 con 0x7ff2080cc690 2023-06-10T19:05:47.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.999+0000 7ff2102c6640 1 -- 172.21.15.53:0/1527855872 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2080b2d60 con 0x7ff2080cc690 2023-06-10T19:05:47.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.999+0000 7ff1feffd640 1 -- 172.21.15.53:0/1527855872 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f80b7d50 con 0x7ff2080cc690 2023-06-10T19:05:47.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.999+0000 7ff2102c6640 1 -- 172.21.15.53:0/1527855872 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff208153780 con 0x7ff2080cc690 2023-06-10T19:05:47.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.999+0000 7ff2102c6640 1 -- 172.21.15.53:0/1527855872 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff208153f80 con 0x7ff2080cc690 2023-06-10T19:05:47.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.999+0000 7ff1feffd640 1 -- 172.21.15.53:0/1527855872 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff1f80b3070 con 0x7ff2080cc690 2023-06-10T19:05:47.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.999+0000 7ff1feffd640 1 --2- 172.21.15.53:0/1527855872 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff1ec066280 0x7ff1ec068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:47.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.999+0000 7ff1feffd640 1 -- 172.21.15.53:0/1527855872 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ff1f811e100 con 0x7ff2080cc690 2023-06-10T19:05:47.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.999+0000 7ff20e062640 1 --2- 172.21.15.53:0/1527855872 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff1ec066280 0x7ff1ec068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:47.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:46.999+0000 7ff20e062640 1 --2- 172.21.15.53:0/1527855872 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff1ec066280 0x7ff1ec068730 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7ff204003d60 tx=0x7ff204009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:47.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.003+0000 7ff1feffd640 1 -- 172.21.15.53:0/1527855872 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff208153f80 con 0x7ff2080cc690 2023-06-10T19:05:47.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.159+0000 7ff2102c6640 1 -- 172.21.15.53:0/1527855872 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff208153f80 con 0x7ff2080cc690 2023-06-10T19:05:47.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.163+0000 7ff1feffd640 1 -- 172.21.15.53:0/1527855872 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v134) v1 ==== 74+0+14637 (secure 0 0 0) 0x7ff208153f80 con 0x7ff2080cc690 2023-06-10T19:05:47.167 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:05:47.168 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":134,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:05:46.436834+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:05:47.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.163+0000 7ff2102c6640 1 -- 172.21.15.53:0/1527855872 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff1ec066280 msgr2=0x7ff1ec068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:47.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.163+0000 7ff2102c6640 1 --2- 172.21.15.53:0/1527855872 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff1ec066280 0x7ff1ec068730 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7ff204003d60 tx=0x7ff204009040 comp rx=0 tx=0).stop 2023-06-10T19:05:47.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.163+0000 7ff2102c6640 1 -- 172.21.15.53:0/1527855872 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2080cc690 msgr2=0x7ff2080b2820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:47.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.163+0000 7ff2102c6640 1 --2- 172.21.15.53:0/1527855872 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2080cc690 0x7ff2080b2820 secure :-1 s=READY pgs=2005 cs=0 l=1 rev1=1 crypto rx=0x7ff1f80097c0 tx=0x7ff1f801ad10 comp rx=0 tx=0).stop 2023-06-10T19:05:47.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.163+0000 7ff2102c6640 1 -- 172.21.15.53:0/1527855872 shutdown_connections 2023-06-10T19:05:47.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.163+0000 7ff2102c6640 1 --2- 172.21.15.53:0/1527855872 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff1ec066280 0x7ff1ec068730 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:47.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.163+0000 7ff2102c6640 1 --2- 172.21.15.53:0/1527855872 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff2080ccae0 0x7ff20815be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:47.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.163+0000 7ff2102c6640 1 --2- 172.21.15.53:0/1527855872 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2080cc690 0x7ff2080b2820 unknown :-1 s=CLOSED pgs=2005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:47.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.163+0000 7ff2102c6640 1 --2- 172.21.15.53:0/1527855872 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2080b3ac0 0x7ff2081521a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:47.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.163+0000 7ff2102c6640 1 -- 172.21.15.53:0/1527855872 >> 172.21.15.53:0/1527855872 conn(0x7ff208071790 msgr2=0x7ff208158460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:47.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.163+0000 7ff2102c6640 1 -- 172.21.15.53:0/1527855872 shutdown_connections 2023-06-10T19:05:47.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.163+0000 7ff2102c6640 1 -- 172.21.15.53:0/1527855872 wait complete. 2023-06-10T19:05:47.187 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-10T18:52:33.633114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-10T18:52:39.171487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-10T19:05:47.187 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-10T19:05:47.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.299+0000 7fa5ab046640 1 Processor -- start 2023-06-10T19:05:47.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.299+0000 7fa5ab046640 1 -- start start 2023-06-10T19:05:47.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.303+0000 7fa5ab046640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5a40b3ac0 0x7fa5a40b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:47.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.303+0000 7fa5ab046640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5a40d0020 con 0x7fa5a40d14c0 2023-06-10T19:05:47.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.303+0000 7fa5ab046640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5a4160190 con 0x7fa5a40cc690 2023-06-10T19:05:47.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.303+0000 7fa5ab046640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a40b43d0 con 0x7fa5a40b3ac0 2023-06-10T19:05:47.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.303+0000 7fa5a95e3640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fa5a40d14c0 0x7fa5a415fa80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:43844/0 (socket says 172.21.15.53:43844) 2023-06-10T19:05:47.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.303+0000 7fa5a95e3640 1 -- 172.21.15.53:0/546145974 learned_addr learned my addr 172.21.15.53:0/546145974 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:05:47.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.303+0000 7fa5a8de2640 1 --2- 172.21.15.53:0/546145974 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5a40b3ac0 0x7fa5a40b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:47.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.303+0000 7fa5a37fe640 1 -- 172.21.15.53:0/546145974 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3511482372 0 0) 0x7fa5a40d0020 con 0x7fa5a40d14c0 2023-06-10T19:05:47.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.303+0000 7fa5a37fe640 1 -- 172.21.15.53:0/546145974 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa58c003530 con 0x7fa5a40d14c0 2023-06-10T19:05:47.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.303+0000 7fa5a37fe640 1 -- 172.21.15.53:0/546145974 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4245076202 0 0) 0x7fa58c003530 con 0x7fa5a40d14c0 2023-06-10T19:05:47.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.303+0000 7fa5a37fe640 1 -- 172.21.15.53:0/546145974 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5a40b3ac0 msgr2=0x7fa5a40b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:47.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.303+0000 7fa5a37fe640 1 --2- 172.21.15.53:0/546145974 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5a40b3ac0 0x7fa5a40b3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:47.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.303+0000 7fa5a37fe640 1 -- 172.21.15.53:0/546145974 >> v1:172.21.15.117:6789/0 conn(0x7fa5a40cc690 legacy=0x7fa5a415f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:47.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.303+0000 7fa5a37fe640 1 -- 172.21.15.53:0/546145974 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a40cef40 con 0x7fa5a40d14c0 2023-06-10T19:05:47.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.303+0000 7fa5a37fe640 1 -- 172.21.15.53:0/546145974 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fa59c001a00 con 0x7fa5a40d14c0 2023-06-10T19:05:47.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.303+0000 7fa5a37fe640 1 -- 172.21.15.53:0/546145974 >> v1:172.21.15.53:6789/0 conn(0x7fa5a40d14c0 legacy=0x7fa5a415fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:47.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.303+0000 7fa5a37fe640 1 --2- 172.21.15.53:0/546145974 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5a40b3ac0 0x7fa58c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:47.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.303+0000 7fa5a37fe640 1 --2- 172.21.15.53:0/546145974 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa58c003f30 0x7fa58c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:47.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.303+0000 7fa5a37fe640 1 --2- 172.21.15.53:0/546145974 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa58c004d10 0x7fa58c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:47.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.303+0000 7fa5a37fe640 1 -- 172.21.15.53:0/546145974 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a40b43d0 con 0x7fa58c003f30 2023-06-10T19:05:47.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.303+0000 7fa5a37fe640 1 -- 172.21.15.53:0/546145974 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa58c00ba70 con 0x7fa58c004d10 2023-06-10T19:05:47.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.303+0000 7fa5a37fe640 1 -- 172.21.15.53:0/546145974 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa58c00bc30 con 0x7fa5a40b3ac0 2023-06-10T19:05:47.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.303+0000 7fa5a3fff640 1 --2- 172.21.15.53:0/546145974 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa58c003f30 0x7fa58c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:47.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.303+0000 7fa5a95e3640 1 --2- 172.21.15.53:0/546145974 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa58c004d10 0x7fa58c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:47.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.303+0000 7fa5a8de2640 1 --2- 172.21.15.53:0/546145974 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5a40b3ac0 0x7fa58c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:47.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.303+0000 7fa5a3fff640 1 -- 172.21.15.53:0/546145974 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5a40b3ac0 msgr2=0x7fa58c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:47.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.303+0000 7fa5a3fff640 1 --2- 172.21.15.53:0/546145974 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5a40b3ac0 0x7fa58c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:47.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.303+0000 7fa5a3fff640 1 -- 172.21.15.53:0/546145974 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa58c004d10 msgr2=0x7fa58c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:47.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.303+0000 7fa5a3fff640 1 --2- 172.21.15.53:0/546145974 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa58c004d10 0x7fa58c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:47.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.303+0000 7fa5a3fff640 1 -- 172.21.15.53:0/546145974 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa58c003530 con 0x7fa58c003f30 2023-06-10T19:05:47.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.307+0000 7fa5a3fff640 1 --2- 172.21.15.53:0/546145974 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa58c003f30 0x7fa58c0047d0 secure :-1 s=READY pgs=2007 cs=0 l=1 rev1=1 crypto rx=0x7fa594001750 tx=0x7fa59401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29e7e0c3450b6fa6 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:47.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.307+0000 7fa5a37fe640 1 -- 172.21.15.53:0/546145974 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5940052d0 con 0x7fa58c003f30 2023-06-10T19:05:47.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.307+0000 7fa5a37fe640 1 -- 172.21.15.53:0/546145974 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5940a7050 con 0x7fa58c003f30 2023-06-10T19:05:47.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.307+0000 7fa5a37fe640 1 -- 172.21.15.53:0/546145974 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa594003600 con 0x7fa58c003f30 2023-06-10T19:05:47.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.307+0000 7fa5ab046640 1 -- 172.21.15.53:0/546145974 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa58c003f30 msgr2=0x7fa58c0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:47.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.307+0000 7fa5ab046640 1 --2- 172.21.15.53:0/546145974 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa58c003f30 0x7fa58c0047d0 secure :-1 s=READY pgs=2007 cs=0 l=1 rev1=1 crypto rx=0x7fa594001750 tx=0x7fa59401c3c0 comp rx=0 tx=0).stop 2023-06-10T19:05:47.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.307+0000 7fa5a95e3640 1 -- 172.21.15.53:0/546145974 reap_dead start 2023-06-10T19:05:47.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.307+0000 7fa5ab046640 1 -- 172.21.15.53:0/546145974 shutdown_connections 2023-06-10T19:05:47.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.307+0000 7fa5ab046640 1 -- 172.21.15.53:0/546145974 >> 172.21.15.53:0/546145974 conn(0x7fa5a4071790 msgr2=0x7fa5a4069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:47.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.307+0000 7fa5ab046640 1 -- 172.21.15.53:0/546145974 shutdown_connections 2023-06-10T19:05:47.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.307+0000 7fa5ab046640 1 -- 172.21.15.53:0/546145974 wait complete. 2023-06-10T19:05:47.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.307+0000 7fa5ab046640 1 Processor -- start 2023-06-10T19:05:47.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.307+0000 7fa5ab046640 1 -- start start 2023-06-10T19:05:47.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.307+0000 7fa5ab046640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5a4158850 0x7fa5a41e8930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:47.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.307+0000 7fa5ab046640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5a4158c20 0x7fa5a40cb4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:47.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.307+0000 7fa5ab046640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa5a4159090 0x7fa5a40cba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:47.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.307+0000 7fa5ab046640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a40c69d0 con 0x7fa5a4159090 2023-06-10T19:05:47.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.307+0000 7fa5ab046640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a40cbf70 con 0x7fa5a4158850 2023-06-10T19:05:47.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.307+0000 7fa5ab046640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a41e8fc0 con 0x7fa5a4158c20 2023-06-10T19:05:47.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.307+0000 7fa5a95e3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa5a4159090 0x7fa5a40cba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:47.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.307+0000 7fa5a95e3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa5a4159090 0x7fa5a40cba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57486/0 (socket says 172.21.15.53:57486) 2023-06-10T19:05:47.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.307+0000 7fa5a95e3640 1 -- 172.21.15.53:0/297597422 learned_addr learned my addr 172.21.15.53:0/297597422 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:47.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.307+0000 7fa5a8de2640 1 --2- 172.21.15.53:0/297597422 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5a4158850 0x7fa5a41e8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:47.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.307+0000 7fa5a3fff640 1 --2- 172.21.15.53:0/297597422 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5a4158c20 0x7fa5a40cb4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:47.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.307+0000 7fa5a95e3640 1 -- 172.21.15.53:0/297597422 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5a4158c20 msgr2=0x7fa5a40cb4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:47.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.307+0000 7fa5a95e3640 1 --2- 172.21.15.53:0/297597422 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5a4158c20 0x7fa5a40cb4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:47.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.307+0000 7fa5a95e3640 1 -- 172.21.15.53:0/297597422 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5a4158850 msgr2=0x7fa5a41e8930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:47.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.307+0000 7fa5a95e3640 1 --2- 172.21.15.53:0/297597422 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5a4158850 0x7fa5a41e8930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:47.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.307+0000 7fa5a95e3640 1 -- 172.21.15.53:0/297597422 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a40c9a60 con 0x7fa5a4159090 2023-06-10T19:05:47.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.307+0000 7fa5a95e3640 1 --2- 172.21.15.53:0/297597422 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa5a4159090 0x7fa5a40cba30 secure :-1 s=READY pgs=2008 cs=0 l=1 rev1=1 crypto rx=0x7fa59c000f90 tx=0x7fa59c011790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:47.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.311+0000 7fa5a17fa640 1 -- 172.21.15.53:0/297597422 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa59c014370 con 0x7fa5a4159090 2023-06-10T19:05:47.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.311+0000 7fa5ab046640 1 -- 172.21.15.53:0/297597422 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5a40cc350 con 0x7fa5a4159090 2023-06-10T19:05:47.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.311+0000 7fa5ab046640 1 -- 172.21.15.53:0/297597422 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5a40c9fe0 con 0x7fa5a4159090 2023-06-10T19:05:47.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.311+0000 7fa5a17fa640 1 -- 172.21.15.53:0/297597422 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa59c0144d0 con 0x7fa5a4159090 2023-06-10T19:05:47.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.311+0000 7fa5a17fa640 1 -- 172.21.15.53:0/297597422 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa59c014880 con 0x7fa5a4159090 2023-06-10T19:05:47.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.311+0000 7fa5ab046640 1 -- 172.21.15.53:0/297597422 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa584005260 con 0x7fa5a4159090 2023-06-10T19:05:47.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.311+0000 7fa5a17fa640 1 -- 172.21.15.53:0/297597422 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa59c0149e0 con 0x7fa5a4159090 2023-06-10T19:05:47.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.311+0000 7fa5a17fa640 1 --2- 172.21.15.53:0/297597422 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa590066280 0x7fa590068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:47.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.311+0000 7fa5a17fa640 1 -- 172.21.15.53:0/297597422 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fa59c085b70 con 0x7fa5a4159090 2023-06-10T19:05:47.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.311+0000 7fa5a8de2640 1 --2- 172.21.15.53:0/297597422 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa590066280 0x7fa590068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:47.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.311+0000 7fa5a8de2640 1 --2- 172.21.15.53:0/297597422 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa590066280 0x7fa590068730 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fa5a41e86f0 tx=0x7fa598008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:47.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.315+0000 7fa5a17fa640 1 -- 172.21.15.53:0/297597422 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa59c053350 con 0x7fa5a4159090 2023-06-10T19:05:47.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.471+0000 7fa5ab046640 1 -- 172.21.15.53:0/297597422 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa584005a90 con 0x7fa5a4159090 2023-06-10T19:05:47.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.471+0000 7fa5a17fa640 1 -- 172.21.15.53:0/297597422 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v134) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa59c01c0a0 con 0x7fa5a4159090 2023-06-10T19:05:47.476 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-06-10T19:05:47.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.471+0000 7fa5ab046640 1 -- 172.21.15.53:0/297597422 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa590066280 msgr2=0x7fa590068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:47.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.471+0000 7fa5ab046640 1 --2- 172.21.15.53:0/297597422 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa590066280 0x7fa590068730 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fa5a41e86f0 tx=0x7fa598008040 comp rx=0 tx=0).stop 2023-06-10T19:05:47.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.471+0000 7fa5ab046640 1 -- 172.21.15.53:0/297597422 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa5a4159090 msgr2=0x7fa5a40cba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:47.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.471+0000 7fa5ab046640 1 --2- 172.21.15.53:0/297597422 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa5a4159090 0x7fa5a40cba30 secure :-1 s=READY pgs=2008 cs=0 l=1 rev1=1 crypto rx=0x7fa59c000f90 tx=0x7fa59c011790 comp rx=0 tx=0).stop 2023-06-10T19:05:47.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.471+0000 7fa5ab046640 1 -- 172.21.15.53:0/297597422 shutdown_connections 2023-06-10T19:05:47.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.471+0000 7fa5ab046640 1 --2- 172.21.15.53:0/297597422 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa590066280 0x7fa590068730 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:47.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.471+0000 7fa5ab046640 1 --2- 172.21.15.53:0/297597422 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa5a4159090 0x7fa5a40cba30 unknown :-1 s=CLOSED pgs=2008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:47.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.471+0000 7fa5ab046640 1 --2- 172.21.15.53:0/297597422 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5a4158c20 0x7fa5a40cb4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:47.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.471+0000 7fa5ab046640 1 --2- 172.21.15.53:0/297597422 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5a4158850 0x7fa5a41e8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:47.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.471+0000 7fa5ab046640 1 -- 172.21.15.53:0/297597422 >> 172.21.15.53:0/297597422 conn(0x7fa5a4071790 msgr2=0x7fa5a415f0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:47.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.471+0000 7fa5ab046640 1 -- 172.21.15.53:0/297597422 shutdown_connections 2023-06-10T19:05:47.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.471+0000 7fa5ab046640 1 -- 172.21.15.53:0/297597422 wait complete. 2023-06-10T19:05:47.495 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-10T19:05:47.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.619+0000 7fbaf87a2640 1 Processor -- start 2023-06-10T19:05:47.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.619+0000 7fbaf87a2640 1 -- start start 2023-06-10T19:05:47.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.619+0000 7fbaf87a2640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbaf015b870 0x7fbaf006a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:47.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.619+0000 7fbaf87a2640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbaf00affc0 0x7fbaf00b03f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:47.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.619+0000 7fbaf87a2640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaf006ae70 con 0x7fbaf0069450 2023-06-10T19:05:47.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.619+0000 7fbaf87a2640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaf00b0930 con 0x7fbaf015b870 2023-06-10T19:05:47.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.619+0000 7fbaf87a2640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaf00655c0 con 0x7fbaf00affc0 2023-06-10T19:05:47.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.619+0000 7fbaf653e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbaf015b870 0x7fbaf006a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:47.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.619+0000 7fbaf653e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbaf015b870 0x7fbaf006a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57500/0 (socket says 172.21.15.53:57500) 2023-06-10T19:05:47.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.619+0000 7fbaf6d3f640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fbaf0069450 0x7fbaf00698b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:43850/0 (socket says 172.21.15.53:43850) 2023-06-10T19:05:47.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.619+0000 7fbaf653e640 1 -- 172.21.15.53:0/1897613961 learned_addr learned my addr 172.21.15.53:0/1897613961 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:47.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.619+0000 7fbaf5d3d640 1 --2- 172.21.15.53:0/1897613961 >> v2:172.21.15.117:3300/0 conn(0x7fbaf00affc0 0x7fbaf00b03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:47.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.619+0000 7fbaf653e640 1 -- 172.21.15.53:0/1897613961 >> v2:172.21.15.117:3300/0 conn(0x7fbaf00affc0 msgr2=0x7fbaf00b03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:47.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.619+0000 7fbaf653e640 1 --2- 172.21.15.53:0/1897613961 >> v2:172.21.15.117:3300/0 conn(0x7fbaf00affc0 0x7fbaf00b03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:47.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.619+0000 7fbaf653e640 1 -- 172.21.15.53:0/1897613961 >> v1:172.21.15.53:6789/0 conn(0x7fbaf0069450 legacy=0x7fbaf00698b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:47.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.619+0000 7fbaf553c640 1 -- 172.21.15.53:0/1897613961 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1029241982 0 0) 0x7fbae80014a0 con 0x7fbaf0069450 2023-06-10T19:05:47.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.619+0000 7fbaf653e640 1 -- 172.21.15.53:0/1897613961 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaf00cc110 con 0x7fbaf015b870 2023-06-10T19:05:47.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.623+0000 7fbaf653e640 1 --2- 172.21.15.53:0/1897613961 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbaf015b870 0x7fbaf006a930 secure :-1 s=READY pgs=2010 cs=0 l=1 rev1=1 crypto rx=0x7fbaf00c9660 tx=0x7fbaec01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3855d0c332a32019 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:47.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.623+0000 7fbaf553c640 1 -- 172.21.15.53:0/1897613961 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaec0ad660 con 0x7fbaf015b870 2023-06-10T19:05:47.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.623+0000 7fbaf553c640 1 -- 172.21.15.53:0/1897613961 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaec0ad7c0 con 0x7fbaf015b870 2023-06-10T19:05:47.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.623+0000 7fbaf553c640 1 -- 172.21.15.53:0/1897613961 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaec0adb50 con 0x7fbaf015b870 2023-06-10T19:05:47.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.623+0000 7fbaf87a2640 1 -- 172.21.15.53:0/1897613961 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbaf015b870 msgr2=0x7fbaf006a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:47.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.623+0000 7fbaf87a2640 1 --2- 172.21.15.53:0/1897613961 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbaf015b870 0x7fbaf006a930 secure :-1 s=READY pgs=2010 cs=0 l=1 rev1=1 crypto rx=0x7fbaf00c9660 tx=0x7fbaec01c440 comp rx=0 tx=0).stop 2023-06-10T19:05:47.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.623+0000 7fbaf87a2640 1 -- 172.21.15.53:0/1897613961 shutdown_connections 2023-06-10T19:05:47.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.623+0000 7fbaf87a2640 1 --2- 172.21.15.53:0/1897613961 >> v2:172.21.15.117:3300/0 conn(0x7fbaf00affc0 0x7fbaf00b03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:47.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.623+0000 7fbaf87a2640 1 --2- 172.21.15.53:0/1897613961 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbaf015b870 0x7fbaf006a930 unknown :-1 s=CLOSED pgs=2010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:47.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.623+0000 7fbaf87a2640 1 -- 172.21.15.53:0/1897613961 >> 172.21.15.53:0/1897613961 conn(0x7fbaf00cafc0 msgr2=0x7fbaf00cb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:47.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.623+0000 7fbaf87a2640 1 -- 172.21.15.53:0/1897613961 shutdown_connections 2023-06-10T19:05:47.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.623+0000 7fbaf87a2640 1 -- 172.21.15.53:0/1897613961 wait complete. 2023-06-10T19:05:47.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.623+0000 7fbaf87a2640 1 Processor -- start 2023-06-10T19:05:47.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.623+0000 7fbaf87a2640 1 -- start start 2023-06-10T19:05:47.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.623+0000 7fbaf87a2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbaf0069450 0x7fbaf00c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:47.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.623+0000 7fbaf87a2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbaf00affc0 0x7fbaf015cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:47.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.623+0000 7fbaf87a2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbaf015b870 0x7fbaf015d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:47.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.623+0000 7fbaf87a2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf015d700 con 0x7fbaf015b870 2023-06-10T19:05:47.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.623+0000 7fbaf87a2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf00c3980 con 0x7fbaf0069450 2023-06-10T19:05:47.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.623+0000 7fbaf87a2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf00c3c60 con 0x7fbaf00affc0 2023-06-10T19:05:47.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.627+0000 7fbaf6d3f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbaf015b870 0x7fbaf015d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:47.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.627+0000 7fbaf6d3f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbaf015b870 0x7fbaf015d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57510/0 (socket says 172.21.15.53:57510) 2023-06-10T19:05:47.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.627+0000 7fbaf6d3f640 1 -- 172.21.15.53:0/244729310 learned_addr learned my addr 172.21.15.53:0/244729310 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:47.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.627+0000 7fbaf653e640 1 --2- 172.21.15.53:0/244729310 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbaf0069450 0x7fbaf00c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:47.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.627+0000 7fbaf5d3d640 1 --2- 172.21.15.53:0/244729310 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbaf00affc0 0x7fbaf015cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:47.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.627+0000 7fbaf6d3f640 1 -- 172.21.15.53:0/244729310 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbaf00affc0 msgr2=0x7fbaf015cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:47.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.627+0000 7fbaf6d3f640 1 --2- 172.21.15.53:0/244729310 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbaf00affc0 0x7fbaf015cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:47.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.627+0000 7fbaf6d3f640 1 -- 172.21.15.53:0/244729310 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbaf0069450 msgr2=0x7fbaf00c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:47.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.627+0000 7fbaf6d3f640 1 --2- 172.21.15.53:0/244729310 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbaf0069450 0x7fbaf00c7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:47.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.627+0000 7fbaf6d3f640 1 -- 172.21.15.53:0/244729310 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaec0094d0 con 0x7fbaf015b870 2023-06-10T19:05:47.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.627+0000 7fbaf653e640 1 --2- 172.21.15.53:0/244729310 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbaf0069450 0x7fbaf00c7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:05:47.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.627+0000 7fbaf5d3d640 1 --2- 172.21.15.53:0/244729310 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbaf00affc0 0x7fbaf015cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:05:47.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.627+0000 7fbaf6d3f640 1 --2- 172.21.15.53:0/244729310 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbaf015b870 0x7fbaf015d1c0 secure :-1 s=READY pgs=2011 cs=0 l=1 rev1=1 crypto rx=0x7fbae800c780 tx=0x7fbae800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:47.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.627+0000 7fbae6ffd640 1 -- 172.21.15.53:0/244729310 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae800ce90 con 0x7fbaf015b870 2023-06-10T19:05:47.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.627+0000 7fbae6ffd640 1 -- 172.21.15.53:0/244729310 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbae800a640 con 0x7fbaf015b870 2023-06-10T19:05:47.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.627+0000 7fbae6ffd640 1 -- 172.21.15.53:0/244729310 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae800a9d0 con 0x7fbaf015b870 2023-06-10T19:05:47.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.627+0000 7fbaf87a2640 1 -- 172.21.15.53:0/244729310 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaf0150960 con 0x7fbaf015b870 2023-06-10T19:05:47.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.627+0000 7fbaf87a2640 1 -- 172.21.15.53:0/244729310 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaf0150f20 con 0x7fbaf015b870 2023-06-10T19:05:47.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.627+0000 7fbaf87a2640 1 -- 172.21.15.53:0/244729310 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbaf0151140 con 0x7fbaf015b870 2023-06-10T19:05:47.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.627+0000 7fbae6ffd640 1 -- 172.21.15.53:0/244729310 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbae800ab30 con 0x7fbaf015b870 2023-06-10T19:05:47.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.627+0000 7fbae6ffd640 1 --2- 172.21.15.53:0/244729310 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbad4066280 0x7fbad4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:47.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.627+0000 7fbae6ffd640 1 -- 172.21.15.53:0/244729310 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fbae8082de0 con 0x7fbaf015b870 2023-06-10T19:05:47.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.627+0000 7fbaf653e640 1 --2- 172.21.15.53:0/244729310 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbad4066280 0x7fbad4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:47.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.631+0000 7fbaf653e640 1 --2- 172.21.15.53:0/244729310 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbad4066280 0x7fbad4068730 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fbaec0af000 tx=0x7fbaec008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:47.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.631+0000 7fbae6ffd640 1 -- 172.21.15.53:0/244729310 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbae8050520 con 0x7fbaf015b870 2023-06-10T19:05:47.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.779+0000 7fbaf87a2640 1 -- 172.21.15.53:0/244729310 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fbaf006ae70 con 0x7fbaf015b870 2023-06-10T19:05:47.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.783+0000 7fbae6ffd640 1 -- 172.21.15.53:0/244729310 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v134) v1 ==== 92+0+10 (secure 0 0 0) 0x7fbaf006ae70 con 0x7fbaf015b870 2023-06-10T19:05:47.787 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-06-10T19:05:47.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.783+0000 7fbaf87a2640 1 -- 172.21.15.53:0/244729310 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbad4066280 msgr2=0x7fbad4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:47.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.783+0000 7fbaf87a2640 1 --2- 172.21.15.53:0/244729310 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbad4066280 0x7fbad4068730 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fbaec0af000 tx=0x7fbaec008040 comp rx=0 tx=0).stop 2023-06-10T19:05:47.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.783+0000 7fbaf87a2640 1 -- 172.21.15.53:0/244729310 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbaf015b870 msgr2=0x7fbaf015d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:47.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.783+0000 7fbaf87a2640 1 --2- 172.21.15.53:0/244729310 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbaf015b870 0x7fbaf015d1c0 secure :-1 s=READY pgs=2011 cs=0 l=1 rev1=1 crypto rx=0x7fbae800c780 tx=0x7fbae800cc40 comp rx=0 tx=0).stop 2023-06-10T19:05:47.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.783+0000 7fbaf87a2640 1 -- 172.21.15.53:0/244729310 shutdown_connections 2023-06-10T19:05:47.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.783+0000 7fbaf87a2640 1 --2- 172.21.15.53:0/244729310 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbad4066280 0x7fbad4068730 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:47.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.783+0000 7fbaf87a2640 1 --2- 172.21.15.53:0/244729310 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbaf015b870 0x7fbaf015d1c0 unknown :-1 s=CLOSED pgs=2011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:47.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.783+0000 7fbaf87a2640 1 --2- 172.21.15.53:0/244729310 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbaf00affc0 0x7fbaf015cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:47.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.783+0000 7fbaf87a2640 1 --2- 172.21.15.53:0/244729310 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbaf0069450 0x7fbaf00c7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:47.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.783+0000 7fbaf87a2640 1 -- 172.21.15.53:0/244729310 >> 172.21.15.53:0/244729310 conn(0x7fbaf00cafc0 msgr2=0x7fbaf00b1390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:47.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.783+0000 7fbaf87a2640 1 -- 172.21.15.53:0/244729310 shutdown_connections 2023-06-10T19:05:47.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.783+0000 7fbaf87a2640 1 -- 172.21.15.53:0/244729310 wait complete. 2023-06-10T19:05:47.804 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-06-10T19:05:47.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.919+0000 7f04a4115640 1 Processor -- start 2023-06-10T19:05:47.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.919+0000 7f04a4115640 1 -- start start 2023-06-10T19:05:47.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.923+0000 7f04a4115640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f049c0b3ac0 0x7f049c0b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:47.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.923+0000 7f04a4115640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f049c0d14c0 0x7f049c15fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:47.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.923+0000 7f04a4115640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f049c0d0020 con 0x7f049c0cc690 2023-06-10T19:05:47.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.923+0000 7f04a4115640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f049c0b43d0 con 0x7f049c0b3ac0 2023-06-10T19:05:47.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.923+0000 7f04a4115640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f049c0cef40 con 0x7f049c0d14c0 2023-06-10T19:05:47.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.923+0000 7f04a1eb1640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f049c0b3ac0 0x7f049c0b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:47.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.923+0000 7f04a1eb1640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f049c0b3ac0 0x7f049c0b3e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57522/0 (socket says 172.21.15.53:57522) 2023-06-10T19:05:47.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.923+0000 7f04a16b0640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f049c0cc690 0x7f049c15f370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:43856/0 (socket says 172.21.15.53:43856) 2023-06-10T19:05:47.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.923+0000 7f04a1eb1640 1 -- 172.21.15.53:0/2837774551 learned_addr learned my addr 172.21.15.53:0/2837774551 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:47.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.923+0000 7f04a26b2640 1 --2- 172.21.15.53:0/2837774551 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f049c0d14c0 0x7f049c15fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:47.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.923+0000 7f04a1eb1640 1 -- 172.21.15.53:0/2837774551 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f049c0d14c0 msgr2=0x7f049c15fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:47.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.923+0000 7f04a0eaf640 1 -- 172.21.15.53:0/2837774551 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 339184944 0 0) 0x7f049c0d0020 con 0x7f049c0cc690 2023-06-10T19:05:47.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.923+0000 7f04a1eb1640 1 --2- 172.21.15.53:0/2837774551 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f049c0d14c0 0x7f049c15fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:47.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.923+0000 7f04a1eb1640 1 -- 172.21.15.53:0/2837774551 >> v1:172.21.15.53:6789/0 conn(0x7f049c0cc690 legacy=0x7f049c15f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:47.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.923+0000 7f04a1eb1640 1 -- 172.21.15.53:0/2837774551 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f049c0cf220 con 0x7f049c0b3ac0 2023-06-10T19:05:47.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.923+0000 7f04a1eb1640 1 --2- 172.21.15.53:0/2837774551 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f049c0b3ac0 0x7f049c0b3e90 secure :-1 s=READY pgs=2013 cs=0 l=1 rev1=1 crypto rx=0x7f0498009870 tx=0x7f049801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3a72e6adb169f57 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:47.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.923+0000 7f04a0eaf640 1 -- 172.21.15.53:0/2837774551 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04980ab620 con 0x7f049c0b3ac0 2023-06-10T19:05:47.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.923+0000 7f04a0eaf640 1 -- 172.21.15.53:0/2837774551 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04980ab780 con 0x7f049c0b3ac0 2023-06-10T19:05:47.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.923+0000 7f04a0eaf640 1 -- 172.21.15.53:0/2837774551 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04980abb10 con 0x7f049c0b3ac0 2023-06-10T19:05:47.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.927+0000 7f04a4115640 1 -- 172.21.15.53:0/2837774551 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f049c0b3ac0 msgr2=0x7f049c0b3e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:47.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.927+0000 7f04a4115640 1 --2- 172.21.15.53:0/2837774551 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f049c0b3ac0 0x7f049c0b3e90 secure :-1 s=READY pgs=2013 cs=0 l=1 rev1=1 crypto rx=0x7f0498009870 tx=0x7f049801c510 comp rx=0 tx=0).stop 2023-06-10T19:05:47.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.927+0000 7f04a4115640 1 -- 172.21.15.53:0/2837774551 shutdown_connections 2023-06-10T19:05:47.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.927+0000 7f04a4115640 1 --2- 172.21.15.53:0/2837774551 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f049c0d14c0 0x7f049c15fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:47.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.927+0000 7f04a4115640 1 --2- 172.21.15.53:0/2837774551 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f049c0b3ac0 0x7f049c0b3e90 unknown :-1 s=CLOSED pgs=2013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:47.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.927+0000 7f04a4115640 1 -- 172.21.15.53:0/2837774551 >> 172.21.15.53:0/2837774551 conn(0x7f049c071790 msgr2=0x7f049c069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:47.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.927+0000 7f04a4115640 1 -- 172.21.15.53:0/2837774551 shutdown_connections 2023-06-10T19:05:47.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.927+0000 7f04a4115640 1 -- 172.21.15.53:0/2837774551 wait complete. 2023-06-10T19:05:47.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.927+0000 7f04a4115640 1 Processor -- start 2023-06-10T19:05:47.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.927+0000 7f04a4115640 1 -- start start 2023-06-10T19:05:47.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.927+0000 7f04a4115640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f049c0b3ac0 0x7f049c15f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:47.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.927+0000 7f04a4115640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f049c0cc690 0x7f049c15a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:47.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.927+0000 7f04a4115640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f049c0d14c0 0x7f049c14e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:47.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.927+0000 7f04a4115640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f049c153b10 con 0x7f049c0d14c0 2023-06-10T19:05:47.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.927+0000 7f04a4115640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f049c152770 con 0x7f049c0cc690 2023-06-10T19:05:47.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.927+0000 7f04a4115640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f049c152470 con 0x7f049c0b3ac0 2023-06-10T19:05:47.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.927+0000 7f04a26b2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f049c0d14c0 0x7f049c14e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:47.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.927+0000 7f04a26b2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f049c0d14c0 0x7f049c14e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57530/0 (socket says 172.21.15.53:57530) 2023-06-10T19:05:47.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.927+0000 7f04a26b2640 1 -- 172.21.15.53:0/159749817 learned_addr learned my addr 172.21.15.53:0/159749817 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:47.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.927+0000 7f04a1eb1640 1 --2- 172.21.15.53:0/159749817 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f049c0b3ac0 0x7f049c15f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:47.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.927+0000 7f04a16b0640 1 --2- 172.21.15.53:0/159749817 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f049c0cc690 0x7f049c15a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:47.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.927+0000 7f04a26b2640 1 -- 172.21.15.53:0/159749817 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f049c0b3ac0 msgr2=0x7f049c15f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:47.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.927+0000 7f04a26b2640 1 --2- 172.21.15.53:0/159749817 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f049c0b3ac0 0x7f049c15f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:47.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.927+0000 7f04a26b2640 1 -- 172.21.15.53:0/159749817 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f049c0cc690 msgr2=0x7f049c15a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:47.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.927+0000 7f04a26b2640 1 --2- 172.21.15.53:0/159749817 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f049c0cc690 0x7f049c15a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:47.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.927+0000 7f04a26b2640 1 -- 172.21.15.53:0/159749817 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04980094d0 con 0x7f049c0d14c0 2023-06-10T19:05:47.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.927+0000 7f04a16b0640 1 --2- 172.21.15.53:0/159749817 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f049c0cc690 0x7f049c15a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:05:47.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.927+0000 7f04a26b2640 1 --2- 172.21.15.53:0/159749817 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f049c0d14c0 0x7f049c14e420 secure :-1 s=READY pgs=2014 cs=0 l=1 rev1=1 crypto rx=0x7f0494007ec0 tx=0x7f049400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:47.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.927+0000 7f04927fc640 1 -- 172.21.15.53:0/159749817 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0494014620 con 0x7f049c0d14c0 2023-06-10T19:05:47.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.927+0000 7f04927fc640 1 -- 172.21.15.53:0/159749817 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04940147a0 con 0x7f049c0d14c0 2023-06-10T19:05:47.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.927+0000 7f04a4115640 1 -- 172.21.15.53:0/159749817 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f049c15ace0 con 0x7f049c0d14c0 2023-06-10T19:05:47.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.927+0000 7f04927fc640 1 -- 172.21.15.53:0/159749817 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0494014b50 con 0x7f049c0d14c0 2023-06-10T19:05:47.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.927+0000 7f04a4115640 1 -- 172.21.15.53:0/159749817 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f049c14e960 con 0x7f049c0d14c0 2023-06-10T19:05:47.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.931+0000 7f04a4115640 1 -- 172.21.15.53:0/159749817 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f049c152900 con 0x7f049c0d14c0 2023-06-10T19:05:47.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.931+0000 7f04927fc640 1 -- 172.21.15.53:0/159749817 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0494014cb0 con 0x7f049c0d14c0 2023-06-10T19:05:47.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.931+0000 7f04927fc640 1 --2- 172.21.15.53:0/159749817 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0480066280 0x7f0480068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:47.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.931+0000 7f04927fc640 1 -- 172.21.15.53:0/159749817 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0494084220 con 0x7f049c0d14c0 2023-06-10T19:05:47.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.931+0000 7f04a1eb1640 1 --2- 172.21.15.53:0/159749817 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0480066280 0x7f0480068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:47.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.931+0000 7f04a1eb1640 1 --2- 172.21.15.53:0/159749817 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0480066280 0x7f0480068730 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f04980af000 tx=0x7f04980a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:47.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:47.935+0000 7f04927fc640 1 -- 172.21.15.53:0/159749817 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0494051a80 con 0x7f049c0d14c0 2023-06-10T19:05:48.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:48.091+0000 7f04a4115640 1 -- 172.21.15.53:0/159749817 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f049c04d790 con 0x7f049c0d14c0 2023-06-10T19:05:48.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:48.091+0000 7f04927fc640 1 -- 172.21.15.53:0/159749817 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v134) v1 ==== 84+0+126 (secure 0 0 0) 0x7f04940550a0 con 0x7f049c0d14c0 2023-06-10T19:05:48.098 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:05:48.099 INFO:teuthology.orchestra.run.smithi053.stdout:[ 2023-06-10T19:05:48.099 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:05:48.099 INFO:teuthology.orchestra.run.smithi053.stdout: "poolnum": 1, 2023-06-10T19:05:48.100 INFO:teuthology.orchestra.run.smithi053.stdout: "poolname": ".mgr" 2023-06-10T19:05:48.100 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:05:48.100 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:05:48.100 INFO:teuthology.orchestra.run.smithi053.stdout: "poolnum": 2, 2023-06-10T19:05:48.100 INFO:teuthology.orchestra.run.smithi053.stdout: "poolname": "rbd" 2023-06-10T19:05:48.100 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:05:48.100 INFO:teuthology.orchestra.run.smithi053.stdout:] 2023-06-10T19:05:48.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:48.095+0000 7f04a4115640 1 -- 172.21.15.53:0/159749817 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0480066280 msgr2=0x7f0480068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:48.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:48.095+0000 7f04a4115640 1 --2- 172.21.15.53:0/159749817 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0480066280 0x7f0480068730 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f04980af000 tx=0x7f04980a7000 comp rx=0 tx=0).stop 2023-06-10T19:05:48.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:48.095+0000 7f04a4115640 1 -- 172.21.15.53:0/159749817 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f049c0d14c0 msgr2=0x7f049c14e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:48.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:48.095+0000 7f04a4115640 1 --2- 172.21.15.53:0/159749817 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f049c0d14c0 0x7f049c14e420 secure :-1 s=READY pgs=2014 cs=0 l=1 rev1=1 crypto rx=0x7f0494007ec0 tx=0x7f049400e4b0 comp rx=0 tx=0).stop 2023-06-10T19:05:48.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:48.095+0000 7f04a4115640 1 -- 172.21.15.53:0/159749817 shutdown_connections 2023-06-10T19:05:48.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:48.095+0000 7f04a4115640 1 --2- 172.21.15.53:0/159749817 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0480066280 0x7f0480068730 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:48.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:48.095+0000 7f04a4115640 1 --2- 172.21.15.53:0/159749817 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f049c0d14c0 0x7f049c14e420 unknown :-1 s=CLOSED pgs=2014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:48.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:48.095+0000 7f04a4115640 1 --2- 172.21.15.53:0/159749817 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f049c0cc690 0x7f049c15a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:48.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:48.095+0000 7f04a4115640 1 --2- 172.21.15.53:0/159749817 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f049c0b3ac0 0x7f049c15f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:48.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:48.095+0000 7f04a4115640 1 -- 172.21.15.53:0/159749817 >> 172.21.15.53:0/159749817 conn(0x7f049c071790 msgr2=0x7f049c0ce250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:48.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:48.095+0000 7f04a4115640 1 -- 172.21.15.53:0/159749817 shutdown_connections 2023-06-10T19:05:48.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:48.095+0000 7f04a4115640 1 -- 172.21.15.53:0/159749817 wait complete. 2023-06-10T19:05:48.118 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-06-10T19:05:48.118 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-06-10T19:05:48.247 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:48.243+0000 7fd80a113640 1 Processor -- start 2023-06-10T19:05:48.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:48.243+0000 7fd80a113640 1 -- start start 2023-06-10T19:05:48.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:48.243+0000 7fd80a113640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd8040c8400 0x7fd8040accd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:48.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:48.243+0000 7fd80a113640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8040ad210 0x7fd8040abb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:48.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:48.243+0000 7fd80a113640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd80415c3e0 con 0x7fd804156020 2023-06-10T19:05:48.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:48.243+0000 7fd80a113640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8040ad690 con 0x7fd8040c8400 2023-06-10T19:05:48.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:48.243+0000 7fd80a113640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd80415c6c0 con 0x7fd8040ad210 2023-06-10T19:05:48.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:48.243+0000 7fd802ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd8040c8400 0x7fd8040accd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:48.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:48.243+0000 7fd8037fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fd804156020 0x7fd8040cd390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:43862/0 (socket says 172.21.15.53:43862) 2023-06-10T19:05:48.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:48.243+0000 7fd8037fe640 1 -- 172.21.15.53:0/2197119174 learned_addr learned my addr 172.21.15.53:0/2197119174 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:05:48.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:48.243+0000 7fd803fff640 1 --2- 172.21.15.53:0/2197119174 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8040ad210 0x7fd8040abb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:48.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:48.243+0000 7fd802ffd640 1 -- 172.21.15.53:0/2197119174 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8040ad210 msgr2=0x7fd8040abb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:48.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:48.243+0000 7fd802ffd640 1 --2- 172.21.15.53:0/2197119174 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8040ad210 0x7fd8040abb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:48.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:48.243+0000 7fd802ffd640 1 -- 172.21.15.53:0/2197119174 >> v1:172.21.15.53:6789/0 conn(0x7fd804156020 legacy=0x7fd8040cd390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:48.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:48.243+0000 7fd8027fc640 1 -- 172.21.15.53:0/2197119174 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2482551456 0 0) 0x7fd80415c3e0 con 0x7fd804156020 2023-06-10T19:05:48.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:48.243+0000 7fd802ffd640 1 -- 172.21.15.53:0/2197119174 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd80415c9a0 con 0x7fd8040c8400 2023-06-10T19:05:48.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:48.243+0000 7fd803fff640 1 --2- 172.21.15.53:0/2197119174 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8040ad210 0x7fd8040abb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:05:48.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:48.247+0000 7fd802ffd640 1 --2- 172.21.15.53:0/2197119174 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8040c8400 0x7fd8040accd0 secure :-1 s=READY pgs=2016 cs=0 l=1 rev1=1 crypto rx=0x7fd7f80097c0 tx=0x7fd7f801cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d797358e3220d453 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:48.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:48.247+0000 7fd8027fc640 1 -- 172.21.15.53:0/2197119174 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f80a6040 con 0x7fd8040c8400 2023-06-10T19:05:48.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:48.247+0000 7fd8027fc640 1 -- 172.21.15.53:0/2197119174 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7f80aa400 con 0x7fd8040c8400 2023-06-10T19:05:48.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:48.247+0000 7fd8027fc640 1 -- 172.21.15.53:0/2197119174 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f80aa790 con 0x7fd8040c8400 2023-06-10T19:05:48.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:48.247+0000 7fd80a113640 1 -- 172.21.15.53:0/2197119174 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8040c8400 msgr2=0x7fd8040accd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:48.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:48.247+0000 7fd80a113640 1 --2- 172.21.15.53:0/2197119174 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8040c8400 0x7fd8040accd0 secure :-1 s=READY pgs=2016 cs=0 l=1 rev1=1 crypto rx=0x7fd7f80097c0 tx=0x7fd7f801cee0 comp rx=0 tx=0).stop 2023-06-10T19:05:48.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:48.247+0000 7fd80a113640 1 -- 172.21.15.53:0/2197119174 shutdown_connections 2023-06-10T19:05:48.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:48.247+0000 7fd80a113640 1 --2- 172.21.15.53:0/2197119174 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8040c8400 0x7fd8040accd0 unknown :-1 s=CLOSED pgs=2016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:48.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:48.247+0000 7fd80a113640 1 --2- 172.21.15.53:0/2197119174 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8040ad210 0x7fd8040abb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:48.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:48.247+0000 7fd80a113640 1 -- 172.21.15.53:0/2197119174 >> 172.21.15.53:0/2197119174 conn(0x7fd8040ca830 msgr2=0x7fd8040cac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:48.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:48.247+0000 7fd80a113640 1 -- 172.21.15.53:0/2197119174 shutdown_connections 2023-06-10T19:05:48.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:48.247+0000 7fd80a113640 1 -- 172.21.15.53:0/2197119174 wait complete. 2023-06-10T19:05:48.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:48.247+0000 7fd80a113640 1 Processor -- start 2023-06-10T19:05:48.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:48.247+0000 7fd80a113640 1 -- start start 2023-06-10T19:05:48.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:48.247+0000 7fd80a113640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8040ad210 0x7fd80414b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:48.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:48.247+0000 7fd80a113640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8040c8400 0x7fd8040c3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:48.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:48.247+0000 7fd80a113640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd804156020 0x7fd8040c4290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:48.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:48.247+0000 7fd80a113640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8040c47d0 con 0x7fd8040c8400 2023-06-10T19:05:48.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:48.247+0000 7fd80a113640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd804150770 con 0x7fd804156020 2023-06-10T19:05:48.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:48.247+0000 7fd80a113640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd804150a50 con 0x7fd8040ad210 2023-06-10T19:05:48.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:48.247+0000 7fd802ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8040c8400 0x7fd8040c3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:48.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:48.247+0000 7fd802ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8040c8400 0x7fd8040c3d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57552/0 (socket says 172.21.15.53:57552) 2023-06-10T19:05:48.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:48.247+0000 7fd802ffd640 1 -- 172.21.15.53:0/2323401261 learned_addr learned my addr 172.21.15.53:0/2323401261 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:48.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:48.247+0000 7fd8037fe640 1 --2- 172.21.15.53:0/2323401261 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8040ad210 0x7fd80414b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:48.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:48.247+0000 7fd803fff640 1 --2- 172.21.15.53:0/2323401261 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd804156020 0x7fd8040c4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:48.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:48.247+0000 7fd802ffd640 1 -- 172.21.15.53:0/2323401261 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8040ad210 msgr2=0x7fd80414b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:48.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:48.247+0000 7fd802ffd640 1 --2- 172.21.15.53:0/2323401261 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8040ad210 0x7fd80414b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:48.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:48.247+0000 7fd802ffd640 1 -- 172.21.15.53:0/2323401261 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd804156020 msgr2=0x7fd8040c4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:48.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:48.247+0000 7fd802ffd640 1 --2- 172.21.15.53:0/2323401261 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd804156020 0x7fd8040c4290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:48.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:48.247+0000 7fd802ffd640 1 -- 172.21.15.53:0/2323401261 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7f8009420 con 0x7fd8040c8400 2023-06-10T19:05:48.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:48.247+0000 7fd803fff640 1 --2- 172.21.15.53:0/2323401261 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd804156020 0x7fd8040c4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:05:48.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:48.251+0000 7fd802ffd640 1 --2- 172.21.15.53:0/2323401261 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8040c8400 0x7fd8040c3d50 secure :-1 s=READY pgs=2017 cs=0 l=1 rev1=1 crypto rx=0x7fd7f801ab30 tx=0x7fd7f801acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:48.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:48.251+0000 7fd7ebfff640 1 -- 172.21.15.53:0/2323401261 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f80aaea0 con 0x7fd8040c8400 2023-06-10T19:05:48.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:48.251+0000 7fd7ebfff640 1 -- 172.21.15.53:0/2323401261 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7f80b3820 con 0x7fd8040c8400 2023-06-10T19:05:48.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:48.251+0000 7fd80a113640 1 -- 172.21.15.53:0/2323401261 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd804156570 con 0x7fd8040c8400 2023-06-10T19:05:48.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:48.251+0000 7fd7ebfff640 1 -- 172.21.15.53:0/2323401261 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f80b3bd0 con 0x7fd8040c8400 2023-06-10T19:05:48.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:48.251+0000 7fd80a113640 1 -- 172.21.15.53:0/2323401261 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd804151010 con 0x7fd8040c8400 2023-06-10T19:05:48.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:48.251+0000 7fd80a113640 1 -- 172.21.15.53:0/2323401261 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd80404d790 con 0x7fd8040c8400 2023-06-10T19:05:48.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:48.251+0000 7fd7ebfff640 1 -- 172.21.15.53:0/2323401261 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd7f80b3d30 con 0x7fd8040c8400 2023-06-10T19:05:48.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:48.251+0000 7fd7ebfff640 1 --2- 172.21.15.53:0/2323401261 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd7f0066280 0x7fd7f0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:48.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:48.251+0000 7fd7ebfff640 1 -- 172.21.15.53:0/2323401261 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fd7f811d870 con 0x7fd8040c8400 2023-06-10T19:05:48.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:48.251+0000 7fd8037fe640 1 --2- 172.21.15.53:0/2323401261 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd7f0066280 0x7fd7f0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:48.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:48.251+0000 7fd8037fe640 1 --2- 172.21.15.53:0/2323401261 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd7f0066280 0x7fd7f0068730 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fd7f4000f70 tx=0x7fd7f4007c10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:48.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:48.255+0000 7fd7ebfff640 1 -- 172.21.15.53:0/2323401261 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd7f80eafa0 con 0x7fd8040c8400 2023-06-10T19:05:48.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:48.403+0000 7fd80a113640 1 -- 172.21.15.53:0/2323401261 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fd804070220 con 0x7fd8040c8400 2023-06-10T19:05:49.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:49.395+0000 7fd7ebfff640 1 -- 172.21.15.53:0/2323401261 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v135) v1 ==== 138+0+0 (secure 0 0 0) 0x7fd7f80ee5c0 con 0x7fd8040c8400 2023-06-10T19:05:49.402 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_metadata' created 2023-06-10T19:05:49.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:49.403+0000 7fd80a113640 1 -- 172.21.15.53:0/2323401261 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd7f0066280 msgr2=0x7fd7f0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:49.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:49.403+0000 7fd80a113640 1 --2- 172.21.15.53:0/2323401261 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd7f0066280 0x7fd7f0068730 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fd7f4000f70 tx=0x7fd7f4007c10 comp rx=0 tx=0).stop 2023-06-10T19:05:49.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:49.403+0000 7fd80a113640 1 -- 172.21.15.53:0/2323401261 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8040c8400 msgr2=0x7fd8040c3d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:49.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:49.403+0000 7fd80a113640 1 --2- 172.21.15.53:0/2323401261 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8040c8400 0x7fd8040c3d50 secure :-1 s=READY pgs=2017 cs=0 l=1 rev1=1 crypto rx=0x7fd7f801ab30 tx=0x7fd7f801acc0 comp rx=0 tx=0).stop 2023-06-10T19:05:49.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:49.403+0000 7fd80a113640 1 -- 172.21.15.53:0/2323401261 shutdown_connections 2023-06-10T19:05:49.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:49.403+0000 7fd80a113640 1 --2- 172.21.15.53:0/2323401261 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd7f0066280 0x7fd7f0068730 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:49.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:49.403+0000 7fd80a113640 1 --2- 172.21.15.53:0/2323401261 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd804156020 0x7fd8040c4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:49.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:49.403+0000 7fd80a113640 1 --2- 172.21.15.53:0/2323401261 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8040c8400 0x7fd8040c3d50 unknown :-1 s=CLOSED pgs=2017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:49.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:49.403+0000 7fd80a113640 1 --2- 172.21.15.53:0/2323401261 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8040ad210 0x7fd80414b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:49.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:49.403+0000 7fd80a113640 1 -- 172.21.15.53:0/2323401261 >> 172.21.15.53:0/2323401261 conn(0x7fd8040ca830 msgr2=0x7fd8040c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:49.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:49.407+0000 7fd80a113640 1 -- 172.21.15.53:0/2323401261 shutdown_connections 2023-06-10T19:05:49.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:49.407+0000 7fd80a113640 1 -- 172.21.15.53:0/2323401261 wait complete. 2023-06-10T19:05:49.433 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-06-10T19:05:49.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:49.567+0000 7f60be030640 1 Processor -- start 2023-06-10T19:05:49.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:49.567+0000 7f60be030640 1 -- start start 2023-06-10T19:05:49.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:49.567+0000 7f60be030640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f60b8159770 0x7f60b8069450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:49.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:49.567+0000 7f60be030640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60b80cca70 0x7f60b8069990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:49.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:49.567+0000 7f60be030640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60b8159f10 con 0x7f60b80cdf10 2023-06-10T19:05:49.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:49.567+0000 7f60be030640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60b815ab90 con 0x7f60b8159770 2023-06-10T19:05:49.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:49.567+0000 7f60be030640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60b815a1f0 con 0x7f60b80cca70 2023-06-10T19:05:49.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:49.567+0000 7f60b77fe640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f60b8159770 0x7f60b8069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:49.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:49.567+0000 7f60b6ffd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60b80cca70 0x7f60b8069990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:49.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:49.567+0000 7f60b7fff640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f60b80cdf10 0x7f60b80ce390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.53:60480/0 (socket says 172.21.15.53:60480) 2023-06-10T19:05:49.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:49.567+0000 7f60b7fff640 1 -- 172.21.15.53:0/3216029594 learned_addr learned my addr 172.21.15.53:0/3216029594 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:05:49.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:49.567+0000 7f60b6ffd640 1 -- 172.21.15.53:0/3216029594 >> v2:172.21.15.117:3300/0 conn(0x7f60b8159770 msgr2=0x7f60b8069450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:49.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:49.567+0000 7f60b6ffd640 1 --2- 172.21.15.53:0/3216029594 >> v2:172.21.15.117:3300/0 conn(0x7f60b8159770 0x7f60b8069450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:49.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:49.567+0000 7f60b6ffd640 1 -- 172.21.15.53:0/3216029594 >> v1:172.21.15.117:6789/0 conn(0x7f60b80cdf10 legacy=0x7f60b80ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:49.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:49.567+0000 7f60b6ffd640 1 -- 172.21.15.53:0/3216029594 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60b815a4d0 con 0x7f60b80cca70 2023-06-10T19:05:49.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:49.567+0000 7f60b77fe640 1 --2- 172.21.15.53:0/3216029594 >> v2:172.21.15.117:3300/0 conn(0x7f60b8159770 0x7f60b8069450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-10T19:05:49.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:49.571+0000 7f60b6ffd640 1 --2- 172.21.15.53:0/3216029594 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60b80cca70 0x7f60b8069990 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f60ac0097c0 tx=0x7f60ac01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=207ca610ad0316e4 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:49.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:49.571+0000 7f60b67fc640 1 -- 172.21.15.53:0/3216029594 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ac0ab670 con 0x7f60b80cca70 2023-06-10T19:05:49.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:49.571+0000 7f60b67fc640 1 -- 172.21.15.53:0/3216029594 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60ac0ab7d0 con 0x7f60b80cca70 2023-06-10T19:05:49.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:49.571+0000 7f60b67fc640 1 -- 172.21.15.53:0/3216029594 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ac0abb60 con 0x7f60b80cca70 2023-06-10T19:05:49.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:49.571+0000 7f60be030640 1 -- 172.21.15.53:0/3216029594 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60b80cca70 msgr2=0x7f60b8069990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:49.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:49.571+0000 7f60be030640 1 --2- 172.21.15.53:0/3216029594 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60b80cca70 0x7f60b8069990 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f60ac0097c0 tx=0x7f60ac01c450 comp rx=0 tx=0).stop 2023-06-10T19:05:49.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:49.571+0000 7f60be030640 1 -- 172.21.15.53:0/3216029594 shutdown_connections 2023-06-10T19:05:49.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:49.571+0000 7f60be030640 1 --2- 172.21.15.53:0/3216029594 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60b80cca70 0x7f60b8069990 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:49.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:49.571+0000 7f60be030640 1 --2- 172.21.15.53:0/3216029594 >> v2:172.21.15.117:3300/0 conn(0x7f60b8159770 0x7f60b8069450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:49.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:49.571+0000 7f60be030640 1 -- 172.21.15.53:0/3216029594 >> 172.21.15.53:0/3216029594 conn(0x7f60b80cb920 msgr2=0x7f60b80cbd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:49.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:49.571+0000 7f60be030640 1 -- 172.21.15.53:0/3216029594 shutdown_connections 2023-06-10T19:05:49.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:49.571+0000 7f60be030640 1 -- 172.21.15.53:0/3216029594 wait complete. 2023-06-10T19:05:49.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:49.575+0000 7f60be030640 1 Processor -- start 2023-06-10T19:05:49.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:49.575+0000 7f60be030640 1 -- start start 2023-06-10T19:05:49.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:49.575+0000 7f60be030640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60b80cca70 0x7f60b81f3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:49.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:49.575+0000 7f60be030640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60b80cdf10 0x7f60b8162880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:49.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:49.575+0000 7f60be030640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60b8159770 0x7f60b814b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:49.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:49.575+0000 7f60be030640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b8156f40 con 0x7f60b80cdf10 2023-06-10T19:05:49.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:49.575+0000 7f60be030640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b8156330 con 0x7f60b80cca70 2023-06-10T19:05:49.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:49.575+0000 7f60be030640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60b8156610 con 0x7f60b8159770 2023-06-10T19:05:49.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:49.575+0000 7f60b6ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60b80cdf10 0x7f60b8162880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:49.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:49.575+0000 7f60b6ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60b80cdf10 0x7f60b8162880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57556/0 (socket says 172.21.15.53:57556) 2023-06-10T19:05:49.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:49.575+0000 7f60b6ffd640 1 -- 172.21.15.53:0/3260501496 learned_addr learned my addr 172.21.15.53:0/3260501496 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:49.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:49.575+0000 7f60b7fff640 1 --2- 172.21.15.53:0/3260501496 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60b8159770 0x7f60b814b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:49.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:49.575+0000 7f60b77fe640 1 --2- 172.21.15.53:0/3260501496 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60b80cca70 0x7f60b81f3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:49.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:49.575+0000 7f60b6ffd640 1 -- 172.21.15.53:0/3260501496 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60b8159770 msgr2=0x7f60b814b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:49.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:49.575+0000 7f60b6ffd640 1 --2- 172.21.15.53:0/3260501496 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60b8159770 0x7f60b814b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:49.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:49.575+0000 7f60b6ffd640 1 -- 172.21.15.53:0/3260501496 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60b80cca70 msgr2=0x7f60b81f3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:49.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:49.575+0000 7f60b6ffd640 1 --2- 172.21.15.53:0/3260501496 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60b80cca70 0x7f60b81f3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:49.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:49.575+0000 7f60b6ffd640 1 -- 172.21.15.53:0/3260501496 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a8009420 con 0x7f60b80cdf10 2023-06-10T19:05:49.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:49.575+0000 7f60b7fff640 1 --2- 172.21.15.53:0/3260501496 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60b8159770 0x7f60b814b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:05:49.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:49.575+0000 7f60b6ffd640 1 --2- 172.21.15.53:0/3260501496 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60b80cdf10 0x7f60b8162880 secure :-1 s=READY pgs=2018 cs=0 l=1 rev1=1 crypto rx=0x7f60ac0ad040 tx=0x7f60ac01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:49.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:49.575+0000 7f609ffff640 1 -- 172.21.15.53:0/3260501496 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ac0bf610 con 0x7f60b80cdf10 2023-06-10T19:05:49.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:49.575+0000 7f609ffff640 1 -- 172.21.15.53:0/3260501496 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60ac0bf770 con 0x7f60b80cdf10 2023-06-10T19:05:49.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:49.575+0000 7f60be030640 1 -- 172.21.15.53:0/3260501496 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60ac009420 con 0x7f60b80cdf10 2023-06-10T19:05:49.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:49.575+0000 7f609ffff640 1 -- 172.21.15.53:0/3260501496 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ac0bfae0 con 0x7f60b80cdf10 2023-06-10T19:05:49.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:49.575+0000 7f60be030640 1 -- 172.21.15.53:0/3260501496 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60b8156bd0 con 0x7f60b80cdf10 2023-06-10T19:05:49.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:49.575+0000 7f60be030640 1 -- 172.21.15.53:0/3260501496 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60b81570b0 con 0x7f60b80cdf10 2023-06-10T19:05:49.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:49.575+0000 7f609ffff640 1 -- 172.21.15.53:0/3260501496 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f60ac0bfc40 con 0x7f60b80cdf10 2023-06-10T19:05:49.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:49.579+0000 7f609ffff640 1 --2- 172.21.15.53:0/3260501496 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f60a40662b0 0x7f60a4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:49.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:49.579+0000 7f609ffff640 1 -- 172.21.15.53:0/3260501496 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f60ac11e700 con 0x7f60b80cdf10 2023-06-10T19:05:49.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:49.579+0000 7f60b77fe640 1 --2- 172.21.15.53:0/3260501496 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f60a40662b0 0x7f60a4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:49.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:49.579+0000 7f60b77fe640 1 --2- 172.21.15.53:0/3260501496 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f60a40662b0 0x7f60a4068760 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f60a8009be0 tx=0x7f60a8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:49.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:49.583+0000 7f609ffff640 1 -- 172.21.15.53:0/3260501496 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f60ac0ebd60 con 0x7f60b80cdf10 2023-06-10T19:05:49.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:49.735+0000 7f60be030640 1 -- 172.21.15.53:0/3260501496 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f60b804d790 con 0x7f60b80cdf10 2023-06-10T19:05:50.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.411+0000 7f609ffff640 1 -- 172.21.15.53:0/3260501496 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v136) v1 ==== 170+0+0 (secure 0 0 0) 0x7f60ac0ef380 con 0x7f60b80cdf10 2023-06-10T19:05:50.416 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_data' created 2023-06-10T19:05:50.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.419+0000 7f60be030640 1 -- 172.21.15.53:0/3260501496 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f60a40662b0 msgr2=0x7f60a4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:50.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.419+0000 7f60be030640 1 --2- 172.21.15.53:0/3260501496 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f60a40662b0 0x7f60a4068760 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f60a8009be0 tx=0x7f60a8008040 comp rx=0 tx=0).stop 2023-06-10T19:05:50.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.419+0000 7f60be030640 1 -- 172.21.15.53:0/3260501496 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60b80cdf10 msgr2=0x7f60b8162880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:50.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.419+0000 7f60be030640 1 --2- 172.21.15.53:0/3260501496 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60b80cdf10 0x7f60b8162880 secure :-1 s=READY pgs=2018 cs=0 l=1 rev1=1 crypto rx=0x7f60ac0ad040 tx=0x7f60ac01ac90 comp rx=0 tx=0).stop 2023-06-10T19:05:50.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.419+0000 7f60be030640 1 -- 172.21.15.53:0/3260501496 shutdown_connections 2023-06-10T19:05:50.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.419+0000 7f60be030640 1 --2- 172.21.15.53:0/3260501496 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f60a40662b0 0x7f60a4068760 secure :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f60a8009be0 tx=0x7f60a8008040 comp rx=0 tx=0).stop 2023-06-10T19:05:50.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.419+0000 7f60be030640 1 --2- 172.21.15.53:0/3260501496 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60b8159770 0x7f60b814b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:50.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.419+0000 7f60be030640 1 --2- 172.21.15.53:0/3260501496 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60b80cdf10 0x7f60b8162880 unknown :-1 s=CLOSED pgs=2018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:50.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.419+0000 7f60be030640 1 --2- 172.21.15.53:0/3260501496 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60b80cca70 0x7f60b81f3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:50.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.419+0000 7f60be030640 1 -- 172.21.15.53:0/3260501496 >> 172.21.15.53:0/3260501496 conn(0x7f60b80cb920 msgr2=0x7f60b815b970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:50.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.435+0000 7f60be030640 1 -- 172.21.15.53:0/3260501496 shutdown_connections 2023-06-10T19:05:50.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.435+0000 7f60be030640 1 -- 172.21.15.53:0/3260501496 wait complete. 2023-06-10T19:05:50.466 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-06-10T19:05:50.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.583+0000 7f7d1e470640 1 Processor -- start 2023-06-10T19:05:50.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.583+0000 7f7d1e470640 1 -- start start 2023-06-10T19:05:50.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.583+0000 7f7d1e470640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7d18159b20 0x7f7d180cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:50.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.583+0000 7f7d1e470640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7d1806eca0 0x7f7d1806f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:50.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.583+0000 7f7d1e470640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d180ce620 con 0x7f7d180cda10 2023-06-10T19:05:50.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.583+0000 7f7d1e470640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d1806f680 con 0x7f7d1806eca0 2023-06-10T19:05:50.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.583+0000 7f7d1e470640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d180cbb30 con 0x7f7d18159b20 2023-06-10T19:05:50.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.583+0000 7f7d177fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7d1806eca0 0x7f7d1806f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:50.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.583+0000 7f7d1ca0d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f7d180cda10 0x7f7d180cde70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:43870/0 (socket says 172.21.15.53:43870) 2023-06-10T19:05:50.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.583+0000 7f7d177fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7d1806eca0 0x7f7d1806f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57568/0 (socket says 172.21.15.53:57568) 2023-06-10T19:05:50.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.583+0000 7f7d1ca0d640 1 -- 172.21.15.53:0/2275974360 learned_addr learned my addr 172.21.15.53:0/2275974360 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:05:50.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.583+0000 7f7d17fff640 1 --2- 172.21.15.53:0/2275974360 >> v2:172.21.15.117:3300/0 conn(0x7f7d18159b20 0x7f7d180cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:50.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.583+0000 7f7d177fe640 1 -- 172.21.15.53:0/2275974360 >> v2:172.21.15.117:3300/0 conn(0x7f7d18159b20 msgr2=0x7f7d180cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:50.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.583+0000 7f7d177fe640 1 --2- 172.21.15.53:0/2275974360 >> v2:172.21.15.117:3300/0 conn(0x7f7d18159b20 0x7f7d180cf6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:50.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.583+0000 7f7d177fe640 1 -- 172.21.15.53:0/2275974360 >> v1:172.21.15.53:6789/0 conn(0x7f7d180cda10 legacy=0x7f7d180cde70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:50.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.583+0000 7f7d177fe640 1 -- 172.21.15.53:0/2275974360 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d180ce900 con 0x7f7d1806eca0 2023-06-10T19:05:50.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.583+0000 7f7d16ffd640 1 -- 172.21.15.53:0/2275974360 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1042726904 0 0) 0x7f7d180ce620 con 0x7f7d180cda10 2023-06-10T19:05:50.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.583+0000 7f7d17fff640 1 --2- 172.21.15.53:0/2275974360 >> v2:172.21.15.117:3300/0 conn(0x7f7d18159b20 0x7f7d180cf6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:05:50.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.587+0000 7f7d177fe640 1 --2- 172.21.15.53:0/2275974360 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d1806eca0 0x7f7d1806f140 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 crypto rx=0x7f7d180c6ec0 tx=0x7f7d0801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d234d919ce69228 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:50.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.587+0000 7f7d16ffd640 1 -- 172.21.15.53:0/2275974360 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d08004230 con 0x7f7d1806eca0 2023-06-10T19:05:50.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.587+0000 7f7d16ffd640 1 -- 172.21.15.53:0/2275974360 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d080a7050 con 0x7f7d1806eca0 2023-06-10T19:05:50.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.587+0000 7f7d16ffd640 1 -- 172.21.15.53:0/2275974360 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d08003620 con 0x7f7d1806eca0 2023-06-10T19:05:50.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.587+0000 7f7d1e470640 1 -- 172.21.15.53:0/2275974360 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d1806eca0 msgr2=0x7f7d1806f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:50.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.587+0000 7f7d1e470640 1 --2- 172.21.15.53:0/2275974360 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d1806eca0 0x7f7d1806f140 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 crypto rx=0x7f7d180c6ec0 tx=0x7f7d0801c460 comp rx=0 tx=0).stop 2023-06-10T19:05:50.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.587+0000 7f7d1e470640 1 -- 172.21.15.53:0/2275974360 shutdown_connections 2023-06-10T19:05:50.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.587+0000 7f7d1e470640 1 --2- 172.21.15.53:0/2275974360 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d1806eca0 0x7f7d1806f140 unknown :-1 s=CLOSED pgs=2020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:50.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.587+0000 7f7d1e470640 1 --2- 172.21.15.53:0/2275974360 >> v2:172.21.15.117:3300/0 conn(0x7f7d18159b20 0x7f7d180cf6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:50.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.587+0000 7f7d1e470640 1 -- 172.21.15.53:0/2275974360 >> 172.21.15.53:0/2275974360 conn(0x7f7d1806a0e0 msgr2=0x7f7d1806d270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:50.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.587+0000 7f7d1e470640 1 -- 172.21.15.53:0/2275974360 shutdown_connections 2023-06-10T19:05:50.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.587+0000 7f7d1e470640 1 -- 172.21.15.53:0/2275974360 wait complete. 2023-06-10T19:05:50.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.587+0000 7f7d1e470640 1 Processor -- start 2023-06-10T19:05:50.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.587+0000 7f7d1e470640 1 -- start start 2023-06-10T19:05:50.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.587+0000 7f7d1e470640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7d1806eca0 0x7f7d180c5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:50.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.587+0000 7f7d1e470640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d180cda10 0x7f7d1815c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:50.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.587+0000 7f7d1e470640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d18159b20 0x7f7d180c78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:50.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.587+0000 7f7d1e470640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d180c7e10 con 0x7f7d180cda10 2023-06-10T19:05:50.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.587+0000 7f7d1e470640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d180c8090 con 0x7f7d18159b20 2023-06-10T19:05:50.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.587+0000 7f7d1e470640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d180c8370 con 0x7f7d1806eca0 2023-06-10T19:05:50.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.587+0000 7f7d177fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d180cda10 0x7f7d1815c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:50.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.587+0000 7f7d177fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d180cda10 0x7f7d1815c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57572/0 (socket says 172.21.15.53:57572) 2023-06-10T19:05:50.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.587+0000 7f7d177fe640 1 -- 172.21.15.53:0/2708738631 learned_addr learned my addr 172.21.15.53:0/2708738631 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:50.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.587+0000 7f7d17fff640 1 --2- 172.21.15.53:0/2708738631 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7d1806eca0 0x7f7d180c5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:50.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.587+0000 7f7d1ca0d640 1 --2- 172.21.15.53:0/2708738631 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d18159b20 0x7f7d180c78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:50.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.587+0000 7f7d177fe640 1 -- 172.21.15.53:0/2708738631 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7d1806eca0 msgr2=0x7f7d180c5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:50.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.587+0000 7f7d177fe640 1 --2- 172.21.15.53:0/2708738631 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7d1806eca0 0x7f7d180c5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:50.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.587+0000 7f7d177fe640 1 -- 172.21.15.53:0/2708738631 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d18159b20 msgr2=0x7f7d180c78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:50.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.587+0000 7f7d177fe640 1 --2- 172.21.15.53:0/2708738631 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d18159b20 0x7f7d180c78d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:50.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.591+0000 7f7d177fe640 1 -- 172.21.15.53:0/2708738631 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d08009420 con 0x7f7d180cda10 2023-06-10T19:05:50.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.591+0000 7f7d177fe640 1 --2- 172.21.15.53:0/2708738631 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d180cda10 0x7f7d1815c9f0 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 crypto rx=0x7f7d080ae040 tx=0x7f7d08019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:50.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.591+0000 7f7d14ff9640 1 -- 172.21.15.53:0/2708738631 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d08003cf0 con 0x7f7d180cda10 2023-06-10T19:05:50.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.591+0000 7f7d14ff9640 1 -- 172.21.15.53:0/2708738631 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d08003e70 con 0x7f7d180cda10 2023-06-10T19:05:50.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.591+0000 7f7d1e470640 1 -- 172.21.15.53:0/2708738631 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d180c8650 con 0x7f7d180cda10 2023-06-10T19:05:50.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.591+0000 7f7d14ff9640 1 -- 172.21.15.53:0/2708738631 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d080ab660 con 0x7f7d180cda10 2023-06-10T19:05:50.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.591+0000 7f7d1e470640 1 -- 172.21.15.53:0/2708738631 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d1815a9e0 con 0x7f7d180cda10 2023-06-10T19:05:50.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.591+0000 7f7d1e470640 1 -- 172.21.15.53:0/2708738631 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d1815a840 con 0x7f7d180cda10 2023-06-10T19:05:50.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.591+0000 7f7d14ff9640 1 -- 172.21.15.53:0/2708738631 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7d080b2040 con 0x7f7d180cda10 2023-06-10T19:05:50.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.591+0000 7f7d14ff9640 1 --2- 172.21.15.53:0/2708738631 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7d04066280 0x7f7d04068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:50.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.591+0000 7f7d14ff9640 1 -- 172.21.15.53:0/2708738631 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f7d0811e8a0 con 0x7f7d180cda10 2023-06-10T19:05:50.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.591+0000 7f7d17fff640 1 --2- 172.21.15.53:0/2708738631 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7d04066280 0x7f7d04068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:50.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.591+0000 7f7d17fff640 1 --2- 172.21.15.53:0/2708738631 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7d04066280 0x7f7d04068730 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c006fd0 tx=0x7f7d0c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:50.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.595+0000 7f7d14ff9640 1 -- 172.21.15.53:0/2708738631 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7d080ebf80 con 0x7f7d180cda10 2023-06-10T19:05:50.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.783+0000 7f7d1e470640 1 -- 172.21.15.53:0/2708738631 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f7d1815a840 con 0x7f7d180cda10 2023-06-10T19:05:50.801 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.795+0000 7f7d14ff9640 1 -- 172.21.15.53:0/2708738631 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 19 and data pool 20 v73) v1 ==== 174+0+0 (secure 0 0 0) 0x7f7d1815a840 con 0x7f7d180cda10 2023-06-10T19:05:50.804 INFO:teuthology.orchestra.run.smithi053.stderr:new fs with metadata pool 19 and data pool 20 2023-06-10T19:05:50.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.799+0000 7f7d1e470640 1 -- 172.21.15.53:0/2708738631 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7d04066280 msgr2=0x7f7d04068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:50.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.799+0000 7f7d1e470640 1 --2- 172.21.15.53:0/2708738631 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7d04066280 0x7f7d04068730 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c006fd0 tx=0x7f7d0c008040 comp rx=0 tx=0).stop 2023-06-10T19:05:50.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.799+0000 7f7d1e470640 1 -- 172.21.15.53:0/2708738631 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d180cda10 msgr2=0x7f7d1815c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:50.808 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.799+0000 7f7d1e470640 1 --2- 172.21.15.53:0/2708738631 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d180cda10 0x7f7d1815c9f0 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 crypto rx=0x7f7d080ae040 tx=0x7f7d08019200 comp rx=0 tx=0).stop 2023-06-10T19:05:50.808 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.799+0000 7f7d1e470640 1 -- 172.21.15.53:0/2708738631 shutdown_connections 2023-06-10T19:05:50.809 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.799+0000 7f7d1e470640 1 --2- 172.21.15.53:0/2708738631 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7d04066280 0x7f7d04068730 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:50.809 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.799+0000 7f7d1e470640 1 --2- 172.21.15.53:0/2708738631 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d18159b20 0x7f7d180c78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:50.809 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.799+0000 7f7d1e470640 1 --2- 172.21.15.53:0/2708738631 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d180cda10 0x7f7d1815c9f0 unknown :-1 s=CLOSED pgs=2021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:50.809 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.799+0000 7f7d1e470640 1 --2- 172.21.15.53:0/2708738631 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7d1806eca0 0x7f7d180c5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:50.809 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.799+0000 7f7d1e470640 1 -- 172.21.15.53:0/2708738631 >> 172.21.15.53:0/2708738631 conn(0x7f7d1806a0e0 msgr2=0x7f7d180cfd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:50.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.811+0000 7f7d1e470640 1 -- 172.21.15.53:0/2708738631 shutdown_connections 2023-06-10T19:05:50.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.811+0000 7f7d1e470640 1 -- 172.21.15.53:0/2708738631 wait complete. 2023-06-10T19:05:50.839 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:05:50.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.967+0000 7fa13c040640 1 Processor -- start 2023-06-10T19:05:50.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.967+0000 7fa13c040640 1 -- start start 2023-06-10T19:05:50.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.967+0000 7fa13c040640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1340c9840 0x7fa1340c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:50.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.967+0000 7fa13c040640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa13406b090 0x7fa13406b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:50.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.967+0000 7fa13c040640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa134159b50 con 0x7fa134071060 2023-06-10T19:05:50.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.967+0000 7fa13c040640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1340ca150 con 0x7fa13406b090 2023-06-10T19:05:50.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.967+0000 7fa13c040640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1340702a0 con 0x7fa1340c9840 2023-06-10T19:05:50.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.967+0000 7fa1395db640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fa134071060 0x7fa1340af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:43874/0 (socket says 172.21.15.53:43874) 2023-06-10T19:05:50.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.967+0000 7fa1395db640 1 -- 172.21.15.53:0/124453106 learned_addr learned my addr 172.21.15.53:0/124453106 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:05:50.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.967+0000 7fa139ddc640 1 --2- 172.21.15.53:0/124453106 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1340c9840 0x7fa1340c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:50.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.967+0000 7fa13a5dd640 1 --2- 172.21.15.53:0/124453106 >> v2:172.21.15.117:3300/0 conn(0x7fa13406b090 0x7fa13406b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:50.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.967+0000 7fa138dda640 1 -- 172.21.15.53:0/124453106 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 494868406 0 0) 0x7fa134159b50 con 0x7fa134071060 2023-06-10T19:05:50.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.967+0000 7fa138dda640 1 -- 172.21.15.53:0/124453106 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa120003530 con 0x7fa134071060 2023-06-10T19:05:50.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.967+0000 7fa138dda640 1 -- 172.21.15.53:0/124453106 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3388022447 0 0) 0x7fa120003530 con 0x7fa134071060 2023-06-10T19:05:50.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.967+0000 7fa138dda640 1 -- 172.21.15.53:0/124453106 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1340c9840 msgr2=0x7fa1340c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:50.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.967+0000 7fa138dda640 1 --2- 172.21.15.53:0/124453106 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1340c9840 0x7fa1340c9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:50.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.967+0000 7fa138dda640 1 -- 172.21.15.53:0/124453106 >> v2:172.21.15.117:3300/0 conn(0x7fa13406b090 msgr2=0x7fa13406b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:50.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.967+0000 7fa138dda640 1 --2- 172.21.15.53:0/124453106 >> v2:172.21.15.117:3300/0 conn(0x7fa13406b090 0x7fa13406b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:50.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.967+0000 7fa138dda640 1 -- 172.21.15.53:0/124453106 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa134070580 con 0x7fa134071060 2023-06-10T19:05:50.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.967+0000 7fa138dda640 1 -- 172.21.15.53:0/124453106 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fa124001680 con 0x7fa134071060 2023-06-10T19:05:50.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.967+0000 7fa138dda640 1 -- 172.21.15.53:0/124453106 >> v1:172.21.15.53:6789/0 conn(0x7fa134071060 legacy=0x7fa1340af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:50.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.967+0000 7fa138dda640 1 --2- 172.21.15.53:0/124453106 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1200039f0 0x7fa120003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:50.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.967+0000 7fa138dda640 1 --2- 172.21.15.53:0/124453106 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1340c9840 0x7fa1200047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:50.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.967+0000 7fa138dda640 1 --2- 172.21.15.53:0/124453106 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa120004d10 0x7fa120005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:50.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.967+0000 7fa138dda640 1 -- 172.21.15.53:0/124453106 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1340ca150 con 0x7fa120004d10 2023-06-10T19:05:50.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.967+0000 7fa138dda640 1 -- 172.21.15.53:0/124453106 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1340702a0 con 0x7fa1200039f0 2023-06-10T19:05:50.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.967+0000 7fa138dda640 1 -- 172.21.15.53:0/124453106 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa12000b990 con 0x7fa1340c9840 2023-06-10T19:05:50.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.967+0000 7fa13a5dd640 1 --2- 172.21.15.53:0/124453106 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa120004d10 0x7fa120005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:50.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.967+0000 7fa139ddc640 1 --2- 172.21.15.53:0/124453106 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1200039f0 0x7fa120003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:50.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.967+0000 7fa1395db640 1 --2- 172.21.15.53:0/124453106 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1340c9840 0x7fa1200047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:50.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.967+0000 7fa13a5dd640 1 -- 172.21.15.53:0/124453106 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1340c9840 msgr2=0x7fa1200047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:50.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.967+0000 7fa13a5dd640 1 --2- 172.21.15.53:0/124453106 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1340c9840 0x7fa1200047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:50.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.967+0000 7fa13a5dd640 1 -- 172.21.15.53:0/124453106 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1200039f0 msgr2=0x7fa120003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:50.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.967+0000 7fa13a5dd640 1 --2- 172.21.15.53:0/124453106 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1200039f0 0x7fa120003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:50.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.967+0000 7fa13a5dd640 1 -- 172.21.15.53:0/124453106 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa120003530 con 0x7fa120004d10 2023-06-10T19:05:50.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.971+0000 7fa13a5dd640 1 --2- 172.21.15.53:0/124453106 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa120004d10 0x7fa120005180 secure :-1 s=READY pgs=2023 cs=0 l=1 rev1=1 crypto rx=0x7fa12c009b10 tx=0x7fa12c01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59101d8afdc80d22 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:50.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.971+0000 7fa138dda640 1 -- 172.21.15.53:0/124453106 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa12c0a5680 con 0x7fa120004d10 2023-06-10T19:05:50.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.971+0000 7fa138dda640 1 -- 172.21.15.53:0/124453106 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa12c0a57e0 con 0x7fa120004d10 2023-06-10T19:05:50.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.971+0000 7fa138dda640 1 -- 172.21.15.53:0/124453106 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa12c0a5b90 con 0x7fa120004d10 2023-06-10T19:05:50.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.971+0000 7fa13c040640 1 -- 172.21.15.53:0/124453106 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa120004d10 msgr2=0x7fa120005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:50.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.971+0000 7fa13c040640 1 --2- 172.21.15.53:0/124453106 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa120004d10 0x7fa120005180 secure :-1 s=READY pgs=2023 cs=0 l=1 rev1=1 crypto rx=0x7fa12c009b10 tx=0x7fa12c01ca30 comp rx=0 tx=0).stop 2023-06-10T19:05:50.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.971+0000 7fa13a5dd640 1 -- 172.21.15.53:0/124453106 reap_dead start 2023-06-10T19:05:50.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.971+0000 7fa13c040640 1 -- 172.21.15.53:0/124453106 shutdown_connections 2023-06-10T19:05:50.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.971+0000 7fa13c040640 1 -- 172.21.15.53:0/124453106 >> 172.21.15.53:0/124453106 conn(0x7fa13406a0d0 msgr2=0x7fa1340ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:50.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.971+0000 7fa13c040640 1 -- 172.21.15.53:0/124453106 shutdown_connections 2023-06-10T19:05:50.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.971+0000 7fa13c040640 1 -- 172.21.15.53:0/124453106 wait complete. 2023-06-10T19:05:50.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.971+0000 7fa13c040640 1 Processor -- start 2023-06-10T19:05:50.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.971+0000 7fa13c040640 1 -- start start 2023-06-10T19:05:50.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.971+0000 7fa13c040640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1341f27f0 0x7fa1340c2780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:50.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.971+0000 7fa13c040640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1341f2bc0 0x7fa1340af4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:50.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.971+0000 7fa13c040640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1340afa10 0x7fa1340c6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:50.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.971+0000 7fa13c040640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1340c6710 con 0x7fa1341f27f0 2023-06-10T19:05:50.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.971+0000 7fa13c040640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1341f3010 con 0x7fa1341f2bc0 2023-06-10T19:05:50.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.971+0000 7fa13c040640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1340afe80 con 0x7fa1340afa10 2023-06-10T19:05:50.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.971+0000 7fa139ddc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1341f27f0 0x7fa1340c2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:50.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.971+0000 7fa139ddc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1341f27f0 0x7fa1340c2780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57582/0 (socket says 172.21.15.53:57582) 2023-06-10T19:05:50.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.971+0000 7fa139ddc640 1 -- 172.21.15.53:0/3701554635 learned_addr learned my addr 172.21.15.53:0/3701554635 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:50.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.975+0000 7fa139ddc640 1 -- 172.21.15.53:0/3701554635 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1340afa10 msgr2=0x7fa1340c6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:50.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.975+0000 7fa139ddc640 1 --2- 172.21.15.53:0/3701554635 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1340afa10 0x7fa1340c6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:50.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.975+0000 7fa1395db640 1 --2- 172.21.15.53:0/3701554635 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1341f2bc0 0x7fa1340af4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:50.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.975+0000 7fa139ddc640 1 -- 172.21.15.53:0/3701554635 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1341f2bc0 msgr2=0x7fa1340af4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:50.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.975+0000 7fa139ddc640 1 --2- 172.21.15.53:0/3701554635 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1341f2bc0 0x7fa1340af4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:50.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.975+0000 7fa139ddc640 1 -- 172.21.15.53:0/3701554635 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1340c5db0 con 0x7fa1341f27f0 2023-06-10T19:05:50.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.975+0000 7fa139ddc640 1 --2- 172.21.15.53:0/3701554635 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1341f27f0 0x7fa1340c2780 secure :-1 s=READY pgs=2024 cs=0 l=1 rev1=1 crypto rx=0x7fa130007f60 tx=0x7fa130007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:50.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.975+0000 7fa12a7fc640 1 -- 172.21.15.53:0/3701554635 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa13000e030 con 0x7fa1341f27f0 2023-06-10T19:05:50.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.975+0000 7fa12a7fc640 1 -- 172.21.15.53:0/3701554635 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa130016470 con 0x7fa1341f27f0 2023-06-10T19:05:50.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.975+0000 7fa13c040640 1 -- 172.21.15.53:0/3701554635 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1340b36c0 con 0x7fa1341f27f0 2023-06-10T19:05:50.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.975+0000 7fa12a7fc640 1 -- 172.21.15.53:0/3701554635 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa130016820 con 0x7fa1341f27f0 2023-06-10T19:05:50.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.975+0000 7fa13c040640 1 -- 172.21.15.53:0/3701554635 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1340c6330 con 0x7fa1341f27f0 2023-06-10T19:05:50.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.975+0000 7fa13c040640 1 -- 172.21.15.53:0/3701554635 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa13404d790 con 0x7fa1341f27f0 2023-06-10T19:05:50.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.975+0000 7fa12a7fc640 1 -- 172.21.15.53:0/3701554635 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa130016980 con 0x7fa1341f27f0 2023-06-10T19:05:50.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.975+0000 7fa12a7fc640 1 --2- 172.21.15.53:0/3701554635 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa1180662b0 0x7fa118068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:50.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.975+0000 7fa12a7fc640 1 -- 172.21.15.53:0/3701554635 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa13000f070 con 0x7fa1341f27f0 2023-06-10T19:05:50.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.975+0000 7fa1395db640 1 --2- 172.21.15.53:0/3701554635 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa1180662b0 0x7fa118068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:50.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.979+0000 7fa1395db640 1 --2- 172.21.15.53:0/3701554635 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa1180662b0 0x7fa118068760 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fa124001060 tx=0x7fa124001820 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:50.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:50.979+0000 7fa12a7fc640 1 -- 172.21.15.53:0/3701554635 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa1300520a0 con 0x7fa1341f27f0 2023-06-10T19:05:51.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.135+0000 7fa13c040640 1 -- 172.21.15.53:0/3701554635 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa1340cb140 con 0x7fa1341f27f0 2023-06-10T19:05:51.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.139+0000 7fa12a7fc640 1 -- 172.21.15.53:0/3701554635 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v137) v1 ==== 74+0+18310 (secure 0 0 0) 0x7fa1300556c0 con 0x7fa1341f27f0 2023-06-10T19:05:51.145 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:05:51.145 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":137,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:05:50.789002+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-06-10T19:05:48.449837+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-06-10T19:05:49.783728+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:05:51.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.139+0000 7fa13c040640 1 -- 172.21.15.53:0/3701554635 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa1180662b0 msgr2=0x7fa118068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:51.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.139+0000 7fa13c040640 1 --2- 172.21.15.53:0/3701554635 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa1180662b0 0x7fa118068760 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fa124001060 tx=0x7fa124001820 comp rx=0 tx=0).stop 2023-06-10T19:05:51.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.139+0000 7fa13c040640 1 -- 172.21.15.53:0/3701554635 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1341f27f0 msgr2=0x7fa1340c2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:51.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.139+0000 7fa13c040640 1 --2- 172.21.15.53:0/3701554635 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1341f27f0 0x7fa1340c2780 secure :-1 s=READY pgs=2024 cs=0 l=1 rev1=1 crypto rx=0x7fa130007f60 tx=0x7fa130007f90 comp rx=0 tx=0).stop 2023-06-10T19:05:51.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.139+0000 7fa13c040640 1 -- 172.21.15.53:0/3701554635 shutdown_connections 2023-06-10T19:05:51.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.139+0000 7fa13c040640 1 --2- 172.21.15.53:0/3701554635 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa1180662b0 0x7fa118068760 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:51.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.139+0000 7fa13c040640 1 --2- 172.21.15.53:0/3701554635 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1340afa10 0x7fa1340c6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:51.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.139+0000 7fa13c040640 1 --2- 172.21.15.53:0/3701554635 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1341f2bc0 0x7fa1340af4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:51.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.139+0000 7fa13c040640 1 --2- 172.21.15.53:0/3701554635 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1341f27f0 0x7fa1340c2780 unknown :-1 s=CLOSED pgs=2024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:51.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.139+0000 7fa13c040640 1 -- 172.21.15.53:0/3701554635 >> 172.21.15.53:0/3701554635 conn(0x7fa13406a0d0 msgr2=0x7fa134158060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:51.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.139+0000 7fa13c040640 1 -- 172.21.15.53:0/3701554635 shutdown_connections 2023-06-10T19:05:51.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.139+0000 7fa13c040640 1 -- 172.21.15.53:0/3701554635 wait complete. 2023-06-10T19:05:51.164 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:05:51.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.295+0000 7fb3c93a9640 1 Processor -- start 2023-06-10T19:05:51.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.295+0000 7fb3c93a9640 1 -- start start 2023-06-10T19:05:51.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.295+0000 7fb3c93a9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3c40b3ac0 0x7fb3c40b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:51.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.295+0000 7fb3c93a9640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb3c40d14c0 0x7fb3c415fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:51.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.295+0000 7fb3c93a9640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3c40d0020 con 0x7fb3c40cc690 2023-06-10T19:05:51.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.295+0000 7fb3c93a9640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3c40b43d0 con 0x7fb3c40d14c0 2023-06-10T19:05:51.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.295+0000 7fb3c93a9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c40cef40 con 0x7fb3c40b3ac0 2023-06-10T19:05:51.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.295+0000 7fb3c37fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb3c40d14c0 0x7fb3c415fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:51.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.295+0000 7fb3c37fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb3c40d14c0 0x7fb3c415fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47100/0 (socket says 172.21.15.53:47100) 2023-06-10T19:05:51.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.295+0000 7fb3c37fe640 1 -- 172.21.15.53:0/266708017 learned_addr learned my addr 172.21.15.53:0/266708017 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:51.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.295+0000 7fb3c2ffd640 1 --2- 172.21.15.53:0/266708017 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3c40b3ac0 0x7fb3c40b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:51.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.295+0000 7fb3c37fe640 1 -- 172.21.15.53:0/266708017 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3c40b3ac0 msgr2=0x7fb3c40b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:51.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.295+0000 7fb3c37fe640 1 --2- 172.21.15.53:0/266708017 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3c40b3ac0 0x7fb3c40b3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:51.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.295+0000 7fb3c37fe640 1 -- 172.21.15.53:0/266708017 >> v1:172.21.15.117:6789/0 conn(0x7fb3c40cc690 legacy=0x7fb3c415f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:51.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.295+0000 7fb3c37fe640 1 -- 172.21.15.53:0/266708017 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3c40cf220 con 0x7fb3c40d14c0 2023-06-10T19:05:51.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.295+0000 7fb3c2ffd640 1 --2- 172.21.15.53:0/266708017 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3c40b3ac0 0x7fb3c40b3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:05:51.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.299+0000 7fb3c37fe640 1 --2- 172.21.15.53:0/266708017 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3c40d14c0 0x7fb3c415fa80 secure :-1 s=READY pgs=2025 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc009e50 tx=0x7fb3bc01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d1c9b504dc0df59 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:51.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.299+0000 7fb3c27fc640 1 -- 172.21.15.53:0/266708017 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3bc0a5840 con 0x7fb3c40d14c0 2023-06-10T19:05:51.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.299+0000 7fb3c27fc640 1 -- 172.21.15.53:0/266708017 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3bc0a59a0 con 0x7fb3c40d14c0 2023-06-10T19:05:51.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.299+0000 7fb3c27fc640 1 -- 172.21.15.53:0/266708017 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3bc0a5d30 con 0x7fb3c40d14c0 2023-06-10T19:05:51.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.299+0000 7fb3c93a9640 1 -- 172.21.15.53:0/266708017 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3c40d14c0 msgr2=0x7fb3c415fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:51.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.299+0000 7fb3c93a9640 1 --2- 172.21.15.53:0/266708017 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3c40d14c0 0x7fb3c415fa80 secure :-1 s=READY pgs=2025 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc009e50 tx=0x7fb3bc01c9a0 comp rx=0 tx=0).stop 2023-06-10T19:05:51.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.299+0000 7fb3c93a9640 1 -- 172.21.15.53:0/266708017 shutdown_connections 2023-06-10T19:05:51.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.299+0000 7fb3c93a9640 1 --2- 172.21.15.53:0/266708017 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3c40d14c0 0x7fb3c415fa80 unknown :-1 s=CLOSED pgs=2025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:51.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.299+0000 7fb3c93a9640 1 --2- 172.21.15.53:0/266708017 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3c40b3ac0 0x7fb3c40b3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:51.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.299+0000 7fb3c93a9640 1 -- 172.21.15.53:0/266708017 >> 172.21.15.53:0/266708017 conn(0x7fb3c4071790 msgr2=0x7fb3c4069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:51.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.299+0000 7fb3c93a9640 1 -- 172.21.15.53:0/266708017 shutdown_connections 2023-06-10T19:05:51.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.299+0000 7fb3c93a9640 1 -- 172.21.15.53:0/266708017 wait complete. 2023-06-10T19:05:51.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.299+0000 7fb3c93a9640 1 Processor -- start 2023-06-10T19:05:51.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.299+0000 7fb3c93a9640 1 -- start start 2023-06-10T19:05:51.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.299+0000 7fb3c93a9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3c40b3ac0 0x7fb3c4154b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:51.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.299+0000 7fb3c93a9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3c40cc690 0x7fb3c40cb120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:51.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.299+0000 7fb3c93a9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3c40d14c0 0x7fb3c4155910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:51.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.299+0000 7fb3c93a9640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c40c95d0 con 0x7fb3c40b3ac0 2023-06-10T19:05:51.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.299+0000 7fb3c93a9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c40c98b0 con 0x7fb3c40d14c0 2023-06-10T19:05:51.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.299+0000 7fb3c93a9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c40c9b90 con 0x7fb3c40cc690 2023-06-10T19:05:51.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.299+0000 7fb3c2ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3c40b3ac0 0x7fb3c4154b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:51.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.299+0000 7fb3c2ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3c40b3ac0 0x7fb3c4154b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47106/0 (socket says 172.21.15.53:47106) 2023-06-10T19:05:51.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.299+0000 7fb3c2ffd640 1 -- 172.21.15.53:0/776697761 learned_addr learned my addr 172.21.15.53:0/776697761 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:51.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.303+0000 7fb3c37fe640 1 --2- 172.21.15.53:0/776697761 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3c40d14c0 0x7fb3c4155910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:51.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.303+0000 7fb3ba7fc640 1 --2- 172.21.15.53:0/776697761 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3c40cc690 0x7fb3c40cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:51.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.303+0000 7fb3c2ffd640 1 -- 172.21.15.53:0/776697761 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3c40cc690 msgr2=0x7fb3c40cb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:51.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.303+0000 7fb3c2ffd640 1 --2- 172.21.15.53:0/776697761 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3c40cc690 0x7fb3c40cb120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:51.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.303+0000 7fb3c2ffd640 1 -- 172.21.15.53:0/776697761 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3c40d14c0 msgr2=0x7fb3c4155910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:51.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.303+0000 7fb3c2ffd640 1 --2- 172.21.15.53:0/776697761 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3c40d14c0 0x7fb3c4155910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:51.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.303+0000 7fb3c2ffd640 1 -- 172.21.15.53:0/776697761 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3bc009b30 con 0x7fb3c40b3ac0 2023-06-10T19:05:51.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.303+0000 7fb3c37fe640 1 --2- 172.21.15.53:0/776697761 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3c40d14c0 0x7fb3c4155910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:05:51.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.303+0000 7fb3c2ffd640 1 --2- 172.21.15.53:0/776697761 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3c40b3ac0 0x7fb3c4154b40 secure :-1 s=READY pgs=2026 cs=0 l=1 rev1=1 crypto rx=0x7fb3b400c7f0 tx=0x7fb3b400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:51.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.303+0000 7fb3bbfff640 1 -- 172.21.15.53:0/776697761 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b4007820 con 0x7fb3c40b3ac0 2023-06-10T19:05:51.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.303+0000 7fb3bbfff640 1 -- 172.21.15.53:0/776697761 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3b4007980 con 0x7fb3c40b3ac0 2023-06-10T19:05:51.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.303+0000 7fb3c93a9640 1 -- 172.21.15.53:0/776697761 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3c40c9e70 con 0x7fb3c40b3ac0 2023-06-10T19:05:51.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.303+0000 7fb3bbfff640 1 -- 172.21.15.53:0/776697761 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b4007d30 con 0x7fb3c40b3ac0 2023-06-10T19:05:51.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.303+0000 7fb3c93a9640 1 -- 172.21.15.53:0/776697761 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3c40c9110 con 0x7fb3c40b3ac0 2023-06-10T19:05:51.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.303+0000 7fb3c93a9640 1 -- 172.21.15.53:0/776697761 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3c40c9330 con 0x7fb3c40b3ac0 2023-06-10T19:05:51.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.303+0000 7fb3bbfff640 1 -- 172.21.15.53:0/776697761 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb3b40113f0 con 0x7fb3c40b3ac0 2023-06-10T19:05:51.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.303+0000 7fb3bbfff640 1 --2- 172.21.15.53:0/776697761 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb3a4066280 0x7fb3a4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:51.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.303+0000 7fb3bbfff640 1 -- 172.21.15.53:0/776697761 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb3b4084010 con 0x7fb3c40b3ac0 2023-06-10T19:05:51.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.303+0000 7fb3ba7fc640 1 --2- 172.21.15.53:0/776697761 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb3a4066280 0x7fb3a4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:51.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.303+0000 7fb3ba7fc640 1 --2- 172.21.15.53:0/776697761 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb3a4066280 0x7fb3a4068730 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fb3c415ee70 tx=0x7fb3ac009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:51.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.307+0000 7fb3bbfff640 1 -- 172.21.15.53:0/776697761 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb3b4051520 con 0x7fb3c40b3ac0 2023-06-10T19:05:51.378 INFO:tasks.ceph.mds.a.smithi053.stderr:2023-06-10T19:05:51.371+0000 7fae04bef640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-06-10T19:05:51.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.463+0000 7fb3c93a9640 1 -- 172.21.15.53:0/776697761 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb3c404d790 con 0x7fb3c40b3ac0 2023-06-10T19:05:51.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.467+0000 7fb3bbfff640 1 -- 172.21.15.53:0/776697761 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v137) v1 ==== 74+0+18310 (secure 0 0 0) 0x7fb3b4054b40 con 0x7fb3c40b3ac0 2023-06-10T19:05:51.474 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:05:51.475 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":137,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:05:50.789002+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-06-10T19:05:48.449837+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-06-10T19:05:49.783728+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:05:51.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.467+0000 7fb3c93a9640 1 -- 172.21.15.53:0/776697761 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb3a4066280 msgr2=0x7fb3a4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:51.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.467+0000 7fb3c93a9640 1 --2- 172.21.15.53:0/776697761 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb3a4066280 0x7fb3a4068730 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fb3c415ee70 tx=0x7fb3ac009040 comp rx=0 tx=0).stop 2023-06-10T19:05:51.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.467+0000 7fb3c93a9640 1 -- 172.21.15.53:0/776697761 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3c40b3ac0 msgr2=0x7fb3c4154b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:51.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.467+0000 7fb3c93a9640 1 --2- 172.21.15.53:0/776697761 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3c40b3ac0 0x7fb3c4154b40 secure :-1 s=READY pgs=2026 cs=0 l=1 rev1=1 crypto rx=0x7fb3b400c7f0 tx=0x7fb3b400ccb0 comp rx=0 tx=0).stop 2023-06-10T19:05:51.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.467+0000 7fb3c93a9640 1 -- 172.21.15.53:0/776697761 shutdown_connections 2023-06-10T19:05:51.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.467+0000 7fb3c93a9640 1 --2- 172.21.15.53:0/776697761 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb3a4066280 0x7fb3a4068730 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:51.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.467+0000 7fb3c93a9640 1 --2- 172.21.15.53:0/776697761 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3c40d14c0 0x7fb3c4155910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:51.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.467+0000 7fb3c93a9640 1 --2- 172.21.15.53:0/776697761 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3c40cc690 0x7fb3c40cb120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:51.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.467+0000 7fb3c93a9640 1 --2- 172.21.15.53:0/776697761 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3c40b3ac0 0x7fb3c4154b40 unknown :-1 s=CLOSED pgs=2026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:51.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.467+0000 7fb3c93a9640 1 -- 172.21.15.53:0/776697761 >> 172.21.15.53:0/776697761 conn(0x7fb3c4071790 msgr2=0x7fb3c40d1fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:51.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.467+0000 7fb3c93a9640 1 -- 172.21.15.53:0/776697761 shutdown_connections 2023-06-10T19:05:51.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.467+0000 7fb3c93a9640 1 -- 172.21.15.53:0/776697761 wait complete. 2023-06-10T19:05:51.493 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-06-10T19:05:51.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.615+0000 7f563bf63640 1 Processor -- start 2023-06-10T19:05:51.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.615+0000 7f563bf63640 1 -- start start 2023-06-10T19:05:51.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.615+0000 7f563bf63640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f56340c97d0 0x7f56340cb820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:51.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.615+0000 7f563bf63640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f56340af760 0x7f56340afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:51.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.615+0000 7f563bf63640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56340ac910 con 0x7f563406c350 2023-06-10T19:05:51.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.615+0000 7f563bf63640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56340ca5c0 con 0x7f56340c97d0 2023-06-10T19:05:51.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.615+0000 7f563bf63640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56340b0120 con 0x7f56340af760 2023-06-10T19:05:51.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.615+0000 7f5639cff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f56340c97d0 0x7f56340cb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:51.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.615+0000 7f5639cff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f56340c97d0 0x7f56340cb820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47120/0 (socket says 172.21.15.53:47120) 2023-06-10T19:05:51.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.615+0000 7f5639cff640 1 -- 172.21.15.53:0/1762570639 learned_addr learned my addr 172.21.15.53:0/1762570639 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:51.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.615+0000 7f563a500640 1 --2- 172.21.15.53:0/1762570639 >> v2:172.21.15.117:3300/0 conn(0x7f56340af760 0x7f56340afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:51.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.615+0000 7f5639cff640 1 -- 172.21.15.53:0/1762570639 >> v2:172.21.15.117:3300/0 conn(0x7f56340af760 msgr2=0x7f56340afbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:51.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.615+0000 7f5639cff640 1 --2- 172.21.15.53:0/1762570639 >> v2:172.21.15.117:3300/0 conn(0x7f56340af760 0x7f56340afbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:51.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.615+0000 7f5639cff640 1 -- 172.21.15.53:0/1762570639 >> v1:172.21.15.117:6789/0 conn(0x7f563406c350 legacy=0x7f56340ac200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:51.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.615+0000 7f5639cff640 1 -- 172.21.15.53:0/1762570639 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56340cbd60 con 0x7f56340c97d0 2023-06-10T19:05:51.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.619+0000 7f5639cff640 1 --2- 172.21.15.53:0/1762570639 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56340c97d0 0x7f56340cb820 secure :-1 s=READY pgs=2027 cs=0 l=1 rev1=1 crypto rx=0x7f5634070f70 tx=0x7f563001c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=646a99c5938232d6 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:51.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.619+0000 7f5638cfd640 1 -- 172.21.15.53:0/1762570639 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56300ab600 con 0x7f56340c97d0 2023-06-10T19:05:51.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.619+0000 7f5638cfd640 1 -- 172.21.15.53:0/1762570639 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56300a7050 con 0x7f56340c97d0 2023-06-10T19:05:51.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.619+0000 7f5638cfd640 1 -- 172.21.15.53:0/1762570639 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56300ab980 con 0x7f56340c97d0 2023-06-10T19:05:51.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.619+0000 7f563bf63640 1 -- 172.21.15.53:0/1762570639 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56340c97d0 msgr2=0x7f56340cb820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:51.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.619+0000 7f563bf63640 1 --2- 172.21.15.53:0/1762570639 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56340c97d0 0x7f56340cb820 secure :-1 s=READY pgs=2027 cs=0 l=1 rev1=1 crypto rx=0x7f5634070f70 tx=0x7f563001c3a0 comp rx=0 tx=0).stop 2023-06-10T19:05:51.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.619+0000 7f563bf63640 1 -- 172.21.15.53:0/1762570639 shutdown_connections 2023-06-10T19:05:51.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.619+0000 7f563bf63640 1 --2- 172.21.15.53:0/1762570639 >> v2:172.21.15.117:3300/0 conn(0x7f56340af760 0x7f56340afbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:51.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.619+0000 7f563bf63640 1 --2- 172.21.15.53:0/1762570639 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56340c97d0 0x7f56340cb820 unknown :-1 s=CLOSED pgs=2027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:51.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.619+0000 7f563bf63640 1 -- 172.21.15.53:0/1762570639 >> 172.21.15.53:0/1762570639 conn(0x7f563406a0e0 msgr2=0x7f56340cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:51.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.619+0000 7f563bf63640 1 -- 172.21.15.53:0/1762570639 shutdown_connections 2023-06-10T19:05:51.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.619+0000 7f563bf63640 1 -- 172.21.15.53:0/1762570639 wait complete. 2023-06-10T19:05:51.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.619+0000 7f563bf63640 1 Processor -- start 2023-06-10T19:05:51.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.619+0000 7f563bf63640 1 -- start start 2023-06-10T19:05:51.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.623+0000 7f563bf63640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f563406c350 0x7f563414f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:51.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.623+0000 7f563bf63640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56340af760 0x7f563415c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:51.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.623+0000 7f563bf63640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56340c97d0 0x7f563415a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:51.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.623+0000 7f563bf63640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f563415a2d0 con 0x7f56340af760 2023-06-10T19:05:51.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.623+0000 7f563bf63640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56341596c0 con 0x7f563406c350 2023-06-10T19:05:51.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.623+0000 7f563bf63640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56341599a0 con 0x7f56340c97d0 2023-06-10T19:05:51.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.623+0000 7f56394fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56340af760 0x7f563415c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:51.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.623+0000 7f56394fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56340af760 0x7f563415c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47122/0 (socket says 172.21.15.53:47122) 2023-06-10T19:05:51.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.623+0000 7f56394fe640 1 -- 172.21.15.53:0/2232241962 learned_addr learned my addr 172.21.15.53:0/2232241962 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:51.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.623+0000 7f563a500640 1 --2- 172.21.15.53:0/2232241962 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56340c97d0 0x7f563415a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:51.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.623+0000 7f5639cff640 1 --2- 172.21.15.53:0/2232241962 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f563406c350 0x7f563414f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:51.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.623+0000 7f56394fe640 1 -- 172.21.15.53:0/2232241962 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56340c97d0 msgr2=0x7f563415a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:51.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.623+0000 7f56394fe640 1 --2- 172.21.15.53:0/2232241962 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56340c97d0 0x7f563415a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:51.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.623+0000 7f56394fe640 1 -- 172.21.15.53:0/2232241962 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f563406c350 msgr2=0x7f563414f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:51.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.623+0000 7f56394fe640 1 --2- 172.21.15.53:0/2232241962 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f563406c350 0x7f563414f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:51.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.623+0000 7f56394fe640 1 -- 172.21.15.53:0/2232241962 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56300094d0 con 0x7f56340af760 2023-06-10T19:05:51.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.623+0000 7f56394fe640 1 --2- 172.21.15.53:0/2232241962 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56340af760 0x7f563415c040 secure :-1 s=READY pgs=2028 cs=0 l=1 rev1=1 crypto rx=0x7f562400c450 tx=0x7f562400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:51.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.623+0000 7f562a7fc640 1 -- 172.21.15.53:0/2232241962 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5624012830 con 0x7f56340af760 2023-06-10T19:05:51.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.623+0000 7f562a7fc640 1 -- 172.21.15.53:0/2232241962 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56240129b0 con 0x7f56340af760 2023-06-10T19:05:51.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.623+0000 7f563bf63640 1 -- 172.21.15.53:0/2232241962 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5634159c80 con 0x7f56340af760 2023-06-10T19:05:51.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.623+0000 7f562a7fc640 1 -- 172.21.15.53:0/2232241962 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5624012d60 con 0x7f56340af760 2023-06-10T19:05:51.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.623+0000 7f563bf63640 1 -- 172.21.15.53:0/2232241962 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5634159230 con 0x7f56340af760 2023-06-10T19:05:51.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.623+0000 7f563bf63640 1 -- 172.21.15.53:0/2232241962 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f563415a480 con 0x7f56340af760 2023-06-10T19:05:51.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.623+0000 7f562a7fc640 1 -- 172.21.15.53:0/2232241962 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f562401c460 con 0x7f56340af760 2023-06-10T19:05:51.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.623+0000 7f562a7fc640 1 --2- 172.21.15.53:0/2232241962 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f56180662b0 0x7f5618068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:51.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.623+0000 7f562a7fc640 1 -- 172.21.15.53:0/2232241962 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5624083af0 con 0x7f56340af760 2023-06-10T19:05:51.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.623+0000 7f5639cff640 1 --2- 172.21.15.53:0/2232241962 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f56180662b0 0x7f5618068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:51.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.627+0000 7f5639cff640 1 --2- 172.21.15.53:0/2232241962 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f56180662b0 0x7f5618068760 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f56300ad000 tx=0x7f5630008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:51.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.627+0000 7f562a7fc640 1 -- 172.21.15.53:0/2232241962 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f563415a480 con 0x7f56340af760 2023-06-10T19:05:51.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:51.815+0000 7f563bf63640 1 -- 172.21.15.53:0/2232241962 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f563404d790 con 0x7f56340af760 2023-06-10T19:05:52.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.807+0000 7f562a7fc640 1 -- 172.21.15.53:0/2232241962 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v75) v1 ==== 118+0+0 (secure 0 0 0) 0x7f5624051000 con 0x7f56340af760 2023-06-10T19:05:52.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.811+0000 7f563bf63640 1 -- 172.21.15.53:0/2232241962 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f56180662b0 msgr2=0x7f5618068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:52.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.811+0000 7f563bf63640 1 --2- 172.21.15.53:0/2232241962 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f56180662b0 0x7f5618068760 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f56300ad000 tx=0x7f5630008040 comp rx=0 tx=0).stop 2023-06-10T19:05:52.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.811+0000 7f563bf63640 1 -- 172.21.15.53:0/2232241962 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56340af760 msgr2=0x7f563415c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:52.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.811+0000 7f563bf63640 1 --2- 172.21.15.53:0/2232241962 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56340af760 0x7f563415c040 secure :-1 s=READY pgs=2028 cs=0 l=1 rev1=1 crypto rx=0x7f562400c450 tx=0x7f562400c910 comp rx=0 tx=0).stop 2023-06-10T19:05:52.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.811+0000 7f563bf63640 1 -- 172.21.15.53:0/2232241962 shutdown_connections 2023-06-10T19:05:52.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.811+0000 7f563bf63640 1 --2- 172.21.15.53:0/2232241962 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f56180662b0 0x7f5618068760 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:52.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.811+0000 7f563bf63640 1 --2- 172.21.15.53:0/2232241962 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56340c97d0 0x7f563415a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:52.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.811+0000 7f563bf63640 1 --2- 172.21.15.53:0/2232241962 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56340af760 0x7f563415c040 unknown :-1 s=CLOSED pgs=2028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:52.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.811+0000 7f563bf63640 1 --2- 172.21.15.53:0/2232241962 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f563406c350 0x7f563414f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:52.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.811+0000 7f563bf63640 1 -- 172.21.15.53:0/2232241962 >> 172.21.15.53:0/2232241962 conn(0x7f563406a0e0 msgr2=0x7f56340cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:52.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.811+0000 7f563bf63640 1 -- 172.21.15.53:0/2232241962 shutdown_connections 2023-06-10T19:05:52.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.811+0000 7f563bf63640 1 -- 172.21.15.53:0/2232241962 wait complete. 2023-06-10T19:05:52.838 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-06-10T19:05:52.838 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-06-10T19:05:52.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.963+0000 7fe2adc90640 1 Processor -- start 2023-06-10T19:05:52.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.963+0000 7fe2adc90640 1 -- start start 2023-06-10T19:05:52.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.963+0000 7fe2adc90640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2a806eca0 0x7fe2a806f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:52.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.963+0000 7fe2adc90640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe2a80af0e0 0x7fe2a815f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:52.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.963+0000 7fe2adc90640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2a80ccda0 con 0x7fe2a815fc40 2023-06-10T19:05:52.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.963+0000 7fe2adc90640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2a806f5b0 con 0x7fe2a80af0e0 2023-06-10T19:05:52.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.963+0000 7fe2adc90640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a806a920 con 0x7fe2a806eca0 2023-06-10T19:05:52.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.963+0000 7fe2a7fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fe2a815fc40 0x7fe2a80ced80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:45192/0 (socket says 172.21.15.53:45192) 2023-06-10T19:05:52.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.963+0000 7fe2a7fff640 1 -- 172.21.15.53:0/3850362497 learned_addr learned my addr 172.21.15.53:0/3850362497 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:05:52.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.963+0000 7fe2a77fe640 1 --2- 172.21.15.53:0/3850362497 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2a806eca0 0x7fe2a806f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:52.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.963+0000 7fe2a6ffd640 1 --2- 172.21.15.53:0/3850362497 >> v2:172.21.15.117:3300/0 conn(0x7fe2a80af0e0 0x7fe2a815f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:52.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.963+0000 7fe2a67fc640 1 -- 172.21.15.53:0/3850362497 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3267703658 0 0) 0x7fe2a80ccda0 con 0x7fe2a815fc40 2023-06-10T19:05:52.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.963+0000 7fe2a67fc640 1 -- 172.21.15.53:0/3850362497 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe290003530 con 0x7fe2a815fc40 2023-06-10T19:05:52.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.963+0000 7fe2a67fc640 1 -- 172.21.15.53:0/3850362497 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2007137692 0 0) 0x7fe290003530 con 0x7fe2a815fc40 2023-06-10T19:05:52.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.963+0000 7fe2a67fc640 1 -- 172.21.15.53:0/3850362497 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2a806eca0 msgr2=0x7fe2a806f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:52.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.963+0000 7fe2a67fc640 1 --2- 172.21.15.53:0/3850362497 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2a806eca0 0x7fe2a806f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:52.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.963+0000 7fe2a67fc640 1 -- 172.21.15.53:0/3850362497 >> v2:172.21.15.117:3300/0 conn(0x7fe2a80af0e0 msgr2=0x7fe2a815f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:52.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.963+0000 7fe2a67fc640 1 --2- 172.21.15.53:0/3850362497 >> v2:172.21.15.117:3300/0 conn(0x7fe2a80af0e0 0x7fe2a815f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:52.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.963+0000 7fe2a67fc640 1 -- 172.21.15.53:0/3850362497 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2a806ac00 con 0x7fe2a815fc40 2023-06-10T19:05:52.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.963+0000 7fe2a67fc640 1 -- 172.21.15.53:0/3850362497 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fe2a0001a00 con 0x7fe2a815fc40 2023-06-10T19:05:52.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.963+0000 7fe2a67fc640 1 -- 172.21.15.53:0/3850362497 >> v1:172.21.15.53:6789/0 conn(0x7fe2a815fc40 legacy=0x7fe2a80ced80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:52.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.963+0000 7fe2a67fc640 1 --2- 172.21.15.53:0/3850362497 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe290003980 0x7fe290003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:52.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.963+0000 7fe2a67fc640 1 --2- 172.21.15.53:0/3850362497 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe2900043b0 0x7fe290004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:52.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.963+0000 7fe2a67fc640 1 --2- 172.21.15.53:0/3850362497 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2a806eca0 0x7fe290004f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:52.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.963+0000 7fe2a67fc640 1 -- 172.21.15.53:0/3850362497 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a806f5b0 con 0x7fe2900043b0 2023-06-10T19:05:52.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.963+0000 7fe2a67fc640 1 -- 172.21.15.53:0/3850362497 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a806a920 con 0x7fe290003980 2023-06-10T19:05:52.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.963+0000 7fe2a67fc640 1 -- 172.21.15.53:0/3850362497 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe29000b990 con 0x7fe2a806eca0 2023-06-10T19:05:52.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.963+0000 7fe2a6ffd640 1 --2- 172.21.15.53:0/3850362497 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe2900043b0 0x7fe290004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:52.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.963+0000 7fe2a77fe640 1 --2- 172.21.15.53:0/3850362497 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe290003980 0x7fe290003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:52.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.963+0000 7fe2a7fff640 1 --2- 172.21.15.53:0/3850362497 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2a806eca0 0x7fe290004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:52.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.963+0000 7fe2a6ffd640 1 -- 172.21.15.53:0/3850362497 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2a806eca0 msgr2=0x7fe290004f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:52.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.963+0000 7fe2a6ffd640 1 --2- 172.21.15.53:0/3850362497 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2a806eca0 0x7fe290004f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:52.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.963+0000 7fe2a6ffd640 1 -- 172.21.15.53:0/3850362497 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe290003980 msgr2=0x7fe290003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:52.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.963+0000 7fe2a6ffd640 1 --2- 172.21.15.53:0/3850362497 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe290003980 0x7fe290003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:52.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.963+0000 7fe2a6ffd640 1 -- 172.21.15.53:0/3850362497 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe290003530 con 0x7fe2900043b0 2023-06-10T19:05:52.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.967+0000 7fe2a6ffd640 1 --2- 172.21.15.53:0/3850362497 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe2900043b0 0x7fe290004870 secure :-1 s=READY pgs=2030 cs=0 l=1 rev1=1 crypto rx=0x7fe29c009ae0 tx=0x7fe29c01ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bedeaa1f1d6e1c95 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:52.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.967+0000 7fe2a67fc640 1 -- 172.21.15.53:0/3850362497 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe29c0a5680 con 0x7fe2900043b0 2023-06-10T19:05:52.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.967+0000 7fe2a67fc640 1 -- 172.21.15.53:0/3850362497 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe29c0a57e0 con 0x7fe2900043b0 2023-06-10T19:05:52.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.967+0000 7fe2a67fc640 1 -- 172.21.15.53:0/3850362497 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe29c0a5b90 con 0x7fe2900043b0 2023-06-10T19:05:52.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.967+0000 7fe2adc90640 1 -- 172.21.15.53:0/3850362497 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe2900043b0 msgr2=0x7fe290004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:52.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.967+0000 7fe2adc90640 1 --2- 172.21.15.53:0/3850362497 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe2900043b0 0x7fe290004870 secure :-1 s=READY pgs=2030 cs=0 l=1 rev1=1 crypto rx=0x7fe29c009ae0 tx=0x7fe29c01ca90 comp rx=0 tx=0).stop 2023-06-10T19:05:52.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.967+0000 7fe2a7fff640 1 -- 172.21.15.53:0/3850362497 reap_dead start 2023-06-10T19:05:52.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.967+0000 7fe2adc90640 1 -- 172.21.15.53:0/3850362497 shutdown_connections 2023-06-10T19:05:52.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.967+0000 7fe2adc90640 1 -- 172.21.15.53:0/3850362497 >> 172.21.15.53:0/3850362497 conn(0x7fe2a806a0e0 msgr2=0x7fe2a806d270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:52.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.967+0000 7fe2adc90640 1 -- 172.21.15.53:0/3850362497 shutdown_connections 2023-06-10T19:05:52.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.967+0000 7fe2adc90640 1 -- 172.21.15.53:0/3850362497 wait complete. 2023-06-10T19:05:52.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.967+0000 7fe2adc90640 1 Processor -- start 2023-06-10T19:05:52.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.967+0000 7fe2adc90640 1 -- start start 2023-06-10T19:05:52.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.971+0000 7fe2adc90640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe2900043b0 0x7fe2a815d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:52.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.971+0000 7fe2adc90640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2a81f5880 0x7fe2a814a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:52.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.971+0000 7fe2adc90640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2a80b4d30 0x7fe2a80b51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:52.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.971+0000 7fe2adc90640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a80b56e0 con 0x7fe2900043b0 2023-06-10T19:05:52.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.971+0000 7fe2adc90640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a80ab900 con 0x7fe2a81f5880 2023-06-10T19:05:52.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.971+0000 7fe2adc90640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a81f5cf0 con 0x7fe2a80b4d30 2023-06-10T19:05:52.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.971+0000 7fe2a77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe2900043b0 0x7fe2a815d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:52.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.971+0000 7fe2a77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe2900043b0 0x7fe2a815d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47146/0 (socket says 172.21.15.53:47146) 2023-06-10T19:05:52.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.971+0000 7fe2a77fe640 1 -- 172.21.15.53:0/2294618676 learned_addr learned my addr 172.21.15.53:0/2294618676 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:52.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.971+0000 7fe2a6ffd640 1 --2- 172.21.15.53:0/2294618676 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2a81f5880 0x7fe2a814a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:52.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.971+0000 7fe2a7fff640 1 --2- 172.21.15.53:0/2294618676 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2a80b4d30 0x7fe2a80b51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:52.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.971+0000 7fe2a77fe640 1 -- 172.21.15.53:0/2294618676 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2a80b4d30 msgr2=0x7fe2a80b51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:52.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.971+0000 7fe2a77fe640 1 --2- 172.21.15.53:0/2294618676 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2a80b4d30 0x7fe2a80b51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:52.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.971+0000 7fe2a77fe640 1 -- 172.21.15.53:0/2294618676 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2a81f5880 msgr2=0x7fe2a814a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:52.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.971+0000 7fe2a77fe640 1 --2- 172.21.15.53:0/2294618676 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2a81f5880 0x7fe2a814a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:52.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.971+0000 7fe2a77fe640 1 -- 172.21.15.53:0/2294618676 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2a815e090 con 0x7fe2900043b0 2023-06-10T19:05:52.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.971+0000 7fe2a6ffd640 1 --2- 172.21.15.53:0/2294618676 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2a81f5880 0x7fe2a814a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:05:52.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.971+0000 7fe2a77fe640 1 --2- 172.21.15.53:0/2294618676 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe2900043b0 0x7fe2a815d990 secure :-1 s=READY pgs=2031 cs=0 l=1 rev1=1 crypto rx=0x7fe2980115e0 tx=0x7fe298011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:52.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.971+0000 7fe28ffff640 1 -- 172.21.15.53:0/2294618676 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe29800f8f0 con 0x7fe2900043b0 2023-06-10T19:05:52.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.971+0000 7fe28ffff640 1 -- 172.21.15.53:0/2294618676 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe29800fa50 con 0x7fe2900043b0 2023-06-10T19:05:52.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.971+0000 7fe2adc90640 1 -- 172.21.15.53:0/2294618676 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2a815e370 con 0x7fe2900043b0 2023-06-10T19:05:52.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.971+0000 7fe28ffff640 1 -- 172.21.15.53:0/2294618676 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe29800fdc0 con 0x7fe2900043b0 2023-06-10T19:05:52.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.971+0000 7fe2adc90640 1 -- 172.21.15.53:0/2294618676 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2a815e930 con 0x7fe2900043b0 2023-06-10T19:05:52.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.971+0000 7fe2adc90640 1 -- 172.21.15.53:0/2294618676 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2a80aba70 con 0x7fe2900043b0 2023-06-10T19:05:52.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.971+0000 7fe28ffff640 1 -- 172.21.15.53:0/2294618676 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe298015460 con 0x7fe2900043b0 2023-06-10T19:05:52.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.971+0000 7fe28ffff640 1 --2- 172.21.15.53:0/2294618676 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe294066280 0x7fe294068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:52.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.971+0000 7fe28ffff640 1 -- 172.21.15.53:0/2294618676 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe2980844a0 con 0x7fe2900043b0 2023-06-10T19:05:52.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.971+0000 7fe2a6ffd640 1 --2- 172.21.15.53:0/2294618676 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe294066280 0x7fe294068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:52.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.975+0000 7fe2a6ffd640 1 --2- 172.21.15.53:0/2294618676 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe294066280 0x7fe294068730 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fe29c0af000 tx=0x7fe29c0046d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:52.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:52.979+0000 7fe28ffff640 1 -- 172.21.15.53:0/2294618676 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe2a80aba70 con 0x7fe2900043b0 2023-06-10T19:05:53.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:53.163+0000 7fe2adc90640 1 -- 172.21.15.53:0/2294618676 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fe2a80aba70 con 0x7fe2900043b0 2023-06-10T19:05:53.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:53.811+0000 7fe28ffff640 1 -- 172.21.15.53:0/2294618676 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v76) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe2a80aba70 con 0x7fe2900043b0 2023-06-10T19:05:53.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:53.815+0000 7fe2adc90640 1 -- 172.21.15.53:0/2294618676 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe294066280 msgr2=0x7fe294068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:53.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:53.815+0000 7fe2adc90640 1 --2- 172.21.15.53:0/2294618676 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe294066280 0x7fe294068730 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fe29c0af000 tx=0x7fe29c0046d0 comp rx=0 tx=0).stop 2023-06-10T19:05:53.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:53.815+0000 7fe2adc90640 1 -- 172.21.15.53:0/2294618676 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe2900043b0 msgr2=0x7fe2a815d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:53.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:53.815+0000 7fe2adc90640 1 --2- 172.21.15.53:0/2294618676 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe2900043b0 0x7fe2a815d990 secure :-1 s=READY pgs=2031 cs=0 l=1 rev1=1 crypto rx=0x7fe2980115e0 tx=0x7fe298011aa0 comp rx=0 tx=0).stop 2023-06-10T19:05:53.819 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:53.815+0000 7fe2adc90640 1 -- 172.21.15.53:0/2294618676 shutdown_connections 2023-06-10T19:05:53.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:53.815+0000 7fe2adc90640 1 --2- 172.21.15.53:0/2294618676 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe294066280 0x7fe294068730 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:53.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:53.815+0000 7fe2adc90640 1 --2- 172.21.15.53:0/2294618676 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe2a80b4d30 0x7fe2a80b51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:53.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:53.815+0000 7fe2adc90640 1 --2- 172.21.15.53:0/2294618676 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2a81f5880 0x7fe2a814a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:53.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:53.815+0000 7fe2adc90640 1 --2- 172.21.15.53:0/2294618676 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe2900043b0 0x7fe2a815d990 unknown :-1 s=CLOSED pgs=2031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:53.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:53.815+0000 7fe2adc90640 1 -- 172.21.15.53:0/2294618676 >> 172.21.15.53:0/2294618676 conn(0x7fe2a806a0e0 msgr2=0x7fe2a80d0460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:53.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:53.815+0000 7fe2adc90640 1 -- 172.21.15.53:0/2294618676 shutdown_connections 2023-06-10T19:05:53.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:53.815+0000 7fe2adc90640 1 -- 172.21.15.53:0/2294618676 wait complete. 2023-06-10T19:05:53.843 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-06-10T19:05:53.843 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:05:53.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:53.963+0000 7fcf626c7640 1 Processor -- start 2023-06-10T19:05:53.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:53.963+0000 7fcf626c7640 1 -- start start 2023-06-10T19:05:53.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:53.963+0000 7fcf626c7640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fcf5c0c8d00 0x7fcf5c06b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:53.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:53.963+0000 7fcf626c7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fcf5c06bc00 0x7fcf5c162180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:53.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:53.963+0000 7fcf626c7640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf5c158a90 con 0x7fcf5c06b2f0 2023-06-10T19:05:53.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:53.963+0000 7fcf626c7640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf5c06f780 con 0x7fcf5c06bc00 2023-06-10T19:05:53.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:53.963+0000 7fcf626c7640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf5c0705d0 con 0x7fcf5c0c8d00 2023-06-10T19:05:53.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:53.963+0000 7fcf60c64640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fcf5c06bc00 0x7fcf5c162180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:53.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:53.963+0000 7fcf60c64640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fcf5c06bc00 0x7fcf5c162180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47154/0 (socket says 172.21.15.53:47154) 2023-06-10T19:05:53.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:53.963+0000 7fcf60c64640 1 -- 172.21.15.53:0/141980587 learned_addr learned my addr 172.21.15.53:0/141980587 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:53.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:53.963+0000 7fcf5b7fe640 1 --2- 172.21.15.53:0/141980587 >> v2:172.21.15.117:3300/0 conn(0x7fcf5c0c8d00 0x7fcf5c06b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:53.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:53.963+0000 7fcf60c64640 1 -- 172.21.15.53:0/141980587 >> v2:172.21.15.117:3300/0 conn(0x7fcf5c0c8d00 msgr2=0x7fcf5c06b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:53.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:53.963+0000 7fcf60c64640 1 --2- 172.21.15.53:0/141980587 >> v2:172.21.15.117:3300/0 conn(0x7fcf5c0c8d00 0x7fcf5c06b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:53.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:53.963+0000 7fcf60c64640 1 -- 172.21.15.53:0/141980587 >> v1:172.21.15.117:6789/0 conn(0x7fcf5c06b2f0 legacy=0x7fcf5c06f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:53.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:53.963+0000 7fcf60c64640 1 -- 172.21.15.53:0/141980587 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf5c0cce10 con 0x7fcf5c06bc00 2023-06-10T19:05:53.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:53.967+0000 7fcf60c64640 1 --2- 172.21.15.53:0/141980587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf5c06bc00 0x7fcf5c162180 secure :-1 s=READY pgs=2032 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c15c0b0 tx=0x7fcf5401f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3835ffc0617c2c1a server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:53.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:53.967+0000 7fcf5affd640 1 -- 172.21.15.53:0/141980587 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf540af400 con 0x7fcf5c06bc00 2023-06-10T19:05:53.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:53.967+0000 7fcf5affd640 1 -- 172.21.15.53:0/141980587 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf540ab050 con 0x7fcf5c06bc00 2023-06-10T19:05:53.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:53.967+0000 7fcf5affd640 1 -- 172.21.15.53:0/141980587 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf540af780 con 0x7fcf5c06bc00 2023-06-10T19:05:53.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:53.967+0000 7fcf626c7640 1 -- 172.21.15.53:0/141980587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf5c06bc00 msgr2=0x7fcf5c162180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:53.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:53.967+0000 7fcf626c7640 1 --2- 172.21.15.53:0/141980587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf5c06bc00 0x7fcf5c162180 secure :-1 s=READY pgs=2032 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c15c0b0 tx=0x7fcf5401f1c0 comp rx=0 tx=0).stop 2023-06-10T19:05:53.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:53.967+0000 7fcf626c7640 1 -- 172.21.15.53:0/141980587 shutdown_connections 2023-06-10T19:05:53.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:53.967+0000 7fcf626c7640 1 --2- 172.21.15.53:0/141980587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf5c06bc00 0x7fcf5c162180 unknown :-1 s=CLOSED pgs=2032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:53.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:53.967+0000 7fcf626c7640 1 --2- 172.21.15.53:0/141980587 >> v2:172.21.15.117:3300/0 conn(0x7fcf5c0c8d00 0x7fcf5c06b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:53.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:53.967+0000 7fcf626c7640 1 -- 172.21.15.53:0/141980587 >> 172.21.15.53:0/141980587 conn(0x7fcf5c06a0d0 msgr2=0x7fcf5c0ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:53.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:53.967+0000 7fcf626c7640 1 -- 172.21.15.53:0/141980587 shutdown_connections 2023-06-10T19:05:53.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:53.967+0000 7fcf626c7640 1 -- 172.21.15.53:0/141980587 wait complete. 2023-06-10T19:05:53.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:53.967+0000 7fcf626c7640 1 Processor -- start 2023-06-10T19:05:53.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:53.967+0000 7fcf626c7640 1 -- start start 2023-06-10T19:05:53.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:53.967+0000 7fcf626c7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf5c06b2f0 0x7fcf5c15a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:53.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:53.967+0000 7fcf626c7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcf5c06bc00 0x7fcf5c154f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:53.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:53.967+0000 7fcf626c7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf5c0c8d00 0x7fcf5c153ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:53.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:53.967+0000 7fcf626c7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c0b2640 con 0x7fcf5c0c8d00 2023-06-10T19:05:53.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:53.967+0000 7fcf626c7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c0b2920 con 0x7fcf5c06b2f0 2023-06-10T19:05:53.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:53.967+0000 7fcf626c7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c0b2c00 con 0x7fcf5c06bc00 2023-06-10T19:05:53.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:53.967+0000 7fcf60c64640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf5c0c8d00 0x7fcf5c153ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:53.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:53.967+0000 7fcf60c64640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf5c0c8d00 0x7fcf5c153ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47166/0 (socket says 172.21.15.53:47166) 2023-06-10T19:05:53.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:53.967+0000 7fcf60c64640 1 -- 172.21.15.53:0/923352745 learned_addr learned my addr 172.21.15.53:0/923352745 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:53.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:53.967+0000 7fcf5bfff640 1 --2- 172.21.15.53:0/923352745 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf5c06b2f0 0x7fcf5c15a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:53.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:53.967+0000 7fcf5b7fe640 1 --2- 172.21.15.53:0/923352745 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcf5c06bc00 0x7fcf5c154f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:53.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:53.971+0000 7fcf60c64640 1 -- 172.21.15.53:0/923352745 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcf5c06bc00 msgr2=0x7fcf5c154f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:53.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:53.971+0000 7fcf60c64640 1 --2- 172.21.15.53:0/923352745 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcf5c06bc00 0x7fcf5c154f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:53.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:53.971+0000 7fcf60c64640 1 -- 172.21.15.53:0/923352745 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf5c06b2f0 msgr2=0x7fcf5c15a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:53.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:53.971+0000 7fcf60c64640 1 --2- 172.21.15.53:0/923352745 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf5c06b2f0 0x7fcf5c15a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:53.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:53.971+0000 7fcf60c64640 1 -- 172.21.15.53:0/923352745 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf54009b30 con 0x7fcf5c0c8d00 2023-06-10T19:05:53.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:53.971+0000 7fcf5bfff640 1 --2- 172.21.15.53:0/923352745 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf5c06b2f0 0x7fcf5c15a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:05:53.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:53.971+0000 7fcf60c64640 1 --2- 172.21.15.53:0/923352745 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf5c0c8d00 0x7fcf5c153ce0 secure :-1 s=READY pgs=2033 cs=0 l=1 rev1=1 crypto rx=0x7fcf5401bdd0 tx=0x7fcf5401bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:53.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:53.971+0000 7fcf58ff9640 1 -- 172.21.15.53:0/923352745 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf540bf070 con 0x7fcf5c0c8d00 2023-06-10T19:05:53.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:53.971+0000 7fcf58ff9640 1 -- 172.21.15.53:0/923352745 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf54009510 con 0x7fcf5c0c8d00 2023-06-10T19:05:53.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:53.971+0000 7fcf626c7640 1 -- 172.21.15.53:0/923352745 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf5c0b2ee0 con 0x7fcf5c0c8d00 2023-06-10T19:05:53.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:53.971+0000 7fcf58ff9640 1 -- 172.21.15.53:0/923352745 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf540afd90 con 0x7fcf5c0c8d00 2023-06-10T19:05:53.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:53.971+0000 7fcf626c7640 1 -- 172.21.15.53:0/923352745 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf5c15a560 con 0x7fcf5c0c8d00 2023-06-10T19:05:53.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:53.971+0000 7fcf626c7640 1 -- 172.21.15.53:0/923352745 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf5c04d790 con 0x7fcf5c0c8d00 2023-06-10T19:05:53.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:53.971+0000 7fcf58ff9640 1 -- 172.21.15.53:0/923352745 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcf540b6070 con 0x7fcf5c0c8d00 2023-06-10T19:05:53.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:53.971+0000 7fcf58ff9640 1 --2- 172.21.15.53:0/923352745 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcf48066280 0x7fcf48068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:53.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:53.971+0000 7fcf58ff9640 1 -- 172.21.15.53:0/923352745 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcf54121ab0 con 0x7fcf5c0c8d00 2023-06-10T19:05:53.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:53.971+0000 7fcf5bfff640 1 --2- 172.21.15.53:0/923352745 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcf48066280 0x7fcf48068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:53.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:53.975+0000 7fcf5bfff640 1 --2- 172.21.15.53:0/923352745 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcf48066280 0x7fcf48068730 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c165440 tx=0x7fcf4c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:53.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:53.975+0000 7fcf58ff9640 1 -- 172.21.15.53:0/923352745 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcf540ef0a0 con 0x7fcf5c0c8d00 2023-06-10T19:05:54.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.159+0000 7fcf626c7640 1 -- 172.21.15.53:0/923352745 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcf5c0b3390 con 0x7fcf5c0c8d00 2023-06-10T19:05:54.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.163+0000 7fcf58ff9640 1 -- 172.21.15.53:0/923352745 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+4670 (secure 0 0 0) 0x7fcf540f26c0 con 0x7fcf5c0c8d00 2023-06-10T19:05:54.168 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:05:54.168 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":76,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7981,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3614073676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3614073676},{"type":"v1","addr":"172.21.15.117:6835","nonce":3614073676}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":7984,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/775375987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":775375987},{"type":"v1","addr":"172.21.15.117:6837","nonce":775375987}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":9537,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/53265583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":53265583},{"type":"v1","addr":"172.21.15.53:6833","nonce":53265583}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:05:50.789763+0000","modified":"2023-06-10T19:05:53.806474+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9543},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9543":{"gid":9543,"name":"a","rank":0,"incarnation":73,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/1171476971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":1171476971},{"type":"v1","addr":"172.21.15.53:6835","nonce":1171476971}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-06-10T19:05:54.168 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 76 2023-06-10T19:05:54.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.163+0000 7fcf626c7640 1 -- 172.21.15.53:0/923352745 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcf48066280 msgr2=0x7fcf48068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:54.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.163+0000 7fcf626c7640 1 --2- 172.21.15.53:0/923352745 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcf48066280 0x7fcf48068730 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c165440 tx=0x7fcf4c009040 comp rx=0 tx=0).stop 2023-06-10T19:05:54.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.163+0000 7fcf626c7640 1 -- 172.21.15.53:0/923352745 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf5c0c8d00 msgr2=0x7fcf5c153ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:54.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.163+0000 7fcf626c7640 1 --2- 172.21.15.53:0/923352745 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf5c0c8d00 0x7fcf5c153ce0 secure :-1 s=READY pgs=2033 cs=0 l=1 rev1=1 crypto rx=0x7fcf5401bdd0 tx=0x7fcf5401bf60 comp rx=0 tx=0).stop 2023-06-10T19:05:54.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.163+0000 7fcf626c7640 1 -- 172.21.15.53:0/923352745 shutdown_connections 2023-06-10T19:05:54.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.163+0000 7fcf626c7640 1 --2- 172.21.15.53:0/923352745 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcf48066280 0x7fcf48068730 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:54.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.163+0000 7fcf626c7640 1 --2- 172.21.15.53:0/923352745 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf5c0c8d00 0x7fcf5c153ce0 unknown :-1 s=CLOSED pgs=2033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:54.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.163+0000 7fcf626c7640 1 --2- 172.21.15.53:0/923352745 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcf5c06bc00 0x7fcf5c154f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:54.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.163+0000 7fcf626c7640 1 --2- 172.21.15.53:0/923352745 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf5c06b2f0 0x7fcf5c15a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:54.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.163+0000 7fcf626c7640 1 -- 172.21.15.53:0/923352745 >> 172.21.15.53:0/923352745 conn(0x7fcf5c06a0d0 msgr2=0x7fcf5c0ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:54.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.163+0000 7fcf626c7640 1 -- 172.21.15.53:0/923352745 shutdown_connections 2023-06-10T19:05:54.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.163+0000 7fcf626c7640 1 -- 172.21.15.53:0/923352745 wait complete. 2023-06-10T19:05:54.187 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:05:54.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.291+0000 7f0bab18b640 1 Processor -- start 2023-06-10T19:05:54.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.295+0000 7f0bab18b640 1 -- start start 2023-06-10T19:05:54.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.295+0000 7f0bab18b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0ba4157e10 0x7f0ba406efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:54.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.295+0000 7f0bab18b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0ba406bb30 0x7f0ba40ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:54.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.295+0000 7f0bab18b640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ba40c9e50 con 0x7f0ba40af720 2023-06-10T19:05:54.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.295+0000 7f0bab18b640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ba40cd520 con 0x7f0ba406bb30 2023-06-10T19:05:54.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.295+0000 7f0bab18b640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ba40c82f0 con 0x7f0ba4157e10 2023-06-10T19:05:54.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.295+0000 7f0ba3fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0ba406bb30 0x7f0ba40ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:54.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.295+0000 7f0ba9728640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f0ba40af720 0x7f0ba40afb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:45204/0 (socket says 172.21.15.53:45204) 2023-06-10T19:05:54.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.295+0000 7f0ba9728640 1 -- 172.21.15.53:0/1545595290 learned_addr learned my addr 172.21.15.53:0/1545595290 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:05:54.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.295+0000 7f0ba3fff640 1 --2- 172.21.15.53:0/1545595290 >> v2:172.21.15.53:3300/0 conn(0x7f0ba406bb30 0x7f0ba40ccfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47178/0 (socket says 172.21.15.53:47178) 2023-06-10T19:05:54.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.295+0000 7f0ba8f27640 1 --2- 172.21.15.53:0/1545595290 >> v2:172.21.15.117:3300/0 conn(0x7f0ba4157e10 0x7f0ba406efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:54.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.295+0000 7f0ba3fff640 1 -- 172.21.15.53:0/1545595290 >> v2:172.21.15.117:3300/0 conn(0x7f0ba4157e10 msgr2=0x7f0ba406efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:54.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.295+0000 7f0ba3fff640 1 --2- 172.21.15.53:0/1545595290 >> v2:172.21.15.117:3300/0 conn(0x7f0ba4157e10 0x7f0ba406efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:54.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.295+0000 7f0ba3fff640 1 -- 172.21.15.53:0/1545595290 >> v1:172.21.15.53:6789/0 conn(0x7f0ba40af720 legacy=0x7f0ba40afb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:54.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.295+0000 7f0ba3fff640 1 -- 172.21.15.53:0/1545595290 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ba406bf80 con 0x7f0ba406bb30 2023-06-10T19:05:54.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.299+0000 7f0ba3fff640 1 --2- 172.21.15.53:0/1545595290 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ba406bb30 0x7f0ba40ccfe0 secure :-1 s=READY pgs=2035 cs=0 l=1 rev1=1 crypto rx=0x7f0ba406e9d0 tx=0x7f0b9001c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc9a90619c93b7a server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:54.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.299+0000 7f0ba37fe640 1 -- 172.21.15.53:0/1545595290 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b900ab600 con 0x7f0ba406bb30 2023-06-10T19:05:54.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.299+0000 7f0ba37fe640 1 -- 172.21.15.53:0/1545595290 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b900a7050 con 0x7f0ba406bb30 2023-06-10T19:05:54.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.299+0000 7f0ba37fe640 1 -- 172.21.15.53:0/1545595290 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b900ab980 con 0x7f0ba406bb30 2023-06-10T19:05:54.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.299+0000 7f0bab18b640 1 -- 172.21.15.53:0/1545595290 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ba406bb30 msgr2=0x7f0ba40ccfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:54.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.299+0000 7f0bab18b640 1 --2- 172.21.15.53:0/1545595290 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ba406bb30 0x7f0ba40ccfe0 secure :-1 s=READY pgs=2035 cs=0 l=1 rev1=1 crypto rx=0x7f0ba406e9d0 tx=0x7f0b9001c260 comp rx=0 tx=0).stop 2023-06-10T19:05:54.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.299+0000 7f0bab18b640 1 -- 172.21.15.53:0/1545595290 shutdown_connections 2023-06-10T19:05:54.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.299+0000 7f0bab18b640 1 --2- 172.21.15.53:0/1545595290 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ba406bb30 0x7f0ba40ccfe0 unknown :-1 s=CLOSED pgs=2035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:54.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.299+0000 7f0bab18b640 1 --2- 172.21.15.53:0/1545595290 >> v2:172.21.15.117:3300/0 conn(0x7f0ba4157e10 0x7f0ba406efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:54.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.299+0000 7f0bab18b640 1 -- 172.21.15.53:0/1545595290 >> 172.21.15.53:0/1545595290 conn(0x7f0ba406a0d0 msgr2=0x7f0ba40ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:54.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.299+0000 7f0bab18b640 1 -- 172.21.15.53:0/1545595290 shutdown_connections 2023-06-10T19:05:54.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.299+0000 7f0bab18b640 1 -- 172.21.15.53:0/1545595290 wait complete. 2023-06-10T19:05:54.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.299+0000 7f0bab18b640 1 Processor -- start 2023-06-10T19:05:54.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.299+0000 7f0bab18b640 1 -- start start 2023-06-10T19:05:54.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.299+0000 7f0bab18b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0ba406bb30 0x7f0ba4145cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:54.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.299+0000 7f0bab18b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ba40af720 0x7f0ba41653a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:54.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.299+0000 7f0bab18b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ba4157e10 0x7f0ba414beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:54.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.299+0000 7f0bab18b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba4166f00 con 0x7f0ba4157e10 2023-06-10T19:05:54.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.299+0000 7f0bab18b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba4146230 con 0x7f0ba40af720 2023-06-10T19:05:54.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.299+0000 7f0bab18b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba4166a70 con 0x7f0ba406bb30 2023-06-10T19:05:54.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.299+0000 7f0ba9728640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ba4157e10 0x7f0ba414beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:54.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.299+0000 7f0ba9728640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ba4157e10 0x7f0ba414beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47186/0 (socket says 172.21.15.53:47186) 2023-06-10T19:05:54.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.299+0000 7f0ba9728640 1 -- 172.21.15.53:0/2707346876 learned_addr learned my addr 172.21.15.53:0/2707346876 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:54.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.299+0000 7f0ba9728640 1 -- 172.21.15.53:0/2707346876 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0ba406bb30 msgr2=0x7f0ba4145cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:54.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.299+0000 7f0ba8f27640 1 --2- 172.21.15.53:0/2707346876 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0ba406bb30 0x7f0ba4145cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:54.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.299+0000 7f0ba3fff640 1 --2- 172.21.15.53:0/2707346876 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ba40af720 0x7f0ba41653a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:54.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.299+0000 7f0ba9728640 1 --2- 172.21.15.53:0/2707346876 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0ba406bb30 0x7f0ba4145cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:54.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.299+0000 7f0ba9728640 1 -- 172.21.15.53:0/2707346876 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ba40af720 msgr2=0x7f0ba41653a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:54.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.299+0000 7f0ba9728640 1 --2- 172.21.15.53:0/2707346876 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ba40af720 0x7f0ba41653a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:54.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.299+0000 7f0ba9728640 1 -- 172.21.15.53:0/2707346876 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b90009420 con 0x7f0ba4157e10 2023-06-10T19:05:54.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.303+0000 7f0ba9728640 1 --2- 172.21.15.53:0/2707346876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ba4157e10 0x7f0ba414beb0 secure :-1 s=READY pgs=2036 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c00e570 tx=0x7f0b9c00ea30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:54.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.303+0000 7f0ba17fa640 1 -- 172.21.15.53:0/2707346876 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b9c0094e0 con 0x7f0ba4157e10 2023-06-10T19:05:54.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.303+0000 7f0ba17fa640 1 -- 172.21.15.53:0/2707346876 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b9c009640 con 0x7f0ba4157e10 2023-06-10T19:05:54.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.303+0000 7f0bab18b640 1 -- 172.21.15.53:0/2707346876 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ba4165e60 con 0x7f0ba4157e10 2023-06-10T19:05:54.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.303+0000 7f0ba17fa640 1 -- 172.21.15.53:0/2707346876 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b9c0099f0 con 0x7f0ba4157e10 2023-06-10T19:05:54.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.303+0000 7f0bab18b640 1 -- 172.21.15.53:0/2707346876 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ba4166420 con 0x7f0ba4157e10 2023-06-10T19:05:54.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.303+0000 7f0bab18b640 1 -- 172.21.15.53:0/2707346876 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ba4166be0 con 0x7f0ba4157e10 2023-06-10T19:05:54.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.303+0000 7f0ba17fa640 1 -- 172.21.15.53:0/2707346876 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0b9c012400 con 0x7f0ba4157e10 2023-06-10T19:05:54.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.303+0000 7f0ba17fa640 1 --2- 172.21.15.53:0/2707346876 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0b880662b0 0x7f0b88068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:54.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.303+0000 7f0ba17fa640 1 -- 172.21.15.53:0/2707346876 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0b9c086c00 con 0x7f0ba4157e10 2023-06-10T19:05:54.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.303+0000 7f0ba8f27640 1 --2- 172.21.15.53:0/2707346876 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0b880662b0 0x7f0b88068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:54.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.303+0000 7f0ba8f27640 1 --2- 172.21.15.53:0/2707346876 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0b880662b0 0x7f0b88068760 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f0ba40cecf0 tx=0x7f0b98008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:54.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.307+0000 7f0ba17fa640 1 -- 172.21.15.53:0/2707346876 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0b9c08d080 con 0x7f0ba4157e10 2023-06-10T19:05:54.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.463+0000 7f0bab18b640 1 -- 172.21.15.53:0/2707346876 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0ba404d790 con 0x7f0ba4157e10 2023-06-10T19:05:54.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.463+0000 7f0ba17fa640 1 -- 172.21.15.53:0/2707346876 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v138) v1 ==== 74+0+18297 (secure 0 0 0) 0x7f0b9c054080 con 0x7f0ba4157e10 2023-06-10T19:05:54.469 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:05:54.469 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":138,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:05:51.792930+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-06-10T19:05:48.449837+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-06-10T19:05:49.783728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:05:54.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.467+0000 7f0bab18b640 1 -- 172.21.15.53:0/2707346876 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0b880662b0 msgr2=0x7f0b88068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:54.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.467+0000 7f0bab18b640 1 --2- 172.21.15.53:0/2707346876 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0b880662b0 0x7f0b88068760 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f0ba40cecf0 tx=0x7f0b98008040 comp rx=0 tx=0).stop 2023-06-10T19:05:54.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.467+0000 7f0bab18b640 1 -- 172.21.15.53:0/2707346876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ba4157e10 msgr2=0x7f0ba414beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:54.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.467+0000 7f0bab18b640 1 --2- 172.21.15.53:0/2707346876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ba4157e10 0x7f0ba414beb0 secure :-1 s=READY pgs=2036 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c00e570 tx=0x7f0b9c00ea30 comp rx=0 tx=0).stop 2023-06-10T19:05:54.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.467+0000 7f0bab18b640 1 -- 172.21.15.53:0/2707346876 shutdown_connections 2023-06-10T19:05:54.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.467+0000 7f0bab18b640 1 --2- 172.21.15.53:0/2707346876 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0b880662b0 0x7f0b88068760 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:54.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.467+0000 7f0bab18b640 1 --2- 172.21.15.53:0/2707346876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ba4157e10 0x7f0ba414beb0 unknown :-1 s=CLOSED pgs=2036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:54.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.467+0000 7f0bab18b640 1 --2- 172.21.15.53:0/2707346876 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ba40af720 0x7f0ba41653a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:54.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.467+0000 7f0bab18b640 1 --2- 172.21.15.53:0/2707346876 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0ba406bb30 0x7f0ba4145cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:54.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.467+0000 7f0bab18b640 1 -- 172.21.15.53:0/2707346876 >> 172.21.15.53:0/2707346876 conn(0x7f0ba406a0d0 msgr2=0x7f0ba40cc590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:54.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.467+0000 7f0bab18b640 1 -- 172.21.15.53:0/2707346876 shutdown_connections 2023-06-10T19:05:54.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.467+0000 7f0bab18b640 1 -- 172.21.15.53:0/2707346876 wait complete. 2023-06-10T19:05:54.489 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-06-10T19:05:54.489 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-10T19:05:54.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.603+0000 7f9994daa640 1 Processor -- start 2023-06-10T19:05:54.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.603+0000 7f9994daa640 1 -- start start 2023-06-10T19:05:54.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.603+0000 7f9994daa640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9990162640 0x7f9990164a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:54.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.603+0000 7f9994daa640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9990159b50 con 0x7f9990071060 2023-06-10T19:05:54.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.603+0000 7f9994daa640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99900702a0 con 0x7f99900c9840 2023-06-10T19:05:54.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.603+0000 7f9994daa640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9990070580 con 0x7f9990162640 2023-06-10T19:05:54.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.603+0000 7f998dd9b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f9990071060 0x7f99900af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:45216/0 (socket says 172.21.15.53:45216) 2023-06-10T19:05:54.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.603+0000 7f998dd9b640 1 -- 172.21.15.53:0/1974344447 learned_addr learned my addr 172.21.15.53:0/1974344447 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:05:54.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.603+0000 7f998ed9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9990162640 0x7f9990164a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:54.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.603+0000 7f998ed9d640 1 -- 172.21.15.53:0/1974344447 >> v1:172.21.15.117:6789/0 conn(0x7f99900c9840 legacy=0x7f99900c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:54.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.603+0000 7f998ed9d640 1 -- 172.21.15.53:0/1974344447 >> v1:172.21.15.53:6789/0 conn(0x7f9990071060 legacy=0x7f99900af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:54.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.603+0000 7f998d59a640 1 -- 172.21.15.53:0/1974344447 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1742345287 0 0) 0x7f9990159b50 con 0x7f9990071060 2023-06-10T19:05:54.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.603+0000 7f998ed9d640 1 -- 172.21.15.53:0/1974344447 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9990070860 con 0x7f9990162640 2023-06-10T19:05:54.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.607+0000 7f998ed9d640 1 --2- 172.21.15.53:0/1974344447 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9990162640 0x7f9990164a20 secure :-1 s=READY pgs=2038 cs=0 l=1 rev1=1 crypto rx=0x7f99880097c0 tx=0x7f998801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=193397d3af9bbac9 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:54.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.607+0000 7f998d59a640 1 -- 172.21.15.53:0/1974344447 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99880ab670 con 0x7f9990162640 2023-06-10T19:05:54.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.607+0000 7f998d59a640 1 -- 172.21.15.53:0/1974344447 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99880ab7d0 con 0x7f9990162640 2023-06-10T19:05:54.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.607+0000 7f998d59a640 1 -- 172.21.15.53:0/1974344447 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99880abb60 con 0x7f9990162640 2023-06-10T19:05:54.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.607+0000 7f9994daa640 1 -- 172.21.15.53:0/1974344447 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9990162640 msgr2=0x7f9990164a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:54.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.607+0000 7f9994daa640 1 --2- 172.21.15.53:0/1974344447 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9990162640 0x7f9990164a20 secure :-1 s=READY pgs=2038 cs=0 l=1 rev1=1 crypto rx=0x7f99880097c0 tx=0x7f998801c450 comp rx=0 tx=0).stop 2023-06-10T19:05:54.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.607+0000 7f9994daa640 1 -- 172.21.15.53:0/1974344447 shutdown_connections 2023-06-10T19:05:54.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.607+0000 7f9994daa640 1 --2- 172.21.15.53:0/1974344447 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9990162640 0x7f9990164a20 unknown :-1 s=CLOSED pgs=2038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:54.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.607+0000 7f9994daa640 1 -- 172.21.15.53:0/1974344447 >> 172.21.15.53:0/1974344447 conn(0x7f999006a0d0 msgr2=0x7f99900ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:54.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.607+0000 7f9994daa640 1 -- 172.21.15.53:0/1974344447 shutdown_connections 2023-06-10T19:05:54.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.607+0000 7f9994daa640 1 -- 172.21.15.53:0/1974344447 wait complete. 2023-06-10T19:05:54.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.607+0000 7f9994daa640 1 Processor -- start 2023-06-10T19:05:54.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.607+0000 7f9994daa640 1 -- start start 2023-06-10T19:05:54.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.607+0000 7f9994daa640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9990071060 0x7f9990153540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:54.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.607+0000 7f9994daa640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99900c9840 0x7f99900cc280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:54.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.607+0000 7f9994daa640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9990162640 0x7f99901528a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:54.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.607+0000 7f9994daa640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99900cc7c0 con 0x7f99900c9840 2023-06-10T19:05:54.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.611+0000 7f9994daa640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99900b0c00 con 0x7f9990071060 2023-06-10T19:05:54.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.611+0000 7f9994daa640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99900cc9b0 con 0x7f9990162640 2023-06-10T19:05:54.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.611+0000 7f998dd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99900c9840 0x7f99900cc280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:54.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.611+0000 7f998dd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99900c9840 0x7f99900cc280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47208/0 (socket says 172.21.15.53:47208) 2023-06-10T19:05:54.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.611+0000 7f998dd9b640 1 -- 172.21.15.53:0/1476934369 learned_addr learned my addr 172.21.15.53:0/1476934369 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:54.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.611+0000 7f998ed9d640 1 --2- 172.21.15.53:0/1476934369 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9990162640 0x7f99901528a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:54.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.611+0000 7f998dd9b640 1 -- 172.21.15.53:0/1476934369 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9990162640 msgr2=0x7f99901528a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:54.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.611+0000 7f998dd9b640 1 --2- 172.21.15.53:0/1476934369 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9990162640 0x7f99901528a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:54.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.611+0000 7f998dd9b640 1 -- 172.21.15.53:0/1476934369 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9990071060 msgr2=0x7f9990153540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:54.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.611+0000 7f998e59c640 1 --2- 172.21.15.53:0/1476934369 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9990071060 0x7f9990153540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:54.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.611+0000 7f998dd9b640 1 --2- 172.21.15.53:0/1476934369 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9990071060 0x7f9990153540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:54.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.611+0000 7f998dd9b640 1 -- 172.21.15.53:0/1476934369 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9988009420 con 0x7f99900c9840 2023-06-10T19:05:54.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.611+0000 7f998dd9b640 1 --2- 172.21.15.53:0/1476934369 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99900c9840 0x7f99900cc280 secure :-1 s=READY pgs=2039 cs=0 l=1 rev1=1 crypto rx=0x7f998400c480 tx=0x7f998400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:54.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.611+0000 7f997effd640 1 -- 172.21.15.53:0/1476934369 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99840074e0 con 0x7f99900c9840 2023-06-10T19:05:54.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.611+0000 7f997effd640 1 -- 172.21.15.53:0/1476934369 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9984007640 con 0x7f99900c9840 2023-06-10T19:05:54.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.611+0000 7f997effd640 1 -- 172.21.15.53:0/1476934369 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9984004a10 con 0x7f99900c9840 2023-06-10T19:05:54.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.611+0000 7f9994daa640 1 -- 172.21.15.53:0/1476934369 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99900c4ea0 con 0x7f99900c9840 2023-06-10T19:05:54.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.611+0000 7f9994daa640 1 -- 172.21.15.53:0/1476934369 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99900c5460 con 0x7f99900c9840 2023-06-10T19:05:54.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.611+0000 7f9994daa640 1 -- 172.21.15.53:0/1476934369 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f999004d790 con 0x7f99900c9840 2023-06-10T19:05:54.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.611+0000 7f997effd640 1 -- 172.21.15.53:0/1476934369 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9984004b70 con 0x7f99900c9840 2023-06-10T19:05:54.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.611+0000 7f997effd640 1 --2- 172.21.15.53:0/1476934369 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9970066280 0x7f9970068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:54.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.611+0000 7f997effd640 1 -- 172.21.15.53:0/1476934369 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9984082e50 con 0x7f99900c9840 2023-06-10T19:05:54.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.611+0000 7f998e59c640 1 --2- 172.21.15.53:0/1476934369 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9970066280 0x7f9970068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:54.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.611+0000 7f998e59c640 1 --2- 172.21.15.53:0/1476934369 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9970066280 0x7f9970068730 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f99800012f0 tx=0x7f9980009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:54.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.615+0000 7f997effd640 1 -- 172.21.15.53:0/1476934369 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9984050410 con 0x7f99900c9840 2023-06-10T19:05:54.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.763+0000 7f9994daa640 1 -- 172.21.15.53:0/1476934369 --> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f99900afe30 con 0x7f9970066280 2023-06-10T19:05:54.791 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.787+0000 7f997effd640 1 -- 172.21.15.53:0/1476934369 <== mgr.4105 v2:172.21.15.117:6832/3061986771 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310360 (secure 0 0 0) 0x7f9980001a50 con 0x7f9970066280 2023-06-10T19:05:54.793 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:05:54.798 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-06-10T19:05:54.799 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.791+0000 7f9994daa640 1 -- 172.21.15.53:0/1476934369 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9970066280 msgr2=0x7f9970068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:54.799 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.791+0000 7f9994daa640 1 --2- 172.21.15.53:0/1476934369 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9970066280 0x7f9970068730 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f99800012f0 tx=0x7f9980009040 comp rx=0 tx=0).stop 2023-06-10T19:05:54.799 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.791+0000 7f9994daa640 1 -- 172.21.15.53:0/1476934369 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99900c9840 msgr2=0x7f99900cc280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:54.799 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.791+0000 7f9994daa640 1 --2- 172.21.15.53:0/1476934369 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99900c9840 0x7f99900cc280 secure :-1 s=READY pgs=2039 cs=0 l=1 rev1=1 crypto rx=0x7f998400c480 tx=0x7f998400c940 comp rx=0 tx=0).stop 2023-06-10T19:05:54.799 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.791+0000 7f9994daa640 1 -- 172.21.15.53:0/1476934369 shutdown_connections 2023-06-10T19:05:54.799 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.791+0000 7f9994daa640 1 --2- 172.21.15.53:0/1476934369 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9970066280 0x7f9970068730 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:54.800 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.791+0000 7f9994daa640 1 --2- 172.21.15.53:0/1476934369 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9990162640 0x7f99901528a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:54.800 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.791+0000 7f9994daa640 1 --2- 172.21.15.53:0/1476934369 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99900c9840 0x7f99900cc280 unknown :-1 s=CLOSED pgs=2039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:54.800 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.791+0000 7f9994daa640 1 --2- 172.21.15.53:0/1476934369 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9990071060 0x7f9990153540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:54.800 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.791+0000 7f9994daa640 1 -- 172.21.15.53:0/1476934369 >> 172.21.15.53:0/1476934369 conn(0x7f999006a0d0 msgr2=0x7f9990155be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:54.800 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.791+0000 7f9994daa640 1 -- 172.21.15.53:0/1476934369 shutdown_connections 2023-06-10T19:05:54.801 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.791+0000 7f9994daa640 1 -- 172.21.15.53:0/1476934369 wait complete. 2023-06-10T19:05:54.811 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":532,"stamp":"2023-06-10T19:05:53.844576+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":113,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":275264,"kb_used_data":14592,"kb_used_omap":0,"kb_used_meta":260608,"kb_avail":754699456,"statfs":{"total":773094113280,"available":772812242944,"internally_reserved":0,"allocated":14942208,"data_stored":7544522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":266862592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":57,"apply_latency_ms":57,"commit_latency_ns":57000000,"apply_latency_ns":57000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.446687"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:51.800548+0000","last_change":"2023-06-10T19:05:50.818095+0000","last_active":"2023-06-10T19:05:51.800548+0000","last_peered":"2023-06-10T19:05:51.800548+0000","last_clean":"2023-06-10T19:05:51.800548+0000","last_became_active":"2023-06-10T19:05:50.817788+0000","last_became_peered":"2023-06-10T19:05:50.817788+0000","last_unstale":"2023-06-10T19:05:51.800548+0000","last_undegraded":"2023-06-10T19:05:51.800548+0000","last_fullsized":"2023-06-10T19:05:51.800548+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:04:30.604067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:51.805789+0000","last_change":"2023-06-10T19:05:50.852873+0000","last_active":"2023-06-10T19:05:51.805789+0000","last_peered":"2023-06-10T19:05:51.805789+0000","last_clean":"2023-06-10T19:05:51.805789+0000","last_became_active":"2023-06-10T19:05:50.852230+0000","last_became_peered":"2023-06-10T19:05:50.852230+0000","last_unstale":"2023-06-10T19:05:51.805789+0000","last_undegraded":"2023-06-10T19:05:51.805789+0000","last_fullsized":"2023-06-10T19:05:51.805789+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:30:38.170585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.734522+0000","last_change":"2023-06-10T19:05:50.861338+0000","last_active":"2023-06-10T19:05:52.734522+0000","last_peered":"2023-06-10T19:05:52.734522+0000","last_clean":"2023-06-10T19:05:52.734522+0000","last_became_active":"2023-06-10T19:05:50.860706+0000","last_became_peered":"2023-06-10T19:05:50.860706+0000","last_unstale":"2023-06-10T19:05:52.734522+0000","last_undegraded":"2023-06-10T19:05:52.734522+0000","last_fullsized":"2023-06-10T19:05:52.734522+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:13:05.245657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:51.804641+0000","last_change":"2023-06-10T19:05:50.845678+0000","last_active":"2023-06-10T19:05:51.804641+0000","last_peered":"2023-06-10T19:05:51.804641+0000","last_clean":"2023-06-10T19:05:51.804641+0000","last_became_active":"2023-06-10T19:05:50.844941+0000","last_became_peered":"2023-06-10T19:05:50.844941+0000","last_unstale":"2023-06-10T19:05:51.804641+0000","last_undegraded":"2023-06-10T19:05:51.804641+0000","last_fullsized":"2023-06-10T19:05:51.804641+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:50:57.284645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.681906+0000","last_change":"2023-06-10T19:05:50.827940+0000","last_active":"2023-06-10T19:05:52.681906+0000","last_peered":"2023-06-10T19:05:52.681906+0000","last_clean":"2023-06-10T19:05:52.681906+0000","last_became_active":"2023-06-10T19:05:50.827561+0000","last_became_peered":"2023-06-10T19:05:50.827561+0000","last_unstale":"2023-06-10T19:05:52.681906+0000","last_undegraded":"2023-06-10T19:05:52.681906+0000","last_fullsized":"2023-06-10T19:05:52.681906+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:09:14.638261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-06-10T19:05:50.864845+0000","last_change":"2023-06-10T19:05:50.862303+0000","last_active":"2023-06-10T19:05:50.864845+0000","last_peered":"2023-06-10T19:05:50.864845+0000","last_clean":"2023-06-10T19:05:50.864845+0000","last_became_active":"2023-06-10T19:05:50.862020+0000","last_became_peered":"2023-06-10T19:05:50.862020+0000","last_unstale":"2023-06-10T19:05:50.864845+0000","last_undegraded":"2023-06-10T19:05:50.864845+0000","last_fullsized":"2023-06-10T19:05:50.864845+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:06:20.251632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.732580+0000","last_change":"2023-06-10T19:05:50.867655+0000","last_active":"2023-06-10T19:05:52.732580+0000","last_peered":"2023-06-10T19:05:52.732580+0000","last_clean":"2023-06-10T19:05:52.732580+0000","last_became_active":"2023-06-10T19:05:50.867188+0000","last_became_peered":"2023-06-10T19:05:50.867188+0000","last_unstale":"2023-06-10T19:05:52.732580+0000","last_undegraded":"2023-06-10T19:05:52.732580+0000","last_fullsized":"2023-06-10T19:05:52.732580+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:26:54.736067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:51.803393+0000","last_change":"2023-06-10T19:05:50.830026+0000","last_active":"2023-06-10T19:05:51.803393+0000","last_peered":"2023-06-10T19:05:51.803393+0000","last_clean":"2023-06-10T19:05:51.803393+0000","last_became_active":"2023-06-10T19:05:50.829264+0000","last_became_peered":"2023-06-10T19:05:50.829264+0000","last_unstale":"2023-06-10T19:05:51.803393+0000","last_undegraded":"2023-06-10T19:05:51.803393+0000","last_fullsized":"2023-06-10T19:05:51.803393+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:39:16.537480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-06-10T19:05:50.847596+0000","last_change":"2023-06-10T19:05:50.846159+0000","last_active":"2023-06-10T19:05:50.847596+0000","last_peered":"2023-06-10T19:05:50.847596+0000","last_clean":"2023-06-10T19:05:50.847596+0000","last_became_active":"2023-06-10T19:05:50.845903+0000","last_became_peered":"2023-06-10T19:05:50.845903+0000","last_unstale":"2023-06-10T19:05:50.847596+0000","last_undegraded":"2023-06-10T19:05:50.847596+0000","last_fullsized":"2023-06-10T19:05:50.847596+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:44:41.180623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-06-10T19:05:50.832099+0000","last_change":"2023-06-10T19:05:50.830749+0000","last_active":"2023-06-10T19:05:50.832099+0000","last_peered":"2023-06-10T19:05:50.832099+0000","last_clean":"2023-06-10T19:05:50.832099+0000","last_became_active":"2023-06-10T19:05:50.830170+0000","last_became_peered":"2023-06-10T19:05:50.830170+0000","last_unstale":"2023-06-10T19:05:50.832099+0000","last_undegraded":"2023-06-10T19:05:50.832099+0000","last_fullsized":"2023-06-10T19:05:50.832099+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:27:30.563568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:51.804462+0000","last_change":"2023-06-10T19:05:50.867760+0000","last_active":"2023-06-10T19:05:51.804462+0000","last_peered":"2023-06-10T19:05:51.804462+0000","last_clean":"2023-06-10T19:05:51.804462+0000","last_became_active":"2023-06-10T19:05:50.867217+0000","last_became_peered":"2023-06-10T19:05:50.867217+0000","last_unstale":"2023-06-10T19:05:51.804462+0000","last_undegraded":"2023-06-10T19:05:51.804462+0000","last_fullsized":"2023-06-10T19:05:51.804462+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:26:52.568664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:51.800558+0000","last_change":"2023-06-10T19:05:50.819285+0000","last_active":"2023-06-10T19:05:51.800558+0000","last_peered":"2023-06-10T19:05:51.800558+0000","last_clean":"2023-06-10T19:05:51.800558+0000","last_became_active":"2023-06-10T19:05:50.819022+0000","last_became_peered":"2023-06-10T19:05:50.819022+0000","last_unstale":"2023-06-10T19:05:51.800558+0000","last_undegraded":"2023-06-10T19:05:51.800558+0000","last_fullsized":"2023-06-10T19:05:51.800558+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:52:28.468372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-06-10T19:05:50.865113+0000","last_change":"2023-06-10T19:05:50.863964+0000","last_active":"2023-06-10T19:05:50.865113+0000","last_peered":"2023-06-10T19:05:50.865113+0000","last_clean":"2023-06-10T19:05:50.865113+0000","last_became_active":"2023-06-10T19:05:50.863517+0000","last_became_peered":"2023-06-10T19:05:50.863517+0000","last_unstale":"2023-06-10T19:05:50.865113+0000","last_undegraded":"2023-06-10T19:05:50.865113+0000","last_fullsized":"2023-06-10T19:05:50.865113+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:20:51.069947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:51.799989+0000","last_change":"2023-06-10T19:05:50.842665+0000","last_active":"2023-06-10T19:05:51.799989+0000","last_peered":"2023-06-10T19:05:51.799989+0000","last_clean":"2023-06-10T19:05:51.799989+0000","last_became_active":"2023-06-10T19:05:50.842334+0000","last_became_peered":"2023-06-10T19:05:50.842334+0000","last_unstale":"2023-06-10T19:05:51.799989+0000","last_undegraded":"2023-06-10T19:05:51.799989+0000","last_fullsized":"2023-06-10T19:05:51.799989+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:05:27.893460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:51.799671+0000","last_change":"2023-06-10T19:05:50.842738+0000","last_active":"2023-06-10T19:05:51.799671+0000","last_peered":"2023-06-10T19:05:51.799671+0000","last_clean":"2023-06-10T19:05:51.799671+0000","last_became_active":"2023-06-10T19:05:50.842434+0000","last_became_peered":"2023-06-10T19:05:50.842434+0000","last_unstale":"2023-06-10T19:05:51.799671+0000","last_undegraded":"2023-06-10T19:05:51.799671+0000","last_fullsized":"2023-06-10T19:05:51.799671+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:39:43.489639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-06-10T19:05:50.810601+0000","last_change":"2023-06-10T19:05:50.805582+0000","last_active":"2023-06-10T19:05:50.810601+0000","last_peered":"2023-06-10T19:05:50.810601+0000","last_clean":"2023-06-10T19:05:50.810601+0000","last_became_active":"2023-06-10T19:05:50.805282+0000","last_became_peered":"2023-06-10T19:05:50.805282+0000","last_unstale":"2023-06-10T19:05:50.810601+0000","last_undegraded":"2023-06-10T19:05:50.810601+0000","last_fullsized":"2023-06-10T19:05:50.810601+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:28:14.486117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-06-10T19:05:50.810352+0000","last_change":"2023-06-10T19:05:50.803660+0000","last_active":"2023-06-10T19:05:50.810352+0000","last_peered":"2023-06-10T19:05:50.810352+0000","last_clean":"2023-06-10T19:05:50.810352+0000","last_became_active":"2023-06-10T19:05:50.803332+0000","last_became_peered":"2023-06-10T19:05:50.803332+0000","last_unstale":"2023-06-10T19:05:50.810352+0000","last_undegraded":"2023-06-10T19:05:50.810352+0000","last_fullsized":"2023-06-10T19:05:50.810352+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:33:48.238441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.681634+0000","last_change":"2023-06-10T19:05:50.811158+0000","last_active":"2023-06-10T19:05:52.681634+0000","last_peered":"2023-06-10T19:05:52.681634+0000","last_clean":"2023-06-10T19:05:52.681634+0000","last_became_active":"2023-06-10T19:05:50.810827+0000","last_became_peered":"2023-06-10T19:05:50.810827+0000","last_unstale":"2023-06-10T19:05:52.681634+0000","last_undegraded":"2023-06-10T19:05:52.681634+0000","last_fullsized":"2023-06-10T19:05:52.681634+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:15:19.626767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.733288+0000","last_change":"2023-06-10T19:05:50.855680+0000","last_active":"2023-06-10T19:05:52.733288+0000","last_peered":"2023-06-10T19:05:52.733288+0000","last_clean":"2023-06-10T19:05:52.733288+0000","last_became_active":"2023-06-10T19:05:50.854420+0000","last_became_peered":"2023-06-10T19:05:50.854420+0000","last_unstale":"2023-06-10T19:05:52.733288+0000","last_undegraded":"2023-06-10T19:05:52.733288+0000","last_fullsized":"2023-06-10T19:05:52.733288+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:11:46.052629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.682275+0000","last_change":"2023-06-10T19:05:50.841778+0000","last_active":"2023-06-10T19:05:52.682275+0000","last_peered":"2023-06-10T19:05:52.682275+0000","last_clean":"2023-06-10T19:05:52.682275+0000","last_became_active":"2023-06-10T19:05:50.841460+0000","last_became_peered":"2023-06-10T19:05:50.841460+0000","last_unstale":"2023-06-10T19:05:52.682275+0000","last_undegraded":"2023-06-10T19:05:52.682275+0000","last_fullsized":"2023-06-10T19:05:52.682275+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:43:51.032420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:51.802966+0000","last_change":"2023-06-10T19:05:50.845333+0000","last_active":"2023-06-10T19:05:51.802966+0000","last_peered":"2023-06-10T19:05:51.802966+0000","last_clean":"2023-06-10T19:05:51.802966+0000","last_became_active":"2023-06-10T19:05:50.844655+0000","last_became_peered":"2023-06-10T19:05:50.844655+0000","last_unstale":"2023-06-10T19:05:51.802966+0000","last_undegraded":"2023-06-10T19:05:51.802966+0000","last_fullsized":"2023-06-10T19:05:51.802966+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:52:14.571254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:51.799791+0000","last_change":"2023-06-10T19:05:50.847013+0000","last_active":"2023-06-10T19:05:51.799791+0000","last_peered":"2023-06-10T19:05:51.799791+0000","last_clean":"2023-06-10T19:05:51.799791+0000","last_became_active":"2023-06-10T19:05:50.846635+0000","last_became_peered":"2023-06-10T19:05:50.846635+0000","last_unstale":"2023-06-10T19:05:51.799791+0000","last_undegraded":"2023-06-10T19:05:51.799791+0000","last_fullsized":"2023-06-10T19:05:51.799791+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:01:17.617338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:51.803088+0000","last_change":"2023-06-10T19:05:50.856514+0000","last_active":"2023-06-10T19:05:51.803088+0000","last_peered":"2023-06-10T19:05:51.803088+0000","last_clean":"2023-06-10T19:05:51.803088+0000","last_became_active":"2023-06-10T19:05:50.855909+0000","last_became_peered":"2023-06-10T19:05:50.855909+0000","last_unstale":"2023-06-10T19:05:51.803088+0000","last_undegraded":"2023-06-10T19:05:51.803088+0000","last_fullsized":"2023-06-10T19:05:51.803088+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:38:12.641119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-06-10T19:05:50.847081+0000","last_change":"2023-06-10T19:05:50.846062+0000","last_active":"2023-06-10T19:05:50.847081+0000","last_peered":"2023-06-10T19:05:50.847081+0000","last_clean":"2023-06-10T19:05:50.847081+0000","last_became_active":"2023-06-10T19:05:50.845767+0000","last_became_peered":"2023-06-10T19:05:50.845767+0000","last_unstale":"2023-06-10T19:05:50.847081+0000","last_undegraded":"2023-06-10T19:05:50.847081+0000","last_fullsized":"2023-06-10T19:05:50.847081+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:06:38.772263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.734887+0000","last_change":"2023-06-10T19:05:50.861788+0000","last_active":"2023-06-10T19:05:52.734887+0000","last_peered":"2023-06-10T19:05:52.734887+0000","last_clean":"2023-06-10T19:05:52.734887+0000","last_became_active":"2023-06-10T19:05:50.861140+0000","last_became_peered":"2023-06-10T19:05:50.861140+0000","last_unstale":"2023-06-10T19:05:52.734887+0000","last_undegraded":"2023-06-10T19:05:52.734887+0000","last_fullsized":"2023-06-10T19:05:52.734887+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:05:29.285662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.734747+0000","last_change":"2023-06-10T19:05:50.860239+0000","last_active":"2023-06-10T19:05:52.734747+0000","last_peered":"2023-06-10T19:05:52.734747+0000","last_clean":"2023-06-10T19:05:52.734747+0000","last_became_active":"2023-06-10T19:05:50.859602+0000","last_became_peered":"2023-06-10T19:05:50.859602+0000","last_unstale":"2023-06-10T19:05:52.734747+0000","last_undegraded":"2023-06-10T19:05:52.734747+0000","last_fullsized":"2023-06-10T19:05:52.734747+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:35:26.002277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.733693+0000","last_change":"2023-06-10T19:05:50.855986+0000","last_active":"2023-06-10T19:05:52.733693+0000","last_peered":"2023-06-10T19:05:52.733693+0000","last_clean":"2023-06-10T19:05:52.733693+0000","last_became_active":"2023-06-10T19:05:50.855046+0000","last_became_peered":"2023-06-10T19:05:50.855046+0000","last_unstale":"2023-06-10T19:05:52.733693+0000","last_undegraded":"2023-06-10T19:05:52.733693+0000","last_fullsized":"2023-06-10T19:05:52.733693+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:04:00.400484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-06-10T19:05:50.832452+0000","last_change":"2023-06-10T19:05:50.830645+0000","last_active":"2023-06-10T19:05:50.832452+0000","last_peered":"2023-06-10T19:05:50.832452+0000","last_clean":"2023-06-10T19:05:50.832452+0000","last_became_active":"2023-06-10T19:05:50.830318+0000","last_became_peered":"2023-06-10T19:05:50.830318+0000","last_unstale":"2023-06-10T19:05:50.832452+0000","last_undegraded":"2023-06-10T19:05:50.832452+0000","last_fullsized":"2023-06-10T19:05:50.832452+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:17:46.678761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.734202+0000","last_change":"2023-06-10T19:05:50.863097+0000","last_active":"2023-06-10T19:05:52.734202+0000","last_peered":"2023-06-10T19:05:52.734202+0000","last_clean":"2023-06-10T19:05:52.734202+0000","last_became_active":"2023-06-10T19:05:50.862503+0000","last_became_peered":"2023-06-10T19:05:50.862503+0000","last_unstale":"2023-06-10T19:05:52.734202+0000","last_undegraded":"2023-06-10T19:05:52.734202+0000","last_fullsized":"2023-06-10T19:05:52.734202+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:00:59.305862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.731909+0000","last_change":"2023-06-10T19:05:50.860386+0000","last_active":"2023-06-10T19:05:52.731909+0000","last_peered":"2023-06-10T19:05:52.731909+0000","last_clean":"2023-06-10T19:05:52.731909+0000","last_became_active":"2023-06-10T19:05:50.859784+0000","last_became_peered":"2023-06-10T19:05:50.859784+0000","last_unstale":"2023-06-10T19:05:52.731909+0000","last_undegraded":"2023-06-10T19:05:52.731909+0000","last_fullsized":"2023-06-10T19:05:52.731909+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:20:14.986471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:51.803107+0000","last_change":"2023-06-10T19:05:50.828127+0000","last_active":"2023-06-10T19:05:51.803107+0000","last_peered":"2023-06-10T19:05:51.803107+0000","last_clean":"2023-06-10T19:05:51.803107+0000","last_became_active":"2023-06-10T19:05:50.827365+0000","last_became_peered":"2023-06-10T19:05:50.827365+0000","last_unstale":"2023-06-10T19:05:51.803107+0000","last_undegraded":"2023-06-10T19:05:51.803107+0000","last_fullsized":"2023-06-10T19:05:51.803107+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:39:58.976588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-06-10T19:05:50.817368+0000","last_change":"2023-06-10T19:05:50.814231+0000","last_active":"2023-06-10T19:05:50.817368+0000","last_peered":"2023-06-10T19:05:50.817368+0000","last_clean":"2023-06-10T19:05:50.817368+0000","last_became_active":"2023-06-10T19:05:50.813869+0000","last_became_peered":"2023-06-10T19:05:50.813869+0000","last_unstale":"2023-06-10T19:05:50.817368+0000","last_undegraded":"2023-06-10T19:05:50.817368+0000","last_fullsized":"2023-06-10T19:05:50.817368+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:31:05.660633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:51.803769+0000","last_change":"2023-06-10T19:05:50.841604+0000","last_active":"2023-06-10T19:05:51.803769+0000","last_peered":"2023-06-10T19:05:51.803769+0000","last_clean":"2023-06-10T19:05:51.803769+0000","last_became_active":"2023-06-10T19:05:50.840982+0000","last_became_peered":"2023-06-10T19:05:50.840982+0000","last_unstale":"2023-06-10T19:05:51.803769+0000","last_undegraded":"2023-06-10T19:05:51.803769+0000","last_fullsized":"2023-06-10T19:05:51.803769+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:38:56.499878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"137'4","reported_seq":17,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.735045+0000","last_change":"2023-06-10T19:05:50.450125+0000","last_active":"2023-06-10T19:05:52.735045+0000","last_peered":"2023-06-10T19:05:52.735045+0000","last_clean":"2023-06-10T19:05:52.735045+0000","last_became_active":"2023-06-10T19:05:50.449467+0000","last_became_peered":"2023-06-10T19:05:50.449467+0000","last_unstale":"2023-06-10T19:05:52.735045+0000","last_undegraded":"2023-06-10T19:05:52.735045+0000","last_fullsized":"2023-06-10T19:05:52.735045+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_clean_scrub_stamp":"2023-06-10T19:05:49.381507+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:58:01.012145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:51.799944+0000","last_change":"2023-06-10T19:05:50.845217+0000","last_active":"2023-06-10T19:05:51.799944+0000","last_peered":"2023-06-10T19:05:51.799944+0000","last_clean":"2023-06-10T19:05:51.799944+0000","last_became_active":"2023-06-10T19:05:50.844879+0000","last_became_peered":"2023-06-10T19:05:50.844879+0000","last_unstale":"2023-06-10T19:05:51.799944+0000","last_undegraded":"2023-06-10T19:05:51.799944+0000","last_fullsized":"2023-06-10T19:05:51.799944+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:56:52.692145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"137'1","reported_seq":14,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.682368+0000","last_change":"2023-06-10T19:05:50.439100+0000","last_active":"2023-06-10T19:05:52.682368+0000","last_peered":"2023-06-10T19:05:52.682368+0000","last_clean":"2023-06-10T19:05:52.682368+0000","last_became_active":"2023-06-10T19:05:50.438724+0000","last_became_peered":"2023-06-10T19:05:50.438724+0000","last_unstale":"2023-06-10T19:05:52.682368+0000","last_undegraded":"2023-06-10T19:05:52.682368+0000","last_fullsized":"2023-06-10T19:05:52.682368+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_clean_scrub_stamp":"2023-06-10T19:05:49.381507+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:59:30.264463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:51.803882+0000","last_change":"2023-06-10T19:05:50.857960+0000","last_active":"2023-06-10T19:05:51.803882+0000","last_peered":"2023-06-10T19:05:51.803882+0000","last_clean":"2023-06-10T19:05:51.803882+0000","last_became_active":"2023-06-10T19:05:50.857356+0000","last_became_peered":"2023-06-10T19:05:50.857356+0000","last_unstale":"2023-06-10T19:05:51.803882+0000","last_undegraded":"2023-06-10T19:05:51.803882+0000","last_fullsized":"2023-06-10T19:05:51.803882+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:38:09.162671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"137'2","reported_seq":15,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.733691+0000","last_change":"2023-06-10T19:05:50.458589+0000","last_active":"2023-06-10T19:05:52.733691+0000","last_peered":"2023-06-10T19:05:52.733691+0000","last_clean":"2023-06-10T19:05:52.733691+0000","last_became_active":"2023-06-10T19:05:50.457863+0000","last_became_peered":"2023-06-10T19:05:50.457863+0000","last_unstale":"2023-06-10T19:05:52.733691+0000","last_undegraded":"2023-06-10T19:05:52.733691+0000","last_fullsized":"2023-06-10T19:05:52.733691+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_clean_scrub_stamp":"2023-06-10T19:05:49.381507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:00:57.405373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:51.799876+0000","last_change":"2023-06-10T19:05:50.842720+0000","last_active":"2023-06-10T19:05:51.799876+0000","last_peered":"2023-06-10T19:05:51.799876+0000","last_clean":"2023-06-10T19:05:51.799876+0000","last_became_active":"2023-06-10T19:05:50.842414+0000","last_became_peered":"2023-06-10T19:05:50.842414+0000","last_unstale":"2023-06-10T19:05:51.799876+0000","last_undegraded":"2023-06-10T19:05:51.799876+0000","last_fullsized":"2023-06-10T19:05:51.799876+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:43:17.204571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"137'2","reported_seq":15,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.733177+0000","last_change":"2023-06-10T19:05:50.452952+0000","last_active":"2023-06-10T19:05:52.733177+0000","last_peered":"2023-06-10T19:05:52.733177+0000","last_clean":"2023-06-10T19:05:52.733177+0000","last_became_active":"2023-06-10T19:05:50.451890+0000","last_became_peered":"2023-06-10T19:05:50.451890+0000","last_unstale":"2023-06-10T19:05:52.733177+0000","last_undegraded":"2023-06-10T19:05:52.733177+0000","last_fullsized":"2023-06-10T19:05:52.733177+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_clean_scrub_stamp":"2023-06-10T19:05:49.381507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:50:19.085788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:51.803871+0000","last_change":"2023-06-10T19:05:50.828658+0000","last_active":"2023-06-10T19:05:51.803871+0000","last_peered":"2023-06-10T19:05:51.803871+0000","last_clean":"2023-06-10T19:05:51.803871+0000","last_became_active":"2023-06-10T19:05:50.827710+0000","last_became_peered":"2023-06-10T19:05:50.827710+0000","last_unstale":"2023-06-10T19:05:51.803871+0000","last_undegraded":"2023-06-10T19:05:51.803871+0000","last_fullsized":"2023-06-10T19:05:51.803871+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:46:56.030274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"137'1","reported_seq":14,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:51.803906+0000","last_change":"2023-06-10T19:05:50.436207+0000","last_active":"2023-06-10T19:05:51.803906+0000","last_peered":"2023-06-10T19:05:51.803906+0000","last_clean":"2023-06-10T19:05:51.803906+0000","last_became_active":"2023-06-10T19:05:50.435401+0000","last_became_peered":"2023-06-10T19:05:50.435401+0000","last_unstale":"2023-06-10T19:05:51.803906+0000","last_undegraded":"2023-06-10T19:05:51.803906+0000","last_fullsized":"2023-06-10T19:05:51.803906+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_clean_scrub_stamp":"2023-06-10T19:05:49.381507+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:43:50.018310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:51.804384+0000","last_change":"2023-06-10T19:05:50.812138+0000","last_active":"2023-06-10T19:05:51.804384+0000","last_peered":"2023-06-10T19:05:51.804384+0000","last_clean":"2023-06-10T19:05:51.804384+0000","last_became_active":"2023-06-10T19:05:50.811208+0000","last_became_peered":"2023-06-10T19:05:50.811208+0000","last_unstale":"2023-06-10T19:05:51.804384+0000","last_undegraded":"2023-06-10T19:05:51.804384+0000","last_fullsized":"2023-06-10T19:05:51.804384+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:00:38.878138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"137'1","reported_seq":14,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.681468+0000","last_change":"2023-06-10T19:05:50.439632+0000","last_active":"2023-06-10T19:05:52.681468+0000","last_peered":"2023-06-10T19:05:52.681468+0000","last_clean":"2023-06-10T19:05:52.681468+0000","last_became_active":"2023-06-10T19:05:50.439228+0000","last_became_peered":"2023-06-10T19:05:50.439228+0000","last_unstale":"2023-06-10T19:05:52.681468+0000","last_undegraded":"2023-06-10T19:05:52.681468+0000","last_fullsized":"2023-06-10T19:05:52.681468+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_clean_scrub_stamp":"2023-06-10T19:05:49.381507+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:22:35.551375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.682062+0000","last_change":"2023-06-10T19:05:50.853824+0000","last_active":"2023-06-10T19:05:52.682062+0000","last_peered":"2023-06-10T19:05:52.682062+0000","last_clean":"2023-06-10T19:05:52.682062+0000","last_became_active":"2023-06-10T19:05:50.853480+0000","last_became_peered":"2023-06-10T19:05:50.853480+0000","last_unstale":"2023-06-10T19:05:52.682062+0000","last_undegraded":"2023-06-10T19:05:52.682062+0000","last_fullsized":"2023-06-10T19:05:52.682062+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:34:04.270631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-06-10T19:05:50.798959+0000","last_change":"2023-06-10T19:05:50.440135+0000","last_active":"2023-06-10T19:05:50.798959+0000","last_peered":"2023-06-10T19:05:50.798959+0000","last_clean":"2023-06-10T19:05:50.798959+0000","last_became_active":"2023-06-10T19:05:50.439807+0000","last_became_peered":"2023-06-10T19:05:50.439807+0000","last_unstale":"2023-06-10T19:05:50.798959+0000","last_undegraded":"2023-06-10T19:05:50.798959+0000","last_fullsized":"2023-06-10T19:05:50.798959+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_clean_scrub_stamp":"2023-06-10T19:05:49.381507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:57:13.281356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.732270+0000","last_change":"2023-06-10T19:05:50.843333+0000","last_active":"2023-06-10T19:05:52.732270+0000","last_peered":"2023-06-10T19:05:52.732270+0000","last_clean":"2023-06-10T19:05:52.732270+0000","last_became_active":"2023-06-10T19:05:50.842607+0000","last_became_peered":"2023-06-10T19:05:50.842607+0000","last_unstale":"2023-06-10T19:05:52.732270+0000","last_undegraded":"2023-06-10T19:05:52.732270+0000","last_fullsized":"2023-06-10T19:05:52.732270+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:25:42.771747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":13,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.732164+0000","last_change":"2023-06-10T19:05:50.446660+0000","last_active":"2023-06-10T19:05:52.732164+0000","last_peered":"2023-06-10T19:05:52.732164+0000","last_clean":"2023-06-10T19:05:52.732164+0000","last_became_active":"2023-06-10T19:05:50.444550+0000","last_became_peered":"2023-06-10T19:05:50.444550+0000","last_unstale":"2023-06-10T19:05:52.732164+0000","last_undegraded":"2023-06-10T19:05:52.732164+0000","last_fullsized":"2023-06-10T19:05:52.732164+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_clean_scrub_stamp":"2023-06-10T19:05:49.381507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:30:09.422670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.731861+0000","last_change":"2023-06-10T19:05:50.863523+0000","last_active":"2023-06-10T19:05:52.731861+0000","last_peered":"2023-06-10T19:05:52.731861+0000","last_clean":"2023-06-10T19:05:52.731861+0000","last_became_active":"2023-06-10T19:05:50.863096+0000","last_became_peered":"2023-06-10T19:05:50.863096+0000","last_unstale":"2023-06-10T19:05:52.731861+0000","last_undegraded":"2023-06-10T19:05:52.731861+0000","last_fullsized":"2023-06-10T19:05:52.731861+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:37:06.323664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"137'1","reported_seq":14,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:51.806037+0000","last_change":"2023-06-10T19:05:50.440054+0000","last_active":"2023-06-10T19:05:51.806037+0000","last_peered":"2023-06-10T19:05:51.806037+0000","last_clean":"2023-06-10T19:05:51.806037+0000","last_became_active":"2023-06-10T19:05:50.438013+0000","last_became_peered":"2023-06-10T19:05:50.438013+0000","last_unstale":"2023-06-10T19:05:51.806037+0000","last_undegraded":"2023-06-10T19:05:51.806037+0000","last_fullsized":"2023-06-10T19:05:51.806037+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_clean_scrub_stamp":"2023-06-10T19:05:49.381507+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:29:36.059396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.732979+0000","last_change":"2023-06-10T19:05:50.857707+0000","last_active":"2023-06-10T19:05:52.732979+0000","last_peered":"2023-06-10T19:05:52.732979+0000","last_clean":"2023-06-10T19:05:52.732979+0000","last_became_active":"2023-06-10T19:05:50.856577+0000","last_became_peered":"2023-06-10T19:05:50.856577+0000","last_unstale":"2023-06-10T19:05:52.732979+0000","last_undegraded":"2023-06-10T19:05:52.732979+0000","last_fullsized":"2023-06-10T19:05:52.732979+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:27:33.745853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"137'2","reported_seq":15,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.734912+0000","last_change":"2023-06-10T19:05:50.444104+0000","last_active":"2023-06-10T19:05:52.734912+0000","last_peered":"2023-06-10T19:05:52.734912+0000","last_clean":"2023-06-10T19:05:52.734912+0000","last_became_active":"2023-06-10T19:05:50.443438+0000","last_became_peered":"2023-06-10T19:05:50.443438+0000","last_unstale":"2023-06-10T19:05:52.734912+0000","last_undegraded":"2023-06-10T19:05:52.734912+0000","last_fullsized":"2023-06-10T19:05:52.734912+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_clean_scrub_stamp":"2023-06-10T19:05:49.381507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:03:48.403477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.733235+0000","last_change":"2023-06-10T19:05:50.854928+0000","last_active":"2023-06-10T19:05:52.733235+0000","last_peered":"2023-06-10T19:05:52.733235+0000","last_clean":"2023-06-10T19:05:52.733235+0000","last_became_active":"2023-06-10T19:05:50.854212+0000","last_became_peered":"2023-06-10T19:05:50.854212+0000","last_unstale":"2023-06-10T19:05:52.733235+0000","last_undegraded":"2023-06-10T19:05:52.733235+0000","last_fullsized":"2023-06-10T19:05:52.733235+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:27:15.909597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"137'1","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-06-10T19:05:50.821146+0000","last_change":"2023-06-10T19:05:50.438790+0000","last_active":"2023-06-10T19:05:50.821146+0000","last_peered":"2023-06-10T19:05:50.821146+0000","last_clean":"2023-06-10T19:05:50.821146+0000","last_became_active":"2023-06-10T19:05:50.438459+0000","last_became_peered":"2023-06-10T19:05:50.438459+0000","last_unstale":"2023-06-10T19:05:50.821146+0000","last_undegraded":"2023-06-10T19:05:50.821146+0000","last_fullsized":"2023-06-10T19:05:50.821146+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_clean_scrub_stamp":"2023-06-10T19:05:49.381507+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:30:04.925465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-06-10T19:05:50.865108+0000","last_change":"2023-06-10T19:05:50.863424+0000","last_active":"2023-06-10T19:05:50.865108+0000","last_peered":"2023-06-10T19:05:50.865108+0000","last_clean":"2023-06-10T19:05:50.865108+0000","last_became_active":"2023-06-10T19:05:50.863112+0000","last_became_peered":"2023-06-10T19:05:50.863112+0000","last_unstale":"2023-06-10T19:05:50.865108+0000","last_undegraded":"2023-06-10T19:05:50.865108+0000","last_fullsized":"2023-06-10T19:05:50.865108+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:09:31.161349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":13,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.682474+0000","last_change":"2023-06-10T19:05:50.442563+0000","last_active":"2023-06-10T19:05:52.682474+0000","last_peered":"2023-06-10T19:05:52.682474+0000","last_clean":"2023-06-10T19:05:52.682474+0000","last_became_active":"2023-06-10T19:05:50.442171+0000","last_became_peered":"2023-06-10T19:05:50.442171+0000","last_unstale":"2023-06-10T19:05:52.682474+0000","last_undegraded":"2023-06-10T19:05:52.682474+0000","last_fullsized":"2023-06-10T19:05:52.682474+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_clean_scrub_stamp":"2023-06-10T19:05:49.381507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:00:37.864027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.682243+0000","last_change":"2023-06-10T19:05:50.817573+0000","last_active":"2023-06-10T19:05:52.682243+0000","last_peered":"2023-06-10T19:05:52.682243+0000","last_clean":"2023-06-10T19:05:52.682243+0000","last_became_active":"2023-06-10T19:05:50.817221+0000","last_became_peered":"2023-06-10T19:05:50.817221+0000","last_unstale":"2023-06-10T19:05:52.682243+0000","last_undegraded":"2023-06-10T19:05:52.682243+0000","last_fullsized":"2023-06-10T19:05:52.682243+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:38:56.499878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"137'2","reported_seq":15,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:51.804185+0000","last_change":"2023-06-10T19:05:50.451157+0000","last_active":"2023-06-10T19:05:51.804185+0000","last_peered":"2023-06-10T19:05:51.804185+0000","last_clean":"2023-06-10T19:05:51.804185+0000","last_became_active":"2023-06-10T19:05:50.449816+0000","last_became_peered":"2023-06-10T19:05:50.449816+0000","last_unstale":"2023-06-10T19:05:51.804185+0000","last_undegraded":"2023-06-10T19:05:51.804185+0000","last_fullsized":"2023-06-10T19:05:51.804185+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_clean_scrub_stamp":"2023-06-10T19:05:49.381507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:59:30.264463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:51.800450+0000","last_change":"2023-06-10T19:05:50.843211+0000","last_active":"2023-06-10T19:05:51.800450+0000","last_peered":"2023-06-10T19:05:51.800450+0000","last_clean":"2023-06-10T19:05:51.800450+0000","last_became_active":"2023-06-10T19:05:50.842909+0000","last_became_peered":"2023-06-10T19:05:50.842909+0000","last_unstale":"2023-06-10T19:05:51.800450+0000","last_undegraded":"2023-06-10T19:05:51.800450+0000","last_fullsized":"2023-06-10T19:05:51.800450+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:25:28.931028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":13,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:51.800156+0000","last_change":"2023-06-10T19:05:50.432563+0000","last_active":"2023-06-10T19:05:51.800156+0000","last_peered":"2023-06-10T19:05:51.800156+0000","last_clean":"2023-06-10T19:05:51.800156+0000","last_became_active":"2023-06-10T19:05:50.432211+0000","last_became_peered":"2023-06-10T19:05:50.432211+0000","last_unstale":"2023-06-10T19:05:51.800156+0000","last_undegraded":"2023-06-10T19:05:51.800156+0000","last_fullsized":"2023-06-10T19:05:51.800156+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_clean_scrub_stamp":"2023-06-10T19:05:49.381507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:05:42.815382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.682197+0000","last_change":"2023-06-10T19:05:50.862029+0000","last_active":"2023-06-10T19:05:52.682197+0000","last_peered":"2023-06-10T19:05:52.682197+0000","last_clean":"2023-06-10T19:05:52.682197+0000","last_became_active":"2023-06-10T19:05:50.861632+0000","last_became_peered":"2023-06-10T19:05:50.861632+0000","last_unstale":"2023-06-10T19:05:52.682197+0000","last_undegraded":"2023-06-10T19:05:52.682197+0000","last_fullsized":"2023-06-10T19:05:52.682197+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:39:16.537480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":13,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.733280+0000","last_change":"2023-06-10T19:05:50.453792+0000","last_active":"2023-06-10T19:05:52.733280+0000","last_peered":"2023-06-10T19:05:52.733280+0000","last_clean":"2023-06-10T19:05:52.733280+0000","last_became_active":"2023-06-10T19:05:50.452188+0000","last_became_peered":"2023-06-10T19:05:50.452188+0000","last_unstale":"2023-06-10T19:05:52.733280+0000","last_undegraded":"2023-06-10T19:05:52.733280+0000","last_fullsized":"2023-06-10T19:05:52.733280+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_clean_scrub_stamp":"2023-06-10T19:05:49.381507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:39:37.746582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:51.805686+0000","last_change":"2023-06-10T19:05:50.867820+0000","last_active":"2023-06-10T19:05:51.805686+0000","last_peered":"2023-06-10T19:05:51.805686+0000","last_clean":"2023-06-10T19:05:51.805686+0000","last_became_active":"2023-06-10T19:05:50.867157+0000","last_became_peered":"2023-06-10T19:05:50.867157+0000","last_unstale":"2023-06-10T19:05:51.805686+0000","last_undegraded":"2023-06-10T19:05:51.805686+0000","last_fullsized":"2023-06-10T19:05:51.805686+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:51:06.580829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-06-10T19:05:50.799910+0000","last_change":"2023-06-10T19:05:50.434689+0000","last_active":"2023-06-10T19:05:50.799910+0000","last_peered":"2023-06-10T19:05:50.799910+0000","last_clean":"2023-06-10T19:05:50.799910+0000","last_became_active":"2023-06-10T19:05:50.434328+0000","last_became_peered":"2023-06-10T19:05:50.434328+0000","last_unstale":"2023-06-10T19:05:50.799910+0000","last_undegraded":"2023-06-10T19:05:50.799910+0000","last_fullsized":"2023-06-10T19:05:50.799910+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_clean_scrub_stamp":"2023-06-10T19:05:49.381507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:38:08.148560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.681791+0000","last_change":"2023-06-10T19:05:50.842501+0000","last_active":"2023-06-10T19:05:52.681791+0000","last_peered":"2023-06-10T19:05:52.681791+0000","last_clean":"2023-06-10T19:05:52.681791+0000","last_became_active":"2023-06-10T19:05:50.842064+0000","last_became_peered":"2023-06-10T19:05:50.842064+0000","last_unstale":"2023-06-10T19:05:52.681791+0000","last_undegraded":"2023-06-10T19:05:52.681791+0000","last_fullsized":"2023-06-10T19:05:52.681791+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:58:44.358912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"137'2","reported_seq":15,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:51.800815+0000","last_change":"2023-06-10T19:05:50.449452+0000","last_active":"2023-06-10T19:05:51.800815+0000","last_peered":"2023-06-10T19:05:51.800815+0000","last_clean":"2023-06-10T19:05:51.800815+0000","last_became_active":"2023-06-10T19:05:50.449008+0000","last_became_peered":"2023-06-10T19:05:50.449008+0000","last_unstale":"2023-06-10T19:05:51.800815+0000","last_undegraded":"2023-06-10T19:05:51.800815+0000","last_fullsized":"2023-06-10T19:05:51.800815+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_clean_scrub_stamp":"2023-06-10T19:05:49.381507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:47:03.999183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.731719+0000","last_change":"2023-06-10T19:05:50.834910+0000","last_active":"2023-06-10T19:05:52.731719+0000","last_peered":"2023-06-10T19:05:52.731719+0000","last_clean":"2023-06-10T19:05:52.731719+0000","last_became_active":"2023-06-10T19:05:50.834146+0000","last_became_peered":"2023-06-10T19:05:50.834146+0000","last_unstale":"2023-06-10T19:05:52.731719+0000","last_undegraded":"2023-06-10T19:05:52.731719+0000","last_fullsized":"2023-06-10T19:05:52.731719+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T07:01:42.898368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":13,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:51.805082+0000","last_change":"2023-06-10T19:05:50.453769+0000","last_active":"2023-06-10T19:05:51.805082+0000","last_peered":"2023-06-10T19:05:51.805082+0000","last_clean":"2023-06-10T19:05:51.805082+0000","last_became_active":"2023-06-10T19:05:50.453037+0000","last_became_peered":"2023-06-10T19:05:50.453037+0000","last_unstale":"2023-06-10T19:05:51.805082+0000","last_undegraded":"2023-06-10T19:05:51.805082+0000","last_fullsized":"2023-06-10T19:05:51.805082+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_clean_scrub_stamp":"2023-06-10T19:05:49.381507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:50:35.970177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.732493+0000","last_change":"2023-06-10T19:05:50.867546+0000","last_active":"2023-06-10T19:05:52.732493+0000","last_peered":"2023-06-10T19:05:52.732493+0000","last_clean":"2023-06-10T19:05:52.732493+0000","last_became_active":"2023-06-10T19:05:50.867051+0000","last_became_peered":"2023-06-10T19:05:50.867051+0000","last_unstale":"2023-06-10T19:05:52.732493+0000","last_undegraded":"2023-06-10T19:05:52.732493+0000","last_fullsized":"2023-06-10T19:05:52.732493+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:16:49.161949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":13,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:51.804516+0000","last_change":"2023-06-10T19:05:50.443535+0000","last_active":"2023-06-10T19:05:51.804516+0000","last_peered":"2023-06-10T19:05:51.804516+0000","last_clean":"2023-06-10T19:05:51.804516+0000","last_became_active":"2023-06-10T19:05:50.442891+0000","last_became_peered":"2023-06-10T19:05:50.442891+0000","last_unstale":"2023-06-10T19:05:51.804516+0000","last_undegraded":"2023-06-10T19:05:51.804516+0000","last_fullsized":"2023-06-10T19:05:51.804516+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_clean_scrub_stamp":"2023-06-10T19:05:49.381507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:30:59.400403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-06-10T19:05:50.831643+0000","last_change":"2023-06-10T19:05:50.830548+0000","last_active":"2023-06-10T19:05:50.831643+0000","last_peered":"2023-06-10T19:05:50.831643+0000","last_clean":"2023-06-10T19:05:50.831643+0000","last_became_active":"2023-06-10T19:05:50.830194+0000","last_became_peered":"2023-06-10T19:05:50.830194+0000","last_unstale":"2023-06-10T19:05:50.831643+0000","last_undegraded":"2023-06-10T19:05:50.831643+0000","last_fullsized":"2023-06-10T19:05:50.831643+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:15:59.883362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-06-10T19:05:50.800658+0000","last_change":"2023-06-10T19:05:50.447472+0000","last_active":"2023-06-10T19:05:50.800658+0000","last_peered":"2023-06-10T19:05:50.800658+0000","last_clean":"2023-06-10T19:05:50.800658+0000","last_became_active":"2023-06-10T19:05:50.447197+0000","last_became_peered":"2023-06-10T19:05:50.447197+0000","last_unstale":"2023-06-10T19:05:50.800658+0000","last_undegraded":"2023-06-10T19:05:50.800658+0000","last_fullsized":"2023-06-10T19:05:50.800658+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_clean_scrub_stamp":"2023-06-10T19:05:49.381507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:26:51.554553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-06-10T19:05:50.821466+0000","last_change":"2023-06-10T19:05:50.816896+0000","last_active":"2023-06-10T19:05:50.821466+0000","last_peered":"2023-06-10T19:05:50.821466+0000","last_clean":"2023-06-10T19:05:50.821466+0000","last_became_active":"2023-06-10T19:05:50.816599+0000","last_became_peered":"2023-06-10T19:05:50.816599+0000","last_unstale":"2023-06-10T19:05:50.821466+0000","last_undegraded":"2023-06-10T19:05:50.821466+0000","last_fullsized":"2023-06-10T19:05:50.821466+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:23:07.367404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":13,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:51.804270+0000","last_change":"2023-06-10T19:05:50.442330+0000","last_active":"2023-06-10T19:05:51.804270+0000","last_peered":"2023-06-10T19:05:51.804270+0000","last_clean":"2023-06-10T19:05:51.804270+0000","last_became_active":"2023-06-10T19:05:50.441707+0000","last_became_peered":"2023-06-10T19:05:50.441707+0000","last_unstale":"2023-06-10T19:05:51.804270+0000","last_undegraded":"2023-06-10T19:05:51.804270+0000","last_fullsized":"2023-06-10T19:05:51.804270+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_clean_scrub_stamp":"2023-06-10T19:05:49.381507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:44:40.166512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-06-10T19:05:50.821493+0000","last_change":"2023-06-10T19:05:50.816923+0000","last_active":"2023-06-10T19:05:50.821493+0000","last_peered":"2023-06-10T19:05:50.821493+0000","last_clean":"2023-06-10T19:05:50.821493+0000","last_became_active":"2023-06-10T19:05:50.816585+0000","last_became_peered":"2023-06-10T19:05:50.816585+0000","last_unstale":"2023-06-10T19:05:50.821493+0000","last_undegraded":"2023-06-10T19:05:50.821493+0000","last_fullsized":"2023-06-10T19:05:50.821493+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:09:29.999840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":13,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.733591+0000","last_change":"2023-06-10T19:05:50.458803+0000","last_active":"2023-06-10T19:05:52.733591+0000","last_peered":"2023-06-10T19:05:52.733591+0000","last_clean":"2023-06-10T19:05:52.733591+0000","last_became_active":"2023-06-10T19:05:50.458147+0000","last_became_peered":"2023-06-10T19:05:50.458147+0000","last_unstale":"2023-06-10T19:05:52.733591+0000","last_undegraded":"2023-06-10T19:05:52.733591+0000","last_fullsized":"2023-06-10T19:05:52.733591+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_clean_scrub_stamp":"2023-06-10T19:05:49.381507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:18:01.608584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-06-10T19:05:50.844361+0000","last_change":"2023-06-10T19:05:50.842552+0000","last_active":"2023-06-10T19:05:50.844361+0000","last_peered":"2023-06-10T19:05:50.844361+0000","last_clean":"2023-06-10T19:05:50.844361+0000","last_became_active":"2023-06-10T19:05:50.842237+0000","last_became_peered":"2023-06-10T19:05:50.842237+0000","last_unstale":"2023-06-10T19:05:50.844361+0000","last_undegraded":"2023-06-10T19:05:50.844361+0000","last_fullsized":"2023-06-10T19:05:50.844361+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:52:14.571254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-06-10T19:05:50.799143+0000","last_change":"2023-06-10T19:05:50.447904+0000","last_active":"2023-06-10T19:05:50.799143+0000","last_peered":"2023-06-10T19:05:50.799143+0000","last_clean":"2023-06-10T19:05:50.799143+0000","last_became_active":"2023-06-10T19:05:50.447541+0000","last_became_peered":"2023-06-10T19:05:50.447541+0000","last_unstale":"2023-06-10T19:05:50.799143+0000","last_undegraded":"2023-06-10T19:05:50.799143+0000","last_fullsized":"2023-06-10T19:05:50.799143+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_clean_scrub_stamp":"2023-06-10T19:05:49.381507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:46:51.181220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.732797+0000","last_change":"2023-06-10T19:05:50.868384+0000","last_active":"2023-06-10T19:05:52.732797+0000","last_peered":"2023-06-10T19:05:52.732797+0000","last_clean":"2023-06-10T19:05:52.732797+0000","last_became_active":"2023-06-10T19:05:50.867929+0000","last_became_peered":"2023-06-10T19:05:50.867929+0000","last_unstale":"2023-06-10T19:05:52.732797+0000","last_undegraded":"2023-06-10T19:05:52.732797+0000","last_fullsized":"2023-06-10T19:05:52.732797+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:36:59.494746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":13,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.682108+0000","last_change":"2023-06-10T19:05:50.451025+0000","last_active":"2023-06-10T19:05:52.682108+0000","last_peered":"2023-06-10T19:05:52.682108+0000","last_clean":"2023-06-10T19:05:52.682108+0000","last_became_active":"2023-06-10T19:05:50.450409+0000","last_became_peered":"2023-06-10T19:05:50.450409+0000","last_unstale":"2023-06-10T19:05:52.682108+0000","last_undegraded":"2023-06-10T19:05:52.682108+0000","last_fullsized":"2023-06-10T19:05:52.682108+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_clean_scrub_stamp":"2023-06-10T19:05:49.381507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:39:57.962477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.734653+0000","last_change":"2023-06-10T19:05:50.860202+0000","last_active":"2023-06-10T19:05:52.734653+0000","last_peered":"2023-06-10T19:05:52.734653+0000","last_clean":"2023-06-10T19:05:52.734653+0000","last_became_active":"2023-06-10T19:05:50.859562+0000","last_became_peered":"2023-06-10T19:05:50.859562+0000","last_unstale":"2023-06-10T19:05:52.734653+0000","last_undegraded":"2023-06-10T19:05:52.734653+0000","last_fullsized":"2023-06-10T19:05:52.734653+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:35:57.380078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":13,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.732878+0000","last_change":"2023-06-10T19:05:50.453894+0000","last_active":"2023-06-10T19:05:52.732878+0000","last_peered":"2023-06-10T19:05:52.732878+0000","last_clean":"2023-06-10T19:05:52.732878+0000","last_became_active":"2023-06-10T19:05:50.453018+0000","last_became_peered":"2023-06-10T19:05:50.453018+0000","last_unstale":"2023-06-10T19:05:52.732878+0000","last_undegraded":"2023-06-10T19:05:52.732878+0000","last_fullsized":"2023-06-10T19:05:52.732878+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_clean_scrub_stamp":"2023-06-10T19:05:49.381507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:53:51.880254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":373,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.733610+0000","last_change":"2023-06-10T18:52:34.951528+0000","last_active":"2023-06-10T19:05:52.733610+0000","last_peered":"2023-06-10T19:05:52.733610+0000","last_clean":"2023-06-10T19:05:52.733610+0000","last_became_active":"2023-06-10T18:52:34.949099+0000","last_became_peered":"2023-06-10T18:52:34.949099+0000","last_unstale":"2023-06-10T19:05:52.733610+0000","last_undegraded":"2023-06-10T19:05:52.733610+0000","last_fullsized":"2023-06-10T19:05:52.733610+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_clean_scrub_stamp":"2023-06-10T18:52:33.633295+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:19:12.275959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":231,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:51.804299+0000","last_change":"2023-06-10T18:52:40.506384+0000","last_active":"2023-06-10T19:05:51.804299+0000","last_peered":"2023-06-10T19:05:51.804299+0000","last_clean":"2023-06-10T19:05:51.804299+0000","last_became_active":"2023-06-10T18:52:40.505701+0000","last_became_peered":"2023-06-10T18:52:40.505701+0000","last_unstale":"2023-06-10T19:05:51.804299+0000","last_undegraded":"2023-06-10T19:05:51.804299+0000","last_fullsized":"2023-06-10T19:05:51.804299+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:09:56.446628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.732912+0000","last_change":"2023-06-10T19:05:50.854701+0000","last_active":"2023-06-10T19:05:52.732912+0000","last_peered":"2023-06-10T19:05:52.732912+0000","last_clean":"2023-06-10T19:05:52.732912+0000","last_became_active":"2023-06-10T19:05:50.854025+0000","last_became_peered":"2023-06-10T19:05:50.854025+0000","last_unstale":"2023-06-10T19:05:52.732912+0000","last_undegraded":"2023-06-10T19:05:52.732912+0000","last_fullsized":"2023-06-10T19:05:52.732912+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:32:38.724560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":13,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.731793+0000","last_change":"2023-06-10T19:05:50.448946+0000","last_active":"2023-06-10T19:05:52.731793+0000","last_peered":"2023-06-10T19:05:52.731793+0000","last_clean":"2023-06-10T19:05:52.731793+0000","last_became_active":"2023-06-10T19:05:50.448251+0000","last_became_peered":"2023-06-10T19:05:50.448251+0000","last_unstale":"2023-06-10T19:05:52.731793+0000","last_undegraded":"2023-06-10T19:05:52.731793+0000","last_fullsized":"2023-06-10T19:05:52.731793+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_clean_scrub_stamp":"2023-06-10T19:05:49.381507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:28:14.719948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":217,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.733366+0000","last_change":"2023-06-10T18:52:40.512015+0000","last_active":"2023-06-10T19:05:52.733366+0000","last_peered":"2023-06-10T19:05:52.733366+0000","last_clean":"2023-06-10T19:05:52.733366+0000","last_became_active":"2023-06-10T18:52:40.511382+0000","last_became_peered":"2023-06-10T18:52:40.511382+0000","last_unstale":"2023-06-10T19:05:52.733366+0000","last_undegraded":"2023-06-10T19:05:52.733366+0000","last_fullsized":"2023-06-10T19:05:52.733366+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:53:32.110170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.682262+0000","last_change":"2023-06-10T19:05:50.811602+0000","last_active":"2023-06-10T19:05:52.682262+0000","last_peered":"2023-06-10T19:05:52.682262+0000","last_clean":"2023-06-10T19:05:52.682262+0000","last_became_active":"2023-06-10T19:05:50.811327+0000","last_became_peered":"2023-06-10T19:05:50.811327+0000","last_unstale":"2023-06-10T19:05:52.682262+0000","last_undegraded":"2023-06-10T19:05:52.682262+0000","last_fullsized":"2023-06-10T19:05:52.682262+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:46:56.030274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"137'8","reported_seq":19,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-06-10T19:05:50.865517+0000","last_change":"2023-06-10T19:05:50.450791+0000","last_active":"2023-06-10T19:05:50.865517+0000","last_peered":"2023-06-10T19:05:50.865517+0000","last_clean":"2023-06-10T19:05:50.865517+0000","last_became_active":"2023-06-10T19:05:50.450411+0000","last_became_peered":"2023-06-10T19:05:50.450411+0000","last_unstale":"2023-06-10T19:05:50.865517+0000","last_undegraded":"2023-06-10T19:05:50.865517+0000","last_fullsized":"2023-06-10T19:05:50.865517+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_clean_scrub_stamp":"2023-06-10T19:05:49.381507+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:42:29.198130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":231,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:51.799788+0000","last_change":"2023-06-10T18:52:40.671725+0000","last_active":"2023-06-10T19:05:51.799788+0000","last_peered":"2023-06-10T19:05:51.799788+0000","last_clean":"2023-06-10T19:05:51.799788+0000","last_became_active":"2023-06-10T18:52:40.671442+0000","last_became_peered":"2023-06-10T18:52:40.671442+0000","last_unstale":"2023-06-10T19:05:51.799788+0000","last_undegraded":"2023-06-10T19:05:51.799788+0000","last_fullsized":"2023-06-10T19:05:51.799788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:38:26.504917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-06-10T19:05:50.821286+0000","last_change":"2023-06-10T19:05:50.817246+0000","last_active":"2023-06-10T19:05:50.821286+0000","last_peered":"2023-06-10T19:05:50.821286+0000","last_clean":"2023-06-10T19:05:50.821286+0000","last_became_active":"2023-06-10T19:05:50.816818+0000","last_became_peered":"2023-06-10T19:05:50.816818+0000","last_unstale":"2023-06-10T19:05:50.821286+0000","last_undegraded":"2023-06-10T19:05:50.821286+0000","last_fullsized":"2023-06-10T19:05:50.821286+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:26:16.079224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"137'2","reported_seq":15,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:51.800137+0000","last_change":"2023-06-10T19:05:50.424153+0000","last_active":"2023-06-10T19:05:51.800137+0000","last_peered":"2023-06-10T19:05:51.800137+0000","last_clean":"2023-06-10T19:05:51.800137+0000","last_became_active":"2023-06-10T19:05:50.422802+0000","last_became_peered":"2023-06-10T19:05:50.422802+0000","last_unstale":"2023-06-10T19:05:51.800137+0000","last_undegraded":"2023-06-10T19:05:51.800137+0000","last_fullsized":"2023-06-10T19:05:51.800137+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_clean_scrub_stamp":"2023-06-10T19:05:49.381507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:37:50.905105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":231,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:51.803216+0000","last_change":"2023-06-10T18:52:40.510258+0000","last_active":"2023-06-10T19:05:51.803216+0000","last_peered":"2023-06-10T19:05:51.803216+0000","last_clean":"2023-06-10T19:05:51.803216+0000","last_became_active":"2023-06-10T18:52:40.509560+0000","last_became_peered":"2023-06-10T18:52:40.509560+0000","last_unstale":"2023-06-10T19:05:51.803216+0000","last_undegraded":"2023-06-10T19:05:51.803216+0000","last_fullsized":"2023-06-10T19:05:51.803216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:29:19.291465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.732123+0000","last_change":"2023-06-10T19:05:50.849759+0000","last_active":"2023-06-10T19:05:52.732123+0000","last_peered":"2023-06-10T19:05:52.732123+0000","last_clean":"2023-06-10T19:05:52.732123+0000","last_became_active":"2023-06-10T19:05:50.849111+0000","last_became_peered":"2023-06-10T19:05:50.849111+0000","last_unstale":"2023-06-10T19:05:52.732123+0000","last_undegraded":"2023-06-10T19:05:52.732123+0000","last_fullsized":"2023-06-10T19:05:52.732123+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:13:48.609493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"137'3","reported_seq":16,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.734047+0000","last_change":"2023-06-10T19:05:50.459724+0000","last_active":"2023-06-10T19:05:52.734047+0000","last_peered":"2023-06-10T19:05:52.734047+0000","last_clean":"2023-06-10T19:05:52.734047+0000","last_became_active":"2023-06-10T19:05:50.459161+0000","last_became_peered":"2023-06-10T19:05:50.459161+0000","last_unstale":"2023-06-10T19:05:52.734047+0000","last_undegraded":"2023-06-10T19:05:52.734047+0000","last_fullsized":"2023-06-10T19:05:52.734047+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_clean_scrub_stamp":"2023-06-10T19:05:49.381507+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:40:54.535176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":217,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-06-10T19:05:50.800741+0000","last_change":"2023-06-10T18:52:40.672266+0000","last_active":"2023-06-10T19:05:50.800741+0000","last_peered":"2023-06-10T19:05:50.800741+0000","last_clean":"2023-06-10T19:05:50.800741+0000","last_became_active":"2023-06-10T18:52:40.671966+0000","last_became_peered":"2023-06-10T18:52:40.671966+0000","last_unstale":"2023-06-10T19:05:50.800741+0000","last_undegraded":"2023-06-10T19:05:50.800741+0000","last_fullsized":"2023-06-10T19:05:50.800741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:37:46.363869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.734447+0000","last_change":"2023-06-10T19:05:50.863094+0000","last_active":"2023-06-10T19:05:52.734447+0000","last_peered":"2023-06-10T19:05:52.734447+0000","last_clean":"2023-06-10T19:05:52.734447+0000","last_became_active":"2023-06-10T19:05:50.861829+0000","last_became_peered":"2023-06-10T19:05:50.861829+0000","last_unstale":"2023-06-10T19:05:52.734447+0000","last_undegraded":"2023-06-10T19:05:52.734447+0000","last_fullsized":"2023-06-10T19:05:52.734447+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:16:14.220941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"137'6","reported_seq":19,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.733225+0000","last_change":"2023-06-10T19:05:50.452823+0000","last_active":"2023-06-10T19:05:52.733225+0000","last_peered":"2023-06-10T19:05:52.733225+0000","last_clean":"2023-06-10T19:05:52.733225+0000","last_became_active":"2023-06-10T19:05:50.452363+0000","last_became_peered":"2023-06-10T19:05:50.452363+0000","last_unstale":"2023-06-10T19:05:52.733225+0000","last_undegraded":"2023-06-10T19:05:52.733225+0000","last_fullsized":"2023-06-10T19:05:52.733225+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_clean_scrub_stamp":"2023-06-10T19:05:49.381507+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:01:03.823283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":217,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.733912+0000","last_change":"2023-06-10T18:52:40.671084+0000","last_active":"2023-06-10T19:05:52.733912+0000","last_peered":"2023-06-10T19:05:52.733912+0000","last_clean":"2023-06-10T19:05:52.733912+0000","last_became_active":"2023-06-10T18:52:40.670697+0000","last_became_peered":"2023-06-10T18:52:40.670697+0000","last_unstale":"2023-06-10T19:05:52.733912+0000","last_undegraded":"2023-06-10T19:05:52.733912+0000","last_fullsized":"2023-06-10T19:05:52.733912+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:04:09.898647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:51.799774+0000","last_change":"2023-06-10T19:05:50.863850+0000","last_active":"2023-06-10T19:05:51.799774+0000","last_peered":"2023-06-10T19:05:51.799774+0000","last_clean":"2023-06-10T19:05:51.799774+0000","last_became_active":"2023-06-10T19:05:50.863076+0000","last_became_peered":"2023-06-10T19:05:50.863076+0000","last_unstale":"2023-06-10T19:05:51.799774+0000","last_undegraded":"2023-06-10T19:05:51.799774+0000","last_fullsized":"2023-06-10T19:05:51.799774+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:12:46.361782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":13,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:51.805742+0000","last_change":"2023-06-10T19:05:50.439616+0000","last_active":"2023-06-10T19:05:51.805742+0000","last_peered":"2023-06-10T19:05:51.805742+0000","last_clean":"2023-06-10T19:05:51.805742+0000","last_became_active":"2023-06-10T19:05:50.437229+0000","last_became_peered":"2023-06-10T19:05:50.437229+0000","last_unstale":"2023-06-10T19:05:51.805742+0000","last_undegraded":"2023-06-10T19:05:51.805742+0000","last_fullsized":"2023-06-10T19:05:51.805742+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_clean_scrub_stamp":"2023-06-10T19:05:49.381507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:39:53.195805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":217,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-06-10T19:05:50.799652+0000","last_change":"2023-06-10T18:52:40.514114+0000","last_active":"2023-06-10T19:05:50.799652+0000","last_peered":"2023-06-10T19:05:50.799652+0000","last_clean":"2023-06-10T19:05:50.799652+0000","last_became_active":"2023-06-10T18:52:40.513638+0000","last_became_peered":"2023-06-10T18:52:40.513638+0000","last_unstale":"2023-06-10T19:05:50.799652+0000","last_undegraded":"2023-06-10T19:05:50.799652+0000","last_fullsized":"2023-06-10T19:05:50.799652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:25:01.720343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-06-10T19:05:50.820651+0000","last_change":"2023-06-10T19:05:50.812128+0000","last_active":"2023-06-10T19:05:50.820651+0000","last_peered":"2023-06-10T19:05:50.820651+0000","last_clean":"2023-06-10T19:05:50.820651+0000","last_became_active":"2023-06-10T19:05:50.811730+0000","last_became_peered":"2023-06-10T19:05:50.811730+0000","last_unstale":"2023-06-10T19:05:50.820651+0000","last_undegraded":"2023-06-10T19:05:50.820651+0000","last_fullsized":"2023-06-10T19:05:50.820651+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:07:02.577307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":13,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:51.800699+0000","last_change":"2023-06-10T19:05:50.434211+0000","last_active":"2023-06-10T19:05:51.800699+0000","last_peered":"2023-06-10T19:05:51.800699+0000","last_clean":"2023-06-10T19:05:51.800699+0000","last_became_active":"2023-06-10T19:05:50.433897+0000","last_became_peered":"2023-06-10T19:05:50.433897+0000","last_unstale":"2023-06-10T19:05:51.800699+0000","last_undegraded":"2023-06-10T19:05:51.800699+0000","last_fullsized":"2023-06-10T19:05:51.800699+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_clean_scrub_stamp":"2023-06-10T19:05:49.381507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:24:34.025371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":219,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.735001+0000","last_change":"2023-06-10T18:52:40.515396+0000","last_active":"2023-06-10T19:05:52.735001+0000","last_peered":"2023-06-10T19:05:52.735001+0000","last_clean":"2023-06-10T19:05:52.735001+0000","last_became_active":"2023-06-10T18:52:40.514663+0000","last_became_peered":"2023-06-10T18:52:40.514663+0000","last_unstale":"2023-06-10T19:05:52.735001+0000","last_undegraded":"2023-06-10T19:05:52.735001+0000","last_fullsized":"2023-06-10T19:05:52.735001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:12:56.279905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575011,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33312,"kb_used_data":2264,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338528,"statfs":{"total":96636764160,"available":96602652672,"internally_reserved":0,"allocated":2318336,"data_stored":1384792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:05:00 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.93999999999999995,"15min":0.91800000000000004},"min":{"1min":0.53600000000000003,"5min":0.49399999999999999,"15min":0.434},"max":{"1min":1.351,"5min":1.351,"15min":1.6220000000000001},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.92000000000000004,"15min":0.92700000000000005},"min":{"1min":0.59599999999999997,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.153,"5min":1.2909999999999999,"15min":1.6870000000000001},"last":0.57799999999999996}]},{"osd":1,"last update":"Sat Jun 10 19:05:00 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.90700000000000003,"15min":0.91900000000000004},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1759999999999999,"5min":1.238,"15min":1.377},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.92900000000000005,"15min":0.94099999999999995},"min":{"1min":0.60399999999999998,"5min":0.51300000000000001,"15min":0.504},"max":{"1min":1.214,"5min":1.238,"15min":1.5960000000000001},"last":0.67800000000000005}]},{"osd":2,"last update":"Sat Jun 10 19:05:00 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.86399999999999999,"15min":0.84799999999999998},"min":{"1min":0.58599999999999997,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.26,"5min":1.26,"15min":1.4059999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.91900000000000004,"15min":0.90200000000000002},"min":{"1min":0.70799999999999996,"5min":0.54100000000000004,"15min":0.50600000000000001},"max":{"1min":1.3100000000000001,"5min":1.448,"15min":1.448},"last":0.78300000000000003}]},{"osd":3,"last update":"Sat Jun 10 19:05:00 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.90300000000000002,"15min":0.91500000000000004},"min":{"1min":0.68300000000000005,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.1539999999999999,"5min":1.2370000000000001,"15min":1.502},"last":0.82999999999999996},{"interface":"front","average":{"1min":1.0489999999999999,"5min":0.97799999999999998,"15min":0.95499999999999996},"min":{"1min":0.85599999999999998,"5min":0.432,"15min":0.432},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.86299999999999999}]},{"osd":4,"last update":"Sat Jun 10 19:05:00 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.82099999999999995,"15min":0.84899999999999998},"min":{"1min":0.64500000000000002,"5min":0.307,"15min":0.307},"max":{"1min":1.145,"5min":1.2210000000000001,"15min":1.639},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.998,"5min":0.96499999999999997,"15min":0.96599999999999997},"min":{"1min":0.70999999999999996,"5min":0.41199999999999998,"15min":0.40000000000000002},"max":{"1min":1.218,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.0920000000000001}]},{"osd":5,"last update":"Sat Jun 10 19:05:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1,"15min":1.0089999999999999},"min":{"1min":0.72899999999999998,"5min":0.40500000000000003,"15min":0.38400000000000001},"max":{"1min":1.3100000000000001,"5min":1.379,"15min":1.806},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0269999999999999,"15min":1.034},"min":{"1min":0.67500000000000004,"5min":0.48499999999999999,"15min":0.46500000000000002},"max":{"1min":1.3,"5min":1.579,"15min":1.579},"last":0.96799999999999997}]},{"osd":6,"last update":"Sat Jun 10 19:05:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.006,"15min":1.0069999999999999},"min":{"1min":0.70399999999999996,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.274,"5min":1.391,"15min":1.718},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.0940000000000001,"15min":1.0940000000000001},"min":{"1min":0.91000000000000003,"5min":0.48799999999999999,"15min":0.441},"max":{"1min":1.5129999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":1.0429999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575012,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32724,"kb_used_data":1676,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339116,"statfs":{"total":96636764160,"available":96603254784,"internally_reserved":0,"allocated":1716224,"data_stored":793442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:04:50 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.84499999999999997,"15min":0.85799999999999998},"min":{"1min":0.64600000000000002,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.498},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.87,"15min":0.876},"min":{"1min":0.63100000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.175,"5min":1.2250000000000001,"15min":1.496},"last":0.66800000000000004}]},{"osd":1,"last update":"Sat Jun 10 19:04:50 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.86299999999999999,"15min":0.86699999999999999},"min":{"1min":0.51500000000000001,"5min":0.502,"15min":0.48699999999999999},"max":{"1min":1.163,"5min":1.163,"15min":1.5229999999999999},"last":0.872},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.90100000000000002,"15min":0.89600000000000002},"min":{"1min":0.61599999999999999,"5min":0.48699999999999999,"15min":0.45300000000000001},"max":{"1min":1.204,"5min":1.258,"15min":1.778},"last":0.83299999999999996}]},{"osd":2,"last update":"Sat Jun 10 19:04:50 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.92600000000000005,"15min":0.89800000000000002},"min":{"1min":0.55200000000000005,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.224,"5min":1.2809999999999999,"15min":1.3759999999999999},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.88,"15min":0.88800000000000001},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.145,"5min":1.2330000000000001,"15min":1.246},"last":0.61299999999999999}]},{"osd":3,"last update":"Sat Jun 10 19:04:50 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.92500000000000004,"15min":0.91100000000000003},"min":{"1min":0.72199999999999998,"5min":0.55100000000000005,"15min":0.52700000000000002},"max":{"1min":1.161,"5min":1.238,"15min":1.7190000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.97499999999999998,"15min":0.98999999999999999},"min":{"1min":0.68100000000000005,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.22,"5min":1.371,"15min":1.4370000000000001},"last":0.98099999999999998}]},{"osd":4,"last update":"Sat Jun 10 19:04:50 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.89300000000000002,"15min":0.91600000000000004},"min":{"1min":0.45900000000000002,"5min":0.373,"15min":0.373},"max":{"1min":1.167,"5min":1.401,"15min":1.798},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.98099999999999998,"15min":0.98799999999999999},"min":{"1min":0.52800000000000002,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.2669999999999999,"5min":1.357,"15min":1.5489999999999999},"last":1.0649999999999999}]},{"osd":5,"last update":"Sat Jun 10 19:04:50 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.90300000000000002,"15min":0.92100000000000004},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.163,"5min":1.29,"15min":1.333},"last":1.0940000000000001},{"interface":"front","average":{"1min":0.98299999999999998,"5min":1.004,"15min":1.022},"min":{"1min":0.50700000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.296,"5min":1.296,"15min":2.536},"last":1.028}]},{"osd":7,"last update":"Sat Jun 10 19:04:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.0429999999999999,"15min":1.0349999999999999},"min":{"1min":0.59199999999999997,"5min":0.58599999999999997,"15min":0.57099999999999995},"max":{"1min":1.3029999999999999,"5min":1.879,"15min":1.917},"last":1.155},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.98599999999999999,"15min":1.0169999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.258,"5min":1.4850000000000001,"15min":1.5569999999999999},"last":1.179}]}]},{"osd":5,"up_from":13,"seq":55834575012,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32732,"kb_used_data":1684,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339108,"statfs":{"total":96636764160,"available":96603246592,"internally_reserved":0,"allocated":1724416,"data_stored":799445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.877,"15min":0.873},"min":{"1min":0.51500000000000001,"5min":0.499,"15min":0.499},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.94199999999999995,"15min":0.91800000000000004},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.49399999999999999},"max":{"1min":1.212,"5min":2.347,"15min":2.347},"last":1.093}]},{"osd":1,"last update":"Sat Jun 10 19:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.96299999999999997,"15min":0.91900000000000004},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.52600000000000002},"max":{"1min":1.6739999999999999,"5min":7.0800000000000001,"15min":7.0800000000000001},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.86499999999999999,"5min":1.117,"15min":0.98399999999999999},"min":{"1min":0.59599999999999997,"5min":0.56499999999999995,"15min":0.53800000000000003},"max":{"1min":1.171,"5min":15.845000000000001,"15min":15.845000000000001},"last":1.1319999999999999}]},{"osd":2,"last update":"Sat Jun 10 19:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.94999999999999996,"15min":0.89400000000000002},"min":{"1min":0.59899999999999998,"5min":0.54300000000000004,"15min":0.48299999999999998},"max":{"1min":1.6459999999999999,"5min":5.0049999999999999,"15min":5.0049999999999999},"last":1.012},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.99299999999999999,"15min":0.94499999999999995},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.391,"5min":6.851,"15min":6.851},"last":0.86399999999999999}]},{"osd":3,"last update":"Sat Jun 10 19:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.96799999999999997,"15min":0.95599999999999996},"min":{"1min":0.58699999999999997,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.6910000000000001,"5min":2.544,"15min":2.544},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.98299999999999998,"5min":1.004,"15min":0.999},"min":{"1min":0.66000000000000003,"5min":0.63100000000000001,"15min":0.59799999999999998},"max":{"1min":1.4870000000000001,"5min":3.0830000000000002,"15min":3.0830000000000002},"last":1.1659999999999999}]},{"osd":4,"last update":"Sat Jun 10 19:05:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.012,"15min":0.95699999999999996},"min":{"1min":0.65300000000000002,"5min":0.64000000000000001,"15min":0.58099999999999996},"max":{"1min":1.6140000000000001,"5min":6.7290000000000001,"15min":6.7290000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.97399999999999998,"15min":0.99399999999999999},"min":{"1min":0.70199999999999996,"5min":0.64900000000000002,"15min":0.61199999999999999},"max":{"1min":1.446,"5min":1.446,"15min":1.575},"last":0.97999999999999998}]},{"osd":6,"last update":"Sat Jun 10 19:05:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":0.98999999999999999,"15min":0.997},"min":{"1min":0.65300000000000002,"5min":0.60499999999999998,"15min":0.54200000000000004},"max":{"1min":1.8009999999999999,"5min":1.8009999999999999,"15min":1.8009999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.105,"15min":1.0600000000000001},"min":{"1min":0.73299999999999998,"5min":0.71999999999999997,"15min":0.57899999999999996},"max":{"1min":1.8380000000000001,"5min":6.923,"15min":6.923},"last":0.92000000000000004}]},{"osd":7,"last update":"Sat Jun 10 19:05:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.101,"15min":1.095},"min":{"1min":0.70699999999999996,"5min":0.69899999999999995,"15min":0.66200000000000003},"max":{"1min":1.7749999999999999,"5min":2.6080000000000001,"15min":2.6080000000000001},"last":1.0589999999999999},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1850000000000001,"15min":1.143},"min":{"1min":0.84399999999999997,"5min":0.72499999999999998,"15min":0.66200000000000003},"max":{"1min":1.732,"5min":5.4169999999999998,"15min":5.4169999999999998},"last":0.94399999999999995}]}]},{"osd":4,"up_from":13,"seq":55834575011,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32728,"kb_used_data":1680,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339112,"statfs":{"total":96636764160,"available":96603250688,"internally_reserved":0,"allocated":1720320,"data_stored":799423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.84999999999999998,"15min":0.82299999999999995},"min":{"1min":0.52800000000000002,"5min":0.45400000000000001,"15min":0.45100000000000001},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.88500000000000001,"15min":0.90400000000000003},"min":{"1min":0.67200000000000004,"5min":0.49199999999999999,"15min":0.48899999999999999},"max":{"1min":1.196,"5min":1.3979999999999999,"15min":3.7280000000000002},"last":0.99299999999999999}]},{"osd":1,"last update":"Sat Jun 10 19:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.91300000000000003,"15min":0.94099999999999995},"min":{"1min":0.49199999999999999,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":3.3969999999999998},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.878,"5min":0.83699999999999997,"15min":0.85999999999999999},"min":{"1min":0.58399999999999996,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":2.496},"last":0.47899999999999998}]},{"osd":2,"last update":"Sat Jun 10 19:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.873,"15min":0.88300000000000001},"min":{"1min":0.53400000000000003,"5min":0.52200000000000002,"15min":0.49299999999999999},"max":{"1min":1.143,"5min":1.3,"15min":1.522},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.96699999999999997,"15min":0.99199999999999999},"min":{"1min":0.70899999999999996,"5min":0.64400000000000002,"15min":0.55000000000000004},"max":{"1min":1.169,"5min":1.2649999999999999,"15min":3.5750000000000002},"last":0.93799999999999994}]},{"osd":3,"last update":"Sat Jun 10 19:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.90400000000000003,"15min":0.89900000000000002},"min":{"1min":0.628,"5min":0.56200000000000006,"15min":0.53900000000000003},"max":{"1min":1.28,"5min":1.46,"15min":2.3809999999999998},"last":0.68799999999999994},{"interface":"front","average":{"1min":1.028,"5min":0.95699999999999996,"15min":0.96499999999999997},"min":{"1min":0.71899999999999997,"5min":0.61499999999999999,"15min":0.54400000000000004},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.6479999999999999},"last":1.014}]},{"osd":5,"last update":"Sat Jun 10 19:05:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":0.94499999999999995,"15min":0.96599999999999997},"min":{"1min":0.70399999999999996,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.236,"5min":1.3360000000000001,"15min":3.6539999999999999},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.92500000000000004,"15min":0.95099999999999996},"min":{"1min":0.65800000000000003,"5min":0.495,"15min":0.495},"max":{"1min":1.2250000000000001,"5min":1.26,"15min":2.6720000000000002},"last":0.60499999999999998}]},{"osd":6,"last update":"Sat Jun 10 19:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.97499999999999998,"15min":0.98099999999999998},"min":{"1min":0.60399999999999998,"5min":0.58499999999999996,"15min":0.54900000000000004},"max":{"1min":1.413,"5min":1.413,"15min":2.2639999999999998},"last":0.89400000000000002},{"interface":"front","average":{"1min":1.131,"5min":1.0649999999999999,"15min":1.071},"min":{"1min":0.753,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":3.4980000000000002},"last":0.63200000000000001}]},{"osd":7,"last update":"Sat Jun 10 19:05:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.0189999999999999,"15min":0.999},"min":{"1min":0.79100000000000004,"5min":0.63800000000000001,"15min":0.41399999999999998},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":2.5910000000000002},"last":0.83299999999999996},{"interface":"front","average":{"1min":1.105,"5min":1.0780000000000001,"15min":1.0720000000000001},"min":{"1min":0.79900000000000004,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.3420000000000001,"5min":1.4279999999999999,"15min":1.4399999999999999},"last":1.0660000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575010,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36824,"kb_used_data":1680,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335016,"statfs":{"total":96636764160,"available":96599056384,"internally_reserved":0,"allocated":1720320,"data_stored":793385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.63900000000000001,"15min":0.62},"min":{"1min":0.42099999999999999,"5min":0.248,"15min":0.248},"max":{"1min":0.99299999999999999,"5min":1.1539999999999999,"15min":1.169},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.67500000000000004,"15min":0.66800000000000004},"min":{"1min":0.318,"5min":0.30299999999999999,"15min":0.251},"max":{"1min":0.96899999999999997,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.84799999999999998}]},{"osd":1,"last update":"Sat Jun 10 19:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.69299999999999995,"15min":0.67900000000000005},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.27500000000000002},"max":{"1min":0.98799999999999999,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.71299999999999997,"15min":0.73199999999999998},"min":{"1min":0.35499999999999998,"5min":0.34399999999999997,"15min":0.318},"max":{"1min":0.89700000000000002,"5min":1.2569999999999999,"15min":1.411},"last":0.89700000000000002}]},{"osd":2,"last update":"Sat Jun 10 19:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.75600000000000001,"15min":0.77400000000000002},"min":{"1min":0.40699999999999997,"5min":0.39300000000000002,"15min":0.30299999999999999},"max":{"1min":1.155,"5min":1.2829999999999999,"15min":1.9530000000000001},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.81299999999999994,"15min":0.79000000000000004},"min":{"1min":0.39200000000000002,"5min":0.35299999999999998,"15min":0.29699999999999999},"max":{"1min":1.2769999999999999,"5min":1.591,"15min":1.591},"last":1.0329999999999999}]},{"osd":4,"last update":"Sat Jun 10 19:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.96599999999999997,"15min":0.95599999999999996},"min":{"1min":0.67800000000000005,"5min":0.60899999999999999,"15min":0.41899999999999998},"max":{"1min":1.333,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":1.333},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.98899999999999999,"15min":0.99199999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.47999999999999998},"max":{"1min":1.2110000000000001,"5min":1.873,"15min":1.873},"last":0.95799999999999996}]},{"osd":5,"last update":"Sat Jun 10 19:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":1.004,"15min":1.0169999999999999},"min":{"1min":0.55900000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.3120000000000001,"5min":1.752,"15min":2.024},"last":1.165},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0369999999999999,"15min":1.0309999999999999},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.46899999999999997},"max":{"1min":1.337,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":1.282}]},{"osd":6,"last update":"Sat Jun 10 19:05:52 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.0669999999999999,"15min":1.0609999999999999},"min":{"1min":0.625,"5min":0.56999999999999995,"15min":0.55300000000000005},"max":{"1min":1.258,"5min":1.786,"15min":1.8500000000000001},"last":1.123},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0589999999999999,"15min":1.0580000000000001},"min":{"1min":0.69499999999999995,"5min":0.61199999999999999,"15min":0.58799999999999997},"max":{"1min":1.3029999999999999,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":1.081}]},{"osd":7,"last update":"Sat Jun 10 19:05:52 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.0800000000000001,"15min":1.093},"min":{"1min":0.77200000000000002,"5min":0.57999999999999996,"15min":0.56999999999999995},"max":{"1min":1.27,"5min":2.1150000000000002,"15min":2.1150000000000002},"last":1.2110000000000001},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.089,"15min":1.0960000000000001},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.61099999999999999},"max":{"1min":1.3129999999999999,"5min":1.9850000000000001,"15min":1.9850000000000001},"last":1.242}]}]},{"osd":2,"up_from":13,"seq":55834575011,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32736,"kb_used_data":1688,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339104,"statfs":{"total":96636764160,"available":96603242496,"internally_reserved":0,"allocated":1728512,"data_stored":800039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:04:59 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.621,"15min":0.61299999999999999},"min":{"1min":0.33700000000000002,"5min":0.31,"15min":0.27300000000000002},"max":{"1min":0.98799999999999999,"5min":1.095,"15min":1.1220000000000001},"last":2.883},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.71699999999999997,"15min":0.72199999999999998},"min":{"1min":0.34999999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":6.5670000000000002}]},{"osd":1,"last update":"Sat Jun 10 19:04:59 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.65900000000000003,"15min":0.66600000000000004},"min":{"1min":0.39600000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.1950000000000001},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.745,"15min":0.748},"min":{"1min":0.375,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.1799999999999999,"5min":1.446,"15min":1.446},"last":8.4429999999999996}]},{"osd":3,"last update":"Sat Jun 10 19:04:59 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.78200000000000003,"15min":0.76900000000000002},"min":{"1min":0.45700000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.127,"5min":1.1899999999999999,"15min":1.2350000000000001},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.75800000000000001,"15min":0.77200000000000002},"min":{"1min":0.41799999999999998,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":1.032,"5min":1.181,"15min":1.3340000000000001},"last":4.1849999999999996}]},{"osd":4,"last update":"Sat Jun 10 19:04:59 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.90800000000000003,"15min":0.92500000000000004},"min":{"1min":0.67600000000000005,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.337,"5min":1.337,"15min":1.3620000000000001},"last":2.8420000000000001},{"interface":"front","average":{"1min":1.044,"5min":0.996,"15min":1.0169999999999999},"min":{"1min":0.59699999999999998,"5min":0.496,"15min":0.496},"max":{"1min":1.3149999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":13.254}]},{"osd":5,"last update":"Sat Jun 10 19:04:59 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":0.997,"15min":1.0129999999999999},"min":{"1min":0.63400000000000001,"5min":0.55900000000000005,"15min":0.54100000000000004},"max":{"1min":1.3129999999999999,"5min":1.5429999999999999,"15min":1.5700000000000001},"last":6.9189999999999996},{"interface":"front","average":{"1min":1.105,"5min":1.01,"15min":1.014},"min":{"1min":0.753,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.5309999999999999,"5min":1.5609999999999999,"15min":1.667},"last":15.526}]},{"osd":6,"last update":"Sat Jun 10 19:04:59 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.03,"15min":1.044},"min":{"1min":0.77800000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.5900000000000001},"last":8.7089999999999996},{"interface":"front","average":{"1min":1.054,"5min":1.0309999999999999,"15min":1.0449999999999999},"min":{"1min":0.58499999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.341,"5min":1.486,"15min":1.6499999999999999},"last":6.1299999999999999}]},{"osd":7,"last update":"Sat Jun 10 19:04:59 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.097,"15min":1.1000000000000001},"min":{"1min":0.70499999999999996,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.339,"5min":1.734,"15min":1.734},"last":10.760999999999999},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.101,"15min":1.109},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.48,"5min":1.657,"15min":1.752},"last":0.56299999999999994}]}]},{"osd":1,"up_from":13,"seq":55834575013,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36812,"kb_used_data":1668,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335028,"statfs":{"total":96636764160,"available":96599068672,"internally_reserved":0,"allocated":1708032,"data_stored":791821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:04:59 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65800000000000003,"15min":0.67500000000000004},"min":{"1min":0.36399999999999999,"5min":0.28599999999999998,"15min":0.25800000000000001},"max":{"1min":1.048,"5min":1.111,"15min":1.288},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.72899999999999998,"15min":0.73999999999999999},"min":{"1min":0.35399999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.105,"5min":1.1859999999999999,"15min":1.694},"last":0.56399999999999995}]},{"osd":2,"last update":"Sat Jun 10 19:04:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.63400000000000001,"15min":0.63800000000000001},"min":{"1min":0.38200000000000001,"5min":0.308,"15min":0.249},"max":{"1min":0.84099999999999997,"5min":1.0900000000000001,"15min":1.21},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.70499999999999996,"15min":0.71399999999999997},"min":{"1min":0.433,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.415},"last":0.46300000000000002}]},{"osd":3,"last update":"Sat Jun 10 19:04:59 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.75900000000000001,"15min":0.77900000000000003},"min":{"1min":0.34000000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.034,"5min":1.1679999999999999,"15min":1.6299999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.754,"5min":0.70599999999999996,"15min":0.74099999999999999},"min":{"1min":0.45900000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.998,"5min":1.2909999999999999,"15min":2.1749999999999998},"last":0.41199999999999998}]},{"osd":4,"last update":"Sat Jun 10 19:04:59 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.85799999999999998,"15min":0.86199999999999999},"min":{"1min":0.627,"5min":0.56399999999999995,"15min":0.53000000000000003},"max":{"1min":1.196,"5min":1.343,"15min":1.4930000000000001},"last":1.0309999999999999},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.96099999999999997,"15min":1.038},"min":{"1min":0.63900000000000001,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.2010000000000001,"5min":1.492,"15min":5.8209999999999997},"last":1.0549999999999999}]},{"osd":5,"last update":"Sat Jun 10 19:04:59 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.97399999999999998,"15min":1.0029999999999999},"min":{"1min":0.66800000000000004,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.244,"5min":1.6299999999999999,"15min":1.8620000000000001},"last":1.222},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.94999999999999996,"15min":0.97599999999999998},"min":{"1min":0.59999999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.2809999999999999,"5min":1.3220000000000001,"15min":3.089},"last":0.92500000000000004}]},{"osd":6,"last update":"Sat Jun 10 19:04:59 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.999,"15min":1.0489999999999999},"min":{"1min":0.71699999999999997,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.145,"5min":1.6759999999999999,"15min":7.2599999999999998},"last":1.1100000000000001},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.98999999999999999,"15min":1.0349999999999999},"min":{"1min":0.72899999999999998,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.341,"5min":1.6000000000000001,"15min":9.0069999999999997},"last":1.1859999999999999}]},{"osd":7,"last update":"Sat Jun 10 19:04:59 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.05,"15min":1.0820000000000001},"min":{"1min":0.69999999999999996,"5min":0.495,"15min":0.495},"max":{"1min":1.4339999999999999,"5min":1.494,"15min":2.105},"last":1.0049999999999999},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.046,"15min":1.0820000000000001},"min":{"1min":0.75700000000000001,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.4670000000000001,"5min":1.5620000000000001,"15min":2.2570000000000001},"last":0.96699999999999997}]}]},{"osd":0,"up_from":13,"seq":55834575012,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37396,"kb_used_data":2252,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334444,"statfs":{"total":96636764160,"available":96598470656,"internally_reserved":0,"allocated":2306048,"data_stored":1382175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jun 10 19:04:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.61699999999999999,"15min":0.63},"min":{"1min":0.34100000000000003,"5min":0.248,"15min":0.248},"max":{"1min":1.042,"5min":1.127,"15min":1.127},"last":0.88},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.78800000000000003,"15min":0.79800000000000004},"min":{"1min":0.38,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.093,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.98899999999999999}]},{"osd":2,"last update":"Sat Jun 10 19:04:58 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.71999999999999997,"15min":0.71599999999999997},"min":{"1min":0.38100000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.1970000000000001,"5min":1.2010000000000001,"15min":1.2829999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.64100000000000001,"15min":0.65300000000000002},"min":{"1min":0.28699999999999998,"5min":0.27600000000000002,"15min":0.245},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.371},"last":0.61899999999999999}]},{"osd":3,"last update":"Sat Jun 10 19:04:58 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.66000000000000003,"15min":0.68400000000000005},"min":{"1min":0.40100000000000002,"5min":0.29499999999999998,"15min":0.28899999999999998},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.226},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.80400000000000005,"15min":0.82399999999999995},"min":{"1min":0.435,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.321,"5min":1.742,"15min":1.829},"last":0.92200000000000004}]},{"osd":4,"last update":"Sat Jun 10 19:04:58 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.90700000000000003,"15min":0.92000000000000004},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.1619999999999999,"5min":1.7250000000000001,"15min":3.0209999999999999},"last":1.0569999999999999},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.012,"15min":1.0289999999999999},"min":{"1min":0.69199999999999995,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.2270000000000001,"5min":1.873,"15min":1.9510000000000001},"last":1.1100000000000001}]},{"osd":5,"last update":"Sat Jun 10 19:04:58 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.91900000000000004,"15min":0.93999999999999995},"min":{"1min":0.624,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.206,"5min":1.3109999999999999,"15min":1.694},"last":1.012},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.97799999999999998,"15min":1.008},"min":{"1min":0.71699999999999997,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.2749999999999999,"5min":1.78,"15min":4.5620000000000003},"last":0.97499999999999998}]},{"osd":6,"last update":"Sat Jun 10 19:04:58 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.042,"15min":1.077},"min":{"1min":0.58699999999999997,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.395,"5min":1.7909999999999999,"15min":3.5569999999999999},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.0109999999999999,"5min":0.98799999999999999,"15min":1.002},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.3049999999999999,"5min":1.6319999999999999,"15min":1.883},"last":0.95199999999999996}]},{"osd":7,"last update":"Sat Jun 10 19:04:58 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.0129999999999999,"15min":1.032},"min":{"1min":0.57299999999999995,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.2250000000000001,"5min":1.512,"15min":1.5800000000000001},"last":0.84599999999999997},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.036,"15min":1.0580000000000001},"min":{"1min":0.80600000000000005,"5min":0.624,"15min":0.58699999999999997},"max":{"1min":1.298,"5min":1.6619999999999999,"15min":1.9830000000000001},"last":1.129}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-10T19:05:54.820 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-10T19:05:54.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.967+0000 7f1ca4870640 1 Processor -- start 2023-06-10T19:05:54.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.967+0000 7f1ca4870640 1 -- start start 2023-06-10T19:05:54.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.971+0000 7f1ca4870640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1ca00c9750 0x7f1ca00aced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:54.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.971+0000 7f1ca4870640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ca00cb870 0x7f1ca00af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:54.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.971+0000 7f1ca4870640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1ca00afc60 0x7f1ca015bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:54.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.971+0000 7f1ca4870640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ca00cd990 con 0x7f1ca00c9750 2023-06-10T19:05:54.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.971+0000 7f1ca4870640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ca00b00e0 con 0x7f1ca00afc60 2023-06-10T19:05:54.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.971+0000 7f1ca4870640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca00ad410 con 0x7f1ca00cb870 2023-06-10T19:05:54.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.971+0000 7f1c9e59c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1ca00c9750 0x7f1ca00aced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:54.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.971+0000 7f1c9e59c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1ca00c9750 0x7f1ca00aced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47218/0 (socket says 172.21.15.53:47218) 2023-06-10T19:05:54.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.971+0000 7f1c9e59c640 1 -- 172.21.15.53:0/1383869591 learned_addr learned my addr 172.21.15.53:0/1383869591 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:54.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.971+0000 7f1c9dd9b640 1 --2- 172.21.15.53:0/1383869591 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ca00cb870 0x7f1ca00af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:54.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.971+0000 7f1c9ed9d640 1 --2- 172.21.15.53:0/1383869591 >> v2:172.21.15.117:3300/0 conn(0x7f1ca00afc60 0x7f1ca015bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:54.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.971+0000 7f1c9e59c640 1 -- 172.21.15.53:0/1383869591 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ca00cb870 msgr2=0x7f1ca00af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:54.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.971+0000 7f1c9e59c640 1 --2- 172.21.15.53:0/1383869591 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ca00cb870 0x7f1ca00af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:54.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.971+0000 7f1c9e59c640 1 -- 172.21.15.53:0/1383869591 >> v2:172.21.15.117:3300/0 conn(0x7f1ca00afc60 msgr2=0x7f1ca015bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:54.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.971+0000 7f1c9e59c640 1 --2- 172.21.15.53:0/1383869591 >> v2:172.21.15.117:3300/0 conn(0x7f1ca00afc60 0x7f1ca015bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:54.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.971+0000 7f1c9e59c640 1 -- 172.21.15.53:0/1383869591 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ca01600d0 con 0x7f1ca00c9750 2023-06-10T19:05:54.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.975+0000 7f1c9e59c640 1 --2- 172.21.15.53:0/1383869591 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ca00c9750 0x7f1ca00aced0 secure :-1 s=READY pgs=2040 cs=0 l=1 rev1=1 crypto rx=0x7f1ca00c4d00 tx=0x7f1c9001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60373eee952de761 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:54.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.975+0000 7f1c9d59a640 1 -- 172.21.15.53:0/1383869591 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c900ac600 con 0x7f1ca00c9750 2023-06-10T19:05:54.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.975+0000 7f1c9d59a640 1 -- 172.21.15.53:0/1383869591 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c900a8050 con 0x7f1ca00c9750 2023-06-10T19:05:54.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.975+0000 7f1c9d59a640 1 -- 172.21.15.53:0/1383869591 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c900ac980 con 0x7f1ca00c9750 2023-06-10T19:05:54.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.975+0000 7f1ca4870640 1 -- 172.21.15.53:0/1383869591 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ca00c9750 msgr2=0x7f1ca00aced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:54.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.975+0000 7f1ca4870640 1 --2- 172.21.15.53:0/1383869591 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ca00c9750 0x7f1ca00aced0 secure :-1 s=READY pgs=2040 cs=0 l=1 rev1=1 crypto rx=0x7f1ca00c4d00 tx=0x7f1c9001c4d0 comp rx=0 tx=0).stop 2023-06-10T19:05:54.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.975+0000 7f1ca4870640 1 -- 172.21.15.53:0/1383869591 shutdown_connections 2023-06-10T19:05:54.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.975+0000 7f1ca4870640 1 --2- 172.21.15.53:0/1383869591 >> v2:172.21.15.117:3300/0 conn(0x7f1ca00afc60 0x7f1ca015bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:54.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.975+0000 7f1ca4870640 1 --2- 172.21.15.53:0/1383869591 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ca00cb870 0x7f1ca00af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:54.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.975+0000 7f1ca4870640 1 --2- 172.21.15.53:0/1383869591 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ca00c9750 0x7f1ca00aced0 unknown :-1 s=CLOSED pgs=2040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:54.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.975+0000 7f1ca4870640 1 -- 172.21.15.53:0/1383869591 >> 172.21.15.53:0/1383869591 conn(0x7f1ca006a0d0 msgr2=0x7f1ca00ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:54.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.975+0000 7f1ca4870640 1 -- 172.21.15.53:0/1383869591 shutdown_connections 2023-06-10T19:05:54.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.975+0000 7f1ca4870640 1 -- 172.21.15.53:0/1383869591 wait complete. 2023-06-10T19:05:54.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.979+0000 7f1ca4870640 1 Processor -- start 2023-06-10T19:05:54.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.979+0000 7f1ca4870640 1 -- start start 2023-06-10T19:05:54.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.979+0000 7f1ca4870640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ca00afc60 0x7f1ca014c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:54.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.979+0000 7f1ca4870640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ca00c9750 0x7f1ca0155820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:54.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.979+0000 7f1ca4870640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ca00cb870 0x7f1ca0155d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:54.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.979+0000 7f1ca4870640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca014c7e0 con 0x7f1ca00afc60 2023-06-10T19:05:54.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.979+0000 7f1ca4870640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca0070da0 con 0x7f1ca00cb870 2023-06-10T19:05:54.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.979+0000 7f1ca4870640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca00705d0 con 0x7f1ca00c9750 2023-06-10T19:05:54.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.979+0000 7f1c9e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ca00afc60 0x7f1ca014c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:54.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.979+0000 7f1c9e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ca00afc60 0x7f1ca014c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47220/0 (socket says 172.21.15.53:47220) 2023-06-10T19:05:54.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.979+0000 7f1c9e59c640 1 -- 172.21.15.53:0/1968486364 learned_addr learned my addr 172.21.15.53:0/1968486364 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:54.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.979+0000 7f1c9ed9d640 1 --2- 172.21.15.53:0/1968486364 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ca00cb870 0x7f1ca0155d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:54.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.979+0000 7f1c9dd9b640 1 --2- 172.21.15.53:0/1968486364 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ca00c9750 0x7f1ca0155820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:54.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.979+0000 7f1c9e59c640 1 -- 172.21.15.53:0/1968486364 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ca00c9750 msgr2=0x7f1ca0155820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:54.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.979+0000 7f1c9e59c640 1 --2- 172.21.15.53:0/1968486364 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ca00c9750 0x7f1ca0155820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:54.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.979+0000 7f1c9e59c640 1 -- 172.21.15.53:0/1968486364 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ca00cb870 msgr2=0x7f1ca0155d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:54.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.979+0000 7f1c9e59c640 1 --2- 172.21.15.53:0/1968486364 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ca00cb870 0x7f1ca0155d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:54.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.979+0000 7f1c9e59c640 1 -- 172.21.15.53:0/1968486364 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c900094d0 con 0x7f1ca00afc60 2023-06-10T19:05:54.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.979+0000 7f1c9e59c640 1 --2- 172.21.15.53:0/1968486364 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ca00afc60 0x7f1ca014c2a0 secure :-1 s=READY pgs=2041 cs=0 l=1 rev1=1 crypto rx=0x7f1c9001cd70 tx=0x7f1c9001ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:54.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.979+0000 7f1c96ffd640 1 -- 172.21.15.53:0/1968486364 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c900b7420 con 0x7f1ca00afc60 2023-06-10T19:05:54.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.979+0000 7f1c96ffd640 1 -- 172.21.15.53:0/1968486364 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c900b7580 con 0x7f1ca00afc60 2023-06-10T19:05:54.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.979+0000 7f1ca4870640 1 -- 172.21.15.53:0/1968486364 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ca015a930 con 0x7f1ca00afc60 2023-06-10T19:05:54.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.979+0000 7f1c96ffd640 1 -- 172.21.15.53:0/1968486364 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c900b78f0 con 0x7f1ca00afc60 2023-06-10T19:05:54.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.979+0000 7f1ca4870640 1 -- 172.21.15.53:0/1968486364 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ca00707e0 con 0x7f1ca00afc60 2023-06-10T19:05:54.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.979+0000 7f1ca4870640 1 -- 172.21.15.53:0/1968486364 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ca004d790 con 0x7f1ca00afc60 2023-06-10T19:05:54.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.979+0000 7f1c96ffd640 1 -- 172.21.15.53:0/1968486364 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1c900b3040 con 0x7f1ca00afc60 2023-06-10T19:05:54.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.979+0000 7f1c96ffd640 1 --2- 172.21.15.53:0/1968486364 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1c80066280 0x7f1c80068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:54.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.979+0000 7f1c96ffd640 1 -- 172.21.15.53:0/1968486364 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1c9011de60 con 0x7f1ca00afc60 2023-06-10T19:05:54.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.983+0000 7f1c9dd9b640 1 --2- 172.21.15.53:0/1968486364 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1c80066280 0x7f1c80068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:54.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.983+0000 7f1c9dd9b640 1 --2- 172.21.15.53:0/1968486364 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1c80066280 0x7f1c80068730 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f1ca015ef00 tx=0x7f1c88008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:54.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:54.987+0000 7f1c96ffd640 1 -- 172.21.15.53:0/1968486364 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1c900eb2e0 con 0x7f1ca00afc60 2023-06-10T19:05:55.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.131+0000 7f1ca4870640 1 -- 172.21.15.53:0/1968486364 --> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1ca00c9b20 con 0x7f1c80066280 2023-06-10T19:05:55.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.155+0000 7f1c96ffd640 1 -- 172.21.15.53:0/1968486364 <== mgr.4105 v2:172.21.15.117:6832/3061986771 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310360 (secure 0 0 0) 0x7f1c880118e0 con 0x7f1c80066280 2023-06-10T19:05:55.163 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:05:55.166 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-06-10T19:05:55.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.159+0000 7f1ca4870640 1 -- 172.21.15.53:0/1968486364 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1c80066280 msgr2=0x7f1c80068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:55.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.159+0000 7f1ca4870640 1 --2- 172.21.15.53:0/1968486364 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1c80066280 0x7f1c80068730 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f1ca015ef00 tx=0x7f1c88008040 comp rx=0 tx=0).stop 2023-06-10T19:05:55.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.159+0000 7f1ca4870640 1 -- 172.21.15.53:0/1968486364 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ca00afc60 msgr2=0x7f1ca014c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:55.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.159+0000 7f1ca4870640 1 --2- 172.21.15.53:0/1968486364 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ca00afc60 0x7f1ca014c2a0 secure :-1 s=READY pgs=2041 cs=0 l=1 rev1=1 crypto rx=0x7f1c9001cd70 tx=0x7f1c9001ad10 comp rx=0 tx=0).stop 2023-06-10T19:05:55.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.159+0000 7f1ca4870640 1 -- 172.21.15.53:0/1968486364 shutdown_connections 2023-06-10T19:05:55.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.159+0000 7f1ca4870640 1 --2- 172.21.15.53:0/1968486364 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1c80066280 0x7f1c80068730 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:55.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.159+0000 7f1ca4870640 1 --2- 172.21.15.53:0/1968486364 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ca00cb870 0x7f1ca0155d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:55.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.159+0000 7f1ca4870640 1 --2- 172.21.15.53:0/1968486364 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ca00c9750 0x7f1ca0155820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:55.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.159+0000 7f1ca4870640 1 --2- 172.21.15.53:0/1968486364 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ca00afc60 0x7f1ca014c2a0 unknown :-1 s=CLOSED pgs=2041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:55.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.159+0000 7f1ca4870640 1 -- 172.21.15.53:0/1968486364 >> 172.21.15.53:0/1968486364 conn(0x7f1ca006a0d0 msgr2=0x7f1ca006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:55.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.159+0000 7f1ca4870640 1 -- 172.21.15.53:0/1968486364 shutdown_connections 2023-06-10T19:05:55.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.159+0000 7f1ca4870640 1 -- 172.21.15.53:0/1968486364 wait complete. 2023-06-10T19:05:55.182 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":532,"stamp":"2023-06-10T19:05:53.844576+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":113,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":275264,"kb_used_data":14592,"kb_used_omap":0,"kb_used_meta":260608,"kb_avail":754699456,"statfs":{"total":773094113280,"available":772812242944,"internally_reserved":0,"allocated":14942208,"data_stored":7544522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":266862592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":57,"apply_latency_ms":57,"commit_latency_ns":57000000,"apply_latency_ns":57000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.446687"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:51.800548+0000","last_change":"2023-06-10T19:05:50.818095+0000","last_active":"2023-06-10T19:05:51.800548+0000","last_peered":"2023-06-10T19:05:51.800548+0000","last_clean":"2023-06-10T19:05:51.800548+0000","last_became_active":"2023-06-10T19:05:50.817788+0000","last_became_peered":"2023-06-10T19:05:50.817788+0000","last_unstale":"2023-06-10T19:05:51.800548+0000","last_undegraded":"2023-06-10T19:05:51.800548+0000","last_fullsized":"2023-06-10T19:05:51.800548+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:04:30.604067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:51.805789+0000","last_change":"2023-06-10T19:05:50.852873+0000","last_active":"2023-06-10T19:05:51.805789+0000","last_peered":"2023-06-10T19:05:51.805789+0000","last_clean":"2023-06-10T19:05:51.805789+0000","last_became_active":"2023-06-10T19:05:50.852230+0000","last_became_peered":"2023-06-10T19:05:50.852230+0000","last_unstale":"2023-06-10T19:05:51.805789+0000","last_undegraded":"2023-06-10T19:05:51.805789+0000","last_fullsized":"2023-06-10T19:05:51.805789+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:30:38.170585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.734522+0000","last_change":"2023-06-10T19:05:50.861338+0000","last_active":"2023-06-10T19:05:52.734522+0000","last_peered":"2023-06-10T19:05:52.734522+0000","last_clean":"2023-06-10T19:05:52.734522+0000","last_became_active":"2023-06-10T19:05:50.860706+0000","last_became_peered":"2023-06-10T19:05:50.860706+0000","last_unstale":"2023-06-10T19:05:52.734522+0000","last_undegraded":"2023-06-10T19:05:52.734522+0000","last_fullsized":"2023-06-10T19:05:52.734522+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:13:05.245657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:51.804641+0000","last_change":"2023-06-10T19:05:50.845678+0000","last_active":"2023-06-10T19:05:51.804641+0000","last_peered":"2023-06-10T19:05:51.804641+0000","last_clean":"2023-06-10T19:05:51.804641+0000","last_became_active":"2023-06-10T19:05:50.844941+0000","last_became_peered":"2023-06-10T19:05:50.844941+0000","last_unstale":"2023-06-10T19:05:51.804641+0000","last_undegraded":"2023-06-10T19:05:51.804641+0000","last_fullsized":"2023-06-10T19:05:51.804641+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:50:57.284645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.681906+0000","last_change":"2023-06-10T19:05:50.827940+0000","last_active":"2023-06-10T19:05:52.681906+0000","last_peered":"2023-06-10T19:05:52.681906+0000","last_clean":"2023-06-10T19:05:52.681906+0000","last_became_active":"2023-06-10T19:05:50.827561+0000","last_became_peered":"2023-06-10T19:05:50.827561+0000","last_unstale":"2023-06-10T19:05:52.681906+0000","last_undegraded":"2023-06-10T19:05:52.681906+0000","last_fullsized":"2023-06-10T19:05:52.681906+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:09:14.638261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-06-10T19:05:50.864845+0000","last_change":"2023-06-10T19:05:50.862303+0000","last_active":"2023-06-10T19:05:50.864845+0000","last_peered":"2023-06-10T19:05:50.864845+0000","last_clean":"2023-06-10T19:05:50.864845+0000","last_became_active":"2023-06-10T19:05:50.862020+0000","last_became_peered":"2023-06-10T19:05:50.862020+0000","last_unstale":"2023-06-10T19:05:50.864845+0000","last_undegraded":"2023-06-10T19:05:50.864845+0000","last_fullsized":"2023-06-10T19:05:50.864845+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:06:20.251632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.732580+0000","last_change":"2023-06-10T19:05:50.867655+0000","last_active":"2023-06-10T19:05:52.732580+0000","last_peered":"2023-06-10T19:05:52.732580+0000","last_clean":"2023-06-10T19:05:52.732580+0000","last_became_active":"2023-06-10T19:05:50.867188+0000","last_became_peered":"2023-06-10T19:05:50.867188+0000","last_unstale":"2023-06-10T19:05:52.732580+0000","last_undegraded":"2023-06-10T19:05:52.732580+0000","last_fullsized":"2023-06-10T19:05:52.732580+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:26:54.736067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:51.803393+0000","last_change":"2023-06-10T19:05:50.830026+0000","last_active":"2023-06-10T19:05:51.803393+0000","last_peered":"2023-06-10T19:05:51.803393+0000","last_clean":"2023-06-10T19:05:51.803393+0000","last_became_active":"2023-06-10T19:05:50.829264+0000","last_became_peered":"2023-06-10T19:05:50.829264+0000","last_unstale":"2023-06-10T19:05:51.803393+0000","last_undegraded":"2023-06-10T19:05:51.803393+0000","last_fullsized":"2023-06-10T19:05:51.803393+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:39:16.537480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-06-10T19:05:50.847596+0000","last_change":"2023-06-10T19:05:50.846159+0000","last_active":"2023-06-10T19:05:50.847596+0000","last_peered":"2023-06-10T19:05:50.847596+0000","last_clean":"2023-06-10T19:05:50.847596+0000","last_became_active":"2023-06-10T19:05:50.845903+0000","last_became_peered":"2023-06-10T19:05:50.845903+0000","last_unstale":"2023-06-10T19:05:50.847596+0000","last_undegraded":"2023-06-10T19:05:50.847596+0000","last_fullsized":"2023-06-10T19:05:50.847596+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:44:41.180623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-06-10T19:05:50.832099+0000","last_change":"2023-06-10T19:05:50.830749+0000","last_active":"2023-06-10T19:05:50.832099+0000","last_peered":"2023-06-10T19:05:50.832099+0000","last_clean":"2023-06-10T19:05:50.832099+0000","last_became_active":"2023-06-10T19:05:50.830170+0000","last_became_peered":"2023-06-10T19:05:50.830170+0000","last_unstale":"2023-06-10T19:05:50.832099+0000","last_undegraded":"2023-06-10T19:05:50.832099+0000","last_fullsized":"2023-06-10T19:05:50.832099+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:27:30.563568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:51.804462+0000","last_change":"2023-06-10T19:05:50.867760+0000","last_active":"2023-06-10T19:05:51.804462+0000","last_peered":"2023-06-10T19:05:51.804462+0000","last_clean":"2023-06-10T19:05:51.804462+0000","last_became_active":"2023-06-10T19:05:50.867217+0000","last_became_peered":"2023-06-10T19:05:50.867217+0000","last_unstale":"2023-06-10T19:05:51.804462+0000","last_undegraded":"2023-06-10T19:05:51.804462+0000","last_fullsized":"2023-06-10T19:05:51.804462+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:26:52.568664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:51.800558+0000","last_change":"2023-06-10T19:05:50.819285+0000","last_active":"2023-06-10T19:05:51.800558+0000","last_peered":"2023-06-10T19:05:51.800558+0000","last_clean":"2023-06-10T19:05:51.800558+0000","last_became_active":"2023-06-10T19:05:50.819022+0000","last_became_peered":"2023-06-10T19:05:50.819022+0000","last_unstale":"2023-06-10T19:05:51.800558+0000","last_undegraded":"2023-06-10T19:05:51.800558+0000","last_fullsized":"2023-06-10T19:05:51.800558+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:52:28.468372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-06-10T19:05:50.865113+0000","last_change":"2023-06-10T19:05:50.863964+0000","last_active":"2023-06-10T19:05:50.865113+0000","last_peered":"2023-06-10T19:05:50.865113+0000","last_clean":"2023-06-10T19:05:50.865113+0000","last_became_active":"2023-06-10T19:05:50.863517+0000","last_became_peered":"2023-06-10T19:05:50.863517+0000","last_unstale":"2023-06-10T19:05:50.865113+0000","last_undegraded":"2023-06-10T19:05:50.865113+0000","last_fullsized":"2023-06-10T19:05:50.865113+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:20:51.069947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:51.799989+0000","last_change":"2023-06-10T19:05:50.842665+0000","last_active":"2023-06-10T19:05:51.799989+0000","last_peered":"2023-06-10T19:05:51.799989+0000","last_clean":"2023-06-10T19:05:51.799989+0000","last_became_active":"2023-06-10T19:05:50.842334+0000","last_became_peered":"2023-06-10T19:05:50.842334+0000","last_unstale":"2023-06-10T19:05:51.799989+0000","last_undegraded":"2023-06-10T19:05:51.799989+0000","last_fullsized":"2023-06-10T19:05:51.799989+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:05:27.893460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:51.799671+0000","last_change":"2023-06-10T19:05:50.842738+0000","last_active":"2023-06-10T19:05:51.799671+0000","last_peered":"2023-06-10T19:05:51.799671+0000","last_clean":"2023-06-10T19:05:51.799671+0000","last_became_active":"2023-06-10T19:05:50.842434+0000","last_became_peered":"2023-06-10T19:05:50.842434+0000","last_unstale":"2023-06-10T19:05:51.799671+0000","last_undegraded":"2023-06-10T19:05:51.799671+0000","last_fullsized":"2023-06-10T19:05:51.799671+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:39:43.489639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-06-10T19:05:50.810601+0000","last_change":"2023-06-10T19:05:50.805582+0000","last_active":"2023-06-10T19:05:50.810601+0000","last_peered":"2023-06-10T19:05:50.810601+0000","last_clean":"2023-06-10T19:05:50.810601+0000","last_became_active":"2023-06-10T19:05:50.805282+0000","last_became_peered":"2023-06-10T19:05:50.805282+0000","last_unstale":"2023-06-10T19:05:50.810601+0000","last_undegraded":"2023-06-10T19:05:50.810601+0000","last_fullsized":"2023-06-10T19:05:50.810601+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:28:14.486117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-06-10T19:05:50.810352+0000","last_change":"2023-06-10T19:05:50.803660+0000","last_active":"2023-06-10T19:05:50.810352+0000","last_peered":"2023-06-10T19:05:50.810352+0000","last_clean":"2023-06-10T19:05:50.810352+0000","last_became_active":"2023-06-10T19:05:50.803332+0000","last_became_peered":"2023-06-10T19:05:50.803332+0000","last_unstale":"2023-06-10T19:05:50.810352+0000","last_undegraded":"2023-06-10T19:05:50.810352+0000","last_fullsized":"2023-06-10T19:05:50.810352+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:33:48.238441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.681634+0000","last_change":"2023-06-10T19:05:50.811158+0000","last_active":"2023-06-10T19:05:52.681634+0000","last_peered":"2023-06-10T19:05:52.681634+0000","last_clean":"2023-06-10T19:05:52.681634+0000","last_became_active":"2023-06-10T19:05:50.810827+0000","last_became_peered":"2023-06-10T19:05:50.810827+0000","last_unstale":"2023-06-10T19:05:52.681634+0000","last_undegraded":"2023-06-10T19:05:52.681634+0000","last_fullsized":"2023-06-10T19:05:52.681634+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:15:19.626767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.733288+0000","last_change":"2023-06-10T19:05:50.855680+0000","last_active":"2023-06-10T19:05:52.733288+0000","last_peered":"2023-06-10T19:05:52.733288+0000","last_clean":"2023-06-10T19:05:52.733288+0000","last_became_active":"2023-06-10T19:05:50.854420+0000","last_became_peered":"2023-06-10T19:05:50.854420+0000","last_unstale":"2023-06-10T19:05:52.733288+0000","last_undegraded":"2023-06-10T19:05:52.733288+0000","last_fullsized":"2023-06-10T19:05:52.733288+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:11:46.052629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.682275+0000","last_change":"2023-06-10T19:05:50.841778+0000","last_active":"2023-06-10T19:05:52.682275+0000","last_peered":"2023-06-10T19:05:52.682275+0000","last_clean":"2023-06-10T19:05:52.682275+0000","last_became_active":"2023-06-10T19:05:50.841460+0000","last_became_peered":"2023-06-10T19:05:50.841460+0000","last_unstale":"2023-06-10T19:05:52.682275+0000","last_undegraded":"2023-06-10T19:05:52.682275+0000","last_fullsized":"2023-06-10T19:05:52.682275+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:43:51.032420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:51.802966+0000","last_change":"2023-06-10T19:05:50.845333+0000","last_active":"2023-06-10T19:05:51.802966+0000","last_peered":"2023-06-10T19:05:51.802966+0000","last_clean":"2023-06-10T19:05:51.802966+0000","last_became_active":"2023-06-10T19:05:50.844655+0000","last_became_peered":"2023-06-10T19:05:50.844655+0000","last_unstale":"2023-06-10T19:05:51.802966+0000","last_undegraded":"2023-06-10T19:05:51.802966+0000","last_fullsized":"2023-06-10T19:05:51.802966+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:52:14.571254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:51.799791+0000","last_change":"2023-06-10T19:05:50.847013+0000","last_active":"2023-06-10T19:05:51.799791+0000","last_peered":"2023-06-10T19:05:51.799791+0000","last_clean":"2023-06-10T19:05:51.799791+0000","last_became_active":"2023-06-10T19:05:50.846635+0000","last_became_peered":"2023-06-10T19:05:50.846635+0000","last_unstale":"2023-06-10T19:05:51.799791+0000","last_undegraded":"2023-06-10T19:05:51.799791+0000","last_fullsized":"2023-06-10T19:05:51.799791+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:01:17.617338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:51.803088+0000","last_change":"2023-06-10T19:05:50.856514+0000","last_active":"2023-06-10T19:05:51.803088+0000","last_peered":"2023-06-10T19:05:51.803088+0000","last_clean":"2023-06-10T19:05:51.803088+0000","last_became_active":"2023-06-10T19:05:50.855909+0000","last_became_peered":"2023-06-10T19:05:50.855909+0000","last_unstale":"2023-06-10T19:05:51.803088+0000","last_undegraded":"2023-06-10T19:05:51.803088+0000","last_fullsized":"2023-06-10T19:05:51.803088+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:38:12.641119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-06-10T19:05:50.847081+0000","last_change":"2023-06-10T19:05:50.846062+0000","last_active":"2023-06-10T19:05:50.847081+0000","last_peered":"2023-06-10T19:05:50.847081+0000","last_clean":"2023-06-10T19:05:50.847081+0000","last_became_active":"2023-06-10T19:05:50.845767+0000","last_became_peered":"2023-06-10T19:05:50.845767+0000","last_unstale":"2023-06-10T19:05:50.847081+0000","last_undegraded":"2023-06-10T19:05:50.847081+0000","last_fullsized":"2023-06-10T19:05:50.847081+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:06:38.772263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.734887+0000","last_change":"2023-06-10T19:05:50.861788+0000","last_active":"2023-06-10T19:05:52.734887+0000","last_peered":"2023-06-10T19:05:52.734887+0000","last_clean":"2023-06-10T19:05:52.734887+0000","last_became_active":"2023-06-10T19:05:50.861140+0000","last_became_peered":"2023-06-10T19:05:50.861140+0000","last_unstale":"2023-06-10T19:05:52.734887+0000","last_undegraded":"2023-06-10T19:05:52.734887+0000","last_fullsized":"2023-06-10T19:05:52.734887+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:05:29.285662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.734747+0000","last_change":"2023-06-10T19:05:50.860239+0000","last_active":"2023-06-10T19:05:52.734747+0000","last_peered":"2023-06-10T19:05:52.734747+0000","last_clean":"2023-06-10T19:05:52.734747+0000","last_became_active":"2023-06-10T19:05:50.859602+0000","last_became_peered":"2023-06-10T19:05:50.859602+0000","last_unstale":"2023-06-10T19:05:52.734747+0000","last_undegraded":"2023-06-10T19:05:52.734747+0000","last_fullsized":"2023-06-10T19:05:52.734747+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:35:26.002277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.733693+0000","last_change":"2023-06-10T19:05:50.855986+0000","last_active":"2023-06-10T19:05:52.733693+0000","last_peered":"2023-06-10T19:05:52.733693+0000","last_clean":"2023-06-10T19:05:52.733693+0000","last_became_active":"2023-06-10T19:05:50.855046+0000","last_became_peered":"2023-06-10T19:05:50.855046+0000","last_unstale":"2023-06-10T19:05:52.733693+0000","last_undegraded":"2023-06-10T19:05:52.733693+0000","last_fullsized":"2023-06-10T19:05:52.733693+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:04:00.400484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-06-10T19:05:50.832452+0000","last_change":"2023-06-10T19:05:50.830645+0000","last_active":"2023-06-10T19:05:50.832452+0000","last_peered":"2023-06-10T19:05:50.832452+0000","last_clean":"2023-06-10T19:05:50.832452+0000","last_became_active":"2023-06-10T19:05:50.830318+0000","last_became_peered":"2023-06-10T19:05:50.830318+0000","last_unstale":"2023-06-10T19:05:50.832452+0000","last_undegraded":"2023-06-10T19:05:50.832452+0000","last_fullsized":"2023-06-10T19:05:50.832452+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:17:46.678761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.734202+0000","last_change":"2023-06-10T19:05:50.863097+0000","last_active":"2023-06-10T19:05:52.734202+0000","last_peered":"2023-06-10T19:05:52.734202+0000","last_clean":"2023-06-10T19:05:52.734202+0000","last_became_active":"2023-06-10T19:05:50.862503+0000","last_became_peered":"2023-06-10T19:05:50.862503+0000","last_unstale":"2023-06-10T19:05:52.734202+0000","last_undegraded":"2023-06-10T19:05:52.734202+0000","last_fullsized":"2023-06-10T19:05:52.734202+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:00:59.305862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.731909+0000","last_change":"2023-06-10T19:05:50.860386+0000","last_active":"2023-06-10T19:05:52.731909+0000","last_peered":"2023-06-10T19:05:52.731909+0000","last_clean":"2023-06-10T19:05:52.731909+0000","last_became_active":"2023-06-10T19:05:50.859784+0000","last_became_peered":"2023-06-10T19:05:50.859784+0000","last_unstale":"2023-06-10T19:05:52.731909+0000","last_undegraded":"2023-06-10T19:05:52.731909+0000","last_fullsized":"2023-06-10T19:05:52.731909+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:20:14.986471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:51.803107+0000","last_change":"2023-06-10T19:05:50.828127+0000","last_active":"2023-06-10T19:05:51.803107+0000","last_peered":"2023-06-10T19:05:51.803107+0000","last_clean":"2023-06-10T19:05:51.803107+0000","last_became_active":"2023-06-10T19:05:50.827365+0000","last_became_peered":"2023-06-10T19:05:50.827365+0000","last_unstale":"2023-06-10T19:05:51.803107+0000","last_undegraded":"2023-06-10T19:05:51.803107+0000","last_fullsized":"2023-06-10T19:05:51.803107+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:39:58.976588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-06-10T19:05:50.817368+0000","last_change":"2023-06-10T19:05:50.814231+0000","last_active":"2023-06-10T19:05:50.817368+0000","last_peered":"2023-06-10T19:05:50.817368+0000","last_clean":"2023-06-10T19:05:50.817368+0000","last_became_active":"2023-06-10T19:05:50.813869+0000","last_became_peered":"2023-06-10T19:05:50.813869+0000","last_unstale":"2023-06-10T19:05:50.817368+0000","last_undegraded":"2023-06-10T19:05:50.817368+0000","last_fullsized":"2023-06-10T19:05:50.817368+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:31:05.660633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:51.803769+0000","last_change":"2023-06-10T19:05:50.841604+0000","last_active":"2023-06-10T19:05:51.803769+0000","last_peered":"2023-06-10T19:05:51.803769+0000","last_clean":"2023-06-10T19:05:51.803769+0000","last_became_active":"2023-06-10T19:05:50.840982+0000","last_became_peered":"2023-06-10T19:05:50.840982+0000","last_unstale":"2023-06-10T19:05:51.803769+0000","last_undegraded":"2023-06-10T19:05:51.803769+0000","last_fullsized":"2023-06-10T19:05:51.803769+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:38:56.499878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"137'4","reported_seq":17,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.735045+0000","last_change":"2023-06-10T19:05:50.450125+0000","last_active":"2023-06-10T19:05:52.735045+0000","last_peered":"2023-06-10T19:05:52.735045+0000","last_clean":"2023-06-10T19:05:52.735045+0000","last_became_active":"2023-06-10T19:05:50.449467+0000","last_became_peered":"2023-06-10T19:05:50.449467+0000","last_unstale":"2023-06-10T19:05:52.735045+0000","last_undegraded":"2023-06-10T19:05:52.735045+0000","last_fullsized":"2023-06-10T19:05:52.735045+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_clean_scrub_stamp":"2023-06-10T19:05:49.381507+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:58:01.012145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:51.799944+0000","last_change":"2023-06-10T19:05:50.845217+0000","last_active":"2023-06-10T19:05:51.799944+0000","last_peered":"2023-06-10T19:05:51.799944+0000","last_clean":"2023-06-10T19:05:51.799944+0000","last_became_active":"2023-06-10T19:05:50.844879+0000","last_became_peered":"2023-06-10T19:05:50.844879+0000","last_unstale":"2023-06-10T19:05:51.799944+0000","last_undegraded":"2023-06-10T19:05:51.799944+0000","last_fullsized":"2023-06-10T19:05:51.799944+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:56:52.692145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"137'1","reported_seq":14,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.682368+0000","last_change":"2023-06-10T19:05:50.439100+0000","last_active":"2023-06-10T19:05:52.682368+0000","last_peered":"2023-06-10T19:05:52.682368+0000","last_clean":"2023-06-10T19:05:52.682368+0000","last_became_active":"2023-06-10T19:05:50.438724+0000","last_became_peered":"2023-06-10T19:05:50.438724+0000","last_unstale":"2023-06-10T19:05:52.682368+0000","last_undegraded":"2023-06-10T19:05:52.682368+0000","last_fullsized":"2023-06-10T19:05:52.682368+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_clean_scrub_stamp":"2023-06-10T19:05:49.381507+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:59:30.264463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:51.803882+0000","last_change":"2023-06-10T19:05:50.857960+0000","last_active":"2023-06-10T19:05:51.803882+0000","last_peered":"2023-06-10T19:05:51.803882+0000","last_clean":"2023-06-10T19:05:51.803882+0000","last_became_active":"2023-06-10T19:05:50.857356+0000","last_became_peered":"2023-06-10T19:05:50.857356+0000","last_unstale":"2023-06-10T19:05:51.803882+0000","last_undegraded":"2023-06-10T19:05:51.803882+0000","last_fullsized":"2023-06-10T19:05:51.803882+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:38:09.162671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"137'2","reported_seq":15,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.733691+0000","last_change":"2023-06-10T19:05:50.458589+0000","last_active":"2023-06-10T19:05:52.733691+0000","last_peered":"2023-06-10T19:05:52.733691+0000","last_clean":"2023-06-10T19:05:52.733691+0000","last_became_active":"2023-06-10T19:05:50.457863+0000","last_became_peered":"2023-06-10T19:05:50.457863+0000","last_unstale":"2023-06-10T19:05:52.733691+0000","last_undegraded":"2023-06-10T19:05:52.733691+0000","last_fullsized":"2023-06-10T19:05:52.733691+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_clean_scrub_stamp":"2023-06-10T19:05:49.381507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:00:57.405373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:51.799876+0000","last_change":"2023-06-10T19:05:50.842720+0000","last_active":"2023-06-10T19:05:51.799876+0000","last_peered":"2023-06-10T19:05:51.799876+0000","last_clean":"2023-06-10T19:05:51.799876+0000","last_became_active":"2023-06-10T19:05:50.842414+0000","last_became_peered":"2023-06-10T19:05:50.842414+0000","last_unstale":"2023-06-10T19:05:51.799876+0000","last_undegraded":"2023-06-10T19:05:51.799876+0000","last_fullsized":"2023-06-10T19:05:51.799876+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:43:17.204571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"137'2","reported_seq":15,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.733177+0000","last_change":"2023-06-10T19:05:50.452952+0000","last_active":"2023-06-10T19:05:52.733177+0000","last_peered":"2023-06-10T19:05:52.733177+0000","last_clean":"2023-06-10T19:05:52.733177+0000","last_became_active":"2023-06-10T19:05:50.451890+0000","last_became_peered":"2023-06-10T19:05:50.451890+0000","last_unstale":"2023-06-10T19:05:52.733177+0000","last_undegraded":"2023-06-10T19:05:52.733177+0000","last_fullsized":"2023-06-10T19:05:52.733177+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_clean_scrub_stamp":"2023-06-10T19:05:49.381507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:50:19.085788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:51.803871+0000","last_change":"2023-06-10T19:05:50.828658+0000","last_active":"2023-06-10T19:05:51.803871+0000","last_peered":"2023-06-10T19:05:51.803871+0000","last_clean":"2023-06-10T19:05:51.803871+0000","last_became_active":"2023-06-10T19:05:50.827710+0000","last_became_peered":"2023-06-10T19:05:50.827710+0000","last_unstale":"2023-06-10T19:05:51.803871+0000","last_undegraded":"2023-06-10T19:05:51.803871+0000","last_fullsized":"2023-06-10T19:05:51.803871+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:46:56.030274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"137'1","reported_seq":14,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:51.803906+0000","last_change":"2023-06-10T19:05:50.436207+0000","last_active":"2023-06-10T19:05:51.803906+0000","last_peered":"2023-06-10T19:05:51.803906+0000","last_clean":"2023-06-10T19:05:51.803906+0000","last_became_active":"2023-06-10T19:05:50.435401+0000","last_became_peered":"2023-06-10T19:05:50.435401+0000","last_unstale":"2023-06-10T19:05:51.803906+0000","last_undegraded":"2023-06-10T19:05:51.803906+0000","last_fullsized":"2023-06-10T19:05:51.803906+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_clean_scrub_stamp":"2023-06-10T19:05:49.381507+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:43:50.018310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:51.804384+0000","last_change":"2023-06-10T19:05:50.812138+0000","last_active":"2023-06-10T19:05:51.804384+0000","last_peered":"2023-06-10T19:05:51.804384+0000","last_clean":"2023-06-10T19:05:51.804384+0000","last_became_active":"2023-06-10T19:05:50.811208+0000","last_became_peered":"2023-06-10T19:05:50.811208+0000","last_unstale":"2023-06-10T19:05:51.804384+0000","last_undegraded":"2023-06-10T19:05:51.804384+0000","last_fullsized":"2023-06-10T19:05:51.804384+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:00:38.878138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"137'1","reported_seq":14,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.681468+0000","last_change":"2023-06-10T19:05:50.439632+0000","last_active":"2023-06-10T19:05:52.681468+0000","last_peered":"2023-06-10T19:05:52.681468+0000","last_clean":"2023-06-10T19:05:52.681468+0000","last_became_active":"2023-06-10T19:05:50.439228+0000","last_became_peered":"2023-06-10T19:05:50.439228+0000","last_unstale":"2023-06-10T19:05:52.681468+0000","last_undegraded":"2023-06-10T19:05:52.681468+0000","last_fullsized":"2023-06-10T19:05:52.681468+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_clean_scrub_stamp":"2023-06-10T19:05:49.381507+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:22:35.551375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.682062+0000","last_change":"2023-06-10T19:05:50.853824+0000","last_active":"2023-06-10T19:05:52.682062+0000","last_peered":"2023-06-10T19:05:52.682062+0000","last_clean":"2023-06-10T19:05:52.682062+0000","last_became_active":"2023-06-10T19:05:50.853480+0000","last_became_peered":"2023-06-10T19:05:50.853480+0000","last_unstale":"2023-06-10T19:05:52.682062+0000","last_undegraded":"2023-06-10T19:05:52.682062+0000","last_fullsized":"2023-06-10T19:05:52.682062+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:34:04.270631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-06-10T19:05:50.798959+0000","last_change":"2023-06-10T19:05:50.440135+0000","last_active":"2023-06-10T19:05:50.798959+0000","last_peered":"2023-06-10T19:05:50.798959+0000","last_clean":"2023-06-10T19:05:50.798959+0000","last_became_active":"2023-06-10T19:05:50.439807+0000","last_became_peered":"2023-06-10T19:05:50.439807+0000","last_unstale":"2023-06-10T19:05:50.798959+0000","last_undegraded":"2023-06-10T19:05:50.798959+0000","last_fullsized":"2023-06-10T19:05:50.798959+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_clean_scrub_stamp":"2023-06-10T19:05:49.381507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:57:13.281356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.732270+0000","last_change":"2023-06-10T19:05:50.843333+0000","last_active":"2023-06-10T19:05:52.732270+0000","last_peered":"2023-06-10T19:05:52.732270+0000","last_clean":"2023-06-10T19:05:52.732270+0000","last_became_active":"2023-06-10T19:05:50.842607+0000","last_became_peered":"2023-06-10T19:05:50.842607+0000","last_unstale":"2023-06-10T19:05:52.732270+0000","last_undegraded":"2023-06-10T19:05:52.732270+0000","last_fullsized":"2023-06-10T19:05:52.732270+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:25:42.771747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":13,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.732164+0000","last_change":"2023-06-10T19:05:50.446660+0000","last_active":"2023-06-10T19:05:52.732164+0000","last_peered":"2023-06-10T19:05:52.732164+0000","last_clean":"2023-06-10T19:05:52.732164+0000","last_became_active":"2023-06-10T19:05:50.444550+0000","last_became_peered":"2023-06-10T19:05:50.444550+0000","last_unstale":"2023-06-10T19:05:52.732164+0000","last_undegraded":"2023-06-10T19:05:52.732164+0000","last_fullsized":"2023-06-10T19:05:52.732164+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_clean_scrub_stamp":"2023-06-10T19:05:49.381507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:30:09.422670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.731861+0000","last_change":"2023-06-10T19:05:50.863523+0000","last_active":"2023-06-10T19:05:52.731861+0000","last_peered":"2023-06-10T19:05:52.731861+0000","last_clean":"2023-06-10T19:05:52.731861+0000","last_became_active":"2023-06-10T19:05:50.863096+0000","last_became_peered":"2023-06-10T19:05:50.863096+0000","last_unstale":"2023-06-10T19:05:52.731861+0000","last_undegraded":"2023-06-10T19:05:52.731861+0000","last_fullsized":"2023-06-10T19:05:52.731861+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:37:06.323664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"137'1","reported_seq":14,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:51.806037+0000","last_change":"2023-06-10T19:05:50.440054+0000","last_active":"2023-06-10T19:05:51.806037+0000","last_peered":"2023-06-10T19:05:51.806037+0000","last_clean":"2023-06-10T19:05:51.806037+0000","last_became_active":"2023-06-10T19:05:50.438013+0000","last_became_peered":"2023-06-10T19:05:50.438013+0000","last_unstale":"2023-06-10T19:05:51.806037+0000","last_undegraded":"2023-06-10T19:05:51.806037+0000","last_fullsized":"2023-06-10T19:05:51.806037+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_clean_scrub_stamp":"2023-06-10T19:05:49.381507+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:29:36.059396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.732979+0000","last_change":"2023-06-10T19:05:50.857707+0000","last_active":"2023-06-10T19:05:52.732979+0000","last_peered":"2023-06-10T19:05:52.732979+0000","last_clean":"2023-06-10T19:05:52.732979+0000","last_became_active":"2023-06-10T19:05:50.856577+0000","last_became_peered":"2023-06-10T19:05:50.856577+0000","last_unstale":"2023-06-10T19:05:52.732979+0000","last_undegraded":"2023-06-10T19:05:52.732979+0000","last_fullsized":"2023-06-10T19:05:52.732979+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:27:33.745853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"137'2","reported_seq":15,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.734912+0000","last_change":"2023-06-10T19:05:50.444104+0000","last_active":"2023-06-10T19:05:52.734912+0000","last_peered":"2023-06-10T19:05:52.734912+0000","last_clean":"2023-06-10T19:05:52.734912+0000","last_became_active":"2023-06-10T19:05:50.443438+0000","last_became_peered":"2023-06-10T19:05:50.443438+0000","last_unstale":"2023-06-10T19:05:52.734912+0000","last_undegraded":"2023-06-10T19:05:52.734912+0000","last_fullsized":"2023-06-10T19:05:52.734912+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_clean_scrub_stamp":"2023-06-10T19:05:49.381507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:03:48.403477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.733235+0000","last_change":"2023-06-10T19:05:50.854928+0000","last_active":"2023-06-10T19:05:52.733235+0000","last_peered":"2023-06-10T19:05:52.733235+0000","last_clean":"2023-06-10T19:05:52.733235+0000","last_became_active":"2023-06-10T19:05:50.854212+0000","last_became_peered":"2023-06-10T19:05:50.854212+0000","last_unstale":"2023-06-10T19:05:52.733235+0000","last_undegraded":"2023-06-10T19:05:52.733235+0000","last_fullsized":"2023-06-10T19:05:52.733235+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:27:15.909597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"137'1","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-06-10T19:05:50.821146+0000","last_change":"2023-06-10T19:05:50.438790+0000","last_active":"2023-06-10T19:05:50.821146+0000","last_peered":"2023-06-10T19:05:50.821146+0000","last_clean":"2023-06-10T19:05:50.821146+0000","last_became_active":"2023-06-10T19:05:50.438459+0000","last_became_peered":"2023-06-10T19:05:50.438459+0000","last_unstale":"2023-06-10T19:05:50.821146+0000","last_undegraded":"2023-06-10T19:05:50.821146+0000","last_fullsized":"2023-06-10T19:05:50.821146+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_clean_scrub_stamp":"2023-06-10T19:05:49.381507+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:30:04.925465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-06-10T19:05:50.865108+0000","last_change":"2023-06-10T19:05:50.863424+0000","last_active":"2023-06-10T19:05:50.865108+0000","last_peered":"2023-06-10T19:05:50.865108+0000","last_clean":"2023-06-10T19:05:50.865108+0000","last_became_active":"2023-06-10T19:05:50.863112+0000","last_became_peered":"2023-06-10T19:05:50.863112+0000","last_unstale":"2023-06-10T19:05:50.865108+0000","last_undegraded":"2023-06-10T19:05:50.865108+0000","last_fullsized":"2023-06-10T19:05:50.865108+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:09:31.161349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":13,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.682474+0000","last_change":"2023-06-10T19:05:50.442563+0000","last_active":"2023-06-10T19:05:52.682474+0000","last_peered":"2023-06-10T19:05:52.682474+0000","last_clean":"2023-06-10T19:05:52.682474+0000","last_became_active":"2023-06-10T19:05:50.442171+0000","last_became_peered":"2023-06-10T19:05:50.442171+0000","last_unstale":"2023-06-10T19:05:52.682474+0000","last_undegraded":"2023-06-10T19:05:52.682474+0000","last_fullsized":"2023-06-10T19:05:52.682474+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_clean_scrub_stamp":"2023-06-10T19:05:49.381507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:00:37.864027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.682243+0000","last_change":"2023-06-10T19:05:50.817573+0000","last_active":"2023-06-10T19:05:52.682243+0000","last_peered":"2023-06-10T19:05:52.682243+0000","last_clean":"2023-06-10T19:05:52.682243+0000","last_became_active":"2023-06-10T19:05:50.817221+0000","last_became_peered":"2023-06-10T19:05:50.817221+0000","last_unstale":"2023-06-10T19:05:52.682243+0000","last_undegraded":"2023-06-10T19:05:52.682243+0000","last_fullsized":"2023-06-10T19:05:52.682243+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:38:56.499878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"137'2","reported_seq":15,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:51.804185+0000","last_change":"2023-06-10T19:05:50.451157+0000","last_active":"2023-06-10T19:05:51.804185+0000","last_peered":"2023-06-10T19:05:51.804185+0000","last_clean":"2023-06-10T19:05:51.804185+0000","last_became_active":"2023-06-10T19:05:50.449816+0000","last_became_peered":"2023-06-10T19:05:50.449816+0000","last_unstale":"2023-06-10T19:05:51.804185+0000","last_undegraded":"2023-06-10T19:05:51.804185+0000","last_fullsized":"2023-06-10T19:05:51.804185+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_clean_scrub_stamp":"2023-06-10T19:05:49.381507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:59:30.264463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:51.800450+0000","last_change":"2023-06-10T19:05:50.843211+0000","last_active":"2023-06-10T19:05:51.800450+0000","last_peered":"2023-06-10T19:05:51.800450+0000","last_clean":"2023-06-10T19:05:51.800450+0000","last_became_active":"2023-06-10T19:05:50.842909+0000","last_became_peered":"2023-06-10T19:05:50.842909+0000","last_unstale":"2023-06-10T19:05:51.800450+0000","last_undegraded":"2023-06-10T19:05:51.800450+0000","last_fullsized":"2023-06-10T19:05:51.800450+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:25:28.931028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":13,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:51.800156+0000","last_change":"2023-06-10T19:05:50.432563+0000","last_active":"2023-06-10T19:05:51.800156+0000","last_peered":"2023-06-10T19:05:51.800156+0000","last_clean":"2023-06-10T19:05:51.800156+0000","last_became_active":"2023-06-10T19:05:50.432211+0000","last_became_peered":"2023-06-10T19:05:50.432211+0000","last_unstale":"2023-06-10T19:05:51.800156+0000","last_undegraded":"2023-06-10T19:05:51.800156+0000","last_fullsized":"2023-06-10T19:05:51.800156+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_clean_scrub_stamp":"2023-06-10T19:05:49.381507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:05:42.815382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.682197+0000","last_change":"2023-06-10T19:05:50.862029+0000","last_active":"2023-06-10T19:05:52.682197+0000","last_peered":"2023-06-10T19:05:52.682197+0000","last_clean":"2023-06-10T19:05:52.682197+0000","last_became_active":"2023-06-10T19:05:50.861632+0000","last_became_peered":"2023-06-10T19:05:50.861632+0000","last_unstale":"2023-06-10T19:05:52.682197+0000","last_undegraded":"2023-06-10T19:05:52.682197+0000","last_fullsized":"2023-06-10T19:05:52.682197+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:39:16.537480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":13,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.733280+0000","last_change":"2023-06-10T19:05:50.453792+0000","last_active":"2023-06-10T19:05:52.733280+0000","last_peered":"2023-06-10T19:05:52.733280+0000","last_clean":"2023-06-10T19:05:52.733280+0000","last_became_active":"2023-06-10T19:05:50.452188+0000","last_became_peered":"2023-06-10T19:05:50.452188+0000","last_unstale":"2023-06-10T19:05:52.733280+0000","last_undegraded":"2023-06-10T19:05:52.733280+0000","last_fullsized":"2023-06-10T19:05:52.733280+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_clean_scrub_stamp":"2023-06-10T19:05:49.381507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:39:37.746582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:51.805686+0000","last_change":"2023-06-10T19:05:50.867820+0000","last_active":"2023-06-10T19:05:51.805686+0000","last_peered":"2023-06-10T19:05:51.805686+0000","last_clean":"2023-06-10T19:05:51.805686+0000","last_became_active":"2023-06-10T19:05:50.867157+0000","last_became_peered":"2023-06-10T19:05:50.867157+0000","last_unstale":"2023-06-10T19:05:51.805686+0000","last_undegraded":"2023-06-10T19:05:51.805686+0000","last_fullsized":"2023-06-10T19:05:51.805686+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:51:06.580829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-06-10T19:05:50.799910+0000","last_change":"2023-06-10T19:05:50.434689+0000","last_active":"2023-06-10T19:05:50.799910+0000","last_peered":"2023-06-10T19:05:50.799910+0000","last_clean":"2023-06-10T19:05:50.799910+0000","last_became_active":"2023-06-10T19:05:50.434328+0000","last_became_peered":"2023-06-10T19:05:50.434328+0000","last_unstale":"2023-06-10T19:05:50.799910+0000","last_undegraded":"2023-06-10T19:05:50.799910+0000","last_fullsized":"2023-06-10T19:05:50.799910+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_clean_scrub_stamp":"2023-06-10T19:05:49.381507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:38:08.148560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.681791+0000","last_change":"2023-06-10T19:05:50.842501+0000","last_active":"2023-06-10T19:05:52.681791+0000","last_peered":"2023-06-10T19:05:52.681791+0000","last_clean":"2023-06-10T19:05:52.681791+0000","last_became_active":"2023-06-10T19:05:50.842064+0000","last_became_peered":"2023-06-10T19:05:50.842064+0000","last_unstale":"2023-06-10T19:05:52.681791+0000","last_undegraded":"2023-06-10T19:05:52.681791+0000","last_fullsized":"2023-06-10T19:05:52.681791+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:58:44.358912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"137'2","reported_seq":15,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:51.800815+0000","last_change":"2023-06-10T19:05:50.449452+0000","last_active":"2023-06-10T19:05:51.800815+0000","last_peered":"2023-06-10T19:05:51.800815+0000","last_clean":"2023-06-10T19:05:51.800815+0000","last_became_active":"2023-06-10T19:05:50.449008+0000","last_became_peered":"2023-06-10T19:05:50.449008+0000","last_unstale":"2023-06-10T19:05:51.800815+0000","last_undegraded":"2023-06-10T19:05:51.800815+0000","last_fullsized":"2023-06-10T19:05:51.800815+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_clean_scrub_stamp":"2023-06-10T19:05:49.381507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:47:03.999183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.731719+0000","last_change":"2023-06-10T19:05:50.834910+0000","last_active":"2023-06-10T19:05:52.731719+0000","last_peered":"2023-06-10T19:05:52.731719+0000","last_clean":"2023-06-10T19:05:52.731719+0000","last_became_active":"2023-06-10T19:05:50.834146+0000","last_became_peered":"2023-06-10T19:05:50.834146+0000","last_unstale":"2023-06-10T19:05:52.731719+0000","last_undegraded":"2023-06-10T19:05:52.731719+0000","last_fullsized":"2023-06-10T19:05:52.731719+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T07:01:42.898368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":13,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:51.805082+0000","last_change":"2023-06-10T19:05:50.453769+0000","last_active":"2023-06-10T19:05:51.805082+0000","last_peered":"2023-06-10T19:05:51.805082+0000","last_clean":"2023-06-10T19:05:51.805082+0000","last_became_active":"2023-06-10T19:05:50.453037+0000","last_became_peered":"2023-06-10T19:05:50.453037+0000","last_unstale":"2023-06-10T19:05:51.805082+0000","last_undegraded":"2023-06-10T19:05:51.805082+0000","last_fullsized":"2023-06-10T19:05:51.805082+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_clean_scrub_stamp":"2023-06-10T19:05:49.381507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:50:35.970177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.732493+0000","last_change":"2023-06-10T19:05:50.867546+0000","last_active":"2023-06-10T19:05:52.732493+0000","last_peered":"2023-06-10T19:05:52.732493+0000","last_clean":"2023-06-10T19:05:52.732493+0000","last_became_active":"2023-06-10T19:05:50.867051+0000","last_became_peered":"2023-06-10T19:05:50.867051+0000","last_unstale":"2023-06-10T19:05:52.732493+0000","last_undegraded":"2023-06-10T19:05:52.732493+0000","last_fullsized":"2023-06-10T19:05:52.732493+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:16:49.161949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":13,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:51.804516+0000","last_change":"2023-06-10T19:05:50.443535+0000","last_active":"2023-06-10T19:05:51.804516+0000","last_peered":"2023-06-10T19:05:51.804516+0000","last_clean":"2023-06-10T19:05:51.804516+0000","last_became_active":"2023-06-10T19:05:50.442891+0000","last_became_peered":"2023-06-10T19:05:50.442891+0000","last_unstale":"2023-06-10T19:05:51.804516+0000","last_undegraded":"2023-06-10T19:05:51.804516+0000","last_fullsized":"2023-06-10T19:05:51.804516+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_clean_scrub_stamp":"2023-06-10T19:05:49.381507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:30:59.400403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-06-10T19:05:50.831643+0000","last_change":"2023-06-10T19:05:50.830548+0000","last_active":"2023-06-10T19:05:50.831643+0000","last_peered":"2023-06-10T19:05:50.831643+0000","last_clean":"2023-06-10T19:05:50.831643+0000","last_became_active":"2023-06-10T19:05:50.830194+0000","last_became_peered":"2023-06-10T19:05:50.830194+0000","last_unstale":"2023-06-10T19:05:50.831643+0000","last_undegraded":"2023-06-10T19:05:50.831643+0000","last_fullsized":"2023-06-10T19:05:50.831643+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:15:59.883362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-06-10T19:05:50.800658+0000","last_change":"2023-06-10T19:05:50.447472+0000","last_active":"2023-06-10T19:05:50.800658+0000","last_peered":"2023-06-10T19:05:50.800658+0000","last_clean":"2023-06-10T19:05:50.800658+0000","last_became_active":"2023-06-10T19:05:50.447197+0000","last_became_peered":"2023-06-10T19:05:50.447197+0000","last_unstale":"2023-06-10T19:05:50.800658+0000","last_undegraded":"2023-06-10T19:05:50.800658+0000","last_fullsized":"2023-06-10T19:05:50.800658+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_clean_scrub_stamp":"2023-06-10T19:05:49.381507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:26:51.554553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-06-10T19:05:50.821466+0000","last_change":"2023-06-10T19:05:50.816896+0000","last_active":"2023-06-10T19:05:50.821466+0000","last_peered":"2023-06-10T19:05:50.821466+0000","last_clean":"2023-06-10T19:05:50.821466+0000","last_became_active":"2023-06-10T19:05:50.816599+0000","last_became_peered":"2023-06-10T19:05:50.816599+0000","last_unstale":"2023-06-10T19:05:50.821466+0000","last_undegraded":"2023-06-10T19:05:50.821466+0000","last_fullsized":"2023-06-10T19:05:50.821466+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:23:07.367404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":13,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:51.804270+0000","last_change":"2023-06-10T19:05:50.442330+0000","last_active":"2023-06-10T19:05:51.804270+0000","last_peered":"2023-06-10T19:05:51.804270+0000","last_clean":"2023-06-10T19:05:51.804270+0000","last_became_active":"2023-06-10T19:05:50.441707+0000","last_became_peered":"2023-06-10T19:05:50.441707+0000","last_unstale":"2023-06-10T19:05:51.804270+0000","last_undegraded":"2023-06-10T19:05:51.804270+0000","last_fullsized":"2023-06-10T19:05:51.804270+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_clean_scrub_stamp":"2023-06-10T19:05:49.381507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:44:40.166512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-06-10T19:05:50.821493+0000","last_change":"2023-06-10T19:05:50.816923+0000","last_active":"2023-06-10T19:05:50.821493+0000","last_peered":"2023-06-10T19:05:50.821493+0000","last_clean":"2023-06-10T19:05:50.821493+0000","last_became_active":"2023-06-10T19:05:50.816585+0000","last_became_peered":"2023-06-10T19:05:50.816585+0000","last_unstale":"2023-06-10T19:05:50.821493+0000","last_undegraded":"2023-06-10T19:05:50.821493+0000","last_fullsized":"2023-06-10T19:05:50.821493+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:09:29.999840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":13,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.733591+0000","last_change":"2023-06-10T19:05:50.458803+0000","last_active":"2023-06-10T19:05:52.733591+0000","last_peered":"2023-06-10T19:05:52.733591+0000","last_clean":"2023-06-10T19:05:52.733591+0000","last_became_active":"2023-06-10T19:05:50.458147+0000","last_became_peered":"2023-06-10T19:05:50.458147+0000","last_unstale":"2023-06-10T19:05:52.733591+0000","last_undegraded":"2023-06-10T19:05:52.733591+0000","last_fullsized":"2023-06-10T19:05:52.733591+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_clean_scrub_stamp":"2023-06-10T19:05:49.381507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:18:01.608584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-06-10T19:05:50.844361+0000","last_change":"2023-06-10T19:05:50.842552+0000","last_active":"2023-06-10T19:05:50.844361+0000","last_peered":"2023-06-10T19:05:50.844361+0000","last_clean":"2023-06-10T19:05:50.844361+0000","last_became_active":"2023-06-10T19:05:50.842237+0000","last_became_peered":"2023-06-10T19:05:50.842237+0000","last_unstale":"2023-06-10T19:05:50.844361+0000","last_undegraded":"2023-06-10T19:05:50.844361+0000","last_fullsized":"2023-06-10T19:05:50.844361+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:52:14.571254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-06-10T19:05:50.799143+0000","last_change":"2023-06-10T19:05:50.447904+0000","last_active":"2023-06-10T19:05:50.799143+0000","last_peered":"2023-06-10T19:05:50.799143+0000","last_clean":"2023-06-10T19:05:50.799143+0000","last_became_active":"2023-06-10T19:05:50.447541+0000","last_became_peered":"2023-06-10T19:05:50.447541+0000","last_unstale":"2023-06-10T19:05:50.799143+0000","last_undegraded":"2023-06-10T19:05:50.799143+0000","last_fullsized":"2023-06-10T19:05:50.799143+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_clean_scrub_stamp":"2023-06-10T19:05:49.381507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:46:51.181220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.732797+0000","last_change":"2023-06-10T19:05:50.868384+0000","last_active":"2023-06-10T19:05:52.732797+0000","last_peered":"2023-06-10T19:05:52.732797+0000","last_clean":"2023-06-10T19:05:52.732797+0000","last_became_active":"2023-06-10T19:05:50.867929+0000","last_became_peered":"2023-06-10T19:05:50.867929+0000","last_unstale":"2023-06-10T19:05:52.732797+0000","last_undegraded":"2023-06-10T19:05:52.732797+0000","last_fullsized":"2023-06-10T19:05:52.732797+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:36:59.494746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":13,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.682108+0000","last_change":"2023-06-10T19:05:50.451025+0000","last_active":"2023-06-10T19:05:52.682108+0000","last_peered":"2023-06-10T19:05:52.682108+0000","last_clean":"2023-06-10T19:05:52.682108+0000","last_became_active":"2023-06-10T19:05:50.450409+0000","last_became_peered":"2023-06-10T19:05:50.450409+0000","last_unstale":"2023-06-10T19:05:52.682108+0000","last_undegraded":"2023-06-10T19:05:52.682108+0000","last_fullsized":"2023-06-10T19:05:52.682108+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_clean_scrub_stamp":"2023-06-10T19:05:49.381507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:39:57.962477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.734653+0000","last_change":"2023-06-10T19:05:50.860202+0000","last_active":"2023-06-10T19:05:52.734653+0000","last_peered":"2023-06-10T19:05:52.734653+0000","last_clean":"2023-06-10T19:05:52.734653+0000","last_became_active":"2023-06-10T19:05:50.859562+0000","last_became_peered":"2023-06-10T19:05:50.859562+0000","last_unstale":"2023-06-10T19:05:52.734653+0000","last_undegraded":"2023-06-10T19:05:52.734653+0000","last_fullsized":"2023-06-10T19:05:52.734653+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:35:57.380078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":13,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.732878+0000","last_change":"2023-06-10T19:05:50.453894+0000","last_active":"2023-06-10T19:05:52.732878+0000","last_peered":"2023-06-10T19:05:52.732878+0000","last_clean":"2023-06-10T19:05:52.732878+0000","last_became_active":"2023-06-10T19:05:50.453018+0000","last_became_peered":"2023-06-10T19:05:50.453018+0000","last_unstale":"2023-06-10T19:05:52.732878+0000","last_undegraded":"2023-06-10T19:05:52.732878+0000","last_fullsized":"2023-06-10T19:05:52.732878+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_clean_scrub_stamp":"2023-06-10T19:05:49.381507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:53:51.880254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":373,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.733610+0000","last_change":"2023-06-10T18:52:34.951528+0000","last_active":"2023-06-10T19:05:52.733610+0000","last_peered":"2023-06-10T19:05:52.733610+0000","last_clean":"2023-06-10T19:05:52.733610+0000","last_became_active":"2023-06-10T18:52:34.949099+0000","last_became_peered":"2023-06-10T18:52:34.949099+0000","last_unstale":"2023-06-10T19:05:52.733610+0000","last_undegraded":"2023-06-10T19:05:52.733610+0000","last_fullsized":"2023-06-10T19:05:52.733610+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_clean_scrub_stamp":"2023-06-10T18:52:33.633295+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:19:12.275959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":231,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:51.804299+0000","last_change":"2023-06-10T18:52:40.506384+0000","last_active":"2023-06-10T19:05:51.804299+0000","last_peered":"2023-06-10T19:05:51.804299+0000","last_clean":"2023-06-10T19:05:51.804299+0000","last_became_active":"2023-06-10T18:52:40.505701+0000","last_became_peered":"2023-06-10T18:52:40.505701+0000","last_unstale":"2023-06-10T19:05:51.804299+0000","last_undegraded":"2023-06-10T19:05:51.804299+0000","last_fullsized":"2023-06-10T19:05:51.804299+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:09:56.446628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.732912+0000","last_change":"2023-06-10T19:05:50.854701+0000","last_active":"2023-06-10T19:05:52.732912+0000","last_peered":"2023-06-10T19:05:52.732912+0000","last_clean":"2023-06-10T19:05:52.732912+0000","last_became_active":"2023-06-10T19:05:50.854025+0000","last_became_peered":"2023-06-10T19:05:50.854025+0000","last_unstale":"2023-06-10T19:05:52.732912+0000","last_undegraded":"2023-06-10T19:05:52.732912+0000","last_fullsized":"2023-06-10T19:05:52.732912+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:32:38.724560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":13,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.731793+0000","last_change":"2023-06-10T19:05:50.448946+0000","last_active":"2023-06-10T19:05:52.731793+0000","last_peered":"2023-06-10T19:05:52.731793+0000","last_clean":"2023-06-10T19:05:52.731793+0000","last_became_active":"2023-06-10T19:05:50.448251+0000","last_became_peered":"2023-06-10T19:05:50.448251+0000","last_unstale":"2023-06-10T19:05:52.731793+0000","last_undegraded":"2023-06-10T19:05:52.731793+0000","last_fullsized":"2023-06-10T19:05:52.731793+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_clean_scrub_stamp":"2023-06-10T19:05:49.381507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:28:14.719948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":217,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.733366+0000","last_change":"2023-06-10T18:52:40.512015+0000","last_active":"2023-06-10T19:05:52.733366+0000","last_peered":"2023-06-10T19:05:52.733366+0000","last_clean":"2023-06-10T19:05:52.733366+0000","last_became_active":"2023-06-10T18:52:40.511382+0000","last_became_peered":"2023-06-10T18:52:40.511382+0000","last_unstale":"2023-06-10T19:05:52.733366+0000","last_undegraded":"2023-06-10T19:05:52.733366+0000","last_fullsized":"2023-06-10T19:05:52.733366+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:53:32.110170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.682262+0000","last_change":"2023-06-10T19:05:50.811602+0000","last_active":"2023-06-10T19:05:52.682262+0000","last_peered":"2023-06-10T19:05:52.682262+0000","last_clean":"2023-06-10T19:05:52.682262+0000","last_became_active":"2023-06-10T19:05:50.811327+0000","last_became_peered":"2023-06-10T19:05:50.811327+0000","last_unstale":"2023-06-10T19:05:52.682262+0000","last_undegraded":"2023-06-10T19:05:52.682262+0000","last_fullsized":"2023-06-10T19:05:52.682262+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:46:56.030274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"137'8","reported_seq":19,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-06-10T19:05:50.865517+0000","last_change":"2023-06-10T19:05:50.450791+0000","last_active":"2023-06-10T19:05:50.865517+0000","last_peered":"2023-06-10T19:05:50.865517+0000","last_clean":"2023-06-10T19:05:50.865517+0000","last_became_active":"2023-06-10T19:05:50.450411+0000","last_became_peered":"2023-06-10T19:05:50.450411+0000","last_unstale":"2023-06-10T19:05:50.865517+0000","last_undegraded":"2023-06-10T19:05:50.865517+0000","last_fullsized":"2023-06-10T19:05:50.865517+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_clean_scrub_stamp":"2023-06-10T19:05:49.381507+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:42:29.198130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":231,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:51.799788+0000","last_change":"2023-06-10T18:52:40.671725+0000","last_active":"2023-06-10T19:05:51.799788+0000","last_peered":"2023-06-10T19:05:51.799788+0000","last_clean":"2023-06-10T19:05:51.799788+0000","last_became_active":"2023-06-10T18:52:40.671442+0000","last_became_peered":"2023-06-10T18:52:40.671442+0000","last_unstale":"2023-06-10T19:05:51.799788+0000","last_undegraded":"2023-06-10T19:05:51.799788+0000","last_fullsized":"2023-06-10T19:05:51.799788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:38:26.504917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-06-10T19:05:50.821286+0000","last_change":"2023-06-10T19:05:50.817246+0000","last_active":"2023-06-10T19:05:50.821286+0000","last_peered":"2023-06-10T19:05:50.821286+0000","last_clean":"2023-06-10T19:05:50.821286+0000","last_became_active":"2023-06-10T19:05:50.816818+0000","last_became_peered":"2023-06-10T19:05:50.816818+0000","last_unstale":"2023-06-10T19:05:50.821286+0000","last_undegraded":"2023-06-10T19:05:50.821286+0000","last_fullsized":"2023-06-10T19:05:50.821286+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:26:16.079224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"137'2","reported_seq":15,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:51.800137+0000","last_change":"2023-06-10T19:05:50.424153+0000","last_active":"2023-06-10T19:05:51.800137+0000","last_peered":"2023-06-10T19:05:51.800137+0000","last_clean":"2023-06-10T19:05:51.800137+0000","last_became_active":"2023-06-10T19:05:50.422802+0000","last_became_peered":"2023-06-10T19:05:50.422802+0000","last_unstale":"2023-06-10T19:05:51.800137+0000","last_undegraded":"2023-06-10T19:05:51.800137+0000","last_fullsized":"2023-06-10T19:05:51.800137+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_clean_scrub_stamp":"2023-06-10T19:05:49.381507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:37:50.905105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":231,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:51.803216+0000","last_change":"2023-06-10T18:52:40.510258+0000","last_active":"2023-06-10T19:05:51.803216+0000","last_peered":"2023-06-10T19:05:51.803216+0000","last_clean":"2023-06-10T19:05:51.803216+0000","last_became_active":"2023-06-10T18:52:40.509560+0000","last_became_peered":"2023-06-10T18:52:40.509560+0000","last_unstale":"2023-06-10T19:05:51.803216+0000","last_undegraded":"2023-06-10T19:05:51.803216+0000","last_fullsized":"2023-06-10T19:05:51.803216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:29:19.291465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.732123+0000","last_change":"2023-06-10T19:05:50.849759+0000","last_active":"2023-06-10T19:05:52.732123+0000","last_peered":"2023-06-10T19:05:52.732123+0000","last_clean":"2023-06-10T19:05:52.732123+0000","last_became_active":"2023-06-10T19:05:50.849111+0000","last_became_peered":"2023-06-10T19:05:50.849111+0000","last_unstale":"2023-06-10T19:05:52.732123+0000","last_undegraded":"2023-06-10T19:05:52.732123+0000","last_fullsized":"2023-06-10T19:05:52.732123+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:13:48.609493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"137'3","reported_seq":16,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.734047+0000","last_change":"2023-06-10T19:05:50.459724+0000","last_active":"2023-06-10T19:05:52.734047+0000","last_peered":"2023-06-10T19:05:52.734047+0000","last_clean":"2023-06-10T19:05:52.734047+0000","last_became_active":"2023-06-10T19:05:50.459161+0000","last_became_peered":"2023-06-10T19:05:50.459161+0000","last_unstale":"2023-06-10T19:05:52.734047+0000","last_undegraded":"2023-06-10T19:05:52.734047+0000","last_fullsized":"2023-06-10T19:05:52.734047+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_clean_scrub_stamp":"2023-06-10T19:05:49.381507+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:40:54.535176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":217,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-06-10T19:05:50.800741+0000","last_change":"2023-06-10T18:52:40.672266+0000","last_active":"2023-06-10T19:05:50.800741+0000","last_peered":"2023-06-10T19:05:50.800741+0000","last_clean":"2023-06-10T19:05:50.800741+0000","last_became_active":"2023-06-10T18:52:40.671966+0000","last_became_peered":"2023-06-10T18:52:40.671966+0000","last_unstale":"2023-06-10T19:05:50.800741+0000","last_undegraded":"2023-06-10T19:05:50.800741+0000","last_fullsized":"2023-06-10T19:05:50.800741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:37:46.363869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.734447+0000","last_change":"2023-06-10T19:05:50.863094+0000","last_active":"2023-06-10T19:05:52.734447+0000","last_peered":"2023-06-10T19:05:52.734447+0000","last_clean":"2023-06-10T19:05:52.734447+0000","last_became_active":"2023-06-10T19:05:50.861829+0000","last_became_peered":"2023-06-10T19:05:50.861829+0000","last_unstale":"2023-06-10T19:05:52.734447+0000","last_undegraded":"2023-06-10T19:05:52.734447+0000","last_fullsized":"2023-06-10T19:05:52.734447+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:16:14.220941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"137'6","reported_seq":19,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.733225+0000","last_change":"2023-06-10T19:05:50.452823+0000","last_active":"2023-06-10T19:05:52.733225+0000","last_peered":"2023-06-10T19:05:52.733225+0000","last_clean":"2023-06-10T19:05:52.733225+0000","last_became_active":"2023-06-10T19:05:50.452363+0000","last_became_peered":"2023-06-10T19:05:50.452363+0000","last_unstale":"2023-06-10T19:05:52.733225+0000","last_undegraded":"2023-06-10T19:05:52.733225+0000","last_fullsized":"2023-06-10T19:05:52.733225+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_clean_scrub_stamp":"2023-06-10T19:05:49.381507+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:01:03.823283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":217,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.733912+0000","last_change":"2023-06-10T18:52:40.671084+0000","last_active":"2023-06-10T19:05:52.733912+0000","last_peered":"2023-06-10T19:05:52.733912+0000","last_clean":"2023-06-10T19:05:52.733912+0000","last_became_active":"2023-06-10T18:52:40.670697+0000","last_became_peered":"2023-06-10T18:52:40.670697+0000","last_unstale":"2023-06-10T19:05:52.733912+0000","last_undegraded":"2023-06-10T19:05:52.733912+0000","last_fullsized":"2023-06-10T19:05:52.733912+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:04:09.898647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:51.799774+0000","last_change":"2023-06-10T19:05:50.863850+0000","last_active":"2023-06-10T19:05:51.799774+0000","last_peered":"2023-06-10T19:05:51.799774+0000","last_clean":"2023-06-10T19:05:51.799774+0000","last_became_active":"2023-06-10T19:05:50.863076+0000","last_became_peered":"2023-06-10T19:05:50.863076+0000","last_unstale":"2023-06-10T19:05:51.799774+0000","last_undegraded":"2023-06-10T19:05:51.799774+0000","last_fullsized":"2023-06-10T19:05:51.799774+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:12:46.361782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":13,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:51.805742+0000","last_change":"2023-06-10T19:05:50.439616+0000","last_active":"2023-06-10T19:05:51.805742+0000","last_peered":"2023-06-10T19:05:51.805742+0000","last_clean":"2023-06-10T19:05:51.805742+0000","last_became_active":"2023-06-10T19:05:50.437229+0000","last_became_peered":"2023-06-10T19:05:50.437229+0000","last_unstale":"2023-06-10T19:05:51.805742+0000","last_undegraded":"2023-06-10T19:05:51.805742+0000","last_fullsized":"2023-06-10T19:05:51.805742+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_clean_scrub_stamp":"2023-06-10T19:05:49.381507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:39:53.195805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":217,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-06-10T19:05:50.799652+0000","last_change":"2023-06-10T18:52:40.514114+0000","last_active":"2023-06-10T19:05:50.799652+0000","last_peered":"2023-06-10T19:05:50.799652+0000","last_clean":"2023-06-10T19:05:50.799652+0000","last_became_active":"2023-06-10T18:52:40.513638+0000","last_became_peered":"2023-06-10T18:52:40.513638+0000","last_unstale":"2023-06-10T19:05:50.799652+0000","last_undegraded":"2023-06-10T19:05:50.799652+0000","last_fullsized":"2023-06-10T19:05:50.799652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:25:01.720343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-06-10T19:05:50.820651+0000","last_change":"2023-06-10T19:05:50.812128+0000","last_active":"2023-06-10T19:05:50.820651+0000","last_peered":"2023-06-10T19:05:50.820651+0000","last_clean":"2023-06-10T19:05:50.820651+0000","last_became_active":"2023-06-10T19:05:50.811730+0000","last_became_peered":"2023-06-10T19:05:50.811730+0000","last_unstale":"2023-06-10T19:05:50.820651+0000","last_undegraded":"2023-06-10T19:05:50.820651+0000","last_fullsized":"2023-06-10T19:05:50.820651+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:50.395618+0000","last_clean_scrub_stamp":"2023-06-10T19:05:50.395618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:07:02.577307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":13,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:51.800699+0000","last_change":"2023-06-10T19:05:50.434211+0000","last_active":"2023-06-10T19:05:51.800699+0000","last_peered":"2023-06-10T19:05:51.800699+0000","last_clean":"2023-06-10T19:05:51.800699+0000","last_became_active":"2023-06-10T19:05:50.433897+0000","last_became_peered":"2023-06-10T19:05:50.433897+0000","last_unstale":"2023-06-10T19:05:51.800699+0000","last_undegraded":"2023-06-10T19:05:51.800699+0000","last_fullsized":"2023-06-10T19:05:51.800699+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:05:49.381507+0000","last_clean_scrub_stamp":"2023-06-10T19:05:49.381507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:24:34.025371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":219,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-06-10T19:05:52.735001+0000","last_change":"2023-06-10T18:52:40.515396+0000","last_active":"2023-06-10T19:05:52.735001+0000","last_peered":"2023-06-10T19:05:52.735001+0000","last_clean":"2023-06-10T19:05:52.735001+0000","last_became_active":"2023-06-10T18:52:40.514663+0000","last_became_peered":"2023-06-10T18:52:40.514663+0000","last_unstale":"2023-06-10T19:05:52.735001+0000","last_undegraded":"2023-06-10T19:05:52.735001+0000","last_fullsized":"2023-06-10T19:05:52.735001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:12:56.279905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575011,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33312,"kb_used_data":2264,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338528,"statfs":{"total":96636764160,"available":96602652672,"internally_reserved":0,"allocated":2318336,"data_stored":1384792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:05:00 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.93999999999999995,"15min":0.91800000000000004},"min":{"1min":0.53600000000000003,"5min":0.49399999999999999,"15min":0.434},"max":{"1min":1.351,"5min":1.351,"15min":1.6220000000000001},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.92000000000000004,"15min":0.92700000000000005},"min":{"1min":0.59599999999999997,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.153,"5min":1.2909999999999999,"15min":1.6870000000000001},"last":0.57799999999999996}]},{"osd":1,"last update":"Sat Jun 10 19:05:00 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.90700000000000003,"15min":0.91900000000000004},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1759999999999999,"5min":1.238,"15min":1.377},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.92900000000000005,"15min":0.94099999999999995},"min":{"1min":0.60399999999999998,"5min":0.51300000000000001,"15min":0.504},"max":{"1min":1.214,"5min":1.238,"15min":1.5960000000000001},"last":0.67800000000000005}]},{"osd":2,"last update":"Sat Jun 10 19:05:00 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.86399999999999999,"15min":0.84799999999999998},"min":{"1min":0.58599999999999997,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.26,"5min":1.26,"15min":1.4059999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.91900000000000004,"15min":0.90200000000000002},"min":{"1min":0.70799999999999996,"5min":0.54100000000000004,"15min":0.50600000000000001},"max":{"1min":1.3100000000000001,"5min":1.448,"15min":1.448},"last":0.78300000000000003}]},{"osd":3,"last update":"Sat Jun 10 19:05:00 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.90300000000000002,"15min":0.91500000000000004},"min":{"1min":0.68300000000000005,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.1539999999999999,"5min":1.2370000000000001,"15min":1.502},"last":0.82999999999999996},{"interface":"front","average":{"1min":1.0489999999999999,"5min":0.97799999999999998,"15min":0.95499999999999996},"min":{"1min":0.85599999999999998,"5min":0.432,"15min":0.432},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.86299999999999999}]},{"osd":4,"last update":"Sat Jun 10 19:05:00 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.82099999999999995,"15min":0.84899999999999998},"min":{"1min":0.64500000000000002,"5min":0.307,"15min":0.307},"max":{"1min":1.145,"5min":1.2210000000000001,"15min":1.639},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.998,"5min":0.96499999999999997,"15min":0.96599999999999997},"min":{"1min":0.70999999999999996,"5min":0.41199999999999998,"15min":0.40000000000000002},"max":{"1min":1.218,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.0920000000000001}]},{"osd":5,"last update":"Sat Jun 10 19:05:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1,"15min":1.0089999999999999},"min":{"1min":0.72899999999999998,"5min":0.40500000000000003,"15min":0.38400000000000001},"max":{"1min":1.3100000000000001,"5min":1.379,"15min":1.806},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0269999999999999,"15min":1.034},"min":{"1min":0.67500000000000004,"5min":0.48499999999999999,"15min":0.46500000000000002},"max":{"1min":1.3,"5min":1.579,"15min":1.579},"last":0.96799999999999997}]},{"osd":6,"last update":"Sat Jun 10 19:05:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.006,"15min":1.0069999999999999},"min":{"1min":0.70399999999999996,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.274,"5min":1.391,"15min":1.718},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.0940000000000001,"15min":1.0940000000000001},"min":{"1min":0.91000000000000003,"5min":0.48799999999999999,"15min":0.441},"max":{"1min":1.5129999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":1.0429999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575012,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32724,"kb_used_data":1676,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339116,"statfs":{"total":96636764160,"available":96603254784,"internally_reserved":0,"allocated":1716224,"data_stored":793442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:04:50 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.84499999999999997,"15min":0.85799999999999998},"min":{"1min":0.64600000000000002,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.498},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.87,"15min":0.876},"min":{"1min":0.63100000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.175,"5min":1.2250000000000001,"15min":1.496},"last":0.66800000000000004}]},{"osd":1,"last update":"Sat Jun 10 19:04:50 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.86299999999999999,"15min":0.86699999999999999},"min":{"1min":0.51500000000000001,"5min":0.502,"15min":0.48699999999999999},"max":{"1min":1.163,"5min":1.163,"15min":1.5229999999999999},"last":0.872},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.90100000000000002,"15min":0.89600000000000002},"min":{"1min":0.61599999999999999,"5min":0.48699999999999999,"15min":0.45300000000000001},"max":{"1min":1.204,"5min":1.258,"15min":1.778},"last":0.83299999999999996}]},{"osd":2,"last update":"Sat Jun 10 19:04:50 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.92600000000000005,"15min":0.89800000000000002},"min":{"1min":0.55200000000000005,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.224,"5min":1.2809999999999999,"15min":1.3759999999999999},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.88,"15min":0.88800000000000001},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.145,"5min":1.2330000000000001,"15min":1.246},"last":0.61299999999999999}]},{"osd":3,"last update":"Sat Jun 10 19:04:50 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.92500000000000004,"15min":0.91100000000000003},"min":{"1min":0.72199999999999998,"5min":0.55100000000000005,"15min":0.52700000000000002},"max":{"1min":1.161,"5min":1.238,"15min":1.7190000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.97499999999999998,"15min":0.98999999999999999},"min":{"1min":0.68100000000000005,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.22,"5min":1.371,"15min":1.4370000000000001},"last":0.98099999999999998}]},{"osd":4,"last update":"Sat Jun 10 19:04:50 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.89300000000000002,"15min":0.91600000000000004},"min":{"1min":0.45900000000000002,"5min":0.373,"15min":0.373},"max":{"1min":1.167,"5min":1.401,"15min":1.798},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.98099999999999998,"15min":0.98799999999999999},"min":{"1min":0.52800000000000002,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.2669999999999999,"5min":1.357,"15min":1.5489999999999999},"last":1.0649999999999999}]},{"osd":5,"last update":"Sat Jun 10 19:04:50 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.90300000000000002,"15min":0.92100000000000004},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.163,"5min":1.29,"15min":1.333},"last":1.0940000000000001},{"interface":"front","average":{"1min":0.98299999999999998,"5min":1.004,"15min":1.022},"min":{"1min":0.50700000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.296,"5min":1.296,"15min":2.536},"last":1.028}]},{"osd":7,"last update":"Sat Jun 10 19:04:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.0429999999999999,"15min":1.0349999999999999},"min":{"1min":0.59199999999999997,"5min":0.58599999999999997,"15min":0.57099999999999995},"max":{"1min":1.3029999999999999,"5min":1.879,"15min":1.917},"last":1.155},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.98599999999999999,"15min":1.0169999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.258,"5min":1.4850000000000001,"15min":1.5569999999999999},"last":1.179}]}]},{"osd":5,"up_from":13,"seq":55834575012,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32732,"kb_used_data":1684,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339108,"statfs":{"total":96636764160,"available":96603246592,"internally_reserved":0,"allocated":1724416,"data_stored":799445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.877,"15min":0.873},"min":{"1min":0.51500000000000001,"5min":0.499,"15min":0.499},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.94199999999999995,"15min":0.91800000000000004},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.49399999999999999},"max":{"1min":1.212,"5min":2.347,"15min":2.347},"last":1.093}]},{"osd":1,"last update":"Sat Jun 10 19:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.96299999999999997,"15min":0.91900000000000004},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.52600000000000002},"max":{"1min":1.6739999999999999,"5min":7.0800000000000001,"15min":7.0800000000000001},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.86499999999999999,"5min":1.117,"15min":0.98399999999999999},"min":{"1min":0.59599999999999997,"5min":0.56499999999999995,"15min":0.53800000000000003},"max":{"1min":1.171,"5min":15.845000000000001,"15min":15.845000000000001},"last":1.1319999999999999}]},{"osd":2,"last update":"Sat Jun 10 19:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.94999999999999996,"15min":0.89400000000000002},"min":{"1min":0.59899999999999998,"5min":0.54300000000000004,"15min":0.48299999999999998},"max":{"1min":1.6459999999999999,"5min":5.0049999999999999,"15min":5.0049999999999999},"last":1.012},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.99299999999999999,"15min":0.94499999999999995},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.391,"5min":6.851,"15min":6.851},"last":0.86399999999999999}]},{"osd":3,"last update":"Sat Jun 10 19:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.96799999999999997,"15min":0.95599999999999996},"min":{"1min":0.58699999999999997,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.6910000000000001,"5min":2.544,"15min":2.544},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.98299999999999998,"5min":1.004,"15min":0.999},"min":{"1min":0.66000000000000003,"5min":0.63100000000000001,"15min":0.59799999999999998},"max":{"1min":1.4870000000000001,"5min":3.0830000000000002,"15min":3.0830000000000002},"last":1.1659999999999999}]},{"osd":4,"last update":"Sat Jun 10 19:05:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.012,"15min":0.95699999999999996},"min":{"1min":0.65300000000000002,"5min":0.64000000000000001,"15min":0.58099999999999996},"max":{"1min":1.6140000000000001,"5min":6.7290000000000001,"15min":6.7290000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.97399999999999998,"15min":0.99399999999999999},"min":{"1min":0.70199999999999996,"5min":0.64900000000000002,"15min":0.61199999999999999},"max":{"1min":1.446,"5min":1.446,"15min":1.575},"last":0.97999999999999998}]},{"osd":6,"last update":"Sat Jun 10 19:05:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":0.98999999999999999,"15min":0.997},"min":{"1min":0.65300000000000002,"5min":0.60499999999999998,"15min":0.54200000000000004},"max":{"1min":1.8009999999999999,"5min":1.8009999999999999,"15min":1.8009999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.105,"15min":1.0600000000000001},"min":{"1min":0.73299999999999998,"5min":0.71999999999999997,"15min":0.57899999999999996},"max":{"1min":1.8380000000000001,"5min":6.923,"15min":6.923},"last":0.92000000000000004}]},{"osd":7,"last update":"Sat Jun 10 19:05:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.101,"15min":1.095},"min":{"1min":0.70699999999999996,"5min":0.69899999999999995,"15min":0.66200000000000003},"max":{"1min":1.7749999999999999,"5min":2.6080000000000001,"15min":2.6080000000000001},"last":1.0589999999999999},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1850000000000001,"15min":1.143},"min":{"1min":0.84399999999999997,"5min":0.72499999999999998,"15min":0.66200000000000003},"max":{"1min":1.732,"5min":5.4169999999999998,"15min":5.4169999999999998},"last":0.94399999999999995}]}]},{"osd":4,"up_from":13,"seq":55834575011,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32728,"kb_used_data":1680,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339112,"statfs":{"total":96636764160,"available":96603250688,"internally_reserved":0,"allocated":1720320,"data_stored":799423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.84999999999999998,"15min":0.82299999999999995},"min":{"1min":0.52800000000000002,"5min":0.45400000000000001,"15min":0.45100000000000001},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.88500000000000001,"15min":0.90400000000000003},"min":{"1min":0.67200000000000004,"5min":0.49199999999999999,"15min":0.48899999999999999},"max":{"1min":1.196,"5min":1.3979999999999999,"15min":3.7280000000000002},"last":0.99299999999999999}]},{"osd":1,"last update":"Sat Jun 10 19:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.91300000000000003,"15min":0.94099999999999995},"min":{"1min":0.49199999999999999,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":3.3969999999999998},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.878,"5min":0.83699999999999997,"15min":0.85999999999999999},"min":{"1min":0.58399999999999996,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":2.496},"last":0.47899999999999998}]},{"osd":2,"last update":"Sat Jun 10 19:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.873,"15min":0.88300000000000001},"min":{"1min":0.53400000000000003,"5min":0.52200000000000002,"15min":0.49299999999999999},"max":{"1min":1.143,"5min":1.3,"15min":1.522},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.96699999999999997,"15min":0.99199999999999999},"min":{"1min":0.70899999999999996,"5min":0.64400000000000002,"15min":0.55000000000000004},"max":{"1min":1.169,"5min":1.2649999999999999,"15min":3.5750000000000002},"last":0.93799999999999994}]},{"osd":3,"last update":"Sat Jun 10 19:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.90400000000000003,"15min":0.89900000000000002},"min":{"1min":0.628,"5min":0.56200000000000006,"15min":0.53900000000000003},"max":{"1min":1.28,"5min":1.46,"15min":2.3809999999999998},"last":0.68799999999999994},{"interface":"front","average":{"1min":1.028,"5min":0.95699999999999996,"15min":0.96499999999999997},"min":{"1min":0.71899999999999997,"5min":0.61499999999999999,"15min":0.54400000000000004},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.6479999999999999},"last":1.014}]},{"osd":5,"last update":"Sat Jun 10 19:05:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":0.94499999999999995,"15min":0.96599999999999997},"min":{"1min":0.70399999999999996,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.236,"5min":1.3360000000000001,"15min":3.6539999999999999},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.92500000000000004,"15min":0.95099999999999996},"min":{"1min":0.65800000000000003,"5min":0.495,"15min":0.495},"max":{"1min":1.2250000000000001,"5min":1.26,"15min":2.6720000000000002},"last":0.60499999999999998}]},{"osd":6,"last update":"Sat Jun 10 19:05:06 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.97499999999999998,"15min":0.98099999999999998},"min":{"1min":0.60399999999999998,"5min":0.58499999999999996,"15min":0.54900000000000004},"max":{"1min":1.413,"5min":1.413,"15min":2.2639999999999998},"last":0.89400000000000002},{"interface":"front","average":{"1min":1.131,"5min":1.0649999999999999,"15min":1.071},"min":{"1min":0.753,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":3.4980000000000002},"last":0.63200000000000001}]},{"osd":7,"last update":"Sat Jun 10 19:05:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.0189999999999999,"15min":0.999},"min":{"1min":0.79100000000000004,"5min":0.63800000000000001,"15min":0.41399999999999998},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":2.5910000000000002},"last":0.83299999999999996},{"interface":"front","average":{"1min":1.105,"5min":1.0780000000000001,"15min":1.0720000000000001},"min":{"1min":0.79900000000000004,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.3420000000000001,"5min":1.4279999999999999,"15min":1.4399999999999999},"last":1.0660000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575010,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36824,"kb_used_data":1680,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335016,"statfs":{"total":96636764160,"available":96599056384,"internally_reserved":0,"allocated":1720320,"data_stored":793385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.63900000000000001,"15min":0.62},"min":{"1min":0.42099999999999999,"5min":0.248,"15min":0.248},"max":{"1min":0.99299999999999999,"5min":1.1539999999999999,"15min":1.169},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.67500000000000004,"15min":0.66800000000000004},"min":{"1min":0.318,"5min":0.30299999999999999,"15min":0.251},"max":{"1min":0.96899999999999997,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.84799999999999998}]},{"osd":1,"last update":"Sat Jun 10 19:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.69299999999999995,"15min":0.67900000000000005},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.27500000000000002},"max":{"1min":0.98799999999999999,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.71299999999999997,"15min":0.73199999999999998},"min":{"1min":0.35499999999999998,"5min":0.34399999999999997,"15min":0.318},"max":{"1min":0.89700000000000002,"5min":1.2569999999999999,"15min":1.411},"last":0.89700000000000002}]},{"osd":2,"last update":"Sat Jun 10 19:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.75600000000000001,"15min":0.77400000000000002},"min":{"1min":0.40699999999999997,"5min":0.39300000000000002,"15min":0.30299999999999999},"max":{"1min":1.155,"5min":1.2829999999999999,"15min":1.9530000000000001},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.81299999999999994,"15min":0.79000000000000004},"min":{"1min":0.39200000000000002,"5min":0.35299999999999998,"15min":0.29699999999999999},"max":{"1min":1.2769999999999999,"5min":1.591,"15min":1.591},"last":1.0329999999999999}]},{"osd":4,"last update":"Sat Jun 10 19:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.96599999999999997,"15min":0.95599999999999996},"min":{"1min":0.67800000000000005,"5min":0.60899999999999999,"15min":0.41899999999999998},"max":{"1min":1.333,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":1.333},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.98899999999999999,"15min":0.99199999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.47999999999999998},"max":{"1min":1.2110000000000001,"5min":1.873,"15min":1.873},"last":0.95799999999999996}]},{"osd":5,"last update":"Sat Jun 10 19:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":1.004,"15min":1.0169999999999999},"min":{"1min":0.55900000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.3120000000000001,"5min":1.752,"15min":2.024},"last":1.165},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0369999999999999,"15min":1.0309999999999999},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.46899999999999997},"max":{"1min":1.337,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":1.282}]},{"osd":6,"last update":"Sat Jun 10 19:05:52 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.0669999999999999,"15min":1.0609999999999999},"min":{"1min":0.625,"5min":0.56999999999999995,"15min":0.55300000000000005},"max":{"1min":1.258,"5min":1.786,"15min":1.8500000000000001},"last":1.123},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0589999999999999,"15min":1.0580000000000001},"min":{"1min":0.69499999999999995,"5min":0.61199999999999999,"15min":0.58799999999999997},"max":{"1min":1.3029999999999999,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":1.081}]},{"osd":7,"last update":"Sat Jun 10 19:05:52 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.0800000000000001,"15min":1.093},"min":{"1min":0.77200000000000002,"5min":0.57999999999999996,"15min":0.56999999999999995},"max":{"1min":1.27,"5min":2.1150000000000002,"15min":2.1150000000000002},"last":1.2110000000000001},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.089,"15min":1.0960000000000001},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.61099999999999999},"max":{"1min":1.3129999999999999,"5min":1.9850000000000001,"15min":1.9850000000000001},"last":1.242}]}]},{"osd":2,"up_from":13,"seq":55834575011,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32736,"kb_used_data":1688,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339104,"statfs":{"total":96636764160,"available":96603242496,"internally_reserved":0,"allocated":1728512,"data_stored":800039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:04:59 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.621,"15min":0.61299999999999999},"min":{"1min":0.33700000000000002,"5min":0.31,"15min":0.27300000000000002},"max":{"1min":0.98799999999999999,"5min":1.095,"15min":1.1220000000000001},"last":2.883},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.71699999999999997,"15min":0.72199999999999998},"min":{"1min":0.34999999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":6.5670000000000002}]},{"osd":1,"last update":"Sat Jun 10 19:04:59 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.65900000000000003,"15min":0.66600000000000004},"min":{"1min":0.39600000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.1950000000000001},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.745,"15min":0.748},"min":{"1min":0.375,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.1799999999999999,"5min":1.446,"15min":1.446},"last":8.4429999999999996}]},{"osd":3,"last update":"Sat Jun 10 19:04:59 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.78200000000000003,"15min":0.76900000000000002},"min":{"1min":0.45700000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.127,"5min":1.1899999999999999,"15min":1.2350000000000001},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.75800000000000001,"15min":0.77200000000000002},"min":{"1min":0.41799999999999998,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":1.032,"5min":1.181,"15min":1.3340000000000001},"last":4.1849999999999996}]},{"osd":4,"last update":"Sat Jun 10 19:04:59 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.90800000000000003,"15min":0.92500000000000004},"min":{"1min":0.67600000000000005,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.337,"5min":1.337,"15min":1.3620000000000001},"last":2.8420000000000001},{"interface":"front","average":{"1min":1.044,"5min":0.996,"15min":1.0169999999999999},"min":{"1min":0.59699999999999998,"5min":0.496,"15min":0.496},"max":{"1min":1.3149999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":13.254}]},{"osd":5,"last update":"Sat Jun 10 19:04:59 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":0.997,"15min":1.0129999999999999},"min":{"1min":0.63400000000000001,"5min":0.55900000000000005,"15min":0.54100000000000004},"max":{"1min":1.3129999999999999,"5min":1.5429999999999999,"15min":1.5700000000000001},"last":6.9189999999999996},{"interface":"front","average":{"1min":1.105,"5min":1.01,"15min":1.014},"min":{"1min":0.753,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.5309999999999999,"5min":1.5609999999999999,"15min":1.667},"last":15.526}]},{"osd":6,"last update":"Sat Jun 10 19:04:59 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.03,"15min":1.044},"min":{"1min":0.77800000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.5900000000000001},"last":8.7089999999999996},{"interface":"front","average":{"1min":1.054,"5min":1.0309999999999999,"15min":1.0449999999999999},"min":{"1min":0.58499999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.341,"5min":1.486,"15min":1.6499999999999999},"last":6.1299999999999999}]},{"osd":7,"last update":"Sat Jun 10 19:04:59 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.097,"15min":1.1000000000000001},"min":{"1min":0.70499999999999996,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.339,"5min":1.734,"15min":1.734},"last":10.760999999999999},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.101,"15min":1.109},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.48,"5min":1.657,"15min":1.752},"last":0.56299999999999994}]}]},{"osd":1,"up_from":13,"seq":55834575013,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36812,"kb_used_data":1668,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335028,"statfs":{"total":96636764160,"available":96599068672,"internally_reserved":0,"allocated":1708032,"data_stored":791821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:04:59 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65800000000000003,"15min":0.67500000000000004},"min":{"1min":0.36399999999999999,"5min":0.28599999999999998,"15min":0.25800000000000001},"max":{"1min":1.048,"5min":1.111,"15min":1.288},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.72899999999999998,"15min":0.73999999999999999},"min":{"1min":0.35399999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.105,"5min":1.1859999999999999,"15min":1.694},"last":0.56399999999999995}]},{"osd":2,"last update":"Sat Jun 10 19:04:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.63400000000000001,"15min":0.63800000000000001},"min":{"1min":0.38200000000000001,"5min":0.308,"15min":0.249},"max":{"1min":0.84099999999999997,"5min":1.0900000000000001,"15min":1.21},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.70499999999999996,"15min":0.71399999999999997},"min":{"1min":0.433,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.415},"last":0.46300000000000002}]},{"osd":3,"last update":"Sat Jun 10 19:04:59 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.75900000000000001,"15min":0.77900000000000003},"min":{"1min":0.34000000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.034,"5min":1.1679999999999999,"15min":1.6299999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.754,"5min":0.70599999999999996,"15min":0.74099999999999999},"min":{"1min":0.45900000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.998,"5min":1.2909999999999999,"15min":2.1749999999999998},"last":0.41199999999999998}]},{"osd":4,"last update":"Sat Jun 10 19:04:59 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.85799999999999998,"15min":0.86199999999999999},"min":{"1min":0.627,"5min":0.56399999999999995,"15min":0.53000000000000003},"max":{"1min":1.196,"5min":1.343,"15min":1.4930000000000001},"last":1.0309999999999999},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.96099999999999997,"15min":1.038},"min":{"1min":0.63900000000000001,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.2010000000000001,"5min":1.492,"15min":5.8209999999999997},"last":1.0549999999999999}]},{"osd":5,"last update":"Sat Jun 10 19:04:59 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.97399999999999998,"15min":1.0029999999999999},"min":{"1min":0.66800000000000004,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.244,"5min":1.6299999999999999,"15min":1.8620000000000001},"last":1.222},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.94999999999999996,"15min":0.97599999999999998},"min":{"1min":0.59999999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.2809999999999999,"5min":1.3220000000000001,"15min":3.089},"last":0.92500000000000004}]},{"osd":6,"last update":"Sat Jun 10 19:04:59 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.999,"15min":1.0489999999999999},"min":{"1min":0.71699999999999997,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.145,"5min":1.6759999999999999,"15min":7.2599999999999998},"last":1.1100000000000001},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.98999999999999999,"15min":1.0349999999999999},"min":{"1min":0.72899999999999998,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.341,"5min":1.6000000000000001,"15min":9.0069999999999997},"last":1.1859999999999999}]},{"osd":7,"last update":"Sat Jun 10 19:04:59 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.05,"15min":1.0820000000000001},"min":{"1min":0.69999999999999996,"5min":0.495,"15min":0.495},"max":{"1min":1.4339999999999999,"5min":1.494,"15min":2.105},"last":1.0049999999999999},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.046,"15min":1.0820000000000001},"min":{"1min":0.75700000000000001,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.4670000000000001,"5min":1.5620000000000001,"15min":2.2570000000000001},"last":0.96699999999999997}]}]},{"osd":0,"up_from":13,"seq":55834575012,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37396,"kb_used_data":2252,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334444,"statfs":{"total":96636764160,"available":96598470656,"internally_reserved":0,"allocated":2306048,"data_stored":1382175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jun 10 19:04:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.61699999999999999,"15min":0.63},"min":{"1min":0.34100000000000003,"5min":0.248,"15min":0.248},"max":{"1min":1.042,"5min":1.127,"15min":1.127},"last":0.88},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.78800000000000003,"15min":0.79800000000000004},"min":{"1min":0.38,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.093,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.98899999999999999}]},{"osd":2,"last update":"Sat Jun 10 19:04:58 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.71999999999999997,"15min":0.71599999999999997},"min":{"1min":0.38100000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.1970000000000001,"5min":1.2010000000000001,"15min":1.2829999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.64100000000000001,"15min":0.65300000000000002},"min":{"1min":0.28699999999999998,"5min":0.27600000000000002,"15min":0.245},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.371},"last":0.61899999999999999}]},{"osd":3,"last update":"Sat Jun 10 19:04:58 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.66000000000000003,"15min":0.68400000000000005},"min":{"1min":0.40100000000000002,"5min":0.29499999999999998,"15min":0.28899999999999998},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.226},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.80400000000000005,"15min":0.82399999999999995},"min":{"1min":0.435,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.321,"5min":1.742,"15min":1.829},"last":0.92200000000000004}]},{"osd":4,"last update":"Sat Jun 10 19:04:58 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.90700000000000003,"15min":0.92000000000000004},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.1619999999999999,"5min":1.7250000000000001,"15min":3.0209999999999999},"last":1.0569999999999999},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.012,"15min":1.0289999999999999},"min":{"1min":0.69199999999999995,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.2270000000000001,"5min":1.873,"15min":1.9510000000000001},"last":1.1100000000000001}]},{"osd":5,"last update":"Sat Jun 10 19:04:58 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.91900000000000004,"15min":0.93999999999999995},"min":{"1min":0.624,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.206,"5min":1.3109999999999999,"15min":1.694},"last":1.012},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.97799999999999998,"15min":1.008},"min":{"1min":0.71699999999999997,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.2749999999999999,"5min":1.78,"15min":4.5620000000000003},"last":0.97499999999999998}]},{"osd":6,"last update":"Sat Jun 10 19:04:58 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.042,"15min":1.077},"min":{"1min":0.58699999999999997,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.395,"5min":1.7909999999999999,"15min":3.5569999999999999},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.0109999999999999,"5min":0.98799999999999999,"15min":1.002},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.3049999999999999,"5min":1.6319999999999999,"15min":1.883},"last":0.95199999999999996}]},{"osd":7,"last update":"Sat Jun 10 19:04:58 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.0129999999999999,"15min":1.032},"min":{"1min":0.57299999999999995,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.2250000000000001,"5min":1.512,"15min":1.5800000000000001},"last":0.84599999999999997},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.036,"15min":1.0580000000000001},"min":{"1min":0.80600000000000005,"5min":0.624,"15min":0.58699999999999997},"max":{"1min":1.298,"5min":1.6619999999999999,"15min":1.9830000000000001},"last":1.129}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-10T19:05:55.193 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-06-10T19:05:55.194 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-06-10T19:05:55.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.347+0000 7fc21ee25640 1 Processor -- start 2023-06-10T19:05:55.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.347+0000 7fc21ee25640 1 -- start start 2023-06-10T19:05:55.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.347+0000 7fc21ee25640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc2180af810 0x7fc2180cd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:55.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.347+0000 7fc21ee25640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2181599b0 0x7fc2180afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:55.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.347+0000 7fc21ee25640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc218070460 0x7fc2180cb960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:55.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.347+0000 7fc21ee25640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2180ccee0 con 0x7fc2180af810 2023-06-10T19:05:55.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.347+0000 7fc21ee25640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2180b0120 con 0x7fc218070460 2023-06-10T19:05:55.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.347+0000 7fc21ee25640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2180cc2d0 con 0x7fc2181599b0 2023-06-10T19:05:55.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.347+0000 7fc21cbc1640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc2180af810 0x7fc2180cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:55.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.347+0000 7fc21cbc1640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc2180af810 0x7fc2180cd370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47222/0 (socket says 172.21.15.53:47222) 2023-06-10T19:05:55.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.347+0000 7fc21cbc1640 1 -- 172.21.15.53:0/2211848840 learned_addr learned my addr 172.21.15.53:0/2211848840 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:55.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.347+0000 7fc217fff640 1 --2- 172.21.15.53:0/2211848840 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2181599b0 0x7fc2180afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:55.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.347+0000 7fc21d3c2640 1 --2- 172.21.15.53:0/2211848840 >> v2:172.21.15.117:3300/0 conn(0x7fc218070460 0x7fc2180cb960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:55.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.347+0000 7fc21cbc1640 1 -- 172.21.15.53:0/2211848840 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2181599b0 msgr2=0x7fc2180afbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:55.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.347+0000 7fc21cbc1640 1 --2- 172.21.15.53:0/2211848840 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2181599b0 0x7fc2180afbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:55.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.347+0000 7fc21cbc1640 1 -- 172.21.15.53:0/2211848840 >> v2:172.21.15.117:3300/0 conn(0x7fc218070460 msgr2=0x7fc2180cb960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:55.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.347+0000 7fc21cbc1640 1 --2- 172.21.15.53:0/2211848840 >> v2:172.21.15.117:3300/0 conn(0x7fc218070460 0x7fc2180cb960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:55.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.347+0000 7fc21cbc1640 1 -- 172.21.15.53:0/2211848840 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2180cc5b0 con 0x7fc2180af810 2023-06-10T19:05:55.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.351+0000 7fc21cbc1640 1 --2- 172.21.15.53:0/2211848840 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2180af810 0x7fc2180cd370 secure :-1 s=READY pgs=2042 cs=0 l=1 rev1=1 crypto rx=0x7fc2180c8370 tx=0x7fc20801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3205e4b779beba27 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:55.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.351+0000 7fc2177fe640 1 -- 172.21.15.53:0/2211848840 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2080aa5f0 con 0x7fc2180af810 2023-06-10T19:05:55.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.351+0000 7fc2177fe640 1 -- 172.21.15.53:0/2211848840 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2080aa750 con 0x7fc2180af810 2023-06-10T19:05:55.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.351+0000 7fc2177fe640 1 -- 172.21.15.53:0/2211848840 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2080aaae0 con 0x7fc2180af810 2023-06-10T19:05:55.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.351+0000 7fc21ee25640 1 -- 172.21.15.53:0/2211848840 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2180af810 msgr2=0x7fc2180cd370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:55.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.351+0000 7fc21ee25640 1 --2- 172.21.15.53:0/2211848840 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2180af810 0x7fc2180cd370 secure :-1 s=READY pgs=2042 cs=0 l=1 rev1=1 crypto rx=0x7fc2180c8370 tx=0x7fc20801c4d0 comp rx=0 tx=0).stop 2023-06-10T19:05:55.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.351+0000 7fc21ee25640 1 -- 172.21.15.53:0/2211848840 shutdown_connections 2023-06-10T19:05:55.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.351+0000 7fc21ee25640 1 --2- 172.21.15.53:0/2211848840 >> v2:172.21.15.117:3300/0 conn(0x7fc218070460 0x7fc2180cb960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:55.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.351+0000 7fc21ee25640 1 --2- 172.21.15.53:0/2211848840 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2181599b0 0x7fc2180afbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:55.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.351+0000 7fc21ee25640 1 --2- 172.21.15.53:0/2211848840 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2180af810 0x7fc2180cd370 unknown :-1 s=CLOSED pgs=2042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:55.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.351+0000 7fc21ee25640 1 -- 172.21.15.53:0/2211848840 >> 172.21.15.53:0/2211848840 conn(0x7fc21806a0e0 msgr2=0x7fc2180ca810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:55.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.351+0000 7fc21ee25640 1 -- 172.21.15.53:0/2211848840 shutdown_connections 2023-06-10T19:05:55.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.351+0000 7fc21ee25640 1 -- 172.21.15.53:0/2211848840 wait complete. 2023-06-10T19:05:55.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.355+0000 7fc21ee25640 1 Processor -- start 2023-06-10T19:05:55.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.355+0000 7fc21ee25640 1 -- start start 2023-06-10T19:05:55.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.355+0000 7fc21ee25640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc218070460 0x7fc2180c6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:55.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.355+0000 7fc21ee25640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2180af810 0x7fc21815c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:55.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.355+0000 7fc21ee25640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2181599b0 0x7fc2180c3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:55.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.355+0000 7fc21ee25640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2180c4930 con 0x7fc2180af810 2023-06-10T19:05:55.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.355+0000 7fc21ee25640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2180c7890 con 0x7fc2181599b0 2023-06-10T19:05:55.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.355+0000 7fc21ee25640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2180c7dc0 con 0x7fc218070460 2023-06-10T19:05:55.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.355+0000 7fc217fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2180af810 0x7fc21815c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:55.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.355+0000 7fc217fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2180af810 0x7fc21815c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47230/0 (socket says 172.21.15.53:47230) 2023-06-10T19:05:55.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.355+0000 7fc217fff640 1 -- 172.21.15.53:0/3900766588 learned_addr learned my addr 172.21.15.53:0/3900766588 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:55.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.355+0000 7fc21cbc1640 1 --2- 172.21.15.53:0/3900766588 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc218070460 0x7fc2180c6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:55.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.355+0000 7fc21d3c2640 1 --2- 172.21.15.53:0/3900766588 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2181599b0 0x7fc2180c3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:55.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.355+0000 7fc217fff640 1 -- 172.21.15.53:0/3900766588 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc218070460 msgr2=0x7fc2180c6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:55.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.355+0000 7fc217fff640 1 --2- 172.21.15.53:0/3900766588 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc218070460 0x7fc2180c6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:55.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.355+0000 7fc217fff640 1 -- 172.21.15.53:0/3900766588 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2181599b0 msgr2=0x7fc2180c3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:55.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.355+0000 7fc217fff640 1 --2- 172.21.15.53:0/3900766588 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2181599b0 0x7fc2180c3840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:55.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.355+0000 7fc217fff640 1 -- 172.21.15.53:0/3900766588 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2080094d0 con 0x7fc2180af810 2023-06-10T19:05:55.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.355+0000 7fc217fff640 1 --2- 172.21.15.53:0/3900766588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2180af810 0x7fc21815c070 secure :-1 s=READY pgs=2043 cs=0 l=1 rev1=1 crypto rx=0x7fc20c006e90 tx=0x7fc20c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:55.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.355+0000 7fc2157fa640 1 -- 172.21.15.53:0/3900766588 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc20c00b6c0 con 0x7fc2180af810 2023-06-10T19:05:55.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.355+0000 7fc2157fa640 1 -- 172.21.15.53:0/3900766588 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc20c00b840 con 0x7fc2180af810 2023-06-10T19:05:55.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.355+0000 7fc21ee25640 1 -- 172.21.15.53:0/3900766588 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2180c59a0 con 0x7fc2180af810 2023-06-10T19:05:55.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.355+0000 7fc2157fa640 1 -- 172.21.15.53:0/3900766588 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc20c00bbf0 con 0x7fc2180af810 2023-06-10T19:05:55.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.355+0000 7fc21ee25640 1 -- 172.21.15.53:0/3900766588 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2180c5c40 con 0x7fc2180af810 2023-06-10T19:05:55.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.355+0000 7fc21ee25640 1 -- 172.21.15.53:0/3900766588 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc21804d790 con 0x7fc2180af810 2023-06-10T19:05:55.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.355+0000 7fc2157fa640 1 -- 172.21.15.53:0/3900766588 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc20c00bd50 con 0x7fc2180af810 2023-06-10T19:05:55.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.359+0000 7fc2157fa640 1 --2- 172.21.15.53:0/3900766588 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc204066280 0x7fc204068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:55.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.359+0000 7fc2157fa640 1 -- 172.21.15.53:0/3900766588 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc20c084230 con 0x7fc2180af810 2023-06-10T19:05:55.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.359+0000 7fc21cbc1640 1 --2- 172.21.15.53:0/3900766588 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc204066280 0x7fc204068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:55.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.359+0000 7fc21cbc1640 1 --2- 172.21.15.53:0/3900766588 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc204066280 0x7fc204068730 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fc2080ae000 tx=0x7fc2080a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:55.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.363+0000 7fc2157fa640 1 -- 172.21.15.53:0/3900766588 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc20c0516b0 con 0x7fc2180af810 2023-06-10T19:05:55.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.571+0000 7fc21ee25640 1 -- 172.21.15.53:0/3900766588 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fc2180b3690 con 0x7fc2180af810 2023-06-10T19:05:55.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.579+0000 7fc2157fa640 1 -- 172.21.15.53:0/3900766588 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v20) v1 ==== 190+0+0 (secure 0 0 0) 0x7fc20c054cd0 con 0x7fc2180af810 2023-06-10T19:05:55.584 INFO:teuthology.orchestra.run.smithi053.stderr:updated caps for client.0 2023-06-10T19:05:55.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.579+0000 7fc21ee25640 1 -- 172.21.15.53:0/3900766588 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc204066280 msgr2=0x7fc204068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:55.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.579+0000 7fc21ee25640 1 --2- 172.21.15.53:0/3900766588 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc204066280 0x7fc204068730 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fc2080ae000 tx=0x7fc2080a7000 comp rx=0 tx=0).stop 2023-06-10T19:05:55.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.579+0000 7fc21ee25640 1 -- 172.21.15.53:0/3900766588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2180af810 msgr2=0x7fc21815c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:55.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.579+0000 7fc21ee25640 1 --2- 172.21.15.53:0/3900766588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2180af810 0x7fc21815c070 secure :-1 s=READY pgs=2043 cs=0 l=1 rev1=1 crypto rx=0x7fc20c006e90 tx=0x7fc20c00dc60 comp rx=0 tx=0).stop 2023-06-10T19:05:55.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.579+0000 7fc21ee25640 1 -- 172.21.15.53:0/3900766588 shutdown_connections 2023-06-10T19:05:55.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.579+0000 7fc21ee25640 1 --2- 172.21.15.53:0/3900766588 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc204066280 0x7fc204068730 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:55.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.579+0000 7fc21ee25640 1 --2- 172.21.15.53:0/3900766588 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2181599b0 0x7fc2180c3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:55.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.579+0000 7fc21ee25640 1 --2- 172.21.15.53:0/3900766588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2180af810 0x7fc21815c070 unknown :-1 s=CLOSED pgs=2043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:55.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.579+0000 7fc21ee25640 1 --2- 172.21.15.53:0/3900766588 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc218070460 0x7fc2180c6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:55.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.579+0000 7fc21ee25640 1 -- 172.21.15.53:0/3900766588 >> 172.21.15.53:0/3900766588 conn(0x7fc21806a0e0 msgr2=0x7fc2180c9cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:55.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.579+0000 7fc21ee25640 1 -- 172.21.15.53:0/3900766588 shutdown_connections 2023-06-10T19:05:55.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.583+0000 7fc21ee25640 1 -- 172.21.15.53:0/3900766588 wait complete. 2023-06-10T19:05:55.604 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:05:55.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.719+0000 7f5c41386640 1 Processor -- start 2023-06-10T19:05:55.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.719+0000 7f5c41386640 1 -- start start 2023-06-10T19:05:55.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.719+0000 7f5c41386640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5c3c15eef0 0x7f5c3c070f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:55.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.719+0000 7f5c41386640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5c3c15f570 0x7f5c3c0ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:55.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.719+0000 7f5c41386640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5c3c0ce990 0x7f5c3c069450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:55.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.719+0000 7f5c41386640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c3c15f2c0 con 0x7f5c3c0ce990 2023-06-10T19:05:55.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.719+0000 7f5c41386640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c3c15fdc0 con 0x7f5c3c15f570 2023-06-10T19:05:55.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.719+0000 7f5c41386640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3c1600a0 con 0x7f5c3c15eef0 2023-06-10T19:05:55.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.719+0000 7f5c3b7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5c3c0ce990 0x7f5c3c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:55.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.719+0000 7f5c3b7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5c3c0ce990 0x7f5c3c069450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47242/0 (socket says 172.21.15.53:47242) 2023-06-10T19:05:55.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.719+0000 7f5c3b7fe640 1 -- 172.21.15.53:0/3432757521 learned_addr learned my addr 172.21.15.53:0/3432757521 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:55.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.719+0000 7f5c3affd640 1 --2- 172.21.15.53:0/3432757521 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5c3c15eef0 0x7f5c3c070f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:55.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.719+0000 7f5c3a7fc640 1 --2- 172.21.15.53:0/3432757521 >> v2:172.21.15.117:3300/0 conn(0x7f5c3c15f570 0x7f5c3c0ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:55.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.719+0000 7f5c3b7fe640 1 -- 172.21.15.53:0/3432757521 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5c3c15eef0 msgr2=0x7f5c3c070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:55.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.719+0000 7f5c3b7fe640 1 --2- 172.21.15.53:0/3432757521 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5c3c15eef0 0x7f5c3c070f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:55.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.719+0000 7f5c3b7fe640 1 -- 172.21.15.53:0/3432757521 >> v2:172.21.15.117:3300/0 conn(0x7f5c3c15f570 msgr2=0x7f5c3c0ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:55.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.719+0000 7f5c3b7fe640 1 --2- 172.21.15.53:0/3432757521 >> v2:172.21.15.117:3300/0 conn(0x7f5c3c15f570 0x7f5c3c0ce450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:55.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.719+0000 7f5c3b7fe640 1 -- 172.21.15.53:0/3432757521 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c3c160380 con 0x7f5c3c0ce990 2023-06-10T19:05:55.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.723+0000 7f5c3b7fe640 1 --2- 172.21.15.53:0/3432757521 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5c3c0ce990 0x7f5c3c069450 secure :-1 s=READY pgs=2044 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c0cc8d0 tx=0x7f5c2c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e798e93831a18a4 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:55.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.723+0000 7f5c39ffb640 1 -- 172.21.15.53:0/3432757521 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c2c0ab600 con 0x7f5c3c0ce990 2023-06-10T19:05:55.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.723+0000 7f5c39ffb640 1 -- 172.21.15.53:0/3432757521 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c2c0a7050 con 0x7f5c3c0ce990 2023-06-10T19:05:55.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.723+0000 7f5c39ffb640 1 -- 172.21.15.53:0/3432757521 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c2c0ab980 con 0x7f5c3c0ce990 2023-06-10T19:05:55.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.723+0000 7f5c41386640 1 -- 172.21.15.53:0/3432757521 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5c3c0ce990 msgr2=0x7f5c3c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:55.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.723+0000 7f5c41386640 1 --2- 172.21.15.53:0/3432757521 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5c3c0ce990 0x7f5c3c069450 secure :-1 s=READY pgs=2044 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c0cc8d0 tx=0x7f5c2c01c500 comp rx=0 tx=0).stop 2023-06-10T19:05:55.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.723+0000 7f5c41386640 1 -- 172.21.15.53:0/3432757521 shutdown_connections 2023-06-10T19:05:55.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.723+0000 7f5c41386640 1 --2- 172.21.15.53:0/3432757521 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5c3c0ce990 0x7f5c3c069450 unknown :-1 s=CLOSED pgs=2044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:55.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.723+0000 7f5c41386640 1 --2- 172.21.15.53:0/3432757521 >> v2:172.21.15.117:3300/0 conn(0x7f5c3c15f570 0x7f5c3c0ce450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:55.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.723+0000 7f5c41386640 1 --2- 172.21.15.53:0/3432757521 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5c3c15eef0 0x7f5c3c070f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:55.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.723+0000 7f5c41386640 1 -- 172.21.15.53:0/3432757521 >> 172.21.15.53:0/3432757521 conn(0x7f5c3c06a560 msgr2=0x7f5c3c06a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:55.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.723+0000 7f5c41386640 1 -- 172.21.15.53:0/3432757521 shutdown_connections 2023-06-10T19:05:55.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.723+0000 7f5c41386640 1 -- 172.21.15.53:0/3432757521 wait complete. 2023-06-10T19:05:55.732 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.723+0000 7f5c41386640 1 Processor -- start 2023-06-10T19:05:55.732 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.723+0000 7f5c41386640 1 -- start start 2023-06-10T19:05:55.732 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.723+0000 7f5c41386640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5c3c0ce990 0x7f5c3c159280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:55.732 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.723+0000 7f5c41386640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5c3c15eef0 0x7f5c3c14fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:55.732 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.723+0000 7f5c41386640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5c3c15f570 0x7f5c3c0aee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:55.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.723+0000 7f5c41386640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3c14ff50 con 0x7f5c3c15eef0 2023-06-10T19:05:55.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.723+0000 7f5c41386640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3c155d80 con 0x7f5c3c0ce990 2023-06-10T19:05:55.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.723+0000 7f5c41386640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3c156060 con 0x7f5c3c15f570 2023-06-10T19:05:55.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.723+0000 7f5c3a7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5c3c15eef0 0x7f5c3c14fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:55.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.723+0000 7f5c3a7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5c3c15eef0 0x7f5c3c14fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47250/0 (socket says 172.21.15.53:47250) 2023-06-10T19:05:55.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.723+0000 7f5c3a7fc640 1 -- 172.21.15.53:0/2349677895 learned_addr learned my addr 172.21.15.53:0/2349677895 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:55.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.723+0000 7f5c3affd640 1 --2- 172.21.15.53:0/2349677895 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5c3c0ce990 0x7f5c3c159280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:55.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.723+0000 7f5c3b7fe640 1 --2- 172.21.15.53:0/2349677895 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5c3c15f570 0x7f5c3c0aee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:55.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.727+0000 7f5c3a7fc640 1 -- 172.21.15.53:0/2349677895 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5c3c15f570 msgr2=0x7f5c3c0aee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:55.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.727+0000 7f5c3a7fc640 1 --2- 172.21.15.53:0/2349677895 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5c3c15f570 0x7f5c3c0aee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:55.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.727+0000 7f5c3a7fc640 1 -- 172.21.15.53:0/2349677895 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5c3c0ce990 msgr2=0x7f5c3c159280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:55.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.727+0000 7f5c3a7fc640 1 --2- 172.21.15.53:0/2349677895 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5c3c0ce990 0x7f5c3c159280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:55.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.727+0000 7f5c3a7fc640 1 -- 172.21.15.53:0/2349677895 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c2c0094d0 con 0x7f5c3c15eef0 2023-06-10T19:05:55.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.727+0000 7f5c3a7fc640 1 --2- 172.21.15.53:0/2349677895 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5c3c15eef0 0x7f5c3c14fa10 secure :-1 s=READY pgs=2045 cs=0 l=1 rev1=1 crypto rx=0x7f5c3000d5f0 tx=0x7f5c3000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:55.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.727+0000 7f5c237fe640 1 -- 172.21.15.53:0/2349677895 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c300125f0 con 0x7f5c3c15eef0 2023-06-10T19:05:55.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.727+0000 7f5c237fe640 1 -- 172.21.15.53:0/2349677895 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c30012750 con 0x7f5c3c15eef0 2023-06-10T19:05:55.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.727+0000 7f5c41386640 1 -- 172.21.15.53:0/2349677895 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c3c156340 con 0x7f5c3c15eef0 2023-06-10T19:05:55.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.727+0000 7f5c237fe640 1 -- 172.21.15.53:0/2349677895 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c30012ae0 con 0x7f5c3c15eef0 2023-06-10T19:05:55.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.727+0000 7f5c41386640 1 -- 172.21.15.53:0/2349677895 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c3c156900 con 0x7f5c3c15eef0 2023-06-10T19:05:55.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.727+0000 7f5c41386640 1 -- 172.21.15.53:0/2349677895 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c3c156ac0 con 0x7f5c3c15eef0 2023-06-10T19:05:55.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.727+0000 7f5c237fe640 1 -- 172.21.15.53:0/2349677895 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5c30012c40 con 0x7f5c3c15eef0 2023-06-10T19:05:55.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.727+0000 7f5c237fe640 1 --2- 172.21.15.53:0/2349677895 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5c280662b0 0x7f5c28068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:55.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.727+0000 7f5c237fe640 1 -- 172.21.15.53:0/2349677895 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5c30084200 con 0x7f5c3c15eef0 2023-06-10T19:05:55.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.727+0000 7f5c3affd640 1 --2- 172.21.15.53:0/2349677895 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5c280662b0 0x7f5c28068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:55.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.727+0000 7f5c3affd640 1 --2- 172.21.15.53:0/2349677895 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5c280662b0 0x7f5c28068760 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f5c34003fd0 tx=0x7f5c34003a00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:55.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.731+0000 7f5c237fe640 1 -- 172.21.15.53:0/2349677895 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5c30051680 con 0x7f5c3c15eef0 2023-06-10T19:05:55.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.915+0000 7f5c41386640 1 -- 172.21.15.53:0/2349677895 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5c3c04d790 con 0x7f5c3c15eef0 2023-06-10T19:05:55.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.915+0000 7f5c237fe640 1 -- 172.21.15.53:0/2349677895 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+4670 (secure 0 0 0) 0x7f5c30054ca0 con 0x7f5c3c15eef0 2023-06-10T19:05:55.922 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:05:55.922 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":76,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7981,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3614073676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3614073676},{"type":"v1","addr":"172.21.15.117:6835","nonce":3614073676}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":7984,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/775375987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":775375987},{"type":"v1","addr":"172.21.15.117:6837","nonce":775375987}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":9537,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/53265583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":53265583},{"type":"v1","addr":"172.21.15.53:6833","nonce":53265583}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:05:50.789763+0000","modified":"2023-06-10T19:05:53.806474+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9543},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9543":{"gid":9543,"name":"a","rank":0,"incarnation":73,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/1171476971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":1171476971},{"type":"v1","addr":"172.21.15.53:6835","nonce":1171476971}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-06-10T19:05:55.923 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 76 2023-06-10T19:05:55.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.919+0000 7f5c41386640 1 -- 172.21.15.53:0/2349677895 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5c280662b0 msgr2=0x7f5c28068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:55.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.919+0000 7f5c41386640 1 --2- 172.21.15.53:0/2349677895 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5c280662b0 0x7f5c28068760 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f5c34003fd0 tx=0x7f5c34003a00 comp rx=0 tx=0).stop 2023-06-10T19:05:55.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.919+0000 7f5c41386640 1 -- 172.21.15.53:0/2349677895 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5c3c15eef0 msgr2=0x7f5c3c14fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:55.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.919+0000 7f5c41386640 1 --2- 172.21.15.53:0/2349677895 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5c3c15eef0 0x7f5c3c14fa10 secure :-1 s=READY pgs=2045 cs=0 l=1 rev1=1 crypto rx=0x7f5c3000d5f0 tx=0x7f5c3000dab0 comp rx=0 tx=0).stop 2023-06-10T19:05:55.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.919+0000 7f5c41386640 1 -- 172.21.15.53:0/2349677895 shutdown_connections 2023-06-10T19:05:55.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.919+0000 7f5c41386640 1 --2- 172.21.15.53:0/2349677895 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5c280662b0 0x7f5c28068760 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:55.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.919+0000 7f5c41386640 1 --2- 172.21.15.53:0/2349677895 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5c3c15f570 0x7f5c3c0aee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:55.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.919+0000 7f5c41386640 1 --2- 172.21.15.53:0/2349677895 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5c3c15eef0 0x7f5c3c14fa10 unknown :-1 s=CLOSED pgs=2045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:55.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.919+0000 7f5c41386640 1 --2- 172.21.15.53:0/2349677895 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5c3c0ce990 0x7f5c3c159280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:55.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.919+0000 7f5c41386640 1 -- 172.21.15.53:0/2349677895 >> 172.21.15.53:0/2349677895 conn(0x7f5c3c06a560 msgr2=0x7f5c3c15ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:55.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.919+0000 7f5c41386640 1 -- 172.21.15.53:0/2349677895 shutdown_connections 2023-06-10T19:05:55.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:55.919+0000 7f5c41386640 1 -- 172.21.15.53:0/2349677895 wait complete. 2023-06-10T19:05:56.342 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 76, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-06-10T19:05:50.789763+0000', 'modified': '2023-06-10T19:05:53.806474+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9543}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9543': {'gid': 9543, 'name': 'a', 'rank': 0, 'incarnation': 73, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.53:6835/1171476971', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.53:6834', 'nonce': 1171476971}, {'type': 'v1', 'addr': '172.21.15.53:6835', 'nonce': 1171476971}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [20], 'metadata_pool': 19, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-06-10T19:05:56.342 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-06-10T19:05:56.343 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-06-10T19:05:56.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.475+0000 7f65aac21640 1 Processor -- start 2023-06-10T19:05:56.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.475+0000 7f65aac21640 1 -- start start 2023-06-10T19:05:56.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.475+0000 7f65aac21640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f65a40b3ac0 0x7f65a40b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:56.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.475+0000 7f65aac21640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f65a40d1b00 0x7f65a40b43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:56.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.475+0000 7f65aac21640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65a40ccde0 con 0x7f65a40cc690 2023-06-10T19:05:56.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.475+0000 7f65aac21640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65a40ced00 con 0x7f65a40b3ac0 2023-06-10T19:05:56.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.475+0000 7f65aac21640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65a40cfc10 con 0x7f65a40d1b00 2023-06-10T19:05:56.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.475+0000 7f65a89bd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f65a40b3ac0 0x7f65a40b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:56.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.475+0000 7f65a3fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f65a40cc690 0x7f65a415f3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:45232/0 (socket says 172.21.15.53:45232) 2023-06-10T19:05:56.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.475+0000 7f65a3fff640 1 -- 172.21.15.53:0/1996235421 learned_addr learned my addr 172.21.15.53:0/1996235421 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:05:56.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.475+0000 7f65a91be640 1 --2- 172.21.15.53:0/1996235421 >> v2:172.21.15.117:3300/0 conn(0x7f65a40d1b00 0x7f65a40b43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:56.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.475+0000 7f65a89bd640 1 -- 172.21.15.53:0/1996235421 >> v2:172.21.15.117:3300/0 conn(0x7f65a40d1b00 msgr2=0x7f65a40b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:56.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.475+0000 7f65a89bd640 1 --2- 172.21.15.53:0/1996235421 >> v2:172.21.15.117:3300/0 conn(0x7f65a40d1b00 0x7f65a40b43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:56.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.475+0000 7f65a89bd640 1 -- 172.21.15.53:0/1996235421 >> v1:172.21.15.53:6789/0 conn(0x7f65a40cc690 legacy=0x7f65a415f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:56.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.475+0000 7f65a89bd640 1 -- 172.21.15.53:0/1996235421 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65a40b4910 con 0x7f65a40b3ac0 2023-06-10T19:05:56.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.479+0000 7f65a89bd640 1 --2- 172.21.15.53:0/1996235421 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65a40b3ac0 0x7f65a40b3e90 secure :-1 s=READY pgs=2047 cs=0 l=1 rev1=1 crypto rx=0x7f65a40b8110 tx=0x7f659401c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e54b59f756d523bb server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:56.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.479+0000 7f65a37fe640 1 -- 172.21.15.53:0/1996235421 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65940ab600 con 0x7f65a40b3ac0 2023-06-10T19:05:56.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.479+0000 7f65a37fe640 1 -- 172.21.15.53:0/1996235421 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65940a7050 con 0x7f65a40b3ac0 2023-06-10T19:05:56.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.479+0000 7f65a37fe640 1 -- 172.21.15.53:0/1996235421 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65940ab980 con 0x7f65a40b3ac0 2023-06-10T19:05:56.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.479+0000 7f65aac21640 1 -- 172.21.15.53:0/1996235421 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65a40b3ac0 msgr2=0x7f65a40b3e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:56.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.479+0000 7f65aac21640 1 --2- 172.21.15.53:0/1996235421 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65a40b3ac0 0x7f65a40b3e90 secure :-1 s=READY pgs=2047 cs=0 l=1 rev1=1 crypto rx=0x7f65a40b8110 tx=0x7f659401c340 comp rx=0 tx=0).stop 2023-06-10T19:05:56.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.479+0000 7f65aac21640 1 -- 172.21.15.53:0/1996235421 shutdown_connections 2023-06-10T19:05:56.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.479+0000 7f65aac21640 1 --2- 172.21.15.53:0/1996235421 >> v2:172.21.15.117:3300/0 conn(0x7f65a40d1b00 0x7f65a40b43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:56.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.479+0000 7f65aac21640 1 --2- 172.21.15.53:0/1996235421 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65a40b3ac0 0x7f65a40b3e90 unknown :-1 s=CLOSED pgs=2047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:56.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.479+0000 7f65aac21640 1 -- 172.21.15.53:0/1996235421 >> 172.21.15.53:0/1996235421 conn(0x7f65a4069de0 msgr2=0x7f65a406a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:56.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.479+0000 7f65aac21640 1 -- 172.21.15.53:0/1996235421 shutdown_connections 2023-06-10T19:05:56.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.479+0000 7f65aac21640 1 -- 172.21.15.53:0/1996235421 wait complete. 2023-06-10T19:05:56.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.479+0000 7f65aac21640 1 Processor -- start 2023-06-10T19:05:56.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.479+0000 7f65aac21640 1 -- start start 2023-06-10T19:05:56.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.479+0000 7f65aac21640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65a40b3ac0 0x7f65a4158f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:56.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.479+0000 7f65aac21640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65a40cc690 0x7f65a41494b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:56.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.479+0000 7f65aac21640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65a40d1b00 0x7f65a40c9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:56.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.479+0000 7f65aac21640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65a4159900 con 0x7f65a40cc690 2023-06-10T19:05:56.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.479+0000 7f65aac21640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65a40c6360 con 0x7f65a40d1b00 2023-06-10T19:05:56.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.479+0000 7f65aac21640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65a40cc440 con 0x7f65a40b3ac0 2023-06-10T19:05:56.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.483+0000 7f65a3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65a40cc690 0x7f65a41494b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:56.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.483+0000 7f65a3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65a40cc690 0x7f65a41494b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47260/0 (socket says 172.21.15.53:47260) 2023-06-10T19:05:56.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.483+0000 7f65a3fff640 1 -- 172.21.15.53:0/4044502602 learned_addr learned my addr 172.21.15.53:0/4044502602 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:56.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.483+0000 7f65a89bd640 1 --2- 172.21.15.53:0/4044502602 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65a40b3ac0 0x7f65a4158f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:56.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.483+0000 7f65a91be640 1 --2- 172.21.15.53:0/4044502602 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65a40d1b00 0x7f65a40c9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:56.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.483+0000 7f65a3fff640 1 -- 172.21.15.53:0/4044502602 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65a40b3ac0 msgr2=0x7f65a4158f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:56.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.483+0000 7f65a3fff640 1 --2- 172.21.15.53:0/4044502602 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65a40b3ac0 0x7f65a4158f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:56.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.483+0000 7f65a3fff640 1 -- 172.21.15.53:0/4044502602 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65a40d1b00 msgr2=0x7f65a40c9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:56.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.483+0000 7f65a3fff640 1 --2- 172.21.15.53:0/4044502602 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65a40d1b00 0x7f65a40c9ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:56.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.483+0000 7f65a3fff640 1 -- 172.21.15.53:0/4044502602 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6594009420 con 0x7f65a40cc690 2023-06-10T19:05:56.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.483+0000 7f65a89bd640 1 --2- 172.21.15.53:0/4044502602 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65a40b3ac0 0x7f65a4158f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:05:56.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.483+0000 7f65a3fff640 1 --2- 172.21.15.53:0/4044502602 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65a40cc690 0x7f65a41494b0 secure :-1 s=READY pgs=2048 cs=0 l=1 rev1=1 crypto rx=0x7f659800c530 tx=0x7f659800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:56.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.483+0000 7f65a17fa640 1 -- 172.21.15.53:0/4044502602 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6598005cf0 con 0x7f65a40cc690 2023-06-10T19:05:56.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.483+0000 7f65a17fa640 1 -- 172.21.15.53:0/4044502602 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6598005e50 con 0x7f65a40cc690 2023-06-10T19:05:56.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.483+0000 7f65aac21640 1 -- 172.21.15.53:0/4044502602 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65a41499f0 con 0x7f65a40cc690 2023-06-10T19:05:56.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.483+0000 7f65a17fa640 1 -- 172.21.15.53:0/4044502602 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6598007270 con 0x7f65a40cc690 2023-06-10T19:05:56.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.483+0000 7f65aac21640 1 -- 172.21.15.53:0/4044502602 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65a40c5d10 con 0x7f65a40cc690 2023-06-10T19:05:56.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.483+0000 7f65a17fa640 1 -- 172.21.15.53:0/4044502602 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f65980073d0 con 0x7f65a40cc690 2023-06-10T19:05:56.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.483+0000 7f65a17fa640 1 --2- 172.21.15.53:0/4044502602 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6590066280 0x7f6590068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:56.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.483+0000 7f65a17fa640 1 -- 172.21.15.53:0/4044502602 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f65980831a0 con 0x7f65a40cc690 2023-06-10T19:05:56.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.483+0000 7f65a89bd640 1 --2- 172.21.15.53:0/4044502602 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6590066280 0x7f6590068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:56.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.483+0000 7f65add3d000 1 Processor -- start 2023-06-10T19:05:56.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.483+0000 7f65add3d000 1 -- start start 2023-06-10T19:05:56.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.487+0000 7f65a89bd640 1 --2- 172.21.15.53:0/4044502602 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6590066280 0x7f6590068730 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f65940ad000 tx=0x7f6594008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:56.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.487+0000 7f65add3d000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555dcd6fc740 0x555dcd6fcb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:56.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.487+0000 7f65add3d000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555dcd6fd050 0x555dcd6b2840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:56.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.487+0000 7f65add3d000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555dcd6b2d80 0x555dcd6b3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:56.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.487+0000 7f65add3d000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dcd57aac0 con 0x555dcd6fd050 2023-06-10T19:05:56.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.487+0000 7f65add3d000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dcd4b4840 con 0x555dcd6b2d80 2023-06-10T19:05:56.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.487+0000 7f65add3d000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x555dcd5082e0 con 0x555dcd6fc740 2023-06-10T19:05:56.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.487+0000 7f65a3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555dcd6fd050 0x555dcd6b2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:56.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.487+0000 7f65a3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555dcd6fd050 0x555dcd6b2840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47268/0 (socket says 172.21.15.53:47268) 2023-06-10T19:05:56.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.487+0000 7f65a3fff640 1 -- 172.21.15.53:0/3815904615 learned_addr learned my addr 172.21.15.53:0/3815904615 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:56.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.487+0000 7f65a91be640 1 --2- 172.21.15.53:0/3815904615 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555dcd6b2d80 0x555dcd6b3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:56.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.487+0000 7f65a89bd640 1 --2- 172.21.15.53:0/3815904615 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555dcd6fc740 0x555dcd6fcb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:56.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.487+0000 7f65a3fff640 1 -- 172.21.15.53:0/3815904615 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555dcd6fc740 msgr2=0x555dcd6fcb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:56.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.487+0000 7f65a3fff640 1 --2- 172.21.15.53:0/3815904615 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555dcd6fc740 0x555dcd6fcb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:56.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.487+0000 7f65a3fff640 1 -- 172.21.15.53:0/3815904615 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555dcd6b2d80 msgr2=0x555dcd6b3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:56.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.487+0000 7f65a3fff640 1 --2- 172.21.15.53:0/3815904615 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555dcd6b2d80 0x555dcd6b3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:56.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.487+0000 7f65a3fff640 1 -- 172.21.15.53:0/3815904615 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555dcd1fd890 con 0x555dcd6fd050 2023-06-10T19:05:56.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.487+0000 7f65a3fff640 1 --2- 172.21.15.53:0/3815904615 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555dcd6fd050 0x555dcd6b2840 secure :-1 s=READY pgs=2049 cs=0 l=1 rev1=1 crypto rx=0x7f6598081590 tx=0x7f659805c770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaaf8404a74e39aa server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:56.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.487+0000 7f658a7fc640 1 -- 172.21.15.53:0/3815904615 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6598007680 con 0x555dcd6fd050 2023-06-10T19:05:56.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.487+0000 7f658a7fc640 1 -- 172.21.15.53:0/3815904615 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6598050aa0 con 0x555dcd6fd050 2023-06-10T19:05:56.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.487+0000 7f658a7fc640 1 -- 172.21.15.53:0/3815904615 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f659805c3c0 con 0x555dcd6fd050 2023-06-10T19:05:56.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.487+0000 7f65add3d000 1 -- 172.21.15.53:0/3815904615 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555dcd6fd050 msgr2=0x555dcd6b2840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:56.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.487+0000 7f65add3d000 1 --2- 172.21.15.53:0/3815904615 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555dcd6fd050 0x555dcd6b2840 secure :-1 s=READY pgs=2049 cs=0 l=1 rev1=1 crypto rx=0x7f6598081590 tx=0x7f659805c770 comp rx=0 tx=0).stop 2023-06-10T19:05:56.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.487+0000 7f65add3d000 1 -- 172.21.15.53:0/3815904615 shutdown_connections 2023-06-10T19:05:56.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.487+0000 7f65add3d000 1 --2- 172.21.15.53:0/3815904615 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555dcd6b2d80 0x555dcd6b3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:56.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.487+0000 7f65add3d000 1 --2- 172.21.15.53:0/3815904615 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555dcd6fd050 0x555dcd6b2840 unknown :-1 s=CLOSED pgs=2049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:56.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.487+0000 7f65add3d000 1 --2- 172.21.15.53:0/3815904615 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555dcd6fc740 0x555dcd6fcb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:56.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.487+0000 7f65add3d000 1 -- 172.21.15.53:0/3815904615 >> 172.21.15.53:0/3815904615 conn(0x555dcd6aa800 msgr2=0x555dcd6b9800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:56.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.487+0000 7f65add3d000 1 -- 172.21.15.53:0/3815904615 shutdown_connections 2023-06-10T19:05:56.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.487+0000 7f65add3d000 1 -- 172.21.15.53:0/3815904615 wait complete. 2023-06-10T19:05:56.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.487+0000 7f65add3d000 1 -- start start 2023-06-10T19:05:56.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.487+0000 7f65add3d000 1 Processor -- start 2023-06-10T19:05:56.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.487+0000 7f65add3d000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555dcd6b2d80 0x555dcd6b8910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:56.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.487+0000 7f65add3d000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555dcd6fc740 0x555dcd6be0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:56.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.487+0000 7f65add3d000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555dcd6fd050 0x555dcd6be620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:56.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.487+0000 7f65add3d000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dcd501380 con 0x555dcd6fd050 2023-06-10T19:05:56.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.487+0000 7f65add3d000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dcd4bdae0 con 0x555dcd6fc740 2023-06-10T19:05:56.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.487+0000 7f65add3d000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x555dcd4bd780 con 0x555dcd6b2d80 2023-06-10T19:05:56.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.487+0000 7f65add3d000 10 client.0 _ll_register_callbacks cb 0x555dcd69ee30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-10T19:05:56.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.487+0000 7f65a91be640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555dcd6fd050 0x555dcd6be620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:56.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.487+0000 7f65a91be640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555dcd6fd050 0x555dcd6be620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47274/0 (socket says 172.21.15.53:47274) 2023-06-10T19:05:56.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.487+0000 7f65a91be640 1 -- 172.21.15.53:0/939784779 learned_addr learned my addr 172.21.15.53:0/939784779 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:56.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.487+0000 7f65a3fff640 1 --2- 172.21.15.53:0/939784779 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555dcd6fc740 0x555dcd6be0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:56.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.487+0000 7f65a89bd640 1 --2- 172.21.15.53:0/939784779 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555dcd6b2d80 0x555dcd6b8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:56.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.487+0000 7f65a91be640 1 -- 172.21.15.53:0/939784779 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555dcd6b2d80 msgr2=0x555dcd6b8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:56.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.487+0000 7f65a91be640 1 --2- 172.21.15.53:0/939784779 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555dcd6b2d80 0x555dcd6b8910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:56.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.487+0000 7f65a91be640 1 -- 172.21.15.53:0/939784779 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555dcd6fc740 msgr2=0x555dcd6be0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:56.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.491+0000 7f65a91be640 1 --2- 172.21.15.53:0/939784779 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555dcd6fc740 0x555dcd6be0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:56.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.491+0000 7f65a91be640 1 -- 172.21.15.53:0/939784779 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65a40c5d10 con 0x555dcd6fd050 2023-06-10T19:05:56.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.491+0000 7f65a3fff640 1 --2- 172.21.15.53:0/939784779 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555dcd6fc740 0x555dcd6be0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:05:56.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.491+0000 7f65a91be640 1 --2- 172.21.15.53:0/939784779 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555dcd6fd050 0x555dcd6be620 secure :-1 s=READY pgs=2050 cs=0 l=1 rev1=1 crypto rx=0x7f659c0079d0 tx=0x7f659c007e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=358ed2b1911a760b server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:56.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.491+0000 7f65837fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-06-10T19:05:56.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.491+0000 7f65837fe640 1 -- 172.21.15.53:0/939784779 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f659c011a80 con 0x555dcd6fd050 2023-06-10T19:05:56.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.491+0000 7f65837fe640 1 -- 172.21.15.53:0/939784779 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(138..138 src has 1..138) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f659c011be0 con 0x555dcd6fd050 2023-06-10T19:05:56.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.491+0000 7f65add3d000 1 -- 172.21.15.53:0/939784779 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555dcd4c8a20 con 0x555dcd6fd050 2023-06-10T19:05:56.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.491+0000 7f65837fe640 1 -- 172.21.15.53:0/939784779 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) v2 ==== 24+0+0 (secure 0 0 0) 0x7f659c011de0 con 0x555dcd6fd050 2023-06-10T19:05:56.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.491+0000 7f65add3d000 10 client.9708 fetch_fsmap learned FSMap version 76 2023-06-10T19:05:56.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.491+0000 7f65add3d000 1 -- 172.21.15.53:0/939784779 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=2+}) v3 -- 0x555dcd4c5d10 con 0x555dcd6fd050 2023-06-10T19:05:56.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.491+0000 7f65837fe640 1 -- 172.21.15.53:0/939784779 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555dcd4c8a20 con 0x555dcd6fd050 2023-06-10T19:05:56.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.491+0000 7f65837fe640 1 -- 172.21.15.53:0/939784779 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 76) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f659c014070 con 0x555dcd6fd050 2023-06-10T19:05:56.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.491+0000 7f65add3d000 10 client.9708 fetch_fsmap finished waiting for FSMap version 76 2023-06-10T19:05:56.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.491+0000 7f65add3d000 10 client.9708 resolve_mds: resolved name 'a' to daemon mds.a 2023-06-10T19:05:56.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.491+0000 7f65add3d000 20 client.9708 populate_metadata read hostname 'smithi053' 2023-06-10T19:05:56.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.491+0000 7f65add3d000 1 --2- 172.21.15.53:0/939784779 >> [v2:172.21.15.53:6834/1171476971,v1:172.21.15.53:6835/1171476971] conn(0x555dcd70bc80 0x555dcd70e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:56.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.491+0000 7f65add3d000 4 client.9708 mds_command: new command op to 9543 tid=0[{"prefix": "get_command_descriptions"}] 2023-06-10T19:05:56.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.491+0000 7f65add3d000 1 -- 172.21.15.53:0/939784779 --> [v2:172.21.15.53:6834/1171476971,v1:172.21.15.53:6835/1171476971] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555dcd530710 con 0x555dcd70bc80 2023-06-10T19:05:56.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.491+0000 7f65a89bd640 1 --2- 172.21.15.53:0/939784779 >> [v2:172.21.15.53:6834/1171476971,v1:172.21.15.53:6835/1171476971] conn(0x555dcd70bc80 0x555dcd70e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:56.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.491+0000 7f65a89bd640 1 --2- 172.21.15.53:0/939784779 >> [v2:172.21.15.53:6834/1171476971,v1:172.21.15.53:6835/1171476971] conn(0x555dcd70bc80 0x555dcd70e060 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e15f7e09033418f server_cookie=ebcc7e6ecdd2db72 in_seq=0 out_seq=0 2023-06-10T19:05:56.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.491+0000 7f65837fe640 10 client.9708 ms_handle_connect on v2:172.21.15.53:6834/1171476971 2023-06-10T19:05:56.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.491+0000 7f65837fe640 1 -- 172.21.15.53:0/939784779 <== mds.0 v2:172.21.15.53:6834/1171476971 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x555dcd530710 con 0x555dcd70bc80 2023-06-10T19:05:56.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.491+0000 7f65837fe640 10 client.9708 handle_command_reply: tid=0 2023-06-10T19:05:56.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.491+0000 7f65add3d000 1 client.9708 shutdown 2023-06-10T19:05:56.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.491+0000 7f65add3d000 1 -- 172.21.15.53:0/939784779 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555dcd6fd050 msgr2=0x555dcd6be620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:56.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.491+0000 7f65add3d000 1 --2- 172.21.15.53:0/939784779 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555dcd6fd050 0x555dcd6be620 secure :-1 s=READY pgs=2050 cs=0 l=1 rev1=1 crypto rx=0x7f659c0079d0 tx=0x7f659c007e90 comp rx=0 tx=0).stop 2023-06-10T19:05:56.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.491+0000 7f65add3d000 1 -- 172.21.15.53:0/939784779 shutdown_connections 2023-06-10T19:05:56.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.491+0000 7f65add3d000 1 --2- 172.21.15.53:0/939784779 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555dcd6fd050 0x555dcd6be620 unknown :-1 s=CLOSED pgs=2050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:56.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.491+0000 7f65add3d000 1 --2- 172.21.15.53:0/939784779 >> [v2:172.21.15.53:6834/1171476971,v1:172.21.15.53:6835/1171476971] conn(0x555dcd70bc80 0x555dcd70e060 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:56.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.491+0000 7f65add3d000 1 --2- 172.21.15.53:0/939784779 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555dcd6fc740 0x555dcd6be0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:56.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.491+0000 7f65add3d000 1 --2- 172.21.15.53:0/939784779 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555dcd6b2d80 0x555dcd6b8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:56.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.491+0000 7f65837fe640 0 client.9708 ms_handle_reset on v2:172.21.15.53:6834/1171476971 2023-06-10T19:05:56.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.491+0000 7f65add3d000 1 -- 172.21.15.53:0/939784779 >> 172.21.15.53:0/939784779 conn(0x555dcd6aa800 msgr2=0x555dcd6b1830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:56.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.491+0000 7f65add3d000 1 -- 172.21.15.53:0/939784779 shutdown_connections 2023-06-10T19:05:56.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.491+0000 7f65add3d000 1 -- 172.21.15.53:0/939784779 wait complete. 2023-06-10T19:05:56.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.491+0000 7f65add3d000 20 client.9708 trim_cache size 0 max 16384 2023-06-10T19:05:56.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.507+0000 7f65add3d000 1 Processor -- start 2023-06-10T19:05:56.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.507+0000 7f65add3d000 1 -- start start 2023-06-10T19:05:56.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.507+0000 7f65add3d000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555dcd6b2d80 0x555dcd70ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:56.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.507+0000 7f65add3d000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555dcd6fc740 0x555dcd70c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:56.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.507+0000 7f65add3d000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555dcd6fd050 0x555dcd70c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:56.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.507+0000 7f65add3d000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dcd1be940 con 0x555dcd6b2d80 2023-06-10T19:05:56.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.507+0000 7f65add3d000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dcd4fdf90 con 0x555dcd6fd050 2023-06-10T19:05:56.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.507+0000 7f65add3d000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x555dcd49ea80 con 0x555dcd6fc740 2023-06-10T19:05:56.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.507+0000 7f65a89bd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555dcd6b2d80 0x555dcd70ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:56.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.507+0000 7f65a89bd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555dcd6b2d80 0x555dcd70ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47284/0 (socket says 172.21.15.53:47284) 2023-06-10T19:05:56.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.507+0000 7f65a89bd640 1 -- 172.21.15.53:0/2569788807 learned_addr learned my addr 172.21.15.53:0/2569788807 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:56.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.507+0000 7f65a89bd640 1 -- 172.21.15.53:0/2569788807 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555dcd6fc740 msgr2=0x555dcd70c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:56.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.507+0000 7f65a89bd640 1 --2- 172.21.15.53:0/2569788807 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555dcd6fc740 0x555dcd70c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:56.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.507+0000 7f65a89bd640 1 -- 172.21.15.53:0/2569788807 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555dcd6fd050 msgr2=0x555dcd70c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:56.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.507+0000 7f65a89bd640 1 --2- 172.21.15.53:0/2569788807 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555dcd6fd050 0x555dcd70c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:56.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.507+0000 7f65a89bd640 1 -- 172.21.15.53:0/2569788807 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555dcd6b5450 con 0x555dcd6b2d80 2023-06-10T19:05:56.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.507+0000 7f65a89bd640 1 --2- 172.21.15.53:0/2569788807 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555dcd6b2d80 0x555dcd70ffd0 secure :-1 s=READY pgs=2051 cs=0 l=1 rev1=1 crypto rx=0x7f65940ae040 tx=0x7f65940a6000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71adaabf3a9516b5 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:56.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.507+0000 7f658affd640 1 -- 172.21.15.53:0/2569788807 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65940bc040 con 0x555dcd6b2d80 2023-06-10T19:05:56.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.507+0000 7f658affd640 1 -- 172.21.15.53:0/2569788807 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65940c9030 con 0x555dcd6b2d80 2023-06-10T19:05:56.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.507+0000 7f658affd640 1 -- 172.21.15.53:0/2569788807 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65940c5a40 con 0x555dcd6b2d80 2023-06-10T19:05:56.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.507+0000 7f65add3d000 1 -- 172.21.15.53:0/2569788807 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555dcd6b2d80 msgr2=0x555dcd70ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:56.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.507+0000 7f65add3d000 1 --2- 172.21.15.53:0/2569788807 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555dcd6b2d80 0x555dcd70ffd0 secure :-1 s=READY pgs=2051 cs=0 l=1 rev1=1 crypto rx=0x7f65940ae040 tx=0x7f65940a6000 comp rx=0 tx=0).stop 2023-06-10T19:05:56.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.507+0000 7f65add3d000 1 -- 172.21.15.53:0/2569788807 shutdown_connections 2023-06-10T19:05:56.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.507+0000 7f65add3d000 1 --2- 172.21.15.53:0/2569788807 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555dcd6fd050 0x555dcd70c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:56.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.507+0000 7f65add3d000 1 --2- 172.21.15.53:0/2569788807 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555dcd6fc740 0x555dcd70c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:56.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.507+0000 7f65add3d000 1 --2- 172.21.15.53:0/2569788807 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555dcd6b2d80 0x555dcd70ffd0 unknown :-1 s=CLOSED pgs=2051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:56.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.507+0000 7f65add3d000 1 -- 172.21.15.53:0/2569788807 >> 172.21.15.53:0/2569788807 conn(0x555dcd6aa800 msgr2=0x555dcd6b1eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:56.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.507+0000 7f65add3d000 1 -- 172.21.15.53:0/2569788807 shutdown_connections 2023-06-10T19:05:56.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.507+0000 7f65add3d000 1 -- 172.21.15.53:0/2569788807 wait complete. 2023-06-10T19:05:56.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.511+0000 7f65add3d000 1 -- start start 2023-06-10T19:05:56.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.511+0000 7f65add3d000 1 Processor -- start 2023-06-10T19:05:56.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.511+0000 7f65add3d000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555dcd6b2d80 0x555dcd70f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:56.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.511+0000 7f65add3d000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555dcd6fc740 0x555dcd7174c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:56.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.511+0000 7f65add3d000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555dcd6fd050 0x555dcd717a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:56.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.511+0000 7f65add3d000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dcd6b7310 con 0x555dcd6fd050 2023-06-10T19:05:56.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.511+0000 7f65add3d000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dcd4fe780 con 0x555dcd6fc740 2023-06-10T19:05:56.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.511+0000 7f65add3d000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x555dcd4a9450 con 0x555dcd6b2d80 2023-06-10T19:05:56.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.511+0000 7f65add3d000 10 client.0 _ll_register_callbacks cb 0x555dcd4c57f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-10T19:05:56.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.511+0000 7f65a91be640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555dcd6fd050 0x555dcd717a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:56.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.511+0000 7f65a91be640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555dcd6fd050 0x555dcd717a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47290/0 (socket says 172.21.15.53:47290) 2023-06-10T19:05:56.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.511+0000 7f65a91be640 1 -- 172.21.15.53:0/1803461919 learned_addr learned my addr 172.21.15.53:0/1803461919 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:56.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.511+0000 7f65a89bd640 1 --2- 172.21.15.53:0/1803461919 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555dcd6b2d80 0x555dcd70f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:56.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.511+0000 7f65a3fff640 1 --2- 172.21.15.53:0/1803461919 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555dcd6fc740 0x555dcd7174c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:56.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.511+0000 7f65a91be640 1 -- 172.21.15.53:0/1803461919 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555dcd6b2d80 msgr2=0x555dcd70f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:56.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.511+0000 7f65a91be640 1 --2- 172.21.15.53:0/1803461919 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555dcd6b2d80 0x555dcd70f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:56.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.511+0000 7f65a91be640 1 -- 172.21.15.53:0/1803461919 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555dcd6fc740 msgr2=0x555dcd7174c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:56.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.511+0000 7f65a91be640 1 --2- 172.21.15.53:0/1803461919 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555dcd6fc740 0x555dcd7174c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:56.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.511+0000 7f65a91be640 1 -- 172.21.15.53:0/1803461919 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65a40b4910 con 0x555dcd6fd050 2023-06-10T19:05:56.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.511+0000 7f65a3fff640 1 --2- 172.21.15.53:0/1803461919 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555dcd6fc740 0x555dcd7174c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:05:56.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.511+0000 7f65a91be640 1 --2- 172.21.15.53:0/1803461919 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555dcd6fd050 0x555dcd717a00 secure :-1 s=READY pgs=2052 cs=0 l=1 rev1=1 crypto rx=0x7f659c003c50 tx=0x7f659c004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8e9b8c28d1dba96 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:56.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.511+0000 7f65837fe640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-06-10T19:05:56.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.511+0000 7f65837fe640 1 -- 172.21.15.53:0/1803461919 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f659c007540 con 0x555dcd6fd050 2023-06-10T19:05:56.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.511+0000 7f65add3d000 1 -- 172.21.15.53:0/1803461919 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555dcd6b66e0 con 0x555dcd6fd050 2023-06-10T19:05:56.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.511+0000 7f65837fe640 1 -- 172.21.15.53:0/1803461919 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(138..138 src has 1..138) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f659c003e30 con 0x555dcd6fd050 2023-06-10T19:05:56.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.511+0000 7f65837fe640 1 -- 172.21.15.53:0/1803461919 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) v2 ==== 24+0+0 (secure 0 0 0) 0x7f659c0115a0 con 0x555dcd6fd050 2023-06-10T19:05:56.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.511+0000 7f65add3d000 10 client.9714 fetch_fsmap learned FSMap version 76 2023-06-10T19:05:56.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.511+0000 7f65add3d000 1 -- 172.21.15.53:0/1803461919 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=2+}) v3 -- 0x555dcd4abfa0 con 0x555dcd6fd050 2023-06-10T19:05:56.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.511+0000 7f65837fe640 1 -- 172.21.15.53:0/1803461919 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555dcd6b66e0 con 0x555dcd6fd050 2023-06-10T19:05:56.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.511+0000 7f65837fe640 1 -- 172.21.15.53:0/1803461919 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 76) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f659c004240 con 0x555dcd6fd050 2023-06-10T19:05:56.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.511+0000 7f65add3d000 10 client.9714 fetch_fsmap finished waiting for FSMap version 76 2023-06-10T19:05:56.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.511+0000 7f65add3d000 10 client.9714 resolve_mds: resolved name 'a' to daemon mds.a 2023-06-10T19:05:56.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.511+0000 7f65add3d000 20 client.9714 populate_metadata read hostname 'smithi053' 2023-06-10T19:05:56.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.511+0000 7f65add3d000 1 --2- 172.21.15.53:0/1803461919 >> [v2:172.21.15.53:6834/1171476971,v1:172.21.15.53:6835/1171476971] conn(0x555dcd75af30 0x555dcd75b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:56.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.511+0000 7f65add3d000 4 client.9714 mds_command: new command op to 9543 tid=0[{"prefix": "status"}] 2023-06-10T19:05:56.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.511+0000 7f65add3d000 1 -- 172.21.15.53:0/1803461919 --> [v2:172.21.15.53:6834/1171476971,v1:172.21.15.53:6835/1171476971] -- command(tid 0: {"prefix": "status"}) v1 -- 0x555dcd4ffcd0 con 0x555dcd75af30 2023-06-10T19:05:56.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.511+0000 7f65a89bd640 1 --2- 172.21.15.53:0/1803461919 >> [v2:172.21.15.53:6834/1171476971,v1:172.21.15.53:6835/1171476971] conn(0x555dcd75af30 0x555dcd75b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:56.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.511+0000 7f65837fe640 10 client.9714 ms_handle_connect on v2:172.21.15.53:6834/1171476971 2023-06-10T19:05:56.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.511+0000 7f65a89bd640 1 --2- 172.21.15.53:0/1803461919 >> [v2:172.21.15.53:6834/1171476971,v1:172.21.15.53:6835/1171476971] conn(0x555dcd75af30 0x555dcd75b300 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3183764f158b55ec server_cookie=9c64dbeed1b54c0d in_seq=0 out_seq=0 2023-06-10T19:05:56.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.511+0000 7f65837fe640 1 -- 172.21.15.53:0/1803461919 <== mds.0 v2:172.21.15.53:6834/1171476971 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x555dcd4ffcd0 con 0x555dcd75af30 2023-06-10T19:05:56.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.511+0000 7f65837fe640 10 client.9714 handle_command_reply: tid=0 2023-06-10T19:05:56.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.511+0000 7f65add3d000 1 client.9714 shutdown 2023-06-10T19:05:56.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.511+0000 7f65add3d000 1 -- 172.21.15.53:0/1803461919 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555dcd6fd050 msgr2=0x555dcd717a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:56.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.511+0000 7f65add3d000 1 --2- 172.21.15.53:0/1803461919 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555dcd6fd050 0x555dcd717a00 secure :-1 s=READY pgs=2052 cs=0 l=1 rev1=1 crypto rx=0x7f659c003c50 tx=0x7f659c004ac0 comp rx=0 tx=0).stop 2023-06-10T19:05:56.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.511+0000 7f65add3d000 1 -- 172.21.15.53:0/1803461919 shutdown_connections 2023-06-10T19:05:56.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.511+0000 7f65add3d000 1 --2- 172.21.15.53:0/1803461919 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555dcd6fd050 0x555dcd717a00 unknown :-1 s=CLOSED pgs=2052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:56.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.511+0000 7f65add3d000 1 --2- 172.21.15.53:0/1803461919 >> [v2:172.21.15.53:6834/1171476971,v1:172.21.15.53:6835/1171476971] conn(0x555dcd75af30 0x555dcd75b300 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:56.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.511+0000 7f65add3d000 1 --2- 172.21.15.53:0/1803461919 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555dcd6fc740 0x555dcd7174c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:56.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.511+0000 7f65add3d000 1 --2- 172.21.15.53:0/1803461919 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x555dcd6b2d80 0x555dcd70f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:56.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.511+0000 7f65837fe640 0 client.9714 ms_handle_reset on v2:172.21.15.53:6834/1171476971 2023-06-10T19:05:56.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.511+0000 7f65add3d000 1 -- 172.21.15.53:0/1803461919 >> 172.21.15.53:0/1803461919 conn(0x555dcd6aa800 msgr2=0x555dcd6fb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:56.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.511+0000 7f65add3d000 1 -- 172.21.15.53:0/1803461919 shutdown_connections 2023-06-10T19:05:56.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.511+0000 7f65add3d000 1 -- 172.21.15.53:0/1803461919 wait complete. 2023-06-10T19:05:56.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.511+0000 7f65add3d000 20 client.9714 trim_cache size 0 max 16384 2023-06-10T19:05:56.528 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-06-10T19:05:56.528 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_fsid": "c8c64bed-c406-4936-93f9-d16335f1067d", 2023-06-10T19:05:56.529 INFO:teuthology.orchestra.run.smithi053.stdout: "whoami": 0, 2023-06-10T19:05:56.529 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 9543, 2023-06-10T19:05:56.529 INFO:teuthology.orchestra.run.smithi053.stdout: "want_state": "up:active", 2023-06-10T19:05:56.529 INFO:teuthology.orchestra.run.smithi053.stdout: "state": "up:active", 2023-06-10T19:05:56.529 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs", 2023-06-10T19:05:56.529 INFO:teuthology.orchestra.run.smithi053.stdout: "rank_uptime": 5.7246909730000004, 2023-06-10T19:05:56.529 INFO:teuthology.orchestra.run.smithi053.stdout: "mdsmap_epoch": 76, 2023-06-10T19:05:56.529 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch": 138, 2023-06-10T19:05:56.530 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch_barrier": 138, 2023-06-10T19:05:56.530 INFO:teuthology.orchestra.run.smithi053.stdout: "uptime": 11.120283533 2023-06-10T19:05:56.530 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-06-10T19:05:56.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.511+0000 7f65aac21640 1 -- 172.21.15.53:0/4044502602 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6590066280 msgr2=0x7f6590068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:56.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.511+0000 7f65aac21640 1 --2- 172.21.15.53:0/4044502602 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6590066280 0x7f6590068730 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f65940ad000 tx=0x7f6594008040 comp rx=0 tx=0).stop 2023-06-10T19:05:56.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.511+0000 7f65aac21640 1 -- 172.21.15.53:0/4044502602 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65a40cc690 msgr2=0x7f65a41494b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:56.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.511+0000 7f65aac21640 1 --2- 172.21.15.53:0/4044502602 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65a40cc690 0x7f65a41494b0 secure :-1 s=READY pgs=2048 cs=0 l=1 rev1=1 crypto rx=0x7f659800c530 tx=0x7f659800c9f0 comp rx=0 tx=0).stop 2023-06-10T19:05:56.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.515+0000 7f65aac21640 1 -- 172.21.15.53:0/4044502602 shutdown_connections 2023-06-10T19:05:56.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.515+0000 7f65aac21640 1 --2- 172.21.15.53:0/4044502602 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6590066280 0x7f6590068730 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:56.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.515+0000 7f65aac21640 1 --2- 172.21.15.53:0/4044502602 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65a40d1b00 0x7f65a40c9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:56.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.515+0000 7f65aac21640 1 --2- 172.21.15.53:0/4044502602 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65a40cc690 0x7f65a41494b0 unknown :-1 s=CLOSED pgs=2048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:56.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.515+0000 7f65aac21640 1 --2- 172.21.15.53:0/4044502602 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65a40b3ac0 0x7f65a4158f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:56.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.515+0000 7f65aac21640 1 -- 172.21.15.53:0/4044502602 >> 172.21.15.53:0/4044502602 conn(0x7f65a4069de0 msgr2=0x7f65a415e770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:56.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.515+0000 7f65aac21640 1 -- 172.21.15.53:0/4044502602 shutdown_connections 2023-06-10T19:05:56.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.515+0000 7f65aac21640 1 -- 172.21.15.53:0/4044502602 wait complete. 2023-06-10T19:05:56.534 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-10T19:05:56.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.639+0000 7f396c09f640 1 Processor -- start 2023-06-10T19:05:56.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.639+0000 7f396c09f640 1 -- start start 2023-06-10T19:05:56.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.639+0000 7f396c09f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3964159830 0x7f39640c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:56.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.639+0000 7f396c09f640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f39640c9c80 0x7f3964159c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:56.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.639+0000 7f396c09f640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f396415d260 con 0x7f396415a140 2023-06-10T19:05:56.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.639+0000 7f396c09f640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39640ca120 con 0x7f3964159830 2023-06-10T19:05:56.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.639+0000 7f396c09f640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39640c9270 con 0x7f39640c9c80 2023-06-10T19:05:56.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.643+0000 7f3969e3b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3964159830 0x7f39640c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:56.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.643+0000 7f3969e3b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3964159830 0x7f39640c9740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47306/0 (socket says 172.21.15.53:47306) 2023-06-10T19:05:56.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.643+0000 7f3969e3b640 1 -- 172.21.15.53:0/3629047289 learned_addr learned my addr 172.21.15.53:0/3629047289 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:56.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.643+0000 7f396963a640 1 --2- 172.21.15.53:0/3629047289 >> v2:172.21.15.117:3300/0 conn(0x7f39640c9c80 0x7f3964159c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:56.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.643+0000 7f3969e3b640 1 -- 172.21.15.53:0/3629047289 >> v2:172.21.15.117:3300/0 conn(0x7f39640c9c80 msgr2=0x7f3964159c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:56.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.643+0000 7f3969e3b640 1 --2- 172.21.15.53:0/3629047289 >> v2:172.21.15.117:3300/0 conn(0x7f39640c9c80 0x7f3964159c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:56.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.643+0000 7f3969e3b640 1 -- 172.21.15.53:0/3629047289 >> v1:172.21.15.117:6789/0 conn(0x7f396415a140 legacy=0x7f396406a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:56.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.643+0000 7f3969e3b640 1 -- 172.21.15.53:0/3629047289 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f396415aa30 con 0x7f3964159830 2023-06-10T19:05:56.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.643+0000 7f3969e3b640 1 --2- 172.21.15.53:0/3629047289 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3964159830 0x7f39640c9740 secure :-1 s=READY pgs=2053 cs=0 l=1 rev1=1 crypto rx=0x7f396406c350 tx=0x7f396001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcb8b3c51164d65d server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:56.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.643+0000 7f3968e39640 1 -- 172.21.15.53:0/3629047289 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39600ab600 con 0x7f3964159830 2023-06-10T19:05:56.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.643+0000 7f3968e39640 1 -- 172.21.15.53:0/3629047289 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39600ab760 con 0x7f3964159830 2023-06-10T19:05:56.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.643+0000 7f3968e39640 1 -- 172.21.15.53:0/3629047289 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39600abaf0 con 0x7f3964159830 2023-06-10T19:05:56.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.643+0000 7f396c09f640 1 -- 172.21.15.53:0/3629047289 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3964159830 msgr2=0x7f39640c9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:56.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.643+0000 7f396c09f640 1 --2- 172.21.15.53:0/3629047289 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3964159830 0x7f39640c9740 secure :-1 s=READY pgs=2053 cs=0 l=1 rev1=1 crypto rx=0x7f396406c350 tx=0x7f396001c400 comp rx=0 tx=0).stop 2023-06-10T19:05:56.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.643+0000 7f396c09f640 1 -- 172.21.15.53:0/3629047289 shutdown_connections 2023-06-10T19:05:56.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.643+0000 7f396c09f640 1 --2- 172.21.15.53:0/3629047289 >> v2:172.21.15.117:3300/0 conn(0x7f39640c9c80 0x7f3964159c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:56.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.643+0000 7f396c09f640 1 --2- 172.21.15.53:0/3629047289 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3964159830 0x7f39640c9740 unknown :-1 s=CLOSED pgs=2053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:56.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.643+0000 7f396c09f640 1 -- 172.21.15.53:0/3629047289 >> 172.21.15.53:0/3629047289 conn(0x7f39640cdca0 msgr2=0x7f39640ce0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:56.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.643+0000 7f396c09f640 1 -- 172.21.15.53:0/3629047289 shutdown_connections 2023-06-10T19:05:56.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.643+0000 7f396c09f640 1 -- 172.21.15.53:0/3629047289 wait complete. 2023-06-10T19:05:56.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.647+0000 7f396c09f640 1 Processor -- start 2023-06-10T19:05:56.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.647+0000 7f396c09f640 1 -- start start 2023-06-10T19:05:56.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.647+0000 7f396c09f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39640c9c80 0x7f39640c4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:56.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.647+0000 7f396c09f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3964159830 0x7f39640b0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:56.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.647+0000 7f396c09f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f396415a140 0x7f396414f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:56.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.647+0000 7f396c09f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39640cccb0 con 0x7f396415a140 2023-06-10T19:05:56.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.647+0000 7f396c09f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39640b1010 con 0x7f39640c9c80 2023-06-10T19:05:56.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.647+0000 7f396c09f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39640ccec0 con 0x7f3964159830 2023-06-10T19:05:56.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.647+0000 7f396a63c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f396415a140 0x7f396414f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:56.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.647+0000 7f396a63c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f396415a140 0x7f396414f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47316/0 (socket says 172.21.15.53:47316) 2023-06-10T19:05:56.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.647+0000 7f396a63c640 1 -- 172.21.15.53:0/1715927264 learned_addr learned my addr 172.21.15.53:0/1715927264 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:56.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.647+0000 7f396963a640 1 --2- 172.21.15.53:0/1715927264 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3964159830 0x7f39640b0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:56.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.647+0000 7f3969e3b640 1 --2- 172.21.15.53:0/1715927264 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39640c9c80 0x7f39640c4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:56.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.647+0000 7f396a63c640 1 -- 172.21.15.53:0/1715927264 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3964159830 msgr2=0x7f39640b0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:56.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.647+0000 7f396a63c640 1 --2- 172.21.15.53:0/1715927264 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3964159830 0x7f39640b0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:56.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.647+0000 7f396a63c640 1 -- 172.21.15.53:0/1715927264 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39640c9c80 msgr2=0x7f39640c4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:56.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.647+0000 7f396a63c640 1 --2- 172.21.15.53:0/1715927264 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39640c9c80 0x7f39640c4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:56.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.647+0000 7f396a63c640 1 -- 172.21.15.53:0/1715927264 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39600094d0 con 0x7f396415a140 2023-06-10T19:05:56.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.647+0000 7f396a63c640 1 --2- 172.21.15.53:0/1715927264 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f396415a140 0x7f396414f040 secure :-1 s=READY pgs=2054 cs=0 l=1 rev1=1 crypto rx=0x7f395c00b970 tx=0x7f395c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:56.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.647+0000 7f395a7fc640 1 -- 172.21.15.53:0/1715927264 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f395c00cb40 con 0x7f396415a140 2023-06-10T19:05:56.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.647+0000 7f395a7fc640 1 -- 172.21.15.53:0/1715927264 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f395c00cca0 con 0x7f396415a140 2023-06-10T19:05:56.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.647+0000 7f396c09f640 1 -- 172.21.15.53:0/1715927264 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f396415e110 con 0x7f396415a140 2023-06-10T19:05:56.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.647+0000 7f395a7fc640 1 -- 172.21.15.53:0/1715927264 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f395c014680 con 0x7f396415a140 2023-06-10T19:05:56.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.647+0000 7f396c09f640 1 -- 172.21.15.53:0/1715927264 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39640cd480 con 0x7f396415a140 2023-06-10T19:05:56.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.647+0000 7f396c09f640 1 -- 172.21.15.53:0/1715927264 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f396404d790 con 0x7f396415a140 2023-06-10T19:05:56.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.647+0000 7f395a7fc640 1 -- 172.21.15.53:0/1715927264 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f395c01d3b0 con 0x7f396415a140 2023-06-10T19:05:56.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.651+0000 7f395a7fc640 1 --2- 172.21.15.53:0/1715927264 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f39480662b0 0x7f3948068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:56.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.651+0000 7f395a7fc640 1 -- 172.21.15.53:0/1715927264 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f395c083ae0 con 0x7f396415a140 2023-06-10T19:05:56.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.651+0000 7f3969e3b640 1 --2- 172.21.15.53:0/1715927264 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f39480662b0 0x7f3948068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:56.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.651+0000 7f3969e3b640 1 --2- 172.21.15.53:0/1715927264 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f39480662b0 0x7f3948068760 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f39600af000 tx=0x7f39600a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:56.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.655+0000 7f395a7fc640 1 -- 172.21.15.53:0/1715927264 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f395c050ff0 con 0x7f396415a140 2023-06-10T19:05:56.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.843+0000 7f396c09f640 1 -- 172.21.15.53:0/1715927264 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f396406b8b0 con 0x7f396415a140 2023-06-10T19:05:56.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.843+0000 7f395a7fc640 1 -- 172.21.15.53:0/1715927264 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v76) v1 ==== 53+0+73 (secure 0 0 0) 0x7f395c054610 con 0x7f396415a140 2023-06-10T19:05:56.848 INFO:teuthology.orchestra.run.smithi053.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-06-10T19:05:56.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.843+0000 7f396c09f640 1 -- 172.21.15.53:0/1715927264 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f39480662b0 msgr2=0x7f3948068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:56.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.843+0000 7f396c09f640 1 --2- 172.21.15.53:0/1715927264 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f39480662b0 0x7f3948068760 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f39600af000 tx=0x7f39600a7000 comp rx=0 tx=0).stop 2023-06-10T19:05:56.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.843+0000 7f396c09f640 1 -- 172.21.15.53:0/1715927264 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f396415a140 msgr2=0x7f396414f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:56.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.843+0000 7f396c09f640 1 --2- 172.21.15.53:0/1715927264 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f396415a140 0x7f396414f040 secure :-1 s=READY pgs=2054 cs=0 l=1 rev1=1 crypto rx=0x7f395c00b970 tx=0x7f395c00be30 comp rx=0 tx=0).stop 2023-06-10T19:05:56.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.843+0000 7f396c09f640 1 -- 172.21.15.53:0/1715927264 shutdown_connections 2023-06-10T19:05:56.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.843+0000 7f396c09f640 1 --2- 172.21.15.53:0/1715927264 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f39480662b0 0x7f3948068760 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:56.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.843+0000 7f396c09f640 1 --2- 172.21.15.53:0/1715927264 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f396415a140 0x7f396414f040 unknown :-1 s=CLOSED pgs=2054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:56.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.843+0000 7f396c09f640 1 --2- 172.21.15.53:0/1715927264 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3964159830 0x7f39640b0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:56.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.843+0000 7f396c09f640 1 --2- 172.21.15.53:0/1715927264 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39640c9c80 0x7f39640c4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:56.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.843+0000 7f396c09f640 1 -- 172.21.15.53:0/1715927264 >> 172.21.15.53:0/1715927264 conn(0x7f39640cdca0 msgr2=0x7f3964157370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:56.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.847+0000 7f396c09f640 1 -- 172.21.15.53:0/1715927264 shutdown_connections 2023-06-10T19:05:56.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:56.847+0000 7f396c09f640 1 -- 172.21.15.53:0/1715927264 wait complete. 2023-06-10T19:05:56.867 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-10T19:05:56.867 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-10T19:05:56.867 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi053.front.sepia.ceph.com 2023-06-10T19:05:56.868 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-06-10T19:05:56.868 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-06-10T19:05:56.868 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-10T19:05:56.869 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-10T19:05:56.869 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-10T19:05:56.869 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-06-10T19:05:56.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:05:56.870 DEBUG:teuthology.orchestra.run.smithi053:> ip addr 2023-06-10T19:05:56.875 INFO:teuthology.orchestra.run.smithi053.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-10T19:05:56.875 INFO:teuthology.orchestra.run.smithi053.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-10T19:05:56.875 INFO:teuthology.orchestra.run.smithi053.stdout: inet 127.0.0.1/8 scope host lo 2023-06-10T19:05:56.875 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:05:56.875 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 ::1/128 scope host 2023-06-10T19:05:56.875 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:05:56.876 INFO:teuthology.orchestra.run.smithi053.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T19:05:56.876 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:da brd ff:ff:ff:ff:ff:ff 2023-06-10T19:05:56.876 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f0 2023-06-10T19:05:56.876 INFO:teuthology.orchestra.run.smithi053.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T19:05:56.876 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:db brd ff:ff:ff:ff:ff:ff 2023-06-10T19:05:56.876 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f1 2023-06-10T19:05:56.876 INFO:teuthology.orchestra.run.smithi053.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-10T19:05:56.877 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:18 brd ff:ff:ff:ff:ff:ff 2023-06-10T19:05:56.877 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f0 2023-06-10T19:05:56.877 INFO:teuthology.orchestra.run.smithi053.stdout: inet 172.21.15.53/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-06-10T19:05:56.877 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft 41692sec preferred_lft 41692sec 2023-06-10T19:05:56.877 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::ae1f:6bff:fef8:3718/64 scope link 2023-06-10T19:05:56.877 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:05:56.877 INFO:teuthology.orchestra.run.smithi053.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T19:05:56.877 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:19 brd ff:ff:ff:ff:ff:ff 2023-06-10T19:05:56.878 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f1 2023-06-10T19:05:56.878 INFO:teuthology.orchestra.run.smithi053.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-06-10T19:05:56.878 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 02:42:49:3d:ee:1e brd ff:ff:ff:ff:ff:ff 2023-06-10T19:05:56.878 INFO:teuthology.orchestra.run.smithi053.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-06-10T19:05:56.878 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:05:56.878 INFO:teuthology.orchestra.run.smithi053.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-10T19:05:56.878 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-06-10T19:05:56.878 INFO:teuthology.orchestra.run.smithi053.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-06-10T19:05:56.879 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:05:56.879 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-06-10T19:05:56.879 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:05:56.879 INFO:teuthology.orchestra.run.smithi053.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-10T19:05:56.879 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-06-10T19:05:56.879 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-06-10T19:05:56.879 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:05:56.880 INFO:teuthology.orchestra.run.smithi053.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-10T19:05:56.880 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-06-10T19:05:56.880 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-06-10T19:05:56.880 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:05:56.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:05:56.881 DEBUG:teuthology.orchestra.run.smithi053:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-10T19:05:56.928 INFO:teuthology.orchestra.run.smithi053.stdout:1 2023-06-10T19:05:56.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:05:56.930 DEBUG:teuthology.orchestra.run.smithi053:> route 2023-06-10T19:05:56.976 INFO:teuthology.orchestra.run.smithi053.stdout:Kernel IP routing table 2023-06-10T19:05:56.977 INFO:teuthology.orchestra.run.smithi053.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-10T19:05:56.977 INFO:teuthology.orchestra.run.smithi053.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-06-10T19:05:56.977 INFO:teuthology.orchestra.run.smithi053.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-06-10T19:05:56.978 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-06-10T19:05:56.978 INFO:teuthology.orchestra.run.smithi053.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-10T19:05:56.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:05:56.979 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec bash -c ' 2023-06-10T19:05:56.979 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2023-06-10T19:05:56.979 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-06-10T19:05:56.980 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-06-10T19:05:56.980 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-06-10T19:05:56.980 DEBUG:teuthology.orchestra.run.smithi053:> ') 2023-06-10T19:05:57.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:05:57.053 DEBUG:teuthology.orchestra.run.smithi053:> ip netns list 2023-06-10T19:05:57.099 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-06-10T19:05:57.100 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-06-10T19:05:57.100 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-06-10T19:05:57.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:05:57.101 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link set brx.0 up 2023-06-10T19:05:57.160 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-06-10T19:05:57.160 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-10T19:05:57.161 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-06-10T19:05:57.207 INFO:teuthology.orchestra.run.smithi053.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-06-10T19:05:57.208 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-10T19:05:57.208 DEBUG:teuthology.orchestra.run.smithi053:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-06-10T19:05:57.256 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2023-06-10T19:05:57.314 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T19:05:57.314 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T19:05:57.366 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T19:05:57.368 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T19:05:57.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:05:57.369 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2023-06-10T19:05:57.415 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-06-10T19:05:57.416 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-06-10T19:05:57.461 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2023-06-10T19:05:57.475 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T19:05:57.476 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T19:05:57.530 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T19:05:57.531 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T19:05:57.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:05:57.532 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2023-06-10T19:05:57.545 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:2023-06-10T19:05:57.539+0000 7f40ed400580 -1 init, newargv = 0x55f079874fe0 newargc=15 2023-06-10T19:05:57.546 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[64532]: starting ceph client 2023-06-10T19:05:57.552 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[64532]: starting fuse 2023-06-10T19:05:58.652 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2023-06-10T19:05:58.669 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T19:05:58.669 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T19:05:58.723 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T19:05:58.724 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T19:05:58.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:05:58.725 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2023-06-10T19:05:58.771 INFO:teuthology.orchestra.run.smithi053.stdout:45 2023-06-10T19:05:58.772 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-06-10T19:05:58.772 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-06-10T19:05:58.773 DEBUG:teuthology.orchestra.run.smithi053:> import glob 2023-06-10T19:05:58.773 DEBUG:teuthology.orchestra.run.smithi053:> import re 2023-06-10T19:05:58.773 DEBUG:teuthology.orchestra.run.smithi053:> import os 2023-06-10T19:05:58.773 DEBUG:teuthology.orchestra.run.smithi053:> import subprocess 2023-06-10T19:05:58.774 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:05:58.774 DEBUG:teuthology.orchestra.run.smithi053:> def _find_admin_socket(client_name): 2023-06-10T19:05:58.774 DEBUG:teuthology.orchestra.run.smithi053:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-06-10T19:05:58.775 DEBUG:teuthology.orchestra.run.smithi053:> files = glob.glob(asok_path) 2023-06-10T19:05:58.775 DEBUG:teuthology.orchestra.run.smithi053:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-06-10T19:05:58.775 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:05:58.776 DEBUG:teuthology.orchestra.run.smithi053:> # Given a non-glob path, it better be there 2023-06-10T19:05:58.776 DEBUG:teuthology.orchestra.run.smithi053:> if "*" not in asok_path: 2023-06-10T19:05:58.776 DEBUG:teuthology.orchestra.run.smithi053:> assert(len(files) == 1) 2023-06-10T19:05:58.776 DEBUG:teuthology.orchestra.run.smithi053:> return files[0] 2023-06-10T19:05:58.777 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:05:58.777 DEBUG:teuthology.orchestra.run.smithi053:> for f in files: 2023-06-10T19:05:58.777 DEBUG:teuthology.orchestra.run.smithi053:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-06-10T19:05:58.778 DEBUG:teuthology.orchestra.run.smithi053:> if os.path.exists("/proc/{0}".format(pid)): 2023-06-10T19:05:58.778 DEBUG:teuthology.orchestra.run.smithi053:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-06-10T19:05:58.778 DEBUG:teuthology.orchestra.run.smithi053:> contents = proc_f.read() 2023-06-10T19:05:58.779 DEBUG:teuthology.orchestra.run.smithi053:> if mountpoint in contents: 2023-06-10T19:05:58.779 DEBUG:teuthology.orchestra.run.smithi053:> return f 2023-06-10T19:05:58.779 DEBUG:teuthology.orchestra.run.smithi053:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-06-10T19:05:58.779 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:05:58.780 DEBUG:teuthology.orchestra.run.smithi053:> print(_find_admin_socket("client.0")) 2023-06-10T19:05:58.780 DEBUG:teuthology.orchestra.run.smithi053:> ' 2023-06-10T19:05:58.899 INFO:teuthology.orchestra.run.smithi053.stdout:/var/run/ceph/ceph-client.0.64532.asok 2023-06-10T19:05:59.081 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.64532.asok 2023-06-10T19:05:59.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:05:59.082 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.64532.asok status 2023-06-10T19:05:59.241 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-06-10T19:05:59.241 INFO:teuthology.orchestra.run.smithi053.stdout: "metadata": { 2023-06-10T19:05:59.241 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_sha1": "219d315c3a0b2075e570fb1964be2ad33fe7a9c8", 2023-06-10T19:05:59.241 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_version": "ceph version 18.0.0-4359-g219d315c (219d315c3a0b2075e570fb1964be2ad33fe7a9c8) reef (dev)", 2023-06-10T19:05:59.242 INFO:teuthology.orchestra.run.smithi053.stdout: "entity_id": "0", 2023-06-10T19:05:59.242 INFO:teuthology.orchestra.run.smithi053.stdout: "hostname": "smithi053", 2023-06-10T19:05:59.242 INFO:teuthology.orchestra.run.smithi053.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-06-10T19:05:59.242 INFO:teuthology.orchestra.run.smithi053.stdout: "pid": "64532", 2023-06-10T19:05:59.243 INFO:teuthology.orchestra.run.smithi053.stdout: "root": "/" 2023-06-10T19:05:59.243 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:05:59.243 INFO:teuthology.orchestra.run.smithi053.stdout: "dentry_count": 0, 2023-06-10T19:05:59.243 INFO:teuthology.orchestra.run.smithi053.stdout: "dentry_pinned_count": 0, 2023-06-10T19:05:59.243 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 9726, 2023-06-10T19:05:59.243 INFO:teuthology.orchestra.run.smithi053.stdout: "inst": { 2023-06-10T19:05:59.243 INFO:teuthology.orchestra.run.smithi053.stdout: "name": { 2023-06-10T19:05:59.244 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "client", 2023-06-10T19:05:59.244 INFO:teuthology.orchestra.run.smithi053.stdout: "num": 9726 2023-06-10T19:05:59.244 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:05:59.244 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": { 2023-06-10T19:05:59.244 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2023-06-10T19:05:59.244 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "192.168.0.1:0", 2023-06-10T19:05:59.245 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 1923076265 2023-06-10T19:05:59.245 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:05:59.245 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:05:59.245 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": { 2023-06-10T19:05:59.245 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2023-06-10T19:05:59.245 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "192.168.0.1:0", 2023-06-10T19:05:59.245 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 1923076265 2023-06-10T19:05:59.245 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:05:59.246 INFO:teuthology.orchestra.run.smithi053.stdout: "inst_str": "client.9726 192.168.0.1:0/1923076265", 2023-06-10T19:05:59.246 INFO:teuthology.orchestra.run.smithi053.stdout: "addr_str": "192.168.0.1:0/1923076265", 2023-06-10T19:05:59.246 INFO:teuthology.orchestra.run.smithi053.stdout: "inode_count": 1, 2023-06-10T19:05:59.246 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_epoch": 76, 2023-06-10T19:05:59.246 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_epoch": 138, 2023-06-10T19:05:59.247 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_epoch_barrier": 0, 2023-06-10T19:05:59.247 INFO:teuthology.orchestra.run.smithi053.stdout: "blocklisted": false, 2023-06-10T19:05:59.247 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs" 2023-06-10T19:05:59.247 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-06-10T19:05:59.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:05:59.254 DEBUG:teuthology.orchestra.run.smithi053:> stat --file-system '--printf=%T 2023-06-10T19:05:59.255 DEBUG:teuthology.orchestra.run.smithi053:> ' -- /home/ubuntu/cephtest/mnt.0 2023-06-10T19:05:59.261 INFO:teuthology.orchestra.run.smithi053.stdout:fuseblk 2023-06-10T19:05:59.261 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-06-10T19:05:59.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:05:59.263 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-06-10T19:05:59.321 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-10T19:05:59.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.487+0000 7f51b662e640 1 Processor -- start 2023-06-10T19:05:59.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.487+0000 7f51b662e640 1 -- start start 2023-06-10T19:05:59.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.487+0000 7f51b662e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51b0162640 0x7f51b0164a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:59.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.487+0000 7f51b662e640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51b0159b50 con 0x7f51b0071060 2023-06-10T19:05:59.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.487+0000 7f51b662e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51b00702a0 con 0x7f51b00c9840 2023-06-10T19:05:59.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.487+0000 7f51b662e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51b0070580 con 0x7f51b0162640 2023-06-10T19:05:59.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.487+0000 7f51a7fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f51b0071060 0x7f51b00af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:45248/0 (socket says 172.21.15.53:45248) 2023-06-10T19:05:59.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.487+0000 7f51a7fff640 1 -- 172.21.15.53:0/3903576166 learned_addr learned my addr 172.21.15.53:0/3903576166 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:05:59.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.487+0000 7f51b4bcb640 1 --2- 172.21.15.53:0/3903576166 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51b0162640 0x7f51b0164a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:59.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.487+0000 7f51af7fe640 1 -- 172.21.15.53:0/3903576166 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3610089106 0 0) 0x7f51b0159b50 con 0x7f51b0071060 2023-06-10T19:05:59.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.487+0000 7f51af7fe640 1 -- 172.21.15.53:0/3903576166 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f519c003530 con 0x7f51b0071060 2023-06-10T19:05:59.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.487+0000 7f51af7fe640 1 -- 172.21.15.53:0/3903576166 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 811892304 0 0) 0x7f519c003530 con 0x7f51b0071060 2023-06-10T19:05:59.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.487+0000 7f51af7fe640 1 -- 172.21.15.53:0/3903576166 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51b0162640 msgr2=0x7f51b0164a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:59.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.487+0000 7f51af7fe640 1 --2- 172.21.15.53:0/3903576166 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51b0162640 0x7f51b0164a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:59.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.487+0000 7f51af7fe640 1 -- 172.21.15.53:0/3903576166 >> v1:172.21.15.117:6789/0 conn(0x7f51b00c9840 legacy=0x7f51b00c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:59.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.487+0000 7f51af7fe640 1 -- 172.21.15.53:0/3903576166 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51b0070860 con 0x7f51b0071060 2023-06-10T19:05:59.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.487+0000 7f51af7fe640 1 -- 172.21.15.53:0/3903576166 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f5198001680 con 0x7f51b0071060 2023-06-10T19:05:59.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.487+0000 7f51af7fe640 1 -- 172.21.15.53:0/3903576166 >> v1:172.21.15.53:6789/0 conn(0x7f51b0071060 legacy=0x7f51b00af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:59.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.487+0000 7f51af7fe640 1 --2- 172.21.15.53:0/3903576166 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51b0162640 0x7f519c003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:59.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.487+0000 7f51af7fe640 1 --2- 172.21.15.53:0/3903576166 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f519c003fa0 0x7f519c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:59.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.487+0000 7f51af7fe640 1 --2- 172.21.15.53:0/3903576166 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f519c004d10 0x7f519c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:59.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.487+0000 7f51af7fe640 1 -- 172.21.15.53:0/3903576166 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51b0070580 con 0x7f519c004d10 2023-06-10T19:05:59.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.487+0000 7f51af7fe640 1 -- 172.21.15.53:0/3903576166 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f519c00bad0 con 0x7f519c003fa0 2023-06-10T19:05:59.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.487+0000 7f51af7fe640 1 -- 172.21.15.53:0/3903576166 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f519c00bc90 con 0x7f51b0162640 2023-06-10T19:05:59.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.487+0000 7f51b4bcb640 1 --2- 172.21.15.53:0/3903576166 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f519c004d10 0x7f519c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:59.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.487+0000 7f51a7fff640 1 --2- 172.21.15.53:0/3903576166 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f519c003fa0 0x7f519c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:59.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.487+0000 7f51affff640 1 --2- 172.21.15.53:0/3903576166 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51b0162640 0x7f519c003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:59.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.487+0000 7f51b4bcb640 1 -- 172.21.15.53:0/3903576166 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51b0162640 msgr2=0x7f519c003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:59.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.487+0000 7f51b4bcb640 1 --2- 172.21.15.53:0/3903576166 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51b0162640 0x7f519c003a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:59.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.487+0000 7f51b4bcb640 1 -- 172.21.15.53:0/3903576166 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f519c003fa0 msgr2=0x7f519c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:05:59.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.487+0000 7f51b4bcb640 1 --2- 172.21.15.53:0/3903576166 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f519c003fa0 0x7f519c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:59.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.487+0000 7f51b4bcb640 1 -- 172.21.15.53:0/3903576166 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f519c003530 con 0x7f519c004d10 2023-06-10T19:05:59.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.491+0000 7f51b4bcb640 1 --2- 172.21.15.53:0/3903576166 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f519c004d10 0x7f519c005180 secure :-1 s=READY pgs=2059 cs=0 l=1 rev1=1 crypto rx=0x7f51b015e380 tx=0x7f51a801cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa1ed08bf1a2a829 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:59.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.491+0000 7f51af7fe640 1 -- 172.21.15.53:0/3903576166 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a80a5bd0 con 0x7f519c004d10 2023-06-10T19:05:59.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.491+0000 7f51af7fe640 1 -- 172.21.15.53:0/3903576166 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51a800f040 con 0x7f519c004d10 2023-06-10T19:05:59.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.491+0000 7f51af7fe640 1 -- 172.21.15.53:0/3903576166 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a80ad440 con 0x7f519c004d10 2023-06-10T19:05:59.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.491+0000 7f51b662e640 1 -- 172.21.15.53:0/3903576166 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f519c004d10 msgr2=0x7f519c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:59.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.491+0000 7f51b662e640 1 --2- 172.21.15.53:0/3903576166 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f519c004d10 0x7f519c005180 secure :-1 s=READY pgs=2059 cs=0 l=1 rev1=1 crypto rx=0x7f51b015e380 tx=0x7f51a801cbc0 comp rx=0 tx=0).stop 2023-06-10T19:05:59.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.491+0000 7f51b4bcb640 1 -- 172.21.15.53:0/3903576166 reap_dead start 2023-06-10T19:05:59.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.491+0000 7f51b662e640 1 -- 172.21.15.53:0/3903576166 shutdown_connections 2023-06-10T19:05:59.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.491+0000 7f51b662e640 1 -- 172.21.15.53:0/3903576166 >> 172.21.15.53:0/3903576166 conn(0x7f51b006a0d0 msgr2=0x7f51b00ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:59.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.491+0000 7f51b662e640 1 -- 172.21.15.53:0/3903576166 shutdown_connections 2023-06-10T19:05:59.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.491+0000 7f51b662e640 1 -- 172.21.15.53:0/3903576166 wait complete. 2023-06-10T19:05:59.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.491+0000 7f51b662e640 1 Processor -- start 2023-06-10T19:05:59.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.491+0000 7f51b662e640 1 -- start start 2023-06-10T19:05:59.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.495+0000 7f51b662e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f519c004d10 0x7f51b00b2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:59.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.495+0000 7f51b662e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51b0150490 0x7f51b00b30c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:59.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.495+0000 7f51b662e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51b01f2780 0x7f51b01f2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:59.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.495+0000 7f51b662e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51b0151680 con 0x7f519c004d10 2023-06-10T19:05:59.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.495+0000 7f51b662e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51b015dae0 con 0x7f51b01f2780 2023-06-10T19:05:59.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.495+0000 7f51b662e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51b0150a00 con 0x7f51b0150490 2023-06-10T19:05:59.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.495+0000 7f51affff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f519c004d10 0x7f51b00b2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:59.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.495+0000 7f51affff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f519c004d10 0x7f51b00b2b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47342/0 (socket says 172.21.15.53:47342) 2023-06-10T19:05:59.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.495+0000 7f51affff640 1 -- 172.21.15.53:0/2816691031 learned_addr learned my addr 172.21.15.53:0/2816691031 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:05:59.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.495+0000 7f51b4bcb640 1 --2- 172.21.15.53:0/2816691031 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51b01f2780 0x7f51b01f2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:59.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.495+0000 7f51a7fff640 1 --2- 172.21.15.53:0/2816691031 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51b0150490 0x7f51b00b30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:59.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.495+0000 7f51affff640 1 -- 172.21.15.53:0/2816691031 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51b0150490 msgr2=0x7f51b00b30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:59.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.495+0000 7f51affff640 1 --2- 172.21.15.53:0/2816691031 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51b0150490 0x7f51b00b30c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:59.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.495+0000 7f51affff640 1 -- 172.21.15.53:0/2816691031 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51b01f2780 msgr2=0x7f51b01f2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:59.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.495+0000 7f51affff640 1 --2- 172.21.15.53:0/2816691031 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51b01f2780 0x7f51b01f2bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:59.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.495+0000 7f51affff640 1 -- 172.21.15.53:0/2816691031 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51b0150ce0 con 0x7f519c004d10 2023-06-10T19:05:59.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.495+0000 7f51b4bcb640 1 --2- 172.21.15.53:0/2816691031 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51b01f2780 0x7f51b01f2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:05:59.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.495+0000 7f51affff640 1 --2- 172.21.15.53:0/2816691031 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f519c004d10 0x7f51b00b2b80 secure :-1 s=READY pgs=2060 cs=0 l=1 rev1=1 crypto rx=0x7f51a000e550 tx=0x7f51a000ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:59.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.495+0000 7f51ad7fa640 1 -- 172.21.15.53:0/2816691031 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a00052e0 con 0x7f519c004d10 2023-06-10T19:05:59.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.495+0000 7f51ad7fa640 1 -- 172.21.15.53:0/2816691031 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51a0005440 con 0x7f519c004d10 2023-06-10T19:05:59.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.495+0000 7f51b662e640 1 -- 172.21.15.53:0/2816691031 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51b0150fc0 con 0x7f519c004d10 2023-06-10T19:05:59.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.495+0000 7f51ad7fa640 1 -- 172.21.15.53:0/2816691031 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a0003820 con 0x7f519c004d10 2023-06-10T19:05:59.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.495+0000 7f51b662e640 1 -- 172.21.15.53:0/2816691031 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51b01f3130 con 0x7f519c004d10 2023-06-10T19:05:59.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.495+0000 7f51b662e640 1 -- 172.21.15.53:0/2816691031 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51b00c6330 con 0x7f519c004d10 2023-06-10T19:05:59.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.495+0000 7f51ad7fa640 1 -- 172.21.15.53:0/2816691031 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f51a0003980 con 0x7f519c004d10 2023-06-10T19:05:59.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.495+0000 7f51ad7fa640 1 --2- 172.21.15.53:0/2816691031 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5190066280 0x7f5190068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:05:59.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.495+0000 7f51ad7fa640 1 -- 172.21.15.53:0/2816691031 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f51a0083ac0 con 0x7f519c004d10 2023-06-10T19:05:59.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.495+0000 7f51a7fff640 1 --2- 172.21.15.53:0/2816691031 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5190066280 0x7f5190068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:05:59.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.499+0000 7f51a7fff640 1 --2- 172.21.15.53:0/2816691031 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5190066280 0x7f5190068730 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f51b0154fe0 tx=0x7f5198009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:05:59.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.499+0000 7f51ad7fa640 1 -- 172.21.15.53:0/2816691031 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f51a0050fd0 con 0x7f519c004d10 2023-06-10T19:05:59.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.687+0000 7f51b662e640 1 -- 172.21.15.53:0/2816691031 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f51b004d790 con 0x7f519c004d10 2023-06-10T19:05:59.695 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.691+0000 7f51ad7fa640 1 -- 172.21.15.53:0/2816691031 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v76) v1 ==== 53+0+73 (secure 0 0 0) 0x7f51a00545f0 con 0x7f519c004d10 2023-06-10T19:05:59.695 INFO:teuthology.orchestra.run.smithi053.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-06-10T19:05:59.697 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.691+0000 7f51b662e640 1 -- 172.21.15.53:0/2816691031 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5190066280 msgr2=0x7f5190068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:59.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.691+0000 7f51b662e640 1 --2- 172.21.15.53:0/2816691031 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5190066280 0x7f5190068730 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f51b0154fe0 tx=0x7f5198009040 comp rx=0 tx=0).stop 2023-06-10T19:05:59.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.691+0000 7f51b662e640 1 -- 172.21.15.53:0/2816691031 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f519c004d10 msgr2=0x7f51b00b2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:05:59.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.691+0000 7f51b662e640 1 --2- 172.21.15.53:0/2816691031 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f519c004d10 0x7f51b00b2b80 secure :-1 s=READY pgs=2060 cs=0 l=1 rev1=1 crypto rx=0x7f51a000e550 tx=0x7f51a000ea10 comp rx=0 tx=0).stop 2023-06-10T19:05:59.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.691+0000 7f51b662e640 1 -- 172.21.15.53:0/2816691031 shutdown_connections 2023-06-10T19:05:59.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.691+0000 7f51b662e640 1 --2- 172.21.15.53:0/2816691031 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5190066280 0x7f5190068730 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:59.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.691+0000 7f51b662e640 1 --2- 172.21.15.53:0/2816691031 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51b01f2780 0x7f51b01f2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:59.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.691+0000 7f51b662e640 1 --2- 172.21.15.53:0/2816691031 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51b0150490 0x7f51b00b30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:59.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.691+0000 7f51b662e640 1 --2- 172.21.15.53:0/2816691031 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f519c004d10 0x7f51b00b2b80 unknown :-1 s=CLOSED pgs=2060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:05:59.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.691+0000 7f51b662e640 1 -- 172.21.15.53:0/2816691031 >> 172.21.15.53:0/2816691031 conn(0x7f51b006a0d0 msgr2=0x7f51b00ca370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:05:59.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.691+0000 7f51b662e640 1 -- 172.21.15.53:0/2816691031 shutdown_connections 2023-06-10T19:05:59.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:05:59.691+0000 7f51b662e640 1 -- 172.21.15.53:0/2816691031 wait complete. 2023-06-10T19:05:59.714 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-10T19:05:59.715 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-10T19:05:59.715 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi117.front.sepia.ceph.com 2023-06-10T19:05:59.715 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-06-10T19:05:59.715 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-06-10T19:05:59.716 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-10T19:05:59.716 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-10T19:05:59.716 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-10T19:05:59.716 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-06-10T19:05:59.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:05:59.717 DEBUG:teuthology.orchestra.run.smithi117:> ip addr 2023-06-10T19:05:59.723 INFO:teuthology.orchestra.run.smithi117.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-10T19:05:59.724 INFO:teuthology.orchestra.run.smithi117.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-10T19:05:59.724 INFO:teuthology.orchestra.run.smithi117.stdout: inet 127.0.0.1/8 scope host lo 2023-06-10T19:05:59.724 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:05:59.724 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 ::1/128 scope host 2023-06-10T19:05:59.724 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:05:59.724 INFO:teuthology.orchestra.run.smithi117.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T19:05:59.725 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8a brd ff:ff:ff:ff:ff:ff 2023-06-10T19:05:59.725 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f0 2023-06-10T19:05:59.725 INFO:teuthology.orchestra.run.smithi117.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T19:05:59.725 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8b brd ff:ff:ff:ff:ff:ff 2023-06-10T19:05:59.725 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f1 2023-06-10T19:05:59.725 INFO:teuthology.orchestra.run.smithi117.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T19:05:59.725 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:62 brd ff:ff:ff:ff:ff:ff 2023-06-10T19:05:59.726 INFO:teuthology.orchestra.run.smithi117.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-10T19:05:59.726 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:63 brd ff:ff:ff:ff:ff:ff 2023-06-10T19:05:59.726 INFO:teuthology.orchestra.run.smithi117.stdout: inet 172.21.15.117/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-06-10T19:05:59.726 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft 41690sec preferred_lft 41690sec 2023-06-10T19:05:59.726 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::ec4:7aff:fe8f:4463/64 scope link 2023-06-10T19:05:59.726 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:05:59.726 INFO:teuthology.orchestra.run.smithi117.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-06-10T19:05:59.726 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 02:42:f8:40:b2:dc brd ff:ff:ff:ff:ff:ff 2023-06-10T19:05:59.727 INFO:teuthology.orchestra.run.smithi117.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-06-10T19:05:59.727 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:05:59.727 INFO:teuthology.orchestra.run.smithi117.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-10T19:05:59.727 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-06-10T19:05:59.727 INFO:teuthology.orchestra.run.smithi117.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-06-10T19:05:59.727 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:05:59.727 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-06-10T19:05:59.727 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:05:59.728 INFO:teuthology.orchestra.run.smithi117.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-10T19:05:59.728 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-06-10T19:05:59.728 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-06-10T19:05:59.728 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:05:59.728 INFO:teuthology.orchestra.run.smithi117.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-10T19:05:59.728 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-06-10T19:05:59.728 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-06-10T19:05:59.729 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:05:59.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:05:59.730 DEBUG:teuthology.orchestra.run.smithi117:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-10T19:05:59.783 INFO:teuthology.orchestra.run.smithi117.stdout:1 2023-06-10T19:05:59.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:05:59.784 DEBUG:teuthology.orchestra.run.smithi117:> route 2023-06-10T19:05:59.833 INFO:teuthology.orchestra.run.smithi117.stdout:Kernel IP routing table 2023-06-10T19:05:59.833 INFO:teuthology.orchestra.run.smithi117.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-10T19:05:59.833 INFO:teuthology.orchestra.run.smithi117.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-06-10T19:05:59.834 INFO:teuthology.orchestra.run.smithi117.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-06-10T19:05:59.834 INFO:teuthology.orchestra.run.smithi117.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-06-10T19:05:59.834 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-06-10T19:05:59.834 INFO:teuthology.orchestra.run.smithi117.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-10T19:05:59.834 INFO:teuthology.orchestra.run.smithi117.stdout:ns2.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-10T19:05:59.834 INFO:teuthology.orchestra.run.smithi117.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-10T19:05:59.834 INFO:teuthology.orchestra.run.smithi117.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-10T19:05:59.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:05:59.835 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec bash -c ' 2023-06-10T19:05:59.835 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2023-06-10T19:05:59.836 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-06-10T19:05:59.836 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-06-10T19:05:59.836 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-06-10T19:05:59.837 DEBUG:teuthology.orchestra.run.smithi117:> ') 2023-06-10T19:05:59.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:05:59.912 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list 2023-06-10T19:05:59.959 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-06-10T19:05:59.959 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-06-10T19:05:59.959 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-06-10T19:05:59.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:05:59.960 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link set brx.0 up 2023-06-10T19:06:00.012 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-06-10T19:06:00.013 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-10T19:06:00.013 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-06-10T19:06:00.059 INFO:teuthology.orchestra.run.smithi117.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-06-10T19:06:00.059 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-10T19:06:00.060 DEBUG:teuthology.orchestra.run.smithi117:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-06-10T19:06:00.110 DEBUG:teuthology.orchestra.run.smithi117:> sudo modprobe fuse 2023-06-10T19:06:00.172 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T19:06:00.173 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T19:06:00.230 INFO:teuthology.orchestra.run.smithi117.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T19:06:00.231 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T19:06:00.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:06:00.233 DEBUG:teuthology.orchestra.run.smithi117:> ls /sys/fs/fuse/connections 2023-06-10T19:06:00.279 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-06-10T19:06:00.279 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-06-10T19:06:00.324 DEBUG:teuthology.orchestra.run.smithi117:> sudo modprobe fuse 2023-06-10T19:06:00.340 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T19:06:00.341 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T19:06:00.392 INFO:teuthology.orchestra.run.smithi117.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T19:06:00.394 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T19:06:00.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:06:00.395 DEBUG:teuthology.orchestra.run.smithi117:> ls /sys/fs/fuse/connections 2023-06-10T19:06:00.403 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi117.stderr:2023-06-10T19:06:00.402+0000 7ff87811f580 -1 init, newargv = 0x56175fb06f20 newargc=15 2023-06-10T19:06:00.404 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi117.stderr:ceph-fuse[45442]: starting ceph client 2023-06-10T19:06:00.411 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi117.stderr:ceph-fuse[45442]: starting fuse 2023-06-10T19:06:01.510 DEBUG:teuthology.orchestra.run.smithi117:> sudo modprobe fuse 2023-06-10T19:06:01.526 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T19:06:01.526 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T19:06:01.581 INFO:teuthology.orchestra.run.smithi117.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T19:06:01.582 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T19:06:01.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:06:01.584 DEBUG:teuthology.orchestra.run.smithi117:> ls /sys/fs/fuse/connections 2023-06-10T19:06:01.635 INFO:teuthology.orchestra.run.smithi117.stdout:45 2023-06-10T19:06:01.636 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-06-10T19:06:01.636 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-06-10T19:06:01.636 DEBUG:teuthology.orchestra.run.smithi117:> import glob 2023-06-10T19:06:01.637 DEBUG:teuthology.orchestra.run.smithi117:> import re 2023-06-10T19:06:01.637 DEBUG:teuthology.orchestra.run.smithi117:> import os 2023-06-10T19:06:01.638 DEBUG:teuthology.orchestra.run.smithi117:> import subprocess 2023-06-10T19:06:01.638 DEBUG:teuthology.orchestra.run.smithi117:> 2023-06-10T19:06:01.638 DEBUG:teuthology.orchestra.run.smithi117:> def _find_admin_socket(client_name): 2023-06-10T19:06:01.638 DEBUG:teuthology.orchestra.run.smithi117:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-06-10T19:06:01.639 DEBUG:teuthology.orchestra.run.smithi117:> files = glob.glob(asok_path) 2023-06-10T19:06:01.639 DEBUG:teuthology.orchestra.run.smithi117:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-06-10T19:06:01.639 DEBUG:teuthology.orchestra.run.smithi117:> 2023-06-10T19:06:01.640 DEBUG:teuthology.orchestra.run.smithi117:> # Given a non-glob path, it better be there 2023-06-10T19:06:01.640 DEBUG:teuthology.orchestra.run.smithi117:> if "*" not in asok_path: 2023-06-10T19:06:01.641 DEBUG:teuthology.orchestra.run.smithi117:> assert(len(files) == 1) 2023-06-10T19:06:01.641 DEBUG:teuthology.orchestra.run.smithi117:> return files[0] 2023-06-10T19:06:01.642 DEBUG:teuthology.orchestra.run.smithi117:> 2023-06-10T19:06:01.643 DEBUG:teuthology.orchestra.run.smithi117:> for f in files: 2023-06-10T19:06:01.644 DEBUG:teuthology.orchestra.run.smithi117:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-06-10T19:06:01.644 DEBUG:teuthology.orchestra.run.smithi117:> if os.path.exists("/proc/{0}".format(pid)): 2023-06-10T19:06:01.645 DEBUG:teuthology.orchestra.run.smithi117:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-06-10T19:06:01.646 DEBUG:teuthology.orchestra.run.smithi117:> contents = proc_f.read() 2023-06-10T19:06:01.646 DEBUG:teuthology.orchestra.run.smithi117:> if mountpoint in contents: 2023-06-10T19:06:01.646 DEBUG:teuthology.orchestra.run.smithi117:> return f 2023-06-10T19:06:01.647 DEBUG:teuthology.orchestra.run.smithi117:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-06-10T19:06:01.647 DEBUG:teuthology.orchestra.run.smithi117:> 2023-06-10T19:06:01.648 DEBUG:teuthology.orchestra.run.smithi117:> print(_find_admin_socket("client.1")) 2023-06-10T19:06:01.648 DEBUG:teuthology.orchestra.run.smithi117:> ' 2023-06-10T19:06:01.755 INFO:teuthology.orchestra.run.smithi117.stdout:/var/run/ceph/ceph-client.1.45442.asok 2023-06-10T19:06:01.938 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.45442.asok 2023-06-10T19:06:01.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:06:01.939 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.45442.asok status 2023-06-10T19:06:02.099 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2023-06-10T19:06:02.099 INFO:teuthology.orchestra.run.smithi117.stdout: "metadata": { 2023-06-10T19:06:02.099 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_sha1": "219d315c3a0b2075e570fb1964be2ad33fe7a9c8", 2023-06-10T19:06:02.099 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_version": "ceph version 18.0.0-4359-g219d315c (219d315c3a0b2075e570fb1964be2ad33fe7a9c8) reef (dev)", 2023-06-10T19:06:02.100 INFO:teuthology.orchestra.run.smithi117.stdout: "entity_id": "1", 2023-06-10T19:06:02.100 INFO:teuthology.orchestra.run.smithi117.stdout: "hostname": "smithi117", 2023-06-10T19:06:02.100 INFO:teuthology.orchestra.run.smithi117.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-06-10T19:06:02.100 INFO:teuthology.orchestra.run.smithi117.stdout: "pid": "45442", 2023-06-10T19:06:02.100 INFO:teuthology.orchestra.run.smithi117.stdout: "root": "/" 2023-06-10T19:06:02.101 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-06-10T19:06:02.101 INFO:teuthology.orchestra.run.smithi117.stdout: "dentry_count": 0, 2023-06-10T19:06:02.101 INFO:teuthology.orchestra.run.smithi117.stdout: "dentry_pinned_count": 0, 2023-06-10T19:06:02.101 INFO:teuthology.orchestra.run.smithi117.stdout: "id": 8086, 2023-06-10T19:06:02.101 INFO:teuthology.orchestra.run.smithi117.stdout: "inst": { 2023-06-10T19:06:02.101 INFO:teuthology.orchestra.run.smithi117.stdout: "name": { 2023-06-10T19:06:02.102 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "client", 2023-06-10T19:06:02.102 INFO:teuthology.orchestra.run.smithi117.stdout: "num": 8086 2023-06-10T19:06:02.102 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-06-10T19:06:02.102 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": { 2023-06-10T19:06:02.102 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "v1", 2023-06-10T19:06:02.102 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": "192.168.0.1:0", 2023-06-10T19:06:02.102 INFO:teuthology.orchestra.run.smithi117.stdout: "nonce": 711538463 2023-06-10T19:06:02.103 INFO:teuthology.orchestra.run.smithi117.stdout: } 2023-06-10T19:06:02.103 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-06-10T19:06:02.103 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": { 2023-06-10T19:06:02.103 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "v1", 2023-06-10T19:06:02.103 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": "192.168.0.1:0", 2023-06-10T19:06:02.103 INFO:teuthology.orchestra.run.smithi117.stdout: "nonce": 711538463 2023-06-10T19:06:02.103 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-06-10T19:06:02.104 INFO:teuthology.orchestra.run.smithi117.stdout: "inst_str": "client.8086 192.168.0.1:0/711538463", 2023-06-10T19:06:02.104 INFO:teuthology.orchestra.run.smithi117.stdout: "addr_str": "192.168.0.1:0/711538463", 2023-06-10T19:06:02.104 INFO:teuthology.orchestra.run.smithi117.stdout: "inode_count": 1, 2023-06-10T19:06:02.104 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_epoch": 76, 2023-06-10T19:06:02.104 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_epoch": 138, 2023-06-10T19:06:02.104 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_epoch_barrier": 0, 2023-06-10T19:06:02.105 INFO:teuthology.orchestra.run.smithi117.stdout: "blocklisted": false, 2023-06-10T19:06:02.105 INFO:teuthology.orchestra.run.smithi117.stdout: "fs_name": "cephfs" 2023-06-10T19:06:02.105 INFO:teuthology.orchestra.run.smithi117.stdout:} 2023-06-10T19:06:02.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:06:02.113 DEBUG:teuthology.orchestra.run.smithi117:> stat --file-system '--printf=%T 2023-06-10T19:06:02.114 DEBUG:teuthology.orchestra.run.smithi117:> ' -- /home/ubuntu/cephtest/mnt.1 2023-06-10T19:06:02.120 INFO:teuthology.orchestra.run.smithi117.stdout:fuseblk 2023-06-10T19:06:02.120 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-06-10T19:06:02.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:06:02.121 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-06-10T19:06:02.174 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config get mds_reconnect_timeout 2023-06-10T19:06:02.315 INFO:teuthology.orchestra.run.smithi053.stdout:{"mds_reconnect_timeout":"45.000000"} 2023-06-10T19:06:02.315 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_reconnect_timeout": "45.000000" } 2023-06-10T19:06:02.316 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config get ms_max_backoff 2023-06-10T19:06:02.453 INFO:teuthology.orchestra.run.smithi053.stdout:{"ms_max_backoff":"15.000000"} 2023-06-10T19:06:02.453 DEBUG:tasks.cephfs.filesystem:_json_asok output { "ms_max_backoff": "15.000000" } 2023-06-10T19:06:02.454 DEBUG:teuthology.orchestra.run.smithi053:> dpkg-query -W -f '${Version}' fuse 2023-06-10T19:06:02.475 INFO:teuthology.orchestra.run.smithi053.stdout:2.9.9-3 2023-06-10T19:06:02.475 INFO:teuthology.packaging:The installed version of fuse is 2.9.9-3 2023-06-10T19:06:02.476 DEBUG:teuthology.orchestra.run.smithi117:> dpkg-query -W -f '${Version}' fuse 2023-06-10T19:06:02.496 INFO:teuthology.orchestra.run.smithi117.stdout:2.9.9-3 2023-06-10T19:06:02.496 INFO:teuthology.packaging:The installed version of fuse is 2.9.9-3 2023-06-10T19:06:02.497 INFO:tasks.cephfs.test_client_recovery:flock locks are available 2023-06-10T19:06:02.497 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T19:06:02.498 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:06:02.525 INFO:tasks.cephfs.mount:lock_background file background_file 2023-06-10T19:06:02.525 DEBUG:teuthology.orchestra.run.smithi053:> adjust-ulimits daemon-helper kill python3 -c ' 2023-06-10T19:06:02.525 DEBUG:teuthology.orchestra.run.smithi053:> import time 2023-06-10T19:06:02.526 DEBUG:teuthology.orchestra.run.smithi053:> import fcntl 2023-06-10T19:06:02.526 DEBUG:teuthology.orchestra.run.smithi053:> import struct 2023-06-10T19:06:02.526 DEBUG:teuthology.orchestra.run.smithi053:> f1 = open("/home/ubuntu/cephtest/mnt.0/background_file-1", '"'"'w'"'"') 2023-06-10T19:06:02.527 DEBUG:teuthology.orchestra.run.smithi053:> fcntl.flock(f1, fcntl.LOCK_EX | fcntl.LOCK_NB) 2023-06-10T19:06:02.527 DEBUG:teuthology.orchestra.run.smithi053:> f2 = open("/home/ubuntu/cephtest/mnt.0/background_file-2", '"'"'w'"'"') 2023-06-10T19:06:02.527 DEBUG:teuthology.orchestra.run.smithi053:> lockdata = struct.pack('"'"'hhllhh'"'"', fcntl.F_WRLCK, 0, 0, 0, 0, 0) 2023-06-10T19:06:02.528 DEBUG:teuthology.orchestra.run.smithi053:> fcntl.fcntl(f2, fcntl.F_SETLK, lockdata) 2023-06-10T19:06:02.528 DEBUG:teuthology.orchestra.run.smithi053:> while True: 2023-06-10T19:06:02.528 DEBUG:teuthology.orchestra.run.smithi053:> time.sleep(1) 2023-06-10T19:06:02.528 DEBUG:teuthology.orchestra.run.smithi053:> ' 2023-06-10T19:06:02.568 DEBUG:teuthology.orchestra.run.smithi117:> stat /home/ubuntu/cephtest/mnt.1/background_file-2 2023-06-10T19:06:02.575 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-10T19:06:02.576 INFO:teuthology.orchestra.run.smithi117.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.1/background_file-2': No such file or directory 2023-06-10T19:06:03.577 DEBUG:teuthology.orchestra.run.smithi117:> stat /home/ubuntu/cephtest/mnt.1/background_file-2 2023-06-10T19:06:03.598 INFO:teuthology.orchestra.run.smithi117.stdout: File: /home/ubuntu/cephtest/mnt.1/background_file-2 2023-06-10T19:06:03.598 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 0 Blocks: 0 IO Block: 4194304 regular empty file 2023-06-10T19:06:03.598 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 2dh/45d Inode: 1099511627777 Links: 1 2023-06-10T19:06:03.599 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0664/-rw-rw-r--) Uid: ( 1000/ ubuntu) Gid: ( 1271/ ubuntu) 2023-06-10T19:06:03.599 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2023-06-10 19:06:02.639841854 +0000 2023-06-10T19:06:03.599 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2023-06-10 19:06:02.639841854 +0000 2023-06-10T19:06:03.599 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2023-06-10 19:06:02.639841854 +0000 2023-06-10T19:06:03.599 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: - 2023-06-10T19:06:03.599 INFO:tasks.cephfs.mount:File background_file-2 became visible from 1 after 1s 2023-06-10T19:06:03.600 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T19:06:03.600 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:06:03.649 INFO:tasks.cephfs.mount:check lock on file background_file 2023-06-10T19:06:03.650 DEBUG:teuthology.orchestra.run.smithi117:> python3 -c ' 2023-06-10T19:06:03.650 DEBUG:teuthology.orchestra.run.smithi117:> import fcntl 2023-06-10T19:06:03.650 DEBUG:teuthology.orchestra.run.smithi117:> import errno 2023-06-10T19:06:03.651 DEBUG:teuthology.orchestra.run.smithi117:> import struct 2023-06-10T19:06:03.651 DEBUG:teuthology.orchestra.run.smithi117:> f1 = open("/home/ubuntu/cephtest/mnt.1/background_file-1", '"'"'r'"'"') 2023-06-10T19:06:03.652 DEBUG:teuthology.orchestra.run.smithi117:> try: 2023-06-10T19:06:03.652 DEBUG:teuthology.orchestra.run.smithi117:> fcntl.flock(f1, fcntl.LOCK_EX | fcntl.LOCK_NB) 2023-06-10T19:06:03.652 DEBUG:teuthology.orchestra.run.smithi117:> except IOError as e: 2023-06-10T19:06:03.653 DEBUG:teuthology.orchestra.run.smithi117:> if e.errno == errno.EAGAIN: 2023-06-10T19:06:03.653 DEBUG:teuthology.orchestra.run.smithi117:> pass 2023-06-10T19:06:03.653 DEBUG:teuthology.orchestra.run.smithi117:> else: 2023-06-10T19:06:03.654 DEBUG:teuthology.orchestra.run.smithi117:> raise RuntimeError("flock on file /home/ubuntu/cephtest/mnt.1/background_file-1 not found") 2023-06-10T19:06:03.654 DEBUG:teuthology.orchestra.run.smithi117:> f2 = open("/home/ubuntu/cephtest/mnt.1/background_file-2", '"'"'r'"'"') 2023-06-10T19:06:03.654 DEBUG:teuthology.orchestra.run.smithi117:> try: 2023-06-10T19:06:03.655 DEBUG:teuthology.orchestra.run.smithi117:> lockdata = struct.pack('"'"'hhllhh'"'"', fcntl.F_WRLCK, 0, 0, 0, 0, 0) 2023-06-10T19:06:03.655 DEBUG:teuthology.orchestra.run.smithi117:> fcntl.fcntl(f2, fcntl.F_SETLK, lockdata) 2023-06-10T19:06:03.656 DEBUG:teuthology.orchestra.run.smithi117:> except IOError as e: 2023-06-10T19:06:03.656 DEBUG:teuthology.orchestra.run.smithi117:> if e.errno == errno.EAGAIN: 2023-06-10T19:06:03.657 DEBUG:teuthology.orchestra.run.smithi117:> pass 2023-06-10T19:06:03.657 DEBUG:teuthology.orchestra.run.smithi117:> else: 2023-06-10T19:06:03.657 DEBUG:teuthology.orchestra.run.smithi117:> raise RuntimeError("posix lock on file /home/ubuntu/cephtest/mnt.1/background_file-2 not found") 2023-06-10T19:06:03.657 DEBUG:teuthology.orchestra.run.smithi117:> ' 2023-06-10T19:06:03.744 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-06-10T19:06:03.744 INFO:teuthology.orchestra.run:waiting for 300 2023-06-10T19:06:03.745 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-06-10T19:06:03.745 INFO:teuthology.orchestra.run:waiting for 300 2023-06-10T19:06:03.745 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-06-10T19:06:03.745 INFO:teuthology.orchestra.run:waiting for 300 2023-06-10T19:06:03.746 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-06-10T19:06:03.746 INFO:teuthology.orchestra.run:waiting for 300 2023-06-10T19:06:03.758 INFO:tasks.ceph.mds.b:Stopped 2023-06-10T19:06:03.758 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2023-06-10T19:06:03.760 INFO:tasks.ceph.mds.a:Stopped 2023-06-10T19:06:03.760 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2023-06-10T19:06:03.761 INFO:tasks.ceph.mds.d:Stopped 2023-06-10T19:06:03.761 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail d 2023-06-10T19:06:03.774 INFO:tasks.ceph.mds.c:Stopped 2023-06-10T19:06:03.775 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail c 2023-06-10T19:06:03.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.931+0000 7fd974ce7640 1 Processor -- start 2023-06-10T19:06:03.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.931+0000 7fd974ce7640 1 -- start start 2023-06-10T19:06:03.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.931+0000 7fdcca8ea640 1 Processor -- start 2023-06-10T19:06:03.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.931+0000 7fdcca8ea640 1 -- start start 2023-06-10T19:06:03.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.931+0000 7fc077af3640 1 Processor -- start 2023-06-10T19:06:03.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.931+0000 7fc077af3640 1 -- start start 2023-06-10T19:06:03.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.935+0000 7fd974ce7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd97015eef0 0x7fd970070f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:03.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.935+0000 7fd974ce7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd970069450 0x7fd9700698b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:03.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.935+0000 7fdcca8ea640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fdcc4158640 0x7fdcc40cb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:03.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.935+0000 7fdcca8ea640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdcc40cad50 0x7fdcc40ccc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:03.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.935+0000 7fdcca8ea640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcc40b1470 con 0x7fdcc40cd140 2023-06-10T19:06:03.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.935+0000 7fdcca8ea640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcc415cfc0 con 0x7fdcc4158640 2023-06-10T19:06:03.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.935+0000 7fdcca8ea640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc40cd5c0 con 0x7fdcc40cad50 2023-06-10T19:06:03.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.935+0000 7fd96ed9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd970069450 0x7fd9700698b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:03.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.935+0000 7fd96ed9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd970069450 0x7fd9700698b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49366/0 (socket says 172.21.15.53:49366) 2023-06-10T19:06:03.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.935+0000 7fd96ed9d640 1 -- 172.21.15.53:0/2760377804 learned_addr learned my addr 172.21.15.53:0/2760377804 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:03.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.935+0000 7fd974ce7640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd970069df0 con 0x7fd97015f570 2023-06-10T19:06:03.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.935+0000 7fd974ce7640 1 -- 172.21.15.53:0/2760377804 --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd97015f2c0 con 0x7fd970069450 2023-06-10T19:06:03.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.935+0000 7fd974ce7640 1 -- 172.21.15.53:0/2760377804 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd97015fdc0 con 0x7fd97015eef0 2023-06-10T19:06:03.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.935+0000 7fc077af3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc070069450 0x7fc070069850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:03.944 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.935+0000 7fc077af3640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc070069d90 con 0x7fc070070f80 2023-06-10T19:06:03.944 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.935+0000 7fd96e59c640 1 --2- 172.21.15.53:0/2760377804 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd97015eef0 0x7fd970070f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:03.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.935+0000 7fdcc37fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdcc40cad50 0x7fdcc40ccc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:03.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.935+0000 7fc077af3640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc07015f2c0 con 0x7fc07015eef0 2023-06-10T19:06:03.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.935+0000 7fc077af3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc07015fdc0 con 0x7fc070069450 2023-06-10T19:06:03.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.935+0000 7fdcc3fff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fdcc4158640 0x7fdcc40cb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:03.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.935+0000 7fdcc37fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdcc40cad50 0x7fdcc40ccc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.53:51638/0 (socket says 172.21.15.53:51638) 2023-06-10T19:06:03.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.935+0000 7fdcc37fe640 1 -- 172.21.15.53:0/2865977466 learned_addr learned my addr 172.21.15.53:0/2865977466 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:03.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.935+0000 7fc07508e640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fc070070f80 0x7fc0700ce450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56834/0 (socket says 172.21.15.53:56834) 2023-06-10T19:06:03.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.935+0000 7fc07508e640 1 -- 172.21.15.53:0/2965886997 learned_addr learned my addr 172.21.15.53:0/2965886997 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:06:03.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.935+0000 7fc076090640 1 --2- 172.21.15.53:0/2965886997 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc070069450 0x7fc070069850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:03.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.935+0000 7fc07488d640 1 -- 172.21.15.53:0/2965886997 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2033276252 0 0) 0x7fc070069d90 con 0x7fc070070f80 2023-06-10T19:06:03.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.935+0000 7fc07488d640 1 -- 172.21.15.53:0/2965886997 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc05c003530 con 0x7fc070070f80 2023-06-10T19:06:03.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.935+0000 7fc07488d640 1 -- 172.21.15.53:0/2965886997 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2969134072 0 0) 0x7fc05c003530 con 0x7fc070070f80 2023-06-10T19:06:03.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.935+0000 7fc07488d640 1 -- 172.21.15.53:0/2965886997 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc070069450 msgr2=0x7fc070069850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:03.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.935+0000 7fc07488d640 1 --2- 172.21.15.53:0/2965886997 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc070069450 0x7fc070069850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:03.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.935+0000 7fc07488d640 1 -- 172.21.15.53:0/2965886997 >> v1:172.21.15.117:6789/0 conn(0x7fc07015eef0 legacy=0x7fc07015f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:03.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.935+0000 7fc07488d640 1 -- 172.21.15.53:0/2965886997 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0701600a0 con 0x7fc070070f80 2023-06-10T19:06:03.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.935+0000 7fc07488d640 1 -- 172.21.15.53:0/2965886997 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fc060001680 con 0x7fc070070f80 2023-06-10T19:06:03.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.935+0000 7fc07488d640 1 -- 172.21.15.53:0/2965886997 >> v1:172.21.15.53:6789/0 conn(0x7fc070070f80 legacy=0x7fc0700ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:03.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.935+0000 7fc07488d640 1 --2- 172.21.15.53:0/2965886997 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc05c0039b0 0x7fc05c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:03.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.935+0000 7fc07488d640 1 --2- 172.21.15.53:0/2965886997 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc05c0047d0 0x7fc05c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:03.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.935+0000 7fc07488d640 1 --2- 172.21.15.53:0/2965886997 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc070069450 0x7fc05c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:03.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.935+0000 7fc07488d640 1 -- 172.21.15.53:0/2965886997 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc07015fdc0 con 0x7fc05c0039b0 2023-06-10T19:06:03.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.935+0000 7fc07488d640 1 -- 172.21.15.53:0/2965886997 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc05c00ba40 con 0x7fc05c0047d0 2023-06-10T19:06:03.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.935+0000 7fc07488d640 1 -- 172.21.15.53:0/2965886997 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc05c00bbd0 con 0x7fc070069450 2023-06-10T19:06:03.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.935+0000 7fc07588f640 1 --2- 172.21.15.53:0/2965886997 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc05c0039b0 0x7fc05c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:03.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.935+0000 7fc076090640 1 --2- 172.21.15.53:0/2965886997 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc070069450 0x7fc05c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:03.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.935+0000 7fc07588f640 1 -- 172.21.15.53:0/2965886997 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc070069450 msgr2=0x7fc05c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:03.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.935+0000 7fc07588f640 1 --2- 172.21.15.53:0/2965886997 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc070069450 0x7fc05c005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:03.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.935+0000 7fc07508e640 1 --2- 172.21.15.53:0/2965886997 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc05c0047d0 0x7fc05c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:03.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.935+0000 7fc07588f640 1 -- 172.21.15.53:0/2965886997 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc05c0047d0 msgr2=0x7fc05c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:03.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.935+0000 7fc07588f640 1 --2- 172.21.15.53:0/2965886997 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc05c0047d0 0x7fc05c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:03.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.935+0000 7fc07588f640 1 -- 172.21.15.53:0/2965886997 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc05c003530 con 0x7fc05c0039b0 2023-06-10T19:06:03.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.935+0000 7fc07508e640 1 --2- 172.21.15.53:0/2965886997 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc05c0047d0 0x7fc05c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:06:03.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.935+0000 7fd96ed9d640 1 -- 172.21.15.53:0/2760377804 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd97015eef0 msgr2=0x7fd970070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:03.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.935+0000 7fd96ed9d640 1 --2- 172.21.15.53:0/2760377804 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd97015eef0 0x7fd970070f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:03.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.935+0000 7fd96ed9d640 1 -- 172.21.15.53:0/2760377804 >> v1:172.21.15.117:6789/0 conn(0x7fd97015f570 legacy=0x7fd9700ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:03.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.935+0000 7fd96ed9d640 1 -- 172.21.15.53:0/2760377804 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9701600a0 con 0x7fd970069450 2023-06-10T19:06:03.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.935+0000 7fdcc37fe640 1 -- 172.21.15.53:0/2865977466 >> v2:172.21.15.117:3300/0 conn(0x7fdcc4158640 msgr2=0x7fdcc40cb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:03.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.935+0000 7fdcc37fe640 1 --2- 172.21.15.53:0/2865977466 >> v2:172.21.15.117:3300/0 conn(0x7fdcc4158640 0x7fdcc40cb2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:03.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.935+0000 7fdcc37fe640 1 -- 172.21.15.53:0/2865977466 >> v1:172.21.15.117:6789/0 conn(0x7fdcc40cd140 legacy=0x7fdcc406ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:03.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.935+0000 7fdcc37fe640 1 -- 172.21.15.53:0/2865977466 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc415c340 con 0x7fdcc40cad50 2023-06-10T19:06:03.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.939+0000 7fdcc37fe640 1 --2- 172.21.15.53:0/2865977466 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdcc40cad50 0x7fdcc40ccc00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdcb8009870 tx=0x7fdcb801c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0f5d5e95389c93d server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:03.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.939+0000 7fc07588f640 1 --2- 172.21.15.53:0/2965886997 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc05c0039b0 0x7fc05c003dc0 secure :-1 s=READY pgs=2062 cs=0 l=1 rev1=1 crypto rx=0x7fc06c001780 tx=0x7fc06c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=696d1ecd504f82a4 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:03.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.939+0000 7fdcc2ffd640 1 -- 172.21.15.53:0/2865977466 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb80ab680 con 0x7fdcc40cad50 2023-06-10T19:06:03.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.939+0000 7fdcc2ffd640 1 -- 172.21.15.53:0/2865977466 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcb80ab7e0 con 0x7fdcc40cad50 2023-06-10T19:06:03.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.939+0000 7fdcc2ffd640 1 -- 172.21.15.53:0/2865977466 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb80abb70 con 0x7fdcc40cad50 2023-06-10T19:06:03.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.939+0000 7fd96ed9d640 1 --2- 172.21.15.53:0/2760377804 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd970069450 0x7fd9700698b0 secure :-1 s=READY pgs=2063 cs=0 l=1 rev1=1 crypto rx=0x7fd968009e50 tx=0x7fd96801c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3896ad437676adf server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:03.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.939+0000 7fc07488d640 1 -- 172.21.15.53:0/2965886997 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc06c0052d0 con 0x7fc05c0039b0 2023-06-10T19:06:03.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.939+0000 7fc07488d640 1 -- 172.21.15.53:0/2965886997 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc06c0a7050 con 0x7fc05c0039b0 2023-06-10T19:06:03.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.939+0000 7fc07488d640 1 -- 172.21.15.53:0/2965886997 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc06c003600 con 0x7fc05c0039b0 2023-06-10T19:06:03.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.939+0000 7fd96d59a640 1 -- 172.21.15.53:0/2760377804 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9680a5740 con 0x7fd970069450 2023-06-10T19:06:03.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.939+0000 7fd96d59a640 1 -- 172.21.15.53:0/2760377804 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9680a58a0 con 0x7fd970069450 2023-06-10T19:06:03.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.939+0000 7fd96d59a640 1 -- 172.21.15.53:0/2760377804 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9680a5c30 con 0x7fd970069450 2023-06-10T19:06:03.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.939+0000 7fdcca8ea640 1 -- 172.21.15.53:0/2865977466 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdcc40cad50 msgr2=0x7fdcc40ccc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:03.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.939+0000 7fdcca8ea640 1 --2- 172.21.15.53:0/2865977466 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdcc40cad50 0x7fdcc40ccc00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdcb8009870 tx=0x7fdcb801c480 comp rx=0 tx=0).stop 2023-06-10T19:06:03.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.939+0000 7fdcca8ea640 1 -- 172.21.15.53:0/2865977466 shutdown_connections 2023-06-10T19:06:03.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.939+0000 7fdcca8ea640 1 --2- 172.21.15.53:0/2865977466 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdcc40cad50 0x7fdcc40ccc00 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:03.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.939+0000 7fdcca8ea640 1 --2- 172.21.15.53:0/2865977466 >> v2:172.21.15.117:3300/0 conn(0x7fdcc4158640 0x7fdcc40cb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:03.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.939+0000 7fdcca8ea640 1 -- 172.21.15.53:0/2865977466 >> 172.21.15.53:0/2865977466 conn(0x7fdcc40ced90 msgr2=0x7fdcc40cf190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:03.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.939+0000 7fdcca8ea640 1 -- 172.21.15.53:0/2865977466 shutdown_connections 2023-06-10T19:06:03.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.939+0000 7fdcca8ea640 1 -- 172.21.15.53:0/2865977466 wait complete. 2023-06-10T19:06:03.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.939+0000 7fc077af3640 1 -- 172.21.15.53:0/2965886997 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc05c0039b0 msgr2=0x7fc05c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:03.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.939+0000 7fc077af3640 1 --2- 172.21.15.53:0/2965886997 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc05c0039b0 0x7fc05c003dc0 secure :-1 s=READY pgs=2062 cs=0 l=1 rev1=1 crypto rx=0x7fc06c001780 tx=0x7fc06c01c400 comp rx=0 tx=0).stop 2023-06-10T19:06:03.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.939+0000 7fc076090640 1 -- 172.21.15.53:0/2965886997 reap_dead start 2023-06-10T19:06:03.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.939+0000 7fd974ce7640 1 -- 172.21.15.53:0/2760377804 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd970069450 msgr2=0x7fd9700698b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:03.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.939+0000 7fd974ce7640 1 --2- 172.21.15.53:0/2760377804 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd970069450 0x7fd9700698b0 secure :-1 s=READY pgs=2063 cs=0 l=1 rev1=1 crypto rx=0x7fd968009e50 tx=0x7fd96801c9d0 comp rx=0 tx=0).stop 2023-06-10T19:06:03.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.939+0000 7fd974ce7640 1 -- 172.21.15.53:0/2760377804 shutdown_connections 2023-06-10T19:06:03.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.939+0000 7fd974ce7640 1 --2- 172.21.15.53:0/2760377804 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd970069450 0x7fd9700698b0 unknown :-1 s=CLOSED pgs=2063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:03.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.939+0000 7fd974ce7640 1 --2- 172.21.15.53:0/2760377804 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd97015eef0 0x7fd970070f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:03.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.939+0000 7fd974ce7640 1 -- 172.21.15.53:0/2760377804 >> 172.21.15.53:0/2760377804 conn(0x7fd97006a560 msgr2=0x7fd97006a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:03.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.939+0000 7fc077af3640 1 -- 172.21.15.53:0/2965886997 shutdown_connections 2023-06-10T19:06:03.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.939+0000 7fc077af3640 1 -- 172.21.15.53:0/2965886997 >> 172.21.15.53:0/2965886997 conn(0x7fc07006a560 msgr2=0x7fc07006a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:03.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.939+0000 7fc077af3640 1 -- 172.21.15.53:0/2965886997 shutdown_connections 2023-06-10T19:06:03.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.939+0000 7fd974ce7640 1 -- 172.21.15.53:0/2760377804 shutdown_connections 2023-06-10T19:06:03.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.939+0000 7fc077af3640 1 -- 172.21.15.53:0/2965886997 wait complete. 2023-06-10T19:06:03.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.939+0000 7fd974ce7640 1 -- 172.21.15.53:0/2760377804 wait complete. 2023-06-10T19:06:03.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.939+0000 7fdcca8ea640 1 Processor -- start 2023-06-10T19:06:03.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.939+0000 7fdcca8ea640 1 -- start start 2023-06-10T19:06:03.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.939+0000 7fc077af3640 1 Processor -- start 2023-06-10T19:06:03.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.939+0000 7fc077af3640 1 -- start start 2023-06-10T19:06:03.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.939+0000 7fd974ce7640 1 Processor -- start 2023-06-10T19:06:03.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.939+0000 7fd974ce7640 1 -- start start 2023-06-10T19:06:03.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.939+0000 7fdcca8ea640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdcc40cad50 0x7fdcc414af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:03.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.943+0000 7fdcca8ea640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdcc40cd140 0x7fdcc4162380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:03.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.943+0000 7fdcc37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdcc40cd140 0x7fdcc4162380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:03.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.943+0000 7fdcc37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdcc40cd140 0x7fdcc4162380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49376/0 (socket says 172.21.15.53:49376) 2023-06-10T19:06:03.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.943+0000 7fdcca8ea640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdcc4158640 0x7fdcc40c9e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:03.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.943+0000 7fdcc37fe640 1 -- 172.21.15.53:0/572422628 learned_addr learned my addr 172.21.15.53:0/572422628 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:03.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.943+0000 7fdcca8ea640 1 -- 172.21.15.53:0/572422628 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc41632b0 con 0x7fdcc40cd140 2023-06-10T19:06:03.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.943+0000 7fdcca8ea640 1 -- 172.21.15.53:0/572422628 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc414b460 con 0x7fdcc4158640 2023-06-10T19:06:03.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.943+0000 7fdcca8ea640 1 -- 172.21.15.53:0/572422628 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc40b1f30 con 0x7fdcc40cad50 2023-06-10T19:06:03.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.943+0000 7fd974ce7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd970069450 0x7fd9700b2740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:03.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.943+0000 7fd974ce7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd97015eef0 0x7fd970154d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:03.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.943+0000 7fc077af3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc05c0039b0 0x7fc0700c2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:03.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.943+0000 7fd974ce7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd97015f570 0x7fd97014caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:03.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.943+0000 7fd974ce7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd97014bae0 con 0x7fd97015f570 2023-06-10T19:06:03.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.943+0000 7fd974ce7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd970149fd0 con 0x7fd97015eef0 2023-06-10T19:06:03.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.943+0000 7fd974ce7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd97014bd30 con 0x7fd970069450 2023-06-10T19:06:03.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.943+0000 7fc077af3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0700c51c0 0x7fc0700c3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:03.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.943+0000 7fdcc3fff640 1 --2- 172.21.15.53:0/572422628 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdcc40cad50 0x7fdcc414af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:03.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.943+0000 7fdcc8e87640 1 --2- 172.21.15.53:0/572422628 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdcc4158640 0x7fdcc40c9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:03.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.943+0000 7fc077af3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc07015c900 0x7fc07015cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:03.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.943+0000 7fc077af3640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0700c5630 con 0x7fc0700c51c0 2023-06-10T19:06:03.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.943+0000 7fc077af3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc070156d50 con 0x7fc07015c900 2023-06-10T19:06:03.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.943+0000 7fc077af3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc070157030 con 0x7fc05c0039b0 2023-06-10T19:06:03.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.943+0000 7fd96e59c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd970069450 0x7fd9700b2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:03.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.943+0000 7fd96ed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd97015f570 0x7fd97014caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:03.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.943+0000 7fd96ed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd97015f570 0x7fd97014caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49404/0 (socket says 172.21.15.53:49404) 2023-06-10T19:06:03.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.943+0000 7fd96e59c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd970069450 0x7fd9700b2740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.53:51666/0 (socket says 172.21.15.53:51666) 2023-06-10T19:06:03.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.943+0000 7fdcc37fe640 1 -- 172.21.15.53:0/572422628 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdcc40cad50 msgr2=0x7fdcc414af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:03.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.943+0000 7fdcc37fe640 1 --2- 172.21.15.53:0/572422628 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdcc40cad50 0x7fdcc414af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:03.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.943+0000 7fdcc37fe640 1 -- 172.21.15.53:0/572422628 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdcc4158640 msgr2=0x7fdcc40c9e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:03.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.943+0000 7fdcc37fe640 1 --2- 172.21.15.53:0/572422628 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdcc4158640 0x7fdcc40c9e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:03.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.943+0000 7fdcc37fe640 1 -- 172.21.15.53:0/572422628 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcb80094d0 con 0x7fdcc40cd140 2023-06-10T19:06:03.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.943+0000 7fd96ed9d640 1 -- 172.21.15.53:0/3135814978 learned_addr learned my addr 172.21.15.53:0/3135814978 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:03.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.943+0000 7fd96dd9b640 1 --2- 172.21.15.53:0/3135814978 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd97015eef0 0x7fd970154d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:03.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.943+0000 7fc076090640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc07015c900 0x7fc07015cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:03.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.943+0000 7fc076090640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc07015c900 0x7fc07015cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.53:54450/0 (socket says 172.21.15.53:54450) 2023-06-10T19:06:03.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.943+0000 7fc076090640 1 -- 172.21.15.53:0/3544606463 learned_addr learned my addr 172.21.15.53:0/3544606463 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:03.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.943+0000 7fdcc37fe640 1 --2- 172.21.15.53:0/572422628 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdcc40cd140 0x7fdcc4162380 secure :-1 s=READY pgs=2064 cs=0 l=1 rev1=1 crypto rx=0x7fdcb80ad040 tx=0x7fdcb801acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:03.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.943+0000 7fd96ed9d640 1 -- 172.21.15.53:0/3135814978 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd970069450 msgr2=0x7fd9700b2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:03.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.943+0000 7fd96ed9d640 1 --2- 172.21.15.53:0/3135814978 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd970069450 0x7fd9700b2740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:03.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.943+0000 7fd96ed9d640 1 -- 172.21.15.53:0/3135814978 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd97015eef0 msgr2=0x7fd970154d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:03.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.943+0000 7fd96ed9d640 1 --2- 172.21.15.53:0/3135814978 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd97015eef0 0x7fd970154d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:03.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.943+0000 7fd96ed9d640 1 -- 172.21.15.53:0/3135814978 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd968009b30 con 0x7fd97015f570 2023-06-10T19:06:03.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.943+0000 7fc07508e640 1 --2- 172.21.15.53:0/3544606463 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0700c51c0 0x7fc0700c3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:03.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.943+0000 7fc07588f640 1 --2- 172.21.15.53:0/3544606463 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc05c0039b0 0x7fc0700c2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:03.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.943+0000 7fdcc0ff9640 1 -- 172.21.15.53:0/572422628 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb80ab680 con 0x7fdcc40cd140 2023-06-10T19:06:03.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.943+0000 7fdcc0ff9640 1 -- 172.21.15.53:0/572422628 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcb80b4800 con 0x7fdcc40cd140 2023-06-10T19:06:03.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.943+0000 7fdcca8ea640 1 -- 172.21.15.53:0/572422628 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcc40b2210 con 0x7fdcc40cd140 2023-06-10T19:06:03.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.943+0000 7fdcc0ff9640 1 -- 172.21.15.53:0/572422628 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb80b4bb0 con 0x7fdcc40cd140 2023-06-10T19:06:03.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.943+0000 7fdcca8ea640 1 -- 172.21.15.53:0/572422628 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcc40b27d0 con 0x7fdcc40cd140 2023-06-10T19:06:03.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.943+0000 7fd96ed9d640 1 --2- 172.21.15.53:0/3135814978 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd97015f570 0x7fd97014caf0 secure :-1 s=READY pgs=2065 cs=0 l=1 rev1=1 crypto rx=0x7fd96801b080 tx=0x7fd968019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:03.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.943+0000 7fc07508e640 1 -- 172.21.15.53:0/3544606463 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc05c0039b0 msgr2=0x7fc0700c2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:03.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.943+0000 7fc07508e640 1 --2- 172.21.15.53:0/3544606463 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc05c0039b0 0x7fc0700c2af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:03.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.943+0000 7fc07508e640 1 -- 172.21.15.53:0/3544606463 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc07015c900 msgr2=0x7fc07015cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:03.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.943+0000 7fc07508e640 1 --2- 172.21.15.53:0/3544606463 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc07015c900 0x7fc07015cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:03.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.943+0000 7fc07508e640 1 -- 172.21.15.53:0/3544606463 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc070157310 con 0x7fc0700c51c0 2023-06-10T19:06:03.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.943+0000 7fc07588f640 1 --2- 172.21.15.53:0/3544606463 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc05c0039b0 0x7fc0700c2af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:06:03.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.943+0000 7fc076090640 1 --2- 172.21.15.53:0/3544606463 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc07015c900 0x7fc07015cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-10T19:06:03.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.943+0000 7fc07508e640 1 --2- 172.21.15.53:0/3544606463 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0700c51c0 0x7fc0700c3550 secure :-1 s=READY pgs=2066 cs=0 l=1 rev1=1 crypto rx=0x7fc060007fd0 tx=0x7fc06000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:03.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.943+0000 7fdcca8ea640 1 -- 172.21.15.53:0/572422628 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcc40cfad0 con 0x7fdcc40cd140 2023-06-10T19:06:03.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.943+0000 7fc0667fc640 1 -- 172.21.15.53:0/3544606463 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0600074e0 con 0x7fc0700c51c0 2023-06-10T19:06:03.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.943+0000 7fd95effd640 1 -- 172.21.15.53:0/3135814978 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9680b8670 con 0x7fd97015f570 2023-06-10T19:06:03.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.943+0000 7fc0667fc640 1 -- 172.21.15.53:0/3544606463 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc060007640 con 0x7fc0700c51c0 2023-06-10T19:06:03.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.943+0000 7fc0667fc640 1 -- 172.21.15.53:0/3544606463 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0600049f0 con 0x7fc0700c51c0 2023-06-10T19:06:03.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.943+0000 7fd95effd640 1 -- 172.21.15.53:0/3135814978 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9680b8810 con 0x7fd97015f570 2023-06-10T19:06:03.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.943+0000 7fc077af3640 1 -- 172.21.15.53:0/3544606463 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0701575f0 con 0x7fc0700c51c0 2023-06-10T19:06:03.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.943+0000 7fd95effd640 1 -- 172.21.15.53:0/3135814978 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9680b8bc0 con 0x7fd97015f570 2023-06-10T19:06:03.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.943+0000 7fc077af3640 1 -- 172.21.15.53:0/3544606463 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc070156a40 con 0x7fc0700c51c0 2023-06-10T19:06:03.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.943+0000 7fd974ce7640 1 -- 172.21.15.53:0/3135814978 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd97014c010 con 0x7fd97015f570 2023-06-10T19:06:03.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.943+0000 7fd974ce7640 1 -- 172.21.15.53:0/3135814978 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd97014c5d0 con 0x7fd97015f570 2023-06-10T19:06:03.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.947+0000 7fdcc0ff9640 1 -- 172.21.15.53:0/572422628 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdcb80b4d10 con 0x7fdcc40cd140 2023-06-10T19:06:03.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.947+0000 7fdcc0ff9640 1 --2- 172.21.15.53:0/572422628 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdcb0066300 0x7fdcb00687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:03.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.947+0000 7fc0667fc640 1 -- 172.21.15.53:0/3544606463 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc060004b50 con 0x7fc0700c51c0 2023-06-10T19:06:03.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.947+0000 7fd974ce7640 1 -- 172.21.15.53:0/3135814978 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd97014c7f0 con 0x7fd97015f570 2023-06-10T19:06:03.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.947+0000 7fdcc0ff9640 1 -- 172.21.15.53:0/572422628 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdcb811eb40 con 0x7fdcc40cd140 2023-06-10T19:06:03.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.947+0000 7fdcc3fff640 1 --2- 172.21.15.53:0/572422628 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdcb0066300 0x7fdcb00687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:03.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.947+0000 7fc0667fc640 1 --2- 172.21.15.53:0/3544606463 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc054066280 0x7fc054068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:03.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.947+0000 7fc0667fc640 1 -- 172.21.15.53:0/3544606463 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc0600834a0 con 0x7fc0700c51c0 2023-06-10T19:06:03.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.947+0000 7fc07588f640 1 --2- 172.21.15.53:0/3544606463 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc054066280 0x7fc054068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:03.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.947+0000 7fdcc3fff640 1 --2- 172.21.15.53:0/572422628 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdcb0066300 0x7fdcb00687b0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fdcb4009930 tx=0x7fdcb4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:03.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.947+0000 7fc07588f640 1 --2- 172.21.15.53:0/3544606463 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc054066280 0x7fc054068730 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fc06c001750 tx=0x7fc06c0011a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:03.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.951+0000 7fc077af3640 1 -- 172.21.15.53:0/3544606463 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc058005260 con 0x7fc0700c51c0 2023-06-10T19:06:03.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.951+0000 7fdcc0ff9640 1 -- 172.21.15.53:0/572422628 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdcb80ebfa0 con 0x7fdcc40cd140 2023-06-10T19:06:03.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.951+0000 7fd95effd640 1 -- 172.21.15.53:0/3135814978 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd9680b8d20 con 0x7fd97015f570 2023-06-10T19:06:03.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.951+0000 7fd95effd640 1 --2- 172.21.15.53:0/3135814978 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd950066280 0x7fd950068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:03.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.955+0000 7fd96e59c640 1 --2- 172.21.15.53:0/3135814978 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd950066280 0x7fd950068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:03.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.955+0000 7fd96e59c640 1 --2- 172.21.15.53:0/3135814978 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd950066280 0x7fd950068730 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fd960009b60 tx=0x7fd960009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:03.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.955+0000 7fd95effd640 1 -- 172.21.15.53:0/3135814978 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd9680f4d80 con 0x7fd97015f570 2023-06-10T19:06:03.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.955+0000 7fc0667fc640 1 -- 172.21.15.53:0/3544606463 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc0600509d0 con 0x7fc0700c51c0 2023-06-10T19:06:03.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.959+0000 7fd95effd640 1 -- 172.21.15.53:0/3135814978 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd9680ed1b0 con 0x7fd97015f570 2023-06-10T19:06:04.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.979+0000 7fc89510b640 1 Processor -- start 2023-06-10T19:06:04.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.979+0000 7fc89510b640 1 -- start start 2023-06-10T19:06:04.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.979+0000 7fc89510b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc89015c7f0 0x7fc89015f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:04.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.979+0000 7fc89510b640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc89015cc40 con 0x7fc89006b780 2023-06-10T19:06:04.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.979+0000 7fc89510b640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8900af530 con 0x7fc89015f860 2023-06-10T19:06:04.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.979+0000 7fc89510b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc89015c3d0 con 0x7fc89015c7f0 2023-06-10T19:06:04.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.979+0000 7fc88ed9d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fc89006b780 0x7fc89006bb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56838/0 (socket says 172.21.15.53:56838) 2023-06-10T19:06:04.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.979+0000 7fc88ed9d640 1 -- 172.21.15.53:0/3531781430 learned_addr learned my addr 172.21.15.53:0/3531781430 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:06:04.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.979+0000 7fc88e59c640 1 --2- 172.21.15.53:0/3531781430 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc89015c7f0 0x7fc89015f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:04.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.983+0000 7fc88dd9b640 1 -- 172.21.15.53:0/3531781430 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3631140088 0 0) 0x7fc89015cc40 con 0x7fc89006b780 2023-06-10T19:06:04.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.983+0000 7fc88dd9b640 1 -- 172.21.15.53:0/3531781430 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc878003530 con 0x7fc89006b780 2023-06-10T19:06:04.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.983+0000 7fc88dd9b640 1 -- 172.21.15.53:0/3531781430 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2990161855 0 0) 0x7fc878003530 con 0x7fc89006b780 2023-06-10T19:06:04.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.983+0000 7fc88dd9b640 1 -- 172.21.15.53:0/3531781430 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc89015c7f0 msgr2=0x7fc89015f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:04.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.983+0000 7fc88dd9b640 1 --2- 172.21.15.53:0/3531781430 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc89015c7f0 0x7fc89015f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:04.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.983+0000 7fc88dd9b640 1 -- 172.21.15.53:0/3531781430 >> v1:172.21.15.117:6789/0 conn(0x7fc89015f860 legacy=0x7fc8900ceb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:04.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.983+0000 7fc88dd9b640 1 -- 172.21.15.53:0/3531781430 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc89015fd70 con 0x7fc89006b780 2023-06-10T19:06:04.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.983+0000 7fc88dd9b640 1 -- 172.21.15.53:0/3531781430 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fc880001680 con 0x7fc89006b780 2023-06-10T19:06:04.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.983+0000 7fc88dd9b640 1 -- 172.21.15.53:0/3531781430 >> v1:172.21.15.53:6789/0 conn(0x7fc89006b780 legacy=0x7fc89006bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:04.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.983+0000 7fc88dd9b640 1 --2- 172.21.15.53:0/3531781430 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8780039b0 0x7fc878003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:04.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.983+0000 7fc88dd9b640 1 --2- 172.21.15.53:0/3531781430 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8780043a0 0x7fc878004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:04.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.983+0000 7fc88dd9b640 1 --2- 172.21.15.53:0/3531781430 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc89015c7f0 0x7fc878005170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:04.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.983+0000 7fc88dd9b640 1 -- 172.21.15.53:0/3531781430 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc89015c3d0 con 0x7fc8780043a0 2023-06-10T19:06:04.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.983+0000 7fc88dd9b640 1 -- 172.21.15.53:0/3531781430 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc87800ba70 con 0x7fc8780039b0 2023-06-10T19:06:04.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.983+0000 7fc88dd9b640 1 -- 172.21.15.53:0/3531781430 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc87800bc30 con 0x7fc89015c7f0 2023-06-10T19:06:04.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.983+0000 7fc88e59c640 1 --2- 172.21.15.53:0/3531781430 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8780043a0 0x7fc878004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:04.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.983+0000 7fc88f59e640 1 --2- 172.21.15.53:0/3531781430 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc89015c7f0 0x7fc878005170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:04.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.983+0000 7fc88ed9d640 1 --2- 172.21.15.53:0/3531781430 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8780039b0 0x7fc878003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:04.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.983+0000 7fc88e59c640 1 -- 172.21.15.53:0/3531781430 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc89015c7f0 msgr2=0x7fc878005170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:04.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.983+0000 7fc88e59c640 1 --2- 172.21.15.53:0/3531781430 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc89015c7f0 0x7fc878005170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:04.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.983+0000 7fc88e59c640 1 -- 172.21.15.53:0/3531781430 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8780039b0 msgr2=0x7fc878003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:04.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.983+0000 7fc88e59c640 1 --2- 172.21.15.53:0/3531781430 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8780039b0 0x7fc878003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:04.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.983+0000 7fc88e59c640 1 -- 172.21.15.53:0/3531781430 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc878003530 con 0x7fc8780043a0 2023-06-10T19:06:04.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.983+0000 7fc88ed9d640 1 --2- 172.21.15.53:0/3531781430 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8780039b0 0x7fc878003d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:06:04.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.983+0000 7fc88e59c640 1 --2- 172.21.15.53:0/3531781430 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8780043a0 0x7fc878004870 secure :-1 s=READY pgs=2068 cs=0 l=1 rev1=1 crypto rx=0x7fc884009ab0 tx=0x7fc88401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d30617511dd6730 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:04.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.983+0000 7fc88dd9b640 1 -- 172.21.15.53:0/3531781430 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8840a5620 con 0x7fc8780043a0 2023-06-10T19:06:04.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.983+0000 7fc88dd9b640 1 -- 172.21.15.53:0/3531781430 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8840a5780 con 0x7fc8780043a0 2023-06-10T19:06:04.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.983+0000 7fc88dd9b640 1 -- 172.21.15.53:0/3531781430 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8840a5b30 con 0x7fc8780043a0 2023-06-10T19:06:04.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.987+0000 7fc89510b640 1 -- 172.21.15.53:0/3531781430 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8780043a0 msgr2=0x7fc878004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:04.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.987+0000 7fc89510b640 1 --2- 172.21.15.53:0/3531781430 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8780043a0 0x7fc878004870 secure :-1 s=READY pgs=2068 cs=0 l=1 rev1=1 crypto rx=0x7fc884009ab0 tx=0x7fc88401ca30 comp rx=0 tx=0).stop 2023-06-10T19:06:04.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.987+0000 7fc88f59e640 1 -- 172.21.15.53:0/3531781430 reap_dead start 2023-06-10T19:06:04.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.987+0000 7fc89510b640 1 -- 172.21.15.53:0/3531781430 shutdown_connections 2023-06-10T19:06:04.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.987+0000 7fc89510b640 1 -- 172.21.15.53:0/3531781430 >> 172.21.15.53:0/3531781430 conn(0x7fc89006a0b0 msgr2=0x7fc89006d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:04.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.987+0000 7fc89510b640 1 -- 172.21.15.53:0/3531781430 shutdown_connections 2023-06-10T19:06:04.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.987+0000 7fc89510b640 1 -- 172.21.15.53:0/3531781430 wait complete. 2023-06-10T19:06:04.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.987+0000 7fc89510b640 1 Processor -- start 2023-06-10T19:06:04.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.987+0000 7fc89510b640 1 -- start start 2023-06-10T19:06:04.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.991+0000 7fc89510b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc89014e2c0 0x7fc8900ccd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:04.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.991+0000 7fc89510b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8900c95b0 0x7fc89006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:04.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.991+0000 7fc89510b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8900c9a20 0x7fc89006d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:04.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.991+0000 7fc89510b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8900cd280 con 0x7fc8900c9a20 2023-06-10T19:06:04.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.991+0000 7fc89510b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8900cbca0 con 0x7fc8900c95b0 2023-06-10T19:06:04.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.991+0000 7fc89510b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8900cbf80 con 0x7fc89014e2c0 2023-06-10T19:06:04.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.991+0000 7fc88f59e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8900c9a20 0x7fc89006d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:04.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.991+0000 7fc88f59e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8900c9a20 0x7fc89006d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49424/0 (socket says 172.21.15.53:49424) 2023-06-10T19:06:04.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.991+0000 7fc88f59e640 1 -- 172.21.15.53:0/2320194401 learned_addr learned my addr 172.21.15.53:0/2320194401 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:04.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.991+0000 7fc88e59c640 1 --2- 172.21.15.53:0/2320194401 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8900c95b0 0x7fc89006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:04.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.991+0000 7fc88ed9d640 1 --2- 172.21.15.53:0/2320194401 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc89014e2c0 0x7fc8900ccd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:04.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.991+0000 7fc88f59e640 1 -- 172.21.15.53:0/2320194401 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc89014e2c0 msgr2=0x7fc8900ccd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:04.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.991+0000 7fc88f59e640 1 --2- 172.21.15.53:0/2320194401 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc89014e2c0 0x7fc8900ccd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:04.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.991+0000 7fc88f59e640 1 -- 172.21.15.53:0/2320194401 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8900c95b0 msgr2=0x7fc89006d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:04.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.991+0000 7fc88f59e640 1 --2- 172.21.15.53:0/2320194401 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8900c95b0 0x7fc89006d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:04.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.991+0000 7fc88f59e640 1 -- 172.21.15.53:0/2320194401 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8900cc260 con 0x7fc8900c9a20 2023-06-10T19:06:04.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.991+0000 7fc88f59e640 1 --2- 172.21.15.53:0/2320194401 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8900c9a20 0x7fc89006d700 secure :-1 s=READY pgs=2069 cs=0 l=1 rev1=1 crypto rx=0x7fc8900cd910 tx=0x7fc888010a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:04.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.991+0000 7fc8777fe640 1 -- 172.21.15.53:0/2320194401 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc888003b80 con 0x7fc8900c9a20 2023-06-10T19:06:04.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.991+0000 7fc8777fe640 1 -- 172.21.15.53:0/2320194401 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc88800d050 con 0x7fc8900c9a20 2023-06-10T19:06:04.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.991+0000 7fc89510b640 1 -- 172.21.15.53:0/2320194401 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8900cc540 con 0x7fc8900c9a20 2023-06-10T19:06:04.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.991+0000 7fc8777fe640 1 -- 172.21.15.53:0/2320194401 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8880050d0 con 0x7fc8900c9a20 2023-06-10T19:06:04.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.991+0000 7fc89510b640 1 -- 172.21.15.53:0/2320194401 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc89014e690 con 0x7fc8900c9a20 2023-06-10T19:06:04.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.991+0000 7fc89510b640 1 -- 172.21.15.53:0/2320194401 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc89015bc30 con 0x7fc8900c9a20 2023-06-10T19:06:04.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.991+0000 7fc8777fe640 1 -- 172.21.15.53:0/2320194401 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc888005230 con 0x7fc8900c9a20 2023-06-10T19:06:04.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.991+0000 7fc8777fe640 1 --2- 172.21.15.53:0/2320194401 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc87c0662b0 0x7fc87c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:04.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.991+0000 7fc8777fe640 1 -- 172.21.15.53:0/2320194401 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc888085fc0 con 0x7fc8900c9a20 2023-06-10T19:06:04.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.991+0000 7fc88ed9d640 1 --2- 172.21.15.53:0/2320194401 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc87c0662b0 0x7fc87c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:04.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.995+0000 7fc88ed9d640 1 --2- 172.21.15.53:0/2320194401 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc87c0662b0 0x7fc87c068760 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fc89015ef90 tx=0x7fc880009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:04.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:03.999+0000 7fc8777fe640 1 -- 172.21.15.53:0/2320194401 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc89015bc30 con 0x7fc8900c9a20 2023-06-10T19:06:04.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:04.175+0000 7fd974ce7640 1 -- 172.21.15.53:0/3135814978 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) v1 -- 0x7fd97014c7f0 con 0x7fd97015f570 2023-06-10T19:06:04.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:04.207+0000 7fdcca8ea640 1 -- 172.21.15.53:0/572422628 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "d"} v 0) v1 -- 0x7fdcc404d790 con 0x7fdcc40cd140 2023-06-10T19:06:04.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:04.211+0000 7fc077af3640 1 -- 172.21.15.53:0/3544606463 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) v1 -- 0x7fc0580057e0 con 0x7fc0700c51c0 2023-06-10T19:06:04.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:04.215+0000 7fc89510b640 1 -- 172.21.15.53:0/2320194401 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "c"} v 0) v1 -- 0x7fc89015bc30 con 0x7fc8900c9a20 2023-06-10T19:06:05.082 INFO:tasks.ceph.mon.a.smithi053.stderr:2023-06-10T19:06:05.079+0000 7f74752c1640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-06-10T19:06:05.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.095+0000 7fd95effd640 1 -- 172.21.15.53:0/3135814978 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 9543 v77) v1 ==== 95+0+0 (secure 0 0 0) 0x7fd9680f07d0 con 0x7fd97015f570 2023-06-10T19:06:05.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.095+0000 7fdcc0ff9640 1 -- 172.21.15.53:0/572422628 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "d"}]=0 failed mds gid 7984 v77) v1 ==== 95+0+0 (secure 0 0 0) 0x7fdcb80ef5c0 con 0x7fdcc40cd140 2023-06-10T19:06:05.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.095+0000 7fc0667fc640 1 -- 172.21.15.53:0/3544606463 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 7981 v77) v1 ==== 95+0+0 (secure 0 0 0) 0x7fc060019020 con 0x7fc0700c51c0 2023-06-10T19:06:05.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.095+0000 7fc8777fe640 1 -- 172.21.15.53:0/2320194401 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "c"}]=0 failed mds gid 9537 v77) v1 ==== 95+0+0 (secure 0 0 0) 0x7fc89015bc30 con 0x7fc8900c9a20 2023-06-10T19:06:05.103 INFO:teuthology.orchestra.run.smithi053.stderr:failed mds gid 9543 2023-06-10T19:06:05.104 INFO:teuthology.orchestra.run.smithi053.stderr:failed mds gid 7984 2023-06-10T19:06:05.104 INFO:teuthology.orchestra.run.smithi053.stderr:failed mds gid 7981 2023-06-10T19:06:05.105 INFO:teuthology.orchestra.run.smithi053.stderr:failed mds gid 9537 2023-06-10T19:06:05.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.099+0000 7fd974ce7640 1 -- 172.21.15.53:0/3135814978 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd950066280 msgr2=0x7fd950068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:05.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.099+0000 7fd974ce7640 1 --2- 172.21.15.53:0/3135814978 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd950066280 0x7fd950068730 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fd960009b60 tx=0x7fd960009190 comp rx=0 tx=0).stop 2023-06-10T19:06:05.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.099+0000 7fd974ce7640 1 -- 172.21.15.53:0/3135814978 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd97015f570 msgr2=0x7fd97014caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:05.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.099+0000 7fd974ce7640 1 --2- 172.21.15.53:0/3135814978 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd97015f570 0x7fd97014caf0 secure :-1 s=READY pgs=2065 cs=0 l=1 rev1=1 crypto rx=0x7fd96801b080 tx=0x7fd968019770 comp rx=0 tx=0).stop 2023-06-10T19:06:05.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.099+0000 7fdcca8ea640 1 -- 172.21.15.53:0/572422628 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdcb0066300 msgr2=0x7fdcb00687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:05.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.099+0000 7fdcca8ea640 1 --2- 172.21.15.53:0/572422628 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdcb0066300 0x7fdcb00687b0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fdcb4009930 tx=0x7fdcb4008040 comp rx=0 tx=0).stop 2023-06-10T19:06:05.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.099+0000 7fdcca8ea640 1 -- 172.21.15.53:0/572422628 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdcc40cd140 msgr2=0x7fdcc4162380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:05.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.099+0000 7fdcca8ea640 1 --2- 172.21.15.53:0/572422628 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdcc40cd140 0x7fdcc4162380 secure :-1 s=READY pgs=2064 cs=0 l=1 rev1=1 crypto rx=0x7fdcb80ad040 tx=0x7fdcb801acc0 comp rx=0 tx=0).stop 2023-06-10T19:06:05.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.099+0000 7fdcca8ea640 1 -- 172.21.15.53:0/572422628 shutdown_connections 2023-06-10T19:06:05.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.099+0000 7fdcca8ea640 1 --2- 172.21.15.53:0/572422628 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdcb0066300 0x7fdcb00687b0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:05.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.099+0000 7fdcca8ea640 1 --2- 172.21.15.53:0/572422628 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdcc4158640 0x7fdcc40c9e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:05.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.099+0000 7fdcca8ea640 1 --2- 172.21.15.53:0/572422628 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdcc40cd140 0x7fdcc4162380 unknown :-1 s=CLOSED pgs=2064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:05.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.099+0000 7fdcca8ea640 1 --2- 172.21.15.53:0/572422628 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdcc40cad50 0x7fdcc414af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:05.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.099+0000 7fdcca8ea640 1 -- 172.21.15.53:0/572422628 >> 172.21.15.53:0/572422628 conn(0x7fdcc40ced90 msgr2=0x7fdcc41567b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:05.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.099+0000 7fd974ce7640 1 -- 172.21.15.53:0/3135814978 shutdown_connections 2023-06-10T19:06:05.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.099+0000 7fd974ce7640 1 --2- 172.21.15.53:0/3135814978 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd950066280 0x7fd950068730 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:05.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.099+0000 7fd974ce7640 1 --2- 172.21.15.53:0/3135814978 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd97015f570 0x7fd97014caf0 unknown :-1 s=CLOSED pgs=2065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:05.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.099+0000 7fd974ce7640 1 --2- 172.21.15.53:0/3135814978 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd97015eef0 0x7fd970154d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:05.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.099+0000 7fd974ce7640 1 --2- 172.21.15.53:0/3135814978 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd970069450 0x7fd9700b2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:05.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.099+0000 7fd974ce7640 1 -- 172.21.15.53:0/3135814978 >> 172.21.15.53:0/3135814978 conn(0x7fd97006a560 msgr2=0x7fd9701574d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:05.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.099+0000 7fdcca8ea640 1 -- 172.21.15.53:0/572422628 shutdown_connections 2023-06-10T19:06:05.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.099+0000 7fdcca8ea640 1 -- 172.21.15.53:0/572422628 wait complete. 2023-06-10T19:06:05.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.099+0000 7fd974ce7640 1 -- 172.21.15.53:0/3135814978 shutdown_connections 2023-06-10T19:06:05.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.099+0000 7fd974ce7640 1 -- 172.21.15.53:0/3135814978 wait complete. 2023-06-10T19:06:05.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.099+0000 7fc077af3640 1 -- 172.21.15.53:0/3544606463 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc054066280 msgr2=0x7fc054068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:05.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.099+0000 7fc077af3640 1 --2- 172.21.15.53:0/3544606463 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc054066280 0x7fc054068730 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fc06c001750 tx=0x7fc06c0011a0 comp rx=0 tx=0).stop 2023-06-10T19:06:05.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.099+0000 7fc077af3640 1 -- 172.21.15.53:0/3544606463 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0700c51c0 msgr2=0x7fc0700c3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:05.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.099+0000 7fc077af3640 1 --2- 172.21.15.53:0/3544606463 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0700c51c0 0x7fc0700c3550 secure :-1 s=READY pgs=2066 cs=0 l=1 rev1=1 crypto rx=0x7fc060007fd0 tx=0x7fc06000dc00 comp rx=0 tx=0).stop 2023-06-10T19:06:05.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.099+0000 7fc89510b640 1 -- 172.21.15.53:0/2320194401 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc87c0662b0 msgr2=0x7fc87c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:05.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.099+0000 7fc89510b640 1 --2- 172.21.15.53:0/2320194401 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc87c0662b0 0x7fc87c068760 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fc89015ef90 tx=0x7fc880009040 comp rx=0 tx=0).stop 2023-06-10T19:06:05.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.099+0000 7fc89510b640 1 -- 172.21.15.53:0/2320194401 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8900c9a20 msgr2=0x7fc89006d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:05.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.099+0000 7fc89510b640 1 --2- 172.21.15.53:0/2320194401 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8900c9a20 0x7fc89006d700 secure :-1 s=READY pgs=2069 cs=0 l=1 rev1=1 crypto rx=0x7fc8900cd910 tx=0x7fc888010a00 comp rx=0 tx=0).stop 2023-06-10T19:06:05.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.099+0000 7fc077af3640 1 -- 172.21.15.53:0/3544606463 shutdown_connections 2023-06-10T19:06:05.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.099+0000 7fc077af3640 1 --2- 172.21.15.53:0/3544606463 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc054066280 0x7fc054068730 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:05.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.099+0000 7fc077af3640 1 --2- 172.21.15.53:0/3544606463 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc07015c900 0x7fc07015cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:05.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.099+0000 7fc077af3640 1 --2- 172.21.15.53:0/3544606463 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0700c51c0 0x7fc0700c3550 unknown :-1 s=CLOSED pgs=2066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:05.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.099+0000 7fc077af3640 1 --2- 172.21.15.53:0/3544606463 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc05c0039b0 0x7fc0700c2af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:05.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.099+0000 7fc077af3640 1 -- 172.21.15.53:0/3544606463 >> 172.21.15.53:0/3544606463 conn(0x7fc07006a560 msgr2=0x7fc07015c070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:05.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.099+0000 7fc89510b640 1 -- 172.21.15.53:0/2320194401 shutdown_connections 2023-06-10T19:06:05.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.099+0000 7fc89510b640 1 --2- 172.21.15.53:0/2320194401 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc87c0662b0 0x7fc87c068760 secure :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fc89015ef90 tx=0x7fc880009040 comp rx=0 tx=0).stop 2023-06-10T19:06:05.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.099+0000 7fc89510b640 1 --2- 172.21.15.53:0/2320194401 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8900c9a20 0x7fc89006d700 unknown :-1 s=CLOSED pgs=2069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:05.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.099+0000 7fc89510b640 1 --2- 172.21.15.53:0/2320194401 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8900c95b0 0x7fc89006d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:05.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.099+0000 7fc89510b640 1 --2- 172.21.15.53:0/2320194401 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc89014e2c0 0x7fc8900ccd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:05.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.099+0000 7fc89510b640 1 -- 172.21.15.53:0/2320194401 >> 172.21.15.53:0/2320194401 conn(0x7fc89006a0b0 msgr2=0x7fc89006f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:05.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.099+0000 7fc077af3640 1 -- 172.21.15.53:0/3544606463 shutdown_connections 2023-06-10T19:06:05.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.099+0000 7fc077af3640 1 -- 172.21.15.53:0/3544606463 wait complete. 2023-06-10T19:06:05.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.099+0000 7fc89510b640 1 -- 172.21.15.53:0/2320194401 shutdown_connections 2023-06-10T19:06:05.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.099+0000 7fc89510b640 1 -- 172.21.15.53:0/2320194401 wait complete. 2023-06-10T19:06:05.129 INFO:tasks.ceph.mds.a:Restarting daemon 2023-06-10T19:06:05.129 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-06-10T19:06:05.131 INFO:tasks.ceph.mds.d:Restarting daemon 2023-06-10T19:06:05.131 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-06-10T19:06:05.133 INFO:tasks.ceph.mds.d:Started 2023-06-10T19:06:05.134 DEBUG:teuthology.parallel:result is None 2023-06-10T19:06:05.139 INFO:tasks.ceph.mds.b:Restarting daemon 2023-06-10T19:06:05.140 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-06-10T19:06:05.141 INFO:tasks.ceph.mds.c:Restarting daemon 2023-06-10T19:06:05.141 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-06-10T19:06:05.142 INFO:tasks.ceph.mds.a:Started 2023-06-10T19:06:05.142 DEBUG:teuthology.parallel:result is None 2023-06-10T19:06:05.144 INFO:tasks.ceph.mds.b:Started 2023-06-10T19:06:05.144 DEBUG:teuthology.parallel:result is None 2023-06-10T19:06:05.183 INFO:tasks.ceph.mds.c:Started 2023-06-10T19:06:05.184 DEBUG:teuthology.parallel:result is None 2023-06-10T19:06:05.184 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:06:05.199 INFO:tasks.ceph.mds.a.smithi053.stdout:starting mds.a at 2023-06-10T19:06:05.211 INFO:tasks.ceph.mds.d.smithi117.stdout:starting mds.d at 2023-06-10T19:06:05.216 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2023-06-10T19:06:05.245 INFO:tasks.ceph.mds.c.smithi053.stdout:starting mds.c at 2023-06-10T19:06:05.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.299+0000 7f0c82276640 1 Processor -- start 2023-06-10T19:06:05.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.299+0000 7f0c82276640 1 -- start start 2023-06-10T19:06:05.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.299+0000 7f0c82276640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0c7c0c8d00 0x7f0c7c06b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:05.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.299+0000 7f0c82276640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0c7c06bc00 0x7f0c7c162180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:05.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.299+0000 7f0c82276640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c7c158a90 con 0x7f0c7c06b2f0 2023-06-10T19:06:05.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.299+0000 7f0c82276640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c7c06f780 con 0x7f0c7c06bc00 2023-06-10T19:06:05.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.299+0000 7f0c82276640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c7c0705d0 con 0x7f0c7c0c8d00 2023-06-10T19:06:05.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.299+0000 7f0c80813640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0c7c06bc00 0x7f0c7c162180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:05.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.299+0000 7f0c80813640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0c7c06bc00 0x7f0c7c162180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49446/0 (socket says 172.21.15.53:49446) 2023-06-10T19:06:05.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.299+0000 7f0c80813640 1 -- 172.21.15.53:0/3923923125 learned_addr learned my addr 172.21.15.53:0/3923923125 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:05.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.299+0000 7f0c7b7fe640 1 --2- 172.21.15.53:0/3923923125 >> v2:172.21.15.117:3300/0 conn(0x7f0c7c0c8d00 0x7f0c7c06b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:05.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.299+0000 7f0c80813640 1 -- 172.21.15.53:0/3923923125 >> v2:172.21.15.117:3300/0 conn(0x7f0c7c0c8d00 msgr2=0x7f0c7c06b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:05.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.299+0000 7f0c80813640 1 --2- 172.21.15.53:0/3923923125 >> v2:172.21.15.117:3300/0 conn(0x7f0c7c0c8d00 0x7f0c7c06b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:05.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.299+0000 7f0c80813640 1 -- 172.21.15.53:0/3923923125 >> v1:172.21.15.117:6789/0 conn(0x7f0c7c06b2f0 legacy=0x7f0c7c06f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:05.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.299+0000 7f0c80813640 1 -- 172.21.15.53:0/3923923125 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c7c0cce10 con 0x7f0c7c06bc00 2023-06-10T19:06:05.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.299+0000 7f0c7b7fe640 1 --2- 172.21.15.53:0/3923923125 >> v2:172.21.15.117:3300/0 conn(0x7f0c7c0c8d00 0x7f0c7c06b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:06:05.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.299+0000 7f0c80813640 1 --2- 172.21.15.53:0/3923923125 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c7c06bc00 0x7f0c7c162180 secure :-1 s=READY pgs=2076 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c15c0b0 tx=0x7f0c7401f180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c45c1988e3b394dc server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:05.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.299+0000 7f0c7affd640 1 -- 172.21.15.53:0/3923923125 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c740af400 con 0x7f0c7c06bc00 2023-06-10T19:06:05.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.299+0000 7f0c7affd640 1 -- 172.21.15.53:0/3923923125 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c740ab050 con 0x7f0c7c06bc00 2023-06-10T19:06:05.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.299+0000 7f0c7affd640 1 -- 172.21.15.53:0/3923923125 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c740af780 con 0x7f0c7c06bc00 2023-06-10T19:06:05.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.299+0000 7f0c82276640 1 -- 172.21.15.53:0/3923923125 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c7c06bc00 msgr2=0x7f0c7c162180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:05.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.299+0000 7f0c82276640 1 --2- 172.21.15.53:0/3923923125 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c7c06bc00 0x7f0c7c162180 secure :-1 s=READY pgs=2076 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c15c0b0 tx=0x7f0c7401f180 comp rx=0 tx=0).stop 2023-06-10T19:06:05.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.299+0000 7f0c82276640 1 -- 172.21.15.53:0/3923923125 shutdown_connections 2023-06-10T19:06:05.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.299+0000 7f0c82276640 1 --2- 172.21.15.53:0/3923923125 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c7c06bc00 0x7f0c7c162180 unknown :-1 s=CLOSED pgs=2076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:05.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.299+0000 7f0c82276640 1 --2- 172.21.15.53:0/3923923125 >> v2:172.21.15.117:3300/0 conn(0x7f0c7c0c8d00 0x7f0c7c06b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:05.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.299+0000 7f0c82276640 1 -- 172.21.15.53:0/3923923125 >> 172.21.15.53:0/3923923125 conn(0x7f0c7c06a0d0 msgr2=0x7f0c7c0ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:05.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.299+0000 7f0c82276640 1 -- 172.21.15.53:0/3923923125 shutdown_connections 2023-06-10T19:06:05.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.299+0000 7f0c82276640 1 -- 172.21.15.53:0/3923923125 wait complete. 2023-06-10T19:06:05.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.299+0000 7f0c82276640 1 Processor -- start 2023-06-10T19:06:05.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.299+0000 7f0c82276640 1 -- start start 2023-06-10T19:06:05.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.303+0000 7f0c82276640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c7c06b2f0 0x7f0c7c153100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:05.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.303+0000 7f0c82276640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0c7c06bc00 0x7f0c7c0ae330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:05.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.303+0000 7f0c82276640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c7c0c8d00 0x7f0c7c0abf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:05.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.303+0000 7f0c82276640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7c165740 con 0x7f0c7c0c8d00 2023-06-10T19:06:05.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.303+0000 7f0c82276640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7c153640 con 0x7f0c7c06b2f0 2023-06-10T19:06:05.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.303+0000 7f0c82276640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7c164ea0 con 0x7f0c7c06bc00 2023-06-10T19:06:05.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.303+0000 7f0c80813640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c7c0c8d00 0x7f0c7c0abf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:05.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.303+0000 7f0c80813640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c7c0c8d00 0x7f0c7c0abf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49460/0 (socket says 172.21.15.53:49460) 2023-06-10T19:06:05.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.303+0000 7f0c80813640 1 -- 172.21.15.53:0/191821979 learned_addr learned my addr 172.21.15.53:0/191821979 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:05.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.303+0000 7f0c7bfff640 1 --2- 172.21.15.53:0/191821979 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c7c06b2f0 0x7f0c7c153100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:05.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.303+0000 7f0c80813640 1 -- 172.21.15.53:0/191821979 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0c7c06bc00 msgr2=0x7f0c7c0ae330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:05.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.303+0000 7f0c80813640 1 --2- 172.21.15.53:0/191821979 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0c7c06bc00 0x7f0c7c0ae330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:05.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.303+0000 7f0c80813640 1 -- 172.21.15.53:0/191821979 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c7c06b2f0 msgr2=0x7f0c7c153100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:05.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.303+0000 7f0c80813640 1 --2- 172.21.15.53:0/191821979 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c7c06b2f0 0x7f0c7c153100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:05.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.303+0000 7f0c80813640 1 -- 172.21.15.53:0/191821979 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c74009b30 con 0x7f0c7c0c8d00 2023-06-10T19:06:05.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.303+0000 7f0c7bfff640 1 --2- 172.21.15.53:0/191821979 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c7c06b2f0 0x7f0c7c153100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:06:05.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.303+0000 7f0c80813640 1 --2- 172.21.15.53:0/191821979 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c7c0c8d00 0x7f0c7c0abf20 secure :-1 s=READY pgs=2077 cs=0 l=1 rev1=1 crypto rx=0x7f0c740b2040 tx=0x7f0c7401bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:05.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.303+0000 7f0c78ff9640 1 -- 172.21.15.53:0/191821979 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c740afde0 con 0x7f0c7c0c8d00 2023-06-10T19:06:05.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.303+0000 7f0c78ff9640 1 -- 172.21.15.53:0/191821979 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c74009510 con 0x7f0c7c0c8d00 2023-06-10T19:06:05.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.303+0000 7f0c82276640 1 -- 172.21.15.53:0/191821979 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c7c165180 con 0x7f0c7c0c8d00 2023-06-10T19:06:05.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.303+0000 7f0c78ff9640 1 -- 172.21.15.53:0/191821979 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c740ba660 con 0x7f0c7c0c8d00 2023-06-10T19:06:05.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.303+0000 7f0c82276640 1 -- 172.21.15.53:0/191821979 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c7c0aba00 con 0x7f0c7c0c8d00 2023-06-10T19:06:05.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.303+0000 7f0c82276640 1 -- 172.21.15.53:0/191821979 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c7c0ab860 con 0x7f0c7c0c8d00 2023-06-10T19:06:05.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.303+0000 7f0c78ff9640 1 -- 172.21.15.53:0/191821979 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0c740b6040 con 0x7f0c7c0c8d00 2023-06-10T19:06:05.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.303+0000 7f0c78ff9640 1 --2- 172.21.15.53:0/191821979 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0c68066280 0x7f0c68068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:05.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.303+0000 7f0c78ff9640 1 -- 172.21.15.53:0/191821979 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f0c74121f90 con 0x7f0c7c0c8d00 2023-06-10T19:06:05.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.303+0000 7f0c7bfff640 1 --2- 172.21.15.53:0/191821979 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0c68066280 0x7f0c68068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:05.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.307+0000 7f0c7bfff640 1 --2- 172.21.15.53:0/191821979 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0c68066280 0x7f0c68068730 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c0aef00 tx=0x7f0c6c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:05.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.307+0000 7f0c78ff9640 1 -- 172.21.15.53:0/191821979 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0c7c0ab860 con 0x7f0c7c0c8d00 2023-06-10T19:06:05.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.495+0000 7f0c82276640 1 -- 172.21.15.53:0/191821979 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0c7c0ab860 con 0x7f0c7c0c8d00 2023-06-10T19:06:05.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.495+0000 7f0c78ff9640 1 -- 172.21.15.53:0/191821979 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) v1 ==== 94+0+1639 (secure 0 0 0) 0x7f0c7c0ab860 con 0x7f0c7c0c8d00 2023-06-10T19:06:05.496 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:06:05.497 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":77,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":77,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:05:50.789763+0000","modified":"2023-06-10T19:06:05.082116+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":139,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-06-10T19:06:05.497 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 77 2023-06-10T19:06:05.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.495+0000 7f0c82276640 1 -- 172.21.15.53:0/191821979 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0c68066280 msgr2=0x7f0c68068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:05.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.495+0000 7f0c82276640 1 --2- 172.21.15.53:0/191821979 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0c68066280 0x7f0c68068730 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c0aef00 tx=0x7f0c6c009040 comp rx=0 tx=0).stop 2023-06-10T19:06:05.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.495+0000 7f0c82276640 1 -- 172.21.15.53:0/191821979 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c7c0c8d00 msgr2=0x7f0c7c0abf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:05.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.495+0000 7f0c82276640 1 --2- 172.21.15.53:0/191821979 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c7c0c8d00 0x7f0c7c0abf20 secure :-1 s=READY pgs=2077 cs=0 l=1 rev1=1 crypto rx=0x7f0c740b2040 tx=0x7f0c7401bf20 comp rx=0 tx=0).stop 2023-06-10T19:06:05.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.495+0000 7f0c82276640 1 -- 172.21.15.53:0/191821979 shutdown_connections 2023-06-10T19:06:05.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.495+0000 7f0c82276640 1 --2- 172.21.15.53:0/191821979 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0c68066280 0x7f0c68068730 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:05.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.495+0000 7f0c82276640 1 --2- 172.21.15.53:0/191821979 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c7c0c8d00 0x7f0c7c0abf20 unknown :-1 s=CLOSED pgs=2077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:05.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.495+0000 7f0c82276640 1 --2- 172.21.15.53:0/191821979 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0c7c06bc00 0x7f0c7c0ae330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:05.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.495+0000 7f0c82276640 1 --2- 172.21.15.53:0/191821979 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c7c06b2f0 0x7f0c7c153100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:05.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.495+0000 7f0c82276640 1 -- 172.21.15.53:0/191821979 >> 172.21.15.53:0/191821979 conn(0x7f0c7c06a0d0 msgr2=0x7f0c7c0af770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:05.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.495+0000 7f0c82276640 1 -- 172.21.15.53:0/191821979 shutdown_connections 2023-06-10T19:06:05.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:05.495+0000 7f0c82276640 1 -- 172.21.15.53:0/191821979 wait complete. 2023-06-10T19:06:05.513 DEBUG:tasks.cephfs.filesystem:mapped states [] to None 2023-06-10T19:06:06.516 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:06:06.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:06.647+0000 7f5ec2041640 1 Processor -- start 2023-06-10T19:06:06.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:06.647+0000 7f5ec2041640 1 -- start start 2023-06-10T19:06:06.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:06.651+0000 7f5ec2041640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ebc0c9840 0x7f5ebc0c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:06.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:06.651+0000 7f5ec2041640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5ebc071060 0x7f5ebc0af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:06.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:06.651+0000 7f5ec2041640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ebc159b50 con 0x7f5ebc0afc60 2023-06-10T19:06:06.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:06.651+0000 7f5ec2041640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ebc0ca150 con 0x7f5ebc071060 2023-06-10T19:06:06.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:06.651+0000 7f5ec2041640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ebc0702a0 con 0x7f5ebc0c9840 2023-06-10T19:06:06.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:06.651+0000 7f5ebbfff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f5ebc0afc60 0x7f5ebc15d2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56858/0 (socket says 172.21.15.53:56858) 2023-06-10T19:06:06.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:06.651+0000 7f5ebbfff640 1 -- 172.21.15.53:0/1649479874 learned_addr learned my addr 172.21.15.53:0/1649479874 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:06:06.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:06.651+0000 7f5ebaffd640 1 --2- 172.21.15.53:0/1649479874 >> v2:172.21.15.53:3300/0 conn(0x7f5ebc071060 0x7f5ebc0af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:06.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:06.651+0000 7f5ebb7fe640 1 --2- 172.21.15.53:0/1649479874 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ebc0c9840 0x7f5ebc0c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:06.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:06.651+0000 7f5eba7fc640 1 -- 172.21.15.53:0/1649479874 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1128743375 0 0) 0x7f5ebc159b50 con 0x7f5ebc0afc60 2023-06-10T19:06:06.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:06.651+0000 7f5eba7fc640 1 -- 172.21.15.53:0/1649479874 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ea8003530 con 0x7f5ebc0afc60 2023-06-10T19:06:06.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:06.651+0000 7f5ebaffd640 1 -- 172.21.15.53:0/1649479874 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ebc0c9840 msgr2=0x7f5ebc0c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:06.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:06.651+0000 7f5ebaffd640 1 --2- 172.21.15.53:0/1649479874 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ebc0c9840 0x7f5ebc0c9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:06.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:06.651+0000 7f5ebaffd640 1 -- 172.21.15.53:0/1649479874 >> v1:172.21.15.53:6789/0 conn(0x7f5ebc0afc60 legacy=0x7f5ebc15d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:06.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:06.651+0000 7f5ebaffd640 1 -- 172.21.15.53:0/1649479874 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ebc070580 con 0x7f5ebc071060 2023-06-10T19:06:06.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:06.651+0000 7f5ebaffd640 1 --2- 172.21.15.53:0/1649479874 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ebc071060 0x7f5ebc0af720 secure :-1 s=READY pgs=2079 cs=0 l=1 rev1=1 crypto rx=0x7f5eac009d90 tx=0x7f5eac01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba33713aa5d2b83e server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:06.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:06.651+0000 7f5eba7fc640 1 -- 172.21.15.53:0/1649479874 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eac0a5900 con 0x7f5ebc071060 2023-06-10T19:06:06.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:06.651+0000 7f5eba7fc640 1 -- 172.21.15.53:0/1649479874 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eac0a5a60 con 0x7f5ebc071060 2023-06-10T19:06:06.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:06.651+0000 7f5eba7fc640 1 -- 172.21.15.53:0/1649479874 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eac0a5dd0 con 0x7f5ebc071060 2023-06-10T19:06:06.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:06.651+0000 7f5ec2041640 1 -- 172.21.15.53:0/1649479874 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ebc071060 msgr2=0x7f5ebc0af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:06.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:06.651+0000 7f5ec2041640 1 --2- 172.21.15.53:0/1649479874 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ebc071060 0x7f5ebc0af720 secure :-1 s=READY pgs=2079 cs=0 l=1 rev1=1 crypto rx=0x7f5eac009d90 tx=0x7f5eac01c920 comp rx=0 tx=0).stop 2023-06-10T19:06:06.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:06.655+0000 7f5ec2041640 1 -- 172.21.15.53:0/1649479874 shutdown_connections 2023-06-10T19:06:06.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:06.655+0000 7f5ec2041640 1 --2- 172.21.15.53:0/1649479874 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ebc071060 0x7f5ebc0af720 unknown :-1 s=CLOSED pgs=2079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:06.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:06.655+0000 7f5ec2041640 1 --2- 172.21.15.53:0/1649479874 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ebc0c9840 0x7f5ebc0c9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:06.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:06.655+0000 7f5ec2041640 1 -- 172.21.15.53:0/1649479874 >> 172.21.15.53:0/1649479874 conn(0x7f5ebc06a0d0 msgr2=0x7f5ebc0ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:06.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:06.655+0000 7f5ec2041640 1 -- 172.21.15.53:0/1649479874 shutdown_connections 2023-06-10T19:06:06.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:06.655+0000 7f5ec2041640 1 -- 172.21.15.53:0/1649479874 wait complete. 2023-06-10T19:06:06.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:06.655+0000 7f5ec2041640 1 Processor -- start 2023-06-10T19:06:06.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:06.655+0000 7f5ec2041640 1 -- start start 2023-06-10T19:06:06.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:06.655+0000 7f5ec2041640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ebc071060 0x7f5ebc14f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:06.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:06.655+0000 7f5ec2041640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ebc0afc60 0x7f5ebc150970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:06.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:06.655+0000 7f5ec2041640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ebc0c9840 0x7f5ebc14ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:06.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:06.655+0000 7f5ec2041640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ebc14f8d0 con 0x7f5ebc0c9840 2023-06-10T19:06:06.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:06.655+0000 7f5ec2041640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ebc14fbb0 con 0x7f5ebc071060 2023-06-10T19:06:06.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:06.655+0000 7f5ec2041640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ebc14fe90 con 0x7f5ebc0afc60 2023-06-10T19:06:06.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:06.655+0000 7f5ebbfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ebc0c9840 0x7f5ebc14ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:06.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:06.655+0000 7f5ebbfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ebc0c9840 0x7f5ebc14ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49478/0 (socket says 172.21.15.53:49478) 2023-06-10T19:06:06.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:06.655+0000 7f5ebbfff640 1 -- 172.21.15.53:0/674123001 learned_addr learned my addr 172.21.15.53:0/674123001 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:06.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:06.655+0000 7f5ebaffd640 1 --2- 172.21.15.53:0/674123001 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ebc0afc60 0x7f5ebc150970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:06.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:06.655+0000 7f5ebb7fe640 1 --2- 172.21.15.53:0/674123001 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ebc071060 0x7f5ebc14f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:06.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:06.655+0000 7f5ebbfff640 1 -- 172.21.15.53:0/674123001 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ebc0afc60 msgr2=0x7f5ebc150970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:06.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:06.655+0000 7f5ebbfff640 1 --2- 172.21.15.53:0/674123001 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ebc0afc60 0x7f5ebc150970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:06.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:06.655+0000 7f5ebbfff640 1 -- 172.21.15.53:0/674123001 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ebc071060 msgr2=0x7f5ebc14f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:06.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:06.655+0000 7f5ebbfff640 1 --2- 172.21.15.53:0/674123001 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ebc071060 0x7f5ebc14f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:06.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:06.655+0000 7f5ebbfff640 1 -- 172.21.15.53:0/674123001 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eac009a70 con 0x7f5ebc0c9840 2023-06-10T19:06:06.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:06.655+0000 7f5ebaffd640 1 --2- 172.21.15.53:0/674123001 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ebc0afc60 0x7f5ebc150970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:06:06.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:06.655+0000 7f5ebbfff640 1 --2- 172.21.15.53:0/674123001 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ebc0c9840 0x7f5ebc14ca60 secure :-1 s=READY pgs=2080 cs=0 l=1 rev1=1 crypto rx=0x7f5eb400c450 tx=0x7f5eb400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:06.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:06.655+0000 7f5eb3fff640 1 -- 172.21.15.53:0/674123001 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb4005cf0 con 0x7f5ebc0c9840 2023-06-10T19:06:06.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:06.655+0000 7f5eb3fff640 1 -- 172.21.15.53:0/674123001 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eb4005e50 con 0x7f5ebc0c9840 2023-06-10T19:06:06.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:06.655+0000 7f5ec2041640 1 -- 172.21.15.53:0/674123001 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ebc150170 con 0x7f5ebc0c9840 2023-06-10T19:06:06.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:06.655+0000 7f5eb3fff640 1 -- 172.21.15.53:0/674123001 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb40072b0 con 0x7f5ebc0c9840 2023-06-10T19:06:06.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:06.655+0000 7f5ec2041640 1 -- 172.21.15.53:0/674123001 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ebc14be10 con 0x7f5ebc0c9840 2023-06-10T19:06:06.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:06.655+0000 7f5ec2041640 1 -- 172.21.15.53:0/674123001 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ebc150690 con 0x7f5ebc0c9840 2023-06-10T19:06:06.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:06.659+0000 7f5eb3fff640 1 -- 172.21.15.53:0/674123001 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5eb4007410 con 0x7f5ebc0c9840 2023-06-10T19:06:06.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:06.659+0000 7f5eb3fff640 1 --2- 172.21.15.53:0/674123001 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5e9c066280 0x7f5e9c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:06.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:06.659+0000 7f5eb3fff640 1 -- 172.21.15.53:0/674123001 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f5eb4083210 con 0x7f5ebc0c9840 2023-06-10T19:06:06.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:06.659+0000 7f5ebb7fe640 1 --2- 172.21.15.53:0/674123001 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5e9c066280 0x7f5e9c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:06.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:06.659+0000 7f5ebb7fe640 1 --2- 172.21.15.53:0/674123001 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5e9c066280 0x7f5e9c068730 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f5ea400b930 tx=0x7f5ea4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:06.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:06.663+0000 7f5eb3fff640 1 -- 172.21.15.53:0/674123001 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5ebc150690 con 0x7f5ebc0c9840 2023-06-10T19:06:06.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:06.847+0000 7f5ec2041640 1 -- 172.21.15.53:0/674123001 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5ebc150690 con 0x7f5ebc0c9840 2023-06-10T19:06:06.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:06.851+0000 7f5eb3fff640 1 -- 172.21.15.53:0/674123001 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4678 (secure 0 0 0) 0x7f5ebc150690 con 0x7f5ebc0c9840 2023-06-10T19:06:06.852 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:06:06.852 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":78,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8125,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3512570304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3512570304},{"type":"v1","addr":"172.21.15.117:6835","nonce":3512570304}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78},{"gid":8128,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/325110995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":325110995},{"type":"v1","addr":"172.21.15.117:6837","nonce":325110995}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78},{"gid":9759,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/2776844045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2776844045},{"type":"v1","addr":"172.21.15.53:6833","nonce":2776844045}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:05:50.789763+0000","modified":"2023-06-10T19:06:06.071940+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":139,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9780},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9780":{"gid":9780,"name":"c","rank":0,"incarnation":78,"state":"up:replay","state_seq":1,"addr":"172.21.15.53:6835/2721536857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2721536857},{"type":"v1","addr":"172.21.15.53:6835","nonce":2721536857}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-06-10T19:06:06.852 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 78 2023-06-10T19:06:06.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:06.851+0000 7f5ec2041640 1 -- 172.21.15.53:0/674123001 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5e9c066280 msgr2=0x7f5e9c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:06.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:06.851+0000 7f5ec2041640 1 --2- 172.21.15.53:0/674123001 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5e9c066280 0x7f5e9c068730 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f5ea400b930 tx=0x7f5ea4008040 comp rx=0 tx=0).stop 2023-06-10T19:06:06.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:06.851+0000 7f5ec2041640 1 -- 172.21.15.53:0/674123001 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ebc0c9840 msgr2=0x7f5ebc14ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:06.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:06.851+0000 7f5ec2041640 1 --2- 172.21.15.53:0/674123001 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ebc0c9840 0x7f5ebc14ca60 secure :-1 s=READY pgs=2080 cs=0 l=1 rev1=1 crypto rx=0x7f5eb400c450 tx=0x7f5eb400c910 comp rx=0 tx=0).stop 2023-06-10T19:06:06.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:06.851+0000 7f5ec2041640 1 -- 172.21.15.53:0/674123001 shutdown_connections 2023-06-10T19:06:06.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:06.851+0000 7f5ec2041640 1 --2- 172.21.15.53:0/674123001 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5e9c066280 0x7f5e9c068730 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:06.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:06.851+0000 7f5ec2041640 1 --2- 172.21.15.53:0/674123001 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ebc0c9840 0x7f5ebc14ca60 unknown :-1 s=CLOSED pgs=2080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:06.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:06.851+0000 7f5ec2041640 1 --2- 172.21.15.53:0/674123001 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ebc0afc60 0x7f5ebc150970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:06.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:06.851+0000 7f5ec2041640 1 --2- 172.21.15.53:0/674123001 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ebc071060 0x7f5ebc14f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:06.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:06.851+0000 7f5ec2041640 1 -- 172.21.15.53:0/674123001 >> 172.21.15.53:0/674123001 conn(0x7f5ebc06a0d0 msgr2=0x7f5ebc0adf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:06.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:06.851+0000 7f5ec2041640 1 -- 172.21.15.53:0/674123001 shutdown_connections 2023-06-10T19:06:06.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:06.851+0000 7f5ec2041640 1 -- 172.21.15.53:0/674123001 wait complete. 2023-06-10T19:06:06.870 DEBUG:tasks.cephfs.filesystem:mapped states ['up:replay'] to None 2023-06-10T19:06:07.871 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:06:08.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:08.003+0000 7f50e2216640 1 Processor -- start 2023-06-10T19:06:08.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:08.003+0000 7f50e2216640 1 -- start start 2023-06-10T19:06:08.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:08.007+0000 7f50e2216640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f50dc0c9840 0x7f50dc0c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:08.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:08.007+0000 7f50e2216640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50dc159b50 con 0x7f50dc06b090 2023-06-10T19:06:08.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:08.007+0000 7f50e2216640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50dc0ca150 con 0x7f50dc071060 2023-06-10T19:06:08.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:08.007+0000 7f50e2216640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50dc0702a0 con 0x7f50dc0c9840 2023-06-10T19:06:08.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:08.007+0000 7f50db7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f50dc0c9840 0x7f50dc0c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:08.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:08.007+0000 7f50dbfff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f50dc06b090 0x7f50dc06b510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56862/0 (socket says 172.21.15.53:56862) 2023-06-10T19:06:08.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:08.007+0000 7f50dbfff640 1 -- 172.21.15.53:0/907575016 learned_addr learned my addr 172.21.15.53:0/907575016 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:06:08.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:08.007+0000 7f50db7fe640 1 -- 172.21.15.53:0/907575016 >> v1:172.21.15.117:6789/0 conn(0x7f50dc071060 legacy=0x7f50dc0af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:08.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:08.007+0000 7f50db7fe640 1 -- 172.21.15.53:0/907575016 >> v1:172.21.15.53:6789/0 conn(0x7f50dc06b090 legacy=0x7f50dc06b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:08.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:08.007+0000 7f50db7fe640 1 -- 172.21.15.53:0/907575016 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50dc070580 con 0x7f50dc0c9840 2023-06-10T19:06:08.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:08.007+0000 7f50db7fe640 1 --2- 172.21.15.53:0/907575016 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50dc0c9840 0x7f50dc0c9c10 secure :-1 s=READY pgs=2082 cs=0 l=1 rev1=1 crypto rx=0x7f50cc0097c0 tx=0x7f50cc01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b94099301b12e4bc server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:08.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:08.007+0000 7f50da7fc640 1 -- 172.21.15.53:0/907575016 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50cc0ab650 con 0x7f50dc0c9840 2023-06-10T19:06:08.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:08.007+0000 7f50da7fc640 1 -- 172.21.15.53:0/907575016 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50cc0ab7b0 con 0x7f50dc0c9840 2023-06-10T19:06:08.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:08.007+0000 7f50da7fc640 1 -- 172.21.15.53:0/907575016 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50cc0abb40 con 0x7f50dc0c9840 2023-06-10T19:06:08.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:08.011+0000 7f50e2216640 1 -- 172.21.15.53:0/907575016 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50dc0c9840 msgr2=0x7f50dc0c9c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:08.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:08.011+0000 7f50e2216640 1 --2- 172.21.15.53:0/907575016 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50dc0c9840 0x7f50dc0c9c10 secure :-1 s=READY pgs=2082 cs=0 l=1 rev1=1 crypto rx=0x7f50cc0097c0 tx=0x7f50cc01c450 comp rx=0 tx=0).stop 2023-06-10T19:06:08.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:08.011+0000 7f50e2216640 1 -- 172.21.15.53:0/907575016 shutdown_connections 2023-06-10T19:06:08.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:08.011+0000 7f50e2216640 1 --2- 172.21.15.53:0/907575016 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50dc0c9840 0x7f50dc0c9c10 unknown :-1 s=CLOSED pgs=2082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:08.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:08.011+0000 7f50e2216640 1 -- 172.21.15.53:0/907575016 >> 172.21.15.53:0/907575016 conn(0x7f50dc06a0d0 msgr2=0x7f50dc0ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:08.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:08.011+0000 7f50e2216640 1 -- 172.21.15.53:0/907575016 shutdown_connections 2023-06-10T19:06:08.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:08.011+0000 7f50e2216640 1 -- 172.21.15.53:0/907575016 wait complete. 2023-06-10T19:06:08.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:08.011+0000 7f50e2216640 1 Processor -- start 2023-06-10T19:06:08.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:08.011+0000 7f50e2216640 1 -- start start 2023-06-10T19:06:08.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:08.011+0000 7f50e2216640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50dc06b090 0x7f50dc1509d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:08.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:08.011+0000 7f50e2216640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50dc071060 0x7f50dc154f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:08.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:08.011+0000 7f50e2216640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50dc0c9840 0x7f50dc14cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:08.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:08.011+0000 7f50e2216640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50dc0cd830 con 0x7f50dc071060 2023-06-10T19:06:08.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:08.011+0000 7f50e2216640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50dc0cd270 con 0x7f50dc06b090 2023-06-10T19:06:08.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:08.011+0000 7f50e2216640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50dc0cd550 con 0x7f50dc0c9840 2023-06-10T19:06:08.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:08.011+0000 7f50daffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50dc071060 0x7f50dc154f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:08.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:08.011+0000 7f50daffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50dc071060 0x7f50dc154f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49502/0 (socket says 172.21.15.53:49502) 2023-06-10T19:06:08.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:08.011+0000 7f50daffd640 1 -- 172.21.15.53:0/3393871435 learned_addr learned my addr 172.21.15.53:0/3393871435 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:08.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:08.011+0000 7f50db7fe640 1 --2- 172.21.15.53:0/3393871435 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50dc06b090 0x7f50dc1509d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:08.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:08.011+0000 7f50dbfff640 1 --2- 172.21.15.53:0/3393871435 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50dc0c9840 0x7f50dc14cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:08.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:08.011+0000 7f50daffd640 1 -- 172.21.15.53:0/3393871435 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50dc0c9840 msgr2=0x7f50dc14cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:08.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:08.011+0000 7f50daffd640 1 --2- 172.21.15.53:0/3393871435 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50dc0c9840 0x7f50dc14cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:08.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:08.011+0000 7f50daffd640 1 -- 172.21.15.53:0/3393871435 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50dc06b090 msgr2=0x7f50dc1509d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:08.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:08.011+0000 7f50daffd640 1 --2- 172.21.15.53:0/3393871435 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50dc06b090 0x7f50dc1509d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:08.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:08.011+0000 7f50daffd640 1 -- 172.21.15.53:0/3393871435 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50cc009420 con 0x7f50dc071060 2023-06-10T19:06:08.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:08.011+0000 7f50dbfff640 1 --2- 172.21.15.53:0/3393871435 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50dc0c9840 0x7f50dc14cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:06:08.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:08.011+0000 7f50daffd640 1 --2- 172.21.15.53:0/3393871435 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50dc071060 0x7f50dc154f80 secure :-1 s=READY pgs=2083 cs=0 l=1 rev1=1 crypto rx=0x7f50c400c7c0 tx=0x7f50c400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:08.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:08.011+0000 7f50d3fff640 1 -- 172.21.15.53:0/3393871435 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c4003b80 con 0x7f50dc071060 2023-06-10T19:06:08.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:08.011+0000 7f50d3fff640 1 -- 172.21.15.53:0/3393871435 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50c4003ce0 con 0x7f50dc071060 2023-06-10T19:06:08.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:08.011+0000 7f50d3fff640 1 -- 172.21.15.53:0/3393871435 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c400aa90 con 0x7f50dc071060 2023-06-10T19:06:08.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:08.011+0000 7f50e2216640 1 -- 172.21.15.53:0/3393871435 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50dc0cbbb0 con 0x7f50dc071060 2023-06-10T19:06:08.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:08.011+0000 7f50e2216640 1 -- 172.21.15.53:0/3393871435 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50dc14f230 con 0x7f50dc071060 2023-06-10T19:06:08.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:08.015+0000 7f50e2216640 1 -- 172.21.15.53:0/3393871435 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50dc04d790 con 0x7f50dc071060 2023-06-10T19:06:08.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:08.015+0000 7f50d3fff640 1 -- 172.21.15.53:0/3393871435 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f50c400abf0 con 0x7f50dc071060 2023-06-10T19:06:08.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:08.015+0000 7f50d3fff640 1 --2- 172.21.15.53:0/3393871435 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f50bc066280 0x7f50bc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:08.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:08.015+0000 7f50d3fff640 1 -- 172.21.15.53:0/3393871435 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f50c4083c40 con 0x7f50dc071060 2023-06-10T19:06:08.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:08.015+0000 7f50db7fe640 1 --2- 172.21.15.53:0/3393871435 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f50bc066280 0x7f50bc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:08.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:08.015+0000 7f50db7fe640 1 --2- 172.21.15.53:0/3393871435 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f50bc066280 0x7f50bc068730 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f50cc0af000 tx=0x7f50cc0a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:08.020 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:08.019+0000 7f50d3fff640 1 -- 172.21.15.53:0/3393871435 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f50c4051060 con 0x7f50dc071060 2023-06-10T19:06:08.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:08.203+0000 7f50e2216640 1 -- 172.21.15.53:0/3393871435 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f50dc0cc060 con 0x7f50dc071060 2023-06-10T19:06:08.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:08.203+0000 7f50d3fff640 1 -- 172.21.15.53:0/3393871435 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) v1 ==== 94+0+4678 (secure 0 0 0) 0x7f50c4054680 con 0x7f50dc071060 2023-06-10T19:06:08.207 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:06:08.207 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":80,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8125,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3512570304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3512570304},{"type":"v1","addr":"172.21.15.117:6835","nonce":3512570304}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78},{"gid":8128,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/325110995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":325110995},{"type":"v1","addr":"172.21.15.117:6837","nonce":325110995}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78},{"gid":9759,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/2776844045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2776844045},{"type":"v1","addr":"172.21.15.53:6833","nonce":2776844045}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":80,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:05:50.789763+0000","modified":"2023-06-10T19:06:08.110180+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":139,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9780},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9780":{"gid":9780,"name":"c","rank":0,"incarnation":78,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.53:6835/2721536857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2721536857},{"type":"v1","addr":"172.21.15.53:6835","nonce":2721536857}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-06-10T19:06:08.207 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 80 2023-06-10T19:06:08.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:08.207+0000 7f50e2216640 1 -- 172.21.15.53:0/3393871435 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f50bc066280 msgr2=0x7f50bc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:08.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:08.207+0000 7f50e2216640 1 --2- 172.21.15.53:0/3393871435 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f50bc066280 0x7f50bc068730 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f50cc0af000 tx=0x7f50cc0a7000 comp rx=0 tx=0).stop 2023-06-10T19:06:08.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:08.207+0000 7f50e2216640 1 -- 172.21.15.53:0/3393871435 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50dc071060 msgr2=0x7f50dc154f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:08.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:08.207+0000 7f50e2216640 1 --2- 172.21.15.53:0/3393871435 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50dc071060 0x7f50dc154f80 secure :-1 s=READY pgs=2083 cs=0 l=1 rev1=1 crypto rx=0x7f50c400c7c0 tx=0x7f50c400cc80 comp rx=0 tx=0).stop 2023-06-10T19:06:08.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:08.207+0000 7f50e2216640 1 -- 172.21.15.53:0/3393871435 shutdown_connections 2023-06-10T19:06:08.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:08.207+0000 7f50e2216640 1 --2- 172.21.15.53:0/3393871435 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f50bc066280 0x7f50bc068730 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:08.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:08.207+0000 7f50e2216640 1 --2- 172.21.15.53:0/3393871435 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f50dc0c9840 0x7f50dc14cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:08.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:08.207+0000 7f50e2216640 1 --2- 172.21.15.53:0/3393871435 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50dc071060 0x7f50dc154f80 unknown :-1 s=CLOSED pgs=2083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:08.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:08.207+0000 7f50e2216640 1 --2- 172.21.15.53:0/3393871435 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50dc06b090 0x7f50dc1509d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:08.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:08.207+0000 7f50e2216640 1 -- 172.21.15.53:0/3393871435 >> 172.21.15.53:0/3393871435 conn(0x7f50dc06a0d0 msgr2=0x7f50dc0ca370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:08.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:08.207+0000 7f50e2216640 1 -- 172.21.15.53:0/3393871435 shutdown_connections 2023-06-10T19:06:08.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:08.207+0000 7f50e2216640 1 -- 172.21.15.53:0/3393871435 wait complete. 2023-06-10T19:06:08.216 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-10T19:06:08.218 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-10T19:06:08.225 DEBUG:tasks.cephfs.filesystem:mapped states ['up:rejoin'] to None 2023-06-10T19:06:09.226 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:06:09.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:09.359+0000 7f8dee439640 1 Processor -- start 2023-06-10T19:06:09.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:09.359+0000 7f8dee439640 1 -- start start 2023-06-10T19:06:09.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:09.359+0000 7f8dee439640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8de806b780 0x7f8de815c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:09.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:09.359+0000 7f8dee439640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8de80ceb20 0x7f8de80cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:09.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:09.359+0000 7f8dee439640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8de80af530 con 0x7f8de806bb50 2023-06-10T19:06:09.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:09.359+0000 7f8dee439640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8de815c3d0 con 0x7f8de806b780 2023-06-10T19:06:09.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:09.359+0000 7f8dee439640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8de815fd70 con 0x7f8de80ceb20 2023-06-10T19:06:09.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:09.359+0000 7f8de7fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8de806b780 0x7f8de815c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:09.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:09.359+0000 7f8ddffff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f8de806bb50 0x7f8de815f320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56868/0 (socket says 172.21.15.53:56868) 2023-06-10T19:06:09.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:09.359+0000 7f8ddffff640 1 -- 172.21.15.53:0/1883676068 learned_addr learned my addr 172.21.15.53:0/1883676068 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:06:09.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:09.359+0000 7f8dec9d6640 1 --2- 172.21.15.53:0/1883676068 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8de80ceb20 0x7f8de80cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:09.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:09.359+0000 7f8de7fff640 1 -- 172.21.15.53:0/1883676068 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8de80ceb20 msgr2=0x7f8de80cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:09.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:09.359+0000 7f8de7fff640 1 --2- 172.21.15.53:0/1883676068 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8de80ceb20 0x7f8de80cefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:09.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:09.359+0000 7f8de7fff640 1 -- 172.21.15.53:0/1883676068 >> v1:172.21.15.53:6789/0 conn(0x7f8de806bb50 legacy=0x7f8de815f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:09.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:09.359+0000 7f8de7fff640 1 -- 172.21.15.53:0/1883676068 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8de8160050 con 0x7f8de806b780 2023-06-10T19:06:09.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:09.359+0000 7f8dec9d6640 1 --2- 172.21.15.53:0/1883676068 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8de80ceb20 0x7f8de80cefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:06:09.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:09.363+0000 7f8de7fff640 1 --2- 172.21.15.53:0/1883676068 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8de806b780 0x7f8de815c7f0 secure :-1 s=READY pgs=2085 cs=0 l=1 rev1=1 crypto rx=0x7f8dd80097c0 tx=0x7f8dd801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=602cc8c537b082d7 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:09.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:09.363+0000 7f8de77fe640 1 -- 172.21.15.53:0/1883676068 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd80ab600 con 0x7f8de806b780 2023-06-10T19:06:09.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:09.363+0000 7f8de77fe640 1 -- 172.21.15.53:0/1883676068 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dd80a7050 con 0x7f8de806b780 2023-06-10T19:06:09.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:09.363+0000 7f8de77fe640 1 -- 172.21.15.53:0/1883676068 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd80ab980 con 0x7f8de806b780 2023-06-10T19:06:09.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:09.363+0000 7f8dee439640 1 -- 172.21.15.53:0/1883676068 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8de806b780 msgr2=0x7f8de815c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:09.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:09.363+0000 7f8dee439640 1 --2- 172.21.15.53:0/1883676068 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8de806b780 0x7f8de815c7f0 secure :-1 s=READY pgs=2085 cs=0 l=1 rev1=1 crypto rx=0x7f8dd80097c0 tx=0x7f8dd801c3f0 comp rx=0 tx=0).stop 2023-06-10T19:06:09.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:09.363+0000 7f8dee439640 1 -- 172.21.15.53:0/1883676068 shutdown_connections 2023-06-10T19:06:09.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:09.363+0000 7f8dee439640 1 --2- 172.21.15.53:0/1883676068 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8de80ceb20 0x7f8de80cefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:09.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:09.363+0000 7f8dee439640 1 --2- 172.21.15.53:0/1883676068 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8de806b780 0x7f8de815c7f0 unknown :-1 s=CLOSED pgs=2085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:09.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:09.363+0000 7f8dee439640 1 -- 172.21.15.53:0/1883676068 >> 172.21.15.53:0/1883676068 conn(0x7f8de806a090 msgr2=0x7f8de806d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:09.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:09.363+0000 7f8dee439640 1 -- 172.21.15.53:0/1883676068 shutdown_connections 2023-06-10T19:06:09.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:09.363+0000 7f8dee439640 1 -- 172.21.15.53:0/1883676068 wait complete. 2023-06-10T19:06:09.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:09.363+0000 7f8dee439640 1 Processor -- start 2023-06-10T19:06:09.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:09.363+0000 7f8dee439640 1 -- start start 2023-06-10T19:06:09.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:09.363+0000 7f8dee439640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8de806b780 0x7f8de814f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:09.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:09.363+0000 7f8dee439640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8de806bb50 0x7f8de8156a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:09.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:09.363+0000 7f8dee439640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8de80ceb20 0x7f8de80b0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:09.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:09.363+0000 7f8dee439640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8de814f790 con 0x7f8de80ceb20 2023-06-10T19:06:09.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:09.363+0000 7f8dee439640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8de80acdb0 con 0x7f8de806b780 2023-06-10T19:06:09.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:09.363+0000 7f8dee439640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8de8152130 con 0x7f8de806bb50 2023-06-10T19:06:09.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:09.363+0000 7f8dec9d6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8de80ceb20 0x7f8de80b0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:09.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:09.363+0000 7f8dec9d6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8de80ceb20 0x7f8de80b0a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49518/0 (socket says 172.21.15.53:49518) 2023-06-10T19:06:09.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:09.363+0000 7f8dec9d6640 1 -- 172.21.15.53:0/878760132 learned_addr learned my addr 172.21.15.53:0/878760132 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:09.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:09.363+0000 7f8de7fff640 1 --2- 172.21.15.53:0/878760132 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8de806b780 0x7f8de814f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:09.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:09.363+0000 7f8ddffff640 1 --2- 172.21.15.53:0/878760132 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8de806bb50 0x7f8de8156a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:09.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:09.363+0000 7f8dec9d6640 1 -- 172.21.15.53:0/878760132 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8de806bb50 msgr2=0x7f8de8156a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:09.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:09.363+0000 7f8dec9d6640 1 --2- 172.21.15.53:0/878760132 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8de806bb50 0x7f8de8156a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:09.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:09.363+0000 7f8dec9d6640 1 -- 172.21.15.53:0/878760132 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8de806b780 msgr2=0x7f8de814f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:09.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:09.363+0000 7f8dec9d6640 1 --2- 172.21.15.53:0/878760132 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8de806b780 0x7f8de814f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:09.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:09.363+0000 7f8dec9d6640 1 -- 172.21.15.53:0/878760132 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dd8009420 con 0x7f8de80ceb20 2023-06-10T19:06:09.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:09.363+0000 7f8de7fff640 1 --2- 172.21.15.53:0/878760132 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8de806b780 0x7f8de814f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:06:09.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:09.363+0000 7f8ddffff640 1 --2- 172.21.15.53:0/878760132 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8de806bb50 0x7f8de8156a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:06:09.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:09.363+0000 7f8dec9d6640 1 --2- 172.21.15.53:0/878760132 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8de80ceb20 0x7f8de80b0a90 secure :-1 s=READY pgs=2086 cs=0 l=1 rev1=1 crypto rx=0x7f8de000cef0 tx=0x7f8de000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:09.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:09.363+0000 7f8de57fa640 1 -- 172.21.15.53:0/878760132 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de000d840 con 0x7f8de80ceb20 2023-06-10T19:06:09.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:09.363+0000 7f8de57fa640 1 -- 172.21.15.53:0/878760132 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8de000d9c0 con 0x7f8de80ceb20 2023-06-10T19:06:09.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:09.363+0000 7f8dee439640 1 -- 172.21.15.53:0/878760132 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8de8152410 con 0x7f8de80ceb20 2023-06-10T19:06:09.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:09.363+0000 7f8de57fa640 1 -- 172.21.15.53:0/878760132 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de000dd70 con 0x7f8de80ceb20 2023-06-10T19:06:09.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:09.367+0000 7f8dee439640 1 -- 172.21.15.53:0/878760132 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8de81529d0 con 0x7f8de80ceb20 2023-06-10T19:06:09.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:09.367+0000 7f8dee439640 1 -- 172.21.15.53:0/878760132 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8de80acc10 con 0x7f8de80ceb20 2023-06-10T19:06:09.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:09.367+0000 7f8de57fa640 1 -- 172.21.15.53:0/878760132 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8de001e3b0 con 0x7f8de80ceb20 2023-06-10T19:06:09.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:09.367+0000 7f8de57fa640 1 --2- 172.21.15.53:0/878760132 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8dc80662d0 0x7f8dc8068780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:09.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:09.367+0000 7f8de57fa640 1 -- 172.21.15.53:0/878760132 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f8de0084720 con 0x7f8de80ceb20 2023-06-10T19:06:09.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:09.367+0000 7f8de7fff640 1 --2- 172.21.15.53:0/878760132 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8dc80662d0 0x7f8dc8068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:09.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:09.367+0000 7f8de7fff640 1 --2- 172.21.15.53:0/878760132 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8dc80662d0 0x7f8dc8068780 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f8dd80ad000 tx=0x7f8dd8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:09.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:09.371+0000 7f8de57fa640 1 -- 172.21.15.53:0/878760132 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8de80acc10 con 0x7f8de80ceb20 2023-06-10T19:06:09.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:09.559+0000 7f8dee439640 1 -- 172.21.15.53:0/878760132 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8de80acc10 con 0x7f8de80ceb20 2023-06-10T19:06:09.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:09.559+0000 7f8de57fa640 1 -- 172.21.15.53:0/878760132 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) v1 ==== 94+0+4678 (secure 0 0 0) 0x7f8de80acc10 con 0x7f8de80ceb20 2023-06-10T19:06:09.561 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:06:09.561 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":81,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8125,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3512570304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3512570304},{"type":"v1","addr":"172.21.15.117:6835","nonce":3512570304}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78},{"gid":8128,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/325110995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":325110995},{"type":"v1","addr":"172.21.15.117:6837","nonce":325110995}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78},{"gid":9759,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/2776844045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2776844045},{"type":"v1","addr":"172.21.15.53:6833","nonce":2776844045}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:05:50.789763+0000","modified":"2023-06-10T19:06:09.123261+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":139,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9780},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9780":{"gid":9780,"name":"c","rank":0,"incarnation":78,"state":"up:active","state_seq":4,"addr":"172.21.15.53:6835/2721536857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2721536857},{"type":"v1","addr":"172.21.15.53:6835","nonce":2721536857}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-06-10T19:06:09.561 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 81 2023-06-10T19:06:09.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:09.563+0000 7f8dee439640 1 -- 172.21.15.53:0/878760132 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8dc80662d0 msgr2=0x7f8dc8068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:09.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:09.563+0000 7f8dee439640 1 --2- 172.21.15.53:0/878760132 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8dc80662d0 0x7f8dc8068780 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f8dd80ad000 tx=0x7f8dd8008040 comp rx=0 tx=0).stop 2023-06-10T19:06:09.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:09.563+0000 7f8dee439640 1 -- 172.21.15.53:0/878760132 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8de80ceb20 msgr2=0x7f8de80b0a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:09.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:09.563+0000 7f8dee439640 1 --2- 172.21.15.53:0/878760132 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8de80ceb20 0x7f8de80b0a90 secure :-1 s=READY pgs=2086 cs=0 l=1 rev1=1 crypto rx=0x7f8de000cef0 tx=0x7f8de000a710 comp rx=0 tx=0).stop 2023-06-10T19:06:09.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:09.563+0000 7f8dee439640 1 -- 172.21.15.53:0/878760132 shutdown_connections 2023-06-10T19:06:09.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:09.563+0000 7f8dee439640 1 --2- 172.21.15.53:0/878760132 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8dc80662d0 0x7f8dc8068780 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:09.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:09.563+0000 7f8dee439640 1 --2- 172.21.15.53:0/878760132 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8de80ceb20 0x7f8de80b0a90 unknown :-1 s=CLOSED pgs=2086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:09.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:09.563+0000 7f8dee439640 1 --2- 172.21.15.53:0/878760132 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8de806bb50 0x7f8de8156a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:09.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:09.563+0000 7f8dee439640 1 --2- 172.21.15.53:0/878760132 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8de806b780 0x7f8de814f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:09.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:09.563+0000 7f8dee439640 1 -- 172.21.15.53:0/878760132 >> 172.21.15.53:0/878760132 conn(0x7f8de806a090 msgr2=0x7f8de80af750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:09.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:09.563+0000 7f8dee439640 1 -- 172.21.15.53:0/878760132 shutdown_connections 2023-06-10T19:06:09.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:09.563+0000 7f8dee439640 1 -- 172.21.15.53:0/878760132 wait complete. 2023-06-10T19:06:09.581 DEBUG:tasks.cephfs.filesystem:mapped states ['up:active'] to up:active 2023-06-10T19:06:09.581 DEBUG:tasks.cephfs.filesystem:reached state 'up:active' in 4.396763324737549s 2023-06-10T19:06:09.581 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T19:06:09.582 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:06:09.588 INFO:tasks.cephfs.mount:check lock on file background_file 2023-06-10T19:06:09.589 DEBUG:teuthology.orchestra.run.smithi117:> python3 -c ' 2023-06-10T19:06:09.589 DEBUG:teuthology.orchestra.run.smithi117:> import fcntl 2023-06-10T19:06:09.590 DEBUG:teuthology.orchestra.run.smithi117:> import errno 2023-06-10T19:06:09.590 DEBUG:teuthology.orchestra.run.smithi117:> import struct 2023-06-10T19:06:09.590 DEBUG:teuthology.orchestra.run.smithi117:> f1 = open("/home/ubuntu/cephtest/mnt.1/background_file-1", '"'"'r'"'"') 2023-06-10T19:06:09.591 DEBUG:teuthology.orchestra.run.smithi117:> try: 2023-06-10T19:06:09.591 DEBUG:teuthology.orchestra.run.smithi117:> fcntl.flock(f1, fcntl.LOCK_EX | fcntl.LOCK_NB) 2023-06-10T19:06:09.591 DEBUG:teuthology.orchestra.run.smithi117:> except IOError as e: 2023-06-10T19:06:09.591 DEBUG:teuthology.orchestra.run.smithi117:> if e.errno == errno.EAGAIN: 2023-06-10T19:06:09.592 DEBUG:teuthology.orchestra.run.smithi117:> pass 2023-06-10T19:06:09.592 DEBUG:teuthology.orchestra.run.smithi117:> else: 2023-06-10T19:06:09.592 DEBUG:teuthology.orchestra.run.smithi117:> raise RuntimeError("flock on file /home/ubuntu/cephtest/mnt.1/background_file-1 not found") 2023-06-10T19:06:09.593 DEBUG:teuthology.orchestra.run.smithi117:> f2 = open("/home/ubuntu/cephtest/mnt.1/background_file-2", '"'"'r'"'"') 2023-06-10T19:06:09.593 DEBUG:teuthology.orchestra.run.smithi117:> try: 2023-06-10T19:06:09.593 DEBUG:teuthology.orchestra.run.smithi117:> lockdata = struct.pack('"'"'hhllhh'"'"', fcntl.F_WRLCK, 0, 0, 0, 0, 0) 2023-06-10T19:06:09.593 DEBUG:teuthology.orchestra.run.smithi117:> fcntl.fcntl(f2, fcntl.F_SETLK, lockdata) 2023-06-10T19:06:09.594 DEBUG:teuthology.orchestra.run.smithi117:> except IOError as e: 2023-06-10T19:06:09.594 DEBUG:teuthology.orchestra.run.smithi117:> if e.errno == errno.EAGAIN: 2023-06-10T19:06:09.594 DEBUG:teuthology.orchestra.run.smithi117:> pass 2023-06-10T19:06:09.594 DEBUG:teuthology.orchestra.run.smithi117:> else: 2023-06-10T19:06:09.595 DEBUG:teuthology.orchestra.run.smithi117:> raise RuntimeError("posix lock on file /home/ubuntu/cephtest/mnt.1/background_file-2 not found") 2023-06-10T19:06:09.595 DEBUG:teuthology.orchestra.run.smithi117:> ' 2023-06-10T19:06:09.704 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-06-10T19:06:09.705 DEBUG:teuthology.orchestra.run.smithi053:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-06-10T19:06:09.796 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-06-10T19:06:09.849 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-06-10T19:06:09.849 INFO:tasks.cephfs.mount:Terminating background process 2023-06-10T19:06:09.850 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T19:06:09.850 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:06:09.856 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:06:10.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.031+0000 7fc94f9d1640 1 Processor -- start 2023-06-10T19:06:10.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.031+0000 7fc94f9d1640 1 -- start start 2023-06-10T19:06:10.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.031+0000 7fc94f9d1640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc9480b06d0 0x7fc94806a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:10.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.031+0000 7fc94f9d1640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc94806ae70 con 0x7fc94815b870 2023-06-10T19:06:10.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.031+0000 7fc94f9d1640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9480655c0 con 0x7fc94815f450 2023-06-10T19:06:10.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.031+0000 7fc94f9d1640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9480cc110 con 0x7fc9480b06d0 2023-06-10T19:06:10.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.031+0000 7fc94d76d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fc94815b870 0x7fc9480affc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56870/0 (socket says 172.21.15.53:56870) 2023-06-10T19:06:10.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.031+0000 7fc94d76d640 1 -- 172.21.15.53:0/2307038257 learned_addr learned my addr 172.21.15.53:0/2307038257 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:06:10.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.031+0000 7fc94cf6c640 1 --2- 172.21.15.53:0/2307038257 >> v2:172.21.15.117:3300/0 conn(0x7fc9480b06d0 0x7fc94806a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:10.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.031+0000 7fc93bfff640 1 -- 172.21.15.53:0/2307038257 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 139413982 0 0) 0x7fc9400014a0 con 0x7fc94815b870 2023-06-10T19:06:10.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.031+0000 7fc93bfff640 1 -- 172.21.15.53:0/2307038257 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc934003530 con 0x7fc94815b870 2023-06-10T19:06:10.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.031+0000 7fc93bfff640 1 -- 172.21.15.53:0/2307038257 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3993647334 0 0) 0x7fc934003530 con 0x7fc94815b870 2023-06-10T19:06:10.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.031+0000 7fc93bfff640 1 -- 172.21.15.53:0/2307038257 >> v2:172.21.15.117:3300/0 conn(0x7fc9480b06d0 msgr2=0x7fc94806a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:10.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.031+0000 7fc93bfff640 1 --2- 172.21.15.53:0/2307038257 >> v2:172.21.15.117:3300/0 conn(0x7fc9480b06d0 0x7fc94806a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:10.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.031+0000 7fc93bfff640 1 -- 172.21.15.53:0/2307038257 >> v1:172.21.15.117:6789/0 conn(0x7fc94815f450 legacy=0x7fc94815f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:10.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.031+0000 7fc93bfff640 1 -- 172.21.15.53:0/2307038257 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9480cc3f0 con 0x7fc94815b870 2023-06-10T19:06:10.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.031+0000 7fc93bfff640 1 -- 172.21.15.53:0/2307038257 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fc940001b90 con 0x7fc94815b870 2023-06-10T19:06:10.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.031+0000 7fc93bfff640 1 -- 172.21.15.53:0/2307038257 >> v1:172.21.15.53:6789/0 conn(0x7fc94815b870 legacy=0x7fc9480affc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:10.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.031+0000 7fc93bfff640 1 --2- 172.21.15.53:0/2307038257 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9340039f0 0x7fc934003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:10.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.031+0000 7fc93bfff640 1 --2- 172.21.15.53:0/2307038257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9340047d0 0x7fc934004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:10.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.031+0000 7fc93bfff640 1 --2- 172.21.15.53:0/2307038257 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9340052a0 0x7fc93400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:10.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.031+0000 7fc93bfff640 1 -- 172.21.15.53:0/2307038257 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9480cc110 con 0x7fc9340047d0 2023-06-10T19:06:10.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.031+0000 7fc93bfff640 1 -- 172.21.15.53:0/2307038257 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc93400c1b0 con 0x7fc9340039f0 2023-06-10T19:06:10.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.031+0000 7fc93bfff640 1 -- 172.21.15.53:0/2307038257 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc93400c370 con 0x7fc9340052a0 2023-06-10T19:06:10.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.031+0000 7fc94cf6c640 1 --2- 172.21.15.53:0/2307038257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9340047d0 0x7fc934004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:10.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.031+0000 7fc94d76d640 1 --2- 172.21.15.53:0/2307038257 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9340039f0 0x7fc934003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:10.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.031+0000 7fc94df6e640 1 --2- 172.21.15.53:0/2307038257 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9340052a0 0x7fc93400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:10.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.031+0000 7fc94cf6c640 1 -- 172.21.15.53:0/2307038257 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9340052a0 msgr2=0x7fc93400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:10.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.031+0000 7fc94cf6c640 1 --2- 172.21.15.53:0/2307038257 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9340052a0 0x7fc93400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:10.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.031+0000 7fc94cf6c640 1 -- 172.21.15.53:0/2307038257 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9340039f0 msgr2=0x7fc934003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:10.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.031+0000 7fc94cf6c640 1 --2- 172.21.15.53:0/2307038257 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9340039f0 0x7fc934003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:10.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.031+0000 7fc94cf6c640 1 -- 172.21.15.53:0/2307038257 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc934003530 con 0x7fc9340047d0 2023-06-10T19:06:10.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.031+0000 7fc94df6e640 1 --2- 172.21.15.53:0/2307038257 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9340052a0 0x7fc93400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:06:10.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.035+0000 7fc94df6e640 1 -- 172.21.15.53:0/2307038257 reap_dead start 2023-06-10T19:06:10.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.035+0000 7fc94cf6c640 1 --2- 172.21.15.53:0/2307038257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9340047d0 0x7fc934004c40 secure :-1 s=READY pgs=2088 cs=0 l=1 rev1=1 crypto rx=0x7fc93c009ab0 tx=0x7fc93c01ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61be953ac775beea server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:10.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.035+0000 7fc93bfff640 1 -- 172.21.15.53:0/2307038257 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc93c0a64f0 con 0x7fc9340047d0 2023-06-10T19:06:10.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.035+0000 7fc93bfff640 1 -- 172.21.15.53:0/2307038257 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc93c0a6650 con 0x7fc9340047d0 2023-06-10T19:06:10.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.035+0000 7fc93bfff640 1 -- 172.21.15.53:0/2307038257 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc93c0a6a00 con 0x7fc9340047d0 2023-06-10T19:06:10.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.035+0000 7fc94f9d1640 1 -- 172.21.15.53:0/2307038257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9340047d0 msgr2=0x7fc934004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:10.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.035+0000 7fc94f9d1640 1 --2- 172.21.15.53:0/2307038257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9340047d0 0x7fc934004c40 secure :-1 s=READY pgs=2088 cs=0 l=1 rev1=1 crypto rx=0x7fc93c009ab0 tx=0x7fc93c01ca00 comp rx=0 tx=0).stop 2023-06-10T19:06:10.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.035+0000 7fc94f9d1640 1 -- 172.21.15.53:0/2307038257 shutdown_connections 2023-06-10T19:06:10.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.035+0000 7fc94f9d1640 1 --2- 172.21.15.53:0/2307038257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9340047d0 0x7fc934004c40 unknown :-1 s=CLOSED pgs=2088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:10.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.035+0000 7fc94f9d1640 1 -- 172.21.15.53:0/2307038257 >> 172.21.15.53:0/2307038257 conn(0x7fc9480cafc0 msgr2=0x7fc9480cb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:10.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.035+0000 7fc94f9d1640 1 -- 172.21.15.53:0/2307038257 shutdown_connections 2023-06-10T19:06:10.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.035+0000 7fc94f9d1640 1 -- 172.21.15.53:0/2307038257 wait complete. 2023-06-10T19:06:10.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.039+0000 7fc94f9d1640 1 Processor -- start 2023-06-10T19:06:10.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.039+0000 7fc94f9d1640 1 -- start start 2023-06-10T19:06:10.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.039+0000 7fc94f9d1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9340047d0 0x7fc9480b1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:10.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.039+0000 7fc94f9d1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9480ca0d0 0x7fc94815bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:10.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.039+0000 7fc94f9d1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9480ca540 0x7fc948155f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:10.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.039+0000 7fc94f9d1640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc94815c6e0 con 0x7fc9480ca540 2023-06-10T19:06:10.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.039+0000 7fc94f9d1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc94815c9c0 con 0x7fc9480ca0d0 2023-06-10T19:06:10.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.039+0000 7fc94f9d1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc94815cca0 con 0x7fc9340047d0 2023-06-10T19:06:10.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.039+0000 7fc94df6e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9480ca540 0x7fc948155f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:10.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.039+0000 7fc94df6e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9480ca540 0x7fc948155f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49540/0 (socket says 172.21.15.53:49540) 2023-06-10T19:06:10.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.039+0000 7fc94df6e640 1 -- 172.21.15.53:0/397487049 learned_addr learned my addr 172.21.15.53:0/397487049 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:10.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.039+0000 7fc94cf6c640 1 --2- 172.21.15.53:0/397487049 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9480ca0d0 0x7fc94815bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:10.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.039+0000 7fc94d76d640 1 --2- 172.21.15.53:0/397487049 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9340047d0 0x7fc9480b1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:10.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.039+0000 7fc94df6e640 1 -- 172.21.15.53:0/397487049 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9340047d0 msgr2=0x7fc9480b1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:10.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.039+0000 7fc94df6e640 1 --2- 172.21.15.53:0/397487049 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9340047d0 0x7fc9480b1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:10.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.039+0000 7fc94df6e640 1 -- 172.21.15.53:0/397487049 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9480ca0d0 msgr2=0x7fc94815bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:10.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.039+0000 7fc94df6e640 1 --2- 172.21.15.53:0/397487049 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9480ca0d0 0x7fc94815bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:10.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.039+0000 7fc94df6e640 1 -- 172.21.15.53:0/397487049 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc94815cf80 con 0x7fc9480ca540 2023-06-10T19:06:10.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.039+0000 7fc94df6e640 1 --2- 172.21.15.53:0/397487049 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9480ca540 0x7fc948155f50 secure :-1 s=READY pgs=2089 cs=0 l=1 rev1=1 crypto rx=0x7fc9480b1090 tx=0x7fc94400d4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:10.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.039+0000 7fc939ffb640 1 -- 172.21.15.53:0/397487049 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9440052d0 con 0x7fc9480ca540 2023-06-10T19:06:10.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.039+0000 7fc939ffb640 1 -- 172.21.15.53:0/397487049 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc944005430 con 0x7fc9480ca540 2023-06-10T19:06:10.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.039+0000 7fc939ffb640 1 -- 172.21.15.53:0/397487049 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc94400dc20 con 0x7fc9480ca540 2023-06-10T19:06:10.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.039+0000 7fc94f9d1640 1 -- 172.21.15.53:0/397487049 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc94815d260 con 0x7fc9480ca540 2023-06-10T19:06:10.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.039+0000 7fc94f9d1640 1 -- 172.21.15.53:0/397487049 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9480b20a0 con 0x7fc9480ca540 2023-06-10T19:06:10.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.039+0000 7fc94f9d1640 1 -- 172.21.15.53:0/397487049 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc94804d790 con 0x7fc9480ca540 2023-06-10T19:06:10.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.039+0000 7fc939ffb640 1 -- 172.21.15.53:0/397487049 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc94400dd80 con 0x7fc9480ca540 2023-06-10T19:06:10.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.039+0000 7fc939ffb640 1 --2- 172.21.15.53:0/397487049 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc92c0662b0 0x7fc92c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:10.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.043+0000 7fc939ffb640 1 -- 172.21.15.53:0/397487049 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6148+0+0 (secure 0 0 0) 0x7fc944082850 con 0x7fc9480ca540 2023-06-10T19:06:10.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.043+0000 7fc94d76d640 1 --2- 172.21.15.53:0/397487049 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc92c0662b0 0x7fc92c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:10.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.043+0000 7fc94d76d640 1 --2- 172.21.15.53:0/397487049 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc92c0662b0 0x7fc92c068760 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fc9400020f0 tx=0x7fc940009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:10.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.047+0000 7fc939ffb640 1 -- 172.21.15.53:0/397487049 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc94404fd20 con 0x7fc9480ca540 2023-06-10T19:06:10.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.203+0000 7fc94f9d1640 1 -- 172.21.15.53:0/397487049 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc9480b44c0 con 0x7fc9480ca540 2023-06-10T19:06:10.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.203+0000 7fc939ffb640 1 -- 172.21.15.53:0/397487049 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v142) v1 ==== 74+0+18426 (secure 0 0 0) 0x7fc944053340 con 0x7fc9480ca540 2023-06-10T19:06:10.205 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:06:10.205 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":142,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:06:04.229769+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-06-10T19:05:48.449837+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-06-10T19:05:49.783728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.53:6835/1171476971":"2023-06-11T19:06:04.182476+0000","172.21.15.53:6834/1171476971":"2023-06-11T19:06:04.182476+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:06:10.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.207+0000 7fc94f9d1640 1 -- 172.21.15.53:0/397487049 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc92c0662b0 msgr2=0x7fc92c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:10.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.207+0000 7fc94f9d1640 1 --2- 172.21.15.53:0/397487049 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc92c0662b0 0x7fc92c068760 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fc9400020f0 tx=0x7fc940009040 comp rx=0 tx=0).stop 2023-06-10T19:06:10.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.207+0000 7fc94f9d1640 1 -- 172.21.15.53:0/397487049 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9480ca540 msgr2=0x7fc948155f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:10.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.207+0000 7fc94f9d1640 1 --2- 172.21.15.53:0/397487049 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9480ca540 0x7fc948155f50 secure :-1 s=READY pgs=2089 cs=0 l=1 rev1=1 crypto rx=0x7fc9480b1090 tx=0x7fc94400d4c0 comp rx=0 tx=0).stop 2023-06-10T19:06:10.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.207+0000 7fc94f9d1640 1 -- 172.21.15.53:0/397487049 shutdown_connections 2023-06-10T19:06:10.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.207+0000 7fc94f9d1640 1 --2- 172.21.15.53:0/397487049 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc92c0662b0 0x7fc92c068760 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:10.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.207+0000 7fc94f9d1640 1 --2- 172.21.15.53:0/397487049 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9480ca540 0x7fc948155f50 unknown :-1 s=CLOSED pgs=2089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:10.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.207+0000 7fc94f9d1640 1 --2- 172.21.15.53:0/397487049 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9480ca0d0 0x7fc94815bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:10.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.207+0000 7fc94f9d1640 1 --2- 172.21.15.53:0/397487049 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9340047d0 0x7fc9480b1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:10.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.207+0000 7fc94f9d1640 1 -- 172.21.15.53:0/397487049 >> 172.21.15.53:0/397487049 conn(0x7fc9480cafc0 msgr2=0x7fc9480cb390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:10.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.207+0000 7fc94f9d1640 1 -- 172.21.15.53:0/397487049 shutdown_connections 2023-06-10T19:06:10.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.207+0000 7fc94f9d1640 1 -- 172.21.15.53:0/397487049 wait complete. 2023-06-10T19:06:10.223 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-10T18:52:33.633114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-10T18:52:39.171487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 19, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-10T19:05:48.449837+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '137', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 20, 'pool_name': 'cephfs_data', 'create_time': '2023-06-10T19:05:49.783728+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '138', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-10T19:06:10.224 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-10T19:06:10.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.343+0000 7fb70114a640 1 Processor -- start 2023-06-10T19:06:10.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.343+0000 7fb70114a640 1 -- start start 2023-06-10T19:06:10.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.343+0000 7fb70114a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb6fc15c060 0x7fb6fc0cc020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:10.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.343+0000 7fb70114a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb6fc15cb40 0x7fb6fc06bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:10.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.343+0000 7fb70114a640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6fc15cf80 con 0x7fb6fc070de0 2023-06-10T19:06:10.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.343+0000 7fb70114a640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6fc0c8d50 con 0x7fb6fc15cb40 2023-06-10T19:06:10.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.343+0000 7fb70114a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6fc0c9030 con 0x7fb6fc15c060 2023-06-10T19:06:10.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.343+0000 7fb6fa59c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fb6fc070de0 0x7fb6fc15c430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56872/0 (socket says 172.21.15.53:56872) 2023-06-10T19:06:10.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.343+0000 7fb6fa59c640 1 -- 172.21.15.53:0/3837682190 learned_addr learned my addr 172.21.15.53:0/3837682190 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:06:10.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.343+0000 7fb6f9d9b640 1 -- 172.21.15.53:0/3837682190 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2160760787 0 0) 0x7fb6fc15cf80 con 0x7fb6fc070de0 2023-06-10T19:06:10.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.343+0000 7fb6f9d9b640 1 -- 172.21.15.53:0/3837682190 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6e4003530 con 0x7fb6fc070de0 2023-06-10T19:06:10.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.343+0000 7fb6fb59e640 1 --2- 172.21.15.53:0/3837682190 >> v2:172.21.15.117:3300/0 conn(0x7fb6fc15cb40 0x7fb6fc06bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:10.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.343+0000 7fb6fad9d640 1 --2- 172.21.15.53:0/3837682190 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb6fc15c060 0x7fb6fc0cc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:10.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.343+0000 7fb6f9d9b640 1 -- 172.21.15.53:0/3837682190 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1263030600 0 0) 0x7fb6e4003530 con 0x7fb6fc070de0 2023-06-10T19:06:10.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.343+0000 7fb6f9d9b640 1 -- 172.21.15.53:0/3837682190 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb6fc15c060 msgr2=0x7fb6fc0cc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:10.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.343+0000 7fb6f9d9b640 1 --2- 172.21.15.53:0/3837682190 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb6fc15c060 0x7fb6fc0cc020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:10.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.343+0000 7fb6f9d9b640 1 -- 172.21.15.53:0/3837682190 >> v2:172.21.15.117:3300/0 conn(0x7fb6fc15cb40 msgr2=0x7fb6fc06bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:10.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.343+0000 7fb6f9d9b640 1 --2- 172.21.15.53:0/3837682190 >> v2:172.21.15.117:3300/0 conn(0x7fb6fc15cb40 0x7fb6fc06bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:10.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.343+0000 7fb6f9d9b640 1 -- 172.21.15.53:0/3837682190 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6fc070300 con 0x7fb6fc070de0 2023-06-10T19:06:10.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.343+0000 7fb6f9d9b640 1 -- 172.21.15.53:0/3837682190 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fb6f0001680 con 0x7fb6fc070de0 2023-06-10T19:06:10.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.343+0000 7fb6fb59e640 1 --2- 172.21.15.53:0/3837682190 >> v2:172.21.15.117:3300/0 conn(0x7fb6fc15cb40 0x7fb6fc06bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:06:10.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.343+0000 7fb6f9d9b640 1 -- 172.21.15.53:0/3837682190 >> v1:172.21.15.53:6789/0 conn(0x7fb6fc070de0 legacy=0x7fb6fc15c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:10.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.343+0000 7fb6f9d9b640 1 --2- 172.21.15.53:0/3837682190 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6e4003980 0x7fb6e4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:10.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.343+0000 7fb6f9d9b640 1 --2- 172.21.15.53:0/3837682190 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb6e40047d0 0x7fb6e4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:10.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.343+0000 7fb6f9d9b640 1 --2- 172.21.15.53:0/3837682190 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb6e4005180 0x7fb6e400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:10.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.343+0000 7fb6f9d9b640 1 -- 172.21.15.53:0/3837682190 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6fc0c8d50 con 0x7fb6e4003980 2023-06-10T19:06:10.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.343+0000 7fb6f9d9b640 1 -- 172.21.15.53:0/3837682190 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6fc0c9030 con 0x7fb6e4005180 2023-06-10T19:06:10.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.343+0000 7fb6f9d9b640 1 -- 172.21.15.53:0/3837682190 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e400c030 con 0x7fb6e40047d0 2023-06-10T19:06:10.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.343+0000 7fb6fad9d640 1 --2- 172.21.15.53:0/3837682190 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb6fc15c060 0x7fb6fc0cc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:06:10.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.343+0000 7fb6fad9d640 1 --2- 172.21.15.53:0/3837682190 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6e4003980 0x7fb6e4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:10.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.343+0000 7fb6fb59e640 1 --2- 172.21.15.53:0/3837682190 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb6e4005180 0x7fb6e400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:10.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.343+0000 7fb6fa59c640 1 --2- 172.21.15.53:0/3837682190 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb6e40047d0 0x7fb6e4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:10.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.343+0000 7fb6fad9d640 1 -- 172.21.15.53:0/3837682190 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb6e40047d0 msgr2=0x7fb6e4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:10.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.343+0000 7fb6fad9d640 1 --2- 172.21.15.53:0/3837682190 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb6e40047d0 0x7fb6e4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:10.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.343+0000 7fb6fad9d640 1 -- 172.21.15.53:0/3837682190 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb6e4005180 msgr2=0x7fb6e400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:10.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.343+0000 7fb6fad9d640 1 --2- 172.21.15.53:0/3837682190 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb6e4005180 0x7fb6e400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:10.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.343+0000 7fb6fad9d640 1 -- 172.21.15.53:0/3837682190 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6e4003530 con 0x7fb6e4003980 2023-06-10T19:06:10.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.343+0000 7fb6fb59e640 1 --2- 172.21.15.53:0/3837682190 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb6e4005180 0x7fb6e400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:06:10.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.347+0000 7fb6fad9d640 1 --2- 172.21.15.53:0/3837682190 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6e4003980 0x7fb6e4003d90 secure :-1 s=READY pgs=2091 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc071d80 tx=0x7fb6ec01ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8576f11bf1c55a8a server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:10.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.347+0000 7fb6f9d9b640 1 -- 172.21.15.53:0/3837682190 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6ec003ba0 con 0x7fb6e4003980 2023-06-10T19:06:10.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.347+0000 7fb6f9d9b640 1 -- 172.21.15.53:0/3837682190 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6ec003d00 con 0x7fb6e4003980 2023-06-10T19:06:10.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.347+0000 7fb6f9d9b640 1 -- 172.21.15.53:0/3837682190 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6ec004250 con 0x7fb6e4003980 2023-06-10T19:06:10.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.347+0000 7fb70114a640 1 -- 172.21.15.53:0/3837682190 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6e4003980 msgr2=0x7fb6e4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:10.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.347+0000 7fb70114a640 1 --2- 172.21.15.53:0/3837682190 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6e4003980 0x7fb6e4003d90 secure :-1 s=READY pgs=2091 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc071d80 tx=0x7fb6ec01ccc0 comp rx=0 tx=0).stop 2023-06-10T19:06:10.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.347+0000 7fb6fb59e640 1 -- 172.21.15.53:0/3837682190 reap_dead start 2023-06-10T19:06:10.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.347+0000 7fb70114a640 1 -- 172.21.15.53:0/3837682190 shutdown_connections 2023-06-10T19:06:10.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.347+0000 7fb70114a640 1 -- 172.21.15.53:0/3837682190 >> 172.21.15.53:0/3837682190 conn(0x7fb6fc06a0e0 msgr2=0x7fb6fc0cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:10.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.347+0000 7fb70114a640 1 -- 172.21.15.53:0/3837682190 shutdown_connections 2023-06-10T19:06:10.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.347+0000 7fb70114a640 1 -- 172.21.15.53:0/3837682190 wait complete. 2023-06-10T19:06:10.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.347+0000 7fb70114a640 1 Processor -- start 2023-06-10T19:06:10.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.347+0000 7fb70114a640 1 -- start start 2023-06-10T19:06:10.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.351+0000 7fb70114a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6e4003980 0x7fb6fc0ad8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:10.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.351+0000 7fb70114a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb6fc0c1950 0x7fb6fc14d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:10.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.351+0000 7fb70114a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb6fc0c55c0 0x7fb6fc150fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:10.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.351+0000 7fb70114a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6fc0ae530 con 0x7fb6e4003980 2023-06-10T19:06:10.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.351+0000 7fb70114a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6fc0adf70 con 0x7fb6fc0c55c0 2023-06-10T19:06:10.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.351+0000 7fb70114a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6fc0ae250 con 0x7fb6fc0c1950 2023-06-10T19:06:10.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.351+0000 7fb6fad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6e4003980 0x7fb6fc0ad8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:10.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.351+0000 7fb6fad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6e4003980 0x7fb6fc0ad8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49564/0 (socket says 172.21.15.53:49564) 2023-06-10T19:06:10.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.351+0000 7fb6fad9d640 1 -- 172.21.15.53:0/3656762755 learned_addr learned my addr 172.21.15.53:0/3656762755 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:10.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.351+0000 7fb6fb59e640 1 --2- 172.21.15.53:0/3656762755 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb6fc0c55c0 0x7fb6fc150fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:10.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.351+0000 7fb6fa59c640 1 --2- 172.21.15.53:0/3656762755 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb6fc0c1950 0x7fb6fc14d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:10.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.351+0000 7fb6fad9d640 1 -- 172.21.15.53:0/3656762755 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb6fc0c1950 msgr2=0x7fb6fc14d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:10.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.351+0000 7fb6fad9d640 1 --2- 172.21.15.53:0/3656762755 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb6fc0c1950 0x7fb6fc14d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:10.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.351+0000 7fb6fad9d640 1 -- 172.21.15.53:0/3656762755 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb6fc0c55c0 msgr2=0x7fb6fc150fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:10.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.351+0000 7fb6fad9d640 1 --2- 172.21.15.53:0/3656762755 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb6fc0c55c0 0x7fb6fc150fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:10.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.351+0000 7fb6fad9d640 1 -- 172.21.15.53:0/3656762755 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6fc0c4dc0 con 0x7fb6e4003980 2023-06-10T19:06:10.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.351+0000 7fb6fb59e640 1 --2- 172.21.15.53:0/3656762755 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb6fc0c55c0 0x7fb6fc150fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:06:10.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.351+0000 7fb6fad9d640 1 --2- 172.21.15.53:0/3656762755 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6e4003980 0x7fb6fc0ad8b0 secure :-1 s=READY pgs=2092 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec01caf0 tx=0x7fb6e4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:10.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.351+0000 7fb6e37fe640 1 -- 172.21.15.53:0/3656762755 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6ec004690 con 0x7fb6e4003980 2023-06-10T19:06:10.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.351+0000 7fb6e37fe640 1 -- 172.21.15.53:0/3656762755 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6ec0047f0 con 0x7fb6e4003980 2023-06-10T19:06:10.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.351+0000 7fb6e37fe640 1 -- 172.21.15.53:0/3656762755 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6ec0a6720 con 0x7fb6e4003980 2023-06-10T19:06:10.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.351+0000 7fb70114a640 1 -- 172.21.15.53:0/3656762755 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6fc0c50a0 con 0x7fb6e4003980 2023-06-10T19:06:10.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.351+0000 7fb70114a640 1 -- 172.21.15.53:0/3656762755 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6fc14d730 con 0x7fb6e4003980 2023-06-10T19:06:10.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.351+0000 7fb70114a640 1 -- 172.21.15.53:0/3656762755 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6fc0c5260 con 0x7fb6e4003980 2023-06-10T19:06:10.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.351+0000 7fb6e37fe640 1 -- 172.21.15.53:0/3656762755 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb6ec0a6880 con 0x7fb6e4003980 2023-06-10T19:06:10.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.351+0000 7fb6e37fe640 1 --2- 172.21.15.53:0/3656762755 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb6e80662b0 0x7fb6e8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:10.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.351+0000 7fb6e37fe640 1 -- 172.21.15.53:0/3656762755 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6148+0+0 (secure 0 0 0) 0x7fb6ec11dd30 con 0x7fb6e4003980 2023-06-10T19:06:10.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.351+0000 7fb6fa59c640 1 --2- 172.21.15.53:0/3656762755 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb6e80662b0 0x7fb6e8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:10.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.355+0000 7fb6fa59c640 1 --2- 172.21.15.53:0/3656762755 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb6e80662b0 0x7fb6e8068760 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fb6f0001060 tx=0x7fb6f0000ff0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:10.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.355+0000 7fb6e37fe640 1 -- 172.21.15.53:0/3656762755 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb6ec0eb200 con 0x7fb6e4003980 2023-06-10T19:06:10.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.511+0000 7fb70114a640 1 -- 172.21.15.53:0/3656762755 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb6fc04d790 con 0x7fb6e4003980 2023-06-10T19:06:10.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.515+0000 7fb6e37fe640 1 -- 172.21.15.53:0/3656762755 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v142) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb6ec0ee820 con 0x7fb6e4003980 2023-06-10T19:06:10.515 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-06-10T19:06:10.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.515+0000 7fb70114a640 1 -- 172.21.15.53:0/3656762755 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb6e80662b0 msgr2=0x7fb6e8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:10.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.515+0000 7fb70114a640 1 --2- 172.21.15.53:0/3656762755 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb6e80662b0 0x7fb6e8068760 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fb6f0001060 tx=0x7fb6f0000ff0 comp rx=0 tx=0).stop 2023-06-10T19:06:10.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.515+0000 7fb70114a640 1 -- 172.21.15.53:0/3656762755 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6e4003980 msgr2=0x7fb6fc0ad8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:10.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.515+0000 7fb70114a640 1 --2- 172.21.15.53:0/3656762755 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6e4003980 0x7fb6fc0ad8b0 secure :-1 s=READY pgs=2092 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec01caf0 tx=0x7fb6e4005800 comp rx=0 tx=0).stop 2023-06-10T19:06:10.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.515+0000 7fb70114a640 1 -- 172.21.15.53:0/3656762755 shutdown_connections 2023-06-10T19:06:10.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.515+0000 7fb70114a640 1 --2- 172.21.15.53:0/3656762755 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb6e80662b0 0x7fb6e8068760 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:10.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.515+0000 7fb70114a640 1 --2- 172.21.15.53:0/3656762755 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb6fc0c55c0 0x7fb6fc150fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:10.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.515+0000 7fb70114a640 1 --2- 172.21.15.53:0/3656762755 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb6fc0c1950 0x7fb6fc14d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:10.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.515+0000 7fb70114a640 1 --2- 172.21.15.53:0/3656762755 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6e4003980 0x7fb6fc0ad8b0 unknown :-1 s=CLOSED pgs=2092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:10.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.515+0000 7fb70114a640 1 -- 172.21.15.53:0/3656762755 >> 172.21.15.53:0/3656762755 conn(0x7fb6fc06a0e0 msgr2=0x7fb6fc153630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:10.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.515+0000 7fb70114a640 1 -- 172.21.15.53:0/3656762755 shutdown_connections 2023-06-10T19:06:10.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.515+0000 7fb70114a640 1 -- 172.21.15.53:0/3656762755 wait complete. 2023-06-10T19:06:10.534 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-10T19:06:10.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.659+0000 7f0b528a3640 1 Processor -- start 2023-06-10T19:06:10.660 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.659+0000 7f0b528a3640 1 -- start start 2023-06-10T19:06:10.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.659+0000 7f0b528a3640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0b4c0b7e30 0x7f0b4c0b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:10.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.659+0000 7f0b528a3640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b4c0cc7c0 con 0x7f0b4c0b0b90 2023-06-10T19:06:10.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.659+0000 7f0b528a3640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b4c0ccaa0 con 0x7f0b4c15c090 2023-06-10T19:06:10.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.659+0000 7f0b528a3640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b4c0ccd80 con 0x7f0b4c0b7e30 2023-06-10T19:06:10.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.659+0000 7f0b50e40640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f0b4c0b0b90 0x7f0b4c0d04d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56888/0 (socket says 172.21.15.53:56888) 2023-06-10T19:06:10.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.659+0000 7f0b50e40640 1 -- 172.21.15.53:0/2686600475 learned_addr learned my addr 172.21.15.53:0/2686600475 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:06:10.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.659+0000 7f0b4b7fe640 1 --2- 172.21.15.53:0/2686600475 >> v2:172.21.15.117:3300/0 conn(0x7f0b4c0b7e30 0x7f0b4c0b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:10.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.659+0000 7f0b4affd640 1 -- 172.21.15.53:0/2686600475 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 80703362 0 0) 0x7f0b4c0cc7c0 con 0x7f0b4c0b0b90 2023-06-10T19:06:10.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.659+0000 7f0b4affd640 1 -- 172.21.15.53:0/2686600475 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b38003530 con 0x7f0b4c0b0b90 2023-06-10T19:06:10.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.659+0000 7f0b4affd640 1 -- 172.21.15.53:0/2686600475 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2095719085 0 0) 0x7f0b38003530 con 0x7f0b4c0b0b90 2023-06-10T19:06:10.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.659+0000 7f0b4affd640 1 -- 172.21.15.53:0/2686600475 >> v2:172.21.15.117:3300/0 conn(0x7f0b4c0b7e30 msgr2=0x7f0b4c0b10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:10.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.659+0000 7f0b4affd640 1 --2- 172.21.15.53:0/2686600475 >> v2:172.21.15.117:3300/0 conn(0x7f0b4c0b7e30 0x7f0b4c0b10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:10.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.659+0000 7f0b4affd640 1 -- 172.21.15.53:0/2686600475 >> v1:172.21.15.117:6789/0 conn(0x7f0b4c15c090 legacy=0x7f0b4c0b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:10.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.659+0000 7f0b4affd640 1 -- 172.21.15.53:0/2686600475 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b4c0cd060 con 0x7f0b4c0b0b90 2023-06-10T19:06:10.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.659+0000 7f0b4affd640 1 -- 172.21.15.53:0/2686600475 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f0b44001680 con 0x7f0b4c0b0b90 2023-06-10T19:06:10.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.659+0000 7f0b4affd640 1 -- 172.21.15.53:0/2686600475 >> v1:172.21.15.53:6789/0 conn(0x7f0b4c0b0b90 legacy=0x7f0b4c0d04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:10.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.659+0000 7f0b4affd640 1 --2- 172.21.15.53:0/2686600475 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b38003980 0x7f0b38003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:10.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.659+0000 7f0b4affd640 1 --2- 172.21.15.53:0/2686600475 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b380047d0 0x7f0b38004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:10.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.659+0000 7f0b4affd640 1 --2- 172.21.15.53:0/2686600475 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b38005180 0x7f0b3800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:10.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.659+0000 7f0b4affd640 1 -- 172.21.15.53:0/2686600475 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4c0ccd80 con 0x7f0b38005180 2023-06-10T19:06:10.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.659+0000 7f0b4affd640 1 -- 172.21.15.53:0/2686600475 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3800c090 con 0x7f0b380047d0 2023-06-10T19:06:10.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.659+0000 7f0b4affd640 1 -- 172.21.15.53:0/2686600475 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3800c250 con 0x7f0b38003980 2023-06-10T19:06:10.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.659+0000 7f0b50e40640 1 --2- 172.21.15.53:0/2686600475 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b38005180 0x7f0b3800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:10.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.659+0000 7f0b4bfff640 1 --2- 172.21.15.53:0/2686600475 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b38003980 0x7f0b38003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:10.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.659+0000 7f0b4b7fe640 1 --2- 172.21.15.53:0/2686600475 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b380047d0 0x7f0b38004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:10.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.659+0000 7f0b50e40640 1 -- 172.21.15.53:0/2686600475 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b38003980 msgr2=0x7f0b38003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:10.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.659+0000 7f0b50e40640 1 --2- 172.21.15.53:0/2686600475 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b38003980 0x7f0b38003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:10.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.659+0000 7f0b50e40640 1 -- 172.21.15.53:0/2686600475 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b380047d0 msgr2=0x7f0b38004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:10.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.659+0000 7f0b50e40640 1 --2- 172.21.15.53:0/2686600475 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b380047d0 0x7f0b38004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:10.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.659+0000 7f0b50e40640 1 -- 172.21.15.53:0/2686600475 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b38003530 con 0x7f0b38005180 2023-06-10T19:06:10.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.663+0000 7f0b50e40640 1 -- 172.21.15.53:0/2686600475 reap_dead start 2023-06-10T19:06:10.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.663+0000 7f0b50e40640 1 --2- 172.21.15.53:0/2686600475 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b38005180 0x7f0b3800b990 secure :-1 s=READY pgs=2094 cs=0 l=1 rev1=1 crypto rx=0x7f0b4400c240 tx=0x7f0b4401f3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20cf67fb9e2c31c server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:10.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.663+0000 7f0b4affd640 1 -- 172.21.15.53:0/2686600475 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b44005ae0 con 0x7f0b38005180 2023-06-10T19:06:10.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.663+0000 7f0b4affd640 1 -- 172.21.15.53:0/2686600475 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b440ab070 con 0x7f0b38005180 2023-06-10T19:06:10.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.663+0000 7f0b4affd640 1 -- 172.21.15.53:0/2686600475 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b44007070 con 0x7f0b38005180 2023-06-10T19:06:10.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.663+0000 7f0b528a3640 1 -- 172.21.15.53:0/2686600475 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b38005180 msgr2=0x7f0b3800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:10.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.663+0000 7f0b528a3640 1 --2- 172.21.15.53:0/2686600475 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b38005180 0x7f0b3800b990 secure :-1 s=READY pgs=2094 cs=0 l=1 rev1=1 crypto rx=0x7f0b4400c240 tx=0x7f0b4401f3b0 comp rx=0 tx=0).stop 2023-06-10T19:06:10.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.663+0000 7f0b528a3640 1 -- 172.21.15.53:0/2686600475 shutdown_connections 2023-06-10T19:06:10.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.663+0000 7f0b528a3640 1 --2- 172.21.15.53:0/2686600475 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b38005180 0x7f0b3800b990 unknown :-1 s=CLOSED pgs=2094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:10.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.663+0000 7f0b528a3640 1 -- 172.21.15.53:0/2686600475 >> 172.21.15.53:0/2686600475 conn(0x7f0b4c069e20 msgr2=0x7f0b4c06a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:10.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.663+0000 7f0b528a3640 1 -- 172.21.15.53:0/2686600475 shutdown_connections 2023-06-10T19:06:10.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.663+0000 7f0b528a3640 1 -- 172.21.15.53:0/2686600475 wait complete. 2023-06-10T19:06:10.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.663+0000 7f0b528a3640 1 Processor -- start 2023-06-10T19:06:10.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.663+0000 7f0b528a3640 1 -- start start 2023-06-10T19:06:10.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.667+0000 7f0b528a3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b38005180 0x7f0b4c0b6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:10.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.667+0000 7f0b528a3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b4c0c9210 0x7f0b4c0c9680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:10.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.667+0000 7f0b528a3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b4c153480 0x7f0b4c1538f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:10.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.667+0000 7f0b528a3640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4c153e30 con 0x7f0b38005180 2023-06-10T19:06:10.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.667+0000 7f0b528a3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4c0c9cd0 con 0x7f0b4c153480 2023-06-10T19:06:10.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.667+0000 7f0b528a3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4c0c9fb0 con 0x7f0b4c0c9210 2023-06-10T19:06:10.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.667+0000 7f0b4bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b38005180 0x7f0b4c0b6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:10.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.667+0000 7f0b4bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b38005180 0x7f0b4c0b6410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49586/0 (socket says 172.21.15.53:49586) 2023-06-10T19:06:10.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.667+0000 7f0b4bfff640 1 -- 172.21.15.53:0/2121869275 learned_addr learned my addr 172.21.15.53:0/2121869275 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:10.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.667+0000 7f0b4b7fe640 1 --2- 172.21.15.53:0/2121869275 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b4c0c9210 0x7f0b4c0c9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:10.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.667+0000 7f0b50e40640 1 --2- 172.21.15.53:0/2121869275 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b4c153480 0x7f0b4c1538f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:10.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.667+0000 7f0b4bfff640 1 -- 172.21.15.53:0/2121869275 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b4c0c9210 msgr2=0x7f0b4c0c9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:10.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.667+0000 7f0b4bfff640 1 --2- 172.21.15.53:0/2121869275 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b4c0c9210 0x7f0b4c0c9680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:10.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.667+0000 7f0b4bfff640 1 -- 172.21.15.53:0/2121869275 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b4c153480 msgr2=0x7f0b4c1538f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:10.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.667+0000 7f0b4bfff640 1 --2- 172.21.15.53:0/2121869275 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b4c153480 0x7f0b4c1538f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:10.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.667+0000 7f0b4bfff640 1 -- 172.21.15.53:0/2121869275 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b4c0ca290 con 0x7f0b38005180 2023-06-10T19:06:10.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.667+0000 7f0b50e40640 1 --2- 172.21.15.53:0/2121869275 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b4c153480 0x7f0b4c1538f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:06:10.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.667+0000 7f0b4bfff640 1 --2- 172.21.15.53:0/2121869275 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b38005180 0x7f0b4c0b6410 secure :-1 s=READY pgs=2095 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c00d8e0 tx=0x7f0b3c00dda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:10.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.667+0000 7f0b48ff9640 1 -- 172.21.15.53:0/2121869275 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b3c003db0 con 0x7f0b38005180 2023-06-10T19:06:10.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.667+0000 7f0b48ff9640 1 -- 172.21.15.53:0/2121869275 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b3c00b6b0 con 0x7f0b38005180 2023-06-10T19:06:10.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.667+0000 7f0b528a3640 1 -- 172.21.15.53:0/2121869275 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b4c0ca570 con 0x7f0b38005180 2023-06-10T19:06:10.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.667+0000 7f0b48ff9640 1 -- 172.21.15.53:0/2121869275 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b3c00ba40 con 0x7f0b38005180 2023-06-10T19:06:10.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.667+0000 7f0b528a3640 1 -- 172.21.15.53:0/2121869275 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b4c155e50 con 0x7f0b38005180 2023-06-10T19:06:10.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.667+0000 7f0b528a3640 1 -- 172.21.15.53:0/2121869275 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b4c0c6fc0 con 0x7f0b38005180 2023-06-10T19:06:10.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.667+0000 7f0b48ff9640 1 -- 172.21.15.53:0/2121869275 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0b3c00bba0 con 0x7f0b38005180 2023-06-10T19:06:10.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.667+0000 7f0b48ff9640 1 --2- 172.21.15.53:0/2121869275 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0b2c0662b0 0x7f0b2c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:10.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.667+0000 7f0b48ff9640 1 -- 172.21.15.53:0/2121869275 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f0b3c083fd0 con 0x7f0b38005180 2023-06-10T19:06:10.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.667+0000 7f0b4b7fe640 1 --2- 172.21.15.53:0/2121869275 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0b2c0662b0 0x7f0b2c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:10.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.671+0000 7f0b4b7fe640 1 --2- 172.21.15.53:0/2121869275 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0b2c0662b0 0x7f0b2c068760 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c0b6d00 tx=0x7f0b34008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:10.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.671+0000 7f0b48ff9640 1 -- 172.21.15.53:0/2121869275 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0b3c0513f0 con 0x7f0b38005180 2023-06-10T19:06:10.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.827+0000 7f0b528a3640 1 -- 172.21.15.53:0/2121869275 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0b4c0b1770 con 0x7f0b38005180 2023-06-10T19:06:10.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.827+0000 7f0b48ff9640 1 -- 172.21.15.53:0/2121869275 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v142) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0b3c054a10 con 0x7f0b38005180 2023-06-10T19:06:10.828 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-06-10T19:06:10.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.827+0000 7f0b528a3640 1 -- 172.21.15.53:0/2121869275 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0b2c0662b0 msgr2=0x7f0b2c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:10.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.827+0000 7f0b528a3640 1 --2- 172.21.15.53:0/2121869275 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0b2c0662b0 0x7f0b2c068760 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c0b6d00 tx=0x7f0b34008040 comp rx=0 tx=0).stop 2023-06-10T19:06:10.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.827+0000 7f0b528a3640 1 -- 172.21.15.53:0/2121869275 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b38005180 msgr2=0x7f0b4c0b6410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:10.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.827+0000 7f0b528a3640 1 --2- 172.21.15.53:0/2121869275 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b38005180 0x7f0b4c0b6410 secure :-1 s=READY pgs=2095 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c00d8e0 tx=0x7f0b3c00dda0 comp rx=0 tx=0).stop 2023-06-10T19:06:10.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.827+0000 7f0b528a3640 1 -- 172.21.15.53:0/2121869275 shutdown_connections 2023-06-10T19:06:10.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.827+0000 7f0b528a3640 1 --2- 172.21.15.53:0/2121869275 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0b2c0662b0 0x7f0b2c068760 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:10.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.827+0000 7f0b528a3640 1 --2- 172.21.15.53:0/2121869275 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b4c153480 0x7f0b4c1538f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:10.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.827+0000 7f0b528a3640 1 --2- 172.21.15.53:0/2121869275 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b4c0c9210 0x7f0b4c0c9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:10.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.827+0000 7f0b528a3640 1 --2- 172.21.15.53:0/2121869275 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b38005180 0x7f0b4c0b6410 unknown :-1 s=CLOSED pgs=2095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:10.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.827+0000 7f0b528a3640 1 -- 172.21.15.53:0/2121869275 >> 172.21.15.53:0/2121869275 conn(0x7f0b4c069e20 msgr2=0x7f0b4c0d0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:10.832 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.827+0000 7f0b528a3640 1 -- 172.21.15.53:0/2121869275 shutdown_connections 2023-06-10T19:06:10.832 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.827+0000 7f0b528a3640 1 -- 172.21.15.53:0/2121869275 wait complete. 2023-06-10T19:06:10.847 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-10T19:06:10.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.979+0000 7fd243050640 1 Processor -- start 2023-06-10T19:06:10.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.979+0000 7fd243050640 1 -- start start 2023-06-10T19:06:10.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.979+0000 7fd243050640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd23c0c97d0 0x7fd23c0cb820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:10.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.979+0000 7fd243050640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd23c0af760 0x7fd23c0afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:10.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.979+0000 7fd243050640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd23c0ac910 con 0x7fd23c06c350 2023-06-10T19:06:10.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.979+0000 7fd243050640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd23c0ca5c0 con 0x7fd23c0af760 2023-06-10T19:06:10.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.979+0000 7fd243050640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd23c0b0120 con 0x7fd23c0c97d0 2023-06-10T19:06:10.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.979+0000 7fd2415ed640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd23c0af760 0x7fd23c0afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:10.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.979+0000 7fd2415ed640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd23c0af760 0x7fd23c0afbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49602/0 (socket says 172.21.15.53:49602) 2023-06-10T19:06:10.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.979+0000 7fd2415ed640 1 -- 172.21.15.53:0/2319922506 learned_addr learned my addr 172.21.15.53:0/2319922506 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:10.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.979+0000 7fd240dec640 1 --2- 172.21.15.53:0/2319922506 >> v2:172.21.15.117:3300/0 conn(0x7fd23c0c97d0 0x7fd23c0cb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:10.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.979+0000 7fd2415ed640 1 -- 172.21.15.53:0/2319922506 >> v2:172.21.15.117:3300/0 conn(0x7fd23c0c97d0 msgr2=0x7fd23c0cb820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:10.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.979+0000 7fd2415ed640 1 --2- 172.21.15.53:0/2319922506 >> v2:172.21.15.117:3300/0 conn(0x7fd23c0c97d0 0x7fd23c0cb820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:10.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.979+0000 7fd2415ed640 1 -- 172.21.15.53:0/2319922506 >> v1:172.21.15.117:6789/0 conn(0x7fd23c06c350 legacy=0x7fd23c0ac200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:10.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.979+0000 7fd2415ed640 1 -- 172.21.15.53:0/2319922506 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd23c0cbd60 con 0x7fd23c0af760 2023-06-10T19:06:10.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.983+0000 7fd2415ed640 1 --2- 172.21.15.53:0/2319922506 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd23c0af760 0x7fd23c0afbe0 secure :-1 s=READY pgs=2096 cs=0 l=1 rev1=1 crypto rx=0x7fd23c06e9d0 tx=0x7fd23401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eceecc7a2fad4e6f server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:10.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.983+0000 7fd23b7fe640 1 -- 172.21.15.53:0/2319922506 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2340ab600 con 0x7fd23c0af760 2023-06-10T19:06:10.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.983+0000 7fd23b7fe640 1 -- 172.21.15.53:0/2319922506 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2340a7050 con 0x7fd23c0af760 2023-06-10T19:06:10.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.983+0000 7fd23b7fe640 1 -- 172.21.15.53:0/2319922506 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2340ab980 con 0x7fd23c0af760 2023-06-10T19:06:10.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.983+0000 7fd243050640 1 -- 172.21.15.53:0/2319922506 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd23c0af760 msgr2=0x7fd23c0afbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:10.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.983+0000 7fd243050640 1 --2- 172.21.15.53:0/2319922506 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd23c0af760 0x7fd23c0afbe0 secure :-1 s=READY pgs=2096 cs=0 l=1 rev1=1 crypto rx=0x7fd23c06e9d0 tx=0x7fd23401c3e0 comp rx=0 tx=0).stop 2023-06-10T19:06:10.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.983+0000 7fd243050640 1 -- 172.21.15.53:0/2319922506 shutdown_connections 2023-06-10T19:06:10.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.983+0000 7fd243050640 1 --2- 172.21.15.53:0/2319922506 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd23c0af760 0x7fd23c0afbe0 unknown :-1 s=CLOSED pgs=2096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:10.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.983+0000 7fd243050640 1 --2- 172.21.15.53:0/2319922506 >> v2:172.21.15.117:3300/0 conn(0x7fd23c0c97d0 0x7fd23c0cb820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:10.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.983+0000 7fd243050640 1 -- 172.21.15.53:0/2319922506 >> 172.21.15.53:0/2319922506 conn(0x7fd23c06a0e0 msgr2=0x7fd23c0cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:10.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.983+0000 7fd243050640 1 -- 172.21.15.53:0/2319922506 shutdown_connections 2023-06-10T19:06:10.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.983+0000 7fd243050640 1 -- 172.21.15.53:0/2319922506 wait complete. 2023-06-10T19:06:10.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.983+0000 7fd243050640 1 Processor -- start 2023-06-10T19:06:10.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.983+0000 7fd243050640 1 -- start start 2023-06-10T19:06:10.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.983+0000 7fd243050640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd23c06c350 0x7fd23c15e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:10.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.983+0000 7fd243050640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd23c0af760 0x7fd23c0b1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:10.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.983+0000 7fd243050640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd23c0c97d0 0x7fd23c151d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:10.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.983+0000 7fd243050640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c153e80 con 0x7fd23c0af760 2023-06-10T19:06:10.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.983+0000 7fd243050640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c0b1e90 con 0x7fd23c0c97d0 2023-06-10T19:06:10.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.983+0000 7fd243050640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c152d60 con 0x7fd23c06c350 2023-06-10T19:06:10.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.983+0000 7fd23bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd23c0af760 0x7fd23c0b1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:10.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.983+0000 7fd23bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd23c0af760 0x7fd23c0b1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49614/0 (socket says 172.21.15.53:49614) 2023-06-10T19:06:10.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.983+0000 7fd23bfff640 1 -- 172.21.15.53:0/2747832198 learned_addr learned my addr 172.21.15.53:0/2747832198 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:10.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.983+0000 7fd2415ed640 1 --2- 172.21.15.53:0/2747832198 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd23c0c97d0 0x7fd23c151d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:10.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.983+0000 7fd240dec640 1 --2- 172.21.15.53:0/2747832198 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd23c06c350 0x7fd23c15e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:10.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.987+0000 7fd23bfff640 1 -- 172.21.15.53:0/2747832198 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd23c06c350 msgr2=0x7fd23c15e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:10.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.987+0000 7fd23bfff640 1 --2- 172.21.15.53:0/2747832198 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd23c06c350 0x7fd23c15e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:10.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.987+0000 7fd23bfff640 1 -- 172.21.15.53:0/2747832198 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd23c0c97d0 msgr2=0x7fd23c151d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:10.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.987+0000 7fd23bfff640 1 --2- 172.21.15.53:0/2747832198 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd23c0c97d0 0x7fd23c151d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:10.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.987+0000 7fd23bfff640 1 -- 172.21.15.53:0/2747832198 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2340094d0 con 0x7fd23c0af760 2023-06-10T19:06:10.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.987+0000 7fd2415ed640 1 --2- 172.21.15.53:0/2747832198 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd23c0c97d0 0x7fd23c151d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:06:10.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.987+0000 7fd23bfff640 1 --2- 172.21.15.53:0/2747832198 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd23c0af760 0x7fd23c0b1520 secure :-1 s=READY pgs=2097 cs=0 l=1 rev1=1 crypto rx=0x7fd23000c7a0 tx=0x7fd23000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:10.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.987+0000 7fd2397fa640 1 -- 172.21.15.53:0/2747832198 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd230003b80 con 0x7fd23c0af760 2023-06-10T19:06:10.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.987+0000 7fd2397fa640 1 -- 172.21.15.53:0/2747832198 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd230003ce0 con 0x7fd23c0af760 2023-06-10T19:06:10.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.987+0000 7fd2397fa640 1 -- 172.21.15.53:0/2747832198 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23000aa90 con 0x7fd23c0af760 2023-06-10T19:06:10.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.987+0000 7fd243050640 1 -- 172.21.15.53:0/2747832198 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd23c0b1bb0 con 0x7fd23c0af760 2023-06-10T19:06:10.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.987+0000 7fd243050640 1 -- 172.21.15.53:0/2747832198 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd23c1529f0 con 0x7fd23c0af760 2023-06-10T19:06:10.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.987+0000 7fd243050640 1 -- 172.21.15.53:0/2747832198 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd23c152570 con 0x7fd23c0af760 2023-06-10T19:06:10.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.987+0000 7fd2397fa640 1 -- 172.21.15.53:0/2747832198 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd23000abf0 con 0x7fd23c0af760 2023-06-10T19:06:10.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.987+0000 7fd2397fa640 1 --2- 172.21.15.53:0/2747832198 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd228066280 0x7fd228068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:10.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.987+0000 7fd2397fa640 1 -- 172.21.15.53:0/2747832198 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6148+0+0 (secure 0 0 0) 0x7fd230083c30 con 0x7fd23c0af760 2023-06-10T19:06:10.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.987+0000 7fd240dec640 1 --2- 172.21.15.53:0/2747832198 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd228066280 0x7fd228068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:10.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.987+0000 7fd240dec640 1 --2- 172.21.15.53:0/2747832198 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd228066280 0x7fd228068730 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fd23c1579d0 tx=0x7fd22c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:10.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:10.991+0000 7fd2397fa640 1 -- 172.21.15.53:0/2747832198 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd23c152570 con 0x7fd23c0af760 2023-06-10T19:06:11.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.147+0000 7fd243050640 1 -- 172.21.15.53:0/2747832198 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd23c152570 con 0x7fd23c0af760 2023-06-10T19:06:11.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.147+0000 7fd2397fa640 1 -- 172.21.15.53:0/2747832198 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v142) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd23c152570 con 0x7fd23c0af760 2023-06-10T19:06:11.148 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-06-10T19:06:11.150 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.147+0000 7fd243050640 1 -- 172.21.15.53:0/2747832198 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd228066280 msgr2=0x7fd228068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:11.150 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.147+0000 7fd243050640 1 --2- 172.21.15.53:0/2747832198 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd228066280 0x7fd228068730 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fd23c1579d0 tx=0x7fd22c008040 comp rx=0 tx=0).stop 2023-06-10T19:06:11.150 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.147+0000 7fd243050640 1 -- 172.21.15.53:0/2747832198 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd23c0af760 msgr2=0x7fd23c0b1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:11.150 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.147+0000 7fd243050640 1 --2- 172.21.15.53:0/2747832198 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd23c0af760 0x7fd23c0b1520 secure :-1 s=READY pgs=2097 cs=0 l=1 rev1=1 crypto rx=0x7fd23000c7a0 tx=0x7fd23000cc60 comp rx=0 tx=0).stop 2023-06-10T19:06:11.150 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.147+0000 7fd243050640 1 -- 172.21.15.53:0/2747832198 shutdown_connections 2023-06-10T19:06:11.150 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.147+0000 7fd243050640 1 --2- 172.21.15.53:0/2747832198 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd228066280 0x7fd228068730 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:11.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.147+0000 7fd243050640 1 --2- 172.21.15.53:0/2747832198 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd23c0c97d0 0x7fd23c151d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:11.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.147+0000 7fd243050640 1 --2- 172.21.15.53:0/2747832198 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd23c0af760 0x7fd23c0b1520 unknown :-1 s=CLOSED pgs=2097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:11.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.147+0000 7fd243050640 1 --2- 172.21.15.53:0/2747832198 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd23c06c350 0x7fd23c15e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:11.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.147+0000 7fd243050640 1 -- 172.21.15.53:0/2747832198 >> 172.21.15.53:0/2747832198 conn(0x7fd23c06a0e0 msgr2=0x7fd23c0cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:11.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.147+0000 7fd243050640 1 -- 172.21.15.53:0/2747832198 shutdown_connections 2023-06-10T19:06:11.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.147+0000 7fd243050640 1 -- 172.21.15.53:0/2747832198 wait complete. 2023-06-10T19:06:11.167 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-10T19:06:11.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.295+0000 7f6aceaa4640 1 Processor -- start 2023-06-10T19:06:11.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.295+0000 7f6aceaa4640 1 -- start start 2023-06-10T19:06:11.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.295+0000 7f6aceaa4640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6ac8159690 0x7f6ac8070950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:11.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.295+0000 7f6aceaa4640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ac80cb080 con 0x7f6ac80b0f30 2023-06-10T19:06:11.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.295+0000 7f6aceaa4640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ac80cb320 con 0x7f6ac8159a60 2023-06-10T19:06:11.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.295+0000 7f6aceaa4640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ac8070e90 con 0x7f6ac8159690 2023-06-10T19:06:11.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.295+0000 7f6ac7fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f6ac80b0f30 0x7f6ac80cbe00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60274/0 (socket says 172.21.15.53:60274) 2023-06-10T19:06:11.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.295+0000 7f6ac7fff640 1 -- 172.21.15.53:0/455505456 learned_addr learned my addr 172.21.15.53:0/455505456 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:06:11.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.295+0000 7f6ac77fe640 1 -- 172.21.15.53:0/455505456 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 336014041 0 0) 0x7f6ac80cb080 con 0x7f6ac80b0f30 2023-06-10T19:06:11.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.295+0000 7f6ac77fe640 1 -- 172.21.15.53:0/455505456 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ab8003530 con 0x7f6ac80b0f30 2023-06-10T19:06:11.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.295+0000 7f6acc840640 1 --2- 172.21.15.53:0/455505456 >> v2:172.21.15.117:3300/0 conn(0x7f6ac8159690 0x7f6ac8070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:11.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.295+0000 7f6ac77fe640 1 -- 172.21.15.53:0/455505456 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3334272408 0 0) 0x7f6ab8003530 con 0x7f6ac80b0f30 2023-06-10T19:06:11.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.295+0000 7f6ac77fe640 1 -- 172.21.15.53:0/455505456 >> v2:172.21.15.117:3300/0 conn(0x7f6ac8159690 msgr2=0x7f6ac8070950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:11.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.295+0000 7f6ac77fe640 1 --2- 172.21.15.53:0/455505456 >> v2:172.21.15.117:3300/0 conn(0x7f6ac8159690 0x7f6ac8070950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:11.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.295+0000 7f6ac77fe640 1 -- 172.21.15.53:0/455505456 >> v1:172.21.15.117:6789/0 conn(0x7f6ac8159a60 legacy=0x7f6ac80c2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:11.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.295+0000 7f6ac77fe640 1 -- 172.21.15.53:0/455505456 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ac80cb600 con 0x7f6ac80b0f30 2023-06-10T19:06:11.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.295+0000 7f6ac77fe640 1 -- 172.21.15.53:0/455505456 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f6ab4001680 con 0x7f6ac80b0f30 2023-06-10T19:06:11.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.295+0000 7f6ac77fe640 1 -- 172.21.15.53:0/455505456 >> v1:172.21.15.53:6789/0 conn(0x7f6ac80b0f30 legacy=0x7f6ac80cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:11.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.295+0000 7f6ac77fe640 1 --2- 172.21.15.53:0/455505456 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ab8003980 0x7f6ab8003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:11.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.295+0000 7f6ac77fe640 1 --2- 172.21.15.53:0/455505456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ab8004390 0x7f6ab8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:11.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.295+0000 7f6ac77fe640 1 --2- 172.21.15.53:0/455505456 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ab8005050 0x7f6ab800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:11.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.295+0000 7f6ac77fe640 1 -- 172.21.15.53:0/455505456 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac8070e90 con 0x7f6ab8004390 2023-06-10T19:06:11.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.295+0000 7f6ac77fe640 1 -- 172.21.15.53:0/455505456 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab800bf80 con 0x7f6ab8003980 2023-06-10T19:06:11.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.295+0000 7f6ac77fe640 1 -- 172.21.15.53:0/455505456 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab800c140 con 0x7f6ab8005050 2023-06-10T19:06:11.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.295+0000 7f6ac7fff640 1 --2- 172.21.15.53:0/455505456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ab8004390 0x7f6ab8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:11.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.295+0000 7f6acd041640 1 --2- 172.21.15.53:0/455505456 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ab8005050 0x7f6ab800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:11.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.295+0000 7f6ac7fff640 1 -- 172.21.15.53:0/455505456 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ab8005050 msgr2=0x7f6ab800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:11.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.295+0000 7f6ac7fff640 1 --2- 172.21.15.53:0/455505456 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ab8005050 0x7f6ab800b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:11.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.295+0000 7f6ac7fff640 1 -- 172.21.15.53:0/455505456 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ab8003980 msgr2=0x7f6ab8003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:11.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.295+0000 7f6acc840640 1 --2- 172.21.15.53:0/455505456 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ab8003980 0x7f6ab8003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:11.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.295+0000 7f6ac7fff640 1 --2- 172.21.15.53:0/455505456 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ab8003980 0x7f6ab8003d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:11.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.295+0000 7f6acd041640 1 -- 172.21.15.53:0/455505456 reap_dead start 2023-06-10T19:06:11.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.295+0000 7f6ac7fff640 1 -- 172.21.15.53:0/455505456 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab8003530 con 0x7f6ab8004390 2023-06-10T19:06:11.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.299+0000 7f6ac7fff640 1 --2- 172.21.15.53:0/455505456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ab8004390 0x7f6ab8004850 secure :-1 s=READY pgs=2099 cs=0 l=1 rev1=1 crypto rx=0x7f6ab400c1c0 tx=0x7f6ab401f370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b758182713e8b39 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:11.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.299+0000 7f6ac77fe640 1 -- 172.21.15.53:0/455505456 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab4005ae0 con 0x7f6ab8004390 2023-06-10T19:06:11.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.299+0000 7f6ac77fe640 1 -- 172.21.15.53:0/455505456 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ab40ab070 con 0x7f6ab8004390 2023-06-10T19:06:11.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.299+0000 7f6ac77fe640 1 -- 172.21.15.53:0/455505456 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab4005e80 con 0x7f6ab8004390 2023-06-10T19:06:11.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.299+0000 7f6aceaa4640 1 -- 172.21.15.53:0/455505456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ab8004390 msgr2=0x7f6ab8004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:11.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.299+0000 7f6aceaa4640 1 --2- 172.21.15.53:0/455505456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ab8004390 0x7f6ab8004850 secure :-1 s=READY pgs=2099 cs=0 l=1 rev1=1 crypto rx=0x7f6ab400c1c0 tx=0x7f6ab401f370 comp rx=0 tx=0).stop 2023-06-10T19:06:11.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.299+0000 7f6aceaa4640 1 -- 172.21.15.53:0/455505456 shutdown_connections 2023-06-10T19:06:11.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.299+0000 7f6aceaa4640 1 --2- 172.21.15.53:0/455505456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ab8004390 0x7f6ab8004850 unknown :-1 s=CLOSED pgs=2099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:11.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.299+0000 7f6aceaa4640 1 -- 172.21.15.53:0/455505456 >> 172.21.15.53:0/455505456 conn(0x7f6ac806a560 msgr2=0x7f6ac806a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:11.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.299+0000 7f6aceaa4640 1 -- 172.21.15.53:0/455505456 shutdown_connections 2023-06-10T19:06:11.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.299+0000 7f6aceaa4640 1 -- 172.21.15.53:0/455505456 wait complete. 2023-06-10T19:06:11.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.299+0000 7f6aceaa4640 1 Processor -- start 2023-06-10T19:06:11.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.299+0000 7f6aceaa4640 1 -- start start 2023-06-10T19:06:11.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.299+0000 7f6aceaa4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ab8004390 0x7f6ac80b1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:11.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.299+0000 7f6aceaa4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ac81eebb0 0x7f6ac80b4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:11.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.299+0000 7f6aceaa4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ac8147ed0 0x7f6ac8148340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:11.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.299+0000 7f6aceaa4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac815b960 con 0x7f6ac81eebb0 2023-06-10T19:06:11.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.299+0000 7f6aceaa4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac81ef020 con 0x7f6ac8147ed0 2023-06-10T19:06:11.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.299+0000 7f6aceaa4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac8148880 con 0x7f6ab8004390 2023-06-10T19:06:11.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.299+0000 7f6ac7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ac81eebb0 0x7f6ac80b4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:11.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.299+0000 7f6ac7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ac81eebb0 0x7f6ac80b4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41966/0 (socket says 172.21.15.53:41966) 2023-06-10T19:06:11.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.299+0000 7f6ac7fff640 1 -- 172.21.15.53:0/90253661 learned_addr learned my addr 172.21.15.53:0/90253661 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:11.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.299+0000 7f6acc840640 1 --2- 172.21.15.53:0/90253661 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ab8004390 0x7f6ac80b1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:11.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.299+0000 7f6acd041640 1 --2- 172.21.15.53:0/90253661 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ac8147ed0 0x7f6ac8148340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:11.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.303+0000 7f6ac7fff640 1 -- 172.21.15.53:0/90253661 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ab8004390 msgr2=0x7f6ac80b1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:11.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.303+0000 7f6ac7fff640 1 --2- 172.21.15.53:0/90253661 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ab8004390 0x7f6ac80b1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:11.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.303+0000 7f6ac7fff640 1 -- 172.21.15.53:0/90253661 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ac8147ed0 msgr2=0x7f6ac8148340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:11.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.303+0000 7f6ac7fff640 1 --2- 172.21.15.53:0/90253661 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ac8147ed0 0x7f6ac8148340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:11.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.303+0000 7f6ac7fff640 1 -- 172.21.15.53:0/90253661 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ac815c930 con 0x7f6ac81eebb0 2023-06-10T19:06:11.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.303+0000 7f6ac7fff640 1 --2- 172.21.15.53:0/90253661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ac81eebb0 0x7f6ac80b4700 secure :-1 s=READY pgs=2100 cs=0 l=1 rev1=1 crypto rx=0x7f6ab401f1a0 tx=0x7f6ab401c110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:11.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.303+0000 7f6ac57fa640 1 -- 172.21.15.53:0/90253661 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab40b7040 con 0x7f6ac81eebb0 2023-06-10T19:06:11.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.303+0000 7f6ac57fa640 1 -- 172.21.15.53:0/90253661 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ab4001660 con 0x7f6ac81eebb0 2023-06-10T19:06:11.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.303+0000 7f6aceaa4640 1 -- 172.21.15.53:0/90253661 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ac80b4c40 con 0x7f6ac81eebb0 2023-06-10T19:06:11.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.303+0000 7f6ac57fa640 1 -- 172.21.15.53:0/90253661 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab40072b0 con 0x7f6ac81eebb0 2023-06-10T19:06:11.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.303+0000 7f6aceaa4640 1 -- 172.21.15.53:0/90253661 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ac815be50 con 0x7f6ac81eebb0 2023-06-10T19:06:11.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.303+0000 7f6aceaa4640 1 -- 172.21.15.53:0/90253661 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ac804d790 con 0x7f6ac81eebb0 2023-06-10T19:06:11.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.303+0000 7f6ac57fa640 1 -- 172.21.15.53:0/90253661 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6ab4007410 con 0x7f6ac81eebb0 2023-06-10T19:06:11.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.303+0000 7f6ac57fa640 1 --2- 172.21.15.53:0/90253661 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6aac0662b0 0x7f6aac068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:11.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.303+0000 7f6ac57fa640 1 -- 172.21.15.53:0/90253661 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f6ab41214f0 con 0x7f6ac81eebb0 2023-06-10T19:06:11.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.303+0000 7f6acc840640 1 --2- 172.21.15.53:0/90253661 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6aac0662b0 0x7f6aac068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:11.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.303+0000 7f6acc840640 1 --2- 172.21.15.53:0/90253661 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6aac0662b0 0x7f6aac068760 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f6ac8063080 tx=0x7f6abc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:11.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.307+0000 7f6ac57fa640 1 -- 172.21.15.53:0/90253661 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6ab40ee960 con 0x7f6ac81eebb0 2023-06-10T19:06:11.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.459+0000 7f6aceaa4640 1 -- 172.21.15.53:0/90253661 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6ac80b24c0 con 0x7f6ac81eebb0 2023-06-10T19:06:11.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.459+0000 7f6ac57fa640 1 -- 172.21.15.53:0/90253661 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v142) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6ab40f1f80 con 0x7f6ac81eebb0 2023-06-10T19:06:11.461 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-06-10T19:06:11.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.463+0000 7f6aceaa4640 1 -- 172.21.15.53:0/90253661 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6aac0662b0 msgr2=0x7f6aac068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:11.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.463+0000 7f6aceaa4640 1 --2- 172.21.15.53:0/90253661 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6aac0662b0 0x7f6aac068760 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f6ac8063080 tx=0x7f6abc008040 comp rx=0 tx=0).stop 2023-06-10T19:06:11.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.463+0000 7f6aceaa4640 1 -- 172.21.15.53:0/90253661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ac81eebb0 msgr2=0x7f6ac80b4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:11.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.463+0000 7f6aceaa4640 1 --2- 172.21.15.53:0/90253661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ac81eebb0 0x7f6ac80b4700 secure :-1 s=READY pgs=2100 cs=0 l=1 rev1=1 crypto rx=0x7f6ab401f1a0 tx=0x7f6ab401c110 comp rx=0 tx=0).stop 2023-06-10T19:06:11.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.463+0000 7f6aceaa4640 1 -- 172.21.15.53:0/90253661 shutdown_connections 2023-06-10T19:06:11.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.463+0000 7f6aceaa4640 1 --2- 172.21.15.53:0/90253661 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6aac0662b0 0x7f6aac068760 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:11.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.463+0000 7f6aceaa4640 1 --2- 172.21.15.53:0/90253661 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ac8147ed0 0x7f6ac8148340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:11.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.463+0000 7f6aceaa4640 1 --2- 172.21.15.53:0/90253661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ac81eebb0 0x7f6ac80b4700 unknown :-1 s=CLOSED pgs=2100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:11.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.463+0000 7f6aceaa4640 1 --2- 172.21.15.53:0/90253661 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ab8004390 0x7f6ac80b1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:11.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.463+0000 7f6aceaa4640 1 -- 172.21.15.53:0/90253661 >> 172.21.15.53:0/90253661 conn(0x7f6ac806a560 msgr2=0x7f6ac8156c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:11.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.463+0000 7f6aceaa4640 1 -- 172.21.15.53:0/90253661 shutdown_connections 2023-06-10T19:06:11.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.463+0000 7f6aceaa4640 1 -- 172.21.15.53:0/90253661 wait complete. 2023-06-10T19:06:11.481 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-10T19:06:11.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.595+0000 7fdc6d386640 1 Processor -- start 2023-06-10T19:06:11.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.595+0000 7fdc6d386640 1 -- start start 2023-06-10T19:06:11.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.595+0000 7fdc6d386640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fdc680cd6d0 0x7fdc6815b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:11.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.595+0000 7fdc6d386640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc680afee0 0x7fdc68158660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:11.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.595+0000 7fdc6d386640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc6806b7a0 con 0x7fdc680c83c0 2023-06-10T19:06:11.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.595+0000 7fdc6d386640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc6806a8b0 con 0x7fdc680cd6d0 2023-06-10T19:06:11.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.595+0000 7fdc6d386640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6806ab90 con 0x7fdc680afee0 2023-06-10T19:06:11.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.595+0000 7fdc66ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fdc680cd6d0 0x7fdc6815b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:11.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.595+0000 7fdc66ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fdc680cd6d0 0x7fdc6815b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41968/0 (socket says 172.21.15.53:41968) 2023-06-10T19:06:11.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.595+0000 7fdc66ffd640 1 -- 172.21.15.53:0/433353928 learned_addr learned my addr 172.21.15.53:0/433353928 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:11.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.595+0000 7fdc677fe640 1 --2- 172.21.15.53:0/433353928 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc680afee0 0x7fdc68158660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:11.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.595+0000 7fdc66ffd640 1 -- 172.21.15.53:0/433353928 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc680afee0 msgr2=0x7fdc68158660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:11.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.595+0000 7fdc66ffd640 1 --2- 172.21.15.53:0/433353928 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc680afee0 0x7fdc68158660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:11.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.595+0000 7fdc66ffd640 1 -- 172.21.15.53:0/433353928 >> v1:172.21.15.117:6789/0 conn(0x7fdc680c83c0 legacy=0x7fdc680af7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:11.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.599+0000 7fdc66ffd640 1 -- 172.21.15.53:0/433353928 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc6806ae70 con 0x7fdc680cd6d0 2023-06-10T19:06:11.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.599+0000 7fdc66ffd640 1 --2- 172.21.15.53:0/433353928 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc680cd6d0 0x7fdc6815b900 secure :-1 s=READY pgs=2101 cs=0 l=1 rev1=1 crypto rx=0x7fdc58006fd0 tx=0x7fdc5801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=680980856f852a0d server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:11.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.599+0000 7fdc667fc640 1 -- 172.21.15.53:0/433353928 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc580ab5f0 con 0x7fdc680cd6d0 2023-06-10T19:06:11.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.599+0000 7fdc667fc640 1 -- 172.21.15.53:0/433353928 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc580ab750 con 0x7fdc680cd6d0 2023-06-10T19:06:11.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.599+0000 7fdc667fc640 1 -- 172.21.15.53:0/433353928 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc580abae0 con 0x7fdc680cd6d0 2023-06-10T19:06:11.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.599+0000 7fdc6d386640 1 -- 172.21.15.53:0/433353928 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc680cd6d0 msgr2=0x7fdc6815b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:11.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.599+0000 7fdc6d386640 1 --2- 172.21.15.53:0/433353928 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc680cd6d0 0x7fdc6815b900 secure :-1 s=READY pgs=2101 cs=0 l=1 rev1=1 crypto rx=0x7fdc58006fd0 tx=0x7fdc5801c4b0 comp rx=0 tx=0).stop 2023-06-10T19:06:11.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.599+0000 7fdc6d386640 1 -- 172.21.15.53:0/433353928 shutdown_connections 2023-06-10T19:06:11.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.599+0000 7fdc6d386640 1 --2- 172.21.15.53:0/433353928 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc680afee0 0x7fdc68158660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:11.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.599+0000 7fdc6d386640 1 --2- 172.21.15.53:0/433353928 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc680cd6d0 0x7fdc6815b900 unknown :-1 s=CLOSED pgs=2101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:11.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.599+0000 7fdc6d386640 1 -- 172.21.15.53:0/433353928 >> 172.21.15.53:0/433353928 conn(0x7fdc680ce9e0 msgr2=0x7fdc680ca7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:11.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.599+0000 7fdc6d386640 1 -- 172.21.15.53:0/433353928 shutdown_connections 2023-06-10T19:06:11.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.599+0000 7fdc6d386640 1 -- 172.21.15.53:0/433353928 wait complete. 2023-06-10T19:06:11.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.599+0000 7fdc6d386640 1 Processor -- start 2023-06-10T19:06:11.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.603+0000 7fdc6d386640 1 -- start start 2023-06-10T19:06:11.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.603+0000 7fdc6d386640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc680afee0 0x7fdc6814a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:11.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.603+0000 7fdc6d386640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc680c83c0 0x7fdc680c3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:11.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.603+0000 7fdc6d386640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdc680cd6d0 0x7fdc680c3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:11.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.603+0000 7fdc6d386640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6814c280 con 0x7fdc680c83c0 2023-06-10T19:06:11.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.603+0000 7fdc6d386640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6814cb20 con 0x7fdc680cd6d0 2023-06-10T19:06:11.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.603+0000 7fdc6d386640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc680c4450 con 0x7fdc680afee0 2023-06-10T19:06:11.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.603+0000 7fdc5ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc680c83c0 0x7fdc680c3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:11.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.603+0000 7fdc5ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc680c83c0 0x7fdc680c3890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41976/0 (socket says 172.21.15.53:41976) 2023-06-10T19:06:11.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.603+0000 7fdc5ffff640 1 -- 172.21.15.53:0/2269553930 learned_addr learned my addr 172.21.15.53:0/2269553930 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:11.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.603+0000 7fdc66ffd640 1 --2- 172.21.15.53:0/2269553930 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc680afee0 0x7fdc6814a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:11.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.603+0000 7fdc677fe640 1 --2- 172.21.15.53:0/2269553930 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdc680cd6d0 0x7fdc680c3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:11.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.603+0000 7fdc5ffff640 1 -- 172.21.15.53:0/2269553930 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc680afee0 msgr2=0x7fdc6814a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:11.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.603+0000 7fdc5ffff640 1 --2- 172.21.15.53:0/2269553930 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc680afee0 0x7fdc6814a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:11.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.603+0000 7fdc5ffff640 1 -- 172.21.15.53:0/2269553930 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdc680cd6d0 msgr2=0x7fdc680c3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:11.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.603+0000 7fdc5ffff640 1 --2- 172.21.15.53:0/2269553930 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdc680cd6d0 0x7fdc680c3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:11.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.603+0000 7fdc5ffff640 1 -- 172.21.15.53:0/2269553930 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc58009480 con 0x7fdc680c83c0 2023-06-10T19:06:11.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.603+0000 7fdc5ffff640 1 --2- 172.21.15.53:0/2269553930 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc680c83c0 0x7fdc680c3890 secure :-1 s=READY pgs=2102 cs=0 l=1 rev1=1 crypto rx=0x7fdc5000b440 tx=0x7fdc5000b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:11.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.603+0000 7fdc5f7fe640 1 -- 172.21.15.53:0/2269553930 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc50011890 con 0x7fdc680c83c0 2023-06-10T19:06:11.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.603+0000 7fdc5f7fe640 1 -- 172.21.15.53:0/2269553930 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc500119f0 con 0x7fdc680c83c0 2023-06-10T19:06:11.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.603+0000 7fdc6d386640 1 -- 172.21.15.53:0/2269553930 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc6814c4d0 con 0x7fdc680c83c0 2023-06-10T19:06:11.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.603+0000 7fdc5f7fe640 1 -- 172.21.15.53:0/2269553930 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc50011da0 con 0x7fdc680c83c0 2023-06-10T19:06:11.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.603+0000 7fdc6d386640 1 -- 172.21.15.53:0/2269553930 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc6814aa60 con 0x7fdc680c83c0 2023-06-10T19:06:11.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.603+0000 7fdc6d386640 1 -- 172.21.15.53:0/2269553930 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc6804d790 con 0x7fdc680c83c0 2023-06-10T19:06:11.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.603+0000 7fdc5f7fe640 1 -- 172.21.15.53:0/2269553930 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdc5001a400 con 0x7fdc680c83c0 2023-06-10T19:06:11.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.603+0000 7fdc5f7fe640 1 --2- 172.21.15.53:0/2269553930 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdc480662b0 0x7fdc48068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:11.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.603+0000 7fdc5f7fe640 1 -- 172.21.15.53:0/2269553930 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6148+0+0 (secure 0 0 0) 0x7fdc50083e40 con 0x7fdc680c83c0 2023-06-10T19:06:11.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.603+0000 7fdc66ffd640 1 --2- 172.21.15.53:0/2269553930 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdc480662b0 0x7fdc48068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:11.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.607+0000 7fdc66ffd640 1 --2- 172.21.15.53:0/2269553930 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdc480662b0 0x7fdc48068760 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fdc580af000 tx=0x7fdc58009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:11.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.607+0000 7fdc5f7fe640 1 -- 172.21.15.53:0/2269553930 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdc50051260 con 0x7fdc680c83c0 2023-06-10T19:06:11.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.763+0000 7fdc6d386640 1 -- 172.21.15.53:0/2269553930 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fdc6814cc60 con 0x7fdc680c83c0 2023-06-10T19:06:11.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.767+0000 7fdc5f7fe640 1 -- 172.21.15.53:0/2269553930 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v142) v1 ==== 80+0+122 (secure 0 0 0) 0x7fdc50015080 con 0x7fdc680c83c0 2023-06-10T19:06:11.767 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:6835/1171476971 2023-06-11T19:06:04.182476+0000 2023-06-10T19:06:11.767 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:6834/1171476971 2023-06-11T19:06:04.182476+0000 2023-06-10T19:06:11.767 INFO:teuthology.orchestra.run.smithi053.stderr:listed 2 entries 2023-06-10T19:06:11.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.767+0000 7fdc6d386640 1 -- 172.21.15.53:0/2269553930 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdc480662b0 msgr2=0x7fdc48068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:11.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.767+0000 7fdc6d386640 1 --2- 172.21.15.53:0/2269553930 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdc480662b0 0x7fdc48068760 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fdc580af000 tx=0x7fdc58009040 comp rx=0 tx=0).stop 2023-06-10T19:06:11.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.767+0000 7fdc6d386640 1 -- 172.21.15.53:0/2269553930 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc680c83c0 msgr2=0x7fdc680c3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:11.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.767+0000 7fdc6d386640 1 --2- 172.21.15.53:0/2269553930 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc680c83c0 0x7fdc680c3890 secure :-1 s=READY pgs=2102 cs=0 l=1 rev1=1 crypto rx=0x7fdc5000b440 tx=0x7fdc5000b900 comp rx=0 tx=0).stop 2023-06-10T19:06:11.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.767+0000 7fdc6d386640 1 -- 172.21.15.53:0/2269553930 shutdown_connections 2023-06-10T19:06:11.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.767+0000 7fdc6d386640 1 --2- 172.21.15.53:0/2269553930 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdc480662b0 0x7fdc48068760 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:11.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.767+0000 7fdc6d386640 1 --2- 172.21.15.53:0/2269553930 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdc680cd6d0 0x7fdc680c3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:11.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.767+0000 7fdc6d386640 1 --2- 172.21.15.53:0/2269553930 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc680c83c0 0x7fdc680c3890 unknown :-1 s=CLOSED pgs=2102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:11.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.767+0000 7fdc6d386640 1 --2- 172.21.15.53:0/2269553930 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc680afee0 0x7fdc6814a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:11.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.767+0000 7fdc6d386640 1 -- 172.21.15.53:0/2269553930 >> 172.21.15.53:0/2269553930 conn(0x7fdc680ce9e0 msgr2=0x7fdc6815ad80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:11.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.767+0000 7fdc6d386640 1 -- 172.21.15.53:0/2269553930 shutdown_connections 2023-06-10T19:06:11.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:11.767+0000 7fdc6d386640 1 -- 172.21.15.53:0/2269553930 wait complete. 2023-06-10T19:06:11.784 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi053.front.sepia.ceph.com... 2023-06-10T19:06:11.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:06:11.785 DEBUG:teuthology.orchestra.run.smithi053:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-06-10T19:06:11.796 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[64532]: fuse finished with error 0 and tester_r 0 2023-06-10T19:06:11.797 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi053.front.sepia.ceph.com 2023-06-10T19:06:11.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:06:11.798 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-06-10T19:06:11.955 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T19:06:11.956 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:06:11.965 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:06:12.089 INFO:tasks.ceph.mds.c.smithi053.stderr:2023-06-10T19:06:12.087+0000 7fbcbebf4640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-06-10T19:06:12.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.123+0000 7fd922ad0640 1 Processor -- start 2023-06-10T19:06:12.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.123+0000 7fd922ad0640 1 -- start start 2023-06-10T19:06:12.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.123+0000 7fd922ad0640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd91c0c8d00 0x7fd91c06b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:12.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.123+0000 7fd922ad0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd91c06bc00 0x7fd91c162180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:12.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.123+0000 7fd922ad0640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd91c158a90 con 0x7fd91c06b2f0 2023-06-10T19:06:12.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.123+0000 7fd922ad0640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd91c06f780 con 0x7fd91c0c8d00 2023-06-10T19:06:12.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.123+0000 7fd922ad0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd91c0705d0 con 0x7fd91c06bc00 2023-06-10T19:06:12.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.123+0000 7fd913fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd91c0c8d00 0x7fd91c06b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:12.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.123+0000 7fd92086c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fd91c06b2f0 0x7fd91c06f070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60286/0 (socket says 172.21.15.53:60286) 2023-06-10T19:06:12.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.123+0000 7fd92086c640 1 -- 172.21.15.53:0/3687750978 learned_addr learned my addr 172.21.15.53:0/3687750978 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:06:12.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.123+0000 7fd92106d640 1 --2- 172.21.15.53:0/3687750978 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd91c06bc00 0x7fd91c162180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:12.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.123+0000 7fd913fff640 1 -- 172.21.15.53:0/3687750978 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd91c06bc00 msgr2=0x7fd91c162180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:12.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.123+0000 7fd913fff640 1 --2- 172.21.15.53:0/3687750978 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd91c06bc00 0x7fd91c162180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:12.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.123+0000 7fd913fff640 1 -- 172.21.15.53:0/3687750978 >> v1:172.21.15.53:6789/0 conn(0x7fd91c06b2f0 legacy=0x7fd91c06f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:12.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.123+0000 7fd913fff640 1 -- 172.21.15.53:0/3687750978 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd91c0cce10 con 0x7fd91c0c8d00 2023-06-10T19:06:12.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.123+0000 7fd9137fe640 1 -- 172.21.15.53:0/3687750978 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1359008334 0 0) 0x7fd918001120 con 0x7fd91c06b2f0 2023-06-10T19:06:12.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.123+0000 7fd913fff640 1 --2- 172.21.15.53:0/3687750978 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd91c0c8d00 0x7fd91c06b6c0 secure :-1 s=READY pgs=2104 cs=0 l=1 rev1=1 crypto rx=0x7fd90c0097c0 tx=0x7fd90c01ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b869bc0b69ee1ce server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:12.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.127+0000 7fd9137fe640 1 -- 172.21.15.53:0/3687750978 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90c0a8970 con 0x7fd91c0c8d00 2023-06-10T19:06:12.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.127+0000 7fd9137fe640 1 -- 172.21.15.53:0/3687750978 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd90c0a8ad0 con 0x7fd91c0c8d00 2023-06-10T19:06:12.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.127+0000 7fd9137fe640 1 -- 172.21.15.53:0/3687750978 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90c0a8e60 con 0x7fd91c0c8d00 2023-06-10T19:06:12.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.127+0000 7fd922ad0640 1 -- 172.21.15.53:0/3687750978 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd91c0c8d00 msgr2=0x7fd91c06b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:12.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.127+0000 7fd922ad0640 1 --2- 172.21.15.53:0/3687750978 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd91c0c8d00 0x7fd91c06b6c0 secure :-1 s=READY pgs=2104 cs=0 l=1 rev1=1 crypto rx=0x7fd90c0097c0 tx=0x7fd90c01ec70 comp rx=0 tx=0).stop 2023-06-10T19:06:12.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.127+0000 7fd922ad0640 1 -- 172.21.15.53:0/3687750978 shutdown_connections 2023-06-10T19:06:12.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.127+0000 7fd922ad0640 1 --2- 172.21.15.53:0/3687750978 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd91c0c8d00 0x7fd91c06b6c0 unknown :-1 s=CLOSED pgs=2104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:12.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.127+0000 7fd922ad0640 1 --2- 172.21.15.53:0/3687750978 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd91c06bc00 0x7fd91c162180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:12.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.127+0000 7fd922ad0640 1 -- 172.21.15.53:0/3687750978 >> 172.21.15.53:0/3687750978 conn(0x7fd91c06a0d0 msgr2=0x7fd91c0ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:12.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.127+0000 7fd922ad0640 1 -- 172.21.15.53:0/3687750978 shutdown_connections 2023-06-10T19:06:12.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.127+0000 7fd922ad0640 1 -- 172.21.15.53:0/3687750978 wait complete. 2023-06-10T19:06:12.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.127+0000 7fd922ad0640 1 Processor -- start 2023-06-10T19:06:12.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.127+0000 7fd922ad0640 1 -- start start 2023-06-10T19:06:12.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.127+0000 7fd922ad0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd91c06b2f0 0x7fd91c0c6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:12.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.127+0000 7fd922ad0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd91c06bc00 0x7fd91c0a8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:12.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.127+0000 7fd922ad0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd91c0c8d00 0x7fd91c0a9410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:12.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.127+0000 7fd922ad0640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd91c0a9950 con 0x7fd91c0c8d00 2023-06-10T19:06:12.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.127+0000 7fd922ad0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd91c1ef4b0 con 0x7fd91c06bc00 2023-06-10T19:06:12.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.127+0000 7fd922ad0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd91c1eeb80 con 0x7fd91c06b2f0 2023-06-10T19:06:12.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.127+0000 7fd92106d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd91c0c8d00 0x7fd91c0a9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:12.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.127+0000 7fd92106d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd91c0c8d00 0x7fd91c0a9410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42004/0 (socket says 172.21.15.53:42004) 2023-06-10T19:06:12.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.127+0000 7fd92106d640 1 -- 172.21.15.53:0/1899057590 learned_addr learned my addr 172.21.15.53:0/1899057590 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:12.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.127+0000 7fd913fff640 1 --2- 172.21.15.53:0/1899057590 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd91c06bc00 0x7fd91c0a8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:12.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.127+0000 7fd92086c640 1 --2- 172.21.15.53:0/1899057590 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd91c06b2f0 0x7fd91c0c6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:12.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.127+0000 7fd92106d640 1 -- 172.21.15.53:0/1899057590 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd91c06b2f0 msgr2=0x7fd91c0c6fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:12.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.127+0000 7fd92106d640 1 --2- 172.21.15.53:0/1899057590 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd91c06b2f0 0x7fd91c0c6fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:12.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.127+0000 7fd92106d640 1 -- 172.21.15.53:0/1899057590 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd91c06bc00 msgr2=0x7fd91c0a8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:12.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.127+0000 7fd92106d640 1 --2- 172.21.15.53:0/1899057590 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd91c06bc00 0x7fd91c0a8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:12.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.127+0000 7fd92106d640 1 -- 172.21.15.53:0/1899057590 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd90c009420 con 0x7fd91c0c8d00 2023-06-10T19:06:12.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.127+0000 7fd913fff640 1 --2- 172.21.15.53:0/1899057590 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd91c06bc00 0x7fd91c0a8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:06:12.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.127+0000 7fd92086c640 1 --2- 172.21.15.53:0/1899057590 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd91c06b2f0 0x7fd91c0c6fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:06:12.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.127+0000 7fd92106d640 1 --2- 172.21.15.53:0/1899057590 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd91c0c8d00 0x7fd91c0a9410 secure :-1 s=READY pgs=2105 cs=0 l=1 rev1=1 crypto rx=0x7fd914007e40 tx=0x7fd91400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:12.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.127+0000 7fd9117fa640 1 -- 172.21.15.53:0/1899057590 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd914014620 con 0x7fd91c0c8d00 2023-06-10T19:06:12.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.127+0000 7fd9117fa640 1 -- 172.21.15.53:0/1899057590 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd91400ee90 con 0x7fd91c0c8d00 2023-06-10T19:06:12.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.127+0000 7fd922ad0640 1 -- 172.21.15.53:0/1899057590 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd91c1eee60 con 0x7fd91c0c8d00 2023-06-10T19:06:12.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.127+0000 7fd9117fa640 1 -- 172.21.15.53:0/1899057590 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9140149e0 con 0x7fd91c0c8d00 2023-06-10T19:06:12.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.127+0000 7fd922ad0640 1 -- 172.21.15.53:0/1899057590 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd91c1ee830 con 0x7fd91c0c8d00 2023-06-10T19:06:12.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.131+0000 7fd922ad0640 1 -- 172.21.15.53:0/1899057590 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd91c1ef640 con 0x7fd91c0c8d00 2023-06-10T19:06:12.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.131+0000 7fd9117fa640 1 -- 172.21.15.53:0/1899057590 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd914014b40 con 0x7fd91c0c8d00 2023-06-10T19:06:12.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.131+0000 7fd9117fa640 1 --2- 172.21.15.53:0/1899057590 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd908066280 0x7fd908068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:12.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.131+0000 7fd9117fa640 1 -- 172.21.15.53:0/1899057590 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6148+0+0 (secure 0 0 0) 0x7fd914084730 con 0x7fd91c0c8d00 2023-06-10T19:06:12.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.131+0000 7fd92086c640 1 --2- 172.21.15.53:0/1899057590 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd908066280 0x7fd908068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:12.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.131+0000 7fd92086c640 1 --2- 172.21.15.53:0/1899057590 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd908066280 0x7fd908068730 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fd918007fd0 tx=0x7fd918009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:12.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.135+0000 7fd9117fa640 1 -- 172.21.15.53:0/1899057590 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd914051b50 con 0x7fd91c0c8d00 2023-06-10T19:06:12.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.291+0000 7fd922ad0640 1 -- 172.21.15.53:0/1899057590 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd91c04d790 con 0x7fd91c0c8d00 2023-06-10T19:06:12.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.291+0000 7fd9117fa640 1 -- 172.21.15.53:0/1899057590 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v142) v1 ==== 74+0+18426 (secure 0 0 0) 0x7fd914055170 con 0x7fd91c0c8d00 2023-06-10T19:06:12.295 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:06:12.295 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":142,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:06:04.229769+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-06-10T19:05:48.449837+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-06-10T19:05:49.783728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.53:6835/1171476971":"2023-06-11T19:06:04.182476+0000","172.21.15.53:6834/1171476971":"2023-06-11T19:06:04.182476+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:06:12.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.295+0000 7fd922ad0640 1 -- 172.21.15.53:0/1899057590 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd908066280 msgr2=0x7fd908068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:12.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.295+0000 7fd922ad0640 1 --2- 172.21.15.53:0/1899057590 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd908066280 0x7fd908068730 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fd918007fd0 tx=0x7fd918009040 comp rx=0 tx=0).stop 2023-06-10T19:06:12.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.295+0000 7fd922ad0640 1 -- 172.21.15.53:0/1899057590 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd91c0c8d00 msgr2=0x7fd91c0a9410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:12.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.295+0000 7fd922ad0640 1 --2- 172.21.15.53:0/1899057590 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd91c0c8d00 0x7fd91c0a9410 secure :-1 s=READY pgs=2105 cs=0 l=1 rev1=1 crypto rx=0x7fd914007e40 tx=0x7fd91400e4b0 comp rx=0 tx=0).stop 2023-06-10T19:06:12.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.295+0000 7fd922ad0640 1 -- 172.21.15.53:0/1899057590 shutdown_connections 2023-06-10T19:06:12.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.295+0000 7fd922ad0640 1 --2- 172.21.15.53:0/1899057590 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd908066280 0x7fd908068730 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:12.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.295+0000 7fd922ad0640 1 --2- 172.21.15.53:0/1899057590 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd91c0c8d00 0x7fd91c0a9410 unknown :-1 s=CLOSED pgs=2105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:12.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.295+0000 7fd922ad0640 1 --2- 172.21.15.53:0/1899057590 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd91c06bc00 0x7fd91c0a8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:12.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.295+0000 7fd922ad0640 1 --2- 172.21.15.53:0/1899057590 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd91c06b2f0 0x7fd91c0c6fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:12.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.295+0000 7fd922ad0640 1 -- 172.21.15.53:0/1899057590 >> 172.21.15.53:0/1899057590 conn(0x7fd91c06a0d0 msgr2=0x7fd91c0c80b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:12.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.295+0000 7fd922ad0640 1 -- 172.21.15.53:0/1899057590 shutdown_connections 2023-06-10T19:06:12.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.295+0000 7fd922ad0640 1 -- 172.21.15.53:0/1899057590 wait complete. 2023-06-10T19:06:12.313 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-10T18:52:33.633114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-10T18:52:39.171487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 19, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-10T19:05:48.449837+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '137', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 20, 'pool_name': 'cephfs_data', 'create_time': '2023-06-10T19:05:49.783728+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '138', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-10T19:06:12.314 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-10T19:06:12.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.427+0000 7efccb333640 1 Processor -- start 2023-06-10T19:06:12.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.427+0000 7efccb333640 1 -- start start 2023-06-10T19:06:12.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.427+0000 7efccb333640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7efcc4158f40 0x7efcc40cb820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:12.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.427+0000 7efccb333640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efcc40cbd60 0x7efcc406b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:12.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.427+0000 7efccb333640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcc406c230 con 0x7efcc41558e0 2023-06-10T19:06:12.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.427+0000 7efccb333640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcc406ca40 con 0x7efcc4158f40 2023-06-10T19:06:12.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.427+0000 7efccb333640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcc4155cb0 con 0x7efcc40cbd60 2023-06-10T19:06:12.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.427+0000 7efcc90cf640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7efcc41558e0 0x7efcc40c82a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60302/0 (socket says 172.21.15.53:60302) 2023-06-10T19:06:12.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.427+0000 7efcc90cf640 1 -- 172.21.15.53:0/2274710467 learned_addr learned my addr 172.21.15.53:0/2274710467 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:06:12.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.427+0000 7efcc88ce640 1 --2- 172.21.15.53:0/2274710467 >> v2:172.21.15.117:3300/0 conn(0x7efcc4158f40 0x7efcc40cb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:12.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.427+0000 7efcc98d0640 1 --2- 172.21.15.53:0/2274710467 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efcc40cbd60 0x7efcc406b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:12.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.427+0000 7efcbbfff640 1 -- 172.21.15.53:0/2274710467 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2687881800 0 0) 0x7efcc406c230 con 0x7efcc41558e0 2023-06-10T19:06:12.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.427+0000 7efcbbfff640 1 -- 172.21.15.53:0/2274710467 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efcb0003530 con 0x7efcc41558e0 2023-06-10T19:06:12.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.427+0000 7efcbbfff640 1 -- 172.21.15.53:0/2274710467 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2838409490 0 0) 0x7efcb0003530 con 0x7efcc41558e0 2023-06-10T19:06:12.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.427+0000 7efcbbfff640 1 -- 172.21.15.53:0/2274710467 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efcc40cbd60 msgr2=0x7efcc406b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:12.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.427+0000 7efcbbfff640 1 --2- 172.21.15.53:0/2274710467 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efcc40cbd60 0x7efcc406b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:12.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.427+0000 7efcbbfff640 1 -- 172.21.15.53:0/2274710467 >> v2:172.21.15.117:3300/0 conn(0x7efcc4158f40 msgr2=0x7efcc40cb820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:12.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.427+0000 7efcbbfff640 1 --2- 172.21.15.53:0/2274710467 >> v2:172.21.15.117:3300/0 conn(0x7efcc4158f40 0x7efcc40cb820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:12.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.427+0000 7efcbbfff640 1 -- 172.21.15.53:0/2274710467 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcc406c480 con 0x7efcc41558e0 2023-06-10T19:06:12.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.427+0000 7efcbbfff640 1 -- 172.21.15.53:0/2274710467 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7efcbc001a00 con 0x7efcc41558e0 2023-06-10T19:06:12.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.427+0000 7efcbbfff640 1 -- 172.21.15.53:0/2274710467 >> v1:172.21.15.53:6789/0 conn(0x7efcc41558e0 legacy=0x7efcc40c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:12.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.427+0000 7efcbbfff640 1 --2- 172.21.15.53:0/2274710467 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcb0003980 0x7efcb0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:12.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.427+0000 7efcbbfff640 1 --2- 172.21.15.53:0/2274710467 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efcb00047d0 0x7efcb0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:12.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.427+0000 7efcbbfff640 1 --2- 172.21.15.53:0/2274710467 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efcc40cbd60 0x7efcb0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:12.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.427+0000 7efcbbfff640 1 -- 172.21.15.53:0/2274710467 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcc406ca40 con 0x7efcb00047d0 2023-06-10T19:06:12.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.427+0000 7efcbbfff640 1 -- 172.21.15.53:0/2274710467 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcc4155cb0 con 0x7efcb0003980 2023-06-10T19:06:12.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.427+0000 7efcbbfff640 1 -- 172.21.15.53:0/2274710467 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcb000ba10 con 0x7efcc40cbd60 2023-06-10T19:06:12.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.427+0000 7efcc88ce640 1 --2- 172.21.15.53:0/2274710467 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efcb00047d0 0x7efcb0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:12.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.431+0000 7efcc88ce640 1 -- 172.21.15.53:0/2274710467 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efcc40cbd60 msgr2=0x7efcb0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:12.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.431+0000 7efcc98d0640 1 --2- 172.21.15.53:0/2274710467 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efcc40cbd60 0x7efcb0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:12.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.431+0000 7efcc88ce640 1 --2- 172.21.15.53:0/2274710467 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efcc40cbd60 0x7efcb0005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:12.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.431+0000 7efcc88ce640 1 -- 172.21.15.53:0/2274710467 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcb0003980 msgr2=0x7efcb0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:12.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.431+0000 7efcc88ce640 1 --2- 172.21.15.53:0/2274710467 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcb0003980 0x7efcb0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:12.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.431+0000 7efcc88ce640 1 -- 172.21.15.53:0/2274710467 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcb0003530 con 0x7efcb00047d0 2023-06-10T19:06:12.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.431+0000 7efcc88ce640 1 --2- 172.21.15.53:0/2274710467 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efcb00047d0 0x7efcb0004c40 secure :-1 s=READY pgs=2107 cs=0 l=1 rev1=1 crypto rx=0x7efcb4009ae0 tx=0x7efcb401ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b584a87bda92ef3a server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:12.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.431+0000 7efcbbfff640 1 -- 172.21.15.53:0/2274710467 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb40a55d0 con 0x7efcb00047d0 2023-06-10T19:06:12.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.431+0000 7efcbbfff640 1 -- 172.21.15.53:0/2274710467 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcb40a5730 con 0x7efcb00047d0 2023-06-10T19:06:12.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.431+0000 7efcbbfff640 1 -- 172.21.15.53:0/2274710467 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb40a5ae0 con 0x7efcb00047d0 2023-06-10T19:06:12.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.431+0000 7efccb333640 1 -- 172.21.15.53:0/2274710467 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efcb00047d0 msgr2=0x7efcb0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:12.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.431+0000 7efccb333640 1 --2- 172.21.15.53:0/2274710467 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efcb00047d0 0x7efcb0004c40 secure :-1 s=READY pgs=2107 cs=0 l=1 rev1=1 crypto rx=0x7efcb4009ae0 tx=0x7efcb401ca60 comp rx=0 tx=0).stop 2023-06-10T19:06:12.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.431+0000 7efcc98d0640 1 -- 172.21.15.53:0/2274710467 reap_dead start 2023-06-10T19:06:12.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.431+0000 7efccb333640 1 -- 172.21.15.53:0/2274710467 shutdown_connections 2023-06-10T19:06:12.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.431+0000 7efccb333640 1 -- 172.21.15.53:0/2274710467 >> 172.21.15.53:0/2274710467 conn(0x7efcc406a0e0 msgr2=0x7efcc40cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:12.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.431+0000 7efccb333640 1 -- 172.21.15.53:0/2274710467 shutdown_connections 2023-06-10T19:06:12.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.431+0000 7efccb333640 1 -- 172.21.15.53:0/2274710467 wait complete. 2023-06-10T19:06:12.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.435+0000 7efccb333640 1 Processor -- start 2023-06-10T19:06:12.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.435+0000 7efccb333640 1 -- start start 2023-06-10T19:06:12.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.435+0000 7efccb333640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efcb00047d0 0x7efcc406ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:12.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.435+0000 7efccb333640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efcc4154800 0x7efcc4153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:12.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.435+0000 7efccb333640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcc4163e80 0x7efcc4164300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:12.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.435+0000 7efccb333640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcc40c8910 con 0x7efcc4154800 2023-06-10T19:06:12.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.435+0000 7efccb333640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcc40b2800 con 0x7efcc4163e80 2023-06-10T19:06:12.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.435+0000 7efccb333640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcc40b1bc0 con 0x7efcb00047d0 2023-06-10T19:06:12.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.435+0000 7efcc88ce640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efcc4154800 0x7efcc4153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:12.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.435+0000 7efcc88ce640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efcc4154800 0x7efcc4153cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42018/0 (socket says 172.21.15.53:42018) 2023-06-10T19:06:12.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.435+0000 7efcc88ce640 1 -- 172.21.15.53:0/3831792792 learned_addr learned my addr 172.21.15.53:0/3831792792 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:12.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.435+0000 7efcc90cf640 1 --2- 172.21.15.53:0/3831792792 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efcb00047d0 0x7efcc406ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:12.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.435+0000 7efcc98d0640 1 --2- 172.21.15.53:0/3831792792 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcc4163e80 0x7efcc4164300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:12.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.435+0000 7efcc88ce640 1 -- 172.21.15.53:0/3831792792 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efcb00047d0 msgr2=0x7efcc406ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:12.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.435+0000 7efcc88ce640 1 --2- 172.21.15.53:0/3831792792 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efcb00047d0 0x7efcc406ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:12.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.435+0000 7efcc88ce640 1 -- 172.21.15.53:0/3831792792 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcc4163e80 msgr2=0x7efcc4164300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:12.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.435+0000 7efcc88ce640 1 --2- 172.21.15.53:0/3831792792 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcc4163e80 0x7efcc4164300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:12.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.435+0000 7efcc88ce640 1 -- 172.21.15.53:0/3831792792 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcc40b1e60 con 0x7efcc4154800 2023-06-10T19:06:12.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.435+0000 7efcc88ce640 1 --2- 172.21.15.53:0/3831792792 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efcc4154800 0x7efcc4153cd0 secure :-1 s=READY pgs=2108 cs=0 l=1 rev1=1 crypto rx=0x7efcb4009ae0 tx=0x7efcb0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:12.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.435+0000 7efcb9ffb640 1 -- 172.21.15.53:0/3831792792 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb40a55d0 con 0x7efcc4154800 2023-06-10T19:06:12.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.435+0000 7efcb9ffb640 1 -- 172.21.15.53:0/3831792792 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcb4004020 con 0x7efcc4154800 2023-06-10T19:06:12.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.435+0000 7efccb333640 1 -- 172.21.15.53:0/3831792792 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcc40b2140 con 0x7efcc4154800 2023-06-10T19:06:12.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.435+0000 7efcb9ffb640 1 -- 172.21.15.53:0/3831792792 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb4004390 con 0x7efcc4154800 2023-06-10T19:06:12.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.435+0000 7efccb333640 1 -- 172.21.15.53:0/3831792792 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcc4164840 con 0x7efcc4154800 2023-06-10T19:06:12.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.435+0000 7efccb333640 1 -- 172.21.15.53:0/3831792792 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcc404d790 con 0x7efcc4154800 2023-06-10T19:06:12.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.435+0000 7efcb9ffb640 1 -- 172.21.15.53:0/3831792792 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7efcb40b4040 con 0x7efcc4154800 2023-06-10T19:06:12.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.435+0000 7efcb9ffb640 1 --2- 172.21.15.53:0/3831792792 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efca8066280 0x7efca8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:12.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.435+0000 7efcb9ffb640 1 -- 172.21.15.53:0/3831792792 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6148+0+0 (secure 0 0 0) 0x7efcb411ddb0 con 0x7efcc4154800 2023-06-10T19:06:12.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.435+0000 7efcc90cf640 1 --2- 172.21.15.53:0/3831792792 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efca8066280 0x7efca8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:12.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.439+0000 7efcc90cf640 1 --2- 172.21.15.53:0/3831792792 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efca8066280 0x7efca8068730 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7efcbc001b90 tx=0x7efcbc0019e0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:12.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.439+0000 7efcb9ffb640 1 -- 172.21.15.53:0/3831792792 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7efcb40eb310 con 0x7efcc4154800 2023-06-10T19:06:12.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.587+0000 7efccb333640 1 -- 172.21.15.53:0/3831792792 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efcc40b3c60 con 0x7efcc4154800 2023-06-10T19:06:12.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.587+0000 7efcb9ffb640 1 -- 172.21.15.53:0/3831792792 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v142) v1 ==== 93+0+10 (secure 0 0 0) 0x7efcb40044f0 con 0x7efcc4154800 2023-06-10T19:06:12.589 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-06-10T19:06:12.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.587+0000 7efccb333640 1 -- 172.21.15.53:0/3831792792 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efca8066280 msgr2=0x7efca8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:12.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.587+0000 7efccb333640 1 --2- 172.21.15.53:0/3831792792 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efca8066280 0x7efca8068730 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7efcbc001b90 tx=0x7efcbc0019e0 comp rx=0 tx=0).stop 2023-06-10T19:06:12.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.587+0000 7efccb333640 1 -- 172.21.15.53:0/3831792792 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efcc4154800 msgr2=0x7efcc4153cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:12.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.587+0000 7efccb333640 1 --2- 172.21.15.53:0/3831792792 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efcc4154800 0x7efcc4153cd0 secure :-1 s=READY pgs=2108 cs=0 l=1 rev1=1 crypto rx=0x7efcb4009ae0 tx=0x7efcb0005800 comp rx=0 tx=0).stop 2023-06-10T19:06:12.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.587+0000 7efccb333640 1 -- 172.21.15.53:0/3831792792 shutdown_connections 2023-06-10T19:06:12.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.587+0000 7efccb333640 1 --2- 172.21.15.53:0/3831792792 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efca8066280 0x7efca8068730 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:12.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.587+0000 7efccb333640 1 --2- 172.21.15.53:0/3831792792 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcc4163e80 0x7efcc4164300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:12.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.591+0000 7efccb333640 1 --2- 172.21.15.53:0/3831792792 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efcc4154800 0x7efcc4153cd0 unknown :-1 s=CLOSED pgs=2108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:12.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.591+0000 7efccb333640 1 --2- 172.21.15.53:0/3831792792 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efcb00047d0 0x7efcc406ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:12.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.591+0000 7efccb333640 1 -- 172.21.15.53:0/3831792792 >> 172.21.15.53:0/3831792792 conn(0x7efcc406a0e0 msgr2=0x7efcc4159460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:12.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.591+0000 7efccb333640 1 -- 172.21.15.53:0/3831792792 shutdown_connections 2023-06-10T19:06:12.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.591+0000 7efccb333640 1 -- 172.21.15.53:0/3831792792 wait complete. 2023-06-10T19:06:12.608 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-10T19:06:12.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.723+0000 7f2e2bfac640 1 Processor -- start 2023-06-10T19:06:12.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.723+0000 7f2e2bfac640 1 -- start start 2023-06-10T19:06:12.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.723+0000 7f2e2bfac640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2e240af760 0x7f2e240c9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:12.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.723+0000 7f2e2bfac640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e240afb30 0x7f2e2415dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:12.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.723+0000 7f2e2bfac640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e240706f0 con 0x7f2e24070b80 2023-06-10T19:06:12.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.723+0000 7f2e2bfac640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e2415ab10 con 0x7f2e240af760 2023-06-10T19:06:12.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.723+0000 7f2e2bfac640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e240700e0 con 0x7f2e240afb30 2023-06-10T19:06:12.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.723+0000 7f2e2a549640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f2e24070b80 0x7f2e2406b090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60318/0 (socket says 172.21.15.53:60318) 2023-06-10T19:06:12.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.723+0000 7f2e2a549640 1 -- 172.21.15.53:0/480141775 learned_addr learned my addr 172.21.15.53:0/480141775 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:06:12.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.723+0000 7f2e29547640 1 --2- 172.21.15.53:0/480141775 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e240afb30 0x7f2e2415dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:12.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.723+0000 7f2e29d48640 1 --2- 172.21.15.53:0/480141775 >> v2:172.21.15.117:3300/0 conn(0x7f2e240af760 0x7f2e240c9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:12.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.723+0000 7f2e28d46640 1 -- 172.21.15.53:0/480141775 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3819829229 0 0) 0x7f2e240706f0 con 0x7f2e24070b80 2023-06-10T19:06:12.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.723+0000 7f2e28d46640 1 -- 172.21.15.53:0/480141775 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e10003530 con 0x7f2e24070b80 2023-06-10T19:06:12.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.723+0000 7f2e29547640 1 -- 172.21.15.53:0/480141775 >> v2:172.21.15.117:3300/0 conn(0x7f2e240af760 msgr2=0x7f2e240c9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:12.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.723+0000 7f2e29547640 1 --2- 172.21.15.53:0/480141775 >> v2:172.21.15.117:3300/0 conn(0x7f2e240af760 0x7f2e240c9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:12.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.723+0000 7f2e29547640 1 -- 172.21.15.53:0/480141775 >> v1:172.21.15.53:6789/0 conn(0x7f2e24070b80 legacy=0x7f2e2406b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:12.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.723+0000 7f2e29547640 1 -- 172.21.15.53:0/480141775 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e240c9e10 con 0x7f2e240afb30 2023-06-10T19:06:12.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.727+0000 7f2e29547640 1 --2- 172.21.15.53:0/480141775 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e240afb30 0x7f2e2415dbd0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2e140097c0 tx=0x7f2e1401c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8cfd7b737774260d server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:12.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.727+0000 7f2e28d46640 1 -- 172.21.15.53:0/480141775 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e140ab650 con 0x7f2e240afb30 2023-06-10T19:06:12.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.727+0000 7f2e28d46640 1 -- 172.21.15.53:0/480141775 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e140ab7b0 con 0x7f2e240afb30 2023-06-10T19:06:12.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.727+0000 7f2e28d46640 1 -- 172.21.15.53:0/480141775 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e140abb20 con 0x7f2e240afb30 2023-06-10T19:06:12.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.727+0000 7f2e2bfac640 1 -- 172.21.15.53:0/480141775 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e240afb30 msgr2=0x7f2e2415dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:12.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.727+0000 7f2e2bfac640 1 --2- 172.21.15.53:0/480141775 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e240afb30 0x7f2e2415dbd0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2e140097c0 tx=0x7f2e1401c450 comp rx=0 tx=0).stop 2023-06-10T19:06:12.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.727+0000 7f2e2bfac640 1 -- 172.21.15.53:0/480141775 shutdown_connections 2023-06-10T19:06:12.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.727+0000 7f2e2bfac640 1 --2- 172.21.15.53:0/480141775 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e240afb30 0x7f2e2415dbd0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:12.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.727+0000 7f2e2bfac640 1 --2- 172.21.15.53:0/480141775 >> v2:172.21.15.117:3300/0 conn(0x7f2e240af760 0x7f2e240c9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:12.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.727+0000 7f2e2bfac640 1 -- 172.21.15.53:0/480141775 >> 172.21.15.53:0/480141775 conn(0x7f2e2406a0e0 msgr2=0x7f2e240cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:12.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.727+0000 7f2e2bfac640 1 -- 172.21.15.53:0/480141775 shutdown_connections 2023-06-10T19:06:12.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.727+0000 7f2e2bfac640 1 -- 172.21.15.53:0/480141775 wait complete. 2023-06-10T19:06:12.732 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.727+0000 7f2e2bfac640 1 Processor -- start 2023-06-10T19:06:12.732 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.727+0000 7f2e2bfac640 1 -- start start 2023-06-10T19:06:12.732 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.727+0000 7f2e2bfac640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e24070b80 0x7f2e240c42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:12.732 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.727+0000 7f2e2bfac640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e240af760 0x7f2e240ccad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:12.732 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.727+0000 7f2e2bfac640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e240afb30 0x7f2e24156a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:12.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.727+0000 7f2e2bfac640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e240c3720 con 0x7f2e240afb30 2023-06-10T19:06:12.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.727+0000 7f2e2bfac640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e240c2b10 con 0x7f2e24070b80 2023-06-10T19:06:12.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.727+0000 7f2e2bfac640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e240c2df0 con 0x7f2e240af760 2023-06-10T19:06:12.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.727+0000 7f2e2a549640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e240afb30 0x7f2e24156a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:12.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.727+0000 7f2e2a549640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e240afb30 0x7f2e24156a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42020/0 (socket says 172.21.15.53:42020) 2023-06-10T19:06:12.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.727+0000 7f2e2a549640 1 -- 172.21.15.53:0/3860579146 learned_addr learned my addr 172.21.15.53:0/3860579146 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:12.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.727+0000 7f2e29d48640 1 --2- 172.21.15.53:0/3860579146 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e24070b80 0x7f2e240c42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:12.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.727+0000 7f2e29547640 1 --2- 172.21.15.53:0/3860579146 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e240af760 0x7f2e240ccad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:12.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.727+0000 7f2e2a549640 1 -- 172.21.15.53:0/3860579146 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e240af760 msgr2=0x7f2e240ccad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:12.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.727+0000 7f2e2a549640 1 --2- 172.21.15.53:0/3860579146 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e240af760 0x7f2e240ccad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:12.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.727+0000 7f2e2a549640 1 -- 172.21.15.53:0/3860579146 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e24070b80 msgr2=0x7f2e240c42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:12.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.727+0000 7f2e2a549640 1 --2- 172.21.15.53:0/3860579146 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e24070b80 0x7f2e240c42f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:12.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.727+0000 7f2e2a549640 1 -- 172.21.15.53:0/3860579146 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e14009420 con 0x7f2e240afb30 2023-06-10T19:06:12.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.727+0000 7f2e29547640 1 --2- 172.21.15.53:0/3860579146 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e240af760 0x7f2e240ccad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:06:12.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.731+0000 7f2e2a549640 1 --2- 172.21.15.53:0/3860579146 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e240afb30 0x7f2e24156a20 secure :-1 s=READY pgs=2110 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c00ca20 tx=0x7f2e1c00cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:12.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.731+0000 7f2e1a7fc640 1 -- 172.21.15.53:0/3860579146 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e1c00abd0 con 0x7f2e240afb30 2023-06-10T19:06:12.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.731+0000 7f2e1a7fc640 1 -- 172.21.15.53:0/3860579146 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e1c00ad30 con 0x7f2e240afb30 2023-06-10T19:06:12.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.731+0000 7f2e2bfac640 1 -- 172.21.15.53:0/3860579146 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e240b0100 con 0x7f2e240afb30 2023-06-10T19:06:12.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.731+0000 7f2e1a7fc640 1 -- 172.21.15.53:0/3860579146 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e1c012620 con 0x7f2e240afb30 2023-06-10T19:06:12.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.731+0000 7f2e2bfac640 1 -- 172.21.15.53:0/3860579146 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e240c33b0 con 0x7f2e240afb30 2023-06-10T19:06:12.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.731+0000 7f2e2bfac640 1 -- 172.21.15.53:0/3860579146 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e240c3890 con 0x7f2e240afb30 2023-06-10T19:06:12.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.731+0000 7f2e1a7fc640 1 -- 172.21.15.53:0/3860579146 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2e1c007070 con 0x7f2e240afb30 2023-06-10T19:06:12.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.731+0000 7f2e1a7fc640 1 --2- 172.21.15.53:0/3860579146 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2e08066280 0x7f2e08068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:12.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.731+0000 7f2e1a7fc640 1 -- 172.21.15.53:0/3860579146 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f2e1c083d50 con 0x7f2e240afb30 2023-06-10T19:06:12.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.731+0000 7f2e29d48640 1 --2- 172.21.15.53:0/3860579146 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2e08066280 0x7f2e08068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:12.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.731+0000 7f2e29d48640 1 --2- 172.21.15.53:0/3860579146 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2e08066280 0x7f2e08068730 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f2e20009a50 tx=0x7f2e20008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:12.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.735+0000 7f2e1a7fc640 1 -- 172.21.15.53:0/3860579146 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2e1c087030 con 0x7f2e240afb30 2023-06-10T19:06:12.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.883+0000 7f2e2bfac640 1 -- 172.21.15.53:0/3860579146 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2e2404d790 con 0x7f2e240afb30 2023-06-10T19:06:12.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.887+0000 7f2e1a7fc640 1 -- 172.21.15.53:0/3860579146 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v142) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2e1c0510f0 con 0x7f2e240afb30 2023-06-10T19:06:12.887 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-06-10T19:06:12.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.887+0000 7f2e2bfac640 1 -- 172.21.15.53:0/3860579146 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2e08066280 msgr2=0x7f2e08068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:12.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.887+0000 7f2e2bfac640 1 --2- 172.21.15.53:0/3860579146 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2e08066280 0x7f2e08068730 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f2e20009a50 tx=0x7f2e20008040 comp rx=0 tx=0).stop 2023-06-10T19:06:12.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.887+0000 7f2e2bfac640 1 -- 172.21.15.53:0/3860579146 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e240afb30 msgr2=0x7f2e24156a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:12.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.887+0000 7f2e2bfac640 1 --2- 172.21.15.53:0/3860579146 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e240afb30 0x7f2e24156a20 secure :-1 s=READY pgs=2110 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c00ca20 tx=0x7f2e1c00cee0 comp rx=0 tx=0).stop 2023-06-10T19:06:12.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.887+0000 7f2e2bfac640 1 -- 172.21.15.53:0/3860579146 shutdown_connections 2023-06-10T19:06:12.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.887+0000 7f2e2bfac640 1 --2- 172.21.15.53:0/3860579146 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2e08066280 0x7f2e08068730 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:12.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.887+0000 7f2e2bfac640 1 --2- 172.21.15.53:0/3860579146 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e240afb30 0x7f2e24156a20 unknown :-1 s=CLOSED pgs=2110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:12.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.887+0000 7f2e2bfac640 1 --2- 172.21.15.53:0/3860579146 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e240af760 0x7f2e240ccad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:12.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.887+0000 7f2e2bfac640 1 --2- 172.21.15.53:0/3860579146 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e24070b80 0x7f2e240c42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:12.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.887+0000 7f2e2bfac640 1 -- 172.21.15.53:0/3860579146 >> 172.21.15.53:0/3860579146 conn(0x7f2e2406a0e0 msgr2=0x7f2e2406f140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:12.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.887+0000 7f2e2bfac640 1 -- 172.21.15.53:0/3860579146 shutdown_connections 2023-06-10T19:06:12.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:12.887+0000 7f2e2bfac640 1 -- 172.21.15.53:0/3860579146 wait complete. 2023-06-10T19:06:12.904 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-10T19:06:13.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.031+0000 7f831de52640 1 Processor -- start 2023-06-10T19:06:13.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.031+0000 7f831de52640 1 -- start start 2023-06-10T19:06:13.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.031+0000 7f831de52640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83180c9fa0 0x7f831806bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:13.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.031+0000 7f831de52640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f83180af760 0x7f83180afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:13.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.031+0000 7f831de52640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f831806b090 con 0x7f831806c020 2023-06-10T19:06:13.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.031+0000 7f831de52640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83180b0120 con 0x7f83180af760 2023-06-10T19:06:13.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.031+0000 7f831de52640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83180ca370 con 0x7f83180c9fa0 2023-06-10T19:06:13.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.031+0000 7f8317fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f83180af760 0x7f83180afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:13.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.031+0000 7f8317fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f83180af760 0x7f83180afbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42036/0 (socket says 172.21.15.53:42036) 2023-06-10T19:06:13.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.031+0000 7f8317fff640 1 -- 172.21.15.53:0/1804891879 learned_addr learned my addr 172.21.15.53:0/1804891879 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:13.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.031+0000 7f83177fe640 1 --2- 172.21.15.53:0/1804891879 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83180c9fa0 0x7f831806bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:13.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.031+0000 7f8317fff640 1 -- 172.21.15.53:0/1804891879 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83180c9fa0 msgr2=0x7f831806bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:13.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.031+0000 7f8317fff640 1 --2- 172.21.15.53:0/1804891879 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83180c9fa0 0x7f831806bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:13.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.031+0000 7f8317fff640 1 -- 172.21.15.53:0/1804891879 >> v1:172.21.15.117:6789/0 conn(0x7f831806c020 legacy=0x7f83180c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:13.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.031+0000 7f8317fff640 1 -- 172.21.15.53:0/1804891879 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8318070d50 con 0x7f83180af760 2023-06-10T19:06:13.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.035+0000 7f8317fff640 1 --2- 172.21.15.53:0/1804891879 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83180af760 0x7f83180afbe0 secure :-1 s=READY pgs=2111 cs=0 l=1 rev1=1 crypto rx=0x7f8310009e50 tx=0x7f831001c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa3dabc4e4bd48c4 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:13.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.035+0000 7f83167fc640 1 -- 172.21.15.53:0/1804891879 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83100a5720 con 0x7f83180af760 2023-06-10T19:06:13.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.035+0000 7f83167fc640 1 -- 172.21.15.53:0/1804891879 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83100a5880 con 0x7f83180af760 2023-06-10T19:06:13.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.035+0000 7f83167fc640 1 -- 172.21.15.53:0/1804891879 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83100a5c10 con 0x7f83180af760 2023-06-10T19:06:13.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.035+0000 7f831de52640 1 -- 172.21.15.53:0/1804891879 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83180af760 msgr2=0x7f83180afbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:13.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.035+0000 7f831de52640 1 --2- 172.21.15.53:0/1804891879 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83180af760 0x7f83180afbe0 secure :-1 s=READY pgs=2111 cs=0 l=1 rev1=1 crypto rx=0x7f8310009e50 tx=0x7f831001c950 comp rx=0 tx=0).stop 2023-06-10T19:06:13.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.035+0000 7f831de52640 1 -- 172.21.15.53:0/1804891879 shutdown_connections 2023-06-10T19:06:13.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.035+0000 7f831de52640 1 --2- 172.21.15.53:0/1804891879 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83180af760 0x7f83180afbe0 unknown :-1 s=CLOSED pgs=2111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:13.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.035+0000 7f831de52640 1 --2- 172.21.15.53:0/1804891879 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83180c9fa0 0x7f831806bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:13.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.035+0000 7f831de52640 1 -- 172.21.15.53:0/1804891879 >> 172.21.15.53:0/1804891879 conn(0x7f831806a0e0 msgr2=0x7f83180cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:13.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.035+0000 7f831de52640 1 -- 172.21.15.53:0/1804891879 shutdown_connections 2023-06-10T19:06:13.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.035+0000 7f831de52640 1 -- 172.21.15.53:0/1804891879 wait complete. 2023-06-10T19:06:13.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.035+0000 7f831de52640 1 Processor -- start 2023-06-10T19:06:13.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.035+0000 7f831de52640 1 -- start start 2023-06-10T19:06:13.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.039+0000 7f831de52640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f831806c020 0x7f83180c19e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:13.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.039+0000 7f831de52640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83180af760 0x7f8318156860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:13.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.039+0000 7f831de52640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83180c9fa0 0x7f831815c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:13.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.039+0000 7f831de52640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83181573d0 con 0x7f831806c020 2023-06-10T19:06:13.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.039+0000 7f831de52640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8318161780 con 0x7f83180af760 2023-06-10T19:06:13.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.039+0000 7f831de52640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8318161a60 con 0x7f83180c9fa0 2023-06-10T19:06:13.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.039+0000 7f83177fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f831806c020 0x7f83180c19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:13.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.039+0000 7f83177fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f831806c020 0x7f83180c19e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42040/0 (socket says 172.21.15.53:42040) 2023-06-10T19:06:13.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.039+0000 7f83177fe640 1 -- 172.21.15.53:0/2106611281 learned_addr learned my addr 172.21.15.53:0/2106611281 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:13.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.039+0000 7f8316ffd640 1 --2- 172.21.15.53:0/2106611281 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83180af760 0x7f8318156860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:13.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.039+0000 7f8317fff640 1 --2- 172.21.15.53:0/2106611281 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83180c9fa0 0x7f831815c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:13.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.039+0000 7f83177fe640 1 -- 172.21.15.53:0/2106611281 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83180c9fa0 msgr2=0x7f831815c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:13.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.039+0000 7f83177fe640 1 --2- 172.21.15.53:0/2106611281 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83180c9fa0 0x7f831815c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:13.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.039+0000 7f83177fe640 1 -- 172.21.15.53:0/2106611281 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83180af760 msgr2=0x7f8318156860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:13.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.039+0000 7f83177fe640 1 --2- 172.21.15.53:0/2106611281 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83180af760 0x7f8318156860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:13.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.039+0000 7f83177fe640 1 -- 172.21.15.53:0/2106611281 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8310009b30 con 0x7f831806c020 2023-06-10T19:06:13.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.039+0000 7f8317fff640 1 --2- 172.21.15.53:0/2106611281 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83180c9fa0 0x7f831815c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:06:13.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.039+0000 7f83177fe640 1 --2- 172.21.15.53:0/2106611281 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f831806c020 0x7f83180c19e0 secure :-1 s=READY pgs=2112 cs=0 l=1 rev1=1 crypto rx=0x7f830800d800 tx=0x7f830800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:13.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.039+0000 7f82fffff640 1 -- 172.21.15.53:0/2106611281 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f830800b6c0 con 0x7f831806c020 2023-06-10T19:06:13.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.039+0000 7f82fffff640 1 -- 172.21.15.53:0/2106611281 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f830800b820 con 0x7f831806c020 2023-06-10T19:06:13.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.039+0000 7f831de52640 1 -- 172.21.15.53:0/2106611281 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8318161d40 con 0x7f831806c020 2023-06-10T19:06:13.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.039+0000 7f82fffff640 1 -- 172.21.15.53:0/2106611281 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f830800bb90 con 0x7f831806c020 2023-06-10T19:06:13.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.039+0000 7f831de52640 1 -- 172.21.15.53:0/2106611281 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83180c1f20 con 0x7f831806c020 2023-06-10T19:06:13.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.039+0000 7f831de52640 1 -- 172.21.15.53:0/2106611281 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f831804d790 con 0x7f831806c020 2023-06-10T19:06:13.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.039+0000 7f82fffff640 1 -- 172.21.15.53:0/2106611281 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f830800bcf0 con 0x7f831806c020 2023-06-10T19:06:13.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.039+0000 7f82fffff640 1 --2- 172.21.15.53:0/2106611281 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8304066280 0x7f8304068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:13.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.039+0000 7f82fffff640 1 -- 172.21.15.53:0/2106611281 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f8308084290 con 0x7f831806c020 2023-06-10T19:06:13.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.039+0000 7f8316ffd640 1 --2- 172.21.15.53:0/2106611281 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8304066280 0x7f8304068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:13.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.043+0000 7f8316ffd640 1 --2- 172.21.15.53:0/2106611281 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8304066280 0x7f8304068730 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f831815bdc0 tx=0x7f830c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:13.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.043+0000 7f82fffff640 1 -- 172.21.15.53:0/2106611281 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f83080551d0 con 0x7f831806c020 2023-06-10T19:06:13.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.199+0000 7f831de52640 1 -- 172.21.15.53:0/2106611281 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f831806bd00 con 0x7f831806c020 2023-06-10T19:06:13.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.203+0000 7f82fffff640 1 -- 172.21.15.53:0/2106611281 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v142) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8308054d60 con 0x7f831806c020 2023-06-10T19:06:13.203 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-06-10T19:06:13.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.203+0000 7f831de52640 1 -- 172.21.15.53:0/2106611281 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8304066280 msgr2=0x7f8304068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:13.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.203+0000 7f831de52640 1 --2- 172.21.15.53:0/2106611281 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8304066280 0x7f8304068730 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f831815bdc0 tx=0x7f830c009040 comp rx=0 tx=0).stop 2023-06-10T19:06:13.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.203+0000 7f831de52640 1 -- 172.21.15.53:0/2106611281 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f831806c020 msgr2=0x7f83180c19e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:13.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.203+0000 7f831de52640 1 --2- 172.21.15.53:0/2106611281 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f831806c020 0x7f83180c19e0 secure :-1 s=READY pgs=2112 cs=0 l=1 rev1=1 crypto rx=0x7f830800d800 tx=0x7f830800dcc0 comp rx=0 tx=0).stop 2023-06-10T19:06:13.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.203+0000 7f831de52640 1 -- 172.21.15.53:0/2106611281 shutdown_connections 2023-06-10T19:06:13.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.203+0000 7f831de52640 1 --2- 172.21.15.53:0/2106611281 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8304066280 0x7f8304068730 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:13.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.203+0000 7f831de52640 1 --2- 172.21.15.53:0/2106611281 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83180c9fa0 0x7f831815c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:13.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.203+0000 7f831de52640 1 --2- 172.21.15.53:0/2106611281 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83180af760 0x7f8318156860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:13.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.203+0000 7f831de52640 1 --2- 172.21.15.53:0/2106611281 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f831806c020 0x7f83180c19e0 unknown :-1 s=CLOSED pgs=2112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:13.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.203+0000 7f831de52640 1 -- 172.21.15.53:0/2106611281 >> 172.21.15.53:0/2106611281 conn(0x7f831806a0e0 msgr2=0x7f83180b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:13.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.203+0000 7f831de52640 1 -- 172.21.15.53:0/2106611281 shutdown_connections 2023-06-10T19:06:13.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.203+0000 7f831de52640 1 -- 172.21.15.53:0/2106611281 wait complete. 2023-06-10T19:06:13.222 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-10T19:06:13.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.351+0000 7f4048a77640 1 Processor -- start 2023-06-10T19:06:13.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.351+0000 7f4048a77640 1 -- start start 2023-06-10T19:06:13.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.351+0000 7f4048a77640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f40440c9fa0 0x7f404406bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:13.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.351+0000 7f4048a77640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40440af760 0x7f40440afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:13.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.351+0000 7f4048a77640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f404406b090 con 0x7f404406c020 2023-06-10T19:06:13.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.351+0000 7f4048a77640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40440b0120 con 0x7f40440c9fa0 2023-06-10T19:06:13.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.351+0000 7f4048a77640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40440ca370 con 0x7f40440af760 2023-06-10T19:06:13.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.351+0000 7f4042d9d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40440af760 0x7f40440afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:13.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.351+0000 7f404259c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f40440c9fa0 0x7f404406bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:13.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.351+0000 7f404259c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f40440c9fa0 0x7f404406bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.53:55876/0 (socket says 172.21.15.53:55876) 2023-06-10T19:06:13.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.351+0000 7f404259c640 1 -- 172.21.15.53:0/640123353 learned_addr learned my addr 172.21.15.53:0/640123353 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:13.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.351+0000 7f4041d9b640 1 --1- 172.21.15.53:0/640123353 >> v1:172.21.15.117:6789/0 conn(0x7f404406c020 0x7f40440c82a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.53:35348/0 (socket says 172.21.15.53:35348) 2023-06-10T19:06:13.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.351+0000 7f4042d9d640 1 -- 172.21.15.53:0/640123353 >> v2:172.21.15.117:3300/0 conn(0x7f40440c9fa0 msgr2=0x7f404406bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:13.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.351+0000 7f4042d9d640 1 --2- 172.21.15.53:0/640123353 >> v2:172.21.15.117:3300/0 conn(0x7f40440c9fa0 0x7f404406bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:13.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.351+0000 7f4042d9d640 1 -- 172.21.15.53:0/640123353 >> v1:172.21.15.117:6789/0 conn(0x7f404406c020 legacy=0x7f40440c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:13.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.351+0000 7f4042d9d640 1 -- 172.21.15.53:0/640123353 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4044070d50 con 0x7f40440af760 2023-06-10T19:06:13.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.351+0000 7f404259c640 1 --2- 172.21.15.53:0/640123353 >> v2:172.21.15.117:3300/0 conn(0x7f40440c9fa0 0x7f404406bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-10T19:06:13.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.355+0000 7f4042d9d640 1 --2- 172.21.15.53:0/640123353 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40440af760 0x7f40440afbe0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f403c009d90 tx=0x7f403c01c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2d196eb30d349aa server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:13.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.355+0000 7f404159a640 1 -- 172.21.15.53:0/640123353 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403c0a5860 con 0x7f40440af760 2023-06-10T19:06:13.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.355+0000 7f404159a640 1 -- 172.21.15.53:0/640123353 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f403c0a59c0 con 0x7f40440af760 2023-06-10T19:06:13.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.355+0000 7f404159a640 1 -- 172.21.15.53:0/640123353 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403c0a5d50 con 0x7f40440af760 2023-06-10T19:06:13.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.355+0000 7f4048a77640 1 -- 172.21.15.53:0/640123353 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40440af760 msgr2=0x7f40440afbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:13.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.355+0000 7f4048a77640 1 --2- 172.21.15.53:0/640123353 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40440af760 0x7f40440afbe0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f403c009d90 tx=0x7f403c01c890 comp rx=0 tx=0).stop 2023-06-10T19:06:13.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.355+0000 7f4048a77640 1 -- 172.21.15.53:0/640123353 shutdown_connections 2023-06-10T19:06:13.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.355+0000 7f4048a77640 1 --2- 172.21.15.53:0/640123353 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f40440af760 0x7f40440afbe0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:13.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.355+0000 7f4048a77640 1 --2- 172.21.15.53:0/640123353 >> v2:172.21.15.117:3300/0 conn(0x7f40440c9fa0 0x7f404406bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:13.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.355+0000 7f4048a77640 1 -- 172.21.15.53:0/640123353 >> 172.21.15.53:0/640123353 conn(0x7f404406a0e0 msgr2=0x7f40440cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:13.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.355+0000 7f4048a77640 1 -- 172.21.15.53:0/640123353 shutdown_connections 2023-06-10T19:06:13.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.355+0000 7f4048a77640 1 -- 172.21.15.53:0/640123353 wait complete. 2023-06-10T19:06:13.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.355+0000 7f4048a77640 1 Processor -- start 2023-06-10T19:06:13.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.355+0000 7f4048a77640 1 -- start start 2023-06-10T19:06:13.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.355+0000 7f4048a77640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f404406c020 0x7f40440cc660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:13.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.359+0000 7f4048a77640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40440af760 0x7f4044155a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:13.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.359+0000 7f4048a77640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40440c9fa0 0x7f40440c3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:13.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.359+0000 7f4048a77640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40440b39a0 con 0x7f40440af760 2023-06-10T19:06:13.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.359+0000 7f4048a77640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4044148530 con 0x7f40440c9fa0 2023-06-10T19:06:13.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.359+0000 7f4048a77640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40440b2ae0 con 0x7f404406c020 2023-06-10T19:06:13.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.359+0000 7f4041d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40440af760 0x7f4044155a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:13.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.359+0000 7f4041d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40440af760 0x7f4044155a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42054/0 (socket says 172.21.15.53:42054) 2023-06-10T19:06:13.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.359+0000 7f4041d9b640 1 -- 172.21.15.53:0/1310187038 learned_addr learned my addr 172.21.15.53:0/1310187038 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:13.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.359+0000 7f4042d9d640 1 --2- 172.21.15.53:0/1310187038 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40440c9fa0 0x7f40440c3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:13.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.359+0000 7f4041d9b640 1 -- 172.21.15.53:0/1310187038 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f404406c020 msgr2=0x7f40440cc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:13.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.359+0000 7f404259c640 1 --2- 172.21.15.53:0/1310187038 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f404406c020 0x7f40440cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:13.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.359+0000 7f4041d9b640 1 --2- 172.21.15.53:0/1310187038 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f404406c020 0x7f40440cc660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:13.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.359+0000 7f4041d9b640 1 -- 172.21.15.53:0/1310187038 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40440c9fa0 msgr2=0x7f40440c3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:13.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.359+0000 7f4041d9b640 1 --2- 172.21.15.53:0/1310187038 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40440c9fa0 0x7f40440c3840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:13.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.359+0000 7f4041d9b640 1 -- 172.21.15.53:0/1310187038 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40340094d0 con 0x7f40440af760 2023-06-10T19:06:13.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.359+0000 7f4041d9b640 1 --2- 172.21.15.53:0/1310187038 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40440af760 0x7f4044155a60 secure :-1 s=READY pgs=2113 cs=0 l=1 rev1=1 crypto rx=0x7f403800c450 tx=0x7f403800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:13.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.359+0000 7f4032ffd640 1 -- 172.21.15.53:0/1310187038 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40380074e0 con 0x7f40440af760 2023-06-10T19:06:13.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.359+0000 7f4032ffd640 1 -- 172.21.15.53:0/1310187038 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4038007640 con 0x7f40440af760 2023-06-10T19:06:13.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.359+0000 7f4032ffd640 1 -- 172.21.15.53:0/1310187038 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4038004a30 con 0x7f40440af760 2023-06-10T19:06:13.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.359+0000 7f4048a77640 1 -- 172.21.15.53:0/1310187038 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f403c009a70 con 0x7f40440af760 2023-06-10T19:06:13.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.359+0000 7f4048a77640 1 -- 172.21.15.53:0/1310187038 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4044155fa0 con 0x7f40440af760 2023-06-10T19:06:13.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.359+0000 7f4048a77640 1 -- 172.21.15.53:0/1310187038 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f404404d790 con 0x7f40440af760 2023-06-10T19:06:13.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.359+0000 7f4032ffd640 1 -- 172.21.15.53:0/1310187038 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4038004b90 con 0x7f40440af760 2023-06-10T19:06:13.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.359+0000 7f4032ffd640 1 --2- 172.21.15.53:0/1310187038 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4024066280 0x7f4024068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:13.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.359+0000 7f4032ffd640 1 -- 172.21.15.53:0/1310187038 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f40380835a0 con 0x7f40440af760 2023-06-10T19:06:13.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.359+0000 7f404259c640 1 --2- 172.21.15.53:0/1310187038 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4024066280 0x7f4024068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:13.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.363+0000 7f404259c640 1 --2- 172.21.15.53:0/1310187038 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4024066280 0x7f4024068730 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f4034009af0 tx=0x7f4034008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:13.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.363+0000 7f4032ffd640 1 -- 172.21.15.53:0/1310187038 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4038050a50 con 0x7f40440af760 2023-06-10T19:06:13.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.515+0000 7f4048a77640 1 -- 172.21.15.53:0/1310187038 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4044155fa0 con 0x7f40440af760 2023-06-10T19:06:13.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.519+0000 7f4032ffd640 1 -- 172.21.15.53:0/1310187038 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v142) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4044155fa0 con 0x7f40440af760 2023-06-10T19:06:13.519 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-06-10T19:06:13.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.519+0000 7f4048a77640 1 -- 172.21.15.53:0/1310187038 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4024066280 msgr2=0x7f4024068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:13.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.519+0000 7f4048a77640 1 --2- 172.21.15.53:0/1310187038 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4024066280 0x7f4024068730 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f4034009af0 tx=0x7f4034008040 comp rx=0 tx=0).stop 2023-06-10T19:06:13.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.519+0000 7f4048a77640 1 -- 172.21.15.53:0/1310187038 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40440af760 msgr2=0x7f4044155a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:13.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.519+0000 7f4048a77640 1 --2- 172.21.15.53:0/1310187038 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40440af760 0x7f4044155a60 secure :-1 s=READY pgs=2113 cs=0 l=1 rev1=1 crypto rx=0x7f403800c450 tx=0x7f403800c910 comp rx=0 tx=0).stop 2023-06-10T19:06:13.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.519+0000 7f4048a77640 1 -- 172.21.15.53:0/1310187038 shutdown_connections 2023-06-10T19:06:13.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.519+0000 7f4048a77640 1 --2- 172.21.15.53:0/1310187038 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4024066280 0x7f4024068730 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:13.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.519+0000 7f4048a77640 1 --2- 172.21.15.53:0/1310187038 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40440c9fa0 0x7f40440c3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:13.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.519+0000 7f4048a77640 1 --2- 172.21.15.53:0/1310187038 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40440af760 0x7f4044155a60 unknown :-1 s=CLOSED pgs=2113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:13.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.519+0000 7f4048a77640 1 --2- 172.21.15.53:0/1310187038 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f404406c020 0x7f40440cc660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:13.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.519+0000 7f4048a77640 1 -- 172.21.15.53:0/1310187038 >> 172.21.15.53:0/1310187038 conn(0x7f404406a0e0 msgr2=0x7f40440cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:13.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.519+0000 7f4048a77640 1 -- 172.21.15.53:0/1310187038 shutdown_connections 2023-06-10T19:06:13.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.519+0000 7f4048a77640 1 -- 172.21.15.53:0/1310187038 wait complete. 2023-06-10T19:06:13.539 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-10T19:06:13.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.655+0000 7ff0363ce640 1 Processor -- start 2023-06-10T19:06:13.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.655+0000 7ff0363ce640 1 -- start start 2023-06-10T19:06:13.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.655+0000 7ff0363ce640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff0300cc690 0x7ff0300d00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:13.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.655+0000 7ff0363ce640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0300d1b00 0x7ff0300d05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:13.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.655+0000 7ff0363ce640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0300ccde0 con 0x7ff0300b3ac0 2023-06-10T19:06:13.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.655+0000 7ff0363ce640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0300ced00 con 0x7ff0300cc690 2023-06-10T19:06:13.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.655+0000 7ff0363ce640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0300cfc10 con 0x7ff0300d1b00 2023-06-10T19:06:13.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.655+0000 7ff02f7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff0300cc690 0x7ff0300d00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:13.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.655+0000 7ff02f7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff0300cc690 0x7ff0300d00a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42070/0 (socket says 172.21.15.53:42070) 2023-06-10T19:06:13.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.655+0000 7ff02f7fe640 1 -- 172.21.15.53:0/2696212978 learned_addr learned my addr 172.21.15.53:0/2696212978 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:13.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.655+0000 7ff03496b640 1 --2- 172.21.15.53:0/2696212978 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0300d1b00 0x7ff0300d05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:13.660 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.659+0000 7ff02f7fe640 1 -- 172.21.15.53:0/2696212978 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0300d1b00 msgr2=0x7ff0300d05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:13.660 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.659+0000 7ff02f7fe640 1 --2- 172.21.15.53:0/2696212978 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0300d1b00 0x7ff0300d05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:13.660 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.659+0000 7ff02f7fe640 1 -- 172.21.15.53:0/2696212978 >> v1:172.21.15.117:6789/0 conn(0x7ff0300b3ac0 legacy=0x7ff0300b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:13.660 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.659+0000 7ff02f7fe640 1 -- 172.21.15.53:0/2696212978 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0300b7b50 con 0x7ff0300cc690 2023-06-10T19:06:13.660 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.659+0000 7ff02f7fe640 1 --2- 172.21.15.53:0/2696212978 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff0300cc690 0x7ff0300d00a0 secure :-1 s=READY pgs=2114 cs=0 l=1 rev1=1 crypto rx=0x7ff024009e50 tx=0x7ff02401c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fd1ad1afe313d18 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:13.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.659+0000 7ff02effd640 1 -- 172.21.15.53:0/2696212978 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0240a57a0 con 0x7ff0300cc690 2023-06-10T19:06:13.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.659+0000 7ff02effd640 1 -- 172.21.15.53:0/2696212978 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0240a5900 con 0x7ff0300cc690 2023-06-10T19:06:13.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.659+0000 7ff02effd640 1 -- 172.21.15.53:0/2696212978 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0240a5c90 con 0x7ff0300cc690 2023-06-10T19:06:13.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.659+0000 7ff0363ce640 1 -- 172.21.15.53:0/2696212978 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff0300cc690 msgr2=0x7ff0300d00a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:13.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.659+0000 7ff0363ce640 1 --2- 172.21.15.53:0/2696212978 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff0300cc690 0x7ff0300d00a0 secure :-1 s=READY pgs=2114 cs=0 l=1 rev1=1 crypto rx=0x7ff024009e50 tx=0x7ff02401c8c0 comp rx=0 tx=0).stop 2023-06-10T19:06:13.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.659+0000 7ff0363ce640 1 -- 172.21.15.53:0/2696212978 shutdown_connections 2023-06-10T19:06:13.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.659+0000 7ff0363ce640 1 --2- 172.21.15.53:0/2696212978 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0300d1b00 0x7ff0300d05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:13.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.659+0000 7ff0363ce640 1 --2- 172.21.15.53:0/2696212978 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff0300cc690 0x7ff0300d00a0 unknown :-1 s=CLOSED pgs=2114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:13.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.659+0000 7ff0363ce640 1 -- 172.21.15.53:0/2696212978 >> 172.21.15.53:0/2696212978 conn(0x7ff030069de0 msgr2=0x7ff03006a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:13.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.659+0000 7ff0363ce640 1 -- 172.21.15.53:0/2696212978 shutdown_connections 2023-06-10T19:06:13.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.659+0000 7ff0363ce640 1 -- 172.21.15.53:0/2696212978 wait complete. 2023-06-10T19:06:13.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.663+0000 7ff0363ce640 1 Processor -- start 2023-06-10T19:06:13.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.663+0000 7ff0363ce640 1 -- start start 2023-06-10T19:06:13.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.663+0000 7ff0363ce640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0300b3ac0 0x7ff0300c7570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:13.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.663+0000 7ff0363ce640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff0300cc690 0x7ff0300b2d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:13.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.663+0000 7ff0363ce640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0300d1b00 0x7ff03014cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:13.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.663+0000 7ff0363ce640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0300c7c00 con 0x7ff0300cc690 2023-06-10T19:06:13.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.663+0000 7ff0363ce640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0300c7ee0 con 0x7ff0300d1b00 2023-06-10T19:06:13.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.663+0000 7ff0363ce640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0300c81c0 con 0x7ff0300b3ac0 2023-06-10T19:06:13.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.663+0000 7ff02f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff0300cc690 0x7ff0300b2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:13.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.663+0000 7ff02f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff0300cc690 0x7ff0300b2d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42080/0 (socket says 172.21.15.53:42080) 2023-06-10T19:06:13.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.663+0000 7ff02f7fe640 1 -- 172.21.15.53:0/1414940003 learned_addr learned my addr 172.21.15.53:0/1414940003 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:13.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.663+0000 7ff02ffff640 1 --2- 172.21.15.53:0/1414940003 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0300b3ac0 0x7ff0300c7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:13.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.663+0000 7ff03496b640 1 --2- 172.21.15.53:0/1414940003 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0300d1b00 0x7ff03014cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:13.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.663+0000 7ff02f7fe640 1 -- 172.21.15.53:0/1414940003 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0300b3ac0 msgr2=0x7ff0300c7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:13.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.663+0000 7ff02f7fe640 1 --2- 172.21.15.53:0/1414940003 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0300b3ac0 0x7ff0300c7570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:13.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.663+0000 7ff02f7fe640 1 -- 172.21.15.53:0/1414940003 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0300d1b00 msgr2=0x7ff03014cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:13.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.663+0000 7ff02f7fe640 1 --2- 172.21.15.53:0/1414940003 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0300d1b00 0x7ff03014cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:13.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.663+0000 7ff02f7fe640 1 -- 172.21.15.53:0/1414940003 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff024009b30 con 0x7ff0300cc690 2023-06-10T19:06:13.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.663+0000 7ff03496b640 1 --2- 172.21.15.53:0/1414940003 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0300d1b00 0x7ff03014cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:06:13.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.663+0000 7ff02ffff640 1 --2- 172.21.15.53:0/1414940003 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0300b3ac0 0x7ff0300c7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:06:13.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.663+0000 7ff02f7fe640 1 --2- 172.21.15.53:0/1414940003 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff0300cc690 0x7ff0300b2d50 secure :-1 s=READY pgs=2115 cs=0 l=1 rev1=1 crypto rx=0x7ff0240af040 tx=0x7ff024019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:13.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.663+0000 7ff02cff9640 1 -- 172.21.15.53:0/1414940003 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0240b8670 con 0x7ff0300cc690 2023-06-10T19:06:13.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.663+0000 7ff02cff9640 1 -- 172.21.15.53:0/1414940003 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0240b87f0 con 0x7ff0300cc690 2023-06-10T19:06:13.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.663+0000 7ff0363ce640 1 -- 172.21.15.53:0/1414940003 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0300c84a0 con 0x7ff0300cc690 2023-06-10T19:06:13.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.663+0000 7ff02cff9640 1 -- 172.21.15.53:0/1414940003 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0240b8ba0 con 0x7ff0300cc690 2023-06-10T19:06:13.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.663+0000 7ff0363ce640 1 -- 172.21.15.53:0/1414940003 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0300b3290 con 0x7ff0300cc690 2023-06-10T19:06:13.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.663+0000 7ff0363ce640 1 -- 172.21.15.53:0/1414940003 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff03004d790 con 0x7ff0300cc690 2023-06-10T19:06:13.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.663+0000 7ff02cff9640 1 -- 172.21.15.53:0/1414940003 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff0240b8d00 con 0x7ff0300cc690 2023-06-10T19:06:13.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.667+0000 7ff02cff9640 1 --2- 172.21.15.53:0/1414940003 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff01c0662b0 0x7ff01c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:13.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.667+0000 7ff02cff9640 1 -- 172.21.15.53:0/1414940003 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6148+0+0 (secure 0 0 0) 0x7ff02411f2a0 con 0x7ff0300cc690 2023-06-10T19:06:13.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.667+0000 7ff02ffff640 1 --2- 172.21.15.53:0/1414940003 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff01c0662b0 0x7ff01c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:13.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.667+0000 7ff02ffff640 1 --2- 172.21.15.53:0/1414940003 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff01c0662b0 0x7ff01c068760 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7ff020000f70 tx=0x7ff020009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:13.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.671+0000 7ff02cff9640 1 -- 172.21.15.53:0/1414940003 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff0240ec6c0 con 0x7ff0300cc690 2023-06-10T19:06:13.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.831+0000 7ff0363ce640 1 -- 172.21.15.53:0/1414940003 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff0300ce1f0 con 0x7ff0300cc690 2023-06-10T19:06:13.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.831+0000 7ff02cff9640 1 -- 172.21.15.53:0/1414940003 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v142) v1 ==== 80+0+122 (secure 0 0 0) 0x7ff0240efce0 con 0x7ff0300cc690 2023-06-10T19:06:13.832 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:6835/1171476971 2023-06-11T19:06:04.182476+0000 2023-06-10T19:06:13.832 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53:6834/1171476971 2023-06-11T19:06:04.182476+0000 2023-06-10T19:06:13.832 INFO:teuthology.orchestra.run.smithi053.stderr:listed 2 entries 2023-06-10T19:06:13.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.831+0000 7ff0363ce640 1 -- 172.21.15.53:0/1414940003 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff01c0662b0 msgr2=0x7ff01c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:13.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.831+0000 7ff0363ce640 1 --2- 172.21.15.53:0/1414940003 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff01c0662b0 0x7ff01c068760 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7ff020000f70 tx=0x7ff020009040 comp rx=0 tx=0).stop 2023-06-10T19:06:13.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.831+0000 7ff0363ce640 1 -- 172.21.15.53:0/1414940003 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff0300cc690 msgr2=0x7ff0300b2d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:13.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.831+0000 7ff0363ce640 1 --2- 172.21.15.53:0/1414940003 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff0300cc690 0x7ff0300b2d50 secure :-1 s=READY pgs=2115 cs=0 l=1 rev1=1 crypto rx=0x7ff0240af040 tx=0x7ff024019660 comp rx=0 tx=0).stop 2023-06-10T19:06:13.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.831+0000 7ff0363ce640 1 -- 172.21.15.53:0/1414940003 shutdown_connections 2023-06-10T19:06:13.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.831+0000 7ff0363ce640 1 --2- 172.21.15.53:0/1414940003 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff01c0662b0 0x7ff01c068760 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:13.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.831+0000 7ff0363ce640 1 --2- 172.21.15.53:0/1414940003 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0300d1b00 0x7ff03014cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:13.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.831+0000 7ff0363ce640 1 --2- 172.21.15.53:0/1414940003 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff0300cc690 0x7ff0300b2d50 unknown :-1 s=CLOSED pgs=2115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:13.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.831+0000 7ff0363ce640 1 --2- 172.21.15.53:0/1414940003 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff0300b3ac0 0x7ff0300c7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:13.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.831+0000 7ff0363ce640 1 -- 172.21.15.53:0/1414940003 >> 172.21.15.53:0/1414940003 conn(0x7ff030069de0 msgr2=0x7ff0300b4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:13.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.831+0000 7ff0363ce640 1 -- 172.21.15.53:0/1414940003 shutdown_connections 2023-06-10T19:06:13.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:13.831+0000 7ff0363ce640 1 -- 172.21.15.53:0/1414940003 wait complete. 2023-06-10T19:06:13.849 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi117.front.sepia.ceph.com... 2023-06-10T19:06:13.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:06:13.850 DEBUG:teuthology.orchestra.run.smithi117:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-06-10T19:06:13.864 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi117.stderr:ceph-fuse[45442]: fuse finished with error 0 and tester_r 0 2023-06-10T19:06:13.866 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi117.front.sepia.ceph.com 2023-06-10T19:06:13.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:06:13.868 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-06-10T19:06:14.015 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T19:06:14.015 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:06:14.022 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16345192k,nr_inodes=4086298,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276544k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=407 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276540k,nr_inodes=819135,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276544k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-06-10T19:06:14.022 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi053.front.sepia.ceph.com 2023-06-10T19:06:14.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:06:14.023 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-06-10T19:06:14.067 INFO:teuthology.orchestra.run.smithi053.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-06-10T19:06:14.068 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-10T19:06:14.069 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T19:06:14.070 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:06:14.077 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16342088k,nr_inodes=4085522,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275924k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18845 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275920k,nr_inodes=818980,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275924k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-06-10T19:06:14.078 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi117.front.sepia.ceph.com 2023-06-10T19:06:14.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:06:14.081 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-06-10T19:06:14.123 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-10T19:06:14.124 INFO:teuthology.orchestra.run.smithi117.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-06-10T19:06:14.124 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:06:14.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.259+0000 7fc0bb74c640 1 Processor -- start 2023-06-10T19:06:14.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.259+0000 7fc0bb74c640 1 -- start start 2023-06-10T19:06:14.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.259+0000 7fc0bb74c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc0b406b780 0x7fc0b415c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:14.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.259+0000 7fc0bb74c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc0b406bb50 0x7fc0b415f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:14.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.259+0000 7fc0bb74c640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0b40af530 con 0x7fc0b415f860 2023-06-10T19:06:14.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.259+0000 7fc0bb74c640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0b415c3d0 con 0x7fc0b406b780 2023-06-10T19:06:14.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.259+0000 7fc0bb74c640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0b415fd70 con 0x7fc0b406bb50 2023-06-10T19:06:14.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.259+0000 7fc0b94e8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc0b406b780 0x7fc0b415c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:14.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.259+0000 7fc0b94e8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc0b406b780 0x7fc0b415c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42088/0 (socket says 172.21.15.53:42088) 2023-06-10T19:06:14.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.259+0000 7fc0b94e8640 1 -- 172.21.15.53:0/209710863 learned_addr learned my addr 172.21.15.53:0/209710863 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:14.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.259+0000 7fc0b8ce7640 1 --2- 172.21.15.53:0/209710863 >> v2:172.21.15.117:3300/0 conn(0x7fc0b406bb50 0x7fc0b415f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:14.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.259+0000 7fc0b94e8640 1 -- 172.21.15.53:0/209710863 >> v2:172.21.15.117:3300/0 conn(0x7fc0b406bb50 msgr2=0x7fc0b415f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:14.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.259+0000 7fc0b94e8640 1 --2- 172.21.15.53:0/209710863 >> v2:172.21.15.117:3300/0 conn(0x7fc0b406bb50 0x7fc0b415f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:14.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.259+0000 7fc0b94e8640 1 -- 172.21.15.53:0/209710863 >> v1:172.21.15.117:6789/0 conn(0x7fc0b415f860 legacy=0x7fc0b40ceb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:14.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.259+0000 7fc0b94e8640 1 -- 172.21.15.53:0/209710863 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0b4160050 con 0x7fc0b406b780 2023-06-10T19:06:14.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.263+0000 7fc0b94e8640 1 --2- 172.21.15.53:0/209710863 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0b406b780 0x7fc0b415c7f0 secure :-1 s=READY pgs=2116 cs=0 l=1 rev1=1 crypto rx=0x7fc0b40cdad0 tx=0x7fc0b001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87d34cb3e3569ee6 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:14.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.263+0000 7fc0abfff640 1 -- 172.21.15.53:0/209710863 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b00ac600 con 0x7fc0b406b780 2023-06-10T19:06:14.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.263+0000 7fc0abfff640 1 -- 172.21.15.53:0/209710863 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0b00a8050 con 0x7fc0b406b780 2023-06-10T19:06:14.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.263+0000 7fc0abfff640 1 -- 172.21.15.53:0/209710863 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b00ac980 con 0x7fc0b406b780 2023-06-10T19:06:14.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.263+0000 7fc0bb74c640 1 -- 172.21.15.53:0/209710863 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0b406b780 msgr2=0x7fc0b415c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:14.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.263+0000 7fc0bb74c640 1 --2- 172.21.15.53:0/209710863 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0b406b780 0x7fc0b415c7f0 secure :-1 s=READY pgs=2116 cs=0 l=1 rev1=1 crypto rx=0x7fc0b40cdad0 tx=0x7fc0b001c470 comp rx=0 tx=0).stop 2023-06-10T19:06:14.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.263+0000 7fc0bb74c640 1 -- 172.21.15.53:0/209710863 shutdown_connections 2023-06-10T19:06:14.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.263+0000 7fc0bb74c640 1 --2- 172.21.15.53:0/209710863 >> v2:172.21.15.117:3300/0 conn(0x7fc0b406bb50 0x7fc0b415f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:14.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.263+0000 7fc0bb74c640 1 --2- 172.21.15.53:0/209710863 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0b406b780 0x7fc0b415c7f0 unknown :-1 s=CLOSED pgs=2116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:14.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.263+0000 7fc0bb74c640 1 -- 172.21.15.53:0/209710863 >> 172.21.15.53:0/209710863 conn(0x7fc0b406a090 msgr2=0x7fc0b406d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:14.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.263+0000 7fc0bb74c640 1 -- 172.21.15.53:0/209710863 shutdown_connections 2023-06-10T19:06:14.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.263+0000 7fc0bb74c640 1 -- 172.21.15.53:0/209710863 wait complete. 2023-06-10T19:06:14.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.267+0000 7fc0bb74c640 1 Processor -- start 2023-06-10T19:06:14.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.267+0000 7fc0bb74c640 1 -- start start 2023-06-10T19:06:14.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.267+0000 7fc0bb74c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0b406b780 0x7fc0b40b2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:14.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.267+0000 7fc0bb74c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0b406bb50 0x7fc0b40c5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:14.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.267+0000 7fc0bb74c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0b415f860 0x7fc0b4152030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:14.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.267+0000 7fc0bb74c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b40b05a0 con 0x7fc0b415f860 2023-06-10T19:06:14.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.267+0000 7fc0bb74c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b40b47e0 con 0x7fc0b406bb50 2023-06-10T19:06:14.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.267+0000 7fc0bb74c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b40afa20 con 0x7fc0b406b780 2023-06-10T19:06:14.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.267+0000 7fc0b9ce9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0b415f860 0x7fc0b4152030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:14.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.267+0000 7fc0b9ce9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0b415f860 0x7fc0b4152030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42098/0 (socket says 172.21.15.53:42098) 2023-06-10T19:06:14.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.267+0000 7fc0b9ce9640 1 -- 172.21.15.53:0/1441566135 learned_addr learned my addr 172.21.15.53:0/1441566135 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:14.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.267+0000 7fc0b8ce7640 1 --2- 172.21.15.53:0/1441566135 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0b406bb50 0x7fc0b40c5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:14.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.267+0000 7fc0b94e8640 1 --2- 172.21.15.53:0/1441566135 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0b406b780 0x7fc0b40b2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:14.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.267+0000 7fc0b9ce9640 1 -- 172.21.15.53:0/1441566135 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0b406b780 msgr2=0x7fc0b40b2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:14.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.267+0000 7fc0b9ce9640 1 --2- 172.21.15.53:0/1441566135 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0b406b780 0x7fc0b40b2c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:14.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.267+0000 7fc0b9ce9640 1 -- 172.21.15.53:0/1441566135 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0b406bb50 msgr2=0x7fc0b40c5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:14.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.267+0000 7fc0b9ce9640 1 --2- 172.21.15.53:0/1441566135 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0b406bb50 0x7fc0b40c5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:14.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.267+0000 7fc0b9ce9640 1 -- 172.21.15.53:0/1441566135 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0b00094d0 con 0x7fc0b415f860 2023-06-10T19:06:14.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.267+0000 7fc0b9ce9640 1 --2- 172.21.15.53:0/1441566135 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0b415f860 0x7fc0b4152030 secure :-1 s=READY pgs=2117 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac00c7a0 tx=0x7fc0ac00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:14.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.267+0000 7fc0a9ffb640 1 -- 172.21.15.53:0/1441566135 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0ac003b80 con 0x7fc0b415f860 2023-06-10T19:06:14.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.267+0000 7fc0a9ffb640 1 -- 172.21.15.53:0/1441566135 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0ac003ce0 con 0x7fc0b415f860 2023-06-10T19:06:14.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.267+0000 7fc0a9ffb640 1 -- 172.21.15.53:0/1441566135 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0ac00aa30 con 0x7fc0b415f860 2023-06-10T19:06:14.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.267+0000 7fc0bb74c640 1 -- 172.21.15.53:0/1441566135 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0b40afd00 con 0x7fc0b415f860 2023-06-10T19:06:14.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.267+0000 7fc0bb74c640 1 -- 172.21.15.53:0/1441566135 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0b40b02c0 con 0x7fc0b415f860 2023-06-10T19:06:14.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.267+0000 7fc0bb74c640 1 -- 172.21.15.53:0/1441566135 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0b40c6bc0 con 0x7fc0b415f860 2023-06-10T19:06:14.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.267+0000 7fc0a9ffb640 1 -- 172.21.15.53:0/1441566135 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc0ac00ab90 con 0x7fc0b415f860 2023-06-10T19:06:14.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.267+0000 7fc0a9ffb640 1 --2- 172.21.15.53:0/1441566135 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc0980662b0 0x7fc098068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:14.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.267+0000 7fc0a9ffb640 1 -- 172.21.15.53:0/1441566135 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6148+0+0 (secure 0 0 0) 0x7fc0ac083bd0 con 0x7fc0b415f860 2023-06-10T19:06:14.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.267+0000 7fc0b94e8640 1 --2- 172.21.15.53:0/1441566135 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc0980662b0 0x7fc098068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:14.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.271+0000 7fc0b94e8640 1 --2- 172.21.15.53:0/1441566135 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc0980662b0 0x7fc098068760 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fc0b00ae000 tx=0x7fc0b0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:14.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.271+0000 7fc0a9ffb640 1 -- 172.21.15.53:0/1441566135 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc0ac050ff0 con 0x7fc0b415f860 2023-06-10T19:06:14.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.459+0000 7fc0bb74c640 1 -- 172.21.15.53:0/1441566135 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc0b404d790 con 0x7fc0b415f860 2023-06-10T19:06:14.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.459+0000 7fc0a9ffb640 1 -- 172.21.15.53:0/1441566135 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) v1 ==== 94+0+4678 (secure 0 0 0) 0x7fc0ac054610 con 0x7fc0b415f860 2023-06-10T19:06:14.462 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:06:14.462 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":81,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8125,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3512570304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3512570304},{"type":"v1","addr":"172.21.15.117:6835","nonce":3512570304}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78},{"gid":8128,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/325110995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":325110995},{"type":"v1","addr":"172.21.15.117:6837","nonce":325110995}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78},{"gid":9759,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/2776844045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2776844045},{"type":"v1","addr":"172.21.15.53:6833","nonce":2776844045}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:05:50.789763+0000","modified":"2023-06-10T19:06:09.123261+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":139,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9780},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9780":{"gid":9780,"name":"c","rank":0,"incarnation":78,"state":"up:active","state_seq":4,"addr":"172.21.15.53:6835/2721536857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2721536857},{"type":"v1","addr":"172.21.15.53:6835","nonce":2721536857}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-06-10T19:06:14.463 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 81 2023-06-10T19:06:14.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.463+0000 7fc0bb74c640 1 -- 172.21.15.53:0/1441566135 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc0980662b0 msgr2=0x7fc098068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:14.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.463+0000 7fc0bb74c640 1 --2- 172.21.15.53:0/1441566135 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc0980662b0 0x7fc098068760 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fc0b00ae000 tx=0x7fc0b0008040 comp rx=0 tx=0).stop 2023-06-10T19:06:14.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.463+0000 7fc0bb74c640 1 -- 172.21.15.53:0/1441566135 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0b415f860 msgr2=0x7fc0b4152030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:14.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.463+0000 7fc0bb74c640 1 --2- 172.21.15.53:0/1441566135 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0b415f860 0x7fc0b4152030 secure :-1 s=READY pgs=2117 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac00c7a0 tx=0x7fc0ac00cc60 comp rx=0 tx=0).stop 2023-06-10T19:06:14.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.463+0000 7fc0bb74c640 1 -- 172.21.15.53:0/1441566135 shutdown_connections 2023-06-10T19:06:14.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.463+0000 7fc0bb74c640 1 --2- 172.21.15.53:0/1441566135 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc0980662b0 0x7fc098068760 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:14.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.463+0000 7fc0bb74c640 1 --2- 172.21.15.53:0/1441566135 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0b415f860 0x7fc0b4152030 unknown :-1 s=CLOSED pgs=2117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:14.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.463+0000 7fc0bb74c640 1 --2- 172.21.15.53:0/1441566135 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0b406bb50 0x7fc0b40c5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:14.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.463+0000 7fc0bb74c640 1 --2- 172.21.15.53:0/1441566135 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0b406b780 0x7fc0b40b2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:14.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.463+0000 7fc0bb74c640 1 -- 172.21.15.53:0/1441566135 >> 172.21.15.53:0/1441566135 conn(0x7fc0b406a090 msgr2=0x7fc0b415dc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:14.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.463+0000 7fc0bb74c640 1 -- 172.21.15.53:0/1441566135 shutdown_connections 2023-06-10T19:06:14.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.463+0000 7fc0bb74c640 1 -- 172.21.15.53:0/1441566135 wait complete. 2023-06-10T19:06:14.479 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:06:14.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.603+0000 7fb1726bf640 1 Processor -- start 2023-06-10T19:06:14.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.603+0000 7fb1726bf640 1 -- start start 2023-06-10T19:06:14.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.603+0000 7fb1726bf640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb16c15d5d0 0x7fb16c06b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:14.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.603+0000 7fb1726bf640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb16c0b24c0 0x7fb16c0c2c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:14.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.603+0000 7fb1726bf640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb16c1642c0 0x7fb16c0c31a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:14.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.603+0000 7fb1726bf640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb16c06c060 con 0x7fb16c1642c0 2023-06-10T19:06:14.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.603+0000 7fb1726bf640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb16c1637e0 con 0x7fb16c15d5d0 2023-06-10T19:06:14.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.603+0000 7fb1726bf640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb16c163ac0 con 0x7fb16c0b24c0 2023-06-10T19:06:14.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.603+0000 7fb170c5c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb16c1642c0 0x7fb16c0c31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:14.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.603+0000 7fb170c5c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb16c1642c0 0x7fb16c0c31a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42114/0 (socket says 172.21.15.53:42114) 2023-06-10T19:06:14.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.603+0000 7fb170c5c640 1 -- 172.21.15.53:0/158901107 learned_addr learned my addr 172.21.15.53:0/158901107 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:14.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.603+0000 7fb16bfff640 1 --2- 172.21.15.53:0/158901107 >> v2:172.21.15.117:3300/0 conn(0x7fb16c15d5d0 0x7fb16c06b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:14.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.603+0000 7fb163fff640 1 --2- 172.21.15.53:0/158901107 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb16c0b24c0 0x7fb16c0c2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:14.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.603+0000 7fb170c5c640 1 -- 172.21.15.53:0/158901107 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb16c0b24c0 msgr2=0x7fb16c0c2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:14.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.603+0000 7fb170c5c640 1 --2- 172.21.15.53:0/158901107 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb16c0b24c0 0x7fb16c0c2c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:14.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.603+0000 7fb170c5c640 1 -- 172.21.15.53:0/158901107 >> v2:172.21.15.117:3300/0 conn(0x7fb16c15d5d0 msgr2=0x7fb16c06b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:14.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.603+0000 7fb170c5c640 1 --2- 172.21.15.53:0/158901107 >> v2:172.21.15.117:3300/0 conn(0x7fb16c15d5d0 0x7fb16c06b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:14.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.603+0000 7fb170c5c640 1 -- 172.21.15.53:0/158901107 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb16c163da0 con 0x7fb16c1642c0 2023-06-10T19:06:14.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.607+0000 7fb170c5c640 1 --2- 172.21.15.53:0/158901107 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb16c1642c0 0x7fb16c0c31a0 secure :-1 s=READY pgs=2118 cs=0 l=1 rev1=1 crypto rx=0x7fb16c070eb0 tx=0x7fb16401c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e9494bc5f11e232 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:14.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.607+0000 7fb16b7fe640 1 -- 172.21.15.53:0/158901107 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1640a57e0 con 0x7fb16c1642c0 2023-06-10T19:06:14.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.607+0000 7fb16b7fe640 1 -- 172.21.15.53:0/158901107 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1640a5940 con 0x7fb16c1642c0 2023-06-10T19:06:14.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.607+0000 7fb16b7fe640 1 -- 172.21.15.53:0/158901107 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1640a5cd0 con 0x7fb16c1642c0 2023-06-10T19:06:14.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.607+0000 7fb1726bf640 1 -- 172.21.15.53:0/158901107 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb16c1642c0 msgr2=0x7fb16c0c31a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:14.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.607+0000 7fb1726bf640 1 --2- 172.21.15.53:0/158901107 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb16c1642c0 0x7fb16c0c31a0 secure :-1 s=READY pgs=2118 cs=0 l=1 rev1=1 crypto rx=0x7fb16c070eb0 tx=0x7fb16401c940 comp rx=0 tx=0).stop 2023-06-10T19:06:14.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.607+0000 7fb1726bf640 1 -- 172.21.15.53:0/158901107 shutdown_connections 2023-06-10T19:06:14.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.607+0000 7fb1726bf640 1 --2- 172.21.15.53:0/158901107 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb16c1642c0 0x7fb16c0c31a0 unknown :-1 s=CLOSED pgs=2118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:14.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.607+0000 7fb1726bf640 1 --2- 172.21.15.53:0/158901107 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb16c0b24c0 0x7fb16c0c2c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:14.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.607+0000 7fb1726bf640 1 --2- 172.21.15.53:0/158901107 >> v2:172.21.15.117:3300/0 conn(0x7fb16c15d5d0 0x7fb16c06b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:14.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.607+0000 7fb1726bf640 1 -- 172.21.15.53:0/158901107 >> 172.21.15.53:0/158901107 conn(0x7fb16c06a090 msgr2=0x7fb16c06d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:14.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.607+0000 7fb1726bf640 1 -- 172.21.15.53:0/158901107 shutdown_connections 2023-06-10T19:06:14.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.607+0000 7fb1726bf640 1 -- 172.21.15.53:0/158901107 wait complete. 2023-06-10T19:06:14.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.607+0000 7fb1726bf640 1 Processor -- start 2023-06-10T19:06:14.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.607+0000 7fb1726bf640 1 -- start start 2023-06-10T19:06:14.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.607+0000 7fb1726bf640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb16c0b24c0 0x7fb16c156760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:14.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.607+0000 7fb1726bf640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb16c15d5d0 0x7fb16c15ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:14.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.607+0000 7fb1726bf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb16c1642c0 0x7fb16c0b5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:14.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.607+0000 7fb1726bf640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb16c161240 con 0x7fb16c1642c0 2023-06-10T19:06:14.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.607+0000 7fb1726bf640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb16c160ef0 con 0x7fb16c15d5d0 2023-06-10T19:06:14.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.607+0000 7fb1726bf640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb16c159330 con 0x7fb16c0b24c0 2023-06-10T19:06:14.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.607+0000 7fb170c5c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb16c1642c0 0x7fb16c0b5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:14.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.607+0000 7fb170c5c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb16c1642c0 0x7fb16c0b5370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42130/0 (socket says 172.21.15.53:42130) 2023-06-10T19:06:14.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.607+0000 7fb170c5c640 1 -- 172.21.15.53:0/754699950 learned_addr learned my addr 172.21.15.53:0/754699950 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:14.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.607+0000 7fb16bfff640 1 --2- 172.21.15.53:0/754699950 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb16c0b24c0 0x7fb16c156760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:14.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.607+0000 7fb163fff640 1 --2- 172.21.15.53:0/754699950 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb16c15d5d0 0x7fb16c15ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:14.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.607+0000 7fb170c5c640 1 -- 172.21.15.53:0/754699950 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb16c0b24c0 msgr2=0x7fb16c156760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:14.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.607+0000 7fb170c5c640 1 --2- 172.21.15.53:0/754699950 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb16c0b24c0 0x7fb16c156760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:14.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.607+0000 7fb170c5c640 1 -- 172.21.15.53:0/754699950 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb16c15d5d0 msgr2=0x7fb16c15ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:14.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.607+0000 7fb170c5c640 1 --2- 172.21.15.53:0/754699950 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb16c15d5d0 0x7fb16c15ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:14.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.607+0000 7fb170c5c640 1 -- 172.21.15.53:0/754699950 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb164009b30 con 0x7fb16c1642c0 2023-06-10T19:06:14.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.611+0000 7fb170c5c640 1 --2- 172.21.15.53:0/754699950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb16c1642c0 0x7fb16c0b5370 secure :-1 s=READY pgs=2119 cs=0 l=1 rev1=1 crypto rx=0x7fb16401d1e0 tx=0x7fb1640196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:14.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.611+0000 7fb1697fa640 1 -- 172.21.15.53:0/754699950 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1640b8670 con 0x7fb16c1642c0 2023-06-10T19:06:14.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.611+0000 7fb1697fa640 1 -- 172.21.15.53:0/754699950 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1640b87d0 con 0x7fb16c1642c0 2023-06-10T19:06:14.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.611+0000 7fb1726bf640 1 -- 172.21.15.53:0/754699950 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb16c159610 con 0x7fb16c1642c0 2023-06-10T19:06:14.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.611+0000 7fb1697fa640 1 -- 172.21.15.53:0/754699950 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1640b8b80 con 0x7fb16c1642c0 2023-06-10T19:06:14.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.611+0000 7fb1726bf640 1 -- 172.21.15.53:0/754699950 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb16c158fe0 con 0x7fb16c1642c0 2023-06-10T19:06:14.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.611+0000 7fb1726bf640 1 -- 172.21.15.53:0/754699950 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb16c161380 con 0x7fb16c1642c0 2023-06-10T19:06:14.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.611+0000 7fb1697fa640 1 -- 172.21.15.53:0/754699950 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb1640b8ce0 con 0x7fb16c1642c0 2023-06-10T19:06:14.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.611+0000 7fb1697fa640 1 --2- 172.21.15.53:0/754699950 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb14c066280 0x7fb14c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:14.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.611+0000 7fb1697fa640 1 -- 172.21.15.53:0/754699950 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6148+0+0 (secure 0 0 0) 0x7fb16411f530 con 0x7fb16c1642c0 2023-06-10T19:06:14.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.611+0000 7fb16bfff640 1 --2- 172.21.15.53:0/754699950 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb14c066280 0x7fb14c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:14.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.611+0000 7fb16bfff640 1 --2- 172.21.15.53:0/754699950 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb14c066280 0x7fb14c068730 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fb16c0b0940 tx=0x7fb15c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:14.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.615+0000 7fb1697fa640 1 -- 172.21.15.53:0/754699950 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb16c161380 con 0x7fb16c1642c0 2023-06-10T19:06:14.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.763+0000 7fb1726bf640 1 -- 172.21.15.53:0/754699950 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb16c161380 con 0x7fb16c1642c0 2023-06-10T19:06:14.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.767+0000 7fb1697fa640 1 -- 172.21.15.53:0/754699950 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v142) v1 ==== 74+0+18426 (secure 0 0 0) 0x7fb16c161380 con 0x7fb16c1642c0 2023-06-10T19:06:14.769 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:06:14.769 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":142,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:06:04.229769+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-06-10T19:05:48.449837+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-06-10T19:05:49.783728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.53:6835/1171476971":"2023-06-11T19:06:04.182476+0000","172.21.15.53:6834/1171476971":"2023-06-11T19:06:04.182476+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:06:14.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.767+0000 7fb1726bf640 1 -- 172.21.15.53:0/754699950 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb14c066280 msgr2=0x7fb14c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:14.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.767+0000 7fb1726bf640 1 --2- 172.21.15.53:0/754699950 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb14c066280 0x7fb14c068730 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fb16c0b0940 tx=0x7fb15c008040 comp rx=0 tx=0).stop 2023-06-10T19:06:14.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.767+0000 7fb1726bf640 1 -- 172.21.15.53:0/754699950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb16c1642c0 msgr2=0x7fb16c0b5370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:14.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.767+0000 7fb1726bf640 1 --2- 172.21.15.53:0/754699950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb16c1642c0 0x7fb16c0b5370 secure :-1 s=READY pgs=2119 cs=0 l=1 rev1=1 crypto rx=0x7fb16401d1e0 tx=0x7fb1640196e0 comp rx=0 tx=0).stop 2023-06-10T19:06:14.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.767+0000 7fb1726bf640 1 -- 172.21.15.53:0/754699950 shutdown_connections 2023-06-10T19:06:14.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.767+0000 7fb1726bf640 1 --2- 172.21.15.53:0/754699950 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb14c066280 0x7fb14c068730 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:14.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.767+0000 7fb1726bf640 1 --2- 172.21.15.53:0/754699950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb16c1642c0 0x7fb16c0b5370 unknown :-1 s=CLOSED pgs=2119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:14.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.767+0000 7fb1726bf640 1 --2- 172.21.15.53:0/754699950 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb16c15d5d0 0x7fb16c15ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:14.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.767+0000 7fb1726bf640 1 --2- 172.21.15.53:0/754699950 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb16c0b24c0 0x7fb16c156760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:14.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.767+0000 7fb1726bf640 1 -- 172.21.15.53:0/754699950 >> 172.21.15.53:0/754699950 conn(0x7fb16c06a090 msgr2=0x7fb16c0b13c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:14.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.767+0000 7fb1726bf640 1 -- 172.21.15.53:0/754699950 shutdown_connections 2023-06-10T19:06:14.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.767+0000 7fb1726bf640 1 -- 172.21.15.53:0/754699950 wait complete. 2023-06-10T19:06:14.787 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-10T18:52:33.633114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-10T18:52:39.171487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 19, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-10T19:05:48.449837+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '137', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 20, 'pool_name': 'cephfs_data', 'create_time': '2023-06-10T19:05:49.783728+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '138', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-10T19:06:14.789 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-10T19:06:14.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.907+0000 7f1650053640 1 Processor -- start 2023-06-10T19:06:14.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.907+0000 7f1650053640 1 -- start start 2023-06-10T19:06:14.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.907+0000 7f1650053640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16480c9fa0 0x7f164806bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:14.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.907+0000 7f1650053640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f164806b090 con 0x7f164806c020 2023-06-10T19:06:14.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.907+0000 7f1650053640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16480ca370 con 0x7f16480af760 2023-06-10T19:06:14.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.907+0000 7f1650053640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1648070d50 con 0x7f16480c9fa0 2023-06-10T19:06:14.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.907+0000 7f164d5ee640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f164806c020 0x7f16480c82a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60324/0 (socket says 172.21.15.53:60324) 2023-06-10T19:06:14.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.907+0000 7f164d5ee640 1 -- 172.21.15.53:0/1319109671 learned_addr learned my addr 172.21.15.53:0/1319109671 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:06:14.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.907+0000 7f164ddef640 1 --2- 172.21.15.53:0/1319109671 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16480c9fa0 0x7f164806bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:14.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.907+0000 7f164cded640 1 -- 172.21.15.53:0/1319109671 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 774360889 0 0) 0x7f164806b090 con 0x7f164806c020 2023-06-10T19:06:14.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.907+0000 7f164cded640 1 -- 172.21.15.53:0/1319109671 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1634003530 con 0x7f164806c020 2023-06-10T19:06:14.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.907+0000 7f164cded640 1 -- 172.21.15.53:0/1319109671 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4071949053 0 0) 0x7f1634003530 con 0x7f164806c020 2023-06-10T19:06:14.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.907+0000 7f164cded640 1 -- 172.21.15.53:0/1319109671 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16480c9fa0 msgr2=0x7f164806bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:14.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.907+0000 7f164cded640 1 --2- 172.21.15.53:0/1319109671 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16480c9fa0 0x7f164806bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:14.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.907+0000 7f164cded640 1 -- 172.21.15.53:0/1319109671 >> v1:172.21.15.117:6789/0 conn(0x7f16480af760 legacy=0x7f16480700e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:14.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.907+0000 7f164cded640 1 -- 172.21.15.53:0/1319109671 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1648071030 con 0x7f164806c020 2023-06-10T19:06:14.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.907+0000 7f164cded640 1 -- 172.21.15.53:0/1319109671 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f1638001680 con 0x7f164806c020 2023-06-10T19:06:14.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.907+0000 7f164cded640 1 -- 172.21.15.53:0/1319109671 >> v1:172.21.15.53:6789/0 conn(0x7f164806c020 legacy=0x7f16480c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:14.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.907+0000 7f164cded640 1 --2- 172.21.15.53:0/1319109671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16340039b0 0x7f1634003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:14.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.907+0000 7f164cded640 1 --2- 172.21.15.53:0/1319109671 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16340047d0 0x7f1634004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:14.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.907+0000 7f164cded640 1 --2- 172.21.15.53:0/1319109671 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16480c9fa0 0x7f1634005250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:14.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.907+0000 7f164cded640 1 -- 172.21.15.53:0/1319109671 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1648070d50 con 0x7f16340039b0 2023-06-10T19:06:14.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.907+0000 7f164cded640 1 -- 172.21.15.53:0/1319109671 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f163400bb50 con 0x7f16340047d0 2023-06-10T19:06:14.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.907+0000 7f164cded640 1 -- 172.21.15.53:0/1319109671 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f163400bd10 con 0x7f16480c9fa0 2023-06-10T19:06:14.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.907+0000 7f164ddef640 1 --2- 172.21.15.53:0/1319109671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16340039b0 0x7f1634003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:14.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.907+0000 7f164d5ee640 1 --2- 172.21.15.53:0/1319109671 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16340047d0 0x7f1634004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:14.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.907+0000 7f164e5f0640 1 --2- 172.21.15.53:0/1319109671 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16480c9fa0 0x7f1634005250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:14.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.907+0000 7f164ddef640 1 -- 172.21.15.53:0/1319109671 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16480c9fa0 msgr2=0x7f1634005250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:14.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.907+0000 7f164ddef640 1 --2- 172.21.15.53:0/1319109671 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16480c9fa0 0x7f1634005250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:14.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.907+0000 7f164ddef640 1 -- 172.21.15.53:0/1319109671 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16340047d0 msgr2=0x7f1634004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:14.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.907+0000 7f164ddef640 1 --2- 172.21.15.53:0/1319109671 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16340047d0 0x7f1634004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:14.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.907+0000 7f164ddef640 1 -- 172.21.15.53:0/1319109671 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1634003530 con 0x7f16340039b0 2023-06-10T19:06:14.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.907+0000 7f164e5f0640 1 --2- 172.21.15.53:0/1319109671 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16480c9fa0 0x7f1634005250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:06:14.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.907+0000 7f164d5ee640 1 --2- 172.21.15.53:0/1319109671 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16340047d0 0x7f1634004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:06:14.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.911+0000 7f164ddef640 1 --2- 172.21.15.53:0/1319109671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16340039b0 0x7f1634003dc0 secure :-1 s=READY pgs=2121 cs=0 l=1 rev1=1 crypto rx=0x7f164400ba00 tx=0x7f164401c5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=369e998af26d4bc server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:14.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.911+0000 7f164cded640 1 -- 172.21.15.53:0/1319109671 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16440ad3f0 con 0x7f16340039b0 2023-06-10T19:06:14.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.911+0000 7f164cded640 1 -- 172.21.15.53:0/1319109671 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16440ad550 con 0x7f16340039b0 2023-06-10T19:06:14.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.911+0000 7f164cded640 1 -- 172.21.15.53:0/1319109671 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16440ad900 con 0x7f16340039b0 2023-06-10T19:06:14.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.911+0000 7f1650053640 1 -- 172.21.15.53:0/1319109671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16340039b0 msgr2=0x7f1634003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:14.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.911+0000 7f1650053640 1 --2- 172.21.15.53:0/1319109671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16340039b0 0x7f1634003dc0 secure :-1 s=READY pgs=2121 cs=0 l=1 rev1=1 crypto rx=0x7f164400ba00 tx=0x7f164401c5f0 comp rx=0 tx=0).stop 2023-06-10T19:06:14.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.911+0000 7f164e5f0640 1 -- 172.21.15.53:0/1319109671 reap_dead start 2023-06-10T19:06:14.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.911+0000 7f1650053640 1 -- 172.21.15.53:0/1319109671 shutdown_connections 2023-06-10T19:06:14.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.911+0000 7f1650053640 1 -- 172.21.15.53:0/1319109671 >> 172.21.15.53:0/1319109671 conn(0x7f164806a0e0 msgr2=0x7f16480cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:14.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.911+0000 7f1650053640 1 -- 172.21.15.53:0/1319109671 shutdown_connections 2023-06-10T19:06:14.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.911+0000 7f1650053640 1 -- 172.21.15.53:0/1319109671 wait complete. 2023-06-10T19:06:14.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.911+0000 7f1650053640 1 Processor -- start 2023-06-10T19:06:14.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.911+0000 7f1650053640 1 -- start start 2023-06-10T19:06:14.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.911+0000 7f1650053640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16340039b0 0x7f16481542a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:14.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.911+0000 7f1650053640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16480b3900 0x7f16481f4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:14.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.911+0000 7f1650053640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1648157680 0x7f1648157b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:14.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.911+0000 7f1650053640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1648158060 con 0x7f16340039b0 2023-06-10T19:06:14.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.911+0000 7f1650053640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16481547e0 con 0x7f1648157680 2023-06-10T19:06:14.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.911+0000 7f1650053640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16480c5130 con 0x7f16480b3900 2023-06-10T19:06:14.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.911+0000 7f164ddef640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16340039b0 0x7f16481542a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:14.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.911+0000 7f164ddef640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16340039b0 0x7f16481542a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42142/0 (socket says 172.21.15.53:42142) 2023-06-10T19:06:14.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.911+0000 7f164ddef640 1 -- 172.21.15.53:0/929661449 learned_addr learned my addr 172.21.15.53:0/929661449 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:14.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.915+0000 7f164e5f0640 1 --2- 172.21.15.53:0/929661449 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1648157680 0x7f1648157b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:14.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.915+0000 7f164d5ee640 1 --2- 172.21.15.53:0/929661449 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16480b3900 0x7f16481f4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:14.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.915+0000 7f164ddef640 1 -- 172.21.15.53:0/929661449 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16480b3900 msgr2=0x7f16481f4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:14.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.915+0000 7f164ddef640 1 --2- 172.21.15.53:0/929661449 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16480b3900 0x7f16481f4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:14.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.915+0000 7f164ddef640 1 -- 172.21.15.53:0/929661449 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1648157680 msgr2=0x7f1648157b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:14.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.915+0000 7f164ddef640 1 --2- 172.21.15.53:0/929661449 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1648157680 0x7f1648157b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:14.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.915+0000 7f164ddef640 1 -- 172.21.15.53:0/929661449 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16481f50a0 con 0x7f16340039b0 2023-06-10T19:06:14.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.915+0000 7f164d5ee640 1 --2- 172.21.15.53:0/929661449 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16480b3900 0x7f16481f4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:06:14.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.915+0000 7f164e5f0640 1 --2- 172.21.15.53:0/929661449 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1648157680 0x7f1648157b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:06:14.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.915+0000 7f164ddef640 1 --2- 172.21.15.53:0/929661449 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16340039b0 0x7f16481542a0 secure :-1 s=READY pgs=2122 cs=0 l=1 rev1=1 crypto rx=0x7f16440b0040 tx=0x7f1634005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:14.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.915+0000 7f163e7fc640 1 -- 172.21.15.53:0/929661449 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1644004020 con 0x7f16340039b0 2023-06-10T19:06:14.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.915+0000 7f163e7fc640 1 -- 172.21.15.53:0/929661449 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1644004180 con 0x7f16340039b0 2023-06-10T19:06:14.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.915+0000 7f1650053640 1 -- 172.21.15.53:0/929661449 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16481f5380 con 0x7f16340039b0 2023-06-10T19:06:14.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.915+0000 7f163e7fc640 1 -- 172.21.15.53:0/929661449 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16440044f0 con 0x7f16340039b0 2023-06-10T19:06:14.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.915+0000 7f1650053640 1 -- 172.21.15.53:0/929661449 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16480c4dc0 con 0x7f16340039b0 2023-06-10T19:06:14.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.915+0000 7f1650053640 1 -- 172.21.15.53:0/929661449 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f164804d790 con 0x7f16340039b0 2023-06-10T19:06:14.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.915+0000 7f163e7fc640 1 -- 172.21.15.53:0/929661449 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f16440b4070 con 0x7f16340039b0 2023-06-10T19:06:14.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.915+0000 7f163e7fc640 1 --2- 172.21.15.53:0/929661449 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f162c0662b0 0x7f162c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:14.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.915+0000 7f163e7fc640 1 -- 172.21.15.53:0/929661449 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f164411dd10 con 0x7f16340039b0 2023-06-10T19:06:14.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.915+0000 7f164d5ee640 1 --2- 172.21.15.53:0/929661449 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f162c0662b0 0x7f162c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:14.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.915+0000 7f164d5ee640 1 --2- 172.21.15.53:0/929661449 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f162c0662b0 0x7f162c068760 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f1638001210 tx=0x7f1638009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:14.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:14.919+0000 7f163e7fc640 1 -- 172.21.15.53:0/929661449 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f16440eb1b0 con 0x7f16340039b0 2023-06-10T19:06:15.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.071+0000 7f1650053640 1 -- 172.21.15.53:0/929661449 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f16480ce670 con 0x7f16340039b0 2023-06-10T19:06:15.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.071+0000 7f163e7fc640 1 -- 172.21.15.53:0/929661449 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v142) v1 ==== 93+0+10 (secure 0 0 0) 0x7f16440b20a0 con 0x7f16340039b0 2023-06-10T19:06:15.074 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-06-10T19:06:15.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.075+0000 7f1650053640 1 -- 172.21.15.53:0/929661449 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f162c0662b0 msgr2=0x7f162c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:15.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.075+0000 7f1650053640 1 --2- 172.21.15.53:0/929661449 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f162c0662b0 0x7f162c068760 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f1638001210 tx=0x7f1638009040 comp rx=0 tx=0).stop 2023-06-10T19:06:15.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.075+0000 7f1650053640 1 -- 172.21.15.53:0/929661449 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16340039b0 msgr2=0x7f16481542a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:15.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.075+0000 7f1650053640 1 --2- 172.21.15.53:0/929661449 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16340039b0 0x7f16481542a0 secure :-1 s=READY pgs=2122 cs=0 l=1 rev1=1 crypto rx=0x7f16440b0040 tx=0x7f1634005800 comp rx=0 tx=0).stop 2023-06-10T19:06:15.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.075+0000 7f1650053640 1 -- 172.21.15.53:0/929661449 shutdown_connections 2023-06-10T19:06:15.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.075+0000 7f1650053640 1 --2- 172.21.15.53:0/929661449 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f162c0662b0 0x7f162c068760 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:15.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.075+0000 7f1650053640 1 --2- 172.21.15.53:0/929661449 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1648157680 0x7f1648157b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:15.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.075+0000 7f1650053640 1 --2- 172.21.15.53:0/929661449 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16480b3900 0x7f16481f4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:15.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.075+0000 7f1650053640 1 --2- 172.21.15.53:0/929661449 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16340039b0 0x7f16481542a0 unknown :-1 s=CLOSED pgs=2122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:15.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.075+0000 7f1650053640 1 -- 172.21.15.53:0/929661449 >> 172.21.15.53:0/929661449 conn(0x7f164806a0e0 msgr2=0x7f1648164960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:15.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.075+0000 7f1650053640 1 -- 172.21.15.53:0/929661449 shutdown_connections 2023-06-10T19:06:15.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.075+0000 7f1650053640 1 -- 172.21.15.53:0/929661449 wait complete. 2023-06-10T19:06:15.092 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-10T19:06:15.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.223+0000 7f73182b7640 1 Processor -- start 2023-06-10T19:06:15.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.223+0000 7f73182b7640 1 -- start start 2023-06-10T19:06:15.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.223+0000 7f73182b7640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f73100af760 0x7f73100afb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:15.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.223+0000 7f73182b7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f731015dae0 0x7f731006b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:15.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.223+0000 7f73182b7640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73100b0070 con 0x7f73100700e0 2023-06-10T19:06:15.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.223+0000 7f73182b7640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7310070910 con 0x7f731015dae0 2023-06-10T19:06:15.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.223+0000 7f73182b7640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7310070bf0 con 0x7f73100af760 2023-06-10T19:06:15.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.223+0000 7f7316854640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f731015dae0 0x7f731006b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:15.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.223+0000 7f7315852640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f73100700e0 0x7f73100c82a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60332/0 (socket says 172.21.15.53:60332) 2023-06-10T19:06:15.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.223+0000 7f7315852640 1 -- 172.21.15.53:0/4195726246 learned_addr learned my addr 172.21.15.53:0/4195726246 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:06:15.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.223+0000 7f7316854640 1 -- 172.21.15.53:0/4195726246 >> v2:172.21.15.117:3300/0 conn(0x7f73100af760 msgr2=0x7f73100afb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:15.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.223+0000 7f7316053640 1 --2- 172.21.15.53:0/4195726246 >> v2:172.21.15.117:3300/0 conn(0x7f73100af760 0x7f73100afb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:15.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.223+0000 7f7315051640 1 -- 172.21.15.53:0/4195726246 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 368063257 0 0) 0x7f73100b0070 con 0x7f73100700e0 2023-06-10T19:06:15.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.223+0000 7f7316854640 1 --2- 172.21.15.53:0/4195726246 >> v2:172.21.15.117:3300/0 conn(0x7f73100af760 0x7f73100afb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:15.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.223+0000 7f7316854640 1 -- 172.21.15.53:0/4195726246 >> v1:172.21.15.53:6789/0 conn(0x7f73100700e0 legacy=0x7f73100c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:15.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.223+0000 7f7316854640 1 -- 172.21.15.53:0/4195726246 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7310070ed0 con 0x7f731015dae0 2023-06-10T19:06:15.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.223+0000 7f7316053640 1 --2- 172.21.15.53:0/4195726246 >> v2:172.21.15.117:3300/0 conn(0x7f73100af760 0x7f73100afb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:06:15.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.227+0000 7f7316854640 1 --2- 172.21.15.53:0/4195726246 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f731015dae0 0x7f731006b650 secure :-1 s=READY pgs=2124 cs=0 l=1 rev1=1 crypto rx=0x7f731006e9d0 tx=0x7f730801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44e3d5b8803a7e18 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:15.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.227+0000 7f7315051640 1 -- 172.21.15.53:0/4195726246 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73080a59a0 con 0x7f731015dae0 2023-06-10T19:06:15.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.227+0000 7f7315051640 1 -- 172.21.15.53:0/4195726246 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73080a5b00 con 0x7f731015dae0 2023-06-10T19:06:15.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.227+0000 7f7315051640 1 -- 172.21.15.53:0/4195726246 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73080a5e90 con 0x7f731015dae0 2023-06-10T19:06:15.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.227+0000 7f73182b7640 1 -- 172.21.15.53:0/4195726246 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f731015dae0 msgr2=0x7f731006b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:15.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.227+0000 7f73182b7640 1 --2- 172.21.15.53:0/4195726246 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f731015dae0 0x7f731006b650 secure :-1 s=READY pgs=2124 cs=0 l=1 rev1=1 crypto rx=0x7f731006e9d0 tx=0x7f730801c8e0 comp rx=0 tx=0).stop 2023-06-10T19:06:15.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.227+0000 7f73182b7640 1 -- 172.21.15.53:0/4195726246 shutdown_connections 2023-06-10T19:06:15.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.227+0000 7f73182b7640 1 --2- 172.21.15.53:0/4195726246 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f731015dae0 0x7f731006b650 unknown :-1 s=CLOSED pgs=2124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:15.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.227+0000 7f73182b7640 1 --2- 172.21.15.53:0/4195726246 >> v2:172.21.15.117:3300/0 conn(0x7f73100af760 0x7f73100afb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:15.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.227+0000 7f73182b7640 1 -- 172.21.15.53:0/4195726246 >> 172.21.15.53:0/4195726246 conn(0x7f731006a0e0 msgr2=0x7f73100cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:15.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.227+0000 7f73182b7640 1 -- 172.21.15.53:0/4195726246 shutdown_connections 2023-06-10T19:06:15.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.227+0000 7f73182b7640 1 -- 172.21.15.53:0/4195726246 wait complete. 2023-06-10T19:06:15.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.227+0000 7f73182b7640 1 Processor -- start 2023-06-10T19:06:15.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.227+0000 7f73182b7640 1 -- start start 2023-06-10T19:06:15.232 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.227+0000 7f73182b7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73100700e0 0x7f73101548f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:15.232 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.227+0000 7f73182b7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73100af760 0x7f7310156b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:15.232 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.227+0000 7f73182b7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f731015dae0 0x7f73100c1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:15.232 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.227+0000 7f73182b7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7310154e30 con 0x7f73100af760 2023-06-10T19:06:15.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.227+0000 7f73182b7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73101570a0 con 0x7f73100700e0 2023-06-10T19:06:15.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.227+0000 7f73182b7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73100c23a0 con 0x7f731015dae0 2023-06-10T19:06:15.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.227+0000 7f7315852640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73100af760 0x7f7310156b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:15.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.227+0000 7f7315852640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73100af760 0x7f7310156b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42150/0 (socket says 172.21.15.53:42150) 2023-06-10T19:06:15.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.227+0000 7f7315852640 1 -- 172.21.15.53:0/4141563863 learned_addr learned my addr 172.21.15.53:0/4141563863 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:15.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.227+0000 7f7316053640 1 --2- 172.21.15.53:0/4141563863 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73100700e0 0x7f73101548f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:15.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.227+0000 7f7315852640 1 -- 172.21.15.53:0/4141563863 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f731015dae0 msgr2=0x7f73100c1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:15.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.227+0000 7f7316854640 1 --2- 172.21.15.53:0/4141563863 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f731015dae0 0x7f73100c1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:15.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.227+0000 7f7315852640 1 --2- 172.21.15.53:0/4141563863 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f731015dae0 0x7f73100c1e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:15.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.227+0000 7f7315852640 1 -- 172.21.15.53:0/4141563863 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73100700e0 msgr2=0x7f73101548f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:15.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.227+0000 7f7315852640 1 --2- 172.21.15.53:0/4141563863 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73100700e0 0x7f73101548f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:15.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.227+0000 7f7315852640 1 -- 172.21.15.53:0/4141563863 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7308009a70 con 0x7f73100af760 2023-06-10T19:06:15.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.227+0000 7f7315852640 1 --2- 172.21.15.53:0/4141563863 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73100af760 0x7f7310156b60 secure :-1 s=READY pgs=2125 cs=0 l=1 rev1=1 crypto rx=0x7f730c00c480 tx=0x7f730c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:15.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.227+0000 7f7302ffd640 1 -- 172.21.15.53:0/4141563863 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f730c0074e0 con 0x7f73100af760 2023-06-10T19:06:15.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.227+0000 7f7302ffd640 1 -- 172.21.15.53:0/4141563863 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f730c007660 con 0x7f73100af760 2023-06-10T19:06:15.235 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.227+0000 7f73182b7640 1 -- 172.21.15.53:0/4141563863 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73101572b0 con 0x7f73100af760 2023-06-10T19:06:15.235 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.227+0000 7f7302ffd640 1 -- 172.21.15.53:0/4141563863 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f730c004a30 con 0x7f73100af760 2023-06-10T19:06:15.235 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.227+0000 7f73182b7640 1 -- 172.21.15.53:0/4141563863 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7310157870 con 0x7f73100af760 2023-06-10T19:06:15.235 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.231+0000 7f73182b7640 1 -- 172.21.15.53:0/4141563863 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f731004d790 con 0x7f73100af760 2023-06-10T19:06:15.235 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.231+0000 7f7302ffd640 1 -- 172.21.15.53:0/4141563863 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f730c004b90 con 0x7f73100af760 2023-06-10T19:06:15.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.231+0000 7f7302ffd640 1 --2- 172.21.15.53:0/4141563863 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f72f4066280 0x7f72f4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:15.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.231+0000 7f7302ffd640 1 -- 172.21.15.53:0/4141563863 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f730c082e80 con 0x7f73100af760 2023-06-10T19:06:15.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.231+0000 7f7316053640 1 --2- 172.21.15.53:0/4141563863 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f72f4066280 0x7f72f4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:15.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.231+0000 7f7316053640 1 --2- 172.21.15.53:0/4141563863 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f72f4066280 0x7f72f4068730 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f7304006fd0 tx=0x7f7304008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:15.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.235+0000 7f7302ffd640 1 -- 172.21.15.53:0/4141563863 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f730c053dc0 con 0x7f73100af760 2023-06-10T19:06:15.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.391+0000 7f73182b7640 1 -- 172.21.15.53:0/4141563863 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f73100b3a40 con 0x7f73100af760 2023-06-10T19:06:15.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.391+0000 7f7302ffd640 1 -- 172.21.15.53:0/4141563863 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v142) v1 ==== 92+0+10 (secure 0 0 0) 0x7f730c018020 con 0x7f73100af760 2023-06-10T19:06:15.392 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-06-10T19:06:15.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.391+0000 7f73182b7640 1 -- 172.21.15.53:0/4141563863 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f72f4066280 msgr2=0x7f72f4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:15.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.391+0000 7f73182b7640 1 --2- 172.21.15.53:0/4141563863 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f72f4066280 0x7f72f4068730 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f7304006fd0 tx=0x7f7304008040 comp rx=0 tx=0).stop 2023-06-10T19:06:15.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.391+0000 7f73182b7640 1 -- 172.21.15.53:0/4141563863 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73100af760 msgr2=0x7f7310156b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:15.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.391+0000 7f73182b7640 1 --2- 172.21.15.53:0/4141563863 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73100af760 0x7f7310156b60 secure :-1 s=READY pgs=2125 cs=0 l=1 rev1=1 crypto rx=0x7f730c00c480 tx=0x7f730c00c940 comp rx=0 tx=0).stop 2023-06-10T19:06:15.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.391+0000 7f73182b7640 1 -- 172.21.15.53:0/4141563863 shutdown_connections 2023-06-10T19:06:15.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.391+0000 7f73182b7640 1 --2- 172.21.15.53:0/4141563863 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f72f4066280 0x7f72f4068730 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:15.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.391+0000 7f73182b7640 1 --2- 172.21.15.53:0/4141563863 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f731015dae0 0x7f73100c1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:15.395 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.391+0000 7f73182b7640 1 --2- 172.21.15.53:0/4141563863 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73100af760 0x7f7310156b60 unknown :-1 s=CLOSED pgs=2125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:15.395 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.391+0000 7f73182b7640 1 --2- 172.21.15.53:0/4141563863 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73100700e0 0x7f73101548f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:15.395 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.391+0000 7f73182b7640 1 -- 172.21.15.53:0/4141563863 >> 172.21.15.53:0/4141563863 conn(0x7f731006a0e0 msgr2=0x7f73100c8280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:15.395 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.391+0000 7f73182b7640 1 -- 172.21.15.53:0/4141563863 shutdown_connections 2023-06-10T19:06:15.395 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.391+0000 7f73182b7640 1 -- 172.21.15.53:0/4141563863 wait complete. 2023-06-10T19:06:15.410 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-10T19:06:15.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.527+0000 7f088c930640 1 Processor -- start 2023-06-10T19:06:15.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.527+0000 7f088c930640 1 -- start start 2023-06-10T19:06:15.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.527+0000 7f088c930640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0888159450 0x7f088815d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:15.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.527+0000 7f088c930640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f088815d680 0x7f08880cec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:15.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.527+0000 7f088c930640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08880cbac0 con 0x7f08880cf180 2023-06-10T19:06:15.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.527+0000 7f088c930640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08880cf5c0 con 0x7f088815d680 2023-06-10T19:06:15.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.527+0000 7f088c930640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f088815dc00 con 0x7f0888159450 2023-06-10T19:06:15.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.527+0000 7f0885d9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f088815d680 0x7f08880cec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:15.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.527+0000 7f0885d9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f088815d680 0x7f08880cec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42164/0 (socket says 172.21.15.53:42164) 2023-06-10T19:06:15.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.527+0000 7f0885d9b640 1 -- 172.21.15.53:0/1929138673 learned_addr learned my addr 172.21.15.53:0/1929138673 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:15.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.527+0000 7f0885d9b640 1 -- 172.21.15.53:0/1929138673 >> v2:172.21.15.117:3300/0 conn(0x7f0888159450 msgr2=0x7f088815d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:15.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.527+0000 7f0885d9b640 1 --2- 172.21.15.53:0/1929138673 >> v2:172.21.15.117:3300/0 conn(0x7f0888159450 0x7f088815d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:15.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.527+0000 7f0885d9b640 1 -- 172.21.15.53:0/1929138673 >> v1:172.21.15.117:6789/0 conn(0x7f08880cf180 legacy=0x7f08880cda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:15.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.527+0000 7f0885d9b640 1 -- 172.21.15.53:0/1929138673 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f088815dee0 con 0x7f088815d680 2023-06-10T19:06:15.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.531+0000 7f0885d9b640 1 --2- 172.21.15.53:0/1929138673 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f088815d680 0x7f08880cec40 secure :-1 s=READY pgs=2126 cs=0 l=1 rev1=1 crypto rx=0x7f08880b29a0 tx=0x7f087401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8f5a38229b0dcbb server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:15.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.531+0000 7f088559a640 1 -- 172.21.15.53:0/1929138673 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08740ab650 con 0x7f088815d680 2023-06-10T19:06:15.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.531+0000 7f088559a640 1 -- 172.21.15.53:0/1929138673 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08740ab7b0 con 0x7f088815d680 2023-06-10T19:06:15.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.531+0000 7f088559a640 1 -- 172.21.15.53:0/1929138673 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08740abb40 con 0x7f088815d680 2023-06-10T19:06:15.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.531+0000 7f088c930640 1 -- 172.21.15.53:0/1929138673 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f088815d680 msgr2=0x7f08880cec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:15.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.531+0000 7f088c930640 1 --2- 172.21.15.53:0/1929138673 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f088815d680 0x7f08880cec40 secure :-1 s=READY pgs=2126 cs=0 l=1 rev1=1 crypto rx=0x7f08880b29a0 tx=0x7f087401c490 comp rx=0 tx=0).stop 2023-06-10T19:06:15.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.531+0000 7f088c930640 1 -- 172.21.15.53:0/1929138673 shutdown_connections 2023-06-10T19:06:15.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.531+0000 7f088c930640 1 --2- 172.21.15.53:0/1929138673 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f088815d680 0x7f08880cec40 unknown :-1 s=CLOSED pgs=2126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:15.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.531+0000 7f088c930640 1 --2- 172.21.15.53:0/1929138673 >> v2:172.21.15.117:3300/0 conn(0x7f0888159450 0x7f088815d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:15.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.531+0000 7f088c930640 1 -- 172.21.15.53:0/1929138673 >> 172.21.15.53:0/1929138673 conn(0x7f088806a090 msgr2=0x7f088806d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:15.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.531+0000 7f088c930640 1 -- 172.21.15.53:0/1929138673 shutdown_connections 2023-06-10T19:06:15.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.531+0000 7f088c930640 1 -- 172.21.15.53:0/1929138673 wait complete. 2023-06-10T19:06:15.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.531+0000 7f088c930640 1 Processor -- start 2023-06-10T19:06:15.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.531+0000 7f088c930640 1 -- start start 2023-06-10T19:06:15.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.531+0000 7f088c930640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08880cf180 0x7f08880b2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:15.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.531+0000 7f088c930640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0888159450 0x7f08880c7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:15.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.531+0000 7f088c930640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f08880c7e50 0x7f0888153550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:15.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.531+0000 7f088c930640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08880c8340 con 0x7f08880c7e50 2023-06-10T19:06:15.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.531+0000 7f088c930640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08880c8620 con 0x7f0888159450 2023-06-10T19:06:15.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.531+0000 7f088c930640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08880c8900 con 0x7f08880cf180 2023-06-10T19:06:15.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.531+0000 7f0886d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f08880c7e50 0x7f0888153550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:15.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.531+0000 7f0886d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f08880c7e50 0x7f0888153550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42180/0 (socket says 172.21.15.53:42180) 2023-06-10T19:06:15.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.531+0000 7f0886d9d640 1 -- 172.21.15.53:0/2131569378 learned_addr learned my addr 172.21.15.53:0/2131569378 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:15.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.531+0000 7f088659c640 1 --2- 172.21.15.53:0/2131569378 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08880cf180 0x7f08880b2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:15.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.535+0000 7f0885d9b640 1 --2- 172.21.15.53:0/2131569378 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0888159450 0x7f08880c7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:15.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.535+0000 7f0886d9d640 1 -- 172.21.15.53:0/2131569378 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08880cf180 msgr2=0x7f08880b2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:15.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.535+0000 7f0886d9d640 1 --2- 172.21.15.53:0/2131569378 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08880cf180 0x7f08880b2ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:15.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.535+0000 7f0886d9d640 1 -- 172.21.15.53:0/2131569378 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0888159450 msgr2=0x7f08880c7910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:15.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.535+0000 7f0886d9d640 1 --2- 172.21.15.53:0/2131569378 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0888159450 0x7f08880c7910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:15.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.535+0000 7f0886d9d640 1 -- 172.21.15.53:0/2131569378 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08740094d0 con 0x7f08880c7e50 2023-06-10T19:06:15.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.535+0000 7f0885d9b640 1 --2- 172.21.15.53:0/2131569378 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0888159450 0x7f08880c7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:06:15.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.535+0000 7f0886d9d640 1 --2- 172.21.15.53:0/2131569378 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f08880c7e50 0x7f0888153550 secure :-1 s=READY pgs=2127 cs=0 l=1 rev1=1 crypto rx=0x7f088000b410 tx=0x7f088000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:15.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.535+0000 7f087effd640 1 -- 172.21.15.53:0/2131569378 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0880011830 con 0x7f08880c7e50 2023-06-10T19:06:15.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.535+0000 7f087effd640 1 -- 172.21.15.53:0/2131569378 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0880011990 con 0x7f08880c7e50 2023-06-10T19:06:15.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.535+0000 7f088c930640 1 -- 172.21.15.53:0/2131569378 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08880c8be0 con 0x7f08880c7e50 2023-06-10T19:06:15.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.535+0000 7f087effd640 1 -- 172.21.15.53:0/2131569378 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0880011d40 con 0x7f08880c7e50 2023-06-10T19:06:15.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.535+0000 7f088c930640 1 -- 172.21.15.53:0/2131569378 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0888152870 con 0x7f08880c7e50 2023-06-10T19:06:15.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.535+0000 7f088c930640 1 -- 172.21.15.53:0/2131569378 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f088804d790 con 0x7f08880c7e50 2023-06-10T19:06:15.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.535+0000 7f087effd640 1 -- 172.21.15.53:0/2131569378 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f088001a400 con 0x7f08880c7e50 2023-06-10T19:06:15.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.535+0000 7f087effd640 1 --2- 172.21.15.53:0/2131569378 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0870066280 0x7f0870068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:15.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.535+0000 7f087effd640 1 -- 172.21.15.53:0/2131569378 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f0880083ed0 con 0x7f08880c7e50 2023-06-10T19:06:15.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.535+0000 7f088659c640 1 --2- 172.21.15.53:0/2131569378 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0870066280 0x7f0870068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:15.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.535+0000 7f088659c640 1 --2- 172.21.15.53:0/2131569378 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0870066280 0x7f0870068730 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f0878007dc0 tx=0x7f08780072f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:15.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.539+0000 7f087effd640 1 -- 172.21.15.53:0/2131569378 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0880051380 con 0x7f08880c7e50 2023-06-10T19:06:15.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.687+0000 7f088c930640 1 -- 172.21.15.53:0/2131569378 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f08881642b0 con 0x7f08880c7e50 2023-06-10T19:06:15.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.687+0000 7f087effd640 1 -- 172.21.15.53:0/2131569378 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v142) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0880015020 con 0x7f08880c7e50 2023-06-10T19:06:15.689 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-06-10T19:06:15.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.691+0000 7f088c930640 1 -- 172.21.15.53:0/2131569378 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0870066280 msgr2=0x7f0870068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:15.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.691+0000 7f088c930640 1 --2- 172.21.15.53:0/2131569378 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0870066280 0x7f0870068730 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f0878007dc0 tx=0x7f08780072f0 comp rx=0 tx=0).stop 2023-06-10T19:06:15.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.691+0000 7f088c930640 1 -- 172.21.15.53:0/2131569378 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f08880c7e50 msgr2=0x7f0888153550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:15.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.691+0000 7f088c930640 1 --2- 172.21.15.53:0/2131569378 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f08880c7e50 0x7f0888153550 secure :-1 s=READY pgs=2127 cs=0 l=1 rev1=1 crypto rx=0x7f088000b410 tx=0x7f088000b8d0 comp rx=0 tx=0).stop 2023-06-10T19:06:15.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.691+0000 7f088c930640 1 -- 172.21.15.53:0/2131569378 shutdown_connections 2023-06-10T19:06:15.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.691+0000 7f088c930640 1 --2- 172.21.15.53:0/2131569378 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0870066280 0x7f0870068730 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:15.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.691+0000 7f088c930640 1 --2- 172.21.15.53:0/2131569378 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f08880c7e50 0x7f0888153550 unknown :-1 s=CLOSED pgs=2127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:15.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.691+0000 7f088c930640 1 --2- 172.21.15.53:0/2131569378 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0888159450 0x7f08880c7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:15.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.691+0000 7f088c930640 1 --2- 172.21.15.53:0/2131569378 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08880cf180 0x7f08880b2ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:15.693 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.691+0000 7f088c930640 1 -- 172.21.15.53:0/2131569378 >> 172.21.15.53:0/2131569378 conn(0x7f088806a090 msgr2=0x7f08880af8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:15.693 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.691+0000 7f088c930640 1 -- 172.21.15.53:0/2131569378 shutdown_connections 2023-06-10T19:06:15.693 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.691+0000 7f088c930640 1 -- 172.21.15.53:0/2131569378 wait complete. 2023-06-10T19:06:15.707 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-10T19:06:15.832 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.831+0000 7f7f880b0640 1 Processor -- start 2023-06-10T19:06:15.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.831+0000 7f7f880b0640 1 -- start start 2023-06-10T19:06:15.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.831+0000 7f7f880b0640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7f800ccae0 0x7f7f800d0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:15.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.831+0000 7f7f880b0640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f800d0020 con 0x7f7f800cc690 2023-06-10T19:06:15.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.831+0000 7f7f880b0640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f800cef40 con 0x7f7f800b3ac0 2023-06-10T19:06:15.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.831+0000 7f7f880b0640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f800cf220 con 0x7f7f800ccae0 2023-06-10T19:06:15.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.831+0000 7f7f8564b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f7f800cc690 0x7f7f800d04b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60342/0 (socket says 172.21.15.53:60342) 2023-06-10T19:06:15.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.831+0000 7f7f8564b640 1 -- 172.21.15.53:0/572500333 learned_addr learned my addr 172.21.15.53:0/572500333 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:06:15.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.831+0000 7f7f8664d640 1 --2- 172.21.15.53:0/572500333 >> v2:172.21.15.117:3300/0 conn(0x7f7f800ccae0 0x7f7f800d0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:15.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.831+0000 7f7f84e4a640 1 -- 172.21.15.53:0/572500333 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 852772870 0 0) 0x7f7f800d0020 con 0x7f7f800cc690 2023-06-10T19:06:15.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.831+0000 7f7f84e4a640 1 -- 172.21.15.53:0/572500333 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f6c003530 con 0x7f7f800cc690 2023-06-10T19:06:15.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.831+0000 7f7f84e4a640 1 -- 172.21.15.53:0/572500333 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2576322907 0 0) 0x7f7f6c003530 con 0x7f7f800cc690 2023-06-10T19:06:15.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.831+0000 7f7f84e4a640 1 -- 172.21.15.53:0/572500333 >> v2:172.21.15.117:3300/0 conn(0x7f7f800ccae0 msgr2=0x7f7f800d0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:15.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.831+0000 7f7f84e4a640 1 --2- 172.21.15.53:0/572500333 >> v2:172.21.15.117:3300/0 conn(0x7f7f800ccae0 0x7f7f800d0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:15.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.831+0000 7f7f84e4a640 1 -- 172.21.15.53:0/572500333 >> v1:172.21.15.117:6789/0 conn(0x7f7f800b3ac0 legacy=0x7f7f800b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:15.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.831+0000 7f7f84e4a640 1 -- 172.21.15.53:0/572500333 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f800cf500 con 0x7f7f800cc690 2023-06-10T19:06:15.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.831+0000 7f7f84e4a640 1 -- 172.21.15.53:0/572500333 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f7f70001680 con 0x7f7f800cc690 2023-06-10T19:06:15.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.831+0000 7f7f84e4a640 1 -- 172.21.15.53:0/572500333 >> v1:172.21.15.53:6789/0 conn(0x7f7f800cc690 legacy=0x7f7f800d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:15.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.831+0000 7f7f84e4a640 1 --2- 172.21.15.53:0/572500333 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f6c003980 0x7f7f6c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:15.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.831+0000 7f7f84e4a640 1 --2- 172.21.15.53:0/572500333 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f6c0047d0 0x7f7f6c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:15.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.831+0000 7f7f84e4a640 1 --2- 172.21.15.53:0/572500333 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f6c005180 0x7f7f6c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:15.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.831+0000 7f7f84e4a640 1 -- 172.21.15.53:0/572500333 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f800cf220 con 0x7f7f6c0047d0 2023-06-10T19:06:15.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.831+0000 7f7f84e4a640 1 -- 172.21.15.53:0/572500333 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6c00c000 con 0x7f7f6c005180 2023-06-10T19:06:15.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.831+0000 7f7f84e4a640 1 -- 172.21.15.53:0/572500333 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6c00c1c0 con 0x7f7f6c003980 2023-06-10T19:06:15.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.831+0000 7f7f8564b640 1 --2- 172.21.15.53:0/572500333 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f6c0047d0 0x7f7f6c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:15.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.831+0000 7f7f8664d640 1 --2- 172.21.15.53:0/572500333 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f6c005180 0x7f7f6c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:15.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.831+0000 7f7f8564b640 1 -- 172.21.15.53:0/572500333 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f6c003980 msgr2=0x7f7f6c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:15.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.831+0000 7f7f8564b640 1 --2- 172.21.15.53:0/572500333 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f6c003980 0x7f7f6c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:15.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.831+0000 7f7f8564b640 1 -- 172.21.15.53:0/572500333 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f6c005180 msgr2=0x7f7f6c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:15.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.831+0000 7f7f8564b640 1 --2- 172.21.15.53:0/572500333 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f6c005180 0x7f7f6c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:15.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.831+0000 7f7f8664d640 1 -- 172.21.15.53:0/572500333 reap_dead start 2023-06-10T19:06:15.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.831+0000 7f7f8564b640 1 -- 172.21.15.53:0/572500333 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f6c003530 con 0x7f7f6c0047d0 2023-06-10T19:06:15.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.835+0000 7f7f8564b640 1 --2- 172.21.15.53:0/572500333 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f6c0047d0 0x7f7f6c004c40 secure :-1 s=READY pgs=2129 cs=0 l=1 rev1=1 crypto rx=0x7f7f7000c240 tx=0x7f7f7001f370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83cb6e103222535b server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:15.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.835+0000 7f7f84e4a640 1 -- 172.21.15.53:0/572500333 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f700a8e90 con 0x7f7f6c0047d0 2023-06-10T19:06:15.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.835+0000 7f7f84e4a640 1 -- 172.21.15.53:0/572500333 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f700058e0 con 0x7f7f6c0047d0 2023-06-10T19:06:15.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.835+0000 7f7f84e4a640 1 -- 172.21.15.53:0/572500333 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f70005d10 con 0x7f7f6c0047d0 2023-06-10T19:06:15.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.835+0000 7f7f880b0640 1 -- 172.21.15.53:0/572500333 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f6c0047d0 msgr2=0x7f7f6c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:15.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.835+0000 7f7f880b0640 1 --2- 172.21.15.53:0/572500333 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f6c0047d0 0x7f7f6c004c40 secure :-1 s=READY pgs=2129 cs=0 l=1 rev1=1 crypto rx=0x7f7f7000c240 tx=0x7f7f7001f370 comp rx=0 tx=0).stop 2023-06-10T19:06:15.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.835+0000 7f7f880b0640 1 -- 172.21.15.53:0/572500333 shutdown_connections 2023-06-10T19:06:15.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.835+0000 7f7f880b0640 1 --2- 172.21.15.53:0/572500333 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f6c0047d0 0x7f7f6c004c40 unknown :-1 s=CLOSED pgs=2129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:15.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.835+0000 7f7f880b0640 1 -- 172.21.15.53:0/572500333 >> 172.21.15.53:0/572500333 conn(0x7f7f80071790 msgr2=0x7f7f80069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:15.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.835+0000 7f7f880b0640 1 -- 172.21.15.53:0/572500333 shutdown_connections 2023-06-10T19:06:15.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.835+0000 7f7f880b0640 1 -- 172.21.15.53:0/572500333 wait complete. 2023-06-10T19:06:15.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.835+0000 7f7f880b0640 1 Processor -- start 2023-06-10T19:06:15.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.835+0000 7f7f880b0640 1 -- start start 2023-06-10T19:06:15.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.839+0000 7f7f880b0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f6c0047d0 0x7f7f800ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:15.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.839+0000 7f7f880b0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f800c58a0 0x7f7f800c5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:15.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.839+0000 7f7f880b0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f8015a130 0x7f7f8015a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:15.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.839+0000 7f7f880b0640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f800c6250 con 0x7f7f8015a130 2023-06-10T19:06:15.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.839+0000 7f7f880b0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f801f12f0 con 0x7f7f800c58a0 2023-06-10T19:06:15.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.839+0000 7f7f880b0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f801f15d0 con 0x7f7f6c0047d0 2023-06-10T19:06:15.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.839+0000 7f7f8664d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f8015a130 0x7f7f8015a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:15.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.839+0000 7f7f8664d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f8015a130 0x7f7f8015a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42206/0 (socket says 172.21.15.53:42206) 2023-06-10T19:06:15.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.839+0000 7f7f8664d640 1 -- 172.21.15.53:0/2082022604 learned_addr learned my addr 172.21.15.53:0/2082022604 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:15.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.839+0000 7f7f85e4c640 1 --2- 172.21.15.53:0/2082022604 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f6c0047d0 0x7f7f800ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:15.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.839+0000 7f7f8564b640 1 --2- 172.21.15.53:0/2082022604 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f800c58a0 0x7f7f800c5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:15.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.839+0000 7f7f8664d640 1 -- 172.21.15.53:0/2082022604 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f6c0047d0 msgr2=0x7f7f800ce4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:15.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.839+0000 7f7f8664d640 1 --2- 172.21.15.53:0/2082022604 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f6c0047d0 0x7f7f800ce4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:15.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.839+0000 7f7f8664d640 1 -- 172.21.15.53:0/2082022604 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f800c58a0 msgr2=0x7f7f800c5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:15.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.839+0000 7f7f8664d640 1 --2- 172.21.15.53:0/2082022604 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f800c58a0 0x7f7f800c5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:15.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.839+0000 7f7f8664d640 1 -- 172.21.15.53:0/2082022604 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f801f18b0 con 0x7f7f8015a130 2023-06-10T19:06:15.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.839+0000 7f7f8564b640 1 --2- 172.21.15.53:0/2082022604 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f800c58a0 0x7f7f800c5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:06:15.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.839+0000 7f7f8664d640 1 --2- 172.21.15.53:0/2082022604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f8015a130 0x7f7f8015a580 secure :-1 s=READY pgs=2130 cs=0 l=1 rev1=1 crypto rx=0x7f7f8008aff0 tx=0x7f7f78007d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:15.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.839+0000 7f7f767fc640 1 -- 172.21.15.53:0/2082022604 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7800e070 con 0x7f7f8015a130 2023-06-10T19:06:15.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.839+0000 7f7f767fc640 1 -- 172.21.15.53:0/2082022604 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f78003c70 con 0x7f7f8015a130 2023-06-10T19:06:15.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.839+0000 7f7f767fc640 1 -- 172.21.15.53:0/2082022604 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f78003e40 con 0x7f7f8015a130 2023-06-10T19:06:15.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.839+0000 7f7f880b0640 1 -- 172.21.15.53:0/2082022604 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f801f1b90 con 0x7f7f8015a130 2023-06-10T19:06:15.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.839+0000 7f7f880b0640 1 -- 172.21.15.53:0/2082022604 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f8015d200 con 0x7f7f8015a130 2023-06-10T19:06:15.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.839+0000 7f7f880b0640 1 -- 172.21.15.53:0/2082022604 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f801f1d80 con 0x7f7f8015a130 2023-06-10T19:06:15.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.839+0000 7f7f767fc640 1 -- 172.21.15.53:0/2082022604 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7f78004030 con 0x7f7f8015a130 2023-06-10T19:06:15.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.839+0000 7f7f767fc640 1 --2- 172.21.15.53:0/2082022604 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7f64066280 0x7f7f64068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:15.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.839+0000 7f7f767fc640 1 -- 172.21.15.53:0/2082022604 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f7f78083d20 con 0x7f7f8015a130 2023-06-10T19:06:15.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.839+0000 7f7f85e4c640 1 --2- 172.21.15.53:0/2082022604 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7f64066280 0x7f7f64068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:15.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.843+0000 7f7f85e4c640 1 --2- 172.21.15.53:0/2082022604 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7f64066280 0x7f7f64068730 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f7f801f5690 tx=0x7f7f7c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:15.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.843+0000 7f7f767fc640 1 -- 172.21.15.53:0/2082022604 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7f780510a0 con 0x7f7f8015a130 2023-06-10T19:06:15.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.991+0000 7f7f880b0640 1 -- 172.21.15.53:0/2082022604 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7f8004d790 con 0x7f7f8015a130 2023-06-10T19:06:15.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.991+0000 7f7f767fc640 1 -- 172.21.15.53:0/2082022604 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v142) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7f780546c0 con 0x7f7f8015a130 2023-06-10T19:06:15.993 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-06-10T19:06:15.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.991+0000 7f7f880b0640 1 -- 172.21.15.53:0/2082022604 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7f64066280 msgr2=0x7f7f64068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:15.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.991+0000 7f7f880b0640 1 --2- 172.21.15.53:0/2082022604 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7f64066280 0x7f7f64068730 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f7f801f5690 tx=0x7f7f7c009040 comp rx=0 tx=0).stop 2023-06-10T19:06:15.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.991+0000 7f7f880b0640 1 -- 172.21.15.53:0/2082022604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f8015a130 msgr2=0x7f7f8015a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:15.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.991+0000 7f7f880b0640 1 --2- 172.21.15.53:0/2082022604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f8015a130 0x7f7f8015a580 secure :-1 s=READY pgs=2130 cs=0 l=1 rev1=1 crypto rx=0x7f7f8008aff0 tx=0x7f7f78007d20 comp rx=0 tx=0).stop 2023-06-10T19:06:15.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.991+0000 7f7f880b0640 1 -- 172.21.15.53:0/2082022604 shutdown_connections 2023-06-10T19:06:15.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.991+0000 7f7f880b0640 1 --2- 172.21.15.53:0/2082022604 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7f64066280 0x7f7f64068730 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:15.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.991+0000 7f7f880b0640 1 --2- 172.21.15.53:0/2082022604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f8015a130 0x7f7f8015a580 unknown :-1 s=CLOSED pgs=2130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:15.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.991+0000 7f7f880b0640 1 --2- 172.21.15.53:0/2082022604 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f800c58a0 0x7f7f800c5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:15.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.991+0000 7f7f880b0640 1 --2- 172.21.15.53:0/2082022604 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f6c0047d0 0x7f7f800ce4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:15.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.991+0000 7f7f880b0640 1 -- 172.21.15.53:0/2082022604 >> 172.21.15.53:0/2082022604 conn(0x7f7f80071790 msgr2=0x7f7f800b2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:15.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.991+0000 7f7f880b0640 1 -- 172.21.15.53:0/2082022604 shutdown_connections 2023-06-10T19:06:15.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:15.995+0000 7f7f880b0640 1 -- 172.21.15.53:0/2082022604 wait complete. 2023-06-10T19:06:16.011 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:06:16.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.123+0000 7f5714aa1640 1 Processor -- start 2023-06-10T19:06:16.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.123+0000 7f5714aa1640 1 -- start start 2023-06-10T19:06:16.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.123+0000 7f5714aa1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5710157e10 0x7f571006efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:16.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.123+0000 7f5714aa1640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f571006bb30 0x7f57100ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:16.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.123+0000 7f5714aa1640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57100c9e50 con 0x7f57100af720 2023-06-10T19:06:16.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.123+0000 7f5714aa1640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57100cd520 con 0x7f571006bb30 2023-06-10T19:06:16.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.123+0000 7f5714aa1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57100c82f0 con 0x7f5710157e10 2023-06-10T19:06:16.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.123+0000 7f570dd9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f571006bb30 0x7f57100ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:16.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.123+0000 7f570ed9d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f57100af720 0x7f571015bc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60344/0 (socket says 172.21.15.53:60344) 2023-06-10T19:06:16.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.123+0000 7f570ed9d640 1 -- 172.21.15.53:0/3454683572 learned_addr learned my addr 172.21.15.53:0/3454683572 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:06:16.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.127+0000 7f570e59c640 1 --2- 172.21.15.53:0/3454683572 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5710157e10 0x7f571006efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:16.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.127+0000 7f570dd9b640 1 -- 172.21.15.53:0/3454683572 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5710157e10 msgr2=0x7f571006efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:16.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.127+0000 7f570dd9b640 1 --2- 172.21.15.53:0/3454683572 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5710157e10 0x7f571006efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:16.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.127+0000 7f570dd9b640 1 -- 172.21.15.53:0/3454683572 >> v1:172.21.15.53:6789/0 conn(0x7f57100af720 legacy=0x7f571015bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:16.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.127+0000 7f570dd9b640 1 -- 172.21.15.53:0/3454683572 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f571006bf80 con 0x7f571006bb30 2023-06-10T19:06:16.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.127+0000 7f570dd9b640 1 --2- 172.21.15.53:0/3454683572 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f571006bb30 0x7f57100ccfe0 secure :-1 s=READY pgs=2132 cs=0 l=1 rev1=1 crypto rx=0x7f57040097c0 tx=0x7f570401d390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a880493eda92e198 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:16.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.127+0000 7f570d59a640 1 -- 172.21.15.53:0/3454683572 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57040ac600 con 0x7f571006bb30 2023-06-10T19:06:16.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.127+0000 7f570d59a640 1 -- 172.21.15.53:0/3454683572 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57040a8050 con 0x7f571006bb30 2023-06-10T19:06:16.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.127+0000 7f570d59a640 1 -- 172.21.15.53:0/3454683572 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57040ac980 con 0x7f571006bb30 2023-06-10T19:06:16.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.127+0000 7f5714aa1640 1 -- 172.21.15.53:0/3454683572 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f571006bb30 msgr2=0x7f57100ccfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:16.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.127+0000 7f5714aa1640 1 --2- 172.21.15.53:0/3454683572 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f571006bb30 0x7f57100ccfe0 secure :-1 s=READY pgs=2132 cs=0 l=1 rev1=1 crypto rx=0x7f57040097c0 tx=0x7f570401d390 comp rx=0 tx=0).stop 2023-06-10T19:06:16.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.127+0000 7f5714aa1640 1 -- 172.21.15.53:0/3454683572 shutdown_connections 2023-06-10T19:06:16.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.127+0000 7f5714aa1640 1 --2- 172.21.15.53:0/3454683572 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f571006bb30 0x7f57100ccfe0 unknown :-1 s=CLOSED pgs=2132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:16.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.127+0000 7f5714aa1640 1 --2- 172.21.15.53:0/3454683572 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5710157e10 0x7f571006efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:16.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.127+0000 7f5714aa1640 1 -- 172.21.15.53:0/3454683572 >> 172.21.15.53:0/3454683572 conn(0x7f571006a0d0 msgr2=0x7f57100ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:16.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.127+0000 7f5714aa1640 1 -- 172.21.15.53:0/3454683572 shutdown_connections 2023-06-10T19:06:16.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.127+0000 7f5714aa1640 1 -- 172.21.15.53:0/3454683572 wait complete. 2023-06-10T19:06:16.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.131+0000 7f5714aa1640 1 Processor -- start 2023-06-10T19:06:16.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.131+0000 7f5714aa1640 1 -- start start 2023-06-10T19:06:16.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.131+0000 7f5714aa1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f571006bb30 0x7f57100c7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:16.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.131+0000 7f5714aa1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57100af720 0x7f57100c6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:16.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.131+0000 7f5714aa1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5710157e10 0x7f57101490e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:16.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.131+0000 7f5714aa1640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5710149620 con 0x7f5710157e10 2023-06-10T19:06:16.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.131+0000 7f5714aa1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5710159890 con 0x7f57100af720 2023-06-10T19:06:16.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.131+0000 7f5714aa1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57101595b0 con 0x7f571006bb30 2023-06-10T19:06:16.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.131+0000 7f570ed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5710157e10 0x7f57101490e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:16.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.131+0000 7f570ed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5710157e10 0x7f57101490e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42234/0 (socket says 172.21.15.53:42234) 2023-06-10T19:06:16.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.131+0000 7f570ed9d640 1 -- 172.21.15.53:0/125142762 learned_addr learned my addr 172.21.15.53:0/125142762 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:16.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.131+0000 7f570ed9d640 1 -- 172.21.15.53:0/125142762 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f571006bb30 msgr2=0x7f57100c7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:16.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.131+0000 7f570ed9d640 1 --2- 172.21.15.53:0/125142762 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f571006bb30 0x7f57100c7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:16.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.131+0000 7f570ed9d640 1 -- 172.21.15.53:0/125142762 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57100af720 msgr2=0x7f57100c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:16.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.131+0000 7f570ed9d640 1 --2- 172.21.15.53:0/125142762 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57100af720 0x7f57100c6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:16.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.131+0000 7f570ed9d640 1 -- 172.21.15.53:0/125142762 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5704009420 con 0x7f5710157e10 2023-06-10T19:06:16.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.131+0000 7f570ed9d640 1 --2- 172.21.15.53:0/125142762 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5710157e10 0x7f57101490e0 secure :-1 s=READY pgs=2133 cs=0 l=1 rev1=1 crypto rx=0x7f570800e780 tx=0x7f570800ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:16.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.131+0000 7f56feffd640 1 -- 172.21.15.53:0/125142762 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f570800f930 con 0x7f5710157e10 2023-06-10T19:06:16.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.131+0000 7f56feffd640 1 -- 172.21.15.53:0/125142762 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f570800fa90 con 0x7f5710157e10 2023-06-10T19:06:16.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.131+0000 7f5714aa1640 1 -- 172.21.15.53:0/125142762 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57100c5820 con 0x7f5710157e10 2023-06-10T19:06:16.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.131+0000 7f56feffd640 1 -- 172.21.15.53:0/125142762 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f570800fe60 con 0x7f5710157e10 2023-06-10T19:06:16.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.131+0000 7f5714aa1640 1 -- 172.21.15.53:0/125142762 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57100c5de0 con 0x7f5710157e10 2023-06-10T19:06:16.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.131+0000 7f5714aa1640 1 -- 172.21.15.53:0/125142762 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57100c5fd0 con 0x7f5710157e10 2023-06-10T19:06:16.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.131+0000 7f56feffd640 1 -- 172.21.15.53:0/125142762 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5708015070 con 0x7f5710157e10 2023-06-10T19:06:16.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.131+0000 7f56feffd640 1 --2- 172.21.15.53:0/125142762 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f56f0066280 0x7f56f0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:16.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.131+0000 7f56feffd640 1 -- 172.21.15.53:0/125142762 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f5708086750 con 0x7f5710157e10 2023-06-10T19:06:16.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.135+0000 7f570e59c640 1 --2- 172.21.15.53:0/125142762 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f56f0066280 0x7f56f0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:16.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.135+0000 7f570e59c640 1 --2- 172.21.15.53:0/125142762 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f56f0066280 0x7f56f0068730 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f5710159d00 tx=0x7f5700008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:16.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.139+0000 7f56feffd640 1 -- 172.21.15.53:0/125142762 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5708053b70 con 0x7f5710157e10 2023-06-10T19:06:16.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.315+0000 7f5714aa1640 1 -- 172.21.15.53:0/125142762 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f571004d790 con 0x7f5710157e10 2023-06-10T19:06:16.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.315+0000 7f56feffd640 1 -- 172.21.15.53:0/125142762 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) v1 ==== 94+0+4678 (secure 0 0 0) 0x7f5708057190 con 0x7f5710157e10 2023-06-10T19:06:16.318 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:06:16.318 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":81,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8125,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3512570304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3512570304},{"type":"v1","addr":"172.21.15.117:6835","nonce":3512570304}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78},{"gid":8128,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/325110995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":325110995},{"type":"v1","addr":"172.21.15.117:6837","nonce":325110995}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78},{"gid":9759,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/2776844045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2776844045},{"type":"v1","addr":"172.21.15.53:6833","nonce":2776844045}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:05:50.789763+0000","modified":"2023-06-10T19:06:09.123261+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":139,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9780},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9780":{"gid":9780,"name":"c","rank":0,"incarnation":78,"state":"up:active","state_seq":4,"addr":"172.21.15.53:6835/2721536857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2721536857},{"type":"v1","addr":"172.21.15.53:6835","nonce":2721536857}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-06-10T19:06:16.318 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 81 2023-06-10T19:06:16.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.319+0000 7f5714aa1640 1 -- 172.21.15.53:0/125142762 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f56f0066280 msgr2=0x7f56f0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:16.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.319+0000 7f5714aa1640 1 --2- 172.21.15.53:0/125142762 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f56f0066280 0x7f56f0068730 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f5710159d00 tx=0x7f5700008040 comp rx=0 tx=0).stop 2023-06-10T19:06:16.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.319+0000 7f5714aa1640 1 -- 172.21.15.53:0/125142762 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5710157e10 msgr2=0x7f57101490e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:16.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.319+0000 7f5714aa1640 1 --2- 172.21.15.53:0/125142762 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5710157e10 0x7f57101490e0 secure :-1 s=READY pgs=2133 cs=0 l=1 rev1=1 crypto rx=0x7f570800e780 tx=0x7f570800ec40 comp rx=0 tx=0).stop 2023-06-10T19:06:16.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.319+0000 7f5714aa1640 1 -- 172.21.15.53:0/125142762 shutdown_connections 2023-06-10T19:06:16.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.319+0000 7f5714aa1640 1 --2- 172.21.15.53:0/125142762 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f56f0066280 0x7f56f0068730 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:16.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.319+0000 7f5714aa1640 1 --2- 172.21.15.53:0/125142762 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5710157e10 0x7f57101490e0 unknown :-1 s=CLOSED pgs=2133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:16.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.319+0000 7f5714aa1640 1 --2- 172.21.15.53:0/125142762 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57100af720 0x7f57100c6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:16.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.319+0000 7f5714aa1640 1 --2- 172.21.15.53:0/125142762 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f571006bb30 0x7f57100c7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:16.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.319+0000 7f5714aa1640 1 -- 172.21.15.53:0/125142762 >> 172.21.15.53:0/125142762 conn(0x7f571006a0d0 msgr2=0x7f57100cb850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:16.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.319+0000 7f5714aa1640 1 -- 172.21.15.53:0/125142762 shutdown_connections 2023-06-10T19:06:16.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.319+0000 7f5714aa1640 1 -- 172.21.15.53:0/125142762 wait complete. 2023-06-10T19:06:16.336 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:06:16.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.447+0000 7fd8e2245640 1 Processor -- start 2023-06-10T19:06:16.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.447+0000 7fd8e2245640 1 -- start start 2023-06-10T19:06:16.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.451+0000 7fd8e2245640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd8dc15c0b0 0x7fd8dc070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:16.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.451+0000 7fd8e2245640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8dc0cbd50 0x7fd8dc06bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:16.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.451+0000 7fd8e2245640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8dc070080 con 0x7fd8dc0cc160 2023-06-10T19:06:16.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.451+0000 7fd8e2245640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8dc0705c0 con 0x7fd8dc15c0b0 2023-06-10T19:06:16.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.451+0000 7fd8e2245640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8dc0c8e30 con 0x7fd8dc0cbd50 2023-06-10T19:06:16.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.451+0000 7fd8daffd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8dc0cbd50 0x7fd8dc06bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:16.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.451+0000 7fd8daffd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8dc0cbd50 0x7fd8dc06bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.53:40670/0 (socket says 172.21.15.53:40670) 2023-06-10T19:06:16.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.451+0000 7fd8daffd640 1 -- 172.21.15.53:0/178408964 learned_addr learned my addr 172.21.15.53:0/178408964 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:16.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.451+0000 7fd8db7fe640 1 --2- 172.21.15.53:0/178408964 >> v2:172.21.15.117:3300/0 conn(0x7fd8dc15c0b0 0x7fd8dc070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:16.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.451+0000 7fd8da7fc640 1 -- 172.21.15.53:0/178408964 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 337634930 0 0) 0x7fd8dc070080 con 0x7fd8dc0cc160 2023-06-10T19:06:16.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.451+0000 7fd8da7fc640 1 -- 172.21.15.53:0/178408964 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8c4003530 con 0x7fd8dc0cc160 2023-06-10T19:06:16.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.451+0000 7fd8daffd640 1 -- 172.21.15.53:0/178408964 >> v2:172.21.15.117:3300/0 conn(0x7fd8dc15c0b0 msgr2=0x7fd8dc070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:16.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.451+0000 7fd8daffd640 1 --2- 172.21.15.53:0/178408964 >> v2:172.21.15.117:3300/0 conn(0x7fd8dc15c0b0 0x7fd8dc070f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:16.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.451+0000 7fd8daffd640 1 -- 172.21.15.53:0/178408964 >> v1:172.21.15.117:6789/0 conn(0x7fd8dc0cc160 legacy=0x7fd8dc15c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:16.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.451+0000 7fd8daffd640 1 -- 172.21.15.53:0/178408964 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8dc06baa0 con 0x7fd8dc0cbd50 2023-06-10T19:06:16.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.451+0000 7fd8daffd640 1 --2- 172.21.15.53:0/178408964 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8dc0cbd50 0x7fd8dc06bf80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd8d0009870 tx=0x7fd8d001c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bdf151796476d1f server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:16.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.451+0000 7fd8da7fc640 1 -- 172.21.15.53:0/178408964 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d00a7070 con 0x7fd8dc0cbd50 2023-06-10T19:06:16.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.451+0000 7fd8da7fc640 1 -- 172.21.15.53:0/178408964 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8d00ab430 con 0x7fd8dc0cbd50 2023-06-10T19:06:16.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.451+0000 7fd8da7fc640 1 -- 172.21.15.53:0/178408964 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d00ab7a0 con 0x7fd8dc0cbd50 2023-06-10T19:06:16.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.455+0000 7fd8e2245640 1 -- 172.21.15.53:0/178408964 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8dc0cbd50 msgr2=0x7fd8dc06bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:16.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.455+0000 7fd8e2245640 1 --2- 172.21.15.53:0/178408964 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8dc0cbd50 0x7fd8dc06bf80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd8d0009870 tx=0x7fd8d001c540 comp rx=0 tx=0).stop 2023-06-10T19:06:16.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.455+0000 7fd8e2245640 1 -- 172.21.15.53:0/178408964 shutdown_connections 2023-06-10T19:06:16.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.455+0000 7fd8e2245640 1 --2- 172.21.15.53:0/178408964 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8dc0cbd50 0x7fd8dc06bf80 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:16.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.455+0000 7fd8e2245640 1 --2- 172.21.15.53:0/178408964 >> v2:172.21.15.117:3300/0 conn(0x7fd8dc15c0b0 0x7fd8dc070f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:16.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.455+0000 7fd8e2245640 1 -- 172.21.15.53:0/178408964 >> 172.21.15.53:0/178408964 conn(0x7fd8dc06a0d0 msgr2=0x7fd8dc0ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:16.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.455+0000 7fd8e2245640 1 -- 172.21.15.53:0/178408964 shutdown_connections 2023-06-10T19:06:16.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.455+0000 7fd8e2245640 1 -- 172.21.15.53:0/178408964 wait complete. 2023-06-10T19:06:16.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.455+0000 7fd8e2245640 1 Processor -- start 2023-06-10T19:06:16.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.455+0000 7fd8e2245640 1 -- start start 2023-06-10T19:06:16.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.455+0000 7fd8e2245640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8dc0cbd50 0x7fd8dc156370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:16.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.455+0000 7fd8e2245640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8dc0cc160 0x7fd8dc14e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:16.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.455+0000 7fd8e2245640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8dc15c0b0 0x7fd8dc0c7680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:16.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.455+0000 7fd8e2245640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8dc14e670 con 0x7fd8dc15c0b0 2023-06-10T19:06:16.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.455+0000 7fd8e2245640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8dc0c7bc0 con 0x7fd8dc0cc160 2023-06-10T19:06:16.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.455+0000 7fd8e2245640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8dc156a80 con 0x7fd8dc0cbd50 2023-06-10T19:06:16.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.455+0000 7fd8dbfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8dc15c0b0 0x7fd8dc0c7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:16.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.455+0000 7fd8dbfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8dc15c0b0 0x7fd8dc0c7680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42250/0 (socket says 172.21.15.53:42250) 2023-06-10T19:06:16.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.455+0000 7fd8dbfff640 1 -- 172.21.15.53:0/460616868 learned_addr learned my addr 172.21.15.53:0/460616868 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:16.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.455+0000 7fd8daffd640 1 --2- 172.21.15.53:0/460616868 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8dc0cc160 0x7fd8dc14e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:16.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.455+0000 7fd8db7fe640 1 --2- 172.21.15.53:0/460616868 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8dc0cbd50 0x7fd8dc156370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:16.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.455+0000 7fd8dbfff640 1 -- 172.21.15.53:0/460616868 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8dc0cbd50 msgr2=0x7fd8dc156370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:16.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.455+0000 7fd8dbfff640 1 --2- 172.21.15.53:0/460616868 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8dc0cbd50 0x7fd8dc156370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:16.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.455+0000 7fd8dbfff640 1 -- 172.21.15.53:0/460616868 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8dc0cc160 msgr2=0x7fd8dc14e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:16.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.455+0000 7fd8dbfff640 1 --2- 172.21.15.53:0/460616868 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8dc0cc160 0x7fd8dc14e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:16.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.455+0000 7fd8dbfff640 1 -- 172.21.15.53:0/460616868 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8d00094d0 con 0x7fd8dc15c0b0 2023-06-10T19:06:16.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.455+0000 7fd8db7fe640 1 --2- 172.21.15.53:0/460616868 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8dc0cbd50 0x7fd8dc156370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:06:16.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.455+0000 7fd8dbfff640 1 --2- 172.21.15.53:0/460616868 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8dc15c0b0 0x7fd8dc0c7680 secure :-1 s=READY pgs=2134 cs=0 l=1 rev1=1 crypto rx=0x7fd8d400c7c0 tx=0x7fd8d400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:16.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.455+0000 7fd8c3fff640 1 -- 172.21.15.53:0/460616868 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d4003b80 con 0x7fd8dc15c0b0 2023-06-10T19:06:16.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.455+0000 7fd8c3fff640 1 -- 172.21.15.53:0/460616868 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8d4003ce0 con 0x7fd8dc15c0b0 2023-06-10T19:06:16.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.455+0000 7fd8e2245640 1 -- 172.21.15.53:0/460616868 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8dc156d60 con 0x7fd8dc15c0b0 2023-06-10T19:06:16.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.455+0000 7fd8c3fff640 1 -- 172.21.15.53:0/460616868 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d400aa50 con 0x7fd8dc15c0b0 2023-06-10T19:06:16.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.455+0000 7fd8e2245640 1 -- 172.21.15.53:0/460616868 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8dc157320 con 0x7fd8dc15c0b0 2023-06-10T19:06:16.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.459+0000 7fd8e2245640 1 -- 172.21.15.53:0/460616868 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8dc04d790 con 0x7fd8dc15c0b0 2023-06-10T19:06:16.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.459+0000 7fd8c3fff640 1 -- 172.21.15.53:0/460616868 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd8d400abb0 con 0x7fd8dc15c0b0 2023-06-10T19:06:16.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.459+0000 7fd8c3fff640 1 --2- 172.21.15.53:0/460616868 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd8c8066280 0x7fd8c8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:16.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.459+0000 7fd8c3fff640 1 -- 172.21.15.53:0/460616868 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6148+0+0 (secure 0 0 0) 0x7fd8d4083b50 con 0x7fd8dc15c0b0 2023-06-10T19:06:16.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.459+0000 7fd8db7fe640 1 --2- 172.21.15.53:0/460616868 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd8c8066280 0x7fd8c8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:16.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.459+0000 7fd8db7fe640 1 --2- 172.21.15.53:0/460616868 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd8c8066280 0x7fd8c8068730 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc009b10 tx=0x7fd8cc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:16.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.463+0000 7fd8c3fff640 1 -- 172.21.15.53:0/460616868 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd8d4051000 con 0x7fd8dc15c0b0 2023-06-10T19:06:16.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.619+0000 7fd8e2245640 1 -- 172.21.15.53:0/460616868 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd8dc0b3c20 con 0x7fd8dc15c0b0 2023-06-10T19:06:16.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.619+0000 7fd8c3fff640 1 -- 172.21.15.53:0/460616868 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v142) v1 ==== 74+0+18426 (secure 0 0 0) 0x7fd8d400ae60 con 0x7fd8dc15c0b0 2023-06-10T19:06:16.621 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:06:16.621 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":142,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:06:04.229769+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-06-10T19:05:48.449837+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-06-10T19:05:49.783728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.53:6835/1171476971":"2023-06-11T19:06:04.182476+0000","172.21.15.53:6834/1171476971":"2023-06-11T19:06:04.182476+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:06:16.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.623+0000 7fd8e2245640 1 -- 172.21.15.53:0/460616868 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd8c8066280 msgr2=0x7fd8c8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:16.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.623+0000 7fd8e2245640 1 --2- 172.21.15.53:0/460616868 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd8c8066280 0x7fd8c8068730 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc009b10 tx=0x7fd8cc008040 comp rx=0 tx=0).stop 2023-06-10T19:06:16.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.623+0000 7fd8e2245640 1 -- 172.21.15.53:0/460616868 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8dc15c0b0 msgr2=0x7fd8dc0c7680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:16.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.623+0000 7fd8e2245640 1 --2- 172.21.15.53:0/460616868 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8dc15c0b0 0x7fd8dc0c7680 secure :-1 s=READY pgs=2134 cs=0 l=1 rev1=1 crypto rx=0x7fd8d400c7c0 tx=0x7fd8d400cc80 comp rx=0 tx=0).stop 2023-06-10T19:06:16.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.623+0000 7fd8e2245640 1 -- 172.21.15.53:0/460616868 shutdown_connections 2023-06-10T19:06:16.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.623+0000 7fd8e2245640 1 --2- 172.21.15.53:0/460616868 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd8c8066280 0x7fd8c8068730 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:16.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.623+0000 7fd8e2245640 1 --2- 172.21.15.53:0/460616868 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8dc15c0b0 0x7fd8dc0c7680 unknown :-1 s=CLOSED pgs=2134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:16.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.623+0000 7fd8e2245640 1 --2- 172.21.15.53:0/460616868 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8dc0cc160 0x7fd8dc14e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:16.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.623+0000 7fd8e2245640 1 --2- 172.21.15.53:0/460616868 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd8dc0cbd50 0x7fd8dc156370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:16.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.623+0000 7fd8e2245640 1 -- 172.21.15.53:0/460616868 >> 172.21.15.53:0/460616868 conn(0x7fd8dc06a0d0 msgr2=0x7fd8dc06f830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:16.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.623+0000 7fd8e2245640 1 -- 172.21.15.53:0/460616868 shutdown_connections 2023-06-10T19:06:16.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.623+0000 7fd8e2245640 1 -- 172.21.15.53:0/460616868 wait complete. 2023-06-10T19:06:16.641 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-06-10T19:06:16.642 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:06:16.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.767+0000 7faeb26f7640 1 Processor -- start 2023-06-10T19:06:16.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.767+0000 7faeb26f7640 1 -- start start 2023-06-10T19:06:16.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.771+0000 7faeb26f7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faeac071060 0x7faeac0af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:16.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.771+0000 7faeb26f7640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faeac159b50 con 0x7faeac0c9840 2023-06-10T19:06:16.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.771+0000 7faeb26f7640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faeac0702a0 con 0x7faeac0afc60 2023-06-10T19:06:16.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.771+0000 7faeb26f7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeac070580 con 0x7faeac071060 2023-06-10T19:06:16.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.771+0000 7faeabfff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7faeac0c9840 0x7faeac0c9c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60354/0 (socket says 172.21.15.53:60354) 2023-06-10T19:06:16.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.771+0000 7faeabfff640 1 -- 172.21.15.53:0/4087094998 learned_addr learned my addr 172.21.15.53:0/4087094998 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:06:16.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.771+0000 7faeab7fe640 1 --2- 172.21.15.53:0/4087094998 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faeac071060 0x7faeac0af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:16.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.771+0000 7faeaaffd640 1 -- 172.21.15.53:0/4087094998 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2093327898 0 0) 0x7faeac159b50 con 0x7faeac0c9840 2023-06-10T19:06:16.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.771+0000 7faeaaffd640 1 -- 172.21.15.53:0/4087094998 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae98003530 con 0x7faeac0c9840 2023-06-10T19:06:16.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.771+0000 7faeaaffd640 1 -- 172.21.15.53:0/4087094998 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 671516300 0 0) 0x7fae98003530 con 0x7faeac0c9840 2023-06-10T19:06:16.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.771+0000 7faeab7fe640 1 -- 172.21.15.53:0/4087094998 >> v1:172.21.15.117:6789/0 conn(0x7faeac0afc60 legacy=0x7faeac06b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:16.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.771+0000 7faeab7fe640 1 -- 172.21.15.53:0/4087094998 >> v1:172.21.15.53:6789/0 conn(0x7faeac0c9840 legacy=0x7faeac0c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:16.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.771+0000 7faeab7fe640 1 -- 172.21.15.53:0/4087094998 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeac070860 con 0x7faeac071060 2023-06-10T19:06:16.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.771+0000 7faeab7fe640 1 --2- 172.21.15.53:0/4087094998 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faeac071060 0x7faeac0af720 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fae9c009dc0 tx=0x7fae9c01c710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a82f548ed5f61665 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:16.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.771+0000 7faeaaffd640 1 -- 172.21.15.53:0/4087094998 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae94001680 con 0x7faeac071060 2023-06-10T19:06:16.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.771+0000 7faeaaffd640 1 -- 172.21.15.53:0/4087094998 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae9c0a6480 con 0x7faeac071060 2023-06-10T19:06:16.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.771+0000 7faeaaffd640 1 -- 172.21.15.53:0/4087094998 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae9c0a67f0 con 0x7faeac071060 2023-06-10T19:06:16.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.775+0000 7faeb26f7640 1 -- 172.21.15.53:0/4087094998 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faeac071060 msgr2=0x7faeac0af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:16.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.775+0000 7faeb26f7640 1 --2- 172.21.15.53:0/4087094998 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faeac071060 0x7faeac0af720 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fae9c009dc0 tx=0x7fae9c01c710 comp rx=0 tx=0).stop 2023-06-10T19:06:16.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.775+0000 7faeb26f7640 1 -- 172.21.15.53:0/4087094998 shutdown_connections 2023-06-10T19:06:16.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.775+0000 7faeb26f7640 1 --2- 172.21.15.53:0/4087094998 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faeac071060 0x7faeac0af720 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:16.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.775+0000 7faeb26f7640 1 -- 172.21.15.53:0/4087094998 >> 172.21.15.53:0/4087094998 conn(0x7faeac06a0d0 msgr2=0x7faeac0ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:16.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.775+0000 7faeb26f7640 1 -- 172.21.15.53:0/4087094998 shutdown_connections 2023-06-10T19:06:16.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.775+0000 7faeb26f7640 1 -- 172.21.15.53:0/4087094998 wait complete. 2023-06-10T19:06:16.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.775+0000 7faeb26f7640 1 Processor -- start 2023-06-10T19:06:16.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.775+0000 7faeb26f7640 1 -- start start 2023-06-10T19:06:16.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.775+0000 7faeb26f7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faeac071060 0x7faeac147980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:16.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.775+0000 7faeb26f7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faeac0afc60 0x7faeac0c2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:16.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.775+0000 7faeb26f7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faeac0c9840 0x7faeac147130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:16.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.775+0000 7faeb26f7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeac151e70 con 0x7faeac0c9840 2023-06-10T19:06:16.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.775+0000 7faeb26f7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeac152150 con 0x7faeac071060 2023-06-10T19:06:16.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.775+0000 7faeb26f7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeac152430 con 0x7faeac0afc60 2023-06-10T19:06:16.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.775+0000 7faeb0c94640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faeac0c9840 0x7faeac147130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:16.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.775+0000 7faeb0c94640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faeac0c9840 0x7faeac147130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42266/0 (socket says 172.21.15.53:42266) 2023-06-10T19:06:16.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.775+0000 7faeb0c94640 1 -- 172.21.15.53:0/1012364286 learned_addr learned my addr 172.21.15.53:0/1012364286 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:16.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.775+0000 7faeab7fe640 1 --2- 172.21.15.53:0/1012364286 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faeac0afc60 0x7faeac0c2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:16.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.775+0000 7faeabfff640 1 --2- 172.21.15.53:0/1012364286 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faeac071060 0x7faeac147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:16.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.775+0000 7faeb0c94640 1 -- 172.21.15.53:0/1012364286 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faeac0afc60 msgr2=0x7faeac0c2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:16.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.775+0000 7faeb0c94640 1 --2- 172.21.15.53:0/1012364286 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faeac0afc60 0x7faeac0c2680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:16.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.775+0000 7faeb0c94640 1 -- 172.21.15.53:0/1012364286 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faeac071060 msgr2=0x7faeac147980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:16.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.775+0000 7faeb0c94640 1 --2- 172.21.15.53:0/1012364286 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faeac071060 0x7faeac147980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:16.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.775+0000 7faeb0c94640 1 -- 172.21.15.53:0/1012364286 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae9c009a70 con 0x7faeac0c9840 2023-06-10T19:06:16.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.775+0000 7faeb0c94640 1 --2- 172.21.15.53:0/1012364286 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faeac0c9840 0x7faeac147130 secure :-1 s=READY pgs=2136 cs=0 l=1 rev1=1 crypto rx=0x7faea400c520 tx=0x7faea400c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:16.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.775+0000 7faea8ff9640 1 -- 172.21.15.53:0/1012364286 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea4005480 con 0x7faeac0c9840 2023-06-10T19:06:16.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.775+0000 7faea8ff9640 1 -- 172.21.15.53:0/1012364286 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faea4003600 con 0x7faeac0c9840 2023-06-10T19:06:16.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.775+0000 7faeb26f7640 1 -- 172.21.15.53:0/1012364286 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faeac152710 con 0x7faeac0c9840 2023-06-10T19:06:16.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.775+0000 7faea8ff9640 1 -- 172.21.15.53:0/1012364286 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea40039b0 con 0x7faeac0c9840 2023-06-10T19:06:16.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.775+0000 7faeb26f7640 1 -- 172.21.15.53:0/1012364286 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeac0c2eb0 con 0x7faeac0c9840 2023-06-10T19:06:16.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.779+0000 7faeb26f7640 1 -- 172.21.15.53:0/1012364286 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faeac152950 con 0x7faeac0c9840 2023-06-10T19:06:16.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.779+0000 7faea8ff9640 1 -- 172.21.15.53:0/1012364286 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7faea4003b10 con 0x7faeac0c9840 2023-06-10T19:06:16.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.779+0000 7faea8ff9640 1 --2- 172.21.15.53:0/1012364286 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fae8c0662b0 0x7fae8c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:16.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.779+0000 7faea8ff9640 1 -- 172.21.15.53:0/1012364286 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6148+0+0 (secure 0 0 0) 0x7faea4083290 con 0x7faeac0c9840 2023-06-10T19:06:16.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.779+0000 7faeabfff640 1 --2- 172.21.15.53:0/1012364286 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fae8c0662b0 0x7fae8c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:16.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.779+0000 7faeabfff640 1 --2- 172.21.15.53:0/1012364286 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fae8c0662b0 0x7fae8c068760 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fae940011f0 tx=0x7fae94001720 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:16.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.783+0000 7faea8ff9640 1 -- 172.21.15.53:0/1012364286 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7faeac152950 con 0x7faeac0c9840 2023-06-10T19:06:16.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.967+0000 7faeb26f7640 1 -- 172.21.15.53:0/1012364286 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faeac151fb0 con 0x7faeac0c9840 2023-06-10T19:06:16.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.967+0000 7faea8ff9640 1 -- 172.21.15.53:0/1012364286 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) v1 ==== 94+0+4678 (secure 0 0 0) 0x7faeac151fb0 con 0x7faeac0c9840 2023-06-10T19:06:16.970 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:06:16.970 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":81,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8125,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3512570304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3512570304},{"type":"v1","addr":"172.21.15.117:6835","nonce":3512570304}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78},{"gid":8128,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/325110995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":325110995},{"type":"v1","addr":"172.21.15.117:6837","nonce":325110995}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78},{"gid":9759,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/2776844045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2776844045},{"type":"v1","addr":"172.21.15.53:6833","nonce":2776844045}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:05:50.789763+0000","modified":"2023-06-10T19:06:09.123261+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":139,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9780},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9780":{"gid":9780,"name":"c","rank":0,"incarnation":78,"state":"up:active","state_seq":4,"addr":"172.21.15.53:6835/2721536857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2721536857},{"type":"v1","addr":"172.21.15.53:6835","nonce":2721536857}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-06-10T19:06:16.970 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 81 2023-06-10T19:06:16.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.971+0000 7faeb26f7640 1 -- 172.21.15.53:0/1012364286 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fae8c0662b0 msgr2=0x7fae8c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:16.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.971+0000 7faeb26f7640 1 --2- 172.21.15.53:0/1012364286 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fae8c0662b0 0x7fae8c068760 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fae940011f0 tx=0x7fae94001720 comp rx=0 tx=0).stop 2023-06-10T19:06:16.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.971+0000 7faeb26f7640 1 -- 172.21.15.53:0/1012364286 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faeac0c9840 msgr2=0x7faeac147130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:16.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.971+0000 7faeb26f7640 1 --2- 172.21.15.53:0/1012364286 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faeac0c9840 0x7faeac147130 secure :-1 s=READY pgs=2136 cs=0 l=1 rev1=1 crypto rx=0x7faea400c520 tx=0x7faea400c9e0 comp rx=0 tx=0).stop 2023-06-10T19:06:16.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.971+0000 7faeb26f7640 1 -- 172.21.15.53:0/1012364286 shutdown_connections 2023-06-10T19:06:16.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.971+0000 7faeb26f7640 1 --2- 172.21.15.53:0/1012364286 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fae8c0662b0 0x7fae8c068760 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:16.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.971+0000 7faeb26f7640 1 --2- 172.21.15.53:0/1012364286 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faeac0c9840 0x7faeac147130 unknown :-1 s=CLOSED pgs=2136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:16.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.971+0000 7faeb26f7640 1 --2- 172.21.15.53:0/1012364286 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faeac0afc60 0x7faeac0c2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:16.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.971+0000 7faeb26f7640 1 --2- 172.21.15.53:0/1012364286 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faeac071060 0x7faeac147980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:16.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.971+0000 7faeb26f7640 1 -- 172.21.15.53:0/1012364286 >> 172.21.15.53:0/1012364286 conn(0x7faeac06a0d0 msgr2=0x7faeac0c9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:16.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.971+0000 7faeb26f7640 1 -- 172.21.15.53:0/1012364286 shutdown_connections 2023-06-10T19:06:16.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:16.971+0000 7faeb26f7640 1 -- 172.21.15.53:0/1012364286 wait complete. 2023-06-10T19:06:16.987 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:06:17.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.111+0000 7f2e176ea640 1 Processor -- start 2023-06-10T19:06:17.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.111+0000 7f2e176ea640 1 -- start start 2023-06-10T19:06:17.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.111+0000 7f2e176ea640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2e10159450 0x7f2e1015d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:17.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.111+0000 7f2e176ea640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2e1015d680 0x7f2e100cec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:17.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.111+0000 7f2e176ea640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e100cf180 0x7f2e100cda20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:17.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.111+0000 7f2e176ea640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e100cf600 con 0x7f2e1015d680 2023-06-10T19:06:17.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.111+0000 7f2e176ea640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e100cbac0 con 0x7f2e10159450 2023-06-10T19:06:17.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.111+0000 7f2e176ea640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1015dc00 con 0x7f2e100cf180 2023-06-10T19:06:17.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.111+0000 7f2e14c85640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2e1015d680 0x7f2e100cec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:17.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.111+0000 7f2e14c85640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2e1015d680 0x7f2e100cec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42282/0 (socket says 172.21.15.53:42282) 2023-06-10T19:06:17.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.111+0000 7f2e14c85640 1 -- 172.21.15.53:0/3257395061 learned_addr learned my addr 172.21.15.53:0/3257395061 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:17.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.111+0000 7f2e15486640 1 --2- 172.21.15.53:0/3257395061 >> v2:172.21.15.117:3300/0 conn(0x7f2e10159450 0x7f2e1015d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:17.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.111+0000 7f2e15c87640 1 --2- 172.21.15.53:0/3257395061 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e100cf180 0x7f2e100cda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:17.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.111+0000 7f2e14c85640 1 -- 172.21.15.53:0/3257395061 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e100cf180 msgr2=0x7f2e100cda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:17.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.111+0000 7f2e14c85640 1 --2- 172.21.15.53:0/3257395061 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e100cf180 0x7f2e100cda20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:17.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.111+0000 7f2e14c85640 1 -- 172.21.15.53:0/3257395061 >> v2:172.21.15.117:3300/0 conn(0x7f2e10159450 msgr2=0x7f2e1015d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:17.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.111+0000 7f2e14c85640 1 --2- 172.21.15.53:0/3257395061 >> v2:172.21.15.117:3300/0 conn(0x7f2e10159450 0x7f2e1015d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:17.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.111+0000 7f2e14c85640 1 -- 172.21.15.53:0/3257395061 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e1015dee0 con 0x7f2e1015d680 2023-06-10T19:06:17.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.115+0000 7f2e14c85640 1 --2- 172.21.15.53:0/3257395061 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e1015d680 0x7f2e100cec40 secure :-1 s=READY pgs=2137 cs=0 l=1 rev1=1 crypto rx=0x7f2e100b29a0 tx=0x7f2e0001c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b81b05fb0c034bf server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:17.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.115+0000 7f2e07fff640 1 -- 172.21.15.53:0/3257395061 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e000ab600 con 0x7f2e1015d680 2023-06-10T19:06:17.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.115+0000 7f2e07fff640 1 -- 172.21.15.53:0/3257395061 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e000a7050 con 0x7f2e1015d680 2023-06-10T19:06:17.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.115+0000 7f2e07fff640 1 -- 172.21.15.53:0/3257395061 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e000ab980 con 0x7f2e1015d680 2023-06-10T19:06:17.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.115+0000 7f2e176ea640 1 -- 172.21.15.53:0/3257395061 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e1015d680 msgr2=0x7f2e100cec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:17.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.115+0000 7f2e176ea640 1 --2- 172.21.15.53:0/3257395061 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e1015d680 0x7f2e100cec40 secure :-1 s=READY pgs=2137 cs=0 l=1 rev1=1 crypto rx=0x7f2e100b29a0 tx=0x7f2e0001c210 comp rx=0 tx=0).stop 2023-06-10T19:06:17.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.115+0000 7f2e176ea640 1 -- 172.21.15.53:0/3257395061 shutdown_connections 2023-06-10T19:06:17.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.115+0000 7f2e176ea640 1 --2- 172.21.15.53:0/3257395061 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e100cf180 0x7f2e100cda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:17.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.115+0000 7f2e176ea640 1 --2- 172.21.15.53:0/3257395061 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e1015d680 0x7f2e100cec40 unknown :-1 s=CLOSED pgs=2137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:17.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.115+0000 7f2e176ea640 1 --2- 172.21.15.53:0/3257395061 >> v2:172.21.15.117:3300/0 conn(0x7f2e10159450 0x7f2e1015d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:17.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.115+0000 7f2e176ea640 1 -- 172.21.15.53:0/3257395061 >> 172.21.15.53:0/3257395061 conn(0x7f2e1006a090 msgr2=0x7f2e1006d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:17.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.115+0000 7f2e176ea640 1 -- 172.21.15.53:0/3257395061 shutdown_connections 2023-06-10T19:06:17.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.115+0000 7f2e176ea640 1 -- 172.21.15.53:0/3257395061 wait complete. 2023-06-10T19:06:17.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.115+0000 7f2e176ea640 1 Processor -- start 2023-06-10T19:06:17.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.115+0000 7f2e176ea640 1 -- start start 2023-06-10T19:06:17.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.115+0000 7f2e176ea640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e100cf180 0x7f2e1006c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:17.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.115+0000 7f2e176ea640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e10159450 0x7f2e10150570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:17.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.115+0000 7f2e176ea640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e1015d680 0x7f2e10156d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:17.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.115+0000 7f2e176ea640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e10151630 con 0x7f2e1015d680 2023-06-10T19:06:17.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.115+0000 7f2e176ea640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e101569c0 con 0x7f2e10159450 2023-06-10T19:06:17.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.115+0000 7f2e176ea640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e10156400 con 0x7f2e100cf180 2023-06-10T19:06:17.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.115+0000 7f2e15c87640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e1015d680 0x7f2e10156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:17.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.115+0000 7f2e15c87640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e1015d680 0x7f2e10156d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42298/0 (socket says 172.21.15.53:42298) 2023-06-10T19:06:17.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.115+0000 7f2e15c87640 1 -- 172.21.15.53:0/3352208283 learned_addr learned my addr 172.21.15.53:0/3352208283 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:17.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.115+0000 7f2e14c85640 1 --2- 172.21.15.53:0/3352208283 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e10159450 0x7f2e10150570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:17.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.115+0000 7f2e15486640 1 --2- 172.21.15.53:0/3352208283 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e100cf180 0x7f2e1006c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:17.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.115+0000 7f2e15c87640 1 -- 172.21.15.53:0/3352208283 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e100cf180 msgr2=0x7f2e1006c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:17.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.115+0000 7f2e15c87640 1 --2- 172.21.15.53:0/3352208283 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e100cf180 0x7f2e1006c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:17.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.115+0000 7f2e15c87640 1 -- 172.21.15.53:0/3352208283 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e10159450 msgr2=0x7f2e10150570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:17.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.115+0000 7f2e15c87640 1 --2- 172.21.15.53:0/3352208283 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e10159450 0x7f2e10150570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:17.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.115+0000 7f2e15c87640 1 -- 172.21.15.53:0/3352208283 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e000094d0 con 0x7f2e1015d680 2023-06-10T19:06:17.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.119+0000 7f2e15c87640 1 --2- 172.21.15.53:0/3352208283 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e1015d680 0x7f2e10156d80 secure :-1 s=READY pgs=2138 cs=0 l=1 rev1=1 crypto rx=0x7f2e0800d560 tx=0x7f2e0800da20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:17.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.119+0000 7f2e05ffb640 1 -- 172.21.15.53:0/3352208283 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e080125f0 con 0x7f2e1015d680 2023-06-10T19:06:17.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.119+0000 7f2e05ffb640 1 -- 172.21.15.53:0/3352208283 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e08012770 con 0x7f2e1015d680 2023-06-10T19:06:17.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.119+0000 7f2e176ea640 1 -- 172.21.15.53:0/3352208283 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e101566e0 con 0x7f2e1015d680 2023-06-10T19:06:17.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.119+0000 7f2e05ffb640 1 -- 172.21.15.53:0/3352208283 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e08012b20 con 0x7f2e1015d680 2023-06-10T19:06:17.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.119+0000 7f2e176ea640 1 -- 172.21.15.53:0/3352208283 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e101633f0 con 0x7f2e1015d680 2023-06-10T19:06:17.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.119+0000 7f2e176ea640 1 -- 172.21.15.53:0/3352208283 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e101635e0 con 0x7f2e1015d680 2023-06-10T19:06:17.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.119+0000 7f2e05ffb640 1 -- 172.21.15.53:0/3352208283 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2e08012c80 con 0x7f2e1015d680 2023-06-10T19:06:17.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.119+0000 7f2e05ffb640 1 --2- 172.21.15.53:0/3352208283 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2df4066280 0x7f2df4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:17.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.119+0000 7f2e05ffb640 1 -- 172.21.15.53:0/3352208283 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f2e08084280 con 0x7f2e1015d680 2023-06-10T19:06:17.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.119+0000 7f2e15486640 1 --2- 172.21.15.53:0/3352208283 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2df4066280 0x7f2df4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:17.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.119+0000 7f2e15486640 1 --2- 172.21.15.53:0/3352208283 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2df4066280 0x7f2df4068730 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c009e10 tx=0x7f2e0c00b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:17.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.123+0000 7f2e05ffb640 1 -- 172.21.15.53:0/3352208283 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2e080516a0 con 0x7f2e1015d680 2023-06-10T19:06:17.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.315+0000 7f2e176ea640 1 -- 172.21.15.53:0/3352208283 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2e1004d790 con 0x7f2e1015d680 2023-06-10T19:06:17.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.315+0000 7f2e05ffb640 1 -- 172.21.15.53:0/3352208283 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) v1 ==== 94+0+4678 (secure 0 0 0) 0x7f2e08054cc0 con 0x7f2e1015d680 2023-06-10T19:06:17.317 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:06:17.317 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":81,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8125,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3512570304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3512570304},{"type":"v1","addr":"172.21.15.117:6835","nonce":3512570304}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78},{"gid":8128,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/325110995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":325110995},{"type":"v1","addr":"172.21.15.117:6837","nonce":325110995}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78},{"gid":9759,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/2776844045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2776844045},{"type":"v1","addr":"172.21.15.53:6833","nonce":2776844045}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:05:50.789763+0000","modified":"2023-06-10T19:06:09.123261+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":139,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9780},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9780":{"gid":9780,"name":"c","rank":0,"incarnation":78,"state":"up:active","state_seq":4,"addr":"172.21.15.53:6835/2721536857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2721536857},{"type":"v1","addr":"172.21.15.53:6835","nonce":2721536857}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-06-10T19:06:17.318 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 81 2023-06-10T19:06:17.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.319+0000 7f2e176ea640 1 -- 172.21.15.53:0/3352208283 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2df4066280 msgr2=0x7f2df4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:17.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.319+0000 7f2e176ea640 1 --2- 172.21.15.53:0/3352208283 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2df4066280 0x7f2df4068730 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c009e10 tx=0x7f2e0c00b040 comp rx=0 tx=0).stop 2023-06-10T19:06:17.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.319+0000 7f2e176ea640 1 -- 172.21.15.53:0/3352208283 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e1015d680 msgr2=0x7f2e10156d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:17.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.319+0000 7f2e176ea640 1 --2- 172.21.15.53:0/3352208283 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e1015d680 0x7f2e10156d80 secure :-1 s=READY pgs=2138 cs=0 l=1 rev1=1 crypto rx=0x7f2e0800d560 tx=0x7f2e0800da20 comp rx=0 tx=0).stop 2023-06-10T19:06:17.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.319+0000 7f2e176ea640 1 -- 172.21.15.53:0/3352208283 shutdown_connections 2023-06-10T19:06:17.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.319+0000 7f2e176ea640 1 --2- 172.21.15.53:0/3352208283 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2df4066280 0x7f2df4068730 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:17.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.319+0000 7f2e176ea640 1 --2- 172.21.15.53:0/3352208283 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e1015d680 0x7f2e10156d80 unknown :-1 s=CLOSED pgs=2138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:17.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.319+0000 7f2e176ea640 1 --2- 172.21.15.53:0/3352208283 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e10159450 0x7f2e10150570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:17.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.319+0000 7f2e176ea640 1 --2- 172.21.15.53:0/3352208283 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e100cf180 0x7f2e1006c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:17.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.319+0000 7f2e176ea640 1 -- 172.21.15.53:0/3352208283 >> 172.21.15.53:0/3352208283 conn(0x7f2e1006a090 msgr2=0x7f2e10151d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:17.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.319+0000 7f2e176ea640 1 -- 172.21.15.53:0/3352208283 shutdown_connections 2023-06-10T19:06:17.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.319+0000 7f2e176ea640 1 -- 172.21.15.53:0/3352208283 wait complete. 2023-06-10T19:06:17.337 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:06:17.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.451+0000 7f47496d7640 1 Processor -- start 2023-06-10T19:06:17.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.451+0000 7f47496d7640 1 -- start start 2023-06-10T19:06:17.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.455+0000 7f47496d7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4744071060 0x7f47440af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:17.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.455+0000 7f47496d7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f47440afc60 0x7f474406b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:17.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.455+0000 7f47496d7640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4744159b50 con 0x7f47440c9840 2023-06-10T19:06:17.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.455+0000 7f47496d7640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47440702a0 con 0x7f47440afc60 2023-06-10T19:06:17.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.455+0000 7f47496d7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4744070580 con 0x7f4744071060 2023-06-10T19:06:17.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.455+0000 7f4742ffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f47440c9840 0x7f47440c9c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60358/0 (socket says 172.21.15.53:60358) 2023-06-10T19:06:17.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.455+0000 7f4742ffd640 1 -- 172.21.15.53:0/2818195209 learned_addr learned my addr 172.21.15.53:0/2818195209 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:06:17.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.455+0000 7f47437fe640 1 --2- 172.21.15.53:0/2818195209 >> v2:172.21.15.53:3300/0 conn(0x7f47440afc60 0x7f474406b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:17.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.455+0000 7f473bfff640 1 --2- 172.21.15.53:0/2818195209 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4744071060 0x7f47440af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:17.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.455+0000 7f47427fc640 1 -- 172.21.15.53:0/2818195209 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1009789416 0 0) 0x7f4744159b50 con 0x7f47440c9840 2023-06-10T19:06:17.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.455+0000 7f47427fc640 1 -- 172.21.15.53:0/2818195209 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4730003530 con 0x7f47440c9840 2023-06-10T19:06:17.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.455+0000 7f47437fe640 1 -- 172.21.15.53:0/2818195209 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4744071060 msgr2=0x7f47440af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:17.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.455+0000 7f47437fe640 1 --2- 172.21.15.53:0/2818195209 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4744071060 0x7f47440af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:17.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.455+0000 7f47437fe640 1 -- 172.21.15.53:0/2818195209 >> v1:172.21.15.53:6789/0 conn(0x7f47440c9840 legacy=0x7f47440c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:17.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.455+0000 7f47437fe640 1 -- 172.21.15.53:0/2818195209 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4744070860 con 0x7f47440afc60 2023-06-10T19:06:17.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.455+0000 7f47437fe640 1 --2- 172.21.15.53:0/2818195209 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47440afc60 0x7f474406b090 secure :-1 s=READY pgs=2140 cs=0 l=1 rev1=1 crypto rx=0x7f473c009d90 tx=0x7f473c01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a667c097b18dea2c server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:17.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.455+0000 7f47427fc640 1 -- 172.21.15.53:0/2818195209 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f473c0a5a00 con 0x7f47440afc60 2023-06-10T19:06:17.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.459+0000 7f47427fc640 1 -- 172.21.15.53:0/2818195209 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f473c0a5b60 con 0x7f47440afc60 2023-06-10T19:06:17.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.459+0000 7f47427fc640 1 -- 172.21.15.53:0/2818195209 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f473c0ad440 con 0x7f47440afc60 2023-06-10T19:06:17.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.459+0000 7f47496d7640 1 -- 172.21.15.53:0/2818195209 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47440afc60 msgr2=0x7f474406b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:17.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.459+0000 7f47496d7640 1 --2- 172.21.15.53:0/2818195209 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47440afc60 0x7f474406b090 secure :-1 s=READY pgs=2140 cs=0 l=1 rev1=1 crypto rx=0x7f473c009d90 tx=0x7f473c01c920 comp rx=0 tx=0).stop 2023-06-10T19:06:17.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.459+0000 7f47496d7640 1 -- 172.21.15.53:0/2818195209 shutdown_connections 2023-06-10T19:06:17.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.459+0000 7f47496d7640 1 --2- 172.21.15.53:0/2818195209 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47440afc60 0x7f474406b090 unknown :-1 s=CLOSED pgs=2140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:17.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.459+0000 7f47496d7640 1 --2- 172.21.15.53:0/2818195209 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4744071060 0x7f47440af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:17.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.459+0000 7f47496d7640 1 -- 172.21.15.53:0/2818195209 >> 172.21.15.53:0/2818195209 conn(0x7f474406a0d0 msgr2=0x7f47440ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:17.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.459+0000 7f47496d7640 1 -- 172.21.15.53:0/2818195209 shutdown_connections 2023-06-10T19:06:17.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.459+0000 7f47496d7640 1 -- 172.21.15.53:0/2818195209 wait complete. 2023-06-10T19:06:17.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.459+0000 7f47496d7640 1 Processor -- start 2023-06-10T19:06:17.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.459+0000 7f47496d7640 1 -- start start 2023-06-10T19:06:17.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.459+0000 7f47496d7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4744071060 0x7f47440cb870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:17.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.459+0000 7f47496d7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47440afc60 0x7f474414c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:17.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.459+0000 7f47496d7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47440c9840 0x7f47440b0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:17.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.459+0000 7f47496d7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f474414ca00 con 0x7f47440c9840 2023-06-10T19:06:17.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.459+0000 7f47496d7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47440cbee0 con 0x7f4744071060 2023-06-10T19:06:17.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.459+0000 7f47496d7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47440cc1c0 con 0x7f47440afc60 2023-06-10T19:06:17.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.459+0000 7f47437fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47440c9840 0x7f47440b0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:17.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.459+0000 7f47437fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47440c9840 0x7f47440b0ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42316/0 (socket says 172.21.15.53:42316) 2023-06-10T19:06:17.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.459+0000 7f47437fe640 1 -- 172.21.15.53:0/1225921488 learned_addr learned my addr 172.21.15.53:0/1225921488 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:17.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.459+0000 7f47437fe640 1 -- 172.21.15.53:0/1225921488 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47440afc60 msgr2=0x7f474414c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:17.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.459+0000 7f47437fe640 1 --2- 172.21.15.53:0/1225921488 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47440afc60 0x7f474414c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:17.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.459+0000 7f47437fe640 1 -- 172.21.15.53:0/1225921488 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4744071060 msgr2=0x7f47440cb870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:17.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.459+0000 7f47437fe640 1 --2- 172.21.15.53:0/1225921488 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4744071060 0x7f47440cb870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:17.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.459+0000 7f47437fe640 1 -- 172.21.15.53:0/1225921488 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f473c009a70 con 0x7f47440c9840 2023-06-10T19:06:17.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.459+0000 7f47437fe640 1 --2- 172.21.15.53:0/1225921488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47440c9840 0x7f47440b0ad0 secure :-1 s=READY pgs=2141 cs=0 l=1 rev1=1 crypto rx=0x7f473c01a550 tx=0x7f473c0196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:17.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.459+0000 7f473b7fe640 1 -- 172.21.15.53:0/1225921488 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f473c0bd070 con 0x7f47440c9840 2023-06-10T19:06:17.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.459+0000 7f473b7fe640 1 -- 172.21.15.53:0/1225921488 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f473c004040 con 0x7f47440c9840 2023-06-10T19:06:17.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.459+0000 7f47496d7640 1 -- 172.21.15.53:0/1225921488 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47440cc4a0 con 0x7f47440c9840 2023-06-10T19:06:17.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.459+0000 7f473b7fe640 1 -- 172.21.15.53:0/1225921488 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f473c004430 con 0x7f47440c9840 2023-06-10T19:06:17.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.459+0000 7f47496d7640 1 -- 172.21.15.53:0/1225921488 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47440cca60 con 0x7f47440c9840 2023-06-10T19:06:17.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.463+0000 7f47496d7640 1 -- 172.21.15.53:0/1225921488 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47440ccc50 con 0x7f47440c9840 2023-06-10T19:06:17.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.463+0000 7f473b7fe640 1 -- 172.21.15.53:0/1225921488 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f473c0b4030 con 0x7f47440c9840 2023-06-10T19:06:17.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.463+0000 7f473b7fe640 1 --2- 172.21.15.53:0/1225921488 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4724066280 0x7f4724068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:17.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.463+0000 7f473b7fe640 1 -- 172.21.15.53:0/1225921488 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f473c11f260 con 0x7f47440c9840 2023-06-10T19:06:17.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.463+0000 7f4742ffd640 1 --2- 172.21.15.53:0/1225921488 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4724066280 0x7f4724068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:17.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.463+0000 7f4742ffd640 1 --2- 172.21.15.53:0/1225921488 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4724066280 0x7f4724068730 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f4734007fd0 tx=0x7f4734007900 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:17.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.467+0000 7f473b7fe640 1 -- 172.21.15.53:0/1225921488 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f473c0ec760 con 0x7f47440c9840 2023-06-10T19:06:17.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.615+0000 7f47496d7640 1 -- 172.21.15.53:0/1225921488 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f474404d790 con 0x7f47440c9840 2023-06-10T19:06:17.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.619+0000 7f473b7fe640 1 -- 172.21.15.53:0/1225921488 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v142) v1 ==== 74+0+18426 (secure 0 0 0) 0x7f473c0efd80 con 0x7f47440c9840 2023-06-10T19:06:17.619 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:06:17.619 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":142,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:06:04.229769+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-06-10T19:05:48.449837+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-06-10T19:05:49.783728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.53:6835/1171476971":"2023-06-11T19:06:04.182476+0000","172.21.15.53:6834/1171476971":"2023-06-11T19:06:04.182476+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:06:17.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.619+0000 7f47496d7640 1 -- 172.21.15.53:0/1225921488 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4724066280 msgr2=0x7f4724068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:17.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.619+0000 7f47496d7640 1 --2- 172.21.15.53:0/1225921488 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4724066280 0x7f4724068730 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f4734007fd0 tx=0x7f4734007900 comp rx=0 tx=0).stop 2023-06-10T19:06:17.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.619+0000 7f47496d7640 1 -- 172.21.15.53:0/1225921488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47440c9840 msgr2=0x7f47440b0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:17.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.619+0000 7f47496d7640 1 --2- 172.21.15.53:0/1225921488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47440c9840 0x7f47440b0ad0 secure :-1 s=READY pgs=2141 cs=0 l=1 rev1=1 crypto rx=0x7f473c01a550 tx=0x7f473c0196c0 comp rx=0 tx=0).stop 2023-06-10T19:06:17.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.619+0000 7f47496d7640 1 -- 172.21.15.53:0/1225921488 shutdown_connections 2023-06-10T19:06:17.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.619+0000 7f47496d7640 1 --2- 172.21.15.53:0/1225921488 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4724066280 0x7f4724068730 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:17.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.619+0000 7f47496d7640 1 --2- 172.21.15.53:0/1225921488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47440c9840 0x7f47440b0ad0 unknown :-1 s=CLOSED pgs=2141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:17.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.619+0000 7f47496d7640 1 --2- 172.21.15.53:0/1225921488 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47440afc60 0x7f474414c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:17.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.619+0000 7f47496d7640 1 --2- 172.21.15.53:0/1225921488 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4744071060 0x7f47440cb870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:17.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.619+0000 7f47496d7640 1 -- 172.21.15.53:0/1225921488 >> 172.21.15.53:0/1225921488 conn(0x7f474406a0d0 msgr2=0x7f47440af530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:17.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.619+0000 7f47496d7640 1 -- 172.21.15.53:0/1225921488 shutdown_connections 2023-06-10T19:06:17.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.619+0000 7f47496d7640 1 -- 172.21.15.53:0/1225921488 wait complete. 2023-06-10T19:06:17.637 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-06-10T19:06:17.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.759+0000 7f3d867d5640 1 Processor -- start 2023-06-10T19:06:17.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.759+0000 7f3d867d5640 1 -- start start 2023-06-10T19:06:17.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.759+0000 7f3d867d5640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3d80159690 0x7f3d80070950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:17.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.759+0000 7f3d867d5640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3d80159a60 0x7f3d800c2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:17.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.759+0000 7f3d867d5640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d800cb080 con 0x7f3d800b0f30 2023-06-10T19:06:17.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.759+0000 7f3d867d5640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d80070e90 con 0x7f3d80159a60 2023-06-10T19:06:17.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.759+0000 7f3d867d5640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d8006d450 con 0x7f3d80159690 2023-06-10T19:06:17.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.759+0000 7f3d84d72640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3d80159a60 0x7f3d800c2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:17.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.759+0000 7f3d7f7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f3d800b0f30 0x7f3d800cbe00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60368/0 (socket says 172.21.15.53:60368) 2023-06-10T19:06:17.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.759+0000 7f3d7f7fe640 1 -- 172.21.15.53:0/2085597621 learned_addr learned my addr 172.21.15.53:0/2085597621 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:06:17.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.763+0000 7f3d7ffff640 1 --2- 172.21.15.53:0/2085597621 >> v2:172.21.15.117:3300/0 conn(0x7f3d80159690 0x7f3d80070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:17.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.763+0000 7f3d84d72640 1 -- 172.21.15.53:0/2085597621 >> v2:172.21.15.117:3300/0 conn(0x7f3d80159690 msgr2=0x7f3d80070950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:17.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.763+0000 7f3d84d72640 1 --2- 172.21.15.53:0/2085597621 >> v2:172.21.15.117:3300/0 conn(0x7f3d80159690 0x7f3d80070950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:17.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.763+0000 7f3d84d72640 1 -- 172.21.15.53:0/2085597621 >> v1:172.21.15.53:6789/0 conn(0x7f3d800b0f30 legacy=0x7f3d800cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:17.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.763+0000 7f3d84d72640 1 -- 172.21.15.53:0/2085597621 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d800cb320 con 0x7f3d80159a60 2023-06-10T19:06:17.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.763+0000 7f3d84d72640 1 --2- 172.21.15.53:0/2085597621 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d80159a60 0x7f3d800c2900 secure :-1 s=READY pgs=2143 cs=0 l=1 rev1=1 crypto rx=0x7f3d80071570 tx=0x7f3d7801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b7550d7b849ad52 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:17.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.763+0000 7f3d7effd640 1 -- 172.21.15.53:0/2085597621 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d780ab600 con 0x7f3d80159a60 2023-06-10T19:06:17.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.763+0000 7f3d7effd640 1 -- 172.21.15.53:0/2085597621 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d780a7050 con 0x7f3d80159a60 2023-06-10T19:06:17.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.763+0000 7f3d7effd640 1 -- 172.21.15.53:0/2085597621 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d780ab980 con 0x7f3d80159a60 2023-06-10T19:06:17.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.763+0000 7f3d867d5640 1 -- 172.21.15.53:0/2085597621 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d80159a60 msgr2=0x7f3d800c2900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:17.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.763+0000 7f3d867d5640 1 --2- 172.21.15.53:0/2085597621 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d80159a60 0x7f3d800c2900 secure :-1 s=READY pgs=2143 cs=0 l=1 rev1=1 crypto rx=0x7f3d80071570 tx=0x7f3d7801c430 comp rx=0 tx=0).stop 2023-06-10T19:06:17.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.763+0000 7f3d867d5640 1 -- 172.21.15.53:0/2085597621 shutdown_connections 2023-06-10T19:06:17.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.763+0000 7f3d867d5640 1 --2- 172.21.15.53:0/2085597621 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d80159a60 0x7f3d800c2900 unknown :-1 s=CLOSED pgs=2143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:17.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.763+0000 7f3d867d5640 1 --2- 172.21.15.53:0/2085597621 >> v2:172.21.15.117:3300/0 conn(0x7f3d80159690 0x7f3d80070950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:17.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.763+0000 7f3d867d5640 1 -- 172.21.15.53:0/2085597621 >> 172.21.15.53:0/2085597621 conn(0x7f3d8006a560 msgr2=0x7f3d8006a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:17.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.763+0000 7f3d867d5640 1 -- 172.21.15.53:0/2085597621 shutdown_connections 2023-06-10T19:06:17.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.763+0000 7f3d867d5640 1 -- 172.21.15.53:0/2085597621 wait complete. 2023-06-10T19:06:17.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.767+0000 7f3d867d5640 1 Processor -- start 2023-06-10T19:06:17.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.767+0000 7f3d867d5640 1 -- start start 2023-06-10T19:06:17.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.767+0000 7f3d867d5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d800b0f30 0x7f3d8015cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:17.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.767+0000 7f3d867d5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d80159690 0x7f3d8015a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:17.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.767+0000 7f3d867d5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d80159a60 0x7f3d8014b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:17.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.767+0000 7f3d867d5640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8015a630 con 0x7f3d800b0f30 2023-06-10T19:06:17.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.767+0000 7f3d867d5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8014b840 con 0x7f3d80159a60 2023-06-10T19:06:17.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.767+0000 7f3d867d5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d800b28e0 con 0x7f3d80159690 2023-06-10T19:06:17.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.767+0000 7f3d7ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d800b0f30 0x7f3d8015cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:17.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.767+0000 7f3d7ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d800b0f30 0x7f3d8015cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42334/0 (socket says 172.21.15.53:42334) 2023-06-10T19:06:17.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.767+0000 7f3d7ffff640 1 -- 172.21.15.53:0/2401066751 learned_addr learned my addr 172.21.15.53:0/2401066751 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:17.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.767+0000 7f3d84d72640 1 --2- 172.21.15.53:0/2401066751 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d80159a60 0x7f3d8014b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:17.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.767+0000 7f3d7ffff640 1 -- 172.21.15.53:0/2401066751 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d80159690 msgr2=0x7f3d8015a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:17.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.767+0000 7f3d7f7fe640 1 --2- 172.21.15.53:0/2401066751 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d80159690 0x7f3d8015a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:17.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.767+0000 7f3d7ffff640 1 --2- 172.21.15.53:0/2401066751 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d80159690 0x7f3d8015a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:17.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.767+0000 7f3d7ffff640 1 -- 172.21.15.53:0/2401066751 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d80159a60 msgr2=0x7f3d8014b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:17.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.767+0000 7f3d7ffff640 1 --2- 172.21.15.53:0/2401066751 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d80159a60 0x7f3d8014b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:17.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.767+0000 7f3d7ffff640 1 -- 172.21.15.53:0/2401066751 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d78009420 con 0x7f3d800b0f30 2023-06-10T19:06:17.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.767+0000 7f3d7ffff640 1 --2- 172.21.15.53:0/2401066751 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d800b0f30 0x7f3d8015cd10 secure :-1 s=READY pgs=2144 cs=0 l=1 rev1=1 crypto rx=0x7f3d70007ef0 tx=0x7f3d7000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:17.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.767+0000 7f3d7cff9640 1 -- 172.21.15.53:0/2401066751 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d70014620 con 0x7f3d800b0f30 2023-06-10T19:06:17.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.767+0000 7f3d7cff9640 1 -- 172.21.15.53:0/2401066751 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d70014780 con 0x7f3d800b0f30 2023-06-10T19:06:17.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.767+0000 7f3d867d5640 1 -- 172.21.15.53:0/2401066751 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d8015a860 con 0x7f3d800b0f30 2023-06-10T19:06:17.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.767+0000 7f3d7cff9640 1 -- 172.21.15.53:0/2401066751 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d70014b30 con 0x7f3d800b0f30 2023-06-10T19:06:17.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.767+0000 7f3d867d5640 1 -- 172.21.15.53:0/2401066751 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d800b2e60 con 0x7f3d800b0f30 2023-06-10T19:06:17.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.767+0000 7f3d867d5640 1 -- 172.21.15.53:0/2401066751 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d8004d790 con 0x7f3d800b0f30 2023-06-10T19:06:17.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.767+0000 7f3d7cff9640 1 -- 172.21.15.53:0/2401066751 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3d70014c90 con 0x7f3d800b0f30 2023-06-10T19:06:17.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.767+0000 7f3d7cff9640 1 --2- 172.21.15.53:0/2401066751 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3d6c066280 0x7f3d6c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:17.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.767+0000 7f3d7cff9640 1 -- 172.21.15.53:0/2401066751 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f3d70084770 con 0x7f3d800b0f30 2023-06-10T19:06:17.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.771+0000 7f3d7f7fe640 1 --2- 172.21.15.53:0/2401066751 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3d6c066280 0x7f3d6c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:17.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.771+0000 7f3d7f7fe640 1 --2- 172.21.15.53:0/2401066751 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3d6c066280 0x7f3d6c068730 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f3d80157b30 tx=0x7f3d74009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:17.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.771+0000 7f3d7cff9640 1 -- 172.21.15.53:0/2401066751 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3d70051b90 con 0x7f3d800b0f30 2023-06-10T19:06:17.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:17.959+0000 7f3d867d5640 1 -- 172.21.15.53:0/2401066751 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f3d80154200 con 0x7f3d800b0f30 2023-06-10T19:06:18.177 INFO:tasks.ceph.mon.a.smithi053.stderr:2023-06-10T19:06:18.175+0000 7f74752c1640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-06-10T19:06:18.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.183+0000 7f3d7cff9640 1 -- 172.21.15.53:0/2401066751 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v82) v1 ==== 161+0+0 (secure 0 0 0) 0x7f3d700551b0 con 0x7f3d800b0f30 2023-06-10T19:06:18.186 INFO:teuthology.orchestra.run.smithi053.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-06-10T19:06:18.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.187+0000 7f3d867d5640 1 -- 172.21.15.53:0/2401066751 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3d6c066280 msgr2=0x7f3d6c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:18.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.187+0000 7f3d867d5640 1 --2- 172.21.15.53:0/2401066751 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3d6c066280 0x7f3d6c068730 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f3d80157b30 tx=0x7f3d74009040 comp rx=0 tx=0).stop 2023-06-10T19:06:18.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.187+0000 7f3d867d5640 1 -- 172.21.15.53:0/2401066751 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d800b0f30 msgr2=0x7f3d8015cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:18.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.187+0000 7f3d867d5640 1 --2- 172.21.15.53:0/2401066751 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d800b0f30 0x7f3d8015cd10 secure :-1 s=READY pgs=2144 cs=0 l=1 rev1=1 crypto rx=0x7f3d70007ef0 tx=0x7f3d7000e4b0 comp rx=0 tx=0).stop 2023-06-10T19:06:18.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.187+0000 7f3d867d5640 1 -- 172.21.15.53:0/2401066751 shutdown_connections 2023-06-10T19:06:18.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.187+0000 7f3d867d5640 1 --2- 172.21.15.53:0/2401066751 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3d6c066280 0x7f3d6c068730 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:18.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.187+0000 7f3d867d5640 1 --2- 172.21.15.53:0/2401066751 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d80159a60 0x7f3d8014b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:18.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.187+0000 7f3d867d5640 1 --2- 172.21.15.53:0/2401066751 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d80159690 0x7f3d8015a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:18.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.187+0000 7f3d867d5640 1 --2- 172.21.15.53:0/2401066751 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d800b0f30 0x7f3d8015cd10 unknown :-1 s=CLOSED pgs=2144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:18.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.187+0000 7f3d867d5640 1 -- 172.21.15.53:0/2401066751 >> 172.21.15.53:0/2401066751 conn(0x7f3d8006a560 msgr2=0x7f3d8006cce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:18.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.187+0000 7f3d867d5640 1 -- 172.21.15.53:0/2401066751 shutdown_connections 2023-06-10T19:06:18.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.187+0000 7f3d867d5640 1 -- 172.21.15.53:0/2401066751 wait complete. 2023-06-10T19:06:18.198 INFO:tasks.ceph.mds.c.smithi053.stderr: -297> 2023-06-10T19:06:12.087+0000 7fbcbebf4640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-06-10T19:06:18.214 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-06-10T19:06:18.235 INFO:tasks.ceph.mds.c.smithi053.stdout:starting mds.c at 2023-06-10T19:06:18.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.351+0000 7f7c23365640 1 Processor -- start 2023-06-10T19:06:18.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.351+0000 7f7c23365640 1 -- start start 2023-06-10T19:06:18.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.351+0000 7f7c23365640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c1c071170 0x7f7c1c1586f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:18.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.351+0000 7f7c23365640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c1c15c260 con 0x7f7c1c06c7d0 2023-06-10T19:06:18.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.351+0000 7f7c23365640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c1c15c540 con 0x7f7c1c06c400 2023-06-10T19:06:18.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.351+0000 7f7c23365640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1c15cee0 con 0x7f7c1c071170 2023-06-10T19:06:18.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.351+0000 7f7c20900640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f7c1c06c7d0 0x7f7c1c0ccc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60376/0 (socket says 172.21.15.53:60376) 2023-06-10T19:06:18.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.351+0000 7f7c20900640 1 -- 172.21.15.53:0/2687117439 learned_addr learned my addr 172.21.15.53:0/2687117439 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:06:18.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.351+0000 7f7c21902640 1 --2- 172.21.15.53:0/2687117439 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c1c071170 0x7f7c1c1586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:18.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.355+0000 7f7c13fff640 1 -- 172.21.15.53:0/2687117439 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1808513757 0 0) 0x7f7c1c15c260 con 0x7f7c1c06c7d0 2023-06-10T19:06:18.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.355+0000 7f7c13fff640 1 -- 172.21.15.53:0/2687117439 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c08003530 con 0x7f7c1c06c7d0 2023-06-10T19:06:18.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.355+0000 7f7c13fff640 1 -- 172.21.15.53:0/2687117439 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 239055672 0 0) 0x7f7c08003530 con 0x7f7c1c06c7d0 2023-06-10T19:06:18.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.355+0000 7f7c13fff640 1 -- 172.21.15.53:0/2687117439 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c1c071170 msgr2=0x7f7c1c1586f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:18.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.355+0000 7f7c13fff640 1 --2- 172.21.15.53:0/2687117439 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c1c071170 0x7f7c1c1586f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:18.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.355+0000 7f7c13fff640 1 -- 172.21.15.53:0/2687117439 >> v1:172.21.15.117:6789/0 conn(0x7f7c1c06c400 legacy=0x7f7c1c157fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:18.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.355+0000 7f7c13fff640 1 -- 172.21.15.53:0/2687117439 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c1c15c820 con 0x7f7c1c06c7d0 2023-06-10T19:06:18.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.355+0000 7f7c13fff640 1 -- 172.21.15.53:0/2687117439 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f7c0c001680 con 0x7f7c1c06c7d0 2023-06-10T19:06:18.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.355+0000 7f7c13fff640 1 -- 172.21.15.53:0/2687117439 >> v1:172.21.15.53:6789/0 conn(0x7f7c1c06c7d0 legacy=0x7f7c1c0ccc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:18.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.355+0000 7f7c13fff640 1 --2- 172.21.15.53:0/2687117439 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c080039b0 0x7f7c08003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:18.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.355+0000 7f7c13fff640 1 --2- 172.21.15.53:0/2687117439 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c08004300 0x7f7c080047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:18.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.355+0000 7f7c13fff640 1 --2- 172.21.15.53:0/2687117439 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c08004fd0 0x7f7c0800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:18.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.355+0000 7f7c13fff640 1 -- 172.21.15.53:0/2687117439 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1c15cee0 con 0x7f7c08004fd0 2023-06-10T19:06:18.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.355+0000 7f7c13fff640 1 -- 172.21.15.53:0/2687117439 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0800bed0 con 0x7f7c08004300 2023-06-10T19:06:18.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.355+0000 7f7c13fff640 1 -- 172.21.15.53:0/2687117439 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0800c090 con 0x7f7c080039b0 2023-06-10T19:06:18.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.355+0000 7f7c21902640 1 --2- 172.21.15.53:0/2687117439 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c08004fd0 0x7f7c0800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:18.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.355+0000 7f7c21101640 1 --2- 172.21.15.53:0/2687117439 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c080039b0 0x7f7c08003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:18.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.355+0000 7f7c20900640 1 --2- 172.21.15.53:0/2687117439 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c08004300 0x7f7c080047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:18.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.355+0000 7f7c21902640 1 -- 172.21.15.53:0/2687117439 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c080039b0 msgr2=0x7f7c08003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:18.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.355+0000 7f7c21902640 1 --2- 172.21.15.53:0/2687117439 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c080039b0 0x7f7c08003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:18.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.355+0000 7f7c21902640 1 -- 172.21.15.53:0/2687117439 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c08004300 msgr2=0x7f7c080047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:18.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.355+0000 7f7c21902640 1 --2- 172.21.15.53:0/2687117439 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c08004300 0x7f7c080047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:18.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.355+0000 7f7c21902640 1 -- 172.21.15.53:0/2687117439 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c08003530 con 0x7f7c08004fd0 2023-06-10T19:06:18.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.355+0000 7f7c21101640 1 --2- 172.21.15.53:0/2687117439 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c080039b0 0x7f7c08003d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:06:18.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.355+0000 7f7c21902640 1 --2- 172.21.15.53:0/2687117439 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c08004fd0 0x7f7c0800b990 secure :-1 s=READY pgs=2149 cs=0 l=1 rev1=1 crypto rx=0x7f7c18009ab0 tx=0x7f7c1801ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=832315595c1308c8 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:18.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.355+0000 7f7c13fff640 1 -- 172.21.15.53:0/2687117439 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c180a5510 con 0x7f7c08004fd0 2023-06-10T19:06:18.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.355+0000 7f7c13fff640 1 -- 172.21.15.53:0/2687117439 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c180a5670 con 0x7f7c08004fd0 2023-06-10T19:06:18.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.355+0000 7f7c13fff640 1 -- 172.21.15.53:0/2687117439 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c180a5a20 con 0x7f7c08004fd0 2023-06-10T19:06:18.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.355+0000 7f7c23365640 1 -- 172.21.15.53:0/2687117439 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c08004fd0 msgr2=0x7f7c0800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:18.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.355+0000 7f7c23365640 1 --2- 172.21.15.53:0/2687117439 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c08004fd0 0x7f7c0800b990 secure :-1 s=READY pgs=2149 cs=0 l=1 rev1=1 crypto rx=0x7f7c18009ab0 tx=0x7f7c1801ca30 comp rx=0 tx=0).stop 2023-06-10T19:06:18.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.355+0000 7f7c21902640 1 -- 172.21.15.53:0/2687117439 reap_dead start 2023-06-10T19:06:18.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.355+0000 7f7c23365640 1 -- 172.21.15.53:0/2687117439 shutdown_connections 2023-06-10T19:06:18.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.355+0000 7f7c23365640 1 -- 172.21.15.53:0/2687117439 >> 172.21.15.53:0/2687117439 conn(0x7f7c1c06a560 msgr2=0x7f7c1c06a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:18.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.355+0000 7f7c23365640 1 -- 172.21.15.53:0/2687117439 shutdown_connections 2023-06-10T19:06:18.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.355+0000 7f7c23365640 1 -- 172.21.15.53:0/2687117439 wait complete. 2023-06-10T19:06:18.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.359+0000 7f7c23365640 1 Processor -- start 2023-06-10T19:06:18.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.359+0000 7f7c23365640 1 -- start start 2023-06-10T19:06:18.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.359+0000 7f7c23365640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c1c0c4f70 0x7f7c1c0aea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:18.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.359+0000 7f7c23365640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c1c0c5340 0x7f7c1c1ef630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:18.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.359+0000 7f7c23365640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c1c14eae0 0x7f7c1c14ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:18.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.359+0000 7f7c23365640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1c14f480 con 0x7f7c1c0c4f70 2023-06-10T19:06:18.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.359+0000 7f7c23365640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1c0b2880 con 0x7f7c1c14eae0 2023-06-10T19:06:18.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.359+0000 7f7c23365640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1c1efb70 con 0x7f7c1c0c5340 2023-06-10T19:06:18.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.359+0000 7f7c21101640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c1c0c4f70 0x7f7c1c0aea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:18.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.359+0000 7f7c21101640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c1c0c4f70 0x7f7c1c0aea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42352/0 (socket says 172.21.15.53:42352) 2023-06-10T19:06:18.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.359+0000 7f7c21101640 1 -- 172.21.15.53:0/2013067745 learned_addr learned my addr 172.21.15.53:0/2013067745 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:18.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.359+0000 7f7c20900640 1 --2- 172.21.15.53:0/2013067745 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c1c0c5340 0x7f7c1c1ef630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:18.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.359+0000 7f7c21902640 1 --2- 172.21.15.53:0/2013067745 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c1c14eae0 0x7f7c1c14ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:18.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.359+0000 7f7c21101640 1 -- 172.21.15.53:0/2013067745 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c1c0c5340 msgr2=0x7f7c1c1ef630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:18.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.359+0000 7f7c21101640 1 --2- 172.21.15.53:0/2013067745 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c1c0c5340 0x7f7c1c1ef630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:18.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.359+0000 7f7c21101640 1 -- 172.21.15.53:0/2013067745 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c1c14eae0 msgr2=0x7f7c1c14ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:18.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.359+0000 7f7c21101640 1 --2- 172.21.15.53:0/2013067745 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c1c14eae0 0x7f7c1c14ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:18.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.359+0000 7f7c21101640 1 -- 172.21.15.53:0/2013067745 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c1c0af090 con 0x7f7c1c0c4f70 2023-06-10T19:06:18.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.359+0000 7f7c20900640 1 --2- 172.21.15.53:0/2013067745 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c1c0c5340 0x7f7c1c1ef630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:06:18.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.359+0000 7f7c21902640 1 --2- 172.21.15.53:0/2013067745 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c1c14eae0 0x7f7c1c14ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:06:18.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.359+0000 7f7c21101640 1 --2- 172.21.15.53:0/2013067745 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c1c0c4f70 0x7f7c1c0aea70 secure :-1 s=READY pgs=2150 cs=0 l=1 rev1=1 crypto rx=0x7f7c1400eb20 tx=0x7f7c140020a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:18.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.359+0000 7f7c11ffb640 1 -- 172.21.15.53:0/2013067745 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c14003b90 con 0x7f7c1c0c4f70 2023-06-10T19:06:18.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.359+0000 7f7c11ffb640 1 -- 172.21.15.53:0/2013067745 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c14003cf0 con 0x7f7c1c0c4f70 2023-06-10T19:06:18.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.359+0000 7f7c23365640 1 -- 172.21.15.53:0/2013067745 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c1c0af370 con 0x7f7c1c0c4f70 2023-06-10T19:06:18.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.359+0000 7f7c11ffb640 1 -- 172.21.15.53:0/2013067745 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c1400c9c0 con 0x7f7c1c0c4f70 2023-06-10T19:06:18.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.359+0000 7f7c23365640 1 -- 172.21.15.53:0/2013067745 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c1c0af930 con 0x7f7c1c0c4f70 2023-06-10T19:06:18.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.359+0000 7f7c23365640 1 -- 172.21.15.53:0/2013067745 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c1c04d790 con 0x7f7c1c0c4f70 2023-06-10T19:06:18.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.363+0000 7f7c11ffb640 1 -- 172.21.15.53:0/2013067745 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7c1400cb20 con 0x7f7c1c0c4f70 2023-06-10T19:06:18.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.363+0000 7f7c11ffb640 1 --2- 172.21.15.53:0/2013067745 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7c000662b0 0x7f7c00068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:18.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.363+0000 7f7c11ffb640 1 -- 172.21.15.53:0/2013067745 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6234+0+0 (secure 0 0 0) 0x7f7c14083ff0 con 0x7f7c1c0c4f70 2023-06-10T19:06:18.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.363+0000 7f7c20900640 1 --2- 172.21.15.53:0/2013067745 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7c000662b0 0x7f7c00068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:18.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.363+0000 7f7c20900640 1 --2- 172.21.15.53:0/2013067745 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7c000662b0 0x7f7c00068760 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c0017b0 tx=0x7f7c0c001160 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:18.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.367+0000 7f7c11ffb640 1 -- 172.21.15.53:0/2013067745 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7c14051410 con 0x7f7c1c0c4f70 2023-06-10T19:06:18.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:18.555+0000 7f7c23365640 1 -- 172.21.15.53:0/2013067745 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f7c1c0b4d30 con 0x7f7c1c0c4f70 2023-06-10T19:06:19.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:19.195+0000 7f7c11ffb640 1 -- 172.21.15.53:0/2013067745 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v83) v1 ==== 104+0+0 (secure 0 0 0) 0x7f7c14003e60 con 0x7f7c1c0c4f70 2023-06-10T19:06:19.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:19.199+0000 7f7c23365640 1 -- 172.21.15.53:0/2013067745 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7c000662b0 msgr2=0x7f7c00068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:19.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:19.199+0000 7f7c23365640 1 --2- 172.21.15.53:0/2013067745 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7c000662b0 0x7f7c00068760 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c0017b0 tx=0x7f7c0c001160 comp rx=0 tx=0).stop 2023-06-10T19:06:19.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:19.199+0000 7f7c23365640 1 -- 172.21.15.53:0/2013067745 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c1c0c4f70 msgr2=0x7f7c1c0aea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:19.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:19.199+0000 7f7c23365640 1 --2- 172.21.15.53:0/2013067745 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c1c0c4f70 0x7f7c1c0aea70 secure :-1 s=READY pgs=2150 cs=0 l=1 rev1=1 crypto rx=0x7f7c1400eb20 tx=0x7f7c140020a0 comp rx=0 tx=0).stop 2023-06-10T19:06:19.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:19.199+0000 7f7c23365640 1 -- 172.21.15.53:0/2013067745 shutdown_connections 2023-06-10T19:06:19.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:19.199+0000 7f7c23365640 1 --2- 172.21.15.53:0/2013067745 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7c000662b0 0x7f7c00068760 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:19.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:19.199+0000 7f7c23365640 1 --2- 172.21.15.53:0/2013067745 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c1c14eae0 0x7f7c1c14ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:19.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:19.199+0000 7f7c23365640 1 --2- 172.21.15.53:0/2013067745 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7c1c0c5340 0x7f7c1c1ef630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:19.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:19.199+0000 7f7c23365640 1 --2- 172.21.15.53:0/2013067745 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c1c0c4f70 0x7f7c1c0aea70 unknown :-1 s=CLOSED pgs=2150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:19.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:19.199+0000 7f7c23365640 1 -- 172.21.15.53:0/2013067745 >> 172.21.15.53:0/2013067745 conn(0x7f7c1c06a560 msgr2=0x7f7c1c157db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:19.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:19.199+0000 7f7c23365640 1 -- 172.21.15.53:0/2013067745 shutdown_connections 2023-06-10T19:06:19.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:19.199+0000 7f7c23365640 1 -- 172.21.15.53:0/2013067745 wait complete. 2023-06-10T19:06:19.225 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-06-10T19:06:19.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:19.403+0000 7f698933e640 1 Processor -- start 2023-06-10T19:06:19.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:19.403+0000 7f698933e640 1 -- start start 2023-06-10T19:06:19.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:19.403+0000 7f698933e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6984159760 0x7f69840cec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:19.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:19.403+0000 7f698933e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f69840cf1a0 0x7f69840cbf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:19.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:19.403+0000 7f698933e640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69840cf5f0 con 0x7f6984159390 2023-06-10T19:06:19.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:19.403+0000 7f698933e640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f698415e1b0 con 0x7f6984159760 2023-06-10T19:06:19.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:19.403+0000 7f698933e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69840cb460 con 0x7f69840cf1a0 2023-06-10T19:06:19.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:19.403+0000 7f69827fc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6984159760 0x7f69840cec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:19.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:19.403+0000 7f6982ffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f6984159390 0x7f698415d1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60384/0 (socket says 172.21.15.53:60384) 2023-06-10T19:06:19.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:19.403+0000 7f6982ffd640 1 -- 172.21.15.53:0/4250909393 learned_addr learned my addr 172.21.15.53:0/4250909393 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:06:19.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:19.407+0000 7f69837fe640 1 --2- 172.21.15.53:0/4250909393 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f69840cf1a0 0x7f69840cbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:19.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:19.407+0000 7f69827fc640 1 -- 172.21.15.53:0/4250909393 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f69840cf1a0 msgr2=0x7f69840cbf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:19.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:19.407+0000 7f69827fc640 1 --2- 172.21.15.53:0/4250909393 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f69840cf1a0 0x7f69840cbf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:19.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:19.407+0000 7f69827fc640 1 -- 172.21.15.53:0/4250909393 >> v1:172.21.15.53:6789/0 conn(0x7f6984159390 legacy=0x7f698415d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:19.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:19.407+0000 7f69827fc640 1 -- 172.21.15.53:0/4250909393 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f698415dbf0 con 0x7f6984159760 2023-06-10T19:06:19.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:19.407+0000 7f69827fc640 1 --2- 172.21.15.53:0/4250909393 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6984159760 0x7f69840cec60 secure :-1 s=READY pgs=2152 cs=0 l=1 rev1=1 crypto rx=0x7f69740097c0 tx=0x7f697401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c199702f7acf0d0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:19.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:19.407+0000 7f6981ffb640 1 -- 172.21.15.53:0/4250909393 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69740ab650 con 0x7f6984159760 2023-06-10T19:06:19.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:19.407+0000 7f6981ffb640 1 -- 172.21.15.53:0/4250909393 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69740ab7b0 con 0x7f6984159760 2023-06-10T19:06:19.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:19.407+0000 7f6981ffb640 1 -- 172.21.15.53:0/4250909393 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69740abb40 con 0x7f6984159760 2023-06-10T19:06:19.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:19.407+0000 7f698933e640 1 -- 172.21.15.53:0/4250909393 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6984159760 msgr2=0x7f69840cec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:19.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:19.407+0000 7f698933e640 1 --2- 172.21.15.53:0/4250909393 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6984159760 0x7f69840cec60 secure :-1 s=READY pgs=2152 cs=0 l=1 rev1=1 crypto rx=0x7f69740097c0 tx=0x7f697401c450 comp rx=0 tx=0).stop 2023-06-10T19:06:19.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:19.407+0000 7f698933e640 1 -- 172.21.15.53:0/4250909393 shutdown_connections 2023-06-10T19:06:19.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:19.407+0000 7f698933e640 1 --2- 172.21.15.53:0/4250909393 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6984159760 0x7f69840cec60 unknown :-1 s=CLOSED pgs=2152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:19.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:19.407+0000 7f698933e640 1 --2- 172.21.15.53:0/4250909393 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f69840cf1a0 0x7f69840cbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:19.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:19.407+0000 7f698933e640 1 -- 172.21.15.53:0/4250909393 >> 172.21.15.53:0/4250909393 conn(0x7f698406a0b0 msgr2=0x7f698406d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:19.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:19.407+0000 7f698933e640 1 -- 172.21.15.53:0/4250909393 shutdown_connections 2023-06-10T19:06:19.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:19.407+0000 7f698933e640 1 -- 172.21.15.53:0/4250909393 wait complete. 2023-06-10T19:06:19.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:19.411+0000 7f698933e640 1 Processor -- start 2023-06-10T19:06:19.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:19.411+0000 7f698933e640 1 -- start start 2023-06-10T19:06:19.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:19.411+0000 7f698933e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f69840cf1a0 0x7f698406c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:19.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:19.411+0000 7f698933e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6984159390 0x7f6984150ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:19.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:19.411+0000 7f698933e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6984159760 0x7f698406a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:19.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:19.411+0000 7f698933e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f698406bc00 con 0x7f6984159390 2023-06-10T19:06:19.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:19.411+0000 7f698933e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f698406c5d0 con 0x7f6984159760 2023-06-10T19:06:19.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:19.411+0000 7f698933e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6984151400 con 0x7f69840cf1a0 2023-06-10T19:06:19.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:19.411+0000 7f69827fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6984159390 0x7f6984150ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:19.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:19.411+0000 7f69827fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6984159390 0x7f6984150ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42382/0 (socket says 172.21.15.53:42382) 2023-06-10T19:06:19.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:19.411+0000 7f69827fc640 1 -- 172.21.15.53:0/3016880176 learned_addr learned my addr 172.21.15.53:0/3016880176 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:19.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:19.411+0000 7f69837fe640 1 --2- 172.21.15.53:0/3016880176 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6984159760 0x7f698406a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:19.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:19.411+0000 7f6982ffd640 1 --2- 172.21.15.53:0/3016880176 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f69840cf1a0 0x7f698406c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:19.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:19.411+0000 7f69827fc640 1 -- 172.21.15.53:0/3016880176 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f69840cf1a0 msgr2=0x7f698406c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:19.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:19.411+0000 7f69827fc640 1 --2- 172.21.15.53:0/3016880176 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f69840cf1a0 0x7f698406c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:19.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:19.411+0000 7f69827fc640 1 -- 172.21.15.53:0/3016880176 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6984159760 msgr2=0x7f698406a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:19.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:19.411+0000 7f69827fc640 1 --2- 172.21.15.53:0/3016880176 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6984159760 0x7f698406a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:19.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:19.411+0000 7f69827fc640 1 -- 172.21.15.53:0/3016880176 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6974009420 con 0x7f6984159390 2023-06-10T19:06:19.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:19.411+0000 7f6982ffd640 1 --2- 172.21.15.53:0/3016880176 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f69840cf1a0 0x7f698406c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:06:19.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:19.411+0000 7f69827fc640 1 --2- 172.21.15.53:0/3016880176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6984159390 0x7f6984150ec0 secure :-1 s=READY pgs=2153 cs=0 l=1 rev1=1 crypto rx=0x7f697401ab00 tx=0x7f69740191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:19.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:19.411+0000 7f697b7fe640 1 -- 172.21.15.53:0/3016880176 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69740abe70 con 0x7f6984159390 2023-06-10T19:06:19.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:19.411+0000 7f697b7fe640 1 -- 172.21.15.53:0/3016880176 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69740bf450 con 0x7f6984159390 2023-06-10T19:06:19.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:19.411+0000 7f698933e640 1 -- 172.21.15.53:0/3016880176 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f698406aff0 con 0x7f6984159390 2023-06-10T19:06:19.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:19.411+0000 7f697b7fe640 1 -- 172.21.15.53:0/3016880176 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69740bf820 con 0x7f6984159390 2023-06-10T19:06:19.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:19.411+0000 7f698933e640 1 -- 172.21.15.53:0/3016880176 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f698406b5b0 con 0x7f6984159390 2023-06-10T19:06:19.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:19.415+0000 7f698933e640 1 -- 172.21.15.53:0/3016880176 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f698404d790 con 0x7f6984159390 2023-06-10T19:06:19.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:19.415+0000 7f697b7fe640 1 -- 172.21.15.53:0/3016880176 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f69740bf980 con 0x7f6984159390 2023-06-10T19:06:19.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:19.415+0000 7f697b7fe640 1 --2- 172.21.15.53:0/3016880176 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f69640662b0 0x7f6964068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:19.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:19.415+0000 7f697b7fe640 1 -- 172.21.15.53:0/3016880176 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6234+0+0 (secure 0 0 0) 0x7f697411eb00 con 0x7f6984159390 2023-06-10T19:06:19.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:19.415+0000 7f6982ffd640 1 --2- 172.21.15.53:0/3016880176 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f69640662b0 0x7f6964068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:19.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:19.415+0000 7f6982ffd640 1 --2- 172.21.15.53:0/3016880176 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f69640662b0 0x7f6964068760 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f696c000f70 tx=0x7f696c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:19.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:19.419+0000 7f697b7fe640 1 -- 172.21.15.53:0/3016880176 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6974120e60 con 0x7f6984159390 2023-06-10T19:06:19.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:19.567+0000 7f698933e640 1 -- 172.21.15.53:0/3016880176 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f698406e000 con 0x7f6984159390 2023-06-10T19:06:20.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.223+0000 7f697b7fe640 1 -- 172.21.15.53:0/3016880176 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v144) v1 ==== 181+0+0 (secure 0 0 0) 0x7f69740ef8c0 con 0x7f6984159390 2023-06-10T19:06:20.230 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_metadata' removed 2023-06-10T19:06:20.235 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.231+0000 7f698933e640 1 -- 172.21.15.53:0/3016880176 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f69640662b0 msgr2=0x7f6964068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:20.235 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.231+0000 7f698933e640 1 --2- 172.21.15.53:0/3016880176 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f69640662b0 0x7f6964068760 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f696c000f70 tx=0x7f696c009040 comp rx=0 tx=0).stop 2023-06-10T19:06:20.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.231+0000 7f698933e640 1 -- 172.21.15.53:0/3016880176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6984159390 msgr2=0x7f6984150ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:20.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.231+0000 7f698933e640 1 --2- 172.21.15.53:0/3016880176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6984159390 0x7f6984150ec0 secure :-1 s=READY pgs=2153 cs=0 l=1 rev1=1 crypto rx=0x7f697401ab00 tx=0x7f69740191f0 comp rx=0 tx=0).stop 2023-06-10T19:06:20.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.231+0000 7f698933e640 1 -- 172.21.15.53:0/3016880176 shutdown_connections 2023-06-10T19:06:20.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.231+0000 7f698933e640 1 --2- 172.21.15.53:0/3016880176 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f69640662b0 0x7f6964068760 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:20.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.231+0000 7f698933e640 1 --2- 172.21.15.53:0/3016880176 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6984159760 0x7f698406a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:20.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.231+0000 7f698933e640 1 --2- 172.21.15.53:0/3016880176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6984159390 0x7f6984150ec0 unknown :-1 s=CLOSED pgs=2153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:20.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.231+0000 7f698933e640 1 --2- 172.21.15.53:0/3016880176 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f69840cf1a0 0x7f698406c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:20.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.231+0000 7f698933e640 1 -- 172.21.15.53:0/3016880176 >> 172.21.15.53:0/3016880176 conn(0x7f698406a0b0 msgr2=0x7f6984154ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:20.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.231+0000 7f698933e640 1 -- 172.21.15.53:0/3016880176 shutdown_connections 2023-06-10T19:06:20.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.235+0000 7f698933e640 1 -- 172.21.15.53:0/3016880176 wait complete. 2023-06-10T19:06:20.260 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-06-10T19:06:20.395 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.395+0000 7fb53a6ca640 1 Processor -- start 2023-06-10T19:06:20.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.395+0000 7fb53a6ca640 1 -- start start 2023-06-10T19:06:20.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.395+0000 7fb53a6ca640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb534159940 0x7fb5340c9b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:20.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.395+0000 7fb53a6ca640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5340ca4a0 con 0x7fb5340ca050 2023-06-10T19:06:20.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.395+0000 7fb53a6ca640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb534159d10 con 0x7fb5340aff40 2023-06-10T19:06:20.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.395+0000 7fb53a6ca640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb53406b100 con 0x7fb534159940 2023-06-10T19:06:20.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.395+0000 7fb5337fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fb5340ca050 0x7fb5340af830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60396/0 (socket says 172.21.15.53:60396) 2023-06-10T19:06:20.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.395+0000 7fb5337fe640 1 -- 172.21.15.53:0/1584810269 learned_addr learned my addr 172.21.15.53:0/1584810269 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:06:20.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.395+0000 7fb533fff640 1 --2- 172.21.15.53:0/1584810269 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb534159940 0x7fb5340c9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:20.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.395+0000 7fb532ffd640 1 -- 172.21.15.53:0/1584810269 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2307890588 0 0) 0x7fb528001120 con 0x7fb5340ca050 2023-06-10T19:06:20.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.395+0000 7fb532ffd640 1 -- 172.21.15.53:0/1584810269 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb51c003530 con 0x7fb5340ca050 2023-06-10T19:06:20.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.395+0000 7fb532ffd640 1 -- 172.21.15.53:0/1584810269 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2127399195 0 0) 0x7fb51c003530 con 0x7fb5340ca050 2023-06-10T19:06:20.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.395+0000 7fb532ffd640 1 -- 172.21.15.53:0/1584810269 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb534159940 msgr2=0x7fb5340c9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:20.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.395+0000 7fb532ffd640 1 --2- 172.21.15.53:0/1584810269 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb534159940 0x7fb5340c9b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:20.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.395+0000 7fb532ffd640 1 -- 172.21.15.53:0/1584810269 >> v1:172.21.15.117:6789/0 conn(0x7fb5340aff40 legacy=0x7fb5340c8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:20.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.395+0000 7fb532ffd640 1 -- 172.21.15.53:0/1584810269 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb53406bc80 con 0x7fb5340ca050 2023-06-10T19:06:20.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.395+0000 7fb532ffd640 1 -- 172.21.15.53:0/1584810269 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fb528001810 con 0x7fb5340ca050 2023-06-10T19:06:20.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.395+0000 7fb532ffd640 1 -- 172.21.15.53:0/1584810269 >> v1:172.21.15.53:6789/0 conn(0x7fb5340ca050 legacy=0x7fb5340af830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:20.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.395+0000 7fb532ffd640 1 --2- 172.21.15.53:0/1584810269 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb51c0039b0 0x7fb51c003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:20.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.395+0000 7fb532ffd640 1 --2- 172.21.15.53:0/1584810269 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb51c004350 0x7fb51c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:20.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.395+0000 7fb532ffd640 1 --2- 172.21.15.53:0/1584810269 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb534159940 0x7fb51c005110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:20.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.395+0000 7fb532ffd640 1 -- 172.21.15.53:0/1584810269 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb53406b100 con 0x7fb51c0039b0 2023-06-10T19:06:20.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.395+0000 7fb532ffd640 1 -- 172.21.15.53:0/1584810269 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb51c00fe50 con 0x7fb51c004350 2023-06-10T19:06:20.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.395+0000 7fb532ffd640 1 -- 172.21.15.53:0/1584810269 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb51c00ffe0 con 0x7fb534159940 2023-06-10T19:06:20.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.395+0000 7fb533fff640 1 --2- 172.21.15.53:0/1584810269 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb51c0039b0 0x7fb51c003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:20.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.395+0000 7fb5337fe640 1 --2- 172.21.15.53:0/1584810269 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb51c004350 0x7fb51c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:20.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.395+0000 7fb538c67640 1 --2- 172.21.15.53:0/1584810269 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb534159940 0x7fb51c005110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:20.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.395+0000 7fb533fff640 1 -- 172.21.15.53:0/1584810269 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb534159940 msgr2=0x7fb51c005110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:20.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.395+0000 7fb533fff640 1 --2- 172.21.15.53:0/1584810269 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb534159940 0x7fb51c005110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:20.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.395+0000 7fb533fff640 1 -- 172.21.15.53:0/1584810269 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb51c004350 msgr2=0x7fb51c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:20.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.395+0000 7fb533fff640 1 --2- 172.21.15.53:0/1584810269 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb51c004350 0x7fb51c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:20.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.399+0000 7fb533fff640 1 -- 172.21.15.53:0/1584810269 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb51c003530 con 0x7fb51c0039b0 2023-06-10T19:06:20.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.399+0000 7fb533fff640 1 --2- 172.21.15.53:0/1584810269 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb51c0039b0 0x7fb51c003d80 secure :-1 s=READY pgs=2155 cs=0 l=1 rev1=1 crypto rx=0x7fb524009b10 tx=0x7fb52401ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=533c491de8d8d8a6 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:20.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.403+0000 7fb532ffd640 1 -- 172.21.15.53:0/1584810269 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5240a6430 con 0x7fb51c0039b0 2023-06-10T19:06:20.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.403+0000 7fb532ffd640 1 -- 172.21.15.53:0/1584810269 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5240a6590 con 0x7fb51c0039b0 2023-06-10T19:06:20.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.403+0000 7fb532ffd640 1 -- 172.21.15.53:0/1584810269 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5240a6940 con 0x7fb51c0039b0 2023-06-10T19:06:20.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.403+0000 7fb53a6ca640 1 -- 172.21.15.53:0/1584810269 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb51c0039b0 msgr2=0x7fb51c003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:20.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.403+0000 7fb53a6ca640 1 --2- 172.21.15.53:0/1584810269 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb51c0039b0 0x7fb51c003d80 secure :-1 s=READY pgs=2155 cs=0 l=1 rev1=1 crypto rx=0x7fb524009b10 tx=0x7fb52401ca50 comp rx=0 tx=0).stop 2023-06-10T19:06:20.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.403+0000 7fb538c67640 1 -- 172.21.15.53:0/1584810269 reap_dead start 2023-06-10T19:06:20.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.403+0000 7fb53a6ca640 1 -- 172.21.15.53:0/1584810269 shutdown_connections 2023-06-10T19:06:20.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.403+0000 7fb53a6ca640 1 -- 172.21.15.53:0/1584810269 >> 172.21.15.53:0/1584810269 conn(0x7fb5340ca830 msgr2=0x7fb5340cac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:20.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.403+0000 7fb53a6ca640 1 -- 172.21.15.53:0/1584810269 shutdown_connections 2023-06-10T19:06:20.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.403+0000 7fb53a6ca640 1 -- 172.21.15.53:0/1584810269 wait complete. 2023-06-10T19:06:20.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.403+0000 7fb53a6ca640 1 Processor -- start 2023-06-10T19:06:20.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.403+0000 7fb53a6ca640 1 -- start start 2023-06-10T19:06:20.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.403+0000 7fb53a6ca640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5340c3110 0x7fb5341f02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:20.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.403+0000 7fb53a6ca640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5340c34e0 0x7fb53415c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:20.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.403+0000 7fb53a6ca640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5340c6ea0 0x7fb5340c7340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:20.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.403+0000 7fb53a6ca640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5341f08d0 con 0x7fb5340c6ea0 2023-06-10T19:06:20.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.403+0000 7fb53a6ca640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5341f0bb0 con 0x7fb5340c34e0 2023-06-10T19:06:20.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.403+0000 7fb53a6ca640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5341f0e90 con 0x7fb5340c3110 2023-06-10T19:06:20.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.403+0000 7fb538c67640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5340c6ea0 0x7fb5340c7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:20.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.403+0000 7fb538c67640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5340c6ea0 0x7fb5340c7340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42410/0 (socket says 172.21.15.53:42410) 2023-06-10T19:06:20.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.403+0000 7fb538c67640 1 -- 172.21.15.53:0/793901219 learned_addr learned my addr 172.21.15.53:0/793901219 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:20.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.403+0000 7fb533fff640 1 --2- 172.21.15.53:0/793901219 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5340c3110 0x7fb5341f02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:20.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.403+0000 7fb5337fe640 1 --2- 172.21.15.53:0/793901219 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5340c34e0 0x7fb53415c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:20.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.403+0000 7fb538c67640 1 -- 172.21.15.53:0/793901219 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5340c3110 msgr2=0x7fb5341f02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:20.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.403+0000 7fb538c67640 1 --2- 172.21.15.53:0/793901219 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5340c3110 0x7fb5341f02e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:20.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.403+0000 7fb538c67640 1 -- 172.21.15.53:0/793901219 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5340c34e0 msgr2=0x7fb53415c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:20.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.403+0000 7fb538c67640 1 --2- 172.21.15.53:0/793901219 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5340c34e0 0x7fb53415c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:20.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.403+0000 7fb538c67640 1 -- 172.21.15.53:0/793901219 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5341f1170 con 0x7fb5340c6ea0 2023-06-10T19:06:20.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.403+0000 7fb538c67640 1 --2- 172.21.15.53:0/793901219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5340c6ea0 0x7fb5340c7340 secure :-1 s=READY pgs=2156 cs=0 l=1 rev1=1 crypto rx=0x7fb53406eb80 tx=0x7fb52c00fba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:20.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.403+0000 7fb530ff9640 1 -- 172.21.15.53:0/793901219 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb52c003980 con 0x7fb5340c6ea0 2023-06-10T19:06:20.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.403+0000 7fb530ff9640 1 -- 172.21.15.53:0/793901219 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb52c003b00 con 0x7fb5340c6ea0 2023-06-10T19:06:20.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.403+0000 7fb53a6ca640 1 -- 172.21.15.53:0/793901219 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5341e5250 con 0x7fb5340c6ea0 2023-06-10T19:06:20.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.403+0000 7fb530ff9640 1 -- 172.21.15.53:0/793901219 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb52c0050d0 con 0x7fb5340c6ea0 2023-06-10T19:06:20.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.403+0000 7fb53a6ca640 1 -- 172.21.15.53:0/793901219 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb53415ccb0 con 0x7fb5340c6ea0 2023-06-10T19:06:20.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.407+0000 7fb53a6ca640 1 -- 172.21.15.53:0/793901219 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb53406b8f0 con 0x7fb5340c6ea0 2023-06-10T19:06:20.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.407+0000 7fb530ff9640 1 -- 172.21.15.53:0/793901219 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb52c005230 con 0x7fb5340c6ea0 2023-06-10T19:06:20.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.407+0000 7fb530ff9640 1 --2- 172.21.15.53:0/793901219 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb520066280 0x7fb520068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:20.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.407+0000 7fb530ff9640 1 -- 172.21.15.53:0/793901219 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 5796+0+0 (secure 0 0 0) 0x7fb52c083550 con 0x7fb5340c6ea0 2023-06-10T19:06:20.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.407+0000 7fb533fff640 1 --2- 172.21.15.53:0/793901219 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb520066280 0x7fb520068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:20.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.407+0000 7fb533fff640 1 --2- 172.21.15.53:0/793901219 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb520066280 0x7fb520068730 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fb5240ad000 tx=0x7fb5240b2040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:20.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.411+0000 7fb530ff9640 1 -- 172.21.15.53:0/793901219 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb53406b8f0 con 0x7fb5340c6ea0 2023-06-10T19:06:20.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:20.559+0000 7fb53a6ca640 1 -- 172.21.15.53:0/793901219 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb53406b8f0 con 0x7fb5340c6ea0 2023-06-10T19:06:21.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.227+0000 7fb530ff9640 1 -- 172.21.15.53:0/793901219 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v145) v1 ==== 169+0+0 (secure 0 0 0) 0x7fb53406b8f0 con 0x7fb5340c6ea0 2023-06-10T19:06:21.228 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_data' removed 2023-06-10T19:06:21.232 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.231+0000 7fb53a6ca640 1 -- 172.21.15.53:0/793901219 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb520066280 msgr2=0x7fb520068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:21.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.231+0000 7fb53a6ca640 1 --2- 172.21.15.53:0/793901219 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb520066280 0x7fb520068730 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fb5240ad000 tx=0x7fb5240b2040 comp rx=0 tx=0).stop 2023-06-10T19:06:21.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.231+0000 7fb53a6ca640 1 -- 172.21.15.53:0/793901219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5340c6ea0 msgr2=0x7fb5340c7340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:21.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.231+0000 7fb53a6ca640 1 --2- 172.21.15.53:0/793901219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5340c6ea0 0x7fb5340c7340 secure :-1 s=READY pgs=2156 cs=0 l=1 rev1=1 crypto rx=0x7fb53406eb80 tx=0x7fb52c00fba0 comp rx=0 tx=0).stop 2023-06-10T19:06:21.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.231+0000 7fb53a6ca640 1 -- 172.21.15.53:0/793901219 shutdown_connections 2023-06-10T19:06:21.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.231+0000 7fb53a6ca640 1 --2- 172.21.15.53:0/793901219 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb520066280 0x7fb520068730 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:21.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.231+0000 7fb53a6ca640 1 --2- 172.21.15.53:0/793901219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5340c6ea0 0x7fb5340c7340 unknown :-1 s=CLOSED pgs=2156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:21.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.231+0000 7fb53a6ca640 1 --2- 172.21.15.53:0/793901219 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5340c34e0 0x7fb53415c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:21.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.231+0000 7fb53a6ca640 1 --2- 172.21.15.53:0/793901219 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb5340c3110 0x7fb5341f02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:21.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.231+0000 7fb53a6ca640 1 -- 172.21.15.53:0/793901219 >> 172.21.15.53:0/793901219 conn(0x7fb5340ca830 msgr2=0x7fb5340b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:21.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.231+0000 7fb53a6ca640 1 -- 172.21.15.53:0/793901219 shutdown_connections 2023-06-10T19:06:21.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.231+0000 7fb53a6ca640 1 -- 172.21.15.53:0/793901219 wait complete. 2023-06-10T19:06:21.258 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-06-10T19:06:21.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.399+0000 7f18533af640 1 Processor -- start 2023-06-10T19:06:21.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.399+0000 7f18533af640 1 -- start start 2023-06-10T19:06:21.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.399+0000 7f18533af640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f184c0c97d0 0x7f184c0cb820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:21.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.399+0000 7f18533af640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f184c0af760 0x7f184c0afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:21.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.399+0000 7f18533af640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f184c0ac910 con 0x7f184c06c350 2023-06-10T19:06:21.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.399+0000 7f18533af640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f184c0ca5c0 con 0x7f184c0af760 2023-06-10T19:06:21.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.399+0000 7f18533af640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f184c0b0120 con 0x7f184c0c97d0 2023-06-10T19:06:21.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.399+0000 7f185194c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f184c0af760 0x7f184c0afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:21.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.399+0000 7f185194c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f184c0af760 0x7f184c0afbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55210/0 (socket says 172.21.15.53:55210) 2023-06-10T19:06:21.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.399+0000 7f185194c640 1 -- 172.21.15.53:0/2863073365 learned_addr learned my addr 172.21.15.53:0/2863073365 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:21.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.399+0000 7f185114b640 1 --2- 172.21.15.53:0/2863073365 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f184c0c97d0 0x7f184c0cb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:21.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.399+0000 7f185194c640 1 -- 172.21.15.53:0/2863073365 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f184c0c97d0 msgr2=0x7f184c0cb820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:21.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.399+0000 7f185194c640 1 --2- 172.21.15.53:0/2863073365 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f184c0c97d0 0x7f184c0cb820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:21.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.399+0000 7f185194c640 1 -- 172.21.15.53:0/2863073365 >> v1:172.21.15.117:6789/0 conn(0x7f184c06c350 legacy=0x7f184c0ac200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:21.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.399+0000 7f185194c640 1 -- 172.21.15.53:0/2863073365 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f184c0cbd60 con 0x7f184c0af760 2023-06-10T19:06:21.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.403+0000 7f185194c640 1 --2- 172.21.15.53:0/2863073365 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f184c0af760 0x7f184c0afbe0 secure :-1 s=READY pgs=2157 cs=0 l=1 rev1=1 crypto rx=0x7f183c009870 tx=0x7f183c01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cff1cc2ed777f5b server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:21.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.403+0000 7f184bfff640 1 -- 172.21.15.53:0/2863073365 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f183c0ab600 con 0x7f184c0af760 2023-06-10T19:06:21.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.403+0000 7f184bfff640 1 -- 172.21.15.53:0/2863073365 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f183c0a7050 con 0x7f184c0af760 2023-06-10T19:06:21.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.403+0000 7f184bfff640 1 -- 172.21.15.53:0/2863073365 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f183c0ab980 con 0x7f184c0af760 2023-06-10T19:06:21.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.403+0000 7f18533af640 1 -- 172.21.15.53:0/2863073365 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f184c0af760 msgr2=0x7f184c0afbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:21.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.403+0000 7f18533af640 1 --2- 172.21.15.53:0/2863073365 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f184c0af760 0x7f184c0afbe0 secure :-1 s=READY pgs=2157 cs=0 l=1 rev1=1 crypto rx=0x7f183c009870 tx=0x7f183c01c3e0 comp rx=0 tx=0).stop 2023-06-10T19:06:21.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.403+0000 7f18533af640 1 -- 172.21.15.53:0/2863073365 shutdown_connections 2023-06-10T19:06:21.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.403+0000 7f18533af640 1 --2- 172.21.15.53:0/2863073365 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f184c0af760 0x7f184c0afbe0 unknown :-1 s=CLOSED pgs=2157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:21.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.403+0000 7f18533af640 1 --2- 172.21.15.53:0/2863073365 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f184c0c97d0 0x7f184c0cb820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:21.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.403+0000 7f18533af640 1 -- 172.21.15.53:0/2863073365 >> 172.21.15.53:0/2863073365 conn(0x7f184c06a0e0 msgr2=0x7f184c0cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:21.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.403+0000 7f18533af640 1 -- 172.21.15.53:0/2863073365 shutdown_connections 2023-06-10T19:06:21.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.403+0000 7f18533af640 1 -- 172.21.15.53:0/2863073365 wait complete. 2023-06-10T19:06:21.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.407+0000 7f18533af640 1 Processor -- start 2023-06-10T19:06:21.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.407+0000 7f18533af640 1 -- start start 2023-06-10T19:06:21.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.407+0000 7f18533af640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f184c06c350 0x7f184c0c4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:21.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.407+0000 7f18533af640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f184c0af760 0x7f184c14f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:21.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.407+0000 7f18533af640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f184c0c97d0 0x7f184c15a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:21.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.407+0000 7f18533af640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f184c070360 con 0x7f184c0af760 2023-06-10T19:06:21.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.407+0000 7f18533af640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f184c0ad8e0 con 0x7f184c0c97d0 2023-06-10T19:06:21.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.407+0000 7f18533af640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f184c070080 con 0x7f184c06c350 2023-06-10T19:06:21.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.407+0000 7f185094a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f184c0af760 0x7f184c14f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:21.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.407+0000 7f185094a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f184c0af760 0x7f184c14f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55226/0 (socket says 172.21.15.53:55226) 2023-06-10T19:06:21.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.407+0000 7f185094a640 1 -- 172.21.15.53:0/251651640 learned_addr learned my addr 172.21.15.53:0/251651640 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:21.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.407+0000 7f185114b640 1 --2- 172.21.15.53:0/251651640 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f184c06c350 0x7f184c0c4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:21.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.407+0000 7f185094a640 1 -- 172.21.15.53:0/251651640 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f184c06c350 msgr2=0x7f184c0c4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:21.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.407+0000 7f185194c640 1 --2- 172.21.15.53:0/251651640 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f184c0c97d0 0x7f184c15a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:21.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.407+0000 7f185094a640 1 --2- 172.21.15.53:0/251651640 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f184c06c350 0x7f184c0c4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:21.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.407+0000 7f185094a640 1 -- 172.21.15.53:0/251651640 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f184c0c97d0 msgr2=0x7f184c15a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:21.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.407+0000 7f185094a640 1 --2- 172.21.15.53:0/251651640 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f184c0c97d0 0x7f184c15a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:21.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.407+0000 7f185094a640 1 -- 172.21.15.53:0/251651640 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f183c0094d0 con 0x7f184c0af760 2023-06-10T19:06:21.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.407+0000 7f185114b640 1 --2- 172.21.15.53:0/251651640 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f184c06c350 0x7f184c0c4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:06:21.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.407+0000 7f185094a640 1 --2- 172.21.15.53:0/251651640 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f184c0af760 0x7f184c14f480 secure :-1 s=READY pgs=2158 cs=0 l=1 rev1=1 crypto rx=0x7f184000c7c0 tx=0x7f184000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:21.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.407+0000 7f1849ffb640 1 -- 172.21.15.53:0/251651640 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f184000aa50 con 0x7f184c0af760 2023-06-10T19:06:21.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.407+0000 7f1849ffb640 1 -- 172.21.15.53:0/251651640 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f184000abb0 con 0x7f184c0af760 2023-06-10T19:06:21.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.407+0000 7f18533af640 1 -- 172.21.15.53:0/251651640 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f184c0adb80 con 0x7f184c0af760 2023-06-10T19:06:21.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.407+0000 7f1849ffb640 1 -- 172.21.15.53:0/251651640 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1840012420 con 0x7f184c0af760 2023-06-10T19:06:21.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.407+0000 7f18533af640 1 -- 172.21.15.53:0/251651640 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f184c0c5260 con 0x7f184c0af760 2023-06-10T19:06:21.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.407+0000 7f18533af640 1 -- 172.21.15.53:0/251651640 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f184c0b0770 con 0x7f184c0af760 2023-06-10T19:06:21.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.407+0000 7f1849ffb640 1 -- 172.21.15.53:0/251651640 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1840012580 con 0x7f184c0af760 2023-06-10T19:06:21.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.407+0000 7f1849ffb640 1 --2- 172.21.15.53:0/251651640 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f18380662b0 0x7f1838068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:21.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.411+0000 7f1849ffb640 1 -- 172.21.15.53:0/251651640 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f1840083bf0 con 0x7f184c0af760 2023-06-10T19:06:21.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.411+0000 7f185114b640 1 --2- 172.21.15.53:0/251651640 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f18380662b0 0x7f1838068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:21.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.411+0000 7f185114b640 1 --2- 172.21.15.53:0/251651640 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f18380662b0 0x7f1838068760 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f1844006fd0 tx=0x7f1844008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:21.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.415+0000 7f1849ffb640 1 -- 172.21.15.53:0/251651640 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f18400513a0 con 0x7f184c0af760 2023-06-10T19:06:21.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.567+0000 7f18533af640 1 -- 172.21.15.53:0/251651640 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f184c0ad740 con 0x7f184c0af760 2023-06-10T19:06:21.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.575+0000 7f1849ffb640 1 -- 172.21.15.53:0/251651640 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v25) v1 ==== 104+0+0 (secure 0 0 0) 0x7f184c0ad740 con 0x7f184c0af760 2023-06-10T19:06:21.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.575+0000 7f18533af640 1 -- 172.21.15.53:0/251651640 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f18380662b0 msgr2=0x7f1838068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:21.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.575+0000 7f18533af640 1 --2- 172.21.15.53:0/251651640 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f18380662b0 0x7f1838068760 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f1844006fd0 tx=0x7f1844008040 comp rx=0 tx=0).stop 2023-06-10T19:06:21.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.575+0000 7f18533af640 1 -- 172.21.15.53:0/251651640 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f184c0af760 msgr2=0x7f184c14f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:21.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.575+0000 7f18533af640 1 --2- 172.21.15.53:0/251651640 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f184c0af760 0x7f184c14f480 secure :-1 s=READY pgs=2158 cs=0 l=1 rev1=1 crypto rx=0x7f184000c7c0 tx=0x7f184000cc80 comp rx=0 tx=0).stop 2023-06-10T19:06:21.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.575+0000 7f18533af640 1 -- 172.21.15.53:0/251651640 shutdown_connections 2023-06-10T19:06:21.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.575+0000 7f18533af640 1 --2- 172.21.15.53:0/251651640 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f18380662b0 0x7f1838068760 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:21.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.575+0000 7f18533af640 1 --2- 172.21.15.53:0/251651640 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f184c0c97d0 0x7f184c15a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:21.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.575+0000 7f18533af640 1 --2- 172.21.15.53:0/251651640 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f184c0af760 0x7f184c14f480 unknown :-1 s=CLOSED pgs=2158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:21.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.575+0000 7f18533af640 1 --2- 172.21.15.53:0/251651640 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f184c06c350 0x7f184c0c4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:21.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.575+0000 7f18533af640 1 -- 172.21.15.53:0/251651640 >> 172.21.15.53:0/251651640 conn(0x7f184c06a0e0 msgr2=0x7f184c0ac200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:21.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.575+0000 7f18533af640 1 -- 172.21.15.53:0/251651640 shutdown_connections 2023-06-10T19:06:21.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.575+0000 7f18533af640 1 -- 172.21.15.53:0/251651640 wait complete. 2023-06-10T19:06:21.595 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_filelock' 2023-06-10T19:06:21.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.715+0000 7f0a64291640 1 Processor -- start 2023-06-10T19:06:21.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.715+0000 7f0a64291640 1 -- start start 2023-06-10T19:06:21.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.715+0000 7f0a64291640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0a5c15fe00 0x7f0a5c163980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:21.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.715+0000 7f0a64291640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a5c0cb870 0x7f0a5c0c10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:21.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.715+0000 7f0a64291640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0a5c0af720 0x7f0a5c0afb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:21.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.715+0000 7f0a64291640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a5c1648e0 con 0x7f0a5c15fe00 2023-06-10T19:06:21.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.715+0000 7f0a64291640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a5c0b00b0 con 0x7f0a5c0af720 2023-06-10T19:06:21.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.715+0000 7f0a64291640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5c06b2c0 con 0x7f0a5c0cb870 2023-06-10T19:06:21.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.715+0000 7f0a6202d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0a5c15fe00 0x7f0a5c163980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:21.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.715+0000 7f0a6202d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0a5c15fe00 0x7f0a5c163980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55232/0 (socket says 172.21.15.53:55232) 2023-06-10T19:06:21.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.715+0000 7f0a6202d640 1 -- 172.21.15.53:0/1235200489 learned_addr learned my addr 172.21.15.53:0/1235200489 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:21.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.715+0000 7f0a6282e640 1 --2- 172.21.15.53:0/1235200489 >> v2:172.21.15.117:3300/0 conn(0x7f0a5c0af720 0x7f0a5c0afb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:21.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.715+0000 7f0a6182c640 1 --2- 172.21.15.53:0/1235200489 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a5c0cb870 0x7f0a5c0c10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:21.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.715+0000 7f0a6202d640 1 -- 172.21.15.53:0/1235200489 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a5c0cb870 msgr2=0x7f0a5c0c10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:21.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.715+0000 7f0a6202d640 1 --2- 172.21.15.53:0/1235200489 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a5c0cb870 0x7f0a5c0c10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:21.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.715+0000 7f0a6202d640 1 -- 172.21.15.53:0/1235200489 >> v2:172.21.15.117:3300/0 conn(0x7f0a5c0af720 msgr2=0x7f0a5c0afb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:21.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.715+0000 7f0a6202d640 1 --2- 172.21.15.53:0/1235200489 >> v2:172.21.15.117:3300/0 conn(0x7f0a5c0af720 0x7f0a5c0afb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:21.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.715+0000 7f0a6202d640 1 -- 172.21.15.53:0/1235200489 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a5c0c1620 con 0x7f0a5c15fe00 2023-06-10T19:06:21.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.719+0000 7f0a6202d640 1 --2- 172.21.15.53:0/1235200489 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0a5c15fe00 0x7f0a5c163980 secure :-1 s=READY pgs=2159 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c06c7c0 tx=0x7f0a5801c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3e5b07dc9b8e844 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:21.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.719+0000 7f0a6102b640 1 -- 172.21.15.53:0/1235200489 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a580a5740 con 0x7f0a5c15fe00 2023-06-10T19:06:21.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.719+0000 7f0a6102b640 1 -- 172.21.15.53:0/1235200489 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a580a58a0 con 0x7f0a5c15fe00 2023-06-10T19:06:21.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.719+0000 7f0a6102b640 1 -- 172.21.15.53:0/1235200489 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a580a5c30 con 0x7f0a5c15fe00 2023-06-10T19:06:21.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.719+0000 7f0a64291640 1 -- 172.21.15.53:0/1235200489 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0a5c15fe00 msgr2=0x7f0a5c163980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:21.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.719+0000 7f0a64291640 1 --2- 172.21.15.53:0/1235200489 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0a5c15fe00 0x7f0a5c163980 secure :-1 s=READY pgs=2159 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c06c7c0 tx=0x7f0a5801c9d0 comp rx=0 tx=0).stop 2023-06-10T19:06:21.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.719+0000 7f0a64291640 1 -- 172.21.15.53:0/1235200489 shutdown_connections 2023-06-10T19:06:21.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.719+0000 7f0a64291640 1 --2- 172.21.15.53:0/1235200489 >> v2:172.21.15.117:3300/0 conn(0x7f0a5c0af720 0x7f0a5c0afb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:21.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.719+0000 7f0a64291640 1 --2- 172.21.15.53:0/1235200489 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a5c0cb870 0x7f0a5c0c10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:21.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.719+0000 7f0a64291640 1 --2- 172.21.15.53:0/1235200489 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0a5c15fe00 0x7f0a5c163980 unknown :-1 s=CLOSED pgs=2159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:21.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.719+0000 7f0a64291640 1 -- 172.21.15.53:0/1235200489 >> 172.21.15.53:0/1235200489 conn(0x7f0a5c06a0d0 msgr2=0x7f0a5c0ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:21.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.719+0000 7f0a64291640 1 -- 172.21.15.53:0/1235200489 shutdown_connections 2023-06-10T19:06:21.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.719+0000 7f0a64291640 1 -- 172.21.15.53:0/1235200489 wait complete. 2023-06-10T19:06:21.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.719+0000 7f0a64291640 1 Processor -- start 2023-06-10T19:06:21.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.719+0000 7f0a64291640 1 -- start start 2023-06-10T19:06:21.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.723+0000 7f0a64291640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a5c0af720 0x7f0a5c1558d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:21.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.723+0000 7f0a64291640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0a5c0cb870 0x7f0a5c0c3230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:21.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.723+0000 7f0a64291640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a5c15fe00 0x7f0a5c15bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:21.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.723+0000 7f0a64291640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5c155e10 con 0x7f0a5c0cb870 2023-06-10T19:06:21.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.723+0000 7f0a64291640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5c0c5a70 con 0x7f0a5c0af720 2023-06-10T19:06:21.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.723+0000 7f0a64291640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5c0c4ea0 con 0x7f0a5c15fe00 2023-06-10T19:06:21.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.723+0000 7f0a6182c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0a5c0cb870 0x7f0a5c0c3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:21.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.723+0000 7f0a6182c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0a5c0cb870 0x7f0a5c0c3230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55236/0 (socket says 172.21.15.53:55236) 2023-06-10T19:06:21.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.723+0000 7f0a6182c640 1 -- 172.21.15.53:0/2527739310 learned_addr learned my addr 172.21.15.53:0/2527739310 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:21.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.723+0000 7f0a6202d640 1 --2- 172.21.15.53:0/2527739310 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a5c0af720 0x7f0a5c1558d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:21.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.723+0000 7f0a6282e640 1 --2- 172.21.15.53:0/2527739310 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a5c15fe00 0x7f0a5c15bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:21.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.723+0000 7f0a6182c640 1 -- 172.21.15.53:0/2527739310 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a5c15fe00 msgr2=0x7f0a5c15bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:21.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.723+0000 7f0a6182c640 1 --2- 172.21.15.53:0/2527739310 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a5c15fe00 0x7f0a5c15bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:21.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.723+0000 7f0a6182c640 1 -- 172.21.15.53:0/2527739310 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a5c0af720 msgr2=0x7f0a5c1558d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:21.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.723+0000 7f0a6182c640 1 --2- 172.21.15.53:0/2527739310 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a5c0af720 0x7f0a5c1558d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:21.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.723+0000 7f0a6182c640 1 -- 172.21.15.53:0/2527739310 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a58009b30 con 0x7f0a5c0cb870 2023-06-10T19:06:21.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.723+0000 7f0a6282e640 1 --2- 172.21.15.53:0/2527739310 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a5c15fe00 0x7f0a5c15bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:06:21.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.723+0000 7f0a6202d640 1 --2- 172.21.15.53:0/2527739310 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a5c0af720 0x7f0a5c1558d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:06:21.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.723+0000 7f0a6182c640 1 --2- 172.21.15.53:0/2527739310 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0a5c0cb870 0x7f0a5c0c3230 secure :-1 s=READY pgs=2160 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c00d800 tx=0x7f0a4c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:21.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.723+0000 7f0a52ffd640 1 -- 172.21.15.53:0/2527739310 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4c00b6c0 con 0x7f0a5c0cb870 2023-06-10T19:06:21.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.723+0000 7f0a52ffd640 1 -- 172.21.15.53:0/2527739310 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a4c00b820 con 0x7f0a5c0cb870 2023-06-10T19:06:21.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.723+0000 7f0a64291640 1 -- 172.21.15.53:0/2527739310 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a5c0c5140 con 0x7f0a5c0cb870 2023-06-10T19:06:21.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.723+0000 7f0a52ffd640 1 -- 172.21.15.53:0/2527739310 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4c00bb90 con 0x7f0a5c0cb870 2023-06-10T19:06:21.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.723+0000 7f0a64291640 1 -- 172.21.15.53:0/2527739310 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a5c0c5700 con 0x7f0a5c0cb870 2023-06-10T19:06:21.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.723+0000 7f0a64291640 1 -- 172.21.15.53:0/2527739310 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a5c0c5be0 con 0x7f0a5c0cb870 2023-06-10T19:06:21.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.723+0000 7f0a52ffd640 1 -- 172.21.15.53:0/2527739310 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0a4c00bcf0 con 0x7f0a5c0cb870 2023-06-10T19:06:21.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.723+0000 7f0a52ffd640 1 --2- 172.21.15.53:0/2527739310 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0a40066280 0x7f0a40068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:21.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.723+0000 7f0a52ffd640 1 -- 172.21.15.53:0/2527739310 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f0a4c083ff0 con 0x7f0a5c0cb870 2023-06-10T19:06:21.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.723+0000 7f0a6202d640 1 --2- 172.21.15.53:0/2527739310 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0a40066280 0x7f0a40068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:21.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.727+0000 7f0a6202d640 1 --2- 172.21.15.53:0/2527739310 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0a40066280 0x7f0a40068730 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f0a580ae000 tx=0x7f0a580a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:21.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.727+0000 7f0a52ffd640 1 -- 172.21.15.53:0/2527739310 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0a4c055230 con 0x7f0a5c0cb870 2023-06-10T19:06:21.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:21.939+0000 7f0a64291640 1 -- 172.21.15.53:0/2527739310 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_filelock"]} v 0) v1 -- 0x7f0a5c04d790 con 0x7f0a5c0cb870 2023-06-10T19:06:22.245 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:22.243+0000 7f0a52ffd640 1 -- 172.21.15.53:0/2527739310 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_filelock"]}]=0 v645) v1 ==== 145+0+0 (secure 0 0 0) 0x7f0a4c054dc0 con 0x7f0a5c0cb870 2023-06-10T19:06:22.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:22.247+0000 7f0a64291640 1 -- 172.21.15.53:0/2527739310 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0a40066280 msgr2=0x7f0a40068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:22.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:22.247+0000 7f0a64291640 1 --2- 172.21.15.53:0/2527739310 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0a40066280 0x7f0a40068730 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f0a580ae000 tx=0x7f0a580a7070 comp rx=0 tx=0).stop 2023-06-10T19:06:22.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:22.247+0000 7f0a64291640 1 -- 172.21.15.53:0/2527739310 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0a5c0cb870 msgr2=0x7f0a5c0c3230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:22.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:22.247+0000 7f0a64291640 1 --2- 172.21.15.53:0/2527739310 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0a5c0cb870 0x7f0a5c0c3230 secure :-1 s=READY pgs=2160 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c00d800 tx=0x7f0a4c00dcc0 comp rx=0 tx=0).stop 2023-06-10T19:06:22.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:22.247+0000 7f0a64291640 1 -- 172.21.15.53:0/2527739310 shutdown_connections 2023-06-10T19:06:22.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:22.247+0000 7f0a64291640 1 --2- 172.21.15.53:0/2527739310 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0a40066280 0x7f0a40068730 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:22.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:22.247+0000 7f0a64291640 1 --2- 172.21.15.53:0/2527739310 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0a5c15fe00 0x7f0a5c15bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:22.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:22.247+0000 7f0a64291640 1 --2- 172.21.15.53:0/2527739310 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0a5c0cb870 0x7f0a5c0c3230 unknown :-1 s=CLOSED pgs=2160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:22.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:22.247+0000 7f0a64291640 1 --2- 172.21.15.53:0/2527739310 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a5c0af720 0x7f0a5c1558d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:22.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:22.247+0000 7f0a64291640 1 -- 172.21.15.53:0/2527739310 >> 172.21.15.53:0/2527739310 conn(0x7f0a5c06a0d0 msgr2=0x7f0a5c06f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:22.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:22.247+0000 7f0a64291640 1 -- 172.21.15.53:0/2527739310 shutdown_connections 2023-06-10T19:06:22.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:22.247+0000 7f0a64291640 1 -- 172.21.15.53:0/2527739310 wait complete. 2023-06-10T19:06:22.269 INFO:tasks.cephfs_test_runner:test_filelock (tasks.cephfs.test_client_recovery.TestClientRecovery) ... ok 2023-06-10T19:06:22.269 INFO:tasks.cephfs_test_runner:Starting test: test_filelock_eviction (tasks.cephfs.test_client_recovery.TestClientRecovery) 2023-06-10T19:06:22.270 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_filelock_eviction' 2023-06-10T19:06:22.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:22.395+0000 7ffba678f640 1 Processor -- start 2023-06-10T19:06:22.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:22.399+0000 7ffba678f640 1 -- start start 2023-06-10T19:06:22.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:22.399+0000 7ffba678f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ffba00cd760 0x7ffba00cbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:22.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:22.399+0000 7ffba678f640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffba00cc6c0 con 0x7ffba015c810 2023-06-10T19:06:22.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:22.399+0000 7ffba678f640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffba00cc9a0 con 0x7ffba015ba70 2023-06-10T19:06:22.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:22.399+0000 7ffba678f640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffba00cdb30 con 0x7ffba00cd760 2023-06-10T19:06:22.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:22.399+0000 7ffba4d2c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ffba00cd760 0x7ffba00cbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:22.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:22.399+0000 7ffb9f7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ffba015c810 0x7ffba006efc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:49550/0 (socket says 172.21.15.53:49550) 2023-06-10T19:06:22.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:22.399+0000 7ffb9f7fe640 1 -- 172.21.15.53:0/2128932858 learned_addr learned my addr 172.21.15.53:0/2128932858 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:06:22.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:22.399+0000 7ffba4d2c640 1 -- 172.21.15.53:0/2128932858 >> v1:172.21.15.117:6789/0 conn(0x7ffba015ba70 legacy=0x7ffba015c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:22.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:22.399+0000 7ffba4d2c640 1 -- 172.21.15.53:0/2128932858 >> v1:172.21.15.53:6789/0 conn(0x7ffba015c810 legacy=0x7ffba006efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:22.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:22.399+0000 7ffba4d2c640 1 -- 172.21.15.53:0/2128932858 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffba00ccc80 con 0x7ffba00cd760 2023-06-10T19:06:22.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:22.399+0000 7ffba4d2c640 1 --2- 172.21.15.53:0/2128932858 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffba00cd760 0x7ffba00cbfc0 secure :-1 s=READY pgs=2162 cs=0 l=1 rev1=1 crypto rx=0x7ffb980097c0 tx=0x7ffb9801c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68284b683a3db725 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:22.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:22.399+0000 7ffb9effd640 1 -- 172.21.15.53:0/2128932858 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb980ac410 con 0x7ffba00cd760 2023-06-10T19:06:22.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:22.399+0000 7ffb9effd640 1 -- 172.21.15.53:0/2128932858 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb980ac570 con 0x7ffba00cd760 2023-06-10T19:06:22.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:22.399+0000 7ffb9effd640 1 -- 172.21.15.53:0/2128932858 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb980ac900 con 0x7ffba00cd760 2023-06-10T19:06:22.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:22.403+0000 7ffba678f640 1 -- 172.21.15.53:0/2128932858 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffba00cd760 msgr2=0x7ffba00cbfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:22.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:22.403+0000 7ffba678f640 1 --2- 172.21.15.53:0/2128932858 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffba00cd760 0x7ffba00cbfc0 secure :-1 s=READY pgs=2162 cs=0 l=1 rev1=1 crypto rx=0x7ffb980097c0 tx=0x7ffb9801c3b0 comp rx=0 tx=0).stop 2023-06-10T19:06:22.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:22.403+0000 7ffba678f640 1 -- 172.21.15.53:0/2128932858 shutdown_connections 2023-06-10T19:06:22.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:22.403+0000 7ffba678f640 1 --2- 172.21.15.53:0/2128932858 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffba00cd760 0x7ffba00cbfc0 unknown :-1 s=CLOSED pgs=2162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:22.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:22.403+0000 7ffba678f640 1 -- 172.21.15.53:0/2128932858 >> 172.21.15.53:0/2128932858 conn(0x7ffba006a0d0 msgr2=0x7ffba00ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:22.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:22.403+0000 7ffba678f640 1 -- 172.21.15.53:0/2128932858 shutdown_connections 2023-06-10T19:06:22.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:22.403+0000 7ffba678f640 1 -- 172.21.15.53:0/2128932858 wait complete. 2023-06-10T19:06:22.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:22.403+0000 7ffba678f640 1 Processor -- start 2023-06-10T19:06:22.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:22.403+0000 7ffba678f640 1 -- start start 2023-06-10T19:06:22.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:22.403+0000 7ffba678f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffba00cd760 0x7ffba014e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:22.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:22.403+0000 7ffba678f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffba015ba70 0x7ffba0146fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:22.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:22.403+0000 7ffba678f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffba015c810 0x7ffba0154e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:22.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:22.403+0000 7ffba678f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffba0156be0 con 0x7ffba00cd760 2023-06-10T19:06:22.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:22.403+0000 7ffba678f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffba0155f60 con 0x7ffba015ba70 2023-06-10T19:06:22.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:22.403+0000 7ffba678f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffba0156240 con 0x7ffba015c810 2023-06-10T19:06:22.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:22.403+0000 7ffb9ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffba00cd760 0x7ffba014e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:22.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:22.403+0000 7ffb9ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffba00cd760 0x7ffba014e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55252/0 (socket says 172.21.15.53:55252) 2023-06-10T19:06:22.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:22.403+0000 7ffb9ffff640 1 -- 172.21.15.53:0/3413365726 learned_addr learned my addr 172.21.15.53:0/3413365726 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:22.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:22.403+0000 7ffb9ffff640 1 -- 172.21.15.53:0/3413365726 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffba015c810 msgr2=0x7ffba0154e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:22.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:22.403+0000 7ffba4d2c640 1 --2- 172.21.15.53:0/3413365726 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffba015c810 0x7ffba0154e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:22.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:22.403+0000 7ffb9f7fe640 1 --2- 172.21.15.53:0/3413365726 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffba015ba70 0x7ffba0146fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:22.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:22.403+0000 7ffb9ffff640 1 --2- 172.21.15.53:0/3413365726 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffba015c810 0x7ffba0154e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:22.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:22.403+0000 7ffb9ffff640 1 -- 172.21.15.53:0/3413365726 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffba015ba70 msgr2=0x7ffba0146fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:22.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:22.403+0000 7ffb9ffff640 1 --2- 172.21.15.53:0/3413365726 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffba015ba70 0x7ffba0146fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:22.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:22.403+0000 7ffb9ffff640 1 -- 172.21.15.53:0/3413365726 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb98009420 con 0x7ffba00cd760 2023-06-10T19:06:22.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:22.403+0000 7ffb9f7fe640 1 --2- 172.21.15.53:0/3413365726 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffba015ba70 0x7ffba0146fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:06:22.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:22.403+0000 7ffb9ffff640 1 --2- 172.21.15.53:0/3413365726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffba00cd760 0x7ffba014e380 secure :-1 s=READY pgs=2163 cs=0 l=1 rev1=1 crypto rx=0x7ffb8800c490 tx=0x7ffb88001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:22.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:22.403+0000 7ffb9cff9640 1 -- 172.21.15.53:0/3413365726 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb88003600 con 0x7ffba00cd760 2023-06-10T19:06:22.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:22.403+0000 7ffb9cff9640 1 -- 172.21.15.53:0/3413365726 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb88003780 con 0x7ffba00cd760 2023-06-10T19:06:22.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:22.403+0000 7ffba678f640 1 -- 172.21.15.53:0/3413365726 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffba0156520 con 0x7ffba00cd760 2023-06-10T19:06:22.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:22.403+0000 7ffb9cff9640 1 -- 172.21.15.53:0/3413365726 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb88003b30 con 0x7ffba00cd760 2023-06-10T19:06:22.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:22.403+0000 7ffba678f640 1 -- 172.21.15.53:0/3413365726 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffba014e8c0 con 0x7ffba00cd760 2023-06-10T19:06:22.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:22.407+0000 7ffba678f640 1 -- 172.21.15.53:0/3413365726 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffba00ca040 con 0x7ffba00cd760 2023-06-10T19:06:22.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:22.407+0000 7ffb9cff9640 1 -- 172.21.15.53:0/3413365726 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ffb88003c90 con 0x7ffba00cd760 2023-06-10T19:06:22.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:22.407+0000 7ffb9cff9640 1 --2- 172.21.15.53:0/3413365726 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ffb80066280 0x7ffb80068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:22.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:22.407+0000 7ffb9cff9640 1 -- 172.21.15.53:0/3413365726 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 5382+0+0 (secure 0 0 0) 0x7ffb88082cc0 con 0x7ffba00cd760 2023-06-10T19:06:22.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:22.407+0000 7ffb9f7fe640 1 --2- 172.21.15.53:0/3413365726 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ffb80066280 0x7ffb80068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:22.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:22.407+0000 7ffb9f7fe640 1 --2- 172.21.15.53:0/3413365726 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ffb80066280 0x7ffb80068730 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7ffba00aca50 tx=0x7ffb90009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:22.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:22.411+0000 7ffb9cff9640 1 -- 172.21.15.53:0/3413365726 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ffb880503e0 con 0x7ffba00cd760 2023-06-10T19:06:22.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:22.623+0000 7ffba678f640 1 -- 172.21.15.53:0/3413365726 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_filelock_eviction"]} v 0) v1 -- 0x7ffba004d790 con 0x7ffba00cd760 2023-06-10T19:06:23.247 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.247+0000 7ffb9cff9640 1 -- 172.21.15.53:0/3413365726 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_filelock_eviction"]}]=0 v646) v1 ==== 157+0+0 (secure 0 0 0) 0x7ffb880170e0 con 0x7ffba00cd760 2023-06-10T19:06:23.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.247+0000 7ffba678f640 1 -- 172.21.15.53:0/3413365726 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ffb80066280 msgr2=0x7ffb80068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:23.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.247+0000 7ffba678f640 1 --2- 172.21.15.53:0/3413365726 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ffb80066280 0x7ffb80068730 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7ffba00aca50 tx=0x7ffb90009040 comp rx=0 tx=0).stop 2023-06-10T19:06:23.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.247+0000 7ffba678f640 1 -- 172.21.15.53:0/3413365726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffba00cd760 msgr2=0x7ffba014e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:23.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.247+0000 7ffba678f640 1 --2- 172.21.15.53:0/3413365726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffba00cd760 0x7ffba014e380 secure :-1 s=READY pgs=2163 cs=0 l=1 rev1=1 crypto rx=0x7ffb8800c490 tx=0x7ffb88001e80 comp rx=0 tx=0).stop 2023-06-10T19:06:23.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.247+0000 7ffba678f640 1 -- 172.21.15.53:0/3413365726 shutdown_connections 2023-06-10T19:06:23.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.247+0000 7ffba678f640 1 --2- 172.21.15.53:0/3413365726 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ffb80066280 0x7ffb80068730 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:23.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.247+0000 7ffba678f640 1 --2- 172.21.15.53:0/3413365726 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffba015c810 0x7ffba0154e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:23.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.247+0000 7ffba678f640 1 --2- 172.21.15.53:0/3413365726 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffba015ba70 0x7ffba0146fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:23.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.247+0000 7ffba678f640 1 --2- 172.21.15.53:0/3413365726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffba00cd760 0x7ffba014e380 unknown :-1 s=CLOSED pgs=2163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:23.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.247+0000 7ffba678f640 1 -- 172.21.15.53:0/3413365726 >> 172.21.15.53:0/3413365726 conn(0x7ffba006a0d0 msgr2=0x7ffba015bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:23.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.247+0000 7ffba678f640 1 -- 172.21.15.53:0/3413365726 shutdown_connections 2023-06-10T19:06:23.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.247+0000 7ffba678f640 1 -- 172.21.15.53:0/3413365726 wait complete. 2023-06-10T19:06:23.273 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-06-10T19:06:23.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.403+0000 7fc92251b640 1 Processor -- start 2023-06-10T19:06:23.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.403+0000 7fc92251b640 1 -- start start 2023-06-10T19:06:23.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.403+0000 7fc92251b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc91c0c9fa0 0x7fc91c06bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:23.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.403+0000 7fc92251b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc91c0af760 0x7fc91c0afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:23.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.403+0000 7fc92251b640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc91c06b090 con 0x7fc91c06c020 2023-06-10T19:06:23.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.403+0000 7fc92251b640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc91c0b0120 con 0x7fc91c0af760 2023-06-10T19:06:23.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.403+0000 7fc92251b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc91c0ca370 con 0x7fc91c0c9fa0 2023-06-10T19:06:23.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.403+0000 7fc91b7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fc91c06c020 0x7fc91c0c82a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:49552/0 (socket says 172.21.15.53:49552) 2023-06-10T19:06:23.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.403+0000 7fc91b7fe640 1 -- 172.21.15.53:0/520380589 learned_addr learned my addr 172.21.15.53:0/520380589 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:06:23.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.403+0000 7fc91bfff640 1 --2- 172.21.15.53:0/520380589 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc91c0c9fa0 0x7fc91c06bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:23.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.403+0000 7fc920ab8640 1 --2- 172.21.15.53:0/520380589 >> v2:172.21.15.117:3300/0 conn(0x7fc91c0af760 0x7fc91c0afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:23.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.403+0000 7fc91affd640 1 -- 172.21.15.53:0/520380589 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 774861435 0 0) 0x7fc91c06b090 con 0x7fc91c06c020 2023-06-10T19:06:23.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.403+0000 7fc91affd640 1 -- 172.21.15.53:0/520380589 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc908003530 con 0x7fc91c06c020 2023-06-10T19:06:23.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.403+0000 7fc91bfff640 1 -- 172.21.15.53:0/520380589 >> v2:172.21.15.117:3300/0 conn(0x7fc91c0af760 msgr2=0x7fc91c0afbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:23.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.403+0000 7fc91bfff640 1 --2- 172.21.15.53:0/520380589 >> v2:172.21.15.117:3300/0 conn(0x7fc91c0af760 0x7fc91c0afbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:23.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.403+0000 7fc91bfff640 1 -- 172.21.15.53:0/520380589 >> v1:172.21.15.53:6789/0 conn(0x7fc91c06c020 legacy=0x7fc91c0c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:23.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.403+0000 7fc91bfff640 1 -- 172.21.15.53:0/520380589 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc91c070d50 con 0x7fc91c0c9fa0 2023-06-10T19:06:23.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.403+0000 7fc920ab8640 1 --2- 172.21.15.53:0/520380589 >> v2:172.21.15.117:3300/0 conn(0x7fc91c0af760 0x7fc91c0afbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-10T19:06:23.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.407+0000 7fc91bfff640 1 --2- 172.21.15.53:0/520380589 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc91c0c9fa0 0x7fc91c06bae0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc914009d90 tx=0x7fc91401c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=470b271e3e3ef824 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:23.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.407+0000 7fc91affd640 1 -- 172.21.15.53:0/520380589 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9140a5860 con 0x7fc91c0c9fa0 2023-06-10T19:06:23.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.407+0000 7fc91affd640 1 -- 172.21.15.53:0/520380589 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9140a59c0 con 0x7fc91c0c9fa0 2023-06-10T19:06:23.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.407+0000 7fc91affd640 1 -- 172.21.15.53:0/520380589 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9140a5d30 con 0x7fc91c0c9fa0 2023-06-10T19:06:23.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.407+0000 7fc92251b640 1 -- 172.21.15.53:0/520380589 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc91c0c9fa0 msgr2=0x7fc91c06bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:23.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.407+0000 7fc92251b640 1 --2- 172.21.15.53:0/520380589 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc91c0c9fa0 0x7fc91c06bae0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc914009d90 tx=0x7fc91401c890 comp rx=0 tx=0).stop 2023-06-10T19:06:23.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.407+0000 7fc92251b640 1 -- 172.21.15.53:0/520380589 shutdown_connections 2023-06-10T19:06:23.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.407+0000 7fc92251b640 1 --2- 172.21.15.53:0/520380589 >> v2:172.21.15.117:3300/0 conn(0x7fc91c0af760 0x7fc91c0afbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:23.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.407+0000 7fc92251b640 1 --2- 172.21.15.53:0/520380589 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc91c0c9fa0 0x7fc91c06bae0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:23.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.407+0000 7fc92251b640 1 -- 172.21.15.53:0/520380589 >> 172.21.15.53:0/520380589 conn(0x7fc91c06a0e0 msgr2=0x7fc91c0cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:23.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.407+0000 7fc92251b640 1 -- 172.21.15.53:0/520380589 shutdown_connections 2023-06-10T19:06:23.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.407+0000 7fc92251b640 1 -- 172.21.15.53:0/520380589 wait complete. 2023-06-10T19:06:23.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.407+0000 7fc92251b640 1 Processor -- start 2023-06-10T19:06:23.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.407+0000 7fc92251b640 1 -- start start 2023-06-10T19:06:23.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.411+0000 7fc92251b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc91c06c020 0x7fc91c157a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:23.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.411+0000 7fc92251b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc91c0af760 0x7fc91c158f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:23.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.411+0000 7fc92251b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc91c0c9fa0 0x7fc91c153390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:23.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.411+0000 7fc92251b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc91c15ad10 con 0x7fc91c0c9fa0 2023-06-10T19:06:23.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.411+0000 7fc92251b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc91c15aa30 con 0x7fc91c06c020 2023-06-10T19:06:23.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.411+0000 7fc92251b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc91c158440 con 0x7fc91c0af760 2023-06-10T19:06:23.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.411+0000 7fc920ab8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc91c0c9fa0 0x7fc91c153390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:23.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.411+0000 7fc920ab8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc91c0c9fa0 0x7fc91c153390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55260/0 (socket says 172.21.15.53:55260) 2023-06-10T19:06:23.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.411+0000 7fc920ab8640 1 -- 172.21.15.53:0/3897550253 learned_addr learned my addr 172.21.15.53:0/3897550253 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:23.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.411+0000 7fc91bfff640 1 --2- 172.21.15.53:0/3897550253 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc91c06c020 0x7fc91c157a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:23.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.411+0000 7fc91b7fe640 1 --2- 172.21.15.53:0/3897550253 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc91c0af760 0x7fc91c158f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:23.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.411+0000 7fc920ab8640 1 -- 172.21.15.53:0/3897550253 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc91c0af760 msgr2=0x7fc91c158f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:23.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.411+0000 7fc920ab8640 1 --2- 172.21.15.53:0/3897550253 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc91c0af760 0x7fc91c158f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:23.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.411+0000 7fc920ab8640 1 -- 172.21.15.53:0/3897550253 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc91c06c020 msgr2=0x7fc91c157a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:23.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.411+0000 7fc920ab8640 1 --2- 172.21.15.53:0/3897550253 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc91c06c020 0x7fc91c157a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:23.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.411+0000 7fc920ab8640 1 -- 172.21.15.53:0/3897550253 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc90c009420 con 0x7fc91c0c9fa0 2023-06-10T19:06:23.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.411+0000 7fc91b7fe640 1 --2- 172.21.15.53:0/3897550253 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc91c0af760 0x7fc91c158f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:06:23.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.411+0000 7fc920ab8640 1 --2- 172.21.15.53:0/3897550253 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc91c0c9fa0 0x7fc91c153390 secure :-1 s=READY pgs=2165 cs=0 l=1 rev1=1 crypto rx=0x7fc90c00e950 tx=0x7fc90c00ee10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:23.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.411+0000 7fc918ff9640 1 -- 172.21.15.53:0/3897550253 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90c009720 con 0x7fc91c0c9fa0 2023-06-10T19:06:23.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.411+0000 7fc918ff9640 1 -- 172.21.15.53:0/3897550253 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc90c00ca00 con 0x7fc91c0c9fa0 2023-06-10T19:06:23.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.411+0000 7fc92251b640 1 -- 172.21.15.53:0/3897550253 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc914009a70 con 0x7fc91c0c9fa0 2023-06-10T19:06:23.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.411+0000 7fc918ff9640 1 -- 172.21.15.53:0/3897550253 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90c00cd90 con 0x7fc91c0c9fa0 2023-06-10T19:06:23.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.411+0000 7fc92251b640 1 -- 172.21.15.53:0/3897550253 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc91c158a00 con 0x7fc91c0c9fa0 2023-06-10T19:06:23.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.411+0000 7fc92251b640 1 -- 172.21.15.53:0/3897550253 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc91c158c20 con 0x7fc91c0c9fa0 2023-06-10T19:06:23.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.411+0000 7fc918ff9640 1 -- 172.21.15.53:0/3897550253 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc90c013470 con 0x7fc91c0c9fa0 2023-06-10T19:06:23.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.411+0000 7fc918ff9640 1 --2- 172.21.15.53:0/3897550253 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc8fc0662b0 0x7fc8fc068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:23.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.411+0000 7fc918ff9640 1 -- 172.21.15.53:0/3897550253 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fc90c083640 con 0x7fc91c0c9fa0 2023-06-10T19:06:23.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.415+0000 7fc91bfff640 1 --2- 172.21.15.53:0/3897550253 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc8fc0662b0 0x7fc8fc068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:23.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.415+0000 7fc91bfff640 1 --2- 172.21.15.53:0/3897550253 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc8fc0662b0 0x7fc8fc068760 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fc9140af000 tx=0x7fc9140a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:23.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.415+0000 7fc918ff9640 1 -- 172.21.15.53:0/3897550253 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc90c050d60 con 0x7fc91c0c9fa0 2023-06-10T19:06:23.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.571+0000 7fc92251b640 1 -- 172.21.15.53:0/3897550253 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fc91c04d790 con 0x7fc91c0c9fa0 2023-06-10T19:06:23.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.579+0000 7fc918ff9640 1 -- 172.21.15.53:0/3897550253 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v26)=0 v26) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc90c054380 con 0x7fc91c0c9fa0 2023-06-10T19:06:23.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.583+0000 7fc92251b640 1 -- 172.21.15.53:0/3897550253 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc8fc0662b0 msgr2=0x7fc8fc068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:23.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.583+0000 7fc92251b640 1 --2- 172.21.15.53:0/3897550253 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc8fc0662b0 0x7fc8fc068760 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fc9140af000 tx=0x7fc9140a7070 comp rx=0 tx=0).stop 2023-06-10T19:06:23.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.583+0000 7fc92251b640 1 -- 172.21.15.53:0/3897550253 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc91c0c9fa0 msgr2=0x7fc91c153390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:23.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.583+0000 7fc92251b640 1 --2- 172.21.15.53:0/3897550253 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc91c0c9fa0 0x7fc91c153390 secure :-1 s=READY pgs=2165 cs=0 l=1 rev1=1 crypto rx=0x7fc90c00e950 tx=0x7fc90c00ee10 comp rx=0 tx=0).stop 2023-06-10T19:06:23.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.583+0000 7fc92251b640 1 -- 172.21.15.53:0/3897550253 shutdown_connections 2023-06-10T19:06:23.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.583+0000 7fc92251b640 1 --2- 172.21.15.53:0/3897550253 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc8fc0662b0 0x7fc8fc068760 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:23.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.583+0000 7fc92251b640 1 --2- 172.21.15.53:0/3897550253 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc91c0c9fa0 0x7fc91c153390 unknown :-1 s=CLOSED pgs=2165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:23.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.583+0000 7fc92251b640 1 --2- 172.21.15.53:0/3897550253 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc91c0af760 0x7fc91c158f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:23.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.583+0000 7fc92251b640 1 --2- 172.21.15.53:0/3897550253 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc91c06c020 0x7fc91c157a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:23.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.583+0000 7fc92251b640 1 -- 172.21.15.53:0/3897550253 >> 172.21.15.53:0/3897550253 conn(0x7fc91c06a0e0 msgr2=0x7fc91c0b3150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:23.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.583+0000 7fc92251b640 1 -- 172.21.15.53:0/3897550253 shutdown_connections 2023-06-10T19:06:23.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.583+0000 7fc92251b640 1 -- 172.21.15.53:0/3897550253 wait complete. 2023-06-10T19:06:23.601 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-06-10T19:06:23.602 DEBUG:teuthology.orchestra.run.smithi053:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-06-10T19:06:23.644 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-06-10T19:06:23.700 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-06-10T19:06:23.700 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T19:06:23.701 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:06:23.707 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16345192k,nr_inodes=4086298,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276544k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=407 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276540k,nr_inodes=819135,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276544k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-06-10T19:06:23.707 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T19:06:23.708 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:06:23.713 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16342088k,nr_inodes=4085522,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275924k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18845 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275920k,nr_inodes=818980,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275924k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-06-10T19:06:23.714 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T19:06:23.714 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:06:23.755 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16345192k,nr_inodes=4086298,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276544k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=407 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276540k,nr_inodes=819135,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276544k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-06-10T19:06:23.756 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T19:06:23.756 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:06:23.762 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16342088k,nr_inodes=4085522,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275924k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18845 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275920k,nr_inodes=818980,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275924k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-06-10T19:06:23.762 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-06-10T19:06:23.762 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:06:23.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.931+0000 7f033e4a5640 1 Processor -- start 2023-06-10T19:06:23.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.931+0000 7f033e4a5640 1 -- start start 2023-06-10T19:06:23.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.931+0000 7f033e4a5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03380ccae0 0x7f03380d0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:23.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.931+0000 7f033e4a5640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03380d0020 con 0x7f03380b3ac0 2023-06-10T19:06:23.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.931+0000 7f033e4a5640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03380cef40 con 0x7f03380cc690 2023-06-10T19:06:23.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.931+0000 7f033e4a5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03380cf220 con 0x7f03380ccae0 2023-06-10T19:06:23.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.931+0000 7f0337fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f03380b3ac0 0x7f03380b3e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:49554/0 (socket says 172.21.15.53:49554) 2023-06-10T19:06:23.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.931+0000 7f0337fff640 1 -- 172.21.15.53:0/1338975103 learned_addr learned my addr 172.21.15.53:0/1338975103 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:06:23.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.931+0000 7f033ca42640 1 --2- 172.21.15.53:0/1338975103 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03380ccae0 0x7f03380d0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:23.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.931+0000 7f0336ffd640 1 -- 172.21.15.53:0/1338975103 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 229760604 0 0) 0x7f03380d0020 con 0x7f03380b3ac0 2023-06-10T19:06:23.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.931+0000 7f0336ffd640 1 -- 172.21.15.53:0/1338975103 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0324003530 con 0x7f03380b3ac0 2023-06-10T19:06:23.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.931+0000 7f0336ffd640 1 -- 172.21.15.53:0/1338975103 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1614453494 0 0) 0x7f0324003530 con 0x7f03380b3ac0 2023-06-10T19:06:23.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.931+0000 7f0336ffd640 1 -- 172.21.15.53:0/1338975103 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03380ccae0 msgr2=0x7f03380d0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:23.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.931+0000 7f0336ffd640 1 --2- 172.21.15.53:0/1338975103 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03380ccae0 0x7f03380d0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:23.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.931+0000 7f0336ffd640 1 -- 172.21.15.53:0/1338975103 >> v1:172.21.15.117:6789/0 conn(0x7f03380cc690 legacy=0x7f03380d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:23.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.931+0000 7f0336ffd640 1 -- 172.21.15.53:0/1338975103 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03380cf500 con 0x7f03380b3ac0 2023-06-10T19:06:23.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.931+0000 7f0336ffd640 1 -- 172.21.15.53:0/1338975103 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f0320001680 con 0x7f03380b3ac0 2023-06-10T19:06:23.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.931+0000 7f0336ffd640 1 -- 172.21.15.53:0/1338975103 >> v1:172.21.15.53:6789/0 conn(0x7f03380b3ac0 legacy=0x7f03380b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:23.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.931+0000 7f0336ffd640 1 --2- 172.21.15.53:0/1338975103 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03380ccae0 0x7f0324003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:23.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.931+0000 7f0336ffd640 1 --2- 172.21.15.53:0/1338975103 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0324003fa0 0x7f03240047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:23.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.931+0000 7f0336ffd640 1 --2- 172.21.15.53:0/1338975103 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0324004d10 0x7f0324005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:23.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.931+0000 7f0336ffd640 1 -- 172.21.15.53:0/1338975103 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03380cf220 con 0x7f0324004d10 2023-06-10T19:06:23.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.931+0000 7f0336ffd640 1 -- 172.21.15.53:0/1338975103 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f032400bad0 con 0x7f0324003fa0 2023-06-10T19:06:23.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.931+0000 7f0336ffd640 1 -- 172.21.15.53:0/1338975103 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f032400bc90 con 0x7f03380ccae0 2023-06-10T19:06:23.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.931+0000 7f033ca42640 1 --2- 172.21.15.53:0/1338975103 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0324004d10 0x7f0324005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:23.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.931+0000 7f0337fff640 1 --2- 172.21.15.53:0/1338975103 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03380ccae0 0x7f0324003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:23.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.931+0000 7f03377fe640 1 --2- 172.21.15.53:0/1338975103 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0324003fa0 0x7f03240047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:23.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.931+0000 7f033ca42640 1 -- 172.21.15.53:0/1338975103 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03380ccae0 msgr2=0x7f0324003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:23.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.931+0000 7f033ca42640 1 --2- 172.21.15.53:0/1338975103 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f03380ccae0 0x7f0324003a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:23.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.931+0000 7f033ca42640 1 -- 172.21.15.53:0/1338975103 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0324003fa0 msgr2=0x7f03240047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:23.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.931+0000 7f033ca42640 1 --2- 172.21.15.53:0/1338975103 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0324003fa0 0x7f03240047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:23.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.931+0000 7f033ca42640 1 -- 172.21.15.53:0/1338975103 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0324003530 con 0x7f0324004d10 2023-06-10T19:06:23.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.935+0000 7f033ca42640 1 --2- 172.21.15.53:0/1338975103 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0324004d10 0x7f0324005180 secure :-1 s=READY pgs=2167 cs=0 l=1 rev1=1 crypto rx=0x7f0330009fc0 tx=0x7f033001cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d33cfb25442b04b server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:23.944 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.935+0000 7f0336ffd640 1 -- 172.21.15.53:0/1338975103 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03300a5c70 con 0x7f0324004d10 2023-06-10T19:06:23.944 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.935+0000 7f0336ffd640 1 -- 172.21.15.53:0/1338975103 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f033000f040 con 0x7f0324004d10 2023-06-10T19:06:23.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.935+0000 7f0336ffd640 1 -- 172.21.15.53:0/1338975103 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03300ad440 con 0x7f0324004d10 2023-06-10T19:06:23.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.935+0000 7f033e4a5640 1 -- 172.21.15.53:0/1338975103 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0324004d10 msgr2=0x7f0324005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:23.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.935+0000 7f033e4a5640 1 --2- 172.21.15.53:0/1338975103 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0324004d10 0x7f0324005180 secure :-1 s=READY pgs=2167 cs=0 l=1 rev1=1 crypto rx=0x7f0330009fc0 tx=0x7f033001cc60 comp rx=0 tx=0).stop 2023-06-10T19:06:23.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.935+0000 7f033ca42640 1 -- 172.21.15.53:0/1338975103 reap_dead start 2023-06-10T19:06:23.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.935+0000 7f033e4a5640 1 -- 172.21.15.53:0/1338975103 shutdown_connections 2023-06-10T19:06:23.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.935+0000 7f033e4a5640 1 -- 172.21.15.53:0/1338975103 >> 172.21.15.53:0/1338975103 conn(0x7f0338071790 msgr2=0x7f0338069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:23.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.935+0000 7f033e4a5640 1 -- 172.21.15.53:0/1338975103 shutdown_connections 2023-06-10T19:06:23.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.935+0000 7f033e4a5640 1 -- 172.21.15.53:0/1338975103 wait complete. 2023-06-10T19:06:23.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.935+0000 7f033e4a5640 1 Processor -- start 2023-06-10T19:06:23.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.935+0000 7f033e4a5640 1 -- start start 2023-06-10T19:06:23.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.939+0000 7f033e4a5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0324004d10 0x7f03381f17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:23.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.939+0000 7f033e4a5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03380cade0 0x7f03380cb250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:23.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.939+0000 7f033e4a5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03380c6f10 0x7f03380c7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:23.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.939+0000 7f033e4a5640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03380c78c0 con 0x7f03380c6f10 2023-06-10T19:06:23.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.939+0000 7f033e4a5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03380c58a0 con 0x7f03380cade0 2023-06-10T19:06:23.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.939+0000 7f033e4a5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03380c6700 con 0x7f0324004d10 2023-06-10T19:06:23.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.939+0000 7f033ca42640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03380c6f10 0x7f03380c7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:23.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.939+0000 7f033ca42640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03380c6f10 0x7f03380c7380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55274/0 (socket says 172.21.15.53:55274) 2023-06-10T19:06:23.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.939+0000 7f033ca42640 1 -- 172.21.15.53:0/3296319314 learned_addr learned my addr 172.21.15.53:0/3296319314 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:23.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.939+0000 7f03377fe640 1 --2- 172.21.15.53:0/3296319314 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03380cade0 0x7f03380cb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:23.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.939+0000 7f0337fff640 1 --2- 172.21.15.53:0/3296319314 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0324004d10 0x7f03381f17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:23.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.939+0000 7f033ca42640 1 -- 172.21.15.53:0/3296319314 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0324004d10 msgr2=0x7f03381f17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:23.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.939+0000 7f033ca42640 1 --2- 172.21.15.53:0/3296319314 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0324004d10 0x7f03381f17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:23.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.939+0000 7f033ca42640 1 -- 172.21.15.53:0/3296319314 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03380cade0 msgr2=0x7f03380cb250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:23.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.939+0000 7f033ca42640 1 --2- 172.21.15.53:0/3296319314 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03380cade0 0x7f03380cb250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:23.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.939+0000 7f033ca42640 1 -- 172.21.15.53:0/3296319314 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03380c5af0 con 0x7f03380c6f10 2023-06-10T19:06:23.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.939+0000 7f033ca42640 1 --2- 172.21.15.53:0/3296319314 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03380c6f10 0x7f03380c7380 secure :-1 s=READY pgs=2168 cs=0 l=1 rev1=1 crypto rx=0x7f03300b0040 tx=0x7f0330009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:23.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.939+0000 7f0334ff9640 1 -- 172.21.15.53:0/3296319314 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03300bc070 con 0x7f03380c6f10 2023-06-10T19:06:23.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.939+0000 7f0334ff9640 1 -- 172.21.15.53:0/3296319314 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03300039a0 con 0x7f03380c6f10 2023-06-10T19:06:23.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.939+0000 7f033e4a5640 1 -- 172.21.15.53:0/3296319314 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03380c5dd0 con 0x7f03380c6f10 2023-06-10T19:06:23.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.939+0000 7f0334ff9640 1 -- 172.21.15.53:0/3296319314 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0330003b30 con 0x7f03380c6f10 2023-06-10T19:06:23.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.939+0000 7f033e4a5640 1 -- 172.21.15.53:0/3296319314 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03380c6390 con 0x7f03380c6f10 2023-06-10T19:06:23.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.939+0000 7f033e4a5640 1 -- 172.21.15.53:0/3296319314 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03380c6870 con 0x7f03380c6f10 2023-06-10T19:06:23.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.939+0000 7f0334ff9640 1 -- 172.21.15.53:0/3296319314 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f03300b4040 con 0x7f03380c6f10 2023-06-10T19:06:23.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.939+0000 7f0334ff9640 1 --2- 172.21.15.53:0/3296319314 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f03180662b0 0x7f0318068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:23.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.939+0000 7f0334ff9640 1 -- 172.21.15.53:0/3296319314 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f033011dbc0 con 0x7f03380c6f10 2023-06-10T19:06:23.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.939+0000 7f0337fff640 1 --2- 172.21.15.53:0/3296319314 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f03180662b0 0x7f0318068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:23.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.943+0000 7f0337fff640 1 --2- 172.21.15.53:0/3296319314 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f03180662b0 0x7f0318068760 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f0320005a00 tx=0x7f0320009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:23.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:23.943+0000 7f0334ff9640 1 -- 172.21.15.53:0/3296319314 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f03300eb390 con 0x7f03380c6f10 2023-06-10T19:06:24.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:24.131+0000 7f033e4a5640 1 -- 172.21.15.53:0/3296319314 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f033804d790 con 0x7f03380c6f10 2023-06-10T19:06:24.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:24.131+0000 7f0334ff9640 1 -- 172.21.15.53:0/3296319314 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) v1 ==== 94+0+3532 (secure 0 0 0) 0x7f03300b2070 con 0x7f03380c6f10 2023-06-10T19:06:24.132 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:06:24.133 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":83,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8125,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3512570304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3512570304},{"type":"v1","addr":"172.21.15.117:6835","nonce":3512570304}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78},{"gid":8128,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/325110995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":325110995},{"type":"v1","addr":"172.21.15.117:6837","nonce":325110995}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78},{"gid":9759,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/2776844045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":2776844045},{"type":"v1","addr":"172.21.15.53:6833","nonce":2776844045}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78},{"gid":9975,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/2999609356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2999609356},{"type":"v1","addr":"172.21.15.53:6835","nonce":2999609356}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83}],"filesystems":[]} 2023-06-10T19:06:24.133 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 83 2023-06-10T19:06:24.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:24.131+0000 7f033e4a5640 1 -- 172.21.15.53:0/3296319314 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f03180662b0 msgr2=0x7f0318068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:24.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:24.131+0000 7f033e4a5640 1 --2- 172.21.15.53:0/3296319314 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f03180662b0 0x7f0318068760 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f0320005a00 tx=0x7f0320009040 comp rx=0 tx=0).stop 2023-06-10T19:06:24.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:24.131+0000 7f033e4a5640 1 -- 172.21.15.53:0/3296319314 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03380c6f10 msgr2=0x7f03380c7380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:24.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:24.131+0000 7f033e4a5640 1 --2- 172.21.15.53:0/3296319314 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03380c6f10 0x7f03380c7380 secure :-1 s=READY pgs=2168 cs=0 l=1 rev1=1 crypto rx=0x7f03300b0040 tx=0x7f0330009750 comp rx=0 tx=0).stop 2023-06-10T19:06:24.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:24.131+0000 7f033e4a5640 1 -- 172.21.15.53:0/3296319314 shutdown_connections 2023-06-10T19:06:24.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:24.131+0000 7f033e4a5640 1 --2- 172.21.15.53:0/3296319314 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f03180662b0 0x7f0318068760 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:24.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:24.131+0000 7f033e4a5640 1 --2- 172.21.15.53:0/3296319314 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03380c6f10 0x7f03380c7380 unknown :-1 s=CLOSED pgs=2168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:24.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:24.131+0000 7f033e4a5640 1 --2- 172.21.15.53:0/3296319314 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03380cade0 0x7f03380cb250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:24.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:24.131+0000 7f033e4a5640 1 --2- 172.21.15.53:0/3296319314 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0324004d10 0x7f03381f17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:24.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:24.131+0000 7f033e4a5640 1 -- 172.21.15.53:0/3296319314 >> 172.21.15.53:0/3296319314 conn(0x7f0338071790 msgr2=0x7f03380b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:24.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:24.131+0000 7f033e4a5640 1 -- 172.21.15.53:0/3296319314 shutdown_connections 2023-06-10T19:06:24.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:24.131+0000 7f033e4a5640 1 -- 172.21.15.53:0/3296319314 wait complete. 2023-06-10T19:06:24.150 INFO:tasks.ceph.mds.a:Restarting daemon 2023-06-10T19:06:24.150 INFO:tasks.ceph.mds.a:Stopping old one... 2023-06-10T19:06:24.151 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-06-10T19:06:24.151 INFO:teuthology.orchestra.run:waiting for 300 2023-06-10T19:06:24.151 INFO:tasks.ceph.mds.c:Restarting daemon 2023-06-10T19:06:24.151 INFO:tasks.ceph.mds.c:Stopping old one... 2023-06-10T19:06:24.152 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-06-10T19:06:24.153 INFO:teuthology.orchestra.run:waiting for 300 2023-06-10T19:06:24.153 INFO:tasks.ceph.mds.b:Restarting daemon 2023-06-10T19:06:24.154 INFO:tasks.ceph.mds.b:Stopping old one... 2023-06-10T19:06:24.154 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-06-10T19:06:24.154 INFO:teuthology.orchestra.run:waiting for 300 2023-06-10T19:06:24.155 INFO:tasks.ceph.mds.d:Restarting daemon 2023-06-10T19:06:24.155 INFO:tasks.ceph.mds.d:Stopping old one... 2023-06-10T19:06:24.155 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-06-10T19:06:24.155 INFO:teuthology.orchestra.run:waiting for 300 2023-06-10T19:06:24.161 INFO:tasks.ceph.mds.c:Stopped 2023-06-10T19:06:24.161 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-06-10T19:06:24.162 INFO:tasks.ceph.mds.a:Stopped 2023-06-10T19:06:24.162 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-06-10T19:06:24.171 INFO:tasks.ceph.mds.d:Stopped 2023-06-10T19:06:24.172 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-06-10T19:06:24.172 INFO:tasks.ceph.mds.b:Stopped 2023-06-10T19:06:24.173 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-06-10T19:06:24.208 INFO:tasks.ceph.mds.c:Started 2023-06-10T19:06:24.209 INFO:tasks.ceph.mds.a:Started 2023-06-10T19:06:24.209 DEBUG:teuthology.parallel:result is None 2023-06-10T19:06:24.210 DEBUG:teuthology.parallel:result is None 2023-06-10T19:06:24.216 INFO:tasks.ceph.mds.d:Started 2023-06-10T19:06:24.216 DEBUG:teuthology.parallel:result is None 2023-06-10T19:06:24.217 INFO:tasks.ceph.mds.b:Started 2023-06-10T19:06:24.217 DEBUG:teuthology.parallel:result is None 2023-06-10T19:06:24.218 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-06-10T19:06:24.268 INFO:tasks.ceph.mds.c.smithi053.stdout:starting mds.c at 2023-06-10T19:06:24.279 INFO:tasks.ceph.mds.a.smithi053.stdout:starting mds.a at 2023-06-10T19:06:24.286 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2023-06-10T19:06:24.288 INFO:tasks.ceph.mds.d.smithi117.stdout:starting mds.d at 2023-06-10T19:06:24.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:24.339+0000 7fa31b417640 1 Processor -- start 2023-06-10T19:06:24.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:24.339+0000 7fa31b417640 1 -- start start 2023-06-10T19:06:24.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:24.339+0000 7fa31b417640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa314159450 0x7fa31415d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:24.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:24.339+0000 7fa31b417640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa3140cf350 0x7fa3140cbf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:24.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:24.339+0000 7fa31b417640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3140cbac0 con 0x7fa31415d680 2023-06-10T19:06:24.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:24.339+0000 7fa31b417640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa31415dc00 con 0x7fa3140cf350 2023-06-10T19:06:24.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:24.339+0000 7fa31b417640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa31415dee0 con 0x7fa314159450 2023-06-10T19:06:24.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:24.339+0000 7fa3199b4640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa3140cf350 0x7fa3140cbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:24.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:24.339+0000 7fa3199b4640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa3140cf350 0x7fa3140cbf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55334/0 (socket says 172.21.15.53:55334) 2023-06-10T19:06:24.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:24.339+0000 7fa3199b4640 1 -- 172.21.15.53:0/3422698825 learned_addr learned my addr 172.21.15.53:0/3422698825 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:24.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:24.339+0000 7fa3191b3640 1 --2- 172.21.15.53:0/3422698825 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa314159450 0x7fa31415d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:24.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:24.339+0000 7fa3199b4640 1 -- 172.21.15.53:0/3422698825 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa314159450 msgr2=0x7fa31415d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:24.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:24.339+0000 7fa3199b4640 1 --2- 172.21.15.53:0/3422698825 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa314159450 0x7fa31415d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:24.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:24.339+0000 7fa3199b4640 1 -- 172.21.15.53:0/3422698825 >> v1:172.21.15.117:6789/0 conn(0x7fa31415d680 legacy=0x7fa3140cec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:24.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:24.339+0000 7fa3199b4640 1 -- 172.21.15.53:0/3422698825 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3140cb750 con 0x7fa3140cf350 2023-06-10T19:06:24.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:24.339+0000 7fa3199b4640 1 --2- 172.21.15.53:0/3422698825 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3140cf350 0x7fa3140cbf50 secure :-1 s=READY pgs=2177 cs=0 l=1 rev1=1 crypto rx=0x7fa30c009e50 tx=0x7fa30c01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=912531f97d557f0c server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:24.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:24.339+0000 7fa30bfff640 1 -- 172.21.15.53:0/3422698825 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30c0a5780 con 0x7fa3140cf350 2023-06-10T19:06:24.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:24.339+0000 7fa30bfff640 1 -- 172.21.15.53:0/3422698825 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa30c0a58e0 con 0x7fa3140cf350 2023-06-10T19:06:24.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:24.339+0000 7fa30bfff640 1 -- 172.21.15.53:0/3422698825 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30c0a5c70 con 0x7fa3140cf350 2023-06-10T19:06:24.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:24.343+0000 7fa31b417640 1 -- 172.21.15.53:0/3422698825 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3140cf350 msgr2=0x7fa3140cbf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:24.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:24.343+0000 7fa31b417640 1 --2- 172.21.15.53:0/3422698825 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3140cf350 0x7fa3140cbf50 secure :-1 s=READY pgs=2177 cs=0 l=1 rev1=1 crypto rx=0x7fa30c009e50 tx=0x7fa30c01c8e0 comp rx=0 tx=0).stop 2023-06-10T19:06:24.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:24.343+0000 7fa31b417640 1 -- 172.21.15.53:0/3422698825 shutdown_connections 2023-06-10T19:06:24.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:24.343+0000 7fa31b417640 1 --2- 172.21.15.53:0/3422698825 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3140cf350 0x7fa3140cbf50 unknown :-1 s=CLOSED pgs=2177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:24.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:24.343+0000 7fa31b417640 1 --2- 172.21.15.53:0/3422698825 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa314159450 0x7fa31415d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:24.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:24.343+0000 7fa31b417640 1 -- 172.21.15.53:0/3422698825 >> 172.21.15.53:0/3422698825 conn(0x7fa31406a0b0 msgr2=0x7fa31406d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:24.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:24.343+0000 7fa31b417640 1 -- 172.21.15.53:0/3422698825 shutdown_connections 2023-06-10T19:06:24.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:24.343+0000 7fa31b417640 1 -- 172.21.15.53:0/3422698825 wait complete. 2023-06-10T19:06:24.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:24.343+0000 7fa31b417640 1 Processor -- start 2023-06-10T19:06:24.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:24.343+0000 7fa31b417640 1 -- start start 2023-06-10T19:06:24.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:24.343+0000 7fa31b417640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3140cf350 0x7fa3140c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:24.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:24.343+0000 7fa31b417640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa314159450 0x7fa314155150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:24.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:24.343+0000 7fa31b417640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa31415d680 0x7fa314155690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:24.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:24.343+0000 7fa31b417640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3141535d0 con 0x7fa314159450 2023-06-10T19:06:24.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:24.343+0000 7fa31b417640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa314150620 con 0x7fa3140cf350 2023-06-10T19:06:24.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:24.343+0000 7fa31b417640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3140c8ad0 con 0x7fa31415d680 2023-06-10T19:06:24.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:24.343+0000 7fa3189b2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa314159450 0x7fa314155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:24.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:24.343+0000 7fa3189b2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa314159450 0x7fa314155150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55350/0 (socket says 172.21.15.53:55350) 2023-06-10T19:06:24.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:24.343+0000 7fa3189b2640 1 -- 172.21.15.53:0/2424569392 learned_addr learned my addr 172.21.15.53:0/2424569392 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:24.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:24.343+0000 7fa3199b4640 1 --2- 172.21.15.53:0/2424569392 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa31415d680 0x7fa314155690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:24.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:24.343+0000 7fa3191b3640 1 --2- 172.21.15.53:0/2424569392 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3140cf350 0x7fa3140c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:24.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:24.343+0000 7fa3189b2640 1 -- 172.21.15.53:0/2424569392 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa31415d680 msgr2=0x7fa314155690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:24.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:24.343+0000 7fa3189b2640 1 --2- 172.21.15.53:0/2424569392 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa31415d680 0x7fa314155690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:24.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:24.343+0000 7fa3189b2640 1 -- 172.21.15.53:0/2424569392 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3140cf350 msgr2=0x7fa3140c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:24.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:24.343+0000 7fa3189b2640 1 --2- 172.21.15.53:0/2424569392 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3140cf350 0x7fa3140c5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:24.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:24.343+0000 7fa3189b2640 1 -- 172.21.15.53:0/2424569392 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa30c009b30 con 0x7fa314159450 2023-06-10T19:06:24.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:24.343+0000 7fa3199b4640 1 --2- 172.21.15.53:0/2424569392 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa31415d680 0x7fa314155690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:06:24.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:24.343+0000 7fa3191b3640 1 --2- 172.21.15.53:0/2424569392 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3140cf350 0x7fa3140c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:06:24.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:24.343+0000 7fa3189b2640 1 --2- 172.21.15.53:0/2424569392 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa314159450 0x7fa314155150 secure :-1 s=READY pgs=2178 cs=0 l=1 rev1=1 crypto rx=0x7fa30400b410 tx=0x7fa30400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:24.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:24.343+0000 7fa309ffb640 1 -- 172.21.15.53:0/2424569392 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa304004020 con 0x7fa314159450 2023-06-10T19:06:24.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:24.343+0000 7fa309ffb640 1 -- 172.21.15.53:0/2424569392 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa304004180 con 0x7fa314159450 2023-06-10T19:06:24.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:24.343+0000 7fa31b417640 1 -- 172.21.15.53:0/2424569392 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa314152c30 con 0x7fa314159450 2023-06-10T19:06:24.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:24.343+0000 7fa309ffb640 1 -- 172.21.15.53:0/2424569392 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa304011630 con 0x7fa314159450 2023-06-10T19:06:24.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:24.343+0000 7fa31b417640 1 -- 172.21.15.53:0/2424569392 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3141531f0 con 0x7fa314159450 2023-06-10T19:06:24.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:24.343+0000 7fa31b417640 1 -- 172.21.15.53:0/2424569392 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa31404d790 con 0x7fa314159450 2023-06-10T19:06:24.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:24.347+0000 7fa309ffb640 1 -- 172.21.15.53:0/2424569392 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa304011790 con 0x7fa314159450 2023-06-10T19:06:24.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:24.347+0000 7fa309ffb640 1 --2- 172.21.15.53:0/2424569392 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa2f8066280 0x7fa2f8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:24.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:24.347+0000 7fa309ffb640 1 -- 172.21.15.53:0/2424569392 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fa3040837b0 con 0x7fa314159450 2023-06-10T19:06:24.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:24.347+0000 7fa3191b3640 1 --2- 172.21.15.53:0/2424569392 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa2f8066280 0x7fa2f8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:24.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:24.347+0000 7fa3191b3640 1 --2- 172.21.15.53:0/2424569392 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa2f8066280 0x7fa2f8068730 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fa310007a70 tx=0x7fa310008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:24.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:24.351+0000 7fa309ffb640 1 -- 172.21.15.53:0/2424569392 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa304050f60 con 0x7fa314159450 2023-06-10T19:06:24.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:24.511+0000 7fa31b417640 1 -- 172.21.15.53:0/2424569392 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fa31406df70 con 0x7fa314159450 2023-06-10T19:06:25.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.326+0000 7fa309ffb640 1 -- 172.21.15.53:0/2424569392 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v150) v1 ==== 97+0+0 (secure 0 0 0) 0x7fa304054580 con 0x7fa314159450 2023-06-10T19:06:25.328 INFO:teuthology.orchestra.run.smithi053.stderr: removed all blocklist entries 2023-06-10T19:06:25.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.326+0000 7fa31b417640 1 -- 172.21.15.53:0/2424569392 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa2f8066280 msgr2=0x7fa2f8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:25.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.326+0000 7fa31b417640 1 --2- 172.21.15.53:0/2424569392 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa2f8066280 0x7fa2f8068730 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fa310007a70 tx=0x7fa310008040 comp rx=0 tx=0).stop 2023-06-10T19:06:25.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.326+0000 7fa31b417640 1 -- 172.21.15.53:0/2424569392 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa314159450 msgr2=0x7fa314155150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:25.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.326+0000 7fa31b417640 1 --2- 172.21.15.53:0/2424569392 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa314159450 0x7fa314155150 secure :-1 s=READY pgs=2178 cs=0 l=1 rev1=1 crypto rx=0x7fa30400b410 tx=0x7fa30400b8d0 comp rx=0 tx=0).stop 2023-06-10T19:06:25.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.330+0000 7fa31b417640 1 -- 172.21.15.53:0/2424569392 shutdown_connections 2023-06-10T19:06:25.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.330+0000 7fa31b417640 1 --2- 172.21.15.53:0/2424569392 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa2f8066280 0x7fa2f8068730 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:25.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.330+0000 7fa31b417640 1 --2- 172.21.15.53:0/2424569392 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa31415d680 0x7fa314155690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:25.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.330+0000 7fa31b417640 1 --2- 172.21.15.53:0/2424569392 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa314159450 0x7fa314155150 unknown :-1 s=CLOSED pgs=2178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:25.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.330+0000 7fa31b417640 1 --2- 172.21.15.53:0/2424569392 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3140cf350 0x7fa3140c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:25.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.330+0000 7fa31b417640 1 -- 172.21.15.53:0/2424569392 >> 172.21.15.53:0/2424569392 conn(0x7fa31406a0b0 msgr2=0x7fa3140b2db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:25.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.330+0000 7fa31b417640 1 -- 172.21.15.53:0/2424569392 shutdown_connections 2023-06-10T19:06:25.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.330+0000 7fa31b417640 1 -- 172.21.15.53:0/2424569392 wait complete. 2023-06-10T19:06:25.352 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-06-10T19:06:25.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.478+0000 7fd073fa0640 1 Processor -- start 2023-06-10T19:06:25.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.482+0000 7fd073fa0640 1 -- start start 2023-06-10T19:06:25.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.482+0000 7fd073fa0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd06c0b3ac0 0x7fd06c0b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:25.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.482+0000 7fd073fa0640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd06c0cc690 0x7fd06c15f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:25.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.482+0000 7fd073fa0640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd06c0ccae0 0x7fd06c15f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:25.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.482+0000 7fd073fa0640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd06c0d0020 con 0x7fd06c0cc690 2023-06-10T19:06:25.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.482+0000 7fd073fa0640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd06c0b43d0 con 0x7fd06c0ccae0 2023-06-10T19:06:25.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.482+0000 7fd073fa0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd06c0cef40 con 0x7fd06c0b3ac0 2023-06-10T19:06:25.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.482+0000 7fd07153b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd06c0cc690 0x7fd06c15f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:25.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.482+0000 7fd07153b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd06c0cc690 0x7fd06c15f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55358/0 (socket says 172.21.15.53:55358) 2023-06-10T19:06:25.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.482+0000 7fd07153b640 1 -- 172.21.15.53:0/4101846458 learned_addr learned my addr 172.21.15.53:0/4101846458 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:25.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.482+0000 7fd07253d640 1 --2- 172.21.15.53:0/4101846458 >> v2:172.21.15.117:3300/0 conn(0x7fd06c0ccae0 0x7fd06c15f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:25.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.482+0000 7fd071d3c640 1 --2- 172.21.15.53:0/4101846458 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd06c0b3ac0 0x7fd06c0b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:25.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.482+0000 7fd07153b640 1 -- 172.21.15.53:0/4101846458 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd06c0b3ac0 msgr2=0x7fd06c0b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:25.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.482+0000 7fd07153b640 1 --2- 172.21.15.53:0/4101846458 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd06c0b3ac0 0x7fd06c0b3e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:25.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.482+0000 7fd07153b640 1 -- 172.21.15.53:0/4101846458 >> v2:172.21.15.117:3300/0 conn(0x7fd06c0ccae0 msgr2=0x7fd06c15f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:25.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.482+0000 7fd07153b640 1 --2- 172.21.15.53:0/4101846458 >> v2:172.21.15.117:3300/0 conn(0x7fd06c0ccae0 0x7fd06c15f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:25.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.482+0000 7fd07153b640 1 -- 172.21.15.53:0/4101846458 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd06c0cf220 con 0x7fd06c0cc690 2023-06-10T19:06:25.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.482+0000 7fd07153b640 1 --2- 172.21.15.53:0/4101846458 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd06c0cc690 0x7fd06c15f370 secure :-1 s=READY pgs=2179 cs=0 l=1 rev1=1 crypto rx=0x7fd06c0b14a0 tx=0x7fd05c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ac432d702bc0a70 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:25.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.482+0000 7fd070d3a640 1 -- 172.21.15.53:0/4101846458 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05c0ac600 con 0x7fd06c0cc690 2023-06-10T19:06:25.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.482+0000 7fd070d3a640 1 -- 172.21.15.53:0/4101846458 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd05c0a8050 con 0x7fd06c0cc690 2023-06-10T19:06:25.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.482+0000 7fd070d3a640 1 -- 172.21.15.53:0/4101846458 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05c0ac980 con 0x7fd06c0cc690 2023-06-10T19:06:25.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.486+0000 7fd073fa0640 1 -- 172.21.15.53:0/4101846458 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd06c0cc690 msgr2=0x7fd06c15f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:25.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.486+0000 7fd073fa0640 1 --2- 172.21.15.53:0/4101846458 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd06c0cc690 0x7fd06c15f370 secure :-1 s=READY pgs=2179 cs=0 l=1 rev1=1 crypto rx=0x7fd06c0b14a0 tx=0x7fd05c01c4d0 comp rx=0 tx=0).stop 2023-06-10T19:06:25.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.486+0000 7fd073fa0640 1 -- 172.21.15.53:0/4101846458 shutdown_connections 2023-06-10T19:06:25.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.486+0000 7fd073fa0640 1 --2- 172.21.15.53:0/4101846458 >> v2:172.21.15.117:3300/0 conn(0x7fd06c0ccae0 0x7fd06c15f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:25.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.486+0000 7fd073fa0640 1 --2- 172.21.15.53:0/4101846458 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd06c0cc690 0x7fd06c15f370 unknown :-1 s=CLOSED pgs=2179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:25.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.486+0000 7fd073fa0640 1 --2- 172.21.15.53:0/4101846458 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd06c0b3ac0 0x7fd06c0b3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:25.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.486+0000 7fd073fa0640 1 -- 172.21.15.53:0/4101846458 >> 172.21.15.53:0/4101846458 conn(0x7fd06c071790 msgr2=0x7fd06c069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:25.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.486+0000 7fd073fa0640 1 -- 172.21.15.53:0/4101846458 shutdown_connections 2023-06-10T19:06:25.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.486+0000 7fd073fa0640 1 -- 172.21.15.53:0/4101846458 wait complete. 2023-06-10T19:06:25.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.486+0000 7fd073fa0640 1 Processor -- start 2023-06-10T19:06:25.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.486+0000 7fd073fa0640 1 -- start start 2023-06-10T19:06:25.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.486+0000 7fd073fa0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd06c0b3ac0 0x7fd06c152080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:25.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.486+0000 7fd073fa0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd06c0cc690 0x7fd06c15dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:25.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.486+0000 7fd073fa0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd06c0ccae0 0x7fd06c152c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:25.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.486+0000 7fd073fa0640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd06c1550e0 con 0x7fd06c0ccae0 2023-06-10T19:06:25.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.486+0000 7fd073fa0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd06c0cac10 con 0x7fd06c0b3ac0 2023-06-10T19:06:25.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.486+0000 7fd073fa0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd06c0c9f90 con 0x7fd06c0cc690 2023-06-10T19:06:25.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.486+0000 7fd07253d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd06c0ccae0 0x7fd06c152c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:25.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.486+0000 7fd07253d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd06c0ccae0 0x7fd06c152c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55370/0 (socket says 172.21.15.53:55370) 2023-06-10T19:06:25.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.486+0000 7fd07253d640 1 -- 172.21.15.53:0/911353337 learned_addr learned my addr 172.21.15.53:0/911353337 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:25.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.486+0000 7fd07153b640 1 --2- 172.21.15.53:0/911353337 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd06c0cc690 0x7fd06c15dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:25.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.486+0000 7fd071d3c640 1 --2- 172.21.15.53:0/911353337 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd06c0b3ac0 0x7fd06c152080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:25.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.486+0000 7fd07253d640 1 -- 172.21.15.53:0/911353337 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd06c0cc690 msgr2=0x7fd06c15dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:25.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.486+0000 7fd07253d640 1 --2- 172.21.15.53:0/911353337 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd06c0cc690 0x7fd06c15dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:25.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.486+0000 7fd07253d640 1 -- 172.21.15.53:0/911353337 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd06c0b3ac0 msgr2=0x7fd06c152080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:25.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.486+0000 7fd07253d640 1 --2- 172.21.15.53:0/911353337 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd06c0b3ac0 0x7fd06c152080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:25.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.486+0000 7fd07253d640 1 -- 172.21.15.53:0/911353337 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd05c0094d0 con 0x7fd06c0ccae0 2023-06-10T19:06:25.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.486+0000 7fd07253d640 1 --2- 172.21.15.53:0/911353337 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd06c0ccae0 0x7fd06c152c00 secure :-1 s=READY pgs=2180 cs=0 l=1 rev1=1 crypto rx=0x7fd06400cc30 tx=0x7fd06400a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:25.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.486+0000 7fd0627fc640 1 -- 172.21.15.53:0/911353337 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd06400ce40 con 0x7fd06c0ccae0 2023-06-10T19:06:25.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.486+0000 7fd0627fc640 1 -- 172.21.15.53:0/911353337 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0640039a0 con 0x7fd06c0ccae0 2023-06-10T19:06:25.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.486+0000 7fd073fa0640 1 -- 172.21.15.53:0/911353337 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd06c0ca270 con 0x7fd06c0ccae0 2023-06-10T19:06:25.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.486+0000 7fd0627fc640 1 -- 172.21.15.53:0/911353337 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd064003d30 con 0x7fd06c0ccae0 2023-06-10T19:06:25.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.486+0000 7fd073fa0640 1 -- 172.21.15.53:0/911353337 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd06c0ca830 con 0x7fd06c0ccae0 2023-06-10T19:06:25.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.490+0000 7fd073fa0640 1 -- 172.21.15.53:0/911353337 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd06c0cad50 con 0x7fd06c0ccae0 2023-06-10T19:06:25.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.490+0000 7fd0627fc640 1 -- 172.21.15.53:0/911353337 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd064003e90 con 0x7fd06c0ccae0 2023-06-10T19:06:25.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.490+0000 7fd0627fc640 1 --2- 172.21.15.53:0/911353337 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd0500662b0 0x7fd050068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:25.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.490+0000 7fd0627fc640 1 -- 172.21.15.53:0/911353337 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fd064083d00 con 0x7fd06c0ccae0 2023-06-10T19:06:25.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.490+0000 7fd071d3c640 1 --2- 172.21.15.53:0/911353337 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd0500662b0 0x7fd050068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:25.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.490+0000 7fd071d3c640 1 --2- 172.21.15.53:0/911353337 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd0500662b0 0x7fd050068760 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fd068006fd0 tx=0x7fd068008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:25.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.494+0000 7fd0627fc640 1 -- 172.21.15.53:0/911353337 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd064051560 con 0x7fd06c0ccae0 2023-06-10T19:06:25.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.702+0000 7fd073fa0640 1 -- 172.21.15.53:0/911353337 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fd06c04d790 con 0x7fd06c0ccae0 2023-06-10T19:06:25.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.702+0000 7fd0627fc640 1 -- 172.21.15.53:0/911353337 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v20) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fd06401d090 con 0x7fd06c0ccae0 2023-06-10T19:06:25.705 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:06:25.705 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-06-10T19:06:25.706 INFO:teuthology.orchestra.run.smithi053.stdout: "auth_dump": [ 2023-06-10T19:06:25.706 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:06:25.706 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.a", 2023-06-10T19:06:25.706 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkWqEQBhAAW+iEw0Gxfw744rsYc/tfTQ==", 2023-06-10T19:06:25.706 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:06:25.706 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T19:06:25.706 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2023-06-10T19:06:25.706 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2023-06-10T19:06:25.707 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:06:25.707 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:06:25.707 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:06:25.707 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:06:25.707 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.b", 2023-06-10T19:06:25.707 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkSu02FRAAFpo6NpcwDLZUt2Rgk/wm8w==", 2023-06-10T19:06:25.707 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:06:25.708 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T19:06:25.708 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2023-06-10T19:06:25.708 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2023-06-10T19:06:25.708 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:06:25.708 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:06:25.708 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:06:25.708 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:06:25.708 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.c", 2023-06-10T19:06:25.709 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRk19/ODhAAodfGGNLP7UbNhHySgaukrg==", 2023-06-10T19:06:25.709 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:06:25.709 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T19:06:25.709 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2023-06-10T19:06:25.709 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2023-06-10T19:06:25.709 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:06:25.709 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:06:25.710 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:06:25.710 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:06:25.710 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.d", 2023-06-10T19:06:25.710 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkogwkGxAAIavVKa8GtML1XQDEMwwokQ==", 2023-06-10T19:06:25.710 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:06:25.710 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T19:06:25.710 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2023-06-10T19:06:25.710 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2023-06-10T19:06:25.711 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:06:25.711 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:06:25.711 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:06:25.711 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:06:25.711 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.0", 2023-06-10T19:06:25.711 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA7xoRkoj1OMhAAYFc4W5kAlMBqY2yzeJZXQw==", 2023-06-10T19:06:25.711 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:06:25.711 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T19:06:25.712 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T19:06:25.712 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:06:25.712 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:06:25.712 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:06:25.712 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:06:25.712 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.1", 2023-06-10T19:06:25.712 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA+xoRk6FpDOBAALjxW3eaIh3Gu9b1rmMmqfw==", 2023-06-10T19:06:25.712 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:06:25.713 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T19:06:25.713 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T19:06:25.713 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:06:25.713 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:06:25.713 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:06:25.713 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:06:25.713 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.2", 2023-06-10T19:06:25.714 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBCxoRkaO2GBRAA0Xr5en+n5DxhZDg8kVswpQ==", 2023-06-10T19:06:25.714 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:06:25.714 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T19:06:25.714 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T19:06:25.714 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:06:25.714 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:06:25.714 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:06:25.714 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:06:25.715 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.3", 2023-06-10T19:06:25.715 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBFxoRkjfsBDhAAArYYrPnmXu5VcUMGVjQXZg==", 2023-06-10T19:06:25.715 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:06:25.715 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T19:06:25.715 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T19:06:25.715 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:06:25.715 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:06:25.715 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:06:25.716 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:06:25.716 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.4", 2023-06-10T19:06:25.716 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBLxoRkybumChAAdym/nl9bzyI71flvuy9Vtw==", 2023-06-10T19:06:25.716 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:06:25.716 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T19:06:25.716 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T19:06:25.716 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:06:25.716 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:06:25.717 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:06:25.717 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:06:25.717 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.5", 2023-06-10T19:06:25.717 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBOxoRkinSGIRAAwLbgYKI4NsbHKqGo9O4WuQ==", 2023-06-10T19:06:25.717 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:06:25.717 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T19:06:25.717 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T19:06:25.718 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:06:25.718 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:06:25.718 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:06:25.718 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:06:25.718 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.6", 2023-06-10T19:06:25.718 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBRxoRkj7VlKRAAs2ReBZ5iqtr17Nli9kUtGQ==", 2023-06-10T19:06:25.718 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:06:25.718 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T19:06:25.719 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T19:06:25.719 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:06:25.719 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:06:25.719 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:06:25.719 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:06:25.719 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.7", 2023-06-10T19:06:25.719 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBUxoRk48CnMhAASfbeuCo9jDuHQrYDQ8Vt3A==", 2023-06-10T19:06:25.719 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:06:25.720 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T19:06:25.720 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T19:06:25.720 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:06:25.720 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:06:25.720 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:06:25.720 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:06:25.720 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.0", 2023-06-10T19:06:25.721 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkgey1IBAAkNYrXMgUOnavBY/5uGyFrw==", 2023-06-10T19:06:25.721 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:06:25.721 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T19:06:25.721 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow r", 2023-06-10T19:06:25.721 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-06-10T19:06:25.721 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:06:25.721 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:06:25.721 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:06:25.722 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.1", 2023-06-10T19:06:25.722 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkBw+UKBAAuvT+vXmJLG5CvQVg5xItDQ==", 2023-06-10T19:06:25.722 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:06:25.722 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T19:06:25.722 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow r", 2023-06-10T19:06:25.722 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow rw", 2023-06-10T19:06:25.722 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rwx" 2023-06-10T19:06:25.722 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:06:25.723 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:06:25.723 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:06:25.723 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.2", 2023-06-10T19:06:25.723 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkewjeJRAA4pmIEVJ3Z7GKQFmA54CZ5Q==", 2023-06-10T19:06:25.723 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:06:25.723 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T19:06:25.723 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow r", 2023-06-10T19:06:25.723 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow rw", 2023-06-10T19:06:25.724 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rwx" 2023-06-10T19:06:25.724 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:06:25.724 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:06:25.724 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:06:25.724 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.3", 2023-06-10T19:06:25.724 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkHwCiLRAAWGt8UoWxGlG1Y1zSPbKUCg==", 2023-06-10T19:06:25.724 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:06:25.725 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T19:06:25.725 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow r", 2023-06-10T19:06:25.725 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow rw", 2023-06-10T19:06:25.725 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rwx" 2023-06-10T19:06:25.725 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:06:25.725 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:06:25.725 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:06:25.725 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.admin", 2023-06-10T19:06:25.726 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA5xoRkIVgrKBAABIxiaOPe9h5ne2y2l50aMg==", 2023-06-10T19:06:25.726 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:06:25.726 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow *", 2023-06-10T19:06:25.726 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2023-06-10T19:06:25.726 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2023-06-10T19:06:25.726 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:06:25.726 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:06:25.726 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:06:25.727 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:06:25.727 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mgr.x", 2023-06-10T19:06:25.727 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkzWG3AhAAh3NFYHAbp4fgn4FZeRRNuw==", 2023-06-10T19:06:25.727 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:06:25.727 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow *", 2023-06-10T19:06:25.727 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile mgr", 2023-06-10T19:06:25.727 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:06:25.727 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:06:25.728 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:06:25.728 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:06:25.728 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mgr.y", 2023-06-10T19:06:25.728 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA5xoRkBriKOxAA6G+T7Yp2rH7XV7z37lvMYQ==", 2023-06-10T19:06:25.728 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:06:25.728 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow *", 2023-06-10T19:06:25.728 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile mgr", 2023-06-10T19:06:25.729 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:06:25.729 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:06:25.729 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:06:25.729 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2023-06-10T19:06:25.729 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-06-10T19:06:25.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.706+0000 7fd073fa0640 1 -- 172.21.15.53:0/911353337 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd0500662b0 msgr2=0x7fd050068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:25.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.706+0000 7fd073fa0640 1 --2- 172.21.15.53:0/911353337 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd0500662b0 0x7fd050068760 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fd068006fd0 tx=0x7fd068008040 comp rx=0 tx=0).stop 2023-06-10T19:06:25.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.706+0000 7fd073fa0640 1 -- 172.21.15.53:0/911353337 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd06c0ccae0 msgr2=0x7fd06c152c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:25.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.706+0000 7fd073fa0640 1 --2- 172.21.15.53:0/911353337 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd06c0ccae0 0x7fd06c152c00 secure :-1 s=READY pgs=2180 cs=0 l=1 rev1=1 crypto rx=0x7fd06400cc30 tx=0x7fd06400a5c0 comp rx=0 tx=0).stop 2023-06-10T19:06:25.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.706+0000 7fd073fa0640 1 -- 172.21.15.53:0/911353337 shutdown_connections 2023-06-10T19:06:25.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.706+0000 7fd073fa0640 1 --2- 172.21.15.53:0/911353337 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd0500662b0 0x7fd050068760 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:25.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.706+0000 7fd073fa0640 1 --2- 172.21.15.53:0/911353337 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd06c0ccae0 0x7fd06c152c00 unknown :-1 s=CLOSED pgs=2180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:25.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.706+0000 7fd073fa0640 1 --2- 172.21.15.53:0/911353337 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd06c0cc690 0x7fd06c15dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:25.732 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.706+0000 7fd073fa0640 1 --2- 172.21.15.53:0/911353337 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd06c0b3ac0 0x7fd06c152080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:25.732 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.706+0000 7fd073fa0640 1 -- 172.21.15.53:0/911353337 >> 172.21.15.53:0/911353337 conn(0x7fd06c071790 msgr2=0x7fd06c0b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:25.732 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.706+0000 7fd073fa0640 1 -- 172.21.15.53:0/911353337 shutdown_connections 2023-06-10T19:06:25.732 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.706+0000 7fd073fa0640 1 -- 172.21.15.53:0/911353337 wait complete. 2023-06-10T19:06:25.733 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:06:25.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.842+0000 7f049f411640 1 Processor -- start 2023-06-10T19:06:25.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.842+0000 7f049f411640 1 -- start start 2023-06-10T19:06:25.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.846+0000 7f049f411640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04980b3ac0 0x7f04980b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:25.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.846+0000 7f049f411640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04980d0020 con 0x7f04980cc690 2023-06-10T19:06:25.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.846+0000 7f049f411640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0498160190 con 0x7f04980d14c0 2023-06-10T19:06:25.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.846+0000 7f049f411640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04980b43d0 con 0x7f04980b3ac0 2023-06-10T19:06:25.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.846+0000 7f049c9ac640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f04980cc690 0x7f049815f370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:49590/0 (socket says 172.21.15.53:49590) 2023-06-10T19:06:25.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.846+0000 7f049c9ac640 1 -- 172.21.15.53:0/3772282097 learned_addr learned my addr 172.21.15.53:0/3772282097 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:06:25.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.846+0000 7f049d1ad640 1 --2- 172.21.15.53:0/3772282097 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04980b3ac0 0x7f04980b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:25.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.846+0000 7f048ffff640 1 -- 172.21.15.53:0/3772282097 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 33801830 0 0) 0x7f04980d0020 con 0x7f04980cc690 2023-06-10T19:06:25.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.846+0000 7f048ffff640 1 -- 172.21.15.53:0/3772282097 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0484003530 con 0x7f04980cc690 2023-06-10T19:06:25.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.846+0000 7f048ffff640 1 -- 172.21.15.53:0/3772282097 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1313163830 0 0) 0x7f0484003530 con 0x7f04980cc690 2023-06-10T19:06:25.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.846+0000 7f048ffff640 1 -- 172.21.15.53:0/3772282097 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04980b3ac0 msgr2=0x7f04980b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:25.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.846+0000 7f048ffff640 1 --2- 172.21.15.53:0/3772282097 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04980b3ac0 0x7f04980b3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:25.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.846+0000 7f048ffff640 1 -- 172.21.15.53:0/3772282097 >> v1:172.21.15.117:6789/0 conn(0x7f04980d14c0 legacy=0x7f049815fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:25.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.846+0000 7f048ffff640 1 -- 172.21.15.53:0/3772282097 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04980cef40 con 0x7f04980cc690 2023-06-10T19:06:25.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.846+0000 7f048ffff640 1 -- 172.21.15.53:0/3772282097 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f0488001680 con 0x7f04980cc690 2023-06-10T19:06:25.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.846+0000 7f048ffff640 1 -- 172.21.15.53:0/3772282097 >> v1:172.21.15.53:6789/0 conn(0x7f04980cc690 legacy=0x7f049815f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:25.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.846+0000 7f048ffff640 1 --2- 172.21.15.53:0/3772282097 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0484003a20 0x7f0484003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:25.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.846+0000 7f048ffff640 1 --2- 172.21.15.53:0/3772282097 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04840047d0 0x7f0484004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:25.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.846+0000 7f048ffff640 1 --2- 172.21.15.53:0/3772282097 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04980b3ac0 0x7f0484005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:25.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.846+0000 7f048ffff640 1 -- 172.21.15.53:0/3772282097 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04980b43d0 con 0x7f0484003a20 2023-06-10T19:06:25.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.846+0000 7f048ffff640 1 -- 172.21.15.53:0/3772282097 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f048400ba70 con 0x7f04840047d0 2023-06-10T19:06:25.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.846+0000 7f048ffff640 1 -- 172.21.15.53:0/3772282097 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f048400bc30 con 0x7f04980b3ac0 2023-06-10T19:06:25.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.846+0000 7f049d1ad640 1 --2- 172.21.15.53:0/3772282097 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0484003a20 0x7f0484003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:25.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.846+0000 7f049d9ae640 1 --2- 172.21.15.53:0/3772282097 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04980b3ac0 0x7f0484005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:25.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.846+0000 7f049c9ac640 1 --2- 172.21.15.53:0/3772282097 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04840047d0 0x7f0484004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:25.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.846+0000 7f049d1ad640 1 -- 172.21.15.53:0/3772282097 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04980b3ac0 msgr2=0x7f0484005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:25.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.846+0000 7f049d1ad640 1 --2- 172.21.15.53:0/3772282097 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04980b3ac0 0x7f0484005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:25.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.846+0000 7f049d1ad640 1 -- 172.21.15.53:0/3772282097 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04840047d0 msgr2=0x7f0484004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:25.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.846+0000 7f049d1ad640 1 --2- 172.21.15.53:0/3772282097 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04840047d0 0x7f0484004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:25.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.846+0000 7f049d1ad640 1 -- 172.21.15.53:0/3772282097 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0484003530 con 0x7f0484003a20 2023-06-10T19:06:25.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.846+0000 7f049d9ae640 1 --2- 172.21.15.53:0/3772282097 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04980b3ac0 0x7f0484005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:06:25.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.850+0000 7f049d1ad640 1 --2- 172.21.15.53:0/3772282097 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0484003a20 0x7f0484003e30 secure :-1 s=READY pgs=2182 cs=0 l=1 rev1=1 crypto rx=0x7f0494009ae0 tx=0x7f049401ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8961dd304a7bd856 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:25.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.850+0000 7f048ffff640 1 -- 172.21.15.53:0/3772282097 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04940a6510 con 0x7f0484003a20 2023-06-10T19:06:25.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.850+0000 7f048ffff640 1 -- 172.21.15.53:0/3772282097 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04940a6670 con 0x7f0484003a20 2023-06-10T19:06:25.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.850+0000 7f048ffff640 1 -- 172.21.15.53:0/3772282097 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04940a6a20 con 0x7f0484003a20 2023-06-10T19:06:25.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.850+0000 7f049f411640 1 -- 172.21.15.53:0/3772282097 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0484003a20 msgr2=0x7f0484003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:25.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.850+0000 7f049f411640 1 --2- 172.21.15.53:0/3772282097 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0484003a20 0x7f0484003e30 secure :-1 s=READY pgs=2182 cs=0 l=1 rev1=1 crypto rx=0x7f0494009ae0 tx=0x7f049401ca20 comp rx=0 tx=0).stop 2023-06-10T19:06:25.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.850+0000 7f049d9ae640 1 -- 172.21.15.53:0/3772282097 reap_dead start 2023-06-10T19:06:25.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.850+0000 7f049f411640 1 -- 172.21.15.53:0/3772282097 shutdown_connections 2023-06-10T19:06:25.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.850+0000 7f049f411640 1 -- 172.21.15.53:0/3772282097 >> 172.21.15.53:0/3772282097 conn(0x7f0498071790 msgr2=0x7f0498069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:25.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.850+0000 7f049f411640 1 -- 172.21.15.53:0/3772282097 shutdown_connections 2023-06-10T19:06:25.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.850+0000 7f049f411640 1 -- 172.21.15.53:0/3772282097 wait complete. 2023-06-10T19:06:25.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.850+0000 7f049f411640 1 Processor -- start 2023-06-10T19:06:25.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.850+0000 7f049f411640 1 -- start start 2023-06-10T19:06:25.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.850+0000 7f049f411640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0498153790 0x7f049815d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:25.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.850+0000 7f049f411640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0498153b60 0x7f049815d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:25.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.850+0000 7f049f411640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0498153fa0 0x7f04980c66b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:25.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.850+0000 7f049f411640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f049815e480 con 0x7f0498153b60 2023-06-10T19:06:25.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.850+0000 7f049f411640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04980cb950 con 0x7f0498153790 2023-06-10T19:06:25.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.850+0000 7f049f411640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f049815c8b0 con 0x7f0498153fa0 2023-06-10T19:06:25.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.850+0000 7f049c9ac640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0498153b60 0x7f049815d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:25.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.850+0000 7f049c9ac640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0498153b60 0x7f049815d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55388/0 (socket says 172.21.15.53:55388) 2023-06-10T19:06:25.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.850+0000 7f049c9ac640 1 -- 172.21.15.53:0/2153028540 learned_addr learned my addr 172.21.15.53:0/2153028540 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:25.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.850+0000 7f049d1ad640 1 --2- 172.21.15.53:0/2153028540 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0498153790 0x7f049815d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:25.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.850+0000 7f049d9ae640 1 --2- 172.21.15.53:0/2153028540 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0498153fa0 0x7f04980c66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:25.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.850+0000 7f049c9ac640 1 -- 172.21.15.53:0/2153028540 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0498153fa0 msgr2=0x7f04980c66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:25.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.850+0000 7f049c9ac640 1 --2- 172.21.15.53:0/2153028540 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0498153fa0 0x7f04980c66b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:25.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.850+0000 7f049c9ac640 1 -- 172.21.15.53:0/2153028540 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0498153790 msgr2=0x7f049815d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:25.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.850+0000 7f049c9ac640 1 --2- 172.21.15.53:0/2153028540 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0498153790 0x7f049815d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:25.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.850+0000 7f049c9ac640 1 -- 172.21.15.53:0/2153028540 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f049815e660 con 0x7f0498153b60 2023-06-10T19:06:25.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.850+0000 7f049d9ae640 1 --2- 172.21.15.53:0/2153028540 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0498153fa0 0x7f04980c66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:06:25.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.850+0000 7f049c9ac640 1 --2- 172.21.15.53:0/2153028540 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0498153b60 0x7f049815d5b0 secure :-1 s=READY pgs=2183 cs=0 l=1 rev1=1 crypto rx=0x7f048800db10 tx=0x7f0488007e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:25.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.854+0000 7f048dffb640 1 -- 172.21.15.53:0/2153028540 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0488001d90 con 0x7f0498153b60 2023-06-10T19:06:25.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.854+0000 7f048dffb640 1 -- 172.21.15.53:0/2153028540 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0488004cc0 con 0x7f0498153b60 2023-06-10T19:06:25.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.854+0000 7f049f411640 1 -- 172.21.15.53:0/2153028540 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f049815e940 con 0x7f0498153b60 2023-06-10T19:06:25.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.854+0000 7f048dffb640 1 -- 172.21.15.53:0/2153028540 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04880072f0 con 0x7f0498153b60 2023-06-10T19:06:25.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.854+0000 7f049f411640 1 -- 172.21.15.53:0/2153028540 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f049815ec20 con 0x7f0498153b60 2023-06-10T19:06:25.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.854+0000 7f049f411640 1 -- 172.21.15.53:0/2153028540 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f049804d790 con 0x7f0498153b60 2023-06-10T19:06:25.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.854+0000 7f048dffb640 1 -- 172.21.15.53:0/2153028540 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0488007450 con 0x7f0498153b60 2023-06-10T19:06:25.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.854+0000 7f048dffb640 1 --2- 172.21.15.53:0/2153028540 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f047c0662b0 0x7f047c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:25.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.854+0000 7f048dffb640 1 -- 172.21.15.53:0/2153028540 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0488083140 con 0x7f0498153b60 2023-06-10T19:06:25.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.854+0000 7f049d1ad640 1 --2- 172.21.15.53:0/2153028540 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f047c0662b0 0x7f047c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:25.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.854+0000 7f049d1ad640 1 --2- 172.21.15.53:0/2153028540 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f047c0662b0 0x7f047c068760 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f04940af000 tx=0x7f0494008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:25.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:25.858+0000 7f048dffb640 1 -- 172.21.15.53:0/2153028540 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f04880545a0 con 0x7f0498153b60 2023-06-10T19:06:26.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.006+0000 7f049f411640 1 -- 172.21.15.53:0/2153028540 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f049815cd20 con 0x7f0498153b60 2023-06-10T19:06:26.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.010+0000 7f048dffb640 1 -- 172.21.15.53:0/2153028540 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v150) v1 ==== 74+0+14637 (secure 0 0 0) 0x7f0488054130 con 0x7f0498153b60 2023-06-10T19:06:26.012 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:06:26.012 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":150,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:06:25.318402+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:06:26.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.010+0000 7f049f411640 1 -- 172.21.15.53:0/2153028540 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f047c0662b0 msgr2=0x7f047c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:26.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.010+0000 7f049f411640 1 --2- 172.21.15.53:0/2153028540 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f047c0662b0 0x7f047c068760 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f04940af000 tx=0x7f0494008040 comp rx=0 tx=0).stop 2023-06-10T19:06:26.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.010+0000 7f049f411640 1 -- 172.21.15.53:0/2153028540 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0498153b60 msgr2=0x7f049815d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:26.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.010+0000 7f049f411640 1 --2- 172.21.15.53:0/2153028540 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0498153b60 0x7f049815d5b0 secure :-1 s=READY pgs=2183 cs=0 l=1 rev1=1 crypto rx=0x7f048800db10 tx=0x7f0488007e40 comp rx=0 tx=0).stop 2023-06-10T19:06:26.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.010+0000 7f049f411640 1 -- 172.21.15.53:0/2153028540 shutdown_connections 2023-06-10T19:06:26.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.010+0000 7f049f411640 1 --2- 172.21.15.53:0/2153028540 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f047c0662b0 0x7f047c068760 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:26.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.010+0000 7f049f411640 1 --2- 172.21.15.53:0/2153028540 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0498153fa0 0x7f04980c66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:26.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.010+0000 7f049f411640 1 --2- 172.21.15.53:0/2153028540 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0498153b60 0x7f049815d5b0 unknown :-1 s=CLOSED pgs=2183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:26.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.010+0000 7f049f411640 1 --2- 172.21.15.53:0/2153028540 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0498153790 0x7f049815d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:26.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.010+0000 7f049f411640 1 -- 172.21.15.53:0/2153028540 >> 172.21.15.53:0/2153028540 conn(0x7f0498071790 msgr2=0x7f04980d0300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:26.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.010+0000 7f049f411640 1 -- 172.21.15.53:0/2153028540 shutdown_connections 2023-06-10T19:06:26.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.010+0000 7f049f411640 1 -- 172.21.15.53:0/2153028540 wait complete. 2023-06-10T19:06:26.031 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-10T18:52:33.633114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-10T18:52:39.171487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-10T19:06:26.032 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-10T19:06:26.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.146+0000 7f157a998640 1 Processor -- start 2023-06-10T19:06:26.150 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.146+0000 7f157a998640 1 -- start start 2023-06-10T19:06:26.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.146+0000 7f157a998640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f157415c060 0x7f15740cc020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:26.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.146+0000 7f157a998640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1574070de0 0x7f157415c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:26.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.150+0000 7f157a998640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15740c8d50 con 0x7f157415c970 2023-06-10T19:06:26.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.150+0000 7f157a998640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15740c9030 con 0x7f157415c060 2023-06-10T19:06:26.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.150+0000 7f157a998640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1574070300 con 0x7f1574070de0 2023-06-10T19:06:26.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.150+0000 7f1578f35640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f157415c970 0x7f157406bd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:49600/0 (socket says 172.21.15.53:49600) 2023-06-10T19:06:26.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.150+0000 7f1578f35640 1 -- 172.21.15.53:0/2427306446 learned_addr learned my addr 172.21.15.53:0/2427306446 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:06:26.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.150+0000 7f1573fff640 1 --2- 172.21.15.53:0/2427306446 >> v2:172.21.15.53:3300/0 conn(0x7f157415c060 0x7f15740cc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:26.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.150+0000 7f15737fe640 1 --2- 172.21.15.53:0/2427306446 >> v2:172.21.15.117:3300/0 conn(0x7f1574070de0 0x7f157415c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:26.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.150+0000 7f1572ffd640 1 -- 172.21.15.53:0/2427306446 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3066721628 0 0) 0x7f15740c8d50 con 0x7f157415c970 2023-06-10T19:06:26.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.150+0000 7f1572ffd640 1 -- 172.21.15.53:0/2427306446 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f155c003530 con 0x7f157415c970 2023-06-10T19:06:26.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.150+0000 7f1573fff640 1 -- 172.21.15.53:0/2427306446 >> v2:172.21.15.117:3300/0 conn(0x7f1574070de0 msgr2=0x7f157415c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:26.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.150+0000 7f1573fff640 1 --2- 172.21.15.53:0/2427306446 >> v2:172.21.15.117:3300/0 conn(0x7f1574070de0 0x7f157415c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:26.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.150+0000 7f1573fff640 1 -- 172.21.15.53:0/2427306446 >> v1:172.21.15.53:6789/0 conn(0x7f157415c970 legacy=0x7f157406bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:26.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.150+0000 7f1573fff640 1 -- 172.21.15.53:0/2427306446 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15740705e0 con 0x7f157415c060 2023-06-10T19:06:26.154 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.150+0000 7f1573fff640 1 --2- 172.21.15.53:0/2427306446 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f157415c060 0x7f15740cc020 secure :-1 s=READY pgs=2185 cs=0 l=1 rev1=1 crypto rx=0x7f1574071450 tx=0x7f156401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dcc3dd2a0ad3836 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:26.154 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.150+0000 7f1572ffd640 1 -- 172.21.15.53:0/2427306446 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15640ab600 con 0x7f157415c060 2023-06-10T19:06:26.154 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.150+0000 7f1572ffd640 1 -- 172.21.15.53:0/2427306446 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15640a7050 con 0x7f157415c060 2023-06-10T19:06:26.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.150+0000 7f1572ffd640 1 -- 172.21.15.53:0/2427306446 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15640ab980 con 0x7f157415c060 2023-06-10T19:06:26.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.150+0000 7f157a998640 1 -- 172.21.15.53:0/2427306446 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f157415c060 msgr2=0x7f15740cc020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:26.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.150+0000 7f157a998640 1 --2- 172.21.15.53:0/2427306446 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f157415c060 0x7f15740cc020 secure :-1 s=READY pgs=2185 cs=0 l=1 rev1=1 crypto rx=0x7f1574071450 tx=0x7f156401c3d0 comp rx=0 tx=0).stop 2023-06-10T19:06:26.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.154+0000 7f157a998640 1 -- 172.21.15.53:0/2427306446 shutdown_connections 2023-06-10T19:06:26.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.154+0000 7f157a998640 1 --2- 172.21.15.53:0/2427306446 >> v2:172.21.15.117:3300/0 conn(0x7f1574070de0 0x7f157415c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:26.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.154+0000 7f157a998640 1 --2- 172.21.15.53:0/2427306446 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f157415c060 0x7f15740cc020 unknown :-1 s=CLOSED pgs=2185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:26.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.154+0000 7f157a998640 1 -- 172.21.15.53:0/2427306446 >> 172.21.15.53:0/2427306446 conn(0x7f157406a0e0 msgr2=0x7f15740cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:26.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.154+0000 7f157a998640 1 -- 172.21.15.53:0/2427306446 shutdown_connections 2023-06-10T19:06:26.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.154+0000 7f157a998640 1 -- 172.21.15.53:0/2427306446 wait complete. 2023-06-10T19:06:26.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.154+0000 7f157a998640 1 Processor -- start 2023-06-10T19:06:26.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.154+0000 7f157a998640 1 -- start start 2023-06-10T19:06:26.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.154+0000 7f157a998640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1574070de0 0x7f1574164cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:26.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.154+0000 7f157a998640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f157415c060 0x7f1574151230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:26.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.154+0000 7f157a998640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f157415c970 0x7f1574154350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:26.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.154+0000 7f157a998640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15740c27d0 con 0x7f157415c970 2023-06-10T19:06:26.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.154+0000 7f157a998640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1574151770 con 0x7f157415c060 2023-06-10T19:06:26.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.154+0000 7f157a998640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15740ac0c0 con 0x7f1574070de0 2023-06-10T19:06:26.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.154+0000 7f1578f35640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f157415c970 0x7f1574154350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:26.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.154+0000 7f1578f35640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f157415c970 0x7f1574154350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55408/0 (socket says 172.21.15.53:55408) 2023-06-10T19:06:26.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.154+0000 7f1578f35640 1 -- 172.21.15.53:0/1134716765 learned_addr learned my addr 172.21.15.53:0/1134716765 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:26.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.154+0000 7f1573fff640 1 --2- 172.21.15.53:0/1134716765 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1574070de0 0x7f1574164cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:26.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.154+0000 7f15737fe640 1 --2- 172.21.15.53:0/1134716765 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f157415c060 0x7f1574151230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:26.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.154+0000 7f1578f35640 1 -- 172.21.15.53:0/1134716765 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1574070de0 msgr2=0x7f1574164cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:26.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.154+0000 7f1578f35640 1 --2- 172.21.15.53:0/1134716765 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1574070de0 0x7f1574164cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:26.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.154+0000 7f1578f35640 1 -- 172.21.15.53:0/1134716765 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f157415c060 msgr2=0x7f1574151230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:26.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.154+0000 7f1578f35640 1 --2- 172.21.15.53:0/1134716765 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f157415c060 0x7f1574151230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:26.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.154+0000 7f1578f35640 1 -- 172.21.15.53:0/1134716765 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1564009420 con 0x7f157415c970 2023-06-10T19:06:26.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.154+0000 7f1578f35640 1 --2- 172.21.15.53:0/1134716765 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f157415c970 0x7f1574154350 secure :-1 s=READY pgs=2186 cs=0 l=1 rev1=1 crypto rx=0x7f156c00cad0 tx=0x7f156c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:26.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.154+0000 7f1570ff9640 1 -- 172.21.15.53:0/1134716765 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f156c00ac30 con 0x7f157415c970 2023-06-10T19:06:26.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.154+0000 7f1570ff9640 1 -- 172.21.15.53:0/1134716765 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f156c00ad90 con 0x7f157415c970 2023-06-10T19:06:26.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.154+0000 7f1570ff9640 1 -- 172.21.15.53:0/1134716765 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f156c012620 con 0x7f157415c970 2023-06-10T19:06:26.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.154+0000 7f157a998640 1 -- 172.21.15.53:0/1134716765 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1574158950 con 0x7f157415c970 2023-06-10T19:06:26.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.154+0000 7f157a998640 1 -- 172.21.15.53:0/1134716765 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15740c2cc0 con 0x7f157415c970 2023-06-10T19:06:26.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.158+0000 7f157a998640 1 -- 172.21.15.53:0/1134716765 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f157404d790 con 0x7f157415c970 2023-06-10T19:06:26.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.158+0000 7f1570ff9640 1 -- 172.21.15.53:0/1134716765 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f156c007070 con 0x7f157415c970 2023-06-10T19:06:26.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.158+0000 7f1570ff9640 1 --2- 172.21.15.53:0/1134716765 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1560066280 0x7f1560068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:26.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.158+0000 7f1570ff9640 1 -- 172.21.15.53:0/1134716765 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f156c083900 con 0x7f157415c970 2023-06-10T19:06:26.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.158+0000 7f1573fff640 1 --2- 172.21.15.53:0/1134716765 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1560066280 0x7f1560068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:26.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.158+0000 7f1573fff640 1 --2- 172.21.15.53:0/1134716765 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1560066280 0x7f1560068730 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f15640ad000 tx=0x7f15640a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:26.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.162+0000 7f1570ff9640 1 -- 172.21.15.53:0/1134716765 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f156c051160 con 0x7f157415c970 2023-06-10T19:06:26.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.314+0000 7f157a998640 1 -- 172.21.15.53:0/1134716765 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f15740b3c60 con 0x7f157415c970 2023-06-10T19:06:26.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.314+0000 7f1570ff9640 1 -- 172.21.15.53:0/1134716765 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v150) v1 ==== 93+0+10 (secure 0 0 0) 0x7f156c054780 con 0x7f157415c970 2023-06-10T19:06:26.316 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-06-10T19:06:26.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.314+0000 7f157a998640 1 -- 172.21.15.53:0/1134716765 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1560066280 msgr2=0x7f1560068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:26.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.314+0000 7f157a998640 1 --2- 172.21.15.53:0/1134716765 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1560066280 0x7f1560068730 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f15640ad000 tx=0x7f15640a6000 comp rx=0 tx=0).stop 2023-06-10T19:06:26.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.314+0000 7f157a998640 1 -- 172.21.15.53:0/1134716765 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f157415c970 msgr2=0x7f1574154350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:26.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.314+0000 7f157a998640 1 --2- 172.21.15.53:0/1134716765 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f157415c970 0x7f1574154350 secure :-1 s=READY pgs=2186 cs=0 l=1 rev1=1 crypto rx=0x7f156c00cad0 tx=0x7f156c00cf90 comp rx=0 tx=0).stop 2023-06-10T19:06:26.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.314+0000 7f157a998640 1 -- 172.21.15.53:0/1134716765 shutdown_connections 2023-06-10T19:06:26.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.314+0000 7f157a998640 1 --2- 172.21.15.53:0/1134716765 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1560066280 0x7f1560068730 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:26.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.314+0000 7f157a998640 1 --2- 172.21.15.53:0/1134716765 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f157415c970 0x7f1574154350 unknown :-1 s=CLOSED pgs=2186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:26.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.314+0000 7f157a998640 1 --2- 172.21.15.53:0/1134716765 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f157415c060 0x7f1574151230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:26.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.314+0000 7f157a998640 1 --2- 172.21.15.53:0/1134716765 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1574070de0 0x7f1574164cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:26.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.314+0000 7f157a998640 1 -- 172.21.15.53:0/1134716765 >> 172.21.15.53:0/1134716765 conn(0x7f157406a0e0 msgr2=0x7f15740ca6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:26.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.314+0000 7f157a998640 1 -- 172.21.15.53:0/1134716765 shutdown_connections 2023-06-10T19:06:26.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.314+0000 7f157a998640 1 -- 172.21.15.53:0/1134716765 wait complete. 2023-06-10T19:06:26.333 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-10T19:06:26.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.458+0000 7fd489b8d640 1 Processor -- start 2023-06-10T19:06:26.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.458+0000 7fd489b8d640 1 -- start start 2023-06-10T19:06:26.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.458+0000 7fd489b8d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd48406c400 0x7fd484157fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:26.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.458+0000 7fd489b8d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd4840ccc90 0x7fd4840cd130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:26.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.458+0000 7fd489b8d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd48415c260 con 0x7fd48406c7d0 2023-06-10T19:06:26.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.458+0000 7fd489b8d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd48415cee0 con 0x7fd4840ccc90 2023-06-10T19:06:26.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.458+0000 7fd489b8d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd48415c540 con 0x7fd48406c400 2023-06-10T19:06:26.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.458+0000 7fd483fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd4840ccc90 0x7fd4840cd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:26.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.458+0000 7fd482ffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fd48406c7d0 0x7fd484158520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:49612/0 (socket says 172.21.15.53:49612) 2023-06-10T19:06:26.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.458+0000 7fd482ffd640 1 -- 172.21.15.53:0/1746732807 learned_addr learned my addr 172.21.15.53:0/1746732807 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:06:26.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.458+0000 7fd4837fe640 1 --2- 172.21.15.53:0/1746732807 >> v2:172.21.15.117:3300/0 conn(0x7fd48406c400 0x7fd484157fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:26.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.458+0000 7fd483fff640 1 -- 172.21.15.53:0/1746732807 >> v2:172.21.15.117:3300/0 conn(0x7fd48406c400 msgr2=0x7fd484157fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:26.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.458+0000 7fd483fff640 1 --2- 172.21.15.53:0/1746732807 >> v2:172.21.15.117:3300/0 conn(0x7fd48406c400 0x7fd484157fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:26.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.458+0000 7fd483fff640 1 -- 172.21.15.53:0/1746732807 >> v1:172.21.15.53:6789/0 conn(0x7fd48406c7d0 legacy=0x7fd484158520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:26.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.458+0000 7fd4827fc640 1 -- 172.21.15.53:0/1746732807 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2706991297 0 0) 0x7fd48415c260 con 0x7fd48406c7d0 2023-06-10T19:06:26.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.458+0000 7fd483fff640 1 -- 172.21.15.53:0/1746732807 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd48415c820 con 0x7fd4840ccc90 2023-06-10T19:06:26.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.458+0000 7fd4837fe640 1 --2- 172.21.15.53:0/1746732807 >> v2:172.21.15.117:3300/0 conn(0x7fd48406c400 0x7fd484157fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:06:26.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.462+0000 7fd483fff640 1 --2- 172.21.15.53:0/1746732807 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4840ccc90 0x7fd4840cd130 secure :-1 s=READY pgs=2188 cs=0 l=1 rev1=1 crypto rx=0x7fd4840b1910 tx=0x7fd47c01c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2b30939657c2dad server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:26.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.462+0000 7fd4827fc640 1 -- 172.21.15.53:0/1746732807 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd47c0a5820 con 0x7fd4840ccc90 2023-06-10T19:06:26.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.462+0000 7fd4827fc640 1 -- 172.21.15.53:0/1746732807 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd47c0a5980 con 0x7fd4840ccc90 2023-06-10T19:06:26.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.462+0000 7fd4827fc640 1 -- 172.21.15.53:0/1746732807 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd47c0a5d10 con 0x7fd4840ccc90 2023-06-10T19:06:26.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.462+0000 7fd489b8d640 1 -- 172.21.15.53:0/1746732807 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4840ccc90 msgr2=0x7fd4840cd130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:26.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.462+0000 7fd489b8d640 1 --2- 172.21.15.53:0/1746732807 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4840ccc90 0x7fd4840cd130 secure :-1 s=READY pgs=2188 cs=0 l=1 rev1=1 crypto rx=0x7fd4840b1910 tx=0x7fd47c01c850 comp rx=0 tx=0).stop 2023-06-10T19:06:26.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.462+0000 7fd489b8d640 1 -- 172.21.15.53:0/1746732807 shutdown_connections 2023-06-10T19:06:26.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.462+0000 7fd489b8d640 1 --2- 172.21.15.53:0/1746732807 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4840ccc90 0x7fd4840cd130 unknown :-1 s=CLOSED pgs=2188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:26.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.462+0000 7fd489b8d640 1 --2- 172.21.15.53:0/1746732807 >> v2:172.21.15.117:3300/0 conn(0x7fd48406c400 0x7fd484157fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:26.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.462+0000 7fd489b8d640 1 -- 172.21.15.53:0/1746732807 >> 172.21.15.53:0/1746732807 conn(0x7fd48406a560 msgr2=0x7fd48406a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:26.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.462+0000 7fd489b8d640 1 -- 172.21.15.53:0/1746732807 shutdown_connections 2023-06-10T19:06:26.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.462+0000 7fd489b8d640 1 -- 172.21.15.53:0/1746732807 wait complete. 2023-06-10T19:06:26.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.462+0000 7fd489b8d640 1 Processor -- start 2023-06-10T19:06:26.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.462+0000 7fd489b8d640 1 -- start start 2023-06-10T19:06:26.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.466+0000 7fd489b8d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd48406c400 0x7fd4841581d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:26.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.466+0000 7fd489b8d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd48406c7d0 0x7fd48414e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:26.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.466+0000 7fd489b8d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4840ccc90 0x7fd4841485a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:26.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.466+0000 7fd489b8d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd48414b6f0 con 0x7fd48406c400 2023-06-10T19:06:26.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.466+0000 7fd489b8d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd48414b9d0 con 0x7fd48406c7d0 2023-06-10T19:06:26.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.466+0000 7fd489b8d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd48414bcb0 con 0x7fd4840ccc90 2023-06-10T19:06:26.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.466+0000 7fd4837fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd48406c400 0x7fd4841581d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:26.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.466+0000 7fd4837fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd48406c400 0x7fd4841581d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55426/0 (socket says 172.21.15.53:55426) 2023-06-10T19:06:26.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.466+0000 7fd4837fe640 1 -- 172.21.15.53:0/188527511 learned_addr learned my addr 172.21.15.53:0/188527511 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:26.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.466+0000 7fd483fff640 1 --2- 172.21.15.53:0/188527511 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4840ccc90 0x7fd4841485a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:26.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.466+0000 7fd482ffd640 1 --2- 172.21.15.53:0/188527511 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd48406c7d0 0x7fd48414e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:26.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.466+0000 7fd4837fe640 1 -- 172.21.15.53:0/188527511 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4840ccc90 msgr2=0x7fd4841485a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:26.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.466+0000 7fd4837fe640 1 --2- 172.21.15.53:0/188527511 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4840ccc90 0x7fd4841485a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:26.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.466+0000 7fd4837fe640 1 -- 172.21.15.53:0/188527511 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd48406c7d0 msgr2=0x7fd48414e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:26.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.466+0000 7fd4837fe640 1 --2- 172.21.15.53:0/188527511 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd48406c7d0 0x7fd48414e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:26.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.466+0000 7fd4837fe640 1 -- 172.21.15.53:0/188527511 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd47c009a70 con 0x7fd48406c400 2023-06-10T19:06:26.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.466+0000 7fd482ffd640 1 --2- 172.21.15.53:0/188527511 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd48406c7d0 0x7fd48414e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:06:26.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.466+0000 7fd4837fe640 1 --2- 172.21.15.53:0/188527511 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd48406c400 0x7fd4841581d0 secure :-1 s=READY pgs=2189 cs=0 l=1 rev1=1 crypto rx=0x7fd47400c7c0 tx=0x7fd47400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:26.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.466+0000 7fd46bfff640 1 -- 172.21.15.53:0/188527511 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd474007a30 con 0x7fd48406c400 2023-06-10T19:06:26.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.466+0000 7fd46bfff640 1 -- 172.21.15.53:0/188527511 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd474007b90 con 0x7fd48406c400 2023-06-10T19:06:26.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.466+0000 7fd46bfff640 1 -- 172.21.15.53:0/188527511 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd47400ce70 con 0x7fd48406c400 2023-06-10T19:06:26.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.466+0000 7fd489b8d640 1 -- 172.21.15.53:0/188527511 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd48414bf90 con 0x7fd48406c400 2023-06-10T19:06:26.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.466+0000 7fd489b8d640 1 -- 172.21.15.53:0/188527511 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd48414b330 con 0x7fd48406c400 2023-06-10T19:06:26.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.466+0000 7fd489b8d640 1 -- 172.21.15.53:0/188527511 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd48404d790 con 0x7fd48406c400 2023-06-10T19:06:26.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.466+0000 7fd46bfff640 1 -- 172.21.15.53:0/188527511 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd4740113f0 con 0x7fd48406c400 2023-06-10T19:06:26.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.466+0000 7fd46bfff640 1 --2- 172.21.15.53:0/188527511 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd470066280 0x7fd470068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:26.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.466+0000 7fd46bfff640 1 -- 172.21.15.53:0/188527511 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fd474083e60 con 0x7fd48406c400 2023-06-10T19:06:26.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.470+0000 7fd482ffd640 1 --2- 172.21.15.53:0/188527511 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd470066280 0x7fd470068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:26.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.470+0000 7fd482ffd640 1 --2- 172.21.15.53:0/188527511 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd470066280 0x7fd470068730 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fd4841634b0 tx=0x7fd478009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:26.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.470+0000 7fd46bfff640 1 -- 172.21.15.53:0/188527511 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd4740516c0 con 0x7fd48406c400 2023-06-10T19:06:26.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.622+0000 7fd489b8d640 1 -- 172.21.15.53:0/188527511 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd48415b7e0 con 0x7fd48406c400 2023-06-10T19:06:26.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.622+0000 7fd46bfff640 1 -- 172.21.15.53:0/188527511 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v150) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd474054ce0 con 0x7fd48406c400 2023-06-10T19:06:26.624 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-06-10T19:06:26.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.626+0000 7fd489b8d640 1 -- 172.21.15.53:0/188527511 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd470066280 msgr2=0x7fd470068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:26.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.626+0000 7fd489b8d640 1 --2- 172.21.15.53:0/188527511 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd470066280 0x7fd470068730 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fd4841634b0 tx=0x7fd478009040 comp rx=0 tx=0).stop 2023-06-10T19:06:26.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.626+0000 7fd489b8d640 1 -- 172.21.15.53:0/188527511 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd48406c400 msgr2=0x7fd4841581d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:26.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.626+0000 7fd489b8d640 1 --2- 172.21.15.53:0/188527511 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd48406c400 0x7fd4841581d0 secure :-1 s=READY pgs=2189 cs=0 l=1 rev1=1 crypto rx=0x7fd47400c7c0 tx=0x7fd47400cc80 comp rx=0 tx=0).stop 2023-06-10T19:06:26.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.626+0000 7fd489b8d640 1 -- 172.21.15.53:0/188527511 shutdown_connections 2023-06-10T19:06:26.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.626+0000 7fd489b8d640 1 --2- 172.21.15.53:0/188527511 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd470066280 0x7fd470068730 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:26.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.626+0000 7fd489b8d640 1 --2- 172.21.15.53:0/188527511 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4840ccc90 0x7fd4841485a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:26.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.626+0000 7fd489b8d640 1 --2- 172.21.15.53:0/188527511 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd48406c7d0 0x7fd48414e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:26.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.626+0000 7fd489b8d640 1 --2- 172.21.15.53:0/188527511 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd48406c400 0x7fd4841581d0 unknown :-1 s=CLOSED pgs=2189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:26.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.626+0000 7fd489b8d640 1 -- 172.21.15.53:0/188527511 >> 172.21.15.53:0/188527511 conn(0x7fd48406a560 msgr2=0x7fd4840c2950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:26.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.626+0000 7fd489b8d640 1 -- 172.21.15.53:0/188527511 shutdown_connections 2023-06-10T19:06:26.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.626+0000 7fd489b8d640 1 -- 172.21.15.53:0/188527511 wait complete. 2023-06-10T19:06:26.643 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-06-10T19:06:26.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.758+0000 7f3fb0963640 1 Processor -- start 2023-06-10T19:06:26.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.758+0000 7f3fb0963640 1 -- start start 2023-06-10T19:06:26.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.758+0000 7f3fb0963640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3fac071060 0x7f3fac0af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:26.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.758+0000 7f3fb0963640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3fac0afc60 0x7f3fac06b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:26.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.758+0000 7f3fb0963640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fac159b50 con 0x7f3fac0c9840 2023-06-10T19:06:26.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.758+0000 7f3fb0963640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fac0702a0 con 0x7f3fac071060 2023-06-10T19:06:26.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.758+0000 7f3fb0963640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fac070580 con 0x7f3fac0afc60 2023-06-10T19:06:26.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.758+0000 7f3fa9d9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3fac071060 0x7f3fac0af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:26.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.758+0000 7f3fa9d9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3fac071060 0x7f3fac0af720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55428/0 (socket says 172.21.15.53:55428) 2023-06-10T19:06:26.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.758+0000 7f3fa9d9b640 1 -- 172.21.15.53:0/3724849423 learned_addr learned my addr 172.21.15.53:0/3724849423 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:26.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.758+0000 7f3faad9d640 1 --2- 172.21.15.53:0/3724849423 >> v2:172.21.15.117:3300/0 conn(0x7f3fac0afc60 0x7f3fac06b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:26.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.758+0000 7f3fa9d9b640 1 -- 172.21.15.53:0/3724849423 >> v2:172.21.15.117:3300/0 conn(0x7f3fac0afc60 msgr2=0x7f3fac06b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:26.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.758+0000 7f3fa9d9b640 1 --2- 172.21.15.53:0/3724849423 >> v2:172.21.15.117:3300/0 conn(0x7f3fac0afc60 0x7f3fac06b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:26.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.758+0000 7f3fa9d9b640 1 -- 172.21.15.53:0/3724849423 >> v1:172.21.15.117:6789/0 conn(0x7f3fac0c9840 legacy=0x7f3fac0c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:26.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.758+0000 7f3fa9d9b640 1 -- 172.21.15.53:0/3724849423 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fac070860 con 0x7f3fac071060 2023-06-10T19:06:26.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.758+0000 7f3faad9d640 1 --2- 172.21.15.53:0/3724849423 >> v2:172.21.15.117:3300/0 conn(0x7f3fac0afc60 0x7f3fac06b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:06:26.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.762+0000 7f3fa9d9b640 1 --2- 172.21.15.53:0/3724849423 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3fac071060 0x7f3fac0af720 secure :-1 s=READY pgs=2190 cs=0 l=1 rev1=1 crypto rx=0x7f3fac15e360 tx=0x7f3fa001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3717f81931178e6 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:26.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.762+0000 7f3fa959a640 1 -- 172.21.15.53:0/3724849423 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa00aa610 con 0x7f3fac071060 2023-06-10T19:06:26.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.762+0000 7f3fa959a640 1 -- 172.21.15.53:0/3724849423 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fa00a6040 con 0x7f3fac071060 2023-06-10T19:06:26.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.762+0000 7f3fa959a640 1 -- 172.21.15.53:0/3724849423 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa00aa990 con 0x7f3fac071060 2023-06-10T19:06:26.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.762+0000 7f3fb0963640 1 -- 172.21.15.53:0/3724849423 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3fac071060 msgr2=0x7f3fac0af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:26.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.762+0000 7f3fb0963640 1 --2- 172.21.15.53:0/3724849423 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3fac071060 0x7f3fac0af720 secure :-1 s=READY pgs=2190 cs=0 l=1 rev1=1 crypto rx=0x7f3fac15e360 tx=0x7f3fa001c490 comp rx=0 tx=0).stop 2023-06-10T19:06:26.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.762+0000 7f3fb0963640 1 -- 172.21.15.53:0/3724849423 shutdown_connections 2023-06-10T19:06:26.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.762+0000 7f3fb0963640 1 --2- 172.21.15.53:0/3724849423 >> v2:172.21.15.117:3300/0 conn(0x7f3fac0afc60 0x7f3fac06b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:26.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.762+0000 7f3fb0963640 1 --2- 172.21.15.53:0/3724849423 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3fac071060 0x7f3fac0af720 unknown :-1 s=CLOSED pgs=2190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:26.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.762+0000 7f3fb0963640 1 -- 172.21.15.53:0/3724849423 >> 172.21.15.53:0/3724849423 conn(0x7f3fac06a0d0 msgr2=0x7f3fac0ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:26.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.762+0000 7f3fb0963640 1 -- 172.21.15.53:0/3724849423 shutdown_connections 2023-06-10T19:06:26.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.762+0000 7f3fb0963640 1 -- 172.21.15.53:0/3724849423 wait complete. 2023-06-10T19:06:26.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.762+0000 7f3fb0963640 1 Processor -- start 2023-06-10T19:06:26.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.762+0000 7f3fb0963640 1 -- start start 2023-06-10T19:06:26.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.762+0000 7f3fb0963640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3fac071060 0x7f3fac14b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:26.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.762+0000 7f3fb0963640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3fac0afc60 0x7f3fac0c2f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:26.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.762+0000 7f3fb0963640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3fac0c9840 0x7f3fac1528e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:26.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.762+0000 7f3fb0963640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fac14b860 con 0x7f3fac0c9840 2023-06-10T19:06:26.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.762+0000 7f3fb0963640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fac0b0ad0 con 0x7f3fac071060 2023-06-10T19:06:26.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.762+0000 7f3fb0963640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fac0b0d70 con 0x7f3fac0afc60 2023-06-10T19:06:26.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.762+0000 7f3faad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3fac0c9840 0x7f3fac1528e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:26.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.762+0000 7f3faad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3fac0c9840 0x7f3fac1528e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55438/0 (socket says 172.21.15.53:55438) 2023-06-10T19:06:26.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.762+0000 7f3faad9d640 1 -- 172.21.15.53:0/297752642 learned_addr learned my addr 172.21.15.53:0/297752642 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:26.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.762+0000 7f3fa9d9b640 1 --2- 172.21.15.53:0/297752642 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3fac0afc60 0x7f3fac0c2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:26.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.762+0000 7f3faad9d640 1 -- 172.21.15.53:0/297752642 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3fac0afc60 msgr2=0x7f3fac0c2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:26.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.762+0000 7f3faa59c640 1 --2- 172.21.15.53:0/297752642 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3fac071060 0x7f3fac14b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:26.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.762+0000 7f3faad9d640 1 --2- 172.21.15.53:0/297752642 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3fac0afc60 0x7f3fac0c2f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:26.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.762+0000 7f3faad9d640 1 -- 172.21.15.53:0/297752642 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3fac071060 msgr2=0x7f3fac14b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:26.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.762+0000 7f3faad9d640 1 --2- 172.21.15.53:0/297752642 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3fac071060 0x7f3fac14b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:26.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.762+0000 7f3faad9d640 1 -- 172.21.15.53:0/297752642 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fa00094d0 con 0x7f3fac0c9840 2023-06-10T19:06:26.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.762+0000 7f3faad9d640 1 --2- 172.21.15.53:0/297752642 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3fac0c9840 0x7f3fac1528e0 secure :-1 s=READY pgs=2191 cs=0 l=1 rev1=1 crypto rx=0x7f3fa400cef0 tx=0x7f3fa400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:26.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.762+0000 7f3f9affd640 1 -- 172.21.15.53:0/297752642 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa400d840 con 0x7f3fac0c9840 2023-06-10T19:06:26.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.762+0000 7f3f9affd640 1 -- 172.21.15.53:0/297752642 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fa400d9c0 con 0x7f3fac0c9840 2023-06-10T19:06:26.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.762+0000 7f3fb0963640 1 -- 172.21.15.53:0/297752642 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fac0b1050 con 0x7f3fac0c9840 2023-06-10T19:06:26.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.762+0000 7f3f9affd640 1 -- 172.21.15.53:0/297752642 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa400dd70 con 0x7f3fac0c9840 2023-06-10T19:06:26.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.762+0000 7f3fb0963640 1 -- 172.21.15.53:0/297752642 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fac0b1610 con 0x7f3fac0c9840 2023-06-10T19:06:26.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.766+0000 7f3fb0963640 1 -- 172.21.15.53:0/297752642 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fac0b1800 con 0x7f3fac0c9840 2023-06-10T19:06:26.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.766+0000 7f3f9affd640 1 -- 172.21.15.53:0/297752642 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3fa401e3b0 con 0x7f3fac0c9840 2023-06-10T19:06:26.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.766+0000 7f3f9affd640 1 --2- 172.21.15.53:0/297752642 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3f8c066280 0x7f3f8c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:26.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.766+0000 7f3f9affd640 1 -- 172.21.15.53:0/297752642 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f3fa4084520 con 0x7f3fac0c9840 2023-06-10T19:06:26.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.766+0000 7f3faa59c640 1 --2- 172.21.15.53:0/297752642 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3f8c066280 0x7f3f8c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:26.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.766+0000 7f3faa59c640 1 --2- 172.21.15.53:0/297752642 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3f8c066280 0x7f3f8c068730 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c00a750 tx=0x7f3f9c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:26.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.770+0000 7f3f9affd640 1 -- 172.21.15.53:0/297752642 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3fa4051d10 con 0x7f3fac0c9840 2023-06-10T19:06:26.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.926+0000 7f3fb0963640 1 -- 172.21.15.53:0/297752642 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f3fac04d790 con 0x7f3fac0c9840 2023-06-10T19:06:26.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.926+0000 7f3f9affd640 1 -- 172.21.15.53:0/297752642 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v150) v1 ==== 84+0+126 (secure 0 0 0) 0x7f3fa4055330 con 0x7f3fac0c9840 2023-06-10T19:06:26.928 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:06:26.928 INFO:teuthology.orchestra.run.smithi053.stdout:[ 2023-06-10T19:06:26.929 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:06:26.929 INFO:teuthology.orchestra.run.smithi053.stdout: "poolnum": 1, 2023-06-10T19:06:26.929 INFO:teuthology.orchestra.run.smithi053.stdout: "poolname": ".mgr" 2023-06-10T19:06:26.929 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:06:26.929 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:06:26.929 INFO:teuthology.orchestra.run.smithi053.stdout: "poolnum": 2, 2023-06-10T19:06:26.929 INFO:teuthology.orchestra.run.smithi053.stdout: "poolname": "rbd" 2023-06-10T19:06:26.929 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:06:26.930 INFO:teuthology.orchestra.run.smithi053.stdout:] 2023-06-10T19:06:26.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.926+0000 7f3fb0963640 1 -- 172.21.15.53:0/297752642 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3f8c066280 msgr2=0x7f3f8c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:26.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.926+0000 7f3fb0963640 1 --2- 172.21.15.53:0/297752642 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3f8c066280 0x7f3f8c068730 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c00a750 tx=0x7f3f9c008040 comp rx=0 tx=0).stop 2023-06-10T19:06:26.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.926+0000 7f3fb0963640 1 -- 172.21.15.53:0/297752642 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3fac0c9840 msgr2=0x7f3fac1528e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:26.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.926+0000 7f3fb0963640 1 --2- 172.21.15.53:0/297752642 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3fac0c9840 0x7f3fac1528e0 secure :-1 s=READY pgs=2191 cs=0 l=1 rev1=1 crypto rx=0x7f3fa400cef0 tx=0x7f3fa400a710 comp rx=0 tx=0).stop 2023-06-10T19:06:26.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.926+0000 7f3fb0963640 1 -- 172.21.15.53:0/297752642 shutdown_connections 2023-06-10T19:06:26.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.926+0000 7f3fb0963640 1 --2- 172.21.15.53:0/297752642 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3f8c066280 0x7f3f8c068730 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:26.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.926+0000 7f3fb0963640 1 --2- 172.21.15.53:0/297752642 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3fac0c9840 0x7f3fac1528e0 unknown :-1 s=CLOSED pgs=2191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:26.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.926+0000 7f3fb0963640 1 --2- 172.21.15.53:0/297752642 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3fac0afc60 0x7f3fac0c2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:26.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.926+0000 7f3fb0963640 1 --2- 172.21.15.53:0/297752642 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3fac071060 0x7f3fac14b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:26.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.926+0000 7f3fb0963640 1 -- 172.21.15.53:0/297752642 >> 172.21.15.53:0/297752642 conn(0x7f3fac06a0d0 msgr2=0x7f3fac0c9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:26.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.926+0000 7f3fb0963640 1 -- 172.21.15.53:0/297752642 shutdown_connections 2023-06-10T19:06:26.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:26.926+0000 7f3fb0963640 1 -- 172.21.15.53:0/297752642 wait complete. 2023-06-10T19:06:26.947 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-06-10T19:06:26.948 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-06-10T19:06:27.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.070+0000 7fe5a4093640 1 Processor -- start 2023-06-10T19:06:27.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.070+0000 7fe5a4093640 1 -- start start 2023-06-10T19:06:27.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.070+0000 7fe5a4093640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe59c06b840 0x7fe59c0cf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:27.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.070+0000 7fe5a4093640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe59c0cf380 con 0x7fe59c15f370 2023-06-10T19:06:27.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.070+0000 7fe5a4093640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe59c160260 con 0x7fe59c15ba00 2023-06-10T19:06:27.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.070+0000 7fe5a4093640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe59c0ceb40 con 0x7fe59c06b840 2023-06-10T19:06:27.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.070+0000 7fe5a2630640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fe59c15f370 0x7fe59c06a560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:49628/0 (socket says 172.21.15.53:49628) 2023-06-10T19:06:27.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.070+0000 7fe5a2630640 1 -- 172.21.15.53:0/2395150656 learned_addr learned my addr 172.21.15.53:0/2395150656 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:06:27.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.070+0000 7fe5a1e2f640 1 --2- 172.21.15.53:0/2395150656 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe59c06b840 0x7fe59c0cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:27.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.070+0000 7fe5a0e2d640 1 -- 172.21.15.53:0/2395150656 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2622905225 0 0) 0x7fe59c0cf380 con 0x7fe59c15f370 2023-06-10T19:06:27.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.070+0000 7fe5a0e2d640 1 -- 172.21.15.53:0/2395150656 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe588003530 con 0x7fe59c15f370 2023-06-10T19:06:27.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.070+0000 7fe5a0e2d640 1 -- 172.21.15.53:0/2395150656 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 789022039 0 0) 0x7fe588003530 con 0x7fe59c15f370 2023-06-10T19:06:27.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.070+0000 7fe5a0e2d640 1 -- 172.21.15.53:0/2395150656 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe59c06b840 msgr2=0x7fe59c0cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:27.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.070+0000 7fe5a0e2d640 1 --2- 172.21.15.53:0/2395150656 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe59c06b840 0x7fe59c0cf810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:27.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.070+0000 7fe5a0e2d640 1 -- 172.21.15.53:0/2395150656 >> v1:172.21.15.117:6789/0 conn(0x7fe59c15ba00 legacy=0x7fe59c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:27.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.070+0000 7fe5a0e2d640 1 -- 172.21.15.53:0/2395150656 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe59c15ff80 con 0x7fe59c15f370 2023-06-10T19:06:27.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.070+0000 7fe5a0e2d640 1 -- 172.21.15.53:0/2395150656 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fe594001680 con 0x7fe59c15f370 2023-06-10T19:06:27.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.070+0000 7fe5a0e2d640 1 -- 172.21.15.53:0/2395150656 >> v1:172.21.15.53:6789/0 conn(0x7fe59c15f370 legacy=0x7fe59c06a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:27.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.070+0000 7fe5a0e2d640 1 --2- 172.21.15.53:0/2395150656 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5880039b0 0x7fe588003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:27.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.070+0000 7fe5a0e2d640 1 --2- 172.21.15.53:0/2395150656 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe59c06b840 0x7fe5880047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:27.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.070+0000 7fe5a0e2d640 1 --2- 172.21.15.53:0/2395150656 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe588004d10 0x7fe588005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:27.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.070+0000 7fe5a0e2d640 1 -- 172.21.15.53:0/2395150656 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe58800ba40 con 0x7fe588004d10 2023-06-10T19:06:27.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.070+0000 7fe5a0e2d640 1 -- 172.21.15.53:0/2395150656 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe58800bb80 con 0x7fe5880039b0 2023-06-10T19:06:27.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.070+0000 7fe5a0e2d640 1 -- 172.21.15.53:0/2395150656 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe58800bd10 con 0x7fe59c06b840 2023-06-10T19:06:27.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.070+0000 7fe5a2630640 1 --2- 172.21.15.53:0/2395150656 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe588004d10 0x7fe588005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:27.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.070+0000 7fe5a1e2f640 1 --2- 172.21.15.53:0/2395150656 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5880039b0 0x7fe588003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:27.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.070+0000 7fe5a162e640 1 --2- 172.21.15.53:0/2395150656 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe59c06b840 0x7fe5880047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:27.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.070+0000 7fe5a2630640 1 -- 172.21.15.53:0/2395150656 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe59c06b840 msgr2=0x7fe5880047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:27.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.070+0000 7fe5a2630640 1 --2- 172.21.15.53:0/2395150656 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe59c06b840 0x7fe5880047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:27.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.070+0000 7fe5a2630640 1 -- 172.21.15.53:0/2395150656 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5880039b0 msgr2=0x7fe588003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:27.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.070+0000 7fe5a2630640 1 --2- 172.21.15.53:0/2395150656 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5880039b0 0x7fe588003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:27.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.070+0000 7fe5a2630640 1 -- 172.21.15.53:0/2395150656 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe588003530 con 0x7fe588004d10 2023-06-10T19:06:27.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.070+0000 7fe5a162e640 1 --2- 172.21.15.53:0/2395150656 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe59c06b840 0x7fe5880047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:06:27.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.074+0000 7fe5a2630640 1 --2- 172.21.15.53:0/2395150656 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe588004d10 0x7fe588005180 secure :-1 s=READY pgs=2193 cs=0 l=1 rev1=1 crypto rx=0x7fe59400c240 tx=0x7fe59401cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=792f0126155b6d server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:27.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.074+0000 7fe5a0e2d640 1 -- 172.21.15.53:0/2395150656 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5940a5b40 con 0x7fe588004d10 2023-06-10T19:06:27.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.074+0000 7fe5a0e2d640 1 -- 172.21.15.53:0/2395150656 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5940a5ca0 con 0x7fe588004d10 2023-06-10T19:06:27.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.074+0000 7fe5a0e2d640 1 -- 172.21.15.53:0/2395150656 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe594005b20 con 0x7fe588004d10 2023-06-10T19:06:27.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.074+0000 7fe5a4093640 1 -- 172.21.15.53:0/2395150656 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe588004d10 msgr2=0x7fe588005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:27.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.074+0000 7fe5a4093640 1 --2- 172.21.15.53:0/2395150656 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe588004d10 0x7fe588005180 secure :-1 s=READY pgs=2193 cs=0 l=1 rev1=1 crypto rx=0x7fe59400c240 tx=0x7fe59401cc40 comp rx=0 tx=0).stop 2023-06-10T19:06:27.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.074+0000 7fe5a2630640 1 -- 172.21.15.53:0/2395150656 reap_dead start 2023-06-10T19:06:27.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.074+0000 7fe5a4093640 1 -- 172.21.15.53:0/2395150656 shutdown_connections 2023-06-10T19:06:27.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.074+0000 7fe5a4093640 1 -- 172.21.15.53:0/2395150656 >> 172.21.15.53:0/2395150656 conn(0x7fe59c06a0b0 msgr2=0x7fe59c06d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:27.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.074+0000 7fe5a4093640 1 -- 172.21.15.53:0/2395150656 shutdown_connections 2023-06-10T19:06:27.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.074+0000 7fe5a4093640 1 -- 172.21.15.53:0/2395150656 wait complete. 2023-06-10T19:06:27.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.074+0000 7fe5a4093640 1 Processor -- start 2023-06-10T19:06:27.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.074+0000 7fe5a4093640 1 -- start start 2023-06-10T19:06:27.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.078+0000 7fe5a4093640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe588004d10 0x7fe59c0b56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:27.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.078+0000 7fe5a4093640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe59c1f4660 0x7fe59c0cb480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:27.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.078+0000 7fe5a4093640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe59c154fc0 0x7fe59c155430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:27.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.078+0000 7fe5a4093640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe59c155970 con 0x7fe59c1f4660 2023-06-10T19:06:27.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.078+0000 7fe5a4093640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe59c1f4bd0 con 0x7fe59c154fc0 2023-06-10T19:06:27.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.078+0000 7fe5a4093640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe59c1f4eb0 con 0x7fe588004d10 2023-06-10T19:06:27.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.078+0000 7fe5a162e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe59c1f4660 0x7fe59c0cb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:27.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.078+0000 7fe5a162e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe59c1f4660 0x7fe59c0cb480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55460/0 (socket says 172.21.15.53:55460) 2023-06-10T19:06:27.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.078+0000 7fe5a162e640 1 -- 172.21.15.53:0/2840316083 learned_addr learned my addr 172.21.15.53:0/2840316083 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:27.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.078+0000 7fe5a1e2f640 1 --2- 172.21.15.53:0/2840316083 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe588004d10 0x7fe59c0b56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:27.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.078+0000 7fe5a2630640 1 --2- 172.21.15.53:0/2840316083 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe59c154fc0 0x7fe59c155430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:27.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.078+0000 7fe5a162e640 1 -- 172.21.15.53:0/2840316083 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe588004d10 msgr2=0x7fe59c0b56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:27.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.078+0000 7fe5a162e640 1 --2- 172.21.15.53:0/2840316083 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe588004d10 0x7fe59c0b56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:27.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.078+0000 7fe5a162e640 1 -- 172.21.15.53:0/2840316083 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe59c154fc0 msgr2=0x7fe59c155430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:27.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.078+0000 7fe5a162e640 1 --2- 172.21.15.53:0/2840316083 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe59c154fc0 0x7fe59c155430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:27.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.078+0000 7fe5a162e640 1 -- 172.21.15.53:0/2840316083 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe59c1f5190 con 0x7fe59c1f4660 2023-06-10T19:06:27.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.078+0000 7fe5a2630640 1 --2- 172.21.15.53:0/2840316083 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe59c154fc0 0x7fe59c155430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:06:27.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.078+0000 7fe5a162e640 1 --2- 172.21.15.53:0/2840316083 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe59c1f4660 0x7fe59c0cb480 secure :-1 s=READY pgs=2194 cs=0 l=1 rev1=1 crypto rx=0x7fe59800dae0 tx=0x7fe5980020d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:27.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.078+0000 7fe58e7fc640 1 -- 172.21.15.53:0/2840316083 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe598016070 con 0x7fe59c1f4660 2023-06-10T19:06:27.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.078+0000 7fe58e7fc640 1 -- 172.21.15.53:0/2840316083 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe598003bb0 con 0x7fe59c1f4660 2023-06-10T19:06:27.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.078+0000 7fe5a4093640 1 -- 172.21.15.53:0/2840316083 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe59c1f5470 con 0x7fe59c1f4660 2023-06-10T19:06:27.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.078+0000 7fe58e7fc640 1 -- 172.21.15.53:0/2840316083 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe598006b60 con 0x7fe59c1f4660 2023-06-10T19:06:27.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.078+0000 7fe5a4093640 1 -- 172.21.15.53:0/2840316083 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe59c0b5be0 con 0x7fe59c1f4660 2023-06-10T19:06:27.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.078+0000 7fe5a4093640 1 -- 172.21.15.53:0/2840316083 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe59c04d790 con 0x7fe59c1f4660 2023-06-10T19:06:27.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.078+0000 7fe58e7fc640 1 -- 172.21.15.53:0/2840316083 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe598006cc0 con 0x7fe59c1f4660 2023-06-10T19:06:27.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.078+0000 7fe58e7fc640 1 --2- 172.21.15.53:0/2840316083 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe580066280 0x7fe580068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:27.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.078+0000 7fe58e7fc640 1 -- 172.21.15.53:0/2840316083 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fe5980835f0 con 0x7fe59c1f4660 2023-06-10T19:06:27.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.082+0000 7fe5a1e2f640 1 --2- 172.21.15.53:0/2840316083 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe580066280 0x7fe580068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:27.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.082+0000 7fe5a1e2f640 1 --2- 172.21.15.53:0/2840316083 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe580066280 0x7fe580068730 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fe590009ae0 tx=0x7fe590008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:27.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.086+0000 7fe58e7fc640 1 -- 172.21.15.53:0/2840316083 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe598050d20 con 0x7fe59c1f4660 2023-06-10T19:06:27.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.234+0000 7fe5a4093640 1 -- 172.21.15.53:0/2840316083 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fe59c06e000 con 0x7fe59c1f4660 2023-06-10T19:06:27.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.326+0000 7fe58e7fc640 1 -- 172.21.15.53:0/2840316083 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v151) v1 ==== 138+0+0 (secure 0 0 0) 0x7fe598054340 con 0x7fe59c1f4660 2023-06-10T19:06:27.329 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_metadata' created 2023-06-10T19:06:27.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.330+0000 7fe5a4093640 1 -- 172.21.15.53:0/2840316083 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe580066280 msgr2=0x7fe580068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:27.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.330+0000 7fe5a4093640 1 --2- 172.21.15.53:0/2840316083 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe580066280 0x7fe580068730 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fe590009ae0 tx=0x7fe590008040 comp rx=0 tx=0).stop 2023-06-10T19:06:27.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.330+0000 7fe5a4093640 1 -- 172.21.15.53:0/2840316083 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe59c1f4660 msgr2=0x7fe59c0cb480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:27.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.330+0000 7fe5a4093640 1 --2- 172.21.15.53:0/2840316083 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe59c1f4660 0x7fe59c0cb480 secure :-1 s=READY pgs=2194 cs=0 l=1 rev1=1 crypto rx=0x7fe59800dae0 tx=0x7fe5980020d0 comp rx=0 tx=0).stop 2023-06-10T19:06:27.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.330+0000 7fe5a4093640 1 -- 172.21.15.53:0/2840316083 shutdown_connections 2023-06-10T19:06:27.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.330+0000 7fe5a4093640 1 --2- 172.21.15.53:0/2840316083 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe580066280 0x7fe580068730 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:27.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.330+0000 7fe5a4093640 1 --2- 172.21.15.53:0/2840316083 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe59c154fc0 0x7fe59c155430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:27.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.330+0000 7fe5a4093640 1 --2- 172.21.15.53:0/2840316083 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe59c1f4660 0x7fe59c0cb480 unknown :-1 s=CLOSED pgs=2194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:27.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.330+0000 7fe5a4093640 1 --2- 172.21.15.53:0/2840316083 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe588004d10 0x7fe59c0b56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:27.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.330+0000 7fe5a4093640 1 -- 172.21.15.53:0/2840316083 >> 172.21.15.53:0/2840316083 conn(0x7fe59c06a0b0 msgr2=0x7fe59c15c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:27.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.330+0000 7fe5a4093640 1 -- 172.21.15.53:0/2840316083 shutdown_connections 2023-06-10T19:06:27.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.330+0000 7fe5a4093640 1 -- 172.21.15.53:0/2840316083 wait complete. 2023-06-10T19:06:27.351 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-06-10T19:06:27.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.478+0000 7f83d2420640 1 Processor -- start 2023-06-10T19:06:27.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.478+0000 7f83d2420640 1 -- start start 2023-06-10T19:06:27.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.478+0000 7f83d2420640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f83cc15c220 0x7f83cc0cce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:27.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.478+0000 7f83d2420640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83cc0b45c0 con 0x7f83cc0b7660 2023-06-10T19:06:27.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.478+0000 7f83d2420640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83cc0b4af0 con 0x7f83cc15be50 2023-06-10T19:06:27.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.478+0000 7f83d2420640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83cc0cfec0 con 0x7f83cc15c220 2023-06-10T19:06:27.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.478+0000 7f83d09bd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f83cc0b7660 0x7f83cc0d0350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:49642/0 (socket says 172.21.15.53:49642) 2023-06-10T19:06:27.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.478+0000 7f83d09bd640 1 -- 172.21.15.53:0/2582819579 learned_addr learned my addr 172.21.15.53:0/2582819579 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:06:27.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.478+0000 7f83cb7fe640 1 --2- 172.21.15.53:0/2582819579 >> v2:172.21.15.53:3300/0 conn(0x7f83cc15c220 0x7f83cc0cce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:27.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.482+0000 7f83cb7fe640 1 -- 172.21.15.53:0/2582819579 >> v1:172.21.15.117:6789/0 conn(0x7f83cc15be50 legacy=0x7f83cc0cc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:27.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.482+0000 7f83cb7fe640 1 -- 172.21.15.53:0/2582819579 >> v1:172.21.15.53:6789/0 conn(0x7f83cc0b7660 legacy=0x7f83cc0d0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:27.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.482+0000 7f83cb7fe640 1 -- 172.21.15.53:0/2582819579 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83cc0b7f00 con 0x7f83cc15c220 2023-06-10T19:06:27.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.482+0000 7f83cb7fe640 1 --2- 172.21.15.53:0/2582819579 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83cc15c220 0x7f83cc0cce90 secure :-1 s=READY pgs=2196 cs=0 l=1 rev1=1 crypto rx=0x7f83b80097c0 tx=0x7f83b801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bb8b02d258aa427 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:27.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.482+0000 7f83caffd640 1 -- 172.21.15.53:0/2582819579 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b80ac640 con 0x7f83cc15c220 2023-06-10T19:06:27.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.482+0000 7f83caffd640 1 -- 172.21.15.53:0/2582819579 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83b80ac7a0 con 0x7f83cc15c220 2023-06-10T19:06:27.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.482+0000 7f83caffd640 1 -- 172.21.15.53:0/2582819579 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b80acb30 con 0x7f83cc15c220 2023-06-10T19:06:27.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.482+0000 7f83d2420640 1 -- 172.21.15.53:0/2582819579 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83cc15c220 msgr2=0x7f83cc0cce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:27.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.482+0000 7f83d2420640 1 --2- 172.21.15.53:0/2582819579 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83cc15c220 0x7f83cc0cce90 secure :-1 s=READY pgs=2196 cs=0 l=1 rev1=1 crypto rx=0x7f83b80097c0 tx=0x7f83b801c3c0 comp rx=0 tx=0).stop 2023-06-10T19:06:27.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.482+0000 7f83d2420640 1 -- 172.21.15.53:0/2582819579 shutdown_connections 2023-06-10T19:06:27.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.482+0000 7f83d2420640 1 --2- 172.21.15.53:0/2582819579 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83cc15c220 0x7f83cc0cce90 unknown :-1 s=CLOSED pgs=2196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:27.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.482+0000 7f83d2420640 1 -- 172.21.15.53:0/2582819579 >> 172.21.15.53:0/2582819579 conn(0x7f83cc06aa30 msgr2=0x7f83cc0cebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:27.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.482+0000 7f83d2420640 1 -- 172.21.15.53:0/2582819579 shutdown_connections 2023-06-10T19:06:27.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.482+0000 7f83d2420640 1 -- 172.21.15.53:0/2582819579 wait complete. 2023-06-10T19:06:27.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.486+0000 7f83d2420640 1 Processor -- start 2023-06-10T19:06:27.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.486+0000 7f83d2420640 1 -- start start 2023-06-10T19:06:27.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.486+0000 7f83d2420640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83cc0b7660 0x7f83cc0c4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:27.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.486+0000 7f83d2420640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83cc15be50 0x7f83cc0b6db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:27.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.486+0000 7f83d2420640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83cc15c220 0x7f83cc0c9200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:27.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.486+0000 7f83d2420640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83cc0c6ce0 con 0x7f83cc0b7660 2023-06-10T19:06:27.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.486+0000 7f83d2420640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83cc15f3d0 con 0x7f83cc15be50 2023-06-10T19:06:27.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.486+0000 7f83d2420640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83cc0c6f30 con 0x7f83cc15c220 2023-06-10T19:06:27.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.486+0000 7f83cbfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83cc0b7660 0x7f83cc0c4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:27.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.486+0000 7f83cbfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83cc0b7660 0x7f83cc0c4d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55476/0 (socket says 172.21.15.53:55476) 2023-06-10T19:06:27.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.486+0000 7f83cbfff640 1 -- 172.21.15.53:0/1658625066 learned_addr learned my addr 172.21.15.53:0/1658625066 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:27.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.486+0000 7f83d09bd640 1 --2- 172.21.15.53:0/1658625066 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83cc15c220 0x7f83cc0c9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:27.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.486+0000 7f83cbfff640 1 -- 172.21.15.53:0/1658625066 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83cc15c220 msgr2=0x7f83cc0c9200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:27.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.486+0000 7f83cb7fe640 1 --2- 172.21.15.53:0/1658625066 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83cc15be50 0x7f83cc0b6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:27.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.486+0000 7f83cbfff640 1 --2- 172.21.15.53:0/1658625066 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83cc15c220 0x7f83cc0c9200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:27.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.486+0000 7f83cbfff640 1 -- 172.21.15.53:0/1658625066 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83cc15be50 msgr2=0x7f83cc0b6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:27.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.486+0000 7f83cbfff640 1 --2- 172.21.15.53:0/1658625066 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83cc15be50 0x7f83cc0b6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:27.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.486+0000 7f83cbfff640 1 -- 172.21.15.53:0/1658625066 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83b8009420 con 0x7f83cc0b7660 2023-06-10T19:06:27.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.486+0000 7f83d09bd640 1 --2- 172.21.15.53:0/1658625066 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83cc15c220 0x7f83cc0c9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:06:27.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.486+0000 7f83cb7fe640 1 --2- 172.21.15.53:0/1658625066 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83cc15be50 0x7f83cc0b6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:06:27.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.486+0000 7f83cbfff640 1 --2- 172.21.15.53:0/1658625066 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83cc0b7660 0x7f83cc0c4d10 secure :-1 s=READY pgs=2197 cs=0 l=1 rev1=1 crypto rx=0x7f83bc00c500 tx=0x7f83bc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:27.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.486+0000 7f83c8ff9640 1 -- 172.21.15.53:0/1658625066 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83bc005220 con 0x7f83cc0b7660 2023-06-10T19:06:27.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.486+0000 7f83c8ff9640 1 -- 172.21.15.53:0/1658625066 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83bc005380 con 0x7f83cc0b7660 2023-06-10T19:06:27.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.486+0000 7f83d2420640 1 -- 172.21.15.53:0/1658625066 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83cc0c7210 con 0x7f83cc0b7660 2023-06-10T19:06:27.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.486+0000 7f83c8ff9640 1 -- 172.21.15.53:0/1658625066 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83bc007270 con 0x7f83cc0b7660 2023-06-10T19:06:27.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.486+0000 7f83d2420640 1 -- 172.21.15.53:0/1658625066 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83cc15f0c0 con 0x7f83cc0b7660 2023-06-10T19:06:27.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.486+0000 7f83d2420640 1 -- 172.21.15.53:0/1658625066 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83cc0c7730 con 0x7f83cc0b7660 2023-06-10T19:06:27.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.486+0000 7f83c8ff9640 1 -- 172.21.15.53:0/1658625066 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f83bc0073d0 con 0x7f83cc0b7660 2023-06-10T19:06:27.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.490+0000 7f83c8ff9640 1 --2- 172.21.15.53:0/1658625066 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f83b40662b0 0x7f83b4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:27.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.490+0000 7f83c8ff9640 1 -- 172.21.15.53:0/1658625066 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f83bc084110 con 0x7f83cc0b7660 2023-06-10T19:06:27.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.490+0000 7f83cb7fe640 1 --2- 172.21.15.53:0/1658625066 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f83b40662b0 0x7f83b4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:27.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.490+0000 7f83cb7fe640 1 --2- 172.21.15.53:0/1658625066 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f83b40662b0 0x7f83b4068760 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f83b80ae000 tx=0x7f83b8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:27.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.494+0000 7f83c8ff9640 1 -- 172.21.15.53:0/1658625066 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f83bc051760 con 0x7f83cc0b7660 2023-06-10T19:06:27.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:27.646+0000 7f83d2420640 1 -- 172.21.15.53:0/1658625066 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f83cc0c7730 con 0x7f83cc0b7660 2023-06-10T19:06:28.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.338+0000 7f83c8ff9640 1 -- 172.21.15.53:0/1658625066 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v152) v1 ==== 170+0+0 (secure 0 0 0) 0x7f83cc0c7730 con 0x7f83cc0b7660 2023-06-10T19:06:28.339 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_data' created 2023-06-10T19:06:28.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.354+0000 7f83d2420640 1 -- 172.21.15.53:0/1658625066 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f83b40662b0 msgr2=0x7f83b4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:28.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.354+0000 7f83d2420640 1 --2- 172.21.15.53:0/1658625066 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f83b40662b0 0x7f83b4068760 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f83b80ae000 tx=0x7f83b8008040 comp rx=0 tx=0).stop 2023-06-10T19:06:28.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.354+0000 7f83d2420640 1 -- 172.21.15.53:0/1658625066 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83cc0b7660 msgr2=0x7f83cc0c4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:28.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.354+0000 7f83d2420640 1 --2- 172.21.15.53:0/1658625066 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83cc0b7660 0x7f83cc0c4d10 secure :-1 s=READY pgs=2197 cs=0 l=1 rev1=1 crypto rx=0x7f83bc00c500 tx=0x7f83bc00c9c0 comp rx=0 tx=0).stop 2023-06-10T19:06:28.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.358+0000 7f83d2420640 1 -- 172.21.15.53:0/1658625066 shutdown_connections 2023-06-10T19:06:28.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.358+0000 7f83d2420640 1 --2- 172.21.15.53:0/1658625066 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f83b40662b0 0x7f83b4068760 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:28.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.358+0000 7f83d2420640 1 --2- 172.21.15.53:0/1658625066 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f83cc15c220 0x7f83cc0c9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:28.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.358+0000 7f83d2420640 1 --2- 172.21.15.53:0/1658625066 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83cc15be50 0x7f83cc0b6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:28.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.358+0000 7f83d2420640 1 --2- 172.21.15.53:0/1658625066 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83cc0b7660 0x7f83cc0c4d10 unknown :-1 s=CLOSED pgs=2197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:28.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.358+0000 7f83d2420640 1 -- 172.21.15.53:0/1658625066 >> 172.21.15.53:0/1658625066 conn(0x7f83cc06aa30 msgr2=0x7f83cc0b2310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:28.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.358+0000 7f83d2420640 1 -- 172.21.15.53:0/1658625066 shutdown_connections 2023-06-10T19:06:28.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.358+0000 7f83d2420640 1 -- 172.21.15.53:0/1658625066 wait complete. 2023-06-10T19:06:28.388 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-06-10T19:06:28.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.514+0000 7f9c112f8640 1 Processor -- start 2023-06-10T19:06:28.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.514+0000 7f9c112f8640 1 -- start start 2023-06-10T19:06:28.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.514+0000 7f9c112f8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9c0c15c090 0x7f9c0c0b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:28.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.514+0000 7f9c112f8640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9c0c0b0b90 0x7f9c0c0b7720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:28.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.514+0000 7f9c112f8640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c0c0b80a0 con 0x7f9c0c0b7c60 2023-06-10T19:06:28.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.514+0000 7f9c112f8640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c0c0cc7c0 con 0x7f9c0c15c090 2023-06-10T19:06:28.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.514+0000 7f9c112f8640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c0c0ccaa0 con 0x7f9c0c0b0b90 2023-06-10T19:06:28.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.514+0000 7f9c0affd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9c0c15c090 0x7f9c0c0b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:28.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.514+0000 7f9c0affd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9c0c15c090 0x7f9c0c0b10c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55488/0 (socket says 172.21.15.53:55488) 2023-06-10T19:06:28.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.514+0000 7f9c0affd640 1 -- 172.21.15.53:0/132296853 learned_addr learned my addr 172.21.15.53:0/132296853 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:28.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.514+0000 7f9c0a7fc640 1 --2- 172.21.15.53:0/132296853 >> v2:172.21.15.117:3300/0 conn(0x7f9c0c0b0b90 0x7f9c0c0b7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:28.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.514+0000 7f9c0affd640 1 -- 172.21.15.53:0/132296853 >> v2:172.21.15.117:3300/0 conn(0x7f9c0c0b0b90 msgr2=0x7f9c0c0b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:28.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.514+0000 7f9c0affd640 1 --2- 172.21.15.53:0/132296853 >> v2:172.21.15.117:3300/0 conn(0x7f9c0c0b0b90 0x7f9c0c0b7720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:28.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.514+0000 7f9c0affd640 1 -- 172.21.15.53:0/132296853 >> v1:172.21.15.117:6789/0 conn(0x7f9c0c0b7c60 legacy=0x7f9c0c0b3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:28.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.514+0000 7f9c0affd640 1 -- 172.21.15.53:0/132296853 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c0c0ccd80 con 0x7f9c0c15c090 2023-06-10T19:06:28.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.518+0000 7f9c0affd640 1 --2- 172.21.15.53:0/132296853 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c0c15c090 0x7f9c0c0b10c0 secure :-1 s=READY pgs=2198 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c0b4c30 tx=0x7f9bfc01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3872b7ff0588ce0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:28.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.518+0000 7f9c09ffb640 1 -- 172.21.15.53:0/132296853 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bfc0ab600 con 0x7f9c0c15c090 2023-06-10T19:06:28.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.518+0000 7f9c09ffb640 1 -- 172.21.15.53:0/132296853 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bfc0a7050 con 0x7f9c0c15c090 2023-06-10T19:06:28.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.518+0000 7f9c09ffb640 1 -- 172.21.15.53:0/132296853 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bfc0ab980 con 0x7f9c0c15c090 2023-06-10T19:06:28.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.518+0000 7f9c112f8640 1 -- 172.21.15.53:0/132296853 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c0c15c090 msgr2=0x7f9c0c0b10c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:28.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.518+0000 7f9c112f8640 1 --2- 172.21.15.53:0/132296853 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c0c15c090 0x7f9c0c0b10c0 secure :-1 s=READY pgs=2198 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c0b4c30 tx=0x7f9bfc01c400 comp rx=0 tx=0).stop 2023-06-10T19:06:28.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.518+0000 7f9c112f8640 1 -- 172.21.15.53:0/132296853 shutdown_connections 2023-06-10T19:06:28.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.518+0000 7f9c112f8640 1 --2- 172.21.15.53:0/132296853 >> v2:172.21.15.117:3300/0 conn(0x7f9c0c0b0b90 0x7f9c0c0b7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:28.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.518+0000 7f9c112f8640 1 --2- 172.21.15.53:0/132296853 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c0c15c090 0x7f9c0c0b10c0 unknown :-1 s=CLOSED pgs=2198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:28.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.518+0000 7f9c112f8640 1 -- 172.21.15.53:0/132296853 >> 172.21.15.53:0/132296853 conn(0x7f9c0c069e20 msgr2=0x7f9c0c06a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:28.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.518+0000 7f9c112f8640 1 -- 172.21.15.53:0/132296853 shutdown_connections 2023-06-10T19:06:28.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.518+0000 7f9c112f8640 1 -- 172.21.15.53:0/132296853 wait complete. 2023-06-10T19:06:28.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.518+0000 7f9c112f8640 1 Processor -- start 2023-06-10T19:06:28.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.518+0000 7f9c112f8640 1 -- start start 2023-06-10T19:06:28.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.518+0000 7f9c112f8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c0c0b0b90 0x7f9c0c0cbbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:28.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.518+0000 7f9c112f8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c0c0b7c60 0x7f9c0c150120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:28.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.518+0000 7f9c112f8640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c0c15c090 0x7f9c0c0d0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:28.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.518+0000 7f9c112f8640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0c0b1af0 con 0x7f9c0c0b0b90 2023-06-10T19:06:28.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.518+0000 7f9c112f8640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0c14e9e0 con 0x7f9c0c0b7c60 2023-06-10T19:06:28.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.518+0000 7f9c112f8640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0c14e700 con 0x7f9c0c15c090 2023-06-10T19:06:28.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.518+0000 7f9c0affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c0c0b0b90 0x7f9c0c0cbbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:28.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.518+0000 7f9c0affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c0c0b0b90 0x7f9c0c0cbbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55492/0 (socket says 172.21.15.53:55492) 2023-06-10T19:06:28.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.518+0000 7f9c0affd640 1 -- 172.21.15.53:0/3180098211 learned_addr learned my addr 172.21.15.53:0/3180098211 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:28.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.518+0000 7f9c0b7fe640 1 --2- 172.21.15.53:0/3180098211 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c0c15c090 0x7f9c0c0d0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:28.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.518+0000 7f9c0a7fc640 1 --2- 172.21.15.53:0/3180098211 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c0c0b7c60 0x7f9c0c150120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:28.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.522+0000 7f9c0affd640 1 -- 172.21.15.53:0/3180098211 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c0c15c090 msgr2=0x7f9c0c0d0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:28.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.522+0000 7f9c0affd640 1 --2- 172.21.15.53:0/3180098211 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c0c15c090 0x7f9c0c0d0730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:28.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.522+0000 7f9c0affd640 1 -- 172.21.15.53:0/3180098211 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c0c0b7c60 msgr2=0x7f9c0c150120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:28.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.522+0000 7f9c0affd640 1 --2- 172.21.15.53:0/3180098211 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c0c0b7c60 0x7f9c0c150120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:28.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.522+0000 7f9c0affd640 1 -- 172.21.15.53:0/3180098211 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bfc0094d0 con 0x7f9c0c0b0b90 2023-06-10T19:06:28.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.522+0000 7f9c0a7fc640 1 --2- 172.21.15.53:0/3180098211 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c0c0b7c60 0x7f9c0c150120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:06:28.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.522+0000 7f9c0affd640 1 --2- 172.21.15.53:0/3180098211 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c0c0b0b90 0x7f9c0c0cbbe0 secure :-1 s=READY pgs=2199 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc0ae040 tx=0x7f9bfc01ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:28.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.522+0000 7f9c037fe640 1 -- 172.21.15.53:0/3180098211 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bfc0b6620 con 0x7f9c0c0b0b90 2023-06-10T19:06:28.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.522+0000 7f9c037fe640 1 -- 172.21.15.53:0/3180098211 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bfc0b67a0 con 0x7f9c0c0b0b90 2023-06-10T19:06:28.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.522+0000 7f9c037fe640 1 -- 172.21.15.53:0/3180098211 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bfc0b6b50 con 0x7f9c0c0b0b90 2023-06-10T19:06:28.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.522+0000 7f9c112f8640 1 -- 172.21.15.53:0/3180098211 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c0c0b1cd0 con 0x7f9c0c0b0b90 2023-06-10T19:06:28.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.522+0000 7f9c112f8640 1 -- 172.21.15.53:0/3180098211 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c0c0b2290 con 0x7f9c0c0b0b90 2023-06-10T19:06:28.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.522+0000 7f9c112f8640 1 -- 172.21.15.53:0/3180098211 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c0c04d790 con 0x7f9c0c0b0b90 2023-06-10T19:06:28.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.522+0000 7f9c037fe640 1 -- 172.21.15.53:0/3180098211 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9bfc0b2040 con 0x7f9c0c0b0b90 2023-06-10T19:06:28.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.522+0000 7f9c037fe640 1 --2- 172.21.15.53:0/3180098211 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9bec066280 0x7f9bec068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:28.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.522+0000 7f9c037fe640 1 -- 172.21.15.53:0/3180098211 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f9bfc11e150 con 0x7f9c0c0b0b90 2023-06-10T19:06:28.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.522+0000 7f9c0a7fc640 1 --2- 172.21.15.53:0/3180098211 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9bec066280 0x7f9bec068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:28.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.522+0000 7f9c0a7fc640 1 --2- 172.21.15.53:0/3180098211 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9bec066280 0x7f9bec068730 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f9bf4006fd0 tx=0x7f9bf4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:28.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.526+0000 7f9c037fe640 1 -- 172.21.15.53:0/3180098211 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9bfc0eb6c0 con 0x7f9c0c0b0b90 2023-06-10T19:06:28.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.714+0000 7f9c112f8640 1 -- 172.21.15.53:0/3180098211 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f9c0c0b72f0 con 0x7f9c0c0b0b90 2023-06-10T19:06:28.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.730+0000 7f9c037fe640 1 -- 172.21.15.53:0/3180098211 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 21 and data pool 22 v85) v1 ==== 174+0+0 (secure 0 0 0) 0x7f9bfc0eece0 con 0x7f9c0c0b0b90 2023-06-10T19:06:28.732 INFO:teuthology.orchestra.run.smithi053.stderr:new fs with metadata pool 21 and data pool 22 2023-06-10T19:06:28.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.730+0000 7f9c112f8640 1 -- 172.21.15.53:0/3180098211 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9bec066280 msgr2=0x7f9bec068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:28.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.730+0000 7f9c112f8640 1 --2- 172.21.15.53:0/3180098211 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9bec066280 0x7f9bec068730 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f9bf4006fd0 tx=0x7f9bf4008040 comp rx=0 tx=0).stop 2023-06-10T19:06:28.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.734+0000 7f9c112f8640 1 -- 172.21.15.53:0/3180098211 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c0c0b0b90 msgr2=0x7f9c0c0cbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:28.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.734+0000 7f9c112f8640 1 --2- 172.21.15.53:0/3180098211 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c0c0b0b90 0x7f9c0c0cbbe0 secure :-1 s=READY pgs=2199 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc0ae040 tx=0x7f9bfc01ac40 comp rx=0 tx=0).stop 2023-06-10T19:06:28.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.746+0000 7f9c112f8640 1 -- 172.21.15.53:0/3180098211 shutdown_connections 2023-06-10T19:06:28.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.746+0000 7f9c112f8640 1 --2- 172.21.15.53:0/3180098211 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9bec066280 0x7f9bec068730 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:28.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.746+0000 7f9c112f8640 1 --2- 172.21.15.53:0/3180098211 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c0c15c090 0x7f9c0c0d0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:28.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.746+0000 7f9c112f8640 1 --2- 172.21.15.53:0/3180098211 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c0c0b7c60 0x7f9c0c150120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:28.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.746+0000 7f9c112f8640 1 --2- 172.21.15.53:0/3180098211 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c0c0b0b90 0x7f9c0c0cbbe0 unknown :-1 s=CLOSED pgs=2199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:28.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.746+0000 7f9c112f8640 1 -- 172.21.15.53:0/3180098211 >> 172.21.15.53:0/3180098211 conn(0x7f9c0c069e20 msgr2=0x7f9c0c0b6af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:28.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.746+0000 7f9c112f8640 1 -- 172.21.15.53:0/3180098211 shutdown_connections 2023-06-10T19:06:28.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.746+0000 7f9c112f8640 1 -- 172.21.15.53:0/3180098211 wait complete. 2023-06-10T19:06:28.775 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:06:28.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.890+0000 7fb45b1e9640 1 Processor -- start 2023-06-10T19:06:28.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.890+0000 7fb45b1e9640 1 -- start start 2023-06-10T19:06:28.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.894+0000 7fb45b1e9640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb4540cb870 0x7fb4540af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:28.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.894+0000 7fb45b1e9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb4540afc60 0x7fb4540aba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:28.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.894+0000 7fb45b1e9640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4541600d0 con 0x7fb4540c9750 2023-06-10T19:06:28.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.894+0000 7fb45b1e9640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4540cd990 con 0x7fb4540cb870 2023-06-10T19:06:28.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.894+0000 7fb45b1e9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4540b00e0 con 0x7fb4540afc60 2023-06-10T19:06:28.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.894+0000 7fb458f85640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fb4540c9750 0x7fb4540aced0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:49656/0 (socket says 172.21.15.53:49656) 2023-06-10T19:06:28.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.894+0000 7fb458f85640 1 -- 172.21.15.53:0/4131408209 learned_addr learned my addr 172.21.15.53:0/4131408209 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:06:28.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.894+0000 7fb459786640 1 --2- 172.21.15.53:0/4131408209 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb4540afc60 0x7fb4540aba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:28.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.894+0000 7fb453fff640 1 --2- 172.21.15.53:0/4131408209 >> v2:172.21.15.117:3300/0 conn(0x7fb4540cb870 0x7fb4540af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:28.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.894+0000 7fb4537fe640 1 -- 172.21.15.53:0/4131408209 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1457927997 0 0) 0x7fb4541600d0 con 0x7fb4540c9750 2023-06-10T19:06:28.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.894+0000 7fb4537fe640 1 -- 172.21.15.53:0/4131408209 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb440003530 con 0x7fb4540c9750 2023-06-10T19:06:28.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.894+0000 7fb4537fe640 1 -- 172.21.15.53:0/4131408209 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2059225199 0 0) 0x7fb440003530 con 0x7fb4540c9750 2023-06-10T19:06:28.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.894+0000 7fb4537fe640 1 -- 172.21.15.53:0/4131408209 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb4540afc60 msgr2=0x7fb4540aba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:28.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.894+0000 7fb4537fe640 1 --2- 172.21.15.53:0/4131408209 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb4540afc60 0x7fb4540aba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:28.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.894+0000 7fb4537fe640 1 -- 172.21.15.53:0/4131408209 >> v2:172.21.15.117:3300/0 conn(0x7fb4540cb870 msgr2=0x7fb4540af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:28.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.894+0000 7fb4537fe640 1 --2- 172.21.15.53:0/4131408209 >> v2:172.21.15.117:3300/0 conn(0x7fb4540cb870 0x7fb4540af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:28.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.894+0000 7fb4537fe640 1 -- 172.21.15.53:0/4131408209 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb454160370 con 0x7fb4540c9750 2023-06-10T19:06:28.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.894+0000 7fb4537fe640 1 -- 172.21.15.53:0/4131408209 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fb44c001a00 con 0x7fb4540c9750 2023-06-10T19:06:28.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.894+0000 7fb459786640 1 --2- 172.21.15.53:0/4131408209 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb4540afc60 0x7fb4540aba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-10T19:06:28.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.894+0000 7fb4537fe640 1 -- 172.21.15.53:0/4131408209 >> v1:172.21.15.53:6789/0 conn(0x7fb4540c9750 legacy=0x7fb4540aced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:28.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.894+0000 7fb4537fe640 1 --2- 172.21.15.53:0/4131408209 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb4400039f0 0x7fb440003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:28.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.894+0000 7fb4537fe640 1 --2- 172.21.15.53:0/4131408209 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb4400047d0 0x7fb440004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:28.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.894+0000 7fb4537fe640 1 --2- 172.21.15.53:0/4131408209 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb4540afc60 0x7fb440005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:28.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.894+0000 7fb4537fe640 1 -- 172.21.15.53:0/4131408209 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4540cd990 con 0x7fb4400047d0 2023-06-10T19:06:28.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.894+0000 7fb4537fe640 1 -- 172.21.15.53:0/4131408209 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4540b00e0 con 0x7fb4400039f0 2023-06-10T19:06:28.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.894+0000 7fb4537fe640 1 -- 172.21.15.53:0/4131408209 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb44000b990 con 0x7fb4540afc60 2023-06-10T19:06:28.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.894+0000 7fb453fff640 1 --2- 172.21.15.53:0/4131408209 >> v2:172.21.15.117:3300/0 conn(0x7fb4540cb870 0x7fb4540af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-10T19:06:28.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.894+0000 7fb453fff640 1 --2- 172.21.15.53:0/4131408209 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb4400047d0 0x7fb440004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:28.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.894+0000 7fb459786640 1 --2- 172.21.15.53:0/4131408209 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb4540afc60 0x7fb440005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:28.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.894+0000 7fb458f85640 1 --2- 172.21.15.53:0/4131408209 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb4400039f0 0x7fb440003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:28.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.894+0000 7fb453fff640 1 -- 172.21.15.53:0/4131408209 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb4540afc60 msgr2=0x7fb440005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:28.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.894+0000 7fb453fff640 1 --2- 172.21.15.53:0/4131408209 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb4540afc60 0x7fb440005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:28.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.894+0000 7fb453fff640 1 -- 172.21.15.53:0/4131408209 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb4400039f0 msgr2=0x7fb440003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:28.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.894+0000 7fb453fff640 1 --2- 172.21.15.53:0/4131408209 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb4400039f0 0x7fb440003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:28.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.894+0000 7fb453fff640 1 -- 172.21.15.53:0/4131408209 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb444009420 con 0x7fb4400047d0 2023-06-10T19:06:28.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.898+0000 7fb453fff640 1 --2- 172.21.15.53:0/4131408209 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb4400047d0 0x7fb440004c40 secure :-1 s=READY pgs=2201 cs=0 l=1 rev1=1 crypto rx=0x7fb43c009c90 tx=0x7fb43c01cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d440f67c18ec1e0d server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:28.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.898+0000 7fb4537fe640 1 -- 172.21.15.53:0/4131408209 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43c004020 con 0x7fb4400047d0 2023-06-10T19:06:28.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.898+0000 7fb4537fe640 1 -- 172.21.15.53:0/4131408209 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb43c004180 con 0x7fb4400047d0 2023-06-10T19:06:28.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.898+0000 7fb4537fe640 1 -- 172.21.15.53:0/4131408209 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43c0a5800 con 0x7fb4400047d0 2023-06-10T19:06:28.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.898+0000 7fb45b1e9640 1 -- 172.21.15.53:0/4131408209 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb4400047d0 msgr2=0x7fb440004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:28.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.898+0000 7fb45b1e9640 1 --2- 172.21.15.53:0/4131408209 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb4400047d0 0x7fb440004c40 secure :-1 s=READY pgs=2201 cs=0 l=1 rev1=1 crypto rx=0x7fb43c009c90 tx=0x7fb43c01cc50 comp rx=0 tx=0).stop 2023-06-10T19:06:28.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.898+0000 7fb459786640 1 -- 172.21.15.53:0/4131408209 reap_dead start 2023-06-10T19:06:28.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.898+0000 7fb45b1e9640 1 -- 172.21.15.53:0/4131408209 shutdown_connections 2023-06-10T19:06:28.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.898+0000 7fb45b1e9640 1 -- 172.21.15.53:0/4131408209 >> 172.21.15.53:0/4131408209 conn(0x7fb45406a0d0 msgr2=0x7fb4540ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:28.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.898+0000 7fb45b1e9640 1 -- 172.21.15.53:0/4131408209 shutdown_connections 2023-06-10T19:06:28.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.898+0000 7fb45b1e9640 1 -- 172.21.15.53:0/4131408209 wait complete. 2023-06-10T19:06:28.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.898+0000 7fb45b1e9640 1 Processor -- start 2023-06-10T19:06:28.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.898+0000 7fb45b1e9640 1 -- start start 2023-06-10T19:06:28.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.898+0000 7fb45b1e9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb4400047d0 0x7fb4540c6770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:28.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.898+0000 7fb45b1e9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb4540c5ad0 0x7fb4540b0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:28.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.898+0000 7fb45b1e9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb45406bee0 0x7fb454157e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:28.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.898+0000 7fb45b1e9640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb45415c040 con 0x7fb45406bee0 2023-06-10T19:06:28.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.898+0000 7fb45b1e9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb45415c300 con 0x7fb4400047d0 2023-06-10T19:06:28.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.898+0000 7fb45b1e9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb45415c5e0 con 0x7fb4540c5ad0 2023-06-10T19:06:28.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.898+0000 7fb459786640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb45406bee0 0x7fb454157e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:28.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.898+0000 7fb458f85640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb4400047d0 0x7fb4540c6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:28.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.898+0000 7fb459786640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb45406bee0 0x7fb454157e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55508/0 (socket says 172.21.15.53:55508) 2023-06-10T19:06:28.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.898+0000 7fb459786640 1 -- 172.21.15.53:0/1746733801 learned_addr learned my addr 172.21.15.53:0/1746733801 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:28.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.898+0000 7fb453fff640 1 --2- 172.21.15.53:0/1746733801 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb4540c5ad0 0x7fb4540b0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:28.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.898+0000 7fb459786640 1 -- 172.21.15.53:0/1746733801 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb4540c5ad0 msgr2=0x7fb4540b0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:28.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.898+0000 7fb459786640 1 --2- 172.21.15.53:0/1746733801 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb4540c5ad0 0x7fb4540b0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:28.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.898+0000 7fb459786640 1 -- 172.21.15.53:0/1746733801 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb4400047d0 msgr2=0x7fb4540c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:28.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.898+0000 7fb459786640 1 --2- 172.21.15.53:0/1746733801 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb4400047d0 0x7fb4540c6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:28.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.898+0000 7fb459786640 1 -- 172.21.15.53:0/1746733801 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb45415c8c0 con 0x7fb45406bee0 2023-06-10T19:06:28.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.902+0000 7fb459786640 1 --2- 172.21.15.53:0/1746733801 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb45406bee0 0x7fb454157e20 secure :-1 s=READY pgs=2202 cs=0 l=1 rev1=1 crypto rx=0x7fb4540cdc00 tx=0x7fb444011620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:28.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.902+0000 7fb4517fa640 1 -- 172.21.15.53:0/1746733801 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb444004440 con 0x7fb45406bee0 2023-06-10T19:06:28.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.902+0000 7fb4517fa640 1 -- 172.21.15.53:0/1746733801 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4440119d0 con 0x7fb45406bee0 2023-06-10T19:06:28.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.902+0000 7fb45b1e9640 1 -- 172.21.15.53:0/1746733801 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4540c6cb0 con 0x7fb45406bee0 2023-06-10T19:06:28.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.902+0000 7fb4517fa640 1 -- 172.21.15.53:0/1746733801 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb444011d40 con 0x7fb45406bee0 2023-06-10T19:06:28.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.902+0000 7fb45b1e9640 1 -- 172.21.15.53:0/1746733801 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb45406c350 con 0x7fb45406bee0 2023-06-10T19:06:28.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.902+0000 7fb45b1e9640 1 -- 172.21.15.53:0/1746733801 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb45404d790 con 0x7fb45406bee0 2023-06-10T19:06:28.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.902+0000 7fb4517fa640 1 -- 172.21.15.53:0/1746733801 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb444003620 con 0x7fb45406bee0 2023-06-10T19:06:28.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.902+0000 7fb4517fa640 1 --2- 172.21.15.53:0/1746733801 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb434066280 0x7fb434068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:28.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.902+0000 7fb4517fa640 1 -- 172.21.15.53:0/1746733801 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb444083cd0 con 0x7fb45406bee0 2023-06-10T19:06:28.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.902+0000 7fb458f85640 1 --2- 172.21.15.53:0/1746733801 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb434066280 0x7fb434068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:28.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.902+0000 7fb458f85640 1 --2- 172.21.15.53:0/1746733801 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb434066280 0x7fb434068730 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fb44c001c70 tx=0x7fb44c0017c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:28.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:28.906+0000 7fb4517fa640 1 -- 172.21.15.53:0/1746733801 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb4440512e0 con 0x7fb45406bee0 2023-06-10T19:06:29.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.062+0000 7fb45b1e9640 1 -- 172.21.15.53:0/1746733801 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb45415c440 con 0x7fb45406bee0 2023-06-10T19:06:29.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.066+0000 7fb4517fa640 1 -- 172.21.15.53:0/1746733801 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v153) v1 ==== 74+0+18302 (secure 0 0 0) 0x7fb45415c440 con 0x7fb45406bee0 2023-06-10T19:06:29.067 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:06:29.067 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":153,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:06:28.716200+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-06-10T19:06:27.279397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-06-10T19:06:27.689260+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:06:29.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.066+0000 7fb45b1e9640 1 -- 172.21.15.53:0/1746733801 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb434066280 msgr2=0x7fb434068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:29.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.066+0000 7fb45b1e9640 1 --2- 172.21.15.53:0/1746733801 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb434066280 0x7fb434068730 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fb44c001c70 tx=0x7fb44c0017c0 comp rx=0 tx=0).stop 2023-06-10T19:06:29.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.066+0000 7fb45b1e9640 1 -- 172.21.15.53:0/1746733801 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb45406bee0 msgr2=0x7fb454157e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:29.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.066+0000 7fb45b1e9640 1 --2- 172.21.15.53:0/1746733801 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb45406bee0 0x7fb454157e20 secure :-1 s=READY pgs=2202 cs=0 l=1 rev1=1 crypto rx=0x7fb4540cdc00 tx=0x7fb444011620 comp rx=0 tx=0).stop 2023-06-10T19:06:29.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.066+0000 7fb45b1e9640 1 -- 172.21.15.53:0/1746733801 shutdown_connections 2023-06-10T19:06:29.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.066+0000 7fb45b1e9640 1 --2- 172.21.15.53:0/1746733801 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb434066280 0x7fb434068730 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:29.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.066+0000 7fb45b1e9640 1 --2- 172.21.15.53:0/1746733801 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb45406bee0 0x7fb454157e20 unknown :-1 s=CLOSED pgs=2202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:29.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.066+0000 7fb45b1e9640 1 --2- 172.21.15.53:0/1746733801 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb4540c5ad0 0x7fb4540b0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:29.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.066+0000 7fb45b1e9640 1 --2- 172.21.15.53:0/1746733801 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb4400047d0 0x7fb4540c6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:29.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.066+0000 7fb45b1e9640 1 -- 172.21.15.53:0/1746733801 >> 172.21.15.53:0/1746733801 conn(0x7fb45406a0d0 msgr2=0x7fb454159000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:29.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.066+0000 7fb45b1e9640 1 -- 172.21.15.53:0/1746733801 shutdown_connections 2023-06-10T19:06:29.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.066+0000 7fb45b1e9640 1 -- 172.21.15.53:0/1746733801 wait complete. 2023-06-10T19:06:29.086 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:06:29.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.202+0000 7fee5155b640 1 Processor -- start 2023-06-10T19:06:29.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.202+0000 7fee5155b640 1 -- start start 2023-06-10T19:06:29.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.206+0000 7fee5155b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fee4c0c9840 0x7fee4c0c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:29.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.206+0000 7fee5155b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee4c071060 0x7fee4c0af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:29.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.206+0000 7fee5155b640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee4c159b50 con 0x7fee4c0afc60 2023-06-10T19:06:29.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.206+0000 7fee5155b640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee4c0ca150 con 0x7fee4c0c9840 2023-06-10T19:06:29.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.206+0000 7fee5155b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee4c0702a0 con 0x7fee4c071060 2023-06-10T19:06:29.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.206+0000 7fee4affd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fee4c0c9840 0x7fee4c0c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:29.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.206+0000 7fee4b7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fee4c0afc60 0x7fee4c15d2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:49662/0 (socket says 172.21.15.53:49662) 2023-06-10T19:06:29.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.206+0000 7fee4b7fe640 1 -- 172.21.15.53:0/1713214859 learned_addr learned my addr 172.21.15.53:0/1713214859 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:06:29.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.206+0000 7fee4a7fc640 1 --2- 172.21.15.53:0/1713214859 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee4c071060 0x7fee4c0af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:29.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.206+0000 7fee4affd640 1 -- 172.21.15.53:0/1713214859 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee4c071060 msgr2=0x7fee4c0af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:29.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.206+0000 7fee4affd640 1 --2- 172.21.15.53:0/1713214859 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee4c071060 0x7fee4c0af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:29.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.206+0000 7fee4affd640 1 -- 172.21.15.53:0/1713214859 >> v1:172.21.15.53:6789/0 conn(0x7fee4c0afc60 legacy=0x7fee4c15d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:29.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.206+0000 7fee4affd640 1 -- 172.21.15.53:0/1713214859 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee4c070580 con 0x7fee4c0c9840 2023-06-10T19:06:29.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.206+0000 7fee49ffb640 1 -- 172.21.15.53:0/1713214859 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3101582943 0 0) 0x7fee4c159b50 con 0x7fee4c0afc60 2023-06-10T19:06:29.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.206+0000 7fee4affd640 1 --2- 172.21.15.53:0/1713214859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee4c0c9840 0x7fee4c0c9c10 secure :-1 s=READY pgs=2204 cs=0 l=1 rev1=1 crypto rx=0x7fee3c009d90 tx=0x7fee3c01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83c39741acf29022 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:29.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.206+0000 7fee49ffb640 1 -- 172.21.15.53:0/1713214859 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee3c0a5900 con 0x7fee4c0c9840 2023-06-10T19:06:29.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.206+0000 7fee49ffb640 1 -- 172.21.15.53:0/1713214859 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee3c0a5a60 con 0x7fee4c0c9840 2023-06-10T19:06:29.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.206+0000 7fee49ffb640 1 -- 172.21.15.53:0/1713214859 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee3c0a5df0 con 0x7fee4c0c9840 2023-06-10T19:06:29.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.206+0000 7fee5155b640 1 -- 172.21.15.53:0/1713214859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee4c0c9840 msgr2=0x7fee4c0c9c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:29.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.206+0000 7fee5155b640 1 --2- 172.21.15.53:0/1713214859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee4c0c9840 0x7fee4c0c9c10 secure :-1 s=READY pgs=2204 cs=0 l=1 rev1=1 crypto rx=0x7fee3c009d90 tx=0x7fee3c01c920 comp rx=0 tx=0).stop 2023-06-10T19:06:29.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.206+0000 7fee5155b640 1 -- 172.21.15.53:0/1713214859 shutdown_connections 2023-06-10T19:06:29.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.206+0000 7fee5155b640 1 --2- 172.21.15.53:0/1713214859 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee4c071060 0x7fee4c0af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:29.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.206+0000 7fee5155b640 1 --2- 172.21.15.53:0/1713214859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee4c0c9840 0x7fee4c0c9c10 secure :-1 s=CLOSED pgs=2204 cs=0 l=1 rev1=1 crypto rx=0x7fee3c009d90 tx=0x7fee3c01c920 comp rx=0 tx=0).stop 2023-06-10T19:06:29.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.206+0000 7fee5155b640 1 -- 172.21.15.53:0/1713214859 >> 172.21.15.53:0/1713214859 conn(0x7fee4c06a0d0 msgr2=0x7fee4c0ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:29.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.206+0000 7fee5155b640 1 -- 172.21.15.53:0/1713214859 shutdown_connections 2023-06-10T19:06:29.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.206+0000 7fee5155b640 1 -- 172.21.15.53:0/1713214859 wait complete. 2023-06-10T19:06:29.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.210+0000 7fee5155b640 1 Processor -- start 2023-06-10T19:06:29.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.210+0000 7fee5155b640 1 -- start start 2023-06-10T19:06:29.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.210+0000 7fee5155b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee4c071060 0x7fee4c150a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:29.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.210+0000 7fee5155b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee4c0afc60 0x7fee4c15be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:29.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.210+0000 7fee5155b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee4c0ae110 0x7fee4c14e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:29.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.210+0000 7fee5155b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee4c0ae6d0 con 0x7fee4c071060 2023-06-10T19:06:29.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.210+0000 7fee5155b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee4c0ae9b0 con 0x7fee4c0ae110 2023-06-10T19:06:29.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.210+0000 7fee5155b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee4c0aec90 con 0x7fee4c0afc60 2023-06-10T19:06:29.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.210+0000 7fee4affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee4c071060 0x7fee4c150a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:29.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.210+0000 7fee4affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee4c071060 0x7fee4c150a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55524/0 (socket says 172.21.15.53:55524) 2023-06-10T19:06:29.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.210+0000 7fee4affd640 1 -- 172.21.15.53:0/407879288 learned_addr learned my addr 172.21.15.53:0/407879288 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:29.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.210+0000 7fee4a7fc640 1 --2- 172.21.15.53:0/407879288 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee4c0afc60 0x7fee4c15be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:29.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.210+0000 7fee4b7fe640 1 --2- 172.21.15.53:0/407879288 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee4c0ae110 0x7fee4c14e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:29.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.210+0000 7fee4affd640 1 -- 172.21.15.53:0/407879288 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee4c0afc60 msgr2=0x7fee4c15be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:29.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.210+0000 7fee4affd640 1 --2- 172.21.15.53:0/407879288 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee4c0afc60 0x7fee4c15be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:29.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.210+0000 7fee4affd640 1 -- 172.21.15.53:0/407879288 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee4c0ae110 msgr2=0x7fee4c14e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:29.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.210+0000 7fee4affd640 1 --2- 172.21.15.53:0/407879288 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee4c0ae110 0x7fee4c14e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:29.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.210+0000 7fee4affd640 1 -- 172.21.15.53:0/407879288 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee3c009a70 con 0x7fee4c071060 2023-06-10T19:06:29.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.210+0000 7fee4a7fc640 1 --2- 172.21.15.53:0/407879288 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee4c0afc60 0x7fee4c15be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:06:29.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.210+0000 7fee4b7fe640 1 --2- 172.21.15.53:0/407879288 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee4c0ae110 0x7fee4c14e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:06:29.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.210+0000 7fee4affd640 1 --2- 172.21.15.53:0/407879288 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee4c071060 0x7fee4c150a50 secure :-1 s=READY pgs=2205 cs=0 l=1 rev1=1 crypto rx=0x7fee3c0b0040 tx=0x7fee3c0196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:29.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.210+0000 7fee337fe640 1 -- 172.21.15.53:0/407879288 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee3c0b9860 con 0x7fee4c071060 2023-06-10T19:06:29.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.210+0000 7fee337fe640 1 -- 172.21.15.53:0/407879288 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee3c0b99c0 con 0x7fee4c071060 2023-06-10T19:06:29.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.210+0000 7fee5155b640 1 -- 172.21.15.53:0/407879288 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee4c0aef70 con 0x7fee4c071060 2023-06-10T19:06:29.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.210+0000 7fee337fe640 1 -- 172.21.15.53:0/407879288 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee3c0b9d70 con 0x7fee4c071060 2023-06-10T19:06:29.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.210+0000 7fee5155b640 1 -- 172.21.15.53:0/407879288 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee4c150f90 con 0x7fee4c071060 2023-06-10T19:06:29.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.210+0000 7fee5155b640 1 -- 172.21.15.53:0/407879288 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee4c04d790 con 0x7fee4c071060 2023-06-10T19:06:29.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.214+0000 7fee337fe640 1 -- 172.21.15.53:0/407879288 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fee3c0c4460 con 0x7fee4c071060 2023-06-10T19:06:29.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.214+0000 7fee337fe640 1 --2- 172.21.15.53:0/407879288 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fee38066280 0x7fee38068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:29.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.214+0000 7fee337fe640 1 -- 172.21.15.53:0/407879288 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fee3c11fc30 con 0x7fee4c071060 2023-06-10T19:06:29.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.214+0000 7fee4a7fc640 1 --2- 172.21.15.53:0/407879288 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fee38066280 0x7fee38068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:29.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.214+0000 7fee4a7fc640 1 --2- 172.21.15.53:0/407879288 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fee38066280 0x7fee38068730 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fee4c152530 tx=0x7fee40008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:29.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.218+0000 7fee337fe640 1 -- 172.21.15.53:0/407879288 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fee3c0ed120 con 0x7fee4c071060 2023-06-10T19:06:29.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.374+0000 7fee5155b640 1 -- 172.21.15.53:0/407879288 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fee4c0ad4b0 con 0x7fee4c071060 2023-06-10T19:06:29.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.378+0000 7fee337fe640 1 -- 172.21.15.53:0/407879288 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v153) v1 ==== 74+0+18302 (secure 0 0 0) 0x7fee3c0f0740 con 0x7fee4c071060 2023-06-10T19:06:29.380 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:06:29.380 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":153,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:06:28.716200+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-06-10T19:06:27.279397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-06-10T19:06:27.689260+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:06:29.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.378+0000 7fee5155b640 1 -- 172.21.15.53:0/407879288 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fee38066280 msgr2=0x7fee38068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:29.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.378+0000 7fee5155b640 1 --2- 172.21.15.53:0/407879288 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fee38066280 0x7fee38068730 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fee4c152530 tx=0x7fee40008040 comp rx=0 tx=0).stop 2023-06-10T19:06:29.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.378+0000 7fee5155b640 1 -- 172.21.15.53:0/407879288 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee4c071060 msgr2=0x7fee4c150a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:29.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.378+0000 7fee5155b640 1 --2- 172.21.15.53:0/407879288 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee4c071060 0x7fee4c150a50 secure :-1 s=READY pgs=2205 cs=0 l=1 rev1=1 crypto rx=0x7fee3c0b0040 tx=0x7fee3c0196c0 comp rx=0 tx=0).stop 2023-06-10T19:06:29.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.378+0000 7fee5155b640 1 -- 172.21.15.53:0/407879288 shutdown_connections 2023-06-10T19:06:29.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.378+0000 7fee5155b640 1 --2- 172.21.15.53:0/407879288 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fee38066280 0x7fee38068730 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:29.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.378+0000 7fee5155b640 1 --2- 172.21.15.53:0/407879288 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee4c0ae110 0x7fee4c14e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:29.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.378+0000 7fee5155b640 1 --2- 172.21.15.53:0/407879288 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee4c0afc60 0x7fee4c15be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:29.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.378+0000 7fee5155b640 1 --2- 172.21.15.53:0/407879288 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee4c071060 0x7fee4c150a50 unknown :-1 s=CLOSED pgs=2205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:29.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.378+0000 7fee5155b640 1 -- 172.21.15.53:0/407879288 >> 172.21.15.53:0/407879288 conn(0x7fee4c06a0d0 msgr2=0x7fee4c0c9090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:29.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.378+0000 7fee5155b640 1 -- 172.21.15.53:0/407879288 shutdown_connections 2023-06-10T19:06:29.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.378+0000 7fee5155b640 1 -- 172.21.15.53:0/407879288 wait complete. 2023-06-10T19:06:29.400 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-06-10T19:06:29.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.518+0000 7f2a86c8d640 1 Processor -- start 2023-06-10T19:06:29.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.522+0000 7f2a86c8d640 1 -- start start 2023-06-10T19:06:29.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.522+0000 7f2a86c8d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2a800b7e30 0x7f2a800b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:29.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.522+0000 7f2a86c8d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a800b0b90 0x7f2a800d04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:29.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.522+0000 7f2a86c8d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a800cc7c0 con 0x7f2a8015c090 2023-06-10T19:06:29.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.522+0000 7f2a86c8d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a800ccaa0 con 0x7f2a800b7e30 2023-06-10T19:06:29.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.522+0000 7f2a86c8d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a800ccd80 con 0x7f2a800b0b90 2023-06-10T19:06:29.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.522+0000 7f2a84a29640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f2a8015c090 0x7f2a800b7720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:49672/0 (socket says 172.21.15.53:49672) 2023-06-10T19:06:29.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.522+0000 7f2a7ffff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2a800b7e30 0x7f2a800b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:29.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.522+0000 7f2a84a29640 1 -- 172.21.15.53:0/3610891440 learned_addr learned my addr 172.21.15.53:0/3610891440 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:06:29.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.522+0000 7f2a8522a640 1 --2- 172.21.15.53:0/3610891440 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a800b0b90 0x7f2a800d04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:29.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.522+0000 7f2a7ffff640 1 -- 172.21.15.53:0/3610891440 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a800b0b90 msgr2=0x7f2a800d04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:29.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.522+0000 7f2a7ffff640 1 --2- 172.21.15.53:0/3610891440 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a800b0b90 0x7f2a800d04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:29.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.522+0000 7f2a7ffff640 1 -- 172.21.15.53:0/3610891440 >> v1:172.21.15.53:6789/0 conn(0x7f2a8015c090 legacy=0x7f2a800b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:29.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.522+0000 7f2a7f7fe640 1 -- 172.21.15.53:0/3610891440 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 574194656 0 0) 0x7f2a800cc7c0 con 0x7f2a8015c090 2023-06-10T19:06:29.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.522+0000 7f2a7ffff640 1 -- 172.21.15.53:0/3610891440 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a800cd060 con 0x7f2a800b7e30 2023-06-10T19:06:29.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.522+0000 7f2a7ffff640 1 --2- 172.21.15.53:0/3610891440 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a800b7e30 0x7f2a800b10c0 secure :-1 s=READY pgs=2207 cs=0 l=1 rev1=1 crypto rx=0x7f2a740097c0 tx=0x7f2a7401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aaa65624724ce1b server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:29.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.526+0000 7f2a7f7fe640 1 -- 172.21.15.53:0/3610891440 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a740ab600 con 0x7f2a800b7e30 2023-06-10T19:06:29.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.526+0000 7f2a7f7fe640 1 -- 172.21.15.53:0/3610891440 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a740a7050 con 0x7f2a800b7e30 2023-06-10T19:06:29.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.526+0000 7f2a7f7fe640 1 -- 172.21.15.53:0/3610891440 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a740ab980 con 0x7f2a800b7e30 2023-06-10T19:06:29.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.526+0000 7f2a86c8d640 1 -- 172.21.15.53:0/3610891440 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a800b7e30 msgr2=0x7f2a800b10c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:29.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.526+0000 7f2a86c8d640 1 --2- 172.21.15.53:0/3610891440 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a800b7e30 0x7f2a800b10c0 secure :-1 s=READY pgs=2207 cs=0 l=1 rev1=1 crypto rx=0x7f2a740097c0 tx=0x7f2a7401c3c0 comp rx=0 tx=0).stop 2023-06-10T19:06:29.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.526+0000 7f2a86c8d640 1 -- 172.21.15.53:0/3610891440 shutdown_connections 2023-06-10T19:06:29.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.526+0000 7f2a86c8d640 1 --2- 172.21.15.53:0/3610891440 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a800b7e30 0x7f2a800b10c0 unknown :-1 s=CLOSED pgs=2207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:29.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.526+0000 7f2a86c8d640 1 --2- 172.21.15.53:0/3610891440 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a800b0b90 0x7f2a800d04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:29.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.526+0000 7f2a86c8d640 1 -- 172.21.15.53:0/3610891440 >> 172.21.15.53:0/3610891440 conn(0x7f2a80069e20 msgr2=0x7f2a8006a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:29.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.526+0000 7f2a86c8d640 1 -- 172.21.15.53:0/3610891440 shutdown_connections 2023-06-10T19:06:29.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.526+0000 7f2a86c8d640 1 -- 172.21.15.53:0/3610891440 wait complete. 2023-06-10T19:06:29.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.526+0000 7f2a86c8d640 1 Processor -- start 2023-06-10T19:06:29.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.526+0000 7f2a86c8d640 1 -- start start 2023-06-10T19:06:29.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.526+0000 7f2a86c8d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a800b0b90 0x7f2a80149f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:29.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.526+0000 7f2a86c8d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a800b7e30 0x7f2a8014ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:29.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.526+0000 7f2a86c8d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a8015c090 0x7f2a800c9760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:29.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.526+0000 7f2a86c8d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a8014c640 con 0x7f2a800b7e30 2023-06-10T19:06:29.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.526+0000 7f2a86c8d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a8014b9c0 con 0x7f2a800b0b90 2023-06-10T19:06:29.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.526+0000 7f2a86c8d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a8014bca0 con 0x7f2a8015c090 2023-06-10T19:06:29.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.526+0000 7f2a7ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a800b7e30 0x7f2a8014ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:29.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.526+0000 7f2a7ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a800b7e30 0x7f2a8014ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55540/0 (socket says 172.21.15.53:55540) 2023-06-10T19:06:29.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.526+0000 7f2a7ffff640 1 -- 172.21.15.53:0/1858053594 learned_addr learned my addr 172.21.15.53:0/1858053594 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:29.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.526+0000 7f2a8522a640 1 --2- 172.21.15.53:0/1858053594 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a8015c090 0x7f2a800c9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:29.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.526+0000 7f2a7ffff640 1 -- 172.21.15.53:0/1858053594 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a8015c090 msgr2=0x7f2a800c9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:29.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.526+0000 7f2a84a29640 1 --2- 172.21.15.53:0/1858053594 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a800b0b90 0x7f2a80149f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:29.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.526+0000 7f2a7ffff640 1 --2- 172.21.15.53:0/1858053594 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a8015c090 0x7f2a800c9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:29.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.526+0000 7f2a7ffff640 1 -- 172.21.15.53:0/1858053594 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a800b0b90 msgr2=0x7f2a80149f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:29.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.526+0000 7f2a7ffff640 1 --2- 172.21.15.53:0/1858053594 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a800b0b90 0x7f2a80149f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:29.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.526+0000 7f2a7ffff640 1 -- 172.21.15.53:0/1858053594 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a74009420 con 0x7f2a800b7e30 2023-06-10T19:06:29.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.526+0000 7f2a8522a640 1 --2- 172.21.15.53:0/1858053594 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a8015c090 0x7f2a800c9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:06:29.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.526+0000 7f2a7ffff640 1 --2- 172.21.15.53:0/1858053594 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a800b7e30 0x7f2a8014ca40 secure :-1 s=READY pgs=2208 cs=0 l=1 rev1=1 crypto rx=0x7f2a74019ff0 tx=0x7f2a74019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:29.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.526+0000 7f2a7d7fa640 1 -- 172.21.15.53:0/1858053594 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a740b4610 con 0x7f2a800b7e30 2023-06-10T19:06:29.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.526+0000 7f2a7d7fa640 1 -- 172.21.15.53:0/1858053594 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a740abe90 con 0x7f2a800b7e30 2023-06-10T19:06:29.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.526+0000 7f2a86c8d640 1 -- 172.21.15.53:0/1858053594 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a8014bf80 con 0x7f2a800b7e30 2023-06-10T19:06:29.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.526+0000 7f2a7d7fa640 1 -- 172.21.15.53:0/1858053594 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a740b49d0 con 0x7f2a800b7e30 2023-06-10T19:06:29.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.526+0000 7f2a86c8d640 1 -- 172.21.15.53:0/1858053594 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a800b13d0 con 0x7f2a800b7e30 2023-06-10T19:06:29.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.530+0000 7f2a86c8d640 1 -- 172.21.15.53:0/1858053594 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a8004d790 con 0x7f2a800b7e30 2023-06-10T19:06:29.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.530+0000 7f2a7d7fa640 1 -- 172.21.15.53:0/1858053594 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2a740b2040 con 0x7f2a800b7e30 2023-06-10T19:06:29.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.530+0000 7f2a7d7fa640 1 --2- 172.21.15.53:0/1858053594 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2a6c066280 0x7f2a6c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:29.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.530+0000 7f2a7d7fa640 1 -- 172.21.15.53:0/1858053594 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2a7411df70 con 0x7f2a800b7e30 2023-06-10T19:06:29.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.530+0000 7f2a84a29640 1 --2- 172.21.15.53:0/1858053594 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2a6c066280 0x7f2a6c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:29.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.530+0000 7f2a84a29640 1 --2- 172.21.15.53:0/1858053594 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2a6c066280 0x7f2a6c068730 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f2a70000f70 tx=0x7f2a70009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:29.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.534+0000 7f2a7d7fa640 1 -- 172.21.15.53:0/1858053594 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2a7414e700 con 0x7f2a800b7e30 2023-06-10T19:06:29.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:29.722+0000 7f2a86c8d640 1 -- 172.21.15.53:0/1858053594 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f2a80072480 con 0x7f2a800b7e30 2023-06-10T19:06:30.261 INFO:tasks.ceph.mds.a.smithi053.stderr:2023-06-10T19:06:30.258+0000 7fa6c9434640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-06-10T19:06:30.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:30.746+0000 7f2a7d7fa640 1 -- 172.21.15.53:0/1858053594 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v88) v1 ==== 118+0+0 (secure 0 0 0) 0x7f2a740b00b0 con 0x7f2a800b7e30 2023-06-10T19:06:30.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:30.750+0000 7f2a86c8d640 1 -- 172.21.15.53:0/1858053594 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2a6c066280 msgr2=0x7f2a6c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:30.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:30.750+0000 7f2a86c8d640 1 --2- 172.21.15.53:0/1858053594 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2a6c066280 0x7f2a6c068730 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f2a70000f70 tx=0x7f2a70009040 comp rx=0 tx=0).stop 2023-06-10T19:06:30.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:30.750+0000 7f2a86c8d640 1 -- 172.21.15.53:0/1858053594 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a800b7e30 msgr2=0x7f2a8014ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:30.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:30.750+0000 7f2a86c8d640 1 --2- 172.21.15.53:0/1858053594 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a800b7e30 0x7f2a8014ca40 secure :-1 s=READY pgs=2208 cs=0 l=1 rev1=1 crypto rx=0x7f2a74019ff0 tx=0x7f2a74019160 comp rx=0 tx=0).stop 2023-06-10T19:06:30.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:30.750+0000 7f2a86c8d640 1 -- 172.21.15.53:0/1858053594 shutdown_connections 2023-06-10T19:06:30.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:30.750+0000 7f2a86c8d640 1 --2- 172.21.15.53:0/1858053594 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2a6c066280 0x7f2a6c068730 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:30.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:30.750+0000 7f2a86c8d640 1 --2- 172.21.15.53:0/1858053594 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2a8015c090 0x7f2a800c9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:30.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:30.750+0000 7f2a86c8d640 1 --2- 172.21.15.53:0/1858053594 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a800b7e30 0x7f2a8014ca40 unknown :-1 s=CLOSED pgs=2208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:30.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:30.750+0000 7f2a86c8d640 1 --2- 172.21.15.53:0/1858053594 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2a800b0b90 0x7f2a80149f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:30.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:30.750+0000 7f2a86c8d640 1 -- 172.21.15.53:0/1858053594 >> 172.21.15.53:0/1858053594 conn(0x7f2a80069e20 msgr2=0x7f2a8006a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:30.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:30.750+0000 7f2a86c8d640 1 -- 172.21.15.53:0/1858053594 shutdown_connections 2023-06-10T19:06:30.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:30.750+0000 7f2a86c8d640 1 -- 172.21.15.53:0/1858053594 wait complete. 2023-06-10T19:06:30.772 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-06-10T19:06:30.773 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-06-10T19:06:30.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:30.906+0000 7f7d464b0640 1 Processor -- start 2023-06-10T19:06:30.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:30.906+0000 7f7d464b0640 1 -- start start 2023-06-10T19:06:30.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:30.906+0000 7f7d464b0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7d4015c090 0x7f7d400b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:30.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:30.906+0000 7f7d464b0640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7d400b7e30 0x7f7d400d04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:30.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:30.906+0000 7f7d464b0640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d400cc7c0 con 0x7f7d400b0b90 2023-06-10T19:06:30.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:30.906+0000 7f7d464b0640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d400ccaa0 con 0x7f7d400b7e30 2023-06-10T19:06:30.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:30.906+0000 7f7d464b0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d400ccd80 con 0x7f7d4015c090 2023-06-10T19:06:30.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:30.906+0000 7f7d3ffff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7d4015c090 0x7f7d400b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:30.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:30.906+0000 7f7d44a4d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7d400b7e30 0x7f7d400d04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:30.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:30.906+0000 7f7d44a4d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7d400b7e30 0x7f7d400d04d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.53:36448/0 (socket says 172.21.15.53:36448) 2023-06-10T19:06:30.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:30.906+0000 7f7d44a4d640 1 -- 172.21.15.53:0/2257631914 learned_addr learned my addr 172.21.15.53:0/2257631914 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:30.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:30.906+0000 7f7d44a4d640 1 -- 172.21.15.53:0/2257631914 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7d4015c090 msgr2=0x7f7d400b10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:30.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:30.906+0000 7f7d44a4d640 1 --2- 172.21.15.53:0/2257631914 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7d4015c090 0x7f7d400b10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:30.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:30.906+0000 7f7d44a4d640 1 -- 172.21.15.53:0/2257631914 >> v1:172.21.15.117:6789/0 conn(0x7f7d400b0b90 legacy=0x7f7d400b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:30.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:30.906+0000 7f7d44a4d640 1 -- 172.21.15.53:0/2257631914 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d400cd060 con 0x7f7d400b7e30 2023-06-10T19:06:30.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:30.910+0000 7f7d44a4d640 1 --2- 172.21.15.53:0/2257631914 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d400b7e30 0x7f7d400d04d0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f7d38009870 tx=0x7f7d3801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56ac79b05021de06 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:30.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:30.910+0000 7f7d3effd640 1 -- 172.21.15.53:0/2257631914 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d380ac640 con 0x7f7d400b7e30 2023-06-10T19:06:30.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:30.910+0000 7f7d3effd640 1 -- 172.21.15.53:0/2257631914 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d380ac7a0 con 0x7f7d400b7e30 2023-06-10T19:06:30.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:30.910+0000 7f7d3effd640 1 -- 172.21.15.53:0/2257631914 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d380acb30 con 0x7f7d400b7e30 2023-06-10T19:06:30.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:30.910+0000 7f7d464b0640 1 -- 172.21.15.53:0/2257631914 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d400b7e30 msgr2=0x7f7d400d04d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:30.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:30.910+0000 7f7d464b0640 1 --2- 172.21.15.53:0/2257631914 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d400b7e30 0x7f7d400d04d0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f7d38009870 tx=0x7f7d3801c480 comp rx=0 tx=0).stop 2023-06-10T19:06:30.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:30.910+0000 7f7d464b0640 1 -- 172.21.15.53:0/2257631914 shutdown_connections 2023-06-10T19:06:30.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:30.910+0000 7f7d464b0640 1 --2- 172.21.15.53:0/2257631914 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d400b7e30 0x7f7d400d04d0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:30.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:30.910+0000 7f7d464b0640 1 --2- 172.21.15.53:0/2257631914 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7d4015c090 0x7f7d400b10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:30.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:30.910+0000 7f7d464b0640 1 -- 172.21.15.53:0/2257631914 >> 172.21.15.53:0/2257631914 conn(0x7f7d40069e20 msgr2=0x7f7d4006a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:30.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:30.910+0000 7f7d464b0640 1 -- 172.21.15.53:0/2257631914 shutdown_connections 2023-06-10T19:06:30.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:30.910+0000 7f7d464b0640 1 -- 172.21.15.53:0/2257631914 wait complete. 2023-06-10T19:06:30.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:30.910+0000 7f7d464b0640 1 Processor -- start 2023-06-10T19:06:30.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:30.910+0000 7f7d464b0640 1 -- start start 2023-06-10T19:06:30.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:30.914+0000 7f7d464b0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7d400b0b90 0x7f7d40147030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:30.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:30.914+0000 7f7d464b0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d400b7e30 0x7f7d40145520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:30.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:30.914+0000 7f7d464b0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d4015c090 0x7f7d4014c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:30.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:30.914+0000 7f7d464b0640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4014bd10 con 0x7f7d4015c090 2023-06-10T19:06:30.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:30.914+0000 7f7d464b0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4014d550 con 0x7f7d400b7e30 2023-06-10T19:06:30.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:30.914+0000 7f7d464b0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4014b420 con 0x7f7d400b0b90 2023-06-10T19:06:30.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:30.914+0000 7f7d44a4d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d4015c090 0x7f7d4014c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:30.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:30.914+0000 7f7d44a4d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d4015c090 0x7f7d4014c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55552/0 (socket says 172.21.15.53:55552) 2023-06-10T19:06:30.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:30.914+0000 7f7d44a4d640 1 -- 172.21.15.53:0/423666389 learned_addr learned my addr 172.21.15.53:0/423666389 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:30.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:30.914+0000 7f7d3f7fe640 1 --2- 172.21.15.53:0/423666389 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d400b7e30 0x7f7d40145520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:30.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:30.914+0000 7f7d3ffff640 1 --2- 172.21.15.53:0/423666389 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7d400b0b90 0x7f7d40147030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:30.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:30.914+0000 7f7d44a4d640 1 -- 172.21.15.53:0/423666389 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7d400b0b90 msgr2=0x7f7d40147030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:30.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:30.914+0000 7f7d44a4d640 1 --2- 172.21.15.53:0/423666389 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7d400b0b90 0x7f7d40147030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:30.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:30.914+0000 7f7d44a4d640 1 -- 172.21.15.53:0/423666389 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d400b7e30 msgr2=0x7f7d40145520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:30.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:30.914+0000 7f7d44a4d640 1 --2- 172.21.15.53:0/423666389 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d400b7e30 0x7f7d40145520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:30.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:30.914+0000 7f7d44a4d640 1 -- 172.21.15.53:0/423666389 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d380094d0 con 0x7f7d4015c090 2023-06-10T19:06:30.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:30.914+0000 7f7d44a4d640 1 --2- 172.21.15.53:0/423666389 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d4015c090 0x7f7d4014c1a0 secure :-1 s=READY pgs=2209 cs=0 l=1 rev1=1 crypto rx=0x7f7d3801a0b0 tx=0x7f7d38019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:30.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:30.914+0000 7f7d3cff9640 1 -- 172.21.15.53:0/423666389 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d380b7670 con 0x7f7d4015c090 2023-06-10T19:06:30.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:30.914+0000 7f7d3cff9640 1 -- 172.21.15.53:0/423666389 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d380b77d0 con 0x7f7d4015c090 2023-06-10T19:06:30.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:30.914+0000 7f7d464b0640 1 -- 172.21.15.53:0/423666389 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d4014b6c0 con 0x7f7d4015c090 2023-06-10T19:06:30.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:30.914+0000 7f7d3cff9640 1 -- 172.21.15.53:0/423666389 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d380b7b40 con 0x7f7d4015c090 2023-06-10T19:06:30.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:30.914+0000 7f7d464b0640 1 -- 172.21.15.53:0/423666389 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d4014d100 con 0x7f7d4015c090 2023-06-10T19:06:30.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:30.914+0000 7f7d464b0640 1 -- 172.21.15.53:0/423666389 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d4014be80 con 0x7f7d4015c090 2023-06-10T19:06:30.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:30.914+0000 7f7d3cff9640 1 -- 172.21.15.53:0/423666389 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7d380b3070 con 0x7f7d4015c090 2023-06-10T19:06:30.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:30.914+0000 7f7d3cff9640 1 --2- 172.21.15.53:0/423666389 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7d20066280 0x7f7d20068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:30.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:30.914+0000 7f7d3cff9640 1 -- 172.21.15.53:0/423666389 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7d3811e630 con 0x7f7d4015c090 2023-06-10T19:06:30.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:30.914+0000 7f7d3ffff640 1 --2- 172.21.15.53:0/423666389 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7d20066280 0x7f7d20068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:30.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:30.918+0000 7f7d3ffff640 1 --2- 172.21.15.53:0/423666389 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7d20066280 0x7f7d20068730 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f7d300073f0 tx=0x7f7d3000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:30.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:30.918+0000 7f7d3cff9640 1 -- 172.21.15.53:0/423666389 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7d380ebac0 con 0x7f7d4015c090 2023-06-10T19:06:31.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:31.110+0000 7f7d464b0640 1 -- 172.21.15.53:0/423666389 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f7d4004d790 con 0x7f7d4015c090 2023-06-10T19:06:32.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.090+0000 7f7d3cff9640 1 -- 172.21.15.53:0/423666389 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v89) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7d380ef0e0 con 0x7f7d4015c090 2023-06-10T19:06:32.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.094+0000 7f7d464b0640 1 -- 172.21.15.53:0/423666389 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7d20066280 msgr2=0x7f7d20068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:32.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.094+0000 7f7d464b0640 1 --2- 172.21.15.53:0/423666389 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7d20066280 0x7f7d20068730 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f7d300073f0 tx=0x7f7d3000b040 comp rx=0 tx=0).stop 2023-06-10T19:06:32.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.094+0000 7f7d464b0640 1 -- 172.21.15.53:0/423666389 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d4015c090 msgr2=0x7f7d4014c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:32.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.094+0000 7f7d464b0640 1 --2- 172.21.15.53:0/423666389 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d4015c090 0x7f7d4014c1a0 secure :-1 s=READY pgs=2209 cs=0 l=1 rev1=1 crypto rx=0x7f7d3801a0b0 tx=0x7f7d38019220 comp rx=0 tx=0).stop 2023-06-10T19:06:32.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.094+0000 7f7d464b0640 1 -- 172.21.15.53:0/423666389 shutdown_connections 2023-06-10T19:06:32.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.094+0000 7f7d464b0640 1 --2- 172.21.15.53:0/423666389 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7d20066280 0x7f7d20068730 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:32.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.094+0000 7f7d464b0640 1 --2- 172.21.15.53:0/423666389 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d4015c090 0x7f7d4014c1a0 unknown :-1 s=CLOSED pgs=2209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:32.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.094+0000 7f7d464b0640 1 --2- 172.21.15.53:0/423666389 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d400b7e30 0x7f7d40145520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:32.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.094+0000 7f7d464b0640 1 --2- 172.21.15.53:0/423666389 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7d400b0b90 0x7f7d40147030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:32.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.094+0000 7f7d464b0640 1 -- 172.21.15.53:0/423666389 >> 172.21.15.53:0/423666389 conn(0x7f7d40069e20 msgr2=0x7f7d400ce8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:32.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.094+0000 7f7d464b0640 1 -- 172.21.15.53:0/423666389 shutdown_connections 2023-06-10T19:06:32.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.094+0000 7f7d464b0640 1 -- 172.21.15.53:0/423666389 wait complete. 2023-06-10T19:06:32.117 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-06-10T19:06:32.118 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:06:32.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.242+0000 7f801f1ac640 1 Processor -- start 2023-06-10T19:06:32.243 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.242+0000 7f801f1ac640 1 -- start start 2023-06-10T19:06:32.244 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.242+0000 7f801f1ac640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f80180cc690 0x7f80180d04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:32.244 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.242+0000 7f801f1ac640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f80180ccae0 0x7f80180d09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:32.244 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.242+0000 7f801f1ac640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80180d0020 con 0x7f80180b3ac0 2023-06-10T19:06:32.245 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.242+0000 7f801f1ac640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80180cef40 con 0x7f80180cc690 2023-06-10T19:06:32.245 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.242+0000 7f801f1ac640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80180cf220 con 0x7f80180ccae0 2023-06-10T19:06:32.245 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.242+0000 7f8017fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f80180cc690 0x7f80180d04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:32.245 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.242+0000 7f801cf48640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f80180b3ac0 0x7f80180b3e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:37432/0 (socket says 172.21.15.53:37432) 2023-06-10T19:06:32.245 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.242+0000 7f8017fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f80180cc690 0x7f80180d04b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51026/0 (socket says 172.21.15.53:51026) 2023-06-10T19:06:32.245 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.242+0000 7f801cf48640 1 -- 172.21.15.53:0/820763598 learned_addr learned my addr 172.21.15.53:0/820763598 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:06:32.246 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.242+0000 7f801d749640 1 --2- 172.21.15.53:0/820763598 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f80180ccae0 0x7f80180d09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:32.246 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.242+0000 7f8017fff640 1 -- 172.21.15.53:0/820763598 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f80180ccae0 msgr2=0x7f80180d09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:32.246 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.242+0000 7f8017fff640 1 --2- 172.21.15.53:0/820763598 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f80180ccae0 0x7f80180d09f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:32.246 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.242+0000 7f8017fff640 1 -- 172.21.15.53:0/820763598 >> v1:172.21.15.53:6789/0 conn(0x7f80180b3ac0 legacy=0x7f80180b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:32.247 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.242+0000 7f80177fe640 1 -- 172.21.15.53:0/820763598 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2164412240 0 0) 0x7f80180d0020 con 0x7f80180b3ac0 2023-06-10T19:06:32.247 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.242+0000 7f8017fff640 1 -- 172.21.15.53:0/820763598 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80180cf500 con 0x7f80180cc690 2023-06-10T19:06:32.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.246+0000 7f8017fff640 1 --2- 172.21.15.53:0/820763598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80180cc690 0x7f80180d04b0 secure :-1 s=READY pgs=2211 cs=0 l=1 rev1=1 crypto rx=0x7f80040097c0 tx=0x7f800401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0f04d289cf5d07c server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:32.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.246+0000 7f80177fe640 1 -- 172.21.15.53:0/820763598 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80040ad660 con 0x7f80180cc690 2023-06-10T19:06:32.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.246+0000 7f80177fe640 1 -- 172.21.15.53:0/820763598 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80040ad7c0 con 0x7f80180cc690 2023-06-10T19:06:32.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.246+0000 7f80177fe640 1 -- 172.21.15.53:0/820763598 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80040adb50 con 0x7f80180cc690 2023-06-10T19:06:32.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.246+0000 7f801f1ac640 1 -- 172.21.15.53:0/820763598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80180cc690 msgr2=0x7f80180d04b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:32.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.246+0000 7f801f1ac640 1 --2- 172.21.15.53:0/820763598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80180cc690 0x7f80180d04b0 secure :-1 s=READY pgs=2211 cs=0 l=1 rev1=1 crypto rx=0x7f80040097c0 tx=0x7f800401c450 comp rx=0 tx=0).stop 2023-06-10T19:06:32.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.246+0000 7f801f1ac640 1 -- 172.21.15.53:0/820763598 shutdown_connections 2023-06-10T19:06:32.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.246+0000 7f801f1ac640 1 --2- 172.21.15.53:0/820763598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80180cc690 0x7f80180d04b0 unknown :-1 s=CLOSED pgs=2211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:32.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.246+0000 7f801f1ac640 1 --2- 172.21.15.53:0/820763598 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f80180ccae0 0x7f80180d09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:32.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.246+0000 7f801f1ac640 1 -- 172.21.15.53:0/820763598 >> 172.21.15.53:0/820763598 conn(0x7f8018071790 msgr2=0x7f8018069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:32.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.246+0000 7f801f1ac640 1 -- 172.21.15.53:0/820763598 shutdown_connections 2023-06-10T19:06:32.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.246+0000 7f801f1ac640 1 -- 172.21.15.53:0/820763598 wait complete. 2023-06-10T19:06:32.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.246+0000 7f801f1ac640 1 Processor -- start 2023-06-10T19:06:32.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.246+0000 7f801f1ac640 1 -- start start 2023-06-10T19:06:32.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.246+0000 7f801f1ac640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f80180b3ac0 0x7f801815be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:32.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.246+0000 7f801f1ac640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80180cc690 0x7f8018155200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:32.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.246+0000 7f801f1ac640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80180ccae0 0x7f80181586b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:32.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.246+0000 7f801f1ac640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8018158bf0 con 0x7f80180cc690 2023-06-10T19:06:32.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.246+0000 7f801f1ac640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f801815c8a0 con 0x7f80180ccae0 2023-06-10T19:06:32.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.246+0000 7f801f1ac640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f801815cb80 con 0x7f80180b3ac0 2023-06-10T19:06:32.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.246+0000 7f8017fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80180cc690 0x7f8018155200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:32.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.246+0000 7f8017fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80180cc690 0x7f8018155200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51036/0 (socket says 172.21.15.53:51036) 2023-06-10T19:06:32.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.246+0000 7f8017fff640 1 -- 172.21.15.53:0/2893218486 learned_addr learned my addr 172.21.15.53:0/2893218486 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:32.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.246+0000 7f801cf48640 1 --2- 172.21.15.53:0/2893218486 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f80180b3ac0 0x7f801815be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:32.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.246+0000 7f801d749640 1 --2- 172.21.15.53:0/2893218486 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80180ccae0 0x7f80181586b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:32.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.246+0000 7f8017fff640 1 -- 172.21.15.53:0/2893218486 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f80180b3ac0 msgr2=0x7f801815be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:32.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.246+0000 7f8017fff640 1 --2- 172.21.15.53:0/2893218486 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f80180b3ac0 0x7f801815be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:32.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.246+0000 7f8017fff640 1 -- 172.21.15.53:0/2893218486 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80180ccae0 msgr2=0x7f80181586b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:32.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.246+0000 7f8017fff640 1 --2- 172.21.15.53:0/2893218486 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80180ccae0 0x7f80181586b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:32.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.246+0000 7f8017fff640 1 -- 172.21.15.53:0/2893218486 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8004009420 con 0x7f80180cc690 2023-06-10T19:06:32.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.246+0000 7f8017fff640 1 --2- 172.21.15.53:0/2893218486 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80180cc690 0x7f8018155200 secure :-1 s=READY pgs=2212 cs=0 l=1 rev1=1 crypto rx=0x7f800401ab00 tx=0x7f80040191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:32.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.250+0000 7f80157fa640 1 -- 172.21.15.53:0/2893218486 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8004004230 con 0x7f80180cc690 2023-06-10T19:06:32.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.250+0000 7f80157fa640 1 -- 172.21.15.53:0/2893218486 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8004004390 con 0x7f80180cc690 2023-06-10T19:06:32.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.250+0000 7f801f1ac640 1 -- 172.21.15.53:0/2893218486 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80180c8820 con 0x7f80180cc690 2023-06-10T19:06:32.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.250+0000 7f80157fa640 1 -- 172.21.15.53:0/2893218486 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8004003820 con 0x7f80180cc690 2023-06-10T19:06:32.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.250+0000 7f801f1ac640 1 -- 172.21.15.53:0/2893218486 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80180c8de0 con 0x7f80180cc690 2023-06-10T19:06:32.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.250+0000 7f801f1ac640 1 -- 172.21.15.53:0/2893218486 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8018154fc0 con 0x7f80180cc690 2023-06-10T19:06:32.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.250+0000 7f80157fa640 1 -- 172.21.15.53:0/2893218486 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f80040b4040 con 0x7f80180cc690 2023-06-10T19:06:32.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.250+0000 7f80157fa640 1 --2- 172.21.15.53:0/2893218486 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7ffc066280 0x7f7ffc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:32.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.250+0000 7f80157fa640 1 -- 172.21.15.53:0/2893218486 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f800411e050 con 0x7f80180cc690 2023-06-10T19:06:32.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.250+0000 7f801cf48640 1 --2- 172.21.15.53:0/2893218486 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7ffc066280 0x7f7ffc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:32.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.250+0000 7f801cf48640 1 --2- 172.21.15.53:0/2893218486 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7ffc066280 0x7f7ffc068730 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f800c000f70 tx=0x7f800c007b60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:32.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.254+0000 7f80157fa640 1 -- 172.21.15.53:0/2893218486 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f80040eb560 con 0x7f80180cc690 2023-06-10T19:06:32.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.450+0000 7f801f1ac640 1 -- 172.21.15.53:0/2893218486 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8018155740 con 0x7f80180cc690 2023-06-10T19:06:32.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.450+0000 7f80157fa640 1 -- 172.21.15.53:0/2893218486 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) v1 ==== 94+0+4679 (secure 0 0 0) 0x7f80040eeb80 con 0x7f80180cc690 2023-06-10T19:06:32.452 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:06:32.452 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":89,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/67248348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":67248348},{"type":"v1","addr":"172.21.15.117:6835","nonce":67248348}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":84},{"gid":8296,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3907684243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":3907684243},{"type":"v1","addr":"172.21.15.117:6837","nonce":3907684243}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":84},{"gid":10038,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/1699177406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":1699177406},{"type":"v1","addr":"172.21.15.53:6833","nonce":1699177406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":84}],"filesystems":[{"mdsmap":{"epoch":89,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:06:28.716939+0000","modified":"2023-06-10T19:06:32.084420+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10044},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10044":{"gid":10044,"name":"a","rank":0,"incarnation":85,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/2077620799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2077620799},{"type":"v1","addr":"172.21.15.53:6835","nonce":2077620799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-06-10T19:06:32.453 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 89 2023-06-10T19:06:32.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.450+0000 7f801f1ac640 1 -- 172.21.15.53:0/2893218486 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7ffc066280 msgr2=0x7f7ffc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:32.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.450+0000 7f801f1ac640 1 --2- 172.21.15.53:0/2893218486 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7ffc066280 0x7f7ffc068730 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f800c000f70 tx=0x7f800c007b60 comp rx=0 tx=0).stop 2023-06-10T19:06:32.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.450+0000 7f801f1ac640 1 -- 172.21.15.53:0/2893218486 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80180cc690 msgr2=0x7f8018155200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:32.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.450+0000 7f801f1ac640 1 --2- 172.21.15.53:0/2893218486 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80180cc690 0x7f8018155200 secure :-1 s=READY pgs=2212 cs=0 l=1 rev1=1 crypto rx=0x7f800401ab00 tx=0x7f80040191f0 comp rx=0 tx=0).stop 2023-06-10T19:06:32.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.450+0000 7f801f1ac640 1 -- 172.21.15.53:0/2893218486 shutdown_connections 2023-06-10T19:06:32.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.450+0000 7f801f1ac640 1 --2- 172.21.15.53:0/2893218486 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7ffc066280 0x7f7ffc068730 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:32.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.450+0000 7f801f1ac640 1 --2- 172.21.15.53:0/2893218486 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80180ccae0 0x7f80181586b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:32.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.450+0000 7f801f1ac640 1 --2- 172.21.15.53:0/2893218486 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80180cc690 0x7f8018155200 unknown :-1 s=CLOSED pgs=2212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:32.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.450+0000 7f801f1ac640 1 --2- 172.21.15.53:0/2893218486 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f80180b3ac0 0x7f801815be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:32.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.450+0000 7f801f1ac640 1 -- 172.21.15.53:0/2893218486 >> 172.21.15.53:0/2893218486 conn(0x7f8018071790 msgr2=0x7f80180b1aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:32.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.450+0000 7f801f1ac640 1 -- 172.21.15.53:0/2893218486 shutdown_connections 2023-06-10T19:06:32.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.454+0000 7f801f1ac640 1 -- 172.21.15.53:0/2893218486 wait complete. 2023-06-10T19:06:32.472 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:06:32.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.598+0000 7f94879d3640 1 Processor -- start 2023-06-10T19:06:32.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.598+0000 7f94879d3640 1 -- start start 2023-06-10T19:06:32.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.598+0000 7f94879d3640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f94800cb870 0x7f94800af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:32.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.598+0000 7f94879d3640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f94800afc60 0x7f94800aba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:32.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.598+0000 7f94879d3640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94800b00a0 con 0x7f94800c9750 2023-06-10T19:06:32.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.598+0000 7f94879d3640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94800cd990 con 0x7f94800afc60 2023-06-10T19:06:32.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.598+0000 7f94879d3640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94801600d0 con 0x7f94800cb870 2023-06-10T19:06:32.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.598+0000 7f9485f70640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f94800afc60 0x7f94800aba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:32.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.598+0000 7f9485f70640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f94800afc60 0x7f94800aba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51044/0 (socket says 172.21.15.53:51044) 2023-06-10T19:06:32.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.598+0000 7f9485f70640 1 -- 172.21.15.53:0/3283252831 learned_addr learned my addr 172.21.15.53:0/3283252831 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:32.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.598+0000 7f948576f640 1 --1- 172.21.15.53:0/3283252831 >> v1:172.21.15.53:6789/0 conn(0x7f94800c9750 0x7f94800aced0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:37446/0 (socket says 172.21.15.53:37446) 2023-06-10T19:06:32.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.598+0000 7f9484f6e640 1 --2- 172.21.15.53:0/3283252831 >> v2:172.21.15.117:3300/0 conn(0x7f94800cb870 0x7f94800af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:32.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.598+0000 7f9485f70640 1 -- 172.21.15.53:0/3283252831 >> v2:172.21.15.117:3300/0 conn(0x7f94800cb870 msgr2=0x7f94800af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:32.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.598+0000 7f9485f70640 1 --2- 172.21.15.53:0/3283252831 >> v2:172.21.15.117:3300/0 conn(0x7f94800cb870 0x7f94800af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:32.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.598+0000 7f9485f70640 1 -- 172.21.15.53:0/3283252831 >> v1:172.21.15.53:6789/0 conn(0x7f94800c9750 legacy=0x7f94800aced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:32.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.598+0000 7f9477fff640 1 -- 172.21.15.53:0/3283252831 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4097101060 0 0) 0x7f94800b00a0 con 0x7f94800c9750 2023-06-10T19:06:32.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.598+0000 7f9485f70640 1 -- 172.21.15.53:0/3283252831 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9480160370 con 0x7f94800afc60 2023-06-10T19:06:32.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.598+0000 7f9484f6e640 1 --2- 172.21.15.53:0/3283252831 >> v2:172.21.15.117:3300/0 conn(0x7f94800cb870 0x7f94800af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:06:32.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.602+0000 7f9485f70640 1 --2- 172.21.15.53:0/3283252831 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f94800afc60 0x7f94800aba10 secure :-1 s=READY pgs=2214 cs=0 l=1 rev1=1 crypto rx=0x7f948015d0a0 tx=0x7f947801c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ada70dceae5d6881 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:32.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.602+0000 7f9477fff640 1 -- 172.21.15.53:0/3283252831 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94780a57a0 con 0x7f94800afc60 2023-06-10T19:06:32.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.602+0000 7f9477fff640 1 -- 172.21.15.53:0/3283252831 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94780a5900 con 0x7f94800afc60 2023-06-10T19:06:32.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.602+0000 7f9477fff640 1 -- 172.21.15.53:0/3283252831 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94780a5c90 con 0x7f94800afc60 2023-06-10T19:06:32.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.602+0000 7f94879d3640 1 -- 172.21.15.53:0/3283252831 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f94800afc60 msgr2=0x7f94800aba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:32.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.602+0000 7f94879d3640 1 --2- 172.21.15.53:0/3283252831 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f94800afc60 0x7f94800aba10 secure :-1 s=READY pgs=2214 cs=0 l=1 rev1=1 crypto rx=0x7f948015d0a0 tx=0x7f947801c9d0 comp rx=0 tx=0).stop 2023-06-10T19:06:32.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.602+0000 7f94879d3640 1 -- 172.21.15.53:0/3283252831 shutdown_connections 2023-06-10T19:06:32.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.602+0000 7f94879d3640 1 --2- 172.21.15.53:0/3283252831 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f94800afc60 0x7f94800aba10 unknown :-1 s=CLOSED pgs=2214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:32.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.602+0000 7f94879d3640 1 --2- 172.21.15.53:0/3283252831 >> v2:172.21.15.117:3300/0 conn(0x7f94800cb870 0x7f94800af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:32.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.602+0000 7f94879d3640 1 -- 172.21.15.53:0/3283252831 >> 172.21.15.53:0/3283252831 conn(0x7f948006a0d0 msgr2=0x7f94800ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:32.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.602+0000 7f94879d3640 1 -- 172.21.15.53:0/3283252831 shutdown_connections 2023-06-10T19:06:32.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.602+0000 7f94879d3640 1 -- 172.21.15.53:0/3283252831 wait complete. 2023-06-10T19:06:32.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.602+0000 7f94879d3640 1 Processor -- start 2023-06-10T19:06:32.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.602+0000 7f94879d3640 1 -- start start 2023-06-10T19:06:32.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.602+0000 7f94879d3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f94800afc60 0x7f94800b1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:32.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.602+0000 7f94879d3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94800c9750 0x7f9480154520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:32.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.602+0000 7f94879d3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94800cb870 0x7f9480154c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:32.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.602+0000 7f94879d3640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94800b17b0 con 0x7f94800afc60 2023-06-10T19:06:32.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.602+0000 7f94879d3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94800b0b70 con 0x7f94800cb870 2023-06-10T19:06:32.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.602+0000 7f94879d3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9480154a60 con 0x7f94800c9750 2023-06-10T19:06:32.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.602+0000 7f948576f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f94800afc60 0x7f94800b1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:32.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.602+0000 7f948576f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f94800afc60 0x7f94800b1bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51054/0 (socket says 172.21.15.53:51054) 2023-06-10T19:06:32.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.602+0000 7f948576f640 1 -- 172.21.15.53:0/4184788525 learned_addr learned my addr 172.21.15.53:0/4184788525 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:32.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.602+0000 7f9484f6e640 1 --2- 172.21.15.53:0/4184788525 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94800c9750 0x7f9480154520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:32.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.602+0000 7f9485f70640 1 --2- 172.21.15.53:0/4184788525 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94800cb870 0x7f9480154c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:32.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.602+0000 7f948576f640 1 -- 172.21.15.53:0/4184788525 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94800c9750 msgr2=0x7f9480154520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:32.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.602+0000 7f948576f640 1 --2- 172.21.15.53:0/4184788525 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94800c9750 0x7f9480154520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:32.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.602+0000 7f948576f640 1 -- 172.21.15.53:0/4184788525 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94800cb870 msgr2=0x7f9480154c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:32.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.602+0000 7f948576f640 1 --2- 172.21.15.53:0/4184788525 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94800cb870 0x7f9480154c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:32.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.602+0000 7f948576f640 1 -- 172.21.15.53:0/4184788525 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9478009b30 con 0x7f94800afc60 2023-06-10T19:06:32.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.602+0000 7f9485f70640 1 --2- 172.21.15.53:0/4184788525 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94800cb870 0x7f9480154c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:06:32.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.606+0000 7f948576f640 1 --2- 172.21.15.53:0/4184788525 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f94800afc60 0x7f94800b1bd0 secure :-1 s=READY pgs=2215 cs=0 l=1 rev1=1 crypto rx=0x7f94700011f0 tx=0x7f947000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:32.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.606+0000 7f9475ffb640 1 -- 172.21.15.53:0/4184788525 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94700074e0 con 0x7f94800afc60 2023-06-10T19:06:32.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.606+0000 7f9475ffb640 1 -- 172.21.15.53:0/4184788525 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9470007640 con 0x7f94800afc60 2023-06-10T19:06:32.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.606+0000 7f94879d3640 1 -- 172.21.15.53:0/4184788525 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94800b0e10 con 0x7f94800afc60 2023-06-10T19:06:32.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.606+0000 7f9475ffb640 1 -- 172.21.15.53:0/4184788525 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9470004a10 con 0x7f94800afc60 2023-06-10T19:06:32.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.606+0000 7f94879d3640 1 -- 172.21.15.53:0/4184788525 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94800b13d0 con 0x7f94800afc60 2023-06-10T19:06:32.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.606+0000 7f94879d3640 1 -- 172.21.15.53:0/4184788525 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f948004d790 con 0x7f94800afc60 2023-06-10T19:06:32.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.606+0000 7f9475ffb640 1 -- 172.21.15.53:0/4184788525 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9470004b70 con 0x7f94800afc60 2023-06-10T19:06:32.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.606+0000 7f9475ffb640 1 --2- 172.21.15.53:0/4184788525 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9464066280 0x7f9464068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:32.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.606+0000 7f9475ffb640 1 -- 172.21.15.53:0/4184788525 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9470082ef0 con 0x7f94800afc60 2023-06-10T19:06:32.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.606+0000 7f9484f6e640 1 --2- 172.21.15.53:0/4184788525 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9464066280 0x7f9464068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:32.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.606+0000 7f9484f6e640 1 --2- 172.21.15.53:0/4184788525 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9464066280 0x7f9464068730 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f947c006fd0 tx=0x7f947c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:32.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.610+0000 7f9475ffb640 1 -- 172.21.15.53:0/4184788525 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9470050370 con 0x7f94800afc60 2023-06-10T19:06:32.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.770+0000 7f94879d3640 1 -- 172.21.15.53:0/4184788525 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9480155720 con 0x7f94800afc60 2023-06-10T19:06:32.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.770+0000 7f9475ffb640 1 -- 172.21.15.53:0/4184788525 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v154) v1 ==== 74+0+18289 (secure 0 0 0) 0x7f9470018020 con 0x7f94800afc60 2023-06-10T19:06:32.773 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:06:32.773 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":154,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:06:29.721223+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-06-10T19:06:27.279397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-06-10T19:06:27.689260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"154","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:06:32.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.774+0000 7f94879d3640 1 -- 172.21.15.53:0/4184788525 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9464066280 msgr2=0x7f9464068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:32.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.774+0000 7f94879d3640 1 --2- 172.21.15.53:0/4184788525 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9464066280 0x7f9464068730 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f947c006fd0 tx=0x7f947c008040 comp rx=0 tx=0).stop 2023-06-10T19:06:32.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.774+0000 7f94879d3640 1 -- 172.21.15.53:0/4184788525 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f94800afc60 msgr2=0x7f94800b1bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:32.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.774+0000 7f94879d3640 1 --2- 172.21.15.53:0/4184788525 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f94800afc60 0x7f94800b1bd0 secure :-1 s=READY pgs=2215 cs=0 l=1 rev1=1 crypto rx=0x7f94700011f0 tx=0x7f947000c9b0 comp rx=0 tx=0).stop 2023-06-10T19:06:32.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.774+0000 7f94879d3640 1 -- 172.21.15.53:0/4184788525 shutdown_connections 2023-06-10T19:06:32.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.774+0000 7f94879d3640 1 --2- 172.21.15.53:0/4184788525 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9464066280 0x7f9464068730 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:32.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.774+0000 7f94879d3640 1 --2- 172.21.15.53:0/4184788525 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94800cb870 0x7f9480154c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:32.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.774+0000 7f94879d3640 1 --2- 172.21.15.53:0/4184788525 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f94800c9750 0x7f9480154520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:32.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.774+0000 7f94879d3640 1 --2- 172.21.15.53:0/4184788525 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f94800afc60 0x7f94800b1bd0 unknown :-1 s=CLOSED pgs=2215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:32.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.774+0000 7f94879d3640 1 -- 172.21.15.53:0/4184788525 >> 172.21.15.53:0/4184788525 conn(0x7f948006a0d0 msgr2=0x7f948015f440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:32.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.774+0000 7f94879d3640 1 -- 172.21.15.53:0/4184788525 shutdown_connections 2023-06-10T19:06:32.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.774+0000 7f94879d3640 1 -- 172.21.15.53:0/4184788525 wait complete. 2023-06-10T19:06:32.793 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-06-10T19:06:32.794 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-10T19:06:32.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.910+0000 7fbae4998640 1 Processor -- start 2023-06-10T19:06:32.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.910+0000 7fbae4998640 1 -- start start 2023-06-10T19:06:32.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.914+0000 7fbae4998640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbae00c9840 0x7fbae00c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:32.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.914+0000 7fbae4998640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbae006b090 0x7fbae006b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:32.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.914+0000 7fbae4998640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbae0159b50 con 0x7fbae0071060 2023-06-10T19:06:32.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.914+0000 7fbae4998640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbae00ca150 con 0x7fbae006b090 2023-06-10T19:06:32.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.914+0000 7fbae4998640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbae00702a0 con 0x7fbae00c9840 2023-06-10T19:06:32.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.914+0000 7fbaddd9b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fbae0071060 0x7fbae00af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:37448/0 (socket says 172.21.15.53:37448) 2023-06-10T19:06:32.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.914+0000 7fbaddd9b640 1 -- 172.21.15.53:0/1254060214 learned_addr learned my addr 172.21.15.53:0/1254060214 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:06:32.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.914+0000 7fbade59c640 1 --2- 172.21.15.53:0/1254060214 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbae00c9840 0x7fbae00c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:32.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.914+0000 7fbaded9d640 1 --2- 172.21.15.53:0/1254060214 >> v2:172.21.15.117:3300/0 conn(0x7fbae006b090 0x7fbae006b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:32.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.914+0000 7fbadd59a640 1 -- 172.21.15.53:0/1254060214 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4285600337 0 0) 0x7fbae0159b50 con 0x7fbae0071060 2023-06-10T19:06:32.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.914+0000 7fbadd59a640 1 -- 172.21.15.53:0/1254060214 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbac8003530 con 0x7fbae0071060 2023-06-10T19:06:32.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.914+0000 7fbadd59a640 1 -- 172.21.15.53:0/1254060214 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 112981580 0 0) 0x7fbac8003530 con 0x7fbae0071060 2023-06-10T19:06:32.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.914+0000 7fbadd59a640 1 -- 172.21.15.53:0/1254060214 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbae00c9840 msgr2=0x7fbae00c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:32.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.914+0000 7fbadd59a640 1 --2- 172.21.15.53:0/1254060214 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbae00c9840 0x7fbae00c9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:32.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.914+0000 7fbadd59a640 1 -- 172.21.15.53:0/1254060214 >> v2:172.21.15.117:3300/0 conn(0x7fbae006b090 msgr2=0x7fbae006b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:32.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.914+0000 7fbadd59a640 1 --2- 172.21.15.53:0/1254060214 >> v2:172.21.15.117:3300/0 conn(0x7fbae006b090 0x7fbae006b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:32.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.914+0000 7fbadd59a640 1 -- 172.21.15.53:0/1254060214 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbae0070580 con 0x7fbae0071060 2023-06-10T19:06:32.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.914+0000 7fbadd59a640 1 -- 172.21.15.53:0/1254060214 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fbad4001680 con 0x7fbae0071060 2023-06-10T19:06:32.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.914+0000 7fbadd59a640 1 -- 172.21.15.53:0/1254060214 >> v1:172.21.15.53:6789/0 conn(0x7fbae0071060 legacy=0x7fbae00af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:32.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.914+0000 7fbadd59a640 1 --2- 172.21.15.53:0/1254060214 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbac80039f0 0x7fbac8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:32.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.914+0000 7fbadd59a640 1 --2- 172.21.15.53:0/1254060214 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbac80047d0 0x7fbac8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:32.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.914+0000 7fbadd59a640 1 --2- 172.21.15.53:0/1254060214 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbae00c9840 0x7fbac8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:32.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.914+0000 7fbadd59a640 1 -- 172.21.15.53:0/1254060214 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbae00ca150 con 0x7fbac80047d0 2023-06-10T19:06:32.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.914+0000 7fbadd59a640 1 -- 172.21.15.53:0/1254060214 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbae00702a0 con 0x7fbac80039f0 2023-06-10T19:06:32.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.914+0000 7fbadd59a640 1 -- 172.21.15.53:0/1254060214 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbac800fda0 con 0x7fbae00c9840 2023-06-10T19:06:32.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.914+0000 7fbaddd9b640 1 --2- 172.21.15.53:0/1254060214 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbac80047d0 0x7fbac8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:32.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.914+0000 7fbaded9d640 1 --2- 172.21.15.53:0/1254060214 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbae00c9840 0x7fbac8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:32.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.914+0000 7fbaddd9b640 1 -- 172.21.15.53:0/1254060214 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbae00c9840 msgr2=0x7fbac8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:32.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.914+0000 7fbaddd9b640 1 --2- 172.21.15.53:0/1254060214 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbae00c9840 0x7fbac8005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:32.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.914+0000 7fbade59c640 1 --2- 172.21.15.53:0/1254060214 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbac80039f0 0x7fbac8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:32.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.914+0000 7fbaddd9b640 1 -- 172.21.15.53:0/1254060214 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbac80039f0 msgr2=0x7fbac8003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:32.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.914+0000 7fbaddd9b640 1 --2- 172.21.15.53:0/1254060214 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbac80039f0 0x7fbac8003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:32.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.914+0000 7fbaddd9b640 1 -- 172.21.15.53:0/1254060214 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbac8003530 con 0x7fbac80047d0 2023-06-10T19:06:32.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.914+0000 7fbade59c640 1 --2- 172.21.15.53:0/1254060214 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbac80039f0 0x7fbac8003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:06:32.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.914+0000 7fbaddd9b640 1 --2- 172.21.15.53:0/1254060214 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbac80047d0 0x7fbac8004c40 secure :-1 s=READY pgs=2217 cs=0 l=1 rev1=1 crypto rx=0x7fbad400c210 tx=0x7fbad401f390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4095144cf4b9967 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:32.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.918+0000 7fbadd59a640 1 -- 172.21.15.53:0/1254060214 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad4005ae0 con 0x7fbac80047d0 2023-06-10T19:06:32.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.918+0000 7fbadd59a640 1 -- 172.21.15.53:0/1254060214 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbad40ab070 con 0x7fbac80047d0 2023-06-10T19:06:32.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.918+0000 7fbadd59a640 1 -- 172.21.15.53:0/1254060214 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad4005ea0 con 0x7fbac80047d0 2023-06-10T19:06:32.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.918+0000 7fbae4998640 1 -- 172.21.15.53:0/1254060214 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbac80047d0 msgr2=0x7fbac8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:32.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.918+0000 7fbae4998640 1 --2- 172.21.15.53:0/1254060214 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbac80047d0 0x7fbac8004c40 secure :-1 s=READY pgs=2217 cs=0 l=1 rev1=1 crypto rx=0x7fbad400c210 tx=0x7fbad401f390 comp rx=0 tx=0).stop 2023-06-10T19:06:32.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.918+0000 7fbaded9d640 1 -- 172.21.15.53:0/1254060214 reap_dead start 2023-06-10T19:06:32.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.918+0000 7fbae4998640 1 -- 172.21.15.53:0/1254060214 shutdown_connections 2023-06-10T19:06:32.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.918+0000 7fbae4998640 1 -- 172.21.15.53:0/1254060214 >> 172.21.15.53:0/1254060214 conn(0x7fbae006a0d0 msgr2=0x7fbae00ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:32.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.918+0000 7fbae4998640 1 -- 172.21.15.53:0/1254060214 shutdown_connections 2023-06-10T19:06:32.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.918+0000 7fbae4998640 1 -- 172.21.15.53:0/1254060214 wait complete. 2023-06-10T19:06:32.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.918+0000 7fbae4998640 1 Processor -- start 2023-06-10T19:06:32.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.918+0000 7fbae4998640 1 -- start start 2023-06-10T19:06:32.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.918+0000 7fbae4998640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbac80047d0 0x7fbae00aeba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:32.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.918+0000 7fbae4998640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbae00c17d0 0x7fbae00c1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:32.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.918+0000 7fbae4998640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbae00c3800 0x7fbae00c3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:32.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.918+0000 7fbae4998640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbae00c4750 con 0x7fbac80047d0 2023-06-10T19:06:32.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.918+0000 7fbae4998640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbae00c2160 con 0x7fbae00c17d0 2023-06-10T19:06:32.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.918+0000 7fbae4998640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbae00af0e0 con 0x7fbae00c3800 2023-06-10T19:06:32.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.918+0000 7fbade59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbac80047d0 0x7fbae00aeba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:32.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.918+0000 7fbade59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbac80047d0 0x7fbae00aeba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51086/0 (socket says 172.21.15.53:51086) 2023-06-10T19:06:32.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.918+0000 7fbade59c640 1 -- 172.21.15.53:0/3800584740 learned_addr learned my addr 172.21.15.53:0/3800584740 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:32.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.918+0000 7fbaddd9b640 1 --2- 172.21.15.53:0/3800584740 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbae00c17d0 0x7fbae00c1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:32.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.918+0000 7fbaded9d640 1 --2- 172.21.15.53:0/3800584740 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbae00c3800 0x7fbae00c3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:32.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.918+0000 7fbade59c640 1 -- 172.21.15.53:0/3800584740 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbae00c3800 msgr2=0x7fbae00c3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:32.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.918+0000 7fbade59c640 1 --2- 172.21.15.53:0/3800584740 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbae00c3800 0x7fbae00c3c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:32.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.918+0000 7fbade59c640 1 -- 172.21.15.53:0/3800584740 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbae00c17d0 msgr2=0x7fbae00c1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:32.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.918+0000 7fbade59c640 1 --2- 172.21.15.53:0/3800584740 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbae00c17d0 0x7fbae00c1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:32.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.918+0000 7fbade59c640 1 -- 172.21.15.53:0/3800584740 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbae00c41b0 con 0x7fbac80047d0 2023-06-10T19:06:32.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.918+0000 7fbade59c640 1 --2- 172.21.15.53:0/3800584740 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbac80047d0 0x7fbae00aeba0 secure :-1 s=READY pgs=2218 cs=0 l=1 rev1=1 crypto rx=0x7fbad0010900 tx=0x7fbad0010dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:32.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.918+0000 7fbaceffd640 1 -- 172.21.15.53:0/3800584740 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad0004220 con 0x7fbac80047d0 2023-06-10T19:06:32.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.918+0000 7fbaceffd640 1 -- 172.21.15.53:0/3800584740 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbad0004380 con 0x7fbac80047d0 2023-06-10T19:06:32.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.918+0000 7fbaceffd640 1 -- 172.21.15.53:0/3800584740 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad000eb80 con 0x7fbac80047d0 2023-06-10T19:06:32.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.922+0000 7fbae4998640 1 -- 172.21.15.53:0/3800584740 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbae00c4470 con 0x7fbac80047d0 2023-06-10T19:06:32.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.922+0000 7fbae4998640 1 -- 172.21.15.53:0/3800584740 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbae00b1620 con 0x7fbac80047d0 2023-06-10T19:06:32.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.922+0000 7fbae4998640 1 -- 172.21.15.53:0/3800584740 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbae00b11a0 con 0x7fbac80047d0 2023-06-10T19:06:32.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.922+0000 7fbaceffd640 1 -- 172.21.15.53:0/3800584740 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbad000ece0 con 0x7fbac80047d0 2023-06-10T19:06:32.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.922+0000 7fbaceffd640 1 --2- 172.21.15.53:0/3800584740 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbac0066280 0x7fbac0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:32.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.922+0000 7fbaceffd640 1 -- 172.21.15.53:0/3800584740 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbad0083b80 con 0x7fbac80047d0 2023-06-10T19:06:32.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.922+0000 7fbaddd9b640 1 --2- 172.21.15.53:0/3800584740 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbac0066280 0x7fbac0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:32.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.922+0000 7fbaddd9b640 1 --2- 172.21.15.53:0/3800584740 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbac0066280 0x7fbac0068730 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fbad40ae000 tx=0x7fbad40b4040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:32.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:32.926+0000 7fbaceffd640 1 -- 172.21.15.53:0/3800584740 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbae00b11a0 con 0x7fbac80047d0 2023-06-10T19:06:33.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.074+0000 7fbae4998640 1 -- 172.21.15.53:0/3800584740 --> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbae0070b40 con 0x7fbac0066280 2023-06-10T19:06:33.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.098+0000 7fbaceffd640 1 -- 172.21.15.53:0/3800584740 <== mgr.4105 v2:172.21.15.117:6832/3061986771 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+297902 (secure 0 0 0) 0x7fbad40b8040 con 0x7fbac0066280 2023-06-10T19:06:33.102 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:06:33.105 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-06-10T19:06:33.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.102+0000 7fbae4998640 1 -- 172.21.15.53:0/3800584740 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbac0066280 msgr2=0x7fbac0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:33.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.102+0000 7fbae4998640 1 --2- 172.21.15.53:0/3800584740 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbac0066280 0x7fbac0068730 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fbad40ae000 tx=0x7fbad40b4040 comp rx=0 tx=0).stop 2023-06-10T19:06:33.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.102+0000 7fbae4998640 1 -- 172.21.15.53:0/3800584740 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbac80047d0 msgr2=0x7fbae00aeba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:33.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.102+0000 7fbae4998640 1 --2- 172.21.15.53:0/3800584740 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbac80047d0 0x7fbae00aeba0 secure :-1 s=READY pgs=2218 cs=0 l=1 rev1=1 crypto rx=0x7fbad0010900 tx=0x7fbad0010dc0 comp rx=0 tx=0).stop 2023-06-10T19:06:33.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.102+0000 7fbae4998640 1 -- 172.21.15.53:0/3800584740 shutdown_connections 2023-06-10T19:06:33.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.102+0000 7fbae4998640 1 --2- 172.21.15.53:0/3800584740 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbac0066280 0x7fbac0068730 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:33.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.102+0000 7fbae4998640 1 --2- 172.21.15.53:0/3800584740 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbae00c3800 0x7fbae00c3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:33.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.102+0000 7fbae4998640 1 --2- 172.21.15.53:0/3800584740 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbae00c17d0 0x7fbae00c1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:33.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.102+0000 7fbae4998640 1 --2- 172.21.15.53:0/3800584740 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbac80047d0 0x7fbae00aeba0 unknown :-1 s=CLOSED pgs=2218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:33.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.102+0000 7fbae4998640 1 -- 172.21.15.53:0/3800584740 >> 172.21.15.53:0/3800584740 conn(0x7fbae006a0d0 msgr2=0x7fbae01568c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:33.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.102+0000 7fbae4998640 1 -- 172.21.15.53:0/3800584740 shutdown_connections 2023-06-10T19:06:33.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.102+0000 7fbae4998640 1 -- 172.21.15.53:0/3800584740 wait complete. 2023-06-10T19:06:33.124 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":567,"stamp":"2023-06-10T19:06:31.858001+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":72,"acting":72,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":21,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":276512,"kb_used_data":15840,"kb_used_omap":0,"kb_used_meta":260608,"kb_avail":754698208,"statfs":{"total":773094113280,"available":772810964992,"internally_reserved":0,"allocated":16220160,"data_stored":8170149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":266862592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.527339"},"pg_stats":[{"pgid":"22.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:27.323985+0000","last_change":"2023-06-10T19:06:27.323985+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.323985+0000","last_undegraded":"2023-06-10T19:06:27.323985+0000","last_fullsized":"2023-06-10T19:06:27.323985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":1,"reported_epoch":151,"state":"creating+peering","last_fresh":"2023-06-10T19:06:27.346493+0000","last_change":"2023-06-10T19:06:27.346493+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.346493+0000","last_undegraded":"2023-06-10T19:06:27.346493+0000","last_fullsized":"2023-06-10T19:06:27.346493+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":1,"reported_epoch":151,"state":"creating+peering","last_fresh":"2023-06-10T19:06:27.344670+0000","last_change":"2023-06-10T19:06:27.344670+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.344670+0000","last_undegraded":"2023-06-10T19:06:27.344670+0000","last_fullsized":"2023-06-10T19:06:27.344670+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":1,"reported_epoch":151,"state":"creating+peering","last_fresh":"2023-06-10T19:06:27.332884+0000","last_change":"2023-06-10T19:06:27.332884+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.332884+0000","last_undegraded":"2023-06-10T19:06:27.332884+0000","last_fullsized":"2023-06-10T19:06:27.332884+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":1,"reported_epoch":151,"state":"creating+peering","last_fresh":"2023-06-10T19:06:27.333545+0000","last_change":"2023-06-10T19:06:27.333545+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.333545+0000","last_undegraded":"2023-06-10T19:06:27.333545+0000","last_fullsized":"2023-06-10T19:06:27.333545+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:27.323985+0000","last_change":"2023-06-10T19:06:27.323985+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.323985+0000","last_undegraded":"2023-06-10T19:06:27.323985+0000","last_fullsized":"2023-06-10T19:06:27.323985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":1,"reported_epoch":151,"state":"creating+peering","last_fresh":"2023-06-10T19:06:27.350149+0000","last_change":"2023-06-10T19:06:27.350149+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.350149+0000","last_undegraded":"2023-06-10T19:06:27.350149+0000","last_fullsized":"2023-06-10T19:06:27.350149+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:27.323985+0000","last_change":"2023-06-10T19:06:27.323985+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.323985+0000","last_undegraded":"2023-06-10T19:06:27.323985+0000","last_fullsized":"2023-06-10T19:06:27.323985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":1,"reported_epoch":151,"state":"creating+peering","last_fresh":"2023-06-10T19:06:27.340406+0000","last_change":"2023-06-10T19:06:27.340406+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.340406+0000","last_undegraded":"2023-06-10T19:06:27.340406+0000","last_fullsized":"2023-06-10T19:06:27.340406+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":1,"reported_epoch":151,"state":"creating+peering","last_fresh":"2023-06-10T19:06:27.344986+0000","last_change":"2023-06-10T19:06:27.344986+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.344986+0000","last_undegraded":"2023-06-10T19:06:27.344986+0000","last_fullsized":"2023-06-10T19:06:27.344986+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":1,"reported_epoch":151,"state":"creating+peering","last_fresh":"2023-06-10T19:06:27.333557+0000","last_change":"2023-06-10T19:06:27.333557+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.333557+0000","last_undegraded":"2023-06-10T19:06:27.333557+0000","last_fullsized":"2023-06-10T19:06:27.333557+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":1,"reported_epoch":151,"state":"creating+peering","last_fresh":"2023-06-10T19:06:27.337976+0000","last_change":"2023-06-10T19:06:27.337976+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.337976+0000","last_undegraded":"2023-06-10T19:06:27.337976+0000","last_fullsized":"2023-06-10T19:06:27.337976+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":1,"reported_epoch":151,"state":"creating+peering","last_fresh":"2023-06-10T19:06:27.330418+0000","last_change":"2023-06-10T19:06:27.330418+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.330418+0000","last_undegraded":"2023-06-10T19:06:27.330418+0000","last_fullsized":"2023-06-10T19:06:27.330418+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":1,"reported_epoch":151,"state":"creating+peering","last_fresh":"2023-06-10T19:06:27.333586+0000","last_change":"2023-06-10T19:06:27.333586+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.333586+0000","last_undegraded":"2023-06-10T19:06:27.333586+0000","last_fullsized":"2023-06-10T19:06:27.333586+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":1,"reported_epoch":151,"state":"creating+peering","last_fresh":"2023-06-10T19:06:27.330409+0000","last_change":"2023-06-10T19:06:27.330409+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.330409+0000","last_undegraded":"2023-06-10T19:06:27.330409+0000","last_fullsized":"2023-06-10T19:06:27.330409+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":1,"reported_epoch":151,"state":"creating+peering","last_fresh":"2023-06-10T19:06:27.333635+0000","last_change":"2023-06-10T19:06:27.333635+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.333635+0000","last_undegraded":"2023-06-10T19:06:27.333635+0000","last_fullsized":"2023-06-10T19:06:27.333635+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":1,"reported_epoch":151,"state":"creating+peering","last_fresh":"2023-06-10T19:06:27.339024+0000","last_change":"2023-06-10T19:06:27.339024+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.339024+0000","last_undegraded":"2023-06-10T19:06:27.339024+0000","last_fullsized":"2023-06-10T19:06:27.339024+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":1,"reported_epoch":151,"state":"creating+peering","last_fresh":"2023-06-10T19:06:27.348835+0000","last_change":"2023-06-10T19:06:27.348835+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.348835+0000","last_undegraded":"2023-06-10T19:06:27.348835+0000","last_fullsized":"2023-06-10T19:06:27.348835+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":1,"reported_epoch":151,"state":"creating+peering","last_fresh":"2023-06-10T19:06:27.333062+0000","last_change":"2023-06-10T19:06:27.333062+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.333062+0000","last_undegraded":"2023-06-10T19:06:27.333062+0000","last_fullsized":"2023-06-10T19:06:27.333062+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:27.323985+0000","last_change":"2023-06-10T19:06:27.323985+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.323985+0000","last_undegraded":"2023-06-10T19:06:27.323985+0000","last_fullsized":"2023-06-10T19:06:27.323985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":1,"reported_epoch":151,"state":"creating+peering","last_fresh":"2023-06-10T19:06:27.348787+0000","last_change":"2023-06-10T19:06:27.348787+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.348787+0000","last_undegraded":"2023-06-10T19:06:27.348787+0000","last_fullsized":"2023-06-10T19:06:27.348787+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":1,"reported_epoch":151,"state":"creating+peering","last_fresh":"2023-06-10T19:06:27.340422+0000","last_change":"2023-06-10T19:06:27.340422+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.340422+0000","last_undegraded":"2023-06-10T19:06:27.340422+0000","last_fullsized":"2023-06-10T19:06:27.340422+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":1,"reported_epoch":151,"state":"creating+peering","last_fresh":"2023-06-10T19:06:27.348737+0000","last_change":"2023-06-10T19:06:27.348737+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.348737+0000","last_undegraded":"2023-06-10T19:06:27.348737+0000","last_fullsized":"2023-06-10T19:06:27.348737+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":1,"reported_epoch":151,"state":"creating+peering","last_fresh":"2023-06-10T19:06:27.344861+0000","last_change":"2023-06-10T19:06:27.344861+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.344861+0000","last_undegraded":"2023-06-10T19:06:27.344861+0000","last_fullsized":"2023-06-10T19:06:27.344861+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":1,"reported_epoch":151,"state":"creating+peering","last_fresh":"2023-06-10T19:06:27.330573+0000","last_change":"2023-06-10T19:06:27.330573+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.330573+0000","last_undegraded":"2023-06-10T19:06:27.330573+0000","last_fullsized":"2023-06-10T19:06:27.330573+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":389,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-06-10T19:06:27.347308+0000","last_change":"2023-06-10T18:52:34.951528+0000","last_active":"2023-06-10T19:06:27.347308+0000","last_peered":"2023-06-10T19:06:27.347308+0000","last_clean":"2023-06-10T19:06:27.347308+0000","last_became_active":"2023-06-10T18:52:34.949099+0000","last_became_peered":"2023-06-10T18:52:34.949099+0000","last_unstale":"2023-06-10T19:06:27.347308+0000","last_undegraded":"2023-06-10T19:06:27.347308+0000","last_fullsized":"2023-06-10T19:06:27.347308+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_clean_scrub_stamp":"2023-06-10T18:52:33.633295+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:02:14.381678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":255,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-06-10T19:06:27.352091+0000","last_change":"2023-06-10T18:52:40.506384+0000","last_active":"2023-06-10T19:06:27.352091+0000","last_peered":"2023-06-10T19:06:27.352091+0000","last_clean":"2023-06-10T19:06:27.352091+0000","last_became_active":"2023-06-10T18:52:40.505701+0000","last_became_peered":"2023-06-10T18:52:40.505701+0000","last_unstale":"2023-06-10T19:06:27.352091+0000","last_undegraded":"2023-06-10T19:06:27.352091+0000","last_fullsized":"2023-06-10T19:06:27.352091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:12:31.850971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":1,"reported_epoch":151,"state":"creating+peering","last_fresh":"2023-06-10T19:06:27.344973+0000","last_change":"2023-06-10T19:06:27.344973+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.344973+0000","last_undegraded":"2023-06-10T19:06:27.344973+0000","last_fullsized":"2023-06-10T19:06:27.344973+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":233,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-06-10T19:06:27.347292+0000","last_change":"2023-06-10T18:52:40.512015+0000","last_active":"2023-06-10T19:06:27.347292+0000","last_peered":"2023-06-10T19:06:27.347292+0000","last_clean":"2023-06-10T19:06:27.347292+0000","last_became_active":"2023-06-10T18:52:40.511382+0000","last_became_peered":"2023-06-10T18:52:40.511382+0000","last_unstale":"2023-06-10T19:06:27.347292+0000","last_undegraded":"2023-06-10T19:06:27.347292+0000","last_fullsized":"2023-06-10T19:06:27.347292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:47:27.116209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":1,"reported_epoch":151,"state":"creating+peering","last_fresh":"2023-06-10T19:06:27.350114+0000","last_change":"2023-06-10T19:06:27.350114+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.350114+0000","last_undegraded":"2023-06-10T19:06:27.350114+0000","last_fullsized":"2023-06-10T19:06:27.350114+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":253,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-06-10T19:06:27.341460+0000","last_change":"2023-06-10T18:52:40.671725+0000","last_active":"2023-06-10T19:06:27.341460+0000","last_peered":"2023-06-10T19:06:27.341460+0000","last_clean":"2023-06-10T19:06:27.341460+0000","last_became_active":"2023-06-10T18:52:40.671442+0000","last_became_peered":"2023-06-10T18:52:40.671442+0000","last_unstale":"2023-06-10T19:06:27.341460+0000","last_undegraded":"2023-06-10T19:06:27.341460+0000","last_fullsized":"2023-06-10T19:06:27.341460+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:39:40.376529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":1,"reported_epoch":151,"state":"creating+peering","last_fresh":"2023-06-10T19:06:27.340003+0000","last_change":"2023-06-10T19:06:27.340003+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.340003+0000","last_undegraded":"2023-06-10T19:06:27.340003+0000","last_fullsized":"2023-06-10T19:06:27.340003+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":255,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-06-10T19:06:27.351589+0000","last_change":"2023-06-10T18:52:40.510258+0000","last_active":"2023-06-10T19:06:27.351589+0000","last_peered":"2023-06-10T19:06:27.351589+0000","last_clean":"2023-06-10T19:06:27.351589+0000","last_became_active":"2023-06-10T18:52:40.509560+0000","last_became_peered":"2023-06-10T18:52:40.509560+0000","last_unstale":"2023-06-10T19:06:27.351589+0000","last_undegraded":"2023-06-10T19:06:27.351589+0000","last_fullsized":"2023-06-10T19:06:27.351589+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:50:05.648602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:27.323985+0000","last_change":"2023-06-10T19:06:27.323985+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.323985+0000","last_undegraded":"2023-06-10T19:06:27.323985+0000","last_fullsized":"2023-06-10T19:06:27.323985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":233,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-06-10T19:06:27.334081+0000","last_change":"2023-06-10T18:52:40.672266+0000","last_active":"2023-06-10T19:06:27.334081+0000","last_peered":"2023-06-10T19:06:27.334081+0000","last_clean":"2023-06-10T19:06:27.334081+0000","last_became_active":"2023-06-10T18:52:40.671966+0000","last_became_peered":"2023-06-10T18:52:40.671966+0000","last_unstale":"2023-06-10T19:06:27.334081+0000","last_undegraded":"2023-06-10T19:06:27.334081+0000","last_fullsized":"2023-06-10T19:06:27.334081+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:10:16.750337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":1,"reported_epoch":151,"state":"creating+peering","last_fresh":"2023-06-10T19:06:27.338587+0000","last_change":"2023-06-10T19:06:27.338587+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.338587+0000","last_undegraded":"2023-06-10T19:06:27.338587+0000","last_fullsized":"2023-06-10T19:06:27.338587+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":233,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-06-10T19:06:27.347346+0000","last_change":"2023-06-10T18:52:40.671084+0000","last_active":"2023-06-10T19:06:27.347346+0000","last_peered":"2023-06-10T19:06:27.347346+0000","last_clean":"2023-06-10T19:06:27.347346+0000","last_became_active":"2023-06-10T18:52:40.670697+0000","last_became_peered":"2023-06-10T18:52:40.670697+0000","last_unstale":"2023-06-10T19:06:27.347346+0000","last_undegraded":"2023-06-10T19:06:27.347346+0000","last_fullsized":"2023-06-10T19:06:27.347346+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:49:50.216107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":1,"reported_epoch":151,"state":"creating+peering","last_fresh":"2023-06-10T19:06:27.338061+0000","last_change":"2023-06-10T19:06:27.338061+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.338061+0000","last_undegraded":"2023-06-10T19:06:27.338061+0000","last_fullsized":"2023-06-10T19:06:27.338061+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":233,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-06-10T19:06:27.334108+0000","last_change":"2023-06-10T18:52:40.514114+0000","last_active":"2023-06-10T19:06:27.334108+0000","last_peered":"2023-06-10T19:06:27.334108+0000","last_clean":"2023-06-10T19:06:27.334108+0000","last_became_active":"2023-06-10T18:52:40.513638+0000","last_became_peered":"2023-06-10T18:52:40.513638+0000","last_unstale":"2023-06-10T19:06:27.334108+0000","last_undegraded":"2023-06-10T19:06:27.334108+0000","last_fullsized":"2023-06-10T19:06:27.334108+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:20:15.088951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":1,"reported_epoch":151,"state":"creating+peering","last_fresh":"2023-06-10T19:06:27.348768+0000","last_change":"2023-06-10T19:06:27.348768+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.348768+0000","last_undegraded":"2023-06-10T19:06:27.348768+0000","last_fullsized":"2023-06-10T19:06:27.348768+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":235,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-06-10T19:06:27.340152+0000","last_change":"2023-06-10T18:52:40.515396+0000","last_active":"2023-06-10T19:06:27.340152+0000","last_peered":"2023-06-10T19:06:27.340152+0000","last_clean":"2023-06-10T19:06:27.340152+0000","last_became_active":"2023-06-10T18:52:40.514663+0000","last_became_peered":"2023-06-10T18:52:40.514663+0000","last_unstale":"2023-06-10T19:06:27.340152+0000","last_undegraded":"2023-06-10T19:06:27.340152+0000","last_fullsized":"2023-06-10T19:06:27.340152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:17:33.819336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":54,"acting":54,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575018,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33472,"kb_used_data":2424,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338368,"statfs":{"total":96636764160,"available":96602488832,"internally_reserved":0,"allocated":2482176,"data_stored":1468283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:06:01 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":0.96199999999999997,"15min":0.92900000000000005},"min":{"1min":0.70499999999999996,"5min":0.49399999999999999,"15min":0.434},"max":{"1min":1.522,"5min":1.522,"15min":1.6220000000000001},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.92100000000000004,"15min":0.92700000000000005},"min":{"1min":0.52800000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.6870000000000001},"last":0.69199999999999995}]},{"osd":1,"last update":"Sat Jun 10 19:06:01 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.91000000000000003,"15min":0.92000000000000004},"min":{"1min":0.56999999999999995,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1879999999999999,"5min":1.238,"15min":1.377},"last":1.0840000000000001},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.92800000000000005,"15min":0.94199999999999995},"min":{"1min":0.67800000000000005,"5min":0.51300000000000001,"15min":0.504},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.5960000000000001},"last":0.82899999999999996}]},{"osd":2,"last update":"Sat Jun 10 19:06:01 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.88100000000000001,"15min":0.85299999999999998},"min":{"1min":0.60999999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.4059999999999999},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.91000000000000003,"15min":0.89800000000000002},"min":{"1min":0.61399999999999999,"5min":0.54100000000000004,"15min":0.50600000000000001},"max":{"1min":1.129,"5min":1.448,"15min":1.448},"last":0.64700000000000002}]},{"osd":3,"last update":"Sat Jun 10 19:06:01 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.91300000000000003,"15min":0.92100000000000004},"min":{"1min":0.75800000000000001,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.502},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.97399999999999998,"15min":0.95699999999999996},"min":{"1min":0.58599999999999997,"5min":0.432,"15min":0.432},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.74199999999999999}]},{"osd":4,"last update":"Sat Jun 10 19:06:01 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.81599999999999995,"15min":0.84499999999999997},"min":{"1min":0.60299999999999998,"5min":0.307,"15min":0.307},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.639},"last":0.60799999999999998},{"interface":"front","average":{"1min":1.054,"5min":0.98499999999999999,"15min":0.96999999999999997},"min":{"1min":0.80200000000000005,"5min":0.41199999999999998,"15min":0.40000000000000002},"max":{"1min":1.3540000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.91000000000000003}]},{"osd":5,"last update":"Sat Jun 10 19:06:01 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":1.0049999999999999,"15min":1.006},"min":{"1min":0.64000000000000001,"5min":0.45100000000000001,"15min":0.38400000000000001},"max":{"1min":1.385,"5min":1.385,"15min":1.806},"last":0.996},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.03,"15min":1.0349999999999999},"min":{"1min":0.69699999999999995,"5min":0.48499999999999999,"15min":0.46500000000000002},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":1.0169999999999999}]},{"osd":6,"last update":"Sat Jun 10 19:06:01 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.999,"15min":1.004},"min":{"1min":0.67400000000000004,"5min":0.47699999999999998,"15min":0.35999999999999999},"max":{"1min":1.3149999999999999,"5min":1.391,"15min":1.718},"last":0.93899999999999995},{"interface":"front","average":{"1min":1.127,"5min":1.1020000000000001,"15min":1.097},"min":{"1min":0.82499999999999996,"5min":0.504,"15min":0.441},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":1.056}]}]},{"osd":6,"up_from":13,"seq":55834575019,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32880,"kb_used_data":1832,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338960,"statfs":{"total":96636764160,"available":96603095040,"internally_reserved":0,"allocated":1875968,"data_stored":871745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:05:53 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83799999999999997,"15min":0.85999999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.1839999999999999,"5min":1.2450000000000001,"15min":1.498},"last":1.149},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.86199999999999999,"15min":0.879},"min":{"1min":0.57099999999999995,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.496},"last":0.628}]},{"osd":1,"last update":"Sat Jun 10 19:05:53 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.84999999999999998,"15min":0.86699999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.5229999999999999},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.89500000000000002,"15min":0.89900000000000002},"min":{"1min":0.66000000000000003,"5min":0.48699999999999999,"15min":0.45300000000000001},"max":{"1min":1.341,"5min":1.341,"15min":1.778},"last":0.68400000000000005}]},{"osd":2,"last update":"Sat Jun 10 19:05:53 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.91400000000000003,"15min":0.89900000000000002},"min":{"1min":0.51200000000000001,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.224,"5min":1.2809999999999999,"15min":1.3759999999999999},"last":1.115},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.86699999999999999,"15min":0.88500000000000001},"min":{"1min":0.60499999999999998,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.1220000000000001,"5min":1.2330000000000001,"15min":1.246},"last":0.91900000000000004}]},{"osd":3,"last update":"Sat Jun 10 19:05:53 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.55900000000000005,"5min":0.55100000000000005,"15min":0.52700000000000002},"max":{"1min":1.202,"5min":1.238,"15min":1.7190000000000001},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.96299999999999997,"15min":0.98299999999999998},"min":{"1min":0.61599999999999999,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.198,"5min":1.371,"15min":1.4370000000000001},"last":0.77500000000000002}]},{"osd":4,"last update":"Sat Jun 10 19:05:53 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.90600000000000003,"15min":0.91200000000000003},"min":{"1min":0.48499999999999999,"5min":0.373,"15min":0.373},"max":{"1min":1.248,"5min":1.401,"15min":1.798},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.032,"5min":0.99399999999999999,"15min":0.98899999999999999},"min":{"1min":0.60399999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.371,"5min":1.371,"15min":1.5489999999999999},"last":0.89100000000000001}]},{"osd":5,"last update":"Sat Jun 10 19:05:53 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.89700000000000002,"15min":0.91500000000000004},"min":{"1min":0.66000000000000003,"5min":0.437,"15min":0.437},"max":{"1min":1.1950000000000001,"5min":1.29,"15min":1.333},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.0109999999999999,"5min":0.997,"15min":1.0209999999999999},"min":{"1min":0.63100000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.256,"5min":1.296,"15min":2.536},"last":1.0580000000000001}]},{"osd":7,"last update":"Sat Jun 10 19:05:53 2023","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.054,"15min":1.0329999999999999},"min":{"1min":0.73999999999999999,"5min":0.58599999999999997,"15min":0.57099999999999995},"max":{"1min":1.2929999999999999,"5min":1.879,"15min":1.917},"last":1.0289999999999999},{"interface":"front","average":{"1min":0.998,"5min":0.98899999999999999,"15min":1.012},"min":{"1min":0.64000000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.345,"5min":1.4850000000000001,"15min":1.5569999999999999},"last":1.083}]}]},{"osd":5,"up_from":13,"seq":55834575019,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32880,"kb_used_data":1832,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338960,"statfs":{"total":96636764160,"available":96603095040,"internally_reserved":0,"allocated":1875968,"data_stored":871745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.877,"15min":0.873},"min":{"1min":0.51500000000000001,"5min":0.499,"15min":0.499},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.94199999999999995,"15min":0.91800000000000004},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.49399999999999999},"max":{"1min":1.212,"5min":2.347,"15min":2.347},"last":0.92400000000000004}]},{"osd":1,"last update":"Sat Jun 10 19:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.96299999999999997,"15min":0.91900000000000004},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.52600000000000002},"max":{"1min":1.6739999999999999,"5min":7.0800000000000001,"15min":7.0800000000000001},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.86499999999999999,"5min":1.117,"15min":0.98399999999999999},"min":{"1min":0.59599999999999997,"5min":0.56499999999999995,"15min":0.53800000000000003},"max":{"1min":1.171,"5min":15.845000000000001,"15min":15.845000000000001},"last":0.86799999999999999}]},{"osd":2,"last update":"Sat Jun 10 19:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.94999999999999996,"15min":0.89400000000000002},"min":{"1min":0.59899999999999998,"5min":0.54300000000000004,"15min":0.48299999999999998},"max":{"1min":1.6459999999999999,"5min":5.0049999999999999,"15min":5.0049999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.99299999999999999,"15min":0.94499999999999995},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.391,"5min":6.851,"15min":6.851},"last":0.95699999999999996}]},{"osd":3,"last update":"Sat Jun 10 19:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.96799999999999997,"15min":0.95599999999999996},"min":{"1min":0.58699999999999997,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.6910000000000001,"5min":2.544,"15min":2.544},"last":1.071},{"interface":"front","average":{"1min":0.98299999999999998,"5min":1.004,"15min":0.999},"min":{"1min":0.66000000000000003,"5min":0.63100000000000001,"15min":0.59799999999999998},"max":{"1min":1.4870000000000001,"5min":3.0830000000000002,"15min":3.0830000000000002},"last":0.67500000000000004}]},{"osd":4,"last update":"Sat Jun 10 19:05:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.012,"15min":0.95699999999999996},"min":{"1min":0.65300000000000002,"5min":0.64000000000000001,"15min":0.58099999999999996},"max":{"1min":1.6140000000000001,"5min":6.7290000000000001,"15min":6.7290000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.97399999999999998,"15min":0.99399999999999999},"min":{"1min":0.70199999999999996,"5min":0.64900000000000002,"15min":0.61199999999999999},"max":{"1min":1.446,"5min":1.446,"15min":1.575},"last":0.98199999999999998}]},{"osd":6,"last update":"Sat Jun 10 19:05:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":0.98999999999999999,"15min":0.997},"min":{"1min":0.65300000000000002,"5min":0.60499999999999998,"15min":0.54200000000000004},"max":{"1min":1.8009999999999999,"5min":1.8009999999999999,"15min":1.8009999999999999},"last":0.83799999999999997},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.105,"15min":1.0600000000000001},"min":{"1min":0.73299999999999998,"5min":0.71999999999999997,"15min":0.57899999999999996},"max":{"1min":1.8380000000000001,"5min":6.923,"15min":6.923},"last":1.048}]},{"osd":7,"last update":"Sat Jun 10 19:05:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.101,"15min":1.095},"min":{"1min":0.70699999999999996,"5min":0.69899999999999995,"15min":0.66200000000000003},"max":{"1min":1.7749999999999999,"5min":2.6080000000000001,"15min":2.6080000000000001},"last":0.72299999999999998},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1850000000000001,"15min":1.143},"min":{"1min":0.84399999999999997,"5min":0.72499999999999998,"15min":0.66200000000000003},"max":{"1min":1.732,"5min":5.4169999999999998,"15min":5.4169999999999998},"last":1.024}]}]},{"osd":4,"up_from":13,"seq":55834575018,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32892,"kb_used_data":1844,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338948,"statfs":{"total":96636764160,"available":96603082752,"internally_reserved":0,"allocated":1888256,"data_stored":877915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:06:06 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.84899999999999998,"15min":0.82799999999999996},"min":{"1min":0.502,"5min":0.45400000000000001,"15min":0.45100000000000001},"max":{"1min":1.1319999999999999,"5min":1.29,"15min":1.29},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.91000000000000003,"15min":0.90800000000000003},"min":{"1min":0.64100000000000001,"5min":0.498,"15min":0.48899999999999999},"max":{"1min":1.1699999999999999,"5min":1.3979999999999999,"15min":3.7280000000000002},"last":1.375}]},{"osd":1,"last update":"Sat Jun 10 19:06:06 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.90700000000000003,"15min":0.93300000000000005},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47599999999999998},"max":{"1min":1.196,"5min":1.3600000000000001,"15min":3.3969999999999998},"last":1.5429999999999999},{"interface":"front","average":{"1min":0.87,"5min":0.84799999999999998,"15min":0.86199999999999999},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47699999999999998},"max":{"1min":1.1679999999999999,"5min":1.2430000000000001,"15min":2.496},"last":0.88300000000000001}]},{"osd":2,"last update":"Sat Jun 10 19:06:06 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.876,"15min":0.88100000000000001},"min":{"1min":0.52800000000000002,"5min":0.52200000000000002,"15min":0.49299999999999999},"max":{"1min":1.206,"5min":1.3,"15min":1.522},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.97499999999999998,"15min":0.98899999999999999},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.55000000000000004},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":3.5750000000000002},"last":1.4670000000000001}]},{"osd":3,"last update":"Sat Jun 10 19:06:06 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.89000000000000001,"15min":0.89700000000000002},"min":{"1min":0.68200000000000005,"5min":0.56200000000000006,"15min":0.53900000000000003},"max":{"1min":1.0669999999999999,"5min":1.46,"15min":2.3809999999999998},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95999999999999996,"15min":0.96599999999999997},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.54400000000000004},"max":{"1min":1.2929999999999999,"5min":1.4279999999999999,"15min":1.6479999999999999},"last":0.73299999999999998}]},{"osd":5,"last update":"Sat Jun 10 19:06:06 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.94499999999999995,"15min":0.96099999999999997},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.53100000000000003},"max":{"1min":1.2290000000000001,"5min":1.3260000000000001,"15min":3.6539999999999999},"last":1.083},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.91500000000000004,"15min":0.94299999999999995},"min":{"1min":0.54600000000000004,"5min":0.495,"15min":0.495},"max":{"1min":1.2170000000000001,"5min":1.26,"15min":2.6720000000000002},"last":1}]},{"osd":6,"last update":"Sat Jun 10 19:06:06 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.97099999999999997,"15min":0.97199999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.2270000000000001,"5min":1.413,"15min":2.2639999999999998},"last":1.196},{"interface":"front","average":{"1min":1.036,"5min":1.0720000000000001,"15min":1.069},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.44400000000000001},"max":{"1min":1.3100000000000001,"5min":1.4670000000000001,"15min":3.4980000000000002},"last":1.625}]},{"osd":7,"last update":"Sat Jun 10 19:06:06 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":1.0189999999999999,"15min":0.998},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.41399999999999998},"max":{"1min":1.2370000000000001,"5min":1.3919999999999999,"15min":2.5910000000000002},"last":1.1439999999999999},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.087,"15min":1.071},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.46300000000000002},"max":{"1min":1.635,"5min":1.635,"15min":1.635},"last":0.92800000000000005}]}]},{"osd":3,"up_from":13,"seq":55834575017,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36972,"kb_used_data":1828,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334868,"statfs":{"total":96636764160,"available":96598904832,"internally_reserved":0,"allocated":1871872,"data_stored":870726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.63900000000000001,"15min":0.62},"min":{"1min":0.42099999999999999,"5min":0.248,"15min":0.248},"max":{"1min":0.99299999999999999,"5min":1.1539999999999999,"15min":1.169},"last":0.626},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.67500000000000004,"15min":0.66800000000000004},"min":{"1min":0.318,"5min":0.30299999999999999,"15min":0.251},"max":{"1min":0.96899999999999997,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.80100000000000005}]},{"osd":1,"last update":"Sat Jun 10 19:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.69299999999999995,"15min":0.67900000000000005},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.27500000000000002},"max":{"1min":0.98799999999999999,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.748},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.71299999999999997,"15min":0.73199999999999998},"min":{"1min":0.35499999999999998,"5min":0.34399999999999997,"15min":0.318},"max":{"1min":0.89700000000000002,"5min":1.2569999999999999,"15min":1.411},"last":0.72899999999999998}]},{"osd":2,"last update":"Sat Jun 10 19:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.75600000000000001,"15min":0.77400000000000002},"min":{"1min":0.40699999999999997,"5min":0.39300000000000002,"15min":0.30299999999999999},"max":{"1min":1.155,"5min":1.2829999999999999,"15min":1.9530000000000001},"last":0.5},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.81299999999999994,"15min":0.79000000000000004},"min":{"1min":0.39200000000000002,"5min":0.35299999999999998,"15min":0.29699999999999999},"max":{"1min":1.2769999999999999,"5min":1.591,"15min":1.591},"last":0.877}]},{"osd":4,"last update":"Sat Jun 10 19:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.96599999999999997,"15min":0.95599999999999996},"min":{"1min":0.67800000000000005,"5min":0.60899999999999999,"15min":0.41899999999999998},"max":{"1min":1.333,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":1.008},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.98899999999999999,"15min":0.99199999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.47999999999999998},"max":{"1min":1.2110000000000001,"5min":1.873,"15min":1.873},"last":0.84799999999999998}]},{"osd":5,"last update":"Sat Jun 10 19:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":1.004,"15min":1.0169999999999999},"min":{"1min":0.55900000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.3120000000000001,"5min":1.752,"15min":2.024},"last":1.052},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0369999999999999,"15min":1.0309999999999999},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.46899999999999997},"max":{"1min":1.337,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.97299999999999998}]},{"osd":6,"last update":"Sat Jun 10 19:05:52 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.0669999999999999,"15min":1.0609999999999999},"min":{"1min":0.625,"5min":0.56999999999999995,"15min":0.55300000000000005},"max":{"1min":1.258,"5min":1.786,"15min":1.8500000000000001},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0589999999999999,"15min":1.0580000000000001},"min":{"1min":0.69499999999999995,"5min":0.61199999999999999,"15min":0.58799999999999997},"max":{"1min":1.3029999999999999,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":1.1339999999999999}]},{"osd":7,"last update":"Sat Jun 10 19:05:52 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.0800000000000001,"15min":1.093},"min":{"1min":0.77200000000000002,"5min":0.57999999999999996,"15min":0.56999999999999995},"max":{"1min":1.27,"5min":2.1150000000000002,"15min":2.1150000000000002},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.089,"15min":1.0960000000000001},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.61099999999999999},"max":{"1min":1.3129999999999999,"5min":1.9850000000000001,"15min":1.9850000000000001},"last":0.93899999999999995}]}]},{"osd":2,"up_from":13,"seq":55834575018,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32880,"kb_used_data":1832,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338960,"statfs":{"total":96636764160,"available":96603095040,"internally_reserved":0,"allocated":1875968,"data_stored":871745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.65100000000000002,"15min":0.624},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.27300000000000002},"max":{"1min":2.883,"5min":2.883,"15min":2.883},"last":0.498},{"interface":"front","average":{"1min":1.0389999999999999,"5min":0.77400000000000002,"15min":0.74299999999999999},"min":{"1min":0.40400000000000003,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":6.5670000000000002,"5min":6.5670000000000002,"15min":6.5670000000000002},"last":0.52500000000000002}]},{"osd":1,"last update":"Sat Jun 10 19:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.65000000000000002,"15min":0.66400000000000003},"min":{"1min":0.32300000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.91000000000000003,"5min":1.0389999999999999,"15min":1.1950000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":1.204,"5min":0.82699999999999996,"15min":0.78400000000000003},"min":{"1min":0.374,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":8.4429999999999996,"5min":8.4429999999999996,"15min":8.4429999999999996},"last":0.623}]},{"osd":3,"last update":"Sat Jun 10 19:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80100000000000005,"15min":0.77600000000000002},"min":{"1min":0.40899999999999997,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.105,"5min":1.1899999999999999,"15min":1.2350000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.78800000000000003,"15min":0.78400000000000003},"min":{"1min":0.42299999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":4.1849999999999996,"5min":4.1849999999999996,"15min":4.1849999999999996},"last":0.59199999999999997}]},{"osd":4,"last update":"Sat Jun 10 19:06:00 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":0.96499999999999997,"15min":0.94099999999999995},"min":{"1min":0.70299999999999996,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":3.996,"5min":3.996,"15min":3.996},"last":0.73199999999999998},{"interface":"front","average":{"1min":1.6759999999999999,"5min":1.1299999999999999,"15min":1.0600000000000001},"min":{"1min":0.53100000000000003,"5min":0.496,"15min":0.496},"max":{"1min":13.254,"5min":13.254,"15min":13.254},"last":1.0289999999999999}]},{"osd":5,"last update":"Sat Jun 10 19:06:00 2023","interfaces":[{"interface":"back","average":{"1min":1.643,"5min":1.125,"15min":1.0549999999999999},"min":{"1min":0.57999999999999996,"5min":0.55900000000000005,"15min":0.54100000000000004},"max":{"1min":6.9189999999999996,"5min":6.9189999999999996,"15min":6.9189999999999996},"last":1.113},{"interface":"front","average":{"1min":2.1299999999999999,"5min":1.2410000000000001,"15min":1.0920000000000001},"min":{"1min":0.72199999999999998,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":15.526,"5min":15.526,"15min":15.526},"last":0.98999999999999999}]},{"osd":6,"last update":"Sat Jun 10 19:06:00 2023","interfaces":[{"interface":"back","average":{"1min":1.5980000000000001,"5min":1.149,"15min":1.083},"min":{"1min":0.74199999999999999,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":8.7089999999999996,"5min":8.7089999999999996,"15min":8.7089999999999996},"last":0.78300000000000003},{"interface":"front","average":{"1min":1.296,"5min":1.0880000000000001,"15min":1.0620000000000001},"min":{"1min":0.63800000000000001,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":6.1299999999999999,"5min":6.1299999999999999,"15min":6.1299999999999999},"last":0.97299999999999998}]},{"osd":7,"last update":"Sat Jun 10 19:06:00 2023","interfaces":[{"interface":"back","average":{"1min":2.2229999999999999,"5min":1.3260000000000001,"15min":1.175},"min":{"1min":0.74099999999999999,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":12.138,"5min":12.138,"15min":12.138},"last":1.077},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.105,"15min":1.1100000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.421,"5min":1.657,"15min":1.752},"last":0.94799999999999995}]}]},{"osd":1,"up_from":13,"seq":55834575020,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36972,"kb_used_data":1828,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334868,"statfs":{"total":96636764160,"available":96598904832,"internally_reserved":0,"allocated":1871872,"data_stored":870726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:06:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66300000000000003,"15min":0.67600000000000005},"min":{"1min":0.33600000000000002,"5min":0.32100000000000001,"15min":0.25800000000000001},"max":{"1min":0.97499999999999998,"5min":1.111,"15min":1.288},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.74399999999999999},"min":{"1min":0.35699999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.079,"5min":1.1859999999999999,"15min":1.694},"last":0.50900000000000001}]},{"osd":2,"last update":"Sat Jun 10 19:06:02 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.249},"max":{"1min":0.86099999999999999,"5min":1.0900000000000001,"15min":1.21},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.69999999999999996,"15min":0.71699999999999997},"min":{"1min":0.33000000000000002,"5min":0.32800000000000001,"15min":0.29699999999999999},"max":{"1min":0.89400000000000002,"5min":1.1040000000000001,"15min":1.415},"last":0.80900000000000005}]},{"osd":3,"last update":"Sat Jun 10 19:06:02 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.77300000000000002,"15min":0.78200000000000003},"min":{"1min":0.38200000000000001,"5min":0.34000000000000002,"15min":0.25600000000000001},"max":{"1min":1.0620000000000001,"5min":1.1679999999999999,"15min":1.6299999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.70299999999999996,"15min":0.73599999999999999},"min":{"1min":0.38800000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.1479999999999999,"5min":1.2909999999999999,"15min":2.1749999999999998},"last":0.73199999999999998}]},{"osd":4,"last update":"Sat Jun 10 19:06:02 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.85499999999999998,"15min":0.86299999999999999},"min":{"1min":0.59499999999999997,"5min":0.56399999999999995,"15min":0.53000000000000003},"max":{"1min":1.0309999999999999,"5min":1.343,"15min":1.4930000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":1.006,"5min":0.97799999999999998,"15min":1.034},"min":{"1min":0.60299999999999998,"5min":0.47299999999999998,"15min":0.47099999999999997},"max":{"1min":1.3340000000000001,"5min":1.492,"15min":5.8209999999999997},"last":0.998}]},{"osd":5,"last update":"Sat Jun 10 19:06:02 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.97199999999999998,"15min":0.998},"min":{"1min":0.63,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.2949999999999999,"5min":1.6299999999999999,"15min":1.8620000000000001},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.94499999999999995,"15min":0.97699999999999998},"min":{"1min":0.56100000000000005,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.194,"5min":1.3220000000000001,"15min":3.089},"last":0.83999999999999997}]},{"osd":6,"last update":"Sat Jun 10 19:06:02 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.99399999999999999,"15min":1.0489999999999999},"min":{"1min":0.61199999999999999,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.238,"5min":1.6759999999999999,"15min":7.2599999999999998},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.0089999999999999,"5min":0.98999999999999999,"15min":1.036},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.2829999999999999,"5min":1.6000000000000001,"15min":9.0069999999999997},"last":0.878}]},{"osd":7,"last update":"Sat Jun 10 19:06:02 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.0449999999999999,"15min":1.0780000000000001},"min":{"1min":0.65300000000000002,"5min":0.58799999999999997,"15min":0.495},"max":{"1min":1.3999999999999999,"5min":1.494,"15min":2.105},"last":1.1850000000000001},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0449999999999999,"15min":1.0800000000000001},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.56699999999999995},"max":{"1min":1.321,"5min":1.5620000000000001,"15min":2.2570000000000001},"last":1.2270000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575019,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37564,"kb_used_data":2420,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334276,"statfs":{"total":96636764160,"available":96598298624,"internally_reserved":0,"allocated":2478080,"data_stored":1467264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jun 10 19:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.63100000000000001,"15min":0.63400000000000001},"min":{"1min":0.46200000000000002,"5min":0.309,"15min":0.248},"max":{"1min":0.92300000000000004,"5min":1.127,"15min":1.127},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.44900000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.028,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.54400000000000004}]},{"osd":2,"last update":"Sat Jun 10 19:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.73999999999999999,"15min":0.71699999999999997},"min":{"1min":0.35199999999999998,"5min":0.33500000000000002,"15min":0.29199999999999998},"max":{"1min":1.0640000000000001,"5min":1.2010000000000001,"15min":1.2829999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.65000000000000002,"15min":0.65400000000000003},"min":{"1min":0.30199999999999999,"5min":0.28699999999999998,"15min":0.245},"max":{"1min":1.1080000000000001,"5min":1.1779999999999999,"15min":1.371},"last":0.58799999999999997}]},{"osd":3,"last update":"Sat Jun 10 19:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.68300000000000005,"15min":0.68400000000000005},"min":{"1min":0.35499999999999998,"5min":0.30299999999999999,"15min":0.28899999999999998},"max":{"1min":1.133,"5min":1.133,"15min":1.226},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.82599999999999996,"15min":0.82299999999999995},"min":{"1min":0.39100000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.179,"5min":1.742,"15min":1.829},"last":0.68100000000000005}]},{"osd":4,"last update":"Sat Jun 10 19:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.91700000000000004,"15min":0.92100000000000004},"min":{"1min":0.65600000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.2210000000000001,"5min":1.7250000000000001,"15min":3.0209999999999999},"last":0.624},{"interface":"front","average":{"1min":0.98499999999999999,"5min":1.0169999999999999,"15min":1.026},"min":{"1min":0.58799999999999997,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.266,"5min":1.873,"15min":1.9510000000000001},"last":1.256}]},{"osd":5,"last update":"Sat Jun 10 19:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.92400000000000004,"15min":0.93600000000000005},"min":{"1min":0.54000000000000004,"5min":0.51200000000000001,"15min":0.45100000000000001},"max":{"1min":1.224,"5min":1.3109999999999999,"15min":1.694},"last":1.0229999999999999},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.98899999999999999,"15min":1.0049999999999999},"min":{"1min":0.60399999999999998,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.278,"5min":1.78,"15min":4.5620000000000003},"last":0.66300000000000003}]},{"osd":6,"last update":"Sat Jun 10 19:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":1.054,"15min":1.073},"min":{"1min":0.628,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.2250000000000001,"5min":1.7909999999999999,"15min":3.5569999999999999},"last":1.2030000000000001},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.99399999999999999,"15min":1.0009999999999999},"min":{"1min":0.71099999999999997,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.2969999999999999,"5min":1.6319999999999999,"15min":1.883},"last":1.087}]},{"osd":7,"last update":"Sat Jun 10 19:06:00 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.0249999999999999,"15min":1.0309999999999999},"min":{"1min":0.61799999999999999,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.375,"5min":1.512,"15min":1.5800000000000001},"last":1.149},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0569999999999999,"15min":1.0589999999999999},"min":{"1min":0.67700000000000005,"5min":0.63,"15min":0.58699999999999997},"max":{"1min":1.341,"5min":1.6619999999999999,"15min":1.9830000000000001},"last":0.71299999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-10T19:06:33.132 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-10T19:06:33.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.290+0000 7fde82cde640 1 Processor -- start 2023-06-10T19:06:33.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.290+0000 7fde82cde640 1 -- start start 2023-06-10T19:06:33.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.294+0000 7fde82cde640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fde7c06b2f0 0x7fde7c06f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:33.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.294+0000 7fde82cde640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde7c0c8d00 0x7fde7c06b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:33.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.294+0000 7fde82cde640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde7c158a90 con 0x7fde7c06bc00 2023-06-10T19:06:33.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.294+0000 7fde82cde640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde7c0705d0 con 0x7fde7c06b2f0 2023-06-10T19:06:33.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.294+0000 7fde82cde640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde7c06f9c0 con 0x7fde7c0c8d00 2023-06-10T19:06:33.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.294+0000 7fde8127b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fde7c06bc00 0x7fde7c0cbe00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:37454/0 (socket says 172.21.15.53:37454) 2023-06-10T19:06:33.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.294+0000 7fde8127b640 1 -- 172.21.15.53:0/2828682059 learned_addr learned my addr 172.21.15.53:0/2828682059 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:06:33.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.294+0000 7fde80a7a640 1 --2- 172.21.15.53:0/2828682059 >> v2:172.21.15.117:3300/0 conn(0x7fde7c06b2f0 0x7fde7c06f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:33.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.294+0000 7fde7bfff640 1 --2- 172.21.15.53:0/2828682059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde7c0c8d00 0x7fde7c06b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:33.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.294+0000 7fde7b7fe640 1 -- 172.21.15.53:0/2828682059 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 282856460 0 0) 0x7fde74001120 con 0x7fde7c06bc00 2023-06-10T19:06:33.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.294+0000 7fde7b7fe640 1 -- 172.21.15.53:0/2828682059 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde64003530 con 0x7fde7c06bc00 2023-06-10T19:06:33.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.294+0000 7fde7b7fe640 1 -- 172.21.15.53:0/2828682059 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3575359756 0 0) 0x7fde64003530 con 0x7fde7c06bc00 2023-06-10T19:06:33.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.294+0000 7fde7b7fe640 1 -- 172.21.15.53:0/2828682059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde7c0c8d00 msgr2=0x7fde7c06b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:33.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.294+0000 7fde7b7fe640 1 --2- 172.21.15.53:0/2828682059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde7c0c8d00 0x7fde7c06b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:33.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.294+0000 7fde7b7fe640 1 -- 172.21.15.53:0/2828682059 >> v2:172.21.15.117:3300/0 conn(0x7fde7c06b2f0 msgr2=0x7fde7c06f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:33.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.294+0000 7fde7b7fe640 1 --2- 172.21.15.53:0/2828682059 >> v2:172.21.15.117:3300/0 conn(0x7fde7c06b2f0 0x7fde7c06f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:33.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.294+0000 7fde7b7fe640 1 -- 172.21.15.53:0/2828682059 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde7c06fca0 con 0x7fde7c06bc00 2023-06-10T19:06:33.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.294+0000 7fde7b7fe640 1 -- 172.21.15.53:0/2828682059 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fde74001810 con 0x7fde7c06bc00 2023-06-10T19:06:33.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.294+0000 7fde7b7fe640 1 -- 172.21.15.53:0/2828682059 >> v1:172.21.15.53:6789/0 conn(0x7fde7c06bc00 legacy=0x7fde7c0cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:33.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.294+0000 7fde7b7fe640 1 --2- 172.21.15.53:0/2828682059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde640039f0 0x7fde64003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:33.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.294+0000 7fde7b7fe640 1 --2- 172.21.15.53:0/2828682059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde7c0c8d00 0x7fde640047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:33.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.294+0000 7fde7b7fe640 1 --2- 172.21.15.53:0/2828682059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde64004d10 0x7fde64005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:33.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.294+0000 7fde7b7fe640 1 -- 172.21.15.53:0/2828682059 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde7c0705d0 con 0x7fde64004d10 2023-06-10T19:06:33.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.294+0000 7fde7b7fe640 1 -- 172.21.15.53:0/2828682059 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde7c06f9c0 con 0x7fde640039f0 2023-06-10T19:06:33.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.294+0000 7fde7b7fe640 1 -- 172.21.15.53:0/2828682059 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde6400b9c0 con 0x7fde7c0c8d00 2023-06-10T19:06:33.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.294+0000 7fde8127b640 1 --2- 172.21.15.53:0/2828682059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde64004d10 0x7fde64005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:33.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.294+0000 7fde7bfff640 1 --2- 172.21.15.53:0/2828682059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde7c0c8d00 0x7fde640047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:33.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.294+0000 7fde80a7a640 1 --2- 172.21.15.53:0/2828682059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde640039f0 0x7fde64003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:33.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.294+0000 7fde8127b640 1 -- 172.21.15.53:0/2828682059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde7c0c8d00 msgr2=0x7fde640047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:33.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.294+0000 7fde8127b640 1 --2- 172.21.15.53:0/2828682059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde7c0c8d00 0x7fde640047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:33.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.294+0000 7fde8127b640 1 -- 172.21.15.53:0/2828682059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde640039f0 msgr2=0x7fde64003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:33.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.294+0000 7fde8127b640 1 --2- 172.21.15.53:0/2828682059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde640039f0 0x7fde64003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:33.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.294+0000 7fde8127b640 1 -- 172.21.15.53:0/2828682059 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde64003530 con 0x7fde64004d10 2023-06-10T19:06:33.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.298+0000 7fde8127b640 1 --2- 172.21.15.53:0/2828682059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde64004d10 0x7fde64005180 secure :-1 s=READY pgs=2220 cs=0 l=1 rev1=1 crypto rx=0x7fde7400c240 tx=0x7fde7401cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a80304731c28dbc5 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:33.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.298+0000 7fde7b7fe640 1 -- 172.21.15.53:0/2828682059 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde740a5b40 con 0x7fde64004d10 2023-06-10T19:06:33.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.298+0000 7fde7b7fe640 1 -- 172.21.15.53:0/2828682059 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde740a5cc0 con 0x7fde64004d10 2023-06-10T19:06:33.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.298+0000 7fde7b7fe640 1 -- 172.21.15.53:0/2828682059 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde74005b20 con 0x7fde64004d10 2023-06-10T19:06:33.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.298+0000 7fde82cde640 1 -- 172.21.15.53:0/2828682059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde64004d10 msgr2=0x7fde64005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:33.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.298+0000 7fde82cde640 1 --2- 172.21.15.53:0/2828682059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde64004d10 0x7fde64005180 secure :-1 s=READY pgs=2220 cs=0 l=1 rev1=1 crypto rx=0x7fde7400c240 tx=0x7fde7401cbe0 comp rx=0 tx=0).stop 2023-06-10T19:06:33.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.298+0000 7fde8127b640 1 -- 172.21.15.53:0/2828682059 reap_dead start 2023-06-10T19:06:33.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.298+0000 7fde82cde640 1 -- 172.21.15.53:0/2828682059 shutdown_connections 2023-06-10T19:06:33.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.298+0000 7fde82cde640 1 -- 172.21.15.53:0/2828682059 >> 172.21.15.53:0/2828682059 conn(0x7fde7c06a0d0 msgr2=0x7fde7c0ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:33.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.298+0000 7fde82cde640 1 -- 172.21.15.53:0/2828682059 shutdown_connections 2023-06-10T19:06:33.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.298+0000 7fde82cde640 1 -- 172.21.15.53:0/2828682059 wait complete. 2023-06-10T19:06:33.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.298+0000 7fde82cde640 1 Processor -- start 2023-06-10T19:06:33.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.298+0000 7fde82cde640 1 -- start start 2023-06-10T19:06:33.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.298+0000 7fde82cde640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde7c146f70 0x7fde7c0b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:33.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.298+0000 7fde82cde640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde7c0b0ad0 0x7fde7c0c55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:33.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.298+0000 7fde82cde640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde7c0c5090 0x7fde7c0c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:33.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.298+0000 7fde82cde640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde7c0c6060 con 0x7fde7c0c5090 2023-06-10T19:06:33.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.298+0000 7fde82cde640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde7c0b37a0 con 0x7fde7c0b0ad0 2023-06-10T19:06:33.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.298+0000 7fde82cde640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde7c14ef40 con 0x7fde7c146f70 2023-06-10T19:06:33.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.298+0000 7fde8127b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde7c0c5090 0x7fde7c0c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:33.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.298+0000 7fde8127b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde7c0c5090 0x7fde7c0c5b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51106/0 (socket says 172.21.15.53:51106) 2023-06-10T19:06:33.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.298+0000 7fde8127b640 1 -- 172.21.15.53:0/3205108501 learned_addr learned my addr 172.21.15.53:0/3205108501 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:33.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.298+0000 7fde7bfff640 1 --2- 172.21.15.53:0/3205108501 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde7c0b0ad0 0x7fde7c0c55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:33.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.298+0000 7fde80a7a640 1 --2- 172.21.15.53:0/3205108501 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde7c146f70 0x7fde7c0b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:33.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.298+0000 7fde8127b640 1 -- 172.21.15.53:0/3205108501 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde7c146f70 msgr2=0x7fde7c0b3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:33.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.298+0000 7fde8127b640 1 --2- 172.21.15.53:0/3205108501 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde7c146f70 0x7fde7c0b3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:33.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.298+0000 7fde8127b640 1 -- 172.21.15.53:0/3205108501 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde7c0b0ad0 msgr2=0x7fde7c0c55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:33.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.298+0000 7fde8127b640 1 --2- 172.21.15.53:0/3205108501 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde7c0b0ad0 0x7fde7c0c55e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:33.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.298+0000 7fde8127b640 1 -- 172.21.15.53:0/3205108501 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde7c0c62b0 con 0x7fde7c0c5090 2023-06-10T19:06:33.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.298+0000 7fde7bfff640 1 --2- 172.21.15.53:0/3205108501 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde7c0b0ad0 0x7fde7c0c55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:06:33.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.302+0000 7fde8127b640 1 --2- 172.21.15.53:0/3205108501 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde7c0c5090 0x7fde7c0c5b20 secure :-1 s=READY pgs=2221 cs=0 l=1 rev1=1 crypto rx=0x7fde7400c240 tx=0x7fde64005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:33.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.302+0000 7fde797fa640 1 -- 172.21.15.53:0/3205108501 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde740b3070 con 0x7fde7c0c5090 2023-06-10T19:06:33.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.302+0000 7fde797fa640 1 -- 172.21.15.53:0/3205108501 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde74001120 con 0x7fde7c0c5090 2023-06-10T19:06:33.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.302+0000 7fde82cde640 1 -- 172.21.15.53:0/3205108501 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde7c14f1e0 con 0x7fde7c0c5090 2023-06-10T19:06:33.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.302+0000 7fde797fa640 1 -- 172.21.15.53:0/3205108501 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde740a5b40 con 0x7fde7c0c5090 2023-06-10T19:06:33.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.302+0000 7fde82cde640 1 -- 172.21.15.53:0/3205108501 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde7c0c6590 con 0x7fde7c0c5090 2023-06-10T19:06:33.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.302+0000 7fde82cde640 1 -- 172.21.15.53:0/3205108501 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde7c04d790 con 0x7fde7c0c5090 2023-06-10T19:06:33.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.302+0000 7fde797fa640 1 -- 172.21.15.53:0/3205108501 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fde740015d0 con 0x7fde7c0c5090 2023-06-10T19:06:33.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.302+0000 7fde797fa640 1 --2- 172.21.15.53:0/3205108501 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fde680662b0 0x7fde68068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:33.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.302+0000 7fde797fa640 1 -- 172.21.15.53:0/3205108501 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fde7411d4d0 con 0x7fde7c0c5090 2023-06-10T19:06:33.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.302+0000 7fde80a7a640 1 --2- 172.21.15.53:0/3205108501 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fde680662b0 0x7fde68068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:33.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.302+0000 7fde80a7a640 1 --2- 172.21.15.53:0/3205108501 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fde680662b0 0x7fde68068760 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fde7c153fa0 tx=0x7fde6c00b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:33.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.306+0000 7fde797fa640 1 -- 172.21.15.53:0/3205108501 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fde740ea940 con 0x7fde7c0c5090 2023-06-10T19:06:33.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.458+0000 7fde82cde640 1 -- 172.21.15.53:0/3205108501 --> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fde7c070260 con 0x7fde680662b0 2023-06-10T19:06:33.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.482+0000 7fde797fa640 1 -- 172.21.15.53:0/3205108501 <== mgr.4105 v2:172.21.15.117:6832/3061986771 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+297902 (secure 0 0 0) 0x7fde6c0039a0 con 0x7fde680662b0 2023-06-10T19:06:33.485 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:06:33.489 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-06-10T19:06:33.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.486+0000 7fde82cde640 1 -- 172.21.15.53:0/3205108501 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fde680662b0 msgr2=0x7fde68068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:33.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.486+0000 7fde82cde640 1 --2- 172.21.15.53:0/3205108501 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fde680662b0 0x7fde68068760 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fde7c153fa0 tx=0x7fde6c00b040 comp rx=0 tx=0).stop 2023-06-10T19:06:33.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.486+0000 7fde82cde640 1 -- 172.21.15.53:0/3205108501 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde7c0c5090 msgr2=0x7fde7c0c5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:33.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.486+0000 7fde82cde640 1 --2- 172.21.15.53:0/3205108501 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde7c0c5090 0x7fde7c0c5b20 secure :-1 s=READY pgs=2221 cs=0 l=1 rev1=1 crypto rx=0x7fde7400c240 tx=0x7fde64005800 comp rx=0 tx=0).stop 2023-06-10T19:06:33.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.486+0000 7fde82cde640 1 -- 172.21.15.53:0/3205108501 shutdown_connections 2023-06-10T19:06:33.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.486+0000 7fde82cde640 1 --2- 172.21.15.53:0/3205108501 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fde680662b0 0x7fde68068760 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:33.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.486+0000 7fde82cde640 1 --2- 172.21.15.53:0/3205108501 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde7c0c5090 0x7fde7c0c5b20 unknown :-1 s=CLOSED pgs=2221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:33.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.486+0000 7fde82cde640 1 --2- 172.21.15.53:0/3205108501 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde7c0b0ad0 0x7fde7c0c55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:33.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.486+0000 7fde82cde640 1 --2- 172.21.15.53:0/3205108501 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde7c146f70 0x7fde7c0b3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:33.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.486+0000 7fde82cde640 1 -- 172.21.15.53:0/3205108501 >> 172.21.15.53:0/3205108501 conn(0x7fde7c06a0d0 msgr2=0x7fde7c0abc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:33.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.486+0000 7fde82cde640 1 -- 172.21.15.53:0/3205108501 shutdown_connections 2023-06-10T19:06:33.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.486+0000 7fde82cde640 1 -- 172.21.15.53:0/3205108501 wait complete. 2023-06-10T19:06:33.508 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":567,"stamp":"2023-06-10T19:06:31.858001+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":72,"acting":72,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":21,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":276512,"kb_used_data":15840,"kb_used_omap":0,"kb_used_meta":260608,"kb_avail":754698208,"statfs":{"total":773094113280,"available":772810964992,"internally_reserved":0,"allocated":16220160,"data_stored":8170149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":266862592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.527339"},"pg_stats":[{"pgid":"22.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:27.323985+0000","last_change":"2023-06-10T19:06:27.323985+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.323985+0000","last_undegraded":"2023-06-10T19:06:27.323985+0000","last_fullsized":"2023-06-10T19:06:27.323985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":1,"reported_epoch":151,"state":"creating+peering","last_fresh":"2023-06-10T19:06:27.346493+0000","last_change":"2023-06-10T19:06:27.346493+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.346493+0000","last_undegraded":"2023-06-10T19:06:27.346493+0000","last_fullsized":"2023-06-10T19:06:27.346493+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":1,"reported_epoch":151,"state":"creating+peering","last_fresh":"2023-06-10T19:06:27.344670+0000","last_change":"2023-06-10T19:06:27.344670+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.344670+0000","last_undegraded":"2023-06-10T19:06:27.344670+0000","last_fullsized":"2023-06-10T19:06:27.344670+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":1,"reported_epoch":151,"state":"creating+peering","last_fresh":"2023-06-10T19:06:27.332884+0000","last_change":"2023-06-10T19:06:27.332884+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.332884+0000","last_undegraded":"2023-06-10T19:06:27.332884+0000","last_fullsized":"2023-06-10T19:06:27.332884+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":1,"reported_epoch":151,"state":"creating+peering","last_fresh":"2023-06-10T19:06:27.333545+0000","last_change":"2023-06-10T19:06:27.333545+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.333545+0000","last_undegraded":"2023-06-10T19:06:27.333545+0000","last_fullsized":"2023-06-10T19:06:27.333545+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:27.323985+0000","last_change":"2023-06-10T19:06:27.323985+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.323985+0000","last_undegraded":"2023-06-10T19:06:27.323985+0000","last_fullsized":"2023-06-10T19:06:27.323985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":1,"reported_epoch":151,"state":"creating+peering","last_fresh":"2023-06-10T19:06:27.350149+0000","last_change":"2023-06-10T19:06:27.350149+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.350149+0000","last_undegraded":"2023-06-10T19:06:27.350149+0000","last_fullsized":"2023-06-10T19:06:27.350149+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:27.323985+0000","last_change":"2023-06-10T19:06:27.323985+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.323985+0000","last_undegraded":"2023-06-10T19:06:27.323985+0000","last_fullsized":"2023-06-10T19:06:27.323985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":1,"reported_epoch":151,"state":"creating+peering","last_fresh":"2023-06-10T19:06:27.340406+0000","last_change":"2023-06-10T19:06:27.340406+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.340406+0000","last_undegraded":"2023-06-10T19:06:27.340406+0000","last_fullsized":"2023-06-10T19:06:27.340406+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":1,"reported_epoch":151,"state":"creating+peering","last_fresh":"2023-06-10T19:06:27.344986+0000","last_change":"2023-06-10T19:06:27.344986+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.344986+0000","last_undegraded":"2023-06-10T19:06:27.344986+0000","last_fullsized":"2023-06-10T19:06:27.344986+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":1,"reported_epoch":151,"state":"creating+peering","last_fresh":"2023-06-10T19:06:27.333557+0000","last_change":"2023-06-10T19:06:27.333557+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.333557+0000","last_undegraded":"2023-06-10T19:06:27.333557+0000","last_fullsized":"2023-06-10T19:06:27.333557+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":1,"reported_epoch":151,"state":"creating+peering","last_fresh":"2023-06-10T19:06:27.337976+0000","last_change":"2023-06-10T19:06:27.337976+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.337976+0000","last_undegraded":"2023-06-10T19:06:27.337976+0000","last_fullsized":"2023-06-10T19:06:27.337976+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":1,"reported_epoch":151,"state":"creating+peering","last_fresh":"2023-06-10T19:06:27.330418+0000","last_change":"2023-06-10T19:06:27.330418+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.330418+0000","last_undegraded":"2023-06-10T19:06:27.330418+0000","last_fullsized":"2023-06-10T19:06:27.330418+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":1,"reported_epoch":151,"state":"creating+peering","last_fresh":"2023-06-10T19:06:27.333586+0000","last_change":"2023-06-10T19:06:27.333586+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.333586+0000","last_undegraded":"2023-06-10T19:06:27.333586+0000","last_fullsized":"2023-06-10T19:06:27.333586+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":1,"reported_epoch":151,"state":"creating+peering","last_fresh":"2023-06-10T19:06:27.330409+0000","last_change":"2023-06-10T19:06:27.330409+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.330409+0000","last_undegraded":"2023-06-10T19:06:27.330409+0000","last_fullsized":"2023-06-10T19:06:27.330409+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":1,"reported_epoch":151,"state":"creating+peering","last_fresh":"2023-06-10T19:06:27.333635+0000","last_change":"2023-06-10T19:06:27.333635+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.333635+0000","last_undegraded":"2023-06-10T19:06:27.333635+0000","last_fullsized":"2023-06-10T19:06:27.333635+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":1,"reported_epoch":151,"state":"creating+peering","last_fresh":"2023-06-10T19:06:27.339024+0000","last_change":"2023-06-10T19:06:27.339024+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.339024+0000","last_undegraded":"2023-06-10T19:06:27.339024+0000","last_fullsized":"2023-06-10T19:06:27.339024+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":1,"reported_epoch":151,"state":"creating+peering","last_fresh":"2023-06-10T19:06:27.348835+0000","last_change":"2023-06-10T19:06:27.348835+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.348835+0000","last_undegraded":"2023-06-10T19:06:27.348835+0000","last_fullsized":"2023-06-10T19:06:27.348835+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":1,"reported_epoch":151,"state":"creating+peering","last_fresh":"2023-06-10T19:06:27.333062+0000","last_change":"2023-06-10T19:06:27.333062+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.333062+0000","last_undegraded":"2023-06-10T19:06:27.333062+0000","last_fullsized":"2023-06-10T19:06:27.333062+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:27.323985+0000","last_change":"2023-06-10T19:06:27.323985+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.323985+0000","last_undegraded":"2023-06-10T19:06:27.323985+0000","last_fullsized":"2023-06-10T19:06:27.323985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":1,"reported_epoch":151,"state":"creating+peering","last_fresh":"2023-06-10T19:06:27.348787+0000","last_change":"2023-06-10T19:06:27.348787+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.348787+0000","last_undegraded":"2023-06-10T19:06:27.348787+0000","last_fullsized":"2023-06-10T19:06:27.348787+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":1,"reported_epoch":151,"state":"creating+peering","last_fresh":"2023-06-10T19:06:27.340422+0000","last_change":"2023-06-10T19:06:27.340422+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.340422+0000","last_undegraded":"2023-06-10T19:06:27.340422+0000","last_fullsized":"2023-06-10T19:06:27.340422+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":1,"reported_epoch":151,"state":"creating+peering","last_fresh":"2023-06-10T19:06:27.348737+0000","last_change":"2023-06-10T19:06:27.348737+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.348737+0000","last_undegraded":"2023-06-10T19:06:27.348737+0000","last_fullsized":"2023-06-10T19:06:27.348737+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":1,"reported_epoch":151,"state":"creating+peering","last_fresh":"2023-06-10T19:06:27.344861+0000","last_change":"2023-06-10T19:06:27.344861+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.344861+0000","last_undegraded":"2023-06-10T19:06:27.344861+0000","last_fullsized":"2023-06-10T19:06:27.344861+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":1,"reported_epoch":151,"state":"creating+peering","last_fresh":"2023-06-10T19:06:27.330573+0000","last_change":"2023-06-10T19:06:27.330573+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.330573+0000","last_undegraded":"2023-06-10T19:06:27.330573+0000","last_fullsized":"2023-06-10T19:06:27.330573+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":389,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-06-10T19:06:27.347308+0000","last_change":"2023-06-10T18:52:34.951528+0000","last_active":"2023-06-10T19:06:27.347308+0000","last_peered":"2023-06-10T19:06:27.347308+0000","last_clean":"2023-06-10T19:06:27.347308+0000","last_became_active":"2023-06-10T18:52:34.949099+0000","last_became_peered":"2023-06-10T18:52:34.949099+0000","last_unstale":"2023-06-10T19:06:27.347308+0000","last_undegraded":"2023-06-10T19:06:27.347308+0000","last_fullsized":"2023-06-10T19:06:27.347308+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_clean_scrub_stamp":"2023-06-10T18:52:33.633295+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:02:14.381678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":255,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-06-10T19:06:27.352091+0000","last_change":"2023-06-10T18:52:40.506384+0000","last_active":"2023-06-10T19:06:27.352091+0000","last_peered":"2023-06-10T19:06:27.352091+0000","last_clean":"2023-06-10T19:06:27.352091+0000","last_became_active":"2023-06-10T18:52:40.505701+0000","last_became_peered":"2023-06-10T18:52:40.505701+0000","last_unstale":"2023-06-10T19:06:27.352091+0000","last_undegraded":"2023-06-10T19:06:27.352091+0000","last_fullsized":"2023-06-10T19:06:27.352091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:12:31.850971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":1,"reported_epoch":151,"state":"creating+peering","last_fresh":"2023-06-10T19:06:27.344973+0000","last_change":"2023-06-10T19:06:27.344973+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.344973+0000","last_undegraded":"2023-06-10T19:06:27.344973+0000","last_fullsized":"2023-06-10T19:06:27.344973+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":233,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-06-10T19:06:27.347292+0000","last_change":"2023-06-10T18:52:40.512015+0000","last_active":"2023-06-10T19:06:27.347292+0000","last_peered":"2023-06-10T19:06:27.347292+0000","last_clean":"2023-06-10T19:06:27.347292+0000","last_became_active":"2023-06-10T18:52:40.511382+0000","last_became_peered":"2023-06-10T18:52:40.511382+0000","last_unstale":"2023-06-10T19:06:27.347292+0000","last_undegraded":"2023-06-10T19:06:27.347292+0000","last_fullsized":"2023-06-10T19:06:27.347292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:47:27.116209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":1,"reported_epoch":151,"state":"creating+peering","last_fresh":"2023-06-10T19:06:27.350114+0000","last_change":"2023-06-10T19:06:27.350114+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.350114+0000","last_undegraded":"2023-06-10T19:06:27.350114+0000","last_fullsized":"2023-06-10T19:06:27.350114+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":253,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-06-10T19:06:27.341460+0000","last_change":"2023-06-10T18:52:40.671725+0000","last_active":"2023-06-10T19:06:27.341460+0000","last_peered":"2023-06-10T19:06:27.341460+0000","last_clean":"2023-06-10T19:06:27.341460+0000","last_became_active":"2023-06-10T18:52:40.671442+0000","last_became_peered":"2023-06-10T18:52:40.671442+0000","last_unstale":"2023-06-10T19:06:27.341460+0000","last_undegraded":"2023-06-10T19:06:27.341460+0000","last_fullsized":"2023-06-10T19:06:27.341460+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:39:40.376529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":1,"reported_epoch":151,"state":"creating+peering","last_fresh":"2023-06-10T19:06:27.340003+0000","last_change":"2023-06-10T19:06:27.340003+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.340003+0000","last_undegraded":"2023-06-10T19:06:27.340003+0000","last_fullsized":"2023-06-10T19:06:27.340003+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":255,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-06-10T19:06:27.351589+0000","last_change":"2023-06-10T18:52:40.510258+0000","last_active":"2023-06-10T19:06:27.351589+0000","last_peered":"2023-06-10T19:06:27.351589+0000","last_clean":"2023-06-10T19:06:27.351589+0000","last_became_active":"2023-06-10T18:52:40.509560+0000","last_became_peered":"2023-06-10T18:52:40.509560+0000","last_unstale":"2023-06-10T19:06:27.351589+0000","last_undegraded":"2023-06-10T19:06:27.351589+0000","last_fullsized":"2023-06-10T19:06:27.351589+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:50:05.648602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:27.323985+0000","last_change":"2023-06-10T19:06:27.323985+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.323985+0000","last_undegraded":"2023-06-10T19:06:27.323985+0000","last_fullsized":"2023-06-10T19:06:27.323985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":233,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-06-10T19:06:27.334081+0000","last_change":"2023-06-10T18:52:40.672266+0000","last_active":"2023-06-10T19:06:27.334081+0000","last_peered":"2023-06-10T19:06:27.334081+0000","last_clean":"2023-06-10T19:06:27.334081+0000","last_became_active":"2023-06-10T18:52:40.671966+0000","last_became_peered":"2023-06-10T18:52:40.671966+0000","last_unstale":"2023-06-10T19:06:27.334081+0000","last_undegraded":"2023-06-10T19:06:27.334081+0000","last_fullsized":"2023-06-10T19:06:27.334081+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:10:16.750337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":1,"reported_epoch":151,"state":"creating+peering","last_fresh":"2023-06-10T19:06:27.338587+0000","last_change":"2023-06-10T19:06:27.338587+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.338587+0000","last_undegraded":"2023-06-10T19:06:27.338587+0000","last_fullsized":"2023-06-10T19:06:27.338587+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":233,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-06-10T19:06:27.347346+0000","last_change":"2023-06-10T18:52:40.671084+0000","last_active":"2023-06-10T19:06:27.347346+0000","last_peered":"2023-06-10T19:06:27.347346+0000","last_clean":"2023-06-10T19:06:27.347346+0000","last_became_active":"2023-06-10T18:52:40.670697+0000","last_became_peered":"2023-06-10T18:52:40.670697+0000","last_unstale":"2023-06-10T19:06:27.347346+0000","last_undegraded":"2023-06-10T19:06:27.347346+0000","last_fullsized":"2023-06-10T19:06:27.347346+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:49:50.216107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":1,"reported_epoch":151,"state":"creating+peering","last_fresh":"2023-06-10T19:06:27.338061+0000","last_change":"2023-06-10T19:06:27.338061+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.338061+0000","last_undegraded":"2023-06-10T19:06:27.338061+0000","last_fullsized":"2023-06-10T19:06:27.338061+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":233,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-06-10T19:06:27.334108+0000","last_change":"2023-06-10T18:52:40.514114+0000","last_active":"2023-06-10T19:06:27.334108+0000","last_peered":"2023-06-10T19:06:27.334108+0000","last_clean":"2023-06-10T19:06:27.334108+0000","last_became_active":"2023-06-10T18:52:40.513638+0000","last_became_peered":"2023-06-10T18:52:40.513638+0000","last_unstale":"2023-06-10T19:06:27.334108+0000","last_undegraded":"2023-06-10T19:06:27.334108+0000","last_fullsized":"2023-06-10T19:06:27.334108+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:20:15.088951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":1,"reported_epoch":151,"state":"creating+peering","last_fresh":"2023-06-10T19:06:27.348768+0000","last_change":"2023-06-10T19:06:27.348768+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.348768+0000","last_undegraded":"2023-06-10T19:06:27.348768+0000","last_fullsized":"2023-06-10T19:06:27.348768+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":235,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-06-10T19:06:27.340152+0000","last_change":"2023-06-10T18:52:40.515396+0000","last_active":"2023-06-10T19:06:27.340152+0000","last_peered":"2023-06-10T19:06:27.340152+0000","last_clean":"2023-06-10T19:06:27.340152+0000","last_became_active":"2023-06-10T18:52:40.514663+0000","last_became_peered":"2023-06-10T18:52:40.514663+0000","last_unstale":"2023-06-10T19:06:27.340152+0000","last_undegraded":"2023-06-10T19:06:27.340152+0000","last_fullsized":"2023-06-10T19:06:27.340152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:17:33.819336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":54,"acting":54,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575018,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33472,"kb_used_data":2424,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338368,"statfs":{"total":96636764160,"available":96602488832,"internally_reserved":0,"allocated":2482176,"data_stored":1468283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:06:01 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":0.96199999999999997,"15min":0.92900000000000005},"min":{"1min":0.70499999999999996,"5min":0.49399999999999999,"15min":0.434},"max":{"1min":1.522,"5min":1.522,"15min":1.6220000000000001},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.92100000000000004,"15min":0.92700000000000005},"min":{"1min":0.52800000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.6870000000000001},"last":0.69199999999999995}]},{"osd":1,"last update":"Sat Jun 10 19:06:01 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.91000000000000003,"15min":0.92000000000000004},"min":{"1min":0.56999999999999995,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1879999999999999,"5min":1.238,"15min":1.377},"last":1.0840000000000001},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.92800000000000005,"15min":0.94199999999999995},"min":{"1min":0.67800000000000005,"5min":0.51300000000000001,"15min":0.504},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.5960000000000001},"last":0.82899999999999996}]},{"osd":2,"last update":"Sat Jun 10 19:06:01 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.88100000000000001,"15min":0.85299999999999998},"min":{"1min":0.60999999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.4059999999999999},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.91000000000000003,"15min":0.89800000000000002},"min":{"1min":0.61399999999999999,"5min":0.54100000000000004,"15min":0.50600000000000001},"max":{"1min":1.129,"5min":1.448,"15min":1.448},"last":0.64700000000000002}]},{"osd":3,"last update":"Sat Jun 10 19:06:01 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.91300000000000003,"15min":0.92100000000000004},"min":{"1min":0.75800000000000001,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.502},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.97399999999999998,"15min":0.95699999999999996},"min":{"1min":0.58599999999999997,"5min":0.432,"15min":0.432},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.74199999999999999}]},{"osd":4,"last update":"Sat Jun 10 19:06:01 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.81599999999999995,"15min":0.84499999999999997},"min":{"1min":0.60299999999999998,"5min":0.307,"15min":0.307},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.639},"last":0.60799999999999998},{"interface":"front","average":{"1min":1.054,"5min":0.98499999999999999,"15min":0.96999999999999997},"min":{"1min":0.80200000000000005,"5min":0.41199999999999998,"15min":0.40000000000000002},"max":{"1min":1.3540000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.91000000000000003}]},{"osd":5,"last update":"Sat Jun 10 19:06:01 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":1.0049999999999999,"15min":1.006},"min":{"1min":0.64000000000000001,"5min":0.45100000000000001,"15min":0.38400000000000001},"max":{"1min":1.385,"5min":1.385,"15min":1.806},"last":0.996},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.03,"15min":1.0349999999999999},"min":{"1min":0.69699999999999995,"5min":0.48499999999999999,"15min":0.46500000000000002},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":1.0169999999999999}]},{"osd":6,"last update":"Sat Jun 10 19:06:01 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.999,"15min":1.004},"min":{"1min":0.67400000000000004,"5min":0.47699999999999998,"15min":0.35999999999999999},"max":{"1min":1.3149999999999999,"5min":1.391,"15min":1.718},"last":0.93899999999999995},{"interface":"front","average":{"1min":1.127,"5min":1.1020000000000001,"15min":1.097},"min":{"1min":0.82499999999999996,"5min":0.504,"15min":0.441},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":1.056}]}]},{"osd":6,"up_from":13,"seq":55834575019,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32880,"kb_used_data":1832,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338960,"statfs":{"total":96636764160,"available":96603095040,"internally_reserved":0,"allocated":1875968,"data_stored":871745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:05:53 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83799999999999997,"15min":0.85999999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.1839999999999999,"5min":1.2450000000000001,"15min":1.498},"last":1.149},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.86199999999999999,"15min":0.879},"min":{"1min":0.57099999999999995,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.496},"last":0.628}]},{"osd":1,"last update":"Sat Jun 10 19:05:53 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.84999999999999998,"15min":0.86699999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.5229999999999999},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.89500000000000002,"15min":0.89900000000000002},"min":{"1min":0.66000000000000003,"5min":0.48699999999999999,"15min":0.45300000000000001},"max":{"1min":1.341,"5min":1.341,"15min":1.778},"last":0.68400000000000005}]},{"osd":2,"last update":"Sat Jun 10 19:05:53 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.91400000000000003,"15min":0.89900000000000002},"min":{"1min":0.51200000000000001,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.224,"5min":1.2809999999999999,"15min":1.3759999999999999},"last":1.115},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.86699999999999999,"15min":0.88500000000000001},"min":{"1min":0.60499999999999998,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.1220000000000001,"5min":1.2330000000000001,"15min":1.246},"last":0.91900000000000004}]},{"osd":3,"last update":"Sat Jun 10 19:05:53 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.55900000000000005,"5min":0.55100000000000005,"15min":0.52700000000000002},"max":{"1min":1.202,"5min":1.238,"15min":1.7190000000000001},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.96299999999999997,"15min":0.98299999999999998},"min":{"1min":0.61599999999999999,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.198,"5min":1.371,"15min":1.4370000000000001},"last":0.77500000000000002}]},{"osd":4,"last update":"Sat Jun 10 19:05:53 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.90600000000000003,"15min":0.91200000000000003},"min":{"1min":0.48499999999999999,"5min":0.373,"15min":0.373},"max":{"1min":1.248,"5min":1.401,"15min":1.798},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.032,"5min":0.99399999999999999,"15min":0.98899999999999999},"min":{"1min":0.60399999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.371,"5min":1.371,"15min":1.5489999999999999},"last":0.89100000000000001}]},{"osd":5,"last update":"Sat Jun 10 19:05:53 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.89700000000000002,"15min":0.91500000000000004},"min":{"1min":0.66000000000000003,"5min":0.437,"15min":0.437},"max":{"1min":1.1950000000000001,"5min":1.29,"15min":1.333},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.0109999999999999,"5min":0.997,"15min":1.0209999999999999},"min":{"1min":0.63100000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.256,"5min":1.296,"15min":2.536},"last":1.0580000000000001}]},{"osd":7,"last update":"Sat Jun 10 19:05:53 2023","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.054,"15min":1.0329999999999999},"min":{"1min":0.73999999999999999,"5min":0.58599999999999997,"15min":0.57099999999999995},"max":{"1min":1.2929999999999999,"5min":1.879,"15min":1.917},"last":1.0289999999999999},{"interface":"front","average":{"1min":0.998,"5min":0.98899999999999999,"15min":1.012},"min":{"1min":0.64000000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.345,"5min":1.4850000000000001,"15min":1.5569999999999999},"last":1.083}]}]},{"osd":5,"up_from":13,"seq":55834575019,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32880,"kb_used_data":1832,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338960,"statfs":{"total":96636764160,"available":96603095040,"internally_reserved":0,"allocated":1875968,"data_stored":871745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.877,"15min":0.873},"min":{"1min":0.51500000000000001,"5min":0.499,"15min":0.499},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.94199999999999995,"15min":0.91800000000000004},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.49399999999999999},"max":{"1min":1.212,"5min":2.347,"15min":2.347},"last":0.92400000000000004}]},{"osd":1,"last update":"Sat Jun 10 19:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.96299999999999997,"15min":0.91900000000000004},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.52600000000000002},"max":{"1min":1.6739999999999999,"5min":7.0800000000000001,"15min":7.0800000000000001},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.86499999999999999,"5min":1.117,"15min":0.98399999999999999},"min":{"1min":0.59599999999999997,"5min":0.56499999999999995,"15min":0.53800000000000003},"max":{"1min":1.171,"5min":15.845000000000001,"15min":15.845000000000001},"last":0.86799999999999999}]},{"osd":2,"last update":"Sat Jun 10 19:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.94999999999999996,"15min":0.89400000000000002},"min":{"1min":0.59899999999999998,"5min":0.54300000000000004,"15min":0.48299999999999998},"max":{"1min":1.6459999999999999,"5min":5.0049999999999999,"15min":5.0049999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.99299999999999999,"15min":0.94499999999999995},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.391,"5min":6.851,"15min":6.851},"last":0.95699999999999996}]},{"osd":3,"last update":"Sat Jun 10 19:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.96799999999999997,"15min":0.95599999999999996},"min":{"1min":0.58699999999999997,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.6910000000000001,"5min":2.544,"15min":2.544},"last":1.071},{"interface":"front","average":{"1min":0.98299999999999998,"5min":1.004,"15min":0.999},"min":{"1min":0.66000000000000003,"5min":0.63100000000000001,"15min":0.59799999999999998},"max":{"1min":1.4870000000000001,"5min":3.0830000000000002,"15min":3.0830000000000002},"last":0.67500000000000004}]},{"osd":4,"last update":"Sat Jun 10 19:05:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.012,"15min":0.95699999999999996},"min":{"1min":0.65300000000000002,"5min":0.64000000000000001,"15min":0.58099999999999996},"max":{"1min":1.6140000000000001,"5min":6.7290000000000001,"15min":6.7290000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.97399999999999998,"15min":0.99399999999999999},"min":{"1min":0.70199999999999996,"5min":0.64900000000000002,"15min":0.61199999999999999},"max":{"1min":1.446,"5min":1.446,"15min":1.575},"last":0.98199999999999998}]},{"osd":6,"last update":"Sat Jun 10 19:05:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":0.98999999999999999,"15min":0.997},"min":{"1min":0.65300000000000002,"5min":0.60499999999999998,"15min":0.54200000000000004},"max":{"1min":1.8009999999999999,"5min":1.8009999999999999,"15min":1.8009999999999999},"last":0.83799999999999997},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.105,"15min":1.0600000000000001},"min":{"1min":0.73299999999999998,"5min":0.71999999999999997,"15min":0.57899999999999996},"max":{"1min":1.8380000000000001,"5min":6.923,"15min":6.923},"last":1.048}]},{"osd":7,"last update":"Sat Jun 10 19:05:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.101,"15min":1.095},"min":{"1min":0.70699999999999996,"5min":0.69899999999999995,"15min":0.66200000000000003},"max":{"1min":1.7749999999999999,"5min":2.6080000000000001,"15min":2.6080000000000001},"last":0.72299999999999998},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1850000000000001,"15min":1.143},"min":{"1min":0.84399999999999997,"5min":0.72499999999999998,"15min":0.66200000000000003},"max":{"1min":1.732,"5min":5.4169999999999998,"15min":5.4169999999999998},"last":1.024}]}]},{"osd":4,"up_from":13,"seq":55834575018,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32892,"kb_used_data":1844,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338948,"statfs":{"total":96636764160,"available":96603082752,"internally_reserved":0,"allocated":1888256,"data_stored":877915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:06:06 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.84899999999999998,"15min":0.82799999999999996},"min":{"1min":0.502,"5min":0.45400000000000001,"15min":0.45100000000000001},"max":{"1min":1.1319999999999999,"5min":1.29,"15min":1.29},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.91000000000000003,"15min":0.90800000000000003},"min":{"1min":0.64100000000000001,"5min":0.498,"15min":0.48899999999999999},"max":{"1min":1.1699999999999999,"5min":1.3979999999999999,"15min":3.7280000000000002},"last":1.375}]},{"osd":1,"last update":"Sat Jun 10 19:06:06 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.90700000000000003,"15min":0.93300000000000005},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47599999999999998},"max":{"1min":1.196,"5min":1.3600000000000001,"15min":3.3969999999999998},"last":1.5429999999999999},{"interface":"front","average":{"1min":0.87,"5min":0.84799999999999998,"15min":0.86199999999999999},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47699999999999998},"max":{"1min":1.1679999999999999,"5min":1.2430000000000001,"15min":2.496},"last":0.88300000000000001}]},{"osd":2,"last update":"Sat Jun 10 19:06:06 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.876,"15min":0.88100000000000001},"min":{"1min":0.52800000000000002,"5min":0.52200000000000002,"15min":0.49299999999999999},"max":{"1min":1.206,"5min":1.3,"15min":1.522},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.97499999999999998,"15min":0.98899999999999999},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.55000000000000004},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":3.5750000000000002},"last":1.4670000000000001}]},{"osd":3,"last update":"Sat Jun 10 19:06:06 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.89000000000000001,"15min":0.89700000000000002},"min":{"1min":0.68200000000000005,"5min":0.56200000000000006,"15min":0.53900000000000003},"max":{"1min":1.0669999999999999,"5min":1.46,"15min":2.3809999999999998},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95999999999999996,"15min":0.96599999999999997},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.54400000000000004},"max":{"1min":1.2929999999999999,"5min":1.4279999999999999,"15min":1.6479999999999999},"last":0.73299999999999998}]},{"osd":5,"last update":"Sat Jun 10 19:06:06 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.94499999999999995,"15min":0.96099999999999997},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.53100000000000003},"max":{"1min":1.2290000000000001,"5min":1.3260000000000001,"15min":3.6539999999999999},"last":1.083},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.91500000000000004,"15min":0.94299999999999995},"min":{"1min":0.54600000000000004,"5min":0.495,"15min":0.495},"max":{"1min":1.2170000000000001,"5min":1.26,"15min":2.6720000000000002},"last":1}]},{"osd":6,"last update":"Sat Jun 10 19:06:06 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.97099999999999997,"15min":0.97199999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.2270000000000001,"5min":1.413,"15min":2.2639999999999998},"last":1.196},{"interface":"front","average":{"1min":1.036,"5min":1.0720000000000001,"15min":1.069},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.44400000000000001},"max":{"1min":1.3100000000000001,"5min":1.4670000000000001,"15min":3.4980000000000002},"last":1.625}]},{"osd":7,"last update":"Sat Jun 10 19:06:06 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":1.0189999999999999,"15min":0.998},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.41399999999999998},"max":{"1min":1.2370000000000001,"5min":1.3919999999999999,"15min":2.5910000000000002},"last":1.1439999999999999},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.087,"15min":1.071},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.46300000000000002},"max":{"1min":1.635,"5min":1.635,"15min":1.635},"last":0.92800000000000005}]}]},{"osd":3,"up_from":13,"seq":55834575017,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36972,"kb_used_data":1828,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334868,"statfs":{"total":96636764160,"available":96598904832,"internally_reserved":0,"allocated":1871872,"data_stored":870726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.63900000000000001,"15min":0.62},"min":{"1min":0.42099999999999999,"5min":0.248,"15min":0.248},"max":{"1min":0.99299999999999999,"5min":1.1539999999999999,"15min":1.169},"last":0.626},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.67500000000000004,"15min":0.66800000000000004},"min":{"1min":0.318,"5min":0.30299999999999999,"15min":0.251},"max":{"1min":0.96899999999999997,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.80100000000000005}]},{"osd":1,"last update":"Sat Jun 10 19:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.69299999999999995,"15min":0.67900000000000005},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.27500000000000002},"max":{"1min":0.98799999999999999,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.748},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.71299999999999997,"15min":0.73199999999999998},"min":{"1min":0.35499999999999998,"5min":0.34399999999999997,"15min":0.318},"max":{"1min":0.89700000000000002,"5min":1.2569999999999999,"15min":1.411},"last":0.72899999999999998}]},{"osd":2,"last update":"Sat Jun 10 19:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.75600000000000001,"15min":0.77400000000000002},"min":{"1min":0.40699999999999997,"5min":0.39300000000000002,"15min":0.30299999999999999},"max":{"1min":1.155,"5min":1.2829999999999999,"15min":1.9530000000000001},"last":0.5},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.81299999999999994,"15min":0.79000000000000004},"min":{"1min":0.39200000000000002,"5min":0.35299999999999998,"15min":0.29699999999999999},"max":{"1min":1.2769999999999999,"5min":1.591,"15min":1.591},"last":0.877}]},{"osd":4,"last update":"Sat Jun 10 19:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.96599999999999997,"15min":0.95599999999999996},"min":{"1min":0.67800000000000005,"5min":0.60899999999999999,"15min":0.41899999999999998},"max":{"1min":1.333,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":1.008},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.98899999999999999,"15min":0.99199999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.47999999999999998},"max":{"1min":1.2110000000000001,"5min":1.873,"15min":1.873},"last":0.84799999999999998}]},{"osd":5,"last update":"Sat Jun 10 19:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":1.004,"15min":1.0169999999999999},"min":{"1min":0.55900000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.3120000000000001,"5min":1.752,"15min":2.024},"last":1.052},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0369999999999999,"15min":1.0309999999999999},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.46899999999999997},"max":{"1min":1.337,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.97299999999999998}]},{"osd":6,"last update":"Sat Jun 10 19:05:52 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.0669999999999999,"15min":1.0609999999999999},"min":{"1min":0.625,"5min":0.56999999999999995,"15min":0.55300000000000005},"max":{"1min":1.258,"5min":1.786,"15min":1.8500000000000001},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0589999999999999,"15min":1.0580000000000001},"min":{"1min":0.69499999999999995,"5min":0.61199999999999999,"15min":0.58799999999999997},"max":{"1min":1.3029999999999999,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":1.1339999999999999}]},{"osd":7,"last update":"Sat Jun 10 19:05:52 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.0800000000000001,"15min":1.093},"min":{"1min":0.77200000000000002,"5min":0.57999999999999996,"15min":0.56999999999999995},"max":{"1min":1.27,"5min":2.1150000000000002,"15min":2.1150000000000002},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.089,"15min":1.0960000000000001},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.61099999999999999},"max":{"1min":1.3129999999999999,"5min":1.9850000000000001,"15min":1.9850000000000001},"last":0.93899999999999995}]}]},{"osd":2,"up_from":13,"seq":55834575018,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32880,"kb_used_data":1832,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338960,"statfs":{"total":96636764160,"available":96603095040,"internally_reserved":0,"allocated":1875968,"data_stored":871745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.65100000000000002,"15min":0.624},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.27300000000000002},"max":{"1min":2.883,"5min":2.883,"15min":2.883},"last":0.498},{"interface":"front","average":{"1min":1.0389999999999999,"5min":0.77400000000000002,"15min":0.74299999999999999},"min":{"1min":0.40400000000000003,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":6.5670000000000002,"5min":6.5670000000000002,"15min":6.5670000000000002},"last":0.52500000000000002}]},{"osd":1,"last update":"Sat Jun 10 19:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.65000000000000002,"15min":0.66400000000000003},"min":{"1min":0.32300000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.91000000000000003,"5min":1.0389999999999999,"15min":1.1950000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":1.204,"5min":0.82699999999999996,"15min":0.78400000000000003},"min":{"1min":0.374,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":8.4429999999999996,"5min":8.4429999999999996,"15min":8.4429999999999996},"last":0.623}]},{"osd":3,"last update":"Sat Jun 10 19:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80100000000000005,"15min":0.77600000000000002},"min":{"1min":0.40899999999999997,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.105,"5min":1.1899999999999999,"15min":1.2350000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.78800000000000003,"15min":0.78400000000000003},"min":{"1min":0.42299999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":4.1849999999999996,"5min":4.1849999999999996,"15min":4.1849999999999996},"last":0.59199999999999997}]},{"osd":4,"last update":"Sat Jun 10 19:06:00 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":0.96499999999999997,"15min":0.94099999999999995},"min":{"1min":0.70299999999999996,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":3.996,"5min":3.996,"15min":3.996},"last":0.73199999999999998},{"interface":"front","average":{"1min":1.6759999999999999,"5min":1.1299999999999999,"15min":1.0600000000000001},"min":{"1min":0.53100000000000003,"5min":0.496,"15min":0.496},"max":{"1min":13.254,"5min":13.254,"15min":13.254},"last":1.0289999999999999}]},{"osd":5,"last update":"Sat Jun 10 19:06:00 2023","interfaces":[{"interface":"back","average":{"1min":1.643,"5min":1.125,"15min":1.0549999999999999},"min":{"1min":0.57999999999999996,"5min":0.55900000000000005,"15min":0.54100000000000004},"max":{"1min":6.9189999999999996,"5min":6.9189999999999996,"15min":6.9189999999999996},"last":1.113},{"interface":"front","average":{"1min":2.1299999999999999,"5min":1.2410000000000001,"15min":1.0920000000000001},"min":{"1min":0.72199999999999998,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":15.526,"5min":15.526,"15min":15.526},"last":0.98999999999999999}]},{"osd":6,"last update":"Sat Jun 10 19:06:00 2023","interfaces":[{"interface":"back","average":{"1min":1.5980000000000001,"5min":1.149,"15min":1.083},"min":{"1min":0.74199999999999999,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":8.7089999999999996,"5min":8.7089999999999996,"15min":8.7089999999999996},"last":0.78300000000000003},{"interface":"front","average":{"1min":1.296,"5min":1.0880000000000001,"15min":1.0620000000000001},"min":{"1min":0.63800000000000001,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":6.1299999999999999,"5min":6.1299999999999999,"15min":6.1299999999999999},"last":0.97299999999999998}]},{"osd":7,"last update":"Sat Jun 10 19:06:00 2023","interfaces":[{"interface":"back","average":{"1min":2.2229999999999999,"5min":1.3260000000000001,"15min":1.175},"min":{"1min":0.74099999999999999,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":12.138,"5min":12.138,"15min":12.138},"last":1.077},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.105,"15min":1.1100000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.421,"5min":1.657,"15min":1.752},"last":0.94799999999999995}]}]},{"osd":1,"up_from":13,"seq":55834575020,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36972,"kb_used_data":1828,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334868,"statfs":{"total":96636764160,"available":96598904832,"internally_reserved":0,"allocated":1871872,"data_stored":870726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:06:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66300000000000003,"15min":0.67600000000000005},"min":{"1min":0.33600000000000002,"5min":0.32100000000000001,"15min":0.25800000000000001},"max":{"1min":0.97499999999999998,"5min":1.111,"15min":1.288},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.74399999999999999},"min":{"1min":0.35699999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.079,"5min":1.1859999999999999,"15min":1.694},"last":0.50900000000000001}]},{"osd":2,"last update":"Sat Jun 10 19:06:02 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.249},"max":{"1min":0.86099999999999999,"5min":1.0900000000000001,"15min":1.21},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.69999999999999996,"15min":0.71699999999999997},"min":{"1min":0.33000000000000002,"5min":0.32800000000000001,"15min":0.29699999999999999},"max":{"1min":0.89400000000000002,"5min":1.1040000000000001,"15min":1.415},"last":0.80900000000000005}]},{"osd":3,"last update":"Sat Jun 10 19:06:02 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.77300000000000002,"15min":0.78200000000000003},"min":{"1min":0.38200000000000001,"5min":0.34000000000000002,"15min":0.25600000000000001},"max":{"1min":1.0620000000000001,"5min":1.1679999999999999,"15min":1.6299999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.70299999999999996,"15min":0.73599999999999999},"min":{"1min":0.38800000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.1479999999999999,"5min":1.2909999999999999,"15min":2.1749999999999998},"last":0.73199999999999998}]},{"osd":4,"last update":"Sat Jun 10 19:06:02 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.85499999999999998,"15min":0.86299999999999999},"min":{"1min":0.59499999999999997,"5min":0.56399999999999995,"15min":0.53000000000000003},"max":{"1min":1.0309999999999999,"5min":1.343,"15min":1.4930000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":1.006,"5min":0.97799999999999998,"15min":1.034},"min":{"1min":0.60299999999999998,"5min":0.47299999999999998,"15min":0.47099999999999997},"max":{"1min":1.3340000000000001,"5min":1.492,"15min":5.8209999999999997},"last":0.998}]},{"osd":5,"last update":"Sat Jun 10 19:06:02 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.97199999999999998,"15min":0.998},"min":{"1min":0.63,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.2949999999999999,"5min":1.6299999999999999,"15min":1.8620000000000001},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.94499999999999995,"15min":0.97699999999999998},"min":{"1min":0.56100000000000005,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.194,"5min":1.3220000000000001,"15min":3.089},"last":0.83999999999999997}]},{"osd":6,"last update":"Sat Jun 10 19:06:02 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.99399999999999999,"15min":1.0489999999999999},"min":{"1min":0.61199999999999999,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.238,"5min":1.6759999999999999,"15min":7.2599999999999998},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.0089999999999999,"5min":0.98999999999999999,"15min":1.036},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.2829999999999999,"5min":1.6000000000000001,"15min":9.0069999999999997},"last":0.878}]},{"osd":7,"last update":"Sat Jun 10 19:06:02 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.0449999999999999,"15min":1.0780000000000001},"min":{"1min":0.65300000000000002,"5min":0.58799999999999997,"15min":0.495},"max":{"1min":1.3999999999999999,"5min":1.494,"15min":2.105},"last":1.1850000000000001},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0449999999999999,"15min":1.0800000000000001},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.56699999999999995},"max":{"1min":1.321,"5min":1.5620000000000001,"15min":2.2570000000000001},"last":1.2270000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575019,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37564,"kb_used_data":2420,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334276,"statfs":{"total":96636764160,"available":96598298624,"internally_reserved":0,"allocated":2478080,"data_stored":1467264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jun 10 19:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.63100000000000001,"15min":0.63400000000000001},"min":{"1min":0.46200000000000002,"5min":0.309,"15min":0.248},"max":{"1min":0.92300000000000004,"5min":1.127,"15min":1.127},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.44900000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.028,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.54400000000000004}]},{"osd":2,"last update":"Sat Jun 10 19:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.73999999999999999,"15min":0.71699999999999997},"min":{"1min":0.35199999999999998,"5min":0.33500000000000002,"15min":0.29199999999999998},"max":{"1min":1.0640000000000001,"5min":1.2010000000000001,"15min":1.2829999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.65000000000000002,"15min":0.65400000000000003},"min":{"1min":0.30199999999999999,"5min":0.28699999999999998,"15min":0.245},"max":{"1min":1.1080000000000001,"5min":1.1779999999999999,"15min":1.371},"last":0.58799999999999997}]},{"osd":3,"last update":"Sat Jun 10 19:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.68300000000000005,"15min":0.68400000000000005},"min":{"1min":0.35499999999999998,"5min":0.30299999999999999,"15min":0.28899999999999998},"max":{"1min":1.133,"5min":1.133,"15min":1.226},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.82599999999999996,"15min":0.82299999999999995},"min":{"1min":0.39100000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.179,"5min":1.742,"15min":1.829},"last":0.68100000000000005}]},{"osd":4,"last update":"Sat Jun 10 19:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.91700000000000004,"15min":0.92100000000000004},"min":{"1min":0.65600000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.2210000000000001,"5min":1.7250000000000001,"15min":3.0209999999999999},"last":0.624},{"interface":"front","average":{"1min":0.98499999999999999,"5min":1.0169999999999999,"15min":1.026},"min":{"1min":0.58799999999999997,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.266,"5min":1.873,"15min":1.9510000000000001},"last":1.256}]},{"osd":5,"last update":"Sat Jun 10 19:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.92400000000000004,"15min":0.93600000000000005},"min":{"1min":0.54000000000000004,"5min":0.51200000000000001,"15min":0.45100000000000001},"max":{"1min":1.224,"5min":1.3109999999999999,"15min":1.694},"last":1.0229999999999999},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.98899999999999999,"15min":1.0049999999999999},"min":{"1min":0.60399999999999998,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.278,"5min":1.78,"15min":4.5620000000000003},"last":0.66300000000000003}]},{"osd":6,"last update":"Sat Jun 10 19:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":1.054,"15min":1.073},"min":{"1min":0.628,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.2250000000000001,"5min":1.7909999999999999,"15min":3.5569999999999999},"last":1.2030000000000001},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.99399999999999999,"15min":1.0009999999999999},"min":{"1min":0.71099999999999997,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.2969999999999999,"5min":1.6319999999999999,"15min":1.883},"last":1.087}]},{"osd":7,"last update":"Sat Jun 10 19:06:00 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.0249999999999999,"15min":1.0309999999999999},"min":{"1min":0.61799999999999999,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.375,"5min":1.512,"15min":1.5800000000000001},"last":1.149},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0569999999999999,"15min":1.0589999999999999},"min":{"1min":0.67700000000000005,"5min":0.63,"15min":0.58699999999999997},"max":{"1min":1.341,"5min":1.6619999999999999,"15min":1.9830000000000001},"last":0.71299999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-10T19:06:33.515 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-10T19:06:33.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.682+0000 7f16dbf41640 1 Processor -- start 2023-06-10T19:06:33.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.682+0000 7f16dbf41640 1 -- start start 2023-06-10T19:06:33.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.682+0000 7f16dbf41640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16d40ccae0 0x7f16d40d0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:33.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.682+0000 7f16dbf41640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16d40d0020 con 0x7f16d40cc690 2023-06-10T19:06:33.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.682+0000 7f16dbf41640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16d40cef40 con 0x7f16d40b3ac0 2023-06-10T19:06:33.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.682+0000 7f16dbf41640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16d40cf220 con 0x7f16d40ccae0 2023-06-10T19:06:33.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.682+0000 7f16d94dc640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f16d40cc690 0x7f16d40d04b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:37458/0 (socket says 172.21.15.53:37458) 2023-06-10T19:06:33.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.682+0000 7f16d94dc640 1 -- 172.21.15.53:0/1418464689 learned_addr learned my addr 172.21.15.53:0/1418464689 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:06:33.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.682+0000 7f16da4de640 1 --2- 172.21.15.53:0/1418464689 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16d40ccae0 0x7f16d40d0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:33.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.682+0000 7f16d8cdb640 1 -- 172.21.15.53:0/1418464689 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2875316789 0 0) 0x7f16d40d0020 con 0x7f16d40cc690 2023-06-10T19:06:33.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.682+0000 7f16d8cdb640 1 -- 172.21.15.53:0/1418464689 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16bc003530 con 0x7f16d40cc690 2023-06-10T19:06:33.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.682+0000 7f16d8cdb640 1 -- 172.21.15.53:0/1418464689 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1365917030 0 0) 0x7f16bc003530 con 0x7f16d40cc690 2023-06-10T19:06:33.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.682+0000 7f16d8cdb640 1 -- 172.21.15.53:0/1418464689 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16d40ccae0 msgr2=0x7f16d40d0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:33.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.682+0000 7f16d8cdb640 1 --2- 172.21.15.53:0/1418464689 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16d40ccae0 0x7f16d40d0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:33.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.682+0000 7f16d8cdb640 1 -- 172.21.15.53:0/1418464689 >> v1:172.21.15.117:6789/0 conn(0x7f16d40b3ac0 legacy=0x7f16d40b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:33.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.682+0000 7f16d8cdb640 1 -- 172.21.15.53:0/1418464689 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16d40cf500 con 0x7f16d40cc690 2023-06-10T19:06:33.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.682+0000 7f16d8cdb640 1 -- 172.21.15.53:0/1418464689 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f16c8001680 con 0x7f16d40cc690 2023-06-10T19:06:33.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.682+0000 7f16d8cdb640 1 -- 172.21.15.53:0/1418464689 >> v1:172.21.15.53:6789/0 conn(0x7f16d40cc690 legacy=0x7f16d40d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:33.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.682+0000 7f16d8cdb640 1 --2- 172.21.15.53:0/1418464689 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16bc003a20 0x7f16bc003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:33.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.682+0000 7f16d8cdb640 1 --2- 172.21.15.53:0/1418464689 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16bc0047d0 0x7f16bc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:33.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.682+0000 7f16d8cdb640 1 --2- 172.21.15.53:0/1418464689 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16d40ccae0 0x7f16bc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:33.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.682+0000 7f16d8cdb640 1 -- 172.21.15.53:0/1418464689 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16d40cf220 con 0x7f16bc003a20 2023-06-10T19:06:33.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.682+0000 7f16d8cdb640 1 -- 172.21.15.53:0/1418464689 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16bc00baa0 con 0x7f16bc0047d0 2023-06-10T19:06:33.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.682+0000 7f16d8cdb640 1 -- 172.21.15.53:0/1418464689 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16bc00bc60 con 0x7f16d40ccae0 2023-06-10T19:06:33.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.682+0000 7f16d9cdd640 1 --2- 172.21.15.53:0/1418464689 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16bc003a20 0x7f16bc003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:33.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.682+0000 7f16d94dc640 1 --2- 172.21.15.53:0/1418464689 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16bc0047d0 0x7f16bc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:33.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.682+0000 7f16d9cdd640 1 -- 172.21.15.53:0/1418464689 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16d40ccae0 msgr2=0x7f16bc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:33.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.682+0000 7f16d9cdd640 1 --2- 172.21.15.53:0/1418464689 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16d40ccae0 0x7f16bc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:33.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.682+0000 7f16d9cdd640 1 -- 172.21.15.53:0/1418464689 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16bc0047d0 msgr2=0x7f16bc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:33.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.682+0000 7f16d9cdd640 1 --2- 172.21.15.53:0/1418464689 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16bc0047d0 0x7f16bc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:33.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.682+0000 7f16d9cdd640 1 -- 172.21.15.53:0/1418464689 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16bc003530 con 0x7f16bc003a20 2023-06-10T19:06:33.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.682+0000 7f16d94dc640 1 --2- 172.21.15.53:0/1418464689 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16bc0047d0 0x7f16bc004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:06:33.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.686+0000 7f16d9cdd640 1 --2- 172.21.15.53:0/1418464689 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16bc003a20 0x7f16bc003e30 secure :-1 s=READY pgs=2223 cs=0 l=1 rev1=1 crypto rx=0x7f16c4001e70 tx=0x7f16c401c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d7ba22f29c01d7 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:33.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.686+0000 7f16d8cdb640 1 -- 172.21.15.53:0/1418464689 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c4003b80 con 0x7f16bc003a20 2023-06-10T19:06:33.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.686+0000 7f16d8cdb640 1 -- 172.21.15.53:0/1418464689 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16c4003ce0 con 0x7f16bc003a20 2023-06-10T19:06:33.693 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.686+0000 7f16d8cdb640 1 -- 172.21.15.53:0/1418464689 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c40052c0 con 0x7f16bc003a20 2023-06-10T19:06:33.693 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.686+0000 7f16dbf41640 1 -- 172.21.15.53:0/1418464689 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16bc003a20 msgr2=0x7f16bc003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:33.693 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.686+0000 7f16dbf41640 1 --2- 172.21.15.53:0/1418464689 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16bc003a20 0x7f16bc003e30 secure :-1 s=READY pgs=2223 cs=0 l=1 rev1=1 crypto rx=0x7f16c4001e70 tx=0x7f16c401c730 comp rx=0 tx=0).stop 2023-06-10T19:06:33.693 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.686+0000 7f16da4de640 1 -- 172.21.15.53:0/1418464689 reap_dead start 2023-06-10T19:06:33.693 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.686+0000 7f16dbf41640 1 -- 172.21.15.53:0/1418464689 shutdown_connections 2023-06-10T19:06:33.693 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.686+0000 7f16dbf41640 1 -- 172.21.15.53:0/1418464689 >> 172.21.15.53:0/1418464689 conn(0x7f16d4071790 msgr2=0x7f16d4069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:33.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.686+0000 7f16dbf41640 1 -- 172.21.15.53:0/1418464689 shutdown_connections 2023-06-10T19:06:33.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.686+0000 7f16dbf41640 1 -- 172.21.15.53:0/1418464689 wait complete. 2023-06-10T19:06:33.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.686+0000 7f16dbf41640 1 Processor -- start 2023-06-10T19:06:33.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.686+0000 7f16dbf41640 1 -- start start 2023-06-10T19:06:33.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.686+0000 7f16dbf41640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16d415f310 0x7f16d415ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:33.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.686+0000 7f16dbf41640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16d4154af0 0x7f16d415a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:33.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.686+0000 7f16dbf41640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16d415f6e0 0x7f16d415a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:33.695 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.690+0000 7f16dbf41640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16d4155390 con 0x7f16d415f310 2023-06-10T19:06:33.695 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.690+0000 7f16dbf41640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16d40c9700 con 0x7f16d4154af0 2023-06-10T19:06:33.695 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.690+0000 7f16dbf41640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16d40c99e0 con 0x7f16d415f6e0 2023-06-10T19:06:33.695 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.690+0000 7f16d9cdd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16d415f310 0x7f16d415ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:33.695 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.690+0000 7f16d9cdd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16d415f310 0x7f16d415ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51120/0 (socket says 172.21.15.53:51120) 2023-06-10T19:06:33.695 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.690+0000 7f16d9cdd640 1 -- 172.21.15.53:0/1665691610 learned_addr learned my addr 172.21.15.53:0/1665691610 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:33.695 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.690+0000 7f16da4de640 1 --2- 172.21.15.53:0/1665691610 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16d415f6e0 0x7f16d415a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:33.696 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.690+0000 7f16d94dc640 1 --2- 172.21.15.53:0/1665691610 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16d4154af0 0x7f16d415a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:33.696 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.690+0000 7f16d9cdd640 1 -- 172.21.15.53:0/1665691610 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16d415f6e0 msgr2=0x7f16d415a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:33.696 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.690+0000 7f16d9cdd640 1 --2- 172.21.15.53:0/1665691610 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16d415f6e0 0x7f16d415a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:33.696 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.690+0000 7f16d9cdd640 1 -- 172.21.15.53:0/1665691610 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16d4154af0 msgr2=0x7f16d415a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:33.696 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.690+0000 7f16d9cdd640 1 --2- 172.21.15.53:0/1665691610 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16d4154af0 0x7f16d415a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:33.697 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.690+0000 7f16d9cdd640 1 -- 172.21.15.53:0/1665691610 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16d415e2f0 con 0x7f16d415f310 2023-06-10T19:06:33.697 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.690+0000 7f16d9cdd640 1 --2- 172.21.15.53:0/1665691610 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16d415f310 0x7f16d415ddb0 secure :-1 s=READY pgs=2224 cs=0 l=1 rev1=1 crypto rx=0x7f16c4098030 tx=0x7f16bc005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:33.697 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.690+0000 7f16d27fc640 1 -- 172.21.15.53:0/1665691610 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c4005230 con 0x7f16d415f310 2023-06-10T19:06:33.697 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.690+0000 7f16d27fc640 1 -- 172.21.15.53:0/1665691610 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16c4005390 con 0x7f16d415f310 2023-06-10T19:06:33.697 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.690+0000 7f16d27fc640 1 -- 172.21.15.53:0/1665691610 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c4005720 con 0x7f16d415f310 2023-06-10T19:06:33.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.690+0000 7f16dbf41640 1 -- 172.21.15.53:0/1665691610 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16d415e590 con 0x7f16d415f310 2023-06-10T19:06:33.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.690+0000 7f16dbf41640 1 -- 172.21.15.53:0/1665691610 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16d415eb50 con 0x7f16d415f310 2023-06-10T19:06:33.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.690+0000 7f16dbf41640 1 -- 172.21.15.53:0/1665691610 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16d404d790 con 0x7f16d415f310 2023-06-10T19:06:33.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.690+0000 7f16d27fc640 1 -- 172.21.15.53:0/1665691610 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f16c40a9420 con 0x7f16d415f310 2023-06-10T19:06:33.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.690+0000 7f16d27fc640 1 --2- 172.21.15.53:0/1665691610 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f16c00662b0 0x7f16c0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:33.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.690+0000 7f16d27fc640 1 -- 172.21.15.53:0/1665691610 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f16c411d330 con 0x7f16d415f310 2023-06-10T19:06:33.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.690+0000 7f16d94dc640 1 --2- 172.21.15.53:0/1665691610 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f16c00662b0 0x7f16c0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:33.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.694+0000 7f16d94dc640 1 --2- 172.21.15.53:0/1665691610 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f16c00662b0 0x7f16c0068760 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f16c8001ec0 tx=0x7f16c8001ca0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:33.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.694+0000 7f16d27fc640 1 -- 172.21.15.53:0/1665691610 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f16c40ea8f0 con 0x7f16d415f310 2023-06-10T19:06:33.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.846+0000 7f16dbf41640 1 -- 172.21.15.53:0/1665691610 --> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f16d40d13d0 con 0x7f16c00662b0 2023-06-10T19:06:33.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.866+0000 7f16d27fc640 1 -- 172.21.15.53:0/1665691610 <== mgr.4105 v2:172.21.15.117:6832/3061986771 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+297902 (secure 0 0 0) 0x7f16c800d050 con 0x7f16c00662b0 2023-06-10T19:06:33.872 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:06:33.875 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-06-10T19:06:33.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.874+0000 7f16dbf41640 1 -- 172.21.15.53:0/1665691610 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f16c00662b0 msgr2=0x7f16c0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:33.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.874+0000 7f16dbf41640 1 --2- 172.21.15.53:0/1665691610 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f16c00662b0 0x7f16c0068760 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f16c8001ec0 tx=0x7f16c8001ca0 comp rx=0 tx=0).stop 2023-06-10T19:06:33.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.874+0000 7f16dbf41640 1 -- 172.21.15.53:0/1665691610 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16d415f310 msgr2=0x7f16d415ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:33.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.874+0000 7f16dbf41640 1 --2- 172.21.15.53:0/1665691610 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16d415f310 0x7f16d415ddb0 secure :-1 s=READY pgs=2224 cs=0 l=1 rev1=1 crypto rx=0x7f16c4098030 tx=0x7f16bc005800 comp rx=0 tx=0).stop 2023-06-10T19:06:33.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.874+0000 7f16dbf41640 1 -- 172.21.15.53:0/1665691610 shutdown_connections 2023-06-10T19:06:33.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.874+0000 7f16dbf41640 1 --2- 172.21.15.53:0/1665691610 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f16c00662b0 0x7f16c0068760 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:33.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.874+0000 7f16dbf41640 1 --2- 172.21.15.53:0/1665691610 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16d415f6e0 0x7f16d415a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:33.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.874+0000 7f16dbf41640 1 --2- 172.21.15.53:0/1665691610 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16d4154af0 0x7f16d415a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:33.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.874+0000 7f16dbf41640 1 --2- 172.21.15.53:0/1665691610 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16d415f310 0x7f16d415ddb0 unknown :-1 s=CLOSED pgs=2224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:33.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.874+0000 7f16dbf41640 1 -- 172.21.15.53:0/1665691610 >> 172.21.15.53:0/1665691610 conn(0x7f16d4071790 msgr2=0x7f16d4156620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:33.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.874+0000 7f16dbf41640 1 -- 172.21.15.53:0/1665691610 shutdown_connections 2023-06-10T19:06:33.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:33.874+0000 7f16dbf41640 1 -- 172.21.15.53:0/1665691610 wait complete. 2023-06-10T19:06:33.892 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":567,"stamp":"2023-06-10T19:06:31.858001+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":72,"acting":72,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":21,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":276512,"kb_used_data":15840,"kb_used_omap":0,"kb_used_meta":260608,"kb_avail":754698208,"statfs":{"total":773094113280,"available":772810964992,"internally_reserved":0,"allocated":16220160,"data_stored":8170149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":266862592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.527339"},"pg_stats":[{"pgid":"22.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:27.323985+0000","last_change":"2023-06-10T19:06:27.323985+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.323985+0000","last_undegraded":"2023-06-10T19:06:27.323985+0000","last_fullsized":"2023-06-10T19:06:27.323985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":1,"reported_epoch":151,"state":"creating+peering","last_fresh":"2023-06-10T19:06:27.346493+0000","last_change":"2023-06-10T19:06:27.346493+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.346493+0000","last_undegraded":"2023-06-10T19:06:27.346493+0000","last_fullsized":"2023-06-10T19:06:27.346493+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":1,"reported_epoch":151,"state":"creating+peering","last_fresh":"2023-06-10T19:06:27.344670+0000","last_change":"2023-06-10T19:06:27.344670+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.344670+0000","last_undegraded":"2023-06-10T19:06:27.344670+0000","last_fullsized":"2023-06-10T19:06:27.344670+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":1,"reported_epoch":151,"state":"creating+peering","last_fresh":"2023-06-10T19:06:27.332884+0000","last_change":"2023-06-10T19:06:27.332884+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.332884+0000","last_undegraded":"2023-06-10T19:06:27.332884+0000","last_fullsized":"2023-06-10T19:06:27.332884+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":1,"reported_epoch":151,"state":"creating+peering","last_fresh":"2023-06-10T19:06:27.333545+0000","last_change":"2023-06-10T19:06:27.333545+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.333545+0000","last_undegraded":"2023-06-10T19:06:27.333545+0000","last_fullsized":"2023-06-10T19:06:27.333545+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:27.323985+0000","last_change":"2023-06-10T19:06:27.323985+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.323985+0000","last_undegraded":"2023-06-10T19:06:27.323985+0000","last_fullsized":"2023-06-10T19:06:27.323985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":1,"reported_epoch":151,"state":"creating+peering","last_fresh":"2023-06-10T19:06:27.350149+0000","last_change":"2023-06-10T19:06:27.350149+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.350149+0000","last_undegraded":"2023-06-10T19:06:27.350149+0000","last_fullsized":"2023-06-10T19:06:27.350149+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:27.323985+0000","last_change":"2023-06-10T19:06:27.323985+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.323985+0000","last_undegraded":"2023-06-10T19:06:27.323985+0000","last_fullsized":"2023-06-10T19:06:27.323985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":1,"reported_epoch":151,"state":"creating+peering","last_fresh":"2023-06-10T19:06:27.340406+0000","last_change":"2023-06-10T19:06:27.340406+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.340406+0000","last_undegraded":"2023-06-10T19:06:27.340406+0000","last_fullsized":"2023-06-10T19:06:27.340406+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":1,"reported_epoch":151,"state":"creating+peering","last_fresh":"2023-06-10T19:06:27.344986+0000","last_change":"2023-06-10T19:06:27.344986+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.344986+0000","last_undegraded":"2023-06-10T19:06:27.344986+0000","last_fullsized":"2023-06-10T19:06:27.344986+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":1,"reported_epoch":151,"state":"creating+peering","last_fresh":"2023-06-10T19:06:27.333557+0000","last_change":"2023-06-10T19:06:27.333557+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.333557+0000","last_undegraded":"2023-06-10T19:06:27.333557+0000","last_fullsized":"2023-06-10T19:06:27.333557+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":1,"reported_epoch":151,"state":"creating+peering","last_fresh":"2023-06-10T19:06:27.337976+0000","last_change":"2023-06-10T19:06:27.337976+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.337976+0000","last_undegraded":"2023-06-10T19:06:27.337976+0000","last_fullsized":"2023-06-10T19:06:27.337976+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":1,"reported_epoch":151,"state":"creating+peering","last_fresh":"2023-06-10T19:06:27.330418+0000","last_change":"2023-06-10T19:06:27.330418+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.330418+0000","last_undegraded":"2023-06-10T19:06:27.330418+0000","last_fullsized":"2023-06-10T19:06:27.330418+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":1,"reported_epoch":151,"state":"creating+peering","last_fresh":"2023-06-10T19:06:27.333586+0000","last_change":"2023-06-10T19:06:27.333586+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.333586+0000","last_undegraded":"2023-06-10T19:06:27.333586+0000","last_fullsized":"2023-06-10T19:06:27.333586+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":1,"reported_epoch":151,"state":"creating+peering","last_fresh":"2023-06-10T19:06:27.330409+0000","last_change":"2023-06-10T19:06:27.330409+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.330409+0000","last_undegraded":"2023-06-10T19:06:27.330409+0000","last_fullsized":"2023-06-10T19:06:27.330409+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":1,"reported_epoch":151,"state":"creating+peering","last_fresh":"2023-06-10T19:06:27.333635+0000","last_change":"2023-06-10T19:06:27.333635+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.333635+0000","last_undegraded":"2023-06-10T19:06:27.333635+0000","last_fullsized":"2023-06-10T19:06:27.333635+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":1,"reported_epoch":151,"state":"creating+peering","last_fresh":"2023-06-10T19:06:27.339024+0000","last_change":"2023-06-10T19:06:27.339024+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.339024+0000","last_undegraded":"2023-06-10T19:06:27.339024+0000","last_fullsized":"2023-06-10T19:06:27.339024+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":1,"reported_epoch":151,"state":"creating+peering","last_fresh":"2023-06-10T19:06:27.348835+0000","last_change":"2023-06-10T19:06:27.348835+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.348835+0000","last_undegraded":"2023-06-10T19:06:27.348835+0000","last_fullsized":"2023-06-10T19:06:27.348835+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":1,"reported_epoch":151,"state":"creating+peering","last_fresh":"2023-06-10T19:06:27.333062+0000","last_change":"2023-06-10T19:06:27.333062+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.333062+0000","last_undegraded":"2023-06-10T19:06:27.333062+0000","last_fullsized":"2023-06-10T19:06:27.333062+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:27.323985+0000","last_change":"2023-06-10T19:06:27.323985+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.323985+0000","last_undegraded":"2023-06-10T19:06:27.323985+0000","last_fullsized":"2023-06-10T19:06:27.323985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":1,"reported_epoch":151,"state":"creating+peering","last_fresh":"2023-06-10T19:06:27.348787+0000","last_change":"2023-06-10T19:06:27.348787+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.348787+0000","last_undegraded":"2023-06-10T19:06:27.348787+0000","last_fullsized":"2023-06-10T19:06:27.348787+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":1,"reported_epoch":151,"state":"creating+peering","last_fresh":"2023-06-10T19:06:27.340422+0000","last_change":"2023-06-10T19:06:27.340422+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.340422+0000","last_undegraded":"2023-06-10T19:06:27.340422+0000","last_fullsized":"2023-06-10T19:06:27.340422+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":1,"reported_epoch":151,"state":"creating+peering","last_fresh":"2023-06-10T19:06:27.348737+0000","last_change":"2023-06-10T19:06:27.348737+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.348737+0000","last_undegraded":"2023-06-10T19:06:27.348737+0000","last_fullsized":"2023-06-10T19:06:27.348737+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":1,"reported_epoch":151,"state":"creating+peering","last_fresh":"2023-06-10T19:06:27.344861+0000","last_change":"2023-06-10T19:06:27.344861+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.344861+0000","last_undegraded":"2023-06-10T19:06:27.344861+0000","last_fullsized":"2023-06-10T19:06:27.344861+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":1,"reported_epoch":151,"state":"creating+peering","last_fresh":"2023-06-10T19:06:27.330573+0000","last_change":"2023-06-10T19:06:27.330573+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.330573+0000","last_undegraded":"2023-06-10T19:06:27.330573+0000","last_fullsized":"2023-06-10T19:06:27.330573+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":389,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-06-10T19:06:27.347308+0000","last_change":"2023-06-10T18:52:34.951528+0000","last_active":"2023-06-10T19:06:27.347308+0000","last_peered":"2023-06-10T19:06:27.347308+0000","last_clean":"2023-06-10T19:06:27.347308+0000","last_became_active":"2023-06-10T18:52:34.949099+0000","last_became_peered":"2023-06-10T18:52:34.949099+0000","last_unstale":"2023-06-10T19:06:27.347308+0000","last_undegraded":"2023-06-10T19:06:27.347308+0000","last_fullsized":"2023-06-10T19:06:27.347308+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_clean_scrub_stamp":"2023-06-10T18:52:33.633295+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:02:14.381678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":255,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-06-10T19:06:27.352091+0000","last_change":"2023-06-10T18:52:40.506384+0000","last_active":"2023-06-10T19:06:27.352091+0000","last_peered":"2023-06-10T19:06:27.352091+0000","last_clean":"2023-06-10T19:06:27.352091+0000","last_became_active":"2023-06-10T18:52:40.505701+0000","last_became_peered":"2023-06-10T18:52:40.505701+0000","last_unstale":"2023-06-10T19:06:27.352091+0000","last_undegraded":"2023-06-10T19:06:27.352091+0000","last_fullsized":"2023-06-10T19:06:27.352091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:12:31.850971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":1,"reported_epoch":151,"state":"creating+peering","last_fresh":"2023-06-10T19:06:27.344973+0000","last_change":"2023-06-10T19:06:27.344973+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.344973+0000","last_undegraded":"2023-06-10T19:06:27.344973+0000","last_fullsized":"2023-06-10T19:06:27.344973+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":233,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-06-10T19:06:27.347292+0000","last_change":"2023-06-10T18:52:40.512015+0000","last_active":"2023-06-10T19:06:27.347292+0000","last_peered":"2023-06-10T19:06:27.347292+0000","last_clean":"2023-06-10T19:06:27.347292+0000","last_became_active":"2023-06-10T18:52:40.511382+0000","last_became_peered":"2023-06-10T18:52:40.511382+0000","last_unstale":"2023-06-10T19:06:27.347292+0000","last_undegraded":"2023-06-10T19:06:27.347292+0000","last_fullsized":"2023-06-10T19:06:27.347292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:47:27.116209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":1,"reported_epoch":151,"state":"creating+peering","last_fresh":"2023-06-10T19:06:27.350114+0000","last_change":"2023-06-10T19:06:27.350114+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.350114+0000","last_undegraded":"2023-06-10T19:06:27.350114+0000","last_fullsized":"2023-06-10T19:06:27.350114+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":253,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-06-10T19:06:27.341460+0000","last_change":"2023-06-10T18:52:40.671725+0000","last_active":"2023-06-10T19:06:27.341460+0000","last_peered":"2023-06-10T19:06:27.341460+0000","last_clean":"2023-06-10T19:06:27.341460+0000","last_became_active":"2023-06-10T18:52:40.671442+0000","last_became_peered":"2023-06-10T18:52:40.671442+0000","last_unstale":"2023-06-10T19:06:27.341460+0000","last_undegraded":"2023-06-10T19:06:27.341460+0000","last_fullsized":"2023-06-10T19:06:27.341460+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:39:40.376529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":1,"reported_epoch":151,"state":"creating+peering","last_fresh":"2023-06-10T19:06:27.340003+0000","last_change":"2023-06-10T19:06:27.340003+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.340003+0000","last_undegraded":"2023-06-10T19:06:27.340003+0000","last_fullsized":"2023-06-10T19:06:27.340003+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":255,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-06-10T19:06:27.351589+0000","last_change":"2023-06-10T18:52:40.510258+0000","last_active":"2023-06-10T19:06:27.351589+0000","last_peered":"2023-06-10T19:06:27.351589+0000","last_clean":"2023-06-10T19:06:27.351589+0000","last_became_active":"2023-06-10T18:52:40.509560+0000","last_became_peered":"2023-06-10T18:52:40.509560+0000","last_unstale":"2023-06-10T19:06:27.351589+0000","last_undegraded":"2023-06-10T19:06:27.351589+0000","last_fullsized":"2023-06-10T19:06:27.351589+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:50:05.648602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:27.323985+0000","last_change":"2023-06-10T19:06:27.323985+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.323985+0000","last_undegraded":"2023-06-10T19:06:27.323985+0000","last_fullsized":"2023-06-10T19:06:27.323985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":233,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-06-10T19:06:27.334081+0000","last_change":"2023-06-10T18:52:40.672266+0000","last_active":"2023-06-10T19:06:27.334081+0000","last_peered":"2023-06-10T19:06:27.334081+0000","last_clean":"2023-06-10T19:06:27.334081+0000","last_became_active":"2023-06-10T18:52:40.671966+0000","last_became_peered":"2023-06-10T18:52:40.671966+0000","last_unstale":"2023-06-10T19:06:27.334081+0000","last_undegraded":"2023-06-10T19:06:27.334081+0000","last_fullsized":"2023-06-10T19:06:27.334081+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:10:16.750337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":1,"reported_epoch":151,"state":"creating+peering","last_fresh":"2023-06-10T19:06:27.338587+0000","last_change":"2023-06-10T19:06:27.338587+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.338587+0000","last_undegraded":"2023-06-10T19:06:27.338587+0000","last_fullsized":"2023-06-10T19:06:27.338587+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":233,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-06-10T19:06:27.347346+0000","last_change":"2023-06-10T18:52:40.671084+0000","last_active":"2023-06-10T19:06:27.347346+0000","last_peered":"2023-06-10T19:06:27.347346+0000","last_clean":"2023-06-10T19:06:27.347346+0000","last_became_active":"2023-06-10T18:52:40.670697+0000","last_became_peered":"2023-06-10T18:52:40.670697+0000","last_unstale":"2023-06-10T19:06:27.347346+0000","last_undegraded":"2023-06-10T19:06:27.347346+0000","last_fullsized":"2023-06-10T19:06:27.347346+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:49:50.216107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":1,"reported_epoch":151,"state":"creating+peering","last_fresh":"2023-06-10T19:06:27.338061+0000","last_change":"2023-06-10T19:06:27.338061+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.338061+0000","last_undegraded":"2023-06-10T19:06:27.338061+0000","last_fullsized":"2023-06-10T19:06:27.338061+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":233,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-06-10T19:06:27.334108+0000","last_change":"2023-06-10T18:52:40.514114+0000","last_active":"2023-06-10T19:06:27.334108+0000","last_peered":"2023-06-10T19:06:27.334108+0000","last_clean":"2023-06-10T19:06:27.334108+0000","last_became_active":"2023-06-10T18:52:40.513638+0000","last_became_peered":"2023-06-10T18:52:40.513638+0000","last_unstale":"2023-06-10T19:06:27.334108+0000","last_undegraded":"2023-06-10T19:06:27.334108+0000","last_fullsized":"2023-06-10T19:06:27.334108+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:20:15.088951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:06:28.326546+0000","last_change":"2023-06-10T19:06:28.326546+0000","last_active":"2023-06-10T19:06:28.326546+0000","last_peered":"2023-06-10T19:06:28.326546+0000","last_clean":"2023-06-10T19:06:28.326546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:28.326546+0000","last_undegraded":"2023-06-10T19:06:28.326546+0000","last_fullsized":"2023-06-10T19:06:28.326546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":1,"reported_epoch":151,"state":"creating+peering","last_fresh":"2023-06-10T19:06:27.348768+0000","last_change":"2023-06-10T19:06:27.348768+0000","last_active":"2023-06-10T19:06:27.323985+0000","last_peered":"2023-06-10T19:06:27.323985+0000","last_clean":"2023-06-10T19:06:27.323985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:06:27.348768+0000","last_undegraded":"2023-06-10T19:06:27.348768+0000","last_fullsized":"2023-06-10T19:06:27.348768+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":235,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-06-10T19:06:27.340152+0000","last_change":"2023-06-10T18:52:40.515396+0000","last_active":"2023-06-10T19:06:27.340152+0000","last_peered":"2023-06-10T19:06:27.340152+0000","last_clean":"2023-06-10T19:06:27.340152+0000","last_became_active":"2023-06-10T18:52:40.514663+0000","last_became_peered":"2023-06-10T18:52:40.514663+0000","last_unstale":"2023-06-10T19:06:27.340152+0000","last_undegraded":"2023-06-10T19:06:27.340152+0000","last_fullsized":"2023-06-10T19:06:27.340152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:17:33.819336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":54,"acting":54,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575018,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33472,"kb_used_data":2424,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338368,"statfs":{"total":96636764160,"available":96602488832,"internally_reserved":0,"allocated":2482176,"data_stored":1468283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:06:01 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":0.96199999999999997,"15min":0.92900000000000005},"min":{"1min":0.70499999999999996,"5min":0.49399999999999999,"15min":0.434},"max":{"1min":1.522,"5min":1.522,"15min":1.6220000000000001},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.92100000000000004,"15min":0.92700000000000005},"min":{"1min":0.52800000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.6870000000000001},"last":0.69199999999999995}]},{"osd":1,"last update":"Sat Jun 10 19:06:01 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.91000000000000003,"15min":0.92000000000000004},"min":{"1min":0.56999999999999995,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1879999999999999,"5min":1.238,"15min":1.377},"last":1.0840000000000001},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.92800000000000005,"15min":0.94199999999999995},"min":{"1min":0.67800000000000005,"5min":0.51300000000000001,"15min":0.504},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.5960000000000001},"last":0.82899999999999996}]},{"osd":2,"last update":"Sat Jun 10 19:06:01 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.88100000000000001,"15min":0.85299999999999998},"min":{"1min":0.60999999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.4059999999999999},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.91000000000000003,"15min":0.89800000000000002},"min":{"1min":0.61399999999999999,"5min":0.54100000000000004,"15min":0.50600000000000001},"max":{"1min":1.129,"5min":1.448,"15min":1.448},"last":0.64700000000000002}]},{"osd":3,"last update":"Sat Jun 10 19:06:01 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.91300000000000003,"15min":0.92100000000000004},"min":{"1min":0.75800000000000001,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.502},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.97399999999999998,"15min":0.95699999999999996},"min":{"1min":0.58599999999999997,"5min":0.432,"15min":0.432},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.74199999999999999}]},{"osd":4,"last update":"Sat Jun 10 19:06:01 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.81599999999999995,"15min":0.84499999999999997},"min":{"1min":0.60299999999999998,"5min":0.307,"15min":0.307},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.639},"last":0.60799999999999998},{"interface":"front","average":{"1min":1.054,"5min":0.98499999999999999,"15min":0.96999999999999997},"min":{"1min":0.80200000000000005,"5min":0.41199999999999998,"15min":0.40000000000000002},"max":{"1min":1.3540000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.91000000000000003}]},{"osd":5,"last update":"Sat Jun 10 19:06:01 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":1.0049999999999999,"15min":1.006},"min":{"1min":0.64000000000000001,"5min":0.45100000000000001,"15min":0.38400000000000001},"max":{"1min":1.385,"5min":1.385,"15min":1.806},"last":0.996},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.03,"15min":1.0349999999999999},"min":{"1min":0.69699999999999995,"5min":0.48499999999999999,"15min":0.46500000000000002},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":1.0169999999999999}]},{"osd":6,"last update":"Sat Jun 10 19:06:01 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.999,"15min":1.004},"min":{"1min":0.67400000000000004,"5min":0.47699999999999998,"15min":0.35999999999999999},"max":{"1min":1.3149999999999999,"5min":1.391,"15min":1.718},"last":0.93899999999999995},{"interface":"front","average":{"1min":1.127,"5min":1.1020000000000001,"15min":1.097},"min":{"1min":0.82499999999999996,"5min":0.504,"15min":0.441},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":1.056}]}]},{"osd":6,"up_from":13,"seq":55834575019,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32880,"kb_used_data":1832,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338960,"statfs":{"total":96636764160,"available":96603095040,"internally_reserved":0,"allocated":1875968,"data_stored":871745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:05:53 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83799999999999997,"15min":0.85999999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.1839999999999999,"5min":1.2450000000000001,"15min":1.498},"last":1.149},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.86199999999999999,"15min":0.879},"min":{"1min":0.57099999999999995,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.496},"last":0.628}]},{"osd":1,"last update":"Sat Jun 10 19:05:53 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.84999999999999998,"15min":0.86699999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.5229999999999999},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.89500000000000002,"15min":0.89900000000000002},"min":{"1min":0.66000000000000003,"5min":0.48699999999999999,"15min":0.45300000000000001},"max":{"1min":1.341,"5min":1.341,"15min":1.778},"last":0.68400000000000005}]},{"osd":2,"last update":"Sat Jun 10 19:05:53 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.91400000000000003,"15min":0.89900000000000002},"min":{"1min":0.51200000000000001,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.224,"5min":1.2809999999999999,"15min":1.3759999999999999},"last":1.115},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.86699999999999999,"15min":0.88500000000000001},"min":{"1min":0.60499999999999998,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.1220000000000001,"5min":1.2330000000000001,"15min":1.246},"last":0.91900000000000004}]},{"osd":3,"last update":"Sat Jun 10 19:05:53 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.55900000000000005,"5min":0.55100000000000005,"15min":0.52700000000000002},"max":{"1min":1.202,"5min":1.238,"15min":1.7190000000000001},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.96299999999999997,"15min":0.98299999999999998},"min":{"1min":0.61599999999999999,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.198,"5min":1.371,"15min":1.4370000000000001},"last":0.77500000000000002}]},{"osd":4,"last update":"Sat Jun 10 19:05:53 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.90600000000000003,"15min":0.91200000000000003},"min":{"1min":0.48499999999999999,"5min":0.373,"15min":0.373},"max":{"1min":1.248,"5min":1.401,"15min":1.798},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.032,"5min":0.99399999999999999,"15min":0.98899999999999999},"min":{"1min":0.60399999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.371,"5min":1.371,"15min":1.5489999999999999},"last":0.89100000000000001}]},{"osd":5,"last update":"Sat Jun 10 19:05:53 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.89700000000000002,"15min":0.91500000000000004},"min":{"1min":0.66000000000000003,"5min":0.437,"15min":0.437},"max":{"1min":1.1950000000000001,"5min":1.29,"15min":1.333},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.0109999999999999,"5min":0.997,"15min":1.0209999999999999},"min":{"1min":0.63100000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.256,"5min":1.296,"15min":2.536},"last":1.0580000000000001}]},{"osd":7,"last update":"Sat Jun 10 19:05:53 2023","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.054,"15min":1.0329999999999999},"min":{"1min":0.73999999999999999,"5min":0.58599999999999997,"15min":0.57099999999999995},"max":{"1min":1.2929999999999999,"5min":1.879,"15min":1.917},"last":1.0289999999999999},{"interface":"front","average":{"1min":0.998,"5min":0.98899999999999999,"15min":1.012},"min":{"1min":0.64000000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.345,"5min":1.4850000000000001,"15min":1.5569999999999999},"last":1.083}]}]},{"osd":5,"up_from":13,"seq":55834575019,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32880,"kb_used_data":1832,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338960,"statfs":{"total":96636764160,"available":96603095040,"internally_reserved":0,"allocated":1875968,"data_stored":871745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.877,"15min":0.873},"min":{"1min":0.51500000000000001,"5min":0.499,"15min":0.499},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.94199999999999995,"15min":0.91800000000000004},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.49399999999999999},"max":{"1min":1.212,"5min":2.347,"15min":2.347},"last":0.92400000000000004}]},{"osd":1,"last update":"Sat Jun 10 19:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.96299999999999997,"15min":0.91900000000000004},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.52600000000000002},"max":{"1min":1.6739999999999999,"5min":7.0800000000000001,"15min":7.0800000000000001},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.86499999999999999,"5min":1.117,"15min":0.98399999999999999},"min":{"1min":0.59599999999999997,"5min":0.56499999999999995,"15min":0.53800000000000003},"max":{"1min":1.171,"5min":15.845000000000001,"15min":15.845000000000001},"last":0.86799999999999999}]},{"osd":2,"last update":"Sat Jun 10 19:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.94999999999999996,"15min":0.89400000000000002},"min":{"1min":0.59899999999999998,"5min":0.54300000000000004,"15min":0.48299999999999998},"max":{"1min":1.6459999999999999,"5min":5.0049999999999999,"15min":5.0049999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.99299999999999999,"15min":0.94499999999999995},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.391,"5min":6.851,"15min":6.851},"last":0.95699999999999996}]},{"osd":3,"last update":"Sat Jun 10 19:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.96799999999999997,"15min":0.95599999999999996},"min":{"1min":0.58699999999999997,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.6910000000000001,"5min":2.544,"15min":2.544},"last":1.071},{"interface":"front","average":{"1min":0.98299999999999998,"5min":1.004,"15min":0.999},"min":{"1min":0.66000000000000003,"5min":0.63100000000000001,"15min":0.59799999999999998},"max":{"1min":1.4870000000000001,"5min":3.0830000000000002,"15min":3.0830000000000002},"last":0.67500000000000004}]},{"osd":4,"last update":"Sat Jun 10 19:05:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.012,"15min":0.95699999999999996},"min":{"1min":0.65300000000000002,"5min":0.64000000000000001,"15min":0.58099999999999996},"max":{"1min":1.6140000000000001,"5min":6.7290000000000001,"15min":6.7290000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.97399999999999998,"15min":0.99399999999999999},"min":{"1min":0.70199999999999996,"5min":0.64900000000000002,"15min":0.61199999999999999},"max":{"1min":1.446,"5min":1.446,"15min":1.575},"last":0.98199999999999998}]},{"osd":6,"last update":"Sat Jun 10 19:05:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":0.98999999999999999,"15min":0.997},"min":{"1min":0.65300000000000002,"5min":0.60499999999999998,"15min":0.54200000000000004},"max":{"1min":1.8009999999999999,"5min":1.8009999999999999,"15min":1.8009999999999999},"last":0.83799999999999997},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.105,"15min":1.0600000000000001},"min":{"1min":0.73299999999999998,"5min":0.71999999999999997,"15min":0.57899999999999996},"max":{"1min":1.8380000000000001,"5min":6.923,"15min":6.923},"last":1.048}]},{"osd":7,"last update":"Sat Jun 10 19:05:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.101,"15min":1.095},"min":{"1min":0.70699999999999996,"5min":0.69899999999999995,"15min":0.66200000000000003},"max":{"1min":1.7749999999999999,"5min":2.6080000000000001,"15min":2.6080000000000001},"last":0.72299999999999998},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1850000000000001,"15min":1.143},"min":{"1min":0.84399999999999997,"5min":0.72499999999999998,"15min":0.66200000000000003},"max":{"1min":1.732,"5min":5.4169999999999998,"15min":5.4169999999999998},"last":1.024}]}]},{"osd":4,"up_from":13,"seq":55834575018,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32892,"kb_used_data":1844,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338948,"statfs":{"total":96636764160,"available":96603082752,"internally_reserved":0,"allocated":1888256,"data_stored":877915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:06:06 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.84899999999999998,"15min":0.82799999999999996},"min":{"1min":0.502,"5min":0.45400000000000001,"15min":0.45100000000000001},"max":{"1min":1.1319999999999999,"5min":1.29,"15min":1.29},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.91000000000000003,"15min":0.90800000000000003},"min":{"1min":0.64100000000000001,"5min":0.498,"15min":0.48899999999999999},"max":{"1min":1.1699999999999999,"5min":1.3979999999999999,"15min":3.7280000000000002},"last":1.375}]},{"osd":1,"last update":"Sat Jun 10 19:06:06 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.90700000000000003,"15min":0.93300000000000005},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47599999999999998},"max":{"1min":1.196,"5min":1.3600000000000001,"15min":3.3969999999999998},"last":1.5429999999999999},{"interface":"front","average":{"1min":0.87,"5min":0.84799999999999998,"15min":0.86199999999999999},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47699999999999998},"max":{"1min":1.1679999999999999,"5min":1.2430000000000001,"15min":2.496},"last":0.88300000000000001}]},{"osd":2,"last update":"Sat Jun 10 19:06:06 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.876,"15min":0.88100000000000001},"min":{"1min":0.52800000000000002,"5min":0.52200000000000002,"15min":0.49299999999999999},"max":{"1min":1.206,"5min":1.3,"15min":1.522},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.97499999999999998,"15min":0.98899999999999999},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.55000000000000004},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":3.5750000000000002},"last":1.4670000000000001}]},{"osd":3,"last update":"Sat Jun 10 19:06:06 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.89000000000000001,"15min":0.89700000000000002},"min":{"1min":0.68200000000000005,"5min":0.56200000000000006,"15min":0.53900000000000003},"max":{"1min":1.0669999999999999,"5min":1.46,"15min":2.3809999999999998},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95999999999999996,"15min":0.96599999999999997},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.54400000000000004},"max":{"1min":1.2929999999999999,"5min":1.4279999999999999,"15min":1.6479999999999999},"last":0.73299999999999998}]},{"osd":5,"last update":"Sat Jun 10 19:06:06 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.94499999999999995,"15min":0.96099999999999997},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.53100000000000003},"max":{"1min":1.2290000000000001,"5min":1.3260000000000001,"15min":3.6539999999999999},"last":1.083},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.91500000000000004,"15min":0.94299999999999995},"min":{"1min":0.54600000000000004,"5min":0.495,"15min":0.495},"max":{"1min":1.2170000000000001,"5min":1.26,"15min":2.6720000000000002},"last":1}]},{"osd":6,"last update":"Sat Jun 10 19:06:06 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.97099999999999997,"15min":0.97199999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.2270000000000001,"5min":1.413,"15min":2.2639999999999998},"last":1.196},{"interface":"front","average":{"1min":1.036,"5min":1.0720000000000001,"15min":1.069},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.44400000000000001},"max":{"1min":1.3100000000000001,"5min":1.4670000000000001,"15min":3.4980000000000002},"last":1.625}]},{"osd":7,"last update":"Sat Jun 10 19:06:06 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":1.0189999999999999,"15min":0.998},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.41399999999999998},"max":{"1min":1.2370000000000001,"5min":1.3919999999999999,"15min":2.5910000000000002},"last":1.1439999999999999},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.087,"15min":1.071},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.46300000000000002},"max":{"1min":1.635,"5min":1.635,"15min":1.635},"last":0.92800000000000005}]}]},{"osd":3,"up_from":13,"seq":55834575017,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36972,"kb_used_data":1828,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334868,"statfs":{"total":96636764160,"available":96598904832,"internally_reserved":0,"allocated":1871872,"data_stored":870726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.63900000000000001,"15min":0.62},"min":{"1min":0.42099999999999999,"5min":0.248,"15min":0.248},"max":{"1min":0.99299999999999999,"5min":1.1539999999999999,"15min":1.169},"last":0.626},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.67500000000000004,"15min":0.66800000000000004},"min":{"1min":0.318,"5min":0.30299999999999999,"15min":0.251},"max":{"1min":0.96899999999999997,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.80100000000000005}]},{"osd":1,"last update":"Sat Jun 10 19:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.69299999999999995,"15min":0.67900000000000005},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.27500000000000002},"max":{"1min":0.98799999999999999,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.748},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.71299999999999997,"15min":0.73199999999999998},"min":{"1min":0.35499999999999998,"5min":0.34399999999999997,"15min":0.318},"max":{"1min":0.89700000000000002,"5min":1.2569999999999999,"15min":1.411},"last":0.72899999999999998}]},{"osd":2,"last update":"Sat Jun 10 19:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.75600000000000001,"15min":0.77400000000000002},"min":{"1min":0.40699999999999997,"5min":0.39300000000000002,"15min":0.30299999999999999},"max":{"1min":1.155,"5min":1.2829999999999999,"15min":1.9530000000000001},"last":0.5},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.81299999999999994,"15min":0.79000000000000004},"min":{"1min":0.39200000000000002,"5min":0.35299999999999998,"15min":0.29699999999999999},"max":{"1min":1.2769999999999999,"5min":1.591,"15min":1.591},"last":0.877}]},{"osd":4,"last update":"Sat Jun 10 19:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.96599999999999997,"15min":0.95599999999999996},"min":{"1min":0.67800000000000005,"5min":0.60899999999999999,"15min":0.41899999999999998},"max":{"1min":1.333,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":1.008},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.98899999999999999,"15min":0.99199999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.47999999999999998},"max":{"1min":1.2110000000000001,"5min":1.873,"15min":1.873},"last":0.84799999999999998}]},{"osd":5,"last update":"Sat Jun 10 19:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":1.004,"15min":1.0169999999999999},"min":{"1min":0.55900000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.3120000000000001,"5min":1.752,"15min":2.024},"last":1.052},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0369999999999999,"15min":1.0309999999999999},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.46899999999999997},"max":{"1min":1.337,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.97299999999999998}]},{"osd":6,"last update":"Sat Jun 10 19:05:52 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.0669999999999999,"15min":1.0609999999999999},"min":{"1min":0.625,"5min":0.56999999999999995,"15min":0.55300000000000005},"max":{"1min":1.258,"5min":1.786,"15min":1.8500000000000001},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0589999999999999,"15min":1.0580000000000001},"min":{"1min":0.69499999999999995,"5min":0.61199999999999999,"15min":0.58799999999999997},"max":{"1min":1.3029999999999999,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":1.1339999999999999}]},{"osd":7,"last update":"Sat Jun 10 19:05:52 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.0800000000000001,"15min":1.093},"min":{"1min":0.77200000000000002,"5min":0.57999999999999996,"15min":0.56999999999999995},"max":{"1min":1.27,"5min":2.1150000000000002,"15min":2.1150000000000002},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.089,"15min":1.0960000000000001},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.61099999999999999},"max":{"1min":1.3129999999999999,"5min":1.9850000000000001,"15min":1.9850000000000001},"last":0.93899999999999995}]}]},{"osd":2,"up_from":13,"seq":55834575018,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32880,"kb_used_data":1832,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338960,"statfs":{"total":96636764160,"available":96603095040,"internally_reserved":0,"allocated":1875968,"data_stored":871745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.65100000000000002,"15min":0.624},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.27300000000000002},"max":{"1min":2.883,"5min":2.883,"15min":2.883},"last":0.498},{"interface":"front","average":{"1min":1.0389999999999999,"5min":0.77400000000000002,"15min":0.74299999999999999},"min":{"1min":0.40400000000000003,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":6.5670000000000002,"5min":6.5670000000000002,"15min":6.5670000000000002},"last":0.52500000000000002}]},{"osd":1,"last update":"Sat Jun 10 19:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.65000000000000002,"15min":0.66400000000000003},"min":{"1min":0.32300000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.91000000000000003,"5min":1.0389999999999999,"15min":1.1950000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":1.204,"5min":0.82699999999999996,"15min":0.78400000000000003},"min":{"1min":0.374,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":8.4429999999999996,"5min":8.4429999999999996,"15min":8.4429999999999996},"last":0.623}]},{"osd":3,"last update":"Sat Jun 10 19:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80100000000000005,"15min":0.77600000000000002},"min":{"1min":0.40899999999999997,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.105,"5min":1.1899999999999999,"15min":1.2350000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.78800000000000003,"15min":0.78400000000000003},"min":{"1min":0.42299999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":4.1849999999999996,"5min":4.1849999999999996,"15min":4.1849999999999996},"last":0.59199999999999997}]},{"osd":4,"last update":"Sat Jun 10 19:06:00 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":0.96499999999999997,"15min":0.94099999999999995},"min":{"1min":0.70299999999999996,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":3.996,"5min":3.996,"15min":3.996},"last":0.73199999999999998},{"interface":"front","average":{"1min":1.6759999999999999,"5min":1.1299999999999999,"15min":1.0600000000000001},"min":{"1min":0.53100000000000003,"5min":0.496,"15min":0.496},"max":{"1min":13.254,"5min":13.254,"15min":13.254},"last":1.0289999999999999}]},{"osd":5,"last update":"Sat Jun 10 19:06:00 2023","interfaces":[{"interface":"back","average":{"1min":1.643,"5min":1.125,"15min":1.0549999999999999},"min":{"1min":0.57999999999999996,"5min":0.55900000000000005,"15min":0.54100000000000004},"max":{"1min":6.9189999999999996,"5min":6.9189999999999996,"15min":6.9189999999999996},"last":1.113},{"interface":"front","average":{"1min":2.1299999999999999,"5min":1.2410000000000001,"15min":1.0920000000000001},"min":{"1min":0.72199999999999998,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":15.526,"5min":15.526,"15min":15.526},"last":0.98999999999999999}]},{"osd":6,"last update":"Sat Jun 10 19:06:00 2023","interfaces":[{"interface":"back","average":{"1min":1.5980000000000001,"5min":1.149,"15min":1.083},"min":{"1min":0.74199999999999999,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":8.7089999999999996,"5min":8.7089999999999996,"15min":8.7089999999999996},"last":0.78300000000000003},{"interface":"front","average":{"1min":1.296,"5min":1.0880000000000001,"15min":1.0620000000000001},"min":{"1min":0.63800000000000001,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":6.1299999999999999,"5min":6.1299999999999999,"15min":6.1299999999999999},"last":0.97299999999999998}]},{"osd":7,"last update":"Sat Jun 10 19:06:00 2023","interfaces":[{"interface":"back","average":{"1min":2.2229999999999999,"5min":1.3260000000000001,"15min":1.175},"min":{"1min":0.74099999999999999,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":12.138,"5min":12.138,"15min":12.138},"last":1.077},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.105,"15min":1.1100000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.421,"5min":1.657,"15min":1.752},"last":0.94799999999999995}]}]},{"osd":1,"up_from":13,"seq":55834575020,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36972,"kb_used_data":1828,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334868,"statfs":{"total":96636764160,"available":96598904832,"internally_reserved":0,"allocated":1871872,"data_stored":870726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:06:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66300000000000003,"15min":0.67600000000000005},"min":{"1min":0.33600000000000002,"5min":0.32100000000000001,"15min":0.25800000000000001},"max":{"1min":0.97499999999999998,"5min":1.111,"15min":1.288},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.74399999999999999},"min":{"1min":0.35699999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.079,"5min":1.1859999999999999,"15min":1.694},"last":0.50900000000000001}]},{"osd":2,"last update":"Sat Jun 10 19:06:02 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.249},"max":{"1min":0.86099999999999999,"5min":1.0900000000000001,"15min":1.21},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.69999999999999996,"15min":0.71699999999999997},"min":{"1min":0.33000000000000002,"5min":0.32800000000000001,"15min":0.29699999999999999},"max":{"1min":0.89400000000000002,"5min":1.1040000000000001,"15min":1.415},"last":0.80900000000000005}]},{"osd":3,"last update":"Sat Jun 10 19:06:02 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.77300000000000002,"15min":0.78200000000000003},"min":{"1min":0.38200000000000001,"5min":0.34000000000000002,"15min":0.25600000000000001},"max":{"1min":1.0620000000000001,"5min":1.1679999999999999,"15min":1.6299999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.70299999999999996,"15min":0.73599999999999999},"min":{"1min":0.38800000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.1479999999999999,"5min":1.2909999999999999,"15min":2.1749999999999998},"last":0.73199999999999998}]},{"osd":4,"last update":"Sat Jun 10 19:06:02 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.85499999999999998,"15min":0.86299999999999999},"min":{"1min":0.59499999999999997,"5min":0.56399999999999995,"15min":0.53000000000000003},"max":{"1min":1.0309999999999999,"5min":1.343,"15min":1.4930000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":1.006,"5min":0.97799999999999998,"15min":1.034},"min":{"1min":0.60299999999999998,"5min":0.47299999999999998,"15min":0.47099999999999997},"max":{"1min":1.3340000000000001,"5min":1.492,"15min":5.8209999999999997},"last":0.998}]},{"osd":5,"last update":"Sat Jun 10 19:06:02 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.97199999999999998,"15min":0.998},"min":{"1min":0.63,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.2949999999999999,"5min":1.6299999999999999,"15min":1.8620000000000001},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.94499999999999995,"15min":0.97699999999999998},"min":{"1min":0.56100000000000005,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.194,"5min":1.3220000000000001,"15min":3.089},"last":0.83999999999999997}]},{"osd":6,"last update":"Sat Jun 10 19:06:02 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.99399999999999999,"15min":1.0489999999999999},"min":{"1min":0.61199999999999999,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.238,"5min":1.6759999999999999,"15min":7.2599999999999998},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.0089999999999999,"5min":0.98999999999999999,"15min":1.036},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.2829999999999999,"5min":1.6000000000000001,"15min":9.0069999999999997},"last":0.878}]},{"osd":7,"last update":"Sat Jun 10 19:06:02 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.0449999999999999,"15min":1.0780000000000001},"min":{"1min":0.65300000000000002,"5min":0.58799999999999997,"15min":0.495},"max":{"1min":1.3999999999999999,"5min":1.494,"15min":2.105},"last":1.1850000000000001},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0449999999999999,"15min":1.0800000000000001},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.56699999999999995},"max":{"1min":1.321,"5min":1.5620000000000001,"15min":2.2570000000000001},"last":1.2270000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575019,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37564,"kb_used_data":2420,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334276,"statfs":{"total":96636764160,"available":96598298624,"internally_reserved":0,"allocated":2478080,"data_stored":1467264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jun 10 19:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.63100000000000001,"15min":0.63400000000000001},"min":{"1min":0.46200000000000002,"5min":0.309,"15min":0.248},"max":{"1min":0.92300000000000004,"5min":1.127,"15min":1.127},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.44900000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.028,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.54400000000000004}]},{"osd":2,"last update":"Sat Jun 10 19:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.73999999999999999,"15min":0.71699999999999997},"min":{"1min":0.35199999999999998,"5min":0.33500000000000002,"15min":0.29199999999999998},"max":{"1min":1.0640000000000001,"5min":1.2010000000000001,"15min":1.2829999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.65000000000000002,"15min":0.65400000000000003},"min":{"1min":0.30199999999999999,"5min":0.28699999999999998,"15min":0.245},"max":{"1min":1.1080000000000001,"5min":1.1779999999999999,"15min":1.371},"last":0.58799999999999997}]},{"osd":3,"last update":"Sat Jun 10 19:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.68300000000000005,"15min":0.68400000000000005},"min":{"1min":0.35499999999999998,"5min":0.30299999999999999,"15min":0.28899999999999998},"max":{"1min":1.133,"5min":1.133,"15min":1.226},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.82599999999999996,"15min":0.82299999999999995},"min":{"1min":0.39100000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.179,"5min":1.742,"15min":1.829},"last":0.68100000000000005}]},{"osd":4,"last update":"Sat Jun 10 19:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.91700000000000004,"15min":0.92100000000000004},"min":{"1min":0.65600000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.2210000000000001,"5min":1.7250000000000001,"15min":3.0209999999999999},"last":0.624},{"interface":"front","average":{"1min":0.98499999999999999,"5min":1.0169999999999999,"15min":1.026},"min":{"1min":0.58799999999999997,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.266,"5min":1.873,"15min":1.9510000000000001},"last":1.256}]},{"osd":5,"last update":"Sat Jun 10 19:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.92400000000000004,"15min":0.93600000000000005},"min":{"1min":0.54000000000000004,"5min":0.51200000000000001,"15min":0.45100000000000001},"max":{"1min":1.224,"5min":1.3109999999999999,"15min":1.694},"last":1.0229999999999999},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.98899999999999999,"15min":1.0049999999999999},"min":{"1min":0.60399999999999998,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.278,"5min":1.78,"15min":4.5620000000000003},"last":0.66300000000000003}]},{"osd":6,"last update":"Sat Jun 10 19:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":1.054,"15min":1.073},"min":{"1min":0.628,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.2250000000000001,"5min":1.7909999999999999,"15min":3.5569999999999999},"last":1.2030000000000001},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.99399999999999999,"15min":1.0009999999999999},"min":{"1min":0.71099999999999997,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.2969999999999999,"5min":1.6319999999999999,"15min":1.883},"last":1.087}]},{"osd":7,"last update":"Sat Jun 10 19:06:00 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.0249999999999999,"15min":1.0309999999999999},"min":{"1min":0.61799999999999999,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.375,"5min":1.512,"15min":1.5800000000000001},"last":1.149},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0569999999999999,"15min":1.0589999999999999},"min":{"1min":0.67700000000000005,"5min":0.63,"15min":0.58699999999999997},"max":{"1min":1.341,"5min":1.6619999999999999,"15min":1.9830000000000001},"last":0.71299999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-10T19:06:33.899 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.3f is not active+clean 2023-06-10T19:06:33.900 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:06:28.326546+0000', 'last_change': '2023-06-10T19:06:28.326546+0000', 'last_active': '2023-06-10T19:06:28.326546+0000', 'last_peered': '2023-06-10T19:06:28.326546+0000', 'last_clean': '2023-06-10T19:06:28.326546+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:28.326546+0000', 'last_undegraded': '2023-06-10T19:06:28.326546+0000', 'last_fullsized': '2023-06-10T19:06:28.326546+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:06:33.900 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.3e is not active+clean 2023-06-10T19:06:33.900 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:06:28.326546+0000', 'last_change': '2023-06-10T19:06:28.326546+0000', 'last_active': '2023-06-10T19:06:28.326546+0000', 'last_peered': '2023-06-10T19:06:28.326546+0000', 'last_clean': '2023-06-10T19:06:28.326546+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:28.326546+0000', 'last_undegraded': '2023-06-10T19:06:28.326546+0000', 'last_fullsized': '2023-06-10T19:06:28.326546+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:06:33.901 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.3d is not active+clean 2023-06-10T19:06:33.901 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:06:28.326546+0000', 'last_change': '2023-06-10T19:06:28.326546+0000', 'last_active': '2023-06-10T19:06:28.326546+0000', 'last_peered': '2023-06-10T19:06:28.326546+0000', 'last_clean': '2023-06-10T19:06:28.326546+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:28.326546+0000', 'last_undegraded': '2023-06-10T19:06:28.326546+0000', 'last_fullsized': '2023-06-10T19:06:28.326546+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:06:33.901 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.3c is not active+clean 2023-06-10T19:06:33.902 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:06:28.326546+0000', 'last_change': '2023-06-10T19:06:28.326546+0000', 'last_active': '2023-06-10T19:06:28.326546+0000', 'last_peered': '2023-06-10T19:06:28.326546+0000', 'last_clean': '2023-06-10T19:06:28.326546+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:28.326546+0000', 'last_undegraded': '2023-06-10T19:06:28.326546+0000', 'last_fullsized': '2023-06-10T19:06:28.326546+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:06:33.902 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.3b is not active+clean 2023-06-10T19:06:33.902 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:06:28.326546+0000', 'last_change': '2023-06-10T19:06:28.326546+0000', 'last_active': '2023-06-10T19:06:28.326546+0000', 'last_peered': '2023-06-10T19:06:28.326546+0000', 'last_clean': '2023-06-10T19:06:28.326546+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:28.326546+0000', 'last_undegraded': '2023-06-10T19:06:28.326546+0000', 'last_fullsized': '2023-06-10T19:06:28.326546+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:06:33.903 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.3a is not active+clean 2023-06-10T19:06:33.903 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:06:28.326546+0000', 'last_change': '2023-06-10T19:06:28.326546+0000', 'last_active': '2023-06-10T19:06:28.326546+0000', 'last_peered': '2023-06-10T19:06:28.326546+0000', 'last_clean': '2023-06-10T19:06:28.326546+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:28.326546+0000', 'last_undegraded': '2023-06-10T19:06:28.326546+0000', 'last_fullsized': '2023-06-10T19:06:28.326546+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:06:33.903 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.39 is not active+clean 2023-06-10T19:06:33.903 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:06:28.326546+0000', 'last_change': '2023-06-10T19:06:28.326546+0000', 'last_active': '2023-06-10T19:06:28.326546+0000', 'last_peered': '2023-06-10T19:06:28.326546+0000', 'last_clean': '2023-06-10T19:06:28.326546+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:28.326546+0000', 'last_undegraded': '2023-06-10T19:06:28.326546+0000', 'last_fullsized': '2023-06-10T19:06:28.326546+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:06:33.904 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.38 is not active+clean 2023-06-10T19:06:33.904 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:06:28.326546+0000', 'last_change': '2023-06-10T19:06:28.326546+0000', 'last_active': '2023-06-10T19:06:28.326546+0000', 'last_peered': '2023-06-10T19:06:28.326546+0000', 'last_clean': '2023-06-10T19:06:28.326546+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:28.326546+0000', 'last_undegraded': '2023-06-10T19:06:28.326546+0000', 'last_fullsized': '2023-06-10T19:06:28.326546+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:06:33.904 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.37 is not active+clean 2023-06-10T19:06:33.905 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:06:28.326546+0000', 'last_change': '2023-06-10T19:06:28.326546+0000', 'last_active': '2023-06-10T19:06:28.326546+0000', 'last_peered': '2023-06-10T19:06:28.326546+0000', 'last_clean': '2023-06-10T19:06:28.326546+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:28.326546+0000', 'last_undegraded': '2023-06-10T19:06:28.326546+0000', 'last_fullsized': '2023-06-10T19:06:28.326546+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:06:33.905 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.36 is not active+clean 2023-06-10T19:06:33.905 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:06:28.326546+0000', 'last_change': '2023-06-10T19:06:28.326546+0000', 'last_active': '2023-06-10T19:06:28.326546+0000', 'last_peered': '2023-06-10T19:06:28.326546+0000', 'last_clean': '2023-06-10T19:06:28.326546+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:28.326546+0000', 'last_undegraded': '2023-06-10T19:06:28.326546+0000', 'last_fullsized': '2023-06-10T19:06:28.326546+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:06:33.906 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.35 is not active+clean 2023-06-10T19:06:33.906 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:06:28.326546+0000', 'last_change': '2023-06-10T19:06:28.326546+0000', 'last_active': '2023-06-10T19:06:28.326546+0000', 'last_peered': '2023-06-10T19:06:28.326546+0000', 'last_clean': '2023-06-10T19:06:28.326546+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:28.326546+0000', 'last_undegraded': '2023-06-10T19:06:28.326546+0000', 'last_fullsized': '2023-06-10T19:06:28.326546+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:06:33.906 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.34 is not active+clean 2023-06-10T19:06:33.907 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:06:28.326546+0000', 'last_change': '2023-06-10T19:06:28.326546+0000', 'last_active': '2023-06-10T19:06:28.326546+0000', 'last_peered': '2023-06-10T19:06:28.326546+0000', 'last_clean': '2023-06-10T19:06:28.326546+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:28.326546+0000', 'last_undegraded': '2023-06-10T19:06:28.326546+0000', 'last_fullsized': '2023-06-10T19:06:28.326546+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:06:33.907 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.33 is not active+clean 2023-06-10T19:06:33.907 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:06:28.326546+0000', 'last_change': '2023-06-10T19:06:28.326546+0000', 'last_active': '2023-06-10T19:06:28.326546+0000', 'last_peered': '2023-06-10T19:06:28.326546+0000', 'last_clean': '2023-06-10T19:06:28.326546+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:28.326546+0000', 'last_undegraded': '2023-06-10T19:06:28.326546+0000', 'last_fullsized': '2023-06-10T19:06:28.326546+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:06:33.908 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.32 is not active+clean 2023-06-10T19:06:33.908 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:06:28.326546+0000', 'last_change': '2023-06-10T19:06:28.326546+0000', 'last_active': '2023-06-10T19:06:28.326546+0000', 'last_peered': '2023-06-10T19:06:28.326546+0000', 'last_clean': '2023-06-10T19:06:28.326546+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:28.326546+0000', 'last_undegraded': '2023-06-10T19:06:28.326546+0000', 'last_fullsized': '2023-06-10T19:06:28.326546+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:06:33.908 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.31 is not active+clean 2023-06-10T19:06:33.908 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:06:28.326546+0000', 'last_change': '2023-06-10T19:06:28.326546+0000', 'last_active': '2023-06-10T19:06:28.326546+0000', 'last_peered': '2023-06-10T19:06:28.326546+0000', 'last_clean': '2023-06-10T19:06:28.326546+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:28.326546+0000', 'last_undegraded': '2023-06-10T19:06:28.326546+0000', 'last_fullsized': '2023-06-10T19:06:28.326546+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:06:33.909 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.30 is not active+clean 2023-06-10T19:06:33.909 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:06:28.326546+0000', 'last_change': '2023-06-10T19:06:28.326546+0000', 'last_active': '2023-06-10T19:06:28.326546+0000', 'last_peered': '2023-06-10T19:06:28.326546+0000', 'last_clean': '2023-06-10T19:06:28.326546+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:28.326546+0000', 'last_undegraded': '2023-06-10T19:06:28.326546+0000', 'last_fullsized': '2023-06-10T19:06:28.326546+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:06:33.909 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.2f is not active+clean 2023-06-10T19:06:33.910 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:06:28.326546+0000', 'last_change': '2023-06-10T19:06:28.326546+0000', 'last_active': '2023-06-10T19:06:28.326546+0000', 'last_peered': '2023-06-10T19:06:28.326546+0000', 'last_clean': '2023-06-10T19:06:28.326546+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:28.326546+0000', 'last_undegraded': '2023-06-10T19:06:28.326546+0000', 'last_fullsized': '2023-06-10T19:06:28.326546+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:06:33.910 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.2e is not active+clean 2023-06-10T19:06:33.910 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:06:28.326546+0000', 'last_change': '2023-06-10T19:06:28.326546+0000', 'last_active': '2023-06-10T19:06:28.326546+0000', 'last_peered': '2023-06-10T19:06:28.326546+0000', 'last_clean': '2023-06-10T19:06:28.326546+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:28.326546+0000', 'last_undegraded': '2023-06-10T19:06:28.326546+0000', 'last_fullsized': '2023-06-10T19:06:28.326546+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:06:33.911 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.2d is not active+clean 2023-06-10T19:06:33.911 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:06:28.326546+0000', 'last_change': '2023-06-10T19:06:28.326546+0000', 'last_active': '2023-06-10T19:06:28.326546+0000', 'last_peered': '2023-06-10T19:06:28.326546+0000', 'last_clean': '2023-06-10T19:06:28.326546+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:28.326546+0000', 'last_undegraded': '2023-06-10T19:06:28.326546+0000', 'last_fullsized': '2023-06-10T19:06:28.326546+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:06:33.912 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.2c is not active+clean 2023-06-10T19:06:33.913 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:06:28.326546+0000', 'last_change': '2023-06-10T19:06:28.326546+0000', 'last_active': '2023-06-10T19:06:28.326546+0000', 'last_peered': '2023-06-10T19:06:28.326546+0000', 'last_clean': '2023-06-10T19:06:28.326546+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:28.326546+0000', 'last_undegraded': '2023-06-10T19:06:28.326546+0000', 'last_fullsized': '2023-06-10T19:06:28.326546+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:06:33.913 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.2b is not active+clean 2023-06-10T19:06:33.914 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:06:28.326546+0000', 'last_change': '2023-06-10T19:06:28.326546+0000', 'last_active': '2023-06-10T19:06:28.326546+0000', 'last_peered': '2023-06-10T19:06:28.326546+0000', 'last_clean': '2023-06-10T19:06:28.326546+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:28.326546+0000', 'last_undegraded': '2023-06-10T19:06:28.326546+0000', 'last_fullsized': '2023-06-10T19:06:28.326546+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:06:33.914 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.2a is not active+clean 2023-06-10T19:06:33.914 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:06:28.326546+0000', 'last_change': '2023-06-10T19:06:28.326546+0000', 'last_active': '2023-06-10T19:06:28.326546+0000', 'last_peered': '2023-06-10T19:06:28.326546+0000', 'last_clean': '2023-06-10T19:06:28.326546+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:28.326546+0000', 'last_undegraded': '2023-06-10T19:06:28.326546+0000', 'last_fullsized': '2023-06-10T19:06:28.326546+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:06:33.915 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.29 is not active+clean 2023-06-10T19:06:33.915 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:06:28.326546+0000', 'last_change': '2023-06-10T19:06:28.326546+0000', 'last_active': '2023-06-10T19:06:28.326546+0000', 'last_peered': '2023-06-10T19:06:28.326546+0000', 'last_clean': '2023-06-10T19:06:28.326546+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:28.326546+0000', 'last_undegraded': '2023-06-10T19:06:28.326546+0000', 'last_fullsized': '2023-06-10T19:06:28.326546+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:06:33.916 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.28 is not active+clean 2023-06-10T19:06:33.916 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:06:28.326546+0000', 'last_change': '2023-06-10T19:06:28.326546+0000', 'last_active': '2023-06-10T19:06:28.326546+0000', 'last_peered': '2023-06-10T19:06:28.326546+0000', 'last_clean': '2023-06-10T19:06:28.326546+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:28.326546+0000', 'last_undegraded': '2023-06-10T19:06:28.326546+0000', 'last_fullsized': '2023-06-10T19:06:28.326546+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:06:33.916 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.27 is not active+clean 2023-06-10T19:06:33.917 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:06:28.326546+0000', 'last_change': '2023-06-10T19:06:28.326546+0000', 'last_active': '2023-06-10T19:06:28.326546+0000', 'last_peered': '2023-06-10T19:06:28.326546+0000', 'last_clean': '2023-06-10T19:06:28.326546+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:28.326546+0000', 'last_undegraded': '2023-06-10T19:06:28.326546+0000', 'last_fullsized': '2023-06-10T19:06:28.326546+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:06:33.918 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.26 is not active+clean 2023-06-10T19:06:33.918 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:06:28.326546+0000', 'last_change': '2023-06-10T19:06:28.326546+0000', 'last_active': '2023-06-10T19:06:28.326546+0000', 'last_peered': '2023-06-10T19:06:28.326546+0000', 'last_clean': '2023-06-10T19:06:28.326546+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:28.326546+0000', 'last_undegraded': '2023-06-10T19:06:28.326546+0000', 'last_fullsized': '2023-06-10T19:06:28.326546+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:06:33.919 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.25 is not active+clean 2023-06-10T19:06:33.919 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:06:28.326546+0000', 'last_change': '2023-06-10T19:06:28.326546+0000', 'last_active': '2023-06-10T19:06:28.326546+0000', 'last_peered': '2023-06-10T19:06:28.326546+0000', 'last_clean': '2023-06-10T19:06:28.326546+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:28.326546+0000', 'last_undegraded': '2023-06-10T19:06:28.326546+0000', 'last_fullsized': '2023-06-10T19:06:28.326546+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:06:33.919 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.24 is not active+clean 2023-06-10T19:06:33.920 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:06:28.326546+0000', 'last_change': '2023-06-10T19:06:28.326546+0000', 'last_active': '2023-06-10T19:06:28.326546+0000', 'last_peered': '2023-06-10T19:06:28.326546+0000', 'last_clean': '2023-06-10T19:06:28.326546+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:28.326546+0000', 'last_undegraded': '2023-06-10T19:06:28.326546+0000', 'last_fullsized': '2023-06-10T19:06:28.326546+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:06:33.920 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.23 is not active+clean 2023-06-10T19:06:33.920 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:06:28.326546+0000', 'last_change': '2023-06-10T19:06:28.326546+0000', 'last_active': '2023-06-10T19:06:28.326546+0000', 'last_peered': '2023-06-10T19:06:28.326546+0000', 'last_clean': '2023-06-10T19:06:28.326546+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:28.326546+0000', 'last_undegraded': '2023-06-10T19:06:28.326546+0000', 'last_fullsized': '2023-06-10T19:06:28.326546+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:06:33.921 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.22 is not active+clean 2023-06-10T19:06:33.921 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:06:28.326546+0000', 'last_change': '2023-06-10T19:06:28.326546+0000', 'last_active': '2023-06-10T19:06:28.326546+0000', 'last_peered': '2023-06-10T19:06:28.326546+0000', 'last_clean': '2023-06-10T19:06:28.326546+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:28.326546+0000', 'last_undegraded': '2023-06-10T19:06:28.326546+0000', 'last_fullsized': '2023-06-10T19:06:28.326546+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:06:33.921 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.21 is not active+clean 2023-06-10T19:06:33.922 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:06:28.326546+0000', 'last_change': '2023-06-10T19:06:28.326546+0000', 'last_active': '2023-06-10T19:06:28.326546+0000', 'last_peered': '2023-06-10T19:06:28.326546+0000', 'last_clean': '2023-06-10T19:06:28.326546+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:28.326546+0000', 'last_undegraded': '2023-06-10T19:06:28.326546+0000', 'last_fullsized': '2023-06-10T19:06:28.326546+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:06:33.922 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.20 is not active+clean 2023-06-10T19:06:33.922 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:06:28.326546+0000', 'last_change': '2023-06-10T19:06:28.326546+0000', 'last_active': '2023-06-10T19:06:28.326546+0000', 'last_peered': '2023-06-10T19:06:28.326546+0000', 'last_clean': '2023-06-10T19:06:28.326546+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:28.326546+0000', 'last_undegraded': '2023-06-10T19:06:28.326546+0000', 'last_fullsized': '2023-06-10T19:06:28.326546+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:06:33.923 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1c is not active+clean 2023-06-10T19:06:33.923 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:06:28.326546+0000', 'last_change': '2023-06-10T19:06:28.326546+0000', 'last_active': '2023-06-10T19:06:28.326546+0000', 'last_peered': '2023-06-10T19:06:28.326546+0000', 'last_clean': '2023-06-10T19:06:28.326546+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:28.326546+0000', 'last_undegraded': '2023-06-10T19:06:28.326546+0000', 'last_fullsized': '2023-06-10T19:06:28.326546+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:06:33.923 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.1f is not active+clean 2023-06-10T19:06:33.923 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:06:27.323985+0000', 'last_change': '2023-06-10T19:06:27.323985+0000', 'last_active': '2023-06-10T19:06:27.323985+0000', 'last_peered': '2023-06-10T19:06:27.323985+0000', 'last_clean': '2023-06-10T19:06:27.323985+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:27.323985+0000', 'last_undegraded': '2023-06-10T19:06:27.323985+0000', 'last_fullsized': '2023-06-10T19:06:27.323985+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:06:33.924 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1d is not active+clean 2023-06-10T19:06:33.924 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:06:28.326546+0000', 'last_change': '2023-06-10T19:06:28.326546+0000', 'last_active': '2023-06-10T19:06:28.326546+0000', 'last_peered': '2023-06-10T19:06:28.326546+0000', 'last_clean': '2023-06-10T19:06:28.326546+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:28.326546+0000', 'last_undegraded': '2023-06-10T19:06:28.326546+0000', 'last_fullsized': '2023-06-10T19:06:28.326546+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:06:33.924 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.1e is not active+clean 2023-06-10T19:06:33.925 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 151, 'state': 'creating+peering', 'last_fresh': '2023-06-10T19:06:27.346493+0000', 'last_change': '2023-06-10T19:06:27.346493+0000', 'last_active': '2023-06-10T19:06:27.323985+0000', 'last_peered': '2023-06-10T19:06:27.323985+0000', 'last_clean': '2023-06-10T19:06:27.323985+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:27.346493+0000', 'last_undegraded': '2023-06-10T19:06:27.346493+0000', 'last_fullsized': '2023-06-10T19:06:27.346493+0000', 'mapping_epoch': 151, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 151, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-06-10T19:06:33.926 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1e is not active+clean 2023-06-10T19:06:33.926 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:06:28.326546+0000', 'last_change': '2023-06-10T19:06:28.326546+0000', 'last_active': '2023-06-10T19:06:28.326546+0000', 'last_peered': '2023-06-10T19:06:28.326546+0000', 'last_clean': '2023-06-10T19:06:28.326546+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:28.326546+0000', 'last_undegraded': '2023-06-10T19:06:28.326546+0000', 'last_fullsized': '2023-06-10T19:06:28.326546+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:06:33.927 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.1d is not active+clean 2023-06-10T19:06:33.927 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 151, 'state': 'creating+peering', 'last_fresh': '2023-06-10T19:06:27.344670+0000', 'last_change': '2023-06-10T19:06:27.344670+0000', 'last_active': '2023-06-10T19:06:27.323985+0000', 'last_peered': '2023-06-10T19:06:27.323985+0000', 'last_clean': '2023-06-10T19:06:27.323985+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:27.344670+0000', 'last_undegraded': '2023-06-10T19:06:27.344670+0000', 'last_fullsized': '2023-06-10T19:06:27.344670+0000', 'mapping_epoch': 151, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 151, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-06-10T19:06:33.927 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1f is not active+clean 2023-06-10T19:06:33.928 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:06:28.326546+0000', 'last_change': '2023-06-10T19:06:28.326546+0000', 'last_active': '2023-06-10T19:06:28.326546+0000', 'last_peered': '2023-06-10T19:06:28.326546+0000', 'last_clean': '2023-06-10T19:06:28.326546+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:28.326546+0000', 'last_undegraded': '2023-06-10T19:06:28.326546+0000', 'last_fullsized': '2023-06-10T19:06:28.326546+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:06:33.928 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.1c is not active+clean 2023-06-10T19:06:33.928 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 151, 'state': 'creating+peering', 'last_fresh': '2023-06-10T19:06:27.332884+0000', 'last_change': '2023-06-10T19:06:27.332884+0000', 'last_active': '2023-06-10T19:06:27.323985+0000', 'last_peered': '2023-06-10T19:06:27.323985+0000', 'last_clean': '2023-06-10T19:06:27.323985+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:27.332884+0000', 'last_undegraded': '2023-06-10T19:06:27.332884+0000', 'last_fullsized': '2023-06-10T19:06:27.332884+0000', 'mapping_epoch': 151, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 151, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-06-10T19:06:33.929 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.18 is not active+clean 2023-06-10T19:06:33.929 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:06:28.326546+0000', 'last_change': '2023-06-10T19:06:28.326546+0000', 'last_active': '2023-06-10T19:06:28.326546+0000', 'last_peered': '2023-06-10T19:06:28.326546+0000', 'last_clean': '2023-06-10T19:06:28.326546+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:28.326546+0000', 'last_undegraded': '2023-06-10T19:06:28.326546+0000', 'last_fullsized': '2023-06-10T19:06:28.326546+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:06:33.929 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.1b is not active+clean 2023-06-10T19:06:33.929 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 151, 'state': 'creating+peering', 'last_fresh': '2023-06-10T19:06:27.333545+0000', 'last_change': '2023-06-10T19:06:27.333545+0000', 'last_active': '2023-06-10T19:06:27.323985+0000', 'last_peered': '2023-06-10T19:06:27.323985+0000', 'last_clean': '2023-06-10T19:06:27.323985+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:27.333545+0000', 'last_undegraded': '2023-06-10T19:06:27.333545+0000', 'last_fullsized': '2023-06-10T19:06:27.333545+0000', 'mapping_epoch': 151, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 151, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-06-10T19:06:33.930 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.19 is not active+clean 2023-06-10T19:06:33.930 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:06:28.326546+0000', 'last_change': '2023-06-10T19:06:28.326546+0000', 'last_active': '2023-06-10T19:06:28.326546+0000', 'last_peered': '2023-06-10T19:06:28.326546+0000', 'last_clean': '2023-06-10T19:06:28.326546+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:28.326546+0000', 'last_undegraded': '2023-06-10T19:06:28.326546+0000', 'last_fullsized': '2023-06-10T19:06:28.326546+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:06:33.930 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.1a is not active+clean 2023-06-10T19:06:33.931 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:06:27.323985+0000', 'last_change': '2023-06-10T19:06:27.323985+0000', 'last_active': '2023-06-10T19:06:27.323985+0000', 'last_peered': '2023-06-10T19:06:27.323985+0000', 'last_clean': '2023-06-10T19:06:27.323985+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:27.323985+0000', 'last_undegraded': '2023-06-10T19:06:27.323985+0000', 'last_fullsized': '2023-06-10T19:06:27.323985+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:06:33.931 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1a is not active+clean 2023-06-10T19:06:33.931 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:06:28.326546+0000', 'last_change': '2023-06-10T19:06:28.326546+0000', 'last_active': '2023-06-10T19:06:28.326546+0000', 'last_peered': '2023-06-10T19:06:28.326546+0000', 'last_clean': '2023-06-10T19:06:28.326546+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:28.326546+0000', 'last_undegraded': '2023-06-10T19:06:28.326546+0000', 'last_fullsized': '2023-06-10T19:06:28.326546+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:06:33.932 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.19 is not active+clean 2023-06-10T19:06:33.932 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 151, 'state': 'creating+peering', 'last_fresh': '2023-06-10T19:06:27.350149+0000', 'last_change': '2023-06-10T19:06:27.350149+0000', 'last_active': '2023-06-10T19:06:27.323985+0000', 'last_peered': '2023-06-10T19:06:27.323985+0000', 'last_clean': '2023-06-10T19:06:27.323985+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:27.350149+0000', 'last_undegraded': '2023-06-10T19:06:27.350149+0000', 'last_fullsized': '2023-06-10T19:06:27.350149+0000', 'mapping_epoch': 151, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 151, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-06-10T19:06:33.932 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1b is not active+clean 2023-06-10T19:06:33.932 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:06:28.326546+0000', 'last_change': '2023-06-10T19:06:28.326546+0000', 'last_active': '2023-06-10T19:06:28.326546+0000', 'last_peered': '2023-06-10T19:06:28.326546+0000', 'last_clean': '2023-06-10T19:06:28.326546+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:28.326546+0000', 'last_undegraded': '2023-06-10T19:06:28.326546+0000', 'last_fullsized': '2023-06-10T19:06:28.326546+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:06:33.933 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.18 is not active+clean 2023-06-10T19:06:33.933 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:06:27.323985+0000', 'last_change': '2023-06-10T19:06:27.323985+0000', 'last_active': '2023-06-10T19:06:27.323985+0000', 'last_peered': '2023-06-10T19:06:27.323985+0000', 'last_clean': '2023-06-10T19:06:27.323985+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:27.323985+0000', 'last_undegraded': '2023-06-10T19:06:27.323985+0000', 'last_fullsized': '2023-06-10T19:06:27.323985+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:06:33.933 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.c is not active+clean 2023-06-10T19:06:33.934 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:06:28.326546+0000', 'last_change': '2023-06-10T19:06:28.326546+0000', 'last_active': '2023-06-10T19:06:28.326546+0000', 'last_peered': '2023-06-10T19:06:28.326546+0000', 'last_clean': '2023-06-10T19:06:28.326546+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:28.326546+0000', 'last_undegraded': '2023-06-10T19:06:28.326546+0000', 'last_fullsized': '2023-06-10T19:06:28.326546+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:06:33.935 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.f is not active+clean 2023-06-10T19:06:33.935 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 151, 'state': 'creating+peering', 'last_fresh': '2023-06-10T19:06:27.340406+0000', 'last_change': '2023-06-10T19:06:27.340406+0000', 'last_active': '2023-06-10T19:06:27.323985+0000', 'last_peered': '2023-06-10T19:06:27.323985+0000', 'last_clean': '2023-06-10T19:06:27.323985+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:27.340406+0000', 'last_undegraded': '2023-06-10T19:06:27.340406+0000', 'last_fullsized': '2023-06-10T19:06:27.340406+0000', 'mapping_epoch': 151, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 151, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-06-10T19:06:33.936 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.d is not active+clean 2023-06-10T19:06:33.936 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:06:28.326546+0000', 'last_change': '2023-06-10T19:06:28.326546+0000', 'last_active': '2023-06-10T19:06:28.326546+0000', 'last_peered': '2023-06-10T19:06:28.326546+0000', 'last_clean': '2023-06-10T19:06:28.326546+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:28.326546+0000', 'last_undegraded': '2023-06-10T19:06:28.326546+0000', 'last_fullsized': '2023-06-10T19:06:28.326546+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:06:33.936 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.e is not active+clean 2023-06-10T19:06:33.937 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 151, 'state': 'creating+peering', 'last_fresh': '2023-06-10T19:06:27.344986+0000', 'last_change': '2023-06-10T19:06:27.344986+0000', 'last_active': '2023-06-10T19:06:27.323985+0000', 'last_peered': '2023-06-10T19:06:27.323985+0000', 'last_clean': '2023-06-10T19:06:27.323985+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:27.344986+0000', 'last_undegraded': '2023-06-10T19:06:27.344986+0000', 'last_fullsized': '2023-06-10T19:06:27.344986+0000', 'mapping_epoch': 151, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 151, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-06-10T19:06:33.937 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.e is not active+clean 2023-06-10T19:06:33.937 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:06:28.326546+0000', 'last_change': '2023-06-10T19:06:28.326546+0000', 'last_active': '2023-06-10T19:06:28.326546+0000', 'last_peered': '2023-06-10T19:06:28.326546+0000', 'last_clean': '2023-06-10T19:06:28.326546+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:28.326546+0000', 'last_undegraded': '2023-06-10T19:06:28.326546+0000', 'last_fullsized': '2023-06-10T19:06:28.326546+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:06:33.938 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.d is not active+clean 2023-06-10T19:06:33.938 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 151, 'state': 'creating+peering', 'last_fresh': '2023-06-10T19:06:27.333557+0000', 'last_change': '2023-06-10T19:06:27.333557+0000', 'last_active': '2023-06-10T19:06:27.323985+0000', 'last_peered': '2023-06-10T19:06:27.323985+0000', 'last_clean': '2023-06-10T19:06:27.323985+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:27.333557+0000', 'last_undegraded': '2023-06-10T19:06:27.333557+0000', 'last_fullsized': '2023-06-10T19:06:27.333557+0000', 'mapping_epoch': 151, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 151, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-06-10T19:06:33.938 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.f is not active+clean 2023-06-10T19:06:33.939 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:06:28.326546+0000', 'last_change': '2023-06-10T19:06:28.326546+0000', 'last_active': '2023-06-10T19:06:28.326546+0000', 'last_peered': '2023-06-10T19:06:28.326546+0000', 'last_clean': '2023-06-10T19:06:28.326546+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:28.326546+0000', 'last_undegraded': '2023-06-10T19:06:28.326546+0000', 'last_fullsized': '2023-06-10T19:06:28.326546+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:06:33.939 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.c is not active+clean 2023-06-10T19:06:33.939 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 151, 'state': 'creating+peering', 'last_fresh': '2023-06-10T19:06:27.337976+0000', 'last_change': '2023-06-10T19:06:27.337976+0000', 'last_active': '2023-06-10T19:06:27.323985+0000', 'last_peered': '2023-06-10T19:06:27.323985+0000', 'last_clean': '2023-06-10T19:06:27.323985+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:27.337976+0000', 'last_undegraded': '2023-06-10T19:06:27.337976+0000', 'last_fullsized': '2023-06-10T19:06:27.337976+0000', 'mapping_epoch': 151, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 151, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-06-10T19:06:33.940 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.8 is not active+clean 2023-06-10T19:06:33.940 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:06:28.326546+0000', 'last_change': '2023-06-10T19:06:28.326546+0000', 'last_active': '2023-06-10T19:06:28.326546+0000', 'last_peered': '2023-06-10T19:06:28.326546+0000', 'last_clean': '2023-06-10T19:06:28.326546+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:28.326546+0000', 'last_undegraded': '2023-06-10T19:06:28.326546+0000', 'last_fullsized': '2023-06-10T19:06:28.326546+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:06:33.941 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.b is not active+clean 2023-06-10T19:06:33.941 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 151, 'state': 'creating+peering', 'last_fresh': '2023-06-10T19:06:27.330418+0000', 'last_change': '2023-06-10T19:06:27.330418+0000', 'last_active': '2023-06-10T19:06:27.323985+0000', 'last_peered': '2023-06-10T19:06:27.323985+0000', 'last_clean': '2023-06-10T19:06:27.323985+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:27.330418+0000', 'last_undegraded': '2023-06-10T19:06:27.330418+0000', 'last_fullsized': '2023-06-10T19:06:27.330418+0000', 'mapping_epoch': 151, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 151, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-06-10T19:06:33.941 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.9 is not active+clean 2023-06-10T19:06:33.941 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:06:28.326546+0000', 'last_change': '2023-06-10T19:06:28.326546+0000', 'last_active': '2023-06-10T19:06:28.326546+0000', 'last_peered': '2023-06-10T19:06:28.326546+0000', 'last_clean': '2023-06-10T19:06:28.326546+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:28.326546+0000', 'last_undegraded': '2023-06-10T19:06:28.326546+0000', 'last_fullsized': '2023-06-10T19:06:28.326546+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:06:33.942 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.a is not active+clean 2023-06-10T19:06:33.942 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 151, 'state': 'creating+peering', 'last_fresh': '2023-06-10T19:06:27.333586+0000', 'last_change': '2023-06-10T19:06:27.333586+0000', 'last_active': '2023-06-10T19:06:27.323985+0000', 'last_peered': '2023-06-10T19:06:27.323985+0000', 'last_clean': '2023-06-10T19:06:27.323985+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:27.333586+0000', 'last_undegraded': '2023-06-10T19:06:27.333586+0000', 'last_fullsized': '2023-06-10T19:06:27.333586+0000', 'mapping_epoch': 151, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 151, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-06-10T19:06:33.943 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.a is not active+clean 2023-06-10T19:06:33.943 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:06:28.326546+0000', 'last_change': '2023-06-10T19:06:28.326546+0000', 'last_active': '2023-06-10T19:06:28.326546+0000', 'last_peered': '2023-06-10T19:06:28.326546+0000', 'last_clean': '2023-06-10T19:06:28.326546+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:28.326546+0000', 'last_undegraded': '2023-06-10T19:06:28.326546+0000', 'last_fullsized': '2023-06-10T19:06:28.326546+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:06:33.943 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.9 is not active+clean 2023-06-10T19:06:33.943 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 151, 'state': 'creating+peering', 'last_fresh': '2023-06-10T19:06:27.330409+0000', 'last_change': '2023-06-10T19:06:27.330409+0000', 'last_active': '2023-06-10T19:06:27.323985+0000', 'last_peered': '2023-06-10T19:06:27.323985+0000', 'last_clean': '2023-06-10T19:06:27.323985+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:27.330409+0000', 'last_undegraded': '2023-06-10T19:06:27.330409+0000', 'last_fullsized': '2023-06-10T19:06:27.330409+0000', 'mapping_epoch': 151, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 151, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-06-10T19:06:33.944 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.b is not active+clean 2023-06-10T19:06:33.944 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:06:28.326546+0000', 'last_change': '2023-06-10T19:06:28.326546+0000', 'last_active': '2023-06-10T19:06:28.326546+0000', 'last_peered': '2023-06-10T19:06:28.326546+0000', 'last_clean': '2023-06-10T19:06:28.326546+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:28.326546+0000', 'last_undegraded': '2023-06-10T19:06:28.326546+0000', 'last_fullsized': '2023-06-10T19:06:28.326546+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:06:33.944 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.8 is not active+clean 2023-06-10T19:06:33.945 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 151, 'state': 'creating+peering', 'last_fresh': '2023-06-10T19:06:27.333635+0000', 'last_change': '2023-06-10T19:06:27.333635+0000', 'last_active': '2023-06-10T19:06:27.323985+0000', 'last_peered': '2023-06-10T19:06:27.323985+0000', 'last_clean': '2023-06-10T19:06:27.323985+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:27.333635+0000', 'last_undegraded': '2023-06-10T19:06:27.333635+0000', 'last_fullsized': '2023-06-10T19:06:27.333635+0000', 'mapping_epoch': 151, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 151, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-06-10T19:06:33.945 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.4 is not active+clean 2023-06-10T19:06:33.945 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:06:28.326546+0000', 'last_change': '2023-06-10T19:06:28.326546+0000', 'last_active': '2023-06-10T19:06:28.326546+0000', 'last_peered': '2023-06-10T19:06:28.326546+0000', 'last_clean': '2023-06-10T19:06:28.326546+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:28.326546+0000', 'last_undegraded': '2023-06-10T19:06:28.326546+0000', 'last_fullsized': '2023-06-10T19:06:28.326546+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:06:33.946 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.7 is not active+clean 2023-06-10T19:06:33.946 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 151, 'state': 'creating+peering', 'last_fresh': '2023-06-10T19:06:27.339024+0000', 'last_change': '2023-06-10T19:06:27.339024+0000', 'last_active': '2023-06-10T19:06:27.323985+0000', 'last_peered': '2023-06-10T19:06:27.323985+0000', 'last_clean': '2023-06-10T19:06:27.323985+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:27.339024+0000', 'last_undegraded': '2023-06-10T19:06:27.339024+0000', 'last_fullsized': '2023-06-10T19:06:27.339024+0000', 'mapping_epoch': 151, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 151, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-06-10T19:06:33.946 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.5 is not active+clean 2023-06-10T19:06:33.947 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:06:28.326546+0000', 'last_change': '2023-06-10T19:06:28.326546+0000', 'last_active': '2023-06-10T19:06:28.326546+0000', 'last_peered': '2023-06-10T19:06:28.326546+0000', 'last_clean': '2023-06-10T19:06:28.326546+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:28.326546+0000', 'last_undegraded': '2023-06-10T19:06:28.326546+0000', 'last_fullsized': '2023-06-10T19:06:28.326546+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:06:33.947 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.6 is not active+clean 2023-06-10T19:06:33.947 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 151, 'state': 'creating+peering', 'last_fresh': '2023-06-10T19:06:27.348835+0000', 'last_change': '2023-06-10T19:06:27.348835+0000', 'last_active': '2023-06-10T19:06:27.323985+0000', 'last_peered': '2023-06-10T19:06:27.323985+0000', 'last_clean': '2023-06-10T19:06:27.323985+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:27.348835+0000', 'last_undegraded': '2023-06-10T19:06:27.348835+0000', 'last_fullsized': '2023-06-10T19:06:27.348835+0000', 'mapping_epoch': 151, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 151, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-06-10T19:06:33.948 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.6 is not active+clean 2023-06-10T19:06:33.948 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:06:28.326546+0000', 'last_change': '2023-06-10T19:06:28.326546+0000', 'last_active': '2023-06-10T19:06:28.326546+0000', 'last_peered': '2023-06-10T19:06:28.326546+0000', 'last_clean': '2023-06-10T19:06:28.326546+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:28.326546+0000', 'last_undegraded': '2023-06-10T19:06:28.326546+0000', 'last_fullsized': '2023-06-10T19:06:28.326546+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:06:33.948 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.5 is not active+clean 2023-06-10T19:06:33.949 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 151, 'state': 'creating+peering', 'last_fresh': '2023-06-10T19:06:27.333062+0000', 'last_change': '2023-06-10T19:06:27.333062+0000', 'last_active': '2023-06-10T19:06:27.323985+0000', 'last_peered': '2023-06-10T19:06:27.323985+0000', 'last_clean': '2023-06-10T19:06:27.323985+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:27.333062+0000', 'last_undegraded': '2023-06-10T19:06:27.333062+0000', 'last_fullsized': '2023-06-10T19:06:27.333062+0000', 'mapping_epoch': 151, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 151, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-06-10T19:06:33.949 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.7 is not active+clean 2023-06-10T19:06:33.949 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:06:28.326546+0000', 'last_change': '2023-06-10T19:06:28.326546+0000', 'last_active': '2023-06-10T19:06:28.326546+0000', 'last_peered': '2023-06-10T19:06:28.326546+0000', 'last_clean': '2023-06-10T19:06:28.326546+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:28.326546+0000', 'last_undegraded': '2023-06-10T19:06:28.326546+0000', 'last_fullsized': '2023-06-10T19:06:28.326546+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:06:33.950 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.4 is not active+clean 2023-06-10T19:06:33.950 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:06:27.323985+0000', 'last_change': '2023-06-10T19:06:27.323985+0000', 'last_active': '2023-06-10T19:06:27.323985+0000', 'last_peered': '2023-06-10T19:06:27.323985+0000', 'last_clean': '2023-06-10T19:06:27.323985+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:27.323985+0000', 'last_undegraded': '2023-06-10T19:06:27.323985+0000', 'last_fullsized': '2023-06-10T19:06:27.323985+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:06:33.950 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.0 is not active+clean 2023-06-10T19:06:33.950 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:06:28.326546+0000', 'last_change': '2023-06-10T19:06:28.326546+0000', 'last_active': '2023-06-10T19:06:28.326546+0000', 'last_peered': '2023-06-10T19:06:28.326546+0000', 'last_clean': '2023-06-10T19:06:28.326546+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:28.326546+0000', 'last_undegraded': '2023-06-10T19:06:28.326546+0000', 'last_fullsized': '2023-06-10T19:06:28.326546+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:06:33.951 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.3 is not active+clean 2023-06-10T19:06:33.951 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 151, 'state': 'creating+peering', 'last_fresh': '2023-06-10T19:06:27.348787+0000', 'last_change': '2023-06-10T19:06:27.348787+0000', 'last_active': '2023-06-10T19:06:27.323985+0000', 'last_peered': '2023-06-10T19:06:27.323985+0000', 'last_clean': '2023-06-10T19:06:27.323985+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:27.348787+0000', 'last_undegraded': '2023-06-10T19:06:27.348787+0000', 'last_fullsized': '2023-06-10T19:06:27.348787+0000', 'mapping_epoch': 151, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 151, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-06-10T19:06:33.951 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1 is not active+clean 2023-06-10T19:06:33.952 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:06:28.326546+0000', 'last_change': '2023-06-10T19:06:28.326546+0000', 'last_active': '2023-06-10T19:06:28.326546+0000', 'last_peered': '2023-06-10T19:06:28.326546+0000', 'last_clean': '2023-06-10T19:06:28.326546+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:28.326546+0000', 'last_undegraded': '2023-06-10T19:06:28.326546+0000', 'last_fullsized': '2023-06-10T19:06:28.326546+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:06:33.952 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.2 is not active+clean 2023-06-10T19:06:33.952 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 151, 'state': 'creating+peering', 'last_fresh': '2023-06-10T19:06:27.340422+0000', 'last_change': '2023-06-10T19:06:27.340422+0000', 'last_active': '2023-06-10T19:06:27.323985+0000', 'last_peered': '2023-06-10T19:06:27.323985+0000', 'last_clean': '2023-06-10T19:06:27.323985+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:27.340422+0000', 'last_undegraded': '2023-06-10T19:06:27.340422+0000', 'last_fullsized': '2023-06-10T19:06:27.340422+0000', 'mapping_epoch': 151, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 151, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-06-10T19:06:33.953 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.2 is not active+clean 2023-06-10T19:06:33.953 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:06:28.326546+0000', 'last_change': '2023-06-10T19:06:28.326546+0000', 'last_active': '2023-06-10T19:06:28.326546+0000', 'last_peered': '2023-06-10T19:06:28.326546+0000', 'last_clean': '2023-06-10T19:06:28.326546+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:28.326546+0000', 'last_undegraded': '2023-06-10T19:06:28.326546+0000', 'last_fullsized': '2023-06-10T19:06:28.326546+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:06:33.953 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.1 is not active+clean 2023-06-10T19:06:33.954 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 151, 'state': 'creating+peering', 'last_fresh': '2023-06-10T19:06:27.348737+0000', 'last_change': '2023-06-10T19:06:27.348737+0000', 'last_active': '2023-06-10T19:06:27.323985+0000', 'last_peered': '2023-06-10T19:06:27.323985+0000', 'last_clean': '2023-06-10T19:06:27.323985+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:27.348737+0000', 'last_undegraded': '2023-06-10T19:06:27.348737+0000', 'last_fullsized': '2023-06-10T19:06:27.348737+0000', 'mapping_epoch': 151, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 151, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-06-10T19:06:33.955 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.3 is not active+clean 2023-06-10T19:06:33.955 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:06:28.326546+0000', 'last_change': '2023-06-10T19:06:28.326546+0000', 'last_active': '2023-06-10T19:06:28.326546+0000', 'last_peered': '2023-06-10T19:06:28.326546+0000', 'last_clean': '2023-06-10T19:06:28.326546+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:28.326546+0000', 'last_undegraded': '2023-06-10T19:06:28.326546+0000', 'last_fullsized': '2023-06-10T19:06:28.326546+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:06:33.956 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.0 is not active+clean 2023-06-10T19:06:33.956 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 151, 'state': 'creating+peering', 'last_fresh': '2023-06-10T19:06:27.344861+0000', 'last_change': '2023-06-10T19:06:27.344861+0000', 'last_active': '2023-06-10T19:06:27.323985+0000', 'last_peered': '2023-06-10T19:06:27.323985+0000', 'last_clean': '2023-06-10T19:06:27.323985+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:27.344861+0000', 'last_undegraded': '2023-06-10T19:06:27.344861+0000', 'last_fullsized': '2023-06-10T19:06:27.344861+0000', 'mapping_epoch': 151, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 151, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-06-10T19:06:33.957 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.17 is not active+clean 2023-06-10T19:06:33.957 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:06:28.326546+0000', 'last_change': '2023-06-10T19:06:28.326546+0000', 'last_active': '2023-06-10T19:06:28.326546+0000', 'last_peered': '2023-06-10T19:06:28.326546+0000', 'last_clean': '2023-06-10T19:06:28.326546+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:28.326546+0000', 'last_undegraded': '2023-06-10T19:06:28.326546+0000', 'last_fullsized': '2023-06-10T19:06:28.326546+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:06:33.958 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.14 is not active+clean 2023-06-10T19:06:33.958 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 151, 'state': 'creating+peering', 'last_fresh': '2023-06-10T19:06:27.330573+0000', 'last_change': '2023-06-10T19:06:27.330573+0000', 'last_active': '2023-06-10T19:06:27.323985+0000', 'last_peered': '2023-06-10T19:06:27.323985+0000', 'last_clean': '2023-06-10T19:06:27.323985+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:27.330573+0000', 'last_undegraded': '2023-06-10T19:06:27.330573+0000', 'last_fullsized': '2023-06-10T19:06:27.330573+0000', 'mapping_epoch': 151, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 151, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-06-10T19:06:33.959 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.14 is not active+clean 2023-06-10T19:06:33.960 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:06:28.326546+0000', 'last_change': '2023-06-10T19:06:28.326546+0000', 'last_active': '2023-06-10T19:06:28.326546+0000', 'last_peered': '2023-06-10T19:06:28.326546+0000', 'last_clean': '2023-06-10T19:06:28.326546+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:28.326546+0000', 'last_undegraded': '2023-06-10T19:06:28.326546+0000', 'last_fullsized': '2023-06-10T19:06:28.326546+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:06:33.961 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.17 is not active+clean 2023-06-10T19:06:33.961 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 151, 'state': 'creating+peering', 'last_fresh': '2023-06-10T19:06:27.344973+0000', 'last_change': '2023-06-10T19:06:27.344973+0000', 'last_active': '2023-06-10T19:06:27.323985+0000', 'last_peered': '2023-06-10T19:06:27.323985+0000', 'last_clean': '2023-06-10T19:06:27.323985+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:27.344973+0000', 'last_undegraded': '2023-06-10T19:06:27.344973+0000', 'last_fullsized': '2023-06-10T19:06:27.344973+0000', 'mapping_epoch': 151, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 151, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-06-10T19:06:33.962 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.15 is not active+clean 2023-06-10T19:06:33.962 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:06:28.326546+0000', 'last_change': '2023-06-10T19:06:28.326546+0000', 'last_active': '2023-06-10T19:06:28.326546+0000', 'last_peered': '2023-06-10T19:06:28.326546+0000', 'last_clean': '2023-06-10T19:06:28.326546+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:28.326546+0000', 'last_undegraded': '2023-06-10T19:06:28.326546+0000', 'last_fullsized': '2023-06-10T19:06:28.326546+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:06:33.963 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.16 is not active+clean 2023-06-10T19:06:33.964 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 151, 'state': 'creating+peering', 'last_fresh': '2023-06-10T19:06:27.350114+0000', 'last_change': '2023-06-10T19:06:27.350114+0000', 'last_active': '2023-06-10T19:06:27.323985+0000', 'last_peered': '2023-06-10T19:06:27.323985+0000', 'last_clean': '2023-06-10T19:06:27.323985+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:27.350114+0000', 'last_undegraded': '2023-06-10T19:06:27.350114+0000', 'last_fullsized': '2023-06-10T19:06:27.350114+0000', 'mapping_epoch': 151, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 151, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-06-10T19:06:33.965 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.16 is not active+clean 2023-06-10T19:06:33.965 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:06:28.326546+0000', 'last_change': '2023-06-10T19:06:28.326546+0000', 'last_active': '2023-06-10T19:06:28.326546+0000', 'last_peered': '2023-06-10T19:06:28.326546+0000', 'last_clean': '2023-06-10T19:06:28.326546+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:28.326546+0000', 'last_undegraded': '2023-06-10T19:06:28.326546+0000', 'last_fullsized': '2023-06-10T19:06:28.326546+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:06:33.966 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.15 is not active+clean 2023-06-10T19:06:33.967 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 151, 'state': 'creating+peering', 'last_fresh': '2023-06-10T19:06:27.340003+0000', 'last_change': '2023-06-10T19:06:27.340003+0000', 'last_active': '2023-06-10T19:06:27.323985+0000', 'last_peered': '2023-06-10T19:06:27.323985+0000', 'last_clean': '2023-06-10T19:06:27.323985+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:27.340003+0000', 'last_undegraded': '2023-06-10T19:06:27.340003+0000', 'last_fullsized': '2023-06-10T19:06:27.340003+0000', 'mapping_epoch': 151, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 151, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-06-10T19:06:33.967 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.10 is not active+clean 2023-06-10T19:06:33.968 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:06:28.326546+0000', 'last_change': '2023-06-10T19:06:28.326546+0000', 'last_active': '2023-06-10T19:06:28.326546+0000', 'last_peered': '2023-06-10T19:06:28.326546+0000', 'last_clean': '2023-06-10T19:06:28.326546+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:28.326546+0000', 'last_undegraded': '2023-06-10T19:06:28.326546+0000', 'last_fullsized': '2023-06-10T19:06:28.326546+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:06:33.969 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.13 is not active+clean 2023-06-10T19:06:33.969 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:06:27.323985+0000', 'last_change': '2023-06-10T19:06:27.323985+0000', 'last_active': '2023-06-10T19:06:27.323985+0000', 'last_peered': '2023-06-10T19:06:27.323985+0000', 'last_clean': '2023-06-10T19:06:27.323985+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:27.323985+0000', 'last_undegraded': '2023-06-10T19:06:27.323985+0000', 'last_fullsized': '2023-06-10T19:06:27.323985+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:06:33.970 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.11 is not active+clean 2023-06-10T19:06:33.970 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:06:28.326546+0000', 'last_change': '2023-06-10T19:06:28.326546+0000', 'last_active': '2023-06-10T19:06:28.326546+0000', 'last_peered': '2023-06-10T19:06:28.326546+0000', 'last_clean': '2023-06-10T19:06:28.326546+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:28.326546+0000', 'last_undegraded': '2023-06-10T19:06:28.326546+0000', 'last_fullsized': '2023-06-10T19:06:28.326546+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:06:33.971 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.12 is not active+clean 2023-06-10T19:06:33.971 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 151, 'state': 'creating+peering', 'last_fresh': '2023-06-10T19:06:27.338587+0000', 'last_change': '2023-06-10T19:06:27.338587+0000', 'last_active': '2023-06-10T19:06:27.323985+0000', 'last_peered': '2023-06-10T19:06:27.323985+0000', 'last_clean': '2023-06-10T19:06:27.323985+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:27.338587+0000', 'last_undegraded': '2023-06-10T19:06:27.338587+0000', 'last_fullsized': '2023-06-10T19:06:27.338587+0000', 'mapping_epoch': 151, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 151, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-06-10T19:06:33.972 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.12 is not active+clean 2023-06-10T19:06:33.972 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:06:28.326546+0000', 'last_change': '2023-06-10T19:06:28.326546+0000', 'last_active': '2023-06-10T19:06:28.326546+0000', 'last_peered': '2023-06-10T19:06:28.326546+0000', 'last_clean': '2023-06-10T19:06:28.326546+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:28.326546+0000', 'last_undegraded': '2023-06-10T19:06:28.326546+0000', 'last_fullsized': '2023-06-10T19:06:28.326546+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:06:33.973 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.11 is not active+clean 2023-06-10T19:06:33.973 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 151, 'state': 'creating+peering', 'last_fresh': '2023-06-10T19:06:27.338061+0000', 'last_change': '2023-06-10T19:06:27.338061+0000', 'last_active': '2023-06-10T19:06:27.323985+0000', 'last_peered': '2023-06-10T19:06:27.323985+0000', 'last_clean': '2023-06-10T19:06:27.323985+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:27.338061+0000', 'last_undegraded': '2023-06-10T19:06:27.338061+0000', 'last_fullsized': '2023-06-10T19:06:27.338061+0000', 'mapping_epoch': 151, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 151, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-06-10T19:06:33.974 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.13 is not active+clean 2023-06-10T19:06:33.975 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-06-10T19:06:28.326546+0000', 'last_change': '2023-06-10T19:06:28.326546+0000', 'last_active': '2023-06-10T19:06:28.326546+0000', 'last_peered': '2023-06-10T19:06:28.326546+0000', 'last_clean': '2023-06-10T19:06:28.326546+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:28.326546+0000', 'last_undegraded': '2023-06-10T19:06:28.326546+0000', 'last_fullsized': '2023-06-10T19:06:28.326546+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:28.326546+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-06-10T19:06:33.976 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.10 is not active+clean 2023-06-10T19:06:33.976 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 151, 'state': 'creating+peering', 'last_fresh': '2023-06-10T19:06:27.348768+0000', 'last_change': '2023-06-10T19:06:27.348768+0000', 'last_active': '2023-06-10T19:06:27.323985+0000', 'last_peered': '2023-06-10T19:06:27.323985+0000', 'last_clean': '2023-06-10T19:06:27.323985+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-06-10T19:06:27.348768+0000', 'last_undegraded': '2023-06-10T19:06:27.348768+0000', 'last_fullsized': '2023-06-10T19:06:27.348768+0000', 'mapping_epoch': 151, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 151, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'last_clean_scrub_stamp': '2023-06-10T19:06:27.323985+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-06-10T19:06:33.978 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-06-10T19:06:34.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.102+0000 7f2e5bf6e640 1 Processor -- start 2023-06-10T19:06:34.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.102+0000 7f2e5bf6e640 1 -- start start 2023-06-10T19:06:34.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.106+0000 7f2e5bf6e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2e54070f80 0x7f2e540ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:34.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.106+0000 7f2e5bf6e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2e540ce990 0x7f2e54069450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:34.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.106+0000 7f2e5bf6e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e5415f2c0 con 0x7f2e5415eef0 2023-06-10T19:06:34.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.106+0000 7f2e5bf6e640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e5415fdc0 con 0x7f2e540ce990 2023-06-10T19:06:34.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.106+0000 7f2e5bf6e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e541600a0 con 0x7f2e54070f80 2023-06-10T19:06:34.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.106+0000 7f2e5a50b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2e540ce990 0x7f2e54069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:34.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.106+0000 7f2e5a50b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2e540ce990 0x7f2e54069450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51136/0 (socket says 172.21.15.53:51136) 2023-06-10T19:06:34.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.106+0000 7f2e5a50b640 1 -- 172.21.15.53:0/2629457599 learned_addr learned my addr 172.21.15.53:0/2629457599 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:34.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.106+0000 7f2e59509640 1 --2- 172.21.15.53:0/2629457599 >> v2:172.21.15.117:3300/0 conn(0x7f2e54070f80 0x7f2e540ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:34.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.106+0000 7f2e5a50b640 1 -- 172.21.15.53:0/2629457599 >> v2:172.21.15.117:3300/0 conn(0x7f2e54070f80 msgr2=0x7f2e540ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:34.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.106+0000 7f2e5a50b640 1 --2- 172.21.15.53:0/2629457599 >> v2:172.21.15.117:3300/0 conn(0x7f2e54070f80 0x7f2e540ce450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:34.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.106+0000 7f2e5a50b640 1 -- 172.21.15.53:0/2629457599 >> v1:172.21.15.117:6789/0 conn(0x7f2e5415eef0 legacy=0x7f2e5415f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:34.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.106+0000 7f2e5a50b640 1 -- 172.21.15.53:0/2629457599 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e54160380 con 0x7f2e540ce990 2023-06-10T19:06:34.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.106+0000 7f2e5a50b640 1 --2- 172.21.15.53:0/2629457599 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e540ce990 0x7f2e54069450 secure :-1 s=READY pgs=2225 cs=0 l=1 rev1=1 crypto rx=0x7f2e54070210 tx=0x7f2e4c01c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e3de6250aab2f05 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:34.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.106+0000 7f2e58d08640 1 -- 172.21.15.53:0/2629457599 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c0a5650 con 0x7f2e540ce990 2023-06-10T19:06:34.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.106+0000 7f2e58d08640 1 -- 172.21.15.53:0/2629457599 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e4c0a57b0 con 0x7f2e540ce990 2023-06-10T19:06:34.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.106+0000 7f2e58d08640 1 -- 172.21.15.53:0/2629457599 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c0a5b40 con 0x7f2e540ce990 2023-06-10T19:06:34.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.106+0000 7f2e5bf6e640 1 -- 172.21.15.53:0/2629457599 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e540ce990 msgr2=0x7f2e54069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:34.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.106+0000 7f2e5bf6e640 1 --2- 172.21.15.53:0/2629457599 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e540ce990 0x7f2e54069450 secure :-1 s=READY pgs=2225 cs=0 l=1 rev1=1 crypto rx=0x7f2e54070210 tx=0x7f2e4c01c990 comp rx=0 tx=0).stop 2023-06-10T19:06:34.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.110+0000 7f2e5bf6e640 1 -- 172.21.15.53:0/2629457599 shutdown_connections 2023-06-10T19:06:34.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.110+0000 7f2e5bf6e640 1 --2- 172.21.15.53:0/2629457599 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e540ce990 0x7f2e54069450 unknown :-1 s=CLOSED pgs=2225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:34.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.110+0000 7f2e5bf6e640 1 --2- 172.21.15.53:0/2629457599 >> v2:172.21.15.117:3300/0 conn(0x7f2e54070f80 0x7f2e540ce450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:34.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.110+0000 7f2e5bf6e640 1 -- 172.21.15.53:0/2629457599 >> 172.21.15.53:0/2629457599 conn(0x7f2e5406a560 msgr2=0x7f2e5406a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:34.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.110+0000 7f2e5bf6e640 1 -- 172.21.15.53:0/2629457599 shutdown_connections 2023-06-10T19:06:34.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.110+0000 7f2e5bf6e640 1 -- 172.21.15.53:0/2629457599 wait complete. 2023-06-10T19:06:34.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.110+0000 7f2e5bf6e640 1 Processor -- start 2023-06-10T19:06:34.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.110+0000 7f2e5bf6e640 1 -- start start 2023-06-10T19:06:34.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.110+0000 7f2e5bf6e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e54070f80 0x7f2e54159ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:34.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.110+0000 7f2e5bf6e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e540ce990 0x7f2e54155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:34.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.110+0000 7f2e5bf6e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e5415eef0 0x7f2e541580d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:34.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.110+0000 7f2e5bf6e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e54152080 con 0x7f2e540ce990 2023-06-10T19:06:34.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.110+0000 7f2e5bf6e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e54155560 con 0x7f2e54070f80 2023-06-10T19:06:34.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.110+0000 7f2e5bf6e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e54158610 con 0x7f2e5415eef0 2023-06-10T19:06:34.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.110+0000 7f2e59509640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e540ce990 0x7f2e54155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:34.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.110+0000 7f2e59509640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e540ce990 0x7f2e54155cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51152/0 (socket says 172.21.15.53:51152) 2023-06-10T19:06:34.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.110+0000 7f2e59509640 1 -- 172.21.15.53:0/3683067673 learned_addr learned my addr 172.21.15.53:0/3683067673 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:34.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.110+0000 7f2e5a50b640 1 --2- 172.21.15.53:0/3683067673 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e5415eef0 0x7f2e541580d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:34.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.110+0000 7f2e59d0a640 1 --2- 172.21.15.53:0/3683067673 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e54070f80 0x7f2e54159ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:34.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.110+0000 7f2e59509640 1 -- 172.21.15.53:0/3683067673 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e5415eef0 msgr2=0x7f2e541580d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:34.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.110+0000 7f2e59509640 1 --2- 172.21.15.53:0/3683067673 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e5415eef0 0x7f2e541580d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:34.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.110+0000 7f2e59509640 1 -- 172.21.15.53:0/3683067673 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e54070f80 msgr2=0x7f2e54159ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:34.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.110+0000 7f2e59509640 1 --2- 172.21.15.53:0/3683067673 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e54070f80 0x7f2e54159ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:34.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.110+0000 7f2e59509640 1 -- 172.21.15.53:0/3683067673 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e4c009b30 con 0x7f2e540ce990 2023-06-10T19:06:34.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.110+0000 7f2e59d0a640 1 --2- 172.21.15.53:0/3683067673 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e54070f80 0x7f2e54159ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:06:34.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.110+0000 7f2e59509640 1 --2- 172.21.15.53:0/3683067673 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e540ce990 0x7f2e54155cd0 secure :-1 s=READY pgs=2226 cs=0 l=1 rev1=1 crypto rx=0x7f2e4800d830 tx=0x7f2e4800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:34.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.110+0000 7f2e467fc640 1 -- 172.21.15.53:0/3683067673 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4800b6c0 con 0x7f2e540ce990 2023-06-10T19:06:34.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.110+0000 7f2e467fc640 1 -- 172.21.15.53:0/3683067673 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e4800b820 con 0x7f2e540ce990 2023-06-10T19:06:34.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.110+0000 7f2e5bf6e640 1 -- 172.21.15.53:0/3683067673 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e541522d0 con 0x7f2e540ce990 2023-06-10T19:06:34.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.110+0000 7f2e467fc640 1 -- 172.21.15.53:0/3683067673 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4800bb90 con 0x7f2e540ce990 2023-06-10T19:06:34.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.110+0000 7f2e5bf6e640 1 -- 172.21.15.53:0/3683067673 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e541557b0 con 0x7f2e540ce990 2023-06-10T19:06:34.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.110+0000 7f2e5bf6e640 1 -- 172.21.15.53:0/3683067673 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e5404d790 con 0x7f2e540ce990 2023-06-10T19:06:34.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.114+0000 7f2e467fc640 1 -- 172.21.15.53:0/3683067673 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2e4800bcf0 con 0x7f2e540ce990 2023-06-10T19:06:34.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.114+0000 7f2e467fc640 1 --2- 172.21.15.53:0/3683067673 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2e38066280 0x7f2e38068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:34.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.114+0000 7f2e467fc640 1 -- 172.21.15.53:0/3683067673 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2e48084340 con 0x7f2e540ce990 2023-06-10T19:06:34.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.114+0000 7f2e59d0a640 1 --2- 172.21.15.53:0/3683067673 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2e38066280 0x7f2e38068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:34.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.114+0000 7f2e59d0a640 1 --2- 172.21.15.53:0/3683067673 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2e38066280 0x7f2e38068730 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f2e5000a850 tx=0x7f2e50008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:34.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.118+0000 7f2e467fc640 1 -- 172.21.15.53:0/3683067673 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2e480551d0 con 0x7f2e540ce990 2023-06-10T19:06:34.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.326+0000 7f2e5bf6e640 1 -- 172.21.15.53:0/3683067673 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f2e541527f0 con 0x7f2e540ce990 2023-06-10T19:06:34.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.326+0000 7f2e467fc640 1 -- 172.21.15.53:0/3683067673 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1019 (secure 0 0 0) 0x7f2e48054d60 con 0x7f2e540ce990 2023-06-10T19:06:34.329 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:06:34.329 INFO:teuthology.orchestra.run.smithi053.stdout:{"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":853,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":154,"num_osds":8,"num_up_osds":8,"osd_up_since":1686423152,"num_in_osds":8,"osd_in_since":1686423143,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":23,"data_bytes":592730,"bytes_used":283570176,"bytes_avail":772810543104,"bytes_total":773094113280,"write_bytes_sec":2383,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":89,"id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"a","status":"up:active","gid":10044}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":17,"modified":"2023-06-10T19:06:05.849274+0000","services":{}},"progress_events":{}} 2023-06-10T19:06:34.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.330+0000 7f2e5bf6e640 1 -- 172.21.15.53:0/3683067673 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2e38066280 msgr2=0x7f2e38068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:34.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.330+0000 7f2e5bf6e640 1 --2- 172.21.15.53:0/3683067673 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2e38066280 0x7f2e38068730 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f2e5000a850 tx=0x7f2e50008040 comp rx=0 tx=0).stop 2023-06-10T19:06:34.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.330+0000 7f2e5bf6e640 1 -- 172.21.15.53:0/3683067673 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e540ce990 msgr2=0x7f2e54155cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:34.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.330+0000 7f2e5bf6e640 1 --2- 172.21.15.53:0/3683067673 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e540ce990 0x7f2e54155cd0 secure :-1 s=READY pgs=2226 cs=0 l=1 rev1=1 crypto rx=0x7f2e4800d830 tx=0x7f2e4800dcf0 comp rx=0 tx=0).stop 2023-06-10T19:06:34.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.330+0000 7f2e5bf6e640 1 -- 172.21.15.53:0/3683067673 shutdown_connections 2023-06-10T19:06:34.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.330+0000 7f2e5bf6e640 1 --2- 172.21.15.53:0/3683067673 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2e38066280 0x7f2e38068730 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:34.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.330+0000 7f2e5bf6e640 1 --2- 172.21.15.53:0/3683067673 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e5415eef0 0x7f2e541580d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:34.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.330+0000 7f2e5bf6e640 1 --2- 172.21.15.53:0/3683067673 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e540ce990 0x7f2e54155cd0 unknown :-1 s=CLOSED pgs=2226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:34.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.330+0000 7f2e5bf6e640 1 --2- 172.21.15.53:0/3683067673 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e54070f80 0x7f2e54159ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:34.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.330+0000 7f2e5bf6e640 1 -- 172.21.15.53:0/3683067673 >> 172.21.15.53:0/3683067673 conn(0x7f2e5406a560 msgr2=0x7f2e540c9ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:34.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.330+0000 7f2e5bf6e640 1 -- 172.21.15.53:0/3683067673 shutdown_connections 2023-06-10T19:06:34.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.330+0000 7f2e5bf6e640 1 -- 172.21.15.53:0/3683067673 wait complete. 2023-06-10T19:06:34.346 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-06-10T19:06:34.347 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-10T19:06:34.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.454+0000 7f63a55c7640 1 Processor -- start 2023-06-10T19:06:34.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.454+0000 7f63a55c7640 1 -- start start 2023-06-10T19:06:34.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.454+0000 7f63a55c7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63a015eef0 0x7f63a0070f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:34.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.454+0000 7f63a55c7640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f63a0069450 0x7f63a00698b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:34.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.454+0000 7f63a55c7640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63a0069df0 con 0x7f63a015f570 2023-06-10T19:06:34.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.454+0000 7f63a55c7640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63a015f2c0 con 0x7f63a0069450 2023-06-10T19:06:34.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.454+0000 7f63a55c7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63a015fdc0 con 0x7f63a015eef0 2023-06-10T19:06:34.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.454+0000 7f639effd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63a015eef0 0x7f63a0070f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:34.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.454+0000 7f639f7fe640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f63a0069450 0x7f63a00698b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:34.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.454+0000 7f639effd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63a015eef0 0x7f63a0070f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.53:44358/0 (socket says 172.21.15.53:44358) 2023-06-10T19:06:34.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.454+0000 7f639effd640 1 -- 172.21.15.53:0/2708935107 learned_addr learned my addr 172.21.15.53:0/2708935107 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:34.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.454+0000 7f639effd640 1 -- 172.21.15.53:0/2708935107 >> v2:172.21.15.117:3300/0 conn(0x7f63a0069450 msgr2=0x7f63a00698b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:34.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.454+0000 7f639effd640 1 --2- 172.21.15.53:0/2708935107 >> v2:172.21.15.117:3300/0 conn(0x7f63a0069450 0x7f63a00698b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:34.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.454+0000 7f639effd640 1 -- 172.21.15.53:0/2708935107 >> v1:172.21.15.117:6789/0 conn(0x7f63a015f570 legacy=0x7f63a00ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:34.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.454+0000 7f639effd640 1 -- 172.21.15.53:0/2708935107 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63a01600a0 con 0x7f63a015eef0 2023-06-10T19:06:34.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.458+0000 7f639effd640 1 --2- 172.21.15.53:0/2708935107 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63a015eef0 0x7f63a0070f80 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6390009870 tx=0x7f639001c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f1dfd091727c54a server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:34.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.458+0000 7f639dffb640 1 -- 172.21.15.53:0/2708935107 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63900a7070 con 0x7f63a015eef0 2023-06-10T19:06:34.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.458+0000 7f639dffb640 1 -- 172.21.15.53:0/2708935107 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63900ab430 con 0x7f63a015eef0 2023-06-10T19:06:34.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.458+0000 7f639dffb640 1 -- 172.21.15.53:0/2708935107 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63900ab7c0 con 0x7f63a015eef0 2023-06-10T19:06:34.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.458+0000 7f63a55c7640 1 -- 172.21.15.53:0/2708935107 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63a015eef0 msgr2=0x7f63a0070f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:34.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.458+0000 7f63a55c7640 1 --2- 172.21.15.53:0/2708935107 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63a015eef0 0x7f63a0070f80 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6390009870 tx=0x7f639001c540 comp rx=0 tx=0).stop 2023-06-10T19:06:34.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.458+0000 7f63a55c7640 1 -- 172.21.15.53:0/2708935107 shutdown_connections 2023-06-10T19:06:34.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.458+0000 7f63a55c7640 1 --2- 172.21.15.53:0/2708935107 >> v2:172.21.15.117:3300/0 conn(0x7f63a0069450 0x7f63a00698b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:34.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.458+0000 7f63a55c7640 1 --2- 172.21.15.53:0/2708935107 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63a015eef0 0x7f63a0070f80 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:34.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.458+0000 7f63a55c7640 1 -- 172.21.15.53:0/2708935107 >> 172.21.15.53:0/2708935107 conn(0x7f63a006a560 msgr2=0x7f63a006a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:34.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.458+0000 7f63a55c7640 1 -- 172.21.15.53:0/2708935107 shutdown_connections 2023-06-10T19:06:34.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.458+0000 7f63a55c7640 1 -- 172.21.15.53:0/2708935107 wait complete. 2023-06-10T19:06:34.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.458+0000 7f63a55c7640 1 Processor -- start 2023-06-10T19:06:34.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.458+0000 7f63a55c7640 1 -- start start 2023-06-10T19:06:34.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.458+0000 7f63a55c7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63a0069450 0x7f63a00c47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:34.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.458+0000 7f63a55c7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63a015eef0 0x7f63a01561a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:34.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.458+0000 7f63a55c7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63a015f570 0x7f63a014ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:34.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.458+0000 7f63a55c7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63a00c4310 con 0x7f63a0069450 2023-06-10T19:06:34.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.458+0000 7f63a55c7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63a00c3a20 con 0x7f63a015f570 2023-06-10T19:06:34.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.458+0000 7f63a55c7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63a014da50 con 0x7f63a015eef0 2023-06-10T19:06:34.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.462+0000 7f639effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63a0069450 0x7f63a00c47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:34.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.462+0000 7f639effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63a0069450 0x7f63a00c47a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51168/0 (socket says 172.21.15.53:51168) 2023-06-10T19:06:34.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.462+0000 7f639effd640 1 -- 172.21.15.53:0/4286574890 learned_addr learned my addr 172.21.15.53:0/4286574890 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:34.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.462+0000 7f639e7fc640 1 --2- 172.21.15.53:0/4286574890 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63a015eef0 0x7f63a01561a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:34.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.462+0000 7f639f7fe640 1 --2- 172.21.15.53:0/4286574890 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63a015f570 0x7f63a014ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:34.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.462+0000 7f639effd640 1 -- 172.21.15.53:0/4286574890 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63a015eef0 msgr2=0x7f63a01561a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:34.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.462+0000 7f639effd640 1 --2- 172.21.15.53:0/4286574890 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63a015eef0 0x7f63a01561a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:34.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.462+0000 7f639effd640 1 -- 172.21.15.53:0/4286574890 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63a015f570 msgr2=0x7f63a014ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:34.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.462+0000 7f639effd640 1 --2- 172.21.15.53:0/4286574890 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63a015f570 0x7f63a014ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:34.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.462+0000 7f639effd640 1 -- 172.21.15.53:0/4286574890 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63900094d0 con 0x7f63a0069450 2023-06-10T19:06:34.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.462+0000 7f639f7fe640 1 --2- 172.21.15.53:0/4286574890 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63a015f570 0x7f63a014ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:06:34.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.462+0000 7f639effd640 1 --2- 172.21.15.53:0/4286574890 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63a0069450 0x7f63a00c47a0 secure :-1 s=READY pgs=2227 cs=0 l=1 rev1=1 crypto rx=0x7f639001cde0 tx=0x7f63900192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:34.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.462+0000 7f63877fe640 1 -- 172.21.15.53:0/4286574890 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63900b45f0 con 0x7f63a0069450 2023-06-10T19:06:34.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.462+0000 7f63877fe640 1 -- 172.21.15.53:0/4286574890 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63900b4750 con 0x7f63a0069450 2023-06-10T19:06:34.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.462+0000 7f63a55c7640 1 -- 172.21.15.53:0/4286574890 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63a00c3cc0 con 0x7f63a0069450 2023-06-10T19:06:34.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.462+0000 7f63877fe640 1 -- 172.21.15.53:0/4286574890 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63900b4ac0 con 0x7f63a0069450 2023-06-10T19:06:34.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.462+0000 7f63a55c7640 1 -- 172.21.15.53:0/4286574890 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63a01568a0 con 0x7f63a0069450 2023-06-10T19:06:34.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.462+0000 7f63a55c7640 1 -- 172.21.15.53:0/4286574890 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63a004d790 con 0x7f63a0069450 2023-06-10T19:06:34.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.462+0000 7f63877fe640 1 -- 172.21.15.53:0/4286574890 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f63900b4c20 con 0x7f63a0069450 2023-06-10T19:06:34.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.462+0000 7f63877fe640 1 --2- 172.21.15.53:0/4286574890 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f638c066280 0x7f638c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:34.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.462+0000 7f63877fe640 1 -- 172.21.15.53:0/4286574890 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f639011d4c0 con 0x7f63a0069450 2023-06-10T19:06:34.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.462+0000 7f639e7fc640 1 --2- 172.21.15.53:0/4286574890 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f638c066280 0x7f638c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:34.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.462+0000 7f639e7fc640 1 --2- 172.21.15.53:0/4286574890 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f638c066280 0x7f638c068730 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f63a0155a50 tx=0x7f6394009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:34.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.466+0000 7f63877fe640 1 -- 172.21.15.53:0/4286574890 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f63900ea940 con 0x7f63a0069450 2023-06-10T19:06:34.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.610+0000 7f63a55c7640 1 -- 172.21.15.53:0/4286574890 --> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f63a00ceb60 con 0x7f638c066280 2023-06-10T19:06:34.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.634+0000 7f63877fe640 1 -- 172.21.15.53:0/4286574890 <== mgr.4105 v2:172.21.15.117:6832/3061986771 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310546 (secure 0 0 0) 0x7f63940050d0 con 0x7f638c066280 2023-06-10T19:06:34.640 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:06:34.642 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-06-10T19:06:34.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.638+0000 7f63a55c7640 1 -- 172.21.15.53:0/4286574890 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f638c066280 msgr2=0x7f638c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:34.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.638+0000 7f63a55c7640 1 --2- 172.21.15.53:0/4286574890 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f638c066280 0x7f638c068730 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f63a0155a50 tx=0x7f6394009040 comp rx=0 tx=0).stop 2023-06-10T19:06:34.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.638+0000 7f63a55c7640 1 -- 172.21.15.53:0/4286574890 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63a0069450 msgr2=0x7f63a00c47a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:34.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.638+0000 7f63a55c7640 1 --2- 172.21.15.53:0/4286574890 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63a0069450 0x7f63a00c47a0 secure :-1 s=READY pgs=2227 cs=0 l=1 rev1=1 crypto rx=0x7f639001cde0 tx=0x7f63900192e0 comp rx=0 tx=0).stop 2023-06-10T19:06:34.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.638+0000 7f63a55c7640 1 -- 172.21.15.53:0/4286574890 shutdown_connections 2023-06-10T19:06:34.644 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.638+0000 7f63a55c7640 1 --2- 172.21.15.53:0/4286574890 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f638c066280 0x7f638c068730 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:34.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.638+0000 7f63a55c7640 1 --2- 172.21.15.53:0/4286574890 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63a015f570 0x7f63a014ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:34.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.638+0000 7f63a55c7640 1 --2- 172.21.15.53:0/4286574890 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63a015eef0 0x7f63a01561a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:34.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.638+0000 7f63a55c7640 1 --2- 172.21.15.53:0/4286574890 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63a0069450 0x7f63a00c47a0 unknown :-1 s=CLOSED pgs=2227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:34.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.638+0000 7f63a55c7640 1 -- 172.21.15.53:0/4286574890 >> 172.21.15.53:0/4286574890 conn(0x7f63a006a560 msgr2=0x7f63a00c6120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:34.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.638+0000 7f63a55c7640 1 -- 172.21.15.53:0/4286574890 shutdown_connections 2023-06-10T19:06:34.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:34.638+0000 7f63a55c7640 1 -- 172.21.15.53:0/4286574890 wait complete. 2023-06-10T19:06:34.657 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":568,"stamp":"2023-06-10T19:06:33.870290+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":196,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":276924,"kb_used_data":16252,"kb_used_omap":0,"kb_used_meta":260608,"kb_avail":754697796,"statfs":{"total":773094113280,"available":772810543104,"internally_reserved":0,"allocated":16642048,"data_stored":8368995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":266862592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":68,"apply_latency_ms":68,"commit_latency_ns":68000000,"apply_latency_ns":68000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.013574"},"pg_stats":[{"pgid":"22.3f","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.742525+0000","last_change":"2023-06-10T19:06:28.771286+0000","last_active":"2023-06-10T19:06:29.742525+0000","last_peered":"2023-06-10T19:06:29.742525+0000","last_clean":"2023-06-10T19:06:29.742525+0000","last_became_active":"2023-06-10T19:06:28.770055+0000","last_became_peered":"2023-06-10T19:06:28.770055+0000","last_unstale":"2023-06-10T19:06:29.742525+0000","last_undegraded":"2023-06-10T19:06:29.742525+0000","last_fullsized":"2023-06-10T19:06:29.742525+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:33:17.900642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.819661+0000","last_change":"2023-06-10T19:06:28.785659+0000","last_active":"2023-06-10T19:06:29.819661+0000","last_peered":"2023-06-10T19:06:29.819661+0000","last_clean":"2023-06-10T19:06:29.819661+0000","last_became_active":"2023-06-10T19:06:28.785244+0000","last_became_peered":"2023-06-10T19:06:28.785244+0000","last_unstale":"2023-06-10T19:06:29.819661+0000","last_undegraded":"2023-06-10T19:06:29.819661+0000","last_fullsized":"2023-06-10T19:06:29.819661+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:03:58.780698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.819492+0000","last_change":"2023-06-10T19:06:28.780703+0000","last_active":"2023-06-10T19:06:29.819492+0000","last_peered":"2023-06-10T19:06:29.819492+0000","last_clean":"2023-06-10T19:06:29.819492+0000","last_became_active":"2023-06-10T19:06:28.780391+0000","last_became_peered":"2023-06-10T19:06:28.780391+0000","last_unstale":"2023-06-10T19:06:29.819492+0000","last_undegraded":"2023-06-10T19:06:29.819492+0000","last_fullsized":"2023-06-10T19:06:29.819492+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:11:34.550427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.815816+0000","last_change":"2023-06-10T19:06:28.763970+0000","last_active":"2023-06-10T19:06:29.815816+0000","last_peered":"2023-06-10T19:06:29.815816+0000","last_clean":"2023-06-10T19:06:29.815816+0000","last_became_active":"2023-06-10T19:06:28.763100+0000","last_became_peered":"2023-06-10T19:06:28.763100+0000","last_unstale":"2023-06-10T19:06:29.815816+0000","last_undegraded":"2023-06-10T19:06:29.815816+0000","last_fullsized":"2023-06-10T19:06:29.815816+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:18:39.369943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.817487+0000","last_change":"2023-06-10T19:06:28.769479+0000","last_active":"2023-06-10T19:06:29.817487+0000","last_peered":"2023-06-10T19:06:29.817487+0000","last_clean":"2023-06-10T19:06:29.817487+0000","last_became_active":"2023-06-10T19:06:28.769111+0000","last_became_peered":"2023-06-10T19:06:28.769111+0000","last_unstale":"2023-06-10T19:06:29.817487+0000","last_undegraded":"2023-06-10T19:06:29.817487+0000","last_fullsized":"2023-06-10T19:06:29.817487+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:07:16.703192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.816275+0000","last_change":"2023-06-10T19:06:28.769245+0000","last_active":"2023-06-10T19:06:29.816275+0000","last_peered":"2023-06-10T19:06:29.816275+0000","last_clean":"2023-06-10T19:06:29.816275+0000","last_became_active":"2023-06-10T19:06:28.768967+0000","last_became_peered":"2023-06-10T19:06:28.768967+0000","last_unstale":"2023-06-10T19:06:29.816275+0000","last_undegraded":"2023-06-10T19:06:29.816275+0000","last_fullsized":"2023-06-10T19:06:29.816275+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:13:54.850010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.741483+0000","last_change":"2023-06-10T19:06:28.768609+0000","last_active":"2023-06-10T19:06:29.741483+0000","last_peered":"2023-06-10T19:06:29.741483+0000","last_clean":"2023-06-10T19:06:29.741483+0000","last_became_active":"2023-06-10T19:06:28.767657+0000","last_became_peered":"2023-06-10T19:06:28.767657+0000","last_unstale":"2023-06-10T19:06:29.741483+0000","last_undegraded":"2023-06-10T19:06:29.741483+0000","last_fullsized":"2023-06-10T19:06:29.741483+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:36:00.226299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.739670+0000","last_change":"2023-06-10T19:06:28.748841+0000","last_active":"2023-06-10T19:06:29.739670+0000","last_peered":"2023-06-10T19:06:29.739670+0000","last_clean":"2023-06-10T19:06:29.739670+0000","last_became_active":"2023-06-10T19:06:28.747096+0000","last_became_peered":"2023-06-10T19:06:28.747096+0000","last_unstale":"2023-06-10T19:06:29.739670+0000","last_undegraded":"2023-06-10T19:06:29.739670+0000","last_fullsized":"2023-06-10T19:06:29.739670+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:55:11.732559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.818613+0000","last_change":"2023-06-10T19:06:28.769983+0000","last_active":"2023-06-10T19:06:29.818613+0000","last_peered":"2023-06-10T19:06:29.818613+0000","last_clean":"2023-06-10T19:06:29.818613+0000","last_became_active":"2023-06-10T19:06:28.769700+0000","last_became_peered":"2023-06-10T19:06:28.769700+0000","last_unstale":"2023-06-10T19:06:29.818613+0000","last_undegraded":"2023-06-10T19:06:29.818613+0000","last_fullsized":"2023-06-10T19:06:29.818613+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:06:58.182560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.818860+0000","last_change":"2023-06-10T19:06:28.750068+0000","last_active":"2023-06-10T19:06:29.818860+0000","last_peered":"2023-06-10T19:06:29.818860+0000","last_clean":"2023-06-10T19:06:29.818860+0000","last_became_active":"2023-06-10T19:06:28.749799+0000","last_became_peered":"2023-06-10T19:06:28.749799+0000","last_unstale":"2023-06-10T19:06:29.818860+0000","last_undegraded":"2023-06-10T19:06:29.818860+0000","last_fullsized":"2023-06-10T19:06:29.818860+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:30:43.870504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.816840+0000","last_change":"2023-06-10T19:06:28.787448+0000","last_active":"2023-06-10T19:06:29.816840+0000","last_peered":"2023-06-10T19:06:29.816840+0000","last_clean":"2023-06-10T19:06:29.816840+0000","last_became_active":"2023-06-10T19:06:28.787150+0000","last_became_peered":"2023-06-10T19:06:28.787150+0000","last_unstale":"2023-06-10T19:06:29.816840+0000","last_undegraded":"2023-06-10T19:06:29.816840+0000","last_fullsized":"2023-06-10T19:06:29.816840+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:32:49.755586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.816139+0000","last_change":"2023-06-10T19:06:28.762159+0000","last_active":"2023-06-10T19:06:29.816139+0000","last_peered":"2023-06-10T19:06:29.816139+0000","last_clean":"2023-06-10T19:06:29.816139+0000","last_became_active":"2023-06-10T19:06:28.761356+0000","last_became_peered":"2023-06-10T19:06:28.761356+0000","last_unstale":"2023-06-10T19:06:29.816139+0000","last_undegraded":"2023-06-10T19:06:29.816139+0000","last_fullsized":"2023-06-10T19:06:29.816139+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:17:58.848483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.816814+0000","last_change":"2023-06-10T19:06:28.751078+0000","last_active":"2023-06-10T19:06:29.816814+0000","last_peered":"2023-06-10T19:06:29.816814+0000","last_clean":"2023-06-10T19:06:29.816814+0000","last_became_active":"2023-06-10T19:06:28.750405+0000","last_became_peered":"2023-06-10T19:06:28.750405+0000","last_unstale":"2023-06-10T19:06:29.816814+0000","last_undegraded":"2023-06-10T19:06:29.816814+0000","last_fullsized":"2023-06-10T19:06:29.816814+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:32:00.542354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.817132+0000","last_change":"2023-06-10T19:06:28.776726+0000","last_active":"2023-06-10T19:06:29.817132+0000","last_peered":"2023-06-10T19:06:29.817132+0000","last_clean":"2023-06-10T19:06:29.817132+0000","last_became_active":"2023-06-10T19:06:28.771959+0000","last_became_peered":"2023-06-10T19:06:28.771959+0000","last_unstale":"2023-06-10T19:06:29.817132+0000","last_undegraded":"2023-06-10T19:06:29.817132+0000","last_fullsized":"2023-06-10T19:06:29.817132+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:57:00.817666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.815316+0000","last_change":"2023-06-10T19:06:28.795555+0000","last_active":"2023-06-10T19:06:29.815316+0000","last_peered":"2023-06-10T19:06:29.815316+0000","last_clean":"2023-06-10T19:06:29.815316+0000","last_became_active":"2023-06-10T19:06:28.795121+0000","last_became_peered":"2023-06-10T19:06:28.795121+0000","last_unstale":"2023-06-10T19:06:29.815316+0000","last_undegraded":"2023-06-10T19:06:29.815316+0000","last_fullsized":"2023-06-10T19:06:29.815316+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:02:55.799695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.815797+0000","last_change":"2023-06-10T19:06:28.752151+0000","last_active":"2023-06-10T19:06:29.815797+0000","last_peered":"2023-06-10T19:06:29.815797+0000","last_clean":"2023-06-10T19:06:29.815797+0000","last_became_active":"2023-06-10T19:06:28.751925+0000","last_became_peered":"2023-06-10T19:06:28.751925+0000","last_unstale":"2023-06-10T19:06:29.815797+0000","last_undegraded":"2023-06-10T19:06:29.815797+0000","last_fullsized":"2023-06-10T19:06:29.815797+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:48:39.584975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.816574+0000","last_change":"2023-06-10T19:06:28.754769+0000","last_active":"2023-06-10T19:06:29.816574+0000","last_peered":"2023-06-10T19:06:29.816574+0000","last_clean":"2023-06-10T19:06:29.816574+0000","last_became_active":"2023-06-10T19:06:28.754010+0000","last_became_peered":"2023-06-10T19:06:28.754010+0000","last_unstale":"2023-06-10T19:06:29.816574+0000","last_undegraded":"2023-06-10T19:06:29.816574+0000","last_fullsized":"2023-06-10T19:06:29.816574+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:52:02.662761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.817501+0000","last_change":"2023-06-10T19:06:28.767402+0000","last_active":"2023-06-10T19:06:29.817501+0000","last_peered":"2023-06-10T19:06:29.817501+0000","last_clean":"2023-06-10T19:06:29.817501+0000","last_became_active":"2023-06-10T19:06:28.767059+0000","last_became_peered":"2023-06-10T19:06:28.767059+0000","last_unstale":"2023-06-10T19:06:29.817501+0000","last_undegraded":"2023-06-10T19:06:29.817501+0000","last_fullsized":"2023-06-10T19:06:29.817501+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:16:59.605819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.817399+0000","last_change":"2023-06-10T19:06:28.792444+0000","last_active":"2023-06-10T19:06:29.817399+0000","last_peered":"2023-06-10T19:06:29.817399+0000","last_clean":"2023-06-10T19:06:29.817399+0000","last_became_active":"2023-06-10T19:06:28.791051+0000","last_became_peered":"2023-06-10T19:06:28.791051+0000","last_unstale":"2023-06-10T19:06:29.817399+0000","last_undegraded":"2023-06-10T19:06:29.817399+0000","last_fullsized":"2023-06-10T19:06:29.817399+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:28:36.990605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.735500+0000","last_change":"2023-06-10T19:06:28.745072+0000","last_active":"2023-06-10T19:06:29.735500+0000","last_peered":"2023-06-10T19:06:29.735500+0000","last_clean":"2023-06-10T19:06:29.735500+0000","last_became_active":"2023-06-10T19:06:28.744657+0000","last_became_peered":"2023-06-10T19:06:28.744657+0000","last_unstale":"2023-06-10T19:06:29.735500+0000","last_undegraded":"2023-06-10T19:06:29.735500+0000","last_fullsized":"2023-06-10T19:06:29.735500+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:32:11.219410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.817165+0000","last_change":"2023-06-10T19:06:28.769988+0000","last_active":"2023-06-10T19:06:29.817165+0000","last_peered":"2023-06-10T19:06:29.817165+0000","last_clean":"2023-06-10T19:06:29.817165+0000","last_became_active":"2023-06-10T19:06:28.769685+0000","last_became_peered":"2023-06-10T19:06:28.769685+0000","last_unstale":"2023-06-10T19:06:29.817165+0000","last_undegraded":"2023-06-10T19:06:29.817165+0000","last_fullsized":"2023-06-10T19:06:29.817165+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:21:29.000876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.741829+0000","last_change":"2023-06-10T19:06:28.768803+0000","last_active":"2023-06-10T19:06:29.741829+0000","last_peered":"2023-06-10T19:06:29.741829+0000","last_clean":"2023-06-10T19:06:29.741829+0000","last_became_active":"2023-06-10T19:06:28.767900+0000","last_became_peered":"2023-06-10T19:06:28.767900+0000","last_unstale":"2023-06-10T19:06:29.741829+0000","last_undegraded":"2023-06-10T19:06:29.741829+0000","last_fullsized":"2023-06-10T19:06:29.741829+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:46:58.992630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.739698+0000","last_change":"2023-06-10T19:06:28.777655+0000","last_active":"2023-06-10T19:06:29.739698+0000","last_peered":"2023-06-10T19:06:29.739698+0000","last_clean":"2023-06-10T19:06:29.739698+0000","last_became_active":"2023-06-10T19:06:28.776977+0000","last_became_peered":"2023-06-10T19:06:28.776977+0000","last_unstale":"2023-06-10T19:06:29.739698+0000","last_undegraded":"2023-06-10T19:06:29.739698+0000","last_fullsized":"2023-06-10T19:06:29.739698+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:12:44.430568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.816416+0000","last_change":"2023-06-10T19:06:28.742905+0000","last_active":"2023-06-10T19:06:29.816416+0000","last_peered":"2023-06-10T19:06:29.816416+0000","last_clean":"2023-06-10T19:06:29.816416+0000","last_became_active":"2023-06-10T19:06:28.742168+0000","last_became_peered":"2023-06-10T19:06:28.742168+0000","last_unstale":"2023-06-10T19:06:29.816416+0000","last_undegraded":"2023-06-10T19:06:29.816416+0000","last_fullsized":"2023-06-10T19:06:29.816416+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:47:00.542040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.742812+0000","last_change":"2023-06-10T19:06:28.770760+0000","last_active":"2023-06-10T19:06:29.742812+0000","last_peered":"2023-06-10T19:06:29.742812+0000","last_clean":"2023-06-10T19:06:29.742812+0000","last_became_active":"2023-06-10T19:06:28.767169+0000","last_became_peered":"2023-06-10T19:06:28.767169+0000","last_unstale":"2023-06-10T19:06:29.742812+0000","last_undegraded":"2023-06-10T19:06:29.742812+0000","last_fullsized":"2023-06-10T19:06:29.742812+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:19:31.195637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.742893+0000","last_change":"2023-06-10T19:06:28.766154+0000","last_active":"2023-06-10T19:06:29.742893+0000","last_peered":"2023-06-10T19:06:29.742893+0000","last_clean":"2023-06-10T19:06:29.742893+0000","last_became_active":"2023-06-10T19:06:28.765412+0000","last_became_peered":"2023-06-10T19:06:28.765412+0000","last_unstale":"2023-06-10T19:06:29.742893+0000","last_undegraded":"2023-06-10T19:06:29.742893+0000","last_fullsized":"2023-06-10T19:06:29.742893+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:53:19.560713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.818614+0000","last_change":"2023-06-10T19:06:28.777672+0000","last_active":"2023-06-10T19:06:29.818614+0000","last_peered":"2023-06-10T19:06:29.818614+0000","last_clean":"2023-06-10T19:06:29.818614+0000","last_became_active":"2023-06-10T19:06:28.777456+0000","last_became_peered":"2023-06-10T19:06:28.777456+0000","last_unstale":"2023-06-10T19:06:29.818614+0000","last_undegraded":"2023-06-10T19:06:29.818614+0000","last_fullsized":"2023-06-10T19:06:29.818614+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:57:52.226395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.816822+0000","last_change":"2023-06-10T19:06:28.746273+0000","last_active":"2023-06-10T19:06:29.816822+0000","last_peered":"2023-06-10T19:06:29.816822+0000","last_clean":"2023-06-10T19:06:29.816822+0000","last_became_active":"2023-06-10T19:06:28.746021+0000","last_became_peered":"2023-06-10T19:06:28.746021+0000","last_unstale":"2023-06-10T19:06:29.816822+0000","last_undegraded":"2023-06-10T19:06:29.816822+0000","last_fullsized":"2023-06-10T19:06:29.816822+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:04:50.164507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.741380+0000","last_change":"2023-06-10T19:06:28.747840+0000","last_active":"2023-06-10T19:06:29.741380+0000","last_peered":"2023-06-10T19:06:29.741380+0000","last_clean":"2023-06-10T19:06:29.741380+0000","last_became_active":"2023-06-10T19:06:28.746680+0000","last_became_peered":"2023-06-10T19:06:28.746680+0000","last_unstale":"2023-06-10T19:06:29.741380+0000","last_undegraded":"2023-06-10T19:06:29.741380+0000","last_fullsized":"2023-06-10T19:06:29.741380+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:13:54.850010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.817184+0000","last_change":"2023-06-10T19:06:28.755925+0000","last_active":"2023-06-10T19:06:29.817184+0000","last_peered":"2023-06-10T19:06:29.817184+0000","last_clean":"2023-06-10T19:06:29.817184+0000","last_became_active":"2023-06-10T19:06:28.755672+0000","last_became_peered":"2023-06-10T19:06:28.755672+0000","last_unstale":"2023-06-10T19:06:29.817184+0000","last_undegraded":"2023-06-10T19:06:29.817184+0000","last_fullsized":"2023-06-10T19:06:29.817184+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:09:17.141142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.816364+0000","last_change":"2023-06-10T19:06:28.739753+0000","last_active":"2023-06-10T19:06:29.816364+0000","last_peered":"2023-06-10T19:06:29.816364+0000","last_clean":"2023-06-10T19:06:29.816364+0000","last_became_active":"2023-06-10T19:06:28.739483+0000","last_became_peered":"2023-06-10T19:06:28.739483+0000","last_unstale":"2023-06-10T19:06:29.816364+0000","last_undegraded":"2023-06-10T19:06:29.816364+0000","last_fullsized":"2023-06-10T19:06:29.816364+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:20:22.974358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.739738+0000","last_change":"2023-06-10T19:06:28.748006+0000","last_active":"2023-06-10T19:06:29.739738+0000","last_peered":"2023-06-10T19:06:29.739738+0000","last_clean":"2023-06-10T19:06:29.739738+0000","last_became_active":"2023-06-10T19:06:28.746995+0000","last_became_peered":"2023-06-10T19:06:28.746995+0000","last_unstale":"2023-06-10T19:06:29.739738+0000","last_undegraded":"2023-06-10T19:06:29.739738+0000","last_fullsized":"2023-06-10T19:06:29.739738+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:34:27.539951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.818409+0000","last_change":"2023-06-10T19:06:28.778542+0000","last_active":"2023-06-10T19:06:29.818409+0000","last_peered":"2023-06-10T19:06:29.818409+0000","last_clean":"2023-06-10T19:06:29.818409+0000","last_became_active":"2023-06-10T19:06:28.778261+0000","last_became_peered":"2023-06-10T19:06:28.778261+0000","last_unstale":"2023-06-10T19:06:29.818409+0000","last_undegraded":"2023-06-10T19:06:29.818409+0000","last_fullsized":"2023-06-10T19:06:29.818409+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:36:00.226299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"153'4","reported_seq":17,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.818959+0000","last_change":"2023-06-10T19:06:28.361549+0000","last_active":"2023-06-10T19:06:29.818959+0000","last_peered":"2023-06-10T19:06:29.818959+0000","last_clean":"2023-06-10T19:06:29.818959+0000","last_became_active":"2023-06-10T19:06:28.359070+0000","last_became_peered":"2023-06-10T19:06:28.359070+0000","last_unstale":"2023-06-10T19:06:29.818959+0000","last_undegraded":"2023-06-10T19:06:29.818959+0000","last_fullsized":"2023-06-10T19:06:29.818959+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:28:51.414484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.819506+0000","last_change":"2023-06-10T19:06:28.785530+0000","last_active":"2023-06-10T19:06:29.819506+0000","last_peered":"2023-06-10T19:06:29.819506+0000","last_clean":"2023-06-10T19:06:29.819506+0000","last_became_active":"2023-06-10T19:06:28.785265+0000","last_became_peered":"2023-06-10T19:06:28.785265+0000","last_unstale":"2023-06-10T19:06:29.819506+0000","last_undegraded":"2023-06-10T19:06:29.819506+0000","last_fullsized":"2023-06-10T19:06:29.819506+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:35:01.491376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"153'1","reported_seq":14,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.815691+0000","last_change":"2023-06-10T19:06:28.387547+0000","last_active":"2023-06-10T19:06:29.815691+0000","last_peered":"2023-06-10T19:06:29.815691+0000","last_clean":"2023-06-10T19:06:29.815691+0000","last_became_active":"2023-06-10T19:06:28.386957+0000","last_became_peered":"2023-06-10T19:06:28.386957+0000","last_unstale":"2023-06-10T19:06:29.815691+0000","last_undegraded":"2023-06-10T19:06:29.815691+0000","last_fullsized":"2023-06-10T19:06:29.815691+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:56:47.937613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.740356+0000","last_change":"2023-06-10T19:06:28.759941+0000","last_active":"2023-06-10T19:06:29.740356+0000","last_peered":"2023-06-10T19:06:29.740356+0000","last_clean":"2023-06-10T19:06:29.740356+0000","last_became_active":"2023-06-10T19:06:28.758907+0000","last_became_peered":"2023-06-10T19:06:28.758907+0000","last_unstale":"2023-06-10T19:06:29.740356+0000","last_undegraded":"2023-06-10T19:06:29.740356+0000","last_fullsized":"2023-06-10T19:06:29.740356+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:31:26.250900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"153'2","reported_seq":15,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.817151+0000","last_change":"2023-06-10T19:06:28.387277+0000","last_active":"2023-06-10T19:06:29.817151+0000","last_peered":"2023-06-10T19:06:29.817151+0000","last_clean":"2023-06-10T19:06:29.817151+0000","last_became_active":"2023-06-10T19:06:28.386787+0000","last_became_peered":"2023-06-10T19:06:28.386787+0000","last_unstale":"2023-06-10T19:06:29.817151+0000","last_undegraded":"2023-06-10T19:06:29.817151+0000","last_fullsized":"2023-06-10T19:06:29.817151+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:10:00.641667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.817359+0000","last_change":"2023-06-10T19:06:28.795152+0000","last_active":"2023-06-10T19:06:29.817359+0000","last_peered":"2023-06-10T19:06:29.817359+0000","last_clean":"2023-06-10T19:06:29.817359+0000","last_became_active":"2023-06-10T19:06:28.794621+0000","last_became_peered":"2023-06-10T19:06:28.794621+0000","last_unstale":"2023-06-10T19:06:29.817359+0000","last_undegraded":"2023-06-10T19:06:29.817359+0000","last_fullsized":"2023-06-10T19:06:29.817359+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:17:50.360480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"153'2","reported_seq":15,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.818947+0000","last_change":"2023-06-10T19:06:28.381539+0000","last_active":"2023-06-10T19:06:29.818947+0000","last_peered":"2023-06-10T19:06:29.818947+0000","last_clean":"2023-06-10T19:06:29.818947+0000","last_became_active":"2023-06-10T19:06:28.381072+0000","last_became_peered":"2023-06-10T19:06:28.381072+0000","last_unstale":"2023-06-10T19:06:29.818947+0000","last_undegraded":"2023-06-10T19:06:29.818947+0000","last_fullsized":"2023-06-10T19:06:29.818947+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:46:57.990068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.735246+0000","last_change":"2023-06-10T19:06:28.744109+0000","last_active":"2023-06-10T19:06:29.735246+0000","last_peered":"2023-06-10T19:06:29.735246+0000","last_clean":"2023-06-10T19:06:29.735246+0000","last_became_active":"2023-06-10T19:06:28.743610+0000","last_became_peered":"2023-06-10T19:06:28.743610+0000","last_unstale":"2023-06-10T19:06:29.735246+0000","last_undegraded":"2023-06-10T19:06:29.735246+0000","last_fullsized":"2023-06-10T19:06:29.735246+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:57:00.817666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"153'1","reported_seq":14,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.741606+0000","last_change":"2023-06-10T19:06:28.362338+0000","last_active":"2023-06-10T19:06:29.741606+0000","last_peered":"2023-06-10T19:06:29.741606+0000","last_clean":"2023-06-10T19:06:29.741606+0000","last_became_active":"2023-06-10T19:06:28.360739+0000","last_became_peered":"2023-06-10T19:06:28.360739+0000","last_unstale":"2023-06-10T19:06:29.741606+0000","last_undegraded":"2023-06-10T19:06:29.741606+0000","last_fullsized":"2023-06-10T19:06:29.741606+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:20:21.971797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.816884+0000","last_change":"2023-06-10T19:06:28.755807+0000","last_active":"2023-06-10T19:06:29.816884+0000","last_peered":"2023-06-10T19:06:29.816884+0000","last_clean":"2023-06-10T19:06:29.816884+0000","last_became_active":"2023-06-10T19:06:28.754868+0000","last_became_peered":"2023-06-10T19:06:28.754868+0000","last_unstale":"2023-06-10T19:06:29.816884+0000","last_undegraded":"2023-06-10T19:06:29.816884+0000","last_fullsized":"2023-06-10T19:06:29.816884+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:27:42.233003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1a","version":"153'1","reported_seq":14,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.816851+0000","last_change":"2023-06-10T19:06:28.363282+0000","last_active":"2023-06-10T19:06:29.816851+0000","last_peered":"2023-06-10T19:06:29.816851+0000","last_clean":"2023-06-10T19:06:29.816851+0000","last_became_active":"2023-06-10T19:06:28.362706+0000","last_became_peered":"2023-06-10T19:06:28.362706+0000","last_unstale":"2023-06-10T19:06:29.816851+0000","last_undegraded":"2023-06-10T19:06:29.816851+0000","last_fullsized":"2023-06-10T19:06:29.816851+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:07:39.505674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.815136+0000","last_change":"2023-06-10T19:06:28.745329+0000","last_active":"2023-06-10T19:06:29.815136+0000","last_peered":"2023-06-10T19:06:29.815136+0000","last_clean":"2023-06-10T19:06:29.815136+0000","last_became_active":"2023-06-10T19:06:28.745050+0000","last_became_peered":"2023-06-10T19:06:28.745050+0000","last_unstale":"2023-06-10T19:06:29.815136+0000","last_undegraded":"2023-06-10T19:06:29.815136+0000","last_fullsized":"2023-06-10T19:06:29.815136+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:29:57.951463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.741468+0000","last_change":"2023-06-10T19:06:28.379064+0000","last_active":"2023-06-10T19:06:29.741468+0000","last_peered":"2023-06-10T19:06:29.741468+0000","last_clean":"2023-06-10T19:06:29.741468+0000","last_became_active":"2023-06-10T19:06:28.378372+0000","last_became_peered":"2023-06-10T19:06:28.378372+0000","last_unstale":"2023-06-10T19:06:29.741468+0000","last_undegraded":"2023-06-10T19:06:29.741468+0000","last_fullsized":"2023-06-10T19:06:29.741468+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:16:05.108766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.742347+0000","last_change":"2023-06-10T19:06:28.769293+0000","last_active":"2023-06-10T19:06:29.742347+0000","last_peered":"2023-06-10T19:06:29.742347+0000","last_clean":"2023-06-10T19:06:29.742347+0000","last_became_active":"2023-06-10T19:06:28.768567+0000","last_became_peered":"2023-06-10T19:06:28.768567+0000","last_unstale":"2023-06-10T19:06:29.742347+0000","last_undegraded":"2023-06-10T19:06:29.742347+0000","last_fullsized":"2023-06-10T19:06:29.742347+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:35:01.491376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.816086+0000","last_change":"2023-06-10T19:06:28.378370+0000","last_active":"2023-06-10T19:06:29.816086+0000","last_peered":"2023-06-10T19:06:29.816086+0000","last_clean":"2023-06-10T19:06:29.816086+0000","last_became_active":"2023-06-10T19:06:28.377853+0000","last_became_peered":"2023-06-10T19:06:28.377853+0000","last_unstale":"2023-06-10T19:06:29.816086+0000","last_undegraded":"2023-06-10T19:06:29.816086+0000","last_fullsized":"2023-06-10T19:06:29.816086+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:16:43.381255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.816525+0000","last_change":"2023-06-10T19:06:28.787738+0000","last_active":"2023-06-10T19:06:29.816525+0000","last_peered":"2023-06-10T19:06:29.816525+0000","last_clean":"2023-06-10T19:06:29.816525+0000","last_became_active":"2023-06-10T19:06:28.787004+0000","last_became_peered":"2023-06-10T19:06:28.787004+0000","last_unstale":"2023-06-10T19:06:29.816525+0000","last_undegraded":"2023-06-10T19:06:29.816525+0000","last_fullsized":"2023-06-10T19:06:29.816525+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:08:25.504629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"153'1","reported_seq":14,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.817177+0000","last_change":"2023-06-10T19:06:28.376382+0000","last_active":"2023-06-10T19:06:29.817177+0000","last_peered":"2023-06-10T19:06:29.817177+0000","last_clean":"2023-06-10T19:06:29.817177+0000","last_became_active":"2023-06-10T19:06:28.376019+0000","last_became_peered":"2023-06-10T19:06:28.376019+0000","last_unstale":"2023-06-10T19:06:29.817177+0000","last_undegraded":"2023-06-10T19:06:29.817177+0000","last_fullsized":"2023-06-10T19:06:29.817177+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:30:45.559203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.816916+0000","last_change":"2023-06-10T19:06:28.794391+0000","last_active":"2023-06-10T19:06:29.816916+0000","last_peered":"2023-06-10T19:06:29.816916+0000","last_clean":"2023-06-10T19:06:29.816916+0000","last_became_active":"2023-06-10T19:06:28.793148+0000","last_became_peered":"2023-06-10T19:06:28.793148+0000","last_unstale":"2023-06-10T19:06:29.816916+0000","last_undegraded":"2023-06-10T19:06:29.816916+0000","last_fullsized":"2023-06-10T19:06:29.816916+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:57:36.035948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"153'2","reported_seq":15,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.816046+0000","last_change":"2023-06-10T19:06:28.361366+0000","last_active":"2023-06-10T19:06:29.816046+0000","last_peered":"2023-06-10T19:06:29.816046+0000","last_clean":"2023-06-10T19:06:29.816046+0000","last_became_active":"2023-06-10T19:06:28.360578+0000","last_became_peered":"2023-06-10T19:06:28.360578+0000","last_unstale":"2023-06-10T19:06:29.816046+0000","last_undegraded":"2023-06-10T19:06:29.816046+0000","last_fullsized":"2023-06-10T19:06:29.816046+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:11:44.455139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.742876+0000","last_change":"2023-06-10T19:06:28.774574+0000","last_active":"2023-06-10T19:06:29.742876+0000","last_peered":"2023-06-10T19:06:29.742876+0000","last_clean":"2023-06-10T19:06:29.742876+0000","last_became_active":"2023-06-10T19:06:28.773861+0000","last_became_peered":"2023-06-10T19:06:28.773861+0000","last_unstale":"2023-06-10T19:06:29.742876+0000","last_undegraded":"2023-06-10T19:06:29.742876+0000","last_fullsized":"2023-06-10T19:06:29.742876+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:59:13.222474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"153'1","reported_seq":14,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.819738+0000","last_change":"2023-06-10T19:06:28.362909+0000","last_active":"2023-06-10T19:06:29.819738+0000","last_peered":"2023-06-10T19:06:29.819738+0000","last_clean":"2023-06-10T19:06:29.819738+0000","last_became_active":"2023-06-10T19:06:28.362297+0000","last_became_peered":"2023-06-10T19:06:28.362297+0000","last_unstale":"2023-06-10T19:06:29.819738+0000","last_undegraded":"2023-06-10T19:06:29.819738+0000","last_fullsized":"2023-06-10T19:06:29.819738+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:19:30.193076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.742883+0000","last_change":"2023-06-10T19:06:28.797277+0000","last_active":"2023-06-10T19:06:29.742883+0000","last_peered":"2023-06-10T19:06:29.742883+0000","last_clean":"2023-06-10T19:06:29.742883+0000","last_became_active":"2023-06-10T19:06:28.796739+0000","last_became_peered":"2023-06-10T19:06:28.796739+0000","last_unstale":"2023-06-10T19:06:29.742883+0000","last_undegraded":"2023-06-10T19:06:29.742883+0000","last_fullsized":"2023-06-10T19:06:29.742883+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:54:43.414642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.816346+0000","last_change":"2023-06-10T19:06:28.375260+0000","last_active":"2023-06-10T19:06:29.816346+0000","last_peered":"2023-06-10T19:06:29.816346+0000","last_clean":"2023-06-10T19:06:29.816346+0000","last_became_active":"2023-06-10T19:06:28.374564+0000","last_became_peered":"2023-06-10T19:06:28.374564+0000","last_unstale":"2023-06-10T19:06:29.816346+0000","last_undegraded":"2023-06-10T19:06:29.816346+0000","last_fullsized":"2023-06-10T19:06:29.816346+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:07:17.695664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.815456+0000","last_change":"2023-06-10T19:06:28.790693+0000","last_active":"2023-06-10T19:06:29.815456+0000","last_peered":"2023-06-10T19:06:29.815456+0000","last_clean":"2023-06-10T19:06:29.815456+0000","last_became_active":"2023-06-10T19:06:28.790142+0000","last_became_peered":"2023-06-10T19:06:28.790142+0000","last_unstale":"2023-06-10T19:06:29.815456+0000","last_undegraded":"2023-06-10T19:06:29.815456+0000","last_fullsized":"2023-06-10T19:06:29.815456+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:32:03.590928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"153'2","reported_seq":15,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.735466+0000","last_change":"2023-06-10T19:06:28.360853+0000","last_active":"2023-06-10T19:06:29.735466+0000","last_peered":"2023-06-10T19:06:29.735466+0000","last_clean":"2023-06-10T19:06:29.735466+0000","last_became_active":"2023-06-10T19:06:28.360580+0000","last_became_peered":"2023-06-10T19:06:28.360580+0000","last_unstale":"2023-06-10T19:06:29.735466+0000","last_undegraded":"2023-06-10T19:06:29.735466+0000","last_fullsized":"2023-06-10T19:06:29.735466+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:47:03.626499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.815643+0000","last_change":"2023-06-10T19:06:28.779975+0000","last_active":"2023-06-10T19:06:29.815643+0000","last_peered":"2023-06-10T19:06:29.815643+0000","last_clean":"2023-06-10T19:06:29.815643+0000","last_became_active":"2023-06-10T19:06:28.779641+0000","last_became_peered":"2023-06-10T19:06:28.779641+0000","last_unstale":"2023-06-10T19:06:29.815643+0000","last_undegraded":"2023-06-10T19:06:29.815643+0000","last_fullsized":"2023-06-10T19:06:29.815643+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:08:24.612209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.740027+0000","last_change":"2023-06-10T19:06:28.370275+0000","last_active":"2023-06-10T19:06:29.740027+0000","last_peered":"2023-06-10T19:06:29.740027+0000","last_clean":"2023-06-10T19:06:29.740027+0000","last_became_active":"2023-06-10T19:06:28.369565+0000","last_became_peered":"2023-06-10T19:06:28.369565+0000","last_unstale":"2023-06-10T19:06:29.740027+0000","last_undegraded":"2023-06-10T19:06:29.740027+0000","last_fullsized":"2023-06-10T19:06:29.740027+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:44:57.816682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.815722+0000","last_change":"2023-06-10T19:06:28.787202+0000","last_active":"2023-06-10T19:06:29.815722+0000","last_peered":"2023-06-10T19:06:29.815722+0000","last_clean":"2023-06-10T19:06:29.815722+0000","last_became_active":"2023-06-10T19:06:28.786442+0000","last_became_peered":"2023-06-10T19:06:28.786442+0000","last_unstale":"2023-06-10T19:06:29.815722+0000","last_undegraded":"2023-06-10T19:06:29.815722+0000","last_fullsized":"2023-06-10T19:06:29.815722+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:02:04.709298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.735271+0000","last_change":"2023-06-10T19:06:28.360981+0000","last_active":"2023-06-10T19:06:29.735271+0000","last_peered":"2023-06-10T19:06:29.735271+0000","last_clean":"2023-06-10T19:06:29.735271+0000","last_became_active":"2023-06-10T19:06:28.359939+0000","last_became_peered":"2023-06-10T19:06:28.359939+0000","last_unstale":"2023-06-10T19:06:29.735271+0000","last_undegraded":"2023-06-10T19:06:29.735271+0000","last_fullsized":"2023-06-10T19:06:29.735271+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:33:39.166739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.818762+0000","last_change":"2023-06-10T19:06:28.786698+0000","last_active":"2023-06-10T19:06:29.818762+0000","last_peered":"2023-06-10T19:06:29.818762+0000","last_clean":"2023-06-10T19:06:29.818762+0000","last_became_active":"2023-06-10T19:06:28.785937+0000","last_became_peered":"2023-06-10T19:06:28.785937+0000","last_unstale":"2023-06-10T19:06:29.818762+0000","last_undegraded":"2023-06-10T19:06:29.818762+0000","last_fullsized":"2023-06-10T19:06:29.818762+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:40:25.451299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.740317+0000","last_change":"2023-06-10T19:06:28.371414+0000","last_active":"2023-06-10T19:06:29.740317+0000","last_peered":"2023-06-10T19:06:29.740317+0000","last_clean":"2023-06-10T19:06:29.740317+0000","last_became_active":"2023-06-10T19:06:28.370691+0000","last_became_peered":"2023-06-10T19:06:28.370691+0000","last_unstale":"2023-06-10T19:06:29.740317+0000","last_undegraded":"2023-06-10T19:06:29.740317+0000","last_fullsized":"2023-06-10T19:06:29.740317+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:06:33.893531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.815989+0000","last_change":"2023-06-10T19:06:28.766856+0000","last_active":"2023-06-10T19:06:29.815989+0000","last_peered":"2023-06-10T19:06:29.815989+0000","last_clean":"2023-06-10T19:06:29.815989+0000","last_became_active":"2023-06-10T19:06:28.766558+0000","last_became_peered":"2023-06-10T19:06:28.766558+0000","last_unstale":"2023-06-10T19:06:29.815989+0000","last_undegraded":"2023-06-10T19:06:29.815989+0000","last_fullsized":"2023-06-10T19:06:29.815989+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:53:06.418851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"153'2","reported_seq":15,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.816704+0000","last_change":"2023-06-10T19:06:28.381155+0000","last_active":"2023-06-10T19:06:29.816704+0000","last_peered":"2023-06-10T19:06:29.816704+0000","last_clean":"2023-06-10T19:06:29.816704+0000","last_became_active":"2023-06-10T19:06:28.380459+0000","last_became_peered":"2023-06-10T19:06:28.380459+0000","last_unstale":"2023-06-10T19:06:29.816704+0000","last_undegraded":"2023-06-10T19:06:29.816704+0000","last_fullsized":"2023-06-10T19:06:29.816704+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:32:05.470611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.816533+0000","last_change":"2023-06-10T19:06:28.776676+0000","last_active":"2023-06-10T19:06:29.816533+0000","last_peered":"2023-06-10T19:06:29.816533+0000","last_clean":"2023-06-10T19:06:29.816533+0000","last_became_active":"2023-06-10T19:06:28.771861+0000","last_became_peered":"2023-06-10T19:06:28.771861+0000","last_unstale":"2023-06-10T19:06:29.816533+0000","last_undegraded":"2023-06-10T19:06:29.816533+0000","last_fullsized":"2023-06-10T19:06:29.816533+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:03:55.555134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.743295+0000","last_change":"2023-06-10T19:06:28.383932+0000","last_active":"2023-06-10T19:06:29.743295+0000","last_peered":"2023-06-10T19:06:29.743295+0000","last_clean":"2023-06-10T19:06:29.743295+0000","last_became_active":"2023-06-10T19:06:28.383270+0000","last_became_peered":"2023-06-10T19:06:28.383270+0000","last_unstale":"2023-06-10T19:06:29.743295+0000","last_undegraded":"2023-06-10T19:06:29.743295+0000","last_fullsized":"2023-06-10T19:06:29.743295+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:05:30.785228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.743238+0000","last_change":"2023-06-10T19:06:28.766095+0000","last_active":"2023-06-10T19:06:29.743238+0000","last_peered":"2023-06-10T19:06:29.743238+0000","last_clean":"2023-06-10T19:06:29.743238+0000","last_became_active":"2023-06-10T19:06:28.765343+0000","last_became_peered":"2023-06-10T19:06:28.765343+0000","last_unstale":"2023-06-10T19:06:29.743238+0000","last_undegraded":"2023-06-10T19:06:29.743238+0000","last_fullsized":"2023-06-10T19:06:29.743238+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:55:36.049949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.819796+0000","last_change":"2023-06-10T19:06:28.371204+0000","last_active":"2023-06-10T19:06:29.819796+0000","last_peered":"2023-06-10T19:06:29.819796+0000","last_clean":"2023-06-10T19:06:29.819796+0000","last_became_active":"2023-06-10T19:06:28.370793+0000","last_became_peered":"2023-06-10T19:06:28.370793+0000","last_unstale":"2023-06-10T19:06:29.819796+0000","last_undegraded":"2023-06-10T19:06:29.819796+0000","last_fullsized":"2023-06-10T19:06:29.819796+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:59:12.219912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.818647+0000","last_change":"2023-06-10T19:06:28.755865+0000","last_active":"2023-06-10T19:06:29.818647+0000","last_peered":"2023-06-10T19:06:29.818647+0000","last_clean":"2023-06-10T19:06:29.818647+0000","last_became_active":"2023-06-10T19:06:28.755384+0000","last_became_peered":"2023-06-10T19:06:28.755384+0000","last_unstale":"2023-06-10T19:06:29.818647+0000","last_undegraded":"2023-06-10T19:06:29.818647+0000","last_fullsized":"2023-06-10T19:06:29.818647+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:47:30.126259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.818388+0000","last_change":"2023-06-10T19:06:28.374175+0000","last_active":"2023-06-10T19:06:29.818388+0000","last_peered":"2023-06-10T19:06:29.818388+0000","last_clean":"2023-06-10T19:06:29.818388+0000","last_became_active":"2023-06-10T19:06:28.373842+0000","last_became_peered":"2023-06-10T19:06:28.373842+0000","last_unstale":"2023-06-10T19:06:29.818388+0000","last_undegraded":"2023-06-10T19:06:29.818388+0000","last_fullsized":"2023-06-10T19:06:29.818388+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:34:25.166808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.740122+0000","last_change":"2023-06-10T19:06:28.746364+0000","last_active":"2023-06-10T19:06:29.740122+0000","last_peered":"2023-06-10T19:06:29.740122+0000","last_clean":"2023-06-10T19:06:29.740122+0000","last_became_active":"2023-06-10T19:06:28.745341+0000","last_became_peered":"2023-06-10T19:06:28.745341+0000","last_unstale":"2023-06-10T19:06:29.740122+0000","last_undegraded":"2023-06-10T19:06:29.740122+0000","last_fullsized":"2023-06-10T19:06:29.740122+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:46:09.212467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.742112+0000","last_change":"2023-06-10T19:06:28.386971+0000","last_active":"2023-06-10T19:06:29.742112+0000","last_peered":"2023-06-10T19:06:29.742112+0000","last_clean":"2023-06-10T19:06:29.742112+0000","last_became_active":"2023-06-10T19:06:28.386521+0000","last_became_peered":"2023-06-10T19:06:28.386521+0000","last_unstale":"2023-06-10T19:06:29.742112+0000","last_undegraded":"2023-06-10T19:06:29.742112+0000","last_fullsized":"2023-06-10T19:06:29.742112+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:37:09.449195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.815381+0000","last_change":"2023-06-10T19:06:28.761972+0000","last_active":"2023-06-10T19:06:29.815381+0000","last_peered":"2023-06-10T19:06:29.815381+0000","last_clean":"2023-06-10T19:06:29.815381+0000","last_became_active":"2023-06-10T19:06:28.755251+0000","last_became_peered":"2023-06-10T19:06:28.755251+0000","last_unstale":"2023-06-10T19:06:29.815381+0000","last_undegraded":"2023-06-10T19:06:29.815381+0000","last_fullsized":"2023-06-10T19:06:29.815381+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:01:22.398136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.817403+0000","last_change":"2023-06-10T19:06:28.379787+0000","last_active":"2023-06-10T19:06:29.817403+0000","last_peered":"2023-06-10T19:06:29.817403+0000","last_clean":"2023-06-10T19:06:29.817403+0000","last_became_active":"2023-06-10T19:06:28.379364+0000","last_became_peered":"2023-06-10T19:06:28.379364+0000","last_unstale":"2023-06-10T19:06:29.817403+0000","last_undegraded":"2023-06-10T19:06:29.817403+0000","last_fullsized":"2023-06-10T19:06:29.817403+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:39:52.105903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.818307+0000","last_change":"2023-06-10T19:06:28.751726+0000","last_active":"2023-06-10T19:06:29.818307+0000","last_peered":"2023-06-10T19:06:29.818307+0000","last_clean":"2023-06-10T19:06:29.818307+0000","last_became_active":"2023-06-10T19:06:28.751388+0000","last_became_peered":"2023-06-10T19:06:28.751388+0000","last_unstale":"2023-06-10T19:06:29.818307+0000","last_undegraded":"2023-06-10T19:06:29.818307+0000","last_fullsized":"2023-06-10T19:06:29.818307+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:20:33.075170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.741678+0000","last_change":"2023-06-10T19:06:28.379674+0000","last_active":"2023-06-10T19:06:29.741678+0000","last_peered":"2023-06-10T19:06:29.741678+0000","last_clean":"2023-06-10T19:06:29.741678+0000","last_became_active":"2023-06-10T19:06:28.378954+0000","last_became_peered":"2023-06-10T19:06:28.378954+0000","last_unstale":"2023-06-10T19:06:29.741678+0000","last_undegraded":"2023-06-10T19:06:29.741678+0000","last_fullsized":"2023-06-10T19:06:29.741678+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:40:24.448737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.740882+0000","last_change":"2023-06-10T19:06:28.747513+0000","last_active":"2023-06-10T19:06:29.740882+0000","last_peered":"2023-06-10T19:06:29.740882+0000","last_clean":"2023-06-10T19:06:29.740882+0000","last_became_active":"2023-06-10T19:06:28.746692+0000","last_became_peered":"2023-06-10T19:06:28.746692+0000","last_unstale":"2023-06-10T19:06:29.740882+0000","last_undegraded":"2023-06-10T19:06:29.740882+0000","last_fullsized":"2023-06-10T19:06:29.740882+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:16:44.383817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.815681+0000","last_change":"2023-06-10T19:06:28.366358+0000","last_active":"2023-06-10T19:06:29.815681+0000","last_peered":"2023-06-10T19:06:29.815681+0000","last_clean":"2023-06-10T19:06:29.815681+0000","last_became_active":"2023-06-10T19:06:28.365633+0000","last_became_peered":"2023-06-10T19:06:28.365633+0000","last_unstale":"2023-06-10T19:06:29.815681+0000","last_undegraded":"2023-06-10T19:06:29.815681+0000","last_fullsized":"2023-06-10T19:06:29.815681+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:53:54.090645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.740566+0000","last_change":"2023-06-10T19:06:28.744385+0000","last_active":"2023-06-10T19:06:29.740566+0000","last_peered":"2023-06-10T19:06:29.740566+0000","last_clean":"2023-06-10T19:06:29.740566+0000","last_became_active":"2023-06-10T19:06:28.743587+0000","last_became_peered":"2023-06-10T19:06:28.743587+0000","last_unstale":"2023-06-10T19:06:29.740566+0000","last_undegraded":"2023-06-10T19:06:29.740566+0000","last_fullsized":"2023-06-10T19:06:29.740566+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:53:06.418851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"153'6","reported_seq":19,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.735390+0000","last_change":"2023-06-10T19:06:28.360862+0000","last_active":"2023-06-10T19:06:29.735390+0000","last_peered":"2023-06-10T19:06:29.735390+0000","last_clean":"2023-06-10T19:06:29.735390+0000","last_became_active":"2023-06-10T19:06:28.359953+0000","last_became_peered":"2023-06-10T19:06:28.359953+0000","last_unstale":"2023-06-10T19:06:29.735390+0000","last_undegraded":"2023-06-10T19:06:29.735390+0000","last_fullsized":"2023-06-10T19:06:29.735390+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:36:43.229767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":395,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.816347+0000","last_change":"2023-06-10T18:52:34.951528+0000","last_active":"2023-06-10T19:06:29.816347+0000","last_peered":"2023-06-10T19:06:29.816347+0000","last_clean":"2023-06-10T19:06:29.816347+0000","last_became_active":"2023-06-10T18:52:34.949099+0000","last_became_peered":"2023-06-10T18:52:34.949099+0000","last_unstale":"2023-06-10T19:06:29.816347+0000","last_undegraded":"2023-06-10T19:06:29.816347+0000","last_fullsized":"2023-06-10T19:06:29.816347+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_clean_scrub_stamp":"2023-06-10T18:52:33.633295+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:49:47.533676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":261,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.742402+0000","last_change":"2023-06-10T18:52:40.506384+0000","last_active":"2023-06-10T19:06:29.742402+0000","last_peered":"2023-06-10T19:06:29.742402+0000","last_clean":"2023-06-10T19:06:29.742402+0000","last_became_active":"2023-06-10T18:52:40.505701+0000","last_became_peered":"2023-06-10T18:52:40.505701+0000","last_unstale":"2023-06-10T19:06:29.742402+0000","last_undegraded":"2023-06-10T19:06:29.742402+0000","last_fullsized":"2023-06-10T19:06:29.742402+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:50:09.928994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.740497+0000","last_change":"2023-06-10T19:06:28.781491+0000","last_active":"2023-06-10T19:06:29.740497+0000","last_peered":"2023-06-10T19:06:29.740497+0000","last_clean":"2023-06-10T19:06:29.740497+0000","last_became_active":"2023-06-10T19:06:28.780751+0000","last_became_peered":"2023-06-10T19:06:28.780751+0000","last_unstale":"2023-06-10T19:06:29.740497+0000","last_undegraded":"2023-06-10T19:06:29.740497+0000","last_fullsized":"2023-06-10T19:06:29.740497+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:48:39.584975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.817306+0000","last_change":"2023-06-10T19:06:28.366139+0000","last_active":"2023-06-10T19:06:29.817306+0000","last_peered":"2023-06-10T19:06:29.817306+0000","last_clean":"2023-06-10T19:06:29.817306+0000","last_became_active":"2023-06-10T19:06:28.365460+0000","last_became_peered":"2023-06-10T19:06:28.365460+0000","last_unstale":"2023-06-10T19:06:29.817306+0000","last_undegraded":"2023-06-10T19:06:29.817306+0000","last_fullsized":"2023-06-10T19:06:29.817306+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:46:47.381771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":239,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.816027+0000","last_change":"2023-06-10T18:52:40.512015+0000","last_active":"2023-06-10T19:06:29.816027+0000","last_peered":"2023-06-10T19:06:29.816027+0000","last_clean":"2023-06-10T19:06:29.816027+0000","last_became_active":"2023-06-10T18:52:40.511382+0000","last_became_peered":"2023-06-10T18:52:40.511382+0000","last_unstale":"2023-06-10T19:06:29.816027+0000","last_undegraded":"2023-06-10T19:06:29.816027+0000","last_fullsized":"2023-06-10T19:06:29.816027+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:15:25.480469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.817282+0000","last_change":"2023-06-10T19:06:28.780318+0000","last_active":"2023-06-10T19:06:29.817282+0000","last_peered":"2023-06-10T19:06:29.817282+0000","last_clean":"2023-06-10T19:06:29.817282+0000","last_became_active":"2023-06-10T19:06:28.779806+0000","last_became_peered":"2023-06-10T19:06:28.779806+0000","last_unstale":"2023-06-10T19:06:29.817282+0000","last_undegraded":"2023-06-10T19:06:29.817282+0000","last_fullsized":"2023-06-10T19:06:29.817282+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:06:15.891044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.743141+0000","last_change":"2023-06-10T19:06:28.381480+0000","last_active":"2023-06-10T19:06:29.743141+0000","last_peered":"2023-06-10T19:06:29.743141+0000","last_clean":"2023-06-10T19:06:29.743141+0000","last_became_active":"2023-06-10T19:06:28.380221+0000","last_became_peered":"2023-06-10T19:06:28.380221+0000","last_unstale":"2023-06-10T19:06:29.743141+0000","last_undegraded":"2023-06-10T19:06:29.743141+0000","last_fullsized":"2023-06-10T19:06:29.743141+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:05:07.876924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":259,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.815656+0000","last_change":"2023-06-10T18:52:40.671725+0000","last_active":"2023-06-10T19:06:29.815656+0000","last_peered":"2023-06-10T19:06:29.815656+0000","last_clean":"2023-06-10T19:06:29.815656+0000","last_became_active":"2023-06-10T18:52:40.671442+0000","last_became_peered":"2023-06-10T18:52:40.671442+0000","last_unstale":"2023-06-10T19:06:29.815656+0000","last_undegraded":"2023-06-10T19:06:29.815656+0000","last_fullsized":"2023-06-10T19:06:29.815656+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:35:55.010336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.817830+0000","last_change":"2023-06-10T19:06:28.767649+0000","last_active":"2023-06-10T19:06:29.817830+0000","last_peered":"2023-06-10T19:06:29.817830+0000","last_clean":"2023-06-10T19:06:29.817830+0000","last_became_active":"2023-06-10T19:06:28.767162+0000","last_became_peered":"2023-06-10T19:06:28.767162+0000","last_unstale":"2023-06-10T19:06:29.817830+0000","last_undegraded":"2023-06-10T19:06:29.817830+0000","last_fullsized":"2023-06-10T19:06:29.817830+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:18:24.609690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"153'3","reported_seq":16,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.817162+0000","last_change":"2023-06-10T19:06:28.356792+0000","last_active":"2023-06-10T19:06:29.817162+0000","last_peered":"2023-06-10T19:06:29.817162+0000","last_clean":"2023-06-10T19:06:29.817162+0000","last_became_active":"2023-06-10T19:06:28.355531+0000","last_became_peered":"2023-06-10T19:06:28.355531+0000","last_unstale":"2023-06-10T19:06:29.817162+0000","last_undegraded":"2023-06-10T19:06:29.817162+0000","last_fullsized":"2023-06-10T19:06:29.817162+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:53:49.382226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":261,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.741984+0000","last_change":"2023-06-10T18:52:40.510258+0000","last_active":"2023-06-10T19:06:29.741984+0000","last_peered":"2023-06-10T19:06:29.741984+0000","last_clean":"2023-06-10T19:06:29.741984+0000","last_became_active":"2023-06-10T18:52:40.509560+0000","last_became_peered":"2023-06-10T18:52:40.509560+0000","last_unstale":"2023-06-10T19:06:29.741984+0000","last_undegraded":"2023-06-10T19:06:29.741984+0000","last_fullsized":"2023-06-10T19:06:29.741984+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:57:45.698722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.740102+0000","last_change":"2023-06-10T19:06:28.775041+0000","last_active":"2023-06-10T19:06:29.740102+0000","last_peered":"2023-06-10T19:06:29.740102+0000","last_clean":"2023-06-10T19:06:29.740102+0000","last_became_active":"2023-06-10T19:06:28.773161+0000","last_became_peered":"2023-06-10T19:06:28.773161+0000","last_unstale":"2023-06-10T19:06:29.740102+0000","last_undegraded":"2023-06-10T19:06:29.740102+0000","last_fullsized":"2023-06-10T19:06:29.740102+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:19:29.967777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"153'2","reported_seq":15,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.817830+0000","last_change":"2023-06-10T19:06:28.356032+0000","last_active":"2023-06-10T19:06:29.817830+0000","last_peered":"2023-06-10T19:06:29.817830+0000","last_clean":"2023-06-10T19:06:29.817830+0000","last_became_active":"2023-06-10T19:06:28.355800+0000","last_became_peered":"2023-06-10T19:06:28.355800+0000","last_unstale":"2023-06-10T19:06:29.817830+0000","last_undegraded":"2023-06-10T19:06:29.817830+0000","last_fullsized":"2023-06-10T19:06:29.817830+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:10:06.928207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":239,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.819332+0000","last_change":"2023-06-10T18:52:40.672266+0000","last_active":"2023-06-10T19:06:29.819332+0000","last_peered":"2023-06-10T19:06:29.819332+0000","last_clean":"2023-06-10T19:06:29.819332+0000","last_became_active":"2023-06-10T18:52:40.671966+0000","last_became_peered":"2023-06-10T18:52:40.671966+0000","last_unstale":"2023-06-10T19:06:29.819332+0000","last_undegraded":"2023-06-10T19:06:29.819332+0000","last_fullsized":"2023-06-10T19:06:29.819332+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:23:21.600052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.817735+0000","last_change":"2023-06-10T19:06:28.795427+0000","last_active":"2023-06-10T19:06:29.817735+0000","last_peered":"2023-06-10T19:06:29.817735+0000","last_clean":"2023-06-10T19:06:29.817735+0000","last_became_active":"2023-06-10T19:06:28.795077+0000","last_became_peered":"2023-06-10T19:06:28.795077+0000","last_unstale":"2023-06-10T19:06:29.817735+0000","last_undegraded":"2023-06-10T19:06:29.817735+0000","last_fullsized":"2023-06-10T19:06:29.817735+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:18:39.937587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.815315+0000","last_change":"2023-06-10T19:06:28.381830+0000","last_active":"2023-06-10T19:06:29.815315+0000","last_peered":"2023-06-10T19:06:29.815315+0000","last_clean":"2023-06-10T19:06:29.815315+0000","last_became_active":"2023-06-10T19:06:28.380345+0000","last_became_peered":"2023-06-10T19:06:28.380345+0000","last_unstale":"2023-06-10T19:06:29.815315+0000","last_undegraded":"2023-06-10T19:06:29.815315+0000","last_fullsized":"2023-06-10T19:06:29.815315+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:56:55.672876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":239,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.817471+0000","last_change":"2023-06-10T18:52:40.671084+0000","last_active":"2023-06-10T19:06:29.817471+0000","last_peered":"2023-06-10T19:06:29.817471+0000","last_clean":"2023-06-10T19:06:29.817471+0000","last_became_active":"2023-06-10T18:52:40.670697+0000","last_became_peered":"2023-06-10T18:52:40.670697+0000","last_unstale":"2023-06-10T19:06:29.817471+0000","last_undegraded":"2023-06-10T19:06:29.817471+0000","last_fullsized":"2023-06-10T19:06:29.817471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:30:59.333653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.816611+0000","last_change":"2023-06-10T19:06:28.736426+0000","last_active":"2023-06-10T19:06:29.816611+0000","last_peered":"2023-06-10T19:06:29.816611+0000","last_clean":"2023-06-10T19:06:29.816611+0000","last_became_active":"2023-06-10T19:06:28.736098+0000","last_became_peered":"2023-06-10T19:06:28.736098+0000","last_unstale":"2023-06-10T19:06:29.816611+0000","last_undegraded":"2023-06-10T19:06:29.816611+0000","last_fullsized":"2023-06-10T19:06:29.816611+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:39:03.014139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.815621+0000","last_change":"2023-06-10T19:06:28.368131+0000","last_active":"2023-06-10T19:06:29.815621+0000","last_peered":"2023-06-10T19:06:29.815621+0000","last_clean":"2023-06-10T19:06:29.815621+0000","last_became_active":"2023-06-10T19:06:28.367449+0000","last_became_peered":"2023-06-10T19:06:28.367449+0000","last_unstale":"2023-06-10T19:06:29.815621+0000","last_undegraded":"2023-06-10T19:06:29.815621+0000","last_fullsized":"2023-06-10T19:06:29.815621+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:22:10.806617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":239,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.819665+0000","last_change":"2023-06-10T18:52:40.514114+0000","last_active":"2023-06-10T19:06:29.819665+0000","last_peered":"2023-06-10T19:06:29.819665+0000","last_clean":"2023-06-10T19:06:29.819665+0000","last_became_active":"2023-06-10T18:52:40.513638+0000","last_became_peered":"2023-06-10T18:52:40.513638+0000","last_unstale":"2023-06-10T19:06:29.819665+0000","last_undegraded":"2023-06-10T19:06:29.819665+0000","last_fullsized":"2023-06-10T19:06:29.819665+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:19:29.048938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.818424+0000","last_change":"2023-06-10T19:06:28.771489+0000","last_active":"2023-06-10T19:06:29.818424+0000","last_peered":"2023-06-10T19:06:29.818424+0000","last_clean":"2023-06-10T19:06:29.818424+0000","last_became_active":"2023-06-10T19:06:28.771174+0000","last_became_peered":"2023-06-10T19:06:28.771174+0000","last_unstale":"2023-06-10T19:06:29.818424+0000","last_undegraded":"2023-06-10T19:06:29.818424+0000","last_fullsized":"2023-06-10T19:06:29.818424+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:16:06.111327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"153'8","reported_seq":21,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.740652+0000","last_change":"2023-06-10T19:06:28.384158+0000","last_active":"2023-06-10T19:06:29.740652+0000","last_peered":"2023-06-10T19:06:29.740652+0000","last_clean":"2023-06-10T19:06:29.740652+0000","last_became_active":"2023-06-10T19:06:28.383394+0000","last_became_peered":"2023-06-10T19:06:28.383394+0000","last_unstale":"2023-06-10T19:06:29.740652+0000","last_undegraded":"2023-06-10T19:06:29.740652+0000","last_fullsized":"2023-06-10T19:06:29.740652+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:20:32.072608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":241,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.816792+0000","last_change":"2023-06-10T18:52:40.515396+0000","last_active":"2023-06-10T19:06:29.816792+0000","last_peered":"2023-06-10T19:06:29.816792+0000","last_clean":"2023-06-10T19:06:29.816792+0000","last_became_active":"2023-06-10T18:52:40.514663+0000","last_became_peered":"2023-06-10T18:52:40.514663+0000","last_unstale":"2023-06-10T19:06:29.816792+0000","last_undegraded":"2023-06-10T19:06:29.816792+0000","last_fullsized":"2023-06-10T19:06:29.816792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:37:15.549708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575019,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33512,"kb_used_data":2464,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338328,"statfs":{"total":96636764160,"available":96602447872,"internally_reserved":0,"allocated":2523136,"data_stored":1488714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:06:01 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":0.96199999999999997,"15min":0.92900000000000005},"min":{"1min":0.70499999999999996,"5min":0.49399999999999999,"15min":0.434},"max":{"1min":1.522,"5min":1.522,"15min":1.6220000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.92100000000000004,"15min":0.92700000000000005},"min":{"1min":0.52800000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.6870000000000001},"last":1.1140000000000001}]},{"osd":1,"last update":"Sat Jun 10 19:06:01 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.91000000000000003,"15min":0.92000000000000004},"min":{"1min":0.56999999999999995,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1879999999999999,"5min":1.238,"15min":1.377},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.92800000000000005,"15min":0.94199999999999995},"min":{"1min":0.67800000000000005,"5min":0.51300000000000001,"15min":0.504},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.5960000000000001},"last":1}]},{"osd":2,"last update":"Sat Jun 10 19:06:01 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.88100000000000001,"15min":0.85299999999999998},"min":{"1min":0.60999999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.4059999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.91000000000000003,"15min":0.89800000000000002},"min":{"1min":0.61399999999999999,"5min":0.54100000000000004,"15min":0.50600000000000001},"max":{"1min":1.129,"5min":1.448,"15min":1.448},"last":1.091}]},{"osd":3,"last update":"Sat Jun 10 19:06:01 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.91300000000000003,"15min":0.92100000000000004},"min":{"1min":0.75800000000000001,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.502},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.97399999999999998,"15min":0.95699999999999996},"min":{"1min":0.58599999999999997,"5min":0.432,"15min":0.432},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":1.0349999999999999}]},{"osd":4,"last update":"Sat Jun 10 19:06:01 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.81599999999999995,"15min":0.84499999999999997},"min":{"1min":0.60299999999999998,"5min":0.307,"15min":0.307},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.639},"last":0.85899999999999999},{"interface":"front","average":{"1min":1.054,"5min":0.98499999999999999,"15min":0.96999999999999997},"min":{"1min":0.80200000000000005,"5min":0.41199999999999998,"15min":0.40000000000000002},"max":{"1min":1.3540000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.95599999999999996}]},{"osd":5,"last update":"Sat Jun 10 19:06:01 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":1.0049999999999999,"15min":1.006},"min":{"1min":0.64000000000000001,"5min":0.45100000000000001,"15min":0.38400000000000001},"max":{"1min":1.385,"5min":1.385,"15min":1.806},"last":1.179},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.03,"15min":1.0349999999999999},"min":{"1min":0.69699999999999995,"5min":0.48499999999999999,"15min":0.46500000000000002},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":1.0680000000000001}]},{"osd":6,"last update":"Sat Jun 10 19:06:01 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.999,"15min":1.004},"min":{"1min":0.67400000000000004,"5min":0.47699999999999998,"15min":0.35999999999999999},"max":{"1min":1.3149999999999999,"5min":1.391,"15min":1.718},"last":1.206},{"interface":"front","average":{"1min":1.127,"5min":1.1020000000000001,"15min":1.097},"min":{"1min":0.82499999999999996,"5min":0.504,"15min":0.441},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":1.151}]}]},{"osd":6,"up_from":13,"seq":55834575020,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32932,"kb_used_data":1884,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338908,"statfs":{"total":96636764160,"available":96603041792,"internally_reserved":0,"allocated":1929216,"data_stored":898394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:05:53 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83799999999999997,"15min":0.85999999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.1839999999999999,"5min":1.2450000000000001,"15min":1.498},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.86199999999999999,"15min":0.879},"min":{"1min":0.57099999999999995,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.496},"last":0.67400000000000004}]},{"osd":1,"last update":"Sat Jun 10 19:05:53 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.84999999999999998,"15min":0.86699999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.5229999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.89500000000000002,"15min":0.89900000000000002},"min":{"1min":0.66000000000000003,"5min":0.48699999999999999,"15min":0.45300000000000001},"max":{"1min":1.341,"5min":1.341,"15min":1.778},"last":1.0229999999999999}]},{"osd":2,"last update":"Sat Jun 10 19:05:53 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.91400000000000003,"15min":0.89900000000000002},"min":{"1min":0.51200000000000001,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.224,"5min":1.2809999999999999,"15min":1.3759999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.86699999999999999,"15min":0.88500000000000001},"min":{"1min":0.60499999999999998,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.1220000000000001,"5min":1.2330000000000001,"15min":1.246},"last":0.73099999999999998}]},{"osd":3,"last update":"Sat Jun 10 19:05:53 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.55900000000000005,"5min":0.55100000000000005,"15min":0.52700000000000002},"max":{"1min":1.202,"5min":1.238,"15min":1.7190000000000001},"last":1.0820000000000001},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.96299999999999997,"15min":0.98299999999999998},"min":{"1min":0.61599999999999999,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.198,"5min":1.371,"15min":1.4370000000000001},"last":0.91800000000000004}]},{"osd":4,"last update":"Sat Jun 10 19:05:53 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.90600000000000003,"15min":0.91200000000000003},"min":{"1min":0.48499999999999999,"5min":0.373,"15min":0.373},"max":{"1min":1.248,"5min":1.401,"15min":1.798},"last":1.123},{"interface":"front","average":{"1min":1.032,"5min":0.99399999999999999,"15min":0.98899999999999999},"min":{"1min":0.60399999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.371,"5min":1.371,"15min":1.5489999999999999},"last":1.0009999999999999}]},{"osd":5,"last update":"Sat Jun 10 19:05:53 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.89700000000000002,"15min":0.91500000000000004},"min":{"1min":0.66000000000000003,"5min":0.437,"15min":0.437},"max":{"1min":1.1950000000000001,"5min":1.29,"15min":1.333},"last":0.88100000000000001},{"interface":"front","average":{"1min":1.0109999999999999,"5min":0.997,"15min":1.0209999999999999},"min":{"1min":0.63100000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.256,"5min":1.296,"15min":2.536},"last":1.196}]},{"osd":7,"last update":"Sat Jun 10 19:05:53 2023","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.054,"15min":1.0329999999999999},"min":{"1min":0.73999999999999999,"5min":0.58599999999999997,"15min":0.57099999999999995},"max":{"1min":1.2929999999999999,"5min":1.879,"15min":1.917},"last":1.0489999999999999},{"interface":"front","average":{"1min":0.998,"5min":0.98899999999999999,"15min":1.012},"min":{"1min":0.64000000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.345,"5min":1.4850000000000001,"15min":1.5569999999999999},"last":0.96899999999999997}]}]},{"osd":5,"up_from":13,"seq":55834575020,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32928,"kb_used_data":1880,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338912,"statfs":{"total":96636764160,"available":96603045888,"internally_reserved":0,"allocated":1925120,"data_stored":898324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.877,"15min":0.873},"min":{"1min":0.51500000000000001,"5min":0.499,"15min":0.499},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":1.2669999999999999},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.94199999999999995,"15min":0.91800000000000004},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.49399999999999999},"max":{"1min":1.212,"5min":2.347,"15min":2.347},"last":0.90600000000000003}]},{"osd":1,"last update":"Sat Jun 10 19:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.96299999999999997,"15min":0.91900000000000004},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.52600000000000002},"max":{"1min":1.6739999999999999,"5min":7.0800000000000001,"15min":7.0800000000000001},"last":1.2290000000000001},{"interface":"front","average":{"1min":0.86499999999999999,"5min":1.117,"15min":0.98399999999999999},"min":{"1min":0.59599999999999997,"5min":0.56499999999999995,"15min":0.53800000000000003},"max":{"1min":1.171,"5min":15.845000000000001,"15min":15.845000000000001},"last":1.155}]},{"osd":2,"last update":"Sat Jun 10 19:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.94999999999999996,"15min":0.89400000000000002},"min":{"1min":0.59899999999999998,"5min":0.54300000000000004,"15min":0.48299999999999998},"max":{"1min":1.6459999999999999,"5min":5.0049999999999999,"15min":5.0049999999999999},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.99299999999999999,"15min":0.94499999999999995},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.391,"5min":6.851,"15min":6.851},"last":1.127}]},{"osd":3,"last update":"Sat Jun 10 19:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.96799999999999997,"15min":0.95599999999999996},"min":{"1min":0.58699999999999997,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.6910000000000001,"5min":2.544,"15min":2.544},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.98299999999999998,"5min":1.004,"15min":0.999},"min":{"1min":0.66000000000000003,"5min":0.63100000000000001,"15min":0.59799999999999998},"max":{"1min":1.4870000000000001,"5min":3.0830000000000002,"15min":3.0830000000000002},"last":1.294}]},{"osd":4,"last update":"Sat Jun 10 19:05:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.012,"15min":0.95699999999999996},"min":{"1min":0.65300000000000002,"5min":0.64000000000000001,"15min":0.58099999999999996},"max":{"1min":1.6140000000000001,"5min":6.7290000000000001,"15min":6.7290000000000001},"last":1.0629999999999999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.97399999999999998,"15min":0.99399999999999999},"min":{"1min":0.70199999999999996,"5min":0.64900000000000002,"15min":0.61199999999999999},"max":{"1min":1.446,"5min":1.446,"15min":1.575},"last":0.67900000000000005}]},{"osd":6,"last update":"Sat Jun 10 19:05:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":0.98999999999999999,"15min":0.997},"min":{"1min":0.65300000000000002,"5min":0.60499999999999998,"15min":0.54200000000000004},"max":{"1min":1.8009999999999999,"5min":1.8009999999999999,"15min":1.8009999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.105,"15min":1.0600000000000001},"min":{"1min":0.73299999999999998,"5min":0.71999999999999997,"15min":0.57899999999999996},"max":{"1min":1.8380000000000001,"5min":6.923,"15min":6.923},"last":0.85799999999999998}]},{"osd":7,"last update":"Sat Jun 10 19:05:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.101,"15min":1.095},"min":{"1min":0.70699999999999996,"5min":0.69899999999999995,"15min":0.66200000000000003},"max":{"1min":1.7749999999999999,"5min":2.6080000000000001,"15min":2.6080000000000001},"last":1.339},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1850000000000001,"15min":1.143},"min":{"1min":0.84399999999999997,"5min":0.72499999999999998,"15min":0.66200000000000003},"max":{"1min":1.732,"5min":5.4169999999999998,"15min":5.4169999999999998},"last":1.089}]}]},{"osd":4,"up_from":13,"seq":55834575019,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32940,"kb_used_data":1892,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338900,"statfs":{"total":96636764160,"available":96603033600,"internally_reserved":0,"allocated":1937408,"data_stored":899888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:06:06 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.84899999999999998,"15min":0.82799999999999996},"min":{"1min":0.502,"5min":0.45400000000000001,"15min":0.45100000000000001},"max":{"1min":1.1319999999999999,"5min":1.29,"15min":1.29},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.91000000000000003,"15min":0.90800000000000003},"min":{"1min":0.64100000000000001,"5min":0.498,"15min":0.48899999999999999},"max":{"1min":1.1699999999999999,"5min":1.3979999999999999,"15min":3.7280000000000002},"last":1.024}]},{"osd":1,"last update":"Sat Jun 10 19:06:06 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.90700000000000003,"15min":0.93300000000000005},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47599999999999998},"max":{"1min":1.196,"5min":1.3600000000000001,"15min":3.3969999999999998},"last":0.88},{"interface":"front","average":{"1min":0.87,"5min":0.84799999999999998,"15min":0.86199999999999999},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47699999999999998},"max":{"1min":1.1679999999999999,"5min":1.2430000000000001,"15min":2.496},"last":0.90900000000000003}]},{"osd":2,"last update":"Sat Jun 10 19:06:06 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.876,"15min":0.88100000000000001},"min":{"1min":0.52800000000000002,"5min":0.52200000000000002,"15min":0.49299999999999999},"max":{"1min":1.206,"5min":1.3,"15min":1.522},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.97499999999999998,"15min":0.98899999999999999},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.55000000000000004},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":3.5750000000000002},"last":1.1739999999999999}]},{"osd":3,"last update":"Sat Jun 10 19:06:06 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.89000000000000001,"15min":0.89700000000000002},"min":{"1min":0.68200000000000005,"5min":0.56200000000000006,"15min":0.53900000000000003},"max":{"1min":1.0669999999999999,"5min":1.46,"15min":2.3809999999999998},"last":1.056},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95999999999999996,"15min":0.96599999999999997},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.54400000000000004},"max":{"1min":1.2929999999999999,"5min":1.4279999999999999,"15min":1.6479999999999999},"last":0.95099999999999996}]},{"osd":5,"last update":"Sat Jun 10 19:06:06 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.94499999999999995,"15min":0.96099999999999997},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.53100000000000003},"max":{"1min":1.2290000000000001,"5min":1.3260000000000001,"15min":3.6539999999999999},"last":1.224},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.91500000000000004,"15min":0.94299999999999995},"min":{"1min":0.54600000000000004,"5min":0.495,"15min":0.495},"max":{"1min":1.2170000000000001,"5min":1.26,"15min":2.6720000000000002},"last":0.80900000000000005}]},{"osd":6,"last update":"Sat Jun 10 19:06:06 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.97099999999999997,"15min":0.97199999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.2270000000000001,"5min":1.413,"15min":2.2639999999999998},"last":1.0880000000000001},{"interface":"front","average":{"1min":1.036,"5min":1.0720000000000001,"15min":1.069},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.44400000000000001},"max":{"1min":1.3100000000000001,"5min":1.4670000000000001,"15min":3.4980000000000002},"last":1.115}]},{"osd":7,"last update":"Sat Jun 10 19:06:06 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":1.0189999999999999,"15min":0.998},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.41399999999999998},"max":{"1min":1.2370000000000001,"5min":1.3919999999999999,"15min":2.5910000000000002},"last":0.99199999999999999},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.087,"15min":1.071},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.46300000000000002},"max":{"1min":1.635,"5min":1.635,"15min":1.635},"last":1.141}]}]},{"osd":3,"up_from":13,"seq":55834575018,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37028,"kb_used_data":1884,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334812,"statfs":{"total":96636764160,"available":96598847488,"internally_reserved":0,"allocated":1929216,"data_stored":897921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.63900000000000001,"15min":0.62},"min":{"1min":0.42099999999999999,"5min":0.248,"15min":0.248},"max":{"1min":0.99299999999999999,"5min":1.1539999999999999,"15min":1.169},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.67500000000000004,"15min":0.66800000000000004},"min":{"1min":0.318,"5min":0.30299999999999999,"15min":0.251},"max":{"1min":0.96899999999999997,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.73499999999999999}]},{"osd":1,"last update":"Sat Jun 10 19:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.69299999999999995,"15min":0.67900000000000005},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.27500000000000002},"max":{"1min":0.98799999999999999,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.71299999999999997,"15min":0.73199999999999998},"min":{"1min":0.35499999999999998,"5min":0.34399999999999997,"15min":0.318},"max":{"1min":0.89700000000000002,"5min":1.2569999999999999,"15min":1.411},"last":1.1439999999999999}]},{"osd":2,"last update":"Sat Jun 10 19:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.75600000000000001,"15min":0.77400000000000002},"min":{"1min":0.40699999999999997,"5min":0.39300000000000002,"15min":0.30299999999999999},"max":{"1min":1.155,"5min":1.2829999999999999,"15min":1.9530000000000001},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.81299999999999994,"15min":0.79000000000000004},"min":{"1min":0.39200000000000002,"5min":0.35299999999999998,"15min":0.29699999999999999},"max":{"1min":1.2769999999999999,"5min":1.591,"15min":1.591},"last":1}]},{"osd":4,"last update":"Sat Jun 10 19:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.96599999999999997,"15min":0.95599999999999996},"min":{"1min":0.67800000000000005,"5min":0.60899999999999999,"15min":0.41899999999999998},"max":{"1min":1.333,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.98899999999999999,"15min":0.99199999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.47999999999999998},"max":{"1min":1.2110000000000001,"5min":1.873,"15min":1.873},"last":1.089}]},{"osd":5,"last update":"Sat Jun 10 19:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":1.004,"15min":1.0169999999999999},"min":{"1min":0.55900000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.3120000000000001,"5min":1.752,"15min":2.024},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0369999999999999,"15min":1.0309999999999999},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.46899999999999997},"max":{"1min":1.337,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":1.3280000000000001}]},{"osd":6,"last update":"Sat Jun 10 19:05:52 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.0669999999999999,"15min":1.0609999999999999},"min":{"1min":0.625,"5min":0.56999999999999995,"15min":0.55300000000000005},"max":{"1min":1.258,"5min":1.786,"15min":1.8500000000000001},"last":1.2490000000000001},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0589999999999999,"15min":1.0580000000000001},"min":{"1min":0.69499999999999995,"5min":0.61199999999999999,"15min":0.58799999999999997},"max":{"1min":1.3029999999999999,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":1.1899999999999999}]},{"osd":7,"last update":"Sat Jun 10 19:05:52 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.0800000000000001,"15min":1.093},"min":{"1min":0.77200000000000002,"5min":0.57999999999999996,"15min":0.56999999999999995},"max":{"1min":1.27,"5min":2.1150000000000002,"15min":2.1150000000000002},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.089,"15min":1.0960000000000001},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.61099999999999999},"max":{"1min":1.3129999999999999,"5min":1.9850000000000001,"15min":1.9850000000000001},"last":1.216}]}]},{"osd":2,"up_from":13,"seq":55834575019,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32936,"kb_used_data":1888,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338904,"statfs":{"total":96636764160,"available":96603037696,"internally_reserved":0,"allocated":1933312,"data_stored":898436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.65100000000000002,"15min":0.624},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.27300000000000002},"max":{"1min":2.883,"5min":2.883,"15min":2.883},"last":0.65600000000000003},{"interface":"front","average":{"1min":1.0389999999999999,"5min":0.77400000000000002,"15min":0.74299999999999999},"min":{"1min":0.40400000000000003,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":6.5670000000000002,"5min":6.5670000000000002,"15min":6.5670000000000002},"last":0.80300000000000005}]},{"osd":1,"last update":"Sat Jun 10 19:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.65000000000000002,"15min":0.66400000000000003},"min":{"1min":0.32300000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.91000000000000003,"5min":1.0389999999999999,"15min":1.1950000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":1.204,"5min":0.82699999999999996,"15min":0.78400000000000003},"min":{"1min":0.374,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":8.4429999999999996,"5min":8.4429999999999996,"15min":8.4429999999999996},"last":0.91100000000000003}]},{"osd":3,"last update":"Sat Jun 10 19:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80100000000000005,"15min":0.77600000000000002},"min":{"1min":0.40899999999999997,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.105,"5min":1.1899999999999999,"15min":1.2350000000000001},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.78800000000000003,"15min":0.78400000000000003},"min":{"1min":0.42299999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":4.1849999999999996,"5min":4.1849999999999996,"15min":4.1849999999999996},"last":0.84999999999999998}]},{"osd":4,"last update":"Sat Jun 10 19:06:00 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":0.96499999999999997,"15min":0.94099999999999995},"min":{"1min":0.70299999999999996,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":3.996,"5min":3.996,"15min":3.996},"last":1.0349999999999999},{"interface":"front","average":{"1min":1.6759999999999999,"5min":1.1299999999999999,"15min":1.0600000000000001},"min":{"1min":0.53100000000000003,"5min":0.496,"15min":0.496},"max":{"1min":13.254,"5min":13.254,"15min":13.254},"last":1.004}]},{"osd":5,"last update":"Sat Jun 10 19:06:00 2023","interfaces":[{"interface":"back","average":{"1min":1.643,"5min":1.125,"15min":1.0549999999999999},"min":{"1min":0.57999999999999996,"5min":0.55900000000000005,"15min":0.54100000000000004},"max":{"1min":6.9189999999999996,"5min":6.9189999999999996,"15min":6.9189999999999996},"last":1.1040000000000001},{"interface":"front","average":{"1min":2.1299999999999999,"5min":1.2410000000000001,"15min":1.0920000000000001},"min":{"1min":0.72199999999999998,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":15.526,"5min":15.526,"15min":15.526},"last":1.1499999999999999}]},{"osd":6,"last update":"Sat Jun 10 19:06:00 2023","interfaces":[{"interface":"back","average":{"1min":1.5980000000000001,"5min":1.149,"15min":1.083},"min":{"1min":0.74199999999999999,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":8.7089999999999996,"5min":8.7089999999999996,"15min":8.7089999999999996},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.296,"5min":1.0880000000000001,"15min":1.0620000000000001},"min":{"1min":0.63800000000000001,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":6.1299999999999999,"5min":6.1299999999999999,"15min":6.1299999999999999},"last":1.1779999999999999}]},{"osd":7,"last update":"Sat Jun 10 19:06:00 2023","interfaces":[{"interface":"back","average":{"1min":2.2229999999999999,"5min":1.3260000000000001,"15min":1.175},"min":{"1min":0.74099999999999999,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":12.138,"5min":12.138,"15min":12.138},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.105,"15min":1.1100000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.421,"5min":1.657,"15min":1.752},"last":1.2310000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575021,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37024,"kb_used_data":1880,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334816,"statfs":{"total":96636764160,"available":96598851584,"internally_reserved":0,"allocated":1925120,"data_stored":897375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:06:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66300000000000003,"15min":0.67600000000000005},"min":{"1min":0.33600000000000002,"5min":0.32100000000000001,"15min":0.25800000000000001},"max":{"1min":0.97499999999999998,"5min":1.111,"15min":1.288},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.74399999999999999},"min":{"1min":0.35699999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.079,"5min":1.1859999999999999,"15min":1.694},"last":0.79000000000000004}]},{"osd":2,"last update":"Sat Jun 10 19:06:02 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.249},"max":{"1min":0.86099999999999999,"5min":1.0900000000000001,"15min":1.21},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.69999999999999996,"15min":0.71699999999999997},"min":{"1min":0.33000000000000002,"5min":0.32800000000000001,"15min":0.29699999999999999},"max":{"1min":0.89400000000000002,"5min":1.1040000000000001,"15min":1.415},"last":1.0149999999999999}]},{"osd":3,"last update":"Sat Jun 10 19:06:02 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.77300000000000002,"15min":0.78200000000000003},"min":{"1min":0.38200000000000001,"5min":0.34000000000000002,"15min":0.25600000000000001},"max":{"1min":1.0620000000000001,"5min":1.1679999999999999,"15min":1.6299999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.70299999999999996,"15min":0.73599999999999999},"min":{"1min":0.38800000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.1479999999999999,"5min":1.2909999999999999,"15min":2.1749999999999998},"last":0.71999999999999997}]},{"osd":4,"last update":"Sat Jun 10 19:06:02 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.85499999999999998,"15min":0.86299999999999999},"min":{"1min":0.59499999999999997,"5min":0.56399999999999995,"15min":0.53000000000000003},"max":{"1min":1.0309999999999999,"5min":1.343,"15min":1.4930000000000001},"last":0.97399999999999998},{"interface":"front","average":{"1min":1.006,"5min":0.97799999999999998,"15min":1.034},"min":{"1min":0.60299999999999998,"5min":0.47299999999999998,"15min":0.47099999999999997},"max":{"1min":1.3340000000000001,"5min":1.492,"15min":5.8209999999999997},"last":1.1419999999999999}]},{"osd":5,"last update":"Sat Jun 10 19:06:02 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.97199999999999998,"15min":0.998},"min":{"1min":0.63,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.2949999999999999,"5min":1.6299999999999999,"15min":1.8620000000000001},"last":1.0629999999999999},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.94499999999999995,"15min":0.97699999999999998},"min":{"1min":0.56100000000000005,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.194,"5min":1.3220000000000001,"15min":3.089},"last":1.2629999999999999}]},{"osd":6,"last update":"Sat Jun 10 19:06:02 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.99399999999999999,"15min":1.0489999999999999},"min":{"1min":0.61199999999999999,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.238,"5min":1.6759999999999999,"15min":7.2599999999999998},"last":0.90000000000000002},{"interface":"front","average":{"1min":1.0089999999999999,"5min":0.98999999999999999,"15min":1.036},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.2829999999999999,"5min":1.6000000000000001,"15min":9.0069999999999997},"last":1.091}]},{"osd":7,"last update":"Sat Jun 10 19:06:02 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.0449999999999999,"15min":1.0780000000000001},"min":{"1min":0.65300000000000002,"5min":0.58799999999999997,"15min":0.495},"max":{"1min":1.3999999999999999,"5min":1.494,"15min":2.105},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0449999999999999,"15min":1.0800000000000001},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.56699999999999995},"max":{"1min":1.321,"5min":1.5620000000000001,"15min":2.2570000000000001},"last":1.1839999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575020,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37624,"kb_used_data":2480,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334216,"statfs":{"total":96636764160,"available":96598237184,"internally_reserved":0,"allocated":2539520,"data_stored":1489943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jun 10 19:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.63100000000000001,"15min":0.63400000000000001},"min":{"1min":0.46200000000000002,"5min":0.309,"15min":0.248},"max":{"1min":0.92300000000000004,"5min":1.127,"15min":1.127},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.44900000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.028,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.68600000000000005}]},{"osd":2,"last update":"Sat Jun 10 19:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.73999999999999999,"15min":0.71699999999999997},"min":{"1min":0.35199999999999998,"5min":0.33500000000000002,"15min":0.29199999999999998},"max":{"1min":1.0640000000000001,"5min":1.2010000000000001,"15min":1.2829999999999999},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.65000000000000002,"15min":0.65400000000000003},"min":{"1min":0.30199999999999999,"5min":0.28699999999999998,"15min":0.245},"max":{"1min":1.1080000000000001,"5min":1.1779999999999999,"15min":1.371},"last":0.76500000000000001}]},{"osd":3,"last update":"Sat Jun 10 19:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.68300000000000005,"15min":0.68400000000000005},"min":{"1min":0.35499999999999998,"5min":0.30299999999999999,"15min":0.28899999999999998},"max":{"1min":1.133,"5min":1.133,"15min":1.226},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.82599999999999996,"15min":0.82299999999999995},"min":{"1min":0.39100000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.179,"5min":1.742,"15min":1.829},"last":1.02}]},{"osd":4,"last update":"Sat Jun 10 19:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.91700000000000004,"15min":0.92100000000000004},"min":{"1min":0.65600000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.2210000000000001,"5min":1.7250000000000001,"15min":3.0209999999999999},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.98499999999999999,"5min":1.0169999999999999,"15min":1.026},"min":{"1min":0.58799999999999997,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.266,"5min":1.873,"15min":1.9510000000000001},"last":1.1200000000000001}]},{"osd":5,"last update":"Sat Jun 10 19:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.92400000000000004,"15min":0.93600000000000005},"min":{"1min":0.54000000000000004,"5min":0.51200000000000001,"15min":0.45100000000000001},"max":{"1min":1.224,"5min":1.3109999999999999,"15min":1.694},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.98899999999999999,"15min":1.0049999999999999},"min":{"1min":0.60399999999999998,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.278,"5min":1.78,"15min":4.5620000000000003},"last":0.91700000000000004}]},{"osd":6,"last update":"Sat Jun 10 19:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":1.054,"15min":1.073},"min":{"1min":0.628,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.2250000000000001,"5min":1.7909999999999999,"15min":3.5569999999999999},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.99399999999999999,"15min":1.0009999999999999},"min":{"1min":0.71099999999999997,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.2969999999999999,"5min":1.6319999999999999,"15min":1.883},"last":1.054}]},{"osd":7,"last update":"Sat Jun 10 19:06:00 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.0249999999999999,"15min":1.0309999999999999},"min":{"1min":0.61799999999999999,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.375,"5min":1.512,"15min":1.5800000000000001},"last":0.89000000000000001},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0569999999999999,"15min":1.0589999999999999},"min":{"1min":0.67700000000000005,"5min":0.63,"15min":0.58699999999999997},"max":{"1min":1.341,"5min":1.6619999999999999,"15min":1.9830000000000001},"last":1.079}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-10T19:06:37.664 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-10T19:06:37.798 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.798+0000 7f27f6bbd640 1 Processor -- start 2023-06-10T19:06:37.799 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.798+0000 7f27f6bbd640 1 -- start start 2023-06-10T19:06:37.799 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.798+0000 7f27f6bbd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f27f00cc690 0x7f27f00d04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:37.800 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.798+0000 7f27f6bbd640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27f00d0020 con 0x7f27f00ccae0 2023-06-10T19:06:37.800 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.798+0000 7f27f6bbd640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27f00cef40 con 0x7f27f00b3ac0 2023-06-10T19:06:37.800 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.798+0000 7f27f6bbd640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27f00cf220 con 0x7f27f00cc690 2023-06-10T19:06:37.800 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.798+0000 7f27f515a640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f27f00ccae0 0x7f27f00d09f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:37464/0 (socket says 172.21.15.53:37464) 2023-06-10T19:06:37.800 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.798+0000 7f27f515a640 1 -- 172.21.15.53:0/1578360225 learned_addr learned my addr 172.21.15.53:0/1578360225 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:06:37.800 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.798+0000 7f27effff640 1 --2- 172.21.15.53:0/1578360225 >> v2:172.21.15.117:3300/0 conn(0x7f27f00cc690 0x7f27f00d04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:37.801 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.798+0000 7f27ef7fe640 1 -- 172.21.15.53:0/1578360225 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2141221113 0 0) 0x7f27f00d0020 con 0x7f27f00ccae0 2023-06-10T19:06:37.801 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.798+0000 7f27ef7fe640 1 -- 172.21.15.53:0/1578360225 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27dc003530 con 0x7f27f00ccae0 2023-06-10T19:06:37.802 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.798+0000 7f27ef7fe640 1 -- 172.21.15.53:0/1578360225 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1842890199 0 0) 0x7f27dc003530 con 0x7f27f00ccae0 2023-06-10T19:06:37.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.798+0000 7f27ef7fe640 1 -- 172.21.15.53:0/1578360225 >> v2:172.21.15.117:3300/0 conn(0x7f27f00cc690 msgr2=0x7f27f00d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:37.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.798+0000 7f27ef7fe640 1 --2- 172.21.15.53:0/1578360225 >> v2:172.21.15.117:3300/0 conn(0x7f27f00cc690 0x7f27f00d04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:37.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.798+0000 7f27ef7fe640 1 -- 172.21.15.53:0/1578360225 >> v1:172.21.15.117:6789/0 conn(0x7f27f00b3ac0 legacy=0x7f27f00b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:37.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.798+0000 7f27ef7fe640 1 -- 172.21.15.53:0/1578360225 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f00cf500 con 0x7f27f00ccae0 2023-06-10T19:06:37.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.798+0000 7f27ef7fe640 1 -- 172.21.15.53:0/1578360225 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f27e8001680 con 0x7f27f00ccae0 2023-06-10T19:06:37.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.798+0000 7f27ef7fe640 1 -- 172.21.15.53:0/1578360225 >> v1:172.21.15.53:6789/0 conn(0x7f27f00ccae0 legacy=0x7f27f00d09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:37.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.798+0000 7f27ef7fe640 1 --2- 172.21.15.53:0/1578360225 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27dc0039f0 0x7f27dc003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:37.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.798+0000 7f27ef7fe640 1 --2- 172.21.15.53:0/1578360225 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27dc0047d0 0x7f27dc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:37.804 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.798+0000 7f27ef7fe640 1 --2- 172.21.15.53:0/1578360225 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27dc005180 0x7f27dc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:37.804 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.798+0000 7f27ef7fe640 1 -- 172.21.15.53:0/1578360225 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f00cf220 con 0x7f27dc005180 2023-06-10T19:06:37.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.798+0000 7f27ef7fe640 1 -- 172.21.15.53:0/1578360225 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27dc00c060 con 0x7f27dc0047d0 2023-06-10T19:06:37.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.798+0000 7f27ef7fe640 1 -- 172.21.15.53:0/1578360225 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27dc00c220 con 0x7f27dc0039f0 2023-06-10T19:06:37.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.798+0000 7f27f515a640 1 --2- 172.21.15.53:0/1578360225 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27dc005180 0x7f27dc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:37.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.798+0000 7f27effff640 1 --2- 172.21.15.53:0/1578360225 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27dc0047d0 0x7f27dc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:37.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.798+0000 7f27f4959640 1 --2- 172.21.15.53:0/1578360225 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27dc0039f0 0x7f27dc003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:37.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.798+0000 7f27f515a640 1 -- 172.21.15.53:0/1578360225 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27dc0039f0 msgr2=0x7f27dc003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:37.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.798+0000 7f27f515a640 1 --2- 172.21.15.53:0/1578360225 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27dc0039f0 0x7f27dc003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:37.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.798+0000 7f27f515a640 1 -- 172.21.15.53:0/1578360225 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27dc0047d0 msgr2=0x7f27dc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:37.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.798+0000 7f27f515a640 1 --2- 172.21.15.53:0/1578360225 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27dc0047d0 0x7f27dc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:37.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.798+0000 7f27f515a640 1 -- 172.21.15.53:0/1578360225 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27dc003530 con 0x7f27dc005180 2023-06-10T19:06:37.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.798+0000 7f27f4959640 1 --2- 172.21.15.53:0/1578360225 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27dc0039f0 0x7f27dc003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:06:37.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.798+0000 7f27effff640 1 --2- 172.21.15.53:0/1578360225 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27dc0047d0 0x7f27dc004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:06:37.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.802+0000 7f27f515a640 1 -- 172.21.15.53:0/1578360225 reap_dead start 2023-06-10T19:06:37.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.802+0000 7f27f515a640 1 --2- 172.21.15.53:0/1578360225 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27dc005180 0x7f27dc00b990 secure :-1 s=READY pgs=2229 cs=0 l=1 rev1=1 crypto rx=0x7f27e800c240 tx=0x7f27e801cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fa79f1eace2a726 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:37.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.802+0000 7f27ef7fe640 1 -- 172.21.15.53:0/1578360225 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e80a5b40 con 0x7f27dc005180 2023-06-10T19:06:37.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.802+0000 7f27ef7fe640 1 -- 172.21.15.53:0/1578360225 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27e80a5ce0 con 0x7f27dc005180 2023-06-10T19:06:37.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.802+0000 7f27ef7fe640 1 -- 172.21.15.53:0/1578360225 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e8005b20 con 0x7f27dc005180 2023-06-10T19:06:37.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.802+0000 7f27f6bbd640 1 -- 172.21.15.53:0/1578360225 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27dc005180 msgr2=0x7f27dc00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:37.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.802+0000 7f27f6bbd640 1 --2- 172.21.15.53:0/1578360225 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27dc005180 0x7f27dc00b990 secure :-1 s=READY pgs=2229 cs=0 l=1 rev1=1 crypto rx=0x7f27e800c240 tx=0x7f27e801cc40 comp rx=0 tx=0).stop 2023-06-10T19:06:37.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.802+0000 7f27f6bbd640 1 -- 172.21.15.53:0/1578360225 shutdown_connections 2023-06-10T19:06:37.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.802+0000 7f27f6bbd640 1 --2- 172.21.15.53:0/1578360225 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27dc005180 0x7f27dc00b990 unknown :-1 s=CLOSED pgs=2229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:37.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.802+0000 7f27f6bbd640 1 -- 172.21.15.53:0/1578360225 >> 172.21.15.53:0/1578360225 conn(0x7f27f0071790 msgr2=0x7f27f0069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:37.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.802+0000 7f27f6bbd640 1 -- 172.21.15.53:0/1578360225 shutdown_connections 2023-06-10T19:06:37.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.802+0000 7f27f6bbd640 1 -- 172.21.15.53:0/1578360225 wait complete. 2023-06-10T19:06:37.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.802+0000 7f27f6bbd640 1 Processor -- start 2023-06-10T19:06:37.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.802+0000 7f27f6bbd640 1 -- start start 2023-06-10T19:06:37.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.802+0000 7f27f6bbd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27dc005180 0x7f27f01f1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:37.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.802+0000 7f27f6bbd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27f00c7d40 0x7f27f015e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:37.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.802+0000 7f27f6bbd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27f0147420 0x7f27f00d03b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:37.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.802+0000 7f27f6bbd640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f015ecf0 con 0x7f27f00c7d40 2023-06-10T19:06:37.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.802+0000 7f27f6bbd640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f015d9f0 con 0x7f27dc005180 2023-06-10T19:06:37.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.802+0000 7f27f6bbd640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27f015dcd0 con 0x7f27f0147420 2023-06-10T19:06:37.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.802+0000 7f27effff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27f00c7d40 0x7f27f015e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:37.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.802+0000 7f27effff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27f00c7d40 0x7f27f015e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51186/0 (socket says 172.21.15.53:51186) 2023-06-10T19:06:37.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.802+0000 7f27effff640 1 -- 172.21.15.53:0/1803326837 learned_addr learned my addr 172.21.15.53:0/1803326837 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:37.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.802+0000 7f27f4959640 1 --2- 172.21.15.53:0/1803326837 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27dc005180 0x7f27f01f1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:37.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.802+0000 7f27f515a640 1 --2- 172.21.15.53:0/1803326837 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27f0147420 0x7f27f00d03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:37.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.806+0000 7f27effff640 1 -- 172.21.15.53:0/1803326837 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27f0147420 msgr2=0x7f27f00d03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:37.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.806+0000 7f27effff640 1 --2- 172.21.15.53:0/1803326837 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27f0147420 0x7f27f00d03b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:37.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.806+0000 7f27effff640 1 -- 172.21.15.53:0/1803326837 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27dc005180 msgr2=0x7f27f01f1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:37.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.806+0000 7f27effff640 1 --2- 172.21.15.53:0/1803326837 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27dc005180 0x7f27f01f1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:37.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.806+0000 7f27effff640 1 -- 172.21.15.53:0/1803326837 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f015dfb0 con 0x7f27f00c7d40 2023-06-10T19:06:37.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.806+0000 7f27effff640 1 --2- 172.21.15.53:0/1803326837 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27f00c7d40 0x7f27f015e7b0 secure :-1 s=READY pgs=2230 cs=0 l=1 rev1=1 crypto rx=0x7f27e0007f30 tx=0x7f27e0010650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:37.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.806+0000 7f27ed7fa640 1 -- 172.21.15.53:0/1803326837 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e000e050 con 0x7f27f00c7d40 2023-06-10T19:06:37.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.806+0000 7f27ed7fa640 1 -- 172.21.15.53:0/1803326837 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27e000f040 con 0x7f27f00c7d40 2023-06-10T19:06:37.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.806+0000 7f27f6bbd640 1 -- 172.21.15.53:0/1803326837 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27f015e290 con 0x7f27f00c7d40 2023-06-10T19:06:37.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.806+0000 7f27ed7fa640 1 -- 172.21.15.53:0/1803326837 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e0003bc0 con 0x7f27f00c7d40 2023-06-10T19:06:37.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.806+0000 7f27f6bbd640 1 -- 172.21.15.53:0/1803326837 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27f0147890 con 0x7f27f00c7d40 2023-06-10T19:06:37.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.806+0000 7f27f6bbd640 1 -- 172.21.15.53:0/1803326837 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27f004d790 con 0x7f27f00c7d40 2023-06-10T19:06:37.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.806+0000 7f27ed7fa640 1 -- 172.21.15.53:0/1803326837 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f27e0003d20 con 0x7f27f00c7d40 2023-06-10T19:06:37.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.806+0000 7f27ed7fa640 1 --2- 172.21.15.53:0/1803326837 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f27d0066280 0x7f27d0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:37.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.806+0000 7f27ed7fa640 1 -- 172.21.15.53:0/1803326837 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f27e00849d0 con 0x7f27f00c7d40 2023-06-10T19:06:37.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.806+0000 7f27f4959640 1 --2- 172.21.15.53:0/1803326837 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f27d0066280 0x7f27d0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:37.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.806+0000 7f27f4959640 1 --2- 172.21.15.53:0/1803326837 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f27d0066280 0x7f27d0068730 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f27d8000c10 tx=0x7f27d8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:37.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.810+0000 7f27ed7fa640 1 -- 172.21.15.53:0/1803326837 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f27e0051ee0 con 0x7f27f00c7d40 2023-06-10T19:06:37.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.962+0000 7f27f6bbd640 1 -- 172.21.15.53:0/1803326837 --> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f27f00cfcb0 con 0x7f27d0066280 2023-06-10T19:06:37.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.986+0000 7f27ed7fa640 1 -- 172.21.15.53:0/1803326837 <== mgr.4105 v2:172.21.15.117:6832/3061986771 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310506 (secure 0 0 0) 0x7f27d800d050 con 0x7f27d0066280 2023-06-10T19:06:37.990 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:06:37.991 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-06-10T19:06:37.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.990+0000 7f27f6bbd640 1 -- 172.21.15.53:0/1803326837 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f27d0066280 msgr2=0x7f27d0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:37.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.990+0000 7f27f6bbd640 1 --2- 172.21.15.53:0/1803326837 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f27d0066280 0x7f27d0068730 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f27d8000c10 tx=0x7f27d8009040 comp rx=0 tx=0).stop 2023-06-10T19:06:37.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.990+0000 7f27f6bbd640 1 -- 172.21.15.53:0/1803326837 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27f00c7d40 msgr2=0x7f27f015e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:37.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.990+0000 7f27f6bbd640 1 --2- 172.21.15.53:0/1803326837 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27f00c7d40 0x7f27f015e7b0 secure :-1 s=READY pgs=2230 cs=0 l=1 rev1=1 crypto rx=0x7f27e0007f30 tx=0x7f27e0010650 comp rx=0 tx=0).stop 2023-06-10T19:06:37.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.990+0000 7f27f6bbd640 1 -- 172.21.15.53:0/1803326837 shutdown_connections 2023-06-10T19:06:37.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.990+0000 7f27f6bbd640 1 --2- 172.21.15.53:0/1803326837 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f27d0066280 0x7f27d0068730 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:37.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.990+0000 7f27f6bbd640 1 --2- 172.21.15.53:0/1803326837 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27f0147420 0x7f27f00d03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:37.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.990+0000 7f27f6bbd640 1 --2- 172.21.15.53:0/1803326837 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27f00c7d40 0x7f27f015e7b0 unknown :-1 s=CLOSED pgs=2230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:37.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.990+0000 7f27f6bbd640 1 --2- 172.21.15.53:0/1803326837 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27dc005180 0x7f27f01f1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:37.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.990+0000 7f27f6bbd640 1 -- 172.21.15.53:0/1803326837 >> 172.21.15.53:0/1803326837 conn(0x7f27f0071790 msgr2=0x7f27f00b6800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:37.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.990+0000 7f27f6bbd640 1 -- 172.21.15.53:0/1803326837 shutdown_connections 2023-06-10T19:06:37.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:37.990+0000 7f27f6bbd640 1 -- 172.21.15.53:0/1803326837 wait complete. 2023-06-10T19:06:38.009 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":570,"stamp":"2023-06-10T19:06:37.871822+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":276924,"kb_used_data":16252,"kb_used_omap":0,"kb_used_meta":260608,"kb_avail":754697796,"statfs":{"total":773094113280,"available":772810543104,"internally_reserved":0,"allocated":16642048,"data_stored":8368995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":266862592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.147529"},"pg_stats":[{"pgid":"22.3f","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.742525+0000","last_change":"2023-06-10T19:06:28.771286+0000","last_active":"2023-06-10T19:06:29.742525+0000","last_peered":"2023-06-10T19:06:29.742525+0000","last_clean":"2023-06-10T19:06:29.742525+0000","last_became_active":"2023-06-10T19:06:28.770055+0000","last_became_peered":"2023-06-10T19:06:28.770055+0000","last_unstale":"2023-06-10T19:06:29.742525+0000","last_undegraded":"2023-06-10T19:06:29.742525+0000","last_fullsized":"2023-06-10T19:06:29.742525+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:33:17.900642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.819661+0000","last_change":"2023-06-10T19:06:28.785659+0000","last_active":"2023-06-10T19:06:29.819661+0000","last_peered":"2023-06-10T19:06:29.819661+0000","last_clean":"2023-06-10T19:06:29.819661+0000","last_became_active":"2023-06-10T19:06:28.785244+0000","last_became_peered":"2023-06-10T19:06:28.785244+0000","last_unstale":"2023-06-10T19:06:29.819661+0000","last_undegraded":"2023-06-10T19:06:29.819661+0000","last_fullsized":"2023-06-10T19:06:29.819661+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:03:58.780698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.819492+0000","last_change":"2023-06-10T19:06:28.780703+0000","last_active":"2023-06-10T19:06:29.819492+0000","last_peered":"2023-06-10T19:06:29.819492+0000","last_clean":"2023-06-10T19:06:29.819492+0000","last_became_active":"2023-06-10T19:06:28.780391+0000","last_became_peered":"2023-06-10T19:06:28.780391+0000","last_unstale":"2023-06-10T19:06:29.819492+0000","last_undegraded":"2023-06-10T19:06:29.819492+0000","last_fullsized":"2023-06-10T19:06:29.819492+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:11:34.550427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.815816+0000","last_change":"2023-06-10T19:06:28.763970+0000","last_active":"2023-06-10T19:06:29.815816+0000","last_peered":"2023-06-10T19:06:29.815816+0000","last_clean":"2023-06-10T19:06:29.815816+0000","last_became_active":"2023-06-10T19:06:28.763100+0000","last_became_peered":"2023-06-10T19:06:28.763100+0000","last_unstale":"2023-06-10T19:06:29.815816+0000","last_undegraded":"2023-06-10T19:06:29.815816+0000","last_fullsized":"2023-06-10T19:06:29.815816+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:18:39.369943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.817487+0000","last_change":"2023-06-10T19:06:28.769479+0000","last_active":"2023-06-10T19:06:29.817487+0000","last_peered":"2023-06-10T19:06:29.817487+0000","last_clean":"2023-06-10T19:06:29.817487+0000","last_became_active":"2023-06-10T19:06:28.769111+0000","last_became_peered":"2023-06-10T19:06:28.769111+0000","last_unstale":"2023-06-10T19:06:29.817487+0000","last_undegraded":"2023-06-10T19:06:29.817487+0000","last_fullsized":"2023-06-10T19:06:29.817487+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:07:16.703192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.816275+0000","last_change":"2023-06-10T19:06:28.769245+0000","last_active":"2023-06-10T19:06:29.816275+0000","last_peered":"2023-06-10T19:06:29.816275+0000","last_clean":"2023-06-10T19:06:29.816275+0000","last_became_active":"2023-06-10T19:06:28.768967+0000","last_became_peered":"2023-06-10T19:06:28.768967+0000","last_unstale":"2023-06-10T19:06:29.816275+0000","last_undegraded":"2023-06-10T19:06:29.816275+0000","last_fullsized":"2023-06-10T19:06:29.816275+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:13:54.850010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.741483+0000","last_change":"2023-06-10T19:06:28.768609+0000","last_active":"2023-06-10T19:06:29.741483+0000","last_peered":"2023-06-10T19:06:29.741483+0000","last_clean":"2023-06-10T19:06:29.741483+0000","last_became_active":"2023-06-10T19:06:28.767657+0000","last_became_peered":"2023-06-10T19:06:28.767657+0000","last_unstale":"2023-06-10T19:06:29.741483+0000","last_undegraded":"2023-06-10T19:06:29.741483+0000","last_fullsized":"2023-06-10T19:06:29.741483+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:36:00.226299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.739670+0000","last_change":"2023-06-10T19:06:28.748841+0000","last_active":"2023-06-10T19:06:29.739670+0000","last_peered":"2023-06-10T19:06:29.739670+0000","last_clean":"2023-06-10T19:06:29.739670+0000","last_became_active":"2023-06-10T19:06:28.747096+0000","last_became_peered":"2023-06-10T19:06:28.747096+0000","last_unstale":"2023-06-10T19:06:29.739670+0000","last_undegraded":"2023-06-10T19:06:29.739670+0000","last_fullsized":"2023-06-10T19:06:29.739670+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:55:11.732559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.818613+0000","last_change":"2023-06-10T19:06:28.769983+0000","last_active":"2023-06-10T19:06:29.818613+0000","last_peered":"2023-06-10T19:06:29.818613+0000","last_clean":"2023-06-10T19:06:29.818613+0000","last_became_active":"2023-06-10T19:06:28.769700+0000","last_became_peered":"2023-06-10T19:06:28.769700+0000","last_unstale":"2023-06-10T19:06:29.818613+0000","last_undegraded":"2023-06-10T19:06:29.818613+0000","last_fullsized":"2023-06-10T19:06:29.818613+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:06:58.182560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.818860+0000","last_change":"2023-06-10T19:06:28.750068+0000","last_active":"2023-06-10T19:06:29.818860+0000","last_peered":"2023-06-10T19:06:29.818860+0000","last_clean":"2023-06-10T19:06:29.818860+0000","last_became_active":"2023-06-10T19:06:28.749799+0000","last_became_peered":"2023-06-10T19:06:28.749799+0000","last_unstale":"2023-06-10T19:06:29.818860+0000","last_undegraded":"2023-06-10T19:06:29.818860+0000","last_fullsized":"2023-06-10T19:06:29.818860+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:30:43.870504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.816840+0000","last_change":"2023-06-10T19:06:28.787448+0000","last_active":"2023-06-10T19:06:29.816840+0000","last_peered":"2023-06-10T19:06:29.816840+0000","last_clean":"2023-06-10T19:06:29.816840+0000","last_became_active":"2023-06-10T19:06:28.787150+0000","last_became_peered":"2023-06-10T19:06:28.787150+0000","last_unstale":"2023-06-10T19:06:29.816840+0000","last_undegraded":"2023-06-10T19:06:29.816840+0000","last_fullsized":"2023-06-10T19:06:29.816840+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:32:49.755586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.816139+0000","last_change":"2023-06-10T19:06:28.762159+0000","last_active":"2023-06-10T19:06:29.816139+0000","last_peered":"2023-06-10T19:06:29.816139+0000","last_clean":"2023-06-10T19:06:29.816139+0000","last_became_active":"2023-06-10T19:06:28.761356+0000","last_became_peered":"2023-06-10T19:06:28.761356+0000","last_unstale":"2023-06-10T19:06:29.816139+0000","last_undegraded":"2023-06-10T19:06:29.816139+0000","last_fullsized":"2023-06-10T19:06:29.816139+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:17:58.848483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.816814+0000","last_change":"2023-06-10T19:06:28.751078+0000","last_active":"2023-06-10T19:06:29.816814+0000","last_peered":"2023-06-10T19:06:29.816814+0000","last_clean":"2023-06-10T19:06:29.816814+0000","last_became_active":"2023-06-10T19:06:28.750405+0000","last_became_peered":"2023-06-10T19:06:28.750405+0000","last_unstale":"2023-06-10T19:06:29.816814+0000","last_undegraded":"2023-06-10T19:06:29.816814+0000","last_fullsized":"2023-06-10T19:06:29.816814+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:32:00.542354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.817132+0000","last_change":"2023-06-10T19:06:28.776726+0000","last_active":"2023-06-10T19:06:29.817132+0000","last_peered":"2023-06-10T19:06:29.817132+0000","last_clean":"2023-06-10T19:06:29.817132+0000","last_became_active":"2023-06-10T19:06:28.771959+0000","last_became_peered":"2023-06-10T19:06:28.771959+0000","last_unstale":"2023-06-10T19:06:29.817132+0000","last_undegraded":"2023-06-10T19:06:29.817132+0000","last_fullsized":"2023-06-10T19:06:29.817132+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:57:00.817666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.815316+0000","last_change":"2023-06-10T19:06:28.795555+0000","last_active":"2023-06-10T19:06:29.815316+0000","last_peered":"2023-06-10T19:06:29.815316+0000","last_clean":"2023-06-10T19:06:29.815316+0000","last_became_active":"2023-06-10T19:06:28.795121+0000","last_became_peered":"2023-06-10T19:06:28.795121+0000","last_unstale":"2023-06-10T19:06:29.815316+0000","last_undegraded":"2023-06-10T19:06:29.815316+0000","last_fullsized":"2023-06-10T19:06:29.815316+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:02:55.799695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.815797+0000","last_change":"2023-06-10T19:06:28.752151+0000","last_active":"2023-06-10T19:06:29.815797+0000","last_peered":"2023-06-10T19:06:29.815797+0000","last_clean":"2023-06-10T19:06:29.815797+0000","last_became_active":"2023-06-10T19:06:28.751925+0000","last_became_peered":"2023-06-10T19:06:28.751925+0000","last_unstale":"2023-06-10T19:06:29.815797+0000","last_undegraded":"2023-06-10T19:06:29.815797+0000","last_fullsized":"2023-06-10T19:06:29.815797+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:48:39.584975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.816574+0000","last_change":"2023-06-10T19:06:28.754769+0000","last_active":"2023-06-10T19:06:29.816574+0000","last_peered":"2023-06-10T19:06:29.816574+0000","last_clean":"2023-06-10T19:06:29.816574+0000","last_became_active":"2023-06-10T19:06:28.754010+0000","last_became_peered":"2023-06-10T19:06:28.754010+0000","last_unstale":"2023-06-10T19:06:29.816574+0000","last_undegraded":"2023-06-10T19:06:29.816574+0000","last_fullsized":"2023-06-10T19:06:29.816574+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:52:02.662761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.817501+0000","last_change":"2023-06-10T19:06:28.767402+0000","last_active":"2023-06-10T19:06:29.817501+0000","last_peered":"2023-06-10T19:06:29.817501+0000","last_clean":"2023-06-10T19:06:29.817501+0000","last_became_active":"2023-06-10T19:06:28.767059+0000","last_became_peered":"2023-06-10T19:06:28.767059+0000","last_unstale":"2023-06-10T19:06:29.817501+0000","last_undegraded":"2023-06-10T19:06:29.817501+0000","last_fullsized":"2023-06-10T19:06:29.817501+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:16:59.605819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.817399+0000","last_change":"2023-06-10T19:06:28.792444+0000","last_active":"2023-06-10T19:06:29.817399+0000","last_peered":"2023-06-10T19:06:29.817399+0000","last_clean":"2023-06-10T19:06:29.817399+0000","last_became_active":"2023-06-10T19:06:28.791051+0000","last_became_peered":"2023-06-10T19:06:28.791051+0000","last_unstale":"2023-06-10T19:06:29.817399+0000","last_undegraded":"2023-06-10T19:06:29.817399+0000","last_fullsized":"2023-06-10T19:06:29.817399+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:28:36.990605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.735500+0000","last_change":"2023-06-10T19:06:28.745072+0000","last_active":"2023-06-10T19:06:29.735500+0000","last_peered":"2023-06-10T19:06:29.735500+0000","last_clean":"2023-06-10T19:06:29.735500+0000","last_became_active":"2023-06-10T19:06:28.744657+0000","last_became_peered":"2023-06-10T19:06:28.744657+0000","last_unstale":"2023-06-10T19:06:29.735500+0000","last_undegraded":"2023-06-10T19:06:29.735500+0000","last_fullsized":"2023-06-10T19:06:29.735500+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:32:11.219410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.817165+0000","last_change":"2023-06-10T19:06:28.769988+0000","last_active":"2023-06-10T19:06:29.817165+0000","last_peered":"2023-06-10T19:06:29.817165+0000","last_clean":"2023-06-10T19:06:29.817165+0000","last_became_active":"2023-06-10T19:06:28.769685+0000","last_became_peered":"2023-06-10T19:06:28.769685+0000","last_unstale":"2023-06-10T19:06:29.817165+0000","last_undegraded":"2023-06-10T19:06:29.817165+0000","last_fullsized":"2023-06-10T19:06:29.817165+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:21:29.000876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.741829+0000","last_change":"2023-06-10T19:06:28.768803+0000","last_active":"2023-06-10T19:06:29.741829+0000","last_peered":"2023-06-10T19:06:29.741829+0000","last_clean":"2023-06-10T19:06:29.741829+0000","last_became_active":"2023-06-10T19:06:28.767900+0000","last_became_peered":"2023-06-10T19:06:28.767900+0000","last_unstale":"2023-06-10T19:06:29.741829+0000","last_undegraded":"2023-06-10T19:06:29.741829+0000","last_fullsized":"2023-06-10T19:06:29.741829+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:46:58.992630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.739698+0000","last_change":"2023-06-10T19:06:28.777655+0000","last_active":"2023-06-10T19:06:29.739698+0000","last_peered":"2023-06-10T19:06:29.739698+0000","last_clean":"2023-06-10T19:06:29.739698+0000","last_became_active":"2023-06-10T19:06:28.776977+0000","last_became_peered":"2023-06-10T19:06:28.776977+0000","last_unstale":"2023-06-10T19:06:29.739698+0000","last_undegraded":"2023-06-10T19:06:29.739698+0000","last_fullsized":"2023-06-10T19:06:29.739698+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:12:44.430568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.816416+0000","last_change":"2023-06-10T19:06:28.742905+0000","last_active":"2023-06-10T19:06:29.816416+0000","last_peered":"2023-06-10T19:06:29.816416+0000","last_clean":"2023-06-10T19:06:29.816416+0000","last_became_active":"2023-06-10T19:06:28.742168+0000","last_became_peered":"2023-06-10T19:06:28.742168+0000","last_unstale":"2023-06-10T19:06:29.816416+0000","last_undegraded":"2023-06-10T19:06:29.816416+0000","last_fullsized":"2023-06-10T19:06:29.816416+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:47:00.542040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.742812+0000","last_change":"2023-06-10T19:06:28.770760+0000","last_active":"2023-06-10T19:06:29.742812+0000","last_peered":"2023-06-10T19:06:29.742812+0000","last_clean":"2023-06-10T19:06:29.742812+0000","last_became_active":"2023-06-10T19:06:28.767169+0000","last_became_peered":"2023-06-10T19:06:28.767169+0000","last_unstale":"2023-06-10T19:06:29.742812+0000","last_undegraded":"2023-06-10T19:06:29.742812+0000","last_fullsized":"2023-06-10T19:06:29.742812+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:19:31.195637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.742893+0000","last_change":"2023-06-10T19:06:28.766154+0000","last_active":"2023-06-10T19:06:29.742893+0000","last_peered":"2023-06-10T19:06:29.742893+0000","last_clean":"2023-06-10T19:06:29.742893+0000","last_became_active":"2023-06-10T19:06:28.765412+0000","last_became_peered":"2023-06-10T19:06:28.765412+0000","last_unstale":"2023-06-10T19:06:29.742893+0000","last_undegraded":"2023-06-10T19:06:29.742893+0000","last_fullsized":"2023-06-10T19:06:29.742893+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:53:19.560713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.818614+0000","last_change":"2023-06-10T19:06:28.777672+0000","last_active":"2023-06-10T19:06:29.818614+0000","last_peered":"2023-06-10T19:06:29.818614+0000","last_clean":"2023-06-10T19:06:29.818614+0000","last_became_active":"2023-06-10T19:06:28.777456+0000","last_became_peered":"2023-06-10T19:06:28.777456+0000","last_unstale":"2023-06-10T19:06:29.818614+0000","last_undegraded":"2023-06-10T19:06:29.818614+0000","last_fullsized":"2023-06-10T19:06:29.818614+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:57:52.226395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.816822+0000","last_change":"2023-06-10T19:06:28.746273+0000","last_active":"2023-06-10T19:06:29.816822+0000","last_peered":"2023-06-10T19:06:29.816822+0000","last_clean":"2023-06-10T19:06:29.816822+0000","last_became_active":"2023-06-10T19:06:28.746021+0000","last_became_peered":"2023-06-10T19:06:28.746021+0000","last_unstale":"2023-06-10T19:06:29.816822+0000","last_undegraded":"2023-06-10T19:06:29.816822+0000","last_fullsized":"2023-06-10T19:06:29.816822+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:04:50.164507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.741380+0000","last_change":"2023-06-10T19:06:28.747840+0000","last_active":"2023-06-10T19:06:29.741380+0000","last_peered":"2023-06-10T19:06:29.741380+0000","last_clean":"2023-06-10T19:06:29.741380+0000","last_became_active":"2023-06-10T19:06:28.746680+0000","last_became_peered":"2023-06-10T19:06:28.746680+0000","last_unstale":"2023-06-10T19:06:29.741380+0000","last_undegraded":"2023-06-10T19:06:29.741380+0000","last_fullsized":"2023-06-10T19:06:29.741380+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:13:54.850010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.817184+0000","last_change":"2023-06-10T19:06:28.755925+0000","last_active":"2023-06-10T19:06:29.817184+0000","last_peered":"2023-06-10T19:06:29.817184+0000","last_clean":"2023-06-10T19:06:29.817184+0000","last_became_active":"2023-06-10T19:06:28.755672+0000","last_became_peered":"2023-06-10T19:06:28.755672+0000","last_unstale":"2023-06-10T19:06:29.817184+0000","last_undegraded":"2023-06-10T19:06:29.817184+0000","last_fullsized":"2023-06-10T19:06:29.817184+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:09:17.141142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.816364+0000","last_change":"2023-06-10T19:06:28.739753+0000","last_active":"2023-06-10T19:06:29.816364+0000","last_peered":"2023-06-10T19:06:29.816364+0000","last_clean":"2023-06-10T19:06:29.816364+0000","last_became_active":"2023-06-10T19:06:28.739483+0000","last_became_peered":"2023-06-10T19:06:28.739483+0000","last_unstale":"2023-06-10T19:06:29.816364+0000","last_undegraded":"2023-06-10T19:06:29.816364+0000","last_fullsized":"2023-06-10T19:06:29.816364+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:20:22.974358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.739738+0000","last_change":"2023-06-10T19:06:28.748006+0000","last_active":"2023-06-10T19:06:29.739738+0000","last_peered":"2023-06-10T19:06:29.739738+0000","last_clean":"2023-06-10T19:06:29.739738+0000","last_became_active":"2023-06-10T19:06:28.746995+0000","last_became_peered":"2023-06-10T19:06:28.746995+0000","last_unstale":"2023-06-10T19:06:29.739738+0000","last_undegraded":"2023-06-10T19:06:29.739738+0000","last_fullsized":"2023-06-10T19:06:29.739738+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:34:27.539951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.818409+0000","last_change":"2023-06-10T19:06:28.778542+0000","last_active":"2023-06-10T19:06:29.818409+0000","last_peered":"2023-06-10T19:06:29.818409+0000","last_clean":"2023-06-10T19:06:29.818409+0000","last_became_active":"2023-06-10T19:06:28.778261+0000","last_became_peered":"2023-06-10T19:06:28.778261+0000","last_unstale":"2023-06-10T19:06:29.818409+0000","last_undegraded":"2023-06-10T19:06:29.818409+0000","last_fullsized":"2023-06-10T19:06:29.818409+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:36:00.226299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"153'4","reported_seq":17,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.818959+0000","last_change":"2023-06-10T19:06:28.361549+0000","last_active":"2023-06-10T19:06:29.818959+0000","last_peered":"2023-06-10T19:06:29.818959+0000","last_clean":"2023-06-10T19:06:29.818959+0000","last_became_active":"2023-06-10T19:06:28.359070+0000","last_became_peered":"2023-06-10T19:06:28.359070+0000","last_unstale":"2023-06-10T19:06:29.818959+0000","last_undegraded":"2023-06-10T19:06:29.818959+0000","last_fullsized":"2023-06-10T19:06:29.818959+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:28:51.414484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.819506+0000","last_change":"2023-06-10T19:06:28.785530+0000","last_active":"2023-06-10T19:06:29.819506+0000","last_peered":"2023-06-10T19:06:29.819506+0000","last_clean":"2023-06-10T19:06:29.819506+0000","last_became_active":"2023-06-10T19:06:28.785265+0000","last_became_peered":"2023-06-10T19:06:28.785265+0000","last_unstale":"2023-06-10T19:06:29.819506+0000","last_undegraded":"2023-06-10T19:06:29.819506+0000","last_fullsized":"2023-06-10T19:06:29.819506+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:35:01.491376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"153'1","reported_seq":14,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.815691+0000","last_change":"2023-06-10T19:06:28.387547+0000","last_active":"2023-06-10T19:06:29.815691+0000","last_peered":"2023-06-10T19:06:29.815691+0000","last_clean":"2023-06-10T19:06:29.815691+0000","last_became_active":"2023-06-10T19:06:28.386957+0000","last_became_peered":"2023-06-10T19:06:28.386957+0000","last_unstale":"2023-06-10T19:06:29.815691+0000","last_undegraded":"2023-06-10T19:06:29.815691+0000","last_fullsized":"2023-06-10T19:06:29.815691+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:56:47.937613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.740356+0000","last_change":"2023-06-10T19:06:28.759941+0000","last_active":"2023-06-10T19:06:29.740356+0000","last_peered":"2023-06-10T19:06:29.740356+0000","last_clean":"2023-06-10T19:06:29.740356+0000","last_became_active":"2023-06-10T19:06:28.758907+0000","last_became_peered":"2023-06-10T19:06:28.758907+0000","last_unstale":"2023-06-10T19:06:29.740356+0000","last_undegraded":"2023-06-10T19:06:29.740356+0000","last_fullsized":"2023-06-10T19:06:29.740356+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:31:26.250900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"153'2","reported_seq":15,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.817151+0000","last_change":"2023-06-10T19:06:28.387277+0000","last_active":"2023-06-10T19:06:29.817151+0000","last_peered":"2023-06-10T19:06:29.817151+0000","last_clean":"2023-06-10T19:06:29.817151+0000","last_became_active":"2023-06-10T19:06:28.386787+0000","last_became_peered":"2023-06-10T19:06:28.386787+0000","last_unstale":"2023-06-10T19:06:29.817151+0000","last_undegraded":"2023-06-10T19:06:29.817151+0000","last_fullsized":"2023-06-10T19:06:29.817151+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:10:00.641667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.817359+0000","last_change":"2023-06-10T19:06:28.795152+0000","last_active":"2023-06-10T19:06:29.817359+0000","last_peered":"2023-06-10T19:06:29.817359+0000","last_clean":"2023-06-10T19:06:29.817359+0000","last_became_active":"2023-06-10T19:06:28.794621+0000","last_became_peered":"2023-06-10T19:06:28.794621+0000","last_unstale":"2023-06-10T19:06:29.817359+0000","last_undegraded":"2023-06-10T19:06:29.817359+0000","last_fullsized":"2023-06-10T19:06:29.817359+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:17:50.360480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"153'2","reported_seq":15,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.818947+0000","last_change":"2023-06-10T19:06:28.381539+0000","last_active":"2023-06-10T19:06:29.818947+0000","last_peered":"2023-06-10T19:06:29.818947+0000","last_clean":"2023-06-10T19:06:29.818947+0000","last_became_active":"2023-06-10T19:06:28.381072+0000","last_became_peered":"2023-06-10T19:06:28.381072+0000","last_unstale":"2023-06-10T19:06:29.818947+0000","last_undegraded":"2023-06-10T19:06:29.818947+0000","last_fullsized":"2023-06-10T19:06:29.818947+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:46:57.990068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.735246+0000","last_change":"2023-06-10T19:06:28.744109+0000","last_active":"2023-06-10T19:06:29.735246+0000","last_peered":"2023-06-10T19:06:29.735246+0000","last_clean":"2023-06-10T19:06:29.735246+0000","last_became_active":"2023-06-10T19:06:28.743610+0000","last_became_peered":"2023-06-10T19:06:28.743610+0000","last_unstale":"2023-06-10T19:06:29.735246+0000","last_undegraded":"2023-06-10T19:06:29.735246+0000","last_fullsized":"2023-06-10T19:06:29.735246+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:57:00.817666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"153'1","reported_seq":14,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.741606+0000","last_change":"2023-06-10T19:06:28.362338+0000","last_active":"2023-06-10T19:06:29.741606+0000","last_peered":"2023-06-10T19:06:29.741606+0000","last_clean":"2023-06-10T19:06:29.741606+0000","last_became_active":"2023-06-10T19:06:28.360739+0000","last_became_peered":"2023-06-10T19:06:28.360739+0000","last_unstale":"2023-06-10T19:06:29.741606+0000","last_undegraded":"2023-06-10T19:06:29.741606+0000","last_fullsized":"2023-06-10T19:06:29.741606+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:20:21.971797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.816884+0000","last_change":"2023-06-10T19:06:28.755807+0000","last_active":"2023-06-10T19:06:29.816884+0000","last_peered":"2023-06-10T19:06:29.816884+0000","last_clean":"2023-06-10T19:06:29.816884+0000","last_became_active":"2023-06-10T19:06:28.754868+0000","last_became_peered":"2023-06-10T19:06:28.754868+0000","last_unstale":"2023-06-10T19:06:29.816884+0000","last_undegraded":"2023-06-10T19:06:29.816884+0000","last_fullsized":"2023-06-10T19:06:29.816884+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:27:42.233003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1a","version":"153'1","reported_seq":14,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.816851+0000","last_change":"2023-06-10T19:06:28.363282+0000","last_active":"2023-06-10T19:06:29.816851+0000","last_peered":"2023-06-10T19:06:29.816851+0000","last_clean":"2023-06-10T19:06:29.816851+0000","last_became_active":"2023-06-10T19:06:28.362706+0000","last_became_peered":"2023-06-10T19:06:28.362706+0000","last_unstale":"2023-06-10T19:06:29.816851+0000","last_undegraded":"2023-06-10T19:06:29.816851+0000","last_fullsized":"2023-06-10T19:06:29.816851+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:07:39.505674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.815136+0000","last_change":"2023-06-10T19:06:28.745329+0000","last_active":"2023-06-10T19:06:29.815136+0000","last_peered":"2023-06-10T19:06:29.815136+0000","last_clean":"2023-06-10T19:06:29.815136+0000","last_became_active":"2023-06-10T19:06:28.745050+0000","last_became_peered":"2023-06-10T19:06:28.745050+0000","last_unstale":"2023-06-10T19:06:29.815136+0000","last_undegraded":"2023-06-10T19:06:29.815136+0000","last_fullsized":"2023-06-10T19:06:29.815136+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:29:57.951463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.741468+0000","last_change":"2023-06-10T19:06:28.379064+0000","last_active":"2023-06-10T19:06:29.741468+0000","last_peered":"2023-06-10T19:06:29.741468+0000","last_clean":"2023-06-10T19:06:29.741468+0000","last_became_active":"2023-06-10T19:06:28.378372+0000","last_became_peered":"2023-06-10T19:06:28.378372+0000","last_unstale":"2023-06-10T19:06:29.741468+0000","last_undegraded":"2023-06-10T19:06:29.741468+0000","last_fullsized":"2023-06-10T19:06:29.741468+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:16:05.108766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.742347+0000","last_change":"2023-06-10T19:06:28.769293+0000","last_active":"2023-06-10T19:06:29.742347+0000","last_peered":"2023-06-10T19:06:29.742347+0000","last_clean":"2023-06-10T19:06:29.742347+0000","last_became_active":"2023-06-10T19:06:28.768567+0000","last_became_peered":"2023-06-10T19:06:28.768567+0000","last_unstale":"2023-06-10T19:06:29.742347+0000","last_undegraded":"2023-06-10T19:06:29.742347+0000","last_fullsized":"2023-06-10T19:06:29.742347+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:35:01.491376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.816086+0000","last_change":"2023-06-10T19:06:28.378370+0000","last_active":"2023-06-10T19:06:29.816086+0000","last_peered":"2023-06-10T19:06:29.816086+0000","last_clean":"2023-06-10T19:06:29.816086+0000","last_became_active":"2023-06-10T19:06:28.377853+0000","last_became_peered":"2023-06-10T19:06:28.377853+0000","last_unstale":"2023-06-10T19:06:29.816086+0000","last_undegraded":"2023-06-10T19:06:29.816086+0000","last_fullsized":"2023-06-10T19:06:29.816086+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:16:43.381255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.816525+0000","last_change":"2023-06-10T19:06:28.787738+0000","last_active":"2023-06-10T19:06:29.816525+0000","last_peered":"2023-06-10T19:06:29.816525+0000","last_clean":"2023-06-10T19:06:29.816525+0000","last_became_active":"2023-06-10T19:06:28.787004+0000","last_became_peered":"2023-06-10T19:06:28.787004+0000","last_unstale":"2023-06-10T19:06:29.816525+0000","last_undegraded":"2023-06-10T19:06:29.816525+0000","last_fullsized":"2023-06-10T19:06:29.816525+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:08:25.504629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"153'1","reported_seq":14,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.817177+0000","last_change":"2023-06-10T19:06:28.376382+0000","last_active":"2023-06-10T19:06:29.817177+0000","last_peered":"2023-06-10T19:06:29.817177+0000","last_clean":"2023-06-10T19:06:29.817177+0000","last_became_active":"2023-06-10T19:06:28.376019+0000","last_became_peered":"2023-06-10T19:06:28.376019+0000","last_unstale":"2023-06-10T19:06:29.817177+0000","last_undegraded":"2023-06-10T19:06:29.817177+0000","last_fullsized":"2023-06-10T19:06:29.817177+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:30:45.559203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.816916+0000","last_change":"2023-06-10T19:06:28.794391+0000","last_active":"2023-06-10T19:06:29.816916+0000","last_peered":"2023-06-10T19:06:29.816916+0000","last_clean":"2023-06-10T19:06:29.816916+0000","last_became_active":"2023-06-10T19:06:28.793148+0000","last_became_peered":"2023-06-10T19:06:28.793148+0000","last_unstale":"2023-06-10T19:06:29.816916+0000","last_undegraded":"2023-06-10T19:06:29.816916+0000","last_fullsized":"2023-06-10T19:06:29.816916+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:57:36.035948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"153'2","reported_seq":15,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.816046+0000","last_change":"2023-06-10T19:06:28.361366+0000","last_active":"2023-06-10T19:06:29.816046+0000","last_peered":"2023-06-10T19:06:29.816046+0000","last_clean":"2023-06-10T19:06:29.816046+0000","last_became_active":"2023-06-10T19:06:28.360578+0000","last_became_peered":"2023-06-10T19:06:28.360578+0000","last_unstale":"2023-06-10T19:06:29.816046+0000","last_undegraded":"2023-06-10T19:06:29.816046+0000","last_fullsized":"2023-06-10T19:06:29.816046+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:11:44.455139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.742876+0000","last_change":"2023-06-10T19:06:28.774574+0000","last_active":"2023-06-10T19:06:29.742876+0000","last_peered":"2023-06-10T19:06:29.742876+0000","last_clean":"2023-06-10T19:06:29.742876+0000","last_became_active":"2023-06-10T19:06:28.773861+0000","last_became_peered":"2023-06-10T19:06:28.773861+0000","last_unstale":"2023-06-10T19:06:29.742876+0000","last_undegraded":"2023-06-10T19:06:29.742876+0000","last_fullsized":"2023-06-10T19:06:29.742876+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:59:13.222474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"153'1","reported_seq":14,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.819738+0000","last_change":"2023-06-10T19:06:28.362909+0000","last_active":"2023-06-10T19:06:29.819738+0000","last_peered":"2023-06-10T19:06:29.819738+0000","last_clean":"2023-06-10T19:06:29.819738+0000","last_became_active":"2023-06-10T19:06:28.362297+0000","last_became_peered":"2023-06-10T19:06:28.362297+0000","last_unstale":"2023-06-10T19:06:29.819738+0000","last_undegraded":"2023-06-10T19:06:29.819738+0000","last_fullsized":"2023-06-10T19:06:29.819738+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:19:30.193076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.742883+0000","last_change":"2023-06-10T19:06:28.797277+0000","last_active":"2023-06-10T19:06:29.742883+0000","last_peered":"2023-06-10T19:06:29.742883+0000","last_clean":"2023-06-10T19:06:29.742883+0000","last_became_active":"2023-06-10T19:06:28.796739+0000","last_became_peered":"2023-06-10T19:06:28.796739+0000","last_unstale":"2023-06-10T19:06:29.742883+0000","last_undegraded":"2023-06-10T19:06:29.742883+0000","last_fullsized":"2023-06-10T19:06:29.742883+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:54:43.414642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.816346+0000","last_change":"2023-06-10T19:06:28.375260+0000","last_active":"2023-06-10T19:06:29.816346+0000","last_peered":"2023-06-10T19:06:29.816346+0000","last_clean":"2023-06-10T19:06:29.816346+0000","last_became_active":"2023-06-10T19:06:28.374564+0000","last_became_peered":"2023-06-10T19:06:28.374564+0000","last_unstale":"2023-06-10T19:06:29.816346+0000","last_undegraded":"2023-06-10T19:06:29.816346+0000","last_fullsized":"2023-06-10T19:06:29.816346+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:07:17.695664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.815456+0000","last_change":"2023-06-10T19:06:28.790693+0000","last_active":"2023-06-10T19:06:29.815456+0000","last_peered":"2023-06-10T19:06:29.815456+0000","last_clean":"2023-06-10T19:06:29.815456+0000","last_became_active":"2023-06-10T19:06:28.790142+0000","last_became_peered":"2023-06-10T19:06:28.790142+0000","last_unstale":"2023-06-10T19:06:29.815456+0000","last_undegraded":"2023-06-10T19:06:29.815456+0000","last_fullsized":"2023-06-10T19:06:29.815456+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:32:03.590928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"153'2","reported_seq":15,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.735466+0000","last_change":"2023-06-10T19:06:28.360853+0000","last_active":"2023-06-10T19:06:29.735466+0000","last_peered":"2023-06-10T19:06:29.735466+0000","last_clean":"2023-06-10T19:06:29.735466+0000","last_became_active":"2023-06-10T19:06:28.360580+0000","last_became_peered":"2023-06-10T19:06:28.360580+0000","last_unstale":"2023-06-10T19:06:29.735466+0000","last_undegraded":"2023-06-10T19:06:29.735466+0000","last_fullsized":"2023-06-10T19:06:29.735466+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:47:03.626499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.815643+0000","last_change":"2023-06-10T19:06:28.779975+0000","last_active":"2023-06-10T19:06:29.815643+0000","last_peered":"2023-06-10T19:06:29.815643+0000","last_clean":"2023-06-10T19:06:29.815643+0000","last_became_active":"2023-06-10T19:06:28.779641+0000","last_became_peered":"2023-06-10T19:06:28.779641+0000","last_unstale":"2023-06-10T19:06:29.815643+0000","last_undegraded":"2023-06-10T19:06:29.815643+0000","last_fullsized":"2023-06-10T19:06:29.815643+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:08:24.612209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.740027+0000","last_change":"2023-06-10T19:06:28.370275+0000","last_active":"2023-06-10T19:06:29.740027+0000","last_peered":"2023-06-10T19:06:29.740027+0000","last_clean":"2023-06-10T19:06:29.740027+0000","last_became_active":"2023-06-10T19:06:28.369565+0000","last_became_peered":"2023-06-10T19:06:28.369565+0000","last_unstale":"2023-06-10T19:06:29.740027+0000","last_undegraded":"2023-06-10T19:06:29.740027+0000","last_fullsized":"2023-06-10T19:06:29.740027+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:44:57.816682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.815722+0000","last_change":"2023-06-10T19:06:28.787202+0000","last_active":"2023-06-10T19:06:29.815722+0000","last_peered":"2023-06-10T19:06:29.815722+0000","last_clean":"2023-06-10T19:06:29.815722+0000","last_became_active":"2023-06-10T19:06:28.786442+0000","last_became_peered":"2023-06-10T19:06:28.786442+0000","last_unstale":"2023-06-10T19:06:29.815722+0000","last_undegraded":"2023-06-10T19:06:29.815722+0000","last_fullsized":"2023-06-10T19:06:29.815722+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:02:04.709298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.735271+0000","last_change":"2023-06-10T19:06:28.360981+0000","last_active":"2023-06-10T19:06:29.735271+0000","last_peered":"2023-06-10T19:06:29.735271+0000","last_clean":"2023-06-10T19:06:29.735271+0000","last_became_active":"2023-06-10T19:06:28.359939+0000","last_became_peered":"2023-06-10T19:06:28.359939+0000","last_unstale":"2023-06-10T19:06:29.735271+0000","last_undegraded":"2023-06-10T19:06:29.735271+0000","last_fullsized":"2023-06-10T19:06:29.735271+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:33:39.166739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.818762+0000","last_change":"2023-06-10T19:06:28.786698+0000","last_active":"2023-06-10T19:06:29.818762+0000","last_peered":"2023-06-10T19:06:29.818762+0000","last_clean":"2023-06-10T19:06:29.818762+0000","last_became_active":"2023-06-10T19:06:28.785937+0000","last_became_peered":"2023-06-10T19:06:28.785937+0000","last_unstale":"2023-06-10T19:06:29.818762+0000","last_undegraded":"2023-06-10T19:06:29.818762+0000","last_fullsized":"2023-06-10T19:06:29.818762+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:40:25.451299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.740317+0000","last_change":"2023-06-10T19:06:28.371414+0000","last_active":"2023-06-10T19:06:29.740317+0000","last_peered":"2023-06-10T19:06:29.740317+0000","last_clean":"2023-06-10T19:06:29.740317+0000","last_became_active":"2023-06-10T19:06:28.370691+0000","last_became_peered":"2023-06-10T19:06:28.370691+0000","last_unstale":"2023-06-10T19:06:29.740317+0000","last_undegraded":"2023-06-10T19:06:29.740317+0000","last_fullsized":"2023-06-10T19:06:29.740317+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:06:33.893531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.815989+0000","last_change":"2023-06-10T19:06:28.766856+0000","last_active":"2023-06-10T19:06:29.815989+0000","last_peered":"2023-06-10T19:06:29.815989+0000","last_clean":"2023-06-10T19:06:29.815989+0000","last_became_active":"2023-06-10T19:06:28.766558+0000","last_became_peered":"2023-06-10T19:06:28.766558+0000","last_unstale":"2023-06-10T19:06:29.815989+0000","last_undegraded":"2023-06-10T19:06:29.815989+0000","last_fullsized":"2023-06-10T19:06:29.815989+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:53:06.418851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"153'2","reported_seq":15,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.816704+0000","last_change":"2023-06-10T19:06:28.381155+0000","last_active":"2023-06-10T19:06:29.816704+0000","last_peered":"2023-06-10T19:06:29.816704+0000","last_clean":"2023-06-10T19:06:29.816704+0000","last_became_active":"2023-06-10T19:06:28.380459+0000","last_became_peered":"2023-06-10T19:06:28.380459+0000","last_unstale":"2023-06-10T19:06:29.816704+0000","last_undegraded":"2023-06-10T19:06:29.816704+0000","last_fullsized":"2023-06-10T19:06:29.816704+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:32:05.470611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.816533+0000","last_change":"2023-06-10T19:06:28.776676+0000","last_active":"2023-06-10T19:06:29.816533+0000","last_peered":"2023-06-10T19:06:29.816533+0000","last_clean":"2023-06-10T19:06:29.816533+0000","last_became_active":"2023-06-10T19:06:28.771861+0000","last_became_peered":"2023-06-10T19:06:28.771861+0000","last_unstale":"2023-06-10T19:06:29.816533+0000","last_undegraded":"2023-06-10T19:06:29.816533+0000","last_fullsized":"2023-06-10T19:06:29.816533+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:03:55.555134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"154'1","reported_seq":14,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.743341+0000","last_change":"2023-06-10T19:06:28.383932+0000","last_active":"2023-06-10T19:06:29.743341+0000","last_peered":"2023-06-10T19:06:29.743341+0000","last_clean":"2023-06-10T19:06:29.743341+0000","last_became_active":"2023-06-10T19:06:28.383270+0000","last_became_peered":"2023-06-10T19:06:28.383270+0000","last_unstale":"2023-06-10T19:06:29.743341+0000","last_undegraded":"2023-06-10T19:06:29.743341+0000","last_fullsized":"2023-06-10T19:06:29.743341+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:05:30.785228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.743238+0000","last_change":"2023-06-10T19:06:28.766095+0000","last_active":"2023-06-10T19:06:29.743238+0000","last_peered":"2023-06-10T19:06:29.743238+0000","last_clean":"2023-06-10T19:06:29.743238+0000","last_became_active":"2023-06-10T19:06:28.765343+0000","last_became_peered":"2023-06-10T19:06:28.765343+0000","last_unstale":"2023-06-10T19:06:29.743238+0000","last_undegraded":"2023-06-10T19:06:29.743238+0000","last_fullsized":"2023-06-10T19:06:29.743238+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:55:36.049949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.819796+0000","last_change":"2023-06-10T19:06:28.371204+0000","last_active":"2023-06-10T19:06:29.819796+0000","last_peered":"2023-06-10T19:06:29.819796+0000","last_clean":"2023-06-10T19:06:29.819796+0000","last_became_active":"2023-06-10T19:06:28.370793+0000","last_became_peered":"2023-06-10T19:06:28.370793+0000","last_unstale":"2023-06-10T19:06:29.819796+0000","last_undegraded":"2023-06-10T19:06:29.819796+0000","last_fullsized":"2023-06-10T19:06:29.819796+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:59:12.219912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.818647+0000","last_change":"2023-06-10T19:06:28.755865+0000","last_active":"2023-06-10T19:06:29.818647+0000","last_peered":"2023-06-10T19:06:29.818647+0000","last_clean":"2023-06-10T19:06:29.818647+0000","last_became_active":"2023-06-10T19:06:28.755384+0000","last_became_peered":"2023-06-10T19:06:28.755384+0000","last_unstale":"2023-06-10T19:06:29.818647+0000","last_undegraded":"2023-06-10T19:06:29.818647+0000","last_fullsized":"2023-06-10T19:06:29.818647+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:47:30.126259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.818388+0000","last_change":"2023-06-10T19:06:28.374175+0000","last_active":"2023-06-10T19:06:29.818388+0000","last_peered":"2023-06-10T19:06:29.818388+0000","last_clean":"2023-06-10T19:06:29.818388+0000","last_became_active":"2023-06-10T19:06:28.373842+0000","last_became_peered":"2023-06-10T19:06:28.373842+0000","last_unstale":"2023-06-10T19:06:29.818388+0000","last_undegraded":"2023-06-10T19:06:29.818388+0000","last_fullsized":"2023-06-10T19:06:29.818388+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:34:25.166808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.740122+0000","last_change":"2023-06-10T19:06:28.746364+0000","last_active":"2023-06-10T19:06:29.740122+0000","last_peered":"2023-06-10T19:06:29.740122+0000","last_clean":"2023-06-10T19:06:29.740122+0000","last_became_active":"2023-06-10T19:06:28.745341+0000","last_became_peered":"2023-06-10T19:06:28.745341+0000","last_unstale":"2023-06-10T19:06:29.740122+0000","last_undegraded":"2023-06-10T19:06:29.740122+0000","last_fullsized":"2023-06-10T19:06:29.740122+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:46:09.212467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.742112+0000","last_change":"2023-06-10T19:06:28.386971+0000","last_active":"2023-06-10T19:06:29.742112+0000","last_peered":"2023-06-10T19:06:29.742112+0000","last_clean":"2023-06-10T19:06:29.742112+0000","last_became_active":"2023-06-10T19:06:28.386521+0000","last_became_peered":"2023-06-10T19:06:28.386521+0000","last_unstale":"2023-06-10T19:06:29.742112+0000","last_undegraded":"2023-06-10T19:06:29.742112+0000","last_fullsized":"2023-06-10T19:06:29.742112+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:37:09.449195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.815381+0000","last_change":"2023-06-10T19:06:28.761972+0000","last_active":"2023-06-10T19:06:29.815381+0000","last_peered":"2023-06-10T19:06:29.815381+0000","last_clean":"2023-06-10T19:06:29.815381+0000","last_became_active":"2023-06-10T19:06:28.755251+0000","last_became_peered":"2023-06-10T19:06:28.755251+0000","last_unstale":"2023-06-10T19:06:29.815381+0000","last_undegraded":"2023-06-10T19:06:29.815381+0000","last_fullsized":"2023-06-10T19:06:29.815381+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:01:22.398136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.817403+0000","last_change":"2023-06-10T19:06:28.379787+0000","last_active":"2023-06-10T19:06:29.817403+0000","last_peered":"2023-06-10T19:06:29.817403+0000","last_clean":"2023-06-10T19:06:29.817403+0000","last_became_active":"2023-06-10T19:06:28.379364+0000","last_became_peered":"2023-06-10T19:06:28.379364+0000","last_unstale":"2023-06-10T19:06:29.817403+0000","last_undegraded":"2023-06-10T19:06:29.817403+0000","last_fullsized":"2023-06-10T19:06:29.817403+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:39:52.105903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.818307+0000","last_change":"2023-06-10T19:06:28.751726+0000","last_active":"2023-06-10T19:06:29.818307+0000","last_peered":"2023-06-10T19:06:29.818307+0000","last_clean":"2023-06-10T19:06:29.818307+0000","last_became_active":"2023-06-10T19:06:28.751388+0000","last_became_peered":"2023-06-10T19:06:28.751388+0000","last_unstale":"2023-06-10T19:06:29.818307+0000","last_undegraded":"2023-06-10T19:06:29.818307+0000","last_fullsized":"2023-06-10T19:06:29.818307+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:20:33.075170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.741678+0000","last_change":"2023-06-10T19:06:28.379674+0000","last_active":"2023-06-10T19:06:29.741678+0000","last_peered":"2023-06-10T19:06:29.741678+0000","last_clean":"2023-06-10T19:06:29.741678+0000","last_became_active":"2023-06-10T19:06:28.378954+0000","last_became_peered":"2023-06-10T19:06:28.378954+0000","last_unstale":"2023-06-10T19:06:29.741678+0000","last_undegraded":"2023-06-10T19:06:29.741678+0000","last_fullsized":"2023-06-10T19:06:29.741678+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:40:24.448737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.740882+0000","last_change":"2023-06-10T19:06:28.747513+0000","last_active":"2023-06-10T19:06:29.740882+0000","last_peered":"2023-06-10T19:06:29.740882+0000","last_clean":"2023-06-10T19:06:29.740882+0000","last_became_active":"2023-06-10T19:06:28.746692+0000","last_became_peered":"2023-06-10T19:06:28.746692+0000","last_unstale":"2023-06-10T19:06:29.740882+0000","last_undegraded":"2023-06-10T19:06:29.740882+0000","last_fullsized":"2023-06-10T19:06:29.740882+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:16:44.383817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.815681+0000","last_change":"2023-06-10T19:06:28.366358+0000","last_active":"2023-06-10T19:06:29.815681+0000","last_peered":"2023-06-10T19:06:29.815681+0000","last_clean":"2023-06-10T19:06:29.815681+0000","last_became_active":"2023-06-10T19:06:28.365633+0000","last_became_peered":"2023-06-10T19:06:28.365633+0000","last_unstale":"2023-06-10T19:06:29.815681+0000","last_undegraded":"2023-06-10T19:06:29.815681+0000","last_fullsized":"2023-06-10T19:06:29.815681+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:53:54.090645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.740566+0000","last_change":"2023-06-10T19:06:28.744385+0000","last_active":"2023-06-10T19:06:29.740566+0000","last_peered":"2023-06-10T19:06:29.740566+0000","last_clean":"2023-06-10T19:06:29.740566+0000","last_became_active":"2023-06-10T19:06:28.743587+0000","last_became_peered":"2023-06-10T19:06:28.743587+0000","last_unstale":"2023-06-10T19:06:29.740566+0000","last_undegraded":"2023-06-10T19:06:29.740566+0000","last_fullsized":"2023-06-10T19:06:29.740566+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:53:06.418851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"153'6","reported_seq":19,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.735390+0000","last_change":"2023-06-10T19:06:28.360862+0000","last_active":"2023-06-10T19:06:29.735390+0000","last_peered":"2023-06-10T19:06:29.735390+0000","last_clean":"2023-06-10T19:06:29.735390+0000","last_became_active":"2023-06-10T19:06:28.359953+0000","last_became_peered":"2023-06-10T19:06:28.359953+0000","last_unstale":"2023-06-10T19:06:29.735390+0000","last_undegraded":"2023-06-10T19:06:29.735390+0000","last_fullsized":"2023-06-10T19:06:29.735390+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:36:43.229767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":396,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.816440+0000","last_change":"2023-06-10T18:52:34.951528+0000","last_active":"2023-06-10T19:06:29.816440+0000","last_peered":"2023-06-10T19:06:29.816440+0000","last_clean":"2023-06-10T19:06:29.816440+0000","last_became_active":"2023-06-10T18:52:34.949099+0000","last_became_peered":"2023-06-10T18:52:34.949099+0000","last_unstale":"2023-06-10T19:06:29.816440+0000","last_undegraded":"2023-06-10T19:06:29.816440+0000","last_fullsized":"2023-06-10T19:06:29.816440+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_clean_scrub_stamp":"2023-06-10T18:52:33.633295+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:49:47.533676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":261,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.742402+0000","last_change":"2023-06-10T18:52:40.506384+0000","last_active":"2023-06-10T19:06:29.742402+0000","last_peered":"2023-06-10T19:06:29.742402+0000","last_clean":"2023-06-10T19:06:29.742402+0000","last_became_active":"2023-06-10T18:52:40.505701+0000","last_became_peered":"2023-06-10T18:52:40.505701+0000","last_unstale":"2023-06-10T19:06:29.742402+0000","last_undegraded":"2023-06-10T19:06:29.742402+0000","last_fullsized":"2023-06-10T19:06:29.742402+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:50:09.928994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.740497+0000","last_change":"2023-06-10T19:06:28.781491+0000","last_active":"2023-06-10T19:06:29.740497+0000","last_peered":"2023-06-10T19:06:29.740497+0000","last_clean":"2023-06-10T19:06:29.740497+0000","last_became_active":"2023-06-10T19:06:28.780751+0000","last_became_peered":"2023-06-10T19:06:28.780751+0000","last_unstale":"2023-06-10T19:06:29.740497+0000","last_undegraded":"2023-06-10T19:06:29.740497+0000","last_fullsized":"2023-06-10T19:06:29.740497+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:48:39.584975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.817306+0000","last_change":"2023-06-10T19:06:28.366139+0000","last_active":"2023-06-10T19:06:29.817306+0000","last_peered":"2023-06-10T19:06:29.817306+0000","last_clean":"2023-06-10T19:06:29.817306+0000","last_became_active":"2023-06-10T19:06:28.365460+0000","last_became_peered":"2023-06-10T19:06:28.365460+0000","last_unstale":"2023-06-10T19:06:29.817306+0000","last_undegraded":"2023-06-10T19:06:29.817306+0000","last_fullsized":"2023-06-10T19:06:29.817306+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:46:47.381771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":239,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.816027+0000","last_change":"2023-06-10T18:52:40.512015+0000","last_active":"2023-06-10T19:06:29.816027+0000","last_peered":"2023-06-10T19:06:29.816027+0000","last_clean":"2023-06-10T19:06:29.816027+0000","last_became_active":"2023-06-10T18:52:40.511382+0000","last_became_peered":"2023-06-10T18:52:40.511382+0000","last_unstale":"2023-06-10T19:06:29.816027+0000","last_undegraded":"2023-06-10T19:06:29.816027+0000","last_fullsized":"2023-06-10T19:06:29.816027+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:15:25.480469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.817282+0000","last_change":"2023-06-10T19:06:28.780318+0000","last_active":"2023-06-10T19:06:29.817282+0000","last_peered":"2023-06-10T19:06:29.817282+0000","last_clean":"2023-06-10T19:06:29.817282+0000","last_became_active":"2023-06-10T19:06:28.779806+0000","last_became_peered":"2023-06-10T19:06:28.779806+0000","last_unstale":"2023-06-10T19:06:29.817282+0000","last_undegraded":"2023-06-10T19:06:29.817282+0000","last_fullsized":"2023-06-10T19:06:29.817282+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:06:15.891044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.743141+0000","last_change":"2023-06-10T19:06:28.381480+0000","last_active":"2023-06-10T19:06:29.743141+0000","last_peered":"2023-06-10T19:06:29.743141+0000","last_clean":"2023-06-10T19:06:29.743141+0000","last_became_active":"2023-06-10T19:06:28.380221+0000","last_became_peered":"2023-06-10T19:06:28.380221+0000","last_unstale":"2023-06-10T19:06:29.743141+0000","last_undegraded":"2023-06-10T19:06:29.743141+0000","last_fullsized":"2023-06-10T19:06:29.743141+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:05:07.876924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":259,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.815656+0000","last_change":"2023-06-10T18:52:40.671725+0000","last_active":"2023-06-10T19:06:29.815656+0000","last_peered":"2023-06-10T19:06:29.815656+0000","last_clean":"2023-06-10T19:06:29.815656+0000","last_became_active":"2023-06-10T18:52:40.671442+0000","last_became_peered":"2023-06-10T18:52:40.671442+0000","last_unstale":"2023-06-10T19:06:29.815656+0000","last_undegraded":"2023-06-10T19:06:29.815656+0000","last_fullsized":"2023-06-10T19:06:29.815656+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:35:55.010336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.817830+0000","last_change":"2023-06-10T19:06:28.767649+0000","last_active":"2023-06-10T19:06:29.817830+0000","last_peered":"2023-06-10T19:06:29.817830+0000","last_clean":"2023-06-10T19:06:29.817830+0000","last_became_active":"2023-06-10T19:06:28.767162+0000","last_became_peered":"2023-06-10T19:06:28.767162+0000","last_unstale":"2023-06-10T19:06:29.817830+0000","last_undegraded":"2023-06-10T19:06:29.817830+0000","last_fullsized":"2023-06-10T19:06:29.817830+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:18:24.609690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"153'3","reported_seq":16,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.817162+0000","last_change":"2023-06-10T19:06:28.356792+0000","last_active":"2023-06-10T19:06:29.817162+0000","last_peered":"2023-06-10T19:06:29.817162+0000","last_clean":"2023-06-10T19:06:29.817162+0000","last_became_active":"2023-06-10T19:06:28.355531+0000","last_became_peered":"2023-06-10T19:06:28.355531+0000","last_unstale":"2023-06-10T19:06:29.817162+0000","last_undegraded":"2023-06-10T19:06:29.817162+0000","last_fullsized":"2023-06-10T19:06:29.817162+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:53:49.382226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":261,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.741984+0000","last_change":"2023-06-10T18:52:40.510258+0000","last_active":"2023-06-10T19:06:29.741984+0000","last_peered":"2023-06-10T19:06:29.741984+0000","last_clean":"2023-06-10T19:06:29.741984+0000","last_became_active":"2023-06-10T18:52:40.509560+0000","last_became_peered":"2023-06-10T18:52:40.509560+0000","last_unstale":"2023-06-10T19:06:29.741984+0000","last_undegraded":"2023-06-10T19:06:29.741984+0000","last_fullsized":"2023-06-10T19:06:29.741984+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:57:45.698722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.740102+0000","last_change":"2023-06-10T19:06:28.775041+0000","last_active":"2023-06-10T19:06:29.740102+0000","last_peered":"2023-06-10T19:06:29.740102+0000","last_clean":"2023-06-10T19:06:29.740102+0000","last_became_active":"2023-06-10T19:06:28.773161+0000","last_became_peered":"2023-06-10T19:06:28.773161+0000","last_unstale":"2023-06-10T19:06:29.740102+0000","last_undegraded":"2023-06-10T19:06:29.740102+0000","last_fullsized":"2023-06-10T19:06:29.740102+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:19:29.967777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"153'2","reported_seq":15,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.817830+0000","last_change":"2023-06-10T19:06:28.356032+0000","last_active":"2023-06-10T19:06:29.817830+0000","last_peered":"2023-06-10T19:06:29.817830+0000","last_clean":"2023-06-10T19:06:29.817830+0000","last_became_active":"2023-06-10T19:06:28.355800+0000","last_became_peered":"2023-06-10T19:06:28.355800+0000","last_unstale":"2023-06-10T19:06:29.817830+0000","last_undegraded":"2023-06-10T19:06:29.817830+0000","last_fullsized":"2023-06-10T19:06:29.817830+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:10:06.928207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":239,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.819332+0000","last_change":"2023-06-10T18:52:40.672266+0000","last_active":"2023-06-10T19:06:29.819332+0000","last_peered":"2023-06-10T19:06:29.819332+0000","last_clean":"2023-06-10T19:06:29.819332+0000","last_became_active":"2023-06-10T18:52:40.671966+0000","last_became_peered":"2023-06-10T18:52:40.671966+0000","last_unstale":"2023-06-10T19:06:29.819332+0000","last_undegraded":"2023-06-10T19:06:29.819332+0000","last_fullsized":"2023-06-10T19:06:29.819332+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:23:21.600052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.817735+0000","last_change":"2023-06-10T19:06:28.795427+0000","last_active":"2023-06-10T19:06:29.817735+0000","last_peered":"2023-06-10T19:06:29.817735+0000","last_clean":"2023-06-10T19:06:29.817735+0000","last_became_active":"2023-06-10T19:06:28.795077+0000","last_became_peered":"2023-06-10T19:06:28.795077+0000","last_unstale":"2023-06-10T19:06:29.817735+0000","last_undegraded":"2023-06-10T19:06:29.817735+0000","last_fullsized":"2023-06-10T19:06:29.817735+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:18:39.937587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.815315+0000","last_change":"2023-06-10T19:06:28.381830+0000","last_active":"2023-06-10T19:06:29.815315+0000","last_peered":"2023-06-10T19:06:29.815315+0000","last_clean":"2023-06-10T19:06:29.815315+0000","last_became_active":"2023-06-10T19:06:28.380345+0000","last_became_peered":"2023-06-10T19:06:28.380345+0000","last_unstale":"2023-06-10T19:06:29.815315+0000","last_undegraded":"2023-06-10T19:06:29.815315+0000","last_fullsized":"2023-06-10T19:06:29.815315+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:56:55.672876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":239,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.817471+0000","last_change":"2023-06-10T18:52:40.671084+0000","last_active":"2023-06-10T19:06:29.817471+0000","last_peered":"2023-06-10T19:06:29.817471+0000","last_clean":"2023-06-10T19:06:29.817471+0000","last_became_active":"2023-06-10T18:52:40.670697+0000","last_became_peered":"2023-06-10T18:52:40.670697+0000","last_unstale":"2023-06-10T19:06:29.817471+0000","last_undegraded":"2023-06-10T19:06:29.817471+0000","last_fullsized":"2023-06-10T19:06:29.817471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:30:59.333653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.816611+0000","last_change":"2023-06-10T19:06:28.736426+0000","last_active":"2023-06-10T19:06:29.816611+0000","last_peered":"2023-06-10T19:06:29.816611+0000","last_clean":"2023-06-10T19:06:29.816611+0000","last_became_active":"2023-06-10T19:06:28.736098+0000","last_became_peered":"2023-06-10T19:06:28.736098+0000","last_unstale":"2023-06-10T19:06:29.816611+0000","last_undegraded":"2023-06-10T19:06:29.816611+0000","last_fullsized":"2023-06-10T19:06:29.816611+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:39:03.014139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.815621+0000","last_change":"2023-06-10T19:06:28.368131+0000","last_active":"2023-06-10T19:06:29.815621+0000","last_peered":"2023-06-10T19:06:29.815621+0000","last_clean":"2023-06-10T19:06:29.815621+0000","last_became_active":"2023-06-10T19:06:28.367449+0000","last_became_peered":"2023-06-10T19:06:28.367449+0000","last_unstale":"2023-06-10T19:06:29.815621+0000","last_undegraded":"2023-06-10T19:06:29.815621+0000","last_fullsized":"2023-06-10T19:06:29.815621+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:22:10.806617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":239,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.819665+0000","last_change":"2023-06-10T18:52:40.514114+0000","last_active":"2023-06-10T19:06:29.819665+0000","last_peered":"2023-06-10T19:06:29.819665+0000","last_clean":"2023-06-10T19:06:29.819665+0000","last_became_active":"2023-06-10T18:52:40.513638+0000","last_became_peered":"2023-06-10T18:52:40.513638+0000","last_unstale":"2023-06-10T19:06:29.819665+0000","last_undegraded":"2023-06-10T19:06:29.819665+0000","last_fullsized":"2023-06-10T19:06:29.819665+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:19:29.048938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":11,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.818424+0000","last_change":"2023-06-10T19:06:28.771489+0000","last_active":"2023-06-10T19:06:29.818424+0000","last_peered":"2023-06-10T19:06:29.818424+0000","last_clean":"2023-06-10T19:06:29.818424+0000","last_became_active":"2023-06-10T19:06:28.771174+0000","last_became_peered":"2023-06-10T19:06:28.771174+0000","last_unstale":"2023-06-10T19:06:29.818424+0000","last_undegraded":"2023-06-10T19:06:29.818424+0000","last_fullsized":"2023-06-10T19:06:29.818424+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:28.326546+0000","last_clean_scrub_stamp":"2023-06-10T19:06:28.326546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:16:06.111327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"153'8","reported_seq":21,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.740652+0000","last_change":"2023-06-10T19:06:28.384158+0000","last_active":"2023-06-10T19:06:29.740652+0000","last_peered":"2023-06-10T19:06:29.740652+0000","last_clean":"2023-06-10T19:06:29.740652+0000","last_became_active":"2023-06-10T19:06:28.383394+0000","last_became_peered":"2023-06-10T19:06:28.383394+0000","last_unstale":"2023-06-10T19:06:29.740652+0000","last_undegraded":"2023-06-10T19:06:29.740652+0000","last_fullsized":"2023-06-10T19:06:29.740652+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:06:27.323985+0000","last_clean_scrub_stamp":"2023-06-10T19:06:27.323985+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:20:32.072608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":241,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-06-10T19:06:29.816792+0000","last_change":"2023-06-10T18:52:40.515396+0000","last_active":"2023-06-10T19:06:29.816792+0000","last_peered":"2023-06-10T19:06:29.816792+0000","last_clean":"2023-06-10T19:06:29.816792+0000","last_became_active":"2023-06-10T18:52:40.514663+0000","last_became_peered":"2023-06-10T18:52:40.514663+0000","last_unstale":"2023-06-10T19:06:29.816792+0000","last_undegraded":"2023-06-10T19:06:29.816792+0000","last_fullsized":"2023-06-10T19:06:29.816792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:37:15.549708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575020,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33512,"kb_used_data":2464,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338328,"statfs":{"total":96636764160,"available":96602447872,"internally_reserved":0,"allocated":2523136,"data_stored":1488714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:06:01 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":0.96199999999999997,"15min":0.92900000000000005},"min":{"1min":0.70499999999999996,"5min":0.49399999999999999,"15min":0.434},"max":{"1min":1.522,"5min":1.522,"15min":1.6220000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.92100000000000004,"15min":0.92700000000000005},"min":{"1min":0.52800000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.6870000000000001},"last":0.98899999999999999}]},{"osd":1,"last update":"Sat Jun 10 19:06:01 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.91000000000000003,"15min":0.92000000000000004},"min":{"1min":0.56999999999999995,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1879999999999999,"5min":1.238,"15min":1.377},"last":1.0920000000000001},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.92800000000000005,"15min":0.94199999999999995},"min":{"1min":0.67800000000000005,"5min":0.51300000000000001,"15min":0.504},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.5960000000000001},"last":1.2889999999999999}]},{"osd":2,"last update":"Sat Jun 10 19:06:01 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.88100000000000001,"15min":0.85299999999999998},"min":{"1min":0.60999999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.4059999999999999},"last":1.2370000000000001},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.91000000000000003,"15min":0.89800000000000002},"min":{"1min":0.61399999999999999,"5min":0.54100000000000004,"15min":0.50600000000000001},"max":{"1min":1.129,"5min":1.448,"15min":1.448},"last":0.93500000000000005}]},{"osd":3,"last update":"Sat Jun 10 19:06:01 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.91300000000000003,"15min":0.92100000000000004},"min":{"1min":0.75800000000000001,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.502},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.97399999999999998,"15min":0.95699999999999996},"min":{"1min":0.58599999999999997,"5min":0.432,"15min":0.432},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":1.2}]},{"osd":4,"last update":"Sat Jun 10 19:06:01 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.81599999999999995,"15min":0.84499999999999997},"min":{"1min":0.60299999999999998,"5min":0.307,"15min":0.307},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.639},"last":1.1639999999999999},{"interface":"front","average":{"1min":1.054,"5min":0.98499999999999999,"15min":0.96999999999999997},"min":{"1min":0.80200000000000005,"5min":0.41199999999999998,"15min":0.40000000000000002},"max":{"1min":1.3540000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.0509999999999999}]},{"osd":5,"last update":"Sat Jun 10 19:06:01 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":1.0049999999999999,"15min":1.006},"min":{"1min":0.64000000000000001,"5min":0.45100000000000001,"15min":0.38400000000000001},"max":{"1min":1.385,"5min":1.385,"15min":1.806},"last":1.268},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.03,"15min":1.0349999999999999},"min":{"1min":0.69699999999999995,"5min":0.48499999999999999,"15min":0.46500000000000002},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":1.137}]},{"osd":6,"last update":"Sat Jun 10 19:06:01 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.999,"15min":1.004},"min":{"1min":0.67400000000000004,"5min":0.47699999999999998,"15min":0.35999999999999999},"max":{"1min":1.3149999999999999,"5min":1.391,"15min":1.718},"last":1.3600000000000001},{"interface":"front","average":{"1min":1.127,"5min":1.1020000000000001,"15min":1.097},"min":{"1min":0.82499999999999996,"5min":0.504,"15min":0.441},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":1.333}]}]},{"osd":6,"up_from":13,"seq":55834575021,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32932,"kb_used_data":1884,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338908,"statfs":{"total":96636764160,"available":96603041792,"internally_reserved":0,"allocated":1929216,"data_stored":898394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:05:53 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83799999999999997,"15min":0.85999999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.1839999999999999,"5min":1.2450000000000001,"15min":1.498},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.86199999999999999,"15min":0.879},"min":{"1min":0.57099999999999995,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.496},"last":1.103}]},{"osd":1,"last update":"Sat Jun 10 19:05:53 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.84999999999999998,"15min":0.86699999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.5229999999999999},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.89500000000000002,"15min":0.89900000000000002},"min":{"1min":0.66000000000000003,"5min":0.48699999999999999,"15min":0.45300000000000001},"max":{"1min":1.341,"5min":1.341,"15min":1.778},"last":1.1279999999999999}]},{"osd":2,"last update":"Sat Jun 10 19:05:53 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.91400000000000003,"15min":0.89900000000000002},"min":{"1min":0.51200000000000001,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.224,"5min":1.2809999999999999,"15min":1.3759999999999999},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.86699999999999999,"15min":0.88500000000000001},"min":{"1min":0.60499999999999998,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.1220000000000001,"5min":1.2330000000000001,"15min":1.246},"last":0.96499999999999997}]},{"osd":3,"last update":"Sat Jun 10 19:05:53 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.55900000000000005,"5min":0.55100000000000005,"15min":0.52700000000000002},"max":{"1min":1.202,"5min":1.238,"15min":1.7190000000000001},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.96299999999999997,"15min":0.98299999999999998},"min":{"1min":0.61599999999999999,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.198,"5min":1.371,"15min":1.4370000000000001},"last":1.155}]},{"osd":4,"last update":"Sat Jun 10 19:05:53 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.90600000000000003,"15min":0.91200000000000003},"min":{"1min":0.48499999999999999,"5min":0.373,"15min":0.373},"max":{"1min":1.248,"5min":1.401,"15min":1.798},"last":1.071},{"interface":"front","average":{"1min":1.032,"5min":0.99399999999999999,"15min":0.98899999999999999},"min":{"1min":0.60399999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.371,"5min":1.371,"15min":1.5489999999999999},"last":0.85099999999999998}]},{"osd":5,"last update":"Sat Jun 10 19:05:53 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.89700000000000002,"15min":0.91500000000000004},"min":{"1min":0.66000000000000003,"5min":0.437,"15min":0.437},"max":{"1min":1.1950000000000001,"5min":1.29,"15min":1.333},"last":0.81899999999999995},{"interface":"front","average":{"1min":1.0109999999999999,"5min":0.997,"15min":1.0209999999999999},"min":{"1min":0.63100000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.256,"5min":1.296,"15min":2.536},"last":1.012}]},{"osd":7,"last update":"Sat Jun 10 19:05:53 2023","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.054,"15min":1.0329999999999999},"min":{"1min":0.73999999999999999,"5min":0.58599999999999997,"15min":0.57099999999999995},"max":{"1min":1.2929999999999999,"5min":1.879,"15min":1.917},"last":1.046},{"interface":"front","average":{"1min":0.998,"5min":0.98899999999999999,"15min":1.012},"min":{"1min":0.64000000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.345,"5min":1.4850000000000001,"15min":1.5569999999999999},"last":0.68899999999999995}]}]},{"osd":5,"up_from":13,"seq":55834575021,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32928,"kb_used_data":1880,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338912,"statfs":{"total":96636764160,"available":96603045888,"internally_reserved":0,"allocated":1925120,"data_stored":898324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.877,"15min":0.873},"min":{"1min":0.51500000000000001,"5min":0.499,"15min":0.499},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.94199999999999995,"15min":0.91800000000000004},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.49399999999999999},"max":{"1min":1.212,"5min":2.347,"15min":2.347},"last":1.071}]},{"osd":1,"last update":"Sat Jun 10 19:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.96299999999999997,"15min":0.91900000000000004},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.52600000000000002},"max":{"1min":1.6739999999999999,"5min":7.0800000000000001,"15min":7.0800000000000001},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.86499999999999999,"5min":1.117,"15min":0.98399999999999999},"min":{"1min":0.59599999999999997,"5min":0.56499999999999995,"15min":0.53800000000000003},"max":{"1min":1.171,"5min":15.845000000000001,"15min":15.845000000000001},"last":0.86299999999999999}]},{"osd":2,"last update":"Sat Jun 10 19:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.94999999999999996,"15min":0.89400000000000002},"min":{"1min":0.59899999999999998,"5min":0.54300000000000004,"15min":0.48299999999999998},"max":{"1min":1.6459999999999999,"5min":5.0049999999999999,"15min":5.0049999999999999},"last":1.204},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.99299999999999999,"15min":0.94499999999999995},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.391,"5min":6.851,"15min":6.851},"last":0.78900000000000003}]},{"osd":3,"last update":"Sat Jun 10 19:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.96799999999999997,"15min":0.95599999999999996},"min":{"1min":0.58699999999999997,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.6910000000000001,"5min":2.544,"15min":2.544},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.98299999999999998,"5min":1.004,"15min":0.999},"min":{"1min":0.66000000000000003,"5min":0.63100000000000001,"15min":0.59799999999999998},"max":{"1min":1.4870000000000001,"5min":3.0830000000000002,"15min":3.0830000000000002},"last":1.264}]},{"osd":4,"last update":"Sat Jun 10 19:05:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.012,"15min":0.95699999999999996},"min":{"1min":0.65300000000000002,"5min":0.64000000000000001,"15min":0.58099999999999996},"max":{"1min":1.6140000000000001,"5min":6.7290000000000001,"15min":6.7290000000000001},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.97399999999999998,"15min":0.99399999999999999},"min":{"1min":0.70199999999999996,"5min":0.64900000000000002,"15min":0.61199999999999999},"max":{"1min":1.446,"5min":1.446,"15min":1.575},"last":1.2869999999999999}]},{"osd":6,"last update":"Sat Jun 10 19:05:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":0.98999999999999999,"15min":0.997},"min":{"1min":0.65300000000000002,"5min":0.60499999999999998,"15min":0.54200000000000004},"max":{"1min":1.8009999999999999,"5min":1.8009999999999999,"15min":1.8009999999999999},"last":1.327},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.105,"15min":1.0600000000000001},"min":{"1min":0.73299999999999998,"5min":0.71999999999999997,"15min":0.57899999999999996},"max":{"1min":1.8380000000000001,"5min":6.923,"15min":6.923},"last":1.048}]},{"osd":7,"last update":"Sat Jun 10 19:05:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.101,"15min":1.095},"min":{"1min":0.70699999999999996,"5min":0.69899999999999995,"15min":0.66200000000000003},"max":{"1min":1.7749999999999999,"5min":2.6080000000000001,"15min":2.6080000000000001},"last":1.1279999999999999},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1850000000000001,"15min":1.143},"min":{"1min":0.84399999999999997,"5min":0.72499999999999998,"15min":0.66200000000000003},"max":{"1min":1.732,"5min":5.4169999999999998,"15min":5.4169999999999998},"last":1.3859999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575020,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32940,"kb_used_data":1892,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338900,"statfs":{"total":96636764160,"available":96603033600,"internally_reserved":0,"allocated":1937408,"data_stored":899888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:06:06 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.84899999999999998,"15min":0.82799999999999996},"min":{"1min":0.502,"5min":0.45400000000000001,"15min":0.45100000000000001},"max":{"1min":1.1319999999999999,"5min":1.29,"15min":1.29},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.91000000000000003,"15min":0.90800000000000003},"min":{"1min":0.64100000000000001,"5min":0.498,"15min":0.48899999999999999},"max":{"1min":1.1699999999999999,"5min":1.3979999999999999,"15min":3.7280000000000002},"last":1.0489999999999999}]},{"osd":1,"last update":"Sat Jun 10 19:06:06 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.90700000000000003,"15min":0.93300000000000005},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47599999999999998},"max":{"1min":1.196,"5min":1.3600000000000001,"15min":3.3969999999999998},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.87,"5min":0.84799999999999998,"15min":0.86199999999999999},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47699999999999998},"max":{"1min":1.1679999999999999,"5min":1.2430000000000001,"15min":2.496},"last":0.94999999999999996}]},{"osd":2,"last update":"Sat Jun 10 19:06:06 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.876,"15min":0.88100000000000001},"min":{"1min":0.52800000000000002,"5min":0.52200000000000002,"15min":0.49299999999999999},"max":{"1min":1.206,"5min":1.3,"15min":1.522},"last":1.1339999999999999},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.97499999999999998,"15min":0.98899999999999999},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.55000000000000004},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":3.5750000000000002},"last":1.0009999999999999}]},{"osd":3,"last update":"Sat Jun 10 19:06:06 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.89000000000000001,"15min":0.89700000000000002},"min":{"1min":0.68200000000000005,"5min":0.56200000000000006,"15min":0.53900000000000003},"max":{"1min":1.0669999999999999,"5min":1.46,"15min":2.3809999999999998},"last":1.0229999999999999},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95999999999999996,"15min":0.96599999999999997},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.54400000000000004},"max":{"1min":1.2929999999999999,"5min":1.4279999999999999,"15min":1.6479999999999999},"last":1.075}]},{"osd":5,"last update":"Sat Jun 10 19:06:06 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.94499999999999995,"15min":0.96099999999999997},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.53100000000000003},"max":{"1min":1.2290000000000001,"5min":1.3260000000000001,"15min":3.6539999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.91500000000000004,"15min":0.94299999999999995},"min":{"1min":0.54600000000000004,"5min":0.495,"15min":0.495},"max":{"1min":1.2170000000000001,"5min":1.26,"15min":2.6720000000000002},"last":0.77300000000000002}]},{"osd":6,"last update":"Sat Jun 10 19:06:06 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.97099999999999997,"15min":0.97199999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.2270000000000001,"5min":1.413,"15min":2.2639999999999998},"last":0.84699999999999998},{"interface":"front","average":{"1min":1.036,"5min":1.0720000000000001,"15min":1.069},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.44400000000000001},"max":{"1min":1.3100000000000001,"5min":1.4670000000000001,"15min":3.4980000000000002},"last":0.81799999999999995}]},{"osd":7,"last update":"Sat Jun 10 19:06:06 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":1.0189999999999999,"15min":0.998},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.41399999999999998},"max":{"1min":1.2370000000000001,"5min":1.3919999999999999,"15min":2.5910000000000002},"last":0.89500000000000002},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.087,"15min":1.071},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.46300000000000002},"max":{"1min":1.635,"5min":1.635,"15min":1.635},"last":1.181}]}]},{"osd":3,"up_from":13,"seq":55834575019,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37028,"kb_used_data":1884,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334812,"statfs":{"total":96636764160,"available":96598847488,"internally_reserved":0,"allocated":1929216,"data_stored":897921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.63900000000000001,"15min":0.62},"min":{"1min":0.42099999999999999,"5min":0.248,"15min":0.248},"max":{"1min":0.99299999999999999,"5min":1.1539999999999999,"15min":1.169},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.67500000000000004,"15min":0.66800000000000004},"min":{"1min":0.318,"5min":0.30299999999999999,"15min":0.251},"max":{"1min":0.96899999999999997,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.60499999999999998}]},{"osd":1,"last update":"Sat Jun 10 19:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.69299999999999995,"15min":0.67900000000000005},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.27500000000000002},"max":{"1min":0.98799999999999999,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.71299999999999997,"15min":0.73199999999999998},"min":{"1min":0.35499999999999998,"5min":0.34399999999999997,"15min":0.318},"max":{"1min":0.89700000000000002,"5min":1.2569999999999999,"15min":1.411},"last":0.71299999999999997}]},{"osd":2,"last update":"Sat Jun 10 19:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.75600000000000001,"15min":0.77400000000000002},"min":{"1min":0.40699999999999997,"5min":0.39300000000000002,"15min":0.30299999999999999},"max":{"1min":1.155,"5min":1.2829999999999999,"15min":1.9530000000000001},"last":1.0009999999999999},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.81299999999999994,"15min":0.79000000000000004},"min":{"1min":0.39200000000000002,"5min":0.35299999999999998,"15min":0.29699999999999999},"max":{"1min":1.2769999999999999,"5min":1.591,"15min":1.591},"last":0.80700000000000005}]},{"osd":4,"last update":"Sat Jun 10 19:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.96599999999999997,"15min":0.95599999999999996},"min":{"1min":0.67800000000000005,"5min":0.60899999999999999,"15min":0.41899999999999998},"max":{"1min":1.333,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.98899999999999999,"15min":0.99199999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.47999999999999998},"max":{"1min":1.2110000000000001,"5min":1.873,"15min":1.873},"last":1.1040000000000001}]},{"osd":5,"last update":"Sat Jun 10 19:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":1.004,"15min":1.0169999999999999},"min":{"1min":0.55900000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.3120000000000001,"5min":1.752,"15min":2.024},"last":0.82299999999999995},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0369999999999999,"15min":1.0309999999999999},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.46899999999999997},"max":{"1min":1.337,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":1.054}]},{"osd":6,"last update":"Sat Jun 10 19:05:52 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.0669999999999999,"15min":1.0609999999999999},"min":{"1min":0.625,"5min":0.56999999999999995,"15min":0.55300000000000005},"max":{"1min":1.258,"5min":1.786,"15min":1.8500000000000001},"last":0.96599999999999997},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0589999999999999,"15min":1.0580000000000001},"min":{"1min":0.69499999999999995,"5min":0.61199999999999999,"15min":0.58799999999999997},"max":{"1min":1.3029999999999999,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":1.081}]},{"osd":7,"last update":"Sat Jun 10 19:05:52 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.0800000000000001,"15min":1.093},"min":{"1min":0.77200000000000002,"5min":0.57999999999999996,"15min":0.56999999999999995},"max":{"1min":1.27,"5min":2.1150000000000002,"15min":2.1150000000000002},"last":1.149},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.089,"15min":1.0960000000000001},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.61099999999999999},"max":{"1min":1.3129999999999999,"5min":1.9850000000000001,"15min":1.9850000000000001},"last":1.1910000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575020,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32936,"kb_used_data":1888,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338904,"statfs":{"total":96636764160,"available":96603037696,"internally_reserved":0,"allocated":1933312,"data_stored":898436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.65100000000000002,"15min":0.624},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.27300000000000002},"max":{"1min":2.883,"5min":2.883,"15min":2.883},"last":0.58899999999999997},{"interface":"front","average":{"1min":1.0389999999999999,"5min":0.77400000000000002,"15min":0.74299999999999999},"min":{"1min":0.40400000000000003,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":6.5670000000000002,"5min":6.5670000000000002,"15min":6.5670000000000002},"last":0.67200000000000004}]},{"osd":1,"last update":"Sat Jun 10 19:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.65000000000000002,"15min":0.66400000000000003},"min":{"1min":0.32300000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.91000000000000003,"5min":1.0389999999999999,"15min":1.1950000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":1.204,"5min":0.82699999999999996,"15min":0.78400000000000003},"min":{"1min":0.374,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":8.4429999999999996,"5min":8.4429999999999996,"15min":8.4429999999999996},"last":0.85399999999999998}]},{"osd":3,"last update":"Sat Jun 10 19:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80100000000000005,"15min":0.77600000000000002},"min":{"1min":0.40899999999999997,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.105,"5min":1.1899999999999999,"15min":1.2350000000000001},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.78800000000000003,"15min":0.78400000000000003},"min":{"1min":0.42299999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":4.1849999999999996,"5min":4.1849999999999996,"15min":4.1849999999999996},"last":0.80700000000000005}]},{"osd":4,"last update":"Sat Jun 10 19:06:00 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":0.96499999999999997,"15min":0.94099999999999995},"min":{"1min":0.70299999999999996,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":3.996,"5min":3.996,"15min":3.996},"last":0.95599999999999996},{"interface":"front","average":{"1min":1.6759999999999999,"5min":1.1299999999999999,"15min":1.0600000000000001},"min":{"1min":0.53100000000000003,"5min":0.496,"15min":0.496},"max":{"1min":13.254,"5min":13.254,"15min":13.254},"last":0.76100000000000001}]},{"osd":5,"last update":"Sat Jun 10 19:06:00 2023","interfaces":[{"interface":"back","average":{"1min":1.643,"5min":1.125,"15min":1.0549999999999999},"min":{"1min":0.57999999999999996,"5min":0.55900000000000005,"15min":0.54100000000000004},"max":{"1min":6.9189999999999996,"5min":6.9189999999999996,"15min":6.9189999999999996},"last":0.93300000000000005},{"interface":"front","average":{"1min":2.1299999999999999,"5min":1.2410000000000001,"15min":1.0920000000000001},"min":{"1min":0.72199999999999998,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":15.526,"5min":15.526,"15min":15.526},"last":1.1579999999999999}]},{"osd":6,"last update":"Sat Jun 10 19:06:00 2023","interfaces":[{"interface":"back","average":{"1min":1.5980000000000001,"5min":1.149,"15min":1.083},"min":{"1min":0.74199999999999999,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":8.7089999999999996,"5min":8.7089999999999996,"15min":8.7089999999999996},"last":1.202},{"interface":"front","average":{"1min":1.296,"5min":1.0880000000000001,"15min":1.0620000000000001},"min":{"1min":0.63800000000000001,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":6.1299999999999999,"5min":6.1299999999999999,"15min":6.1299999999999999},"last":1.0129999999999999}]},{"osd":7,"last update":"Sat Jun 10 19:06:00 2023","interfaces":[{"interface":"back","average":{"1min":2.2229999999999999,"5min":1.3260000000000001,"15min":1.175},"min":{"1min":0.74099999999999999,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":12.138,"5min":12.138,"15min":12.138},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.105,"15min":1.1100000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.421,"5min":1.657,"15min":1.752},"last":1.0900000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575022,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37024,"kb_used_data":1880,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334816,"statfs":{"total":96636764160,"available":96598851584,"internally_reserved":0,"allocated":1925120,"data_stored":897375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:06:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66300000000000003,"15min":0.67600000000000005},"min":{"1min":0.33600000000000002,"5min":0.32100000000000001,"15min":0.25800000000000001},"max":{"1min":0.97499999999999998,"5min":1.111,"15min":1.288},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.74399999999999999},"min":{"1min":0.35699999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.079,"5min":1.1859999999999999,"15min":1.694},"last":0.74099999999999999}]},{"osd":2,"last update":"Sat Jun 10 19:06:02 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.249},"max":{"1min":0.86099999999999999,"5min":1.0900000000000001,"15min":1.21},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.69999999999999996,"15min":0.71699999999999997},"min":{"1min":0.33000000000000002,"5min":0.32800000000000001,"15min":0.29699999999999999},"max":{"1min":0.89400000000000002,"5min":1.1040000000000001,"15min":1.415},"last":0.61599999999999999}]},{"osd":3,"last update":"Sat Jun 10 19:06:02 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.77300000000000002,"15min":0.78200000000000003},"min":{"1min":0.38200000000000001,"5min":0.34000000000000002,"15min":0.25600000000000001},"max":{"1min":1.0620000000000001,"5min":1.1679999999999999,"15min":1.6299999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.70299999999999996,"15min":0.73599999999999999},"min":{"1min":0.38800000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.1479999999999999,"5min":1.2909999999999999,"15min":2.1749999999999998},"last":0.499}]},{"osd":4,"last update":"Sat Jun 10 19:06:02 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.85499999999999998,"15min":0.86299999999999999},"min":{"1min":0.59499999999999997,"5min":0.56399999999999995,"15min":0.53000000000000003},"max":{"1min":1.0309999999999999,"5min":1.343,"15min":1.4930000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":1.006,"5min":0.97799999999999998,"15min":1.034},"min":{"1min":0.60299999999999998,"5min":0.47299999999999998,"15min":0.47099999999999997},"max":{"1min":1.3340000000000001,"5min":1.492,"15min":5.8209999999999997},"last":0.81499999999999995}]},{"osd":5,"last update":"Sat Jun 10 19:06:02 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.97199999999999998,"15min":0.998},"min":{"1min":0.63,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.2949999999999999,"5min":1.6299999999999999,"15min":1.8620000000000001},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.94499999999999995,"15min":0.97699999999999998},"min":{"1min":0.56100000000000005,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.194,"5min":1.3220000000000001,"15min":3.089},"last":0.95299999999999996}]},{"osd":6,"last update":"Sat Jun 10 19:06:02 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.99399999999999999,"15min":1.0489999999999999},"min":{"1min":0.61199999999999999,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.238,"5min":1.6759999999999999,"15min":7.2599999999999998},"last":0.83399999999999996},{"interface":"front","average":{"1min":1.0089999999999999,"5min":0.98999999999999999,"15min":1.036},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.2829999999999999,"5min":1.6000000000000001,"15min":9.0069999999999997},"last":0.86299999999999999}]},{"osd":7,"last update":"Sat Jun 10 19:06:02 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.0449999999999999,"15min":1.0780000000000001},"min":{"1min":0.65300000000000002,"5min":0.58799999999999997,"15min":0.495},"max":{"1min":1.3999999999999999,"5min":1.494,"15min":2.105},"last":0.89100000000000001},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0449999999999999,"15min":1.0800000000000001},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.56699999999999995},"max":{"1min":1.321,"5min":1.5620000000000001,"15min":2.2570000000000001},"last":0.97199999999999998}]}]},{"osd":0,"up_from":13,"seq":55834575021,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37624,"kb_used_data":2480,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334216,"statfs":{"total":96636764160,"available":96598237184,"internally_reserved":0,"allocated":2539520,"data_stored":1489943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jun 10 19:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.63100000000000001,"15min":0.63400000000000001},"min":{"1min":0.46200000000000002,"5min":0.309,"15min":0.248},"max":{"1min":0.92300000000000004,"5min":1.127,"15min":1.127},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.44900000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.028,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.73899999999999999}]},{"osd":2,"last update":"Sat Jun 10 19:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.73999999999999999,"15min":0.71699999999999997},"min":{"1min":0.35199999999999998,"5min":0.33500000000000002,"15min":0.29199999999999998},"max":{"1min":1.0640000000000001,"5min":1.2010000000000001,"15min":1.2829999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.65000000000000002,"15min":0.65400000000000003},"min":{"1min":0.30199999999999999,"5min":0.28699999999999998,"15min":0.245},"max":{"1min":1.1080000000000001,"5min":1.1779999999999999,"15min":1.371},"last":0.60199999999999998}]},{"osd":3,"last update":"Sat Jun 10 19:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.68300000000000005,"15min":0.68400000000000005},"min":{"1min":0.35499999999999998,"5min":0.30299999999999999,"15min":0.28899999999999998},"max":{"1min":1.133,"5min":1.133,"15min":1.226},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.82599999999999996,"15min":0.82299999999999995},"min":{"1min":0.39100000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.179,"5min":1.742,"15min":1.829},"last":0.56599999999999995}]},{"osd":4,"last update":"Sat Jun 10 19:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.91700000000000004,"15min":0.92100000000000004},"min":{"1min":0.65600000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.2210000000000001,"5min":1.7250000000000001,"15min":3.0209999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.98499999999999999,"5min":1.0169999999999999,"15min":1.026},"min":{"1min":0.58799999999999997,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.266,"5min":1.873,"15min":1.9510000000000001},"last":1.089}]},{"osd":5,"last update":"Sat Jun 10 19:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.92400000000000004,"15min":0.93600000000000005},"min":{"1min":0.54000000000000004,"5min":0.51200000000000001,"15min":0.45100000000000001},"max":{"1min":1.224,"5min":1.3109999999999999,"15min":1.694},"last":1.0649999999999999},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.98899999999999999,"15min":1.0049999999999999},"min":{"1min":0.60399999999999998,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.278,"5min":1.78,"15min":4.5620000000000003},"last":0.98099999999999998}]},{"osd":6,"last update":"Sat Jun 10 19:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":1.054,"15min":1.073},"min":{"1min":0.628,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.2250000000000001,"5min":1.7909999999999999,"15min":3.5569999999999999},"last":1.046},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.99399999999999999,"15min":1.0009999999999999},"min":{"1min":0.71099999999999997,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.2969999999999999,"5min":1.6319999999999999,"15min":1.883},"last":1.1699999999999999}]},{"osd":7,"last update":"Sat Jun 10 19:06:00 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.0249999999999999,"15min":1.0309999999999999},"min":{"1min":0.61799999999999999,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.375,"5min":1.512,"15min":1.5800000000000001},"last":1.123},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0569999999999999,"15min":1.0589999999999999},"min":{"1min":0.67700000000000005,"5min":0.63,"15min":0.58699999999999997},"max":{"1min":1.341,"5min":1.6619999999999999,"15min":1.9830000000000001},"last":1.0269999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-10T19:06:38.016 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-06-10T19:06:38.017 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-06-10T19:06:38.180 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.178+0000 7faa80786640 1 Processor -- start 2023-06-10T19:06:38.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.178+0000 7faa80786640 1 -- start start 2023-06-10T19:06:38.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.178+0000 7faa80786640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7faa780cc900 0x7faa780cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:38.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.178+0000 7faa80786640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7faa7806c320 0x7faa780cdac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:38.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.178+0000 7faa80786640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa780aefe0 con 0x7faa780ce000 2023-06-10T19:06:38.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.178+0000 7faa80786640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa7815bd80 con 0x7faa780cc900 2023-06-10T19:06:38.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.178+0000 7faa80786640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa780cd210 con 0x7faa7806c320 2023-06-10T19:06:38.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.178+0000 7faa7e522640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7faa780cc900 0x7faa780cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:38.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.178+0000 7faa7ed23640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7faa780ce000 0x7faa780acb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:37468/0 (socket says 172.21.15.53:37468) 2023-06-10T19:06:38.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.178+0000 7faa7ed23640 1 -- 172.21.15.53:0/4008449234 learned_addr learned my addr 172.21.15.53:0/4008449234 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:06:38.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.178+0000 7faa7dd21640 1 --2- 172.21.15.53:0/4008449234 >> v2:172.21.15.117:3300/0 conn(0x7faa7806c320 0x7faa780cdac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:38.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.178+0000 7faa7e522640 1 -- 172.21.15.53:0/4008449234 >> v2:172.21.15.117:3300/0 conn(0x7faa7806c320 msgr2=0x7faa780cdac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:38.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.178+0000 7faa7d520640 1 -- 172.21.15.53:0/4008449234 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1531676239 0 0) 0x7faa780aefe0 con 0x7faa780ce000 2023-06-10T19:06:38.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.178+0000 7faa7e522640 1 --2- 172.21.15.53:0/4008449234 >> v2:172.21.15.117:3300/0 conn(0x7faa7806c320 0x7faa780cdac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:38.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.178+0000 7faa7e522640 1 -- 172.21.15.53:0/4008449234 >> v1:172.21.15.53:6789/0 conn(0x7faa780ce000 legacy=0x7faa780acb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:38.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.178+0000 7faa7e522640 1 -- 172.21.15.53:0/4008449234 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa780ceb70 con 0x7faa780cc900 2023-06-10T19:06:38.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.178+0000 7faa7dd21640 1 --2- 172.21.15.53:0/4008449234 >> v2:172.21.15.117:3300/0 conn(0x7faa7806c320 0x7faa780cdac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:06:38.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.182+0000 7faa7e522640 1 --2- 172.21.15.53:0/4008449234 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa780cc900 0x7faa780cccd0 secure :-1 s=READY pgs=2232 cs=0 l=1 rev1=1 crypto rx=0x7faa78071720 tx=0x7faa6c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=793145ce3ef89dc0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:38.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.182+0000 7faa7d520640 1 -- 172.21.15.53:0/4008449234 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6c004230 con 0x7faa780cc900 2023-06-10T19:06:38.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.182+0000 7faa7d520640 1 -- 172.21.15.53:0/4008449234 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa6c0a7050 con 0x7faa780cc900 2023-06-10T19:06:38.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.182+0000 7faa7d520640 1 -- 172.21.15.53:0/4008449234 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6c003620 con 0x7faa780cc900 2023-06-10T19:06:38.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.182+0000 7faa80786640 1 -- 172.21.15.53:0/4008449234 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa780cc900 msgr2=0x7faa780cccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:38.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.182+0000 7faa80786640 1 --2- 172.21.15.53:0/4008449234 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa780cc900 0x7faa780cccd0 secure :-1 s=READY pgs=2232 cs=0 l=1 rev1=1 crypto rx=0x7faa78071720 tx=0x7faa6c01c460 comp rx=0 tx=0).stop 2023-06-10T19:06:38.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.182+0000 7faa80786640 1 -- 172.21.15.53:0/4008449234 shutdown_connections 2023-06-10T19:06:38.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.182+0000 7faa80786640 1 --2- 172.21.15.53:0/4008449234 >> v2:172.21.15.117:3300/0 conn(0x7faa7806c320 0x7faa780cdac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:38.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.182+0000 7faa80786640 1 --2- 172.21.15.53:0/4008449234 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa780cc900 0x7faa780cccd0 unknown :-1 s=CLOSED pgs=2232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:38.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.182+0000 7faa80786640 1 -- 172.21.15.53:0/4008449234 >> 172.21.15.53:0/4008449234 conn(0x7faa78099250 msgr2=0x7faa780cfef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:38.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.182+0000 7faa80786640 1 -- 172.21.15.53:0/4008449234 shutdown_connections 2023-06-10T19:06:38.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.182+0000 7faa80786640 1 -- 172.21.15.53:0/4008449234 wait complete. 2023-06-10T19:06:38.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.182+0000 7faa80786640 1 Processor -- start 2023-06-10T19:06:38.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.186+0000 7faa80786640 1 -- start start 2023-06-10T19:06:38.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.186+0000 7faa80786640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa7806c320 0x7faa7814f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:38.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.186+0000 7faa80786640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa780cc900 0x7faa780cafa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:38.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.186+0000 7faa80786640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faa780ce000 0x7faa780cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:38.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.186+0000 7faa80786640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa7814fe50 con 0x7faa780cc900 2023-06-10T19:06:38.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.186+0000 7faa80786640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa780b5c90 con 0x7faa7806c320 2023-06-10T19:06:38.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.186+0000 7faa80786640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa78137920 con 0x7faa780ce000 2023-06-10T19:06:38.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.186+0000 7faa7dd21640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa780cc900 0x7faa780cafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:38.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.186+0000 7faa7dd21640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa780cc900 0x7faa780cafa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51208/0 (socket says 172.21.15.53:51208) 2023-06-10T19:06:38.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.186+0000 7faa7dd21640 1 -- 172.21.15.53:0/1963147016 learned_addr learned my addr 172.21.15.53:0/1963147016 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:38.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.186+0000 7faa7e522640 1 --2- 172.21.15.53:0/1963147016 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa7806c320 0x7faa7814f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:38.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.186+0000 7faa7ed23640 1 --2- 172.21.15.53:0/1963147016 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faa780ce000 0x7faa780cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:38.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.186+0000 7faa7dd21640 1 -- 172.21.15.53:0/1963147016 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faa780ce000 msgr2=0x7faa780cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:38.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.186+0000 7faa7dd21640 1 --2- 172.21.15.53:0/1963147016 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faa780ce000 0x7faa780cb4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:38.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.186+0000 7faa7dd21640 1 -- 172.21.15.53:0/1963147016 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa7806c320 msgr2=0x7faa7814f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:38.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.186+0000 7faa7dd21640 1 --2- 172.21.15.53:0/1963147016 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa7806c320 0x7faa7814f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:38.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.186+0000 7faa7dd21640 1 -- 172.21.15.53:0/1963147016 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa6c009420 con 0x7faa780cc900 2023-06-10T19:06:38.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.186+0000 7faa7e522640 1 --2- 172.21.15.53:0/1963147016 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa7806c320 0x7faa7814f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:06:38.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.186+0000 7faa7dd21640 1 --2- 172.21.15.53:0/1963147016 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa780cc900 0x7faa780cafa0 secure :-1 s=READY pgs=2233 cs=0 l=1 rev1=1 crypto rx=0x7faa7400cf60 tx=0x7faa7400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:38.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.186+0000 7faa6affd640 1 -- 172.21.15.53:0/1963147016 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa7400d840 con 0x7faa780cc900 2023-06-10T19:06:38.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.186+0000 7faa6affd640 1 -- 172.21.15.53:0/1963147016 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa7400d9a0 con 0x7faa780cc900 2023-06-10T19:06:38.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.186+0000 7faa80786640 1 -- 172.21.15.53:0/1963147016 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa78137c00 con 0x7faa780cc900 2023-06-10T19:06:38.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.186+0000 7faa6affd640 1 -- 172.21.15.53:0/1963147016 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa7400dd30 con 0x7faa780cc900 2023-06-10T19:06:38.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.186+0000 7faa80786640 1 -- 172.21.15.53:0/1963147016 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa781381c0 con 0x7faa780cc900 2023-06-10T19:06:38.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.186+0000 7faa80786640 1 -- 172.21.15.53:0/1963147016 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa7804d790 con 0x7faa780cc900 2023-06-10T19:06:38.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.186+0000 7faa6affd640 1 -- 172.21.15.53:0/1963147016 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7faa74015440 con 0x7faa780cc900 2023-06-10T19:06:38.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.186+0000 7faa6affd640 1 --2- 172.21.15.53:0/1963147016 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7faa5c066280 0x7faa5c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:38.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.186+0000 7faa6affd640 1 -- 172.21.15.53:0/1963147016 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 6062+0+0 (secure 0 0 0) 0x7faa740846d0 con 0x7faa780cc900 2023-06-10T19:06:38.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.190+0000 7faa7e522640 1 --2- 172.21.15.53:0/1963147016 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7faa5c066280 0x7faa5c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:38.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.190+0000 7faa7e522640 1 --2- 172.21.15.53:0/1963147016 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7faa5c066280 0x7faa5c068730 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7faa6c0ad000 tx=0x7faa6c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:38.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.194+0000 7faa6affd640 1 -- 172.21.15.53:0/1963147016 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7faa74051be0 con 0x7faa780cc900 2023-06-10T19:06:38.340 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-10T19:06:38.343 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-10T19:06:38.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.402+0000 7faa80786640 1 -- 172.21.15.53:0/1963147016 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7faa7806ef00 con 0x7faa780cc900 2023-06-10T19:06:38.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.410+0000 7faa6affd640 1 -- 172.21.15.53:0/1963147016 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v21) v1 ==== 190+0+0 (secure 0 0 0) 0x7faa74055200 con 0x7faa780cc900 2023-06-10T19:06:38.411 INFO:teuthology.orchestra.run.smithi053.stderr:updated caps for client.0 2023-06-10T19:06:38.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.410+0000 7faa80786640 1 -- 172.21.15.53:0/1963147016 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7faa5c066280 msgr2=0x7faa5c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:38.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.410+0000 7faa80786640 1 --2- 172.21.15.53:0/1963147016 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7faa5c066280 0x7faa5c068730 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7faa6c0ad000 tx=0x7faa6c008040 comp rx=0 tx=0).stop 2023-06-10T19:06:38.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.410+0000 7faa80786640 1 -- 172.21.15.53:0/1963147016 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa780cc900 msgr2=0x7faa780cafa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:38.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.410+0000 7faa80786640 1 --2- 172.21.15.53:0/1963147016 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa780cc900 0x7faa780cafa0 secure :-1 s=READY pgs=2233 cs=0 l=1 rev1=1 crypto rx=0x7faa7400cf60 tx=0x7faa7400cf90 comp rx=0 tx=0).stop 2023-06-10T19:06:38.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.410+0000 7faa80786640 1 -- 172.21.15.53:0/1963147016 shutdown_connections 2023-06-10T19:06:38.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.410+0000 7faa80786640 1 --2- 172.21.15.53:0/1963147016 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7faa5c066280 0x7faa5c068730 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:38.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.410+0000 7faa80786640 1 --2- 172.21.15.53:0/1963147016 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faa780ce000 0x7faa780cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:38.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.410+0000 7faa80786640 1 --2- 172.21.15.53:0/1963147016 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa780cc900 0x7faa780cafa0 unknown :-1 s=CLOSED pgs=2233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:38.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.410+0000 7faa80786640 1 --2- 172.21.15.53:0/1963147016 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa7806c320 0x7faa7814f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:38.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.410+0000 7faa80786640 1 -- 172.21.15.53:0/1963147016 >> 172.21.15.53:0/1963147016 conn(0x7faa78099250 msgr2=0x7faa780cc100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:38.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.410+0000 7faa80786640 1 -- 172.21.15.53:0/1963147016 shutdown_connections 2023-06-10T19:06:38.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.410+0000 7faa80786640 1 -- 172.21.15.53:0/1963147016 wait complete. 2023-06-10T19:06:38.430 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:06:38.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.590+0000 7f70db399640 1 Processor -- start 2023-06-10T19:06:38.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.590+0000 7f70db399640 1 -- start start 2023-06-10T19:06:38.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.594+0000 7f70db399640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f70d40c9840 0x7f70d40c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:38.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.594+0000 7f70db399640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f70d406b090 0x7f70d406b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:38.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.594+0000 7f70db399640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70d4159b50 con 0x7f70d4071060 2023-06-10T19:06:38.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.594+0000 7f70db399640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70d40ca150 con 0x7f70d406b090 2023-06-10T19:06:38.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.594+0000 7f70db399640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70d40702a0 con 0x7f70d40c9840 2023-06-10T19:06:38.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.594+0000 7f70d9936640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f70d406b090 0x7f70d406b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:38.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.594+0000 7f70d8934640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f70d4071060 0x7f70d40af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:37482/0 (socket says 172.21.15.53:37482) 2023-06-10T19:06:38.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.594+0000 7f70d8934640 1 -- 172.21.15.53:0/2174351652 learned_addr learned my addr 172.21.15.53:0/2174351652 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:06:38.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.594+0000 7f70d9135640 1 --2- 172.21.15.53:0/2174351652 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f70d40c9840 0x7f70d40c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:38.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.594+0000 7f70d9936640 1 -- 172.21.15.53:0/2174351652 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f70d40c9840 msgr2=0x7f70d40c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:38.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.594+0000 7f70d9936640 1 --2- 172.21.15.53:0/2174351652 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f70d40c9840 0x7f70d40c9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:38.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.594+0000 7f70d9936640 1 -- 172.21.15.53:0/2174351652 >> v1:172.21.15.53:6789/0 conn(0x7f70d4071060 legacy=0x7f70d40af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:38.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.594+0000 7f70d9936640 1 -- 172.21.15.53:0/2174351652 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d4070580 con 0x7f70d406b090 2023-06-10T19:06:38.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.594+0000 7f70cbfff640 1 -- 172.21.15.53:0/2174351652 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 483785972 0 0) 0x7f70d4159b50 con 0x7f70d4071060 2023-06-10T19:06:38.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.594+0000 7f70d9936640 1 --2- 172.21.15.53:0/2174351652 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70d406b090 0x7f70d406b530 secure :-1 s=READY pgs=2235 cs=0 l=1 rev1=1 crypto rx=0x7f70cc009d90 tx=0x7f70cc01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b9edb536628d746 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:38.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.594+0000 7f70cbfff640 1 -- 172.21.15.53:0/2174351652 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70cc0a59e0 con 0x7f70d406b090 2023-06-10T19:06:38.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.594+0000 7f70cbfff640 1 -- 172.21.15.53:0/2174351652 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70cc0a5b40 con 0x7f70d406b090 2023-06-10T19:06:38.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.594+0000 7f70cbfff640 1 -- 172.21.15.53:0/2174351652 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70cc0ad440 con 0x7f70d406b090 2023-06-10T19:06:38.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.598+0000 7f70db399640 1 -- 172.21.15.53:0/2174351652 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70d406b090 msgr2=0x7f70d406b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:38.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.598+0000 7f70db399640 1 --2- 172.21.15.53:0/2174351652 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70d406b090 0x7f70d406b530 secure :-1 s=READY pgs=2235 cs=0 l=1 rev1=1 crypto rx=0x7f70cc009d90 tx=0x7f70cc01c920 comp rx=0 tx=0).stop 2023-06-10T19:06:38.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.598+0000 7f70db399640 1 -- 172.21.15.53:0/2174351652 shutdown_connections 2023-06-10T19:06:38.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.598+0000 7f70db399640 1 --2- 172.21.15.53:0/2174351652 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70d406b090 0x7f70d406b530 unknown :-1 s=CLOSED pgs=2235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:38.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.598+0000 7f70db399640 1 --2- 172.21.15.53:0/2174351652 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f70d40c9840 0x7f70d40c9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:38.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.598+0000 7f70db399640 1 -- 172.21.15.53:0/2174351652 >> 172.21.15.53:0/2174351652 conn(0x7f70d406a0d0 msgr2=0x7f70d40ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:38.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.598+0000 7f70db399640 1 -- 172.21.15.53:0/2174351652 shutdown_connections 2023-06-10T19:06:38.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.598+0000 7f70db399640 1 -- 172.21.15.53:0/2174351652 wait complete. 2023-06-10T19:06:38.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.598+0000 7f70db399640 1 Processor -- start 2023-06-10T19:06:38.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.598+0000 7f70db399640 1 -- start start 2023-06-10T19:06:38.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.598+0000 7f70db399640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70d406b090 0x7f70d40b14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:38.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.598+0000 7f70db399640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f70d4071060 0x7f70d40aea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:38.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.598+0000 7f70db399640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70d40c9840 0x7f70d41f88a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:38.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.598+0000 7f70db399640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d40b0ad0 con 0x7f70d40c9840 2023-06-10T19:06:38.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.598+0000 7f70db399640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d40b1050 con 0x7f70d406b090 2023-06-10T19:06:38.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.598+0000 7f70db399640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70d41f93d0 con 0x7f70d4071060 2023-06-10T19:06:38.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.598+0000 7f70d9936640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70d40c9840 0x7f70d41f88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:38.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.598+0000 7f70d9936640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70d40c9840 0x7f70d41f88a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51224/0 (socket says 172.21.15.53:51224) 2023-06-10T19:06:38.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.598+0000 7f70d9936640 1 -- 172.21.15.53:0/613161374 learned_addr learned my addr 172.21.15.53:0/613161374 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:38.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.598+0000 7f70d8934640 1 --2- 172.21.15.53:0/613161374 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f70d4071060 0x7f70d40aea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:38.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.598+0000 7f70d9936640 1 -- 172.21.15.53:0/613161374 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f70d4071060 msgr2=0x7f70d40aea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:38.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.598+0000 7f70d9936640 1 --2- 172.21.15.53:0/613161374 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f70d4071060 0x7f70d40aea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:38.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.598+0000 7f70d9936640 1 -- 172.21.15.53:0/613161374 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70d406b090 msgr2=0x7f70d40b14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:38.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.598+0000 7f70d9936640 1 --2- 172.21.15.53:0/613161374 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70d406b090 0x7f70d40b14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:38.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.598+0000 7f70d9936640 1 -- 172.21.15.53:0/613161374 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70cc009a70 con 0x7f70d40c9840 2023-06-10T19:06:38.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.598+0000 7f70d8934640 1 --2- 172.21.15.53:0/613161374 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f70d4071060 0x7f70d40aea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:06:38.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.598+0000 7f70d9936640 1 --2- 172.21.15.53:0/613161374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70d40c9840 0x7f70d41f88a0 secure :-1 s=READY pgs=2236 cs=0 l=1 rev1=1 crypto rx=0x7f70cc01a550 tx=0x7f70cc0196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:38.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.598+0000 7f70c9ffb640 1 -- 172.21.15.53:0/613161374 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70cc0a59e0 con 0x7f70d40c9840 2023-06-10T19:06:38.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.598+0000 7f70c9ffb640 1 -- 172.21.15.53:0/613161374 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70cc009450 con 0x7f70d40c9840 2023-06-10T19:06:38.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.598+0000 7f70db399640 1 -- 172.21.15.53:0/613161374 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70d41f96b0 con 0x7f70d40c9840 2023-06-10T19:06:38.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.598+0000 7f70c9ffb640 1 -- 172.21.15.53:0/613161374 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70cc003ba0 con 0x7f70d40c9840 2023-06-10T19:06:38.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.598+0000 7f70db399640 1 -- 172.21.15.53:0/613161374 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70d40b1a20 con 0x7f70d40c9840 2023-06-10T19:06:38.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.602+0000 7f70db399640 1 -- 172.21.15.53:0/613161374 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70d404d790 con 0x7f70d40c9840 2023-06-10T19:06:38.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.602+0000 7f70c9ffb640 1 -- 172.21.15.53:0/613161374 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f70cc0b4050 con 0x7f70d40c9840 2023-06-10T19:06:38.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.602+0000 7f70c9ffb640 1 --2- 172.21.15.53:0/613161374 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f70b8066280 0x7f70b8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:38.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.602+0000 7f70c9ffb640 1 -- 172.21.15.53:0/613161374 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f70cc11e670 con 0x7f70d40c9840 2023-06-10T19:06:38.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.602+0000 7f70d9135640 1 --2- 172.21.15.53:0/613161374 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f70b8066280 0x7f70b8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:38.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.602+0000 7f70d9135640 1 --2- 172.21.15.53:0/613161374 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f70b8066280 0x7f70b8068730 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f70d000b850 tx=0x7f70d0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:38.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.606+0000 7f70c9ffb640 1 -- 172.21.15.53:0/613161374 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f70cc0ebbd0 con 0x7f70d40c9840 2023-06-10T19:06:38.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.786+0000 7f70db399640 1 -- 172.21.15.53:0/613161374 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f70d40b11e0 con 0x7f70d40c9840 2023-06-10T19:06:38.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.786+0000 7f70c9ffb640 1 -- 172.21.15.53:0/613161374 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) v1 ==== 94+0+4679 (secure 0 0 0) 0x7f70cc0ef1f0 con 0x7f70d40c9840 2023-06-10T19:06:38.790 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:06:38.790 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":89,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/67248348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":67248348},{"type":"v1","addr":"172.21.15.117:6835","nonce":67248348}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":84},{"gid":8296,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3907684243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":3907684243},{"type":"v1","addr":"172.21.15.117:6837","nonce":3907684243}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":84},{"gid":10038,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/1699177406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":1699177406},{"type":"v1","addr":"172.21.15.53:6833","nonce":1699177406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":84}],"filesystems":[{"mdsmap":{"epoch":89,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:06:28.716939+0000","modified":"2023-06-10T19:06:32.084420+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10044},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10044":{"gid":10044,"name":"a","rank":0,"incarnation":85,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/2077620799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2077620799},{"type":"v1","addr":"172.21.15.53:6835","nonce":2077620799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-06-10T19:06:38.791 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 89 2023-06-10T19:06:38.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.786+0000 7f70db399640 1 -- 172.21.15.53:0/613161374 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f70b8066280 msgr2=0x7f70b8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:38.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.790+0000 7f70db399640 1 --2- 172.21.15.53:0/613161374 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f70b8066280 0x7f70b8068730 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f70d000b850 tx=0x7f70d0008040 comp rx=0 tx=0).stop 2023-06-10T19:06:38.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.790+0000 7f70db399640 1 -- 172.21.15.53:0/613161374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70d40c9840 msgr2=0x7f70d41f88a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:38.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.790+0000 7f70db399640 1 --2- 172.21.15.53:0/613161374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70d40c9840 0x7f70d41f88a0 secure :-1 s=READY pgs=2236 cs=0 l=1 rev1=1 crypto rx=0x7f70cc01a550 tx=0x7f70cc0196c0 comp rx=0 tx=0).stop 2023-06-10T19:06:38.793 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.790+0000 7f70db399640 1 -- 172.21.15.53:0/613161374 shutdown_connections 2023-06-10T19:06:38.793 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.790+0000 7f70db399640 1 --2- 172.21.15.53:0/613161374 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f70b8066280 0x7f70b8068730 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:38.793 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.790+0000 7f70db399640 1 --2- 172.21.15.53:0/613161374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70d40c9840 0x7f70d41f88a0 unknown :-1 s=CLOSED pgs=2236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:38.794 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.790+0000 7f70db399640 1 --2- 172.21.15.53:0/613161374 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f70d4071060 0x7f70d40aea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:38.794 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.790+0000 7f70db399640 1 --2- 172.21.15.53:0/613161374 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70d406b090 0x7f70d40b14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:38.794 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.790+0000 7f70db399640 1 -- 172.21.15.53:0/613161374 >> 172.21.15.53:0/613161374 conn(0x7f70d406a0d0 msgr2=0x7f70d4163d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:38.794 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.790+0000 7f70db399640 1 -- 172.21.15.53:0/613161374 shutdown_connections 2023-06-10T19:06:38.795 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:38.790+0000 7f70db399640 1 -- 172.21.15.53:0/613161374 wait complete. 2023-06-10T19:06:39.208 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 89, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-06-10T19:06:28.716939+0000', 'modified': '2023-06-10T19:06:32.084420+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10044}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10044': {'gid': 10044, 'name': 'a', 'rank': 0, 'incarnation': 85, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.53:6835/2077620799', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.53:6834', 'nonce': 2077620799}, {'type': 'v1', 'addr': '172.21.15.53:6835', 'nonce': 2077620799}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [22], 'metadata_pool': 21, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-06-10T19:06:39.208 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-06-10T19:06:39.209 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-06-10T19:06:39.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.338+0000 7f81d4d3c640 1 Processor -- start 2023-06-10T19:06:39.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.338+0000 7f81d4d3c640 1 -- start start 2023-06-10T19:06:39.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.338+0000 7f81d4d3c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f81d0159690 0x7f81d0070950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:39.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.338+0000 7f81d4d3c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f81d00b0f30 0x7f81d00cbe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:39.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.338+0000 7f81d4d3c640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81d00cb080 con 0x7f81d0159a60 2023-06-10T19:06:39.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.338+0000 7f81d4d3c640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81d0070e90 con 0x7f81d0159690 2023-06-10T19:06:39.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.338+0000 7f81d4d3c640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81d006d450 con 0x7f81d00b0f30 2023-06-10T19:06:39.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.338+0000 7f81ce59c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f81d0159690 0x7f81d0070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:39.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.338+0000 7f81ce59c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f81d0159690 0x7f81d0070950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51232/0 (socket says 172.21.15.53:51232) 2023-06-10T19:06:39.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.338+0000 7f81ce59c640 1 -- 172.21.15.53:0/3378870294 learned_addr learned my addr 172.21.15.53:0/3378870294 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:39.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.338+0000 7f81cdd9b640 1 --2- 172.21.15.53:0/3378870294 >> v2:172.21.15.117:3300/0 conn(0x7f81d00b0f30 0x7f81d00cbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:39.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.338+0000 7f81ce59c640 1 -- 172.21.15.53:0/3378870294 >> v2:172.21.15.117:3300/0 conn(0x7f81d00b0f30 msgr2=0x7f81d00cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:39.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.338+0000 7f81ce59c640 1 --2- 172.21.15.53:0/3378870294 >> v2:172.21.15.117:3300/0 conn(0x7f81d00b0f30 0x7f81d00cbe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:39.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.338+0000 7f81ce59c640 1 -- 172.21.15.53:0/3378870294 >> v1:172.21.15.117:6789/0 conn(0x7f81d0159a60 legacy=0x7f81d00c2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:39.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.338+0000 7f81ce59c640 1 -- 172.21.15.53:0/3378870294 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d00cb320 con 0x7f81d0159690 2023-06-10T19:06:39.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.338+0000 7f81cdd9b640 1 --2- 172.21.15.53:0/3378870294 >> v2:172.21.15.117:3300/0 conn(0x7f81d00b0f30 0x7f81d00cbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:06:39.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.342+0000 7f81ce59c640 1 --2- 172.21.15.53:0/3378870294 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f81d0159690 0x7f81d0070950 secure :-1 s=READY pgs=2237 cs=0 l=1 rev1=1 crypto rx=0x7f81d00cec80 tx=0x7f81c401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93afa5b71294eeee server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:39.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.342+0000 7f81cd59a640 1 -- 172.21.15.53:0/3378870294 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c40ac600 con 0x7f81d0159690 2023-06-10T19:06:39.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.342+0000 7f81cd59a640 1 -- 172.21.15.53:0/3378870294 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81c40a8050 con 0x7f81d0159690 2023-06-10T19:06:39.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.342+0000 7f81cd59a640 1 -- 172.21.15.53:0/3378870294 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c40ac980 con 0x7f81d0159690 2023-06-10T19:06:39.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.342+0000 7f81d4d3c640 1 -- 172.21.15.53:0/3378870294 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f81d0159690 msgr2=0x7f81d0070950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:39.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.342+0000 7f81d4d3c640 1 --2- 172.21.15.53:0/3378870294 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f81d0159690 0x7f81d0070950 secure :-1 s=READY pgs=2237 cs=0 l=1 rev1=1 crypto rx=0x7f81d00cec80 tx=0x7f81c401c490 comp rx=0 tx=0).stop 2023-06-10T19:06:39.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.342+0000 7f81d4d3c640 1 -- 172.21.15.53:0/3378870294 shutdown_connections 2023-06-10T19:06:39.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.342+0000 7f81d4d3c640 1 --2- 172.21.15.53:0/3378870294 >> v2:172.21.15.117:3300/0 conn(0x7f81d00b0f30 0x7f81d00cbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:39.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.342+0000 7f81d4d3c640 1 --2- 172.21.15.53:0/3378870294 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f81d0159690 0x7f81d0070950 unknown :-1 s=CLOSED pgs=2237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:39.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.342+0000 7f81d4d3c640 1 -- 172.21.15.53:0/3378870294 >> 172.21.15.53:0/3378870294 conn(0x7f81d006a560 msgr2=0x7f81d006a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:39.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.342+0000 7f81d4d3c640 1 -- 172.21.15.53:0/3378870294 shutdown_connections 2023-06-10T19:06:39.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.342+0000 7f81d4d3c640 1 -- 172.21.15.53:0/3378870294 wait complete. 2023-06-10T19:06:39.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.342+0000 7f81d4d3c640 1 Processor -- start 2023-06-10T19:06:39.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.342+0000 7f81d4d3c640 1 -- start start 2023-06-10T19:06:39.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.342+0000 7f81d4d3c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f81d00b0f30 0x7f81d0144b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:39.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.342+0000 7f81d4d3c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81d0159690 0x7f81d014e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:39.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.346+0000 7f81d4d3c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f81d0159a60 0x7f81d01452d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:39.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.346+0000 7f81d4d3c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81d00c5ef0 con 0x7f81d0159a60 2023-06-10T19:06:39.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.346+0000 7f81d4d3c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81d014ebc0 con 0x7f81d0159690 2023-06-10T19:06:39.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.346+0000 7f81d4d3c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81d014eea0 con 0x7f81d00b0f30 2023-06-10T19:06:39.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.346+0000 7f81ced9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f81d0159a60 0x7f81d01452d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:39.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.346+0000 7f81ced9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f81d0159a60 0x7f81d01452d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51244/0 (socket says 172.21.15.53:51244) 2023-06-10T19:06:39.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.346+0000 7f81ced9d640 1 -- 172.21.15.53:0/3683400816 learned_addr learned my addr 172.21.15.53:0/3683400816 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:39.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.346+0000 7f81ce59c640 1 --2- 172.21.15.53:0/3683400816 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f81d00b0f30 0x7f81d0144b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:39.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.346+0000 7f81cdd9b640 1 --2- 172.21.15.53:0/3683400816 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81d0159690 0x7f81d014e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:39.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.346+0000 7f81ced9d640 1 -- 172.21.15.53:0/3683400816 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f81d00b0f30 msgr2=0x7f81d0144b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:39.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.346+0000 7f81ced9d640 1 --2- 172.21.15.53:0/3683400816 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f81d00b0f30 0x7f81d0144b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:39.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.346+0000 7f81ced9d640 1 -- 172.21.15.53:0/3683400816 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81d0159690 msgr2=0x7f81d014e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:39.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.346+0000 7f81ced9d640 1 --2- 172.21.15.53:0/3683400816 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81d0159690 0x7f81d014e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:39.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.346+0000 7f81ced9d640 1 -- 172.21.15.53:0/3683400816 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c40094d0 con 0x7f81d0159a60 2023-06-10T19:06:39.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.346+0000 7f81cdd9b640 1 --2- 172.21.15.53:0/3683400816 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81d0159690 0x7f81d014e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:06:39.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.346+0000 7f81ced9d640 1 --2- 172.21.15.53:0/3683400816 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f81d0159a60 0x7f81d01452d0 secure :-1 s=READY pgs=2238 cs=0 l=1 rev1=1 crypto rx=0x7f81c800b970 tx=0x7f81c800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:39.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.346+0000 7f81beffd640 1 -- 172.21.15.53:0/3683400816 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c800cb40 con 0x7f81d0159a60 2023-06-10T19:06:39.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.346+0000 7f81beffd640 1 -- 172.21.15.53:0/3683400816 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81c800cca0 con 0x7f81d0159a60 2023-06-10T19:06:39.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.346+0000 7f81d4d3c640 1 -- 172.21.15.53:0/3683400816 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81d014f180 con 0x7f81d0159a60 2023-06-10T19:06:39.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.346+0000 7f81beffd640 1 -- 172.21.15.53:0/3683400816 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c8014680 con 0x7f81d0159a60 2023-06-10T19:06:39.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.346+0000 7f81d4d3c640 1 -- 172.21.15.53:0/3683400816 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81d014f740 con 0x7f81d0159a60 2023-06-10T19:06:39.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.346+0000 7f81beffd640 1 -- 172.21.15.53:0/3683400816 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f81c801d3b0 con 0x7f81d0159a60 2023-06-10T19:06:39.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.346+0000 7f81beffd640 1 --2- 172.21.15.53:0/3683400816 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f81b0066280 0x7f81b0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:39.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.346+0000 7f81beffd640 1 -- 172.21.15.53:0/3683400816 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f81c8083c50 con 0x7f81d0159a60 2023-06-10T19:06:39.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.346+0000 7f81ce59c640 1 --2- 172.21.15.53:0/3683400816 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f81b0066280 0x7f81b0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:39.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.346+0000 7f81d7e58000 1 Processor -- start 2023-06-10T19:06:39.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.346+0000 7f81d7e58000 1 -- start start 2023-06-10T19:06:39.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.350+0000 7f81ce59c640 1 --2- 172.21.15.53:0/3683400816 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f81b0066280 0x7f81b0068730 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f81c40ae000 tx=0x7f81c40a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:39.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.350+0000 7f81d7e58000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5579e26f2740 0x5579e26f2b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:39.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.350+0000 7f81d7e58000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5579e26f3050 0x5579e26a8840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:39.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.350+0000 7f81d7e58000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5579e26a8d80 0x5579e26a9150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:39.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.350+0000 7f81d7e58000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579e2570ac0 con 0x5579e26f2740 2023-06-10T19:06:39.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.350+0000 7f81d7e58000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579e24aa840 con 0x5579e26a8d80 2023-06-10T19:06:39.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.350+0000 7f81d7e58000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x5579e24fe2e0 con 0x5579e26f3050 2023-06-10T19:06:39.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.350+0000 7f81ce59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5579e26f2740 0x5579e26f2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:39.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.350+0000 7f81ce59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5579e26f2740 0x5579e26f2b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51246/0 (socket says 172.21.15.53:51246) 2023-06-10T19:06:39.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.350+0000 7f81ce59c640 1 -- 172.21.15.53:0/10287498 learned_addr learned my addr 172.21.15.53:0/10287498 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:39.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.350+0000 7f81ced9d640 1 --2- 172.21.15.53:0/10287498 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5579e26a8d80 0x5579e26a9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:39.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.350+0000 7f81ce59c640 1 -- 172.21.15.53:0/10287498 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5579e26f3050 msgr2=0x5579e26a8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:39.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.350+0000 7f81ce59c640 1 --2- 172.21.15.53:0/10287498 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5579e26f3050 0x5579e26a8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:39.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.350+0000 7f81ce59c640 1 -- 172.21.15.53:0/10287498 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5579e26a8d80 msgr2=0x5579e26a9150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:39.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.350+0000 7f81ce59c640 1 --2- 172.21.15.53:0/10287498 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5579e26a8d80 0x5579e26a9150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:39.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.350+0000 7f81ce59c640 1 -- 172.21.15.53:0/10287498 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5579e21f3890 con 0x5579e26f2740 2023-06-10T19:06:39.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.350+0000 7f81ce59c640 1 --2- 172.21.15.53:0/10287498 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5579e26f2740 0x5579e26f2b10 secure :-1 s=READY pgs=2239 cs=0 l=1 rev1=1 crypto rx=0x7f81c40af040 tx=0x7f81c4004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d0f9f99e5325d2a server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:39.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.350+0000 7f81affff640 1 -- 172.21.15.53:0/10287498 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c40b6670 con 0x5579e26f2740 2023-06-10T19:06:39.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.350+0000 7f81affff640 1 -- 172.21.15.53:0/10287498 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81c40bd040 con 0x5579e26f2740 2023-06-10T19:06:39.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.350+0000 7f81affff640 1 -- 172.21.15.53:0/10287498 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c40b6a10 con 0x5579e26f2740 2023-06-10T19:06:39.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.350+0000 7f81d7e58000 1 -- 172.21.15.53:0/10287498 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5579e26f2740 msgr2=0x5579e26f2b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:39.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.350+0000 7f81d7e58000 1 --2- 172.21.15.53:0/10287498 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5579e26f2740 0x5579e26f2b10 secure :-1 s=READY pgs=2239 cs=0 l=1 rev1=1 crypto rx=0x7f81c40af040 tx=0x7f81c4004740 comp rx=0 tx=0).stop 2023-06-10T19:06:39.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.350+0000 7f81d7e58000 1 -- 172.21.15.53:0/10287498 shutdown_connections 2023-06-10T19:06:39.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.350+0000 7f81d7e58000 1 --2- 172.21.15.53:0/10287498 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5579e26a8d80 0x5579e26a9150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:39.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.350+0000 7f81d7e58000 1 --2- 172.21.15.53:0/10287498 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5579e26f3050 0x5579e26a8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:39.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.350+0000 7f81d7e58000 1 --2- 172.21.15.53:0/10287498 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5579e26f2740 0x5579e26f2b10 unknown :-1 s=CLOSED pgs=2239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:39.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.350+0000 7f81d7e58000 1 -- 172.21.15.53:0/10287498 >> 172.21.15.53:0/10287498 conn(0x5579e26a0800 msgr2=0x5579e26af800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:39.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.350+0000 7f81d7e58000 1 -- 172.21.15.53:0/10287498 shutdown_connections 2023-06-10T19:06:39.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.350+0000 7f81d7e58000 1 -- 172.21.15.53:0/10287498 wait complete. 2023-06-10T19:06:39.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.350+0000 7f81d7e58000 1 -- start start 2023-06-10T19:06:39.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.350+0000 7f81d7e58000 1 Processor -- start 2023-06-10T19:06:39.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.350+0000 7f81d7e58000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5579e26a8d80 0x5579e26ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:39.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.350+0000 7f81d7e58000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5579e26f2740 0x5579e26b40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:39.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.350+0000 7f81d7e58000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5579e26f3050 0x5579e26b4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:39.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.350+0000 7f81d7e58000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579e24f7380 con 0x5579e26a8d80 2023-06-10T19:06:39.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.350+0000 7f81d7e58000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579e24b3ae0 con 0x5579e26f2740 2023-06-10T19:06:39.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.350+0000 7f81d7e58000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x5579e24b3780 con 0x5579e26f3050 2023-06-10T19:06:39.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.350+0000 7f81d7e58000 10 client.0 _ll_register_callbacks cb 0x5579e2694e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-10T19:06:39.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.350+0000 7f81ce59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5579e26a8d80 0x5579e26ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:39.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.350+0000 7f81ce59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5579e26a8d80 0x5579e26ae8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51256/0 (socket says 172.21.15.53:51256) 2023-06-10T19:06:39.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.350+0000 7f81ce59c640 1 -- 172.21.15.53:0/1042099598 learned_addr learned my addr 172.21.15.53:0/1042099598 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:39.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.350+0000 7f81cdd9b640 1 --2- 172.21.15.53:0/1042099598 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5579e26f2740 0x5579e26b40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:39.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.350+0000 7f81ced9d640 1 --2- 172.21.15.53:0/1042099598 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5579e26f3050 0x5579e26b4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:39.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.354+0000 7f81ce59c640 1 -- 172.21.15.53:0/1042099598 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5579e26f3050 msgr2=0x5579e26b4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:39.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.354+0000 7f81ce59c640 1 --2- 172.21.15.53:0/1042099598 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5579e26f3050 0x5579e26b4620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:39.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.354+0000 7f81ce59c640 1 -- 172.21.15.53:0/1042099598 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5579e26f2740 msgr2=0x5579e26b40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:39.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.354+0000 7f81ce59c640 1 --2- 172.21.15.53:0/1042099598 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5579e26f2740 0x5579e26b40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:39.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.354+0000 7f81ce59c640 1 -- 172.21.15.53:0/1042099598 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81d00cb320 con 0x5579e26a8d80 2023-06-10T19:06:39.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.354+0000 7f81ce59c640 1 --2- 172.21.15.53:0/1042099598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5579e26a8d80 0x5579e26ae8e0 secure :-1 s=READY pgs=2240 cs=0 l=1 rev1=1 crypto rx=0x7f81c401a0c0 tx=0x7f81c40046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c35a6211b8795f6 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:39.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.354+0000 7f81ad7fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-06-10T19:06:39.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.354+0000 7f81ad7fa640 1 -- 172.21.15.53:0/1042099598 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c40d0070 con 0x5579e26a8d80 2023-06-10T19:06:39.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.354+0000 7f81d7e58000 1 -- 172.21.15.53:0/1042099598 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5579e24bea20 con 0x5579e26a8d80 2023-06-10T19:06:39.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.354+0000 7f81ad7fa640 1 -- 172.21.15.53:0/1042099598 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(154..154 src has 1..154) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f81c40b6c30 con 0x5579e26a8d80 2023-06-10T19:06:39.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.354+0000 7f81ad7fa640 1 -- 172.21.15.53:0/1042099598 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7f81c40b6df0 con 0x5579e26a8d80 2023-06-10T19:06:39.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.354+0000 7f81d7e58000 10 client.10227 fetch_fsmap learned FSMap version 89 2023-06-10T19:06:39.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.354+0000 7f81d7e58000 1 -- 172.21.15.53:0/1042099598 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=2+}) v3 -- 0x5579e24bbd10 con 0x5579e26a8d80 2023-06-10T19:06:39.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.354+0000 7f81ad7fa640 1 -- 172.21.15.53:0/1042099598 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5579e24bea20 con 0x5579e26a8d80 2023-06-10T19:06:39.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.354+0000 7f81ad7fa640 1 -- 172.21.15.53:0/1042099598 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 89) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f81c40d3020 con 0x5579e26a8d80 2023-06-10T19:06:39.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.354+0000 7f81d7e58000 10 client.10227 fetch_fsmap finished waiting for FSMap version 89 2023-06-10T19:06:39.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.354+0000 7f81d7e58000 10 client.10227 resolve_mds: resolved name 'a' to daemon mds.a 2023-06-10T19:06:39.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.354+0000 7f81d7e58000 20 client.10227 populate_metadata read hostname 'smithi053' 2023-06-10T19:06:39.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.354+0000 7f81d7e58000 1 --2- 172.21.15.53:0/1042099598 >> [v2:172.21.15.53:6834/2077620799,v1:172.21.15.53:6835/2077620799] conn(0x5579e2701c80 0x5579e2704060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:39.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.354+0000 7f81d7e58000 4 client.10227 mds_command: new command op to 10044 tid=0[{"prefix": "get_command_descriptions"}] 2023-06-10T19:06:39.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.354+0000 7f81d7e58000 1 -- 172.21.15.53:0/1042099598 --> [v2:172.21.15.53:6834/2077620799,v1:172.21.15.53:6835/2077620799] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5579e2526710 con 0x5579e2701c80 2023-06-10T19:06:39.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.354+0000 7f81cdd9b640 1 --2- 172.21.15.53:0/1042099598 >> [v2:172.21.15.53:6834/2077620799,v1:172.21.15.53:6835/2077620799] conn(0x5579e2701c80 0x5579e2704060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:39.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.354+0000 7f81cdd9b640 1 --2- 172.21.15.53:0/1042099598 >> [v2:172.21.15.53:6834/2077620799,v1:172.21.15.53:6835/2077620799] conn(0x5579e2701c80 0x5579e2704060 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a06ae2ec91074f9a server_cookie=7bc1c6cfeec1af50 in_seq=0 out_seq=0 2023-06-10T19:06:39.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.354+0000 7f81ad7fa640 10 client.10227 ms_handle_connect on v2:172.21.15.53:6834/2077620799 2023-06-10T19:06:39.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.354+0000 7f81ad7fa640 1 -- 172.21.15.53:0/1042099598 <== mds.0 v2:172.21.15.53:6834/2077620799 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5579e2526710 con 0x5579e2701c80 2023-06-10T19:06:39.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.354+0000 7f81ad7fa640 10 client.10227 handle_command_reply: tid=0 2023-06-10T19:06:39.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.354+0000 7f81d7e58000 1 client.10227 shutdown 2023-06-10T19:06:39.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.354+0000 7f81d7e58000 1 -- 172.21.15.53:0/1042099598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5579e26a8d80 msgr2=0x5579e26ae8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:39.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.354+0000 7f81d7e58000 1 --2- 172.21.15.53:0/1042099598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5579e26a8d80 0x5579e26ae8e0 secure :-1 s=READY pgs=2240 cs=0 l=1 rev1=1 crypto rx=0x7f81c401a0c0 tx=0x7f81c40046d0 comp rx=0 tx=0).stop 2023-06-10T19:06:39.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.354+0000 7f81d7e58000 1 -- 172.21.15.53:0/1042099598 shutdown_connections 2023-06-10T19:06:39.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.354+0000 7f81d7e58000 1 --2- 172.21.15.53:0/1042099598 >> [v2:172.21.15.53:6834/2077620799,v1:172.21.15.53:6835/2077620799] conn(0x5579e2701c80 0x5579e2704060 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:39.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.354+0000 7f81d7e58000 1 --2- 172.21.15.53:0/1042099598 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5579e26f3050 0x5579e26b4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:39.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.354+0000 7f81d7e58000 1 --2- 172.21.15.53:0/1042099598 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5579e26f2740 0x5579e26b40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:39.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.354+0000 7f81d7e58000 1 --2- 172.21.15.53:0/1042099598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5579e26a8d80 0x5579e26ae8e0 unknown :-1 s=CLOSED pgs=2240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:39.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.354+0000 7f81ad7fa640 0 client.10227 ms_handle_reset on v2:172.21.15.53:6834/2077620799 2023-06-10T19:06:39.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.354+0000 7f81d7e58000 1 -- 172.21.15.53:0/1042099598 >> 172.21.15.53:0/1042099598 conn(0x5579e26a0800 msgr2=0x5579e26a7830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:39.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.354+0000 7f81d7e58000 1 -- 172.21.15.53:0/1042099598 shutdown_connections 2023-06-10T19:06:39.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.354+0000 7f81d7e58000 1 -- 172.21.15.53:0/1042099598 wait complete. 2023-06-10T19:06:39.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.354+0000 7f81d7e58000 20 client.10227 trim_cache size 0 max 16384 2023-06-10T19:06:39.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.370+0000 7f81d7e58000 1 Processor -- start 2023-06-10T19:06:39.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.370+0000 7f81d7e58000 1 -- start start 2023-06-10T19:06:39.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.370+0000 7f81d7e58000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5579e26a8d80 0x5579e2705fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:39.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.370+0000 7f81d7e58000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5579e26f2740 0x5579e2702050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:39.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.370+0000 7f81d7e58000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5579e26f3050 0x5579e2702590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:39.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.370+0000 7f81d7e58000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579e21b4940 con 0x5579e26a8d80 2023-06-10T19:06:39.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.370+0000 7f81d7e58000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579e24f1680 con 0x5579e26f2740 2023-06-10T19:06:39.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.370+0000 7f81d7e58000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x5579e24f32f0 con 0x5579e26f3050 2023-06-10T19:06:39.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.370+0000 7f81ce59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5579e26a8d80 0x5579e2705fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:39.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.370+0000 7f81ce59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5579e26a8d80 0x5579e2705fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51268/0 (socket says 172.21.15.53:51268) 2023-06-10T19:06:39.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.370+0000 7f81ce59c640 1 -- 172.21.15.53:0/1585248130 learned_addr learned my addr 172.21.15.53:0/1585248130 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:39.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.370+0000 7f81ced9d640 1 --2- 172.21.15.53:0/1585248130 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5579e26f3050 0x5579e2702590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:39.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.370+0000 7f81ce59c640 1 -- 172.21.15.53:0/1585248130 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5579e26f3050 msgr2=0x5579e2702590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:39.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.370+0000 7f81ce59c640 1 --2- 172.21.15.53:0/1585248130 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5579e26f3050 0x5579e2702590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:39.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.370+0000 7f81ce59c640 1 -- 172.21.15.53:0/1585248130 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5579e26f2740 msgr2=0x5579e2702050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:39.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.370+0000 7f81ce59c640 1 --2- 172.21.15.53:0/1585248130 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5579e26f2740 0x5579e2702050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:39.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.370+0000 7f81ce59c640 1 -- 172.21.15.53:0/1585248130 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5579e26ab450 con 0x5579e26a8d80 2023-06-10T19:06:39.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.370+0000 7f81ce59c640 1 --2- 172.21.15.53:0/1585248130 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5579e26a8d80 0x5579e2705fd0 secure :-1 s=READY pgs=2241 cs=0 l=1 rev1=1 crypto rx=0x7f81c4009380 tx=0x7f81c40be000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7719794c76717b6 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:39.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.370+0000 7f81bcff9640 1 -- 172.21.15.53:0/1585248130 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c40d0070 con 0x5579e26a8d80 2023-06-10T19:06:39.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.370+0000 7f81bcff9640 1 -- 172.21.15.53:0/1585248130 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81c40bd040 con 0x5579e26a8d80 2023-06-10T19:06:39.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.370+0000 7f81bcff9640 1 -- 172.21.15.53:0/1585248130 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c40b6860 con 0x5579e26a8d80 2023-06-10T19:06:39.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.374+0000 7f81d7e58000 1 -- 172.21.15.53:0/1585248130 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5579e26a8d80 msgr2=0x5579e2705fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:39.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.374+0000 7f81d7e58000 1 --2- 172.21.15.53:0/1585248130 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5579e26a8d80 0x5579e2705fd0 secure :-1 s=READY pgs=2241 cs=0 l=1 rev1=1 crypto rx=0x7f81c4009380 tx=0x7f81c40be000 comp rx=0 tx=0).stop 2023-06-10T19:06:39.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.374+0000 7f81d7e58000 1 -- 172.21.15.53:0/1585248130 shutdown_connections 2023-06-10T19:06:39.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.374+0000 7f81d7e58000 1 --2- 172.21.15.53:0/1585248130 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5579e26f3050 0x5579e2702590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:39.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.374+0000 7f81d7e58000 1 --2- 172.21.15.53:0/1585248130 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5579e26f2740 0x5579e2702050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:39.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.374+0000 7f81d7e58000 1 --2- 172.21.15.53:0/1585248130 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5579e26a8d80 0x5579e2705fd0 unknown :-1 s=CLOSED pgs=2241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:39.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.374+0000 7f81d7e58000 1 -- 172.21.15.53:0/1585248130 >> 172.21.15.53:0/1585248130 conn(0x5579e26a0800 msgr2=0x5579e26a7eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:39.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.374+0000 7f81d7e58000 1 -- 172.21.15.53:0/1585248130 shutdown_connections 2023-06-10T19:06:39.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.374+0000 7f81d7e58000 1 -- 172.21.15.53:0/1585248130 wait complete. 2023-06-10T19:06:39.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.374+0000 7f81d7e58000 1 -- start start 2023-06-10T19:06:39.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.374+0000 7f81d7e58000 1 Processor -- start 2023-06-10T19:06:39.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.374+0000 7f81d7e58000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5579e26a8d80 0x5579e2705710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:39.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.374+0000 7f81d7e58000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5579e26f2740 0x5579e270d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:39.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.374+0000 7f81d7e58000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5579e26f3050 0x5579e270da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:39.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.374+0000 7f81d7e58000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579e2494a80 con 0x5579e26a8d80 2023-06-10T19:06:39.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.374+0000 7f81d7e58000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579e24f9ee0 con 0x5579e26f2740 2023-06-10T19:06:39.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.374+0000 7f81d7e58000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x5579e2480970 con 0x5579e26f3050 2023-06-10T19:06:39.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.374+0000 7f81d7e58000 10 client.0 _ll_register_callbacks cb 0x5579e24bb7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-10T19:06:39.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.374+0000 7f81ce59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5579e26a8d80 0x5579e2705710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:39.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.374+0000 7f81ce59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5579e26a8d80 0x5579e2705710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51278/0 (socket says 172.21.15.53:51278) 2023-06-10T19:06:39.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.374+0000 7f81ce59c640 1 -- 172.21.15.53:0/1012905115 learned_addr learned my addr 172.21.15.53:0/1012905115 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:39.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.374+0000 7f81ced9d640 1 --2- 172.21.15.53:0/1012905115 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5579e26f3050 0x5579e270da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:39.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.374+0000 7f81ce59c640 1 -- 172.21.15.53:0/1012905115 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5579e26f3050 msgr2=0x5579e270da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:39.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.374+0000 7f81ce59c640 1 --2- 172.21.15.53:0/1012905115 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5579e26f3050 0x5579e270da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:39.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.374+0000 7f81ce59c640 1 -- 172.21.15.53:0/1012905115 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5579e26f2740 msgr2=0x5579e270d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:39.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.374+0000 7f81ce59c640 1 --2- 172.21.15.53:0/1012905115 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5579e26f2740 0x5579e270d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:39.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.374+0000 7f81ce59c640 1 -- 172.21.15.53:0/1012905115 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5579e24bbd10 con 0x5579e26a8d80 2023-06-10T19:06:39.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.374+0000 7f81ce59c640 1 --2- 172.21.15.53:0/1012905115 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5579e26a8d80 0x5579e2705710 secure :-1 s=READY pgs=2242 cs=0 l=1 rev1=1 crypto rx=0x7f81c401c970 tx=0x7f81c4009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66f28d99e0942cb6 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:39.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.374+0000 7f81ad7fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-06-10T19:06:39.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.374+0000 7f81ad7fa640 1 -- 172.21.15.53:0/1012905115 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c40d0070 con 0x5579e26a8d80 2023-06-10T19:06:39.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.374+0000 7f81ad7fa640 1 -- 172.21.15.53:0/1012905115 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(154..154 src has 1..154) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f81c40e0920 con 0x5579e26a8d80 2023-06-10T19:06:39.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.374+0000 7f81d7e58000 1 -- 172.21.15.53:0/1012905115 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5579e26ac6e0 con 0x5579e26a8d80 2023-06-10T19:06:39.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.374+0000 7f81ad7fa640 1 -- 172.21.15.53:0/1012905115 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7f81c40e0ae0 con 0x5579e26a8d80 2023-06-10T19:06:39.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.374+0000 7f81d7e58000 10 client.10233 fetch_fsmap learned FSMap version 89 2023-06-10T19:06:39.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.374+0000 7f81d7e58000 1 -- 172.21.15.53:0/1012905115 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=2+}) v3 -- 0x5579e24a1fa0 con 0x5579e26a8d80 2023-06-10T19:06:39.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.374+0000 7f81ad7fa640 1 -- 172.21.15.53:0/1012905115 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5579e26ac6e0 con 0x5579e26a8d80 2023-06-10T19:06:39.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.374+0000 7f81ad7fa640 1 -- 172.21.15.53:0/1012905115 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 89) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f81c40e6020 con 0x5579e26a8d80 2023-06-10T19:06:39.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.374+0000 7f81d7e58000 10 client.10233 fetch_fsmap finished waiting for FSMap version 89 2023-06-10T19:06:39.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.374+0000 7f81d7e58000 10 client.10233 resolve_mds: resolved name 'a' to daemon mds.a 2023-06-10T19:06:39.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.374+0000 7f81d7e58000 20 client.10233 populate_metadata read hostname 'smithi053' 2023-06-10T19:06:39.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.374+0000 7f81d7e58000 1 --2- 172.21.15.53:0/1012905115 >> [v2:172.21.15.53:6834/2077620799,v1:172.21.15.53:6835/2077620799] conn(0x5579e2750d10 0x5579e27510e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:39.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.374+0000 7f81d7e58000 4 client.10233 mds_command: new command op to 10044 tid=0[{"prefix": "status"}] 2023-06-10T19:06:39.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.374+0000 7f81d7e58000 1 -- 172.21.15.53:0/1012905115 --> [v2:172.21.15.53:6834/2077620799,v1:172.21.15.53:6835/2077620799] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5579e24f5cd0 con 0x5579e2750d10 2023-06-10T19:06:39.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.374+0000 7f81cdd9b640 1 --2- 172.21.15.53:0/1012905115 >> [v2:172.21.15.53:6834/2077620799,v1:172.21.15.53:6835/2077620799] conn(0x5579e2750d10 0x5579e27510e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:39.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.374+0000 7f81cdd9b640 1 --2- 172.21.15.53:0/1012905115 >> [v2:172.21.15.53:6834/2077620799,v1:172.21.15.53:6835/2077620799] conn(0x5579e2750d10 0x5579e27510e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e35cf7e64bd6f5c server_cookie=46d361b3241a25fd in_seq=0 out_seq=0 2023-06-10T19:06:39.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.374+0000 7f81ad7fa640 10 client.10233 ms_handle_connect on v2:172.21.15.53:6834/2077620799 2023-06-10T19:06:39.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.374+0000 7f81ad7fa640 1 -- 172.21.15.53:0/1012905115 <== mds.0 v2:172.21.15.53:6834/2077620799 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+322 (crc 0 0 0) 0x5579e24f5cd0 con 0x5579e2750d10 2023-06-10T19:06:39.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.374+0000 7f81ad7fa640 10 client.10233 handle_command_reply: tid=0 2023-06-10T19:06:39.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.374+0000 7f81d7e58000 1 client.10233 shutdown 2023-06-10T19:06:39.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.374+0000 7f81d7e58000 1 -- 172.21.15.53:0/1012905115 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5579e26a8d80 msgr2=0x5579e2705710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:39.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.374+0000 7f81d7e58000 1 --2- 172.21.15.53:0/1012905115 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5579e26a8d80 0x5579e2705710 secure :-1 s=READY pgs=2242 cs=0 l=1 rev1=1 crypto rx=0x7f81c401c970 tx=0x7f81c4009240 comp rx=0 tx=0).stop 2023-06-10T19:06:39.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.374+0000 7f81d7e58000 1 -- 172.21.15.53:0/1012905115 shutdown_connections 2023-06-10T19:06:39.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.374+0000 7f81d7e58000 1 --2- 172.21.15.53:0/1012905115 >> [v2:172.21.15.53:6834/2077620799,v1:172.21.15.53:6835/2077620799] conn(0x5579e2750d10 0x5579e27510e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:39.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.374+0000 7f81d7e58000 1 --2- 172.21.15.53:0/1012905115 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x5579e26f3050 0x5579e270da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:39.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.374+0000 7f81d7e58000 1 --2- 172.21.15.53:0/1012905115 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5579e26f2740 0x5579e270d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:39.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.374+0000 7f81d7e58000 1 --2- 172.21.15.53:0/1012905115 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5579e26a8d80 0x5579e2705710 unknown :-1 s=CLOSED pgs=2242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:39.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.374+0000 7f81d7e58000 1 -- 172.21.15.53:0/1012905115 >> 172.21.15.53:0/1012905115 conn(0x5579e26a0800 msgr2=0x5579e26f10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:39.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.378+0000 7f81ad7fa640 0 client.10233 ms_handle_reset on v2:172.21.15.53:6834/2077620799 2023-06-10T19:06:39.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.378+0000 7f81d7e58000 1 -- 172.21.15.53:0/1012905115 shutdown_connections 2023-06-10T19:06:39.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.378+0000 7f81d7e58000 1 -- 172.21.15.53:0/1012905115 wait complete. 2023-06-10T19:06:39.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.378+0000 7f81d7e58000 20 client.10233 trim_cache size 0 max 16384 2023-06-10T19:06:39.388 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-06-10T19:06:39.388 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_fsid": "c8c64bed-c406-4936-93f9-d16335f1067d", 2023-06-10T19:06:39.388 INFO:teuthology.orchestra.run.smithi053.stdout: "whoami": 0, 2023-06-10T19:06:39.389 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 10044, 2023-06-10T19:06:39.389 INFO:teuthology.orchestra.run.smithi053.stdout: "want_state": "up:active", 2023-06-10T19:06:39.389 INFO:teuthology.orchestra.run.smithi053.stdout: "state": "up:active", 2023-06-10T19:06:39.389 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs", 2023-06-10T19:06:39.389 INFO:teuthology.orchestra.run.smithi053.stdout: "rank_uptime": 10.657486319, 2023-06-10T19:06:39.389 INFO:teuthology.orchestra.run.smithi053.stdout: "mdsmap_epoch": 89, 2023-06-10T19:06:39.389 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch": 154, 2023-06-10T19:06:39.389 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch_barrier": 154, 2023-06-10T19:06:39.390 INFO:teuthology.orchestra.run.smithi053.stdout: "uptime": 15.097185283 2023-06-10T19:06:39.390 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-06-10T19:06:39.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.378+0000 7f81d4d3c640 1 -- 172.21.15.53:0/3683400816 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f81b0066280 msgr2=0x7f81b0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:39.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.378+0000 7f81d4d3c640 1 --2- 172.21.15.53:0/3683400816 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f81b0066280 0x7f81b0068730 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f81c40ae000 tx=0x7f81c40a7000 comp rx=0 tx=0).stop 2023-06-10T19:06:39.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.378+0000 7f81d4d3c640 1 -- 172.21.15.53:0/3683400816 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f81d0159a60 msgr2=0x7f81d01452d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:39.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.378+0000 7f81d4d3c640 1 --2- 172.21.15.53:0/3683400816 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f81d0159a60 0x7f81d01452d0 secure :-1 s=READY pgs=2238 cs=0 l=1 rev1=1 crypto rx=0x7f81c800b970 tx=0x7f81c800be30 comp rx=0 tx=0).stop 2023-06-10T19:06:39.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.378+0000 7f81d4d3c640 1 -- 172.21.15.53:0/3683400816 shutdown_connections 2023-06-10T19:06:39.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.378+0000 7f81d4d3c640 1 --2- 172.21.15.53:0/3683400816 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f81b0066280 0x7f81b0068730 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:39.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.378+0000 7f81d4d3c640 1 --2- 172.21.15.53:0/3683400816 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f81d0159a60 0x7f81d01452d0 unknown :-1 s=CLOSED pgs=2238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:39.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.378+0000 7f81d4d3c640 1 --2- 172.21.15.53:0/3683400816 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81d0159690 0x7f81d014e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:39.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.378+0000 7f81d4d3c640 1 --2- 172.21.15.53:0/3683400816 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f81d00b0f30 0x7f81d0144b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:39.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.378+0000 7f81d4d3c640 1 -- 172.21.15.53:0/3683400816 >> 172.21.15.53:0/3683400816 conn(0x7f81d006a560 msgr2=0x7f81d014fcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:39.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.378+0000 7f81d4d3c640 1 -- 172.21.15.53:0/3683400816 shutdown_connections 2023-06-10T19:06:39.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.378+0000 7f81d4d3c640 1 -- 172.21.15.53:0/3683400816 wait complete. 2023-06-10T19:06:39.394 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-10T19:06:39.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.498+0000 7f2bc7df7640 1 Processor -- start 2023-06-10T19:06:39.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.498+0000 7f2bc7df7640 1 -- start start 2023-06-10T19:06:39.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.498+0000 7f2bc7df7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2bc0157cf0 0x7f2bc00ca6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:39.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.498+0000 7f2bc7df7640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2bc00affc0 0x7f2bc00b0410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:39.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.498+0000 7f2bc7df7640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bc00b0950 con 0x7f2bc015b8e0 2023-06-10T19:06:39.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.498+0000 7f2bc7df7640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bc006fa60 con 0x7f2bc00affc0 2023-06-10T19:06:39.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.498+0000 7f2bc7df7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc006a340 con 0x7f2bc0157cf0 2023-06-10T19:06:39.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.498+0000 7f2bc5b93640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2bc0157cf0 0x7f2bc00ca6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:39.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.498+0000 7f2bc5392640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2bc00affc0 0x7f2bc00b0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:39.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.498+0000 7f2bc5b93640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2bc0157cf0 0x7f2bc00ca6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.53:44476/0 (socket says 172.21.15.53:44476) 2023-06-10T19:06:39.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.498+0000 7f2bc5b93640 1 -- 172.21.15.53:0/3578654027 learned_addr learned my addr 172.21.15.53:0/3578654027 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:39.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.498+0000 7f2bc6394640 1 --1- 172.21.15.53:0/3578654027 >> v1:172.21.15.117:6789/0 conn(0x7f2bc015b8e0 0x7f2bc015bd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.53:39944/0 (socket says 172.21.15.53:39944) 2023-06-10T19:06:39.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.498+0000 7f2bc5b93640 1 -- 172.21.15.53:0/3578654027 >> v2:172.21.15.117:3300/0 conn(0x7f2bc00affc0 msgr2=0x7f2bc00b0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:39.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.498+0000 7f2bc5b93640 1 --2- 172.21.15.53:0/3578654027 >> v2:172.21.15.117:3300/0 conn(0x7f2bc00affc0 0x7f2bc00b0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:39.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.498+0000 7f2bc5b93640 1 -- 172.21.15.53:0/3578654027 >> v1:172.21.15.117:6789/0 conn(0x7f2bc015b8e0 legacy=0x7f2bc015bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:39.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.498+0000 7f2bc5b93640 1 -- 172.21.15.53:0/3578654027 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bc00c9250 con 0x7f2bc0157cf0 2023-06-10T19:06:39.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.502+0000 7f2bc5b93640 1 --2- 172.21.15.53:0/3578654027 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2bc0157cf0 0x7f2bc00ca6f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2bb800d150 tx=0x7f2bb801ebe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c77fffedaaf9e047 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:39.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.502+0000 7f2bc4b91640 1 -- 172.21.15.53:0/3578654027 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb80a7cb0 con 0x7f2bc0157cf0 2023-06-10T19:06:39.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.502+0000 7f2bc4b91640 1 -- 172.21.15.53:0/3578654027 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bb80ab070 con 0x7f2bc0157cf0 2023-06-10T19:06:39.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.502+0000 7f2bc4b91640 1 -- 172.21.15.53:0/3578654027 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb80b1620 con 0x7f2bc0157cf0 2023-06-10T19:06:39.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.502+0000 7f2bc7df7640 1 -- 172.21.15.53:0/3578654027 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2bc0157cf0 msgr2=0x7f2bc00ca6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:39.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.502+0000 7f2bc7df7640 1 --2- 172.21.15.53:0/3578654027 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2bc0157cf0 0x7f2bc00ca6f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2bb800d150 tx=0x7f2bb801ebe0 comp rx=0 tx=0).stop 2023-06-10T19:06:39.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.502+0000 7f2bc7df7640 1 -- 172.21.15.53:0/3578654027 shutdown_connections 2023-06-10T19:06:39.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.502+0000 7f2bc7df7640 1 --2- 172.21.15.53:0/3578654027 >> v2:172.21.15.117:3300/0 conn(0x7f2bc00affc0 0x7f2bc00b0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:39.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.502+0000 7f2bc7df7640 1 --2- 172.21.15.53:0/3578654027 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2bc0157cf0 0x7f2bc00ca6f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:39.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.502+0000 7f2bc7df7640 1 -- 172.21.15.53:0/3578654027 >> 172.21.15.53:0/3578654027 conn(0x7f2bc00cafc0 msgr2=0x7f2bc00cb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:39.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.502+0000 7f2bc7df7640 1 -- 172.21.15.53:0/3578654027 shutdown_connections 2023-06-10T19:06:39.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.502+0000 7f2bc7df7640 1 -- 172.21.15.53:0/3578654027 wait complete. 2023-06-10T19:06:39.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.506+0000 7f2bc7df7640 1 Processor -- start 2023-06-10T19:06:39.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.506+0000 7f2bc7df7640 1 -- start start 2023-06-10T19:06:39.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.506+0000 7f2bc7df7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2bc00affc0 0x7f2bc00c4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:39.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.506+0000 7f2bc7df7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2bc0157cf0 0x7f2bc00c4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:39.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.506+0000 7f2bc7df7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bc015b8e0 0x7f2bc00c3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:39.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.506+0000 7f2bc7df7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc014a5a0 con 0x7f2bc015b8e0 2023-06-10T19:06:39.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.506+0000 7f2bc7df7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc01514c0 con 0x7f2bc00affc0 2023-06-10T19:06:39.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.506+0000 7f2bc7df7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc01517a0 con 0x7f2bc0157cf0 2023-06-10T19:06:39.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.506+0000 7f2bc6394640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bc015b8e0 0x7f2bc00c3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:39.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.506+0000 7f2bc6394640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bc015b8e0 0x7f2bc00c3400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51288/0 (socket says 172.21.15.53:51288) 2023-06-10T19:06:39.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.506+0000 7f2bc6394640 1 -- 172.21.15.53:0/2257103167 learned_addr learned my addr 172.21.15.53:0/2257103167 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:39.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.506+0000 7f2bc5392640 1 --2- 172.21.15.53:0/2257103167 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2bc0157cf0 0x7f2bc00c4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:39.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.506+0000 7f2bc5b93640 1 --2- 172.21.15.53:0/2257103167 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2bc00affc0 0x7f2bc00c4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:39.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.506+0000 7f2bc6394640 1 -- 172.21.15.53:0/2257103167 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2bc0157cf0 msgr2=0x7f2bc00c4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:39.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.506+0000 7f2bc6394640 1 --2- 172.21.15.53:0/2257103167 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2bc0157cf0 0x7f2bc00c4280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:39.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.506+0000 7f2bc6394640 1 -- 172.21.15.53:0/2257103167 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2bc00affc0 msgr2=0x7f2bc00c4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:39.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.506+0000 7f2bc6394640 1 --2- 172.21.15.53:0/2257103167 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2bc00affc0 0x7f2bc00c4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:39.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.506+0000 7f2bc6394640 1 -- 172.21.15.53:0/2257103167 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bb800bd40 con 0x7f2bc015b8e0 2023-06-10T19:06:39.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.506+0000 7f2bc6394640 1 --2- 172.21.15.53:0/2257103167 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bc015b8e0 0x7f2bc00c3400 secure :-1 s=READY pgs=2243 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc00c3c0 tx=0x7f2bbc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:39.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.506+0000 7f2bb67fc640 1 -- 172.21.15.53:0/2257103167 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bbc0074e0 con 0x7f2bc015b8e0 2023-06-10T19:06:39.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.506+0000 7f2bc7df7640 1 -- 172.21.15.53:0/2257103167 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bc00cadb0 con 0x7f2bc015b8e0 2023-06-10T19:06:39.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.506+0000 7f2bb67fc640 1 -- 172.21.15.53:0/2257103167 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bbc007640 con 0x7f2bc015b8e0 2023-06-10T19:06:39.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.506+0000 7f2bb67fc640 1 -- 172.21.15.53:0/2257103167 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bbc004a10 con 0x7f2bc015b8e0 2023-06-10T19:06:39.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.506+0000 7f2bc7df7640 1 -- 172.21.15.53:0/2257103167 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bc014bd20 con 0x7f2bc015b8e0 2023-06-10T19:06:39.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.506+0000 7f2bc7df7640 1 -- 172.21.15.53:0/2257103167 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bc004d790 con 0x7f2bc015b8e0 2023-06-10T19:06:39.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.506+0000 7f2bb67fc640 1 -- 172.21.15.53:0/2257103167 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2bbc004b70 con 0x7f2bc015b8e0 2023-06-10T19:06:39.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.506+0000 7f2bb67fc640 1 --2- 172.21.15.53:0/2257103167 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2ba4066280 0x7f2ba4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:39.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.506+0000 7f2bb67fc640 1 -- 172.21.15.53:0/2257103167 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2bbc0836c0 con 0x7f2bc015b8e0 2023-06-10T19:06:39.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.510+0000 7f2bc5b93640 1 --2- 172.21.15.53:0/2257103167 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2ba4066280 0x7f2ba4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:39.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.510+0000 7f2bc5b93640 1 --2- 172.21.15.53:0/2257103167 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2ba4066280 0x7f2ba4068730 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f2bb80b2000 tx=0x7f2bb80a9070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:39.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.510+0000 7f2bb67fc640 1 -- 172.21.15.53:0/2257103167 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2bbc050a20 con 0x7f2bc015b8e0 2023-06-10T19:06:39.697 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.694+0000 7f2bc7df7640 1 -- 172.21.15.53:0/2257103167 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2bc00b0950 con 0x7f2bc015b8e0 2023-06-10T19:06:39.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.694+0000 7f2bb67fc640 1 -- 172.21.15.53:0/2257103167 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v89) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2bc00b0950 con 0x7f2bc015b8e0 2023-06-10T19:06:39.698 INFO:teuthology.orchestra.run.smithi053.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-06-10T19:06:39.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.698+0000 7f2bc7df7640 1 -- 172.21.15.53:0/2257103167 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2ba4066280 msgr2=0x7f2ba4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:39.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.698+0000 7f2bc7df7640 1 --2- 172.21.15.53:0/2257103167 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2ba4066280 0x7f2ba4068730 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f2bb80b2000 tx=0x7f2bb80a9070 comp rx=0 tx=0).stop 2023-06-10T19:06:39.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.698+0000 7f2bc7df7640 1 -- 172.21.15.53:0/2257103167 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bc015b8e0 msgr2=0x7f2bc00c3400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:39.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.698+0000 7f2bc7df7640 1 --2- 172.21.15.53:0/2257103167 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bc015b8e0 0x7f2bc00c3400 secure :-1 s=READY pgs=2243 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc00c3c0 tx=0x7f2bbc00c880 comp rx=0 tx=0).stop 2023-06-10T19:06:39.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.698+0000 7f2bc7df7640 1 -- 172.21.15.53:0/2257103167 shutdown_connections 2023-06-10T19:06:39.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.698+0000 7f2bc7df7640 1 --2- 172.21.15.53:0/2257103167 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2ba4066280 0x7f2ba4068730 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:39.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.698+0000 7f2bc7df7640 1 --2- 172.21.15.53:0/2257103167 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2bc015b8e0 0x7f2bc00c3400 unknown :-1 s=CLOSED pgs=2243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:39.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.698+0000 7f2bc7df7640 1 --2- 172.21.15.53:0/2257103167 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2bc0157cf0 0x7f2bc00c4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:39.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.698+0000 7f2bc7df7640 1 --2- 172.21.15.53:0/2257103167 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2bc00affc0 0x7f2bc00c4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:39.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.698+0000 7f2bc7df7640 1 -- 172.21.15.53:0/2257103167 >> 172.21.15.53:0/2257103167 conn(0x7f2bc00cafc0 msgr2=0x7f2bc015bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:39.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.698+0000 7f2bc7df7640 1 -- 172.21.15.53:0/2257103167 shutdown_connections 2023-06-10T19:06:39.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:39.698+0000 7f2bc7df7640 1 -- 172.21.15.53:0/2257103167 wait complete. 2023-06-10T19:06:39.716 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-10T19:06:39.716 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-10T19:06:39.716 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi053.front.sepia.ceph.com 2023-06-10T19:06:39.717 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-06-10T19:06:39.717 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-06-10T19:06:39.717 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-10T19:06:39.717 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-10T19:06:39.718 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-10T19:06:39.718 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-06-10T19:06:39.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:06:39.719 DEBUG:teuthology.orchestra.run.smithi053:> ip addr 2023-06-10T19:06:39.724 INFO:teuthology.orchestra.run.smithi053.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-10T19:06:39.725 INFO:teuthology.orchestra.run.smithi053.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-10T19:06:39.725 INFO:teuthology.orchestra.run.smithi053.stdout: inet 127.0.0.1/8 scope host lo 2023-06-10T19:06:39.725 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:06:39.725 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 ::1/128 scope host 2023-06-10T19:06:39.725 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:06:39.725 INFO:teuthology.orchestra.run.smithi053.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T19:06:39.726 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:da brd ff:ff:ff:ff:ff:ff 2023-06-10T19:06:39.726 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f0 2023-06-10T19:06:39.726 INFO:teuthology.orchestra.run.smithi053.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T19:06:39.726 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:db brd ff:ff:ff:ff:ff:ff 2023-06-10T19:06:39.726 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f1 2023-06-10T19:06:39.726 INFO:teuthology.orchestra.run.smithi053.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-10T19:06:39.726 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:18 brd ff:ff:ff:ff:ff:ff 2023-06-10T19:06:39.727 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f0 2023-06-10T19:06:39.727 INFO:teuthology.orchestra.run.smithi053.stdout: inet 172.21.15.53/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-06-10T19:06:39.727 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft 41650sec preferred_lft 41650sec 2023-06-10T19:06:39.727 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::ae1f:6bff:fef8:3718/64 scope link 2023-06-10T19:06:39.727 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:06:39.727 INFO:teuthology.orchestra.run.smithi053.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T19:06:39.727 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:19 brd ff:ff:ff:ff:ff:ff 2023-06-10T19:06:39.727 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f1 2023-06-10T19:06:39.728 INFO:teuthology.orchestra.run.smithi053.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-06-10T19:06:39.728 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 02:42:49:3d:ee:1e brd ff:ff:ff:ff:ff:ff 2023-06-10T19:06:39.728 INFO:teuthology.orchestra.run.smithi053.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-06-10T19:06:39.728 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:06:39.728 INFO:teuthology.orchestra.run.smithi053.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-10T19:06:39.728 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-06-10T19:06:39.728 INFO:teuthology.orchestra.run.smithi053.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-06-10T19:06:39.729 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:06:39.729 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-06-10T19:06:39.729 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:06:39.729 INFO:teuthology.orchestra.run.smithi053.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-10T19:06:39.729 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-06-10T19:06:39.729 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-06-10T19:06:39.729 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:06:39.729 INFO:teuthology.orchestra.run.smithi053.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-10T19:06:39.730 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-06-10T19:06:39.730 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-06-10T19:06:39.730 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:06:39.730 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:06:39.731 DEBUG:teuthology.orchestra.run.smithi053:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-10T19:06:39.776 INFO:teuthology.orchestra.run.smithi053.stdout:1 2023-06-10T19:06:39.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:06:39.778 DEBUG:teuthology.orchestra.run.smithi053:> route 2023-06-10T19:06:39.824 INFO:teuthology.orchestra.run.smithi053.stdout:Kernel IP routing table 2023-06-10T19:06:39.824 INFO:teuthology.orchestra.run.smithi053.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-10T19:06:39.825 INFO:teuthology.orchestra.run.smithi053.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-06-10T19:06:39.825 INFO:teuthology.orchestra.run.smithi053.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-06-10T19:06:39.825 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-06-10T19:06:39.825 INFO:teuthology.orchestra.run.smithi053.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-10T19:06:39.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:06:39.826 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec bash -c ' 2023-06-10T19:06:39.826 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2023-06-10T19:06:39.827 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-06-10T19:06:39.827 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-06-10T19:06:39.827 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-06-10T19:06:39.828 DEBUG:teuthology.orchestra.run.smithi053:> ') 2023-06-10T19:06:39.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:06:39.899 DEBUG:teuthology.orchestra.run.smithi053:> ip netns list 2023-06-10T19:06:39.947 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-06-10T19:06:39.947 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-06-10T19:06:39.947 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-06-10T19:06:39.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:06:39.948 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link set brx.0 up 2023-06-10T19:06:40.003 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-06-10T19:06:40.003 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-10T19:06:40.004 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-06-10T19:06:40.051 INFO:teuthology.orchestra.run.smithi053.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-06-10T19:06:40.052 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-10T19:06:40.052 DEBUG:teuthology.orchestra.run.smithi053:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-06-10T19:06:40.099 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2023-06-10T19:06:40.161 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T19:06:40.161 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T19:06:40.213 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T19:06:40.214 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T19:06:40.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:06:40.215 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2023-06-10T19:06:40.263 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-06-10T19:06:40.263 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-06-10T19:06:40.308 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2023-06-10T19:06:40.322 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T19:06:40.323 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T19:06:40.377 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T19:06:40.378 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T19:06:40.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:06:40.379 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2023-06-10T19:06:40.393 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:2023-06-10T19:06:40.390+0000 7fbcd9e99580 -1 init, newargv = 0x55afa8832cc0 newargc=15 2023-06-10T19:06:40.393 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[66536]: starting ceph client 2023-06-10T19:06:40.399 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[66536]: starting fuse 2023-06-10T19:06:41.498 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2023-06-10T19:06:41.515 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T19:06:41.516 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T19:06:41.571 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T19:06:41.572 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T19:06:41.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:06:41.573 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2023-06-10T19:06:41.619 INFO:teuthology.orchestra.run.smithi053.stdout:45 2023-06-10T19:06:41.619 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-06-10T19:06:41.620 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-06-10T19:06:41.620 DEBUG:teuthology.orchestra.run.smithi053:> import glob 2023-06-10T19:06:41.620 DEBUG:teuthology.orchestra.run.smithi053:> import re 2023-06-10T19:06:41.621 DEBUG:teuthology.orchestra.run.smithi053:> import os 2023-06-10T19:06:41.621 DEBUG:teuthology.orchestra.run.smithi053:> import subprocess 2023-06-10T19:06:41.621 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:06:41.622 DEBUG:teuthology.orchestra.run.smithi053:> def _find_admin_socket(client_name): 2023-06-10T19:06:41.622 DEBUG:teuthology.orchestra.run.smithi053:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-06-10T19:06:41.622 DEBUG:teuthology.orchestra.run.smithi053:> files = glob.glob(asok_path) 2023-06-10T19:06:41.622 DEBUG:teuthology.orchestra.run.smithi053:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-06-10T19:06:41.623 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:06:41.623 DEBUG:teuthology.orchestra.run.smithi053:> # Given a non-glob path, it better be there 2023-06-10T19:06:41.623 DEBUG:teuthology.orchestra.run.smithi053:> if "*" not in asok_path: 2023-06-10T19:06:41.624 DEBUG:teuthology.orchestra.run.smithi053:> assert(len(files) == 1) 2023-06-10T19:06:41.624 DEBUG:teuthology.orchestra.run.smithi053:> return files[0] 2023-06-10T19:06:41.624 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:06:41.625 DEBUG:teuthology.orchestra.run.smithi053:> for f in files: 2023-06-10T19:06:41.625 DEBUG:teuthology.orchestra.run.smithi053:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-06-10T19:06:41.625 DEBUG:teuthology.orchestra.run.smithi053:> if os.path.exists("/proc/{0}".format(pid)): 2023-06-10T19:06:41.625 DEBUG:teuthology.orchestra.run.smithi053:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-06-10T19:06:41.626 DEBUG:teuthology.orchestra.run.smithi053:> contents = proc_f.read() 2023-06-10T19:06:41.626 DEBUG:teuthology.orchestra.run.smithi053:> if mountpoint in contents: 2023-06-10T19:06:41.626 DEBUG:teuthology.orchestra.run.smithi053:> return f 2023-06-10T19:06:41.627 DEBUG:teuthology.orchestra.run.smithi053:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-06-10T19:06:41.627 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:06:41.627 DEBUG:teuthology.orchestra.run.smithi053:> print(_find_admin_socket("client.0")) 2023-06-10T19:06:41.627 DEBUG:teuthology.orchestra.run.smithi053:> ' 2023-06-10T19:06:41.742 INFO:teuthology.orchestra.run.smithi053.stdout:/var/run/ceph/ceph-client.0.66536.asok 2023-06-10T19:06:41.924 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.66536.asok 2023-06-10T19:06:41.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:06:41.925 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.66536.asok status 2023-06-10T19:06:42.085 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-06-10T19:06:42.085 INFO:teuthology.orchestra.run.smithi053.stdout: "metadata": { 2023-06-10T19:06:42.086 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_sha1": "219d315c3a0b2075e570fb1964be2ad33fe7a9c8", 2023-06-10T19:06:42.086 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_version": "ceph version 18.0.0-4359-g219d315c (219d315c3a0b2075e570fb1964be2ad33fe7a9c8) reef (dev)", 2023-06-10T19:06:42.086 INFO:teuthology.orchestra.run.smithi053.stdout: "entity_id": "0", 2023-06-10T19:06:42.086 INFO:teuthology.orchestra.run.smithi053.stdout: "hostname": "smithi053", 2023-06-10T19:06:42.086 INFO:teuthology.orchestra.run.smithi053.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-06-10T19:06:42.086 INFO:teuthology.orchestra.run.smithi053.stdout: "pid": "66536", 2023-06-10T19:06:42.086 INFO:teuthology.orchestra.run.smithi053.stdout: "root": "/" 2023-06-10T19:06:42.087 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:06:42.087 INFO:teuthology.orchestra.run.smithi053.stdout: "dentry_count": 0, 2023-06-10T19:06:42.087 INFO:teuthology.orchestra.run.smithi053.stdout: "dentry_pinned_count": 0, 2023-06-10T19:06:42.087 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 10245, 2023-06-10T19:06:42.087 INFO:teuthology.orchestra.run.smithi053.stdout: "inst": { 2023-06-10T19:06:42.087 INFO:teuthology.orchestra.run.smithi053.stdout: "name": { 2023-06-10T19:06:42.087 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "client", 2023-06-10T19:06:42.087 INFO:teuthology.orchestra.run.smithi053.stdout: "num": 10245 2023-06-10T19:06:42.088 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:06:42.088 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": { 2023-06-10T19:06:42.088 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2023-06-10T19:06:42.088 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "192.168.0.1:0", 2023-06-10T19:06:42.088 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 2213488734 2023-06-10T19:06:42.088 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:06:42.088 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:06:42.088 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": { 2023-06-10T19:06:42.089 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2023-06-10T19:06:42.089 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "192.168.0.1:0", 2023-06-10T19:06:42.089 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 2213488734 2023-06-10T19:06:42.089 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:06:42.089 INFO:teuthology.orchestra.run.smithi053.stdout: "inst_str": "client.10245 192.168.0.1:0/2213488734", 2023-06-10T19:06:42.089 INFO:teuthology.orchestra.run.smithi053.stdout: "addr_str": "192.168.0.1:0/2213488734", 2023-06-10T19:06:42.089 INFO:teuthology.orchestra.run.smithi053.stdout: "inode_count": 1, 2023-06-10T19:06:42.089 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_epoch": 89, 2023-06-10T19:06:42.090 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_epoch": 154, 2023-06-10T19:06:42.090 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_epoch_barrier": 0, 2023-06-10T19:06:42.090 INFO:teuthology.orchestra.run.smithi053.stdout: "blocklisted": false, 2023-06-10T19:06:42.090 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs" 2023-06-10T19:06:42.090 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-06-10T19:06:42.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:06:42.099 DEBUG:teuthology.orchestra.run.smithi053:> stat --file-system '--printf=%T 2023-06-10T19:06:42.100 DEBUG:teuthology.orchestra.run.smithi053:> ' -- /home/ubuntu/cephtest/mnt.0 2023-06-10T19:06:42.106 INFO:teuthology.orchestra.run.smithi053.stdout:fuseblk 2023-06-10T19:06:42.107 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-06-10T19:06:42.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:06:42.109 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-06-10T19:06:42.164 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-10T19:06:42.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.330+0000 7f1e71e15640 1 Processor -- start 2023-06-10T19:06:42.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.334+0000 7f1e71e15640 1 -- start start 2023-06-10T19:06:42.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.334+0000 7f1e71e15640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e6c0b3ac0 0x7f1e6c0b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:42.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.334+0000 7f1e71e15640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e6c0d0020 con 0x7f1e6c0d14c0 2023-06-10T19:06:42.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.334+0000 7f1e71e15640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e6c160190 con 0x7f1e6c0cc690 2023-06-10T19:06:42.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.334+0000 7f1e71e15640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6c0b43d0 con 0x7f1e6c0b3ac0 2023-06-10T19:06:42.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.334+0000 7f1e6bfff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f1e6c0d14c0 0x7f1e6c15fa80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:36668/0 (socket says 172.21.15.53:36668) 2023-06-10T19:06:42.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.334+0000 7f1e6bfff640 1 -- 172.21.15.53:0/3082556287 learned_addr learned my addr 172.21.15.53:0/3082556287 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:06:42.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.334+0000 7f1e6b7fe640 1 --2- 172.21.15.53:0/3082556287 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e6c0b3ac0 0x7f1e6c0b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:42.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.334+0000 7f1e6affd640 1 -- 172.21.15.53:0/3082556287 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3070894985 0 0) 0x7f1e6c0d0020 con 0x7f1e6c0d14c0 2023-06-10T19:06:42.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.334+0000 7f1e6affd640 1 -- 172.21.15.53:0/3082556287 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e58003530 con 0x7f1e6c0d14c0 2023-06-10T19:06:42.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.334+0000 7f1e6affd640 1 -- 172.21.15.53:0/3082556287 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 453823936 0 0) 0x7f1e58003530 con 0x7f1e6c0d14c0 2023-06-10T19:06:42.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.334+0000 7f1e6affd640 1 -- 172.21.15.53:0/3082556287 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e6c0b3ac0 msgr2=0x7f1e6c0b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:42.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.334+0000 7f1e6affd640 1 --2- 172.21.15.53:0/3082556287 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e6c0b3ac0 0x7f1e6c0b3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:42.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.334+0000 7f1e6affd640 1 -- 172.21.15.53:0/3082556287 >> v1:172.21.15.117:6789/0 conn(0x7f1e6c0cc690 legacy=0x7f1e6c15f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:42.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.334+0000 7f1e6affd640 1 -- 172.21.15.53:0/3082556287 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e6c0cef40 con 0x7f1e6c0d14c0 2023-06-10T19:06:42.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.334+0000 7f1e6affd640 1 -- 172.21.15.53:0/3082556287 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f1e64001a00 con 0x7f1e6c0d14c0 2023-06-10T19:06:42.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.334+0000 7f1e6affd640 1 -- 172.21.15.53:0/3082556287 >> v1:172.21.15.53:6789/0 conn(0x7f1e6c0d14c0 legacy=0x7f1e6c15fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:42.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.334+0000 7f1e6affd640 1 --2- 172.21.15.53:0/3082556287 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e6c0b3ac0 0x7f1e58003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:42.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.334+0000 7f1e6affd640 1 --2- 172.21.15.53:0/3082556287 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e58003fa0 0x7f1e580047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:42.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.334+0000 7f1e6affd640 1 --2- 172.21.15.53:0/3082556287 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e58004d10 0x7f1e58005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:42.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.334+0000 7f1e6affd640 1 -- 172.21.15.53:0/3082556287 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6c0b43d0 con 0x7f1e58003fa0 2023-06-10T19:06:42.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.334+0000 7f1e6affd640 1 -- 172.21.15.53:0/3082556287 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e5800bad0 con 0x7f1e58004d10 2023-06-10T19:06:42.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.334+0000 7f1e6affd640 1 -- 172.21.15.53:0/3082556287 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e5800bc90 con 0x7f1e6c0b3ac0 2023-06-10T19:06:42.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.334+0000 7f1e63fff640 1 --2- 172.21.15.53:0/3082556287 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e58003fa0 0x7f1e580047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:42.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.334+0000 7f1e6bfff640 1 --2- 172.21.15.53:0/3082556287 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e58004d10 0x7f1e58005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:42.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.334+0000 7f1e63fff640 1 -- 172.21.15.53:0/3082556287 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e6c0b3ac0 msgr2=0x7f1e58003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:42.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.334+0000 7f1e6b7fe640 1 --2- 172.21.15.53:0/3082556287 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e6c0b3ac0 0x7f1e58003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:42.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.334+0000 7f1e63fff640 1 --2- 172.21.15.53:0/3082556287 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e6c0b3ac0 0x7f1e58003a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:42.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.334+0000 7f1e63fff640 1 -- 172.21.15.53:0/3082556287 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e58004d10 msgr2=0x7f1e58005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:42.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.334+0000 7f1e63fff640 1 --2- 172.21.15.53:0/3082556287 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e58004d10 0x7f1e58005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:42.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.334+0000 7f1e63fff640 1 -- 172.21.15.53:0/3082556287 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e58003530 con 0x7f1e58003fa0 2023-06-10T19:06:42.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.334+0000 7f1e6bfff640 1 --2- 172.21.15.53:0/3082556287 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e58004d10 0x7f1e58005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:06:42.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.334+0000 7f1e6b7fe640 1 --2- 172.21.15.53:0/3082556287 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e6c0b3ac0 0x7f1e58003a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:06:42.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.338+0000 7f1e63fff640 1 --2- 172.21.15.53:0/3082556287 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e58003fa0 0x7f1e580047d0 secure :-1 s=READY pgs=2248 cs=0 l=1 rev1=1 crypto rx=0x7f1e54001780 tx=0x7f1e5401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aa8378ae90cde3c server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:42.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.338+0000 7f1e6affd640 1 -- 172.21.15.53:0/3082556287 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e540052d0 con 0x7f1e58003fa0 2023-06-10T19:06:42.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.338+0000 7f1e6affd640 1 -- 172.21.15.53:0/3082556287 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e540a7050 con 0x7f1e58003fa0 2023-06-10T19:06:42.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.338+0000 7f1e6affd640 1 -- 172.21.15.53:0/3082556287 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e54003600 con 0x7f1e58003fa0 2023-06-10T19:06:42.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.338+0000 7f1e71e15640 1 -- 172.21.15.53:0/3082556287 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e58003fa0 msgr2=0x7f1e580047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:42.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.338+0000 7f1e71e15640 1 --2- 172.21.15.53:0/3082556287 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e58003fa0 0x7f1e580047d0 secure :-1 s=READY pgs=2248 cs=0 l=1 rev1=1 crypto rx=0x7f1e54001780 tx=0x7f1e5401c400 comp rx=0 tx=0).stop 2023-06-10T19:06:42.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.338+0000 7f1e6bfff640 1 -- 172.21.15.53:0/3082556287 reap_dead start 2023-06-10T19:06:42.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.338+0000 7f1e71e15640 1 -- 172.21.15.53:0/3082556287 shutdown_connections 2023-06-10T19:06:42.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.338+0000 7f1e71e15640 1 -- 172.21.15.53:0/3082556287 >> 172.21.15.53:0/3082556287 conn(0x7f1e6c071790 msgr2=0x7f1e6c069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:42.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.338+0000 7f1e71e15640 1 -- 172.21.15.53:0/3082556287 shutdown_connections 2023-06-10T19:06:42.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.338+0000 7f1e71e15640 1 -- 172.21.15.53:0/3082556287 wait complete. 2023-06-10T19:06:42.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.338+0000 7f1e71e15640 1 Processor -- start 2023-06-10T19:06:42.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.338+0000 7f1e71e15640 1 -- start start 2023-06-10T19:06:42.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.338+0000 7f1e71e15640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e58003fa0 0x7f1e6c157240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:42.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.338+0000 7f1e71e15640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e6c0cbce0 0x7f1e6c15ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:42.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.338+0000 7f1e71e15640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e6c0ce4b0 0x7f1e6c1f1410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:42.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.338+0000 7f1e71e15640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6c157780 con 0x7f1e6c0ce4b0 2023-06-10T19:06:42.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.338+0000 7f1e71e15640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6c15bf30 con 0x7f1e6c0cbce0 2023-06-10T19:06:42.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.338+0000 7f1e71e15640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6c15c210 con 0x7f1e58003fa0 2023-06-10T19:06:42.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.338+0000 7f1e6bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e6c0ce4b0 0x7f1e6c1f1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:42.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.338+0000 7f1e6bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e6c0ce4b0 0x7f1e6c1f1410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52920/0 (socket says 172.21.15.53:52920) 2023-06-10T19:06:42.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.338+0000 7f1e6bfff640 1 -- 172.21.15.53:0/2420148296 learned_addr learned my addr 172.21.15.53:0/2420148296 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:42.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.342+0000 7f1e63fff640 1 --2- 172.21.15.53:0/2420148296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e6c0cbce0 0x7f1e6c15ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:42.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.342+0000 7f1e6b7fe640 1 --2- 172.21.15.53:0/2420148296 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e58003fa0 0x7f1e6c157240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:42.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.342+0000 7f1e6bfff640 1 -- 172.21.15.53:0/2420148296 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e58003fa0 msgr2=0x7f1e6c157240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:42.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.342+0000 7f1e6bfff640 1 --2- 172.21.15.53:0/2420148296 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e58003fa0 0x7f1e6c157240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:42.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.342+0000 7f1e6bfff640 1 -- 172.21.15.53:0/2420148296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e6c0cbce0 msgr2=0x7f1e6c15ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:42.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.342+0000 7f1e6bfff640 1 --2- 172.21.15.53:0/2420148296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e6c0cbce0 0x7f1e6c15ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:42.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.342+0000 7f1e6bfff640 1 -- 172.21.15.53:0/2420148296 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e6c15c4f0 con 0x7f1e6c0ce4b0 2023-06-10T19:06:42.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.342+0000 7f1e6bfff640 1 --2- 172.21.15.53:0/2420148296 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e6c0ce4b0 0x7f1e6c1f1410 secure :-1 s=READY pgs=2249 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c0660e0 tx=0x7f1e64010840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:42.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.342+0000 7f1e68ff9640 1 -- 172.21.15.53:0/2420148296 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e64015600 con 0x7f1e6c0ce4b0 2023-06-10T19:06:42.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.342+0000 7f1e68ff9640 1 -- 172.21.15.53:0/2420148296 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e64015780 con 0x7f1e6c0ce4b0 2023-06-10T19:06:42.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.342+0000 7f1e71e15640 1 -- 172.21.15.53:0/2420148296 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e6c15c7d0 con 0x7f1e6c0ce4b0 2023-06-10T19:06:42.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.342+0000 7f1e68ff9640 1 -- 172.21.15.53:0/2420148296 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e64015b30 con 0x7f1e6c0ce4b0 2023-06-10T19:06:42.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.342+0000 7f1e71e15640 1 -- 172.21.15.53:0/2420148296 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e6c156ed0 con 0x7f1e6c0ce4b0 2023-06-10T19:06:42.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.342+0000 7f1e71e15640 1 -- 172.21.15.53:0/2420148296 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e6c15ff60 con 0x7f1e6c0ce4b0 2023-06-10T19:06:42.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.342+0000 7f1e68ff9640 1 -- 172.21.15.53:0/2420148296 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1e6401e3b0 con 0x7f1e6c0ce4b0 2023-06-10T19:06:42.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.342+0000 7f1e68ff9640 1 --2- 172.21.15.53:0/2420148296 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1e4c066280 0x7f1e4c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:42.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.342+0000 7f1e68ff9640 1 -- 172.21.15.53:0/2420148296 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1e64086530 con 0x7f1e6c0ce4b0 2023-06-10T19:06:42.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.342+0000 7f1e6b7fe640 1 --2- 172.21.15.53:0/2420148296 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1e4c066280 0x7f1e4c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:42.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.342+0000 7f1e6b7fe640 1 --2- 172.21.15.53:0/2420148296 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1e4c066280 0x7f1e4c068730 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c0b3120 tx=0x7f1e5c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:42.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.346+0000 7f1e68ff9640 1 -- 172.21.15.53:0/2420148296 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1e64053a40 con 0x7f1e6c0ce4b0 2023-06-10T19:06:42.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.538+0000 7f1e71e15640 1 -- 172.21.15.53:0/2420148296 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1e6c0b47c0 con 0x7f1e6c0ce4b0 2023-06-10T19:06:42.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.538+0000 7f1e68ff9640 1 -- 172.21.15.53:0/2420148296 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v89) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1e64057060 con 0x7f1e6c0ce4b0 2023-06-10T19:06:42.541 INFO:teuthology.orchestra.run.smithi053.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-06-10T19:06:42.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.542+0000 7f1e71e15640 1 -- 172.21.15.53:0/2420148296 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1e4c066280 msgr2=0x7f1e4c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:42.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.542+0000 7f1e71e15640 1 --2- 172.21.15.53:0/2420148296 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1e4c066280 0x7f1e4c068730 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c0b3120 tx=0x7f1e5c008040 comp rx=0 tx=0).stop 2023-06-10T19:06:42.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.542+0000 7f1e71e15640 1 -- 172.21.15.53:0/2420148296 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e6c0ce4b0 msgr2=0x7f1e6c1f1410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:42.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.542+0000 7f1e71e15640 1 --2- 172.21.15.53:0/2420148296 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e6c0ce4b0 0x7f1e6c1f1410 secure :-1 s=READY pgs=2249 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c0660e0 tx=0x7f1e64010840 comp rx=0 tx=0).stop 2023-06-10T19:06:42.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.542+0000 7f1e71e15640 1 -- 172.21.15.53:0/2420148296 shutdown_connections 2023-06-10T19:06:42.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.542+0000 7f1e71e15640 1 --2- 172.21.15.53:0/2420148296 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1e4c066280 0x7f1e4c068730 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:42.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.542+0000 7f1e71e15640 1 --2- 172.21.15.53:0/2420148296 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e6c0ce4b0 0x7f1e6c1f1410 unknown :-1 s=CLOSED pgs=2249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:42.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.542+0000 7f1e71e15640 1 --2- 172.21.15.53:0/2420148296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e6c0cbce0 0x7f1e6c15ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:42.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.542+0000 7f1e71e15640 1 --2- 172.21.15.53:0/2420148296 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e58003fa0 0x7f1e6c157240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:42.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.542+0000 7f1e71e15640 1 -- 172.21.15.53:0/2420148296 >> 172.21.15.53:0/2420148296 conn(0x7f1e6c071790 msgr2=0x7f1e6c159aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:42.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.542+0000 7f1e71e15640 1 -- 172.21.15.53:0/2420148296 shutdown_connections 2023-06-10T19:06:42.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:42.542+0000 7f1e71e15640 1 -- 172.21.15.53:0/2420148296 wait complete. 2023-06-10T19:06:42.560 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-10T19:06:42.561 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-10T19:06:42.561 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi117.front.sepia.ceph.com 2023-06-10T19:06:42.561 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-06-10T19:06:42.561 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-06-10T19:06:42.562 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-10T19:06:42.562 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-10T19:06:42.562 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-10T19:06:42.562 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-06-10T19:06:42.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:06:42.563 DEBUG:teuthology.orchestra.run.smithi117:> ip addr 2023-06-10T19:06:42.570 INFO:teuthology.orchestra.run.smithi117.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-10T19:06:42.570 INFO:teuthology.orchestra.run.smithi117.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-10T19:06:42.570 INFO:teuthology.orchestra.run.smithi117.stdout: inet 127.0.0.1/8 scope host lo 2023-06-10T19:06:42.570 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:06:42.570 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 ::1/128 scope host 2023-06-10T19:06:42.570 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:06:42.571 INFO:teuthology.orchestra.run.smithi117.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T19:06:42.571 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8a brd ff:ff:ff:ff:ff:ff 2023-06-10T19:06:42.571 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f0 2023-06-10T19:06:42.571 INFO:teuthology.orchestra.run.smithi117.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T19:06:42.571 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8b brd ff:ff:ff:ff:ff:ff 2023-06-10T19:06:42.571 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f1 2023-06-10T19:06:42.571 INFO:teuthology.orchestra.run.smithi117.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T19:06:42.571 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:62 brd ff:ff:ff:ff:ff:ff 2023-06-10T19:06:42.572 INFO:teuthology.orchestra.run.smithi117.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-10T19:06:42.572 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:63 brd ff:ff:ff:ff:ff:ff 2023-06-10T19:06:42.572 INFO:teuthology.orchestra.run.smithi117.stdout: inet 172.21.15.117/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-06-10T19:06:42.572 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft 41647sec preferred_lft 41647sec 2023-06-10T19:06:42.572 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::ec4:7aff:fe8f:4463/64 scope link 2023-06-10T19:06:42.572 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:06:42.572 INFO:teuthology.orchestra.run.smithi117.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-06-10T19:06:42.573 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 02:42:f8:40:b2:dc brd ff:ff:ff:ff:ff:ff 2023-06-10T19:06:42.573 INFO:teuthology.orchestra.run.smithi117.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-06-10T19:06:42.573 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:06:42.573 INFO:teuthology.orchestra.run.smithi117.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-10T19:06:42.574 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-06-10T19:06:42.574 INFO:teuthology.orchestra.run.smithi117.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-06-10T19:06:42.574 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:06:42.574 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-06-10T19:06:42.574 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:06:42.575 INFO:teuthology.orchestra.run.smithi117.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-10T19:06:42.575 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-06-10T19:06:42.575 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-06-10T19:06:42.575 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:06:42.576 INFO:teuthology.orchestra.run.smithi117.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-10T19:06:42.576 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-06-10T19:06:42.576 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-06-10T19:06:42.577 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:06:42.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:06:42.578 DEBUG:teuthology.orchestra.run.smithi117:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-10T19:06:42.626 INFO:teuthology.orchestra.run.smithi117.stdout:1 2023-06-10T19:06:42.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:06:42.628 DEBUG:teuthology.orchestra.run.smithi117:> route 2023-06-10T19:06:42.678 INFO:teuthology.orchestra.run.smithi117.stdout:Kernel IP routing table 2023-06-10T19:06:42.678 INFO:teuthology.orchestra.run.smithi117.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-10T19:06:42.678 INFO:teuthology.orchestra.run.smithi117.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-06-10T19:06:42.679 INFO:teuthology.orchestra.run.smithi117.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-06-10T19:06:42.679 INFO:teuthology.orchestra.run.smithi117.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-06-10T19:06:42.679 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-06-10T19:06:42.679 INFO:teuthology.orchestra.run.smithi117.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-10T19:06:42.679 INFO:teuthology.orchestra.run.smithi117.stdout:ns2.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-10T19:06:42.679 INFO:teuthology.orchestra.run.smithi117.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-10T19:06:42.680 INFO:teuthology.orchestra.run.smithi117.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-10T19:06:42.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:06:42.680 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec bash -c ' 2023-06-10T19:06:42.681 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2023-06-10T19:06:42.681 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-06-10T19:06:42.681 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-06-10T19:06:42.681 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-06-10T19:06:42.682 DEBUG:teuthology.orchestra.run.smithi117:> ') 2023-06-10T19:06:42.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:06:42.760 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list 2023-06-10T19:06:42.811 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-06-10T19:06:42.812 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-06-10T19:06:42.812 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-06-10T19:06:42.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:06:42.813 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link set brx.0 up 2023-06-10T19:06:42.868 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-06-10T19:06:42.869 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-10T19:06:42.869 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-06-10T19:06:42.915 INFO:teuthology.orchestra.run.smithi117.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-06-10T19:06:42.915 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-10T19:06:42.916 DEBUG:teuthology.orchestra.run.smithi117:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-06-10T19:06:42.962 DEBUG:teuthology.orchestra.run.smithi117:> sudo modprobe fuse 2023-06-10T19:06:43.020 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T19:06:43.020 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T19:06:43.074 INFO:teuthology.orchestra.run.smithi117.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T19:06:43.075 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T19:06:43.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:06:43.076 DEBUG:teuthology.orchestra.run.smithi117:> ls /sys/fs/fuse/connections 2023-06-10T19:06:43.123 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-06-10T19:06:43.123 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-06-10T19:06:43.168 DEBUG:teuthology.orchestra.run.smithi117:> sudo modprobe fuse 2023-06-10T19:06:43.184 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T19:06:43.185 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T19:06:43.236 INFO:teuthology.orchestra.run.smithi117.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T19:06:43.237 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T19:06:43.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:06:43.239 DEBUG:teuthology.orchestra.run.smithi117:> ls /sys/fs/fuse/connections 2023-06-10T19:06:43.245 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi117.stderr:2023-06-10T19:06:43.241+0000 7f0ca5c82580 -1 init, newargv = 0x560585ec8c10 newargc=15 2023-06-10T19:06:43.245 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi117.stderr:ceph-fuse[45655]: starting ceph client 2023-06-10T19:06:43.253 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi117.stderr:ceph-fuse[45655]: starting fuse 2023-06-10T19:06:44.351 DEBUG:teuthology.orchestra.run.smithi117:> sudo modprobe fuse 2023-06-10T19:06:44.368 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T19:06:44.369 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T19:06:44.422 INFO:teuthology.orchestra.run.smithi117.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T19:06:44.424 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T19:06:44.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:06:44.425 DEBUG:teuthology.orchestra.run.smithi117:> ls /sys/fs/fuse/connections 2023-06-10T19:06:44.471 INFO:teuthology.orchestra.run.smithi117.stdout:45 2023-06-10T19:06:44.471 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-06-10T19:06:44.471 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-06-10T19:06:44.472 DEBUG:teuthology.orchestra.run.smithi117:> import glob 2023-06-10T19:06:44.472 DEBUG:teuthology.orchestra.run.smithi117:> import re 2023-06-10T19:06:44.472 DEBUG:teuthology.orchestra.run.smithi117:> import os 2023-06-10T19:06:44.473 DEBUG:teuthology.orchestra.run.smithi117:> import subprocess 2023-06-10T19:06:44.473 DEBUG:teuthology.orchestra.run.smithi117:> 2023-06-10T19:06:44.473 DEBUG:teuthology.orchestra.run.smithi117:> def _find_admin_socket(client_name): 2023-06-10T19:06:44.474 DEBUG:teuthology.orchestra.run.smithi117:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-06-10T19:06:44.474 DEBUG:teuthology.orchestra.run.smithi117:> files = glob.glob(asok_path) 2023-06-10T19:06:44.474 DEBUG:teuthology.orchestra.run.smithi117:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-06-10T19:06:44.474 DEBUG:teuthology.orchestra.run.smithi117:> 2023-06-10T19:06:44.475 DEBUG:teuthology.orchestra.run.smithi117:> # Given a non-glob path, it better be there 2023-06-10T19:06:44.475 DEBUG:teuthology.orchestra.run.smithi117:> if "*" not in asok_path: 2023-06-10T19:06:44.475 DEBUG:teuthology.orchestra.run.smithi117:> assert(len(files) == 1) 2023-06-10T19:06:44.476 DEBUG:teuthology.orchestra.run.smithi117:> return files[0] 2023-06-10T19:06:44.476 DEBUG:teuthology.orchestra.run.smithi117:> 2023-06-10T19:06:44.476 DEBUG:teuthology.orchestra.run.smithi117:> for f in files: 2023-06-10T19:06:44.477 DEBUG:teuthology.orchestra.run.smithi117:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-06-10T19:06:44.477 DEBUG:teuthology.orchestra.run.smithi117:> if os.path.exists("/proc/{0}".format(pid)): 2023-06-10T19:06:44.477 DEBUG:teuthology.orchestra.run.smithi117:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-06-10T19:06:44.477 DEBUG:teuthology.orchestra.run.smithi117:> contents = proc_f.read() 2023-06-10T19:06:44.478 DEBUG:teuthology.orchestra.run.smithi117:> if mountpoint in contents: 2023-06-10T19:06:44.478 DEBUG:teuthology.orchestra.run.smithi117:> return f 2023-06-10T19:06:44.478 DEBUG:teuthology.orchestra.run.smithi117:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-06-10T19:06:44.479 DEBUG:teuthology.orchestra.run.smithi117:> 2023-06-10T19:06:44.479 DEBUG:teuthology.orchestra.run.smithi117:> print(_find_admin_socket("client.1")) 2023-06-10T19:06:44.479 DEBUG:teuthology.orchestra.run.smithi117:> ' 2023-06-10T19:06:44.591 INFO:teuthology.orchestra.run.smithi117.stdout:/var/run/ceph/ceph-client.1.45655.asok 2023-06-10T19:06:44.774 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.45655.asok 2023-06-10T19:06:44.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:06:44.836 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.45655.asok status 2023-06-10T19:06:44.954 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2023-06-10T19:06:44.955 INFO:teuthology.orchestra.run.smithi117.stdout: "metadata": { 2023-06-10T19:06:44.955 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_sha1": "219d315c3a0b2075e570fb1964be2ad33fe7a9c8", 2023-06-10T19:06:44.955 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_version": "ceph version 18.0.0-4359-g219d315c (219d315c3a0b2075e570fb1964be2ad33fe7a9c8) reef (dev)", 2023-06-10T19:06:44.955 INFO:teuthology.orchestra.run.smithi117.stdout: "entity_id": "1", 2023-06-10T19:06:44.955 INFO:teuthology.orchestra.run.smithi117.stdout: "hostname": "smithi117", 2023-06-10T19:06:44.955 INFO:teuthology.orchestra.run.smithi117.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-06-10T19:06:44.955 INFO:teuthology.orchestra.run.smithi117.stdout: "pid": "45655", 2023-06-10T19:06:44.956 INFO:teuthology.orchestra.run.smithi117.stdout: "root": "/" 2023-06-10T19:06:44.956 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-06-10T19:06:44.956 INFO:teuthology.orchestra.run.smithi117.stdout: "dentry_count": 0, 2023-06-10T19:06:44.956 INFO:teuthology.orchestra.run.smithi117.stdout: "dentry_pinned_count": 0, 2023-06-10T19:06:44.956 INFO:teuthology.orchestra.run.smithi117.stdout: "id": 8407, 2023-06-10T19:06:44.956 INFO:teuthology.orchestra.run.smithi117.stdout: "inst": { 2023-06-10T19:06:44.956 INFO:teuthology.orchestra.run.smithi117.stdout: "name": { 2023-06-10T19:06:44.957 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "client", 2023-06-10T19:06:44.957 INFO:teuthology.orchestra.run.smithi117.stdout: "num": 8407 2023-06-10T19:06:44.957 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-06-10T19:06:44.957 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": { 2023-06-10T19:06:44.957 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "v1", 2023-06-10T19:06:44.957 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": "192.168.0.1:0", 2023-06-10T19:06:44.957 INFO:teuthology.orchestra.run.smithi117.stdout: "nonce": 2940708518 2023-06-10T19:06:44.957 INFO:teuthology.orchestra.run.smithi117.stdout: } 2023-06-10T19:06:44.958 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-06-10T19:06:44.958 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": { 2023-06-10T19:06:44.958 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "v1", 2023-06-10T19:06:44.958 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": "192.168.0.1:0", 2023-06-10T19:06:44.958 INFO:teuthology.orchestra.run.smithi117.stdout: "nonce": 2940708518 2023-06-10T19:06:44.958 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-06-10T19:06:44.958 INFO:teuthology.orchestra.run.smithi117.stdout: "inst_str": "client.8407 192.168.0.1:0/2940708518", 2023-06-10T19:06:44.959 INFO:teuthology.orchestra.run.smithi117.stdout: "addr_str": "192.168.0.1:0/2940708518", 2023-06-10T19:06:44.959 INFO:teuthology.orchestra.run.smithi117.stdout: "inode_count": 1, 2023-06-10T19:06:44.959 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_epoch": 89, 2023-06-10T19:06:44.959 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_epoch": 154, 2023-06-10T19:06:44.959 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_epoch_barrier": 0, 2023-06-10T19:06:44.959 INFO:teuthology.orchestra.run.smithi117.stdout: "blocklisted": false, 2023-06-10T19:06:44.959 INFO:teuthology.orchestra.run.smithi117.stdout: "fs_name": "cephfs" 2023-06-10T19:06:44.959 INFO:teuthology.orchestra.run.smithi117.stdout:} 2023-06-10T19:06:44.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:06:44.968 DEBUG:teuthology.orchestra.run.smithi117:> stat --file-system '--printf=%T 2023-06-10T19:06:44.969 DEBUG:teuthology.orchestra.run.smithi117:> ' -- /home/ubuntu/cephtest/mnt.1 2023-06-10T19:06:44.975 INFO:teuthology.orchestra.run.smithi117.stdout:fuseblk 2023-06-10T19:06:44.975 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-06-10T19:06:44.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:06:44.976 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-06-10T19:06:45.029 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config get mds_reconnect_timeout 2023-06-10T19:06:45.174 INFO:teuthology.orchestra.run.smithi053.stdout:{"mds_reconnect_timeout":"45.000000"} 2023-06-10T19:06:45.174 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_reconnect_timeout": "45.000000" } 2023-06-10T19:06:45.175 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config get ms_max_backoff 2023-06-10T19:06:45.314 INFO:teuthology.orchestra.run.smithi053.stdout:{"ms_max_backoff":"15.000000"} 2023-06-10T19:06:45.314 DEBUG:tasks.cephfs.filesystem:_json_asok output { "ms_max_backoff": "15.000000" } 2023-06-10T19:06:45.315 DEBUG:teuthology.orchestra.run.smithi053:> dpkg-query -W -f '${Version}' fuse 2023-06-10T19:06:45.329 INFO:teuthology.orchestra.run.smithi053.stdout:2.9.9-3 2023-06-10T19:06:45.329 INFO:teuthology.packaging:The installed version of fuse is 2.9.9-3 2023-06-10T19:06:45.330 DEBUG:teuthology.orchestra.run.smithi117:> dpkg-query -W -f '${Version}' fuse 2023-06-10T19:06:45.349 INFO:teuthology.orchestra.run.smithi117.stdout:2.9.9-3 2023-06-10T19:06:45.350 INFO:teuthology.packaging:The installed version of fuse is 2.9.9-3 2023-06-10T19:06:45.350 INFO:tasks.cephfs.test_client_recovery:flock locks are available 2023-06-10T19:06:45.350 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T19:06:45.351 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:06:45.375 INFO:tasks.cephfs.mount:lock_background file background_file 2023-06-10T19:06:45.376 DEBUG:teuthology.orchestra.run.smithi053:> adjust-ulimits daemon-helper kill python3 -c ' 2023-06-10T19:06:45.376 DEBUG:teuthology.orchestra.run.smithi053:> import time 2023-06-10T19:06:45.376 DEBUG:teuthology.orchestra.run.smithi053:> import fcntl 2023-06-10T19:06:45.377 DEBUG:teuthology.orchestra.run.smithi053:> import struct 2023-06-10T19:06:45.377 DEBUG:teuthology.orchestra.run.smithi053:> f1 = open("/home/ubuntu/cephtest/mnt.0/background_file-1", '"'"'w'"'"') 2023-06-10T19:06:45.377 DEBUG:teuthology.orchestra.run.smithi053:> fcntl.flock(f1, fcntl.LOCK_EX | fcntl.LOCK_NB) 2023-06-10T19:06:45.378 DEBUG:teuthology.orchestra.run.smithi053:> f2 = open("/home/ubuntu/cephtest/mnt.0/background_file-2", '"'"'w'"'"') 2023-06-10T19:06:45.378 DEBUG:teuthology.orchestra.run.smithi053:> lockdata = struct.pack('"'"'hhllhh'"'"', fcntl.F_WRLCK, 0, 0, 0, 0, 0) 2023-06-10T19:06:45.378 DEBUG:teuthology.orchestra.run.smithi053:> fcntl.fcntl(f2, fcntl.F_SETLK, lockdata) 2023-06-10T19:06:45.379 DEBUG:teuthology.orchestra.run.smithi053:> while True: 2023-06-10T19:06:45.379 DEBUG:teuthology.orchestra.run.smithi053:> time.sleep(1) 2023-06-10T19:06:45.379 DEBUG:teuthology.orchestra.run.smithi053:> ' 2023-06-10T19:06:45.424 DEBUG:teuthology.orchestra.run.smithi117:> stat /home/ubuntu/cephtest/mnt.1/background_file-2 2023-06-10T19:06:45.430 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-10T19:06:45.431 INFO:teuthology.orchestra.run.smithi117.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.1/background_file-2': No such file or directory 2023-06-10T19:06:46.432 DEBUG:teuthology.orchestra.run.smithi117:> stat /home/ubuntu/cephtest/mnt.1/background_file-2 2023-06-10T19:06:46.454 INFO:teuthology.orchestra.run.smithi117.stdout: File: /home/ubuntu/cephtest/mnt.1/background_file-2 2023-06-10T19:06:46.454 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 0 Blocks: 0 IO Block: 4194304 regular empty file 2023-06-10T19:06:46.455 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 2dh/45d Inode: 1099511627777 Links: 1 2023-06-10T19:06:46.455 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0664/-rw-rw-r--) Uid: ( 1000/ ubuntu) Gid: ( 1271/ ubuntu) 2023-06-10T19:06:46.455 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2023-06-10 19:06:45.497573354 +0000 2023-06-10T19:06:46.455 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2023-06-10 19:06:45.497573354 +0000 2023-06-10T19:06:46.455 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2023-06-10 19:06:45.497573354 +0000 2023-06-10T19:06:46.456 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: - 2023-06-10T19:06:46.456 INFO:tasks.cephfs.mount:File background_file-2 became visible from 1 after 1s 2023-06-10T19:06:46.456 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T19:06:46.457 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:06:46.504 INFO:tasks.cephfs.mount:check lock on file background_file 2023-06-10T19:06:46.505 DEBUG:teuthology.orchestra.run.smithi117:> python3 -c ' 2023-06-10T19:06:46.505 DEBUG:teuthology.orchestra.run.smithi117:> import fcntl 2023-06-10T19:06:46.505 DEBUG:teuthology.orchestra.run.smithi117:> import errno 2023-06-10T19:06:46.506 DEBUG:teuthology.orchestra.run.smithi117:> import struct 2023-06-10T19:06:46.506 DEBUG:teuthology.orchestra.run.smithi117:> f1 = open("/home/ubuntu/cephtest/mnt.1/background_file-1", '"'"'r'"'"') 2023-06-10T19:06:46.506 DEBUG:teuthology.orchestra.run.smithi117:> try: 2023-06-10T19:06:46.506 DEBUG:teuthology.orchestra.run.smithi117:> fcntl.flock(f1, fcntl.LOCK_EX | fcntl.LOCK_NB) 2023-06-10T19:06:46.507 DEBUG:teuthology.orchestra.run.smithi117:> except IOError as e: 2023-06-10T19:06:46.507 DEBUG:teuthology.orchestra.run.smithi117:> if e.errno == errno.EAGAIN: 2023-06-10T19:06:46.507 DEBUG:teuthology.orchestra.run.smithi117:> pass 2023-06-10T19:06:46.507 DEBUG:teuthology.orchestra.run.smithi117:> else: 2023-06-10T19:06:46.508 DEBUG:teuthology.orchestra.run.smithi117:> raise RuntimeError("flock on file /home/ubuntu/cephtest/mnt.1/background_file-1 not found") 2023-06-10T19:06:46.508 DEBUG:teuthology.orchestra.run.smithi117:> f2 = open("/home/ubuntu/cephtest/mnt.1/background_file-2", '"'"'r'"'"') 2023-06-10T19:06:46.508 DEBUG:teuthology.orchestra.run.smithi117:> try: 2023-06-10T19:06:46.508 DEBUG:teuthology.orchestra.run.smithi117:> lockdata = struct.pack('"'"'hhllhh'"'"', fcntl.F_WRLCK, 0, 0, 0, 0, 0) 2023-06-10T19:06:46.509 DEBUG:teuthology.orchestra.run.smithi117:> fcntl.fcntl(f2, fcntl.F_SETLK, lockdata) 2023-06-10T19:06:46.509 DEBUG:teuthology.orchestra.run.smithi117:> except IOError as e: 2023-06-10T19:06:46.509 DEBUG:teuthology.orchestra.run.smithi117:> if e.errno == errno.EAGAIN: 2023-06-10T19:06:46.509 DEBUG:teuthology.orchestra.run.smithi117:> pass 2023-06-10T19:06:46.510 DEBUG:teuthology.orchestra.run.smithi117:> else: 2023-06-10T19:06:46.510 DEBUG:teuthology.orchestra.run.smithi117:> raise RuntimeError("posix lock on file /home/ubuntu/cephtest/mnt.1/background_file-2 not found") 2023-06-10T19:06:46.510 DEBUG:teuthology.orchestra.run.smithi117:> ' 2023-06-10T19:06:46.601 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T19:06:46.602 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:06:46.608 INFO:tasks.cephfs.mount:lock_and_release file background_file 2023-06-10T19:06:46.608 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits daemon-helper kill python3 -c ' 2023-06-10T19:06:46.609 DEBUG:teuthology.orchestra.run.smithi117:> import time 2023-06-10T19:06:46.609 DEBUG:teuthology.orchestra.run.smithi117:> import fcntl 2023-06-10T19:06:46.609 DEBUG:teuthology.orchestra.run.smithi117:> import struct 2023-06-10T19:06:46.610 DEBUG:teuthology.orchestra.run.smithi117:> f1 = open("/home/ubuntu/cephtest/mnt.1/background_file-1", '"'"'w'"'"') 2023-06-10T19:06:46.610 DEBUG:teuthology.orchestra.run.smithi117:> fcntl.flock(f1, fcntl.LOCK_EX) 2023-06-10T19:06:46.610 DEBUG:teuthology.orchestra.run.smithi117:> f2 = open("/home/ubuntu/cephtest/mnt.1/background_file-2", '"'"'w'"'"') 2023-06-10T19:06:46.610 DEBUG:teuthology.orchestra.run.smithi117:> lockdata = struct.pack('"'"'hhllhh'"'"', fcntl.F_WRLCK, 0, 0, 0, 0, 0) 2023-06-10T19:06:46.611 DEBUG:teuthology.orchestra.run.smithi117:> fcntl.fcntl(f2, fcntl.F_SETLK, lockdata) 2023-06-10T19:06:46.611 DEBUG:teuthology.orchestra.run.smithi117:> ' 2023-06-10T19:06:48.854 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-06-10T19:06:48.855 DEBUG:teuthology.orchestra.run.smithi053:> import glob 2023-06-10T19:06:48.855 DEBUG:teuthology.orchestra.run.smithi053:> import re 2023-06-10T19:06:48.856 DEBUG:teuthology.orchestra.run.smithi053:> import os 2023-06-10T19:06:48.856 DEBUG:teuthology.orchestra.run.smithi053:> import subprocess 2023-06-10T19:06:48.856 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:06:48.856 DEBUG:teuthology.orchestra.run.smithi053:> def _find_admin_socket(client_name): 2023-06-10T19:06:48.857 DEBUG:teuthology.orchestra.run.smithi053:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-06-10T19:06:48.857 DEBUG:teuthology.orchestra.run.smithi053:> files = glob.glob(asok_path) 2023-06-10T19:06:48.857 DEBUG:teuthology.orchestra.run.smithi053:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-06-10T19:06:48.858 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:06:48.858 DEBUG:teuthology.orchestra.run.smithi053:> # Given a non-glob path, it better be there 2023-06-10T19:06:48.858 DEBUG:teuthology.orchestra.run.smithi053:> if "*" not in asok_path: 2023-06-10T19:06:48.858 DEBUG:teuthology.orchestra.run.smithi053:> assert(len(files) == 1) 2023-06-10T19:06:48.859 DEBUG:teuthology.orchestra.run.smithi053:> return files[0] 2023-06-10T19:06:48.859 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:06:48.860 DEBUG:teuthology.orchestra.run.smithi053:> for f in files: 2023-06-10T19:06:48.861 DEBUG:teuthology.orchestra.run.smithi053:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-06-10T19:06:48.861 DEBUG:teuthology.orchestra.run.smithi053:> if os.path.exists("/proc/{0}".format(pid)): 2023-06-10T19:06:48.862 DEBUG:teuthology.orchestra.run.smithi053:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-06-10T19:06:48.863 DEBUG:teuthology.orchestra.run.smithi053:> contents = proc_f.read() 2023-06-10T19:06:48.864 DEBUG:teuthology.orchestra.run.smithi053:> if mountpoint in contents: 2023-06-10T19:06:48.864 DEBUG:teuthology.orchestra.run.smithi053:> return f 2023-06-10T19:06:48.865 DEBUG:teuthology.orchestra.run.smithi053:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-06-10T19:06:48.866 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:06:48.866 DEBUG:teuthology.orchestra.run.smithi053:> print(_find_admin_socket("client.0")) 2023-06-10T19:06:48.867 DEBUG:teuthology.orchestra.run.smithi053:> ' 2023-06-10T19:06:48.951 INFO:teuthology.orchestra.run.smithi053.stdout:/var/run/ceph/ceph-client.0.66536.asok 2023-06-10T19:06:49.133 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.66536.asok 2023-06-10T19:06:49.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:06:49.134 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.66536.asok mds_sessions 2023-06-10T19:06:49.291 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-06-10T19:06:49.292 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 10245, 2023-06-10T19:06:49.292 INFO:teuthology.orchestra.run.smithi053.stdout: "inst": { 2023-06-10T19:06:49.292 INFO:teuthology.orchestra.run.smithi053.stdout: "name": { 2023-06-10T19:06:49.293 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "client", 2023-06-10T19:06:49.293 INFO:teuthology.orchestra.run.smithi053.stdout: "num": 10245 2023-06-10T19:06:49.293 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:06:49.293 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": { 2023-06-10T19:06:49.294 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2023-06-10T19:06:49.294 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "192.168.0.1:0", 2023-06-10T19:06:49.294 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 2213488734 2023-06-10T19:06:49.295 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:06:49.295 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:06:49.295 INFO:teuthology.orchestra.run.smithi053.stdout: "inst_str": "client.10245 v1:192.168.0.1:0/2213488734", 2023-06-10T19:06:49.295 INFO:teuthology.orchestra.run.smithi053.stdout: "addr_str": "v1:192.168.0.1:0/2213488734", 2023-06-10T19:06:49.295 INFO:teuthology.orchestra.run.smithi053.stdout: "sessions": [ 2023-06-10T19:06:49.296 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:06:49.296 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": 0, 2023-06-10T19:06:49.296 INFO:teuthology.orchestra.run.smithi053.stdout: "addrs": { 2023-06-10T19:06:49.296 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2023-06-10T19:06:49.296 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:06:49.296 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2023-06-10T19:06:49.296 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.53:6834", 2023-06-10T19:06:49.297 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 2077620799 2023-06-10T19:06:49.297 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:06:49.297 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:06:49.297 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2023-06-10T19:06:49.297 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.53:6835", 2023-06-10T19:06:49.297 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 2077620799 2023-06-10T19:06:49.297 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:06:49.298 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2023-06-10T19:06:49.298 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:06:49.298 INFO:teuthology.orchestra.run.smithi053.stdout: "seq": 35, 2023-06-10T19:06:49.298 INFO:teuthology.orchestra.run.smithi053.stdout: "cap_gen": 0, 2023-06-10T19:06:49.298 INFO:teuthology.orchestra.run.smithi053.stdout: "cap_ttl": "2023-06-10T19:07:41.395942+0000", 2023-06-10T19:06:49.298 INFO:teuthology.orchestra.run.smithi053.stdout: "last_cap_renew_request": "2023-06-10T19:06:41.395942+0000", 2023-06-10T19:06:49.298 INFO:teuthology.orchestra.run.smithi053.stdout: "cap_renew_seq": 2, 2023-06-10T19:06:49.299 INFO:teuthology.orchestra.run.smithi053.stdout: "num_caps": 3, 2023-06-10T19:06:49.299 INFO:teuthology.orchestra.run.smithi053.stdout: "state": "open" 2023-06-10T19:06:49.299 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:06:49.299 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2023-06-10T19:06:49.300 INFO:teuthology.orchestra.run.smithi053.stdout: "mdsmap_epoch": 89 2023-06-10T19:06:49.300 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-06-10T19:06:49.306 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:06:49.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:49.434+0000 7fbbb88df640 1 Processor -- start 2023-06-10T19:06:49.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:49.434+0000 7fbbb88df640 1 -- start start 2023-06-10T19:06:49.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:49.434+0000 7fbbb88df640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbbb40cf0c0 0x7fbbb40cc660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:49.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:49.434+0000 7fbbb88df640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbb40cbac0 con 0x7fbbb40cec40 2023-06-10T19:06:49.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:49.434+0000 7fbbb88df640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbb415dc00 con 0x7fbbb4159450 2023-06-10T19:06:49.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:49.434+0000 7fbbb88df640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbb415dee0 con 0x7fbbb40cf0c0 2023-06-10T19:06:49.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:49.434+0000 7fbbb2d9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbbb40cf0c0 0x7fbbb40cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:49.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:49.434+0000 7fbbb2d9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbbb40cf0c0 0x7fbbb40cc660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52924/0 (socket says 172.21.15.53:52924) 2023-06-10T19:06:49.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:49.434+0000 7fbbb2d9d640 1 -- 172.21.15.53:0/581414630 learned_addr learned my addr 172.21.15.53:0/581414630 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:49.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:49.434+0000 7fbbb1d9b640 1 --1- 172.21.15.53:0/581414630 >> v1:172.21.15.53:6789/0 conn(0x7fbbb40cec40 0x7fbbb40cbf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:36674/0 (socket says 172.21.15.53:36674) 2023-06-10T19:06:49.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:49.434+0000 7fbbb2d9d640 1 -- 172.21.15.53:0/581414630 >> v1:172.21.15.117:6789/0 conn(0x7fbbb4159450 legacy=0x7fbbb415d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:49.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:49.434+0000 7fbbb2d9d640 1 -- 172.21.15.53:0/581414630 >> v1:172.21.15.53:6789/0 conn(0x7fbbb40cec40 legacy=0x7fbbb40cbf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:49.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:49.434+0000 7fbbb2d9d640 1 -- 172.21.15.53:0/581414630 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbb40cb750 con 0x7fbbb40cf0c0 2023-06-10T19:06:49.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:49.438+0000 7fbbb2d9d640 1 --2- 172.21.15.53:0/581414630 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbbb40cf0c0 0x7fbbb40cc660 secure :-1 s=READY pgs=2251 cs=0 l=1 rev1=1 crypto rx=0x7fbbac009e50 tx=0x7fbbac01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90a7e40dba3d3453 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:49.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:49.438+0000 7fbbb159a640 1 -- 172.21.15.53:0/581414630 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbac0a57f0 con 0x7fbbb40cf0c0 2023-06-10T19:06:49.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:49.438+0000 7fbbb159a640 1 -- 172.21.15.53:0/581414630 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbac0a5950 con 0x7fbbb40cf0c0 2023-06-10T19:06:49.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:49.438+0000 7fbbb159a640 1 -- 172.21.15.53:0/581414630 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbac0a5ce0 con 0x7fbbb40cf0c0 2023-06-10T19:06:49.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:49.438+0000 7fbbb88df640 1 -- 172.21.15.53:0/581414630 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbbb40cf0c0 msgr2=0x7fbbb40cc660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:49.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:49.438+0000 7fbbb88df640 1 --2- 172.21.15.53:0/581414630 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbbb40cf0c0 0x7fbbb40cc660 secure :-1 s=READY pgs=2251 cs=0 l=1 rev1=1 crypto rx=0x7fbbac009e50 tx=0x7fbbac01c970 comp rx=0 tx=0).stop 2023-06-10T19:06:49.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:49.438+0000 7fbbb88df640 1 -- 172.21.15.53:0/581414630 shutdown_connections 2023-06-10T19:06:49.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:49.438+0000 7fbbb88df640 1 --2- 172.21.15.53:0/581414630 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbbb40cf0c0 0x7fbbb40cc660 unknown :-1 s=CLOSED pgs=2251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:49.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:49.438+0000 7fbbb88df640 1 -- 172.21.15.53:0/581414630 >> 172.21.15.53:0/581414630 conn(0x7fbbb406a090 msgr2=0x7fbbb406d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:49.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:49.438+0000 7fbbb88df640 1 -- 172.21.15.53:0/581414630 shutdown_connections 2023-06-10T19:06:49.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:49.438+0000 7fbbb88df640 1 -- 172.21.15.53:0/581414630 wait complete. 2023-06-10T19:06:49.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:49.438+0000 7fbbb88df640 1 Processor -- start 2023-06-10T19:06:49.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:49.438+0000 7fbbb88df640 1 -- start start 2023-06-10T19:06:49.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:49.438+0000 7fbbb88df640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbbb40cec40 0x7fbbb4155c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:49.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:49.438+0000 7fbbb88df640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbbb40cf0c0 0x7fbbb40c5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:49.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:49.438+0000 7fbbb88df640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbbb4159450 0x7fbbb41574c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:49.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:49.438+0000 7fbbb88df640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb415a140 con 0x7fbbb4159450 2023-06-10T19:06:49.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:49.438+0000 7fbbb88df640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb415a420 con 0x7fbbb40cf0c0 2023-06-10T19:06:49.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:49.438+0000 7fbbb88df640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb40c6210 con 0x7fbbb40cec40 2023-06-10T19:06:49.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:49.438+0000 7fbbb2d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbbb4159450 0x7fbbb41574c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:49.445 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:49.438+0000 7fbbb2d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbbb4159450 0x7fbbb41574c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52926/0 (socket says 172.21.15.53:52926) 2023-06-10T19:06:49.445 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:49.438+0000 7fbbb2d9d640 1 -- 172.21.15.53:0/1186017294 learned_addr learned my addr 172.21.15.53:0/1186017294 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:49.445 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:49.438+0000 7fbbb259c640 1 --2- 172.21.15.53:0/1186017294 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbbb40cec40 0x7fbbb4155c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:49.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:49.438+0000 7fbbb1d9b640 1 --2- 172.21.15.53:0/1186017294 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbbb40cf0c0 0x7fbbb40c5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:49.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:49.438+0000 7fbbb2d9d640 1 -- 172.21.15.53:0/1186017294 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbbb40cec40 msgr2=0x7fbbb4155c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:49.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:49.438+0000 7fbbb2d9d640 1 --2- 172.21.15.53:0/1186017294 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbbb40cec40 0x7fbbb4155c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:49.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:49.438+0000 7fbbb2d9d640 1 -- 172.21.15.53:0/1186017294 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbbb40cf0c0 msgr2=0x7fbbb40c5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:49.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:49.438+0000 7fbbb2d9d640 1 --2- 172.21.15.53:0/1186017294 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbbb40cf0c0 0x7fbbb40c5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:49.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:49.438+0000 7fbbb2d9d640 1 -- 172.21.15.53:0/1186017294 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbac009b30 con 0x7fbbb4159450 2023-06-10T19:06:49.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:49.438+0000 7fbbb2d9d640 1 --2- 172.21.15.53:0/1186017294 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbbb4159450 0x7fbbb41574c0 secure :-1 s=READY pgs=2252 cs=0 l=1 rev1=1 crypto rx=0x7fbbac009e50 tx=0x7fbbb40cd3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:49.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:49.442+0000 7fbba2ffd640 1 -- 172.21.15.53:0/1186017294 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbac0b8670 con 0x7fbbb4159450 2023-06-10T19:06:49.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:49.442+0000 7fbba2ffd640 1 -- 172.21.15.53:0/1186017294 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbac0b87d0 con 0x7fbbb4159450 2023-06-10T19:06:49.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:49.442+0000 7fbbb88df640 1 -- 172.21.15.53:0/1186017294 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbb415d9d0 con 0x7fbbb4159450 2023-06-10T19:06:49.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:49.442+0000 7fbba2ffd640 1 -- 172.21.15.53:0/1186017294 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbac0b8b60 con 0x7fbbb4159450 2023-06-10T19:06:49.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:49.442+0000 7fbbb88df640 1 -- 172.21.15.53:0/1186017294 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbb4158010 con 0x7fbbb4159450 2023-06-10T19:06:49.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:49.442+0000 7fbbb88df640 1 -- 172.21.15.53:0/1186017294 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbb415a5b0 con 0x7fbbb4159450 2023-06-10T19:06:49.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:49.442+0000 7fbba2ffd640 1 -- 172.21.15.53:0/1186017294 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbbac0b8cc0 con 0x7fbbb4159450 2023-06-10T19:06:49.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:49.442+0000 7fbba2ffd640 1 --2- 172.21.15.53:0/1186017294 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbb94066280 0x7fbb94068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:49.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:49.442+0000 7fbba2ffd640 1 -- 172.21.15.53:0/1186017294 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbbac11f820 con 0x7fbbb4159450 2023-06-10T19:06:49.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:49.442+0000 7fbbb259c640 1 --2- 172.21.15.53:0/1186017294 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbb94066280 0x7fbb94068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:49.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:49.442+0000 7fbbb259c640 1 --2- 172.21.15.53:0/1186017294 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbb94066280 0x7fbb94068730 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fbbb406d950 tx=0x7fbba4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:49.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:49.446+0000 7fbba2ffd640 1 -- 172.21.15.53:0/1186017294 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbbac0f0980 con 0x7fbbb4159450 2023-06-10T19:06:49.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:49.630+0000 7fbbb88df640 1 -- 172.21.15.53:0/1186017294 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbbb404d790 con 0x7fbbb4159450 2023-06-10T19:06:49.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:49.630+0000 7fbba2ffd640 1 -- 172.21.15.53:0/1186017294 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) v1 ==== 94+0+4679 (secure 0 0 0) 0x7fbbac0f0510 con 0x7fbbb4159450 2023-06-10T19:06:49.634 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:06:49.634 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":89,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/67248348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":67248348},{"type":"v1","addr":"172.21.15.117:6835","nonce":67248348}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":84},{"gid":8296,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3907684243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":3907684243},{"type":"v1","addr":"172.21.15.117:6837","nonce":3907684243}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":84},{"gid":10038,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/1699177406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":1699177406},{"type":"v1","addr":"172.21.15.53:6833","nonce":1699177406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":84}],"filesystems":[{"mdsmap":{"epoch":89,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:06:28.716939+0000","modified":"2023-06-10T19:06:32.084420+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10044},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10044":{"gid":10044,"name":"a","rank":0,"incarnation":85,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/2077620799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2077620799},{"type":"v1","addr":"172.21.15.53:6835","nonce":2077620799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-06-10T19:06:49.635 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 89 2023-06-10T19:06:49.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:49.634+0000 7fbbb88df640 1 -- 172.21.15.53:0/1186017294 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbb94066280 msgr2=0x7fbb94068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:49.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:49.634+0000 7fbbb88df640 1 --2- 172.21.15.53:0/1186017294 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbb94066280 0x7fbb94068730 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fbbb406d950 tx=0x7fbba4009040 comp rx=0 tx=0).stop 2023-06-10T19:06:49.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:49.634+0000 7fbbb88df640 1 -- 172.21.15.53:0/1186017294 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbbb4159450 msgr2=0x7fbbb41574c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:49.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:49.634+0000 7fbbb88df640 1 --2- 172.21.15.53:0/1186017294 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbbb4159450 0x7fbbb41574c0 secure :-1 s=READY pgs=2252 cs=0 l=1 rev1=1 crypto rx=0x7fbbac009e50 tx=0x7fbbb40cd3b0 comp rx=0 tx=0).stop 2023-06-10T19:06:49.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:49.634+0000 7fbbb88df640 1 -- 172.21.15.53:0/1186017294 shutdown_connections 2023-06-10T19:06:49.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:49.634+0000 7fbbb88df640 1 --2- 172.21.15.53:0/1186017294 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbb94066280 0x7fbb94068730 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:49.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:49.634+0000 7fbbb88df640 1 --2- 172.21.15.53:0/1186017294 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbbb4159450 0x7fbbb41574c0 unknown :-1 s=CLOSED pgs=2252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:49.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:49.634+0000 7fbbb88df640 1 --2- 172.21.15.53:0/1186017294 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbbb40cf0c0 0x7fbbb40c5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:49.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:49.634+0000 7fbbb88df640 1 --2- 172.21.15.53:0/1186017294 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbbb40cec40 0x7fbbb4155c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:49.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:49.634+0000 7fbbb88df640 1 -- 172.21.15.53:0/1186017294 >> 172.21.15.53:0/1186017294 conn(0x7fbbb406a090 msgr2=0x7fbbb40b2c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:49.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:49.634+0000 7fbbb88df640 1 -- 172.21.15.53:0/1186017294 shutdown_connections 2023-06-10T19:06:49.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:49.634+0000 7fbbb88df640 1 -- 172.21.15.53:0/1186017294 wait complete. 2023-06-10T19:06:49.653 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session evict 10245 2023-06-10T19:06:50.210 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:2023-06-10T19:06:50.206+0000 7fbcbf7fe640 -1 client.10245 I was blocklisted at osd epoch 155 2023-06-10T19:06:50.247 DEBUG:tasks.cephfs.filesystem:_json_asok output empty 2023-06-10T19:06:50.304 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-06-10T19:06:50.314 INFO:tasks.cephfs.mount:Killing connection on ubuntu@smithi053.front.sepia.ceph.com... 2023-06-10T19:06:50.315 INFO:tasks.cephfs.mount:Suspending the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-06-10T19:06:50.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:06:50.315 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link set brx.0 down 2023-06-10T19:06:50.371 INFO:tasks.cephfs.mount:Cleaning up killed connection on ubuntu@smithi053.front.sepia.ceph.com 2023-06-10T19:06:50.371 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T19:06:50.372 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:06:50.419 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:06:50.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.586+0000 7feda5102640 1 Processor -- start 2023-06-10T19:06:50.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.586+0000 7feda5102640 1 -- start start 2023-06-10T19:06:50.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.590+0000 7feda5102640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7feda00c9750 0x7feda00aced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:50.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.590+0000 7feda5102640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feda00cb870 0x7feda00af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:50.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.590+0000 7feda5102640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feda00ad410 con 0x7feda00afc60 2023-06-10T19:06:50.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.590+0000 7feda5102640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feda00cd990 con 0x7feda00c9750 2023-06-10T19:06:50.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.590+0000 7feda5102640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feda00b00e0 con 0x7feda00cb870 2023-06-10T19:06:50.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.590+0000 7fed9e59c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feda00cb870 0x7feda00af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:50.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.590+0000 7fed9ed9d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7feda00c9750 0x7feda00aced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:50.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.590+0000 7fed9f59e640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7feda00afc60 0x7feda015bec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.53:50400/0 (socket says 172.21.15.53:50400) 2023-06-10T19:06:50.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.590+0000 7fed9f59e640 1 -- 172.21.15.53:0/3333384545 learned_addr learned my addr 172.21.15.53:0/3333384545 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:06:50.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.590+0000 7fed9e59c640 1 -- 172.21.15.53:0/3333384545 >> v2:172.21.15.117:3300/0 conn(0x7feda00c9750 msgr2=0x7feda00aced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:50.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.590+0000 7fed9e59c640 1 --2- 172.21.15.53:0/3333384545 >> v2:172.21.15.117:3300/0 conn(0x7feda00c9750 0x7feda00aced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:50.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.590+0000 7fed9e59c640 1 -- 172.21.15.53:0/3333384545 >> v1:172.21.15.117:6789/0 conn(0x7feda00afc60 legacy=0x7feda015bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:50.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.590+0000 7fed9e59c640 1 -- 172.21.15.53:0/3333384545 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feda01600d0 con 0x7feda00cb870 2023-06-10T19:06:50.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.594+0000 7fed9e59c640 1 --2- 172.21.15.53:0/3333384545 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feda00cb870 0x7feda00af720 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fed880097c0 tx=0x7fed8801c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1010754f10c9a7f7 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:50.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.594+0000 7fed9dd9b640 1 -- 172.21.15.53:0/3333384545 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed880ab650 con 0x7feda00cb870 2023-06-10T19:06:50.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.594+0000 7fed9dd9b640 1 -- 172.21.15.53:0/3333384545 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed880ab7b0 con 0x7feda00cb870 2023-06-10T19:06:50.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.594+0000 7fed9dd9b640 1 -- 172.21.15.53:0/3333384545 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed880abb40 con 0x7feda00cb870 2023-06-10T19:06:50.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.594+0000 7feda5102640 1 -- 172.21.15.53:0/3333384545 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feda00cb870 msgr2=0x7feda00af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:50.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.594+0000 7feda5102640 1 --2- 172.21.15.53:0/3333384545 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feda00cb870 0x7feda00af720 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fed880097c0 tx=0x7fed8801c450 comp rx=0 tx=0).stop 2023-06-10T19:06:50.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.594+0000 7feda5102640 1 -- 172.21.15.53:0/3333384545 shutdown_connections 2023-06-10T19:06:50.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.594+0000 7feda5102640 1 --2- 172.21.15.53:0/3333384545 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feda00cb870 0x7feda00af720 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:50.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.594+0000 7feda5102640 1 --2- 172.21.15.53:0/3333384545 >> v2:172.21.15.117:3300/0 conn(0x7feda00c9750 0x7feda00aced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:50.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.594+0000 7feda5102640 1 -- 172.21.15.53:0/3333384545 >> 172.21.15.53:0/3333384545 conn(0x7feda006a0d0 msgr2=0x7feda00ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:50.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.594+0000 7feda5102640 1 -- 172.21.15.53:0/3333384545 shutdown_connections 2023-06-10T19:06:50.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.594+0000 7feda5102640 1 -- 172.21.15.53:0/3333384545 wait complete. 2023-06-10T19:06:50.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.594+0000 7feda5102640 1 Processor -- start 2023-06-10T19:06:50.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.594+0000 7feda5102640 1 -- start start 2023-06-10T19:06:50.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.594+0000 7feda5102640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feda00afc60 0x7feda014f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:50.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.594+0000 7feda5102640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feda00c9750 0x7feda015dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:50.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.594+0000 7feda5102640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feda00cb870 0x7feda0159860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:50.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.594+0000 7feda5102640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feda014f8a0 con 0x7feda00afc60 2023-06-10T19:06:50.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.594+0000 7feda5102640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feda015ede0 con 0x7feda00cb870 2023-06-10T19:06:50.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.594+0000 7feda5102640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feda015e2b0 con 0x7feda00c9750 2023-06-10T19:06:50.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.594+0000 7fed9ed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feda00afc60 0x7feda014f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:50.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.594+0000 7fed9ed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feda00afc60 0x7feda014f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52942/0 (socket says 172.21.15.53:52942) 2023-06-10T19:06:50.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.594+0000 7fed9ed9d640 1 -- 172.21.15.53:0/1697777822 learned_addr learned my addr 172.21.15.53:0/1697777822 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:50.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.594+0000 7fed9f59e640 1 --2- 172.21.15.53:0/1697777822 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feda00cb870 0x7feda0159860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:50.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.594+0000 7fed9e59c640 1 --2- 172.21.15.53:0/1697777822 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feda00c9750 0x7feda015dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:50.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.594+0000 7fed9ed9d640 1 -- 172.21.15.53:0/1697777822 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feda00c9750 msgr2=0x7feda015dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:50.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.594+0000 7fed9ed9d640 1 --2- 172.21.15.53:0/1697777822 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feda00c9750 0x7feda015dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:50.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.594+0000 7fed9ed9d640 1 -- 172.21.15.53:0/1697777822 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feda00cb870 msgr2=0x7feda0159860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:50.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.594+0000 7fed9ed9d640 1 --2- 172.21.15.53:0/1697777822 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feda00cb870 0x7feda0159860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:50.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.594+0000 7fed9ed9d640 1 -- 172.21.15.53:0/1697777822 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed88009420 con 0x7feda00afc60 2023-06-10T19:06:50.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.594+0000 7fed9ed9d640 1 --2- 172.21.15.53:0/1697777822 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feda00afc60 0x7feda014f360 secure :-1 s=READY pgs=2253 cs=0 l=1 rev1=1 crypto rx=0x7fed98009d10 tx=0x7fed9800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:50.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.598+0000 7fed977fe640 1 -- 172.21.15.53:0/1697777822 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed98009b80 con 0x7feda00afc60 2023-06-10T19:06:50.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.598+0000 7fed977fe640 1 -- 172.21.15.53:0/1697777822 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed9800f040 con 0x7feda00afc60 2023-06-10T19:06:50.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.598+0000 7feda5102640 1 -- 172.21.15.53:0/1697777822 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feda0154e70 con 0x7feda00afc60 2023-06-10T19:06:50.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.598+0000 7fed977fe640 1 -- 172.21.15.53:0/1697777822 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed98014680 con 0x7feda00afc60 2023-06-10T19:06:50.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.598+0000 7feda5102640 1 -- 172.21.15.53:0/1697777822 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feda015d290 con 0x7feda00afc60 2023-06-10T19:06:50.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.598+0000 7feda5102640 1 -- 172.21.15.53:0/1697777822 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feda004d790 con 0x7feda00afc60 2023-06-10T19:06:50.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.598+0000 7fed977fe640 1 -- 172.21.15.53:0/1697777822 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fed980147e0 con 0x7feda00afc60 2023-06-10T19:06:50.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.598+0000 7fed977fe640 1 --2- 172.21.15.53:0/1697777822 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fed80066250 0x7fed80068700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:50.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.598+0000 7fed977fe640 1 -- 172.21.15.53:0/1697777822 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6105+0+0 (secure 0 0 0) 0x7fed98084780 con 0x7feda00afc60 2023-06-10T19:06:50.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.598+0000 7fed9e59c640 1 --2- 172.21.15.53:0/1697777822 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fed80066250 0x7fed80068700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:50.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.598+0000 7fed9e59c640 1 --2- 172.21.15.53:0/1697777822 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fed80066250 0x7fed80068700 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fed880af000 tx=0x7fed880a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:50.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.602+0000 7fed977fe640 1 -- 172.21.15.53:0/1697777822 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fed98055710 con 0x7feda00afc60 2023-06-10T19:06:50.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.762+0000 7feda5102640 1 -- 172.21.15.53:0/1697777822 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feda00b0680 con 0x7feda00afc60 2023-06-10T19:06:50.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.762+0000 7fed977fe640 1 -- 172.21.15.53:0/1697777822 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v155) v1 ==== 74+0+18349 (secure 0 0 0) 0x7fed980552a0 con 0x7feda00afc60 2023-06-10T19:06:50.766 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:06:50.766 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":155,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:06:50.154677+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-06-10T19:06:27.279397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-06-10T19:06:27.689260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"154","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.0.1:0/2213488734":"2023-06-10T20:06:49.780814+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:06:50.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.766+0000 7feda5102640 1 -- 172.21.15.53:0/1697777822 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fed80066250 msgr2=0x7fed80068700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:50.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.766+0000 7feda5102640 1 --2- 172.21.15.53:0/1697777822 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fed80066250 0x7fed80068700 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fed880af000 tx=0x7fed880a7000 comp rx=0 tx=0).stop 2023-06-10T19:06:50.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.766+0000 7feda5102640 1 -- 172.21.15.53:0/1697777822 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feda00afc60 msgr2=0x7feda014f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:50.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.766+0000 7feda5102640 1 --2- 172.21.15.53:0/1697777822 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feda00afc60 0x7feda014f360 secure :-1 s=READY pgs=2253 cs=0 l=1 rev1=1 crypto rx=0x7fed98009d10 tx=0x7fed9800c490 comp rx=0 tx=0).stop 2023-06-10T19:06:50.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.766+0000 7feda5102640 1 -- 172.21.15.53:0/1697777822 shutdown_connections 2023-06-10T19:06:50.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.766+0000 7feda5102640 1 --2- 172.21.15.53:0/1697777822 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fed80066250 0x7fed80068700 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:50.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.766+0000 7feda5102640 1 --2- 172.21.15.53:0/1697777822 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feda00cb870 0x7feda0159860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:50.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.766+0000 7feda5102640 1 --2- 172.21.15.53:0/1697777822 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feda00c9750 0x7feda015dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:50.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.766+0000 7feda5102640 1 --2- 172.21.15.53:0/1697777822 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feda00afc60 0x7feda014f360 unknown :-1 s=CLOSED pgs=2253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:50.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.766+0000 7feda5102640 1 -- 172.21.15.53:0/1697777822 >> 172.21.15.53:0/1697777822 conn(0x7feda006a0d0 msgr2=0x7feda01585b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:50.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.766+0000 7feda5102640 1 -- 172.21.15.53:0/1697777822 shutdown_connections 2023-06-10T19:06:50.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.766+0000 7feda5102640 1 -- 172.21.15.53:0/1697777822 wait complete. 2023-06-10T19:06:50.785 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-10T18:52:33.633114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-10T18:52:39.171487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 21, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-10T19:06:27.279397+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '153', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 22, 'pool_name': 'cephfs_data', 'create_time': '2023-06-10T19:06:27.689260+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '154', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-10T19:06:50.786 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-10T19:06:50.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.906+0000 7f581f244640 1 Processor -- start 2023-06-10T19:06:50.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.906+0000 7f581f244640 1 -- start start 2023-06-10T19:06:50.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.906+0000 7f581f244640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f581815c060 0x7f58180cc020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:50.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.906+0000 7f581f244640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f581815cf40 con 0x7f5818070de0 2023-06-10T19:06:50.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.906+0000 7f581f244640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58180c8d50 con 0x7f581815cb40 2023-06-10T19:06:50.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.906+0000 7f581f244640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58180c9030 con 0x7f581815c060 2023-06-10T19:06:50.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.906+0000 7f5817fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f5818070de0 0x7f581815c430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:36676/0 (socket says 172.21.15.53:36676) 2023-06-10T19:06:50.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.906+0000 7f5817fff640 1 -- 172.21.15.53:0/1997899153 learned_addr learned my addr 172.21.15.53:0/1997899153 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:06:50.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.906+0000 7f581cfe0640 1 --2- 172.21.15.53:0/1997899153 >> v2:172.21.15.117:3300/0 conn(0x7f581815c060 0x7f58180cc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:50.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.906+0000 7f58177fe640 1 -- 172.21.15.53:0/1997899153 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1847499933 0 0) 0x7f581815cf40 con 0x7f5818070de0 2023-06-10T19:06:50.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.906+0000 7f58177fe640 1 -- 172.21.15.53:0/1997899153 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5800003530 con 0x7f5818070de0 2023-06-10T19:06:50.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.906+0000 7f58177fe640 1 -- 172.21.15.53:0/1997899153 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1017689839 0 0) 0x7f5800003530 con 0x7f5818070de0 2023-06-10T19:06:50.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.906+0000 7f58177fe640 1 -- 172.21.15.53:0/1997899153 >> v2:172.21.15.117:3300/0 conn(0x7f581815c060 msgr2=0x7f58180cc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:50.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.906+0000 7f58177fe640 1 --2- 172.21.15.53:0/1997899153 >> v2:172.21.15.117:3300/0 conn(0x7f581815c060 0x7f58180cc020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:50.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.906+0000 7f58177fe640 1 -- 172.21.15.53:0/1997899153 >> v1:172.21.15.117:6789/0 conn(0x7f581815cb40 legacy=0x7f581806bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:50.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.906+0000 7f58177fe640 1 -- 172.21.15.53:0/1997899153 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5818070300 con 0x7f5818070de0 2023-06-10T19:06:50.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.906+0000 7f58177fe640 1 -- 172.21.15.53:0/1997899153 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f580c001680 con 0x7f5818070de0 2023-06-10T19:06:50.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.906+0000 7f58177fe640 1 -- 172.21.15.53:0/1997899153 >> v1:172.21.15.53:6789/0 conn(0x7f5818070de0 legacy=0x7f581815c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:50.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.906+0000 7f58177fe640 1 --2- 172.21.15.53:0/1997899153 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5800003980 0x7f5800003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:50.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.906+0000 7f58177fe640 1 --2- 172.21.15.53:0/1997899153 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f58000047d0 0x7f5800004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:50.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.906+0000 7f58177fe640 1 --2- 172.21.15.53:0/1997899153 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5800005180 0x7f580000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:50.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.906+0000 7f58177fe640 1 -- 172.21.15.53:0/1997899153 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58180c9030 con 0x7f58000047d0 2023-06-10T19:06:50.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.906+0000 7f58177fe640 1 -- 172.21.15.53:0/1997899153 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f580000c090 con 0x7f5800003980 2023-06-10T19:06:50.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.906+0000 7f58177fe640 1 -- 172.21.15.53:0/1997899153 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f580000c250 con 0x7f5800005180 2023-06-10T19:06:50.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.906+0000 7f5817fff640 1 --2- 172.21.15.53:0/1997899153 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f58000047d0 0x7f5800004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:50.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.906+0000 7f581cfe0640 1 --2- 172.21.15.53:0/1997899153 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5800003980 0x7f5800003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:50.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.906+0000 7f581d7e1640 1 --2- 172.21.15.53:0/1997899153 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5800005180 0x7f580000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:50.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.906+0000 7f5817fff640 1 -- 172.21.15.53:0/1997899153 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5800005180 msgr2=0x7f580000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:50.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.906+0000 7f5817fff640 1 --2- 172.21.15.53:0/1997899153 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5800005180 0x7f580000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:50.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.906+0000 7f5817fff640 1 -- 172.21.15.53:0/1997899153 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5800003980 msgr2=0x7f5800003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:50.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.906+0000 7f5817fff640 1 --2- 172.21.15.53:0/1997899153 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5800003980 0x7f5800003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:50.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.906+0000 7f5817fff640 1 -- 172.21.15.53:0/1997899153 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5800003530 con 0x7f58000047d0 2023-06-10T19:06:50.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.906+0000 7f581cfe0640 1 --2- 172.21.15.53:0/1997899153 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5800003980 0x7f5800003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:06:50.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.906+0000 7f581d7e1640 1 --2- 172.21.15.53:0/1997899153 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5800005180 0x7f580000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:06:50.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.906+0000 7f581d7e1640 1 -- 172.21.15.53:0/1997899153 reap_dead start 2023-06-10T19:06:50.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.910+0000 7f5817fff640 1 --2- 172.21.15.53:0/1997899153 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f58000047d0 0x7f5800004c40 secure :-1 s=READY pgs=2255 cs=0 l=1 rev1=1 crypto rx=0x7f580c00c240 tx=0x7f580c01cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e097c4a095b3fb server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:50.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.910+0000 7f58177fe640 1 -- 172.21.15.53:0/1997899153 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f580c0a5b10 con 0x7f58000047d0 2023-06-10T19:06:50.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.910+0000 7f58177fe640 1 -- 172.21.15.53:0/1997899153 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f580c0a5c70 con 0x7f58000047d0 2023-06-10T19:06:50.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.910+0000 7f58177fe640 1 -- 172.21.15.53:0/1997899153 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f580c005b20 con 0x7f58000047d0 2023-06-10T19:06:50.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.910+0000 7f581f244640 1 -- 172.21.15.53:0/1997899153 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f58000047d0 msgr2=0x7f5800004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:50.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.910+0000 7f581f244640 1 --2- 172.21.15.53:0/1997899153 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f58000047d0 0x7f5800004c40 secure :-1 s=READY pgs=2255 cs=0 l=1 rev1=1 crypto rx=0x7f580c00c240 tx=0x7f580c01cc10 comp rx=0 tx=0).stop 2023-06-10T19:06:50.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.910+0000 7f581f244640 1 -- 172.21.15.53:0/1997899153 shutdown_connections 2023-06-10T19:06:50.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.910+0000 7f581f244640 1 --2- 172.21.15.53:0/1997899153 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f58000047d0 0x7f5800004c40 unknown :-1 s=CLOSED pgs=2255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:50.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.910+0000 7f581f244640 1 -- 172.21.15.53:0/1997899153 >> 172.21.15.53:0/1997899153 conn(0x7f581806a0e0 msgr2=0x7f58180cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:50.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.910+0000 7f581f244640 1 -- 172.21.15.53:0/1997899153 shutdown_connections 2023-06-10T19:06:50.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.910+0000 7f581f244640 1 -- 172.21.15.53:0/1997899153 wait complete. 2023-06-10T19:06:50.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.910+0000 7f581f244640 1 Processor -- start 2023-06-10T19:06:50.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.910+0000 7f581f244640 1 -- start start 2023-06-10T19:06:50.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.914+0000 7f581f244640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f58000047d0 0x7f5818151bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:50.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.914+0000 7f581f244640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f581815b050 0x7f58180cd060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:50.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.914+0000 7f581f244640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58180cd5a0 0x7f58181e84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:50.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.914+0000 7f581f244640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5818152780 con 0x7f58000047d0 2023-06-10T19:06:50.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.914+0000 7f581f244640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5818159fb0 con 0x7f58180cd5a0 2023-06-10T19:06:50.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.914+0000 7f581f244640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f581815a290 con 0x7f581815b050 2023-06-10T19:06:50.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.914+0000 7f581cfe0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f58000047d0 0x7f5818151bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:50.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.914+0000 7f581cfe0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f58000047d0 0x7f5818151bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52960/0 (socket says 172.21.15.53:52960) 2023-06-10T19:06:50.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.914+0000 7f581cfe0640 1 -- 172.21.15.53:0/3516020164 learned_addr learned my addr 172.21.15.53:0/3516020164 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:50.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.914+0000 7f5817fff640 1 --2- 172.21.15.53:0/3516020164 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f581815b050 0x7f58180cd060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:50.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.914+0000 7f581d7e1640 1 --2- 172.21.15.53:0/3516020164 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58180cd5a0 0x7f58181e84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:50.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.914+0000 7f581cfe0640 1 -- 172.21.15.53:0/3516020164 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f581815b050 msgr2=0x7f58180cd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:50.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.914+0000 7f581cfe0640 1 --2- 172.21.15.53:0/3516020164 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f581815b050 0x7f58180cd060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:50.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.914+0000 7f581cfe0640 1 -- 172.21.15.53:0/3516020164 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58180cd5a0 msgr2=0x7f58181e84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:50.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.914+0000 7f581cfe0640 1 --2- 172.21.15.53:0/3516020164 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58180cd5a0 0x7f58181e84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:50.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.914+0000 7f581cfe0640 1 -- 172.21.15.53:0/3516020164 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f581815a570 con 0x7f58000047d0 2023-06-10T19:06:50.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.914+0000 7f581d7e1640 1 --2- 172.21.15.53:0/3516020164 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58180cd5a0 0x7f58181e84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:06:50.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.914+0000 7f581cfe0640 1 --2- 172.21.15.53:0/3516020164 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f58000047d0 0x7f5818151bd0 secure :-1 s=READY pgs=2256 cs=0 l=1 rev1=1 crypto rx=0x7f58080118d0 tx=0x7f5808011d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:50.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.914+0000 7f58157fa640 1 -- 172.21.15.53:0/3516020164 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5808004220 con 0x7f58000047d0 2023-06-10T19:06:50.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.914+0000 7f58157fa640 1 -- 172.21.15.53:0/3516020164 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5808004380 con 0x7f58000047d0 2023-06-10T19:06:50.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.914+0000 7f581f244640 1 -- 172.21.15.53:0/3516020164 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f581815a850 con 0x7f58000047d0 2023-06-10T19:06:50.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.914+0000 7f58157fa640 1 -- 172.21.15.53:0/3516020164 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f580800fbd0 con 0x7f58000047d0 2023-06-10T19:06:50.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.914+0000 7f581f244640 1 -- 172.21.15.53:0/3516020164 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5818159c60 con 0x7f58000047d0 2023-06-10T19:06:50.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.914+0000 7f581f244640 1 -- 172.21.15.53:0/3516020164 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f581804d790 con 0x7f58000047d0 2023-06-10T19:06:50.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.914+0000 7f58157fa640 1 -- 172.21.15.53:0/3516020164 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f580800fd30 con 0x7f58000047d0 2023-06-10T19:06:50.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.914+0000 7f58157fa640 1 --2- 172.21.15.53:0/3516020164 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f58040662b0 0x7f5804068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:50.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.914+0000 7f58157fa640 1 -- 172.21.15.53:0/3516020164 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6105+0+0 (secure 0 0 0) 0x7f5808084480 con 0x7f58000047d0 2023-06-10T19:06:50.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.918+0000 7f5817fff640 1 --2- 172.21.15.53:0/3516020164 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f58040662b0 0x7f5804068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:50.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.918+0000 7f5817fff640 1 --2- 172.21.15.53:0/3516020164 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f58040662b0 0x7f5804068760 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f580c0ab000 tx=0x7f580c006040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:50.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:50.918+0000 7f58157fa640 1 -- 172.21.15.53:0/3516020164 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5808051830 con 0x7f58000047d0 2023-06-10T19:06:51.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.074+0000 7f581f244640 1 -- 172.21.15.53:0/3516020164 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f58180aef30 con 0x7f58000047d0 2023-06-10T19:06:51.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.078+0000 7f58157fa640 1 -- 172.21.15.53:0/3516020164 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v155) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5808054e50 con 0x7f58000047d0 2023-06-10T19:06:51.079 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-06-10T19:06:51.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.078+0000 7f581f244640 1 -- 172.21.15.53:0/3516020164 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f58040662b0 msgr2=0x7f5804068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:51.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.078+0000 7f581f244640 1 --2- 172.21.15.53:0/3516020164 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f58040662b0 0x7f5804068760 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f580c0ab000 tx=0x7f580c006040 comp rx=0 tx=0).stop 2023-06-10T19:06:51.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.078+0000 7f581f244640 1 -- 172.21.15.53:0/3516020164 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f58000047d0 msgr2=0x7f5818151bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:51.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.078+0000 7f581f244640 1 --2- 172.21.15.53:0/3516020164 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f58000047d0 0x7f5818151bd0 secure :-1 s=READY pgs=2256 cs=0 l=1 rev1=1 crypto rx=0x7f58080118d0 tx=0x7f5808011d90 comp rx=0 tx=0).stop 2023-06-10T19:06:51.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.078+0000 7f581f244640 1 -- 172.21.15.53:0/3516020164 shutdown_connections 2023-06-10T19:06:51.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.078+0000 7f581f244640 1 --2- 172.21.15.53:0/3516020164 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f58040662b0 0x7f5804068760 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:51.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.078+0000 7f581f244640 1 --2- 172.21.15.53:0/3516020164 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58180cd5a0 0x7f58181e84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:51.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.078+0000 7f581f244640 1 --2- 172.21.15.53:0/3516020164 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f581815b050 0x7f58180cd060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:51.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.078+0000 7f581f244640 1 --2- 172.21.15.53:0/3516020164 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f58000047d0 0x7f5818151bd0 unknown :-1 s=CLOSED pgs=2256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:51.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.078+0000 7f581f244640 1 -- 172.21.15.53:0/3516020164 >> 172.21.15.53:0/3516020164 conn(0x7f581806a0e0 msgr2=0x7f58180b0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:51.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.078+0000 7f581f244640 1 -- 172.21.15.53:0/3516020164 shutdown_connections 2023-06-10T19:06:51.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.078+0000 7f581f244640 1 -- 172.21.15.53:0/3516020164 wait complete. 2023-06-10T19:06:51.099 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-10T19:06:51.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.230+0000 7f3b989cc640 1 Processor -- start 2023-06-10T19:06:51.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.230+0000 7f3b989cc640 1 -- start start 2023-06-10T19:06:51.232 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.230+0000 7f3b989cc640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3b940c97d0 0x7f3b940cb820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:51.232 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.230+0000 7f3b989cc640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b940ac910 con 0x7f3b9406c350 2023-06-10T19:06:51.232 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.230+0000 7f3b989cc640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b940cbd60 con 0x7f3b940af760 2023-06-10T19:06:51.232 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.230+0000 7f3b989cc640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b940ca5c0 con 0x7f3b940c97d0 2023-06-10T19:06:51.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.230+0000 7f3b91d9b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f3b9406c350 0x7f3b940ac200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:47694/0 (socket says 172.21.15.53:47694) 2023-06-10T19:06:51.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.230+0000 7f3b91d9b640 1 -- 172.21.15.53:0/2091009021 learned_addr learned my addr 172.21.15.53:0/2091009021 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:06:51.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.230+0000 7f3b9259c640 1 --2- 172.21.15.53:0/2091009021 >> v2:172.21.15.117:3300/0 conn(0x7f3b940c97d0 0x7f3b940cb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:51.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.230+0000 7f3b9159a640 1 -- 172.21.15.53:0/2091009021 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3766400854 0 0) 0x7f3b940ac910 con 0x7f3b9406c350 2023-06-10T19:06:51.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.230+0000 7f3b9159a640 1 -- 172.21.15.53:0/2091009021 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b7c003530 con 0x7f3b9406c350 2023-06-10T19:06:51.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.230+0000 7f3b9259c640 1 -- 172.21.15.53:0/2091009021 >> v1:172.21.15.117:6789/0 conn(0x7f3b940af760 legacy=0x7f3b9406b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:51.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.230+0000 7f3b9259c640 1 -- 172.21.15.53:0/2091009021 >> v1:172.21.15.53:6789/0 conn(0x7f3b9406c350 legacy=0x7f3b940ac200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:51.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.230+0000 7f3b9159a640 1 -- 172.21.15.53:0/2091009021 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2106556412 0 0) 0x7f3b7c003530 con 0x7f3b9406c350 2023-06-10T19:06:51.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.230+0000 7f3b9259c640 1 -- 172.21.15.53:0/2091009021 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b940abd70 con 0x7f3b940c97d0 2023-06-10T19:06:51.235 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.234+0000 7f3b9259c640 1 --2- 172.21.15.53:0/2091009021 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b940c97d0 0x7f3b940cb820 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f3b840097c0 tx=0x7f3b8401c280 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f4326dae64bae06 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:51.235 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.234+0000 7f3b9159a640 1 -- 172.21.15.53:0/2091009021 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b88001680 con 0x7f3b940c97d0 2023-06-10T19:06:51.235 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.234+0000 7f3b9159a640 1 -- 172.21.15.53:0/2091009021 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b840a7050 con 0x7f3b940c97d0 2023-06-10T19:06:51.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.234+0000 7f3b9159a640 1 -- 172.21.15.53:0/2091009021 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b840ab600 con 0x7f3b940c97d0 2023-06-10T19:06:51.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.234+0000 7f3b989cc640 1 -- 172.21.15.53:0/2091009021 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b940c97d0 msgr2=0x7f3b940cb820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:51.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.234+0000 7f3b989cc640 1 --2- 172.21.15.53:0/2091009021 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b940c97d0 0x7f3b940cb820 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f3b840097c0 tx=0x7f3b8401c280 comp rx=0 tx=0).stop 2023-06-10T19:06:51.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.234+0000 7f3b989cc640 1 -- 172.21.15.53:0/2091009021 shutdown_connections 2023-06-10T19:06:51.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.234+0000 7f3b989cc640 1 --2- 172.21.15.53:0/2091009021 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b940c97d0 0x7f3b940cb820 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:51.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.234+0000 7f3b989cc640 1 -- 172.21.15.53:0/2091009021 >> 172.21.15.53:0/2091009021 conn(0x7f3b9406a0e0 msgr2=0x7f3b940cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:51.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.234+0000 7f3b989cc640 1 -- 172.21.15.53:0/2091009021 shutdown_connections 2023-06-10T19:06:51.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.234+0000 7f3b989cc640 1 -- 172.21.15.53:0/2091009021 wait complete. 2023-06-10T19:06:51.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.234+0000 7f3b989cc640 1 Processor -- start 2023-06-10T19:06:51.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.234+0000 7f3b989cc640 1 -- start start 2023-06-10T19:06:51.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.238+0000 7f3b989cc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b9406c350 0x7f3b9414fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:51.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.238+0000 7f3b989cc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b940af760 0x7f3b9415a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:51.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.238+0000 7f3b989cc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b940c97d0 0x7f3b940b20f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:51.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.238+0000 7f3b989cc640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b94158420 con 0x7f3b940c97d0 2023-06-10T19:06:51.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.238+0000 7f3b989cc640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b94150160 con 0x7f3b940af760 2023-06-10T19:06:51.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.238+0000 7f3b989cc640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9415a7a0 con 0x7f3b9406c350 2023-06-10T19:06:51.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.238+0000 7f3b92d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b940c97d0 0x7f3b940b20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:51.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.238+0000 7f3b92d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b940c97d0 0x7f3b940b20f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48760/0 (socket says 172.21.15.53:48760) 2023-06-10T19:06:51.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.238+0000 7f3b92d9d640 1 -- 172.21.15.53:0/3155454017 learned_addr learned my addr 172.21.15.53:0/3155454017 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:51.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.238+0000 7f3b91d9b640 1 --2- 172.21.15.53:0/3155454017 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b940af760 0x7f3b9415a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:51.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.238+0000 7f3b9259c640 1 --2- 172.21.15.53:0/3155454017 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b9406c350 0x7f3b9414fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:51.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.238+0000 7f3b92d9d640 1 -- 172.21.15.53:0/3155454017 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b9406c350 msgr2=0x7f3b9414fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:51.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.238+0000 7f3b92d9d640 1 --2- 172.21.15.53:0/3155454017 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b9406c350 0x7f3b9414fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:51.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.238+0000 7f3b92d9d640 1 -- 172.21.15.53:0/3155454017 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b940af760 msgr2=0x7f3b9415a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:51.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.238+0000 7f3b92d9d640 1 --2- 172.21.15.53:0/3155454017 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b940af760 0x7f3b9415a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:51.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.238+0000 7f3b92d9d640 1 -- 172.21.15.53:0/3155454017 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b84009420 con 0x7f3b940c97d0 2023-06-10T19:06:51.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.238+0000 7f3b92d9d640 1 --2- 172.21.15.53:0/3155454017 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b940c97d0 0x7f3b940b20f0 secure :-1 s=READY pgs=2258 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c00c760 tx=0x7f3b8c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:51.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.238+0000 7f3b82ffd640 1 -- 172.21.15.53:0/3155454017 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8c003b80 con 0x7f3b940c97d0 2023-06-10T19:06:51.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.238+0000 7f3b82ffd640 1 -- 172.21.15.53:0/3155454017 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b8c003ce0 con 0x7f3b940c97d0 2023-06-10T19:06:51.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.238+0000 7f3b989cc640 1 -- 172.21.15.53:0/3155454017 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b94152fb0 con 0x7f3b940c97d0 2023-06-10T19:06:51.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.238+0000 7f3b82ffd640 1 -- 172.21.15.53:0/3155454017 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8c00aa30 con 0x7f3b940c97d0 2023-06-10T19:06:51.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.238+0000 7f3b989cc640 1 -- 172.21.15.53:0/3155454017 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b9415acb0 con 0x7f3b940c97d0 2023-06-10T19:06:51.243 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.238+0000 7f3b989cc640 1 -- 172.21.15.53:0/3155454017 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b94158560 con 0x7f3b940c97d0 2023-06-10T19:06:51.243 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.238+0000 7f3b82ffd640 1 -- 172.21.15.53:0/3155454017 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3b8c00ab90 con 0x7f3b940c97d0 2023-06-10T19:06:51.243 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.238+0000 7f3b82ffd640 1 --2- 172.21.15.53:0/3155454017 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3b74066280 0x7f3b74068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:51.244 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.238+0000 7f3b82ffd640 1 -- 172.21.15.53:0/3155454017 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6105+0+0 (secure 0 0 0) 0x7f3b8c0839c0 con 0x7f3b940c97d0 2023-06-10T19:06:51.244 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.238+0000 7f3b9259c640 1 --2- 172.21.15.53:0/3155454017 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3b74066280 0x7f3b74068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:51.244 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.242+0000 7f3b9259c640 1 --2- 172.21.15.53:0/3155454017 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3b74066280 0x7f3b74068730 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f3b840ad000 tx=0x7f3b840a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:51.245 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.242+0000 7f3b82ffd640 1 -- 172.21.15.53:0/3155454017 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3b94158560 con 0x7f3b940c97d0 2023-06-10T19:06:51.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.394+0000 7f3b989cc640 1 -- 172.21.15.53:0/3155454017 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3b940cbd60 con 0x7f3b940c97d0 2023-06-10T19:06:51.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.398+0000 7f3b82ffd640 1 -- 172.21.15.53:0/3155454017 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v155) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3b940cbd60 con 0x7f3b940c97d0 2023-06-10T19:06:51.399 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-06-10T19:06:51.401 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.398+0000 7f3b989cc640 1 -- 172.21.15.53:0/3155454017 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3b74066280 msgr2=0x7f3b74068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:51.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.398+0000 7f3b989cc640 1 --2- 172.21.15.53:0/3155454017 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3b74066280 0x7f3b74068730 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f3b840ad000 tx=0x7f3b840a6000 comp rx=0 tx=0).stop 2023-06-10T19:06:51.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.398+0000 7f3b989cc640 1 -- 172.21.15.53:0/3155454017 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b940c97d0 msgr2=0x7f3b940b20f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:51.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.398+0000 7f3b989cc640 1 --2- 172.21.15.53:0/3155454017 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b940c97d0 0x7f3b940b20f0 secure :-1 s=READY pgs=2258 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c00c760 tx=0x7f3b8c00cc20 comp rx=0 tx=0).stop 2023-06-10T19:06:51.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.398+0000 7f3b989cc640 1 -- 172.21.15.53:0/3155454017 shutdown_connections 2023-06-10T19:06:51.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.398+0000 7f3b989cc640 1 --2- 172.21.15.53:0/3155454017 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3b74066280 0x7f3b74068730 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:51.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.398+0000 7f3b989cc640 1 --2- 172.21.15.53:0/3155454017 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b940c97d0 0x7f3b940b20f0 unknown :-1 s=CLOSED pgs=2258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:51.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.398+0000 7f3b989cc640 1 --2- 172.21.15.53:0/3155454017 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b940af760 0x7f3b9415a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:51.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.398+0000 7f3b989cc640 1 --2- 172.21.15.53:0/3155454017 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b9406c350 0x7f3b9414fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:51.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.398+0000 7f3b989cc640 1 -- 172.21.15.53:0/3155454017 >> 172.21.15.53:0/3155454017 conn(0x7f3b9406a0e0 msgr2=0x7f3b940cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:51.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.398+0000 7f3b989cc640 1 -- 172.21.15.53:0/3155454017 shutdown_connections 2023-06-10T19:06:51.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.398+0000 7f3b989cc640 1 -- 172.21.15.53:0/3155454017 wait complete. 2023-06-10T19:06:51.419 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-10T19:06:51.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.542+0000 7fd3ff73c640 1 Processor -- start 2023-06-10T19:06:51.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.542+0000 7fd3ff73c640 1 -- start start 2023-06-10T19:06:51.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.542+0000 7fd3ff73c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd3f806c400 0x7fd3f8157fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:51.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.542+0000 7fd3ff73c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd3f806c7d0 0x7fd3f8158520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:51.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.542+0000 7fd3ff73c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3f80ccc90 0x7fd3f80cd110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:51.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.542+0000 7fd3ff73c640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3f815cee0 con 0x7fd3f806c400 2023-06-10T19:06:51.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.542+0000 7fd3ff73c640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3f8158a60 con 0x7fd3f806c7d0 2023-06-10T19:06:51.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.542+0000 7fd3ff73c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f815c260 con 0x7fd3f80ccc90 2023-06-10T19:06:51.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.542+0000 7fd3fd4d8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd3f806c400 0x7fd3f8157fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:51.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.542+0000 7fd3fd4d8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd3f806c400 0x7fd3f8157fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48774/0 (socket says 172.21.15.53:48774) 2023-06-10T19:06:51.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.542+0000 7fd3fd4d8640 1 -- 172.21.15.53:0/1472445383 learned_addr learned my addr 172.21.15.53:0/1472445383 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:51.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.542+0000 7fd3fdcd9640 1 --2- 172.21.15.53:0/1472445383 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3f80ccc90 0x7fd3f80cd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:51.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.542+0000 7fd3fccd7640 1 --2- 172.21.15.53:0/1472445383 >> v2:172.21.15.117:3300/0 conn(0x7fd3f806c7d0 0x7fd3f8158520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:51.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.542+0000 7fd3fd4d8640 1 -- 172.21.15.53:0/1472445383 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3f80ccc90 msgr2=0x7fd3f80cd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:51.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.542+0000 7fd3fd4d8640 1 --2- 172.21.15.53:0/1472445383 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3f80ccc90 0x7fd3f80cd110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:51.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.542+0000 7fd3fd4d8640 1 -- 172.21.15.53:0/1472445383 >> v2:172.21.15.117:3300/0 conn(0x7fd3f806c7d0 msgr2=0x7fd3f8158520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:51.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.542+0000 7fd3fd4d8640 1 --2- 172.21.15.53:0/1472445383 >> v2:172.21.15.117:3300/0 conn(0x7fd3f806c7d0 0x7fd3f8158520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:51.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.542+0000 7fd3fd4d8640 1 -- 172.21.15.53:0/1472445383 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3f815c540 con 0x7fd3f806c400 2023-06-10T19:06:51.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.542+0000 7fd3fccd7640 1 --2- 172.21.15.53:0/1472445383 >> v2:172.21.15.117:3300/0 conn(0x7fd3f806c7d0 0x7fd3f8158520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:06:51.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.546+0000 7fd3fd4d8640 1 --2- 172.21.15.53:0/1472445383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3f806c400 0x7fd3f8157fe0 secure :-1 s=READY pgs=2259 cs=0 l=1 rev1=1 crypto rx=0x7fd3f80cfeb0 tx=0x7fd3f001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=defd53f41733128 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:51.550 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.546+0000 7fd3f7fff640 1 -- 172.21.15.53:0/1472445383 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f00ab600 con 0x7fd3f806c400 2023-06-10T19:06:51.550 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.546+0000 7fd3f7fff640 1 -- 172.21.15.53:0/1472445383 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3f00ab760 con 0x7fd3f806c400 2023-06-10T19:06:51.550 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.546+0000 7fd3f7fff640 1 -- 172.21.15.53:0/1472445383 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f00abaf0 con 0x7fd3f806c400 2023-06-10T19:06:51.550 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.546+0000 7fd3ff73c640 1 -- 172.21.15.53:0/1472445383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3f806c400 msgr2=0x7fd3f8157fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:51.550 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.546+0000 7fd3ff73c640 1 --2- 172.21.15.53:0/1472445383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3f806c400 0x7fd3f8157fe0 secure :-1 s=READY pgs=2259 cs=0 l=1 rev1=1 crypto rx=0x7fd3f80cfeb0 tx=0x7fd3f001c440 comp rx=0 tx=0).stop 2023-06-10T19:06:51.550 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.546+0000 7fd3ff73c640 1 -- 172.21.15.53:0/1472445383 shutdown_connections 2023-06-10T19:06:51.550 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.546+0000 7fd3ff73c640 1 --2- 172.21.15.53:0/1472445383 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3f80ccc90 0x7fd3f80cd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:51.551 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.546+0000 7fd3ff73c640 1 --2- 172.21.15.53:0/1472445383 >> v2:172.21.15.117:3300/0 conn(0x7fd3f806c7d0 0x7fd3f8158520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:51.551 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.546+0000 7fd3ff73c640 1 --2- 172.21.15.53:0/1472445383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3f806c400 0x7fd3f8157fe0 unknown :-1 s=CLOSED pgs=2259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:51.551 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.546+0000 7fd3ff73c640 1 -- 172.21.15.53:0/1472445383 >> 172.21.15.53:0/1472445383 conn(0x7fd3f806a560 msgr2=0x7fd3f806a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:51.551 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.546+0000 7fd3ff73c640 1 -- 172.21.15.53:0/1472445383 shutdown_connections 2023-06-10T19:06:51.551 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.546+0000 7fd3ff73c640 1 -- 172.21.15.53:0/1472445383 wait complete. 2023-06-10T19:06:51.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.550+0000 7fd3ff73c640 1 Processor -- start 2023-06-10T19:06:51.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.550+0000 7fd3ff73c640 1 -- start start 2023-06-10T19:06:51.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.550+0000 7fd3ff73c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3f806c400 0x7fd3f8153a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:51.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.550+0000 7fd3ff73c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3f806c7d0 0x7fd3f8157270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:51.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.550+0000 7fd3ff73c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3f80ccc90 0x7fd3f8154d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:51.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.550+0000 7fd3ff73c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f80c2a80 con 0x7fd3f806c400 2023-06-10T19:06:51.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.550+0000 7fd3ff73c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f80c2d60 con 0x7fd3f80ccc90 2023-06-10T19:06:51.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.550+0000 7fd3ff73c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f80c3040 con 0x7fd3f806c7d0 2023-06-10T19:06:51.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.550+0000 7fd3fd4d8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3f806c400 0x7fd3f8153a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:51.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.550+0000 7fd3fd4d8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3f806c400 0x7fd3f8153a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48776/0 (socket says 172.21.15.53:48776) 2023-06-10T19:06:51.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.550+0000 7fd3fd4d8640 1 -- 172.21.15.53:0/983181560 learned_addr learned my addr 172.21.15.53:0/983181560 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:51.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.550+0000 7fd3fccd7640 1 --2- 172.21.15.53:0/983181560 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3f806c7d0 0x7fd3f8157270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:51.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.550+0000 7fd3fd4d8640 1 -- 172.21.15.53:0/983181560 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3f806c7d0 msgr2=0x7fd3f8157270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:51.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.550+0000 7fd3fd4d8640 1 --2- 172.21.15.53:0/983181560 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3f806c7d0 0x7fd3f8157270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:51.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.550+0000 7fd3fdcd9640 1 --2- 172.21.15.53:0/983181560 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3f80ccc90 0x7fd3f8154d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:51.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.550+0000 7fd3fd4d8640 1 -- 172.21.15.53:0/983181560 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3f80ccc90 msgr2=0x7fd3f8154d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:51.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.550+0000 7fd3fd4d8640 1 --2- 172.21.15.53:0/983181560 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3f80ccc90 0x7fd3f8154d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:51.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.550+0000 7fd3fd4d8640 1 -- 172.21.15.53:0/983181560 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3f00094d0 con 0x7fd3f806c400 2023-06-10T19:06:51.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.550+0000 7fd3fd4d8640 1 --2- 172.21.15.53:0/983181560 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3f806c400 0x7fd3f8153a40 secure :-1 s=READY pgs=2260 cs=0 l=1 rev1=1 crypto rx=0x7fd3f001aaf0 tx=0x7fd3f001ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:51.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.550+0000 7fd3f5ffb640 1 -- 172.21.15.53:0/983181560 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f00ab600 con 0x7fd3f806c400 2023-06-10T19:06:51.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.550+0000 7fd3f5ffb640 1 -- 172.21.15.53:0/983181560 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3f00b4800 con 0x7fd3f806c400 2023-06-10T19:06:51.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.550+0000 7fd3ff73c640 1 -- 172.21.15.53:0/983181560 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3f80c3320 con 0x7fd3f806c400 2023-06-10T19:06:51.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.550+0000 7fd3f5ffb640 1 -- 172.21.15.53:0/983181560 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f00b4b70 con 0x7fd3f806c400 2023-06-10T19:06:51.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.550+0000 7fd3ff73c640 1 -- 172.21.15.53:0/983181560 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3f8153f80 con 0x7fd3f806c400 2023-06-10T19:06:51.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.550+0000 7fd3ff73c640 1 -- 172.21.15.53:0/983181560 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3f804d790 con 0x7fd3f806c400 2023-06-10T19:06:51.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.550+0000 7fd3f5ffb640 1 -- 172.21.15.53:0/983181560 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd3f00b4cd0 con 0x7fd3f806c400 2023-06-10T19:06:51.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.550+0000 7fd3f5ffb640 1 --2- 172.21.15.53:0/983181560 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd3e40662b0 0x7fd3e4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:51.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.550+0000 7fd3f5ffb640 1 -- 172.21.15.53:0/983181560 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6105+0+0 (secure 0 0 0) 0x7fd3f011e2b0 con 0x7fd3f806c400 2023-06-10T19:06:51.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.554+0000 7fd3fccd7640 1 --2- 172.21.15.53:0/983181560 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd3e40662b0 0x7fd3e4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:51.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.554+0000 7fd3fccd7640 1 --2- 172.21.15.53:0/983181560 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd3e40662b0 0x7fd3e4068760 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fd3f8155da0 tx=0x7fd3ec008460 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:51.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.558+0000 7fd3f5ffb640 1 -- 172.21.15.53:0/983181560 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd3f00eb720 con 0x7fd3f806c400 2023-06-10T19:06:51.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.710+0000 7fd3ff73c640 1 -- 172.21.15.53:0/983181560 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd3f80c2bc0 con 0x7fd3f806c400 2023-06-10T19:06:51.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.710+0000 7fd3f5ffb640 1 -- 172.21.15.53:0/983181560 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v155) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd3f80c2bc0 con 0x7fd3f806c400 2023-06-10T19:06:51.714 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-06-10T19:06:51.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.714+0000 7fd3ff73c640 1 -- 172.21.15.53:0/983181560 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd3e40662b0 msgr2=0x7fd3e4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:51.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.714+0000 7fd3ff73c640 1 --2- 172.21.15.53:0/983181560 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd3e40662b0 0x7fd3e4068760 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fd3f8155da0 tx=0x7fd3ec008460 comp rx=0 tx=0).stop 2023-06-10T19:06:51.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.714+0000 7fd3ff73c640 1 -- 172.21.15.53:0/983181560 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3f806c400 msgr2=0x7fd3f8153a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:51.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.714+0000 7fd3ff73c640 1 --2- 172.21.15.53:0/983181560 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3f806c400 0x7fd3f8153a40 secure :-1 s=READY pgs=2260 cs=0 l=1 rev1=1 crypto rx=0x7fd3f001aaf0 tx=0x7fd3f001ac80 comp rx=0 tx=0).stop 2023-06-10T19:06:51.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.714+0000 7fd3ff73c640 1 -- 172.21.15.53:0/983181560 shutdown_connections 2023-06-10T19:06:51.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.714+0000 7fd3ff73c640 1 --2- 172.21.15.53:0/983181560 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd3e40662b0 0x7fd3e4068760 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:51.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.714+0000 7fd3ff73c640 1 --2- 172.21.15.53:0/983181560 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3f80ccc90 0x7fd3f8154d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:51.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.714+0000 7fd3ff73c640 1 --2- 172.21.15.53:0/983181560 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3f806c7d0 0x7fd3f8157270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:51.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.714+0000 7fd3ff73c640 1 --2- 172.21.15.53:0/983181560 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3f806c400 0x7fd3f8153a40 unknown :-1 s=CLOSED pgs=2260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:51.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.714+0000 7fd3ff73c640 1 -- 172.21.15.53:0/983181560 >> 172.21.15.53:0/983181560 conn(0x7fd3f806a560 msgr2=0x7fd3f8154450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:51.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.714+0000 7fd3ff73c640 1 -- 172.21.15.53:0/983181560 shutdown_connections 2023-06-10T19:06:51.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.714+0000 7fd3ff73c640 1 -- 172.21.15.53:0/983181560 wait complete. 2023-06-10T19:06:51.734 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-10T19:06:51.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.862+0000 7ff96718f640 1 Processor -- start 2023-06-10T19:06:51.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.862+0000 7ff96718f640 1 -- start start 2023-06-10T19:06:51.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.862+0000 7ff96718f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff96015c060 0x7ff9600cc020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:51.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.862+0000 7ff96718f640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff96015cb40 0x7ff96006bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:51.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.862+0000 7ff96718f640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff96015cf40 con 0x7ff960070de0 2023-06-10T19:06:51.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.862+0000 7ff96718f640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9600c8d50 con 0x7ff96015c060 2023-06-10T19:06:51.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.862+0000 7ff96718f640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9600c9030 con 0x7ff96015cb40 2023-06-10T19:06:51.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.862+0000 7ff95ffff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ff960070de0 0x7ff96015c430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:47696/0 (socket says 172.21.15.53:47696) 2023-06-10T19:06:51.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.862+0000 7ff95ffff640 1 -- 172.21.15.53:0/3119200795 learned_addr learned my addr 172.21.15.53:0/3119200795 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:06:51.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.862+0000 7ff964f2b640 1 --2- 172.21.15.53:0/3119200795 >> v2:172.21.15.53:3300/0 conn(0x7ff96015c060 0x7ff9600cc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:51.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.862+0000 7ff96572c640 1 --2- 172.21.15.53:0/3119200795 >> v2:172.21.15.117:3300/0 conn(0x7ff96015cb40 0x7ff96006bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:51.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.862+0000 7ff95f7fe640 1 -- 172.21.15.53:0/3119200795 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2395502866 0 0) 0x7ff96015cf40 con 0x7ff960070de0 2023-06-10T19:06:51.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.862+0000 7ff95f7fe640 1 -- 172.21.15.53:0/3119200795 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff950003530 con 0x7ff960070de0 2023-06-10T19:06:51.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.862+0000 7ff964f2b640 1 -- 172.21.15.53:0/3119200795 >> v2:172.21.15.117:3300/0 conn(0x7ff96015cb40 msgr2=0x7ff96006bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:51.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.862+0000 7ff964f2b640 1 --2- 172.21.15.53:0/3119200795 >> v2:172.21.15.117:3300/0 conn(0x7ff96015cb40 0x7ff96006bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:51.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.862+0000 7ff964f2b640 1 -- 172.21.15.53:0/3119200795 >> v1:172.21.15.53:6789/0 conn(0x7ff960070de0 legacy=0x7ff96015c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:51.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.862+0000 7ff964f2b640 1 -- 172.21.15.53:0/3119200795 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff960070300 con 0x7ff96015c060 2023-06-10T19:06:51.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.866+0000 7ff964f2b640 1 --2- 172.21.15.53:0/3119200795 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff96015c060 0x7ff9600cc020 secure :-1 s=READY pgs=2262 cs=0 l=1 rev1=1 crypto rx=0x7ff96006e980 tx=0x7ff95401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fd8be41de0389de server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:51.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.866+0000 7ff95f7fe640 1 -- 172.21.15.53:0/3119200795 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9540ab600 con 0x7ff96015c060 2023-06-10T19:06:51.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.866+0000 7ff95f7fe640 1 -- 172.21.15.53:0/3119200795 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9540a7050 con 0x7ff96015c060 2023-06-10T19:06:51.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.866+0000 7ff95f7fe640 1 -- 172.21.15.53:0/3119200795 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9540ab980 con 0x7ff96015c060 2023-06-10T19:06:51.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.866+0000 7ff96718f640 1 -- 172.21.15.53:0/3119200795 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff96015c060 msgr2=0x7ff9600cc020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:51.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.866+0000 7ff96718f640 1 --2- 172.21.15.53:0/3119200795 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff96015c060 0x7ff9600cc020 secure :-1 s=READY pgs=2262 cs=0 l=1 rev1=1 crypto rx=0x7ff96006e980 tx=0x7ff95401c3d0 comp rx=0 tx=0).stop 2023-06-10T19:06:51.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.866+0000 7ff96718f640 1 -- 172.21.15.53:0/3119200795 shutdown_connections 2023-06-10T19:06:51.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.866+0000 7ff96718f640 1 --2- 172.21.15.53:0/3119200795 >> v2:172.21.15.117:3300/0 conn(0x7ff96015cb40 0x7ff96006bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:51.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.866+0000 7ff96718f640 1 --2- 172.21.15.53:0/3119200795 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff96015c060 0x7ff9600cc020 unknown :-1 s=CLOSED pgs=2262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:51.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.866+0000 7ff96718f640 1 -- 172.21.15.53:0/3119200795 >> 172.21.15.53:0/3119200795 conn(0x7ff96006a0e0 msgr2=0x7ff9600cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:51.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.866+0000 7ff96718f640 1 -- 172.21.15.53:0/3119200795 shutdown_connections 2023-06-10T19:06:51.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.866+0000 7ff96718f640 1 -- 172.21.15.53:0/3119200795 wait complete. 2023-06-10T19:06:51.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.866+0000 7ff96718f640 1 Processor -- start 2023-06-10T19:06:51.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.866+0000 7ff96718f640 1 -- start start 2023-06-10T19:06:51.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.866+0000 7ff96718f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff960070de0 0x7ff960158f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:51.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.866+0000 7ff96718f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff96015c060 0x7ff960159470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:51.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.866+0000 7ff96718f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff96015cb40 0x7ff9600af7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:51.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.866+0000 7ff96718f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9600c5730 con 0x7ff960070de0 2023-06-10T19:06:51.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.866+0000 7ff96718f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9600c5fd0 con 0x7ff96015c060 2023-06-10T19:06:51.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.866+0000 7ff96718f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9600b3430 con 0x7ff96015cb40 2023-06-10T19:06:51.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.866+0000 7ff964f2b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff960070de0 0x7ff960158f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:51.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.866+0000 7ff964f2b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff960070de0 0x7ff960158f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48784/0 (socket says 172.21.15.53:48784) 2023-06-10T19:06:51.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.866+0000 7ff964f2b640 1 -- 172.21.15.53:0/3596084846 learned_addr learned my addr 172.21.15.53:0/3596084846 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:51.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.866+0000 7ff96572c640 1 --2- 172.21.15.53:0/3596084846 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff96015cb40 0x7ff9600af7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:51.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.866+0000 7ff95ffff640 1 --2- 172.21.15.53:0/3596084846 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff96015c060 0x7ff960159470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:51.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.866+0000 7ff964f2b640 1 -- 172.21.15.53:0/3596084846 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff96015cb40 msgr2=0x7ff9600af7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:51.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.866+0000 7ff964f2b640 1 --2- 172.21.15.53:0/3596084846 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff96015cb40 0x7ff9600af7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:51.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.866+0000 7ff964f2b640 1 -- 172.21.15.53:0/3596084846 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff96015c060 msgr2=0x7ff960159470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:51.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.866+0000 7ff964f2b640 1 --2- 172.21.15.53:0/3596084846 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff96015c060 0x7ff960159470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:51.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.866+0000 7ff964f2b640 1 -- 172.21.15.53:0/3596084846 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff954009420 con 0x7ff960070de0 2023-06-10T19:06:51.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.866+0000 7ff96572c640 1 --2- 172.21.15.53:0/3596084846 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff96015cb40 0x7ff9600af7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:06:51.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.866+0000 7ff95ffff640 1 --2- 172.21.15.53:0/3596084846 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff96015c060 0x7ff960159470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:06:51.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.870+0000 7ff964f2b640 1 --2- 172.21.15.53:0/3596084846 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff960070de0 0x7ff960158f30 secure :-1 s=READY pgs=2263 cs=0 l=1 rev1=1 crypto rx=0x7ff9540ae040 tx=0x7ff954019170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:51.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.870+0000 7ff95d7fa640 1 -- 172.21.15.53:0/3596084846 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9540b4410 con 0x7ff960070de0 2023-06-10T19:06:51.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.870+0000 7ff95d7fa640 1 -- 172.21.15.53:0/3596084846 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9540b4570 con 0x7ff960070de0 2023-06-10T19:06:51.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.870+0000 7ff96718f640 1 -- 172.21.15.53:0/3596084846 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9600c5980 con 0x7ff960070de0 2023-06-10T19:06:51.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.870+0000 7ff95d7fa640 1 -- 172.21.15.53:0/3596084846 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9540b4920 con 0x7ff960070de0 2023-06-10T19:06:51.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.870+0000 7ff96718f640 1 -- 172.21.15.53:0/3596084846 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9600b2fa0 con 0x7ff960070de0 2023-06-10T19:06:51.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.870+0000 7ff96718f640 1 -- 172.21.15.53:0/3596084846 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff96004d790 con 0x7ff960070de0 2023-06-10T19:06:51.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.870+0000 7ff95d7fa640 1 -- 172.21.15.53:0/3596084846 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff9540b2040 con 0x7ff960070de0 2023-06-10T19:06:51.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.870+0000 7ff95d7fa640 1 --2- 172.21.15.53:0/3596084846 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff944066280 0x7ff944068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:51.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.870+0000 7ff95d7fa640 1 -- 172.21.15.53:0/3596084846 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6105+0+0 (secure 0 0 0) 0x7ff95411dc40 con 0x7ff960070de0 2023-06-10T19:06:51.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.870+0000 7ff95ffff640 1 --2- 172.21.15.53:0/3596084846 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff944066280 0x7ff944068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:51.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.870+0000 7ff95ffff640 1 --2- 172.21.15.53:0/3596084846 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff944066280 0x7ff944068730 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7ff96014b170 tx=0x7ff94c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:51.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:51.874+0000 7ff95d7fa640 1 -- 172.21.15.53:0/3596084846 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff9540eb0a0 con 0x7ff960070de0 2023-06-10T19:06:52.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.026+0000 7ff96718f640 1 -- 172.21.15.53:0/3596084846 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff9600b3c60 con 0x7ff960070de0 2023-06-10T19:06:52.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.030+0000 7ff95d7fa640 1 -- 172.21.15.53:0/3596084846 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v155) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff9540ee6c0 con 0x7ff960070de0 2023-06-10T19:06:52.031 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-06-10T19:06:52.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.030+0000 7ff96718f640 1 -- 172.21.15.53:0/3596084846 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff944066280 msgr2=0x7ff944068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:52.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.030+0000 7ff96718f640 1 --2- 172.21.15.53:0/3596084846 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff944066280 0x7ff944068730 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7ff96014b170 tx=0x7ff94c009040 comp rx=0 tx=0).stop 2023-06-10T19:06:52.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.030+0000 7ff96718f640 1 -- 172.21.15.53:0/3596084846 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff960070de0 msgr2=0x7ff960158f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:52.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.030+0000 7ff96718f640 1 --2- 172.21.15.53:0/3596084846 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff960070de0 0x7ff960158f30 secure :-1 s=READY pgs=2263 cs=0 l=1 rev1=1 crypto rx=0x7ff9540ae040 tx=0x7ff954019170 comp rx=0 tx=0).stop 2023-06-10T19:06:52.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.030+0000 7ff96718f640 1 -- 172.21.15.53:0/3596084846 shutdown_connections 2023-06-10T19:06:52.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.030+0000 7ff96718f640 1 --2- 172.21.15.53:0/3596084846 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff944066280 0x7ff944068730 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:52.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.030+0000 7ff96718f640 1 --2- 172.21.15.53:0/3596084846 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff96015cb40 0x7ff9600af7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:52.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.030+0000 7ff96718f640 1 --2- 172.21.15.53:0/3596084846 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff96015c060 0x7ff960159470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:52.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.030+0000 7ff96718f640 1 --2- 172.21.15.53:0/3596084846 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff960070de0 0x7ff960158f30 unknown :-1 s=CLOSED pgs=2263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:52.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.030+0000 7ff96718f640 1 -- 172.21.15.53:0/3596084846 >> 172.21.15.53:0/3596084846 conn(0x7ff96006a0e0 msgr2=0x7ff9600c8450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:52.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.030+0000 7ff96718f640 1 -- 172.21.15.53:0/3596084846 shutdown_connections 2023-06-10T19:06:52.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.030+0000 7ff96718f640 1 -- 172.21.15.53:0/3596084846 wait complete. 2023-06-10T19:06:52.050 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-10T19:06:52.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.162+0000 7fecf8ece640 1 Processor -- start 2023-06-10T19:06:52.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.162+0000 7fecf8ece640 1 -- start start 2023-06-10T19:06:52.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.162+0000 7fecf8ece640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fecf40b3ac0 0x7fecf40b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:52.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.162+0000 7fecf8ece640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fecf40d1b00 0x7fecf40b43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:52.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.162+0000 7fecf8ece640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecf40ccde0 con 0x7fecf40cc690 2023-06-10T19:06:52.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.162+0000 7fecf8ece640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecf40ced00 con 0x7fecf40d1b00 2023-06-10T19:06:52.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.162+0000 7fecf8ece640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecf40cfc10 con 0x7fecf40b3ac0 2023-06-10T19:06:52.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.162+0000 7fecf2d9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fecf40d1b00 0x7fecf40b43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:52.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.162+0000 7fecebfff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fecf40cc690 0x7fecf415f3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:47712/0 (socket says 172.21.15.53:47712) 2023-06-10T19:06:52.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.162+0000 7fecebfff640 1 -- 172.21.15.53:0/2138376834 learned_addr learned my addr 172.21.15.53:0/2138376834 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:06:52.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.166+0000 7fecf259c640 1 --2- 172.21.15.53:0/2138376834 >> v2:172.21.15.117:3300/0 conn(0x7fecf40b3ac0 0x7fecf40b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:52.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.166+0000 7fecf2d9d640 1 -- 172.21.15.53:0/2138376834 >> v2:172.21.15.117:3300/0 conn(0x7fecf40b3ac0 msgr2=0x7fecf40b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:52.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.166+0000 7fecf2d9d640 1 --2- 172.21.15.53:0/2138376834 >> v2:172.21.15.117:3300/0 conn(0x7fecf40b3ac0 0x7fecf40b3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:52.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.166+0000 7fecf2d9d640 1 -- 172.21.15.53:0/2138376834 >> v1:172.21.15.53:6789/0 conn(0x7fecf40cc690 legacy=0x7fecf415f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:52.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.166+0000 7fecf2d9d640 1 -- 172.21.15.53:0/2138376834 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecf40b4910 con 0x7fecf40d1b00 2023-06-10T19:06:52.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.166+0000 7fecf1d9b640 1 -- 172.21.15.53:0/2138376834 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3742548176 0 0) 0x7fecf40ccde0 con 0x7fecf40cc690 2023-06-10T19:06:52.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.166+0000 7fecf2d9d640 1 --2- 172.21.15.53:0/2138376834 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fecf40d1b00 0x7fecf40b43d0 secure :-1 s=READY pgs=2265 cs=0 l=1 rev1=1 crypto rx=0x7fecf40b4bd0 tx=0x7fecec01c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b1cef7024e4257c server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:52.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.166+0000 7fecf1d9b640 1 -- 172.21.15.53:0/2138376834 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecec0a57a0 con 0x7fecf40d1b00 2023-06-10T19:06:52.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.166+0000 7fecf1d9b640 1 -- 172.21.15.53:0/2138376834 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecec0a5900 con 0x7fecf40d1b00 2023-06-10T19:06:52.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.166+0000 7fecf1d9b640 1 -- 172.21.15.53:0/2138376834 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecec0a5c90 con 0x7fecf40d1b00 2023-06-10T19:06:52.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.166+0000 7fecf8ece640 1 -- 172.21.15.53:0/2138376834 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fecf40d1b00 msgr2=0x7fecf40b43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:52.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.166+0000 7fecf8ece640 1 --2- 172.21.15.53:0/2138376834 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fecf40d1b00 0x7fecf40b43d0 secure :-1 s=READY pgs=2265 cs=0 l=1 rev1=1 crypto rx=0x7fecf40b4bd0 tx=0x7fecec01c7f0 comp rx=0 tx=0).stop 2023-06-10T19:06:52.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.166+0000 7fecf8ece640 1 -- 172.21.15.53:0/2138376834 shutdown_connections 2023-06-10T19:06:52.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.166+0000 7fecf8ece640 1 --2- 172.21.15.53:0/2138376834 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fecf40d1b00 0x7fecf40b43d0 unknown :-1 s=CLOSED pgs=2265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:52.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.166+0000 7fecf8ece640 1 --2- 172.21.15.53:0/2138376834 >> v2:172.21.15.117:3300/0 conn(0x7fecf40b3ac0 0x7fecf40b3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:52.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.166+0000 7fecf8ece640 1 -- 172.21.15.53:0/2138376834 >> 172.21.15.53:0/2138376834 conn(0x7fecf4069de0 msgr2=0x7fecf406a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:52.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.166+0000 7fecf8ece640 1 -- 172.21.15.53:0/2138376834 shutdown_connections 2023-06-10T19:06:52.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.166+0000 7fecf8ece640 1 -- 172.21.15.53:0/2138376834 wait complete. 2023-06-10T19:06:52.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.170+0000 7fecf8ece640 1 Processor -- start 2023-06-10T19:06:52.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.170+0000 7fecf8ece640 1 -- start start 2023-06-10T19:06:52.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.170+0000 7fecf8ece640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fecf40b3ac0 0x7fecf4153790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:52.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.170+0000 7fecf8ece640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fecf40cc690 0x7fecf415ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:52.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.170+0000 7fecf8ece640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fecf40d1b00 0x7fecf4158330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:52.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.170+0000 7fecf8ece640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf415ec90 con 0x7fecf40d1b00 2023-06-10T19:06:52.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.170+0000 7fecf8ece640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf415e9b0 con 0x7fecf40b3ac0 2023-06-10T19:06:52.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.170+0000 7fecf8ece640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecf415bf50 con 0x7fecf40cc690 2023-06-10T19:06:52.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.170+0000 7fecf2d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fecf40d1b00 0x7fecf4158330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:52.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.170+0000 7fecf2d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fecf40d1b00 0x7fecf4158330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48810/0 (socket says 172.21.15.53:48810) 2023-06-10T19:06:52.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.170+0000 7fecf2d9d640 1 -- 172.21.15.53:0/2304060682 learned_addr learned my addr 172.21.15.53:0/2304060682 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:52.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.170+0000 7fecebfff640 1 --2- 172.21.15.53:0/2304060682 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fecf40cc690 0x7fecf415ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:52.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.170+0000 7fecf259c640 1 --2- 172.21.15.53:0/2304060682 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fecf40b3ac0 0x7fecf4153790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:52.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.170+0000 7fecf2d9d640 1 -- 172.21.15.53:0/2304060682 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fecf40cc690 msgr2=0x7fecf415ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:52.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.170+0000 7fecf2d9d640 1 --2- 172.21.15.53:0/2304060682 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fecf40cc690 0x7fecf415ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:52.175 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.170+0000 7fecf2d9d640 1 -- 172.21.15.53:0/2304060682 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fecf40b3ac0 msgr2=0x7fecf4153790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:52.175 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.170+0000 7fecf2d9d640 1 --2- 172.21.15.53:0/2304060682 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fecf40b3ac0 0x7fecf4153790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:52.175 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.170+0000 7fecf2d9d640 1 -- 172.21.15.53:0/2304060682 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecec009a70 con 0x7fecf40d1b00 2023-06-10T19:06:52.175 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.170+0000 7fecf2d9d640 1 --2- 172.21.15.53:0/2304060682 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fecf40d1b00 0x7fecf4158330 secure :-1 s=READY pgs=2266 cs=0 l=1 rev1=1 crypto rx=0x7fecec019400 tx=0x7fecec019590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:52.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.174+0000 7feceaffd640 1 -- 172.21.15.53:0/2304060682 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecec0b9650 con 0x7fecf40d1b00 2023-06-10T19:06:52.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.174+0000 7feceaffd640 1 -- 172.21.15.53:0/2304060682 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecec0b97b0 con 0x7fecf40d1b00 2023-06-10T19:06:52.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.174+0000 7fecf8ece640 1 -- 172.21.15.53:0/2304060682 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecf415c230 con 0x7fecf40d1b00 2023-06-10T19:06:52.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.174+0000 7feceaffd640 1 -- 172.21.15.53:0/2304060682 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecec0b9b60 con 0x7fecf40d1b00 2023-06-10T19:06:52.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.174+0000 7fecf8ece640 1 -- 172.21.15.53:0/2304060682 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecf4153cd0 con 0x7fecf40d1b00 2023-06-10T19:06:52.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.174+0000 7fecf8ece640 1 -- 172.21.15.53:0/2304060682 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecf404d790 con 0x7fecf40d1b00 2023-06-10T19:06:52.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.174+0000 7feceaffd640 1 -- 172.21.15.53:0/2304060682 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fecec0b9cc0 con 0x7fecf40d1b00 2023-06-10T19:06:52.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.174+0000 7feceaffd640 1 --2- 172.21.15.53:0/2304060682 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fecd4066280 0x7fecd4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:52.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.174+0000 7feceaffd640 1 -- 172.21.15.53:0/2304060682 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6105+0+0 (secure 0 0 0) 0x7fecec11ef40 con 0x7fecf40d1b00 2023-06-10T19:06:52.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.174+0000 7fecf259c640 1 --2- 172.21.15.53:0/2304060682 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fecd4066280 0x7fecd4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:52.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.174+0000 7fecf259c640 1 --2- 172.21.15.53:0/2304060682 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fecd4066280 0x7fecd4068730 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fece400b9d0 tx=0x7fece4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:52.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.178+0000 7feceaffd640 1 -- 172.21.15.53:0/2304060682 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fecec0ec420 con 0x7fecf40d1b00 2023-06-10T19:06:52.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.346+0000 7fecf8ece640 1 -- 172.21.15.53:0/2304060682 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fecf406ac70 con 0x7fecf40d1b00 2023-06-10T19:06:52.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.346+0000 7feceaffd640 1 -- 172.21.15.53:0/2304060682 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 1 entries v155) v1 ==== 80+0+57 (secure 0 0 0) 0x7fecec0b2050 con 0x7fecf40d1b00 2023-06-10T19:06:52.349 INFO:teuthology.orchestra.run.smithi053.stdout:192.168.0.1:0/2213488734 2023-06-10T20:06:49.780814+0000 2023-06-10T19:06:52.349 INFO:teuthology.orchestra.run.smithi053.stderr:listed 1 entries 2023-06-10T19:06:52.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.350+0000 7fecf8ece640 1 -- 172.21.15.53:0/2304060682 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fecd4066280 msgr2=0x7fecd4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:52.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.350+0000 7fecf8ece640 1 --2- 172.21.15.53:0/2304060682 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fecd4066280 0x7fecd4068730 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fece400b9d0 tx=0x7fece4008040 comp rx=0 tx=0).stop 2023-06-10T19:06:52.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.350+0000 7fecf8ece640 1 -- 172.21.15.53:0/2304060682 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fecf40d1b00 msgr2=0x7fecf4158330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:52.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.350+0000 7fecf8ece640 1 --2- 172.21.15.53:0/2304060682 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fecf40d1b00 0x7fecf4158330 secure :-1 s=READY pgs=2266 cs=0 l=1 rev1=1 crypto rx=0x7fecec019400 tx=0x7fecec019590 comp rx=0 tx=0).stop 2023-06-10T19:06:52.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.350+0000 7fecf8ece640 1 -- 172.21.15.53:0/2304060682 shutdown_connections 2023-06-10T19:06:52.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.350+0000 7fecf8ece640 1 --2- 172.21.15.53:0/2304060682 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fecd4066280 0x7fecd4068730 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:52.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.350+0000 7fecf8ece640 1 --2- 172.21.15.53:0/2304060682 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fecf40d1b00 0x7fecf4158330 unknown :-1 s=CLOSED pgs=2266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:52.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.350+0000 7fecf8ece640 1 --2- 172.21.15.53:0/2304060682 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fecf40cc690 0x7fecf415ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:52.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.350+0000 7fecf8ece640 1 --2- 172.21.15.53:0/2304060682 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fecf40b3ac0 0x7fecf4153790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:52.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.350+0000 7fecf8ece640 1 -- 172.21.15.53:0/2304060682 >> 172.21.15.53:0/2304060682 conn(0x7fecf4069de0 msgr2=0x7fecf415f3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:52.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.350+0000 7fecf8ece640 1 -- 172.21.15.53:0/2304060682 shutdown_connections 2023-06-10T19:06:52.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.350+0000 7fecf8ece640 1 -- 172.21.15.53:0/2304060682 wait complete. 2023-06-10T19:06:52.367 DEBUG:tasks.cephfs.mount:Force/lazy unmounting on client.0 2023-06-10T19:06:52.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:06:52.368 DEBUG:teuthology.orchestra.run.smithi053:> sudo umount --lazy --force /home/ubuntu/cephtest/mnt.0 2023-06-10T19:06:52.381 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi053.front.sepia.ceph.com 2023-06-10T19:06:52.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:06:52.383 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-06-10T19:06:52.431 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-10T19:06:52.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.594+0000 7f0d80d2c640 1 Processor -- start 2023-06-10T19:06:52.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.598+0000 7f0d80d2c640 1 -- start start 2023-06-10T19:06:52.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.598+0000 7f0d80d2c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0d7c15c950 0x7f0d7c069e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:52.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.598+0000 7f0d80d2c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d7c06f970 0x7f0d7c06a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:52.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.598+0000 7f0d80d2c640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d7c0ccf20 con 0x7f0d7c1586b0 2023-06-10T19:06:52.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.598+0000 7f0d80d2c640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d7c0cc4c0 con 0x7f0d7c15c950 2023-06-10T19:06:52.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.598+0000 7f0d80d2c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7c0ce3c0 con 0x7f0d7c06f970 2023-06-10T19:06:52.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.598+0000 7f0d79d9b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0d7c15c950 0x7f0d7c069e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:52.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.598+0000 7f0d7ad9d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d7c06f970 0x7f0d7c06a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:52.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.598+0000 7f0d7a59c640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f0d7c1586b0 0x7f0d7c15c240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.53:41206/0 (socket says 172.21.15.53:41206) 2023-06-10T19:06:52.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.598+0000 7f0d7a59c640 1 -- 172.21.15.53:0/2462569268 learned_addr learned my addr 172.21.15.53:0/2462569268 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:06:52.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.598+0000 7f0d79d9b640 1 -- 172.21.15.53:0/2462569268 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d7c06f970 msgr2=0x7f0d7c06a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:52.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.598+0000 7f0d79d9b640 1 --2- 172.21.15.53:0/2462569268 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d7c06f970 0x7f0d7c06a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:52.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.598+0000 7f0d79d9b640 1 -- 172.21.15.53:0/2462569268 >> v1:172.21.15.117:6789/0 conn(0x7f0d7c1586b0 legacy=0x7f0d7c15c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:52.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.598+0000 7f0d79d9b640 1 -- 172.21.15.53:0/2462569268 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d7c06aa70 con 0x7f0d7c15c950 2023-06-10T19:06:52.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.598+0000 7f0d7ad9d640 1 --2- 172.21.15.53:0/2462569268 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d7c06f970 0x7f0d7c06a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-10T19:06:52.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.602+0000 7f0d79d9b640 1 --2- 172.21.15.53:0/2462569268 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d7c15c950 0x7f0d7c069e60 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f0d700097f0 tx=0x7f0d7001ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=831e231052a9a4a9 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:52.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.602+0000 7f0d7959a640 1 -- 172.21.15.53:0/2462569268 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d700a8970 con 0x7f0d7c15c950 2023-06-10T19:06:52.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.602+0000 7f0d7959a640 1 -- 172.21.15.53:0/2462569268 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d700a8ad0 con 0x7f0d7c15c950 2023-06-10T19:06:52.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.602+0000 7f0d7959a640 1 -- 172.21.15.53:0/2462569268 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d700a8e60 con 0x7f0d7c15c950 2023-06-10T19:06:52.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.602+0000 7f0d80d2c640 1 -- 172.21.15.53:0/2462569268 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d7c15c950 msgr2=0x7f0d7c069e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:52.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.602+0000 7f0d80d2c640 1 --2- 172.21.15.53:0/2462569268 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d7c15c950 0x7f0d7c069e60 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f0d700097f0 tx=0x7f0d7001ec70 comp rx=0 tx=0).stop 2023-06-10T19:06:52.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.602+0000 7f0d80d2c640 1 -- 172.21.15.53:0/2462569268 shutdown_connections 2023-06-10T19:06:52.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.602+0000 7f0d80d2c640 1 --2- 172.21.15.53:0/2462569268 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d7c06f970 0x7f0d7c06a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:52.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.602+0000 7f0d80d2c640 1 --2- 172.21.15.53:0/2462569268 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d7c15c950 0x7f0d7c069e60 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:52.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.602+0000 7f0d80d2c640 1 -- 172.21.15.53:0/2462569268 >> 172.21.15.53:0/2462569268 conn(0x7f0d7c0cafc0 msgr2=0x7f0d7c0cb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:52.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.602+0000 7f0d80d2c640 1 -- 172.21.15.53:0/2462569268 shutdown_connections 2023-06-10T19:06:52.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.602+0000 7f0d80d2c640 1 -- 172.21.15.53:0/2462569268 wait complete. 2023-06-10T19:06:52.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.602+0000 7f0d80d2c640 1 Processor -- start 2023-06-10T19:06:52.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.602+0000 7f0d80d2c640 1 -- start start 2023-06-10T19:06:52.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.606+0000 7f0d80d2c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d7c06f970 0x7f0d7c0c7430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:52.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.606+0000 7f0d80d2c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d7c1586b0 0x7f0d7c0c3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:52.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.606+0000 7f0d80d2c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d7c15c950 0x7f0d7c153e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:52.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.606+0000 7f0d80d2c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7c154f70 con 0x7f0d7c1586b0 2023-06-10T19:06:52.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.606+0000 7f0d80d2c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7c0c6390 con 0x7f0d7c06f970 2023-06-10T19:06:52.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.606+0000 7f0d80d2c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7c0c6670 con 0x7f0d7c15c950 2023-06-10T19:06:52.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.606+0000 7f0d79d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d7c1586b0 0x7f0d7c0c3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:52.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.606+0000 7f0d79d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d7c1586b0 0x7f0d7c0c3c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48824/0 (socket says 172.21.15.53:48824) 2023-06-10T19:06:52.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.606+0000 7f0d79d9b640 1 -- 172.21.15.53:0/4000909324 learned_addr learned my addr 172.21.15.53:0/4000909324 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:52.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.606+0000 7f0d7ad9d640 1 --2- 172.21.15.53:0/4000909324 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d7c15c950 0x7f0d7c153e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:52.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.606+0000 7f0d7a59c640 1 --2- 172.21.15.53:0/4000909324 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d7c06f970 0x7f0d7c0c7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:52.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.606+0000 7f0d79d9b640 1 -- 172.21.15.53:0/4000909324 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d7c15c950 msgr2=0x7f0d7c153e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:52.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.606+0000 7f0d79d9b640 1 --2- 172.21.15.53:0/4000909324 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d7c15c950 0x7f0d7c153e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:52.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.606+0000 7f0d79d9b640 1 -- 172.21.15.53:0/4000909324 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d7c06f970 msgr2=0x7f0d7c0c7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:52.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.606+0000 7f0d79d9b640 1 --2- 172.21.15.53:0/4000909324 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d7c06f970 0x7f0d7c0c7430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:52.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.606+0000 7f0d79d9b640 1 -- 172.21.15.53:0/4000909324 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d74009420 con 0x7f0d7c1586b0 2023-06-10T19:06:52.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.606+0000 7f0d79d9b640 1 --2- 172.21.15.53:0/4000909324 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d7c1586b0 0x7f0d7c0c3c00 secure :-1 s=READY pgs=2267 cs=0 l=1 rev1=1 crypto rx=0x7f0d7001c8a0 tx=0x7f0d7001ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:52.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.606+0000 7f0d6affd640 1 -- 172.21.15.53:0/4000909324 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d700c0070 con 0x7f0d7c1586b0 2023-06-10T19:06:52.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.606+0000 7f0d6affd640 1 -- 172.21.15.53:0/4000909324 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d70006e20 con 0x7f0d7c1586b0 2023-06-10T19:06:52.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.606+0000 7f0d80d2c640 1 -- 172.21.15.53:0/4000909324 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d70009420 con 0x7f0d7c1586b0 2023-06-10T19:06:52.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.606+0000 7f0d6affd640 1 -- 172.21.15.53:0/4000909324 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d700ba640 con 0x7f0d7c1586b0 2023-06-10T19:06:52.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.606+0000 7f0d80d2c640 1 -- 172.21.15.53:0/4000909324 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d7c0c6c30 con 0x7f0d7c1586b0 2023-06-10T19:06:52.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.606+0000 7f0d80d2c640 1 -- 172.21.15.53:0/4000909324 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d7c04d790 con 0x7f0d7c1586b0 2023-06-10T19:06:52.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.606+0000 7f0d6affd640 1 -- 172.21.15.53:0/4000909324 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0d700ba7a0 con 0x7f0d7c1586b0 2023-06-10T19:06:52.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.606+0000 7f0d6affd640 1 --2- 172.21.15.53:0/4000909324 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0d5c066280 0x7f0d5c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:52.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.606+0000 7f0d6affd640 1 -- 172.21.15.53:0/4000909324 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6105+0+0 (secure 0 0 0) 0x7f0d701222d0 con 0x7f0d7c1586b0 2023-06-10T19:06:52.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.610+0000 7f0d7a59c640 1 --2- 172.21.15.53:0/4000909324 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0d5c066280 0x7f0d5c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:52.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.610+0000 7f0d7a59c640 1 --2- 172.21.15.53:0/4000909324 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0d5c066280 0x7f0d5c068730 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c005c10 tx=0x7f0d6c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:52.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.610+0000 7f0d6affd640 1 -- 172.21.15.53:0/4000909324 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0d700ef800 con 0x7f0d7c1586b0 2023-06-10T19:06:52.800 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.798+0000 7f0d80d2c640 1 -- 172.21.15.53:0/4000909324 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0d7c0b0c60 con 0x7f0d7c1586b0 2023-06-10T19:06:52.801 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.798+0000 7f0d6affd640 1 -- 172.21.15.53:0/4000909324 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v89) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0d700f2e20 con 0x7f0d7c1586b0 2023-06-10T19:06:52.802 INFO:teuthology.orchestra.run.smithi053.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-06-10T19:06:52.804 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.802+0000 7f0d80d2c640 1 -- 172.21.15.53:0/4000909324 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0d5c066280 msgr2=0x7f0d5c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:52.804 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.802+0000 7f0d80d2c640 1 --2- 172.21.15.53:0/4000909324 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0d5c066280 0x7f0d5c068730 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c005c10 tx=0x7f0d6c009040 comp rx=0 tx=0).stop 2023-06-10T19:06:52.804 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.802+0000 7f0d80d2c640 1 -- 172.21.15.53:0/4000909324 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d7c1586b0 msgr2=0x7f0d7c0c3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:52.805 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.802+0000 7f0d80d2c640 1 --2- 172.21.15.53:0/4000909324 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d7c1586b0 0x7f0d7c0c3c00 secure :-1 s=READY pgs=2267 cs=0 l=1 rev1=1 crypto rx=0x7f0d7001c8a0 tx=0x7f0d7001ba10 comp rx=0 tx=0).stop 2023-06-10T19:06:52.805 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.802+0000 7f0d80d2c640 1 -- 172.21.15.53:0/4000909324 shutdown_connections 2023-06-10T19:06:52.805 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.802+0000 7f0d80d2c640 1 --2- 172.21.15.53:0/4000909324 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0d5c066280 0x7f0d5c068730 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:52.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.802+0000 7f0d80d2c640 1 --2- 172.21.15.53:0/4000909324 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0d7c15c950 0x7f0d7c153e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:52.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.802+0000 7f0d80d2c640 1 --2- 172.21.15.53:0/4000909324 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d7c1586b0 0x7f0d7c0c3c00 unknown :-1 s=CLOSED pgs=2267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:52.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.802+0000 7f0d80d2c640 1 --2- 172.21.15.53:0/4000909324 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d7c06f970 0x7f0d7c0c7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:52.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.802+0000 7f0d80d2c640 1 -- 172.21.15.53:0/4000909324 >> 172.21.15.53:0/4000909324 conn(0x7f0d7c0cafc0 msgr2=0x7f0d7c06a140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:52.808 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.802+0000 7f0d80d2c640 1 -- 172.21.15.53:0/4000909324 shutdown_connections 2023-06-10T19:06:52.808 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:52.802+0000 7f0d80d2c640 1 -- 172.21.15.53:0/4000909324 wait complete. 2023-06-10T19:06:52.819 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-10T19:06:52.819 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-10T19:06:52.820 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi053.front.sepia.ceph.com 2023-06-10T19:06:52.820 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-06-10T19:06:52.820 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-06-10T19:06:52.821 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-10T19:06:52.821 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-10T19:06:52.821 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-10T19:06:52.821 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-06-10T19:06:52.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:06:52.822 DEBUG:teuthology.orchestra.run.smithi053:> ip addr 2023-06-10T19:06:52.828 INFO:teuthology.orchestra.run.smithi053.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-10T19:06:52.828 INFO:teuthology.orchestra.run.smithi053.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-10T19:06:52.828 INFO:teuthology.orchestra.run.smithi053.stdout: inet 127.0.0.1/8 scope host lo 2023-06-10T19:06:52.828 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:06:52.829 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 ::1/128 scope host 2023-06-10T19:06:52.829 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:06:52.829 INFO:teuthology.orchestra.run.smithi053.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T19:06:52.829 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:da brd ff:ff:ff:ff:ff:ff 2023-06-10T19:06:52.829 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f0 2023-06-10T19:06:52.829 INFO:teuthology.orchestra.run.smithi053.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T19:06:52.829 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:db brd ff:ff:ff:ff:ff:ff 2023-06-10T19:06:52.829 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f1 2023-06-10T19:06:52.830 INFO:teuthology.orchestra.run.smithi053.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-10T19:06:52.830 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:18 brd ff:ff:ff:ff:ff:ff 2023-06-10T19:06:52.830 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f0 2023-06-10T19:06:52.830 INFO:teuthology.orchestra.run.smithi053.stdout: inet 172.21.15.53/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-06-10T19:06:52.830 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft 41637sec preferred_lft 41637sec 2023-06-10T19:06:52.830 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::ae1f:6bff:fef8:3718/64 scope link 2023-06-10T19:06:52.830 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:06:52.831 INFO:teuthology.orchestra.run.smithi053.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T19:06:52.831 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:19 brd ff:ff:ff:ff:ff:ff 2023-06-10T19:06:52.831 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f1 2023-06-10T19:06:52.831 INFO:teuthology.orchestra.run.smithi053.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-06-10T19:06:52.831 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 02:42:49:3d:ee:1e brd ff:ff:ff:ff:ff:ff 2023-06-10T19:06:52.831 INFO:teuthology.orchestra.run.smithi053.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-06-10T19:06:52.831 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:06:52.832 INFO:teuthology.orchestra.run.smithi053.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-10T19:06:52.832 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-06-10T19:06:52.832 INFO:teuthology.orchestra.run.smithi053.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-06-10T19:06:52.832 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:06:52.833 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-06-10T19:06:52.833 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:06:52.833 INFO:teuthology.orchestra.run.smithi053.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state DOWN group default qlen 1000 2023-06-10T19:06:52.833 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-06-10T19:06:52.834 INFO:teuthology.orchestra.run.smithi053.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-10T19:06:52.834 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-06-10T19:06:52.834 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-06-10T19:06:52.834 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:06:52.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:06:52.836 DEBUG:teuthology.orchestra.run.smithi053:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-10T19:06:52.879 INFO:teuthology.orchestra.run.smithi053.stdout:1 2023-06-10T19:06:52.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:06:52.881 DEBUG:teuthology.orchestra.run.smithi053:> route 2023-06-10T19:06:52.927 INFO:teuthology.orchestra.run.smithi053.stdout:Kernel IP routing table 2023-06-10T19:06:52.927 INFO:teuthology.orchestra.run.smithi053.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-10T19:06:52.928 INFO:teuthology.orchestra.run.smithi053.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-06-10T19:06:52.928 INFO:teuthology.orchestra.run.smithi053.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-06-10T19:06:52.928 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-06-10T19:06:52.928 INFO:teuthology.orchestra.run.smithi053.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-10T19:06:52.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:06:52.929 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec bash -c ' 2023-06-10T19:06:52.929 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2023-06-10T19:06:52.929 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-06-10T19:06:52.930 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-06-10T19:06:52.930 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-06-10T19:06:52.930 DEBUG:teuthology.orchestra.run.smithi053:> ') 2023-06-10T19:06:53.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:06:53.001 DEBUG:teuthology.orchestra.run.smithi053:> ip netns list 2023-06-10T19:06:53.047 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-06-10T19:06:53.048 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-06-10T19:06:53.048 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-06-10T19:06:53.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:06:53.049 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link set brx.0 up 2023-06-10T19:06:53.104 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-06-10T19:06:53.105 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-10T19:06:53.105 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-06-10T19:06:53.151 INFO:teuthology.orchestra.run.smithi053.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-06-10T19:06:53.151 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-10T19:06:53.152 DEBUG:teuthology.orchestra.run.smithi053:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-06-10T19:06:53.198 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2023-06-10T19:06:53.256 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T19:06:53.256 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T19:06:53.311 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T19:06:53.312 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T19:06:53.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:06:53.313 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2023-06-10T19:06:53.359 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-06-10T19:06:53.359 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-06-10T19:06:53.403 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2023-06-10T19:06:53.419 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T19:06:53.420 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T19:06:53.473 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T19:06:53.475 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T19:06:53.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:06:53.477 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2023-06-10T19:06:53.742 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:2023-06-10T19:06:53.738+0000 7f420f625580 -1 init, newargv = 0x56467ce29dc0 newargc=15 2023-06-10T19:06:53.743 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[66884]: starting ceph client 2023-06-10T19:06:53.749 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[66884]: starting fuse 2023-06-10T19:06:54.625 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2023-06-10T19:06:54.641 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T19:06:54.642 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T19:06:54.694 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T19:06:54.695 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T19:06:54.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:06:54.697 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2023-06-10T19:06:54.745 INFO:teuthology.orchestra.run.smithi053.stdout:45 2023-06-10T19:06:54.745 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-06-10T19:06:54.745 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-06-10T19:06:54.746 DEBUG:teuthology.orchestra.run.smithi053:> import glob 2023-06-10T19:06:54.746 DEBUG:teuthology.orchestra.run.smithi053:> import re 2023-06-10T19:06:54.746 DEBUG:teuthology.orchestra.run.smithi053:> import os 2023-06-10T19:06:54.747 DEBUG:teuthology.orchestra.run.smithi053:> import subprocess 2023-06-10T19:06:54.747 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:06:54.747 DEBUG:teuthology.orchestra.run.smithi053:> def _find_admin_socket(client_name): 2023-06-10T19:06:54.748 DEBUG:teuthology.orchestra.run.smithi053:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-06-10T19:06:54.748 DEBUG:teuthology.orchestra.run.smithi053:> files = glob.glob(asok_path) 2023-06-10T19:06:54.749 DEBUG:teuthology.orchestra.run.smithi053:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-06-10T19:06:54.749 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:06:54.750 DEBUG:teuthology.orchestra.run.smithi053:> # Given a non-glob path, it better be there 2023-06-10T19:06:54.751 DEBUG:teuthology.orchestra.run.smithi053:> if "*" not in asok_path: 2023-06-10T19:06:54.752 DEBUG:teuthology.orchestra.run.smithi053:> assert(len(files) == 1) 2023-06-10T19:06:54.753 DEBUG:teuthology.orchestra.run.smithi053:> return files[0] 2023-06-10T19:06:54.754 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:06:54.754 DEBUG:teuthology.orchestra.run.smithi053:> for f in files: 2023-06-10T19:06:54.755 DEBUG:teuthology.orchestra.run.smithi053:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-06-10T19:06:54.756 DEBUG:teuthology.orchestra.run.smithi053:> if os.path.exists("/proc/{0}".format(pid)): 2023-06-10T19:06:54.756 DEBUG:teuthology.orchestra.run.smithi053:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-06-10T19:06:54.757 DEBUG:teuthology.orchestra.run.smithi053:> contents = proc_f.read() 2023-06-10T19:06:54.757 DEBUG:teuthology.orchestra.run.smithi053:> if mountpoint in contents: 2023-06-10T19:06:54.758 DEBUG:teuthology.orchestra.run.smithi053:> return f 2023-06-10T19:06:54.758 DEBUG:teuthology.orchestra.run.smithi053:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-06-10T19:06:54.759 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:06:54.760 DEBUG:teuthology.orchestra.run.smithi053:> print(_find_admin_socket("client.0")) 2023-06-10T19:06:54.760 DEBUG:teuthology.orchestra.run.smithi053:> ' 2023-06-10T19:06:54.867 INFO:teuthology.orchestra.run.smithi053.stdout:/var/run/ceph/ceph-client.0.66884.asok 2023-06-10T19:06:55.049 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.66884.asok 2023-06-10T19:06:55.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:06:55.050 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.66884.asok status 2023-06-10T19:06:55.214 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-06-10T19:06:55.214 INFO:teuthology.orchestra.run.smithi053.stdout: "metadata": { 2023-06-10T19:06:55.214 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_sha1": "219d315c3a0b2075e570fb1964be2ad33fe7a9c8", 2023-06-10T19:06:55.215 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_version": "ceph version 18.0.0-4359-g219d315c (219d315c3a0b2075e570fb1964be2ad33fe7a9c8) reef (dev)", 2023-06-10T19:06:55.215 INFO:teuthology.orchestra.run.smithi053.stdout: "entity_id": "0", 2023-06-10T19:06:55.215 INFO:teuthology.orchestra.run.smithi053.stdout: "hostname": "smithi053", 2023-06-10T19:06:55.215 INFO:teuthology.orchestra.run.smithi053.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-06-10T19:06:55.215 INFO:teuthology.orchestra.run.smithi053.stdout: "pid": "66884", 2023-06-10T19:06:55.215 INFO:teuthology.orchestra.run.smithi053.stdout: "root": "/" 2023-06-10T19:06:55.215 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:06:55.216 INFO:teuthology.orchestra.run.smithi053.stdout: "dentry_count": 0, 2023-06-10T19:06:55.216 INFO:teuthology.orchestra.run.smithi053.stdout: "dentry_pinned_count": 0, 2023-06-10T19:06:55.216 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 10314, 2023-06-10T19:06:55.216 INFO:teuthology.orchestra.run.smithi053.stdout: "inst": { 2023-06-10T19:06:55.216 INFO:teuthology.orchestra.run.smithi053.stdout: "name": { 2023-06-10T19:06:55.216 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "client", 2023-06-10T19:06:55.216 INFO:teuthology.orchestra.run.smithi053.stdout: "num": 10314 2023-06-10T19:06:55.216 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:06:55.217 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": { 2023-06-10T19:06:55.217 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2023-06-10T19:06:55.217 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "192.168.0.1:0", 2023-06-10T19:06:55.217 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 2812505311 2023-06-10T19:06:55.217 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:06:55.217 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:06:55.217 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": { 2023-06-10T19:06:55.218 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2023-06-10T19:06:55.218 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "192.168.0.1:0", 2023-06-10T19:06:55.218 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 2812505311 2023-06-10T19:06:55.218 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:06:55.218 INFO:teuthology.orchestra.run.smithi053.stdout: "inst_str": "client.10314 192.168.0.1:0/2812505311", 2023-06-10T19:06:55.218 INFO:teuthology.orchestra.run.smithi053.stdout: "addr_str": "192.168.0.1:0/2812505311", 2023-06-10T19:06:55.219 INFO:teuthology.orchestra.run.smithi053.stdout: "inode_count": 1, 2023-06-10T19:06:55.219 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_epoch": 89, 2023-06-10T19:06:55.219 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_epoch": 155, 2023-06-10T19:06:55.219 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_epoch_barrier": 0, 2023-06-10T19:06:55.219 INFO:teuthology.orchestra.run.smithi053.stdout: "blocklisted": false, 2023-06-10T19:06:55.219 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs" 2023-06-10T19:06:55.220 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-06-10T19:06:55.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:06:55.229 DEBUG:teuthology.orchestra.run.smithi053:> stat --file-system '--printf=%T 2023-06-10T19:06:55.229 DEBUG:teuthology.orchestra.run.smithi053:> ' -- /home/ubuntu/cephtest/mnt.0 2023-06-10T19:06:55.235 INFO:teuthology.orchestra.run.smithi053.stdout:fuseblk 2023-06-10T19:06:55.236 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-06-10T19:06:55.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:06:55.237 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-06-10T19:06:55.294 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-06-10T19:06:55.295 DEBUG:teuthology.orchestra.run.smithi053:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-06-10T19:06:55.377 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-06-10T19:06:55.421 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-06-10T19:06:55.421 INFO:tasks.cephfs.mount:Terminating background process 2023-06-10T19:06:55.422 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T19:06:55.422 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:06:55.428 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:06:55.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.602+0000 7f684dd48640 1 Processor -- start 2023-06-10T19:06:55.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.602+0000 7f684dd48640 1 -- start start 2023-06-10T19:06:55.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.606+0000 7f684dd48640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f68480ccae0 0x7f68480d0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:55.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.606+0000 7f684dd48640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68480d0020 con 0x7f68480b3ac0 2023-06-10T19:06:55.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.606+0000 7f684dd48640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68480cef40 con 0x7f68480cc690 2023-06-10T19:06:55.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.606+0000 7f684dd48640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68480cf220 con 0x7f68480ccae0 2023-06-10T19:06:55.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.606+0000 7f68477fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f68480b3ac0 0x7f68480b3e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:47728/0 (socket says 172.21.15.53:47728) 2023-06-10T19:06:55.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.606+0000 7f68477fe640 1 -- 172.21.15.53:0/1670821389 learned_addr learned my addr 172.21.15.53:0/1670821389 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:06:55.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.606+0000 7f6847fff640 1 --2- 172.21.15.53:0/1670821389 >> v2:172.21.15.53:3300/0 conn(0x7f68480ccae0 0x7f68480d0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:55.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.606+0000 7f6846ffd640 1 -- 172.21.15.53:0/1670821389 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2806879460 0 0) 0x7f68480d0020 con 0x7f68480b3ac0 2023-06-10T19:06:55.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.606+0000 7f6846ffd640 1 -- 172.21.15.53:0/1670821389 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6834003530 con 0x7f68480b3ac0 2023-06-10T19:06:55.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.606+0000 7f6847fff640 1 -- 172.21.15.53:0/1670821389 >> v1:172.21.15.117:6789/0 conn(0x7f68480cc690 legacy=0x7f68480d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:55.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.606+0000 7f6847fff640 1 -- 172.21.15.53:0/1670821389 >> v1:172.21.15.53:6789/0 conn(0x7f68480b3ac0 legacy=0x7f68480b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:55.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.606+0000 7f6847fff640 1 -- 172.21.15.53:0/1670821389 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68480cf500 con 0x7f68480ccae0 2023-06-10T19:06:55.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.606+0000 7f6847fff640 1 --2- 172.21.15.53:0/1670821389 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68480ccae0 0x7f68480d0bc0 secure :-1 s=READY pgs=2271 cs=0 l=1 rev1=1 crypto rx=0x7f6840009d90 tx=0x7f684001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e392dbc9eeef6050 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:55.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.606+0000 7f6846ffd640 1 -- 172.21.15.53:0/1670821389 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68400a5a00 con 0x7f68480ccae0 2023-06-10T19:06:55.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.606+0000 7f6846ffd640 1 -- 172.21.15.53:0/1670821389 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68400a5b60 con 0x7f68480ccae0 2023-06-10T19:06:55.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.606+0000 7f6846ffd640 1 -- 172.21.15.53:0/1670821389 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68400ad440 con 0x7f68480ccae0 2023-06-10T19:06:55.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.610+0000 7f684dd48640 1 -- 172.21.15.53:0/1670821389 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68480ccae0 msgr2=0x7f68480d0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:55.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.610+0000 7f684dd48640 1 --2- 172.21.15.53:0/1670821389 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68480ccae0 0x7f68480d0bc0 secure :-1 s=READY pgs=2271 cs=0 l=1 rev1=1 crypto rx=0x7f6840009d90 tx=0x7f684001c920 comp rx=0 tx=0).stop 2023-06-10T19:06:55.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.610+0000 7f684dd48640 1 -- 172.21.15.53:0/1670821389 shutdown_connections 2023-06-10T19:06:55.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.610+0000 7f684dd48640 1 --2- 172.21.15.53:0/1670821389 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68480ccae0 0x7f68480d0bc0 unknown :-1 s=CLOSED pgs=2271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:55.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.610+0000 7f684dd48640 1 -- 172.21.15.53:0/1670821389 >> 172.21.15.53:0/1670821389 conn(0x7f6848071790 msgr2=0x7f6848069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:55.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.610+0000 7f684dd48640 1 -- 172.21.15.53:0/1670821389 shutdown_connections 2023-06-10T19:06:55.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.610+0000 7f684dd48640 1 -- 172.21.15.53:0/1670821389 wait complete. 2023-06-10T19:06:55.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.610+0000 7f684dd48640 1 Processor -- start 2023-06-10T19:06:55.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.610+0000 7f684dd48640 1 -- start start 2023-06-10T19:06:55.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.610+0000 7f684dd48640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68480b3ac0 0x7f68480c5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:55.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.610+0000 7f684dd48640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f68480cc690 0x7f684814e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:55.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.610+0000 7f684dd48640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68480ccae0 0x7f684815be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:55.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.610+0000 7f684dd48640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68480c7a10 con 0x7f68480b3ac0 2023-06-10T19:06:55.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.610+0000 7f684dd48640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f684814e5b0 con 0x7f68480ccae0 2023-06-10T19:06:55.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.610+0000 7f684dd48640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f684814e880 con 0x7f68480cc690 2023-06-10T19:06:55.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.610+0000 7f68477fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68480b3ac0 0x7f68480c5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:55.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.610+0000 7f68477fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68480b3ac0 0x7f68480c5e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48842/0 (socket says 172.21.15.53:48842) 2023-06-10T19:06:55.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.610+0000 7f68477fe640 1 -- 172.21.15.53:0/927854702 learned_addr learned my addr 172.21.15.53:0/927854702 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:55.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.610+0000 7f6847fff640 1 --2- 172.21.15.53:0/927854702 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68480ccae0 0x7f684815be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:55.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.610+0000 7f683ffff640 1 --2- 172.21.15.53:0/927854702 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f68480cc690 0x7f684814e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:55.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.610+0000 7f68477fe640 1 -- 172.21.15.53:0/927854702 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f68480cc690 msgr2=0x7f684814e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:55.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.610+0000 7f68477fe640 1 --2- 172.21.15.53:0/927854702 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f68480cc690 0x7f684814e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:55.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.610+0000 7f68477fe640 1 -- 172.21.15.53:0/927854702 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68480ccae0 msgr2=0x7f684815be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:55.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.610+0000 7f68477fe640 1 --2- 172.21.15.53:0/927854702 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68480ccae0 0x7f684815be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:55.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.610+0000 7f68477fe640 1 -- 172.21.15.53:0/927854702 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6840009a70 con 0x7f68480b3ac0 2023-06-10T19:06:55.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.610+0000 7f683ffff640 1 --2- 172.21.15.53:0/927854702 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f68480cc690 0x7f684814e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:06:55.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.610+0000 7f68477fe640 1 --2- 172.21.15.53:0/927854702 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68480b3ac0 0x7f68480c5e90 secure :-1 s=READY pgs=2272 cs=0 l=1 rev1=1 crypto rx=0x7f683800c4d0 tx=0x7f683800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:55.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.614+0000 7f6844ff9640 1 -- 172.21.15.53:0/927854702 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6838005cf0 con 0x7f68480b3ac0 2023-06-10T19:06:55.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.614+0000 7f6844ff9640 1 -- 172.21.15.53:0/927854702 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6838005e50 con 0x7f68480b3ac0 2023-06-10T19:06:55.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.614+0000 7f6844ff9640 1 -- 172.21.15.53:0/927854702 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6838007270 con 0x7f68480b3ac0 2023-06-10T19:06:55.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.614+0000 7f684dd48640 1 -- 172.21.15.53:0/927854702 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f684814eb60 con 0x7f68480b3ac0 2023-06-10T19:06:55.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.614+0000 7f684dd48640 1 -- 172.21.15.53:0/927854702 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f684814f120 con 0x7f68480b3ac0 2023-06-10T19:06:55.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.614+0000 7f684dd48640 1 -- 172.21.15.53:0/927854702 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f684804d790 con 0x7f68480b3ac0 2023-06-10T19:06:55.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.614+0000 7f6844ff9640 1 -- 172.21.15.53:0/927854702 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f68380073d0 con 0x7f68480b3ac0 2023-06-10T19:06:55.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.614+0000 7f6844ff9640 1 --2- 172.21.15.53:0/927854702 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f68280662b0 0x7f6828068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:55.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.614+0000 7f6844ff9640 1 -- 172.21.15.53:0/927854702 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6105+0+0 (secure 0 0 0) 0x7f68380832f0 con 0x7f68480b3ac0 2023-06-10T19:06:55.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.614+0000 7f683ffff640 1 --2- 172.21.15.53:0/927854702 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f68280662b0 0x7f6828068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:55.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.614+0000 7f683ffff640 1 --2- 172.21.15.53:0/927854702 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f68280662b0 0x7f6828068760 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f68480b5b50 tx=0x7f6830009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:55.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.618+0000 7f6844ff9640 1 -- 172.21.15.53:0/927854702 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6838050750 con 0x7f68480b3ac0 2023-06-10T19:06:55.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.774+0000 7f684dd48640 1 -- 172.21.15.53:0/927854702 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f68480c7770 con 0x7f68480b3ac0 2023-06-10T19:06:55.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.774+0000 7f6844ff9640 1 -- 172.21.15.53:0/927854702 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v155) v1 ==== 74+0+18349 (secure 0 0 0) 0x7f6838053d70 con 0x7f68480b3ac0 2023-06-10T19:06:55.778 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:06:55.778 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":155,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:06:50.154677+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-06-10T19:06:27.279397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-06-10T19:06:27.689260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"154","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.0.1:0/2213488734":"2023-06-10T20:06:49.780814+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:06:55.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.778+0000 7f684dd48640 1 -- 172.21.15.53:0/927854702 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f68280662b0 msgr2=0x7f6828068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:55.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.778+0000 7f684dd48640 1 --2- 172.21.15.53:0/927854702 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f68280662b0 0x7f6828068760 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f68480b5b50 tx=0x7f6830009040 comp rx=0 tx=0).stop 2023-06-10T19:06:55.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.778+0000 7f684dd48640 1 -- 172.21.15.53:0/927854702 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68480b3ac0 msgr2=0x7f68480c5e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:55.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.778+0000 7f684dd48640 1 --2- 172.21.15.53:0/927854702 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68480b3ac0 0x7f68480c5e90 secure :-1 s=READY pgs=2272 cs=0 l=1 rev1=1 crypto rx=0x7f683800c4d0 tx=0x7f683800c990 comp rx=0 tx=0).stop 2023-06-10T19:06:55.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.778+0000 7f684dd48640 1 -- 172.21.15.53:0/927854702 shutdown_connections 2023-06-10T19:06:55.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.778+0000 7f684dd48640 1 --2- 172.21.15.53:0/927854702 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f68280662b0 0x7f6828068760 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:55.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.778+0000 7f684dd48640 1 --2- 172.21.15.53:0/927854702 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68480ccae0 0x7f684815be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:55.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.778+0000 7f684dd48640 1 --2- 172.21.15.53:0/927854702 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f68480cc690 0x7f684814e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:55.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.778+0000 7f684dd48640 1 --2- 172.21.15.53:0/927854702 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68480b3ac0 0x7f68480c5e90 unknown :-1 s=CLOSED pgs=2272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:55.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.778+0000 7f684dd48640 1 -- 172.21.15.53:0/927854702 >> 172.21.15.53:0/927854702 conn(0x7f6848071790 msgr2=0x7f68480b2fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:55.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.778+0000 7f684dd48640 1 -- 172.21.15.53:0/927854702 shutdown_connections 2023-06-10T19:06:55.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.778+0000 7f684dd48640 1 -- 172.21.15.53:0/927854702 wait complete. 2023-06-10T19:06:55.799 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-10T18:52:33.633114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-10T18:52:39.171487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 21, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-10T19:06:27.279397+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '153', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 22, 'pool_name': 'cephfs_data', 'create_time': '2023-06-10T19:06:27.689260+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '154', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-10T19:06:55.800 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-10T19:06:55.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.930+0000 7fc45d1f3640 1 Processor -- start 2023-06-10T19:06:55.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.930+0000 7fc45d1f3640 1 -- start start 2023-06-10T19:06:55.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.930+0000 7fc45d1f3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4580afe70 0x7fc4580c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:55.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.930+0000 7fc45d1f3640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc45806b090 con 0x7fc4580c9fa0 2023-06-10T19:06:55.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.930+0000 7fc45d1f3640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4580ca370 con 0x7fc4580c82a0 2023-06-10T19:06:55.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.930+0000 7fc45d1f3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc458070d50 con 0x7fc4580afe70 2023-06-10T19:06:55.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.930+0000 7fc456d9d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fc4580c9fa0 0x7fc45806bae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:47744/0 (socket says 172.21.15.53:47744) 2023-06-10T19:06:55.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.930+0000 7fc456d9d640 1 -- 172.21.15.53:0/1623988270 learned_addr learned my addr 172.21.15.53:0/1623988270 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:06:55.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.930+0000 7fc45759e640 1 --2- 172.21.15.53:0/1623988270 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4580afe70 0x7fc4580c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:55.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.930+0000 7fc455d9b640 1 -- 172.21.15.53:0/1623988270 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4096069971 0 0) 0x7fc45806b090 con 0x7fc4580c9fa0 2023-06-10T19:06:55.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.930+0000 7fc455d9b640 1 -- 172.21.15.53:0/1623988270 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc440003530 con 0x7fc4580c9fa0 2023-06-10T19:06:55.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.930+0000 7fc455d9b640 1 -- 172.21.15.53:0/1623988270 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2455216008 0 0) 0x7fc440003530 con 0x7fc4580c9fa0 2023-06-10T19:06:55.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.930+0000 7fc455d9b640 1 -- 172.21.15.53:0/1623988270 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4580afe70 msgr2=0x7fc4580c86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:55.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.930+0000 7fc455d9b640 1 --2- 172.21.15.53:0/1623988270 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4580afe70 0x7fc4580c86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:55.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.930+0000 7fc455d9b640 1 -- 172.21.15.53:0/1623988270 >> v1:172.21.15.117:6789/0 conn(0x7fc4580c82a0 legacy=0x7fc4580af760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:55.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.930+0000 7fc455d9b640 1 -- 172.21.15.53:0/1623988270 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc458071030 con 0x7fc4580c9fa0 2023-06-10T19:06:55.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.930+0000 7fc455d9b640 1 -- 172.21.15.53:0/1623988270 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fc448001680 con 0x7fc4580c9fa0 2023-06-10T19:06:55.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.930+0000 7fc455d9b640 1 -- 172.21.15.53:0/1623988270 >> v1:172.21.15.53:6789/0 conn(0x7fc4580c9fa0 legacy=0x7fc45806bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:55.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.930+0000 7fc455d9b640 1 --2- 172.21.15.53:0/1623988270 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4580afe70 0x7fc4400039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:55.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.930+0000 7fc455d9b640 1 --2- 172.21.15.53:0/1623988270 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc440003ef0 0x7fc4400047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:55.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.930+0000 7fc455d9b640 1 --2- 172.21.15.53:0/1623988270 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc440004d10 0x7fc440005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:55.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.930+0000 7fc455d9b640 1 -- 172.21.15.53:0/1623988270 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc458070d50 con 0x7fc440004d10 2023-06-10T19:06:55.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.930+0000 7fc455d9b640 1 -- 172.21.15.53:0/1623988270 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc44000ba70 con 0x7fc440003ef0 2023-06-10T19:06:55.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.930+0000 7fc455d9b640 1 -- 172.21.15.53:0/1623988270 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc44000bc30 con 0x7fc4580afe70 2023-06-10T19:06:55.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.930+0000 7fc45759e640 1 --2- 172.21.15.53:0/1623988270 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc440004d10 0x7fc440005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:55.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.930+0000 7fc456d9d640 1 --2- 172.21.15.53:0/1623988270 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4580afe70 0x7fc4400039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:55.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.930+0000 7fc45659c640 1 --2- 172.21.15.53:0/1623988270 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc440003ef0 0x7fc4400047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:55.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.930+0000 7fc45759e640 1 -- 172.21.15.53:0/1623988270 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4580afe70 msgr2=0x7fc4400039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:55.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.930+0000 7fc45759e640 1 --2- 172.21.15.53:0/1623988270 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4580afe70 0x7fc4400039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:55.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.930+0000 7fc45759e640 1 -- 172.21.15.53:0/1623988270 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc440003ef0 msgr2=0x7fc4400047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:55.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.930+0000 7fc45759e640 1 --2- 172.21.15.53:0/1623988270 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc440003ef0 0x7fc4400047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:55.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.930+0000 7fc45759e640 1 -- 172.21.15.53:0/1623988270 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc440003530 con 0x7fc440004d10 2023-06-10T19:06:55.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.930+0000 7fc456d9d640 1 --2- 172.21.15.53:0/1623988270 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc4580afe70 0x7fc4400039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:06:55.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.934+0000 7fc45759e640 1 --2- 172.21.15.53:0/1623988270 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc440004d10 0x7fc440005180 secure :-1 s=READY pgs=2274 cs=0 l=1 rev1=1 crypto rx=0x7fc4580cdc40 tx=0x7fc45001cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b83586cc237666c2 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:55.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.934+0000 7fc455d9b640 1 -- 172.21.15.53:0/1623988270 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4500a5c10 con 0x7fc440004d10 2023-06-10T19:06:55.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.934+0000 7fc455d9b640 1 -- 172.21.15.53:0/1623988270 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc45000f040 con 0x7fc440004d10 2023-06-10T19:06:55.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.934+0000 7fc455d9b640 1 -- 172.21.15.53:0/1623988270 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4500ad440 con 0x7fc440004d10 2023-06-10T19:06:55.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.934+0000 7fc45d1f3640 1 -- 172.21.15.53:0/1623988270 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc440004d10 msgr2=0x7fc440005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:55.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.934+0000 7fc45d1f3640 1 --2- 172.21.15.53:0/1623988270 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc440004d10 0x7fc440005180 secure :-1 s=READY pgs=2274 cs=0 l=1 rev1=1 crypto rx=0x7fc4580cdc40 tx=0x7fc45001cc00 comp rx=0 tx=0).stop 2023-06-10T19:06:55.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.934+0000 7fc45759e640 1 -- 172.21.15.53:0/1623988270 reap_dead start 2023-06-10T19:06:55.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.934+0000 7fc45d1f3640 1 -- 172.21.15.53:0/1623988270 shutdown_connections 2023-06-10T19:06:55.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.934+0000 7fc45d1f3640 1 -- 172.21.15.53:0/1623988270 >> 172.21.15.53:0/1623988270 conn(0x7fc45806a0e0 msgr2=0x7fc4580cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:55.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.934+0000 7fc45d1f3640 1 -- 172.21.15.53:0/1623988270 shutdown_connections 2023-06-10T19:06:55.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.934+0000 7fc45d1f3640 1 -- 172.21.15.53:0/1623988270 wait complete. 2023-06-10T19:06:55.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.934+0000 7fc45d1f3640 1 Processor -- start 2023-06-10T19:06:55.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.934+0000 7fc45d1f3640 1 -- start start 2023-06-10T19:06:55.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.938+0000 7fc45d1f3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc440004d10 0x7fc458159140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:55.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.938+0000 7fc45d1f3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4581f0d50 0x7fc458159a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:55.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.938+0000 7fc45d1f3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc458159f60 0x7fc45815b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:55.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.938+0000 7fc45d1f3640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc45815a3e0 con 0x7fc458159f60 2023-06-10T19:06:55.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.938+0000 7fc45d1f3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc45815b140 con 0x7fc4581f0d50 2023-06-10T19:06:55.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.938+0000 7fc45d1f3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc458159680 con 0x7fc440004d10 2023-06-10T19:06:55.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.938+0000 7fc45759e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc458159f60 0x7fc45815b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:55.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.938+0000 7fc45759e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc458159f60 0x7fc45815b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48864/0 (socket says 172.21.15.53:48864) 2023-06-10T19:06:55.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.938+0000 7fc45759e640 1 -- 172.21.15.53:0/1465971285 learned_addr learned my addr 172.21.15.53:0/1465971285 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:55.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.938+0000 7fc456d9d640 1 --2- 172.21.15.53:0/1465971285 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc440004d10 0x7fc458159140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:55.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.938+0000 7fc45659c640 1 --2- 172.21.15.53:0/1465971285 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4581f0d50 0x7fc458159a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:55.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.938+0000 7fc45759e640 1 -- 172.21.15.53:0/1465971285 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc440004d10 msgr2=0x7fc458159140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:55.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.938+0000 7fc45759e640 1 --2- 172.21.15.53:0/1465971285 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc440004d10 0x7fc458159140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:55.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.938+0000 7fc45759e640 1 -- 172.21.15.53:0/1465971285 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4581f0d50 msgr2=0x7fc458159a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:55.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.938+0000 7fc45759e640 1 --2- 172.21.15.53:0/1465971285 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4581f0d50 0x7fc458159a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:55.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.938+0000 7fc45759e640 1 -- 172.21.15.53:0/1465971285 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc45815a600 con 0x7fc458159f60 2023-06-10T19:06:55.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.938+0000 7fc45659c640 1 --2- 172.21.15.53:0/1465971285 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4581f0d50 0x7fc458159a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:06:55.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.938+0000 7fc45759e640 1 --2- 172.21.15.53:0/1465971285 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc458159f60 0x7fc45815b490 secure :-1 s=READY pgs=2275 cs=0 l=1 rev1=1 crypto rx=0x7fc450002240 tx=0x7fc450009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:55.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.938+0000 7fc43f7fe640 1 -- 172.21.15.53:0/1465971285 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4500039a0 con 0x7fc458159f60 2023-06-10T19:06:55.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.938+0000 7fc43f7fe640 1 -- 172.21.15.53:0/1465971285 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc450003b00 con 0x7fc458159f60 2023-06-10T19:06:55.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.938+0000 7fc43f7fe640 1 -- 172.21.15.53:0/1465971285 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc450003e70 con 0x7fc458159f60 2023-06-10T19:06:55.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.938+0000 7fc45d1f3640 1 -- 172.21.15.53:0/1465971285 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc45815a8e0 con 0x7fc458159f60 2023-06-10T19:06:55.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.938+0000 7fc45d1f3640 1 -- 172.21.15.53:0/1465971285 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4580b0df0 con 0x7fc458159f60 2023-06-10T19:06:55.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.938+0000 7fc45d1f3640 1 -- 172.21.15.53:0/1465971285 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4580b0370 con 0x7fc458159f60 2023-06-10T19:06:55.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.938+0000 7fc43f7fe640 1 -- 172.21.15.53:0/1465971285 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc4500b4040 con 0x7fc458159f60 2023-06-10T19:06:55.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.938+0000 7fc43f7fe640 1 --2- 172.21.15.53:0/1465971285 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc444066280 0x7fc444068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:55.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.938+0000 7fc43f7fe640 1 -- 172.21.15.53:0/1465971285 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6105+0+0 (secure 0 0 0) 0x7fc45011d800 con 0x7fc458159f60 2023-06-10T19:06:55.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.938+0000 7fc456d9d640 1 --2- 172.21.15.53:0/1465971285 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc444066280 0x7fc444068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:55.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.942+0000 7fc456d9d640 1 --2- 172.21.15.53:0/1465971285 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc444066280 0x7fc444068730 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fc4581e2020 tx=0x7fc448009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:55.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:55.942+0000 7fc43f7fe640 1 -- 172.21.15.53:0/1465971285 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc4500eac60 con 0x7fc458159f60 2023-06-10T19:06:56.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.098+0000 7fc45d1f3640 1 -- 172.21.15.53:0/1465971285 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc45804d790 con 0x7fc458159f60 2023-06-10T19:06:56.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.098+0000 7fc43f7fe640 1 -- 172.21.15.53:0/1465971285 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v155) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc4500ee280 con 0x7fc458159f60 2023-06-10T19:06:56.100 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-06-10T19:06:56.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.098+0000 7fc45d1f3640 1 -- 172.21.15.53:0/1465971285 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc444066280 msgr2=0x7fc444068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:56.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.098+0000 7fc45d1f3640 1 --2- 172.21.15.53:0/1465971285 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc444066280 0x7fc444068730 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fc4581e2020 tx=0x7fc448009040 comp rx=0 tx=0).stop 2023-06-10T19:06:56.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.098+0000 7fc45d1f3640 1 -- 172.21.15.53:0/1465971285 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc458159f60 msgr2=0x7fc45815b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:56.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.098+0000 7fc45d1f3640 1 --2- 172.21.15.53:0/1465971285 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc458159f60 0x7fc45815b490 secure :-1 s=READY pgs=2275 cs=0 l=1 rev1=1 crypto rx=0x7fc450002240 tx=0x7fc450009750 comp rx=0 tx=0).stop 2023-06-10T19:06:56.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.102+0000 7fc45d1f3640 1 -- 172.21.15.53:0/1465971285 shutdown_connections 2023-06-10T19:06:56.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.102+0000 7fc45d1f3640 1 --2- 172.21.15.53:0/1465971285 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc444066280 0x7fc444068730 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:56.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.102+0000 7fc45d1f3640 1 --2- 172.21.15.53:0/1465971285 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc458159f60 0x7fc45815b490 unknown :-1 s=CLOSED pgs=2275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:56.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.102+0000 7fc45d1f3640 1 --2- 172.21.15.53:0/1465971285 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4581f0d50 0x7fc458159a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:56.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.102+0000 7fc45d1f3640 1 --2- 172.21.15.53:0/1465971285 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc440004d10 0x7fc458159140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:56.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.102+0000 7fc45d1f3640 1 -- 172.21.15.53:0/1465971285 >> 172.21.15.53:0/1465971285 conn(0x7fc45806a0e0 msgr2=0x7fc4580cc9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:56.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.102+0000 7fc45d1f3640 1 -- 172.21.15.53:0/1465971285 shutdown_connections 2023-06-10T19:06:56.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.102+0000 7fc45d1f3640 1 -- 172.21.15.53:0/1465971285 wait complete. 2023-06-10T19:06:56.120 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-10T19:06:56.245 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.242+0000 7f2d2007d640 1 Processor -- start 2023-06-10T19:06:56.246 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.242+0000 7f2d2007d640 1 -- start start 2023-06-10T19:06:56.247 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.246+0000 7f2d2007d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d180c82a0 0x7f2d180c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:56.247 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.246+0000 7f2d2007d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2d180af760 0x7f2d180afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:56.247 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.246+0000 7f2d2007d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d1806b090 con 0x7f2d180c9fa0 2023-06-10T19:06:56.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.246+0000 7f2d2007d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d180b0120 con 0x7f2d180af760 2023-06-10T19:06:56.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.246+0000 7f2d2007d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d180ca370 con 0x7f2d180c82a0 2023-06-10T19:06:56.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.246+0000 7f2d1e61a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2d180af760 0x7f2d180afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:56.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.246+0000 7f2d1e61a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2d180af760 0x7f2d180afbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48868/0 (socket says 172.21.15.53:48868) 2023-06-10T19:06:56.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.246+0000 7f2d1e61a640 1 -- 172.21.15.53:0/2263827836 learned_addr learned my addr 172.21.15.53:0/2263827836 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:56.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.246+0000 7f2d1d618640 1 --2- 172.21.15.53:0/2263827836 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d180c82a0 0x7f2d180c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:56.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.246+0000 7f2d1e61a640 1 -- 172.21.15.53:0/2263827836 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d180c82a0 msgr2=0x7f2d180c86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:56.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.246+0000 7f2d1e61a640 1 --2- 172.21.15.53:0/2263827836 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d180c82a0 0x7f2d180c86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:56.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.246+0000 7f2d1e61a640 1 -- 172.21.15.53:0/2263827836 >> v1:172.21.15.117:6789/0 conn(0x7f2d180c9fa0 legacy=0x7f2d1806bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:56.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.246+0000 7f2d1e61a640 1 -- 172.21.15.53:0/2263827836 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d18070d50 con 0x7f2d180af760 2023-06-10T19:06:56.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.246+0000 7f2d1e61a640 1 --2- 172.21.15.53:0/2263827836 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d180af760 0x7f2d180afbe0 secure :-1 s=READY pgs=2276 cs=0 l=1 rev1=1 crypto rx=0x7f2d10009e50 tx=0x7f2d1001c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f1ffff55f3d0c3b server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:56.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.246+0000 7f2d1ce17640 1 -- 172.21.15.53:0/2263827836 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d100a5810 con 0x7f2d180af760 2023-06-10T19:06:56.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.246+0000 7f2d1ce17640 1 -- 172.21.15.53:0/2263827836 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d100a5970 con 0x7f2d180af760 2023-06-10T19:06:56.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.246+0000 7f2d1ce17640 1 -- 172.21.15.53:0/2263827836 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d100a5d00 con 0x7f2d180af760 2023-06-10T19:06:56.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.246+0000 7f2d2007d640 1 -- 172.21.15.53:0/2263827836 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d180af760 msgr2=0x7f2d180afbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:56.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.246+0000 7f2d2007d640 1 --2- 172.21.15.53:0/2263827836 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d180af760 0x7f2d180afbe0 secure :-1 s=READY pgs=2276 cs=0 l=1 rev1=1 crypto rx=0x7f2d10009e50 tx=0x7f2d1001c950 comp rx=0 tx=0).stop 2023-06-10T19:06:56.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.250+0000 7f2d2007d640 1 -- 172.21.15.53:0/2263827836 shutdown_connections 2023-06-10T19:06:56.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.250+0000 7f2d2007d640 1 --2- 172.21.15.53:0/2263827836 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d180af760 0x7f2d180afbe0 unknown :-1 s=CLOSED pgs=2276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:56.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.250+0000 7f2d2007d640 1 --2- 172.21.15.53:0/2263827836 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d180c82a0 0x7f2d180c86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:56.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.250+0000 7f2d2007d640 1 -- 172.21.15.53:0/2263827836 >> 172.21.15.53:0/2263827836 conn(0x7f2d1806a0e0 msgr2=0x7f2d180cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:56.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.250+0000 7f2d2007d640 1 -- 172.21.15.53:0/2263827836 shutdown_connections 2023-06-10T19:06:56.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.250+0000 7f2d2007d640 1 -- 172.21.15.53:0/2263827836 wait complete. 2023-06-10T19:06:56.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.250+0000 7f2d2007d640 1 Processor -- start 2023-06-10T19:06:56.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.250+0000 7f2d2007d640 1 -- start start 2023-06-10T19:06:56.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.250+0000 7f2d2007d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d180af760 0x7f2d18159a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:56.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.250+0000 7f2d2007d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d180c82a0 0x7f2d180c7a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:56.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.250+0000 7f2d2007d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d180c9fa0 0x7f2d18145a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:56.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.250+0000 7f2d2007d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1815c100 con 0x7f2d180c82a0 2023-06-10T19:06:56.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.250+0000 7f2d2007d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1815b7d0 con 0x7f2d180af760 2023-06-10T19:06:56.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.250+0000 7f2d2007d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1815bab0 con 0x7f2d180c9fa0 2023-06-10T19:06:56.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.250+0000 7f2d1d618640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d180c82a0 0x7f2d180c7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:56.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.250+0000 7f2d1d618640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d180c82a0 0x7f2d180c7a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48878/0 (socket says 172.21.15.53:48878) 2023-06-10T19:06:56.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.250+0000 7f2d1d618640 1 -- 172.21.15.53:0/3077598826 learned_addr learned my addr 172.21.15.53:0/3077598826 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:56.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.250+0000 7f2d1e61a640 1 --2- 172.21.15.53:0/3077598826 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d180c9fa0 0x7f2d18145a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:56.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.250+0000 7f2d1de19640 1 --2- 172.21.15.53:0/3077598826 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d180af760 0x7f2d18159a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:56.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.250+0000 7f2d1d618640 1 -- 172.21.15.53:0/3077598826 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d180c9fa0 msgr2=0x7f2d18145a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:56.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.250+0000 7f2d1d618640 1 --2- 172.21.15.53:0/3077598826 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d180c9fa0 0x7f2d18145a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:56.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.250+0000 7f2d1d618640 1 -- 172.21.15.53:0/3077598826 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d180af760 msgr2=0x7f2d18159a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:56.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.250+0000 7f2d1d618640 1 --2- 172.21.15.53:0/3077598826 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d180af760 0x7f2d18159a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:56.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.250+0000 7f2d1d618640 1 -- 172.21.15.53:0/3077598826 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d10009b30 con 0x7f2d180c82a0 2023-06-10T19:06:56.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.250+0000 7f2d1e61a640 1 --2- 172.21.15.53:0/3077598826 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d180c9fa0 0x7f2d18145a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:06:56.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.250+0000 7f2d1de19640 1 --2- 172.21.15.53:0/3077598826 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d180af760 0x7f2d18159a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:06:56.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.250+0000 7f2d1d618640 1 --2- 172.21.15.53:0/3077598826 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d180c82a0 0x7f2d180c7a60 secure :-1 s=READY pgs=2277 cs=0 l=1 rev1=1 crypto rx=0x7f2d0800d800 tx=0x7f2d0800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:56.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.250+0000 7f2d0e7fc640 1 -- 172.21.15.53:0/3077598826 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d0800b6c0 con 0x7f2d180c82a0 2023-06-10T19:06:56.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.250+0000 7f2d0e7fc640 1 -- 172.21.15.53:0/3077598826 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d0800b820 con 0x7f2d180c82a0 2023-06-10T19:06:56.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.250+0000 7f2d2007d640 1 -- 172.21.15.53:0/3077598826 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d1815bd90 con 0x7f2d180c82a0 2023-06-10T19:06:56.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.250+0000 7f2d0e7fc640 1 -- 172.21.15.53:0/3077598826 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d0800bb90 con 0x7f2d180c82a0 2023-06-10T19:06:56.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.250+0000 7f2d2007d640 1 -- 172.21.15.53:0/3077598826 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d1815b3f0 con 0x7f2d180c82a0 2023-06-10T19:06:56.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.254+0000 7f2d2007d640 1 -- 172.21.15.53:0/3077598826 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d181593f0 con 0x7f2d180c82a0 2023-06-10T19:06:56.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.254+0000 7f2d0e7fc640 1 -- 172.21.15.53:0/3077598826 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2d0800bcf0 con 0x7f2d180c82a0 2023-06-10T19:06:56.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.254+0000 7f2d0e7fc640 1 --2- 172.21.15.53:0/3077598826 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2cfc066280 0x7f2cfc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:56.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.254+0000 7f2d0e7fc640 1 -- 172.21.15.53:0/3077598826 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6105+0+0 (secure 0 0 0) 0x7f2d080842d0 con 0x7f2d180c82a0 2023-06-10T19:06:56.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.254+0000 7f2d1de19640 1 --2- 172.21.15.53:0/3077598826 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2cfc066280 0x7f2cfc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:56.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.254+0000 7f2d1de19640 1 --2- 172.21.15.53:0/3077598826 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2cfc066280 0x7f2cfc068730 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f2d14000f70 tx=0x7f2d14009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:56.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.258+0000 7f2d0e7fc640 1 -- 172.21.15.53:0/3077598826 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2d080551b0 con 0x7f2d180c82a0 2023-06-10T19:06:56.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.410+0000 7f2d2007d640 1 -- 172.21.15.53:0/3077598826 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2d1804d790 con 0x7f2d180c82a0 2023-06-10T19:06:56.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.414+0000 7f2d0e7fc640 1 -- 172.21.15.53:0/3077598826 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v155) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2d08054d40 con 0x7f2d180c82a0 2023-06-10T19:06:56.415 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-06-10T19:06:56.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.414+0000 7f2d2007d640 1 -- 172.21.15.53:0/3077598826 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2cfc066280 msgr2=0x7f2cfc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:56.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.414+0000 7f2d2007d640 1 --2- 172.21.15.53:0/3077598826 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2cfc066280 0x7f2cfc068730 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f2d14000f70 tx=0x7f2d14009040 comp rx=0 tx=0).stop 2023-06-10T19:06:56.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.414+0000 7f2d2007d640 1 -- 172.21.15.53:0/3077598826 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d180c82a0 msgr2=0x7f2d180c7a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:56.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.414+0000 7f2d2007d640 1 --2- 172.21.15.53:0/3077598826 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d180c82a0 0x7f2d180c7a60 secure :-1 s=READY pgs=2277 cs=0 l=1 rev1=1 crypto rx=0x7f2d0800d800 tx=0x7f2d0800dcc0 comp rx=0 tx=0).stop 2023-06-10T19:06:56.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.414+0000 7f2d2007d640 1 -- 172.21.15.53:0/3077598826 shutdown_connections 2023-06-10T19:06:56.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.414+0000 7f2d2007d640 1 --2- 172.21.15.53:0/3077598826 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2cfc066280 0x7f2cfc068730 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:56.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.414+0000 7f2d2007d640 1 --2- 172.21.15.53:0/3077598826 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d180c9fa0 0x7f2d18145a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:56.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.414+0000 7f2d2007d640 1 --2- 172.21.15.53:0/3077598826 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d180c82a0 0x7f2d180c7a60 unknown :-1 s=CLOSED pgs=2277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:56.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.414+0000 7f2d2007d640 1 --2- 172.21.15.53:0/3077598826 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d180af760 0x7f2d18159a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:56.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.414+0000 7f2d2007d640 1 -- 172.21.15.53:0/3077598826 >> 172.21.15.53:0/3077598826 conn(0x7f2d1806a0e0 msgr2=0x7f2d180ae9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:56.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.414+0000 7f2d2007d640 1 -- 172.21.15.53:0/3077598826 shutdown_connections 2023-06-10T19:06:56.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.414+0000 7f2d2007d640 1 -- 172.21.15.53:0/3077598826 wait complete. 2023-06-10T19:06:56.433 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-10T19:06:56.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.550+0000 7fa206d7a640 1 Processor -- start 2023-06-10T19:06:56.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.550+0000 7fa206d7a640 1 -- start start 2023-06-10T19:06:56.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.550+0000 7fa206d7a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa200156180 0x7fa2000cd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:56.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.550+0000 7fa206d7a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa20015c4f0 0x7fa200159190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:56.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.550+0000 7fa206d7a640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa20006b090 con 0x7fa20015c070 2023-06-10T19:06:56.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.550+0000 7fa206d7a640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa20006efa0 con 0x7fa200156180 2023-06-10T19:06:56.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.550+0000 7fa206d7a640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2000cc720 con 0x7fa20015c4f0 2023-06-10T19:06:56.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.554+0000 7fa204b16640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa200156180 0x7fa2000cd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:56.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.554+0000 7fa1fffff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fa20015c070 0x7fa200158a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:47756/0 (socket says 172.21.15.53:47756) 2023-06-10T19:06:56.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.554+0000 7fa1fffff640 1 -- 172.21.15.53:0/4051320313 learned_addr learned my addr 172.21.15.53:0/4051320313 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:06:56.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.554+0000 7fa204b16640 1 -- 172.21.15.53:0/4051320313 >> v2:172.21.15.117:3300/0 conn(0x7fa20015c4f0 msgr2=0x7fa200159190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:56.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.554+0000 7fa205317640 1 --2- 172.21.15.53:0/4051320313 >> v2:172.21.15.117:3300/0 conn(0x7fa20015c4f0 0x7fa200159190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:56.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.554+0000 7fa204b16640 1 --2- 172.21.15.53:0/4051320313 >> v2:172.21.15.117:3300/0 conn(0x7fa20015c4f0 0x7fa200159190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:56.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.554+0000 7fa204b16640 1 -- 172.21.15.53:0/4051320313 >> v1:172.21.15.53:6789/0 conn(0x7fa20015c070 legacy=0x7fa200158a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:56.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.554+0000 7fa1ff7fe640 1 -- 172.21.15.53:0/4051320313 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2601420343 0 0) 0x7fa20006b090 con 0x7fa20015c070 2023-06-10T19:06:56.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.554+0000 7fa204b16640 1 -- 172.21.15.53:0/4051320313 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2000cc9a0 con 0x7fa200156180 2023-06-10T19:06:56.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.554+0000 7fa205317640 1 --2- 172.21.15.53:0/4051320313 >> v2:172.21.15.117:3300/0 conn(0x7fa20015c4f0 0x7fa200159190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:06:56.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.554+0000 7fa204b16640 1 --2- 172.21.15.53:0/4051320313 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa200156180 0x7fa2000cd4a0 secure :-1 s=READY pgs=2279 cs=0 l=1 rev1=1 crypto rx=0x7fa20006e5c0 tx=0x7fa1f401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c538b970894d86cf server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:56.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.554+0000 7fa1ff7fe640 1 -- 172.21.15.53:0/4051320313 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f4004230 con 0x7fa200156180 2023-06-10T19:06:56.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.554+0000 7fa1ff7fe640 1 -- 172.21.15.53:0/4051320313 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1f40a7050 con 0x7fa200156180 2023-06-10T19:06:56.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.554+0000 7fa1ff7fe640 1 -- 172.21.15.53:0/4051320313 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f4003620 con 0x7fa200156180 2023-06-10T19:06:56.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.554+0000 7fa206d7a640 1 -- 172.21.15.53:0/4051320313 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa200156180 msgr2=0x7fa2000cd4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:56.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.554+0000 7fa206d7a640 1 --2- 172.21.15.53:0/4051320313 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa200156180 0x7fa2000cd4a0 secure :-1 s=READY pgs=2279 cs=0 l=1 rev1=1 crypto rx=0x7fa20006e5c0 tx=0x7fa1f401c460 comp rx=0 tx=0).stop 2023-06-10T19:06:56.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.554+0000 7fa206d7a640 1 -- 172.21.15.53:0/4051320313 shutdown_connections 2023-06-10T19:06:56.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.554+0000 7fa206d7a640 1 --2- 172.21.15.53:0/4051320313 >> v2:172.21.15.117:3300/0 conn(0x7fa20015c4f0 0x7fa200159190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:56.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.554+0000 7fa206d7a640 1 --2- 172.21.15.53:0/4051320313 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa200156180 0x7fa2000cd4a0 unknown :-1 s=CLOSED pgs=2279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:56.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.554+0000 7fa206d7a640 1 -- 172.21.15.53:0/4051320313 >> 172.21.15.53:0/4051320313 conn(0x7fa20006a0e0 msgr2=0x7fa2000cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:56.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.554+0000 7fa206d7a640 1 -- 172.21.15.53:0/4051320313 shutdown_connections 2023-06-10T19:06:56.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.554+0000 7fa206d7a640 1 -- 172.21.15.53:0/4051320313 wait complete. 2023-06-10T19:06:56.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.558+0000 7fa206d7a640 1 Processor -- start 2023-06-10T19:06:56.561 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.558+0000 7fa206d7a640 1 -- start start 2023-06-10T19:06:56.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.558+0000 7fa206d7a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa200156180 0x7fa2000b3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:56.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.558+0000 7fa206d7a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa20015c070 0x7fa2001f4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:56.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.558+0000 7fa206d7a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa20015c4f0 0x7fa2000b0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:56.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.558+0000 7fa206d7a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2001f4640 con 0x7fa20015c070 2023-06-10T19:06:56.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.558+0000 7fa206d7a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa200151b40 con 0x7fa200156180 2023-06-10T19:06:56.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.558+0000 7fa206d7a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2000b1050 con 0x7fa20015c4f0 2023-06-10T19:06:56.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.558+0000 7fa1fffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa20015c070 0x7fa2001f4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:56.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.558+0000 7fa1fffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa20015c070 0x7fa2001f4100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48892/0 (socket says 172.21.15.53:48892) 2023-06-10T19:06:56.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.558+0000 7fa1fffff640 1 -- 172.21.15.53:0/2427538292 learned_addr learned my addr 172.21.15.53:0/2427538292 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:56.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.558+0000 7fa204b16640 1 --2- 172.21.15.53:0/2427538292 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa200156180 0x7fa2000b3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:56.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.558+0000 7fa205317640 1 --2- 172.21.15.53:0/2427538292 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa20015c4f0 0x7fa2000b0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:56.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.558+0000 7fa1fffff640 1 -- 172.21.15.53:0/2427538292 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa20015c4f0 msgr2=0x7fa2000b0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:56.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.558+0000 7fa1fffff640 1 --2- 172.21.15.53:0/2427538292 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa20015c4f0 0x7fa2000b0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:56.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.558+0000 7fa1fffff640 1 -- 172.21.15.53:0/2427538292 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa200156180 msgr2=0x7fa2000b3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:56.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.558+0000 7fa1fffff640 1 --2- 172.21.15.53:0/2427538292 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa200156180 0x7fa2000b3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:56.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.558+0000 7fa1fffff640 1 -- 172.21.15.53:0/2427538292 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f4009420 con 0x7fa20015c070 2023-06-10T19:06:56.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.558+0000 7fa1fffff640 1 --2- 172.21.15.53:0/2427538292 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa20015c070 0x7fa2001f4100 secure :-1 s=READY pgs=2280 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec00c520 tx=0x7fa1ec00c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:56.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.558+0000 7fa1fd7fa640 1 -- 172.21.15.53:0/2427538292 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1ec0074e0 con 0x7fa20015c070 2023-06-10T19:06:56.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.558+0000 7fa1fd7fa640 1 -- 172.21.15.53:0/2427538292 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1ec007640 con 0x7fa20015c070 2023-06-10T19:06:56.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.558+0000 7fa206d7a640 1 -- 172.21.15.53:0/2427538292 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2000b39f0 con 0x7fa20015c070 2023-06-10T19:06:56.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.558+0000 7fa1fd7fa640 1 -- 172.21.15.53:0/2427538292 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1ec0049f0 con 0x7fa20015c070 2023-06-10T19:06:56.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.558+0000 7fa206d7a640 1 -- 172.21.15.53:0/2427538292 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2001514a0 con 0x7fa20015c070 2023-06-10T19:06:56.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.558+0000 7fa206d7a640 1 -- 172.21.15.53:0/2427538292 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa20004d790 con 0x7fa20015c070 2023-06-10T19:06:56.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.562+0000 7fa1fd7fa640 1 -- 172.21.15.53:0/2427538292 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa1ec004b50 con 0x7fa20015c070 2023-06-10T19:06:56.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.562+0000 7fa1fd7fa640 1 --2- 172.21.15.53:0/2427538292 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa1e4066280 0x7fa1e4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:56.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.562+0000 7fa1fd7fa640 1 -- 172.21.15.53:0/2427538292 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6105+0+0 (secure 0 0 0) 0x7fa1ec0834a0 con 0x7fa20015c070 2023-06-10T19:06:56.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.562+0000 7fa204b16640 1 --2- 172.21.15.53:0/2427538292 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa1e4066280 0x7fa1e4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:56.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.562+0000 7fa204b16640 1 --2- 172.21.15.53:0/2427538292 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa1e4066280 0x7fa1e4068730 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fa1f40ad000 tx=0x7fa1f40a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:56.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.566+0000 7fa1fd7fa640 1 -- 172.21.15.53:0/2427538292 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa1ec050850 con 0x7fa20015c070 2023-06-10T19:06:56.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.718+0000 7fa206d7a640 1 -- 172.21.15.53:0/2427538292 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa2001631e0 con 0x7fa20015c070 2023-06-10T19:06:56.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.718+0000 7fa1fd7fa640 1 -- 172.21.15.53:0/2427538292 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v155) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa1ec053e70 con 0x7fa20015c070 2023-06-10T19:06:56.720 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-06-10T19:06:56.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.718+0000 7fa206d7a640 1 -- 172.21.15.53:0/2427538292 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa1e4066280 msgr2=0x7fa1e4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:56.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.718+0000 7fa206d7a640 1 --2- 172.21.15.53:0/2427538292 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa1e4066280 0x7fa1e4068730 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fa1f40ad000 tx=0x7fa1f40a6000 comp rx=0 tx=0).stop 2023-06-10T19:06:56.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.718+0000 7fa206d7a640 1 -- 172.21.15.53:0/2427538292 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa20015c070 msgr2=0x7fa2001f4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:56.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.718+0000 7fa206d7a640 1 --2- 172.21.15.53:0/2427538292 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa20015c070 0x7fa2001f4100 secure :-1 s=READY pgs=2280 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec00c520 tx=0x7fa1ec00c9e0 comp rx=0 tx=0).stop 2023-06-10T19:06:56.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.718+0000 7fa206d7a640 1 -- 172.21.15.53:0/2427538292 shutdown_connections 2023-06-10T19:06:56.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.718+0000 7fa206d7a640 1 --2- 172.21.15.53:0/2427538292 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa1e4066280 0x7fa1e4068730 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:56.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.718+0000 7fa206d7a640 1 --2- 172.21.15.53:0/2427538292 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa20015c4f0 0x7fa2000b0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:56.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.718+0000 7fa206d7a640 1 --2- 172.21.15.53:0/2427538292 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa20015c070 0x7fa2001f4100 unknown :-1 s=CLOSED pgs=2280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:56.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.718+0000 7fa206d7a640 1 --2- 172.21.15.53:0/2427538292 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa200156180 0x7fa2000b3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:56.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.718+0000 7fa206d7a640 1 -- 172.21.15.53:0/2427538292 >> 172.21.15.53:0/2427538292 conn(0x7fa20006a0e0 msgr2=0x7fa200157de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:56.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.718+0000 7fa206d7a640 1 -- 172.21.15.53:0/2427538292 shutdown_connections 2023-06-10T19:06:56.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.718+0000 7fa206d7a640 1 -- 172.21.15.53:0/2427538292 wait complete. 2023-06-10T19:06:56.738 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-10T19:06:56.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.854+0000 7fc764f5e640 1 Processor -- start 2023-06-10T19:06:56.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.854+0000 7fc764f5e640 1 -- start start 2023-06-10T19:06:56.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.854+0000 7fc764f5e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc7600b7e30 0x7fc7600b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:56.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.854+0000 7fc764f5e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc7600b0b90 0x7fc7600d04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:56.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.854+0000 7fc764f5e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7600cc7c0 con 0x7fc76015c090 2023-06-10T19:06:56.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.854+0000 7fc764f5e640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7600ccaa0 con 0x7fc7600b0b90 2023-06-10T19:06:56.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.854+0000 7fc764f5e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7600ccd80 con 0x7fc7600b7e30 2023-06-10T19:06:56.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.854+0000 7fc75ed9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc7600b0b90 0x7fc7600d04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:56.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.854+0000 7fc75ed9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc7600b0b90 0x7fc7600d04d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48900/0 (socket says 172.21.15.53:48900) 2023-06-10T19:06:56.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.854+0000 7fc75ed9d640 1 -- 172.21.15.53:0/263481037 learned_addr learned my addr 172.21.15.53:0/263481037 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:56.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.854+0000 7fc755d9b640 1 --2- 172.21.15.53:0/263481037 >> v2:172.21.15.117:3300/0 conn(0x7fc7600b7e30 0x7fc7600b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:56.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.854+0000 7fc75ed9d640 1 -- 172.21.15.53:0/263481037 >> v2:172.21.15.117:3300/0 conn(0x7fc7600b7e30 msgr2=0x7fc7600b10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:56.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.854+0000 7fc75ed9d640 1 --2- 172.21.15.53:0/263481037 >> v2:172.21.15.117:3300/0 conn(0x7fc7600b7e30 0x7fc7600b10c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:56.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.854+0000 7fc75ed9d640 1 -- 172.21.15.53:0/263481037 >> v1:172.21.15.117:6789/0 conn(0x7fc76015c090 legacy=0x7fc7600b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:56.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.854+0000 7fc75ed9d640 1 -- 172.21.15.53:0/263481037 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7600cd060 con 0x7fc7600b0b90 2023-06-10T19:06:56.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.854+0000 7fc75ed9d640 1 --2- 172.21.15.53:0/263481037 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7600b0b90 0x7fc7600d04d0 secure :-1 s=READY pgs=2281 cs=0 l=1 rev1=1 crypto rx=0x7fc7600b4c30 tx=0x7fc75801c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=981483d3f565fed2 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:56.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.854+0000 7fc75dd9b640 1 -- 172.21.15.53:0/263481037 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7580a56f0 con 0x7fc7600b0b90 2023-06-10T19:06:56.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.854+0000 7fc75dd9b640 1 -- 172.21.15.53:0/263481037 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7580a5850 con 0x7fc7600b0b90 2023-06-10T19:06:56.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.854+0000 7fc75dd9b640 1 -- 172.21.15.53:0/263481037 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7580a5be0 con 0x7fc7600b0b90 2023-06-10T19:06:56.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.858+0000 7fc764f5e640 1 -- 172.21.15.53:0/263481037 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7600b0b90 msgr2=0x7fc7600d04d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:56.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.858+0000 7fc764f5e640 1 --2- 172.21.15.53:0/263481037 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7600b0b90 0x7fc7600d04d0 secure :-1 s=READY pgs=2281 cs=0 l=1 rev1=1 crypto rx=0x7fc7600b4c30 tx=0x7fc75801c8d0 comp rx=0 tx=0).stop 2023-06-10T19:06:56.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.858+0000 7fc764f5e640 1 -- 172.21.15.53:0/263481037 shutdown_connections 2023-06-10T19:06:56.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.858+0000 7fc764f5e640 1 --2- 172.21.15.53:0/263481037 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7600b0b90 0x7fc7600d04d0 unknown :-1 s=CLOSED pgs=2281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:56.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.858+0000 7fc764f5e640 1 --2- 172.21.15.53:0/263481037 >> v2:172.21.15.117:3300/0 conn(0x7fc7600b7e30 0x7fc7600b10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:56.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.858+0000 7fc764f5e640 1 -- 172.21.15.53:0/263481037 >> 172.21.15.53:0/263481037 conn(0x7fc760069e20 msgr2=0x7fc76006a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:56.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.858+0000 7fc764f5e640 1 -- 172.21.15.53:0/263481037 shutdown_connections 2023-06-10T19:06:56.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.858+0000 7fc764f5e640 1 -- 172.21.15.53:0/263481037 wait complete. 2023-06-10T19:06:56.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.858+0000 7fc764f5e640 1 Processor -- start 2023-06-10T19:06:56.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.858+0000 7fc764f5e640 1 -- start start 2023-06-10T19:06:56.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.858+0000 7fc764f5e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7600b0b90 0x7fc760146120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:56.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.858+0000 7fc764f5e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7600b7e30 0x7fc7600d2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:56.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.858+0000 7fc764f5e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc76015c090 0x7fc760155760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:56.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.858+0000 7fc764f5e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7600d2b40 con 0x7fc7600b0b90 2023-06-10T19:06:56.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.858+0000 7fc764f5e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7601572a0 con 0x7fc76015c090 2023-06-10T19:06:56.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.858+0000 7fc764f5e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc760145880 con 0x7fc7600b7e30 2023-06-10T19:06:56.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.858+0000 7fc75e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7600b0b90 0x7fc760146120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:56.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.858+0000 7fc75e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7600b0b90 0x7fc760146120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48906/0 (socket says 172.21.15.53:48906) 2023-06-10T19:06:56.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.858+0000 7fc75e59c640 1 -- 172.21.15.53:0/164582859 learned_addr learned my addr 172.21.15.53:0/164582859 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:56.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.858+0000 7fc75ed9d640 1 --2- 172.21.15.53:0/164582859 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc76015c090 0x7fc760155760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:56.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.858+0000 7fc755d9b640 1 --2- 172.21.15.53:0/164582859 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7600b7e30 0x7fc7600d2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:56.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.858+0000 7fc75e59c640 1 -- 172.21.15.53:0/164582859 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7600b7e30 msgr2=0x7fc7600d2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:56.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.858+0000 7fc75e59c640 1 --2- 172.21.15.53:0/164582859 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7600b7e30 0x7fc7600d2600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:56.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.858+0000 7fc75e59c640 1 -- 172.21.15.53:0/164582859 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc76015c090 msgr2=0x7fc760155760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:56.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.858+0000 7fc75e59c640 1 --2- 172.21.15.53:0/164582859 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc76015c090 0x7fc760155760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:56.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.858+0000 7fc75e59c640 1 -- 172.21.15.53:0/164582859 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc758009b30 con 0x7fc7600b0b90 2023-06-10T19:06:56.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.858+0000 7fc75ed9d640 1 --2- 172.21.15.53:0/164582859 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc76015c090 0x7fc760155760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:06:56.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.858+0000 7fc75e59c640 1 --2- 172.21.15.53:0/164582859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7600b0b90 0x7fc760146120 secure :-1 s=READY pgs=2282 cs=0 l=1 rev1=1 crypto rx=0x7fc75000b410 tx=0x7fc75000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:56.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.858+0000 7fc7577fe640 1 -- 172.21.15.53:0/164582859 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc750004020 con 0x7fc7600b0b90 2023-06-10T19:06:56.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.858+0000 7fc7577fe640 1 -- 172.21.15.53:0/164582859 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc750004180 con 0x7fc7600b0b90 2023-06-10T19:06:56.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.858+0000 7fc764f5e640 1 -- 172.21.15.53:0/164582859 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc760145b60 con 0x7fc7600b0b90 2023-06-10T19:06:56.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.858+0000 7fc7577fe640 1 -- 172.21.15.53:0/164582859 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc750011630 con 0x7fc7600b0b90 2023-06-10T19:06:56.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.858+0000 7fc764f5e640 1 -- 172.21.15.53:0/164582859 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7601574f0 con 0x7fc7600b0b90 2023-06-10T19:06:56.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.862+0000 7fc764f5e640 1 -- 172.21.15.53:0/164582859 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc760157710 con 0x7fc7600b0b90 2023-06-10T19:06:56.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.862+0000 7fc7577fe640 1 -- 172.21.15.53:0/164582859 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc750011790 con 0x7fc7600b0b90 2023-06-10T19:06:56.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.862+0000 7fc7577fe640 1 --2- 172.21.15.53:0/164582859 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc744066280 0x7fc744068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:56.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.862+0000 7fc7577fe640 1 -- 172.21.15.53:0/164582859 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6105+0+0 (secure 0 0 0) 0x7fc750083a20 con 0x7fc7600b0b90 2023-06-10T19:06:56.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.862+0000 7fc755d9b640 1 --2- 172.21.15.53:0/164582859 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc744066280 0x7fc744068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:56.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.862+0000 7fc755d9b640 1 --2- 172.21.15.53:0/164582859 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc744066280 0x7fc744068730 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fc74800a970 tx=0x7fc748008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:56.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:56.866+0000 7fc7577fe640 1 -- 172.21.15.53:0/164582859 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc750050f00 con 0x7fc7600b0b90 2023-06-10T19:06:57.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.010+0000 7fc764f5e640 1 -- 172.21.15.53:0/164582859 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc76004d790 con 0x7fc7600b0b90 2023-06-10T19:06:57.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.010+0000 7fc7577fe640 1 -- 172.21.15.53:0/164582859 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v155) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc750054520 con 0x7fc7600b0b90 2023-06-10T19:06:57.013 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-06-10T19:06:57.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.014+0000 7fc764f5e640 1 -- 172.21.15.53:0/164582859 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc744066280 msgr2=0x7fc744068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:57.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.014+0000 7fc764f5e640 1 --2- 172.21.15.53:0/164582859 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc744066280 0x7fc744068730 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fc74800a970 tx=0x7fc748008040 comp rx=0 tx=0).stop 2023-06-10T19:06:57.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.014+0000 7fc764f5e640 1 -- 172.21.15.53:0/164582859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7600b0b90 msgr2=0x7fc760146120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:57.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.014+0000 7fc764f5e640 1 --2- 172.21.15.53:0/164582859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7600b0b90 0x7fc760146120 secure :-1 s=READY pgs=2282 cs=0 l=1 rev1=1 crypto rx=0x7fc75000b410 tx=0x7fc75000b8d0 comp rx=0 tx=0).stop 2023-06-10T19:06:57.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.014+0000 7fc764f5e640 1 -- 172.21.15.53:0/164582859 shutdown_connections 2023-06-10T19:06:57.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.014+0000 7fc764f5e640 1 --2- 172.21.15.53:0/164582859 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc744066280 0x7fc744068730 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:57.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.014+0000 7fc764f5e640 1 --2- 172.21.15.53:0/164582859 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc76015c090 0x7fc760155760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:57.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.014+0000 7fc764f5e640 1 --2- 172.21.15.53:0/164582859 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc7600b7e30 0x7fc7600d2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:57.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.014+0000 7fc764f5e640 1 --2- 172.21.15.53:0/164582859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7600b0b90 0x7fc760146120 unknown :-1 s=CLOSED pgs=2282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:57.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.014+0000 7fc764f5e640 1 -- 172.21.15.53:0/164582859 >> 172.21.15.53:0/164582859 conn(0x7fc760069e20 msgr2=0x7fc7600b4f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:57.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.014+0000 7fc764f5e640 1 -- 172.21.15.53:0/164582859 shutdown_connections 2023-06-10T19:06:57.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.014+0000 7fc764f5e640 1 -- 172.21.15.53:0/164582859 wait complete. 2023-06-10T19:06:57.031 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-10T19:06:57.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.142+0000 7fadf38dd640 1 Processor -- start 2023-06-10T19:06:57.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.142+0000 7fadf38dd640 1 -- start start 2023-06-10T19:06:57.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.146+0000 7fadf38dd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fadec1571a0 0x7fadec0c9f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:57.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.146+0000 7fadf38dd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fadec0afee0 0x7fadec0c83f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:57.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.146+0000 7fadf38dd640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadec071190 con 0x7fadec070100 2023-06-10T19:06:57.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.146+0000 7fadf38dd640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadec0ca440 con 0x7fadec1571a0 2023-06-10T19:06:57.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.146+0000 7fadf38dd640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadec070580 con 0x7fadec0afee0 2023-06-10T19:06:57.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.146+0000 7fadf1e7a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fadec0afee0 0x7fadec0c83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:57.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.146+0000 7fadf1679640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fadec1571a0 0x7fadec0c9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:57.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.146+0000 7fadf1e7a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fadec0afee0 0x7fadec0c83f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.53:52722/0 (socket says 172.21.15.53:52722) 2023-06-10T19:06:57.148 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.146+0000 7fadf1e7a640 1 -- 172.21.15.53:0/468669234 learned_addr learned my addr 172.21.15.53:0/468669234 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:57.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.146+0000 7fadf1e7a640 1 -- 172.21.15.53:0/468669234 >> v2:172.21.15.117:3300/0 conn(0x7fadec1571a0 msgr2=0x7fadec0c9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:57.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.146+0000 7fadf1e7a640 1 --2- 172.21.15.53:0/468669234 >> v2:172.21.15.117:3300/0 conn(0x7fadec1571a0 0x7fadec0c9f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:57.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.146+0000 7fadf1e7a640 1 -- 172.21.15.53:0/468669234 >> v1:172.21.15.117:6789/0 conn(0x7fadec070100 legacy=0x7fadec0af7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:57.149 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.146+0000 7fadf1e7a640 1 -- 172.21.15.53:0/468669234 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadec070860 con 0x7fadec0afee0 2023-06-10T19:06:57.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.150+0000 7fadf1e7a640 1 --2- 172.21.15.53:0/468669234 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fadec0afee0 0x7fadec0c83f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fade4009870 tx=0x7fade401c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=76e6ab89e876f619 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:57.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.150+0000 7faddffff640 1 -- 172.21.15.53:0/468669234 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade40aa670 con 0x7fadec0afee0 2023-06-10T19:06:57.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.150+0000 7faddffff640 1 -- 172.21.15.53:0/468669234 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fade40aa7d0 con 0x7fadec0afee0 2023-06-10T19:06:57.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.150+0000 7faddffff640 1 -- 172.21.15.53:0/468669234 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade40aab60 con 0x7fadec0afee0 2023-06-10T19:06:57.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.150+0000 7fadf38dd640 1 -- 172.21.15.53:0/468669234 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fadec0afee0 msgr2=0x7fadec0c83f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:57.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.150+0000 7fadf38dd640 1 --2- 172.21.15.53:0/468669234 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fadec0afee0 0x7fadec0c83f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fade4009870 tx=0x7fade401c510 comp rx=0 tx=0).stop 2023-06-10T19:06:57.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.150+0000 7fadf38dd640 1 -- 172.21.15.53:0/468669234 shutdown_connections 2023-06-10T19:06:57.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.150+0000 7fadf38dd640 1 --2- 172.21.15.53:0/468669234 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fadec0afee0 0x7fadec0c83f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:57.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.150+0000 7fadf38dd640 1 --2- 172.21.15.53:0/468669234 >> v2:172.21.15.117:3300/0 conn(0x7fadec1571a0 0x7fadec0c9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:57.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.150+0000 7fadf38dd640 1 -- 172.21.15.53:0/468669234 >> 172.21.15.53:0/468669234 conn(0x7fadec0ce9e0 msgr2=0x7fadec0ca7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:57.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.150+0000 7fadf38dd640 1 -- 172.21.15.53:0/468669234 shutdown_connections 2023-06-10T19:06:57.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.150+0000 7fadf38dd640 1 -- 172.21.15.53:0/468669234 wait complete. 2023-06-10T19:06:57.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.150+0000 7fadf38dd640 1 Processor -- start 2023-06-10T19:06:57.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.150+0000 7fadf38dd640 1 -- start start 2023-06-10T19:06:57.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.150+0000 7fadf38dd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fadec0afee0 0x7fadec0b1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:57.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.150+0000 7fadf38dd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fadec1571a0 0x7fadec155b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:57.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.150+0000 7fadf38dd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fadec154f10 0x7fadec148d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:57.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.150+0000 7fadf38dd640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadec0b1960 con 0x7fadec154f10 2023-06-10T19:06:57.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.150+0000 7fadf38dd640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadec06a8b0 con 0x7fadec1571a0 2023-06-10T19:06:57.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.150+0000 7fadf38dd640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadec06ab00 con 0x7fadec0afee0 2023-06-10T19:06:57.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.150+0000 7fadf1e7a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fadec154f10 0x7fadec148d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:57.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.150+0000 7fadf1e7a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fadec154f10 0x7fadec148d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48910/0 (socket says 172.21.15.53:48910) 2023-06-10T19:06:57.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.154+0000 7fadf1e7a640 1 -- 172.21.15.53:0/2251118593 learned_addr learned my addr 172.21.15.53:0/2251118593 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:57.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.154+0000 7fadf1679640 1 --2- 172.21.15.53:0/2251118593 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fadec0afee0 0x7fadec0b1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:57.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.154+0000 7fadf0e78640 1 --2- 172.21.15.53:0/2251118593 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fadec1571a0 0x7fadec155b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:57.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.154+0000 7fadf1e7a640 1 -- 172.21.15.53:0/2251118593 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fadec0afee0 msgr2=0x7fadec0b1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:57.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.154+0000 7fadf1e7a640 1 --2- 172.21.15.53:0/2251118593 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fadec0afee0 0x7fadec0b1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:57.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.154+0000 7fadf1e7a640 1 -- 172.21.15.53:0/2251118593 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fadec1571a0 msgr2=0x7fadec155b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:57.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.154+0000 7fadf1e7a640 1 --2- 172.21.15.53:0/2251118593 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fadec1571a0 0x7fadec155b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:57.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.154+0000 7fadf1e7a640 1 -- 172.21.15.53:0/2251118593 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fade40094d0 con 0x7fadec154f10 2023-06-10T19:06:57.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.154+0000 7fadf1679640 1 --2- 172.21.15.53:0/2251118593 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fadec0afee0 0x7fadec0b1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:06:57.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.154+0000 7fadf1e7a640 1 --2- 172.21.15.53:0/2251118593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fadec154f10 0x7fadec148d70 secure :-1 s=READY pgs=2283 cs=0 l=1 rev1=1 crypto rx=0x7fade40ac040 tx=0x7fade401ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:57.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.154+0000 7fadddffb640 1 -- 172.21.15.53:0/2251118593 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade40bd5f0 con 0x7fadec154f10 2023-06-10T19:06:57.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.154+0000 7fadddffb640 1 -- 172.21.15.53:0/2251118593 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fade40bd770 con 0x7fadec154f10 2023-06-10T19:06:57.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.154+0000 7fadf38dd640 1 -- 172.21.15.53:0/2251118593 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadec06ade0 con 0x7fadec154f10 2023-06-10T19:06:57.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.154+0000 7fadddffb640 1 -- 172.21.15.53:0/2251118593 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade40bdb20 con 0x7fadec154f10 2023-06-10T19:06:57.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.154+0000 7fadf38dd640 1 -- 172.21.15.53:0/2251118593 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadec06b3a0 con 0x7fadec154f10 2023-06-10T19:06:57.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.154+0000 7fadf38dd640 1 -- 172.21.15.53:0/2251118593 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadec04d790 con 0x7fadec154f10 2023-06-10T19:06:57.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.154+0000 7fadddffb640 1 -- 172.21.15.53:0/2251118593 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fade40b33f0 con 0x7fadec154f10 2023-06-10T19:06:57.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.154+0000 7fadddffb640 1 --2- 172.21.15.53:0/2251118593 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fadd0066280 0x7fadd0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:57.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.154+0000 7fadddffb640 1 -- 172.21.15.53:0/2251118593 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6105+0+0 (secure 0 0 0) 0x7fade411ec30 con 0x7fadec154f10 2023-06-10T19:06:57.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.154+0000 7fadf1679640 1 --2- 172.21.15.53:0/2251118593 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fadd0066280 0x7fadd0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:57.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.154+0000 7fadf1679640 1 --2- 172.21.15.53:0/2251118593 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fadd0066280 0x7fadd0068730 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fade0009af0 tx=0x7fade0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:57.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.158+0000 7fadddffb640 1 -- 172.21.15.53:0/2251118593 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fade40ec140 con 0x7fadec154f10 2023-06-10T19:06:57.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.322+0000 7fadf38dd640 1 -- 172.21.15.53:0/2251118593 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fadec1643d0 con 0x7fadec154f10 2023-06-10T19:06:57.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.322+0000 7fadddffb640 1 -- 172.21.15.53:0/2251118593 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 1 entries v155) v1 ==== 80+0+57 (secure 0 0 0) 0x7fade40ef760 con 0x7fadec154f10 2023-06-10T19:06:57.323 INFO:teuthology.orchestra.run.smithi053.stdout:192.168.0.1:0/2213488734 2023-06-10T20:06:49.780814+0000 2023-06-10T19:06:57.324 INFO:teuthology.orchestra.run.smithi053.stderr:listed 1 entries 2023-06-10T19:06:57.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.322+0000 7fadf38dd640 1 -- 172.21.15.53:0/2251118593 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fadd0066280 msgr2=0x7fadd0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:57.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.322+0000 7fadf38dd640 1 --2- 172.21.15.53:0/2251118593 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fadd0066280 0x7fadd0068730 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fade0009af0 tx=0x7fade0008040 comp rx=0 tx=0).stop 2023-06-10T19:06:57.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.322+0000 7fadf38dd640 1 -- 172.21.15.53:0/2251118593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fadec154f10 msgr2=0x7fadec148d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:57.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.322+0000 7fadf38dd640 1 --2- 172.21.15.53:0/2251118593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fadec154f10 0x7fadec148d70 secure :-1 s=READY pgs=2283 cs=0 l=1 rev1=1 crypto rx=0x7fade40ac040 tx=0x7fade401ad50 comp rx=0 tx=0).stop 2023-06-10T19:06:57.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.322+0000 7fadf38dd640 1 -- 172.21.15.53:0/2251118593 shutdown_connections 2023-06-10T19:06:57.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.322+0000 7fadf38dd640 1 --2- 172.21.15.53:0/2251118593 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fadd0066280 0x7fadd0068730 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:57.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.322+0000 7fadf38dd640 1 --2- 172.21.15.53:0/2251118593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fadec154f10 0x7fadec148d70 unknown :-1 s=CLOSED pgs=2283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:57.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.322+0000 7fadf38dd640 1 --2- 172.21.15.53:0/2251118593 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fadec1571a0 0x7fadec155b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:57.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.322+0000 7fadf38dd640 1 --2- 172.21.15.53:0/2251118593 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fadec0afee0 0x7fadec0b1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:57.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.322+0000 7fadf38dd640 1 -- 172.21.15.53:0/2251118593 >> 172.21.15.53:0/2251118593 conn(0x7fadec0ce9e0 msgr2=0x7fadec158de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:57.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.322+0000 7fadf38dd640 1 -- 172.21.15.53:0/2251118593 shutdown_connections 2023-06-10T19:06:57.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.322+0000 7fadf38dd640 1 -- 172.21.15.53:0/2251118593 wait complete. 2023-06-10T19:06:57.340 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi053.front.sepia.ceph.com... 2023-06-10T19:06:57.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:06:57.341 DEBUG:teuthology.orchestra.run.smithi053:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-06-10T19:06:57.352 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[66884]: fuse finished with error 0 and tester_r 0 2023-06-10T19:06:57.353 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi053.front.sepia.ceph.com 2023-06-10T19:06:57.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:06:57.354 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-06-10T19:06:57.483 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T19:06:57.484 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:06:57.491 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:06:57.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.614+0000 7fe6658b2640 1 Processor -- start 2023-06-10T19:06:57.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.614+0000 7fe6658b2640 1 -- start start 2023-06-10T19:06:57.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.618+0000 7fe6658b2640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe660157e10 0x7fe66006efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:57.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.618+0000 7fe6658b2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe66006bb30 0x7fe6600ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:57.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.618+0000 7fe6658b2640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6600c9e50 con 0x7fe6600af720 2023-06-10T19:06:57.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.618+0000 7fe6658b2640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6600cd520 con 0x7fe660157e10 2023-06-10T19:06:57.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.618+0000 7fe6658b2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6600c82f0 con 0x7fe66006bb30 2023-06-10T19:06:57.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.618+0000 7fe65f7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fe6600af720 0x7fe66015bc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:47768/0 (socket says 172.21.15.53:47768) 2023-06-10T19:06:57.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.618+0000 7fe65f7fe640 1 -- 172.21.15.53:0/559391157 learned_addr learned my addr 172.21.15.53:0/559391157 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:06:57.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.618+0000 7fe65effd640 1 --2- 172.21.15.53:0/559391157 >> v2:172.21.15.117:3300/0 conn(0x7fe660157e10 0x7fe66006efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:57.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.618+0000 7fe657fff640 1 --2- 172.21.15.53:0/559391157 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe66006bb30 0x7fe6600ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:57.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.618+0000 7fe65e7fc640 1 -- 172.21.15.53:0/559391157 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1690225208 0 0) 0x7fe6600c9e50 con 0x7fe6600af720 2023-06-10T19:06:57.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.618+0000 7fe65e7fc640 1 -- 172.21.15.53:0/559391157 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe64c003530 con 0x7fe6600af720 2023-06-10T19:06:57.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.618+0000 7fe65e7fc640 1 -- 172.21.15.53:0/559391157 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3820491968 0 0) 0x7fe64c003530 con 0x7fe6600af720 2023-06-10T19:06:57.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.618+0000 7fe65e7fc640 1 -- 172.21.15.53:0/559391157 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe66006bb30 msgr2=0x7fe6600ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:57.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.618+0000 7fe65e7fc640 1 --2- 172.21.15.53:0/559391157 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe66006bb30 0x7fe6600ccfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:57.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.618+0000 7fe65e7fc640 1 -- 172.21.15.53:0/559391157 >> v2:172.21.15.117:3300/0 conn(0x7fe660157e10 msgr2=0x7fe66006efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:57.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.618+0000 7fe65e7fc640 1 --2- 172.21.15.53:0/559391157 >> v2:172.21.15.117:3300/0 conn(0x7fe660157e10 0x7fe66006efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:57.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.618+0000 7fe65e7fc640 1 -- 172.21.15.53:0/559391157 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe66006bf80 con 0x7fe6600af720 2023-06-10T19:06:57.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.618+0000 7fe65e7fc640 1 -- 172.21.15.53:0/559391157 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fe658001a00 con 0x7fe6600af720 2023-06-10T19:06:57.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.618+0000 7fe65e7fc640 1 -- 172.21.15.53:0/559391157 >> v1:172.21.15.53:6789/0 conn(0x7fe6600af720 legacy=0x7fe66015bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:57.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.618+0000 7fe65e7fc640 1 --2- 172.21.15.53:0/559391157 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe64c0039f0 0x7fe64c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:57.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.618+0000 7fe65e7fc640 1 --2- 172.21.15.53:0/559391157 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe66006bb30 0x7fe64c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:57.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.618+0000 7fe65e7fc640 1 --2- 172.21.15.53:0/559391157 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe64c004d10 0x7fe64c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:57.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.618+0000 7fe65e7fc640 1 -- 172.21.15.53:0/559391157 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6600cd520 con 0x7fe64c0039f0 2023-06-10T19:06:57.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.618+0000 7fe65e7fc640 1 -- 172.21.15.53:0/559391157 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6600c82f0 con 0x7fe64c004d10 2023-06-10T19:06:57.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.618+0000 7fe65e7fc640 1 -- 172.21.15.53:0/559391157 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe64c00b9e0 con 0x7fe66006bb30 2023-06-10T19:06:57.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.618+0000 7fe65effd640 1 --2- 172.21.15.53:0/559391157 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe64c0039f0 0x7fe64c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:57.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.618+0000 7fe657fff640 1 --2- 172.21.15.53:0/559391157 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe66006bb30 0x7fe64c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:57.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.618+0000 7fe65f7fe640 1 --2- 172.21.15.53:0/559391157 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe64c004d10 0x7fe64c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:57.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.618+0000 7fe65effd640 1 -- 172.21.15.53:0/559391157 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe66006bb30 msgr2=0x7fe64c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:57.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.618+0000 7fe65effd640 1 --2- 172.21.15.53:0/559391157 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe66006bb30 0x7fe64c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:57.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.618+0000 7fe65effd640 1 -- 172.21.15.53:0/559391157 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe64c004d10 msgr2=0x7fe64c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:57.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.618+0000 7fe65effd640 1 --2- 172.21.15.53:0/559391157 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe64c004d10 0x7fe64c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:57.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.618+0000 7fe65effd640 1 -- 172.21.15.53:0/559391157 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe64c003530 con 0x7fe64c0039f0 2023-06-10T19:06:57.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.622+0000 7fe65effd640 1 --2- 172.21.15.53:0/559391157 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe64c0039f0 0x7fe64c003e00 secure :-1 s=READY pgs=2285 cs=0 l=1 rev1=1 crypto rx=0x7fe650009b10 tx=0x7fe65001de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=876939187ca46106 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:57.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.622+0000 7fe65e7fc640 1 -- 172.21.15.53:0/559391157 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6500a6d30 con 0x7fe64c0039f0 2023-06-10T19:06:57.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.622+0000 7fe65e7fc640 1 -- 172.21.15.53:0/559391157 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6500aa070 con 0x7fe64c0039f0 2023-06-10T19:06:57.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.622+0000 7fe65e7fc640 1 -- 172.21.15.53:0/559391157 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6500b0640 con 0x7fe64c0039f0 2023-06-10T19:06:57.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.622+0000 7fe6658b2640 1 -- 172.21.15.53:0/559391157 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe64c0039f0 msgr2=0x7fe64c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:57.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.622+0000 7fe6658b2640 1 --2- 172.21.15.53:0/559391157 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe64c0039f0 0x7fe64c003e00 secure :-1 s=READY pgs=2285 cs=0 l=1 rev1=1 crypto rx=0x7fe650009b10 tx=0x7fe65001de40 comp rx=0 tx=0).stop 2023-06-10T19:06:57.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.622+0000 7fe65f7fe640 1 -- 172.21.15.53:0/559391157 reap_dead start 2023-06-10T19:06:57.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.622+0000 7fe6658b2640 1 -- 172.21.15.53:0/559391157 shutdown_connections 2023-06-10T19:06:57.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.622+0000 7fe6658b2640 1 -- 172.21.15.53:0/559391157 >> 172.21.15.53:0/559391157 conn(0x7fe66006a0d0 msgr2=0x7fe6600ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:57.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.622+0000 7fe6658b2640 1 -- 172.21.15.53:0/559391157 shutdown_connections 2023-06-10T19:06:57.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.622+0000 7fe6658b2640 1 -- 172.21.15.53:0/559391157 wait complete. 2023-06-10T19:06:57.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.622+0000 7fe6658b2640 1 Processor -- start 2023-06-10T19:06:57.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.622+0000 7fe6658b2640 1 -- start start 2023-06-10T19:06:57.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.622+0000 7fe6658b2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe64c0039f0 0x7fe6600c21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:57.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.622+0000 7fe6658b2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6600ad080 0x7fe660070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:57.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.622+0000 7fe6658b2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe66014e680 0x7fe6600709c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:57.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.622+0000 7fe6658b2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6600c2720 con 0x7fe66014e680 2023-06-10T19:06:57.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.622+0000 7fe6658b2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe660152bd0 con 0x7fe64c0039f0 2023-06-10T19:06:57.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.622+0000 7fe6658b2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe660152eb0 con 0x7fe6600ad080 2023-06-10T19:06:57.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.622+0000 7fe65f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe66014e680 0x7fe6600709c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:57.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.622+0000 7fe65f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe66014e680 0x7fe6600709c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48938/0 (socket says 172.21.15.53:48938) 2023-06-10T19:06:57.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.622+0000 7fe65f7fe640 1 -- 172.21.15.53:0/3473747050 learned_addr learned my addr 172.21.15.53:0/3473747050 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:57.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.622+0000 7fe657fff640 1 --2- 172.21.15.53:0/3473747050 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6600ad080 0x7fe660070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:57.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.622+0000 7fe65effd640 1 --2- 172.21.15.53:0/3473747050 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe64c0039f0 0x7fe6600c21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:57.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.626+0000 7fe65f7fe640 1 -- 172.21.15.53:0/3473747050 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6600ad080 msgr2=0x7fe660070480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:57.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.626+0000 7fe65f7fe640 1 --2- 172.21.15.53:0/3473747050 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6600ad080 0x7fe660070480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:57.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.626+0000 7fe65f7fe640 1 -- 172.21.15.53:0/3473747050 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe64c0039f0 msgr2=0x7fe6600c21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:57.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.626+0000 7fe65f7fe640 1 --2- 172.21.15.53:0/3473747050 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe64c0039f0 0x7fe6600c21e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:57.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.626+0000 7fe65f7fe640 1 -- 172.21.15.53:0/3473747050 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe660153190 con 0x7fe66014e680 2023-06-10T19:06:57.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.626+0000 7fe65f7fe640 1 --2- 172.21.15.53:0/3473747050 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe66014e680 0x7fe6600709c0 secure :-1 s=READY pgs=2286 cs=0 l=1 rev1=1 crypto rx=0x7fe66006e510 tx=0x7fe658007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:57.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.626+0000 7fe65cff9640 1 -- 172.21.15.53:0/3473747050 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6580114f0 con 0x7fe66014e680 2023-06-10T19:06:57.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.626+0000 7fe65cff9640 1 -- 172.21.15.53:0/3473747050 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe658011670 con 0x7fe66014e680 2023-06-10T19:06:57.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.626+0000 7fe65cff9640 1 -- 172.21.15.53:0/3473747050 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe658011a20 con 0x7fe66014e680 2023-06-10T19:06:57.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.626+0000 7fe6658b2640 1 -- 172.21.15.53:0/3473747050 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe660153470 con 0x7fe66014e680 2023-06-10T19:06:57.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.626+0000 7fe6658b2640 1 -- 172.21.15.53:0/3473747050 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe660153c70 con 0x7fe66014e680 2023-06-10T19:06:57.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.626+0000 7fe6658b2640 1 -- 172.21.15.53:0/3473747050 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe66004d790 con 0x7fe66014e680 2023-06-10T19:06:57.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.626+0000 7fe65cff9640 1 -- 172.21.15.53:0/3473747050 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe658011b80 con 0x7fe66014e680 2023-06-10T19:06:57.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.626+0000 7fe65cff9640 1 --2- 172.21.15.53:0/3473747050 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe6400662b0 0x7fe640068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:57.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.626+0000 7fe65cff9640 1 -- 172.21.15.53:0/3473747050 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6105+0+0 (secure 0 0 0) 0x7fe658083540 con 0x7fe66014e680 2023-06-10T19:06:57.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.626+0000 7fe65effd640 1 --2- 172.21.15.53:0/3473747050 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe6400662b0 0x7fe640068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:57.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.626+0000 7fe65effd640 1 --2- 172.21.15.53:0/3473747050 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe6400662b0 0x7fe640068760 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fe6500b1000 tx=0x7fe650004740 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:57.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.630+0000 7fe65cff9640 1 -- 172.21.15.53:0/3473747050 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe658050990 con 0x7fe66014e680 2023-06-10T19:06:57.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.786+0000 7fe6658b2640 1 -- 172.21.15.53:0/3473747050 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe6600c1fc0 con 0x7fe66014e680 2023-06-10T19:06:57.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.786+0000 7fe65cff9640 1 -- 172.21.15.53:0/3473747050 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v155) v1 ==== 74+0+18349 (secure 0 0 0) 0x7fe658053fb0 con 0x7fe66014e680 2023-06-10T19:06:57.791 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:06:57.791 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":155,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:06:50.154677+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-06-10T19:06:27.279397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-06-10T19:06:27.689260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"154","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.0.1:0/2213488734":"2023-06-10T20:06:49.780814+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:06:57.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.790+0000 7fe6658b2640 1 -- 172.21.15.53:0/3473747050 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe6400662b0 msgr2=0x7fe640068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:57.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.790+0000 7fe6658b2640 1 --2- 172.21.15.53:0/3473747050 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe6400662b0 0x7fe640068760 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fe6500b1000 tx=0x7fe650004740 comp rx=0 tx=0).stop 2023-06-10T19:06:57.793 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.790+0000 7fe6658b2640 1 -- 172.21.15.53:0/3473747050 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe66014e680 msgr2=0x7fe6600709c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:57.793 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.790+0000 7fe6658b2640 1 --2- 172.21.15.53:0/3473747050 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe66014e680 0x7fe6600709c0 secure :-1 s=READY pgs=2286 cs=0 l=1 rev1=1 crypto rx=0x7fe66006e510 tx=0x7fe658007700 comp rx=0 tx=0).stop 2023-06-10T19:06:57.793 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.790+0000 7fe6658b2640 1 -- 172.21.15.53:0/3473747050 shutdown_connections 2023-06-10T19:06:57.793 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.790+0000 7fe6658b2640 1 --2- 172.21.15.53:0/3473747050 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe6400662b0 0x7fe640068760 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:57.793 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.790+0000 7fe6658b2640 1 --2- 172.21.15.53:0/3473747050 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe66014e680 0x7fe6600709c0 unknown :-1 s=CLOSED pgs=2286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:57.793 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.790+0000 7fe6658b2640 1 --2- 172.21.15.53:0/3473747050 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe6600ad080 0x7fe660070480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:57.793 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.790+0000 7fe6658b2640 1 --2- 172.21.15.53:0/3473747050 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe64c0039f0 0x7fe6600c21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:57.794 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.790+0000 7fe6658b2640 1 -- 172.21.15.53:0/3473747050 >> 172.21.15.53:0/3473747050 conn(0x7fe66006a0d0 msgr2=0x7fe6600cc460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:57.794 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.790+0000 7fe6658b2640 1 -- 172.21.15.53:0/3473747050 shutdown_connections 2023-06-10T19:06:57.794 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.790+0000 7fe6658b2640 1 -- 172.21.15.53:0/3473747050 wait complete. 2023-06-10T19:06:57.810 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-10T18:52:33.633114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-10T18:52:39.171487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 21, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-10T19:06:27.279397+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '153', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 22, 'pool_name': 'cephfs_data', 'create_time': '2023-06-10T19:06:27.689260+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '154', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-10T19:06:57.812 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-10T19:06:57.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.934+0000 7f8ec8c5c640 1 Processor -- start 2023-06-10T19:06:57.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.934+0000 7f8ec8c5c640 1 -- start start 2023-06-10T19:06:57.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.934+0000 7f8ec8c5c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8ec4159690 0x7f8ec4070950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:57.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.934+0000 7f8ec8c5c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ec4159a60 0x7f8ec40c2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:57.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.934+0000 7f8ec8c5c640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ec40cb080 con 0x7f8ec40b0f30 2023-06-10T19:06:57.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.934+0000 7f8ec8c5c640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ec4070e90 con 0x7f8ec4159690 2023-06-10T19:06:57.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.934+0000 7f8ec8c5c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec406d450 con 0x7f8ec4159a60 2023-06-10T19:06:57.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.934+0000 7f8ec1d9b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f8ec40b0f30 0x7f8ec40cbe00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:47780/0 (socket says 172.21.15.53:47780) 2023-06-10T19:06:57.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.934+0000 7f8ec1d9b640 1 -- 172.21.15.53:0/549800091 learned_addr learned my addr 172.21.15.53:0/549800091 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:06:57.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.934+0000 7f8ec259c640 1 --2- 172.21.15.53:0/549800091 >> v2:172.21.15.53:3300/0 conn(0x7f8ec4159690 0x7f8ec4070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:57.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.934+0000 7f8ec2d9d640 1 --2- 172.21.15.53:0/549800091 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ec4159a60 0x7f8ec40c2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:57.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.934+0000 7f8ec159a640 1 -- 172.21.15.53:0/549800091 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4076585308 0 0) 0x7f8ec40cb080 con 0x7f8ec40b0f30 2023-06-10T19:06:57.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.934+0000 7f8ec159a640 1 -- 172.21.15.53:0/549800091 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8eac003530 con 0x7f8ec40b0f30 2023-06-10T19:06:57.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.934+0000 7f8ec259c640 1 -- 172.21.15.53:0/549800091 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ec4159a60 msgr2=0x7f8ec40c2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:57.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.934+0000 7f8ec259c640 1 --2- 172.21.15.53:0/549800091 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ec4159a60 0x7f8ec40c2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:57.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.934+0000 7f8ec259c640 1 -- 172.21.15.53:0/549800091 >> v1:172.21.15.53:6789/0 conn(0x7f8ec40b0f30 legacy=0x7f8ec40cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:57.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.934+0000 7f8ec259c640 1 -- 172.21.15.53:0/549800091 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ec40cb320 con 0x7f8ec4159690 2023-06-10T19:06:57.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.938+0000 7f8ec259c640 1 --2- 172.21.15.53:0/549800091 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ec4159690 0x7f8ec4070950 secure :-1 s=READY pgs=2288 cs=0 l=1 rev1=1 crypto rx=0x7f8eb40097c0 tx=0x7f8eb401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f21c3a446e1233b server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:57.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.938+0000 7f8ec159a640 1 -- 172.21.15.53:0/549800091 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb40ad660 con 0x7f8ec4159690 2023-06-10T19:06:57.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.938+0000 7f8ec159a640 1 -- 172.21.15.53:0/549800091 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eb40ad7c0 con 0x7f8ec4159690 2023-06-10T19:06:57.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.938+0000 7f8ec159a640 1 -- 172.21.15.53:0/549800091 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb40adb50 con 0x7f8ec4159690 2023-06-10T19:06:57.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.938+0000 7f8ec8c5c640 1 -- 172.21.15.53:0/549800091 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ec4159690 msgr2=0x7f8ec4070950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:57.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.938+0000 7f8ec8c5c640 1 --2- 172.21.15.53:0/549800091 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ec4159690 0x7f8ec4070950 secure :-1 s=READY pgs=2288 cs=0 l=1 rev1=1 crypto rx=0x7f8eb40097c0 tx=0x7f8eb401c450 comp rx=0 tx=0).stop 2023-06-10T19:06:57.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.938+0000 7f8ec8c5c640 1 -- 172.21.15.53:0/549800091 shutdown_connections 2023-06-10T19:06:57.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.938+0000 7f8ec8c5c640 1 --2- 172.21.15.53:0/549800091 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ec4159a60 0x7f8ec40c2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:57.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.938+0000 7f8ec8c5c640 1 --2- 172.21.15.53:0/549800091 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ec4159690 0x7f8ec4070950 unknown :-1 s=CLOSED pgs=2288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:57.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.938+0000 7f8ec8c5c640 1 -- 172.21.15.53:0/549800091 >> 172.21.15.53:0/549800091 conn(0x7f8ec406a560 msgr2=0x7f8ec406a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:57.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.938+0000 7f8ec8c5c640 1 -- 172.21.15.53:0/549800091 shutdown_connections 2023-06-10T19:06:57.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.938+0000 7f8ec8c5c640 1 -- 172.21.15.53:0/549800091 wait complete. 2023-06-10T19:06:57.944 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.938+0000 7f8ec8c5c640 1 Processor -- start 2023-06-10T19:06:57.944 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.938+0000 7f8ec8c5c640 1 -- start start 2023-06-10T19:06:57.944 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.938+0000 7f8ec8c5c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ec40b0f30 0x7f8ec414f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:57.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.938+0000 7f8ec8c5c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ec4159690 0x7f8ec40c5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:57.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.938+0000 7f8ec8c5c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ec4159a60 0x7f8ec414e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:57.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.938+0000 7f8ec8c5c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec4146340 con 0x7f8ec40b0f30 2023-06-10T19:06:57.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.938+0000 7f8ec8c5c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec4156b20 con 0x7f8ec4159a60 2023-06-10T19:06:57.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.938+0000 7f8ec8c5c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec414f370 con 0x7f8ec4159690 2023-06-10T19:06:57.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.938+0000 7f8ec259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ec40b0f30 0x7f8ec414f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:57.946 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.938+0000 7f8ec259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ec40b0f30 0x7f8ec414f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48958/0 (socket says 172.21.15.53:48958) 2023-06-10T19:06:57.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.938+0000 7f8ec259c640 1 -- 172.21.15.53:0/3513492890 learned_addr learned my addr 172.21.15.53:0/3513492890 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:57.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.938+0000 7f8ec1d9b640 1 --2- 172.21.15.53:0/3513492890 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ec4159690 0x7f8ec40c5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:57.947 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.938+0000 7f8ec2d9d640 1 --2- 172.21.15.53:0/3513492890 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ec4159a60 0x7f8ec414e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:57.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.938+0000 7f8ec259c640 1 -- 172.21.15.53:0/3513492890 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ec4159690 msgr2=0x7f8ec40c5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:57.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.938+0000 7f8ec259c640 1 --2- 172.21.15.53:0/3513492890 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ec4159690 0x7f8ec40c5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:57.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.938+0000 7f8ec259c640 1 -- 172.21.15.53:0/3513492890 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ec4159a60 msgr2=0x7f8ec414e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:57.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.938+0000 7f8ec259c640 1 --2- 172.21.15.53:0/3513492890 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ec4159a60 0x7f8ec414e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:57.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.938+0000 7f8ec259c640 1 -- 172.21.15.53:0/3513492890 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eb4009420 con 0x7f8ec40b0f30 2023-06-10T19:06:57.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.938+0000 7f8ec2d9d640 1 --2- 172.21.15.53:0/3513492890 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ec4159a60 0x7f8ec414e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:06:57.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.938+0000 7f8ec1d9b640 1 --2- 172.21.15.53:0/3513492890 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ec4159690 0x7f8ec40c5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:06:57.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.942+0000 7f8ec259c640 1 --2- 172.21.15.53:0/3513492890 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ec40b0f30 0x7f8ec414f760 secure :-1 s=READY pgs=2289 cs=0 l=1 rev1=1 crypto rx=0x7f8eb40b0040 tx=0x7f8eb401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:57.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.942+0000 7f8eb2ffd640 1 -- 172.21.15.53:0/3513492890 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb40b9650 con 0x7f8ec40b0f30 2023-06-10T19:06:57.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.942+0000 7f8eb2ffd640 1 -- 172.21.15.53:0/3513492890 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eb40b97f0 con 0x7f8ec40b0f30 2023-06-10T19:06:57.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.942+0000 7f8eb2ffd640 1 -- 172.21.15.53:0/3513492890 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb40b9ba0 con 0x7f8ec40b0f30 2023-06-10T19:06:57.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.942+0000 7f8ec8c5c640 1 -- 172.21.15.53:0/3513492890 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ec414f090 con 0x7f8ec40b0f30 2023-06-10T19:06:57.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.942+0000 7f8ec8c5c640 1 -- 172.21.15.53:0/3513492890 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ec4157010 con 0x7f8ec40b0f30 2023-06-10T19:06:57.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.942+0000 7f8ec8c5c640 1 -- 172.21.15.53:0/3513492890 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ec40b4dc0 con 0x7f8ec40b0f30 2023-06-10T19:06:57.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.942+0000 7f8eb2ffd640 1 -- 172.21.15.53:0/3513492890 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8eb40b9d00 con 0x7f8ec40b0f30 2023-06-10T19:06:57.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.942+0000 7f8eb2ffd640 1 --2- 172.21.15.53:0/3513492890 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8ea4066280 0x7f8ea4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:57.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.942+0000 7f8eb2ffd640 1 -- 172.21.15.53:0/3513492890 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6105+0+0 (secure 0 0 0) 0x7f8eb411e8b0 con 0x7f8ec40b0f30 2023-06-10T19:06:57.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.942+0000 7f8ec1d9b640 1 --2- 172.21.15.53:0/3513492890 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8ea4066280 0x7f8ea4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:57.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.942+0000 7f8ec1d9b640 1 --2- 172.21.15.53:0/3513492890 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8ea4066280 0x7f8ea4068730 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f8ec4150120 tx=0x7f8eb8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:57.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:57.946+0000 7f8eb2ffd640 1 -- 172.21.15.53:0/3513492890 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8eb40ebd90 con 0x7f8ec40b0f30 2023-06-10T19:06:58.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.102+0000 7f8ec8c5c640 1 -- 172.21.15.53:0/3513492890 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8ec404d790 con 0x7f8ec40b0f30 2023-06-10T19:06:58.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.102+0000 7f8eb2ffd640 1 -- 172.21.15.53:0/3513492890 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v155) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8eb40ef3b0 con 0x7f8ec40b0f30 2023-06-10T19:06:58.103 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-06-10T19:06:58.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.102+0000 7f8ec8c5c640 1 -- 172.21.15.53:0/3513492890 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8ea4066280 msgr2=0x7f8ea4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:58.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.102+0000 7f8ec8c5c640 1 --2- 172.21.15.53:0/3513492890 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8ea4066280 0x7f8ea4068730 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f8ec4150120 tx=0x7f8eb8009040 comp rx=0 tx=0).stop 2023-06-10T19:06:58.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.102+0000 7f8ec8c5c640 1 -- 172.21.15.53:0/3513492890 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ec40b0f30 msgr2=0x7f8ec414f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:58.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.102+0000 7f8ec8c5c640 1 --2- 172.21.15.53:0/3513492890 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ec40b0f30 0x7f8ec414f760 secure :-1 s=READY pgs=2289 cs=0 l=1 rev1=1 crypto rx=0x7f8eb40b0040 tx=0x7f8eb401ac90 comp rx=0 tx=0).stop 2023-06-10T19:06:58.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.102+0000 7f8ec8c5c640 1 -- 172.21.15.53:0/3513492890 shutdown_connections 2023-06-10T19:06:58.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.102+0000 7f8ec8c5c640 1 --2- 172.21.15.53:0/3513492890 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8ea4066280 0x7f8ea4068730 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:58.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.102+0000 7f8ec8c5c640 1 --2- 172.21.15.53:0/3513492890 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ec4159a60 0x7f8ec414e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:58.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.102+0000 7f8ec8c5c640 1 --2- 172.21.15.53:0/3513492890 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ec4159690 0x7f8ec40c5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:58.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.102+0000 7f8ec8c5c640 1 --2- 172.21.15.53:0/3513492890 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ec40b0f30 0x7f8ec414f760 unknown :-1 s=CLOSED pgs=2289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:58.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.102+0000 7f8ec8c5c640 1 -- 172.21.15.53:0/3513492890 >> 172.21.15.53:0/3513492890 conn(0x7f8ec406a560 msgr2=0x7f8ec40ae530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:58.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.102+0000 7f8ec8c5c640 1 -- 172.21.15.53:0/3513492890 shutdown_connections 2023-06-10T19:06:58.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.102+0000 7f8ec8c5c640 1 -- 172.21.15.53:0/3513492890 wait complete. 2023-06-10T19:06:58.123 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-10T19:06:58.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.254+0000 7f8ac8081640 1 Processor -- start 2023-06-10T19:06:58.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.254+0000 7f8ac8081640 1 -- start start 2023-06-10T19:06:58.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.254+0000 7f8ac8081640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8ac00b0170 0x7f8ac00c9e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:58.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.254+0000 7f8ac8081640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ac00ca350 0x7f8ac00ccea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:58.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.254+0000 7f8ac8081640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ac01606f0 con 0x7f8ac015fc10 2023-06-10T19:06:58.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.254+0000 7f8ac8081640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ac0160990 con 0x7f8ac00b0170 2023-06-10T19:06:58.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.254+0000 7f8ac8081640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac0160c70 con 0x7f8ac00ca350 2023-06-10T19:06:58.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.254+0000 7f8ac5e1d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f8ac015fc10 0x7f8ac015ffe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:47792/0 (socket says 172.21.15.53:47792) 2023-06-10T19:06:58.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.254+0000 7f8ac5e1d640 1 -- 172.21.15.53:0/3004621208 learned_addr learned my addr 172.21.15.53:0/3004621208 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:06:58.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.254+0000 7f8ac561c640 1 --2- 172.21.15.53:0/3004621208 >> v2:172.21.15.117:3300/0 conn(0x7f8ac00b0170 0x7f8ac00c9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:58.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.254+0000 7f8ac661e640 1 --2- 172.21.15.53:0/3004621208 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ac00ca350 0x7f8ac00ccea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:58.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.254+0000 7f8ac4e1b640 1 -- 172.21.15.53:0/3004621208 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3212029124 0 0) 0x7f8ac01606f0 con 0x7f8ac015fc10 2023-06-10T19:06:58.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.254+0000 7f8ac4e1b640 1 -- 172.21.15.53:0/3004621208 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8aac003530 con 0x7f8ac015fc10 2023-06-10T19:06:58.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.254+0000 7f8ac561c640 1 -- 172.21.15.53:0/3004621208 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ac00ca350 msgr2=0x7f8ac00ccea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:58.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.254+0000 7f8ac561c640 1 --2- 172.21.15.53:0/3004621208 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ac00ca350 0x7f8ac00ccea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:58.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.254+0000 7f8ac561c640 1 -- 172.21.15.53:0/3004621208 >> v1:172.21.15.53:6789/0 conn(0x7f8ac015fc10 legacy=0x7f8ac015ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:58.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.254+0000 7f8ac4e1b640 1 -- 172.21.15.53:0/3004621208 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1254828112 0 0) 0x7f8aac003530 con 0x7f8ac015fc10 2023-06-10T19:06:58.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.254+0000 7f8ac561c640 1 -- 172.21.15.53:0/3004621208 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ac0160f50 con 0x7f8ac00b0170 2023-06-10T19:06:58.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.254+0000 7f8ac661e640 1 --2- 172.21.15.53:0/3004621208 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ac00ca350 0x7f8ac00ccea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-10T19:06:58.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.258+0000 7f8ac561c640 1 --2- 172.21.15.53:0/3004621208 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ac00b0170 0x7f8ac00c9e10 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f8ab00097c0 tx=0x7f8ab001c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=396a1ffe670d3942 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:58.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.258+0000 7f8ac4e1b640 1 -- 172.21.15.53:0/3004621208 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab00ad660 con 0x7f8ac00b0170 2023-06-10T19:06:58.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.258+0000 7f8ac4e1b640 1 -- 172.21.15.53:0/3004621208 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ab00ad7c0 con 0x7f8ac00b0170 2023-06-10T19:06:58.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.258+0000 7f8ac4e1b640 1 -- 172.21.15.53:0/3004621208 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab00adb30 con 0x7f8ac00b0170 2023-06-10T19:06:58.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.258+0000 7f8ac8081640 1 -- 172.21.15.53:0/3004621208 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ac00b0170 msgr2=0x7f8ac00c9e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:58.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.258+0000 7f8ac8081640 1 --2- 172.21.15.53:0/3004621208 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ac00b0170 0x7f8ac00c9e10 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f8ab00097c0 tx=0x7f8ab001c450 comp rx=0 tx=0).stop 2023-06-10T19:06:58.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.258+0000 7f8ac8081640 1 -- 172.21.15.53:0/3004621208 shutdown_connections 2023-06-10T19:06:58.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.258+0000 7f8ac8081640 1 --2- 172.21.15.53:0/3004621208 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ac00b0170 0x7f8ac00c9e10 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:58.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.258+0000 7f8ac8081640 1 --2- 172.21.15.53:0/3004621208 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ac00ca350 0x7f8ac00ccea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:58.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.258+0000 7f8ac8081640 1 -- 172.21.15.53:0/3004621208 >> 172.21.15.53:0/3004621208 conn(0x7f8ac006a0e0 msgr2=0x7f8ac00cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:58.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.258+0000 7f8ac8081640 1 -- 172.21.15.53:0/3004621208 shutdown_connections 2023-06-10T19:06:58.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.258+0000 7f8ac8081640 1 -- 172.21.15.53:0/3004621208 wait complete. 2023-06-10T19:06:58.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.258+0000 7f8ac8081640 1 Processor -- start 2023-06-10T19:06:58.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.258+0000 7f8ac8081640 1 -- start start 2023-06-10T19:06:58.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.258+0000 7f8ac8081640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ac00b0170 0x7f8ac015cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:58.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.258+0000 7f8ac8081640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ac00ca350 0x7f8ac015f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:58.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.258+0000 7f8ac8081640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ac015fc10 0x7f8ac0153020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:58.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.258+0000 7f8ac8081640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac0163ed0 con 0x7f8ac015fc10 2023-06-10T19:06:58.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.258+0000 7f8ac8081640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac00b2380 con 0x7f8ac00ca350 2023-06-10T19:06:58.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.258+0000 7f8ac8081640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac015f7f0 con 0x7f8ac00b0170 2023-06-10T19:06:58.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.258+0000 7f8ac661e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ac015fc10 0x7f8ac0153020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:58.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.258+0000 7f8ac661e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ac015fc10 0x7f8ac0153020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48962/0 (socket says 172.21.15.53:48962) 2023-06-10T19:06:58.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.258+0000 7f8ac661e640 1 -- 172.21.15.53:0/834977573 learned_addr learned my addr 172.21.15.53:0/834977573 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:58.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.258+0000 7f8ac561c640 1 --2- 172.21.15.53:0/834977573 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ac00ca350 0x7f8ac015f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:58.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.262+0000 7f8ac5e1d640 1 --2- 172.21.15.53:0/834977573 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ac00b0170 0x7f8ac015cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:58.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.262+0000 7f8ac661e640 1 -- 172.21.15.53:0/834977573 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ac00b0170 msgr2=0x7f8ac015cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:58.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.262+0000 7f8ac661e640 1 --2- 172.21.15.53:0/834977573 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ac00b0170 0x7f8ac015cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:58.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.262+0000 7f8ac661e640 1 -- 172.21.15.53:0/834977573 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ac00ca350 msgr2=0x7f8ac015f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:58.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.262+0000 7f8ac661e640 1 --2- 172.21.15.53:0/834977573 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ac00ca350 0x7f8ac015f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:58.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.262+0000 7f8ac661e640 1 -- 172.21.15.53:0/834977573 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ab8009a70 con 0x7f8ac015fc10 2023-06-10T19:06:58.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.262+0000 7f8ac661e640 1 --2- 172.21.15.53:0/834977573 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ac015fc10 0x7f8ac0153020 secure :-1 s=READY pgs=2291 cs=0 l=1 rev1=1 crypto rx=0x7f8ab8009ea0 tx=0x7f8ab8009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:58.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.262+0000 7f8ab67fc640 1 -- 172.21.15.53:0/834977573 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab800cde0 con 0x7f8ac015fc10 2023-06-10T19:06:58.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.262+0000 7f8ab67fc640 1 -- 172.21.15.53:0/834977573 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ab800f040 con 0x7f8ac015fc10 2023-06-10T19:06:58.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.262+0000 7f8ac8081640 1 -- 172.21.15.53:0/834977573 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ab0009420 con 0x7f8ac015fc10 2023-06-10T19:06:58.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.262+0000 7f8ab67fc640 1 -- 172.21.15.53:0/834977573 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab8003be0 con 0x7f8ac015fc10 2023-06-10T19:06:58.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.262+0000 7f8ac8081640 1 -- 172.21.15.53:0/834977573 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ac0153560 con 0x7f8ac015fc10 2023-06-10T19:06:58.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.262+0000 7f8ac8081640 1 -- 172.21.15.53:0/834977573 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ac00b2510 con 0x7f8ac015fc10 2023-06-10T19:06:58.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.262+0000 7f8ab67fc640 1 -- 172.21.15.53:0/834977573 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8ab8014480 con 0x7f8ac015fc10 2023-06-10T19:06:58.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.262+0000 7f8ab67fc640 1 --2- 172.21.15.53:0/834977573 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8aa4066280 0x7f8aa4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:58.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.262+0000 7f8ab67fc640 1 -- 172.21.15.53:0/834977573 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6105+0+0 (secure 0 0 0) 0x7f8ab8084820 con 0x7f8ac015fc10 2023-06-10T19:06:58.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.262+0000 7f8ac5e1d640 1 --2- 172.21.15.53:0/834977573 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8aa4066280 0x7f8aa4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:58.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.262+0000 7f8ac5e1d640 1 --2- 172.21.15.53:0/834977573 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8aa4066280 0x7f8aa4068730 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f8abc007fd0 tx=0x7f8abc007ca0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:58.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.266+0000 7f8ab67fc640 1 -- 172.21.15.53:0/834977573 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8ab8051d20 con 0x7f8ac015fc10 2023-06-10T19:06:58.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.418+0000 7f8ac8081640 1 -- 172.21.15.53:0/834977573 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8ac00b3940 con 0x7f8ac015fc10 2023-06-10T19:06:58.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.422+0000 7f8ab67fc640 1 -- 172.21.15.53:0/834977573 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v155) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8ab8055340 con 0x7f8ac015fc10 2023-06-10T19:06:58.425 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-06-10T19:06:58.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.422+0000 7f8ac8081640 1 -- 172.21.15.53:0/834977573 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8aa4066280 msgr2=0x7f8aa4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:58.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.422+0000 7f8ac8081640 1 --2- 172.21.15.53:0/834977573 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8aa4066280 0x7f8aa4068730 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f8abc007fd0 tx=0x7f8abc007ca0 comp rx=0 tx=0).stop 2023-06-10T19:06:58.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.422+0000 7f8ac8081640 1 -- 172.21.15.53:0/834977573 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ac015fc10 msgr2=0x7f8ac0153020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:58.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.422+0000 7f8ac8081640 1 --2- 172.21.15.53:0/834977573 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ac015fc10 0x7f8ac0153020 secure :-1 s=READY pgs=2291 cs=0 l=1 rev1=1 crypto rx=0x7f8ab8009ea0 tx=0x7f8ab8009f90 comp rx=0 tx=0).stop 2023-06-10T19:06:58.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.422+0000 7f8ac8081640 1 -- 172.21.15.53:0/834977573 shutdown_connections 2023-06-10T19:06:58.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.422+0000 7f8ac8081640 1 --2- 172.21.15.53:0/834977573 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8aa4066280 0x7f8aa4068730 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:58.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.422+0000 7f8ac8081640 1 --2- 172.21.15.53:0/834977573 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ac015fc10 0x7f8ac0153020 unknown :-1 s=CLOSED pgs=2291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:58.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.422+0000 7f8ac8081640 1 --2- 172.21.15.53:0/834977573 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ac00ca350 0x7f8ac015f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:58.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.422+0000 7f8ac8081640 1 --2- 172.21.15.53:0/834977573 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8ac00b0170 0x7f8ac015cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:58.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.422+0000 7f8ac8081640 1 -- 172.21.15.53:0/834977573 >> 172.21.15.53:0/834977573 conn(0x7f8ac006a0e0 msgr2=0x7f8ac00ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:58.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.422+0000 7f8ac8081640 1 -- 172.21.15.53:0/834977573 shutdown_connections 2023-06-10T19:06:58.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.422+0000 7f8ac8081640 1 -- 172.21.15.53:0/834977573 wait complete. 2023-06-10T19:06:58.441 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-10T19:06:58.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.554+0000 7fc9dba44640 1 Processor -- start 2023-06-10T19:06:58.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.554+0000 7fc9dba44640 1 -- start start 2023-06-10T19:06:58.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.554+0000 7fc9dba44640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc9d406b780 0x7fc9d415c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:58.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.554+0000 7fc9dba44640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9d40af530 con 0x7fc9d406bb50 2023-06-10T19:06:58.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.554+0000 7fc9dba44640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9d415fd70 con 0x7fc9d40ceb20 2023-06-10T19:06:58.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.554+0000 7fc9dba44640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9d415c3d0 con 0x7fc9d406b780 2023-06-10T19:06:58.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.554+0000 7fc9d97e0640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc9d406b780 0x7fc9d415c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:58.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.554+0000 7fc9d97e0640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc9d406b780 0x7fc9d415c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48966/0 (socket says 172.21.15.53:48966) 2023-06-10T19:06:58.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.554+0000 7fc9d97e0640 1 -- 172.21.15.53:0/375001449 learned_addr learned my addr 172.21.15.53:0/375001449 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:58.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.554+0000 7fc9d8fdf640 1 --1- 172.21.15.53:0/375001449 >> v1:172.21.15.53:6789/0 conn(0x7fc9d406bb50 0x7fc9d415f320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:47796/0 (socket says 172.21.15.53:47796) 2023-06-10T19:06:58.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.554+0000 7fc9d97e0640 1 -- 172.21.15.53:0/375001449 >> v1:172.21.15.117:6789/0 conn(0x7fc9d40ceb20 legacy=0x7fc9d40cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:58.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.554+0000 7fc9d97e0640 1 -- 172.21.15.53:0/375001449 >> v1:172.21.15.53:6789/0 conn(0x7fc9d406bb50 legacy=0x7fc9d415f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:58.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.554+0000 7fc9cbfff640 1 -- 172.21.15.53:0/375001449 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2954628512 0 0) 0x7fc9d40af530 con 0x7fc9d406bb50 2023-06-10T19:06:58.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.554+0000 7fc9d97e0640 1 -- 172.21.15.53:0/375001449 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9d4160050 con 0x7fc9d406b780 2023-06-10T19:06:58.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.558+0000 7fc9d97e0640 1 --2- 172.21.15.53:0/375001449 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9d406b780 0x7fc9d415c7f0 secure :-1 s=READY pgs=2293 cs=0 l=1 rev1=1 crypto rx=0x7fc9c4009870 tx=0x7fc9c401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec585b8688640cf2 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:58.563 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.558+0000 7fc9cbfff640 1 -- 172.21.15.53:0/375001449 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c40ab600 con 0x7fc9d406b780 2023-06-10T19:06:58.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.558+0000 7fc9cbfff640 1 -- 172.21.15.53:0/375001449 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9c40ab760 con 0x7fc9d406b780 2023-06-10T19:06:58.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.558+0000 7fc9cbfff640 1 -- 172.21.15.53:0/375001449 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c40abaf0 con 0x7fc9d406b780 2023-06-10T19:06:58.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.558+0000 7fc9dba44640 1 -- 172.21.15.53:0/375001449 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9d406b780 msgr2=0x7fc9d415c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:58.564 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.558+0000 7fc9dba44640 1 --2- 172.21.15.53:0/375001449 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9d406b780 0x7fc9d415c7f0 secure :-1 s=READY pgs=2293 cs=0 l=1 rev1=1 crypto rx=0x7fc9c4009870 tx=0x7fc9c401c470 comp rx=0 tx=0).stop 2023-06-10T19:06:58.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.558+0000 7fc9dba44640 1 -- 172.21.15.53:0/375001449 shutdown_connections 2023-06-10T19:06:58.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.558+0000 7fc9dba44640 1 --2- 172.21.15.53:0/375001449 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9d406b780 0x7fc9d415c7f0 unknown :-1 s=CLOSED pgs=2293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:58.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.558+0000 7fc9dba44640 1 -- 172.21.15.53:0/375001449 >> 172.21.15.53:0/375001449 conn(0x7fc9d406a090 msgr2=0x7fc9d406d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:58.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.558+0000 7fc9dba44640 1 -- 172.21.15.53:0/375001449 shutdown_connections 2023-06-10T19:06:58.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.558+0000 7fc9dba44640 1 -- 172.21.15.53:0/375001449 wait complete. 2023-06-10T19:06:58.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.558+0000 7fc9dba44640 1 Processor -- start 2023-06-10T19:06:58.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.558+0000 7fc9dba44640 1 -- start start 2023-06-10T19:06:58.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.558+0000 7fc9dba44640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9d406b780 0x7fc9d4150020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:58.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.558+0000 7fc9dba44640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9d406bb50 0x7fc9d40b3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:58.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.558+0000 7fc9dba44640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9d40ceb20 0x7fc9d40b4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:58.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.558+0000 7fc9dba44640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d40b2e20 con 0x7fc9d406bb50 2023-06-10T19:06:58.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.558+0000 7fc9dba44640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d40b3100 con 0x7fc9d40ceb20 2023-06-10T19:06:58.566 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.558+0000 7fc9dba44640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d40b33e0 con 0x7fc9d406b780 2023-06-10T19:06:58.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.558+0000 7fc9d8fdf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9d406bb50 0x7fc9d40b3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:58.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.558+0000 7fc9d8fdf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9d406bb50 0x7fc9d40b3ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48974/0 (socket says 172.21.15.53:48974) 2023-06-10T19:06:58.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.558+0000 7fc9d8fdf640 1 -- 172.21.15.53:0/4020905731 learned_addr learned my addr 172.21.15.53:0/4020905731 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:58.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.558+0000 7fc9d8fdf640 1 -- 172.21.15.53:0/4020905731 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9d406b780 msgr2=0x7fc9d4150020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:58.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.558+0000 7fc9d8fdf640 1 --2- 172.21.15.53:0/4020905731 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9d406b780 0x7fc9d4150020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:58.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.558+0000 7fc9d8fdf640 1 -- 172.21.15.53:0/4020905731 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9d40ceb20 msgr2=0x7fc9d40b4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:58.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.558+0000 7fc9d8fdf640 1 --2- 172.21.15.53:0/4020905731 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9d40ceb20 0x7fc9d40b4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:58.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.558+0000 7fc9d8fdf640 1 -- 172.21.15.53:0/4020905731 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c40094d0 con 0x7fc9d406bb50 2023-06-10T19:06:58.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.558+0000 7fc9d8fdf640 1 --2- 172.21.15.53:0/4020905731 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9d406bb50 0x7fc9d40b3ec0 secure :-1 s=READY pgs=2294 cs=0 l=1 rev1=1 crypto rx=0x7fc9d00011f0 tx=0x7fc9d000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:58.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.558+0000 7fc9c9ffb640 1 -- 172.21.15.53:0/4020905731 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d00074e0 con 0x7fc9d406bb50 2023-06-10T19:06:58.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.558+0000 7fc9c9ffb640 1 -- 172.21.15.53:0/4020905731 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9d0007640 con 0x7fc9d406bb50 2023-06-10T19:06:58.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.562+0000 7fc9dba44640 1 -- 172.21.15.53:0/4020905731 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9d40b36c0 con 0x7fc9d406bb50 2023-06-10T19:06:58.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.562+0000 7fc9c9ffb640 1 -- 172.21.15.53:0/4020905731 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d0004a10 con 0x7fc9d406bb50 2023-06-10T19:06:58.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.562+0000 7fc9dba44640 1 -- 172.21.15.53:0/4020905731 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9d4150560 con 0x7fc9d406bb50 2023-06-10T19:06:58.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.562+0000 7fc9dba44640 1 -- 172.21.15.53:0/4020905731 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9d40b3be0 con 0x7fc9d406bb50 2023-06-10T19:06:58.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.562+0000 7fc9c9ffb640 1 -- 172.21.15.53:0/4020905731 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc9d0004b70 con 0x7fc9d406bb50 2023-06-10T19:06:58.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.562+0000 7fc9c9ffb640 1 --2- 172.21.15.53:0/4020905731 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc9b80662b0 0x7fc9b8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:58.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.562+0000 7fc9c9ffb640 1 -- 172.21.15.53:0/4020905731 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6105+0+0 (secure 0 0 0) 0x7fc9d0082f50 con 0x7fc9d406bb50 2023-06-10T19:06:58.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.562+0000 7fc9d97e0640 1 --2- 172.21.15.53:0/4020905731 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc9b80662b0 0x7fc9b8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:58.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.562+0000 7fc9d97e0640 1 --2- 172.21.15.53:0/4020905731 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc9b80662b0 0x7fc9b8068760 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fc9c40af000 tx=0x7fc9c4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:58.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.566+0000 7fc9c9ffb640 1 -- 172.21.15.53:0/4020905731 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc9d40b3be0 con 0x7fc9d406bb50 2023-06-10T19:06:58.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.714+0000 7fc9dba44640 1 -- 172.21.15.53:0/4020905731 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc9d40b3be0 con 0x7fc9d406bb50 2023-06-10T19:06:58.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.714+0000 7fc9c9ffb640 1 -- 172.21.15.53:0/4020905731 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v155) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc9d40b3be0 con 0x7fc9d406bb50 2023-06-10T19:06:58.717 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-06-10T19:06:58.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.718+0000 7fc9dba44640 1 -- 172.21.15.53:0/4020905731 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc9b80662b0 msgr2=0x7fc9b8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:58.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.718+0000 7fc9dba44640 1 --2- 172.21.15.53:0/4020905731 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc9b80662b0 0x7fc9b8068760 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fc9c40af000 tx=0x7fc9c4008040 comp rx=0 tx=0).stop 2023-06-10T19:06:58.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.718+0000 7fc9dba44640 1 -- 172.21.15.53:0/4020905731 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9d406bb50 msgr2=0x7fc9d40b3ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:58.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.718+0000 7fc9dba44640 1 --2- 172.21.15.53:0/4020905731 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9d406bb50 0x7fc9d40b3ec0 secure :-1 s=READY pgs=2294 cs=0 l=1 rev1=1 crypto rx=0x7fc9d00011f0 tx=0x7fc9d000c9b0 comp rx=0 tx=0).stop 2023-06-10T19:06:58.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.718+0000 7fc9dba44640 1 -- 172.21.15.53:0/4020905731 shutdown_connections 2023-06-10T19:06:58.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.718+0000 7fc9dba44640 1 --2- 172.21.15.53:0/4020905731 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc9b80662b0 0x7fc9b8068760 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:58.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.718+0000 7fc9dba44640 1 --2- 172.21.15.53:0/4020905731 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9d40ceb20 0x7fc9d40b4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:58.719 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.718+0000 7fc9dba44640 1 --2- 172.21.15.53:0/4020905731 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9d406bb50 0x7fc9d40b3ec0 unknown :-1 s=CLOSED pgs=2294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:58.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.718+0000 7fc9dba44640 1 --2- 172.21.15.53:0/4020905731 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc9d406b780 0x7fc9d4150020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:58.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.718+0000 7fc9dba44640 1 -- 172.21.15.53:0/4020905731 >> 172.21.15.53:0/4020905731 conn(0x7fc9d406a090 msgr2=0x7fc9d415ce60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:58.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.718+0000 7fc9dba44640 1 -- 172.21.15.53:0/4020905731 shutdown_connections 2023-06-10T19:06:58.720 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.718+0000 7fc9dba44640 1 -- 172.21.15.53:0/4020905731 wait complete. 2023-06-10T19:06:58.735 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-10T19:06:58.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.846+0000 7fe10f113640 1 Processor -- start 2023-06-10T19:06:58.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.846+0000 7fe10f113640 1 -- start start 2023-06-10T19:06:58.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.850+0000 7fe10f113640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1080c9fa0 0x7fe10806bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:58.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.850+0000 7fe10f113640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe1080af760 0x7fe1080afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:58.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.850+0000 7fe10f113640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe10806b090 con 0x7fe10806c020 2023-06-10T19:06:58.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.850+0000 7fe10f113640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1080b0120 con 0x7fe1080af760 2023-06-10T19:06:58.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.850+0000 7fe10f113640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1080ca370 con 0x7fe1080c9fa0 2023-06-10T19:06:58.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.850+0000 7fe10d6b0640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe1080af760 0x7fe1080afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:58.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.850+0000 7fe10ceaf640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1080c9fa0 0x7fe10806bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:58.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.850+0000 7fe107fff640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fe10806c020 0x7fe1080c82a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.53:41270/0 (socket says 172.21.15.53:41270) 2023-06-10T19:06:58.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.850+0000 7fe10d6b0640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe1080af760 0x7fe1080afbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.53:36382/0 (socket says 172.21.15.53:36382) 2023-06-10T19:06:58.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.850+0000 7fe107fff640 1 -- 172.21.15.53:0/1113847133 learned_addr learned my addr 172.21.15.53:0/1113847133 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:06:58.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.850+0000 7fe10ceaf640 1 -- 172.21.15.53:0/1113847133 >> v2:172.21.15.117:3300/0 conn(0x7fe1080af760 msgr2=0x7fe1080afbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:58.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.850+0000 7fe10ceaf640 1 --2- 172.21.15.53:0/1113847133 >> v2:172.21.15.117:3300/0 conn(0x7fe1080af760 0x7fe1080afbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:58.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.850+0000 7fe10ceaf640 1 -- 172.21.15.53:0/1113847133 >> v1:172.21.15.117:6789/0 conn(0x7fe10806c020 legacy=0x7fe1080c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:58.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.850+0000 7fe10ceaf640 1 -- 172.21.15.53:0/1113847133 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe108070d50 con 0x7fe1080c9fa0 2023-06-10T19:06:58.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.850+0000 7fe10d6b0640 1 --2- 172.21.15.53:0/1113847133 >> v2:172.21.15.117:3300/0 conn(0x7fe1080af760 0x7fe1080afbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-10T19:06:58.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.854+0000 7fe10ceaf640 1 --2- 172.21.15.53:0/1113847133 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1080c9fa0 0x7fe10806bae0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe0f80097c0 tx=0x7fe0f801c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe16a09e06bf1e70 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:58.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.854+0000 7fe1077fe640 1 -- 172.21.15.53:0/1113847133 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f80ab600 con 0x7fe1080c9fa0 2023-06-10T19:06:58.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.854+0000 7fe1077fe640 1 -- 172.21.15.53:0/1113847133 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0f80a7050 con 0x7fe1080c9fa0 2023-06-10T19:06:58.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.854+0000 7fe1077fe640 1 -- 172.21.15.53:0/1113847133 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f80ab980 con 0x7fe1080c9fa0 2023-06-10T19:06:58.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.854+0000 7fe10f113640 1 -- 172.21.15.53:0/1113847133 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1080c9fa0 msgr2=0x7fe10806bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:58.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.854+0000 7fe10f113640 1 --2- 172.21.15.53:0/1113847133 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1080c9fa0 0x7fe10806bae0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe0f80097c0 tx=0x7fe0f801c3c0 comp rx=0 tx=0).stop 2023-06-10T19:06:58.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.854+0000 7fe10f113640 1 -- 172.21.15.53:0/1113847133 shutdown_connections 2023-06-10T19:06:58.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.854+0000 7fe10f113640 1 --2- 172.21.15.53:0/1113847133 >> v2:172.21.15.117:3300/0 conn(0x7fe1080af760 0x7fe1080afbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:58.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.854+0000 7fe10f113640 1 --2- 172.21.15.53:0/1113847133 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe1080c9fa0 0x7fe10806bae0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:58.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.854+0000 7fe10f113640 1 -- 172.21.15.53:0/1113847133 >> 172.21.15.53:0/1113847133 conn(0x7fe10806a0e0 msgr2=0x7fe1080cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:58.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.854+0000 7fe10f113640 1 -- 172.21.15.53:0/1113847133 shutdown_connections 2023-06-10T19:06:58.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.854+0000 7fe10f113640 1 -- 172.21.15.53:0/1113847133 wait complete. 2023-06-10T19:06:58.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.854+0000 7fe10f113640 1 Processor -- start 2023-06-10T19:06:58.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.854+0000 7fe10f113640 1 -- start start 2023-06-10T19:06:58.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.854+0000 7fe10f113640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe10806c020 0x7fe1081f7f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:58.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.854+0000 7fe10f113640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1080af760 0x7fe108162540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:58.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.854+0000 7fe10f113640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1080c9fa0 0x7fe1080ccf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:58.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.854+0000 7fe10f113640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe108159cb0 con 0x7fe1080af760 2023-06-10T19:06:58.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.854+0000 7fe10f113640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1081f8580 con 0x7fe1080c9fa0 2023-06-10T19:06:58.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.854+0000 7fe10f113640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe108161780 con 0x7fe10806c020 2023-06-10T19:06:58.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.854+0000 7fe107fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1080af760 0x7fe108162540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:58.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.854+0000 7fe107fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1080af760 0x7fe108162540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48978/0 (socket says 172.21.15.53:48978) 2023-06-10T19:06:58.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.854+0000 7fe107fff640 1 -- 172.21.15.53:0/469234558 learned_addr learned my addr 172.21.15.53:0/469234558 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:58.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.854+0000 7fe10ceaf640 1 --2- 172.21.15.53:0/469234558 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe10806c020 0x7fe1081f7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:58.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.854+0000 7fe10d6b0640 1 --2- 172.21.15.53:0/469234558 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1080c9fa0 0x7fe1080ccf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:58.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.854+0000 7fe107fff640 1 -- 172.21.15.53:0/469234558 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe10806c020 msgr2=0x7fe1081f7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:58.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.854+0000 7fe107fff640 1 --2- 172.21.15.53:0/469234558 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe10806c020 0x7fe1081f7f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:58.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.854+0000 7fe107fff640 1 -- 172.21.15.53:0/469234558 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1080c9fa0 msgr2=0x7fe1080ccf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:58.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.854+0000 7fe107fff640 1 --2- 172.21.15.53:0/469234558 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1080c9fa0 0x7fe1080ccf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:58.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.854+0000 7fe107fff640 1 -- 172.21.15.53:0/469234558 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe100009a70 con 0x7fe1080af760 2023-06-10T19:06:58.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.854+0000 7fe107fff640 1 --2- 172.21.15.53:0/469234558 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1080af760 0x7fe108162540 secure :-1 s=READY pgs=2295 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc00c400 tx=0x7fe0fc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:58.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.854+0000 7fe1057fa640 1 -- 172.21.15.53:0/469234558 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0fc005cf0 con 0x7fe1080af760 2023-06-10T19:06:58.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.858+0000 7fe1057fa640 1 -- 172.21.15.53:0/469234558 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0fc005e50 con 0x7fe1080af760 2023-06-10T19:06:58.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.858+0000 7fe10f113640 1 -- 172.21.15.53:0/469234558 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0f8009420 con 0x7fe1080af760 2023-06-10T19:06:58.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.858+0000 7fe1057fa640 1 -- 172.21.15.53:0/469234558 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0fc0072d0 con 0x7fe1080af760 2023-06-10T19:06:58.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.858+0000 7fe10f113640 1 -- 172.21.15.53:0/469234558 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe108161d40 con 0x7fe1080af760 2023-06-10T19:06:58.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.858+0000 7fe10f113640 1 -- 172.21.15.53:0/469234558 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe10804d790 con 0x7fe1080af760 2023-06-10T19:06:58.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.858+0000 7fe1057fa640 1 -- 172.21.15.53:0/469234558 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe0fc007430 con 0x7fe1080af760 2023-06-10T19:06:58.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.858+0000 7fe1057fa640 1 --2- 172.21.15.53:0/469234558 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe0f4066280 0x7fe0f4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:58.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.858+0000 7fe1057fa640 1 -- 172.21.15.53:0/469234558 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6105+0+0 (secure 0 0 0) 0x7fe0fc083200 con 0x7fe1080af760 2023-06-10T19:06:58.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.858+0000 7fe10ceaf640 1 --2- 172.21.15.53:0/469234558 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe0f4066280 0x7fe0f4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:58.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.858+0000 7fe10ceaf640 1 --2- 172.21.15.53:0/469234558 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe0f4066280 0x7fe0f4068730 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fe0f80ad000 tx=0x7fe0f80a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:58.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:58.862+0000 7fe1057fa640 1 -- 172.21.15.53:0/469234558 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe0fc050700 con 0x7fe1080af760 2023-06-10T19:06:59.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.010+0000 7fe10f113640 1 -- 172.21.15.53:0/469234558 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe1080ce670 con 0x7fe1080af760 2023-06-10T19:06:59.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.010+0000 7fe1057fa640 1 -- 172.21.15.53:0/469234558 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v155) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe0fc053d20 con 0x7fe1080af760 2023-06-10T19:06:59.014 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-06-10T19:06:59.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.014+0000 7fe10f113640 1 -- 172.21.15.53:0/469234558 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe0f4066280 msgr2=0x7fe0f4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:59.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.014+0000 7fe10f113640 1 --2- 172.21.15.53:0/469234558 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe0f4066280 0x7fe0f4068730 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fe0f80ad000 tx=0x7fe0f80a6000 comp rx=0 tx=0).stop 2023-06-10T19:06:59.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.014+0000 7fe10f113640 1 -- 172.21.15.53:0/469234558 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1080af760 msgr2=0x7fe108162540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:59.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.014+0000 7fe10f113640 1 --2- 172.21.15.53:0/469234558 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1080af760 0x7fe108162540 secure :-1 s=READY pgs=2295 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc00c400 tx=0x7fe0fc00c8c0 comp rx=0 tx=0).stop 2023-06-10T19:06:59.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.014+0000 7fe10f113640 1 -- 172.21.15.53:0/469234558 shutdown_connections 2023-06-10T19:06:59.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.014+0000 7fe10f113640 1 --2- 172.21.15.53:0/469234558 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe0f4066280 0x7fe0f4068730 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:59.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.014+0000 7fe10f113640 1 --2- 172.21.15.53:0/469234558 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1080c9fa0 0x7fe1080ccf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:59.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.014+0000 7fe10f113640 1 --2- 172.21.15.53:0/469234558 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1080af760 0x7fe108162540 unknown :-1 s=CLOSED pgs=2295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:59.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.014+0000 7fe10f113640 1 --2- 172.21.15.53:0/469234558 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe10806c020 0x7fe1081f7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:59.017 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.014+0000 7fe10f113640 1 -- 172.21.15.53:0/469234558 >> 172.21.15.53:0/469234558 conn(0x7fe10806a0e0 msgr2=0x7fe1080b32e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:59.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.014+0000 7fe10f113640 1 -- 172.21.15.53:0/469234558 shutdown_connections 2023-06-10T19:06:59.018 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.014+0000 7fe10f113640 1 -- 172.21.15.53:0/469234558 wait complete. 2023-06-10T19:06:59.032 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-10T19:06:59.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.158+0000 7fa38c6a4640 1 Processor -- start 2023-06-10T19:06:59.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.158+0000 7fa38c6a4640 1 -- start start 2023-06-10T19:06:59.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.158+0000 7fa38c6a4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3841571a0 0x7fa3840c9f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:59.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.158+0000 7fa38c6a4640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa384070100 0x7fa3840af7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:59.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.158+0000 7fa38c6a4640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3840b0160 con 0x7fa3840afd10 2023-06-10T19:06:59.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.158+0000 7fa38c6a4640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa384071190 con 0x7fa384070100 2023-06-10T19:06:59.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.158+0000 7fa38c6a4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3840ca440 con 0x7fa3841571a0 2023-06-10T19:06:59.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.158+0000 7fa389c3f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa384070100 0x7fa3840af7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:59.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.158+0000 7fa389c3f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa384070100 0x7fa3840af7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48990/0 (socket says 172.21.15.53:48990) 2023-06-10T19:06:59.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.158+0000 7fa389c3f640 1 -- 172.21.15.53:0/1441648618 learned_addr learned my addr 172.21.15.53:0/1441648618 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:59.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.158+0000 7fa38a440640 1 --2- 172.21.15.53:0/1441648618 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3841571a0 0x7fa3840c9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:59.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.158+0000 7fa389c3f640 1 -- 172.21.15.53:0/1441648618 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3841571a0 msgr2=0x7fa3840c9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:59.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.158+0000 7fa389c3f640 1 --2- 172.21.15.53:0/1441648618 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3841571a0 0x7fa3840c9f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:59.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.158+0000 7fa389c3f640 1 -- 172.21.15.53:0/1441648618 >> v1:172.21.15.117:6789/0 conn(0x7fa3840afd10 legacy=0x7fa38415d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:59.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.158+0000 7fa389c3f640 1 -- 172.21.15.53:0/1441648618 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa384070580 con 0x7fa384070100 2023-06-10T19:06:59.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.162+0000 7fa389c3f640 1 --2- 172.21.15.53:0/1441648618 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa384070100 0x7fa3840af7d0 secure :-1 s=READY pgs=2296 cs=0 l=1 rev1=1 crypto rx=0x7fa374009870 tx=0x7fa37401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bf7529844c25855 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:59.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.162+0000 7fa38943e640 1 -- 172.21.15.53:0/1441648618 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3740aa5f0 con 0x7fa384070100 2023-06-10T19:06:59.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.162+0000 7fa38943e640 1 -- 172.21.15.53:0/1441648618 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3740aa750 con 0x7fa384070100 2023-06-10T19:06:59.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.162+0000 7fa38943e640 1 -- 172.21.15.53:0/1441648618 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3740aaae0 con 0x7fa384070100 2023-06-10T19:06:59.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.162+0000 7fa38c6a4640 1 -- 172.21.15.53:0/1441648618 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa384070100 msgr2=0x7fa3840af7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:59.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.162+0000 7fa38c6a4640 1 --2- 172.21.15.53:0/1441648618 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa384070100 0x7fa3840af7d0 secure :-1 s=READY pgs=2296 cs=0 l=1 rev1=1 crypto rx=0x7fa374009870 tx=0x7fa37401c4d0 comp rx=0 tx=0).stop 2023-06-10T19:06:59.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.162+0000 7fa38c6a4640 1 -- 172.21.15.53:0/1441648618 shutdown_connections 2023-06-10T19:06:59.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.162+0000 7fa38c6a4640 1 --2- 172.21.15.53:0/1441648618 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa384070100 0x7fa3840af7d0 unknown :-1 s=CLOSED pgs=2296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:59.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.162+0000 7fa38c6a4640 1 --2- 172.21.15.53:0/1441648618 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3841571a0 0x7fa3840c9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:59.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.162+0000 7fa38c6a4640 1 -- 172.21.15.53:0/1441648618 >> 172.21.15.53:0/1441648618 conn(0x7fa3840ce9e0 msgr2=0x7fa3840ca7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:59.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.162+0000 7fa38c6a4640 1 -- 172.21.15.53:0/1441648618 shutdown_connections 2023-06-10T19:06:59.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.162+0000 7fa38c6a4640 1 -- 172.21.15.53:0/1441648618 wait complete. 2023-06-10T19:06:59.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.162+0000 7fa38c6a4640 1 Processor -- start 2023-06-10T19:06:59.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.162+0000 7fa38c6a4640 1 -- start start 2023-06-10T19:06:59.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.162+0000 7fa38c6a4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3840afd10 0x7fa3840c3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:59.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.162+0000 7fa38c6a4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3841571a0 0x7fa38414e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:59.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.162+0000 7fa38c6a4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa384158740 0x7fa384158be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:59.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.162+0000 7fa38c6a4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa384159120 con 0x7fa3840afd10 2023-06-10T19:06:59.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.162+0000 7fa38c6a4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3840c1b60 con 0x7fa384158740 2023-06-10T19:06:59.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.162+0000 7fa38c6a4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3840c1e40 con 0x7fa3841571a0 2023-06-10T19:06:59.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.166+0000 7fa38a440640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3840afd10 0x7fa3840c3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:59.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.166+0000 7fa38a440640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3840afd10 0x7fa3840c3640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48998/0 (socket says 172.21.15.53:48998) 2023-06-10T19:06:59.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.166+0000 7fa38a440640 1 -- 172.21.15.53:0/4262118821 learned_addr learned my addr 172.21.15.53:0/4262118821 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:59.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.166+0000 7fa38ac41640 1 --2- 172.21.15.53:0/4262118821 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa384158740 0x7fa384158be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:59.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.166+0000 7fa389c3f640 1 --2- 172.21.15.53:0/4262118821 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3841571a0 0x7fa38414e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:59.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.166+0000 7fa38a440640 1 -- 172.21.15.53:0/4262118821 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3841571a0 msgr2=0x7fa38414e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:59.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.166+0000 7fa38a440640 1 --2- 172.21.15.53:0/4262118821 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3841571a0 0x7fa38414e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:59.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.166+0000 7fa38a440640 1 -- 172.21.15.53:0/4262118821 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa384158740 msgr2=0x7fa384158be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:59.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.166+0000 7fa38a440640 1 --2- 172.21.15.53:0/4262118821 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa384158740 0x7fa384158be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:59.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.166+0000 7fa38a440640 1 -- 172.21.15.53:0/4262118821 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3740094d0 con 0x7fa3840afd10 2023-06-10T19:06:59.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.166+0000 7fa38ac41640 1 --2- 172.21.15.53:0/4262118821 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa384158740 0x7fa384158be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:06:59.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.166+0000 7fa38a440640 1 --2- 172.21.15.53:0/4262118821 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3840afd10 0x7fa3840c3640 secure :-1 s=READY pgs=2297 cs=0 l=1 rev1=1 crypto rx=0x7fa38000d7d0 tx=0x7fa38000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:59.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.166+0000 7fa37affd640 1 -- 172.21.15.53:0/4262118821 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38000b6c0 con 0x7fa3840afd10 2023-06-10T19:06:59.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.166+0000 7fa37affd640 1 -- 172.21.15.53:0/4262118821 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa38000b820 con 0x7fa3840afd10 2023-06-10T19:06:59.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.166+0000 7fa38c6a4640 1 -- 172.21.15.53:0/4262118821 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3840c2120 con 0x7fa3840afd10 2023-06-10T19:06:59.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.166+0000 7fa37affd640 1 -- 172.21.15.53:0/4262118821 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38000bbd0 con 0x7fa3840afd10 2023-06-10T19:06:59.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.166+0000 7fa38c6a4640 1 -- 172.21.15.53:0/4262118821 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3840c26e0 con 0x7fa3840afd10 2023-06-10T19:06:59.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.166+0000 7fa38c6a4640 1 -- 172.21.15.53:0/4262118821 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa38404d790 con 0x7fa3840afd10 2023-06-10T19:06:59.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.166+0000 7fa37affd640 1 -- 172.21.15.53:0/4262118821 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa38000bd30 con 0x7fa3840afd10 2023-06-10T19:06:59.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.166+0000 7fa37affd640 1 --2- 172.21.15.53:0/4262118821 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa368066280 0x7fa368068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:59.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.166+0000 7fa37affd640 1 -- 172.21.15.53:0/4262118821 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6105+0+0 (secure 0 0 0) 0x7fa380084280 con 0x7fa3840afd10 2023-06-10T19:06:59.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.166+0000 7fa389c3f640 1 --2- 172.21.15.53:0/4262118821 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa368066280 0x7fa368068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:59.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.170+0000 7fa389c3f640 1 --2- 172.21.15.53:0/4262118821 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa368066280 0x7fa368068730 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fa3740ae000 tx=0x7fa3740a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:59.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.170+0000 7fa37affd640 1 -- 172.21.15.53:0/4262118821 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa380055160 con 0x7fa3840afd10 2023-06-10T19:06:59.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.330+0000 7fa38c6a4640 1 -- 172.21.15.53:0/4262118821 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa3840af790 con 0x7fa3840afd10 2023-06-10T19:06:59.334 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.330+0000 7fa37affd640 1 -- 172.21.15.53:0/4262118821 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 1 entries v155) v1 ==== 80+0+57 (secure 0 0 0) 0x7fa380054cf0 con 0x7fa3840afd10 2023-06-10T19:06:59.335 INFO:teuthology.orchestra.run.smithi053.stdout:192.168.0.1:0/2213488734 2023-06-10T20:06:49.780814+0000 2023-06-10T19:06:59.335 INFO:teuthology.orchestra.run.smithi053.stderr:listed 1 entries 2023-06-10T19:06:59.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.334+0000 7fa38c6a4640 1 -- 172.21.15.53:0/4262118821 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa368066280 msgr2=0x7fa368068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:59.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.334+0000 7fa38c6a4640 1 --2- 172.21.15.53:0/4262118821 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa368066280 0x7fa368068730 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fa3740ae000 tx=0x7fa3740a7000 comp rx=0 tx=0).stop 2023-06-10T19:06:59.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.334+0000 7fa38c6a4640 1 -- 172.21.15.53:0/4262118821 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3840afd10 msgr2=0x7fa3840c3640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:59.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.334+0000 7fa38c6a4640 1 --2- 172.21.15.53:0/4262118821 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3840afd10 0x7fa3840c3640 secure :-1 s=READY pgs=2297 cs=0 l=1 rev1=1 crypto rx=0x7fa38000d7d0 tx=0x7fa38000dc90 comp rx=0 tx=0).stop 2023-06-10T19:06:59.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.334+0000 7fa38c6a4640 1 -- 172.21.15.53:0/4262118821 shutdown_connections 2023-06-10T19:06:59.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.334+0000 7fa38c6a4640 1 --2- 172.21.15.53:0/4262118821 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa368066280 0x7fa368068730 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:59.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.334+0000 7fa38c6a4640 1 --2- 172.21.15.53:0/4262118821 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa384158740 0x7fa384158be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:59.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.334+0000 7fa38c6a4640 1 --2- 172.21.15.53:0/4262118821 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3841571a0 0x7fa38414e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:59.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.334+0000 7fa38c6a4640 1 --2- 172.21.15.53:0/4262118821 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3840afd10 0x7fa3840c3640 unknown :-1 s=CLOSED pgs=2297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:59.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.334+0000 7fa38c6a4640 1 -- 172.21.15.53:0/4262118821 >> 172.21.15.53:0/4262118821 conn(0x7fa3840ce9e0 msgr2=0x7fa3840cb890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:59.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.334+0000 7fa38c6a4640 1 -- 172.21.15.53:0/4262118821 shutdown_connections 2023-06-10T19:06:59.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.334+0000 7fa38c6a4640 1 -- 172.21.15.53:0/4262118821 wait complete. 2023-06-10T19:06:59.353 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi117.front.sepia.ceph.com... 2023-06-10T19:06:59.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:06:59.354 DEBUG:teuthology.orchestra.run.smithi117:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-06-10T19:06:59.367 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi117.stderr:ceph-fuse[45655]: fuse finished with error 0 and tester_r 0 2023-06-10T19:06:59.369 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi117.front.sepia.ceph.com 2023-06-10T19:06:59.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:06:59.370 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-06-10T19:06:59.458 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T19:06:59.458 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:06:59.466 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16345192k,nr_inodes=4086298,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276544k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=407 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276540k,nr_inodes=819135,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276544k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-06-10T19:06:59.467 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi053.front.sepia.ceph.com 2023-06-10T19:06:59.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:06:59.467 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-06-10T19:06:59.515 INFO:teuthology.orchestra.run.smithi053.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-06-10T19:06:59.515 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-10T19:06:59.516 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T19:06:59.517 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:06:59.522 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16342088k,nr_inodes=4085522,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275924k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18845 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275920k,nr_inodes=818980,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275924k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-06-10T19:06:59.523 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi117.front.sepia.ceph.com 2023-06-10T19:06:59.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:06:59.523 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-06-10T19:06:59.571 INFO:teuthology.orchestra.run.smithi117.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-06-10T19:06:59.572 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-10T19:06:59.572 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:06:59.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.702+0000 7fee801e2640 1 Processor -- start 2023-06-10T19:06:59.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.702+0000 7fee801e2640 1 -- start start 2023-06-10T19:06:59.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.702+0000 7fee801e2640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fee780c9840 0x7fee780c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:59.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.702+0000 7fee801e2640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fee78071060 0x7fee780af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:59.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.702+0000 7fee801e2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee780afc60 0x7fee7815d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:59.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.702+0000 7fee801e2640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee78159b50 con 0x7fee780c9840 2023-06-10T19:06:59.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.702+0000 7fee801e2640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee780ca150 con 0x7fee78071060 2023-06-10T19:06:59.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.702+0000 7fee801e2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee780702a0 con 0x7fee780afc60 2023-06-10T19:06:59.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.702+0000 7fee7df7e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fee780c9840 0x7fee780c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:59.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.702+0000 7fee7df7e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fee780c9840 0x7fee780c9c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49008/0 (socket says 172.21.15.53:49008) 2023-06-10T19:06:59.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.702+0000 7fee7df7e640 1 -- 172.21.15.53:0/1725813796 learned_addr learned my addr 172.21.15.53:0/1725813796 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:59.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.702+0000 7fee7e77f640 1 --2- 172.21.15.53:0/1725813796 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee780afc60 0x7fee7815d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:59.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.702+0000 7fee7d77d640 1 --2- 172.21.15.53:0/1725813796 >> v2:172.21.15.117:3300/0 conn(0x7fee78071060 0x7fee780af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:59.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.702+0000 7fee7df7e640 1 -- 172.21.15.53:0/1725813796 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee780afc60 msgr2=0x7fee7815d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:59.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.702+0000 7fee7df7e640 1 --2- 172.21.15.53:0/1725813796 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee780afc60 0x7fee7815d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:59.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.702+0000 7fee7df7e640 1 -- 172.21.15.53:0/1725813796 >> v2:172.21.15.117:3300/0 conn(0x7fee78071060 msgr2=0x7fee780af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:06:59.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.702+0000 7fee7df7e640 1 --2- 172.21.15.53:0/1725813796 >> v2:172.21.15.117:3300/0 conn(0x7fee78071060 0x7fee780af720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:59.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.702+0000 7fee7df7e640 1 -- 172.21.15.53:0/1725813796 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee78070580 con 0x7fee780c9840 2023-06-10T19:06:59.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.702+0000 7fee7df7e640 1 --2- 172.21.15.53:0/1725813796 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee780c9840 0x7fee780c9c10 secure :-1 s=READY pgs=2298 cs=0 l=1 rev1=1 crypto rx=0x7fee7806e650 tx=0x7fee7401c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f33c04e105dc57ac server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:59.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.706+0000 7fee7cf7c640 1 -- 172.21.15.53:0/1725813796 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee740ab600 con 0x7fee780c9840 2023-06-10T19:06:59.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.706+0000 7fee7cf7c640 1 -- 172.21.15.53:0/1725813796 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee740a7050 con 0x7fee780c9840 2023-06-10T19:06:59.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.706+0000 7fee7cf7c640 1 -- 172.21.15.53:0/1725813796 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee740ab980 con 0x7fee780c9840 2023-06-10T19:06:59.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.706+0000 7fee801e2640 1 -- 172.21.15.53:0/1725813796 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee780c9840 msgr2=0x7fee780c9c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:59.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.706+0000 7fee801e2640 1 --2- 172.21.15.53:0/1725813796 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee780c9840 0x7fee780c9c10 secure :-1 s=READY pgs=2298 cs=0 l=1 rev1=1 crypto rx=0x7fee7806e650 tx=0x7fee7401c210 comp rx=0 tx=0).stop 2023-06-10T19:06:59.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.706+0000 7fee801e2640 1 -- 172.21.15.53:0/1725813796 shutdown_connections 2023-06-10T19:06:59.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.706+0000 7fee801e2640 1 --2- 172.21.15.53:0/1725813796 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee780afc60 0x7fee7815d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:59.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.706+0000 7fee801e2640 1 --2- 172.21.15.53:0/1725813796 >> v2:172.21.15.117:3300/0 conn(0x7fee78071060 0x7fee780af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:59.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.706+0000 7fee801e2640 1 --2- 172.21.15.53:0/1725813796 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee780c9840 0x7fee780c9c10 unknown :-1 s=CLOSED pgs=2298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:59.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.706+0000 7fee801e2640 1 -- 172.21.15.53:0/1725813796 >> 172.21.15.53:0/1725813796 conn(0x7fee7806a0d0 msgr2=0x7fee780ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:59.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.706+0000 7fee801e2640 1 -- 172.21.15.53:0/1725813796 shutdown_connections 2023-06-10T19:06:59.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.706+0000 7fee801e2640 1 -- 172.21.15.53:0/1725813796 wait complete. 2023-06-10T19:06:59.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.706+0000 7fee801e2640 1 Processor -- start 2023-06-10T19:06:59.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.706+0000 7fee801e2640 1 -- start start 2023-06-10T19:06:59.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.706+0000 7fee801e2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee78071060 0x7fee780c61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:59.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.706+0000 7fee801e2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee780afc60 0x7fee7814ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:59.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.706+0000 7fee801e2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee780c9840 0x7fee780c4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:59.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.706+0000 7fee801e2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee78150a00 con 0x7fee780afc60 2023-06-10T19:06:59.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.706+0000 7fee801e2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee78150160 con 0x7fee780c9840 2023-06-10T19:06:59.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.706+0000 7fee801e2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee78150440 con 0x7fee78071060 2023-06-10T19:06:59.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.706+0000 7fee7d77d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee780afc60 0x7fee7814ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:59.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.706+0000 7fee7d77d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee780afc60 0x7fee7814ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49012/0 (socket says 172.21.15.53:49012) 2023-06-10T19:06:59.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.706+0000 7fee7d77d640 1 -- 172.21.15.53:0/2235817209 learned_addr learned my addr 172.21.15.53:0/2235817209 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:06:59.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.706+0000 7fee7df7e640 1 --2- 172.21.15.53:0/2235817209 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee78071060 0x7fee780c61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:59.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.706+0000 7fee7e77f640 1 --2- 172.21.15.53:0/2235817209 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee780c9840 0x7fee780c4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:59.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.706+0000 7fee7d77d640 1 -- 172.21.15.53:0/2235817209 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee78071060 msgr2=0x7fee780c61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:59.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.706+0000 7fee7d77d640 1 --2- 172.21.15.53:0/2235817209 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee78071060 0x7fee780c61c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:59.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.706+0000 7fee7d77d640 1 -- 172.21.15.53:0/2235817209 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee780c9840 msgr2=0x7fee780c4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:59.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.706+0000 7fee7d77d640 1 --2- 172.21.15.53:0/2235817209 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee780c9840 0x7fee780c4390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:59.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.706+0000 7fee7d77d640 1 -- 172.21.15.53:0/2235817209 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee740094d0 con 0x7fee780afc60 2023-06-10T19:06:59.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.706+0000 7fee7e77f640 1 --2- 172.21.15.53:0/2235817209 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee780c9840 0x7fee780c4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:06:59.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.706+0000 7fee7d77d640 1 --2- 172.21.15.53:0/2235817209 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee780afc60 0x7fee7814ed80 secure :-1 s=READY pgs=2299 cs=0 l=1 rev1=1 crypto rx=0x7fee6800c7f0 tx=0x7fee6800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:59.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.706+0000 7fee6e7fc640 1 -- 172.21.15.53:0/2235817209 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee68007820 con 0x7fee780afc60 2023-06-10T19:06:59.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.706+0000 7fee6e7fc640 1 -- 172.21.15.53:0/2235817209 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee68007980 con 0x7fee780afc60 2023-06-10T19:06:59.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.706+0000 7fee801e2640 1 -- 172.21.15.53:0/2235817209 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee78150720 con 0x7fee780afc60 2023-06-10T19:06:59.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.706+0000 7fee6e7fc640 1 -- 172.21.15.53:0/2235817209 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee68007d10 con 0x7fee780afc60 2023-06-10T19:06:59.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.706+0000 7fee801e2640 1 -- 172.21.15.53:0/2235817209 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee7814f2c0 con 0x7fee780afc60 2023-06-10T19:06:59.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.710+0000 7fee801e2640 1 -- 172.21.15.53:0/2235817209 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee780c1a70 con 0x7fee780afc60 2023-06-10T19:06:59.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.710+0000 7fee6e7fc640 1 -- 172.21.15.53:0/2235817209 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fee680113f0 con 0x7fee780afc60 2023-06-10T19:06:59.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.710+0000 7fee6e7fc640 1 --2- 172.21.15.53:0/2235817209 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fee5c066280 0x7fee5c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:06:59.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.710+0000 7fee6e7fc640 1 -- 172.21.15.53:0/2235817209 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6105+0+0 (secure 0 0 0) 0x7fee68084040 con 0x7fee780afc60 2023-06-10T19:06:59.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.710+0000 7fee7df7e640 1 --2- 172.21.15.53:0/2235817209 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fee5c066280 0x7fee5c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:06:59.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.710+0000 7fee7df7e640 1 --2- 172.21.15.53:0/2235817209 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fee5c066280 0x7fee5c068730 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fee740ad000 tx=0x7fee74008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:06:59.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.714+0000 7fee6e7fc640 1 -- 172.21.15.53:0/2235817209 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fee780c1a70 con 0x7fee780afc60 2023-06-10T19:06:59.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.898+0000 7fee801e2640 1 -- 172.21.15.53:0/2235817209 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fee780c1a70 con 0x7fee780afc60 2023-06-10T19:06:59.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.902+0000 7fee6e7fc640 1 -- 172.21.15.53:0/2235817209 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) v1 ==== 94+0+4679 (secure 0 0 0) 0x7fee780c1a70 con 0x7fee780afc60 2023-06-10T19:06:59.903 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:06:59.904 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":89,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/67248348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":67248348},{"type":"v1","addr":"172.21.15.117:6835","nonce":67248348}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":84},{"gid":8296,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3907684243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":3907684243},{"type":"v1","addr":"172.21.15.117:6837","nonce":3907684243}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":84},{"gid":10038,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/1699177406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":1699177406},{"type":"v1","addr":"172.21.15.53:6833","nonce":1699177406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":84}],"filesystems":[{"mdsmap":{"epoch":89,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:06:28.716939+0000","modified":"2023-06-10T19:06:32.084420+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10044},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10044":{"gid":10044,"name":"a","rank":0,"incarnation":85,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/2077620799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2077620799},{"type":"v1","addr":"172.21.15.53:6835","nonce":2077620799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-06-10T19:06:59.904 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 89 2023-06-10T19:06:59.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.902+0000 7fee801e2640 1 -- 172.21.15.53:0/2235817209 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fee5c066280 msgr2=0x7fee5c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:59.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.902+0000 7fee801e2640 1 --2- 172.21.15.53:0/2235817209 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fee5c066280 0x7fee5c068730 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fee740ad000 tx=0x7fee74008040 comp rx=0 tx=0).stop 2023-06-10T19:06:59.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.902+0000 7fee801e2640 1 -- 172.21.15.53:0/2235817209 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee780afc60 msgr2=0x7fee7814ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:06:59.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.902+0000 7fee801e2640 1 --2- 172.21.15.53:0/2235817209 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee780afc60 0x7fee7814ed80 secure :-1 s=READY pgs=2299 cs=0 l=1 rev1=1 crypto rx=0x7fee6800c7f0 tx=0x7fee6800ccb0 comp rx=0 tx=0).stop 2023-06-10T19:06:59.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.902+0000 7fee801e2640 1 -- 172.21.15.53:0/2235817209 shutdown_connections 2023-06-10T19:06:59.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.902+0000 7fee801e2640 1 --2- 172.21.15.53:0/2235817209 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fee5c066280 0x7fee5c068730 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:59.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.902+0000 7fee801e2640 1 --2- 172.21.15.53:0/2235817209 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee780c9840 0x7fee780c4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:59.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.902+0000 7fee801e2640 1 --2- 172.21.15.53:0/2235817209 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee780afc60 0x7fee7814ed80 unknown :-1 s=CLOSED pgs=2299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:59.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.902+0000 7fee801e2640 1 --2- 172.21.15.53:0/2235817209 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fee78071060 0x7fee780c61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:06:59.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.902+0000 7fee801e2640 1 -- 172.21.15.53:0/2235817209 >> 172.21.15.53:0/2235817209 conn(0x7fee7806a0d0 msgr2=0x7fee78159c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:06:59.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.902+0000 7fee801e2640 1 -- 172.21.15.53:0/2235817209 shutdown_connections 2023-06-10T19:06:59.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:06:59.902+0000 7fee801e2640 1 -- 172.21.15.53:0/2235817209 wait complete. 2023-06-10T19:06:59.922 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:07:00.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.042+0000 7fc8d3fba640 1 Processor -- start 2023-06-10T19:07:00.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.042+0000 7fc8d3fba640 1 -- start start 2023-06-10T19:07:00.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.042+0000 7fc8d3fba640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc8cc06b780 0x7fc8cc15c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:00.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.042+0000 7fc8d3fba640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc8cc06bb50 0x7fc8cc15f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:00.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.042+0000 7fc8d3fba640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8cc0af530 con 0x7fc8cc15f860 2023-06-10T19:07:00.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.042+0000 7fc8d3fba640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8cc15c3d0 con 0x7fc8cc06b780 2023-06-10T19:07:00.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.042+0000 7fc8d3fba640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8cc15fd70 con 0x7fc8cc06bb50 2023-06-10T19:07:00.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.042+0000 7fc8d2557640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fc8cc15f860 0x7fc8cc0ceb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:47808/0 (socket says 172.21.15.53:47808) 2023-06-10T19:07:00.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.042+0000 7fc8d2557640 1 -- 172.21.15.53:0/4243212363 learned_addr learned my addr 172.21.15.53:0/4243212363 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:07:00.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.042+0000 7fc8d1d56640 1 --2- 172.21.15.53:0/4243212363 >> v2:172.21.15.53:3300/0 conn(0x7fc8cc06b780 0x7fc8cc15c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:00.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.042+0000 7fc8d1555640 1 --2- 172.21.15.53:0/4243212363 >> v2:172.21.15.117:3300/0 conn(0x7fc8cc06bb50 0x7fc8cc15f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:00.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.042+0000 7fc8d0d54640 1 -- 172.21.15.53:0/4243212363 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1898768953 0 0) 0x7fc8cc0af530 con 0x7fc8cc15f860 2023-06-10T19:07:00.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.042+0000 7fc8d0d54640 1 -- 172.21.15.53:0/4243212363 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8b8003530 con 0x7fc8cc15f860 2023-06-10T19:07:00.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.042+0000 7fc8d1d56640 1 -- 172.21.15.53:0/4243212363 >> v2:172.21.15.117:3300/0 conn(0x7fc8cc06bb50 msgr2=0x7fc8cc15f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:00.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.042+0000 7fc8d1d56640 1 --2- 172.21.15.53:0/4243212363 >> v2:172.21.15.117:3300/0 conn(0x7fc8cc06bb50 0x7fc8cc15f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:00.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.042+0000 7fc8d1d56640 1 -- 172.21.15.53:0/4243212363 >> v1:172.21.15.53:6789/0 conn(0x7fc8cc15f860 legacy=0x7fc8cc0ceb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:00.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.042+0000 7fc8d1d56640 1 -- 172.21.15.53:0/4243212363 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8cc160050 con 0x7fc8cc06b780 2023-06-10T19:07:00.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.046+0000 7fc8d1d56640 1 --2- 172.21.15.53:0/4243212363 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8cc06b780 0x7fc8cc15c7f0 secure :-1 s=READY pgs=2301 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc0cdad0 tx=0x7fc8c801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c5636442eb2d726 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:00.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.046+0000 7fc8d0d54640 1 -- 172.21.15.53:0/4243212363 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c80ab600 con 0x7fc8cc06b780 2023-06-10T19:07:00.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.046+0000 7fc8d0d54640 1 -- 172.21.15.53:0/4243212363 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8c80a7050 con 0x7fc8cc06b780 2023-06-10T19:07:00.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.046+0000 7fc8d0d54640 1 -- 172.21.15.53:0/4243212363 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c80ab960 con 0x7fc8cc06b780 2023-06-10T19:07:00.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.046+0000 7fc8d3fba640 1 -- 172.21.15.53:0/4243212363 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8cc06b780 msgr2=0x7fc8cc15c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:00.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.046+0000 7fc8d3fba640 1 --2- 172.21.15.53:0/4243212363 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8cc06b780 0x7fc8cc15c7f0 secure :-1 s=READY pgs=2301 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc0cdad0 tx=0x7fc8c801c3d0 comp rx=0 tx=0).stop 2023-06-10T19:07:00.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.046+0000 7fc8d3fba640 1 -- 172.21.15.53:0/4243212363 shutdown_connections 2023-06-10T19:07:00.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.046+0000 7fc8d3fba640 1 --2- 172.21.15.53:0/4243212363 >> v2:172.21.15.117:3300/0 conn(0x7fc8cc06bb50 0x7fc8cc15f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:00.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.046+0000 7fc8d3fba640 1 --2- 172.21.15.53:0/4243212363 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8cc06b780 0x7fc8cc15c7f0 unknown :-1 s=CLOSED pgs=2301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:00.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.046+0000 7fc8d3fba640 1 -- 172.21.15.53:0/4243212363 >> 172.21.15.53:0/4243212363 conn(0x7fc8cc06a090 msgr2=0x7fc8cc06d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:00.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.046+0000 7fc8d3fba640 1 -- 172.21.15.53:0/4243212363 shutdown_connections 2023-06-10T19:07:00.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.046+0000 7fc8d3fba640 1 -- 172.21.15.53:0/4243212363 wait complete. 2023-06-10T19:07:00.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.046+0000 7fc8d3fba640 1 Processor -- start 2023-06-10T19:07:00.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.046+0000 7fc8d3fba640 1 -- start start 2023-06-10T19:07:00.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.046+0000 7fc8d3fba640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8cc06b780 0x7fc8cc15b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:00.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.046+0000 7fc8d3fba640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8cc06bb50 0x7fc8cc14c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:00.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.046+0000 7fc8d3fba640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8cc15f860 0x7fc8cc15c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:00.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.046+0000 7fc8d3fba640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8cc152dd0 con 0x7fc8cc15f860 2023-06-10T19:07:00.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.046+0000 7fc8d3fba640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8cc0c58f0 con 0x7fc8cc06bb50 2023-06-10T19:07:00.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.046+0000 7fc8d3fba640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8cc152fe0 con 0x7fc8cc06b780 2023-06-10T19:07:00.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.046+0000 7fc8d2557640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8cc15f860 0x7fc8cc15c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:00.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.046+0000 7fc8d2557640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8cc15f860 0x7fc8cc15c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49032/0 (socket says 172.21.15.53:49032) 2023-06-10T19:07:00.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.046+0000 7fc8d2557640 1 -- 172.21.15.53:0/3573717743 learned_addr learned my addr 172.21.15.53:0/3573717743 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:00.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.046+0000 7fc8d1d56640 1 --2- 172.21.15.53:0/3573717743 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8cc06b780 0x7fc8cc15b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:00.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.046+0000 7fc8d1555640 1 --2- 172.21.15.53:0/3573717743 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8cc06bb50 0x7fc8cc14c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:00.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.046+0000 7fc8d2557640 1 -- 172.21.15.53:0/3573717743 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8cc06b780 msgr2=0x7fc8cc15b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:00.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.046+0000 7fc8d2557640 1 --2- 172.21.15.53:0/3573717743 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8cc06b780 0x7fc8cc15b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:00.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.046+0000 7fc8d2557640 1 -- 172.21.15.53:0/3573717743 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8cc06bb50 msgr2=0x7fc8cc14c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:00.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.046+0000 7fc8d2557640 1 --2- 172.21.15.53:0/3573717743 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8cc06bb50 0x7fc8cc14c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:00.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.046+0000 7fc8d2557640 1 -- 172.21.15.53:0/3573717743 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8c8009420 con 0x7fc8cc15f860 2023-06-10T19:07:00.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.046+0000 7fc8d2557640 1 --2- 172.21.15.53:0/3573717743 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8cc15f860 0x7fc8cc15c7d0 secure :-1 s=READY pgs=2302 cs=0 l=1 rev1=1 crypto rx=0x7fc8c400cbb0 tx=0x7fc8c400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:00.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.046+0000 7fc8c27fc640 1 -- 172.21.15.53:0/3573717743 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c400ad40 con 0x7fc8cc15f860 2023-06-10T19:07:00.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.046+0000 7fc8c27fc640 1 -- 172.21.15.53:0/3573717743 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8c4012400 con 0x7fc8cc15f860 2023-06-10T19:07:00.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.046+0000 7fc8d3fba640 1 -- 172.21.15.53:0/3573717743 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8cc1532c0 con 0x7fc8cc15f860 2023-06-10T19:07:00.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.046+0000 7fc8c27fc640 1 -- 172.21.15.53:0/3573717743 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c400aea0 con 0x7fc8cc15f860 2023-06-10T19:07:00.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.046+0000 7fc8d3fba640 1 -- 172.21.15.53:0/3573717743 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8cc15b8e0 con 0x7fc8cc15f860 2023-06-10T19:07:00.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.050+0000 7fc8d3fba640 1 -- 172.21.15.53:0/3573717743 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8cc1534e0 con 0x7fc8cc15f860 2023-06-10T19:07:00.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.050+0000 7fc8c27fc640 1 -- 172.21.15.53:0/3573717743 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc8c4007070 con 0x7fc8cc15f860 2023-06-10T19:07:00.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.050+0000 7fc8c27fc640 1 --2- 172.21.15.53:0/3573717743 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc8b0066280 0x7fc8b0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:00.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.050+0000 7fc8c27fc640 1 -- 172.21.15.53:0/3573717743 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6105+0+0 (secure 0 0 0) 0x7fc8c4083ce0 con 0x7fc8cc15f860 2023-06-10T19:07:00.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.050+0000 7fc8d1d56640 1 --2- 172.21.15.53:0/3573717743 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc8b0066280 0x7fc8b0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:00.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.050+0000 7fc8d1d56640 1 --2- 172.21.15.53:0/3573717743 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc8b0066280 0x7fc8b0068730 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fc8c80ad000 tx=0x7fc8c8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:00.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.054+0000 7fc8c27fc640 1 -- 172.21.15.53:0/3573717743 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc8c4051140 con 0x7fc8cc15f860 2023-06-10T19:07:00.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.206+0000 7fc8d3fba640 1 -- 172.21.15.53:0/3573717743 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc8cc04d790 con 0x7fc8cc15f860 2023-06-10T19:07:00.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.206+0000 7fc8c27fc640 1 -- 172.21.15.53:0/3573717743 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v155) v1 ==== 74+0+18349 (secure 0 0 0) 0x7fc8c4017090 con 0x7fc8cc15f860 2023-06-10T19:07:00.210 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:07:00.210 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":155,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:06:50.154677+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-06-10T19:06:27.279397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-06-10T19:06:27.689260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"154","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.0.1:0/2213488734":"2023-06-10T20:06:49.780814+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:07:00.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.210+0000 7fc8d3fba640 1 -- 172.21.15.53:0/3573717743 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc8b0066280 msgr2=0x7fc8b0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:00.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.210+0000 7fc8d3fba640 1 --2- 172.21.15.53:0/3573717743 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc8b0066280 0x7fc8b0068730 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fc8c80ad000 tx=0x7fc8c8008040 comp rx=0 tx=0).stop 2023-06-10T19:07:00.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.210+0000 7fc8d3fba640 1 -- 172.21.15.53:0/3573717743 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8cc15f860 msgr2=0x7fc8cc15c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:00.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.210+0000 7fc8d3fba640 1 --2- 172.21.15.53:0/3573717743 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8cc15f860 0x7fc8cc15c7d0 secure :-1 s=READY pgs=2302 cs=0 l=1 rev1=1 crypto rx=0x7fc8c400cbb0 tx=0x7fc8c400a430 comp rx=0 tx=0).stop 2023-06-10T19:07:00.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.210+0000 7fc8d3fba640 1 -- 172.21.15.53:0/3573717743 shutdown_connections 2023-06-10T19:07:00.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.210+0000 7fc8d3fba640 1 --2- 172.21.15.53:0/3573717743 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc8b0066280 0x7fc8b0068730 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:00.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.210+0000 7fc8d3fba640 1 --2- 172.21.15.53:0/3573717743 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8cc15f860 0x7fc8cc15c7d0 unknown :-1 s=CLOSED pgs=2302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:00.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.210+0000 7fc8d3fba640 1 --2- 172.21.15.53:0/3573717743 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8cc06bb50 0x7fc8cc14c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:00.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.210+0000 7fc8d3fba640 1 --2- 172.21.15.53:0/3573717743 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8cc06b780 0x7fc8cc15b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:00.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.210+0000 7fc8d3fba640 1 -- 172.21.15.53:0/3573717743 >> 172.21.15.53:0/3573717743 conn(0x7fc8cc06a090 msgr2=0x7fc8cc155070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:00.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.210+0000 7fc8d3fba640 1 -- 172.21.15.53:0/3573717743 shutdown_connections 2023-06-10T19:07:00.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.210+0000 7fc8d3fba640 1 -- 172.21.15.53:0/3573717743 wait complete. 2023-06-10T19:07:00.228 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-10T18:52:33.633114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-10T18:52:39.171487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 21, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-10T19:06:27.279397+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '153', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 22, 'pool_name': 'cephfs_data', 'create_time': '2023-06-10T19:06:27.689260+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '154', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-10T19:07:00.229 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-10T19:07:00.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.354+0000 7f43852ab640 1 Processor -- start 2023-06-10T19:07:00.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.354+0000 7f43852ab640 1 -- start start 2023-06-10T19:07:00.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.354+0000 7f43852ab640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f438006eca0 0x7f438006f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:00.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.354+0000 7f43852ab640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f43800cfd90 0x7f438015fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:00.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.354+0000 7f43852ab640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43800ccda0 con 0x7f43800af0e0 2023-06-10T19:07:00.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.354+0000 7f43852ab640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f438006f5b0 con 0x7f43800cfd90 2023-06-10T19:07:00.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.354+0000 7f43852ab640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f438006a920 con 0x7f438006eca0 2023-06-10T19:07:00.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.354+0000 7f437f7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f43800cfd90 0x7f438015fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:00.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.354+0000 7f437f7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f43800cfd90 0x7f438015fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49046/0 (socket says 172.21.15.53:49046) 2023-06-10T19:07:00.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.354+0000 7f437f7fe640 1 -- 172.21.15.53:0/356455271 learned_addr learned my addr 172.21.15.53:0/356455271 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:00.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.354+0000 7f437effd640 1 --2- 172.21.15.53:0/356455271 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f438006eca0 0x7f438006f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:00.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.354+0000 7f437f7fe640 1 -- 172.21.15.53:0/356455271 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f438006eca0 msgr2=0x7f438006f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:00.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.354+0000 7f437f7fe640 1 --2- 172.21.15.53:0/356455271 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f438006eca0 0x7f438006f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:00.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.354+0000 7f437f7fe640 1 -- 172.21.15.53:0/356455271 >> v1:172.21.15.117:6789/0 conn(0x7f43800af0e0 legacy=0x7f438015f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:00.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.354+0000 7f437f7fe640 1 -- 172.21.15.53:0/356455271 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f438006ac00 con 0x7f43800cfd90 2023-06-10T19:07:00.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.358+0000 7f437f7fe640 1 --2- 172.21.15.53:0/356455271 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43800cfd90 0x7f438015fe10 secure :-1 s=READY pgs=2303 cs=0 l=1 rev1=1 crypto rx=0x7f4378009e50 tx=0x7f437801f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=117931e71191f559 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:00.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.358+0000 7f437dffb640 1 -- 172.21.15.53:0/356455271 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43780af400 con 0x7f43800cfd90 2023-06-10T19:07:00.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.358+0000 7f437dffb640 1 -- 172.21.15.53:0/356455271 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43780ab050 con 0x7f43800cfd90 2023-06-10T19:07:00.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.358+0000 7f437dffb640 1 -- 172.21.15.53:0/356455271 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43780af780 con 0x7f43800cfd90 2023-06-10T19:07:00.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.358+0000 7f43852ab640 1 -- 172.21.15.53:0/356455271 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43800cfd90 msgr2=0x7f438015fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:00.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.358+0000 7f43852ab640 1 --2- 172.21.15.53:0/356455271 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43800cfd90 0x7f438015fe10 secure :-1 s=READY pgs=2303 cs=0 l=1 rev1=1 crypto rx=0x7f4378009e50 tx=0x7f437801f1c0 comp rx=0 tx=0).stop 2023-06-10T19:07:00.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.358+0000 7f43852ab640 1 -- 172.21.15.53:0/356455271 shutdown_connections 2023-06-10T19:07:00.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.358+0000 7f43852ab640 1 --2- 172.21.15.53:0/356455271 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43800cfd90 0x7f438015fe10 unknown :-1 s=CLOSED pgs=2303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:00.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.358+0000 7f43852ab640 1 --2- 172.21.15.53:0/356455271 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f438006eca0 0x7f438006f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:00.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.358+0000 7f43852ab640 1 -- 172.21.15.53:0/356455271 >> 172.21.15.53:0/356455271 conn(0x7f438006a0e0 msgr2=0x7f438006d270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:00.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.358+0000 7f43852ab640 1 -- 172.21.15.53:0/356455271 shutdown_connections 2023-06-10T19:07:00.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.358+0000 7f43852ab640 1 -- 172.21.15.53:0/356455271 wait complete. 2023-06-10T19:07:00.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.358+0000 7f43852ab640 1 Processor -- start 2023-06-10T19:07:00.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.358+0000 7f43852ab640 1 -- start start 2023-06-10T19:07:00.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.362+0000 7f43852ab640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f438006eca0 0x7f4380159e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:00.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.362+0000 7f43852ab640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43800af0e0 0x7f438015e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:00.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.362+0000 7f43852ab640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f43800cfd90 0x7f438015e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:00.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.362+0000 7f43852ab640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43800ad3b0 con 0x7f43800af0e0 2023-06-10T19:07:00.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.362+0000 7f43852ab640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43800aca10 con 0x7f438006eca0 2023-06-10T19:07:00.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.362+0000 7f43852ab640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43800accf0 con 0x7f43800cfd90 2023-06-10T19:07:00.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.362+0000 7f437e7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43800af0e0 0x7f438015e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:00.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.362+0000 7f437e7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43800af0e0 0x7f438015e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49050/0 (socket says 172.21.15.53:49050) 2023-06-10T19:07:00.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.362+0000 7f437e7fc640 1 -- 172.21.15.53:0/244912520 learned_addr learned my addr 172.21.15.53:0/244912520 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:00.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.362+0000 7f437f7fe640 1 --2- 172.21.15.53:0/244912520 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f43800cfd90 0x7f438015e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:00.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.362+0000 7f437effd640 1 --2- 172.21.15.53:0/244912520 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f438006eca0 0x7f4380159e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:00.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.362+0000 7f437e7fc640 1 -- 172.21.15.53:0/244912520 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f43800cfd90 msgr2=0x7f438015e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:00.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.362+0000 7f437e7fc640 1 --2- 172.21.15.53:0/244912520 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f43800cfd90 0x7f438015e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:00.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.362+0000 7f437e7fc640 1 -- 172.21.15.53:0/244912520 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f438006eca0 msgr2=0x7f4380159e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:00.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.362+0000 7f437e7fc640 1 --2- 172.21.15.53:0/244912520 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f438006eca0 0x7f4380159e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:00.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.362+0000 7f437e7fc640 1 -- 172.21.15.53:0/244912520 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4378009b30 con 0x7f43800af0e0 2023-06-10T19:07:00.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.362+0000 7f437e7fc640 1 --2- 172.21.15.53:0/244912520 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43800af0e0 0x7f438015e110 secure :-1 s=READY pgs=2304 cs=0 l=1 rev1=1 crypto rx=0x7f437400c450 tx=0x7f437400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:00.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.362+0000 7f43677fe640 1 -- 172.21.15.53:0/244912520 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4374012830 con 0x7f43800af0e0 2023-06-10T19:07:00.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.362+0000 7f43677fe640 1 -- 172.21.15.53:0/244912520 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43740129b0 con 0x7f43800af0e0 2023-06-10T19:07:00.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.362+0000 7f43852ab640 1 -- 172.21.15.53:0/244912520 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43800acfd0 con 0x7f43800af0e0 2023-06-10T19:07:00.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.362+0000 7f43677fe640 1 -- 172.21.15.53:0/244912520 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4374012d60 con 0x7f43800af0e0 2023-06-10T19:07:00.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.362+0000 7f43852ab640 1 -- 172.21.15.53:0/244912520 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43800b2fd0 con 0x7f43800af0e0 2023-06-10T19:07:00.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.362+0000 7f43852ab640 1 -- 172.21.15.53:0/244912520 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43800ad4f0 con 0x7f43800af0e0 2023-06-10T19:07:00.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.362+0000 7f43677fe640 1 -- 172.21.15.53:0/244912520 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f437401c460 con 0x7f43800af0e0 2023-06-10T19:07:00.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.362+0000 7f43677fe640 1 --2- 172.21.15.53:0/244912520 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f436c0662b0 0x7f436c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:00.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.362+0000 7f43677fe640 1 -- 172.21.15.53:0/244912520 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6105+0+0 (secure 0 0 0) 0x7f4374083bb0 con 0x7f43800af0e0 2023-06-10T19:07:00.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.362+0000 7f437effd640 1 --2- 172.21.15.53:0/244912520 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f436c0662b0 0x7f436c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:00.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.366+0000 7f437effd640 1 --2- 172.21.15.53:0/244912520 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f436c0662b0 0x7f436c068760 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f437000b930 tx=0x7f4370008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:00.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.366+0000 7f43677fe640 1 -- 172.21.15.53:0/244912520 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f43800ad4f0 con 0x7f43800af0e0 2023-06-10T19:07:00.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.518+0000 7f43852ab640 1 -- 172.21.15.53:0/244912520 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f43800ad4f0 con 0x7f43800af0e0 2023-06-10T19:07:00.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.518+0000 7f43677fe640 1 -- 172.21.15.53:0/244912520 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v155) v1 ==== 93+0+10 (secure 0 0 0) 0x7f43800ad4f0 con 0x7f43800af0e0 2023-06-10T19:07:00.520 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-06-10T19:07:00.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.518+0000 7f43852ab640 1 -- 172.21.15.53:0/244912520 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f436c0662b0 msgr2=0x7f436c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:00.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.518+0000 7f43852ab640 1 --2- 172.21.15.53:0/244912520 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f436c0662b0 0x7f436c068760 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f437000b930 tx=0x7f4370008040 comp rx=0 tx=0).stop 2023-06-10T19:07:00.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.518+0000 7f43852ab640 1 -- 172.21.15.53:0/244912520 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43800af0e0 msgr2=0x7f438015e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:00.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.518+0000 7f43852ab640 1 --2- 172.21.15.53:0/244912520 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43800af0e0 0x7f438015e110 secure :-1 s=READY pgs=2304 cs=0 l=1 rev1=1 crypto rx=0x7f437400c450 tx=0x7f437400c910 comp rx=0 tx=0).stop 2023-06-10T19:07:00.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.518+0000 7f43852ab640 1 -- 172.21.15.53:0/244912520 shutdown_connections 2023-06-10T19:07:00.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.518+0000 7f43852ab640 1 --2- 172.21.15.53:0/244912520 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f436c0662b0 0x7f436c068760 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:00.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.518+0000 7f43852ab640 1 --2- 172.21.15.53:0/244912520 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f43800cfd90 0x7f438015e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:00.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.518+0000 7f43852ab640 1 --2- 172.21.15.53:0/244912520 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43800af0e0 0x7f438015e110 unknown :-1 s=CLOSED pgs=2304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:00.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.518+0000 7f43852ab640 1 --2- 172.21.15.53:0/244912520 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f438006eca0 0x7f4380159e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:00.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.518+0000 7f43852ab640 1 -- 172.21.15.53:0/244912520 >> 172.21.15.53:0/244912520 conn(0x7f438006a0e0 msgr2=0x7f43800c6080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:00.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.518+0000 7f43852ab640 1 -- 172.21.15.53:0/244912520 shutdown_connections 2023-06-10T19:07:00.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.518+0000 7f43852ab640 1 -- 172.21.15.53:0/244912520 wait complete. 2023-06-10T19:07:00.537 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-10T19:07:00.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.662+0000 7fa56fbcb640 1 Processor -- start 2023-06-10T19:07:00.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.662+0000 7fa56fbcb640 1 -- start start 2023-06-10T19:07:00.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.662+0000 7fa56fbcb640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5680ad730 0x7fa5680713a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:00.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.662+0000 7fa56fbcb640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa568070f10 con 0x7fa568159630 2023-06-10T19:07:00.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.662+0000 7fa56fbcb640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa56815db60 con 0x7fa5680718e0 2023-06-10T19:07:00.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.662+0000 7fa56fbcb640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa56815d970 con 0x7fa5680ad730 2023-06-10T19:07:00.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.662+0000 7fa56d967640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fa568159630 0x7fa56815d260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:47810/0 (socket says 172.21.15.53:47810) 2023-06-10T19:07:00.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.662+0000 7fa56d967640 1 -- 172.21.15.53:0/2025912430 learned_addr learned my addr 172.21.15.53:0/2025912430 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:07:00.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.662+0000 7fa56d166640 1 --2- 172.21.15.53:0/2025912430 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5680ad730 0x7fa5680713a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:00.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.662+0000 7fa56c965640 1 -- 172.21.15.53:0/2025912430 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3597133183 0 0) 0x7fa568070f10 con 0x7fa568159630 2023-06-10T19:07:00.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.662+0000 7fa56c965640 1 -- 172.21.15.53:0/2025912430 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa554003530 con 0x7fa568159630 2023-06-10T19:07:00.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.662+0000 7fa56c965640 1 -- 172.21.15.53:0/2025912430 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2614214474 0 0) 0x7fa554003530 con 0x7fa568159630 2023-06-10T19:07:00.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.662+0000 7fa56c965640 1 -- 172.21.15.53:0/2025912430 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5680ad730 msgr2=0x7fa5680713a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:00.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.662+0000 7fa56c965640 1 --2- 172.21.15.53:0/2025912430 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5680ad730 0x7fa5680713a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:00.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.662+0000 7fa56c965640 1 -- 172.21.15.53:0/2025912430 >> v1:172.21.15.117:6789/0 conn(0x7fa5680718e0 legacy=0x7fa568069450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:00.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.662+0000 7fa56c965640 1 -- 172.21.15.53:0/2025912430 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa56815de40 con 0x7fa568159630 2023-06-10T19:07:00.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.662+0000 7fa56c965640 1 -- 172.21.15.53:0/2025912430 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fa564001680 con 0x7fa568159630 2023-06-10T19:07:00.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.662+0000 7fa56c965640 1 -- 172.21.15.53:0/2025912430 >> v1:172.21.15.53:6789/0 conn(0x7fa568159630 legacy=0x7fa56815d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:00.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.662+0000 7fa56c965640 1 --2- 172.21.15.53:0/2025912430 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5540039b0 0x7fa554003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:00.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.662+0000 7fa56c965640 1 --2- 172.21.15.53:0/2025912430 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5540047d0 0x7fa554004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:00.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.662+0000 7fa56c965640 1 --2- 172.21.15.53:0/2025912430 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa554005180 0x7fa55400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:00.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.662+0000 7fa56c965640 1 -- 172.21.15.53:0/2025912430 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa55400c060 con 0x7fa554005180 2023-06-10T19:07:00.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.662+0000 7fa56c965640 1 -- 172.21.15.53:0/2025912430 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa55400c1a0 con 0x7fa5540047d0 2023-06-10T19:07:00.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.662+0000 7fa56c965640 1 -- 172.21.15.53:0/2025912430 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa55400c310 con 0x7fa5540039b0 2023-06-10T19:07:00.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.662+0000 7fa56d166640 1 --2- 172.21.15.53:0/2025912430 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5680ad730 0x7fa5680713a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:07:00.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.662+0000 7fa56e168640 1 --2- 172.21.15.53:0/2025912430 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa554005180 0x7fa55400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:00.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.662+0000 7fa56d967640 1 --2- 172.21.15.53:0/2025912430 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5540039b0 0x7fa554003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:00.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.662+0000 7fa56e168640 1 -- 172.21.15.53:0/2025912430 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5540039b0 msgr2=0x7fa554003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:00.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.662+0000 7fa56e168640 1 --2- 172.21.15.53:0/2025912430 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5540039b0 0x7fa554003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:00.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.662+0000 7fa56e168640 1 -- 172.21.15.53:0/2025912430 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5540047d0 msgr2=0x7fa554004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:00.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.662+0000 7fa56e168640 1 --2- 172.21.15.53:0/2025912430 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5540047d0 0x7fa554004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:00.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.662+0000 7fa56e168640 1 -- 172.21.15.53:0/2025912430 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa554003530 con 0x7fa554005180 2023-06-10T19:07:00.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.662+0000 7fa56d967640 1 --2- 172.21.15.53:0/2025912430 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5540039b0 0x7fa554003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:07:00.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.666+0000 7fa56e168640 1 --2- 172.21.15.53:0/2025912430 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa554005180 0x7fa55400b990 secure :-1 s=READY pgs=2306 cs=0 l=1 rev1=1 crypto rx=0x7fa560001e70 tx=0x7fa56001c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3eca96cbd1ed852 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:00.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.666+0000 7fa56c965640 1 -- 172.21.15.53:0/2025912430 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa560003b80 con 0x7fa554005180 2023-06-10T19:07:00.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.666+0000 7fa56c965640 1 -- 172.21.15.53:0/2025912430 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa560003ce0 con 0x7fa554005180 2023-06-10T19:07:00.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.666+0000 7fa56c965640 1 -- 172.21.15.53:0/2025912430 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5600052c0 con 0x7fa554005180 2023-06-10T19:07:00.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.666+0000 7fa56fbcb640 1 -- 172.21.15.53:0/2025912430 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa554005180 msgr2=0x7fa55400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:00.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.666+0000 7fa56fbcb640 1 --2- 172.21.15.53:0/2025912430 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa554005180 0x7fa55400b990 secure :-1 s=READY pgs=2306 cs=0 l=1 rev1=1 crypto rx=0x7fa560001e70 tx=0x7fa56001c760 comp rx=0 tx=0).stop 2023-06-10T19:07:00.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.666+0000 7fa56e168640 1 -- 172.21.15.53:0/2025912430 reap_dead start 2023-06-10T19:07:00.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.666+0000 7fa56fbcb640 1 -- 172.21.15.53:0/2025912430 shutdown_connections 2023-06-10T19:07:00.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.666+0000 7fa56fbcb640 1 -- 172.21.15.53:0/2025912430 >> 172.21.15.53:0/2025912430 conn(0x7fa5680cafc0 msgr2=0x7fa5680cb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:00.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.666+0000 7fa56fbcb640 1 -- 172.21.15.53:0/2025912430 shutdown_connections 2023-06-10T19:07:00.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.666+0000 7fa56fbcb640 1 -- 172.21.15.53:0/2025912430 wait complete. 2023-06-10T19:07:00.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.666+0000 7fa56fbcb640 1 Processor -- start 2023-06-10T19:07:00.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.666+0000 7fa56fbcb640 1 -- start start 2023-06-10T19:07:00.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.670+0000 7fa56fbcb640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa568153db0 0x7fa56815b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:00.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.670+0000 7fa56fbcb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa56815bd10 0x7fa5680c5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:00.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.670+0000 7fa56fbcb640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5680c5b50 0x7fa56815a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:00.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.670+0000 7fa56fbcb640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5680b0b20 con 0x7fa56815bd10 2023-06-10T19:07:00.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.670+0000 7fa56fbcb640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5680c7910 con 0x7fa568153db0 2023-06-10T19:07:00.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.670+0000 7fa56fbcb640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5680c5fd0 con 0x7fa5680c5b50 2023-06-10T19:07:00.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.670+0000 7fa56d166640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa56815bd10 0x7fa5680c5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:00.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.670+0000 7fa56d166640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa56815bd10 0x7fa5680c5610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49072/0 (socket says 172.21.15.53:49072) 2023-06-10T19:07:00.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.670+0000 7fa56d166640 1 -- 172.21.15.53:0/209195319 learned_addr learned my addr 172.21.15.53:0/209195319 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:00.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.670+0000 7fa56e168640 1 --2- 172.21.15.53:0/209195319 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5680c5b50 0x7fa56815a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:00.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.670+0000 7fa56d967640 1 --2- 172.21.15.53:0/209195319 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa568153db0 0x7fa56815b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:00.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.670+0000 7fa56d166640 1 -- 172.21.15.53:0/209195319 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5680c5b50 msgr2=0x7fa56815a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:00.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.670+0000 7fa56d166640 1 --2- 172.21.15.53:0/209195319 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5680c5b50 0x7fa56815a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:00.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.670+0000 7fa56d166640 1 -- 172.21.15.53:0/209195319 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa568153db0 msgr2=0x7fa56815b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:00.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.670+0000 7fa56d166640 1 --2- 172.21.15.53:0/209195319 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa568153db0 0x7fa56815b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:00.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.670+0000 7fa56d166640 1 -- 172.21.15.53:0/209195319 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa568154180 con 0x7fa56815bd10 2023-06-10T19:07:00.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.670+0000 7fa56d166640 1 --2- 172.21.15.53:0/209195319 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa56815bd10 0x7fa5680c5610 secure :-1 s=READY pgs=2307 cs=0 l=1 rev1=1 crypto rx=0x7fa55800d410 tx=0x7fa55800d500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:00.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.670+0000 7fa55e7fc640 1 -- 172.21.15.53:0/209195319 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa558013480 con 0x7fa56815bd10 2023-06-10T19:07:00.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.670+0000 7fa55e7fc640 1 -- 172.21.15.53:0/209195319 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa558013600 con 0x7fa56815bd10 2023-06-10T19:07:00.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.670+0000 7fa55e7fc640 1 -- 172.21.15.53:0/209195319 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5580139b0 con 0x7fa56815bd10 2023-06-10T19:07:00.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.670+0000 7fa56fbcb640 1 -- 172.21.15.53:0/209195319 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5680aff10 con 0x7fa56815bd10 2023-06-10T19:07:00.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.670+0000 7fa56fbcb640 1 -- 172.21.15.53:0/209195319 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5680b04d0 con 0x7fa56815bd10 2023-06-10T19:07:00.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.670+0000 7fa56fbcb640 1 -- 172.21.15.53:0/209195319 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5680cbd00 con 0x7fa56815bd10 2023-06-10T19:07:00.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.670+0000 7fa55e7fc640 1 -- 172.21.15.53:0/209195319 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa558013b10 con 0x7fa56815bd10 2023-06-10T19:07:00.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.670+0000 7fa55e7fc640 1 --2- 172.21.15.53:0/209195319 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa54c066280 0x7fa54c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:00.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.674+0000 7fa55e7fc640 1 -- 172.21.15.53:0/209195319 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6105+0+0 (secure 0 0 0) 0x7fa5580839d0 con 0x7fa56815bd10 2023-06-10T19:07:00.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.674+0000 7fa56d967640 1 --2- 172.21.15.53:0/209195319 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa54c066280 0x7fa54c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:00.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.674+0000 7fa56d967640 1 --2- 172.21.15.53:0/209195319 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa54c066280 0x7fa54c068730 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fa564001210 tx=0x7fa564009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:00.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.678+0000 7fa55e7fc640 1 -- 172.21.15.53:0/209195319 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa558050d80 con 0x7fa56815bd10 2023-06-10T19:07:00.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.830+0000 7fa56fbcb640 1 -- 172.21.15.53:0/209195319 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa5680c7a80 con 0x7fa56815bd10 2023-06-10T19:07:00.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.830+0000 7fa55e7fc640 1 -- 172.21.15.53:0/209195319 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v155) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa5680c7a80 con 0x7fa56815bd10 2023-06-10T19:07:00.834 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-06-10T19:07:00.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.834+0000 7fa56fbcb640 1 -- 172.21.15.53:0/209195319 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa54c066280 msgr2=0x7fa54c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:00.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.834+0000 7fa56fbcb640 1 --2- 172.21.15.53:0/209195319 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa54c066280 0x7fa54c068730 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fa564001210 tx=0x7fa564009040 comp rx=0 tx=0).stop 2023-06-10T19:07:00.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.834+0000 7fa56fbcb640 1 -- 172.21.15.53:0/209195319 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa56815bd10 msgr2=0x7fa5680c5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:00.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.834+0000 7fa56fbcb640 1 --2- 172.21.15.53:0/209195319 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa56815bd10 0x7fa5680c5610 secure :-1 s=READY pgs=2307 cs=0 l=1 rev1=1 crypto rx=0x7fa55800d410 tx=0x7fa55800d500 comp rx=0 tx=0).stop 2023-06-10T19:07:00.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.834+0000 7fa56fbcb640 1 -- 172.21.15.53:0/209195319 shutdown_connections 2023-06-10T19:07:00.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.834+0000 7fa56fbcb640 1 --2- 172.21.15.53:0/209195319 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa54c066280 0x7fa54c068730 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:00.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.834+0000 7fa56fbcb640 1 --2- 172.21.15.53:0/209195319 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa5680c5b50 0x7fa56815a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:00.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.834+0000 7fa56fbcb640 1 --2- 172.21.15.53:0/209195319 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa56815bd10 0x7fa5680c5610 unknown :-1 s=CLOSED pgs=2307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:00.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.834+0000 7fa56fbcb640 1 --2- 172.21.15.53:0/209195319 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa568153db0 0x7fa56815b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:00.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.834+0000 7fa56fbcb640 1 -- 172.21.15.53:0/209195319 >> 172.21.15.53:0/209195319 conn(0x7fa5680cafc0 msgr2=0x7fa5680b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:00.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.834+0000 7fa56fbcb640 1 -- 172.21.15.53:0/209195319 shutdown_connections 2023-06-10T19:07:00.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.834+0000 7fa56fbcb640 1 -- 172.21.15.53:0/209195319 wait complete. 2023-06-10T19:07:00.854 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-10T19:07:00.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.978+0000 7f56bdaeb640 1 Processor -- start 2023-06-10T19:07:00.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.978+0000 7f56bdaeb640 1 -- start start 2023-06-10T19:07:00.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.978+0000 7f56bdaeb640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f56b815cb40 0x7f56b80cc020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:00.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.978+0000 7f56bdaeb640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56b815cf40 con 0x7f56b815c060 2023-06-10T19:07:00.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.978+0000 7f56bdaeb640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56b80c8d50 con 0x7f56b8070de0 2023-06-10T19:07:00.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.978+0000 7f56bdaeb640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56b80c9030 con 0x7f56b815cb40 2023-06-10T19:07:00.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.978+0000 7f56b7fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f56b815cb40 0x7f56b80cc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:00.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.978+0000 7f56b77fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f56b815c060 0x7f56b815c430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:47816/0 (socket says 172.21.15.53:47816) 2023-06-10T19:07:00.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.978+0000 7f56b77fe640 1 -- 172.21.15.53:0/88923596 learned_addr learned my addr 172.21.15.53:0/88923596 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:07:00.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.978+0000 7f56b7fff640 1 -- 172.21.15.53:0/88923596 >> v1:172.21.15.117:6789/0 conn(0x7f56b8070de0 legacy=0x7f56b806bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:00.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.978+0000 7f56b7fff640 1 -- 172.21.15.53:0/88923596 >> v1:172.21.15.53:6789/0 conn(0x7f56b815c060 legacy=0x7f56b815c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:00.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.978+0000 7f56b7fff640 1 -- 172.21.15.53:0/88923596 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56b8070300 con 0x7f56b815cb40 2023-06-10T19:07:00.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.982+0000 7f56b7fff640 1 --2- 172.21.15.53:0/88923596 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56b815cb40 0x7f56b80cc020 secure :-1 s=READY pgs=2309 cs=0 l=1 rev1=1 crypto rx=0x7f56b0009d90 tx=0x7f56b001c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c393f5d3bf93a2bd server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:00.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.982+0000 7f56b67fc640 1 -- 172.21.15.53:0/88923596 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b00a58d0 con 0x7f56b815cb40 2023-06-10T19:07:00.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.982+0000 7f56b67fc640 1 -- 172.21.15.53:0/88923596 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56b00a5a30 con 0x7f56b815cb40 2023-06-10T19:07:00.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.982+0000 7f56b67fc640 1 -- 172.21.15.53:0/88923596 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b00a5dc0 con 0x7f56b815cb40 2023-06-10T19:07:00.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.982+0000 7f56bdaeb640 1 -- 172.21.15.53:0/88923596 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56b815cb40 msgr2=0x7f56b80cc020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:00.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.982+0000 7f56bdaeb640 1 --2- 172.21.15.53:0/88923596 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56b815cb40 0x7f56b80cc020 secure :-1 s=READY pgs=2309 cs=0 l=1 rev1=1 crypto rx=0x7f56b0009d90 tx=0x7f56b001c880 comp rx=0 tx=0).stop 2023-06-10T19:07:00.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.982+0000 7f56bdaeb640 1 -- 172.21.15.53:0/88923596 shutdown_connections 2023-06-10T19:07:00.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.982+0000 7f56bdaeb640 1 --2- 172.21.15.53:0/88923596 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56b815cb40 0x7f56b80cc020 unknown :-1 s=CLOSED pgs=2309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:00.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.982+0000 7f56bdaeb640 1 -- 172.21.15.53:0/88923596 >> 172.21.15.53:0/88923596 conn(0x7f56b806a0e0 msgr2=0x7f56b80cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:00.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.982+0000 7f56bdaeb640 1 -- 172.21.15.53:0/88923596 shutdown_connections 2023-06-10T19:07:00.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.982+0000 7f56bdaeb640 1 -- 172.21.15.53:0/88923596 wait complete. 2023-06-10T19:07:00.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.982+0000 7f56bdaeb640 1 Processor -- start 2023-06-10T19:07:00.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.982+0000 7f56bdaeb640 1 -- start start 2023-06-10T19:07:00.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.982+0000 7f56bdaeb640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56b8070de0 0x7f56b814c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:00.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.982+0000 7f56bdaeb640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f56b815c060 0x7f56b80b0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:00.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.982+0000 7f56bdaeb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56b815cb40 0x7f56b80b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:00.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.982+0000 7f56bdaeb640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56b80b2250 con 0x7f56b815cb40 2023-06-10T19:07:00.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.982+0000 7f56bdaeb640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56b80b2670 con 0x7f56b815c060 2023-06-10T19:07:00.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.982+0000 7f56bdaeb640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56b80b15d0 con 0x7f56b8070de0 2023-06-10T19:07:00.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.982+0000 7f56b7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56b815cb40 0x7f56b80b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:00.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.982+0000 7f56b7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56b815cb40 0x7f56b80b2ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49096/0 (socket says 172.21.15.53:49096) 2023-06-10T19:07:00.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.982+0000 7f56b7fff640 1 -- 172.21.15.53:0/453138246 learned_addr learned my addr 172.21.15.53:0/453138246 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:00.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.982+0000 7f56b77fe640 1 --2- 172.21.15.53:0/453138246 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56b8070de0 0x7f56b814c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:00.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.982+0000 7f56b7fff640 1 -- 172.21.15.53:0/453138246 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56b8070de0 msgr2=0x7f56b814c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:00.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.982+0000 7f56b7fff640 1 --2- 172.21.15.53:0/453138246 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56b8070de0 0x7f56b814c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:00.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.982+0000 7f56b7fff640 1 -- 172.21.15.53:0/453138246 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f56b815c060 msgr2=0x7f56b80b0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:00.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.982+0000 7f56b7fff640 1 --2- 172.21.15.53:0/453138246 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f56b815c060 0x7f56b80b0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:00.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.982+0000 7f56b7fff640 1 -- 172.21.15.53:0/453138246 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56b0009a70 con 0x7f56b815cb40 2023-06-10T19:07:00.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.982+0000 7f56b7fff640 1 --2- 172.21.15.53:0/453138246 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56b815cb40 0x7f56b80b2ce0 secure :-1 s=READY pgs=2310 cs=0 l=1 rev1=1 crypto rx=0x7f56b001a4b0 tx=0x7f56b0019620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:00.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.982+0000 7f569ffff640 1 -- 172.21.15.53:0/453138246 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b00b9860 con 0x7f56b815cb40 2023-06-10T19:07:00.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.982+0000 7f569ffff640 1 -- 172.21.15.53:0/453138246 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56b00b99c0 con 0x7f56b815cb40 2023-06-10T19:07:00.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.982+0000 7f56bdaeb640 1 -- 172.21.15.53:0/453138246 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56b80b18b0 con 0x7f56b815cb40 2023-06-10T19:07:00.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.982+0000 7f569ffff640 1 -- 172.21.15.53:0/453138246 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b00b9d50 con 0x7f56b815cb40 2023-06-10T19:07:00.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.982+0000 7f56bdaeb640 1 -- 172.21.15.53:0/453138246 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56b80b1e70 con 0x7f56b815cb40 2023-06-10T19:07:00.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.986+0000 7f56bdaeb640 1 -- 172.21.15.53:0/453138246 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56b804d790 con 0x7f56b815cb40 2023-06-10T19:07:00.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.986+0000 7f569ffff640 1 -- 172.21.15.53:0/453138246 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f56b00ad440 con 0x7f56b815cb40 2023-06-10T19:07:00.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.986+0000 7f569ffff640 1 --2- 172.21.15.53:0/453138246 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f56a4066280 0x7f56a4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:00.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.986+0000 7f569ffff640 1 -- 172.21.15.53:0/453138246 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6105+0+0 (secure 0 0 0) 0x7f56b011f0a0 con 0x7f56b815cb40 2023-06-10T19:07:00.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.986+0000 7f56b77fe640 1 --2- 172.21.15.53:0/453138246 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f56a4066280 0x7f56a4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:00.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.986+0000 7f56b77fe640 1 --2- 172.21.15.53:0/453138246 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f56a4066280 0x7f56a4068730 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f56a8005890 tx=0x7f56a8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:00.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:00.990+0000 7f569ffff640 1 -- 172.21.15.53:0/453138246 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f56b00ec580 con 0x7f56b815cb40 2023-06-10T19:07:01.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.138+0000 7f56bdaeb640 1 -- 172.21.15.53:0/453138246 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f56b80ae520 con 0x7f56b815cb40 2023-06-10T19:07:01.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.138+0000 7f569ffff640 1 -- 172.21.15.53:0/453138246 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v155) v1 ==== 104+0+11 (secure 0 0 0) 0x7f56b00efba0 con 0x7f56b815cb40 2023-06-10T19:07:01.142 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-06-10T19:07:01.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.138+0000 7f56bdaeb640 1 -- 172.21.15.53:0/453138246 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f56a4066280 msgr2=0x7f56a4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:01.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.138+0000 7f56bdaeb640 1 --2- 172.21.15.53:0/453138246 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f56a4066280 0x7f56a4068730 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f56a8005890 tx=0x7f56a8009040 comp rx=0 tx=0).stop 2023-06-10T19:07:01.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.138+0000 7f56bdaeb640 1 -- 172.21.15.53:0/453138246 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56b815cb40 msgr2=0x7f56b80b2ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:01.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.138+0000 7f56bdaeb640 1 --2- 172.21.15.53:0/453138246 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56b815cb40 0x7f56b80b2ce0 secure :-1 s=READY pgs=2310 cs=0 l=1 rev1=1 crypto rx=0x7f56b001a4b0 tx=0x7f56b0019620 comp rx=0 tx=0).stop 2023-06-10T19:07:01.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.138+0000 7f56bdaeb640 1 -- 172.21.15.53:0/453138246 shutdown_connections 2023-06-10T19:07:01.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.138+0000 7f56bdaeb640 1 --2- 172.21.15.53:0/453138246 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f56a4066280 0x7f56a4068730 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:01.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.138+0000 7f56bdaeb640 1 --2- 172.21.15.53:0/453138246 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f56b815cb40 0x7f56b80b2ce0 unknown :-1 s=CLOSED pgs=2310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:01.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.138+0000 7f56bdaeb640 1 --2- 172.21.15.53:0/453138246 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f56b815c060 0x7f56b80b0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:01.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.138+0000 7f56bdaeb640 1 --2- 172.21.15.53:0/453138246 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f56b8070de0 0x7f56b814c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:01.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.138+0000 7f56bdaeb640 1 -- 172.21.15.53:0/453138246 >> 172.21.15.53:0/453138246 conn(0x7f56b806a0e0 msgr2=0x7f56b8150e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:01.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.138+0000 7f56bdaeb640 1 -- 172.21.15.53:0/453138246 shutdown_connections 2023-06-10T19:07:01.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.138+0000 7f56bdaeb640 1 -- 172.21.15.53:0/453138246 wait complete. 2023-06-10T19:07:01.157 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-10T19:07:01.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.266+0000 7f9cef875640 1 Processor -- start 2023-06-10T19:07:01.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.266+0000 7f9cef875640 1 -- start start 2023-06-10T19:07:01.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.270+0000 7f9cef875640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9ce80c82a0 0x7f9ce80c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:01.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.270+0000 7f9cef875640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9ce80af760 0x7f9ce80afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:01.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.270+0000 7f9cef875640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ce806b090 con 0x7f9ce80c9fa0 2023-06-10T19:07:01.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.270+0000 7f9cef875640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ce80b0120 con 0x7f9ce80c82a0 2023-06-10T19:07:01.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.270+0000 7f9cef875640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce80ca370 con 0x7f9ce80af760 2023-06-10T19:07:01.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.270+0000 7f9cece10640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9ce80c82a0 0x7f9ce80c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:01.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.270+0000 7f9ced611640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f9ce80c9fa0 0x7f9ce806bae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41824/0 (socket says 172.21.15.53:41824) 2023-06-10T19:07:01.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.270+0000 7f9ced611640 1 -- 172.21.15.53:0/882688339 learned_addr learned my addr 172.21.15.53:0/882688339 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:07:01.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.270+0000 7f9cece10640 1 -- 172.21.15.53:0/882688339 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9ce80af760 msgr2=0x7f9ce80afbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:01.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.270+0000 7f9cece10640 1 --2- 172.21.15.53:0/882688339 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9ce80af760 0x7f9ce80afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:01.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.270+0000 7f9cece10640 1 -- 172.21.15.53:0/882688339 >> v1:172.21.15.53:6789/0 conn(0x7f9ce80c9fa0 legacy=0x7f9ce806bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:01.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.270+0000 7f9cece10640 1 -- 172.21.15.53:0/882688339 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ce8070d50 con 0x7f9ce80c82a0 2023-06-10T19:07:01.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.270+0000 7f9cece10640 1 --2- 172.21.15.53:0/882688339 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9ce80c82a0 0x7f9ce80c86f0 secure :-1 s=READY pgs=2312 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc0097c0 tx=0x7f9cdc01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7685d95e40edf2a3 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:01.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.270+0000 7f9ce7fff640 1 -- 172.21.15.53:0/882688339 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cdc0ac620 con 0x7f9ce80c82a0 2023-06-10T19:07:01.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.270+0000 7f9ce7fff640 1 -- 172.21.15.53:0/882688339 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cdc0ac780 con 0x7f9ce80c82a0 2023-06-10T19:07:01.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.270+0000 7f9ce7fff640 1 -- 172.21.15.53:0/882688339 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cdc0acb10 con 0x7f9ce80c82a0 2023-06-10T19:07:01.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.274+0000 7f9cef875640 1 -- 172.21.15.53:0/882688339 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9ce80c82a0 msgr2=0x7f9ce80c86f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:01.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.274+0000 7f9cef875640 1 --2- 172.21.15.53:0/882688339 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9ce80c82a0 0x7f9ce80c86f0 secure :-1 s=READY pgs=2312 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc0097c0 tx=0x7f9cdc01c3c0 comp rx=0 tx=0).stop 2023-06-10T19:07:01.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.274+0000 7f9cef875640 1 -- 172.21.15.53:0/882688339 shutdown_connections 2023-06-10T19:07:01.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.274+0000 7f9cef875640 1 --2- 172.21.15.53:0/882688339 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9ce80c82a0 0x7f9ce80c86f0 unknown :-1 s=CLOSED pgs=2312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:01.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.274+0000 7f9cef875640 1 --2- 172.21.15.53:0/882688339 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9ce80af760 0x7f9ce80afbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:01.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.274+0000 7f9cef875640 1 -- 172.21.15.53:0/882688339 >> 172.21.15.53:0/882688339 conn(0x7f9ce806a0e0 msgr2=0x7f9ce80cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:01.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.274+0000 7f9cef875640 1 -- 172.21.15.53:0/882688339 shutdown_connections 2023-06-10T19:07:01.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.274+0000 7f9cef875640 1 -- 172.21.15.53:0/882688339 wait complete. 2023-06-10T19:07:01.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.274+0000 7f9cef875640 1 Processor -- start 2023-06-10T19:07:01.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.274+0000 7f9cef875640 1 -- start start 2023-06-10T19:07:01.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.274+0000 7f9cef875640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9ce80af760 0x7f9ce80cd230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:01.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.274+0000 7f9cef875640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9ce80c82a0 0x7f9ce80cb820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:01.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.274+0000 7f9cef875640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ce80c9fa0 0x7f9ce80c5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:01.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.274+0000 7f9cef875640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce80cce10 con 0x7f9ce80af760 2023-06-10T19:07:01.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.274+0000 7f9cef875640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce80cc190 con 0x7f9ce80c9fa0 2023-06-10T19:07:01.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.274+0000 7f9cef875640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce80cc470 con 0x7f9ce80c82a0 2023-06-10T19:07:01.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.274+0000 7f9ced611640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9ce80af760 0x7f9ce80cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:01.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.274+0000 7f9ced611640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9ce80af760 0x7f9ce80cd230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49654/0 (socket says 172.21.15.53:49654) 2023-06-10T19:07:01.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.274+0000 7f9ced611640 1 -- 172.21.15.53:0/2597207964 learned_addr learned my addr 172.21.15.53:0/2597207964 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:01.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.274+0000 7f9ced611640 1 -- 172.21.15.53:0/2597207964 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9ce80c82a0 msgr2=0x7f9ce80cb820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:01.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.274+0000 7f9cede12640 1 --2- 172.21.15.53:0/2597207964 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ce80c9fa0 0x7f9ce80c5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:01.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.274+0000 7f9ced611640 1 --2- 172.21.15.53:0/2597207964 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9ce80c82a0 0x7f9ce80cb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:01.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.274+0000 7f9ced611640 1 -- 172.21.15.53:0/2597207964 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ce80c9fa0 msgr2=0x7f9ce80c5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:01.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.274+0000 7f9ced611640 1 --2- 172.21.15.53:0/2597207964 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ce80c9fa0 0x7f9ce80c5990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:01.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.274+0000 7f9ced611640 1 -- 172.21.15.53:0/2597207964 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cdc009420 con 0x7f9ce80af760 2023-06-10T19:07:01.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.274+0000 7f9ced611640 1 --2- 172.21.15.53:0/2597207964 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9ce80af760 0x7f9ce80cd230 secure :-1 s=READY pgs=2313 cs=0 l=1 rev1=1 crypto rx=0x7f9ce000cbc0 tx=0x7f9ce000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:01.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.274+0000 7f9ce5ffb640 1 -- 172.21.15.53:0/2597207964 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce000aca0 con 0x7f9ce80af760 2023-06-10T19:07:01.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.274+0000 7f9ce5ffb640 1 -- 172.21.15.53:0/2597207964 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ce000ae00 con 0x7f9ce80af760 2023-06-10T19:07:01.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.274+0000 7f9cef875640 1 -- 172.21.15.53:0/2597207964 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ce80cc750 con 0x7f9ce80af760 2023-06-10T19:07:01.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.274+0000 7f9ce5ffb640 1 -- 172.21.15.53:0/2597207964 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce0012600 con 0x7f9ce80af760 2023-06-10T19:07:01.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.274+0000 7f9cef875640 1 -- 172.21.15.53:0/2597207964 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ce80cbd60 con 0x7f9ce80af760 2023-06-10T19:07:01.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.278+0000 7f9cef875640 1 -- 172.21.15.53:0/2597207964 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ce80ccf50 con 0x7f9ce80af760 2023-06-10T19:07:01.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.278+0000 7f9ce5ffb640 1 -- 172.21.15.53:0/2597207964 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9ce0007070 con 0x7f9ce80af760 2023-06-10T19:07:01.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.278+0000 7f9ce5ffb640 1 --2- 172.21.15.53:0/2597207964 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9cd4066280 0x7f9cd4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:01.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.278+0000 7f9ce5ffb640 1 -- 172.21.15.53:0/2597207964 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6105+0+0 (secure 0 0 0) 0x7f9ce0084060 con 0x7f9ce80af760 2023-06-10T19:07:01.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.278+0000 7f9cece10640 1 --2- 172.21.15.53:0/2597207964 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9cd4066280 0x7f9cd4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:01.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.278+0000 7f9cece10640 1 --2- 172.21.15.53:0/2597207964 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9cd4066280 0x7f9cd4068730 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc0ae000 tx=0x7f9cdc004740 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:01.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.282+0000 7f9ce5ffb640 1 -- 172.21.15.53:0/2597207964 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9ce0051650 con 0x7f9ce80af760 2023-06-10T19:07:01.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.434+0000 7f9cef875640 1 -- 172.21.15.53:0/2597207964 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9ce806f9a0 con 0x7f9ce80af760 2023-06-10T19:07:01.436 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.434+0000 7f9ce5ffb640 1 -- 172.21.15.53:0/2597207964 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v155) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9ce00210a0 con 0x7f9ce80af760 2023-06-10T19:07:01.436 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-06-10T19:07:01.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.434+0000 7f9cef875640 1 -- 172.21.15.53:0/2597207964 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9cd4066280 msgr2=0x7f9cd4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:01.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.434+0000 7f9cef875640 1 --2- 172.21.15.53:0/2597207964 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9cd4066280 0x7f9cd4068730 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc0ae000 tx=0x7f9cdc004740 comp rx=0 tx=0).stop 2023-06-10T19:07:01.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.434+0000 7f9cef875640 1 -- 172.21.15.53:0/2597207964 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9ce80af760 msgr2=0x7f9ce80cd230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:01.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.434+0000 7f9cef875640 1 --2- 172.21.15.53:0/2597207964 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9ce80af760 0x7f9ce80cd230 secure :-1 s=READY pgs=2313 cs=0 l=1 rev1=1 crypto rx=0x7f9ce000cbc0 tx=0x7f9ce000a060 comp rx=0 tx=0).stop 2023-06-10T19:07:01.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.434+0000 7f9cef875640 1 -- 172.21.15.53:0/2597207964 shutdown_connections 2023-06-10T19:07:01.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.434+0000 7f9cef875640 1 --2- 172.21.15.53:0/2597207964 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9cd4066280 0x7f9cd4068730 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:01.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.434+0000 7f9cef875640 1 --2- 172.21.15.53:0/2597207964 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ce80c9fa0 0x7f9ce80c5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:01.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.434+0000 7f9cef875640 1 --2- 172.21.15.53:0/2597207964 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9ce80c82a0 0x7f9ce80cb820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:01.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.434+0000 7f9cef875640 1 --2- 172.21.15.53:0/2597207964 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9ce80af760 0x7f9ce80cd230 unknown :-1 s=CLOSED pgs=2313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:01.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.434+0000 7f9cef875640 1 -- 172.21.15.53:0/2597207964 >> 172.21.15.53:0/2597207964 conn(0x7f9ce806a0e0 msgr2=0x7f9ce80b2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:01.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.434+0000 7f9cef875640 1 -- 172.21.15.53:0/2597207964 shutdown_connections 2023-06-10T19:07:01.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.434+0000 7f9cef875640 1 -- 172.21.15.53:0/2597207964 wait complete. 2023-06-10T19:07:01.455 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:07:01.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.570+0000 7f6e042cd640 1 Processor -- start 2023-06-10T19:07:01.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.570+0000 7f6e042cd640 1 -- start start 2023-06-10T19:07:01.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.574+0000 7f6e042cd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6dfc0c9750 0x7f6dfc0aced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:01.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.574+0000 7f6e042cd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6dfc0cb870 0x7f6dfc0af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:01.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.574+0000 7f6e042cd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6dfc0afc60 0x7f6dfc15bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:01.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.574+0000 7f6e042cd640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dfc0cd990 con 0x7f6dfc0afc60 2023-06-10T19:07:01.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.574+0000 7f6e042cd640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dfc0b00e0 con 0x7f6dfc0cb870 2023-06-10T19:07:01.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.574+0000 7f6e042cd640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dfc0ad410 con 0x7f6dfc0c9750 2023-06-10T19:07:01.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.574+0000 7f6e0286a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6dfc0afc60 0x7f6dfc15bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:01.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.574+0000 7f6e0286a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6dfc0afc60 0x7f6dfc15bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49666/0 (socket says 172.21.15.53:49666) 2023-06-10T19:07:01.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.574+0000 7f6e0286a640 1 -- 172.21.15.53:0/1684660758 learned_addr learned my addr 172.21.15.53:0/1684660758 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:01.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.574+0000 7f6e02069640 1 --2- 172.21.15.53:0/1684660758 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6dfc0c9750 0x7f6dfc0aced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:01.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.574+0000 7f6e01868640 1 --2- 172.21.15.53:0/1684660758 >> v2:172.21.15.117:3300/0 conn(0x7f6dfc0cb870 0x7f6dfc0af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:01.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.574+0000 7f6e0286a640 1 -- 172.21.15.53:0/1684660758 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6dfc0c9750 msgr2=0x7f6dfc0aced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:01.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.574+0000 7f6e0286a640 1 --2- 172.21.15.53:0/1684660758 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6dfc0c9750 0x7f6dfc0aced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:01.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.574+0000 7f6e0286a640 1 -- 172.21.15.53:0/1684660758 >> v2:172.21.15.117:3300/0 conn(0x7f6dfc0cb870 msgr2=0x7f6dfc0af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:01.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.574+0000 7f6e0286a640 1 --2- 172.21.15.53:0/1684660758 >> v2:172.21.15.117:3300/0 conn(0x7f6dfc0cb870 0x7f6dfc0af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:01.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.574+0000 7f6e0286a640 1 -- 172.21.15.53:0/1684660758 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dfc1600d0 con 0x7f6dfc0afc60 2023-06-10T19:07:01.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.574+0000 7f6e0286a640 1 --2- 172.21.15.53:0/1684660758 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6dfc0afc60 0x7f6dfc15bec0 secure :-1 s=READY pgs=2314 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc06e7c0 tx=0x7f6df401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=989649c78334d23a server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:01.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.574+0000 7f6e01067640 1 -- 172.21.15.53:0/1684660758 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6df40a5730 con 0x7f6dfc0afc60 2023-06-10T19:07:01.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.574+0000 7f6e01067640 1 -- 172.21.15.53:0/1684660758 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6df40a5890 con 0x7f6dfc0afc60 2023-06-10T19:07:01.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.574+0000 7f6e01067640 1 -- 172.21.15.53:0/1684660758 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6df40a5c20 con 0x7f6dfc0afc60 2023-06-10T19:07:01.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.578+0000 7f6e042cd640 1 -- 172.21.15.53:0/1684660758 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6dfc0afc60 msgr2=0x7f6dfc15bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:01.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.578+0000 7f6e042cd640 1 --2- 172.21.15.53:0/1684660758 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6dfc0afc60 0x7f6dfc15bec0 secure :-1 s=READY pgs=2314 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc06e7c0 tx=0x7f6df401c9a0 comp rx=0 tx=0).stop 2023-06-10T19:07:01.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.578+0000 7f6e042cd640 1 -- 172.21.15.53:0/1684660758 shutdown_connections 2023-06-10T19:07:01.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.578+0000 7f6e042cd640 1 --2- 172.21.15.53:0/1684660758 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6dfc0afc60 0x7f6dfc15bec0 unknown :-1 s=CLOSED pgs=2314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:01.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.578+0000 7f6e042cd640 1 --2- 172.21.15.53:0/1684660758 >> v2:172.21.15.117:3300/0 conn(0x7f6dfc0cb870 0x7f6dfc0af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:01.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.578+0000 7f6e042cd640 1 --2- 172.21.15.53:0/1684660758 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6dfc0c9750 0x7f6dfc0aced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:01.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.578+0000 7f6e042cd640 1 -- 172.21.15.53:0/1684660758 >> 172.21.15.53:0/1684660758 conn(0x7f6dfc06a0d0 msgr2=0x7f6dfc0ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:01.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.578+0000 7f6e042cd640 1 -- 172.21.15.53:0/1684660758 shutdown_connections 2023-06-10T19:07:01.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.578+0000 7f6e042cd640 1 -- 172.21.15.53:0/1684660758 wait complete. 2023-06-10T19:07:01.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.578+0000 7f6e042cd640 1 Processor -- start 2023-06-10T19:07:01.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.578+0000 7f6e042cd640 1 -- start start 2023-06-10T19:07:01.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.578+0000 7f6e042cd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6dfc0afc60 0x7f6dfc14da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:01.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.578+0000 7f6e042cd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6dfc0c9750 0x7f6dfc14c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:01.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.578+0000 7f6e042cd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6dfc0cb870 0x7f6dfc155840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:01.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.578+0000 7f6e042cd640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dfc156140 con 0x7f6dfc0afc60 2023-06-10T19:07:01.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.578+0000 7f6e042cd640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dfc14cc50 con 0x7f6dfc0cb870 2023-06-10T19:07:01.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.578+0000 7f6e042cd640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dfc14cf30 con 0x7f6dfc0c9750 2023-06-10T19:07:01.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.578+0000 7f6e02069640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6dfc0afc60 0x7f6dfc14da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:01.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.578+0000 7f6e02069640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6dfc0afc60 0x7f6dfc14da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49676/0 (socket says 172.21.15.53:49676) 2023-06-10T19:07:01.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.578+0000 7f6e02069640 1 -- 172.21.15.53:0/3373917865 learned_addr learned my addr 172.21.15.53:0/3373917865 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:01.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.578+0000 7f6e01868640 1 --2- 172.21.15.53:0/3373917865 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6dfc0c9750 0x7f6dfc14c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:01.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.578+0000 7f6e0286a640 1 --2- 172.21.15.53:0/3373917865 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6dfc0cb870 0x7f6dfc155840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:01.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.578+0000 7f6e02069640 1 -- 172.21.15.53:0/3373917865 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6dfc0c9750 msgr2=0x7f6dfc14c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:01.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.578+0000 7f6e02069640 1 --2- 172.21.15.53:0/3373917865 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6dfc0c9750 0x7f6dfc14c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:01.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.578+0000 7f6e02069640 1 -- 172.21.15.53:0/3373917865 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6dfc0cb870 msgr2=0x7f6dfc155840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:01.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.578+0000 7f6e02069640 1 --2- 172.21.15.53:0/3373917865 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6dfc0cb870 0x7f6dfc155840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:01.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.578+0000 7f6e02069640 1 -- 172.21.15.53:0/3373917865 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6df4009b30 con 0x7f6dfc0afc60 2023-06-10T19:07:01.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.578+0000 7f6e01868640 1 --2- 172.21.15.53:0/3373917865 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6dfc0c9750 0x7f6dfc14c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:07:01.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.578+0000 7f6e02069640 1 --2- 172.21.15.53:0/3373917865 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6dfc0afc60 0x7f6dfc14da10 secure :-1 s=READY pgs=2315 cs=0 l=1 rev1=1 crypto rx=0x7f6df800e870 tx=0x7f6df800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:01.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.578+0000 7f6df2ffd640 1 -- 172.21.15.53:0/3373917865 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6df800ee60 con 0x7f6dfc0afc60 2023-06-10T19:07:01.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.578+0000 7f6df2ffd640 1 -- 172.21.15.53:0/3373917865 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6df800c940 con 0x7f6dfc0afc60 2023-06-10T19:07:01.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.578+0000 7f6e042cd640 1 -- 172.21.15.53:0/3373917865 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dfc14d210 con 0x7f6dfc0afc60 2023-06-10T19:07:01.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.578+0000 7f6df2ffd640 1 -- 172.21.15.53:0/3373917865 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6df800ccf0 con 0x7f6dfc0afc60 2023-06-10T19:07:01.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.578+0000 7f6e042cd640 1 -- 172.21.15.53:0/3373917865 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dfc14c820 con 0x7f6dfc0afc60 2023-06-10T19:07:01.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.582+0000 7f6e042cd640 1 -- 172.21.15.53:0/3373917865 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dfc14cd90 con 0x7f6dfc0afc60 2023-06-10T19:07:01.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.582+0000 7f6df2ffd640 1 -- 172.21.15.53:0/3373917865 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6df8013470 con 0x7f6dfc0afc60 2023-06-10T19:07:01.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.582+0000 7f6df2ffd640 1 --2- 172.21.15.53:0/3373917865 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6de0066280 0x7f6de0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:01.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.582+0000 7f6df2ffd640 1 -- 172.21.15.53:0/3373917865 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6105+0+0 (secure 0 0 0) 0x7f6df8083ea0 con 0x7f6dfc0afc60 2023-06-10T19:07:01.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.582+0000 7f6e01868640 1 --2- 172.21.15.53:0/3373917865 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6de0066280 0x7f6de0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:01.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.582+0000 7f6e01868640 1 --2- 172.21.15.53:0/3373917865 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6de0066280 0x7f6de0068730 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc157350 tx=0x7f6dec008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:01.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.586+0000 7f6df2ffd640 1 -- 172.21.15.53:0/3373917865 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6dfc14cd90 con 0x7f6dfc0afc60 2023-06-10T19:07:01.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.774+0000 7f6e042cd640 1 -- 172.21.15.53:0/3373917865 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6dfc14cd90 con 0x7f6dfc0afc60 2023-06-10T19:07:01.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.774+0000 7f6df2ffd640 1 -- 172.21.15.53:0/3373917865 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) v1 ==== 94+0+4679 (secure 0 0 0) 0x7f6dfc14cd90 con 0x7f6dfc0afc60 2023-06-10T19:07:01.776 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:07:01.777 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":89,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/67248348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":67248348},{"type":"v1","addr":"172.21.15.117:6835","nonce":67248348}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":84},{"gid":8296,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3907684243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":3907684243},{"type":"v1","addr":"172.21.15.117:6837","nonce":3907684243}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":84},{"gid":10038,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/1699177406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":1699177406},{"type":"v1","addr":"172.21.15.53:6833","nonce":1699177406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":84}],"filesystems":[{"mdsmap":{"epoch":89,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:06:28.716939+0000","modified":"2023-06-10T19:06:32.084420+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10044},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10044":{"gid":10044,"name":"a","rank":0,"incarnation":85,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/2077620799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2077620799},{"type":"v1","addr":"172.21.15.53:6835","nonce":2077620799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-06-10T19:07:01.777 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 89 2023-06-10T19:07:01.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.778+0000 7f6e042cd640 1 -- 172.21.15.53:0/3373917865 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6de0066280 msgr2=0x7f6de0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:01.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.778+0000 7f6e042cd640 1 --2- 172.21.15.53:0/3373917865 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6de0066280 0x7f6de0068730 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc157350 tx=0x7f6dec008040 comp rx=0 tx=0).stop 2023-06-10T19:07:01.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.778+0000 7f6e042cd640 1 -- 172.21.15.53:0/3373917865 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6dfc0afc60 msgr2=0x7f6dfc14da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:01.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.778+0000 7f6e042cd640 1 --2- 172.21.15.53:0/3373917865 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6dfc0afc60 0x7f6dfc14da10 secure :-1 s=READY pgs=2315 cs=0 l=1 rev1=1 crypto rx=0x7f6df800e870 tx=0x7f6df800ed30 comp rx=0 tx=0).stop 2023-06-10T19:07:01.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.778+0000 7f6e042cd640 1 -- 172.21.15.53:0/3373917865 shutdown_connections 2023-06-10T19:07:01.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.778+0000 7f6e042cd640 1 --2- 172.21.15.53:0/3373917865 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6de0066280 0x7f6de0068730 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:01.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.778+0000 7f6e042cd640 1 --2- 172.21.15.53:0/3373917865 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6dfc0cb870 0x7f6dfc155840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:01.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.778+0000 7f6e042cd640 1 --2- 172.21.15.53:0/3373917865 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6dfc0c9750 0x7f6dfc14c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:01.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.778+0000 7f6e042cd640 1 --2- 172.21.15.53:0/3373917865 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6dfc0afc60 0x7f6dfc14da10 unknown :-1 s=CLOSED pgs=2315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:01.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.778+0000 7f6e042cd640 1 -- 172.21.15.53:0/3373917865 >> 172.21.15.53:0/3373917865 conn(0x7f6dfc06a0d0 msgr2=0x7f6dfc06b780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:01.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.778+0000 7f6e042cd640 1 -- 172.21.15.53:0/3373917865 shutdown_connections 2023-06-10T19:07:01.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.778+0000 7f6e042cd640 1 -- 172.21.15.53:0/3373917865 wait complete. 2023-06-10T19:07:01.796 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:07:01.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.910+0000 7f4456da1640 1 Processor -- start 2023-06-10T19:07:01.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.910+0000 7f4456da1640 1 -- start start 2023-06-10T19:07:01.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.910+0000 7f4456da1640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f44500cec40 0x7f44500cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:01.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.910+0000 7f4456da1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f44500cbf50 0x7f44500cc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:01.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.910+0000 7f4456da1640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44500cbac0 con 0x7f4450159450 2023-06-10T19:07:01.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.910+0000 7f4456da1640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44500cf600 con 0x7f44500cec40 2023-06-10T19:07:01.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.910+0000 7f4456da1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f445015dc00 con 0x7f44500cbf50 2023-06-10T19:07:01.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.910+0000 7f4454b3d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f4450159450 0x7f445015d140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41830/0 (socket says 172.21.15.53:41830) 2023-06-10T19:07:01.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.910+0000 7f4454b3d640 1 -- 172.21.15.53:0/2986143067 learned_addr learned my addr 172.21.15.53:0/2986143067 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:07:01.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.914+0000 7f444ffff640 1 --2- 172.21.15.53:0/2986143067 >> v2:172.21.15.53:3300/0 conn(0x7f44500cec40 0x7f44500cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:01.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.914+0000 7f445533e640 1 --2- 172.21.15.53:0/2986143067 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f44500cbf50 0x7f44500cc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:01.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.914+0000 7f444f7fe640 1 -- 172.21.15.53:0/2986143067 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4267116852 0 0) 0x7f44500cbac0 con 0x7f4450159450 2023-06-10T19:07:01.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.914+0000 7f444f7fe640 1 -- 172.21.15.53:0/2986143067 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4440003530 con 0x7f4450159450 2023-06-10T19:07:01.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.914+0000 7f444ffff640 1 -- 172.21.15.53:0/2986143067 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f44500cbf50 msgr2=0x7f44500cc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:01.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.914+0000 7f444ffff640 1 --2- 172.21.15.53:0/2986143067 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f44500cbf50 0x7f44500cc3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:01.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.914+0000 7f444ffff640 1 -- 172.21.15.53:0/2986143067 >> v1:172.21.15.53:6789/0 conn(0x7f4450159450 legacy=0x7f445015d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:01.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.914+0000 7f444ffff640 1 -- 172.21.15.53:0/2986143067 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f445015dee0 con 0x7f44500cec40 2023-06-10T19:07:01.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.914+0000 7f445533e640 1 --2- 172.21.15.53:0/2986143067 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f44500cbf50 0x7f44500cc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:07:01.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.914+0000 7f444ffff640 1 --2- 172.21.15.53:0/2986143067 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f44500cec40 0x7f44500cf0c0 secure :-1 s=READY pgs=2317 cs=0 l=1 rev1=1 crypto rx=0x7f443c0097c0 tx=0x7f443c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=806911b4e270caef server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:01.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.914+0000 7f444f7fe640 1 -- 172.21.15.53:0/2986143067 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443c0ab610 con 0x7f44500cec40 2023-06-10T19:07:01.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.914+0000 7f444f7fe640 1 -- 172.21.15.53:0/2986143067 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f443c0ab770 con 0x7f44500cec40 2023-06-10T19:07:01.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.914+0000 7f444f7fe640 1 -- 172.21.15.53:0/2986143067 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443c0abb00 con 0x7f44500cec40 2023-06-10T19:07:01.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.914+0000 7f4456da1640 1 -- 172.21.15.53:0/2986143067 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f44500cec40 msgr2=0x7f44500cf0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:01.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.914+0000 7f4456da1640 1 --2- 172.21.15.53:0/2986143067 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f44500cec40 0x7f44500cf0c0 secure :-1 s=READY pgs=2317 cs=0 l=1 rev1=1 crypto rx=0x7f443c0097c0 tx=0x7f443c01c450 comp rx=0 tx=0).stop 2023-06-10T19:07:01.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.914+0000 7f4456da1640 1 -- 172.21.15.53:0/2986143067 shutdown_connections 2023-06-10T19:07:01.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.914+0000 7f4456da1640 1 --2- 172.21.15.53:0/2986143067 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f44500cec40 0x7f44500cf0c0 unknown :-1 s=CLOSED pgs=2317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:01.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.914+0000 7f4456da1640 1 --2- 172.21.15.53:0/2986143067 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f44500cbf50 0x7f44500cc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:01.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.914+0000 7f4456da1640 1 -- 172.21.15.53:0/2986143067 >> 172.21.15.53:0/2986143067 conn(0x7f445006a090 msgr2=0x7f445006d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:01.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.914+0000 7f4456da1640 1 -- 172.21.15.53:0/2986143067 shutdown_connections 2023-06-10T19:07:01.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.914+0000 7f4456da1640 1 -- 172.21.15.53:0/2986143067 wait complete. 2023-06-10T19:07:01.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.918+0000 7f4456da1640 1 Processor -- start 2023-06-10T19:07:01.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.918+0000 7f4456da1640 1 -- start start 2023-06-10T19:07:01.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.918+0000 7f4456da1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f44500cbf50 0x7f44501f6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:01.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.918+0000 7f4456da1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f44500cec40 0x7f4450162660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:01.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.918+0000 7f4456da1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4450159450 0x7f4450157af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:01.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.918+0000 7f4456da1640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f445015a2e0 con 0x7f4450159450 2023-06-10T19:07:01.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.918+0000 7f4456da1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4450163020 con 0x7f44500cbf50 2023-06-10T19:07:01.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.918+0000 7f4456da1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4450163300 con 0x7f44500cec40 2023-06-10T19:07:01.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.918+0000 7f445533e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4450159450 0x7f4450157af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:01.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.918+0000 7f445533e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4450159450 0x7f4450157af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49690/0 (socket says 172.21.15.53:49690) 2023-06-10T19:07:01.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.918+0000 7f445533e640 1 -- 172.21.15.53:0/1465711678 learned_addr learned my addr 172.21.15.53:0/1465711678 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:01.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.918+0000 7f444ffff640 1 --2- 172.21.15.53:0/1465711678 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f44500cec40 0x7f4450162660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:01.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.918+0000 7f4454b3d640 1 --2- 172.21.15.53:0/1465711678 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f44500cbf50 0x7f44501f6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:01.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.918+0000 7f445533e640 1 -- 172.21.15.53:0/1465711678 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f44500cec40 msgr2=0x7f4450162660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:01.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.918+0000 7f445533e640 1 --2- 172.21.15.53:0/1465711678 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f44500cec40 0x7f4450162660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:01.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.918+0000 7f445533e640 1 -- 172.21.15.53:0/1465711678 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f44500cbf50 msgr2=0x7f44501f6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:01.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.918+0000 7f445533e640 1 --2- 172.21.15.53:0/1465711678 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f44500cbf50 0x7f44501f6930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:01.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.918+0000 7f445533e640 1 -- 172.21.15.53:0/1465711678 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f443c009420 con 0x7f4450159450 2023-06-10T19:07:01.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.918+0000 7f445533e640 1 --2- 172.21.15.53:0/1465711678 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4450159450 0x7f4450157af0 secure :-1 s=READY pgs=2318 cs=0 l=1 rev1=1 crypto rx=0x7f4448007e70 tx=0x7f444800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:01.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.918+0000 7f444d7fa640 1 -- 172.21.15.53:0/1465711678 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4448003ba0 con 0x7f4450159450 2023-06-10T19:07:01.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.918+0000 7f444d7fa640 1 -- 172.21.15.53:0/1465711678 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f444800f040 con 0x7f4450159450 2023-06-10T19:07:01.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.918+0000 7f4456da1640 1 -- 172.21.15.53:0/1465711678 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f445015d9d0 con 0x7f4450159450 2023-06-10T19:07:01.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.918+0000 7f444d7fa640 1 -- 172.21.15.53:0/1465711678 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f444800de80 con 0x7f4450159450 2023-06-10T19:07:01.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.918+0000 7f4456da1640 1 -- 172.21.15.53:0/1465711678 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44501638c0 con 0x7f4450159450 2023-06-10T19:07:01.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.918+0000 7f4456da1640 1 -- 172.21.15.53:0/1465711678 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f445015a450 con 0x7f4450159450 2023-06-10T19:07:01.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.922+0000 7f444d7fa640 1 -- 172.21.15.53:0/1465711678 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4448004030 con 0x7f4450159450 2023-06-10T19:07:01.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.922+0000 7f444d7fa640 1 --2- 172.21.15.53:0/1465711678 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4434066280 0x7f4434068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:01.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.922+0000 7f444d7fa640 1 -- 172.21.15.53:0/1465711678 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6105+0+0 (secure 0 0 0) 0x7f4448084030 con 0x7f4450159450 2023-06-10T19:07:01.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.922+0000 7f4454b3d640 1 --2- 172.21.15.53:0/1465711678 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4434066280 0x7f4434068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:01.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.922+0000 7f4454b3d640 1 --2- 172.21.15.53:0/1465711678 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4434066280 0x7f4434068730 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f44440011f0 tx=0x7f4444009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:01.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:01.926+0000 7f444d7fa640 1 -- 172.21.15.53:0/1465711678 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4448051510 con 0x7f4450159450 2023-06-10T19:07:02.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.078+0000 7f4456da1640 1 -- 172.21.15.53:0/1465711678 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f445004d790 con 0x7f4450159450 2023-06-10T19:07:02.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.082+0000 7f444d7fa640 1 -- 172.21.15.53:0/1465711678 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v155) v1 ==== 74+0+18349 (secure 0 0 0) 0x7f4448054b30 con 0x7f4450159450 2023-06-10T19:07:02.084 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:07:02.084 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":155,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:06:50.154677+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-06-10T19:06:27.279397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-06-10T19:06:27.689260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"154","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.0.1:0/2213488734":"2023-06-10T20:06:49.780814+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:07:02.085 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.082+0000 7f4456da1640 1 -- 172.21.15.53:0/1465711678 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4434066280 msgr2=0x7f4434068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:02.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.082+0000 7f4456da1640 1 --2- 172.21.15.53:0/1465711678 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4434066280 0x7f4434068730 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f44440011f0 tx=0x7f4444009040 comp rx=0 tx=0).stop 2023-06-10T19:07:02.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.082+0000 7f4456da1640 1 -- 172.21.15.53:0/1465711678 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4450159450 msgr2=0x7f4450157af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:02.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.082+0000 7f4456da1640 1 --2- 172.21.15.53:0/1465711678 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4450159450 0x7f4450157af0 secure :-1 s=READY pgs=2318 cs=0 l=1 rev1=1 crypto rx=0x7f4448007e70 tx=0x7f444800d4a0 comp rx=0 tx=0).stop 2023-06-10T19:07:02.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.082+0000 7f4456da1640 1 -- 172.21.15.53:0/1465711678 shutdown_connections 2023-06-10T19:07:02.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.082+0000 7f4456da1640 1 --2- 172.21.15.53:0/1465711678 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4434066280 0x7f4434068730 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:02.086 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.082+0000 7f4456da1640 1 --2- 172.21.15.53:0/1465711678 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4450159450 0x7f4450157af0 unknown :-1 s=CLOSED pgs=2318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:02.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.082+0000 7f4456da1640 1 --2- 172.21.15.53:0/1465711678 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f44500cec40 0x7f4450162660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:02.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.082+0000 7f4456da1640 1 --2- 172.21.15.53:0/1465711678 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f44500cbf50 0x7f44501f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:02.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.082+0000 7f4456da1640 1 -- 172.21.15.53:0/1465711678 >> 172.21.15.53:0/1465711678 conn(0x7f445006a090 msgr2=0x7f445015d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:02.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.082+0000 7f4456da1640 1 -- 172.21.15.53:0/1465711678 shutdown_connections 2023-06-10T19:07:02.087 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.082+0000 7f4456da1640 1 -- 172.21.15.53:0/1465711678 wait complete. 2023-06-10T19:07:02.103 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-06-10T19:07:02.104 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:07:02.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.214+0000 7fcee2df7640 1 Processor -- start 2023-06-10T19:07:02.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.214+0000 7fcee2df7640 1 -- start start 2023-06-10T19:07:02.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.218+0000 7fcee2df7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcedc0cb870 0x7fcedc0af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:02.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.218+0000 7fcee2df7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fcedc0afc60 0x7fcedc0aba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:02.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.218+0000 7fcee2df7640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcedc1600d0 con 0x7fcedc0c9750 2023-06-10T19:07:02.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.218+0000 7fcee2df7640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcedc0cd990 con 0x7fcedc0afc60 2023-06-10T19:07:02.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.218+0000 7fcee2df7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcedc0b00e0 con 0x7fcedc0cb870 2023-06-10T19:07:02.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.218+0000 7fcee0b93640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fcedc0c9750 0x7fcedc0aced0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41842/0 (socket says 172.21.15.53:41842) 2023-06-10T19:07:02.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.218+0000 7fcee0b93640 1 -- 172.21.15.53:0/2734866838 learned_addr learned my addr 172.21.15.53:0/2734866838 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:07:02.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.218+0000 7fcee1394640 1 --2- 172.21.15.53:0/2734866838 >> v2:172.21.15.53:3300/0 conn(0x7fcedc0afc60 0x7fcedc0aba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:02.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.218+0000 7fcedbfff640 1 --2- 172.21.15.53:0/2734866838 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcedc0cb870 0x7fcedc0af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:02.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.218+0000 7fcedb7fe640 1 -- 172.21.15.53:0/2734866838 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3243685861 0 0) 0x7fcedc1600d0 con 0x7fcedc0c9750 2023-06-10T19:07:02.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.218+0000 7fcedb7fe640 1 -- 172.21.15.53:0/2734866838 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcec4003530 con 0x7fcedc0c9750 2023-06-10T19:07:02.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.218+0000 7fcee1394640 1 -- 172.21.15.53:0/2734866838 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcedc0cb870 msgr2=0x7fcedc0af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:02.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.218+0000 7fcee1394640 1 --2- 172.21.15.53:0/2734866838 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcedc0cb870 0x7fcedc0af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:02.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.218+0000 7fcee1394640 1 -- 172.21.15.53:0/2734866838 >> v1:172.21.15.53:6789/0 conn(0x7fcedc0c9750 legacy=0x7fcedc0aced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:02.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.218+0000 7fcee1394640 1 -- 172.21.15.53:0/2734866838 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcedc160370 con 0x7fcedc0afc60 2023-06-10T19:07:02.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.218+0000 7fcee1394640 1 --2- 172.21.15.53:0/2734866838 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcedc0afc60 0x7fcedc0aba10 secure :-1 s=READY pgs=2320 cs=0 l=1 rev1=1 crypto rx=0x7fced4009d90 tx=0x7fced401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd0c1cb418341ce8 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:02.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.218+0000 7fcedb7fe640 1 -- 172.21.15.53:0/2734866838 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced40a5920 con 0x7fcedc0afc60 2023-06-10T19:07:02.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.218+0000 7fcedb7fe640 1 -- 172.21.15.53:0/2734866838 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fced40a5a80 con 0x7fcedc0afc60 2023-06-10T19:07:02.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.218+0000 7fcedb7fe640 1 -- 172.21.15.53:0/2734866838 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced40a5df0 con 0x7fcedc0afc60 2023-06-10T19:07:02.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.222+0000 7fcee2df7640 1 -- 172.21.15.53:0/2734866838 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcedc0afc60 msgr2=0x7fcedc0aba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:02.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.222+0000 7fcee2df7640 1 --2- 172.21.15.53:0/2734866838 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcedc0afc60 0x7fcedc0aba10 secure :-1 s=READY pgs=2320 cs=0 l=1 rev1=1 crypto rx=0x7fced4009d90 tx=0x7fced401c950 comp rx=0 tx=0).stop 2023-06-10T19:07:02.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.222+0000 7fcee2df7640 1 -- 172.21.15.53:0/2734866838 shutdown_connections 2023-06-10T19:07:02.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.222+0000 7fcee2df7640 1 --2- 172.21.15.53:0/2734866838 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcedc0afc60 0x7fcedc0aba10 unknown :-1 s=CLOSED pgs=2320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:02.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.222+0000 7fcee2df7640 1 --2- 172.21.15.53:0/2734866838 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcedc0cb870 0x7fcedc0af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:02.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.222+0000 7fcee2df7640 1 -- 172.21.15.53:0/2734866838 >> 172.21.15.53:0/2734866838 conn(0x7fcedc06a0d0 msgr2=0x7fcedc0ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:02.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.222+0000 7fcee2df7640 1 -- 172.21.15.53:0/2734866838 shutdown_connections 2023-06-10T19:07:02.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.222+0000 7fcee2df7640 1 -- 172.21.15.53:0/2734866838 wait complete. 2023-06-10T19:07:02.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.222+0000 7fcee2df7640 1 Processor -- start 2023-06-10T19:07:02.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.222+0000 7fcee2df7640 1 -- start start 2023-06-10T19:07:02.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.222+0000 7fcee2df7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcedc0afc60 0x7fcedc1f71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:02.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.222+0000 7fcee2df7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcedc0c9750 0x7fcedc1f4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:02.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.222+0000 7fcee2df7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcedc0cb870 0x7fcedc158a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:02.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.222+0000 7fcee2df7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcedc1f4bc0 con 0x7fcedc0c9750 2023-06-10T19:07:02.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.222+0000 7fcee2df7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcedc1f80e0 con 0x7fcedc0cb870 2023-06-10T19:07:02.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.222+0000 7fcee2df7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcedc15a6f0 con 0x7fcedc0afc60 2023-06-10T19:07:02.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.222+0000 7fcedbfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcedc0c9750 0x7fcedc1f4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:02.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.222+0000 7fcedbfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcedc0c9750 0x7fcedc1f4680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49714/0 (socket says 172.21.15.53:49714) 2023-06-10T19:07:02.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.222+0000 7fcedbfff640 1 -- 172.21.15.53:0/2143756670 learned_addr learned my addr 172.21.15.53:0/2143756670 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:02.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.222+0000 7fcee0b93640 1 --2- 172.21.15.53:0/2143756670 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcedc0afc60 0x7fcedc1f71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:02.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.222+0000 7fcee1394640 1 --2- 172.21.15.53:0/2143756670 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcedc0cb870 0x7fcedc158a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:02.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.222+0000 7fcedbfff640 1 -- 172.21.15.53:0/2143756670 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcedc0afc60 msgr2=0x7fcedc1f71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:02.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.222+0000 7fcedbfff640 1 --2- 172.21.15.53:0/2143756670 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcedc0afc60 0x7fcedc1f71b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:02.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.222+0000 7fcedbfff640 1 -- 172.21.15.53:0/2143756670 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcedc0cb870 msgr2=0x7fcedc158a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:02.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.222+0000 7fcedbfff640 1 --2- 172.21.15.53:0/2143756670 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcedc0cb870 0x7fcedc158a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:02.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.222+0000 7fcedbfff640 1 -- 172.21.15.53:0/2143756670 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fced4009a70 con 0x7fcedc0c9750 2023-06-10T19:07:02.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.222+0000 7fcee0b93640 1 --2- 172.21.15.53:0/2143756670 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcedc0afc60 0x7fcedc1f71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:07:02.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.222+0000 7fcee1394640 1 --2- 172.21.15.53:0/2143756670 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcedc0cb870 0x7fcedc158a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:07:02.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.222+0000 7fcedbfff640 1 --2- 172.21.15.53:0/2143756670 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcedc0c9750 0x7fcedc1f4680 secure :-1 s=READY pgs=2321 cs=0 l=1 rev1=1 crypto rx=0x7fcecc00d800 tx=0x7fcecc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:02.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.222+0000 7fced97fa640 1 -- 172.21.15.53:0/2143756670 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcecc00b6c0 con 0x7fcedc0c9750 2023-06-10T19:07:02.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.222+0000 7fced97fa640 1 -- 172.21.15.53:0/2143756670 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcecc00b820 con 0x7fcedc0c9750 2023-06-10T19:07:02.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.222+0000 7fcee2df7640 1 -- 172.21.15.53:0/2143756670 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcedc158f60 con 0x7fcedc0c9750 2023-06-10T19:07:02.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.222+0000 7fced97fa640 1 -- 172.21.15.53:0/2143756670 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcecc00bb90 con 0x7fcedc0c9750 2023-06-10T19:07:02.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.222+0000 7fcee2df7640 1 -- 172.21.15.53:0/2143756670 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcedc1f7b20 con 0x7fcedc0c9750 2023-06-10T19:07:02.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.222+0000 7fcee2df7640 1 -- 172.21.15.53:0/2143756670 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcedc15a860 con 0x7fcedc0c9750 2023-06-10T19:07:02.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.226+0000 7fced97fa640 1 -- 172.21.15.53:0/2143756670 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcecc00bcf0 con 0x7fcedc0c9750 2023-06-10T19:07:02.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.226+0000 7fced97fa640 1 --2- 172.21.15.53:0/2143756670 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcec8066280 0x7fcec8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:02.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.226+0000 7fced97fa640 1 -- 172.21.15.53:0/2143756670 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6105+0+0 (secure 0 0 0) 0x7fcecc0842a0 con 0x7fcedc0c9750 2023-06-10T19:07:02.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.226+0000 7fcee0b93640 1 --2- 172.21.15.53:0/2143756670 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcec8066280 0x7fcec8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:02.232 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.226+0000 7fcee0b93640 1 --2- 172.21.15.53:0/2143756670 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcec8066280 0x7fcec8068730 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fced0005890 tx=0x7fced0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:02.232 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.230+0000 7fced97fa640 1 -- 172.21.15.53:0/2143756670 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcecc055210 con 0x7fcedc0c9750 2023-06-10T19:07:02.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.410+0000 7fcee2df7640 1 -- 172.21.15.53:0/2143756670 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcedc04d790 con 0x7fcedc0c9750 2023-06-10T19:07:02.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.410+0000 7fced97fa640 1 -- 172.21.15.53:0/2143756670 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) v1 ==== 94+0+4679 (secure 0 0 0) 0x7fcecc054da0 con 0x7fcedc0c9750 2023-06-10T19:07:02.412 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:07:02.412 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":89,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/67248348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":67248348},{"type":"v1","addr":"172.21.15.117:6835","nonce":67248348}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":84},{"gid":8296,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3907684243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":3907684243},{"type":"v1","addr":"172.21.15.117:6837","nonce":3907684243}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":84},{"gid":10038,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/1699177406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":1699177406},{"type":"v1","addr":"172.21.15.53:6833","nonce":1699177406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":84}],"filesystems":[{"mdsmap":{"epoch":89,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:06:28.716939+0000","modified":"2023-06-10T19:06:32.084420+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10044},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10044":{"gid":10044,"name":"a","rank":0,"incarnation":85,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/2077620799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2077620799},{"type":"v1","addr":"172.21.15.53:6835","nonce":2077620799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-06-10T19:07:02.413 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 89 2023-06-10T19:07:02.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.410+0000 7fcee2df7640 1 -- 172.21.15.53:0/2143756670 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcec8066280 msgr2=0x7fcec8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:02.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.410+0000 7fcee2df7640 1 --2- 172.21.15.53:0/2143756670 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcec8066280 0x7fcec8068730 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fced0005890 tx=0x7fced0009040 comp rx=0 tx=0).stop 2023-06-10T19:07:02.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.410+0000 7fcee2df7640 1 -- 172.21.15.53:0/2143756670 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcedc0c9750 msgr2=0x7fcedc1f4680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:02.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.410+0000 7fcee2df7640 1 --2- 172.21.15.53:0/2143756670 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcedc0c9750 0x7fcedc1f4680 secure :-1 s=READY pgs=2321 cs=0 l=1 rev1=1 crypto rx=0x7fcecc00d800 tx=0x7fcecc00dcc0 comp rx=0 tx=0).stop 2023-06-10T19:07:02.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.410+0000 7fcee2df7640 1 -- 172.21.15.53:0/2143756670 shutdown_connections 2023-06-10T19:07:02.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.410+0000 7fcee2df7640 1 --2- 172.21.15.53:0/2143756670 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcec8066280 0x7fcec8068730 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:02.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.410+0000 7fcee2df7640 1 --2- 172.21.15.53:0/2143756670 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcedc0cb870 0x7fcedc158a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:02.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.410+0000 7fcee2df7640 1 --2- 172.21.15.53:0/2143756670 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcedc0c9750 0x7fcedc1f4680 unknown :-1 s=CLOSED pgs=2321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:02.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.410+0000 7fcee2df7640 1 --2- 172.21.15.53:0/2143756670 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcedc0afc60 0x7fcedc1f71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:02.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.410+0000 7fcee2df7640 1 -- 172.21.15.53:0/2143756670 >> 172.21.15.53:0/2143756670 conn(0x7fcedc06a0d0 msgr2=0x7fcedc15f4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:02.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.410+0000 7fcee2df7640 1 -- 172.21.15.53:0/2143756670 shutdown_connections 2023-06-10T19:07:02.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.410+0000 7fcee2df7640 1 -- 172.21.15.53:0/2143756670 wait complete. 2023-06-10T19:07:02.430 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:07:02.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.538+0000 7fd5dca76640 1 Processor -- start 2023-06-10T19:07:02.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.538+0000 7fd5dca76640 1 -- start start 2023-06-10T19:07:02.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.538+0000 7fd5dca76640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd5d80c9840 0x7fd5d80c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:02.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.538+0000 7fd5dca76640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd5d806b090 0x7fd5d806b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:02.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.538+0000 7fd5dca76640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5d8159b50 con 0x7fd5d8071060 2023-06-10T19:07:02.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.538+0000 7fd5dca76640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5d80ca150 con 0x7fd5d80c9840 2023-06-10T19:07:02.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.538+0000 7fd5dca76640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5d80702a0 con 0x7fd5d806b090 2023-06-10T19:07:02.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.538+0000 7fd5d659c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd5d80c9840 0x7fd5d80c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:02.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.538+0000 7fd5d5d9b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fd5d8071060 0x7fd5d80af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41858/0 (socket says 172.21.15.53:41858) 2023-06-10T19:07:02.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.538+0000 7fd5d5d9b640 1 -- 172.21.15.53:0/3355206233 learned_addr learned my addr 172.21.15.53:0/3355206233 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:07:02.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.538+0000 7fd5d659c640 1 -- 172.21.15.53:0/3355206233 >> v2:172.21.15.117:3300/0 conn(0x7fd5d806b090 msgr2=0x7fd5d806b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:02.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.538+0000 7fd5d659c640 1 --2- 172.21.15.53:0/3355206233 >> v2:172.21.15.117:3300/0 conn(0x7fd5d806b090 0x7fd5d806b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:02.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.538+0000 7fd5d659c640 1 -- 172.21.15.53:0/3355206233 >> v1:172.21.15.53:6789/0 conn(0x7fd5d8071060 legacy=0x7fd5d80af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:02.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.538+0000 7fd5d659c640 1 -- 172.21.15.53:0/3355206233 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5d8070580 con 0x7fd5d80c9840 2023-06-10T19:07:02.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.538+0000 7fd5d559a640 1 -- 172.21.15.53:0/3355206233 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3765720649 0 0) 0x7fd5d8159b50 con 0x7fd5d8071060 2023-06-10T19:07:02.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.542+0000 7fd5d659c640 1 --2- 172.21.15.53:0/3355206233 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5d80c9840 0x7fd5d80c9c10 secure :-1 s=READY pgs=2323 cs=0 l=1 rev1=1 crypto rx=0x7fd5d815e360 tx=0x7fd5c801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=508f043878844d4 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:02.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.542+0000 7fd5d559a640 1 -- 172.21.15.53:0/3355206233 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c80a7070 con 0x7fd5d80c9840 2023-06-10T19:07:02.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.542+0000 7fd5d559a640 1 -- 172.21.15.53:0/3355206233 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5c80ab430 con 0x7fd5d80c9840 2023-06-10T19:07:02.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.542+0000 7fd5d559a640 1 -- 172.21.15.53:0/3355206233 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c80ab7c0 con 0x7fd5d80c9840 2023-06-10T19:07:02.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.542+0000 7fd5dca76640 1 -- 172.21.15.53:0/3355206233 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5d80c9840 msgr2=0x7fd5d80c9c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:02.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.542+0000 7fd5dca76640 1 --2- 172.21.15.53:0/3355206233 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5d80c9840 0x7fd5d80c9c10 secure :-1 s=READY pgs=2323 cs=0 l=1 rev1=1 crypto rx=0x7fd5d815e360 tx=0x7fd5c801c430 comp rx=0 tx=0).stop 2023-06-10T19:07:02.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.542+0000 7fd5dca76640 1 -- 172.21.15.53:0/3355206233 shutdown_connections 2023-06-10T19:07:02.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.542+0000 7fd5dca76640 1 --2- 172.21.15.53:0/3355206233 >> v2:172.21.15.117:3300/0 conn(0x7fd5d806b090 0x7fd5d806b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:02.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.542+0000 7fd5dca76640 1 --2- 172.21.15.53:0/3355206233 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5d80c9840 0x7fd5d80c9c10 unknown :-1 s=CLOSED pgs=2323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:02.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.542+0000 7fd5dca76640 1 -- 172.21.15.53:0/3355206233 >> 172.21.15.53:0/3355206233 conn(0x7fd5d806a0d0 msgr2=0x7fd5d80ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:02.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.542+0000 7fd5dca76640 1 -- 172.21.15.53:0/3355206233 shutdown_connections 2023-06-10T19:07:02.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.542+0000 7fd5dca76640 1 -- 172.21.15.53:0/3355206233 wait complete. 2023-06-10T19:07:02.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.542+0000 7fd5dca76640 1 Processor -- start 2023-06-10T19:07:02.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.542+0000 7fd5dca76640 1 -- start start 2023-06-10T19:07:02.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.542+0000 7fd5dca76640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5d806b090 0x7fd5d80b3450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:02.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.542+0000 7fd5dca76640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5d8071060 0x7fd5d8146240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:02.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.542+0000 7fd5dca76640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5d80c9840 0x7fd5d80b0d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:02.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.542+0000 7fd5dca76640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d815b590 con 0x7fd5d80c9840 2023-06-10T19:07:02.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.542+0000 7fd5dca76640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d8146780 con 0x7fd5d806b090 2023-06-10T19:07:02.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.542+0000 7fd5dca76640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d815b2b0 con 0x7fd5d8071060 2023-06-10T19:07:02.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.542+0000 7fd5d6d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5d80c9840 0x7fd5d80b0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:02.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.542+0000 7fd5d6d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5d80c9840 0x7fd5d80b0d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49732/0 (socket says 172.21.15.53:49732) 2023-06-10T19:07:02.550 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.542+0000 7fd5d6d9d640 1 -- 172.21.15.53:0/3590391123 learned_addr learned my addr 172.21.15.53:0/3590391123 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:02.550 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.542+0000 7fd5d659c640 1 --2- 172.21.15.53:0/3590391123 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5d806b090 0x7fd5d80b3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:02.551 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.542+0000 7fd5d5d9b640 1 --2- 172.21.15.53:0/3590391123 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5d8071060 0x7fd5d8146240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:02.551 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.542+0000 7fd5d6d9d640 1 -- 172.21.15.53:0/3590391123 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5d8071060 msgr2=0x7fd5d8146240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:02.551 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.542+0000 7fd5d6d9d640 1 --2- 172.21.15.53:0/3590391123 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5d8071060 0x7fd5d8146240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:02.551 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.542+0000 7fd5d6d9d640 1 -- 172.21.15.53:0/3590391123 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5d806b090 msgr2=0x7fd5d80b3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:02.551 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.542+0000 7fd5d6d9d640 1 --2- 172.21.15.53:0/3590391123 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5d806b090 0x7fd5d80b3450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:02.551 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.542+0000 7fd5d6d9d640 1 -- 172.21.15.53:0/3590391123 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c8009420 con 0x7fd5d80c9840 2023-06-10T19:07:02.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.542+0000 7fd5d659c640 1 --2- 172.21.15.53:0/3590391123 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5d806b090 0x7fd5d80b3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:07:02.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.542+0000 7fd5d6d9d640 1 --2- 172.21.15.53:0/3590391123 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5d80c9840 0x7fd5d80b0d00 secure :-1 s=READY pgs=2324 cs=0 l=1 rev1=1 crypto rx=0x7fd5d000b970 tx=0x7fd5d000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:02.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.542+0000 7fd5c6ffd640 1 -- 172.21.15.53:0/3590391123 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d000cb40 con 0x7fd5d80c9840 2023-06-10T19:07:02.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.542+0000 7fd5c6ffd640 1 -- 172.21.15.53:0/3590391123 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5d000ccc0 con 0x7fd5d80c9840 2023-06-10T19:07:02.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.542+0000 7fd5c6ffd640 1 -- 172.21.15.53:0/3590391123 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d0014680 con 0x7fd5d80c9840 2023-06-10T19:07:02.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.542+0000 7fd5dca76640 1 -- 172.21.15.53:0/3590391123 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5d80b2200 con 0x7fd5d80c9840 2023-06-10T19:07:02.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.542+0000 7fd5dca76640 1 -- 172.21.15.53:0/3590391123 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5d80b27c0 con 0x7fd5d80c9840 2023-06-10T19:07:02.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.546+0000 7fd5dca76640 1 -- 172.21.15.53:0/3590391123 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5d80b3990 con 0x7fd5d80c9840 2023-06-10T19:07:02.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.546+0000 7fd5c6ffd640 1 -- 172.21.15.53:0/3590391123 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd5d001d3b0 con 0x7fd5d80c9840 2023-06-10T19:07:02.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.546+0000 7fd5c6ffd640 1 --2- 172.21.15.53:0/3590391123 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd5b8066280 0x7fd5b8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:02.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.546+0000 7fd5c6ffd640 1 -- 172.21.15.53:0/3590391123 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6105+0+0 (secure 0 0 0) 0x7fd5d0083d40 con 0x7fd5d80c9840 2023-06-10T19:07:02.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.546+0000 7fd5d659c640 1 --2- 172.21.15.53:0/3590391123 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd5b8066280 0x7fd5b8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:02.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.546+0000 7fd5d659c640 1 --2- 172.21.15.53:0/3590391123 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd5b8066280 0x7fd5b8068730 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fd5c80af000 tx=0x7fd5c8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:02.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.550+0000 7fd5c6ffd640 1 -- 172.21.15.53:0/3590391123 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd5d0051190 con 0x7fd5d80c9840 2023-06-10T19:07:02.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.726+0000 7fd5dca76640 1 -- 172.21.15.53:0/3590391123 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd5d80b2060 con 0x7fd5d80c9840 2023-06-10T19:07:02.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.726+0000 7fd5c6ffd640 1 -- 172.21.15.53:0/3590391123 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) v1 ==== 94+0+4679 (secure 0 0 0) 0x7fd5d80b2060 con 0x7fd5d80c9840 2023-06-10T19:07:02.729 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:07:02.729 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":89,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/67248348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":67248348},{"type":"v1","addr":"172.21.15.117:6835","nonce":67248348}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":84},{"gid":8296,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3907684243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":3907684243},{"type":"v1","addr":"172.21.15.117:6837","nonce":3907684243}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":84},{"gid":10038,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/1699177406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":1699177406},{"type":"v1","addr":"172.21.15.53:6833","nonce":1699177406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":84}],"filesystems":[{"mdsmap":{"epoch":89,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:06:28.716939+0000","modified":"2023-06-10T19:06:32.084420+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10044},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10044":{"gid":10044,"name":"a","rank":0,"incarnation":85,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/2077620799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":2077620799},{"type":"v1","addr":"172.21.15.53:6835","nonce":2077620799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-06-10T19:07:02.730 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 89 2023-06-10T19:07:02.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.730+0000 7fd5dca76640 1 -- 172.21.15.53:0/3590391123 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd5b8066280 msgr2=0x7fd5b8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:02.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.730+0000 7fd5dca76640 1 --2- 172.21.15.53:0/3590391123 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd5b8066280 0x7fd5b8068730 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fd5c80af000 tx=0x7fd5c8008040 comp rx=0 tx=0).stop 2023-06-10T19:07:02.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.730+0000 7fd5dca76640 1 -- 172.21.15.53:0/3590391123 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5d80c9840 msgr2=0x7fd5d80b0d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:02.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.730+0000 7fd5dca76640 1 --2- 172.21.15.53:0/3590391123 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5d80c9840 0x7fd5d80b0d00 secure :-1 s=READY pgs=2324 cs=0 l=1 rev1=1 crypto rx=0x7fd5d000b970 tx=0x7fd5d000be30 comp rx=0 tx=0).stop 2023-06-10T19:07:02.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.730+0000 7fd5dca76640 1 -- 172.21.15.53:0/3590391123 shutdown_connections 2023-06-10T19:07:02.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.730+0000 7fd5dca76640 1 --2- 172.21.15.53:0/3590391123 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd5b8066280 0x7fd5b8068730 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:02.732 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.730+0000 7fd5dca76640 1 --2- 172.21.15.53:0/3590391123 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd5d80c9840 0x7fd5d80b0d00 unknown :-1 s=CLOSED pgs=2324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:02.732 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.730+0000 7fd5dca76640 1 --2- 172.21.15.53:0/3590391123 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5d8071060 0x7fd5d8146240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:02.732 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.730+0000 7fd5dca76640 1 --2- 172.21.15.53:0/3590391123 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5d806b090 0x7fd5d80b3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:02.732 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.730+0000 7fd5dca76640 1 -- 172.21.15.53:0/3590391123 >> 172.21.15.53:0/3590391123 conn(0x7fd5d806a0d0 msgr2=0x7fd5d80c82d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:02.732 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.730+0000 7fd5dca76640 1 -- 172.21.15.53:0/3590391123 shutdown_connections 2023-06-10T19:07:02.732 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.730+0000 7fd5dca76640 1 -- 172.21.15.53:0/3590391123 wait complete. 2023-06-10T19:07:02.746 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:07:02.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.862+0000 7fb3be9f6640 1 Processor -- start 2023-06-10T19:07:02.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.862+0000 7fb3be9f6640 1 -- start start 2023-06-10T19:07:02.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.866+0000 7fb3be9f6640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb3b80c9e50 0x7fb3b8159c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:02.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.866+0000 7fb3be9f6640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb3b815a140 0x7fb3b80c8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:02.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.866+0000 7fb3be9f6640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3b815d260 con 0x7fb3b8159830 2023-06-10T19:07:02.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.866+0000 7fb3be9f6640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3b815aa30 con 0x7fb3b815a140 2023-06-10T19:07:02.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.866+0000 7fb3be9f6640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3b815d4b0 con 0x7fb3b80c9e50 2023-06-10T19:07:02.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.866+0000 7fb3bcf93640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb3b815a140 0x7fb3b80c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:02.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.866+0000 7fb3bcf93640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb3b815a140 0x7fb3b80c8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49744/0 (socket says 172.21.15.53:49744) 2023-06-10T19:07:02.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.866+0000 7fb3bcf93640 1 -- 172.21.15.53:0/1383697954 learned_addr learned my addr 172.21.15.53:0/1383697954 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:02.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.866+0000 7fb3b77fe640 1 --2- 172.21.15.53:0/1383697954 >> v2:172.21.15.117:3300/0 conn(0x7fb3b80c9e50 0x7fb3b8159c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:02.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.866+0000 7fb3bcf93640 1 -- 172.21.15.53:0/1383697954 >> v2:172.21.15.117:3300/0 conn(0x7fb3b80c9e50 msgr2=0x7fb3b8159c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:02.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.866+0000 7fb3bcf93640 1 --2- 172.21.15.53:0/1383697954 >> v2:172.21.15.117:3300/0 conn(0x7fb3b80c9e50 0x7fb3b8159c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:02.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.866+0000 7fb3bcf93640 1 -- 172.21.15.53:0/1383697954 >> v1:172.21.15.117:6789/0 conn(0x7fb3b8159830 legacy=0x7fb3b80c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:02.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.866+0000 7fb3bcf93640 1 -- 172.21.15.53:0/1383697954 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3b815d790 con 0x7fb3b815a140 2023-06-10T19:07:02.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.870+0000 7fb3bcf93640 1 --2- 172.21.15.53:0/1383697954 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3b815a140 0x7fb3b80c8260 secure :-1 s=READY pgs=2325 cs=0 l=1 rev1=1 crypto rx=0x7fb3b80cec70 tx=0x7fb3b001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da867ece7dc7c3d5 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:02.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.870+0000 7fb3b6ffd640 1 -- 172.21.15.53:0/1383697954 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b00a56f0 con 0x7fb3b815a140 2023-06-10T19:07:02.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.870+0000 7fb3b6ffd640 1 -- 172.21.15.53:0/1383697954 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3b00a5850 con 0x7fb3b815a140 2023-06-10T19:07:02.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.870+0000 7fb3b6ffd640 1 -- 172.21.15.53:0/1383697954 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b00a5be0 con 0x7fb3b815a140 2023-06-10T19:07:02.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.870+0000 7fb3be9f6640 1 -- 172.21.15.53:0/1383697954 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3b815a140 msgr2=0x7fb3b80c8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:02.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.870+0000 7fb3be9f6640 1 --2- 172.21.15.53:0/1383697954 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3b815a140 0x7fb3b80c8260 secure :-1 s=READY pgs=2325 cs=0 l=1 rev1=1 crypto rx=0x7fb3b80cec70 tx=0x7fb3b001c910 comp rx=0 tx=0).stop 2023-06-10T19:07:02.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.870+0000 7fb3be9f6640 1 -- 172.21.15.53:0/1383697954 shutdown_connections 2023-06-10T19:07:02.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.870+0000 7fb3be9f6640 1 --2- 172.21.15.53:0/1383697954 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3b815a140 0x7fb3b80c8260 unknown :-1 s=CLOSED pgs=2325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:02.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.870+0000 7fb3be9f6640 1 --2- 172.21.15.53:0/1383697954 >> v2:172.21.15.117:3300/0 conn(0x7fb3b80c9e50 0x7fb3b8159c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:02.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.870+0000 7fb3be9f6640 1 -- 172.21.15.53:0/1383697954 >> 172.21.15.53:0/1383697954 conn(0x7fb3b80cdca0 msgr2=0x7fb3b80ce0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:02.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.870+0000 7fb3be9f6640 1 -- 172.21.15.53:0/1383697954 shutdown_connections 2023-06-10T19:07:02.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.870+0000 7fb3be9f6640 1 -- 172.21.15.53:0/1383697954 wait complete. 2023-06-10T19:07:02.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.870+0000 7fb3be9f6640 1 Processor -- start 2023-06-10T19:07:02.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.870+0000 7fb3be9f6640 1 -- start start 2023-06-10T19:07:02.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.870+0000 7fb3be9f6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3b80c9e50 0x7fb3b81f7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:02.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.870+0000 7fb3be9f6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3b8159830 0x7fb3b80b0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:02.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.870+0000 7fb3be9f6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3b815a140 0x7fb3b80b1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:02.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.870+0000 7fb3be9f6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b8070620 con 0x7fb3b815a140 2023-06-10T19:07:02.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.870+0000 7fb3be9f6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b8070850 con 0x7fb3b80c9e50 2023-06-10T19:07:02.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.870+0000 7fb3be9f6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b8070b30 con 0x7fb3b8159830 2023-06-10T19:07:02.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.870+0000 7fb3bcf93640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3b815a140 0x7fb3b80b1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:02.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.870+0000 7fb3bcf93640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3b815a140 0x7fb3b80b1500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49752/0 (socket says 172.21.15.53:49752) 2023-06-10T19:07:02.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.870+0000 7fb3bcf93640 1 -- 172.21.15.53:0/2332086288 learned_addr learned my addr 172.21.15.53:0/2332086288 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:02.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.870+0000 7fb3b77fe640 1 --2- 172.21.15.53:0/2332086288 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3b8159830 0x7fb3b80b0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:02.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.870+0000 7fb3b7fff640 1 --2- 172.21.15.53:0/2332086288 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3b80c9e50 0x7fb3b81f7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:02.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.870+0000 7fb3bcf93640 1 -- 172.21.15.53:0/2332086288 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3b8159830 msgr2=0x7fb3b80b0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:02.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.870+0000 7fb3bcf93640 1 --2- 172.21.15.53:0/2332086288 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3b8159830 0x7fb3b80b0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:02.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.870+0000 7fb3bcf93640 1 -- 172.21.15.53:0/2332086288 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3b80c9e50 msgr2=0x7fb3b81f7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:02.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.870+0000 7fb3bcf93640 1 --2- 172.21.15.53:0/2332086288 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3b80c9e50 0x7fb3b81f7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:02.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.870+0000 7fb3bcf93640 1 -- 172.21.15.53:0/2332086288 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3b0009b30 con 0x7fb3b815a140 2023-06-10T19:07:02.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.870+0000 7fb3bcf93640 1 --2- 172.21.15.53:0/2332086288 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3b815a140 0x7fb3b80b1500 secure :-1 s=READY pgs=2326 cs=0 l=1 rev1=1 crypto rx=0x7fb3b0019520 tx=0x7fb3b00196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:02.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.870+0000 7fb3b4ff9640 1 -- 172.21.15.53:0/2332086288 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b00b8670 con 0x7fb3b815a140 2023-06-10T19:07:02.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.874+0000 7fb3b4ff9640 1 -- 172.21.15.53:0/2332086288 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3b00b87f0 con 0x7fb3b815a140 2023-06-10T19:07:02.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.874+0000 7fb3b4ff9640 1 -- 172.21.15.53:0/2332086288 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b00b8ba0 con 0x7fb3b815a140 2023-06-10T19:07:02.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.874+0000 7fb3be9f6640 1 -- 172.21.15.53:0/2332086288 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3b8070e10 con 0x7fb3b815a140 2023-06-10T19:07:02.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.874+0000 7fb3be9f6640 1 -- 172.21.15.53:0/2332086288 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3b8163160 con 0x7fb3b815a140 2023-06-10T19:07:02.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.874+0000 7fb3be9f6640 1 -- 172.21.15.53:0/2332086288 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3b8071030 con 0x7fb3b815a140 2023-06-10T19:07:02.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.874+0000 7fb3b4ff9640 1 -- 172.21.15.53:0/2332086288 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb3b00b8d00 con 0x7fb3b815a140 2023-06-10T19:07:02.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.874+0000 7fb3b4ff9640 1 --2- 172.21.15.53:0/2332086288 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb3a4066280 0x7fb3a4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:02.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.874+0000 7fb3b4ff9640 1 -- 172.21.15.53:0/2332086288 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6105+0+0 (secure 0 0 0) 0x7fb3b011f1f0 con 0x7fb3b815a140 2023-06-10T19:07:02.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.874+0000 7fb3b7fff640 1 --2- 172.21.15.53:0/2332086288 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb3a4066280 0x7fb3a4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:02.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.874+0000 7fb3b7fff640 1 --2- 172.21.15.53:0/2332086288 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb3a4066280 0x7fb3a4068730 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fb3a8000f70 tx=0x7fb3a8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:02.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:02.878+0000 7fb3b4ff9640 1 -- 172.21.15.53:0/2332086288 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb3b00ec700 con 0x7fb3b815a140 2023-06-10T19:07:03.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:03.030+0000 7fb3be9f6640 1 -- 172.21.15.53:0/2332086288 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb3b804d790 con 0x7fb3b815a140 2023-06-10T19:07:03.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:03.034+0000 7fb3b4ff9640 1 -- 172.21.15.53:0/2332086288 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v155) v1 ==== 74+0+18349 (secure 0 0 0) 0x7fb3b0009510 con 0x7fb3b815a140 2023-06-10T19:07:03.035 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:07:03.036 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":155,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:06:50.154677+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-06-10T19:06:27.279397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-06-10T19:06:27.689260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"154","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.0.1:0/2213488734":"2023-06-10T20:06:49.780814+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:07:03.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:03.034+0000 7fb3be9f6640 1 -- 172.21.15.53:0/2332086288 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb3a4066280 msgr2=0x7fb3a4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:03.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:03.034+0000 7fb3be9f6640 1 --2- 172.21.15.53:0/2332086288 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb3a4066280 0x7fb3a4068730 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fb3a8000f70 tx=0x7fb3a8009040 comp rx=0 tx=0).stop 2023-06-10T19:07:03.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:03.034+0000 7fb3be9f6640 1 -- 172.21.15.53:0/2332086288 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3b815a140 msgr2=0x7fb3b80b1500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:03.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:03.034+0000 7fb3be9f6640 1 --2- 172.21.15.53:0/2332086288 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3b815a140 0x7fb3b80b1500 secure :-1 s=READY pgs=2326 cs=0 l=1 rev1=1 crypto rx=0x7fb3b0019520 tx=0x7fb3b00196b0 comp rx=0 tx=0).stop 2023-06-10T19:07:03.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:03.034+0000 7fb3be9f6640 1 -- 172.21.15.53:0/2332086288 shutdown_connections 2023-06-10T19:07:03.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:03.034+0000 7fb3be9f6640 1 --2- 172.21.15.53:0/2332086288 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb3a4066280 0x7fb3a4068730 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:03.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:03.034+0000 7fb3be9f6640 1 --2- 172.21.15.53:0/2332086288 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3b815a140 0x7fb3b80b1500 unknown :-1 s=CLOSED pgs=2326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:03.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:03.034+0000 7fb3be9f6640 1 --2- 172.21.15.53:0/2332086288 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb3b8159830 0x7fb3b80b0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:03.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:03.034+0000 7fb3be9f6640 1 --2- 172.21.15.53:0/2332086288 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3b80c9e50 0x7fb3b81f7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:03.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:03.034+0000 7fb3be9f6640 1 -- 172.21.15.53:0/2332086288 >> 172.21.15.53:0/2332086288 conn(0x7fb3b80cdca0 msgr2=0x7fb3b80c9740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:03.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:03.034+0000 7fb3be9f6640 1 -- 172.21.15.53:0/2332086288 shutdown_connections 2023-06-10T19:07:03.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:03.034+0000 7fb3be9f6640 1 -- 172.21.15.53:0/2332086288 wait complete. 2023-06-10T19:07:03.056 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-06-10T19:07:03.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:03.174+0000 7f75320dd640 1 Processor -- start 2023-06-10T19:07:03.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:03.174+0000 7f75320dd640 1 -- start start 2023-06-10T19:07:03.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:03.174+0000 7f75320dd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f752c0cec40 0x7f752c0cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:03.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:03.174+0000 7f75320dd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f752c0cbf50 0x7f752c0cc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:03.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:03.174+0000 7f75320dd640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f752c0cbac0 con 0x7f752c159450 2023-06-10T19:07:03.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:03.174+0000 7f75320dd640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f752c0cf600 con 0x7f752c0cec40 2023-06-10T19:07:03.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:03.174+0000 7f75320dd640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f752c15dc00 con 0x7f752c0cbf50 2023-06-10T19:07:03.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:03.174+0000 7f752bfff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f752c0cbf50 0x7f752c0cc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:03.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:03.174+0000 7f752affd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f752c0cec40 0x7f752c0cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:03.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:03.174+0000 7f752bfff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f752c0cbf50 0x7f752c0cc3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.53:50614/0 (socket says 172.21.15.53:50614) 2023-06-10T19:07:03.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:03.174+0000 7f752bfff640 1 -- 172.21.15.53:0/3968272339 learned_addr learned my addr 172.21.15.53:0/3968272339 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:03.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:03.178+0000 7f752affd640 1 -- 172.21.15.53:0/3968272339 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f752c0cbf50 msgr2=0x7f752c0cc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:03.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:03.178+0000 7f752affd640 1 --2- 172.21.15.53:0/3968272339 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f752c0cbf50 0x7f752c0cc3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:03.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:03.178+0000 7f752affd640 1 -- 172.21.15.53:0/3968272339 >> v1:172.21.15.117:6789/0 conn(0x7f752c159450 legacy=0x7f752c15d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:03.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:03.178+0000 7f752affd640 1 -- 172.21.15.53:0/3968272339 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f752c15dee0 con 0x7f752c0cec40 2023-06-10T19:07:03.180 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:03.178+0000 7f752affd640 1 --2- 172.21.15.53:0/3968272339 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f752c0cec40 0x7f752c0cf0c0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f75200097c0 tx=0x7f752001c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=478e1032615b9472 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:03.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:03.178+0000 7f752a7fc640 1 -- 172.21.15.53:0/3968272339 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75200ab610 con 0x7f752c0cec40 2023-06-10T19:07:03.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:03.178+0000 7f752a7fc640 1 -- 172.21.15.53:0/3968272339 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75200ab770 con 0x7f752c0cec40 2023-06-10T19:07:03.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:03.178+0000 7f752a7fc640 1 -- 172.21.15.53:0/3968272339 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75200abb00 con 0x7f752c0cec40 2023-06-10T19:07:03.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:03.178+0000 7f75320dd640 1 -- 172.21.15.53:0/3968272339 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f752c0cec40 msgr2=0x7f752c0cf0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:03.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:03.178+0000 7f75320dd640 1 --2- 172.21.15.53:0/3968272339 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f752c0cec40 0x7f752c0cf0c0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f75200097c0 tx=0x7f752001c450 comp rx=0 tx=0).stop 2023-06-10T19:07:03.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:03.178+0000 7f75320dd640 1 -- 172.21.15.53:0/3968272339 shutdown_connections 2023-06-10T19:07:03.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:03.178+0000 7f75320dd640 1 --2- 172.21.15.53:0/3968272339 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f752c0cbf50 0x7f752c0cc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:03.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:03.178+0000 7f75320dd640 1 --2- 172.21.15.53:0/3968272339 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f752c0cec40 0x7f752c0cf0c0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:03.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:03.178+0000 7f75320dd640 1 -- 172.21.15.53:0/3968272339 >> 172.21.15.53:0/3968272339 conn(0x7f752c06a0b0 msgr2=0x7f752c06d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:03.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:03.178+0000 7f75320dd640 1 -- 172.21.15.53:0/3968272339 shutdown_connections 2023-06-10T19:07:03.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:03.178+0000 7f75320dd640 1 -- 172.21.15.53:0/3968272339 wait complete. 2023-06-10T19:07:03.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:03.182+0000 7f75320dd640 1 Processor -- start 2023-06-10T19:07:03.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:03.182+0000 7f75320dd640 1 -- start start 2023-06-10T19:07:03.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:03.182+0000 7f75320dd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f752c0cbf50 0x7f752c1477a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:03.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:03.182+0000 7f75320dd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f752c0cec40 0x7f752c0c99d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:03.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:03.182+0000 7f75320dd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f752c159450 0x7f752c0c78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:03.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:03.182+0000 7f75320dd640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f752c1507b0 con 0x7f752c159450 2023-06-10T19:07:03.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:03.182+0000 7f75320dd640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f752c14fba0 con 0x7f752c0cbf50 2023-06-10T19:07:03.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:03.182+0000 7f75320dd640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f752c14fe80 con 0x7f752c0cec40 2023-06-10T19:07:03.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:03.182+0000 7f752bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f752c159450 0x7f752c0c78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:03.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:03.182+0000 7f752bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f752c159450 0x7f752c0c78a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49754/0 (socket says 172.21.15.53:49754) 2023-06-10T19:07:03.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:03.182+0000 7f752bfff640 1 -- 172.21.15.53:0/1528320943 learned_addr learned my addr 172.21.15.53:0/1528320943 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:03.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:03.182+0000 7f752b7fe640 1 --2- 172.21.15.53:0/1528320943 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f752c0cbf50 0x7f752c1477a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:03.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:03.182+0000 7f752affd640 1 --2- 172.21.15.53:0/1528320943 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f752c0cec40 0x7f752c0c99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:03.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:03.182+0000 7f752bfff640 1 -- 172.21.15.53:0/1528320943 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f752c0cec40 msgr2=0x7f752c0c99d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:03.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:03.182+0000 7f752bfff640 1 --2- 172.21.15.53:0/1528320943 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f752c0cec40 0x7f752c0c99d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:03.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:03.182+0000 7f752bfff640 1 -- 172.21.15.53:0/1528320943 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f752c0cbf50 msgr2=0x7f752c1477a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:03.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:03.182+0000 7f752bfff640 1 --2- 172.21.15.53:0/1528320943 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f752c0cbf50 0x7f752c1477a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:03.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:03.182+0000 7f752bfff640 1 -- 172.21.15.53:0/1528320943 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7520009420 con 0x7f752c159450 2023-06-10T19:07:03.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:03.182+0000 7f752affd640 1 --2- 172.21.15.53:0/1528320943 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f752c0cec40 0x7f752c0c99d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:07:03.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:03.182+0000 7f752bfff640 1 --2- 172.21.15.53:0/1528320943 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f752c159450 0x7f752c0c78a0 secure :-1 s=READY pgs=2327 cs=0 l=1 rev1=1 crypto rx=0x7f752400efc0 tx=0x7f752400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:03.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:03.182+0000 7f7513fff640 1 -- 172.21.15.53:0/1528320943 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7524009b60 con 0x7f752c159450 2023-06-10T19:07:03.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:03.182+0000 7f7513fff640 1 -- 172.21.15.53:0/1528320943 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f752400f040 con 0x7f752c159450 2023-06-10T19:07:03.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:03.182+0000 7f75320dd640 1 -- 172.21.15.53:0/1528320943 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f752c15d9d0 con 0x7f752c159450 2023-06-10T19:07:03.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:03.182+0000 7f7513fff640 1 -- 172.21.15.53:0/1528320943 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75240039a0 con 0x7f752c159450 2023-06-10T19:07:03.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:03.182+0000 7f75320dd640 1 -- 172.21.15.53:0/1528320943 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f752c150440 con 0x7f752c159450 2023-06-10T19:07:03.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:03.182+0000 7f75320dd640 1 -- 172.21.15.53:0/1528320943 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f752c150920 con 0x7f752c159450 2023-06-10T19:07:03.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:03.182+0000 7f7513fff640 1 -- 172.21.15.53:0/1528320943 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7524003b00 con 0x7f752c159450 2023-06-10T19:07:03.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:03.186+0000 7f7513fff640 1 --2- 172.21.15.53:0/1528320943 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7518066280 0x7f7518068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:03.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:03.186+0000 7f7513fff640 1 -- 172.21.15.53:0/1528320943 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6105+0+0 (secure 0 0 0) 0x7f7524084310 con 0x7f752c159450 2023-06-10T19:07:03.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:03.186+0000 7f752b7fe640 1 --2- 172.21.15.53:0/1528320943 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7518066280 0x7f7518068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:03.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:03.186+0000 7f752b7fe640 1 --2- 172.21.15.53:0/1528320943 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7518066280 0x7f7518068730 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f751c001810 tx=0x7f751c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:03.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:03.190+0000 7f7513fff640 1 -- 172.21.15.53:0/1528320943 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f75240516c0 con 0x7f752c159450 2023-06-10T19:07:03.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:03.374+0000 7f75320dd640 1 -- 172.21.15.53:0/1528320943 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f752c04d790 con 0x7f752c159450 2023-06-10T19:07:04.243 INFO:tasks.ceph.mon.a.smithi053.stderr:2023-06-10T19:07:04.242+0000 7f74752c1640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-06-10T19:07:04.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:04.258+0000 7f7513fff640 1 -- 172.21.15.53:0/1528320943 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v90) v1 ==== 161+0+0 (secure 0 0 0) 0x7f7524054ce0 con 0x7f752c159450 2023-06-10T19:07:04.260 INFO:teuthology.orchestra.run.smithi053.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-06-10T19:07:04.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:04.262+0000 7f75320dd640 1 -- 172.21.15.53:0/1528320943 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7518066280 msgr2=0x7f7518068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:04.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:04.262+0000 7f75320dd640 1 --2- 172.21.15.53:0/1528320943 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7518066280 0x7f7518068730 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f751c001810 tx=0x7f751c009040 comp rx=0 tx=0).stop 2023-06-10T19:07:04.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:04.262+0000 7f75320dd640 1 -- 172.21.15.53:0/1528320943 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f752c159450 msgr2=0x7f752c0c78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:04.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:04.262+0000 7f75320dd640 1 --2- 172.21.15.53:0/1528320943 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f752c159450 0x7f752c0c78a0 secure :-1 s=READY pgs=2327 cs=0 l=1 rev1=1 crypto rx=0x7f752400efc0 tx=0x7f752400c490 comp rx=0 tx=0).stop 2023-06-10T19:07:04.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:04.262+0000 7f75320dd640 1 -- 172.21.15.53:0/1528320943 shutdown_connections 2023-06-10T19:07:04.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:04.262+0000 7f75320dd640 1 --2- 172.21.15.53:0/1528320943 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7518066280 0x7f7518068730 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:04.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:04.262+0000 7f75320dd640 1 --2- 172.21.15.53:0/1528320943 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f752c159450 0x7f752c0c78a0 unknown :-1 s=CLOSED pgs=2327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:04.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:04.262+0000 7f75320dd640 1 --2- 172.21.15.53:0/1528320943 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f752c0cec40 0x7f752c0c99d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:04.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:04.262+0000 7f75320dd640 1 --2- 172.21.15.53:0/1528320943 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f752c0cbf50 0x7f752c1477a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:04.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:04.262+0000 7f75320dd640 1 -- 172.21.15.53:0/1528320943 >> 172.21.15.53:0/1528320943 conn(0x7f752c06a0b0 msgr2=0x7f752c0af8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:04.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:04.262+0000 7f75320dd640 1 -- 172.21.15.53:0/1528320943 shutdown_connections 2023-06-10T19:07:04.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:04.262+0000 7f75320dd640 1 -- 172.21.15.53:0/1528320943 wait complete. 2023-06-10T19:07:04.266 INFO:tasks.ceph.mds.a.smithi053.stderr: -7427> 2023-06-10T19:06:30.258+0000 7fa6c9434640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-06-10T19:07:04.285 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-06-10T19:07:04.311 INFO:tasks.ceph.mds.a.smithi053.stdout:starting mds.a at 2023-06-10T19:07:04.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:04.406+0000 7fb9d4703640 1 Processor -- start 2023-06-10T19:07:04.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:04.406+0000 7fb9d4703640 1 -- start start 2023-06-10T19:07:04.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:04.406+0000 7fb9d4703640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb9cc156180 0x7fb9cc0cd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:04.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:04.406+0000 7fb9d4703640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9cc06b090 con 0x7fb9cc15c4f0 2023-06-10T19:07:04.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:04.406+0000 7fb9d4703640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9cc06efa0 con 0x7fb9cc15c070 2023-06-10T19:07:04.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:04.406+0000 7fb9d4703640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9cc0cc720 con 0x7fb9cc156180 2023-06-10T19:07:04.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:04.406+0000 7fb9d249f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb9cc156180 0x7fb9cc0cd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:04.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:04.406+0000 7fb9d2ca0640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fb9cc15c4f0 0x7fb9cc159190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41886/0 (socket says 172.21.15.53:41886) 2023-06-10T19:07:04.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:04.410+0000 7fb9d2ca0640 1 -- 172.21.15.53:0/2886257929 learned_addr learned my addr 172.21.15.53:0/2886257929 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:07:04.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:04.410+0000 7fb9d249f640 1 -- 172.21.15.53:0/2886257929 >> v1:172.21.15.117:6789/0 conn(0x7fb9cc15c070 legacy=0x7fb9cc158a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:04.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:04.410+0000 7fb9d249f640 1 -- 172.21.15.53:0/2886257929 >> v1:172.21.15.53:6789/0 conn(0x7fb9cc15c4f0 legacy=0x7fb9cc159190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:04.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:04.410+0000 7fb9d149d640 1 -- 172.21.15.53:0/2886257929 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4042502877 0 0) 0x7fb9cc06b090 con 0x7fb9cc15c4f0 2023-06-10T19:07:04.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:04.410+0000 7fb9d249f640 1 -- 172.21.15.53:0/2886257929 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9cc0cc9a0 con 0x7fb9cc156180 2023-06-10T19:07:04.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:04.410+0000 7fb9d249f640 1 --2- 172.21.15.53:0/2886257929 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9cc156180 0x7fb9cc0cd4a0 secure :-1 s=READY pgs=2332 cs=0 l=1 rev1=1 crypto rx=0x7fb9c80097c0 tx=0x7fb9c801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=456250575d890bea server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:04.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:04.410+0000 7fb9d149d640 1 -- 172.21.15.53:0/2886257929 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c80ab600 con 0x7fb9cc156180 2023-06-10T19:07:04.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:04.410+0000 7fb9d149d640 1 -- 172.21.15.53:0/2886257929 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9c80a7050 con 0x7fb9cc156180 2023-06-10T19:07:04.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:04.410+0000 7fb9d149d640 1 -- 172.21.15.53:0/2886257929 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c80ab980 con 0x7fb9cc156180 2023-06-10T19:07:04.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:04.410+0000 7fb9d4703640 1 -- 172.21.15.53:0/2886257929 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9cc156180 msgr2=0x7fb9cc0cd4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:04.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:04.410+0000 7fb9d4703640 1 --2- 172.21.15.53:0/2886257929 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9cc156180 0x7fb9cc0cd4a0 secure :-1 s=READY pgs=2332 cs=0 l=1 rev1=1 crypto rx=0x7fb9c80097c0 tx=0x7fb9c801c480 comp rx=0 tx=0).stop 2023-06-10T19:07:04.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:04.410+0000 7fb9d4703640 1 -- 172.21.15.53:0/2886257929 shutdown_connections 2023-06-10T19:07:04.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:04.410+0000 7fb9d4703640 1 --2- 172.21.15.53:0/2886257929 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9cc156180 0x7fb9cc0cd4a0 unknown :-1 s=CLOSED pgs=2332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:04.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:04.410+0000 7fb9d4703640 1 -- 172.21.15.53:0/2886257929 >> 172.21.15.53:0/2886257929 conn(0x7fb9cc06a0e0 msgr2=0x7fb9cc0cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:04.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:04.414+0000 7fb9d4703640 1 -- 172.21.15.53:0/2886257929 shutdown_connections 2023-06-10T19:07:04.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:04.414+0000 7fb9d4703640 1 -- 172.21.15.53:0/2886257929 wait complete. 2023-06-10T19:07:04.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:04.414+0000 7fb9d4703640 1 Processor -- start 2023-06-10T19:07:04.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:04.414+0000 7fb9d4703640 1 -- start start 2023-06-10T19:07:04.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:04.414+0000 7fb9d4703640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb9cc156180 0x7fb9cc161620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:04.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:04.414+0000 7fb9d4703640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9cc15c070 0x7fb9cc1523b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:04.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:04.414+0000 7fb9d4703640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9cc15c4f0 0x7fb9cc0702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:04.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:04.414+0000 7fb9d4703640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9cc161b60 con 0x7fb9cc15c4f0 2023-06-10T19:07:04.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:04.414+0000 7fb9d4703640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9cc0c2b30 con 0x7fb9cc156180 2023-06-10T19:07:04.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:04.414+0000 7fb9d4703640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9cc163540 con 0x7fb9cc15c070 2023-06-10T19:07:04.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:04.414+0000 7fb9d2ca0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9cc15c4f0 0x7fb9cc0702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:04.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:04.414+0000 7fb9d2ca0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9cc15c4f0 0x7fb9cc0702f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49794/0 (socket says 172.21.15.53:49794) 2023-06-10T19:07:04.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:04.414+0000 7fb9d2ca0640 1 -- 172.21.15.53:0/205504371 learned_addr learned my addr 172.21.15.53:0/205504371 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:04.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:04.414+0000 7fb9d249f640 1 --2- 172.21.15.53:0/205504371 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb9cc156180 0x7fb9cc161620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:04.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:04.414+0000 7fb9d1c9e640 1 --2- 172.21.15.53:0/205504371 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9cc15c070 0x7fb9cc1523b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:04.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:04.414+0000 7fb9d2ca0640 1 -- 172.21.15.53:0/205504371 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9cc15c070 msgr2=0x7fb9cc1523b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:04.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:04.414+0000 7fb9d2ca0640 1 --2- 172.21.15.53:0/205504371 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9cc15c070 0x7fb9cc1523b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:04.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:04.414+0000 7fb9d2ca0640 1 -- 172.21.15.53:0/205504371 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb9cc156180 msgr2=0x7fb9cc161620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:04.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:04.414+0000 7fb9d2ca0640 1 --2- 172.21.15.53:0/205504371 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb9cc156180 0x7fb9cc161620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:04.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:04.414+0000 7fb9d2ca0640 1 -- 172.21.15.53:0/205504371 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9c8009420 con 0x7fb9cc15c4f0 2023-06-10T19:07:04.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:04.414+0000 7fb9d2ca0640 1 --2- 172.21.15.53:0/205504371 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9cc15c4f0 0x7fb9cc0702f0 secure :-1 s=READY pgs=2333 cs=0 l=1 rev1=1 crypto rx=0x7fb9c400c810 tx=0x7fb9c400ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:04.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:04.414+0000 7fb9c2ffd640 1 -- 172.21.15.53:0/205504371 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c400a640 con 0x7fb9cc15c4f0 2023-06-10T19:07:04.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:04.414+0000 7fb9c2ffd640 1 -- 172.21.15.53:0/205504371 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9c400a7c0 con 0x7fb9cc15c4f0 2023-06-10T19:07:04.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:04.414+0000 7fb9d4703640 1 -- 172.21.15.53:0/205504371 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9cc1628f0 con 0x7fb9cc15c4f0 2023-06-10T19:07:04.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:04.414+0000 7fb9c2ffd640 1 -- 172.21.15.53:0/205504371 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c400ab70 con 0x7fb9cc15c4f0 2023-06-10T19:07:04.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:04.414+0000 7fb9d4703640 1 -- 172.21.15.53:0/205504371 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9cc162050 con 0x7fb9cc15c4f0 2023-06-10T19:07:04.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:04.414+0000 7fb9d4703640 1 -- 172.21.15.53:0/205504371 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9cc0c2cc0 con 0x7fb9cc15c4f0 2023-06-10T19:07:04.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:04.418+0000 7fb9c2ffd640 1 -- 172.21.15.53:0/205504371 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb9c400acd0 con 0x7fb9cc15c4f0 2023-06-10T19:07:04.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:04.418+0000 7fb9c2ffd640 1 --2- 172.21.15.53:0/205504371 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb9b0066280 0x7fb9b0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:04.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:04.418+0000 7fb9c2ffd640 1 -- 172.21.15.53:0/205504371 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 6191+0+0 (secure 0 0 0) 0x7fb9c4083680 con 0x7fb9cc15c4f0 2023-06-10T19:07:04.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:04.418+0000 7fb9d249f640 1 --2- 172.21.15.53:0/205504371 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb9b0066280 0x7fb9b0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:04.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:04.418+0000 7fb9d249f640 1 --2- 172.21.15.53:0/205504371 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb9b0066280 0x7fb9b0068730 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fb9c80ad000 tx=0x7fb9c80a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:04.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:04.422+0000 7fb9c2ffd640 1 -- 172.21.15.53:0/205504371 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb9c4050a80 con 0x7fb9cc15c4f0 2023-06-10T19:07:04.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:04.602+0000 7fb9d4703640 1 -- 172.21.15.53:0/205504371 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb9cc04d790 con 0x7fb9cc15c4f0 2023-06-10T19:07:05.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:05.262+0000 7fb9c2ffd640 1 -- 172.21.15.53:0/205504371 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v91) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb9c40540a0 con 0x7fb9cc15c4f0 2023-06-10T19:07:05.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:05.266+0000 7fb9d4703640 1 -- 172.21.15.53:0/205504371 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb9b0066280 msgr2=0x7fb9b0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:05.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:05.266+0000 7fb9d4703640 1 --2- 172.21.15.53:0/205504371 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb9b0066280 0x7fb9b0068730 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fb9c80ad000 tx=0x7fb9c80a6000 comp rx=0 tx=0).stop 2023-06-10T19:07:05.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:05.266+0000 7fb9d4703640 1 -- 172.21.15.53:0/205504371 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9cc15c4f0 msgr2=0x7fb9cc0702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:05.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:05.266+0000 7fb9d4703640 1 --2- 172.21.15.53:0/205504371 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9cc15c4f0 0x7fb9cc0702f0 secure :-1 s=READY pgs=2333 cs=0 l=1 rev1=1 crypto rx=0x7fb9c400c810 tx=0x7fb9c400ccd0 comp rx=0 tx=0).stop 2023-06-10T19:07:05.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:05.266+0000 7fb9d4703640 1 -- 172.21.15.53:0/205504371 shutdown_connections 2023-06-10T19:07:05.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:05.266+0000 7fb9d4703640 1 --2- 172.21.15.53:0/205504371 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb9b0066280 0x7fb9b0068730 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:05.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:05.266+0000 7fb9d4703640 1 --2- 172.21.15.53:0/205504371 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9cc15c4f0 0x7fb9cc0702f0 unknown :-1 s=CLOSED pgs=2333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:05.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:05.266+0000 7fb9d4703640 1 --2- 172.21.15.53:0/205504371 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9cc15c070 0x7fb9cc1523b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:05.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:05.266+0000 7fb9d4703640 1 --2- 172.21.15.53:0/205504371 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb9cc156180 0x7fb9cc161620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:05.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:05.266+0000 7fb9d4703640 1 -- 172.21.15.53:0/205504371 >> 172.21.15.53:0/205504371 conn(0x7fb9cc06a0e0 msgr2=0x7fb9cc06c310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:05.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:05.266+0000 7fb9d4703640 1 -- 172.21.15.53:0/205504371 shutdown_connections 2023-06-10T19:07:05.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:05.266+0000 7fb9d4703640 1 -- 172.21.15.53:0/205504371 wait complete. 2023-06-10T19:07:05.291 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-06-10T19:07:05.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:05.470+0000 7f3d6db74640 1 Processor -- start 2023-06-10T19:07:05.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:05.470+0000 7f3d6db74640 1 -- start start 2023-06-10T19:07:05.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:05.470+0000 7f3d6db74640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3d68159940 0x7f3d680c9b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:05.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:05.470+0000 7f3d6db74640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d680ca050 0x7f3d680af830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:05.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:05.470+0000 7f3d6db74640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d680ca4a0 con 0x7f3d680afd70 2023-06-10T19:07:05.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:05.470+0000 7f3d6db74640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d68159d10 con 0x7f3d68159940 2023-06-10T19:07:05.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:05.470+0000 7f3d6db74640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6806b100 con 0x7f3d680ca050 2023-06-10T19:07:05.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:05.470+0000 7f3d677fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3d68159940 0x7f3d680c9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:05.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:05.470+0000 7f3d677fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3d68159940 0x7f3d680c9b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49804/0 (socket says 172.21.15.53:49804) 2023-06-10T19:07:05.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:05.470+0000 7f3d677fe640 1 -- 172.21.15.53:0/2595664241 learned_addr learned my addr 172.21.15.53:0/2595664241 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:05.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:05.470+0000 7f3d66ffd640 1 --2- 172.21.15.53:0/2595664241 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d680ca050 0x7f3d680af830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:05.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:05.470+0000 7f3d677fe640 1 -- 172.21.15.53:0/2595664241 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d680ca050 msgr2=0x7f3d680af830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:05.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:05.470+0000 7f3d677fe640 1 --2- 172.21.15.53:0/2595664241 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d680ca050 0x7f3d680af830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:05.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:05.470+0000 7f3d677fe640 1 -- 172.21.15.53:0/2595664241 >> v1:172.21.15.117:6789/0 conn(0x7f3d680afd70 legacy=0x7f3d6815d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:05.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:05.470+0000 7f3d677fe640 1 -- 172.21.15.53:0/2595664241 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d6806bc80 con 0x7f3d68159940 2023-06-10T19:07:05.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:05.474+0000 7f3d677fe640 1 --2- 172.21.15.53:0/2595664241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d68159940 0x7f3d680c9b10 secure :-1 s=READY pgs=2334 cs=0 l=1 rev1=1 crypto rx=0x7f3d58009870 tx=0x7f3d5801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6752345eeec70b4 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:05.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:05.474+0000 7f3d667fc640 1 -- 172.21.15.53:0/2595664241 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d580ab600 con 0x7f3d68159940 2023-06-10T19:07:05.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:05.474+0000 7f3d667fc640 1 -- 172.21.15.53:0/2595664241 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d580a7050 con 0x7f3d68159940 2023-06-10T19:07:05.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:05.474+0000 7f3d667fc640 1 -- 172.21.15.53:0/2595664241 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d580ab980 con 0x7f3d68159940 2023-06-10T19:07:05.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:05.474+0000 7f3d6db74640 1 -- 172.21.15.53:0/2595664241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d68159940 msgr2=0x7f3d680c9b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:05.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:05.474+0000 7f3d6db74640 1 --2- 172.21.15.53:0/2595664241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d68159940 0x7f3d680c9b10 secure :-1 s=READY pgs=2334 cs=0 l=1 rev1=1 crypto rx=0x7f3d58009870 tx=0x7f3d5801c470 comp rx=0 tx=0).stop 2023-06-10T19:07:05.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:05.474+0000 7f3d6db74640 1 -- 172.21.15.53:0/2595664241 shutdown_connections 2023-06-10T19:07:05.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:05.474+0000 7f3d6db74640 1 --2- 172.21.15.53:0/2595664241 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d680ca050 0x7f3d680af830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:05.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:05.474+0000 7f3d6db74640 1 --2- 172.21.15.53:0/2595664241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d68159940 0x7f3d680c9b10 unknown :-1 s=CLOSED pgs=2334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:05.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:05.474+0000 7f3d6db74640 1 -- 172.21.15.53:0/2595664241 >> 172.21.15.53:0/2595664241 conn(0x7f3d680ca830 msgr2=0x7f3d680cac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:05.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:05.474+0000 7f3d6db74640 1 -- 172.21.15.53:0/2595664241 shutdown_connections 2023-06-10T19:07:05.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:05.474+0000 7f3d6db74640 1 -- 172.21.15.53:0/2595664241 wait complete. 2023-06-10T19:07:05.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:05.478+0000 7f3d6db74640 1 Processor -- start 2023-06-10T19:07:05.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:05.478+0000 7f3d6db74640 1 -- start start 2023-06-10T19:07:05.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:05.478+0000 7f3d6db74640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d680afd70 0x7f3d680c5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:05.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:05.478+0000 7f3d6db74640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d680ca050 0x7f3d68140820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:05.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:05.478+0000 7f3d6db74640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d68159940 0x7f3d68158270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:05.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:05.478+0000 7f3d6db74640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d680c4280 con 0x7f3d680afd70 2023-06-10T19:07:05.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:05.478+0000 7f3d6db74640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d68140d60 con 0x7f3d680ca050 2023-06-10T19:07:05.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:05.478+0000 7f3d6db74640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d68152080 con 0x7f3d68159940 2023-06-10T19:07:05.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:05.478+0000 7f3d677fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d680afd70 0x7f3d680c5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:05.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:05.478+0000 7f3d677fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d680afd70 0x7f3d680c5010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49810/0 (socket says 172.21.15.53:49810) 2023-06-10T19:07:05.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:05.478+0000 7f3d677fe640 1 -- 172.21.15.53:0/3858709307 learned_addr learned my addr 172.21.15.53:0/3858709307 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:05.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:05.478+0000 7f3d66ffd640 1 --2- 172.21.15.53:0/3858709307 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d680ca050 0x7f3d68140820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:05.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:05.478+0000 7f3d67fff640 1 --2- 172.21.15.53:0/3858709307 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d68159940 0x7f3d68158270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:05.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:05.478+0000 7f3d677fe640 1 -- 172.21.15.53:0/3858709307 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d68159940 msgr2=0x7f3d68158270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:05.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:05.478+0000 7f3d677fe640 1 --2- 172.21.15.53:0/3858709307 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d68159940 0x7f3d68158270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:05.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:05.478+0000 7f3d677fe640 1 -- 172.21.15.53:0/3858709307 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d680ca050 msgr2=0x7f3d68140820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:05.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:05.478+0000 7f3d677fe640 1 --2- 172.21.15.53:0/3858709307 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d680ca050 0x7f3d68140820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:05.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:05.478+0000 7f3d677fe640 1 -- 172.21.15.53:0/3858709307 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d580094d0 con 0x7f3d680afd70 2023-06-10T19:07:05.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:05.478+0000 7f3d677fe640 1 --2- 172.21.15.53:0/3858709307 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d680afd70 0x7f3d680c5010 secure :-1 s=READY pgs=2335 cs=0 l=1 rev1=1 crypto rx=0x7f3d580ae040 tx=0x7f3d58019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:05.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:05.478+0000 7f3d4ffff640 1 -- 172.21.15.53:0/3858709307 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d580b4640 con 0x7f3d680afd70 2023-06-10T19:07:05.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:05.478+0000 7f3d4ffff640 1 -- 172.21.15.53:0/3858709307 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d580b47a0 con 0x7f3d680afd70 2023-06-10T19:07:05.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:05.478+0000 7f3d6db74640 1 -- 172.21.15.53:0/3858709307 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d68152360 con 0x7f3d680afd70 2023-06-10T19:07:05.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:05.478+0000 7f3d4ffff640 1 -- 172.21.15.53:0/3858709307 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d580b4b30 con 0x7f3d680afd70 2023-06-10T19:07:05.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:05.478+0000 7f3d6db74640 1 -- 172.21.15.53:0/3858709307 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d68152920 con 0x7f3d680afd70 2023-06-10T19:07:05.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:05.478+0000 7f3d6db74640 1 -- 172.21.15.53:0/3858709307 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d6804d790 con 0x7f3d680afd70 2023-06-10T19:07:05.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:05.482+0000 7f3d4ffff640 1 -- 172.21.15.53:0/3858709307 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3d580b2070 con 0x7f3d680afd70 2023-06-10T19:07:05.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:05.482+0000 7f3d4ffff640 1 --2- 172.21.15.53:0/3858709307 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3d54066280 0x7f3d54068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:05.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:05.482+0000 7f3d4ffff640 1 -- 172.21.15.53:0/3858709307 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 6191+0+0 (secure 0 0 0) 0x7f3d5811dbd0 con 0x7f3d680afd70 2023-06-10T19:07:05.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:05.482+0000 7f3d66ffd640 1 --2- 172.21.15.53:0/3858709307 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3d54066280 0x7f3d54068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:05.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:05.482+0000 7f3d66ffd640 1 --2- 172.21.15.53:0/3858709307 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3d54066280 0x7f3d54068730 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c003fd0 tx=0x7f3d5c0039c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:05.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:05.486+0000 7f3d4ffff640 1 -- 172.21.15.53:0/3858709307 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3d580eaf30 con 0x7f3d680afd70 2023-06-10T19:07:05.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:05.634+0000 7f3d6db74640 1 -- 172.21.15.53:0/3858709307 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3d680ca4a0 con 0x7f3d680afd70 2023-06-10T19:07:06.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:06.274+0000 7f3d4ffff640 1 -- 172.21.15.53:0/3858709307 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v157) v1 ==== 181+0+0 (secure 0 0 0) 0x7f3d680ca4a0 con 0x7f3d680afd70 2023-06-10T19:07:06.277 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_metadata' removed 2023-06-10T19:07:06.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:06.278+0000 7f3d6db74640 1 -- 172.21.15.53:0/3858709307 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3d54066280 msgr2=0x7f3d54068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:06.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:06.278+0000 7f3d6db74640 1 --2- 172.21.15.53:0/3858709307 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3d54066280 0x7f3d54068730 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c003fd0 tx=0x7f3d5c0039c0 comp rx=0 tx=0).stop 2023-06-10T19:07:06.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:06.278+0000 7f3d6db74640 1 -- 172.21.15.53:0/3858709307 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d680afd70 msgr2=0x7f3d680c5010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:06.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:06.278+0000 7f3d6db74640 1 --2- 172.21.15.53:0/3858709307 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d680afd70 0x7f3d680c5010 secure :-1 s=READY pgs=2335 cs=0 l=1 rev1=1 crypto rx=0x7f3d580ae040 tx=0x7f3d58019210 comp rx=0 tx=0).stop 2023-06-10T19:07:06.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:06.278+0000 7f3d6db74640 1 -- 172.21.15.53:0/3858709307 shutdown_connections 2023-06-10T19:07:06.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:06.278+0000 7f3d6db74640 1 --2- 172.21.15.53:0/3858709307 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3d54066280 0x7f3d54068730 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:06.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:06.278+0000 7f3d6db74640 1 --2- 172.21.15.53:0/3858709307 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3d68159940 0x7f3d68158270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:06.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:06.278+0000 7f3d6db74640 1 --2- 172.21.15.53:0/3858709307 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d680ca050 0x7f3d68140820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:06.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:06.278+0000 7f3d6db74640 1 --2- 172.21.15.53:0/3858709307 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d680afd70 0x7f3d680c5010 secure :-1 s=CLOSED pgs=2335 cs=0 l=1 rev1=1 crypto rx=0x7f3d580ae040 tx=0x7f3d58019210 comp rx=0 tx=0).stop 2023-06-10T19:07:06.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:06.278+0000 7f3d6db74640 1 -- 172.21.15.53:0/3858709307 >> 172.21.15.53:0/3858709307 conn(0x7f3d680ca830 msgr2=0x7f3d680b0be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:06.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:06.278+0000 7f3d6db74640 1 -- 172.21.15.53:0/3858709307 shutdown_connections 2023-06-10T19:07:06.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:06.278+0000 7f3d6db74640 1 -- 172.21.15.53:0/3858709307 wait complete. 2023-06-10T19:07:06.305 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-06-10T19:07:06.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:06.438+0000 7fdca0b9e640 1 Processor -- start 2023-06-10T19:07:06.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:06.438+0000 7fdca0b9e640 1 -- start start 2023-06-10T19:07:06.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:06.438+0000 7fdca0b9e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc9c15ba00 0x7fdc9c0cf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:06.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:06.438+0000 7fdca0b9e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fdc9c15f370 0x7fdc9c15f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:06.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:06.438+0000 7fdca0b9e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc9c15fd50 con 0x7fdc9c06b840 2023-06-10T19:07:06.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:06.438+0000 7fdca0b9e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc9c0ceb40 con 0x7fdc9c15f370 2023-06-10T19:07:06.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:06.438+0000 7fdca0b9e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc9c15c1c0 con 0x7fdc9c15ba00 2023-06-10T19:07:06.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:06.438+0000 7fdc9ad9d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fdc9c15f370 0x7fdc9c15f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:06.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:06.438+0000 7fdc99d9b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc9c15ba00 0x7fdc9c0cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:06.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:06.438+0000 7fdc9ad9d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fdc9c15f370 0x7fdc9c15f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.53:48148/0 (socket says 172.21.15.53:48148) 2023-06-10T19:07:06.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:06.438+0000 7fdc9ad9d640 1 -- 172.21.15.53:0/388171363 learned_addr learned my addr 172.21.15.53:0/388171363 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:06.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:06.438+0000 7fdc99d9b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc9c15ba00 0x7fdc9c0cf810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.53:50680/0 (socket says 172.21.15.53:50680) 2023-06-10T19:07:06.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:06.442+0000 7fdc9ad9d640 1 -- 172.21.15.53:0/388171363 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc9c15ba00 msgr2=0x7fdc9c0cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:06.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:06.442+0000 7fdc9ad9d640 1 --2- 172.21.15.53:0/388171363 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc9c15ba00 0x7fdc9c0cf810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:06.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:06.442+0000 7fdc9ad9d640 1 -- 172.21.15.53:0/388171363 >> v1:172.21.15.117:6789/0 conn(0x7fdc9c06b840 legacy=0x7fdc9c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:06.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:06.442+0000 7fdc9ad9d640 1 -- 172.21.15.53:0/388171363 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc9c0cf380 con 0x7fdc9c15f370 2023-06-10T19:07:06.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:06.442+0000 7fdc9ad9d640 1 --2- 172.21.15.53:0/388171363 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdc9c15f370 0x7fdc9c15f810 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fdc94009e50 tx=0x7fdc9401ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee27cfce36dc41f8 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:06.445 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:06.442+0000 7fdc9959a640 1 -- 172.21.15.53:0/388171363 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc940a57f0 con 0x7fdc9c15f370 2023-06-10T19:07:06.445 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:06.442+0000 7fdc9959a640 1 -- 172.21.15.53:0/388171363 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc940a5950 con 0x7fdc9c15f370 2023-06-10T19:07:06.445 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:06.442+0000 7fdc9959a640 1 -- 172.21.15.53:0/388171363 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc940a5ce0 con 0x7fdc9c15f370 2023-06-10T19:07:06.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:06.442+0000 7fdca0b9e640 1 -- 172.21.15.53:0/388171363 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdc9c15f370 msgr2=0x7fdc9c15f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:06.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:06.442+0000 7fdca0b9e640 1 --2- 172.21.15.53:0/388171363 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdc9c15f370 0x7fdc9c15f810 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fdc94009e50 tx=0x7fdc9401ca10 comp rx=0 tx=0).stop 2023-06-10T19:07:06.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:06.442+0000 7fdca0b9e640 1 -- 172.21.15.53:0/388171363 shutdown_connections 2023-06-10T19:07:06.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:06.442+0000 7fdca0b9e640 1 --2- 172.21.15.53:0/388171363 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdc9c15f370 0x7fdc9c15f810 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:06.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:06.442+0000 7fdca0b9e640 1 --2- 172.21.15.53:0/388171363 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc9c15ba00 0x7fdc9c0cf810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:06.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:06.442+0000 7fdca0b9e640 1 -- 172.21.15.53:0/388171363 >> 172.21.15.53:0/388171363 conn(0x7fdc9c06a0b0 msgr2=0x7fdc9c06d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:06.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:06.442+0000 7fdca0b9e640 1 -- 172.21.15.53:0/388171363 shutdown_connections 2023-06-10T19:07:06.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:06.442+0000 7fdca0b9e640 1 -- 172.21.15.53:0/388171363 wait complete. 2023-06-10T19:07:06.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:06.446+0000 7fdca0b9e640 1 Processor -- start 2023-06-10T19:07:06.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:06.446+0000 7fdca0b9e640 1 -- start start 2023-06-10T19:07:06.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:06.446+0000 7fdca0b9e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc9c06b840 0x7fdc9c14cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:06.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:06.446+0000 7fdca0b9e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc9c15ba00 0x7fdc9c0c62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:06.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:06.446+0000 7fdca0b9e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdc9c15f370 0x7fdc9c144970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:06.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:06.446+0000 7fdca0b9e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc9c0c67f0 con 0x7fdc9c15ba00 2023-06-10T19:07:06.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:06.446+0000 7fdca0b9e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc9c14d3c0 con 0x7fdc9c15f370 2023-06-10T19:07:06.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:06.446+0000 7fdca0b9e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc9c14d6a0 con 0x7fdc9c06b840 2023-06-10T19:07:06.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:06.446+0000 7fdc99d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc9c15ba00 0x7fdc9c0c62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:06.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:06.446+0000 7fdc99d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc9c15ba00 0x7fdc9c0c62b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49824/0 (socket says 172.21.15.53:49824) 2023-06-10T19:07:06.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:06.446+0000 7fdc99d9b640 1 -- 172.21.15.53:0/2208630215 learned_addr learned my addr 172.21.15.53:0/2208630215 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:06.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:06.446+0000 7fdc9a59c640 1 --2- 172.21.15.53:0/2208630215 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc9c06b840 0x7fdc9c14cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:06.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:06.446+0000 7fdc9ad9d640 1 --2- 172.21.15.53:0/2208630215 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdc9c15f370 0x7fdc9c144970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:06.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:06.446+0000 7fdc99d9b640 1 -- 172.21.15.53:0/2208630215 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc9c06b840 msgr2=0x7fdc9c14cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:06.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:06.446+0000 7fdc99d9b640 1 --2- 172.21.15.53:0/2208630215 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc9c06b840 0x7fdc9c14cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:06.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:06.446+0000 7fdc99d9b640 1 -- 172.21.15.53:0/2208630215 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdc9c15f370 msgr2=0x7fdc9c144970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:06.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:06.446+0000 7fdc99d9b640 1 --2- 172.21.15.53:0/2208630215 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdc9c15f370 0x7fdc9c144970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:06.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:06.446+0000 7fdc99d9b640 1 -- 172.21.15.53:0/2208630215 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc94009b30 con 0x7fdc9c15ba00 2023-06-10T19:07:06.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:06.446+0000 7fdc99d9b640 1 --2- 172.21.15.53:0/2208630215 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc9c15ba00 0x7fdc9c0c62b0 secure :-1 s=READY pgs=2336 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c00e930 tx=0x7fdc8c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:06.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:06.446+0000 7fdc92ffd640 1 -- 172.21.15.53:0/2208630215 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8c009690 con 0x7fdc9c15ba00 2023-06-10T19:07:06.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:06.446+0000 7fdc92ffd640 1 -- 172.21.15.53:0/2208630215 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc8c00ca00 con 0x7fdc9c15ba00 2023-06-10T19:07:06.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:06.446+0000 7fdc92ffd640 1 -- 172.21.15.53:0/2208630215 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8c00cd70 con 0x7fdc9c15ba00 2023-06-10T19:07:06.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:06.450+0000 7fdca0b9e640 1 -- 172.21.15.53:0/2208630215 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc9c0c4770 con 0x7fdc9c15ba00 2023-06-10T19:07:06.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:06.450+0000 7fdca0b9e640 1 -- 172.21.15.53:0/2208630215 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc9c144eb0 con 0x7fdc9c15ba00 2023-06-10T19:07:06.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:06.450+0000 7fdc92ffd640 1 -- 172.21.15.53:0/2208630215 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdc8c013470 con 0x7fdc9c15ba00 2023-06-10T19:07:06.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:06.450+0000 7fdc92ffd640 1 --2- 172.21.15.53:0/2208630215 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdc7c066380 0x7fdc7c068830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:06.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:06.450+0000 7fdc92ffd640 1 -- 172.21.15.53:0/2208630215 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 5753+0+0 (secure 0 0 0) 0x7fdc8c083d40 con 0x7fdc9c15ba00 2023-06-10T19:07:06.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:06.454+0000 7fdc9a59c640 1 --2- 172.21.15.53:0/2208630215 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdc7c066380 0x7fdc7c068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:06.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:06.454+0000 7fdc90ff9640 1 -- 172.21.15.53:0/2208630215 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc9c04d790 con 0x7fdc9c15ba00 2023-06-10T19:07:06.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:06.454+0000 7fdc9a59c640 1 --2- 172.21.15.53:0/2208630215 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdc7c066380 0x7fdc7c068830 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fdc84007fd0 tx=0x7fdc84009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:06.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:06.462+0000 7fdc92ffd640 1 -- 172.21.15.53:0/2208630215 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdc8c0514d0 con 0x7fdc9c15ba00 2023-06-10T19:07:06.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:06.618+0000 7fdc90ff9640 1 -- 172.21.15.53:0/2208630215 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fdc9c0cefe0 con 0x7fdc9c15ba00 2023-06-10T19:07:07.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.286+0000 7fdc92ffd640 1 -- 172.21.15.53:0/2208630215 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v158) v1 ==== 169+0+0 (secure 0 0 0) 0x7fdc8c021070 con 0x7fdc9c15ba00 2023-06-10T19:07:07.288 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_data' removed 2023-06-10T19:07:07.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.290+0000 7fdc90ff9640 1 -- 172.21.15.53:0/2208630215 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdc7c066380 msgr2=0x7fdc7c068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:07.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.290+0000 7fdc90ff9640 1 --2- 172.21.15.53:0/2208630215 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdc7c066380 0x7fdc7c068830 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fdc84007fd0 tx=0x7fdc84009040 comp rx=0 tx=0).stop 2023-06-10T19:07:07.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.290+0000 7fdc90ff9640 1 -- 172.21.15.53:0/2208630215 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc9c15ba00 msgr2=0x7fdc9c0c62b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:07.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.290+0000 7fdc90ff9640 1 --2- 172.21.15.53:0/2208630215 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc9c15ba00 0x7fdc9c0c62b0 secure :-1 s=READY pgs=2336 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c00e930 tx=0x7fdc8c00edf0 comp rx=0 tx=0).stop 2023-06-10T19:07:07.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.290+0000 7fdc90ff9640 1 -- 172.21.15.53:0/2208630215 shutdown_connections 2023-06-10T19:07:07.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.290+0000 7fdc90ff9640 1 --2- 172.21.15.53:0/2208630215 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdc7c066380 0x7fdc7c068830 secure :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fdc84007fd0 tx=0x7fdc84009040 comp rx=0 tx=0).stop 2023-06-10T19:07:07.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.290+0000 7fdc90ff9640 1 --2- 172.21.15.53:0/2208630215 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdc9c15f370 0x7fdc9c144970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:07.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.290+0000 7fdc90ff9640 1 --2- 172.21.15.53:0/2208630215 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc9c15ba00 0x7fdc9c0c62b0 secure :-1 s=CLOSED pgs=2336 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c00e930 tx=0x7fdc8c00edf0 comp rx=0 tx=0).stop 2023-06-10T19:07:07.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.290+0000 7fdc90ff9640 1 --2- 172.21.15.53:0/2208630215 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdc9c06b840 0x7fdc9c14cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:07.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.290+0000 7fdc90ff9640 1 -- 172.21.15.53:0/2208630215 >> 172.21.15.53:0/2208630215 conn(0x7fdc9c06a0b0 msgr2=0x7fdc9c150aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:07.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.294+0000 7fdc90ff9640 1 -- 172.21.15.53:0/2208630215 shutdown_connections 2023-06-10T19:07:07.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.294+0000 7fdc90ff9640 1 -- 172.21.15.53:0/2208630215 wait complete. 2023-06-10T19:07:07.325 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-06-10T19:07:07.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.450+0000 7fcd8d94c640 1 Processor -- start 2023-06-10T19:07:07.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.450+0000 7fcd8d94c640 1 -- start start 2023-06-10T19:07:07.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.450+0000 7fcd8d94c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fcd88156180 0x7fcd880cd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:07.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.450+0000 7fcd8d94c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fcd8815c070 0x7fcd8815c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:07.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.450+0000 7fcd8d94c640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd8806b090 con 0x7fcd88158a80 2023-06-10T19:07:07.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.450+0000 7fcd8d94c640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd8815ca30 con 0x7fcd88156180 2023-06-10T19:07:07.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.450+0000 7fcd8d94c640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd8806efa0 con 0x7fcd8815c070 2023-06-10T19:07:07.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.450+0000 7fcd86ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fcd88156180 0x7fcd880cd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:07.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.450+0000 7fcd877fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fcd88158a80 0x7fcd88158e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41888/0 (socket says 172.21.15.53:41888) 2023-06-10T19:07:07.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.450+0000 7fcd877fe640 1 -- 172.21.15.53:0/1655771165 learned_addr learned my addr 172.21.15.53:0/1655771165 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:07:07.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.454+0000 7fcd867fc640 1 --2- 172.21.15.53:0/1655771165 >> v2:172.21.15.117:3300/0 conn(0x7fcd8815c070 0x7fcd8815c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:07.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.454+0000 7fcd86ffd640 1 -- 172.21.15.53:0/1655771165 >> v2:172.21.15.117:3300/0 conn(0x7fcd8815c070 msgr2=0x7fcd8815c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:07.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.454+0000 7fcd86ffd640 1 --2- 172.21.15.53:0/1655771165 >> v2:172.21.15.117:3300/0 conn(0x7fcd8815c070 0x7fcd8815c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:07.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.454+0000 7fcd86ffd640 1 -- 172.21.15.53:0/1655771165 >> v1:172.21.15.53:6789/0 conn(0x7fcd88158a80 legacy=0x7fcd88158e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:07.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.454+0000 7fcd86ffd640 1 -- 172.21.15.53:0/1655771165 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd880cc720 con 0x7fcd88156180 2023-06-10T19:07:07.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.454+0000 7fcd85ffb640 1 -- 172.21.15.53:0/1655771165 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2899364952 0 0) 0x7fcd8806b090 con 0x7fcd88158a80 2023-06-10T19:07:07.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.454+0000 7fcd86ffd640 1 --2- 172.21.15.53:0/1655771165 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd88156180 0x7fcd880cd4a0 secure :-1 s=READY pgs=2338 cs=0 l=1 rev1=1 crypto rx=0x7fcd880cbae0 tx=0x7fcd7801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=646feef34fa31a82 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:07.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.454+0000 7fcd85ffb640 1 -- 172.21.15.53:0/1655771165 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd780ab600 con 0x7fcd88156180 2023-06-10T19:07:07.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.454+0000 7fcd85ffb640 1 -- 172.21.15.53:0/1655771165 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd780a7050 con 0x7fcd88156180 2023-06-10T19:07:07.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.454+0000 7fcd85ffb640 1 -- 172.21.15.53:0/1655771165 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd780ab980 con 0x7fcd88156180 2023-06-10T19:07:07.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.454+0000 7fcd8d94c640 1 -- 172.21.15.53:0/1655771165 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd88156180 msgr2=0x7fcd880cd4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:07.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.454+0000 7fcd8d94c640 1 --2- 172.21.15.53:0/1655771165 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd88156180 0x7fcd880cd4a0 secure :-1 s=READY pgs=2338 cs=0 l=1 rev1=1 crypto rx=0x7fcd880cbae0 tx=0x7fcd7801c460 comp rx=0 tx=0).stop 2023-06-10T19:07:07.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.454+0000 7fcd8d94c640 1 -- 172.21.15.53:0/1655771165 shutdown_connections 2023-06-10T19:07:07.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.454+0000 7fcd8d94c640 1 --2- 172.21.15.53:0/1655771165 >> v2:172.21.15.117:3300/0 conn(0x7fcd8815c070 0x7fcd8815c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:07.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.454+0000 7fcd8d94c640 1 --2- 172.21.15.53:0/1655771165 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd88156180 0x7fcd880cd4a0 unknown :-1 s=CLOSED pgs=2338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:07.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.454+0000 7fcd8d94c640 1 -- 172.21.15.53:0/1655771165 >> 172.21.15.53:0/1655771165 conn(0x7fcd8806a0e0 msgr2=0x7fcd880cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:07.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.454+0000 7fcd8d94c640 1 -- 172.21.15.53:0/1655771165 shutdown_connections 2023-06-10T19:07:07.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.454+0000 7fcd8d94c640 1 -- 172.21.15.53:0/1655771165 wait complete. 2023-06-10T19:07:07.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.458+0000 7fcd8d94c640 1 Processor -- start 2023-06-10T19:07:07.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.458+0000 7fcd8d94c640 1 -- start start 2023-06-10T19:07:07.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.458+0000 7fcd8d94c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd88156180 0x7fcd8814dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:07.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.458+0000 7fcd8d94c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd88158a80 0x7fcd881509a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:07.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.458+0000 7fcd8d94c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd8815c070 0x7fcd8814fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:07.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.458+0000 7fcd8d94c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd88151740 con 0x7fcd88158a80 2023-06-10T19:07:07.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.458+0000 7fcd8d94c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd88150ee0 con 0x7fcd88156180 2023-06-10T19:07:07.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.458+0000 7fcd8d94c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd88151180 con 0x7fcd8815c070 2023-06-10T19:07:07.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.458+0000 7fcd867fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd88158a80 0x7fcd881509a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:07.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.458+0000 7fcd867fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd88158a80 0x7fcd881509a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49834/0 (socket says 172.21.15.53:49834) 2023-06-10T19:07:07.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.458+0000 7fcd867fc640 1 -- 172.21.15.53:0/166298108 learned_addr learned my addr 172.21.15.53:0/166298108 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:07.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.458+0000 7fcd877fe640 1 --2- 172.21.15.53:0/166298108 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd8815c070 0x7fcd8814fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:07.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.458+0000 7fcd86ffd640 1 --2- 172.21.15.53:0/166298108 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd88156180 0x7fcd8814dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:07.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.458+0000 7fcd867fc640 1 -- 172.21.15.53:0/166298108 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd8815c070 msgr2=0x7fcd8814fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:07.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.458+0000 7fcd867fc640 1 --2- 172.21.15.53:0/166298108 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd8815c070 0x7fcd8814fe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:07.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.458+0000 7fcd867fc640 1 -- 172.21.15.53:0/166298108 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd88156180 msgr2=0x7fcd8814dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:07.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.458+0000 7fcd867fc640 1 --2- 172.21.15.53:0/166298108 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd88156180 0x7fcd8814dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:07.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.458+0000 7fcd867fc640 1 -- 172.21.15.53:0/166298108 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd78009420 con 0x7fcd88158a80 2023-06-10T19:07:07.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.458+0000 7fcd86ffd640 1 --2- 172.21.15.53:0/166298108 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd88156180 0x7fcd8814dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:07:07.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.458+0000 7fcd867fc640 1 --2- 172.21.15.53:0/166298108 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd88158a80 0x7fcd881509a0 secure :-1 s=READY pgs=2339 cs=0 l=1 rev1=1 crypto rx=0x7fcd7000ccd0 tx=0x7fcd7000a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:07.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.458+0000 7fcd7ffff640 1 -- 172.21.15.53:0/166298108 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd700039a0 con 0x7fcd88158a80 2023-06-10T19:07:07.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.458+0000 7fcd7ffff640 1 -- 172.21.15.53:0/166298108 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd70003b00 con 0x7fcd88158a80 2023-06-10T19:07:07.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.458+0000 7fcd8d94c640 1 -- 172.21.15.53:0/166298108 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd88151460 con 0x7fcd88158a80 2023-06-10T19:07:07.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.458+0000 7fcd7ffff640 1 -- 172.21.15.53:0/166298108 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd70004020 con 0x7fcd88158a80 2023-06-10T19:07:07.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.458+0000 7fcd8d94c640 1 -- 172.21.15.53:0/166298108 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd8814f970 con 0x7fcd88158a80 2023-06-10T19:07:07.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.458+0000 7fcd8d94c640 1 -- 172.21.15.53:0/166298108 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd8814fb60 con 0x7fcd88158a80 2023-06-10T19:07:07.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.458+0000 7fcd7ffff640 1 -- 172.21.15.53:0/166298108 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcd70004180 con 0x7fcd88158a80 2023-06-10T19:07:07.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.462+0000 7fcd7ffff640 1 --2- 172.21.15.53:0/166298108 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcd680662b0 0x7fcd68068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:07.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.462+0000 7fcd7ffff640 1 -- 172.21.15.53:0/166298108 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fcd70083df0 con 0x7fcd88158a80 2023-06-10T19:07:07.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.462+0000 7fcd86ffd640 1 --2- 172.21.15.53:0/166298108 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcd680662b0 0x7fcd68068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:07.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.462+0000 7fcd86ffd640 1 --2- 172.21.15.53:0/166298108 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcd680662b0 0x7fcd68068760 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fcd780ad000 tx=0x7fcd78008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:07.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.466+0000 7fcd7ffff640 1 -- 172.21.15.53:0/166298108 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcd70051540 con 0x7fcd88158a80 2023-06-10T19:07:07.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.618+0000 7fcd8d94c640 1 -- 172.21.15.53:0/166298108 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fcd8804d790 con 0x7fcd88158a80 2023-06-10T19:07:07.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.626+0000 7fcd7ffff640 1 -- 172.21.15.53:0/166298108 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v27) v1 ==== 104+0+0 (secure 0 0 0) 0x7fcd7001d0a0 con 0x7fcd88158a80 2023-06-10T19:07:07.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.626+0000 7fcd8d94c640 1 -- 172.21.15.53:0/166298108 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcd680662b0 msgr2=0x7fcd68068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:07.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.626+0000 7fcd8d94c640 1 --2- 172.21.15.53:0/166298108 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcd680662b0 0x7fcd68068760 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fcd780ad000 tx=0x7fcd78008040 comp rx=0 tx=0).stop 2023-06-10T19:07:07.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.626+0000 7fcd8d94c640 1 -- 172.21.15.53:0/166298108 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd88158a80 msgr2=0x7fcd881509a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:07.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.626+0000 7fcd8d94c640 1 --2- 172.21.15.53:0/166298108 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd88158a80 0x7fcd881509a0 secure :-1 s=READY pgs=2339 cs=0 l=1 rev1=1 crypto rx=0x7fcd7000ccd0 tx=0x7fcd7000a5c0 comp rx=0 tx=0).stop 2023-06-10T19:07:07.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.626+0000 7fcd8d94c640 1 -- 172.21.15.53:0/166298108 shutdown_connections 2023-06-10T19:07:07.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.626+0000 7fcd8d94c640 1 --2- 172.21.15.53:0/166298108 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcd680662b0 0x7fcd68068760 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:07.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.626+0000 7fcd8d94c640 1 --2- 172.21.15.53:0/166298108 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcd8815c070 0x7fcd8814fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:07.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.626+0000 7fcd8d94c640 1 --2- 172.21.15.53:0/166298108 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd88158a80 0x7fcd881509a0 unknown :-1 s=CLOSED pgs=2339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:07.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.626+0000 7fcd8d94c640 1 --2- 172.21.15.53:0/166298108 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd88156180 0x7fcd8814dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:07.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.626+0000 7fcd8d94c640 1 -- 172.21.15.53:0/166298108 >> 172.21.15.53:0/166298108 conn(0x7fcd8806a0e0 msgr2=0x7fcd88070b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:07.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.626+0000 7fcd8d94c640 1 -- 172.21.15.53:0/166298108 shutdown_connections 2023-06-10T19:07:07.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.626+0000 7fcd8d94c640 1 -- 172.21.15.53:0/166298108 wait complete. 2023-06-10T19:07:07.648 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_filelock_eviction' 2023-06-10T19:07:07.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.774+0000 7fea1f350640 1 Processor -- start 2023-06-10T19:07:07.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.774+0000 7fea1f350640 1 -- start start 2023-06-10T19:07:07.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.774+0000 7fea1f350640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fea180cc690 0x7fea180d04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:07.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.774+0000 7fea1f350640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fea180ccae0 0x7fea180d09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:07.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.774+0000 7fea1f350640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea180d0020 con 0x7fea180b3ac0 2023-06-10T19:07:07.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.774+0000 7fea1f350640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea180cef40 con 0x7fea180ccae0 2023-06-10T19:07:07.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.774+0000 7fea1f350640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea180cf220 con 0x7fea180cc690 2023-06-10T19:07:07.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.774+0000 7fea1d0ec640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fea180b3ac0 0x7fea180b3e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41900/0 (socket says 172.21.15.53:41900) 2023-06-10T19:07:07.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.774+0000 7fea1d0ec640 1 -- 172.21.15.53:0/2049944920 learned_addr learned my addr 172.21.15.53:0/2049944920 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:07:07.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.774+0000 7fea1d8ed640 1 --2- 172.21.15.53:0/2049944920 >> v2:172.21.15.53:3300/0 conn(0x7fea180ccae0 0x7fea180d09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:07.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.774+0000 7fea1c8eb640 1 --2- 172.21.15.53:0/2049944920 >> v2:172.21.15.117:3300/0 conn(0x7fea180cc690 0x7fea180d04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:07.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.774+0000 7fea1d8ed640 1 -- 172.21.15.53:0/2049944920 >> v2:172.21.15.117:3300/0 conn(0x7fea180cc690 msgr2=0x7fea180d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:07.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.774+0000 7fea1d8ed640 1 --2- 172.21.15.53:0/2049944920 >> v2:172.21.15.117:3300/0 conn(0x7fea180cc690 0x7fea180d04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:07.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.774+0000 7fea1d8ed640 1 -- 172.21.15.53:0/2049944920 >> v1:172.21.15.53:6789/0 conn(0x7fea180b3ac0 legacy=0x7fea180b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:07.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.774+0000 7fea0ffff640 1 -- 172.21.15.53:0/2049944920 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2626913204 0 0) 0x7fea180d0020 con 0x7fea180b3ac0 2023-06-10T19:07:07.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.774+0000 7fea1d8ed640 1 -- 172.21.15.53:0/2049944920 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea180cf500 con 0x7fea180ccae0 2023-06-10T19:07:07.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.778+0000 7fea1d8ed640 1 --2- 172.21.15.53:0/2049944920 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea180ccae0 0x7fea180d09f0 secure :-1 s=READY pgs=2341 cs=0 l=1 rev1=1 crypto rx=0x7fea1808aa80 tx=0x7fea1001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a2e1ac86909166f server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:07.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.778+0000 7fea0ffff640 1 -- 172.21.15.53:0/2049944920 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea100a59c0 con 0x7fea180ccae0 2023-06-10T19:07:07.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.778+0000 7fea0ffff640 1 -- 172.21.15.53:0/2049944920 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea100a5b20 con 0x7fea180ccae0 2023-06-10T19:07:07.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.778+0000 7fea0ffff640 1 -- 172.21.15.53:0/2049944920 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea100ad440 con 0x7fea180ccae0 2023-06-10T19:07:07.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.778+0000 7fea1f350640 1 -- 172.21.15.53:0/2049944920 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea180ccae0 msgr2=0x7fea180d09f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:07.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.778+0000 7fea1f350640 1 --2- 172.21.15.53:0/2049944920 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea180ccae0 0x7fea180d09f0 secure :-1 s=READY pgs=2341 cs=0 l=1 rev1=1 crypto rx=0x7fea1808aa80 tx=0x7fea1001c8e0 comp rx=0 tx=0).stop 2023-06-10T19:07:07.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.778+0000 7fea1f350640 1 -- 172.21.15.53:0/2049944920 shutdown_connections 2023-06-10T19:07:07.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.778+0000 7fea1f350640 1 --2- 172.21.15.53:0/2049944920 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea180ccae0 0x7fea180d09f0 unknown :-1 s=CLOSED pgs=2341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:07.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.778+0000 7fea1f350640 1 --2- 172.21.15.53:0/2049944920 >> v2:172.21.15.117:3300/0 conn(0x7fea180cc690 0x7fea180d04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:07.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.778+0000 7fea1f350640 1 -- 172.21.15.53:0/2049944920 >> 172.21.15.53:0/2049944920 conn(0x7fea18071790 msgr2=0x7fea18069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:07.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.778+0000 7fea1f350640 1 -- 172.21.15.53:0/2049944920 shutdown_connections 2023-06-10T19:07:07.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.778+0000 7fea1f350640 1 -- 172.21.15.53:0/2049944920 wait complete. 2023-06-10T19:07:07.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.778+0000 7fea1f350640 1 Processor -- start 2023-06-10T19:07:07.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.778+0000 7fea1f350640 1 -- start start 2023-06-10T19:07:07.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.778+0000 7fea1f350640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea180b3ac0 0x7fea1815e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:07.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.778+0000 7fea1f350640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea180cc690 0x7fea18156ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:07.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.778+0000 7fea1f350640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea180ccae0 0x7fea180c6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:07.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.778+0000 7fea1f350640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea180c5f90 con 0x7fea180cc690 2023-06-10T19:07:07.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.778+0000 7fea1f350640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea1815ec60 con 0x7fea180ccae0 2023-06-10T19:07:07.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.778+0000 7fea1f350640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea18156ff0 con 0x7fea180b3ac0 2023-06-10T19:07:07.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.778+0000 7fea1c8eb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea180cc690 0x7fea18156ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:07.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.778+0000 7fea1c8eb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea180cc690 0x7fea18156ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49856/0 (socket says 172.21.15.53:49856) 2023-06-10T19:07:07.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.778+0000 7fea1c8eb640 1 -- 172.21.15.53:0/3203735615 learned_addr learned my addr 172.21.15.53:0/3203735615 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:07.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.778+0000 7fea1d0ec640 1 --2- 172.21.15.53:0/3203735615 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea180b3ac0 0x7fea1815e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:07.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.778+0000 7fea1d8ed640 1 --2- 172.21.15.53:0/3203735615 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea180ccae0 0x7fea180c6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:07.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.778+0000 7fea1c8eb640 1 -- 172.21.15.53:0/3203735615 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea180b3ac0 msgr2=0x7fea1815e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:07.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.778+0000 7fea1c8eb640 1 --2- 172.21.15.53:0/3203735615 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea180b3ac0 0x7fea1815e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:07.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.778+0000 7fea1c8eb640 1 -- 172.21.15.53:0/3203735615 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea180ccae0 msgr2=0x7fea180c6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:07.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.778+0000 7fea1c8eb640 1 --2- 172.21.15.53:0/3203735615 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea180ccae0 0x7fea180c6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:07.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.778+0000 7fea1c8eb640 1 -- 172.21.15.53:0/3203735615 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea10009a70 con 0x7fea180cc690 2023-06-10T19:07:07.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.782+0000 7fea1c8eb640 1 --2- 172.21.15.53:0/3203735615 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea180cc690 0x7fea18156ab0 secure :-1 s=READY pgs=2342 cs=0 l=1 rev1=1 crypto rx=0x7fea0800e930 tx=0x7fea0800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:07.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.782+0000 7fea0dffb640 1 -- 172.21.15.53:0/3203735615 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea08009690 con 0x7fea180cc690 2023-06-10T19:07:07.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.782+0000 7fea0dffb640 1 -- 172.21.15.53:0/3203735615 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea0800ca00 con 0x7fea180cc690 2023-06-10T19:07:07.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.782+0000 7fea1f350640 1 -- 172.21.15.53:0/3203735615 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea1815e050 con 0x7fea180cc690 2023-06-10T19:07:07.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.782+0000 7fea0dffb640 1 -- 172.21.15.53:0/3203735615 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0800cd70 con 0x7fea180cc690 2023-06-10T19:07:07.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.782+0000 7fea1f350640 1 -- 172.21.15.53:0/3203735615 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea180c5940 con 0x7fea180cc690 2023-06-10T19:07:07.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.782+0000 7fea1f350640 1 -- 172.21.15.53:0/3203735615 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea1804d790 con 0x7fea180cc690 2023-06-10T19:07:07.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.782+0000 7fea0dffb640 1 -- 172.21.15.53:0/3203735615 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fea08013470 con 0x7fea180cc690 2023-06-10T19:07:07.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.782+0000 7fea0dffb640 1 --2- 172.21.15.53:0/3203735615 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe9fc066280 0x7fe9fc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:07.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.782+0000 7fea0dffb640 1 -- 172.21.15.53:0/3203735615 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fea08083d50 con 0x7fea180cc690 2023-06-10T19:07:07.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.782+0000 7fea1d0ec640 1 --2- 172.21.15.53:0/3203735615 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe9fc066280 0x7fe9fc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:07.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.782+0000 7fea1d0ec640 1 --2- 172.21.15.53:0/3203735615 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe9fc066280 0x7fe9fc068730 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fea14000f70 tx=0x7fea14007b80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:07.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:07.786+0000 7fea0dffb640 1 -- 172.21.15.53:0/3203735615 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fea080514c0 con 0x7fea180cc690 2023-06-10T19:07:08.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.002+0000 7fea1f350640 1 -- 172.21.15.53:0/3203735615 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_filelock_eviction"]} v 0) v1 -- 0x7fea180cc400 con 0x7fea180cc690 2023-06-10T19:07:08.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.286+0000 7fea0dffb640 1 -- 172.21.15.53:0/3203735615 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_filelock_eviction"]}]=0 v684) v1 ==== 154+0+0 (secure 0 0 0) 0x7fea080170e0 con 0x7fea180cc690 2023-06-10T19:07:08.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.290+0000 7fea1f350640 1 -- 172.21.15.53:0/3203735615 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe9fc066280 msgr2=0x7fe9fc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:08.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.290+0000 7fea1f350640 1 --2- 172.21.15.53:0/3203735615 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe9fc066280 0x7fe9fc068730 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fea14000f70 tx=0x7fea14007b80 comp rx=0 tx=0).stop 2023-06-10T19:07:08.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.290+0000 7fea1f350640 1 -- 172.21.15.53:0/3203735615 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea180cc690 msgr2=0x7fea18156ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:08.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.290+0000 7fea1f350640 1 --2- 172.21.15.53:0/3203735615 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea180cc690 0x7fea18156ab0 secure :-1 s=READY pgs=2342 cs=0 l=1 rev1=1 crypto rx=0x7fea0800e930 tx=0x7fea0800edf0 comp rx=0 tx=0).stop 2023-06-10T19:07:08.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.290+0000 7fea1f350640 1 -- 172.21.15.53:0/3203735615 shutdown_connections 2023-06-10T19:07:08.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.290+0000 7fea1f350640 1 --2- 172.21.15.53:0/3203735615 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe9fc066280 0x7fe9fc068730 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:08.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.290+0000 7fea1f350640 1 --2- 172.21.15.53:0/3203735615 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea180ccae0 0x7fea180c6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:08.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.290+0000 7fea1f350640 1 --2- 172.21.15.53:0/3203735615 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea180cc690 0x7fea18156ab0 unknown :-1 s=CLOSED pgs=2342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:08.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.290+0000 7fea1f350640 1 --2- 172.21.15.53:0/3203735615 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fea180b3ac0 0x7fea1815e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:08.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.290+0000 7fea1f350640 1 -- 172.21.15.53:0/3203735615 >> 172.21.15.53:0/3203735615 conn(0x7fea18071790 msgr2=0x7fea18069fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:08.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.290+0000 7fea1f350640 1 -- 172.21.15.53:0/3203735615 shutdown_connections 2023-06-10T19:07:08.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.290+0000 7fea1f350640 1 -- 172.21.15.53:0/3203735615 wait complete. 2023-06-10T19:07:08.313 INFO:tasks.cephfs_test_runner:test_filelock_eviction (tasks.cephfs.test_client_recovery.TestClientRecovery) ... ok 2023-06-10T19:07:08.313 INFO:tasks.cephfs_test_runner:Starting test: test_mount_after_evicted_client (tasks.cephfs.test_client_recovery.TestClientRecovery) Test if a new mount of same fs works after client eviction. 2023-06-10T19:07:08.313 INFO:tasks.cephfs_test_runner:test_mount_after_evicted_client (tasks.cephfs.test_client_recovery.TestClientRecovery) 2023-06-10T19:07:08.314 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_mount_after_evicted_client' 2023-06-10T19:07:08.409 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-10T19:07:08.411 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-10T19:07:08.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.434+0000 7efe4a9b6640 1 Processor -- start 2023-06-10T19:07:08.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.434+0000 7efe4a9b6640 1 -- start start 2023-06-10T19:07:08.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.438+0000 7efe4a9b6640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7efe4406b780 0x7efe4415c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:08.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.438+0000 7efe4a9b6640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe440af530 con 0x7efe440ceb20 2023-06-10T19:07:08.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.438+0000 7efe4a9b6640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe4415fd70 con 0x7efe4406bb50 2023-06-10T19:07:08.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.438+0000 7efe4a9b6640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe4415c3d0 con 0x7efe4406b780 2023-06-10T19:07:08.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.438+0000 7efe48f53640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7efe440ceb20 0x7efe440cefa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41916/0 (socket says 172.21.15.53:41916) 2023-06-10T19:07:08.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.438+0000 7efe48f53640 1 -- 172.21.15.53:0/2261923347 learned_addr learned my addr 172.21.15.53:0/2261923347 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:07:08.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.438+0000 7efe43fff640 1 --2- 172.21.15.53:0/2261923347 >> v2:172.21.15.117:3300/0 conn(0x7efe4406b780 0x7efe4415c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:08.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.438+0000 7efe42ffd640 1 -- 172.21.15.53:0/2261923347 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3089582264 0 0) 0x7efe440af530 con 0x7efe440ceb20 2023-06-10T19:07:08.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.438+0000 7efe42ffd640 1 -- 172.21.15.53:0/2261923347 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe30003530 con 0x7efe440ceb20 2023-06-10T19:07:08.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.438+0000 7efe42ffd640 1 -- 172.21.15.53:0/2261923347 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 713379484 0 0) 0x7efe30003530 con 0x7efe440ceb20 2023-06-10T19:07:08.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.438+0000 7efe42ffd640 1 -- 172.21.15.53:0/2261923347 >> v2:172.21.15.117:3300/0 conn(0x7efe4406b780 msgr2=0x7efe4415c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:08.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.438+0000 7efe42ffd640 1 --2- 172.21.15.53:0/2261923347 >> v2:172.21.15.117:3300/0 conn(0x7efe4406b780 0x7efe4415c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:08.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.438+0000 7efe42ffd640 1 -- 172.21.15.53:0/2261923347 >> v1:172.21.15.117:6789/0 conn(0x7efe4406bb50 legacy=0x7efe4415f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:08.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.438+0000 7efe42ffd640 1 -- 172.21.15.53:0/2261923347 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe44160050 con 0x7efe440ceb20 2023-06-10T19:07:08.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.438+0000 7efe42ffd640 1 -- 172.21.15.53:0/2261923347 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7efe3c001680 con 0x7efe440ceb20 2023-06-10T19:07:08.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.438+0000 7efe42ffd640 1 -- 172.21.15.53:0/2261923347 >> v1:172.21.15.53:6789/0 conn(0x7efe440ceb20 legacy=0x7efe440cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:08.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.438+0000 7efe42ffd640 1 --2- 172.21.15.53:0/2261923347 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe300039f0 0x7efe30003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:08.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.438+0000 7efe42ffd640 1 --2- 172.21.15.53:0/2261923347 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe300047d0 0x7efe30004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:08.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.438+0000 7efe42ffd640 1 --2- 172.21.15.53:0/2261923347 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe30005180 0x7efe3000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:08.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.438+0000 7efe42ffd640 1 -- 172.21.15.53:0/2261923347 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe4415c3d0 con 0x7efe30005180 2023-06-10T19:07:08.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.438+0000 7efe42ffd640 1 -- 172.21.15.53:0/2261923347 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe3000c090 con 0x7efe300047d0 2023-06-10T19:07:08.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.438+0000 7efe42ffd640 1 -- 172.21.15.53:0/2261923347 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe3000c250 con 0x7efe300039f0 2023-06-10T19:07:08.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.438+0000 7efe48f53640 1 --2- 172.21.15.53:0/2261923347 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe30005180 0x7efe3000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:08.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.438+0000 7efe437fe640 1 --2- 172.21.15.53:0/2261923347 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe300047d0 0x7efe30004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:08.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.438+0000 7efe43fff640 1 --2- 172.21.15.53:0/2261923347 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe300039f0 0x7efe30003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:08.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.438+0000 7efe48f53640 1 -- 172.21.15.53:0/2261923347 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe300039f0 msgr2=0x7efe30003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:08.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.438+0000 7efe48f53640 1 --2- 172.21.15.53:0/2261923347 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe300039f0 0x7efe30003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:08.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.438+0000 7efe48f53640 1 -- 172.21.15.53:0/2261923347 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe300047d0 msgr2=0x7efe30004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:08.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.438+0000 7efe48f53640 1 --2- 172.21.15.53:0/2261923347 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe300047d0 0x7efe30004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:08.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.438+0000 7efe48f53640 1 -- 172.21.15.53:0/2261923347 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe30003530 con 0x7efe30005180 2023-06-10T19:07:08.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.438+0000 7efe437fe640 1 --2- 172.21.15.53:0/2261923347 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe300047d0 0x7efe30004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:07:08.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.442+0000 7efe48f53640 1 -- 172.21.15.53:0/2261923347 reap_dead start 2023-06-10T19:07:08.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.442+0000 7efe48f53640 1 --2- 172.21.15.53:0/2261923347 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe30005180 0x7efe3000b990 secure :-1 s=READY pgs=2344 cs=0 l=1 rev1=1 crypto rx=0x7efe3c001ec0 tx=0x7efe3c01cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=985345d724d1de96 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:08.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.442+0000 7efe42ffd640 1 -- 172.21.15.53:0/2261923347 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe3c005ae0 con 0x7efe30005180 2023-06-10T19:07:08.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.442+0000 7efe42ffd640 1 -- 172.21.15.53:0/2261923347 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe3c005c60 con 0x7efe30005180 2023-06-10T19:07:08.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.442+0000 7efe42ffd640 1 -- 172.21.15.53:0/2261923347 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe3c0a5870 con 0x7efe30005180 2023-06-10T19:07:08.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.442+0000 7efe4a9b6640 1 -- 172.21.15.53:0/2261923347 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe30005180 msgr2=0x7efe3000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:08.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.442+0000 7efe4a9b6640 1 --2- 172.21.15.53:0/2261923347 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe30005180 0x7efe3000b990 secure :-1 s=READY pgs=2344 cs=0 l=1 rev1=1 crypto rx=0x7efe3c001ec0 tx=0x7efe3c01cc00 comp rx=0 tx=0).stop 2023-06-10T19:07:08.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.442+0000 7efe4a9b6640 1 -- 172.21.15.53:0/2261923347 shutdown_connections 2023-06-10T19:07:08.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.442+0000 7efe4a9b6640 1 --2- 172.21.15.53:0/2261923347 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe30005180 0x7efe3000b990 unknown :-1 s=CLOSED pgs=2344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:08.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.442+0000 7efe4a9b6640 1 -- 172.21.15.53:0/2261923347 >> 172.21.15.53:0/2261923347 conn(0x7efe4406a090 msgr2=0x7efe4406d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:08.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.442+0000 7efe4a9b6640 1 -- 172.21.15.53:0/2261923347 shutdown_connections 2023-06-10T19:07:08.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.442+0000 7efe4a9b6640 1 -- 172.21.15.53:0/2261923347 wait complete. 2023-06-10T19:07:08.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.442+0000 7efe4a9b6640 1 Processor -- start 2023-06-10T19:07:08.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.442+0000 7efe4a9b6640 1 -- start start 2023-06-10T19:07:08.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.442+0000 7efe4a9b6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe30005180 0x7efe44153780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:08.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.442+0000 7efe4a9b6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe440ab860 0x7efe44151410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:08.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.442+0000 7efe4a9b6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe440ad490 0x7efe440ad900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:08.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.442+0000 7efe4a9b6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe440ade40 con 0x7efe30005180 2023-06-10T19:07:08.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.442+0000 7efe4a9b6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe44154010 con 0x7efe440ad490 2023-06-10T19:07:08.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.442+0000 7efe4a9b6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe441542f0 con 0x7efe440ab860 2023-06-10T19:07:08.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.442+0000 7efe43fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe30005180 0x7efe44153780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:08.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.442+0000 7efe43fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe30005180 0x7efe44153780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49886/0 (socket says 172.21.15.53:49886) 2023-06-10T19:07:08.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.442+0000 7efe43fff640 1 -- 172.21.15.53:0/169102313 learned_addr learned my addr 172.21.15.53:0/169102313 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:08.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.442+0000 7efe437fe640 1 --2- 172.21.15.53:0/169102313 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe440ab860 0x7efe44151410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:08.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.442+0000 7efe48f53640 1 --2- 172.21.15.53:0/169102313 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe440ad490 0x7efe440ad900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:08.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.442+0000 7efe43fff640 1 -- 172.21.15.53:0/169102313 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe440ab860 msgr2=0x7efe44151410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:08.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.442+0000 7efe43fff640 1 --2- 172.21.15.53:0/169102313 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe440ab860 0x7efe44151410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:08.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.442+0000 7efe43fff640 1 -- 172.21.15.53:0/169102313 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe440ad490 msgr2=0x7efe440ad900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:08.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.442+0000 7efe43fff640 1 --2- 172.21.15.53:0/169102313 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe440ad490 0x7efe440ad900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:08.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.442+0000 7efe43fff640 1 -- 172.21.15.53:0/169102313 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe441545d0 con 0x7efe30005180 2023-06-10T19:07:08.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.442+0000 7efe48f53640 1 --2- 172.21.15.53:0/169102313 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe440ad490 0x7efe440ad900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:07:08.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.442+0000 7efe43fff640 1 --2- 172.21.15.53:0/169102313 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe30005180 0x7efe44153780 secure :-1 s=READY pgs=2345 cs=0 l=1 rev1=1 crypto rx=0x7efe34009f10 tx=0x7efe340115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:08.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.442+0000 7efe40ff9640 1 -- 172.21.15.53:0/169102313 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe3400e030 con 0x7efe30005180 2023-06-10T19:07:08.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.442+0000 7efe40ff9640 1 -- 172.21.15.53:0/169102313 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe34016470 con 0x7efe30005180 2023-06-10T19:07:08.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.442+0000 7efe4a9b6640 1 -- 172.21.15.53:0/169102313 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe441548b0 con 0x7efe30005180 2023-06-10T19:07:08.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.442+0000 7efe40ff9640 1 -- 172.21.15.53:0/169102313 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe34009b00 con 0x7efe30005180 2023-06-10T19:07:08.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.442+0000 7efe4a9b6640 1 -- 172.21.15.53:0/169102313 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe44153cc0 con 0x7efe30005180 2023-06-10T19:07:08.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.446+0000 7efe4a9b6640 1 -- 172.21.15.53:0/169102313 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe440b3ad0 con 0x7efe30005180 2023-06-10T19:07:08.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.446+0000 7efe40ff9640 1 -- 172.21.15.53:0/169102313 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7efe34016820 con 0x7efe30005180 2023-06-10T19:07:08.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.446+0000 7efe40ff9640 1 --2- 172.21.15.53:0/169102313 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efe24066280 0x7efe24068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:08.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.446+0000 7efe40ff9640 1 -- 172.21.15.53:0/169102313 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 5339+0+0 (secure 0 0 0) 0x7efe3400f070 con 0x7efe30005180 2023-06-10T19:07:08.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.446+0000 7efe437fe640 1 --2- 172.21.15.53:0/169102313 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efe24066280 0x7efe24068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:08.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.446+0000 7efe437fe640 1 --2- 172.21.15.53:0/169102313 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efe24066280 0x7efe24068730 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7efe440aca70 tx=0x7efe2c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:08.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.450+0000 7efe40ff9640 1 -- 172.21.15.53:0/169102313 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7efe34052030 con 0x7efe30005180 2023-06-10T19:07:08.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:08.678+0000 7efe4a9b6640 1 -- 172.21.15.53:0/169102313 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_mount_after_evicted_client"]} v 0) v1 -- 0x7efe4404d790 con 0x7efe30005180 2023-06-10T19:07:09.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.290+0000 7efe40ff9640 1 -- 172.21.15.53:0/169102313 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_mount_after_evicted_client"]}]=0 v685) v1 ==== 166+0+0 (secure 0 0 0) 0x7efe34055650 con 0x7efe30005180 2023-06-10T19:07:09.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.290+0000 7efe4a9b6640 1 -- 172.21.15.53:0/169102313 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efe24066280 msgr2=0x7efe24068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:09.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.290+0000 7efe4a9b6640 1 --2- 172.21.15.53:0/169102313 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efe24066280 0x7efe24068730 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7efe440aca70 tx=0x7efe2c009040 comp rx=0 tx=0).stop 2023-06-10T19:07:09.294 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.290+0000 7efe4a9b6640 1 -- 172.21.15.53:0/169102313 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe30005180 msgr2=0x7efe44153780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:09.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.290+0000 7efe4a9b6640 1 --2- 172.21.15.53:0/169102313 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe30005180 0x7efe44153780 secure :-1 s=READY pgs=2345 cs=0 l=1 rev1=1 crypto rx=0x7efe34009f10 tx=0x7efe340115a0 comp rx=0 tx=0).stop 2023-06-10T19:07:09.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.290+0000 7efe4a9b6640 1 -- 172.21.15.53:0/169102313 shutdown_connections 2023-06-10T19:07:09.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.290+0000 7efe4a9b6640 1 --2- 172.21.15.53:0/169102313 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efe24066280 0x7efe24068730 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:09.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.290+0000 7efe4a9b6640 1 --2- 172.21.15.53:0/169102313 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe440ad490 0x7efe440ad900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:09.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.290+0000 7efe4a9b6640 1 --2- 172.21.15.53:0/169102313 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efe440ab860 0x7efe44151410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:09.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.290+0000 7efe4a9b6640 1 --2- 172.21.15.53:0/169102313 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe30005180 0x7efe44153780 unknown :-1 s=CLOSED pgs=2345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:09.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.290+0000 7efe4a9b6640 1 -- 172.21.15.53:0/169102313 >> 172.21.15.53:0/169102313 conn(0x7efe4406a090 msgr2=0x7efe4415ee80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:09.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.290+0000 7efe4a9b6640 1 -- 172.21.15.53:0/169102313 shutdown_connections 2023-06-10T19:07:09.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.290+0000 7efe4a9b6640 1 -- 172.21.15.53:0/169102313 wait complete. 2023-06-10T19:07:09.314 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-06-10T19:07:09.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.446+0000 7f5a8fcc8640 1 Processor -- start 2023-06-10T19:07:09.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.446+0000 7f5a8fcc8640 1 -- start start 2023-06-10T19:07:09.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.446+0000 7f5a8fcc8640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5a8806b6e0 0x7f5a8806bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:09.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.446+0000 7f5a8fcc8640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a8806c230 con 0x7f5a88158f40 2023-06-10T19:07:09.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.446+0000 7f5a8fcc8640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a8806ca40 con 0x7f5a881558e0 2023-06-10T19:07:09.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.446+0000 7f5a8fcc8640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a8806c020 con 0x7f5a8806b6e0 2023-06-10T19:07:09.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.446+0000 7f5a8d263640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f5a88158f40 0x7f5a880cb820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41924/0 (socket says 172.21.15.53:41924) 2023-06-10T19:07:09.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.446+0000 7f5a8d263640 1 -- 172.21.15.53:0/1838647222 learned_addr learned my addr 172.21.15.53:0/1838647222 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:07:09.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.446+0000 7f5a8e265640 1 --2- 172.21.15.53:0/1838647222 >> v2:172.21.15.117:3300/0 conn(0x7f5a8806b6e0 0x7f5a8806bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:09.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.446+0000 7f5a8ca62640 1 -- 172.21.15.53:0/1838647222 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 358387405 0 0) 0x7f5a8806c230 con 0x7f5a88158f40 2023-06-10T19:07:09.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.446+0000 7f5a8ca62640 1 -- 172.21.15.53:0/1838647222 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a74003530 con 0x7f5a88158f40 2023-06-10T19:07:09.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.446+0000 7f5a8ca62640 1 -- 172.21.15.53:0/1838647222 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1919949605 0 0) 0x7f5a74003530 con 0x7f5a88158f40 2023-06-10T19:07:09.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.446+0000 7f5a8ca62640 1 -- 172.21.15.53:0/1838647222 >> v2:172.21.15.117:3300/0 conn(0x7f5a8806b6e0 msgr2=0x7f5a8806bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:09.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.446+0000 7f5a8ca62640 1 --2- 172.21.15.53:0/1838647222 >> v2:172.21.15.117:3300/0 conn(0x7f5a8806b6e0 0x7f5a8806bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:09.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.446+0000 7f5a8ca62640 1 -- 172.21.15.53:0/1838647222 >> v1:172.21.15.117:6789/0 conn(0x7f5a881558e0 legacy=0x7f5a880c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:09.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.446+0000 7f5a8ca62640 1 -- 172.21.15.53:0/1838647222 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a88155cb0 con 0x7f5a88158f40 2023-06-10T19:07:09.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.446+0000 7f5a8ca62640 1 -- 172.21.15.53:0/1838647222 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f5a78001680 con 0x7f5a88158f40 2023-06-10T19:07:09.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.446+0000 7f5a8ca62640 1 -- 172.21.15.53:0/1838647222 >> v1:172.21.15.53:6789/0 conn(0x7f5a88158f40 legacy=0x7f5a880cb820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:09.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.446+0000 7f5a8ca62640 1 --2- 172.21.15.53:0/1838647222 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a74003980 0x7f5a74003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:09.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.446+0000 7f5a8ca62640 1 --2- 172.21.15.53:0/1838647222 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5a740047d0 0x7f5a74004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:09.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.446+0000 7f5a8ca62640 1 --2- 172.21.15.53:0/1838647222 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5a740052a0 0x7f5a7400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:09.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.446+0000 7f5a8ca62640 1 -- 172.21.15.53:0/1838647222 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8806c020 con 0x7f5a74003980 2023-06-10T19:07:09.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.446+0000 7f5a8ca62640 1 -- 172.21.15.53:0/1838647222 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a7400c1d0 con 0x7f5a740047d0 2023-06-10T19:07:09.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.446+0000 7f5a8ca62640 1 -- 172.21.15.53:0/1838647222 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a7400c390 con 0x7f5a740052a0 2023-06-10T19:07:09.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.446+0000 7f5a8da64640 1 --2- 172.21.15.53:0/1838647222 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a74003980 0x7f5a74003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:09.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.446+0000 7f5a8d263640 1 --2- 172.21.15.53:0/1838647222 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5a740047d0 0x7f5a74004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:09.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.446+0000 7f5a8e265640 1 --2- 172.21.15.53:0/1838647222 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5a740052a0 0x7f5a7400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:09.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.446+0000 7f5a8da64640 1 -- 172.21.15.53:0/1838647222 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5a740052a0 msgr2=0x7f5a7400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:09.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.446+0000 7f5a8da64640 1 --2- 172.21.15.53:0/1838647222 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5a740052a0 0x7f5a7400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:09.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.446+0000 7f5a8da64640 1 -- 172.21.15.53:0/1838647222 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5a740047d0 msgr2=0x7f5a74004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:09.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.446+0000 7f5a8da64640 1 --2- 172.21.15.53:0/1838647222 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5a740047d0 0x7f5a74004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:09.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.446+0000 7f5a8da64640 1 -- 172.21.15.53:0/1838647222 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a74003530 con 0x7f5a74003980 2023-06-10T19:07:09.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.446+0000 7f5a8e265640 1 --2- 172.21.15.53:0/1838647222 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5a740052a0 0x7f5a7400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:07:09.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.446+0000 7f5a8e265640 1 -- 172.21.15.53:0/1838647222 reap_dead start 2023-06-10T19:07:09.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.450+0000 7f5a8da64640 1 --2- 172.21.15.53:0/1838647222 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a74003980 0x7f5a74003d90 secure :-1 s=READY pgs=2347 cs=0 l=1 rev1=1 crypto rx=0x7f5a84001780 tx=0x7f5a8401c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38365daf11a85e8b server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:09.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.450+0000 7f5a8ca62640 1 -- 172.21.15.53:0/1838647222 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a840052d0 con 0x7f5a74003980 2023-06-10T19:07:09.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.450+0000 7f5a8ca62640 1 -- 172.21.15.53:0/1838647222 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a840a7050 con 0x7f5a74003980 2023-06-10T19:07:09.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.450+0000 7f5a8ca62640 1 -- 172.21.15.53:0/1838647222 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a84003600 con 0x7f5a74003980 2023-06-10T19:07:09.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.450+0000 7f5a8fcc8640 1 -- 172.21.15.53:0/1838647222 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a74003980 msgr2=0x7f5a74003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:09.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.450+0000 7f5a8fcc8640 1 --2- 172.21.15.53:0/1838647222 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a74003980 0x7f5a74003d90 secure :-1 s=READY pgs=2347 cs=0 l=1 rev1=1 crypto rx=0x7f5a84001780 tx=0x7f5a8401c3b0 comp rx=0 tx=0).stop 2023-06-10T19:07:09.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.450+0000 7f5a8fcc8640 1 -- 172.21.15.53:0/1838647222 shutdown_connections 2023-06-10T19:07:09.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.450+0000 7f5a8fcc8640 1 --2- 172.21.15.53:0/1838647222 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a74003980 0x7f5a74003d90 unknown :-1 s=CLOSED pgs=2347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:09.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.450+0000 7f5a8fcc8640 1 -- 172.21.15.53:0/1838647222 >> 172.21.15.53:0/1838647222 conn(0x7f5a8806a0e0 msgr2=0x7f5a880cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:09.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.450+0000 7f5a8fcc8640 1 -- 172.21.15.53:0/1838647222 shutdown_connections 2023-06-10T19:07:09.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.450+0000 7f5a8fcc8640 1 -- 172.21.15.53:0/1838647222 wait complete. 2023-06-10T19:07:09.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.450+0000 7f5a8fcc8640 1 Processor -- start 2023-06-10T19:07:09.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.450+0000 7f5a8fcc8640 1 -- start start 2023-06-10T19:07:09.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.454+0000 7f5a8fcc8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a74003980 0x7f5a881561a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:09.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.454+0000 7f5a8fcc8640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5a880cd4b0 0x7f5a881566e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:09.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.454+0000 7f5a8fcc8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5a880b2b00 0x7f5a880b2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:09.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.454+0000 7f5a8fcc8640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a880b1830 con 0x7f5a74003980 2023-06-10T19:07:09.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.454+0000 7f5a8fcc8640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a88149ba0 con 0x7f5a880b2b00 2023-06-10T19:07:09.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.454+0000 7f5a8fcc8640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a880b0bb0 con 0x7f5a880cd4b0 2023-06-10T19:07:09.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.454+0000 7f5a8da64640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a74003980 0x7f5a881561a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:09.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.454+0000 7f5a8da64640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a74003980 0x7f5a881561a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49908/0 (socket says 172.21.15.53:49908) 2023-06-10T19:07:09.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.454+0000 7f5a8da64640 1 -- 172.21.15.53:0/1679042071 learned_addr learned my addr 172.21.15.53:0/1679042071 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:09.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.454+0000 7f5a8e265640 1 --2- 172.21.15.53:0/1679042071 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5a880b2b00 0x7f5a880b2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:09.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.454+0000 7f5a8d263640 1 --2- 172.21.15.53:0/1679042071 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5a880cd4b0 0x7f5a881566e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:09.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.454+0000 7f5a8da64640 1 -- 172.21.15.53:0/1679042071 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5a880cd4b0 msgr2=0x7f5a881566e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:09.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.454+0000 7f5a8da64640 1 --2- 172.21.15.53:0/1679042071 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5a880cd4b0 0x7f5a881566e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:09.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.454+0000 7f5a8da64640 1 -- 172.21.15.53:0/1679042071 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5a880b2b00 msgr2=0x7f5a880b2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:09.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.454+0000 7f5a8da64640 1 --2- 172.21.15.53:0/1679042071 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5a880b2b00 0x7f5a880b2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:09.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.454+0000 7f5a8da64640 1 -- 172.21.15.53:0/1679042071 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a880b0e90 con 0x7f5a74003980 2023-06-10T19:07:09.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.454+0000 7f5a8e265640 1 --2- 172.21.15.53:0/1679042071 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5a880b2b00 0x7f5a880b2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:07:09.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.454+0000 7f5a8da64640 1 --2- 172.21.15.53:0/1679042071 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a74003980 0x7f5a881561a0 secure :-1 s=READY pgs=2348 cs=0 l=1 rev1=1 crypto rx=0x7f5a8401c1e0 tx=0x7f5a74005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:09.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.454+0000 7f5a7e7fc640 1 -- 172.21.15.53:0/1679042071 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a840072f0 con 0x7f5a74003980 2023-06-10T19:07:09.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.454+0000 7f5a7e7fc640 1 -- 172.21.15.53:0/1679042071 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a84007450 con 0x7f5a74003980 2023-06-10T19:07:09.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.454+0000 7f5a7e7fc640 1 -- 172.21.15.53:0/1679042071 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a840067e0 con 0x7f5a74003980 2023-06-10T19:07:09.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.454+0000 7f5a8fcc8640 1 -- 172.21.15.53:0/1679042071 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a880b1170 con 0x7f5a74003980 2023-06-10T19:07:09.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.454+0000 7f5a8fcc8640 1 -- 172.21.15.53:0/1679042071 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a880b1c50 con 0x7f5a74003980 2023-06-10T19:07:09.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.454+0000 7f5a8fcc8640 1 -- 172.21.15.53:0/1679042071 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a8804d790 con 0x7f5a74003980 2023-06-10T19:07:09.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.454+0000 7f5a7e7fc640 1 -- 172.21.15.53:0/1679042071 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5a84006940 con 0x7f5a74003980 2023-06-10T19:07:09.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.454+0000 7f5a7e7fc640 1 --2- 172.21.15.53:0/1679042071 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5a6c066280 0x7f5a6c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:09.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.454+0000 7f5a7e7fc640 1 -- 172.21.15.53:0/1679042071 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f5a8411da90 con 0x7f5a74003980 2023-06-10T19:07:09.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.454+0000 7f5a8d263640 1 --2- 172.21.15.53:0/1679042071 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5a6c066280 0x7f5a6c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:09.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.458+0000 7f5a8d263640 1 --2- 172.21.15.53:0/1679042071 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5a6c066280 0x7f5a6c068730 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f5a880cd880 tx=0x7f5a78001d40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:09.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.458+0000 7f5a7e7fc640 1 -- 172.21.15.53:0/1679042071 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5a840eed00 con 0x7f5a74003980 2023-06-10T19:07:09.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.606+0000 7f5a8fcc8640 1 -- 172.21.15.53:0/1679042071 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f5a8804d790 con 0x7f5a74003980 2023-06-10T19:07:09.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.614+0000 7f5a7e7fc640 1 -- 172.21.15.53:0/1679042071 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v28)=0 v28) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5a840ee890 con 0x7f5a74003980 2023-06-10T19:07:09.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.614+0000 7f5a8fcc8640 1 -- 172.21.15.53:0/1679042071 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5a6c066280 msgr2=0x7f5a6c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:09.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.614+0000 7f5a8fcc8640 1 --2- 172.21.15.53:0/1679042071 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5a6c066280 0x7f5a6c068730 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f5a880cd880 tx=0x7f5a78001d40 comp rx=0 tx=0).stop 2023-06-10T19:07:09.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.614+0000 7f5a8fcc8640 1 -- 172.21.15.53:0/1679042071 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a74003980 msgr2=0x7f5a881561a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:09.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.614+0000 7f5a8fcc8640 1 --2- 172.21.15.53:0/1679042071 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a74003980 0x7f5a881561a0 secure :-1 s=READY pgs=2348 cs=0 l=1 rev1=1 crypto rx=0x7f5a8401c1e0 tx=0x7f5a74005800 comp rx=0 tx=0).stop 2023-06-10T19:07:09.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.614+0000 7f5a8fcc8640 1 -- 172.21.15.53:0/1679042071 shutdown_connections 2023-06-10T19:07:09.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.614+0000 7f5a8fcc8640 1 --2- 172.21.15.53:0/1679042071 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5a6c066280 0x7f5a6c068730 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:09.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.614+0000 7f5a8fcc8640 1 --2- 172.21.15.53:0/1679042071 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5a880b2b00 0x7f5a880b2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:09.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.614+0000 7f5a8fcc8640 1 --2- 172.21.15.53:0/1679042071 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5a880cd4b0 0x7f5a881566e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:09.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.614+0000 7f5a8fcc8640 1 --2- 172.21.15.53:0/1679042071 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5a74003980 0x7f5a881561a0 unknown :-1 s=CLOSED pgs=2348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:09.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.614+0000 7f5a8fcc8640 1 -- 172.21.15.53:0/1679042071 >> 172.21.15.53:0/1679042071 conn(0x7f5a8806a0e0 msgr2=0x7f5a881543e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:09.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.614+0000 7f5a8fcc8640 1 -- 172.21.15.53:0/1679042071 shutdown_connections 2023-06-10T19:07:09.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.614+0000 7f5a8fcc8640 1 -- 172.21.15.53:0/1679042071 wait complete. 2023-06-10T19:07:09.633 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-06-10T19:07:09.634 DEBUG:teuthology.orchestra.run.smithi053:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-06-10T19:07:09.692 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-06-10T19:07:09.760 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-06-10T19:07:09.761 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T19:07:09.761 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:07:09.766 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16345192k,nr_inodes=4086298,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276544k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=407 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276540k,nr_inodes=819135,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276544k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-06-10T19:07:09.767 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T19:07:09.767 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:07:09.773 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16342088k,nr_inodes=4085522,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275924k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18845 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275920k,nr_inodes=818980,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275924k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-06-10T19:07:09.773 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T19:07:09.774 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:07:09.815 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16345192k,nr_inodes=4086298,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276544k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=407 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276540k,nr_inodes=819135,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276544k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-06-10T19:07:09.816 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T19:07:09.816 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:07:09.822 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16342088k,nr_inodes=4085522,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275924k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18845 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275920k,nr_inodes=818980,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275924k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-06-10T19:07:09.823 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-06-10T19:07:09.823 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:07:09.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.974+0000 7fcace6b6640 1 Processor -- start 2023-06-10T19:07:09.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.974+0000 7fcace6b6640 1 -- start start 2023-06-10T19:07:09.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.974+0000 7fcace6b6640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fcac80cc690 0x7fcac80d04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:09.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.974+0000 7fcace6b6640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fcac80ccae0 0x7fcac80d09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:09.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.974+0000 7fcace6b6640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcac80d0020 con 0x7fcac80b3ac0 2023-06-10T19:07:09.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.974+0000 7fcace6b6640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcac80cef40 con 0x7fcac80ccae0 2023-06-10T19:07:09.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.974+0000 7fcace6b6640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcac80cf220 con 0x7fcac80cc690 2023-06-10T19:07:09.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.974+0000 7fcaccc53640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fcac80ccae0 0x7fcac80d09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:09.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.974+0000 7fcaccc53640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fcac80ccae0 0x7fcac80d09f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49916/0 (socket says 172.21.15.53:49916) 2023-06-10T19:07:09.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.974+0000 7fcaccc53640 1 -- 172.21.15.53:0/2000694980 learned_addr learned my addr 172.21.15.53:0/2000694980 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:09.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.974+0000 7fcac77fe640 1 --2- 172.21.15.53:0/2000694980 >> v2:172.21.15.117:3300/0 conn(0x7fcac80cc690 0x7fcac80d04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:09.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.974+0000 7fcaccc53640 1 -- 172.21.15.53:0/2000694980 >> v2:172.21.15.117:3300/0 conn(0x7fcac80cc690 msgr2=0x7fcac80d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:09.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.974+0000 7fcaccc53640 1 --2- 172.21.15.53:0/2000694980 >> v2:172.21.15.117:3300/0 conn(0x7fcac80cc690 0x7fcac80d04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:09.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.974+0000 7fcaccc53640 1 -- 172.21.15.53:0/2000694980 >> v1:172.21.15.117:6789/0 conn(0x7fcac80b3ac0 legacy=0x7fcac80b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:09.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.974+0000 7fcaccc53640 1 -- 172.21.15.53:0/2000694980 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcac80cf500 con 0x7fcac80ccae0 2023-06-10T19:07:09.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.978+0000 7fcaccc53640 1 --2- 172.21.15.53:0/2000694980 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcac80ccae0 0x7fcac80d09f0 secure :-1 s=READY pgs=2349 cs=0 l=1 rev1=1 crypto rx=0x7fcac808aa80 tx=0x7fcac001c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af13053ed73181fc server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:09.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.978+0000 7fcac6ffd640 1 -- 172.21.15.53:0/2000694980 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac00a5840 con 0x7fcac80ccae0 2023-06-10T19:07:09.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.978+0000 7fcac6ffd640 1 -- 172.21.15.53:0/2000694980 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac00a59a0 con 0x7fcac80ccae0 2023-06-10T19:07:09.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.978+0000 7fcac6ffd640 1 -- 172.21.15.53:0/2000694980 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac00a5d30 con 0x7fcac80ccae0 2023-06-10T19:07:09.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.978+0000 7fcace6b6640 1 -- 172.21.15.53:0/2000694980 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcac80ccae0 msgr2=0x7fcac80d09f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:09.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.978+0000 7fcace6b6640 1 --2- 172.21.15.53:0/2000694980 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcac80ccae0 0x7fcac80d09f0 secure :-1 s=READY pgs=2349 cs=0 l=1 rev1=1 crypto rx=0x7fcac808aa80 tx=0x7fcac001c960 comp rx=0 tx=0).stop 2023-06-10T19:07:09.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.978+0000 7fcace6b6640 1 -- 172.21.15.53:0/2000694980 shutdown_connections 2023-06-10T19:07:09.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.978+0000 7fcace6b6640 1 --2- 172.21.15.53:0/2000694980 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcac80ccae0 0x7fcac80d09f0 unknown :-1 s=CLOSED pgs=2349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:09.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.978+0000 7fcace6b6640 1 --2- 172.21.15.53:0/2000694980 >> v2:172.21.15.117:3300/0 conn(0x7fcac80cc690 0x7fcac80d04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:09.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.978+0000 7fcace6b6640 1 -- 172.21.15.53:0/2000694980 >> 172.21.15.53:0/2000694980 conn(0x7fcac8071790 msgr2=0x7fcac8069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:09.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.978+0000 7fcace6b6640 1 -- 172.21.15.53:0/2000694980 shutdown_connections 2023-06-10T19:07:09.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.978+0000 7fcace6b6640 1 -- 172.21.15.53:0/2000694980 wait complete. 2023-06-10T19:07:09.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.982+0000 7fcace6b6640 1 Processor -- start 2023-06-10T19:07:09.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.982+0000 7fcace6b6640 1 -- start start 2023-06-10T19:07:09.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.982+0000 7fcace6b6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcac80b3ac0 0x7fcac80cd870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:09.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.982+0000 7fcace6b6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcac80cc690 0x7fcac80b2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:09.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.982+0000 7fcace6b6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcac80ccae0 0x7fcac815e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:09.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.982+0000 7fcace6b6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac815be00 con 0x7fcac80cc690 2023-06-10T19:07:09.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.982+0000 7fcace6b6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac8153440 con 0x7fcac80b3ac0 2023-06-10T19:07:09.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.982+0000 7fcace6b6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcac815eca0 con 0x7fcac80ccae0 2023-06-10T19:07:09.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.982+0000 7fcac77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcac80cc690 0x7fcac80b2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:09.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.982+0000 7fcaccc53640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcac80ccae0 0x7fcac815e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:09.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.982+0000 7fcac77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcac80cc690 0x7fcac80b2bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49926/0 (socket says 172.21.15.53:49926) 2023-06-10T19:07:09.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.982+0000 7fcac77fe640 1 -- 172.21.15.53:0/875070790 learned_addr learned my addr 172.21.15.53:0/875070790 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:09.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.982+0000 7fcac7fff640 1 --2- 172.21.15.53:0/875070790 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcac80b3ac0 0x7fcac80cd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:09.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.982+0000 7fcac77fe640 1 -- 172.21.15.53:0/875070790 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcac80ccae0 msgr2=0x7fcac815e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:09.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.982+0000 7fcac77fe640 1 --2- 172.21.15.53:0/875070790 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcac80ccae0 0x7fcac815e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:09.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.982+0000 7fcac77fe640 1 -- 172.21.15.53:0/875070790 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcac80b3ac0 msgr2=0x7fcac80cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:09.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.982+0000 7fcac77fe640 1 --2- 172.21.15.53:0/875070790 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcac80b3ac0 0x7fcac80cd870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:09.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.982+0000 7fcac77fe640 1 -- 172.21.15.53:0/875070790 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcac0009b30 con 0x7fcac80cc690 2023-06-10T19:07:09.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.982+0000 7fcac7fff640 1 --2- 172.21.15.53:0/875070790 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcac80b3ac0 0x7fcac80cd870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:07:09.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.982+0000 7fcac77fe640 1 --2- 172.21.15.53:0/875070790 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcac80cc690 0x7fcac80b2bc0 secure :-1 s=READY pgs=2350 cs=0 l=1 rev1=1 crypto rx=0x7fcabc00d800 tx=0x7fcabc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:09.990 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.982+0000 7fcac4ff9640 1 -- 172.21.15.53:0/875070790 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcabc00b6c0 con 0x7fcac80cc690 2023-06-10T19:07:09.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.982+0000 7fcac4ff9640 1 -- 172.21.15.53:0/875070790 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcabc00b820 con 0x7fcac80cc690 2023-06-10T19:07:09.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.982+0000 7fcace6b6640 1 -- 172.21.15.53:0/875070790 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcac8152830 con 0x7fcac80cc690 2023-06-10T19:07:09.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.982+0000 7fcac4ff9640 1 -- 172.21.15.53:0/875070790 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcabc00bb90 con 0x7fcac80cc690 2023-06-10T19:07:09.991 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.982+0000 7fcace6b6640 1 -- 172.21.15.53:0/875070790 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcac8152df0 con 0x7fcac80cc690 2023-06-10T19:07:09.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.982+0000 7fcace6b6640 1 -- 172.21.15.53:0/875070790 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcac81535f0 con 0x7fcac80cc690 2023-06-10T19:07:09.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.982+0000 7fcac4ff9640 1 -- 172.21.15.53:0/875070790 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcabc00bcf0 con 0x7fcac80cc690 2023-06-10T19:07:09.992 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.986+0000 7fcac4ff9640 1 --2- 172.21.15.53:0/875070790 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcab40662b0 0x7fcab4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:09.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.986+0000 7fcac4ff9640 1 -- 172.21.15.53:0/875070790 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fcabc083ec0 con 0x7fcac80cc690 2023-06-10T19:07:09.993 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.986+0000 7fcac7fff640 1 --2- 172.21.15.53:0/875070790 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcab40662b0 0x7fcab4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:09.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.986+0000 7fcac7fff640 1 --2- 172.21.15.53:0/875070790 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcab40662b0 0x7fcab4068760 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fcab8003ec0 tx=0x7fcab8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:09.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:09.990+0000 7fcac4ff9640 1 -- 172.21.15.53:0/875070790 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcac81535f0 con 0x7fcac80cc690 2023-06-10T19:07:10.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:10.174+0000 7fcace6b6640 1 -- 172.21.15.53:0/875070790 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcac81535b0 con 0x7fcac80cc690 2023-06-10T19:07:10.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:10.174+0000 7fcac4ff9640 1 -- 172.21.15.53:0/875070790 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) v1 ==== 94+0+3528 (secure 0 0 0) 0x7fcabc055090 con 0x7fcac80cc690 2023-06-10T19:07:10.178 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:07:10.178 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":91,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/67248348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":67248348},{"type":"v1","addr":"172.21.15.117:6835","nonce":67248348}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":84},{"gid":8296,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/3907684243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":3907684243},{"type":"v1","addr":"172.21.15.117:6837","nonce":3907684243}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":84},{"gid":10038,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/1699177406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":1699177406},{"type":"v1","addr":"172.21.15.53:6833","nonce":1699177406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":84},{"gid":10488,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/133931708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":133931708},{"type":"v1","addr":"172.21.15.53:6835","nonce":133931708}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":91}],"filesystems":[]} 2023-06-10T19:07:10.178 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 91 2023-06-10T19:07:10.180 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:10.178+0000 7fcace6b6640 1 -- 172.21.15.53:0/875070790 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcab40662b0 msgr2=0x7fcab4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:10.180 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:10.178+0000 7fcace6b6640 1 --2- 172.21.15.53:0/875070790 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcab40662b0 0x7fcab4068760 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fcab8003ec0 tx=0x7fcab8009040 comp rx=0 tx=0).stop 2023-06-10T19:07:10.180 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:10.178+0000 7fcace6b6640 1 -- 172.21.15.53:0/875070790 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcac80cc690 msgr2=0x7fcac80b2bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:10.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:10.178+0000 7fcace6b6640 1 --2- 172.21.15.53:0/875070790 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcac80cc690 0x7fcac80b2bc0 secure :-1 s=READY pgs=2350 cs=0 l=1 rev1=1 crypto rx=0x7fcabc00d800 tx=0x7fcabc00dcc0 comp rx=0 tx=0).stop 2023-06-10T19:07:10.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:10.178+0000 7fcace6b6640 1 -- 172.21.15.53:0/875070790 shutdown_connections 2023-06-10T19:07:10.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:10.178+0000 7fcace6b6640 1 --2- 172.21.15.53:0/875070790 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcab40662b0 0x7fcab4068760 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:10.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:10.178+0000 7fcace6b6640 1 --2- 172.21.15.53:0/875070790 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcac80ccae0 0x7fcac815e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:10.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:10.178+0000 7fcace6b6640 1 --2- 172.21.15.53:0/875070790 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcac80cc690 0x7fcac80b2bc0 unknown :-1 s=CLOSED pgs=2350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:10.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:10.178+0000 7fcace6b6640 1 --2- 172.21.15.53:0/875070790 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcac80b3ac0 0x7fcac80cd870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:10.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:10.178+0000 7fcace6b6640 1 -- 172.21.15.53:0/875070790 >> 172.21.15.53:0/875070790 conn(0x7fcac8071790 msgr2=0x7fcac80b6450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:10.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:10.178+0000 7fcace6b6640 1 -- 172.21.15.53:0/875070790 shutdown_connections 2023-06-10T19:07:10.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:10.178+0000 7fcace6b6640 1 -- 172.21.15.53:0/875070790 wait complete. 2023-06-10T19:07:10.196 INFO:tasks.ceph.mds.a:Restarting daemon 2023-06-10T19:07:10.197 INFO:tasks.ceph.mds.a:Stopping old one... 2023-06-10T19:07:10.197 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-06-10T19:07:10.197 INFO:teuthology.orchestra.run:waiting for 300 2023-06-10T19:07:10.197 INFO:tasks.ceph.mds.c:Restarting daemon 2023-06-10T19:07:10.198 INFO:tasks.ceph.mds.c:Stopping old one... 2023-06-10T19:07:10.198 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-06-10T19:07:10.198 INFO:teuthology.orchestra.run:waiting for 300 2023-06-10T19:07:10.198 INFO:tasks.ceph.mds.b:Restarting daemon 2023-06-10T19:07:10.199 INFO:tasks.ceph.mds.b:Stopping old one... 2023-06-10T19:07:10.199 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-06-10T19:07:10.199 INFO:teuthology.orchestra.run:waiting for 300 2023-06-10T19:07:10.199 INFO:tasks.ceph.mds.d:Restarting daemon 2023-06-10T19:07:10.199 INFO:tasks.ceph.mds.d:Stopping old one... 2023-06-10T19:07:10.200 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-06-10T19:07:10.200 INFO:teuthology.orchestra.run:waiting for 300 2023-06-10T19:07:10.206 INFO:tasks.ceph.mds.a:Stopped 2023-06-10T19:07:10.206 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-06-10T19:07:10.208 INFO:tasks.ceph.mds.c:Stopped 2023-06-10T19:07:10.208 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-06-10T19:07:10.212 INFO:tasks.ceph.mds.b:Stopped 2023-06-10T19:07:10.212 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-06-10T19:07:10.213 INFO:tasks.ceph.mds.d:Stopped 2023-06-10T19:07:10.213 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-06-10T19:07:10.255 INFO:tasks.ceph.mds.a:Started 2023-06-10T19:07:10.256 DEBUG:teuthology.parallel:result is None 2023-06-10T19:07:10.256 INFO:tasks.ceph.mds.c:Started 2023-06-10T19:07:10.257 DEBUG:teuthology.parallel:result is None 2023-06-10T19:07:10.259 INFO:tasks.ceph.mds.b:Started 2023-06-10T19:07:10.260 DEBUG:teuthology.parallel:result is None 2023-06-10T19:07:10.261 INFO:tasks.ceph.mds.d:Started 2023-06-10T19:07:10.261 DEBUG:teuthology.parallel:result is None 2023-06-10T19:07:10.262 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-06-10T19:07:10.312 INFO:tasks.ceph.mds.a.smithi053.stdout:starting mds.a at 2023-06-10T19:07:10.323 INFO:tasks.ceph.mds.c.smithi053.stdout:starting mds.c at 2023-06-10T19:07:10.331 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2023-06-10T19:07:10.332 INFO:tasks.ceph.mds.d.smithi117.stdout:starting mds.d at 2023-06-10T19:07:10.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:10.374+0000 7fa1a59d4640 1 Processor -- start 2023-06-10T19:07:10.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:10.374+0000 7fa1a59d4640 1 -- start start 2023-06-10T19:07:10.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:10.374+0000 7fa1a59d4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1a0159450 0x7fa1a015d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:10.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:10.374+0000 7fa1a59d4640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa1a015d680 0x7fa1a00cec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:10.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:10.374+0000 7fa1a59d4640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1a00cbac0 con 0x7fa1a00cf180 2023-06-10T19:07:10.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:10.374+0000 7fa1a59d4640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1a00cf600 con 0x7fa1a015d680 2023-06-10T19:07:10.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:10.374+0000 7fa1a59d4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a015dc00 con 0x7fa1a0159450 2023-06-10T19:07:10.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:10.374+0000 7fa19e7fc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa1a015d680 0x7fa1a00cec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:10.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:10.374+0000 7fa19f7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fa1a00cf180 0x7fa1a00cda20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:41932/0 (socket says 172.21.15.53:41932) 2023-06-10T19:07:10.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:10.374+0000 7fa19e7fc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa1a015d680 0x7fa1a00cec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49974/0 (socket says 172.21.15.53:49974) 2023-06-10T19:07:10.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:10.374+0000 7fa19f7fe640 1 -- 172.21.15.53:0/787443895 learned_addr learned my addr 172.21.15.53:0/787443895 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:07:10.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:10.374+0000 7fa19effd640 1 --2- 172.21.15.53:0/787443895 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1a0159450 0x7fa1a015d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:10.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:10.374+0000 7fa19e7fc640 1 -- 172.21.15.53:0/787443895 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1a0159450 msgr2=0x7fa1a015d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:10.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:10.374+0000 7fa19e7fc640 1 --2- 172.21.15.53:0/787443895 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1a0159450 0x7fa1a015d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:10.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:10.374+0000 7fa19dffb640 1 -- 172.21.15.53:0/787443895 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 562414780 0 0) 0x7fa1a00cbac0 con 0x7fa1a00cf180 2023-06-10T19:07:10.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:10.374+0000 7fa19e7fc640 1 -- 172.21.15.53:0/787443895 >> v1:172.21.15.53:6789/0 conn(0x7fa1a00cf180 legacy=0x7fa1a00cda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:10.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:10.374+0000 7fa19e7fc640 1 -- 172.21.15.53:0/787443895 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1a015dee0 con 0x7fa1a015d680 2023-06-10T19:07:10.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:10.374+0000 7fa19e7fc640 1 --2- 172.21.15.53:0/787443895 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1a015d680 0x7fa1a00cec40 secure :-1 s=READY pgs=2358 cs=0 l=1 rev1=1 crypto rx=0x7fa1880097c0 tx=0x7fa18801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5824d688d46f7f9d server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:10.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:10.374+0000 7fa19dffb640 1 -- 172.21.15.53:0/787443895 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1880ad680 con 0x7fa1a015d680 2023-06-10T19:07:10.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:10.374+0000 7fa19dffb640 1 -- 172.21.15.53:0/787443895 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1880ad7e0 con 0x7fa1a015d680 2023-06-10T19:07:10.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:10.374+0000 7fa19dffb640 1 -- 172.21.15.53:0/787443895 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1880adb70 con 0x7fa1a015d680 2023-06-10T19:07:10.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:10.378+0000 7fa1a59d4640 1 -- 172.21.15.53:0/787443895 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1a015d680 msgr2=0x7fa1a00cec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:10.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:10.378+0000 7fa1a59d4640 1 --2- 172.21.15.53:0/787443895 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1a015d680 0x7fa1a00cec40 secure :-1 s=READY pgs=2358 cs=0 l=1 rev1=1 crypto rx=0x7fa1880097c0 tx=0x7fa18801c3c0 comp rx=0 tx=0).stop 2023-06-10T19:07:10.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:10.378+0000 7fa1a59d4640 1 -- 172.21.15.53:0/787443895 shutdown_connections 2023-06-10T19:07:10.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:10.378+0000 7fa1a59d4640 1 --2- 172.21.15.53:0/787443895 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1a015d680 0x7fa1a00cec40 unknown :-1 s=CLOSED pgs=2358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:10.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:10.378+0000 7fa1a59d4640 1 --2- 172.21.15.53:0/787443895 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1a0159450 0x7fa1a015d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:10.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:10.378+0000 7fa1a59d4640 1 -- 172.21.15.53:0/787443895 >> 172.21.15.53:0/787443895 conn(0x7fa1a006a0b0 msgr2=0x7fa1a006d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:10.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:10.378+0000 7fa1a59d4640 1 -- 172.21.15.53:0/787443895 shutdown_connections 2023-06-10T19:07:10.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:10.378+0000 7fa1a59d4640 1 -- 172.21.15.53:0/787443895 wait complete. 2023-06-10T19:07:10.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:10.378+0000 7fa1a59d4640 1 Processor -- start 2023-06-10T19:07:10.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:10.378+0000 7fa1a59d4640 1 -- start start 2023-06-10T19:07:10.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:10.378+0000 7fa1a59d4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1a00cf180 0x7fa1a0151450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:10.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:10.378+0000 7fa1a59d4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1a0159450 0x7fa1a0154740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:10.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:10.378+0000 7fa1a59d4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1a015d680 0x7fa1a00c9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:10.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:10.378+0000 7fa1a59d4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a0151270 con 0x7fa1a015d680 2023-06-10T19:07:10.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:10.378+0000 7fa1a59d4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a0152770 con 0x7fa1a0159450 2023-06-10T19:07:10.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:10.378+0000 7fa1a59d4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a0152a50 con 0x7fa1a00cf180 2023-06-10T19:07:10.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:10.378+0000 7fa19f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1a015d680 0x7fa1a00c9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:10.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:10.378+0000 7fa19f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1a015d680 0x7fa1a00c9520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:49986/0 (socket says 172.21.15.53:49986) 2023-06-10T19:07:10.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:10.378+0000 7fa19f7fe640 1 -- 172.21.15.53:0/209351596 learned_addr learned my addr 172.21.15.53:0/209351596 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:10.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:10.378+0000 7fa19effd640 1 --2- 172.21.15.53:0/209351596 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1a00cf180 0x7fa1a0151450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:10.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:10.378+0000 7fa19e7fc640 1 --2- 172.21.15.53:0/209351596 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1a0159450 0x7fa1a0154740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:10.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:10.378+0000 7fa19f7fe640 1 -- 172.21.15.53:0/209351596 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1a00cf180 msgr2=0x7fa1a0151450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:10.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:10.378+0000 7fa19f7fe640 1 --2- 172.21.15.53:0/209351596 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1a00cf180 0x7fa1a0151450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:10.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:10.378+0000 7fa19f7fe640 1 -- 172.21.15.53:0/209351596 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1a0159450 msgr2=0x7fa1a0154740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:10.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:10.378+0000 7fa19f7fe640 1 --2- 172.21.15.53:0/209351596 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1a0159450 0x7fa1a0154740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:10.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:10.378+0000 7fa19f7fe640 1 -- 172.21.15.53:0/209351596 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa188009420 con 0x7fa1a015d680 2023-06-10T19:07:10.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:10.378+0000 7fa19f7fe640 1 --2- 172.21.15.53:0/209351596 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1a015d680 0x7fa1a00c9520 secure :-1 s=READY pgs=2359 cs=0 l=1 rev1=1 crypto rx=0x7fa19800c780 tx=0x7fa19800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:10.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:10.378+0000 7fa197fff640 1 -- 172.21.15.53:0/209351596 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa19800ce90 con 0x7fa1a015d680 2023-06-10T19:07:10.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:10.378+0000 7fa197fff640 1 -- 172.21.15.53:0/209351596 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa19800a640 con 0x7fa1a015d680 2023-06-10T19:07:10.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:10.378+0000 7fa1a59d4640 1 -- 172.21.15.53:0/209351596 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1a0152d30 con 0x7fa1a015d680 2023-06-10T19:07:10.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:10.378+0000 7fa197fff640 1 -- 172.21.15.53:0/209351596 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa19800a9d0 con 0x7fa1a015d680 2023-06-10T19:07:10.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:10.378+0000 7fa1a59d4640 1 -- 172.21.15.53:0/209351596 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1a00c9a60 con 0x7fa1a015d680 2023-06-10T19:07:10.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:10.378+0000 7fa1a59d4640 1 -- 172.21.15.53:0/209351596 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1a0153530 con 0x7fa1a015d680 2023-06-10T19:07:10.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:10.382+0000 7fa197fff640 1 -- 172.21.15.53:0/209351596 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa19800ab30 con 0x7fa1a015d680 2023-06-10T19:07:10.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:10.382+0000 7fa197fff640 1 --2- 172.21.15.53:0/209351596 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa180066280 0x7fa180068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:10.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:10.382+0000 7fa197fff640 1 -- 172.21.15.53:0/209351596 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fa1980830e0 con 0x7fa1a015d680 2023-06-10T19:07:10.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:10.382+0000 7fa19effd640 1 --2- 172.21.15.53:0/209351596 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa180066280 0x7fa180068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:10.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:10.382+0000 7fa19effd640 1 --2- 172.21.15.53:0/209351596 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa180066280 0x7fa180068730 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7fa1a01526a0 tx=0x7fa190009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:10.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:10.386+0000 7fa197fff640 1 -- 172.21.15.53:0/209351596 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa1a0153530 con 0x7fa1a015d680 2023-06-10T19:07:10.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:10.554+0000 7fa1a59d4640 1 -- 172.21.15.53:0/209351596 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fa1a0153530 con 0x7fa1a015d680 2023-06-10T19:07:11.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.366+0000 7fa197fff640 1 -- 172.21.15.53:0/209351596 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v163) v1 ==== 97+0+0 (secure 0 0 0) 0x7fa1a0153530 con 0x7fa1a015d680 2023-06-10T19:07:11.370 INFO:teuthology.orchestra.run.smithi053.stderr: removed all blocklist entries 2023-06-10T19:07:11.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.370+0000 7fa1a59d4640 1 -- 172.21.15.53:0/209351596 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa180066280 msgr2=0x7fa180068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:11.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.370+0000 7fa1a59d4640 1 --2- 172.21.15.53:0/209351596 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa180066280 0x7fa180068730 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7fa1a01526a0 tx=0x7fa190009190 comp rx=0 tx=0).stop 2023-06-10T19:07:11.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.370+0000 7fa1a59d4640 1 -- 172.21.15.53:0/209351596 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1a015d680 msgr2=0x7fa1a00c9520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:11.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.370+0000 7fa1a59d4640 1 --2- 172.21.15.53:0/209351596 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1a015d680 0x7fa1a00c9520 secure :-1 s=READY pgs=2359 cs=0 l=1 rev1=1 crypto rx=0x7fa19800c780 tx=0x7fa19800cc40 comp rx=0 tx=0).stop 2023-06-10T19:07:11.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.370+0000 7fa1a59d4640 1 -- 172.21.15.53:0/209351596 shutdown_connections 2023-06-10T19:07:11.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.370+0000 7fa1a59d4640 1 --2- 172.21.15.53:0/209351596 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa180066280 0x7fa180068730 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:11.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.370+0000 7fa1a59d4640 1 --2- 172.21.15.53:0/209351596 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1a015d680 0x7fa1a00c9520 unknown :-1 s=CLOSED pgs=2359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:11.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.370+0000 7fa1a59d4640 1 --2- 172.21.15.53:0/209351596 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1a0159450 0x7fa1a0154740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:11.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.370+0000 7fa1a59d4640 1 --2- 172.21.15.53:0/209351596 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1a00cf180 0x7fa1a0151450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:11.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.370+0000 7fa1a59d4640 1 -- 172.21.15.53:0/209351596 >> 172.21.15.53:0/209351596 conn(0x7fa1a006a0b0 msgr2=0x7fa1a00af8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:11.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.370+0000 7fa1a59d4640 1 -- 172.21.15.53:0/209351596 shutdown_connections 2023-06-10T19:07:11.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.370+0000 7fa1a59d4640 1 -- 172.21.15.53:0/209351596 wait complete. 2023-06-10T19:07:11.392 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-06-10T19:07:11.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.518+0000 7f1e2cce0640 1 Processor -- start 2023-06-10T19:07:11.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.518+0000 7f1e2cce0640 1 -- start start 2023-06-10T19:07:11.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.518+0000 7f1e2cce0640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1e280c8d00 0x7f1e2806b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:11.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.518+0000 7f1e2cce0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e2806bc00 0x7f1e28162180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:11.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.518+0000 7f1e2cce0640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e28158a90 con 0x7f1e2806b2f0 2023-06-10T19:07:11.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.518+0000 7f1e2cce0640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e2806f780 con 0x7f1e280c8d00 2023-06-10T19:07:11.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.518+0000 7f1e2cce0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e280705d0 con 0x7f1e2806bc00 2023-06-10T19:07:11.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.518+0000 7f1e25d9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1e280c8d00 0x7f1e2806b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:11.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.518+0000 7f1e2659c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f1e2806b2f0 0x7f1e2806f070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:55174/0 (socket says 172.21.15.53:55174) 2023-06-10T19:07:11.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.518+0000 7f1e2659c640 1 -- 172.21.15.53:0/3241646697 learned_addr learned my addr 172.21.15.53:0/3241646697 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:07:11.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.518+0000 7f1e25d9b640 1 -- 172.21.15.53:0/3241646697 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e2806bc00 msgr2=0x7f1e28162180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:11.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.518+0000 7f1e26d9d640 1 --2- 172.21.15.53:0/3241646697 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e2806bc00 0x7f1e28162180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:11.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.518+0000 7f1e25d9b640 1 --2- 172.21.15.53:0/3241646697 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e2806bc00 0x7f1e28162180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:11.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.518+0000 7f1e2559a640 1 -- 172.21.15.53:0/3241646697 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2688883550 0 0) 0x7f1e18001120 con 0x7f1e2806b2f0 2023-06-10T19:07:11.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.518+0000 7f1e25d9b640 1 -- 172.21.15.53:0/3241646697 >> v1:172.21.15.53:6789/0 conn(0x7f1e2806b2f0 legacy=0x7f1e2806f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:11.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.518+0000 7f1e25d9b640 1 -- 172.21.15.53:0/3241646697 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e280cce10 con 0x7f1e280c8d00 2023-06-10T19:07:11.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.522+0000 7f1e25d9b640 1 --2- 172.21.15.53:0/3241646697 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e280c8d00 0x7f1e2806b6c0 secure :-1 s=READY pgs=2361 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c0097c0 tx=0x7f1e1c01ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e115f93d4f02657 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:11.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.522+0000 7f1e2559a640 1 -- 172.21.15.53:0/3241646697 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1c0a8970 con 0x7f1e280c8d00 2023-06-10T19:07:11.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.522+0000 7f1e2559a640 1 -- 172.21.15.53:0/3241646697 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e1c0a8ad0 con 0x7f1e280c8d00 2023-06-10T19:07:11.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.522+0000 7f1e2559a640 1 -- 172.21.15.53:0/3241646697 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1c0a8e60 con 0x7f1e280c8d00 2023-06-10T19:07:11.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.522+0000 7f1e2cce0640 1 -- 172.21.15.53:0/3241646697 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e280c8d00 msgr2=0x7f1e2806b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:11.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.522+0000 7f1e2cce0640 1 --2- 172.21.15.53:0/3241646697 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e280c8d00 0x7f1e2806b6c0 secure :-1 s=READY pgs=2361 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c0097c0 tx=0x7f1e1c01ec70 comp rx=0 tx=0).stop 2023-06-10T19:07:11.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.522+0000 7f1e2cce0640 1 -- 172.21.15.53:0/3241646697 shutdown_connections 2023-06-10T19:07:11.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.522+0000 7f1e2cce0640 1 --2- 172.21.15.53:0/3241646697 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e280c8d00 0x7f1e2806b6c0 unknown :-1 s=CLOSED pgs=2361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:11.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.522+0000 7f1e2cce0640 1 --2- 172.21.15.53:0/3241646697 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e2806bc00 0x7f1e28162180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:11.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.522+0000 7f1e2cce0640 1 -- 172.21.15.53:0/3241646697 >> 172.21.15.53:0/3241646697 conn(0x7f1e2806a0d0 msgr2=0x7f1e280ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:11.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.522+0000 7f1e2cce0640 1 -- 172.21.15.53:0/3241646697 shutdown_connections 2023-06-10T19:07:11.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.522+0000 7f1e2cce0640 1 -- 172.21.15.53:0/3241646697 wait complete. 2023-06-10T19:07:11.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.526+0000 7f1e2cce0640 1 Processor -- start 2023-06-10T19:07:11.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.526+0000 7f1e2cce0640 1 -- start start 2023-06-10T19:07:11.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.526+0000 7f1e2cce0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e2806b2f0 0x7f1e2814dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:11.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.526+0000 7f1e2cce0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e2806bc00 0x7f1e2814e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:11.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.526+0000 7f1e2cce0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e280c8d00 0x7f1e28163d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:11.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.526+0000 7f1e2cce0640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2815b8b0 con 0x7f1e2806b2f0 2023-06-10T19:07:11.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.526+0000 7f1e2cce0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e28159db0 con 0x7f1e2806bc00 2023-06-10T19:07:11.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.526+0000 7f1e2cce0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2815abd0 con 0x7f1e280c8d00 2023-06-10T19:07:11.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.526+0000 7f1e2659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e2806b2f0 0x7f1e2814dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:11.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.526+0000 7f1e2659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e2806b2f0 0x7f1e2814dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33578/0 (socket says 172.21.15.53:33578) 2023-06-10T19:07:11.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.526+0000 7f1e2659c640 1 -- 172.21.15.53:0/3425387642 learned_addr learned my addr 172.21.15.53:0/3425387642 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:11.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.526+0000 7f1e2659c640 1 -- 172.21.15.53:0/3425387642 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e280c8d00 msgr2=0x7f1e28163d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:11.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.526+0000 7f1e26d9d640 1 --2- 172.21.15.53:0/3425387642 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e280c8d00 0x7f1e28163d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:11.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.526+0000 7f1e25d9b640 1 --2- 172.21.15.53:0/3425387642 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e2806bc00 0x7f1e2814e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:11.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.526+0000 7f1e2659c640 1 --2- 172.21.15.53:0/3425387642 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e280c8d00 0x7f1e28163d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:11.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.526+0000 7f1e2659c640 1 -- 172.21.15.53:0/3425387642 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e2806bc00 msgr2=0x7f1e2814e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:11.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.526+0000 7f1e2659c640 1 --2- 172.21.15.53:0/3425387642 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e2806bc00 0x7f1e2814e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:11.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.526+0000 7f1e2659c640 1 -- 172.21.15.53:0/3425387642 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e1c009420 con 0x7f1e2806b2f0 2023-06-10T19:07:11.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.526+0000 7f1e2659c640 1 --2- 172.21.15.53:0/3425387642 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e2806b2f0 0x7f1e2814dd10 secure :-1 s=READY pgs=2362 cs=0 l=1 rev1=1 crypto rx=0x7f1e1800c780 tx=0x7f1e1800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:11.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.526+0000 7f1e16ffd640 1 -- 172.21.15.53:0/3425387642 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e180072d0 con 0x7f1e2806b2f0 2023-06-10T19:07:11.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.526+0000 7f1e16ffd640 1 -- 172.21.15.53:0/3425387642 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e18007450 con 0x7f1e2806b2f0 2023-06-10T19:07:11.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.526+0000 7f1e16ffd640 1 -- 172.21.15.53:0/3425387642 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e180047f0 con 0x7f1e2806b2f0 2023-06-10T19:07:11.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.526+0000 7f1e2cce0640 1 -- 172.21.15.53:0/3425387642 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e28159fc0 con 0x7f1e2806b2f0 2023-06-10T19:07:11.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.526+0000 7f1e2cce0640 1 -- 172.21.15.53:0/3425387642 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e2815a580 con 0x7f1e2806b2f0 2023-06-10T19:07:11.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.526+0000 7f1e2cce0640 1 -- 172.21.15.53:0/3425387642 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e2804d790 con 0x7f1e2806b2f0 2023-06-10T19:07:11.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.526+0000 7f1e16ffd640 1 -- 172.21.15.53:0/3425387642 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1e18004950 con 0x7f1e2806b2f0 2023-06-10T19:07:11.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.526+0000 7f1e16ffd640 1 --2- 172.21.15.53:0/3425387642 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1e080662b0 0x7f1e08068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:11.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.526+0000 7f1e16ffd640 1 -- 172.21.15.53:0/3425387642 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f1e18082b00 con 0x7f1e2806b2f0 2023-06-10T19:07:11.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.530+0000 7f1e25d9b640 1 --2- 172.21.15.53:0/3425387642 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1e080662b0 0x7f1e08068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:11.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.530+0000 7f1e25d9b640 1 --2- 172.21.15.53:0/3425387642 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1e080662b0 0x7f1e08068760 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c0b2000 tx=0x7f1e1c0aa070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:11.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.530+0000 7f1e16ffd640 1 -- 172.21.15.53:0/3425387642 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1e18084e60 con 0x7f1e2806b2f0 2023-06-10T19:07:11.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.738+0000 7f1e2cce0640 1 -- 172.21.15.53:0/3425387642 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f1e2815a920 con 0x7f1e2806b2f0 2023-06-10T19:07:11.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.742+0000 7f1e16ffd640 1 -- 172.21.15.53:0/3425387642 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v21) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f1e18018020 con 0x7f1e2806b2f0 2023-06-10T19:07:11.743 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:07:11.743 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-06-10T19:07:11.743 INFO:teuthology.orchestra.run.smithi053.stdout: "auth_dump": [ 2023-06-10T19:07:11.743 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:07:11.743 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.a", 2023-06-10T19:07:11.743 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkWqEQBhAAW+iEw0Gxfw744rsYc/tfTQ==", 2023-06-10T19:07:11.744 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:07:11.744 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T19:07:11.744 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2023-06-10T19:07:11.744 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2023-06-10T19:07:11.744 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:07:11.744 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:07:11.744 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:07:11.745 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:07:11.745 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.b", 2023-06-10T19:07:11.745 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkSu02FRAAFpo6NpcwDLZUt2Rgk/wm8w==", 2023-06-10T19:07:11.745 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:07:11.745 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T19:07:11.745 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2023-06-10T19:07:11.745 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2023-06-10T19:07:11.746 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:07:11.746 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:07:11.746 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:07:11.746 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:07:11.746 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.c", 2023-06-10T19:07:11.746 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRk19/ODhAAodfGGNLP7UbNhHySgaukrg==", 2023-06-10T19:07:11.747 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:07:11.747 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T19:07:11.747 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2023-06-10T19:07:11.747 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2023-06-10T19:07:11.747 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:07:11.747 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:07:11.747 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:07:11.747 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:07:11.748 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.d", 2023-06-10T19:07:11.748 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkogwkGxAAIavVKa8GtML1XQDEMwwokQ==", 2023-06-10T19:07:11.748 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:07:11.748 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T19:07:11.748 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2023-06-10T19:07:11.748 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2023-06-10T19:07:11.748 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:07:11.749 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:07:11.749 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:07:11.749 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:07:11.749 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.0", 2023-06-10T19:07:11.749 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA7xoRkoj1OMhAAYFc4W5kAlMBqY2yzeJZXQw==", 2023-06-10T19:07:11.749 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:07:11.749 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T19:07:11.750 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T19:07:11.750 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:07:11.750 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:07:11.750 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:07:11.750 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:07:11.750 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.1", 2023-06-10T19:07:11.750 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA+xoRk6FpDOBAALjxW3eaIh3Gu9b1rmMmqfw==", 2023-06-10T19:07:11.750 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:07:11.751 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T19:07:11.751 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T19:07:11.751 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:07:11.751 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:07:11.751 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:07:11.751 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:07:11.751 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.2", 2023-06-10T19:07:11.751 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBCxoRkaO2GBRAA0Xr5en+n5DxhZDg8kVswpQ==", 2023-06-10T19:07:11.752 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:07:11.752 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T19:07:11.752 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T19:07:11.752 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:07:11.752 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:07:11.752 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:07:11.752 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:07:11.753 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.3", 2023-06-10T19:07:11.753 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBFxoRkjfsBDhAAArYYrPnmXu5VcUMGVjQXZg==", 2023-06-10T19:07:11.753 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:07:11.753 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T19:07:11.753 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T19:07:11.753 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:07:11.753 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:07:11.753 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:07:11.754 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:07:11.754 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.4", 2023-06-10T19:07:11.754 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBLxoRkybumChAAdym/nl9bzyI71flvuy9Vtw==", 2023-06-10T19:07:11.754 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:07:11.754 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T19:07:11.755 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T19:07:11.755 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:07:11.755 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:07:11.755 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:07:11.755 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:07:11.755 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.5", 2023-06-10T19:07:11.755 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBOxoRkinSGIRAAwLbgYKI4NsbHKqGo9O4WuQ==", 2023-06-10T19:07:11.756 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:07:11.756 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T19:07:11.756 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T19:07:11.756 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:07:11.756 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:07:11.756 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:07:11.757 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:07:11.757 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.6", 2023-06-10T19:07:11.757 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBRxoRkj7VlKRAAs2ReBZ5iqtr17Nli9kUtGQ==", 2023-06-10T19:07:11.757 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:07:11.757 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T19:07:11.757 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T19:07:11.757 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:07:11.758 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:07:11.758 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:07:11.758 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:07:11.758 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.7", 2023-06-10T19:07:11.758 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBUxoRk48CnMhAASfbeuCo9jDuHQrYDQ8Vt3A==", 2023-06-10T19:07:11.758 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:07:11.758 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T19:07:11.758 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T19:07:11.759 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:07:11.759 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:07:11.759 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:07:11.759 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:07:11.759 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.0", 2023-06-10T19:07:11.759 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkgey1IBAAkNYrXMgUOnavBY/5uGyFrw==", 2023-06-10T19:07:11.759 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:07:11.760 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T19:07:11.760 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow r", 2023-06-10T19:07:11.760 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-06-10T19:07:11.760 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:07:11.760 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:07:11.761 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:07:11.761 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.1", 2023-06-10T19:07:11.761 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkBw+UKBAAuvT+vXmJLG5CvQVg5xItDQ==", 2023-06-10T19:07:11.761 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:07:11.761 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T19:07:11.761 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow r", 2023-06-10T19:07:11.761 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow rw", 2023-06-10T19:07:11.761 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rwx" 2023-06-10T19:07:11.762 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:07:11.762 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:07:11.762 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:07:11.762 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.2", 2023-06-10T19:07:11.762 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkewjeJRAA4pmIEVJ3Z7GKQFmA54CZ5Q==", 2023-06-10T19:07:11.762 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:07:11.762 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T19:07:11.763 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow r", 2023-06-10T19:07:11.763 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow rw", 2023-06-10T19:07:11.763 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rwx" 2023-06-10T19:07:11.763 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:07:11.763 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:07:11.764 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:07:11.764 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.3", 2023-06-10T19:07:11.764 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkHwCiLRAAWGt8UoWxGlG1Y1zSPbKUCg==", 2023-06-10T19:07:11.765 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:07:11.765 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T19:07:11.765 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow r", 2023-06-10T19:07:11.765 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow rw", 2023-06-10T19:07:11.766 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rwx" 2023-06-10T19:07:11.766 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:07:11.766 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:07:11.766 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:07:11.767 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.admin", 2023-06-10T19:07:11.767 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA5xoRkIVgrKBAABIxiaOPe9h5ne2y2l50aMg==", 2023-06-10T19:07:11.767 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:07:11.768 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow *", 2023-06-10T19:07:11.768 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2023-06-10T19:07:11.768 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2023-06-10T19:07:11.768 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:07:11.769 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:07:11.769 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:07:11.769 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:07:11.769 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mgr.x", 2023-06-10T19:07:11.770 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkzWG3AhAAh3NFYHAbp4fgn4FZeRRNuw==", 2023-06-10T19:07:11.770 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:07:11.770 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow *", 2023-06-10T19:07:11.770 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile mgr", 2023-06-10T19:07:11.771 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:07:11.771 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:07:11.771 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:07:11.771 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:07:11.772 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mgr.y", 2023-06-10T19:07:11.772 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA5xoRkBriKOxAA6G+T7Yp2rH7XV7z37lvMYQ==", 2023-06-10T19:07:11.772 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:07:11.772 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow *", 2023-06-10T19:07:11.773 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile mgr", 2023-06-10T19:07:11.773 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:07:11.773 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:07:11.773 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:07:11.773 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2023-06-10T19:07:11.773 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-06-10T19:07:11.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.742+0000 7f1e2cce0640 1 -- 172.21.15.53:0/3425387642 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1e080662b0 msgr2=0x7f1e08068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:11.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.742+0000 7f1e2cce0640 1 --2- 172.21.15.53:0/3425387642 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1e080662b0 0x7f1e08068760 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c0b2000 tx=0x7f1e1c0aa070 comp rx=0 tx=0).stop 2023-06-10T19:07:11.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.742+0000 7f1e2cce0640 1 -- 172.21.15.53:0/3425387642 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e2806b2f0 msgr2=0x7f1e2814dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:11.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.742+0000 7f1e2cce0640 1 --2- 172.21.15.53:0/3425387642 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e2806b2f0 0x7f1e2814dd10 secure :-1 s=READY pgs=2362 cs=0 l=1 rev1=1 crypto rx=0x7f1e1800c780 tx=0x7f1e1800cc40 comp rx=0 tx=0).stop 2023-06-10T19:07:11.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.742+0000 7f1e2cce0640 1 -- 172.21.15.53:0/3425387642 shutdown_connections 2023-06-10T19:07:11.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.742+0000 7f1e2cce0640 1 --2- 172.21.15.53:0/3425387642 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1e080662b0 0x7f1e08068760 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:11.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.742+0000 7f1e2cce0640 1 --2- 172.21.15.53:0/3425387642 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1e280c8d00 0x7f1e28163d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:11.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.742+0000 7f1e2cce0640 1 --2- 172.21.15.53:0/3425387642 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e2806bc00 0x7f1e2814e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:11.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.742+0000 7f1e2cce0640 1 --2- 172.21.15.53:0/3425387642 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e2806b2f0 0x7f1e2814dd10 unknown :-1 s=CLOSED pgs=2362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:11.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.742+0000 7f1e2cce0640 1 -- 172.21.15.53:0/3425387642 >> 172.21.15.53:0/3425387642 conn(0x7f1e2806a0d0 msgr2=0x7f1e280ade30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:11.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.742+0000 7f1e2cce0640 1 -- 172.21.15.53:0/3425387642 shutdown_connections 2023-06-10T19:07:11.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.742+0000 7f1e2cce0640 1 -- 172.21.15.53:0/3425387642 wait complete. 2023-06-10T19:07:11.777 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:07:11.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.902+0000 7fa2c75f2640 1 Processor -- start 2023-06-10T19:07:11.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.902+0000 7fa2c75f2640 1 -- start start 2023-06-10T19:07:11.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.902+0000 7fa2c75f2640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa2c00b3390 0x7fa2c00af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:11.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.906+0000 7fa2c75f2640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2c00712b0 con 0x7fa2c006b090 2023-06-10T19:07:11.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.906+0000 7fa2c75f2640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2c00b3760 con 0x7fa2c0070e30 2023-06-10T19:07:11.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.906+0000 7fa2c75f2640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2c00c82f0 con 0x7fa2c00b3390 2023-06-10T19:07:11.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.906+0000 7fa2c5b8f640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fa2c006b090 0x7fa2c00c9800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:55186/0 (socket says 172.21.15.53:55186) 2023-06-10T19:07:11.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.906+0000 7fa2c5b8f640 1 -- 172.21.15.53:0/270387880 learned_addr learned my addr 172.21.15.53:0/270387880 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:07:11.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.906+0000 7fa2c538e640 1 --2- 172.21.15.53:0/270387880 >> v2:172.21.15.117:3300/0 conn(0x7fa2c00b3390 0x7fa2c00af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:11.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.906+0000 7fa2b7fff640 1 -- 172.21.15.53:0/270387880 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 241425793 0 0) 0x7fa2c00712b0 con 0x7fa2c006b090 2023-06-10T19:07:11.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.906+0000 7fa2b7fff640 1 -- 172.21.15.53:0/270387880 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2ac003530 con 0x7fa2c006b090 2023-06-10T19:07:11.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.906+0000 7fa2b7fff640 1 -- 172.21.15.53:0/270387880 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 815837857 0 0) 0x7fa2ac003530 con 0x7fa2c006b090 2023-06-10T19:07:11.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.906+0000 7fa2b7fff640 1 -- 172.21.15.53:0/270387880 >> v2:172.21.15.117:3300/0 conn(0x7fa2c00b3390 msgr2=0x7fa2c00af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:11.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.906+0000 7fa2b7fff640 1 --2- 172.21.15.53:0/270387880 >> v2:172.21.15.117:3300/0 conn(0x7fa2c00b3390 0x7fa2c00af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:11.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.906+0000 7fa2b7fff640 1 -- 172.21.15.53:0/270387880 >> v1:172.21.15.117:6789/0 conn(0x7fa2c0070e30 legacy=0x7fa2c00c8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:11.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.906+0000 7fa2b7fff640 1 -- 172.21.15.53:0/270387880 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2c00afe20 con 0x7fa2c006b090 2023-06-10T19:07:11.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.906+0000 7fa2b7fff640 1 -- 172.21.15.53:0/270387880 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fa2b8001a00 con 0x7fa2c006b090 2023-06-10T19:07:11.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.906+0000 7fa2c538e640 1 --2- 172.21.15.53:0/270387880 >> v2:172.21.15.117:3300/0 conn(0x7fa2c00b3390 0x7fa2c00af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:07:11.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.906+0000 7fa2b7fff640 1 -- 172.21.15.53:0/270387880 >> v1:172.21.15.53:6789/0 conn(0x7fa2c006b090 legacy=0x7fa2c00c9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:11.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.906+0000 7fa2b7fff640 1 --2- 172.21.15.53:0/270387880 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2ac0039f0 0x7fa2ac003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:11.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.906+0000 7fa2b7fff640 1 --2- 172.21.15.53:0/270387880 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2ac0047d0 0x7fa2ac004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:11.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.906+0000 7fa2b7fff640 1 --2- 172.21.15.53:0/270387880 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2ac0051f0 0x7fa2ac00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:11.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.906+0000 7fa2b7fff640 1 -- 172.21.15.53:0/270387880 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c00c82f0 con 0x7fa2ac0039f0 2023-06-10T19:07:11.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.906+0000 7fa2b7fff640 1 -- 172.21.15.53:0/270387880 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ac00c130 con 0x7fa2ac0047d0 2023-06-10T19:07:11.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.906+0000 7fa2b7fff640 1 -- 172.21.15.53:0/270387880 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ac00c2f0 con 0x7fa2ac0051f0 2023-06-10T19:07:11.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.906+0000 7fa2c538e640 1 --2- 172.21.15.53:0/270387880 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2ac0039f0 0x7fa2ac003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:11.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.906+0000 7fa2c4b8d640 1 --2- 172.21.15.53:0/270387880 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2ac0047d0 0x7fa2ac004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:11.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.906+0000 7fa2c5b8f640 1 --2- 172.21.15.53:0/270387880 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2ac0051f0 0x7fa2ac00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:11.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.906+0000 7fa2c538e640 1 -- 172.21.15.53:0/270387880 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2ac0051f0 msgr2=0x7fa2ac00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:11.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.906+0000 7fa2c538e640 1 --2- 172.21.15.53:0/270387880 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2ac0051f0 0x7fa2ac00b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:11.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.906+0000 7fa2c538e640 1 -- 172.21.15.53:0/270387880 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2ac0047d0 msgr2=0x7fa2ac004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:11.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.906+0000 7fa2c538e640 1 --2- 172.21.15.53:0/270387880 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2ac0047d0 0x7fa2ac004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:11.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.906+0000 7fa2c538e640 1 -- 172.21.15.53:0/270387880 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2ac003530 con 0x7fa2ac0039f0 2023-06-10T19:07:11.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.906+0000 7fa2c5b8f640 1 -- 172.21.15.53:0/270387880 reap_dead start 2023-06-10T19:07:11.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.906+0000 7fa2c538e640 1 --2- 172.21.15.53:0/270387880 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2ac0039f0 0x7fa2ac003e00 secure :-1 s=READY pgs=2364 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc0098d0 tx=0x7fa2bc01c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36f466d273442c04 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:11.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.906+0000 7fa2b7fff640 1 -- 172.21.15.53:0/270387880 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2bc0ab5f0 con 0x7fa2ac0039f0 2023-06-10T19:07:11.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.910+0000 7fa2b7fff640 1 -- 172.21.15.53:0/270387880 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2bc0ab750 con 0x7fa2ac0039f0 2023-06-10T19:07:11.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.910+0000 7fa2b7fff640 1 -- 172.21.15.53:0/270387880 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2bc0abac0 con 0x7fa2ac0039f0 2023-06-10T19:07:11.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.910+0000 7fa2c75f2640 1 -- 172.21.15.53:0/270387880 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2ac0039f0 msgr2=0x7fa2ac003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:11.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.910+0000 7fa2c75f2640 1 --2- 172.21.15.53:0/270387880 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2ac0039f0 0x7fa2ac003e00 secure :-1 s=READY pgs=2364 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc0098d0 tx=0x7fa2bc01c4e0 comp rx=0 tx=0).stop 2023-06-10T19:07:11.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.910+0000 7fa2c75f2640 1 -- 172.21.15.53:0/270387880 shutdown_connections 2023-06-10T19:07:11.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.910+0000 7fa2c75f2640 1 --2- 172.21.15.53:0/270387880 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2ac0039f0 0x7fa2ac003e00 unknown :-1 s=CLOSED pgs=2364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:11.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.910+0000 7fa2c75f2640 1 -- 172.21.15.53:0/270387880 >> 172.21.15.53:0/270387880 conn(0x7fa2c006a0d0 msgr2=0x7fa2c00ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:11.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.910+0000 7fa2c75f2640 1 -- 172.21.15.53:0/270387880 shutdown_connections 2023-06-10T19:07:11.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.910+0000 7fa2c75f2640 1 -- 172.21.15.53:0/270387880 wait complete. 2023-06-10T19:07:11.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.910+0000 7fa2c75f2640 1 Processor -- start 2023-06-10T19:07:11.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.910+0000 7fa2c75f2640 1 -- start start 2023-06-10T19:07:11.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.910+0000 7fa2c75f2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2ac0039f0 0x7fa2c00c4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:11.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.910+0000 7fa2c75f2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2c01506a0 0x7fa2c00c21c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:11.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.910+0000 7fa2c75f2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2c015bd20 0x7fa2c015c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:11.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.910+0000 7fa2c75f2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c015c6d0 con 0x7fa2c015bd20 2023-06-10T19:07:11.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.910+0000 7fa2c75f2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c00cb870 con 0x7fa2c01506a0 2023-06-10T19:07:11.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.910+0000 7fa2c75f2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c00cbb30 con 0x7fa2ac0039f0 2023-06-10T19:07:11.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.910+0000 7fa2c5b8f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2c015bd20 0x7fa2c015c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:11.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.910+0000 7fa2c5b8f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2c015bd20 0x7fa2c015c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33604/0 (socket says 172.21.15.53:33604) 2023-06-10T19:07:11.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.910+0000 7fa2c5b8f640 1 -- 172.21.15.53:0/825888038 learned_addr learned my addr 172.21.15.53:0/825888038 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:11.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.910+0000 7fa2c4b8d640 1 --2- 172.21.15.53:0/825888038 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2c01506a0 0x7fa2c00c21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:11.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.910+0000 7fa2c538e640 1 --2- 172.21.15.53:0/825888038 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2ac0039f0 0x7fa2c00c4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:11.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.910+0000 7fa2c5b8f640 1 -- 172.21.15.53:0/825888038 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2ac0039f0 msgr2=0x7fa2c00c4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:11.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.910+0000 7fa2c5b8f640 1 --2- 172.21.15.53:0/825888038 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2ac0039f0 0x7fa2c00c4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:11.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.910+0000 7fa2c5b8f640 1 -- 172.21.15.53:0/825888038 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2c01506a0 msgr2=0x7fa2c00c21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:11.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.910+0000 7fa2c5b8f640 1 --2- 172.21.15.53:0/825888038 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2c01506a0 0x7fa2c00c21c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:11.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.910+0000 7fa2c5b8f640 1 -- 172.21.15.53:0/825888038 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2c00cbe10 con 0x7fa2c015bd20 2023-06-10T19:07:11.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.910+0000 7fa2c4b8d640 1 --2- 172.21.15.53:0/825888038 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2c01506a0 0x7fa2c00c21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:07:11.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.910+0000 7fa2c5b8f640 1 --2- 172.21.15.53:0/825888038 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2c015bd20 0x7fa2c015c190 secure :-1 s=READY pgs=2365 cs=0 l=1 rev1=1 crypto rx=0x7fa2c00cb820 tx=0x7fa2b800dbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:11.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.910+0000 7fa2b5ffb640 1 -- 172.21.15.53:0/825888038 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b8007070 con 0x7fa2c015bd20 2023-06-10T19:07:11.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.910+0000 7fa2b5ffb640 1 -- 172.21.15.53:0/825888038 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2b80071f0 con 0x7fa2c015bd20 2023-06-10T19:07:11.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.910+0000 7fa2c75f2640 1 -- 172.21.15.53:0/825888038 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2c00cc0f0 con 0x7fa2c015bd20 2023-06-10T19:07:11.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.910+0000 7fa2b5ffb640 1 -- 172.21.15.53:0/825888038 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b80075a0 con 0x7fa2c015bd20 2023-06-10T19:07:11.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.910+0000 7fa2c75f2640 1 -- 172.21.15.53:0/825888038 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2c00cc6b0 con 0x7fa2c015bd20 2023-06-10T19:07:11.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.914+0000 7fa2c75f2640 1 -- 172.21.15.53:0/825888038 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2c004d790 con 0x7fa2c015bd20 2023-06-10T19:07:11.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.914+0000 7fa2b5ffb640 1 -- 172.21.15.53:0/825888038 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa2b8007700 con 0x7fa2c015bd20 2023-06-10T19:07:11.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.914+0000 7fa2b5ffb640 1 --2- 172.21.15.53:0/825888038 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa2a4066280 0x7fa2a4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:11.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.914+0000 7fa2b5ffb640 1 -- 172.21.15.53:0/825888038 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fa2b8083380 con 0x7fa2c015bd20 2023-06-10T19:07:11.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.914+0000 7fa2c538e640 1 --2- 172.21.15.53:0/825888038 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa2a4066280 0x7fa2a4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:11.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.914+0000 7fa2c538e640 1 --2- 172.21.15.53:0/825888038 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa2a4066280 0x7fa2a4068730 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc0af000 tx=0x7fa2bc0b6040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:11.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:11.918+0000 7fa2b5ffb640 1 -- 172.21.15.53:0/825888038 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa2b8050b50 con 0x7fa2c015bd20 2023-06-10T19:07:12.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.074+0000 7fa2c75f2640 1 -- 172.21.15.53:0/825888038 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa2c00cb3f0 con 0x7fa2c015bd20 2023-06-10T19:07:12.079 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.078+0000 7fa2b5ffb640 1 -- 172.21.15.53:0/825888038 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v163) v1 ==== 74+0+14637 (secure 0 0 0) 0x7fa2b8054170 con 0x7fa2c015bd20 2023-06-10T19:07:12.079 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:07:12.079 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":163,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:07:11.360333+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:07:12.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.078+0000 7fa2c75f2640 1 -- 172.21.15.53:0/825888038 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa2a4066280 msgr2=0x7fa2a4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:12.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.078+0000 7fa2c75f2640 1 --2- 172.21.15.53:0/825888038 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa2a4066280 0x7fa2a4068730 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc0af000 tx=0x7fa2bc0b6040 comp rx=0 tx=0).stop 2023-06-10T19:07:12.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.078+0000 7fa2c75f2640 1 -- 172.21.15.53:0/825888038 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2c015bd20 msgr2=0x7fa2c015c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:12.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.078+0000 7fa2c75f2640 1 --2- 172.21.15.53:0/825888038 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2c015bd20 0x7fa2c015c190 secure :-1 s=READY pgs=2365 cs=0 l=1 rev1=1 crypto rx=0x7fa2c00cb820 tx=0x7fa2b800dbd0 comp rx=0 tx=0).stop 2023-06-10T19:07:12.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.078+0000 7fa2c75f2640 1 -- 172.21.15.53:0/825888038 shutdown_connections 2023-06-10T19:07:12.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.078+0000 7fa2c75f2640 1 --2- 172.21.15.53:0/825888038 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa2a4066280 0x7fa2a4068730 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:12.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.078+0000 7fa2c75f2640 1 --2- 172.21.15.53:0/825888038 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2c015bd20 0x7fa2c015c190 unknown :-1 s=CLOSED pgs=2365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:12.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.078+0000 7fa2c75f2640 1 --2- 172.21.15.53:0/825888038 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2c01506a0 0x7fa2c00c21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:12.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.078+0000 7fa2c75f2640 1 --2- 172.21.15.53:0/825888038 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2ac0039f0 0x7fa2c00c4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:12.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.078+0000 7fa2c75f2640 1 -- 172.21.15.53:0/825888038 >> 172.21.15.53:0/825888038 conn(0x7fa2c006a0d0 msgr2=0x7fa2c00b1470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:12.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.078+0000 7fa2c75f2640 1 -- 172.21.15.53:0/825888038 shutdown_connections 2023-06-10T19:07:12.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.078+0000 7fa2c75f2640 1 -- 172.21.15.53:0/825888038 wait complete. 2023-06-10T19:07:12.099 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-10T18:52:33.633114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-10T18:52:39.171487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-10T19:07:12.100 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-10T19:07:12.232 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.230+0000 7fded8ee2640 1 Processor -- start 2023-06-10T19:07:12.232 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.230+0000 7fded8ee2640 1 -- start start 2023-06-10T19:07:12.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.230+0000 7fded8ee2640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fded415c090 0x7fded40b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:12.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.230+0000 7fded8ee2640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fded40b7e30 0x7fded40d04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:12.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.230+0000 7fded8ee2640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fded40cc7c0 con 0x7fded40b0b90 2023-06-10T19:07:12.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.230+0000 7fded8ee2640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fded40ccaa0 con 0x7fded40b7e30 2023-06-10T19:07:12.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.230+0000 7fded8ee2640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fded40ccd80 con 0x7fded415c090 2023-06-10T19:07:12.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.230+0000 7fded2d9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fded40b7e30 0x7fded40d04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:12.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.230+0000 7fded2d9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fded40b7e30 0x7fded40d04d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33610/0 (socket says 172.21.15.53:33610) 2023-06-10T19:07:12.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.230+0000 7fded2d9d640 1 -- 172.21.15.53:0/497786459 learned_addr learned my addr 172.21.15.53:0/497786459 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:12.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.230+0000 7fded259c640 1 --2- 172.21.15.53:0/497786459 >> v2:172.21.15.117:3300/0 conn(0x7fded415c090 0x7fded40b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:12.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.230+0000 7fded2d9d640 1 -- 172.21.15.53:0/497786459 >> v2:172.21.15.117:3300/0 conn(0x7fded415c090 msgr2=0x7fded40b10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:12.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.230+0000 7fded2d9d640 1 --2- 172.21.15.53:0/497786459 >> v2:172.21.15.117:3300/0 conn(0x7fded415c090 0x7fded40b10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:12.235 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.230+0000 7fded2d9d640 1 -- 172.21.15.53:0/497786459 >> v1:172.21.15.117:6789/0 conn(0x7fded40b0b90 legacy=0x7fded40b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:12.235 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.230+0000 7fded2d9d640 1 -- 172.21.15.53:0/497786459 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fded40cd060 con 0x7fded40b7e30 2023-06-10T19:07:12.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.234+0000 7fded2d9d640 1 --2- 172.21.15.53:0/497786459 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fded40b7e30 0x7fded40d04d0 secure :-1 s=READY pgs=2366 cs=0 l=1 rev1=1 crypto rx=0x7fded408a080 tx=0x7fdecc01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8331f5007d05af8 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:12.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.234+0000 7fded159a640 1 -- 172.21.15.53:0/497786459 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdecc0a5730 con 0x7fded40b7e30 2023-06-10T19:07:12.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.234+0000 7fded159a640 1 -- 172.21.15.53:0/497786459 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdecc0a5890 con 0x7fded40b7e30 2023-06-10T19:07:12.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.234+0000 7fded159a640 1 -- 172.21.15.53:0/497786459 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdecc0a5c20 con 0x7fded40b7e30 2023-06-10T19:07:12.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.234+0000 7fded8ee2640 1 -- 172.21.15.53:0/497786459 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fded40b7e30 msgr2=0x7fded40d04d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:12.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.234+0000 7fded8ee2640 1 --2- 172.21.15.53:0/497786459 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fded40b7e30 0x7fded40d04d0 secure :-1 s=READY pgs=2366 cs=0 l=1 rev1=1 crypto rx=0x7fded408a080 tx=0x7fdecc01c910 comp rx=0 tx=0).stop 2023-06-10T19:07:12.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.234+0000 7fded8ee2640 1 -- 172.21.15.53:0/497786459 shutdown_connections 2023-06-10T19:07:12.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.234+0000 7fded8ee2640 1 --2- 172.21.15.53:0/497786459 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fded40b7e30 0x7fded40d04d0 unknown :-1 s=CLOSED pgs=2366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:12.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.234+0000 7fded8ee2640 1 --2- 172.21.15.53:0/497786459 >> v2:172.21.15.117:3300/0 conn(0x7fded415c090 0x7fded40b10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:12.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.234+0000 7fded8ee2640 1 -- 172.21.15.53:0/497786459 >> 172.21.15.53:0/497786459 conn(0x7fded4069e20 msgr2=0x7fded406a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:12.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.234+0000 7fded8ee2640 1 -- 172.21.15.53:0/497786459 shutdown_connections 2023-06-10T19:07:12.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.234+0000 7fded8ee2640 1 -- 172.21.15.53:0/497786459 wait complete. 2023-06-10T19:07:12.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.234+0000 7fded8ee2640 1 Processor -- start 2023-06-10T19:07:12.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.234+0000 7fded8ee2640 1 -- start start 2023-06-10T19:07:12.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.234+0000 7fded8ee2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fded40b0b90 0x7fded4155aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:12.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.234+0000 7fded8ee2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fded40b7e30 0x7fded414eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:12.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.234+0000 7fded8ee2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fded415c090 0x7fded4157b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:12.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.234+0000 7fded8ee2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded40b5a10 con 0x7fded40b7e30 2023-06-10T19:07:12.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.234+0000 7fded8ee2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded414fac0 con 0x7fded40b0b90 2023-06-10T19:07:12.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.234+0000 7fded8ee2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fded40c5030 con 0x7fded415c090 2023-06-10T19:07:12.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.234+0000 7fded1d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fded40b7e30 0x7fded414eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:12.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.234+0000 7fded1d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fded40b7e30 0x7fded414eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33622/0 (socket says 172.21.15.53:33622) 2023-06-10T19:07:12.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.234+0000 7fded1d9b640 1 -- 172.21.15.53:0/4110606927 learned_addr learned my addr 172.21.15.53:0/4110606927 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:12.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.234+0000 7fded259c640 1 --2- 172.21.15.53:0/4110606927 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fded40b0b90 0x7fded4155aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:12.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.238+0000 7fded2d9d640 1 --2- 172.21.15.53:0/4110606927 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fded415c090 0x7fded4157b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:12.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.238+0000 7fded1d9b640 1 -- 172.21.15.53:0/4110606927 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fded415c090 msgr2=0x7fded4157b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:12.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.238+0000 7fded1d9b640 1 --2- 172.21.15.53:0/4110606927 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fded415c090 0x7fded4157b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:12.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.238+0000 7fded1d9b640 1 -- 172.21.15.53:0/4110606927 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fded40b0b90 msgr2=0x7fded4155aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:12.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.238+0000 7fded1d9b640 1 --2- 172.21.15.53:0/4110606927 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fded40b0b90 0x7fded4155aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:12.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.238+0000 7fded1d9b640 1 -- 172.21.15.53:0/4110606927 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdecc009b30 con 0x7fded40b7e30 2023-06-10T19:07:12.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.238+0000 7fded259c640 1 --2- 172.21.15.53:0/4110606927 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fded40b0b90 0x7fded4155aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:07:12.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.238+0000 7fded1d9b640 1 --2- 172.21.15.53:0/4110606927 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fded40b7e30 0x7fded414eb30 secure :-1 s=READY pgs=2367 cs=0 l=1 rev1=1 crypto rx=0x7fdebc00c420 tx=0x7fdebc00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:12.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.238+0000 7fdecaffd640 1 -- 172.21.15.53:0/4110606927 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdebc0052d0 con 0x7fded40b7e30 2023-06-10T19:07:12.243 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.238+0000 7fdecaffd640 1 -- 172.21.15.53:0/4110606927 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdebc005430 con 0x7fded40b7e30 2023-06-10T19:07:12.243 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.238+0000 7fded8ee2640 1 -- 172.21.15.53:0/4110606927 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fded40c4d50 con 0x7fded40b7e30 2023-06-10T19:07:12.243 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.238+0000 7fdecaffd640 1 -- 172.21.15.53:0/4110606927 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdebc003820 con 0x7fded40b7e30 2023-06-10T19:07:12.244 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.238+0000 7fded8ee2640 1 -- 172.21.15.53:0/4110606927 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fded414f5a0 con 0x7fded40b7e30 2023-06-10T19:07:12.245 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.238+0000 7fded8ee2640 1 -- 172.21.15.53:0/4110606927 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fded414f7c0 con 0x7fded40b7e30 2023-06-10T19:07:12.245 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.238+0000 7fdecaffd640 1 -- 172.21.15.53:0/4110606927 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdebc003980 con 0x7fded40b7e30 2023-06-10T19:07:12.245 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.238+0000 7fdecaffd640 1 --2- 172.21.15.53:0/4110606927 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdeb4066280 0x7fdeb4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:12.245 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.238+0000 7fdecaffd640 1 -- 172.21.15.53:0/4110606927 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fdebc082ed0 con 0x7fded40b7e30 2023-06-10T19:07:12.245 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.238+0000 7fded259c640 1 --2- 172.21.15.53:0/4110606927 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdeb4066280 0x7fdeb4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:12.245 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.238+0000 7fded259c640 1 --2- 172.21.15.53:0/4110606927 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdeb4066280 0x7fdeb4068730 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fdec40097a0 tx=0x7fdec4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:12.246 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.242+0000 7fdecaffd640 1 -- 172.21.15.53:0/4110606927 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdebc050730 con 0x7fded40b7e30 2023-06-10T19:07:12.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.390+0000 7fded8ee2640 1 -- 172.21.15.53:0/4110606927 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fded404d790 con 0x7fded40b7e30 2023-06-10T19:07:12.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.394+0000 7fdecaffd640 1 -- 172.21.15.53:0/4110606927 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v163) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdebc017020 con 0x7fded40b7e30 2023-06-10T19:07:12.395 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-06-10T19:07:12.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.394+0000 7fded8ee2640 1 -- 172.21.15.53:0/4110606927 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdeb4066280 msgr2=0x7fdeb4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:12.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.394+0000 7fded8ee2640 1 --2- 172.21.15.53:0/4110606927 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdeb4066280 0x7fdeb4068730 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fdec40097a0 tx=0x7fdec4008040 comp rx=0 tx=0).stop 2023-06-10T19:07:12.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.394+0000 7fded8ee2640 1 -- 172.21.15.53:0/4110606927 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fded40b7e30 msgr2=0x7fded414eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:12.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.394+0000 7fded8ee2640 1 --2- 172.21.15.53:0/4110606927 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fded40b7e30 0x7fded414eb30 secure :-1 s=READY pgs=2367 cs=0 l=1 rev1=1 crypto rx=0x7fdebc00c420 tx=0x7fdebc00c8e0 comp rx=0 tx=0).stop 2023-06-10T19:07:12.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.394+0000 7fded8ee2640 1 -- 172.21.15.53:0/4110606927 shutdown_connections 2023-06-10T19:07:12.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.394+0000 7fded8ee2640 1 --2- 172.21.15.53:0/4110606927 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdeb4066280 0x7fdeb4068730 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:12.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.394+0000 7fded8ee2640 1 --2- 172.21.15.53:0/4110606927 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fded415c090 0x7fded4157b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:12.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.394+0000 7fded8ee2640 1 --2- 172.21.15.53:0/4110606927 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fded40b7e30 0x7fded414eb30 unknown :-1 s=CLOSED pgs=2367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:12.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.394+0000 7fded8ee2640 1 --2- 172.21.15.53:0/4110606927 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fded40b0b90 0x7fded4155aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:12.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.394+0000 7fded8ee2640 1 -- 172.21.15.53:0/4110606927 >> 172.21.15.53:0/4110606927 conn(0x7fded4069e20 msgr2=0x7fded40ce8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:12.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.394+0000 7fded8ee2640 1 -- 172.21.15.53:0/4110606927 shutdown_connections 2023-06-10T19:07:12.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.394+0000 7fded8ee2640 1 -- 172.21.15.53:0/4110606927 wait complete. 2023-06-10T19:07:12.413 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-10T19:07:12.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.538+0000 7ff89bce9640 1 Processor -- start 2023-06-10T19:07:12.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.538+0000 7ff89bce9640 1 -- start start 2023-06-10T19:07:12.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.542+0000 7ff89bce9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8940c9fa0 0x7ff89406bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:12.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.542+0000 7ff89bce9640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff89406c020 0x7ff8940c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:12.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.542+0000 7ff89bce9640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff8940c87e0 0x7ff8940af760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:12.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.542+0000 7ff89bce9640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff89406b090 con 0x7ff89406c020 2023-06-10T19:07:12.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.542+0000 7ff89bce9640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8940ca370 con 0x7ff8940c87e0 2023-06-10T19:07:12.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.542+0000 7ff89bce9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff894070d50 con 0x7ff8940c9fa0 2023-06-10T19:07:12.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.542+0000 7ff899284640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff89406c020 0x7ff8940c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:12.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.542+0000 7ff899284640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff89406c020 0x7ff8940c82a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33638/0 (socket says 172.21.15.53:33638) 2023-06-10T19:07:12.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.542+0000 7ff899284640 1 -- 172.21.15.53:0/1764563219 learned_addr learned my addr 172.21.15.53:0/1764563219 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:12.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.542+0000 7ff89a286640 1 --2- 172.21.15.53:0/1764563219 >> v2:172.21.15.117:3300/0 conn(0x7ff8940c87e0 0x7ff8940af760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:12.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.542+0000 7ff899284640 1 -- 172.21.15.53:0/1764563219 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8940c9fa0 msgr2=0x7ff89406bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:12.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.542+0000 7ff899a85640 1 --2- 172.21.15.53:0/1764563219 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8940c9fa0 0x7ff89406bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:12.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.542+0000 7ff899284640 1 --2- 172.21.15.53:0/1764563219 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8940c9fa0 0x7ff89406bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:12.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.542+0000 7ff899284640 1 -- 172.21.15.53:0/1764563219 >> v2:172.21.15.117:3300/0 conn(0x7ff8940c87e0 msgr2=0x7ff8940af760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:12.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.542+0000 7ff899284640 1 --2- 172.21.15.53:0/1764563219 >> v2:172.21.15.117:3300/0 conn(0x7ff8940c87e0 0x7ff8940af760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:12.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.542+0000 7ff899284640 1 -- 172.21.15.53:0/1764563219 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff894071030 con 0x7ff89406c020 2023-06-10T19:07:12.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.542+0000 7ff899a85640 1 --2- 172.21.15.53:0/1764563219 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8940c9fa0 0x7ff89406bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:07:12.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.542+0000 7ff89a286640 1 --2- 172.21.15.53:0/1764563219 >> v2:172.21.15.117:3300/0 conn(0x7ff8940c87e0 0x7ff8940af760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:07:12.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.546+0000 7ff899284640 1 --2- 172.21.15.53:0/1764563219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff89406c020 0x7ff8940c82a0 secure :-1 s=READY pgs=2368 cs=0 l=1 rev1=1 crypto rx=0x7ff8940c81a0 tx=0x7ff88401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f98cf23a42b5c686 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:12.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.546+0000 7ff898a83640 1 -- 172.21.15.53:0/1764563219 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8840ac640 con 0x7ff89406c020 2023-06-10T19:07:12.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.546+0000 7ff898a83640 1 -- 172.21.15.53:0/1764563219 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8840ac7a0 con 0x7ff89406c020 2023-06-10T19:07:12.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.546+0000 7ff898a83640 1 -- 172.21.15.53:0/1764563219 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8840acb30 con 0x7ff89406c020 2023-06-10T19:07:12.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.546+0000 7ff89bce9640 1 -- 172.21.15.53:0/1764563219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff89406c020 msgr2=0x7ff8940c82a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:12.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.546+0000 7ff89bce9640 1 --2- 172.21.15.53:0/1764563219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff89406c020 0x7ff8940c82a0 secure :-1 s=READY pgs=2368 cs=0 l=1 rev1=1 crypto rx=0x7ff8940c81a0 tx=0x7ff88401c440 comp rx=0 tx=0).stop 2023-06-10T19:07:12.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.546+0000 7ff89bce9640 1 -- 172.21.15.53:0/1764563219 shutdown_connections 2023-06-10T19:07:12.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.546+0000 7ff89bce9640 1 --2- 172.21.15.53:0/1764563219 >> v2:172.21.15.117:3300/0 conn(0x7ff8940c87e0 0x7ff8940af760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:12.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.546+0000 7ff89bce9640 1 --2- 172.21.15.53:0/1764563219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff89406c020 0x7ff8940c82a0 unknown :-1 s=CLOSED pgs=2368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:12.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.546+0000 7ff89bce9640 1 --2- 172.21.15.53:0/1764563219 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8940c9fa0 0x7ff89406bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:12.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.546+0000 7ff89bce9640 1 -- 172.21.15.53:0/1764563219 >> 172.21.15.53:0/1764563219 conn(0x7ff89406a0e0 msgr2=0x7ff8940cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:12.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.546+0000 7ff89bce9640 1 -- 172.21.15.53:0/1764563219 shutdown_connections 2023-06-10T19:07:12.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.546+0000 7ff89bce9640 1 -- 172.21.15.53:0/1764563219 wait complete. 2023-06-10T19:07:12.551 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.546+0000 7ff89bce9640 1 Processor -- start 2023-06-10T19:07:12.551 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.546+0000 7ff89bce9640 1 -- start start 2023-06-10T19:07:12.551 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.546+0000 7ff89bce9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff89406c020 0x7ff894153750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:12.551 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.546+0000 7ff89bce9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8940c87e0 0x7ff8940a7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:12.551 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.546+0000 7ff89bce9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8940c9fa0 0x7ff8940a8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:12.551 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.546+0000 7ff89bce9640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff894155d50 con 0x7ff89406c020 2023-06-10T19:07:12.551 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.546+0000 7ff89bce9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff894156030 con 0x7ff8940c9fa0 2023-06-10T19:07:12.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.546+0000 7ff89bce9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff894156310 con 0x7ff8940c87e0 2023-06-10T19:07:12.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.546+0000 7ff899a85640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff89406c020 0x7ff894153750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:12.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.546+0000 7ff899a85640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff89406c020 0x7ff894153750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33650/0 (socket says 172.21.15.53:33650) 2023-06-10T19:07:12.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.546+0000 7ff899a85640 1 -- 172.21.15.53:0/1776941439 learned_addr learned my addr 172.21.15.53:0/1776941439 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:12.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.546+0000 7ff89a286640 1 --2- 172.21.15.53:0/1776941439 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8940c9fa0 0x7ff8940a8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:12.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.546+0000 7ff899284640 1 --2- 172.21.15.53:0/1776941439 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8940c87e0 0x7ff8940a7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:12.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.546+0000 7ff899a85640 1 -- 172.21.15.53:0/1776941439 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8940c87e0 msgr2=0x7ff8940a7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:12.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.546+0000 7ff899a85640 1 --2- 172.21.15.53:0/1776941439 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8940c87e0 0x7ff8940a7e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:12.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.546+0000 7ff899a85640 1 -- 172.21.15.53:0/1776941439 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8940c9fa0 msgr2=0x7ff8940a8360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:12.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.546+0000 7ff899a85640 1 --2- 172.21.15.53:0/1776941439 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8940c9fa0 0x7ff8940a8360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:12.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.546+0000 7ff899a85640 1 -- 172.21.15.53:0/1776941439 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8840094d0 con 0x7ff89406c020 2023-06-10T19:07:12.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.546+0000 7ff89a286640 1 --2- 172.21.15.53:0/1776941439 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8940c9fa0 0x7ff8940a8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:07:12.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.546+0000 7ff899a85640 1 --2- 172.21.15.53:0/1776941439 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff89406c020 0x7ff894153750 secure :-1 s=READY pgs=2369 cs=0 l=1 rev1=1 crypto rx=0x7ff89000c7c0 tx=0x7ff89000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:12.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.550+0000 7ff88a7fc640 1 -- 172.21.15.53:0/1776941439 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff890007a30 con 0x7ff89406c020 2023-06-10T19:07:12.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.550+0000 7ff88a7fc640 1 -- 172.21.15.53:0/1776941439 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff890007b90 con 0x7ff89406c020 2023-06-10T19:07:12.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.550+0000 7ff89bce9640 1 -- 172.21.15.53:0/1776941439 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8941565f0 con 0x7ff89406c020 2023-06-10T19:07:12.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.550+0000 7ff88a7fc640 1 -- 172.21.15.53:0/1776941439 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89000ce70 con 0x7ff89406c020 2023-06-10T19:07:12.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.550+0000 7ff89bce9640 1 -- 172.21.15.53:0/1776941439 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff894153c90 con 0x7ff89406c020 2023-06-10T19:07:12.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.550+0000 7ff89bce9640 1 -- 172.21.15.53:0/1776941439 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff894156b10 con 0x7ff89406c020 2023-06-10T19:07:12.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.550+0000 7ff88a7fc640 1 -- 172.21.15.53:0/1776941439 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff8900193f0 con 0x7ff89406c020 2023-06-10T19:07:12.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.550+0000 7ff88a7fc640 1 --2- 172.21.15.53:0/1776941439 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff878066280 0x7ff878068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:12.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.550+0000 7ff88a7fc640 1 -- 172.21.15.53:0/1776941439 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ff890083df0 con 0x7ff89406c020 2023-06-10T19:07:12.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.550+0000 7ff899284640 1 --2- 172.21.15.53:0/1776941439 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff878066280 0x7ff878068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:12.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.550+0000 7ff899284640 1 --2- 172.21.15.53:0/1776941439 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff878066280 0x7ff878068730 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7ff8840ae000 tx=0x7ff8840a6070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:12.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.554+0000 7ff88a7fc640 1 -- 172.21.15.53:0/1776941439 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff894156b10 con 0x7ff89406c020 2023-06-10T19:07:12.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.702+0000 7ff89bce9640 1 -- 172.21.15.53:0/1776941439 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff894156b10 con 0x7ff89406c020 2023-06-10T19:07:12.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.706+0000 7ff88a7fc640 1 -- 172.21.15.53:0/1776941439 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v163) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff894156b10 con 0x7ff89406c020 2023-06-10T19:07:12.707 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-06-10T19:07:12.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.706+0000 7ff89bce9640 1 -- 172.21.15.53:0/1776941439 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff878066280 msgr2=0x7ff878068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:12.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.706+0000 7ff89bce9640 1 --2- 172.21.15.53:0/1776941439 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff878066280 0x7ff878068730 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7ff8840ae000 tx=0x7ff8840a6070 comp rx=0 tx=0).stop 2023-06-10T19:07:12.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.706+0000 7ff89bce9640 1 -- 172.21.15.53:0/1776941439 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff89406c020 msgr2=0x7ff894153750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:12.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.706+0000 7ff89bce9640 1 --2- 172.21.15.53:0/1776941439 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff89406c020 0x7ff894153750 secure :-1 s=READY pgs=2369 cs=0 l=1 rev1=1 crypto rx=0x7ff89000c7c0 tx=0x7ff89000cc80 comp rx=0 tx=0).stop 2023-06-10T19:07:12.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.706+0000 7ff89bce9640 1 -- 172.21.15.53:0/1776941439 shutdown_connections 2023-06-10T19:07:12.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.706+0000 7ff89bce9640 1 --2- 172.21.15.53:0/1776941439 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff878066280 0x7ff878068730 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:12.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.706+0000 7ff89bce9640 1 --2- 172.21.15.53:0/1776941439 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8940c9fa0 0x7ff8940a8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:12.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.706+0000 7ff89bce9640 1 --2- 172.21.15.53:0/1776941439 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff8940c87e0 0x7ff8940a7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:12.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.706+0000 7ff89bce9640 1 --2- 172.21.15.53:0/1776941439 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff89406c020 0x7ff894153750 unknown :-1 s=CLOSED pgs=2369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:12.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.706+0000 7ff89bce9640 1 -- 172.21.15.53:0/1776941439 >> 172.21.15.53:0/1776941439 conn(0x7ff89406a0e0 msgr2=0x7ff8940c6d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:12.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.706+0000 7ff89bce9640 1 -- 172.21.15.53:0/1776941439 shutdown_connections 2023-06-10T19:07:12.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.706+0000 7ff89bce9640 1 -- 172.21.15.53:0/1776941439 wait complete. 2023-06-10T19:07:12.725 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-06-10T19:07:12.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.846+0000 7ff6ac957640 1 Processor -- start 2023-06-10T19:07:12.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.846+0000 7ff6ac957640 1 -- start start 2023-06-10T19:07:12.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.846+0000 7ff6ac957640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff6a8162640 0x7ff6a8164a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:12.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.846+0000 7ff6ac957640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6a8159b50 con 0x7ff6a8071060 2023-06-10T19:07:12.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.846+0000 7ff6ac957640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6a80702a0 con 0x7ff6a80c9840 2023-06-10T19:07:12.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.846+0000 7ff6ac957640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6a8070580 con 0x7ff6a8162640 2023-06-10T19:07:12.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.846+0000 7ff6a5d9b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ff6a8071060 0x7ff6a80af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:55202/0 (socket says 172.21.15.53:55202) 2023-06-10T19:07:12.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.846+0000 7ff6a5d9b640 1 -- 172.21.15.53:0/4164668757 learned_addr learned my addr 172.21.15.53:0/4164668757 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:07:12.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.846+0000 7ff6a6d9d640 1 --2- 172.21.15.53:0/4164668757 >> v2:172.21.15.117:3300/0 conn(0x7ff6a8162640 0x7ff6a8164a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:12.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.846+0000 7ff6a559a640 1 -- 172.21.15.53:0/4164668757 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1742623539 0 0) 0x7ff6a8159b50 con 0x7ff6a8071060 2023-06-10T19:07:12.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.846+0000 7ff6a559a640 1 -- 172.21.15.53:0/4164668757 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff690003530 con 0x7ff6a8071060 2023-06-10T19:07:12.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.846+0000 7ff6a559a640 1 -- 172.21.15.53:0/4164668757 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2332023137 0 0) 0x7ff690003530 con 0x7ff6a8071060 2023-06-10T19:07:12.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.846+0000 7ff6a559a640 1 -- 172.21.15.53:0/4164668757 >> v2:172.21.15.117:3300/0 conn(0x7ff6a8162640 msgr2=0x7ff6a8164a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:12.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.846+0000 7ff6a559a640 1 --2- 172.21.15.53:0/4164668757 >> v2:172.21.15.117:3300/0 conn(0x7ff6a8162640 0x7ff6a8164a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:12.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.846+0000 7ff6a559a640 1 -- 172.21.15.53:0/4164668757 >> v1:172.21.15.117:6789/0 conn(0x7ff6a80c9840 legacy=0x7ff6a80c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:12.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.846+0000 7ff6a559a640 1 -- 172.21.15.53:0/4164668757 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a8070860 con 0x7ff6a8071060 2023-06-10T19:07:12.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.846+0000 7ff6a559a640 1 -- 172.21.15.53:0/4164668757 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7ff69c001680 con 0x7ff6a8071060 2023-06-10T19:07:12.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.846+0000 7ff6a559a640 1 -- 172.21.15.53:0/4164668757 >> v1:172.21.15.53:6789/0 conn(0x7ff6a8071060 legacy=0x7ff6a80af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:12.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.846+0000 7ff6a559a640 1 --2- 172.21.15.53:0/4164668757 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6900039f0 0x7ff690003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:12.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.846+0000 7ff6a559a640 1 --2- 172.21.15.53:0/4164668757 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6900047d0 0x7ff690004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:12.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.846+0000 7ff6a559a640 1 --2- 172.21.15.53:0/4164668757 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff690005180 0x7ff69000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:12.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.846+0000 7ff6a559a640 1 -- 172.21.15.53:0/4164668757 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a8070580 con 0x7ff690005180 2023-06-10T19:07:12.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.846+0000 7ff6a559a640 1 -- 172.21.15.53:0/4164668757 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff69000c060 con 0x7ff6900047d0 2023-06-10T19:07:12.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.846+0000 7ff6a559a640 1 -- 172.21.15.53:0/4164668757 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff69000c220 con 0x7ff6900039f0 2023-06-10T19:07:12.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.846+0000 7ff6a6d9d640 1 --2- 172.21.15.53:0/4164668757 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff690005180 0x7ff69000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:12.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.846+0000 7ff6a5d9b640 1 --2- 172.21.15.53:0/4164668757 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6900047d0 0x7ff690004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:12.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.846+0000 7ff6a659c640 1 --2- 172.21.15.53:0/4164668757 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6900039f0 0x7ff690003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:12.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.846+0000 7ff6a6d9d640 1 -- 172.21.15.53:0/4164668757 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6900039f0 msgr2=0x7ff690003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:12.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.846+0000 7ff6a6d9d640 1 --2- 172.21.15.53:0/4164668757 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6900039f0 0x7ff690003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:12.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.846+0000 7ff6a6d9d640 1 -- 172.21.15.53:0/4164668757 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6900047d0 msgr2=0x7ff690004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:12.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.846+0000 7ff6a6d9d640 1 --2- 172.21.15.53:0/4164668757 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6900047d0 0x7ff690004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:12.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.846+0000 7ff6a6d9d640 1 -- 172.21.15.53:0/4164668757 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff690003530 con 0x7ff690005180 2023-06-10T19:07:12.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.850+0000 7ff6a6d9d640 1 -- 172.21.15.53:0/4164668757 reap_dead start 2023-06-10T19:07:12.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.850+0000 7ff6a6d9d640 1 --2- 172.21.15.53:0/4164668757 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff690005180 0x7ff69000b990 secure :-1 s=READY pgs=2371 cs=0 l=1 rev1=1 crypto rx=0x7ff6a806e7e0 tx=0x7ff6a001cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=876975ef9bd7fc2c server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:12.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.850+0000 7ff6a559a640 1 -- 172.21.15.53:0/4164668757 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a00a5c50 con 0x7ff690005180 2023-06-10T19:07:12.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.850+0000 7ff6a559a640 1 -- 172.21.15.53:0/4164668757 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6a000f040 con 0x7ff690005180 2023-06-10T19:07:12.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.850+0000 7ff6a559a640 1 -- 172.21.15.53:0/4164668757 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a00ad440 con 0x7ff690005180 2023-06-10T19:07:12.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.850+0000 7ff6ac957640 1 -- 172.21.15.53:0/4164668757 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff690005180 msgr2=0x7ff69000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:12.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.850+0000 7ff6ac957640 1 --2- 172.21.15.53:0/4164668757 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff690005180 0x7ff69000b990 secure :-1 s=READY pgs=2371 cs=0 l=1 rev1=1 crypto rx=0x7ff6a806e7e0 tx=0x7ff6a001cc40 comp rx=0 tx=0).stop 2023-06-10T19:07:12.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.850+0000 7ff6ac957640 1 -- 172.21.15.53:0/4164668757 shutdown_connections 2023-06-10T19:07:12.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.850+0000 7ff6ac957640 1 --2- 172.21.15.53:0/4164668757 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff690005180 0x7ff69000b990 unknown :-1 s=CLOSED pgs=2371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:12.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.850+0000 7ff6ac957640 1 -- 172.21.15.53:0/4164668757 >> 172.21.15.53:0/4164668757 conn(0x7ff6a806a0d0 msgr2=0x7ff6a80ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:12.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.850+0000 7ff6ac957640 1 -- 172.21.15.53:0/4164668757 shutdown_connections 2023-06-10T19:07:12.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.850+0000 7ff6ac957640 1 -- 172.21.15.53:0/4164668757 wait complete. 2023-06-10T19:07:12.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.850+0000 7ff6ac957640 1 Processor -- start 2023-06-10T19:07:12.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.850+0000 7ff6ac957640 1 -- start start 2023-06-10T19:07:12.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.854+0000 7ff6ac957640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff690005180 0x7ff6a80b3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:12.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.854+0000 7ff6ac957640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6a80c68c0 0x7ff6a814de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:12.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.854+0000 7ff6ac957640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6a81f3010 0x7ff6a81f23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:12.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.854+0000 7ff6ac957640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a80c64a0 con 0x7ff690005180 2023-06-10T19:07:12.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.854+0000 7ff6ac957640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a80c18e0 con 0x7ff6a80c68c0 2023-06-10T19:07:12.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.854+0000 7ff6ac957640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a80c5820 con 0x7ff6a81f3010 2023-06-10T19:07:12.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.854+0000 7ff6a659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff690005180 0x7ff6a80b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:12.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.854+0000 7ff6a659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff690005180 0x7ff6a80b3290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33668/0 (socket says 172.21.15.53:33668) 2023-06-10T19:07:12.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.854+0000 7ff6a659c640 1 -- 172.21.15.53:0/3558197865 learned_addr learned my addr 172.21.15.53:0/3558197865 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:12.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.854+0000 7ff6a5d9b640 1 --2- 172.21.15.53:0/3558197865 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6a80c68c0 0x7ff6a814de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:12.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.854+0000 7ff6a6d9d640 1 --2- 172.21.15.53:0/3558197865 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6a81f3010 0x7ff6a81f23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:12.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.854+0000 7ff6a659c640 1 -- 172.21.15.53:0/3558197865 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6a81f3010 msgr2=0x7ff6a81f23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:12.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.854+0000 7ff6a659c640 1 --2- 172.21.15.53:0/3558197865 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6a81f3010 0x7ff6a81f23e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:12.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.854+0000 7ff6a659c640 1 -- 172.21.15.53:0/3558197865 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6a80c68c0 msgr2=0x7ff6a814de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:12.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.854+0000 7ff6a659c640 1 --2- 172.21.15.53:0/3558197865 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6a80c68c0 0x7ff6a814de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:12.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.854+0000 7ff6a659c640 1 -- 172.21.15.53:0/3558197865 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a80c5b00 con 0x7ff690005180 2023-06-10T19:07:12.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.854+0000 7ff6a5d9b640 1 --2- 172.21.15.53:0/3558197865 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6a80c68c0 0x7ff6a814de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:07:12.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.854+0000 7ff6a6d9d640 1 --2- 172.21.15.53:0/3558197865 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6a81f3010 0x7ff6a81f23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:07:12.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.854+0000 7ff6a659c640 1 --2- 172.21.15.53:0/3558197865 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff690005180 0x7ff6a80b3290 secure :-1 s=READY pgs=2372 cs=0 l=1 rev1=1 crypto rx=0x7ff69800e410 tx=0x7ff69800e8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:12.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.854+0000 7ff696ffd640 1 -- 172.21.15.53:0/3558197865 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6980052e0 con 0x7ff690005180 2023-06-10T19:07:12.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.854+0000 7ff696ffd640 1 -- 172.21.15.53:0/3558197865 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff698005440 con 0x7ff690005180 2023-06-10T19:07:12.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.854+0000 7ff696ffd640 1 -- 172.21.15.53:0/3558197865 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff698003840 con 0x7ff690005180 2023-06-10T19:07:12.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.854+0000 7ff6ac957640 1 -- 172.21.15.53:0/3558197865 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6a80c5de0 con 0x7ff690005180 2023-06-10T19:07:12.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.854+0000 7ff6ac957640 1 -- 172.21.15.53:0/3558197865 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6a80b37d0 con 0x7ff690005180 2023-06-10T19:07:12.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.854+0000 7ff6ac957640 1 -- 172.21.15.53:0/3558197865 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6a80c65e0 con 0x7ff690005180 2023-06-10T19:07:12.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.854+0000 7ff696ffd640 1 -- 172.21.15.53:0/3558197865 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff6980039a0 con 0x7ff690005180 2023-06-10T19:07:12.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.854+0000 7ff696ffd640 1 --2- 172.21.15.53:0/3558197865 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff688066280 0x7ff688068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:12.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.854+0000 7ff696ffd640 1 -- 172.21.15.53:0/3558197865 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ff6980834b0 con 0x7ff690005180 2023-06-10T19:07:12.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.854+0000 7ff6a5d9b640 1 --2- 172.21.15.53:0/3558197865 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff688066280 0x7ff688068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:12.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.858+0000 7ff6a5d9b640 1 --2- 172.21.15.53:0/3558197865 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff688066280 0x7ff688068730 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7ff69c001ec0 tx=0x7ff69c000ff0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:12.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:12.858+0000 7ff696ffd640 1 -- 172.21.15.53:0/3558197865 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff698050d60 con 0x7ff690005180 2023-06-10T19:07:13.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:13.010+0000 7ff6ac957640 1 -- 172.21.15.53:0/3558197865 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ff6a80c65e0 con 0x7ff690005180 2023-06-10T19:07:13.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:13.010+0000 7ff696ffd640 1 -- 172.21.15.53:0/3558197865 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v163) v1 ==== 84+0+126 (secure 0 0 0) 0x7ff698019090 con 0x7ff690005180 2023-06-10T19:07:13.012 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:07:13.012 INFO:teuthology.orchestra.run.smithi053.stdout:[ 2023-06-10T19:07:13.012 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:07:13.012 INFO:teuthology.orchestra.run.smithi053.stdout: "poolnum": 1, 2023-06-10T19:07:13.012 INFO:teuthology.orchestra.run.smithi053.stdout: "poolname": ".mgr" 2023-06-10T19:07:13.012 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:07:13.012 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:07:13.013 INFO:teuthology.orchestra.run.smithi053.stdout: "poolnum": 2, 2023-06-10T19:07:13.013 INFO:teuthology.orchestra.run.smithi053.stdout: "poolname": "rbd" 2023-06-10T19:07:13.013 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:07:13.013 INFO:teuthology.orchestra.run.smithi053.stdout:] 2023-06-10T19:07:13.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:13.010+0000 7ff6ac957640 1 -- 172.21.15.53:0/3558197865 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff688066280 msgr2=0x7ff688068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:13.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:13.010+0000 7ff6ac957640 1 --2- 172.21.15.53:0/3558197865 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff688066280 0x7ff688068730 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7ff69c001ec0 tx=0x7ff69c000ff0 comp rx=0 tx=0).stop 2023-06-10T19:07:13.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:13.010+0000 7ff6ac957640 1 -- 172.21.15.53:0/3558197865 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff690005180 msgr2=0x7ff6a80b3290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:13.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:13.010+0000 7ff6ac957640 1 --2- 172.21.15.53:0/3558197865 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff690005180 0x7ff6a80b3290 secure :-1 s=READY pgs=2372 cs=0 l=1 rev1=1 crypto rx=0x7ff69800e410 tx=0x7ff69800e8d0 comp rx=0 tx=0).stop 2023-06-10T19:07:13.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:13.010+0000 7ff6ac957640 1 -- 172.21.15.53:0/3558197865 shutdown_connections 2023-06-10T19:07:13.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:13.010+0000 7ff6ac957640 1 --2- 172.21.15.53:0/3558197865 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff688066280 0x7ff688068730 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:13.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:13.010+0000 7ff6ac957640 1 --2- 172.21.15.53:0/3558197865 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff6a81f3010 0x7ff6a81f23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:13.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:13.010+0000 7ff6ac957640 1 --2- 172.21.15.53:0/3558197865 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6a80c68c0 0x7ff6a814de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:13.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:13.010+0000 7ff6ac957640 1 --2- 172.21.15.53:0/3558197865 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff690005180 0x7ff6a80b3290 unknown :-1 s=CLOSED pgs=2372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:13.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:13.010+0000 7ff6ac957640 1 -- 172.21.15.53:0/3558197865 >> 172.21.15.53:0/3558197865 conn(0x7ff6a806a0d0 msgr2=0x7ff6a81533b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:13.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:13.010+0000 7ff6ac957640 1 -- 172.21.15.53:0/3558197865 shutdown_connections 2023-06-10T19:07:13.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:13.010+0000 7ff6ac957640 1 -- 172.21.15.53:0/3558197865 wait complete. 2023-06-10T19:07:13.029 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-06-10T19:07:13.030 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-06-10T19:07:13.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:13.158+0000 7fb937197640 1 Processor -- start 2023-06-10T19:07:13.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:13.158+0000 7fb937197640 1 -- start start 2023-06-10T19:07:13.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:13.158+0000 7fb937197640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb930157fb0 0x7fb93006f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:13.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:13.158+0000 7fb937197640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb93006b8f0 con 0x7fb93015c2c0 2023-06-10T19:07:13.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:13.158+0000 7fb937197640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9300cd600 con 0x7fb9300b0250 2023-06-10T19:07:13.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:13.158+0000 7fb937197640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9300cdbc0 con 0x7fb930157fb0 2023-06-10T19:07:13.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:13.158+0000 7fb935734640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fb93015c2c0 0x7fb93006bd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:55218/0 (socket says 172.21.15.53:55218) 2023-06-10T19:07:13.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:13.158+0000 7fb935734640 1 -- 172.21.15.53:0/2068612782 learned_addr learned my addr 172.21.15.53:0/2068612782 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:07:13.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:13.158+0000 7fb934f33640 1 --2- 172.21.15.53:0/2068612782 >> v2:172.21.15.117:3300/0 conn(0x7fb930157fb0 0x7fb93006f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:13.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:13.162+0000 7fb92f7fe640 1 -- 172.21.15.53:0/2068612782 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3210446084 0 0) 0x7fb93006b8f0 con 0x7fb93015c2c0 2023-06-10T19:07:13.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:13.162+0000 7fb92f7fe640 1 -- 172.21.15.53:0/2068612782 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb91c003530 con 0x7fb93015c2c0 2023-06-10T19:07:13.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:13.162+0000 7fb92f7fe640 1 -- 172.21.15.53:0/2068612782 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 754968029 0 0) 0x7fb9300cd600 con 0x7fb9300b0250 2023-06-10T19:07:13.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:13.162+0000 7fb92f7fe640 1 -- 172.21.15.53:0/2068612782 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb93006b8f0 con 0x7fb9300b0250 2023-06-10T19:07:13.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:13.162+0000 7fb92f7fe640 1 -- 172.21.15.53:0/2068612782 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 857003856 0 0) 0x7fb91c003530 con 0x7fb93015c2c0 2023-06-10T19:07:13.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:13.162+0000 7fb934f33640 1 -- 172.21.15.53:0/2068612782 >> v1:172.21.15.117:6789/0 conn(0x7fb9300b0250 legacy=0x7fb93015bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:13.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:13.162+0000 7fb934f33640 1 -- 172.21.15.53:0/2068612782 >> v1:172.21.15.53:6789/0 conn(0x7fb93015c2c0 legacy=0x7fb93006bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:13.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:13.162+0000 7fb934f33640 1 -- 172.21.15.53:0/2068612782 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9300cd8e0 con 0x7fb930157fb0 2023-06-10T19:07:13.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:13.162+0000 7fb934f33640 1 --2- 172.21.15.53:0/2068612782 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb930157fb0 0x7fb93006f0a0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fb92000a960 tx=0x7fb92001d6e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8cf77e25651a037b server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:13.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:13.162+0000 7fb92f7fe640 1 -- 172.21.15.53:0/2068612782 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb928001680 con 0x7fb930157fb0 2023-06-10T19:07:13.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:13.162+0000 7fb92f7fe640 1 -- 172.21.15.53:0/2068612782 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9200a74a0 con 0x7fb930157fb0 2023-06-10T19:07:13.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:13.162+0000 7fb92f7fe640 1 -- 172.21.15.53:0/2068612782 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9200a7830 con 0x7fb930157fb0 2023-06-10T19:07:13.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:13.166+0000 7fb937197640 1 -- 172.21.15.53:0/2068612782 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb930157fb0 msgr2=0x7fb93006f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:13.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:13.166+0000 7fb937197640 1 --2- 172.21.15.53:0/2068612782 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb930157fb0 0x7fb93006f0a0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fb92000a960 tx=0x7fb92001d6e0 comp rx=0 tx=0).stop 2023-06-10T19:07:13.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:13.166+0000 7fb937197640 1 -- 172.21.15.53:0/2068612782 shutdown_connections 2023-06-10T19:07:13.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:13.166+0000 7fb937197640 1 --2- 172.21.15.53:0/2068612782 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb930157fb0 0x7fb93006f0a0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:13.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:13.166+0000 7fb937197640 1 -- 172.21.15.53:0/2068612782 >> 172.21.15.53:0/2068612782 conn(0x7fb9300ca830 msgr2=0x7fb9300cac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:13.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:13.166+0000 7fb937197640 1 -- 172.21.15.53:0/2068612782 shutdown_connections 2023-06-10T19:07:13.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:13.166+0000 7fb937197640 1 -- 172.21.15.53:0/2068612782 wait complete. 2023-06-10T19:07:13.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:13.166+0000 7fb937197640 1 Processor -- start 2023-06-10T19:07:13.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:13.166+0000 7fb937197640 1 -- start start 2023-06-10T19:07:13.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:13.166+0000 7fb937197640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9300b0250 0x7fb9300c3d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:13.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:13.166+0000 7fb937197640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb930157fb0 0x7fb9300ccb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:13.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:13.166+0000 7fb937197640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb93015c2c0 0x7fb930145e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:13.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:13.166+0000 7fb937197640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9300c83a0 con 0x7fb930157fb0 2023-06-10T19:07:13.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:13.166+0000 7fb937197640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9300c1c50 con 0x7fb93015c2c0 2023-06-10T19:07:13.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:13.166+0000 7fb937197640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9300c1f30 con 0x7fb9300b0250 2023-06-10T19:07:13.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:13.166+0000 7fb92ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb930157fb0 0x7fb9300ccb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:13.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:13.166+0000 7fb92ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb930157fb0 0x7fb9300ccb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33680/0 (socket says 172.21.15.53:33680) 2023-06-10T19:07:13.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:13.166+0000 7fb92ffff640 1 -- 172.21.15.53:0/2804171700 learned_addr learned my addr 172.21.15.53:0/2804171700 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:13.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:13.166+0000 7fb934f33640 1 --2- 172.21.15.53:0/2804171700 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9300b0250 0x7fb9300c3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:13.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:13.166+0000 7fb935734640 1 --2- 172.21.15.53:0/2804171700 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb93015c2c0 0x7fb930145e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:13.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:13.166+0000 7fb92ffff640 1 -- 172.21.15.53:0/2804171700 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9300b0250 msgr2=0x7fb9300c3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:13.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:13.166+0000 7fb92ffff640 1 --2- 172.21.15.53:0/2804171700 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9300b0250 0x7fb9300c3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:13.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:13.166+0000 7fb92ffff640 1 -- 172.21.15.53:0/2804171700 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb93015c2c0 msgr2=0x7fb930145e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:13.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:13.166+0000 7fb92ffff640 1 --2- 172.21.15.53:0/2804171700 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb93015c2c0 0x7fb930145e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:13.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:13.166+0000 7fb92ffff640 1 -- 172.21.15.53:0/2804171700 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb92000a5c0 con 0x7fb930157fb0 2023-06-10T19:07:13.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:13.166+0000 7fb92ffff640 1 --2- 172.21.15.53:0/2804171700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb930157fb0 0x7fb9300ccb10 secure :-1 s=READY pgs=2374 cs=0 l=1 rev1=1 crypto rx=0x7fb91800c870 tx=0x7fb91800cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:13.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:13.166+0000 7fb92d7fa640 1 -- 172.21.15.53:0/2804171700 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb918003b80 con 0x7fb930157fb0 2023-06-10T19:07:13.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:13.166+0000 7fb92d7fa640 1 -- 172.21.15.53:0/2804171700 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb918003ce0 con 0x7fb930157fb0 2023-06-10T19:07:13.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:13.166+0000 7fb937197640 1 -- 172.21.15.53:0/2804171700 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9300c2210 con 0x7fb930157fb0 2023-06-10T19:07:13.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:13.166+0000 7fb92d7fa640 1 -- 172.21.15.53:0/2804171700 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb91800aa30 con 0x7fb930157fb0 2023-06-10T19:07:13.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:13.166+0000 7fb937197640 1 -- 172.21.15.53:0/2804171700 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9300c27d0 con 0x7fb930157fb0 2023-06-10T19:07:13.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:13.170+0000 7fb937197640 1 -- 172.21.15.53:0/2804171700 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9300aeb50 con 0x7fb930157fb0 2023-06-10T19:07:13.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:13.170+0000 7fb92d7fa640 1 -- 172.21.15.53:0/2804171700 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb91800ab90 con 0x7fb930157fb0 2023-06-10T19:07:13.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:13.170+0000 7fb92d7fa640 1 --2- 172.21.15.53:0/2804171700 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb9100662b0 0x7fb910068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:13.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:13.170+0000 7fb92d7fa640 1 -- 172.21.15.53:0/2804171700 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fb918084320 con 0x7fb930157fb0 2023-06-10T19:07:13.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:13.170+0000 7fb934f33640 1 --2- 172.21.15.53:0/2804171700 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb9100662b0 0x7fb910068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:13.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:13.170+0000 7fb934f33640 1 --2- 172.21.15.53:0/2804171700 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb9100662b0 0x7fb910068760 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fb9200b0000 tx=0x7fb920008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:13.175 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:13.174+0000 7fb92d7fa640 1 -- 172.21.15.53:0/2804171700 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb918051bd0 con 0x7fb930157fb0 2023-06-10T19:07:13.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:13.322+0000 7fb937197640 1 -- 172.21.15.53:0/2804171700 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fb93004d790 con 0x7fb930157fb0 2023-06-10T19:07:14.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:14.322+0000 7fb92d7fa640 1 -- 172.21.15.53:0/2804171700 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v164) v1 ==== 138+0+0 (secure 0 0 0) 0x7fb9180551f0 con 0x7fb930157fb0 2023-06-10T19:07:14.327 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_metadata' created 2023-06-10T19:07:14.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:14.330+0000 7fb937197640 1 -- 172.21.15.53:0/2804171700 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb9100662b0 msgr2=0x7fb910068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:14.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:14.330+0000 7fb937197640 1 --2- 172.21.15.53:0/2804171700 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb9100662b0 0x7fb910068760 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fb9200b0000 tx=0x7fb920008040 comp rx=0 tx=0).stop 2023-06-10T19:07:14.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:14.330+0000 7fb937197640 1 -- 172.21.15.53:0/2804171700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb930157fb0 msgr2=0x7fb9300ccb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:14.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:14.330+0000 7fb937197640 1 --2- 172.21.15.53:0/2804171700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb930157fb0 0x7fb9300ccb10 secure :-1 s=READY pgs=2374 cs=0 l=1 rev1=1 crypto rx=0x7fb91800c870 tx=0x7fb91800cd30 comp rx=0 tx=0).stop 2023-06-10T19:07:14.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:14.330+0000 7fb937197640 1 -- 172.21.15.53:0/2804171700 shutdown_connections 2023-06-10T19:07:14.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:14.330+0000 7fb937197640 1 --2- 172.21.15.53:0/2804171700 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb9100662b0 0x7fb910068760 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:14.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:14.330+0000 7fb937197640 1 --2- 172.21.15.53:0/2804171700 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb93015c2c0 0x7fb930145e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:14.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:14.330+0000 7fb937197640 1 --2- 172.21.15.53:0/2804171700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb930157fb0 0x7fb9300ccb10 unknown :-1 s=CLOSED pgs=2374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:14.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:14.330+0000 7fb937197640 1 --2- 172.21.15.53:0/2804171700 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9300b0250 0x7fb9300c3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:14.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:14.330+0000 7fb937197640 1 -- 172.21.15.53:0/2804171700 >> 172.21.15.53:0/2804171700 conn(0x7fb9300ca830 msgr2=0x7fb9300ae440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:14.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:14.334+0000 7fb937197640 1 -- 172.21.15.53:0/2804171700 shutdown_connections 2023-06-10T19:07:14.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:14.334+0000 7fb937197640 1 -- 172.21.15.53:0/2804171700 wait complete. 2023-06-10T19:07:14.359 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-06-10T19:07:14.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:14.486+0000 7f99c22fc640 1 Processor -- start 2023-06-10T19:07:14.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:14.486+0000 7f99c22fc640 1 -- start start 2023-06-10T19:07:14.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:14.490+0000 7f99c22fc640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f99bc1599b0 0x7f99bc0cd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:14.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:14.490+0000 7f99c22fc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99bc070460 0x7f99bc0cb960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:14.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:14.490+0000 7f99c22fc640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99bc0ccee0 con 0x7f99bc0af810 2023-06-10T19:07:14.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:14.490+0000 7f99c22fc640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99bc0cc2d0 con 0x7f99bc1599b0 2023-06-10T19:07:14.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:14.490+0000 7f99c22fc640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc0cc5b0 con 0x7f99bc070460 2023-06-10T19:07:14.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:14.490+0000 7f99bbfff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f99bc0af810 0x7f99bc0afbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:55232/0 (socket says 172.21.15.53:55232) 2023-06-10T19:07:14.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:14.490+0000 7f99bbfff640 1 -- 172.21.15.53:0/2446623624 learned_addr learned my addr 172.21.15.53:0/2446623624 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:07:14.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:14.490+0000 7f99c0899640 1 --2- 172.21.15.53:0/2446623624 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99bc070460 0x7f99bc0cb960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:14.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:14.490+0000 7f99bb7fe640 1 --2- 172.21.15.53:0/2446623624 >> v2:172.21.15.117:3300/0 conn(0x7f99bc1599b0 0x7f99bc0cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:14.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:14.490+0000 7f99baffd640 1 -- 172.21.15.53:0/2446623624 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1273443704 0 0) 0x7f99bc0ccee0 con 0x7f99bc0af810 2023-06-10T19:07:14.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:14.490+0000 7f99baffd640 1 -- 172.21.15.53:0/2446623624 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99a4003530 con 0x7f99bc0af810 2023-06-10T19:07:14.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:14.490+0000 7f99c0899640 1 -- 172.21.15.53:0/2446623624 >> v2:172.21.15.117:3300/0 conn(0x7f99bc1599b0 msgr2=0x7f99bc0cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:14.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:14.490+0000 7f99c0899640 1 --2- 172.21.15.53:0/2446623624 >> v2:172.21.15.117:3300/0 conn(0x7f99bc1599b0 0x7f99bc0cd370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:14.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:14.490+0000 7f99c0899640 1 -- 172.21.15.53:0/2446623624 >> v1:172.21.15.53:6789/0 conn(0x7f99bc0af810 legacy=0x7f99bc0afbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:14.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:14.490+0000 7f99c0899640 1 -- 172.21.15.53:0/2446623624 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99bc0cc890 con 0x7f99bc070460 2023-06-10T19:07:14.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:14.490+0000 7f99bb7fe640 1 --2- 172.21.15.53:0/2446623624 >> v2:172.21.15.117:3300/0 conn(0x7f99bc1599b0 0x7f99bc0cd370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-10T19:07:14.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:14.494+0000 7f99c0899640 1 --2- 172.21.15.53:0/2446623624 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99bc070460 0x7f99bc0cb960 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f99b4009d90 tx=0x7f99b401c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac75eb6b31908c05 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:14.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:14.494+0000 7f99baffd640 1 -- 172.21.15.53:0/2446623624 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b40a5a00 con 0x7f99bc070460 2023-06-10T19:07:14.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:14.494+0000 7f99baffd640 1 -- 172.21.15.53:0/2446623624 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99b40a5b60 con 0x7f99bc070460 2023-06-10T19:07:14.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:14.494+0000 7f99baffd640 1 -- 172.21.15.53:0/2446623624 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b40ad440 con 0x7f99bc070460 2023-06-10T19:07:14.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:14.494+0000 7f99c22fc640 1 -- 172.21.15.53:0/2446623624 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99bc070460 msgr2=0x7f99bc0cb960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:14.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:14.494+0000 7f99c22fc640 1 --2- 172.21.15.53:0/2446623624 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99bc070460 0x7f99bc0cb960 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f99b4009d90 tx=0x7f99b401c920 comp rx=0 tx=0).stop 2023-06-10T19:07:14.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:14.494+0000 7f99c22fc640 1 -- 172.21.15.53:0/2446623624 shutdown_connections 2023-06-10T19:07:14.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:14.494+0000 7f99c22fc640 1 --2- 172.21.15.53:0/2446623624 >> v2:172.21.15.117:3300/0 conn(0x7f99bc1599b0 0x7f99bc0cd370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:14.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:14.494+0000 7f99c22fc640 1 --2- 172.21.15.53:0/2446623624 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99bc070460 0x7f99bc0cb960 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:14.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:14.494+0000 7f99c22fc640 1 -- 172.21.15.53:0/2446623624 >> 172.21.15.53:0/2446623624 conn(0x7f99bc06a0e0 msgr2=0x7f99bc0ca810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:14.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:14.494+0000 7f99c22fc640 1 -- 172.21.15.53:0/2446623624 shutdown_connections 2023-06-10T19:07:14.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:14.494+0000 7f99c22fc640 1 -- 172.21.15.53:0/2446623624 wait complete. 2023-06-10T19:07:14.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:14.494+0000 7f99c22fc640 1 Processor -- start 2023-06-10T19:07:14.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:14.494+0000 7f99c22fc640 1 -- start start 2023-06-10T19:07:14.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:14.494+0000 7f99c22fc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99bc070460 0x7f99bc0adc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:14.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:14.494+0000 7f99c22fc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99bc0af810 0x7f99bc0c2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:14.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:14.494+0000 7f99c22fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99bc1599b0 0x7f99bc0c30b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:14.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:14.494+0000 7f99c22fc640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc0ae660 con 0x7f99bc1599b0 2023-06-10T19:07:14.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:14.494+0000 7f99c22fc640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc0ae940 con 0x7f99bc0af810 2023-06-10T19:07:14.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:14.494+0000 7f99c22fc640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc0aec20 con 0x7f99bc070460 2023-06-10T19:07:14.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:14.494+0000 7f99c0899640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99bc1599b0 0x7f99bc0c30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:14.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:14.494+0000 7f99c0899640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99bc1599b0 0x7f99bc0c30b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33696/0 (socket says 172.21.15.53:33696) 2023-06-10T19:07:14.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:14.494+0000 7f99c0899640 1 -- 172.21.15.53:0/887474628 learned_addr learned my addr 172.21.15.53:0/887474628 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:14.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:14.498+0000 7f99bbfff640 1 --2- 172.21.15.53:0/887474628 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99bc070460 0x7f99bc0adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:14.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:14.498+0000 7f99bb7fe640 1 --2- 172.21.15.53:0/887474628 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99bc0af810 0x7f99bc0c2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:14.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:14.498+0000 7f99c0899640 1 -- 172.21.15.53:0/887474628 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99bc070460 msgr2=0x7f99bc0adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:14.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:14.498+0000 7f99c0899640 1 --2- 172.21.15.53:0/887474628 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99bc070460 0x7f99bc0adc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:14.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:14.498+0000 7f99c0899640 1 -- 172.21.15.53:0/887474628 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99bc0af810 msgr2=0x7f99bc0c2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:14.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:14.498+0000 7f99c0899640 1 --2- 172.21.15.53:0/887474628 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99bc0af810 0x7f99bc0c2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:14.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:14.498+0000 7f99c0899640 1 -- 172.21.15.53:0/887474628 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b0009420 con 0x7f99bc1599b0 2023-06-10T19:07:14.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:14.498+0000 7f99c0899640 1 --2- 172.21.15.53:0/887474628 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99bc1599b0 0x7f99bc0c30b0 secure :-1 s=READY pgs=2376 cs=0 l=1 rev1=1 crypto rx=0x7f99b401a550 tx=0x7f99b40196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:14.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:14.498+0000 7f99b8ff9640 1 -- 172.21.15.53:0/887474628 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b4004240 con 0x7f99bc1599b0 2023-06-10T19:07:14.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:14.498+0000 7f99b8ff9640 1 -- 172.21.15.53:0/887474628 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99b40043a0 con 0x7f99bc1599b0 2023-06-10T19:07:14.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:14.498+0000 7f99c22fc640 1 -- 172.21.15.53:0/887474628 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99b4009a70 con 0x7f99bc1599b0 2023-06-10T19:07:14.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:14.498+0000 7f99b8ff9640 1 -- 172.21.15.53:0/887474628 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b4004790 con 0x7f99bc1599b0 2023-06-10T19:07:14.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:14.498+0000 7f99c22fc640 1 -- 172.21.15.53:0/887474628 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99bc0af1e0 con 0x7f99bc1599b0 2023-06-10T19:07:14.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:14.498+0000 7f99c22fc640 1 -- 172.21.15.53:0/887474628 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99bc04d790 con 0x7f99bc1599b0 2023-06-10T19:07:14.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:14.498+0000 7f99b8ff9640 1 -- 172.21.15.53:0/887474628 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f99b40b4030 con 0x7f99bc1599b0 2023-06-10T19:07:14.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:14.498+0000 7f99b8ff9640 1 --2- 172.21.15.53:0/887474628 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f99a80662b0 0x7f99a8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:14.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:14.498+0000 7f99b8ff9640 1 -- 172.21.15.53:0/887474628 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f99b411ecc0 con 0x7f99bc1599b0 2023-06-10T19:07:14.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:14.498+0000 7f99bbfff640 1 --2- 172.21.15.53:0/887474628 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f99a80662b0 0x7f99a8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:14.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:14.498+0000 7f99bbfff640 1 --2- 172.21.15.53:0/887474628 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f99a80662b0 0x7f99a8068760 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f99ac005890 tx=0x7f99ac009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:14.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:14.502+0000 7f99b8ff9640 1 -- 172.21.15.53:0/887474628 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f99b40ec4d0 con 0x7f99bc1599b0 2023-06-10T19:07:14.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:14.650+0000 7f99c22fc640 1 -- 172.21.15.53:0/887474628 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f99bc154ac0 con 0x7f99bc1599b0 2023-06-10T19:07:15.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.342+0000 7f99b8ff9640 1 -- 172.21.15.53:0/887474628 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v165) v1 ==== 170+0+0 (secure 0 0 0) 0x7f99b40efaf0 con 0x7f99bc1599b0 2023-06-10T19:07:15.346 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_data' created 2023-06-10T19:07:15.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.358+0000 7f99c22fc640 1 -- 172.21.15.53:0/887474628 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f99a80662b0 msgr2=0x7f99a8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:15.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.358+0000 7f99c22fc640 1 --2- 172.21.15.53:0/887474628 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f99a80662b0 0x7f99a8068760 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f99ac005890 tx=0x7f99ac009040 comp rx=0 tx=0).stop 2023-06-10T19:07:15.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.358+0000 7f99c22fc640 1 -- 172.21.15.53:0/887474628 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99bc1599b0 msgr2=0x7f99bc0c30b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:15.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.358+0000 7f99c22fc640 1 --2- 172.21.15.53:0/887474628 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99bc1599b0 0x7f99bc0c30b0 secure :-1 s=READY pgs=2376 cs=0 l=1 rev1=1 crypto rx=0x7f99b401a550 tx=0x7f99b40196c0 comp rx=0 tx=0).stop 2023-06-10T19:07:15.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.358+0000 7f99c22fc640 1 -- 172.21.15.53:0/887474628 shutdown_connections 2023-06-10T19:07:15.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.358+0000 7f99c22fc640 1 --2- 172.21.15.53:0/887474628 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f99a80662b0 0x7f99a8068760 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:15.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.358+0000 7f99c22fc640 1 --2- 172.21.15.53:0/887474628 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99bc1599b0 0x7f99bc0c30b0 unknown :-1 s=CLOSED pgs=2376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:15.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.358+0000 7f99c22fc640 1 --2- 172.21.15.53:0/887474628 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99bc0af810 0x7f99bc0c2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:15.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.358+0000 7f99c22fc640 1 --2- 172.21.15.53:0/887474628 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99bc070460 0x7f99bc0adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:15.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.358+0000 7f99c22fc640 1 -- 172.21.15.53:0/887474628 >> 172.21.15.53:0/887474628 conn(0x7f99bc06a0e0 msgr2=0x7f99bc158840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:15.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.366+0000 7f99c22fc640 1 -- 172.21.15.53:0/887474628 shutdown_connections 2023-06-10T19:07:15.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.366+0000 7f99c22fc640 1 -- 172.21.15.53:0/887474628 wait complete. 2023-06-10T19:07:15.395 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-06-10T19:07:15.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.514+0000 7f199c5a2640 1 Processor -- start 2023-06-10T19:07:15.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.514+0000 7f199c5a2640 1 -- start start 2023-06-10T19:07:15.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.518+0000 7f199c5a2640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f19940c9fa0 0x7f199406bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:15.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.518+0000 7f199c5a2640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f19940af760 0x7f19940afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:15.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.518+0000 7f199c5a2640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f199406b090 con 0x7f199406c020 2023-06-10T19:07:15.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.518+0000 7f199c5a2640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19940b0120 con 0x7f19940af760 2023-06-10T19:07:15.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.518+0000 7f199c5a2640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19940ca370 con 0x7f19940c9fa0 2023-06-10T19:07:15.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.518+0000 7f199ab3f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f19940af760 0x7f19940afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:15.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.518+0000 7f199ab3f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f19940af760 0x7f19940afbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33704/0 (socket says 172.21.15.53:33704) 2023-06-10T19:07:15.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.518+0000 7f199ab3f640 1 -- 172.21.15.53:0/1543258337 learned_addr learned my addr 172.21.15.53:0/1543258337 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:15.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.518+0000 7f199a33e640 1 --2- 172.21.15.53:0/1543258337 >> v2:172.21.15.117:3300/0 conn(0x7f19940c9fa0 0x7f199406bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:15.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.518+0000 7f199ab3f640 1 -- 172.21.15.53:0/1543258337 >> v2:172.21.15.117:3300/0 conn(0x7f19940c9fa0 msgr2=0x7f199406bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:15.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.518+0000 7f199ab3f640 1 --2- 172.21.15.53:0/1543258337 >> v2:172.21.15.117:3300/0 conn(0x7f19940c9fa0 0x7f199406bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:15.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.518+0000 7f199ab3f640 1 -- 172.21.15.53:0/1543258337 >> v1:172.21.15.117:6789/0 conn(0x7f199406c020 legacy=0x7f19940c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:15.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.518+0000 7f199ab3f640 1 -- 172.21.15.53:0/1543258337 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1994070d50 con 0x7f19940af760 2023-06-10T19:07:15.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.518+0000 7f199ab3f640 1 --2- 172.21.15.53:0/1543258337 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f19940af760 0x7f19940afbe0 secure :-1 s=READY pgs=2377 cs=0 l=1 rev1=1 crypto rx=0x7f199406e9d0 tx=0x7f198c01c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff639ec6cd0f92a0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:15.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.518+0000 7f199933c640 1 -- 172.21.15.53:0/1543258337 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198c0a5790 con 0x7f19940af760 2023-06-10T19:07:15.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.518+0000 7f199933c640 1 -- 172.21.15.53:0/1543258337 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f198c0a58f0 con 0x7f19940af760 2023-06-10T19:07:15.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.518+0000 7f199933c640 1 -- 172.21.15.53:0/1543258337 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198c0a5c80 con 0x7f19940af760 2023-06-10T19:07:15.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.522+0000 7f199c5a2640 1 -- 172.21.15.53:0/1543258337 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f19940af760 msgr2=0x7f19940afbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:15.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.522+0000 7f199c5a2640 1 --2- 172.21.15.53:0/1543258337 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f19940af760 0x7f19940afbe0 secure :-1 s=READY pgs=2377 cs=0 l=1 rev1=1 crypto rx=0x7f199406e9d0 tx=0x7f198c01c8d0 comp rx=0 tx=0).stop 2023-06-10T19:07:15.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.522+0000 7f199c5a2640 1 -- 172.21.15.53:0/1543258337 shutdown_connections 2023-06-10T19:07:15.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.522+0000 7f199c5a2640 1 --2- 172.21.15.53:0/1543258337 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f19940af760 0x7f19940afbe0 unknown :-1 s=CLOSED pgs=2377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:15.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.522+0000 7f199c5a2640 1 --2- 172.21.15.53:0/1543258337 >> v2:172.21.15.117:3300/0 conn(0x7f19940c9fa0 0x7f199406bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:15.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.522+0000 7f199c5a2640 1 -- 172.21.15.53:0/1543258337 >> 172.21.15.53:0/1543258337 conn(0x7f199406a0e0 msgr2=0x7f19940cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:15.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.522+0000 7f199c5a2640 1 -- 172.21.15.53:0/1543258337 shutdown_connections 2023-06-10T19:07:15.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.522+0000 7f199c5a2640 1 -- 172.21.15.53:0/1543258337 wait complete. 2023-06-10T19:07:15.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.522+0000 7f199c5a2640 1 Processor -- start 2023-06-10T19:07:15.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.522+0000 7f199c5a2640 1 -- start start 2023-06-10T19:07:15.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.522+0000 7f199c5a2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f199406c020 0x7f19941500a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:15.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.522+0000 7f199c5a2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19940af760 0x7f19940bdb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:15.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.522+0000 7f199c5a2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19940c9fa0 0x7f19941513f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:15.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.522+0000 7f199c5a2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1994142c30 con 0x7f199406c020 2023-06-10T19:07:15.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.522+0000 7f199c5a2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19941505e0 con 0x7f19940af760 2023-06-10T19:07:15.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.522+0000 7f199c5a2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19940c1a50 con 0x7f19940c9fa0 2023-06-10T19:07:15.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.522+0000 7f199a33e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f199406c020 0x7f19941500a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:15.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.522+0000 7f199a33e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f199406c020 0x7f19941500a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33720/0 (socket says 172.21.15.53:33720) 2023-06-10T19:07:15.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.522+0000 7f199a33e640 1 -- 172.21.15.53:0/3012925898 learned_addr learned my addr 172.21.15.53:0/3012925898 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:15.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.522+0000 7f1999b3d640 1 --2- 172.21.15.53:0/3012925898 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19940af760 0x7f19940bdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:15.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.522+0000 7f199ab3f640 1 --2- 172.21.15.53:0/3012925898 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19940c9fa0 0x7f19941513f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:15.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.522+0000 7f199a33e640 1 -- 172.21.15.53:0/3012925898 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19940c9fa0 msgr2=0x7f19941513f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:15.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.522+0000 7f199a33e640 1 --2- 172.21.15.53:0/3012925898 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19940c9fa0 0x7f19941513f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:15.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.522+0000 7f199a33e640 1 -- 172.21.15.53:0/3012925898 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19940af760 msgr2=0x7f19940bdb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:15.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.522+0000 7f199a33e640 1 --2- 172.21.15.53:0/3012925898 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19940af760 0x7f19940bdb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:15.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.522+0000 7f199a33e640 1 -- 172.21.15.53:0/3012925898 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f198c009b30 con 0x7f199406c020 2023-06-10T19:07:15.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.522+0000 7f1999b3d640 1 --2- 172.21.15.53:0/3012925898 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19940af760 0x7f19940bdb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:07:15.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.522+0000 7f199a33e640 1 --2- 172.21.15.53:0/3012925898 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f199406c020 0x7f19941500a0 secure :-1 s=READY pgs=2378 cs=0 l=1 rev1=1 crypto rx=0x7f199000d5f0 tx=0x7f199000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:15.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.522+0000 7f198affd640 1 -- 172.21.15.53:0/3012925898 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19900125f0 con 0x7f199406c020 2023-06-10T19:07:15.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.522+0000 7f198affd640 1 -- 172.21.15.53:0/3012925898 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1990012750 con 0x7f199406c020 2023-06-10T19:07:15.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.522+0000 7f199c5a2640 1 -- 172.21.15.53:0/3012925898 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19940c1fd0 con 0x7f199406c020 2023-06-10T19:07:15.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.522+0000 7f198affd640 1 -- 172.21.15.53:0/3012925898 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1990012ae0 con 0x7f199406c020 2023-06-10T19:07:15.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.522+0000 7f199c5a2640 1 -- 172.21.15.53:0/3012925898 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19940c1cf0 con 0x7f199406c020 2023-06-10T19:07:15.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.526+0000 7f199c5a2640 1 -- 172.21.15.53:0/3012925898 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f199404d790 con 0x7f199406c020 2023-06-10T19:07:15.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.526+0000 7f198affd640 1 -- 172.21.15.53:0/3012925898 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1990012c40 con 0x7f199406c020 2023-06-10T19:07:15.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.526+0000 7f198affd640 1 --2- 172.21.15.53:0/3012925898 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1978066280 0x7f1978068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:15.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.526+0000 7f198affd640 1 -- 172.21.15.53:0/3012925898 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f1990084200 con 0x7f199406c020 2023-06-10T19:07:15.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.526+0000 7f1999b3d640 1 --2- 172.21.15.53:0/3012925898 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1978066280 0x7f1978068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:15.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.526+0000 7f1999b3d640 1 --2- 172.21.15.53:0/3012925898 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1978066280 0x7f1978068730 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f19940c97a0 tx=0x7f1984009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:15.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.530+0000 7f198affd640 1 -- 172.21.15.53:0/3012925898 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f19900516d0 con 0x7f199406c020 2023-06-10T19:07:15.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.718+0000 7f199c5a2640 1 -- 172.21.15.53:0/3012925898 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f19940ce670 con 0x7f199406c020 2023-06-10T19:07:15.769 INFO:teuthology.orchestra.run.smithi053.stderr:new fs with metadata pool 23 and data pool 24 2023-06-10T19:07:15.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.738+0000 7f198affd640 1 -- 172.21.15.53:0/3012925898 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 23 and data pool 24 v93) v1 ==== 174+0+0 (secure 0 0 0) 0x7f1990007380 con 0x7f199406c020 2023-06-10T19:07:15.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.746+0000 7f199c5a2640 1 -- 172.21.15.53:0/3012925898 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1978066280 msgr2=0x7f1978068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:15.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.746+0000 7f199c5a2640 1 --2- 172.21.15.53:0/3012925898 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1978066280 0x7f1978068730 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f19940c97a0 tx=0x7f1984009040 comp rx=0 tx=0).stop 2023-06-10T19:07:15.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.746+0000 7f199c5a2640 1 -- 172.21.15.53:0/3012925898 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f199406c020 msgr2=0x7f19941500a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:15.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.746+0000 7f199c5a2640 1 --2- 172.21.15.53:0/3012925898 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f199406c020 0x7f19941500a0 secure :-1 s=READY pgs=2378 cs=0 l=1 rev1=1 crypto rx=0x7f199000d5f0 tx=0x7f199000dab0 comp rx=0 tx=0).stop 2023-06-10T19:07:15.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.746+0000 7f199c5a2640 1 -- 172.21.15.53:0/3012925898 shutdown_connections 2023-06-10T19:07:15.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.746+0000 7f199c5a2640 1 --2- 172.21.15.53:0/3012925898 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1978066280 0x7f1978068730 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:15.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.746+0000 7f199c5a2640 1 --2- 172.21.15.53:0/3012925898 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19940c9fa0 0x7f19941513f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:15.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.746+0000 7f199c5a2640 1 --2- 172.21.15.53:0/3012925898 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19940af760 0x7f19940bdb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:15.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.746+0000 7f199c5a2640 1 --2- 172.21.15.53:0/3012925898 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f199406c020 0x7f19941500a0 unknown :-1 s=CLOSED pgs=2378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:15.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.746+0000 7f199c5a2640 1 -- 172.21.15.53:0/3012925898 >> 172.21.15.53:0/3012925898 conn(0x7f199406a0e0 msgr2=0x7f19941590e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:15.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.750+0000 7f199c5a2640 1 -- 172.21.15.53:0/3012925898 shutdown_connections 2023-06-10T19:07:15.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.750+0000 7f199c5a2640 1 -- 172.21.15.53:0/3012925898 wait complete. 2023-06-10T19:07:15.781 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:07:15.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.894+0000 7f6ed2f02640 1 Processor -- start 2023-06-10T19:07:15.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.894+0000 7f6ed2f02640 1 -- start start 2023-06-10T19:07:15.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.898+0000 7f6ed2f02640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ecc0c9840 0x7f6ecc0c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:15.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.898+0000 7f6ed2f02640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6ecc071060 0x7f6ecc0af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:15.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.898+0000 7f6ed2f02640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6ecc0afc60 0x7f6ecc15d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:15.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.898+0000 7f6ed2f02640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ecc159b50 con 0x7f6ecc071060 2023-06-10T19:07:15.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.898+0000 7f6ed2f02640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ecc0ca150 con 0x7f6ecc0afc60 2023-06-10T19:07:15.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.898+0000 7f6ed2f02640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ecc0702a0 con 0x7f6ecc0c9840 2023-06-10T19:07:15.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.898+0000 7f6ecbfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6ecc071060 0x7f6ecc0af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:15.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.898+0000 7f6ecbfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6ecc071060 0x7f6ecc0af720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33726/0 (socket says 172.21.15.53:33726) 2023-06-10T19:07:15.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.898+0000 7f6ecbfff640 1 -- 172.21.15.53:0/4006396315 learned_addr learned my addr 172.21.15.53:0/4006396315 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:15.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.898+0000 7f6ed0c9e640 1 --2- 172.21.15.53:0/4006396315 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ecc0c9840 0x7f6ecc0c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:15.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.898+0000 7f6ed149f640 1 --2- 172.21.15.53:0/4006396315 >> v2:172.21.15.117:3300/0 conn(0x7f6ecc0afc60 0x7f6ecc15d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:15.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.898+0000 7f6ecbfff640 1 -- 172.21.15.53:0/4006396315 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ecc0c9840 msgr2=0x7f6ecc0c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:15.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.898+0000 7f6ecbfff640 1 --2- 172.21.15.53:0/4006396315 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ecc0c9840 0x7f6ecc0c9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:15.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.898+0000 7f6ecbfff640 1 -- 172.21.15.53:0/4006396315 >> v2:172.21.15.117:3300/0 conn(0x7f6ecc0afc60 msgr2=0x7f6ecc15d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:15.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.898+0000 7f6ecbfff640 1 --2- 172.21.15.53:0/4006396315 >> v2:172.21.15.117:3300/0 conn(0x7f6ecc0afc60 0x7f6ecc15d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:15.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.898+0000 7f6ecbfff640 1 -- 172.21.15.53:0/4006396315 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ecc070580 con 0x7f6ecc071060 2023-06-10T19:07:15.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.898+0000 7f6ed149f640 1 --2- 172.21.15.53:0/4006396315 >> v2:172.21.15.117:3300/0 conn(0x7f6ecc0afc60 0x7f6ecc15d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:07:15.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.898+0000 7f6ecbfff640 1 --2- 172.21.15.53:0/4006396315 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ecc071060 0x7f6ecc0af720 secure :-1 s=READY pgs=2379 cs=0 l=1 rev1=1 crypto rx=0x7f6ecc06ef50 tx=0x7f6eb401c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90cf18e2559b790e server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:15.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.898+0000 7f6ecb7fe640 1 -- 172.21.15.53:0/4006396315 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb40a5560 con 0x7f6ecc071060 2023-06-10T19:07:15.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.898+0000 7f6ecb7fe640 1 -- 172.21.15.53:0/4006396315 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eb40a56c0 con 0x7f6ecc071060 2023-06-10T19:07:15.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.898+0000 7f6ecb7fe640 1 -- 172.21.15.53:0/4006396315 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb40a5a50 con 0x7f6ecc071060 2023-06-10T19:07:15.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.902+0000 7f6ed2f02640 1 -- 172.21.15.53:0/4006396315 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ecc071060 msgr2=0x7f6ecc0af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:15.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.902+0000 7f6ed2f02640 1 --2- 172.21.15.53:0/4006396315 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ecc071060 0x7f6ecc0af720 secure :-1 s=READY pgs=2379 cs=0 l=1 rev1=1 crypto rx=0x7f6ecc06ef50 tx=0x7f6eb401c6e0 comp rx=0 tx=0).stop 2023-06-10T19:07:15.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.902+0000 7f6ed2f02640 1 -- 172.21.15.53:0/4006396315 shutdown_connections 2023-06-10T19:07:15.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.902+0000 7f6ed2f02640 1 --2- 172.21.15.53:0/4006396315 >> v2:172.21.15.117:3300/0 conn(0x7f6ecc0afc60 0x7f6ecc15d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:15.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.902+0000 7f6ed2f02640 1 --2- 172.21.15.53:0/4006396315 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ecc071060 0x7f6ecc0af720 unknown :-1 s=CLOSED pgs=2379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:15.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.902+0000 7f6ed2f02640 1 --2- 172.21.15.53:0/4006396315 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ecc0c9840 0x7f6ecc0c9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:15.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.902+0000 7f6ed2f02640 1 -- 172.21.15.53:0/4006396315 >> 172.21.15.53:0/4006396315 conn(0x7f6ecc06a0d0 msgr2=0x7f6ecc0ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:15.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.902+0000 7f6ed2f02640 1 -- 172.21.15.53:0/4006396315 shutdown_connections 2023-06-10T19:07:15.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.902+0000 7f6ed2f02640 1 -- 172.21.15.53:0/4006396315 wait complete. 2023-06-10T19:07:15.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.902+0000 7f6ed2f02640 1 Processor -- start 2023-06-10T19:07:15.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.902+0000 7f6ed2f02640 1 -- start start 2023-06-10T19:07:15.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.902+0000 7f6ed2f02640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ecc071060 0x7f6ecc156430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:15.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.902+0000 7f6ed2f02640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ecc0afc60 0x7f6ecc0cb990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:15.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.902+0000 7f6ed2f02640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ecc0c9840 0x7f6ecc1511d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:15.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.902+0000 7f6ed2f02640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ecc1576a0 con 0x7f6ecc071060 2023-06-10T19:07:15.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.902+0000 7f6ed2f02640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ecc1578b0 con 0x7f6ecc0afc60 2023-06-10T19:07:15.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.902+0000 7f6ed2f02640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ecc157b90 con 0x7f6ecc0c9840 2023-06-10T19:07:15.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.902+0000 7f6ed0c9e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ecc071060 0x7f6ecc156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:15.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.902+0000 7f6ed0c9e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ecc071060 0x7f6ecc156430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33732/0 (socket says 172.21.15.53:33732) 2023-06-10T19:07:15.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.902+0000 7f6ed0c9e640 1 -- 172.21.15.53:0/744927027 learned_addr learned my addr 172.21.15.53:0/744927027 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:15.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.902+0000 7f6ecbfff640 1 --2- 172.21.15.53:0/744927027 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ecc0afc60 0x7f6ecc0cb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:15.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.902+0000 7f6ed149f640 1 --2- 172.21.15.53:0/744927027 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ecc0c9840 0x7f6ecc1511d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:15.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.902+0000 7f6ed0c9e640 1 -- 172.21.15.53:0/744927027 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ecc0c9840 msgr2=0x7f6ecc1511d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:15.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.902+0000 7f6ed0c9e640 1 --2- 172.21.15.53:0/744927027 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ecc0c9840 0x7f6ecc1511d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:15.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.902+0000 7f6ed0c9e640 1 -- 172.21.15.53:0/744927027 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ecc0afc60 msgr2=0x7f6ecc0cb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:15.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.902+0000 7f6ed0c9e640 1 --2- 172.21.15.53:0/744927027 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ecc0afc60 0x7f6ecc0cb990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:15.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.902+0000 7f6ed0c9e640 1 -- 172.21.15.53:0/744927027 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eb4009b30 con 0x7f6ecc071060 2023-06-10T19:07:15.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.902+0000 7f6ed0c9e640 1 --2- 172.21.15.53:0/744927027 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ecc071060 0x7f6ecc156430 secure :-1 s=READY pgs=2380 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc00d5f0 tx=0x7f6ebc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:15.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.902+0000 7f6ec97fa640 1 -- 172.21.15.53:0/744927027 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ebc0125f0 con 0x7f6ecc071060 2023-06-10T19:07:15.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.902+0000 7f6ec97fa640 1 -- 172.21.15.53:0/744927027 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ebc012750 con 0x7f6ecc071060 2023-06-10T19:07:15.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.902+0000 7f6ed2f02640 1 -- 172.21.15.53:0/744927027 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ecc157e70 con 0x7f6ecc071060 2023-06-10T19:07:15.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.902+0000 7f6ec97fa640 1 -- 172.21.15.53:0/744927027 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ebc012ae0 con 0x7f6ecc071060 2023-06-10T19:07:15.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.902+0000 7f6ed2f02640 1 -- 172.21.15.53:0/744927027 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ecc151710 con 0x7f6ecc071060 2023-06-10T19:07:15.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.906+0000 7f6ed2f02640 1 -- 172.21.15.53:0/744927027 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ecc06b010 con 0x7f6ecc071060 2023-06-10T19:07:15.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.906+0000 7f6ec97fa640 1 -- 172.21.15.53:0/744927027 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6ebc012c40 con 0x7f6ecc071060 2023-06-10T19:07:15.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.906+0000 7f6ec97fa640 1 --2- 172.21.15.53:0/744927027 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6eac066280 0x7f6eac068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:15.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.906+0000 7f6ec97fa640 1 -- 172.21.15.53:0/744927027 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6ebc0841d0 con 0x7f6ecc071060 2023-06-10T19:07:15.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.906+0000 7f6ecbfff640 1 --2- 172.21.15.53:0/744927027 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6eac066280 0x7f6eac068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:15.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.906+0000 7f6ecbfff640 1 --2- 172.21.15.53:0/744927027 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6eac066280 0x7f6eac068730 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f6eb40ae000 tx=0x7f6eb40a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:15.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:15.910+0000 7f6ec97fa640 1 -- 172.21.15.53:0/744927027 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6ebc0516e0 con 0x7f6ecc071060 2023-06-10T19:07:16.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.066+0000 7f6ed2f02640 1 -- 172.21.15.53:0/744927027 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6ecc04d790 con 0x7f6ecc071060 2023-06-10T19:07:16.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.066+0000 7f6ec97fa640 1 -- 172.21.15.53:0/744927027 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v166) v1 ==== 74+0+18294 (secure 0 0 0) 0x7f6ebc054d00 con 0x7f6ecc071060 2023-06-10T19:07:16.070 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:07:16.070 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":166,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:07:15.722534+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-06-10T19:07:13.365954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"166","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-06-10T19:07:14.695077+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"166","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:07:16.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.070+0000 7f6ed2f02640 1 -- 172.21.15.53:0/744927027 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6eac066280 msgr2=0x7f6eac068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:16.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.070+0000 7f6ed2f02640 1 --2- 172.21.15.53:0/744927027 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6eac066280 0x7f6eac068730 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f6eb40ae000 tx=0x7f6eb40a7070 comp rx=0 tx=0).stop 2023-06-10T19:07:16.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.070+0000 7f6ed2f02640 1 -- 172.21.15.53:0/744927027 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ecc071060 msgr2=0x7f6ecc156430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:16.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.070+0000 7f6ed2f02640 1 --2- 172.21.15.53:0/744927027 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ecc071060 0x7f6ecc156430 secure :-1 s=READY pgs=2380 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc00d5f0 tx=0x7f6ebc00dab0 comp rx=0 tx=0).stop 2023-06-10T19:07:16.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.070+0000 7f6ed2f02640 1 -- 172.21.15.53:0/744927027 shutdown_connections 2023-06-10T19:07:16.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.070+0000 7f6ed2f02640 1 --2- 172.21.15.53:0/744927027 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6eac066280 0x7f6eac068730 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:16.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.070+0000 7f6ed2f02640 1 --2- 172.21.15.53:0/744927027 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6ecc0c9840 0x7f6ecc1511d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:16.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.070+0000 7f6ed2f02640 1 --2- 172.21.15.53:0/744927027 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ecc0afc60 0x7f6ecc0cb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:16.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.070+0000 7f6ed2f02640 1 --2- 172.21.15.53:0/744927027 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ecc071060 0x7f6ecc156430 unknown :-1 s=CLOSED pgs=2380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:16.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.070+0000 7f6ed2f02640 1 -- 172.21.15.53:0/744927027 >> 172.21.15.53:0/744927027 conn(0x7f6ecc06a0d0 msgr2=0x7f6ecc15cd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:16.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.070+0000 7f6ed2f02640 1 -- 172.21.15.53:0/744927027 shutdown_connections 2023-06-10T19:07:16.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.070+0000 7f6ed2f02640 1 -- 172.21.15.53:0/744927027 wait complete. 2023-06-10T19:07:16.088 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:07:16.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.206+0000 7f0759678640 1 Processor -- start 2023-06-10T19:07:16.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.210+0000 7f0759678640 1 -- start start 2023-06-10T19:07:16.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.210+0000 7f0759678640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f07540c9840 0x7f07540c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:16.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.210+0000 7f0759678640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f075406b090 0x7f075406b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:16.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.210+0000 7f0759678640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0754159b50 con 0x7f0754071060 2023-06-10T19:07:16.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.210+0000 7f0759678640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07540ca150 con 0x7f07540c9840 2023-06-10T19:07:16.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.210+0000 7f0759678640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07540702a0 con 0x7f075406b090 2023-06-10T19:07:16.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.210+0000 7f07527fc640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f0754071060 0x7f07540af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:55242/0 (socket says 172.21.15.53:55242) 2023-06-10T19:07:16.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.210+0000 7f07527fc640 1 -- 172.21.15.53:0/1532633509 learned_addr learned my addr 172.21.15.53:0/1532633509 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:07:16.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.210+0000 7f0752ffd640 1 --2- 172.21.15.53:0/1532633509 >> v2:172.21.15.117:3300/0 conn(0x7f07540c9840 0x7f07540c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:16.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.210+0000 7f07537fe640 1 --2- 172.21.15.53:0/1532633509 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f075406b090 0x7f075406b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:16.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.210+0000 7f0751ffb640 1 -- 172.21.15.53:0/1532633509 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3811486076 0 0) 0x7f0754159b50 con 0x7f0754071060 2023-06-10T19:07:16.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.210+0000 7f0751ffb640 1 -- 172.21.15.53:0/1532633509 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f073c003530 con 0x7f0754071060 2023-06-10T19:07:16.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.210+0000 7f0751ffb640 1 -- 172.21.15.53:0/1532633509 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4239585088 0 0) 0x7f073c003530 con 0x7f0754071060 2023-06-10T19:07:16.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.210+0000 7f0751ffb640 1 -- 172.21.15.53:0/1532633509 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f075406b090 msgr2=0x7f075406b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:16.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.210+0000 7f0751ffb640 1 --2- 172.21.15.53:0/1532633509 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f075406b090 0x7f075406b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:16.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.210+0000 7f0751ffb640 1 -- 172.21.15.53:0/1532633509 >> v2:172.21.15.117:3300/0 conn(0x7f07540c9840 msgr2=0x7f07540c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:16.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.210+0000 7f0751ffb640 1 --2- 172.21.15.53:0/1532633509 >> v2:172.21.15.117:3300/0 conn(0x7f07540c9840 0x7f07540c9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:16.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.210+0000 7f0751ffb640 1 -- 172.21.15.53:0/1532633509 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0754070580 con 0x7f0754071060 2023-06-10T19:07:16.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.210+0000 7f0751ffb640 1 -- 172.21.15.53:0/1532633509 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f0748001680 con 0x7f0754071060 2023-06-10T19:07:16.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.210+0000 7f0751ffb640 1 -- 172.21.15.53:0/1532633509 >> v1:172.21.15.53:6789/0 conn(0x7f0754071060 legacy=0x7f07540af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:16.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.210+0000 7f0751ffb640 1 --2- 172.21.15.53:0/1532633509 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f073c0039f0 0x7f073c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:16.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.210+0000 7f0751ffb640 1 --2- 172.21.15.53:0/1532633509 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f073c0047d0 0x7f073c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:16.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.210+0000 7f0751ffb640 1 --2- 172.21.15.53:0/1532633509 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f075406b090 0x7f073c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:16.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.210+0000 7f0751ffb640 1 -- 172.21.15.53:0/1532633509 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07540ca150 con 0x7f073c0047d0 2023-06-10T19:07:16.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.210+0000 7f0751ffb640 1 -- 172.21.15.53:0/1532633509 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07540702a0 con 0x7f073c0039f0 2023-06-10T19:07:16.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.210+0000 7f0751ffb640 1 -- 172.21.15.53:0/1532633509 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f073c00b990 con 0x7f075406b090 2023-06-10T19:07:16.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.210+0000 7f07527fc640 1 --2- 172.21.15.53:0/1532633509 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f073c0047d0 0x7f073c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:16.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.210+0000 7f0752ffd640 1 --2- 172.21.15.53:0/1532633509 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f073c0039f0 0x7f073c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:16.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.210+0000 7f07537fe640 1 --2- 172.21.15.53:0/1532633509 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f075406b090 0x7f073c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:16.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.210+0000 7f07527fc640 1 -- 172.21.15.53:0/1532633509 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f075406b090 msgr2=0x7f073c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:16.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.210+0000 7f07527fc640 1 --2- 172.21.15.53:0/1532633509 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f075406b090 0x7f073c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:16.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.210+0000 7f07527fc640 1 -- 172.21.15.53:0/1532633509 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f073c0039f0 msgr2=0x7f073c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:16.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.210+0000 7f07527fc640 1 --2- 172.21.15.53:0/1532633509 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f073c0039f0 0x7f073c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:16.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.210+0000 7f07527fc640 1 -- 172.21.15.53:0/1532633509 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f073c003530 con 0x7f073c0047d0 2023-06-10T19:07:16.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.214+0000 7f07527fc640 1 --2- 172.21.15.53:0/1532633509 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f073c0047d0 0x7f073c004c40 secure :-1 s=READY pgs=2382 cs=0 l=1 rev1=1 crypto rx=0x7f0754071470 tx=0x7f074801f410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef86c63eb46b1165 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:16.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.214+0000 7f0751ffb640 1 -- 172.21.15.53:0/1532633509 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0748005ae0 con 0x7f073c0047d0 2023-06-10T19:07:16.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.214+0000 7f0751ffb640 1 -- 172.21.15.53:0/1532633509 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07480ab070 con 0x7f073c0047d0 2023-06-10T19:07:16.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.214+0000 7f0751ffb640 1 -- 172.21.15.53:0/1532633509 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0748005e80 con 0x7f073c0047d0 2023-06-10T19:07:16.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.214+0000 7f0759678640 1 -- 172.21.15.53:0/1532633509 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f073c0047d0 msgr2=0x7f073c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:16.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.214+0000 7f0759678640 1 --2- 172.21.15.53:0/1532633509 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f073c0047d0 0x7f073c004c40 secure :-1 s=READY pgs=2382 cs=0 l=1 rev1=1 crypto rx=0x7f0754071470 tx=0x7f074801f410 comp rx=0 tx=0).stop 2023-06-10T19:07:16.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.214+0000 7f07537fe640 1 -- 172.21.15.53:0/1532633509 reap_dead start 2023-06-10T19:07:16.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.214+0000 7f0759678640 1 -- 172.21.15.53:0/1532633509 shutdown_connections 2023-06-10T19:07:16.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.214+0000 7f0759678640 1 -- 172.21.15.53:0/1532633509 >> 172.21.15.53:0/1532633509 conn(0x7f075406a0d0 msgr2=0x7f07540ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:16.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.214+0000 7f0759678640 1 -- 172.21.15.53:0/1532633509 shutdown_connections 2023-06-10T19:07:16.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.214+0000 7f0759678640 1 -- 172.21.15.53:0/1532633509 wait complete. 2023-06-10T19:07:16.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.214+0000 7f0759678640 1 Processor -- start 2023-06-10T19:07:16.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.214+0000 7f0759678640 1 -- start start 2023-06-10T19:07:16.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.214+0000 7f0759678640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f073c0047d0 0x7f07540c7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:16.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.214+0000 7f0759678640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0754154e60 0x7f0754154650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:16.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.214+0000 7f0759678640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07540ae750 0x7f07540aebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:16.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.214+0000 7f0759678640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07540b1580 con 0x7f07540ae750 2023-06-10T19:07:16.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.214+0000 7f0759678640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07540af100 con 0x7f073c0047d0 2023-06-10T19:07:16.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.214+0000 7f0759678640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07540c7c60 con 0x7f0754154e60 2023-06-10T19:07:16.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.214+0000 7f07537fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07540ae750 0x7f07540aebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:16.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.214+0000 7f07537fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07540ae750 0x7f07540aebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33744/0 (socket says 172.21.15.53:33744) 2023-06-10T19:07:16.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.214+0000 7f07537fe640 1 -- 172.21.15.53:0/3953984320 learned_addr learned my addr 172.21.15.53:0/3953984320 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:16.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.218+0000 7f07527fc640 1 --2- 172.21.15.53:0/3953984320 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0754154e60 0x7f0754154650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:16.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.218+0000 7f0752ffd640 1 --2- 172.21.15.53:0/3953984320 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f073c0047d0 0x7f07540c7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:16.232 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.218+0000 7f07537fe640 1 -- 172.21.15.53:0/3953984320 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0754154e60 msgr2=0x7f0754154650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:16.232 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.218+0000 7f07537fe640 1 --2- 172.21.15.53:0/3953984320 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0754154e60 0x7f0754154650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:16.232 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.218+0000 7f07537fe640 1 -- 172.21.15.53:0/3953984320 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f073c0047d0 msgr2=0x7f07540c7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:16.232 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.218+0000 7f07537fe640 1 --2- 172.21.15.53:0/3953984320 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f073c0047d0 0x7f07540c7460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:16.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.218+0000 7f07537fe640 1 -- 172.21.15.53:0/3953984320 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07541556e0 con 0x7f07540ae750 2023-06-10T19:07:16.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.218+0000 7f07537fe640 1 --2- 172.21.15.53:0/3953984320 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07540ae750 0x7f07540aebc0 secure :-1 s=READY pgs=2383 cs=0 l=1 rev1=1 crypto rx=0x7f074c007d10 tx=0x7f074c007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:16.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.218+0000 7f073b7fe640 1 -- 172.21.15.53:0/3953984320 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074c00e070 con 0x7f07540ae750 2023-06-10T19:07:16.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.218+0000 7f073b7fe640 1 -- 172.21.15.53:0/3953984320 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f074c003c70 con 0x7f07540ae750 2023-06-10T19:07:16.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.218+0000 7f0759678640 1 -- 172.21.15.53:0/3953984320 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07540c79a0 con 0x7f07540ae750 2023-06-10T19:07:16.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.218+0000 7f073b7fe640 1 -- 172.21.15.53:0/3953984320 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074c003e20 con 0x7f07540ae750 2023-06-10T19:07:16.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.218+0000 7f0759678640 1 -- 172.21.15.53:0/3953984320 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07540b0ec0 con 0x7f07540ae750 2023-06-10T19:07:16.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.218+0000 7f0759678640 1 -- 172.21.15.53:0/3953984320 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f075404d790 con 0x7f07540ae750 2023-06-10T19:07:16.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.218+0000 7f073b7fe640 1 -- 172.21.15.53:0/3953984320 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f074c004030 con 0x7f07540ae750 2023-06-10T19:07:16.235 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.218+0000 7f073b7fe640 1 --2- 172.21.15.53:0/3953984320 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0740066280 0x7f0740068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:16.235 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.218+0000 7f073b7fe640 1 -- 172.21.15.53:0/3953984320 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f074c083cd0 con 0x7f07540ae750 2023-06-10T19:07:16.235 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.218+0000 7f0752ffd640 1 --2- 172.21.15.53:0/3953984320 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0740066280 0x7f0740068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:16.235 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.218+0000 7f0752ffd640 1 --2- 172.21.15.53:0/3953984320 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0740066280 0x7f0740068730 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f0744009b20 tx=0x7f0744008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:16.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.222+0000 7f073b7fe640 1 -- 172.21.15.53:0/3953984320 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f074c051150 con 0x7f07540ae750 2023-06-10T19:07:16.304 INFO:tasks.ceph.mds.c.smithi053.stderr:2023-06-10T19:07:16.302+0000 7fac14360640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-06-10T19:07:16.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.374+0000 7f0759678640 1 -- 172.21.15.53:0/3953984320 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f07540c1120 con 0x7f07540ae750 2023-06-10T19:07:16.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.374+0000 7f073b7fe640 1 -- 172.21.15.53:0/3953984320 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v166) v1 ==== 74+0+18294 (secure 0 0 0) 0x7f074c054770 con 0x7f07540ae750 2023-06-10T19:07:16.376 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:07:16.376 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":166,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:07:15.722534+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-06-10T19:07:13.365954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"166","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-06-10T19:07:14.695077+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"166","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:07:16.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.374+0000 7f0759678640 1 -- 172.21.15.53:0/3953984320 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0740066280 msgr2=0x7f0740068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:16.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.374+0000 7f0759678640 1 --2- 172.21.15.53:0/3953984320 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0740066280 0x7f0740068730 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f0744009b20 tx=0x7f0744008040 comp rx=0 tx=0).stop 2023-06-10T19:07:16.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.374+0000 7f0759678640 1 -- 172.21.15.53:0/3953984320 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07540ae750 msgr2=0x7f07540aebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:16.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.374+0000 7f0759678640 1 --2- 172.21.15.53:0/3953984320 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07540ae750 0x7f07540aebc0 secure :-1 s=READY pgs=2383 cs=0 l=1 rev1=1 crypto rx=0x7f074c007d10 tx=0x7f074c007e00 comp rx=0 tx=0).stop 2023-06-10T19:07:16.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.374+0000 7f0759678640 1 -- 172.21.15.53:0/3953984320 shutdown_connections 2023-06-10T19:07:16.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.374+0000 7f0759678640 1 --2- 172.21.15.53:0/3953984320 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0740066280 0x7f0740068730 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:16.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.374+0000 7f0759678640 1 --2- 172.21.15.53:0/3953984320 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07540ae750 0x7f07540aebc0 unknown :-1 s=CLOSED pgs=2383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:16.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.374+0000 7f0759678640 1 --2- 172.21.15.53:0/3953984320 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0754154e60 0x7f0754154650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:16.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.374+0000 7f0759678640 1 --2- 172.21.15.53:0/3953984320 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f073c0047d0 0x7f07540c7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:16.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.374+0000 7f0759678640 1 -- 172.21.15.53:0/3953984320 >> 172.21.15.53:0/3953984320 conn(0x7f075406a0d0 msgr2=0x7f07540aba10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:16.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.374+0000 7f0759678640 1 -- 172.21.15.53:0/3953984320 shutdown_connections 2023-06-10T19:07:16.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.374+0000 7f0759678640 1 -- 172.21.15.53:0/3953984320 wait complete. 2023-06-10T19:07:16.394 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-06-10T19:07:16.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.522+0000 7f224c82f640 1 Processor -- start 2023-06-10T19:07:16.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.522+0000 7f224c82f640 1 -- start start 2023-06-10T19:07:16.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.522+0000 7f224c82f640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2248159450 0x7f224815d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:16.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.522+0000 7f224c82f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f22480cf350 0x7f22480cbf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:16.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.522+0000 7f224c82f640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22480cbac0 con 0x7f224815d680 2023-06-10T19:07:16.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.522+0000 7f224c82f640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f224815dc00 con 0x7f22480cf350 2023-06-10T19:07:16.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.522+0000 7f224c82f640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f224815dee0 con 0x7f2248159450 2023-06-10T19:07:16.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.526+0000 7f2246d9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f22480cf350 0x7f22480cbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:16.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.526+0000 7f2246d9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f22480cf350 0x7f22480cbf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33756/0 (socket says 172.21.15.53:33756) 2023-06-10T19:07:16.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.526+0000 7f2245d9b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f224815d680 0x7f22480cec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:55246/0 (socket says 172.21.15.53:55246) 2023-06-10T19:07:16.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.526+0000 7f2246d9d640 1 -- 172.21.15.53:0/2752049056 learned_addr learned my addr 172.21.15.53:0/2752049056 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:16.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.526+0000 7f224659c640 1 --2- 172.21.15.53:0/2752049056 >> v2:172.21.15.117:3300/0 conn(0x7f2248159450 0x7f224815d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:16.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.526+0000 7f2246d9d640 1 -- 172.21.15.53:0/2752049056 >> v2:172.21.15.117:3300/0 conn(0x7f2248159450 msgr2=0x7f224815d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:16.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.526+0000 7f2246d9d640 1 --2- 172.21.15.53:0/2752049056 >> v2:172.21.15.117:3300/0 conn(0x7f2248159450 0x7f224815d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:16.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.526+0000 7f2246d9d640 1 -- 172.21.15.53:0/2752049056 >> v1:172.21.15.53:6789/0 conn(0x7f224815d680 legacy=0x7f22480cec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:16.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.526+0000 7f2246d9d640 1 -- 172.21.15.53:0/2752049056 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22480cb750 con 0x7f22480cf350 2023-06-10T19:07:16.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.526+0000 7f2246d9d640 1 --2- 172.21.15.53:0/2752049056 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22480cf350 0x7f22480cbf50 secure :-1 s=READY pgs=2385 cs=0 l=1 rev1=1 crypto rx=0x7f22480b29a0 tx=0x7f224001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff5d29cffd575e33 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:16.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.526+0000 7f224559a640 1 -- 172.21.15.53:0/2752049056 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22400a5850 con 0x7f22480cf350 2023-06-10T19:07:16.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.526+0000 7f224559a640 1 -- 172.21.15.53:0/2752049056 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22400a59b0 con 0x7f22480cf350 2023-06-10T19:07:16.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.526+0000 7f224559a640 1 -- 172.21.15.53:0/2752049056 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22400a5d40 con 0x7f22480cf350 2023-06-10T19:07:16.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.526+0000 7f224c82f640 1 -- 172.21.15.53:0/2752049056 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22480cf350 msgr2=0x7f22480cbf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:16.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.526+0000 7f224c82f640 1 --2- 172.21.15.53:0/2752049056 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22480cf350 0x7f22480cbf50 secure :-1 s=READY pgs=2385 cs=0 l=1 rev1=1 crypto rx=0x7f22480b29a0 tx=0x7f224001c970 comp rx=0 tx=0).stop 2023-06-10T19:07:16.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.526+0000 7f224c82f640 1 -- 172.21.15.53:0/2752049056 shutdown_connections 2023-06-10T19:07:16.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.526+0000 7f224c82f640 1 --2- 172.21.15.53:0/2752049056 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f22480cf350 0x7f22480cbf50 unknown :-1 s=CLOSED pgs=2385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:16.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.526+0000 7f224c82f640 1 --2- 172.21.15.53:0/2752049056 >> v2:172.21.15.117:3300/0 conn(0x7f2248159450 0x7f224815d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:16.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.526+0000 7f224c82f640 1 -- 172.21.15.53:0/2752049056 >> 172.21.15.53:0/2752049056 conn(0x7f224806a090 msgr2=0x7f224806d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:16.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.526+0000 7f224c82f640 1 -- 172.21.15.53:0/2752049056 shutdown_connections 2023-06-10T19:07:16.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.526+0000 7f224c82f640 1 -- 172.21.15.53:0/2752049056 wait complete. 2023-06-10T19:07:16.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.530+0000 7f224c82f640 1 Processor -- start 2023-06-10T19:07:16.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.530+0000 7f224c82f640 1 -- start start 2023-06-10T19:07:16.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.530+0000 7f224c82f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22480cf350 0x7f22481583a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:16.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.530+0000 7f224c82f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2248159450 0x7f22481f21c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:16.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.530+0000 7f224c82f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f224815d680 0x7f22481f4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:16.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.530+0000 7f224c82f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22481f1d30 con 0x7f224815d680 2023-06-10T19:07:16.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.530+0000 7f224c82f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22481f5d40 con 0x7f22480cf350 2023-06-10T19:07:16.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.530+0000 7f224c82f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22481f5780 con 0x7f2248159450 2023-06-10T19:07:16.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.530+0000 7f2246d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f224815d680 0x7f22481f4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:16.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.530+0000 7f2246d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f224815d680 0x7f22481f4e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33760/0 (socket says 172.21.15.53:33760) 2023-06-10T19:07:16.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.530+0000 7f2246d9d640 1 -- 172.21.15.53:0/2457164528 learned_addr learned my addr 172.21.15.53:0/2457164528 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:16.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.530+0000 7f224659c640 1 --2- 172.21.15.53:0/2457164528 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22480cf350 0x7f22481583a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:16.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.530+0000 7f2245d9b640 1 --2- 172.21.15.53:0/2457164528 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2248159450 0x7f22481f21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:16.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.530+0000 7f2246d9d640 1 -- 172.21.15.53:0/2457164528 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2248159450 msgr2=0x7f22481f21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:16.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.530+0000 7f2246d9d640 1 --2- 172.21.15.53:0/2457164528 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2248159450 0x7f22481f21c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:16.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.530+0000 7f2246d9d640 1 -- 172.21.15.53:0/2457164528 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22480cf350 msgr2=0x7f22481583a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:16.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.530+0000 7f2246d9d640 1 --2- 172.21.15.53:0/2457164528 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22480cf350 0x7f22481583a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:16.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.530+0000 7f2246d9d640 1 -- 172.21.15.53:0/2457164528 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2240009b30 con 0x7f224815d680 2023-06-10T19:07:16.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.530+0000 7f2246d9d640 1 --2- 172.21.15.53:0/2457164528 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f224815d680 0x7f22481f4e10 secure :-1 s=READY pgs=2386 cs=0 l=1 rev1=1 crypto rx=0x7f22400af040 tx=0x7f2240019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:16.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.530+0000 7f2236ffd640 1 -- 172.21.15.53:0/2457164528 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22400b8670 con 0x7f224815d680 2023-06-10T19:07:16.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.530+0000 7f224c82f640 1 -- 172.21.15.53:0/2457164528 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22481f5a60 con 0x7f224815d680 2023-06-10T19:07:16.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.530+0000 7f2236ffd640 1 -- 172.21.15.53:0/2457164528 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22400b87d0 con 0x7f224815d680 2023-06-10T19:07:16.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.530+0000 7f2236ffd640 1 -- 172.21.15.53:0/2457164528 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22400b8b80 con 0x7f224815d680 2023-06-10T19:07:16.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.530+0000 7f224c82f640 1 -- 172.21.15.53:0/2457164528 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22481588e0 con 0x7f224815d680 2023-06-10T19:07:16.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.530+0000 7f224c82f640 1 -- 172.21.15.53:0/2457164528 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22481f17f0 con 0x7f224815d680 2023-06-10T19:07:16.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.534+0000 7f2236ffd640 1 -- 172.21.15.53:0/2457164528 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f22400b8ce0 con 0x7f224815d680 2023-06-10T19:07:16.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.534+0000 7f2236ffd640 1 --2- 172.21.15.53:0/2457164528 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2228066280 0x7f2228068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:16.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.534+0000 7f2236ffd640 1 -- 172.21.15.53:0/2457164528 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f224011f800 con 0x7f224815d680 2023-06-10T19:07:16.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.534+0000 7f224659c640 1 --2- 172.21.15.53:0/2457164528 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2228066280 0x7f2228068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:16.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.534+0000 7f224659c640 1 --2- 172.21.15.53:0/2457164528 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2228066280 0x7f2228068730 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f223800b9d0 tx=0x7f2238008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:16.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.538+0000 7f2236ffd640 1 -- 172.21.15.53:0/2457164528 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f22400ece70 con 0x7f224815d680 2023-06-10T19:07:16.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:16.726+0000 7f224c82f640 1 -- 172.21.15.53:0/2457164528 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f224804d790 con 0x7f224815d680 2023-06-10T19:07:17.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:17.354+0000 7f2236ffd640 1 -- 172.21.15.53:0/2457164528 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v95) v1 ==== 118+0+0 (secure 0 0 0) 0x7f22400f0490 con 0x7f224815d680 2023-06-10T19:07:17.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:17.358+0000 7f224c82f640 1 -- 172.21.15.53:0/2457164528 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2228066280 msgr2=0x7f2228068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:17.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:17.358+0000 7f224c82f640 1 --2- 172.21.15.53:0/2457164528 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2228066280 0x7f2228068730 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f223800b9d0 tx=0x7f2238008040 comp rx=0 tx=0).stop 2023-06-10T19:07:17.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:17.358+0000 7f224c82f640 1 -- 172.21.15.53:0/2457164528 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f224815d680 msgr2=0x7f22481f4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:17.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:17.358+0000 7f224c82f640 1 --2- 172.21.15.53:0/2457164528 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f224815d680 0x7f22481f4e10 secure :-1 s=READY pgs=2386 cs=0 l=1 rev1=1 crypto rx=0x7f22400af040 tx=0x7f2240019770 comp rx=0 tx=0).stop 2023-06-10T19:07:17.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:17.358+0000 7f224c82f640 1 -- 172.21.15.53:0/2457164528 shutdown_connections 2023-06-10T19:07:17.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:17.358+0000 7f224c82f640 1 --2- 172.21.15.53:0/2457164528 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2228066280 0x7f2228068730 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:17.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:17.358+0000 7f224c82f640 1 --2- 172.21.15.53:0/2457164528 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f224815d680 0x7f22481f4e10 unknown :-1 s=CLOSED pgs=2386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:17.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:17.358+0000 7f224c82f640 1 --2- 172.21.15.53:0/2457164528 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2248159450 0x7f22481f21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:17.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:17.358+0000 7f224c82f640 1 --2- 172.21.15.53:0/2457164528 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22480cf350 0x7f22481583a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:17.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:17.358+0000 7f224c82f640 1 -- 172.21.15.53:0/2457164528 >> 172.21.15.53:0/2457164528 conn(0x7f224806a090 msgr2=0x7f22480b00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:17.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:17.358+0000 7f224c82f640 1 -- 172.21.15.53:0/2457164528 shutdown_connections 2023-06-10T19:07:17.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:17.358+0000 7f224c82f640 1 -- 172.21.15.53:0/2457164528 wait complete. 2023-06-10T19:07:17.381 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-06-10T19:07:17.382 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-06-10T19:07:17.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:17.506+0000 7fc832312640 1 Processor -- start 2023-06-10T19:07:17.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:17.506+0000 7fc832312640 1 -- start start 2023-06-10T19:07:17.510 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:17.506+0000 7fc832312640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc82c15c090 0x7fc82c0b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:17.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:17.506+0000 7fc832312640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc82c0b0b90 0x7fc82c0b7720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:17.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:17.506+0000 7fc832312640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc82c0cc7c0 con 0x7fc82c0b7c60 2023-06-10T19:07:17.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:17.506+0000 7fc832312640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc82c0b80e0 con 0x7fc82c15c090 2023-06-10T19:07:17.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:17.506+0000 7fc832312640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc82c0ccaa0 con 0x7fc82c0b0b90 2023-06-10T19:07:17.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:17.506+0000 7fc8308af640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fc82c0b7c60 0x7fc82c0b3b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:55260/0 (socket says 172.21.15.53:55260) 2023-06-10T19:07:17.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:17.506+0000 7fc8308af640 1 -- 172.21.15.53:0/3379308094 learned_addr learned my addr 172.21.15.53:0/3379308094 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:07:17.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:17.506+0000 7fc82bfff640 1 --2- 172.21.15.53:0/3379308094 >> v2:172.21.15.53:3300/0 conn(0x7fc82c15c090 0x7fc82c0b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:17.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:17.506+0000 7fc82b7fe640 1 --2- 172.21.15.53:0/3379308094 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc82c0b0b90 0x7fc82c0b7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:17.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:17.506+0000 7fc82affd640 1 -- 172.21.15.53:0/3379308094 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3518200042 0 0) 0x7fc82c0cc7c0 con 0x7fc82c0b7c60 2023-06-10T19:07:17.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:17.506+0000 7fc82affd640 1 -- 172.21.15.53:0/3379308094 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc814003530 con 0x7fc82c0b7c60 2023-06-10T19:07:17.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:17.506+0000 7fc82bfff640 1 -- 172.21.15.53:0/3379308094 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc82c0b0b90 msgr2=0x7fc82c0b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:17.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:17.506+0000 7fc82bfff640 1 --2- 172.21.15.53:0/3379308094 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc82c0b0b90 0x7fc82c0b7720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:17.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:17.506+0000 7fc82bfff640 1 -- 172.21.15.53:0/3379308094 >> v1:172.21.15.53:6789/0 conn(0x7fc82c0b7c60 legacy=0x7fc82c0b3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:17.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:17.506+0000 7fc82bfff640 1 -- 172.21.15.53:0/3379308094 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc82c0ccd80 con 0x7fc82c15c090 2023-06-10T19:07:17.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:17.506+0000 7fc82b7fe640 1 --2- 172.21.15.53:0/3379308094 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc82c0b0b90 0x7fc82c0b7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:07:17.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:17.510+0000 7fc82bfff640 1 --2- 172.21.15.53:0/3379308094 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc82c15c090 0x7fc82c0b10c0 secure :-1 s=READY pgs=2388 cs=0 l=1 rev1=1 crypto rx=0x7fc81c0097c0 tx=0x7fc81c01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95cccb5699426fb4 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:17.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:17.510+0000 7fc82affd640 1 -- 172.21.15.53:0/3379308094 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81c0ab600 con 0x7fc82c15c090 2023-06-10T19:07:17.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:17.510+0000 7fc82affd640 1 -- 172.21.15.53:0/3379308094 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc81c0a7050 con 0x7fc82c15c090 2023-06-10T19:07:17.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:17.510+0000 7fc82affd640 1 -- 172.21.15.53:0/3379308094 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81c0ab980 con 0x7fc82c15c090 2023-06-10T19:07:17.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:17.510+0000 7fc832312640 1 -- 172.21.15.53:0/3379308094 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc82c15c090 msgr2=0x7fc82c0b10c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:17.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:17.510+0000 7fc832312640 1 --2- 172.21.15.53:0/3379308094 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc82c15c090 0x7fc82c0b10c0 secure :-1 s=READY pgs=2388 cs=0 l=1 rev1=1 crypto rx=0x7fc81c0097c0 tx=0x7fc81c01c3c0 comp rx=0 tx=0).stop 2023-06-10T19:07:17.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:17.510+0000 7fc832312640 1 -- 172.21.15.53:0/3379308094 shutdown_connections 2023-06-10T19:07:17.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:17.510+0000 7fc832312640 1 --2- 172.21.15.53:0/3379308094 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc82c0b0b90 0x7fc82c0b7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:17.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:17.510+0000 7fc832312640 1 --2- 172.21.15.53:0/3379308094 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc82c15c090 0x7fc82c0b10c0 unknown :-1 s=CLOSED pgs=2388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:17.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:17.510+0000 7fc832312640 1 -- 172.21.15.53:0/3379308094 >> 172.21.15.53:0/3379308094 conn(0x7fc82c069e20 msgr2=0x7fc82c06a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:17.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:17.510+0000 7fc832312640 1 -- 172.21.15.53:0/3379308094 shutdown_connections 2023-06-10T19:07:17.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:17.510+0000 7fc832312640 1 -- 172.21.15.53:0/3379308094 wait complete. 2023-06-10T19:07:17.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:17.510+0000 7fc832312640 1 Processor -- start 2023-06-10T19:07:17.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:17.510+0000 7fc832312640 1 -- start start 2023-06-10T19:07:17.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:17.510+0000 7fc832312640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc82c0b0b90 0x7fc82c0c2780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:17.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:17.510+0000 7fc832312640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc82c0b7c60 0x7fc82c154b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:17.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:17.510+0000 7fc832312640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc82c15c090 0x7fc82c0b6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:17.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:17.510+0000 7fc832312640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc82c0b6520 con 0x7fc82c15c090 2023-06-10T19:07:17.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:17.514+0000 7fc832312640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc82c1550a0 con 0x7fc82c0b7c60 2023-06-10T19:07:17.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:17.514+0000 7fc832312640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc82c0b62b0 con 0x7fc82c0b0b90 2023-06-10T19:07:17.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:17.514+0000 7fc8308af640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc82c15c090 0x7fc82c0b6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:17.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:17.514+0000 7fc8308af640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc82c15c090 0x7fc82c0b6940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33788/0 (socket says 172.21.15.53:33788) 2023-06-10T19:07:17.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:17.514+0000 7fc8308af640 1 -- 172.21.15.53:0/205921711 learned_addr learned my addr 172.21.15.53:0/205921711 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:17.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:17.514+0000 7fc82bfff640 1 --2- 172.21.15.53:0/205921711 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc82c0b0b90 0x7fc82c0c2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:17.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:17.514+0000 7fc82b7fe640 1 --2- 172.21.15.53:0/205921711 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc82c0b7c60 0x7fc82c154b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:17.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:17.514+0000 7fc8308af640 1 -- 172.21.15.53:0/205921711 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc82c0b0b90 msgr2=0x7fc82c0c2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:17.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:17.514+0000 7fc8308af640 1 --2- 172.21.15.53:0/205921711 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc82c0b0b90 0x7fc82c0c2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:17.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:17.514+0000 7fc8308af640 1 -- 172.21.15.53:0/205921711 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc82c0b7c60 msgr2=0x7fc82c154b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:17.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:17.514+0000 7fc8308af640 1 --2- 172.21.15.53:0/205921711 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc82c0b7c60 0x7fc82c154b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:17.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:17.514+0000 7fc8308af640 1 -- 172.21.15.53:0/205921711 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc81c009420 con 0x7fc82c15c090 2023-06-10T19:07:17.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:17.514+0000 7fc8308af640 1 --2- 172.21.15.53:0/205921711 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc82c15c090 0x7fc82c0b6940 secure :-1 s=READY pgs=2389 cs=0 l=1 rev1=1 crypto rx=0x7fc82400cb70 tx=0x7fc82400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:17.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:17.514+0000 7fc828ff9640 1 -- 172.21.15.53:0/205921711 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82400ad40 con 0x7fc82c15c090 2023-06-10T19:07:17.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:17.514+0000 7fc828ff9640 1 -- 172.21.15.53:0/205921711 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc824012400 con 0x7fc82c15c090 2023-06-10T19:07:17.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:17.514+0000 7fc832312640 1 -- 172.21.15.53:0/205921711 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc82c1530e0 con 0x7fc82c15c090 2023-06-10T19:07:17.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:17.514+0000 7fc828ff9640 1 -- 172.21.15.53:0/205921711 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82400aea0 con 0x7fc82c15c090 2023-06-10T19:07:17.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:17.514+0000 7fc832312640 1 -- 172.21.15.53:0/205921711 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc82c1536a0 con 0x7fc82c15c090 2023-06-10T19:07:17.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:17.514+0000 7fc832312640 1 -- 172.21.15.53:0/205921711 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc82c0b6660 con 0x7fc82c15c090 2023-06-10T19:07:17.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:17.514+0000 7fc828ff9640 1 -- 172.21.15.53:0/205921711 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc824007070 con 0x7fc82c15c090 2023-06-10T19:07:17.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:17.514+0000 7fc828ff9640 1 --2- 172.21.15.53:0/205921711 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc818066280 0x7fc818068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:17.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:17.514+0000 7fc828ff9640 1 -- 172.21.15.53:0/205921711 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc824083d70 con 0x7fc82c15c090 2023-06-10T19:07:17.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:17.514+0000 7fc82bfff640 1 --2- 172.21.15.53:0/205921711 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc818066280 0x7fc818068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:17.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:17.514+0000 7fc82bfff640 1 --2- 172.21.15.53:0/205921711 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc818066280 0x7fc818068730 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fc81c0ad000 tx=0x7fc81c0a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:17.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:17.518+0000 7fc828ff9640 1 -- 172.21.15.53:0/205921711 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc82c0b6660 con 0x7fc82c15c090 2023-06-10T19:07:17.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:17.702+0000 7fc832312640 1 -- 172.21.15.53:0/205921711 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fc82c0b6660 con 0x7fc82c15c090 2023-06-10T19:07:18.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.366+0000 7fc828ff9640 1 -- 172.21.15.53:0/205921711 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v96) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc82c0b6660 con 0x7fc82c15c090 2023-06-10T19:07:18.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.370+0000 7fc832312640 1 -- 172.21.15.53:0/205921711 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc818066280 msgr2=0x7fc818068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:18.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.370+0000 7fc832312640 1 --2- 172.21.15.53:0/205921711 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc818066280 0x7fc818068730 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fc81c0ad000 tx=0x7fc81c0a6000 comp rx=0 tx=0).stop 2023-06-10T19:07:18.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.370+0000 7fc832312640 1 -- 172.21.15.53:0/205921711 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc82c15c090 msgr2=0x7fc82c0b6940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:18.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.370+0000 7fc832312640 1 --2- 172.21.15.53:0/205921711 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc82c15c090 0x7fc82c0b6940 secure :-1 s=READY pgs=2389 cs=0 l=1 rev1=1 crypto rx=0x7fc82400cb70 tx=0x7fc82400a430 comp rx=0 tx=0).stop 2023-06-10T19:07:18.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.370+0000 7fc832312640 1 -- 172.21.15.53:0/205921711 shutdown_connections 2023-06-10T19:07:18.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.370+0000 7fc832312640 1 --2- 172.21.15.53:0/205921711 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc818066280 0x7fc818068730 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:18.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.370+0000 7fc832312640 1 --2- 172.21.15.53:0/205921711 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc82c15c090 0x7fc82c0b6940 unknown :-1 s=CLOSED pgs=2389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:18.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.370+0000 7fc832312640 1 --2- 172.21.15.53:0/205921711 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc82c0b7c60 0x7fc82c154b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:18.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.370+0000 7fc832312640 1 --2- 172.21.15.53:0/205921711 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc82c0b0b90 0x7fc82c0c2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:18.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.370+0000 7fc832312640 1 -- 172.21.15.53:0/205921711 >> 172.21.15.53:0/205921711 conn(0x7fc82c069e20 msgr2=0x7fc82c0d04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:18.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.370+0000 7fc832312640 1 -- 172.21.15.53:0/205921711 shutdown_connections 2023-06-10T19:07:18.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.370+0000 7fc832312640 1 -- 172.21.15.53:0/205921711 wait complete. 2023-06-10T19:07:18.393 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-06-10T19:07:18.393 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:07:18.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.522+0000 7fde9faa9640 1 Processor -- start 2023-06-10T19:07:18.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.522+0000 7fde9faa9640 1 -- start start 2023-06-10T19:07:18.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.522+0000 7fde9faa9640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fde98071060 0x7fde980af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:18.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.522+0000 7fde9faa9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde980afc60 0x7fde9806b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:18.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.522+0000 7fde9faa9640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde98159b50 con 0x7fde980c9840 2023-06-10T19:07:18.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.522+0000 7fde9faa9640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde980702a0 con 0x7fde98071060 2023-06-10T19:07:18.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.522+0000 7fde9faa9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde98070580 con 0x7fde980afc60 2023-06-10T19:07:18.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.522+0000 7fde9d044640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fde98071060 0x7fde980af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:18.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.522+0000 7fde9d044640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fde98071060 0x7fde980af720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33798/0 (socket says 172.21.15.53:33798) 2023-06-10T19:07:18.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.522+0000 7fde9d044640 1 -- 172.21.15.53:0/1269906000 learned_addr learned my addr 172.21.15.53:0/1269906000 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:18.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.522+0000 7fde9e046640 1 --2- 172.21.15.53:0/1269906000 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde980afc60 0x7fde9806b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:18.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.522+0000 7fde9d044640 1 -- 172.21.15.53:0/1269906000 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde980afc60 msgr2=0x7fde9806b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:18.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.522+0000 7fde9d044640 1 --2- 172.21.15.53:0/1269906000 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde980afc60 0x7fde9806b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:18.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.522+0000 7fde9d044640 1 -- 172.21.15.53:0/1269906000 >> v1:172.21.15.117:6789/0 conn(0x7fde980c9840 legacy=0x7fde980c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:18.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.522+0000 7fde9d044640 1 -- 172.21.15.53:0/1269906000 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde98070860 con 0x7fde98071060 2023-06-10T19:07:18.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.526+0000 7fde9d044640 1 --2- 172.21.15.53:0/1269906000 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde98071060 0x7fde980af720 secure :-1 s=READY pgs=2390 cs=0 l=1 rev1=1 crypto rx=0x7fde88009870 tx=0x7fde8801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95b562f81815e8cb server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:18.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.526+0000 7fde9c843640 1 -- 172.21.15.53:0/1269906000 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde880a95f0 con 0x7fde98071060 2023-06-10T19:07:18.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.526+0000 7fde9c843640 1 -- 172.21.15.53:0/1269906000 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde880a9750 con 0x7fde98071060 2023-06-10T19:07:18.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.526+0000 7fde9c843640 1 -- 172.21.15.53:0/1269906000 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde880a9ae0 con 0x7fde98071060 2023-06-10T19:07:18.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.526+0000 7fde9faa9640 1 -- 172.21.15.53:0/1269906000 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde98071060 msgr2=0x7fde980af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:18.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.526+0000 7fde9faa9640 1 --2- 172.21.15.53:0/1269906000 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde98071060 0x7fde980af720 secure :-1 s=READY pgs=2390 cs=0 l=1 rev1=1 crypto rx=0x7fde88009870 tx=0x7fde8801c510 comp rx=0 tx=0).stop 2023-06-10T19:07:18.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.526+0000 7fde9faa9640 1 -- 172.21.15.53:0/1269906000 shutdown_connections 2023-06-10T19:07:18.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.526+0000 7fde9faa9640 1 --2- 172.21.15.53:0/1269906000 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde980afc60 0x7fde9806b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:18.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.526+0000 7fde9faa9640 1 --2- 172.21.15.53:0/1269906000 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde98071060 0x7fde980af720 unknown :-1 s=CLOSED pgs=2390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:18.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.526+0000 7fde9faa9640 1 -- 172.21.15.53:0/1269906000 >> 172.21.15.53:0/1269906000 conn(0x7fde9806a0d0 msgr2=0x7fde980ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:18.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.526+0000 7fde9faa9640 1 -- 172.21.15.53:0/1269906000 shutdown_connections 2023-06-10T19:07:18.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.526+0000 7fde9faa9640 1 -- 172.21.15.53:0/1269906000 wait complete. 2023-06-10T19:07:18.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.526+0000 7fde9faa9640 1 Processor -- start 2023-06-10T19:07:18.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.526+0000 7fde9faa9640 1 -- start start 2023-06-10T19:07:18.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.526+0000 7fde9faa9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde98071060 0x7fde980c7780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:18.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.526+0000 7fde9faa9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde980afc60 0x7fde981584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:18.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.526+0000 7fde9faa9640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde980c9840 0x7fde98158a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:18.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.526+0000 7fde9faa9640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde98150aa0 con 0x7fde980afc60 2023-06-10T19:07:18.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.526+0000 7fde9faa9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde98150d80 con 0x7fde98071060 2023-06-10T19:07:18.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.526+0000 7fde9faa9640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde98151060 con 0x7fde980c9840 2023-06-10T19:07:18.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.526+0000 7fde9d044640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde980afc60 0x7fde981584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:18.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.526+0000 7fde9d044640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde980afc60 0x7fde981584d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33810/0 (socket says 172.21.15.53:33810) 2023-06-10T19:07:18.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.526+0000 7fde9d044640 1 -- 172.21.15.53:0/2143550782 learned_addr learned my addr 172.21.15.53:0/2143550782 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:18.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.526+0000 7fde9e046640 1 --2- 172.21.15.53:0/2143550782 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde980c9840 0x7fde98158a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:18.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.526+0000 7fde9d845640 1 --2- 172.21.15.53:0/2143550782 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde98071060 0x7fde980c7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:18.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.526+0000 7fde9d044640 1 -- 172.21.15.53:0/2143550782 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde980c9840 msgr2=0x7fde98158a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:18.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.526+0000 7fde9d044640 1 --2- 172.21.15.53:0/2143550782 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde980c9840 0x7fde98158a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:18.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.526+0000 7fde9d044640 1 -- 172.21.15.53:0/2143550782 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde98071060 msgr2=0x7fde980c7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:18.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.526+0000 7fde9d044640 1 --2- 172.21.15.53:0/2143550782 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde98071060 0x7fde980c7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:18.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.526+0000 7fde9d044640 1 -- 172.21.15.53:0/2143550782 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde880094d0 con 0x7fde980afc60 2023-06-10T19:07:18.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.530+0000 7fde9d044640 1 --2- 172.21.15.53:0/2143550782 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde980afc60 0x7fde981584d0 secure :-1 s=READY pgs=2391 cs=0 l=1 rev1=1 crypto rx=0x7fde880ab040 tx=0x7fde8801ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:18.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.530+0000 7fde8e7fc640 1 -- 172.21.15.53:0/2143550782 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde880bc650 con 0x7fde980afc60 2023-06-10T19:07:18.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.530+0000 7fde8e7fc640 1 -- 172.21.15.53:0/2143550782 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde880bc7b0 con 0x7fde980afc60 2023-06-10T19:07:18.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.530+0000 7fde8e7fc640 1 -- 172.21.15.53:0/2143550782 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde880bcb60 con 0x7fde980afc60 2023-06-10T19:07:18.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.530+0000 7fde9faa9640 1 -- 172.21.15.53:0/2143550782 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde98151340 con 0x7fde980afc60 2023-06-10T19:07:18.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.530+0000 7fde9faa9640 1 -- 172.21.15.53:0/2143550782 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde980c7cc0 con 0x7fde980afc60 2023-06-10T19:07:18.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.530+0000 7fde9faa9640 1 -- 172.21.15.53:0/2143550782 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde980b1f90 con 0x7fde980afc60 2023-06-10T19:07:18.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.530+0000 7fde8e7fc640 1 -- 172.21.15.53:0/2143550782 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fde880bccc0 con 0x7fde980afc60 2023-06-10T19:07:18.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.530+0000 7fde8e7fc640 1 --2- 172.21.15.53:0/2143550782 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fde7c066280 0x7fde7c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:18.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.530+0000 7fde8e7fc640 1 -- 172.21.15.53:0/2143550782 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fde8811e640 con 0x7fde980afc60 2023-06-10T19:07:18.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.530+0000 7fde9d845640 1 --2- 172.21.15.53:0/2143550782 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fde7c066280 0x7fde7c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:18.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.534+0000 7fde9d845640 1 --2- 172.21.15.53:0/2143550782 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fde7c066280 0x7fde7c068730 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fde9814f870 tx=0x7fde94009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:18.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.534+0000 7fde8e7fc640 1 -- 172.21.15.53:0/2143550782 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fde880eba20 con 0x7fde980afc60 2023-06-10T19:07:18.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.722+0000 7fde9faa9640 1 -- 172.21.15.53:0/2143550782 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fde9804d790 con 0x7fde980afc60 2023-06-10T19:07:18.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.722+0000 7fde8e7fc640 1 -- 172.21.15.53:0/2143550782 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 96 v96) v1 ==== 94+0+4685 (secure 0 0 0) 0x7fde880ef040 con 0x7fde980afc60 2023-06-10T19:07:18.724 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:07:18.724 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":96,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8614,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3518533956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3518533956},{"type":"v1","addr":"172.21.15.117:6835","nonce":3518533956}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92},{"gid":8617,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/2615123885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2615123885},{"type":"v1","addr":"172.21.15.117:6837","nonce":2615123885}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92},{"gid":10551,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/3498697556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3498697556},{"type":"v1","addr":"172.21.15.53:6833","nonce":3498697556}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92}],"filesystems":[{"mdsmap":{"epoch":96,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:07:15.723316+0000","modified":"2023-06-10T19:07:18.354630+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10557},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10557":{"gid":10557,"name":"c","rank":0,"incarnation":93,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/3721509006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":3721509006},{"type":"v1","addr":"172.21.15.53:6835","nonce":3721509006}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-06-10T19:07:18.724 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 96 2023-06-10T19:07:18.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.722+0000 7fde9faa9640 1 -- 172.21.15.53:0/2143550782 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fde7c066280 msgr2=0x7fde7c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:18.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.722+0000 7fde9faa9640 1 --2- 172.21.15.53:0/2143550782 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fde7c066280 0x7fde7c068730 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fde9814f870 tx=0x7fde94009040 comp rx=0 tx=0).stop 2023-06-10T19:07:18.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.722+0000 7fde9faa9640 1 -- 172.21.15.53:0/2143550782 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde980afc60 msgr2=0x7fde981584d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:18.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.722+0000 7fde9faa9640 1 --2- 172.21.15.53:0/2143550782 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde980afc60 0x7fde981584d0 secure :-1 s=READY pgs=2391 cs=0 l=1 rev1=1 crypto rx=0x7fde880ab040 tx=0x7fde8801ad50 comp rx=0 tx=0).stop 2023-06-10T19:07:18.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.722+0000 7fde9faa9640 1 -- 172.21.15.53:0/2143550782 shutdown_connections 2023-06-10T19:07:18.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.722+0000 7fde9faa9640 1 --2- 172.21.15.53:0/2143550782 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fde7c066280 0x7fde7c068730 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:18.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.722+0000 7fde9faa9640 1 --2- 172.21.15.53:0/2143550782 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fde980c9840 0x7fde98158a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:18.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.722+0000 7fde9faa9640 1 --2- 172.21.15.53:0/2143550782 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde980afc60 0x7fde981584d0 unknown :-1 s=CLOSED pgs=2391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:18.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.722+0000 7fde9faa9640 1 --2- 172.21.15.53:0/2143550782 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fde98071060 0x7fde980c7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:18.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.722+0000 7fde9faa9640 1 -- 172.21.15.53:0/2143550782 >> 172.21.15.53:0/2143550782 conn(0x7fde9806a0d0 msgr2=0x7fde980cc7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:18.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.722+0000 7fde9faa9640 1 -- 172.21.15.53:0/2143550782 shutdown_connections 2023-06-10T19:07:18.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.722+0000 7fde9faa9640 1 -- 172.21.15.53:0/2143550782 wait complete. 2023-06-10T19:07:18.741 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:07:18.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.862+0000 7f48417d7640 1 Processor -- start 2023-06-10T19:07:18.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.862+0000 7f48417d7640 1 -- start start 2023-06-10T19:07:18.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.862+0000 7f48417d7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f483c162640 0x7f483c164a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:18.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.862+0000 7f48417d7640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f483c159b50 con 0x7f483c0c9840 2023-06-10T19:07:18.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.862+0000 7f48417d7640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f483c0702a0 con 0x7f483c071060 2023-06-10T19:07:18.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.862+0000 7f48417d7640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f483c070580 con 0x7f483c162640 2023-06-10T19:07:18.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.862+0000 7f483affd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f483c0c9840 0x7f483c0c9c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:55266/0 (socket says 172.21.15.53:55266) 2023-06-10T19:07:18.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.862+0000 7f483affd640 1 -- 172.21.15.53:0/2569313074 learned_addr learned my addr 172.21.15.53:0/2569313074 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:07:18.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.862+0000 7f483b7fe640 1 --2- 172.21.15.53:0/2569313074 >> v2:172.21.15.53:3300/0 conn(0x7f483c162640 0x7f483c164a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:18.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.862+0000 7f4839ffb640 1 -- 172.21.15.53:0/2569313074 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1849796692 0 0) 0x7f483c159b50 con 0x7f483c0c9840 2023-06-10T19:07:18.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.862+0000 7f4839ffb640 1 -- 172.21.15.53:0/2569313074 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4828003530 con 0x7f483c0c9840 2023-06-10T19:07:18.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.862+0000 7f483b7fe640 1 -- 172.21.15.53:0/2569313074 >> v1:172.21.15.117:6789/0 conn(0x7f483c071060 legacy=0x7f483c0af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:18.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.862+0000 7f483b7fe640 1 -- 172.21.15.53:0/2569313074 >> v1:172.21.15.53:6789/0 conn(0x7f483c0c9840 legacy=0x7f483c0c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:18.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.862+0000 7f4839ffb640 1 -- 172.21.15.53:0/2569313074 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2112976468 0 0) 0x7f4828003530 con 0x7f483c0c9840 2023-06-10T19:07:18.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.862+0000 7f483b7fe640 1 -- 172.21.15.53:0/2569313074 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f483c070860 con 0x7f483c162640 2023-06-10T19:07:18.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.866+0000 7f483b7fe640 1 --2- 172.21.15.53:0/2569313074 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f483c162640 0x7f483c164a20 secure :-1 s=READY pgs=2393 cs=0 l=1 rev1=1 crypto rx=0x7f4834009d90 tx=0x7f483401c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16cb04abfa13b6c0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:18.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.866+0000 7f4839ffb640 1 -- 172.21.15.53:0/2569313074 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4824001680 con 0x7f483c162640 2023-06-10T19:07:18.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.866+0000 7f4839ffb640 1 -- 172.21.15.53:0/2569313074 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48340a56a0 con 0x7f483c162640 2023-06-10T19:07:18.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.866+0000 7f4839ffb640 1 -- 172.21.15.53:0/2569313074 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48340a5a30 con 0x7f483c162640 2023-06-10T19:07:18.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.866+0000 7f48417d7640 1 -- 172.21.15.53:0/2569313074 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f483c162640 msgr2=0x7f483c164a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:18.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.866+0000 7f48417d7640 1 --2- 172.21.15.53:0/2569313074 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f483c162640 0x7f483c164a20 secure :-1 s=READY pgs=2393 cs=0 l=1 rev1=1 crypto rx=0x7f4834009d90 tx=0x7f483401c840 comp rx=0 tx=0).stop 2023-06-10T19:07:18.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.866+0000 7f48417d7640 1 -- 172.21.15.53:0/2569313074 shutdown_connections 2023-06-10T19:07:18.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.866+0000 7f48417d7640 1 --2- 172.21.15.53:0/2569313074 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f483c162640 0x7f483c164a20 unknown :-1 s=CLOSED pgs=2393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:18.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.866+0000 7f48417d7640 1 -- 172.21.15.53:0/2569313074 >> 172.21.15.53:0/2569313074 conn(0x7f483c06a0d0 msgr2=0x7f483c0ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:18.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.866+0000 7f48417d7640 1 -- 172.21.15.53:0/2569313074 shutdown_connections 2023-06-10T19:07:18.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.866+0000 7f48417d7640 1 -- 172.21.15.53:0/2569313074 wait complete. 2023-06-10T19:07:18.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.870+0000 7f48417d7640 1 Processor -- start 2023-06-10T19:07:18.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.870+0000 7f48417d7640 1 -- start start 2023-06-10T19:07:18.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.870+0000 7f48417d7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f483c071060 0x7f483c14cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:18.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.870+0000 7f48417d7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f483c0c9840 0x7f483c0c3020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:18.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.870+0000 7f48417d7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f483c162640 0x7f483c14c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:18.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.870+0000 7f48417d7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f483c14ca50 con 0x7f483c162640 2023-06-10T19:07:18.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.870+0000 7f48417d7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f483c1638a0 con 0x7f483c071060 2023-06-10T19:07:18.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.870+0000 7f48417d7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f483c164060 con 0x7f483c0c9840 2023-06-10T19:07:18.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.870+0000 7f483b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f483c162640 0x7f483c14c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:18.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.870+0000 7f483b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f483c162640 0x7f483c14c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33826/0 (socket says 172.21.15.53:33826) 2023-06-10T19:07:18.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.870+0000 7f483b7fe640 1 -- 172.21.15.53:0/3855854885 learned_addr learned my addr 172.21.15.53:0/3855854885 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:18.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.870+0000 7f483b7fe640 1 -- 172.21.15.53:0/3855854885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f483c0c9840 msgr2=0x7f483c0c3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:18.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.870+0000 7f483b7fe640 1 --2- 172.21.15.53:0/3855854885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f483c0c9840 0x7f483c0c3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:18.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.870+0000 7f483affd640 1 --2- 172.21.15.53:0/3855854885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f483c071060 0x7f483c14cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:18.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.870+0000 7f483b7fe640 1 -- 172.21.15.53:0/3855854885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f483c071060 msgr2=0x7f483c14cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:18.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.870+0000 7f483b7fe640 1 --2- 172.21.15.53:0/3855854885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f483c071060 0x7f483c14cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:18.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.870+0000 7f483b7fe640 1 -- 172.21.15.53:0/3855854885 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4834009a70 con 0x7f483c162640 2023-06-10T19:07:18.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.870+0000 7f483b7fe640 1 --2- 172.21.15.53:0/3855854885 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f483c162640 0x7f483c14c080 secure :-1 s=READY pgs=2394 cs=0 l=1 rev1=1 crypto rx=0x7f48340b0040 tx=0x7f48340195e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:18.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.870+0000 7f48337fe640 1 -- 172.21.15.53:0/3855854885 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4834003ba0 con 0x7f483c162640 2023-06-10T19:07:18.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.870+0000 7f48337fe640 1 -- 172.21.15.53:0/3855854885 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4834003d00 con 0x7f483c162640 2023-06-10T19:07:18.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.870+0000 7f48417d7640 1 -- 172.21.15.53:0/3855854885 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f483c1635c0 con 0x7f483c162640 2023-06-10T19:07:18.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.870+0000 7f48337fe640 1 -- 172.21.15.53:0/3855854885 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48340ad870 con 0x7f483c162640 2023-06-10T19:07:18.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.870+0000 7f48417d7640 1 -- 172.21.15.53:0/3855854885 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f483c14c690 con 0x7f483c162640 2023-06-10T19:07:18.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.870+0000 7f48417d7640 1 -- 172.21.15.53:0/3855854885 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f483c1644d0 con 0x7f483c162640 2023-06-10T19:07:18.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.874+0000 7f48337fe640 1 -- 172.21.15.53:0/3855854885 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f48340b4050 con 0x7f483c162640 2023-06-10T19:07:18.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.874+0000 7f48337fe640 1 --2- 172.21.15.53:0/3855854885 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f481c0662b0 0x7f481c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:18.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.874+0000 7f48337fe640 1 -- 172.21.15.53:0/3855854885 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f483411e850 con 0x7f483c162640 2023-06-10T19:07:18.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.874+0000 7f483affd640 1 --2- 172.21.15.53:0/3855854885 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f481c0662b0 0x7f481c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:18.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.874+0000 7f483affd640 1 --2- 172.21.15.53:0/3855854885 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f481c0662b0 0x7f481c068760 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f4824001ec0 tx=0x7f4824009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:18.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:18.878+0000 7f48337fe640 1 -- 172.21.15.53:0/3855854885 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f483c1644d0 con 0x7f483c162640 2023-06-10T19:07:19.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.026+0000 7f48417d7640 1 -- 172.21.15.53:0/3855854885 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f483c1644d0 con 0x7f483c162640 2023-06-10T19:07:19.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.026+0000 7f48337fe640 1 -- 172.21.15.53:0/3855854885 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v167) v1 ==== 74+0+18281 (secure 0 0 0) 0x7f483c1644d0 con 0x7f483c162640 2023-06-10T19:07:19.030 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:07:19.031 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":167,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:07:16.727942+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-06-10T19:07:13.365954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"166","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-06-10T19:07:14.695077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:07:19.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.030+0000 7f48417d7640 1 -- 172.21.15.53:0/3855854885 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f481c0662b0 msgr2=0x7f481c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:19.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.030+0000 7f48417d7640 1 --2- 172.21.15.53:0/3855854885 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f481c0662b0 0x7f481c068760 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f4824001ec0 tx=0x7f4824009040 comp rx=0 tx=0).stop 2023-06-10T19:07:19.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.030+0000 7f48417d7640 1 -- 172.21.15.53:0/3855854885 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f483c162640 msgr2=0x7f483c14c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:19.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.030+0000 7f48417d7640 1 --2- 172.21.15.53:0/3855854885 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f483c162640 0x7f483c14c080 secure :-1 s=READY pgs=2394 cs=0 l=1 rev1=1 crypto rx=0x7f48340b0040 tx=0x7f48340195e0 comp rx=0 tx=0).stop 2023-06-10T19:07:19.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.030+0000 7f48417d7640 1 -- 172.21.15.53:0/3855854885 shutdown_connections 2023-06-10T19:07:19.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.030+0000 7f48417d7640 1 --2- 172.21.15.53:0/3855854885 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f481c0662b0 0x7f481c068760 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:19.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.030+0000 7f48417d7640 1 --2- 172.21.15.53:0/3855854885 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f483c162640 0x7f483c14c080 unknown :-1 s=CLOSED pgs=2394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:19.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.030+0000 7f48417d7640 1 --2- 172.21.15.53:0/3855854885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f483c0c9840 0x7f483c0c3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:19.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.030+0000 7f48417d7640 1 --2- 172.21.15.53:0/3855854885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f483c071060 0x7f483c14cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:19.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.030+0000 7f48417d7640 1 -- 172.21.15.53:0/3855854885 >> 172.21.15.53:0/3855854885 conn(0x7f483c06a0d0 msgr2=0x7f483c0abbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:19.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.030+0000 7f48417d7640 1 -- 172.21.15.53:0/3855854885 shutdown_connections 2023-06-10T19:07:19.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.030+0000 7f48417d7640 1 -- 172.21.15.53:0/3855854885 wait complete. 2023-06-10T19:07:19.048 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-06-10T19:07:19.049 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-10T19:07:19.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.158+0000 7f0b3036b640 1 Processor -- start 2023-06-10T19:07:19.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.158+0000 7f0b3036b640 1 -- start start 2023-06-10T19:07:19.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.158+0000 7f0b3036b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0b280b3ac0 0x7f0b280b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:19.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.158+0000 7f0b3036b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0b280cc690 0x7f0b2815f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:19.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.158+0000 7f0b3036b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b280ccae0 0x7f0b2815f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:19.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.158+0000 7f0b3036b640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b280d0020 con 0x7f0b280cc690 2023-06-10T19:07:19.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.158+0000 7f0b3036b640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b280b43d0 con 0x7f0b280b3ac0 2023-06-10T19:07:19.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.158+0000 7f0b3036b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b280cef40 con 0x7f0b280ccae0 2023-06-10T19:07:19.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.162+0000 7f0b2d906640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0b280cc690 0x7f0b2815f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:19.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.162+0000 7f0b2d906640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0b280cc690 0x7f0b2815f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33840/0 (socket says 172.21.15.53:33840) 2023-06-10T19:07:19.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.162+0000 7f0b2d906640 1 -- 172.21.15.53:0/2091583910 learned_addr learned my addr 172.21.15.53:0/2091583910 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:19.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.162+0000 7f0b2e908640 1 --2- 172.21.15.53:0/2091583910 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b280ccae0 0x7f0b2815f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:19.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.162+0000 7f0b2e107640 1 --2- 172.21.15.53:0/2091583910 >> v2:172.21.15.117:3300/0 conn(0x7f0b280b3ac0 0x7f0b280b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:19.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.162+0000 7f0b2d906640 1 -- 172.21.15.53:0/2091583910 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b280ccae0 msgr2=0x7f0b2815f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:19.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.162+0000 7f0b2d906640 1 --2- 172.21.15.53:0/2091583910 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b280ccae0 0x7f0b2815f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:19.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.162+0000 7f0b2d906640 1 -- 172.21.15.53:0/2091583910 >> v2:172.21.15.117:3300/0 conn(0x7f0b280b3ac0 msgr2=0x7f0b280b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:19.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.162+0000 7f0b2d906640 1 --2- 172.21.15.53:0/2091583910 >> v2:172.21.15.117:3300/0 conn(0x7f0b280b3ac0 0x7f0b280b3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:19.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.162+0000 7f0b2d906640 1 -- 172.21.15.53:0/2091583910 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b280cf220 con 0x7f0b280cc690 2023-06-10T19:07:19.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.162+0000 7f0b2e107640 1 --2- 172.21.15.53:0/2091583910 >> v2:172.21.15.117:3300/0 conn(0x7f0b280b3ac0 0x7f0b280b3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:07:19.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.162+0000 7f0b2d906640 1 --2- 172.21.15.53:0/2091583910 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b280cc690 0x7f0b2815f370 secure :-1 s=READY pgs=2395 cs=0 l=1 rev1=1 crypto rx=0x7f0b280b4ba0 tx=0x7f0b1801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90c5c6890dc5dea5 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:19.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.162+0000 7f0b2d105640 1 -- 172.21.15.53:0/2091583910 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b180ac600 con 0x7f0b280cc690 2023-06-10T19:07:19.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.162+0000 7f0b2d105640 1 -- 172.21.15.53:0/2091583910 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b180a8050 con 0x7f0b280cc690 2023-06-10T19:07:19.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.162+0000 7f0b2d105640 1 -- 172.21.15.53:0/2091583910 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b180ac980 con 0x7f0b280cc690 2023-06-10T19:07:19.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.162+0000 7f0b3036b640 1 -- 172.21.15.53:0/2091583910 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b280cc690 msgr2=0x7f0b2815f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:19.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.162+0000 7f0b3036b640 1 --2- 172.21.15.53:0/2091583910 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b280cc690 0x7f0b2815f370 secure :-1 s=READY pgs=2395 cs=0 l=1 rev1=1 crypto rx=0x7f0b280b4ba0 tx=0x7f0b1801c4d0 comp rx=0 tx=0).stop 2023-06-10T19:07:19.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.166+0000 7f0b3036b640 1 -- 172.21.15.53:0/2091583910 shutdown_connections 2023-06-10T19:07:19.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.166+0000 7f0b3036b640 1 --2- 172.21.15.53:0/2091583910 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b280ccae0 0x7f0b2815f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:19.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.166+0000 7f0b3036b640 1 --2- 172.21.15.53:0/2091583910 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b280cc690 0x7f0b2815f370 unknown :-1 s=CLOSED pgs=2395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:19.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.166+0000 7f0b3036b640 1 --2- 172.21.15.53:0/2091583910 >> v2:172.21.15.117:3300/0 conn(0x7f0b280b3ac0 0x7f0b280b3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:19.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.166+0000 7f0b3036b640 1 -- 172.21.15.53:0/2091583910 >> 172.21.15.53:0/2091583910 conn(0x7f0b28071790 msgr2=0x7f0b28069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:19.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.166+0000 7f0b3036b640 1 -- 172.21.15.53:0/2091583910 shutdown_connections 2023-06-10T19:07:19.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.166+0000 7f0b3036b640 1 -- 172.21.15.53:0/2091583910 wait complete. 2023-06-10T19:07:19.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.166+0000 7f0b3036b640 1 Processor -- start 2023-06-10T19:07:19.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.166+0000 7f0b3036b640 1 -- start start 2023-06-10T19:07:19.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.166+0000 7f0b3036b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b280b3ac0 0x7f0b2815be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:19.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.166+0000 7f0b3036b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b280cc690 0x7f0b280cb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:19.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.166+0000 7f0b3036b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b280ccae0 0x7f0b28152440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:19.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.166+0000 7f0b3036b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b28159820 con 0x7f0b280b3ac0 2023-06-10T19:07:19.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.166+0000 7f0b3036b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b280c91b0 con 0x7f0b280ccae0 2023-06-10T19:07:19.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.166+0000 7f0b3036b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b280c9490 con 0x7f0b280cc690 2023-06-10T19:07:19.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.166+0000 7f0b2e107640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b280b3ac0 0x7f0b2815be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:19.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.166+0000 7f0b2e107640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b280b3ac0 0x7f0b2815be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33854/0 (socket says 172.21.15.53:33854) 2023-06-10T19:07:19.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.166+0000 7f0b2e107640 1 -- 172.21.15.53:0/1888534816 learned_addr learned my addr 172.21.15.53:0/1888534816 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:19.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.166+0000 7f0b2e908640 1 --2- 172.21.15.53:0/1888534816 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b280ccae0 0x7f0b28152440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:19.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.166+0000 7f0b2d906640 1 --2- 172.21.15.53:0/1888534816 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b280cc690 0x7f0b280cb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:19.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.166+0000 7f0b2e107640 1 -- 172.21.15.53:0/1888534816 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b280cc690 msgr2=0x7f0b280cb8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:19.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.166+0000 7f0b2e107640 1 --2- 172.21.15.53:0/1888534816 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b280cc690 0x7f0b280cb8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:19.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.166+0000 7f0b2e107640 1 -- 172.21.15.53:0/1888534816 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b280ccae0 msgr2=0x7f0b28152440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:19.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.166+0000 7f0b2e107640 1 --2- 172.21.15.53:0/1888534816 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b280ccae0 0x7f0b28152440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:19.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.166+0000 7f0b2e107640 1 -- 172.21.15.53:0/1888534816 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b180094d0 con 0x7f0b280b3ac0 2023-06-10T19:07:19.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.166+0000 7f0b2e908640 1 --2- 172.21.15.53:0/1888534816 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b280ccae0 0x7f0b28152440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:07:19.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.166+0000 7f0b2e107640 1 --2- 172.21.15.53:0/1888534816 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b280b3ac0 0x7f0b2815be00 secure :-1 s=READY pgs=2396 cs=0 l=1 rev1=1 crypto rx=0x7f0b2400e810 tx=0x7f0b2400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:19.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.166+0000 7f0b1effd640 1 -- 172.21.15.53:0/1888534816 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b24004030 con 0x7f0b280b3ac0 2023-06-10T19:07:19.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.166+0000 7f0b1effd640 1 -- 172.21.15.53:0/1888534816 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b24004190 con 0x7f0b280b3ac0 2023-06-10T19:07:19.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.166+0000 7f0b3036b640 1 -- 172.21.15.53:0/1888534816 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b280c9770 con 0x7f0b280b3ac0 2023-06-10T19:07:19.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.166+0000 7f0b1effd640 1 -- 172.21.15.53:0/1888534816 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b24004520 con 0x7f0b280b3ac0 2023-06-10T19:07:19.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.166+0000 7f0b3036b640 1 -- 172.21.15.53:0/1888534816 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b280cbe10 con 0x7f0b280b3ac0 2023-06-10T19:07:19.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.166+0000 7f0b3036b640 1 -- 172.21.15.53:0/1888534816 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b280c99b0 con 0x7f0b280b3ac0 2023-06-10T19:07:19.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.170+0000 7f0b1effd640 1 -- 172.21.15.53:0/1888534816 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0b2400c6d0 con 0x7f0b280b3ac0 2023-06-10T19:07:19.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.170+0000 7f0b1effd640 1 --2- 172.21.15.53:0/1888534816 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0b0c066280 0x7f0b0c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:19.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.170+0000 7f0b1effd640 1 -- 172.21.15.53:0/1888534816 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0b240838a0 con 0x7f0b280b3ac0 2023-06-10T19:07:19.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.170+0000 7f0b2d906640 1 --2- 172.21.15.53:0/1888534816 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0b0c066280 0x7f0b0c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:19.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.170+0000 7f0b2d906640 1 --2- 172.21.15.53:0/1888534816 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0b0c066280 0x7f0b0c068730 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f0b180ae000 tx=0x7f0b18008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:19.175 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.174+0000 7f0b1effd640 1 -- 172.21.15.53:0/1888534816 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0b24050db0 con 0x7f0b280b3ac0 2023-06-10T19:07:19.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.318+0000 7f0b3036b640 1 -- 172.21.15.53:0/1888534816 --> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0b28160200 con 0x7f0b0c066280 2023-06-10T19:07:19.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.342+0000 7f0b1effd640 1 -- 172.21.15.53:0/1888534816 <== mgr.4105 v2:172.21.15.117:6832/3061986771 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310342 (secure 0 0 0) 0x7f0b180b7420 con 0x7f0b0c066280 2023-06-10T19:07:19.344 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:07:19.347 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-06-10T19:07:19.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.346+0000 7f0b3036b640 1 -- 172.21.15.53:0/1888534816 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0b0c066280 msgr2=0x7f0b0c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:19.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.346+0000 7f0b3036b640 1 --2- 172.21.15.53:0/1888534816 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0b0c066280 0x7f0b0c068730 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f0b180ae000 tx=0x7f0b18008040 comp rx=0 tx=0).stop 2023-06-10T19:07:19.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.346+0000 7f0b3036b640 1 -- 172.21.15.53:0/1888534816 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b280b3ac0 msgr2=0x7f0b2815be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:19.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.346+0000 7f0b3036b640 1 --2- 172.21.15.53:0/1888534816 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b280b3ac0 0x7f0b2815be00 secure :-1 s=READY pgs=2396 cs=0 l=1 rev1=1 crypto rx=0x7f0b2400e810 tx=0x7f0b2400ecd0 comp rx=0 tx=0).stop 2023-06-10T19:07:19.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.346+0000 7f0b3036b640 1 -- 172.21.15.53:0/1888534816 shutdown_connections 2023-06-10T19:07:19.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.346+0000 7f0b3036b640 1 --2- 172.21.15.53:0/1888534816 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0b0c066280 0x7f0b0c068730 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:19.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.346+0000 7f0b3036b640 1 --2- 172.21.15.53:0/1888534816 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b280ccae0 0x7f0b28152440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:19.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.346+0000 7f0b3036b640 1 --2- 172.21.15.53:0/1888534816 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0b280cc690 0x7f0b280cb8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:19.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.346+0000 7f0b3036b640 1 --2- 172.21.15.53:0/1888534816 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b280b3ac0 0x7f0b2815be00 unknown :-1 s=CLOSED pgs=2396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:19.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.346+0000 7f0b3036b640 1 -- 172.21.15.53:0/1888534816 >> 172.21.15.53:0/1888534816 conn(0x7f0b28071790 msgr2=0x7f0b280d0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:19.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.346+0000 7f0b3036b640 1 -- 172.21.15.53:0/1888534816 shutdown_connections 2023-06-10T19:07:19.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.346+0000 7f0b3036b640 1 -- 172.21.15.53:0/1888534816 wait complete. 2023-06-10T19:07:19.363 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":603,"stamp":"2023-06-10T19:07:17.885840+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":139,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":282308,"kb_used_data":17540,"kb_used_omap":0,"kb_used_meta":264704,"kb_avail":754692412,"statfs":{"total":773094113280,"available":772805029888,"internally_reserved":0,"allocated":17960960,"data_stored":8991105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":271056896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":63,"apply_latency_ms":63,"commit_latency_ns":63000000,"apply_latency_ns":63000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001206"},"pg_stats":[{"pgid":"24.3f","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.748528+0000","last_change":"2023-06-10T19:07:15.794568+0000","last_active":"2023-06-10T19:07:16.748528+0000","last_peered":"2023-06-10T19:07:16.748528+0000","last_clean":"2023-06-10T19:07:16.748528+0000","last_became_active":"2023-06-10T19:07:15.793876+0000","last_became_peered":"2023-06-10T19:07:15.793876+0000","last_unstale":"2023-06-10T19:07:16.748528+0000","last_undegraded":"2023-06-10T19:07:16.748528+0000","last_fullsized":"2023-06-10T19:07:16.748528+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:18:32.043973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.135896+0000","last_change":"2023-06-10T19:07:15.783807+0000","last_active":"2023-06-10T19:07:17.135896+0000","last_peered":"2023-06-10T19:07:17.135896+0000","last_clean":"2023-06-10T19:07:17.135896+0000","last_became_active":"2023-06-10T19:07:15.783154+0000","last_became_peered":"2023-06-10T19:07:15.783154+0000","last_unstale":"2023-06-10T19:07:17.135896+0000","last_undegraded":"2023-06-10T19:07:17.135896+0000","last_fullsized":"2023-06-10T19:07:17.135896+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:04:48.865897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.747869+0000","last_change":"2023-06-10T19:07:15.776017+0000","last_active":"2023-06-10T19:07:16.747869+0000","last_peered":"2023-06-10T19:07:16.747869+0000","last_clean":"2023-06-10T19:07:16.747869+0000","last_became_active":"2023-06-10T19:07:15.775404+0000","last_became_peered":"2023-06-10T19:07:15.775404+0000","last_unstale":"2023-06-10T19:07:16.747869+0000","last_undegraded":"2023-06-10T19:07:16.747869+0000","last_fullsized":"2023-06-10T19:07:16.747869+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:15:59.508610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.748335+0000","last_change":"2023-06-10T19:07:15.775820+0000","last_active":"2023-06-10T19:07:16.748335+0000","last_peered":"2023-06-10T19:07:16.748335+0000","last_clean":"2023-06-10T19:07:16.748335+0000","last_became_active":"2023-06-10T19:07:15.775183+0000","last_became_peered":"2023-06-10T19:07:15.775183+0000","last_unstale":"2023-06-10T19:07:16.748335+0000","last_undegraded":"2023-06-10T19:07:16.748335+0000","last_fullsized":"2023-06-10T19:07:16.748335+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:50:38.473215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.937092+0000","last_change":"2023-06-10T19:07:15.774974+0000","last_active":"2023-06-10T19:07:16.937092+0000","last_peered":"2023-06-10T19:07:16.937092+0000","last_clean":"2023-06-10T19:07:16.937092+0000","last_became_active":"2023-06-10T19:07:15.774664+0000","last_became_peered":"2023-06-10T19:07:15.774664+0000","last_unstale":"2023-06-10T19:07:16.937092+0000","last_undegraded":"2023-06-10T19:07:16.937092+0000","last_fullsized":"2023-06-10T19:07:16.937092+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:19:27.548050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.135175+0000","last_change":"2023-06-10T19:07:15.777256+0000","last_active":"2023-06-10T19:07:17.135175+0000","last_peered":"2023-06-10T19:07:17.135175+0000","last_clean":"2023-06-10T19:07:17.135175+0000","last_became_active":"2023-06-10T19:07:15.776232+0000","last_became_peered":"2023-06-10T19:07:15.776232+0000","last_unstale":"2023-06-10T19:07:17.135175+0000","last_undegraded":"2023-06-10T19:07:17.135175+0000","last_fullsized":"2023-06-10T19:07:17.135175+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:33:40.261750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.135623+0000","last_change":"2023-06-10T19:07:15.763440+0000","last_active":"2023-06-10T19:07:17.135623+0000","last_peered":"2023-06-10T19:07:17.135623+0000","last_clean":"2023-06-10T19:07:17.135623+0000","last_became_active":"2023-06-10T19:07:15.763097+0000","last_became_peered":"2023-06-10T19:07:15.763097+0000","last_unstale":"2023-06-10T19:07:17.135623+0000","last_undegraded":"2023-06-10T19:07:17.135623+0000","last_fullsized":"2023-06-10T19:07:17.135623+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:46:01.552233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.135441+0000","last_change":"2023-06-10T19:07:15.775193+0000","last_active":"2023-06-10T19:07:17.135441+0000","last_peered":"2023-06-10T19:07:17.135441+0000","last_clean":"2023-06-10T19:07:17.135441+0000","last_became_active":"2023-06-10T19:07:15.774847+0000","last_became_peered":"2023-06-10T19:07:15.774847+0000","last_unstale":"2023-06-10T19:07:17.135441+0000","last_undegraded":"2023-06-10T19:07:17.135441+0000","last_fullsized":"2023-06-10T19:07:17.135441+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:48:33.652969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.137235+0000","last_change":"2023-06-10T19:07:15.785422+0000","last_active":"2023-06-10T19:07:17.137235+0000","last_peered":"2023-06-10T19:07:17.137235+0000","last_clean":"2023-06-10T19:07:17.137235+0000","last_became_active":"2023-06-10T19:07:15.785065+0000","last_became_peered":"2023-06-10T19:07:15.785065+0000","last_unstale":"2023-06-10T19:07:17.137235+0000","last_undegraded":"2023-06-10T19:07:17.137235+0000","last_fullsized":"2023-06-10T19:07:17.137235+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:02:48.293254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.137416+0000","last_change":"2023-06-10T19:07:15.774859+0000","last_active":"2023-06-10T19:07:17.137416+0000","last_peered":"2023-06-10T19:07:17.137416+0000","last_clean":"2023-06-10T19:07:17.137416+0000","last_became_active":"2023-06-10T19:07:15.774511+0000","last_became_peered":"2023-06-10T19:07:15.774511+0000","last_unstale":"2023-06-10T19:07:17.137416+0000","last_undegraded":"2023-06-10T19:07:17.137416+0000","last_fullsized":"2023-06-10T19:07:17.137416+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:32:50.585355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.136820+0000","last_change":"2023-06-10T19:07:15.769504+0000","last_active":"2023-06-10T19:07:17.136820+0000","last_peered":"2023-06-10T19:07:17.136820+0000","last_clean":"2023-06-10T19:07:17.136820+0000","last_became_active":"2023-06-10T19:07:15.764579+0000","last_became_peered":"2023-06-10T19:07:15.764579+0000","last_unstale":"2023-06-10T19:07:17.136820+0000","last_undegraded":"2023-06-10T19:07:17.136820+0000","last_fullsized":"2023-06-10T19:07:17.136820+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:18:37.354907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.136040+0000","last_change":"2023-06-10T19:07:15.786847+0000","last_active":"2023-06-10T19:07:17.136040+0000","last_peered":"2023-06-10T19:07:17.136040+0000","last_clean":"2023-06-10T19:07:17.136040+0000","last_became_active":"2023-06-10T19:07:15.786000+0000","last_became_peered":"2023-06-10T19:07:15.786000+0000","last_unstale":"2023-06-10T19:07:17.136040+0000","last_undegraded":"2023-06-10T19:07:17.136040+0000","last_fullsized":"2023-06-10T19:07:17.136040+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:37:38.368110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.136475+0000","last_change":"2023-06-10T19:07:15.783590+0000","last_active":"2023-06-10T19:07:17.136475+0000","last_peered":"2023-06-10T19:07:17.136475+0000","last_clean":"2023-06-10T19:07:17.136475+0000","last_became_active":"2023-06-10T19:07:15.783320+0000","last_became_peered":"2023-06-10T19:07:15.783320+0000","last_unstale":"2023-06-10T19:07:17.136475+0000","last_undegraded":"2023-06-10T19:07:17.136475+0000","last_fullsized":"2023-06-10T19:07:17.136475+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:18:14.087304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.936844+0000","last_change":"2023-06-10T19:07:15.756260+0000","last_active":"2023-06-10T19:07:16.936844+0000","last_peered":"2023-06-10T19:07:16.936844+0000","last_clean":"2023-06-10T19:07:16.936844+0000","last_became_active":"2023-06-10T19:07:15.755987+0000","last_became_peered":"2023-06-10T19:07:15.755987+0000","last_unstale":"2023-06-10T19:07:16.936844+0000","last_undegraded":"2023-06-10T19:07:16.936844+0000","last_fullsized":"2023-06-10T19:07:16.936844+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:13:10.977984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.134807+0000","last_change":"2023-06-10T19:07:15.759913+0000","last_active":"2023-06-10T19:07:17.134807+0000","last_peered":"2023-06-10T19:07:17.134807+0000","last_clean":"2023-06-10T19:07:17.134807+0000","last_became_active":"2023-06-10T19:07:15.759167+0000","last_became_peered":"2023-06-10T19:07:15.759167+0000","last_unstale":"2023-06-10T19:07:17.134807+0000","last_undegraded":"2023-06-10T19:07:17.134807+0000","last_fullsized":"2023-06-10T19:07:17.134807+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:30:01.326600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.30","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.750281+0000","last_change":"2023-06-10T19:07:15.764381+0000","last_active":"2023-06-10T19:07:16.750281+0000","last_peered":"2023-06-10T19:07:16.750281+0000","last_clean":"2023-06-10T19:07:16.750281+0000","last_became_active":"2023-06-10T19:07:15.763576+0000","last_became_peered":"2023-06-10T19:07:15.763576+0000","last_unstale":"2023-06-10T19:07:16.750281+0000","last_undegraded":"2023-06-10T19:07:16.750281+0000","last_fullsized":"2023-06-10T19:07:16.750281+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:03:42.526488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.137609+0000","last_change":"2023-06-10T19:07:15.759920+0000","last_active":"2023-06-10T19:07:17.137609+0000","last_peered":"2023-06-10T19:07:17.137609+0000","last_clean":"2023-06-10T19:07:17.137609+0000","last_became_active":"2023-06-10T19:07:15.759635+0000","last_became_peered":"2023-06-10T19:07:15.759635+0000","last_unstale":"2023-06-10T19:07:17.137609+0000","last_undegraded":"2023-06-10T19:07:17.137609+0000","last_fullsized":"2023-06-10T19:07:17.137609+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:02:51.703725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.747692+0000","last_change":"2023-06-10T19:07:15.790570+0000","last_active":"2023-06-10T19:07:16.747692+0000","last_peered":"2023-06-10T19:07:16.747692+0000","last_clean":"2023-06-10T19:07:16.747692+0000","last_became_active":"2023-06-10T19:07:15.789759+0000","last_became_peered":"2023-06-10T19:07:15.789759+0000","last_unstale":"2023-06-10T19:07:16.747692+0000","last_undegraded":"2023-06-10T19:07:16.747692+0000","last_fullsized":"2023-06-10T19:07:16.747692+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:18:45.744778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.137029+0000","last_change":"2023-06-10T19:07:15.761681+0000","last_active":"2023-06-10T19:07:17.137029+0000","last_peered":"2023-06-10T19:07:17.137029+0000","last_clean":"2023-06-10T19:07:17.137029+0000","last_became_active":"2023-06-10T19:07:15.760951+0000","last_became_peered":"2023-06-10T19:07:15.760951+0000","last_unstale":"2023-06-10T19:07:17.137029+0000","last_undegraded":"2023-06-10T19:07:17.137029+0000","last_fullsized":"2023-06-10T19:07:17.137029+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:29:23.985032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.743593+0000","last_change":"2023-06-10T19:07:15.756132+0000","last_active":"2023-06-10T19:07:16.743593+0000","last_peered":"2023-06-10T19:07:16.743593+0000","last_clean":"2023-06-10T19:07:16.743593+0000","last_became_active":"2023-06-10T19:07:15.755805+0000","last_became_peered":"2023-06-10T19:07:15.755805+0000","last_unstale":"2023-06-10T19:07:16.743593+0000","last_undegraded":"2023-06-10T19:07:16.743593+0000","last_fullsized":"2023-06-10T19:07:16.743593+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:31:40.868453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.136831+0000","last_change":"2023-06-10T19:07:15.785903+0000","last_active":"2023-06-10T19:07:17.136831+0000","last_peered":"2023-06-10T19:07:17.136831+0000","last_clean":"2023-06-10T19:07:17.136831+0000","last_became_active":"2023-06-10T19:07:15.785575+0000","last_became_peered":"2023-06-10T19:07:15.785575+0000","last_unstale":"2023-06-10T19:07:17.136831+0000","last_undegraded":"2023-06-10T19:07:17.136831+0000","last_fullsized":"2023-06-10T19:07:17.136831+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:28:19.661422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.135203+0000","last_change":"2023-06-10T19:07:15.772172+0000","last_active":"2023-06-10T19:07:17.135203+0000","last_peered":"2023-06-10T19:07:17.135203+0000","last_clean":"2023-06-10T19:07:17.135203+0000","last_became_active":"2023-06-10T19:07:15.771331+0000","last_became_peered":"2023-06-10T19:07:15.771331+0000","last_unstale":"2023-06-10T19:07:17.135203+0000","last_undegraded":"2023-06-10T19:07:17.135203+0000","last_fullsized":"2023-06-10T19:07:17.135203+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:21:42.365830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.936790+0000","last_change":"2023-06-10T19:07:15.791799+0000","last_active":"2023-06-10T19:07:16.936790+0000","last_peered":"2023-06-10T19:07:16.936790+0000","last_clean":"2023-06-10T19:07:16.936790+0000","last_became_active":"2023-06-10T19:07:15.791455+0000","last_became_peered":"2023-06-10T19:07:15.791455+0000","last_unstale":"2023-06-10T19:07:16.936790+0000","last_undegraded":"2023-06-10T19:07:16.936790+0000","last_fullsized":"2023-06-10T19:07:16.936790+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:41:03.686048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.750460+0000","last_change":"2023-06-10T19:07:15.764289+0000","last_active":"2023-06-10T19:07:16.750460+0000","last_peered":"2023-06-10T19:07:16.750460+0000","last_clean":"2023-06-10T19:07:16.750460+0000","last_became_active":"2023-06-10T19:07:15.763521+0000","last_became_peered":"2023-06-10T19:07:15.763521+0000","last_unstale":"2023-06-10T19:07:16.750460+0000","last_undegraded":"2023-06-10T19:07:16.750460+0000","last_fullsized":"2023-06-10T19:07:16.750460+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:35:41.433827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.138205+0000","last_change":"2023-06-10T19:07:15.755899+0000","last_active":"2023-06-10T19:07:17.138205+0000","last_peered":"2023-06-10T19:07:17.138205+0000","last_clean":"2023-06-10T19:07:17.138205+0000","last_became_active":"2023-06-10T19:07:15.755603+0000","last_became_peered":"2023-06-10T19:07:15.755603+0000","last_unstale":"2023-06-10T19:07:17.138205+0000","last_undegraded":"2023-06-10T19:07:17.138205+0000","last_fullsized":"2023-06-10T19:07:17.138205+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:13:10.977984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.744173+0000","last_change":"2023-06-10T19:07:15.773692+0000","last_active":"2023-06-10T19:07:16.744173+0000","last_peered":"2023-06-10T19:07:16.744173+0000","last_clean":"2023-06-10T19:07:16.744173+0000","last_became_active":"2023-06-10T19:07:15.773397+0000","last_became_peered":"2023-06-10T19:07:15.773397+0000","last_unstale":"2023-06-10T19:07:16.744173+0000","last_undegraded":"2023-06-10T19:07:16.744173+0000","last_fullsized":"2023-06-10T19:07:16.744173+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:00:55.901188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.135569+0000","last_change":"2023-06-10T19:07:15.783613+0000","last_active":"2023-06-10T19:07:17.135569+0000","last_peered":"2023-06-10T19:07:17.135569+0000","last_clean":"2023-06-10T19:07:17.135569+0000","last_became_active":"2023-06-10T19:07:15.782940+0000","last_became_peered":"2023-06-10T19:07:15.782940+0000","last_unstale":"2023-06-10T19:07:17.135569+0000","last_undegraded":"2023-06-10T19:07:17.135569+0000","last_fullsized":"2023-06-10T19:07:17.135569+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:54:58.950415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.137207+0000","last_change":"2023-06-10T19:07:15.787826+0000","last_active":"2023-06-10T19:07:17.137207+0000","last_peered":"2023-06-10T19:07:17.137207+0000","last_clean":"2023-06-10T19:07:17.137207+0000","last_became_active":"2023-06-10T19:07:15.787561+0000","last_became_peered":"2023-06-10T19:07:15.787561+0000","last_unstale":"2023-06-10T19:07:17.137207+0000","last_undegraded":"2023-06-10T19:07:17.137207+0000","last_fullsized":"2023-06-10T19:07:17.137207+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:38:24.420101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.135174+0000","last_change":"2023-06-10T19:07:15.775697+0000","last_active":"2023-06-10T19:07:17.135174+0000","last_peered":"2023-06-10T19:07:17.135174+0000","last_clean":"2023-06-10T19:07:17.135174+0000","last_became_active":"2023-06-10T19:07:15.770921+0000","last_became_peered":"2023-06-10T19:07:15.770921+0000","last_unstale":"2023-06-10T19:07:17.135174+0000","last_undegraded":"2023-06-10T19:07:17.135174+0000","last_fullsized":"2023-06-10T19:07:17.135174+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:59:20.495211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.747103+0000","last_change":"2023-06-10T19:07:15.790277+0000","last_active":"2023-06-10T19:07:16.747103+0000","last_peered":"2023-06-10T19:07:16.747103+0000","last_clean":"2023-06-10T19:07:16.747103+0000","last_became_active":"2023-06-10T19:07:15.789653+0000","last_became_peered":"2023-06-10T19:07:15.789653+0000","last_unstale":"2023-06-10T19:07:16.747103+0000","last_undegraded":"2023-06-10T19:07:16.747103+0000","last_fullsized":"2023-06-10T19:07:16.747103+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:02:23.344839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.135140+0000","last_change":"2023-06-10T19:07:15.796247+0000","last_active":"2023-06-10T19:07:17.135140+0000","last_peered":"2023-06-10T19:07:17.135140+0000","last_clean":"2023-06-10T19:07:17.135140+0000","last_became_active":"2023-06-10T19:07:15.795685+0000","last_became_peered":"2023-06-10T19:07:15.795685+0000","last_unstale":"2023-06-10T19:07:17.135140+0000","last_undegraded":"2023-06-10T19:07:17.135140+0000","last_fullsized":"2023-06-10T19:07:17.135140+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:12:32.452127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.747081+0000","last_change":"2023-06-10T19:07:15.790089+0000","last_active":"2023-06-10T19:07:16.747081+0000","last_peered":"2023-06-10T19:07:16.747081+0000","last_clean":"2023-06-10T19:07:16.747081+0000","last_became_active":"2023-06-10T19:07:15.789575+0000","last_became_peered":"2023-06-10T19:07:15.789575+0000","last_unstale":"2023-06-10T19:07:16.747081+0000","last_undegraded":"2023-06-10T19:07:16.747081+0000","last_fullsized":"2023-06-10T19:07:16.747081+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:05:25.325840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.136548+0000","last_change":"2023-06-10T19:07:15.771563+0000","last_active":"2023-06-10T19:07:17.136548+0000","last_peered":"2023-06-10T19:07:17.136548+0000","last_clean":"2023-06-10T19:07:17.136548+0000","last_became_active":"2023-06-10T19:07:15.770726+0000","last_became_peered":"2023-06-10T19:07:15.770726+0000","last_unstale":"2023-06-10T19:07:17.136548+0000","last_undegraded":"2023-06-10T19:07:17.136548+0000","last_fullsized":"2023-06-10T19:07:17.136548+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:28:42.149220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"166'4","reported_seq":17,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.748889+0000","last_change":"2023-06-10T19:07:15.365674+0000","last_active":"2023-06-10T19:07:16.748889+0000","last_peered":"2023-06-10T19:07:16.748889+0000","last_clean":"2023-06-10T19:07:16.748889+0000","last_became_active":"2023-06-10T19:07:15.364941+0000","last_became_peered":"2023-06-10T19:07:15.364941+0000","last_unstale":"2023-06-10T19:07:16.748889+0000","last_undegraded":"2023-06-10T19:07:16.748889+0000","last_fullsized":"2023-06-10T19:07:16.748889+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_clean_scrub_stamp":"2023-06-10T19:07:14.306487+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:57:48.557614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.136458+0000","last_change":"2023-06-10T19:07:15.795130+0000","last_active":"2023-06-10T19:07:17.136458+0000","last_peered":"2023-06-10T19:07:17.136458+0000","last_clean":"2023-06-10T19:07:17.136458+0000","last_became_active":"2023-06-10T19:07:15.794850+0000","last_became_peered":"2023-06-10T19:07:15.794850+0000","last_unstale":"2023-06-10T19:07:17.136458+0000","last_undegraded":"2023-06-10T19:07:17.136458+0000","last_fullsized":"2023-06-10T19:07:17.136458+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:27:07.697102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"166'1","reported_seq":14,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.937901+0000","last_change":"2023-06-10T19:07:15.373538+0000","last_active":"2023-06-10T19:07:16.937901+0000","last_peered":"2023-06-10T19:07:16.937901+0000","last_clean":"2023-06-10T19:07:16.937901+0000","last_became_active":"2023-06-10T19:07:15.373262+0000","last_became_peered":"2023-06-10T19:07:15.373262+0000","last_unstale":"2023-06-10T19:07:16.937901+0000","last_undegraded":"2023-06-10T19:07:16.937901+0000","last_fullsized":"2023-06-10T19:07:16.937901+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_clean_scrub_stamp":"2023-06-10T19:07:14.306487+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:57:06.060302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.937050+0000","last_change":"2023-06-10T19:07:15.753464+0000","last_active":"2023-06-10T19:07:16.937050+0000","last_peered":"2023-06-10T19:07:16.937050+0000","last_clean":"2023-06-10T19:07:16.937050+0000","last_became_active":"2023-06-10T19:07:15.753112+0000","last_became_peered":"2023-06-10T19:07:15.753112+0000","last_unstale":"2023-06-10T19:07:16.937050+0000","last_undegraded":"2023-06-10T19:07:16.937050+0000","last_fullsized":"2023-06-10T19:07:16.937050+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:08:07.956301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1d","version":"166'2","reported_seq":15,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.137377+0000","last_change":"2023-06-10T19:07:15.367792+0000","last_active":"2023-06-10T19:07:17.137377+0000","last_peered":"2023-06-10T19:07:17.137377+0000","last_clean":"2023-06-10T19:07:17.137377+0000","last_became_active":"2023-06-10T19:07:15.367058+0000","last_became_peered":"2023-06-10T19:07:15.367058+0000","last_unstale":"2023-06-10T19:07:17.137377+0000","last_undegraded":"2023-06-10T19:07:17.137377+0000","last_fullsized":"2023-06-10T19:07:17.137377+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_clean_scrub_stamp":"2023-06-10T19:07:14.306487+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:10:32.024757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.136347+0000","last_change":"2023-06-10T19:07:15.776787+0000","last_active":"2023-06-10T19:07:17.136347+0000","last_peered":"2023-06-10T19:07:17.136347+0000","last_clean":"2023-06-10T19:07:17.136347+0000","last_became_active":"2023-06-10T19:07:15.771779+0000","last_became_peered":"2023-06-10T19:07:15.771779+0000","last_unstale":"2023-06-10T19:07:17.136347+0000","last_undegraded":"2023-06-10T19:07:17.136347+0000","last_fullsized":"2023-06-10T19:07:17.136347+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:11:20.768494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1c","version":"166'2","reported_seq":15,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.743588+0000","last_change":"2023-06-10T19:07:15.385112+0000","last_active":"2023-06-10T19:07:16.743588+0000","last_peered":"2023-06-10T19:07:16.743588+0000","last_clean":"2023-06-10T19:07:16.743588+0000","last_became_active":"2023-06-10T19:07:15.384740+0000","last_became_peered":"2023-06-10T19:07:15.384740+0000","last_unstale":"2023-06-10T19:07:16.743588+0000","last_undegraded":"2023-06-10T19:07:16.743588+0000","last_fullsized":"2023-06-10T19:07:16.743588+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_clean_scrub_stamp":"2023-06-10T19:07:14.306487+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:00:54.379102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.135889+0000","last_change":"2023-06-10T19:07:15.776088+0000","last_active":"2023-06-10T19:07:17.135889+0000","last_peered":"2023-06-10T19:07:17.135889+0000","last_clean":"2023-06-10T19:07:17.135889+0000","last_became_active":"2023-06-10T19:07:15.775709+0000","last_became_peered":"2023-06-10T19:07:15.775709+0000","last_unstale":"2023-06-10T19:07:17.135889+0000","last_undegraded":"2023-06-10T19:07:17.135889+0000","last_fullsized":"2023-06-10T19:07:17.135889+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:09:27.100001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1b","version":"166'1","reported_seq":14,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.136575+0000","last_change":"2023-06-10T19:07:15.368089+0000","last_active":"2023-06-10T19:07:17.136575+0000","last_peered":"2023-06-10T19:07:17.136575+0000","last_clean":"2023-06-10T19:07:17.136575+0000","last_became_active":"2023-06-10T19:07:15.367528+0000","last_became_peered":"2023-06-10T19:07:15.367528+0000","last_unstale":"2023-06-10T19:07:17.136575+0000","last_undegraded":"2023-06-10T19:07:17.136575+0000","last_fullsized":"2023-06-10T19:07:17.136575+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_clean_scrub_stamp":"2023-06-10T19:07:14.306487+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:31:42.311913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.743896+0000","last_change":"2023-06-10T19:07:15.747201+0000","last_active":"2023-06-10T19:07:16.743896+0000","last_peered":"2023-06-10T19:07:16.743896+0000","last_clean":"2023-06-10T19:07:16.743896+0000","last_became_active":"2023-06-10T19:07:15.746941+0000","last_became_peered":"2023-06-10T19:07:15.746941+0000","last_unstale":"2023-06-10T19:07:16.743896+0000","last_undegraded":"2023-06-10T19:07:16.743896+0000","last_fullsized":"2023-06-10T19:07:16.743896+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:22:09.300045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"166'1","reported_seq":14,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.937436+0000","last_change":"2023-06-10T19:07:15.368752+0000","last_active":"2023-06-10T19:07:16.937436+0000","last_peered":"2023-06-10T19:07:16.937436+0000","last_clean":"2023-06-10T19:07:16.937436+0000","last_became_active":"2023-06-10T19:07:15.368175+0000","last_became_peered":"2023-06-10T19:07:15.368175+0000","last_unstale":"2023-06-10T19:07:16.937436+0000","last_undegraded":"2023-06-10T19:07:16.937436+0000","last_fullsized":"2023-06-10T19:07:16.937436+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_clean_scrub_stamp":"2023-06-10T19:07:14.306487+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:02:22.330353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.744178+0000","last_change":"2023-06-10T19:07:15.791496+0000","last_active":"2023-06-10T19:07:16.744178+0000","last_peered":"2023-06-10T19:07:16.744178+0000","last_clean":"2023-06-10T19:07:16.744178+0000","last_became_active":"2023-06-10T19:07:15.791188+0000","last_became_peered":"2023-06-10T19:07:15.791188+0000","last_unstale":"2023-06-10T19:07:16.744178+0000","last_undegraded":"2023-06-10T19:07:16.744178+0000","last_fullsized":"2023-06-10T19:07:16.744178+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:49:21.142799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.743180+0000","last_change":"2023-06-10T19:07:15.367562+0000","last_active":"2023-06-10T19:07:16.743180+0000","last_peered":"2023-06-10T19:07:16.743180+0000","last_clean":"2023-06-10T19:07:16.743180+0000","last_became_active":"2023-06-10T19:07:15.367136+0000","last_became_peered":"2023-06-10T19:07:15.367136+0000","last_unstale":"2023-06-10T19:07:16.743180+0000","last_undegraded":"2023-06-10T19:07:16.743180+0000","last_fullsized":"2023-06-10T19:07:16.743180+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_clean_scrub_stamp":"2023-06-10T19:07:14.306487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:43:53.877316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.748651+0000","last_change":"2023-06-10T19:07:15.766953+0000","last_active":"2023-06-10T19:07:16.748651+0000","last_peered":"2023-06-10T19:07:16.748651+0000","last_clean":"2023-06-10T19:07:16.748651+0000","last_became_active":"2023-06-10T19:07:15.766237+0000","last_became_peered":"2023-06-10T19:07:15.766237+0000","last_unstale":"2023-06-10T19:07:16.748651+0000","last_undegraded":"2023-06-10T19:07:16.748651+0000","last_fullsized":"2023-06-10T19:07:16.748651+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:44:19.053409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.135857+0000","last_change":"2023-06-10T19:07:15.379438+0000","last_active":"2023-06-10T19:07:17.135857+0000","last_peered":"2023-06-10T19:07:17.135857+0000","last_clean":"2023-06-10T19:07:17.135857+0000","last_became_active":"2023-06-10T19:07:15.379010+0000","last_became_peered":"2023-06-10T19:07:15.379010+0000","last_unstale":"2023-06-10T19:07:17.135857+0000","last_undegraded":"2023-06-10T19:07:17.135857+0000","last_fullsized":"2023-06-10T19:07:17.135857+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_clean_scrub_stamp":"2023-06-10T19:07:14.306487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:30:56.171737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.135483+0000","last_change":"2023-06-10T19:07:15.754608+0000","last_active":"2023-06-10T19:07:17.135483+0000","last_peered":"2023-06-10T19:07:17.135483+0000","last_clean":"2023-06-10T19:07:17.135483+0000","last_became_active":"2023-06-10T19:07:15.754287+0000","last_became_peered":"2023-06-10T19:07:15.754287+0000","last_unstale":"2023-06-10T19:07:17.135483+0000","last_undegraded":"2023-06-10T19:07:17.135483+0000","last_fullsized":"2023-06-10T19:07:17.135483+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:40:58.293347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"166'1","reported_seq":14,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.138446+0000","last_change":"2023-06-10T19:07:15.374162+0000","last_active":"2023-06-10T19:07:17.138446+0000","last_peered":"2023-06-10T19:07:17.138446+0000","last_clean":"2023-06-10T19:07:17.138446+0000","last_became_active":"2023-06-10T19:07:15.373514+0000","last_became_peered":"2023-06-10T19:07:15.373514+0000","last_unstale":"2023-06-10T19:07:17.138446+0000","last_undegraded":"2023-06-10T19:07:17.138446+0000","last_fullsized":"2023-06-10T19:07:17.138446+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_clean_scrub_stamp":"2023-06-10T19:07:14.306487+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:05:24.311354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.747798+0000","last_change":"2023-06-10T19:07:15.790174+0000","last_active":"2023-06-10T19:07:16.747798+0000","last_peered":"2023-06-10T19:07:16.747798+0000","last_clean":"2023-06-10T19:07:16.747798+0000","last_became_active":"2023-06-10T19:07:15.789451+0000","last_became_peered":"2023-06-10T19:07:15.789451+0000","last_unstale":"2023-06-10T19:07:16.747798+0000","last_undegraded":"2023-06-10T19:07:16.747798+0000","last_fullsized":"2023-06-10T19:07:16.747798+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:42:20.474642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.e","version":"166'2","reported_seq":15,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.137730+0000","last_change":"2023-06-10T19:07:15.372125+0000","last_active":"2023-06-10T19:07:17.137730+0000","last_peered":"2023-06-10T19:07:17.137730+0000","last_clean":"2023-06-10T19:07:17.137730+0000","last_became_active":"2023-06-10T19:07:15.371744+0000","last_became_peered":"2023-06-10T19:07:15.371744+0000","last_unstale":"2023-06-10T19:07:17.137730+0000","last_undegraded":"2023-06-10T19:07:17.137730+0000","last_fullsized":"2023-06-10T19:07:17.137730+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_clean_scrub_stamp":"2023-06-10T19:07:14.306487+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:57:34.920115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.136258+0000","last_change":"2023-06-10T19:07:15.776232+0000","last_active":"2023-06-10T19:07:17.136258+0000","last_peered":"2023-06-10T19:07:17.136258+0000","last_clean":"2023-06-10T19:07:17.136258+0000","last_became_active":"2023-06-10T19:07:15.775501+0000","last_became_peered":"2023-06-10T19:07:15.775501+0000","last_unstale":"2023-06-10T19:07:17.136258+0000","last_undegraded":"2023-06-10T19:07:17.136258+0000","last_fullsized":"2023-06-10T19:07:17.136258+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:58:23.030375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.d","version":"166'1","reported_seq":14,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.937633+0000","last_change":"2023-06-10T19:07:15.372148+0000","last_active":"2023-06-10T19:07:16.937633+0000","last_peered":"2023-06-10T19:07:16.937633+0000","last_clean":"2023-06-10T19:07:16.937633+0000","last_became_active":"2023-06-10T19:07:15.371886+0000","last_became_peered":"2023-06-10T19:07:15.371886+0000","last_unstale":"2023-06-10T19:07:16.937633+0000","last_undegraded":"2023-06-10T19:07:16.937633+0000","last_fullsized":"2023-06-10T19:07:16.937633+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_clean_scrub_stamp":"2023-06-10T19:07:14.306487+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:42:19.460156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.136950+0000","last_change":"2023-06-10T19:07:15.756879+0000","last_active":"2023-06-10T19:07:17.136950+0000","last_peered":"2023-06-10T19:07:17.136950+0000","last_clean":"2023-06-10T19:07:17.136950+0000","last_became_active":"2023-06-10T19:07:15.756118+0000","last_became_peered":"2023-06-10T19:07:15.756118+0000","last_unstale":"2023-06-10T19:07:17.136950+0000","last_undegraded":"2023-06-10T19:07:17.136950+0000","last_fullsized":"2023-06-10T19:07:17.136950+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:47:35.378759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.136443+0000","last_change":"2023-06-10T19:07:15.369851+0000","last_active":"2023-06-10T19:07:17.136443+0000","last_peered":"2023-06-10T19:07:17.136443+0000","last_clean":"2023-06-10T19:07:17.136443+0000","last_became_active":"2023-06-10T19:07:15.369258+0000","last_became_peered":"2023-06-10T19:07:15.369258+0000","last_unstale":"2023-06-10T19:07:17.136443+0000","last_undegraded":"2023-06-10T19:07:17.136443+0000","last_fullsized":"2023-06-10T19:07:17.136443+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_clean_scrub_stamp":"2023-06-10T19:07:14.306487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:49:56.075777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.137557+0000","last_change":"2023-06-10T19:07:15.785914+0000","last_active":"2023-06-10T19:07:17.137557+0000","last_peered":"2023-06-10T19:07:17.137557+0000","last_clean":"2023-06-10T19:07:17.137557+0000","last_became_active":"2023-06-10T19:07:15.785596+0000","last_became_peered":"2023-06-10T19:07:15.785596+0000","last_unstale":"2023-06-10T19:07:17.137557+0000","last_undegraded":"2023-06-10T19:07:17.137557+0000","last_fullsized":"2023-06-10T19:07:17.137557+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:28:58.671208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.b","version":"166'2","reported_seq":15,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.937476+0000","last_change":"2023-06-10T19:07:15.379638+0000","last_active":"2023-06-10T19:07:16.937476+0000","last_peered":"2023-06-10T19:07:16.937476+0000","last_clean":"2023-06-10T19:07:16.937476+0000","last_became_active":"2023-06-10T19:07:15.379265+0000","last_became_peered":"2023-06-10T19:07:15.379265+0000","last_unstale":"2023-06-10T19:07:16.937476+0000","last_undegraded":"2023-06-10T19:07:16.937476+0000","last_fullsized":"2023-06-10T19:07:16.937476+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_clean_scrub_stamp":"2023-06-10T19:07:14.306487+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:18:44.730292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.937446+0000","last_change":"2023-06-10T19:07:15.761449+0000","last_active":"2023-06-10T19:07:16.937446+0000","last_peered":"2023-06-10T19:07:16.937446+0000","last_clean":"2023-06-10T19:07:16.937446+0000","last_became_active":"2023-06-10T19:07:15.761180+0000","last_became_peered":"2023-06-10T19:07:15.761180+0000","last_unstale":"2023-06-10T19:07:16.937446+0000","last_undegraded":"2023-06-10T19:07:16.937446+0000","last_fullsized":"2023-06-10T19:07:16.937446+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:33:53.963637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.135909+0000","last_change":"2023-06-10T19:07:15.369619+0000","last_active":"2023-06-10T19:07:17.135909+0000","last_peered":"2023-06-10T19:07:17.135909+0000","last_clean":"2023-06-10T19:07:17.135909+0000","last_became_active":"2023-06-10T19:07:15.368889+0000","last_became_peered":"2023-06-10T19:07:15.368889+0000","last_unstale":"2023-06-10T19:07:17.135909+0000","last_undegraded":"2023-06-10T19:07:17.135909+0000","last_fullsized":"2023-06-10T19:07:17.135909+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_clean_scrub_stamp":"2023-06-10T19:07:14.306487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:54:41.073147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.937708+0000","last_change":"2023-06-10T19:07:15.768091+0000","last_active":"2023-06-10T19:07:16.937708+0000","last_peered":"2023-06-10T19:07:16.937708+0000","last_clean":"2023-06-10T19:07:16.937708+0000","last_became_active":"2023-06-10T19:07:15.767818+0000","last_became_peered":"2023-06-10T19:07:15.767818+0000","last_unstale":"2023-06-10T19:07:16.937708+0000","last_undegraded":"2023-06-10T19:07:16.937708+0000","last_fullsized":"2023-06-10T19:07:16.937708+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:43:05.691428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.743431+0000","last_change":"2023-06-10T19:07:15.367449+0000","last_active":"2023-06-10T19:07:16.743431+0000","last_peered":"2023-06-10T19:07:16.743431+0000","last_clean":"2023-06-10T19:07:16.743431+0000","last_became_active":"2023-06-10T19:07:15.367072+0000","last_became_peered":"2023-06-10T19:07:15.367072+0000","last_unstale":"2023-06-10T19:07:16.743431+0000","last_undegraded":"2023-06-10T19:07:16.743431+0000","last_fullsized":"2023-06-10T19:07:16.743431+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_clean_scrub_stamp":"2023-06-10T19:07:14.306487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:46:05.517752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.137023+0000","last_change":"2023-06-10T19:07:15.783482+0000","last_active":"2023-06-10T19:07:17.137023+0000","last_peered":"2023-06-10T19:07:17.137023+0000","last_clean":"2023-06-10T19:07:17.137023+0000","last_became_active":"2023-06-10T19:07:15.782814+0000","last_became_peered":"2023-06-10T19:07:15.782814+0000","last_unstale":"2023-06-10T19:07:17.137023+0000","last_undegraded":"2023-06-10T19:07:17.137023+0000","last_fullsized":"2023-06-10T19:07:17.137023+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:33:32.368197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.135432+0000","last_change":"2023-06-10T19:07:15.386012+0000","last_active":"2023-06-10T19:07:17.135432+0000","last_peered":"2023-06-10T19:07:17.135432+0000","last_clean":"2023-06-10T19:07:17.135432+0000","last_became_active":"2023-06-10T19:07:15.384922+0000","last_became_peered":"2023-06-10T19:07:15.384922+0000","last_unstale":"2023-06-10T19:07:17.135432+0000","last_undegraded":"2023-06-10T19:07:17.135432+0000","last_fullsized":"2023-06-10T19:07:17.135432+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_clean_scrub_stamp":"2023-06-10T19:07:14.306487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:10:10.195768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.134778+0000","last_change":"2023-06-10T19:07:15.794202+0000","last_active":"2023-06-10T19:07:17.134778+0000","last_peered":"2023-06-10T19:07:17.134778+0000","last_clean":"2023-06-10T19:07:17.134778+0000","last_became_active":"2023-06-10T19:07:15.793629+0000","last_became_peered":"2023-06-10T19:07:15.793629+0000","last_unstale":"2023-06-10T19:07:17.134778+0000","last_undegraded":"2023-06-10T19:07:17.134778+0000","last_fullsized":"2023-06-10T19:07:17.134778+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:57:35.934601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.7","version":"166'2","reported_seq":15,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.937715+0000","last_change":"2023-06-10T19:07:15.366019+0000","last_active":"2023-06-10T19:07:16.937715+0000","last_peered":"2023-06-10T19:07:16.937715+0000","last_clean":"2023-06-10T19:07:16.937715+0000","last_became_active":"2023-06-10T19:07:15.365546+0000","last_became_peered":"2023-06-10T19:07:15.365546+0000","last_unstale":"2023-06-10T19:07:16.937715+0000","last_undegraded":"2023-06-10T19:07:16.937715+0000","last_fullsized":"2023-06-10T19:07:16.937715+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_clean_scrub_stamp":"2023-06-10T19:07:14.306487+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:37:14.610825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.135834+0000","last_change":"2023-06-10T19:07:15.753856+0000","last_active":"2023-06-10T19:07:17.135834+0000","last_peered":"2023-06-10T19:07:17.135834+0000","last_clean":"2023-06-10T19:07:17.135834+0000","last_became_active":"2023-06-10T19:07:15.753582+0000","last_became_peered":"2023-06-10T19:07:15.753582+0000","last_unstale":"2023-06-10T19:07:17.135834+0000","last_undegraded":"2023-06-10T19:07:17.135834+0000","last_fullsized":"2023-06-10T19:07:17.135834+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:40:17.915907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.138445+0000","last_change":"2023-06-10T19:07:15.365207+0000","last_active":"2023-06-10T19:07:17.138445+0000","last_peered":"2023-06-10T19:07:17.138445+0000","last_clean":"2023-06-10T19:07:17.138445+0000","last_became_active":"2023-06-10T19:07:15.364347+0000","last_became_peered":"2023-06-10T19:07:15.364347+0000","last_unstale":"2023-06-10T19:07:17.138445+0000","last_undegraded":"2023-06-10T19:07:17.138445+0000","last_fullsized":"2023-06-10T19:07:17.138445+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_clean_scrub_stamp":"2023-06-10T19:07:14.306487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:02:22.330353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.743135+0000","last_change":"2023-06-10T19:07:15.791430+0000","last_active":"2023-06-10T19:07:16.743135+0000","last_peered":"2023-06-10T19:07:16.743135+0000","last_clean":"2023-06-10T19:07:16.743135+0000","last_became_active":"2023-06-10T19:07:15.791109+0000","last_became_peered":"2023-06-10T19:07:15.791109+0000","last_unstale":"2023-06-10T19:07:16.743135+0000","last_undegraded":"2023-06-10T19:07:16.743135+0000","last_fullsized":"2023-06-10T19:07:16.743135+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:34:36.010281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.137385+0000","last_change":"2023-06-10T19:07:15.385673+0000","last_active":"2023-06-10T19:07:17.137385+0000","last_peered":"2023-06-10T19:07:17.137385+0000","last_clean":"2023-06-10T19:07:17.137385+0000","last_became_active":"2023-06-10T19:07:15.385196+0000","last_became_peered":"2023-06-10T19:07:15.385196+0000","last_unstale":"2023-06-10T19:07:17.137385+0000","last_undegraded":"2023-06-10T19:07:17.137385+0000","last_fullsized":"2023-06-10T19:07:17.137385+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_clean_scrub_stamp":"2023-06-10T19:07:14.306487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:34:02.635429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.136207+0000","last_change":"2023-06-10T19:07:15.763041+0000","last_active":"2023-06-10T19:07:17.136207+0000","last_peered":"2023-06-10T19:07:17.136207+0000","last_clean":"2023-06-10T19:07:17.136207+0000","last_became_active":"2023-06-10T19:07:15.762864+0000","last_became_peered":"2023-06-10T19:07:15.762864+0000","last_unstale":"2023-06-10T19:07:17.136207+0000","last_undegraded":"2023-06-10T19:07:17.136207+0000","last_fullsized":"2023-06-10T19:07:17.136207+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:27:33.110117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.743763+0000","last_change":"2023-06-10T19:07:15.375772+0000","last_active":"2023-06-10T19:07:16.743763+0000","last_peered":"2023-06-10T19:07:16.743763+0000","last_clean":"2023-06-10T19:07:16.743763+0000","last_became_active":"2023-06-10T19:07:15.375376+0000","last_became_peered":"2023-06-10T19:07:15.375376+0000","last_unstale":"2023-06-10T19:07:16.743763+0000","last_undegraded":"2023-06-10T19:07:16.743763+0000","last_fullsized":"2023-06-10T19:07:16.743763+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_clean_scrub_stamp":"2023-06-10T19:07:14.306487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:10:22.395602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.748694+0000","last_change":"2023-06-10T19:07:15.774625+0000","last_active":"2023-06-10T19:07:16.748694+0000","last_peered":"2023-06-10T19:07:16.748694+0000","last_clean":"2023-06-10T19:07:16.748694+0000","last_became_active":"2023-06-10T19:07:15.772827+0000","last_became_peered":"2023-06-10T19:07:15.772827+0000","last_unstale":"2023-06-10T19:07:16.748694+0000","last_undegraded":"2023-06-10T19:07:16.748694+0000","last_fullsized":"2023-06-10T19:07:16.748694+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:12:59.309487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.748401+0000","last_change":"2023-06-10T19:07:15.371238+0000","last_active":"2023-06-10T19:07:16.748401+0000","last_peered":"2023-06-10T19:07:16.748401+0000","last_clean":"2023-06-10T19:07:16.748401+0000","last_became_active":"2023-06-10T19:07:15.370452+0000","last_became_peered":"2023-06-10T19:07:15.370452+0000","last_unstale":"2023-06-10T19:07:16.748401+0000","last_undegraded":"2023-06-10T19:07:16.748401+0000","last_fullsized":"2023-06-10T19:07:16.748401+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_clean_scrub_stamp":"2023-06-10T19:07:14.306487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:30:52.473175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.135915+0000","last_change":"2023-06-10T19:07:15.784671+0000","last_active":"2023-06-10T19:07:17.135915+0000","last_peered":"2023-06-10T19:07:17.135915+0000","last_clean":"2023-06-10T19:07:17.135915+0000","last_became_active":"2023-06-10T19:07:15.783839+0000","last_became_peered":"2023-06-10T19:07:15.783839+0000","last_unstale":"2023-06-10T19:07:17.135915+0000","last_undegraded":"2023-06-10T19:07:17.135915+0000","last_fullsized":"2023-06-10T19:07:17.135915+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:32:53.414324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.137997+0000","last_change":"2023-06-10T19:07:15.365966+0000","last_active":"2023-06-10T19:07:17.137997+0000","last_peered":"2023-06-10T19:07:17.137997+0000","last_clean":"2023-06-10T19:07:17.137997+0000","last_became_active":"2023-06-10T19:07:15.365595+0000","last_became_peered":"2023-06-10T19:07:15.365595+0000","last_unstale":"2023-06-10T19:07:17.137997+0000","last_undegraded":"2023-06-10T19:07:17.137997+0000","last_fullsized":"2023-06-10T19:07:17.137997+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_clean_scrub_stamp":"2023-06-10T19:07:14.306487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:28:39.820467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.138208+0000","last_change":"2023-06-10T19:07:15.785915+0000","last_active":"2023-06-10T19:07:17.138208+0000","last_peered":"2023-06-10T19:07:17.138208+0000","last_clean":"2023-06-10T19:07:17.138208+0000","last_became_active":"2023-06-10T19:07:15.785583+0000","last_became_peered":"2023-06-10T19:07:15.785583+0000","last_unstale":"2023-06-10T19:07:17.138208+0000","last_undegraded":"2023-06-10T19:07:17.138208+0000","last_fullsized":"2023-06-10T19:07:17.138208+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:08:07.956301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.135879+0000","last_change":"2023-06-10T19:07:15.368633+0000","last_active":"2023-06-10T19:07:17.135879+0000","last_peered":"2023-06-10T19:07:17.135879+0000","last_clean":"2023-06-10T19:07:17.135879+0000","last_became_active":"2023-06-10T19:07:15.367893+0000","last_became_peered":"2023-06-10T19:07:15.367893+0000","last_unstale":"2023-06-10T19:07:17.135879+0000","last_undegraded":"2023-06-10T19:07:17.135879+0000","last_fullsized":"2023-06-10T19:07:17.135879+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_clean_scrub_stamp":"2023-06-10T19:07:14.306487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:09:11.484570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.744089+0000","last_change":"2023-06-10T19:07:15.755190+0000","last_active":"2023-06-10T19:07:16.744089+0000","last_peered":"2023-06-10T19:07:16.744089+0000","last_clean":"2023-06-10T19:07:16.744089+0000","last_became_active":"2023-06-10T19:07:15.754901+0000","last_became_peered":"2023-06-10T19:07:15.754901+0000","last_unstale":"2023-06-10T19:07:16.744089+0000","last_undegraded":"2023-06-10T19:07:16.744089+0000","last_fullsized":"2023-06-10T19:07:16.744089+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:16:16.943299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.936705+0000","last_change":"2023-06-10T19:07:15.385634+0000","last_active":"2023-06-10T19:07:16.936705+0000","last_peered":"2023-06-10T19:07:16.936705+0000","last_clean":"2023-06-10T19:07:16.936705+0000","last_became_active":"2023-06-10T19:07:15.385309+0000","last_became_peered":"2023-06-10T19:07:15.385309+0000","last_unstale":"2023-06-10T19:07:16.936705+0000","last_undegraded":"2023-06-10T19:07:16.936705+0000","last_fullsized":"2023-06-10T19:07:16.936705+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_clean_scrub_stamp":"2023-06-10T19:07:14.306487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:28:39.820467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.135050+0000","last_change":"2023-06-10T19:07:15.796650+0000","last_active":"2023-06-10T19:07:17.135050+0000","last_peered":"2023-06-10T19:07:17.135050+0000","last_clean":"2023-06-10T19:07:17.135050+0000","last_became_active":"2023-06-10T19:07:15.795976+0000","last_became_peered":"2023-06-10T19:07:15.795976+0000","last_unstale":"2023-06-10T19:07:17.135050+0000","last_undegraded":"2023-06-10T19:07:17.135050+0000","last_fullsized":"2023-06-10T19:07:17.135050+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:40:40.272825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.138448+0000","last_change":"2023-06-10T19:07:15.365453+0000","last_active":"2023-06-10T19:07:17.138448+0000","last_peered":"2023-06-10T19:07:17.138448+0000","last_clean":"2023-06-10T19:07:17.138448+0000","last_became_active":"2023-06-10T19:07:15.364843+0000","last_became_peered":"2023-06-10T19:07:15.364843+0000","last_unstale":"2023-06-10T19:07:17.138448+0000","last_undegraded":"2023-06-10T19:07:17.138448+0000","last_fullsized":"2023-06-10T19:07:17.138448+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_clean_scrub_stamp":"2023-06-10T19:07:14.306487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:19:26.533564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":414,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.136206+0000","last_change":"2023-06-10T18:52:34.951528+0000","last_active":"2023-06-10T19:07:17.136206+0000","last_peered":"2023-06-10T19:07:17.136206+0000","last_clean":"2023-06-10T19:07:17.136206+0000","last_became_active":"2023-06-10T18:52:34.949099+0000","last_became_peered":"2023-06-10T18:52:34.949099+0000","last_unstale":"2023-06-10T19:07:17.136206+0000","last_undegraded":"2023-06-10T19:07:17.136206+0000","last_fullsized":"2023-06-10T19:07:17.136206+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_clean_scrub_stamp":"2023-06-10T18:52:33.633295+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:33:35.854532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":288,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.137199+0000","last_change":"2023-06-10T18:52:40.506384+0000","last_active":"2023-06-10T19:07:17.137199+0000","last_peered":"2023-06-10T19:07:17.137199+0000","last_clean":"2023-06-10T19:07:17.137199+0000","last_became_active":"2023-06-10T18:52:40.505701+0000","last_became_peered":"2023-06-10T18:52:40.505701+0000","last_unstale":"2023-06-10T19:07:17.137199+0000","last_undegraded":"2023-06-10T19:07:17.137199+0000","last_fullsized":"2023-06-10T19:07:17.137199+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:58:15.038772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.137376+0000","last_change":"2023-06-10T19:07:15.759988+0000","last_active":"2023-06-10T19:07:17.137376+0000","last_peered":"2023-06-10T19:07:17.137376+0000","last_clean":"2023-06-10T19:07:17.137376+0000","last_became_active":"2023-06-10T19:07:15.759768+0000","last_became_peered":"2023-06-10T19:07:15.759768+0000","last_unstale":"2023-06-10T19:07:17.137376+0000","last_undegraded":"2023-06-10T19:07:17.137376+0000","last_fullsized":"2023-06-10T19:07:17.137376+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:55:17.819720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.15","version":"166'3","reported_seq":16,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.748226+0000","last_change":"2023-06-10T19:07:15.377921+0000","last_active":"2023-06-10T19:07:16.748226+0000","last_peered":"2023-06-10T19:07:16.748226+0000","last_clean":"2023-06-10T19:07:16.748226+0000","last_became_active":"2023-06-10T19:07:15.377107+0000","last_became_peered":"2023-06-10T19:07:15.377107+0000","last_unstale":"2023-06-10T19:07:16.748226+0000","last_undegraded":"2023-06-10T19:07:16.748226+0000","last_fullsized":"2023-06-10T19:07:16.748226+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_clean_scrub_stamp":"2023-06-10T19:07:14.306487+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:09:29.407141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":258,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.135862+0000","last_change":"2023-06-10T18:52:40.512015+0000","last_active":"2023-06-10T19:07:17.135862+0000","last_peered":"2023-06-10T19:07:17.135862+0000","last_clean":"2023-06-10T19:07:17.135862+0000","last_became_active":"2023-06-10T18:52:40.511382+0000","last_became_peered":"2023-06-10T18:52:40.511382+0000","last_unstale":"2023-06-10T19:07:17.135862+0000","last_undegraded":"2023-06-10T19:07:17.135862+0000","last_fullsized":"2023-06-10T19:07:17.135862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:41:58.173239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.743490+0000","last_change":"2023-06-10T19:07:15.755336+0000","last_active":"2023-06-10T19:07:16.743490+0000","last_peered":"2023-06-10T19:07:16.743490+0000","last_clean":"2023-06-10T19:07:16.743490+0000","last_became_active":"2023-06-10T19:07:15.755036+0000","last_became_peered":"2023-06-10T19:07:15.755036+0000","last_unstale":"2023-06-10T19:07:16.743490+0000","last_undegraded":"2023-06-10T19:07:16.743490+0000","last_fullsized":"2023-06-10T19:07:16.743490+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:44:45.263461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"166'6","reported_seq":19,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.138099+0000","last_change":"2023-06-10T19:07:15.371940+0000","last_active":"2023-06-10T19:07:17.138099+0000","last_peered":"2023-06-10T19:07:17.138099+0000","last_clean":"2023-06-10T19:07:17.138099+0000","last_became_active":"2023-06-10T19:07:15.371668+0000","last_became_peered":"2023-06-10T19:07:15.371668+0000","last_unstale":"2023-06-10T19:07:17.138099+0000","last_undegraded":"2023-06-10T19:07:17.138099+0000","last_fullsized":"2023-06-10T19:07:17.138099+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_clean_scrub_stamp":"2023-06-10T19:07:14.306487+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:41:02.671562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":282,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.743378+0000","last_change":"2023-06-10T18:52:40.671725+0000","last_active":"2023-06-10T19:07:16.743378+0000","last_peered":"2023-06-10T19:07:16.743378+0000","last_clean":"2023-06-10T19:07:16.743378+0000","last_became_active":"2023-06-10T18:52:40.671442+0000","last_became_peered":"2023-06-10T18:52:40.671442+0000","last_unstale":"2023-06-10T19:07:16.743378+0000","last_undegraded":"2023-06-10T19:07:16.743378+0000","last_fullsized":"2023-06-10T19:07:16.743378+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:48:52.318889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.135091+0000","last_change":"2023-06-10T19:07:15.777944+0000","last_active":"2023-06-10T19:07:17.135091+0000","last_peered":"2023-06-10T19:07:17.135091+0000","last_clean":"2023-06-10T19:07:17.135091+0000","last_became_active":"2023-06-10T19:07:15.770694+0000","last_became_peered":"2023-06-10T19:07:15.770694+0000","last_unstale":"2023-06-10T19:07:17.135091+0000","last_undegraded":"2023-06-10T19:07:17.135091+0000","last_fullsized":"2023-06-10T19:07:17.135091+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:50:04.184265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.137820+0000","last_change":"2023-06-10T19:07:15.366762+0000","last_active":"2023-06-10T19:07:17.137820+0000","last_peered":"2023-06-10T19:07:17.137820+0000","last_clean":"2023-06-10T19:07:17.137820+0000","last_became_active":"2023-06-10T19:07:15.366449+0000","last_became_peered":"2023-06-10T19:07:15.366449+0000","last_unstale":"2023-06-10T19:07:17.137820+0000","last_undegraded":"2023-06-10T19:07:17.137820+0000","last_fullsized":"2023-06-10T19:07:17.137820+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_clean_scrub_stamp":"2023-06-10T19:07:14.306487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:02:28.748263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":288,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.136662+0000","last_change":"2023-06-10T18:52:40.510258+0000","last_active":"2023-06-10T19:07:17.136662+0000","last_peered":"2023-06-10T19:07:17.136662+0000","last_clean":"2023-06-10T19:07:17.136662+0000","last_became_active":"2023-06-10T18:52:40.509560+0000","last_became_peered":"2023-06-10T18:52:40.509560+0000","last_unstale":"2023-06-10T19:07:17.136662+0000","last_undegraded":"2023-06-10T19:07:17.136662+0000","last_fullsized":"2023-06-10T19:07:17.136662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:56:12.792524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.137034+0000","last_change":"2023-06-10T19:07:15.773725+0000","last_active":"2023-06-10T19:07:17.137034+0000","last_peered":"2023-06-10T19:07:17.137034+0000","last_clean":"2023-06-10T19:07:17.137034+0000","last_became_active":"2023-06-10T19:07:15.772957+0000","last_became_peered":"2023-06-10T19:07:15.772957+0000","last_unstale":"2023-06-10T19:07:17.137034+0000","last_undegraded":"2023-06-10T19:07:17.137034+0000","last_fullsized":"2023-06-10T19:07:17.137034+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:45:35.179785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.135443+0000","last_change":"2023-06-10T19:07:15.367620+0000","last_active":"2023-06-10T19:07:17.135443+0000","last_peered":"2023-06-10T19:07:17.135443+0000","last_clean":"2023-06-10T19:07:17.135443+0000","last_became_active":"2023-06-10T19:07:15.366857+0000","last_became_peered":"2023-06-10T19:07:15.366857+0000","last_unstale":"2023-06-10T19:07:17.135443+0000","last_undegraded":"2023-06-10T19:07:17.135443+0000","last_fullsized":"2023-06-10T19:07:17.135443+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_clean_scrub_stamp":"2023-06-10T19:07:14.306487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:04:28.206868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":258,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.136923+0000","last_change":"2023-06-10T18:52:40.672266+0000","last_active":"2023-06-10T19:07:17.136923+0000","last_peered":"2023-06-10T19:07:17.136923+0000","last_clean":"2023-06-10T19:07:17.136923+0000","last_became_active":"2023-06-10T18:52:40.671966+0000","last_became_peered":"2023-06-10T18:52:40.671966+0000","last_unstale":"2023-06-10T19:07:17.136923+0000","last_undegraded":"2023-06-10T19:07:17.136923+0000","last_fullsized":"2023-06-10T19:07:17.136923+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:24:39.709415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.744253+0000","last_change":"2023-06-10T19:07:15.774597+0000","last_active":"2023-06-10T19:07:16.744253+0000","last_peered":"2023-06-10T19:07:16.744253+0000","last_clean":"2023-06-10T19:07:16.744253+0000","last_became_active":"2023-06-10T19:07:15.774285+0000","last_became_peered":"2023-06-10T19:07:15.774285+0000","last_unstale":"2023-06-10T19:07:16.744253+0000","last_undegraded":"2023-06-10T19:07:16.744253+0000","last_fullsized":"2023-06-10T19:07:16.744253+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:46:32.849101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"166'8","reported_seq":21,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.138398+0000","last_change":"2023-06-10T19:07:15.375146+0000","last_active":"2023-06-10T19:07:17.138398+0000","last_peered":"2023-06-10T19:07:17.138398+0000","last_clean":"2023-06-10T19:07:17.138398+0000","last_became_active":"2023-06-10T19:07:15.374403+0000","last_became_peered":"2023-06-10T19:07:15.374403+0000","last_unstale":"2023-06-10T19:07:17.138398+0000","last_undegraded":"2023-06-10T19:07:17.138398+0000","last_fullsized":"2023-06-10T19:07:17.138398+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_clean_scrub_stamp":"2023-06-10T19:07:14.306487+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:12:31.437641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":258,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.136287+0000","last_change":"2023-06-10T18:52:40.671084+0000","last_active":"2023-06-10T19:07:17.136287+0000","last_peered":"2023-06-10T19:07:17.136287+0000","last_clean":"2023-06-10T19:07:17.136287+0000","last_became_active":"2023-06-10T18:52:40.670697+0000","last_became_peered":"2023-06-10T18:52:40.670697+0000","last_unstale":"2023-06-10T19:07:17.136287+0000","last_undegraded":"2023-06-10T19:07:17.136287+0000","last_fullsized":"2023-06-10T19:07:17.136287+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:28:39.564965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.747156+0000","last_change":"2023-06-10T19:07:15.792195+0000","last_active":"2023-06-10T19:07:16.747156+0000","last_peered":"2023-06-10T19:07:16.747156+0000","last_clean":"2023-06-10T19:07:16.747156+0000","last_became_active":"2023-06-10T19:07:15.791446+0000","last_became_peered":"2023-06-10T19:07:15.791446+0000","last_unstale":"2023-06-10T19:07:16.747156+0000","last_undegraded":"2023-06-10T19:07:16.747156+0000","last_fullsized":"2023-06-10T19:07:16.747156+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:33:53.963637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.13","version":"166'2","reported_seq":15,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.937337+0000","last_change":"2023-06-10T19:07:15.374418+0000","last_active":"2023-06-10T19:07:16.937337+0000","last_peered":"2023-06-10T19:07:16.937337+0000","last_clean":"2023-06-10T19:07:16.937337+0000","last_became_active":"2023-06-10T19:07:15.374027+0000","last_became_peered":"2023-06-10T19:07:15.374027+0000","last_unstale":"2023-06-10T19:07:16.937337+0000","last_undegraded":"2023-06-10T19:07:16.937337+0000","last_fullsized":"2023-06-10T19:07:16.937337+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_clean_scrub_stamp":"2023-06-10T19:07:14.306487+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:05:24.311354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":257,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.138015+0000","last_change":"2023-06-10T18:52:40.514114+0000","last_active":"2023-06-10T19:07:17.138015+0000","last_peered":"2023-06-10T19:07:17.138015+0000","last_clean":"2023-06-10T19:07:17.138015+0000","last_became_active":"2023-06-10T18:52:40.513638+0000","last_became_peered":"2023-06-10T18:52:40.513638+0000","last_unstale":"2023-06-10T19:07:17.138015+0000","last_undegraded":"2023-06-10T19:07:17.138015+0000","last_fullsized":"2023-06-10T19:07:17.138015+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:15:25.480469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.136868+0000","last_change":"2023-06-10T19:07:15.764348+0000","last_active":"2023-06-10T19:07:17.136868+0000","last_peered":"2023-06-10T19:07:17.136868+0000","last_clean":"2023-06-10T19:07:17.136868+0000","last_became_active":"2023-06-10T19:07:15.760583+0000","last_became_peered":"2023-06-10T19:07:15.760583+0000","last_unstale":"2023-06-10T19:07:17.136868+0000","last_undegraded":"2023-06-10T19:07:17.136868+0000","last_fullsized":"2023-06-10T19:07:17.136868+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:52:44.890007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.137689+0000","last_change":"2023-06-10T19:07:15.362495+0000","last_active":"2023-06-10T19:07:17.137689+0000","last_peered":"2023-06-10T19:07:17.137689+0000","last_clean":"2023-06-10T19:07:17.137689+0000","last_became_active":"2023-06-10T19:07:15.362195+0000","last_became_peered":"2023-06-10T19:07:15.362195+0000","last_unstale":"2023-06-10T19:07:17.137689+0000","last_undegraded":"2023-06-10T19:07:17.137689+0000","last_fullsized":"2023-06-10T19:07:17.137689+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_clean_scrub_stamp":"2023-06-10T19:07:14.306487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:51:44.010768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":261,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.748436+0000","last_change":"2023-06-10T18:52:40.515396+0000","last_active":"2023-06-10T19:07:16.748436+0000","last_peered":"2023-06-10T19:07:16.748436+0000","last_clean":"2023-06-10T19:07:16.748436+0000","last_became_active":"2023-06-10T18:52:40.514663+0000","last_became_peered":"2023-06-10T18:52:40.514663+0000","last_unstale":"2023-06-10T19:07:16.748436+0000","last_undegraded":"2023-06-10T19:07:16.748436+0000","last_fullsized":"2023-06-10T19:07:16.748436+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:28:29.845297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":23,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575028,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33660,"kb_used_data":2612,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338180,"statfs":{"total":96636764160,"available":96602296320,"internally_reserved":0,"allocated":2674688,"data_stored":1561466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:07:04 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.93600000000000005,"15min":0.92500000000000004},"min":{"1min":0.443,"5min":0.443,"15min":0.434},"max":{"1min":1.131,"5min":1.522,"15min":1.6220000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.88,"5min":0.90900000000000003,"15min":0.92400000000000004},"min":{"1min":0.63400000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.1379999999999999,"5min":1.3109999999999999,"15min":1.6870000000000001},"last":0.83899999999999997}]},{"osd":1,"last update":"Sat Jun 10 19:07:04 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.88800000000000001,"15min":0.91700000000000004},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.377},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.92300000000000004,"15min":0.94299999999999995},"min":{"1min":0.55000000000000004,"5min":0.51300000000000001,"15min":0.504},"max":{"1min":1.302,"5min":1.3320000000000001,"15min":1.5960000000000001},"last":0.97199999999999998}]},{"osd":2,"last update":"Sat Jun 10 19:07:04 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.86699999999999999,"15min":0.85299999999999998},"min":{"1min":0.41899999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.2370000000000001,"5min":1.2629999999999999,"15min":1.4059999999999999},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.88700000000000001,"15min":0.89600000000000002},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.50600000000000001},"max":{"1min":1.2290000000000001,"5min":1.3100000000000001,"15min":1.448},"last":0.64100000000000001}]},{"osd":3,"last update":"Sat Jun 10 19:07:04 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.89600000000000002,"15min":0.92000000000000004},"min":{"1min":0.68600000000000005,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.1299999999999999,"5min":1.4490000000000001,"15min":1.502},"last":1.036},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.95099999999999996,"15min":0.95599999999999996},"min":{"1min":0.496,"5min":0.432,"15min":0.432},"max":{"1min":1.2,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.81999999999999995}]},{"osd":4,"last update":"Sat Jun 10 19:07:04 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.82799999999999996,"15min":0.84399999999999997},"min":{"1min":0.60299999999999998,"5min":0.307,"15min":0.307},"max":{"1min":1.1639999999999999,"5min":1.2290000000000001,"15min":1.639},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.96699999999999997,"15min":0.96599999999999997},"min":{"1min":0.47299999999999998,"5min":0.41199999999999998,"15min":0.40000000000000002},"max":{"1min":1.1799999999999999,"5min":1.454,"15min":1.4590000000000001},"last":0.996}]},{"osd":5,"last update":"Sat Jun 10 19:07:04 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.99399999999999999,"15min":1.002},"min":{"1min":0.66600000000000004,"5min":0.45100000000000001,"15min":0.38400000000000001},"max":{"1min":1.268,"5min":1.385,"15min":1.806},"last":0.77800000000000002},{"interface":"front","average":{"1min":1.044,"5min":1.0269999999999999,"15min":1.0349999999999999},"min":{"1min":0.78200000000000003,"5min":0.48499999999999999,"15min":0.46500000000000002},"max":{"1min":1.254,"5min":1.665,"15min":1.665},"last":1.0780000000000001}]},{"osd":6,"last update":"Sat Jun 10 19:07:04 2023","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.014,"15min":1.0089999999999999},"min":{"1min":0.71899999999999997,"5min":0.47699999999999998,"15min":0.35999999999999999},"max":{"1min":2.1120000000000001,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":0.79200000000000004},{"interface":"front","average":{"1min":1.117,"5min":1.0960000000000001,"15min":1.099},"min":{"1min":0.82499999999999996,"5min":0.504,"15min":0.441},"max":{"1min":1.397,"5min":1.728,"15min":1.728},"last":1.1180000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575029,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33092,"kb_used_data":2044,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338748,"statfs":{"total":96636764160,"available":96602877952,"internally_reserved":0,"allocated":2093056,"data_stored":977751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:06:56 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.83499999999999996,"15min":0.85999999999999999},"min":{"1min":0.50700000000000001,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.149,"5min":1.2450000000000001,"15min":1.498},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.86399999999999999,"15min":0.879},"min":{"1min":0.57199999999999995,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.131,"5min":1.3009999999999999,"15min":1.496},"last":1.1000000000000001}]},{"osd":1,"last update":"Sat Jun 10 19:06:56 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.84199999999999997,"15min":0.86199999999999999},"min":{"1min":0.53800000000000003,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.0109999999999999,"5min":1.2709999999999999,"15min":1.5229999999999999},"last":1.1200000000000001},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.89500000000000002,"15min":0.90000000000000002},"min":{"1min":0.504,"5min":0.48699999999999999,"15min":0.45300000000000001},"max":{"1min":1.1279999999999999,"5min":1.341,"15min":1.778},"last":1.016}]},{"osd":2,"last update":"Sat Jun 10 19:06:56 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.90500000000000003,"15min":0.90000000000000002},"min":{"1min":0.53000000000000003,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.3759999999999999},"last":1.151},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86399999999999999,"15min":0.88300000000000001},"min":{"1min":0.65400000000000003,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.121,"5min":1.22,"15min":1.246},"last":0.88900000000000001}]},{"osd":3,"last update":"Sat Jun 10 19:06:56 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.91500000000000004,"15min":0.91900000000000004},"min":{"1min":0.64500000000000002,"5min":0.55100000000000005,"15min":0.52700000000000002},"max":{"1min":1.232,"5min":1.238,"15min":1.7190000000000001},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.96599999999999997,"15min":0.98199999999999998},"min":{"1min":0.65500000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.304,"5min":1.371,"15min":1.4370000000000001},"last":0.98599999999999999}]},{"osd":4,"last update":"Sat Jun 10 19:06:56 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.75900000000000001,"5min":0.373,"15min":0.373},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.798},"last":1.2130000000000001},{"interface":"front","average":{"1min":1.012,"5min":1,"15min":0.98799999999999999},"min":{"1min":0.504,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.409,"5min":1.409,"15min":1.5489999999999999},"last":0.65600000000000003}]},{"osd":5,"last update":"Sat Jun 10 19:06:56 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.88,"15min":0.90900000000000003},"min":{"1min":0.65300000000000002,"5min":0.437,"15min":0.437},"max":{"1min":1.2150000000000001,"5min":1.29,"15min":1.333},"last":0.76100000000000001},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.004,"15min":1.0229999999999999},"min":{"1min":0.47199999999999998,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":2.536},"last":1.284}]},{"osd":7,"last update":"Sat Jun 10 19:06:56 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.0409999999999999,"15min":1.0309999999999999},"min":{"1min":0.73799999999999999,"5min":0.58599999999999997,"15min":0.57099999999999995},"max":{"1min":1.1970000000000001,"5min":1.879,"15min":1.917},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.98799999999999999,"15min":1.0069999999999999},"min":{"1min":0.63200000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.3320000000000001,"5min":1.4850000000000001,"15min":1.5569999999999999},"last":1.0609999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575029,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33100,"kb_used_data":2052,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338740,"statfs":{"total":96636764160,"available":96602869760,"internally_reserved":0,"allocated":2101248,"data_stored":977875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:06:50 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.86599999999999999,"15min":0.876},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.2669999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.90900000000000003,"15min":0.91200000000000003},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.49399999999999999},"max":{"1min":1.167,"5min":1.2370000000000001,"15min":2.347},"last":0.88500000000000001}]},{"osd":1,"last update":"Sat Jun 10 19:06:50 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.88,"15min":0.91400000000000003},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.52600000000000002},"max":{"1min":1.2290000000000001,"5min":1.6739999999999999,"15min":7.0800000000000001},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.91400000000000003,"15min":0.98499999999999999},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.244,"5min":1.381,"15min":15.845000000000001},"last":0.60899999999999999}]},{"osd":2,"last update":"Sat Jun 10 19:06:50 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.89700000000000002,"15min":0.89400000000000002},"min":{"1min":0.64800000000000002,"5min":0.54300000000000004,"15min":0.48299999999999998},"max":{"1min":1.204,"5min":1.6459999999999999,"15min":5.0049999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.92100000000000004,"15min":0.94599999999999995},"min":{"1min":0.65500000000000003,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.212,"5min":1.391,"15min":6.851},"last":0.95399999999999996}]},{"osd":3,"last update":"Sat Jun 10 19:06:50 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.94199999999999995,"15min":0.95299999999999996},"min":{"1min":0.58799999999999997,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1100000000000001,"5min":1.6910000000000001,"15min":2.544},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.0029999999999999,"5min":0.98699999999999999,"15min":0.996},"min":{"1min":0.67000000000000004,"5min":0.66000000000000003,"15min":0.59799999999999998},"max":{"1min":1.294,"5min":1.4870000000000001,"15min":3.0830000000000002},"last":1.1240000000000001}]},{"osd":4,"last update":"Sat Jun 10 19:06:50 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.94899999999999995,"15min":0.94999999999999996},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.58099999999999996},"max":{"1min":1.222,"5min":1.6140000000000001,"15min":6.7290000000000001},"last":1.016},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.96299999999999997,"15min":0.98799999999999999},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.319,"5min":1.446,"15min":1.575},"last":1.087}]},{"osd":6,"last update":"Sat Jun 10 19:06:50 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.97399999999999998,"15min":0.98799999999999999},"min":{"1min":0.61799999999999999,"5min":0.60499999999999998,"15min":0.54200000000000004},"max":{"1min":1.327,"5min":1.8009999999999999,"15min":1.8009999999999999},"last":1.038},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.028,"15min":1.0529999999999999},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.57899999999999996},"max":{"1min":1.3360000000000001,"5min":1.8380000000000001,"15min":6.923},"last":1.0629999999999999}]},{"osd":7,"last update":"Sat Jun 10 19:06:50 2023","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.0649999999999999,"15min":1.083},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.4259999999999999,"5min":1.7749999999999999,"15min":2.6080000000000001},"last":0.98699999999999999},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.115,"15min":1.135},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.3859999999999999,"5min":1.732,"15min":5.4169999999999998},"last":1.1819999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575028,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33108,"kb_used_data":2060,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338732,"statfs":{"total":96636764160,"available":96602861568,"internally_reserved":0,"allocated":2109440,"data_stored":978515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.83999999999999997,"15min":0.83299999999999996},"min":{"1min":0.53200000000000003,"5min":0.45400000000000001,"15min":0.45100000000000001},"max":{"1min":1.2190000000000001,"5min":1.29,"15min":1.29},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.90000000000000002,"15min":0.90600000000000003},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.375,"5min":1.3979999999999999,"15min":3.7280000000000002},"last":0.71499999999999997}]},{"osd":1,"last update":"Sat Jun 10 19:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.90000000000000002,"15min":0.92800000000000005},"min":{"1min":0.55000000000000004,"5min":0.47799999999999998,"15min":0.47599999999999998},"max":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":3.3969999999999998},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.83199999999999996,"15min":0.86199999999999999},"min":{"1min":0.55700000000000005,"5min":0.47899999999999998,"15min":0.47699999999999998},"max":{"1min":1.212,"5min":1.2430000000000001,"15min":2.496},"last":0.55200000000000005}]},{"osd":2,"last update":"Sat Jun 10 19:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.85899999999999999,"15min":0.879},"min":{"1min":0.52400000000000002,"5min":0.52200000000000002,"15min":0.49299999999999999},"max":{"1min":1.137,"5min":1.236,"15min":1.522},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.95899999999999996,"15min":0.98499999999999999},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.55000000000000004},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":3.5750000000000002},"last":0.877}]},{"osd":3,"last update":"Sat Jun 10 19:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.86399999999999999,"15min":0.89300000000000002},"min":{"1min":0.57799999999999996,"5min":0.56200000000000006,"15min":0.53900000000000003},"max":{"1min":1.1200000000000001,"5min":1.46,"15min":2.3809999999999998},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.94599999999999995,"15min":0.96299999999999997},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.54400000000000004},"max":{"1min":1.2889999999999999,"5min":1.4279999999999999,"15min":1.6479999999999999},"last":0.95799999999999996}]},{"osd":5,"last update":"Sat Jun 10 19:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.95299999999999996,"15min":0.95799999999999996},"min":{"1min":0.66800000000000004,"5min":0.58699999999999997,"15min":0.53100000000000003},"max":{"1min":1.224,"5min":1.3260000000000001,"15min":3.6539999999999999},"last":1.0269999999999999},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.92000000000000004,"15min":0.93999999999999995},"min":{"1min":0.63400000000000001,"5min":0.495,"15min":0.495},"max":{"1min":1.216,"5min":1.26,"15min":2.6720000000000002},"last":0.78000000000000003}]},{"osd":6,"last update":"Sat Jun 10 19:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.97599999999999998,"15min":0.96799999999999997},"min":{"1min":0.67000000000000004,"5min":0.443,"15min":0.443},"max":{"1min":1.2869999999999999,"5min":1.413,"15min":2.2639999999999998},"last":1.002},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.081,"15min":1.0680000000000001},"min":{"1min":0.76300000000000001,"5min":0.58799999999999997,"15min":0.44400000000000001},"max":{"1min":1.625,"5min":1.625,"15min":3.4980000000000002},"last":0.97799999999999998}]},{"osd":7,"last update":"Sat Jun 10 19:07:08 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.02,"15min":1.0009999999999999},"min":{"1min":0.82699999999999996,"5min":0.60899999999999999,"15min":0.41399999999999998},"max":{"1min":1.3240000000000001,"5min":1.3919999999999999,"15min":2.5910000000000002},"last":0.93300000000000005},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.071},"min":{"1min":0.81100000000000005,"5min":0.50800000000000001,"15min":0.46300000000000002},"max":{"1min":1.385,"5min":1.635,"15min":1.635},"last":1.2729999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575027,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37192,"kb_used_data":2048,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334648,"statfs":{"total":96636764160,"available":96598679552,"internally_reserved":0,"allocated":2097152,"data_stored":972247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:06:52 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.65500000000000003,"15min":0.628},"min":{"1min":0.44900000000000001,"5min":0.248,"15min":0.248},"max":{"1min":1.0900000000000001,"5min":1.1539999999999999,"15min":1.169},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.626,"5min":0.66900000000000004,"15min":0.66700000000000004},"min":{"1min":0.307,"5min":0.30299999999999999,"15min":0.251},"max":{"1min":0.85099999999999998,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.78800000000000003}]},{"osd":1,"last update":"Sat Jun 10 19:06:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.69099999999999995,"15min":0.68300000000000005},"min":{"1min":0.34899999999999998,"5min":0.29699999999999999,"15min":0.27500000000000002},"max":{"1min":1.034,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.71399999999999997,"15min":0.73399999999999999},"min":{"1min":0.35399999999999998,"5min":0.34399999999999997,"15min":0.318},"max":{"1min":1.1439999999999999,"5min":1.2569999999999999,"15min":1.411},"last":0.73499999999999999}]},{"osd":2,"last update":"Sat Jun 10 19:06:52 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.76700000000000002,"15min":0.77500000000000002},"min":{"1min":0.42799999999999999,"5min":0.39300000000000002,"15min":0.30299999999999999},"max":{"1min":1.1950000000000001,"5min":1.2829999999999999,"15min":1.9530000000000001},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.81899999999999995,"15min":0.79600000000000004},"min":{"1min":0.45800000000000002,"5min":0.35299999999999998,"15min":0.29699999999999999},"max":{"1min":1.2170000000000001,"5min":1.591,"15min":1.591},"last":1.028}]},{"osd":4,"last update":"Sat Jun 10 19:06:52 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.96699999999999997,"15min":0.95299999999999996},"min":{"1min":0.626,"5min":0.60899999999999999,"15min":0.41899999999999998},"max":{"1min":1.252,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":0.91400000000000003},{"interface":"front","average":{"1min":1.0169999999999999,"5min":0.999,"15min":0.99299999999999999},"min":{"1min":0.73699999999999999,"5min":0.57299999999999995,"15min":0.47999999999999998},"max":{"1min":1.3580000000000001,"5min":1.873,"15min":1.873},"last":1.1080000000000001}]},{"osd":5,"last update":"Sat Jun 10 19:06:52 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.004,"15min":1.0129999999999999},"min":{"1min":0.59599999999999997,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.53,"5min":1.752,"15min":2.024},"last":1.0620000000000001},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.046,"15min":1.036},"min":{"1min":0.65200000000000002,"5min":0.59999999999999998,"15min":0.46899999999999997},"max":{"1min":1.534,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":1.131}]},{"osd":6,"last update":"Sat Jun 10 19:06:52 2023","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.0680000000000001,"15min":1.0649999999999999},"min":{"1min":0.746,"5min":0.56999999999999995,"15min":0.55300000000000005},"max":{"1min":1.617,"5min":1.786,"15min":1.8500000000000001},"last":0.88},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.052,"15min":1.056},"min":{"1min":0.61399999999999999,"5min":0.61199999999999999,"15min":0.58799999999999997},"max":{"1min":1.417,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":1.175}]},{"osd":7,"last update":"Sat Jun 10 19:06:52 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.079,"15min":1.089},"min":{"1min":0.58599999999999997,"5min":0.57999999999999996,"15min":0.56999999999999995},"max":{"1min":1.3320000000000001,"5min":2.1150000000000002,"15min":2.1150000000000002},"last":1.085},{"interface":"front","average":{"1min":1.139,"5min":1.099,"15min":1.101},"min":{"1min":0.625,"5min":0.625,"15min":0.61099999999999999},"max":{"1min":1.538,"5min":1.9850000000000001,"15min":1.9850000000000001},"last":1.153}]}]},{"osd":2,"up_from":13,"seq":55834575028,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37188,"kb_used_data":2044,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334652,"statfs":{"total":96636764160,"available":96598683648,"internally_reserved":0,"allocated":2093056,"data_stored":977751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:07:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.63200000000000001,"15min":0.622},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.27300000000000002},"max":{"1min":0.98599999999999999,"5min":2.883,"15min":2.883},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.77600000000000002,"15min":0.74099999999999999},"min":{"1min":0.38300000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.155,"5min":6.5670000000000002,"15min":6.5670000000000002},"last":0.38900000000000001}]},{"osd":1,"last update":"Sat Jun 10 19:07:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.65500000000000003,"15min":0.66400000000000003},"min":{"1min":0.32500000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1950000000000001},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.81799999999999995,"15min":0.78400000000000003},"min":{"1min":0.32900000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.0669999999999999,"5min":8.4429999999999996,"15min":8.4429999999999996},"last":0.32500000000000001}]},{"osd":3,"last update":"Sat Jun 10 19:07:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.78000000000000003,"15min":0.77500000000000002},"min":{"1min":0.36299999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.0329999999999999,"5min":1.1899999999999999,"15min":1.2350000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.77500000000000002,"15min":0.78100000000000003},"min":{"1min":0.40500000000000003,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":1.143,"5min":4.1849999999999996,"15min":4.1849999999999996},"last":0.46500000000000002}]},{"osd":4,"last update":"Sat Jun 10 19:07:02 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.96199999999999997,"15min":0.93999999999999995},"min":{"1min":0.59699999999999998,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.1699999999999999,"5min":3.996,"15min":3.996},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.91900000000000004,"5min":1.1140000000000001,"15min":1.052},"min":{"1min":0.60599999999999998,"5min":0.496,"15min":0.496},"max":{"1min":1.391,"5min":13.254,"15min":13.254},"last":0.90200000000000002}]},{"osd":5,"last update":"Sat Jun 10 19:07:02 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":1.113,"15min":1.05},"min":{"1min":0.60299999999999998,"5min":0.55900000000000005,"15min":0.54100000000000004},"max":{"1min":1.2270000000000001,"5min":6.9189999999999996,"15min":6.9189999999999996},"last":0.80900000000000005},{"interface":"front","average":{"1min":1.008,"5min":1.246,"15min":1.095},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.609,"5min":15.526,"15min":15.526},"last":0.69999999999999996}]},{"osd":6,"last update":"Sat Jun 10 19:07:02 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":1.1399999999999999,"15min":1.0820000000000001},"min":{"1min":0.71999999999999997,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.5009999999999999,"5min":8.7089999999999996,"15min":8.7089999999999996},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.97399999999999998,"5min":1.075,"15min":1.0589999999999999},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.389,"5min":6.1299999999999999,"15min":6.1299999999999999},"last":0.72599999999999998}]},{"osd":7,"last update":"Sat Jun 10 19:07:02 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.3169999999999999,"15min":1.1699999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.57199999999999995},"max":{"1min":1.4770000000000001,"5min":12.138,"15min":12.138},"last":0.78600000000000003},{"interface":"front","average":{"1min":1.054,"5min":1.099,"15min":1.109},"min":{"1min":0.65000000000000002,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.5660000000000001,"5min":1.657,"15min":1.752},"last":0.71999999999999997}]}]},{"osd":1,"up_from":13,"seq":55834575030,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37196,"kb_used_data":2052,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334644,"statfs":{"total":96636764160,"available":96598675456,"internally_reserved":0,"allocated":2101248,"data_stored":978296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:07:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.64900000000000002,"15min":0.67700000000000005},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":1.0029999999999999,"5min":1.048,"15min":1.288},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.746,"5min":0.73099999999999998,"15min":0.75},"min":{"1min":0.32300000000000001,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.615,"5min":1.615,"15min":1.694},"last":0.627}]},{"osd":2,"last update":"Sat Jun 10 19:07:05 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.61499999999999999,"15min":0.63500000000000001},"min":{"1min":0.30099999999999999,"5min":0.29699999999999999,"15min":0.249},"max":{"1min":0.84599999999999997,"5min":1.0900000000000001,"15min":1.21},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.69299999999999995,"15min":0.72199999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.415},"last":0.33000000000000002}]},{"osd":3,"last update":"Sat Jun 10 19:07:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.73899999999999999,"15min":0.77900000000000003},"min":{"1min":0.41499999999999998,"5min":0.34000000000000002,"15min":0.25600000000000001},"max":{"1min":1.008,"5min":1.143,"15min":1.6299999999999999},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68400000000000005,"15min":0.73299999999999998},"min":{"1min":0.36099999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.083,"5min":1.2709999999999999,"15min":2.1749999999999998},"last":0.48499999999999999}]},{"osd":4,"last update":"Sat Jun 10 19:07:05 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.85099999999999998,"15min":0.86799999999999999},"min":{"1min":0.58599999999999997,"5min":0.56399999999999995,"15min":0.53000000000000003},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.4930000000000001},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.96899999999999997,"15min":1.0289999999999999},"min":{"1min":0.625,"5min":0.47299999999999998,"15min":0.47099999999999997},"max":{"1min":1.575,"5min":1.575,"15min":5.8209999999999997},"last":0.58899999999999997}]},{"osd":5,"last update":"Sat Jun 10 19:07:05 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.96199999999999997,"15min":0.995},"min":{"1min":0.54800000000000004,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.415,"5min":1.5720000000000001,"15min":1.8620000000000001},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.93100000000000005,"15min":0.97699999999999998},"min":{"1min":0.60399999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.448,"5min":1.448,"15min":3.089},"last":0.55000000000000004}]},{"osd":6,"last update":"Sat Jun 10 19:07:05 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.96499999999999997,"15min":1.0449999999999999},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.292,"5min":1.4950000000000001,"15min":7.2599999999999998},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.97399999999999998,"15min":1.036},"min":{"1min":0.65800000000000003,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.542,"5min":1.6000000000000001,"15min":9.0069999999999997},"last":0.60299999999999998}]},{"osd":7,"last update":"Sat Jun 10 19:07:05 2023","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.0189999999999999,"15min":1.075},"min":{"1min":0.67000000000000004,"5min":0.58799999999999997,"15min":0.495},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":2.105},"last":0.54300000000000004},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0389999999999999,"15min":1.0800000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.526,"5min":1.526,"15min":2.2570000000000001},"last":0.78800000000000003}]}]},{"osd":0,"up_from":13,"seq":55834575029,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37772,"kb_used_data":2628,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334068,"statfs":{"total":96636764160,"available":96598085632,"internally_reserved":0,"allocated":2691072,"data_stored":1567204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jun 10 19:07:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.622,"15min":0.63400000000000001},"min":{"1min":0.373,"5min":0.309,"15min":0.248},"max":{"1min":0.91200000000000003,"5min":1.127,"15min":1.127},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.78700000000000003,"15min":0.80100000000000005},"min":{"1min":0.46500000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.3080000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.78800000000000003}]},{"osd":2,"last update":"Sat Jun 10 19:07:02 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.72299999999999998,"15min":0.71699999999999997},"min":{"1min":0.39300000000000002,"5min":0.35199999999999998,"15min":0.29199999999999998},"max":{"1min":1.1000000000000001,"5min":1.2010000000000001,"15min":1.2829999999999999},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.627,"5min":0.64300000000000002,"15min":0.65400000000000003},"min":{"1min":0.41399999999999998,"5min":0.28699999999999998,"15min":0.245},"max":{"1min":0.88400000000000001,"5min":1.1779999999999999,"15min":1.371},"last":0.85599999999999998}]},{"osd":3,"last update":"Sat Jun 10 19:07:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.67300000000000004,"15min":0.68200000000000005},"min":{"1min":0.41299999999999998,"5min":0.35499999999999998,"15min":0.28899999999999998},"max":{"1min":1.397,"5min":1.397,"15min":1.397},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.81799999999999995,"15min":0.82099999999999995},"min":{"1min":0.44500000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.6240000000000001,"5min":1.742,"15min":1.829},"last":0.66900000000000004}]},{"osd":4,"last update":"Sat Jun 10 19:07:02 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.90800000000000003,"15min":0.92000000000000004},"min":{"1min":0.61199999999999999,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.758,"5min":1.758,"15min":3.0209999999999999},"last":1.034},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.022,"15min":1.0249999999999999},"min":{"1min":0.71499999999999997,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.7250000000000001,"5min":1.873,"15min":1.9510000000000001},"last":1.0900000000000001}]},{"osd":5,"last update":"Sat Jun 10 19:07:02 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.91100000000000003,"15min":0.93000000000000005},"min":{"1min":0.628,"5min":0.51200000000000001,"15min":0.45100000000000001},"max":{"1min":1.0649999999999999,"5min":1.3109999999999999,"15min":1.694},"last":0.97199999999999998},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.97599999999999998,"15min":1.0029999999999999},"min":{"1min":0.66300000000000003,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.9870000000000001,"5min":1.9870000000000001,"15min":4.5620000000000003},"last":0.82499999999999996}]},{"osd":6,"last update":"Sat Jun 10 19:07:02 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.05,"15min":1.0720000000000001},"min":{"1min":0.61299999999999999,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.9330000000000001,"5min":1.9330000000000001,"15min":3.5569999999999999},"last":1.008},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":1.0009999999999999},"min":{"1min":0.63600000000000001,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.883},"last":1.2609999999999999}]},{"osd":7,"last update":"Sat Jun 10 19:07:02 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":1.0089999999999999,"15min":1.028},"min":{"1min":0.54700000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.804,"5min":1.804,"15min":1.804},"last":1.175},{"interface":"front","average":{"1min":1.04,"5min":1.0529999999999999,"15min":1.0580000000000001},"min":{"1min":0.71299999999999997,"5min":0.63700000000000001,"15min":0.58699999999999997},"max":{"1min":2.1219999999999999,"5min":2.1219999999999999,"15min":2.1219999999999999},"last":0.90700000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-10T19:07:19.371 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-10T19:07:19.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.526+0000 7f0f1424d640 1 Processor -- start 2023-06-10T19:07:19.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.526+0000 7f0f1424d640 1 -- start start 2023-06-10T19:07:19.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.530+0000 7f0f1424d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0f0c15c7f0 0x7f0f0c15f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:19.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.530+0000 7f0f1424d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f0c15cc40 con 0x7f0f0c15f860 2023-06-10T19:07:19.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.530+0000 7f0f1424d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f0c0af530 con 0x7f0f0c06b780 2023-06-10T19:07:19.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.530+0000 7f0f1424d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f0c15c3d0 con 0x7f0f0c15c7f0 2023-06-10T19:07:19.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.530+0000 7f0f117e8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0f0c15c7f0 0x7f0f0c15f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:19.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.530+0000 7f0f127ea640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f0f0c15f860 0x7f0f0c0ceb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:55272/0 (socket says 172.21.15.53:55272) 2023-06-10T19:07:19.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.530+0000 7f0f127ea640 1 -- 172.21.15.53:0/489448893 learned_addr learned my addr 172.21.15.53:0/489448893 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:07:19.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.530+0000 7f0f10fe7640 1 -- 172.21.15.53:0/489448893 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 84278485 0 0) 0x7f0f0c15cc40 con 0x7f0f0c15f860 2023-06-10T19:07:19.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.530+0000 7f0f10fe7640 1 -- 172.21.15.53:0/489448893 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ef8003530 con 0x7f0f0c15f860 2023-06-10T19:07:19.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.530+0000 7f0f117e8640 1 -- 172.21.15.53:0/489448893 >> v1:172.21.15.117:6789/0 conn(0x7f0f0c06b780 legacy=0x7f0f0c06bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:19.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.530+0000 7f0f117e8640 1 -- 172.21.15.53:0/489448893 >> v1:172.21.15.53:6789/0 conn(0x7f0f0c15f860 legacy=0x7f0f0c0ceb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:19.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.530+0000 7f0f117e8640 1 -- 172.21.15.53:0/489448893 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f0c15fd70 con 0x7f0f0c15c7f0 2023-06-10T19:07:19.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.530+0000 7f0f117e8640 1 --2- 172.21.15.53:0/489448893 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f0c15c7f0 0x7f0f0c15f320 secure :-1 s=READY pgs=2398 cs=0 l=1 rev1=1 crypto rx=0x7f0efc0097c0 tx=0x7f0efc01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7c1ab5638ab942f server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:19.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.530+0000 7f0f10fe7640 1 -- 172.21.15.53:0/489448893 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0efc0ab5f0 con 0x7f0f0c15c7f0 2023-06-10T19:07:19.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.530+0000 7f0f10fe7640 1 -- 172.21.15.53:0/489448893 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0efc0ab750 con 0x7f0f0c15c7f0 2023-06-10T19:07:19.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.534+0000 7f0f10fe7640 1 -- 172.21.15.53:0/489448893 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0efc0abac0 con 0x7f0f0c15c7f0 2023-06-10T19:07:19.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.534+0000 7f0f1424d640 1 -- 172.21.15.53:0/489448893 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f0c15c7f0 msgr2=0x7f0f0c15f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:19.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.534+0000 7f0f1424d640 1 --2- 172.21.15.53:0/489448893 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f0c15c7f0 0x7f0f0c15f320 secure :-1 s=READY pgs=2398 cs=0 l=1 rev1=1 crypto rx=0x7f0efc0097c0 tx=0x7f0efc01c3f0 comp rx=0 tx=0).stop 2023-06-10T19:07:19.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.534+0000 7f0f1424d640 1 -- 172.21.15.53:0/489448893 shutdown_connections 2023-06-10T19:07:19.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.534+0000 7f0f1424d640 1 --2- 172.21.15.53:0/489448893 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f0c15c7f0 0x7f0f0c15f320 unknown :-1 s=CLOSED pgs=2398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:19.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.534+0000 7f0f1424d640 1 -- 172.21.15.53:0/489448893 >> 172.21.15.53:0/489448893 conn(0x7f0f0c06a090 msgr2=0x7f0f0c06d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:19.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.534+0000 7f0f1424d640 1 -- 172.21.15.53:0/489448893 shutdown_connections 2023-06-10T19:07:19.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.534+0000 7f0f1424d640 1 -- 172.21.15.53:0/489448893 wait complete. 2023-06-10T19:07:19.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.534+0000 7f0f1424d640 1 Processor -- start 2023-06-10T19:07:19.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.534+0000 7f0f1424d640 1 -- start start 2023-06-10T19:07:19.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.534+0000 7f0f1424d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f0c06b780 0x7f0f0c1542f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:19.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.534+0000 7f0f1424d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f0c15c7f0 0x7f0f0c0c6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:19.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.534+0000 7f0f1424d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f0c15f860 0x7f0f0c06f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:19.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.534+0000 7f0f1424d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0c0c3980 con 0x7f0f0c15c7f0 2023-06-10T19:07:19.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.534+0000 7f0f1424d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0c159be0 con 0x7f0f0c15f860 2023-06-10T19:07:19.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.534+0000 7f0f1424d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0c159ec0 con 0x7f0f0c06b780 2023-06-10T19:07:19.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.534+0000 7f0f117e8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f0c15c7f0 0x7f0f0c0c6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:19.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.534+0000 7f0f117e8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f0c15c7f0 0x7f0f0c0c6180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33874/0 (socket says 172.21.15.53:33874) 2023-06-10T19:07:19.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.534+0000 7f0f117e8640 1 -- 172.21.15.53:0/2060801360 learned_addr learned my addr 172.21.15.53:0/2060801360 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:19.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.534+0000 7f0f117e8640 1 -- 172.21.15.53:0/2060801360 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f0c06b780 msgr2=0x7f0f0c1542f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:19.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.534+0000 7f0f117e8640 1 --2- 172.21.15.53:0/2060801360 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f0c06b780 0x7f0f0c1542f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:19.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.534+0000 7f0f117e8640 1 -- 172.21.15.53:0/2060801360 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f0c15f860 msgr2=0x7f0f0c06f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:19.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.534+0000 7f0f117e8640 1 --2- 172.21.15.53:0/2060801360 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f0c15f860 0x7f0f0c06f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:19.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.534+0000 7f0f117e8640 1 -- 172.21.15.53:0/2060801360 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0efc009420 con 0x7f0f0c15c7f0 2023-06-10T19:07:19.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.534+0000 7f0f117e8640 1 --2- 172.21.15.53:0/2060801360 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f0c15c7f0 0x7f0f0c0c6180 secure :-1 s=READY pgs=2399 cs=0 l=1 rev1=1 crypto rx=0x7f0efc01a020 tx=0x7f0efc019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:19.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.534+0000 7f0f027fc640 1 -- 172.21.15.53:0/2060801360 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0efc004220 con 0x7f0f0c15c7f0 2023-06-10T19:07:19.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.534+0000 7f0f027fc640 1 -- 172.21.15.53:0/2060801360 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0efc0b9070 con 0x7f0f0c15c7f0 2023-06-10T19:07:19.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.534+0000 7f0f1424d640 1 -- 172.21.15.53:0/2060801360 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f0c15a1a0 con 0x7f0f0c15c7f0 2023-06-10T19:07:19.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.534+0000 7f0f027fc640 1 -- 172.21.15.53:0/2060801360 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0efc003620 con 0x7f0f0c15c7f0 2023-06-10T19:07:19.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.534+0000 7f0f1424d640 1 -- 172.21.15.53:0/2060801360 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f0c15a760 con 0x7f0f0c15c7f0 2023-06-10T19:07:19.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.538+0000 7f0f1424d640 1 -- 172.21.15.53:0/2060801360 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f0c0cb390 con 0x7f0f0c15c7f0 2023-06-10T19:07:19.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.538+0000 7f0f027fc640 1 -- 172.21.15.53:0/2060801360 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0efc003780 con 0x7f0f0c15c7f0 2023-06-10T19:07:19.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.538+0000 7f0f027fc640 1 --2- 172.21.15.53:0/2060801360 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0ef0066280 0x7f0ef0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:19.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.538+0000 7f0f027fc640 1 -- 172.21.15.53:0/2060801360 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0efc0bb070 con 0x7f0f0c15c7f0 2023-06-10T19:07:19.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.538+0000 7f0f11fe9640 1 --2- 172.21.15.53:0/2060801360 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0ef0066280 0x7f0ef0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:19.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.538+0000 7f0f11fe9640 1 --2- 172.21.15.53:0/2060801360 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0ef0066280 0x7f0ef0068730 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f0f08000f70 tx=0x7f0f080079e0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:19.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.542+0000 7f0f027fc640 1 -- 172.21.15.53:0/2060801360 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0efc0eb920 con 0x7f0f0c15c7f0 2023-06-10T19:07:19.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.682+0000 7f0f1424d640 1 -- 172.21.15.53:0/2060801360 --> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0f0c0b1a10 con 0x7f0ef0066280 2023-06-10T19:07:19.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.706+0000 7f0f027fc640 1 -- 172.21.15.53:0/2060801360 <== mgr.4105 v2:172.21.15.117:6832/3061986771 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310342 (secure 0 0 0) 0x7f0f0c0b1a10 con 0x7f0ef0066280 2023-06-10T19:07:19.713 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:07:19.714 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-06-10T19:07:19.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.710+0000 7f0f1424d640 1 -- 172.21.15.53:0/2060801360 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0ef0066280 msgr2=0x7f0ef0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:19.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.710+0000 7f0f1424d640 1 --2- 172.21.15.53:0/2060801360 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0ef0066280 0x7f0ef0068730 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f0f08000f70 tx=0x7f0f080079e0 comp rx=0 tx=0).stop 2023-06-10T19:07:19.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.710+0000 7f0f1424d640 1 -- 172.21.15.53:0/2060801360 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f0c15c7f0 msgr2=0x7f0f0c0c6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:19.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.710+0000 7f0f1424d640 1 --2- 172.21.15.53:0/2060801360 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f0c15c7f0 0x7f0f0c0c6180 secure :-1 s=READY pgs=2399 cs=0 l=1 rev1=1 crypto rx=0x7f0efc01a020 tx=0x7f0efc019190 comp rx=0 tx=0).stop 2023-06-10T19:07:19.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.710+0000 7f0f1424d640 1 -- 172.21.15.53:0/2060801360 shutdown_connections 2023-06-10T19:07:19.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.710+0000 7f0f1424d640 1 --2- 172.21.15.53:0/2060801360 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0ef0066280 0x7f0ef0068730 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:19.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.710+0000 7f0f1424d640 1 --2- 172.21.15.53:0/2060801360 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f0c15f860 0x7f0f0c06f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:19.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.710+0000 7f0f1424d640 1 --2- 172.21.15.53:0/2060801360 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f0c15c7f0 0x7f0f0c0c6180 unknown :-1 s=CLOSED pgs=2399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:19.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.710+0000 7f0f1424d640 1 --2- 172.21.15.53:0/2060801360 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0f0c06b780 0x7f0f0c1542f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:19.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.710+0000 7f0f1424d640 1 -- 172.21.15.53:0/2060801360 >> 172.21.15.53:0/2060801360 conn(0x7f0f0c06a090 msgr2=0x7f0f0c0af7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:19.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.710+0000 7f0f1424d640 1 -- 172.21.15.53:0/2060801360 shutdown_connections 2023-06-10T19:07:19.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.710+0000 7f0f1424d640 1 -- 172.21.15.53:0/2060801360 wait complete. 2023-06-10T19:07:19.731 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":603,"stamp":"2023-06-10T19:07:17.885840+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":139,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":282308,"kb_used_data":17540,"kb_used_omap":0,"kb_used_meta":264704,"kb_avail":754692412,"statfs":{"total":773094113280,"available":772805029888,"internally_reserved":0,"allocated":17960960,"data_stored":8991105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":271056896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":63,"apply_latency_ms":63,"commit_latency_ns":63000000,"apply_latency_ns":63000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001206"},"pg_stats":[{"pgid":"24.3f","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.748528+0000","last_change":"2023-06-10T19:07:15.794568+0000","last_active":"2023-06-10T19:07:16.748528+0000","last_peered":"2023-06-10T19:07:16.748528+0000","last_clean":"2023-06-10T19:07:16.748528+0000","last_became_active":"2023-06-10T19:07:15.793876+0000","last_became_peered":"2023-06-10T19:07:15.793876+0000","last_unstale":"2023-06-10T19:07:16.748528+0000","last_undegraded":"2023-06-10T19:07:16.748528+0000","last_fullsized":"2023-06-10T19:07:16.748528+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:18:32.043973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.135896+0000","last_change":"2023-06-10T19:07:15.783807+0000","last_active":"2023-06-10T19:07:17.135896+0000","last_peered":"2023-06-10T19:07:17.135896+0000","last_clean":"2023-06-10T19:07:17.135896+0000","last_became_active":"2023-06-10T19:07:15.783154+0000","last_became_peered":"2023-06-10T19:07:15.783154+0000","last_unstale":"2023-06-10T19:07:17.135896+0000","last_undegraded":"2023-06-10T19:07:17.135896+0000","last_fullsized":"2023-06-10T19:07:17.135896+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:04:48.865897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.747869+0000","last_change":"2023-06-10T19:07:15.776017+0000","last_active":"2023-06-10T19:07:16.747869+0000","last_peered":"2023-06-10T19:07:16.747869+0000","last_clean":"2023-06-10T19:07:16.747869+0000","last_became_active":"2023-06-10T19:07:15.775404+0000","last_became_peered":"2023-06-10T19:07:15.775404+0000","last_unstale":"2023-06-10T19:07:16.747869+0000","last_undegraded":"2023-06-10T19:07:16.747869+0000","last_fullsized":"2023-06-10T19:07:16.747869+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:15:59.508610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.748335+0000","last_change":"2023-06-10T19:07:15.775820+0000","last_active":"2023-06-10T19:07:16.748335+0000","last_peered":"2023-06-10T19:07:16.748335+0000","last_clean":"2023-06-10T19:07:16.748335+0000","last_became_active":"2023-06-10T19:07:15.775183+0000","last_became_peered":"2023-06-10T19:07:15.775183+0000","last_unstale":"2023-06-10T19:07:16.748335+0000","last_undegraded":"2023-06-10T19:07:16.748335+0000","last_fullsized":"2023-06-10T19:07:16.748335+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:50:38.473215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.937092+0000","last_change":"2023-06-10T19:07:15.774974+0000","last_active":"2023-06-10T19:07:16.937092+0000","last_peered":"2023-06-10T19:07:16.937092+0000","last_clean":"2023-06-10T19:07:16.937092+0000","last_became_active":"2023-06-10T19:07:15.774664+0000","last_became_peered":"2023-06-10T19:07:15.774664+0000","last_unstale":"2023-06-10T19:07:16.937092+0000","last_undegraded":"2023-06-10T19:07:16.937092+0000","last_fullsized":"2023-06-10T19:07:16.937092+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:19:27.548050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.135175+0000","last_change":"2023-06-10T19:07:15.777256+0000","last_active":"2023-06-10T19:07:17.135175+0000","last_peered":"2023-06-10T19:07:17.135175+0000","last_clean":"2023-06-10T19:07:17.135175+0000","last_became_active":"2023-06-10T19:07:15.776232+0000","last_became_peered":"2023-06-10T19:07:15.776232+0000","last_unstale":"2023-06-10T19:07:17.135175+0000","last_undegraded":"2023-06-10T19:07:17.135175+0000","last_fullsized":"2023-06-10T19:07:17.135175+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:33:40.261750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.135623+0000","last_change":"2023-06-10T19:07:15.763440+0000","last_active":"2023-06-10T19:07:17.135623+0000","last_peered":"2023-06-10T19:07:17.135623+0000","last_clean":"2023-06-10T19:07:17.135623+0000","last_became_active":"2023-06-10T19:07:15.763097+0000","last_became_peered":"2023-06-10T19:07:15.763097+0000","last_unstale":"2023-06-10T19:07:17.135623+0000","last_undegraded":"2023-06-10T19:07:17.135623+0000","last_fullsized":"2023-06-10T19:07:17.135623+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:46:01.552233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.135441+0000","last_change":"2023-06-10T19:07:15.775193+0000","last_active":"2023-06-10T19:07:17.135441+0000","last_peered":"2023-06-10T19:07:17.135441+0000","last_clean":"2023-06-10T19:07:17.135441+0000","last_became_active":"2023-06-10T19:07:15.774847+0000","last_became_peered":"2023-06-10T19:07:15.774847+0000","last_unstale":"2023-06-10T19:07:17.135441+0000","last_undegraded":"2023-06-10T19:07:17.135441+0000","last_fullsized":"2023-06-10T19:07:17.135441+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:48:33.652969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.137235+0000","last_change":"2023-06-10T19:07:15.785422+0000","last_active":"2023-06-10T19:07:17.137235+0000","last_peered":"2023-06-10T19:07:17.137235+0000","last_clean":"2023-06-10T19:07:17.137235+0000","last_became_active":"2023-06-10T19:07:15.785065+0000","last_became_peered":"2023-06-10T19:07:15.785065+0000","last_unstale":"2023-06-10T19:07:17.137235+0000","last_undegraded":"2023-06-10T19:07:17.137235+0000","last_fullsized":"2023-06-10T19:07:17.137235+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:02:48.293254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.137416+0000","last_change":"2023-06-10T19:07:15.774859+0000","last_active":"2023-06-10T19:07:17.137416+0000","last_peered":"2023-06-10T19:07:17.137416+0000","last_clean":"2023-06-10T19:07:17.137416+0000","last_became_active":"2023-06-10T19:07:15.774511+0000","last_became_peered":"2023-06-10T19:07:15.774511+0000","last_unstale":"2023-06-10T19:07:17.137416+0000","last_undegraded":"2023-06-10T19:07:17.137416+0000","last_fullsized":"2023-06-10T19:07:17.137416+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:32:50.585355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.136820+0000","last_change":"2023-06-10T19:07:15.769504+0000","last_active":"2023-06-10T19:07:17.136820+0000","last_peered":"2023-06-10T19:07:17.136820+0000","last_clean":"2023-06-10T19:07:17.136820+0000","last_became_active":"2023-06-10T19:07:15.764579+0000","last_became_peered":"2023-06-10T19:07:15.764579+0000","last_unstale":"2023-06-10T19:07:17.136820+0000","last_undegraded":"2023-06-10T19:07:17.136820+0000","last_fullsized":"2023-06-10T19:07:17.136820+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:18:37.354907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.136040+0000","last_change":"2023-06-10T19:07:15.786847+0000","last_active":"2023-06-10T19:07:17.136040+0000","last_peered":"2023-06-10T19:07:17.136040+0000","last_clean":"2023-06-10T19:07:17.136040+0000","last_became_active":"2023-06-10T19:07:15.786000+0000","last_became_peered":"2023-06-10T19:07:15.786000+0000","last_unstale":"2023-06-10T19:07:17.136040+0000","last_undegraded":"2023-06-10T19:07:17.136040+0000","last_fullsized":"2023-06-10T19:07:17.136040+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:37:38.368110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.136475+0000","last_change":"2023-06-10T19:07:15.783590+0000","last_active":"2023-06-10T19:07:17.136475+0000","last_peered":"2023-06-10T19:07:17.136475+0000","last_clean":"2023-06-10T19:07:17.136475+0000","last_became_active":"2023-06-10T19:07:15.783320+0000","last_became_peered":"2023-06-10T19:07:15.783320+0000","last_unstale":"2023-06-10T19:07:17.136475+0000","last_undegraded":"2023-06-10T19:07:17.136475+0000","last_fullsized":"2023-06-10T19:07:17.136475+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:18:14.087304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.936844+0000","last_change":"2023-06-10T19:07:15.756260+0000","last_active":"2023-06-10T19:07:16.936844+0000","last_peered":"2023-06-10T19:07:16.936844+0000","last_clean":"2023-06-10T19:07:16.936844+0000","last_became_active":"2023-06-10T19:07:15.755987+0000","last_became_peered":"2023-06-10T19:07:15.755987+0000","last_unstale":"2023-06-10T19:07:16.936844+0000","last_undegraded":"2023-06-10T19:07:16.936844+0000","last_fullsized":"2023-06-10T19:07:16.936844+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:13:10.977984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.134807+0000","last_change":"2023-06-10T19:07:15.759913+0000","last_active":"2023-06-10T19:07:17.134807+0000","last_peered":"2023-06-10T19:07:17.134807+0000","last_clean":"2023-06-10T19:07:17.134807+0000","last_became_active":"2023-06-10T19:07:15.759167+0000","last_became_peered":"2023-06-10T19:07:15.759167+0000","last_unstale":"2023-06-10T19:07:17.134807+0000","last_undegraded":"2023-06-10T19:07:17.134807+0000","last_fullsized":"2023-06-10T19:07:17.134807+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:30:01.326600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.30","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.750281+0000","last_change":"2023-06-10T19:07:15.764381+0000","last_active":"2023-06-10T19:07:16.750281+0000","last_peered":"2023-06-10T19:07:16.750281+0000","last_clean":"2023-06-10T19:07:16.750281+0000","last_became_active":"2023-06-10T19:07:15.763576+0000","last_became_peered":"2023-06-10T19:07:15.763576+0000","last_unstale":"2023-06-10T19:07:16.750281+0000","last_undegraded":"2023-06-10T19:07:16.750281+0000","last_fullsized":"2023-06-10T19:07:16.750281+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:03:42.526488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.137609+0000","last_change":"2023-06-10T19:07:15.759920+0000","last_active":"2023-06-10T19:07:17.137609+0000","last_peered":"2023-06-10T19:07:17.137609+0000","last_clean":"2023-06-10T19:07:17.137609+0000","last_became_active":"2023-06-10T19:07:15.759635+0000","last_became_peered":"2023-06-10T19:07:15.759635+0000","last_unstale":"2023-06-10T19:07:17.137609+0000","last_undegraded":"2023-06-10T19:07:17.137609+0000","last_fullsized":"2023-06-10T19:07:17.137609+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:02:51.703725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.747692+0000","last_change":"2023-06-10T19:07:15.790570+0000","last_active":"2023-06-10T19:07:16.747692+0000","last_peered":"2023-06-10T19:07:16.747692+0000","last_clean":"2023-06-10T19:07:16.747692+0000","last_became_active":"2023-06-10T19:07:15.789759+0000","last_became_peered":"2023-06-10T19:07:15.789759+0000","last_unstale":"2023-06-10T19:07:16.747692+0000","last_undegraded":"2023-06-10T19:07:16.747692+0000","last_fullsized":"2023-06-10T19:07:16.747692+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:18:45.744778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.137029+0000","last_change":"2023-06-10T19:07:15.761681+0000","last_active":"2023-06-10T19:07:17.137029+0000","last_peered":"2023-06-10T19:07:17.137029+0000","last_clean":"2023-06-10T19:07:17.137029+0000","last_became_active":"2023-06-10T19:07:15.760951+0000","last_became_peered":"2023-06-10T19:07:15.760951+0000","last_unstale":"2023-06-10T19:07:17.137029+0000","last_undegraded":"2023-06-10T19:07:17.137029+0000","last_fullsized":"2023-06-10T19:07:17.137029+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:29:23.985032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.743593+0000","last_change":"2023-06-10T19:07:15.756132+0000","last_active":"2023-06-10T19:07:16.743593+0000","last_peered":"2023-06-10T19:07:16.743593+0000","last_clean":"2023-06-10T19:07:16.743593+0000","last_became_active":"2023-06-10T19:07:15.755805+0000","last_became_peered":"2023-06-10T19:07:15.755805+0000","last_unstale":"2023-06-10T19:07:16.743593+0000","last_undegraded":"2023-06-10T19:07:16.743593+0000","last_fullsized":"2023-06-10T19:07:16.743593+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:31:40.868453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.136831+0000","last_change":"2023-06-10T19:07:15.785903+0000","last_active":"2023-06-10T19:07:17.136831+0000","last_peered":"2023-06-10T19:07:17.136831+0000","last_clean":"2023-06-10T19:07:17.136831+0000","last_became_active":"2023-06-10T19:07:15.785575+0000","last_became_peered":"2023-06-10T19:07:15.785575+0000","last_unstale":"2023-06-10T19:07:17.136831+0000","last_undegraded":"2023-06-10T19:07:17.136831+0000","last_fullsized":"2023-06-10T19:07:17.136831+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:28:19.661422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.135203+0000","last_change":"2023-06-10T19:07:15.772172+0000","last_active":"2023-06-10T19:07:17.135203+0000","last_peered":"2023-06-10T19:07:17.135203+0000","last_clean":"2023-06-10T19:07:17.135203+0000","last_became_active":"2023-06-10T19:07:15.771331+0000","last_became_peered":"2023-06-10T19:07:15.771331+0000","last_unstale":"2023-06-10T19:07:17.135203+0000","last_undegraded":"2023-06-10T19:07:17.135203+0000","last_fullsized":"2023-06-10T19:07:17.135203+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:21:42.365830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.936790+0000","last_change":"2023-06-10T19:07:15.791799+0000","last_active":"2023-06-10T19:07:16.936790+0000","last_peered":"2023-06-10T19:07:16.936790+0000","last_clean":"2023-06-10T19:07:16.936790+0000","last_became_active":"2023-06-10T19:07:15.791455+0000","last_became_peered":"2023-06-10T19:07:15.791455+0000","last_unstale":"2023-06-10T19:07:16.936790+0000","last_undegraded":"2023-06-10T19:07:16.936790+0000","last_fullsized":"2023-06-10T19:07:16.936790+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:41:03.686048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.750460+0000","last_change":"2023-06-10T19:07:15.764289+0000","last_active":"2023-06-10T19:07:16.750460+0000","last_peered":"2023-06-10T19:07:16.750460+0000","last_clean":"2023-06-10T19:07:16.750460+0000","last_became_active":"2023-06-10T19:07:15.763521+0000","last_became_peered":"2023-06-10T19:07:15.763521+0000","last_unstale":"2023-06-10T19:07:16.750460+0000","last_undegraded":"2023-06-10T19:07:16.750460+0000","last_fullsized":"2023-06-10T19:07:16.750460+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:35:41.433827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.138205+0000","last_change":"2023-06-10T19:07:15.755899+0000","last_active":"2023-06-10T19:07:17.138205+0000","last_peered":"2023-06-10T19:07:17.138205+0000","last_clean":"2023-06-10T19:07:17.138205+0000","last_became_active":"2023-06-10T19:07:15.755603+0000","last_became_peered":"2023-06-10T19:07:15.755603+0000","last_unstale":"2023-06-10T19:07:17.138205+0000","last_undegraded":"2023-06-10T19:07:17.138205+0000","last_fullsized":"2023-06-10T19:07:17.138205+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:13:10.977984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.744173+0000","last_change":"2023-06-10T19:07:15.773692+0000","last_active":"2023-06-10T19:07:16.744173+0000","last_peered":"2023-06-10T19:07:16.744173+0000","last_clean":"2023-06-10T19:07:16.744173+0000","last_became_active":"2023-06-10T19:07:15.773397+0000","last_became_peered":"2023-06-10T19:07:15.773397+0000","last_unstale":"2023-06-10T19:07:16.744173+0000","last_undegraded":"2023-06-10T19:07:16.744173+0000","last_fullsized":"2023-06-10T19:07:16.744173+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:00:55.901188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.135569+0000","last_change":"2023-06-10T19:07:15.783613+0000","last_active":"2023-06-10T19:07:17.135569+0000","last_peered":"2023-06-10T19:07:17.135569+0000","last_clean":"2023-06-10T19:07:17.135569+0000","last_became_active":"2023-06-10T19:07:15.782940+0000","last_became_peered":"2023-06-10T19:07:15.782940+0000","last_unstale":"2023-06-10T19:07:17.135569+0000","last_undegraded":"2023-06-10T19:07:17.135569+0000","last_fullsized":"2023-06-10T19:07:17.135569+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:54:58.950415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.137207+0000","last_change":"2023-06-10T19:07:15.787826+0000","last_active":"2023-06-10T19:07:17.137207+0000","last_peered":"2023-06-10T19:07:17.137207+0000","last_clean":"2023-06-10T19:07:17.137207+0000","last_became_active":"2023-06-10T19:07:15.787561+0000","last_became_peered":"2023-06-10T19:07:15.787561+0000","last_unstale":"2023-06-10T19:07:17.137207+0000","last_undegraded":"2023-06-10T19:07:17.137207+0000","last_fullsized":"2023-06-10T19:07:17.137207+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:38:24.420101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.135174+0000","last_change":"2023-06-10T19:07:15.775697+0000","last_active":"2023-06-10T19:07:17.135174+0000","last_peered":"2023-06-10T19:07:17.135174+0000","last_clean":"2023-06-10T19:07:17.135174+0000","last_became_active":"2023-06-10T19:07:15.770921+0000","last_became_peered":"2023-06-10T19:07:15.770921+0000","last_unstale":"2023-06-10T19:07:17.135174+0000","last_undegraded":"2023-06-10T19:07:17.135174+0000","last_fullsized":"2023-06-10T19:07:17.135174+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:59:20.495211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.747103+0000","last_change":"2023-06-10T19:07:15.790277+0000","last_active":"2023-06-10T19:07:16.747103+0000","last_peered":"2023-06-10T19:07:16.747103+0000","last_clean":"2023-06-10T19:07:16.747103+0000","last_became_active":"2023-06-10T19:07:15.789653+0000","last_became_peered":"2023-06-10T19:07:15.789653+0000","last_unstale":"2023-06-10T19:07:16.747103+0000","last_undegraded":"2023-06-10T19:07:16.747103+0000","last_fullsized":"2023-06-10T19:07:16.747103+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:02:23.344839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.135140+0000","last_change":"2023-06-10T19:07:15.796247+0000","last_active":"2023-06-10T19:07:17.135140+0000","last_peered":"2023-06-10T19:07:17.135140+0000","last_clean":"2023-06-10T19:07:17.135140+0000","last_became_active":"2023-06-10T19:07:15.795685+0000","last_became_peered":"2023-06-10T19:07:15.795685+0000","last_unstale":"2023-06-10T19:07:17.135140+0000","last_undegraded":"2023-06-10T19:07:17.135140+0000","last_fullsized":"2023-06-10T19:07:17.135140+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:12:32.452127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.747081+0000","last_change":"2023-06-10T19:07:15.790089+0000","last_active":"2023-06-10T19:07:16.747081+0000","last_peered":"2023-06-10T19:07:16.747081+0000","last_clean":"2023-06-10T19:07:16.747081+0000","last_became_active":"2023-06-10T19:07:15.789575+0000","last_became_peered":"2023-06-10T19:07:15.789575+0000","last_unstale":"2023-06-10T19:07:16.747081+0000","last_undegraded":"2023-06-10T19:07:16.747081+0000","last_fullsized":"2023-06-10T19:07:16.747081+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:05:25.325840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.136548+0000","last_change":"2023-06-10T19:07:15.771563+0000","last_active":"2023-06-10T19:07:17.136548+0000","last_peered":"2023-06-10T19:07:17.136548+0000","last_clean":"2023-06-10T19:07:17.136548+0000","last_became_active":"2023-06-10T19:07:15.770726+0000","last_became_peered":"2023-06-10T19:07:15.770726+0000","last_unstale":"2023-06-10T19:07:17.136548+0000","last_undegraded":"2023-06-10T19:07:17.136548+0000","last_fullsized":"2023-06-10T19:07:17.136548+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:28:42.149220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"166'4","reported_seq":17,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.748889+0000","last_change":"2023-06-10T19:07:15.365674+0000","last_active":"2023-06-10T19:07:16.748889+0000","last_peered":"2023-06-10T19:07:16.748889+0000","last_clean":"2023-06-10T19:07:16.748889+0000","last_became_active":"2023-06-10T19:07:15.364941+0000","last_became_peered":"2023-06-10T19:07:15.364941+0000","last_unstale":"2023-06-10T19:07:16.748889+0000","last_undegraded":"2023-06-10T19:07:16.748889+0000","last_fullsized":"2023-06-10T19:07:16.748889+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_clean_scrub_stamp":"2023-06-10T19:07:14.306487+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:57:48.557614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.136458+0000","last_change":"2023-06-10T19:07:15.795130+0000","last_active":"2023-06-10T19:07:17.136458+0000","last_peered":"2023-06-10T19:07:17.136458+0000","last_clean":"2023-06-10T19:07:17.136458+0000","last_became_active":"2023-06-10T19:07:15.794850+0000","last_became_peered":"2023-06-10T19:07:15.794850+0000","last_unstale":"2023-06-10T19:07:17.136458+0000","last_undegraded":"2023-06-10T19:07:17.136458+0000","last_fullsized":"2023-06-10T19:07:17.136458+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:27:07.697102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"166'1","reported_seq":14,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.937901+0000","last_change":"2023-06-10T19:07:15.373538+0000","last_active":"2023-06-10T19:07:16.937901+0000","last_peered":"2023-06-10T19:07:16.937901+0000","last_clean":"2023-06-10T19:07:16.937901+0000","last_became_active":"2023-06-10T19:07:15.373262+0000","last_became_peered":"2023-06-10T19:07:15.373262+0000","last_unstale":"2023-06-10T19:07:16.937901+0000","last_undegraded":"2023-06-10T19:07:16.937901+0000","last_fullsized":"2023-06-10T19:07:16.937901+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_clean_scrub_stamp":"2023-06-10T19:07:14.306487+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:57:06.060302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.937050+0000","last_change":"2023-06-10T19:07:15.753464+0000","last_active":"2023-06-10T19:07:16.937050+0000","last_peered":"2023-06-10T19:07:16.937050+0000","last_clean":"2023-06-10T19:07:16.937050+0000","last_became_active":"2023-06-10T19:07:15.753112+0000","last_became_peered":"2023-06-10T19:07:15.753112+0000","last_unstale":"2023-06-10T19:07:16.937050+0000","last_undegraded":"2023-06-10T19:07:16.937050+0000","last_fullsized":"2023-06-10T19:07:16.937050+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:08:07.956301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1d","version":"166'2","reported_seq":15,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.137377+0000","last_change":"2023-06-10T19:07:15.367792+0000","last_active":"2023-06-10T19:07:17.137377+0000","last_peered":"2023-06-10T19:07:17.137377+0000","last_clean":"2023-06-10T19:07:17.137377+0000","last_became_active":"2023-06-10T19:07:15.367058+0000","last_became_peered":"2023-06-10T19:07:15.367058+0000","last_unstale":"2023-06-10T19:07:17.137377+0000","last_undegraded":"2023-06-10T19:07:17.137377+0000","last_fullsized":"2023-06-10T19:07:17.137377+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_clean_scrub_stamp":"2023-06-10T19:07:14.306487+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:10:32.024757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.136347+0000","last_change":"2023-06-10T19:07:15.776787+0000","last_active":"2023-06-10T19:07:17.136347+0000","last_peered":"2023-06-10T19:07:17.136347+0000","last_clean":"2023-06-10T19:07:17.136347+0000","last_became_active":"2023-06-10T19:07:15.771779+0000","last_became_peered":"2023-06-10T19:07:15.771779+0000","last_unstale":"2023-06-10T19:07:17.136347+0000","last_undegraded":"2023-06-10T19:07:17.136347+0000","last_fullsized":"2023-06-10T19:07:17.136347+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:11:20.768494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1c","version":"166'2","reported_seq":15,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.743588+0000","last_change":"2023-06-10T19:07:15.385112+0000","last_active":"2023-06-10T19:07:16.743588+0000","last_peered":"2023-06-10T19:07:16.743588+0000","last_clean":"2023-06-10T19:07:16.743588+0000","last_became_active":"2023-06-10T19:07:15.384740+0000","last_became_peered":"2023-06-10T19:07:15.384740+0000","last_unstale":"2023-06-10T19:07:16.743588+0000","last_undegraded":"2023-06-10T19:07:16.743588+0000","last_fullsized":"2023-06-10T19:07:16.743588+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_clean_scrub_stamp":"2023-06-10T19:07:14.306487+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:00:54.379102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.135889+0000","last_change":"2023-06-10T19:07:15.776088+0000","last_active":"2023-06-10T19:07:17.135889+0000","last_peered":"2023-06-10T19:07:17.135889+0000","last_clean":"2023-06-10T19:07:17.135889+0000","last_became_active":"2023-06-10T19:07:15.775709+0000","last_became_peered":"2023-06-10T19:07:15.775709+0000","last_unstale":"2023-06-10T19:07:17.135889+0000","last_undegraded":"2023-06-10T19:07:17.135889+0000","last_fullsized":"2023-06-10T19:07:17.135889+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:09:27.100001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1b","version":"166'1","reported_seq":14,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.136575+0000","last_change":"2023-06-10T19:07:15.368089+0000","last_active":"2023-06-10T19:07:17.136575+0000","last_peered":"2023-06-10T19:07:17.136575+0000","last_clean":"2023-06-10T19:07:17.136575+0000","last_became_active":"2023-06-10T19:07:15.367528+0000","last_became_peered":"2023-06-10T19:07:15.367528+0000","last_unstale":"2023-06-10T19:07:17.136575+0000","last_undegraded":"2023-06-10T19:07:17.136575+0000","last_fullsized":"2023-06-10T19:07:17.136575+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_clean_scrub_stamp":"2023-06-10T19:07:14.306487+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:31:42.311913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.743896+0000","last_change":"2023-06-10T19:07:15.747201+0000","last_active":"2023-06-10T19:07:16.743896+0000","last_peered":"2023-06-10T19:07:16.743896+0000","last_clean":"2023-06-10T19:07:16.743896+0000","last_became_active":"2023-06-10T19:07:15.746941+0000","last_became_peered":"2023-06-10T19:07:15.746941+0000","last_unstale":"2023-06-10T19:07:16.743896+0000","last_undegraded":"2023-06-10T19:07:16.743896+0000","last_fullsized":"2023-06-10T19:07:16.743896+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:22:09.300045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"166'1","reported_seq":14,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.937436+0000","last_change":"2023-06-10T19:07:15.368752+0000","last_active":"2023-06-10T19:07:16.937436+0000","last_peered":"2023-06-10T19:07:16.937436+0000","last_clean":"2023-06-10T19:07:16.937436+0000","last_became_active":"2023-06-10T19:07:15.368175+0000","last_became_peered":"2023-06-10T19:07:15.368175+0000","last_unstale":"2023-06-10T19:07:16.937436+0000","last_undegraded":"2023-06-10T19:07:16.937436+0000","last_fullsized":"2023-06-10T19:07:16.937436+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_clean_scrub_stamp":"2023-06-10T19:07:14.306487+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:02:22.330353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.744178+0000","last_change":"2023-06-10T19:07:15.791496+0000","last_active":"2023-06-10T19:07:16.744178+0000","last_peered":"2023-06-10T19:07:16.744178+0000","last_clean":"2023-06-10T19:07:16.744178+0000","last_became_active":"2023-06-10T19:07:15.791188+0000","last_became_peered":"2023-06-10T19:07:15.791188+0000","last_unstale":"2023-06-10T19:07:16.744178+0000","last_undegraded":"2023-06-10T19:07:16.744178+0000","last_fullsized":"2023-06-10T19:07:16.744178+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:49:21.142799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.743180+0000","last_change":"2023-06-10T19:07:15.367562+0000","last_active":"2023-06-10T19:07:16.743180+0000","last_peered":"2023-06-10T19:07:16.743180+0000","last_clean":"2023-06-10T19:07:16.743180+0000","last_became_active":"2023-06-10T19:07:15.367136+0000","last_became_peered":"2023-06-10T19:07:15.367136+0000","last_unstale":"2023-06-10T19:07:16.743180+0000","last_undegraded":"2023-06-10T19:07:16.743180+0000","last_fullsized":"2023-06-10T19:07:16.743180+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_clean_scrub_stamp":"2023-06-10T19:07:14.306487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:43:53.877316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.748651+0000","last_change":"2023-06-10T19:07:15.766953+0000","last_active":"2023-06-10T19:07:16.748651+0000","last_peered":"2023-06-10T19:07:16.748651+0000","last_clean":"2023-06-10T19:07:16.748651+0000","last_became_active":"2023-06-10T19:07:15.766237+0000","last_became_peered":"2023-06-10T19:07:15.766237+0000","last_unstale":"2023-06-10T19:07:16.748651+0000","last_undegraded":"2023-06-10T19:07:16.748651+0000","last_fullsized":"2023-06-10T19:07:16.748651+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:44:19.053409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.135857+0000","last_change":"2023-06-10T19:07:15.379438+0000","last_active":"2023-06-10T19:07:17.135857+0000","last_peered":"2023-06-10T19:07:17.135857+0000","last_clean":"2023-06-10T19:07:17.135857+0000","last_became_active":"2023-06-10T19:07:15.379010+0000","last_became_peered":"2023-06-10T19:07:15.379010+0000","last_unstale":"2023-06-10T19:07:17.135857+0000","last_undegraded":"2023-06-10T19:07:17.135857+0000","last_fullsized":"2023-06-10T19:07:17.135857+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_clean_scrub_stamp":"2023-06-10T19:07:14.306487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:30:56.171737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.135483+0000","last_change":"2023-06-10T19:07:15.754608+0000","last_active":"2023-06-10T19:07:17.135483+0000","last_peered":"2023-06-10T19:07:17.135483+0000","last_clean":"2023-06-10T19:07:17.135483+0000","last_became_active":"2023-06-10T19:07:15.754287+0000","last_became_peered":"2023-06-10T19:07:15.754287+0000","last_unstale":"2023-06-10T19:07:17.135483+0000","last_undegraded":"2023-06-10T19:07:17.135483+0000","last_fullsized":"2023-06-10T19:07:17.135483+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:40:58.293347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"166'1","reported_seq":14,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.138446+0000","last_change":"2023-06-10T19:07:15.374162+0000","last_active":"2023-06-10T19:07:17.138446+0000","last_peered":"2023-06-10T19:07:17.138446+0000","last_clean":"2023-06-10T19:07:17.138446+0000","last_became_active":"2023-06-10T19:07:15.373514+0000","last_became_peered":"2023-06-10T19:07:15.373514+0000","last_unstale":"2023-06-10T19:07:17.138446+0000","last_undegraded":"2023-06-10T19:07:17.138446+0000","last_fullsized":"2023-06-10T19:07:17.138446+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_clean_scrub_stamp":"2023-06-10T19:07:14.306487+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:05:24.311354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.747798+0000","last_change":"2023-06-10T19:07:15.790174+0000","last_active":"2023-06-10T19:07:16.747798+0000","last_peered":"2023-06-10T19:07:16.747798+0000","last_clean":"2023-06-10T19:07:16.747798+0000","last_became_active":"2023-06-10T19:07:15.789451+0000","last_became_peered":"2023-06-10T19:07:15.789451+0000","last_unstale":"2023-06-10T19:07:16.747798+0000","last_undegraded":"2023-06-10T19:07:16.747798+0000","last_fullsized":"2023-06-10T19:07:16.747798+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:42:20.474642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.e","version":"166'2","reported_seq":15,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.137730+0000","last_change":"2023-06-10T19:07:15.372125+0000","last_active":"2023-06-10T19:07:17.137730+0000","last_peered":"2023-06-10T19:07:17.137730+0000","last_clean":"2023-06-10T19:07:17.137730+0000","last_became_active":"2023-06-10T19:07:15.371744+0000","last_became_peered":"2023-06-10T19:07:15.371744+0000","last_unstale":"2023-06-10T19:07:17.137730+0000","last_undegraded":"2023-06-10T19:07:17.137730+0000","last_fullsized":"2023-06-10T19:07:17.137730+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_clean_scrub_stamp":"2023-06-10T19:07:14.306487+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:57:34.920115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.136258+0000","last_change":"2023-06-10T19:07:15.776232+0000","last_active":"2023-06-10T19:07:17.136258+0000","last_peered":"2023-06-10T19:07:17.136258+0000","last_clean":"2023-06-10T19:07:17.136258+0000","last_became_active":"2023-06-10T19:07:15.775501+0000","last_became_peered":"2023-06-10T19:07:15.775501+0000","last_unstale":"2023-06-10T19:07:17.136258+0000","last_undegraded":"2023-06-10T19:07:17.136258+0000","last_fullsized":"2023-06-10T19:07:17.136258+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:58:23.030375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.d","version":"166'1","reported_seq":14,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.937633+0000","last_change":"2023-06-10T19:07:15.372148+0000","last_active":"2023-06-10T19:07:16.937633+0000","last_peered":"2023-06-10T19:07:16.937633+0000","last_clean":"2023-06-10T19:07:16.937633+0000","last_became_active":"2023-06-10T19:07:15.371886+0000","last_became_peered":"2023-06-10T19:07:15.371886+0000","last_unstale":"2023-06-10T19:07:16.937633+0000","last_undegraded":"2023-06-10T19:07:16.937633+0000","last_fullsized":"2023-06-10T19:07:16.937633+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_clean_scrub_stamp":"2023-06-10T19:07:14.306487+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:42:19.460156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.136950+0000","last_change":"2023-06-10T19:07:15.756879+0000","last_active":"2023-06-10T19:07:17.136950+0000","last_peered":"2023-06-10T19:07:17.136950+0000","last_clean":"2023-06-10T19:07:17.136950+0000","last_became_active":"2023-06-10T19:07:15.756118+0000","last_became_peered":"2023-06-10T19:07:15.756118+0000","last_unstale":"2023-06-10T19:07:17.136950+0000","last_undegraded":"2023-06-10T19:07:17.136950+0000","last_fullsized":"2023-06-10T19:07:17.136950+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:47:35.378759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.136443+0000","last_change":"2023-06-10T19:07:15.369851+0000","last_active":"2023-06-10T19:07:17.136443+0000","last_peered":"2023-06-10T19:07:17.136443+0000","last_clean":"2023-06-10T19:07:17.136443+0000","last_became_active":"2023-06-10T19:07:15.369258+0000","last_became_peered":"2023-06-10T19:07:15.369258+0000","last_unstale":"2023-06-10T19:07:17.136443+0000","last_undegraded":"2023-06-10T19:07:17.136443+0000","last_fullsized":"2023-06-10T19:07:17.136443+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_clean_scrub_stamp":"2023-06-10T19:07:14.306487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:49:56.075777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.137557+0000","last_change":"2023-06-10T19:07:15.785914+0000","last_active":"2023-06-10T19:07:17.137557+0000","last_peered":"2023-06-10T19:07:17.137557+0000","last_clean":"2023-06-10T19:07:17.137557+0000","last_became_active":"2023-06-10T19:07:15.785596+0000","last_became_peered":"2023-06-10T19:07:15.785596+0000","last_unstale":"2023-06-10T19:07:17.137557+0000","last_undegraded":"2023-06-10T19:07:17.137557+0000","last_fullsized":"2023-06-10T19:07:17.137557+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:28:58.671208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.b","version":"166'2","reported_seq":15,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.937476+0000","last_change":"2023-06-10T19:07:15.379638+0000","last_active":"2023-06-10T19:07:16.937476+0000","last_peered":"2023-06-10T19:07:16.937476+0000","last_clean":"2023-06-10T19:07:16.937476+0000","last_became_active":"2023-06-10T19:07:15.379265+0000","last_became_peered":"2023-06-10T19:07:15.379265+0000","last_unstale":"2023-06-10T19:07:16.937476+0000","last_undegraded":"2023-06-10T19:07:16.937476+0000","last_fullsized":"2023-06-10T19:07:16.937476+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_clean_scrub_stamp":"2023-06-10T19:07:14.306487+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:18:44.730292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.937446+0000","last_change":"2023-06-10T19:07:15.761449+0000","last_active":"2023-06-10T19:07:16.937446+0000","last_peered":"2023-06-10T19:07:16.937446+0000","last_clean":"2023-06-10T19:07:16.937446+0000","last_became_active":"2023-06-10T19:07:15.761180+0000","last_became_peered":"2023-06-10T19:07:15.761180+0000","last_unstale":"2023-06-10T19:07:16.937446+0000","last_undegraded":"2023-06-10T19:07:16.937446+0000","last_fullsized":"2023-06-10T19:07:16.937446+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:33:53.963637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.135909+0000","last_change":"2023-06-10T19:07:15.369619+0000","last_active":"2023-06-10T19:07:17.135909+0000","last_peered":"2023-06-10T19:07:17.135909+0000","last_clean":"2023-06-10T19:07:17.135909+0000","last_became_active":"2023-06-10T19:07:15.368889+0000","last_became_peered":"2023-06-10T19:07:15.368889+0000","last_unstale":"2023-06-10T19:07:17.135909+0000","last_undegraded":"2023-06-10T19:07:17.135909+0000","last_fullsized":"2023-06-10T19:07:17.135909+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_clean_scrub_stamp":"2023-06-10T19:07:14.306487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:54:41.073147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.937708+0000","last_change":"2023-06-10T19:07:15.768091+0000","last_active":"2023-06-10T19:07:16.937708+0000","last_peered":"2023-06-10T19:07:16.937708+0000","last_clean":"2023-06-10T19:07:16.937708+0000","last_became_active":"2023-06-10T19:07:15.767818+0000","last_became_peered":"2023-06-10T19:07:15.767818+0000","last_unstale":"2023-06-10T19:07:16.937708+0000","last_undegraded":"2023-06-10T19:07:16.937708+0000","last_fullsized":"2023-06-10T19:07:16.937708+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:43:05.691428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.743431+0000","last_change":"2023-06-10T19:07:15.367449+0000","last_active":"2023-06-10T19:07:16.743431+0000","last_peered":"2023-06-10T19:07:16.743431+0000","last_clean":"2023-06-10T19:07:16.743431+0000","last_became_active":"2023-06-10T19:07:15.367072+0000","last_became_peered":"2023-06-10T19:07:15.367072+0000","last_unstale":"2023-06-10T19:07:16.743431+0000","last_undegraded":"2023-06-10T19:07:16.743431+0000","last_fullsized":"2023-06-10T19:07:16.743431+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_clean_scrub_stamp":"2023-06-10T19:07:14.306487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:46:05.517752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.137023+0000","last_change":"2023-06-10T19:07:15.783482+0000","last_active":"2023-06-10T19:07:17.137023+0000","last_peered":"2023-06-10T19:07:17.137023+0000","last_clean":"2023-06-10T19:07:17.137023+0000","last_became_active":"2023-06-10T19:07:15.782814+0000","last_became_peered":"2023-06-10T19:07:15.782814+0000","last_unstale":"2023-06-10T19:07:17.137023+0000","last_undegraded":"2023-06-10T19:07:17.137023+0000","last_fullsized":"2023-06-10T19:07:17.137023+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:33:32.368197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.135432+0000","last_change":"2023-06-10T19:07:15.386012+0000","last_active":"2023-06-10T19:07:17.135432+0000","last_peered":"2023-06-10T19:07:17.135432+0000","last_clean":"2023-06-10T19:07:17.135432+0000","last_became_active":"2023-06-10T19:07:15.384922+0000","last_became_peered":"2023-06-10T19:07:15.384922+0000","last_unstale":"2023-06-10T19:07:17.135432+0000","last_undegraded":"2023-06-10T19:07:17.135432+0000","last_fullsized":"2023-06-10T19:07:17.135432+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_clean_scrub_stamp":"2023-06-10T19:07:14.306487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:10:10.195768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.134778+0000","last_change":"2023-06-10T19:07:15.794202+0000","last_active":"2023-06-10T19:07:17.134778+0000","last_peered":"2023-06-10T19:07:17.134778+0000","last_clean":"2023-06-10T19:07:17.134778+0000","last_became_active":"2023-06-10T19:07:15.793629+0000","last_became_peered":"2023-06-10T19:07:15.793629+0000","last_unstale":"2023-06-10T19:07:17.134778+0000","last_undegraded":"2023-06-10T19:07:17.134778+0000","last_fullsized":"2023-06-10T19:07:17.134778+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:57:35.934601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.7","version":"166'2","reported_seq":15,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.937715+0000","last_change":"2023-06-10T19:07:15.366019+0000","last_active":"2023-06-10T19:07:16.937715+0000","last_peered":"2023-06-10T19:07:16.937715+0000","last_clean":"2023-06-10T19:07:16.937715+0000","last_became_active":"2023-06-10T19:07:15.365546+0000","last_became_peered":"2023-06-10T19:07:15.365546+0000","last_unstale":"2023-06-10T19:07:16.937715+0000","last_undegraded":"2023-06-10T19:07:16.937715+0000","last_fullsized":"2023-06-10T19:07:16.937715+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_clean_scrub_stamp":"2023-06-10T19:07:14.306487+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:37:14.610825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.135834+0000","last_change":"2023-06-10T19:07:15.753856+0000","last_active":"2023-06-10T19:07:17.135834+0000","last_peered":"2023-06-10T19:07:17.135834+0000","last_clean":"2023-06-10T19:07:17.135834+0000","last_became_active":"2023-06-10T19:07:15.753582+0000","last_became_peered":"2023-06-10T19:07:15.753582+0000","last_unstale":"2023-06-10T19:07:17.135834+0000","last_undegraded":"2023-06-10T19:07:17.135834+0000","last_fullsized":"2023-06-10T19:07:17.135834+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:40:17.915907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.138445+0000","last_change":"2023-06-10T19:07:15.365207+0000","last_active":"2023-06-10T19:07:17.138445+0000","last_peered":"2023-06-10T19:07:17.138445+0000","last_clean":"2023-06-10T19:07:17.138445+0000","last_became_active":"2023-06-10T19:07:15.364347+0000","last_became_peered":"2023-06-10T19:07:15.364347+0000","last_unstale":"2023-06-10T19:07:17.138445+0000","last_undegraded":"2023-06-10T19:07:17.138445+0000","last_fullsized":"2023-06-10T19:07:17.138445+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_clean_scrub_stamp":"2023-06-10T19:07:14.306487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:02:22.330353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.743135+0000","last_change":"2023-06-10T19:07:15.791430+0000","last_active":"2023-06-10T19:07:16.743135+0000","last_peered":"2023-06-10T19:07:16.743135+0000","last_clean":"2023-06-10T19:07:16.743135+0000","last_became_active":"2023-06-10T19:07:15.791109+0000","last_became_peered":"2023-06-10T19:07:15.791109+0000","last_unstale":"2023-06-10T19:07:16.743135+0000","last_undegraded":"2023-06-10T19:07:16.743135+0000","last_fullsized":"2023-06-10T19:07:16.743135+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:34:36.010281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.137385+0000","last_change":"2023-06-10T19:07:15.385673+0000","last_active":"2023-06-10T19:07:17.137385+0000","last_peered":"2023-06-10T19:07:17.137385+0000","last_clean":"2023-06-10T19:07:17.137385+0000","last_became_active":"2023-06-10T19:07:15.385196+0000","last_became_peered":"2023-06-10T19:07:15.385196+0000","last_unstale":"2023-06-10T19:07:17.137385+0000","last_undegraded":"2023-06-10T19:07:17.137385+0000","last_fullsized":"2023-06-10T19:07:17.137385+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_clean_scrub_stamp":"2023-06-10T19:07:14.306487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:34:02.635429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.136207+0000","last_change":"2023-06-10T19:07:15.763041+0000","last_active":"2023-06-10T19:07:17.136207+0000","last_peered":"2023-06-10T19:07:17.136207+0000","last_clean":"2023-06-10T19:07:17.136207+0000","last_became_active":"2023-06-10T19:07:15.762864+0000","last_became_peered":"2023-06-10T19:07:15.762864+0000","last_unstale":"2023-06-10T19:07:17.136207+0000","last_undegraded":"2023-06-10T19:07:17.136207+0000","last_fullsized":"2023-06-10T19:07:17.136207+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:27:33.110117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.743763+0000","last_change":"2023-06-10T19:07:15.375772+0000","last_active":"2023-06-10T19:07:16.743763+0000","last_peered":"2023-06-10T19:07:16.743763+0000","last_clean":"2023-06-10T19:07:16.743763+0000","last_became_active":"2023-06-10T19:07:15.375376+0000","last_became_peered":"2023-06-10T19:07:15.375376+0000","last_unstale":"2023-06-10T19:07:16.743763+0000","last_undegraded":"2023-06-10T19:07:16.743763+0000","last_fullsized":"2023-06-10T19:07:16.743763+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_clean_scrub_stamp":"2023-06-10T19:07:14.306487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:10:22.395602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.748694+0000","last_change":"2023-06-10T19:07:15.774625+0000","last_active":"2023-06-10T19:07:16.748694+0000","last_peered":"2023-06-10T19:07:16.748694+0000","last_clean":"2023-06-10T19:07:16.748694+0000","last_became_active":"2023-06-10T19:07:15.772827+0000","last_became_peered":"2023-06-10T19:07:15.772827+0000","last_unstale":"2023-06-10T19:07:16.748694+0000","last_undegraded":"2023-06-10T19:07:16.748694+0000","last_fullsized":"2023-06-10T19:07:16.748694+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:12:59.309487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.748401+0000","last_change":"2023-06-10T19:07:15.371238+0000","last_active":"2023-06-10T19:07:16.748401+0000","last_peered":"2023-06-10T19:07:16.748401+0000","last_clean":"2023-06-10T19:07:16.748401+0000","last_became_active":"2023-06-10T19:07:15.370452+0000","last_became_peered":"2023-06-10T19:07:15.370452+0000","last_unstale":"2023-06-10T19:07:16.748401+0000","last_undegraded":"2023-06-10T19:07:16.748401+0000","last_fullsized":"2023-06-10T19:07:16.748401+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_clean_scrub_stamp":"2023-06-10T19:07:14.306487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:30:52.473175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.135915+0000","last_change":"2023-06-10T19:07:15.784671+0000","last_active":"2023-06-10T19:07:17.135915+0000","last_peered":"2023-06-10T19:07:17.135915+0000","last_clean":"2023-06-10T19:07:17.135915+0000","last_became_active":"2023-06-10T19:07:15.783839+0000","last_became_peered":"2023-06-10T19:07:15.783839+0000","last_unstale":"2023-06-10T19:07:17.135915+0000","last_undegraded":"2023-06-10T19:07:17.135915+0000","last_fullsized":"2023-06-10T19:07:17.135915+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:32:53.414324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.137997+0000","last_change":"2023-06-10T19:07:15.365966+0000","last_active":"2023-06-10T19:07:17.137997+0000","last_peered":"2023-06-10T19:07:17.137997+0000","last_clean":"2023-06-10T19:07:17.137997+0000","last_became_active":"2023-06-10T19:07:15.365595+0000","last_became_peered":"2023-06-10T19:07:15.365595+0000","last_unstale":"2023-06-10T19:07:17.137997+0000","last_undegraded":"2023-06-10T19:07:17.137997+0000","last_fullsized":"2023-06-10T19:07:17.137997+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_clean_scrub_stamp":"2023-06-10T19:07:14.306487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:28:39.820467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.138208+0000","last_change":"2023-06-10T19:07:15.785915+0000","last_active":"2023-06-10T19:07:17.138208+0000","last_peered":"2023-06-10T19:07:17.138208+0000","last_clean":"2023-06-10T19:07:17.138208+0000","last_became_active":"2023-06-10T19:07:15.785583+0000","last_became_peered":"2023-06-10T19:07:15.785583+0000","last_unstale":"2023-06-10T19:07:17.138208+0000","last_undegraded":"2023-06-10T19:07:17.138208+0000","last_fullsized":"2023-06-10T19:07:17.138208+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:08:07.956301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.135879+0000","last_change":"2023-06-10T19:07:15.368633+0000","last_active":"2023-06-10T19:07:17.135879+0000","last_peered":"2023-06-10T19:07:17.135879+0000","last_clean":"2023-06-10T19:07:17.135879+0000","last_became_active":"2023-06-10T19:07:15.367893+0000","last_became_peered":"2023-06-10T19:07:15.367893+0000","last_unstale":"2023-06-10T19:07:17.135879+0000","last_undegraded":"2023-06-10T19:07:17.135879+0000","last_fullsized":"2023-06-10T19:07:17.135879+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_clean_scrub_stamp":"2023-06-10T19:07:14.306487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:09:11.484570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.744089+0000","last_change":"2023-06-10T19:07:15.755190+0000","last_active":"2023-06-10T19:07:16.744089+0000","last_peered":"2023-06-10T19:07:16.744089+0000","last_clean":"2023-06-10T19:07:16.744089+0000","last_became_active":"2023-06-10T19:07:15.754901+0000","last_became_peered":"2023-06-10T19:07:15.754901+0000","last_unstale":"2023-06-10T19:07:16.744089+0000","last_undegraded":"2023-06-10T19:07:16.744089+0000","last_fullsized":"2023-06-10T19:07:16.744089+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:16:16.943299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.936705+0000","last_change":"2023-06-10T19:07:15.385634+0000","last_active":"2023-06-10T19:07:16.936705+0000","last_peered":"2023-06-10T19:07:16.936705+0000","last_clean":"2023-06-10T19:07:16.936705+0000","last_became_active":"2023-06-10T19:07:15.385309+0000","last_became_peered":"2023-06-10T19:07:15.385309+0000","last_unstale":"2023-06-10T19:07:16.936705+0000","last_undegraded":"2023-06-10T19:07:16.936705+0000","last_fullsized":"2023-06-10T19:07:16.936705+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_clean_scrub_stamp":"2023-06-10T19:07:14.306487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:28:39.820467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.135050+0000","last_change":"2023-06-10T19:07:15.796650+0000","last_active":"2023-06-10T19:07:17.135050+0000","last_peered":"2023-06-10T19:07:17.135050+0000","last_clean":"2023-06-10T19:07:17.135050+0000","last_became_active":"2023-06-10T19:07:15.795976+0000","last_became_peered":"2023-06-10T19:07:15.795976+0000","last_unstale":"2023-06-10T19:07:17.135050+0000","last_undegraded":"2023-06-10T19:07:17.135050+0000","last_fullsized":"2023-06-10T19:07:17.135050+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:40:40.272825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.138448+0000","last_change":"2023-06-10T19:07:15.365453+0000","last_active":"2023-06-10T19:07:17.138448+0000","last_peered":"2023-06-10T19:07:17.138448+0000","last_clean":"2023-06-10T19:07:17.138448+0000","last_became_active":"2023-06-10T19:07:15.364843+0000","last_became_peered":"2023-06-10T19:07:15.364843+0000","last_unstale":"2023-06-10T19:07:17.138448+0000","last_undegraded":"2023-06-10T19:07:17.138448+0000","last_fullsized":"2023-06-10T19:07:17.138448+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_clean_scrub_stamp":"2023-06-10T19:07:14.306487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:19:26.533564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":414,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.136206+0000","last_change":"2023-06-10T18:52:34.951528+0000","last_active":"2023-06-10T19:07:17.136206+0000","last_peered":"2023-06-10T19:07:17.136206+0000","last_clean":"2023-06-10T19:07:17.136206+0000","last_became_active":"2023-06-10T18:52:34.949099+0000","last_became_peered":"2023-06-10T18:52:34.949099+0000","last_unstale":"2023-06-10T19:07:17.136206+0000","last_undegraded":"2023-06-10T19:07:17.136206+0000","last_fullsized":"2023-06-10T19:07:17.136206+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_clean_scrub_stamp":"2023-06-10T18:52:33.633295+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:33:35.854532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":288,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.137199+0000","last_change":"2023-06-10T18:52:40.506384+0000","last_active":"2023-06-10T19:07:17.137199+0000","last_peered":"2023-06-10T19:07:17.137199+0000","last_clean":"2023-06-10T19:07:17.137199+0000","last_became_active":"2023-06-10T18:52:40.505701+0000","last_became_peered":"2023-06-10T18:52:40.505701+0000","last_unstale":"2023-06-10T19:07:17.137199+0000","last_undegraded":"2023-06-10T19:07:17.137199+0000","last_fullsized":"2023-06-10T19:07:17.137199+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:58:15.038772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.137376+0000","last_change":"2023-06-10T19:07:15.759988+0000","last_active":"2023-06-10T19:07:17.137376+0000","last_peered":"2023-06-10T19:07:17.137376+0000","last_clean":"2023-06-10T19:07:17.137376+0000","last_became_active":"2023-06-10T19:07:15.759768+0000","last_became_peered":"2023-06-10T19:07:15.759768+0000","last_unstale":"2023-06-10T19:07:17.137376+0000","last_undegraded":"2023-06-10T19:07:17.137376+0000","last_fullsized":"2023-06-10T19:07:17.137376+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:55:17.819720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.15","version":"166'3","reported_seq":16,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.748226+0000","last_change":"2023-06-10T19:07:15.377921+0000","last_active":"2023-06-10T19:07:16.748226+0000","last_peered":"2023-06-10T19:07:16.748226+0000","last_clean":"2023-06-10T19:07:16.748226+0000","last_became_active":"2023-06-10T19:07:15.377107+0000","last_became_peered":"2023-06-10T19:07:15.377107+0000","last_unstale":"2023-06-10T19:07:16.748226+0000","last_undegraded":"2023-06-10T19:07:16.748226+0000","last_fullsized":"2023-06-10T19:07:16.748226+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_clean_scrub_stamp":"2023-06-10T19:07:14.306487+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:09:29.407141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":258,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.135862+0000","last_change":"2023-06-10T18:52:40.512015+0000","last_active":"2023-06-10T19:07:17.135862+0000","last_peered":"2023-06-10T19:07:17.135862+0000","last_clean":"2023-06-10T19:07:17.135862+0000","last_became_active":"2023-06-10T18:52:40.511382+0000","last_became_peered":"2023-06-10T18:52:40.511382+0000","last_unstale":"2023-06-10T19:07:17.135862+0000","last_undegraded":"2023-06-10T19:07:17.135862+0000","last_fullsized":"2023-06-10T19:07:17.135862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:41:58.173239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.743490+0000","last_change":"2023-06-10T19:07:15.755336+0000","last_active":"2023-06-10T19:07:16.743490+0000","last_peered":"2023-06-10T19:07:16.743490+0000","last_clean":"2023-06-10T19:07:16.743490+0000","last_became_active":"2023-06-10T19:07:15.755036+0000","last_became_peered":"2023-06-10T19:07:15.755036+0000","last_unstale":"2023-06-10T19:07:16.743490+0000","last_undegraded":"2023-06-10T19:07:16.743490+0000","last_fullsized":"2023-06-10T19:07:16.743490+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:44:45.263461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"166'6","reported_seq":19,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.138099+0000","last_change":"2023-06-10T19:07:15.371940+0000","last_active":"2023-06-10T19:07:17.138099+0000","last_peered":"2023-06-10T19:07:17.138099+0000","last_clean":"2023-06-10T19:07:17.138099+0000","last_became_active":"2023-06-10T19:07:15.371668+0000","last_became_peered":"2023-06-10T19:07:15.371668+0000","last_unstale":"2023-06-10T19:07:17.138099+0000","last_undegraded":"2023-06-10T19:07:17.138099+0000","last_fullsized":"2023-06-10T19:07:17.138099+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_clean_scrub_stamp":"2023-06-10T19:07:14.306487+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:41:02.671562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":282,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.743378+0000","last_change":"2023-06-10T18:52:40.671725+0000","last_active":"2023-06-10T19:07:16.743378+0000","last_peered":"2023-06-10T19:07:16.743378+0000","last_clean":"2023-06-10T19:07:16.743378+0000","last_became_active":"2023-06-10T18:52:40.671442+0000","last_became_peered":"2023-06-10T18:52:40.671442+0000","last_unstale":"2023-06-10T19:07:16.743378+0000","last_undegraded":"2023-06-10T19:07:16.743378+0000","last_fullsized":"2023-06-10T19:07:16.743378+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:48:52.318889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.135091+0000","last_change":"2023-06-10T19:07:15.777944+0000","last_active":"2023-06-10T19:07:17.135091+0000","last_peered":"2023-06-10T19:07:17.135091+0000","last_clean":"2023-06-10T19:07:17.135091+0000","last_became_active":"2023-06-10T19:07:15.770694+0000","last_became_peered":"2023-06-10T19:07:15.770694+0000","last_unstale":"2023-06-10T19:07:17.135091+0000","last_undegraded":"2023-06-10T19:07:17.135091+0000","last_fullsized":"2023-06-10T19:07:17.135091+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:50:04.184265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.137820+0000","last_change":"2023-06-10T19:07:15.366762+0000","last_active":"2023-06-10T19:07:17.137820+0000","last_peered":"2023-06-10T19:07:17.137820+0000","last_clean":"2023-06-10T19:07:17.137820+0000","last_became_active":"2023-06-10T19:07:15.366449+0000","last_became_peered":"2023-06-10T19:07:15.366449+0000","last_unstale":"2023-06-10T19:07:17.137820+0000","last_undegraded":"2023-06-10T19:07:17.137820+0000","last_fullsized":"2023-06-10T19:07:17.137820+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_clean_scrub_stamp":"2023-06-10T19:07:14.306487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:02:28.748263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":288,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.136662+0000","last_change":"2023-06-10T18:52:40.510258+0000","last_active":"2023-06-10T19:07:17.136662+0000","last_peered":"2023-06-10T19:07:17.136662+0000","last_clean":"2023-06-10T19:07:17.136662+0000","last_became_active":"2023-06-10T18:52:40.509560+0000","last_became_peered":"2023-06-10T18:52:40.509560+0000","last_unstale":"2023-06-10T19:07:17.136662+0000","last_undegraded":"2023-06-10T19:07:17.136662+0000","last_fullsized":"2023-06-10T19:07:17.136662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:56:12.792524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.137034+0000","last_change":"2023-06-10T19:07:15.773725+0000","last_active":"2023-06-10T19:07:17.137034+0000","last_peered":"2023-06-10T19:07:17.137034+0000","last_clean":"2023-06-10T19:07:17.137034+0000","last_became_active":"2023-06-10T19:07:15.772957+0000","last_became_peered":"2023-06-10T19:07:15.772957+0000","last_unstale":"2023-06-10T19:07:17.137034+0000","last_undegraded":"2023-06-10T19:07:17.137034+0000","last_fullsized":"2023-06-10T19:07:17.137034+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:45:35.179785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.135443+0000","last_change":"2023-06-10T19:07:15.367620+0000","last_active":"2023-06-10T19:07:17.135443+0000","last_peered":"2023-06-10T19:07:17.135443+0000","last_clean":"2023-06-10T19:07:17.135443+0000","last_became_active":"2023-06-10T19:07:15.366857+0000","last_became_peered":"2023-06-10T19:07:15.366857+0000","last_unstale":"2023-06-10T19:07:17.135443+0000","last_undegraded":"2023-06-10T19:07:17.135443+0000","last_fullsized":"2023-06-10T19:07:17.135443+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_clean_scrub_stamp":"2023-06-10T19:07:14.306487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:04:28.206868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":258,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.136923+0000","last_change":"2023-06-10T18:52:40.672266+0000","last_active":"2023-06-10T19:07:17.136923+0000","last_peered":"2023-06-10T19:07:17.136923+0000","last_clean":"2023-06-10T19:07:17.136923+0000","last_became_active":"2023-06-10T18:52:40.671966+0000","last_became_peered":"2023-06-10T18:52:40.671966+0000","last_unstale":"2023-06-10T19:07:17.136923+0000","last_undegraded":"2023-06-10T19:07:17.136923+0000","last_fullsized":"2023-06-10T19:07:17.136923+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:24:39.709415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.744253+0000","last_change":"2023-06-10T19:07:15.774597+0000","last_active":"2023-06-10T19:07:16.744253+0000","last_peered":"2023-06-10T19:07:16.744253+0000","last_clean":"2023-06-10T19:07:16.744253+0000","last_became_active":"2023-06-10T19:07:15.774285+0000","last_became_peered":"2023-06-10T19:07:15.774285+0000","last_unstale":"2023-06-10T19:07:16.744253+0000","last_undegraded":"2023-06-10T19:07:16.744253+0000","last_fullsized":"2023-06-10T19:07:16.744253+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:46:32.849101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"166'8","reported_seq":21,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.138398+0000","last_change":"2023-06-10T19:07:15.375146+0000","last_active":"2023-06-10T19:07:17.138398+0000","last_peered":"2023-06-10T19:07:17.138398+0000","last_clean":"2023-06-10T19:07:17.138398+0000","last_became_active":"2023-06-10T19:07:15.374403+0000","last_became_peered":"2023-06-10T19:07:15.374403+0000","last_unstale":"2023-06-10T19:07:17.138398+0000","last_undegraded":"2023-06-10T19:07:17.138398+0000","last_fullsized":"2023-06-10T19:07:17.138398+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_clean_scrub_stamp":"2023-06-10T19:07:14.306487+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:12:31.437641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":258,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.136287+0000","last_change":"2023-06-10T18:52:40.671084+0000","last_active":"2023-06-10T19:07:17.136287+0000","last_peered":"2023-06-10T19:07:17.136287+0000","last_clean":"2023-06-10T19:07:17.136287+0000","last_became_active":"2023-06-10T18:52:40.670697+0000","last_became_peered":"2023-06-10T18:52:40.670697+0000","last_unstale":"2023-06-10T19:07:17.136287+0000","last_undegraded":"2023-06-10T19:07:17.136287+0000","last_fullsized":"2023-06-10T19:07:17.136287+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:28:39.564965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.747156+0000","last_change":"2023-06-10T19:07:15.792195+0000","last_active":"2023-06-10T19:07:16.747156+0000","last_peered":"2023-06-10T19:07:16.747156+0000","last_clean":"2023-06-10T19:07:16.747156+0000","last_became_active":"2023-06-10T19:07:15.791446+0000","last_became_peered":"2023-06-10T19:07:15.791446+0000","last_unstale":"2023-06-10T19:07:16.747156+0000","last_undegraded":"2023-06-10T19:07:16.747156+0000","last_fullsized":"2023-06-10T19:07:16.747156+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:33:53.963637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.13","version":"166'2","reported_seq":15,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.937337+0000","last_change":"2023-06-10T19:07:15.374418+0000","last_active":"2023-06-10T19:07:16.937337+0000","last_peered":"2023-06-10T19:07:16.937337+0000","last_clean":"2023-06-10T19:07:16.937337+0000","last_became_active":"2023-06-10T19:07:15.374027+0000","last_became_peered":"2023-06-10T19:07:15.374027+0000","last_unstale":"2023-06-10T19:07:16.937337+0000","last_undegraded":"2023-06-10T19:07:16.937337+0000","last_fullsized":"2023-06-10T19:07:16.937337+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_clean_scrub_stamp":"2023-06-10T19:07:14.306487+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:05:24.311354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":257,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.138015+0000","last_change":"2023-06-10T18:52:40.514114+0000","last_active":"2023-06-10T19:07:17.138015+0000","last_peered":"2023-06-10T19:07:17.138015+0000","last_clean":"2023-06-10T19:07:17.138015+0000","last_became_active":"2023-06-10T18:52:40.513638+0000","last_became_peered":"2023-06-10T18:52:40.513638+0000","last_unstale":"2023-06-10T19:07:17.138015+0000","last_undegraded":"2023-06-10T19:07:17.138015+0000","last_fullsized":"2023-06-10T19:07:17.138015+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:15:25.480469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.136868+0000","last_change":"2023-06-10T19:07:15.764348+0000","last_active":"2023-06-10T19:07:17.136868+0000","last_peered":"2023-06-10T19:07:17.136868+0000","last_clean":"2023-06-10T19:07:17.136868+0000","last_became_active":"2023-06-10T19:07:15.760583+0000","last_became_peered":"2023-06-10T19:07:15.760583+0000","last_unstale":"2023-06-10T19:07:17.136868+0000","last_undegraded":"2023-06-10T19:07:17.136868+0000","last_fullsized":"2023-06-10T19:07:17.136868+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:15.320973+0000","last_clean_scrub_stamp":"2023-06-10T19:07:15.320973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:52:44.890007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:17.137689+0000","last_change":"2023-06-10T19:07:15.362495+0000","last_active":"2023-06-10T19:07:17.137689+0000","last_peered":"2023-06-10T19:07:17.137689+0000","last_clean":"2023-06-10T19:07:17.137689+0000","last_became_active":"2023-06-10T19:07:15.362195+0000","last_became_peered":"2023-06-10T19:07:15.362195+0000","last_unstale":"2023-06-10T19:07:17.137689+0000","last_undegraded":"2023-06-10T19:07:17.137689+0000","last_fullsized":"2023-06-10T19:07:17.137689+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:07:14.306487+0000","last_clean_scrub_stamp":"2023-06-10T19:07:14.306487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:51:44.010768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":261,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-06-10T19:07:16.748436+0000","last_change":"2023-06-10T18:52:40.515396+0000","last_active":"2023-06-10T19:07:16.748436+0000","last_peered":"2023-06-10T19:07:16.748436+0000","last_clean":"2023-06-10T19:07:16.748436+0000","last_became_active":"2023-06-10T18:52:40.514663+0000","last_became_peered":"2023-06-10T18:52:40.514663+0000","last_unstale":"2023-06-10T19:07:16.748436+0000","last_undegraded":"2023-06-10T19:07:16.748436+0000","last_fullsized":"2023-06-10T19:07:16.748436+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:28:29.845297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":23,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575028,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33660,"kb_used_data":2612,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338180,"statfs":{"total":96636764160,"available":96602296320,"internally_reserved":0,"allocated":2674688,"data_stored":1561466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:07:04 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.93600000000000005,"15min":0.92500000000000004},"min":{"1min":0.443,"5min":0.443,"15min":0.434},"max":{"1min":1.131,"5min":1.522,"15min":1.6220000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.88,"5min":0.90900000000000003,"15min":0.92400000000000004},"min":{"1min":0.63400000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.1379999999999999,"5min":1.3109999999999999,"15min":1.6870000000000001},"last":0.83899999999999997}]},{"osd":1,"last update":"Sat Jun 10 19:07:04 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.88800000000000001,"15min":0.91700000000000004},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.377},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.92300000000000004,"15min":0.94299999999999995},"min":{"1min":0.55000000000000004,"5min":0.51300000000000001,"15min":0.504},"max":{"1min":1.302,"5min":1.3320000000000001,"15min":1.5960000000000001},"last":0.97199999999999998}]},{"osd":2,"last update":"Sat Jun 10 19:07:04 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.86699999999999999,"15min":0.85299999999999998},"min":{"1min":0.41899999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.2370000000000001,"5min":1.2629999999999999,"15min":1.4059999999999999},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.88700000000000001,"15min":0.89600000000000002},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.50600000000000001},"max":{"1min":1.2290000000000001,"5min":1.3100000000000001,"15min":1.448},"last":0.64100000000000001}]},{"osd":3,"last update":"Sat Jun 10 19:07:04 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.89600000000000002,"15min":0.92000000000000004},"min":{"1min":0.68600000000000005,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.1299999999999999,"5min":1.4490000000000001,"15min":1.502},"last":1.036},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.95099999999999996,"15min":0.95599999999999996},"min":{"1min":0.496,"5min":0.432,"15min":0.432},"max":{"1min":1.2,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.81999999999999995}]},{"osd":4,"last update":"Sat Jun 10 19:07:04 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.82799999999999996,"15min":0.84399999999999997},"min":{"1min":0.60299999999999998,"5min":0.307,"15min":0.307},"max":{"1min":1.1639999999999999,"5min":1.2290000000000001,"15min":1.639},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.96699999999999997,"15min":0.96599999999999997},"min":{"1min":0.47299999999999998,"5min":0.41199999999999998,"15min":0.40000000000000002},"max":{"1min":1.1799999999999999,"5min":1.454,"15min":1.4590000000000001},"last":0.996}]},{"osd":5,"last update":"Sat Jun 10 19:07:04 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.99399999999999999,"15min":1.002},"min":{"1min":0.66600000000000004,"5min":0.45100000000000001,"15min":0.38400000000000001},"max":{"1min":1.268,"5min":1.385,"15min":1.806},"last":0.77800000000000002},{"interface":"front","average":{"1min":1.044,"5min":1.0269999999999999,"15min":1.0349999999999999},"min":{"1min":0.78200000000000003,"5min":0.48499999999999999,"15min":0.46500000000000002},"max":{"1min":1.254,"5min":1.665,"15min":1.665},"last":1.0780000000000001}]},{"osd":6,"last update":"Sat Jun 10 19:07:04 2023","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.014,"15min":1.0089999999999999},"min":{"1min":0.71899999999999997,"5min":0.47699999999999998,"15min":0.35999999999999999},"max":{"1min":2.1120000000000001,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":0.79200000000000004},{"interface":"front","average":{"1min":1.117,"5min":1.0960000000000001,"15min":1.099},"min":{"1min":0.82499999999999996,"5min":0.504,"15min":0.441},"max":{"1min":1.397,"5min":1.728,"15min":1.728},"last":1.1180000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575029,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33092,"kb_used_data":2044,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338748,"statfs":{"total":96636764160,"available":96602877952,"internally_reserved":0,"allocated":2093056,"data_stored":977751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:06:56 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.83499999999999996,"15min":0.85999999999999999},"min":{"1min":0.50700000000000001,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.149,"5min":1.2450000000000001,"15min":1.498},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.86399999999999999,"15min":0.879},"min":{"1min":0.57199999999999995,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.131,"5min":1.3009999999999999,"15min":1.496},"last":1.1000000000000001}]},{"osd":1,"last update":"Sat Jun 10 19:06:56 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.84199999999999997,"15min":0.86199999999999999},"min":{"1min":0.53800000000000003,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.0109999999999999,"5min":1.2709999999999999,"15min":1.5229999999999999},"last":1.1200000000000001},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.89500000000000002,"15min":0.90000000000000002},"min":{"1min":0.504,"5min":0.48699999999999999,"15min":0.45300000000000001},"max":{"1min":1.1279999999999999,"5min":1.341,"15min":1.778},"last":1.016}]},{"osd":2,"last update":"Sat Jun 10 19:06:56 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.90500000000000003,"15min":0.90000000000000002},"min":{"1min":0.53000000000000003,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.3759999999999999},"last":1.151},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86399999999999999,"15min":0.88300000000000001},"min":{"1min":0.65400000000000003,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.121,"5min":1.22,"15min":1.246},"last":0.88900000000000001}]},{"osd":3,"last update":"Sat Jun 10 19:06:56 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.91500000000000004,"15min":0.91900000000000004},"min":{"1min":0.64500000000000002,"5min":0.55100000000000005,"15min":0.52700000000000002},"max":{"1min":1.232,"5min":1.238,"15min":1.7190000000000001},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.96599999999999997,"15min":0.98199999999999998},"min":{"1min":0.65500000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.304,"5min":1.371,"15min":1.4370000000000001},"last":0.98599999999999999}]},{"osd":4,"last update":"Sat Jun 10 19:06:56 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.75900000000000001,"5min":0.373,"15min":0.373},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.798},"last":1.2130000000000001},{"interface":"front","average":{"1min":1.012,"5min":1,"15min":0.98799999999999999},"min":{"1min":0.504,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.409,"5min":1.409,"15min":1.5489999999999999},"last":0.65600000000000003}]},{"osd":5,"last update":"Sat Jun 10 19:06:56 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.88,"15min":0.90900000000000003},"min":{"1min":0.65300000000000002,"5min":0.437,"15min":0.437},"max":{"1min":1.2150000000000001,"5min":1.29,"15min":1.333},"last":0.76100000000000001},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.004,"15min":1.0229999999999999},"min":{"1min":0.47199999999999998,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":2.536},"last":1.284}]},{"osd":7,"last update":"Sat Jun 10 19:06:56 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.0409999999999999,"15min":1.0309999999999999},"min":{"1min":0.73799999999999999,"5min":0.58599999999999997,"15min":0.57099999999999995},"max":{"1min":1.1970000000000001,"5min":1.879,"15min":1.917},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.98799999999999999,"15min":1.0069999999999999},"min":{"1min":0.63200000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.3320000000000001,"5min":1.4850000000000001,"15min":1.5569999999999999},"last":1.0609999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575029,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33100,"kb_used_data":2052,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338740,"statfs":{"total":96636764160,"available":96602869760,"internally_reserved":0,"allocated":2101248,"data_stored":977875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:06:50 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.86599999999999999,"15min":0.876},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.2669999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.90900000000000003,"15min":0.91200000000000003},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.49399999999999999},"max":{"1min":1.167,"5min":1.2370000000000001,"15min":2.347},"last":0.88500000000000001}]},{"osd":1,"last update":"Sat Jun 10 19:06:50 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.88,"15min":0.91400000000000003},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.52600000000000002},"max":{"1min":1.2290000000000001,"5min":1.6739999999999999,"15min":7.0800000000000001},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.91400000000000003,"15min":0.98499999999999999},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.244,"5min":1.381,"15min":15.845000000000001},"last":0.60899999999999999}]},{"osd":2,"last update":"Sat Jun 10 19:06:50 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.89700000000000002,"15min":0.89400000000000002},"min":{"1min":0.64800000000000002,"5min":0.54300000000000004,"15min":0.48299999999999998},"max":{"1min":1.204,"5min":1.6459999999999999,"15min":5.0049999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.92100000000000004,"15min":0.94599999999999995},"min":{"1min":0.65500000000000003,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.212,"5min":1.391,"15min":6.851},"last":0.95399999999999996}]},{"osd":3,"last update":"Sat Jun 10 19:06:50 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.94199999999999995,"15min":0.95299999999999996},"min":{"1min":0.58799999999999997,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1100000000000001,"5min":1.6910000000000001,"15min":2.544},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.0029999999999999,"5min":0.98699999999999999,"15min":0.996},"min":{"1min":0.67000000000000004,"5min":0.66000000000000003,"15min":0.59799999999999998},"max":{"1min":1.294,"5min":1.4870000000000001,"15min":3.0830000000000002},"last":1.1240000000000001}]},{"osd":4,"last update":"Sat Jun 10 19:06:50 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.94899999999999995,"15min":0.94999999999999996},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.58099999999999996},"max":{"1min":1.222,"5min":1.6140000000000001,"15min":6.7290000000000001},"last":1.016},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.96299999999999997,"15min":0.98799999999999999},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.319,"5min":1.446,"15min":1.575},"last":1.087}]},{"osd":6,"last update":"Sat Jun 10 19:06:50 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.97399999999999998,"15min":0.98799999999999999},"min":{"1min":0.61799999999999999,"5min":0.60499999999999998,"15min":0.54200000000000004},"max":{"1min":1.327,"5min":1.8009999999999999,"15min":1.8009999999999999},"last":1.038},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.028,"15min":1.0529999999999999},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.57899999999999996},"max":{"1min":1.3360000000000001,"5min":1.8380000000000001,"15min":6.923},"last":1.0629999999999999}]},{"osd":7,"last update":"Sat Jun 10 19:06:50 2023","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.0649999999999999,"15min":1.083},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.4259999999999999,"5min":1.7749999999999999,"15min":2.6080000000000001},"last":0.98699999999999999},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.115,"15min":1.135},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.3859999999999999,"5min":1.732,"15min":5.4169999999999998},"last":1.1819999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575028,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33108,"kb_used_data":2060,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338732,"statfs":{"total":96636764160,"available":96602861568,"internally_reserved":0,"allocated":2109440,"data_stored":978515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.83999999999999997,"15min":0.83299999999999996},"min":{"1min":0.53200000000000003,"5min":0.45400000000000001,"15min":0.45100000000000001},"max":{"1min":1.2190000000000001,"5min":1.29,"15min":1.29},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.90000000000000002,"15min":0.90600000000000003},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.375,"5min":1.3979999999999999,"15min":3.7280000000000002},"last":0.71499999999999997}]},{"osd":1,"last update":"Sat Jun 10 19:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.90000000000000002,"15min":0.92800000000000005},"min":{"1min":0.55000000000000004,"5min":0.47799999999999998,"15min":0.47599999999999998},"max":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":3.3969999999999998},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.83199999999999996,"15min":0.86199999999999999},"min":{"1min":0.55700000000000005,"5min":0.47899999999999998,"15min":0.47699999999999998},"max":{"1min":1.212,"5min":1.2430000000000001,"15min":2.496},"last":0.55200000000000005}]},{"osd":2,"last update":"Sat Jun 10 19:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.85899999999999999,"15min":0.879},"min":{"1min":0.52400000000000002,"5min":0.52200000000000002,"15min":0.49299999999999999},"max":{"1min":1.137,"5min":1.236,"15min":1.522},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.95899999999999996,"15min":0.98499999999999999},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.55000000000000004},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":3.5750000000000002},"last":0.877}]},{"osd":3,"last update":"Sat Jun 10 19:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.86399999999999999,"15min":0.89300000000000002},"min":{"1min":0.57799999999999996,"5min":0.56200000000000006,"15min":0.53900000000000003},"max":{"1min":1.1200000000000001,"5min":1.46,"15min":2.3809999999999998},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.94599999999999995,"15min":0.96299999999999997},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.54400000000000004},"max":{"1min":1.2889999999999999,"5min":1.4279999999999999,"15min":1.6479999999999999},"last":0.95799999999999996}]},{"osd":5,"last update":"Sat Jun 10 19:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.95299999999999996,"15min":0.95799999999999996},"min":{"1min":0.66800000000000004,"5min":0.58699999999999997,"15min":0.53100000000000003},"max":{"1min":1.224,"5min":1.3260000000000001,"15min":3.6539999999999999},"last":1.0269999999999999},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.92000000000000004,"15min":0.93999999999999995},"min":{"1min":0.63400000000000001,"5min":0.495,"15min":0.495},"max":{"1min":1.216,"5min":1.26,"15min":2.6720000000000002},"last":0.78000000000000003}]},{"osd":6,"last update":"Sat Jun 10 19:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.97599999999999998,"15min":0.96799999999999997},"min":{"1min":0.67000000000000004,"5min":0.443,"15min":0.443},"max":{"1min":1.2869999999999999,"5min":1.413,"15min":2.2639999999999998},"last":1.002},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.081,"15min":1.0680000000000001},"min":{"1min":0.76300000000000001,"5min":0.58799999999999997,"15min":0.44400000000000001},"max":{"1min":1.625,"5min":1.625,"15min":3.4980000000000002},"last":0.97799999999999998}]},{"osd":7,"last update":"Sat Jun 10 19:07:08 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.02,"15min":1.0009999999999999},"min":{"1min":0.82699999999999996,"5min":0.60899999999999999,"15min":0.41399999999999998},"max":{"1min":1.3240000000000001,"5min":1.3919999999999999,"15min":2.5910000000000002},"last":0.93300000000000005},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.071},"min":{"1min":0.81100000000000005,"5min":0.50800000000000001,"15min":0.46300000000000002},"max":{"1min":1.385,"5min":1.635,"15min":1.635},"last":1.2729999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575027,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37192,"kb_used_data":2048,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334648,"statfs":{"total":96636764160,"available":96598679552,"internally_reserved":0,"allocated":2097152,"data_stored":972247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:06:52 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.65500000000000003,"15min":0.628},"min":{"1min":0.44900000000000001,"5min":0.248,"15min":0.248},"max":{"1min":1.0900000000000001,"5min":1.1539999999999999,"15min":1.169},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.626,"5min":0.66900000000000004,"15min":0.66700000000000004},"min":{"1min":0.307,"5min":0.30299999999999999,"15min":0.251},"max":{"1min":0.85099999999999998,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.78800000000000003}]},{"osd":1,"last update":"Sat Jun 10 19:06:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.69099999999999995,"15min":0.68300000000000005},"min":{"1min":0.34899999999999998,"5min":0.29699999999999999,"15min":0.27500000000000002},"max":{"1min":1.034,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.71399999999999997,"15min":0.73399999999999999},"min":{"1min":0.35399999999999998,"5min":0.34399999999999997,"15min":0.318},"max":{"1min":1.1439999999999999,"5min":1.2569999999999999,"15min":1.411},"last":0.73499999999999999}]},{"osd":2,"last update":"Sat Jun 10 19:06:52 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.76700000000000002,"15min":0.77500000000000002},"min":{"1min":0.42799999999999999,"5min":0.39300000000000002,"15min":0.30299999999999999},"max":{"1min":1.1950000000000001,"5min":1.2829999999999999,"15min":1.9530000000000001},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.81899999999999995,"15min":0.79600000000000004},"min":{"1min":0.45800000000000002,"5min":0.35299999999999998,"15min":0.29699999999999999},"max":{"1min":1.2170000000000001,"5min":1.591,"15min":1.591},"last":1.028}]},{"osd":4,"last update":"Sat Jun 10 19:06:52 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.96699999999999997,"15min":0.95299999999999996},"min":{"1min":0.626,"5min":0.60899999999999999,"15min":0.41899999999999998},"max":{"1min":1.252,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":0.91400000000000003},{"interface":"front","average":{"1min":1.0169999999999999,"5min":0.999,"15min":0.99299999999999999},"min":{"1min":0.73699999999999999,"5min":0.57299999999999995,"15min":0.47999999999999998},"max":{"1min":1.3580000000000001,"5min":1.873,"15min":1.873},"last":1.1080000000000001}]},{"osd":5,"last update":"Sat Jun 10 19:06:52 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.004,"15min":1.0129999999999999},"min":{"1min":0.59599999999999997,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.53,"5min":1.752,"15min":2.024},"last":1.0620000000000001},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.046,"15min":1.036},"min":{"1min":0.65200000000000002,"5min":0.59999999999999998,"15min":0.46899999999999997},"max":{"1min":1.534,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":1.131}]},{"osd":6,"last update":"Sat Jun 10 19:06:52 2023","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.0680000000000001,"15min":1.0649999999999999},"min":{"1min":0.746,"5min":0.56999999999999995,"15min":0.55300000000000005},"max":{"1min":1.617,"5min":1.786,"15min":1.8500000000000001},"last":0.88},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.052,"15min":1.056},"min":{"1min":0.61399999999999999,"5min":0.61199999999999999,"15min":0.58799999999999997},"max":{"1min":1.417,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":1.175}]},{"osd":7,"last update":"Sat Jun 10 19:06:52 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.079,"15min":1.089},"min":{"1min":0.58599999999999997,"5min":0.57999999999999996,"15min":0.56999999999999995},"max":{"1min":1.3320000000000001,"5min":2.1150000000000002,"15min":2.1150000000000002},"last":1.085},{"interface":"front","average":{"1min":1.139,"5min":1.099,"15min":1.101},"min":{"1min":0.625,"5min":0.625,"15min":0.61099999999999999},"max":{"1min":1.538,"5min":1.9850000000000001,"15min":1.9850000000000001},"last":1.153}]}]},{"osd":2,"up_from":13,"seq":55834575028,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37188,"kb_used_data":2044,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334652,"statfs":{"total":96636764160,"available":96598683648,"internally_reserved":0,"allocated":2093056,"data_stored":977751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:07:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.63200000000000001,"15min":0.622},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.27300000000000002},"max":{"1min":0.98599999999999999,"5min":2.883,"15min":2.883},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.77600000000000002,"15min":0.74099999999999999},"min":{"1min":0.38300000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.155,"5min":6.5670000000000002,"15min":6.5670000000000002},"last":0.38900000000000001}]},{"osd":1,"last update":"Sat Jun 10 19:07:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.65500000000000003,"15min":0.66400000000000003},"min":{"1min":0.32500000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1950000000000001},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.81799999999999995,"15min":0.78400000000000003},"min":{"1min":0.32900000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.0669999999999999,"5min":8.4429999999999996,"15min":8.4429999999999996},"last":0.32500000000000001}]},{"osd":3,"last update":"Sat Jun 10 19:07:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.78000000000000003,"15min":0.77500000000000002},"min":{"1min":0.36299999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.0329999999999999,"5min":1.1899999999999999,"15min":1.2350000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.77500000000000002,"15min":0.78100000000000003},"min":{"1min":0.40500000000000003,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":1.143,"5min":4.1849999999999996,"15min":4.1849999999999996},"last":0.46500000000000002}]},{"osd":4,"last update":"Sat Jun 10 19:07:02 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.96199999999999997,"15min":0.93999999999999995},"min":{"1min":0.59699999999999998,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.1699999999999999,"5min":3.996,"15min":3.996},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.91900000000000004,"5min":1.1140000000000001,"15min":1.052},"min":{"1min":0.60599999999999998,"5min":0.496,"15min":0.496},"max":{"1min":1.391,"5min":13.254,"15min":13.254},"last":0.90200000000000002}]},{"osd":5,"last update":"Sat Jun 10 19:07:02 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":1.113,"15min":1.05},"min":{"1min":0.60299999999999998,"5min":0.55900000000000005,"15min":0.54100000000000004},"max":{"1min":1.2270000000000001,"5min":6.9189999999999996,"15min":6.9189999999999996},"last":0.80900000000000005},{"interface":"front","average":{"1min":1.008,"5min":1.246,"15min":1.095},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.609,"5min":15.526,"15min":15.526},"last":0.69999999999999996}]},{"osd":6,"last update":"Sat Jun 10 19:07:02 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":1.1399999999999999,"15min":1.0820000000000001},"min":{"1min":0.71999999999999997,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.5009999999999999,"5min":8.7089999999999996,"15min":8.7089999999999996},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.97399999999999998,"5min":1.075,"15min":1.0589999999999999},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.389,"5min":6.1299999999999999,"15min":6.1299999999999999},"last":0.72599999999999998}]},{"osd":7,"last update":"Sat Jun 10 19:07:02 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.3169999999999999,"15min":1.1699999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.57199999999999995},"max":{"1min":1.4770000000000001,"5min":12.138,"15min":12.138},"last":0.78600000000000003},{"interface":"front","average":{"1min":1.054,"5min":1.099,"15min":1.109},"min":{"1min":0.65000000000000002,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.5660000000000001,"5min":1.657,"15min":1.752},"last":0.71999999999999997}]}]},{"osd":1,"up_from":13,"seq":55834575030,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37196,"kb_used_data":2052,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334644,"statfs":{"total":96636764160,"available":96598675456,"internally_reserved":0,"allocated":2101248,"data_stored":978296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:07:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.64900000000000002,"15min":0.67700000000000005},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":1.0029999999999999,"5min":1.048,"15min":1.288},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.746,"5min":0.73099999999999998,"15min":0.75},"min":{"1min":0.32300000000000001,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.615,"5min":1.615,"15min":1.694},"last":0.627}]},{"osd":2,"last update":"Sat Jun 10 19:07:05 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.61499999999999999,"15min":0.63500000000000001},"min":{"1min":0.30099999999999999,"5min":0.29699999999999999,"15min":0.249},"max":{"1min":0.84599999999999997,"5min":1.0900000000000001,"15min":1.21},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.69299999999999995,"15min":0.72199999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.415},"last":0.33000000000000002}]},{"osd":3,"last update":"Sat Jun 10 19:07:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.73899999999999999,"15min":0.77900000000000003},"min":{"1min":0.41499999999999998,"5min":0.34000000000000002,"15min":0.25600000000000001},"max":{"1min":1.008,"5min":1.143,"15min":1.6299999999999999},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68400000000000005,"15min":0.73299999999999998},"min":{"1min":0.36099999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.083,"5min":1.2709999999999999,"15min":2.1749999999999998},"last":0.48499999999999999}]},{"osd":4,"last update":"Sat Jun 10 19:07:05 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.85099999999999998,"15min":0.86799999999999999},"min":{"1min":0.58599999999999997,"5min":0.56399999999999995,"15min":0.53000000000000003},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.4930000000000001},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.96899999999999997,"15min":1.0289999999999999},"min":{"1min":0.625,"5min":0.47299999999999998,"15min":0.47099999999999997},"max":{"1min":1.575,"5min":1.575,"15min":5.8209999999999997},"last":0.58899999999999997}]},{"osd":5,"last update":"Sat Jun 10 19:07:05 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.96199999999999997,"15min":0.995},"min":{"1min":0.54800000000000004,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.415,"5min":1.5720000000000001,"15min":1.8620000000000001},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.93100000000000005,"15min":0.97699999999999998},"min":{"1min":0.60399999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.448,"5min":1.448,"15min":3.089},"last":0.55000000000000004}]},{"osd":6,"last update":"Sat Jun 10 19:07:05 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.96499999999999997,"15min":1.0449999999999999},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.292,"5min":1.4950000000000001,"15min":7.2599999999999998},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.97399999999999998,"15min":1.036},"min":{"1min":0.65800000000000003,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.542,"5min":1.6000000000000001,"15min":9.0069999999999997},"last":0.60299999999999998}]},{"osd":7,"last update":"Sat Jun 10 19:07:05 2023","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.0189999999999999,"15min":1.075},"min":{"1min":0.67000000000000004,"5min":0.58799999999999997,"15min":0.495},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":2.105},"last":0.54300000000000004},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0389999999999999,"15min":1.0800000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.526,"5min":1.526,"15min":2.2570000000000001},"last":0.78800000000000003}]}]},{"osd":0,"up_from":13,"seq":55834575029,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37772,"kb_used_data":2628,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334068,"statfs":{"total":96636764160,"available":96598085632,"internally_reserved":0,"allocated":2691072,"data_stored":1567204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jun 10 19:07:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.622,"15min":0.63400000000000001},"min":{"1min":0.373,"5min":0.309,"15min":0.248},"max":{"1min":0.91200000000000003,"5min":1.127,"15min":1.127},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.78700000000000003,"15min":0.80100000000000005},"min":{"1min":0.46500000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.3080000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.78800000000000003}]},{"osd":2,"last update":"Sat Jun 10 19:07:02 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.72299999999999998,"15min":0.71699999999999997},"min":{"1min":0.39300000000000002,"5min":0.35199999999999998,"15min":0.29199999999999998},"max":{"1min":1.1000000000000001,"5min":1.2010000000000001,"15min":1.2829999999999999},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.627,"5min":0.64300000000000002,"15min":0.65400000000000003},"min":{"1min":0.41399999999999998,"5min":0.28699999999999998,"15min":0.245},"max":{"1min":0.88400000000000001,"5min":1.1779999999999999,"15min":1.371},"last":0.85599999999999998}]},{"osd":3,"last update":"Sat Jun 10 19:07:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.67300000000000004,"15min":0.68200000000000005},"min":{"1min":0.41299999999999998,"5min":0.35499999999999998,"15min":0.28899999999999998},"max":{"1min":1.397,"5min":1.397,"15min":1.397},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.81799999999999995,"15min":0.82099999999999995},"min":{"1min":0.44500000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.6240000000000001,"5min":1.742,"15min":1.829},"last":0.66900000000000004}]},{"osd":4,"last update":"Sat Jun 10 19:07:02 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.90800000000000003,"15min":0.92000000000000004},"min":{"1min":0.61199999999999999,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.758,"5min":1.758,"15min":3.0209999999999999},"last":1.034},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.022,"15min":1.0249999999999999},"min":{"1min":0.71499999999999997,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.7250000000000001,"5min":1.873,"15min":1.9510000000000001},"last":1.0900000000000001}]},{"osd":5,"last update":"Sat Jun 10 19:07:02 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.91100000000000003,"15min":0.93000000000000005},"min":{"1min":0.628,"5min":0.51200000000000001,"15min":0.45100000000000001},"max":{"1min":1.0649999999999999,"5min":1.3109999999999999,"15min":1.694},"last":0.97199999999999998},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.97599999999999998,"15min":1.0029999999999999},"min":{"1min":0.66300000000000003,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.9870000000000001,"5min":1.9870000000000001,"15min":4.5620000000000003},"last":0.82499999999999996}]},{"osd":6,"last update":"Sat Jun 10 19:07:02 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.05,"15min":1.0720000000000001},"min":{"1min":0.61299999999999999,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.9330000000000001,"5min":1.9330000000000001,"15min":3.5569999999999999},"last":1.008},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":1.0009999999999999},"min":{"1min":0.63600000000000001,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.883},"last":1.2609999999999999}]},{"osd":7,"last update":"Sat Jun 10 19:07:02 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":1.0089999999999999,"15min":1.028},"min":{"1min":0.54700000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.804,"5min":1.804,"15min":1.804},"last":1.175},{"interface":"front","average":{"1min":1.04,"5min":1.0529999999999999,"15min":1.0580000000000001},"min":{"1min":0.71299999999999997,"5min":0.63700000000000001,"15min":0.58699999999999997},"max":{"1min":2.1219999999999999,"5min":2.1219999999999999,"15min":2.1219999999999999},"last":0.90700000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-10T19:07:19.739 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-06-10T19:07:19.739 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-06-10T19:07:19.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.906+0000 7fd808996640 1 Processor -- start 2023-06-10T19:07:19.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.906+0000 7fd808996640 1 -- start start 2023-06-10T19:07:19.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.910+0000 7fd808996640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd80415c760 0x7fd804065200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:19.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.910+0000 7fd808996640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd804070a40 0x7fd8040cae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:19.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.910+0000 7fd808996640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8040cd0c0 con 0x7fd8040cccf0 2023-06-10T19:07:19.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.910+0000 7fd808996640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8040c33d0 con 0x7fd804070a40 2023-06-10T19:07:19.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.910+0000 7fd808996640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd804069e60 con 0x7fd80415c760 2023-06-10T19:07:19.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.910+0000 7fd802d9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd804070a40 0x7fd8040cae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:19.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.910+0000 7fd80259c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fd8040cccf0 0x7fd80415c050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:55276/0 (socket says 172.21.15.53:55276) 2023-06-10T19:07:19.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.910+0000 7fd80259c640 1 -- 172.21.15.53:0/2216871800 learned_addr learned my addr 172.21.15.53:0/2216871800 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:07:19.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.910+0000 7fd802d9d640 1 -- 172.21.15.53:0/2216871800 >> v2:172.21.15.117:3300/0 conn(0x7fd80415c760 msgr2=0x7fd804065200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:19.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.910+0000 7fd802d9d640 1 --2- 172.21.15.53:0/2216871800 >> v2:172.21.15.117:3300/0 conn(0x7fd80415c760 0x7fd804065200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:19.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.910+0000 7fd802d9d640 1 -- 172.21.15.53:0/2216871800 >> v1:172.21.15.53:6789/0 conn(0x7fd8040cccf0 legacy=0x7fd80415c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:19.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.910+0000 7fd802d9d640 1 -- 172.21.15.53:0/2216871800 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd80406a9e0 con 0x7fd804070a40 2023-06-10T19:07:19.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.910+0000 7fd80159a640 1 -- 172.21.15.53:0/2216871800 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 272727272 0 0) 0x7fd8040cd0c0 con 0x7fd8040cccf0 2023-06-10T19:07:19.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.910+0000 7fd802d9d640 1 --2- 172.21.15.53:0/2216871800 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd804070a40 0x7fd8040cae30 secure :-1 s=READY pgs=2401 cs=0 l=1 rev1=1 crypto rx=0x7fd80406b4e0 tx=0x7fd7fc01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0da4dfaf5051037 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:19.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.910+0000 7fd80159a640 1 -- 172.21.15.53:0/2216871800 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc0a59d0 con 0x7fd804070a40 2023-06-10T19:07:19.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.910+0000 7fd80159a640 1 -- 172.21.15.53:0/2216871800 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7fc0a5b30 con 0x7fd804070a40 2023-06-10T19:07:19.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.910+0000 7fd80159a640 1 -- 172.21.15.53:0/2216871800 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc0ad440 con 0x7fd804070a40 2023-06-10T19:07:19.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.910+0000 7fd808996640 1 -- 172.21.15.53:0/2216871800 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd804070a40 msgr2=0x7fd8040cae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:19.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.910+0000 7fd808996640 1 --2- 172.21.15.53:0/2216871800 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd804070a40 0x7fd8040cae30 secure :-1 s=READY pgs=2401 cs=0 l=1 rev1=1 crypto rx=0x7fd80406b4e0 tx=0x7fd7fc01c910 comp rx=0 tx=0).stop 2023-06-10T19:07:19.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.910+0000 7fd808996640 1 -- 172.21.15.53:0/2216871800 shutdown_connections 2023-06-10T19:07:19.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.910+0000 7fd808996640 1 --2- 172.21.15.53:0/2216871800 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd804070a40 0x7fd8040cae30 unknown :-1 s=CLOSED pgs=2401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:19.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.910+0000 7fd808996640 1 --2- 172.21.15.53:0/2216871800 >> v2:172.21.15.117:3300/0 conn(0x7fd80415c760 0x7fd804065200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:19.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.910+0000 7fd808996640 1 -- 172.21.15.53:0/2216871800 >> 172.21.15.53:0/2216871800 conn(0x7fd8040ce4f0 msgr2=0x7fd8040ce8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:19.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.910+0000 7fd808996640 1 -- 172.21.15.53:0/2216871800 shutdown_connections 2023-06-10T19:07:19.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.910+0000 7fd808996640 1 -- 172.21.15.53:0/2216871800 wait complete. 2023-06-10T19:07:19.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.914+0000 7fd808996640 1 Processor -- start 2023-06-10T19:07:19.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.914+0000 7fd808996640 1 -- start start 2023-06-10T19:07:19.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.914+0000 7fd808996640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd804070a40 0x7fd804149e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:19.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.914+0000 7fd808996640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8040cccf0 0x7fd8041619d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:19.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.914+0000 7fd808996640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd80415c760 0x7fd8041491b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:19.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.914+0000 7fd808996640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8041615b0 con 0x7fd804070a40 2023-06-10T19:07:19.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.914+0000 7fd808996640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd804160050 con 0x7fd8040cccf0 2023-06-10T19:07:19.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.914+0000 7fd808996640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8041496f0 con 0x7fd80415c760 2023-06-10T19:07:19.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.914+0000 7fd80259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd804070a40 0x7fd804149e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:19.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.914+0000 7fd80259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd804070a40 0x7fd804149e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33888/0 (socket says 172.21.15.53:33888) 2023-06-10T19:07:19.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.914+0000 7fd80259c640 1 -- 172.21.15.53:0/2465375751 learned_addr learned my addr 172.21.15.53:0/2465375751 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:19.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.914+0000 7fd801d9b640 1 --2- 172.21.15.53:0/2465375751 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8040cccf0 0x7fd8041619d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:19.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.914+0000 7fd802d9d640 1 --2- 172.21.15.53:0/2465375751 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd80415c760 0x7fd8041491b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:19.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.914+0000 7fd80259c640 1 -- 172.21.15.53:0/2465375751 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd80415c760 msgr2=0x7fd8041491b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:19.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.914+0000 7fd80259c640 1 --2- 172.21.15.53:0/2465375751 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd80415c760 0x7fd8041491b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:19.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.914+0000 7fd80259c640 1 -- 172.21.15.53:0/2465375751 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8040cccf0 msgr2=0x7fd8041619d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:19.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.914+0000 7fd80259c640 1 --2- 172.21.15.53:0/2465375751 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8040cccf0 0x7fd8041619d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:19.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.914+0000 7fd80259c640 1 -- 172.21.15.53:0/2465375751 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7fc009a70 con 0x7fd804070a40 2023-06-10T19:07:19.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.914+0000 7fd80259c640 1 --2- 172.21.15.53:0/2465375751 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd804070a40 0x7fd804149e10 secure :-1 s=READY pgs=2402 cs=0 l=1 rev1=1 crypto rx=0x7fd7f400c520 tx=0x7fd7f400c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:19.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.914+0000 7fd7f2ffd640 1 -- 172.21.15.53:0/2465375751 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f40074e0 con 0x7fd804070a40 2023-06-10T19:07:19.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.914+0000 7fd7f2ffd640 1 -- 172.21.15.53:0/2465375751 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7f4007640 con 0x7fd804070a40 2023-06-10T19:07:19.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.914+0000 7fd7f2ffd640 1 -- 172.21.15.53:0/2465375751 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f40049f0 con 0x7fd804070a40 2023-06-10T19:07:19.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.914+0000 7fd808996640 1 -- 172.21.15.53:0/2465375751 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd804160930 con 0x7fd804070a40 2023-06-10T19:07:19.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.914+0000 7fd808996640 1 -- 172.21.15.53:0/2465375751 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd804160ef0 con 0x7fd804070a40 2023-06-10T19:07:19.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.914+0000 7fd808996640 1 -- 172.21.15.53:0/2465375751 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd80404d790 con 0x7fd804070a40 2023-06-10T19:07:19.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.918+0000 7fd7f2ffd640 1 -- 172.21.15.53:0/2465375751 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd7f4004b50 con 0x7fd804070a40 2023-06-10T19:07:19.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.918+0000 7fd7f2ffd640 1 --2- 172.21.15.53:0/2465375751 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd7e4066280 0x7fd7e4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:19.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.918+0000 7fd7f2ffd640 1 -- 172.21.15.53:0/2465375751 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd7f4082e70 con 0x7fd804070a40 2023-06-10T19:07:19.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.918+0000 7fd801d9b640 1 --2- 172.21.15.53:0/2465375751 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd7e4066280 0x7fd7e4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:19.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.918+0000 7fd801d9b640 1 --2- 172.21.15.53:0/2465375751 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd7e4066280 0x7fd7e4068730 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fd7f8006fd0 tx=0x7fd7f8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:19.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:19.922+0000 7fd7f2ffd640 1 -- 172.21.15.53:0/2465375751 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd7f4050430 con 0x7fd804070a40 2023-06-10T19:07:20.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.130+0000 7fd808996640 1 -- 172.21.15.53:0/2465375751 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fd80415c420 con 0x7fd804070a40 2023-06-10T19:07:20.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.138+0000 7fd7f2ffd640 1 -- 172.21.15.53:0/2465375751 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v22) v1 ==== 190+0+0 (secure 0 0 0) 0x7fd7f4018020 con 0x7fd804070a40 2023-06-10T19:07:20.139 INFO:teuthology.orchestra.run.smithi053.stderr:updated caps for client.0 2023-06-10T19:07:20.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.138+0000 7fd808996640 1 -- 172.21.15.53:0/2465375751 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd7e4066280 msgr2=0x7fd7e4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:20.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.138+0000 7fd808996640 1 --2- 172.21.15.53:0/2465375751 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd7e4066280 0x7fd7e4068730 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fd7f8006fd0 tx=0x7fd7f8008040 comp rx=0 tx=0).stop 2023-06-10T19:07:20.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.138+0000 7fd808996640 1 -- 172.21.15.53:0/2465375751 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd804070a40 msgr2=0x7fd804149e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:20.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.138+0000 7fd808996640 1 --2- 172.21.15.53:0/2465375751 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd804070a40 0x7fd804149e10 secure :-1 s=READY pgs=2402 cs=0 l=1 rev1=1 crypto rx=0x7fd7f400c520 tx=0x7fd7f400c9e0 comp rx=0 tx=0).stop 2023-06-10T19:07:20.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.138+0000 7fd808996640 1 -- 172.21.15.53:0/2465375751 shutdown_connections 2023-06-10T19:07:20.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.138+0000 7fd808996640 1 --2- 172.21.15.53:0/2465375751 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd7e4066280 0x7fd7e4068730 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:20.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.138+0000 7fd808996640 1 --2- 172.21.15.53:0/2465375751 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd80415c760 0x7fd8041491b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:20.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.138+0000 7fd808996640 1 --2- 172.21.15.53:0/2465375751 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8040cccf0 0x7fd8041619d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:20.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.138+0000 7fd808996640 1 --2- 172.21.15.53:0/2465375751 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd804070a40 0x7fd804149e10 unknown :-1 s=CLOSED pgs=2402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:20.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.138+0000 7fd808996640 1 -- 172.21.15.53:0/2465375751 >> 172.21.15.53:0/2465375751 conn(0x7fd8040ce4f0 msgr2=0x7fd8040cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:20.143 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.138+0000 7fd808996640 1 -- 172.21.15.53:0/2465375751 shutdown_connections 2023-06-10T19:07:20.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.142+0000 7fd808996640 1 -- 172.21.15.53:0/2465375751 wait complete. 2023-06-10T19:07:20.159 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:07:20.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.274+0000 7f1a8946c640 1 Processor -- start 2023-06-10T19:07:20.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.274+0000 7f1a8946c640 1 -- start start 2023-06-10T19:07:20.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.274+0000 7f1a8946c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1a8406b780 0x7f1a8415c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:20.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.274+0000 7f1a8946c640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a840af530 con 0x7f1a8406bb50 2023-06-10T19:07:20.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.274+0000 7f1a8946c640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a8415fd70 con 0x7f1a840ceb20 2023-06-10T19:07:20.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.274+0000 7f1a8946c640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a8415c3d0 con 0x7f1a8406b780 2023-06-10T19:07:20.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.274+0000 7f1a827fc640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f1a8406bb50 0x7f1a8415f320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:55280/0 (socket says 172.21.15.53:55280) 2023-06-10T19:07:20.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.274+0000 7f1a827fc640 1 -- 172.21.15.53:0/1750942203 learned_addr learned my addr 172.21.15.53:0/1750942203 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:07:20.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.274+0000 7f1a82ffd640 1 --2- 172.21.15.53:0/1750942203 >> v2:172.21.15.117:3300/0 conn(0x7f1a8406b780 0x7f1a8415c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:20.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.274+0000 7f1a81ffb640 1 -- 172.21.15.53:0/1750942203 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1813331148 0 0) 0x7f1a840af530 con 0x7f1a8406bb50 2023-06-10T19:07:20.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.274+0000 7f1a81ffb640 1 -- 172.21.15.53:0/1750942203 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a6c003530 con 0x7f1a8406bb50 2023-06-10T19:07:20.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.274+0000 7f1a81ffb640 1 -- 172.21.15.53:0/1750942203 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 735587371 0 0) 0x7f1a6c003530 con 0x7f1a8406bb50 2023-06-10T19:07:20.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.274+0000 7f1a81ffb640 1 -- 172.21.15.53:0/1750942203 >> v2:172.21.15.117:3300/0 conn(0x7f1a8406b780 msgr2=0x7f1a8415c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:20.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.274+0000 7f1a81ffb640 1 --2- 172.21.15.53:0/1750942203 >> v2:172.21.15.117:3300/0 conn(0x7f1a8406b780 0x7f1a8415c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:20.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.274+0000 7f1a81ffb640 1 -- 172.21.15.53:0/1750942203 >> v1:172.21.15.117:6789/0 conn(0x7f1a840ceb20 legacy=0x7f1a840cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:20.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.274+0000 7f1a81ffb640 1 -- 172.21.15.53:0/1750942203 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a84160050 con 0x7f1a8406bb50 2023-06-10T19:07:20.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.274+0000 7f1a81ffb640 1 -- 172.21.15.53:0/1750942203 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f1a74001a00 con 0x7f1a8406bb50 2023-06-10T19:07:20.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.274+0000 7f1a81ffb640 1 -- 172.21.15.53:0/1750942203 >> v1:172.21.15.53:6789/0 conn(0x7f1a8406bb50 legacy=0x7f1a8415f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:20.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.274+0000 7f1a81ffb640 1 --2- 172.21.15.53:0/1750942203 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a6c0039f0 0x7f1a6c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:20.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.274+0000 7f1a81ffb640 1 --2- 172.21.15.53:0/1750942203 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a6c0047d0 0x7f1a6c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:20.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.274+0000 7f1a81ffb640 1 --2- 172.21.15.53:0/1750942203 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a6c0051d0 0x7f1a6c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:20.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.274+0000 7f1a81ffb640 1 -- 172.21.15.53:0/1750942203 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8415c3d0 con 0x7f1a6c0047d0 2023-06-10T19:07:20.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.274+0000 7f1a81ffb640 1 -- 172.21.15.53:0/1750942203 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a6c00c110 con 0x7f1a6c0039f0 2023-06-10T19:07:20.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.274+0000 7f1a81ffb640 1 -- 172.21.15.53:0/1750942203 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a6c00c2d0 con 0x7f1a6c0051d0 2023-06-10T19:07:20.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.274+0000 7f1a827fc640 1 --2- 172.21.15.53:0/1750942203 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a6c0047d0 0x7f1a6c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:20.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.274+0000 7f1a82ffd640 1 --2- 172.21.15.53:0/1750942203 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a6c0039f0 0x7f1a6c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:20.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.274+0000 7f1a837fe640 1 --2- 172.21.15.53:0/1750942203 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a6c0051d0 0x7f1a6c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:20.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.274+0000 7f1a827fc640 1 -- 172.21.15.53:0/1750942203 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a6c0051d0 msgr2=0x7f1a6c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:20.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.274+0000 7f1a827fc640 1 --2- 172.21.15.53:0/1750942203 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a6c0051d0 0x7f1a6c00b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:20.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.274+0000 7f1a827fc640 1 -- 172.21.15.53:0/1750942203 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a6c0039f0 msgr2=0x7f1a6c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:20.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.274+0000 7f1a827fc640 1 --2- 172.21.15.53:0/1750942203 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a6c0039f0 0x7f1a6c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:20.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.274+0000 7f1a827fc640 1 -- 172.21.15.53:0/1750942203 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a6c003530 con 0x7f1a6c0047d0 2023-06-10T19:07:20.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.274+0000 7f1a837fe640 1 -- 172.21.15.53:0/1750942203 reap_dead start 2023-06-10T19:07:20.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.278+0000 7f1a827fc640 1 --2- 172.21.15.53:0/1750942203 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a6c0047d0 0x7f1a6c004c40 secure :-1 s=READY pgs=2404 cs=0 l=1 rev1=1 crypto rx=0x7f1a7400a800 tx=0x7f1a7401d2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1f777e493e65fe2 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:20.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.278+0000 7f1a81ffb640 1 -- 172.21.15.53:0/1750942203 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a740a5ea0 con 0x7f1a6c0047d0 2023-06-10T19:07:20.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.278+0000 7f1a81ffb640 1 -- 172.21.15.53:0/1750942203 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a740a8070 con 0x7f1a6c0047d0 2023-06-10T19:07:20.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.278+0000 7f1a81ffb640 1 -- 172.21.15.53:0/1750942203 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a74007590 con 0x7f1a6c0047d0 2023-06-10T19:07:20.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.278+0000 7f1a8946c640 1 -- 172.21.15.53:0/1750942203 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a6c0047d0 msgr2=0x7f1a6c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:20.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.278+0000 7f1a8946c640 1 --2- 172.21.15.53:0/1750942203 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a6c0047d0 0x7f1a6c004c40 secure :-1 s=READY pgs=2404 cs=0 l=1 rev1=1 crypto rx=0x7f1a7400a800 tx=0x7f1a7401d2e0 comp rx=0 tx=0).stop 2023-06-10T19:07:20.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.278+0000 7f1a8946c640 1 -- 172.21.15.53:0/1750942203 shutdown_connections 2023-06-10T19:07:20.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.278+0000 7f1a8946c640 1 --2- 172.21.15.53:0/1750942203 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a6c0047d0 0x7f1a6c004c40 unknown :-1 s=CLOSED pgs=2404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:20.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.278+0000 7f1a8946c640 1 -- 172.21.15.53:0/1750942203 >> 172.21.15.53:0/1750942203 conn(0x7f1a8406a090 msgr2=0x7f1a8406d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:20.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.278+0000 7f1a8946c640 1 -- 172.21.15.53:0/1750942203 shutdown_connections 2023-06-10T19:07:20.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.278+0000 7f1a8946c640 1 -- 172.21.15.53:0/1750942203 wait complete. 2023-06-10T19:07:20.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.278+0000 7f1a8946c640 1 Processor -- start 2023-06-10T19:07:20.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.278+0000 7f1a8946c640 1 -- start start 2023-06-10T19:07:20.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.278+0000 7f1a8946c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a6c0047d0 0x7f1a84157e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:20.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.278+0000 7f1a8946c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a840ae2c0 0x7f1a840ac9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:20.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.278+0000 7f1a8946c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a840c7c90 0x7f1a840c8110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:20.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.278+0000 7f1a8946c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a841583a0 con 0x7f1a840c7c90 2023-06-10T19:07:20.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.278+0000 7f1a8946c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a840ad2e0 con 0x7f1a840ae2c0 2023-06-10T19:07:20.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.278+0000 7f1a8946c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a840ad5c0 con 0x7f1a6c0047d0 2023-06-10T19:07:20.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.282+0000 7f1a837fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a840c7c90 0x7f1a840c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:20.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.282+0000 7f1a837fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a840c7c90 0x7f1a840c8110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33916/0 (socket says 172.21.15.53:33916) 2023-06-10T19:07:20.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.282+0000 7f1a837fe640 1 -- 172.21.15.53:0/1355742795 learned_addr learned my addr 172.21.15.53:0/1355742795 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:20.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.282+0000 7f1a82ffd640 1 --2- 172.21.15.53:0/1355742795 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a6c0047d0 0x7f1a84157e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:20.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.282+0000 7f1a827fc640 1 --2- 172.21.15.53:0/1355742795 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a840ae2c0 0x7f1a840ac9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:20.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.282+0000 7f1a837fe640 1 -- 172.21.15.53:0/1355742795 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a6c0047d0 msgr2=0x7f1a84157e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:20.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.282+0000 7f1a837fe640 1 --2- 172.21.15.53:0/1355742795 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a6c0047d0 0x7f1a84157e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:20.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.282+0000 7f1a837fe640 1 -- 172.21.15.53:0/1355742795 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a840ae2c0 msgr2=0x7f1a840ac9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:20.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.282+0000 7f1a837fe640 1 --2- 172.21.15.53:0/1355742795 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a840ae2c0 0x7f1a840ac9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:20.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.282+0000 7f1a837fe640 1 -- 172.21.15.53:0/1355742795 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a840ad8a0 con 0x7f1a840c7c90 2023-06-10T19:07:20.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.282+0000 7f1a827fc640 1 --2- 172.21.15.53:0/1355742795 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a840ae2c0 0x7f1a840ac9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:07:20.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.282+0000 7f1a837fe640 1 --2- 172.21.15.53:0/1355742795 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a840c7c90 0x7f1a840c8110 secure :-1 s=READY pgs=2405 cs=0 l=1 rev1=1 crypto rx=0x7f1a840b2950 tx=0x7f1a7800d4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:20.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.282+0000 7f1a6b7fe640 1 -- 172.21.15.53:0/1355742795 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7800b070 con 0x7f1a840c7c90 2023-06-10T19:07:20.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.282+0000 7f1a6b7fe640 1 -- 172.21.15.53:0/1355742795 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a780054e0 con 0x7f1a840c7c90 2023-06-10T19:07:20.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.282+0000 7f1a8946c640 1 -- 172.21.15.53:0/1355742795 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a840c7490 con 0x7f1a840c7c90 2023-06-10T19:07:20.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.282+0000 7f1a6b7fe640 1 -- 172.21.15.53:0/1355742795 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7800d9f0 con 0x7f1a840c7c90 2023-06-10T19:07:20.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.282+0000 7f1a8946c640 1 -- 172.21.15.53:0/1355742795 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a840acf20 con 0x7f1a840c7c90 2023-06-10T19:07:20.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.282+0000 7f1a8946c640 1 -- 172.21.15.53:0/1355742795 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a8404d790 con 0x7f1a840c7c90 2023-06-10T19:07:20.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.282+0000 7f1a6b7fe640 1 -- 172.21.15.53:0/1355742795 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1a7800db50 con 0x7f1a840c7c90 2023-06-10T19:07:20.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.282+0000 7f1a6b7fe640 1 --2- 172.21.15.53:0/1355742795 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1a700662b0 0x7f1a70068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:20.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.282+0000 7f1a6b7fe640 1 -- 172.21.15.53:0/1355742795 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1a78082bc0 con 0x7f1a840c7c90 2023-06-10T19:07:20.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.282+0000 7f1a82ffd640 1 --2- 172.21.15.53:0/1355742795 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1a700662b0 0x7f1a70068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:20.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.282+0000 7f1a82ffd640 1 --2- 172.21.15.53:0/1355742795 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1a700662b0 0x7f1a70068760 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c009ab0 tx=0x7f1a7c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:20.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.286+0000 7f1a6b7fe640 1 -- 172.21.15.53:0/1355742795 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1a78053ad0 con 0x7f1a840c7c90 2023-06-10T19:07:20.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.466+0000 7f1a8946c640 1 -- 172.21.15.53:0/1355742795 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1a840c7940 con 0x7f1a840c7c90 2023-06-10T19:07:20.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.466+0000 7f1a6b7fe640 1 -- 172.21.15.53:0/1355742795 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 96 v96) v1 ==== 94+0+4685 (secure 0 0 0) 0x7f1a78018090 con 0x7f1a840c7c90 2023-06-10T19:07:20.470 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:07:20.470 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":96,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8614,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3518533956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3518533956},{"type":"v1","addr":"172.21.15.117:6835","nonce":3518533956}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92},{"gid":8617,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/2615123885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2615123885},{"type":"v1","addr":"172.21.15.117:6837","nonce":2615123885}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92},{"gid":10551,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/3498697556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3498697556},{"type":"v1","addr":"172.21.15.53:6833","nonce":3498697556}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92}],"filesystems":[{"mdsmap":{"epoch":96,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:07:15.723316+0000","modified":"2023-06-10T19:07:18.354630+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10557},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10557":{"gid":10557,"name":"c","rank":0,"incarnation":93,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/3721509006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":3721509006},{"type":"v1","addr":"172.21.15.53:6835","nonce":3721509006}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-06-10T19:07:20.470 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 96 2023-06-10T19:07:20.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.470+0000 7f1a8946c640 1 -- 172.21.15.53:0/1355742795 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1a700662b0 msgr2=0x7f1a70068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:20.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.470+0000 7f1a8946c640 1 --2- 172.21.15.53:0/1355742795 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1a700662b0 0x7f1a70068760 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c009ab0 tx=0x7f1a7c008040 comp rx=0 tx=0).stop 2023-06-10T19:07:20.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.470+0000 7f1a8946c640 1 -- 172.21.15.53:0/1355742795 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a840c7c90 msgr2=0x7f1a840c8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:20.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.470+0000 7f1a8946c640 1 --2- 172.21.15.53:0/1355742795 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a840c7c90 0x7f1a840c8110 secure :-1 s=READY pgs=2405 cs=0 l=1 rev1=1 crypto rx=0x7f1a840b2950 tx=0x7f1a7800d4c0 comp rx=0 tx=0).stop 2023-06-10T19:07:20.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.470+0000 7f1a8946c640 1 -- 172.21.15.53:0/1355742795 shutdown_connections 2023-06-10T19:07:20.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.470+0000 7f1a8946c640 1 --2- 172.21.15.53:0/1355742795 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1a700662b0 0x7f1a70068760 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:20.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.470+0000 7f1a8946c640 1 --2- 172.21.15.53:0/1355742795 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a840c7c90 0x7f1a840c8110 unknown :-1 s=CLOSED pgs=2405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:20.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.470+0000 7f1a8946c640 1 --2- 172.21.15.53:0/1355742795 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a840ae2c0 0x7f1a840ac9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:20.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.470+0000 7f1a8946c640 1 --2- 172.21.15.53:0/1355742795 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a6c0047d0 0x7f1a84157e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:20.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.470+0000 7f1a8946c640 1 -- 172.21.15.53:0/1355742795 >> 172.21.15.53:0/1355742795 conn(0x7f1a8406a090 msgr2=0x7f1a840aeaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:20.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.470+0000 7f1a8946c640 1 -- 172.21.15.53:0/1355742795 shutdown_connections 2023-06-10T19:07:20.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:20.470+0000 7f1a8946c640 1 -- 172.21.15.53:0/1355742795 wait complete. 2023-06-10T19:07:20.892 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 96, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-06-10T19:07:15.723316+0000', 'modified': '2023-06-10T19:07:18.354630+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10557}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10557': {'gid': 10557, 'name': 'c', 'rank': 0, 'incarnation': 93, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.53:6835/3721509006', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.53:6834', 'nonce': 3721509006}, {'type': 'v1', 'addr': '172.21.15.53:6835', 'nonce': 3721509006}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [24], 'metadata_pool': 23, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-06-10T19:07:20.893 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-06-10T19:07:20.894 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-06-10T19:07:21.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.026+0000 7f803c9d5640 1 Processor -- start 2023-06-10T19:07:21.027 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.026+0000 7f803c9d5640 1 -- start start 2023-06-10T19:07:21.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.026+0000 7f803c9d5640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8038070100 0x7f80380af7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:21.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.026+0000 7f803c9d5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f80380afd10 0x7f80380c83f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:21.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.026+0000 7f803c9d5640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8038071190 con 0x7f80381571a0 2023-06-10T19:07:21.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.026+0000 7f803c9d5640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80380b01b0 con 0x7f8038070100 2023-06-10T19:07:21.028 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.026+0000 7f803c9d5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8038070580 con 0x7f80380afd10 2023-06-10T19:07:21.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.026+0000 7f803659c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f80381571a0 0x7f80380c9f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:55284/0 (socket says 172.21.15.53:55284) 2023-06-10T19:07:21.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.026+0000 7f803659c640 1 -- 172.21.15.53:0/1175610331 learned_addr learned my addr 172.21.15.53:0/1175610331 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:07:21.030 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.026+0000 7f802ffff640 1 --2- 172.21.15.53:0/1175610331 >> v2:172.21.15.117:3300/0 conn(0x7f8038070100 0x7f80380af7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:21.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.026+0000 7f8036d9d640 1 --2- 172.21.15.53:0/1175610331 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f80380afd10 0x7f80380c83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:21.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.026+0000 7f8035d9b640 1 -- 172.21.15.53:0/1175610331 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3221488731 0 0) 0x7f8038071190 con 0x7f80381571a0 2023-06-10T19:07:21.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.026+0000 7f8035d9b640 1 -- 172.21.15.53:0/1175610331 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8024003530 con 0x7f80381571a0 2023-06-10T19:07:21.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.026+0000 7f8035d9b640 1 -- 172.21.15.53:0/1175610331 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4121120942 0 0) 0x7f8024003530 con 0x7f80381571a0 2023-06-10T19:07:21.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.026+0000 7f8035d9b640 1 -- 172.21.15.53:0/1175610331 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f80380afd10 msgr2=0x7f80380c83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:21.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.026+0000 7f8035d9b640 1 --2- 172.21.15.53:0/1175610331 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f80380afd10 0x7f80380c83f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:21.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.026+0000 7f8035d9b640 1 -- 172.21.15.53:0/1175610331 >> v2:172.21.15.117:3300/0 conn(0x7f8038070100 msgr2=0x7f80380af7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:21.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.026+0000 7f8035d9b640 1 --2- 172.21.15.53:0/1175610331 >> v2:172.21.15.117:3300/0 conn(0x7f8038070100 0x7f80380af7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:21.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.026+0000 7f8035d9b640 1 -- 172.21.15.53:0/1175610331 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8038070860 con 0x7f80381571a0 2023-06-10T19:07:21.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.026+0000 7f8035d9b640 1 -- 172.21.15.53:0/1175610331 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f8028001800 con 0x7f80381571a0 2023-06-10T19:07:21.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.026+0000 7f8035d9b640 1 -- 172.21.15.53:0/1175610331 >> v1:172.21.15.53:6789/0 conn(0x7f80381571a0 legacy=0x7f80380c9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:21.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.026+0000 7f8035d9b640 1 --2- 172.21.15.53:0/1175610331 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8024003980 0x7f8024003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:21.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.026+0000 7f8035d9b640 1 --2- 172.21.15.53:0/1175610331 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f80380afd10 0x7f80240047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:21.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.026+0000 7f8035d9b640 1 --2- 172.21.15.53:0/1175610331 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8024004d10 0x7f8024005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:21.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.026+0000 7f8035d9b640 1 -- 172.21.15.53:0/1175610331 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8038070580 con 0x7f8024004d10 2023-06-10T19:07:21.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.026+0000 7f8035d9b640 1 -- 172.21.15.53:0/1175610331 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f802400b990 con 0x7f8024003980 2023-06-10T19:07:21.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.026+0000 7f8035d9b640 1 -- 172.21.15.53:0/1175610331 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f802400bad0 con 0x7f80380afd10 2023-06-10T19:07:21.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.026+0000 7f8036d9d640 1 --2- 172.21.15.53:0/1175610331 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8024004d10 0x7f8024005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:21.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.026+0000 7f803659c640 1 --2- 172.21.15.53:0/1175610331 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8024003980 0x7f8024003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:21.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.026+0000 7f802ffff640 1 --2- 172.21.15.53:0/1175610331 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f80380afd10 0x7f80240047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:21.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.026+0000 7f8036d9d640 1 -- 172.21.15.53:0/1175610331 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f80380afd10 msgr2=0x7f80240047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:21.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.026+0000 7f8036d9d640 1 --2- 172.21.15.53:0/1175610331 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f80380afd10 0x7f80240047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:21.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.026+0000 7f8036d9d640 1 -- 172.21.15.53:0/1175610331 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8024003980 msgr2=0x7f8024003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:21.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.026+0000 7f8036d9d640 1 --2- 172.21.15.53:0/1175610331 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8024003980 0x7f8024003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:21.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.026+0000 7f8036d9d640 1 -- 172.21.15.53:0/1175610331 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8024003530 con 0x7f8024004d10 2023-06-10T19:07:21.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.030+0000 7f8036d9d640 1 --2- 172.21.15.53:0/1175610331 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8024004d10 0x7f8024005180 secure :-1 s=READY pgs=2407 cs=0 l=1 rev1=1 crypto rx=0x7f8030009fc0 tx=0x7f803001cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c47ea8479ce03a6 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:21.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.030+0000 7f8035d9b640 1 -- 172.21.15.53:0/1175610331 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80300a5c70 con 0x7f8024004d10 2023-06-10T19:07:21.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.030+0000 7f8035d9b640 1 -- 172.21.15.53:0/1175610331 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f803000f040 con 0x7f8024004d10 2023-06-10T19:07:21.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.030+0000 7f8035d9b640 1 -- 172.21.15.53:0/1175610331 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80300ad440 con 0x7f8024004d10 2023-06-10T19:07:21.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.030+0000 7f803c9d5640 1 -- 172.21.15.53:0/1175610331 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8024004d10 msgr2=0x7f8024005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:21.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.030+0000 7f803c9d5640 1 --2- 172.21.15.53:0/1175610331 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8024004d10 0x7f8024005180 secure :-1 s=READY pgs=2407 cs=0 l=1 rev1=1 crypto rx=0x7f8030009fc0 tx=0x7f803001cc00 comp rx=0 tx=0).stop 2023-06-10T19:07:21.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.030+0000 7f8036d9d640 1 -- 172.21.15.53:0/1175610331 reap_dead start 2023-06-10T19:07:21.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.030+0000 7f803c9d5640 1 -- 172.21.15.53:0/1175610331 shutdown_connections 2023-06-10T19:07:21.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.030+0000 7f803c9d5640 1 -- 172.21.15.53:0/1175610331 >> 172.21.15.53:0/1175610331 conn(0x7f80380ce9e0 msgr2=0x7f80380ca7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:21.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.030+0000 7f803c9d5640 1 -- 172.21.15.53:0/1175610331 shutdown_connections 2023-06-10T19:07:21.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.030+0000 7f803c9d5640 1 -- 172.21.15.53:0/1175610331 wait complete. 2023-06-10T19:07:21.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.030+0000 7f803c9d5640 1 Processor -- start 2023-06-10T19:07:21.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.030+0000 7f803c9d5640 1 -- start start 2023-06-10T19:07:21.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.034+0000 7f803c9d5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8024004d10 0x7f8038152ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:21.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.034+0000 7f803c9d5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80380b3280 0x7f8038148dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:21.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.034+0000 7f803c9d5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8038154280 0x7f80380c39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:21.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.034+0000 7f803c9d5640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8038149310 con 0x7f80380b3280 2023-06-10T19:07:21.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.034+0000 7f803c9d5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80381531e0 con 0x7f8038154280 2023-06-10T19:07:21.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.034+0000 7f803c9d5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80381534c0 con 0x7f8024004d10 2023-06-10T19:07:21.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.034+0000 7f802ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80380b3280 0x7f8038148dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:21.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.034+0000 7f802ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80380b3280 0x7f8038148dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33948/0 (socket says 172.21.15.53:33948) 2023-06-10T19:07:21.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.034+0000 7f802ffff640 1 -- 172.21.15.53:0/757181590 learned_addr learned my addr 172.21.15.53:0/757181590 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:21.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.034+0000 7f8036d9d640 1 --2- 172.21.15.53:0/757181590 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8038154280 0x7f80380c39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:21.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.034+0000 7f803659c640 1 --2- 172.21.15.53:0/757181590 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8024004d10 0x7f8038152ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:21.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.034+0000 7f802ffff640 1 -- 172.21.15.53:0/757181590 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8024004d10 msgr2=0x7f8038152ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:21.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.034+0000 7f802ffff640 1 --2- 172.21.15.53:0/757181590 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8024004d10 0x7f8038152ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:21.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.034+0000 7f802ffff640 1 -- 172.21.15.53:0/757181590 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8038154280 msgr2=0x7f80380c39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:21.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.034+0000 7f802ffff640 1 --2- 172.21.15.53:0/757181590 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8038154280 0x7f80380c39c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:21.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.034+0000 7f802ffff640 1 -- 172.21.15.53:0/757181590 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80381537a0 con 0x7f80380b3280 2023-06-10T19:07:21.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.034+0000 7f8036d9d640 1 --2- 172.21.15.53:0/757181590 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8038154280 0x7f80380c39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:07:21.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.034+0000 7f803659c640 1 --2- 172.21.15.53:0/757181590 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8024004d10 0x7f8038152ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:07:21.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.034+0000 7f802ffff640 1 --2- 172.21.15.53:0/757181590 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80380b3280 0x7f8038148dd0 secure :-1 s=READY pgs=2408 cs=0 l=1 rev1=1 crypto rx=0x7f80200115d0 tx=0x7f8020011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:21.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.034+0000 7f802effd640 1 -- 172.21.15.53:0/757181590 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f802000f8f0 con 0x7f80380b3280 2023-06-10T19:07:21.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.034+0000 7f802effd640 1 -- 172.21.15.53:0/757181590 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f802000fa50 con 0x7f80380b3280 2023-06-10T19:07:21.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.034+0000 7f802effd640 1 -- 172.21.15.53:0/757181590 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f802000fdc0 con 0x7f80380b3280 2023-06-10T19:07:21.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.034+0000 7f803c9d5640 1 -- 172.21.15.53:0/757181590 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8038153a80 con 0x7f80380b3280 2023-06-10T19:07:21.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.034+0000 7f803c9d5640 1 -- 172.21.15.53:0/757181590 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80380b36d0 con 0x7f80380b3280 2023-06-10T19:07:21.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.034+0000 7f802effd640 1 -- 172.21.15.53:0/757181590 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8020015460 con 0x7f80380b3280 2023-06-10T19:07:21.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.034+0000 7f802effd640 1 --2- 172.21.15.53:0/757181590 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8018066280 0x7f8018068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:21.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.034+0000 7f802effd640 1 -- 172.21.15.53:0/757181590 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f80200841f0 con 0x7f80380b3280 2023-06-10T19:07:21.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.034+0000 7f803659c640 1 --2- 172.21.15.53:0/757181590 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8018066280 0x7f8018068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:21.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.038+0000 7f803faf1000 1 Processor -- start 2023-06-10T19:07:21.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.038+0000 7f803faf1000 1 -- start start 2023-06-10T19:07:21.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.038+0000 7f803659c640 1 --2- 172.21.15.53:0/757181590 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8018066280 0x7f8018068730 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f8028000c10 tx=0x7f8028009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:21.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.038+0000 7f803faf1000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f28c068740 0x55f28c068b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:21.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.038+0000 7f803faf1000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f28c069050 0x55f28c01e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:21.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.038+0000 7f803faf1000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f28c01ed80 0x55f28c01f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:21.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.038+0000 7f803faf1000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f28bee6ac0 con 0x55f28c069050 2023-06-10T19:07:21.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.038+0000 7f803faf1000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f28be20840 con 0x55f28c068740 2023-06-10T19:07:21.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.038+0000 7f803faf1000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f28be742e0 con 0x55f28c01ed80 2023-06-10T19:07:21.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.038+0000 7f802ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f28c069050 0x55f28c01e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:21.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.038+0000 7f802ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f28c069050 0x55f28c01e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33950/0 (socket says 172.21.15.53:33950) 2023-06-10T19:07:21.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.038+0000 7f802ffff640 1 -- 172.21.15.53:0/616043770 learned_addr learned my addr 172.21.15.53:0/616043770 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:21.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.038+0000 7f803659c640 1 --2- 172.21.15.53:0/616043770 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f28c068740 0x55f28c068b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:21.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.038+0000 7f802ffff640 1 -- 172.21.15.53:0/616043770 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f28c01ed80 msgr2=0x55f28c01f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:21.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.038+0000 7f802ffff640 1 --2- 172.21.15.53:0/616043770 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f28c01ed80 0x55f28c01f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:21.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.038+0000 7f802ffff640 1 -- 172.21.15.53:0/616043770 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f28c068740 msgr2=0x55f28c068b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:21.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.038+0000 7f802ffff640 1 --2- 172.21.15.53:0/616043770 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f28c068740 0x55f28c068b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:21.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.038+0000 7f802ffff640 1 -- 172.21.15.53:0/616043770 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f28bb69890 con 0x55f28c069050 2023-06-10T19:07:21.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.038+0000 7f802ffff640 1 --2- 172.21.15.53:0/616043770 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f28c069050 0x55f28c01e840 secure :-1 s=READY pgs=2409 cs=0 l=1 rev1=1 crypto rx=0x7f8020082670 tx=0x7f8020055030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7619aaeb45e3abf6 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:21.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.038+0000 7f8017fff640 1 -- 172.21.15.53:0/616043770 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8020084070 con 0x55f28c069050 2023-06-10T19:07:21.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.038+0000 7f8017fff640 1 -- 172.21.15.53:0/616043770 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8020059170 con 0x55f28c069050 2023-06-10T19:07:21.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.038+0000 7f8017fff640 1 -- 172.21.15.53:0/616043770 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8020051ad0 con 0x55f28c069050 2023-06-10T19:07:21.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.038+0000 7f803faf1000 1 -- 172.21.15.53:0/616043770 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f28c069050 msgr2=0x55f28c01e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:21.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.038+0000 7f803faf1000 1 --2- 172.21.15.53:0/616043770 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f28c069050 0x55f28c01e840 secure :-1 s=READY pgs=2409 cs=0 l=1 rev1=1 crypto rx=0x7f8020082670 tx=0x7f8020055030 comp rx=0 tx=0).stop 2023-06-10T19:07:21.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.038+0000 7f803faf1000 1 -- 172.21.15.53:0/616043770 shutdown_connections 2023-06-10T19:07:21.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.038+0000 7f803faf1000 1 --2- 172.21.15.53:0/616043770 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f28c01ed80 0x55f28c01f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:21.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.038+0000 7f803faf1000 1 --2- 172.21.15.53:0/616043770 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f28c069050 0x55f28c01e840 unknown :-1 s=CLOSED pgs=2409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:21.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.038+0000 7f803faf1000 1 --2- 172.21.15.53:0/616043770 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f28c068740 0x55f28c068b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:21.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.038+0000 7f803faf1000 1 -- 172.21.15.53:0/616043770 >> 172.21.15.53:0/616043770 conn(0x55f28c016800 msgr2=0x55f28c025800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:21.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.038+0000 7f803faf1000 1 -- 172.21.15.53:0/616043770 shutdown_connections 2023-06-10T19:07:21.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.038+0000 7f803faf1000 1 -- 172.21.15.53:0/616043770 wait complete. 2023-06-10T19:07:21.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.038+0000 7f803faf1000 1 -- start start 2023-06-10T19:07:21.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.038+0000 7f803faf1000 1 Processor -- start 2023-06-10T19:07:21.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.042+0000 7f803faf1000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f28c01ed80 0x55f28c024490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:21.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.042+0000 7f803faf1000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f28c068740 0x55f28c0249d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:21.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.042+0000 7f803faf1000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f28c069050 0x55f28c02a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:21.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.042+0000 7f803faf1000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f28be6d380 con 0x55f28c069050 2023-06-10T19:07:21.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.042+0000 7f803faf1000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f28be29ae0 con 0x55f28c01ed80 2023-06-10T19:07:21.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.042+0000 7f803faf1000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f28be29780 con 0x55f28c068740 2023-06-10T19:07:21.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.042+0000 7f803faf1000 10 client.0 _ll_register_callbacks cb 0x55f28c00ae30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-10T19:07:21.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.042+0000 7f8036d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f28c069050 0x55f28c02a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:21.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.042+0000 7f8036d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f28c069050 0x55f28c02a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33960/0 (socket says 172.21.15.53:33960) 2023-06-10T19:07:21.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.042+0000 7f8036d9d640 1 -- 172.21.15.53:0/3733654658 learned_addr learned my addr 172.21.15.53:0/3733654658 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:21.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.042+0000 7f803659c640 1 --2- 172.21.15.53:0/3733654658 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f28c01ed80 0x55f28c024490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:21.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.042+0000 7f802ffff640 1 --2- 172.21.15.53:0/3733654658 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f28c068740 0x55f28c0249d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:21.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.042+0000 7f8036d9d640 1 -- 172.21.15.53:0/3733654658 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f28c068740 msgr2=0x55f28c0249d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:21.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.042+0000 7f8036d9d640 1 --2- 172.21.15.53:0/3733654658 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f28c068740 0x55f28c0249d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:21.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.042+0000 7f8036d9d640 1 -- 172.21.15.53:0/3733654658 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f28c01ed80 msgr2=0x55f28c024490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:21.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.042+0000 7f8036d9d640 1 --2- 172.21.15.53:0/3733654658 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f28c01ed80 0x55f28c024490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:21.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.042+0000 7f8036d9d640 1 -- 172.21.15.53:0/3733654658 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80380b36d0 con 0x55f28c069050 2023-06-10T19:07:21.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.042+0000 7f8036d9d640 1 --2- 172.21.15.53:0/3733654658 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f28c069050 0x55f28c02a0e0 secure :-1 s=READY pgs=2410 cs=0 l=1 rev1=1 crypto rx=0x7f803001d4a0 tx=0x7f8030009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=974f2406bc5265c6 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:21.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.042+0000 7f80157fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-06-10T19:07:21.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.042+0000 7f80157fa640 1 -- 172.21.15.53:0/3733654658 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80300a6ea0 con 0x55f28c069050 2023-06-10T19:07:21.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.042+0000 7f80157fa640 1 -- 172.21.15.53:0/3733654658 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(167..167 src has 1..167) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f80300b8650 con 0x55f28c069050 2023-06-10T19:07:21.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.042+0000 7f803faf1000 1 -- 172.21.15.53:0/3733654658 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f28be34a20 con 0x55f28c069050 2023-06-10T19:07:21.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.042+0000 7f80157fa640 1 -- 172.21.15.53:0/3733654658 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=96) v2 ==== 24+0+0 (secure 0 0 0) 0x7f80300039a0 con 0x55f28c069050 2023-06-10T19:07:21.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.042+0000 7f803faf1000 10 client.10719 fetch_fsmap learned FSMap version 96 2023-06-10T19:07:21.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.042+0000 7f803faf1000 1 -- 172.21.15.53:0/3733654658 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=96,monmap=2+}) v3 -- 0x55f28be31d10 con 0x55f28c069050 2023-06-10T19:07:21.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.042+0000 7f80157fa640 1 -- 172.21.15.53:0/3733654658 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f28be34a20 con 0x55f28c069050 2023-06-10T19:07:21.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.042+0000 7f80157fa640 1 -- 172.21.15.53:0/3733654658 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 96) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f8030003b00 con 0x55f28c069050 2023-06-10T19:07:21.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.042+0000 7f803faf1000 10 client.10719 fetch_fsmap finished waiting for FSMap version 96 2023-06-10T19:07:21.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.042+0000 7f803faf1000 10 client.10719 resolve_mds: resolved name 'c' to daemon mds.c 2023-06-10T19:07:21.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.042+0000 7f803faf1000 20 client.10719 populate_metadata read hostname 'smithi053' 2023-06-10T19:07:21.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.042+0000 7f803faf1000 1 --2- 172.21.15.53:0/3733654658 >> [v2:172.21.15.53:6834/3721509006,v1:172.21.15.53:6835/3721509006] conn(0x55f28c0777b0 0x55f28c079b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:21.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.042+0000 7f803faf1000 4 client.10719 mds_command: new command op to 10557 tid=0[{"prefix": "get_command_descriptions"}] 2023-06-10T19:07:21.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.042+0000 7f803faf1000 1 -- 172.21.15.53:0/3733654658 --> [v2:172.21.15.53:6834/3721509006,v1:172.21.15.53:6835/3721509006] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f28be9c710 con 0x55f28c0777b0 2023-06-10T19:07:21.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.042+0000 7f803659c640 1 --2- 172.21.15.53:0/3733654658 >> [v2:172.21.15.53:6834/3721509006,v1:172.21.15.53:6835/3721509006] conn(0x55f28c0777b0 0x55f28c079b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:21.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.042+0000 7f80157fa640 10 client.10719 ms_handle_connect on v2:172.21.15.53:6834/3721509006 2023-06-10T19:07:21.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.042+0000 7f803659c640 1 --2- 172.21.15.53:0/3733654658 >> [v2:172.21.15.53:6834/3721509006,v1:172.21.15.53:6835/3721509006] conn(0x55f28c0777b0 0x55f28c079b90 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be0c9341df002736 server_cookie=3b1dc8c9d45c2854 in_seq=0 out_seq=0 2023-06-10T19:07:21.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.042+0000 7f80157fa640 1 -- 172.21.15.53:0/3733654658 <== mds.0 v2:172.21.15.53:6834/3721509006 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55f28be9c710 con 0x55f28c0777b0 2023-06-10T19:07:21.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.042+0000 7f80157fa640 10 client.10719 handle_command_reply: tid=0 2023-06-10T19:07:21.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.042+0000 7f803faf1000 1 client.10719 shutdown 2023-06-10T19:07:21.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.042+0000 7f803faf1000 1 -- 172.21.15.53:0/3733654658 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f28c069050 msgr2=0x55f28c02a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:21.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.042+0000 7f803faf1000 1 --2- 172.21.15.53:0/3733654658 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f28c069050 0x55f28c02a0e0 secure :-1 s=READY pgs=2410 cs=0 l=1 rev1=1 crypto rx=0x7f803001d4a0 tx=0x7f8030009750 comp rx=0 tx=0).stop 2023-06-10T19:07:21.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.042+0000 7f803faf1000 1 -- 172.21.15.53:0/3733654658 shutdown_connections 2023-06-10T19:07:21.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.042+0000 7f803faf1000 1 --2- 172.21.15.53:0/3733654658 >> [v2:172.21.15.53:6834/3721509006,v1:172.21.15.53:6835/3721509006] conn(0x55f28c0777b0 0x55f28c079b90 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:21.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.042+0000 7f803faf1000 1 --2- 172.21.15.53:0/3733654658 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f28c069050 0x55f28c02a0e0 unknown :-1 s=CLOSED pgs=2410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:21.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.042+0000 7f80157fa640 0 client.10719 ms_handle_reset on v2:172.21.15.53:6834/3721509006 2023-06-10T19:07:21.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.042+0000 7f803faf1000 1 --2- 172.21.15.53:0/3733654658 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f28c068740 0x55f28c0249d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:21.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.042+0000 7f803faf1000 1 --2- 172.21.15.53:0/3733654658 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f28c01ed80 0x55f28c024490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:21.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.042+0000 7f803faf1000 1 -- 172.21.15.53:0/3733654658 >> 172.21.15.53:0/3733654658 conn(0x55f28c016800 msgr2=0x55f28c01d830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:21.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.042+0000 7f803faf1000 1 -- 172.21.15.53:0/3733654658 shutdown_connections 2023-06-10T19:07:21.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.042+0000 7f803faf1000 1 -- 172.21.15.53:0/3733654658 wait complete. 2023-06-10T19:07:21.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.042+0000 7f803faf1000 20 client.10719 trim_cache size 0 max 16384 2023-06-10T19:07:21.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.058+0000 7f803faf1000 1 Processor -- start 2023-06-10T19:07:21.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.058+0000 7f803faf1000 1 -- start start 2023-06-10T19:07:21.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.058+0000 7f803faf1000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f28c01ed80 0x55f28c01df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:21.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.058+0000 7f803faf1000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f28c068740 0x55f28c01e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:21.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.058+0000 7f803faf1000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f28c069050 0x55f28c077b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:21.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.058+0000 7f803faf1000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f28bb2a940 con 0x55f28c01ed80 2023-06-10T19:07:21.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.058+0000 7f803faf1000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f28c07c1f0 con 0x55f28c068740 2023-06-10T19:07:21.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.058+0000 7f803faf1000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f28be6a780 con 0x55f28c069050 2023-06-10T19:07:21.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.058+0000 7f803659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f28c01ed80 0x55f28c01df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:21.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.058+0000 7f803659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f28c01ed80 0x55f28c01df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33976/0 (socket says 172.21.15.53:33976) 2023-06-10T19:07:21.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.058+0000 7f803659c640 1 -- 172.21.15.53:0/1194560605 learned_addr learned my addr 172.21.15.53:0/1194560605 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:21.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.058+0000 7f803659c640 1 -- 172.21.15.53:0/1194560605 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f28c069050 msgr2=0x55f28c077b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:21.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.058+0000 7f802ffff640 1 --2- 172.21.15.53:0/1194560605 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f28c068740 0x55f28c01e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:21.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.058+0000 7f803659c640 1 --2- 172.21.15.53:0/1194560605 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f28c069050 0x55f28c077b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:21.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.058+0000 7f803659c640 1 -- 172.21.15.53:0/1194560605 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f28c068740 msgr2=0x55f28c01e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:21.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.058+0000 7f803659c640 1 --2- 172.21.15.53:0/1194560605 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f28c068740 0x55f28c01e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:21.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.058+0000 7f803659c640 1 -- 172.21.15.53:0/1194560605 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f28c021450 con 0x55f28c01ed80 2023-06-10T19:07:21.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.058+0000 7f803659c640 1 --2- 172.21.15.53:0/1194560605 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f28c01ed80 0x55f28c01df40 secure :-1 s=READY pgs=2411 cs=0 l=1 rev1=1 crypto rx=0x7f8028001140 tx=0x7f8028012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f47d984d71417bd3 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:21.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.058+0000 7f802cff9640 1 -- 172.21.15.53:0/1194560605 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8028026d00 con 0x55f28c01ed80 2023-06-10T19:07:21.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.058+0000 7f802cff9640 1 -- 172.21.15.53:0/1194560605 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8028026e60 con 0x55f28c01ed80 2023-06-10T19:07:21.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.058+0000 7f802cff9640 1 -- 172.21.15.53:0/1194560605 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80280260b0 con 0x55f28c01ed80 2023-06-10T19:07:21.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.062+0000 7f803faf1000 1 -- 172.21.15.53:0/1194560605 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f28c01ed80 msgr2=0x55f28c01df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:21.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.062+0000 7f803faf1000 1 --2- 172.21.15.53:0/1194560605 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f28c01ed80 0x55f28c01df40 secure :-1 s=READY pgs=2411 cs=0 l=1 rev1=1 crypto rx=0x7f8028001140 tx=0x7f8028012000 comp rx=0 tx=0).stop 2023-06-10T19:07:21.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.062+0000 7f803faf1000 1 -- 172.21.15.53:0/1194560605 shutdown_connections 2023-06-10T19:07:21.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.062+0000 7f803faf1000 1 --2- 172.21.15.53:0/1194560605 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f28c069050 0x55f28c077b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:21.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.062+0000 7f803faf1000 1 --2- 172.21.15.53:0/1194560605 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f28c068740 0x55f28c01e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:21.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.062+0000 7f803faf1000 1 --2- 172.21.15.53:0/1194560605 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f28c01ed80 0x55f28c01df40 unknown :-1 s=CLOSED pgs=2411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:21.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.062+0000 7f803faf1000 1 -- 172.21.15.53:0/1194560605 >> 172.21.15.53:0/1194560605 conn(0x55f28c016800 msgr2=0x55f28c01d830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:21.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.062+0000 7f803faf1000 1 -- 172.21.15.53:0/1194560605 shutdown_connections 2023-06-10T19:07:21.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.062+0000 7f803faf1000 1 -- 172.21.15.53:0/1194560605 wait complete. 2023-06-10T19:07:21.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.062+0000 7f803faf1000 1 -- start start 2023-06-10T19:07:21.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.062+0000 7f803faf1000 1 Processor -- start 2023-06-10T19:07:21.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.062+0000 7f803faf1000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f28c01ed80 0x55f28c07b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:21.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.062+0000 7f803faf1000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f28c068740 0x55f28c082ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:21.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.062+0000 7f803faf1000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f28c069050 0x55f28c083530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:21.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.062+0000 7f803faf1000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f28be0aa80 con 0x55f28c068740 2023-06-10T19:07:21.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.062+0000 7f803faf1000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f28beb0ad0 con 0x55f28c01ed80 2023-06-10T19:07:21.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.062+0000 7f803faf1000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f28be352f0 con 0x55f28c069050 2023-06-10T19:07:21.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.062+0000 7f803faf1000 10 client.0 _ll_register_callbacks cb 0x55f28be317f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-10T19:07:21.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.062+0000 7f802ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f28c068740 0x55f28c082ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:21.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.062+0000 7f802ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f28c068740 0x55f28c082ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:33982/0 (socket says 172.21.15.53:33982) 2023-06-10T19:07:21.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.062+0000 7f802ffff640 1 -- 172.21.15.53:0/1679992409 learned_addr learned my addr 172.21.15.53:0/1679992409 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:21.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.062+0000 7f803659c640 1 --2- 172.21.15.53:0/1679992409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f28c01ed80 0x55f28c07b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:21.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.062+0000 7f8036d9d640 1 --2- 172.21.15.53:0/1679992409 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f28c069050 0x55f28c083530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:21.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.062+0000 7f802ffff640 1 -- 172.21.15.53:0/1679992409 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f28c069050 msgr2=0x55f28c083530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:21.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.062+0000 7f802ffff640 1 --2- 172.21.15.53:0/1679992409 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f28c069050 0x55f28c083530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:21.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.062+0000 7f802ffff640 1 -- 172.21.15.53:0/1679992409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f28c01ed80 msgr2=0x55f28c07b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:21.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.062+0000 7f802ffff640 1 --2- 172.21.15.53:0/1679992409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f28c01ed80 0x55f28c07b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:21.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.062+0000 7f802ffff640 1 -- 172.21.15.53:0/1679992409 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8028019040 con 0x55f28c068740 2023-06-10T19:07:21.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.062+0000 7f8036d9d640 1 --2- 172.21.15.53:0/1679992409 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f28c069050 0x55f28c083530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:07:21.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.062+0000 7f802ffff640 1 --2- 172.21.15.53:0/1679992409 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f28c068740 0x55f28c082ff0 secure :-1 s=READY pgs=2412 cs=0 l=1 rev1=1 crypto rx=0x7f8020055070 tx=0x7f802005b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30c2664192889af server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:21.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.062+0000 7f80157fa640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-06-10T19:07:21.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.062+0000 7f80157fa640 1 -- 172.21.15.53:0/1679992409 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f802001ce30 con 0x55f28c068740 2023-06-10T19:07:21.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.062+0000 7f80157fa640 1 -- 172.21.15.53:0/1679992409 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(167..167 src has 1..167) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f80200511b0 con 0x55f28c068740 2023-06-10T19:07:21.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.062+0000 7f803faf1000 1 -- 172.21.15.53:0/1679992409 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f28c0226e0 con 0x55f28c068740 2023-06-10T19:07:21.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.062+0000 7f80157fa640 1 -- 172.21.15.53:0/1679992409 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=96) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8020084070 con 0x55f28c068740 2023-06-10T19:07:21.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.062+0000 7f803faf1000 10 client.10725 fetch_fsmap learned FSMap version 96 2023-06-10T19:07:21.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.062+0000 7f803faf1000 1 -- 172.21.15.53:0/1679992409 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=96,monmap=2+}) v3 -- 0x55f28be17fa0 con 0x55f28c068740 2023-06-10T19:07:21.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.062+0000 7f80157fa640 1 -- 172.21.15.53:0/1679992409 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8020071020 con 0x55f28c068740 2023-06-10T19:07:21.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.062+0000 7f80157fa640 1 -- 172.21.15.53:0/1679992409 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 96) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f802001b020 con 0x55f28c068740 2023-06-10T19:07:21.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.062+0000 7f803faf1000 10 client.10725 fetch_fsmap finished waiting for FSMap version 96 2023-06-10T19:07:21.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.062+0000 7f803faf1000 10 client.10725 resolve_mds: resolved name 'c' to daemon mds.c 2023-06-10T19:07:21.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.062+0000 7f803faf1000 20 client.10725 populate_metadata read hostname 'smithi053' 2023-06-10T19:07:21.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.062+0000 7f803faf1000 1 --2- 172.21.15.53:0/1679992409 >> [v2:172.21.15.53:6834/3721509006,v1:172.21.15.53:6835/3721509006] conn(0x55f28c0c6420 0x55f28c0c67f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:21.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.062+0000 7f803faf1000 4 client.10725 mds_command: new command op to 10557 tid=0[{"prefix": "status"}] 2023-06-10T19:07:21.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.062+0000 7f803faf1000 1 -- 172.21.15.53:0/1679992409 --> [v2:172.21.15.53:6834/3721509006,v1:172.21.15.53:6835/3721509006] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f28be6bcd0 con 0x55f28c0c6420 2023-06-10T19:07:21.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.062+0000 7f803659c640 1 --2- 172.21.15.53:0/1679992409 >> [v2:172.21.15.53:6834/3721509006,v1:172.21.15.53:6835/3721509006] conn(0x55f28c0c6420 0x55f28c0c67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:21.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.062+0000 7f803659c640 1 --2- 172.21.15.53:0/1679992409 >> [v2:172.21.15.53:6834/3721509006,v1:172.21.15.53:6835/3721509006] conn(0x55f28c0c6420 0x55f28c0c67f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1cdfea50eda18daf server_cookie=ca02dce2dbdf6252 in_seq=0 out_seq=0 2023-06-10T19:07:21.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.062+0000 7f80157fa640 10 client.10725 ms_handle_connect on v2:172.21.15.53:6834/3721509006 2023-06-10T19:07:21.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.062+0000 7f80157fa640 1 -- 172.21.15.53:0/1679992409 <== mds.0 v2:172.21.15.53:6834/3721509006 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+334 (crc 0 0 0) 0x55f28be6bcd0 con 0x55f28c0c6420 2023-06-10T19:07:21.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.062+0000 7f80157fa640 10 client.10725 handle_command_reply: tid=0 2023-06-10T19:07:21.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.062+0000 7f803faf1000 1 client.10725 shutdown 2023-06-10T19:07:21.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.066+0000 7f803faf1000 1 -- 172.21.15.53:0/1679992409 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f28c068740 msgr2=0x55f28c082ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:21.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.066+0000 7f803faf1000 1 --2- 172.21.15.53:0/1679992409 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f28c068740 0x55f28c082ff0 secure :-1 s=READY pgs=2412 cs=0 l=1 rev1=1 crypto rx=0x7f8020055070 tx=0x7f802005b040 comp rx=0 tx=0).stop 2023-06-10T19:07:21.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.066+0000 7f803faf1000 1 -- 172.21.15.53:0/1679992409 shutdown_connections 2023-06-10T19:07:21.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.066+0000 7f803faf1000 1 --2- 172.21.15.53:0/1679992409 >> [v2:172.21.15.53:6834/3721509006,v1:172.21.15.53:6835/3721509006] conn(0x55f28c0c6420 0x55f28c0c67f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:21.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.066+0000 7f803faf1000 1 --2- 172.21.15.53:0/1679992409 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55f28c069050 0x55f28c083530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:21.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.066+0000 7f803faf1000 1 --2- 172.21.15.53:0/1679992409 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f28c068740 0x55f28c082ff0 unknown :-1 s=CLOSED pgs=2412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:21.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.066+0000 7f80157fa640 0 client.10725 ms_handle_reset on v2:172.21.15.53:6834/3721509006 2023-06-10T19:07:21.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.066+0000 7f803faf1000 1 --2- 172.21.15.53:0/1679992409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f28c01ed80 0x55f28c07b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:21.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.066+0000 7f803faf1000 1 -- 172.21.15.53:0/1679992409 >> 172.21.15.53:0/1679992409 conn(0x55f28c016800 msgr2=0x55f28c01d830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:21.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.066+0000 7f803faf1000 1 -- 172.21.15.53:0/1679992409 shutdown_connections 2023-06-10T19:07:21.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.066+0000 7f803faf1000 1 -- 172.21.15.53:0/1679992409 wait complete. 2023-06-10T19:07:21.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.066+0000 7f803faf1000 20 client.10725 trim_cache size 0 max 16384 2023-06-10T19:07:21.076 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-06-10T19:07:21.077 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_fsid": "c8c64bed-c406-4936-93f9-d16335f1067d", 2023-06-10T19:07:21.077 INFO:teuthology.orchestra.run.smithi053.stdout: "whoami": 0, 2023-06-10T19:07:21.077 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 10557, 2023-06-10T19:07:21.077 INFO:teuthology.orchestra.run.smithi053.stdout: "want_state": "up:active", 2023-06-10T19:07:21.077 INFO:teuthology.orchestra.run.smithi053.stdout: "state": "up:active", 2023-06-10T19:07:21.077 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs", 2023-06-10T19:07:21.077 INFO:teuthology.orchestra.run.smithi053.stdout: "rank_uptime": 5.3384966709999997, 2023-06-10T19:07:21.077 INFO:teuthology.orchestra.run.smithi053.stdout: "mdsmap_epoch": 96, 2023-06-10T19:07:21.078 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch": 167, 2023-06-10T19:07:21.078 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch_barrier": 167, 2023-06-10T19:07:21.078 INFO:teuthology.orchestra.run.smithi053.stdout: "uptime": 10.741994718999999 2023-06-10T19:07:21.078 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-06-10T19:07:21.079 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.066+0000 7f803c9d5640 1 -- 172.21.15.53:0/757181590 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8018066280 msgr2=0x7f8018068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:21.079 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.066+0000 7f803c9d5640 1 --2- 172.21.15.53:0/757181590 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8018066280 0x7f8018068730 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f8028000c10 tx=0x7f8028009040 comp rx=0 tx=0).stop 2023-06-10T19:07:21.079 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.066+0000 7f803c9d5640 1 -- 172.21.15.53:0/757181590 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80380b3280 msgr2=0x7f8038148dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:21.079 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.066+0000 7f803c9d5640 1 --2- 172.21.15.53:0/757181590 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80380b3280 0x7f8038148dd0 secure :-1 s=READY pgs=2408 cs=0 l=1 rev1=1 crypto rx=0x7f80200115d0 tx=0x7f8020011a90 comp rx=0 tx=0).stop 2023-06-10T19:07:21.079 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.066+0000 7f803c9d5640 1 -- 172.21.15.53:0/757181590 shutdown_connections 2023-06-10T19:07:21.079 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.066+0000 7f803c9d5640 1 --2- 172.21.15.53:0/757181590 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8018066280 0x7f8018068730 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:21.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.066+0000 7f803c9d5640 1 --2- 172.21.15.53:0/757181590 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8038154280 0x7f80380c39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:21.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.066+0000 7f803c9d5640 1 --2- 172.21.15.53:0/757181590 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80380b3280 0x7f8038148dd0 unknown :-1 s=CLOSED pgs=2408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:21.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.066+0000 7f803c9d5640 1 --2- 172.21.15.53:0/757181590 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8024004d10 0x7f8038152ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:21.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.066+0000 7f803c9d5640 1 -- 172.21.15.53:0/757181590 >> 172.21.15.53:0/757181590 conn(0x7f80380ce9e0 msgr2=0x7f803806b430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:21.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.066+0000 7f803c9d5640 1 -- 172.21.15.53:0/757181590 shutdown_connections 2023-06-10T19:07:21.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.066+0000 7f803c9d5640 1 -- 172.21.15.53:0/757181590 wait complete. 2023-06-10T19:07:21.082 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-10T19:07:21.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.194+0000 7f79c2441640 1 Processor -- start 2023-06-10T19:07:21.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.194+0000 7f79c2441640 1 -- start start 2023-06-10T19:07:21.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.194+0000 7f79c2441640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f79bc0b3ac0 0x7f79bc0b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:21.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.194+0000 7f79c2441640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f79bc0d14c0 0x7f79bc15fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:21.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.194+0000 7f79c2441640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79bc0d0020 con 0x7f79bc0cc690 2023-06-10T19:07:21.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.194+0000 7f79c2441640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79bc0b43d0 con 0x7f79bc0b3ac0 2023-06-10T19:07:21.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.194+0000 7f79c2441640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79bc0cef40 con 0x7f79bc0d14c0 2023-06-10T19:07:21.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.198+0000 7f79bbfff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f79bc0b3ac0 0x7f79bc0b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:21.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.198+0000 7f79c09de640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f79bc0d14c0 0x7f79bc15fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:21.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.198+0000 7f79bb7fe640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f79bc0cc690 0x7f79bc15f370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.53:59650/0 (socket says 172.21.15.53:59650) 2023-06-10T19:07:21.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.198+0000 7f79bb7fe640 1 -- 172.21.15.53:0/911880373 learned_addr learned my addr 172.21.15.53:0/911880373 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:07:21.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.198+0000 7f79bbfff640 1 -- 172.21.15.53:0/911880373 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f79bc0d14c0 msgr2=0x7f79bc15fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:21.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.198+0000 7f79bbfff640 1 --2- 172.21.15.53:0/911880373 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f79bc0d14c0 0x7f79bc15fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:21.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.198+0000 7f79bbfff640 1 -- 172.21.15.53:0/911880373 >> v1:172.21.15.117:6789/0 conn(0x7f79bc0cc690 legacy=0x7f79bc15f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:21.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.198+0000 7f79bbfff640 1 -- 172.21.15.53:0/911880373 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79bc0cf220 con 0x7f79bc0b3ac0 2023-06-10T19:07:21.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.198+0000 7f79bbfff640 1 --2- 172.21.15.53:0/911880373 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79bc0b3ac0 0x7f79bc0b3e90 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f79ac009d90 tx=0x7f79ac01c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ffb59671d6999f1 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:21.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.198+0000 7f79baffd640 1 -- 172.21.15.53:0/911880373 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79ac0a58f0 con 0x7f79bc0b3ac0 2023-06-10T19:07:21.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.198+0000 7f79baffd640 1 -- 172.21.15.53:0/911880373 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79ac0a5a50 con 0x7f79bc0b3ac0 2023-06-10T19:07:21.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.198+0000 7f79baffd640 1 -- 172.21.15.53:0/911880373 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79ac0a5de0 con 0x7f79bc0b3ac0 2023-06-10T19:07:21.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.202+0000 7f79c2441640 1 -- 172.21.15.53:0/911880373 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79bc0b3ac0 msgr2=0x7f79bc0b3e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:21.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.202+0000 7f79c2441640 1 --2- 172.21.15.53:0/911880373 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79bc0b3ac0 0x7f79bc0b3e90 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f79ac009d90 tx=0x7f79ac01c920 comp rx=0 tx=0).stop 2023-06-10T19:07:21.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.202+0000 7f79c2441640 1 -- 172.21.15.53:0/911880373 shutdown_connections 2023-06-10T19:07:21.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.202+0000 7f79c2441640 1 --2- 172.21.15.53:0/911880373 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f79bc0d14c0 0x7f79bc15fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:21.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.202+0000 7f79c2441640 1 --2- 172.21.15.53:0/911880373 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79bc0b3ac0 0x7f79bc0b3e90 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:21.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.202+0000 7f79c2441640 1 -- 172.21.15.53:0/911880373 >> 172.21.15.53:0/911880373 conn(0x7f79bc071790 msgr2=0x7f79bc069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:21.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.202+0000 7f79c2441640 1 -- 172.21.15.53:0/911880373 shutdown_connections 2023-06-10T19:07:21.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.202+0000 7f79c2441640 1 -- 172.21.15.53:0/911880373 wait complete. 2023-06-10T19:07:21.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.202+0000 7f79c2441640 1 Processor -- start 2023-06-10T19:07:21.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.202+0000 7f79c2441640 1 -- start start 2023-06-10T19:07:21.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.202+0000 7f79c2441640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79bc0b3ac0 0x7f79bc15c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:21.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.202+0000 7f79c2441640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f79bc0cc690 0x7f79bc15e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:21.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.202+0000 7f79c2441640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79bc0d14c0 0x7f79bc15e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:21.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.202+0000 7f79c2441640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79bc14f330 con 0x7f79bc0b3ac0 2023-06-10T19:07:21.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.202+0000 7f79c2441640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79bc14f610 con 0x7f79bc0d14c0 2023-06-10T19:07:21.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.202+0000 7f79c2441640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79bc14f8f0 con 0x7f79bc0cc690 2023-06-10T19:07:21.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.202+0000 7f79bbfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79bc0b3ac0 0x7f79bc15c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:21.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.202+0000 7f79bbfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79bc0b3ac0 0x7f79bc15c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42846/0 (socket says 172.21.15.53:42846) 2023-06-10T19:07:21.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.202+0000 7f79bbfff640 1 -- 172.21.15.53:0/999691365 learned_addr learned my addr 172.21.15.53:0/999691365 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:21.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.202+0000 7f79bb7fe640 1 --2- 172.21.15.53:0/999691365 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f79bc0cc690 0x7f79bc15e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:21.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.202+0000 7f79c09de640 1 --2- 172.21.15.53:0/999691365 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79bc0d14c0 0x7f79bc15e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:21.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.202+0000 7f79bbfff640 1 -- 172.21.15.53:0/999691365 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f79bc0cc690 msgr2=0x7f79bc15e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:21.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.202+0000 7f79bbfff640 1 --2- 172.21.15.53:0/999691365 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f79bc0cc690 0x7f79bc15e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:21.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.202+0000 7f79bbfff640 1 -- 172.21.15.53:0/999691365 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79bc0d14c0 msgr2=0x7f79bc15e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:21.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.202+0000 7f79bbfff640 1 --2- 172.21.15.53:0/999691365 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79bc0d14c0 0x7f79bc15e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:21.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.202+0000 7f79bbfff640 1 -- 172.21.15.53:0/999691365 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79ac009a70 con 0x7f79bc0b3ac0 2023-06-10T19:07:21.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.202+0000 7f79bb7fe640 1 --2- 172.21.15.53:0/999691365 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f79bc0cc690 0x7f79bc15e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:07:21.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.202+0000 7f79c09de640 1 --2- 172.21.15.53:0/999691365 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79bc0d14c0 0x7f79bc15e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:07:21.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.202+0000 7f79bbfff640 1 --2- 172.21.15.53:0/999691365 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79bc0b3ac0 0x7f79bc15c450 secure :-1 s=READY pgs=2413 cs=0 l=1 rev1=1 crypto rx=0x7f79ac01afd0 tx=0x7f79ac0196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:21.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.202+0000 7f79b8ff9640 1 -- 172.21.15.53:0/999691365 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79ac007000 con 0x7f79bc0b3ac0 2023-06-10T19:07:21.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.202+0000 7f79b8ff9640 1 -- 172.21.15.53:0/999691365 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79ac0ad650 con 0x7f79bc0b3ac0 2023-06-10T19:07:21.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.202+0000 7f79c2441640 1 -- 172.21.15.53:0/999691365 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79bc14fbd0 con 0x7f79bc0b3ac0 2023-06-10T19:07:21.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.206+0000 7f79b8ff9640 1 -- 172.21.15.53:0/999691365 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79ac0ada00 con 0x7f79bc0b3ac0 2023-06-10T19:07:21.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.206+0000 7f79c2441640 1 -- 172.21.15.53:0/999691365 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79bc150190 con 0x7f79bc0b3ac0 2023-06-10T19:07:21.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.206+0000 7f79c2441640 1 -- 172.21.15.53:0/999691365 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79bc04d790 con 0x7f79bc0b3ac0 2023-06-10T19:07:21.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.206+0000 7f79b8ff9640 1 -- 172.21.15.53:0/999691365 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f79ac0adb60 con 0x7f79bc0b3ac0 2023-06-10T19:07:21.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.206+0000 7f79b8ff9640 1 --2- 172.21.15.53:0/999691365 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f79a8066280 0x7f79a8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:21.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.206+0000 7f79b8ff9640 1 -- 172.21.15.53:0/999691365 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f79ac11f3b0 con 0x7f79bc0b3ac0 2023-06-10T19:07:21.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.206+0000 7f79bb7fe640 1 --2- 172.21.15.53:0/999691365 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f79a8066280 0x7f79a8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:21.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.206+0000 7f79bb7fe640 1 --2- 172.21.15.53:0/999691365 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f79a8066280 0x7f79a8068730 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f79bc154620 tx=0x7f79b0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:21.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.210+0000 7f79b8ff9640 1 -- 172.21.15.53:0/999691365 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f79ac0ec700 con 0x7f79bc0b3ac0 2023-06-10T19:07:21.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.398+0000 7f79c2441640 1 -- 172.21.15.53:0/999691365 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f79bc08a200 con 0x7f79bc0b3ac0 2023-06-10T19:07:21.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.402+0000 7f79b8ff9640 1 -- 172.21.15.53:0/999691365 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v96) v1 ==== 53+0+73 (secure 0 0 0) 0x7f79ac0c6070 con 0x7f79bc0b3ac0 2023-06-10T19:07:21.403 INFO:teuthology.orchestra.run.smithi053.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-06-10T19:07:21.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.402+0000 7f79c2441640 1 -- 172.21.15.53:0/999691365 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f79a8066280 msgr2=0x7f79a8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:21.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.402+0000 7f79c2441640 1 --2- 172.21.15.53:0/999691365 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f79a8066280 0x7f79a8068730 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f79bc154620 tx=0x7f79b0009040 comp rx=0 tx=0).stop 2023-06-10T19:07:21.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.402+0000 7f79c2441640 1 -- 172.21.15.53:0/999691365 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79bc0b3ac0 msgr2=0x7f79bc15c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:21.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.402+0000 7f79c2441640 1 --2- 172.21.15.53:0/999691365 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79bc0b3ac0 0x7f79bc15c450 secure :-1 s=READY pgs=2413 cs=0 l=1 rev1=1 crypto rx=0x7f79ac01afd0 tx=0x7f79ac0196c0 comp rx=0 tx=0).stop 2023-06-10T19:07:21.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.402+0000 7f79c2441640 1 -- 172.21.15.53:0/999691365 shutdown_connections 2023-06-10T19:07:21.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.402+0000 7f79c2441640 1 --2- 172.21.15.53:0/999691365 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f79a8066280 0x7f79a8068730 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:21.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.402+0000 7f79c2441640 1 --2- 172.21.15.53:0/999691365 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79bc0d14c0 0x7f79bc15e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:21.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.402+0000 7f79c2441640 1 --2- 172.21.15.53:0/999691365 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f79bc0cc690 0x7f79bc15e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:21.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.402+0000 7f79c2441640 1 --2- 172.21.15.53:0/999691365 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79bc0b3ac0 0x7f79bc15c450 unknown :-1 s=CLOSED pgs=2413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:21.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.402+0000 7f79c2441640 1 -- 172.21.15.53:0/999691365 >> 172.21.15.53:0/999691365 conn(0x7f79bc071790 msgr2=0x7f79bc0b6970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:21.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.402+0000 7f79c2441640 1 -- 172.21.15.53:0/999691365 shutdown_connections 2023-06-10T19:07:21.407 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:21.402+0000 7f79c2441640 1 -- 172.21.15.53:0/999691365 wait complete. 2023-06-10T19:07:21.422 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-10T19:07:21.422 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-10T19:07:21.422 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi053.front.sepia.ceph.com 2023-06-10T19:07:21.423 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-06-10T19:07:21.423 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-06-10T19:07:21.423 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-10T19:07:21.423 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-10T19:07:21.424 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-10T19:07:21.424 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-06-10T19:07:21.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:07:21.425 DEBUG:teuthology.orchestra.run.smithi053:> ip addr 2023-06-10T19:07:21.431 INFO:teuthology.orchestra.run.smithi053.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-10T19:07:21.431 INFO:teuthology.orchestra.run.smithi053.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-10T19:07:21.431 INFO:teuthology.orchestra.run.smithi053.stdout: inet 127.0.0.1/8 scope host lo 2023-06-10T19:07:21.431 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:07:21.432 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 ::1/128 scope host 2023-06-10T19:07:21.432 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:07:21.432 INFO:teuthology.orchestra.run.smithi053.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T19:07:21.432 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:da brd ff:ff:ff:ff:ff:ff 2023-06-10T19:07:21.432 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f0 2023-06-10T19:07:21.432 INFO:teuthology.orchestra.run.smithi053.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T19:07:21.432 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:db brd ff:ff:ff:ff:ff:ff 2023-06-10T19:07:21.433 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f1 2023-06-10T19:07:21.433 INFO:teuthology.orchestra.run.smithi053.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-10T19:07:21.433 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:18 brd ff:ff:ff:ff:ff:ff 2023-06-10T19:07:21.433 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f0 2023-06-10T19:07:21.433 INFO:teuthology.orchestra.run.smithi053.stdout: inet 172.21.15.53/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-06-10T19:07:21.433 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft 41608sec preferred_lft 41608sec 2023-06-10T19:07:21.433 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::ae1f:6bff:fef8:3718/64 scope link 2023-06-10T19:07:21.434 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:07:21.434 INFO:teuthology.orchestra.run.smithi053.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T19:07:21.434 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:19 brd ff:ff:ff:ff:ff:ff 2023-06-10T19:07:21.434 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f1 2023-06-10T19:07:21.434 INFO:teuthology.orchestra.run.smithi053.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-06-10T19:07:21.434 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 02:42:49:3d:ee:1e brd ff:ff:ff:ff:ff:ff 2023-06-10T19:07:21.434 INFO:teuthology.orchestra.run.smithi053.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-06-10T19:07:21.435 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:07:21.435 INFO:teuthology.orchestra.run.smithi053.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-10T19:07:21.435 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-06-10T19:07:21.435 INFO:teuthology.orchestra.run.smithi053.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-06-10T19:07:21.435 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:07:21.436 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-06-10T19:07:21.436 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:07:21.436 INFO:teuthology.orchestra.run.smithi053.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-10T19:07:21.436 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-06-10T19:07:21.436 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-06-10T19:07:21.436 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:07:21.437 INFO:teuthology.orchestra.run.smithi053.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-10T19:07:21.437 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-06-10T19:07:21.437 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-06-10T19:07:21.437 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:07:21.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:07:21.438 DEBUG:teuthology.orchestra.run.smithi053:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-10T19:07:21.485 INFO:teuthology.orchestra.run.smithi053.stdout:1 2023-06-10T19:07:21.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:07:21.487 DEBUG:teuthology.orchestra.run.smithi053:> route 2023-06-10T19:07:21.536 INFO:teuthology.orchestra.run.smithi053.stdout:Kernel IP routing table 2023-06-10T19:07:21.536 INFO:teuthology.orchestra.run.smithi053.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-10T19:07:21.536 INFO:teuthology.orchestra.run.smithi053.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-06-10T19:07:21.536 INFO:teuthology.orchestra.run.smithi053.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-06-10T19:07:21.537 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-06-10T19:07:21.537 INFO:teuthology.orchestra.run.smithi053.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-10T19:07:21.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:07:21.538 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec bash -c ' 2023-06-10T19:07:21.538 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2023-06-10T19:07:21.538 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-06-10T19:07:21.538 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-06-10T19:07:21.539 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-06-10T19:07:21.539 DEBUG:teuthology.orchestra.run.smithi053:> ') 2023-06-10T19:07:21.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:07:21.613 DEBUG:teuthology.orchestra.run.smithi053:> ip netns list 2023-06-10T19:07:21.659 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-06-10T19:07:21.659 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-06-10T19:07:21.659 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-06-10T19:07:21.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:07:21.660 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link set brx.0 up 2023-06-10T19:07:21.718 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-06-10T19:07:21.719 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-10T19:07:21.720 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-06-10T19:07:21.766 INFO:teuthology.orchestra.run.smithi053.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-06-10T19:07:21.767 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-10T19:07:21.767 DEBUG:teuthology.orchestra.run.smithi053:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-06-10T19:07:21.815 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2023-06-10T19:07:21.872 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T19:07:21.873 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T19:07:21.930 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T19:07:21.931 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T19:07:21.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:07:21.932 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2023-06-10T19:07:21.979 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-06-10T19:07:21.979 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-06-10T19:07:22.024 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2023-06-10T19:07:22.040 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T19:07:22.041 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T19:07:22.093 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T19:07:22.094 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T19:07:22.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:07:22.097 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2023-06-10T19:07:22.110 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:2023-06-10T19:07:22.106+0000 7fecadb24580 -1 init, newargv = 0x563f491c5d30 newargc=15 2023-06-10T19:07:22.111 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[68467]: starting ceph client 2023-06-10T19:07:22.116 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[68467]: starting fuse 2023-06-10T19:07:23.217 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2023-06-10T19:07:23.235 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T19:07:23.236 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T19:07:23.291 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T19:07:23.293 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T19:07:23.294 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:07:23.295 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2023-06-10T19:07:23.343 INFO:teuthology.orchestra.run.smithi053.stdout:45 2023-06-10T19:07:23.343 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-06-10T19:07:23.344 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-06-10T19:07:23.344 DEBUG:teuthology.orchestra.run.smithi053:> import glob 2023-06-10T19:07:23.344 DEBUG:teuthology.orchestra.run.smithi053:> import re 2023-06-10T19:07:23.345 DEBUG:teuthology.orchestra.run.smithi053:> import os 2023-06-10T19:07:23.345 DEBUG:teuthology.orchestra.run.smithi053:> import subprocess 2023-06-10T19:07:23.345 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:07:23.346 DEBUG:teuthology.orchestra.run.smithi053:> def _find_admin_socket(client_name): 2023-06-10T19:07:23.346 DEBUG:teuthology.orchestra.run.smithi053:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-06-10T19:07:23.346 DEBUG:teuthology.orchestra.run.smithi053:> files = glob.glob(asok_path) 2023-06-10T19:07:23.347 DEBUG:teuthology.orchestra.run.smithi053:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-06-10T19:07:23.347 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:07:23.347 DEBUG:teuthology.orchestra.run.smithi053:> # Given a non-glob path, it better be there 2023-06-10T19:07:23.347 DEBUG:teuthology.orchestra.run.smithi053:> if "*" not in asok_path: 2023-06-10T19:07:23.348 DEBUG:teuthology.orchestra.run.smithi053:> assert(len(files) == 1) 2023-06-10T19:07:23.348 DEBUG:teuthology.orchestra.run.smithi053:> return files[0] 2023-06-10T19:07:23.348 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:07:23.349 DEBUG:teuthology.orchestra.run.smithi053:> for f in files: 2023-06-10T19:07:23.349 DEBUG:teuthology.orchestra.run.smithi053:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-06-10T19:07:23.349 DEBUG:teuthology.orchestra.run.smithi053:> if os.path.exists("/proc/{0}".format(pid)): 2023-06-10T19:07:23.349 DEBUG:teuthology.orchestra.run.smithi053:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-06-10T19:07:23.350 DEBUG:teuthology.orchestra.run.smithi053:> contents = proc_f.read() 2023-06-10T19:07:23.350 DEBUG:teuthology.orchestra.run.smithi053:> if mountpoint in contents: 2023-06-10T19:07:23.350 DEBUG:teuthology.orchestra.run.smithi053:> return f 2023-06-10T19:07:23.351 DEBUG:teuthology.orchestra.run.smithi053:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-06-10T19:07:23.351 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:07:23.351 DEBUG:teuthology.orchestra.run.smithi053:> print(_find_admin_socket("client.0")) 2023-06-10T19:07:23.351 DEBUG:teuthology.orchestra.run.smithi053:> ' 2023-06-10T19:07:23.467 INFO:teuthology.orchestra.run.smithi053.stdout:/var/run/ceph/ceph-client.0.68467.asok 2023-06-10T19:07:23.649 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.68467.asok 2023-06-10T19:07:23.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:07:23.650 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.68467.asok status 2023-06-10T19:07:23.809 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-06-10T19:07:23.810 INFO:teuthology.orchestra.run.smithi053.stdout: "metadata": { 2023-06-10T19:07:23.810 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_sha1": "219d315c3a0b2075e570fb1964be2ad33fe7a9c8", 2023-06-10T19:07:23.810 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_version": "ceph version 18.0.0-4359-g219d315c (219d315c3a0b2075e570fb1964be2ad33fe7a9c8) reef (dev)", 2023-06-10T19:07:23.810 INFO:teuthology.orchestra.run.smithi053.stdout: "entity_id": "0", 2023-06-10T19:07:23.810 INFO:teuthology.orchestra.run.smithi053.stdout: "hostname": "smithi053", 2023-06-10T19:07:23.810 INFO:teuthology.orchestra.run.smithi053.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-06-10T19:07:23.811 INFO:teuthology.orchestra.run.smithi053.stdout: "pid": "68467", 2023-06-10T19:07:23.811 INFO:teuthology.orchestra.run.smithi053.stdout: "root": "/" 2023-06-10T19:07:23.811 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:07:23.811 INFO:teuthology.orchestra.run.smithi053.stdout: "dentry_count": 0, 2023-06-10T19:07:23.811 INFO:teuthology.orchestra.run.smithi053.stdout: "dentry_pinned_count": 0, 2023-06-10T19:07:23.811 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 10737, 2023-06-10T19:07:23.811 INFO:teuthology.orchestra.run.smithi053.stdout: "inst": { 2023-06-10T19:07:23.812 INFO:teuthology.orchestra.run.smithi053.stdout: "name": { 2023-06-10T19:07:23.812 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "client", 2023-06-10T19:07:23.812 INFO:teuthology.orchestra.run.smithi053.stdout: "num": 10737 2023-06-10T19:07:23.813 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:07:23.813 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": { 2023-06-10T19:07:23.813 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2023-06-10T19:07:23.813 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "192.168.0.1:0", 2023-06-10T19:07:23.813 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 4011987522 2023-06-10T19:07:23.813 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:07:23.813 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:07:23.813 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": { 2023-06-10T19:07:23.814 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2023-06-10T19:07:23.814 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "192.168.0.1:0", 2023-06-10T19:07:23.814 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 4011987522 2023-06-10T19:07:23.814 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:07:23.814 INFO:teuthology.orchestra.run.smithi053.stdout: "inst_str": "client.10737 192.168.0.1:0/4011987522", 2023-06-10T19:07:23.814 INFO:teuthology.orchestra.run.smithi053.stdout: "addr_str": "192.168.0.1:0/4011987522", 2023-06-10T19:07:23.815 INFO:teuthology.orchestra.run.smithi053.stdout: "inode_count": 1, 2023-06-10T19:07:23.815 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_epoch": 96, 2023-06-10T19:07:23.815 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_epoch": 167, 2023-06-10T19:07:23.815 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_epoch_barrier": 0, 2023-06-10T19:07:23.815 INFO:teuthology.orchestra.run.smithi053.stdout: "blocklisted": false, 2023-06-10T19:07:23.815 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs" 2023-06-10T19:07:23.815 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-06-10T19:07:23.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:07:23.824 DEBUG:teuthology.orchestra.run.smithi053:> stat --file-system '--printf=%T 2023-06-10T19:07:23.824 DEBUG:teuthology.orchestra.run.smithi053:> ' -- /home/ubuntu/cephtest/mnt.0 2023-06-10T19:07:23.830 INFO:teuthology.orchestra.run.smithi053.stdout:fuseblk 2023-06-10T19:07:23.831 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-06-10T19:07:23.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:07:23.831 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-06-10T19:07:23.887 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-10T19:07:24.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:24.050+0000 7f2d6b6e4640 1 Processor -- start 2023-06-10T19:07:24.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:24.050+0000 7f2d6b6e4640 1 -- start start 2023-06-10T19:07:24.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:24.054+0000 7f2d6b6e4640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2d6406c400 0x7f2d64157fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:24.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:24.054+0000 7f2d6b6e4640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2d640ccc90 0x7f2d640cd130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:24.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:24.054+0000 7f2d6b6e4640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d6415c260 con 0x7f2d6406c7d0 2023-06-10T19:07:24.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:24.054+0000 7f2d6b6e4640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d6415cee0 con 0x7f2d640ccc90 2023-06-10T19:07:24.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:24.054+0000 7f2d6b6e4640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d6415c540 con 0x7f2d6406c400 2023-06-10T19:07:24.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:24.054+0000 7f2d69c81640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2d640ccc90 0x7f2d640cd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:24.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:24.054+0000 7f2d69c81640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2d640ccc90 0x7f2d640cd130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42858/0 (socket says 172.21.15.53:42858) 2023-06-10T19:07:24.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:24.054+0000 7f2d69c81640 1 -- 172.21.15.53:0/1285658825 learned_addr learned my addr 172.21.15.53:0/1285658825 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:24.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:24.054+0000 7f2d69480640 1 --2- 172.21.15.53:0/1285658825 >> v2:172.21.15.117:3300/0 conn(0x7f2d6406c400 0x7f2d64157fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:24.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:24.054+0000 7f2d69c81640 1 -- 172.21.15.53:0/1285658825 >> v2:172.21.15.117:3300/0 conn(0x7f2d6406c400 msgr2=0x7f2d64157fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:24.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:24.054+0000 7f2d69c81640 1 --2- 172.21.15.53:0/1285658825 >> v2:172.21.15.117:3300/0 conn(0x7f2d6406c400 0x7f2d64157fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:24.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:24.054+0000 7f2d69c81640 1 -- 172.21.15.53:0/1285658825 >> v1:172.21.15.117:6789/0 conn(0x7f2d6406c7d0 legacy=0x7f2d64158520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:24.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:24.054+0000 7f2d69c81640 1 -- 172.21.15.53:0/1285658825 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d6415c820 con 0x7f2d640ccc90 2023-06-10T19:07:24.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:24.054+0000 7f2d69c81640 1 --2- 172.21.15.53:0/1285658825 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d640ccc90 0x7f2d640cd130 secure :-1 s=READY pgs=2417 cs=0 l=1 rev1=1 crypto rx=0x7f2d640b1910 tx=0x7f2d5c01ead0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d9d591fd418ec58 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:24.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:24.054+0000 7f2d5bfff640 1 -- 172.21.15.53:0/1285658825 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d5c00b2d0 con 0x7f2d640ccc90 2023-06-10T19:07:24.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:24.054+0000 7f2d5bfff640 1 -- 172.21.15.53:0/1285658825 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d5c00b430 con 0x7f2d640ccc90 2023-06-10T19:07:24.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:24.054+0000 7f2d5bfff640 1 -- 172.21.15.53:0/1285658825 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d5c0a79d0 con 0x7f2d640ccc90 2023-06-10T19:07:24.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:24.058+0000 7f2d6b6e4640 1 -- 172.21.15.53:0/1285658825 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d640ccc90 msgr2=0x7f2d640cd130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:24.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:24.058+0000 7f2d6b6e4640 1 --2- 172.21.15.53:0/1285658825 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d640ccc90 0x7f2d640cd130 secure :-1 s=READY pgs=2417 cs=0 l=1 rev1=1 crypto rx=0x7f2d640b1910 tx=0x7f2d5c01ead0 comp rx=0 tx=0).stop 2023-06-10T19:07:24.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:24.058+0000 7f2d6b6e4640 1 -- 172.21.15.53:0/1285658825 shutdown_connections 2023-06-10T19:07:24.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:24.058+0000 7f2d6b6e4640 1 --2- 172.21.15.53:0/1285658825 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d640ccc90 0x7f2d640cd130 unknown :-1 s=CLOSED pgs=2417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:24.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:24.058+0000 7f2d6b6e4640 1 --2- 172.21.15.53:0/1285658825 >> v2:172.21.15.117:3300/0 conn(0x7f2d6406c400 0x7f2d64157fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:24.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:24.058+0000 7f2d6b6e4640 1 -- 172.21.15.53:0/1285658825 >> 172.21.15.53:0/1285658825 conn(0x7f2d6406a560 msgr2=0x7f2d6406a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:24.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:24.058+0000 7f2d6b6e4640 1 -- 172.21.15.53:0/1285658825 shutdown_connections 2023-06-10T19:07:24.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:24.058+0000 7f2d6b6e4640 1 -- 172.21.15.53:0/1285658825 wait complete. 2023-06-10T19:07:24.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:24.058+0000 7f2d6b6e4640 1 Processor -- start 2023-06-10T19:07:24.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:24.058+0000 7f2d6b6e4640 1 -- start start 2023-06-10T19:07:24.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:24.058+0000 7f2d6b6e4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d6406c400 0x7f2d64146100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:24.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:24.058+0000 7f2d6b6e4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d6406c7d0 0x7f2d640b0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:24.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:24.058+0000 7f2d6b6e4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d640ccc90 0x7f2d640b0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:24.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:24.058+0000 7f2d6b6e4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d640aeec0 con 0x7f2d6406c7d0 2023-06-10T19:07:24.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:24.058+0000 7f2d6b6e4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d640c5700 con 0x7f2d640ccc90 2023-06-10T19:07:24.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:24.058+0000 7f2d6b6e4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d640ae900 con 0x7f2d6406c400 2023-06-10T19:07:24.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:24.058+0000 7f2d68c7f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d6406c7d0 0x7f2d640b0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:24.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:24.058+0000 7f2d68c7f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d6406c7d0 0x7f2d640b0330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42862/0 (socket says 172.21.15.53:42862) 2023-06-10T19:07:24.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:24.058+0000 7f2d68c7f640 1 -- 172.21.15.53:0/4169140904 learned_addr learned my addr 172.21.15.53:0/4169140904 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:24.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:24.058+0000 7f2d69480640 1 --2- 172.21.15.53:0/4169140904 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d6406c400 0x7f2d64146100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:24.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:24.058+0000 7f2d69c81640 1 --2- 172.21.15.53:0/4169140904 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d640ccc90 0x7f2d640b0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:24.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:24.058+0000 7f2d68c7f640 1 -- 172.21.15.53:0/4169140904 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d6406c400 msgr2=0x7f2d64146100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:24.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:24.058+0000 7f2d68c7f640 1 --2- 172.21.15.53:0/4169140904 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d6406c400 0x7f2d64146100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:24.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:24.058+0000 7f2d68c7f640 1 -- 172.21.15.53:0/4169140904 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d640ccc90 msgr2=0x7f2d640b0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:24.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:24.058+0000 7f2d68c7f640 1 --2- 172.21.15.53:0/4169140904 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d640ccc90 0x7f2d640b0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:24.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:24.058+0000 7f2d68c7f640 1 -- 172.21.15.53:0/4169140904 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d5c00bd40 con 0x7f2d6406c7d0 2023-06-10T19:07:24.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:24.058+0000 7f2d69c81640 1 --2- 172.21.15.53:0/4169140904 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d640ccc90 0x7f2d640b0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:07:24.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:24.058+0000 7f2d68c7f640 1 --2- 172.21.15.53:0/4169140904 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d6406c7d0 0x7f2d640b0330 secure :-1 s=READY pgs=2418 cs=0 l=1 rev1=1 crypto rx=0x7f2d5400c450 tx=0x7f2d5400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:24.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:24.062+0000 7f2d59ffb640 1 -- 172.21.15.53:0/4169140904 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d54012830 con 0x7f2d6406c7d0 2023-06-10T19:07:24.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:24.062+0000 7f2d59ffb640 1 -- 172.21.15.53:0/4169140904 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d540129b0 con 0x7f2d6406c7d0 2023-06-10T19:07:24.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:24.062+0000 7f2d6b6e4640 1 -- 172.21.15.53:0/4169140904 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d640aebe0 con 0x7f2d6406c7d0 2023-06-10T19:07:24.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:24.062+0000 7f2d59ffb640 1 -- 172.21.15.53:0/4169140904 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d54012d60 con 0x7f2d6406c7d0 2023-06-10T19:07:24.067 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:24.062+0000 7f2d6b6e4640 1 -- 172.21.15.53:0/4169140904 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d640c2d60 con 0x7f2d6406c7d0 2023-06-10T19:07:24.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:24.062+0000 7f2d6b6e4640 1 -- 172.21.15.53:0/4169140904 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d640cd130 con 0x7f2d6406c7d0 2023-06-10T19:07:24.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:24.062+0000 7f2d59ffb640 1 -- 172.21.15.53:0/4169140904 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2d5401c460 con 0x7f2d6406c7d0 2023-06-10T19:07:24.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:24.062+0000 7f2d59ffb640 1 --2- 172.21.15.53:0/4169140904 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2d48066280 0x7f2d48068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:24.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:24.062+0000 7f2d59ffb640 1 -- 172.21.15.53:0/4169140904 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2d54083b80 con 0x7f2d6406c7d0 2023-06-10T19:07:24.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:24.062+0000 7f2d69480640 1 --2- 172.21.15.53:0/4169140904 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2d48066280 0x7f2d48068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:24.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:24.062+0000 7f2d69480640 1 --2- 172.21.15.53:0/4169140904 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2d48066280 0x7f2d48068730 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f2d64153c70 tx=0x7f2d60008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:24.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:24.066+0000 7f2d59ffb640 1 -- 172.21.15.53:0/4169140904 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2d54051090 con 0x7f2d6406c7d0 2023-06-10T19:07:24.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:24.254+0000 7f2d6b6e4640 1 -- 172.21.15.53:0/4169140904 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2d6404d790 con 0x7f2d6406c7d0 2023-06-10T19:07:24.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:24.254+0000 7f2d59ffb640 1 -- 172.21.15.53:0/4169140904 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v96) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2d540546b0 con 0x7f2d6406c7d0 2023-06-10T19:07:24.257 INFO:teuthology.orchestra.run.smithi053.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-06-10T19:07:24.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:24.258+0000 7f2d6b6e4640 1 -- 172.21.15.53:0/4169140904 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2d48066280 msgr2=0x7f2d48068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:24.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:24.258+0000 7f2d6b6e4640 1 --2- 172.21.15.53:0/4169140904 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2d48066280 0x7f2d48068730 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f2d64153c70 tx=0x7f2d60008040 comp rx=0 tx=0).stop 2023-06-10T19:07:24.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:24.258+0000 7f2d6b6e4640 1 -- 172.21.15.53:0/4169140904 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d6406c7d0 msgr2=0x7f2d640b0330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:24.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:24.258+0000 7f2d6b6e4640 1 --2- 172.21.15.53:0/4169140904 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d6406c7d0 0x7f2d640b0330 secure :-1 s=READY pgs=2418 cs=0 l=1 rev1=1 crypto rx=0x7f2d5400c450 tx=0x7f2d5400c910 comp rx=0 tx=0).stop 2023-06-10T19:07:24.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:24.258+0000 7f2d6b6e4640 1 -- 172.21.15.53:0/4169140904 shutdown_connections 2023-06-10T19:07:24.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:24.258+0000 7f2d6b6e4640 1 --2- 172.21.15.53:0/4169140904 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2d48066280 0x7f2d48068730 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:24.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:24.258+0000 7f2d6b6e4640 1 --2- 172.21.15.53:0/4169140904 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d640ccc90 0x7f2d640b0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:24.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:24.258+0000 7f2d6b6e4640 1 --2- 172.21.15.53:0/4169140904 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d6406c7d0 0x7f2d640b0330 unknown :-1 s=CLOSED pgs=2418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:24.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:24.258+0000 7f2d6b6e4640 1 --2- 172.21.15.53:0/4169140904 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2d6406c400 0x7f2d64146100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:24.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:24.258+0000 7f2d6b6e4640 1 -- 172.21.15.53:0/4169140904 >> 172.21.15.53:0/4169140904 conn(0x7f2d6406a560 msgr2=0x7f2d64158100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:24.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:24.258+0000 7f2d6b6e4640 1 -- 172.21.15.53:0/4169140904 shutdown_connections 2023-06-10T19:07:24.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:24.258+0000 7f2d6b6e4640 1 -- 172.21.15.53:0/4169140904 wait complete. 2023-06-10T19:07:24.275 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-10T19:07:24.275 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-10T19:07:24.276 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi117.front.sepia.ceph.com 2023-06-10T19:07:24.276 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-06-10T19:07:24.276 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-06-10T19:07:24.277 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-10T19:07:24.277 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-10T19:07:24.278 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-10T19:07:24.278 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-06-10T19:07:24.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:07:24.280 DEBUG:teuthology.orchestra.run.smithi117:> ip addr 2023-06-10T19:07:24.287 INFO:teuthology.orchestra.run.smithi117.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-10T19:07:24.287 INFO:teuthology.orchestra.run.smithi117.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-10T19:07:24.287 INFO:teuthology.orchestra.run.smithi117.stdout: inet 127.0.0.1/8 scope host lo 2023-06-10T19:07:24.288 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:07:24.288 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 ::1/128 scope host 2023-06-10T19:07:24.288 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:07:24.288 INFO:teuthology.orchestra.run.smithi117.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T19:07:24.288 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8a brd ff:ff:ff:ff:ff:ff 2023-06-10T19:07:24.288 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f0 2023-06-10T19:07:24.288 INFO:teuthology.orchestra.run.smithi117.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T19:07:24.289 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8b brd ff:ff:ff:ff:ff:ff 2023-06-10T19:07:24.289 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f1 2023-06-10T19:07:24.289 INFO:teuthology.orchestra.run.smithi117.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T19:07:24.289 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:62 brd ff:ff:ff:ff:ff:ff 2023-06-10T19:07:24.289 INFO:teuthology.orchestra.run.smithi117.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-10T19:07:24.289 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:63 brd ff:ff:ff:ff:ff:ff 2023-06-10T19:07:24.289 INFO:teuthology.orchestra.run.smithi117.stdout: inet 172.21.15.117/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-06-10T19:07:24.289 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft 41605sec preferred_lft 41605sec 2023-06-10T19:07:24.290 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::ec4:7aff:fe8f:4463/64 scope link 2023-06-10T19:07:24.290 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:07:24.290 INFO:teuthology.orchestra.run.smithi117.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-06-10T19:07:24.290 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 02:42:f8:40:b2:dc brd ff:ff:ff:ff:ff:ff 2023-06-10T19:07:24.290 INFO:teuthology.orchestra.run.smithi117.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-06-10T19:07:24.290 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:07:24.290 INFO:teuthology.orchestra.run.smithi117.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-10T19:07:24.291 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-06-10T19:07:24.291 INFO:teuthology.orchestra.run.smithi117.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-06-10T19:07:24.291 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:07:24.291 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-06-10T19:07:24.291 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:07:24.291 INFO:teuthology.orchestra.run.smithi117.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-10T19:07:24.291 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-06-10T19:07:24.291 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-06-10T19:07:24.292 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:07:24.292 INFO:teuthology.orchestra.run.smithi117.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-10T19:07:24.292 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-06-10T19:07:24.292 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-06-10T19:07:24.292 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:07:24.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:07:24.293 DEBUG:teuthology.orchestra.run.smithi117:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-10T19:07:24.342 INFO:teuthology.orchestra.run.smithi117.stdout:1 2023-06-10T19:07:24.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:07:24.344 DEBUG:teuthology.orchestra.run.smithi117:> route 2023-06-10T19:07:24.398 INFO:teuthology.orchestra.run.smithi117.stdout:Kernel IP routing table 2023-06-10T19:07:24.399 INFO:teuthology.orchestra.run.smithi117.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-10T19:07:24.399 INFO:teuthology.orchestra.run.smithi117.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-06-10T19:07:24.399 INFO:teuthology.orchestra.run.smithi117.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-06-10T19:07:24.399 INFO:teuthology.orchestra.run.smithi117.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-06-10T19:07:24.399 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-06-10T19:07:24.399 INFO:teuthology.orchestra.run.smithi117.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-10T19:07:24.400 INFO:teuthology.orchestra.run.smithi117.stdout:ns2.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-10T19:07:24.400 INFO:teuthology.orchestra.run.smithi117.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-10T19:07:24.400 INFO:teuthology.orchestra.run.smithi117.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-10T19:07:24.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:07:24.401 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec bash -c ' 2023-06-10T19:07:24.401 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2023-06-10T19:07:24.401 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-06-10T19:07:24.402 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-06-10T19:07:24.402 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-06-10T19:07:24.402 DEBUG:teuthology.orchestra.run.smithi117:> ') 2023-06-10T19:07:24.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:07:24.479 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list 2023-06-10T19:07:24.528 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-06-10T19:07:24.528 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-06-10T19:07:24.529 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-06-10T19:07:24.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:07:24.529 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link set brx.0 up 2023-06-10T19:07:24.585 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-06-10T19:07:24.586 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-10T19:07:24.586 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-06-10T19:07:24.631 INFO:teuthology.orchestra.run.smithi117.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-06-10T19:07:24.632 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-10T19:07:24.632 DEBUG:teuthology.orchestra.run.smithi117:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-06-10T19:07:24.679 DEBUG:teuthology.orchestra.run.smithi117:> sudo modprobe fuse 2023-06-10T19:07:24.737 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T19:07:24.737 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T19:07:24.791 INFO:teuthology.orchestra.run.smithi117.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T19:07:24.792 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T19:07:24.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:07:24.793 DEBUG:teuthology.orchestra.run.smithi117:> ls /sys/fs/fuse/connections 2023-06-10T19:07:24.839 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-06-10T19:07:24.840 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-06-10T19:07:24.884 DEBUG:teuthology.orchestra.run.smithi117:> sudo modprobe fuse 2023-06-10T19:07:24.898 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T19:07:24.898 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T19:07:24.949 INFO:teuthology.orchestra.run.smithi117.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T19:07:24.950 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T19:07:24.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:07:24.951 DEBUG:teuthology.orchestra.run.smithi117:> ls /sys/fs/fuse/connections 2023-06-10T19:07:24.966 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi117.stderr:2023-06-10T19:07:24.960+0000 7f6e5b750580 -1 init, newargv = 0x55d551b08e60 newargc=15 2023-06-10T19:07:24.966 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi117.stderr:ceph-fuse[45815]: starting ceph client 2023-06-10T19:07:24.973 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi117.stderr:ceph-fuse[45815]: starting fuse 2023-06-10T19:07:26.071 DEBUG:teuthology.orchestra.run.smithi117:> sudo modprobe fuse 2023-06-10T19:07:26.087 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T19:07:26.088 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T19:07:26.147 INFO:teuthology.orchestra.run.smithi117.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T19:07:26.148 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T19:07:26.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:07:26.149 DEBUG:teuthology.orchestra.run.smithi117:> ls /sys/fs/fuse/connections 2023-06-10T19:07:26.195 INFO:teuthology.orchestra.run.smithi117.stdout:45 2023-06-10T19:07:26.195 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-06-10T19:07:26.195 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-06-10T19:07:26.196 DEBUG:teuthology.orchestra.run.smithi117:> import glob 2023-06-10T19:07:26.196 DEBUG:teuthology.orchestra.run.smithi117:> import re 2023-06-10T19:07:26.196 DEBUG:teuthology.orchestra.run.smithi117:> import os 2023-06-10T19:07:26.197 DEBUG:teuthology.orchestra.run.smithi117:> import subprocess 2023-06-10T19:07:26.197 DEBUG:teuthology.orchestra.run.smithi117:> 2023-06-10T19:07:26.197 DEBUG:teuthology.orchestra.run.smithi117:> def _find_admin_socket(client_name): 2023-06-10T19:07:26.198 DEBUG:teuthology.orchestra.run.smithi117:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-06-10T19:07:26.199 DEBUG:teuthology.orchestra.run.smithi117:> files = glob.glob(asok_path) 2023-06-10T19:07:26.199 DEBUG:teuthology.orchestra.run.smithi117:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-06-10T19:07:26.199 DEBUG:teuthology.orchestra.run.smithi117:> 2023-06-10T19:07:26.200 DEBUG:teuthology.orchestra.run.smithi117:> # Given a non-glob path, it better be there 2023-06-10T19:07:26.200 DEBUG:teuthology.orchestra.run.smithi117:> if "*" not in asok_path: 2023-06-10T19:07:26.200 DEBUG:teuthology.orchestra.run.smithi117:> assert(len(files) == 1) 2023-06-10T19:07:26.201 DEBUG:teuthology.orchestra.run.smithi117:> return files[0] 2023-06-10T19:07:26.201 DEBUG:teuthology.orchestra.run.smithi117:> 2023-06-10T19:07:26.201 DEBUG:teuthology.orchestra.run.smithi117:> for f in files: 2023-06-10T19:07:26.201 DEBUG:teuthology.orchestra.run.smithi117:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-06-10T19:07:26.202 DEBUG:teuthology.orchestra.run.smithi117:> if os.path.exists("/proc/{0}".format(pid)): 2023-06-10T19:07:26.202 DEBUG:teuthology.orchestra.run.smithi117:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-06-10T19:07:26.202 DEBUG:teuthology.orchestra.run.smithi117:> contents = proc_f.read() 2023-06-10T19:07:26.203 DEBUG:teuthology.orchestra.run.smithi117:> if mountpoint in contents: 2023-06-10T19:07:26.203 DEBUG:teuthology.orchestra.run.smithi117:> return f 2023-06-10T19:07:26.203 DEBUG:teuthology.orchestra.run.smithi117:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-06-10T19:07:26.203 DEBUG:teuthology.orchestra.run.smithi117:> 2023-06-10T19:07:26.204 DEBUG:teuthology.orchestra.run.smithi117:> print(_find_admin_socket("client.1")) 2023-06-10T19:07:26.204 DEBUG:teuthology.orchestra.run.smithi117:> ' 2023-06-10T19:07:26.316 INFO:teuthology.orchestra.run.smithi117.stdout:/var/run/ceph/ceph-client.1.45815.asok 2023-06-10T19:07:26.499 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.45815.asok 2023-06-10T19:07:26.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:07:26.501 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.45815.asok status 2023-06-10T19:07:26.660 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2023-06-10T19:07:26.661 INFO:teuthology.orchestra.run.smithi117.stdout: "metadata": { 2023-06-10T19:07:26.661 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_sha1": "219d315c3a0b2075e570fb1964be2ad33fe7a9c8", 2023-06-10T19:07:26.661 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_version": "ceph version 18.0.0-4359-g219d315c (219d315c3a0b2075e570fb1964be2ad33fe7a9c8) reef (dev)", 2023-06-10T19:07:26.661 INFO:teuthology.orchestra.run.smithi117.stdout: "entity_id": "1", 2023-06-10T19:07:26.661 INFO:teuthology.orchestra.run.smithi117.stdout: "hostname": "smithi117", 2023-06-10T19:07:26.661 INFO:teuthology.orchestra.run.smithi117.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-06-10T19:07:26.662 INFO:teuthology.orchestra.run.smithi117.stdout: "pid": "45815", 2023-06-10T19:07:26.662 INFO:teuthology.orchestra.run.smithi117.stdout: "root": "/" 2023-06-10T19:07:26.662 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-06-10T19:07:26.662 INFO:teuthology.orchestra.run.smithi117.stdout: "dentry_count": 0, 2023-06-10T19:07:26.662 INFO:teuthology.orchestra.run.smithi117.stdout: "dentry_pinned_count": 0, 2023-06-10T19:07:26.662 INFO:teuthology.orchestra.run.smithi117.stdout: "id": 8731, 2023-06-10T19:07:26.662 INFO:teuthology.orchestra.run.smithi117.stdout: "inst": { 2023-06-10T19:07:26.663 INFO:teuthology.orchestra.run.smithi117.stdout: "name": { 2023-06-10T19:07:26.663 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "client", 2023-06-10T19:07:26.663 INFO:teuthology.orchestra.run.smithi117.stdout: "num": 8731 2023-06-10T19:07:26.663 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-06-10T19:07:26.663 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": { 2023-06-10T19:07:26.663 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "v1", 2023-06-10T19:07:26.663 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": "192.168.0.1:0", 2023-06-10T19:07:26.663 INFO:teuthology.orchestra.run.smithi117.stdout: "nonce": 959085073 2023-06-10T19:07:26.664 INFO:teuthology.orchestra.run.smithi117.stdout: } 2023-06-10T19:07:26.664 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-06-10T19:07:26.665 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": { 2023-06-10T19:07:26.665 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "v1", 2023-06-10T19:07:26.665 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": "192.168.0.1:0", 2023-06-10T19:07:26.666 INFO:teuthology.orchestra.run.smithi117.stdout: "nonce": 959085073 2023-06-10T19:07:26.666 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-06-10T19:07:26.666 INFO:teuthology.orchestra.run.smithi117.stdout: "inst_str": "client.8731 192.168.0.1:0/959085073", 2023-06-10T19:07:26.666 INFO:teuthology.orchestra.run.smithi117.stdout: "addr_str": "192.168.0.1:0/959085073", 2023-06-10T19:07:26.666 INFO:teuthology.orchestra.run.smithi117.stdout: "inode_count": 1, 2023-06-10T19:07:26.666 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_epoch": 96, 2023-06-10T19:07:26.666 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_epoch": 167, 2023-06-10T19:07:26.666 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_epoch_barrier": 0, 2023-06-10T19:07:26.667 INFO:teuthology.orchestra.run.smithi117.stdout: "blocklisted": false, 2023-06-10T19:07:26.667 INFO:teuthology.orchestra.run.smithi117.stdout: "fs_name": "cephfs" 2023-06-10T19:07:26.667 INFO:teuthology.orchestra.run.smithi117.stdout:} 2023-06-10T19:07:26.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:07:26.676 DEBUG:teuthology.orchestra.run.smithi117:> stat --file-system '--printf=%T 2023-06-10T19:07:26.677 DEBUG:teuthology.orchestra.run.smithi117:> ' -- /home/ubuntu/cephtest/mnt.1 2023-06-10T19:07:26.683 INFO:teuthology.orchestra.run.smithi117.stdout:fuseblk 2023-06-10T19:07:26.683 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-06-10T19:07:26.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:07:26.684 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-06-10T19:07:26.739 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config get mds_reconnect_timeout 2023-06-10T19:07:26.884 INFO:teuthology.orchestra.run.smithi053.stdout:{"mds_reconnect_timeout":"45.000000"} 2023-06-10T19:07:26.885 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_reconnect_timeout": "45.000000" } 2023-06-10T19:07:26.885 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config get ms_max_backoff 2023-06-10T19:07:27.022 INFO:teuthology.orchestra.run.smithi053.stdout:{"ms_max_backoff":"15.000000"} 2023-06-10T19:07:27.023 DEBUG:tasks.cephfs.filesystem:_json_asok output { "ms_max_backoff": "15.000000" } 2023-06-10T19:07:27.023 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T19:07:27.024 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:07:27.030 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:07:27.150 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.150+0000 7fb49e8b6640 1 Processor -- start 2023-06-10T19:07:27.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.150+0000 7fb49e8b6640 1 -- start start 2023-06-10T19:07:27.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.150+0000 7fb49e8b6640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb4980aca20 0x7fb4981668b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:27.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.150+0000 7fb49e8b6640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4981600d0 con 0x7fb4980cb870 2023-06-10T19:07:27.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.150+0000 7fb49e8b6640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb498160370 con 0x7fb4980c9750 2023-06-10T19:07:27.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.150+0000 7fb49e8b6640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4980cd990 con 0x7fb4980aca20 2023-06-10T19:07:27.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.150+0000 7fb49ce53640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb4980aca20 0x7fb4981668b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:27.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.150+0000 7fb49ce53640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb4980aca20 0x7fb4981668b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42864/0 (socket says 172.21.15.53:42864) 2023-06-10T19:07:27.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.150+0000 7fb49ce53640 1 -- 172.21.15.53:0/1470558858 learned_addr learned my addr 172.21.15.53:0/1470558858 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:27.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.150+0000 7fb4977fe640 1 --1- 172.21.15.53:0/1470558858 >> v1:172.21.15.53:6789/0 conn(0x7fb4980cb870 0x7fb4980af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:42692/0 (socket says 172.21.15.53:42692) 2023-06-10T19:07:27.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.150+0000 7fb49ce53640 1 -- 172.21.15.53:0/1470558858 >> v1:172.21.15.117:6789/0 conn(0x7fb4980c9750 legacy=0x7fb4980aced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:27.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.150+0000 7fb49ce53640 1 -- 172.21.15.53:0/1470558858 >> v1:172.21.15.53:6789/0 conn(0x7fb4980cb870 legacy=0x7fb4980af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:27.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.150+0000 7fb496ffd640 1 -- 172.21.15.53:0/1470558858 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2599247003 0 0) 0x7fb4981600d0 con 0x7fb4980cb870 2023-06-10T19:07:27.154 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.150+0000 7fb49ce53640 1 -- 172.21.15.53:0/1470558858 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4980cd5b0 con 0x7fb4980aca20 2023-06-10T19:07:27.154 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.154+0000 7fb49ce53640 1 --2- 172.21.15.53:0/1470558858 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb4980aca20 0x7fb4981668b0 secure :-1 s=READY pgs=2420 cs=0 l=1 rev1=1 crypto rx=0x7fb490009870 tx=0x7fb49001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=257bf3484352d48f server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:27.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.154+0000 7fb496ffd640 1 -- 172.21.15.53:0/1470558858 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4900ab650 con 0x7fb4980aca20 2023-06-10T19:07:27.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.154+0000 7fb496ffd640 1 -- 172.21.15.53:0/1470558858 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4900ab7b0 con 0x7fb4980aca20 2023-06-10T19:07:27.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.154+0000 7fb496ffd640 1 -- 172.21.15.53:0/1470558858 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4900abb40 con 0x7fb4980aca20 2023-06-10T19:07:27.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.154+0000 7fb49e8b6640 1 -- 172.21.15.53:0/1470558858 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb4980aca20 msgr2=0x7fb4981668b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:27.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.154+0000 7fb49e8b6640 1 --2- 172.21.15.53:0/1470558858 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb4980aca20 0x7fb4981668b0 secure :-1 s=READY pgs=2420 cs=0 l=1 rev1=1 crypto rx=0x7fb490009870 tx=0x7fb49001c540 comp rx=0 tx=0).stop 2023-06-10T19:07:27.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.154+0000 7fb49e8b6640 1 -- 172.21.15.53:0/1470558858 shutdown_connections 2023-06-10T19:07:27.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.154+0000 7fb49e8b6640 1 --2- 172.21.15.53:0/1470558858 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb4980aca20 0x7fb4981668b0 unknown :-1 s=CLOSED pgs=2420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:27.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.154+0000 7fb49e8b6640 1 -- 172.21.15.53:0/1470558858 >> 172.21.15.53:0/1470558858 conn(0x7fb49806a0d0 msgr2=0x7fb4980ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:27.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.154+0000 7fb49e8b6640 1 -- 172.21.15.53:0/1470558858 shutdown_connections 2023-06-10T19:07:27.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.154+0000 7fb49e8b6640 1 -- 172.21.15.53:0/1470558858 wait complete. 2023-06-10T19:07:27.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.154+0000 7fb49e8b6640 1 Processor -- start 2023-06-10T19:07:27.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.154+0000 7fb49e8b6640 1 -- start start 2023-06-10T19:07:27.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.154+0000 7fb49e8b6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb4980c9750 0x7fb498155330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:27.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.154+0000 7fb49e8b6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb4980cb870 0x7fb498156400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:27.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.154+0000 7fb49e8b6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb49815d670 0x7fb49815daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:27.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.154+0000 7fb49e8b6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb498155870 con 0x7fb4980cb870 2023-06-10T19:07:27.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.154+0000 7fb49e8b6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb49815e030 con 0x7fb4980c9750 2023-06-10T19:07:27.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.154+0000 7fb49e8b6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb498156940 con 0x7fb49815d670 2023-06-10T19:07:27.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.154+0000 7fb4977fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb4980cb870 0x7fb498156400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:27.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.154+0000 7fb4977fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb4980cb870 0x7fb498156400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42876/0 (socket says 172.21.15.53:42876) 2023-06-10T19:07:27.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.154+0000 7fb4977fe640 1 -- 172.21.15.53:0/2497781121 learned_addr learned my addr 172.21.15.53:0/2497781121 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:27.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.154+0000 7fb497fff640 1 --2- 172.21.15.53:0/2497781121 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb4980c9750 0x7fb498155330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:27.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.154+0000 7fb49ce53640 1 --2- 172.21.15.53:0/2497781121 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb49815d670 0x7fb49815daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:27.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.154+0000 7fb4977fe640 1 -- 172.21.15.53:0/2497781121 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb49815d670 msgr2=0x7fb49815daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:27.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.154+0000 7fb4977fe640 1 --2- 172.21.15.53:0/2497781121 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb49815d670 0x7fb49815daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:27.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.154+0000 7fb4977fe640 1 -- 172.21.15.53:0/2497781121 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb4980c9750 msgr2=0x7fb498155330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:27.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.154+0000 7fb4977fe640 1 --2- 172.21.15.53:0/2497781121 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb4980c9750 0x7fb498155330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:27.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.154+0000 7fb4977fe640 1 -- 172.21.15.53:0/2497781121 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4900094d0 con 0x7fb4980cb870 2023-06-10T19:07:27.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.154+0000 7fb4977fe640 1 --2- 172.21.15.53:0/2497781121 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb4980cb870 0x7fb498156400 secure :-1 s=READY pgs=2421 cs=0 l=1 rev1=1 crypto rx=0x7fb48c0011f0 tx=0x7fb48c00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:27.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.158+0000 7fb494ff9640 1 -- 172.21.15.53:0/2497781121 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb48c0074e0 con 0x7fb4980cb870 2023-06-10T19:07:27.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.158+0000 7fb494ff9640 1 -- 172.21.15.53:0/2497781121 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb48c007640 con 0x7fb4980cb870 2023-06-10T19:07:27.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.158+0000 7fb49e8b6640 1 -- 172.21.15.53:0/2497781121 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb49815a620 con 0x7fb4980cb870 2023-06-10T19:07:27.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.158+0000 7fb494ff9640 1 -- 172.21.15.53:0/2497781121 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb48c004a10 con 0x7fb4980cb870 2023-06-10T19:07:27.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.158+0000 7fb49e8b6640 1 -- 172.21.15.53:0/2497781121 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb49815abe0 con 0x7fb4980cb870 2023-06-10T19:07:27.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.158+0000 7fb49e8b6640 1 -- 172.21.15.53:0/2497781121 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb49804d790 con 0x7fb4980cb870 2023-06-10T19:07:27.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.158+0000 7fb494ff9640 1 -- 172.21.15.53:0/2497781121 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb48c004b70 con 0x7fb4980cb870 2023-06-10T19:07:27.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.158+0000 7fb494ff9640 1 --2- 172.21.15.53:0/2497781121 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb484066280 0x7fb484068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:27.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.158+0000 7fb494ff9640 1 -- 172.21.15.53:0/2497781121 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb48c082fd0 con 0x7fb4980cb870 2023-06-10T19:07:27.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.158+0000 7fb497fff640 1 --2- 172.21.15.53:0/2497781121 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb484066280 0x7fb484068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:27.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.158+0000 7fb497fff640 1 --2- 172.21.15.53:0/2497781121 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb484066280 0x7fb484068730 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fb498157cc0 tx=0x7fb488009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:27.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.162+0000 7fb494ff9640 1 -- 172.21.15.53:0/2497781121 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb48c0504e0 con 0x7fb4980cb870 2023-06-10T19:07:27.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.318+0000 7fb49e8b6640 1 -- 172.21.15.53:0/2497781121 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb4980b0680 con 0x7fb4980cb870 2023-06-10T19:07:27.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.322+0000 7fb494ff9640 1 -- 172.21.15.53:0/2497781121 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v167) v1 ==== 74+0+18281 (secure 0 0 0) 0x7fb48c018020 con 0x7fb4980cb870 2023-06-10T19:07:27.323 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:07:27.323 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":167,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:07:16.727942+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-06-10T19:07:13.365954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"166","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-06-10T19:07:14.695077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:07:27.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.322+0000 7fb49e8b6640 1 -- 172.21.15.53:0/2497781121 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb484066280 msgr2=0x7fb484068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:27.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.322+0000 7fb49e8b6640 1 --2- 172.21.15.53:0/2497781121 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb484066280 0x7fb484068730 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fb498157cc0 tx=0x7fb488009040 comp rx=0 tx=0).stop 2023-06-10T19:07:27.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.322+0000 7fb49e8b6640 1 -- 172.21.15.53:0/2497781121 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb4980cb870 msgr2=0x7fb498156400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:27.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.322+0000 7fb49e8b6640 1 --2- 172.21.15.53:0/2497781121 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb4980cb870 0x7fb498156400 secure :-1 s=READY pgs=2421 cs=0 l=1 rev1=1 crypto rx=0x7fb48c0011f0 tx=0x7fb48c00c9b0 comp rx=0 tx=0).stop 2023-06-10T19:07:27.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.322+0000 7fb49e8b6640 1 -- 172.21.15.53:0/2497781121 shutdown_connections 2023-06-10T19:07:27.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.322+0000 7fb49e8b6640 1 --2- 172.21.15.53:0/2497781121 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb484066280 0x7fb484068730 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:27.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.322+0000 7fb49e8b6640 1 --2- 172.21.15.53:0/2497781121 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb49815d670 0x7fb49815daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:27.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.322+0000 7fb49e8b6640 1 --2- 172.21.15.53:0/2497781121 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb4980cb870 0x7fb498156400 unknown :-1 s=CLOSED pgs=2421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:27.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.322+0000 7fb49e8b6640 1 --2- 172.21.15.53:0/2497781121 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb4980c9750 0x7fb498155330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:27.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.322+0000 7fb49e8b6640 1 -- 172.21.15.53:0/2497781121 >> 172.21.15.53:0/2497781121 conn(0x7fb49806a0d0 msgr2=0x7fb49806fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:27.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.322+0000 7fb49e8b6640 1 -- 172.21.15.53:0/2497781121 shutdown_connections 2023-06-10T19:07:27.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.322+0000 7fb49e8b6640 1 -- 172.21.15.53:0/2497781121 wait complete. 2023-06-10T19:07:27.341 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-10T18:52:33.633114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-10T18:52:39.171487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 23, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-10T19:07:13.365954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '166', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 24, 'pool_name': 'cephfs_data', 'create_time': '2023-06-10T19:07:14.695077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '167', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-10T19:07:27.348 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-10T19:07:27.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.478+0000 7f54796df640 1 Processor -- start 2023-06-10T19:07:27.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.478+0000 7f54796df640 1 -- start start 2023-06-10T19:07:27.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.478+0000 7f54796df640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5474159a20 0x7f547415de90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:27.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.478+0000 7f54796df640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f547406a900 0x7f54740ca070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:27.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.478+0000 7f54796df640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5474069610 con 0x7f5474069aa0 2023-06-10T19:07:27.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.478+0000 7f54796df640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54740b4020 con 0x7f5474159a20 2023-06-10T19:07:27.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.478+0000 7f54796df640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f547406ad80 con 0x7f547406a900 2023-06-10T19:07:27.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.478+0000 7f5472ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5474159a20 0x7f547415de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:27.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.478+0000 7f5472ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5474159a20 0x7f547415de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42878/0 (socket says 172.21.15.53:42878) 2023-06-10T19:07:27.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.478+0000 7f5472ffd640 1 -- 172.21.15.53:0/3786903491 learned_addr learned my addr 172.21.15.53:0/3786903491 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:27.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.478+0000 7f54737fe640 1 --1- 172.21.15.53:0/3786903491 >> v1:172.21.15.53:6789/0 conn(0x7f5474069aa0 0x7f5474069f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:42700/0 (socket says 172.21.15.53:42700) 2023-06-10T19:07:27.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.478+0000 7f54727fc640 1 --2- 172.21.15.53:0/3786903491 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f547406a900 0x7f54740ca070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:27.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.478+0000 7f5472ffd640 1 -- 172.21.15.53:0/3786903491 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f547406a900 msgr2=0x7f54740ca070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:27.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.478+0000 7f5472ffd640 1 --2- 172.21.15.53:0/3786903491 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f547406a900 0x7f54740ca070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:27.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.478+0000 7f5472ffd640 1 -- 172.21.15.53:0/3786903491 >> v1:172.21.15.53:6789/0 conn(0x7f5474069aa0 legacy=0x7f5474069f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:27.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.478+0000 7f5471ffb640 1 -- 172.21.15.53:0/3786903491 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 728808935 0 0) 0x7f5474069610 con 0x7f5474069aa0 2023-06-10T19:07:27.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.478+0000 7f5472ffd640 1 -- 172.21.15.53:0/3786903491 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5474159df0 con 0x7f5474159a20 2023-06-10T19:07:27.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.482+0000 7f5472ffd640 1 --2- 172.21.15.53:0/3786903491 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5474159a20 0x7f547415de90 secure :-1 s=READY pgs=2423 cs=0 l=1 rev1=1 crypto rx=0x7f5464006fd0 tx=0x7f546401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e7f98c5dc11453c server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:27.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.482+0000 7f5471ffb640 1 -- 172.21.15.53:0/3786903491 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54640aa5f0 con 0x7f5474159a20 2023-06-10T19:07:27.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.482+0000 7f5471ffb640 1 -- 172.21.15.53:0/3786903491 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54640aa750 con 0x7f5474159a20 2023-06-10T19:07:27.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.482+0000 7f5471ffb640 1 -- 172.21.15.53:0/3786903491 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54640aaae0 con 0x7f5474159a20 2023-06-10T19:07:27.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.482+0000 7f54796df640 1 -- 172.21.15.53:0/3786903491 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5474159a20 msgr2=0x7f547415de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:27.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.482+0000 7f54796df640 1 --2- 172.21.15.53:0/3786903491 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5474159a20 0x7f547415de90 secure :-1 s=READY pgs=2423 cs=0 l=1 rev1=1 crypto rx=0x7f5464006fd0 tx=0x7f546401c490 comp rx=0 tx=0).stop 2023-06-10T19:07:27.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.482+0000 7f54796df640 1 -- 172.21.15.53:0/3786903491 shutdown_connections 2023-06-10T19:07:27.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.482+0000 7f54796df640 1 --2- 172.21.15.53:0/3786903491 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f547406a900 0x7f54740ca070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:27.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.482+0000 7f54796df640 1 --2- 172.21.15.53:0/3786903491 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5474159a20 0x7f547415de90 unknown :-1 s=CLOSED pgs=2423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:27.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.482+0000 7f54796df640 1 -- 172.21.15.53:0/3786903491 >> 172.21.15.53:0/3786903491 conn(0x7f54740b00a0 msgr2=0x7f54740b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:27.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.482+0000 7f54796df640 1 -- 172.21.15.53:0/3786903491 shutdown_connections 2023-06-10T19:07:27.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.482+0000 7f54796df640 1 -- 172.21.15.53:0/3786903491 wait complete. 2023-06-10T19:07:27.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.482+0000 7f54796df640 1 Processor -- start 2023-06-10T19:07:27.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.482+0000 7f54796df640 1 -- start start 2023-06-10T19:07:27.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.486+0000 7f54796df640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5474069aa0 0x7f54741f4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:27.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.486+0000 7f54796df640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f547406a900 0x7f54740cc120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:27.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.486+0000 7f54796df640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5474159a20 0x7f5474151980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:27.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.486+0000 7f54796df640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54740cd540 con 0x7f5474159a20 2023-06-10T19:07:27.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.486+0000 7f54796df640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54740cc660 con 0x7f5474069aa0 2023-06-10T19:07:27.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.486+0000 7f54796df640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54740cc930 con 0x7f547406a900 2023-06-10T19:07:27.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.486+0000 7f54737fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5474159a20 0x7f5474151980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:27.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.486+0000 7f54737fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5474159a20 0x7f5474151980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42882/0 (socket says 172.21.15.53:42882) 2023-06-10T19:07:27.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.486+0000 7f54737fe640 1 -- 172.21.15.53:0/320649065 learned_addr learned my addr 172.21.15.53:0/320649065 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:27.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.486+0000 7f5472ffd640 1 --2- 172.21.15.53:0/320649065 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5474069aa0 0x7f54741f4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:27.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.486+0000 7f54737fe640 1 -- 172.21.15.53:0/320649065 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f547406a900 msgr2=0x7f54740cc120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:27.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.486+0000 7f54737fe640 1 --2- 172.21.15.53:0/320649065 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f547406a900 0x7f54740cc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:27.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.486+0000 7f54737fe640 1 -- 172.21.15.53:0/320649065 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5474069aa0 msgr2=0x7f54741f4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:27.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.486+0000 7f54737fe640 1 --2- 172.21.15.53:0/320649065 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5474069aa0 0x7f54741f4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:27.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.486+0000 7f54737fe640 1 -- 172.21.15.53:0/320649065 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5464009480 con 0x7f5474159a20 2023-06-10T19:07:27.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.486+0000 7f5472ffd640 1 --2- 172.21.15.53:0/320649065 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5474069aa0 0x7f54741f4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:07:27.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.486+0000 7f54737fe640 1 --2- 172.21.15.53:0/320649065 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5474159a20 0x7f5474151980 secure :-1 s=READY pgs=2424 cs=0 l=1 rev1=1 crypto rx=0x7f546c00c780 tx=0x7f546c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:27.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.486+0000 7f545b7fe640 1 -- 172.21.15.53:0/320649065 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546c00ce90 con 0x7f5474159a20 2023-06-10T19:07:27.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.486+0000 7f545b7fe640 1 -- 172.21.15.53:0/320649065 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f546c00a640 con 0x7f5474159a20 2023-06-10T19:07:27.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.486+0000 7f54796df640 1 -- 172.21.15.53:0/320649065 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54740ccc10 con 0x7f5474159a20 2023-06-10T19:07:27.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.486+0000 7f545b7fe640 1 -- 172.21.15.53:0/320649065 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546c00a9d0 con 0x7f5474159a20 2023-06-10T19:07:27.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.486+0000 7f54796df640 1 -- 172.21.15.53:0/320649065 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54740cd1d0 con 0x7f5474159a20 2023-06-10T19:07:27.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.486+0000 7f54796df640 1 -- 172.21.15.53:0/320649065 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54740cd6f0 con 0x7f5474159a20 2023-06-10T19:07:27.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.486+0000 7f545b7fe640 1 -- 172.21.15.53:0/320649065 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f546c00ab30 con 0x7f5474159a20 2023-06-10T19:07:27.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.486+0000 7f545b7fe640 1 --2- 172.21.15.53:0/320649065 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f54600662b0 0x7f5460068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:27.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.486+0000 7f545b7fe640 1 -- 172.21.15.53:0/320649065 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f546c0834f0 con 0x7f5474159a20 2023-06-10T19:07:27.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.486+0000 7f5472ffd640 1 --2- 172.21.15.53:0/320649065 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f54600662b0 0x7f5460068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:27.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.490+0000 7f5472ffd640 1 --2- 172.21.15.53:0/320649065 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f54600662b0 0x7f5460068760 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f54640ae000 tx=0x7f54640a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:27.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.490+0000 7f545b7fe640 1 -- 172.21.15.53:0/320649065 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f54740cd6f0 con 0x7f5474159a20 2023-06-10T19:07:27.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.646+0000 7f54796df640 1 -- 172.21.15.53:0/320649065 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f547404d790 con 0x7f5474159a20 2023-06-10T19:07:27.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.646+0000 7f545b7fe640 1 -- 172.21.15.53:0/320649065 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v167) v1 ==== 93+0+10 (secure 0 0 0) 0x7f546c050970 con 0x7f5474159a20 2023-06-10T19:07:27.650 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-06-10T19:07:27.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.650+0000 7f54796df640 1 -- 172.21.15.53:0/320649065 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f54600662b0 msgr2=0x7f5460068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:27.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.650+0000 7f54796df640 1 --2- 172.21.15.53:0/320649065 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f54600662b0 0x7f5460068760 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f54640ae000 tx=0x7f54640a7000 comp rx=0 tx=0).stop 2023-06-10T19:07:27.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.650+0000 7f54796df640 1 -- 172.21.15.53:0/320649065 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5474159a20 msgr2=0x7f5474151980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:27.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.650+0000 7f54796df640 1 --2- 172.21.15.53:0/320649065 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5474159a20 0x7f5474151980 secure :-1 s=READY pgs=2424 cs=0 l=1 rev1=1 crypto rx=0x7f546c00c780 tx=0x7f546c00cc40 comp rx=0 tx=0).stop 2023-06-10T19:07:27.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.650+0000 7f54796df640 1 -- 172.21.15.53:0/320649065 shutdown_connections 2023-06-10T19:07:27.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.650+0000 7f54796df640 1 --2- 172.21.15.53:0/320649065 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f54600662b0 0x7f5460068760 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:27.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.650+0000 7f54796df640 1 --2- 172.21.15.53:0/320649065 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5474159a20 0x7f5474151980 unknown :-1 s=CLOSED pgs=2424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:27.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.650+0000 7f54796df640 1 --2- 172.21.15.53:0/320649065 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f547406a900 0x7f54740cc120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:27.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.650+0000 7f54796df640 1 --2- 172.21.15.53:0/320649065 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5474069aa0 0x7f54741f4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:27.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.650+0000 7f54796df640 1 -- 172.21.15.53:0/320649065 >> 172.21.15.53:0/320649065 conn(0x7f54740b00a0 msgr2=0x7f5474155730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:27.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.650+0000 7f54796df640 1 -- 172.21.15.53:0/320649065 shutdown_connections 2023-06-10T19:07:27.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.650+0000 7f54796df640 1 -- 172.21.15.53:0/320649065 wait complete. 2023-06-10T19:07:27.669 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-10T19:07:27.801 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.798+0000 7fd688b8e640 1 Processor -- start 2023-06-10T19:07:27.802 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.798+0000 7fd688b8e640 1 -- start start 2023-06-10T19:07:27.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.802+0000 7fd688b8e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd684159b20 0x7fd6840cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:27.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.802+0000 7fd688b8e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd6840ce120 0x7fd68406f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:27.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.802+0000 7fd688b8e640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6840ce620 con 0x7fd68406eca0 2023-06-10T19:07:27.804 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.802+0000 7fd688b8e640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd68406f680 con 0x7fd684159b20 2023-06-10T19:07:27.804 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.802+0000 7fd688b8e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6840cbb30 con 0x7fd6840ce120 2023-06-10T19:07:27.804 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.802+0000 7fd681d9b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fd68406eca0 0x7fd6840cda10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:42710/0 (socket says 172.21.15.53:42710) 2023-06-10T19:07:27.804 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.802+0000 7fd68259c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd684159b20 0x7fd6840cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:27.804 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.802+0000 7fd681d9b640 1 -- 172.21.15.53:0/1350031085 learned_addr learned my addr 172.21.15.53:0/1350031085 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:07:27.804 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.802+0000 7fd682d9d640 1 --2- 172.21.15.53:0/1350031085 >> v2:172.21.15.117:3300/0 conn(0x7fd6840ce120 0x7fd68406f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:27.805 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.802+0000 7fd68259c640 1 -- 172.21.15.53:0/1350031085 >> v2:172.21.15.117:3300/0 conn(0x7fd6840ce120 msgr2=0x7fd68406f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:27.805 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.802+0000 7fd68259c640 1 --2- 172.21.15.53:0/1350031085 >> v2:172.21.15.117:3300/0 conn(0x7fd6840ce120 0x7fd68406f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:27.805 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.802+0000 7fd68159a640 1 -- 172.21.15.53:0/1350031085 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3677167947 0 0) 0x7fd6840ce620 con 0x7fd68406eca0 2023-06-10T19:07:27.805 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.802+0000 7fd68259c640 1 -- 172.21.15.53:0/1350031085 >> v1:172.21.15.53:6789/0 conn(0x7fd68406eca0 legacy=0x7fd6840cda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:27.805 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.802+0000 7fd68259c640 1 -- 172.21.15.53:0/1350031085 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6840ce900 con 0x7fd684159b20 2023-06-10T19:07:27.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.806+0000 7fd68259c640 1 --2- 172.21.15.53:0/1350031085 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd684159b20 0x7fd6840cf6c0 secure :-1 s=READY pgs=2426 cs=0 l=1 rev1=1 crypto rx=0x7fd6840b5f90 tx=0x7fd67401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5efabaf0c224c4b0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:27.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.806+0000 7fd68159a640 1 -- 172.21.15.53:0/1350031085 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd674004230 con 0x7fd684159b20 2023-06-10T19:07:27.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.806+0000 7fd68159a640 1 -- 172.21.15.53:0/1350031085 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6740a7050 con 0x7fd684159b20 2023-06-10T19:07:27.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.806+0000 7fd68159a640 1 -- 172.21.15.53:0/1350031085 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd674003620 con 0x7fd684159b20 2023-06-10T19:07:27.809 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.806+0000 7fd688b8e640 1 -- 172.21.15.53:0/1350031085 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd684159b20 msgr2=0x7fd6840cf6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:27.809 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.806+0000 7fd688b8e640 1 --2- 172.21.15.53:0/1350031085 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd684159b20 0x7fd6840cf6c0 secure :-1 s=READY pgs=2426 cs=0 l=1 rev1=1 crypto rx=0x7fd6840b5f90 tx=0x7fd67401c460 comp rx=0 tx=0).stop 2023-06-10T19:07:27.809 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.806+0000 7fd688b8e640 1 -- 172.21.15.53:0/1350031085 shutdown_connections 2023-06-10T19:07:27.809 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.806+0000 7fd688b8e640 1 --2- 172.21.15.53:0/1350031085 >> v2:172.21.15.117:3300/0 conn(0x7fd6840ce120 0x7fd68406f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:27.809 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.806+0000 7fd688b8e640 1 --2- 172.21.15.53:0/1350031085 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd684159b20 0x7fd6840cf6c0 unknown :-1 s=CLOSED pgs=2426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:27.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.806+0000 7fd688b8e640 1 -- 172.21.15.53:0/1350031085 >> 172.21.15.53:0/1350031085 conn(0x7fd68406a0e0 msgr2=0x7fd68406d270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:27.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.806+0000 7fd688b8e640 1 -- 172.21.15.53:0/1350031085 shutdown_connections 2023-06-10T19:07:27.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.806+0000 7fd688b8e640 1 -- 172.21.15.53:0/1350031085 wait complete. 2023-06-10T19:07:27.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.806+0000 7fd688b8e640 1 Processor -- start 2023-06-10T19:07:27.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.806+0000 7fd688b8e640 1 -- start start 2023-06-10T19:07:27.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.810+0000 7fd688b8e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd68406eca0 0x7fd684159f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:27.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.810+0000 7fd688b8e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6840ce120 0x7fd684150750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:27.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.810+0000 7fd688b8e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd684159b20 0x7fd684149820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:27.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.810+0000 7fd688b8e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd68414eb10 con 0x7fd6840ce120 2023-06-10T19:07:27.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.810+0000 7fd688b8e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd68414fb70 con 0x7fd68406eca0 2023-06-10T19:07:27.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.810+0000 7fd688b8e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd68414edb0 con 0x7fd684159b20 2023-06-10T19:07:27.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.810+0000 7fd681d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6840ce120 0x7fd684150750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:27.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.810+0000 7fd681d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6840ce120 0x7fd684150750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42900/0 (socket says 172.21.15.53:42900) 2023-06-10T19:07:27.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.810+0000 7fd681d9b640 1 -- 172.21.15.53:0/3003646878 learned_addr learned my addr 172.21.15.53:0/3003646878 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:27.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.810+0000 7fd68259c640 1 --2- 172.21.15.53:0/3003646878 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd68406eca0 0x7fd684159f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:27.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.810+0000 7fd682d9d640 1 --2- 172.21.15.53:0/3003646878 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd684159b20 0x7fd684149820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:27.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.810+0000 7fd681d9b640 1 -- 172.21.15.53:0/3003646878 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd684159b20 msgr2=0x7fd684149820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:27.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.810+0000 7fd681d9b640 1 --2- 172.21.15.53:0/3003646878 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd684159b20 0x7fd684149820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:27.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.810+0000 7fd681d9b640 1 -- 172.21.15.53:0/3003646878 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd68406eca0 msgr2=0x7fd684159f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:27.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.810+0000 7fd681d9b640 1 --2- 172.21.15.53:0/3003646878 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd68406eca0 0x7fd684159f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:27.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.810+0000 7fd681d9b640 1 -- 172.21.15.53:0/3003646878 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd674009420 con 0x7fd6840ce120 2023-06-10T19:07:27.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.810+0000 7fd681d9b640 1 --2- 172.21.15.53:0/3003646878 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6840ce120 0x7fd684150750 secure :-1 s=READY pgs=2427 cs=0 l=1 rev1=1 crypto rx=0x7fd6780011f0 tx=0x7fd67800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:27.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.810+0000 7fd672ffd640 1 -- 172.21.15.53:0/3003646878 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6780074e0 con 0x7fd6840ce120 2023-06-10T19:07:27.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.810+0000 7fd672ffd640 1 -- 172.21.15.53:0/3003646878 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd678007640 con 0x7fd6840ce120 2023-06-10T19:07:27.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.810+0000 7fd688b8e640 1 -- 172.21.15.53:0/3003646878 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd68414f090 con 0x7fd6840ce120 2023-06-10T19:07:27.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.810+0000 7fd672ffd640 1 -- 172.21.15.53:0/3003646878 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd678004a10 con 0x7fd6840ce120 2023-06-10T19:07:27.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.810+0000 7fd688b8e640 1 -- 172.21.15.53:0/3003646878 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd68414f650 con 0x7fd6840ce120 2023-06-10T19:07:27.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.810+0000 7fd688b8e640 1 -- 172.21.15.53:0/3003646878 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd68414f840 con 0x7fd6840ce120 2023-06-10T19:07:27.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.810+0000 7fd672ffd640 1 -- 172.21.15.53:0/3003646878 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd678004b70 con 0x7fd6840ce120 2023-06-10T19:07:27.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.810+0000 7fd672ffd640 1 --2- 172.21.15.53:0/3003646878 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd664066280 0x7fd664068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:27.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.810+0000 7fd672ffd640 1 -- 172.21.15.53:0/3003646878 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd678083380 con 0x7fd6840ce120 2023-06-10T19:07:27.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.810+0000 7fd68259c640 1 --2- 172.21.15.53:0/3003646878 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd664066280 0x7fd664068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:27.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.814+0000 7fd68259c640 1 --2- 172.21.15.53:0/3003646878 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd664066280 0x7fd664068730 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fd6740ad000 tx=0x7fd674008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:27.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.814+0000 7fd672ffd640 1 -- 172.21.15.53:0/3003646878 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd678050760 con 0x7fd6840ce120 2023-06-10T19:07:27.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.974+0000 7fd688b8e640 1 -- 172.21.15.53:0/3003646878 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd68404d790 con 0x7fd6840ce120 2023-06-10T19:07:27.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.974+0000 7fd672ffd640 1 -- 172.21.15.53:0/3003646878 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v167) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd678053d80 con 0x7fd6840ce120 2023-06-10T19:07:27.976 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-06-10T19:07:27.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.974+0000 7fd688b8e640 1 -- 172.21.15.53:0/3003646878 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd664066280 msgr2=0x7fd664068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:27.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.974+0000 7fd688b8e640 1 --2- 172.21.15.53:0/3003646878 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd664066280 0x7fd664068730 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fd6740ad000 tx=0x7fd674008040 comp rx=0 tx=0).stop 2023-06-10T19:07:27.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.974+0000 7fd688b8e640 1 -- 172.21.15.53:0/3003646878 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6840ce120 msgr2=0x7fd684150750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:27.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.974+0000 7fd688b8e640 1 --2- 172.21.15.53:0/3003646878 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6840ce120 0x7fd684150750 secure :-1 s=READY pgs=2427 cs=0 l=1 rev1=1 crypto rx=0x7fd6780011f0 tx=0x7fd67800c9b0 comp rx=0 tx=0).stop 2023-06-10T19:07:27.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.974+0000 7fd688b8e640 1 -- 172.21.15.53:0/3003646878 shutdown_connections 2023-06-10T19:07:27.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.974+0000 7fd688b8e640 1 --2- 172.21.15.53:0/3003646878 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd664066280 0x7fd664068730 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:27.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.974+0000 7fd688b8e640 1 --2- 172.21.15.53:0/3003646878 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd684159b20 0x7fd684149820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:27.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.974+0000 7fd688b8e640 1 --2- 172.21.15.53:0/3003646878 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6840ce120 0x7fd684150750 unknown :-1 s=CLOSED pgs=2427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:27.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.974+0000 7fd688b8e640 1 --2- 172.21.15.53:0/3003646878 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd68406eca0 0x7fd684159f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:27.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.974+0000 7fd688b8e640 1 -- 172.21.15.53:0/3003646878 >> 172.21.15.53:0/3003646878 conn(0x7fd68406a0e0 msgr2=0x7fd684157840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:27.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.974+0000 7fd688b8e640 1 -- 172.21.15.53:0/3003646878 shutdown_connections 2023-06-10T19:07:27.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:27.974+0000 7fd688b8e640 1 -- 172.21.15.53:0/3003646878 wait complete. 2023-06-10T19:07:27.994 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-10T19:07:28.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.122+0000 7f24a1c6c640 1 Processor -- start 2023-06-10T19:07:28.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.122+0000 7f24a1c6c640 1 -- start start 2023-06-10T19:07:28.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.122+0000 7f24a1c6c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f249c159630 0x7f249c15d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:28.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.122+0000 7f24a1c6c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f249c0ad730 0x7f249c0713a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:28.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.122+0000 7f24a1c6c640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f249c070f10 con 0x7f249c0718e0 2023-06-10T19:07:28.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.122+0000 7f24a1c6c640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f249c15db60 con 0x7f249c159630 2023-06-10T19:07:28.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.122+0000 7f24a1c6c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f249c15de40 con 0x7f249c0ad730 2023-06-10T19:07:28.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.122+0000 7f249b7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f249c159630 0x7f249c15d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:28.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.122+0000 7f249b7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f249c159630 0x7f249c15d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42914/0 (socket says 172.21.15.53:42914) 2023-06-10T19:07:28.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.122+0000 7f249b7fe640 1 -- 172.21.15.53:0/2321902181 learned_addr learned my addr 172.21.15.53:0/2321902181 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:28.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.122+0000 7f249affd640 1 --2- 172.21.15.53:0/2321902181 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f249c0ad730 0x7f249c0713a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:28.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.122+0000 7f249b7fe640 1 -- 172.21.15.53:0/2321902181 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f249c0ad730 msgr2=0x7f249c0713a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:28.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.122+0000 7f249b7fe640 1 --2- 172.21.15.53:0/2321902181 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f249c0ad730 0x7f249c0713a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:28.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.122+0000 7f249b7fe640 1 -- 172.21.15.53:0/2321902181 >> v1:172.21.15.117:6789/0 conn(0x7f249c0718e0 legacy=0x7f249c069450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:28.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.122+0000 7f249b7fe640 1 -- 172.21.15.53:0/2321902181 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f249c15e120 con 0x7f249c159630 2023-06-10T19:07:28.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.122+0000 7f249affd640 1 --2- 172.21.15.53:0/2321902181 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f249c0ad730 0x7f249c0713a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:07:28.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.126+0000 7f249b7fe640 1 --2- 172.21.15.53:0/2321902181 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f249c159630 0x7f249c15d260 secure :-1 s=READY pgs=2428 cs=0 l=1 rev1=1 crypto rx=0x7f2494009e50 tx=0x7f249401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6feb1d5da9ff1092 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:28.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.126+0000 7f249a7fc640 1 -- 172.21.15.53:0/2321902181 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24940a5730 con 0x7f249c159630 2023-06-10T19:07:28.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.126+0000 7f249a7fc640 1 -- 172.21.15.53:0/2321902181 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24940a5890 con 0x7f249c159630 2023-06-10T19:07:28.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.126+0000 7f249a7fc640 1 -- 172.21.15.53:0/2321902181 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24940a5c20 con 0x7f249c159630 2023-06-10T19:07:28.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.126+0000 7f24a1c6c640 1 -- 172.21.15.53:0/2321902181 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f249c159630 msgr2=0x7f249c15d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:28.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.126+0000 7f24a1c6c640 1 --2- 172.21.15.53:0/2321902181 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f249c159630 0x7f249c15d260 secure :-1 s=READY pgs=2428 cs=0 l=1 rev1=1 crypto rx=0x7f2494009e50 tx=0x7f249401c9a0 comp rx=0 tx=0).stop 2023-06-10T19:07:28.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.126+0000 7f24a1c6c640 1 -- 172.21.15.53:0/2321902181 shutdown_connections 2023-06-10T19:07:28.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.126+0000 7f24a1c6c640 1 --2- 172.21.15.53:0/2321902181 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f249c0ad730 0x7f249c0713a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:28.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.126+0000 7f24a1c6c640 1 --2- 172.21.15.53:0/2321902181 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f249c159630 0x7f249c15d260 unknown :-1 s=CLOSED pgs=2428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:28.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.126+0000 7f24a1c6c640 1 -- 172.21.15.53:0/2321902181 >> 172.21.15.53:0/2321902181 conn(0x7f249c0cafc0 msgr2=0x7f249c0cb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:28.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.126+0000 7f24a1c6c640 1 -- 172.21.15.53:0/2321902181 shutdown_connections 2023-06-10T19:07:28.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.126+0000 7f24a1c6c640 1 -- 172.21.15.53:0/2321902181 wait complete. 2023-06-10T19:07:28.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.126+0000 7f24a1c6c640 1 Processor -- start 2023-06-10T19:07:28.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.126+0000 7f24a1c6c640 1 -- start start 2023-06-10T19:07:28.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.130+0000 7f24a1c6c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f249c0718e0 0x7f249c0c5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:28.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.130+0000 7f24a1c6c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f249c0ad730 0x7f249c154aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:28.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.130+0000 7f24a1c6c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f249c159630 0x7f249c0c9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:28.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.130+0000 7f24a1c6c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f249c15d020 con 0x7f249c0ad730 2023-06-10T19:07:28.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.130+0000 7f24a1c6c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f249c154610 con 0x7f249c159630 2023-06-10T19:07:28.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.130+0000 7f24a1c6c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f249c15d200 con 0x7f249c0718e0 2023-06-10T19:07:28.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.130+0000 7f249affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f249c0ad730 0x7f249c154aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:28.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.130+0000 7f249affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f249c0ad730 0x7f249c154aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42918/0 (socket says 172.21.15.53:42918) 2023-06-10T19:07:28.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.130+0000 7f249affd640 1 -- 172.21.15.53:0/527798934 learned_addr learned my addr 172.21.15.53:0/527798934 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:28.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.130+0000 7f249b7fe640 1 --2- 172.21.15.53:0/527798934 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f249c0718e0 0x7f249c0c5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:28.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.130+0000 7f249bfff640 1 --2- 172.21.15.53:0/527798934 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f249c159630 0x7f249c0c9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:28.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.130+0000 7f249affd640 1 -- 172.21.15.53:0/527798934 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f249c0718e0 msgr2=0x7f249c0c5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:28.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.130+0000 7f249affd640 1 --2- 172.21.15.53:0/527798934 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f249c0718e0 0x7f249c0c5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:28.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.130+0000 7f249affd640 1 -- 172.21.15.53:0/527798934 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f249c159630 msgr2=0x7f249c0c9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:28.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.130+0000 7f249affd640 1 --2- 172.21.15.53:0/527798934 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f249c159630 0x7f249c0c9490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:28.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.130+0000 7f249affd640 1 -- 172.21.15.53:0/527798934 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2494009b30 con 0x7f249c0ad730 2023-06-10T19:07:28.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.130+0000 7f249bfff640 1 --2- 172.21.15.53:0/527798934 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f249c159630 0x7f249c0c9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:07:28.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.130+0000 7f249affd640 1 --2- 172.21.15.53:0/527798934 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f249c0ad730 0x7f249c154aa0 secure :-1 s=READY pgs=2429 cs=0 l=1 rev1=1 crypto rx=0x7f248400c7c0 tx=0x7f248400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:28.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.130+0000 7f2493fff640 1 -- 172.21.15.53:0/527798934 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2484007a30 con 0x7f249c0ad730 2023-06-10T19:07:28.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.130+0000 7f2493fff640 1 -- 172.21.15.53:0/527798934 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2484007b90 con 0x7f249c0ad730 2023-06-10T19:07:28.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.130+0000 7f24a1c6c640 1 -- 172.21.15.53:0/527798934 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f249c15d4c0 con 0x7f249c0ad730 2023-06-10T19:07:28.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.130+0000 7f2493fff640 1 -- 172.21.15.53:0/527798934 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f248400ce70 con 0x7f249c0ad730 2023-06-10T19:07:28.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.130+0000 7f24a1c6c640 1 -- 172.21.15.53:0/527798934 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f249c0c99d0 con 0x7f249c0ad730 2023-06-10T19:07:28.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.130+0000 7f24a1c6c640 1 -- 172.21.15.53:0/527798934 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f249c0cbd00 con 0x7f249c0ad730 2023-06-10T19:07:28.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.130+0000 7f2493fff640 1 -- 172.21.15.53:0/527798934 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f24840193f0 con 0x7f249c0ad730 2023-06-10T19:07:28.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.130+0000 7f2493fff640 1 --2- 172.21.15.53:0/527798934 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f247c0662b0 0x7f247c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:28.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.130+0000 7f2493fff640 1 -- 172.21.15.53:0/527798934 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f24840841a0 con 0x7f249c0ad730 2023-06-10T19:07:28.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.130+0000 7f249b7fe640 1 --2- 172.21.15.53:0/527798934 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f247c0662b0 0x7f247c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:28.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.134+0000 7f249b7fe640 1 --2- 172.21.15.53:0/527798934 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f247c0662b0 0x7f247c068760 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f24940ae000 tx=0x7f24940a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:28.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.134+0000 7f2493fff640 1 -- 172.21.15.53:0/527798934 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2484051620 con 0x7f249c0ad730 2023-06-10T19:07:28.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.282+0000 7f24a1c6c640 1 -- 172.21.15.53:0/527798934 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f249c1547a0 con 0x7f249c0ad730 2023-06-10T19:07:28.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.282+0000 7f2493fff640 1 -- 172.21.15.53:0/527798934 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v167) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2484054c40 con 0x7f249c0ad730 2023-06-10T19:07:28.283 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-06-10T19:07:28.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.282+0000 7f24a1c6c640 1 -- 172.21.15.53:0/527798934 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f247c0662b0 msgr2=0x7f247c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:28.285 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.282+0000 7f24a1c6c640 1 --2- 172.21.15.53:0/527798934 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f247c0662b0 0x7f247c068760 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f24940ae000 tx=0x7f24940a7070 comp rx=0 tx=0).stop 2023-06-10T19:07:28.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.282+0000 7f24a1c6c640 1 -- 172.21.15.53:0/527798934 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f249c0ad730 msgr2=0x7f249c154aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:28.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.282+0000 7f24a1c6c640 1 --2- 172.21.15.53:0/527798934 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f249c0ad730 0x7f249c154aa0 secure :-1 s=READY pgs=2429 cs=0 l=1 rev1=1 crypto rx=0x7f248400c7c0 tx=0x7f248400cc80 comp rx=0 tx=0).stop 2023-06-10T19:07:28.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.282+0000 7f24a1c6c640 1 -- 172.21.15.53:0/527798934 shutdown_connections 2023-06-10T19:07:28.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.282+0000 7f24a1c6c640 1 --2- 172.21.15.53:0/527798934 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f247c0662b0 0x7f247c068760 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:28.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.282+0000 7f24a1c6c640 1 --2- 172.21.15.53:0/527798934 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f249c159630 0x7f249c0c9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:28.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.282+0000 7f24a1c6c640 1 --2- 172.21.15.53:0/527798934 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f249c0ad730 0x7f249c154aa0 unknown :-1 s=CLOSED pgs=2429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:28.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.282+0000 7f24a1c6c640 1 --2- 172.21.15.53:0/527798934 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f249c0718e0 0x7f249c0c5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:28.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.282+0000 7f24a1c6c640 1 -- 172.21.15.53:0/527798934 >> 172.21.15.53:0/527798934 conn(0x7f249c0cafc0 msgr2=0x7f249c069450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:28.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.282+0000 7f24a1c6c640 1 -- 172.21.15.53:0/527798934 shutdown_connections 2023-06-10T19:07:28.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.282+0000 7f24a1c6c640 1 -- 172.21.15.53:0/527798934 wait complete. 2023-06-10T19:07:28.301 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-10T19:07:28.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.410+0000 7f85081e5640 1 Processor -- start 2023-06-10T19:07:28.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.410+0000 7f85081e5640 1 -- start start 2023-06-10T19:07:28.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.414+0000 7f85081e5640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f85001558e0 0x7f85000c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:28.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.414+0000 7f85081e5640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f850006c230 con 0x7f8500158f40 2023-06-10T19:07:28.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.414+0000 7f85081e5640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f850006ca40 con 0x7f850006b6e0 2023-06-10T19:07:28.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.414+0000 7f85081e5640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8500155cb0 con 0x7f85001558e0 2023-06-10T19:07:28.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.414+0000 7f8505780640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f8500158f40 0x7f85000cb820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:42718/0 (socket says 172.21.15.53:42718) 2023-06-10T19:07:28.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.414+0000 7f8505780640 1 -- 172.21.15.53:0/665146249 learned_addr learned my addr 172.21.15.53:0/665146249 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:07:28.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.414+0000 7f8505f81640 1 --2- 172.21.15.53:0/665146249 >> v2:172.21.15.117:3300/0 conn(0x7f85001558e0 0x7f85000c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:28.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.414+0000 7f8504f7f640 1 -- 172.21.15.53:0/665146249 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3332612945 0 0) 0x7f850006c230 con 0x7f8500158f40 2023-06-10T19:07:28.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.414+0000 7f8504f7f640 1 -- 172.21.15.53:0/665146249 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84ec003530 con 0x7f8500158f40 2023-06-10T19:07:28.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.414+0000 7f8504f7f640 1 -- 172.21.15.53:0/665146249 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 885139579 0 0) 0x7f84ec003530 con 0x7f8500158f40 2023-06-10T19:07:28.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.414+0000 7f8504f7f640 1 -- 172.21.15.53:0/665146249 >> v2:172.21.15.117:3300/0 conn(0x7f85001558e0 msgr2=0x7f85000c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:28.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.414+0000 7f8504f7f640 1 --2- 172.21.15.53:0/665146249 >> v2:172.21.15.117:3300/0 conn(0x7f85001558e0 0x7f85000c82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:28.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.414+0000 7f8504f7f640 1 -- 172.21.15.53:0/665146249 >> v1:172.21.15.117:6789/0 conn(0x7f850006b6e0 legacy=0x7f850006bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:28.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.414+0000 7f8504f7f640 1 -- 172.21.15.53:0/665146249 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f850006c480 con 0x7f8500158f40 2023-06-10T19:07:28.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.414+0000 7f8504f7f640 1 -- 172.21.15.53:0/665146249 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f84f0001680 con 0x7f8500158f40 2023-06-10T19:07:28.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.414+0000 7f8504f7f640 1 -- 172.21.15.53:0/665146249 >> v1:172.21.15.53:6789/0 conn(0x7f8500158f40 legacy=0x7f85000cb820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:28.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.414+0000 7f8504f7f640 1 --2- 172.21.15.53:0/665146249 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f84ec003980 0x7f84ec003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:28.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.414+0000 7f8504f7f640 1 --2- 172.21.15.53:0/665146249 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84ec0047d0 0x7f84ec004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:28.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.414+0000 7f8504f7f640 1 --2- 172.21.15.53:0/665146249 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84ec0052a0 0x7f84ec00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:28.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.414+0000 7f8504f7f640 1 -- 172.21.15.53:0/665146249 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8500155cb0 con 0x7f84ec0052a0 2023-06-10T19:07:28.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.414+0000 7f8504f7f640 1 -- 172.21.15.53:0/665146249 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84ec00c1d0 con 0x7f84ec0047d0 2023-06-10T19:07:28.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.414+0000 7f8504f7f640 1 -- 172.21.15.53:0/665146249 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84ec00c390 con 0x7f84ec003980 2023-06-10T19:07:28.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.414+0000 7f8506782640 1 --2- 172.21.15.53:0/665146249 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84ec0052a0 0x7f84ec00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:28.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.414+0000 7f8505f81640 1 --2- 172.21.15.53:0/665146249 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f84ec003980 0x7f84ec003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:28.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.414+0000 7f8505780640 1 --2- 172.21.15.53:0/665146249 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84ec0047d0 0x7f84ec004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:28.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.414+0000 7f8506782640 1 -- 172.21.15.53:0/665146249 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f84ec003980 msgr2=0x7f84ec003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:28.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.414+0000 7f8506782640 1 --2- 172.21.15.53:0/665146249 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f84ec003980 0x7f84ec003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:28.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.414+0000 7f8506782640 1 -- 172.21.15.53:0/665146249 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84ec0047d0 msgr2=0x7f84ec004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:28.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.414+0000 7f8506782640 1 --2- 172.21.15.53:0/665146249 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84ec0047d0 0x7f84ec004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:28.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.414+0000 7f8506782640 1 -- 172.21.15.53:0/665146249 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84ec003530 con 0x7f84ec0052a0 2023-06-10T19:07:28.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.414+0000 7f8505780640 1 --2- 172.21.15.53:0/665146249 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84ec0047d0 0x7f84ec004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:07:28.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.414+0000 7f8506782640 1 -- 172.21.15.53:0/665146249 reap_dead start 2023-06-10T19:07:28.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.418+0000 7f8506782640 1 --2- 172.21.15.53:0/665146249 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84ec0052a0 0x7f84ec00b990 secure :-1 s=READY pgs=2431 cs=0 l=1 rev1=1 crypto rx=0x7f84f8001780 tx=0x7f84f801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8253bba7053d0480 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:28.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.418+0000 7f8504f7f640 1 -- 172.21.15.53:0/665146249 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f80052d0 con 0x7f84ec0052a0 2023-06-10T19:07:28.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.418+0000 7f8504f7f640 1 -- 172.21.15.53:0/665146249 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f80a7050 con 0x7f84ec0052a0 2023-06-10T19:07:28.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.418+0000 7f8504f7f640 1 -- 172.21.15.53:0/665146249 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f8003840 con 0x7f84ec0052a0 2023-06-10T19:07:28.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.418+0000 7f85081e5640 1 -- 172.21.15.53:0/665146249 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84ec0052a0 msgr2=0x7f84ec00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:28.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.418+0000 7f85081e5640 1 --2- 172.21.15.53:0/665146249 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84ec0052a0 0x7f84ec00b990 secure :-1 s=READY pgs=2431 cs=0 l=1 rev1=1 crypto rx=0x7f84f8001780 tx=0x7f84f801c3d0 comp rx=0 tx=0).stop 2023-06-10T19:07:28.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.418+0000 7f85081e5640 1 -- 172.21.15.53:0/665146249 shutdown_connections 2023-06-10T19:07:28.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.418+0000 7f85081e5640 1 --2- 172.21.15.53:0/665146249 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84ec0052a0 0x7f84ec00b990 unknown :-1 s=CLOSED pgs=2431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:28.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.418+0000 7f85081e5640 1 -- 172.21.15.53:0/665146249 >> 172.21.15.53:0/665146249 conn(0x7f850006a0e0 msgr2=0x7f85000cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:28.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.418+0000 7f85081e5640 1 -- 172.21.15.53:0/665146249 shutdown_connections 2023-06-10T19:07:28.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.418+0000 7f85081e5640 1 -- 172.21.15.53:0/665146249 wait complete. 2023-06-10T19:07:28.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.418+0000 7f85081e5640 1 Processor -- start 2023-06-10T19:07:28.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.418+0000 7f85081e5640 1 -- start start 2023-06-10T19:07:28.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.418+0000 7f85081e5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84ec0052a0 0x7f85000b36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:28.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.418+0000 7f85081e5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f850014b150 0x7f85000b0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:28.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.418+0000 7f85081e5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85000c3e10 0x7f850006ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:28.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.418+0000 7f85081e5640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85000b1050 con 0x7f85000c3e10 2023-06-10T19:07:28.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.418+0000 7f85081e5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f850014b650 con 0x7f84ec0052a0 2023-06-10T19:07:28.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.418+0000 7f85081e5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f850014b930 con 0x7f850014b150 2023-06-10T19:07:28.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.418+0000 7f8506782640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85000c3e10 0x7f850006ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:28.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.418+0000 7f8506782640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85000c3e10 0x7f850006ff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42934/0 (socket says 172.21.15.53:42934) 2023-06-10T19:07:28.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.418+0000 7f8506782640 1 -- 172.21.15.53:0/57675998 learned_addr learned my addr 172.21.15.53:0/57675998 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:28.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.418+0000 7f8505f81640 1 --2- 172.21.15.53:0/57675998 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84ec0052a0 0x7f85000b36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:28.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.418+0000 7f8505780640 1 --2- 172.21.15.53:0/57675998 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f850014b150 0x7f85000b0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:28.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.418+0000 7f8506782640 1 -- 172.21.15.53:0/57675998 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f850014b150 msgr2=0x7f85000b0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:28.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.418+0000 7f8506782640 1 --2- 172.21.15.53:0/57675998 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f850014b150 0x7f85000b0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:28.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.418+0000 7f8506782640 1 -- 172.21.15.53:0/57675998 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84ec0052a0 msgr2=0x7f85000b36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:28.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.418+0000 7f8506782640 1 --2- 172.21.15.53:0/57675998 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84ec0052a0 0x7f85000b36d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:28.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.418+0000 7f8506782640 1 -- 172.21.15.53:0/57675998 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f850014bc10 con 0x7f85000c3e10 2023-06-10T19:07:28.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.418+0000 7f8505f81640 1 --2- 172.21.15.53:0/57675998 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84ec0052a0 0x7f85000b36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:07:28.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.418+0000 7f8505780640 1 --2- 172.21.15.53:0/57675998 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f850014b150 0x7f85000b0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:07:28.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.418+0000 7f8506782640 1 --2- 172.21.15.53:0/57675998 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85000c3e10 0x7f850006ff10 secure :-1 s=READY pgs=2432 cs=0 l=1 rev1=1 crypto rx=0x7f84f801c200 tx=0x7f84ec005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:28.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.418+0000 7f84f67fc640 1 -- 172.21.15.53:0/57675998 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f80b0070 con 0x7f85000c3e10 2023-06-10T19:07:28.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.422+0000 7f84f67fc640 1 -- 172.21.15.53:0/57675998 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f80050d0 con 0x7f85000c3e10 2023-06-10T19:07:28.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.422+0000 7f85081e5640 1 -- 172.21.15.53:0/57675998 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f850014bef0 con 0x7f85000c3e10 2023-06-10T19:07:28.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.422+0000 7f84f67fc640 1 -- 172.21.15.53:0/57675998 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f8003600 con 0x7f85000c3e10 2023-06-10T19:07:28.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.422+0000 7f85081e5640 1 -- 172.21.15.53:0/57675998 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f850015aac0 con 0x7f85000c3e10 2023-06-10T19:07:28.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.422+0000 7f85081e5640 1 -- 172.21.15.53:0/57675998 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f850004d790 con 0x7f85000c3e10 2023-06-10T19:07:28.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.422+0000 7f84f67fc640 1 -- 172.21.15.53:0/57675998 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f84f8003760 con 0x7f85000c3e10 2023-06-10T19:07:28.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.422+0000 7f84f67fc640 1 --2- 172.21.15.53:0/57675998 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f84e40662b0 0x7f84e4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:28.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.422+0000 7f84f67fc640 1 -- 172.21.15.53:0/57675998 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f84f811c4c0 con 0x7f85000c3e10 2023-06-10T19:07:28.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.422+0000 7f8505f81640 1 --2- 172.21.15.53:0/57675998 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f84e40662b0 0x7f84e4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:28.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.422+0000 7f8505f81640 1 --2- 172.21.15.53:0/57675998 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f84e40662b0 0x7f84e4068760 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f84fc00a260 tx=0x7f84fc00a040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:28.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.426+0000 7f84f67fc640 1 -- 172.21.15.53:0/57675998 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f84f80e9940 con 0x7f85000c3e10 2023-06-10T19:07:28.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.578+0000 7f85081e5640 1 -- 172.21.15.53:0/57675998 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f850014c3a0 con 0x7f85000c3e10 2023-06-10T19:07:28.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.578+0000 7f84f67fc640 1 -- 172.21.15.53:0/57675998 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v167) v1 ==== 100+0+11 (secure 0 0 0) 0x7f84f80ecf60 con 0x7f85000c3e10 2023-06-10T19:07:28.587 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-06-10T19:07:28.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.582+0000 7f85081e5640 1 -- 172.21.15.53:0/57675998 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f84e40662b0 msgr2=0x7f84e4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:28.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.582+0000 7f85081e5640 1 --2- 172.21.15.53:0/57675998 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f84e40662b0 0x7f84e4068760 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f84fc00a260 tx=0x7f84fc00a040 comp rx=0 tx=0).stop 2023-06-10T19:07:28.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.582+0000 7f85081e5640 1 -- 172.21.15.53:0/57675998 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85000c3e10 msgr2=0x7f850006ff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:28.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.582+0000 7f85081e5640 1 --2- 172.21.15.53:0/57675998 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85000c3e10 0x7f850006ff10 secure :-1 s=READY pgs=2432 cs=0 l=1 rev1=1 crypto rx=0x7f84f801c200 tx=0x7f84ec005800 comp rx=0 tx=0).stop 2023-06-10T19:07:28.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.582+0000 7f85081e5640 1 -- 172.21.15.53:0/57675998 shutdown_connections 2023-06-10T19:07:28.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.582+0000 7f85081e5640 1 --2- 172.21.15.53:0/57675998 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f84e40662b0 0x7f84e4068760 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:28.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.582+0000 7f85081e5640 1 --2- 172.21.15.53:0/57675998 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85000c3e10 0x7f850006ff10 unknown :-1 s=CLOSED pgs=2432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:28.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.582+0000 7f85081e5640 1 --2- 172.21.15.53:0/57675998 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f850014b150 0x7f85000b0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:28.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.582+0000 7f85081e5640 1 --2- 172.21.15.53:0/57675998 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84ec0052a0 0x7f85000b36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:28.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.582+0000 7f85081e5640 1 -- 172.21.15.53:0/57675998 >> 172.21.15.53:0/57675998 conn(0x7f850006a0e0 msgr2=0x7f85000cc1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:28.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.582+0000 7f85081e5640 1 -- 172.21.15.53:0/57675998 shutdown_connections 2023-06-10T19:07:28.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.582+0000 7f85081e5640 1 -- 172.21.15.53:0/57675998 wait complete. 2023-06-10T19:07:28.601 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-10T19:07:28.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.710+0000 7f1869e5e640 1 Processor -- start 2023-06-10T19:07:28.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.710+0000 7f1869e5e640 1 -- start start 2023-06-10T19:07:28.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.710+0000 7f1869e5e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f186406c7d0 0x7f18641586f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:28.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.710+0000 7f1869e5e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18640ccc90 0x7f18640cd130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:28.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.710+0000 7f1869e5e640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f186415c260 con 0x7f186406c400 2023-06-10T19:07:28.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.710+0000 7f1869e5e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f186415cee0 con 0x7f186406c7d0 2023-06-10T19:07:28.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.710+0000 7f1869e5e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f186415c540 con 0x7f18640ccc90 2023-06-10T19:07:28.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.710+0000 7f18637fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f186406c400 0x7f1864157fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:42720/0 (socket says 172.21.15.53:42720) 2023-06-10T19:07:28.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.710+0000 7f18637fe640 1 -- 172.21.15.53:0/842206446 learned_addr learned my addr 172.21.15.53:0/842206446 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:07:28.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.710+0000 7f1862ffd640 1 --2- 172.21.15.53:0/842206446 >> v2:172.21.15.117:3300/0 conn(0x7f186406c7d0 0x7f18641586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:28.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.710+0000 7f18627fc640 1 -- 172.21.15.53:0/842206446 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2625565477 0 0) 0x7f186415c260 con 0x7f186406c400 2023-06-10T19:07:28.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.710+0000 7f1863fff640 1 --2- 172.21.15.53:0/842206446 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18640ccc90 0x7f18640cd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:28.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.710+0000 7f18627fc640 1 -- 172.21.15.53:0/842206446 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f184c003530 con 0x7f186406c400 2023-06-10T19:07:28.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.710+0000 7f18627fc640 1 -- 172.21.15.53:0/842206446 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2851586631 0 0) 0x7f184c003530 con 0x7f186406c400 2023-06-10T19:07:28.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.710+0000 7f18627fc640 1 -- 172.21.15.53:0/842206446 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18640ccc90 msgr2=0x7f18640cd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:28.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.710+0000 7f18627fc640 1 --2- 172.21.15.53:0/842206446 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18640ccc90 0x7f18640cd130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:28.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.710+0000 7f18627fc640 1 -- 172.21.15.53:0/842206446 >> v2:172.21.15.117:3300/0 conn(0x7f186406c7d0 msgr2=0x7f18641586f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:28.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.710+0000 7f18627fc640 1 --2- 172.21.15.53:0/842206446 >> v2:172.21.15.117:3300/0 conn(0x7f186406c7d0 0x7f18641586f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:28.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.710+0000 7f18627fc640 1 -- 172.21.15.53:0/842206446 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f186415c820 con 0x7f186406c400 2023-06-10T19:07:28.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.710+0000 7f18627fc640 1 -- 172.21.15.53:0/842206446 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f1854001680 con 0x7f186406c400 2023-06-10T19:07:28.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.710+0000 7f18627fc640 1 -- 172.21.15.53:0/842206446 >> v1:172.21.15.53:6789/0 conn(0x7f186406c400 legacy=0x7f1864157fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:28.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.710+0000 7f18627fc640 1 --2- 172.21.15.53:0/842206446 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f184c003980 0x7f184c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:28.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.710+0000 7f18627fc640 1 --2- 172.21.15.53:0/842206446 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18640ccc90 0x7f184c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:28.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.710+0000 7f18627fc640 1 --2- 172.21.15.53:0/842206446 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f184c004d10 0x7f184c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:28.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.710+0000 7f18627fc640 1 -- 172.21.15.53:0/842206446 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f186415cee0 con 0x7f184c004d10 2023-06-10T19:07:28.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.710+0000 7f18627fc640 1 -- 172.21.15.53:0/842206446 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f186415c540 con 0x7f184c003980 2023-06-10T19:07:28.716 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.710+0000 7f18627fc640 1 -- 172.21.15.53:0/842206446 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f184c00bac0 con 0x7f18640ccc90 2023-06-10T19:07:28.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.710+0000 7f1863fff640 1 --2- 172.21.15.53:0/842206446 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f184c004d10 0x7f184c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:28.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.710+0000 7f18637fe640 1 --2- 172.21.15.53:0/842206446 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f184c003980 0x7f184c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:28.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.710+0000 7f1862ffd640 1 --2- 172.21.15.53:0/842206446 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18640ccc90 0x7f184c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:28.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.710+0000 7f1863fff640 1 -- 172.21.15.53:0/842206446 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18640ccc90 msgr2=0x7f184c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:28.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.710+0000 7f1863fff640 1 --2- 172.21.15.53:0/842206446 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18640ccc90 0x7f184c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:28.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.710+0000 7f1863fff640 1 -- 172.21.15.53:0/842206446 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f184c003980 msgr2=0x7f184c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:28.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.710+0000 7f1863fff640 1 --2- 172.21.15.53:0/842206446 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f184c003980 0x7f184c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:28.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.710+0000 7f1863fff640 1 -- 172.21.15.53:0/842206446 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f184c003530 con 0x7f184c004d10 2023-06-10T19:07:28.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.710+0000 7f18637fe640 1 --2- 172.21.15.53:0/842206446 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f184c003980 0x7f184c003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:07:28.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.714+0000 7f1863fff640 1 --2- 172.21.15.53:0/842206446 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f184c004d10 0x7f184c005180 secure :-1 s=READY pgs=2434 cs=0 l=1 rev1=1 crypto rx=0x7f185c009360 tx=0x7f185c01edb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adab23c746c9ebda server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:28.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.714+0000 7f18627fc640 1 -- 172.21.15.53:0/842206446 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f185c0a7bd0 con 0x7f184c004d10 2023-06-10T19:07:28.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.714+0000 7f18627fc640 1 -- 172.21.15.53:0/842206446 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f185c0a7d30 con 0x7f184c004d10 2023-06-10T19:07:28.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.714+0000 7f18627fc640 1 -- 172.21.15.53:0/842206446 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f185c0a7ea0 con 0x7f184c004d10 2023-06-10T19:07:28.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.714+0000 7f1869e5e640 1 -- 172.21.15.53:0/842206446 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f184c004d10 msgr2=0x7f184c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:28.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.714+0000 7f1869e5e640 1 --2- 172.21.15.53:0/842206446 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f184c004d10 0x7f184c005180 secure :-1 s=READY pgs=2434 cs=0 l=1 rev1=1 crypto rx=0x7f185c009360 tx=0x7f185c01edb0 comp rx=0 tx=0).stop 2023-06-10T19:07:28.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.714+0000 7f1863fff640 1 -- 172.21.15.53:0/842206446 reap_dead start 2023-06-10T19:07:28.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.714+0000 7f1869e5e640 1 -- 172.21.15.53:0/842206446 shutdown_connections 2023-06-10T19:07:28.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.714+0000 7f1869e5e640 1 -- 172.21.15.53:0/842206446 >> 172.21.15.53:0/842206446 conn(0x7f186406a560 msgr2=0x7f186406a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:28.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.714+0000 7f1869e5e640 1 -- 172.21.15.53:0/842206446 shutdown_connections 2023-06-10T19:07:28.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.714+0000 7f1869e5e640 1 -- 172.21.15.53:0/842206446 wait complete. 2023-06-10T19:07:28.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.714+0000 7f1869e5e640 1 Processor -- start 2023-06-10T19:07:28.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.714+0000 7f1869e5e640 1 -- start start 2023-06-10T19:07:28.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.714+0000 7f1869e5e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1864147450 0x7f1864147bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:28.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.714+0000 7f1869e5e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18641577d0 0x7f18640b26f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:28.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.714+0000 7f1869e5e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1864156190 0x7f1864156610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:28.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.714+0000 7f1869e5e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18640c3640 con 0x7f1864156190 2023-06-10T19:07:28.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.714+0000 7f1869e5e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1864156b50 con 0x7f18641577d0 2023-06-10T19:07:28.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.714+0000 7f1869e5e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18640c32f0 con 0x7f1864147450 2023-06-10T19:07:28.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.714+0000 7f1863fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1864156190 0x7f1864156610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:28.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.714+0000 7f1863fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1864156190 0x7f1864156610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42950/0 (socket says 172.21.15.53:42950) 2023-06-10T19:07:28.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.714+0000 7f1863fff640 1 -- 172.21.15.53:0/1075044925 learned_addr learned my addr 172.21.15.53:0/1075044925 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:28.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.714+0000 7f1862ffd640 1 --2- 172.21.15.53:0/1075044925 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18641577d0 0x7f18640b26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:28.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.714+0000 7f18637fe640 1 --2- 172.21.15.53:0/1075044925 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1864147450 0x7f1864147bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:28.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.714+0000 7f1863fff640 1 -- 172.21.15.53:0/1075044925 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1864147450 msgr2=0x7f1864147bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:28.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.714+0000 7f1863fff640 1 --2- 172.21.15.53:0/1075044925 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1864147450 0x7f1864147bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:28.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.714+0000 7f1863fff640 1 -- 172.21.15.53:0/1075044925 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18641577d0 msgr2=0x7f18640b26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:28.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.714+0000 7f1863fff640 1 --2- 172.21.15.53:0/1075044925 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18641577d0 0x7f18640b26f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:28.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.714+0000 7f1863fff640 1 -- 172.21.15.53:0/1075044925 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1864148110 con 0x7f1864156190 2023-06-10T19:07:28.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.714+0000 7f1862ffd640 1 --2- 172.21.15.53:0/1075044925 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18641577d0 0x7f18640b26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:07:28.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.714+0000 7f1863fff640 1 --2- 172.21.15.53:0/1075044925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1864156190 0x7f1864156610 secure :-1 s=READY pgs=2435 cs=0 l=1 rev1=1 crypto rx=0x7f185c002240 tx=0x7f184c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:28.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.718+0000 7f184bfff640 1 -- 172.21.15.53:0/1075044925 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f185c0bd070 con 0x7f1864156190 2023-06-10T19:07:28.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.718+0000 7f184bfff640 1 -- 172.21.15.53:0/1075044925 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f185c0039a0 con 0x7f1864156190 2023-06-10T19:07:28.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.718+0000 7f1869e5e640 1 -- 172.21.15.53:0/1075044925 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1864151110 con 0x7f1864156190 2023-06-10T19:07:28.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.718+0000 7f184bfff640 1 -- 172.21.15.53:0/1075044925 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f185c0a7ea0 con 0x7f1864156190 2023-06-10T19:07:28.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.718+0000 7f1869e5e640 1 -- 172.21.15.53:0/1075044925 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1864147860 con 0x7f1864156190 2023-06-10T19:07:28.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.718+0000 7f1869e5e640 1 -- 172.21.15.53:0/1075044925 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18640c3780 con 0x7f1864156190 2023-06-10T19:07:28.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.718+0000 7f184bfff640 1 -- 172.21.15.53:0/1075044925 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f185c0b6040 con 0x7f1864156190 2023-06-10T19:07:28.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.718+0000 7f184bfff640 1 --2- 172.21.15.53:0/1075044925 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1850066280 0x7f1850068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:28.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.718+0000 7f184bfff640 1 -- 172.21.15.53:0/1075044925 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f185c11faa0 con 0x7f1864156190 2023-06-10T19:07:28.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.718+0000 7f18637fe640 1 --2- 172.21.15.53:0/1075044925 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1850066280 0x7f1850068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:28.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.718+0000 7f18637fe640 1 --2- 172.21.15.53:0/1075044925 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1850066280 0x7f1850068730 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f1854001130 tx=0x7f1854001e30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:28.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.722+0000 7f184bfff640 1 -- 172.21.15.53:0/1075044925 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f18640c3780 con 0x7f1864156190 2023-06-10T19:07:28.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.882+0000 7f1869e5e640 1 -- 172.21.15.53:0/1075044925 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f18640c3780 con 0x7f1864156190 2023-06-10T19:07:28.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.882+0000 7f184bfff640 1 -- 172.21.15.53:0/1075044925 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v167) v1 ==== 80+0+0 (secure 0 0 0) 0x7f18640c3780 con 0x7f1864156190 2023-06-10T19:07:28.884 INFO:teuthology.orchestra.run.smithi053.stderr:listed 0 entries 2023-06-10T19:07:28.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.886+0000 7f1869e5e640 1 -- 172.21.15.53:0/1075044925 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1850066280 msgr2=0x7f1850068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:28.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.886+0000 7f1869e5e640 1 --2- 172.21.15.53:0/1075044925 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1850066280 0x7f1850068730 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f1854001130 tx=0x7f1854001e30 comp rx=0 tx=0).stop 2023-06-10T19:07:28.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.886+0000 7f1869e5e640 1 -- 172.21.15.53:0/1075044925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1864156190 msgr2=0x7f1864156610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:28.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.886+0000 7f1869e5e640 1 --2- 172.21.15.53:0/1075044925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1864156190 0x7f1864156610 secure :-1 s=READY pgs=2435 cs=0 l=1 rev1=1 crypto rx=0x7f185c002240 tx=0x7f184c005800 comp rx=0 tx=0).stop 2023-06-10T19:07:28.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.886+0000 7f1869e5e640 1 -- 172.21.15.53:0/1075044925 shutdown_connections 2023-06-10T19:07:28.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.886+0000 7f1869e5e640 1 --2- 172.21.15.53:0/1075044925 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1850066280 0x7f1850068730 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:28.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.886+0000 7f1869e5e640 1 --2- 172.21.15.53:0/1075044925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1864156190 0x7f1864156610 unknown :-1 s=CLOSED pgs=2435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:28.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.886+0000 7f1869e5e640 1 --2- 172.21.15.53:0/1075044925 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18641577d0 0x7f18640b26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:28.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.886+0000 7f1869e5e640 1 --2- 172.21.15.53:0/1075044925 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1864147450 0x7f1864147bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:28.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.886+0000 7f1869e5e640 1 -- 172.21.15.53:0/1075044925 >> 172.21.15.53:0/1075044925 conn(0x7f186406a560 msgr2=0x7f18641556b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:28.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.886+0000 7f1869e5e640 1 -- 172.21.15.53:0/1075044925 shutdown_connections 2023-06-10T19:07:28.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:28.886+0000 7f1869e5e640 1 -- 172.21.15.53:0/1075044925 wait complete. 2023-06-10T19:07:28.902 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T19:07:28.902 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:07:28.909 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:07:29.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.026+0000 7f1606d93640 1 Processor -- start 2023-06-10T19:07:29.029 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.026+0000 7f1606d93640 1 -- start start 2023-06-10T19:07:29.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.026+0000 7f1606d93640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f16000c8d00 0x7f160006b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:29.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.026+0000 7f1606d93640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1600158a90 con 0x7f160006bc00 2023-06-10T19:07:29.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.026+0000 7f1606d93640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f160006f780 con 0x7f160006b2f0 2023-06-10T19:07:29.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.026+0000 7f1606d93640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16000705d0 con 0x7f16000c8d00 2023-06-10T19:07:29.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.026+0000 7f1605330640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f160006bc00 0x7f1600162180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:42724/0 (socket says 172.21.15.53:42724) 2023-06-10T19:07:29.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.026+0000 7f1605330640 1 -- 172.21.15.53:0/492178711 learned_addr learned my addr 172.21.15.53:0/492178711 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:07:29.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.030+0000 7f15fffff640 1 --2- 172.21.15.53:0/492178711 >> v2:172.21.15.117:3300/0 conn(0x7f16000c8d00 0x7f160006b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:29.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.030+0000 7f15ff7fe640 1 -- 172.21.15.53:0/492178711 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3706292557 0 0) 0x7f15f80014a0 con 0x7f160006bc00 2023-06-10T19:07:29.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.030+0000 7f15ff7fe640 1 -- 172.21.15.53:0/492178711 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15e8005740 con 0x7f160006bc00 2023-06-10T19:07:29.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.030+0000 7f15ff7fe640 1 -- 172.21.15.53:0/492178711 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3964811382 0 0) 0x7f15e8005740 con 0x7f160006bc00 2023-06-10T19:07:29.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.030+0000 7f15ff7fe640 1 -- 172.21.15.53:0/492178711 >> v2:172.21.15.117:3300/0 conn(0x7f16000c8d00 msgr2=0x7f160006b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:29.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.030+0000 7f15ff7fe640 1 --2- 172.21.15.53:0/492178711 >> v2:172.21.15.117:3300/0 conn(0x7f16000c8d00 0x7f160006b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:29.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.030+0000 7f15ff7fe640 1 -- 172.21.15.53:0/492178711 >> v1:172.21.15.117:6789/0 conn(0x7f160006b2f0 legacy=0x7f160006f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:29.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.030+0000 7f15ff7fe640 1 -- 172.21.15.53:0/492178711 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16000cce10 con 0x7f160006bc00 2023-06-10T19:07:29.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.030+0000 7f15ff7fe640 1 -- 172.21.15.53:0/492178711 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f15f8001b90 con 0x7f160006bc00 2023-06-10T19:07:29.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.030+0000 7f15ff7fe640 1 -- 172.21.15.53:0/492178711 >> v1:172.21.15.53:6789/0 conn(0x7f160006bc00 legacy=0x7f1600162180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:29.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.030+0000 7f15ff7fe640 1 --2- 172.21.15.53:0/492178711 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15e8005c00 0x7f15e8006010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:29.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.030+0000 7f15ff7fe640 1 --2- 172.21.15.53:0/492178711 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15e80069e0 0x7f15e8006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:29.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.030+0000 7f15ff7fe640 1 --2- 172.21.15.53:0/492178711 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15e8007400 0x7f15e800dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:29.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.030+0000 7f15ff7fe640 1 -- 172.21.15.53:0/492178711 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16000705d0 con 0x7f15e8005c00 2023-06-10T19:07:29.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.030+0000 7f15ff7fe640 1 -- 172.21.15.53:0/492178711 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e800e330 con 0x7f15e80069e0 2023-06-10T19:07:29.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.030+0000 7f15ff7fe640 1 -- 172.21.15.53:0/492178711 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15e800e4f0 con 0x7f15e8007400 2023-06-10T19:07:29.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.030+0000 7f1604b2f640 1 --2- 172.21.15.53:0/492178711 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15e8005c00 0x7f15e8006010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:29.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.030+0000 7f15fffff640 1 --2- 172.21.15.53:0/492178711 >> v2:172.21.15.117:3300/0 conn(0x7f16000c8d00 0x7f160006b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:07:29.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.030+0000 7f1605330640 1 --2- 172.21.15.53:0/492178711 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15e8007400 0x7f15e800dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:29.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.030+0000 7f1604b2f640 1 -- 172.21.15.53:0/492178711 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15e8007400 msgr2=0x7f15e800dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:29.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.030+0000 7f1604b2f640 1 --2- 172.21.15.53:0/492178711 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15e8007400 0x7f15e800dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:29.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.030+0000 7f1604b2f640 1 -- 172.21.15.53:0/492178711 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15e80069e0 msgr2=0x7f15e8006e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:29.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.030+0000 7f1604b2f640 1 --2- 172.21.15.53:0/492178711 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15e80069e0 0x7f15e8006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:29.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.030+0000 7f1605330640 1 -- 172.21.15.53:0/492178711 reap_dead start 2023-06-10T19:07:29.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.030+0000 7f1604b2f640 1 -- 172.21.15.53:0/492178711 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e8005740 con 0x7f15e8005c00 2023-06-10T19:07:29.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.030+0000 7f1604b2f640 1 --2- 172.21.15.53:0/492178711 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15e8005c00 0x7f15e8006010 secure :-1 s=READY pgs=2437 cs=0 l=1 rev1=1 crypto rx=0x7f15f00015e0 tx=0x7f15f001c180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1e0738aa603f8c5 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:29.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.030+0000 7f15ff7fe640 1 -- 172.21.15.53:0/492178711 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f00052d0 con 0x7f15e8005c00 2023-06-10T19:07:29.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.030+0000 7f15ff7fe640 1 -- 172.21.15.53:0/492178711 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15f00a7050 con 0x7f15e8005c00 2023-06-10T19:07:29.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.030+0000 7f15ff7fe640 1 -- 172.21.15.53:0/492178711 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f0003600 con 0x7f15e8005c00 2023-06-10T19:07:29.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.034+0000 7f1606d93640 1 -- 172.21.15.53:0/492178711 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15e8005c00 msgr2=0x7f15e8006010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:29.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.034+0000 7f1606d93640 1 --2- 172.21.15.53:0/492178711 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15e8005c00 0x7f15e8006010 secure :-1 s=READY pgs=2437 cs=0 l=1 rev1=1 crypto rx=0x7f15f00015e0 tx=0x7f15f001c180 comp rx=0 tx=0).stop 2023-06-10T19:07:29.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.034+0000 7f1606d93640 1 -- 172.21.15.53:0/492178711 shutdown_connections 2023-06-10T19:07:29.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.034+0000 7f1606d93640 1 --2- 172.21.15.53:0/492178711 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15e8005c00 0x7f15e8006010 unknown :-1 s=CLOSED pgs=2437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:29.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.034+0000 7f1606d93640 1 -- 172.21.15.53:0/492178711 >> 172.21.15.53:0/492178711 conn(0x7f160006a0d0 msgr2=0x7f16000ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:29.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.034+0000 7f1606d93640 1 -- 172.21.15.53:0/492178711 shutdown_connections 2023-06-10T19:07:29.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.034+0000 7f1606d93640 1 -- 172.21.15.53:0/492178711 wait complete. 2023-06-10T19:07:29.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.034+0000 7f1606d93640 1 Processor -- start 2023-06-10T19:07:29.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.034+0000 7f1606d93640 1 -- start start 2023-06-10T19:07:29.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.034+0000 7f1606d93640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15e8005c00 0x7f1600156460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:29.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.034+0000 7f1606d93640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16000c4550 0x7f16001557f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:29.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.034+0000 7f1606d93640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16001f1190 0x7f16001f1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:29.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.034+0000 7f1606d93640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16001562f0 con 0x7f16000c4550 2023-06-10T19:07:29.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.034+0000 7f1606d93640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16000b2ca0 con 0x7f15e8005c00 2023-06-10T19:07:29.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.034+0000 7f1606d93640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1600155d30 con 0x7f16001f1190 2023-06-10T19:07:29.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.034+0000 7f15fffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16000c4550 0x7f16001557f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:29.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.034+0000 7f15fffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16000c4550 0x7f16001557f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42978/0 (socket says 172.21.15.53:42978) 2023-06-10T19:07:29.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.034+0000 7f15fffff640 1 -- 172.21.15.53:0/3751838243 learned_addr learned my addr 172.21.15.53:0/3751838243 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:29.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.034+0000 7f1604b2f640 1 --2- 172.21.15.53:0/3751838243 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15e8005c00 0x7f1600156460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:29.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.034+0000 7f1605330640 1 --2- 172.21.15.53:0/3751838243 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16001f1190 0x7f16001f1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:29.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.034+0000 7f15fffff640 1 -- 172.21.15.53:0/3751838243 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16001f1190 msgr2=0x7f16001f1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:29.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.034+0000 7f15fffff640 1 --2- 172.21.15.53:0/3751838243 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16001f1190 0x7f16001f1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:29.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.034+0000 7f15fffff640 1 -- 172.21.15.53:0/3751838243 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15e8005c00 msgr2=0x7f1600156460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:29.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.034+0000 7f15fffff640 1 --2- 172.21.15.53:0/3751838243 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15e8005c00 0x7f1600156460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:29.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.034+0000 7f15fffff640 1 -- 172.21.15.53:0/3751838243 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16000b2300 con 0x7f16000c4550 2023-06-10T19:07:29.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.034+0000 7f1605330640 1 --2- 172.21.15.53:0/3751838243 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16001f1190 0x7f16001f1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:07:29.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.034+0000 7f15fffff640 1 --2- 172.21.15.53:0/3751838243 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16000c4550 0x7f16001557f0 secure :-1 s=READY pgs=2438 cs=0 l=1 rev1=1 crypto rx=0x7f15f400e790 tx=0x7f15f400e880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:29.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.034+0000 7f15fd7fa640 1 -- 172.21.15.53:0/3751838243 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f400c070 con 0x7f16000c4550 2023-06-10T19:07:29.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.034+0000 7f15fd7fa640 1 -- 172.21.15.53:0/3751838243 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15f4013610 con 0x7f16000c4550 2023-06-10T19:07:29.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.034+0000 7f1606d93640 1 -- 172.21.15.53:0/3751838243 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16000b25e0 con 0x7f16000c4550 2023-06-10T19:07:29.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.034+0000 7f15fd7fa640 1 -- 172.21.15.53:0/3751838243 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f40139c0 con 0x7f16000c4550 2023-06-10T19:07:29.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.034+0000 7f1606d93640 1 -- 172.21.15.53:0/3751838243 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1600155f30 con 0x7f16000c4550 2023-06-10T19:07:29.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.034+0000 7f1606d93640 1 -- 172.21.15.53:0/3751838243 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16000b2de0 con 0x7f16000c4550 2023-06-10T19:07:29.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.038+0000 7f15fd7fa640 1 -- 172.21.15.53:0/3751838243 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f15f4013b20 con 0x7f16000c4550 2023-06-10T19:07:29.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.038+0000 7f15fd7fa640 1 --2- 172.21.15.53:0/3751838243 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f15ec066280 0x7f15ec068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:29.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.038+0000 7f15fd7fa640 1 -- 172.21.15.53:0/3751838243 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f15f4083780 con 0x7f16000c4550 2023-06-10T19:07:29.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.038+0000 7f1604b2f640 1 --2- 172.21.15.53:0/3751838243 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f15ec066280 0x7f15ec068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:29.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.038+0000 7f1604b2f640 1 --2- 172.21.15.53:0/3751838243 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f15ec066280 0x7f15ec068730 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f15f00015b0 tx=0x7f15f00011a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:29.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.042+0000 7f15fd7fa640 1 -- 172.21.15.53:0/3751838243 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f16000b2de0 con 0x7f16000c4550 2023-06-10T19:07:29.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.194+0000 7f1606d93640 1 -- 172.21.15.53:0/3751838243 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f16000b2de0 con 0x7f16000c4550 2023-06-10T19:07:29.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.198+0000 7f15fd7fa640 1 -- 172.21.15.53:0/3751838243 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v167) v1 ==== 74+0+18281 (secure 0 0 0) 0x7f16000b2de0 con 0x7f16000c4550 2023-06-10T19:07:29.200 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:07:29.200 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":167,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:07:16.727942+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-06-10T19:07:13.365954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"166","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-06-10T19:07:14.695077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:07:29.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.198+0000 7f1606d93640 1 -- 172.21.15.53:0/3751838243 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f15ec066280 msgr2=0x7f15ec068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:29.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.198+0000 7f1606d93640 1 --2- 172.21.15.53:0/3751838243 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f15ec066280 0x7f15ec068730 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f15f00015b0 tx=0x7f15f00011a0 comp rx=0 tx=0).stop 2023-06-10T19:07:29.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.198+0000 7f1606d93640 1 -- 172.21.15.53:0/3751838243 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16000c4550 msgr2=0x7f16001557f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:29.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.198+0000 7f1606d93640 1 --2- 172.21.15.53:0/3751838243 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16000c4550 0x7f16001557f0 secure :-1 s=READY pgs=2438 cs=0 l=1 rev1=1 crypto rx=0x7f15f400e790 tx=0x7f15f400e880 comp rx=0 tx=0).stop 2023-06-10T19:07:29.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.198+0000 7f1606d93640 1 -- 172.21.15.53:0/3751838243 shutdown_connections 2023-06-10T19:07:29.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.198+0000 7f1606d93640 1 --2- 172.21.15.53:0/3751838243 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f15ec066280 0x7f15ec068730 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:29.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.198+0000 7f1606d93640 1 --2- 172.21.15.53:0/3751838243 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16001f1190 0x7f16001f1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:29.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.198+0000 7f1606d93640 1 --2- 172.21.15.53:0/3751838243 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16000c4550 0x7f16001557f0 unknown :-1 s=CLOSED pgs=2438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:29.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.198+0000 7f1606d93640 1 --2- 172.21.15.53:0/3751838243 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15e8005c00 0x7f1600156460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:29.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.198+0000 7f1606d93640 1 -- 172.21.15.53:0/3751838243 >> 172.21.15.53:0/3751838243 conn(0x7f160006a0d0 msgr2=0x7f16000ac430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:29.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.198+0000 7f1606d93640 1 -- 172.21.15.53:0/3751838243 shutdown_connections 2023-06-10T19:07:29.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.198+0000 7f1606d93640 1 -- 172.21.15.53:0/3751838243 wait complete. 2023-06-10T19:07:29.218 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-10T18:52:33.633114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-10T18:52:39.171487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 23, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-10T19:07:13.365954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '166', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 24, 'pool_name': 'cephfs_data', 'create_time': '2023-06-10T19:07:14.695077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '167', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-10T19:07:29.219 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-10T19:07:29.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.334+0000 7f6c8294b640 1 Processor -- start 2023-06-10T19:07:29.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.334+0000 7f6c8294b640 1 -- start start 2023-06-10T19:07:29.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.334+0000 7f6c8294b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6c7c15c090 0x7f6c7c0b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:29.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.334+0000 7f6c8294b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6c7c0b7e30 0x7f6c7c0d04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:29.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.334+0000 7f6c8294b640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c7c0cc7c0 con 0x7f6c7c0b0b90 2023-06-10T19:07:29.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.334+0000 7f6c8294b640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c7c0ccaa0 con 0x7f6c7c15c090 2023-06-10T19:07:29.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.334+0000 7f6c8294b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7c0ccd80 con 0x7f6c7c0b7e30 2023-06-10T19:07:29.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.334+0000 7f6c7bfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6c7c15c090 0x7f6c7c0b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:29.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.334+0000 7f6c7b7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f6c7c0b0b90 0x7f6c7c0b7720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:42732/0 (socket says 172.21.15.53:42732) 2023-06-10T19:07:29.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.334+0000 7f6c7b7fe640 1 -- 172.21.15.53:0/2924818326 learned_addr learned my addr 172.21.15.53:0/2924818326 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:07:29.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.334+0000 7f6c80ee8640 1 --2- 172.21.15.53:0/2924818326 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6c7c0b7e30 0x7f6c7c0d04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:29.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.334+0000 7f6c7affd640 1 -- 172.21.15.53:0/2924818326 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4159536774 0 0) 0x7f6c7c0cc7c0 con 0x7f6c7c0b0b90 2023-06-10T19:07:29.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.334+0000 7f6c7affd640 1 -- 172.21.15.53:0/2924818326 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c68003530 con 0x7f6c7c0b0b90 2023-06-10T19:07:29.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.334+0000 7f6c7bfff640 1 -- 172.21.15.53:0/2924818326 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6c7c0b7e30 msgr2=0x7f6c7c0d04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:29.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.334+0000 7f6c7bfff640 1 --2- 172.21.15.53:0/2924818326 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6c7c0b7e30 0x7f6c7c0d04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:29.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.334+0000 7f6c7bfff640 1 -- 172.21.15.53:0/2924818326 >> v1:172.21.15.53:6789/0 conn(0x7f6c7c0b0b90 legacy=0x7f6c7c0b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:29.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.334+0000 7f6c7bfff640 1 -- 172.21.15.53:0/2924818326 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c7c0cd060 con 0x7f6c7c15c090 2023-06-10T19:07:29.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.338+0000 7f6c7bfff640 1 --2- 172.21.15.53:0/2924818326 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c7c15c090 0x7f6c7c0b10c0 secure :-1 s=READY pgs=2440 cs=0 l=1 rev1=1 crypto rx=0x7f6c640097c0 tx=0x7f6c6401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=281a942c31820527 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:29.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.338+0000 7f6c7affd640 1 -- 172.21.15.53:0/2924818326 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c640ab600 con 0x7f6c7c15c090 2023-06-10T19:07:29.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.338+0000 7f6c7affd640 1 -- 172.21.15.53:0/2924818326 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c640a7050 con 0x7f6c7c15c090 2023-06-10T19:07:29.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.338+0000 7f6c7affd640 1 -- 172.21.15.53:0/2924818326 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c640ab960 con 0x7f6c7c15c090 2023-06-10T19:07:29.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.338+0000 7f6c8294b640 1 -- 172.21.15.53:0/2924818326 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c7c15c090 msgr2=0x7f6c7c0b10c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:29.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.338+0000 7f6c8294b640 1 --2- 172.21.15.53:0/2924818326 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c7c15c090 0x7f6c7c0b10c0 secure :-1 s=READY pgs=2440 cs=0 l=1 rev1=1 crypto rx=0x7f6c640097c0 tx=0x7f6c6401c3c0 comp rx=0 tx=0).stop 2023-06-10T19:07:29.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.338+0000 7f6c8294b640 1 -- 172.21.15.53:0/2924818326 shutdown_connections 2023-06-10T19:07:29.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.338+0000 7f6c8294b640 1 --2- 172.21.15.53:0/2924818326 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6c7c0b7e30 0x7f6c7c0d04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:29.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.338+0000 7f6c8294b640 1 --2- 172.21.15.53:0/2924818326 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c7c15c090 0x7f6c7c0b10c0 unknown :-1 s=CLOSED pgs=2440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:29.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.338+0000 7f6c8294b640 1 -- 172.21.15.53:0/2924818326 >> 172.21.15.53:0/2924818326 conn(0x7f6c7c069e20 msgr2=0x7f6c7c06a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:29.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.338+0000 7f6c8294b640 1 -- 172.21.15.53:0/2924818326 shutdown_connections 2023-06-10T19:07:29.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.338+0000 7f6c8294b640 1 -- 172.21.15.53:0/2924818326 wait complete. 2023-06-10T19:07:29.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.338+0000 7f6c8294b640 1 Processor -- start 2023-06-10T19:07:29.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.338+0000 7f6c8294b640 1 -- start start 2023-06-10T19:07:29.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.342+0000 7f6c8294b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c7c0b0b90 0x7f6c7c14c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:29.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.342+0000 7f6c8294b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c7c0b7e30 0x7f6c7c0cbc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:29.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.342+0000 7f6c8294b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6c7c15c090 0x7f6c7c1575b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:29.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.342+0000 7f6c8294b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7c156e90 con 0x7f6c7c0b7e30 2023-06-10T19:07:29.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.342+0000 7f6c8294b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7c154b80 con 0x7f6c7c0b0b90 2023-06-10T19:07:29.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.342+0000 7f6c8294b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7c1548a0 con 0x7f6c7c15c090 2023-06-10T19:07:29.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.342+0000 7f6c7b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c7c0b7e30 0x7f6c7c0cbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:29.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.342+0000 7f6c7b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c7c0b7e30 0x7f6c7c0cbc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42990/0 (socket says 172.21.15.53:42990) 2023-06-10T19:07:29.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.342+0000 7f6c7b7fe640 1 -- 172.21.15.53:0/2673805907 learned_addr learned my addr 172.21.15.53:0/2673805907 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:29.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.342+0000 7f6c80ee8640 1 --2- 172.21.15.53:0/2673805907 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6c7c15c090 0x7f6c7c1575b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:29.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.342+0000 7f6c7bfff640 1 --2- 172.21.15.53:0/2673805907 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c7c0b0b90 0x7f6c7c14c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:29.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.342+0000 7f6c7b7fe640 1 -- 172.21.15.53:0/2673805907 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6c7c15c090 msgr2=0x7f6c7c1575b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:29.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.342+0000 7f6c7b7fe640 1 --2- 172.21.15.53:0/2673805907 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6c7c15c090 0x7f6c7c1575b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:29.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.342+0000 7f6c7b7fe640 1 -- 172.21.15.53:0/2673805907 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c7c0b0b90 msgr2=0x7f6c7c14c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:29.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.342+0000 7f6c7b7fe640 1 --2- 172.21.15.53:0/2673805907 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c7c0b0b90 0x7f6c7c14c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:29.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.342+0000 7f6c7b7fe640 1 -- 172.21.15.53:0/2673805907 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c64009420 con 0x7f6c7c0b7e30 2023-06-10T19:07:29.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.342+0000 7f6c80ee8640 1 --2- 172.21.15.53:0/2673805907 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6c7c15c090 0x7f6c7c1575b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:07:29.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.342+0000 7f6c7b7fe640 1 --2- 172.21.15.53:0/2673805907 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c7c0b7e30 0x7f6c7c0cbc40 secure :-1 s=READY pgs=2441 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c00c420 tx=0x7f6c6c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:29.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.342+0000 7f6c78ff9640 1 -- 172.21.15.53:0/2673805907 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c005cf0 con 0x7f6c7c0b7e30 2023-06-10T19:07:29.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.342+0000 7f6c78ff9640 1 -- 172.21.15.53:0/2673805907 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c6c005e70 con 0x7f6c7c0b7e30 2023-06-10T19:07:29.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.342+0000 7f6c8294b640 1 -- 172.21.15.53:0/2673805907 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c7c1568d0 con 0x7f6c7c0b7e30 2023-06-10T19:07:29.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.342+0000 7f6c78ff9640 1 -- 172.21.15.53:0/2673805907 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c0072f0 con 0x7f6c7c0b7e30 2023-06-10T19:07:29.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.342+0000 7f6c8294b640 1 -- 172.21.15.53:0/2673805907 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c7c14a670 con 0x7f6c7c0b7e30 2023-06-10T19:07:29.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.342+0000 7f6c8294b640 1 -- 172.21.15.53:0/2673805907 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c7c04d790 con 0x7f6c7c0b7e30 2023-06-10T19:07:29.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.342+0000 7f6c78ff9640 1 -- 172.21.15.53:0/2673805907 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6c6c007490 con 0x7f6c7c0b7e30 2023-06-10T19:07:29.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.342+0000 7f6c78ff9640 1 --2- 172.21.15.53:0/2673805907 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6c5c066280 0x7f6c5c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:29.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.342+0000 7f6c78ff9640 1 -- 172.21.15.53:0/2673805907 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6c6c083370 con 0x7f6c7c0b7e30 2023-06-10T19:07:29.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.342+0000 7f6c7bfff640 1 --2- 172.21.15.53:0/2673805907 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6c5c066280 0x7f6c5c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:29.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.346+0000 7f6c7bfff640 1 --2- 172.21.15.53:0/2673805907 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6c5c066280 0x7f6c5c068730 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f6c640ad000 tx=0x7f6c640a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:29.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.346+0000 7f6c78ff9640 1 -- 172.21.15.53:0/2673805907 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6c6c054340 con 0x7f6c7c0b7e30 2023-06-10T19:07:29.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.494+0000 7f6c8294b640 1 -- 172.21.15.53:0/2673805907 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6c7c0b72f0 con 0x7f6c7c0b7e30 2023-06-10T19:07:29.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.498+0000 7f6c78ff9640 1 -- 172.21.15.53:0/2673805907 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v167) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6c6c053ed0 con 0x7f6c7c0b7e30 2023-06-10T19:07:29.499 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-06-10T19:07:29.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.498+0000 7f6c8294b640 1 -- 172.21.15.53:0/2673805907 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6c5c066280 msgr2=0x7f6c5c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:29.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.498+0000 7f6c8294b640 1 --2- 172.21.15.53:0/2673805907 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6c5c066280 0x7f6c5c068730 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f6c640ad000 tx=0x7f6c640a6000 comp rx=0 tx=0).stop 2023-06-10T19:07:29.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.498+0000 7f6c8294b640 1 -- 172.21.15.53:0/2673805907 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c7c0b7e30 msgr2=0x7f6c7c0cbc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:29.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.498+0000 7f6c8294b640 1 --2- 172.21.15.53:0/2673805907 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c7c0b7e30 0x7f6c7c0cbc40 secure :-1 s=READY pgs=2441 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c00c420 tx=0x7f6c6c00c8e0 comp rx=0 tx=0).stop 2023-06-10T19:07:29.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.498+0000 7f6c8294b640 1 -- 172.21.15.53:0/2673805907 shutdown_connections 2023-06-10T19:07:29.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.498+0000 7f6c8294b640 1 --2- 172.21.15.53:0/2673805907 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6c5c066280 0x7f6c5c068730 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:29.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.498+0000 7f6c8294b640 1 --2- 172.21.15.53:0/2673805907 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6c7c15c090 0x7f6c7c1575b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:29.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.498+0000 7f6c8294b640 1 --2- 172.21.15.53:0/2673805907 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c7c0b7e30 0x7f6c7c0cbc40 unknown :-1 s=CLOSED pgs=2441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:29.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.498+0000 7f6c8294b640 1 --2- 172.21.15.53:0/2673805907 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c7c0b0b90 0x7f6c7c14c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:29.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.498+0000 7f6c8294b640 1 -- 172.21.15.53:0/2673805907 >> 172.21.15.53:0/2673805907 conn(0x7f6c7c069e20 msgr2=0x7f6c7c1595a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:29.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.498+0000 7f6c8294b640 1 -- 172.21.15.53:0/2673805907 shutdown_connections 2023-06-10T19:07:29.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.498+0000 7f6c8294b640 1 -- 172.21.15.53:0/2673805907 wait complete. 2023-06-10T19:07:29.516 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-10T19:07:29.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.626+0000 7f11b401f640 1 Processor -- start 2023-06-10T19:07:29.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.630+0000 7f11b401f640 1 -- start start 2023-06-10T19:07:29.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.630+0000 7f11b401f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11ac159450 0x7f11ac15d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:29.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.630+0000 7f11b401f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f11ac0cf350 0x7f11ac0cbf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:29.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.630+0000 7f11b401f640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11ac0cbac0 con 0x7f11ac15d680 2023-06-10T19:07:29.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.630+0000 7f11b401f640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11ac15dc00 con 0x7f11ac0cf350 2023-06-10T19:07:29.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.630+0000 7f11b401f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11ac15dee0 con 0x7f11ac159450 2023-06-10T19:07:29.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.630+0000 7f11b25bc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f11ac0cf350 0x7f11ac0cbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:29.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.630+0000 7f11b25bc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f11ac0cf350 0x7f11ac0cbf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43000/0 (socket says 172.21.15.53:43000) 2023-06-10T19:07:29.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.630+0000 7f11b25bc640 1 -- 172.21.15.53:0/4107934802 learned_addr learned my addr 172.21.15.53:0/4107934802 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:29.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.630+0000 7f11b25bc640 1 -- 172.21.15.53:0/4107934802 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11ac159450 msgr2=0x7f11ac15d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:29.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.630+0000 7f11b25bc640 1 --2- 172.21.15.53:0/4107934802 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11ac159450 0x7f11ac15d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:29.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.630+0000 7f11b25bc640 1 -- 172.21.15.53:0/4107934802 >> v1:172.21.15.117:6789/0 conn(0x7f11ac15d680 legacy=0x7f11ac0cec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:29.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.630+0000 7f11b25bc640 1 -- 172.21.15.53:0/4107934802 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11ac0cb750 con 0x7f11ac0cf350 2023-06-10T19:07:29.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.630+0000 7f11b25bc640 1 --2- 172.21.15.53:0/4107934802 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f11ac0cf350 0x7f11ac0cbf50 secure :-1 s=READY pgs=2442 cs=0 l=1 rev1=1 crypto rx=0x7f11a4009e50 tx=0x7f11a401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d0cf964a95f360f server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:29.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.630+0000 7f11b0db9640 1 -- 172.21.15.53:0/4107934802 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a40a5780 con 0x7f11ac0cf350 2023-06-10T19:07:29.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.630+0000 7f11b0db9640 1 -- 172.21.15.53:0/4107934802 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11a40a58e0 con 0x7f11ac0cf350 2023-06-10T19:07:29.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.634+0000 7f11b0db9640 1 -- 172.21.15.53:0/4107934802 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a40a5c70 con 0x7f11ac0cf350 2023-06-10T19:07:29.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.634+0000 7f11b401f640 1 -- 172.21.15.53:0/4107934802 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f11ac0cf350 msgr2=0x7f11ac0cbf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:29.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.634+0000 7f11b401f640 1 --2- 172.21.15.53:0/4107934802 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f11ac0cf350 0x7f11ac0cbf50 secure :-1 s=READY pgs=2442 cs=0 l=1 rev1=1 crypto rx=0x7f11a4009e50 tx=0x7f11a401c8e0 comp rx=0 tx=0).stop 2023-06-10T19:07:29.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.634+0000 7f11b401f640 1 -- 172.21.15.53:0/4107934802 shutdown_connections 2023-06-10T19:07:29.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.634+0000 7f11b401f640 1 --2- 172.21.15.53:0/4107934802 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f11ac0cf350 0x7f11ac0cbf50 unknown :-1 s=CLOSED pgs=2442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:29.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.634+0000 7f11b401f640 1 --2- 172.21.15.53:0/4107934802 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11ac159450 0x7f11ac15d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:29.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.634+0000 7f11b401f640 1 -- 172.21.15.53:0/4107934802 >> 172.21.15.53:0/4107934802 conn(0x7f11ac06a090 msgr2=0x7f11ac06d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:29.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.634+0000 7f11b401f640 1 -- 172.21.15.53:0/4107934802 shutdown_connections 2023-06-10T19:07:29.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.634+0000 7f11b401f640 1 -- 172.21.15.53:0/4107934802 wait complete. 2023-06-10T19:07:29.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.634+0000 7f11b401f640 1 Processor -- start 2023-06-10T19:07:29.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.634+0000 7f11b401f640 1 -- start start 2023-06-10T19:07:29.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.634+0000 7f11b401f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11ac0cf350 0x7f11ac0c5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:29.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.634+0000 7f11b401f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f11ac159450 0x7f11ac0c6f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:29.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.634+0000 7f11b401f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11ac15d680 0x7f11ac0c7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:29.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.634+0000 7f11b401f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11ac14e830 con 0x7f11ac159450 2023-06-10T19:07:29.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.634+0000 7f11b401f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11ac0c9e50 con 0x7f11ac0cf350 2023-06-10T19:07:29.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.634+0000 7f11b401f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11ac150f70 con 0x7f11ac15d680 2023-06-10T19:07:29.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.634+0000 7f11b15ba640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f11ac159450 0x7f11ac0c6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:29.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.634+0000 7f11b15ba640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f11ac159450 0x7f11ac0c6f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43012/0 (socket says 172.21.15.53:43012) 2023-06-10T19:07:29.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.634+0000 7f11b15ba640 1 -- 172.21.15.53:0/2298680993 learned_addr learned my addr 172.21.15.53:0/2298680993 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:29.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.634+0000 7f11b1dbb640 1 --2- 172.21.15.53:0/2298680993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11ac0cf350 0x7f11ac0c5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:29.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.634+0000 7f11b25bc640 1 --2- 172.21.15.53:0/2298680993 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11ac15d680 0x7f11ac0c7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:29.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.634+0000 7f11b15ba640 1 -- 172.21.15.53:0/2298680993 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11ac15d680 msgr2=0x7f11ac0c7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:29.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.634+0000 7f11b15ba640 1 --2- 172.21.15.53:0/2298680993 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11ac15d680 0x7f11ac0c7460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:29.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.634+0000 7f11b15ba640 1 -- 172.21.15.53:0/2298680993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11ac0cf350 msgr2=0x7f11ac0c5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:29.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.634+0000 7f11b15ba640 1 --2- 172.21.15.53:0/2298680993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11ac0cf350 0x7f11ac0c5c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:29.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.634+0000 7f11b15ba640 1 -- 172.21.15.53:0/2298680993 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11a4009b30 con 0x7f11ac159450 2023-06-10T19:07:29.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.634+0000 7f11b15ba640 1 --2- 172.21.15.53:0/2298680993 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f11ac159450 0x7f11ac0c6f20 secure :-1 s=READY pgs=2443 cs=0 l=1 rev1=1 crypto rx=0x7f119c00b410 tx=0x7f119c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:29.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.634+0000 7f11a27fc640 1 -- 172.21.15.53:0/2298680993 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f119c004020 con 0x7f11ac159450 2023-06-10T19:07:29.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.634+0000 7f11a27fc640 1 -- 172.21.15.53:0/2298680993 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f119c004180 con 0x7f11ac159450 2023-06-10T19:07:29.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.634+0000 7f11b401f640 1 -- 172.21.15.53:0/2298680993 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11ac151250 con 0x7f11ac159450 2023-06-10T19:07:29.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.634+0000 7f11a27fc640 1 -- 172.21.15.53:0/2298680993 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f119c011630 con 0x7f11ac159450 2023-06-10T19:07:29.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.634+0000 7f11b401f640 1 -- 172.21.15.53:0/2298680993 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11ac151810 con 0x7f11ac159450 2023-06-10T19:07:29.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.638+0000 7f11b401f640 1 -- 172.21.15.53:0/2298680993 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11ac151a30 con 0x7f11ac159450 2023-06-10T19:07:29.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.638+0000 7f11a27fc640 1 -- 172.21.15.53:0/2298680993 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f119c011790 con 0x7f11ac159450 2023-06-10T19:07:29.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.638+0000 7f11a27fc640 1 --2- 172.21.15.53:0/2298680993 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1190066280 0x7f1190068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:29.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.638+0000 7f11a27fc640 1 -- 172.21.15.53:0/2298680993 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f119c083a80 con 0x7f11ac159450 2023-06-10T19:07:29.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.638+0000 7f11b1dbb640 1 --2- 172.21.15.53:0/2298680993 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1190066280 0x7f1190068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:29.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.638+0000 7f11b1dbb640 1 --2- 172.21.15.53:0/2298680993 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1190066280 0x7f1190068730 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f11a8006fd0 tx=0x7f11a8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:29.643 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.642+0000 7f11a27fc640 1 -- 172.21.15.53:0/2298680993 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f119c050f00 con 0x7f11ac159450 2023-06-10T19:07:29.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.786+0000 7f11b401f640 1 -- 172.21.15.53:0/2298680993 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f11ac04d790 con 0x7f11ac159450 2023-06-10T19:07:29.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.790+0000 7f11a27fc640 1 -- 172.21.15.53:0/2298680993 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v167) v1 ==== 92+0+10 (secure 0 0 0) 0x7f119c054520 con 0x7f11ac159450 2023-06-10T19:07:29.790 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-06-10T19:07:29.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.790+0000 7f11b401f640 1 -- 172.21.15.53:0/2298680993 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1190066280 msgr2=0x7f1190068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:29.793 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.790+0000 7f11b401f640 1 --2- 172.21.15.53:0/2298680993 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1190066280 0x7f1190068730 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f11a8006fd0 tx=0x7f11a8008040 comp rx=0 tx=0).stop 2023-06-10T19:07:29.793 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.790+0000 7f11b401f640 1 -- 172.21.15.53:0/2298680993 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f11ac159450 msgr2=0x7f11ac0c6f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:29.793 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.790+0000 7f11b401f640 1 --2- 172.21.15.53:0/2298680993 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f11ac159450 0x7f11ac0c6f20 secure :-1 s=READY pgs=2443 cs=0 l=1 rev1=1 crypto rx=0x7f119c00b410 tx=0x7f119c00b8d0 comp rx=0 tx=0).stop 2023-06-10T19:07:29.793 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.790+0000 7f11b401f640 1 -- 172.21.15.53:0/2298680993 shutdown_connections 2023-06-10T19:07:29.793 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.790+0000 7f11b401f640 1 --2- 172.21.15.53:0/2298680993 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1190066280 0x7f1190068730 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:29.793 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.790+0000 7f11b401f640 1 --2- 172.21.15.53:0/2298680993 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11ac15d680 0x7f11ac0c7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:29.793 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.790+0000 7f11b401f640 1 --2- 172.21.15.53:0/2298680993 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f11ac159450 0x7f11ac0c6f20 unknown :-1 s=CLOSED pgs=2443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:29.794 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.790+0000 7f11b401f640 1 --2- 172.21.15.53:0/2298680993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11ac0cf350 0x7f11ac0c5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:29.794 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.790+0000 7f11b401f640 1 -- 172.21.15.53:0/2298680993 >> 172.21.15.53:0/2298680993 conn(0x7f11ac06a090 msgr2=0x7f11ac0b49f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:29.794 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.790+0000 7f11b401f640 1 -- 172.21.15.53:0/2298680993 shutdown_connections 2023-06-10T19:07:29.794 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.790+0000 7f11b401f640 1 -- 172.21.15.53:0/2298680993 wait complete. 2023-06-10T19:07:29.809 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-10T19:07:29.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.926+0000 7f1a21feb640 1 Processor -- start 2023-06-10T19:07:29.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.926+0000 7f1a21feb640 1 -- start start 2023-06-10T19:07:29.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.926+0000 7f1a21feb640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1a1c15c090 0x7f1a1c0b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:29.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.926+0000 7f1a21feb640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a1c0cc7c0 con 0x7f1a1c0b7e30 2023-06-10T19:07:29.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.926+0000 7f1a21feb640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a1c0ccaa0 con 0x7f1a1c0b0b90 2023-06-10T19:07:29.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.926+0000 7f1a21feb640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a1c0ccd80 con 0x7f1a1c15c090 2023-06-10T19:07:29.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.926+0000 7f1a1b7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1a1c15c090 0x7f1a1c0b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:29.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.926+0000 7f1a1bfff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f1a1c0b7e30 0x7f1a1c0d04d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:42748/0 (socket says 172.21.15.53:42748) 2023-06-10T19:07:29.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.926+0000 7f1a1bfff640 1 -- 172.21.15.53:0/1413585606 learned_addr learned my addr 172.21.15.53:0/1413585606 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:07:29.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.926+0000 7f1a1b7fe640 1 -- 172.21.15.53:0/1413585606 >> v1:172.21.15.117:6789/0 conn(0x7f1a1c0b0b90 legacy=0x7f1a1c0b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:29.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.926+0000 7f1a1b7fe640 1 -- 172.21.15.53:0/1413585606 >> v1:172.21.15.53:6789/0 conn(0x7f1a1c0b7e30 legacy=0x7f1a1c0d04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:29.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.926+0000 7f1a1a7fc640 1 -- 172.21.15.53:0/1413585606 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3193592000 0 0) 0x7f1a1c0cc7c0 con 0x7f1a1c0b7e30 2023-06-10T19:07:29.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.926+0000 7f1a1b7fe640 1 -- 172.21.15.53:0/1413585606 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a1c0cd060 con 0x7f1a1c15c090 2023-06-10T19:07:29.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.926+0000 7f1a1b7fe640 1 --2- 172.21.15.53:0/1413585606 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a1c15c090 0x7f1a1c0b10c0 secure :-1 s=READY pgs=2445 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c009d90 tx=0x7f1a0c01c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc446df1100d7cae server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:29.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.930+0000 7f1a1a7fc640 1 -- 172.21.15.53:0/1413585606 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a0c0a58b0 con 0x7f1a1c15c090 2023-06-10T19:07:29.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.930+0000 7f1a1a7fc640 1 -- 172.21.15.53:0/1413585606 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a0c0a5a10 con 0x7f1a1c15c090 2023-06-10T19:07:29.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.930+0000 7f1a1a7fc640 1 -- 172.21.15.53:0/1413585606 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a0c0a5da0 con 0x7f1a1c15c090 2023-06-10T19:07:29.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.930+0000 7f1a21feb640 1 -- 172.21.15.53:0/1413585606 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a1c15c090 msgr2=0x7f1a1c0b10c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:29.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.930+0000 7f1a21feb640 1 --2- 172.21.15.53:0/1413585606 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a1c15c090 0x7f1a1c0b10c0 secure :-1 s=READY pgs=2445 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c009d90 tx=0x7f1a0c01c890 comp rx=0 tx=0).stop 2023-06-10T19:07:29.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.930+0000 7f1a21feb640 1 -- 172.21.15.53:0/1413585606 shutdown_connections 2023-06-10T19:07:29.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.930+0000 7f1a21feb640 1 --2- 172.21.15.53:0/1413585606 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a1c15c090 0x7f1a1c0b10c0 unknown :-1 s=CLOSED pgs=2445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:29.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.930+0000 7f1a21feb640 1 -- 172.21.15.53:0/1413585606 >> 172.21.15.53:0/1413585606 conn(0x7f1a1c069e20 msgr2=0x7f1a1c06a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:29.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.930+0000 7f1a21feb640 1 -- 172.21.15.53:0/1413585606 shutdown_connections 2023-06-10T19:07:29.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.930+0000 7f1a21feb640 1 -- 172.21.15.53:0/1413585606 wait complete. 2023-06-10T19:07:29.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.930+0000 7f1a21feb640 1 Processor -- start 2023-06-10T19:07:29.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.930+0000 7f1a21feb640 1 -- start start 2023-06-10T19:07:29.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.930+0000 7f1a21feb640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a1c0b0b90 0x7f1a1c0c5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:29.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.930+0000 7f1a21feb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a1c0b7e30 0x7f1a1c14ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:29.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.930+0000 7f1a21feb640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a1c15c090 0x7f1a1c1504b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:29.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.930+0000 7f1a21feb640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1c0c9b30 con 0x7f1a1c0b7e30 2023-06-10T19:07:29.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.930+0000 7f1a21feb640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1c0c61b0 con 0x7f1a1c0b0b90 2023-06-10T19:07:29.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.930+0000 7f1a21feb640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1c0c9240 con 0x7f1a1c15c090 2023-06-10T19:07:29.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.930+0000 7f1a1affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a1c0b7e30 0x7f1a1c14ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:29.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.930+0000 7f1a1affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a1c0b7e30 0x7f1a1c14ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43030/0 (socket says 172.21.15.53:43030) 2023-06-10T19:07:29.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.930+0000 7f1a1affd640 1 -- 172.21.15.53:0/3922496418 learned_addr learned my addr 172.21.15.53:0/3922496418 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:29.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.930+0000 7f1a1bfff640 1 --2- 172.21.15.53:0/3922496418 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a1c15c090 0x7f1a1c1504b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:29.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.930+0000 7f1a1b7fe640 1 --2- 172.21.15.53:0/3922496418 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a1c0b0b90 0x7f1a1c0c5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:29.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.930+0000 7f1a1affd640 1 -- 172.21.15.53:0/3922496418 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a1c15c090 msgr2=0x7f1a1c1504b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:29.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.930+0000 7f1a1affd640 1 --2- 172.21.15.53:0/3922496418 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a1c15c090 0x7f1a1c1504b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:29.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.930+0000 7f1a1affd640 1 -- 172.21.15.53:0/3922496418 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a1c0b0b90 msgr2=0x7f1a1c0c5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:29.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.930+0000 7f1a1affd640 1 --2- 172.21.15.53:0/3922496418 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a1c0b0b90 0x7f1a1c0c5c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:29.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.930+0000 7f1a1affd640 1 -- 172.21.15.53:0/3922496418 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a0c009a70 con 0x7f1a1c0b7e30 2023-06-10T19:07:29.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.930+0000 7f1a1b7fe640 1 --2- 172.21.15.53:0/3922496418 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a1c0b0b90 0x7f1a1c0c5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:07:29.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.930+0000 7f1a1affd640 1 --2- 172.21.15.53:0/3922496418 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a1c0b7e30 0x7f1a1c14ff70 secure :-1 s=READY pgs=2446 cs=0 l=1 rev1=1 crypto rx=0x7f1a0400c4d0 tx=0x7f1a0400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:29.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.930+0000 7f1a13fff640 1 -- 172.21.15.53:0/3922496418 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a040052d0 con 0x7f1a1c0b7e30 2023-06-10T19:07:29.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.930+0000 7f1a13fff640 1 -- 172.21.15.53:0/3922496418 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a04005430 con 0x7f1a1c0b7e30 2023-06-10T19:07:29.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.930+0000 7f1a13fff640 1 -- 172.21.15.53:0/3922496418 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a04012830 con 0x7f1a1c0b7e30 2023-06-10T19:07:29.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.930+0000 7f1a21feb640 1 -- 172.21.15.53:0/3922496418 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a1c0c94e0 con 0x7f1a1c0b7e30 2023-06-10T19:07:29.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.930+0000 7f1a21feb640 1 -- 172.21.15.53:0/3922496418 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a1c150e20 con 0x7f1a1c0b7e30 2023-06-10T19:07:29.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.934+0000 7f1a21feb640 1 -- 172.21.15.53:0/3922496418 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a1c0c9ce0 con 0x7f1a1c0b7e30 2023-06-10T19:07:29.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.934+0000 7f1a13fff640 1 -- 172.21.15.53:0/3922496418 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1a04012990 con 0x7f1a1c0b7e30 2023-06-10T19:07:29.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.934+0000 7f1a13fff640 1 --2- 172.21.15.53:0/3922496418 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f19fc0662b0 0x7f19fc068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:29.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.934+0000 7f1a13fff640 1 -- 172.21.15.53:0/3922496418 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1a04083800 con 0x7f1a1c0b7e30 2023-06-10T19:07:29.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.934+0000 7f1a1b7fe640 1 --2- 172.21.15.53:0/3922496418 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f19fc0662b0 0x7f19fc068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:29.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.934+0000 7f1a1b7fe640 1 --2- 172.21.15.53:0/3922496418 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f19fc0662b0 0x7f19fc068760 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c0af000 tx=0x7f1a0c0a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:29.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:29.938+0000 7f1a13fff640 1 -- 172.21.15.53:0/3922496418 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1a1c0c9ce0 con 0x7f1a1c0b7e30 2023-06-10T19:07:30.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.090+0000 7f1a21feb640 1 -- 172.21.15.53:0/3922496418 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1a1c15b910 con 0x7f1a1c0b7e30 2023-06-10T19:07:30.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.094+0000 7f1a13fff640 1 -- 172.21.15.53:0/3922496418 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v167) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1a04050c80 con 0x7f1a1c0b7e30 2023-06-10T19:07:30.095 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-06-10T19:07:30.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.094+0000 7f1a21feb640 1 -- 172.21.15.53:0/3922496418 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f19fc0662b0 msgr2=0x7f19fc068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:30.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.094+0000 7f1a21feb640 1 --2- 172.21.15.53:0/3922496418 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f19fc0662b0 0x7f19fc068760 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c0af000 tx=0x7f1a0c0a7070 comp rx=0 tx=0).stop 2023-06-10T19:07:30.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.094+0000 7f1a21feb640 1 -- 172.21.15.53:0/3922496418 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a1c0b7e30 msgr2=0x7f1a1c14ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:30.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.094+0000 7f1a21feb640 1 --2- 172.21.15.53:0/3922496418 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a1c0b7e30 0x7f1a1c14ff70 secure :-1 s=READY pgs=2446 cs=0 l=1 rev1=1 crypto rx=0x7f1a0400c4d0 tx=0x7f1a0400c990 comp rx=0 tx=0).stop 2023-06-10T19:07:30.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.094+0000 7f1a21feb640 1 -- 172.21.15.53:0/3922496418 shutdown_connections 2023-06-10T19:07:30.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.094+0000 7f1a21feb640 1 --2- 172.21.15.53:0/3922496418 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f19fc0662b0 0x7f19fc068760 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:30.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.094+0000 7f1a21feb640 1 --2- 172.21.15.53:0/3922496418 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1a1c15c090 0x7f1a1c1504b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:30.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.094+0000 7f1a21feb640 1 --2- 172.21.15.53:0/3922496418 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a1c0b7e30 0x7f1a1c14ff70 unknown :-1 s=CLOSED pgs=2446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:30.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.094+0000 7f1a21feb640 1 --2- 172.21.15.53:0/3922496418 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a1c0b0b90 0x7f1a1c0c5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:30.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.094+0000 7f1a21feb640 1 -- 172.21.15.53:0/3922496418 >> 172.21.15.53:0/3922496418 conn(0x7f1a1c069e20 msgr2=0x7f1a1c1594f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:30.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.094+0000 7f1a21feb640 1 -- 172.21.15.53:0/3922496418 shutdown_connections 2023-06-10T19:07:30.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.094+0000 7f1a21feb640 1 -- 172.21.15.53:0/3922496418 wait complete. 2023-06-10T19:07:30.114 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-10T19:07:30.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.230+0000 7f35ed4e7640 1 Processor -- start 2023-06-10T19:07:30.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.230+0000 7f35ed4e7640 1 -- start start 2023-06-10T19:07:30.235 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.234+0000 7f35ed4e7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f35e815c090 0x7f35e80b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:30.235 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.234+0000 7f35ed4e7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35e80b7e30 0x7f35e80d04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:30.235 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.234+0000 7f35ed4e7640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35e80cc7c0 con 0x7f35e80b0b90 2023-06-10T19:07:30.235 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.234+0000 7f35ed4e7640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35e80ccaa0 con 0x7f35e815c090 2023-06-10T19:07:30.235 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.234+0000 7f35ed4e7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35e80ccd80 con 0x7f35e80b7e30 2023-06-10T19:07:30.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.234+0000 7f35e6ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f35e815c090 0x7f35e80b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:30.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.234+0000 7f35e6ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f35e815c090 0x7f35e80b10c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43038/0 (socket says 172.21.15.53:43038) 2023-06-10T19:07:30.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.234+0000 7f35e6ffd640 1 -- 172.21.15.53:0/1261674381 learned_addr learned my addr 172.21.15.53:0/1261674381 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:30.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.234+0000 7f35e6ffd640 1 -- 172.21.15.53:0/1261674381 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35e80b7e30 msgr2=0x7f35e80d04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:30.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.234+0000 7f35e6ffd640 1 --2- 172.21.15.53:0/1261674381 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35e80b7e30 0x7f35e80d04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:30.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.234+0000 7f35e6ffd640 1 -- 172.21.15.53:0/1261674381 >> v1:172.21.15.117:6789/0 conn(0x7f35e80b0b90 legacy=0x7f35e80b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:30.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.234+0000 7f35e6ffd640 1 -- 172.21.15.53:0/1261674381 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35e80cd060 con 0x7f35e815c090 2023-06-10T19:07:30.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.234+0000 7f35e6ffd640 1 --2- 172.21.15.53:0/1261674381 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f35e815c090 0x7f35e80b10c0 secure :-1 s=READY pgs=2447 cs=0 l=1 rev1=1 crypto rx=0x7f35e0009e50 tx=0x7f35e001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21d2fbd03dd8e01e server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:30.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.234+0000 7f35e5ffb640 1 -- 172.21.15.53:0/1261674381 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e00a5710 con 0x7f35e815c090 2023-06-10T19:07:30.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.234+0000 7f35e5ffb640 1 -- 172.21.15.53:0/1261674381 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35e00a5870 con 0x7f35e815c090 2023-06-10T19:07:30.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.234+0000 7f35e5ffb640 1 -- 172.21.15.53:0/1261674381 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e00a5c00 con 0x7f35e815c090 2023-06-10T19:07:30.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.234+0000 7f35ed4e7640 1 -- 172.21.15.53:0/1261674381 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f35e815c090 msgr2=0x7f35e80b10c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:30.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.234+0000 7f35ed4e7640 1 --2- 172.21.15.53:0/1261674381 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f35e815c090 0x7f35e80b10c0 secure :-1 s=READY pgs=2447 cs=0 l=1 rev1=1 crypto rx=0x7f35e0009e50 tx=0x7f35e001c930 comp rx=0 tx=0).stop 2023-06-10T19:07:30.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.234+0000 7f35ed4e7640 1 -- 172.21.15.53:0/1261674381 shutdown_connections 2023-06-10T19:07:30.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.234+0000 7f35ed4e7640 1 --2- 172.21.15.53:0/1261674381 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35e80b7e30 0x7f35e80d04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:30.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.234+0000 7f35ed4e7640 1 --2- 172.21.15.53:0/1261674381 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f35e815c090 0x7f35e80b10c0 unknown :-1 s=CLOSED pgs=2447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:30.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.234+0000 7f35ed4e7640 1 -- 172.21.15.53:0/1261674381 >> 172.21.15.53:0/1261674381 conn(0x7f35e8069e20 msgr2=0x7f35e806a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:30.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.234+0000 7f35ed4e7640 1 -- 172.21.15.53:0/1261674381 shutdown_connections 2023-06-10T19:07:30.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.234+0000 7f35ed4e7640 1 -- 172.21.15.53:0/1261674381 wait complete. 2023-06-10T19:07:30.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.238+0000 7f35ed4e7640 1 Processor -- start 2023-06-10T19:07:30.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.238+0000 7f35ed4e7640 1 -- start start 2023-06-10T19:07:30.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.238+0000 7f35ed4e7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f35e80b0b90 0x7f35e814dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:30.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.238+0000 7f35ed4e7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35e80b7e30 0x7f35e81544a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:30.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.238+0000 7f35ed4e7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35e815c090 0x7f35e81549e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:30.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.238+0000 7f35ed4e7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35e814b190 con 0x7f35e80b0b90 2023-06-10T19:07:30.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.238+0000 7f35ed4e7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35e80cbb30 con 0x7f35e80b7e30 2023-06-10T19:07:30.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.238+0000 7f35ed4e7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35e80cbe10 con 0x7f35e815c090 2023-06-10T19:07:30.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.238+0000 7f35e6ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f35e80b0b90 0x7f35e814dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:30.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.238+0000 7f35e6ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f35e80b0b90 0x7f35e814dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43050/0 (socket says 172.21.15.53:43050) 2023-06-10T19:07:30.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.238+0000 7f35e6ffd640 1 -- 172.21.15.53:0/2754094571 learned_addr learned my addr 172.21.15.53:0/2754094571 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:30.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.238+0000 7f35e67fc640 1 --2- 172.21.15.53:0/2754094571 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35e80b7e30 0x7f35e81544a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:30.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.238+0000 7f35e77fe640 1 --2- 172.21.15.53:0/2754094571 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35e815c090 0x7f35e81549e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:30.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.238+0000 7f35e6ffd640 1 -- 172.21.15.53:0/2754094571 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35e815c090 msgr2=0x7f35e81549e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:30.243 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.238+0000 7f35e6ffd640 1 --2- 172.21.15.53:0/2754094571 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35e815c090 0x7f35e81549e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:30.243 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.238+0000 7f35e6ffd640 1 -- 172.21.15.53:0/2754094571 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35e80b7e30 msgr2=0x7f35e81544a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:30.243 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.238+0000 7f35e6ffd640 1 --2- 172.21.15.53:0/2754094571 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35e80b7e30 0x7f35e81544a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:30.243 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.238+0000 7f35e6ffd640 1 -- 172.21.15.53:0/2754094571 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35e0009b30 con 0x7f35e80b0b90 2023-06-10T19:07:30.243 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.238+0000 7f35e6ffd640 1 --2- 172.21.15.53:0/2754094571 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f35e80b0b90 0x7f35e814dd40 secure :-1 s=READY pgs=2448 cs=0 l=1 rev1=1 crypto rx=0x7f35e001afe0 tx=0x7f35e00196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:30.243 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.238+0000 7f35cf7fe640 1 -- 172.21.15.53:0/2754094571 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e00b8670 con 0x7f35e80b0b90 2023-06-10T19:07:30.243 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.238+0000 7f35cf7fe640 1 -- 172.21.15.53:0/2754094571 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35e00b87d0 con 0x7f35e80b0b90 2023-06-10T19:07:30.243 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.238+0000 7f35ed4e7640 1 -- 172.21.15.53:0/2754094571 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35e814b420 con 0x7f35e80b0b90 2023-06-10T19:07:30.244 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.238+0000 7f35cf7fe640 1 -- 172.21.15.53:0/2754094571 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e00b8b60 con 0x7f35e80b0b90 2023-06-10T19:07:30.244 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.238+0000 7f35ed4e7640 1 -- 172.21.15.53:0/2754094571 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35e814e280 con 0x7f35e80b0b90 2023-06-10T19:07:30.245 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.238+0000 7f35ed4e7640 1 -- 172.21.15.53:0/2754094571 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35e814b660 con 0x7f35e80b0b90 2023-06-10T19:07:30.245 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.242+0000 7f35cf7fe640 1 -- 172.21.15.53:0/2754094571 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f35e00b8cc0 con 0x7f35e80b0b90 2023-06-10T19:07:30.245 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.242+0000 7f35cf7fe640 1 --2- 172.21.15.53:0/2754094571 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f35d40662b0 0x7f35d4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:30.245 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.242+0000 7f35cf7fe640 1 -- 172.21.15.53:0/2754094571 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f35e011f720 con 0x7f35e80b0b90 2023-06-10T19:07:30.245 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.242+0000 7f35e67fc640 1 --2- 172.21.15.53:0/2754094571 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f35d40662b0 0x7f35d4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:30.245 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.242+0000 7f35e67fc640 1 --2- 172.21.15.53:0/2754094571 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f35d40662b0 0x7f35d4068760 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f35e81f7c10 tx=0x7f35dc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:30.246 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.242+0000 7f35cf7fe640 1 -- 172.21.15.53:0/2754094571 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f35e00ecc80 con 0x7f35e80b0b90 2023-06-10T19:07:30.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.390+0000 7f35ed4e7640 1 -- 172.21.15.53:0/2754094571 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f35e814b610 con 0x7f35e80b0b90 2023-06-10T19:07:30.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.390+0000 7f35cf7fe640 1 -- 172.21.15.53:0/2754094571 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v167) v1 ==== 100+0+11 (secure 0 0 0) 0x7f35e00f02a0 con 0x7f35e80b0b90 2023-06-10T19:07:30.394 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-06-10T19:07:30.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.394+0000 7f35ed4e7640 1 -- 172.21.15.53:0/2754094571 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f35d40662b0 msgr2=0x7f35d4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:30.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.394+0000 7f35ed4e7640 1 --2- 172.21.15.53:0/2754094571 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f35d40662b0 0x7f35d4068760 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f35e81f7c10 tx=0x7f35dc009040 comp rx=0 tx=0).stop 2023-06-10T19:07:30.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.394+0000 7f35ed4e7640 1 -- 172.21.15.53:0/2754094571 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f35e80b0b90 msgr2=0x7f35e814dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:30.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.394+0000 7f35ed4e7640 1 --2- 172.21.15.53:0/2754094571 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f35e80b0b90 0x7f35e814dd40 secure :-1 s=READY pgs=2448 cs=0 l=1 rev1=1 crypto rx=0x7f35e001afe0 tx=0x7f35e00196d0 comp rx=0 tx=0).stop 2023-06-10T19:07:30.396 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.394+0000 7f35ed4e7640 1 -- 172.21.15.53:0/2754094571 shutdown_connections 2023-06-10T19:07:30.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.394+0000 7f35ed4e7640 1 --2- 172.21.15.53:0/2754094571 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f35d40662b0 0x7f35d4068760 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:30.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.394+0000 7f35ed4e7640 1 --2- 172.21.15.53:0/2754094571 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35e815c090 0x7f35e81549e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:30.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.394+0000 7f35ed4e7640 1 --2- 172.21.15.53:0/2754094571 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35e80b7e30 0x7f35e81544a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:30.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.394+0000 7f35ed4e7640 1 --2- 172.21.15.53:0/2754094571 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f35e80b0b90 0x7f35e814dd40 unknown :-1 s=CLOSED pgs=2448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:30.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.394+0000 7f35ed4e7640 1 -- 172.21.15.53:0/2754094571 >> 172.21.15.53:0/2754094571 conn(0x7f35e8069e20 msgr2=0x7f35e8152570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:30.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.394+0000 7f35ed4e7640 1 -- 172.21.15.53:0/2754094571 shutdown_connections 2023-06-10T19:07:30.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.394+0000 7f35ed4e7640 1 -- 172.21.15.53:0/2754094571 wait complete. 2023-06-10T19:07:30.412 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-10T19:07:30.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.530+0000 7f576d393640 1 Processor -- start 2023-06-10T19:07:30.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.530+0000 7f576d393640 1 -- start start 2023-06-10T19:07:30.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.530+0000 7f576d393640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f576815eef0 0x7f5768070f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:30.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.530+0000 7f576d393640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f576815f570 0x7f57680ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:30.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.530+0000 7f576d393640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f57680ce990 0x7f5768069450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:30.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.530+0000 7f576d393640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f576815f2c0 con 0x7f576815eef0 2023-06-10T19:07:30.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.530+0000 7f576d393640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f576815fdc0 con 0x7f57680ce990 2023-06-10T19:07:30.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.530+0000 7f576d393640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57681600a0 con 0x7f576815f570 2023-06-10T19:07:30.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.530+0000 7f5766ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f576815eef0 0x7f5768070f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:30.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.530+0000 7f5766ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f576815eef0 0x7f5768070f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43064/0 (socket says 172.21.15.53:43064) 2023-06-10T19:07:30.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.530+0000 7f5766ffd640 1 -- 172.21.15.53:0/708584014 learned_addr learned my addr 172.21.15.53:0/708584014 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:30.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.530+0000 7f57677fe640 1 --2- 172.21.15.53:0/708584014 >> v2:172.21.15.117:3300/0 conn(0x7f57680ce990 0x7f5768069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:30.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.530+0000 7f57667fc640 1 --2- 172.21.15.53:0/708584014 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f576815f570 0x7f57680ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:30.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.530+0000 7f5766ffd640 1 -- 172.21.15.53:0/708584014 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f576815f570 msgr2=0x7f57680ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:30.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.530+0000 7f5766ffd640 1 --2- 172.21.15.53:0/708584014 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f576815f570 0x7f57680ce450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:30.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.530+0000 7f5766ffd640 1 -- 172.21.15.53:0/708584014 >> v2:172.21.15.117:3300/0 conn(0x7f57680ce990 msgr2=0x7f5768069450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:30.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.530+0000 7f5766ffd640 1 --2- 172.21.15.53:0/708584014 >> v2:172.21.15.117:3300/0 conn(0x7f57680ce990 0x7f5768069450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:30.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.530+0000 7f5766ffd640 1 -- 172.21.15.53:0/708584014 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5768160380 con 0x7f576815eef0 2023-06-10T19:07:30.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.534+0000 7f5766ffd640 1 --2- 172.21.15.53:0/708584014 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f576815eef0 0x7f5768070f80 secure :-1 s=READY pgs=2449 cs=0 l=1 rev1=1 crypto rx=0x7f576806fd30 tx=0x7f575801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1711483d82f6b397 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:30.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.534+0000 7f5765ffb640 1 -- 172.21.15.53:0/708584014 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57580ab600 con 0x7f576815eef0 2023-06-10T19:07:30.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.534+0000 7f5765ffb640 1 -- 172.21.15.53:0/708584014 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57580a7050 con 0x7f576815eef0 2023-06-10T19:07:30.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.534+0000 7f5765ffb640 1 -- 172.21.15.53:0/708584014 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57580ab980 con 0x7f576815eef0 2023-06-10T19:07:30.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.534+0000 7f576d393640 1 -- 172.21.15.53:0/708584014 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f576815eef0 msgr2=0x7f5768070f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:30.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.534+0000 7f576d393640 1 --2- 172.21.15.53:0/708584014 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f576815eef0 0x7f5768070f80 secure :-1 s=READY pgs=2449 cs=0 l=1 rev1=1 crypto rx=0x7f576806fd30 tx=0x7f575801c500 comp rx=0 tx=0).stop 2023-06-10T19:07:30.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.534+0000 7f576d393640 1 -- 172.21.15.53:0/708584014 shutdown_connections 2023-06-10T19:07:30.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.534+0000 7f576d393640 1 --2- 172.21.15.53:0/708584014 >> v2:172.21.15.117:3300/0 conn(0x7f57680ce990 0x7f5768069450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:30.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.534+0000 7f576d393640 1 --2- 172.21.15.53:0/708584014 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f576815f570 0x7f57680ce450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:30.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.534+0000 7f576d393640 1 --2- 172.21.15.53:0/708584014 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f576815eef0 0x7f5768070f80 unknown :-1 s=CLOSED pgs=2449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:30.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.534+0000 7f576d393640 1 -- 172.21.15.53:0/708584014 >> 172.21.15.53:0/708584014 conn(0x7f576806a560 msgr2=0x7f576806a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:30.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.534+0000 7f576d393640 1 -- 172.21.15.53:0/708584014 shutdown_connections 2023-06-10T19:07:30.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.534+0000 7f576d393640 1 -- 172.21.15.53:0/708584014 wait complete. 2023-06-10T19:07:30.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.534+0000 7f576d393640 1 Processor -- start 2023-06-10T19:07:30.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.534+0000 7f576d393640 1 -- start start 2023-06-10T19:07:30.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.538+0000 7f576d393640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57680ce990 0x7f57680c5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:30.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.538+0000 7f576d393640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f576815eef0 0x7f57680cedb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:30.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.538+0000 7f576d393640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f576815f570 0x7f57680cf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:30.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.538+0000 7f576d393640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57681537e0 con 0x7f576815eef0 2023-06-10T19:07:30.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.538+0000 7f576d393640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f576813da40 con 0x7f576815f570 2023-06-10T19:07:30.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.538+0000 7f576d393640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57680c2de0 con 0x7f57680ce990 2023-06-10T19:07:30.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.538+0000 7f57667fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f576815eef0 0x7f57680cedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:30.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.538+0000 7f57667fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f576815eef0 0x7f57680cedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43080/0 (socket says 172.21.15.53:43080) 2023-06-10T19:07:30.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.538+0000 7f57667fc640 1 -- 172.21.15.53:0/3580044238 learned_addr learned my addr 172.21.15.53:0/3580044238 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:30.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.538+0000 7f57677fe640 1 --2- 172.21.15.53:0/3580044238 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f576815f570 0x7f57680cf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:30.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.538+0000 7f5766ffd640 1 --2- 172.21.15.53:0/3580044238 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57680ce990 0x7f57680c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:30.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.538+0000 7f57667fc640 1 -- 172.21.15.53:0/3580044238 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57680ce990 msgr2=0x7f57680c5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:30.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.538+0000 7f57667fc640 1 --2- 172.21.15.53:0/3580044238 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57680ce990 0x7f57680c5300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:30.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.538+0000 7f57667fc640 1 -- 172.21.15.53:0/3580044238 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f576815f570 msgr2=0x7f57680cf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:30.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.538+0000 7f57667fc640 1 --2- 172.21.15.53:0/3580044238 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f576815f570 0x7f57680cf2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:30.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.538+0000 7f57667fc640 1 -- 172.21.15.53:0/3580044238 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57580094d0 con 0x7f576815eef0 2023-06-10T19:07:30.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.538+0000 7f57667fc640 1 --2- 172.21.15.53:0/3580044238 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f576815eef0 0x7f57680cedb0 secure :-1 s=READY pgs=2450 cs=0 l=1 rev1=1 crypto rx=0x7f575000d5f0 tx=0x7f575000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:30.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.538+0000 7f575f7fe640 1 -- 172.21.15.53:0/3580044238 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57500125f0 con 0x7f576815eef0 2023-06-10T19:07:30.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.538+0000 7f575f7fe640 1 -- 172.21.15.53:0/3580044238 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5750012750 con 0x7f576815eef0 2023-06-10T19:07:30.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.538+0000 7f576d393640 1 -- 172.21.15.53:0/3580044238 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57680c4820 con 0x7f576815eef0 2023-06-10T19:07:30.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.538+0000 7f575f7fe640 1 -- 172.21.15.53:0/3580044238 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5750012ae0 con 0x7f576815eef0 2023-06-10T19:07:30.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.538+0000 7f576d393640 1 -- 172.21.15.53:0/3580044238 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57680c4de0 con 0x7f576815eef0 2023-06-10T19:07:30.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.538+0000 7f576d393640 1 -- 172.21.15.53:0/3580044238 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f576804d790 con 0x7f576815eef0 2023-06-10T19:07:30.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.538+0000 7f575f7fe640 1 -- 172.21.15.53:0/3580044238 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5750012c40 con 0x7f576815eef0 2023-06-10T19:07:30.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.538+0000 7f575f7fe640 1 --2- 172.21.15.53:0/3580044238 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5748066280 0x7f5748068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:30.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.538+0000 7f575f7fe640 1 -- 172.21.15.53:0/3580044238 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f57500842b0 con 0x7f576815eef0 2023-06-10T19:07:30.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.538+0000 7f5766ffd640 1 --2- 172.21.15.53:0/3580044238 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5748066280 0x7f5748068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:30.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.542+0000 7f5766ffd640 1 --2- 172.21.15.53:0/3580044238 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5748066280 0x7f5748068730 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f57580ad000 tx=0x7f5758008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:30.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.542+0000 7f575f7fe640 1 -- 172.21.15.53:0/3580044238 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5750051690 con 0x7f576815eef0 2023-06-10T19:07:30.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.714+0000 7f576d393640 1 -- 172.21.15.53:0/3580044238 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f576815a6c0 con 0x7f576815eef0 2023-06-10T19:07:30.715 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.714+0000 7f575f7fe640 1 -- 172.21.15.53:0/3580044238 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v167) v1 ==== 80+0+0 (secure 0 0 0) 0x7f5750054cb0 con 0x7f576815eef0 2023-06-10T19:07:30.715 INFO:teuthology.orchestra.run.smithi053.stderr:listed 0 entries 2023-06-10T19:07:30.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.714+0000 7f576d393640 1 -- 172.21.15.53:0/3580044238 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5748066280 msgr2=0x7f5748068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:30.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.714+0000 7f576d393640 1 --2- 172.21.15.53:0/3580044238 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5748066280 0x7f5748068730 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f57580ad000 tx=0x7f5758008040 comp rx=0 tx=0).stop 2023-06-10T19:07:30.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.714+0000 7f576d393640 1 -- 172.21.15.53:0/3580044238 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f576815eef0 msgr2=0x7f57680cedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:30.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.714+0000 7f576d393640 1 --2- 172.21.15.53:0/3580044238 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f576815eef0 0x7f57680cedb0 secure :-1 s=READY pgs=2450 cs=0 l=1 rev1=1 crypto rx=0x7f575000d5f0 tx=0x7f575000dab0 comp rx=0 tx=0).stop 2023-06-10T19:07:30.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.714+0000 7f576d393640 1 -- 172.21.15.53:0/3580044238 shutdown_connections 2023-06-10T19:07:30.717 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.714+0000 7f576d393640 1 --2- 172.21.15.53:0/3580044238 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5748066280 0x7f5748068730 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:30.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.714+0000 7f576d393640 1 --2- 172.21.15.53:0/3580044238 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f576815f570 0x7f57680cf2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:30.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.714+0000 7f576d393640 1 --2- 172.21.15.53:0/3580044238 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f576815eef0 0x7f57680cedb0 unknown :-1 s=CLOSED pgs=2450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:30.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.714+0000 7f576d393640 1 --2- 172.21.15.53:0/3580044238 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57680ce990 0x7f57680c5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:30.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.714+0000 7f576d393640 1 -- 172.21.15.53:0/3580044238 >> 172.21.15.53:0/3580044238 conn(0x7f576806a560 msgr2=0x7f576815aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:30.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.714+0000 7f576d393640 1 -- 172.21.15.53:0/3580044238 shutdown_connections 2023-06-10T19:07:30.718 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:30.714+0000 7f576d393640 1 -- 172.21.15.53:0/3580044238 wait complete. 2023-06-10T19:07:30.733 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi117.front.sepia.ceph.com... 2023-06-10T19:07:30.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:07:30.734 DEBUG:teuthology.orchestra.run.smithi117:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-06-10T19:07:30.747 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi117.stderr:ceph-fuse[45815]: fuse finished with error 0 and tester_r 0 2023-06-10T19:07:30.749 INFO:teuthology.orchestra.run:waiting for 300 2023-06-10T19:07:36.851 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi117.front.sepia.ceph.com 2023-06-10T19:07:36.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:07:36.852 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-06-10T19:07:36.860 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-06-10T19:07:36.861 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-06-10T19:07:36.861 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-06-10T19:07:36.862 DEBUG:teuthology.orchestra.run.smithi053:> import glob 2023-06-10T19:07:36.862 DEBUG:teuthology.orchestra.run.smithi053:> import re 2023-06-10T19:07:36.862 DEBUG:teuthology.orchestra.run.smithi053:> import os 2023-06-10T19:07:36.862 DEBUG:teuthology.orchestra.run.smithi053:> import subprocess 2023-06-10T19:07:36.863 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:07:36.863 DEBUG:teuthology.orchestra.run.smithi053:> def _find_admin_socket(client_name): 2023-06-10T19:07:36.863 DEBUG:teuthology.orchestra.run.smithi053:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-06-10T19:07:36.864 DEBUG:teuthology.orchestra.run.smithi053:> files = glob.glob(asok_path) 2023-06-10T19:07:36.864 DEBUG:teuthology.orchestra.run.smithi053:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-06-10T19:07:36.864 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:07:36.864 DEBUG:teuthology.orchestra.run.smithi053:> # Given a non-glob path, it better be there 2023-06-10T19:07:36.865 DEBUG:teuthology.orchestra.run.smithi053:> if "*" not in asok_path: 2023-06-10T19:07:36.865 DEBUG:teuthology.orchestra.run.smithi053:> assert(len(files) == 1) 2023-06-10T19:07:36.865 DEBUG:teuthology.orchestra.run.smithi053:> return files[0] 2023-06-10T19:07:36.866 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:07:36.866 DEBUG:teuthology.orchestra.run.smithi053:> for f in files: 2023-06-10T19:07:36.866 DEBUG:teuthology.orchestra.run.smithi053:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-06-10T19:07:36.866 DEBUG:teuthology.orchestra.run.smithi053:> if os.path.exists("/proc/{0}".format(pid)): 2023-06-10T19:07:36.867 DEBUG:teuthology.orchestra.run.smithi053:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-06-10T19:07:36.867 DEBUG:teuthology.orchestra.run.smithi053:> contents = proc_f.read() 2023-06-10T19:07:36.867 DEBUG:teuthology.orchestra.run.smithi053:> if mountpoint in contents: 2023-06-10T19:07:36.868 DEBUG:teuthology.orchestra.run.smithi053:> return f 2023-06-10T19:07:36.868 DEBUG:teuthology.orchestra.run.smithi053:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-06-10T19:07:36.868 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:07:36.868 DEBUG:teuthology.orchestra.run.smithi053:> print(_find_admin_socket("client.0")) 2023-06-10T19:07:36.869 DEBUG:teuthology.orchestra.run.smithi053:> ' 2023-06-10T19:07:36.952 INFO:teuthology.orchestra.run.smithi053.stdout:/var/run/ceph/ceph-client.0.68467.asok 2023-06-10T19:07:37.134 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.68467.asok 2023-06-10T19:07:37.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:07:37.135 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.68467.asok mds_sessions 2023-06-10T19:07:37.297 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-06-10T19:07:37.298 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 10737, 2023-06-10T19:07:37.298 INFO:teuthology.orchestra.run.smithi053.stdout: "inst": { 2023-06-10T19:07:37.298 INFO:teuthology.orchestra.run.smithi053.stdout: "name": { 2023-06-10T19:07:37.299 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "client", 2023-06-10T19:07:37.299 INFO:teuthology.orchestra.run.smithi053.stdout: "num": 10737 2023-06-10T19:07:37.299 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:07:37.299 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": { 2023-06-10T19:07:37.300 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2023-06-10T19:07:37.300 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "192.168.0.1:0", 2023-06-10T19:07:37.300 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 4011987522 2023-06-10T19:07:37.301 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:07:37.301 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:07:37.301 INFO:teuthology.orchestra.run.smithi053.stdout: "inst_str": "client.10737 v1:192.168.0.1:0/4011987522", 2023-06-10T19:07:37.301 INFO:teuthology.orchestra.run.smithi053.stdout: "addr_str": "v1:192.168.0.1:0/4011987522", 2023-06-10T19:07:37.302 INFO:teuthology.orchestra.run.smithi053.stdout: "sessions": [ 2023-06-10T19:07:37.302 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:07:37.303 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": 0, 2023-06-10T19:07:37.303 INFO:teuthology.orchestra.run.smithi053.stdout: "addrs": { 2023-06-10T19:07:37.303 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2023-06-10T19:07:37.304 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:07:37.304 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2023-06-10T19:07:37.304 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.53:6834", 2023-06-10T19:07:37.305 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 3721509006 2023-06-10T19:07:37.305 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:07:37.305 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:07:37.306 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2023-06-10T19:07:37.306 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.53:6835", 2023-06-10T19:07:37.306 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 3721509006 2023-06-10T19:07:37.306 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:07:37.306 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2023-06-10T19:07:37.306 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:07:37.307 INFO:teuthology.orchestra.run.smithi053.stdout: "seq": 0, 2023-06-10T19:07:37.307 INFO:teuthology.orchestra.run.smithi053.stdout: "cap_gen": 0, 2023-06-10T19:07:37.307 INFO:teuthology.orchestra.run.smithi053.stdout: "cap_ttl": "2023-06-10T19:08:23.113054+0000", 2023-06-10T19:07:37.307 INFO:teuthology.orchestra.run.smithi053.stdout: "last_cap_renew_request": "2023-06-10T19:07:23.113054+0000", 2023-06-10T19:07:37.307 INFO:teuthology.orchestra.run.smithi053.stdout: "cap_renew_seq": 2, 2023-06-10T19:07:37.307 INFO:teuthology.orchestra.run.smithi053.stdout: "num_caps": 1, 2023-06-10T19:07:37.307 INFO:teuthology.orchestra.run.smithi053.stdout: "state": "open" 2023-06-10T19:07:37.308 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:07:37.308 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2023-06-10T19:07:37.308 INFO:teuthology.orchestra.run.smithi053.stdout: "mdsmap_epoch": 96 2023-06-10T19:07:37.308 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-06-10T19:07:37.311 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:07:37.445 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.434+0000 7fd13a169640 1 Processor -- start 2023-06-10T19:07:37.445 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.434+0000 7fd13a169640 1 -- start start 2023-06-10T19:07:37.445 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.438+0000 7fd13a169640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd1340c9840 0x7fd1340c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:37.445 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.438+0000 7fd13a169640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd134159b50 con 0x7fd13406b090 2023-06-10T19:07:37.445 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.438+0000 7fd13a169640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1340ca150 con 0x7fd134071060 2023-06-10T19:07:37.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.438+0000 7fd13a169640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1340702a0 con 0x7fd1340c9840 2023-06-10T19:07:37.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.438+0000 7fd133fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fd13406b090 0x7fd13406b530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:32932/0 (socket says 172.21.15.53:32932) 2023-06-10T19:07:37.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.438+0000 7fd133fff640 1 -- 172.21.15.53:0/3554988569 learned_addr learned my addr 172.21.15.53:0/3554988569 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:07:37.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.438+0000 7fd1337fe640 1 --2- 172.21.15.53:0/3554988569 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd1340c9840 0x7fd1340c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:37.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.438+0000 7fd1327fc640 1 -- 172.21.15.53:0/3554988569 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2739308924 0 0) 0x7fd134159b50 con 0x7fd13406b090 2023-06-10T19:07:37.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.438+0000 7fd1327fc640 1 -- 172.21.15.53:0/3554988569 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd11c003530 con 0x7fd13406b090 2023-06-10T19:07:37.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.438+0000 7fd1327fc640 1 -- 172.21.15.53:0/3554988569 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2448187842 0 0) 0x7fd11c003530 con 0x7fd13406b090 2023-06-10T19:07:37.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.438+0000 7fd1327fc640 1 -- 172.21.15.53:0/3554988569 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd1340c9840 msgr2=0x7fd1340c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:37.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.438+0000 7fd1327fc640 1 --2- 172.21.15.53:0/3554988569 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd1340c9840 0x7fd1340c9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:37.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.438+0000 7fd1327fc640 1 -- 172.21.15.53:0/3554988569 >> v1:172.21.15.117:6789/0 conn(0x7fd134071060 legacy=0x7fd1340af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:37.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.438+0000 7fd1327fc640 1 -- 172.21.15.53:0/3554988569 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd134070580 con 0x7fd13406b090 2023-06-10T19:07:37.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.438+0000 7fd1327fc640 1 -- 172.21.15.53:0/3554988569 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fd124001680 con 0x7fd13406b090 2023-06-10T19:07:37.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.438+0000 7fd1327fc640 1 -- 172.21.15.53:0/3554988569 >> v1:172.21.15.53:6789/0 conn(0x7fd13406b090 legacy=0x7fd13406b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:37.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.438+0000 7fd1327fc640 1 --2- 172.21.15.53:0/3554988569 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd11c003a20 0x7fd11c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:37.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.438+0000 7fd1327fc640 1 --2- 172.21.15.53:0/3554988569 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd11c0047d0 0x7fd11c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:37.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.438+0000 7fd1327fc640 1 --2- 172.21.15.53:0/3554988569 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd1340c9840 0x7fd11c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:37.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.438+0000 7fd1327fc640 1 -- 172.21.15.53:0/3554988569 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1340702a0 con 0x7fd11c003a20 2023-06-10T19:07:37.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.438+0000 7fd1327fc640 1 -- 172.21.15.53:0/3554988569 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd11c00ba70 con 0x7fd11c0047d0 2023-06-10T19:07:37.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.438+0000 7fd1327fc640 1 -- 172.21.15.53:0/3554988569 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd11c00bc30 con 0x7fd1340c9840 2023-06-10T19:07:37.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.438+0000 7fd1337fe640 1 --2- 172.21.15.53:0/3554988569 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd11c003a20 0x7fd11c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:37.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.438+0000 7fd132ffd640 1 --2- 172.21.15.53:0/3554988569 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd11c0047d0 0x7fd11c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:37.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.438+0000 7fd133fff640 1 --2- 172.21.15.53:0/3554988569 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd1340c9840 0x7fd11c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:37.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.438+0000 7fd1337fe640 1 -- 172.21.15.53:0/3554988569 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd1340c9840 msgr2=0x7fd11c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:37.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.438+0000 7fd1337fe640 1 --2- 172.21.15.53:0/3554988569 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd1340c9840 0x7fd11c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:37.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.438+0000 7fd1337fe640 1 -- 172.21.15.53:0/3554988569 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd11c0047d0 msgr2=0x7fd11c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:37.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.438+0000 7fd1337fe640 1 --2- 172.21.15.53:0/3554988569 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd11c0047d0 0x7fd11c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:37.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.438+0000 7fd1337fe640 1 -- 172.21.15.53:0/3554988569 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd11c003530 con 0x7fd11c003a20 2023-06-10T19:07:37.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.442+0000 7fd1337fe640 1 --2- 172.21.15.53:0/3554988569 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd11c003a20 0x7fd11c003e30 secure :-1 s=READY pgs=2452 cs=0 l=1 rev1=1 crypto rx=0x7fd12c009fc0 tx=0x7fd12c01cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fadfc2b88556864d server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:37.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.442+0000 7fd1327fc640 1 -- 172.21.15.53:0/3554988569 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12c0a5c20 con 0x7fd11c003a20 2023-06-10T19:07:37.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.442+0000 7fd1327fc640 1 -- 172.21.15.53:0/3554988569 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd12c00f040 con 0x7fd11c003a20 2023-06-10T19:07:37.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.442+0000 7fd1327fc640 1 -- 172.21.15.53:0/3554988569 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12c0ad440 con 0x7fd11c003a20 2023-06-10T19:07:37.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.442+0000 7fd13a169640 1 -- 172.21.15.53:0/3554988569 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd11c003a20 msgr2=0x7fd11c003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:37.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.442+0000 7fd13a169640 1 --2- 172.21.15.53:0/3554988569 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd11c003a20 0x7fd11c003e30 secure :-1 s=READY pgs=2452 cs=0 l=1 rev1=1 crypto rx=0x7fd12c009fc0 tx=0x7fd12c01cc30 comp rx=0 tx=0).stop 2023-06-10T19:07:37.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.442+0000 7fd133fff640 1 -- 172.21.15.53:0/3554988569 reap_dead start 2023-06-10T19:07:37.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.442+0000 7fd13a169640 1 -- 172.21.15.53:0/3554988569 shutdown_connections 2023-06-10T19:07:37.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.442+0000 7fd13a169640 1 -- 172.21.15.53:0/3554988569 >> 172.21.15.53:0/3554988569 conn(0x7fd13406a0d0 msgr2=0x7fd1340ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:37.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.442+0000 7fd13a169640 1 -- 172.21.15.53:0/3554988569 shutdown_connections 2023-06-10T19:07:37.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.442+0000 7fd13a169640 1 -- 172.21.15.53:0/3554988569 wait complete. 2023-06-10T19:07:37.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.442+0000 7fd13a169640 1 Processor -- start 2023-06-10T19:07:37.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.442+0000 7fd13a169640 1 -- start start 2023-06-10T19:07:37.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.442+0000 7fd13a169640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd11c003a20 0x7fd134149070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:37.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.442+0000 7fd13a169640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd134148a60 0x7fd13414d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:37.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.442+0000 7fd13a169640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd1340cc7d0 0x7fd1340ae280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:37.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.442+0000 7fd13a169640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd13414e1a0 con 0x7fd134148a60 2023-06-10T19:07:37.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.442+0000 7fd13a169640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1340c4220 con 0x7fd11c003a20 2023-06-10T19:07:37.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.442+0000 7fd13a169640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd134148ed0 con 0x7fd1340cc7d0 2023-06-10T19:07:37.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.442+0000 7fd132ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd134148a60 0x7fd13414d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:37.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.442+0000 7fd132ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd134148a60 0x7fd13414d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43380/0 (socket says 172.21.15.53:43380) 2023-06-10T19:07:37.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.442+0000 7fd132ffd640 1 -- 172.21.15.53:0/2220632391 learned_addr learned my addr 172.21.15.53:0/2220632391 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:37.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.442+0000 7fd1337fe640 1 --2- 172.21.15.53:0/2220632391 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd11c003a20 0x7fd134149070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:37.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.442+0000 7fd133fff640 1 --2- 172.21.15.53:0/2220632391 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd1340cc7d0 0x7fd1340ae280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:37.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.446+0000 7fd132ffd640 1 -- 172.21.15.53:0/2220632391 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd1340cc7d0 msgr2=0x7fd1340ae280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:37.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.446+0000 7fd132ffd640 1 --2- 172.21.15.53:0/2220632391 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd1340cc7d0 0x7fd1340ae280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:37.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.446+0000 7fd132ffd640 1 -- 172.21.15.53:0/2220632391 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd11c003a20 msgr2=0x7fd134149070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:37.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.446+0000 7fd132ffd640 1 --2- 172.21.15.53:0/2220632391 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd11c003a20 0x7fd134149070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:37.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.446+0000 7fd132ffd640 1 -- 172.21.15.53:0/2220632391 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1340cc340 con 0x7fd134148a60 2023-06-10T19:07:37.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.446+0000 7fd132ffd640 1 --2- 172.21.15.53:0/2220632391 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd134148a60 0x7fd13414d900 secure :-1 s=READY pgs=2453 cs=0 l=1 rev1=1 crypto rx=0x7fd12800e580 tx=0x7fd12800ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:37.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.446+0000 7fd11bfff640 1 -- 172.21.15.53:0/2220632391 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1280052e0 con 0x7fd134148a60 2023-06-10T19:07:37.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.446+0000 7fd11bfff640 1 -- 172.21.15.53:0/2220632391 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd128005440 con 0x7fd134148a60 2023-06-10T19:07:37.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.446+0000 7fd13a169640 1 -- 172.21.15.53:0/2220632391 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1340cba10 con 0x7fd134148a60 2023-06-10T19:07:37.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.446+0000 7fd11bfff640 1 -- 172.21.15.53:0/2220632391 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd128003820 con 0x7fd134148a60 2023-06-10T19:07:37.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.446+0000 7fd13a169640 1 -- 172.21.15.53:0/2220632391 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1340cbfd0 con 0x7fd134148a60 2023-06-10T19:07:37.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.446+0000 7fd13a169640 1 -- 172.21.15.53:0/2220632391 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1340cc4d0 con 0x7fd134148a60 2023-06-10T19:07:37.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.446+0000 7fd11bfff640 1 -- 172.21.15.53:0/2220632391 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd128003980 con 0x7fd134148a60 2023-06-10T19:07:37.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.446+0000 7fd11bfff640 1 --2- 172.21.15.53:0/2220632391 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd120066280 0x7fd120068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:37.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.446+0000 7fd11bfff640 1 -- 172.21.15.53:0/2220632391 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd128083c50 con 0x7fd134148a60 2023-06-10T19:07:37.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.446+0000 7fd1337fe640 1 --2- 172.21.15.53:0/2220632391 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd120066280 0x7fd120068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:37.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.446+0000 7fd1337fe640 1 --2- 172.21.15.53:0/2220632391 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd120066280 0x7fd120068730 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fd12c0af000 tx=0x7fd12c0a7040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:37.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.450+0000 7fd11bfff640 1 -- 172.21.15.53:0/2220632391 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd128051040 con 0x7fd134148a60 2023-06-10T19:07:37.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.634+0000 7fd13a169640 1 -- 172.21.15.53:0/2220632391 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd13404d790 con 0x7fd134148a60 2023-06-10T19:07:37.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.634+0000 7fd11bfff640 1 -- 172.21.15.53:0/2220632391 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 96 v96) v1 ==== 94+0+4685 (secure 0 0 0) 0x7fd128054660 con 0x7fd134148a60 2023-06-10T19:07:37.638 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:07:37.638 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":96,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8614,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3518533956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3518533956},{"type":"v1","addr":"172.21.15.117:6835","nonce":3518533956}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92},{"gid":8617,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/2615123885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2615123885},{"type":"v1","addr":"172.21.15.117:6837","nonce":2615123885}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92},{"gid":10551,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/3498697556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3498697556},{"type":"v1","addr":"172.21.15.53:6833","nonce":3498697556}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92}],"filesystems":[{"mdsmap":{"epoch":96,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:07:15.723316+0000","modified":"2023-06-10T19:07:18.354630+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10557},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10557":{"gid":10557,"name":"c","rank":0,"incarnation":93,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/3721509006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":3721509006},{"type":"v1","addr":"172.21.15.53:6835","nonce":3721509006}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-06-10T19:07:37.638 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 96 2023-06-10T19:07:37.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.638+0000 7fd13a169640 1 -- 172.21.15.53:0/2220632391 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd120066280 msgr2=0x7fd120068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:37.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.638+0000 7fd13a169640 1 --2- 172.21.15.53:0/2220632391 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd120066280 0x7fd120068730 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fd12c0af000 tx=0x7fd12c0a7040 comp rx=0 tx=0).stop 2023-06-10T19:07:37.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.638+0000 7fd13a169640 1 -- 172.21.15.53:0/2220632391 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd134148a60 msgr2=0x7fd13414d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:37.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.638+0000 7fd13a169640 1 --2- 172.21.15.53:0/2220632391 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd134148a60 0x7fd13414d900 secure :-1 s=READY pgs=2453 cs=0 l=1 rev1=1 crypto rx=0x7fd12800e580 tx=0x7fd12800ea40 comp rx=0 tx=0).stop 2023-06-10T19:07:37.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.638+0000 7fd13a169640 1 -- 172.21.15.53:0/2220632391 shutdown_connections 2023-06-10T19:07:37.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.638+0000 7fd13a169640 1 --2- 172.21.15.53:0/2220632391 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd120066280 0x7fd120068730 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:37.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.638+0000 7fd13a169640 1 --2- 172.21.15.53:0/2220632391 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd1340cc7d0 0x7fd1340ae280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:37.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.638+0000 7fd13a169640 1 --2- 172.21.15.53:0/2220632391 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd134148a60 0x7fd13414d900 unknown :-1 s=CLOSED pgs=2453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:37.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.638+0000 7fd13a169640 1 --2- 172.21.15.53:0/2220632391 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd11c003a20 0x7fd134149070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:37.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.638+0000 7fd13a169640 1 -- 172.21.15.53:0/2220632391 >> 172.21.15.53:0/2220632391 conn(0x7fd13406a0d0 msgr2=0x7fd1340ca370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:37.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.638+0000 7fd13a169640 1 -- 172.21.15.53:0/2220632391 shutdown_connections 2023-06-10T19:07:37.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:37.638+0000 7fd13a169640 1 -- 172.21.15.53:0/2220632391 wait complete. 2023-06-10T19:07:37.655 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session evict 10737 2023-06-10T19:07:38.172 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:2023-06-10T19:07:38.170+0000 7fec92ffd640 -1 client.10737 I was blocklisted at osd epoch 168 2023-06-10T19:07:38.187 DEBUG:tasks.cephfs.filesystem:_json_asok output empty 2023-06-10T19:07:38.187 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-10T19:07:38.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:38.306+0000 7fb2c3334640 1 Processor -- start 2023-06-10T19:07:38.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:38.306+0000 7fb2c3334640 1 -- start start 2023-06-10T19:07:38.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:38.306+0000 7fb2c3334640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb2bc0c9840 0x7fb2bc0c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:38.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:38.306+0000 7fb2c3334640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb2bc071060 0x7fb2bc0af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:38.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:38.306+0000 7fb2c3334640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2bc0afc60 0x7fb2bc15d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:38.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:38.306+0000 7fb2c3334640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2bc159b50 con 0x7fb2bc0c9840 2023-06-10T19:07:38.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:38.306+0000 7fb2c3334640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2bc0ca150 con 0x7fb2bc071060 2023-06-10T19:07:38.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:38.306+0000 7fb2c3334640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2bc0702a0 con 0x7fb2bc0afc60 2023-06-10T19:07:38.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:38.306+0000 7fb2c10d0640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb2bc0c9840 0x7fb2bc0c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:38.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:38.306+0000 7fb2c10d0640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb2bc0c9840 0x7fb2bc0c9c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43382/0 (socket says 172.21.15.53:43382) 2023-06-10T19:07:38.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:38.306+0000 7fb2c10d0640 1 -- 172.21.15.53:0/2960381663 learned_addr learned my addr 172.21.15.53:0/2960381663 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:38.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:38.306+0000 7fb2c18d1640 1 --2- 172.21.15.53:0/2960381663 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2bc0afc60 0x7fb2bc15d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:38.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:38.306+0000 7fb2c08cf640 1 --2- 172.21.15.53:0/2960381663 >> v2:172.21.15.117:3300/0 conn(0x7fb2bc071060 0x7fb2bc0af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:38.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:38.306+0000 7fb2c10d0640 1 -- 172.21.15.53:0/2960381663 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2bc0afc60 msgr2=0x7fb2bc15d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:38.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:38.306+0000 7fb2c10d0640 1 --2- 172.21.15.53:0/2960381663 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2bc0afc60 0x7fb2bc15d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:38.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:38.306+0000 7fb2c10d0640 1 -- 172.21.15.53:0/2960381663 >> v2:172.21.15.117:3300/0 conn(0x7fb2bc071060 msgr2=0x7fb2bc0af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:38.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:38.306+0000 7fb2c10d0640 1 --2- 172.21.15.53:0/2960381663 >> v2:172.21.15.117:3300/0 conn(0x7fb2bc071060 0x7fb2bc0af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:38.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:38.306+0000 7fb2c10d0640 1 -- 172.21.15.53:0/2960381663 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2bc070580 con 0x7fb2bc0c9840 2023-06-10T19:07:38.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:38.306+0000 7fb2c08cf640 1 --2- 172.21.15.53:0/2960381663 >> v2:172.21.15.117:3300/0 conn(0x7fb2bc071060 0x7fb2bc0af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:07:38.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:38.310+0000 7fb2c10d0640 1 --2- 172.21.15.53:0/2960381663 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2bc0c9840 0x7fb2bc0c9c10 secure :-1 s=READY pgs=2454 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc06e650 tx=0x7fb2b801c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d89d7921328496de server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:38.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:38.310+0000 7fb2b3fff640 1 -- 172.21.15.53:0/2960381663 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b80ab600 con 0x7fb2bc0c9840 2023-06-10T19:07:38.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:38.310+0000 7fb2b3fff640 1 -- 172.21.15.53:0/2960381663 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2b80a7050 con 0x7fb2bc0c9840 2023-06-10T19:07:38.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:38.310+0000 7fb2b3fff640 1 -- 172.21.15.53:0/2960381663 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b80ab980 con 0x7fb2bc0c9840 2023-06-10T19:07:38.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:38.310+0000 7fb2c3334640 1 -- 172.21.15.53:0/2960381663 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2bc0c9840 msgr2=0x7fb2bc0c9c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:38.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:38.310+0000 7fb2c3334640 1 --2- 172.21.15.53:0/2960381663 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2bc0c9840 0x7fb2bc0c9c10 secure :-1 s=READY pgs=2454 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc06e650 tx=0x7fb2b801c210 comp rx=0 tx=0).stop 2023-06-10T19:07:38.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:38.310+0000 7fb2c3334640 1 -- 172.21.15.53:0/2960381663 shutdown_connections 2023-06-10T19:07:38.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:38.310+0000 7fb2c3334640 1 --2- 172.21.15.53:0/2960381663 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2bc0afc60 0x7fb2bc15d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:38.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:38.310+0000 7fb2c3334640 1 --2- 172.21.15.53:0/2960381663 >> v2:172.21.15.117:3300/0 conn(0x7fb2bc071060 0x7fb2bc0af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:38.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:38.310+0000 7fb2c3334640 1 --2- 172.21.15.53:0/2960381663 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2bc0c9840 0x7fb2bc0c9c10 unknown :-1 s=CLOSED pgs=2454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:38.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:38.310+0000 7fb2c3334640 1 -- 172.21.15.53:0/2960381663 >> 172.21.15.53:0/2960381663 conn(0x7fb2bc06a0d0 msgr2=0x7fb2bc0ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:38.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:38.310+0000 7fb2c3334640 1 -- 172.21.15.53:0/2960381663 shutdown_connections 2023-06-10T19:07:38.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:38.310+0000 7fb2c3334640 1 -- 172.21.15.53:0/2960381663 wait complete. 2023-06-10T19:07:38.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:38.310+0000 7fb2c3334640 1 Processor -- start 2023-06-10T19:07:38.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:38.310+0000 7fb2c3334640 1 -- start start 2023-06-10T19:07:38.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:38.314+0000 7fb2c3334640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2bc071060 0x7fb2bc151bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:38.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:38.314+0000 7fb2c3334640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2bc0afc60 0x7fb2bc150dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:38.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:38.314+0000 7fb2c3334640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2bc0c9840 0x7fb2bc151310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:38.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:38.314+0000 7fb2c3334640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2bc0b2210 con 0x7fb2bc0c9840 2023-06-10T19:07:38.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:38.314+0000 7fb2c3334640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2bc153df0 con 0x7fb2bc071060 2023-06-10T19:07:38.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:38.314+0000 7fb2c3334640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2bc0b1bc0 con 0x7fb2bc0afc60 2023-06-10T19:07:38.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:38.314+0000 7fb2c18d1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2bc0c9840 0x7fb2bc151310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:38.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:38.314+0000 7fb2c18d1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2bc0c9840 0x7fb2bc151310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:43388/0 (socket says 172.21.15.53:43388) 2023-06-10T19:07:38.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:38.314+0000 7fb2c18d1640 1 -- 172.21.15.53:0/481292776 learned_addr learned my addr 172.21.15.53:0/481292776 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:38.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:38.314+0000 7fb2c08cf640 1 --2- 172.21.15.53:0/481292776 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2bc0afc60 0x7fb2bc150dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:38.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:38.314+0000 7fb2c10d0640 1 --2- 172.21.15.53:0/481292776 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2bc071060 0x7fb2bc151bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:38.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:38.314+0000 7fb2c18d1640 1 -- 172.21.15.53:0/481292776 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2bc0afc60 msgr2=0x7fb2bc150dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:38.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:38.314+0000 7fb2c18d1640 1 --2- 172.21.15.53:0/481292776 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2bc0afc60 0x7fb2bc150dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:38.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:38.314+0000 7fb2c18d1640 1 -- 172.21.15.53:0/481292776 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2bc071060 msgr2=0x7fb2bc151bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:38.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:38.314+0000 7fb2c18d1640 1 --2- 172.21.15.53:0/481292776 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2bc071060 0x7fb2bc151bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:38.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:38.314+0000 7fb2c18d1640 1 -- 172.21.15.53:0/481292776 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2b80094d0 con 0x7fb2bc0c9840 2023-06-10T19:07:38.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:38.314+0000 7fb2c10d0640 1 --2- 172.21.15.53:0/481292776 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2bc071060 0x7fb2bc151bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:07:38.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:38.314+0000 7fb2c08cf640 1 --2- 172.21.15.53:0/481292776 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2bc0afc60 0x7fb2bc150dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:07:38.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:38.314+0000 7fb2c18d1640 1 --2- 172.21.15.53:0/481292776 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2bc0c9840 0x7fb2bc151310 secure :-1 s=READY pgs=2455 cs=0 l=1 rev1=1 crypto rx=0x7fb2b4007e40 tx=0x7fb2b400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:38.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:38.314+0000 7fb2b1ffb640 1 -- 172.21.15.53:0/481292776 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b4014620 con 0x7fb2bc0c9840 2023-06-10T19:07:38.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:38.314+0000 7fb2b1ffb640 1 -- 172.21.15.53:0/481292776 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2b400ee90 con 0x7fb2bc0c9840 2023-06-10T19:07:38.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:38.314+0000 7fb2c3334640 1 -- 172.21.15.53:0/481292776 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2bc0b1ea0 con 0x7fb2bc0c9840 2023-06-10T19:07:38.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:38.314+0000 7fb2b1ffb640 1 -- 172.21.15.53:0/481292776 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b40149e0 con 0x7fb2bc0c9840 2023-06-10T19:07:38.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:38.314+0000 7fb2c3334640 1 -- 172.21.15.53:0/481292776 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2bc1539d0 con 0x7fb2bc0c9840 2023-06-10T19:07:38.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:38.314+0000 7fb2c3334640 1 -- 172.21.15.53:0/481292776 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2bc06b010 con 0x7fb2bc0c9840 2023-06-10T19:07:38.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:38.314+0000 7fb2b1ffb640 1 -- 172.21.15.53:0/481292776 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb2b4014b40 con 0x7fb2bc0c9840 2023-06-10T19:07:38.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:38.314+0000 7fb2b1ffb640 1 --2- 172.21.15.53:0/481292776 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb2a0066280 0x7fb2a0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:38.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:38.314+0000 7fb2b1ffb640 1 -- 172.21.15.53:0/481292776 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6105+0+0 (secure 0 0 0) 0x7fb2b4084710 con 0x7fb2bc0c9840 2023-06-10T19:07:38.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:38.314+0000 7fb2c10d0640 1 --2- 172.21.15.53:0/481292776 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb2a0066280 0x7fb2a0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:38.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:38.318+0000 7fb2c10d0640 1 --2- 172.21.15.53:0/481292776 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb2a0066280 0x7fb2a0068730 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fb2b80ad000 tx=0x7fb2b8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:38.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:38.318+0000 7fb2b1ffb640 1 -- 172.21.15.53:0/481292776 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb2b4051b50 con 0x7fb2bc0c9840 2023-06-10T19:07:38.461 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-10T19:07:38.464 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-10T19:07:38.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:38.502+0000 7fb2c3334640 1 -- 172.21.15.53:0/481292776 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb2bc04d790 con 0x7fb2bc0c9840 2023-06-10T19:07:38.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:38.502+0000 7fb2b1ffb640 1 -- 172.21.15.53:0/481292776 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v96) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb2b4055170 con 0x7fb2bc0c9840 2023-06-10T19:07:38.505 INFO:teuthology.orchestra.run.smithi053.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-06-10T19:07:38.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:38.506+0000 7fb2c3334640 1 -- 172.21.15.53:0/481292776 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb2a0066280 msgr2=0x7fb2a0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:38.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:38.506+0000 7fb2c3334640 1 --2- 172.21.15.53:0/481292776 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb2a0066280 0x7fb2a0068730 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fb2b80ad000 tx=0x7fb2b8008040 comp rx=0 tx=0).stop 2023-06-10T19:07:38.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:38.506+0000 7fb2c3334640 1 -- 172.21.15.53:0/481292776 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2bc0c9840 msgr2=0x7fb2bc151310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:38.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:38.506+0000 7fb2c3334640 1 --2- 172.21.15.53:0/481292776 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2bc0c9840 0x7fb2bc151310 secure :-1 s=READY pgs=2455 cs=0 l=1 rev1=1 crypto rx=0x7fb2b4007e40 tx=0x7fb2b400e4b0 comp rx=0 tx=0).stop 2023-06-10T19:07:38.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:38.506+0000 7fb2c3334640 1 -- 172.21.15.53:0/481292776 shutdown_connections 2023-06-10T19:07:38.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:38.506+0000 7fb2c3334640 1 --2- 172.21.15.53:0/481292776 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb2a0066280 0x7fb2a0068730 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:38.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:38.506+0000 7fb2c3334640 1 --2- 172.21.15.53:0/481292776 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2bc0c9840 0x7fb2bc151310 unknown :-1 s=CLOSED pgs=2455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:38.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:38.506+0000 7fb2c3334640 1 --2- 172.21.15.53:0/481292776 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb2bc0afc60 0x7fb2bc150dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:38.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:38.506+0000 7fb2c3334640 1 --2- 172.21.15.53:0/481292776 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2bc071060 0x7fb2bc151bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:38.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:38.506+0000 7fb2c3334640 1 -- 172.21.15.53:0/481292776 >> 172.21.15.53:0/481292776 conn(0x7fb2bc06a0d0 msgr2=0x7fb2bc159c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:38.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:38.506+0000 7fb2c3334640 1 -- 172.21.15.53:0/481292776 shutdown_connections 2023-06-10T19:07:38.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:38.506+0000 7fb2c3334640 1 -- 172.21.15.53:0/481292776 wait complete. 2023-06-10T19:07:38.521 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-10T19:07:38.522 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-10T19:07:38.522 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi053.front.sepia.ceph.com 2023-06-10T19:07:38.522 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-06-10T19:07:38.523 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-06-10T19:07:38.523 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-10T19:07:38.523 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-10T19:07:38.523 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-10T19:07:38.524 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-06-10T19:07:38.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:07:38.524 DEBUG:teuthology.orchestra.run.smithi053:> ip addr 2023-06-10T19:07:38.567 INFO:teuthology.orchestra.run.smithi053.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-10T19:07:38.567 INFO:teuthology.orchestra.run.smithi053.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-10T19:07:38.567 INFO:teuthology.orchestra.run.smithi053.stdout: inet 127.0.0.1/8 scope host lo 2023-06-10T19:07:38.567 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:07:38.568 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 ::1/128 scope host 2023-06-10T19:07:38.568 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:07:38.568 INFO:teuthology.orchestra.run.smithi053.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T19:07:38.568 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:da brd ff:ff:ff:ff:ff:ff 2023-06-10T19:07:38.568 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f0 2023-06-10T19:07:38.568 INFO:teuthology.orchestra.run.smithi053.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T19:07:38.568 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:db brd ff:ff:ff:ff:ff:ff 2023-06-10T19:07:38.569 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f1 2023-06-10T19:07:38.569 INFO:teuthology.orchestra.run.smithi053.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-10T19:07:38.569 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:18 brd ff:ff:ff:ff:ff:ff 2023-06-10T19:07:38.569 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f0 2023-06-10T19:07:38.569 INFO:teuthology.orchestra.run.smithi053.stdout: inet 172.21.15.53/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-06-10T19:07:38.569 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft 41591sec preferred_lft 41591sec 2023-06-10T19:07:38.569 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::ae1f:6bff:fef8:3718/64 scope link 2023-06-10T19:07:38.570 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:07:38.570 INFO:teuthology.orchestra.run.smithi053.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T19:07:38.570 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:19 brd ff:ff:ff:ff:ff:ff 2023-06-10T19:07:38.570 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f1 2023-06-10T19:07:38.570 INFO:teuthology.orchestra.run.smithi053.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-06-10T19:07:38.570 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 02:42:49:3d:ee:1e brd ff:ff:ff:ff:ff:ff 2023-06-10T19:07:38.570 INFO:teuthology.orchestra.run.smithi053.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-06-10T19:07:38.571 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:07:38.571 INFO:teuthology.orchestra.run.smithi053.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-10T19:07:38.571 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-06-10T19:07:38.571 INFO:teuthology.orchestra.run.smithi053.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-06-10T19:07:38.571 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:07:38.571 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-06-10T19:07:38.571 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:07:38.572 INFO:teuthology.orchestra.run.smithi053.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-10T19:07:38.572 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-06-10T19:07:38.572 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-06-10T19:07:38.572 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:07:38.572 INFO:teuthology.orchestra.run.smithi053.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-10T19:07:38.572 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-06-10T19:07:38.573 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-06-10T19:07:38.573 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:07:38.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:07:38.574 DEBUG:teuthology.orchestra.run.smithi053:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-10T19:07:38.620 INFO:teuthology.orchestra.run.smithi053.stdout:1 2023-06-10T19:07:38.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:07:38.622 DEBUG:teuthology.orchestra.run.smithi053:> route 2023-06-10T19:07:38.671 INFO:teuthology.orchestra.run.smithi053.stdout:Kernel IP routing table 2023-06-10T19:07:38.671 INFO:teuthology.orchestra.run.smithi053.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-10T19:07:38.672 INFO:teuthology.orchestra.run.smithi053.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-06-10T19:07:38.672 INFO:teuthology.orchestra.run.smithi053.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-06-10T19:07:38.672 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-06-10T19:07:38.672 INFO:teuthology.orchestra.run.smithi053.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-10T19:07:38.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:07:38.673 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec bash -c ' 2023-06-10T19:07:38.673 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2023-06-10T19:07:38.673 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-06-10T19:07:38.674 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-06-10T19:07:38.674 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-06-10T19:07:38.674 DEBUG:teuthology.orchestra.run.smithi053:> ') 2023-06-10T19:07:38.746 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:07:38.747 DEBUG:teuthology.orchestra.run.smithi053:> ip netns list 2023-06-10T19:07:38.794 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-06-10T19:07:38.795 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-06-10T19:07:38.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:07:38.796 DEBUG:teuthology.orchestra.run.smithi053:> ip netns list-id 2023-06-10T19:07:38.842 INFO:teuthology.orchestra.run.smithi053.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-06-10T19:07:38.843 INFO:teuthology.orchestra.run.smithi053.stdout:nsid 1 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.2) 2023-06-10T19:07:38.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:07:38.843 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec bash -c ' 2023-06-10T19:07:38.844 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2023-06-10T19:07:38.844 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-06-10T19:07:38.844 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 2 2023-06-10T19:07:38.845 DEBUG:teuthology.orchestra.run.smithi053:> ') 2023-06-10T19:07:38.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:07:38.918 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr 2023-06-10T19:07:38.973 INFO:teuthology.orchestra.run.smithi053.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-10T19:07:38.973 INFO:teuthology.orchestra.run.smithi053.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-10T19:07:38.973 INFO:teuthology.orchestra.run.smithi053.stdout: inet 127.0.0.1/8 scope host lo 2023-06-10T19:07:38.974 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:07:38.974 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 ::1/128 scope host 2023-06-10T19:07:38.974 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:07:38.974 INFO:teuthology.orchestra.run.smithi053.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-10T19:07:38.974 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 66:f3:04:5b:31:32 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-06-10T19:07:38.974 INFO:teuthology.orchestra.run.smithi053.stdout: inet 192.168.0.2/16 brd 192.168.255.255 scope global veth0 2023-06-10T19:07:38.974 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:07:38.975 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::64f3:4ff:fe5b:3132/64 scope link 2023-06-10T19:07:38.975 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:07:38.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:07:38.976 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-06-10T19:07:39.030 INFO:teuthology.orchestra.run.smithi053.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-10T19:07:39.030 INFO:teuthology.orchestra.run.smithi053.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-10T19:07:39.030 INFO:teuthology.orchestra.run.smithi053.stdout: inet 127.0.0.1/8 scope host lo 2023-06-10T19:07:39.030 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:07:39.030 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 ::1/128 scope host 2023-06-10T19:07:39.030 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:07:39.031 INFO:teuthology.orchestra.run.smithi053.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-10T19:07:39.031 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 9e:f5:0d:ef:b4:0f brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-06-10T19:07:39.031 INFO:teuthology.orchestra.run.smithi053.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-06-10T19:07:39.031 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:07:39.031 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::9cf5:dff:feef:b40f/64 scope link 2023-06-10T19:07:39.031 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:07:39.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:07:39.033 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr 2023-06-10T19:07:39.086 INFO:teuthology.orchestra.run.smithi053.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-10T19:07:39.086 INFO:teuthology.orchestra.run.smithi053.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-10T19:07:39.087 INFO:teuthology.orchestra.run.smithi053.stdout: inet 127.0.0.1/8 scope host lo 2023-06-10T19:07:39.087 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:07:39.087 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 ::1/128 scope host 2023-06-10T19:07:39.087 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:07:39.087 INFO:teuthology.orchestra.run.smithi053.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-10T19:07:39.087 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 66:f3:04:5b:31:32 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-06-10T19:07:39.087 INFO:teuthology.orchestra.run.smithi053.stdout: inet 192.168.0.2/16 brd 192.168.255.255 scope global veth0 2023-06-10T19:07:39.087 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:07:39.088 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::64f3:4ff:fe5b:3132/64 scope link 2023-06-10T19:07:39.088 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:07:39.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:07:39.089 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr 2023-06-10T19:07:39.142 INFO:teuthology.orchestra.run.smithi053.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-10T19:07:39.143 INFO:teuthology.orchestra.run.smithi053.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-10T19:07:39.143 INFO:teuthology.orchestra.run.smithi053.stdout: inet 127.0.0.1/8 scope host lo 2023-06-10T19:07:39.143 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:07:39.143 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 ::1/128 scope host 2023-06-10T19:07:39.143 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:07:39.144 INFO:teuthology.orchestra.run.smithi053.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-10T19:07:39.144 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 66:f3:04:5b:31:32 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-06-10T19:07:39.144 INFO:teuthology.orchestra.run.smithi053.stdout: inet 192.168.0.2/16 brd 192.168.255.255 scope global veth0 2023-06-10T19:07:39.144 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:07:39.144 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::64f3:4ff:fe5b:3132/64 scope link 2023-06-10T19:07:39.144 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:07:39.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:07:39.146 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-06-10T19:07:39.200 INFO:teuthology.orchestra.run.smithi053.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-10T19:07:39.200 INFO:teuthology.orchestra.run.smithi053.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-10T19:07:39.200 INFO:teuthology.orchestra.run.smithi053.stdout: inet 127.0.0.1/8 scope host lo 2023-06-10T19:07:39.200 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:07:39.200 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 ::1/128 scope host 2023-06-10T19:07:39.201 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:07:39.201 INFO:teuthology.orchestra.run.smithi053.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-10T19:07:39.201 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 9e:f5:0d:ef:b4:0f brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-06-10T19:07:39.201 INFO:teuthology.orchestra.run.smithi053.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-06-10T19:07:39.201 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:07:39.201 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::9cf5:dff:feef:b40f/64 scope link 2023-06-10T19:07:39.201 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:07:39.202 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.3/16 2023-06-10T19:07:39.203 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:07:39.203 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec bash -c ' 2023-06-10T19:07:39.203 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2023-06-10T19:07:39.204 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.2 2023-06-10T19:07:39.204 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.3/16 brd 192.168.255.255 dev veth0 2023-06-10T19:07:39.204 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-06-10T19:07:39.205 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-06-10T19:07:39.205 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-06-10T19:07:39.205 DEBUG:teuthology.orchestra.run.smithi053:> ') 2023-06-10T19:07:39.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:07:39.300 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec bash -c ' 2023-06-10T19:07:39.300 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2023-06-10T19:07:39.301 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link set brx.2 up 2023-06-10T19:07:39.301 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link set dev brx.2 master ceph-brx 2023-06-10T19:07:39.301 DEBUG:teuthology.orchestra.run.smithi053:> ') 2023-06-10T19:07:39.320 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-06-10T19:07:39.320 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-10T19:07:39.321 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-06-10T19:07:39.370 INFO:teuthology.orchestra.run.smithi053.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-06-10T19:07:39.370 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-10T19:07:39.370 DEBUG:teuthology.orchestra.run.smithi053:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-06-10T19:07:39.418 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2023-06-10T19:07:39.475 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T19:07:39.475 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T19:07:39.528 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T19:07:39.530 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T19:07:39.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:07:39.531 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2023-06-10T19:07:39.578 INFO:teuthology.orchestra.run.smithi053.stdout:45 2023-06-10T19:07:39.579 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [45] 2023-06-10T19:07:39.579 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 0) 2023-06-10T19:07:39.623 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2023-06-10T19:07:39.635 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T19:07:39.636 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T19:07:39.690 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T19:07:39.690 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T19:07:39.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:07:39.692 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2023-06-10T19:07:39.703 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:2023-06-10T19:07:39.701+0000 7fe27ce00580 -1 init, newargv = 0x5651c86d12c0 newargc=15 2023-06-10T19:07:39.703 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[69019]: starting ceph client 2023-06-10T19:07:39.707 INFO:teuthology.orchestra.run.smithi053.stdout:45 2023-06-10T19:07:39.708 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[69019]: starting fuse 2023-06-10T19:07:40.808 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2023-06-10T19:07:40.825 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T19:07:40.825 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T19:07:40.878 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T19:07:40.879 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T19:07:40.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:07:40.880 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2023-06-10T19:07:40.927 INFO:teuthology.orchestra.run.smithi053.stdout:45 2023-06-10T19:07:40.927 INFO:teuthology.orchestra.run.smithi053.stdout:46 2023-06-10T19:07:40.927 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45, 46] 2023-06-10T19:07:40.928 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-06-10T19:07:40.928 DEBUG:teuthology.orchestra.run.smithi053:> import glob 2023-06-10T19:07:40.928 DEBUG:teuthology.orchestra.run.smithi053:> import re 2023-06-10T19:07:40.929 DEBUG:teuthology.orchestra.run.smithi053:> import os 2023-06-10T19:07:40.929 DEBUG:teuthology.orchestra.run.smithi053:> import subprocess 2023-06-10T19:07:40.929 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:07:40.929 DEBUG:teuthology.orchestra.run.smithi053:> def _find_admin_socket(client_name): 2023-06-10T19:07:40.930 DEBUG:teuthology.orchestra.run.smithi053:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-06-10T19:07:40.930 DEBUG:teuthology.orchestra.run.smithi053:> files = glob.glob(asok_path) 2023-06-10T19:07:40.930 DEBUG:teuthology.orchestra.run.smithi053:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-06-10T19:07:40.931 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:07:40.931 DEBUG:teuthology.orchestra.run.smithi053:> # Given a non-glob path, it better be there 2023-06-10T19:07:40.931 DEBUG:teuthology.orchestra.run.smithi053:> if "*" not in asok_path: 2023-06-10T19:07:40.931 DEBUG:teuthology.orchestra.run.smithi053:> assert(len(files) == 1) 2023-06-10T19:07:40.932 DEBUG:teuthology.orchestra.run.smithi053:> return files[0] 2023-06-10T19:07:40.932 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:07:40.932 DEBUG:teuthology.orchestra.run.smithi053:> for f in files: 2023-06-10T19:07:40.933 DEBUG:teuthology.orchestra.run.smithi053:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-06-10T19:07:40.933 DEBUG:teuthology.orchestra.run.smithi053:> if os.path.exists("/proc/{0}".format(pid)): 2023-06-10T19:07:40.933 DEBUG:teuthology.orchestra.run.smithi053:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-06-10T19:07:40.934 DEBUG:teuthology.orchestra.run.smithi053:> contents = proc_f.read() 2023-06-10T19:07:40.934 DEBUG:teuthology.orchestra.run.smithi053:> if mountpoint in contents: 2023-06-10T19:07:40.934 DEBUG:teuthology.orchestra.run.smithi053:> return f 2023-06-10T19:07:40.934 DEBUG:teuthology.orchestra.run.smithi053:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-06-10T19:07:40.935 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:07:40.935 DEBUG:teuthology.orchestra.run.smithi053:> print(_find_admin_socket("client.0")) 2023-06-10T19:07:40.935 DEBUG:teuthology.orchestra.run.smithi053:> ' 2023-06-10T19:07:41.050 INFO:teuthology.orchestra.run.smithi053.stdout:/var/run/ceph/ceph-client.0.69019.asok 2023-06-10T19:07:41.231 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.69019.asok 2023-06-10T19:07:41.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:07:41.232 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.69019.asok status 2023-06-10T19:07:41.393 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-06-10T19:07:41.393 INFO:teuthology.orchestra.run.smithi053.stdout: "metadata": { 2023-06-10T19:07:41.393 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_sha1": "219d315c3a0b2075e570fb1964be2ad33fe7a9c8", 2023-06-10T19:07:41.393 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_version": "ceph version 18.0.0-4359-g219d315c (219d315c3a0b2075e570fb1964be2ad33fe7a9c8) reef (dev)", 2023-06-10T19:07:41.394 INFO:teuthology.orchestra.run.smithi053.stdout: "entity_id": "0", 2023-06-10T19:07:41.394 INFO:teuthology.orchestra.run.smithi053.stdout: "hostname": "smithi053", 2023-06-10T19:07:41.394 INFO:teuthology.orchestra.run.smithi053.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-06-10T19:07:41.394 INFO:teuthology.orchestra.run.smithi053.stdout: "pid": "69019", 2023-06-10T19:07:41.394 INFO:teuthology.orchestra.run.smithi053.stdout: "root": "/" 2023-06-10T19:07:41.394 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:07:41.394 INFO:teuthology.orchestra.run.smithi053.stdout: "dentry_count": 0, 2023-06-10T19:07:41.394 INFO:teuthology.orchestra.run.smithi053.stdout: "dentry_pinned_count": 0, 2023-06-10T19:07:41.395 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 10848, 2023-06-10T19:07:41.395 INFO:teuthology.orchestra.run.smithi053.stdout: "inst": { 2023-06-10T19:07:41.395 INFO:teuthology.orchestra.run.smithi053.stdout: "name": { 2023-06-10T19:07:41.395 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "client", 2023-06-10T19:07:41.395 INFO:teuthology.orchestra.run.smithi053.stdout: "num": 10848 2023-06-10T19:07:41.395 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:07:41.395 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": { 2023-06-10T19:07:41.395 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2023-06-10T19:07:41.396 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "192.168.0.3:0", 2023-06-10T19:07:41.396 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 528285328 2023-06-10T19:07:41.396 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:07:41.396 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:07:41.396 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": { 2023-06-10T19:07:41.396 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2023-06-10T19:07:41.396 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "192.168.0.3:0", 2023-06-10T19:07:41.397 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 528285328 2023-06-10T19:07:41.397 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:07:41.397 INFO:teuthology.orchestra.run.smithi053.stdout: "inst_str": "client.10848 192.168.0.3:0/528285328", 2023-06-10T19:07:41.397 INFO:teuthology.orchestra.run.smithi053.stdout: "addr_str": "192.168.0.3:0/528285328", 2023-06-10T19:07:41.397 INFO:teuthology.orchestra.run.smithi053.stdout: "inode_count": 1, 2023-06-10T19:07:41.397 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_epoch": 96, 2023-06-10T19:07:41.397 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_epoch": 168, 2023-06-10T19:07:41.397 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_epoch_barrier": 0, 2023-06-10T19:07:41.398 INFO:teuthology.orchestra.run.smithi053.stdout: "blocklisted": false, 2023-06-10T19:07:41.398 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs" 2023-06-10T19:07:41.398 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-06-10T19:07:41.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:07:41.407 DEBUG:teuthology.orchestra.run.smithi053:> stat --file-system '--printf=%T 2023-06-10T19:07:41.407 DEBUG:teuthology.orchestra.run.smithi053:> ' -- /home/ubuntu/cephtest/mnt.1 2023-06-10T19:07:41.413 INFO:teuthology.orchestra.run.smithi053.stdout:fuseblk 2023-06-10T19:07:41.414 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-06-10T19:07:41.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:07:41.414 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-06-10T19:07:41.472 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T19:07:41.473 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:07:41.518 INFO:tasks.cephfs.mount:Creating file a 2023-06-10T19:07:41.519 DEBUG:teuthology.orchestra.run.smithi053:> touch /home/ubuntu/cephtest/mnt.1/a 2023-06-10T19:07:41.575 INFO:tasks.cephfs.mount:Creating file b 2023-06-10T19:07:41.576 DEBUG:teuthology.orchestra.run.smithi053:> touch /home/ubuntu/cephtest/mnt.1/b 2023-06-10T19:07:41.628 INFO:tasks.cephfs.mount:Creating file c 2023-06-10T19:07:41.628 DEBUG:teuthology.orchestra.run.smithi053:> touch /home/ubuntu/cephtest/mnt.1/c 2023-06-10T19:07:41.678 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T19:07:41.679 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:07:41.727 INFO:tasks.cephfs.mount:Checking file a 2023-06-10T19:07:41.727 DEBUG:teuthology.orchestra.run.smithi053:> ls /home/ubuntu/cephtest/mnt.1/a 2023-06-10T19:07:41.779 INFO:teuthology.orchestra.run.smithi053.stdout:/home/ubuntu/cephtest/mnt.1/a 2023-06-10T19:07:41.779 INFO:tasks.cephfs.mount:Checking file b 2023-06-10T19:07:41.780 DEBUG:teuthology.orchestra.run.smithi053:> ls /home/ubuntu/cephtest/mnt.1/b 2023-06-10T19:07:41.828 INFO:teuthology.orchestra.run.smithi053.stdout:/home/ubuntu/cephtest/mnt.1/b 2023-06-10T19:07:41.828 INFO:tasks.cephfs.mount:Checking file c 2023-06-10T19:07:41.829 DEBUG:teuthology.orchestra.run.smithi053:> ls /home/ubuntu/cephtest/mnt.1/c 2023-06-10T19:07:41.878 INFO:teuthology.orchestra.run.smithi053.stdout:/home/ubuntu/cephtest/mnt.1/c 2023-06-10T19:07:41.879 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T19:07:41.879 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:07:41.927 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:07:42.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.101+0000 7fd2e8e5c640 1 Processor -- start 2023-06-10T19:07:42.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.101+0000 7fd2e8e5c640 1 -- start start 2023-06-10T19:07:42.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.101+0000 7fd2e8e5c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd2e40c9840 0x7fd2e40c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:42.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.101+0000 7fd2e8e5c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd2e406b090 0x7fd2e406b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:42.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.101+0000 7fd2e8e5c640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2e4159b50 con 0x7fd2e4071060 2023-06-10T19:07:42.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.101+0000 7fd2e8e5c640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2e40ca150 con 0x7fd2e406b090 2023-06-10T19:07:42.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.101+0000 7fd2e8e5c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e40702a0 con 0x7fd2e40c9840 2023-06-10T19:07:42.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.101+0000 7fd2e2d9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd2e406b090 0x7fd2e406b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:42.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.101+0000 7fd2e2d9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd2e406b090 0x7fd2e406b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45028/0 (socket says 172.21.15.53:45028) 2023-06-10T19:07:42.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.101+0000 7fd2e1d9b640 1 --1- 172.21.15.53:0/2124603979 >> v1:172.21.15.53:6789/0 conn(0x7fd2e4071060 0x7fd2e40af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:35336/0 (socket says 172.21.15.53:35336) 2023-06-10T19:07:42.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.101+0000 7fd2e2d9d640 1 -- 172.21.15.53:0/2124603979 learned_addr learned my addr 172.21.15.53:0/2124603979 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:42.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.101+0000 7fd2e259c640 1 --2- 172.21.15.53:0/2124603979 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd2e40c9840 0x7fd2e40c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:42.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.101+0000 7fd2e2d9d640 1 -- 172.21.15.53:0/2124603979 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd2e40c9840 msgr2=0x7fd2e40c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:42.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.101+0000 7fd2e2d9d640 1 --2- 172.21.15.53:0/2124603979 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd2e40c9840 0x7fd2e40c9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:42.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.101+0000 7fd2e2d9d640 1 -- 172.21.15.53:0/2124603979 >> v1:172.21.15.53:6789/0 conn(0x7fd2e4071060 legacy=0x7fd2e40af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:42.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.101+0000 7fd2e159a640 1 -- 172.21.15.53:0/2124603979 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 682694747 0 0) 0x7fd2e4159b50 con 0x7fd2e4071060 2023-06-10T19:07:42.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.101+0000 7fd2e2d9d640 1 -- 172.21.15.53:0/2124603979 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2e4070580 con 0x7fd2e406b090 2023-06-10T19:07:42.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.105+0000 7fd2e2d9d640 1 --2- 172.21.15.53:0/2124603979 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2e406b090 0x7fd2e406b530 secure :-1 s=READY pgs=2460 cs=0 l=1 rev1=1 crypto rx=0x7fd2d4009870 tx=0x7fd2d401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f7fe25eabcf856e server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:42.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.105+0000 7fd2e159a640 1 -- 172.21.15.53:0/2124603979 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d40aa670 con 0x7fd2e406b090 2023-06-10T19:07:42.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.105+0000 7fd2e159a640 1 -- 172.21.15.53:0/2124603979 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2d40aa7d0 con 0x7fd2e406b090 2023-06-10T19:07:42.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.105+0000 7fd2e159a640 1 -- 172.21.15.53:0/2124603979 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d40aab60 con 0x7fd2e406b090 2023-06-10T19:07:42.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.105+0000 7fd2e8e5c640 1 -- 172.21.15.53:0/2124603979 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2e406b090 msgr2=0x7fd2e406b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:42.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.105+0000 7fd2e8e5c640 1 --2- 172.21.15.53:0/2124603979 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2e406b090 0x7fd2e406b530 secure :-1 s=READY pgs=2460 cs=0 l=1 rev1=1 crypto rx=0x7fd2d4009870 tx=0x7fd2d401c510 comp rx=0 tx=0).stop 2023-06-10T19:07:42.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.105+0000 7fd2e8e5c640 1 -- 172.21.15.53:0/2124603979 shutdown_connections 2023-06-10T19:07:42.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.105+0000 7fd2e8e5c640 1 --2- 172.21.15.53:0/2124603979 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2e406b090 0x7fd2e406b530 unknown :-1 s=CLOSED pgs=2460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:42.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.105+0000 7fd2e8e5c640 1 --2- 172.21.15.53:0/2124603979 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd2e40c9840 0x7fd2e40c9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:42.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.105+0000 7fd2e8e5c640 1 -- 172.21.15.53:0/2124603979 >> 172.21.15.53:0/2124603979 conn(0x7fd2e406a0d0 msgr2=0x7fd2e40ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:42.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.105+0000 7fd2e8e5c640 1 -- 172.21.15.53:0/2124603979 shutdown_connections 2023-06-10T19:07:42.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.105+0000 7fd2e8e5c640 1 -- 172.21.15.53:0/2124603979 wait complete. 2023-06-10T19:07:42.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.105+0000 7fd2e8e5c640 1 Processor -- start 2023-06-10T19:07:42.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.105+0000 7fd2e8e5c640 1 -- start start 2023-06-10T19:07:42.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.105+0000 7fd2e8e5c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd2e406b090 0x7fd2e40b3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:42.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.105+0000 7fd2e8e5c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd2e4071060 0x7fd2e4158480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:42.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.105+0000 7fd2e8e5c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2e40c9840 0x7fd2e41589c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:42.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.105+0000 7fd2e8e5c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e4147a10 con 0x7fd2e40c9840 2023-06-10T19:07:42.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.105+0000 7fd2e8e5c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e40b39a0 con 0x7fd2e4071060 2023-06-10T19:07:42.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.105+0000 7fd2e8e5c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e40b1990 con 0x7fd2e406b090 2023-06-10T19:07:42.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.109+0000 7fd2e2d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2e40c9840 0x7fd2e41589c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:42.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.109+0000 7fd2e2d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2e40c9840 0x7fd2e41589c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45034/0 (socket says 172.21.15.53:45034) 2023-06-10T19:07:42.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.109+0000 7fd2e2d9d640 1 -- 172.21.15.53:0/1096655691 learned_addr learned my addr 172.21.15.53:0/1096655691 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:42.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.109+0000 7fd2e259c640 1 --2- 172.21.15.53:0/1096655691 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd2e406b090 0x7fd2e40b3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:42.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.109+0000 7fd2e1d9b640 1 --2- 172.21.15.53:0/1096655691 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd2e4071060 0x7fd2e4158480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:42.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.109+0000 7fd2e2d9d640 1 -- 172.21.15.53:0/1096655691 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd2e406b090 msgr2=0x7fd2e40b3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:42.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.109+0000 7fd2e2d9d640 1 --2- 172.21.15.53:0/1096655691 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd2e406b090 0x7fd2e40b3460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:42.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.109+0000 7fd2e2d9d640 1 -- 172.21.15.53:0/1096655691 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd2e4071060 msgr2=0x7fd2e4158480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:42.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.109+0000 7fd2e2d9d640 1 --2- 172.21.15.53:0/1096655691 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd2e4071060 0x7fd2e4158480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:42.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.109+0000 7fd2e2d9d640 1 -- 172.21.15.53:0/1096655691 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d40094d0 con 0x7fd2e40c9840 2023-06-10T19:07:42.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.109+0000 7fd2e2d9d640 1 --2- 172.21.15.53:0/1096655691 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2e40c9840 0x7fd2e41589c0 secure :-1 s=READY pgs=2461 cs=0 l=1 rev1=1 crypto rx=0x7fd2d401abc0 tx=0x7fd2d401ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:42.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.109+0000 7fd2daffd640 1 -- 172.21.15.53:0/1096655691 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d40b3800 con 0x7fd2e40c9840 2023-06-10T19:07:42.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.109+0000 7fd2daffd640 1 -- 172.21.15.53:0/1096655691 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2d40b3980 con 0x7fd2e40c9840 2023-06-10T19:07:42.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.109+0000 7fd2e8e5c640 1 -- 172.21.15.53:0/1096655691 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2e414d9d0 con 0x7fd2e40c9840 2023-06-10T19:07:42.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.109+0000 7fd2daffd640 1 -- 172.21.15.53:0/1096655691 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d40b3d30 con 0x7fd2e40c9840 2023-06-10T19:07:42.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.109+0000 7fd2e8e5c640 1 -- 172.21.15.53:0/1096655691 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2e40ad880 con 0x7fd2e40c9840 2023-06-10T19:07:42.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.109+0000 7fd2e8e5c640 1 -- 172.21.15.53:0/1096655691 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2e404d790 con 0x7fd2e40c9840 2023-06-10T19:07:42.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.109+0000 7fd2daffd640 1 -- 172.21.15.53:0/1096655691 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd2d40b2380 con 0x7fd2e40c9840 2023-06-10T19:07:42.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.109+0000 7fd2daffd640 1 --2- 172.21.15.53:0/1096655691 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd2c4066280 0x7fd2c4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:42.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.109+0000 7fd2daffd640 1 -- 172.21.15.53:0/1096655691 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6105+0+0 (secure 0 0 0) 0x7fd2d411df10 con 0x7fd2e40c9840 2023-06-10T19:07:42.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.109+0000 7fd2e259c640 1 --2- 172.21.15.53:0/1096655691 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd2c4066280 0x7fd2c4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:42.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.113+0000 7fd2e259c640 1 --2- 172.21.15.53:0/1096655691 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd2c4066280 0x7fd2c4068730 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc003fd0 tx=0x7fd2dc0039a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:42.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.113+0000 7fd2daffd640 1 -- 172.21.15.53:0/1096655691 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd2d40eb3f0 con 0x7fd2e40c9840 2023-06-10T19:07:42.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.269+0000 7fd2e8e5c640 1 -- 172.21.15.53:0/1096655691 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd2e40cb630 con 0x7fd2e40c9840 2023-06-10T19:07:42.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.269+0000 7fd2daffd640 1 -- 172.21.15.53:0/1096655691 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v168) v1 ==== 74+0+18341 (secure 0 0 0) 0x7fd2d40eea10 con 0x7fd2e40c9840 2023-06-10T19:07:42.274 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:07:42.275 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":168,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:07:38.149577+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-06-10T19:07:13.365954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"166","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-06-10T19:07:14.695077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.0.1:0/4011987522":"2023-06-10T20:07:37.768015+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:07:42.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.273+0000 7fd2e8e5c640 1 -- 172.21.15.53:0/1096655691 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd2c4066280 msgr2=0x7fd2c4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:42.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.273+0000 7fd2e8e5c640 1 --2- 172.21.15.53:0/1096655691 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd2c4066280 0x7fd2c4068730 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc003fd0 tx=0x7fd2dc0039a0 comp rx=0 tx=0).stop 2023-06-10T19:07:42.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.273+0000 7fd2e8e5c640 1 -- 172.21.15.53:0/1096655691 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2e40c9840 msgr2=0x7fd2e41589c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:42.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.273+0000 7fd2e8e5c640 1 --2- 172.21.15.53:0/1096655691 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2e40c9840 0x7fd2e41589c0 secure :-1 s=READY pgs=2461 cs=0 l=1 rev1=1 crypto rx=0x7fd2d401abc0 tx=0x7fd2d401ad50 comp rx=0 tx=0).stop 2023-06-10T19:07:42.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.273+0000 7fd2e8e5c640 1 -- 172.21.15.53:0/1096655691 shutdown_connections 2023-06-10T19:07:42.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.273+0000 7fd2e8e5c640 1 --2- 172.21.15.53:0/1096655691 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd2c4066280 0x7fd2c4068730 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:42.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.273+0000 7fd2e8e5c640 1 --2- 172.21.15.53:0/1096655691 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd2e40c9840 0x7fd2e41589c0 unknown :-1 s=CLOSED pgs=2461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:42.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.273+0000 7fd2e8e5c640 1 --2- 172.21.15.53:0/1096655691 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd2e4071060 0x7fd2e4158480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:42.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.273+0000 7fd2e8e5c640 1 --2- 172.21.15.53:0/1096655691 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd2e406b090 0x7fd2e40b3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:42.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.273+0000 7fd2e8e5c640 1 -- 172.21.15.53:0/1096655691 >> 172.21.15.53:0/1096655691 conn(0x7fd2e406a0d0 msgr2=0x7fd2e40c8b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:42.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.273+0000 7fd2e8e5c640 1 -- 172.21.15.53:0/1096655691 shutdown_connections 2023-06-10T19:07:42.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.273+0000 7fd2e8e5c640 1 -- 172.21.15.53:0/1096655691 wait complete. 2023-06-10T19:07:42.294 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-10T18:52:33.633114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-10T18:52:39.171487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 23, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-10T19:07:13.365954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '166', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 24, 'pool_name': 'cephfs_data', 'create_time': '2023-06-10T19:07:14.695077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '167', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-10T19:07:42.295 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-10T19:07:42.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.413+0000 7f74b9a48640 1 Processor -- start 2023-06-10T19:07:42.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.413+0000 7f74b9a48640 1 -- start start 2023-06-10T19:07:42.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.413+0000 7f74b9a48640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f74b40cec40 0x7f74b40cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:42.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.413+0000 7f74b9a48640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f74b40cbf50 0x7f74b40cc390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:42.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.413+0000 7f74b9a48640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74b40cbac0 con 0x7f74b4159450 2023-06-10T19:07:42.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.413+0000 7f74b9a48640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74b40cf600 con 0x7f74b40cbf50 2023-06-10T19:07:42.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.413+0000 7f74b9a48640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74b415dc00 con 0x7f74b40cec40 2023-06-10T19:07:42.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.413+0000 7f74b37fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f74b40cbf50 0x7f74b40cc390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:42.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.413+0000 7f74b37fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f74b40cbf50 0x7f74b40cc390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45038/0 (socket says 172.21.15.53:45038) 2023-06-10T19:07:42.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.413+0000 7f74b37fe640 1 -- 172.21.15.53:0/923854368 learned_addr learned my addr 172.21.15.53:0/923854368 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:42.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.413+0000 7f74b27fc640 1 --2- 172.21.15.53:0/923854368 >> v2:172.21.15.117:3300/0 conn(0x7f74b40cec40 0x7f74b40cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:42.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.413+0000 7f74b37fe640 1 -- 172.21.15.53:0/923854368 >> v2:172.21.15.117:3300/0 conn(0x7f74b40cec40 msgr2=0x7f74b40cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:42.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.413+0000 7f74b37fe640 1 --2- 172.21.15.53:0/923854368 >> v2:172.21.15.117:3300/0 conn(0x7f74b40cec40 0x7f74b40cf0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:42.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.413+0000 7f74b37fe640 1 -- 172.21.15.53:0/923854368 >> v1:172.21.15.117:6789/0 conn(0x7f74b4159450 legacy=0x7f74b415d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:42.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.413+0000 7f74b37fe640 1 -- 172.21.15.53:0/923854368 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b415dee0 con 0x7f74b40cbf50 2023-06-10T19:07:42.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.417+0000 7f74b37fe640 1 --2- 172.21.15.53:0/923854368 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74b40cbf50 0x7f74b40cc390 secure :-1 s=READY pgs=2462 cs=0 l=1 rev1=1 crypto rx=0x7f74b406df40 tx=0x7f74ac01c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3828aef60d4b3203 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:42.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.417+0000 7f74b1ffb640 1 -- 172.21.15.53:0/923854368 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ac0a57e0 con 0x7f74b40cbf50 2023-06-10T19:07:42.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.417+0000 7f74b1ffb640 1 -- 172.21.15.53:0/923854368 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74ac0a5940 con 0x7f74b40cbf50 2023-06-10T19:07:42.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.417+0000 7f74b1ffb640 1 -- 172.21.15.53:0/923854368 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ac0a5cd0 con 0x7f74b40cbf50 2023-06-10T19:07:42.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.417+0000 7f74b9a48640 1 -- 172.21.15.53:0/923854368 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74b40cbf50 msgr2=0x7f74b40cc390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:42.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.417+0000 7f74b9a48640 1 --2- 172.21.15.53:0/923854368 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74b40cbf50 0x7f74b40cc390 secure :-1 s=READY pgs=2462 cs=0 l=1 rev1=1 crypto rx=0x7f74b406df40 tx=0x7f74ac01c960 comp rx=0 tx=0).stop 2023-06-10T19:07:42.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.417+0000 7f74b9a48640 1 -- 172.21.15.53:0/923854368 shutdown_connections 2023-06-10T19:07:42.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.417+0000 7f74b9a48640 1 --2- 172.21.15.53:0/923854368 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74b40cbf50 0x7f74b40cc390 unknown :-1 s=CLOSED pgs=2462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:42.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.417+0000 7f74b9a48640 1 --2- 172.21.15.53:0/923854368 >> v2:172.21.15.117:3300/0 conn(0x7f74b40cec40 0x7f74b40cf0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:42.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.417+0000 7f74b9a48640 1 -- 172.21.15.53:0/923854368 >> 172.21.15.53:0/923854368 conn(0x7f74b406a090 msgr2=0x7f74b406d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:42.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.417+0000 7f74b9a48640 1 -- 172.21.15.53:0/923854368 shutdown_connections 2023-06-10T19:07:42.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.417+0000 7f74b9a48640 1 -- 172.21.15.53:0/923854368 wait complete. 2023-06-10T19:07:42.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.417+0000 7f74b9a48640 1 Processor -- start 2023-06-10T19:07:42.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.417+0000 7f74b9a48640 1 -- start start 2023-06-10T19:07:42.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.421+0000 7f74b9a48640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f74b40cbf50 0x7f74b41638a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:42.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.421+0000 7f74b9a48640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74b40cec40 0x7f74b41f7390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:42.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.421+0000 7f74b9a48640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f74b4159450 0x7f74b414d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:42.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.421+0000 7f74b9a48640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b406ac10 con 0x7f74b40cec40 2023-06-10T19:07:42.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.421+0000 7f74b9a48640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b414d860 con 0x7f74b4159450 2023-06-10T19:07:42.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.421+0000 7f74b9a48640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74b41f7a90 con 0x7f74b40cbf50 2023-06-10T19:07:42.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.421+0000 7f74b27fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74b40cec40 0x7f74b41f7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:42.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.421+0000 7f74b27fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74b40cec40 0x7f74b41f7390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45050/0 (socket says 172.21.15.53:45050) 2023-06-10T19:07:42.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.421+0000 7f74b27fc640 1 -- 172.21.15.53:0/3898658395 learned_addr learned my addr 172.21.15.53:0/3898658395 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:42.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.421+0000 7f74b2ffd640 1 --2- 172.21.15.53:0/3898658395 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f74b40cbf50 0x7f74b41638a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:42.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.421+0000 7f74b37fe640 1 --2- 172.21.15.53:0/3898658395 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f74b4159450 0x7f74b414d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:42.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.421+0000 7f74b27fc640 1 -- 172.21.15.53:0/3898658395 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f74b40cbf50 msgr2=0x7f74b41638a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:42.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.421+0000 7f74b27fc640 1 --2- 172.21.15.53:0/3898658395 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f74b40cbf50 0x7f74b41638a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:42.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.421+0000 7f74b27fc640 1 -- 172.21.15.53:0/3898658395 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f74b4159450 msgr2=0x7f74b414d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:42.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.421+0000 7f74b27fc640 1 --2- 172.21.15.53:0/3898658395 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f74b4159450 0x7f74b414d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:42.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.421+0000 7f74b27fc640 1 -- 172.21.15.53:0/3898658395 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74ac009b30 con 0x7f74b40cec40 2023-06-10T19:07:42.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.421+0000 7f74b27fc640 1 --2- 172.21.15.53:0/3898658395 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74b40cec40 0x7f74b41f7390 secure :-1 s=READY pgs=2463 cs=0 l=1 rev1=1 crypto rx=0x7f74a800c820 tx=0x7f74a800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:42.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.421+0000 7f749bfff640 1 -- 172.21.15.53:0/3898658395 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a8007a30 con 0x7f74b40cec40 2023-06-10T19:07:42.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.421+0000 7f749bfff640 1 -- 172.21.15.53:0/3898658395 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a8007b90 con 0x7f74b40cec40 2023-06-10T19:07:42.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.421+0000 7f74b9a48640 1 -- 172.21.15.53:0/3898658395 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74b415d9d0 con 0x7f74b40cec40 2023-06-10T19:07:42.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.421+0000 7f749bfff640 1 -- 172.21.15.53:0/3898658395 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a800ce10 con 0x7f74b40cec40 2023-06-10T19:07:42.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.421+0000 7f74b9a48640 1 -- 172.21.15.53:0/3898658395 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74b41f8050 con 0x7f74b40cec40 2023-06-10T19:07:42.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.421+0000 7f74b9a48640 1 -- 172.21.15.53:0/3898658395 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74b404d790 con 0x7f74b40cec40 2023-06-10T19:07:42.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.421+0000 7f749bfff640 1 -- 172.21.15.53:0/3898658395 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f74a80113f0 con 0x7f74b40cec40 2023-06-10T19:07:42.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.421+0000 7f749bfff640 1 --2- 172.21.15.53:0/3898658395 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f74a0066280 0x7f74a0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:42.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.421+0000 7f749bfff640 1 -- 172.21.15.53:0/3898658395 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6105+0+0 (secure 0 0 0) 0x7f74a8083da0 con 0x7f74b40cec40 2023-06-10T19:07:42.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.421+0000 7f74b2ffd640 1 --2- 172.21.15.53:0/3898658395 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f74a0066280 0x7f74a0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:42.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.425+0000 7f74b2ffd640 1 --2- 172.21.15.53:0/3898658395 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f74a0066280 0x7f74a0068730 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f74a4004e30 tx=0x7f74a4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:42.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.425+0000 7f749bfff640 1 -- 172.21.15.53:0/3898658395 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f74a80511f0 con 0x7f74b40cec40 2023-06-10T19:07:42.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.577+0000 7f74b9a48640 1 -- 172.21.15.53:0/3898658395 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f74b41f8210 con 0x7f74b40cec40 2023-06-10T19:07:42.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.581+0000 7f749bfff640 1 -- 172.21.15.53:0/3898658395 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v168) v1 ==== 93+0+10 (secure 0 0 0) 0x7f74a801f0a0 con 0x7f74b40cec40 2023-06-10T19:07:42.582 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-06-10T19:07:42.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.581+0000 7f74b9a48640 1 -- 172.21.15.53:0/3898658395 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f74a0066280 msgr2=0x7f74a0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:42.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.581+0000 7f74b9a48640 1 --2- 172.21.15.53:0/3898658395 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f74a0066280 0x7f74a0068730 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f74a4004e30 tx=0x7f74a4009040 comp rx=0 tx=0).stop 2023-06-10T19:07:42.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.581+0000 7f74b9a48640 1 -- 172.21.15.53:0/3898658395 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74b40cec40 msgr2=0x7f74b41f7390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:42.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.581+0000 7f74b9a48640 1 --2- 172.21.15.53:0/3898658395 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74b40cec40 0x7f74b41f7390 secure :-1 s=READY pgs=2463 cs=0 l=1 rev1=1 crypto rx=0x7f74a800c820 tx=0x7f74a800cce0 comp rx=0 tx=0).stop 2023-06-10T19:07:42.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.581+0000 7f74b9a48640 1 -- 172.21.15.53:0/3898658395 shutdown_connections 2023-06-10T19:07:42.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.581+0000 7f74b9a48640 1 --2- 172.21.15.53:0/3898658395 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f74a0066280 0x7f74a0068730 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:42.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.581+0000 7f74b9a48640 1 --2- 172.21.15.53:0/3898658395 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f74b4159450 0x7f74b414d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:42.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.581+0000 7f74b9a48640 1 --2- 172.21.15.53:0/3898658395 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74b40cec40 0x7f74b41f7390 unknown :-1 s=CLOSED pgs=2463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:42.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.581+0000 7f74b9a48640 1 --2- 172.21.15.53:0/3898658395 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f74b40cbf50 0x7f74b41638a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:42.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.581+0000 7f74b9a48640 1 -- 172.21.15.53:0/3898658395 >> 172.21.15.53:0/3898658395 conn(0x7f74b406a090 msgr2=0x7f74b40b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:42.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.581+0000 7f74b9a48640 1 -- 172.21.15.53:0/3898658395 shutdown_connections 2023-06-10T19:07:42.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.581+0000 7f74b9a48640 1 -- 172.21.15.53:0/3898658395 wait complete. 2023-06-10T19:07:42.601 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-10T19:07:42.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.725+0000 7ff294446640 1 Processor -- start 2023-06-10T19:07:42.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.725+0000 7ff294446640 1 -- start start 2023-06-10T19:07:42.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.725+0000 7ff294446640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff28c1558e0 0x7ff28c0c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:42.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.725+0000 7ff294446640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff28c06b6e0 0x7ff28c06bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:42.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.725+0000 7ff294446640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff28c06c060 con 0x7ff28c158f40 2023-06-10T19:07:42.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.725+0000 7ff294446640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff28c06c230 con 0x7ff28c06b6e0 2023-06-10T19:07:42.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.725+0000 7ff294446640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff28c06ca40 con 0x7ff28c1558e0 2023-06-10T19:07:42.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.725+0000 7ff2919e1640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ff28c158f40 0x7ff28c0cb820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:35342/0 (socket says 172.21.15.53:35342) 2023-06-10T19:07:42.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.725+0000 7ff2919e1640 1 -- 172.21.15.53:0/795121189 learned_addr learned my addr 172.21.15.53:0/795121189 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:07:42.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.725+0000 7ff2921e2640 1 --2- 172.21.15.53:0/795121189 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff28c1558e0 0x7ff28c0c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:42.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.725+0000 7ff2929e3640 1 --2- 172.21.15.53:0/795121189 >> v2:172.21.15.117:3300/0 conn(0x7ff28c06b6e0 0x7ff28c06bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:42.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.725+0000 7ff2911e0640 1 -- 172.21.15.53:0/795121189 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2843910884 0 0) 0x7ff28c06c060 con 0x7ff28c158f40 2023-06-10T19:07:42.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.725+0000 7ff2911e0640 1 -- 172.21.15.53:0/795121189 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff274003530 con 0x7ff28c158f40 2023-06-10T19:07:42.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.725+0000 7ff2911e0640 1 -- 172.21.15.53:0/795121189 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3837303895 0 0) 0x7ff274003530 con 0x7ff28c158f40 2023-06-10T19:07:42.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.725+0000 7ff2911e0640 1 -- 172.21.15.53:0/795121189 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff28c1558e0 msgr2=0x7ff28c0c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:42.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.725+0000 7ff2911e0640 1 --2- 172.21.15.53:0/795121189 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff28c1558e0 0x7ff28c0c82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:42.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.725+0000 7ff2911e0640 1 -- 172.21.15.53:0/795121189 >> v2:172.21.15.117:3300/0 conn(0x7ff28c06b6e0 msgr2=0x7ff28c06bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:42.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.725+0000 7ff2911e0640 1 --2- 172.21.15.53:0/795121189 >> v2:172.21.15.117:3300/0 conn(0x7ff28c06b6e0 0x7ff28c06bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:42.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.725+0000 7ff2911e0640 1 -- 172.21.15.53:0/795121189 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff28c155cb0 con 0x7ff28c158f40 2023-06-10T19:07:42.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.725+0000 7ff2911e0640 1 -- 172.21.15.53:0/795121189 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7ff280001680 con 0x7ff28c158f40 2023-06-10T19:07:42.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.725+0000 7ff2911e0640 1 -- 172.21.15.53:0/795121189 >> v1:172.21.15.53:6789/0 conn(0x7ff28c158f40 legacy=0x7ff28c0cb820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:42.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.725+0000 7ff2911e0640 1 --2- 172.21.15.53:0/795121189 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff28c1558e0 0x7ff274003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:42.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.725+0000 7ff2911e0640 1 --2- 172.21.15.53:0/795121189 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff274003f00 0x7ff2740047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:42.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.725+0000 7ff2911e0640 1 --2- 172.21.15.53:0/795121189 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff274004d10 0x7ff274005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:42.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.725+0000 7ff2911e0640 1 -- 172.21.15.53:0/795121189 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff28c06c230 con 0x7ff274003f00 2023-06-10T19:07:42.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.725+0000 7ff2911e0640 1 -- 172.21.15.53:0/795121189 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff28c06ca40 con 0x7ff274004d10 2023-06-10T19:07:42.732 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.725+0000 7ff2911e0640 1 -- 172.21.15.53:0/795121189 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff27400ba70 con 0x7ff28c1558e0 2023-06-10T19:07:42.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.725+0000 7ff2921e2640 1 --2- 172.21.15.53:0/795121189 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff28c1558e0 0x7ff274003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:42.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.725+0000 7ff2929e3640 1 --2- 172.21.15.53:0/795121189 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff274004d10 0x7ff274005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:42.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.725+0000 7ff2919e1640 1 --2- 172.21.15.53:0/795121189 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff274003f00 0x7ff2740047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:42.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.725+0000 7ff2919e1640 1 -- 172.21.15.53:0/795121189 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff28c1558e0 msgr2=0x7ff274003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:42.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.725+0000 7ff2919e1640 1 --2- 172.21.15.53:0/795121189 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff28c1558e0 0x7ff274003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:42.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.725+0000 7ff2919e1640 1 -- 172.21.15.53:0/795121189 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff274004d10 msgr2=0x7ff274005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:42.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.725+0000 7ff2919e1640 1 --2- 172.21.15.53:0/795121189 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff274004d10 0x7ff274005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:42.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.725+0000 7ff2919e1640 1 -- 172.21.15.53:0/795121189 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff274003530 con 0x7ff274003f00 2023-06-10T19:07:42.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.729+0000 7ff2919e1640 1 --2- 172.21.15.53:0/795121189 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff274003f00 0x7ff2740047d0 secure :-1 s=READY pgs=2465 cs=0 l=1 rev1=1 crypto rx=0x7ff28000c210 tx=0x7ff28001cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57fc8b16aa2e5a80 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:42.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.729+0000 7ff2911e0640 1 -- 172.21.15.53:0/795121189 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2800058e0 con 0x7ff274003f00 2023-06-10T19:07:42.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.729+0000 7ff2911e0640 1 -- 172.21.15.53:0/795121189 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff280005a40 con 0x7ff274003f00 2023-06-10T19:07:42.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.729+0000 7ff2911e0640 1 -- 172.21.15.53:0/795121189 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff280005e50 con 0x7ff274003f00 2023-06-10T19:07:42.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.729+0000 7ff294446640 1 -- 172.21.15.53:0/795121189 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff274003f00 msgr2=0x7ff2740047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:42.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.729+0000 7ff294446640 1 --2- 172.21.15.53:0/795121189 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff274003f00 0x7ff2740047d0 secure :-1 s=READY pgs=2465 cs=0 l=1 rev1=1 crypto rx=0x7ff28000c210 tx=0x7ff28001cb50 comp rx=0 tx=0).stop 2023-06-10T19:07:42.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.729+0000 7ff2929e3640 1 -- 172.21.15.53:0/795121189 reap_dead start 2023-06-10T19:07:42.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.729+0000 7ff294446640 1 -- 172.21.15.53:0/795121189 shutdown_connections 2023-06-10T19:07:42.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.729+0000 7ff294446640 1 -- 172.21.15.53:0/795121189 >> 172.21.15.53:0/795121189 conn(0x7ff28c06a0e0 msgr2=0x7ff28c0cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:42.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.729+0000 7ff294446640 1 -- 172.21.15.53:0/795121189 shutdown_connections 2023-06-10T19:07:42.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.729+0000 7ff294446640 1 -- 172.21.15.53:0/795121189 wait complete. 2023-06-10T19:07:42.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.729+0000 7ff294446640 1 Processor -- start 2023-06-10T19:07:42.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.729+0000 7ff294446640 1 -- start start 2023-06-10T19:07:42.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.733+0000 7ff294446640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff274003f00 0x7ff28c152290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:42.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.733+0000 7ff294446640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff28c0b1520 0x7ff28c156fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:42.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.733+0000 7ff294446640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff28c0b1970 0x7ff28c157500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:42.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.733+0000 7ff294446640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff28c0c4d20 con 0x7ff274003f00 2023-06-10T19:07:42.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.733+0000 7ff294446640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff28c0c32c0 con 0x7ff28c0b1970 2023-06-10T19:07:42.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.733+0000 7ff294446640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff28c0c35a0 con 0x7ff28c0b1520 2023-06-10T19:07:42.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.733+0000 7ff2921e2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff274003f00 0x7ff28c152290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:42.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.733+0000 7ff2921e2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff274003f00 0x7ff28c152290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45060/0 (socket says 172.21.15.53:45060) 2023-06-10T19:07:42.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.733+0000 7ff2921e2640 1 -- 172.21.15.53:0/3098470132 learned_addr learned my addr 172.21.15.53:0/3098470132 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:42.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.733+0000 7ff2929e3640 1 --2- 172.21.15.53:0/3098470132 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff28c0b1970 0x7ff28c157500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:42.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.733+0000 7ff2921e2640 1 -- 172.21.15.53:0/3098470132 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff28c0b1520 msgr2=0x7ff28c156fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:42.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.733+0000 7ff2921e2640 1 --2- 172.21.15.53:0/3098470132 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff28c0b1520 0x7ff28c156fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:42.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.733+0000 7ff2921e2640 1 -- 172.21.15.53:0/3098470132 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff28c0b1970 msgr2=0x7ff28c157500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:42.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.733+0000 7ff2921e2640 1 --2- 172.21.15.53:0/3098470132 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff28c0b1970 0x7ff28c157500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:42.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.733+0000 7ff2921e2640 1 -- 172.21.15.53:0/3098470132 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff28c0cc0b0 con 0x7ff274003f00 2023-06-10T19:07:42.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.733+0000 7ff2921e2640 1 --2- 172.21.15.53:0/3098470132 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff274003f00 0x7ff28c152290 secure :-1 s=READY pgs=2466 cs=0 l=1 rev1=1 crypto rx=0x7ff27c009d90 tx=0x7ff27c0075e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:42.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.733+0000 7ff28affd640 1 -- 172.21.15.53:0/3098470132 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27c00f070 con 0x7ff274003f00 2023-06-10T19:07:42.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.733+0000 7ff28affd640 1 -- 172.21.15.53:0/3098470132 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff27c010040 con 0x7ff274003f00 2023-06-10T19:07:42.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.733+0000 7ff294446640 1 -- 172.21.15.53:0/3098470132 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff28c0c4f70 con 0x7ff274003f00 2023-06-10T19:07:42.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.733+0000 7ff28affd640 1 -- 172.21.15.53:0/3098470132 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27c00add0 con 0x7ff274003f00 2023-06-10T19:07:42.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.733+0000 7ff294446640 1 -- 172.21.15.53:0/3098470132 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff28c1527d0 con 0x7ff274003f00 2023-06-10T19:07:42.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.733+0000 7ff294446640 1 -- 172.21.15.53:0/3098470132 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff28c0c37c0 con 0x7ff274003f00 2023-06-10T19:07:42.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.733+0000 7ff28affd640 1 -- 172.21.15.53:0/3098470132 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff27c016860 con 0x7ff274003f00 2023-06-10T19:07:42.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.733+0000 7ff28affd640 1 --2- 172.21.15.53:0/3098470132 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff278066280 0x7ff278068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:42.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.733+0000 7ff28affd640 1 -- 172.21.15.53:0/3098470132 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6105+0+0 (secure 0 0 0) 0x7ff27c084d80 con 0x7ff274003f00 2023-06-10T19:07:42.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.733+0000 7ff2919e1640 1 --2- 172.21.15.53:0/3098470132 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff278066280 0x7ff278068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:42.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.737+0000 7ff2919e1640 1 --2- 172.21.15.53:0/3098470132 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff278066280 0x7ff278068730 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7ff2800aa000 tx=0x7ff280001a10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:42.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.737+0000 7ff28affd640 1 -- 172.21.15.53:0/3098470132 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff27c0520a0 con 0x7ff274003f00 2023-06-10T19:07:42.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.885+0000 7ff294446640 1 -- 172.21.15.53:0/3098470132 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff28c04d790 con 0x7ff274003f00 2023-06-10T19:07:42.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.889+0000 7ff28affd640 1 -- 172.21.15.53:0/3098470132 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v168) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff27c0556c0 con 0x7ff274003f00 2023-06-10T19:07:42.891 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-06-10T19:07:42.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.889+0000 7ff294446640 1 -- 172.21.15.53:0/3098470132 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff278066280 msgr2=0x7ff278068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:42.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.889+0000 7ff294446640 1 --2- 172.21.15.53:0/3098470132 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff278066280 0x7ff278068730 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7ff2800aa000 tx=0x7ff280001a10 comp rx=0 tx=0).stop 2023-06-10T19:07:42.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.889+0000 7ff294446640 1 -- 172.21.15.53:0/3098470132 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff274003f00 msgr2=0x7ff28c152290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:42.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.889+0000 7ff294446640 1 --2- 172.21.15.53:0/3098470132 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff274003f00 0x7ff28c152290 secure :-1 s=READY pgs=2466 cs=0 l=1 rev1=1 crypto rx=0x7ff27c009d90 tx=0x7ff27c0075e0 comp rx=0 tx=0).stop 2023-06-10T19:07:42.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.889+0000 7ff294446640 1 -- 172.21.15.53:0/3098470132 shutdown_connections 2023-06-10T19:07:42.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.889+0000 7ff294446640 1 --2- 172.21.15.53:0/3098470132 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff278066280 0x7ff278068730 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:42.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.889+0000 7ff294446640 1 --2- 172.21.15.53:0/3098470132 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff28c0b1970 0x7ff28c157500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:42.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.889+0000 7ff294446640 1 --2- 172.21.15.53:0/3098470132 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff28c0b1520 0x7ff28c156fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:42.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.889+0000 7ff294446640 1 --2- 172.21.15.53:0/3098470132 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff274003f00 0x7ff28c152290 unknown :-1 s=CLOSED pgs=2466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:42.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.889+0000 7ff294446640 1 -- 172.21.15.53:0/3098470132 >> 172.21.15.53:0/3098470132 conn(0x7ff28c06a0e0 msgr2=0x7ff28c0cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:42.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.889+0000 7ff294446640 1 -- 172.21.15.53:0/3098470132 shutdown_connections 2023-06-10T19:07:42.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:42.889+0000 7ff294446640 1 -- 172.21.15.53:0/3098470132 wait complete. 2023-06-10T19:07:42.908 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-10T19:07:43.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.033+0000 7fe9e1372640 1 Processor -- start 2023-06-10T19:07:43.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.033+0000 7fe9e1372640 1 -- start start 2023-06-10T19:07:43.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.033+0000 7fe9e1372640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe9dc15c060 0x7fe9dc0cc020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:43.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.033+0000 7fe9e1372640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9dc15cb40 0x7fe9dc06bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:43.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.033+0000 7fe9e1372640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9dc15cf60 con 0x7fe9dc070de0 2023-06-10T19:07:43.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.033+0000 7fe9e1372640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9dc0c8d50 con 0x7fe9dc15c060 2023-06-10T19:07:43.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.033+0000 7fe9e1372640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9dc0c9030 con 0x7fe9dc15cb40 2023-06-10T19:07:43.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.033+0000 7fe9da7fc640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fe9dc070de0 0x7fe9dc15c430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:35344/0 (socket says 172.21.15.53:35344) 2023-06-10T19:07:43.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.033+0000 7fe9da7fc640 1 -- 172.21.15.53:0/238078666 learned_addr learned my addr 172.21.15.53:0/238078666 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:07:43.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.033+0000 7fe9daffd640 1 --2- 172.21.15.53:0/238078666 >> v2:172.21.15.53:3300/0 conn(0x7fe9dc15c060 0x7fe9dc0cc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:43.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.033+0000 7fe9db7fe640 1 --2- 172.21.15.53:0/238078666 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9dc15cb40 0x7fe9dc06bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:43.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.033+0000 7fe9daffd640 1 -- 172.21.15.53:0/238078666 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9dc15cb40 msgr2=0x7fe9dc06bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:43.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.033+0000 7fe9daffd640 1 --2- 172.21.15.53:0/238078666 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9dc15cb40 0x7fe9dc06bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:43.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.033+0000 7fe9daffd640 1 -- 172.21.15.53:0/238078666 >> v1:172.21.15.53:6789/0 conn(0x7fe9dc070de0 legacy=0x7fe9dc15c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:43.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.033+0000 7fe9daffd640 1 -- 172.21.15.53:0/238078666 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9dc070300 con 0x7fe9dc15c060 2023-06-10T19:07:43.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.033+0000 7fe9d9ffb640 1 -- 172.21.15.53:0/238078666 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 912163457 0 0) 0x7fe9dc15cf60 con 0x7fe9dc070de0 2023-06-10T19:07:43.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.037+0000 7fe9daffd640 1 --2- 172.21.15.53:0/238078666 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9dc15c060 0x7fe9dc0cc020 secure :-1 s=READY pgs=2468 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc0097c0 tx=0x7fe9cc01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e2234afd6d9fd7f server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:43.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.037+0000 7fe9d9ffb640 1 -- 172.21.15.53:0/238078666 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9cc0ab610 con 0x7fe9dc15c060 2023-06-10T19:07:43.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.037+0000 7fe9d9ffb640 1 -- 172.21.15.53:0/238078666 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9cc0ab770 con 0x7fe9dc15c060 2023-06-10T19:07:43.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.037+0000 7fe9d9ffb640 1 -- 172.21.15.53:0/238078666 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9cc0abb00 con 0x7fe9dc15c060 2023-06-10T19:07:43.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.037+0000 7fe9e1372640 1 -- 172.21.15.53:0/238078666 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9dc15c060 msgr2=0x7fe9dc0cc020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:43.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.037+0000 7fe9e1372640 1 --2- 172.21.15.53:0/238078666 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9dc15c060 0x7fe9dc0cc020 secure :-1 s=READY pgs=2468 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc0097c0 tx=0x7fe9cc01c3f0 comp rx=0 tx=0).stop 2023-06-10T19:07:43.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.037+0000 7fe9e1372640 1 -- 172.21.15.53:0/238078666 shutdown_connections 2023-06-10T19:07:43.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.037+0000 7fe9e1372640 1 --2- 172.21.15.53:0/238078666 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9dc15cb40 0x7fe9dc06bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:43.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.037+0000 7fe9e1372640 1 --2- 172.21.15.53:0/238078666 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9dc15c060 0x7fe9dc0cc020 unknown :-1 s=CLOSED pgs=2468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:43.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.037+0000 7fe9e1372640 1 -- 172.21.15.53:0/238078666 >> 172.21.15.53:0/238078666 conn(0x7fe9dc06a0e0 msgr2=0x7fe9dc0cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:43.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.037+0000 7fe9e1372640 1 -- 172.21.15.53:0/238078666 shutdown_connections 2023-06-10T19:07:43.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.037+0000 7fe9e1372640 1 -- 172.21.15.53:0/238078666 wait complete. 2023-06-10T19:07:43.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.037+0000 7fe9e1372640 1 Processor -- start 2023-06-10T19:07:43.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.037+0000 7fe9e1372640 1 -- start start 2023-06-10T19:07:43.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.037+0000 7fe9e1372640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9dc070de0 0x7fe9dc1f3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:43.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.037+0000 7fe9e1372640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe9dc15c060 0x7fe9dc147e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:43.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.037+0000 7fe9e1372640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9dc15cb40 0x7fe9dc155b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:43.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.037+0000 7fe9e1372640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9dc156b20 con 0x7fe9dc15cb40 2023-06-10T19:07:43.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.037+0000 7fe9e1372640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9dc1f40f0 con 0x7fe9dc15c060 2023-06-10T19:07:43.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.037+0000 7fe9e1372640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9dc156560 con 0x7fe9dc070de0 2023-06-10T19:07:43.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.037+0000 7fe9db7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9dc15cb40 0x7fe9dc155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:43.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.037+0000 7fe9db7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9dc15cb40 0x7fe9dc155b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45084/0 (socket says 172.21.15.53:45084) 2023-06-10T19:07:43.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.037+0000 7fe9db7fe640 1 -- 172.21.15.53:0/3333365334 learned_addr learned my addr 172.21.15.53:0/3333365334 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:43.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.037+0000 7fe9daffd640 1 --2- 172.21.15.53:0/3333365334 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9dc070de0 0x7fe9dc1f3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:43.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.037+0000 7fe9da7fc640 1 --2- 172.21.15.53:0/3333365334 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe9dc15c060 0x7fe9dc147e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:43.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.037+0000 7fe9db7fe640 1 -- 172.21.15.53:0/3333365334 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9dc070de0 msgr2=0x7fe9dc1f3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:43.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.037+0000 7fe9db7fe640 1 --2- 172.21.15.53:0/3333365334 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9dc070de0 0x7fe9dc1f3bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:43.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.037+0000 7fe9db7fe640 1 -- 172.21.15.53:0/3333365334 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe9dc15c060 msgr2=0x7fe9dc147e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:43.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.037+0000 7fe9db7fe640 1 --2- 172.21.15.53:0/3333365334 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe9dc15c060 0x7fe9dc147e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:43.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.037+0000 7fe9db7fe640 1 -- 172.21.15.53:0/3333365334 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9cc009420 con 0x7fe9dc15cb40 2023-06-10T19:07:43.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.037+0000 7fe9daffd640 1 --2- 172.21.15.53:0/3333365334 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9dc070de0 0x7fe9dc1f3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:07:43.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.041+0000 7fe9db7fe640 1 --2- 172.21.15.53:0/3333365334 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9dc15cb40 0x7fe9dc155b80 secure :-1 s=READY pgs=2469 cs=0 l=1 rev1=1 crypto rx=0x7fe9d4007e60 tx=0x7fe9d400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:43.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.041+0000 7fe9c37fe640 1 -- 172.21.15.53:0/3333365334 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d4014420 con 0x7fe9dc15cb40 2023-06-10T19:07:43.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.041+0000 7fe9c37fe640 1 -- 172.21.15.53:0/3333365334 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9d40145a0 con 0x7fe9dc15cb40 2023-06-10T19:07:43.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.041+0000 7fe9e1372640 1 -- 172.21.15.53:0/3333365334 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9dc156840 con 0x7fe9dc15cb40 2023-06-10T19:07:43.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.041+0000 7fe9c37fe640 1 -- 172.21.15.53:0/3333365334 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d4014950 con 0x7fe9dc15cb40 2023-06-10T19:07:43.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.041+0000 7fe9e1372640 1 -- 172.21.15.53:0/3333365334 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9dc1f3690 con 0x7fe9dc15cb40 2023-06-10T19:07:43.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.041+0000 7fe9e1372640 1 -- 172.21.15.53:0/3333365334 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9dc1f3210 con 0x7fe9dc15cb40 2023-06-10T19:07:43.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.041+0000 7fe9c37fe640 1 -- 172.21.15.53:0/3333365334 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe9d4014ab0 con 0x7fe9dc15cb40 2023-06-10T19:07:43.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.041+0000 7fe9c37fe640 1 --2- 172.21.15.53:0/3333365334 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe9c8066280 0x7fe9c8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:43.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.041+0000 7fe9c37fe640 1 -- 172.21.15.53:0/3333365334 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6105+0+0 (secure 0 0 0) 0x7fe9d40846a0 con 0x7fe9dc15cb40 2023-06-10T19:07:43.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.041+0000 7fe9daffd640 1 --2- 172.21.15.53:0/3333365334 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe9c8066280 0x7fe9c8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:43.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.041+0000 7fe9daffd640 1 --2- 172.21.15.53:0/3333365334 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe9c8066280 0x7fe9c8068730 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc0af000 tx=0x7fe9cc0a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:43.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.045+0000 7fe9c37fe640 1 -- 172.21.15.53:0/3333365334 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe9dc1f3210 con 0x7fe9dc15cb40 2023-06-10T19:07:43.202 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.201+0000 7fe9e1372640 1 -- 172.21.15.53:0/3333365334 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe9dc1f3210 con 0x7fe9dc15cb40 2023-06-10T19:07:43.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.201+0000 7fe9c37fe640 1 -- 172.21.15.53:0/3333365334 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v168) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe9dc1f3210 con 0x7fe9dc15cb40 2023-06-10T19:07:43.203 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-06-10T19:07:43.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.201+0000 7fe9e1372640 1 -- 172.21.15.53:0/3333365334 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe9c8066280 msgr2=0x7fe9c8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:43.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.201+0000 7fe9e1372640 1 --2- 172.21.15.53:0/3333365334 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe9c8066280 0x7fe9c8068730 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc0af000 tx=0x7fe9cc0a7000 comp rx=0 tx=0).stop 2023-06-10T19:07:43.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.201+0000 7fe9e1372640 1 -- 172.21.15.53:0/3333365334 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9dc15cb40 msgr2=0x7fe9dc155b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:43.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.201+0000 7fe9e1372640 1 --2- 172.21.15.53:0/3333365334 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9dc15cb40 0x7fe9dc155b80 secure :-1 s=READY pgs=2469 cs=0 l=1 rev1=1 crypto rx=0x7fe9d4007e60 tx=0x7fe9d400e4b0 comp rx=0 tx=0).stop 2023-06-10T19:07:43.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.201+0000 7fe9e1372640 1 -- 172.21.15.53:0/3333365334 shutdown_connections 2023-06-10T19:07:43.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.201+0000 7fe9e1372640 1 --2- 172.21.15.53:0/3333365334 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe9c8066280 0x7fe9c8068730 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:43.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.201+0000 7fe9e1372640 1 --2- 172.21.15.53:0/3333365334 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9dc15cb40 0x7fe9dc155b80 unknown :-1 s=CLOSED pgs=2469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:43.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.201+0000 7fe9e1372640 1 --2- 172.21.15.53:0/3333365334 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe9dc15c060 0x7fe9dc147e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:43.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.201+0000 7fe9e1372640 1 --2- 172.21.15.53:0/3333365334 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9dc070de0 0x7fe9dc1f3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:43.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.201+0000 7fe9e1372640 1 -- 172.21.15.53:0/3333365334 >> 172.21.15.53:0/3333365334 conn(0x7fe9dc06a0e0 msgr2=0x7fe9dc0cdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:43.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.201+0000 7fe9e1372640 1 -- 172.21.15.53:0/3333365334 shutdown_connections 2023-06-10T19:07:43.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.201+0000 7fe9e1372640 1 -- 172.21.15.53:0/3333365334 wait complete. 2023-06-10T19:07:43.222 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-10T19:07:43.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.353+0000 7fd619782640 1 Processor -- start 2023-06-10T19:07:43.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.353+0000 7fd619782640 1 -- start start 2023-06-10T19:07:43.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.353+0000 7fd619782640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd61406a930 0x7fd61415fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:43.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.353+0000 7fd619782640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6140655c0 con 0x7fd6140b06d0 2023-06-10T19:07:43.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.353+0000 7fd619782640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6140cc110 con 0x7fd61415b870 2023-06-10T19:07:43.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.353+0000 7fd619782640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6140cc3f0 con 0x7fd61406a930 2023-06-10T19:07:43.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.353+0000 7fd6127fc640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fd6140b06d0 0x7fd61415f450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:35348/0 (socket says 172.21.15.53:35348) 2023-06-10T19:07:43.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.353+0000 7fd6127fc640 1 -- 172.21.15.53:0/2695537726 learned_addr learned my addr 172.21.15.53:0/2695537726 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:07:43.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.353+0000 7fd6137fe640 1 --2- 172.21.15.53:0/2695537726 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd61406a930 0x7fd61415fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:43.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.353+0000 7fd611ffb640 1 -- 172.21.15.53:0/2695537726 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3434982008 0 0) 0x7fd6140655c0 con 0x7fd6140b06d0 2023-06-10T19:07:43.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.353+0000 7fd611ffb640 1 -- 172.21.15.53:0/2695537726 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5fc003530 con 0x7fd6140b06d0 2023-06-10T19:07:43.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.353+0000 7fd611ffb640 1 -- 172.21.15.53:0/2695537726 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2952277846 0 0) 0x7fd6140cc110 con 0x7fd61415b870 2023-06-10T19:07:43.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.353+0000 7fd611ffb640 1 -- 172.21.15.53:0/2695537726 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6140655c0 con 0x7fd61415b870 2023-06-10T19:07:43.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.353+0000 7fd6137fe640 1 -- 172.21.15.53:0/2695537726 >> v1:172.21.15.117:6789/0 conn(0x7fd61415b870 legacy=0x7fd6140affc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:43.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.353+0000 7fd6137fe640 1 -- 172.21.15.53:0/2695537726 >> v1:172.21.15.53:6789/0 conn(0x7fd6140b06d0 legacy=0x7fd61415f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:43.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.353+0000 7fd6137fe640 1 -- 172.21.15.53:0/2695537726 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6140cc6d0 con 0x7fd61406a930 2023-06-10T19:07:43.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.357+0000 7fd6137fe640 1 --2- 172.21.15.53:0/2695537726 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd61406a930 0x7fd61415fb60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd60c0097f0 tx=0x7fd60c01c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=28e1ae1ccd5596f8 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:43.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.357+0000 7fd611ffb640 1 -- 172.21.15.53:0/2695537726 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60c0ab600 con 0x7fd61406a930 2023-06-10T19:07:43.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.357+0000 7fd611ffb640 1 -- 172.21.15.53:0/2695537726 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd60c0a7050 con 0x7fd61406a930 2023-06-10T19:07:43.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.357+0000 7fd611ffb640 1 -- 172.21.15.53:0/2695537726 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60c0ab960 con 0x7fd61406a930 2023-06-10T19:07:43.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.357+0000 7fd619782640 1 -- 172.21.15.53:0/2695537726 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd61406a930 msgr2=0x7fd61415fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:43.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.357+0000 7fd619782640 1 --2- 172.21.15.53:0/2695537726 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd61406a930 0x7fd61415fb60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd60c0097f0 tx=0x7fd60c01c370 comp rx=0 tx=0).stop 2023-06-10T19:07:43.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.357+0000 7fd619782640 1 -- 172.21.15.53:0/2695537726 shutdown_connections 2023-06-10T19:07:43.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.357+0000 7fd619782640 1 --2- 172.21.15.53:0/2695537726 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd61406a930 0x7fd61415fb60 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:43.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.357+0000 7fd619782640 1 -- 172.21.15.53:0/2695537726 >> 172.21.15.53:0/2695537726 conn(0x7fd6140cafc0 msgr2=0x7fd6140cb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:43.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.357+0000 7fd619782640 1 -- 172.21.15.53:0/2695537726 shutdown_connections 2023-06-10T19:07:43.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.357+0000 7fd619782640 1 -- 172.21.15.53:0/2695537726 wait complete. 2023-06-10T19:07:43.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.357+0000 7fd619782640 1 Processor -- start 2023-06-10T19:07:43.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.357+0000 7fd619782640 1 -- start start 2023-06-10T19:07:43.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.361+0000 7fd619782640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd61406a930 0x7fd61415e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:43.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.361+0000 7fd619782640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6140b06d0 0x7fd6141497c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:43.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.361+0000 7fd619782640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd61415b870 0x7fd6140b3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:43.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.361+0000 7fd619782640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd61415c8e0 con 0x7fd6140b06d0 2023-06-10T19:07:43.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.361+0000 7fd619782640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6140b1910 con 0x7fd61406a930 2023-06-10T19:07:43.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.361+0000 7fd619782640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6140b1bf0 con 0x7fd61415b870 2023-06-10T19:07:43.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.361+0000 7fd6127fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6140b06d0 0x7fd6141497c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:43.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.361+0000 7fd6127fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6140b06d0 0x7fd6141497c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45092/0 (socket says 172.21.15.53:45092) 2023-06-10T19:07:43.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.361+0000 7fd6127fc640 1 -- 172.21.15.53:0/2978654254 learned_addr learned my addr 172.21.15.53:0/2978654254 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:43.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.361+0000 7fd6137fe640 1 --2- 172.21.15.53:0/2978654254 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd61415b870 0x7fd6140b3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:43.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.361+0000 7fd612ffd640 1 --2- 172.21.15.53:0/2978654254 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd61406a930 0x7fd61415e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:43.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.361+0000 7fd6127fc640 1 -- 172.21.15.53:0/2978654254 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd61415b870 msgr2=0x7fd6140b3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:43.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.361+0000 7fd6127fc640 1 --2- 172.21.15.53:0/2978654254 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd61415b870 0x7fd6140b3770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:43.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.361+0000 7fd6127fc640 1 -- 172.21.15.53:0/2978654254 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd61406a930 msgr2=0x7fd61415e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:43.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.361+0000 7fd6127fc640 1 --2- 172.21.15.53:0/2978654254 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd61406a930 0x7fd61415e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:43.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.361+0000 7fd6127fc640 1 -- 172.21.15.53:0/2978654254 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd60c009420 con 0x7fd6140b06d0 2023-06-10T19:07:43.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.361+0000 7fd6137fe640 1 --2- 172.21.15.53:0/2978654254 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd61415b870 0x7fd6140b3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:07:43.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.361+0000 7fd6127fc640 1 --2- 172.21.15.53:0/2978654254 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6140b06d0 0x7fd6141497c0 secure :-1 s=READY pgs=2471 cs=0 l=1 rev1=1 crypto rx=0x7fd608005890 tx=0x7fd60800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:43.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.361+0000 7fd5fb7fe640 1 -- 172.21.15.53:0/2978654254 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd608005cf0 con 0x7fd6140b06d0 2023-06-10T19:07:43.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.361+0000 7fd5fb7fe640 1 -- 172.21.15.53:0/2978654254 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd608005e50 con 0x7fd6140b06d0 2023-06-10T19:07:43.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.361+0000 7fd619782640 1 -- 172.21.15.53:0/2978654254 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6140b1ed0 con 0x7fd6140b06d0 2023-06-10T19:07:43.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.361+0000 7fd5fb7fe640 1 -- 172.21.15.53:0/2978654254 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd608007310 con 0x7fd6140b06d0 2023-06-10T19:07:43.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.361+0000 7fd619782640 1 -- 172.21.15.53:0/2978654254 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6140b15a0 con 0x7fd6140b06d0 2023-06-10T19:07:43.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.361+0000 7fd619782640 1 -- 172.21.15.53:0/2978654254 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd61404d790 con 0x7fd6140b06d0 2023-06-10T19:07:43.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.361+0000 7fd5fb7fe640 1 -- 172.21.15.53:0/2978654254 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd608007470 con 0x7fd6140b06d0 2023-06-10T19:07:43.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.361+0000 7fd5fb7fe640 1 --2- 172.21.15.53:0/2978654254 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd600066280 0x7fd600068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:43.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.361+0000 7fd5fb7fe640 1 -- 172.21.15.53:0/2978654254 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6105+0+0 (secure 0 0 0) 0x7fd608083310 con 0x7fd6140b06d0 2023-06-10T19:07:43.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.361+0000 7fd612ffd640 1 --2- 172.21.15.53:0/2978654254 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd600066280 0x7fd600068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:43.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.365+0000 7fd612ffd640 1 --2- 172.21.15.53:0/2978654254 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd600066280 0x7fd600068730 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7fd604007fd0 tx=0x7fd604009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:43.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.365+0000 7fd5fb7fe640 1 -- 172.21.15.53:0/2978654254 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd6080507f0 con 0x7fd6140b06d0 2023-06-10T19:07:43.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.521+0000 7fd619782640 1 -- 172.21.15.53:0/2978654254 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd61415fce0 con 0x7fd6140b06d0 2023-06-10T19:07:43.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.521+0000 7fd5fb7fe640 1 -- 172.21.15.53:0/2978654254 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v168) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd608053e10 con 0x7fd6140b06d0 2023-06-10T19:07:43.525 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-06-10T19:07:43.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.525+0000 7fd619782640 1 -- 172.21.15.53:0/2978654254 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd600066280 msgr2=0x7fd600068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:43.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.525+0000 7fd619782640 1 --2- 172.21.15.53:0/2978654254 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd600066280 0x7fd600068730 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7fd604007fd0 tx=0x7fd604009040 comp rx=0 tx=0).stop 2023-06-10T19:07:43.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.525+0000 7fd619782640 1 -- 172.21.15.53:0/2978654254 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6140b06d0 msgr2=0x7fd6141497c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:43.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.525+0000 7fd619782640 1 --2- 172.21.15.53:0/2978654254 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6140b06d0 0x7fd6141497c0 secure :-1 s=READY pgs=2471 cs=0 l=1 rev1=1 crypto rx=0x7fd608005890 tx=0x7fd60800c8b0 comp rx=0 tx=0).stop 2023-06-10T19:07:43.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.525+0000 7fd619782640 1 -- 172.21.15.53:0/2978654254 shutdown_connections 2023-06-10T19:07:43.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.525+0000 7fd619782640 1 --2- 172.21.15.53:0/2978654254 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd600066280 0x7fd600068730 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:43.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.525+0000 7fd619782640 1 --2- 172.21.15.53:0/2978654254 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd61415b870 0x7fd6140b3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:43.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.525+0000 7fd619782640 1 --2- 172.21.15.53:0/2978654254 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6140b06d0 0x7fd6141497c0 unknown :-1 s=CLOSED pgs=2471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:43.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.525+0000 7fd619782640 1 --2- 172.21.15.53:0/2978654254 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd61406a930 0x7fd61415e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:43.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.525+0000 7fd619782640 1 -- 172.21.15.53:0/2978654254 >> 172.21.15.53:0/2978654254 conn(0x7fd6140cafc0 msgr2=0x7fd61415f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:43.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.525+0000 7fd619782640 1 -- 172.21.15.53:0/2978654254 shutdown_connections 2023-06-10T19:07:43.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.525+0000 7fd619782640 1 -- 172.21.15.53:0/2978654254 wait complete. 2023-06-10T19:07:43.542 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-10T19:07:43.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.653+0000 7fc8cf613640 1 Processor -- start 2023-06-10T19:07:43.660 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.653+0000 7fc8cf613640 1 -- start start 2023-06-10T19:07:43.660 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.657+0000 7fc8cf613640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc8c81571a0 0x7fc8c80c9f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:43.660 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.657+0000 7fc8cf613640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc8c8070100 0x7fc8c80af7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:43.660 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.657+0000 7fc8cf613640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8c8071190 con 0x7fc8c80afd10 2023-06-10T19:07:43.660 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.657+0000 7fc8cf613640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8c80b0190 con 0x7fc8c81571a0 2023-06-10T19:07:43.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.657+0000 7fc8cf613640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8c80ca440 con 0x7fc8c8070100 2023-06-10T19:07:43.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.657+0000 7fc8cd3af640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc8c81571a0 0x7fc8c80c9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:43.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.657+0000 7fc8cdbb0640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fc8c80afd10 0x7fc8c815d260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:35360/0 (socket says 172.21.15.53:35360) 2023-06-10T19:07:43.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.657+0000 7fc8cdbb0640 1 -- 172.21.15.53:0/3876563565 learned_addr learned my addr 172.21.15.53:0/3876563565 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:07:43.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.657+0000 7fc8ccbae640 1 --2- 172.21.15.53:0/3876563565 >> v2:172.21.15.117:3300/0 conn(0x7fc8c8070100 0x7fc8c80af7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:43.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.657+0000 7fc8cd3af640 1 -- 172.21.15.53:0/3876563565 >> v2:172.21.15.117:3300/0 conn(0x7fc8c8070100 msgr2=0x7fc8c80af7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:43.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.657+0000 7fc8cd3af640 1 --2- 172.21.15.53:0/3876563565 >> v2:172.21.15.117:3300/0 conn(0x7fc8c8070100 0x7fc8c80af7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:43.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.657+0000 7fc8cd3af640 1 -- 172.21.15.53:0/3876563565 >> v1:172.21.15.53:6789/0 conn(0x7fc8c80afd10 legacy=0x7fc8c815d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:43.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.657+0000 7fc8cd3af640 1 -- 172.21.15.53:0/3876563565 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8c8070580 con 0x7fc8c81571a0 2023-06-10T19:07:43.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.657+0000 7fc8bbfff640 1 -- 172.21.15.53:0/3876563565 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 432339421 0 0) 0x7fc8c8071190 con 0x7fc8c80afd10 2023-06-10T19:07:43.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.657+0000 7fc8ccbae640 1 --2- 172.21.15.53:0/3876563565 >> v2:172.21.15.117:3300/0 conn(0x7fc8c8070100 0x7fc8c80af7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:07:43.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.657+0000 7fc8cd3af640 1 --2- 172.21.15.53:0/3876563565 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8c81571a0 0x7fc8c80c9f00 secure :-1 s=READY pgs=2473 cs=0 l=1 rev1=1 crypto rx=0x7fc8c80b3ec0 tx=0x7fc8bc01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f1652ca68d1ef93 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:43.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.657+0000 7fc8bbfff640 1 -- 172.21.15.53:0/3876563565 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8bc0ab610 con 0x7fc8c81571a0 2023-06-10T19:07:43.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.657+0000 7fc8bbfff640 1 -- 172.21.15.53:0/3876563565 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8bc0ab770 con 0x7fc8c81571a0 2023-06-10T19:07:43.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.657+0000 7fc8bbfff640 1 -- 172.21.15.53:0/3876563565 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8bc0abb00 con 0x7fc8c81571a0 2023-06-10T19:07:43.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.661+0000 7fc8cf613640 1 -- 172.21.15.53:0/3876563565 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8c81571a0 msgr2=0x7fc8c80c9f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:43.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.661+0000 7fc8cf613640 1 --2- 172.21.15.53:0/3876563565 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8c81571a0 0x7fc8c80c9f00 secure :-1 s=READY pgs=2473 cs=0 l=1 rev1=1 crypto rx=0x7fc8c80b3ec0 tx=0x7fc8bc01c410 comp rx=0 tx=0).stop 2023-06-10T19:07:43.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.661+0000 7fc8cf613640 1 -- 172.21.15.53:0/3876563565 shutdown_connections 2023-06-10T19:07:43.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.661+0000 7fc8cf613640 1 --2- 172.21.15.53:0/3876563565 >> v2:172.21.15.117:3300/0 conn(0x7fc8c8070100 0x7fc8c80af7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:43.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.661+0000 7fc8cf613640 1 --2- 172.21.15.53:0/3876563565 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8c81571a0 0x7fc8c80c9f00 unknown :-1 s=CLOSED pgs=2473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:43.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.661+0000 7fc8cf613640 1 -- 172.21.15.53:0/3876563565 >> 172.21.15.53:0/3876563565 conn(0x7fc8c80ce9e0 msgr2=0x7fc8c80ca7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:43.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.661+0000 7fc8cf613640 1 -- 172.21.15.53:0/3876563565 shutdown_connections 2023-06-10T19:07:43.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.661+0000 7fc8cf613640 1 -- 172.21.15.53:0/3876563565 wait complete. 2023-06-10T19:07:43.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.661+0000 7fc8cf613640 1 Processor -- start 2023-06-10T19:07:43.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.661+0000 7fc8cf613640 1 -- start start 2023-06-10T19:07:43.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.661+0000 7fc8cf613640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8c80afd10 0x7fc8c80c4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:43.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.661+0000 7fc8cf613640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8c81571a0 0x7fc8c8145250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:43.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.661+0000 7fc8cf613640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8c8148f00 0x7fc8c8158df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:43.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.661+0000 7fc8cf613640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c8149c50 con 0x7fc8c8148f00 2023-06-10T19:07:43.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.661+0000 7fc8cf613640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c8145790 con 0x7fc8c81571a0 2023-06-10T19:07:43.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.661+0000 7fc8cf613640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c8149690 con 0x7fc8c80afd10 2023-06-10T19:07:43.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.661+0000 7fc8cdbb0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8c8148f00 0x7fc8c8158df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:43.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.661+0000 7fc8cdbb0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8c8148f00 0x7fc8c8158df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45100/0 (socket says 172.21.15.53:45100) 2023-06-10T19:07:43.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.661+0000 7fc8cdbb0640 1 -- 172.21.15.53:0/3261878080 learned_addr learned my addr 172.21.15.53:0/3261878080 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:43.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.661+0000 7fc8cd3af640 1 --2- 172.21.15.53:0/3261878080 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8c80afd10 0x7fc8c80c4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:43.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.661+0000 7fc8ccbae640 1 --2- 172.21.15.53:0/3261878080 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8c81571a0 0x7fc8c8145250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:43.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.661+0000 7fc8cdbb0640 1 -- 172.21.15.53:0/3261878080 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8c80afd10 msgr2=0x7fc8c80c4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:43.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.661+0000 7fc8cdbb0640 1 --2- 172.21.15.53:0/3261878080 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8c80afd10 0x7fc8c80c4350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:43.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.661+0000 7fc8cdbb0640 1 -- 172.21.15.53:0/3261878080 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8c81571a0 msgr2=0x7fc8c8145250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:43.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.661+0000 7fc8cdbb0640 1 --2- 172.21.15.53:0/3261878080 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8c81571a0 0x7fc8c8145250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:43.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.661+0000 7fc8cdbb0640 1 -- 172.21.15.53:0/3261878080 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8bc0093b0 con 0x7fc8c8148f00 2023-06-10T19:07:43.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.661+0000 7fc8ccbae640 1 --2- 172.21.15.53:0/3261878080 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8c81571a0 0x7fc8c8145250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:07:43.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.661+0000 7fc8cdbb0640 1 --2- 172.21.15.53:0/3261878080 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8c8148f00 0x7fc8c8158df0 secure :-1 s=READY pgs=2474 cs=0 l=1 rev1=1 crypto rx=0x7fc8c000c7a0 tx=0x7fc8c000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:43.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.661+0000 7fc8b9ffb640 1 -- 172.21.15.53:0/3261878080 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c000a5e0 con 0x7fc8c8148f00 2023-06-10T19:07:43.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.661+0000 7fc8b9ffb640 1 -- 172.21.15.53:0/3261878080 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8c000a740 con 0x7fc8c8148f00 2023-06-10T19:07:43.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.661+0000 7fc8cf613640 1 -- 172.21.15.53:0/3261878080 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8c8149970 con 0x7fc8c8148f00 2023-06-10T19:07:43.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.661+0000 7fc8b9ffb640 1 -- 172.21.15.53:0/3261878080 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c000ab30 con 0x7fc8c8148f00 2023-06-10T19:07:43.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.661+0000 7fc8cf613640 1 -- 172.21.15.53:0/3261878080 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8c81588d0 con 0x7fc8c8148f00 2023-06-10T19:07:43.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.665+0000 7fc8cf613640 1 -- 172.21.15.53:0/3261878080 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8c8158450 con 0x7fc8c8148f00 2023-06-10T19:07:43.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.665+0000 7fc8b9ffb640 1 -- 172.21.15.53:0/3261878080 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc8c000ac90 con 0x7fc8c8148f00 2023-06-10T19:07:43.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.665+0000 7fc8b9ffb640 1 --2- 172.21.15.53:0/3261878080 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc8ac0662b0 0x7fc8ac068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:43.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.665+0000 7fc8b9ffb640 1 -- 172.21.15.53:0/3261878080 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6105+0+0 (secure 0 0 0) 0x7fc8c0083550 con 0x7fc8c8148f00 2023-06-10T19:07:43.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.665+0000 7fc8cd3af640 1 --2- 172.21.15.53:0/3261878080 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc8ac0662b0 0x7fc8ac068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:43.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.665+0000 7fc8cd3af640 1 --2- 172.21.15.53:0/3261878080 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc8ac0662b0 0x7fc8ac068760 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc0af000 tx=0x7fc8bc0a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:43.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.669+0000 7fc8b9ffb640 1 -- 172.21.15.53:0/3261878080 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc8c8158450 con 0x7fc8c8148f00 2023-06-10T19:07:43.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.833+0000 7fc8cf613640 1 -- 172.21.15.53:0/3261878080 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc8c8158450 con 0x7fc8c8148f00 2023-06-10T19:07:43.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.833+0000 7fc8b9ffb640 1 -- 172.21.15.53:0/3261878080 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 1 entries v168) v1 ==== 80+0+57 (secure 0 0 0) 0x7fc8c8158450 con 0x7fc8c8148f00 2023-06-10T19:07:43.837 INFO:teuthology.orchestra.run.smithi053.stdout:192.168.0.1:0/4011987522 2023-06-10T20:07:37.768015+0000 2023-06-10T19:07:43.837 INFO:teuthology.orchestra.run.smithi053.stderr:listed 1 entries 2023-06-10T19:07:43.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.837+0000 7fc8cf613640 1 -- 172.21.15.53:0/3261878080 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc8ac0662b0 msgr2=0x7fc8ac068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:43.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.837+0000 7fc8cf613640 1 --2- 172.21.15.53:0/3261878080 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc8ac0662b0 0x7fc8ac068760 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc0af000 tx=0x7fc8bc0a7000 comp rx=0 tx=0).stop 2023-06-10T19:07:43.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.837+0000 7fc8cf613640 1 -- 172.21.15.53:0/3261878080 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8c8148f00 msgr2=0x7fc8c8158df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:43.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.837+0000 7fc8cf613640 1 --2- 172.21.15.53:0/3261878080 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8c8148f00 0x7fc8c8158df0 secure :-1 s=READY pgs=2474 cs=0 l=1 rev1=1 crypto rx=0x7fc8c000c7a0 tx=0x7fc8c000cc60 comp rx=0 tx=0).stop 2023-06-10T19:07:43.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.837+0000 7fc8cf613640 1 -- 172.21.15.53:0/3261878080 shutdown_connections 2023-06-10T19:07:43.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.837+0000 7fc8cf613640 1 --2- 172.21.15.53:0/3261878080 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc8ac0662b0 0x7fc8ac068760 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:43.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.837+0000 7fc8cf613640 1 --2- 172.21.15.53:0/3261878080 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8c8148f00 0x7fc8c8158df0 unknown :-1 s=CLOSED pgs=2474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:43.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.837+0000 7fc8cf613640 1 --2- 172.21.15.53:0/3261878080 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8c81571a0 0x7fc8c8145250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:43.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.837+0000 7fc8cf613640 1 --2- 172.21.15.53:0/3261878080 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc8c80afd10 0x7fc8c80c4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:43.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.837+0000 7fc8cf613640 1 -- 172.21.15.53:0/3261878080 >> 172.21.15.53:0/3261878080 conn(0x7fc8c80ce9e0 msgr2=0x7fc8c8159ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:43.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.837+0000 7fc8cf613640 1 -- 172.21.15.53:0/3261878080 shutdown_connections 2023-06-10T19:07:43.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:43.837+0000 7fc8cf613640 1 -- 172.21.15.53:0/3261878080 wait complete. 2023-06-10T19:07:43.856 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T19:07:43.857 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:07:43.862 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:07:44.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.029+0000 7f32c96b1640 1 Processor -- start 2023-06-10T19:07:44.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.029+0000 7f32c96b1640 1 -- start start 2023-06-10T19:07:44.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.029+0000 7f32c96b1640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f32c40b3ac0 0x7f32c40b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:44.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.029+0000 7f32c96b1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32c40d14c0 0x7f32c415fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:44.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.029+0000 7f32c96b1640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32c40d0020 con 0x7f32c40cc690 2023-06-10T19:07:44.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.029+0000 7f32c96b1640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32c40b43d0 con 0x7f32c40b3ac0 2023-06-10T19:07:44.034 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.029+0000 7f32c96b1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32c40cef40 con 0x7f32c40d14c0 2023-06-10T19:07:44.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.029+0000 7f32c37fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32c40d14c0 0x7f32c415fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:44.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.029+0000 7f32c2ffd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f32c40b3ac0 0x7f32c40b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:44.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.029+0000 7f32c27fc640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f32c40cc690 0x7f32c415f370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.53:47356/0 (socket says 172.21.15.53:47356) 2023-06-10T19:07:44.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.029+0000 7f32c27fc640 1 -- 172.21.15.53:0/3781587652 learned_addr learned my addr 172.21.15.53:0/3781587652 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:07:44.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.029+0000 7f32c2ffd640 1 -- 172.21.15.53:0/3781587652 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32c40d14c0 msgr2=0x7f32c415fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:44.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.029+0000 7f32c2ffd640 1 --2- 172.21.15.53:0/3781587652 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32c40d14c0 0x7f32c415fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:44.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.029+0000 7f32c2ffd640 1 -- 172.21.15.53:0/3781587652 >> v1:172.21.15.117:6789/0 conn(0x7f32c40cc690 legacy=0x7f32c415f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:44.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.029+0000 7f32c2ffd640 1 -- 172.21.15.53:0/3781587652 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32c40cf220 con 0x7f32c40b3ac0 2023-06-10T19:07:44.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.033+0000 7f32c2ffd640 1 --2- 172.21.15.53:0/3781587652 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32c40b3ac0 0x7f32c40b3e90 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f32b40097c0 tx=0x7f32b401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8667cf31f9437c3 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:44.043 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.033+0000 7f32c1ffb640 1 -- 172.21.15.53:0/3781587652 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b40ad660 con 0x7f32c40b3ac0 2023-06-10T19:07:44.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.033+0000 7f32c1ffb640 1 -- 172.21.15.53:0/3781587652 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32b40ad7c0 con 0x7f32c40b3ac0 2023-06-10T19:07:44.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.033+0000 7f32c1ffb640 1 -- 172.21.15.53:0/3781587652 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b40adb50 con 0x7f32c40b3ac0 2023-06-10T19:07:44.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.033+0000 7f32c96b1640 1 -- 172.21.15.53:0/3781587652 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32c40b3ac0 msgr2=0x7f32c40b3e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:44.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.033+0000 7f32c96b1640 1 --2- 172.21.15.53:0/3781587652 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32c40b3ac0 0x7f32c40b3e90 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f32b40097c0 tx=0x7f32b401c450 comp rx=0 tx=0).stop 2023-06-10T19:07:44.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.033+0000 7f32c96b1640 1 -- 172.21.15.53:0/3781587652 shutdown_connections 2023-06-10T19:07:44.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.033+0000 7f32c96b1640 1 --2- 172.21.15.53:0/3781587652 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32c40d14c0 0x7f32c415fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:44.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.033+0000 7f32c96b1640 1 --2- 172.21.15.53:0/3781587652 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32c40b3ac0 0x7f32c40b3e90 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:44.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.033+0000 7f32c96b1640 1 -- 172.21.15.53:0/3781587652 >> 172.21.15.53:0/3781587652 conn(0x7f32c4071790 msgr2=0x7f32c4069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:44.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.033+0000 7f32c96b1640 1 -- 172.21.15.53:0/3781587652 shutdown_connections 2023-06-10T19:07:44.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.033+0000 7f32c96b1640 1 -- 172.21.15.53:0/3781587652 wait complete. 2023-06-10T19:07:44.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.033+0000 7f32c96b1640 1 Processor -- start 2023-06-10T19:07:44.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.033+0000 7f32c96b1640 1 -- start start 2023-06-10T19:07:44.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.037+0000 7f32c96b1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32c40b3ac0 0x7f32c41486c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:44.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.037+0000 7f32c96b1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32c40cc690 0x7f32c41494a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:44.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.037+0000 7f32c96b1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32c40d14c0 0x7f32c41499e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:44.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.037+0000 7f32c96b1640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c414a3e0 con 0x7f32c40d14c0 2023-06-10T19:07:44.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.037+0000 7f32c96b1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c40b24a0 con 0x7f32c40b3ac0 2023-06-10T19:07:44.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.037+0000 7f32c96b1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32c4148c00 con 0x7f32c40cc690 2023-06-10T19:07:44.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.037+0000 7f32c37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32c40d14c0 0x7f32c41499e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:44.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.037+0000 7f32c37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32c40d14c0 0x7f32c41499e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45116/0 (socket says 172.21.15.53:45116) 2023-06-10T19:07:44.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.037+0000 7f32c37fe640 1 -- 172.21.15.53:0/377523114 learned_addr learned my addr 172.21.15.53:0/377523114 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:44.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.037+0000 7f32c27fc640 1 --2- 172.21.15.53:0/377523114 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32c40cc690 0x7f32c41494a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:44.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.037+0000 7f32c2ffd640 1 --2- 172.21.15.53:0/377523114 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32c40b3ac0 0x7f32c41486c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:44.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.037+0000 7f32c37fe640 1 -- 172.21.15.53:0/377523114 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32c40cc690 msgr2=0x7f32c41494a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:44.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.037+0000 7f32c37fe640 1 --2- 172.21.15.53:0/377523114 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32c40cc690 0x7f32c41494a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:44.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.037+0000 7f32c37fe640 1 -- 172.21.15.53:0/377523114 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32c40b3ac0 msgr2=0x7f32c41486c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:44.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.037+0000 7f32c37fe640 1 --2- 172.21.15.53:0/377523114 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32c40b3ac0 0x7f32c41486c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:44.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.037+0000 7f32c37fe640 1 -- 172.21.15.53:0/377523114 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32b4009420 con 0x7f32c40d14c0 2023-06-10T19:07:44.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.037+0000 7f32c27fc640 1 --2- 172.21.15.53:0/377523114 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32c40cc690 0x7f32c41494a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:07:44.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.037+0000 7f32c37fe640 1 --2- 172.21.15.53:0/377523114 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32c40d14c0 0x7f32c41499e0 secure :-1 s=READY pgs=2475 cs=0 l=1 rev1=1 crypto rx=0x7f32bc00efc0 tx=0x7f32bc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:44.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.037+0000 7f32ab7fe640 1 -- 172.21.15.53:0/377523114 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32bc009ba0 con 0x7f32c40d14c0 2023-06-10T19:07:44.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.037+0000 7f32ab7fe640 1 -- 172.21.15.53:0/377523114 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32bc00f040 con 0x7f32c40d14c0 2023-06-10T19:07:44.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.037+0000 7f32ab7fe640 1 -- 172.21.15.53:0/377523114 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32bc0146c0 con 0x7f32c40d14c0 2023-06-10T19:07:44.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.037+0000 7f32c96b1640 1 -- 172.21.15.53:0/377523114 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32c4157320 con 0x7f32c40d14c0 2023-06-10T19:07:44.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.037+0000 7f32c96b1640 1 -- 172.21.15.53:0/377523114 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32c41578a0 con 0x7f32c40d14c0 2023-06-10T19:07:44.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.037+0000 7f32c96b1640 1 -- 172.21.15.53:0/377523114 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32c40b2610 con 0x7f32c40d14c0 2023-06-10T19:07:44.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.037+0000 7f32ab7fe640 1 -- 172.21.15.53:0/377523114 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f32bc014820 con 0x7f32c40d14c0 2023-06-10T19:07:44.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.037+0000 7f32ab7fe640 1 --2- 172.21.15.53:0/377523114 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f32b0066280 0x7f32b0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:44.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.037+0000 7f32ab7fe640 1 -- 172.21.15.53:0/377523114 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6105+0+0 (secure 0 0 0) 0x7f32bc0848d0 con 0x7f32c40d14c0 2023-06-10T19:07:44.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.037+0000 7f32c2ffd640 1 --2- 172.21.15.53:0/377523114 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f32b0066280 0x7f32b0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:44.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.041+0000 7f32c2ffd640 1 --2- 172.21.15.53:0/377523114 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f32b0066280 0x7f32b0068730 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f32b40af000 tx=0x7f32b4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:44.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.041+0000 7f32ab7fe640 1 -- 172.21.15.53:0/377523114 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f32bc051c80 con 0x7f32c40d14c0 2023-06-10T19:07:44.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.201+0000 7f32c96b1640 1 -- 172.21.15.53:0/377523114 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f32c404d790 con 0x7f32c40d14c0 2023-06-10T19:07:44.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.201+0000 7f32ab7fe640 1 -- 172.21.15.53:0/377523114 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v168) v1 ==== 74+0+18341 (secure 0 0 0) 0x7f32bc0552a0 con 0x7f32c40d14c0 2023-06-10T19:07:44.205 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:07:44.205 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":168,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:07:38.149577+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-06-10T19:07:13.365954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"166","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-06-10T19:07:14.695077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.0.1:0/4011987522":"2023-06-10T20:07:37.768015+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:07:44.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.205+0000 7f32c96b1640 1 -- 172.21.15.53:0/377523114 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f32b0066280 msgr2=0x7f32b0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:44.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.205+0000 7f32c96b1640 1 --2- 172.21.15.53:0/377523114 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f32b0066280 0x7f32b0068730 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f32b40af000 tx=0x7f32b4008040 comp rx=0 tx=0).stop 2023-06-10T19:07:44.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.205+0000 7f32c96b1640 1 -- 172.21.15.53:0/377523114 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32c40d14c0 msgr2=0x7f32c41499e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:44.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.205+0000 7f32c96b1640 1 --2- 172.21.15.53:0/377523114 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32c40d14c0 0x7f32c41499e0 secure :-1 s=READY pgs=2475 cs=0 l=1 rev1=1 crypto rx=0x7f32bc00efc0 tx=0x7f32bc00c490 comp rx=0 tx=0).stop 2023-06-10T19:07:44.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.205+0000 7f32c96b1640 1 -- 172.21.15.53:0/377523114 shutdown_connections 2023-06-10T19:07:44.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.205+0000 7f32c96b1640 1 --2- 172.21.15.53:0/377523114 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f32b0066280 0x7f32b0068730 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:44.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.205+0000 7f32c96b1640 1 --2- 172.21.15.53:0/377523114 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32c40d14c0 0x7f32c41499e0 unknown :-1 s=CLOSED pgs=2475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:44.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.205+0000 7f32c96b1640 1 --2- 172.21.15.53:0/377523114 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f32c40cc690 0x7f32c41494a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:44.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.205+0000 7f32c96b1640 1 --2- 172.21.15.53:0/377523114 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32c40b3ac0 0x7f32c41486c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:44.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.205+0000 7f32c96b1640 1 -- 172.21.15.53:0/377523114 >> 172.21.15.53:0/377523114 conn(0x7f32c4071790 msgr2=0x7f32c40b64b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:44.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.205+0000 7f32c96b1640 1 -- 172.21.15.53:0/377523114 shutdown_connections 2023-06-10T19:07:44.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.205+0000 7f32c96b1640 1 -- 172.21.15.53:0/377523114 wait complete. 2023-06-10T19:07:44.225 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-10T18:52:33.633114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-10T18:52:39.171487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 23, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-10T19:07:13.365954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '166', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 24, 'pool_name': 'cephfs_data', 'create_time': '2023-06-10T19:07:14.695077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '167', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-10T19:07:44.226 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-10T19:07:44.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.353+0000 7f88538e6640 1 Processor -- start 2023-06-10T19:07:44.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.353+0000 7f88538e6640 1 -- start start 2023-06-10T19:07:44.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.357+0000 7f88538e6640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f884c159450 0x7f884c15d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:44.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.357+0000 7f88538e6640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f884c15d680 0x7f884c0cec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:44.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.357+0000 7f88538e6640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f884c0cbac0 con 0x7f884c0cf180 2023-06-10T19:07:44.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.357+0000 7f88538e6640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f884c0cf5c0 con 0x7f884c15d680 2023-06-10T19:07:44.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.357+0000 7f88538e6640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f884c15dc00 con 0x7f884c159450 2023-06-10T19:07:44.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.357+0000 7f8850e81640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f884c15d680 0x7f884c0cec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:44.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.357+0000 7f8851e83640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f884c0cf180 0x7f884c0cda20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:35376/0 (socket says 172.21.15.53:35376) 2023-06-10T19:07:44.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.357+0000 7f8851e83640 1 -- 172.21.15.53:0/1455684906 learned_addr learned my addr 172.21.15.53:0/1455684906 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:07:44.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.357+0000 7f8851682640 1 --2- 172.21.15.53:0/1455684906 >> v2:172.21.15.117:3300/0 conn(0x7f884c159450 0x7f884c15d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:44.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.357+0000 7f8850e81640 1 -- 172.21.15.53:0/1455684906 >> v2:172.21.15.117:3300/0 conn(0x7f884c159450 msgr2=0x7f884c15d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:44.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.357+0000 7f8850e81640 1 --2- 172.21.15.53:0/1455684906 >> v2:172.21.15.117:3300/0 conn(0x7f884c159450 0x7f884c15d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:44.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.357+0000 7f8850e81640 1 -- 172.21.15.53:0/1455684906 >> v1:172.21.15.53:6789/0 conn(0x7f884c0cf180 legacy=0x7f884c0cda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:44.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.357+0000 7f8843fff640 1 -- 172.21.15.53:0/1455684906 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2609599307 0 0) 0x7f884c0cbac0 con 0x7f884c0cf180 2023-06-10T19:07:44.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.357+0000 7f8850e81640 1 -- 172.21.15.53:0/1455684906 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f884c15dee0 con 0x7f884c15d680 2023-06-10T19:07:44.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.357+0000 7f8850e81640 1 --2- 172.21.15.53:0/1455684906 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f884c15d680 0x7f884c0cec40 secure :-1 s=READY pgs=2477 cs=0 l=1 rev1=1 crypto rx=0x7f884c0b29a0 tx=0x7f883c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cdf7bb634e98c1e server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:44.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.357+0000 7f8843fff640 1 -- 172.21.15.53:0/1455684906 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883c0ab5f0 con 0x7f884c15d680 2023-06-10T19:07:44.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.357+0000 7f8843fff640 1 -- 172.21.15.53:0/1455684906 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f883c0ab750 con 0x7f884c15d680 2023-06-10T19:07:44.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.357+0000 7f8843fff640 1 -- 172.21.15.53:0/1455684906 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883c0abae0 con 0x7f884c15d680 2023-06-10T19:07:44.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.361+0000 7f88538e6640 1 -- 172.21.15.53:0/1455684906 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f884c15d680 msgr2=0x7f884c0cec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:44.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.361+0000 7f88538e6640 1 --2- 172.21.15.53:0/1455684906 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f884c15d680 0x7f884c0cec40 secure :-1 s=READY pgs=2477 cs=0 l=1 rev1=1 crypto rx=0x7f884c0b29a0 tx=0x7f883c01c430 comp rx=0 tx=0).stop 2023-06-10T19:07:44.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.361+0000 7f88538e6640 1 -- 172.21.15.53:0/1455684906 shutdown_connections 2023-06-10T19:07:44.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.361+0000 7f88538e6640 1 --2- 172.21.15.53:0/1455684906 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f884c15d680 0x7f884c0cec40 unknown :-1 s=CLOSED pgs=2477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:44.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.361+0000 7f88538e6640 1 --2- 172.21.15.53:0/1455684906 >> v2:172.21.15.117:3300/0 conn(0x7f884c159450 0x7f884c15d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:44.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.361+0000 7f88538e6640 1 -- 172.21.15.53:0/1455684906 >> 172.21.15.53:0/1455684906 conn(0x7f884c06a090 msgr2=0x7f884c06d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:44.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.361+0000 7f88538e6640 1 -- 172.21.15.53:0/1455684906 shutdown_connections 2023-06-10T19:07:44.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.361+0000 7f88538e6640 1 -- 172.21.15.53:0/1455684906 wait complete. 2023-06-10T19:07:44.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.361+0000 7f88538e6640 1 Processor -- start 2023-06-10T19:07:44.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.361+0000 7f88538e6640 1 -- start start 2023-06-10T19:07:44.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.361+0000 7f88538e6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f884c0cf180 0x7f884c15c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:44.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.361+0000 7f88538e6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f884c159450 0x7f884c152f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:44.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.361+0000 7f88538e6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f884c15d680 0x7f884c0c96c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:44.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.361+0000 7f88538e6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f884c15c9b0 con 0x7f884c0cf180 2023-06-10T19:07:44.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.361+0000 7f88538e6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f884c0b3910 con 0x7f884c15d680 2023-06-10T19:07:44.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.361+0000 7f88538e6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f884c0b3bf0 con 0x7f884c159450 2023-06-10T19:07:44.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.361+0000 7f8851682640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f884c0cf180 0x7f884c15c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:44.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.361+0000 7f8851682640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f884c0cf180 0x7f884c15c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45140/0 (socket says 172.21.15.53:45140) 2023-06-10T19:07:44.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.361+0000 7f8851682640 1 -- 172.21.15.53:0/1839370073 learned_addr learned my addr 172.21.15.53:0/1839370073 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:44.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.361+0000 7f8850e81640 1 --2- 172.21.15.53:0/1839370073 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f884c159450 0x7f884c152f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:44.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.361+0000 7f8851682640 1 -- 172.21.15.53:0/1839370073 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f884c159450 msgr2=0x7f884c152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:44.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.361+0000 7f8851e83640 1 --2- 172.21.15.53:0/1839370073 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f884c15d680 0x7f884c0c96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:44.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.361+0000 7f8851682640 1 --2- 172.21.15.53:0/1839370073 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f884c159450 0x7f884c152f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:44.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.361+0000 7f8851682640 1 -- 172.21.15.53:0/1839370073 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f884c15d680 msgr2=0x7f884c0c96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:44.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.361+0000 7f8851682640 1 --2- 172.21.15.53:0/1839370073 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f884c15d680 0x7f884c0c96c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:44.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.361+0000 7f8851682640 1 -- 172.21.15.53:0/1839370073 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f883c009420 con 0x7f884c0cf180 2023-06-10T19:07:44.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.361+0000 7f8851e83640 1 --2- 172.21.15.53:0/1839370073 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f884c15d680 0x7f884c0c96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:07:44.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.361+0000 7f8851682640 1 --2- 172.21.15.53:0/1839370073 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f884c0cf180 0x7f884c15c470 secure :-1 s=READY pgs=2478 cs=0 l=1 rev1=1 crypto rx=0x7f884800d5f0 tx=0x7f884800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:44.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.361+0000 7f8841ffb640 1 -- 172.21.15.53:0/1839370073 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88480125f0 con 0x7f884c0cf180 2023-06-10T19:07:44.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.361+0000 7f8841ffb640 1 -- 172.21.15.53:0/1839370073 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8848012750 con 0x7f884c0cf180 2023-06-10T19:07:44.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.361+0000 7f8841ffb640 1 -- 172.21.15.53:0/1839370073 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8848012ae0 con 0x7f884c0cf180 2023-06-10T19:07:44.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.361+0000 7f88538e6640 1 -- 172.21.15.53:0/1839370073 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f884c0b3ed0 con 0x7f884c0cf180 2023-06-10T19:07:44.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.361+0000 7f88538e6640 1 -- 172.21.15.53:0/1839370073 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f884c150e60 con 0x7f884c0cf180 2023-06-10T19:07:44.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.365+0000 7f88538e6640 1 -- 172.21.15.53:0/1839370073 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f884c04d790 con 0x7f884c0cf180 2023-06-10T19:07:44.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.365+0000 7f8841ffb640 1 -- 172.21.15.53:0/1839370073 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8848012c40 con 0x7f884c0cf180 2023-06-10T19:07:44.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.365+0000 7f8841ffb640 1 --2- 172.21.15.53:0/1839370073 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f88300662b0 0x7f8830068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:44.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.365+0000 7f8841ffb640 1 -- 172.21.15.53:0/1839370073 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6105+0+0 (secure 0 0 0) 0x7f8848084220 con 0x7f884c0cf180 2023-06-10T19:07:44.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.365+0000 7f8850e81640 1 --2- 172.21.15.53:0/1839370073 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f88300662b0 0x7f8830068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:44.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.365+0000 7f8850e81640 1 --2- 172.21.15.53:0/1839370073 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f88300662b0 0x7f8830068760 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f883c0af000 tx=0x7f883c0b6040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:44.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.369+0000 7f8841ffb640 1 -- 172.21.15.53:0/1839370073 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8848051670 con 0x7f884c0cf180 2023-06-10T19:07:44.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.525+0000 7f88538e6640 1 -- 172.21.15.53:0/1839370073 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f884c06df70 con 0x7f884c0cf180 2023-06-10T19:07:44.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.529+0000 7f8841ffb640 1 -- 172.21.15.53:0/1839370073 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v168) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8848007380 con 0x7f884c0cf180 2023-06-10T19:07:44.531 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-06-10T19:07:44.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.529+0000 7f88538e6640 1 -- 172.21.15.53:0/1839370073 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f88300662b0 msgr2=0x7f8830068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:44.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.529+0000 7f88538e6640 1 --2- 172.21.15.53:0/1839370073 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f88300662b0 0x7f8830068760 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f883c0af000 tx=0x7f883c0b6040 comp rx=0 tx=0).stop 2023-06-10T19:07:44.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.529+0000 7f88538e6640 1 -- 172.21.15.53:0/1839370073 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f884c0cf180 msgr2=0x7f884c15c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:44.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.529+0000 7f88538e6640 1 --2- 172.21.15.53:0/1839370073 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f884c0cf180 0x7f884c15c470 secure :-1 s=READY pgs=2478 cs=0 l=1 rev1=1 crypto rx=0x7f884800d5f0 tx=0x7f884800dab0 comp rx=0 tx=0).stop 2023-06-10T19:07:44.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.529+0000 7f88538e6640 1 -- 172.21.15.53:0/1839370073 shutdown_connections 2023-06-10T19:07:44.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.529+0000 7f88538e6640 1 --2- 172.21.15.53:0/1839370073 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f88300662b0 0x7f8830068760 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:44.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.529+0000 7f88538e6640 1 --2- 172.21.15.53:0/1839370073 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f884c15d680 0x7f884c0c96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:44.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.529+0000 7f88538e6640 1 --2- 172.21.15.53:0/1839370073 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f884c159450 0x7f884c152f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:44.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.529+0000 7f88538e6640 1 --2- 172.21.15.53:0/1839370073 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f884c0cf180 0x7f884c15c470 unknown :-1 s=CLOSED pgs=2478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:44.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.529+0000 7f88538e6640 1 -- 172.21.15.53:0/1839370073 >> 172.21.15.53:0/1839370073 conn(0x7f884c06a090 msgr2=0x7f884c0b2c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:44.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.529+0000 7f88538e6640 1 -- 172.21.15.53:0/1839370073 shutdown_connections 2023-06-10T19:07:44.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.529+0000 7f88538e6640 1 -- 172.21.15.53:0/1839370073 wait complete. 2023-06-10T19:07:44.550 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-10T19:07:44.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.673+0000 7fc353f95640 1 Processor -- start 2023-06-10T19:07:44.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.673+0000 7fc353f95640 1 -- start start 2023-06-10T19:07:44.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.673+0000 7fc353f95640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc34c15c060 0x7fc34c0cc020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:44.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.673+0000 7fc353f95640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc34c15cb40 0x7fc34c06bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:44.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.673+0000 7fc353f95640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc34c15cf60 con 0x7fc34c070de0 2023-06-10T19:07:44.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.673+0000 7fc353f95640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc34c0c8d50 con 0x7fc34c15c060 2023-06-10T19:07:44.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.673+0000 7fc353f95640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc34c0c9030 con 0x7fc34c15cb40 2023-06-10T19:07:44.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.673+0000 7fc351d31640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc34c15c060 0x7fc34c0cc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:44.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.673+0000 7fc351d31640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc34c15c060 0x7fc34c0cc020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45148/0 (socket says 172.21.15.53:45148) 2023-06-10T19:07:44.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.673+0000 7fc352532640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc34c15cb40 0x7fc34c06bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:44.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.673+0000 7fc351d31640 1 -- 172.21.15.53:0/2521122472 learned_addr learned my addr 172.21.15.53:0/2521122472 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:44.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.673+0000 7fc351d31640 1 -- 172.21.15.53:0/2521122472 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc34c15cb40 msgr2=0x7fc34c06bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:44.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.673+0000 7fc351d31640 1 --2- 172.21.15.53:0/2521122472 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc34c15cb40 0x7fc34c06bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:44.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.673+0000 7fc351d31640 1 -- 172.21.15.53:0/2521122472 >> v1:172.21.15.117:6789/0 conn(0x7fc34c070de0 legacy=0x7fc34c15c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:44.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.673+0000 7fc351d31640 1 -- 172.21.15.53:0/2521122472 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc34c070300 con 0x7fc34c15c060 2023-06-10T19:07:44.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.677+0000 7fc351d31640 1 --2- 172.21.15.53:0/2521122472 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc34c15c060 0x7fc34c0cc020 secure :-1 s=READY pgs=2479 cs=0 l=1 rev1=1 crypto rx=0x7fc348009870 tx=0x7fc34801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df66ba03a4e546cd server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:44.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.681+0000 7fc350d2f640 1 -- 172.21.15.53:0/2521122472 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3480ac620 con 0x7fc34c15c060 2023-06-10T19:07:44.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.681+0000 7fc350d2f640 1 -- 172.21.15.53:0/2521122472 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3480ac780 con 0x7fc34c15c060 2023-06-10T19:07:44.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.681+0000 7fc350d2f640 1 -- 172.21.15.53:0/2521122472 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3480acb10 con 0x7fc34c15c060 2023-06-10T19:07:44.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.681+0000 7fc353f95640 1 -- 172.21.15.53:0/2521122472 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc34c15c060 msgr2=0x7fc34c0cc020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:44.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.681+0000 7fc353f95640 1 --2- 172.21.15.53:0/2521122472 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc34c15c060 0x7fc34c0cc020 secure :-1 s=READY pgs=2479 cs=0 l=1 rev1=1 crypto rx=0x7fc348009870 tx=0x7fc34801c4b0 comp rx=0 tx=0).stop 2023-06-10T19:07:44.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.681+0000 7fc353f95640 1 -- 172.21.15.53:0/2521122472 shutdown_connections 2023-06-10T19:07:44.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.681+0000 7fc353f95640 1 --2- 172.21.15.53:0/2521122472 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc34c15cb40 0x7fc34c06bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:44.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.681+0000 7fc353f95640 1 --2- 172.21.15.53:0/2521122472 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc34c15c060 0x7fc34c0cc020 unknown :-1 s=CLOSED pgs=2479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:44.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.681+0000 7fc353f95640 1 -- 172.21.15.53:0/2521122472 >> 172.21.15.53:0/2521122472 conn(0x7fc34c06a0e0 msgr2=0x7fc34c0cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:44.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.681+0000 7fc353f95640 1 -- 172.21.15.53:0/2521122472 shutdown_connections 2023-06-10T19:07:44.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.681+0000 7fc353f95640 1 -- 172.21.15.53:0/2521122472 wait complete. 2023-06-10T19:07:44.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.681+0000 7fc353f95640 1 Processor -- start 2023-06-10T19:07:44.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.681+0000 7fc353f95640 1 -- start start 2023-06-10T19:07:44.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.681+0000 7fc353f95640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc34c070de0 0x7fc34c158a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:44.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.681+0000 7fc353f95640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc34c15c060 0x7fc34c14b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:44.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.681+0000 7fc353f95640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc34c15cb40 0x7fc34c0af7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:44.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.681+0000 7fc353f95640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc34c14c680 con 0x7fc34c070de0 2023-06-10T19:07:44.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.681+0000 7fc353f95640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc34c0c3cc0 con 0x7fc34c15cb40 2023-06-10T19:07:44.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.681+0000 7fc353f95640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc34c0c3fa0 con 0x7fc34c15c060 2023-06-10T19:07:44.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.681+0000 7fc351d31640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc34c070de0 0x7fc34c158a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:44.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.681+0000 7fc351d31640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc34c070de0 0x7fc34c158a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45150/0 (socket says 172.21.15.53:45150) 2023-06-10T19:07:44.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.681+0000 7fc351530640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc34c15c060 0x7fc34c14b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:44.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.681+0000 7fc351d31640 1 -- 172.21.15.53:0/2609335888 learned_addr learned my addr 172.21.15.53:0/2609335888 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:44.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.681+0000 7fc352532640 1 --2- 172.21.15.53:0/2609335888 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc34c15cb40 0x7fc34c0af7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:44.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.681+0000 7fc351d31640 1 -- 172.21.15.53:0/2609335888 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc34c15c060 msgr2=0x7fc34c14b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:44.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.681+0000 7fc351d31640 1 --2- 172.21.15.53:0/2609335888 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc34c15c060 0x7fc34c14b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:44.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.681+0000 7fc351d31640 1 -- 172.21.15.53:0/2609335888 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc34c15cb40 msgr2=0x7fc34c0af7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:44.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.681+0000 7fc351d31640 1 --2- 172.21.15.53:0/2609335888 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc34c15cb40 0x7fc34c0af7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:44.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.681+0000 7fc351d31640 1 -- 172.21.15.53:0/2609335888 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3480094d0 con 0x7fc34c070de0 2023-06-10T19:07:44.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.681+0000 7fc351d31640 1 --2- 172.21.15.53:0/2609335888 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc34c070de0 0x7fc34c158a70 secure :-1 s=READY pgs=2480 cs=0 l=1 rev1=1 crypto rx=0x7fc3480af040 tx=0x7fc348019250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:44.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.685+0000 7fc33e7fc640 1 -- 172.21.15.53:0/2609335888 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3480b7470 con 0x7fc34c070de0 2023-06-10T19:07:44.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.685+0000 7fc33e7fc640 1 -- 172.21.15.53:0/2609335888 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3480b75d0 con 0x7fc34c070de0 2023-06-10T19:07:44.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.685+0000 7fc353f95640 1 -- 172.21.15.53:0/2609335888 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc34c0c4280 con 0x7fc34c070de0 2023-06-10T19:07:44.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.685+0000 7fc33e7fc640 1 -- 172.21.15.53:0/2609335888 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3480b7980 con 0x7fc34c070de0 2023-06-10T19:07:44.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.685+0000 7fc353f95640 1 -- 172.21.15.53:0/2609335888 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc34c15b1f0 con 0x7fc34c070de0 2023-06-10T19:07:44.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.685+0000 7fc353f95640 1 -- 172.21.15.53:0/2609335888 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc34c15b3e0 con 0x7fc34c070de0 2023-06-10T19:07:44.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.685+0000 7fc33e7fc640 1 -- 172.21.15.53:0/2609335888 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc3480b3070 con 0x7fc34c070de0 2023-06-10T19:07:44.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.685+0000 7fc33e7fc640 1 --2- 172.21.15.53:0/2609335888 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc330066280 0x7fc330068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:44.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.685+0000 7fc33e7fc640 1 -- 172.21.15.53:0/2609335888 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6105+0+0 (secure 0 0 0) 0x7fc34811e1c0 con 0x7fc34c070de0 2023-06-10T19:07:44.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.685+0000 7fc351530640 1 --2- 172.21.15.53:0/2609335888 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc330066280 0x7fc330068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:44.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.685+0000 7fc351530640 1 --2- 172.21.15.53:0/2609335888 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc330066280 0x7fc330068730 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fc34c0c33e0 tx=0x7fc340009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:44.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.689+0000 7fc33e7fc640 1 -- 172.21.15.53:0/2609335888 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc3480eb750 con 0x7fc34c070de0 2023-06-10T19:07:44.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.845+0000 7fc353f95640 1 -- 172.21.15.53:0/2609335888 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc34c04d790 con 0x7fc34c070de0 2023-06-10T19:07:44.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.845+0000 7fc33e7fc640 1 -- 172.21.15.53:0/2609335888 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v168) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc3480b10a0 con 0x7fc34c070de0 2023-06-10T19:07:44.850 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-06-10T19:07:44.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.849+0000 7fc353f95640 1 -- 172.21.15.53:0/2609335888 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc330066280 msgr2=0x7fc330068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:44.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.849+0000 7fc353f95640 1 --2- 172.21.15.53:0/2609335888 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc330066280 0x7fc330068730 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fc34c0c33e0 tx=0x7fc340009040 comp rx=0 tx=0).stop 2023-06-10T19:07:44.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.849+0000 7fc353f95640 1 -- 172.21.15.53:0/2609335888 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc34c070de0 msgr2=0x7fc34c158a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:44.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.849+0000 7fc353f95640 1 --2- 172.21.15.53:0/2609335888 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc34c070de0 0x7fc34c158a70 secure :-1 s=READY pgs=2480 cs=0 l=1 rev1=1 crypto rx=0x7fc3480af040 tx=0x7fc348019250 comp rx=0 tx=0).stop 2023-06-10T19:07:44.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.849+0000 7fc353f95640 1 -- 172.21.15.53:0/2609335888 shutdown_connections 2023-06-10T19:07:44.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.849+0000 7fc353f95640 1 --2- 172.21.15.53:0/2609335888 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc330066280 0x7fc330068730 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:44.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.849+0000 7fc353f95640 1 --2- 172.21.15.53:0/2609335888 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc34c15cb40 0x7fc34c0af7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:44.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.849+0000 7fc353f95640 1 --2- 172.21.15.53:0/2609335888 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc34c15c060 0x7fc34c14b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:44.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.849+0000 7fc353f95640 1 --2- 172.21.15.53:0/2609335888 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc34c070de0 0x7fc34c158a70 unknown :-1 s=CLOSED pgs=2480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:44.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.849+0000 7fc353f95640 1 -- 172.21.15.53:0/2609335888 >> 172.21.15.53:0/2609335888 conn(0x7fc34c06a0e0 msgr2=0x7fc34c0cc680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:44.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.849+0000 7fc353f95640 1 -- 172.21.15.53:0/2609335888 shutdown_connections 2023-06-10T19:07:44.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.849+0000 7fc353f95640 1 -- 172.21.15.53:0/2609335888 wait complete. 2023-06-10T19:07:44.869 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-10T19:07:44.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.993+0000 7f26857b0640 1 Processor -- start 2023-06-10T19:07:44.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.993+0000 7f26857b0640 1 -- start start 2023-06-10T19:07:44.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.993+0000 7f26857b0640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2680157cb0 0x7f268006b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:44.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.993+0000 7f26857b0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f268006b5d0 0x7f268015b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:44.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.993+0000 7f26857b0640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26800cda00 con 0x7f26801578e0 2023-06-10T19:07:44.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.993+0000 7f26857b0640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2680158130 con 0x7f2680157cb0 2023-06-10T19:07:44.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.993+0000 7f26857b0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f268015b440 con 0x7f268006b5d0 2023-06-10T19:07:44.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.993+0000 7f267effd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f26801578e0 0x7f26800cd2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:35382/0 (socket says 172.21.15.53:35382) 2023-06-10T19:07:44.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.993+0000 7f267effd640 1 -- 172.21.15.53:0/1086289682 learned_addr learned my addr 172.21.15.53:0/1086289682 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:07:44.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.993+0000 7f267e7fc640 1 --2- 172.21.15.53:0/1086289682 >> v2:172.21.15.53:3300/0 conn(0x7f2680157cb0 0x7f268006b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:44.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.993+0000 7f267f7fe640 1 --2- 172.21.15.53:0/1086289682 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f268006b5d0 0x7f268015b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:44.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.993+0000 7f267dffb640 1 -- 172.21.15.53:0/1086289682 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 64849253 0 0) 0x7f26800cda00 con 0x7f26801578e0 2023-06-10T19:07:44.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.993+0000 7f267dffb640 1 -- 172.21.15.53:0/1086289682 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f266c003530 con 0x7f26801578e0 2023-06-10T19:07:44.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.993+0000 7f267e7fc640 1 -- 172.21.15.53:0/1086289682 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f268006b5d0 msgr2=0x7f268015b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:44.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.993+0000 7f267e7fc640 1 --2- 172.21.15.53:0/1086289682 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f268006b5d0 0x7f268015b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:44.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.993+0000 7f267e7fc640 1 -- 172.21.15.53:0/1086289682 >> v1:172.21.15.53:6789/0 conn(0x7f26801578e0 legacy=0x7f26800cd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:44.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.993+0000 7f267e7fc640 1 -- 172.21.15.53:0/1086289682 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26801583c0 con 0x7f2680157cb0 2023-06-10T19:07:44.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.997+0000 7f267e7fc640 1 --2- 172.21.15.53:0/1086289682 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2680157cb0 0x7f268006b090 secure :-1 s=READY pgs=2482 cs=0 l=1 rev1=1 crypto rx=0x7f267000aea0 tx=0x7f267001d990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=859113a9d901c00b server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:44.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.997+0000 7f267dffb640 1 -- 172.21.15.53:0/1086289682 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f267000a2d0 con 0x7f2680157cb0 2023-06-10T19:07:44.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.997+0000 7f267dffb640 1 -- 172.21.15.53:0/1086289682 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26700a6850 con 0x7f2680157cb0 2023-06-10T19:07:45.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.997+0000 7f267dffb640 1 -- 172.21.15.53:0/1086289682 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26700a6be0 con 0x7f2680157cb0 2023-06-10T19:07:45.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.997+0000 7f26857b0640 1 -- 172.21.15.53:0/1086289682 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2680157cb0 msgr2=0x7f268006b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:45.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.997+0000 7f26857b0640 1 --2- 172.21.15.53:0/1086289682 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2680157cb0 0x7f268006b090 secure :-1 s=READY pgs=2482 cs=0 l=1 rev1=1 crypto rx=0x7f267000aea0 tx=0x7f267001d990 comp rx=0 tx=0).stop 2023-06-10T19:07:45.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.997+0000 7f26857b0640 1 -- 172.21.15.53:0/1086289682 shutdown_connections 2023-06-10T19:07:45.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.997+0000 7f26857b0640 1 --2- 172.21.15.53:0/1086289682 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2680157cb0 0x7f268006b090 unknown :-1 s=CLOSED pgs=2482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:45.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.997+0000 7f26857b0640 1 --2- 172.21.15.53:0/1086289682 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f268006b5d0 0x7f268015b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:45.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.997+0000 7f26857b0640 1 -- 172.21.15.53:0/1086289682 >> 172.21.15.53:0/1086289682 conn(0x7f268006a0e0 msgr2=0x7f26800cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:45.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.997+0000 7f26857b0640 1 -- 172.21.15.53:0/1086289682 shutdown_connections 2023-06-10T19:07:45.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.997+0000 7f26857b0640 1 -- 172.21.15.53:0/1086289682 wait complete. 2023-06-10T19:07:45.002 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.997+0000 7f26857b0640 1 Processor -- start 2023-06-10T19:07:45.002 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.997+0000 7f26857b0640 1 -- start start 2023-06-10T19:07:45.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.997+0000 7f26857b0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f268006b5d0 0x7f268014fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:45.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.997+0000 7f26857b0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26801578e0 0x7f26800c4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:45.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.997+0000 7f26857b0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2680157cb0 0x7f26800c4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:45.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.997+0000 7f26857b0640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f268014e3b0 con 0x7f268006b5d0 2023-06-10T19:07:45.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.997+0000 7f26857b0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26800c5260 con 0x7f26801578e0 2023-06-10T19:07:45.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.997+0000 7f26857b0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f268014ecd0 con 0x7f2680157cb0 2023-06-10T19:07:45.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.997+0000 7f267effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f268006b5d0 0x7f268014fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:45.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.997+0000 7f267effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f268006b5d0 0x7f268014fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45160/0 (socket says 172.21.15.53:45160) 2023-06-10T19:07:45.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.997+0000 7f267effd640 1 -- 172.21.15.53:0/4027633360 learned_addr learned my addr 172.21.15.53:0/4027633360 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:45.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.997+0000 7f267effd640 1 -- 172.21.15.53:0/4027633360 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2680157cb0 msgr2=0x7f26800c4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:45.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.997+0000 7f267effd640 1 --2- 172.21.15.53:0/4027633360 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2680157cb0 0x7f26800c4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:45.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.997+0000 7f267effd640 1 -- 172.21.15.53:0/4027633360 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26801578e0 msgr2=0x7f26800c4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:45.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.997+0000 7f267effd640 1 --2- 172.21.15.53:0/4027633360 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26801578e0 0x7f26800c4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:45.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:44.997+0000 7f267effd640 1 -- 172.21.15.53:0/4027633360 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f267000ab80 con 0x7f268006b5d0 2023-06-10T19:07:45.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.001+0000 7f267effd640 1 --2- 172.21.15.53:0/4027633360 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f268006b5d0 0x7f268014fce0 secure :-1 s=READY pgs=2483 cs=0 l=1 rev1=1 crypto rx=0x7f266800c4d0 tx=0x7f266800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:45.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.001+0000 7f26777fe640 1 -- 172.21.15.53:0/4027633360 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2668005cf0 con 0x7f268006b5d0 2023-06-10T19:07:45.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.001+0000 7f26777fe640 1 -- 172.21.15.53:0/4027633360 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2668005e50 con 0x7f268006b5d0 2023-06-10T19:07:45.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.001+0000 7f26857b0640 1 -- 172.21.15.53:0/4027633360 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f268014ef20 con 0x7f268006b5d0 2023-06-10T19:07:45.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.001+0000 7f26777fe640 1 -- 172.21.15.53:0/4027633360 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2668007270 con 0x7f268006b5d0 2023-06-10T19:07:45.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.001+0000 7f26857b0640 1 -- 172.21.15.53:0/4027633360 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f268014f4e0 con 0x7f268006b5d0 2023-06-10T19:07:45.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.001+0000 7f26857b0640 1 -- 172.21.15.53:0/4027633360 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f268004d790 con 0x7f268006b5d0 2023-06-10T19:07:45.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.001+0000 7f26777fe640 1 -- 172.21.15.53:0/4027633360 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f26680073d0 con 0x7f268006b5d0 2023-06-10T19:07:45.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.001+0000 7f26777fe640 1 --2- 172.21.15.53:0/4027633360 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2660066280 0x7f2660068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:45.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.001+0000 7f26777fe640 1 -- 172.21.15.53:0/4027633360 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6105+0+0 (secure 0 0 0) 0x7f2668083280 con 0x7f268006b5d0 2023-06-10T19:07:45.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.001+0000 7f267e7fc640 1 --2- 172.21.15.53:0/4027633360 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2660066280 0x7f2660068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:45.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.001+0000 7f267e7fc640 1 --2- 172.21.15.53:0/4027633360 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2660066280 0x7f2660068730 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f26700af000 tx=0x7f2670004ac0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:45.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.005+0000 7f26777fe640 1 -- 172.21.15.53:0/4027633360 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2668054210 con 0x7f268006b5d0 2023-06-10T19:07:45.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.157+0000 7f26857b0640 1 -- 172.21.15.53:0/4027633360 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f26800b0270 con 0x7f268006b5d0 2023-06-10T19:07:45.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.157+0000 7f26777fe640 1 -- 172.21.15.53:0/4027633360 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v168) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2668053da0 con 0x7f268006b5d0 2023-06-10T19:07:45.162 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-06-10T19:07:45.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.161+0000 7f26857b0640 1 -- 172.21.15.53:0/4027633360 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2660066280 msgr2=0x7f2660068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:45.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.161+0000 7f26857b0640 1 --2- 172.21.15.53:0/4027633360 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2660066280 0x7f2660068730 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f26700af000 tx=0x7f2670004ac0 comp rx=0 tx=0).stop 2023-06-10T19:07:45.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.161+0000 7f26857b0640 1 -- 172.21.15.53:0/4027633360 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f268006b5d0 msgr2=0x7f268014fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:45.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.161+0000 7f26857b0640 1 --2- 172.21.15.53:0/4027633360 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f268006b5d0 0x7f268014fce0 secure :-1 s=READY pgs=2483 cs=0 l=1 rev1=1 crypto rx=0x7f266800c4d0 tx=0x7f266800c990 comp rx=0 tx=0).stop 2023-06-10T19:07:45.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.161+0000 7f26857b0640 1 -- 172.21.15.53:0/4027633360 shutdown_connections 2023-06-10T19:07:45.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.161+0000 7f26857b0640 1 --2- 172.21.15.53:0/4027633360 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2660066280 0x7f2660068730 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:45.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.161+0000 7f26857b0640 1 --2- 172.21.15.53:0/4027633360 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2680157cb0 0x7f26800c4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:45.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.161+0000 7f26857b0640 1 --2- 172.21.15.53:0/4027633360 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26801578e0 0x7f26800c4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:45.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.161+0000 7f26857b0640 1 --2- 172.21.15.53:0/4027633360 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f268006b5d0 0x7f268014fce0 unknown :-1 s=CLOSED pgs=2483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:45.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.161+0000 7f26857b0640 1 -- 172.21.15.53:0/4027633360 >> 172.21.15.53:0/4027633360 conn(0x7f268006a0e0 msgr2=0x7f2680161290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:45.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.161+0000 7f26857b0640 1 -- 172.21.15.53:0/4027633360 shutdown_connections 2023-06-10T19:07:45.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.161+0000 7f26857b0640 1 -- 172.21.15.53:0/4027633360 wait complete. 2023-06-10T19:07:45.181 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-10T19:07:45.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.305+0000 7f0ef1a93640 1 Processor -- start 2023-06-10T19:07:45.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.305+0000 7f0ef1a93640 1 -- start start 2023-06-10T19:07:45.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.305+0000 7f0ef1a93640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0eec1558e0 0x7f0eec0c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:45.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.305+0000 7f0ef1a93640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0eec158f40 0x7f0eec0cb820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:45.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.305+0000 7f0ef1a93640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0eec06c230 con 0x7f0eec0cbd60 2023-06-10T19:07:45.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.305+0000 7f0ef1a93640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0eec06ca40 con 0x7f0eec158f40 2023-06-10T19:07:45.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.305+0000 7f0ef1a93640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eec155cb0 con 0x7f0eec1558e0 2023-06-10T19:07:45.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.305+0000 7f0eebfff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f0eec0cbd60 0x7f0eec06b6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:35392/0 (socket says 172.21.15.53:35392) 2023-06-10T19:07:45.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.305+0000 7f0eebfff640 1 -- 172.21.15.53:0/2237908712 learned_addr learned my addr 172.21.15.53:0/2237908712 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:07:45.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.305+0000 7f0eeb7fe640 1 --2- 172.21.15.53:0/2237908712 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0eec1558e0 0x7f0eec0c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:45.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.305+0000 7f0eeaffd640 1 --2- 172.21.15.53:0/2237908712 >> v2:172.21.15.117:3300/0 conn(0x7f0eec158f40 0x7f0eec0cb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:45.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.305+0000 7f0eea7fc640 1 -- 172.21.15.53:0/2237908712 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1098271038 0 0) 0x7f0eec06c230 con 0x7f0eec0cbd60 2023-06-10T19:07:45.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.305+0000 7f0eea7fc640 1 -- 172.21.15.53:0/2237908712 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ed8003530 con 0x7f0eec0cbd60 2023-06-10T19:07:45.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.305+0000 7f0eea7fc640 1 -- 172.21.15.53:0/2237908712 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3411405892 0 0) 0x7f0ed8003530 con 0x7f0eec0cbd60 2023-06-10T19:07:45.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.305+0000 7f0eea7fc640 1 -- 172.21.15.53:0/2237908712 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0eec1558e0 msgr2=0x7f0eec0c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:45.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.305+0000 7f0eea7fc640 1 --2- 172.21.15.53:0/2237908712 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0eec1558e0 0x7f0eec0c82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:45.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.305+0000 7f0eea7fc640 1 -- 172.21.15.53:0/2237908712 >> v2:172.21.15.117:3300/0 conn(0x7f0eec158f40 msgr2=0x7f0eec0cb820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:45.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.305+0000 7f0eea7fc640 1 --2- 172.21.15.53:0/2237908712 >> v2:172.21.15.117:3300/0 conn(0x7f0eec158f40 0x7f0eec0cb820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:45.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.305+0000 7f0eea7fc640 1 -- 172.21.15.53:0/2237908712 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eec06c480 con 0x7f0eec0cbd60 2023-06-10T19:07:45.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.305+0000 7f0eea7fc640 1 -- 172.21.15.53:0/2237908712 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f0ee4001680 con 0x7f0eec0cbd60 2023-06-10T19:07:45.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.305+0000 7f0eea7fc640 1 -- 172.21.15.53:0/2237908712 >> v1:172.21.15.53:6789/0 conn(0x7f0eec0cbd60 legacy=0x7f0eec06b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:45.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.305+0000 7f0eea7fc640 1 --2- 172.21.15.53:0/2237908712 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ed8003980 0x7f0ed8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:45.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.305+0000 7f0eea7fc640 1 --2- 172.21.15.53:0/2237908712 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0eec1558e0 0x7f0ed80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:45.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.305+0000 7f0eea7fc640 1 --2- 172.21.15.53:0/2237908712 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ed8004d10 0x7f0ed8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:45.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.305+0000 7f0eea7fc640 1 -- 172.21.15.53:0/2237908712 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eec06ca40 con 0x7f0ed8003980 2023-06-10T19:07:45.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.305+0000 7f0eea7fc640 1 -- 172.21.15.53:0/2237908712 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eec155cb0 con 0x7f0ed8004d10 2023-06-10T19:07:45.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.305+0000 7f0eea7fc640 1 -- 172.21.15.53:0/2237908712 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed800ba10 con 0x7f0eec1558e0 2023-06-10T19:07:45.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.305+0000 7f0eeb7fe640 1 --2- 172.21.15.53:0/2237908712 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ed8003980 0x7f0ed8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:45.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.305+0000 7f0eebfff640 1 --2- 172.21.15.53:0/2237908712 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ed8004d10 0x7f0ed8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:45.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.305+0000 7f0eeaffd640 1 --2- 172.21.15.53:0/2237908712 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0eec1558e0 0x7f0ed80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:45.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.305+0000 7f0eeb7fe640 1 -- 172.21.15.53:0/2237908712 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0eec1558e0 msgr2=0x7f0ed80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:45.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.305+0000 7f0eeb7fe640 1 --2- 172.21.15.53:0/2237908712 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0eec1558e0 0x7f0ed80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:45.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.305+0000 7f0eeb7fe640 1 -- 172.21.15.53:0/2237908712 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ed8004d10 msgr2=0x7f0ed8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:45.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.305+0000 7f0eeb7fe640 1 --2- 172.21.15.53:0/2237908712 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ed8004d10 0x7f0ed8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:45.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.305+0000 7f0eeb7fe640 1 -- 172.21.15.53:0/2237908712 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed8003530 con 0x7f0ed8003980 2023-06-10T19:07:45.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.309+0000 7f0eeb7fe640 1 --2- 172.21.15.53:0/2237908712 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ed8003980 0x7f0ed8003d90 secure :-1 s=READY pgs=2485 cs=0 l=1 rev1=1 crypto rx=0x7f0edc009fc0 tx=0x7f0edc01cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91fc6fb6e0255130 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:45.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.309+0000 7f0eea7fc640 1 -- 172.21.15.53:0/2237908712 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0edc0a5ab0 con 0x7f0ed8003980 2023-06-10T19:07:45.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.309+0000 7f0eea7fc640 1 -- 172.21.15.53:0/2237908712 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0edc00f040 con 0x7f0ed8003980 2023-06-10T19:07:45.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.309+0000 7f0eea7fc640 1 -- 172.21.15.53:0/2237908712 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0edc0a5e50 con 0x7f0ed8003980 2023-06-10T19:07:45.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.309+0000 7f0ef1a93640 1 -- 172.21.15.53:0/2237908712 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ed8003980 msgr2=0x7f0ed8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:45.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.309+0000 7f0ef1a93640 1 --2- 172.21.15.53:0/2237908712 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ed8003980 0x7f0ed8003d90 secure :-1 s=READY pgs=2485 cs=0 l=1 rev1=1 crypto rx=0x7f0edc009fc0 tx=0x7f0edc01cc30 comp rx=0 tx=0).stop 2023-06-10T19:07:45.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.309+0000 7f0eebfff640 1 -- 172.21.15.53:0/2237908712 reap_dead start 2023-06-10T19:07:45.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.309+0000 7f0ef1a93640 1 -- 172.21.15.53:0/2237908712 shutdown_connections 2023-06-10T19:07:45.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.309+0000 7f0ef1a93640 1 -- 172.21.15.53:0/2237908712 >> 172.21.15.53:0/2237908712 conn(0x7f0eec06a0e0 msgr2=0x7f0eec0cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:45.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.309+0000 7f0ef1a93640 1 -- 172.21.15.53:0/2237908712 shutdown_connections 2023-06-10T19:07:45.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.309+0000 7f0ef1a93640 1 -- 172.21.15.53:0/2237908712 wait complete. 2023-06-10T19:07:45.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.309+0000 7f0ef1a93640 1 Processor -- start 2023-06-10T19:07:45.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.309+0000 7f0ef1a93640 1 -- start start 2023-06-10T19:07:45.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.309+0000 7f0ef1a93640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ed8003980 0x7f0eec14c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:45.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.309+0000 7f0ef1a93640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0eec070750 0x7f0eec151fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:45.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.309+0000 7f0ef1a93640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0eec070bc0 0x7f0eec1524f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:45.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.309+0000 7f0ef1a93640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eec0702c0 con 0x7f0eec070750 2023-06-10T19:07:45.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.309+0000 7f0ef1a93640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eec06f6b0 con 0x7f0ed8003980 2023-06-10T19:07:45.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.309+0000 7f0ef1a93640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eec06f990 con 0x7f0eec070bc0 2023-06-10T19:07:45.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.313+0000 7f0eeaffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0eec070750 0x7f0eec151fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:45.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.313+0000 7f0eeaffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0eec070750 0x7f0eec151fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45174/0 (socket says 172.21.15.53:45174) 2023-06-10T19:07:45.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.313+0000 7f0eeaffd640 1 -- 172.21.15.53:0/2280999751 learned_addr learned my addr 172.21.15.53:0/2280999751 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:45.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.313+0000 7f0eeb7fe640 1 --2- 172.21.15.53:0/2280999751 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ed8003980 0x7f0eec14c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:45.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.313+0000 7f0eebfff640 1 --2- 172.21.15.53:0/2280999751 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0eec070bc0 0x7f0eec1524f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:45.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.313+0000 7f0eeaffd640 1 -- 172.21.15.53:0/2280999751 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0eec070bc0 msgr2=0x7f0eec1524f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:45.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.313+0000 7f0eeaffd640 1 --2- 172.21.15.53:0/2280999751 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0eec070bc0 0x7f0eec1524f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:45.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.313+0000 7f0eeaffd640 1 -- 172.21.15.53:0/2280999751 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ed8003980 msgr2=0x7f0eec14c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:45.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.313+0000 7f0eeaffd640 1 --2- 172.21.15.53:0/2280999751 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ed8003980 0x7f0eec14c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:45.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.313+0000 7f0eeaffd640 1 -- 172.21.15.53:0/2280999751 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eec06fc70 con 0x7f0eec070750 2023-06-10T19:07:45.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.313+0000 7f0eebfff640 1 --2- 172.21.15.53:0/2280999751 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0eec070bc0 0x7f0eec1524f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:07:45.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.313+0000 7f0eeaffd640 1 --2- 172.21.15.53:0/2280999751 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0eec070750 0x7f0eec151fb0 secure :-1 s=READY pgs=2486 cs=0 l=1 rev1=1 crypto rx=0x7f0ed4011660 tx=0x7f0ed4011b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:45.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.313+0000 7f0ee3fff640 1 -- 172.21.15.53:0/2280999751 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed400f9c0 con 0x7f0eec070750 2023-06-10T19:07:45.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.313+0000 7f0ee3fff640 1 -- 172.21.15.53:0/2280999751 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ed400fb20 con 0x7f0eec070750 2023-06-10T19:07:45.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.313+0000 7f0ef1a93640 1 -- 172.21.15.53:0/2280999751 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0eec06ff50 con 0x7f0eec070750 2023-06-10T19:07:45.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.313+0000 7f0ee3fff640 1 -- 172.21.15.53:0/2280999751 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed400fe90 con 0x7f0eec070750 2023-06-10T19:07:45.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.313+0000 7f0ef1a93640 1 -- 172.21.15.53:0/2280999751 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0eec0c4ef0 con 0x7f0eec070750 2023-06-10T19:07:45.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.313+0000 7f0ef1a93640 1 -- 172.21.15.53:0/2280999751 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0eec04d790 con 0x7f0eec070750 2023-06-10T19:07:45.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.313+0000 7f0ee3fff640 1 -- 172.21.15.53:0/2280999751 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0ed4015460 con 0x7f0eec070750 2023-06-10T19:07:45.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.313+0000 7f0ee3fff640 1 --2- 172.21.15.53:0/2280999751 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0ecc0662b0 0x7f0ecc068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:45.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.313+0000 7f0ee3fff640 1 -- 172.21.15.53:0/2280999751 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6105+0+0 (secure 0 0 0) 0x7f0ed40846b0 con 0x7f0eec070750 2023-06-10T19:07:45.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.313+0000 7f0eeb7fe640 1 --2- 172.21.15.53:0/2280999751 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0ecc0662b0 0x7f0ecc068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:45.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.317+0000 7f0eeb7fe640 1 --2- 172.21.15.53:0/2280999751 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0ecc0662b0 0x7f0ecc068760 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f0edc0b0040 tx=0x7f0edc004ac0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:45.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.317+0000 7f0ee3fff640 1 -- 172.21.15.53:0/2280999751 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0ed4051ae0 con 0x7f0eec070750 2023-06-10T19:07:45.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.473+0000 7f0ef1a93640 1 -- 172.21.15.53:0/2280999751 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0eec0cd620 con 0x7f0eec070750 2023-06-10T19:07:45.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.473+0000 7f0ee3fff640 1 -- 172.21.15.53:0/2280999751 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v168) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0ed4055100 con 0x7f0eec070750 2023-06-10T19:07:45.476 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-06-10T19:07:45.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.473+0000 7f0ef1a93640 1 -- 172.21.15.53:0/2280999751 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0ecc0662b0 msgr2=0x7f0ecc068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:45.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.473+0000 7f0ef1a93640 1 --2- 172.21.15.53:0/2280999751 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0ecc0662b0 0x7f0ecc068760 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f0edc0b0040 tx=0x7f0edc004ac0 comp rx=0 tx=0).stop 2023-06-10T19:07:45.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.473+0000 7f0ef1a93640 1 -- 172.21.15.53:0/2280999751 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0eec070750 msgr2=0x7f0eec151fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:45.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.473+0000 7f0ef1a93640 1 --2- 172.21.15.53:0/2280999751 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0eec070750 0x7f0eec151fb0 secure :-1 s=READY pgs=2486 cs=0 l=1 rev1=1 crypto rx=0x7f0ed4011660 tx=0x7f0ed4011b20 comp rx=0 tx=0).stop 2023-06-10T19:07:45.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.473+0000 7f0ef1a93640 1 -- 172.21.15.53:0/2280999751 shutdown_connections 2023-06-10T19:07:45.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.473+0000 7f0ef1a93640 1 --2- 172.21.15.53:0/2280999751 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0ecc0662b0 0x7f0ecc068760 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:45.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.473+0000 7f0ef1a93640 1 --2- 172.21.15.53:0/2280999751 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0eec070bc0 0x7f0eec1524f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:45.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.473+0000 7f0ef1a93640 1 --2- 172.21.15.53:0/2280999751 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0eec070750 0x7f0eec151fb0 unknown :-1 s=CLOSED pgs=2486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:45.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.473+0000 7f0ef1a93640 1 --2- 172.21.15.53:0/2280999751 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ed8003980 0x7f0eec14c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:45.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.473+0000 7f0ef1a93640 1 -- 172.21.15.53:0/2280999751 >> 172.21.15.53:0/2280999751 conn(0x7f0eec06a0e0 msgr2=0x7f0eec14cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:45.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.477+0000 7f0ef1a93640 1 -- 172.21.15.53:0/2280999751 shutdown_connections 2023-06-10T19:07:45.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.477+0000 7f0ef1a93640 1 -- 172.21.15.53:0/2280999751 wait complete. 2023-06-10T19:07:45.498 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-10T19:07:45.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.617+0000 7f46d66e6640 1 Processor -- start 2023-06-10T19:07:45.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.617+0000 7f46d66e6640 1 -- start start 2023-06-10T19:07:45.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.617+0000 7f46d66e6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46d0152bb0 0x7f46d00c8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:45.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.617+0000 7f46d66e6640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f46d015c210 0x7f46d015c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:45.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.617+0000 7f46d66e6640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f46d0158c20 0x7f46d0159040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:45.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.617+0000 7f46d66e6640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46d00c8850 con 0x7f46d0158c20 2023-06-10T19:07:45.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.617+0000 7f46d66e6640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46d00cc8f0 con 0x7f46d015c210 2023-06-10T19:07:45.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.617+0000 7f46d66e6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46d015cb80 con 0x7f46d0152bb0 2023-06-10T19:07:45.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.617+0000 7f46d4c83640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f46d0158c20 0x7f46d0159040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:45.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.617+0000 7f46d4c83640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f46d0158c20 0x7f46d0159040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45184/0 (socket says 172.21.15.53:45184) 2023-06-10T19:07:45.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.617+0000 7f46d4c83640 1 -- 172.21.15.53:0/3223801010 learned_addr learned my addr 172.21.15.53:0/3223801010 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:45.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.617+0000 7f46cf7fe640 1 --2- 172.21.15.53:0/3223801010 >> v2:172.21.15.117:3300/0 conn(0x7f46d015c210 0x7f46d015c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:45.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.617+0000 7f46cffff640 1 --2- 172.21.15.53:0/3223801010 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46d0152bb0 0x7f46d00c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:45.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.617+0000 7f46d4c83640 1 -- 172.21.15.53:0/3223801010 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46d0152bb0 msgr2=0x7f46d00c8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:45.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.617+0000 7f46d4c83640 1 --2- 172.21.15.53:0/3223801010 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46d0152bb0 0x7f46d00c8310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:45.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.617+0000 7f46d4c83640 1 -- 172.21.15.53:0/3223801010 >> v2:172.21.15.117:3300/0 conn(0x7f46d015c210 msgr2=0x7f46d015c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:45.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.617+0000 7f46d4c83640 1 --2- 172.21.15.53:0/3223801010 >> v2:172.21.15.117:3300/0 conn(0x7f46d015c210 0x7f46d015c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:45.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.617+0000 7f46d4c83640 1 -- 172.21.15.53:0/3223801010 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46d00c8b90 con 0x7f46d0158c20 2023-06-10T19:07:45.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.617+0000 7f46cf7fe640 1 --2- 172.21.15.53:0/3223801010 >> v2:172.21.15.117:3300/0 conn(0x7f46d015c210 0x7f46d015c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:07:45.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.621+0000 7f46d4c83640 1 --2- 172.21.15.53:0/3223801010 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46d0158c20 0x7f46d0159040 secure :-1 s=READY pgs=2487 cs=0 l=1 rev1=1 crypto rx=0x7f46d006d1d0 tx=0x7f46c801ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0da1f003cee00d6 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:45.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.621+0000 7f46ceffd640 1 -- 172.21.15.53:0/3223801010 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46c80a89b0 con 0x7f46d0158c20 2023-06-10T19:07:45.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.621+0000 7f46ceffd640 1 -- 172.21.15.53:0/3223801010 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46c80a8b10 con 0x7f46d0158c20 2023-06-10T19:07:45.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.621+0000 7f46ceffd640 1 -- 172.21.15.53:0/3223801010 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46c80a8ea0 con 0x7f46d0158c20 2023-06-10T19:07:45.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.621+0000 7f46d66e6640 1 -- 172.21.15.53:0/3223801010 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46d0158c20 msgr2=0x7f46d0159040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:45.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.621+0000 7f46d66e6640 1 --2- 172.21.15.53:0/3223801010 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46d0158c20 0x7f46d0159040 secure :-1 s=READY pgs=2487 cs=0 l=1 rev1=1 crypto rx=0x7f46d006d1d0 tx=0x7f46c801ecf0 comp rx=0 tx=0).stop 2023-06-10T19:07:45.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.621+0000 7f46d66e6640 1 -- 172.21.15.53:0/3223801010 shutdown_connections 2023-06-10T19:07:45.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.621+0000 7f46d66e6640 1 --2- 172.21.15.53:0/3223801010 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46d0158c20 0x7f46d0159040 unknown :-1 s=CLOSED pgs=2487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:45.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.621+0000 7f46d66e6640 1 --2- 172.21.15.53:0/3223801010 >> v2:172.21.15.117:3300/0 conn(0x7f46d015c210 0x7f46d015c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:45.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.621+0000 7f46d66e6640 1 --2- 172.21.15.53:0/3223801010 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46d0152bb0 0x7f46d00c8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:45.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.621+0000 7f46d66e6640 1 -- 172.21.15.53:0/3223801010 >> 172.21.15.53:0/3223801010 conn(0x7f46d00ce9e0 msgr2=0x7f46d00ca7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:45.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.621+0000 7f46d66e6640 1 -- 172.21.15.53:0/3223801010 shutdown_connections 2023-06-10T19:07:45.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.621+0000 7f46d66e6640 1 -- 172.21.15.53:0/3223801010 wait complete. 2023-06-10T19:07:45.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.621+0000 7f46d66e6640 1 Processor -- start 2023-06-10T19:07:45.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.625+0000 7f46d66e6640 1 -- start start 2023-06-10T19:07:45.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.625+0000 7f46d66e6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46d0152bb0 0x7f46d0151280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:45.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.625+0000 7f46d66e6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46d0158c20 0x7f46d00ad790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:45.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.625+0000 7f46d66e6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46d015c210 0x7f46d00adcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:45.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.625+0000 7f46d66e6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46d00c2580 con 0x7f46d0152bb0 2023-06-10T19:07:45.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.625+0000 7f46d66e6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46d00c1970 con 0x7f46d0158c20 2023-06-10T19:07:45.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.625+0000 7f46d66e6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46d00c1c50 con 0x7f46d015c210 2023-06-10T19:07:45.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.625+0000 7f46cffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46d0152bb0 0x7f46d0151280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:45.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.625+0000 7f46cffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46d0152bb0 0x7f46d0151280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45186/0 (socket says 172.21.15.53:45186) 2023-06-10T19:07:45.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.625+0000 7f46cffff640 1 -- 172.21.15.53:0/3263410015 learned_addr learned my addr 172.21.15.53:0/3263410015 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:45.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.625+0000 7f46cf7fe640 1 --2- 172.21.15.53:0/3263410015 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46d0158c20 0x7f46d00ad790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:45.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.625+0000 7f46d4c83640 1 --2- 172.21.15.53:0/3263410015 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46d015c210 0x7f46d00adcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:45.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.625+0000 7f46cffff640 1 -- 172.21.15.53:0/3263410015 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46d015c210 msgr2=0x7f46d00adcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:45.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.625+0000 7f46cffff640 1 --2- 172.21.15.53:0/3263410015 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46d015c210 0x7f46d00adcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:45.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.625+0000 7f46cffff640 1 -- 172.21.15.53:0/3263410015 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46d0158c20 msgr2=0x7f46d00ad790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:45.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.625+0000 7f46cffff640 1 --2- 172.21.15.53:0/3263410015 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46d0158c20 0x7f46d00ad790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:45.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.625+0000 7f46cffff640 1 -- 172.21.15.53:0/3263410015 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46c80094d0 con 0x7f46d0152bb0 2023-06-10T19:07:45.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.625+0000 7f46cffff640 1 --2- 172.21.15.53:0/3263410015 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46d0152bb0 0x7f46d0151280 secure :-1 s=READY pgs=2488 cs=0 l=1 rev1=1 crypto rx=0x7f46b800c7f0 tx=0x7f46b800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:45.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.625+0000 7f46ccff9640 1 -- 172.21.15.53:0/3263410015 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b8004220 con 0x7f46d0152bb0 2023-06-10T19:07:45.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.625+0000 7f46ccff9640 1 -- 172.21.15.53:0/3263410015 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46b8004380 con 0x7f46d0152bb0 2023-06-10T19:07:45.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.625+0000 7f46ccff9640 1 -- 172.21.15.53:0/3263410015 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b8003860 con 0x7f46d0152bb0 2023-06-10T19:07:45.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.625+0000 7f46d66e6640 1 -- 172.21.15.53:0/3263410015 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46d00c1f30 con 0x7f46d0152bb0 2023-06-10T19:07:45.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.625+0000 7f46d66e6640 1 -- 172.21.15.53:0/3263410015 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46d01517c0 con 0x7f46d0152bb0 2023-06-10T19:07:45.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.625+0000 7f46d66e6640 1 -- 172.21.15.53:0/3263410015 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46d004d790 con 0x7f46d0152bb0 2023-06-10T19:07:45.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.625+0000 7f46ccff9640 1 -- 172.21.15.53:0/3263410015 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f46b8003bd0 con 0x7f46d0152bb0 2023-06-10T19:07:45.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.625+0000 7f46ccff9640 1 --2- 172.21.15.53:0/3263410015 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f46b0066280 0x7f46b0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:45.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.625+0000 7f46ccff9640 1 -- 172.21.15.53:0/3263410015 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6105+0+0 (secure 0 0 0) 0x7f46b8083da0 con 0x7f46d0152bb0 2023-06-10T19:07:45.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.629+0000 7f46cf7fe640 1 --2- 172.21.15.53:0/3263410015 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f46b0066280 0x7f46b0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:45.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.629+0000 7f46cf7fe640 1 --2- 172.21.15.53:0/3263410015 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f46b0066280 0x7f46b0068730 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f46d00c7850 tx=0x7f46c0008430 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:45.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.633+0000 7f46ccff9640 1 -- 172.21.15.53:0/3263410015 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f46b8051160 con 0x7f46d0152bb0 2023-06-10T19:07:45.800 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.797+0000 7f46d66e6640 1 -- 172.21.15.53:0/3263410015 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f46d015b000 con 0x7f46d0152bb0 2023-06-10T19:07:45.800 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.797+0000 7f46ccff9640 1 -- 172.21.15.53:0/3263410015 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 1 entries v168) v1 ==== 80+0+57 (secure 0 0 0) 0x7f46b801e070 con 0x7f46d0152bb0 2023-06-10T19:07:45.801 INFO:teuthology.orchestra.run.smithi053.stdout:192.168.0.1:0/4011987522 2023-06-10T20:07:37.768015+0000 2023-06-10T19:07:45.801 INFO:teuthology.orchestra.run.smithi053.stderr:listed 1 entries 2023-06-10T19:07:45.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.801+0000 7f46d66e6640 1 -- 172.21.15.53:0/3263410015 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f46b0066280 msgr2=0x7f46b0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:45.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.801+0000 7f46d66e6640 1 --2- 172.21.15.53:0/3263410015 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f46b0066280 0x7f46b0068730 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f46d00c7850 tx=0x7f46c0008430 comp rx=0 tx=0).stop 2023-06-10T19:07:45.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.801+0000 7f46d66e6640 1 -- 172.21.15.53:0/3263410015 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46d0152bb0 msgr2=0x7f46d0151280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:45.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.801+0000 7f46d66e6640 1 --2- 172.21.15.53:0/3263410015 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46d0152bb0 0x7f46d0151280 secure :-1 s=READY pgs=2488 cs=0 l=1 rev1=1 crypto rx=0x7f46b800c7f0 tx=0x7f46b800ccb0 comp rx=0 tx=0).stop 2023-06-10T19:07:45.804 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.801+0000 7f46d66e6640 1 -- 172.21.15.53:0/3263410015 shutdown_connections 2023-06-10T19:07:45.804 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.801+0000 7f46d66e6640 1 --2- 172.21.15.53:0/3263410015 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f46b0066280 0x7f46b0068730 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:45.804 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.801+0000 7f46d66e6640 1 --2- 172.21.15.53:0/3263410015 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46d015c210 0x7f46d00adcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:45.804 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.801+0000 7f46d66e6640 1 --2- 172.21.15.53:0/3263410015 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46d0158c20 0x7f46d00ad790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:45.805 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.801+0000 7f46d66e6640 1 --2- 172.21.15.53:0/3263410015 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46d0152bb0 0x7f46d0151280 unknown :-1 s=CLOSED pgs=2488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:45.805 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.801+0000 7f46d66e6640 1 -- 172.21.15.53:0/3263410015 >> 172.21.15.53:0/3263410015 conn(0x7f46d00ce9e0 msgr2=0x7f46d00aebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:45.805 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.801+0000 7f46d66e6640 1 -- 172.21.15.53:0/3263410015 shutdown_connections 2023-06-10T19:07:45.805 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:45.801+0000 7f46d66e6640 1 -- 172.21.15.53:0/3263410015 wait complete. 2023-06-10T19:07:45.819 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi053.front.sepia.ceph.com... 2023-06-10T19:07:45.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:07:45.821 DEBUG:teuthology.orchestra.run.smithi053:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-06-10T19:07:45.832 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[69019]: fuse finished with error 0 and tester_r 0 2023-06-10T19:07:45.834 INFO:teuthology.orchestra.run:waiting for 300 2023-06-10T19:07:45.894 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi053.front.sepia.ceph.com 2023-06-10T19:07:45.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:07:45.895 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-06-10T19:07:45.899 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-06-10T19:07:45.900 DEBUG:teuthology.orchestra.run.smithi053:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-06-10T19:07:45.971 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-06-10T19:07:46.029 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-06-10T19:07:46.029 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T19:07:46.030 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:07:46.036 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:07:46.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.201+0000 7f7803ccf640 1 Processor -- start 2023-06-10T19:07:46.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.201+0000 7f7803ccf640 1 -- start start 2023-06-10T19:07:46.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.201+0000 7f7803ccf640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f77fc0b0f30 0x7f77fc070950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:46.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.201+0000 7f7803ccf640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77fc159a60 0x7f77fc0c2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:46.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.201+0000 7f7803ccf640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77fc0cb080 con 0x7f77fc159690 2023-06-10T19:07:46.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.201+0000 7f7803ccf640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77fc070e90 con 0x7f77fc0b0f30 2023-06-10T19:07:46.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.201+0000 7f7803ccf640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77fc06d450 con 0x7f77fc159a60 2023-06-10T19:07:46.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.201+0000 7f7801a6b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f77fc159690 0x7f77fc0cbe00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:35404/0 (socket says 172.21.15.53:35404) 2023-06-10T19:07:46.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.201+0000 7f7801a6b640 1 -- 172.21.15.53:0/4281419600 learned_addr learned my addr 172.21.15.53:0/4281419600 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:07:46.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.201+0000 7f7800a69640 1 -- 172.21.15.53:0/4281419600 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 436808649 0 0) 0x7f77fc0cb080 con 0x7f77fc159690 2023-06-10T19:07:46.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.201+0000 7f7800a69640 1 -- 172.21.15.53:0/4281419600 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77e8003530 con 0x7f77fc159690 2023-06-10T19:07:46.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.201+0000 7f780126a640 1 --2- 172.21.15.53:0/4281419600 >> v2:172.21.15.117:3300/0 conn(0x7f77fc0b0f30 0x7f77fc070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:46.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.201+0000 7f780226c640 1 --2- 172.21.15.53:0/4281419600 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77fc159a60 0x7f77fc0c2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:46.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.201+0000 7f7800a69640 1 -- 172.21.15.53:0/4281419600 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1445574273 0 0) 0x7f77e8003530 con 0x7f77fc159690 2023-06-10T19:07:46.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.201+0000 7f7800a69640 1 -- 172.21.15.53:0/4281419600 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77fc159a60 msgr2=0x7f77fc0c2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:46.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.201+0000 7f7800a69640 1 --2- 172.21.15.53:0/4281419600 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77fc159a60 0x7f77fc0c2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:46.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.201+0000 7f7800a69640 1 -- 172.21.15.53:0/4281419600 >> v2:172.21.15.117:3300/0 conn(0x7f77fc0b0f30 msgr2=0x7f77fc070950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:46.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.201+0000 7f7800a69640 1 --2- 172.21.15.53:0/4281419600 >> v2:172.21.15.117:3300/0 conn(0x7f77fc0b0f30 0x7f77fc070950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:46.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.201+0000 7f7800a69640 1 -- 172.21.15.53:0/4281419600 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77fc0cb320 con 0x7f77fc159690 2023-06-10T19:07:46.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.201+0000 7f7800a69640 1 -- 172.21.15.53:0/4281419600 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f77ec001680 con 0x7f77fc159690 2023-06-10T19:07:46.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.201+0000 7f7800a69640 1 -- 172.21.15.53:0/4281419600 >> v1:172.21.15.53:6789/0 conn(0x7f77fc159690 legacy=0x7f77fc0cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:46.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.201+0000 7f7800a69640 1 --2- 172.21.15.53:0/4281419600 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f77e80039f0 0x7f77e8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:46.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.201+0000 7f7800a69640 1 --2- 172.21.15.53:0/4281419600 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77fc159a60 0x7f77e80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:46.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.201+0000 7f7800a69640 1 --2- 172.21.15.53:0/4281419600 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77e8004d10 0x7f77e8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:46.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.201+0000 7f7800a69640 1 -- 172.21.15.53:0/4281419600 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77fc070e90 con 0x7f77e80039f0 2023-06-10T19:07:46.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.201+0000 7f7800a69640 1 -- 172.21.15.53:0/4281419600 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77fc06d450 con 0x7f77e8004d10 2023-06-10T19:07:46.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.201+0000 7f7800a69640 1 -- 172.21.15.53:0/4281419600 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77e800b9e0 con 0x7f77fc159a60 2023-06-10T19:07:46.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.201+0000 7f7801a6b640 1 --2- 172.21.15.53:0/4281419600 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f77e80039f0 0x7f77e8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:46.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.201+0000 7f780126a640 1 --2- 172.21.15.53:0/4281419600 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77fc159a60 0x7f77e80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:46.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.201+0000 7f780226c640 1 --2- 172.21.15.53:0/4281419600 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77e8004d10 0x7f77e8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:46.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.201+0000 7f7801a6b640 1 -- 172.21.15.53:0/4281419600 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77fc159a60 msgr2=0x7f77e80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:46.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.201+0000 7f7801a6b640 1 --2- 172.21.15.53:0/4281419600 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77fc159a60 0x7f77e80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:46.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.201+0000 7f7801a6b640 1 -- 172.21.15.53:0/4281419600 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77e8004d10 msgr2=0x7f77e8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:46.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.201+0000 7f7801a6b640 1 --2- 172.21.15.53:0/4281419600 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77e8004d10 0x7f77e8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:46.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.201+0000 7f7801a6b640 1 -- 172.21.15.53:0/4281419600 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77e8003530 con 0x7f77e80039f0 2023-06-10T19:07:46.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.201+0000 7f780226c640 1 --2- 172.21.15.53:0/4281419600 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77e8004d10 0x7f77e8005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:07:46.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.205+0000 7f7801a6b640 1 --2- 172.21.15.53:0/4281419600 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f77e80039f0 0x7f77e8003e00 secure :-1 s=READY pgs=2490 cs=0 l=1 rev1=1 crypto rx=0x7f77ec00c210 tx=0x7f77ec01cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36a55af8e95a7254 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:46.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.205+0000 7f7800a69640 1 -- 172.21.15.53:0/4281419600 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77ec0058e0 con 0x7f77e80039f0 2023-06-10T19:07:46.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.205+0000 7f7800a69640 1 -- 172.21.15.53:0/4281419600 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77ec005a40 con 0x7f77e80039f0 2023-06-10T19:07:46.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.205+0000 7f7800a69640 1 -- 172.21.15.53:0/4281419600 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77ec005e30 con 0x7f77e80039f0 2023-06-10T19:07:46.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.205+0000 7f7803ccf640 1 -- 172.21.15.53:0/4281419600 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f77e80039f0 msgr2=0x7f77e8003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:46.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.205+0000 7f7803ccf640 1 --2- 172.21.15.53:0/4281419600 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f77e80039f0 0x7f77e8003e00 secure :-1 s=READY pgs=2490 cs=0 l=1 rev1=1 crypto rx=0x7f77ec00c210 tx=0x7f77ec01cc10 comp rx=0 tx=0).stop 2023-06-10T19:07:46.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.205+0000 7f780226c640 1 -- 172.21.15.53:0/4281419600 reap_dead start 2023-06-10T19:07:46.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.205+0000 7f7803ccf640 1 -- 172.21.15.53:0/4281419600 shutdown_connections 2023-06-10T19:07:46.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.205+0000 7f7803ccf640 1 -- 172.21.15.53:0/4281419600 >> 172.21.15.53:0/4281419600 conn(0x7f77fc06a560 msgr2=0x7f77fc06a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:46.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.205+0000 7f7803ccf640 1 -- 172.21.15.53:0/4281419600 shutdown_connections 2023-06-10T19:07:46.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.205+0000 7f7803ccf640 1 -- 172.21.15.53:0/4281419600 wait complete. 2023-06-10T19:07:46.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.205+0000 7f7803ccf640 1 Processor -- start 2023-06-10T19:07:46.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.205+0000 7f7803ccf640 1 -- start start 2023-06-10T19:07:46.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.209+0000 7f7803ccf640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77e80039f0 0x7f77fc0c47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:46.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.209+0000 7f7803ccf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f77fc1511d0 0x7f77fc0cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:46.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.209+0000 7f7803ccf640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77fc157510 0x7f77fc1617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:46.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.209+0000 7f7803ccf640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77fc0ce0e0 con 0x7f77fc1511d0 2023-06-10T19:07:46.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.209+0000 7f7803ccf640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77fc0ce910 con 0x7f77e80039f0 2023-06-10T19:07:46.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.209+0000 7f7803ccf640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77fc156de0 con 0x7f77fc157510 2023-06-10T19:07:46.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.209+0000 7f780126a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f77fc1511d0 0x7f77fc0cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:46.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.209+0000 7f780126a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f77fc1511d0 0x7f77fc0cdba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45192/0 (socket says 172.21.15.53:45192) 2023-06-10T19:07:46.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.209+0000 7f780126a640 1 -- 172.21.15.53:0/1361236131 learned_addr learned my addr 172.21.15.53:0/1361236131 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:46.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.209+0000 7f7801a6b640 1 --2- 172.21.15.53:0/1361236131 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77e80039f0 0x7f77fc0c47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:46.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.209+0000 7f780126a640 1 -- 172.21.15.53:0/1361236131 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77fc157510 msgr2=0x7f77fc1617c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:46.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.209+0000 7f780126a640 1 --2- 172.21.15.53:0/1361236131 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77fc157510 0x7f77fc1617c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:46.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.209+0000 7f780126a640 1 -- 172.21.15.53:0/1361236131 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77e80039f0 msgr2=0x7f77fc0c47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:46.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.209+0000 7f780126a640 1 --2- 172.21.15.53:0/1361236131 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77e80039f0 0x7f77fc0c47b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:46.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.209+0000 7f780126a640 1 -- 172.21.15.53:0/1361236131 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77fc0c4e90 con 0x7f77fc1511d0 2023-06-10T19:07:46.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.209+0000 7f780126a640 1 --2- 172.21.15.53:0/1361236131 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f77fc1511d0 0x7f77fc0cdba0 secure :-1 s=READY pgs=2491 cs=0 l=1 rev1=1 crypto rx=0x7f77f8011690 tx=0x7f77f8011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:46.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.209+0000 7f77f27fc640 1 -- 172.21.15.53:0/1361236131 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f800f960 con 0x7f77fc1511d0 2023-06-10T19:07:46.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.209+0000 7f77f27fc640 1 -- 172.21.15.53:0/1361236131 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77f800fac0 con 0x7f77fc1511d0 2023-06-10T19:07:46.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.209+0000 7f77f27fc640 1 -- 172.21.15.53:0/1361236131 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f800fe30 con 0x7f77fc1511d0 2023-06-10T19:07:46.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.209+0000 7f7803ccf640 1 -- 172.21.15.53:0/1361236131 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77fc0c5170 con 0x7f77fc1511d0 2023-06-10T19:07:46.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.209+0000 7f7803ccf640 1 -- 172.21.15.53:0/1361236131 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77fc156ff0 con 0x7f77fc1511d0 2023-06-10T19:07:46.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.209+0000 7f7803ccf640 1 -- 172.21.15.53:0/1361236131 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77fc04d790 con 0x7f77fc1511d0 2023-06-10T19:07:46.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.209+0000 7f77f27fc640 1 -- 172.21.15.53:0/1361236131 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f77f8015460 con 0x7f77fc1511d0 2023-06-10T19:07:46.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.209+0000 7f77f27fc640 1 --2- 172.21.15.53:0/1361236131 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f77e00662b0 0x7f77e0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:46.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.209+0000 7f77f27fc640 1 -- 172.21.15.53:0/1361236131 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6105+0+0 (secure 0 0 0) 0x7f77f8084100 con 0x7f77fc1511d0 2023-06-10T19:07:46.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.209+0000 7f7801a6b640 1 --2- 172.21.15.53:0/1361236131 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f77e00662b0 0x7f77e0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:46.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.213+0000 7f7801a6b640 1 --2- 172.21.15.53:0/1361236131 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f77e00662b0 0x7f77e0068760 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f77ec0aa000 tx=0x7f77ec001a80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:46.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.213+0000 7f77f27fc640 1 -- 172.21.15.53:0/1361236131 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f77f8051550 con 0x7f77fc1511d0 2023-06-10T19:07:46.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.369+0000 7f7803ccf640 1 -- 172.21.15.53:0/1361236131 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f77fc1552c0 con 0x7f77fc1511d0 2023-06-10T19:07:46.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.369+0000 7f77f27fc640 1 -- 172.21.15.53:0/1361236131 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v168) v1 ==== 74+0+18341 (secure 0 0 0) 0x7f77f8054b70 con 0x7f77fc1511d0 2023-06-10T19:07:46.373 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:07:46.373 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":168,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:07:38.149577+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-06-10T19:07:13.365954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"166","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-06-10T19:07:14.695077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.0.1:0/4011987522":"2023-06-10T20:07:37.768015+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:07:46.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.373+0000 7f7803ccf640 1 -- 172.21.15.53:0/1361236131 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f77e00662b0 msgr2=0x7f77e0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:46.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.373+0000 7f7803ccf640 1 --2- 172.21.15.53:0/1361236131 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f77e00662b0 0x7f77e0068760 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f77ec0aa000 tx=0x7f77ec001a80 comp rx=0 tx=0).stop 2023-06-10T19:07:46.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.373+0000 7f7803ccf640 1 -- 172.21.15.53:0/1361236131 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f77fc1511d0 msgr2=0x7f77fc0cdba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:46.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.373+0000 7f7803ccf640 1 --2- 172.21.15.53:0/1361236131 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f77fc1511d0 0x7f77fc0cdba0 secure :-1 s=READY pgs=2491 cs=0 l=1 rev1=1 crypto rx=0x7f77f8011690 tx=0x7f77f8011b50 comp rx=0 tx=0).stop 2023-06-10T19:07:46.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.373+0000 7f7803ccf640 1 -- 172.21.15.53:0/1361236131 shutdown_connections 2023-06-10T19:07:46.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.373+0000 7f7803ccf640 1 --2- 172.21.15.53:0/1361236131 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f77e00662b0 0x7f77e0068760 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:46.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.373+0000 7f7803ccf640 1 --2- 172.21.15.53:0/1361236131 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77fc157510 0x7f77fc1617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:46.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.373+0000 7f7803ccf640 1 --2- 172.21.15.53:0/1361236131 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f77fc1511d0 0x7f77fc0cdba0 unknown :-1 s=CLOSED pgs=2491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:46.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.373+0000 7f7803ccf640 1 --2- 172.21.15.53:0/1361236131 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77e80039f0 0x7f77fc0c47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:46.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.373+0000 7f7803ccf640 1 -- 172.21.15.53:0/1361236131 >> 172.21.15.53:0/1361236131 conn(0x7f77fc06a560 msgr2=0x7f77fc06c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:46.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.373+0000 7f7803ccf640 1 -- 172.21.15.53:0/1361236131 shutdown_connections 2023-06-10T19:07:46.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.373+0000 7f7803ccf640 1 -- 172.21.15.53:0/1361236131 wait complete. 2023-06-10T19:07:46.393 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-10T18:52:33.633114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-10T18:52:39.171487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 23, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-10T19:07:13.365954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '166', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 24, 'pool_name': 'cephfs_data', 'create_time': '2023-06-10T19:07:14.695077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '167', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-10T19:07:46.394 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-10T19:07:46.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.513+0000 7fb95a552640 1 Processor -- start 2023-06-10T19:07:46.515 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.513+0000 7fb95a552640 1 -- start start 2023-06-10T19:07:46.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.513+0000 7fb95a552640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb954159690 0x7fb954070950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:46.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.513+0000 7fb95a552640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb9540b0f30 0x7fb9540cbe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:46.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.513+0000 7fb95a552640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9540cb080 con 0x7fb954159a60 2023-06-10T19:07:46.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.513+0000 7fb95a552640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb954070e90 con 0x7fb954159690 2023-06-10T19:07:46.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.513+0000 7fb95a552640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb95406d450 con 0x7fb9540b0f30 2023-06-10T19:07:46.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.513+0000 7fb953fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb954159690 0x7fb954070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:46.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.513+0000 7fb953fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb954159690 0x7fb954070950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45204/0 (socket says 172.21.15.53:45204) 2023-06-10T19:07:46.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.513+0000 7fb953fff640 1 -- 172.21.15.53:0/2784320572 learned_addr learned my addr 172.21.15.53:0/2784320572 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:46.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.513+0000 7fb953fff640 1 -- 172.21.15.53:0/2784320572 >> v2:172.21.15.117:3300/0 conn(0x7fb9540b0f30 msgr2=0x7fb9540cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:46.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.513+0000 7fb9537fe640 1 --2- 172.21.15.53:0/2784320572 >> v2:172.21.15.117:3300/0 conn(0x7fb9540b0f30 0x7fb9540cbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:46.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.513+0000 7fb952ffd640 1 -- 172.21.15.53:0/2784320572 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3280855641 0 0) 0x7fb9540cb080 con 0x7fb954159a60 2023-06-10T19:07:46.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.513+0000 7fb953fff640 1 --2- 172.21.15.53:0/2784320572 >> v2:172.21.15.117:3300/0 conn(0x7fb9540b0f30 0x7fb9540cbe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:46.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.513+0000 7fb953fff640 1 -- 172.21.15.53:0/2784320572 >> v1:172.21.15.53:6789/0 conn(0x7fb954159a60 legacy=0x7fb9540c2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:46.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.513+0000 7fb953fff640 1 -- 172.21.15.53:0/2784320572 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9540cb320 con 0x7fb954159690 2023-06-10T19:07:46.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.513+0000 7fb9537fe640 1 --2- 172.21.15.53:0/2784320572 >> v2:172.21.15.117:3300/0 conn(0x7fb9540b0f30 0x7fb9540cbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:07:46.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.517+0000 7fb953fff640 1 --2- 172.21.15.53:0/2784320572 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb954159690 0x7fb954070950 secure :-1 s=READY pgs=2493 cs=0 l=1 rev1=1 crypto rx=0x7fb9540cec80 tx=0x7fb94401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8c6d8610a4505 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:46.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.517+0000 7fb952ffd640 1 -- 172.21.15.53:0/2784320572 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9440ac640 con 0x7fb954159690 2023-06-10T19:07:46.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.517+0000 7fb952ffd640 1 -- 172.21.15.53:0/2784320572 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9440ac7a0 con 0x7fb954159690 2023-06-10T19:07:46.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.517+0000 7fb952ffd640 1 -- 172.21.15.53:0/2784320572 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9440acb30 con 0x7fb954159690 2023-06-10T19:07:46.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.517+0000 7fb95a552640 1 -- 172.21.15.53:0/2784320572 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb954159690 msgr2=0x7fb954070950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:46.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.517+0000 7fb95a552640 1 --2- 172.21.15.53:0/2784320572 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb954159690 0x7fb954070950 secure :-1 s=READY pgs=2493 cs=0 l=1 rev1=1 crypto rx=0x7fb9540cec80 tx=0x7fb94401c4d0 comp rx=0 tx=0).stop 2023-06-10T19:07:46.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.517+0000 7fb95a552640 1 -- 172.21.15.53:0/2784320572 shutdown_connections 2023-06-10T19:07:46.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.517+0000 7fb95a552640 1 --2- 172.21.15.53:0/2784320572 >> v2:172.21.15.117:3300/0 conn(0x7fb9540b0f30 0x7fb9540cbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:46.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.517+0000 7fb95a552640 1 --2- 172.21.15.53:0/2784320572 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb954159690 0x7fb954070950 unknown :-1 s=CLOSED pgs=2493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:46.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.517+0000 7fb95a552640 1 -- 172.21.15.53:0/2784320572 >> 172.21.15.53:0/2784320572 conn(0x7fb95406a560 msgr2=0x7fb95406a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:46.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.517+0000 7fb95a552640 1 -- 172.21.15.53:0/2784320572 shutdown_connections 2023-06-10T19:07:46.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.517+0000 7fb95a552640 1 -- 172.21.15.53:0/2784320572 wait complete. 2023-06-10T19:07:46.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.517+0000 7fb95a552640 1 Processor -- start 2023-06-10T19:07:46.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.517+0000 7fb95a552640 1 -- start start 2023-06-10T19:07:46.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.517+0000 7fb95a552640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9540b0f30 0x7fb9540b25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:46.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.517+0000 7fb95a552640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb954159690 0x7fb954155cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:46.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.517+0000 7fb95a552640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb954159a60 0x7fb95414d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:46.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.517+0000 7fb95a552640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb95414f0d0 con 0x7fb954159a60 2023-06-10T19:07:46.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.517+0000 7fb95a552640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9540b2b30 con 0x7fb954159690 2023-06-10T19:07:46.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.517+0000 7fb95a552640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb95414e030 con 0x7fb9540b0f30 2023-06-10T19:07:46.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.521+0000 7fb958aef640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb954159a60 0x7fb95414d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:46.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.521+0000 7fb958aef640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb954159a60 0x7fb95414d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45214/0 (socket says 172.21.15.53:45214) 2023-06-10T19:07:46.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.521+0000 7fb958aef640 1 -- 172.21.15.53:0/3363473459 learned_addr learned my addr 172.21.15.53:0/3363473459 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:46.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.521+0000 7fb9537fe640 1 --2- 172.21.15.53:0/3363473459 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb954159690 0x7fb954155cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:46.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.521+0000 7fb953fff640 1 --2- 172.21.15.53:0/3363473459 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9540b0f30 0x7fb9540b25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:46.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.521+0000 7fb958aef640 1 -- 172.21.15.53:0/3363473459 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9540b0f30 msgr2=0x7fb9540b25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:46.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.521+0000 7fb958aef640 1 --2- 172.21.15.53:0/3363473459 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9540b0f30 0x7fb9540b25f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:46.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.521+0000 7fb958aef640 1 -- 172.21.15.53:0/3363473459 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb954159690 msgr2=0x7fb954155cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:46.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.521+0000 7fb958aef640 1 --2- 172.21.15.53:0/3363473459 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb954159690 0x7fb954155cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:46.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.521+0000 7fb958aef640 1 -- 172.21.15.53:0/3363473459 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9440094d0 con 0x7fb954159a60 2023-06-10T19:07:46.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.521+0000 7fb9537fe640 1 --2- 172.21.15.53:0/3363473459 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb954159690 0x7fb954155cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:07:46.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.521+0000 7fb958aef640 1 --2- 172.21.15.53:0/3363473459 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb954159a60 0x7fb95414d150 secure :-1 s=READY pgs=2494 cs=0 l=1 rev1=1 crypto rx=0x7fb94c002240 tx=0x7fb94c00cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:46.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.521+0000 7fb950ff9640 1 -- 172.21.15.53:0/3363473459 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94c003db0 con 0x7fb954159a60 2023-06-10T19:07:46.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.521+0000 7fb950ff9640 1 -- 172.21.15.53:0/3363473459 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb94c00ce30 con 0x7fb954159a60 2023-06-10T19:07:46.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.521+0000 7fb95a552640 1 -- 172.21.15.53:0/3363473459 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb95414e310 con 0x7fb954159a60 2023-06-10T19:07:46.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.521+0000 7fb950ff9640 1 -- 172.21.15.53:0/3363473459 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94c005270 con 0x7fb954159a60 2023-06-10T19:07:46.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.521+0000 7fb95a552640 1 -- 172.21.15.53:0/3363473459 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb95414e8d0 con 0x7fb954159a60 2023-06-10T19:07:46.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.521+0000 7fb95a552640 1 -- 172.21.15.53:0/3363473459 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb95404d790 con 0x7fb954159a60 2023-06-10T19:07:46.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.521+0000 7fb950ff9640 1 -- 172.21.15.53:0/3363473459 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb94c0053d0 con 0x7fb954159a60 2023-06-10T19:07:46.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.521+0000 7fb950ff9640 1 --2- 172.21.15.53:0/3363473459 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb940066280 0x7fb940068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:46.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.521+0000 7fb950ff9640 1 -- 172.21.15.53:0/3363473459 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6105+0+0 (secure 0 0 0) 0x7fb94c083560 con 0x7fb954159a60 2023-06-10T19:07:46.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.521+0000 7fb953fff640 1 --2- 172.21.15.53:0/3363473459 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb940066280 0x7fb940068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:46.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.521+0000 7fb953fff640 1 --2- 172.21.15.53:0/3363473459 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb940066280 0x7fb940068730 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fb9440ae000 tx=0x7fb9440a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:46.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.525+0000 7fb950ff9640 1 -- 172.21.15.53:0/3363473459 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb94c0509c0 con 0x7fb954159a60 2023-06-10T19:07:46.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.681+0000 7fb95a552640 1 -- 172.21.15.53:0/3363473459 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb95406c6d0 con 0x7fb954159a60 2023-06-10T19:07:46.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.681+0000 7fb950ff9640 1 -- 172.21.15.53:0/3363473459 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v168) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb94c053fe0 con 0x7fb954159a60 2023-06-10T19:07:46.685 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-06-10T19:07:46.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.685+0000 7fb95a552640 1 -- 172.21.15.53:0/3363473459 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb940066280 msgr2=0x7fb940068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:46.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.685+0000 7fb95a552640 1 --2- 172.21.15.53:0/3363473459 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb940066280 0x7fb940068730 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fb9440ae000 tx=0x7fb9440a7000 comp rx=0 tx=0).stop 2023-06-10T19:07:46.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.685+0000 7fb95a552640 1 -- 172.21.15.53:0/3363473459 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb954159a60 msgr2=0x7fb95414d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:46.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.685+0000 7fb95a552640 1 --2- 172.21.15.53:0/3363473459 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb954159a60 0x7fb95414d150 secure :-1 s=READY pgs=2494 cs=0 l=1 rev1=1 crypto rx=0x7fb94c002240 tx=0x7fb94c00cbe0 comp rx=0 tx=0).stop 2023-06-10T19:07:46.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.685+0000 7fb95a552640 1 -- 172.21.15.53:0/3363473459 shutdown_connections 2023-06-10T19:07:46.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.685+0000 7fb95a552640 1 --2- 172.21.15.53:0/3363473459 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb940066280 0x7fb940068730 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:46.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.685+0000 7fb95a552640 1 --2- 172.21.15.53:0/3363473459 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb954159a60 0x7fb95414d150 unknown :-1 s=CLOSED pgs=2494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:46.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.685+0000 7fb95a552640 1 --2- 172.21.15.53:0/3363473459 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb954159690 0x7fb954155cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:46.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.685+0000 7fb95a552640 1 --2- 172.21.15.53:0/3363473459 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb9540b0f30 0x7fb9540b25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:46.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.685+0000 7fb95a552640 1 -- 172.21.15.53:0/3363473459 >> 172.21.15.53:0/3363473459 conn(0x7fb95406a560 msgr2=0x7fb954070190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:46.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.685+0000 7fb95a552640 1 -- 172.21.15.53:0/3363473459 shutdown_connections 2023-06-10T19:07:46.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.685+0000 7fb95a552640 1 -- 172.21.15.53:0/3363473459 wait complete. 2023-06-10T19:07:46.703 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-10T19:07:46.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.829+0000 7fabbddc1640 1 Processor -- start 2023-06-10T19:07:46.831 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.829+0000 7fabbddc1640 1 -- start start 2023-06-10T19:07:46.832 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.829+0000 7fabbddc1640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fabb8070de0 0x7fabb815cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:46.832 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.829+0000 7fabbddc1640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fabb80cc020 0x7fabb806bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:46.832 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.829+0000 7fabbddc1640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabb80c8d50 con 0x7fabb815c060 2023-06-10T19:07:46.832 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.829+0000 7fabbddc1640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabb80c9030 con 0x7fabb8070de0 2023-06-10T19:07:46.832 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.829+0000 7fabbddc1640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabb8070300 con 0x7fabb80cc020 2023-06-10T19:07:46.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.829+0000 7fabb6ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fabb8070de0 0x7fabb815cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:46.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.829+0000 7fabb6ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fabb8070de0 0x7fabb815cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45222/0 (socket says 172.21.15.53:45222) 2023-06-10T19:07:46.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.829+0000 7fabb6ffd640 1 -- 172.21.15.53:0/1383876590 learned_addr learned my addr 172.21.15.53:0/1383876590 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:46.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.829+0000 7fabb7fff640 1 --2- 172.21.15.53:0/1383876590 >> v2:172.21.15.117:3300/0 conn(0x7fabb80cc020 0x7fabb806bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:46.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.829+0000 7fabb6ffd640 1 -- 172.21.15.53:0/1383876590 >> v2:172.21.15.117:3300/0 conn(0x7fabb80cc020 msgr2=0x7fabb806bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:46.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.829+0000 7fabb6ffd640 1 --2- 172.21.15.53:0/1383876590 >> v2:172.21.15.117:3300/0 conn(0x7fabb80cc020 0x7fabb806bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:46.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.829+0000 7fabb6ffd640 1 -- 172.21.15.53:0/1383876590 >> v1:172.21.15.117:6789/0 conn(0x7fabb815c060 legacy=0x7fabb815c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:46.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.829+0000 7fabb6ffd640 1 -- 172.21.15.53:0/1383876590 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabb80705e0 con 0x7fabb8070de0 2023-06-10T19:07:46.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.829+0000 7fabb7fff640 1 --2- 172.21.15.53:0/1383876590 >> v2:172.21.15.117:3300/0 conn(0x7fabb80cc020 0x7fabb806bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:07:46.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.833+0000 7fabb6ffd640 1 --2- 172.21.15.53:0/1383876590 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fabb8070de0 0x7fabb815cb40 secure :-1 s=READY pgs=2495 cs=0 l=1 rev1=1 crypto rx=0x7fabb806e980 tx=0x7fabac01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edfe6872fb00d080 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:46.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.833+0000 7fabb67fc640 1 -- 172.21.15.53:0/1383876590 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabac0ab600 con 0x7fabb8070de0 2023-06-10T19:07:46.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.833+0000 7fabb67fc640 1 -- 172.21.15.53:0/1383876590 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabac0ab760 con 0x7fabb8070de0 2023-06-10T19:07:46.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.833+0000 7fabb67fc640 1 -- 172.21.15.53:0/1383876590 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabac0abaf0 con 0x7fabb8070de0 2023-06-10T19:07:46.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.833+0000 7fabbddc1640 1 -- 172.21.15.53:0/1383876590 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fabb8070de0 msgr2=0x7fabb815cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:46.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.833+0000 7fabbddc1640 1 --2- 172.21.15.53:0/1383876590 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fabb8070de0 0x7fabb815cb40 secure :-1 s=READY pgs=2495 cs=0 l=1 rev1=1 crypto rx=0x7fabb806e980 tx=0x7fabac01c470 comp rx=0 tx=0).stop 2023-06-10T19:07:46.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.833+0000 7fabbddc1640 1 -- 172.21.15.53:0/1383876590 shutdown_connections 2023-06-10T19:07:46.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.833+0000 7fabbddc1640 1 --2- 172.21.15.53:0/1383876590 >> v2:172.21.15.117:3300/0 conn(0x7fabb80cc020 0x7fabb806bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:46.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.833+0000 7fabbddc1640 1 --2- 172.21.15.53:0/1383876590 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fabb8070de0 0x7fabb815cb40 unknown :-1 s=CLOSED pgs=2495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:46.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.833+0000 7fabbddc1640 1 -- 172.21.15.53:0/1383876590 >> 172.21.15.53:0/1383876590 conn(0x7fabb806a0e0 msgr2=0x7fabb80cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:46.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.833+0000 7fabbddc1640 1 -- 172.21.15.53:0/1383876590 shutdown_connections 2023-06-10T19:07:46.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.833+0000 7fabbddc1640 1 -- 172.21.15.53:0/1383876590 wait complete. 2023-06-10T19:07:46.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.833+0000 7fabbddc1640 1 Processor -- start 2023-06-10T19:07:46.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.833+0000 7fabbddc1640 1 -- start start 2023-06-10T19:07:46.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.833+0000 7fabbddc1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fabb8070de0 0x7fabb80c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:46.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.833+0000 7fabbddc1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fabb80cc020 0x7fabb80c1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:46.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.833+0000 7fabbddc1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fabb815c060 0x7fabb80ca950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:46.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.833+0000 7fabbddc1640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabb8159ab0 con 0x7fabb815c060 2023-06-10T19:07:46.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.833+0000 7fabbddc1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabb815a030 con 0x7fabb8070de0 2023-06-10T19:07:46.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.833+0000 7fabbddc1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabb8153f30 con 0x7fabb80cc020 2023-06-10T19:07:46.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.833+0000 7fabb7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fabb815c060 0x7fabb80ca950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:46.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.833+0000 7fabb7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fabb815c060 0x7fabb80ca950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45236/0 (socket says 172.21.15.53:45236) 2023-06-10T19:07:46.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.833+0000 7fabb7fff640 1 -- 172.21.15.53:0/330504733 learned_addr learned my addr 172.21.15.53:0/330504733 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:46.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.833+0000 7fabb6ffd640 1 --2- 172.21.15.53:0/330504733 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fabb80cc020 0x7fabb80c1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:46.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.833+0000 7fabb77fe640 1 --2- 172.21.15.53:0/330504733 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fabb8070de0 0x7fabb80c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:46.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.833+0000 7fabb7fff640 1 -- 172.21.15.53:0/330504733 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fabb80cc020 msgr2=0x7fabb80c1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:46.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.833+0000 7fabb7fff640 1 --2- 172.21.15.53:0/330504733 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fabb80cc020 0x7fabb80c1780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:46.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.833+0000 7fabb7fff640 1 -- 172.21.15.53:0/330504733 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fabb8070de0 msgr2=0x7fabb80c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:46.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.833+0000 7fabb7fff640 1 --2- 172.21.15.53:0/330504733 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fabb8070de0 0x7fabb80c75c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:46.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.833+0000 7fabb7fff640 1 -- 172.21.15.53:0/330504733 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabac0094d0 con 0x7fabb815c060 2023-06-10T19:07:46.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.837+0000 7fabb7fff640 1 --2- 172.21.15.53:0/330504733 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fabb815c060 0x7fabb80ca950 secure :-1 s=READY pgs=2496 cs=0 l=1 rev1=1 crypto rx=0x7fabb0007df0 tx=0x7fabb000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:46.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.837+0000 7fab9ffff640 1 -- 172.21.15.53:0/330504733 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb00039a0 con 0x7fabb815c060 2023-06-10T19:07:46.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.837+0000 7fab9ffff640 1 -- 172.21.15.53:0/330504733 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabb000f040 con 0x7fabb815c060 2023-06-10T19:07:46.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.837+0000 7fabbddc1640 1 -- 172.21.15.53:0/330504733 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabb8154210 con 0x7fabb815c060 2023-06-10T19:07:46.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.837+0000 7fab9ffff640 1 -- 172.21.15.53:0/330504733 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb0003d40 con 0x7fabb815c060 2023-06-10T19:07:46.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.837+0000 7fabbddc1640 1 -- 172.21.15.53:0/330504733 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabb8159cc0 con 0x7fabb815c060 2023-06-10T19:07:46.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.837+0000 7fabbddc1640 1 -- 172.21.15.53:0/330504733 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabb815a1a0 con 0x7fabb815c060 2023-06-10T19:07:46.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.837+0000 7fab9ffff640 1 -- 172.21.15.53:0/330504733 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fabb0004030 con 0x7fabb815c060 2023-06-10T19:07:46.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.837+0000 7fab9ffff640 1 --2- 172.21.15.53:0/330504733 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7faba4066280 0x7faba4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:46.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.837+0000 7fab9ffff640 1 -- 172.21.15.53:0/330504733 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6105+0+0 (secure 0 0 0) 0x7fabb0084590 con 0x7fabb815c060 2023-06-10T19:07:46.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.837+0000 7fabb77fe640 1 --2- 172.21.15.53:0/330504733 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7faba4066280 0x7faba4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:46.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.837+0000 7fabb77fe640 1 --2- 172.21.15.53:0/330504733 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7faba4066280 0x7faba4068730 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7faba8000f70 tx=0x7faba8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:46.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.841+0000 7fab9ffff640 1 -- 172.21.15.53:0/330504733 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fabb0051a50 con 0x7fabb815c060 2023-06-10T19:07:46.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.993+0000 7fabbddc1640 1 -- 172.21.15.53:0/330504733 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fabb804d790 con 0x7fabb815c060 2023-06-10T19:07:46.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.993+0000 7fab9ffff640 1 -- 172.21.15.53:0/330504733 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v168) v1 ==== 92+0+10 (secure 0 0 0) 0x7fabb001a020 con 0x7fabb815c060 2023-06-10T19:07:46.995 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-06-10T19:07:46.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.993+0000 7fabbddc1640 1 -- 172.21.15.53:0/330504733 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7faba4066280 msgr2=0x7faba4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:46.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.993+0000 7fabbddc1640 1 --2- 172.21.15.53:0/330504733 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7faba4066280 0x7faba4068730 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7faba8000f70 tx=0x7faba8009040 comp rx=0 tx=0).stop 2023-06-10T19:07:46.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.993+0000 7fabbddc1640 1 -- 172.21.15.53:0/330504733 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fabb815c060 msgr2=0x7fabb80ca950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:46.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.993+0000 7fabbddc1640 1 --2- 172.21.15.53:0/330504733 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fabb815c060 0x7fabb80ca950 secure :-1 s=READY pgs=2496 cs=0 l=1 rev1=1 crypto rx=0x7fabb0007df0 tx=0x7fabb000d4a0 comp rx=0 tx=0).stop 2023-06-10T19:07:46.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.993+0000 7fabbddc1640 1 -- 172.21.15.53:0/330504733 shutdown_connections 2023-06-10T19:07:46.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.993+0000 7fabbddc1640 1 --2- 172.21.15.53:0/330504733 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7faba4066280 0x7faba4068730 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:46.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.993+0000 7fabbddc1640 1 --2- 172.21.15.53:0/330504733 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fabb815c060 0x7fabb80ca950 unknown :-1 s=CLOSED pgs=2496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:46.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.993+0000 7fabbddc1640 1 --2- 172.21.15.53:0/330504733 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fabb80cc020 0x7fabb80c1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:46.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.993+0000 7fabbddc1640 1 --2- 172.21.15.53:0/330504733 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fabb8070de0 0x7fabb80c75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:46.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.993+0000 7fabbddc1640 1 -- 172.21.15.53:0/330504733 >> 172.21.15.53:0/330504733 conn(0x7fabb806a0e0 msgr2=0x7fabb80cd300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:46.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.993+0000 7fabbddc1640 1 -- 172.21.15.53:0/330504733 shutdown_connections 2023-06-10T19:07:46.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:46.993+0000 7fabbddc1640 1 -- 172.21.15.53:0/330504733 wait complete. 2023-06-10T19:07:47.013 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-10T19:07:47.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.137+0000 7f07cb224640 1 Processor -- start 2023-06-10T19:07:47.142 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.137+0000 7f07cb224640 1 -- start start 2023-06-10T19:07:47.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.141+0000 7f07cb224640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f07c4159690 0x7f07c4070950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:47.144 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.141+0000 7f07cb224640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f07c4159a60 0x7f07c40c2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:47.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.141+0000 7f07cb224640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07c40cb080 con 0x7f07c40b0f30 2023-06-10T19:07:47.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.141+0000 7f07cb224640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07c4070e90 con 0x7f07c4159690 2023-06-10T19:07:47.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.141+0000 7f07cb224640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07c406d450 con 0x7f07c4159a60 2023-06-10T19:07:47.145 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.141+0000 7f07c8fc0640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f07c4159690 0x7f07c4070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:47.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.141+0000 7f07c8fc0640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f07c4159690 0x7f07c4070950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45252/0 (socket says 172.21.15.53:45252) 2023-06-10T19:07:47.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.141+0000 7f07c8fc0640 1 -- 172.21.15.53:0/1629921520 learned_addr learned my addr 172.21.15.53:0/1629921520 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:47.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.141+0000 7f07c97c1640 1 --2- 172.21.15.53:0/1629921520 >> v2:172.21.15.117:3300/0 conn(0x7f07c4159a60 0x7f07c40c2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:47.146 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.141+0000 7f07c8fc0640 1 -- 172.21.15.53:0/1629921520 >> v2:172.21.15.117:3300/0 conn(0x7f07c4159a60 msgr2=0x7f07c40c2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:47.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.141+0000 7f07c8fc0640 1 --2- 172.21.15.53:0/1629921520 >> v2:172.21.15.117:3300/0 conn(0x7f07c4159a60 0x7f07c40c2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:47.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.141+0000 7f07c8fc0640 1 -- 172.21.15.53:0/1629921520 >> v1:172.21.15.117:6789/0 conn(0x7f07c40b0f30 legacy=0x7f07c40cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:47.147 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.141+0000 7f07c8fc0640 1 -- 172.21.15.53:0/1629921520 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07c40cb320 con 0x7f07c4159690 2023-06-10T19:07:47.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.141+0000 7f07c8fc0640 1 --2- 172.21.15.53:0/1629921520 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07c4159690 0x7f07c4070950 secure :-1 s=READY pgs=2497 cs=0 l=1 rev1=1 crypto rx=0x7f07c4070160 tx=0x7f07b401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc3ae8d42e2f2b42 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:47.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.141+0000 7f07c37fe640 1 -- 172.21.15.53:0/1629921520 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b40ac600 con 0x7f07c4159690 2023-06-10T19:07:47.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.141+0000 7f07c37fe640 1 -- 172.21.15.53:0/1629921520 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07b40a8050 con 0x7f07c4159690 2023-06-10T19:07:47.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.141+0000 7f07c37fe640 1 -- 172.21.15.53:0/1629921520 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b40ac980 con 0x7f07c4159690 2023-06-10T19:07:47.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.145+0000 7f07cb224640 1 -- 172.21.15.53:0/1629921520 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07c4159690 msgr2=0x7f07c4070950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:47.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.145+0000 7f07cb224640 1 --2- 172.21.15.53:0/1629921520 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07c4159690 0x7f07c4070950 secure :-1 s=READY pgs=2497 cs=0 l=1 rev1=1 crypto rx=0x7f07c4070160 tx=0x7f07b401c490 comp rx=0 tx=0).stop 2023-06-10T19:07:47.154 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.145+0000 7f07cb224640 1 -- 172.21.15.53:0/1629921520 shutdown_connections 2023-06-10T19:07:47.154 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.145+0000 7f07cb224640 1 --2- 172.21.15.53:0/1629921520 >> v2:172.21.15.117:3300/0 conn(0x7f07c4159a60 0x7f07c40c2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:47.154 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.145+0000 7f07cb224640 1 --2- 172.21.15.53:0/1629921520 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07c4159690 0x7f07c4070950 unknown :-1 s=CLOSED pgs=2497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:47.154 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.145+0000 7f07cb224640 1 -- 172.21.15.53:0/1629921520 >> 172.21.15.53:0/1629921520 conn(0x7f07c406a560 msgr2=0x7f07c406a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:47.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.145+0000 7f07cb224640 1 -- 172.21.15.53:0/1629921520 shutdown_connections 2023-06-10T19:07:47.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.145+0000 7f07cb224640 1 -- 172.21.15.53:0/1629921520 wait complete. 2023-06-10T19:07:47.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.145+0000 7f07cb224640 1 Processor -- start 2023-06-10T19:07:47.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.145+0000 7f07cb224640 1 -- start start 2023-06-10T19:07:47.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.145+0000 7f07cb224640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07c40b0f30 0x7f07c40c6e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:47.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.145+0000 7f07cb224640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07c4159690 0x7f07c40cdee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:47.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.145+0000 7f07cb224640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f07c4159a60 0x7f07c40ce420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:47.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.145+0000 7f07cb224640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c40c5e80 con 0x7f07c4159690 2023-06-10T19:07:47.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.145+0000 7f07cb224640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c40c60d0 con 0x7f07c40b0f30 2023-06-10T19:07:47.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.145+0000 7f07cb224640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07c40c63b0 con 0x7f07c4159a60 2023-06-10T19:07:47.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.145+0000 7f07c3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07c4159690 0x7f07c40cdee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:47.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.145+0000 7f07c3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07c4159690 0x7f07c40cdee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45268/0 (socket says 172.21.15.53:45268) 2023-06-10T19:07:47.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.145+0000 7f07c3fff640 1 -- 172.21.15.53:0/737680506 learned_addr learned my addr 172.21.15.53:0/737680506 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:47.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.145+0000 7f07c97c1640 1 --2- 172.21.15.53:0/737680506 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f07c4159a60 0x7f07c40ce420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:47.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.145+0000 7f07c8fc0640 1 --2- 172.21.15.53:0/737680506 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07c40b0f30 0x7f07c40c6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:47.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.145+0000 7f07c3fff640 1 -- 172.21.15.53:0/737680506 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f07c4159a60 msgr2=0x7f07c40ce420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:47.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.145+0000 7f07c3fff640 1 --2- 172.21.15.53:0/737680506 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f07c4159a60 0x7f07c40ce420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:47.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.145+0000 7f07c3fff640 1 -- 172.21.15.53:0/737680506 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07c40b0f30 msgr2=0x7f07c40c6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:47.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.145+0000 7f07c3fff640 1 --2- 172.21.15.53:0/737680506 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07c40b0f30 0x7f07c40c6e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:47.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.145+0000 7f07c3fff640 1 -- 172.21.15.53:0/737680506 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07b40094d0 con 0x7f07c4159690 2023-06-10T19:07:47.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.145+0000 7f07c3fff640 1 --2- 172.21.15.53:0/737680506 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07c4159690 0x7f07c40cdee0 secure :-1 s=READY pgs=2498 cs=0 l=1 rev1=1 crypto rx=0x7f07b800c450 tx=0x7f07b800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:47.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.145+0000 7f07c17fa640 1 -- 172.21.15.53:0/737680506 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b8012830 con 0x7f07c4159690 2023-06-10T19:07:47.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.145+0000 7f07c17fa640 1 -- 172.21.15.53:0/737680506 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07b80129b0 con 0x7f07c4159690 2023-06-10T19:07:47.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.145+0000 7f07cb224640 1 -- 172.21.15.53:0/737680506 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07c40c6690 con 0x7f07c4159690 2023-06-10T19:07:47.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.145+0000 7f07c17fa640 1 -- 172.21.15.53:0/737680506 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b8012d60 con 0x7f07c4159690 2023-06-10T19:07:47.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.145+0000 7f07cb224640 1 -- 172.21.15.53:0/737680506 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07c4156ab0 con 0x7f07c4159690 2023-06-10T19:07:47.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.145+0000 7f07cb224640 1 -- 172.21.15.53:0/737680506 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07c40b4dc0 con 0x7f07c4159690 2023-06-10T19:07:47.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.149+0000 7f07c17fa640 1 -- 172.21.15.53:0/737680506 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f07b801c460 con 0x7f07c4159690 2023-06-10T19:07:47.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.149+0000 7f07c17fa640 1 --2- 172.21.15.53:0/737680506 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f07b0066280 0x7f07b0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:47.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.149+0000 7f07c17fa640 1 -- 172.21.15.53:0/737680506 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6105+0+0 (secure 0 0 0) 0x7f07b8083c90 con 0x7f07c4159690 2023-06-10T19:07:47.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.149+0000 7f07c8fc0640 1 --2- 172.21.15.53:0/737680506 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f07b0066280 0x7f07b0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:47.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.149+0000 7f07c8fc0640 1 --2- 172.21.15.53:0/737680506 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f07b0066280 0x7f07b0068730 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f07b40ae000 tx=0x7f07b4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:47.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.153+0000 7f07c17fa640 1 -- 172.21.15.53:0/737680506 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f07b8051040 con 0x7f07c4159690 2023-06-10T19:07:47.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.301+0000 7f07cb224640 1 -- 172.21.15.53:0/737680506 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f07c404d790 con 0x7f07c4159690 2023-06-10T19:07:47.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.301+0000 7f07c17fa640 1 -- 172.21.15.53:0/737680506 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v168) v1 ==== 104+0+11 (secure 0 0 0) 0x7f07b8054660 con 0x7f07c4159690 2023-06-10T19:07:47.305 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-06-10T19:07:47.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.305+0000 7f07cb224640 1 -- 172.21.15.53:0/737680506 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f07b0066280 msgr2=0x7f07b0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:47.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.305+0000 7f07cb224640 1 --2- 172.21.15.53:0/737680506 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f07b0066280 0x7f07b0068730 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f07b40ae000 tx=0x7f07b4008040 comp rx=0 tx=0).stop 2023-06-10T19:07:47.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.305+0000 7f07cb224640 1 -- 172.21.15.53:0/737680506 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07c4159690 msgr2=0x7f07c40cdee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:47.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.305+0000 7f07cb224640 1 --2- 172.21.15.53:0/737680506 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07c4159690 0x7f07c40cdee0 secure :-1 s=READY pgs=2498 cs=0 l=1 rev1=1 crypto rx=0x7f07b800c450 tx=0x7f07b800c910 comp rx=0 tx=0).stop 2023-06-10T19:07:47.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.305+0000 7f07cb224640 1 -- 172.21.15.53:0/737680506 shutdown_connections 2023-06-10T19:07:47.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.305+0000 7f07cb224640 1 --2- 172.21.15.53:0/737680506 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f07b0066280 0x7f07b0068730 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:47.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.305+0000 7f07cb224640 1 --2- 172.21.15.53:0/737680506 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f07c4159a60 0x7f07c40ce420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:47.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.305+0000 7f07cb224640 1 --2- 172.21.15.53:0/737680506 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f07c4159690 0x7f07c40cdee0 unknown :-1 s=CLOSED pgs=2498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:47.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.305+0000 7f07cb224640 1 --2- 172.21.15.53:0/737680506 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07c40b0f30 0x7f07c40c6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:47.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.305+0000 7f07cb224640 1 -- 172.21.15.53:0/737680506 >> 172.21.15.53:0/737680506 conn(0x7f07c406a560 msgr2=0x7f07c41575f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:47.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.305+0000 7f07cb224640 1 -- 172.21.15.53:0/737680506 shutdown_connections 2023-06-10T19:07:47.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.305+0000 7f07cb224640 1 -- 172.21.15.53:0/737680506 wait complete. 2023-06-10T19:07:47.322 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-10T19:07:47.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.437+0000 7efc97bed640 1 Processor -- start 2023-06-10T19:07:47.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.437+0000 7efc97bed640 1 -- start start 2023-06-10T19:07:47.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.437+0000 7efc97bed640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7efc901558e0 0x7efc900c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:47.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.437+0000 7efc97bed640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efc90158f40 0x7efc900cb820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:47.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.437+0000 7efc97bed640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc9006c230 con 0x7efc900cbd60 2023-06-10T19:07:47.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.437+0000 7efc97bed640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc9006ca40 con 0x7efc901558e0 2023-06-10T19:07:47.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.437+0000 7efc97bed640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc90155cb0 con 0x7efc90158f40 2023-06-10T19:07:47.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.437+0000 7efc95188640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efc90158f40 0x7efc900cb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:47.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.437+0000 7efc95989640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7efc901558e0 0x7efc900c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:47.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.437+0000 7efc95188640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efc90158f40 0x7efc900cb820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.53:60476/0 (socket says 172.21.15.53:60476) 2023-06-10T19:07:47.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.437+0000 7efc95188640 1 -- 172.21.15.53:0/1825519281 learned_addr learned my addr 172.21.15.53:0/1825519281 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:47.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.437+0000 7efc95188640 1 -- 172.21.15.53:0/1825519281 >> v2:172.21.15.117:3300/0 conn(0x7efc901558e0 msgr2=0x7efc900c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:47.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.437+0000 7efc95188640 1 --2- 172.21.15.53:0/1825519281 >> v2:172.21.15.117:3300/0 conn(0x7efc901558e0 0x7efc900c82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:47.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.437+0000 7efc95188640 1 -- 172.21.15.53:0/1825519281 >> v1:172.21.15.117:6789/0 conn(0x7efc900cbd60 legacy=0x7efc9006b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:47.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.437+0000 7efc95188640 1 -- 172.21.15.53:0/1825519281 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc9006c480 con 0x7efc90158f40 2023-06-10T19:07:47.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.441+0000 7efc95188640 1 --2- 172.21.15.53:0/1825519281 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efc90158f40 0x7efc900cb820 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7efc80009870 tx=0x7efc8001c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8700a43dda3d484c server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:47.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.441+0000 7efc94987640 1 -- 172.21.15.53:0/1825519281 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc800ab600 con 0x7efc90158f40 2023-06-10T19:07:47.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.441+0000 7efc94987640 1 -- 172.21.15.53:0/1825519281 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc800a7050 con 0x7efc90158f40 2023-06-10T19:07:47.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.441+0000 7efc94987640 1 -- 172.21.15.53:0/1825519281 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc800ab980 con 0x7efc90158f40 2023-06-10T19:07:47.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.441+0000 7efc97bed640 1 -- 172.21.15.53:0/1825519281 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efc90158f40 msgr2=0x7efc900cb820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:47.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.441+0000 7efc97bed640 1 --2- 172.21.15.53:0/1825519281 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efc90158f40 0x7efc900cb820 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7efc80009870 tx=0x7efc8001c3f0 comp rx=0 tx=0).stop 2023-06-10T19:07:47.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.441+0000 7efc97bed640 1 -- 172.21.15.53:0/1825519281 shutdown_connections 2023-06-10T19:07:47.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.441+0000 7efc97bed640 1 --2- 172.21.15.53:0/1825519281 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efc90158f40 0x7efc900cb820 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:47.445 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.441+0000 7efc97bed640 1 --2- 172.21.15.53:0/1825519281 >> v2:172.21.15.117:3300/0 conn(0x7efc901558e0 0x7efc900c82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:47.445 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.441+0000 7efc97bed640 1 -- 172.21.15.53:0/1825519281 >> 172.21.15.53:0/1825519281 conn(0x7efc9006a0e0 msgr2=0x7efc900cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:47.445 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.441+0000 7efc97bed640 1 -- 172.21.15.53:0/1825519281 shutdown_connections 2023-06-10T19:07:47.445 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.441+0000 7efc97bed640 1 -- 172.21.15.53:0/1825519281 wait complete. 2023-06-10T19:07:47.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.441+0000 7efc97bed640 1 Processor -- start 2023-06-10T19:07:47.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.441+0000 7efc97bed640 1 -- start start 2023-06-10T19:07:47.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.441+0000 7efc97bed640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efc900cbd60 0x7efc90070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:47.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.441+0000 7efc97bed640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc901558e0 0x7efc900c0a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:47.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.441+0000 7efc97bed640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efc90158f40 0x7efc9006eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:47.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.441+0000 7efc97bed640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc900c0f70 con 0x7efc901558e0 2023-06-10T19:07:47.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.441+0000 7efc97bed640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc90160df0 con 0x7efc900cbd60 2023-06-10T19:07:47.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.441+0000 7efc97bed640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc901610b0 con 0x7efc90158f40 2023-06-10T19:07:47.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.441+0000 7efc95188640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc901558e0 0x7efc900c0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:47.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.441+0000 7efc95188640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc901558e0 0x7efc900c0a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45282/0 (socket says 172.21.15.53:45282) 2023-06-10T19:07:47.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.441+0000 7efc95188640 1 -- 172.21.15.53:0/2060764973 learned_addr learned my addr 172.21.15.53:0/2060764973 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:47.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.445+0000 7efc95989640 1 --2- 172.21.15.53:0/2060764973 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efc900cbd60 0x7efc90070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:47.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.445+0000 7efc9618a640 1 --2- 172.21.15.53:0/2060764973 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efc90158f40 0x7efc9006eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:47.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.445+0000 7efc95188640 1 -- 172.21.15.53:0/2060764973 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efc90158f40 msgr2=0x7efc9006eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:47.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.445+0000 7efc95188640 1 --2- 172.21.15.53:0/2060764973 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efc90158f40 0x7efc9006eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:47.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.445+0000 7efc95188640 1 -- 172.21.15.53:0/2060764973 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efc900cbd60 msgr2=0x7efc90070ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:47.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.445+0000 7efc95188640 1 --2- 172.21.15.53:0/2060764973 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efc900cbd60 0x7efc90070ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:47.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.445+0000 7efc95188640 1 -- 172.21.15.53:0/2060764973 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc800094d0 con 0x7efc901558e0 2023-06-10T19:07:47.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.445+0000 7efc95188640 1 --2- 172.21.15.53:0/2060764973 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc901558e0 0x7efc900c0a30 secure :-1 s=READY pgs=2499 cs=0 l=1 rev1=1 crypto rx=0x7efc800ae040 tx=0x7efc80019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:47.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.445+0000 7efc867fc640 1 -- 172.21.15.53:0/2060764973 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc800b6420 con 0x7efc901558e0 2023-06-10T19:07:47.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.445+0000 7efc867fc640 1 -- 172.21.15.53:0/2060764973 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc800b65c0 con 0x7efc901558e0 2023-06-10T19:07:47.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.445+0000 7efc97bed640 1 -- 172.21.15.53:0/2060764973 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc90161390 con 0x7efc901558e0 2023-06-10T19:07:47.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.445+0000 7efc867fc640 1 -- 172.21.15.53:0/2060764973 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc800b6970 con 0x7efc901558e0 2023-06-10T19:07:47.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.445+0000 7efc97bed640 1 -- 172.21.15.53:0/2060764973 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc90161950 con 0x7efc901558e0 2023-06-10T19:07:47.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.445+0000 7efc97bed640 1 -- 172.21.15.53:0/2060764973 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc90161b40 con 0x7efc901558e0 2023-06-10T19:07:47.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.445+0000 7efc867fc640 1 -- 172.21.15.53:0/2060764973 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7efc800b2040 con 0x7efc901558e0 2023-06-10T19:07:47.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.445+0000 7efc867fc640 1 --2- 172.21.15.53:0/2060764973 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efc74066280 0x7efc74068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:47.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.445+0000 7efc867fc640 1 -- 172.21.15.53:0/2060764973 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6105+0+0 (secure 0 0 0) 0x7efc8011e140 con 0x7efc901558e0 2023-06-10T19:07:47.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.445+0000 7efc95989640 1 --2- 172.21.15.53:0/2060764973 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efc74066280 0x7efc74068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:47.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.445+0000 7efc95989640 1 --2- 172.21.15.53:0/2060764973 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efc74066280 0x7efc74068730 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7efc8c00b240 tx=0x7efc8c00b3a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:47.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.449+0000 7efc867fc640 1 -- 172.21.15.53:0/2060764973 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7efc800eb590 con 0x7efc901558e0 2023-06-10T19:07:47.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.597+0000 7efc97bed640 1 -- 172.21.15.53:0/2060764973 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efc9004d790 con 0x7efc901558e0 2023-06-10T19:07:47.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.597+0000 7efc867fc640 1 -- 172.21.15.53:0/2060764973 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v168) v1 ==== 100+0+11 (secure 0 0 0) 0x7efc800eebb0 con 0x7efc901558e0 2023-06-10T19:07:47.601 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-06-10T19:07:47.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.597+0000 7efc97bed640 1 -- 172.21.15.53:0/2060764973 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efc74066280 msgr2=0x7efc74068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:47.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.597+0000 7efc97bed640 1 --2- 172.21.15.53:0/2060764973 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efc74066280 0x7efc74068730 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7efc8c00b240 tx=0x7efc8c00b3a0 comp rx=0 tx=0).stop 2023-06-10T19:07:47.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.597+0000 7efc97bed640 1 -- 172.21.15.53:0/2060764973 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc901558e0 msgr2=0x7efc900c0a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:47.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.597+0000 7efc97bed640 1 --2- 172.21.15.53:0/2060764973 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc901558e0 0x7efc900c0a30 secure :-1 s=READY pgs=2499 cs=0 l=1 rev1=1 crypto rx=0x7efc800ae040 tx=0x7efc80019190 comp rx=0 tx=0).stop 2023-06-10T19:07:47.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.601+0000 7efc97bed640 1 -- 172.21.15.53:0/2060764973 shutdown_connections 2023-06-10T19:07:47.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.601+0000 7efc97bed640 1 --2- 172.21.15.53:0/2060764973 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efc74066280 0x7efc74068730 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:47.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.601+0000 7efc97bed640 1 --2- 172.21.15.53:0/2060764973 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efc90158f40 0x7efc9006eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:47.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.601+0000 7efc97bed640 1 --2- 172.21.15.53:0/2060764973 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc901558e0 0x7efc900c0a30 unknown :-1 s=CLOSED pgs=2499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:47.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.601+0000 7efc97bed640 1 --2- 172.21.15.53:0/2060764973 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efc900cbd60 0x7efc90070ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:47.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.601+0000 7efc97bed640 1 -- 172.21.15.53:0/2060764973 >> 172.21.15.53:0/2060764973 conn(0x7efc9006a0e0 msgr2=0x7efc9015b840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:47.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.601+0000 7efc97bed640 1 -- 172.21.15.53:0/2060764973 shutdown_connections 2023-06-10T19:07:47.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.601+0000 7efc97bed640 1 -- 172.21.15.53:0/2060764973 wait complete. 2023-06-10T19:07:47.618 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-10T19:07:47.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.729+0000 7f2e5728a640 1 Processor -- start 2023-06-10T19:07:47.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.729+0000 7f2e5728a640 1 -- start start 2023-06-10T19:07:47.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.729+0000 7f2e5728a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e500cec40 0x7f2e500cf090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:47.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.729+0000 7f2e5728a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2e500cbf50 0x7f2e500cc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:47.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.729+0000 7f2e5728a640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e500cf5d0 con 0x7f2e50159450 2023-06-10T19:07:47.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.729+0000 7f2e5728a640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e500cbac0 con 0x7f2e500cbf50 2023-06-10T19:07:47.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.729+0000 7f2e5728a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5015dc00 con 0x7f2e500cec40 2023-06-10T19:07:47.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.729+0000 7f2e55827640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2e500cbf50 0x7f2e500cc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:47.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.729+0000 7f2e55827640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2e500cbf50 0x7f2e500cc3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45296/0 (socket says 172.21.15.53:45296) 2023-06-10T19:07:47.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.729+0000 7f2e55827640 1 -- 172.21.15.53:0/3205370387 learned_addr learned my addr 172.21.15.53:0/3205370387 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:47.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.729+0000 7f2e54825640 1 --2- 172.21.15.53:0/3205370387 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e500cec40 0x7f2e500cf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:47.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.729+0000 7f2e55827640 1 -- 172.21.15.53:0/3205370387 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e500cec40 msgr2=0x7f2e500cf090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:47.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.729+0000 7f2e55827640 1 --2- 172.21.15.53:0/3205370387 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e500cec40 0x7f2e500cf090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:47.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.729+0000 7f2e55827640 1 -- 172.21.15.53:0/3205370387 >> v1:172.21.15.117:6789/0 conn(0x7f2e50159450 legacy=0x7f2e5015d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:47.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.729+0000 7f2e55827640 1 -- 172.21.15.53:0/3205370387 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e5015dee0 con 0x7f2e500cbf50 2023-06-10T19:07:47.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.733+0000 7f2e55827640 1 --2- 172.21.15.53:0/3205370387 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e500cbf50 0x7f2e500cc3d0 secure :-1 s=READY pgs=2500 cs=0 l=1 rev1=1 crypto rx=0x7f2e48009e50 tx=0x7f2e4801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96e1c642a5b9feae server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:47.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.733+0000 7f2e47fff640 1 -- 172.21.15.53:0/3205370387 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e480a57e0 con 0x7f2e500cbf50 2023-06-10T19:07:47.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.733+0000 7f2e47fff640 1 -- 172.21.15.53:0/3205370387 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e480a5940 con 0x7f2e500cbf50 2023-06-10T19:07:47.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.733+0000 7f2e47fff640 1 -- 172.21.15.53:0/3205370387 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e480a5cd0 con 0x7f2e500cbf50 2023-06-10T19:07:47.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.733+0000 7f2e5728a640 1 -- 172.21.15.53:0/3205370387 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e500cbf50 msgr2=0x7f2e500cc3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:47.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.733+0000 7f2e5728a640 1 --2- 172.21.15.53:0/3205370387 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e500cbf50 0x7f2e500cc3d0 secure :-1 s=READY pgs=2500 cs=0 l=1 rev1=1 crypto rx=0x7f2e48009e50 tx=0x7f2e4801c9a0 comp rx=0 tx=0).stop 2023-06-10T19:07:47.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.733+0000 7f2e5728a640 1 -- 172.21.15.53:0/3205370387 shutdown_connections 2023-06-10T19:07:47.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.733+0000 7f2e5728a640 1 --2- 172.21.15.53:0/3205370387 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e500cbf50 0x7f2e500cc3d0 unknown :-1 s=CLOSED pgs=2500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:47.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.733+0000 7f2e5728a640 1 --2- 172.21.15.53:0/3205370387 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e500cec40 0x7f2e500cf090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:47.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.733+0000 7f2e5728a640 1 -- 172.21.15.53:0/3205370387 >> 172.21.15.53:0/3205370387 conn(0x7f2e5006a0b0 msgr2=0x7f2e5006d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:47.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.733+0000 7f2e5728a640 1 -- 172.21.15.53:0/3205370387 shutdown_connections 2023-06-10T19:07:47.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.733+0000 7f2e5728a640 1 -- 172.21.15.53:0/3205370387 wait complete. 2023-06-10T19:07:47.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.733+0000 7f2e5728a640 1 Processor -- start 2023-06-10T19:07:47.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.733+0000 7f2e5728a640 1 -- start start 2023-06-10T19:07:47.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.737+0000 7f2e5728a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e500cbf50 0x7f2e501564e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:47.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.737+0000 7f2e5728a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e500cec40 0x7f2e50151030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:47.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.737+0000 7f2e5728a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e50159450 0x7f2e500b4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:47.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.737+0000 7f2e5728a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e50156a20 con 0x7f2e50159450 2023-06-10T19:07:47.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.737+0000 7f2e5728a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e501557a0 con 0x7f2e500cbf50 2023-06-10T19:07:47.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.737+0000 7f2e5728a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e50155a20 con 0x7f2e500cec40 2023-06-10T19:07:47.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.737+0000 7f2e55827640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e50159450 0x7f2e500b4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:47.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.737+0000 7f2e55827640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e50159450 0x7f2e500b4000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45310/0 (socket says 172.21.15.53:45310) 2023-06-10T19:07:47.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.737+0000 7f2e55827640 1 -- 172.21.15.53:0/2005466672 learned_addr learned my addr 172.21.15.53:0/2005466672 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:47.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.737+0000 7f2e54825640 1 --2- 172.21.15.53:0/2005466672 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e500cec40 0x7f2e50151030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:47.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.737+0000 7f2e55026640 1 --2- 172.21.15.53:0/2005466672 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e500cbf50 0x7f2e501564e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:47.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.737+0000 7f2e55827640 1 -- 172.21.15.53:0/2005466672 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e500cec40 msgr2=0x7f2e50151030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:47.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.737+0000 7f2e55827640 1 --2- 172.21.15.53:0/2005466672 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e500cec40 0x7f2e50151030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:47.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.737+0000 7f2e55827640 1 -- 172.21.15.53:0/2005466672 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e500cbf50 msgr2=0x7f2e501564e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:47.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.737+0000 7f2e55827640 1 --2- 172.21.15.53:0/2005466672 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e500cbf50 0x7f2e501564e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:47.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.737+0000 7f2e55827640 1 -- 172.21.15.53:0/2005466672 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e48009b30 con 0x7f2e50159450 2023-06-10T19:07:47.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.737+0000 7f2e55827640 1 --2- 172.21.15.53:0/2005466672 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e50159450 0x7f2e500b4000 secure :-1 s=READY pgs=2501 cs=0 l=1 rev1=1 crypto rx=0x7f2e480af040 tx=0x7f2e48019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:47.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.737+0000 7f2e45ffb640 1 -- 172.21.15.53:0/2005466672 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e480b8670 con 0x7f2e50159450 2023-06-10T19:07:47.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.737+0000 7f2e45ffb640 1 -- 172.21.15.53:0/2005466672 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e480b87d0 con 0x7f2e50159450 2023-06-10T19:07:47.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.737+0000 7f2e5728a640 1 -- 172.21.15.53:0/2005466672 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e5015d9d0 con 0x7f2e50159450 2023-06-10T19:07:47.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.737+0000 7f2e45ffb640 1 -- 172.21.15.53:0/2005466672 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e480b8b60 con 0x7f2e50159450 2023-06-10T19:07:47.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.737+0000 7f2e5728a640 1 -- 172.21.15.53:0/2005466672 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e50155ce0 con 0x7f2e50159450 2023-06-10T19:07:47.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.737+0000 7f2e5728a640 1 -- 172.21.15.53:0/2005466672 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e5004d790 con 0x7f2e50159450 2023-06-10T19:07:47.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.737+0000 7f2e45ffb640 1 -- 172.21.15.53:0/2005466672 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2e480b8cc0 con 0x7f2e50159450 2023-06-10T19:07:47.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.737+0000 7f2e45ffb640 1 --2- 172.21.15.53:0/2005466672 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2e34066280 0x7f2e34068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:47.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.737+0000 7f2e45ffb640 1 -- 172.21.15.53:0/2005466672 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6105+0+0 (secure 0 0 0) 0x7f2e4811fa50 con 0x7f2e50159450 2023-06-10T19:07:47.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.737+0000 7f2e55026640 1 --2- 172.21.15.53:0/2005466672 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2e34066280 0x7f2e34068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:47.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.741+0000 7f2e55026640 1 --2- 172.21.15.53:0/2005466672 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2e34066280 0x7f2e34068730 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c003d60 tx=0x7f2e4c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:47.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.741+0000 7f2e45ffb640 1 -- 172.21.15.53:0/2005466672 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2e480ed030 con 0x7f2e50159450 2023-06-10T19:07:47.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.909+0000 7f2e5728a640 1 -- 172.21.15.53:0/2005466672 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f2e500cf5d0 con 0x7f2e50159450 2023-06-10T19:07:47.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.909+0000 7f2e45ffb640 1 -- 172.21.15.53:0/2005466672 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 1 entries v168) v1 ==== 80+0+57 (secure 0 0 0) 0x7f2e500cf5d0 con 0x7f2e50159450 2023-06-10T19:07:47.911 INFO:teuthology.orchestra.run.smithi053.stdout:192.168.0.1:0/4011987522 2023-06-10T20:07:37.768015+0000 2023-06-10T19:07:47.912 INFO:teuthology.orchestra.run.smithi053.stderr:listed 1 entries 2023-06-10T19:07:47.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.909+0000 7f2e5728a640 1 -- 172.21.15.53:0/2005466672 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2e34066280 msgr2=0x7f2e34068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:47.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.909+0000 7f2e5728a640 1 --2- 172.21.15.53:0/2005466672 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2e34066280 0x7f2e34068730 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c003d60 tx=0x7f2e4c009040 comp rx=0 tx=0).stop 2023-06-10T19:07:47.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.909+0000 7f2e5728a640 1 -- 172.21.15.53:0/2005466672 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e50159450 msgr2=0x7f2e500b4000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:47.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.909+0000 7f2e5728a640 1 --2- 172.21.15.53:0/2005466672 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e50159450 0x7f2e500b4000 secure :-1 s=READY pgs=2501 cs=0 l=1 rev1=1 crypto rx=0x7f2e480af040 tx=0x7f2e48019740 comp rx=0 tx=0).stop 2023-06-10T19:07:47.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.909+0000 7f2e5728a640 1 -- 172.21.15.53:0/2005466672 shutdown_connections 2023-06-10T19:07:47.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.909+0000 7f2e5728a640 1 --2- 172.21.15.53:0/2005466672 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2e34066280 0x7f2e34068730 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:47.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.909+0000 7f2e5728a640 1 --2- 172.21.15.53:0/2005466672 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e50159450 0x7f2e500b4000 unknown :-1 s=CLOSED pgs=2501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:47.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.909+0000 7f2e5728a640 1 --2- 172.21.15.53:0/2005466672 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e500cec40 0x7f2e50151030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:47.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.909+0000 7f2e5728a640 1 --2- 172.21.15.53:0/2005466672 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e500cbf50 0x7f2e501564e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:47.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.909+0000 7f2e5728a640 1 -- 172.21.15.53:0/2005466672 >> 172.21.15.53:0/2005466672 conn(0x7f2e5006a0b0 msgr2=0x7f2e500b2c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:47.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.909+0000 7f2e5728a640 1 -- 172.21.15.53:0/2005466672 shutdown_connections 2023-06-10T19:07:47.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:47.909+0000 7f2e5728a640 1 -- 172.21.15.53:0/2005466672 wait complete. 2023-06-10T19:07:47.931 DEBUG:tasks.cephfs.mount:Force/lazy unmounting on client.0 2023-06-10T19:07:47.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:07:47.932 DEBUG:teuthology.orchestra.run.smithi053:> sudo umount --lazy --force /home/ubuntu/cephtest/mnt.0 2023-06-10T19:07:47.943 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[68467]: fuse finished with error 0 and tester_r 0 2023-06-10T19:07:47.944 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi053.front.sepia.ceph.com 2023-06-10T19:07:47.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:07:47.945 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-06-10T19:07:48.109 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T19:07:48.109 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:07:48.115 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16342088k,nr_inodes=4085522,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275924k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18845 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275920k,nr_inodes=818980,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275924k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-06-10T19:07:48.116 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi117.front.sepia.ceph.com 2023-06-10T19:07:48.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:07:48.117 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-06-10T19:07:48.163 INFO:teuthology.orchestra.run.smithi117.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-06-10T19:07:48.164 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-10T19:07:48.165 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T19:07:48.165 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:07:48.171 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16345192k,nr_inodes=4086298,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276544k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=407 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276540k,nr_inodes=819135,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276544k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-06-10T19:07:48.172 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi053.front.sepia.ceph.com 2023-06-10T19:07:48.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:07:48.172 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-06-10T19:07:48.218 INFO:teuthology.orchestra.run.smithi053.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-06-10T19:07:48.219 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-10T19:07:48.220 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T19:07:48.220 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:07:48.226 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16342088k,nr_inodes=4085522,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275924k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18845 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275920k,nr_inodes=818980,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275924k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-06-10T19:07:48.227 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi117.front.sepia.ceph.com 2023-06-10T19:07:48.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:07:48.227 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-06-10T19:07:48.276 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-10T19:07:48.278 INFO:teuthology.orchestra.run.smithi117.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-06-10T19:07:48.278 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:07:48.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.409+0000 7fa69c982640 1 Processor -- start 2023-06-10T19:07:48.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.409+0000 7fa69c982640 1 -- start start 2023-06-10T19:07:48.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.413+0000 7fa69c982640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa6980c8d00 0x7fa69806b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:48.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.413+0000 7fa69c982640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa69806bc00 0x7fa698162180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:48.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.413+0000 7fa69c982640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa698158a90 con 0x7fa69806b2f0 2023-06-10T19:07:48.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.413+0000 7fa69c982640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa69806f780 con 0x7fa69806bc00 2023-06-10T19:07:48.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.413+0000 7fa69c982640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6980705d0 con 0x7fa6980c8d00 2023-06-10T19:07:48.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.413+0000 7fa696d9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa69806bc00 0x7fa698162180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:48.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.413+0000 7fa69659c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fa69806b2f0 0x7fa69806f070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:35424/0 (socket says 172.21.15.53:35424) 2023-06-10T19:07:48.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.413+0000 7fa69659c640 1 -- 172.21.15.53:0/1010687604 learned_addr learned my addr 172.21.15.53:0/1010687604 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:07:48.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.413+0000 7fa695d9b640 1 --2- 172.21.15.53:0/1010687604 >> v2:172.21.15.117:3300/0 conn(0x7fa6980c8d00 0x7fa69806b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:48.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.413+0000 7fa696d9d640 1 -- 172.21.15.53:0/1010687604 >> v2:172.21.15.117:3300/0 conn(0x7fa6980c8d00 msgr2=0x7fa69806b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:48.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.413+0000 7fa696d9d640 1 --2- 172.21.15.53:0/1010687604 >> v2:172.21.15.117:3300/0 conn(0x7fa6980c8d00 0x7fa69806b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:48.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.413+0000 7fa696d9d640 1 -- 172.21.15.53:0/1010687604 >> v1:172.21.15.53:6789/0 conn(0x7fa69806b2f0 legacy=0x7fa69806f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:48.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.413+0000 7fa696d9d640 1 -- 172.21.15.53:0/1010687604 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6980cce10 con 0x7fa69806bc00 2023-06-10T19:07:48.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.413+0000 7fa695d9b640 1 --2- 172.21.15.53:0/1010687604 >> v2:172.21.15.117:3300/0 conn(0x7fa6980c8d00 0x7fa69806b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:07:48.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.413+0000 7fa696d9d640 1 --2- 172.21.15.53:0/1010687604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa69806bc00 0x7fa698162180 secure :-1 s=READY pgs=2503 cs=0 l=1 rev1=1 crypto rx=0x7fa69815c0b0 tx=0x7fa69001f0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=309617e1d99c4277 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:48.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.413+0000 7fa69559a640 1 -- 172.21.15.53:0/1010687604 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6900b0440 con 0x7fa69806bc00 2023-06-10T19:07:48.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.413+0000 7fa69559a640 1 -- 172.21.15.53:0/1010687604 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6900b05a0 con 0x7fa69806bc00 2023-06-10T19:07:48.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.413+0000 7fa69559a640 1 -- 172.21.15.53:0/1010687604 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6900b0930 con 0x7fa69806bc00 2023-06-10T19:07:48.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.413+0000 7fa69c982640 1 -- 172.21.15.53:0/1010687604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa69806bc00 msgr2=0x7fa698162180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:48.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.413+0000 7fa69c982640 1 --2- 172.21.15.53:0/1010687604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa69806bc00 0x7fa698162180 secure :-1 s=READY pgs=2503 cs=0 l=1 rev1=1 crypto rx=0x7fa69815c0b0 tx=0x7fa69001f0f0 comp rx=0 tx=0).stop 2023-06-10T19:07:48.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.413+0000 7fa69c982640 1 -- 172.21.15.53:0/1010687604 shutdown_connections 2023-06-10T19:07:48.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.413+0000 7fa69c982640 1 --2- 172.21.15.53:0/1010687604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa69806bc00 0x7fa698162180 unknown :-1 s=CLOSED pgs=2503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:48.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.413+0000 7fa69c982640 1 --2- 172.21.15.53:0/1010687604 >> v2:172.21.15.117:3300/0 conn(0x7fa6980c8d00 0x7fa69806b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:48.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.413+0000 7fa69c982640 1 -- 172.21.15.53:0/1010687604 >> 172.21.15.53:0/1010687604 conn(0x7fa69806a0d0 msgr2=0x7fa6980ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:48.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.417+0000 7fa69c982640 1 -- 172.21.15.53:0/1010687604 shutdown_connections 2023-06-10T19:07:48.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.417+0000 7fa69c982640 1 -- 172.21.15.53:0/1010687604 wait complete. 2023-06-10T19:07:48.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.417+0000 7fa69c982640 1 Processor -- start 2023-06-10T19:07:48.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.417+0000 7fa69c982640 1 -- start start 2023-06-10T19:07:48.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.417+0000 7fa69c982640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa69806b2f0 0x7fa698155130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:48.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.417+0000 7fa69c982640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa69806bc00 0x7fa6980c1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:48.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.417+0000 7fa69c982640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6980c8d00 0x7fa6980af790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:48.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.417+0000 7fa69c982640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6980c3560 con 0x7fa69806b2f0 2023-06-10T19:07:48.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.417+0000 7fa69c982640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6980c2950 con 0x7fa69806bc00 2023-06-10T19:07:48.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.417+0000 7fa69c982640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6980c2c30 con 0x7fa6980c8d00 2023-06-10T19:07:48.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.417+0000 7fa69659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa69806b2f0 0x7fa698155130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:48.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.417+0000 7fa69659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa69806b2f0 0x7fa698155130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45336/0 (socket says 172.21.15.53:45336) 2023-06-10T19:07:48.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.417+0000 7fa69659c640 1 -- 172.21.15.53:0/2941427474 learned_addr learned my addr 172.21.15.53:0/2941427474 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:48.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.417+0000 7fa696d9d640 1 --2- 172.21.15.53:0/2941427474 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6980c8d00 0x7fa6980af790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:48.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.417+0000 7fa695d9b640 1 --2- 172.21.15.53:0/2941427474 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa69806bc00 0x7fa6980c1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:48.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.417+0000 7fa69659c640 1 -- 172.21.15.53:0/2941427474 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6980c8d00 msgr2=0x7fa6980af790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:48.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.417+0000 7fa69659c640 1 --2- 172.21.15.53:0/2941427474 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6980c8d00 0x7fa6980af790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:48.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.417+0000 7fa69659c640 1 -- 172.21.15.53:0/2941427474 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa69806bc00 msgr2=0x7fa6980c1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:48.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.417+0000 7fa69659c640 1 --2- 172.21.15.53:0/2941427474 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa69806bc00 0x7fa6980c1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:48.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.417+0000 7fa69659c640 1 -- 172.21.15.53:0/2941427474 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa690009a70 con 0x7fa69806b2f0 2023-06-10T19:07:48.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.417+0000 7fa695d9b640 1 --2- 172.21.15.53:0/2941427474 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa69806bc00 0x7fa6980c1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:07:48.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.417+0000 7fa69659c640 1 --2- 172.21.15.53:0/2941427474 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa69806b2f0 0x7fa698155130 secure :-1 s=READY pgs=2504 cs=0 l=1 rev1=1 crypto rx=0x7fa68800c400 tx=0x7fa68800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:48.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.417+0000 7fa686ffd640 1 -- 172.21.15.53:0/2941427474 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa688005cf0 con 0x7fa69806b2f0 2023-06-10T19:07:48.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.417+0000 7fa686ffd640 1 -- 172.21.15.53:0/2941427474 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa688005e50 con 0x7fa69806b2f0 2023-06-10T19:07:48.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.417+0000 7fa69c982640 1 -- 172.21.15.53:0/2941427474 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6980c2f10 con 0x7fa69806b2f0 2023-06-10T19:07:48.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.417+0000 7fa686ffd640 1 -- 172.21.15.53:0/2941427474 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6880072d0 con 0x7fa69806b2f0 2023-06-10T19:07:48.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.417+0000 7fa69c982640 1 -- 172.21.15.53:0/2941427474 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6980b2c80 con 0x7fa69806b2f0 2023-06-10T19:07:48.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.417+0000 7fa69c982640 1 -- 172.21.15.53:0/2941427474 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa69804d790 con 0x7fa69806b2f0 2023-06-10T19:07:48.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.421+0000 7fa686ffd640 1 -- 172.21.15.53:0/2941427474 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa688007430 con 0x7fa69806b2f0 2023-06-10T19:07:48.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.421+0000 7fa686ffd640 1 --2- 172.21.15.53:0/2941427474 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa678066280 0x7fa678068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:48.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.421+0000 7fa686ffd640 1 -- 172.21.15.53:0/2941427474 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6105+0+0 (secure 0 0 0) 0x7fa688083050 con 0x7fa69806b2f0 2023-06-10T19:07:48.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.421+0000 7fa695d9b640 1 --2- 172.21.15.53:0/2941427474 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa678066280 0x7fa678068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:48.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.421+0000 7fa695d9b640 1 --2- 172.21.15.53:0/2941427474 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa678066280 0x7fa678068730 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7fa6981f43d0 tx=0x7fa68c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:48.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.425+0000 7fa686ffd640 1 -- 172.21.15.53:0/2941427474 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa688050550 con 0x7fa69806b2f0 2023-06-10T19:07:48.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.605+0000 7fa69c982640 1 -- 172.21.15.53:0/2941427474 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa698158a70 con 0x7fa69806b2f0 2023-06-10T19:07:48.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.605+0000 7fa686ffd640 1 -- 172.21.15.53:0/2941427474 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 96 v96) v1 ==== 94+0+4685 (secure 0 0 0) 0x7fa688053b70 con 0x7fa69806b2f0 2023-06-10T19:07:48.608 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:07:48.608 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":96,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8614,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3518533956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3518533956},{"type":"v1","addr":"172.21.15.117:6835","nonce":3518533956}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92},{"gid":8617,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/2615123885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2615123885},{"type":"v1","addr":"172.21.15.117:6837","nonce":2615123885}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92},{"gid":10551,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/3498697556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3498697556},{"type":"v1","addr":"172.21.15.53:6833","nonce":3498697556}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92}],"filesystems":[{"mdsmap":{"epoch":96,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:07:15.723316+0000","modified":"2023-06-10T19:07:18.354630+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10557},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10557":{"gid":10557,"name":"c","rank":0,"incarnation":93,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/3721509006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":3721509006},{"type":"v1","addr":"172.21.15.53:6835","nonce":3721509006}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-06-10T19:07:48.609 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 96 2023-06-10T19:07:48.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.605+0000 7fa69c982640 1 -- 172.21.15.53:0/2941427474 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa678066280 msgr2=0x7fa678068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:48.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.605+0000 7fa69c982640 1 --2- 172.21.15.53:0/2941427474 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa678066280 0x7fa678068730 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7fa6981f43d0 tx=0x7fa68c008040 comp rx=0 tx=0).stop 2023-06-10T19:07:48.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.605+0000 7fa69c982640 1 -- 172.21.15.53:0/2941427474 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa69806b2f0 msgr2=0x7fa698155130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:48.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.605+0000 7fa69c982640 1 --2- 172.21.15.53:0/2941427474 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa69806b2f0 0x7fa698155130 secure :-1 s=READY pgs=2504 cs=0 l=1 rev1=1 crypto rx=0x7fa68800c400 tx=0x7fa68800c8c0 comp rx=0 tx=0).stop 2023-06-10T19:07:48.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.605+0000 7fa69c982640 1 -- 172.21.15.53:0/2941427474 shutdown_connections 2023-06-10T19:07:48.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.605+0000 7fa69c982640 1 --2- 172.21.15.53:0/2941427474 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa678066280 0x7fa678068730 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:48.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.605+0000 7fa69c982640 1 --2- 172.21.15.53:0/2941427474 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6980c8d00 0x7fa6980af790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:48.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.605+0000 7fa69c982640 1 --2- 172.21.15.53:0/2941427474 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa69806bc00 0x7fa6980c1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:48.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.605+0000 7fa69c982640 1 --2- 172.21.15.53:0/2941427474 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa69806b2f0 0x7fa698155130 unknown :-1 s=CLOSED pgs=2504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:48.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.605+0000 7fa69c982640 1 -- 172.21.15.53:0/2941427474 >> 172.21.15.53:0/2941427474 conn(0x7fa69806a0d0 msgr2=0x7fa6981e6de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:48.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.605+0000 7fa69c982640 1 -- 172.21.15.53:0/2941427474 shutdown_connections 2023-06-10T19:07:48.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.605+0000 7fa69c982640 1 -- 172.21.15.53:0/2941427474 wait complete. 2023-06-10T19:07:48.627 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:07:48.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.737+0000 7f14df966640 1 Processor -- start 2023-06-10T19:07:48.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.737+0000 7f14df966640 1 -- start start 2023-06-10T19:07:48.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.737+0000 7f14df966640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14d8162640 0x7f14d8164a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:48.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.737+0000 7f14df966640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14d8159b50 con 0x7f14d8071060 2023-06-10T19:07:48.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.737+0000 7f14df966640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14d80702a0 con 0x7f14d80c9840 2023-06-10T19:07:48.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.737+0000 7f14df966640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14d8070580 con 0x7f14d8162640 2023-06-10T19:07:48.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.737+0000 7f14dcf01640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f14d8071060 0x7f14d80af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:35436/0 (socket says 172.21.15.53:35436) 2023-06-10T19:07:48.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.737+0000 7f14dcf01640 1 -- 172.21.15.53:0/1698622151 learned_addr learned my addr 172.21.15.53:0/1698622151 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:07:48.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.737+0000 7f14ddf03640 1 --2- 172.21.15.53:0/1698622151 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14d8162640 0x7f14d8164a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:48.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.737+0000 7f14cffff640 1 -- 172.21.15.53:0/1698622151 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 83853001 0 0) 0x7f14d8159b50 con 0x7f14d8071060 2023-06-10T19:07:48.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.737+0000 7f14cffff640 1 -- 172.21.15.53:0/1698622151 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14c4003530 con 0x7f14d8071060 2023-06-10T19:07:48.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.737+0000 7f14cffff640 1 -- 172.21.15.53:0/1698622151 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4025459688 0 0) 0x7f14c4003530 con 0x7f14d8071060 2023-06-10T19:07:48.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.737+0000 7f14cffff640 1 -- 172.21.15.53:0/1698622151 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14d8162640 msgr2=0x7f14d8164a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:48.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.737+0000 7f14cffff640 1 --2- 172.21.15.53:0/1698622151 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14d8162640 0x7f14d8164a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:48.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.737+0000 7f14cffff640 1 -- 172.21.15.53:0/1698622151 >> v1:172.21.15.117:6789/0 conn(0x7f14d80c9840 legacy=0x7f14d80c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:48.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.737+0000 7f14cffff640 1 -- 172.21.15.53:0/1698622151 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14d8070860 con 0x7f14d8071060 2023-06-10T19:07:48.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.737+0000 7f14cffff640 1 -- 172.21.15.53:0/1698622151 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f14d4001680 con 0x7f14d8071060 2023-06-10T19:07:48.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.737+0000 7f14cffff640 1 -- 172.21.15.53:0/1698622151 >> v1:172.21.15.53:6789/0 conn(0x7f14d8071060 legacy=0x7f14d80af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:48.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.737+0000 7f14cffff640 1 --2- 172.21.15.53:0/1698622151 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14c4003a20 0x7f14c4003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:48.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.737+0000 7f14cffff640 1 --2- 172.21.15.53:0/1698622151 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14d8162640 0x7f14c40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:48.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.737+0000 7f14cffff640 1 --2- 172.21.15.53:0/1698622151 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f14c4004d10 0x7f14c4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:48.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.737+0000 7f14cffff640 1 -- 172.21.15.53:0/1698622151 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d8070580 con 0x7f14c4004d10 2023-06-10T19:07:48.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.737+0000 7f14cffff640 1 -- 172.21.15.53:0/1698622151 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c400baa0 con 0x7f14c4003a20 2023-06-10T19:07:48.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.737+0000 7f14cffff640 1 -- 172.21.15.53:0/1698622151 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14c400bc60 con 0x7f14d8162640 2023-06-10T19:07:48.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.737+0000 7f14ddf03640 1 --2- 172.21.15.53:0/1698622151 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f14c4004d10 0x7f14c4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:48.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.737+0000 7f14dcf01640 1 --2- 172.21.15.53:0/1698622151 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14d8162640 0x7f14c40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:48.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.737+0000 7f14dd702640 1 --2- 172.21.15.53:0/1698622151 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14c4003a20 0x7f14c4003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:48.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.737+0000 7f14ddf03640 1 -- 172.21.15.53:0/1698622151 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14d8162640 msgr2=0x7f14c40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:48.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.737+0000 7f14ddf03640 1 --2- 172.21.15.53:0/1698622151 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14d8162640 0x7f14c40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:48.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.737+0000 7f14ddf03640 1 -- 172.21.15.53:0/1698622151 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14c4003a20 msgr2=0x7f14c4003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:48.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.737+0000 7f14ddf03640 1 --2- 172.21.15.53:0/1698622151 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14c4003a20 0x7f14c4003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:48.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.737+0000 7f14ddf03640 1 -- 172.21.15.53:0/1698622151 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14c4003530 con 0x7f14c4004d10 2023-06-10T19:07:48.747 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.741+0000 7f14ddf03640 1 --2- 172.21.15.53:0/1698622151 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f14c4004d10 0x7f14c4005180 secure :-1 s=READY pgs=2506 cs=0 l=1 rev1=1 crypto rx=0x7f14d815e380 tx=0x7f14d001cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b06a8e4785a7f65 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:48.747 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.741+0000 7f14cffff640 1 -- 172.21.15.53:0/1698622151 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d00a5bd0 con 0x7f14c4004d10 2023-06-10T19:07:48.747 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.741+0000 7f14cffff640 1 -- 172.21.15.53:0/1698622151 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14d000f040 con 0x7f14c4004d10 2023-06-10T19:07:48.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.741+0000 7f14cffff640 1 -- 172.21.15.53:0/1698622151 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d00ad440 con 0x7f14c4004d10 2023-06-10T19:07:48.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.741+0000 7f14df966640 1 -- 172.21.15.53:0/1698622151 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f14c4004d10 msgr2=0x7f14c4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:48.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.741+0000 7f14df966640 1 --2- 172.21.15.53:0/1698622151 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f14c4004d10 0x7f14c4005180 secure :-1 s=READY pgs=2506 cs=0 l=1 rev1=1 crypto rx=0x7f14d815e380 tx=0x7f14d001cbc0 comp rx=0 tx=0).stop 2023-06-10T19:07:48.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.741+0000 7f14ddf03640 1 -- 172.21.15.53:0/1698622151 reap_dead start 2023-06-10T19:07:48.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.741+0000 7f14df966640 1 -- 172.21.15.53:0/1698622151 shutdown_connections 2023-06-10T19:07:48.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.741+0000 7f14df966640 1 -- 172.21.15.53:0/1698622151 >> 172.21.15.53:0/1698622151 conn(0x7f14d806a0d0 msgr2=0x7f14d80ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:48.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.741+0000 7f14df966640 1 -- 172.21.15.53:0/1698622151 shutdown_connections 2023-06-10T19:07:48.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.741+0000 7f14df966640 1 -- 172.21.15.53:0/1698622151 wait complete. 2023-06-10T19:07:48.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.741+0000 7f14df966640 1 Processor -- start 2023-06-10T19:07:48.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.741+0000 7f14df966640 1 -- start start 2023-06-10T19:07:48.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.741+0000 7f14df966640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14d80b33c0 0x7f14d815b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:48.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.741+0000 7f14df966640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f14d80cd600 0x7f14d815bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:48.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.741+0000 7f14df966640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14d80af110 0x7f14d815c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:48.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.741+0000 7f14df966640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d8152a20 con 0x7f14d80cd600 2023-06-10T19:07:48.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.741+0000 7f14df966640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d80cd1e0 con 0x7f14d80b33c0 2023-06-10T19:07:48.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.741+0000 7f14df966640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14d80cc280 con 0x7f14d80af110 2023-06-10T19:07:48.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.741+0000 7f14dcf01640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f14d80cd600 0x7f14d815bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:48.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.741+0000 7f14dcf01640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f14d80cd600 0x7f14d815bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45358/0 (socket says 172.21.15.53:45358) 2023-06-10T19:07:48.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.741+0000 7f14dcf01640 1 -- 172.21.15.53:0/2920353457 learned_addr learned my addr 172.21.15.53:0/2920353457 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:48.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.741+0000 7f14dd702640 1 --2- 172.21.15.53:0/2920353457 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14d80b33c0 0x7f14d815b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:48.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.741+0000 7f14ddf03640 1 --2- 172.21.15.53:0/2920353457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14d80af110 0x7f14d815c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:48.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.741+0000 7f14dcf01640 1 -- 172.21.15.53:0/2920353457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14d80af110 msgr2=0x7f14d815c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:48.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.741+0000 7f14dcf01640 1 --2- 172.21.15.53:0/2920353457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14d80af110 0x7f14d815c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:48.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.741+0000 7f14dcf01640 1 -- 172.21.15.53:0/2920353457 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14d80b33c0 msgr2=0x7f14d815b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:48.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.741+0000 7f14dcf01640 1 --2- 172.21.15.53:0/2920353457 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14d80b33c0 0x7f14d815b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:48.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.741+0000 7f14dcf01640 1 -- 172.21.15.53:0/2920353457 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14d80cc560 con 0x7f14d80cd600 2023-06-10T19:07:48.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.745+0000 7f14dd702640 1 --2- 172.21.15.53:0/2920353457 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14d80b33c0 0x7f14d815b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:07:48.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.745+0000 7f14dcf01640 1 --2- 172.21.15.53:0/2920353457 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f14d80cd600 0x7f14d815bcd0 secure :-1 s=READY pgs=2507 cs=0 l=1 rev1=1 crypto rx=0x7f14d400eb20 tx=0x7f14d4005e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:48.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.745+0000 7f14cdffb640 1 -- 172.21.15.53:0/2920353457 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d4001680 con 0x7f14d80cd600 2023-06-10T19:07:48.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.745+0000 7f14cdffb640 1 -- 172.21.15.53:0/2920353457 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14d400c8d0 con 0x7f14d80cd600 2023-06-10T19:07:48.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.745+0000 7f14df966640 1 -- 172.21.15.53:0/2920353457 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14d80cc840 con 0x7f14d80cd600 2023-06-10T19:07:48.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.745+0000 7f14cdffb640 1 -- 172.21.15.53:0/2920353457 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d400cc60 con 0x7f14d80cd600 2023-06-10T19:07:48.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.745+0000 7f14df966640 1 -- 172.21.15.53:0/2920353457 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14d80cce00 con 0x7f14d80cd600 2023-06-10T19:07:48.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.745+0000 7f14df966640 1 -- 172.21.15.53:0/2920353457 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14d80cd320 con 0x7f14d80cd600 2023-06-10T19:07:48.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.745+0000 7f14cdffb640 1 -- 172.21.15.53:0/2920353457 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f14d401d460 con 0x7f14d80cd600 2023-06-10T19:07:48.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.745+0000 7f14cdffb640 1 --2- 172.21.15.53:0/2920353457 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f14bc066280 0x7f14bc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:48.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.745+0000 7f14cdffb640 1 -- 172.21.15.53:0/2920353457 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6105+0+0 (secure 0 0 0) 0x7f14d4083d70 con 0x7f14d80cd600 2023-06-10T19:07:48.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.745+0000 7f14dd702640 1 --2- 172.21.15.53:0/2920353457 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f14bc066280 0x7f14bc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:48.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.745+0000 7f14dd702640 1 --2- 172.21.15.53:0/2920353457 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f14bc066280 0x7f14bc068730 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f14c80016e0 tx=0x7f14c8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:48.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.749+0000 7f14cdffb640 1 -- 172.21.15.53:0/2920353457 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f14d80cd320 con 0x7f14d80cd600 2023-06-10T19:07:48.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.905+0000 7f14df966640 1 -- 172.21.15.53:0/2920353457 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f14d80cd320 con 0x7f14d80cd600 2023-06-10T19:07:48.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.909+0000 7f14cdffb640 1 -- 172.21.15.53:0/2920353457 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v168) v1 ==== 74+0+18341 (secure 0 0 0) 0x7f14d80cd320 con 0x7f14d80cd600 2023-06-10T19:07:48.912 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:07:48.912 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":168,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:07:38.149577+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-06-10T19:07:13.365954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"166","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-06-10T19:07:14.695077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.0.1:0/4011987522":"2023-06-10T20:07:37.768015+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:07:48.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.909+0000 7f14df966640 1 -- 172.21.15.53:0/2920353457 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f14bc066280 msgr2=0x7f14bc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:48.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.909+0000 7f14df966640 1 --2- 172.21.15.53:0/2920353457 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f14bc066280 0x7f14bc068730 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f14c80016e0 tx=0x7f14c8009040 comp rx=0 tx=0).stop 2023-06-10T19:07:48.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.909+0000 7f14df966640 1 -- 172.21.15.53:0/2920353457 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f14d80cd600 msgr2=0x7f14d815bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:48.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.909+0000 7f14df966640 1 --2- 172.21.15.53:0/2920353457 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f14d80cd600 0x7f14d815bcd0 secure :-1 s=READY pgs=2507 cs=0 l=1 rev1=1 crypto rx=0x7f14d400eb20 tx=0x7f14d4005e20 comp rx=0 tx=0).stop 2023-06-10T19:07:48.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.909+0000 7f14df966640 1 -- 172.21.15.53:0/2920353457 shutdown_connections 2023-06-10T19:07:48.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.909+0000 7f14df966640 1 --2- 172.21.15.53:0/2920353457 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f14bc066280 0x7f14bc068730 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:48.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.909+0000 7f14df966640 1 --2- 172.21.15.53:0/2920353457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14d80af110 0x7f14d815c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:48.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.909+0000 7f14df966640 1 --2- 172.21.15.53:0/2920353457 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f14d80cd600 0x7f14d815bcd0 unknown :-1 s=CLOSED pgs=2507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:48.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.909+0000 7f14df966640 1 --2- 172.21.15.53:0/2920353457 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14d80b33c0 0x7f14d815b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:48.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.909+0000 7f14df966640 1 -- 172.21.15.53:0/2920353457 >> 172.21.15.53:0/2920353457 conn(0x7f14d806a0d0 msgr2=0x7f14d80cda80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:48.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.909+0000 7f14df966640 1 -- 172.21.15.53:0/2920353457 shutdown_connections 2023-06-10T19:07:48.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:48.909+0000 7f14df966640 1 -- 172.21.15.53:0/2920353457 wait complete. 2023-06-10T19:07:48.930 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-10T18:52:33.633114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-10T18:52:39.171487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 23, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-10T19:07:13.365954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '166', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 24, 'pool_name': 'cephfs_data', 'create_time': '2023-06-10T19:07:14.695077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '167', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-10T19:07:48.931 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-10T19:07:49.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.045+0000 7fd24939e640 1 Processor -- start 2023-06-10T19:07:49.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.045+0000 7fd24939e640 1 -- start start 2023-06-10T19:07:49.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.049+0000 7fd24939e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd24415c090 0x7fd2440b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:49.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.049+0000 7fd24939e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd2440b0b90 0x7fd2440b7720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:49.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.049+0000 7fd24939e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2440cc7c0 con 0x7fd2440b7c60 2023-06-10T19:07:49.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.049+0000 7fd24939e640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2440b80e0 con 0x7fd24415c090 2023-06-10T19:07:49.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.049+0000 7fd24939e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2440ccaa0 con 0x7fd2440b0b90 2023-06-10T19:07:49.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.049+0000 7fd242ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd24415c090 0x7fd2440b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:49.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.049+0000 7fd242ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd24415c090 0x7fd2440b10c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45374/0 (socket says 172.21.15.53:45374) 2023-06-10T19:07:49.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.049+0000 7fd242ffd640 1 -- 172.21.15.53:0/2164736101 learned_addr learned my addr 172.21.15.53:0/2164736101 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:49.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.049+0000 7fd242ffd640 1 -- 172.21.15.53:0/2164736101 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd2440b0b90 msgr2=0x7fd2440b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:49.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.049+0000 7fd23bfff640 1 --2- 172.21.15.53:0/2164736101 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd2440b0b90 0x7fd2440b7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:49.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.049+0000 7fd242ffd640 1 --2- 172.21.15.53:0/2164736101 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd2440b0b90 0x7fd2440b7720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:49.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.049+0000 7fd242ffd640 1 -- 172.21.15.53:0/2164736101 >> v1:172.21.15.117:6789/0 conn(0x7fd2440b7c60 legacy=0x7fd2440b3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:49.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.049+0000 7fd242ffd640 1 -- 172.21.15.53:0/2164736101 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2440ccd80 con 0x7fd24415c090 2023-06-10T19:07:49.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.049+0000 7fd23bfff640 1 --2- 172.21.15.53:0/2164736101 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd2440b0b90 0x7fd2440b7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:07:49.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.049+0000 7fd242ffd640 1 --2- 172.21.15.53:0/2164736101 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd24415c090 0x7fd2440b10c0 secure :-1 s=READY pgs=2508 cs=0 l=1 rev1=1 crypto rx=0x7fd234009870 tx=0x7fd23401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e02564fbed9feb0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:49.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.049+0000 7fd2427fc640 1 -- 172.21.15.53:0/2164736101 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2340ab600 con 0x7fd24415c090 2023-06-10T19:07:49.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.049+0000 7fd2427fc640 1 -- 172.21.15.53:0/2164736101 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2340a7050 con 0x7fd24415c090 2023-06-10T19:07:49.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.049+0000 7fd2427fc640 1 -- 172.21.15.53:0/2164736101 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2340ab980 con 0x7fd24415c090 2023-06-10T19:07:49.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.049+0000 7fd24939e640 1 -- 172.21.15.53:0/2164736101 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd24415c090 msgr2=0x7fd2440b10c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:49.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.049+0000 7fd24939e640 1 --2- 172.21.15.53:0/2164736101 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd24415c090 0x7fd2440b10c0 secure :-1 s=READY pgs=2508 cs=0 l=1 rev1=1 crypto rx=0x7fd234009870 tx=0x7fd23401c440 comp rx=0 tx=0).stop 2023-06-10T19:07:49.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.049+0000 7fd24939e640 1 -- 172.21.15.53:0/2164736101 shutdown_connections 2023-06-10T19:07:49.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.049+0000 7fd24939e640 1 --2- 172.21.15.53:0/2164736101 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd2440b0b90 0x7fd2440b7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:49.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.049+0000 7fd24939e640 1 --2- 172.21.15.53:0/2164736101 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd24415c090 0x7fd2440b10c0 unknown :-1 s=CLOSED pgs=2508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:49.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.049+0000 7fd24939e640 1 -- 172.21.15.53:0/2164736101 >> 172.21.15.53:0/2164736101 conn(0x7fd244069e20 msgr2=0x7fd24406a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:49.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.049+0000 7fd24939e640 1 -- 172.21.15.53:0/2164736101 shutdown_connections 2023-06-10T19:07:49.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.049+0000 7fd24939e640 1 -- 172.21.15.53:0/2164736101 wait complete. 2023-06-10T19:07:49.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.053+0000 7fd24939e640 1 Processor -- start 2023-06-10T19:07:49.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.053+0000 7fd24939e640 1 -- start start 2023-06-10T19:07:49.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.053+0000 7fd24939e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd2440b0b90 0x7fd2440c91a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:49.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.053+0000 7fd24939e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd2440b7c60 0x7fd24414d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:49.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.053+0000 7fd24939e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd24415c090 0x7fd24414ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:49.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.053+0000 7fd24939e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2441508f0 con 0x7fd24415c090 2023-06-10T19:07:49.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.053+0000 7fd24939e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd244156bb0 con 0x7fd2440b7c60 2023-06-10T19:07:49.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.053+0000 7fd24939e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd244156e90 con 0x7fd2440b0b90 2023-06-10T19:07:49.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.053+0000 7fd2437fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd24415c090 0x7fd24414ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:49.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.053+0000 7fd2437fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd24415c090 0x7fd24414ff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45378/0 (socket says 172.21.15.53:45378) 2023-06-10T19:07:49.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.053+0000 7fd2437fe640 1 -- 172.21.15.53:0/3854562176 learned_addr learned my addr 172.21.15.53:0/3854562176 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:49.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.053+0000 7fd242ffd640 1 --2- 172.21.15.53:0/3854562176 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd2440b0b90 0x7fd2440c91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:49.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.053+0000 7fd23bfff640 1 --2- 172.21.15.53:0/3854562176 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd2440b7c60 0x7fd24414d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:49.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.053+0000 7fd2437fe640 1 -- 172.21.15.53:0/3854562176 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd2440b0b90 msgr2=0x7fd2440c91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:49.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.053+0000 7fd2437fe640 1 --2- 172.21.15.53:0/3854562176 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd2440b0b90 0x7fd2440c91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:49.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.053+0000 7fd2437fe640 1 -- 172.21.15.53:0/3854562176 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd2440b7c60 msgr2=0x7fd24414d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:49.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.053+0000 7fd2437fe640 1 --2- 172.21.15.53:0/3854562176 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd2440b7c60 0x7fd24414d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:49.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.053+0000 7fd2437fe640 1 -- 172.21.15.53:0/3854562176 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2340094d0 con 0x7fd24415c090 2023-06-10T19:07:49.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.053+0000 7fd2437fe640 1 --2- 172.21.15.53:0/3854562176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd24415c090 0x7fd24414ff10 secure :-1 s=READY pgs=2509 cs=0 l=1 rev1=1 crypto rx=0x7fd23c00c780 tx=0x7fd23c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:49.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.053+0000 7fd23b7fe640 1 -- 172.21.15.53:0/3854562176 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23c004b70 con 0x7fd24415c090 2023-06-10T19:07:49.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.053+0000 7fd23b7fe640 1 -- 172.21.15.53:0/3854562176 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd23c00ce90 con 0x7fd24415c090 2023-06-10T19:07:49.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.053+0000 7fd24939e640 1 -- 172.21.15.53:0/3854562176 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd244157170 con 0x7fd24415c090 2023-06-10T19:07:49.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.053+0000 7fd23b7fe640 1 -- 172.21.15.53:0/3854562176 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23c00a850 con 0x7fd24415c090 2023-06-10T19:07:49.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.053+0000 7fd24939e640 1 -- 172.21.15.53:0/3854562176 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd244150450 con 0x7fd24415c090 2023-06-10T19:07:49.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.053+0000 7fd24939e640 1 -- 172.21.15.53:0/3854562176 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd244150670 con 0x7fd24415c090 2023-06-10T19:07:49.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.057+0000 7fd23b7fe640 1 -- 172.21.15.53:0/3854562176 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd23c00a9b0 con 0x7fd24415c090 2023-06-10T19:07:49.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.057+0000 7fd23b7fe640 1 --2- 172.21.15.53:0/3854562176 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd2240662b0 0x7fd224068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:49.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.057+0000 7fd23b7fe640 1 -- 172.21.15.53:0/3854562176 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6105+0+0 (secure 0 0 0) 0x7fd23c083f70 con 0x7fd24415c090 2023-06-10T19:07:49.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.057+0000 7fd242ffd640 1 --2- 172.21.15.53:0/3854562176 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd2240662b0 0x7fd224068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:49.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.057+0000 7fd242ffd640 1 --2- 172.21.15.53:0/3854562176 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd2240662b0 0x7fd224068760 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fd2340ad000 tx=0x7fd234008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:49.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.061+0000 7fd23b7fe640 1 -- 172.21.15.53:0/3854562176 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd23c0b4700 con 0x7fd24415c090 2023-06-10T19:07:49.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.209+0000 7fd24939e640 1 -- 172.21.15.53:0/3854562176 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd24404d790 con 0x7fd24415c090 2023-06-10T19:07:49.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.209+0000 7fd23b7fe640 1 -- 172.21.15.53:0/3854562176 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v168) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd23c054dc0 con 0x7fd24415c090 2023-06-10T19:07:49.212 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-06-10T19:07:49.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.209+0000 7fd24939e640 1 -- 172.21.15.53:0/3854562176 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd2240662b0 msgr2=0x7fd224068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:49.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.209+0000 7fd24939e640 1 --2- 172.21.15.53:0/3854562176 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd2240662b0 0x7fd224068760 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fd2340ad000 tx=0x7fd234008040 comp rx=0 tx=0).stop 2023-06-10T19:07:49.214 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.209+0000 7fd24939e640 1 -- 172.21.15.53:0/3854562176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd24415c090 msgr2=0x7fd24414ff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:49.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.209+0000 7fd24939e640 1 --2- 172.21.15.53:0/3854562176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd24415c090 0x7fd24414ff10 secure :-1 s=READY pgs=2509 cs=0 l=1 rev1=1 crypto rx=0x7fd23c00c780 tx=0x7fd23c00cc40 comp rx=0 tx=0).stop 2023-06-10T19:07:49.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.213+0000 7fd24939e640 1 -- 172.21.15.53:0/3854562176 shutdown_connections 2023-06-10T19:07:49.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.213+0000 7fd24939e640 1 --2- 172.21.15.53:0/3854562176 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd2240662b0 0x7fd224068760 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:49.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.213+0000 7fd24939e640 1 --2- 172.21.15.53:0/3854562176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd24415c090 0x7fd24414ff10 unknown :-1 s=CLOSED pgs=2509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:49.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.213+0000 7fd24939e640 1 --2- 172.21.15.53:0/3854562176 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd2440b7c60 0x7fd24414d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:49.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.213+0000 7fd24939e640 1 --2- 172.21.15.53:0/3854562176 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd2440b0b90 0x7fd2440c91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:49.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.213+0000 7fd24939e640 1 -- 172.21.15.53:0/3854562176 >> 172.21.15.53:0/3854562176 conn(0x7fd244069e20 msgr2=0x7fd244152360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:49.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.213+0000 7fd24939e640 1 -- 172.21.15.53:0/3854562176 shutdown_connections 2023-06-10T19:07:49.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.213+0000 7fd24939e640 1 -- 172.21.15.53:0/3854562176 wait complete. 2023-06-10T19:07:49.231 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-10T19:07:49.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.345+0000 7ff7b6e30640 1 Processor -- start 2023-06-10T19:07:49.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.345+0000 7ff7b6e30640 1 -- start start 2023-06-10T19:07:49.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.349+0000 7ff7b6e30640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff7b006c400 0x7ff7b0157fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:49.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.349+0000 7ff7b6e30640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff7b00ccc90 0x7ff7b00cd130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:49.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.349+0000 7ff7b6e30640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7b015c260 con 0x7ff7b006c7d0 2023-06-10T19:07:49.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.349+0000 7ff7b6e30640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7b015cee0 con 0x7ff7b00ccc90 2023-06-10T19:07:49.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.349+0000 7ff7b6e30640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7b015c540 con 0x7ff7b006c400 2023-06-10T19:07:49.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.349+0000 7ff7affff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ff7b006c7d0 0x7ff7b0158520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:35452/0 (socket says 172.21.15.53:35452) 2023-06-10T19:07:49.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.349+0000 7ff7affff640 1 -- 172.21.15.53:0/865261267 learned_addr learned my addr 172.21.15.53:0/865261267 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:07:49.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.349+0000 7ff7b53cd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff7b00ccc90 0x7ff7b00cd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:49.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.349+0000 7ff7b4bcc640 1 --2- 172.21.15.53:0/865261267 >> v2:172.21.15.117:3300/0 conn(0x7ff7b006c400 0x7ff7b0157fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:49.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.349+0000 7ff7b53cd640 1 -- 172.21.15.53:0/865261267 >> v2:172.21.15.117:3300/0 conn(0x7ff7b006c400 msgr2=0x7ff7b0157fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:49.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.349+0000 7ff7b53cd640 1 --2- 172.21.15.53:0/865261267 >> v2:172.21.15.117:3300/0 conn(0x7ff7b006c400 0x7ff7b0157fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:49.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.349+0000 7ff7b53cd640 1 -- 172.21.15.53:0/865261267 >> v1:172.21.15.53:6789/0 conn(0x7ff7b006c7d0 legacy=0x7ff7b0158520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:49.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.349+0000 7ff7b53cd640 1 -- 172.21.15.53:0/865261267 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7b015c820 con 0x7ff7b00ccc90 2023-06-10T19:07:49.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.349+0000 7ff7b53cd640 1 --2- 172.21.15.53:0/865261267 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff7b00ccc90 0x7ff7b00cd130 secure :-1 s=READY pgs=2511 cs=0 l=1 rev1=1 crypto rx=0x7ff7b00b1910 tx=0x7ff7a801c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4d9bfe954290ec2 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:49.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.349+0000 7ff7af7fe640 1 -- 172.21.15.53:0/865261267 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a80a6640 con 0x7ff7b00ccc90 2023-06-10T19:07:49.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.353+0000 7ff7af7fe640 1 -- 172.21.15.53:0/865261267 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7a80a67a0 con 0x7ff7b00ccc90 2023-06-10T19:07:49.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.353+0000 7ff7af7fe640 1 -- 172.21.15.53:0/865261267 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a80a6b30 con 0x7ff7b00ccc90 2023-06-10T19:07:49.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.353+0000 7ff7b6e30640 1 -- 172.21.15.53:0/865261267 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff7b00ccc90 msgr2=0x7ff7b00cd130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:49.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.353+0000 7ff7b6e30640 1 --2- 172.21.15.53:0/865261267 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff7b00ccc90 0x7ff7b00cd130 secure :-1 s=READY pgs=2511 cs=0 l=1 rev1=1 crypto rx=0x7ff7b00b1910 tx=0x7ff7a801c6e0 comp rx=0 tx=0).stop 2023-06-10T19:07:49.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.353+0000 7ff7b6e30640 1 -- 172.21.15.53:0/865261267 shutdown_connections 2023-06-10T19:07:49.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.353+0000 7ff7b6e30640 1 --2- 172.21.15.53:0/865261267 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff7b00ccc90 0x7ff7b00cd130 unknown :-1 s=CLOSED pgs=2511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:49.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.353+0000 7ff7b6e30640 1 --2- 172.21.15.53:0/865261267 >> v2:172.21.15.117:3300/0 conn(0x7ff7b006c400 0x7ff7b0157fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:49.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.353+0000 7ff7b6e30640 1 -- 172.21.15.53:0/865261267 >> 172.21.15.53:0/865261267 conn(0x7ff7b006a560 msgr2=0x7ff7b006a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:49.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.353+0000 7ff7b6e30640 1 -- 172.21.15.53:0/865261267 shutdown_connections 2023-06-10T19:07:49.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.353+0000 7ff7b6e30640 1 -- 172.21.15.53:0/865261267 wait complete. 2023-06-10T19:07:49.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.353+0000 7ff7b6e30640 1 Processor -- start 2023-06-10T19:07:49.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.353+0000 7ff7b6e30640 1 -- start start 2023-06-10T19:07:49.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.353+0000 7ff7b6e30640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7b006c400 0x7ff7b00c4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:49.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.353+0000 7ff7b6e30640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff7b006c7d0 0x7ff7b00c51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:49.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.353+0000 7ff7b6e30640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7b00ccc90 0x7ff7b01508a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:49.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.353+0000 7ff7b6e30640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b00c6090 con 0x7ff7b006c7d0 2023-06-10T19:07:49.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.353+0000 7ff7b6e30640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b00b1be0 con 0x7ff7b006c400 2023-06-10T19:07:49.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.353+0000 7ff7b6e30640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b00b0ac0 con 0x7ff7b00ccc90 2023-06-10T19:07:49.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.353+0000 7ff7affff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff7b006c7d0 0x7ff7b00c51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:49.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.353+0000 7ff7affff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff7b006c7d0 0x7ff7b00c51f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45394/0 (socket says 172.21.15.53:45394) 2023-06-10T19:07:49.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.353+0000 7ff7affff640 1 -- 172.21.15.53:0/2362957524 learned_addr learned my addr 172.21.15.53:0/2362957524 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:49.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.353+0000 7ff7b53cd640 1 --2- 172.21.15.53:0/2362957524 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7b00ccc90 0x7ff7b01508a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:49.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.353+0000 7ff7b4bcc640 1 --2- 172.21.15.53:0/2362957524 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7b006c400 0x7ff7b00c4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:49.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.353+0000 7ff7affff640 1 -- 172.21.15.53:0/2362957524 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7b00ccc90 msgr2=0x7ff7b01508a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:49.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.353+0000 7ff7affff640 1 --2- 172.21.15.53:0/2362957524 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7b00ccc90 0x7ff7b01508a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:49.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.353+0000 7ff7affff640 1 -- 172.21.15.53:0/2362957524 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7b006c400 msgr2=0x7ff7b00c4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:49.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.353+0000 7ff7affff640 1 --2- 172.21.15.53:0/2362957524 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7b006c400 0x7ff7b00c4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:49.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.353+0000 7ff7affff640 1 -- 172.21.15.53:0/2362957524 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7a8009a70 con 0x7ff7b006c7d0 2023-06-10T19:07:49.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.353+0000 7ff7b53cd640 1 --2- 172.21.15.53:0/2362957524 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7b00ccc90 0x7ff7b01508a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:07:49.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.353+0000 7ff7affff640 1 --2- 172.21.15.53:0/2362957524 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff7b006c7d0 0x7ff7b00c51f0 secure :-1 s=READY pgs=2512 cs=0 l=1 rev1=1 crypto rx=0x7ff7a400c780 tx=0x7ff7a400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:49.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.353+0000 7ff7ad7fa640 1 -- 172.21.15.53:0/2362957524 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a40074e0 con 0x7ff7b006c7d0 2023-06-10T19:07:49.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.353+0000 7ff7ad7fa640 1 -- 172.21.15.53:0/2362957524 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7a4007640 con 0x7ff7b006c7d0 2023-06-10T19:07:49.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.353+0000 7ff7b6e30640 1 -- 172.21.15.53:0/2362957524 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7b00b0da0 con 0x7ff7b006c7d0 2023-06-10T19:07:49.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.353+0000 7ff7ad7fa640 1 -- 172.21.15.53:0/2362957524 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a4004a30 con 0x7ff7b006c7d0 2023-06-10T19:07:49.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.353+0000 7ff7b6e30640 1 -- 172.21.15.53:0/2362957524 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7b00b1360 con 0x7ff7b006c7d0 2023-06-10T19:07:49.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.357+0000 7ff7b6e30640 1 -- 172.21.15.53:0/2362957524 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7b004d790 con 0x7ff7b006c7d0 2023-06-10T19:07:49.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.357+0000 7ff7ad7fa640 1 -- 172.21.15.53:0/2362957524 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff7a4004b90 con 0x7ff7b006c7d0 2023-06-10T19:07:49.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.357+0000 7ff7ad7fa640 1 --2- 172.21.15.53:0/2362957524 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff79c066280 0x7ff79c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:49.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.357+0000 7ff7ad7fa640 1 -- 172.21.15.53:0/2362957524 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6105+0+0 (secure 0 0 0) 0x7ff7a4083250 con 0x7ff7b006c7d0 2023-06-10T19:07:49.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.357+0000 7ff7b4bcc640 1 --2- 172.21.15.53:0/2362957524 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff79c066280 0x7ff79c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:49.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.357+0000 7ff7b4bcc640 1 --2- 172.21.15.53:0/2362957524 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff79c066280 0x7ff79c068730 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7ff7b00cbbc0 tx=0x7ff7a0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:49.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.361+0000 7ff7ad7fa640 1 -- 172.21.15.53:0/2362957524 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff7a4050690 con 0x7ff7b006c7d0 2023-06-10T19:07:49.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.509+0000 7ff7b6e30640 1 -- 172.21.15.53:0/2362957524 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff7b00b1d20 con 0x7ff7b006c7d0 2023-06-10T19:07:49.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.509+0000 7ff7ad7fa640 1 -- 172.21.15.53:0/2362957524 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v168) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff7a4053cb0 con 0x7ff7b006c7d0 2023-06-10T19:07:49.513 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-06-10T19:07:49.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.513+0000 7ff7b6e30640 1 -- 172.21.15.53:0/2362957524 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff79c066280 msgr2=0x7ff79c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:49.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.513+0000 7ff7b6e30640 1 --2- 172.21.15.53:0/2362957524 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff79c066280 0x7ff79c068730 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7ff7b00cbbc0 tx=0x7ff7a0008040 comp rx=0 tx=0).stop 2023-06-10T19:07:49.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.513+0000 7ff7b6e30640 1 -- 172.21.15.53:0/2362957524 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff7b006c7d0 msgr2=0x7ff7b00c51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:49.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.513+0000 7ff7b6e30640 1 --2- 172.21.15.53:0/2362957524 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff7b006c7d0 0x7ff7b00c51f0 secure :-1 s=READY pgs=2512 cs=0 l=1 rev1=1 crypto rx=0x7ff7a400c780 tx=0x7ff7a400cc40 comp rx=0 tx=0).stop 2023-06-10T19:07:49.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.513+0000 7ff7b6e30640 1 -- 172.21.15.53:0/2362957524 shutdown_connections 2023-06-10T19:07:49.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.513+0000 7ff7b6e30640 1 --2- 172.21.15.53:0/2362957524 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff79c066280 0x7ff79c068730 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:49.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.513+0000 7ff7b6e30640 1 --2- 172.21.15.53:0/2362957524 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff7b00ccc90 0x7ff7b01508a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:49.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.513+0000 7ff7b6e30640 1 --2- 172.21.15.53:0/2362957524 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff7b006c7d0 0x7ff7b00c51f0 unknown :-1 s=CLOSED pgs=2512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:49.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.513+0000 7ff7b6e30640 1 --2- 172.21.15.53:0/2362957524 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7b006c400 0x7ff7b00c4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:49.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.513+0000 7ff7b6e30640 1 -- 172.21.15.53:0/2362957524 >> 172.21.15.53:0/2362957524 conn(0x7ff7b006a560 msgr2=0x7ff7b0151dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:49.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.513+0000 7ff7b6e30640 1 -- 172.21.15.53:0/2362957524 shutdown_connections 2023-06-10T19:07:49.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.513+0000 7ff7b6e30640 1 -- 172.21.15.53:0/2362957524 wait complete. 2023-06-10T19:07:49.532 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-10T19:07:49.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.653+0000 7f3ff8e7e640 1 Processor -- start 2023-06-10T19:07:49.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.657+0000 7f3ff8e7e640 1 -- start start 2023-06-10T19:07:49.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.657+0000 7f3ff8e7e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ff4159450 0x7f3ff415d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:49.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.657+0000 7f3ff8e7e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3ff415d680 0x7f3ff40cec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:49.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.657+0000 7f3ff8e7e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ff40cbac0 con 0x7f3ff40cf180 2023-06-10T19:07:49.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.657+0000 7f3ff8e7e640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ff40cf600 con 0x7f3ff415d680 2023-06-10T19:07:49.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.657+0000 7f3ff8e7e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff415dc00 con 0x7f3ff4159450 2023-06-10T19:07:49.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.657+0000 7f3febfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3ff415d680 0x7f3ff40cec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:49.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.657+0000 7f3febfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3ff415d680 0x7f3ff40cec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45400/0 (socket says 172.21.15.53:45400) 2023-06-10T19:07:49.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.657+0000 7f3febfff640 1 -- 172.21.15.53:0/2037550831 learned_addr learned my addr 172.21.15.53:0/2037550831 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:49.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.657+0000 7f3ff259c640 1 --2- 172.21.15.53:0/2037550831 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ff4159450 0x7f3ff415d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:49.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.657+0000 7f3febfff640 1 -- 172.21.15.53:0/2037550831 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ff4159450 msgr2=0x7f3ff415d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:49.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.657+0000 7f3febfff640 1 --2- 172.21.15.53:0/2037550831 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ff4159450 0x7f3ff415d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:49.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.657+0000 7f3febfff640 1 -- 172.21.15.53:0/2037550831 >> v1:172.21.15.117:6789/0 conn(0x7f3ff40cf180 legacy=0x7f3ff40cda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:49.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.657+0000 7f3febfff640 1 -- 172.21.15.53:0/2037550831 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ff415dee0 con 0x7f3ff415d680 2023-06-10T19:07:49.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.657+0000 7f3febfff640 1 --2- 172.21.15.53:0/2037550831 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ff415d680 0x7f3ff40cec40 secure :-1 s=READY pgs=2513 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc009870 tx=0x7f3fdc01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65e29352e4e37e19 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:49.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.657+0000 7f3ff1d9b640 1 -- 172.21.15.53:0/2037550831 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc0ac620 con 0x7f3ff415d680 2023-06-10T19:07:49.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.657+0000 7f3ff1d9b640 1 -- 172.21.15.53:0/2037550831 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fdc0ac780 con 0x7f3ff415d680 2023-06-10T19:07:49.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.657+0000 7f3ff1d9b640 1 -- 172.21.15.53:0/2037550831 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc0acb10 con 0x7f3ff415d680 2023-06-10T19:07:49.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.661+0000 7f3ff8e7e640 1 -- 172.21.15.53:0/2037550831 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ff415d680 msgr2=0x7f3ff40cec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:49.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.661+0000 7f3ff8e7e640 1 --2- 172.21.15.53:0/2037550831 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ff415d680 0x7f3ff40cec40 secure :-1 s=READY pgs=2513 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc009870 tx=0x7f3fdc01c440 comp rx=0 tx=0).stop 2023-06-10T19:07:49.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.661+0000 7f3ff8e7e640 1 -- 172.21.15.53:0/2037550831 shutdown_connections 2023-06-10T19:07:49.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.661+0000 7f3ff8e7e640 1 --2- 172.21.15.53:0/2037550831 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ff415d680 0x7f3ff40cec40 unknown :-1 s=CLOSED pgs=2513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:49.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.661+0000 7f3ff8e7e640 1 --2- 172.21.15.53:0/2037550831 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ff4159450 0x7f3ff415d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:49.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.661+0000 7f3ff8e7e640 1 -- 172.21.15.53:0/2037550831 >> 172.21.15.53:0/2037550831 conn(0x7f3ff406a090 msgr2=0x7f3ff406d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:49.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.661+0000 7f3ff8e7e640 1 -- 172.21.15.53:0/2037550831 shutdown_connections 2023-06-10T19:07:49.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.661+0000 7f3ff8e7e640 1 -- 172.21.15.53:0/2037550831 wait complete. 2023-06-10T19:07:49.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.661+0000 7f3ff8e7e640 1 Processor -- start 2023-06-10T19:07:49.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.661+0000 7f3ff8e7e640 1 -- start start 2023-06-10T19:07:49.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.661+0000 7f3ff8e7e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ff40cf180 0x7f3ff415c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:49.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.661+0000 7f3ff8e7e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ff4159450 0x7f3ff40b4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:49.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.661+0000 7f3ff8e7e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ff415d680 0x7f3ff4163a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:49.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.661+0000 7f3ff8e7e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff415afd0 con 0x7f3ff4159450 2023-06-10T19:07:49.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.661+0000 7f3ff8e7e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff415b2b0 con 0x7f3ff415d680 2023-06-10T19:07:49.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.661+0000 7f3ff8e7e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff415b590 con 0x7f3ff40cf180 2023-06-10T19:07:49.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.661+0000 7f3febfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ff4159450 0x7f3ff40b4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:49.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.661+0000 7f3febfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ff4159450 0x7f3ff40b4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45406/0 (socket says 172.21.15.53:45406) 2023-06-10T19:07:49.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.661+0000 7f3febfff640 1 -- 172.21.15.53:0/1846832424 learned_addr learned my addr 172.21.15.53:0/1846832424 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:49.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.661+0000 7f3ff259c640 1 --2- 172.21.15.53:0/1846832424 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ff40cf180 0x7f3ff415c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:49.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.661+0000 7f3ff2d9d640 1 --2- 172.21.15.53:0/1846832424 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ff415d680 0x7f3ff4163a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:49.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.661+0000 7f3febfff640 1 -- 172.21.15.53:0/1846832424 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ff40cf180 msgr2=0x7f3ff415c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:49.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.661+0000 7f3febfff640 1 --2- 172.21.15.53:0/1846832424 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ff40cf180 0x7f3ff415c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:49.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.661+0000 7f3febfff640 1 -- 172.21.15.53:0/1846832424 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ff415d680 msgr2=0x7f3ff4163a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:49.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.661+0000 7f3febfff640 1 --2- 172.21.15.53:0/1846832424 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ff415d680 0x7f3ff4163a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:49.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.661+0000 7f3febfff640 1 -- 172.21.15.53:0/1846832424 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fdc0094d0 con 0x7f3ff4159450 2023-06-10T19:07:49.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.661+0000 7f3febfff640 1 --2- 172.21.15.53:0/1846832424 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ff4159450 0x7f3ff40b4750 secure :-1 s=READY pgs=2514 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc0af040 tx=0x7f3fdc01ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:49.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.661+0000 7f3feaffd640 1 -- 172.21.15.53:0/1846832424 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc0b7620 con 0x7f3ff4159450 2023-06-10T19:07:49.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.661+0000 7f3feaffd640 1 -- 172.21.15.53:0/1846832424 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fdc0b77a0 con 0x7f3ff4159450 2023-06-10T19:07:49.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.661+0000 7f3ff8e7e640 1 -- 172.21.15.53:0/1846832424 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ff415b870 con 0x7f3ff4159450 2023-06-10T19:07:49.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.661+0000 7f3feaffd640 1 -- 172.21.15.53:0/1846832424 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc0b7b50 con 0x7f3ff4159450 2023-06-10T19:07:49.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.661+0000 7f3ff8e7e640 1 -- 172.21.15.53:0/1846832424 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ff415be30 con 0x7f3ff4159450 2023-06-10T19:07:49.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.665+0000 7f3ff8e7e640 1 -- 172.21.15.53:0/1846832424 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ff415c020 con 0x7f3ff4159450 2023-06-10T19:07:49.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.665+0000 7f3feaffd640 1 -- 172.21.15.53:0/1846832424 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3fdc0b3040 con 0x7f3ff4159450 2023-06-10T19:07:49.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.665+0000 7f3feaffd640 1 --2- 172.21.15.53:0/1846832424 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3fd4066280 0x7f3fd4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:49.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.665+0000 7f3feaffd640 1 -- 172.21.15.53:0/1846832424 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6105+0+0 (secure 0 0 0) 0x7f3fdc11e2c0 con 0x7f3ff4159450 2023-06-10T19:07:49.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.665+0000 7f3ff259c640 1 --2- 172.21.15.53:0/1846832424 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3fd4066280 0x7f3fd4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:49.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.665+0000 7f3ff259c640 1 --2- 172.21.15.53:0/1846832424 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3fd4066280 0x7f3fd4068730 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f3fe40096f0 tx=0x7f3fe4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:49.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.669+0000 7f3feaffd640 1 -- 172.21.15.53:0/1846832424 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3fdc0eb720 con 0x7f3ff4159450 2023-06-10T19:07:49.817 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.813+0000 7f3ff8e7e640 1 -- 172.21.15.53:0/1846832424 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3ff404d790 con 0x7f3ff4159450 2023-06-10T19:07:49.818 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.817+0000 7f3feaffd640 1 -- 172.21.15.53:0/1846832424 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v168) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3fdc0ac5e0 con 0x7f3ff4159450 2023-06-10T19:07:49.818 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-06-10T19:07:49.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.817+0000 7f3ff8e7e640 1 -- 172.21.15.53:0/1846832424 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3fd4066280 msgr2=0x7f3fd4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:49.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.817+0000 7f3ff8e7e640 1 --2- 172.21.15.53:0/1846832424 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3fd4066280 0x7f3fd4068730 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f3fe40096f0 tx=0x7f3fe4008040 comp rx=0 tx=0).stop 2023-06-10T19:07:49.820 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.817+0000 7f3ff8e7e640 1 -- 172.21.15.53:0/1846832424 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ff4159450 msgr2=0x7f3ff40b4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:49.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.817+0000 7f3ff8e7e640 1 --2- 172.21.15.53:0/1846832424 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ff4159450 0x7f3ff40b4750 secure :-1 s=READY pgs=2514 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc0af040 tx=0x7f3fdc01ac80 comp rx=0 tx=0).stop 2023-06-10T19:07:49.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.817+0000 7f3ff8e7e640 1 -- 172.21.15.53:0/1846832424 shutdown_connections 2023-06-10T19:07:49.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.817+0000 7f3ff8e7e640 1 --2- 172.21.15.53:0/1846832424 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3fd4066280 0x7f3fd4068730 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:49.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.817+0000 7f3ff8e7e640 1 --2- 172.21.15.53:0/1846832424 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ff415d680 0x7f3ff4163a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:49.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.817+0000 7f3ff8e7e640 1 --2- 172.21.15.53:0/1846832424 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ff4159450 0x7f3ff40b4750 unknown :-1 s=CLOSED pgs=2514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:49.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.817+0000 7f3ff8e7e640 1 --2- 172.21.15.53:0/1846832424 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ff40cf180 0x7f3ff415c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:49.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.817+0000 7f3ff8e7e640 1 -- 172.21.15.53:0/1846832424 >> 172.21.15.53:0/1846832424 conn(0x7f3ff406a090 msgr2=0x7f3ff40b2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:49.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.817+0000 7f3ff8e7e640 1 -- 172.21.15.53:0/1846832424 shutdown_connections 2023-06-10T19:07:49.822 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.817+0000 7f3ff8e7e640 1 -- 172.21.15.53:0/1846832424 wait complete. 2023-06-10T19:07:49.836 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-10T19:07:49.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.961+0000 7fc372070640 1 Processor -- start 2023-06-10T19:07:49.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.961+0000 7fc372070640 1 -- start start 2023-06-10T19:07:49.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.961+0000 7fc372070640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc36c0c82a0 0x7fc36c0c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:49.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.961+0000 7fc372070640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc36c0af760 0x7fc36c0afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:49.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.961+0000 7fc372070640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc36c06b090 con 0x7fc36c0c9fa0 2023-06-10T19:07:49.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.961+0000 7fc372070640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc36c0b0120 con 0x7fc36c0af760 2023-06-10T19:07:49.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.961+0000 7fc372070640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc36c0ca370 con 0x7fc36c0c82a0 2023-06-10T19:07:49.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.961+0000 7fc36bfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc36c0af760 0x7fc36c0afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:49.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.961+0000 7fc36bfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc36c0af760 0x7fc36c0afbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45420/0 (socket says 172.21.15.53:45420) 2023-06-10T19:07:49.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.961+0000 7fc36bfff640 1 -- 172.21.15.53:0/843748874 learned_addr learned my addr 172.21.15.53:0/843748874 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:49.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.961+0000 7fc36affd640 1 --2- 172.21.15.53:0/843748874 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc36c0c82a0 0x7fc36c0c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:49.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.961+0000 7fc36bfff640 1 -- 172.21.15.53:0/843748874 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc36c0c82a0 msgr2=0x7fc36c0c86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:49.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.961+0000 7fc36bfff640 1 --2- 172.21.15.53:0/843748874 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc36c0c82a0 0x7fc36c0c86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:49.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.961+0000 7fc36bfff640 1 -- 172.21.15.53:0/843748874 >> v1:172.21.15.117:6789/0 conn(0x7fc36c0c9fa0 legacy=0x7fc36c06bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:49.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.961+0000 7fc36bfff640 1 -- 172.21.15.53:0/843748874 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc36c070d50 con 0x7fc36c0af760 2023-06-10T19:07:49.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.965+0000 7fc36bfff640 1 --2- 172.21.15.53:0/843748874 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc36c0af760 0x7fc36c0afbe0 secure :-1 s=READY pgs=2515 cs=0 l=1 rev1=1 crypto rx=0x7fc364009e50 tx=0x7fc36401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f97ce43907036c8 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:49.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.965+0000 7fc36a7fc640 1 -- 172.21.15.53:0/843748874 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3640a5810 con 0x7fc36c0af760 2023-06-10T19:07:49.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.965+0000 7fc36a7fc640 1 -- 172.21.15.53:0/843748874 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3640a5970 con 0x7fc36c0af760 2023-06-10T19:07:49.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.965+0000 7fc36a7fc640 1 -- 172.21.15.53:0/843748874 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3640a5d00 con 0x7fc36c0af760 2023-06-10T19:07:49.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.965+0000 7fc372070640 1 -- 172.21.15.53:0/843748874 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc36c0af760 msgr2=0x7fc36c0afbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:49.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.965+0000 7fc372070640 1 --2- 172.21.15.53:0/843748874 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc36c0af760 0x7fc36c0afbe0 secure :-1 s=READY pgs=2515 cs=0 l=1 rev1=1 crypto rx=0x7fc364009e50 tx=0x7fc36401c950 comp rx=0 tx=0).stop 2023-06-10T19:07:49.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.965+0000 7fc372070640 1 -- 172.21.15.53:0/843748874 shutdown_connections 2023-06-10T19:07:49.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.965+0000 7fc372070640 1 --2- 172.21.15.53:0/843748874 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc36c0af760 0x7fc36c0afbe0 unknown :-1 s=CLOSED pgs=2515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:49.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.965+0000 7fc372070640 1 --2- 172.21.15.53:0/843748874 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc36c0c82a0 0x7fc36c0c86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:49.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.965+0000 7fc372070640 1 -- 172.21.15.53:0/843748874 >> 172.21.15.53:0/843748874 conn(0x7fc36c06a0e0 msgr2=0x7fc36c0cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:49.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.965+0000 7fc372070640 1 -- 172.21.15.53:0/843748874 shutdown_connections 2023-06-10T19:07:49.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.965+0000 7fc372070640 1 -- 172.21.15.53:0/843748874 wait complete. 2023-06-10T19:07:49.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.965+0000 7fc372070640 1 Processor -- start 2023-06-10T19:07:49.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.965+0000 7fc372070640 1 -- start start 2023-06-10T19:07:49.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.965+0000 7fc372070640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc36c0af760 0x7fc36c0c5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:49.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.965+0000 7fc372070640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc36c0c82a0 0x7fc36c0cd160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:49.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.965+0000 7fc372070640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc36c0c9fa0 0x7fc36c156980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:49.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.965+0000 7fc372070640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc36c0c6840 con 0x7fc36c0c9fa0 2023-06-10T19:07:49.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.965+0000 7fc372070640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc36c0c6b20 con 0x7fc36c0c82a0 2023-06-10T19:07:49.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.965+0000 7fc372070640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc36c0c6e00 con 0x7fc36c0af760 2023-06-10T19:07:49.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.965+0000 7fc36bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc36c0c9fa0 0x7fc36c156980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:49.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.965+0000 7fc36bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc36c0c9fa0 0x7fc36c156980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45428/0 (socket says 172.21.15.53:45428) 2023-06-10T19:07:49.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.965+0000 7fc36bfff640 1 -- 172.21.15.53:0/4225383049 learned_addr learned my addr 172.21.15.53:0/4225383049 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:49.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.965+0000 7fc36b7fe640 1 --2- 172.21.15.53:0/4225383049 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc36c0af760 0x7fc36c0c5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:49.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.965+0000 7fc36affd640 1 --2- 172.21.15.53:0/4225383049 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc36c0c82a0 0x7fc36c0cd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:49.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.969+0000 7fc36bfff640 1 -- 172.21.15.53:0/4225383049 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc36c0af760 msgr2=0x7fc36c0c5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:49.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.969+0000 7fc36bfff640 1 --2- 172.21.15.53:0/4225383049 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc36c0af760 0x7fc36c0c5ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:49.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.969+0000 7fc36bfff640 1 -- 172.21.15.53:0/4225383049 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc36c0c82a0 msgr2=0x7fc36c0cd160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:49.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.969+0000 7fc36bfff640 1 --2- 172.21.15.53:0/4225383049 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc36c0c82a0 0x7fc36c0cd160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:49.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.969+0000 7fc36bfff640 1 -- 172.21.15.53:0/4225383049 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc364009b30 con 0x7fc36c0c9fa0 2023-06-10T19:07:49.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.969+0000 7fc36bfff640 1 --2- 172.21.15.53:0/4225383049 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc36c0c9fa0 0x7fc36c156980 secure :-1 s=READY pgs=2516 cs=0 l=1 rev1=1 crypto rx=0x7fc36401a580 tx=0x7fc3640196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:49.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.969+0000 7fc353fff640 1 -- 172.21.15.53:0/4225383049 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3640b8670 con 0x7fc36c0c9fa0 2023-06-10T19:07:49.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.969+0000 7fc353fff640 1 -- 172.21.15.53:0/4225383049 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3640b87d0 con 0x7fc36c0c9fa0 2023-06-10T19:07:49.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.969+0000 7fc372070640 1 -- 172.21.15.53:0/4225383049 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc36c162ff0 con 0x7fc36c0c9fa0 2023-06-10T19:07:49.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.969+0000 7fc353fff640 1 -- 172.21.15.53:0/4225383049 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3640b8b40 con 0x7fc36c0c9fa0 2023-06-10T19:07:49.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.969+0000 7fc372070640 1 -- 172.21.15.53:0/4225383049 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc36c162ca0 con 0x7fc36c0c9fa0 2023-06-10T19:07:49.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.969+0000 7fc372070640 1 -- 172.21.15.53:0/4225383049 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc36c162e30 con 0x7fc36c0c9fa0 2023-06-10T19:07:49.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.969+0000 7fc353fff640 1 -- 172.21.15.53:0/4225383049 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc3640b8ca0 con 0x7fc36c0c9fa0 2023-06-10T19:07:49.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.969+0000 7fc353fff640 1 --2- 172.21.15.53:0/4225383049 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc358066280 0x7fc358068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:49.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.969+0000 7fc353fff640 1 -- 172.21.15.53:0/4225383049 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6105+0+0 (secure 0 0 0) 0x7fc36411f400 con 0x7fc36c0c9fa0 2023-06-10T19:07:49.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.969+0000 7fc36b7fe640 1 --2- 172.21.15.53:0/4225383049 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc358066280 0x7fc358068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:49.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.969+0000 7fc36b7fe640 1 --2- 172.21.15.53:0/4225383049 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc358066280 0x7fc358068730 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fc35c0015b0 tx=0x7fc35c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:49.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:49.973+0000 7fc353fff640 1 -- 172.21.15.53:0/4225383049 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc3640ec850 con 0x7fc36c0c9fa0 2023-06-10T19:07:50.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.125+0000 7fc372070640 1 -- 172.21.15.53:0/4225383049 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc36c1631e0 con 0x7fc36c0c9fa0 2023-06-10T19:07:50.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.129+0000 7fc353fff640 1 -- 172.21.15.53:0/4225383049 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v168) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc3640efe70 con 0x7fc36c0c9fa0 2023-06-10T19:07:50.131 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-06-10T19:07:50.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.129+0000 7fc372070640 1 -- 172.21.15.53:0/4225383049 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc358066280 msgr2=0x7fc358068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:50.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.129+0000 7fc372070640 1 --2- 172.21.15.53:0/4225383049 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc358066280 0x7fc358068730 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fc35c0015b0 tx=0x7fc35c009040 comp rx=0 tx=0).stop 2023-06-10T19:07:50.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.129+0000 7fc372070640 1 -- 172.21.15.53:0/4225383049 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc36c0c9fa0 msgr2=0x7fc36c156980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:50.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.129+0000 7fc372070640 1 --2- 172.21.15.53:0/4225383049 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc36c0c9fa0 0x7fc36c156980 secure :-1 s=READY pgs=2516 cs=0 l=1 rev1=1 crypto rx=0x7fc36401a580 tx=0x7fc3640196f0 comp rx=0 tx=0).stop 2023-06-10T19:07:50.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.129+0000 7fc372070640 1 -- 172.21.15.53:0/4225383049 shutdown_connections 2023-06-10T19:07:50.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.129+0000 7fc372070640 1 --2- 172.21.15.53:0/4225383049 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc358066280 0x7fc358068730 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:50.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.129+0000 7fc372070640 1 --2- 172.21.15.53:0/4225383049 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc36c0c9fa0 0x7fc36c156980 unknown :-1 s=CLOSED pgs=2516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:50.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.129+0000 7fc372070640 1 --2- 172.21.15.53:0/4225383049 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc36c0c82a0 0x7fc36c0cd160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:50.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.129+0000 7fc372070640 1 --2- 172.21.15.53:0/4225383049 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc36c0af760 0x7fc36c0c5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:50.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.129+0000 7fc372070640 1 -- 172.21.15.53:0/4225383049 >> 172.21.15.53:0/4225383049 conn(0x7fc36c06a0e0 msgr2=0x7fc36c0b2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:50.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.129+0000 7fc372070640 1 -- 172.21.15.53:0/4225383049 shutdown_connections 2023-06-10T19:07:50.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.129+0000 7fc372070640 1 -- 172.21.15.53:0/4225383049 wait complete. 2023-06-10T19:07:50.151 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:07:50.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.273+0000 7f654520c640 1 Processor -- start 2023-06-10T19:07:50.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.273+0000 7f654520c640 1 -- start start 2023-06-10T19:07:50.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.277+0000 7f654520c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65400cec40 0x7f65400cf090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:50.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.277+0000 7f654520c640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65400cf5d0 con 0x7f65400cbf50 2023-06-10T19:07:50.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.277+0000 7f654520c640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65400cbac0 con 0x7f6540159450 2023-06-10T19:07:50.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.277+0000 7f654520c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f654015dc00 con 0x7f65400cec40 2023-06-10T19:07:50.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.277+0000 7f653f59e640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f65400cbf50 0x7f65400cc3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:35454/0 (socket says 172.21.15.53:35454) 2023-06-10T19:07:50.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.277+0000 7f653f59e640 1 -- 172.21.15.53:0/58755835 learned_addr learned my addr 172.21.15.53:0/58755835 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:07:50.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.277+0000 7f653e59c640 1 --2- 172.21.15.53:0/58755835 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65400cec40 0x7f65400cf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:50.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.277+0000 7f653dd9b640 1 -- 172.21.15.53:0/58755835 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 568296531 0 0) 0x7f65380014a0 con 0x7f65400cbf50 2023-06-10T19:07:50.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.277+0000 7f653dd9b640 1 -- 172.21.15.53:0/58755835 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6528003530 con 0x7f65400cbf50 2023-06-10T19:07:50.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.277+0000 7f653dd9b640 1 -- 172.21.15.53:0/58755835 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3053215687 0 0) 0x7f6528003530 con 0x7f65400cbf50 2023-06-10T19:07:50.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.277+0000 7f653dd9b640 1 -- 172.21.15.53:0/58755835 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65400cec40 msgr2=0x7f65400cf090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:50.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.277+0000 7f653dd9b640 1 --2- 172.21.15.53:0/58755835 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65400cec40 0x7f65400cf090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:50.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.277+0000 7f653dd9b640 1 -- 172.21.15.53:0/58755835 >> v1:172.21.15.117:6789/0 conn(0x7f6540159450 legacy=0x7f654015d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:50.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.277+0000 7f653dd9b640 1 -- 172.21.15.53:0/58755835 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f654015dee0 con 0x7f65400cbf50 2023-06-10T19:07:50.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.277+0000 7f653dd9b640 1 -- 172.21.15.53:0/58755835 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f6538001b90 con 0x7f65400cbf50 2023-06-10T19:07:50.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.277+0000 7f653dd9b640 1 -- 172.21.15.53:0/58755835 >> v1:172.21.15.53:6789/0 conn(0x7f65400cbf50 legacy=0x7f65400cc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:50.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.277+0000 7f653dd9b640 1 --2- 172.21.15.53:0/58755835 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65400cec40 0x7f6528003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:50.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.277+0000 7f653dd9b640 1 --2- 172.21.15.53:0/58755835 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6528003fa0 0x7f65280047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:50.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.277+0000 7f653dd9b640 1 --2- 172.21.15.53:0/58755835 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6528004d10 0x7f6528005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:50.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.277+0000 7f653dd9b640 1 -- 172.21.15.53:0/58755835 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f654015dc00 con 0x7f6528004d10 2023-06-10T19:07:50.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.277+0000 7f653dd9b640 1 -- 172.21.15.53:0/58755835 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f652800bad0 con 0x7f6528003fa0 2023-06-10T19:07:50.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.277+0000 7f653dd9b640 1 -- 172.21.15.53:0/58755835 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f652800bc90 con 0x7f65400cec40 2023-06-10T19:07:50.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.277+0000 7f653f59e640 1 --2- 172.21.15.53:0/58755835 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6528004d10 0x7f6528005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:50.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.277+0000 7f653ed9d640 1 --2- 172.21.15.53:0/58755835 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65400cec40 0x7f6528003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:50.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.277+0000 7f653e59c640 1 --2- 172.21.15.53:0/58755835 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6528003fa0 0x7f65280047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:50.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.277+0000 7f653f59e640 1 -- 172.21.15.53:0/58755835 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65400cec40 msgr2=0x7f6528003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:50.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.277+0000 7f653f59e640 1 --2- 172.21.15.53:0/58755835 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65400cec40 0x7f6528003a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:50.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.277+0000 7f653f59e640 1 -- 172.21.15.53:0/58755835 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6528003fa0 msgr2=0x7f65280047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:50.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.277+0000 7f653f59e640 1 --2- 172.21.15.53:0/58755835 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6528003fa0 0x7f65280047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:50.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.277+0000 7f653f59e640 1 -- 172.21.15.53:0/58755835 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6528003530 con 0x7f6528004d10 2023-06-10T19:07:50.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.277+0000 7f653e59c640 1 --2- 172.21.15.53:0/58755835 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6528003fa0 0x7f65280047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:07:50.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.281+0000 7f653f59e640 1 --2- 172.21.15.53:0/58755835 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6528004d10 0x7f6528005180 secure :-1 s=READY pgs=2518 cs=0 l=1 rev1=1 crypto rx=0x7f653800a830 tx=0x7f653801d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b530190bfcbb2883 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:50.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.281+0000 7f653dd9b640 1 -- 172.21.15.53:0/58755835 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65380ad630 con 0x7f6528004d10 2023-06-10T19:07:50.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.281+0000 7f653dd9b640 1 -- 172.21.15.53:0/58755835 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65380a8070 con 0x7f6528004d10 2023-06-10T19:07:50.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.281+0000 7f653dd9b640 1 -- 172.21.15.53:0/58755835 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65380ada30 con 0x7f6528004d10 2023-06-10T19:07:50.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.281+0000 7f654520c640 1 -- 172.21.15.53:0/58755835 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6528004d10 msgr2=0x7f6528005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:50.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.281+0000 7f654520c640 1 --2- 172.21.15.53:0/58755835 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6528004d10 0x7f6528005180 secure :-1 s=READY pgs=2518 cs=0 l=1 rev1=1 crypto rx=0x7f653800a830 tx=0x7f653801d340 comp rx=0 tx=0).stop 2023-06-10T19:07:50.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.281+0000 7f653f59e640 1 -- 172.21.15.53:0/58755835 reap_dead start 2023-06-10T19:07:50.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.281+0000 7f654520c640 1 -- 172.21.15.53:0/58755835 shutdown_connections 2023-06-10T19:07:50.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.281+0000 7f654520c640 1 -- 172.21.15.53:0/58755835 >> 172.21.15.53:0/58755835 conn(0x7f654006a090 msgr2=0x7f654006d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:50.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.281+0000 7f654520c640 1 -- 172.21.15.53:0/58755835 shutdown_connections 2023-06-10T19:07:50.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.281+0000 7f654520c640 1 -- 172.21.15.53:0/58755835 wait complete. 2023-06-10T19:07:50.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.281+0000 7f654520c640 1 Processor -- start 2023-06-10T19:07:50.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.281+0000 7f654520c640 1 -- start start 2023-06-10T19:07:50.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.281+0000 7f654520c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6528004d10 0x7f654006af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:50.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.281+0000 7f654520c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65400ac1e0 0x7f65400adc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:50.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.281+0000 7f654520c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65400ae1c0 0x7f65400ae660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:50.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.281+0000 7f654520c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65401f0d60 con 0x7f6528004d10 2023-06-10T19:07:50.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.281+0000 7f654520c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65400aeba0 con 0x7f65400ac1e0 2023-06-10T19:07:50.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.281+0000 7f654520c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65400c7960 con 0x7f65400ae1c0 2023-06-10T19:07:50.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.281+0000 7f653ed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6528004d10 0x7f654006af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:50.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.281+0000 7f653ed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6528004d10 0x7f654006af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45450/0 (socket says 172.21.15.53:45450) 2023-06-10T19:07:50.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.281+0000 7f653ed9d640 1 -- 172.21.15.53:0/1842512197 learned_addr learned my addr 172.21.15.53:0/1842512197 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:50.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.281+0000 7f653f59e640 1 --2- 172.21.15.53:0/1842512197 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65400ae1c0 0x7f65400ae660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:50.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.281+0000 7f653e59c640 1 --2- 172.21.15.53:0/1842512197 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65400ac1e0 0x7f65400adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:50.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.281+0000 7f653ed9d640 1 -- 172.21.15.53:0/1842512197 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65400ae1c0 msgr2=0x7f65400ae660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:50.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.281+0000 7f653ed9d640 1 --2- 172.21.15.53:0/1842512197 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65400ae1c0 0x7f65400ae660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:50.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.281+0000 7f653ed9d640 1 -- 172.21.15.53:0/1842512197 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65400ac1e0 msgr2=0x7f65400adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:50.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.281+0000 7f653ed9d640 1 --2- 172.21.15.53:0/1842512197 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65400ac1e0 0x7f65400adc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:50.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.281+0000 7f653ed9d640 1 -- 172.21.15.53:0/1842512197 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f654006b550 con 0x7f6528004d10 2023-06-10T19:07:50.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.285+0000 7f653ed9d640 1 --2- 172.21.15.53:0/1842512197 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6528004d10 0x7f654006af70 secure :-1 s=READY pgs=2519 cs=0 l=1 rev1=1 crypto rx=0x7f653400f7f0 tx=0x7f653400fcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:50.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.285+0000 7f65277fe640 1 -- 172.21.15.53:0/1842512197 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65340050d0 con 0x7f6528004d10 2023-06-10T19:07:50.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.285+0000 7f65277fe640 1 -- 172.21.15.53:0/1842512197 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6534005230 con 0x7f6528004d10 2023-06-10T19:07:50.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.285+0000 7f654520c640 1 -- 172.21.15.53:0/1842512197 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f654006b830 con 0x7f6528004d10 2023-06-10T19:07:50.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.285+0000 7f65277fe640 1 -- 172.21.15.53:0/1842512197 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f653400d730 con 0x7f6528004d10 2023-06-10T19:07:50.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.285+0000 7f654520c640 1 -- 172.21.15.53:0/1842512197 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f654006bdf0 con 0x7f6528004d10 2023-06-10T19:07:50.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.285+0000 7f654520c640 1 -- 172.21.15.53:0/1842512197 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65400c7af0 con 0x7f6528004d10 2023-06-10T19:07:50.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.285+0000 7f65277fe640 1 -- 172.21.15.53:0/1842512197 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f653400d890 con 0x7f6528004d10 2023-06-10T19:07:50.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.285+0000 7f65277fe640 1 --2- 172.21.15.53:0/1842512197 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f652c066280 0x7f652c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:50.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.285+0000 7f65277fe640 1 -- 172.21.15.53:0/1842512197 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6105+0+0 (secure 0 0 0) 0x7f6534083d10 con 0x7f6528004d10 2023-06-10T19:07:50.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.285+0000 7f653e59c640 1 --2- 172.21.15.53:0/1842512197 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f652c066280 0x7f652c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:50.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.285+0000 7f653e59c640 1 --2- 172.21.15.53:0/1842512197 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f652c066280 0x7f652c068730 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f65400c74f0 tx=0x7f6530008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:50.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.289+0000 7f65277fe640 1 -- 172.21.15.53:0/1842512197 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f65400c7af0 con 0x7f6528004d10 2023-06-10T19:07:50.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.481+0000 7f654520c640 1 -- 172.21.15.53:0/1842512197 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f65400c7aa0 con 0x7f6528004d10 2023-06-10T19:07:50.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.481+0000 7f65277fe640 1 -- 172.21.15.53:0/1842512197 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 96 v96) v1 ==== 94+0+4685 (secure 0 0 0) 0x7f6534051160 con 0x7f6528004d10 2023-06-10T19:07:50.483 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:07:50.484 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":96,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8614,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3518533956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3518533956},{"type":"v1","addr":"172.21.15.117:6835","nonce":3518533956}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92},{"gid":8617,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/2615123885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2615123885},{"type":"v1","addr":"172.21.15.117:6837","nonce":2615123885}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92},{"gid":10551,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/3498697556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3498697556},{"type":"v1","addr":"172.21.15.53:6833","nonce":3498697556}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92}],"filesystems":[{"mdsmap":{"epoch":96,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:07:15.723316+0000","modified":"2023-06-10T19:07:18.354630+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10557},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10557":{"gid":10557,"name":"c","rank":0,"incarnation":93,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/3721509006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":3721509006},{"type":"v1","addr":"172.21.15.53:6835","nonce":3721509006}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-06-10T19:07:50.484 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 96 2023-06-10T19:07:50.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.481+0000 7f654520c640 1 -- 172.21.15.53:0/1842512197 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f652c066280 msgr2=0x7f652c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:50.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.481+0000 7f654520c640 1 --2- 172.21.15.53:0/1842512197 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f652c066280 0x7f652c068730 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f65400c74f0 tx=0x7f6530008040 comp rx=0 tx=0).stop 2023-06-10T19:07:50.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.481+0000 7f654520c640 1 -- 172.21.15.53:0/1842512197 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6528004d10 msgr2=0x7f654006af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:50.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.481+0000 7f654520c640 1 --2- 172.21.15.53:0/1842512197 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6528004d10 0x7f654006af70 secure :-1 s=READY pgs=2519 cs=0 l=1 rev1=1 crypto rx=0x7f653400f7f0 tx=0x7f653400fcb0 comp rx=0 tx=0).stop 2023-06-10T19:07:50.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.481+0000 7f654520c640 1 -- 172.21.15.53:0/1842512197 shutdown_connections 2023-06-10T19:07:50.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.481+0000 7f654520c640 1 --2- 172.21.15.53:0/1842512197 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f652c066280 0x7f652c068730 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:50.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.481+0000 7f654520c640 1 --2- 172.21.15.53:0/1842512197 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65400ae1c0 0x7f65400ae660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:50.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.481+0000 7f654520c640 1 --2- 172.21.15.53:0/1842512197 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65400ac1e0 0x7f65400adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:50.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.481+0000 7f654520c640 1 --2- 172.21.15.53:0/1842512197 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6528004d10 0x7f654006af70 unknown :-1 s=CLOSED pgs=2519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:50.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.481+0000 7f654520c640 1 -- 172.21.15.53:0/1842512197 >> 172.21.15.53:0/1842512197 conn(0x7f654006a090 msgr2=0x7f65401577d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:50.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.481+0000 7f654520c640 1 -- 172.21.15.53:0/1842512197 shutdown_connections 2023-06-10T19:07:50.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.481+0000 7f654520c640 1 -- 172.21.15.53:0/1842512197 wait complete. 2023-06-10T19:07:50.502 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:07:50.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.621+0000 7f576e09b640 1 Processor -- start 2023-06-10T19:07:50.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.621+0000 7f576e09b640 1 -- start start 2023-06-10T19:07:50.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.621+0000 7f576e09b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f576815c810 0x7f57680cd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:50.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.621+0000 7f576e09b640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57680cc6c0 con 0x7f57680cbfc0 2023-06-10T19:07:50.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.621+0000 7f576e09b640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57680cc9a0 con 0x7f576815ba70 2023-06-10T19:07:50.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.621+0000 7f576e09b640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57680ccc80 con 0x7f576815c810 2023-06-10T19:07:50.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.621+0000 7f5766ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f576815c810 0x7f57680cd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:50.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.621+0000 7f5767fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f57680cbfc0 0x7f576806efc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:35464/0 (socket says 172.21.15.53:35464) 2023-06-10T19:07:50.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.621+0000 7f5767fff640 1 -- 172.21.15.53:0/1261354460 learned_addr learned my addr 172.21.15.53:0/1261354460 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:07:50.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.621+0000 7f5766ffd640 1 -- 172.21.15.53:0/1261354460 >> v1:172.21.15.117:6789/0 conn(0x7f576815ba70 legacy=0x7f576815c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:50.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.621+0000 7f5766ffd640 1 -- 172.21.15.53:0/1261354460 >> v1:172.21.15.53:6789/0 conn(0x7f57680cbfc0 legacy=0x7f576806efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:50.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.621+0000 7f57667fc640 1 -- 172.21.15.53:0/1261354460 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1080257547 0 0) 0x7f57680cc6c0 con 0x7f57680cbfc0 2023-06-10T19:07:50.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.621+0000 7f5766ffd640 1 -- 172.21.15.53:0/1261354460 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57680ccf60 con 0x7f576815c810 2023-06-10T19:07:50.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.625+0000 7f5766ffd640 1 --2- 172.21.15.53:0/1261354460 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f576815c810 0x7f57680cd760 secure :-1 s=READY pgs=2521 cs=0 l=1 rev1=1 crypto rx=0x7f575c0097c0 tx=0x7f575c01c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6010750630f031 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:50.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.625+0000 7f57667fc640 1 -- 172.21.15.53:0/1261354460 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575c0ad660 con 0x7f576815c810 2023-06-10T19:07:50.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.625+0000 7f57667fc640 1 -- 172.21.15.53:0/1261354460 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f575c0ad7c0 con 0x7f576815c810 2023-06-10T19:07:50.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.625+0000 7f57667fc640 1 -- 172.21.15.53:0/1261354460 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575c0adb50 con 0x7f576815c810 2023-06-10T19:07:50.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.625+0000 7f576e09b640 1 -- 172.21.15.53:0/1261354460 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f576815c810 msgr2=0x7f57680cd760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:50.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.625+0000 7f576e09b640 1 --2- 172.21.15.53:0/1261354460 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f576815c810 0x7f57680cd760 secure :-1 s=READY pgs=2521 cs=0 l=1 rev1=1 crypto rx=0x7f575c0097c0 tx=0x7f575c01c380 comp rx=0 tx=0).stop 2023-06-10T19:07:50.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.625+0000 7f576e09b640 1 -- 172.21.15.53:0/1261354460 shutdown_connections 2023-06-10T19:07:50.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.625+0000 7f576e09b640 1 --2- 172.21.15.53:0/1261354460 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f576815c810 0x7f57680cd760 unknown :-1 s=CLOSED pgs=2521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:50.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.625+0000 7f576e09b640 1 -- 172.21.15.53:0/1261354460 >> 172.21.15.53:0/1261354460 conn(0x7f576806a0d0 msgr2=0x7f57680ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:50.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.625+0000 7f576e09b640 1 -- 172.21.15.53:0/1261354460 shutdown_connections 2023-06-10T19:07:50.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.625+0000 7f576e09b640 1 -- 172.21.15.53:0/1261354460 wait complete. 2023-06-10T19:07:50.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.625+0000 7f576e09b640 1 Processor -- start 2023-06-10T19:07:50.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.625+0000 7f576e09b640 1 -- start start 2023-06-10T19:07:50.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.625+0000 7f576e09b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57680cbfc0 0x7f5768150960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:50.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.625+0000 7f576e09b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f576815ba70 0x7f576815a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:50.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.625+0000 7f576e09b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f576815c810 0x7f576814e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:50.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.625+0000 7f576e09b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5768150540 con 0x7f576815ba70 2023-06-10T19:07:50.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.625+0000 7f576e09b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5768150ea0 con 0x7f576815c810 2023-06-10T19:07:50.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.625+0000 7f576e09b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f576814fbc0 con 0x7f57680cbfc0 2023-06-10T19:07:50.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.625+0000 7f5766ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f576815ba70 0x7f576815a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:50.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.629+0000 7f5766ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f576815ba70 0x7f576815a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45466/0 (socket says 172.21.15.53:45466) 2023-06-10T19:07:50.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.629+0000 7f5766ffd640 1 -- 172.21.15.53:0/1324589870 learned_addr learned my addr 172.21.15.53:0/1324589870 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:50.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.629+0000 7f57677fe640 1 --2- 172.21.15.53:0/1324589870 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57680cbfc0 0x7f5768150960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:50.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.629+0000 7f5767fff640 1 --2- 172.21.15.53:0/1324589870 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f576815c810 0x7f576814e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:50.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.629+0000 7f5766ffd640 1 -- 172.21.15.53:0/1324589870 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57680cbfc0 msgr2=0x7f5768150960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:50.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.629+0000 7f5766ffd640 1 --2- 172.21.15.53:0/1324589870 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57680cbfc0 0x7f5768150960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:50.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.629+0000 7f5766ffd640 1 -- 172.21.15.53:0/1324589870 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f576815c810 msgr2=0x7f576814e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:50.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.629+0000 7f5766ffd640 1 --2- 172.21.15.53:0/1324589870 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f576815c810 0x7f576814e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:50.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.629+0000 7f5766ffd640 1 -- 172.21.15.53:0/1324589870 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f575c009420 con 0x7f576815ba70 2023-06-10T19:07:50.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.629+0000 7f5766ffd640 1 --2- 172.21.15.53:0/1324589870 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f576815ba70 0x7f576815a7a0 secure :-1 s=READY pgs=2522 cs=0 l=1 rev1=1 crypto rx=0x7f575c019fb0 tx=0x7f575c019120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:50.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.629+0000 7f574ffff640 1 -- 172.21.15.53:0/1324589870 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575c004230 con 0x7f576815ba70 2023-06-10T19:07:50.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.629+0000 7f574ffff640 1 -- 172.21.15.53:0/1324589870 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f575c004390 con 0x7f576815ba70 2023-06-10T19:07:50.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.629+0000 7f576e09b640 1 -- 172.21.15.53:0/1324589870 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f576815b180 con 0x7f576815ba70 2023-06-10T19:07:50.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.629+0000 7f574ffff640 1 -- 172.21.15.53:0/1324589870 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575c003820 con 0x7f576815ba70 2023-06-10T19:07:50.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.629+0000 7f576e09b640 1 -- 172.21.15.53:0/1324589870 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5768150160 con 0x7f576815ba70 2023-06-10T19:07:50.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.629+0000 7f576e09b640 1 -- 172.21.15.53:0/1324589870 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57680ca040 con 0x7f576815ba70 2023-06-10T19:07:50.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.629+0000 7f574ffff640 1 -- 172.21.15.53:0/1324589870 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f575c0b4040 con 0x7f576815ba70 2023-06-10T19:07:50.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.629+0000 7f574ffff640 1 --2- 172.21.15.53:0/1324589870 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5754066280 0x7f5754068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:50.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.629+0000 7f574ffff640 1 -- 172.21.15.53:0/1324589870 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6105+0+0 (secure 0 0 0) 0x7f575c11e060 con 0x7f576815ba70 2023-06-10T19:07:50.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.629+0000 7f57677fe640 1 --2- 172.21.15.53:0/1324589870 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5754066280 0x7f5754068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:50.635 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.633+0000 7f57677fe640 1 --2- 172.21.15.53:0/1324589870 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5754066280 0x7f5754068730 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f5758004e30 tx=0x7f5758009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:50.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.633+0000 7f574ffff640 1 -- 172.21.15.53:0/1324589870 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f575c0eb4c0 con 0x7f576815ba70 2023-06-10T19:07:50.791 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.789+0000 7f576e09b640 1 -- 172.21.15.53:0/1324589870 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5768150680 con 0x7f576815ba70 2023-06-10T19:07:50.794 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.793+0000 7f574ffff640 1 -- 172.21.15.53:0/1324589870 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v168) v1 ==== 74+0+18341 (secure 0 0 0) 0x7f575c0eeae0 con 0x7f576815ba70 2023-06-10T19:07:50.795 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:07:50.795 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":168,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:07:38.149577+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-06-10T19:07:13.365954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"166","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-06-10T19:07:14.695077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.0.1:0/4011987522":"2023-06-10T20:07:37.768015+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:07:50.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.793+0000 7f576e09b640 1 -- 172.21.15.53:0/1324589870 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5754066280 msgr2=0x7f5754068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:50.797 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.793+0000 7f576e09b640 1 --2- 172.21.15.53:0/1324589870 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5754066280 0x7f5754068730 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f5758004e30 tx=0x7f5758009040 comp rx=0 tx=0).stop 2023-06-10T19:07:50.797 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.793+0000 7f576e09b640 1 -- 172.21.15.53:0/1324589870 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f576815ba70 msgr2=0x7f576815a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:50.797 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.793+0000 7f576e09b640 1 --2- 172.21.15.53:0/1324589870 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f576815ba70 0x7f576815a7a0 secure :-1 s=READY pgs=2522 cs=0 l=1 rev1=1 crypto rx=0x7f575c019fb0 tx=0x7f575c019120 comp rx=0 tx=0).stop 2023-06-10T19:07:50.797 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.793+0000 7f576e09b640 1 -- 172.21.15.53:0/1324589870 shutdown_connections 2023-06-10T19:07:50.797 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.793+0000 7f576e09b640 1 --2- 172.21.15.53:0/1324589870 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5754066280 0x7f5754068730 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:50.797 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.793+0000 7f576e09b640 1 --2- 172.21.15.53:0/1324589870 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f576815c810 0x7f576814e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:50.797 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.793+0000 7f576e09b640 1 --2- 172.21.15.53:0/1324589870 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f576815ba70 0x7f576815a7a0 unknown :-1 s=CLOSED pgs=2522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:50.798 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.793+0000 7f576e09b640 1 --2- 172.21.15.53:0/1324589870 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57680cbfc0 0x7f5768150960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:50.798 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.793+0000 7f576e09b640 1 -- 172.21.15.53:0/1324589870 >> 172.21.15.53:0/1324589870 conn(0x7f576806a0d0 msgr2=0x7f57680acab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:50.798 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.793+0000 7f576e09b640 1 -- 172.21.15.53:0/1324589870 shutdown_connections 2023-06-10T19:07:50.798 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.793+0000 7f576e09b640 1 -- 172.21.15.53:0/1324589870 wait complete. 2023-06-10T19:07:50.813 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-06-10T19:07:50.813 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:07:50.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.921+0000 7fd3b26ea640 1 Processor -- start 2023-06-10T19:07:50.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.921+0000 7fd3b26ea640 1 -- start start 2023-06-10T19:07:50.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.925+0000 7fd3b26ea640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd3ac15c7f0 0x7fd3ac15f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:50.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.925+0000 7fd3b26ea640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd3ac15f860 0x7fd3ac0ceb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:50.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.925+0000 7fd3b26ea640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3ac15cc40 con 0x7fd3ac06b780 2023-06-10T19:07:50.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.925+0000 7fd3b26ea640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3ac15c3d0 con 0x7fd3ac15f860 2023-06-10T19:07:50.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.925+0000 7fd3b26ea640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3ac0af530 con 0x7fd3ac15c7f0 2023-06-10T19:07:50.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.925+0000 7fd3b0c87640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd3ac15f860 0x7fd3ac0ceb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:50.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.925+0000 7fd3b0c87640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd3ac15f860 0x7fd3ac0ceb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45480/0 (socket says 172.21.15.53:45480) 2023-06-10T19:07:50.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.925+0000 7fd3b0c87640 1 -- 172.21.15.53:0/2800697726 learned_addr learned my addr 172.21.15.53:0/2800697726 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:50.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.925+0000 7fd3a37fe640 1 --2- 172.21.15.53:0/2800697726 >> v2:172.21.15.117:3300/0 conn(0x7fd3ac15c7f0 0x7fd3ac15f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:50.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.925+0000 7fd3b0c87640 1 -- 172.21.15.53:0/2800697726 >> v2:172.21.15.117:3300/0 conn(0x7fd3ac15c7f0 msgr2=0x7fd3ac15f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:50.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.925+0000 7fd3b0c87640 1 --2- 172.21.15.53:0/2800697726 >> v2:172.21.15.117:3300/0 conn(0x7fd3ac15c7f0 0x7fd3ac15f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:50.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.925+0000 7fd3b0c87640 1 -- 172.21.15.53:0/2800697726 >> v1:172.21.15.117:6789/0 conn(0x7fd3ac06b780 legacy=0x7fd3ac06bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:50.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.925+0000 7fd3b0c87640 1 -- 172.21.15.53:0/2800697726 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3ac15fd70 con 0x7fd3ac15f860 2023-06-10T19:07:50.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.925+0000 7fd3b0c87640 1 --2- 172.21.15.53:0/2800697726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3ac15f860 0x7fd3ac0ceb20 secure :-1 s=READY pgs=2523 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac0cdad0 tx=0x7fd3a401c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3414f6ba48517a22 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:50.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.925+0000 7fd3ab7fe640 1 -- 172.21.15.53:0/2800697726 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a40a57c0 con 0x7fd3ac15f860 2023-06-10T19:07:50.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.925+0000 7fd3ab7fe640 1 -- 172.21.15.53:0/2800697726 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3a40a5920 con 0x7fd3ac15f860 2023-06-10T19:07:50.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.925+0000 7fd3ab7fe640 1 -- 172.21.15.53:0/2800697726 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a40a5cb0 con 0x7fd3ac15f860 2023-06-10T19:07:50.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.929+0000 7fd3b26ea640 1 -- 172.21.15.53:0/2800697726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3ac15f860 msgr2=0x7fd3ac0ceb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:50.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.929+0000 7fd3b26ea640 1 --2- 172.21.15.53:0/2800697726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3ac15f860 0x7fd3ac0ceb20 secure :-1 s=READY pgs=2523 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac0cdad0 tx=0x7fd3a401c900 comp rx=0 tx=0).stop 2023-06-10T19:07:50.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.929+0000 7fd3b26ea640 1 -- 172.21.15.53:0/2800697726 shutdown_connections 2023-06-10T19:07:50.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.929+0000 7fd3b26ea640 1 --2- 172.21.15.53:0/2800697726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3ac15f860 0x7fd3ac0ceb20 unknown :-1 s=CLOSED pgs=2523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:50.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.929+0000 7fd3b26ea640 1 --2- 172.21.15.53:0/2800697726 >> v2:172.21.15.117:3300/0 conn(0x7fd3ac15c7f0 0x7fd3ac15f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:50.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.929+0000 7fd3b26ea640 1 -- 172.21.15.53:0/2800697726 >> 172.21.15.53:0/2800697726 conn(0x7fd3ac06a090 msgr2=0x7fd3ac06d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:50.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.929+0000 7fd3b26ea640 1 -- 172.21.15.53:0/2800697726 shutdown_connections 2023-06-10T19:07:50.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.929+0000 7fd3b26ea640 1 -- 172.21.15.53:0/2800697726 wait complete. 2023-06-10T19:07:50.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.929+0000 7fd3b26ea640 1 Processor -- start 2023-06-10T19:07:50.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.929+0000 7fd3b26ea640 1 -- start start 2023-06-10T19:07:50.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.929+0000 7fd3b26ea640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3ac06b780 0x7fd3ac15b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:50.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.929+0000 7fd3b26ea640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3ac15c7f0 0x7fd3ac154290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:50.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.929+0000 7fd3b26ea640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3ac15f860 0x7fd3ac15e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:50.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.929+0000 7fd3b26ea640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ac0c5370 con 0x7fd3ac15c7f0 2023-06-10T19:07:50.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.929+0000 7fd3b26ea640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ac0cb290 con 0x7fd3ac06b780 2023-06-10T19:07:50.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.929+0000 7fd3b26ea640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ac0ca9f0 con 0x7fd3ac15f860 2023-06-10T19:07:50.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.929+0000 7fd3a37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3ac15c7f0 0x7fd3ac154290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:50.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.929+0000 7fd3a37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3ac15c7f0 0x7fd3ac154290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45486/0 (socket says 172.21.15.53:45486) 2023-06-10T19:07:50.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.929+0000 7fd3a37fe640 1 -- 172.21.15.53:0/673168152 learned_addr learned my addr 172.21.15.53:0/673168152 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:50.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.929+0000 7fd3b0c87640 1 --2- 172.21.15.53:0/673168152 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3ac15f860 0x7fd3ac15e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:50.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.929+0000 7fd3abfff640 1 --2- 172.21.15.53:0/673168152 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3ac06b780 0x7fd3ac15b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:50.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.929+0000 7fd3a37fe640 1 -- 172.21.15.53:0/673168152 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3ac15f860 msgr2=0x7fd3ac15e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:50.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.929+0000 7fd3a37fe640 1 --2- 172.21.15.53:0/673168152 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3ac15f860 0x7fd3ac15e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:50.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.929+0000 7fd3a37fe640 1 -- 172.21.15.53:0/673168152 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3ac06b780 msgr2=0x7fd3ac15b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:50.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.929+0000 7fd3a37fe640 1 --2- 172.21.15.53:0/673168152 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3ac06b780 0x7fd3ac15b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:50.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.929+0000 7fd3a37fe640 1 -- 172.21.15.53:0/673168152 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3a4009b30 con 0x7fd3ac15c7f0 2023-06-10T19:07:50.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.929+0000 7fd3a37fe640 1 --2- 172.21.15.53:0/673168152 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3ac15c7f0 0x7fd3ac154290 secure :-1 s=READY pgs=2524 cs=0 l=1 rev1=1 crypto rx=0x7fd39400c820 tx=0x7fd39400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:50.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.929+0000 7fd3a97fa640 1 -- 172.21.15.53:0/673168152 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd394007a30 con 0x7fd3ac15c7f0 2023-06-10T19:07:50.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.929+0000 7fd3a97fa640 1 -- 172.21.15.53:0/673168152 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd394007b90 con 0x7fd3ac15c7f0 2023-06-10T19:07:50.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.929+0000 7fd3b26ea640 1 -- 172.21.15.53:0/673168152 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3ac0cacd0 con 0x7fd3ac15c7f0 2023-06-10T19:07:50.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.929+0000 7fd3a97fa640 1 -- 172.21.15.53:0/673168152 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd39400ce10 con 0x7fd3ac15c7f0 2023-06-10T19:07:50.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.929+0000 7fd3b26ea640 1 -- 172.21.15.53:0/673168152 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3ac15b870 con 0x7fd3ac15c7f0 2023-06-10T19:07:50.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.933+0000 7fd3b26ea640 1 -- 172.21.15.53:0/673168152 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3ac0c54b0 con 0x7fd3ac15c7f0 2023-06-10T19:07:50.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.933+0000 7fd3a97fa640 1 -- 172.21.15.53:0/673168152 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd394024480 con 0x7fd3ac15c7f0 2023-06-10T19:07:50.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.933+0000 7fd3a97fa640 1 --2- 172.21.15.53:0/673168152 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd38c0662b0 0x7fd38c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:50.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.933+0000 7fd3a97fa640 1 -- 172.21.15.53:0/673168152 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6105+0+0 (secure 0 0 0) 0x7fd394084010 con 0x7fd3ac15c7f0 2023-06-10T19:07:50.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.933+0000 7fd3abfff640 1 --2- 172.21.15.53:0/673168152 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd38c0662b0 0x7fd38c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:50.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.933+0000 7fd3abfff640 1 --2- 172.21.15.53:0/673168152 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd38c0662b0 0x7fd38c068760 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac0cc140 tx=0x7fd39c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:50.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:50.937+0000 7fd3a97fa640 1 -- 172.21.15.53:0/673168152 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd394051540 con 0x7fd3ac15c7f0 2023-06-10T19:07:51.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.121+0000 7fd3b26ea640 1 -- 172.21.15.53:0/673168152 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd3ac0c54b0 con 0x7fd3ac15c7f0 2023-06-10T19:07:51.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.121+0000 7fd3a97fa640 1 -- 172.21.15.53:0/673168152 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 96 v96) v1 ==== 94+0+4685 (secure 0 0 0) 0x7fd3ac0c54b0 con 0x7fd3ac15c7f0 2023-06-10T19:07:51.124 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:07:51.124 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":96,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8614,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3518533956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3518533956},{"type":"v1","addr":"172.21.15.117:6835","nonce":3518533956}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92},{"gid":8617,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/2615123885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2615123885},{"type":"v1","addr":"172.21.15.117:6837","nonce":2615123885}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92},{"gid":10551,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/3498697556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3498697556},{"type":"v1","addr":"172.21.15.53:6833","nonce":3498697556}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92}],"filesystems":[{"mdsmap":{"epoch":96,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:07:15.723316+0000","modified":"2023-06-10T19:07:18.354630+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10557},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10557":{"gid":10557,"name":"c","rank":0,"incarnation":93,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/3721509006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":3721509006},{"type":"v1","addr":"172.21.15.53:6835","nonce":3721509006}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-06-10T19:07:51.124 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 96 2023-06-10T19:07:51.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.121+0000 7fd3b26ea640 1 -- 172.21.15.53:0/673168152 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd38c0662b0 msgr2=0x7fd38c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:51.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.121+0000 7fd3b26ea640 1 --2- 172.21.15.53:0/673168152 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd38c0662b0 0x7fd38c068760 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac0cc140 tx=0x7fd39c008040 comp rx=0 tx=0).stop 2023-06-10T19:07:51.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.121+0000 7fd3b26ea640 1 -- 172.21.15.53:0/673168152 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3ac15c7f0 msgr2=0x7fd3ac154290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:51.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.121+0000 7fd3b26ea640 1 --2- 172.21.15.53:0/673168152 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3ac15c7f0 0x7fd3ac154290 secure :-1 s=READY pgs=2524 cs=0 l=1 rev1=1 crypto rx=0x7fd39400c820 tx=0x7fd39400cce0 comp rx=0 tx=0).stop 2023-06-10T19:07:51.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.121+0000 7fd3b26ea640 1 -- 172.21.15.53:0/673168152 shutdown_connections 2023-06-10T19:07:51.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.121+0000 7fd3b26ea640 1 --2- 172.21.15.53:0/673168152 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd38c0662b0 0x7fd38c068760 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:51.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.121+0000 7fd3b26ea640 1 --2- 172.21.15.53:0/673168152 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd3ac15f860 0x7fd3ac15e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:51.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.121+0000 7fd3b26ea640 1 --2- 172.21.15.53:0/673168152 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3ac15c7f0 0x7fd3ac154290 unknown :-1 s=CLOSED pgs=2524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:51.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.121+0000 7fd3b26ea640 1 --2- 172.21.15.53:0/673168152 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3ac06b780 0x7fd3ac15b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:51.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.121+0000 7fd3b26ea640 1 -- 172.21.15.53:0/673168152 >> 172.21.15.53:0/673168152 conn(0x7fd3ac06a090 msgr2=0x7fd3ac0afb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:51.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.121+0000 7fd3b26ea640 1 -- 172.21.15.53:0/673168152 shutdown_connections 2023-06-10T19:07:51.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.121+0000 7fd3b26ea640 1 -- 172.21.15.53:0/673168152 wait complete. 2023-06-10T19:07:51.141 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:07:51.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.261+0000 7f6d9cf11640 1 Processor -- start 2023-06-10T19:07:51.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.261+0000 7f6d9cf11640 1 -- start start 2023-06-10T19:07:51.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.265+0000 7f6d9cf11640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d980c9750 0x7f6d980aced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:51.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.265+0000 7f6d9cf11640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6d980afe30 0x7f6d980aba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:51.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.265+0000 7f6d9cf11640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d980ad410 con 0x7f6d980cb870 2023-06-10T19:07:51.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.265+0000 7f6d9cf11640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d980cd990 con 0x7f6d980afe30 2023-06-10T19:07:51.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.265+0000 7f6d9cf11640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d981600d0 con 0x7f6d980c9750 2023-06-10T19:07:51.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.265+0000 7f6d95d9b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f6d980cb870 0x7f6d980af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52392/0 (socket says 172.21.15.53:52392) 2023-06-10T19:07:51.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.265+0000 7f6d95d9b640 1 -- 172.21.15.53:0/1109068880 learned_addr learned my addr 172.21.15.53:0/1109068880 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:07:51.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.265+0000 7f6d9659c640 1 --2- 172.21.15.53:0/1109068880 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d980c9750 0x7f6d980aced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:51.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.265+0000 7f6d96d9d640 1 --2- 172.21.15.53:0/1109068880 >> v2:172.21.15.117:3300/0 conn(0x7f6d980afe30 0x7f6d980aba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:51.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.265+0000 7f6d9559a640 1 -- 172.21.15.53:0/1109068880 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1628798264 0 0) 0x7f6d980ad410 con 0x7f6d980cb870 2023-06-10T19:07:51.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.265+0000 7f6d9559a640 1 -- 172.21.15.53:0/1109068880 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d80003530 con 0x7f6d980cb870 2023-06-10T19:07:51.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.265+0000 7f6d9559a640 1 -- 172.21.15.53:0/1109068880 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3951593131 0 0) 0x7f6d80003530 con 0x7f6d980cb870 2023-06-10T19:07:51.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.265+0000 7f6d9559a640 1 -- 172.21.15.53:0/1109068880 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d980c9750 msgr2=0x7f6d980aced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:51.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.265+0000 7f6d9559a640 1 --2- 172.21.15.53:0/1109068880 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d980c9750 0x7f6d980aced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:51.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.265+0000 7f6d9559a640 1 -- 172.21.15.53:0/1109068880 >> v2:172.21.15.117:3300/0 conn(0x7f6d980afe30 msgr2=0x7f6d980aba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:51.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.265+0000 7f6d9559a640 1 --2- 172.21.15.53:0/1109068880 >> v2:172.21.15.117:3300/0 conn(0x7f6d980afe30 0x7f6d980aba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:51.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.265+0000 7f6d9559a640 1 -- 172.21.15.53:0/1109068880 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d98160370 con 0x7f6d980cb870 2023-06-10T19:07:51.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.265+0000 7f6d9559a640 1 -- 172.21.15.53:0/1109068880 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f6d8c001680 con 0x7f6d980cb870 2023-06-10T19:07:51.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.265+0000 7f6d9559a640 1 -- 172.21.15.53:0/1109068880 >> v1:172.21.15.53:6789/0 conn(0x7f6d980cb870 legacy=0x7f6d980af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:51.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.265+0000 7f6d9559a640 1 --2- 172.21.15.53:0/1109068880 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6d800039f0 0x7f6d80003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:51.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.265+0000 7f6d9559a640 1 --2- 172.21.15.53:0/1109068880 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d980c9750 0x7f6d800047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:51.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.265+0000 7f6d9559a640 1 --2- 172.21.15.53:0/1109068880 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d80004d10 0x7f6d80005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:51.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.265+0000 7f6d9559a640 1 -- 172.21.15.53:0/1109068880 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d980cd990 con 0x7f6d800039f0 2023-06-10T19:07:51.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.265+0000 7f6d9559a640 1 -- 172.21.15.53:0/1109068880 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d981600d0 con 0x7f6d80004d10 2023-06-10T19:07:51.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.265+0000 7f6d9559a640 1 -- 172.21.15.53:0/1109068880 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8000b990 con 0x7f6d980c9750 2023-06-10T19:07:51.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.265+0000 7f6d9659c640 1 --2- 172.21.15.53:0/1109068880 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6d800039f0 0x7f6d80003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:51.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.265+0000 7f6d96d9d640 1 --2- 172.21.15.53:0/1109068880 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d80004d10 0x7f6d80005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:51.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.265+0000 7f6d95d9b640 1 --2- 172.21.15.53:0/1109068880 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d980c9750 0x7f6d800047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:51.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.265+0000 7f6d9659c640 1 -- 172.21.15.53:0/1109068880 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d980c9750 msgr2=0x7f6d800047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:51.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.265+0000 7f6d9659c640 1 --2- 172.21.15.53:0/1109068880 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d980c9750 0x7f6d800047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:51.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.265+0000 7f6d9659c640 1 -- 172.21.15.53:0/1109068880 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d80004d10 msgr2=0x7f6d80005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:51.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.265+0000 7f6d9659c640 1 --2- 172.21.15.53:0/1109068880 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d80004d10 0x7f6d80005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:51.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.265+0000 7f6d9659c640 1 -- 172.21.15.53:0/1109068880 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d80003530 con 0x7f6d800039f0 2023-06-10T19:07:51.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.265+0000 7f6d96d9d640 1 --2- 172.21.15.53:0/1109068880 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d80004d10 0x7f6d80005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:07:51.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.265+0000 7f6d9659c640 1 --2- 172.21.15.53:0/1109068880 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6d800039f0 0x7f6d80003e00 secure :-1 s=READY pgs=2526 cs=0 l=1 rev1=1 crypto rx=0x7f6d9000e170 tx=0x7f6d9001cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=918e7de2fd9ded77 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:51.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.265+0000 7f6d9559a640 1 -- 172.21.15.53:0/1109068880 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d900a5b40 con 0x7f6d800039f0 2023-06-10T19:07:51.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.265+0000 7f6d9559a640 1 -- 172.21.15.53:0/1109068880 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d9000f040 con 0x7f6d800039f0 2023-06-10T19:07:51.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.265+0000 7f6d9559a640 1 -- 172.21.15.53:0/1109068880 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d900ad440 con 0x7f6d800039f0 2023-06-10T19:07:51.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.269+0000 7f6d9cf11640 1 -- 172.21.15.53:0/1109068880 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6d800039f0 msgr2=0x7f6d80003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:51.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.269+0000 7f6d9cf11640 1 --2- 172.21.15.53:0/1109068880 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6d800039f0 0x7f6d80003e00 secure :-1 s=READY pgs=2526 cs=0 l=1 rev1=1 crypto rx=0x7f6d9000e170 tx=0x7f6d9001cbe0 comp rx=0 tx=0).stop 2023-06-10T19:07:51.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.269+0000 7f6d96d9d640 1 -- 172.21.15.53:0/1109068880 reap_dead start 2023-06-10T19:07:51.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.269+0000 7f6d9cf11640 1 -- 172.21.15.53:0/1109068880 shutdown_connections 2023-06-10T19:07:51.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.269+0000 7f6d9cf11640 1 -- 172.21.15.53:0/1109068880 >> 172.21.15.53:0/1109068880 conn(0x7f6d9806a0d0 msgr2=0x7f6d980ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:51.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.269+0000 7f6d9cf11640 1 -- 172.21.15.53:0/1109068880 shutdown_connections 2023-06-10T19:07:51.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.269+0000 7f6d9cf11640 1 -- 172.21.15.53:0/1109068880 wait complete. 2023-06-10T19:07:51.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.269+0000 7f6d9cf11640 1 Processor -- start 2023-06-10T19:07:51.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.269+0000 7f6d9cf11640 1 -- start start 2023-06-10T19:07:51.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.269+0000 7f6d9cf11640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d800039f0 0x7f6d981f7a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:51.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.269+0000 7f6d9cf11640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6d980c17d0 0x7f6d98154270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:51.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.269+0000 7f6d9cf11640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d98153250 0x7f6d980c2700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:51.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.269+0000 7f6d9cf11640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d980c1fd0 con 0x7f6d980c17d0 2023-06-10T19:07:51.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.269+0000 7f6d9cf11640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d981f7fb0 con 0x7f6d98153250 2023-06-10T19:07:51.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.269+0000 7f6d9cf11640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d981547b0 con 0x7f6d800039f0 2023-06-10T19:07:51.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.269+0000 7f6d95d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6d980c17d0 0x7f6d98154270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:51.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.269+0000 7f6d95d9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6d980c17d0 0x7f6d98154270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55654/0 (socket says 172.21.15.53:55654) 2023-06-10T19:07:51.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.269+0000 7f6d95d9b640 1 -- 172.21.15.53:0/1354757313 learned_addr learned my addr 172.21.15.53:0/1354757313 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:51.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.269+0000 7f6d9659c640 1 --2- 172.21.15.53:0/1354757313 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d800039f0 0x7f6d981f7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:51.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.269+0000 7f6d96d9d640 1 --2- 172.21.15.53:0/1354757313 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d98153250 0x7f6d980c2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:51.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.269+0000 7f6d95d9b640 1 -- 172.21.15.53:0/1354757313 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d800039f0 msgr2=0x7f6d981f7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:51.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.269+0000 7f6d95d9b640 1 --2- 172.21.15.53:0/1354757313 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d800039f0 0x7f6d981f7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:51.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.269+0000 7f6d95d9b640 1 -- 172.21.15.53:0/1354757313 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d98153250 msgr2=0x7f6d980c2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:51.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.269+0000 7f6d95d9b640 1 --2- 172.21.15.53:0/1354757313 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d98153250 0x7f6d980c2700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:51.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.269+0000 7f6d95d9b640 1 -- 172.21.15.53:0/1354757313 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d981f8240 con 0x7f6d980c17d0 2023-06-10T19:07:51.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.269+0000 7f6d95d9b640 1 --2- 172.21.15.53:0/1354757313 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6d980c17d0 0x7f6d98154270 secure :-1 s=READY pgs=2527 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c00d770 tx=0x7f6d8c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:51.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.269+0000 7f6d86ffd640 1 -- 172.21.15.53:0/1354757313 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c0074e0 con 0x7f6d980c17d0 2023-06-10T19:07:51.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.269+0000 7f6d86ffd640 1 -- 172.21.15.53:0/1354757313 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d8c007640 con 0x7f6d980c17d0 2023-06-10T19:07:51.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.269+0000 7f6d86ffd640 1 -- 172.21.15.53:0/1354757313 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c004a10 con 0x7f6d980c17d0 2023-06-10T19:07:51.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.269+0000 7f6d9cf11640 1 -- 172.21.15.53:0/1354757313 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d981f8520 con 0x7f6d980c17d0 2023-06-10T19:07:51.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.269+0000 7f6d9cf11640 1 -- 172.21.15.53:0/1354757313 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d980c21e0 con 0x7f6d980c17d0 2023-06-10T19:07:51.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.273+0000 7f6d9cf11640 1 -- 172.21.15.53:0/1354757313 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d980c2400 con 0x7f6d980c17d0 2023-06-10T19:07:51.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.273+0000 7f6d86ffd640 1 -- 172.21.15.53:0/1354757313 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6d8c004b70 con 0x7f6d980c17d0 2023-06-10T19:07:51.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.273+0000 7f6d86ffd640 1 --2- 172.21.15.53:0/1354757313 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6d78066280 0x7f6d78068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:51.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.273+0000 7f6d86ffd640 1 -- 172.21.15.53:0/1354757313 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6105+0+0 (secure 0 0 0) 0x7f6d8c083630 con 0x7f6d980c17d0 2023-06-10T19:07:51.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.273+0000 7f6d9659c640 1 --2- 172.21.15.53:0/1354757313 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6d78066280 0x7f6d78068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:51.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.273+0000 7f6d9659c640 1 --2- 172.21.15.53:0/1354757313 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6d78066280 0x7f6d78068730 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f6d900af000 tx=0x7f6d900a7040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:51.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.277+0000 7f6d86ffd640 1 -- 172.21.15.53:0/1354757313 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6d8c050a80 con 0x7f6d980c17d0 2023-06-10T19:07:51.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.457+0000 7f6d9cf11640 1 -- 172.21.15.53:0/1354757313 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6d9804d790 con 0x7f6d980c17d0 2023-06-10T19:07:51.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.457+0000 7f6d86ffd640 1 -- 172.21.15.53:0/1354757313 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 96 v96) v1 ==== 94+0+4685 (secure 0 0 0) 0x7f6d8c0540a0 con 0x7f6d980c17d0 2023-06-10T19:07:51.459 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:07:51.460 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":96,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8614,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3518533956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3518533956},{"type":"v1","addr":"172.21.15.117:6835","nonce":3518533956}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92},{"gid":8617,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/2615123885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2615123885},{"type":"v1","addr":"172.21.15.117:6837","nonce":2615123885}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92},{"gid":10551,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/3498697556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3498697556},{"type":"v1","addr":"172.21.15.53:6833","nonce":3498697556}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92}],"filesystems":[{"mdsmap":{"epoch":96,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:07:15.723316+0000","modified":"2023-06-10T19:07:18.354630+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10557},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10557":{"gid":10557,"name":"c","rank":0,"incarnation":93,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/3721509006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":3721509006},{"type":"v1","addr":"172.21.15.53:6835","nonce":3721509006}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-06-10T19:07:51.460 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 96 2023-06-10T19:07:51.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.457+0000 7f6d9cf11640 1 -- 172.21.15.53:0/1354757313 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6d78066280 msgr2=0x7f6d78068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:51.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.457+0000 7f6d9cf11640 1 --2- 172.21.15.53:0/1354757313 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6d78066280 0x7f6d78068730 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f6d900af000 tx=0x7f6d900a7040 comp rx=0 tx=0).stop 2023-06-10T19:07:51.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.457+0000 7f6d9cf11640 1 -- 172.21.15.53:0/1354757313 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6d980c17d0 msgr2=0x7f6d98154270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:51.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.457+0000 7f6d9cf11640 1 --2- 172.21.15.53:0/1354757313 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6d980c17d0 0x7f6d98154270 secure :-1 s=READY pgs=2527 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c00d770 tx=0x7f6d8c00dc30 comp rx=0 tx=0).stop 2023-06-10T19:07:51.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.457+0000 7f6d9cf11640 1 -- 172.21.15.53:0/1354757313 shutdown_connections 2023-06-10T19:07:51.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.457+0000 7f6d9cf11640 1 --2- 172.21.15.53:0/1354757313 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6d78066280 0x7f6d78068730 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:51.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.457+0000 7f6d9cf11640 1 --2- 172.21.15.53:0/1354757313 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d98153250 0x7f6d980c2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:51.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.457+0000 7f6d9cf11640 1 --2- 172.21.15.53:0/1354757313 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6d980c17d0 0x7f6d98154270 unknown :-1 s=CLOSED pgs=2527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:51.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.457+0000 7f6d9cf11640 1 --2- 172.21.15.53:0/1354757313 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d800039f0 0x7f6d981f7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:51.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.457+0000 7f6d9cf11640 1 -- 172.21.15.53:0/1354757313 >> 172.21.15.53:0/1354757313 conn(0x7f6d9806a0d0 msgr2=0x7f6d9815f4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:51.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.457+0000 7f6d9cf11640 1 -- 172.21.15.53:0/1354757313 shutdown_connections 2023-06-10T19:07:51.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.457+0000 7f6d9cf11640 1 -- 172.21.15.53:0/1354757313 wait complete. 2023-06-10T19:07:51.477 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:07:51.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.585+0000 7f8d295d6640 1 Processor -- start 2023-06-10T19:07:51.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.585+0000 7f8d295d6640 1 -- start start 2023-06-10T19:07:51.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.589+0000 7f8d295d6640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8d240c9840 0x7f8d240c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:51.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.589+0000 7f8d295d6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d24071060 0x7f8d240af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:51.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.589+0000 7f8d295d6640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d24159b50 con 0x7f8d240afc60 2023-06-10T19:07:51.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.589+0000 7f8d295d6640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d240ca150 con 0x7f8d240c9840 2023-06-10T19:07:51.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.589+0000 7f8d295d6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d240702a0 con 0x7f8d24071060 2023-06-10T19:07:51.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.589+0000 7f8d237fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f8d240afc60 0x7f8d2415d2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52398/0 (socket says 172.21.15.53:52398) 2023-06-10T19:07:51.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.589+0000 7f8d237fe640 1 -- 172.21.15.53:0/264623895 learned_addr learned my addr 172.21.15.53:0/264623895 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:07:51.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.589+0000 7f8d227fc640 1 --2- 172.21.15.53:0/264623895 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d24071060 0x7f8d240af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:51.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.589+0000 7f8d21ffb640 1 -- 172.21.15.53:0/264623895 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 674671811 0 0) 0x7f8d24159b50 con 0x7f8d240afc60 2023-06-10T19:07:51.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.589+0000 7f8d21ffb640 1 -- 172.21.15.53:0/264623895 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d10003530 con 0x7f8d240afc60 2023-06-10T19:07:51.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.589+0000 7f8d22ffd640 1 --2- 172.21.15.53:0/264623895 >> v2:172.21.15.117:3300/0 conn(0x7f8d240c9840 0x7f8d240c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:51.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.589+0000 7f8d21ffb640 1 -- 172.21.15.53:0/264623895 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4044730033 0 0) 0x7f8d10003530 con 0x7f8d240afc60 2023-06-10T19:07:51.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.589+0000 7f8d21ffb640 1 -- 172.21.15.53:0/264623895 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d24071060 msgr2=0x7f8d240af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:51.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.589+0000 7f8d21ffb640 1 --2- 172.21.15.53:0/264623895 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d24071060 0x7f8d240af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:51.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.589+0000 7f8d21ffb640 1 -- 172.21.15.53:0/264623895 >> v2:172.21.15.117:3300/0 conn(0x7f8d240c9840 msgr2=0x7f8d240c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:51.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.589+0000 7f8d21ffb640 1 --2- 172.21.15.53:0/264623895 >> v2:172.21.15.117:3300/0 conn(0x7f8d240c9840 0x7f8d240c9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:51.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.589+0000 7f8d21ffb640 1 -- 172.21.15.53:0/264623895 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d24070580 con 0x7f8d240afc60 2023-06-10T19:07:51.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.589+0000 7f8d21ffb640 1 -- 172.21.15.53:0/264623895 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f8d1c001680 con 0x7f8d240afc60 2023-06-10T19:07:51.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.589+0000 7f8d21ffb640 1 -- 172.21.15.53:0/264623895 >> v1:172.21.15.53:6789/0 conn(0x7f8d240afc60 legacy=0x7f8d2415d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:51.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.589+0000 7f8d21ffb640 1 --2- 172.21.15.53:0/264623895 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d24071060 0x7f8d100039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:51.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.589+0000 7f8d21ffb640 1 --2- 172.21.15.53:0/264623895 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d10003f70 0x7f8d100047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:51.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.589+0000 7f8d21ffb640 1 --2- 172.21.15.53:0/264623895 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d10004d10 0x7f8d10005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:51.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.589+0000 7f8d21ffb640 1 -- 172.21.15.53:0/264623895 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d240ca150 con 0x7f8d10003f70 2023-06-10T19:07:51.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.589+0000 7f8d21ffb640 1 -- 172.21.15.53:0/264623895 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d240702a0 con 0x7f8d10004d10 2023-06-10T19:07:51.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.589+0000 7f8d21ffb640 1 -- 172.21.15.53:0/264623895 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1000b990 con 0x7f8d24071060 2023-06-10T19:07:51.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.589+0000 7f8d227fc640 1 --2- 172.21.15.53:0/264623895 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d10003f70 0x7f8d100047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:51.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.589+0000 7f8d22ffd640 1 --2- 172.21.15.53:0/264623895 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d24071060 0x7f8d100039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:51.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.589+0000 7f8d237fe640 1 --2- 172.21.15.53:0/264623895 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d10004d10 0x7f8d10005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:51.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.589+0000 7f8d227fc640 1 -- 172.21.15.53:0/264623895 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d24071060 msgr2=0x7f8d100039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:51.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.589+0000 7f8d227fc640 1 --2- 172.21.15.53:0/264623895 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d24071060 0x7f8d100039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:51.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.589+0000 7f8d227fc640 1 -- 172.21.15.53:0/264623895 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d10004d10 msgr2=0x7f8d10005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:51.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.589+0000 7f8d227fc640 1 --2- 172.21.15.53:0/264623895 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d10004d10 0x7f8d10005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:51.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.589+0000 7f8d227fc640 1 -- 172.21.15.53:0/264623895 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d10003530 con 0x7f8d10003f70 2023-06-10T19:07:51.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.589+0000 7f8d237fe640 1 --2- 172.21.15.53:0/264623895 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d10004d10 0x7f8d10005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:07:51.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.593+0000 7f8d227fc640 1 --2- 172.21.15.53:0/264623895 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d10003f70 0x7f8d100047d0 secure :-1 s=READY pgs=2529 cs=0 l=1 rev1=1 crypto rx=0x7f8d14009fc0 tx=0x7f8d1401cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5217a11fd274630 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:51.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.593+0000 7f8d21ffb640 1 -- 172.21.15.53:0/264623895 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d140a5b20 con 0x7f8d10003f70 2023-06-10T19:07:51.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.593+0000 7f8d21ffb640 1 -- 172.21.15.53:0/264623895 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d1400f040 con 0x7f8d10003f70 2023-06-10T19:07:51.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.593+0000 7f8d21ffb640 1 -- 172.21.15.53:0/264623895 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d140ad440 con 0x7f8d10003f70 2023-06-10T19:07:51.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.593+0000 7f8d295d6640 1 -- 172.21.15.53:0/264623895 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d10003f70 msgr2=0x7f8d100047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:51.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.593+0000 7f8d295d6640 1 --2- 172.21.15.53:0/264623895 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d10003f70 0x7f8d100047d0 secure :-1 s=READY pgs=2529 cs=0 l=1 rev1=1 crypto rx=0x7f8d14009fc0 tx=0x7f8d1401cc20 comp rx=0 tx=0).stop 2023-06-10T19:07:51.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.593+0000 7f8d237fe640 1 -- 172.21.15.53:0/264623895 reap_dead start 2023-06-10T19:07:51.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.593+0000 7f8d295d6640 1 -- 172.21.15.53:0/264623895 shutdown_connections 2023-06-10T19:07:51.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.593+0000 7f8d295d6640 1 -- 172.21.15.53:0/264623895 >> 172.21.15.53:0/264623895 conn(0x7f8d2406a0d0 msgr2=0x7f8d240ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:51.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.593+0000 7f8d295d6640 1 -- 172.21.15.53:0/264623895 shutdown_connections 2023-06-10T19:07:51.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.593+0000 7f8d295d6640 1 -- 172.21.15.53:0/264623895 wait complete. 2023-06-10T19:07:51.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.593+0000 7f8d295d6640 1 Processor -- start 2023-06-10T19:07:51.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.593+0000 7f8d295d6640 1 -- start start 2023-06-10T19:07:51.601 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.593+0000 7f8d295d6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d10003f70 0x7f8d2414f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:51.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.593+0000 7f8d295d6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d241e4b90 0x7f8d241e5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:51.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.593+0000 7f8d295d6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d240b0b60 0x7f8d240b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:51.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.593+0000 7f8d295d6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d241e5540 con 0x7f8d10003f70 2023-06-10T19:07:51.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.593+0000 7f8d295d6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d240b29c0 con 0x7f8d240b0b60 2023-06-10T19:07:51.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.593+0000 7f8d295d6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d240b1920 con 0x7f8d241e4b90 2023-06-10T19:07:51.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.593+0000 7f8d22ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d10003f70 0x7f8d2414f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:51.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.593+0000 7f8d22ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d10003f70 0x7f8d2414f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55686/0 (socket says 172.21.15.53:55686) 2023-06-10T19:07:51.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.593+0000 7f8d22ffd640 1 -- 172.21.15.53:0/3477013230 learned_addr learned my addr 172.21.15.53:0/3477013230 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:51.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.593+0000 7f8d227fc640 1 --2- 172.21.15.53:0/3477013230 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d241e4b90 0x7f8d241e5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:51.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.593+0000 7f8d237fe640 1 --2- 172.21.15.53:0/3477013230 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d240b0b60 0x7f8d240b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:51.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.593+0000 7f8d22ffd640 1 -- 172.21.15.53:0/3477013230 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d241e4b90 msgr2=0x7f8d241e5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:51.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.593+0000 7f8d22ffd640 1 --2- 172.21.15.53:0/3477013230 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d241e4b90 0x7f8d241e5000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:51.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.593+0000 7f8d22ffd640 1 -- 172.21.15.53:0/3477013230 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d240b0b60 msgr2=0x7f8d240b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:51.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.593+0000 7f8d22ffd640 1 --2- 172.21.15.53:0/3477013230 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d240b0b60 0x7f8d240b0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:51.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.593+0000 7f8d22ffd640 1 -- 172.21.15.53:0/3477013230 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d240b1c00 con 0x7f8d10003f70 2023-06-10T19:07:51.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.593+0000 7f8d237fe640 1 --2- 172.21.15.53:0/3477013230 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d240b0b60 0x7f8d240b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:07:51.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.593+0000 7f8d22ffd640 1 --2- 172.21.15.53:0/3477013230 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d10003f70 0x7f8d2414f140 secure :-1 s=READY pgs=2530 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c011aa0 tx=0x7f8d0c011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:51.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.593+0000 7f8d1b7fe640 1 -- 172.21.15.53:0/3477013230 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0c00fb20 con 0x7f8d10003f70 2023-06-10T19:07:51.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.593+0000 7f8d1b7fe640 1 -- 172.21.15.53:0/3477013230 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d0c00fc80 con 0x7f8d10003f70 2023-06-10T19:07:51.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.593+0000 7f8d295d6640 1 -- 172.21.15.53:0/3477013230 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d240b1ee0 con 0x7f8d10003f70 2023-06-10T19:07:51.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.593+0000 7f8d1b7fe640 1 -- 172.21.15.53:0/3477013230 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0c014440 con 0x7f8d10003f70 2023-06-10T19:07:51.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.593+0000 7f8d295d6640 1 -- 172.21.15.53:0/3477013230 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d240b24a0 con 0x7f8d10003f70 2023-06-10T19:07:51.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.597+0000 7f8d295d6640 1 -- 172.21.15.53:0/3477013230 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d2404d790 con 0x7f8d10003f70 2023-06-10T19:07:51.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.597+0000 7f8d1b7fe640 1 -- 172.21.15.53:0/3477013230 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8d0c0145c0 con 0x7f8d10003f70 2023-06-10T19:07:51.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.597+0000 7f8d1b7fe640 1 --2- 172.21.15.53:0/3477013230 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8d04066280 0x7f8d04068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:51.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.597+0000 7f8d1b7fe640 1 -- 172.21.15.53:0/3477013230 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6105+0+0 (secure 0 0 0) 0x7f8d0c084690 con 0x7f8d10003f70 2023-06-10T19:07:51.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.597+0000 7f8d227fc640 1 --2- 172.21.15.53:0/3477013230 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8d04066280 0x7f8d04068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:51.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.597+0000 7f8d227fc640 1 --2- 172.21.15.53:0/3477013230 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8d04066280 0x7f8d04068730 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f8d140af000 tx=0x7f8d140a7040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:51.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.601+0000 7f8d1b7fe640 1 -- 172.21.15.53:0/3477013230 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8d0c051ad0 con 0x7f8d10003f70 2023-06-10T19:07:51.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.749+0000 7f8d295d6640 1 -- 172.21.15.53:0/3477013230 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8d240c9c10 con 0x7f8d10003f70 2023-06-10T19:07:51.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.753+0000 7f8d1b7fe640 1 -- 172.21.15.53:0/3477013230 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v168) v1 ==== 74+0+18341 (secure 0 0 0) 0x7f8d0c0550f0 con 0x7f8d10003f70 2023-06-10T19:07:51.755 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:07:51.755 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":168,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:07:38.149577+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-06-10T19:07:13.365954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"166","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-06-10T19:07:14.695077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.0.1:0/4011987522":"2023-06-10T20:07:37.768015+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:07:51.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.753+0000 7f8d295d6640 1 -- 172.21.15.53:0/3477013230 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8d04066280 msgr2=0x7f8d04068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:51.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.753+0000 7f8d295d6640 1 --2- 172.21.15.53:0/3477013230 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8d04066280 0x7f8d04068730 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f8d140af000 tx=0x7f8d140a7040 comp rx=0 tx=0).stop 2023-06-10T19:07:51.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.753+0000 7f8d295d6640 1 -- 172.21.15.53:0/3477013230 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d10003f70 msgr2=0x7f8d2414f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:51.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.753+0000 7f8d295d6640 1 --2- 172.21.15.53:0/3477013230 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d10003f70 0x7f8d2414f140 secure :-1 s=READY pgs=2530 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c011aa0 tx=0x7f8d0c011f60 comp rx=0 tx=0).stop 2023-06-10T19:07:51.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.753+0000 7f8d295d6640 1 -- 172.21.15.53:0/3477013230 shutdown_connections 2023-06-10T19:07:51.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.753+0000 7f8d295d6640 1 --2- 172.21.15.53:0/3477013230 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8d04066280 0x7f8d04068730 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:51.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.753+0000 7f8d295d6640 1 --2- 172.21.15.53:0/3477013230 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d240b0b60 0x7f8d240b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:51.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.753+0000 7f8d295d6640 1 --2- 172.21.15.53:0/3477013230 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8d241e4b90 0x7f8d241e5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:51.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.753+0000 7f8d295d6640 1 --2- 172.21.15.53:0/3477013230 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d10003f70 0x7f8d2414f140 unknown :-1 s=CLOSED pgs=2530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:51.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.753+0000 7f8d295d6640 1 -- 172.21.15.53:0/3477013230 >> 172.21.15.53:0/3477013230 conn(0x7f8d2406a0d0 msgr2=0x7f8d24155bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:51.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.753+0000 7f8d295d6640 1 -- 172.21.15.53:0/3477013230 shutdown_connections 2023-06-10T19:07:51.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.753+0000 7f8d295d6640 1 -- 172.21.15.53:0/3477013230 wait complete. 2023-06-10T19:07:51.773 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-06-10T19:07:51.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.885+0000 7f4a38350640 1 Processor -- start 2023-06-10T19:07:51.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.885+0000 7f4a38350640 1 -- start start 2023-06-10T19:07:51.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.885+0000 7f4a38350640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4a301571a0 0x7f4a300c9f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:51.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.885+0000 7f4a38350640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4a300afee0 0x7f4a300c83f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:51.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.885+0000 7f4a38350640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a30071190 con 0x7f4a30070100 2023-06-10T19:07:51.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.885+0000 7f4a38350640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a300ca440 con 0x7f4a301571a0 2023-06-10T19:07:51.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.885+0000 7f4a38350640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a30070580 con 0x7f4a300afee0 2023-06-10T19:07:51.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.885+0000 7f4a358eb640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f4a30070100 0x7f4a300af7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52414/0 (socket says 172.21.15.53:52414) 2023-06-10T19:07:51.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.885+0000 7f4a358eb640 1 -- 172.21.15.53:0/1768286577 learned_addr learned my addr 172.21.15.53:0/1768286577 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:07:51.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.885+0000 7f4a360ec640 1 --2- 172.21.15.53:0/1768286577 >> v2:172.21.15.53:3300/0 conn(0x7f4a301571a0 0x7f4a300c9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:51.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.885+0000 7f4a368ed640 1 --2- 172.21.15.53:0/1768286577 >> v2:172.21.15.117:3300/0 conn(0x7f4a300afee0 0x7f4a300c83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:51.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.885+0000 7f4a350ea640 1 -- 172.21.15.53:0/1768286577 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4110092849 0 0) 0x7f4a30071190 con 0x7f4a30070100 2023-06-10T19:07:51.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.885+0000 7f4a350ea640 1 -- 172.21.15.53:0/1768286577 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a1c003530 con 0x7f4a30070100 2023-06-10T19:07:51.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.885+0000 7f4a360ec640 1 -- 172.21.15.53:0/1768286577 >> v2:172.21.15.117:3300/0 conn(0x7f4a300afee0 msgr2=0x7f4a300c83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:51.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.885+0000 7f4a360ec640 1 --2- 172.21.15.53:0/1768286577 >> v2:172.21.15.117:3300/0 conn(0x7f4a300afee0 0x7f4a300c83f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:51.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.885+0000 7f4a360ec640 1 -- 172.21.15.53:0/1768286577 >> v1:172.21.15.53:6789/0 conn(0x7f4a30070100 legacy=0x7f4a300af7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:51.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.885+0000 7f4a350ea640 1 -- 172.21.15.53:0/1768286577 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2527699905 0 0) 0x7f4a1c003530 con 0x7f4a30070100 2023-06-10T19:07:51.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.885+0000 7f4a360ec640 1 -- 172.21.15.53:0/1768286577 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a30070860 con 0x7f4a301571a0 2023-06-10T19:07:51.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.889+0000 7f4a360ec640 1 --2- 172.21.15.53:0/1768286577 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a301571a0 0x7f4a300c9f00 secure :-1 s=READY pgs=2532 cs=0 l=1 rev1=1 crypto rx=0x7f4a30071100 tx=0x7f4a2c01c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6181c5e817ca9953 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:51.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.889+0000 7f4a350ea640 1 -- 172.21.15.53:0/1768286577 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a24001680 con 0x7f4a301571a0 2023-06-10T19:07:51.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.889+0000 7f4a350ea640 1 -- 172.21.15.53:0/1768286577 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a2c0a7050 con 0x7f4a301571a0 2023-06-10T19:07:51.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.889+0000 7f4a350ea640 1 -- 172.21.15.53:0/1768286577 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2c0ab620 con 0x7f4a301571a0 2023-06-10T19:07:51.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.889+0000 7f4a38350640 1 -- 172.21.15.53:0/1768286577 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a301571a0 msgr2=0x7f4a300c9f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:51.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.889+0000 7f4a38350640 1 --2- 172.21.15.53:0/1768286577 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a301571a0 0x7f4a300c9f00 secure :-1 s=READY pgs=2532 cs=0 l=1 rev1=1 crypto rx=0x7f4a30071100 tx=0x7f4a2c01c330 comp rx=0 tx=0).stop 2023-06-10T19:07:51.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.889+0000 7f4a38350640 1 -- 172.21.15.53:0/1768286577 shutdown_connections 2023-06-10T19:07:51.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.889+0000 7f4a38350640 1 --2- 172.21.15.53:0/1768286577 >> v2:172.21.15.117:3300/0 conn(0x7f4a300afee0 0x7f4a300c83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:51.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.889+0000 7f4a38350640 1 --2- 172.21.15.53:0/1768286577 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a301571a0 0x7f4a300c9f00 unknown :-1 s=CLOSED pgs=2532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:51.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.889+0000 7f4a38350640 1 -- 172.21.15.53:0/1768286577 >> 172.21.15.53:0/1768286577 conn(0x7f4a300ce9e0 msgr2=0x7f4a300ca7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:51.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.889+0000 7f4a38350640 1 -- 172.21.15.53:0/1768286577 shutdown_connections 2023-06-10T19:07:51.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.889+0000 7f4a38350640 1 -- 172.21.15.53:0/1768286577 wait complete. 2023-06-10T19:07:51.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.889+0000 7f4a38350640 1 Processor -- start 2023-06-10T19:07:51.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.889+0000 7f4a38350640 1 -- start start 2023-06-10T19:07:51.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.893+0000 7f4a38350640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a300afee0 0x7f4a3014d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:51.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.893+0000 7f4a38350640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a301571a0 0x7f4a300b30b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:51.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.893+0000 7f4a38350640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a3014d6a0 0x7f4a300b35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:51.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.893+0000 7f4a38350640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a30149670 con 0x7f4a301571a0 2023-06-10T19:07:51.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.893+0000 7f4a38350640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a300b2050 con 0x7f4a300afee0 2023-06-10T19:07:51.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.893+0000 7f4a38350640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a300b22f0 con 0x7f4a3014d6a0 2023-06-10T19:07:51.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.893+0000 7f4a358eb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a301571a0 0x7f4a300b30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:51.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.893+0000 7f4a358eb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a301571a0 0x7f4a300b30b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55702/0 (socket says 172.21.15.53:55702) 2023-06-10T19:07:51.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.893+0000 7f4a358eb640 1 -- 172.21.15.53:0/2654347325 learned_addr learned my addr 172.21.15.53:0/2654347325 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:51.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.893+0000 7f4a368ed640 1 --2- 172.21.15.53:0/2654347325 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a3014d6a0 0x7f4a300b35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:51.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.893+0000 7f4a358eb640 1 -- 172.21.15.53:0/2654347325 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a3014d6a0 msgr2=0x7f4a300b35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:51.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.893+0000 7f4a358eb640 1 --2- 172.21.15.53:0/2654347325 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a3014d6a0 0x7f4a300b35f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:51.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.893+0000 7f4a358eb640 1 -- 172.21.15.53:0/2654347325 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a300afee0 msgr2=0x7f4a3014d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:51.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.893+0000 7f4a358eb640 1 --2- 172.21.15.53:0/2654347325 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a300afee0 0x7f4a3014d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:51.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.893+0000 7f4a358eb640 1 -- 172.21.15.53:0/2654347325 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a2c0093c0 con 0x7f4a301571a0 2023-06-10T19:07:51.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.893+0000 7f4a358eb640 1 --2- 172.21.15.53:0/2654347325 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a301571a0 0x7f4a300b30b0 secure :-1 s=READY pgs=2533 cs=0 l=1 rev1=1 crypto rx=0x7f4a2400c750 tx=0x7f4a2400cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:51.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.893+0000 7f4a22ffd640 1 -- 172.21.15.53:0/2654347325 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a24005af0 con 0x7f4a301571a0 2023-06-10T19:07:51.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.893+0000 7f4a22ffd640 1 -- 172.21.15.53:0/2654347325 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a24005c50 con 0x7f4a301571a0 2023-06-10T19:07:51.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.893+0000 7f4a38350640 1 -- 172.21.15.53:0/2654347325 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a300b25d0 con 0x7f4a301571a0 2023-06-10T19:07:51.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.893+0000 7f4a22ffd640 1 -- 172.21.15.53:0/2654347325 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a24007070 con 0x7f4a301571a0 2023-06-10T19:07:51.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.893+0000 7f4a38350640 1 -- 172.21.15.53:0/2654347325 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a300b2b90 con 0x7f4a301571a0 2023-06-10T19:07:51.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.893+0000 7f4a38350640 1 -- 172.21.15.53:0/2654347325 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a300b2db0 con 0x7f4a301571a0 2023-06-10T19:07:51.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.893+0000 7f4a22ffd640 1 -- 172.21.15.53:0/2654347325 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4a240071d0 con 0x7f4a301571a0 2023-06-10T19:07:51.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.893+0000 7f4a22ffd640 1 --2- 172.21.15.53:0/2654347325 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4a14066280 0x7f4a14068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:51.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.893+0000 7f4a22ffd640 1 -- 172.21.15.53:0/2654347325 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6105+0+0 (secure 0 0 0) 0x7f4a24083b70 con 0x7f4a301571a0 2023-06-10T19:07:51.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.893+0000 7f4a360ec640 1 --2- 172.21.15.53:0/2654347325 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4a14066280 0x7f4a14068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:51.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.897+0000 7f4a360ec640 1 --2- 172.21.15.53:0/2654347325 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4a14066280 0x7f4a14068730 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c0ad000 tx=0x7f4a2c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:51.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:51.897+0000 7f4a22ffd640 1 -- 172.21.15.53:0/2654347325 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4a24054a50 con 0x7f4a301571a0 2023-06-10T19:07:52.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.081+0000 7f4a38350640 1 -- 172.21.15.53:0/2654347325 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f4a3004d790 con 0x7f4a301571a0 2023-06-10T19:07:52.229 INFO:tasks.ceph.mon.a.smithi053.stderr:2023-06-10T19:07:52.225+0000 7f74752c1640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-06-10T19:07:52.246 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.241+0000 7f4a22ffd640 1 -- 172.21.15.53:0/2654347325 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v97) v1 ==== 161+0+0 (secure 0 0 0) 0x7f4a24001370 con 0x7f4a301571a0 2023-06-10T19:07:52.246 INFO:teuthology.orchestra.run.smithi053.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-06-10T19:07:52.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.245+0000 7f4a38350640 1 -- 172.21.15.53:0/2654347325 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4a14066280 msgr2=0x7f4a14068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:52.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.245+0000 7f4a38350640 1 --2- 172.21.15.53:0/2654347325 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4a14066280 0x7f4a14068730 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c0ad000 tx=0x7f4a2c008040 comp rx=0 tx=0).stop 2023-06-10T19:07:52.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.245+0000 7f4a38350640 1 -- 172.21.15.53:0/2654347325 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a301571a0 msgr2=0x7f4a300b30b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:52.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.245+0000 7f4a38350640 1 --2- 172.21.15.53:0/2654347325 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a301571a0 0x7f4a300b30b0 secure :-1 s=READY pgs=2533 cs=0 l=1 rev1=1 crypto rx=0x7f4a2400c750 tx=0x7f4a2400cc10 comp rx=0 tx=0).stop 2023-06-10T19:07:52.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.245+0000 7f4a38350640 1 -- 172.21.15.53:0/2654347325 shutdown_connections 2023-06-10T19:07:52.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.245+0000 7f4a38350640 1 --2- 172.21.15.53:0/2654347325 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4a14066280 0x7f4a14068730 secure :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c0ad000 tx=0x7f4a2c008040 comp rx=0 tx=0).stop 2023-06-10T19:07:52.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.245+0000 7f4a38350640 1 --2- 172.21.15.53:0/2654347325 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a3014d6a0 0x7f4a300b35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:52.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.245+0000 7f4a38350640 1 --2- 172.21.15.53:0/2654347325 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a301571a0 0x7f4a300b30b0 unknown :-1 s=CLOSED pgs=2533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:52.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.245+0000 7f4a38350640 1 --2- 172.21.15.53:0/2654347325 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a300afee0 0x7f4a3014d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:52.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.245+0000 7f4a38350640 1 -- 172.21.15.53:0/2654347325 >> 172.21.15.53:0/2654347325 conn(0x7f4a300ce9e0 msgr2=0x7f4a300ad7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:52.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.245+0000 7f4a38350640 1 -- 172.21.15.53:0/2654347325 shutdown_connections 2023-06-10T19:07:52.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.245+0000 7f4a38350640 1 -- 172.21.15.53:0/2654347325 wait complete. 2023-06-10T19:07:52.251 INFO:tasks.ceph.mds.c.smithi053.stderr: -4012> 2023-06-10T19:07:16.302+0000 7fac14360640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-06-10T19:07:52.266 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-06-10T19:07:52.313 INFO:tasks.ceph.mds.c.smithi053.stdout:starting mds.c at 2023-06-10T19:07:52.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.397+0000 7fb15f9c6640 1 Processor -- start 2023-06-10T19:07:52.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.397+0000 7fb15f9c6640 1 -- start start 2023-06-10T19:07:52.402 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.397+0000 7fb15f9c6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb1580cec40 0x7fb1580cf090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:52.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.397+0000 7fb15f9c6640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1580cf5d0 con 0x7fb158159450 2023-06-10T19:07:52.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.397+0000 7fb15f9c6640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1580cbac0 con 0x7fb1580cbf50 2023-06-10T19:07:52.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.397+0000 7fb15f9c6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb15815dc00 con 0x7fb1580cec40 2023-06-10T19:07:52.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.397+0000 7fb15d762640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fb158159450 0x7fb15815d140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52420/0 (socket says 172.21.15.53:52420) 2023-06-10T19:07:52.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.397+0000 7fb15d762640 1 -- 172.21.15.53:0/1867262419 learned_addr learned my addr 172.21.15.53:0/1867262419 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:07:52.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.397+0000 7fb15cf61640 1 --2- 172.21.15.53:0/1867262419 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb1580cec40 0x7fb1580cf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:52.403 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.397+0000 7fb157fff640 1 -- 172.21.15.53:0/1867262419 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3835223163 0 0) 0x7fb150001120 con 0x7fb158159450 2023-06-10T19:07:52.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.397+0000 7fb157fff640 1 -- 172.21.15.53:0/1867262419 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb140003530 con 0x7fb158159450 2023-06-10T19:07:52.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.397+0000 7fb157fff640 1 -- 172.21.15.53:0/1867262419 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2587136089 0 0) 0x7fb140003530 con 0x7fb158159450 2023-06-10T19:07:52.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.397+0000 7fb157fff640 1 -- 172.21.15.53:0/1867262419 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb1580cec40 msgr2=0x7fb1580cf090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:52.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.397+0000 7fb157fff640 1 --2- 172.21.15.53:0/1867262419 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb1580cec40 0x7fb1580cf090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:52.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.397+0000 7fb157fff640 1 -- 172.21.15.53:0/1867262419 >> v1:172.21.15.117:6789/0 conn(0x7fb1580cbf50 legacy=0x7fb1580cc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:52.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.397+0000 7fb157fff640 1 -- 172.21.15.53:0/1867262419 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb15815dee0 con 0x7fb158159450 2023-06-10T19:07:52.404 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.397+0000 7fb157fff640 1 -- 172.21.15.53:0/1867262419 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fb150001810 con 0x7fb158159450 2023-06-10T19:07:52.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.397+0000 7fb157fff640 1 -- 172.21.15.53:0/1867262419 >> v1:172.21.15.53:6789/0 conn(0x7fb158159450 legacy=0x7fb15815d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:52.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.397+0000 7fb157fff640 1 --2- 172.21.15.53:0/1867262419 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb1400039b0 0x7fb140003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:52.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.397+0000 7fb157fff640 1 --2- 172.21.15.53:0/1867262419 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb1580cec40 0x7fb1400047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:52.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.401+0000 7fb157fff640 1 --2- 172.21.15.53:0/1867262419 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb140004d10 0x7fb140005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:52.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.401+0000 7fb157fff640 1 -- 172.21.15.53:0/1867262419 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb15815dc00 con 0x7fb1400039b0 2023-06-10T19:07:52.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.401+0000 7fb157fff640 1 -- 172.21.15.53:0/1867262419 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb14000ba40 con 0x7fb140004d10 2023-06-10T19:07:52.405 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.401+0000 7fb157fff640 1 -- 172.21.15.53:0/1867262419 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb14000bbd0 con 0x7fb1580cec40 2023-06-10T19:07:52.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.401+0000 7fb15d762640 1 --2- 172.21.15.53:0/1867262419 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb1400039b0 0x7fb140003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:52.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.401+0000 7fb15cf61640 1 --2- 172.21.15.53:0/1867262419 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb1580cec40 0x7fb1400047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:52.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.401+0000 7fb15d762640 1 -- 172.21.15.53:0/1867262419 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb1580cec40 msgr2=0x7fb1400047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:52.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.401+0000 7fb15d762640 1 --2- 172.21.15.53:0/1867262419 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb1580cec40 0x7fb1400047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:52.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.401+0000 7fb15d762640 1 -- 172.21.15.53:0/1867262419 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb140004d10 msgr2=0x7fb140005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:52.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.401+0000 7fb15d762640 1 --2- 172.21.15.53:0/1867262419 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb140004d10 0x7fb140005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:52.406 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.401+0000 7fb15d762640 1 -- 172.21.15.53:0/1867262419 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb140003530 con 0x7fb1400039b0 2023-06-10T19:07:52.408 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.401+0000 7fb15d762640 1 --2- 172.21.15.53:0/1867262419 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb1400039b0 0x7fb140003dc0 secure :-1 s=READY pgs=2537 cs=0 l=1 rev1=1 crypto rx=0x7fb15000c240 tx=0x7fb15001cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7132835311cf2b59 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:52.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.401+0000 7fb157fff640 1 -- 172.21.15.53:0/1867262419 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb150005ae0 con 0x7fb1400039b0 2023-06-10T19:07:52.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.401+0000 7fb157fff640 1 -- 172.21.15.53:0/1867262419 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb150005c60 con 0x7fb1400039b0 2023-06-10T19:07:52.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.401+0000 7fb157fff640 1 -- 172.21.15.53:0/1867262419 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1500a5800 con 0x7fb1400039b0 2023-06-10T19:07:52.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.401+0000 7fb15f9c6640 1 -- 172.21.15.53:0/1867262419 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb1400039b0 msgr2=0x7fb140003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:52.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.401+0000 7fb15f9c6640 1 --2- 172.21.15.53:0/1867262419 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb1400039b0 0x7fb140003dc0 secure :-1 s=READY pgs=2537 cs=0 l=1 rev1=1 crypto rx=0x7fb15000c240 tx=0x7fb15001cc10 comp rx=0 tx=0).stop 2023-06-10T19:07:52.409 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.401+0000 7fb15df63640 1 -- 172.21.15.53:0/1867262419 reap_dead start 2023-06-10T19:07:52.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.401+0000 7fb15f9c6640 1 -- 172.21.15.53:0/1867262419 shutdown_connections 2023-06-10T19:07:52.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.401+0000 7fb15f9c6640 1 -- 172.21.15.53:0/1867262419 >> 172.21.15.53:0/1867262419 conn(0x7fb15806a090 msgr2=0x7fb15806d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:52.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.401+0000 7fb15f9c6640 1 -- 172.21.15.53:0/1867262419 shutdown_connections 2023-06-10T19:07:52.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.401+0000 7fb15f9c6640 1 -- 172.21.15.53:0/1867262419 wait complete. 2023-06-10T19:07:52.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.405+0000 7fb15f9c6640 1 Processor -- start 2023-06-10T19:07:52.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.405+0000 7fb15f9c6640 1 -- start start 2023-06-10T19:07:52.410 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.405+0000 7fb15f9c6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb1400039b0 0x7fb15806af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:52.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.405+0000 7fb15f9c6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb15815c6e0 0x7fb15815b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:52.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.405+0000 7fb15f9c6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb15815b540 0x7fb15815b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:52.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.405+0000 7fb15f9c6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb15815bf20 con 0x7fb15815c6e0 2023-06-10T19:07:52.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.405+0000 7fb15f9c6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb15806b850 con 0x7fb15815b540 2023-06-10T19:07:52.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.405+0000 7fb15f9c6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb15806bb30 con 0x7fb1400039b0 2023-06-10T19:07:52.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.405+0000 7fb15cf61640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb15815c6e0 0x7fb15815b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:52.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.405+0000 7fb15cf61640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb15815c6e0 0x7fb15815b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55726/0 (socket says 172.21.15.53:55726) 2023-06-10T19:07:52.411 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.405+0000 7fb15cf61640 1 -- 172.21.15.53:0/472363715 learned_addr learned my addr 172.21.15.53:0/472363715 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:52.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.405+0000 7fb15d762640 1 --2- 172.21.15.53:0/472363715 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb1400039b0 0x7fb15806af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:52.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.405+0000 7fb15df63640 1 --2- 172.21.15.53:0/472363715 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb15815b540 0x7fb15815b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:52.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.405+0000 7fb15cf61640 1 -- 172.21.15.53:0/472363715 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb1400039b0 msgr2=0x7fb15806af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:52.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.405+0000 7fb15cf61640 1 --2- 172.21.15.53:0/472363715 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb1400039b0 0x7fb15806af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:52.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.405+0000 7fb15cf61640 1 -- 172.21.15.53:0/472363715 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb15815b540 msgr2=0x7fb15815b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:52.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.405+0000 7fb15cf61640 1 --2- 172.21.15.53:0/472363715 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb15815b540 0x7fb15815b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:52.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.405+0000 7fb15cf61640 1 -- 172.21.15.53:0/472363715 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb15815d9d0 con 0x7fb15815c6e0 2023-06-10T19:07:52.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.405+0000 7fb15cf61640 1 --2- 172.21.15.53:0/472363715 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb15815c6e0 0x7fb15815b000 secure :-1 s=READY pgs=2538 cs=0 l=1 rev1=1 crypto rx=0x7fb14c010890 tx=0x7fb14c010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:52.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.405+0000 7fb155ffb640 1 -- 172.21.15.53:0/472363715 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb14c009630 con 0x7fb15815c6e0 2023-06-10T19:07:52.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.405+0000 7fb155ffb640 1 -- 172.21.15.53:0/472363715 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb14c00eb60 con 0x7fb15815c6e0 2023-06-10T19:07:52.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.405+0000 7fb15f9c6640 1 -- 172.21.15.53:0/472363715 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb15806be10 con 0x7fb15815c6e0 2023-06-10T19:07:52.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.405+0000 7fb155ffb640 1 -- 172.21.15.53:0/472363715 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb14c01c400 con 0x7fb15815c6e0 2023-06-10T19:07:52.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.405+0000 7fb15f9c6640 1 -- 172.21.15.53:0/472363715 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1580c72a0 con 0x7fb15815c6e0 2023-06-10T19:07:52.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.405+0000 7fb15f9c6640 1 -- 172.21.15.53:0/472363715 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb15804d790 con 0x7fb15815c6e0 2023-06-10T19:07:52.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.405+0000 7fb155ffb640 1 -- 172.21.15.53:0/472363715 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb14c01c560 con 0x7fb15815c6e0 2023-06-10T19:07:52.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.405+0000 7fb155ffb640 1 --2- 172.21.15.53:0/472363715 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb144066280 0x7fb144068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:52.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.409+0000 7fb155ffb640 1 -- 172.21.15.53:0/472363715 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 6191+0+0 (secure 0 0 0) 0x7fb14c084230 con 0x7fb15815c6e0 2023-06-10T19:07:52.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.409+0000 7fb15d762640 1 --2- 172.21.15.53:0/472363715 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb144066280 0x7fb144068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:52.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.409+0000 7fb15d762640 1 --2- 172.21.15.53:0/472363715 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb144066280 0x7fb144068730 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fb1500ab000 tx=0x7fb1500a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:52.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.413+0000 7fb155ffb640 1 -- 172.21.15.53:0/472363715 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb14c051770 con 0x7fb15815c6e0 2023-06-10T19:07:52.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:52.601+0000 7fb15f9c6640 1 -- 172.21.15.53:0/472363715 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb15806df70 con 0x7fb15815c6e0 2023-06-10T19:07:53.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:53.245+0000 7fb155ffb640 1 -- 172.21.15.53:0/472363715 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v98) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb14c054d90 con 0x7fb15815c6e0 2023-06-10T19:07:53.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:53.249+0000 7fb15f9c6640 1 -- 172.21.15.53:0/472363715 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb144066280 msgr2=0x7fb144068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:53.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:53.249+0000 7fb15f9c6640 1 --2- 172.21.15.53:0/472363715 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb144066280 0x7fb144068730 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fb1500ab000 tx=0x7fb1500a7070 comp rx=0 tx=0).stop 2023-06-10T19:07:53.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:53.249+0000 7fb15f9c6640 1 -- 172.21.15.53:0/472363715 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb15815c6e0 msgr2=0x7fb15815b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:53.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:53.249+0000 7fb15f9c6640 1 --2- 172.21.15.53:0/472363715 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb15815c6e0 0x7fb15815b000 secure :-1 s=READY pgs=2538 cs=0 l=1 rev1=1 crypto rx=0x7fb14c010890 tx=0x7fb14c010d50 comp rx=0 tx=0).stop 2023-06-10T19:07:53.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:53.249+0000 7fb15f9c6640 1 -- 172.21.15.53:0/472363715 shutdown_connections 2023-06-10T19:07:53.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:53.249+0000 7fb15f9c6640 1 --2- 172.21.15.53:0/472363715 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb144066280 0x7fb144068730 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:53.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:53.249+0000 7fb15f9c6640 1 --2- 172.21.15.53:0/472363715 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb15815b540 0x7fb15815b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:53.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:53.249+0000 7fb15f9c6640 1 --2- 172.21.15.53:0/472363715 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb15815c6e0 0x7fb15815b000 unknown :-1 s=CLOSED pgs=2538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:53.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:53.249+0000 7fb15f9c6640 1 --2- 172.21.15.53:0/472363715 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb1400039b0 0x7fb15806af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:53.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:53.249+0000 7fb15f9c6640 1 -- 172.21.15.53:0/472363715 >> 172.21.15.53:0/472363715 conn(0x7fb15806a090 msgr2=0x7fb1580af890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:53.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:53.249+0000 7fb15f9c6640 1 -- 172.21.15.53:0/472363715 shutdown_connections 2023-06-10T19:07:53.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:53.249+0000 7fb15f9c6640 1 -- 172.21.15.53:0/472363715 wait complete. 2023-06-10T19:07:53.277 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-06-10T19:07:53.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:53.449+0000 7f1c3c3be640 1 Processor -- start 2023-06-10T19:07:53.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:53.449+0000 7f1c3c3be640 1 -- start start 2023-06-10T19:07:53.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:53.453+0000 7f1c3c3be640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1c3414f670 0x7f1c340cb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:53.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:53.453+0000 7f1c3c3be640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1c340b1130 0x7f1c340cec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:53.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:53.453+0000 7f1c3c3be640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c340b2c80 con 0x7f1c340cb5c0 2023-06-10T19:07:53.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:53.453+0000 7f1c3c3be640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c34070120 con 0x7f1c3414f670 2023-06-10T19:07:53.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:53.453+0000 7f1c3c3be640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c340cba10 con 0x7f1c340b1130 2023-06-10T19:07:53.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:53.453+0000 7f1c3a15a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1c3414f670 0x7f1c340cb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:53.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:53.453+0000 7f1c3a15a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1c3414f670 0x7f1c340cb080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55730/0 (socket says 172.21.15.53:55730) 2023-06-10T19:07:53.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:53.453+0000 7f1c3a15a640 1 -- 172.21.15.53:0/3354538832 learned_addr learned my addr 172.21.15.53:0/3354538832 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:53.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:53.453+0000 7f1c3a95b640 1 --2- 172.21.15.53:0/3354538832 >> v2:172.21.15.117:3300/0 conn(0x7f1c340b1130 0x7f1c340cec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:53.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:53.453+0000 7f1c3a15a640 1 -- 172.21.15.53:0/3354538832 >> v2:172.21.15.117:3300/0 conn(0x7f1c340b1130 msgr2=0x7f1c340cec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:53.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:53.453+0000 7f1c3a15a640 1 --2- 172.21.15.53:0/3354538832 >> v2:172.21.15.117:3300/0 conn(0x7f1c340b1130 0x7f1c340cec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:53.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:53.453+0000 7f1c3a15a640 1 -- 172.21.15.53:0/3354538832 >> v1:172.21.15.117:6789/0 conn(0x7f1c340cb5c0 legacy=0x7f1c340b0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:53.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:53.453+0000 7f1c3a15a640 1 -- 172.21.15.53:0/3354538832 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c3414fa40 con 0x7f1c3414f670 2023-06-10T19:07:53.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:53.453+0000 7f1c3a15a640 1 --2- 172.21.15.53:0/3354538832 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c3414f670 0x7f1c340cb080 secure :-1 s=READY pgs=2539 cs=0 l=1 rev1=1 crypto rx=0x7f1c3414fc30 tx=0x7f1c3001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6637b1958bfa86cf server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:53.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:53.457+0000 7f1c39158640 1 -- 172.21.15.53:0/3354538832 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c300aa5f0 con 0x7f1c3414f670 2023-06-10T19:07:53.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:53.457+0000 7f1c39158640 1 -- 172.21.15.53:0/3354538832 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c300aa750 con 0x7f1c3414f670 2023-06-10T19:07:53.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:53.457+0000 7f1c39158640 1 -- 172.21.15.53:0/3354538832 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c300aaae0 con 0x7f1c3414f670 2023-06-10T19:07:53.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:53.457+0000 7f1c3c3be640 1 -- 172.21.15.53:0/3354538832 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c3414f670 msgr2=0x7f1c340cb080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:53.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:53.457+0000 7f1c3c3be640 1 --2- 172.21.15.53:0/3354538832 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c3414f670 0x7f1c340cb080 secure :-1 s=READY pgs=2539 cs=0 l=1 rev1=1 crypto rx=0x7f1c3414fc30 tx=0x7f1c3001c490 comp rx=0 tx=0).stop 2023-06-10T19:07:53.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:53.457+0000 7f1c3c3be640 1 -- 172.21.15.53:0/3354538832 shutdown_connections 2023-06-10T19:07:53.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:53.457+0000 7f1c3c3be640 1 --2- 172.21.15.53:0/3354538832 >> v2:172.21.15.117:3300/0 conn(0x7f1c340b1130 0x7f1c340cec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:53.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:53.457+0000 7f1c3c3be640 1 --2- 172.21.15.53:0/3354538832 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c3414f670 0x7f1c340cb080 unknown :-1 s=CLOSED pgs=2539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:53.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:53.457+0000 7f1c3c3be640 1 -- 172.21.15.53:0/3354538832 >> 172.21.15.53:0/3354538832 conn(0x7f1c340b42b0 msgr2=0x7f1c340b46b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:53.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:53.457+0000 7f1c3c3be640 1 -- 172.21.15.53:0/3354538832 shutdown_connections 2023-06-10T19:07:53.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:53.457+0000 7f1c3c3be640 1 -- 172.21.15.53:0/3354538832 wait complete. 2023-06-10T19:07:53.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:53.457+0000 7f1c3c3be640 1 Processor -- start 2023-06-10T19:07:53.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:53.457+0000 7f1c3c3be640 1 -- start start 2023-06-10T19:07:53.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:53.457+0000 7f1c3c3be640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c340b1130 0x7f1c34148d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:53.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:53.457+0000 7f1c3c3be640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c340cb5c0 0x7f1c340cd160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:53.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:53.457+0000 7f1c3c3be640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c3414f670 0x7f1c34069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:53.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:53.457+0000 7f1c3c3be640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c340cde90 con 0x7f1c340cb5c0 2023-06-10T19:07:53.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:53.457+0000 7f1c3c3be640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c340cdbb0 con 0x7f1c340b1130 2023-06-10T19:07:53.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:53.457+0000 7f1c3c3be640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c340cbf70 con 0x7f1c3414f670 2023-06-10T19:07:53.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:53.457+0000 7f1c39959640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c340cb5c0 0x7f1c340cd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:53.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:53.457+0000 7f1c39959640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c340cb5c0 0x7f1c340cd160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55732/0 (socket says 172.21.15.53:55732) 2023-06-10T19:07:53.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:53.457+0000 7f1c39959640 1 -- 172.21.15.53:0/1984850126 learned_addr learned my addr 172.21.15.53:0/1984850126 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:53.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:53.457+0000 7f1c3a15a640 1 --2- 172.21.15.53:0/1984850126 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c340b1130 0x7f1c34148d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:53.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:53.457+0000 7f1c3a95b640 1 --2- 172.21.15.53:0/1984850126 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c3414f670 0x7f1c34069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:53.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:53.457+0000 7f1c39959640 1 -- 172.21.15.53:0/1984850126 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c3414f670 msgr2=0x7f1c34069450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:53.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:53.457+0000 7f1c39959640 1 --2- 172.21.15.53:0/1984850126 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c3414f670 0x7f1c34069450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:53.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:53.457+0000 7f1c39959640 1 -- 172.21.15.53:0/1984850126 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c340b1130 msgr2=0x7f1c34148d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:53.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:53.457+0000 7f1c39959640 1 --2- 172.21.15.53:0/1984850126 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c340b1130 0x7f1c34148d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:53.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:53.457+0000 7f1c39959640 1 -- 172.21.15.53:0/1984850126 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c300094d0 con 0x7f1c340cb5c0 2023-06-10T19:07:53.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:53.457+0000 7f1c3a15a640 1 --2- 172.21.15.53:0/1984850126 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c340b1130 0x7f1c34148d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:07:53.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:53.457+0000 7f1c39959640 1 --2- 172.21.15.53:0/1984850126 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c340cb5c0 0x7f1c340cd160 secure :-1 s=READY pgs=2540 cs=0 l=1 rev1=1 crypto rx=0x7f1c2400c430 tx=0x7f1c2400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:53.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:53.457+0000 7f1c2affd640 1 -- 172.21.15.53:0/1984850126 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c24011790 con 0x7f1c340cb5c0 2023-06-10T19:07:53.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:53.457+0000 7f1c2affd640 1 -- 172.21.15.53:0/1984850126 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c240118f0 con 0x7f1c340cb5c0 2023-06-10T19:07:53.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:53.457+0000 7f1c2affd640 1 -- 172.21.15.53:0/1984850126 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c24011ce0 con 0x7f1c340cb5c0 2023-06-10T19:07:53.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:53.461+0000 7f1c3c3be640 1 -- 172.21.15.53:0/1984850126 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c340cc250 con 0x7f1c340cb5c0 2023-06-10T19:07:53.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:53.461+0000 7f1c3c3be640 1 -- 172.21.15.53:0/1984850126 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c341492b0 con 0x7f1c340cb5c0 2023-06-10T19:07:53.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:53.461+0000 7f1c3c3be640 1 -- 172.21.15.53:0/1984850126 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c340cbdd0 con 0x7f1c340cb5c0 2023-06-10T19:07:53.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:53.461+0000 7f1c2affd640 1 -- 172.21.15.53:0/1984850126 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1c24012420 con 0x7f1c340cb5c0 2023-06-10T19:07:53.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:53.461+0000 7f1c2affd640 1 --2- 172.21.15.53:0/1984850126 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1c18066280 0x7f1c18068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:53.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:53.461+0000 7f1c2affd640 1 -- 172.21.15.53:0/1984850126 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 6191+0+0 (secure 0 0 0) 0x7f1c24083a10 con 0x7f1c340cb5c0 2023-06-10T19:07:53.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:53.461+0000 7f1c3a15a640 1 --2- 172.21.15.53:0/1984850126 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1c18066280 0x7f1c18068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:53.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:53.461+0000 7f1c3a15a640 1 --2- 172.21.15.53:0/1984850126 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1c18066280 0x7f1c18068730 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f1c300ae000 tx=0x7f1c300a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:53.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:53.465+0000 7f1c2affd640 1 -- 172.21.15.53:0/1984850126 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1c340cbdd0 con 0x7f1c340cb5c0 2023-06-10T19:07:53.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:53.625+0000 7f1c3c3be640 1 -- 172.21.15.53:0/1984850126 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1c340cbdd0 con 0x7f1c340cb5c0 2023-06-10T19:07:54.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:54.257+0000 7f1c2affd640 1 -- 172.21.15.53:0/1984850126 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v170) v1 ==== 181+0+0 (secure 0 0 0) 0x7f1c340cbdd0 con 0x7f1c340cb5c0 2023-06-10T19:07:54.263 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_metadata' removed 2023-06-10T19:07:54.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:54.265+0000 7f1c3c3be640 1 -- 172.21.15.53:0/1984850126 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1c18066280 msgr2=0x7f1c18068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:54.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:54.265+0000 7f1c3c3be640 1 --2- 172.21.15.53:0/1984850126 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1c18066280 0x7f1c18068730 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f1c300ae000 tx=0x7f1c300a7000 comp rx=0 tx=0).stop 2023-06-10T19:07:54.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:54.265+0000 7f1c3c3be640 1 -- 172.21.15.53:0/1984850126 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c340cb5c0 msgr2=0x7f1c340cd160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:54.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:54.265+0000 7f1c3c3be640 1 --2- 172.21.15.53:0/1984850126 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c340cb5c0 0x7f1c340cd160 secure :-1 s=READY pgs=2540 cs=0 l=1 rev1=1 crypto rx=0x7f1c2400c430 tx=0x7f1c2400c8f0 comp rx=0 tx=0).stop 2023-06-10T19:07:54.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:54.265+0000 7f1c3c3be640 1 -- 172.21.15.53:0/1984850126 shutdown_connections 2023-06-10T19:07:54.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:54.265+0000 7f1c3c3be640 1 --2- 172.21.15.53:0/1984850126 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1c18066280 0x7f1c18068730 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:54.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:54.265+0000 7f1c3c3be640 1 --2- 172.21.15.53:0/1984850126 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c3414f670 0x7f1c34069450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:54.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:54.265+0000 7f1c3c3be640 1 --2- 172.21.15.53:0/1984850126 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c340cb5c0 0x7f1c340cd160 unknown :-1 s=CLOSED pgs=2540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:54.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:54.265+0000 7f1c3c3be640 1 --2- 172.21.15.53:0/1984850126 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c340b1130 0x7f1c34148d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:54.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:54.265+0000 7f1c3c3be640 1 -- 172.21.15.53:0/1984850126 >> 172.21.15.53:0/1984850126 conn(0x7f1c340b42b0 msgr2=0x7f1c3415bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:54.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:54.265+0000 7f1c3c3be640 1 -- 172.21.15.53:0/1984850126 shutdown_connections 2023-06-10T19:07:54.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:54.265+0000 7f1c3c3be640 1 -- 172.21.15.53:0/1984850126 wait complete. 2023-06-10T19:07:54.292 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-06-10T19:07:54.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:54.421+0000 7f9533745640 1 Processor -- start 2023-06-10T19:07:54.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:54.421+0000 7f9533745640 1 -- start start 2023-06-10T19:07:54.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:54.421+0000 7f9533745640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f952c159940 0x7f952c0c9b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:54.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:54.421+0000 7f9533745640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f952c0aff40 0x7f952c0c8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:54.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:54.421+0000 7f9533745640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f952c159d10 con 0x7f952c0ca050 2023-06-10T19:07:54.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:54.421+0000 7f9533745640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f952c0ca4d0 con 0x7f952c159940 2023-06-10T19:07:54.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:54.421+0000 7f9533745640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f952c06b100 con 0x7f952c0aff40 2023-06-10T19:07:54.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:54.421+0000 7f95314e1640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f952c159940 0x7f952c0c9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:54.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:54.421+0000 7f95314e1640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f952c159940 0x7f952c0c9b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55746/0 (socket says 172.21.15.53:55746) 2023-06-10T19:07:54.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:54.421+0000 7f95314e1640 1 -- 172.21.15.53:0/4024803477 learned_addr learned my addr 172.21.15.53:0/4024803477 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:54.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:54.421+0000 7f9531ce2640 1 --2- 172.21.15.53:0/4024803477 >> v2:172.21.15.117:3300/0 conn(0x7f952c0aff40 0x7f952c0c8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:54.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:54.421+0000 7f95314e1640 1 -- 172.21.15.53:0/4024803477 >> v2:172.21.15.117:3300/0 conn(0x7f952c0aff40 msgr2=0x7f952c0c8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:54.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:54.421+0000 7f95314e1640 1 --2- 172.21.15.53:0/4024803477 >> v2:172.21.15.117:3300/0 conn(0x7f952c0aff40 0x7f952c0c8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:54.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:54.421+0000 7f95314e1640 1 -- 172.21.15.53:0/4024803477 >> v1:172.21.15.117:6789/0 conn(0x7f952c0ca050 legacy=0x7f952c0af830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:54.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:54.421+0000 7f95314e1640 1 -- 172.21.15.53:0/4024803477 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f952c06bc80 con 0x7f952c159940 2023-06-10T19:07:54.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:54.421+0000 7f9531ce2640 1 --2- 172.21.15.53:0/4024803477 >> v2:172.21.15.117:3300/0 conn(0x7f952c0aff40 0x7f952c0c8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:07:54.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:54.425+0000 7f95314e1640 1 --2- 172.21.15.53:0/4024803477 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f952c159940 0x7f952c0c9b10 secure :-1 s=READY pgs=2541 cs=0 l=1 rev1=1 crypto rx=0x7f952c0cee50 tx=0x7f952801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=320a5b46c3b46e27 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:54.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:54.425+0000 7f9523fff640 1 -- 172.21.15.53:0/4024803477 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95280ab600 con 0x7f952c159940 2023-06-10T19:07:54.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:54.425+0000 7f9523fff640 1 -- 172.21.15.53:0/4024803477 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95280a7050 con 0x7f952c159940 2023-06-10T19:07:54.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:54.425+0000 7f9523fff640 1 -- 172.21.15.53:0/4024803477 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95280ab980 con 0x7f952c159940 2023-06-10T19:07:54.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:54.425+0000 7f9533745640 1 -- 172.21.15.53:0/4024803477 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f952c159940 msgr2=0x7f952c0c9b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:54.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:54.425+0000 7f9533745640 1 --2- 172.21.15.53:0/4024803477 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f952c159940 0x7f952c0c9b10 secure :-1 s=READY pgs=2541 cs=0 l=1 rev1=1 crypto rx=0x7f952c0cee50 tx=0x7f952801c430 comp rx=0 tx=0).stop 2023-06-10T19:07:54.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:54.425+0000 7f9533745640 1 -- 172.21.15.53:0/4024803477 shutdown_connections 2023-06-10T19:07:54.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:54.425+0000 7f9533745640 1 --2- 172.21.15.53:0/4024803477 >> v2:172.21.15.117:3300/0 conn(0x7f952c0aff40 0x7f952c0c8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:54.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:54.425+0000 7f9533745640 1 --2- 172.21.15.53:0/4024803477 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f952c159940 0x7f952c0c9b10 unknown :-1 s=CLOSED pgs=2541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:54.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:54.425+0000 7f9533745640 1 -- 172.21.15.53:0/4024803477 >> 172.21.15.53:0/4024803477 conn(0x7f952c0ca830 msgr2=0x7f952c0cac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:54.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:54.425+0000 7f9533745640 1 -- 172.21.15.53:0/4024803477 shutdown_connections 2023-06-10T19:07:54.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:54.425+0000 7f9533745640 1 -- 172.21.15.53:0/4024803477 wait complete. 2023-06-10T19:07:54.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:54.425+0000 7f9533745640 1 Processor -- start 2023-06-10T19:07:54.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:54.425+0000 7f9533745640 1 -- start start 2023-06-10T19:07:54.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:54.425+0000 7f9533745640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f952c0aff40 0x7f952c147b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:54.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:54.425+0000 7f9533745640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f952c0ca050 0x7f952c0b1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:54.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:54.425+0000 7f9533745640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f952c159940 0x7f952c15b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:54.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:54.425+0000 7f9533745640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f952c0c3b60 con 0x7f952c159940 2023-06-10T19:07:54.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:54.425+0000 7f9533745640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f952c0c3ff0 con 0x7f952c0ca050 2023-06-10T19:07:54.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:54.425+0000 7f9533745640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f952c0c2f50 con 0x7f952c0aff40 2023-06-10T19:07:54.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:54.429+0000 7f9531ce2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f952c159940 0x7f952c15b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:54.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:54.429+0000 7f9531ce2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f952c159940 0x7f952c15b560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55760/0 (socket says 172.21.15.53:55760) 2023-06-10T19:07:54.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:54.429+0000 7f9531ce2640 1 -- 172.21.15.53:0/938695634 learned_addr learned my addr 172.21.15.53:0/938695634 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:54.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:54.429+0000 7f9530ce0640 1 --2- 172.21.15.53:0/938695634 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f952c0ca050 0x7f952c0b1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:54.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:54.429+0000 7f95314e1640 1 --2- 172.21.15.53:0/938695634 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f952c0aff40 0x7f952c147b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:54.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:54.429+0000 7f9531ce2640 1 -- 172.21.15.53:0/938695634 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f952c0aff40 msgr2=0x7f952c147b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:54.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:54.429+0000 7f9531ce2640 1 --2- 172.21.15.53:0/938695634 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f952c0aff40 0x7f952c147b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:54.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:54.429+0000 7f9531ce2640 1 -- 172.21.15.53:0/938695634 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f952c0ca050 msgr2=0x7f952c0b1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:54.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:54.429+0000 7f9531ce2640 1 --2- 172.21.15.53:0/938695634 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f952c0ca050 0x7f952c0b1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:54.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:54.429+0000 7f9531ce2640 1 -- 172.21.15.53:0/938695634 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95280094d0 con 0x7f952c159940 2023-06-10T19:07:54.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:54.429+0000 7f9531ce2640 1 --2- 172.21.15.53:0/938695634 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f952c159940 0x7f952c15b560 secure :-1 s=READY pgs=2542 cs=0 l=1 rev1=1 crypto rx=0x7f952400cd50 tx=0x7f952400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:54.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:54.429+0000 7f9521ffb640 1 -- 172.21.15.53:0/938695634 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f952400f680 con 0x7f952c159940 2023-06-10T19:07:54.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:54.429+0000 7f9521ffb640 1 -- 172.21.15.53:0/938695634 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f952400f800 con 0x7f952c159940 2023-06-10T19:07:54.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:54.429+0000 7f9533745640 1 -- 172.21.15.53:0/938695634 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f952c0c3230 con 0x7f952c159940 2023-06-10T19:07:54.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:54.429+0000 7f9521ffb640 1 -- 172.21.15.53:0/938695634 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f952400fbb0 con 0x7f952c159940 2023-06-10T19:07:54.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:54.429+0000 7f9533745640 1 -- 172.21.15.53:0/938695634 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f952c0c37f0 con 0x7f952c159940 2023-06-10T19:07:54.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:54.429+0000 7f9533745640 1 -- 172.21.15.53:0/938695634 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f952c0c3cd0 con 0x7f952c159940 2023-06-10T19:07:54.435 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:54.429+0000 7f9521ffb640 1 -- 172.21.15.53:0/938695634 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f952400b040 con 0x7f952c159940 2023-06-10T19:07:54.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:54.433+0000 7f9521ffb640 1 --2- 172.21.15.53:0/938695634 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f95100662b0 0x7f9510068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:54.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:54.433+0000 7f9521ffb640 1 -- 172.21.15.53:0/938695634 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 5753+0+0 (secure 0 0 0) 0x7f9524084680 con 0x7f952c159940 2023-06-10T19:07:54.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:54.433+0000 7f95314e1640 1 --2- 172.21.15.53:0/938695634 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f95100662b0 0x7f9510068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:54.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:54.437+0000 7f95314e1640 1 --2- 172.21.15.53:0/938695634 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f95100662b0 0x7f9510068760 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f95280ad000 tx=0x7f9528009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:54.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:54.445+0000 7f9521ffb640 1 -- 172.21.15.53:0/938695634 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9524051b90 con 0x7f952c159940 2023-06-10T19:07:54.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:54.601+0000 7f9533745640 1 -- 172.21.15.53:0/938695634 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f952c0c3980 con 0x7f952c159940 2023-06-10T19:07:55.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.285+0000 7f9521ffb640 1 -- 172.21.15.53:0/938695634 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v171) v1 ==== 169+0+0 (secure 0 0 0) 0x7f95240551b0 con 0x7f952c159940 2023-06-10T19:07:55.287 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_data' removed 2023-06-10T19:07:55.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.289+0000 7f9533745640 1 -- 172.21.15.53:0/938695634 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f95100662b0 msgr2=0x7f9510068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:55.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.289+0000 7f9533745640 1 --2- 172.21.15.53:0/938695634 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f95100662b0 0x7f9510068760 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f95280ad000 tx=0x7f9528009040 comp rx=0 tx=0).stop 2023-06-10T19:07:55.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.289+0000 7f9533745640 1 -- 172.21.15.53:0/938695634 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f952c159940 msgr2=0x7f952c15b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:55.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.289+0000 7f9533745640 1 --2- 172.21.15.53:0/938695634 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f952c159940 0x7f952c15b560 secure :-1 s=READY pgs=2542 cs=0 l=1 rev1=1 crypto rx=0x7f952400cd50 tx=0x7f952400a650 comp rx=0 tx=0).stop 2023-06-10T19:07:55.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.289+0000 7f9533745640 1 -- 172.21.15.53:0/938695634 shutdown_connections 2023-06-10T19:07:55.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.289+0000 7f9533745640 1 --2- 172.21.15.53:0/938695634 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f95100662b0 0x7f9510068760 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:55.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.289+0000 7f9533745640 1 --2- 172.21.15.53:0/938695634 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f952c159940 0x7f952c15b560 unknown :-1 s=CLOSED pgs=2542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:55.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.289+0000 7f9533745640 1 --2- 172.21.15.53:0/938695634 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f952c0ca050 0x7f952c0b1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:55.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.289+0000 7f9533745640 1 --2- 172.21.15.53:0/938695634 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f952c0aff40 0x7f952c147b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:55.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.289+0000 7f9533745640 1 -- 172.21.15.53:0/938695634 >> 172.21.15.53:0/938695634 conn(0x7f952c0ca830 msgr2=0x7f952c15d370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:55.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.289+0000 7f9533745640 1 -- 172.21.15.53:0/938695634 shutdown_connections 2023-06-10T19:07:55.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.289+0000 7f9533745640 1 -- 172.21.15.53:0/938695634 wait complete. 2023-06-10T19:07:55.318 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-06-10T19:07:55.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.445+0000 7f37ea621640 1 Processor -- start 2023-06-10T19:07:55.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.445+0000 7f37ea621640 1 -- start start 2023-06-10T19:07:55.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.445+0000 7f37ea621640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f37e4159930 0x7f37e4069450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:55.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.445+0000 7f37ea621640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f37e40b4600 0x7f37e4069990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:55.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.445+0000 7f37ea621640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37e4070b50 con 0x7f37e4159560 2023-06-10T19:07:55.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.445+0000 7f37ea621640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37e406cc10 con 0x7f37e40b4600 2023-06-10T19:07:55.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.445+0000 7f37ea621640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37e406ceb0 con 0x7f37e4159930 2023-06-10T19:07:55.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.445+0000 7f37e37fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f37e4159930 0x7f37e4069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:55.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.445+0000 7f37e8bbe640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f37e40b4600 0x7f37e4069990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:55.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.449+0000 7f37e8bbe640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f37e40b4600 0x7f37e4069990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.53:47996/0 (socket says 172.21.15.53:47996) 2023-06-10T19:07:55.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.449+0000 7f37e8bbe640 1 -- 172.21.15.53:0/1423822522 learned_addr learned my addr 172.21.15.53:0/1423822522 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:55.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.449+0000 7f37e3fff640 1 --1- 172.21.15.53:0/1423822522 >> v1:172.21.15.117:6789/0 conn(0x7f37e4159560 0x7f37e40b12f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.53:48406/0 (socket says 172.21.15.53:48406) 2023-06-10T19:07:55.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.449+0000 7f37e8bbe640 1 -- 172.21.15.53:0/1423822522 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f37e4159930 msgr2=0x7f37e4069450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:55.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.449+0000 7f37e8bbe640 1 --2- 172.21.15.53:0/1423822522 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f37e4159930 0x7f37e4069450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:55.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.449+0000 7f37e8bbe640 1 -- 172.21.15.53:0/1423822522 >> v1:172.21.15.117:6789/0 conn(0x7f37e4159560 legacy=0x7f37e40b12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:55.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.449+0000 7f37e8bbe640 1 -- 172.21.15.53:0/1423822522 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37e406d190 con 0x7f37e40b4600 2023-06-10T19:07:55.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.449+0000 7f37e8bbe640 1 --2- 172.21.15.53:0/1423822522 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f37e40b4600 0x7f37e4069990 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f37d4009870 tx=0x7f37d401c4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f684c57f3375245c server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:55.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.449+0000 7f37e2ffd640 1 -- 172.21.15.53:0/1423822522 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d40ac620 con 0x7f37e40b4600 2023-06-10T19:07:55.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.449+0000 7f37e2ffd640 1 -- 172.21.15.53:0/1423822522 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37d40ac780 con 0x7f37e40b4600 2023-06-10T19:07:55.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.449+0000 7f37e2ffd640 1 -- 172.21.15.53:0/1423822522 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d40acb10 con 0x7f37e40b4600 2023-06-10T19:07:55.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.449+0000 7f37ea621640 1 -- 172.21.15.53:0/1423822522 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f37e40b4600 msgr2=0x7f37e4069990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:55.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.449+0000 7f37ea621640 1 --2- 172.21.15.53:0/1423822522 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f37e40b4600 0x7f37e4069990 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f37d4009870 tx=0x7f37d401c4b0 comp rx=0 tx=0).stop 2023-06-10T19:07:55.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.449+0000 7f37ea621640 1 -- 172.21.15.53:0/1423822522 shutdown_connections 2023-06-10T19:07:55.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.449+0000 7f37ea621640 1 --2- 172.21.15.53:0/1423822522 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f37e40b4600 0x7f37e4069990 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:55.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.449+0000 7f37ea621640 1 --2- 172.21.15.53:0/1423822522 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f37e4159930 0x7f37e4069450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:55.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.449+0000 7f37ea621640 1 -- 172.21.15.53:0/1423822522 >> 172.21.15.53:0/1423822522 conn(0x7f37e406a560 msgr2=0x7f37e406a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:55.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.449+0000 7f37ea621640 1 -- 172.21.15.53:0/1423822522 shutdown_connections 2023-06-10T19:07:55.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.449+0000 7f37ea621640 1 -- 172.21.15.53:0/1423822522 wait complete. 2023-06-10T19:07:55.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.453+0000 7f37ea621640 1 Processor -- start 2023-06-10T19:07:55.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.453+0000 7f37ea621640 1 -- start start 2023-06-10T19:07:55.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.453+0000 7f37ea621640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37e40b4600 0x7f37e41459c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:55.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.453+0000 7f37ea621640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f37e4159560 0x7f37e4156060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:55.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.453+0000 7f37ea621640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f37e4159930 0x7f37e41565a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:55.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.453+0000 7f37ea621640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37e40cd200 con 0x7f37e40b4600 2023-06-10T19:07:55.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.453+0000 7f37ea621640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37e4155bd0 con 0x7f37e4159930 2023-06-10T19:07:55.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.453+0000 7f37ea621640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37e4146530 con 0x7f37e4159560 2023-06-10T19:07:55.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.453+0000 7f37e3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37e40b4600 0x7f37e41459c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:55.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.453+0000 7f37e3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37e40b4600 0x7f37e41459c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55774/0 (socket says 172.21.15.53:55774) 2023-06-10T19:07:55.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.453+0000 7f37e3fff640 1 -- 172.21.15.53:0/4189145432 learned_addr learned my addr 172.21.15.53:0/4189145432 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:55.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.453+0000 7f37e8bbe640 1 --2- 172.21.15.53:0/4189145432 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f37e4159930 0x7f37e41565a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:55.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.453+0000 7f37e37fe640 1 --2- 172.21.15.53:0/4189145432 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f37e4159560 0x7f37e4156060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:55.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.453+0000 7f37e3fff640 1 -- 172.21.15.53:0/4189145432 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f37e4159560 msgr2=0x7f37e4156060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:55.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.453+0000 7f37e3fff640 1 --2- 172.21.15.53:0/4189145432 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f37e4159560 0x7f37e4156060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:55.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.453+0000 7f37e3fff640 1 -- 172.21.15.53:0/4189145432 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f37e4159930 msgr2=0x7f37e41565a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:55.458 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.453+0000 7f37e3fff640 1 --2- 172.21.15.53:0/4189145432 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f37e4159930 0x7f37e41565a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:55.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.453+0000 7f37e3fff640 1 -- 172.21.15.53:0/4189145432 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37d40094d0 con 0x7f37e40b4600 2023-06-10T19:07:55.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.453+0000 7f37e8bbe640 1 --2- 172.21.15.53:0/4189145432 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f37e4159930 0x7f37e41565a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:07:55.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.453+0000 7f37e3fff640 1 --2- 172.21.15.53:0/4189145432 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37e40b4600 0x7f37e41459c0 secure :-1 s=READY pgs=2543 cs=0 l=1 rev1=1 crypto rx=0x7f37dc00c450 tx=0x7f37dc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:55.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.453+0000 7f37e0ff9640 1 -- 172.21.15.53:0/4189145432 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37dc007480 con 0x7f37e40b4600 2023-06-10T19:07:55.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.453+0000 7f37e0ff9640 1 -- 172.21.15.53:0/4189145432 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37dc0075e0 con 0x7f37e40b4600 2023-06-10T19:07:55.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.453+0000 7f37e0ff9640 1 -- 172.21.15.53:0/4189145432 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37dc004a30 con 0x7f37e40b4600 2023-06-10T19:07:55.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.453+0000 7f37ea621640 1 -- 172.21.15.53:0/4189145432 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37e41552a0 con 0x7f37e40b4600 2023-06-10T19:07:55.460 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.453+0000 7f37ea621640 1 -- 172.21.15.53:0/4189145432 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37e4155860 con 0x7f37e40b4600 2023-06-10T19:07:55.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.453+0000 7f37ea621640 1 -- 172.21.15.53:0/4189145432 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37e404d790 con 0x7f37e40b4600 2023-06-10T19:07:55.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.457+0000 7f37e0ff9640 1 -- 172.21.15.53:0/4189145432 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f37dc004b90 con 0x7f37e40b4600 2023-06-10T19:07:55.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.457+0000 7f37e0ff9640 1 --2- 172.21.15.53:0/4189145432 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f37d00662b0 0x7f37d0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:55.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.457+0000 7f37e0ff9640 1 -- 172.21.15.53:0/4189145432 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f37dc082b80 con 0x7f37e40b4600 2023-06-10T19:07:55.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.457+0000 7f37e37fe640 1 --2- 172.21.15.53:0/4189145432 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f37d00662b0 0x7f37d0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:55.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.457+0000 7f37e37fe640 1 --2- 172.21.15.53:0/4189145432 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f37d00662b0 0x7f37d0068760 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f37e4154e30 tx=0x7f37d800b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:55.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.461+0000 7f37e0ff9640 1 -- 172.21.15.53:0/4189145432 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f37dc050230 con 0x7f37e40b4600 2023-06-10T19:07:55.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.617+0000 7f37ea621640 1 -- 172.21.15.53:0/4189145432 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f37e406b330 con 0x7f37e40b4600 2023-06-10T19:07:55.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.625+0000 7f37e0ff9640 1 -- 172.21.15.53:0/4189145432 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v29) v1 ==== 104+0+0 (secure 0 0 0) 0x7f37dc053850 con 0x7f37e40b4600 2023-06-10T19:07:55.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.629+0000 7f37ea621640 1 -- 172.21.15.53:0/4189145432 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f37d00662b0 msgr2=0x7f37d0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:55.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.629+0000 7f37ea621640 1 --2- 172.21.15.53:0/4189145432 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f37d00662b0 0x7f37d0068760 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f37e4154e30 tx=0x7f37d800b040 comp rx=0 tx=0).stop 2023-06-10T19:07:55.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.629+0000 7f37ea621640 1 -- 172.21.15.53:0/4189145432 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37e40b4600 msgr2=0x7f37e41459c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:55.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.629+0000 7f37ea621640 1 --2- 172.21.15.53:0/4189145432 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37e40b4600 0x7f37e41459c0 secure :-1 s=READY pgs=2543 cs=0 l=1 rev1=1 crypto rx=0x7f37dc00c450 tx=0x7f37dc00c910 comp rx=0 tx=0).stop 2023-06-10T19:07:55.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.629+0000 7f37ea621640 1 -- 172.21.15.53:0/4189145432 shutdown_connections 2023-06-10T19:07:55.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.629+0000 7f37ea621640 1 --2- 172.21.15.53:0/4189145432 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f37d00662b0 0x7f37d0068760 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:55.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.629+0000 7f37ea621640 1 --2- 172.21.15.53:0/4189145432 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f37e4159930 0x7f37e41565a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:55.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.629+0000 7f37ea621640 1 --2- 172.21.15.53:0/4189145432 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f37e4159560 0x7f37e4156060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:55.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.629+0000 7f37ea621640 1 --2- 172.21.15.53:0/4189145432 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37e40b4600 0x7f37e41459c0 unknown :-1 s=CLOSED pgs=2543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:55.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.629+0000 7f37ea621640 1 -- 172.21.15.53:0/4189145432 >> 172.21.15.53:0/4189145432 conn(0x7f37e406a560 msgr2=0x7f37e4158750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:55.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.629+0000 7f37ea621640 1 -- 172.21.15.53:0/4189145432 shutdown_connections 2023-06-10T19:07:55.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.629+0000 7f37ea621640 1 -- 172.21.15.53:0/4189145432 wait complete. 2023-06-10T19:07:55.649 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_mount_after_evicted_client' 2023-06-10T19:07:55.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.773+0000 7f0fb4395640 1 Processor -- start 2023-06-10T19:07:55.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.773+0000 7f0fb4395640 1 -- start start 2023-06-10T19:07:55.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.777+0000 7f0fb4395640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0fac06b780 0x7f0fac15c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:55.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.777+0000 7f0fb4395640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0fac0ceb20 0x7f0fac0cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:55.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.777+0000 7f0fb4395640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fac0af530 con 0x7f0fac06bb50 2023-06-10T19:07:55.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.777+0000 7f0fb4395640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fac15c3d0 con 0x7f0fac0ceb20 2023-06-10T19:07:55.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.777+0000 7f0fb4395640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fac15fd70 con 0x7f0fac06b780 2023-06-10T19:07:55.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.777+0000 7f0fb2932640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0fac0ceb20 0x7f0fac0cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:55.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.777+0000 7f0fb1930640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f0fac06bb50 0x7f0fac15f320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52422/0 (socket says 172.21.15.53:52422) 2023-06-10T19:07:55.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.777+0000 7f0fb1930640 1 -- 172.21.15.53:0/12368381 learned_addr learned my addr 172.21.15.53:0/12368381 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:07:55.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.777+0000 7f0fb2131640 1 --2- 172.21.15.53:0/12368381 >> v2:172.21.15.117:3300/0 conn(0x7f0fac06b780 0x7f0fac15c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:55.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.777+0000 7f0fb2932640 1 -- 172.21.15.53:0/12368381 >> v2:172.21.15.117:3300/0 conn(0x7f0fac06b780 msgr2=0x7f0fac15c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:55.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.777+0000 7f0fb2932640 1 --2- 172.21.15.53:0/12368381 >> v2:172.21.15.117:3300/0 conn(0x7f0fac06b780 0x7f0fac15c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:55.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.777+0000 7f0fb2932640 1 -- 172.21.15.53:0/12368381 >> v1:172.21.15.53:6789/0 conn(0x7f0fac06bb50 legacy=0x7f0fac15f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:55.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.777+0000 7f0fb2932640 1 -- 172.21.15.53:0/12368381 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fac160050 con 0x7f0fac0ceb20 2023-06-10T19:07:55.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.777+0000 7f0fb2932640 1 --2- 172.21.15.53:0/12368381 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0fac0ceb20 0x7f0fac0cefa0 secure :-1 s=READY pgs=2545 cs=0 l=1 rev1=1 crypto rx=0x7f0fac0d0f20 tx=0x7f0fa401c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3204ee43fb5a6243 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:55.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.777+0000 7f0fb112f640 1 -- 172.21.15.53:0/12368381 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa40a5850 con 0x7f0fac0ceb20 2023-06-10T19:07:55.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.777+0000 7f0fb112f640 1 -- 172.21.15.53:0/12368381 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fa40a59b0 con 0x7f0fac0ceb20 2023-06-10T19:07:55.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.777+0000 7f0fb112f640 1 -- 172.21.15.53:0/12368381 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa40a5d40 con 0x7f0fac0ceb20 2023-06-10T19:07:55.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.781+0000 7f0fb4395640 1 -- 172.21.15.53:0/12368381 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0fac0ceb20 msgr2=0x7f0fac0cefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:55.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.781+0000 7f0fb4395640 1 --2- 172.21.15.53:0/12368381 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0fac0ceb20 0x7f0fac0cefa0 secure :-1 s=READY pgs=2545 cs=0 l=1 rev1=1 crypto rx=0x7f0fac0d0f20 tx=0x7f0fa401c880 comp rx=0 tx=0).stop 2023-06-10T19:07:55.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.781+0000 7f0fb4395640 1 -- 172.21.15.53:0/12368381 shutdown_connections 2023-06-10T19:07:55.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.781+0000 7f0fb4395640 1 --2- 172.21.15.53:0/12368381 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0fac0ceb20 0x7f0fac0cefa0 unknown :-1 s=CLOSED pgs=2545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:55.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.781+0000 7f0fb4395640 1 --2- 172.21.15.53:0/12368381 >> v2:172.21.15.117:3300/0 conn(0x7f0fac06b780 0x7f0fac15c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:55.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.781+0000 7f0fb4395640 1 -- 172.21.15.53:0/12368381 >> 172.21.15.53:0/12368381 conn(0x7f0fac06a090 msgr2=0x7f0fac06d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:55.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.781+0000 7f0fb4395640 1 -- 172.21.15.53:0/12368381 shutdown_connections 2023-06-10T19:07:55.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.781+0000 7f0fb4395640 1 -- 172.21.15.53:0/12368381 wait complete. 2023-06-10T19:07:55.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.781+0000 7f0fb4395640 1 Processor -- start 2023-06-10T19:07:55.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.781+0000 7f0fb4395640 1 -- start start 2023-06-10T19:07:55.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.781+0000 7f0fb4395640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0fac06b780 0x7f0fac157530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:55.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.781+0000 7f0fb4395640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0fac06bb50 0x7f0fac0cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:55.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.781+0000 7f0fb4395640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0fac0ceb20 0x7f0fac0b0360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:55.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.781+0000 7f0fb4395640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fac0cc920 con 0x7f0fac06b780 2023-06-10T19:07:55.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.781+0000 7f0fb4395640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fac0cbae0 con 0x7f0fac06bb50 2023-06-10T19:07:55.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.781+0000 7f0fb4395640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fac0cbda0 con 0x7f0fac0ceb20 2023-06-10T19:07:55.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.781+0000 7f0fb2131640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0fac06b780 0x7f0fac157530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:55.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.781+0000 7f0fb2131640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0fac06b780 0x7f0fac157530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55796/0 (socket says 172.21.15.53:55796) 2023-06-10T19:07:55.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.781+0000 7f0fb2131640 1 -- 172.21.15.53:0/3672386085 learned_addr learned my addr 172.21.15.53:0/3672386085 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:55.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.781+0000 7f0fb2932640 1 --2- 172.21.15.53:0/3672386085 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0fac0ceb20 0x7f0fac0b0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:55.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.781+0000 7f0fb1930640 1 --2- 172.21.15.53:0/3672386085 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0fac06bb50 0x7f0fac0cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:55.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.781+0000 7f0fb2131640 1 -- 172.21.15.53:0/3672386085 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0fac0ceb20 msgr2=0x7f0fac0b0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:55.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.781+0000 7f0fb2131640 1 --2- 172.21.15.53:0/3672386085 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0fac0ceb20 0x7f0fac0b0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:55.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.781+0000 7f0fb2131640 1 -- 172.21.15.53:0/3672386085 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0fac06bb50 msgr2=0x7f0fac0cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:55.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.781+0000 7f0fb2131640 1 --2- 172.21.15.53:0/3672386085 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0fac06bb50 0x7f0fac0cb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:55.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.781+0000 7f0fb2131640 1 -- 172.21.15.53:0/3672386085 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fa4009a70 con 0x7f0fac06b780 2023-06-10T19:07:55.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.781+0000 7f0fb1930640 1 --2- 172.21.15.53:0/3672386085 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0fac06bb50 0x7f0fac0cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:07:55.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.781+0000 7f0fb2131640 1 --2- 172.21.15.53:0/3672386085 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0fac06b780 0x7f0fac157530 secure :-1 s=READY pgs=2546 cs=0 l=1 rev1=1 crypto rx=0x7f0fa800d5f0 tx=0x7f0fa800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:55.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.781+0000 7f0fa2ffd640 1 -- 172.21.15.53:0/3672386085 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa80125f0 con 0x7f0fac06b780 2023-06-10T19:07:55.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.781+0000 7f0fa2ffd640 1 -- 172.21.15.53:0/3672386085 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fa8012750 con 0x7f0fac06b780 2023-06-10T19:07:55.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.781+0000 7f0fa2ffd640 1 -- 172.21.15.53:0/3672386085 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa8012ae0 con 0x7f0fac06b780 2023-06-10T19:07:55.791 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.785+0000 7f0fb4395640 1 -- 172.21.15.53:0/3672386085 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fac0cc080 con 0x7f0fac06b780 2023-06-10T19:07:55.791 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.785+0000 7f0fb4395640 1 -- 172.21.15.53:0/3672386085 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fac0cc640 con 0x7f0fac06b780 2023-06-10T19:07:55.791 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.785+0000 7f0fb4395640 1 -- 172.21.15.53:0/3672386085 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fac04d790 con 0x7f0fac06b780 2023-06-10T19:07:55.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.785+0000 7f0fa2ffd640 1 -- 172.21.15.53:0/3672386085 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0fa8012c40 con 0x7f0fac06b780 2023-06-10T19:07:55.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.785+0000 7f0fa2ffd640 1 --2- 172.21.15.53:0/3672386085 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0f90066280 0x7f0f90068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:55.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.785+0000 7f0fa2ffd640 1 -- 172.21.15.53:0/3672386085 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f0fa8083f90 con 0x7f0fac06b780 2023-06-10T19:07:55.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.785+0000 7f0fb1930640 1 --2- 172.21.15.53:0/3672386085 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0f90066280 0x7f0f90068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:55.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.785+0000 7f0fb1930640 1 --2- 172.21.15.53:0/3672386085 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0f90066280 0x7f0f90068730 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f0fac155e00 tx=0x7f0f9c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:55.793 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:55.789+0000 7f0fa2ffd640 1 -- 172.21.15.53:0/3672386085 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0fa80b4700 con 0x7f0fac06b780 2023-06-10T19:07:56.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:56.001+0000 7f0fb4395640 1 -- 172.21.15.53:0/3672386085 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_mount_after_evicted_client"]} v 0) v1 -- 0x7f0fac06df70 con 0x7f0fac06b780 2023-06-10T19:07:56.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:56.301+0000 7f0fa2ffd640 1 -- 172.21.15.53:0/3672386085 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_mount_after_evicted_client"]}]=0 v724) v1 ==== 163+0+0 (secure 0 0 0) 0x7f0fa80516e0 con 0x7f0fac06b780 2023-06-10T19:07:56.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:56.305+0000 7f0fb4395640 1 -- 172.21.15.53:0/3672386085 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0f90066280 msgr2=0x7f0f90068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:56.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:56.305+0000 7f0fb4395640 1 --2- 172.21.15.53:0/3672386085 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0f90066280 0x7f0f90068730 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f0fac155e00 tx=0x7f0f9c009040 comp rx=0 tx=0).stop 2023-06-10T19:07:56.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:56.305+0000 7f0fb4395640 1 -- 172.21.15.53:0/3672386085 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0fac06b780 msgr2=0x7f0fac157530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:56.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:56.305+0000 7f0fb4395640 1 --2- 172.21.15.53:0/3672386085 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0fac06b780 0x7f0fac157530 secure :-1 s=READY pgs=2546 cs=0 l=1 rev1=1 crypto rx=0x7f0fa800d5f0 tx=0x7f0fa800dab0 comp rx=0 tx=0).stop 2023-06-10T19:07:56.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:56.305+0000 7f0fb4395640 1 -- 172.21.15.53:0/3672386085 shutdown_connections 2023-06-10T19:07:56.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:56.305+0000 7f0fb4395640 1 --2- 172.21.15.53:0/3672386085 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f0f90066280 0x7f0f90068730 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:56.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:56.305+0000 7f0fb4395640 1 --2- 172.21.15.53:0/3672386085 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0fac0ceb20 0x7f0fac0b0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:56.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:56.305+0000 7f0fb4395640 1 --2- 172.21.15.53:0/3672386085 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0fac06bb50 0x7f0fac0cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:56.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:56.305+0000 7f0fb4395640 1 --2- 172.21.15.53:0/3672386085 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0fac06b780 0x7f0fac157530 unknown :-1 s=CLOSED pgs=2546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:56.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:56.305+0000 7f0fb4395640 1 -- 172.21.15.53:0/3672386085 >> 172.21.15.53:0/3672386085 conn(0x7f0fac06a090 msgr2=0x7f0fac0af7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:56.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:56.305+0000 7f0fb4395640 1 -- 172.21.15.53:0/3672386085 shutdown_connections 2023-06-10T19:07:56.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:56.305+0000 7f0fb4395640 1 -- 172.21.15.53:0/3672386085 wait complete. 2023-06-10T19:07:56.332 INFO:tasks.cephfs_test_runner:Test if a new mount of same fs works after client eviction. ... ok 2023-06-10T19:07:56.332 INFO:tasks.cephfs_test_runner:Starting test: test_reconnect_after_blocklisted (tasks.cephfs.test_client_recovery.TestClientRecovery) 2023-06-10T19:07:56.333 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_reconnect_after_blocklisted' 2023-06-10T19:07:56.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:56.461+0000 7faf6b934640 1 Processor -- start 2023-06-10T19:07:56.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:56.461+0000 7faf6b934640 1 -- start start 2023-06-10T19:07:56.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:56.465+0000 7faf6b934640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7faf640c8d00 0x7faf6406b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:56.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:56.465+0000 7faf6b934640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf64158a90 con 0x7faf6406b2f0 2023-06-10T19:07:56.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:56.465+0000 7faf6b934640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf6406f780 con 0x7faf6406bc00 2023-06-10T19:07:56.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:56.465+0000 7faf6b934640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf640705d0 con 0x7faf640c8d00 2023-06-10T19:07:56.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:56.465+0000 7faf68ecf640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7faf640c8d00 0x7faf6406b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:56.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:56.465+0000 7faf696d0640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7faf6406b2f0 0x7faf6406f070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52436/0 (socket says 172.21.15.53:52436) 2023-06-10T19:07:56.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:56.465+0000 7faf696d0640 1 -- 172.21.15.53:0/1133402295 learned_addr learned my addr 172.21.15.53:0/1133402295 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:07:56.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:56.465+0000 7faf68ecf640 1 -- 172.21.15.53:0/1133402295 >> v1:172.21.15.117:6789/0 conn(0x7faf6406bc00 legacy=0x7faf64162180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:56.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:56.465+0000 7faf68ecf640 1 -- 172.21.15.53:0/1133402295 >> v1:172.21.15.53:6789/0 conn(0x7faf6406b2f0 legacy=0x7faf6406f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:56.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:56.465+0000 7faf68ecf640 1 -- 172.21.15.53:0/1133402295 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf640cce10 con 0x7faf640c8d00 2023-06-10T19:07:56.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:56.465+0000 7faf68ecf640 1 --2- 172.21.15.53:0/1133402295 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf640c8d00 0x7faf6406b6c0 secure :-1 s=READY pgs=2548 cs=0 l=1 rev1=1 crypto rx=0x7faf540097c0 tx=0x7faf5401ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb2ae6bb8e7c7878 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:56.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:56.465+0000 7faf5bfff640 1 -- 172.21.15.53:0/1133402295 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf540a8930 con 0x7faf640c8d00 2023-06-10T19:07:56.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:56.469+0000 7faf5bfff640 1 -- 172.21.15.53:0/1133402295 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf540a8a90 con 0x7faf640c8d00 2023-06-10T19:07:56.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:56.469+0000 7faf5bfff640 1 -- 172.21.15.53:0/1133402295 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf540a8e20 con 0x7faf640c8d00 2023-06-10T19:07:56.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:56.469+0000 7faf6b934640 1 -- 172.21.15.53:0/1133402295 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf640c8d00 msgr2=0x7faf6406b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:56.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:56.469+0000 7faf6b934640 1 --2- 172.21.15.53:0/1133402295 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf640c8d00 0x7faf6406b6c0 secure :-1 s=READY pgs=2548 cs=0 l=1 rev1=1 crypto rx=0x7faf540097c0 tx=0x7faf5401ec30 comp rx=0 tx=0).stop 2023-06-10T19:07:56.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:56.469+0000 7faf6b934640 1 -- 172.21.15.53:0/1133402295 shutdown_connections 2023-06-10T19:07:56.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:56.469+0000 7faf6b934640 1 --2- 172.21.15.53:0/1133402295 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf640c8d00 0x7faf6406b6c0 unknown :-1 s=CLOSED pgs=2548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:56.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:56.469+0000 7faf6b934640 1 -- 172.21.15.53:0/1133402295 >> 172.21.15.53:0/1133402295 conn(0x7faf6406a0d0 msgr2=0x7faf640ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:56.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:56.469+0000 7faf6b934640 1 -- 172.21.15.53:0/1133402295 shutdown_connections 2023-06-10T19:07:56.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:56.469+0000 7faf6b934640 1 -- 172.21.15.53:0/1133402295 wait complete. 2023-06-10T19:07:56.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:56.469+0000 7faf6b934640 1 Processor -- start 2023-06-10T19:07:56.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:56.469+0000 7faf6b934640 1 -- start start 2023-06-10T19:07:56.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:56.469+0000 7faf6b934640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf6406b2f0 0x7faf64153030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:56.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:56.469+0000 7faf6b934640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf6406bc00 0x7faf64156670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:56.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:56.469+0000 7faf6b934640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf640c8d00 0x7faf641542c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:56.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:56.469+0000 7faf6b934640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf64155240 con 0x7faf640c8d00 2023-06-10T19:07:56.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:56.469+0000 7faf6b934640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf640b22b0 con 0x7faf6406b2f0 2023-06-10T19:07:56.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:56.469+0000 7faf6b934640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf640b2ac0 con 0x7faf6406bc00 2023-06-10T19:07:56.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:56.469+0000 7faf69ed1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf640c8d00 0x7faf641542c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:56.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:56.469+0000 7faf69ed1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf640c8d00 0x7faf641542c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55822/0 (socket says 172.21.15.53:55822) 2023-06-10T19:07:56.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:56.469+0000 7faf69ed1640 1 -- 172.21.15.53:0/1777787 learned_addr learned my addr 172.21.15.53:0/1777787 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:56.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:56.469+0000 7faf696d0640 1 --2- 172.21.15.53:0/1777787 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf6406b2f0 0x7faf64153030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:56.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:56.469+0000 7faf68ecf640 1 --2- 172.21.15.53:0/1777787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf6406bc00 0x7faf64156670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:56.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:56.469+0000 7faf69ed1640 1 -- 172.21.15.53:0/1777787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf6406bc00 msgr2=0x7faf64156670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:56.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:56.469+0000 7faf69ed1640 1 --2- 172.21.15.53:0/1777787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf6406bc00 0x7faf64156670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:56.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:56.469+0000 7faf69ed1640 1 -- 172.21.15.53:0/1777787 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf6406b2f0 msgr2=0x7faf64153030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:56.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:56.469+0000 7faf69ed1640 1 --2- 172.21.15.53:0/1777787 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf6406b2f0 0x7faf64153030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:56.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:56.469+0000 7faf69ed1640 1 -- 172.21.15.53:0/1777787 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf54009420 con 0x7faf640c8d00 2023-06-10T19:07:56.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:56.469+0000 7faf696d0640 1 --2- 172.21.15.53:0/1777787 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf6406b2f0 0x7faf64153030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:07:56.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:56.469+0000 7faf69ed1640 1 --2- 172.21.15.53:0/1777787 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf640c8d00 0x7faf641542c0 secure :-1 s=READY pgs=2549 cs=0 l=1 rev1=1 crypto rx=0x7faf5c00c7b0 tx=0x7faf5c00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:56.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:56.469+0000 7faf59ffb640 1 -- 172.21.15.53:0/1777787 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c003d90 con 0x7faf640c8d00 2023-06-10T19:07:56.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:56.469+0000 7faf59ffb640 1 -- 172.21.15.53:0/1777787 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf5c005070 con 0x7faf640c8d00 2023-06-10T19:07:56.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:56.469+0000 7faf59ffb640 1 -- 172.21.15.53:0/1777787 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c005420 con 0x7faf640c8d00 2023-06-10T19:07:56.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:56.469+0000 7faf6b934640 1 -- 172.21.15.53:0/1777787 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf640b13f0 con 0x7faf640c8d00 2023-06-10T19:07:56.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:56.469+0000 7faf6b934640 1 -- 172.21.15.53:0/1777787 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf640b27e0 con 0x7faf640c8d00 2023-06-10T19:07:56.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:56.473+0000 7faf6b934640 1 -- 172.21.15.53:0/1777787 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf6404d790 con 0x7faf640c8d00 2023-06-10T19:07:56.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:56.473+0000 7faf59ffb640 1 -- 172.21.15.53:0/1777787 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7faf5c005580 con 0x7faf640c8d00 2023-06-10T19:07:56.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:56.473+0000 7faf59ffb640 1 --2- 172.21.15.53:0/1777787 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7faf480662b0 0x7faf48068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:56.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:56.473+0000 7faf59ffb640 1 -- 172.21.15.53:0/1777787 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 5339+0+0 (secure 0 0 0) 0x7faf5c082e00 con 0x7faf640c8d00 2023-06-10T19:07:56.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:56.473+0000 7faf696d0640 1 --2- 172.21.15.53:0/1777787 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7faf480662b0 0x7faf48068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:56.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:56.473+0000 7faf696d0640 1 --2- 172.21.15.53:0/1777787 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7faf480662b0 0x7faf48068760 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7faf60005890 tx=0x7faf60009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:56.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:56.477+0000 7faf59ffb640 1 -- 172.21.15.53:0/1777787 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7faf5c0505e0 con 0x7faf640c8d00 2023-06-10T19:07:56.696 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:56.693+0000 7faf6b934640 1 -- 172.21.15.53:0/1777787 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_reconnect_after_blocklisted"]} v 0) v1 -- 0x7faf640af8c0 con 0x7faf640c8d00 2023-06-10T19:07:57.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.305+0000 7faf59ffb640 1 -- 172.21.15.53:0/1777787 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientRecovery.test_reconnect_after_blocklisted"]}]=0 v725) v1 ==== 167+0+0 (secure 0 0 0) 0x7faf5c053c00 con 0x7faf640c8d00 2023-06-10T19:07:57.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.305+0000 7faf6b934640 1 -- 172.21.15.53:0/1777787 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7faf480662b0 msgr2=0x7faf48068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:57.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.305+0000 7faf6b934640 1 --2- 172.21.15.53:0/1777787 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7faf480662b0 0x7faf48068760 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7faf60005890 tx=0x7faf60009040 comp rx=0 tx=0).stop 2023-06-10T19:07:57.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.305+0000 7faf6b934640 1 -- 172.21.15.53:0/1777787 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf640c8d00 msgr2=0x7faf641542c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:57.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.305+0000 7faf6b934640 1 --2- 172.21.15.53:0/1777787 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf640c8d00 0x7faf641542c0 secure :-1 s=READY pgs=2549 cs=0 l=1 rev1=1 crypto rx=0x7faf5c00c7b0 tx=0x7faf5c00cc70 comp rx=0 tx=0).stop 2023-06-10T19:07:57.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.305+0000 7faf6b934640 1 -- 172.21.15.53:0/1777787 shutdown_connections 2023-06-10T19:07:57.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.305+0000 7faf6b934640 1 --2- 172.21.15.53:0/1777787 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7faf480662b0 0x7faf48068760 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:57.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.305+0000 7faf6b934640 1 --2- 172.21.15.53:0/1777787 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf640c8d00 0x7faf641542c0 unknown :-1 s=CLOSED pgs=2549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:57.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.305+0000 7faf6b934640 1 --2- 172.21.15.53:0/1777787 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faf6406bc00 0x7faf64156670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:57.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.305+0000 7faf6b934640 1 --2- 172.21.15.53:0/1777787 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf6406b2f0 0x7faf64153030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:57.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.305+0000 7faf6b934640 1 -- 172.21.15.53:0/1777787 >> 172.21.15.53:0/1777787 conn(0x7faf6406a0d0 msgr2=0x7faf6406c060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:57.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.305+0000 7faf6b934640 1 -- 172.21.15.53:0/1777787 shutdown_connections 2023-06-10T19:07:57.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.305+0000 7faf6b934640 1 -- 172.21.15.53:0/1777787 wait complete. 2023-06-10T19:07:57.329 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-06-10T19:07:57.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.457+0000 7f8e50db3640 1 Processor -- start 2023-06-10T19:07:57.459 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.457+0000 7f8e50db3640 1 -- start start 2023-06-10T19:07:57.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.457+0000 7f8e50db3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8e4c15c060 0x7f8e4c0cc020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:57.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.457+0000 7f8e50db3640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8e4c070de0 0x7f8e4c15c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:57.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.457+0000 7f8e50db3640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e4c0c8d50 con 0x7f8e4c15c970 2023-06-10T19:07:57.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.457+0000 7f8e50db3640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e4c0c9030 con 0x7f8e4c070de0 2023-06-10T19:07:57.461 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.457+0000 7f8e50db3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4c070300 con 0x7f8e4c15c060 2023-06-10T19:07:57.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.457+0000 7f8e4a59c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8e4c15c060 0x7f8e4c0cc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:57.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.457+0000 7f8e49d9b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8e4c070de0 0x7f8e4c15c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:57.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.457+0000 7f8e4a59c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8e4c15c060 0x7f8e4c0cc020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.53:40226/0 (socket says 172.21.15.53:40226) 2023-06-10T19:07:57.462 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.457+0000 7f8e4a59c640 1 -- 172.21.15.53:0/2685954419 learned_addr learned my addr 172.21.15.53:0/2685954419 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:57.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.457+0000 7f8e4a59c640 1 -- 172.21.15.53:0/2685954419 >> v2:172.21.15.117:3300/0 conn(0x7f8e4c070de0 msgr2=0x7f8e4c15c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:57.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.457+0000 7f8e4a59c640 1 --2- 172.21.15.53:0/2685954419 >> v2:172.21.15.117:3300/0 conn(0x7f8e4c070de0 0x7f8e4c15c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:57.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.457+0000 7f8e4a59c640 1 -- 172.21.15.53:0/2685954419 >> v1:172.21.15.117:6789/0 conn(0x7f8e4c15c970 legacy=0x7f8e4c06bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:57.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.457+0000 7f8e4a59c640 1 -- 172.21.15.53:0/2685954419 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e4c0705e0 con 0x7f8e4c15c060 2023-06-10T19:07:57.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.457+0000 7f8e49d9b640 1 --2- 172.21.15.53:0/2685954419 >> v2:172.21.15.117:3300/0 conn(0x7f8e4c070de0 0x7f8e4c15c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-10T19:07:57.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.461+0000 7f8e4a59c640 1 --2- 172.21.15.53:0/2685954419 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8e4c15c060 0x7f8e4c0cc020 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8e3400bb10 tx=0x7f8e3401eb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=246e6c4e895822dc server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:57.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.461+0000 7f8e4959a640 1 -- 172.21.15.53:0/2685954419 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e340a7a60 con 0x7f8e4c15c060 2023-06-10T19:07:57.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.461+0000 7f8e4959a640 1 -- 172.21.15.53:0/2685954419 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e340a7bc0 con 0x7f8e4c15c060 2023-06-10T19:07:57.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.461+0000 7f8e4959a640 1 -- 172.21.15.53:0/2685954419 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e340af440 con 0x7f8e4c15c060 2023-06-10T19:07:57.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.461+0000 7f8e50db3640 1 -- 172.21.15.53:0/2685954419 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8e4c15c060 msgr2=0x7f8e4c0cc020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:57.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.461+0000 7f8e50db3640 1 --2- 172.21.15.53:0/2685954419 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8e4c15c060 0x7f8e4c0cc020 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8e3400bb10 tx=0x7f8e3401eb80 comp rx=0 tx=0).stop 2023-06-10T19:07:57.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.461+0000 7f8e50db3640 1 -- 172.21.15.53:0/2685954419 shutdown_connections 2023-06-10T19:07:57.465 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.461+0000 7f8e50db3640 1 --2- 172.21.15.53:0/2685954419 >> v2:172.21.15.117:3300/0 conn(0x7f8e4c070de0 0x7f8e4c15c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:57.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.461+0000 7f8e50db3640 1 --2- 172.21.15.53:0/2685954419 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8e4c15c060 0x7f8e4c0cc020 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:57.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.461+0000 7f8e50db3640 1 -- 172.21.15.53:0/2685954419 >> 172.21.15.53:0/2685954419 conn(0x7f8e4c06a0e0 msgr2=0x7f8e4c0cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:57.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.461+0000 7f8e50db3640 1 -- 172.21.15.53:0/2685954419 shutdown_connections 2023-06-10T19:07:57.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.461+0000 7f8e50db3640 1 -- 172.21.15.53:0/2685954419 wait complete. 2023-06-10T19:07:57.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.461+0000 7f8e50db3640 1 Processor -- start 2023-06-10T19:07:57.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.461+0000 7f8e50db3640 1 -- start start 2023-06-10T19:07:57.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.465+0000 7f8e50db3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e4c070de0 0x7f8e4c14a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:57.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.465+0000 7f8e50db3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8e4c15c060 0x7f8e4c0b0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:57.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.465+0000 7f8e50db3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8e4c15c970 0x7f8e4c0b1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:57.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.465+0000 7f8e50db3640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4c14aa90 con 0x7f8e4c070de0 2023-06-10T19:07:57.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.465+0000 7f8e50db3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4c1574d0 con 0x7f8e4c15c060 2023-06-10T19:07:57.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.465+0000 7f8e50db3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4c159d80 con 0x7f8e4c15c970 2023-06-10T19:07:57.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.465+0000 7f8e4a59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e4c070de0 0x7f8e4c14a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:57.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.465+0000 7f8e4a59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e4c070de0 0x7f8e4c14a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55836/0 (socket says 172.21.15.53:55836) 2023-06-10T19:07:57.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.465+0000 7f8e4a59c640 1 -- 172.21.15.53:0/1938860572 learned_addr learned my addr 172.21.15.53:0/1938860572 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:57.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.465+0000 7f8e49d9b640 1 --2- 172.21.15.53:0/1938860572 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8e4c15c060 0x7f8e4c0b0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:57.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.465+0000 7f8e4ad9d640 1 --2- 172.21.15.53:0/1938860572 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8e4c15c970 0x7f8e4c0b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:57.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.465+0000 7f8e4a59c640 1 -- 172.21.15.53:0/1938860572 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8e4c15c970 msgr2=0x7f8e4c0b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:57.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.465+0000 7f8e4a59c640 1 --2- 172.21.15.53:0/1938860572 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8e4c15c970 0x7f8e4c0b1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:57.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.465+0000 7f8e4a59c640 1 -- 172.21.15.53:0/1938860572 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8e4c15c060 msgr2=0x7f8e4c0b0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:57.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.465+0000 7f8e4a59c640 1 --2- 172.21.15.53:0/1938860572 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8e4c15c060 0x7f8e4c0b0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:57.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.465+0000 7f8e4a59c640 1 -- 172.21.15.53:0/1938860572 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e3c009420 con 0x7f8e4c070de0 2023-06-10T19:07:57.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.465+0000 7f8e4a59c640 1 --2- 172.21.15.53:0/1938860572 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e4c070de0 0x7f8e4c14a550 secure :-1 s=READY pgs=2550 cs=0 l=1 rev1=1 crypto rx=0x7f8e3400b2c0 tx=0x7f8e3401d3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:57.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.465+0000 7f8e42ffd640 1 -- 172.21.15.53:0/1938860572 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e340afe30 con 0x7f8e4c070de0 2023-06-10T19:07:57.470 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.465+0000 7f8e42ffd640 1 -- 172.21.15.53:0/1938860572 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e340ba480 con 0x7f8e4c070de0 2023-06-10T19:07:57.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.465+0000 7f8e50db3640 1 -- 172.21.15.53:0/1938860572 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e3400b770 con 0x7f8e4c070de0 2023-06-10T19:07:57.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.465+0000 7f8e42ffd640 1 -- 172.21.15.53:0/1938860572 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e340ba830 con 0x7f8e4c070de0 2023-06-10T19:07:57.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.465+0000 7f8e50db3640 1 -- 172.21.15.53:0/1938860572 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e4c158950 con 0x7f8e4c070de0 2023-06-10T19:07:57.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.465+0000 7f8e50db3640 1 -- 172.21.15.53:0/1938860572 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e4c04d790 con 0x7f8e4c070de0 2023-06-10T19:07:57.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.465+0000 7f8e42ffd640 1 -- 172.21.15.53:0/1938860572 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8e340ba990 con 0x7f8e4c070de0 2023-06-10T19:07:57.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.465+0000 7f8e42ffd640 1 --2- 172.21.15.53:0/1938860572 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8e2c0662b0 0x7f8e2c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:57.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.465+0000 7f8e42ffd640 1 -- 172.21.15.53:0/1938860572 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f8e3411edf0 con 0x7f8e4c070de0 2023-06-10T19:07:57.472 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.469+0000 7f8e49d9b640 1 --2- 172.21.15.53:0/1938860572 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8e2c0662b0 0x7f8e2c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:57.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.469+0000 7f8e49d9b640 1 --2- 172.21.15.53:0/1938860572 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8e2c0662b0 0x7f8e2c068760 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c0c8450 tx=0x7f8e3c009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:57.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.473+0000 7f8e42ffd640 1 -- 172.21.15.53:0/1938860572 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8e340ec660 con 0x7f8e4c070de0 2023-06-10T19:07:57.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.625+0000 7f8e50db3640 1 -- 172.21.15.53:0/1938860572 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f8e4c06bf20 con 0x7f8e4c070de0 2023-06-10T19:07:57.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.633+0000 7f8e42ffd640 1 -- 172.21.15.53:0/1938860572 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v30)=0 v30) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8e340b4020 con 0x7f8e4c070de0 2023-06-10T19:07:57.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.637+0000 7f8e50db3640 1 -- 172.21.15.53:0/1938860572 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8e2c0662b0 msgr2=0x7f8e2c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:57.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.637+0000 7f8e50db3640 1 --2- 172.21.15.53:0/1938860572 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8e2c0662b0 0x7f8e2c068760 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c0c8450 tx=0x7f8e3c009190 comp rx=0 tx=0).stop 2023-06-10T19:07:57.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.637+0000 7f8e50db3640 1 -- 172.21.15.53:0/1938860572 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e4c070de0 msgr2=0x7f8e4c14a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:57.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.637+0000 7f8e50db3640 1 --2- 172.21.15.53:0/1938860572 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e4c070de0 0x7f8e4c14a550 secure :-1 s=READY pgs=2550 cs=0 l=1 rev1=1 crypto rx=0x7f8e3400b2c0 tx=0x7f8e3401d3c0 comp rx=0 tx=0).stop 2023-06-10T19:07:57.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.637+0000 7f8e50db3640 1 -- 172.21.15.53:0/1938860572 shutdown_connections 2023-06-10T19:07:57.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.637+0000 7f8e50db3640 1 --2- 172.21.15.53:0/1938860572 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8e2c0662b0 0x7f8e2c068760 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:57.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.637+0000 7f8e50db3640 1 --2- 172.21.15.53:0/1938860572 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8e4c15c970 0x7f8e4c0b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:57.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.637+0000 7f8e50db3640 1 --2- 172.21.15.53:0/1938860572 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8e4c15c060 0x7f8e4c0b0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:57.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.637+0000 7f8e50db3640 1 --2- 172.21.15.53:0/1938860572 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e4c070de0 0x7f8e4c14a550 unknown :-1 s=CLOSED pgs=2550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:57.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.637+0000 7f8e50db3640 1 -- 172.21.15.53:0/1938860572 >> 172.21.15.53:0/1938860572 conn(0x7f8e4c06a0e0 msgr2=0x7f8e4c14fae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:57.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.637+0000 7f8e50db3640 1 -- 172.21.15.53:0/1938860572 shutdown_connections 2023-06-10T19:07:57.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.637+0000 7f8e50db3640 1 -- 172.21.15.53:0/1938860572 wait complete. 2023-06-10T19:07:57.656 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-06-10T19:07:57.656 DEBUG:teuthology.orchestra.run.smithi053:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-06-10T19:07:57.688 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-06-10T19:07:57.749 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-06-10T19:07:57.750 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T19:07:57.750 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:07:57.756 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16345192k,nr_inodes=4086298,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276544k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=407 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276540k,nr_inodes=819135,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276544k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-06-10T19:07:57.756 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T19:07:57.756 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:07:57.763 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16342088k,nr_inodes=4085522,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275924k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18845 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275920k,nr_inodes=818980,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275924k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-06-10T19:07:57.764 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T19:07:57.764 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:07:57.804 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16345192k,nr_inodes=4086298,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276544k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=407 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276540k,nr_inodes=819135,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276544k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-06-10T19:07:57.805 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T19:07:57.805 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:07:57.812 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16342088k,nr_inodes=4085522,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275924k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18845 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275920k,nr_inodes=818980,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275924k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-06-10T19:07:57.812 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-06-10T19:07:57.813 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:07:57.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.969+0000 7fa1bf0db640 1 Processor -- start 2023-06-10T19:07:57.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.969+0000 7fa1bf0db640 1 -- start start 2023-06-10T19:07:57.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.969+0000 7fa1bf0db640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa1b806b2f0 0x7fa1b806f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:57.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.969+0000 7fa1bf0db640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1b80c8d00 0x7fa1b806b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:57.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.969+0000 7fa1bf0db640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa1b806bc00 0x7fa1b80cbe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:57.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.969+0000 7fa1bf0db640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1b8158a90 con 0x7fa1b806bc00 2023-06-10T19:07:57.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.969+0000 7fa1bf0db640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1b80705d0 con 0x7fa1b806b2f0 2023-06-10T19:07:57.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.969+0000 7fa1bf0db640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b806f9c0 con 0x7fa1b80c8d00 2023-06-10T19:07:57.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.969+0000 7fa1bd678640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa1b806bc00 0x7fa1b80cbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:57.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.969+0000 7fa1bd678640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa1b806bc00 0x7fa1b80cbe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55838/0 (socket says 172.21.15.53:55838) 2023-06-10T19:07:57.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.969+0000 7fa1bd678640 1 -- 172.21.15.53:0/250913578 learned_addr learned my addr 172.21.15.53:0/250913578 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:57.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.969+0000 7fa1bd678640 1 -- 172.21.15.53:0/250913578 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1b80c8d00 msgr2=0x7fa1b806b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:57.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.969+0000 7fa1bd678640 1 --2- 172.21.15.53:0/250913578 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1b80c8d00 0x7fa1b806b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:57.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.969+0000 7fa1bce77640 1 --2- 172.21.15.53:0/250913578 >> v2:172.21.15.117:3300/0 conn(0x7fa1b806b2f0 0x7fa1b806f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:57.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.969+0000 7fa1bd678640 1 -- 172.21.15.53:0/250913578 >> v2:172.21.15.117:3300/0 conn(0x7fa1b806b2f0 msgr2=0x7fa1b806f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:57.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.969+0000 7fa1bd678640 1 --2- 172.21.15.53:0/250913578 >> v2:172.21.15.117:3300/0 conn(0x7fa1b806b2f0 0x7fa1b806f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:57.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.969+0000 7fa1bd678640 1 -- 172.21.15.53:0/250913578 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1b806fca0 con 0x7fa1b806bc00 2023-06-10T19:07:57.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.973+0000 7fa1bd678640 1 --2- 172.21.15.53:0/250913578 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1b806bc00 0x7fa1b80cbe00 secure :-1 s=READY pgs=2551 cs=0 l=1 rev1=1 crypto rx=0x7fa1b0009e50 tx=0x7fa1b001f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1ac7a201e5c70b0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:57.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.973+0000 7fa1b77fe640 1 -- 172.21.15.53:0/250913578 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b00af400 con 0x7fa1b806bc00 2023-06-10T19:07:57.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.973+0000 7fa1b77fe640 1 -- 172.21.15.53:0/250913578 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1b00ab050 con 0x7fa1b806bc00 2023-06-10T19:07:57.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.973+0000 7fa1b77fe640 1 -- 172.21.15.53:0/250913578 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b00af780 con 0x7fa1b806bc00 2023-06-10T19:07:57.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.973+0000 7fa1bf0db640 1 -- 172.21.15.53:0/250913578 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1b806bc00 msgr2=0x7fa1b80cbe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:57.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.973+0000 7fa1bf0db640 1 --2- 172.21.15.53:0/250913578 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1b806bc00 0x7fa1b80cbe00 secure :-1 s=READY pgs=2551 cs=0 l=1 rev1=1 crypto rx=0x7fa1b0009e50 tx=0x7fa1b001f1c0 comp rx=0 tx=0).stop 2023-06-10T19:07:57.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.973+0000 7fa1bf0db640 1 -- 172.21.15.53:0/250913578 shutdown_connections 2023-06-10T19:07:57.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.973+0000 7fa1bf0db640 1 --2- 172.21.15.53:0/250913578 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1b806bc00 0x7fa1b80cbe00 unknown :-1 s=CLOSED pgs=2551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:57.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.973+0000 7fa1bf0db640 1 --2- 172.21.15.53:0/250913578 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1b80c8d00 0x7fa1b806b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:57.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.973+0000 7fa1bf0db640 1 --2- 172.21.15.53:0/250913578 >> v2:172.21.15.117:3300/0 conn(0x7fa1b806b2f0 0x7fa1b806f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:57.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.973+0000 7fa1bf0db640 1 -- 172.21.15.53:0/250913578 >> 172.21.15.53:0/250913578 conn(0x7fa1b806a0d0 msgr2=0x7fa1b80ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:57.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.973+0000 7fa1bf0db640 1 -- 172.21.15.53:0/250913578 shutdown_connections 2023-06-10T19:07:57.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.973+0000 7fa1bf0db640 1 -- 172.21.15.53:0/250913578 wait complete. 2023-06-10T19:07:57.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.973+0000 7fa1bf0db640 1 Processor -- start 2023-06-10T19:07:57.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.973+0000 7fa1bf0db640 1 -- start start 2023-06-10T19:07:57.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.973+0000 7fa1bf0db640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1b806b2f0 0x7fa1b815b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:57.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.973+0000 7fa1bf0db640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1b806bc00 0x7fa1b80af790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:57.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.973+0000 7fa1bf0db640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1b80c8d00 0x7fa1b81f2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:57.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.973+0000 7fa1bf0db640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b80ad320 con 0x7fa1b80c8d00 2023-06-10T19:07:57.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.973+0000 7fa1bf0db640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b81f1cf0 con 0x7fa1b806bc00 2023-06-10T19:07:57.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.973+0000 7fa1bf0db640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b81f1fd0 con 0x7fa1b806b2f0 2023-06-10T19:07:57.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.973+0000 7fa1bd678640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1b80c8d00 0x7fa1b81f2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:57.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.973+0000 7fa1bd678640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1b80c8d00 0x7fa1b81f2460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55842/0 (socket says 172.21.15.53:55842) 2023-06-10T19:07:57.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.973+0000 7fa1bd678640 1 -- 172.21.15.53:0/3119414274 learned_addr learned my addr 172.21.15.53:0/3119414274 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:57.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.973+0000 7fa1bce77640 1 --2- 172.21.15.53:0/3119414274 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1b806b2f0 0x7fa1b815b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:57.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.973+0000 7fa1b7fff640 1 --2- 172.21.15.53:0/3119414274 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1b806bc00 0x7fa1b80af790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:57.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.973+0000 7fa1bd678640 1 -- 172.21.15.53:0/3119414274 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1b806b2f0 msgr2=0x7fa1b815b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:57.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.973+0000 7fa1bd678640 1 --2- 172.21.15.53:0/3119414274 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1b806b2f0 0x7fa1b815b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:57.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.973+0000 7fa1bd678640 1 -- 172.21.15.53:0/3119414274 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1b806bc00 msgr2=0x7fa1b80af790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:57.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.973+0000 7fa1bd678640 1 --2- 172.21.15.53:0/3119414274 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1b806bc00 0x7fa1b80af790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:57.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.973+0000 7fa1bd678640 1 -- 172.21.15.53:0/3119414274 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1b0009b30 con 0x7fa1b80c8d00 2023-06-10T19:07:57.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.973+0000 7fa1b7fff640 1 --2- 172.21.15.53:0/3119414274 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1b806bc00 0x7fa1b80af790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:07:57.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.973+0000 7fa1bce77640 1 --2- 172.21.15.53:0/3119414274 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1b806b2f0 0x7fa1b815b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:07:57.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.973+0000 7fa1bd678640 1 --2- 172.21.15.53:0/3119414274 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1b80c8d00 0x7fa1b81f2460 secure :-1 s=READY pgs=2552 cs=0 l=1 rev1=1 crypto rx=0x7fa1b00b2040 tx=0x7fa1b001bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:57.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.973+0000 7fa1b57fa640 1 -- 172.21.15.53:0/3119414274 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b00afdc0 con 0x7fa1b80c8d00 2023-06-10T19:07:57.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.973+0000 7fa1b57fa640 1 -- 172.21.15.53:0/3119414274 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1b0009510 con 0x7fa1b80c8d00 2023-06-10T19:07:57.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.973+0000 7fa1bf0db640 1 -- 172.21.15.53:0/3119414274 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1b814c800 con 0x7fa1b80c8d00 2023-06-10T19:07:57.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.977+0000 7fa1b57fa640 1 -- 172.21.15.53:0/3119414274 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b00ba660 con 0x7fa1b80c8d00 2023-06-10T19:07:57.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.977+0000 7fa1bf0db640 1 -- 172.21.15.53:0/3119414274 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1b80b0100 con 0x7fa1b80c8d00 2023-06-10T19:07:57.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.977+0000 7fa1bf0db640 1 -- 172.21.15.53:0/3119414274 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1b81f2140 con 0x7fa1b80c8d00 2023-06-10T19:07:57.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.977+0000 7fa1b57fa640 1 -- 172.21.15.53:0/3119414274 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa1b00b6040 con 0x7fa1b80c8d00 2023-06-10T19:07:57.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.977+0000 7fa1b57fa640 1 --2- 172.21.15.53:0/3119414274 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa19c066280 0x7fa19c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:57.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.977+0000 7fa1b57fa640 1 -- 172.21.15.53:0/3119414274 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fa1b0121d90 con 0x7fa1b80c8d00 2023-06-10T19:07:57.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.977+0000 7fa1bce77640 1 --2- 172.21.15.53:0/3119414274 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa19c066280 0x7fa19c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:57.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.977+0000 7fa1bce77640 1 --2- 172.21.15.53:0/3119414274 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa19c066280 0x7fa19c068730 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac00a990 tx=0x7fa1ac008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:57.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:57.981+0000 7fa1b57fa640 1 -- 172.21.15.53:0/3119414274 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa1b00ef570 con 0x7fa1b80c8d00 2023-06-10T19:07:58.170 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.169+0000 7fa1bf0db640 1 -- 172.21.15.53:0/3119414274 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa1b804d790 con 0x7fa1b80c8d00 2023-06-10T19:07:58.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.169+0000 7fa1b57fa640 1 -- 172.21.15.53:0/3119414274 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) v1 ==== 94+0+3534 (secure 0 0 0) 0x7fa1b00b4090 con 0x7fa1b80c8d00 2023-06-10T19:07:58.172 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:07:58.172 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":98,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8614,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3518533956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3518533956},{"type":"v1","addr":"172.21.15.117:6835","nonce":3518533956}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92},{"gid":8617,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/2615123885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2615123885},{"type":"v1","addr":"172.21.15.117:6837","nonce":2615123885}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92},{"gid":10551,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/3498697556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3498697556},{"type":"v1","addr":"172.21.15.53:6833","nonce":3498697556}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92},{"gid":11058,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/284715035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":284715035},{"type":"v1","addr":"172.21.15.53:6835","nonce":284715035}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":98}],"filesystems":[]} 2023-06-10T19:07:58.172 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 98 2023-06-10T19:07:58.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.169+0000 7fa1bf0db640 1 -- 172.21.15.53:0/3119414274 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa19c066280 msgr2=0x7fa19c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:58.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.169+0000 7fa1bf0db640 1 --2- 172.21.15.53:0/3119414274 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa19c066280 0x7fa19c068730 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac00a990 tx=0x7fa1ac008040 comp rx=0 tx=0).stop 2023-06-10T19:07:58.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.169+0000 7fa1bf0db640 1 -- 172.21.15.53:0/3119414274 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1b80c8d00 msgr2=0x7fa1b81f2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:58.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.169+0000 7fa1bf0db640 1 --2- 172.21.15.53:0/3119414274 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1b80c8d00 0x7fa1b81f2460 secure :-1 s=READY pgs=2552 cs=0 l=1 rev1=1 crypto rx=0x7fa1b00b2040 tx=0x7fa1b001bf60 comp rx=0 tx=0).stop 2023-06-10T19:07:58.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.169+0000 7fa1bf0db640 1 -- 172.21.15.53:0/3119414274 shutdown_connections 2023-06-10T19:07:58.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.169+0000 7fa1bf0db640 1 --2- 172.21.15.53:0/3119414274 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa19c066280 0x7fa19c068730 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:58.175 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.169+0000 7fa1bf0db640 1 --2- 172.21.15.53:0/3119414274 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1b80c8d00 0x7fa1b81f2460 unknown :-1 s=CLOSED pgs=2552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:58.175 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.169+0000 7fa1bf0db640 1 --2- 172.21.15.53:0/3119414274 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1b806bc00 0x7fa1b80af790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:58.175 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.169+0000 7fa1bf0db640 1 --2- 172.21.15.53:0/3119414274 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa1b806b2f0 0x7fa1b815b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:58.175 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.169+0000 7fa1bf0db640 1 -- 172.21.15.53:0/3119414274 >> 172.21.15.53:0/3119414274 conn(0x7fa1b806a0d0 msgr2=0x7fa1b80c4360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:58.175 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.169+0000 7fa1bf0db640 1 -- 172.21.15.53:0/3119414274 shutdown_connections 2023-06-10T19:07:58.175 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.169+0000 7fa1bf0db640 1 -- 172.21.15.53:0/3119414274 wait complete. 2023-06-10T19:07:58.191 INFO:tasks.ceph.mds.a:Restarting daemon 2023-06-10T19:07:58.191 INFO:tasks.ceph.mds.a:Stopping old one... 2023-06-10T19:07:58.191 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-06-10T19:07:58.192 INFO:teuthology.orchestra.run:waiting for 300 2023-06-10T19:07:58.192 INFO:tasks.ceph.mds.c:Restarting daemon 2023-06-10T19:07:58.193 INFO:tasks.ceph.mds.c:Stopping old one... 2023-06-10T19:07:58.193 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-06-10T19:07:58.194 INFO:teuthology.orchestra.run:waiting for 300 2023-06-10T19:07:58.194 INFO:tasks.ceph.mds.b:Restarting daemon 2023-06-10T19:07:58.194 INFO:tasks.ceph.mds.b:Stopping old one... 2023-06-10T19:07:58.195 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-06-10T19:07:58.195 INFO:teuthology.orchestra.run:waiting for 300 2023-06-10T19:07:58.195 INFO:tasks.ceph.mds.d:Restarting daemon 2023-06-10T19:07:58.195 INFO:tasks.ceph.mds.d:Stopping old one... 2023-06-10T19:07:58.196 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-06-10T19:07:58.196 INFO:teuthology.orchestra.run:waiting for 300 2023-06-10T19:07:58.201 INFO:tasks.ceph.mds.a:Stopped 2023-06-10T19:07:58.201 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-06-10T19:07:58.203 INFO:tasks.ceph.mds.c:Stopped 2023-06-10T19:07:58.203 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-06-10T19:07:58.207 INFO:tasks.ceph.mds.b:Stopped 2023-06-10T19:07:58.207 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-06-10T19:07:58.211 INFO:tasks.ceph.mds.d:Stopped 2023-06-10T19:07:58.211 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-06-10T19:07:58.247 INFO:tasks.ceph.mds.a:Started 2023-06-10T19:07:58.247 DEBUG:teuthology.parallel:result is None 2023-06-10T19:07:58.248 INFO:tasks.ceph.mds.c:Started 2023-06-10T19:07:58.248 DEBUG:teuthology.parallel:result is None 2023-06-10T19:07:58.255 INFO:tasks.ceph.mds.b:Started 2023-06-10T19:07:58.256 DEBUG:teuthology.parallel:result is None 2023-06-10T19:07:58.257 INFO:tasks.ceph.mds.d:Started 2023-06-10T19:07:58.258 DEBUG:teuthology.parallel:result is None 2023-06-10T19:07:58.259 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-06-10T19:07:58.307 INFO:tasks.ceph.mds.a.smithi053.stdout:starting mds.a at 2023-06-10T19:07:58.317 INFO:tasks.ceph.mds.c.smithi053.stdout:starting mds.c at 2023-06-10T19:07:58.327 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2023-06-10T19:07:58.328 INFO:tasks.ceph.mds.d.smithi117.stdout:starting mds.d at 2023-06-10T19:07:58.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.377+0000 7f7eee556640 1 Processor -- start 2023-06-10T19:07:58.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.377+0000 7f7eee556640 1 -- start start 2023-06-10T19:07:58.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.377+0000 7f7eee556640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ee815b900 0x7f7ee80af7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:58.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.377+0000 7f7eee556640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7ee80afd10 0x7f7ee8158660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:58.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.377+0000 7f7eee556640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ee815bd70 con 0x7f7ee80cd6d0 2023-06-10T19:07:58.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.377+0000 7f7eee556640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ee80b0190 con 0x7f7ee80afd10 2023-06-10T19:07:58.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.377+0000 7f7eee556640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee806b7a0 con 0x7f7ee815b900 2023-06-10T19:07:58.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.377+0000 7f7ee7fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f7ee80cd6d0 0x7f7ee80c83c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52468/0 (socket says 172.21.15.53:52468) 2023-06-10T19:07:58.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.377+0000 7f7ee7fff640 1 -- 172.21.15.53:0/726326989 learned_addr learned my addr 172.21.15.53:0/726326989 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:07:58.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.377+0000 7f7ee6ffd640 1 -- 172.21.15.53:0/726326989 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2866235421 0 0) 0x7f7ee815bd70 con 0x7f7ee80cd6d0 2023-06-10T19:07:58.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.377+0000 7f7ee6ffd640 1 -- 172.21.15.53:0/726326989 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ed0003530 con 0x7f7ee80cd6d0 2023-06-10T19:07:58.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.377+0000 7f7eecaf3640 1 --2- 172.21.15.53:0/726326989 >> v2:172.21.15.117:3300/0 conn(0x7f7ee80afd10 0x7f7ee8158660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:58.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.377+0000 7f7ee77fe640 1 --2- 172.21.15.53:0/726326989 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ee815b900 0x7f7ee80af7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:58.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.377+0000 7f7ee6ffd640 1 -- 172.21.15.53:0/726326989 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 388578689 0 0) 0x7f7ed0003530 con 0x7f7ee80cd6d0 2023-06-10T19:07:58.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.377+0000 7f7ee6ffd640 1 -- 172.21.15.53:0/726326989 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ee815b900 msgr2=0x7f7ee80af7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:58.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.377+0000 7f7ee6ffd640 1 --2- 172.21.15.53:0/726326989 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ee815b900 0x7f7ee80af7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:58.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.377+0000 7f7ee6ffd640 1 -- 172.21.15.53:0/726326989 >> v2:172.21.15.117:3300/0 conn(0x7f7ee80afd10 msgr2=0x7f7ee8158660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:58.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.377+0000 7f7ee6ffd640 1 --2- 172.21.15.53:0/726326989 >> v2:172.21.15.117:3300/0 conn(0x7f7ee80afd10 0x7f7ee8158660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:58.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.377+0000 7f7ee6ffd640 1 -- 172.21.15.53:0/726326989 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee806a8b0 con 0x7f7ee80cd6d0 2023-06-10T19:07:58.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.377+0000 7f7ee77fe640 1 --2- 172.21.15.53:0/726326989 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ee815b900 0x7f7ee80af7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:07:58.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.377+0000 7f7ee6ffd640 1 -- 172.21.15.53:0/726326989 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f7ed8001800 con 0x7f7ee80cd6d0 2023-06-10T19:07:58.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.377+0000 7f7ee6ffd640 1 -- 172.21.15.53:0/726326989 >> v1:172.21.15.53:6789/0 conn(0x7f7ee80cd6d0 legacy=0x7f7ee80c83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:58.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.377+0000 7f7ee6ffd640 1 --2- 172.21.15.53:0/726326989 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ed0003980 0x7f7ed0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:58.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.377+0000 7f7ee6ffd640 1 --2- 172.21.15.53:0/726326989 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ee815b900 0x7f7ed00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:58.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.377+0000 7f7ee6ffd640 1 --2- 172.21.15.53:0/726326989 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ed0004d10 0x7f7ed0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:58.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.377+0000 7f7ee6ffd640 1 -- 172.21.15.53:0/726326989 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee80b0190 con 0x7f7ed0003980 2023-06-10T19:07:58.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.377+0000 7f7ee6ffd640 1 -- 172.21.15.53:0/726326989 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee806b7a0 con 0x7f7ed0004d10 2023-06-10T19:07:58.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.377+0000 7f7ee6ffd640 1 -- 172.21.15.53:0/726326989 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed000b990 con 0x7f7ee815b900 2023-06-10T19:07:58.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.377+0000 7f7ee7fff640 1 --2- 172.21.15.53:0/726326989 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ed0003980 0x7f7ed0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:58.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.377+0000 7f7ee77fe640 1 --2- 172.21.15.53:0/726326989 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ee815b900 0x7f7ed00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:58.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.377+0000 7f7eecaf3640 1 --2- 172.21.15.53:0/726326989 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ed0004d10 0x7f7ed0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:58.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.377+0000 7f7ee7fff640 1 -- 172.21.15.53:0/726326989 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ee815b900 msgr2=0x7f7ed00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:58.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.377+0000 7f7ee7fff640 1 --2- 172.21.15.53:0/726326989 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ee815b900 0x7f7ed00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:58.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.377+0000 7f7ee7fff640 1 -- 172.21.15.53:0/726326989 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ed0004d10 msgr2=0x7f7ed0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:58.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.377+0000 7f7ee7fff640 1 --2- 172.21.15.53:0/726326989 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ed0004d10 0x7f7ed0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:58.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.377+0000 7f7ee7fff640 1 -- 172.21.15.53:0/726326989 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ed0003530 con 0x7f7ed0003980 2023-06-10T19:07:58.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.381+0000 7f7ee7fff640 1 --2- 172.21.15.53:0/726326989 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ed0003980 0x7f7ed0003d90 secure :-1 s=READY pgs=2558 cs=0 l=1 rev1=1 crypto rx=0x7f7ed800c270 tx=0x7f7ed801cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f84efb4fb17265f7 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:58.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.381+0000 7f7ee6ffd640 1 -- 172.21.15.53:0/726326989 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed80070d0 con 0x7f7ed0003980 2023-06-10T19:07:58.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.381+0000 7f7ee6ffd640 1 -- 172.21.15.53:0/726326989 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed8007230 con 0x7f7ed0003980 2023-06-10T19:07:58.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.381+0000 7f7ee6ffd640 1 -- 172.21.15.53:0/726326989 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed8007620 con 0x7f7ed0003980 2023-06-10T19:07:58.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.381+0000 7f7eee556640 1 -- 172.21.15.53:0/726326989 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ed0003980 msgr2=0x7f7ed0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:58.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.381+0000 7f7eee556640 1 --2- 172.21.15.53:0/726326989 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ed0003980 0x7f7ed0003d90 secure :-1 s=READY pgs=2558 cs=0 l=1 rev1=1 crypto rx=0x7f7ed800c270 tx=0x7f7ed801cbd0 comp rx=0 tx=0).stop 2023-06-10T19:07:58.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.381+0000 7f7eecaf3640 1 -- 172.21.15.53:0/726326989 reap_dead start 2023-06-10T19:07:58.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.381+0000 7f7eee556640 1 -- 172.21.15.53:0/726326989 shutdown_connections 2023-06-10T19:07:58.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.381+0000 7f7eee556640 1 -- 172.21.15.53:0/726326989 >> 172.21.15.53:0/726326989 conn(0x7f7ee80ce9e0 msgr2=0x7f7ee80ca7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:58.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.381+0000 7f7eee556640 1 -- 172.21.15.53:0/726326989 shutdown_connections 2023-06-10T19:07:58.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.381+0000 7f7eee556640 1 -- 172.21.15.53:0/726326989 wait complete. 2023-06-10T19:07:58.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.381+0000 7f7eee556640 1 Processor -- start 2023-06-10T19:07:58.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.381+0000 7f7eee556640 1 -- start start 2023-06-10T19:07:58.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.381+0000 7f7eee556640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ed0003980 0x7f7ee814c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:58.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.381+0000 7f7eee556640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ee80acd60 0x7f7ee80cc120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:58.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.381+0000 7f7eee556640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ee80cc660 0x7f7ee8155f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:58.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.381+0000 7f7eee556640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee80ccad0 con 0x7f7ee80acd60 2023-06-10T19:07:58.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.381+0000 7f7eee556640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee80ab860 con 0x7f7ee80cc660 2023-06-10T19:07:58.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.381+0000 7f7eee556640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee814cb20 con 0x7f7ed0003980 2023-06-10T19:07:58.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.381+0000 7f7ee77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ee80acd60 0x7f7ee80cc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:58.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.381+0000 7f7ee77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ee80acd60 0x7f7ee80cc120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55890/0 (socket says 172.21.15.53:55890) 2023-06-10T19:07:58.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.381+0000 7f7ee77fe640 1 -- 172.21.15.53:0/18600271 learned_addr learned my addr 172.21.15.53:0/18600271 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:58.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.381+0000 7f7eecaf3640 1 --2- 172.21.15.53:0/18600271 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ee80cc660 0x7f7ee8155f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:58.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.381+0000 7f7ee7fff640 1 --2- 172.21.15.53:0/18600271 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ed0003980 0x7f7ee814c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:58.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.385+0000 7f7ee77fe640 1 -- 172.21.15.53:0/18600271 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ed0003980 msgr2=0x7f7ee814c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:58.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.385+0000 7f7ee77fe640 1 --2- 172.21.15.53:0/18600271 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ed0003980 0x7f7ee814c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:58.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.385+0000 7f7ee77fe640 1 -- 172.21.15.53:0/18600271 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ee80cc660 msgr2=0x7f7ee8155f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:58.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.385+0000 7f7ee77fe640 1 --2- 172.21.15.53:0/18600271 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ee80cc660 0x7f7ee8155f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:58.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.385+0000 7f7ee77fe640 1 -- 172.21.15.53:0/18600271 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee80abb00 con 0x7f7ee80acd60 2023-06-10T19:07:58.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.385+0000 7f7ee77fe640 1 --2- 172.21.15.53:0/18600271 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ee80acd60 0x7f7ee80cc120 secure :-1 s=READY pgs=2559 cs=0 l=1 rev1=1 crypto rx=0x7f7edc0116d0 tx=0x7f7edc011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:58.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.385+0000 7f7ee4ff9640 1 -- 172.21.15.53:0/18600271 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7edc004230 con 0x7f7ee80acd60 2023-06-10T19:07:58.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.385+0000 7f7ee4ff9640 1 -- 172.21.15.53:0/18600271 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7edc004390 con 0x7f7ee80acd60 2023-06-10T19:07:58.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.385+0000 7f7eee556640 1 -- 172.21.15.53:0/18600271 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ee80abde0 con 0x7f7ee80acd60 2023-06-10T19:07:58.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.385+0000 7f7ee4ff9640 1 -- 172.21.15.53:0/18600271 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7edc00f9e0 con 0x7f7ee80acd60 2023-06-10T19:07:58.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.385+0000 7f7eee556640 1 -- 172.21.15.53:0/18600271 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ee80ac3a0 con 0x7f7ee80acd60 2023-06-10T19:07:58.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.385+0000 7f7eee556640 1 -- 172.21.15.53:0/18600271 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ee804d790 con 0x7f7ee80acd60 2023-06-10T19:07:58.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.385+0000 7f7ee4ff9640 1 -- 172.21.15.53:0/18600271 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7edc00fb40 con 0x7f7ee80acd60 2023-06-10T19:07:58.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.385+0000 7f7ee4ff9640 1 --2- 172.21.15.53:0/18600271 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7ed4066280 0x7f7ed4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:58.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.385+0000 7f7ee4ff9640 1 -- 172.21.15.53:0/18600271 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f7edc0840e0 con 0x7f7ee80acd60 2023-06-10T19:07:58.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.385+0000 7f7ee7fff640 1 --2- 172.21.15.53:0/18600271 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7ed4066280 0x7f7ed4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:58.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.385+0000 7f7ee7fff640 1 --2- 172.21.15.53:0/18600271 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7ed4066280 0x7f7ed4068730 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f7ed80aa000 tx=0x7f7ed80b0040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:58.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.389+0000 7f7ee4ff9640 1 -- 172.21.15.53:0/18600271 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7edc051730 con 0x7f7ee80acd60 2023-06-10T19:07:58.550 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:58.545+0000 7f7eee556640 1 -- 172.21.15.53:0/18600271 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f7ee80b3cb0 con 0x7f7ee80acd60 2023-06-10T19:07:59.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.361+0000 7f7ee4ff9640 1 -- 172.21.15.53:0/18600271 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v176) v1 ==== 97+0+0 (secure 0 0 0) 0x7f7edc054d50 con 0x7f7ee80acd60 2023-06-10T19:07:59.365 INFO:teuthology.orchestra.run.smithi053.stderr: removed all blocklist entries 2023-06-10T19:07:59.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.365+0000 7f7eee556640 1 -- 172.21.15.53:0/18600271 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7ed4066280 msgr2=0x7f7ed4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:59.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.365+0000 7f7eee556640 1 --2- 172.21.15.53:0/18600271 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7ed4066280 0x7f7ed4068730 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f7ed80aa000 tx=0x7f7ed80b0040 comp rx=0 tx=0).stop 2023-06-10T19:07:59.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.365+0000 7f7eee556640 1 -- 172.21.15.53:0/18600271 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ee80acd60 msgr2=0x7f7ee80cc120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:59.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.365+0000 7f7eee556640 1 --2- 172.21.15.53:0/18600271 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ee80acd60 0x7f7ee80cc120 secure :-1 s=READY pgs=2559 cs=0 l=1 rev1=1 crypto rx=0x7f7edc0116d0 tx=0x7f7edc011b90 comp rx=0 tx=0).stop 2023-06-10T19:07:59.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.365+0000 7f7eee556640 1 -- 172.21.15.53:0/18600271 shutdown_connections 2023-06-10T19:07:59.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.365+0000 7f7eee556640 1 --2- 172.21.15.53:0/18600271 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7ed4066280 0x7f7ed4068730 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:59.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.365+0000 7f7eee556640 1 --2- 172.21.15.53:0/18600271 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ee80cc660 0x7f7ee8155f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:59.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.365+0000 7f7eee556640 1 --2- 172.21.15.53:0/18600271 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ee80acd60 0x7f7ee80cc120 unknown :-1 s=CLOSED pgs=2559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:59.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.365+0000 7f7eee556640 1 --2- 172.21.15.53:0/18600271 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7ed0003980 0x7f7ee814c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:59.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.365+0000 7f7eee556640 1 -- 172.21.15.53:0/18600271 >> 172.21.15.53:0/18600271 conn(0x7f7ee80ce9e0 msgr2=0x7f7ee80ad7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:59.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.365+0000 7f7eee556640 1 -- 172.21.15.53:0/18600271 shutdown_connections 2023-06-10T19:07:59.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.365+0000 7f7eee556640 1 -- 172.21.15.53:0/18600271 wait complete. 2023-06-10T19:07:59.390 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-06-10T19:07:59.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.509+0000 7f51f6258640 1 Processor -- start 2023-06-10T19:07:59.514 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.513+0000 7f51f6258640 1 -- start start 2023-06-10T19:07:59.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.513+0000 7f51f6258640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f51f006b2f0 0x7f51f006f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:59.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.513+0000 7f51f6258640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f51f0160170 0x7f51f0162550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:59.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.513+0000 7f51f6258640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51f0158a90 con 0x7f51f00c8d00 2023-06-10T19:07:59.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.513+0000 7f51f6258640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51f00705d0 con 0x7f51f0160170 2023-06-10T19:07:59.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.513+0000 7f51f6258640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51f00cce10 con 0x7f51f006b2f0 2023-06-10T19:07:59.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.513+0000 7f51effff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f51f0160170 0x7f51f0162550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:59.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.513+0000 7f51effff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f51f0160170 0x7f51f0162550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55896/0 (socket says 172.21.15.53:55896) 2023-06-10T19:07:59.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.513+0000 7f51effff640 1 -- 172.21.15.53:0/3935504236 learned_addr learned my addr 172.21.15.53:0/3935504236 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:59.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.513+0000 7f51ef7fe640 1 --2- 172.21.15.53:0/3935504236 >> v2:172.21.15.117:3300/0 conn(0x7f51f006b2f0 0x7f51f006f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:59.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.513+0000 7f51effff640 1 -- 172.21.15.53:0/3935504236 >> v2:172.21.15.117:3300/0 conn(0x7f51f006b2f0 msgr2=0x7f51f006f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:59.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.513+0000 7f51effff640 1 --2- 172.21.15.53:0/3935504236 >> v2:172.21.15.117:3300/0 conn(0x7f51f006b2f0 0x7f51f006f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:59.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.513+0000 7f51effff640 1 -- 172.21.15.53:0/3935504236 >> v1:172.21.15.117:6789/0 conn(0x7f51f00c8d00 legacy=0x7f51f006b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:59.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.513+0000 7f51effff640 1 -- 172.21.15.53:0/3935504236 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f006f9c0 con 0x7f51f0160170 2023-06-10T19:07:59.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.513+0000 7f51effff640 1 --2- 172.21.15.53:0/3935504236 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51f0160170 0x7f51f0162550 secure :-1 s=READY pgs=2560 cs=0 l=1 rev1=1 crypto rx=0x7f51f0071d80 tx=0x7f51e801f180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2a607f95a16632f server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:59.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.513+0000 7f51ee7fc640 1 -- 172.21.15.53:0/3935504236 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e80af400 con 0x7f51f0160170 2023-06-10T19:07:59.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.513+0000 7f51ee7fc640 1 -- 172.21.15.53:0/3935504236 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51e80ab050 con 0x7f51f0160170 2023-06-10T19:07:59.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.513+0000 7f51ee7fc640 1 -- 172.21.15.53:0/3935504236 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e80af780 con 0x7f51f0160170 2023-06-10T19:07:59.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.517+0000 7f51f6258640 1 -- 172.21.15.53:0/3935504236 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51f0160170 msgr2=0x7f51f0162550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:59.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.517+0000 7f51f6258640 1 --2- 172.21.15.53:0/3935504236 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51f0160170 0x7f51f0162550 secure :-1 s=READY pgs=2560 cs=0 l=1 rev1=1 crypto rx=0x7f51f0071d80 tx=0x7f51e801f180 comp rx=0 tx=0).stop 2023-06-10T19:07:59.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.517+0000 7f51f6258640 1 -- 172.21.15.53:0/3935504236 shutdown_connections 2023-06-10T19:07:59.519 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.517+0000 7f51f6258640 1 --2- 172.21.15.53:0/3935504236 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51f0160170 0x7f51f0162550 unknown :-1 s=CLOSED pgs=2560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:59.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.517+0000 7f51f6258640 1 --2- 172.21.15.53:0/3935504236 >> v2:172.21.15.117:3300/0 conn(0x7f51f006b2f0 0x7f51f006f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:59.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.517+0000 7f51f6258640 1 -- 172.21.15.53:0/3935504236 >> 172.21.15.53:0/3935504236 conn(0x7f51f006a0d0 msgr2=0x7f51f00ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:59.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.517+0000 7f51f6258640 1 -- 172.21.15.53:0/3935504236 shutdown_connections 2023-06-10T19:07:59.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.517+0000 7f51f6258640 1 -- 172.21.15.53:0/3935504236 wait complete. 2023-06-10T19:07:59.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.517+0000 7f51f6258640 1 Processor -- start 2023-06-10T19:07:59.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.517+0000 7f51f6258640 1 -- start start 2023-06-10T19:07:59.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.517+0000 7f51f6258640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51f006b2f0 0x7f51f0156c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:59.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.517+0000 7f51f6258640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51f00c8d00 0x7f51f01f2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:59.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.517+0000 7f51f6258640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51f0160170 0x7f51f01ee610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:59.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.517+0000 7f51f6258640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f0156800 con 0x7f51f006b2f0 2023-06-10T19:07:59.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.517+0000 7f51f6258640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f0155bf0 con 0x7f51f00c8d00 2023-06-10T19:07:59.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.517+0000 7f51f6258640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51f0155ed0 con 0x7f51f0160170 2023-06-10T19:07:59.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.517+0000 7f51ef7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51f006b2f0 0x7f51f0156c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:59.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.517+0000 7f51ef7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51f006b2f0 0x7f51f0156c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55906/0 (socket says 172.21.15.53:55906) 2023-06-10T19:07:59.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.517+0000 7f51ef7fe640 1 -- 172.21.15.53:0/3534975175 learned_addr learned my addr 172.21.15.53:0/3534975175 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:59.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.517+0000 7f51eeffd640 1 --2- 172.21.15.53:0/3534975175 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51f00c8d00 0x7f51f01f2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:59.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.517+0000 7f51effff640 1 --2- 172.21.15.53:0/3534975175 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51f0160170 0x7f51f01ee610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:59.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.517+0000 7f51ef7fe640 1 -- 172.21.15.53:0/3534975175 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51f0160170 msgr2=0x7f51f01ee610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:59.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.517+0000 7f51ef7fe640 1 --2- 172.21.15.53:0/3534975175 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51f0160170 0x7f51f01ee610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:59.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.517+0000 7f51ef7fe640 1 -- 172.21.15.53:0/3534975175 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51f00c8d00 msgr2=0x7f51f01f2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:59.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.517+0000 7f51ef7fe640 1 --2- 172.21.15.53:0/3534975175 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51f00c8d00 0x7f51f01f2960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:59.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.517+0000 7f51ef7fe640 1 -- 172.21.15.53:0/3534975175 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51e8009b30 con 0x7f51f006b2f0 2023-06-10T19:07:59.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.517+0000 7f51ef7fe640 1 --2- 172.21.15.53:0/3534975175 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51f006b2f0 0x7f51f0156c90 secure :-1 s=READY pgs=2561 cs=0 l=1 rev1=1 crypto rx=0x7f51e400d800 tx=0x7f51e400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:59.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.517+0000 7f51d7fff640 1 -- 172.21.15.53:0/3534975175 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e400b6c0 con 0x7f51f006b2f0 2023-06-10T19:07:59.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.517+0000 7f51d7fff640 1 -- 172.21.15.53:0/3534975175 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51e400b820 con 0x7f51f006b2f0 2023-06-10T19:07:59.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.517+0000 7f51d7fff640 1 -- 172.21.15.53:0/3534975175 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e400bb90 con 0x7f51f006b2f0 2023-06-10T19:07:59.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.517+0000 7f51f6258640 1 -- 172.21.15.53:0/3534975175 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51f01561b0 con 0x7f51f006b2f0 2023-06-10T19:07:59.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.517+0000 7f51f6258640 1 -- 172.21.15.53:0/3534975175 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51f01f2ea0 con 0x7f51f006b2f0 2023-06-10T19:07:59.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.521+0000 7f51f6258640 1 -- 172.21.15.53:0/3534975175 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51f004d790 con 0x7f51f006b2f0 2023-06-10T19:07:59.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.521+0000 7f51d7fff640 1 -- 172.21.15.53:0/3534975175 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f51e400bcf0 con 0x7f51f006b2f0 2023-06-10T19:07:59.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.521+0000 7f51d7fff640 1 --2- 172.21.15.53:0/3534975175 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f51dc0662b0 0x7f51dc068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:59.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.521+0000 7f51d7fff640 1 -- 172.21.15.53:0/3534975175 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f51e4083f50 con 0x7f51f006b2f0 2023-06-10T19:07:59.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.521+0000 7f51eeffd640 1 --2- 172.21.15.53:0/3534975175 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f51dc0662b0 0x7f51dc068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:59.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.521+0000 7f51eeffd640 1 --2- 172.21.15.53:0/3534975175 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f51dc0662b0 0x7f51dc068760 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f51f014e930 tx=0x7f51e0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:59.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.525+0000 7f51d7fff640 1 -- 172.21.15.53:0/3534975175 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f51e4051700 con 0x7f51f006b2f0 2023-06-10T19:07:59.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.729+0000 7f51f6258640 1 -- 172.21.15.53:0/3534975175 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f51f0154110 con 0x7f51f006b2f0 2023-06-10T19:07:59.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.729+0000 7f51d7fff640 1 -- 172.21.15.53:0/3534975175 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v22) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f51e4054d20 con 0x7f51f006b2f0 2023-06-10T19:07:59.734 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:07:59.734 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-06-10T19:07:59.734 INFO:teuthology.orchestra.run.smithi053.stdout: "auth_dump": [ 2023-06-10T19:07:59.734 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:07:59.734 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.a", 2023-06-10T19:07:59.735 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkWqEQBhAAW+iEw0Gxfw744rsYc/tfTQ==", 2023-06-10T19:07:59.735 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:07:59.735 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T19:07:59.735 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2023-06-10T19:07:59.735 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2023-06-10T19:07:59.735 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:07:59.735 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:07:59.736 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:07:59.736 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:07:59.736 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.b", 2023-06-10T19:07:59.736 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkSu02FRAAFpo6NpcwDLZUt2Rgk/wm8w==", 2023-06-10T19:07:59.736 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:07:59.736 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T19:07:59.737 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2023-06-10T19:07:59.737 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2023-06-10T19:07:59.737 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:07:59.737 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:07:59.737 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:07:59.737 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:07:59.737 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.c", 2023-06-10T19:07:59.738 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRk19/ODhAAodfGGNLP7UbNhHySgaukrg==", 2023-06-10T19:07:59.738 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:07:59.738 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T19:07:59.738 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2023-06-10T19:07:59.738 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2023-06-10T19:07:59.739 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:07:59.739 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:07:59.739 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:07:59.739 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:07:59.739 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mds.d", 2023-06-10T19:07:59.739 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkogwkGxAAIavVKa8GtML1XQDEMwwokQ==", 2023-06-10T19:07:59.739 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:07:59.740 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T19:07:59.740 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2023-06-10T19:07:59.740 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2023-06-10T19:07:59.740 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:07:59.740 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:07:59.740 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:07:59.740 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:07:59.741 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.0", 2023-06-10T19:07:59.741 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA7xoRkoj1OMhAAYFc4W5kAlMBqY2yzeJZXQw==", 2023-06-10T19:07:59.741 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:07:59.741 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T19:07:59.741 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T19:07:59.741 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:07:59.741 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:07:59.741 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:07:59.742 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:07:59.742 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.1", 2023-06-10T19:07:59.742 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA+xoRk6FpDOBAALjxW3eaIh3Gu9b1rmMmqfw==", 2023-06-10T19:07:59.742 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:07:59.742 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T19:07:59.742 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T19:07:59.742 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:07:59.742 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:07:59.743 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:07:59.743 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:07:59.743 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.2", 2023-06-10T19:07:59.743 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBCxoRkaO2GBRAA0Xr5en+n5DxhZDg8kVswpQ==", 2023-06-10T19:07:59.743 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:07:59.743 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T19:07:59.743 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T19:07:59.743 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:07:59.744 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:07:59.744 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:07:59.744 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:07:59.744 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.3", 2023-06-10T19:07:59.744 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBFxoRkjfsBDhAAArYYrPnmXu5VcUMGVjQXZg==", 2023-06-10T19:07:59.744 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:07:59.744 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T19:07:59.745 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T19:07:59.745 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:07:59.745 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:07:59.745 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:07:59.745 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:07:59.745 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.4", 2023-06-10T19:07:59.745 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBLxoRkybumChAAdym/nl9bzyI71flvuy9Vtw==", 2023-06-10T19:07:59.746 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:07:59.746 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T19:07:59.746 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T19:07:59.746 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:07:59.746 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:07:59.746 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:07:59.746 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:07:59.747 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.5", 2023-06-10T19:07:59.747 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBOxoRkinSGIRAAwLbgYKI4NsbHKqGo9O4WuQ==", 2023-06-10T19:07:59.747 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:07:59.747 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T19:07:59.747 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T19:07:59.747 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:07:59.747 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:07:59.748 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:07:59.748 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:07:59.748 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.6", 2023-06-10T19:07:59.748 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBRxoRkj7VlKRAAs2ReBZ5iqtr17Nli9kUtGQ==", 2023-06-10T19:07:59.748 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:07:59.748 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T19:07:59.749 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T19:07:59.749 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:07:59.749 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:07:59.749 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:07:59.749 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:07:59.749 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "osd.7", 2023-06-10T19:07:59.749 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQBUxoRk48CnMhAASfbeuCo9jDuHQrYDQ8Vt3A==", 2023-06-10T19:07:59.750 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:07:59.750 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow profile osd", 2023-06-10T19:07:59.750 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile osd", 2023-06-10T19:07:59.750 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:07:59.750 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:07:59.750 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:07:59.752 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:07:59.752 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.0", 2023-06-10T19:07:59.752 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkgey1IBAAkNYrXMgUOnavBY/5uGyFrw==", 2023-06-10T19:07:59.752 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:07:59.752 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T19:07:59.752 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow r", 2023-06-10T19:07:59.753 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-06-10T19:07:59.753 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:07:59.753 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:07:59.753 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:07:59.753 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.1", 2023-06-10T19:07:59.753 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkBw+UKBAAuvT+vXmJLG5CvQVg5xItDQ==", 2023-06-10T19:07:59.753 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:07:59.754 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T19:07:59.754 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow r", 2023-06-10T19:07:59.754 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow rw", 2023-06-10T19:07:59.754 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rwx" 2023-06-10T19:07:59.754 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:07:59.754 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:07:59.754 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:07:59.755 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.2", 2023-06-10T19:07:59.755 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkewjeJRAA4pmIEVJ3Z7GKQFmA54CZ5Q==", 2023-06-10T19:07:59.755 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:07:59.755 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T19:07:59.755 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow r", 2023-06-10T19:07:59.755 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow rw", 2023-06-10T19:07:59.755 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rwx" 2023-06-10T19:07:59.755 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:07:59.756 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:07:59.756 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:07:59.756 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.3", 2023-06-10T19:07:59.756 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkHwCiLRAAWGt8UoWxGlG1Y1zSPbKUCg==", 2023-06-10T19:07:59.756 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:07:59.756 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow", 2023-06-10T19:07:59.757 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow r", 2023-06-10T19:07:59.757 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow rw", 2023-06-10T19:07:59.757 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow rwx" 2023-06-10T19:07:59.757 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:07:59.757 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:07:59.757 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:07:59.757 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "client.admin", 2023-06-10T19:07:59.757 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA5xoRkIVgrKBAABIxiaOPe9h5ne2y2l50aMg==", 2023-06-10T19:07:59.758 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:07:59.758 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow *", 2023-06-10T19:07:59.758 INFO:teuthology.orchestra.run.smithi053.stdout: "mgr": "allow *", 2023-06-10T19:07:59.758 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow *", 2023-06-10T19:07:59.758 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:07:59.758 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:07:59.758 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:07:59.759 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:07:59.759 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mgr.x", 2023-06-10T19:07:59.759 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA6xoRkzWG3AhAAh3NFYHAbp4fgn4FZeRRNuw==", 2023-06-10T19:07:59.759 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:07:59.759 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow *", 2023-06-10T19:07:59.759 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile mgr", 2023-06-10T19:07:59.759 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:07:59.760 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:07:59.760 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:07:59.760 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:07:59.760 INFO:teuthology.orchestra.run.smithi053.stdout: "entity": "mgr.y", 2023-06-10T19:07:59.760 INFO:teuthology.orchestra.run.smithi053.stdout: "key": "AQA5xoRkBriKOxAA6G+T7Yp2rH7XV7z37lvMYQ==", 2023-06-10T19:07:59.760 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": { 2023-06-10T19:07:59.760 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": "allow *", 2023-06-10T19:07:59.761 INFO:teuthology.orchestra.run.smithi053.stdout: "mon": "allow profile mgr", 2023-06-10T19:07:59.761 INFO:teuthology.orchestra.run.smithi053.stdout: "osd": "allow *" 2023-06-10T19:07:59.761 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:07:59.761 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:07:59.761 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2023-06-10T19:07:59.761 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-06-10T19:07:59.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.733+0000 7f51f6258640 1 -- 172.21.15.53:0/3534975175 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f51dc0662b0 msgr2=0x7f51dc068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:59.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.733+0000 7f51f6258640 1 --2- 172.21.15.53:0/3534975175 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f51dc0662b0 0x7f51dc068760 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f51f014e930 tx=0x7f51e0009040 comp rx=0 tx=0).stop 2023-06-10T19:07:59.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.733+0000 7f51f6258640 1 -- 172.21.15.53:0/3534975175 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51f006b2f0 msgr2=0x7f51f0156c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:59.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.733+0000 7f51f6258640 1 --2- 172.21.15.53:0/3534975175 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51f006b2f0 0x7f51f0156c90 secure :-1 s=READY pgs=2561 cs=0 l=1 rev1=1 crypto rx=0x7f51e400d800 tx=0x7f51e400dcc0 comp rx=0 tx=0).stop 2023-06-10T19:07:59.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.733+0000 7f51f6258640 1 -- 172.21.15.53:0/3534975175 shutdown_connections 2023-06-10T19:07:59.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.733+0000 7f51f6258640 1 --2- 172.21.15.53:0/3534975175 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f51dc0662b0 0x7f51dc068760 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:59.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.733+0000 7f51f6258640 1 --2- 172.21.15.53:0/3534975175 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f51f0160170 0x7f51f01ee610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:59.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.733+0000 7f51f6258640 1 --2- 172.21.15.53:0/3534975175 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51f00c8d00 0x7f51f01f2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:59.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.733+0000 7f51f6258640 1 --2- 172.21.15.53:0/3534975175 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51f006b2f0 0x7f51f0156c90 unknown :-1 s=CLOSED pgs=2561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:59.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.733+0000 7f51f6258640 1 -- 172.21.15.53:0/3534975175 >> 172.21.15.53:0/3534975175 conn(0x7f51f006a0d0 msgr2=0x7f51f0154d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:59.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.733+0000 7f51f6258640 1 -- 172.21.15.53:0/3534975175 shutdown_connections 2023-06-10T19:07:59.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.733+0000 7f51f6258640 1 -- 172.21.15.53:0/3534975175 wait complete. 2023-06-10T19:07:59.765 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:07:59.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.869+0000 7f369e6ab640 1 Processor -- start 2023-06-10T19:07:59.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.869+0000 7f369e6ab640 1 -- start start 2023-06-10T19:07:59.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.873+0000 7f369e6ab640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3698162640 0x7f3698164a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:59.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.873+0000 7f369e6ab640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3698159b50 con 0x7f3698071060 2023-06-10T19:07:59.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.873+0000 7f369e6ab640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36980702a0 con 0x7f36980c9840 2023-06-10T19:07:59.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.873+0000 7f369e6ab640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3698070580 con 0x7f3698162640 2023-06-10T19:07:59.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.873+0000 7f36977fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f3698071060 0x7f36980af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52480/0 (socket says 172.21.15.53:52480) 2023-06-10T19:07:59.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.873+0000 7f36977fe640 1 -- 172.21.15.53:0/2831876457 learned_addr learned my addr 172.21.15.53:0/2831876457 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:07:59.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.873+0000 7f369cc48640 1 --2- 172.21.15.53:0/2831876457 >> v2:172.21.15.117:3300/0 conn(0x7f3698162640 0x7f3698164a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:59.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.873+0000 7f3696ffd640 1 -- 172.21.15.53:0/2831876457 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4073430051 0 0) 0x7f3698159b50 con 0x7f3698071060 2023-06-10T19:07:59.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.873+0000 7f3696ffd640 1 -- 172.21.15.53:0/2831876457 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3680003530 con 0x7f3698071060 2023-06-10T19:07:59.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.873+0000 7f3696ffd640 1 -- 172.21.15.53:0/2831876457 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1642118854 0 0) 0x7f3680003530 con 0x7f3698071060 2023-06-10T19:07:59.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.873+0000 7f3696ffd640 1 -- 172.21.15.53:0/2831876457 >> v2:172.21.15.117:3300/0 conn(0x7f3698162640 msgr2=0x7f3698164a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:59.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.873+0000 7f3696ffd640 1 --2- 172.21.15.53:0/2831876457 >> v2:172.21.15.117:3300/0 conn(0x7f3698162640 0x7f3698164a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:59.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.873+0000 7f3696ffd640 1 -- 172.21.15.53:0/2831876457 >> v1:172.21.15.117:6789/0 conn(0x7f36980c9840 legacy=0x7f36980c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:59.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.873+0000 7f3696ffd640 1 -- 172.21.15.53:0/2831876457 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3698070860 con 0x7f3698071060 2023-06-10T19:07:59.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.873+0000 7f3696ffd640 1 -- 172.21.15.53:0/2831876457 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f368c001680 con 0x7f3698071060 2023-06-10T19:07:59.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.873+0000 7f3696ffd640 1 -- 172.21.15.53:0/2831876457 >> v1:172.21.15.53:6789/0 conn(0x7f3698071060 legacy=0x7f36980af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:59.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.873+0000 7f3696ffd640 1 --2- 172.21.15.53:0/2831876457 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3680003a40 0x7f3680003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:59.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.873+0000 7f3696ffd640 1 --2- 172.21.15.53:0/2831876457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36800047d0 0x7f3680004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:59.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.873+0000 7f3696ffd640 1 --2- 172.21.15.53:0/2831876457 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3680005180 0x7f368000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:59.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.873+0000 7f3696ffd640 1 -- 172.21.15.53:0/2831876457 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3698070580 con 0x7f3680005180 2023-06-10T19:07:59.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.873+0000 7f3696ffd640 1 -- 172.21.15.53:0/2831876457 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f368000c0c0 con 0x7f3680003a40 2023-06-10T19:07:59.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.873+0000 7f3696ffd640 1 -- 172.21.15.53:0/2831876457 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f368000c280 con 0x7f36800047d0 2023-06-10T19:07:59.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.873+0000 7f369cc48640 1 --2- 172.21.15.53:0/2831876457 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3680005180 0x7f368000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:59.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.873+0000 7f3697fff640 1 --2- 172.21.15.53:0/2831876457 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3680003a40 0x7f3680003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:59.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.873+0000 7f36977fe640 1 --2- 172.21.15.53:0/2831876457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36800047d0 0x7f3680004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:59.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.873+0000 7f369cc48640 1 -- 172.21.15.53:0/2831876457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36800047d0 msgr2=0x7f3680004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:59.883 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.873+0000 7f369cc48640 1 --2- 172.21.15.53:0/2831876457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36800047d0 0x7f3680004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:59.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.873+0000 7f369cc48640 1 -- 172.21.15.53:0/2831876457 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3680003a40 msgr2=0x7f3680003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:07:59.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.873+0000 7f369cc48640 1 --2- 172.21.15.53:0/2831876457 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3680003a40 0x7f3680003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:59.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.873+0000 7f369cc48640 1 -- 172.21.15.53:0/2831876457 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3680003530 con 0x7f3680005180 2023-06-10T19:07:59.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.873+0000 7f369cc48640 1 -- 172.21.15.53:0/2831876457 reap_dead start 2023-06-10T19:07:59.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.873+0000 7f369cc48640 1 --2- 172.21.15.53:0/2831876457 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3680005180 0x7f368000b990 secure :-1 s=READY pgs=2563 cs=0 l=1 rev1=1 crypto rx=0x7f36980c4d20 tx=0x7f369001ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=966539424591fa89 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:59.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.873+0000 7f3696ffd640 1 -- 172.21.15.53:0/2831876457 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36900a5600 con 0x7f3680005180 2023-06-10T19:07:59.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.873+0000 7f3696ffd640 1 -- 172.21.15.53:0/2831876457 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36900a5760 con 0x7f3680005180 2023-06-10T19:07:59.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.873+0000 7f3696ffd640 1 -- 172.21.15.53:0/2831876457 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36900a5ad0 con 0x7f3680005180 2023-06-10T19:07:59.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.877+0000 7f369e6ab640 1 -- 172.21.15.53:0/2831876457 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3680005180 msgr2=0x7f368000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:59.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.877+0000 7f369e6ab640 1 --2- 172.21.15.53:0/2831876457 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3680005180 0x7f368000b990 secure :-1 s=READY pgs=2563 cs=0 l=1 rev1=1 crypto rx=0x7f36980c4d20 tx=0x7f369001ca10 comp rx=0 tx=0).stop 2023-06-10T19:07:59.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.877+0000 7f369e6ab640 1 -- 172.21.15.53:0/2831876457 shutdown_connections 2023-06-10T19:07:59.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.877+0000 7f369e6ab640 1 --2- 172.21.15.53:0/2831876457 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3680005180 0x7f368000b990 unknown :-1 s=CLOSED pgs=2563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:59.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.877+0000 7f369e6ab640 1 -- 172.21.15.53:0/2831876457 >> 172.21.15.53:0/2831876457 conn(0x7f369806a0d0 msgr2=0x7f36980ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:07:59.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.877+0000 7f369e6ab640 1 -- 172.21.15.53:0/2831876457 shutdown_connections 2023-06-10T19:07:59.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.877+0000 7f369e6ab640 1 -- 172.21.15.53:0/2831876457 wait complete. 2023-06-10T19:07:59.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.877+0000 7f369e6ab640 1 Processor -- start 2023-06-10T19:07:59.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.877+0000 7f369e6ab640 1 -- start start 2023-06-10T19:07:59.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.877+0000 7f369e6ab640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3680005180 0x7f3698154670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:59.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.877+0000 7f369e6ab640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36980b2860 0x7f36980c5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:59.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.877+0000 7f369e6ab640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36980c4fd0 0x7f36980c6f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:59.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.877+0000 7f369e6ab640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36980c64a0 con 0x7f3680005180 2023-06-10T19:07:59.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.877+0000 7f369e6ab640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36980c6080 con 0x7f36980c4fd0 2023-06-10T19:07:59.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.877+0000 7f369e6ab640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36980b2fe0 con 0x7f36980b2860 2023-06-10T19:07:59.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.877+0000 7f3697fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3680005180 0x7f3698154670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:59.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.877+0000 7f3697fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3680005180 0x7f3698154670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55920/0 (socket says 172.21.15.53:55920) 2023-06-10T19:07:59.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.877+0000 7f3697fff640 1 -- 172.21.15.53:0/2521966630 learned_addr learned my addr 172.21.15.53:0/2521966630 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:07:59.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.877+0000 7f369cc48640 1 --2- 172.21.15.53:0/2521966630 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36980c4fd0 0x7f36980c6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:59.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.877+0000 7f36977fe640 1 --2- 172.21.15.53:0/2521966630 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36980b2860 0x7f36980c5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:59.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.877+0000 7f3697fff640 1 -- 172.21.15.53:0/2521966630 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36980b2860 msgr2=0x7f36980c5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:59.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.877+0000 7f3697fff640 1 --2- 172.21.15.53:0/2521966630 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36980b2860 0x7f36980c5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:59.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.877+0000 7f3697fff640 1 -- 172.21.15.53:0/2521966630 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36980c4fd0 msgr2=0x7f36980c6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:07:59.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.877+0000 7f3697fff640 1 --2- 172.21.15.53:0/2521966630 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36980c4fd0 0x7f36980c6f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:07:59.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.877+0000 7f3697fff640 1 -- 172.21.15.53:0/2521966630 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36980b32c0 con 0x7f3680005180 2023-06-10T19:07:59.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.877+0000 7f3697fff640 1 --2- 172.21.15.53:0/2521966630 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3680005180 0x7f3698154670 secure :-1 s=READY pgs=2564 cs=0 l=1 rev1=1 crypto rx=0x7f368800e8f0 tx=0x7f368800edb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:59.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.877+0000 7f3694ff9640 1 -- 172.21.15.53:0/2521966630 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3688003b90 con 0x7f3680005180 2023-06-10T19:07:59.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.877+0000 7f3694ff9640 1 -- 172.21.15.53:0/2521966630 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3688003cf0 con 0x7f3680005180 2023-06-10T19:07:59.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.877+0000 7f369e6ab640 1 -- 172.21.15.53:0/2521966630 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36980c6740 con 0x7f3680005180 2023-06-10T19:07:59.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.877+0000 7f3694ff9640 1 -- 172.21.15.53:0/2521966630 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36880052f0 con 0x7f3680005180 2023-06-10T19:07:59.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.877+0000 7f369e6ab640 1 -- 172.21.15.53:0/2521966630 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36980b2cb0 con 0x7f3680005180 2023-06-10T19:07:59.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.877+0000 7f369e6ab640 1 -- 172.21.15.53:0/2521966630 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f369804d790 con 0x7f3680005180 2023-06-10T19:07:59.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.881+0000 7f3694ff9640 1 -- 172.21.15.53:0/2521966630 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3688005450 con 0x7f3680005180 2023-06-10T19:07:59.894 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.881+0000 7f3694ff9640 1 --2- 172.21.15.53:0/2521966630 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f36840662b0 0x7f3684068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:07:59.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.881+0000 7f3694ff9640 1 -- 172.21.15.53:0/2521966630 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f3688083c40 con 0x7f3680005180 2023-06-10T19:07:59.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.881+0000 7f36977fe640 1 --2- 172.21.15.53:0/2521966630 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f36840662b0 0x7f3684068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:07:59.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.881+0000 7f36977fe640 1 --2- 172.21.15.53:0/2521966630 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f36840662b0 0x7f3684068760 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f368c000c10 tx=0x7f368c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:07:59.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:07:59.885+0000 7f3694ff9640 1 -- 172.21.15.53:0/2521966630 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f36880512e0 con 0x7f3680005180 2023-06-10T19:08:00.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.037+0000 7f369e6ab640 1 -- 172.21.15.53:0/2521966630 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f36980cb140 con 0x7f3680005180 2023-06-10T19:08:00.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.037+0000 7f3694ff9640 1 -- 172.21.15.53:0/2521966630 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v176) v1 ==== 74+0+14637 (secure 0 0 0) 0x7f3688003e60 con 0x7f3680005180 2023-06-10T19:08:00.042 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:08:00.042 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":176,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:07:59.356289+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:08:00.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.041+0000 7f369e6ab640 1 -- 172.21.15.53:0/2521966630 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f36840662b0 msgr2=0x7f3684068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:00.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.041+0000 7f369e6ab640 1 --2- 172.21.15.53:0/2521966630 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f36840662b0 0x7f3684068760 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f368c000c10 tx=0x7f368c009040 comp rx=0 tx=0).stop 2023-06-10T19:08:00.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.041+0000 7f369e6ab640 1 -- 172.21.15.53:0/2521966630 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3680005180 msgr2=0x7f3698154670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:00.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.041+0000 7f369e6ab640 1 --2- 172.21.15.53:0/2521966630 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3680005180 0x7f3698154670 secure :-1 s=READY pgs=2564 cs=0 l=1 rev1=1 crypto rx=0x7f368800e8f0 tx=0x7f368800edb0 comp rx=0 tx=0).stop 2023-06-10T19:08:00.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.041+0000 7f369e6ab640 1 -- 172.21.15.53:0/2521966630 shutdown_connections 2023-06-10T19:08:00.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.041+0000 7f369e6ab640 1 --2- 172.21.15.53:0/2521966630 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f36840662b0 0x7f3684068760 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:00.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.041+0000 7f369e6ab640 1 --2- 172.21.15.53:0/2521966630 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f36980c4fd0 0x7f36980c6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:00.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.041+0000 7f369e6ab640 1 --2- 172.21.15.53:0/2521966630 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f36980b2860 0x7f36980c5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:00.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.041+0000 7f369e6ab640 1 --2- 172.21.15.53:0/2521966630 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3680005180 0x7f3698154670 unknown :-1 s=CLOSED pgs=2564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:00.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.041+0000 7f369e6ab640 1 -- 172.21.15.53:0/2521966630 >> 172.21.15.53:0/2521966630 conn(0x7f369806a0d0 msgr2=0x7f36980cdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:00.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.041+0000 7f369e6ab640 1 -- 172.21.15.53:0/2521966630 shutdown_connections 2023-06-10T19:08:00.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.041+0000 7f369e6ab640 1 -- 172.21.15.53:0/2521966630 wait complete. 2023-06-10T19:08:00.061 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-10T18:52:33.633114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-10T18:52:39.171487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-10T19:08:00.062 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-10T19:08:00.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.177+0000 7f588752f640 1 Processor -- start 2023-06-10T19:08:00.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.177+0000 7f588752f640 1 -- start start 2023-06-10T19:08:00.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.177+0000 7f588752f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58800b0b90 0x7f58800b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:00.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.177+0000 7f588752f640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58800cc7c0 con 0x7f588015c090 2023-06-10T19:08:00.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.177+0000 7f588752f640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58800ccaa0 con 0x7f58800b7e30 2023-06-10T19:08:00.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.177+0000 7f588752f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58800ccd80 con 0x7f58800b0b90 2023-06-10T19:08:00.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.177+0000 7f58852cb640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f588015c090 0x7f58800b7720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52486/0 (socket says 172.21.15.53:52486) 2023-06-10T19:08:00.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.177+0000 7f58852cb640 1 -- 172.21.15.53:0/610772354 learned_addr learned my addr 172.21.15.53:0/610772354 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:08:00.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.177+0000 7f5877fff640 1 -- 172.21.15.53:0/610772354 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3842478404 0 0) 0x7f58800cc7c0 con 0x7f588015c090 2023-06-10T19:08:00.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.177+0000 7f5885acc640 1 --2- 172.21.15.53:0/610772354 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58800b0b90 0x7f58800b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:00.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.177+0000 7f5877fff640 1 -- 172.21.15.53:0/610772354 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f586c003530 con 0x7f588015c090 2023-06-10T19:08:00.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.177+0000 7f5877fff640 1 -- 172.21.15.53:0/610772354 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2877856318 0 0) 0x7f586c003530 con 0x7f588015c090 2023-06-10T19:08:00.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.177+0000 7f5877fff640 1 -- 172.21.15.53:0/610772354 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58800b0b90 msgr2=0x7f58800b10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:00.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.177+0000 7f5877fff640 1 --2- 172.21.15.53:0/610772354 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58800b0b90 0x7f58800b10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:00.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.177+0000 7f5877fff640 1 -- 172.21.15.53:0/610772354 >> v1:172.21.15.117:6789/0 conn(0x7f58800b7e30 legacy=0x7f58800d04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:00.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.177+0000 7f5877fff640 1 -- 172.21.15.53:0/610772354 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58800cd060 con 0x7f588015c090 2023-06-10T19:08:00.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.177+0000 7f5877fff640 1 -- 172.21.15.53:0/610772354 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f587c0016a0 con 0x7f588015c090 2023-06-10T19:08:00.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.177+0000 7f5877fff640 1 -- 172.21.15.53:0/610772354 >> v1:172.21.15.53:6789/0 conn(0x7f588015c090 legacy=0x7f58800b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:00.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.177+0000 7f5877fff640 1 --2- 172.21.15.53:0/610772354 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58800b0b90 0x7f586c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:00.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.177+0000 7f5877fff640 1 --2- 172.21.15.53:0/610772354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f586c003f30 0x7f586c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:00.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.177+0000 7f5877fff640 1 --2- 172.21.15.53:0/610772354 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f586c004d10 0x7f586c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:00.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.177+0000 7f5877fff640 1 -- 172.21.15.53:0/610772354 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58800ccd80 con 0x7f586c003f30 2023-06-10T19:08:00.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.177+0000 7f5877fff640 1 -- 172.21.15.53:0/610772354 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f586c00bb20 con 0x7f586c004d10 2023-06-10T19:08:00.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.177+0000 7f5877fff640 1 -- 172.21.15.53:0/610772354 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f586c00bce0 con 0x7f58800b0b90 2023-06-10T19:08:00.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.177+0000 7f5884aca640 1 --2- 172.21.15.53:0/610772354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f586c003f30 0x7f586c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:00.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.177+0000 7f58852cb640 1 --2- 172.21.15.53:0/610772354 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58800b0b90 0x7f586c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:00.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.177+0000 7f5885acc640 1 --2- 172.21.15.53:0/610772354 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f586c004d10 0x7f586c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:00.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.177+0000 7f5884aca640 1 -- 172.21.15.53:0/610772354 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58800b0b90 msgr2=0x7f586c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:00.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.177+0000 7f5884aca640 1 --2- 172.21.15.53:0/610772354 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58800b0b90 0x7f586c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:00.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.177+0000 7f5884aca640 1 -- 172.21.15.53:0/610772354 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f586c004d10 msgr2=0x7f586c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:00.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.177+0000 7f5884aca640 1 --2- 172.21.15.53:0/610772354 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f586c004d10 0x7f586c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:00.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.177+0000 7f5884aca640 1 -- 172.21.15.53:0/610772354 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f586c003530 con 0x7f586c003f30 2023-06-10T19:08:00.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.177+0000 7f58852cb640 1 --2- 172.21.15.53:0/610772354 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58800b0b90 0x7f586c0039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:08:00.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.177+0000 7f5885acc640 1 --2- 172.21.15.53:0/610772354 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f586c004d10 0x7f586c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:08:00.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.181+0000 7f5884aca640 1 --2- 172.21.15.53:0/610772354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f586c003f30 0x7f586c0047d0 secure :-1 s=READY pgs=2566 cs=0 l=1 rev1=1 crypto rx=0x7f5870001750 tx=0x7f587001c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd68df128a7a5609 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:00.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.181+0000 7f5877fff640 1 -- 172.21.15.53:0/610772354 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58700052d0 con 0x7f586c003f30 2023-06-10T19:08:00.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.181+0000 7f5877fff640 1 -- 172.21.15.53:0/610772354 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58700a7050 con 0x7f586c003f30 2023-06-10T19:08:00.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.181+0000 7f5877fff640 1 -- 172.21.15.53:0/610772354 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5870003600 con 0x7f586c003f30 2023-06-10T19:08:00.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.181+0000 7f588752f640 1 -- 172.21.15.53:0/610772354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f586c003f30 msgr2=0x7f586c0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:00.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.181+0000 7f588752f640 1 --2- 172.21.15.53:0/610772354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f586c003f30 0x7f586c0047d0 secure :-1 s=READY pgs=2566 cs=0 l=1 rev1=1 crypto rx=0x7f5870001750 tx=0x7f587001c390 comp rx=0 tx=0).stop 2023-06-10T19:08:00.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.181+0000 7f5885acc640 1 -- 172.21.15.53:0/610772354 reap_dead start 2023-06-10T19:08:00.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.181+0000 7f588752f640 1 -- 172.21.15.53:0/610772354 shutdown_connections 2023-06-10T19:08:00.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.181+0000 7f588752f640 1 -- 172.21.15.53:0/610772354 >> 172.21.15.53:0/610772354 conn(0x7f5880069e20 msgr2=0x7f588006a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:00.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.181+0000 7f588752f640 1 -- 172.21.15.53:0/610772354 shutdown_connections 2023-06-10T19:08:00.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.181+0000 7f588752f640 1 -- 172.21.15.53:0/610772354 wait complete. 2023-06-10T19:08:00.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.181+0000 7f588752f640 1 Processor -- start 2023-06-10T19:08:00.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.181+0000 7f588752f640 1 -- start start 2023-06-10T19:08:00.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.181+0000 7f588752f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f586c003f30 0x7f588014ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:00.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.181+0000 7f588752f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58800c9450 0x7f5880149c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:00.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.181+0000 7f588752f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f58800cad00 0x7f58801579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:00.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.181+0000 7f588752f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f588014d980 con 0x7f58800cad00 2023-06-10T19:08:00.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.181+0000 7f588752f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f588014a140 con 0x7f586c003f30 2023-06-10T19:08:00.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.181+0000 7f588752f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58800c98c0 con 0x7f58800c9450 2023-06-10T19:08:00.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.181+0000 7f5885acc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f58800cad00 0x7f58801579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:00.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.181+0000 7f5885acc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f58800cad00 0x7f58801579a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55936/0 (socket says 172.21.15.53:55936) 2023-06-10T19:08:00.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.181+0000 7f5885acc640 1 -- 172.21.15.53:0/43659094 learned_addr learned my addr 172.21.15.53:0/43659094 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:08:00.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.185+0000 7f58852cb640 1 --2- 172.21.15.53:0/43659094 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f586c003f30 0x7f588014ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:00.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.185+0000 7f5884aca640 1 --2- 172.21.15.53:0/43659094 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58800c9450 0x7f5880149c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:00.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.185+0000 7f5885acc640 1 -- 172.21.15.53:0/43659094 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58800c9450 msgr2=0x7f5880149c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:00.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.185+0000 7f5885acc640 1 --2- 172.21.15.53:0/43659094 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58800c9450 0x7f5880149c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:00.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.185+0000 7f5885acc640 1 -- 172.21.15.53:0/43659094 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f586c003f30 msgr2=0x7f588014ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:00.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.185+0000 7f5885acc640 1 --2- 172.21.15.53:0/43659094 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f586c003f30 0x7f588014ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:00.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.185+0000 7f5885acc640 1 -- 172.21.15.53:0/43659094 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58800cb650 con 0x7f58800cad00 2023-06-10T19:08:00.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.185+0000 7f5884aca640 1 --2- 172.21.15.53:0/43659094 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58800c9450 0x7f5880149c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:08:00.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.185+0000 7f5885acc640 1 --2- 172.21.15.53:0/43659094 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f58800cad00 0x7f58801579a0 secure :-1 s=READY pgs=2567 cs=0 l=1 rev1=1 crypto rx=0x7f588008b4a0 tx=0x7f5878007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:00.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.185+0000 7f5875ffb640 1 -- 172.21.15.53:0/43659094 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5878014760 con 0x7f58800cad00 2023-06-10T19:08:00.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.185+0000 7f5875ffb640 1 -- 172.21.15.53:0/43659094 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5878011040 con 0x7f58800cad00 2023-06-10T19:08:00.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.185+0000 7f588752f640 1 -- 172.21.15.53:0/43659094 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58800cb930 con 0x7f58800cad00 2023-06-10T19:08:00.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.185+0000 7f5875ffb640 1 -- 172.21.15.53:0/43659094 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5878014ae0 con 0x7f58800cad00 2023-06-10T19:08:00.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.185+0000 7f588752f640 1 -- 172.21.15.53:0/43659094 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58800cbef0 con 0x7f58800cad00 2023-06-10T19:08:00.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.185+0000 7f588752f640 1 -- 172.21.15.53:0/43659094 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f588004d790 con 0x7f58800cad00 2023-06-10T19:08:00.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.185+0000 7f5875ffb640 1 -- 172.21.15.53:0/43659094 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5878014c40 con 0x7f58800cad00 2023-06-10T19:08:00.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.185+0000 7f5875ffb640 1 --2- 172.21.15.53:0/43659094 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f58640662b0 0x7f5864068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:00.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.185+0000 7f5875ffb640 1 -- 172.21.15.53:0/43659094 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f58780834a0 con 0x7f58800cad00 2023-06-10T19:08:00.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.185+0000 7f58852cb640 1 --2- 172.21.15.53:0/43659094 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f58640662b0 0x7f5864068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:00.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.185+0000 7f58852cb640 1 --2- 172.21.15.53:0/43659094 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f58640662b0 0x7f5864068760 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f587c0017d0 tx=0x7f587c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:00.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.189+0000 7f5875ffb640 1 -- 172.21.15.53:0/43659094 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5878050d00 con 0x7f58800cad00 2023-06-10T19:08:00.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.337+0000 7f588752f640 1 -- 172.21.15.53:0/43659094 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f58800b72f0 con 0x7f58800cad00 2023-06-10T19:08:00.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.341+0000 7f5875ffb640 1 -- 172.21.15.53:0/43659094 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v176) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5878054320 con 0x7f58800cad00 2023-06-10T19:08:00.343 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-06-10T19:08:00.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.341+0000 7f588752f640 1 -- 172.21.15.53:0/43659094 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f58640662b0 msgr2=0x7f5864068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:00.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.341+0000 7f588752f640 1 --2- 172.21.15.53:0/43659094 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f58640662b0 0x7f5864068760 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f587c0017d0 tx=0x7f587c009040 comp rx=0 tx=0).stop 2023-06-10T19:08:00.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.341+0000 7f588752f640 1 -- 172.21.15.53:0/43659094 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f58800cad00 msgr2=0x7f58801579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:00.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.341+0000 7f588752f640 1 --2- 172.21.15.53:0/43659094 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f58800cad00 0x7f58801579a0 secure :-1 s=READY pgs=2567 cs=0 l=1 rev1=1 crypto rx=0x7f588008b4a0 tx=0x7f5878007f30 comp rx=0 tx=0).stop 2023-06-10T19:08:00.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.341+0000 7f588752f640 1 -- 172.21.15.53:0/43659094 shutdown_connections 2023-06-10T19:08:00.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.341+0000 7f588752f640 1 --2- 172.21.15.53:0/43659094 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f58640662b0 0x7f5864068760 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:00.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.341+0000 7f588752f640 1 --2- 172.21.15.53:0/43659094 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f58800cad00 0x7f58801579a0 unknown :-1 s=CLOSED pgs=2567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:00.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.341+0000 7f588752f640 1 --2- 172.21.15.53:0/43659094 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58800c9450 0x7f5880149c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:00.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.341+0000 7f588752f640 1 --2- 172.21.15.53:0/43659094 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f586c003f30 0x7f588014ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:00.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.341+0000 7f588752f640 1 -- 172.21.15.53:0/43659094 >> 172.21.15.53:0/43659094 conn(0x7f5880069e20 msgr2=0x7f5880157120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:00.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.341+0000 7f588752f640 1 -- 172.21.15.53:0/43659094 shutdown_connections 2023-06-10T19:08:00.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.341+0000 7f588752f640 1 -- 172.21.15.53:0/43659094 wait complete. 2023-06-10T19:08:00.360 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-10T19:08:00.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.485+0000 7f5d22c19640 1 Processor -- start 2023-06-10T19:08:00.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.485+0000 7f5d22c19640 1 -- start start 2023-06-10T19:08:00.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.485+0000 7f5d22c19640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d1c0b7e30 0x7f5d1c0b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:00.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.485+0000 7f5d22c19640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5d1c0b0b90 0x7f5d1c0d04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:00.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.485+0000 7f5d22c19640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d1c0cc7c0 con 0x7f5d1c15c090 2023-06-10T19:08:00.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.485+0000 7f5d22c19640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d1c0ccaa0 con 0x7f5d1c0b0b90 2023-06-10T19:08:00.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.485+0000 7f5d22c19640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d1c0ccd80 con 0x7f5d1c0b7e30 2023-06-10T19:08:00.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.485+0000 7f5d211b6640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5d1c0b0b90 0x7f5d1c0d04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:00.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.485+0000 7f5d211b6640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5d1c0b0b90 0x7f5d1c0d04d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55940/0 (socket says 172.21.15.53:55940) 2023-06-10T19:08:00.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.485+0000 7f5d211b6640 1 -- 172.21.15.53:0/367753087 learned_addr learned my addr 172.21.15.53:0/367753087 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:08:00.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.485+0000 7f5d1bfff640 1 --2- 172.21.15.53:0/367753087 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d1c0b7e30 0x7f5d1c0b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:00.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.485+0000 7f5d211b6640 1 -- 172.21.15.53:0/367753087 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d1c0b7e30 msgr2=0x7f5d1c0b10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:00.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.485+0000 7f5d211b6640 1 --2- 172.21.15.53:0/367753087 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d1c0b7e30 0x7f5d1c0b10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:00.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.485+0000 7f5d211b6640 1 -- 172.21.15.53:0/367753087 >> v1:172.21.15.117:6789/0 conn(0x7f5d1c15c090 legacy=0x7f5d1c0b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:00.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.485+0000 7f5d211b6640 1 -- 172.21.15.53:0/367753087 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d1c0cd060 con 0x7f5d1c0b0b90 2023-06-10T19:08:00.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.489+0000 7f5d211b6640 1 --2- 172.21.15.53:0/367753087 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d1c0b0b90 0x7f5d1c0d04d0 secure :-1 s=READY pgs=2568 cs=0 l=1 rev1=1 crypto rx=0x7f5d14009e50 tx=0x7f5d1401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45df1f6bdf9465d7 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:00.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.489+0000 7f5d1b7fe640 1 -- 172.21.15.53:0/367753087 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d140a56f0 con 0x7f5d1c0b0b90 2023-06-10T19:08:00.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.489+0000 7f5d1b7fe640 1 -- 172.21.15.53:0/367753087 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d140a5850 con 0x7f5d1c0b0b90 2023-06-10T19:08:00.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.489+0000 7f5d1b7fe640 1 -- 172.21.15.53:0/367753087 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d140a5be0 con 0x7f5d1c0b0b90 2023-06-10T19:08:00.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.489+0000 7f5d22c19640 1 -- 172.21.15.53:0/367753087 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d1c0b0b90 msgr2=0x7f5d1c0d04d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:00.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.489+0000 7f5d22c19640 1 --2- 172.21.15.53:0/367753087 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d1c0b0b90 0x7f5d1c0d04d0 secure :-1 s=READY pgs=2568 cs=0 l=1 rev1=1 crypto rx=0x7f5d14009e50 tx=0x7f5d1401c910 comp rx=0 tx=0).stop 2023-06-10T19:08:00.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.489+0000 7f5d22c19640 1 -- 172.21.15.53:0/367753087 shutdown_connections 2023-06-10T19:08:00.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.489+0000 7f5d22c19640 1 --2- 172.21.15.53:0/367753087 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d1c0b0b90 0x7f5d1c0d04d0 unknown :-1 s=CLOSED pgs=2568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:00.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.489+0000 7f5d22c19640 1 --2- 172.21.15.53:0/367753087 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d1c0b7e30 0x7f5d1c0b10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:00.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.489+0000 7f5d22c19640 1 -- 172.21.15.53:0/367753087 >> 172.21.15.53:0/367753087 conn(0x7f5d1c069e20 msgr2=0x7f5d1c06a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:00.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.489+0000 7f5d22c19640 1 -- 172.21.15.53:0/367753087 shutdown_connections 2023-06-10T19:08:00.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.489+0000 7f5d22c19640 1 -- 172.21.15.53:0/367753087 wait complete. 2023-06-10T19:08:00.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.489+0000 7f5d22c19640 1 Processor -- start 2023-06-10T19:08:00.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.489+0000 7f5d22c19640 1 -- start start 2023-06-10T19:08:00.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.489+0000 7f5d22c19640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d1c0b0b90 0x7f5d1c158710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:00.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.489+0000 7f5d22c19640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d1c0b7e30 0x7f5d1c0c4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:00.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.489+0000 7f5d22c19640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d1c15c090 0x7f5d1c155160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:00.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.489+0000 7f5d22c19640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d1c157670 con 0x7f5d1c0b7e30 2023-06-10T19:08:00.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.489+0000 7f5d22c19640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d1c157950 con 0x7f5d1c15c090 2023-06-10T19:08:00.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.489+0000 7f5d22c19640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d1c157c30 con 0x7f5d1c0b0b90 2023-06-10T19:08:00.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.489+0000 7f5d1bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d1c0b7e30 0x7f5d1c0c4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:00.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.489+0000 7f5d1bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d1c0b7e30 0x7f5d1c0c4f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55954/0 (socket says 172.21.15.53:55954) 2023-06-10T19:08:00.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.489+0000 7f5d1bfff640 1 -- 172.21.15.53:0/2699861867 learned_addr learned my addr 172.21.15.53:0/2699861867 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:08:00.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.489+0000 7f5d209b5640 1 --2- 172.21.15.53:0/2699861867 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d1c0b0b90 0x7f5d1c158710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:00.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.489+0000 7f5d211b6640 1 --2- 172.21.15.53:0/2699861867 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d1c15c090 0x7f5d1c155160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:00.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.489+0000 7f5d1bfff640 1 -- 172.21.15.53:0/2699861867 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d1c0b0b90 msgr2=0x7f5d1c158710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:00.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.489+0000 7f5d1bfff640 1 --2- 172.21.15.53:0/2699861867 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d1c0b0b90 0x7f5d1c158710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:00.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.489+0000 7f5d1bfff640 1 -- 172.21.15.53:0/2699861867 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d1c15c090 msgr2=0x7f5d1c155160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:00.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.489+0000 7f5d1bfff640 1 --2- 172.21.15.53:0/2699861867 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d1c15c090 0x7f5d1c155160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:00.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.489+0000 7f5d1bfff640 1 -- 172.21.15.53:0/2699861867 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d14009b30 con 0x7f5d1c0b7e30 2023-06-10T19:08:00.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.493+0000 7f5d1bfff640 1 --2- 172.21.15.53:0/2699861867 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d1c0b7e30 0x7f5d1c0c4f20 secure :-1 s=READY pgs=2569 cs=0 l=1 rev1=1 crypto rx=0x7f5d0c00d7d0 tx=0x7f5d0c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:00.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.493+0000 7f5d197fa640 1 -- 172.21.15.53:0/2699861867 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d0c00b6c0 con 0x7f5d1c0b7e30 2023-06-10T19:08:00.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.493+0000 7f5d197fa640 1 -- 172.21.15.53:0/2699861867 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d0c00b820 con 0x7f5d1c0b7e30 2023-06-10T19:08:00.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.493+0000 7f5d22c19640 1 -- 172.21.15.53:0/2699861867 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d1c157f10 con 0x7f5d1c0b7e30 2023-06-10T19:08:00.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.493+0000 7f5d197fa640 1 -- 172.21.15.53:0/2699861867 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d0c00bbd0 con 0x7f5d1c0b7e30 2023-06-10T19:08:00.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.493+0000 7f5d22c19640 1 -- 172.21.15.53:0/2699861867 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d1c158c50 con 0x7f5d1c0b7e30 2023-06-10T19:08:00.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.493+0000 7f5d22c19640 1 -- 172.21.15.53:0/2699861867 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d1c04d790 con 0x7f5d1c0b7e30 2023-06-10T19:08:00.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.493+0000 7f5d197fa640 1 -- 172.21.15.53:0/2699861867 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5d0c00bd30 con 0x7f5d1c0b7e30 2023-06-10T19:08:00.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.493+0000 7f5d197fa640 1 --2- 172.21.15.53:0/2699861867 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5cfc066280 0x7f5cfc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:00.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.493+0000 7f5d197fa640 1 -- 172.21.15.53:0/2699861867 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f5d0c083f90 con 0x7f5d1c0b7e30 2023-06-10T19:08:00.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.493+0000 7f5d209b5640 1 --2- 172.21.15.53:0/2699861867 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5cfc066280 0x7f5cfc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:00.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.493+0000 7f5d209b5640 1 --2- 172.21.15.53:0/2699861867 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5cfc066280 0x7f5cfc068730 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f5d0400b810 tx=0x7f5d04008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:00.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.497+0000 7f5d197fa640 1 -- 172.21.15.53:0/2699861867 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5d0c0b4700 con 0x7f5d1c0b7e30 2023-06-10T19:08:00.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.645+0000 7f5d22c19640 1 -- 172.21.15.53:0/2699861867 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5d1c0b72f0 con 0x7f5d1c0b7e30 2023-06-10T19:08:00.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.645+0000 7f5d197fa640 1 -- 172.21.15.53:0/2699861867 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v176) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5d0c0551f0 con 0x7f5d1c0b7e30 2023-06-10T19:08:00.650 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-06-10T19:08:00.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.649+0000 7f5d22c19640 1 -- 172.21.15.53:0/2699861867 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5cfc066280 msgr2=0x7f5cfc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:00.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.649+0000 7f5d22c19640 1 --2- 172.21.15.53:0/2699861867 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5cfc066280 0x7f5cfc068730 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f5d0400b810 tx=0x7f5d04008040 comp rx=0 tx=0).stop 2023-06-10T19:08:00.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.649+0000 7f5d22c19640 1 -- 172.21.15.53:0/2699861867 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d1c0b7e30 msgr2=0x7f5d1c0c4f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:00.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.649+0000 7f5d22c19640 1 --2- 172.21.15.53:0/2699861867 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d1c0b7e30 0x7f5d1c0c4f20 secure :-1 s=READY pgs=2569 cs=0 l=1 rev1=1 crypto rx=0x7f5d0c00d7d0 tx=0x7f5d0c00dc90 comp rx=0 tx=0).stop 2023-06-10T19:08:00.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.649+0000 7f5d22c19640 1 -- 172.21.15.53:0/2699861867 shutdown_connections 2023-06-10T19:08:00.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.649+0000 7f5d22c19640 1 --2- 172.21.15.53:0/2699861867 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5cfc066280 0x7f5cfc068730 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:00.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.649+0000 7f5d22c19640 1 --2- 172.21.15.53:0/2699861867 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d1c15c090 0x7f5d1c155160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:00.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.649+0000 7f5d22c19640 1 --2- 172.21.15.53:0/2699861867 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d1c0b7e30 0x7f5d1c0c4f20 unknown :-1 s=CLOSED pgs=2569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:00.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.649+0000 7f5d22c19640 1 --2- 172.21.15.53:0/2699861867 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5d1c0b0b90 0x7f5d1c158710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:00.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.649+0000 7f5d22c19640 1 -- 172.21.15.53:0/2699861867 >> 172.21.15.53:0/2699861867 conn(0x7f5d1c069e20 msgr2=0x7f5d1c06a270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:00.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.649+0000 7f5d22c19640 1 -- 172.21.15.53:0/2699861867 shutdown_connections 2023-06-10T19:08:00.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.649+0000 7f5d22c19640 1 -- 172.21.15.53:0/2699861867 wait complete. 2023-06-10T19:08:00.668 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-06-10T19:08:00.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.777+0000 7fa92f200640 1 Processor -- start 2023-06-10T19:08:00.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.777+0000 7fa92f200640 1 -- start start 2023-06-10T19:08:00.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.777+0000 7fa92f200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa9280c9840 0x7fa9280c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:00.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.777+0000 7fa92f200640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa928159b50 con 0x7fa92806b090 2023-06-10T19:08:00.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.777+0000 7fa92f200640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9280ca150 con 0x7fa928071060 2023-06-10T19:08:00.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.777+0000 7fa92f200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9280702a0 con 0x7fa9280c9840 2023-06-10T19:08:00.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.777+0000 7fa92d79d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fa92806b090 0x7fa92806b530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52498/0 (socket says 172.21.15.53:52498) 2023-06-10T19:08:00.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.777+0000 7fa92d79d640 1 -- 172.21.15.53:0/1903107596 learned_addr learned my addr 172.21.15.53:0/1903107596 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:08:00.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.777+0000 7fa92cf9c640 1 --2- 172.21.15.53:0/1903107596 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa9280c9840 0x7fa9280c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:00.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.777+0000 7fa9277fe640 1 -- 172.21.15.53:0/1903107596 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 786847081 0 0) 0x7fa928159b50 con 0x7fa92806b090 2023-06-10T19:08:00.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.777+0000 7fa9277fe640 1 -- 172.21.15.53:0/1903107596 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa914003530 con 0x7fa92806b090 2023-06-10T19:08:00.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.777+0000 7fa9277fe640 1 -- 172.21.15.53:0/1903107596 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 371394858 0 0) 0x7fa914003530 con 0x7fa92806b090 2023-06-10T19:08:00.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.777+0000 7fa9277fe640 1 -- 172.21.15.53:0/1903107596 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa9280c9840 msgr2=0x7fa9280c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:00.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.777+0000 7fa9277fe640 1 --2- 172.21.15.53:0/1903107596 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa9280c9840 0x7fa9280c9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:00.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.777+0000 7fa9277fe640 1 -- 172.21.15.53:0/1903107596 >> v1:172.21.15.117:6789/0 conn(0x7fa928071060 legacy=0x7fa9280af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:00.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.777+0000 7fa9277fe640 1 -- 172.21.15.53:0/1903107596 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa928070580 con 0x7fa92806b090 2023-06-10T19:08:00.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.777+0000 7fa9277fe640 1 -- 172.21.15.53:0/1903107596 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fa920001a00 con 0x7fa92806b090 2023-06-10T19:08:00.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.777+0000 7fa9277fe640 1 -- 172.21.15.53:0/1903107596 >> v1:172.21.15.53:6789/0 conn(0x7fa92806b090 legacy=0x7fa92806b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:00.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.777+0000 7fa9277fe640 1 --2- 172.21.15.53:0/1903107596 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa914003a20 0x7fa914003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:00.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.777+0000 7fa9277fe640 1 --2- 172.21.15.53:0/1903107596 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa9280c9840 0x7fa9140047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:00.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.777+0000 7fa9277fe640 1 --2- 172.21.15.53:0/1903107596 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa914004d10 0x7fa914005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:00.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.777+0000 7fa9277fe640 1 -- 172.21.15.53:0/1903107596 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9280702a0 con 0x7fa914003a20 2023-06-10T19:08:00.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.777+0000 7fa9277fe640 1 -- 172.21.15.53:0/1903107596 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa91400ba70 con 0x7fa914004d10 2023-06-10T19:08:00.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.777+0000 7fa9277fe640 1 -- 172.21.15.53:0/1903107596 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa91400bc30 con 0x7fa9280c9840 2023-06-10T19:08:00.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.777+0000 7fa92cf9c640 1 --2- 172.21.15.53:0/1903107596 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa914003a20 0x7fa914003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:00.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.777+0000 7fa927fff640 1 --2- 172.21.15.53:0/1903107596 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa9280c9840 0x7fa9140047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:00.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.777+0000 7fa92cf9c640 1 -- 172.21.15.53:0/1903107596 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa9280c9840 msgr2=0x7fa9140047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:00.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.777+0000 7fa92cf9c640 1 --2- 172.21.15.53:0/1903107596 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa9280c9840 0x7fa9140047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:00.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.777+0000 7fa92cf9c640 1 -- 172.21.15.53:0/1903107596 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa914004d10 msgr2=0x7fa914005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:00.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.777+0000 7fa92cf9c640 1 --2- 172.21.15.53:0/1903107596 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa914004d10 0x7fa914005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:00.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.777+0000 7fa92cf9c640 1 -- 172.21.15.53:0/1903107596 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa914003530 con 0x7fa914003a20 2023-06-10T19:08:00.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.781+0000 7fa92cf9c640 1 --2- 172.21.15.53:0/1903107596 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa914003a20 0x7fa914003e30 secure :-1 s=READY pgs=2571 cs=0 l=1 rev1=1 crypto rx=0x7fa918009ae0 tx=0x7fa91801ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38f3a963a61de0a0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:00.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.781+0000 7fa9277fe640 1 -- 172.21.15.53:0/1903107596 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9180a55f0 con 0x7fa914003a20 2023-06-10T19:08:00.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.781+0000 7fa9277fe640 1 -- 172.21.15.53:0/1903107596 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9180a5750 con 0x7fa914003a20 2023-06-10T19:08:00.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.781+0000 7fa9277fe640 1 -- 172.21.15.53:0/1903107596 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9180a5b00 con 0x7fa914003a20 2023-06-10T19:08:00.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.781+0000 7fa92f200640 1 -- 172.21.15.53:0/1903107596 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa914003a20 msgr2=0x7fa914003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:00.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.781+0000 7fa92f200640 1 --2- 172.21.15.53:0/1903107596 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa914003a20 0x7fa914003e30 secure :-1 s=READY pgs=2571 cs=0 l=1 rev1=1 crypto rx=0x7fa918009ae0 tx=0x7fa91801ca20 comp rx=0 tx=0).stop 2023-06-10T19:08:00.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.781+0000 7fa92d79d640 1 -- 172.21.15.53:0/1903107596 reap_dead start 2023-06-10T19:08:00.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.781+0000 7fa92f200640 1 -- 172.21.15.53:0/1903107596 shutdown_connections 2023-06-10T19:08:00.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.781+0000 7fa92f200640 1 -- 172.21.15.53:0/1903107596 >> 172.21.15.53:0/1903107596 conn(0x7fa92806a0d0 msgr2=0x7fa9280ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:00.791 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.781+0000 7fa92f200640 1 -- 172.21.15.53:0/1903107596 shutdown_connections 2023-06-10T19:08:00.791 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.781+0000 7fa92f200640 1 -- 172.21.15.53:0/1903107596 wait complete. 2023-06-10T19:08:00.791 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.781+0000 7fa92f200640 1 Processor -- start 2023-06-10T19:08:00.791 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.781+0000 7fa92f200640 1 -- start start 2023-06-10T19:08:00.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.785+0000 7fa92f200640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa914003a20 0x7fa928150bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:00.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.785+0000 7fa92f200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa92814b9e0 0x7fa9281527b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:00.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.785+0000 7fa92f200640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa9280c2310 0x7fa9280c2740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:00.792 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.785+0000 7fa92f200640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9280b22f0 con 0x7fa914003a20 2023-06-10T19:08:00.793 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.785+0000 7fa92f200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9280b2010 con 0x7fa92814b9e0 2023-06-10T19:08:00.793 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.785+0000 7fa92f200640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa92814c280 con 0x7fa9280c2310 2023-06-10T19:08:00.793 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.785+0000 7fa92cf9c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa914003a20 0x7fa928150bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:00.793 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.785+0000 7fa92cf9c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa914003a20 0x7fa928150bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55976/0 (socket says 172.21.15.53:55976) 2023-06-10T19:08:00.793 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.785+0000 7fa92cf9c640 1 -- 172.21.15.53:0/3728427799 learned_addr learned my addr 172.21.15.53:0/3728427799 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:08:00.794 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.785+0000 7fa92d79d640 1 --2- 172.21.15.53:0/3728427799 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa9280c2310 0x7fa9280c2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:00.794 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.785+0000 7fa927fff640 1 --2- 172.21.15.53:0/3728427799 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa92814b9e0 0x7fa9281527b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:00.794 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.785+0000 7fa92cf9c640 1 -- 172.21.15.53:0/3728427799 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa9280c2310 msgr2=0x7fa9280c2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:00.794 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.785+0000 7fa92cf9c640 1 --2- 172.21.15.53:0/3728427799 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa9280c2310 0x7fa9280c2740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:00.795 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.785+0000 7fa92cf9c640 1 -- 172.21.15.53:0/3728427799 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa92814b9e0 msgr2=0x7fa9281527b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:00.795 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.785+0000 7fa92cf9c640 1 --2- 172.21.15.53:0/3728427799 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa92814b9e0 0x7fa9281527b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:00.795 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.785+0000 7fa92cf9c640 1 -- 172.21.15.53:0/3728427799 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9281517a0 con 0x7fa914003a20 2023-06-10T19:08:00.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.785+0000 7fa92cf9c640 1 --2- 172.21.15.53:0/3728427799 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa914003a20 0x7fa928150bb0 secure :-1 s=READY pgs=2572 cs=0 l=1 rev1=1 crypto rx=0x7fa9180b0040 tx=0x7fa914005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:00.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.785+0000 7fa9257fa640 1 -- 172.21.15.53:0/3728427799 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9180a55f0 con 0x7fa914003a20 2023-06-10T19:08:00.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.785+0000 7fa9257fa640 1 -- 172.21.15.53:0/3728427799 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa918004020 con 0x7fa914003a20 2023-06-10T19:08:00.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.785+0000 7fa9257fa640 1 -- 172.21.15.53:0/3728427799 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9180043d0 con 0x7fa914003a20 2023-06-10T19:08:00.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.785+0000 7fa92f200640 1 -- 172.21.15.53:0/3728427799 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa928151a80 con 0x7fa914003a20 2023-06-10T19:08:00.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.785+0000 7fa92f200640 1 -- 172.21.15.53:0/3728427799 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa928152cf0 con 0x7fa914003a20 2023-06-10T19:08:00.797 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.785+0000 7fa92f200640 1 -- 172.21.15.53:0/3728427799 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa92804d790 con 0x7fa914003a20 2023-06-10T19:08:00.797 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.785+0000 7fa9257fa640 1 -- 172.21.15.53:0/3728427799 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa9180b4040 con 0x7fa914003a20 2023-06-10T19:08:00.797 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.785+0000 7fa9257fa640 1 --2- 172.21.15.53:0/3728427799 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa908066280 0x7fa908068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:00.797 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.785+0000 7fa9257fa640 1 -- 172.21.15.53:0/3728427799 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fa91811dc50 con 0x7fa914003a20 2023-06-10T19:08:00.797 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.785+0000 7fa927fff640 1 --2- 172.21.15.53:0/3728427799 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa908066280 0x7fa908068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:00.798 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.785+0000 7fa927fff640 1 --2- 172.21.15.53:0/3728427799 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa908066280 0x7fa908068730 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fa9280ae3b0 tx=0x7fa910009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:00.798 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.789+0000 7fa9257fa640 1 -- 172.21.15.53:0/3728427799 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa9180eb5f0 con 0x7fa914003a20 2023-06-10T19:08:00.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.945+0000 7fa92f200640 1 -- 172.21.15.53:0/3728427799 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fa9280ad4b0 con 0x7fa914003a20 2023-06-10T19:08:00.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.945+0000 7fa9257fa640 1 -- 172.21.15.53:0/3728427799 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v176) v1 ==== 84+0+126 (secure 0 0 0) 0x7fa9180eec10 con 0x7fa914003a20 2023-06-10T19:08:00.949 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:08:00.949 INFO:teuthology.orchestra.run.smithi053.stdout:[ 2023-06-10T19:08:00.950 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:08:00.950 INFO:teuthology.orchestra.run.smithi053.stdout: "poolnum": 1, 2023-06-10T19:08:00.950 INFO:teuthology.orchestra.run.smithi053.stdout: "poolname": ".mgr" 2023-06-10T19:08:00.950 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:08:00.950 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:08:00.950 INFO:teuthology.orchestra.run.smithi053.stdout: "poolnum": 2, 2023-06-10T19:08:00.950 INFO:teuthology.orchestra.run.smithi053.stdout: "poolname": "rbd" 2023-06-10T19:08:00.951 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:08:00.951 INFO:teuthology.orchestra.run.smithi053.stdout:] 2023-06-10T19:08:00.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.949+0000 7fa92f200640 1 -- 172.21.15.53:0/3728427799 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa908066280 msgr2=0x7fa908068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:00.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.949+0000 7fa92f200640 1 --2- 172.21.15.53:0/3728427799 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa908066280 0x7fa908068730 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fa9280ae3b0 tx=0x7fa910009040 comp rx=0 tx=0).stop 2023-06-10T19:08:00.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.949+0000 7fa92f200640 1 -- 172.21.15.53:0/3728427799 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa914003a20 msgr2=0x7fa928150bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:00.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.949+0000 7fa92f200640 1 --2- 172.21.15.53:0/3728427799 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa914003a20 0x7fa928150bb0 secure :-1 s=READY pgs=2572 cs=0 l=1 rev1=1 crypto rx=0x7fa9180b0040 tx=0x7fa914005800 comp rx=0 tx=0).stop 2023-06-10T19:08:00.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.949+0000 7fa92f200640 1 -- 172.21.15.53:0/3728427799 shutdown_connections 2023-06-10T19:08:00.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.949+0000 7fa92f200640 1 --2- 172.21.15.53:0/3728427799 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa908066280 0x7fa908068730 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:00.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.949+0000 7fa92f200640 1 --2- 172.21.15.53:0/3728427799 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa9280c2310 0x7fa9280c2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:00.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.949+0000 7fa92f200640 1 --2- 172.21.15.53:0/3728427799 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa92814b9e0 0x7fa9281527b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:00.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.949+0000 7fa92f200640 1 --2- 172.21.15.53:0/3728427799 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa914003a20 0x7fa928150bb0 unknown :-1 s=CLOSED pgs=2572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:00.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.949+0000 7fa92f200640 1 -- 172.21.15.53:0/3728427799 >> 172.21.15.53:0/3728427799 conn(0x7fa92806a0d0 msgr2=0x7fa92806b4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:00.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.949+0000 7fa92f200640 1 -- 172.21.15.53:0/3728427799 shutdown_connections 2023-06-10T19:08:00.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:00.949+0000 7fa92f200640 1 -- 172.21.15.53:0/3728427799 wait complete. 2023-06-10T19:08:00.968 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-06-10T19:08:00.969 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-06-10T19:08:01.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:01.089+0000 7fe428234640 1 Processor -- start 2023-06-10T19:08:01.093 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:01.089+0000 7fe428234640 1 -- start start 2023-06-10T19:08:01.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:01.089+0000 7fe428234640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe42006c210 0x7fe42006c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:01.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:01.089+0000 7fe428234640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe42015d0b0 0x7fe4200c8e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:01.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:01.089+0000 7fe428234640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe42006cb20 con 0x7fe420158bc0 2023-06-10T19:08:01.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:01.089+0000 7fe428234640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe420159120 con 0x7fe42006c210 2023-06-10T19:08:01.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:01.089+0000 7fe428234640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe420159400 con 0x7fe42015d0b0 2023-06-10T19:08:01.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:01.089+0000 7fe4267d1640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fe420158bc0 0x7fe4200af830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52508/0 (socket says 172.21.15.53:52508) 2023-06-10T19:08:01.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:01.089+0000 7fe4267d1640 1 -- 172.21.15.53:0/632645409 learned_addr learned my addr 172.21.15.53:0/632645409 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:08:01.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:01.089+0000 7fe4257cf640 1 --2- 172.21.15.53:0/632645409 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe42015d0b0 0x7fe4200c8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:01.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:01.089+0000 7fe425fd0640 1 --2- 172.21.15.53:0/632645409 >> v2:172.21.15.117:3300/0 conn(0x7fe42006c210 0x7fe42006c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:01.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:01.089+0000 7fe424fce640 1 -- 172.21.15.53:0/632645409 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 411595020 0 0) 0x7fe42006cb20 con 0x7fe420158bc0 2023-06-10T19:08:01.096 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:01.089+0000 7fe424fce640 1 -- 172.21.15.53:0/632645409 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe40c003530 con 0x7fe420158bc0 2023-06-10T19:08:01.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:01.093+0000 7fe424fce640 1 -- 172.21.15.53:0/632645409 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 71997980 0 0) 0x7fe40c003530 con 0x7fe420158bc0 2023-06-10T19:08:01.102 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:01.093+0000 7fe424fce640 1 -- 172.21.15.53:0/632645409 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe42015d0b0 msgr2=0x7fe4200c8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:01.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:01.093+0000 7fe424fce640 1 --2- 172.21.15.53:0/632645409 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe42015d0b0 0x7fe4200c8e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:01.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:01.093+0000 7fe424fce640 1 -- 172.21.15.53:0/632645409 >> v2:172.21.15.117:3300/0 conn(0x7fe42006c210 msgr2=0x7fe42006c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:01.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:01.093+0000 7fe424fce640 1 --2- 172.21.15.53:0/632645409 >> v2:172.21.15.117:3300/0 conn(0x7fe42006c210 0x7fe42006c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:01.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:01.093+0000 7fe424fce640 1 -- 172.21.15.53:0/632645409 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4201596e0 con 0x7fe420158bc0 2023-06-10T19:08:01.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:01.093+0000 7fe424fce640 1 -- 172.21.15.53:0/632645409 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fe418001a00 con 0x7fe420158bc0 2023-06-10T19:08:01.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:01.093+0000 7fe424fce640 1 -- 172.21.15.53:0/632645409 >> v1:172.21.15.53:6789/0 conn(0x7fe420158bc0 legacy=0x7fe4200af830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:01.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:01.093+0000 7fe424fce640 1 --2- 172.21.15.53:0/632645409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe40c003980 0x7fe40c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:01.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:01.093+0000 7fe424fce640 1 --2- 172.21.15.53:0/632645409 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe40c0043b0 0x7fe40c004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:01.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:01.093+0000 7fe424fce640 1 --2- 172.21.15.53:0/632645409 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe42015d0b0 0x7fe40c004f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:01.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:01.093+0000 7fe424fce640 1 -- 172.21.15.53:0/632645409 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe420159120 con 0x7fe40c0043b0 2023-06-10T19:08:01.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:01.093+0000 7fe424fce640 1 -- 172.21.15.53:0/632645409 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe420159400 con 0x7fe40c003980 2023-06-10T19:08:01.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:01.093+0000 7fe424fce640 1 -- 172.21.15.53:0/632645409 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe40c00dba0 con 0x7fe42015d0b0 2023-06-10T19:08:01.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:01.093+0000 7fe4257cf640 1 --2- 172.21.15.53:0/632645409 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe40c0043b0 0x7fe40c004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:01.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:01.093+0000 7fe4267d1640 1 --2- 172.21.15.53:0/632645409 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe42015d0b0 0x7fe40c004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:01.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:01.093+0000 7fe425fd0640 1 --2- 172.21.15.53:0/632645409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe40c003980 0x7fe40c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:01.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:01.093+0000 7fe4257cf640 1 -- 172.21.15.53:0/632645409 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe42015d0b0 msgr2=0x7fe40c004f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:01.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:01.093+0000 7fe4257cf640 1 --2- 172.21.15.53:0/632645409 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe42015d0b0 0x7fe40c004f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:01.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:01.093+0000 7fe4257cf640 1 -- 172.21.15.53:0/632645409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe40c003980 msgr2=0x7fe40c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:01.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:01.093+0000 7fe4257cf640 1 --2- 172.21.15.53:0/632645409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe40c003980 0x7fe40c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:01.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:01.093+0000 7fe4257cf640 1 -- 172.21.15.53:0/632645409 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe40c003530 con 0x7fe40c0043b0 2023-06-10T19:08:01.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:01.093+0000 7fe4257cf640 1 --2- 172.21.15.53:0/632645409 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe40c0043b0 0x7fe40c004870 secure :-1 s=READY pgs=2574 cs=0 l=1 rev1=1 crypto rx=0x7fe410009ab0 tx=0x7fe41001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c315aff8fd54a193 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:01.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:01.093+0000 7fe424fce640 1 -- 172.21.15.53:0/632645409 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4100a5510 con 0x7fe40c0043b0 2023-06-10T19:08:01.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:01.093+0000 7fe424fce640 1 -- 172.21.15.53:0/632645409 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4100a5670 con 0x7fe40c0043b0 2023-06-10T19:08:01.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:01.093+0000 7fe424fce640 1 -- 172.21.15.53:0/632645409 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4100a59e0 con 0x7fe40c0043b0 2023-06-10T19:08:01.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:01.093+0000 7fe428234640 1 -- 172.21.15.53:0/632645409 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe40c0043b0 msgr2=0x7fe40c004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:01.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:01.093+0000 7fe428234640 1 --2- 172.21.15.53:0/632645409 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe40c0043b0 0x7fe40c004870 secure :-1 s=READY pgs=2574 cs=0 l=1 rev1=1 crypto rx=0x7fe410009ab0 tx=0x7fe41001ca30 comp rx=0 tx=0).stop 2023-06-10T19:08:01.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:01.093+0000 7fe4267d1640 1 -- 172.21.15.53:0/632645409 reap_dead start 2023-06-10T19:08:01.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:01.093+0000 7fe428234640 1 -- 172.21.15.53:0/632645409 shutdown_connections 2023-06-10T19:08:01.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:01.093+0000 7fe428234640 1 -- 172.21.15.53:0/632645409 >> 172.21.15.53:0/632645409 conn(0x7fe4200ca830 msgr2=0x7fe4200cac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:01.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:01.093+0000 7fe428234640 1 -- 172.21.15.53:0/632645409 shutdown_connections 2023-06-10T19:08:01.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:01.093+0000 7fe428234640 1 -- 172.21.15.53:0/632645409 wait complete. 2023-06-10T19:08:01.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:01.097+0000 7fe428234640 1 Processor -- start 2023-06-10T19:08:01.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:01.097+0000 7fe428234640 1 -- start start 2023-06-10T19:08:01.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:01.097+0000 7fe428234640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4200c51e0 0x7fe4200c78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:01.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:01.097+0000 7fe428234640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4200c55b0 0x7fe4200c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:01.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:01.097+0000 7fe428234640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4200c7150 0x7fe4201428b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:01.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:01.097+0000 7fe428234640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4200b1af0 con 0x7fe4200c55b0 2023-06-10T19:08:01.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:01.097+0000 7fe428234640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4200c7df0 con 0x7fe4200c51e0 2023-06-10T19:08:01.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:01.097+0000 7fe428234640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4200c4270 con 0x7fe4200c7150 2023-06-10T19:08:01.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:01.097+0000 7fe4257cf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4200c55b0 0x7fe4200c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:01.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:01.097+0000 7fe4257cf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4200c55b0 0x7fe4200c6c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55998/0 (socket says 172.21.15.53:55998) 2023-06-10T19:08:01.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:01.097+0000 7fe4257cf640 1 -- 172.21.15.53:0/600832401 learned_addr learned my addr 172.21.15.53:0/600832401 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:08:01.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:01.097+0000 7fe425fd0640 1 --2- 172.21.15.53:0/600832401 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4200c51e0 0x7fe4200c78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:01.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:01.097+0000 7fe4267d1640 1 --2- 172.21.15.53:0/600832401 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4200c7150 0x7fe4201428b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:01.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:01.097+0000 7fe4257cf640 1 -- 172.21.15.53:0/600832401 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4200c7150 msgr2=0x7fe4201428b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:01.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:01.097+0000 7fe4257cf640 1 --2- 172.21.15.53:0/600832401 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4200c7150 0x7fe4201428b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:01.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:01.097+0000 7fe4257cf640 1 -- 172.21.15.53:0/600832401 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4200c51e0 msgr2=0x7fe4200c78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:01.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:01.097+0000 7fe4257cf640 1 --2- 172.21.15.53:0/600832401 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4200c51e0 0x7fe4200c78b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:01.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:01.097+0000 7fe4257cf640 1 -- 172.21.15.53:0/600832401 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4200c3f90 con 0x7fe4200c55b0 2023-06-10T19:08:01.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:01.097+0000 7fe4267d1640 1 --2- 172.21.15.53:0/600832401 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4200c7150 0x7fe4201428b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:08:01.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:01.097+0000 7fe4257cf640 1 --2- 172.21.15.53:0/600832401 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4200c55b0 0x7fe4200c6c10 secure :-1 s=READY pgs=2575 cs=0 l=1 rev1=1 crypto rx=0x7fe410009ab0 tx=0x7fe4100197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:01.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:01.097+0000 7fe4167fc640 1 -- 172.21.15.53:0/600832401 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4100b6660 con 0x7fe4200c55b0 2023-06-10T19:08:01.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:01.097+0000 7fe4167fc640 1 -- 172.21.15.53:0/600832401 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4100b67e0 con 0x7fe4200c55b0 2023-06-10T19:08:01.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:01.097+0000 7fe428234640 1 -- 172.21.15.53:0/600832401 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4200b1430 con 0x7fe4200c55b0 2023-06-10T19:08:01.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:01.097+0000 7fe4167fc640 1 -- 172.21.15.53:0/600832401 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4100b6b90 con 0x7fe4200c55b0 2023-06-10T19:08:01.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:01.097+0000 7fe428234640 1 -- 172.21.15.53:0/600832401 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4200c75c0 con 0x7fe4200c55b0 2023-06-10T19:08:01.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:01.097+0000 7fe428234640 1 -- 172.21.15.53:0/600832401 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4200b1c30 con 0x7fe4200c55b0 2023-06-10T19:08:01.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:01.097+0000 7fe4167fc640 1 -- 172.21.15.53:0/600832401 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe4100b4070 con 0x7fe4200c55b0 2023-06-10T19:08:01.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:01.101+0000 7fe4167fc640 1 --2- 172.21.15.53:0/600832401 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe4040662b0 0x7fe404068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:01.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:01.101+0000 7fe4167fc640 1 -- 172.21.15.53:0/600832401 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fe41011d3e0 con 0x7fe4200c55b0 2023-06-10T19:08:01.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:01.101+0000 7fe425fd0640 1 --2- 172.21.15.53:0/600832401 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe4040662b0 0x7fe404068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:01.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:01.101+0000 7fe425fd0640 1 --2- 172.21.15.53:0/600832401 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe4040662b0 0x7fe404068760 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7fe41c009ab0 tx=0x7fe41c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:01.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:01.105+0000 7fe4167fc640 1 -- 172.21.15.53:0/600832401 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe4200b1c30 con 0x7fe4200c55b0 2023-06-10T19:08:01.256 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:01.253+0000 7fe428234640 1 -- 172.21.15.53:0/600832401 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fe4200b1c30 con 0x7fe4200c55b0 2023-06-10T19:08:02.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:02.125+0000 7fe4167fc640 1 -- 172.21.15.53:0/600832401 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v177) v1 ==== 138+0+0 (secure 0 0 0) 0x7fe4200b1c30 con 0x7fe4200c55b0 2023-06-10T19:08:02.131 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_metadata' created 2023-06-10T19:08:02.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:02.133+0000 7fe428234640 1 -- 172.21.15.53:0/600832401 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe4040662b0 msgr2=0x7fe404068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:02.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:02.133+0000 7fe428234640 1 --2- 172.21.15.53:0/600832401 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe4040662b0 0x7fe404068760 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7fe41c009ab0 tx=0x7fe41c008040 comp rx=0 tx=0).stop 2023-06-10T19:08:02.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:02.133+0000 7fe428234640 1 -- 172.21.15.53:0/600832401 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4200c55b0 msgr2=0x7fe4200c6c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:02.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:02.133+0000 7fe428234640 1 --2- 172.21.15.53:0/600832401 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4200c55b0 0x7fe4200c6c10 secure :-1 s=READY pgs=2575 cs=0 l=1 rev1=1 crypto rx=0x7fe410009ab0 tx=0x7fe4100197d0 comp rx=0 tx=0).stop 2023-06-10T19:08:02.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:02.137+0000 7fe428234640 1 -- 172.21.15.53:0/600832401 shutdown_connections 2023-06-10T19:08:02.138 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:02.137+0000 7fe428234640 1 --2- 172.21.15.53:0/600832401 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe4040662b0 0x7fe404068760 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:02.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:02.137+0000 7fe428234640 1 --2- 172.21.15.53:0/600832401 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4200c7150 0x7fe4201428b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:02.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:02.137+0000 7fe428234640 1 --2- 172.21.15.53:0/600832401 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4200c55b0 0x7fe4200c6c10 unknown :-1 s=CLOSED pgs=2575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:02.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:02.137+0000 7fe428234640 1 --2- 172.21.15.53:0/600832401 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4200c51e0 0x7fe4200c78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:02.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:02.137+0000 7fe428234640 1 -- 172.21.15.53:0/600832401 >> 172.21.15.53:0/600832401 conn(0x7fe4200ca830 msgr2=0x7fe4200abf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:02.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:02.137+0000 7fe428234640 1 -- 172.21.15.53:0/600832401 shutdown_connections 2023-06-10T19:08:02.139 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:02.137+0000 7fe428234640 1 -- 172.21.15.53:0/600832401 wait complete. 2023-06-10T19:08:02.160 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-06-10T19:08:02.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:02.293+0000 7fce81ade640 1 Processor -- start 2023-06-10T19:08:02.295 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:02.293+0000 7fce81ade640 1 -- start start 2023-06-10T19:08:02.296 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:02.293+0000 7fce81ade640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce7c0af810 0x7fce7c0ac920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:02.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:02.293+0000 7fce81ade640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fce7c15fec0 0x7fce7c1559c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:02.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:02.293+0000 7fce81ade640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce7c15fa30 con 0x7fce7c06c4f0 2023-06-10T19:08:02.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:02.293+0000 7fce81ade640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce7c0acfb0 con 0x7fce7c15fec0 2023-06-10T19:08:02.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:02.293+0000 7fce81ade640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce7c0ad290 con 0x7fce7c0af810 2023-06-10T19:08:02.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:02.293+0000 7fce7bfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fce7c15fec0 0x7fce7c1559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:02.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:02.293+0000 7fce7bfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fce7c15fec0 0x7fce7c1559c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36800/0 (socket says 172.21.15.53:36800) 2023-06-10T19:08:02.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:02.293+0000 7fce7bfff640 1 -- 172.21.15.53:0/3237943097 learned_addr learned my addr 172.21.15.53:0/3237943097 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:08:02.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:02.293+0000 7fce7b7fe640 1 --2- 172.21.15.53:0/3237943097 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce7c0af810 0x7fce7c0ac920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:02.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:02.293+0000 7fce7bfff640 1 -- 172.21.15.53:0/3237943097 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce7c0af810 msgr2=0x7fce7c0ac920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:02.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:02.293+0000 7fce7bfff640 1 --2- 172.21.15.53:0/3237943097 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce7c0af810 0x7fce7c0ac920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:02.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:02.293+0000 7fce7bfff640 1 -- 172.21.15.53:0/3237943097 >> v1:172.21.15.117:6789/0 conn(0x7fce7c06c4f0 legacy=0x7fce7c0afbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:02.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:02.293+0000 7fce7bfff640 1 -- 172.21.15.53:0/3237943097 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce7c15f6c0 con 0x7fce7c15fec0 2023-06-10T19:08:02.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:02.293+0000 7fce7b7fe640 1 --2- 172.21.15.53:0/3237943097 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce7c0af810 0x7fce7c0ac920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:08:02.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:02.297+0000 7fce7bfff640 1 --2- 172.21.15.53:0/3237943097 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce7c15fec0 0x7fce7c1559c0 secure :-1 s=READY pgs=2576 cs=0 l=1 rev1=1 crypto rx=0x7fce74009e50 tx=0x7fce7401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd3602de751812cd server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:02.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:02.297+0000 7fce7a7fc640 1 -- 172.21.15.53:0/3237943097 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce740a57c0 con 0x7fce7c15fec0 2023-06-10T19:08:02.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:02.297+0000 7fce7a7fc640 1 -- 172.21.15.53:0/3237943097 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce740a5920 con 0x7fce7c15fec0 2023-06-10T19:08:02.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:02.297+0000 7fce7a7fc640 1 -- 172.21.15.53:0/3237943097 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce740a5cb0 con 0x7fce7c15fec0 2023-06-10T19:08:02.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:02.297+0000 7fce81ade640 1 -- 172.21.15.53:0/3237943097 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce7c15fec0 msgr2=0x7fce7c1559c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:02.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:02.297+0000 7fce81ade640 1 --2- 172.21.15.53:0/3237943097 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce7c15fec0 0x7fce7c1559c0 secure :-1 s=READY pgs=2576 cs=0 l=1 rev1=1 crypto rx=0x7fce74009e50 tx=0x7fce7401c920 comp rx=0 tx=0).stop 2023-06-10T19:08:02.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:02.297+0000 7fce81ade640 1 -- 172.21.15.53:0/3237943097 shutdown_connections 2023-06-10T19:08:02.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:02.297+0000 7fce81ade640 1 --2- 172.21.15.53:0/3237943097 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce7c15fec0 0x7fce7c1559c0 unknown :-1 s=CLOSED pgs=2576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:02.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:02.297+0000 7fce81ade640 1 --2- 172.21.15.53:0/3237943097 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce7c0af810 0x7fce7c0ac920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:02.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:02.297+0000 7fce81ade640 1 -- 172.21.15.53:0/3237943097 >> 172.21.15.53:0/3237943097 conn(0x7fce7c06a0e0 msgr2=0x7fce7c0ca810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:02.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:02.297+0000 7fce81ade640 1 -- 172.21.15.53:0/3237943097 shutdown_connections 2023-06-10T19:08:02.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:02.297+0000 7fce81ade640 1 -- 172.21.15.53:0/3237943097 wait complete. 2023-06-10T19:08:02.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:02.297+0000 7fce81ade640 1 Processor -- start 2023-06-10T19:08:02.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:02.297+0000 7fce81ade640 1 -- start start 2023-06-10T19:08:02.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:02.301+0000 7fce81ade640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce7c06c4f0 0x7fce7c15eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:02.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:02.301+0000 7fce81ade640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce7c0af810 0x7fce7c14bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:02.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:02.301+0000 7fce81ade640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce7c15fec0 0x7fce7c14c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:02.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:02.301+0000 7fce81ade640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce7c15e1e0 con 0x7fce7c15fec0 2023-06-10T19:08:02.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:02.301+0000 7fce81ade640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce7c0ad720 con 0x7fce7c06c4f0 2023-06-10T19:08:02.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:02.301+0000 7fce81ade640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce7c0ad9c0 con 0x7fce7c0af810 2023-06-10T19:08:02.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:02.301+0000 7fce7bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce7c15fec0 0x7fce7c14c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:02.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:02.301+0000 7fce7bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce7c15fec0 0x7fce7c14c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36806/0 (socket says 172.21.15.53:36806) 2023-06-10T19:08:02.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:02.301+0000 7fce7bfff640 1 -- 172.21.15.53:0/2777311883 learned_addr learned my addr 172.21.15.53:0/2777311883 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:08:02.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:02.301+0000 7fce7b7fe640 1 --2- 172.21.15.53:0/2777311883 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce7c06c4f0 0x7fce7c15eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:02.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:02.301+0000 7fce7affd640 1 --2- 172.21.15.53:0/2777311883 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce7c0af810 0x7fce7c14bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:02.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:02.301+0000 7fce7bfff640 1 -- 172.21.15.53:0/2777311883 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce7c0af810 msgr2=0x7fce7c14bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:02.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:02.301+0000 7fce7bfff640 1 --2- 172.21.15.53:0/2777311883 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce7c0af810 0x7fce7c14bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:02.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:02.301+0000 7fce7bfff640 1 -- 172.21.15.53:0/2777311883 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce7c06c4f0 msgr2=0x7fce7c15eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:02.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:02.301+0000 7fce7bfff640 1 --2- 172.21.15.53:0/2777311883 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce7c06c4f0 0x7fce7c15eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:02.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:02.301+0000 7fce7bfff640 1 -- 172.21.15.53:0/2777311883 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce74009b30 con 0x7fce7c15fec0 2023-06-10T19:08:02.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:02.301+0000 7fce7bfff640 1 --2- 172.21.15.53:0/2777311883 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce7c15fec0 0x7fce7c14c120 secure :-1 s=READY pgs=2577 cs=0 l=1 rev1=1 crypto rx=0x7fce7401a5b0 tx=0x7fce74019720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:02.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:02.301+0000 7fce73fff640 1 -- 172.21.15.53:0/2777311883 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce740b8670 con 0x7fce7c15fec0 2023-06-10T19:08:02.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:02.301+0000 7fce73fff640 1 -- 172.21.15.53:0/2777311883 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce740b87d0 con 0x7fce7c15fec0 2023-06-10T19:08:02.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:02.301+0000 7fce81ade640 1 -- 172.21.15.53:0/2777311883 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce7c0c7020 con 0x7fce7c15fec0 2023-06-10T19:08:02.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:02.301+0000 7fce73fff640 1 -- 172.21.15.53:0/2777311883 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce740b8b40 con 0x7fce7c15fec0 2023-06-10T19:08:02.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:02.301+0000 7fce81ade640 1 -- 172.21.15.53:0/2777311883 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce7c0c75e0 con 0x7fce7c15fec0 2023-06-10T19:08:02.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:02.301+0000 7fce81ade640 1 -- 172.21.15.53:0/2777311883 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce7c0adb50 con 0x7fce7c15fec0 2023-06-10T19:08:02.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:02.301+0000 7fce73fff640 1 -- 172.21.15.53:0/2777311883 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fce740b8ca0 con 0x7fce7c15fec0 2023-06-10T19:08:02.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:02.301+0000 7fce73fff640 1 --2- 172.21.15.53:0/2777311883 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fce5c066280 0x7fce5c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:02.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:02.301+0000 7fce73fff640 1 -- 172.21.15.53:0/2777311883 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 5580+0+0 (secure 0 0 0) 0x7fce7411f410 con 0x7fce7c15fec0 2023-06-10T19:08:02.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:02.301+0000 7fce7b7fe640 1 --2- 172.21.15.53:0/2777311883 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fce5c066280 0x7fce5c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:02.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:02.305+0000 7fce7b7fe640 1 --2- 172.21.15.53:0/2777311883 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fce5c066280 0x7fce5c068730 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fce6c00c900 tx=0x7fce6c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:02.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:02.305+0000 7fce73fff640 1 -- 172.21.15.53:0/2777311883 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fce740ecc70 con 0x7fce7c15fec0 2023-06-10T19:08:02.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:02.461+0000 7fce81ade640 1 -- 172.21.15.53:0/2777311883 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fce7c04d790 con 0x7fce7c15fec0 2023-06-10T19:08:03.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.133+0000 7fce73fff640 1 -- 172.21.15.53:0/2777311883 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v178) v1 ==== 170+0+0 (secure 0 0 0) 0x7fce740f0290 con 0x7fce7c15fec0 2023-06-10T19:08:03.137 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_data' created 2023-06-10T19:08:03.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.149+0000 7fce81ade640 1 -- 172.21.15.53:0/2777311883 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fce5c066280 msgr2=0x7fce5c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:03.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.149+0000 7fce81ade640 1 --2- 172.21.15.53:0/2777311883 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fce5c066280 0x7fce5c068730 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fce6c00c900 tx=0x7fce6c008040 comp rx=0 tx=0).stop 2023-06-10T19:08:03.154 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.149+0000 7fce81ade640 1 -- 172.21.15.53:0/2777311883 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce7c15fec0 msgr2=0x7fce7c14c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:03.154 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.149+0000 7fce81ade640 1 --2- 172.21.15.53:0/2777311883 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce7c15fec0 0x7fce7c14c120 secure :-1 s=READY pgs=2577 cs=0 l=1 rev1=1 crypto rx=0x7fce7401a5b0 tx=0x7fce74019720 comp rx=0 tx=0).stop 2023-06-10T19:08:03.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.153+0000 7fce81ade640 1 -- 172.21.15.53:0/2777311883 shutdown_connections 2023-06-10T19:08:03.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.153+0000 7fce81ade640 1 --2- 172.21.15.53:0/2777311883 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fce5c066280 0x7fce5c068730 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:03.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.153+0000 7fce81ade640 1 --2- 172.21.15.53:0/2777311883 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fce7c15fec0 0x7fce7c14c120 unknown :-1 s=CLOSED pgs=2577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:03.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.153+0000 7fce81ade640 1 --2- 172.21.15.53:0/2777311883 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fce7c0af810 0x7fce7c14bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:03.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.153+0000 7fce81ade640 1 --2- 172.21.15.53:0/2777311883 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce7c06c4f0 0x7fce7c15eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:03.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.153+0000 7fce81ade640 1 -- 172.21.15.53:0/2777311883 >> 172.21.15.53:0/2777311883 conn(0x7fce7c06a0e0 msgr2=0x7fce7c0afbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:03.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.153+0000 7fce81ade640 1 -- 172.21.15.53:0/2777311883 shutdown_connections 2023-06-10T19:08:03.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.153+0000 7fce81ade640 1 -- 172.21.15.53:0/2777311883 wait complete. 2023-06-10T19:08:03.188 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-06-10T19:08:03.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.309+0000 7f74aa7a1640 1 Processor -- start 2023-06-10T19:08:03.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.309+0000 7f74aa7a1640 1 -- start start 2023-06-10T19:08:03.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.309+0000 7f74aa7a1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f74a4159690 0x7f74a4070950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:03.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.309+0000 7f74aa7a1640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f74a40b0f30 0x7f74a40cbe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:03.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.309+0000 7f74aa7a1640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f74a4159a60 0x7f74a40c2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:03.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.309+0000 7f74aa7a1640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74a4070e90 con 0x7f74a4159a60 2023-06-10T19:08:03.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.309+0000 7f74aa7a1640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74a406d450 con 0x7f74a40b0f30 2023-06-10T19:08:03.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.309+0000 7f74aa7a1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74a40cb080 con 0x7f74a4159690 2023-06-10T19:08:03.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.309+0000 7f74a8d3e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f74a4159a60 0x7f74a40c2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:03.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.309+0000 7f74a8d3e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f74a4159a60 0x7f74a40c2900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36810/0 (socket says 172.21.15.53:36810) 2023-06-10T19:08:03.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.309+0000 7f74a8d3e640 1 -- 172.21.15.53:0/2756533391 learned_addr learned my addr 172.21.15.53:0/2756533391 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:08:03.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.309+0000 7f74a3fff640 1 --2- 172.21.15.53:0/2756533391 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f74a4159690 0x7f74a4070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:03.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.309+0000 7f74a37fe640 1 --2- 172.21.15.53:0/2756533391 >> v2:172.21.15.117:3300/0 conn(0x7f74a40b0f30 0x7f74a40cbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:03.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.309+0000 7f74a8d3e640 1 -- 172.21.15.53:0/2756533391 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f74a4159690 msgr2=0x7f74a4070950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:03.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.309+0000 7f74a8d3e640 1 --2- 172.21.15.53:0/2756533391 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f74a4159690 0x7f74a4070950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:03.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.309+0000 7f74a8d3e640 1 -- 172.21.15.53:0/2756533391 >> v2:172.21.15.117:3300/0 conn(0x7f74a40b0f30 msgr2=0x7f74a40cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:03.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.309+0000 7f74a8d3e640 1 --2- 172.21.15.53:0/2756533391 >> v2:172.21.15.117:3300/0 conn(0x7f74a40b0f30 0x7f74a40cbe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:03.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.309+0000 7f74a8d3e640 1 -- 172.21.15.53:0/2756533391 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a40cb320 con 0x7f74a4159a60 2023-06-10T19:08:03.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.313+0000 7f74a8d3e640 1 --2- 172.21.15.53:0/2756533391 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74a4159a60 0x7f74a40c2900 secure :-1 s=READY pgs=2578 cs=0 l=1 rev1=1 crypto rx=0x7f74a406a530 tx=0x7f749401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3432567bd8cf2caf server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:03.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.313+0000 7f74a2ffd640 1 -- 172.21.15.53:0/2756533391 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74940ac600 con 0x7f74a4159a60 2023-06-10T19:08:03.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.313+0000 7f74a2ffd640 1 -- 172.21.15.53:0/2756533391 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74940a8050 con 0x7f74a4159a60 2023-06-10T19:08:03.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.313+0000 7f74a2ffd640 1 -- 172.21.15.53:0/2756533391 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74940ac980 con 0x7f74a4159a60 2023-06-10T19:08:03.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.313+0000 7f74aa7a1640 1 -- 172.21.15.53:0/2756533391 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74a4159a60 msgr2=0x7f74a40c2900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:03.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.313+0000 7f74aa7a1640 1 --2- 172.21.15.53:0/2756533391 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74a4159a60 0x7f74a40c2900 secure :-1 s=READY pgs=2578 cs=0 l=1 rev1=1 crypto rx=0x7f74a406a530 tx=0x7f749401c4d0 comp rx=0 tx=0).stop 2023-06-10T19:08:03.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.313+0000 7f74aa7a1640 1 -- 172.21.15.53:0/2756533391 shutdown_connections 2023-06-10T19:08:03.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.313+0000 7f74aa7a1640 1 --2- 172.21.15.53:0/2756533391 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74a4159a60 0x7f74a40c2900 unknown :-1 s=CLOSED pgs=2578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:03.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.313+0000 7f74aa7a1640 1 --2- 172.21.15.53:0/2756533391 >> v2:172.21.15.117:3300/0 conn(0x7f74a40b0f30 0x7f74a40cbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:03.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.313+0000 7f74aa7a1640 1 --2- 172.21.15.53:0/2756533391 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f74a4159690 0x7f74a4070950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:03.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.313+0000 7f74aa7a1640 1 -- 172.21.15.53:0/2756533391 >> 172.21.15.53:0/2756533391 conn(0x7f74a406a560 msgr2=0x7f74a406a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:03.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.313+0000 7f74aa7a1640 1 -- 172.21.15.53:0/2756533391 shutdown_connections 2023-06-10T19:08:03.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.313+0000 7f74aa7a1640 1 -- 172.21.15.53:0/2756533391 wait complete. 2023-06-10T19:08:03.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.313+0000 7f74aa7a1640 1 Processor -- start 2023-06-10T19:08:03.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.313+0000 7f74aa7a1640 1 -- start start 2023-06-10T19:08:03.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.313+0000 7f74aa7a1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f74a40b0f30 0x7f74a4144d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:03.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.313+0000 7f74aa7a1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74a4159690 0x7f74a41453f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:03.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.313+0000 7f74aa7a1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f74a4159a60 0x7f74a40ced90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:03.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.313+0000 7f74aa7a1640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a4145290 con 0x7f74a4159690 2023-06-10T19:08:03.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.313+0000 7f74aa7a1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a40c36e0 con 0x7f74a4159a60 2023-06-10T19:08:03.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.313+0000 7f74aa7a1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74a4145d60 con 0x7f74a40b0f30 2023-06-10T19:08:03.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.313+0000 7f74a37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74a4159690 0x7f74a41453f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:03.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.313+0000 7f74a37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74a4159690 0x7f74a41453f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36826/0 (socket says 172.21.15.53:36826) 2023-06-10T19:08:03.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.313+0000 7f74a37fe640 1 -- 172.21.15.53:0/2057799054 learned_addr learned my addr 172.21.15.53:0/2057799054 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:08:03.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.313+0000 7f74a3fff640 1 --2- 172.21.15.53:0/2057799054 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f74a40b0f30 0x7f74a4144d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:03.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.317+0000 7f74a8d3e640 1 --2- 172.21.15.53:0/2057799054 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f74a4159a60 0x7f74a40ced90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:03.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.317+0000 7f74a37fe640 1 -- 172.21.15.53:0/2057799054 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f74a40b0f30 msgr2=0x7f74a4144d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:03.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.317+0000 7f74a37fe640 1 --2- 172.21.15.53:0/2057799054 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f74a40b0f30 0x7f74a4144d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:03.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.317+0000 7f74a37fe640 1 -- 172.21.15.53:0/2057799054 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f74a4159a60 msgr2=0x7f74a40ced90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:03.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.317+0000 7f74a37fe640 1 --2- 172.21.15.53:0/2057799054 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f74a4159a60 0x7f74a40ced90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:03.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.317+0000 7f74a37fe640 1 -- 172.21.15.53:0/2057799054 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74940094d0 con 0x7f74a4159690 2023-06-10T19:08:03.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.317+0000 7f74a3fff640 1 --2- 172.21.15.53:0/2057799054 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f74a40b0f30 0x7f74a4144d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:08:03.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.317+0000 7f74a37fe640 1 --2- 172.21.15.53:0/2057799054 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74a4159690 0x7f74a41453f0 secure :-1 s=READY pgs=2579 cs=0 l=1 rev1=1 crypto rx=0x7f749800d800 tx=0x7f749800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:03.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.317+0000 7f74a0ff9640 1 -- 172.21.15.53:0/2057799054 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f749800b6c0 con 0x7f74a4159690 2023-06-10T19:08:03.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.317+0000 7f74a0ff9640 1 -- 172.21.15.53:0/2057799054 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f749800b820 con 0x7f74a4159690 2023-06-10T19:08:03.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.317+0000 7f74aa7a1640 1 -- 172.21.15.53:0/2057799054 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74a4146040 con 0x7f74a4159690 2023-06-10T19:08:03.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.317+0000 7f74a0ff9640 1 -- 172.21.15.53:0/2057799054 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f749800bb90 con 0x7f74a4159690 2023-06-10T19:08:03.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.317+0000 7f74aa7a1640 1 -- 172.21.15.53:0/2057799054 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74a4146600 con 0x7f74a4159690 2023-06-10T19:08:03.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.317+0000 7f74aa7a1640 1 -- 172.21.15.53:0/2057799054 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74a404d790 con 0x7f74a4159690 2023-06-10T19:08:03.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.317+0000 7f74a0ff9640 1 -- 172.21.15.53:0/2057799054 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f749800bcf0 con 0x7f74a4159690 2023-06-10T19:08:03.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.317+0000 7f74a0ff9640 1 --2- 172.21.15.53:0/2057799054 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7490066280 0x7f7490068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:03.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.317+0000 7f74a0ff9640 1 -- 172.21.15.53:0/2057799054 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f7498084260 con 0x7f74a4159690 2023-06-10T19:08:03.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.317+0000 7f74a3fff640 1 --2- 172.21.15.53:0/2057799054 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7490066280 0x7f7490068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:03.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.317+0000 7f74a3fff640 1 --2- 172.21.15.53:0/2057799054 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7490066280 0x7f7490068730 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f749c003fd0 tx=0x7f749c0039a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:03.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.321+0000 7f74a0ff9640 1 -- 172.21.15.53:0/2057799054 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f74980551d0 con 0x7f74a4159690 2023-06-10T19:08:03.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.509+0000 7f74aa7a1640 1 -- 172.21.15.53:0/2057799054 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f74a40c3820 con 0x7f74a4159690 2023-06-10T19:08:03.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.521+0000 7f74a0ff9640 1 -- 172.21.15.53:0/2057799054 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 25 and data pool 26 v100) v1 ==== 174+0+0 (secure 0 0 0) 0x7f7498054d60 con 0x7f74a4159690 2023-06-10T19:08:03.527 INFO:teuthology.orchestra.run.smithi053.stderr:new fs with metadata pool 25 and data pool 26 2023-06-10T19:08:03.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.529+0000 7f74aa7a1640 1 -- 172.21.15.53:0/2057799054 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7490066280 msgr2=0x7f7490068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:03.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.529+0000 7f74aa7a1640 1 --2- 172.21.15.53:0/2057799054 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7490066280 0x7f7490068730 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f749c003fd0 tx=0x7f749c0039a0 comp rx=0 tx=0).stop 2023-06-10T19:08:03.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.529+0000 7f74aa7a1640 1 -- 172.21.15.53:0/2057799054 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74a4159690 msgr2=0x7f74a41453f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:03.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.529+0000 7f74aa7a1640 1 --2- 172.21.15.53:0/2057799054 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74a4159690 0x7f74a41453f0 secure :-1 s=READY pgs=2579 cs=0 l=1 rev1=1 crypto rx=0x7f749800d800 tx=0x7f749800dcc0 comp rx=0 tx=0).stop 2023-06-10T19:08:03.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.529+0000 7f74aa7a1640 1 -- 172.21.15.53:0/2057799054 shutdown_connections 2023-06-10T19:08:03.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.529+0000 7f74aa7a1640 1 --2- 172.21.15.53:0/2057799054 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7490066280 0x7f7490068730 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:03.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.529+0000 7f74aa7a1640 1 --2- 172.21.15.53:0/2057799054 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f74a4159a60 0x7f74a40ced90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:03.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.529+0000 7f74aa7a1640 1 --2- 172.21.15.53:0/2057799054 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74a4159690 0x7f74a41453f0 secure :-1 s=CLOSED pgs=2579 cs=0 l=1 rev1=1 crypto rx=0x7f749800d800 tx=0x7f749800dcc0 comp rx=0 tx=0).stop 2023-06-10T19:08:03.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.529+0000 7f74aa7a1640 1 --2- 172.21.15.53:0/2057799054 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f74a40b0f30 0x7f74a4144d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:03.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.529+0000 7f74aa7a1640 1 -- 172.21.15.53:0/2057799054 >> 172.21.15.53:0/2057799054 conn(0x7f74a406a560 msgr2=0x7f74a4157540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:03.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.537+0000 7f74aa7a1640 1 -- 172.21.15.53:0/2057799054 shutdown_connections 2023-06-10T19:08:03.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.537+0000 7f74aa7a1640 1 -- 172.21.15.53:0/2057799054 wait complete. 2023-06-10T19:08:03.567 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:08:03.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.681+0000 7f0265d4d640 1 Processor -- start 2023-06-10T19:08:03.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.685+0000 7f0265d4d640 1 -- start start 2023-06-10T19:08:03.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.685+0000 7f0265d4d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02600ccae0 0x7f02600d0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:03.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.685+0000 7f0265d4d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02600d0020 con 0x7f02600cc690 2023-06-10T19:08:03.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.685+0000 7f0265d4d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02600cef40 con 0x7f02600b3ac0 2023-06-10T19:08:03.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.685+0000 7f0265d4d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02600cf220 con 0x7f02600ccae0 2023-06-10T19:08:03.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.685+0000 7f0257fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f02600cc690 0x7f02600d04b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:45790/0 (socket says 172.21.15.53:45790) 2023-06-10T19:08:03.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.685+0000 7f0257fff640 1 -- 172.21.15.53:0/11522532 learned_addr learned my addr 172.21.15.53:0/11522532 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:08:03.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.685+0000 7f025ffff640 1 --2- 172.21.15.53:0/11522532 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02600ccae0 0x7f02600d0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:03.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.685+0000 7f025effd640 1 -- 172.21.15.53:0/11522532 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 696047114 0 0) 0x7f02600d0020 con 0x7f02600cc690 2023-06-10T19:08:03.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.685+0000 7f025effd640 1 -- 172.21.15.53:0/11522532 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f024c003530 con 0x7f02600cc690 2023-06-10T19:08:03.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.685+0000 7f025effd640 1 -- 172.21.15.53:0/11522532 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1477031199 0 0) 0x7f024c003530 con 0x7f02600cc690 2023-06-10T19:08:03.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.685+0000 7f025effd640 1 -- 172.21.15.53:0/11522532 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02600ccae0 msgr2=0x7f02600d0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:03.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.685+0000 7f025effd640 1 --2- 172.21.15.53:0/11522532 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02600ccae0 0x7f02600d0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:03.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.685+0000 7f025effd640 1 -- 172.21.15.53:0/11522532 >> v1:172.21.15.117:6789/0 conn(0x7f02600b3ac0 legacy=0x7f02600b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:03.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.685+0000 7f025effd640 1 -- 172.21.15.53:0/11522532 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02600cf500 con 0x7f02600cc690 2023-06-10T19:08:03.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.685+0000 7f025effd640 1 -- 172.21.15.53:0/11522532 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f0248001680 con 0x7f02600cc690 2023-06-10T19:08:03.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.685+0000 7f025effd640 1 -- 172.21.15.53:0/11522532 >> v1:172.21.15.53:6789/0 conn(0x7f02600cc690 legacy=0x7f02600d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:03.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.685+0000 7f025effd640 1 --2- 172.21.15.53:0/11522532 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f024c003a20 0x7f024c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:03.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.685+0000 7f025effd640 1 --2- 172.21.15.53:0/11522532 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f024c0047d0 0x7f024c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:03.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.685+0000 7f025effd640 1 --2- 172.21.15.53:0/11522532 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02600ccae0 0x7f024c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:03.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.685+0000 7f025effd640 1 -- 172.21.15.53:0/11522532 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02600cf220 con 0x7f024c003a20 2023-06-10T19:08:03.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.685+0000 7f025effd640 1 -- 172.21.15.53:0/11522532 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f024c00baa0 con 0x7f024c0047d0 2023-06-10T19:08:03.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.685+0000 7f025effd640 1 -- 172.21.15.53:0/11522532 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f024c00bc60 con 0x7f02600ccae0 2023-06-10T19:08:03.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.685+0000 7f025f7fe640 1 --2- 172.21.15.53:0/11522532 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f024c003a20 0x7f024c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:03.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.685+0000 7f0257fff640 1 --2- 172.21.15.53:0/11522532 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f024c0047d0 0x7f024c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:03.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.685+0000 7f025ffff640 1 --2- 172.21.15.53:0/11522532 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02600ccae0 0x7f024c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:03.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.685+0000 7f025f7fe640 1 -- 172.21.15.53:0/11522532 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02600ccae0 msgr2=0x7f024c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:03.693 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.685+0000 7f025f7fe640 1 --2- 172.21.15.53:0/11522532 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02600ccae0 0x7f024c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:03.693 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.685+0000 7f025f7fe640 1 -- 172.21.15.53:0/11522532 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f024c0047d0 msgr2=0x7f024c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:03.693 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.685+0000 7f025f7fe640 1 --2- 172.21.15.53:0/11522532 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f024c0047d0 0x7f024c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:03.693 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.685+0000 7f025f7fe640 1 -- 172.21.15.53:0/11522532 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f024c003530 con 0x7f024c003a20 2023-06-10T19:08:03.693 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.685+0000 7f025ffff640 1 --2- 172.21.15.53:0/11522532 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02600ccae0 0x7f024c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:08:03.696 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.689+0000 7f025f7fe640 1 --2- 172.21.15.53:0/11522532 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f024c003a20 0x7f024c003e30 secure :-1 s=READY pgs=2581 cs=0 l=1 rev1=1 crypto rx=0x7f0250001780 tx=0x7f025001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=133b3ee3604eeda4 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:03.696 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.689+0000 7f025effd640 1 -- 172.21.15.53:0/11522532 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02500052d0 con 0x7f024c003a20 2023-06-10T19:08:03.696 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.689+0000 7f025effd640 1 -- 172.21.15.53:0/11522532 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02500a7050 con 0x7f024c003a20 2023-06-10T19:08:03.696 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.689+0000 7f025effd640 1 -- 172.21.15.53:0/11522532 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0250003600 con 0x7f024c003a20 2023-06-10T19:08:03.696 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.689+0000 7f0265d4d640 1 -- 172.21.15.53:0/11522532 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f024c003a20 msgr2=0x7f024c003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:03.697 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.689+0000 7f0265d4d640 1 --2- 172.21.15.53:0/11522532 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f024c003a20 0x7f024c003e30 secure :-1 s=READY pgs=2581 cs=0 l=1 rev1=1 crypto rx=0x7f0250001780 tx=0x7f025001c3d0 comp rx=0 tx=0).stop 2023-06-10T19:08:03.697 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.689+0000 7f025ffff640 1 -- 172.21.15.53:0/11522532 reap_dead start 2023-06-10T19:08:03.697 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.689+0000 7f0265d4d640 1 -- 172.21.15.53:0/11522532 shutdown_connections 2023-06-10T19:08:03.697 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.689+0000 7f0265d4d640 1 -- 172.21.15.53:0/11522532 >> 172.21.15.53:0/11522532 conn(0x7f0260071790 msgr2=0x7f0260069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:03.697 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.689+0000 7f0265d4d640 1 -- 172.21.15.53:0/11522532 shutdown_connections 2023-06-10T19:08:03.697 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.689+0000 7f0265d4d640 1 -- 172.21.15.53:0/11522532 wait complete. 2023-06-10T19:08:03.697 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.689+0000 7f0265d4d640 1 Processor -- start 2023-06-10T19:08:03.697 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.689+0000 7f0265d4d640 1 -- start start 2023-06-10T19:08:03.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.689+0000 7f0265d4d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f024c003a20 0x7f02601545a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:03.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.689+0000 7f0265d4d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0260154ae0 0x7f02600b2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:03.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.689+0000 7f0265d4d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02600b3300 0x7f026015dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:03.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.689+0000 7f0265d4d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02600c9df0 con 0x7f024c003a20 2023-06-10T19:08:03.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.689+0000 7f0265d4d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02600b3770 con 0x7f02600b3300 2023-06-10T19:08:03.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.689+0000 7f0265d4d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f026015ecc0 con 0x7f0260154ae0 2023-06-10T19:08:03.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.689+0000 7f025f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f024c003a20 0x7f02601545a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:03.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.689+0000 7f025f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f024c003a20 0x7f02601545a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36842/0 (socket says 172.21.15.53:36842) 2023-06-10T19:08:03.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.689+0000 7f025f7fe640 1 -- 172.21.15.53:0/1607943978 learned_addr learned my addr 172.21.15.53:0/1607943978 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:08:03.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.689+0000 7f0257fff640 1 --2- 172.21.15.53:0/1607943978 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0260154ae0 0x7f02600b2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:03.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.689+0000 7f025ffff640 1 --2- 172.21.15.53:0/1607943978 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02600b3300 0x7f026015dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:03.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.689+0000 7f025f7fe640 1 -- 172.21.15.53:0/1607943978 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0260154ae0 msgr2=0x7f02600b2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:03.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.689+0000 7f025f7fe640 1 --2- 172.21.15.53:0/1607943978 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0260154ae0 0x7f02600b2dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:03.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.689+0000 7f025f7fe640 1 -- 172.21.15.53:0/1607943978 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02600b3300 msgr2=0x7f026015dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:03.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.689+0000 7f025f7fe640 1 --2- 172.21.15.53:0/1607943978 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02600b3300 0x7f026015dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:03.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.689+0000 7f025f7fe640 1 -- 172.21.15.53:0/1607943978 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0260155300 con 0x7f024c003a20 2023-06-10T19:08:03.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.689+0000 7f025ffff640 1 --2- 172.21.15.53:0/1607943978 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02600b3300 0x7f026015dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:08:03.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.689+0000 7f025f7fe640 1 --2- 172.21.15.53:0/1607943978 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f024c003a20 0x7f02601545a0 secure :-1 s=READY pgs=2582 cs=0 l=1 rev1=1 crypto rx=0x7f0250001780 tx=0x7f024c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:03.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.689+0000 7f025cff9640 1 -- 172.21.15.53:0/1607943978 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0250007180 con 0x7f024c003a20 2023-06-10T19:08:03.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.689+0000 7f025cff9640 1 -- 172.21.15.53:0/1607943978 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02500a4e90 con 0x7f024c003a20 2023-06-10T19:08:03.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.689+0000 7f0265d4d640 1 -- 172.21.15.53:0/1607943978 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f026015e9e0 con 0x7f024c003a20 2023-06-10T19:08:03.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.693+0000 7f025cff9640 1 -- 172.21.15.53:0/1607943978 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0250007500 con 0x7f024c003a20 2023-06-10T19:08:03.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.693+0000 7f0265d4d640 1 -- 172.21.15.53:0/1607943978 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02600c9a10 con 0x7f024c003a20 2023-06-10T19:08:03.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.693+0000 7f0265d4d640 1 -- 172.21.15.53:0/1607943978 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f026004d790 con 0x7f024c003a20 2023-06-10T19:08:03.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.693+0000 7f025cff9640 1 -- 172.21.15.53:0/1607943978 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f02500067e0 con 0x7f024c003a20 2023-06-10T19:08:03.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.693+0000 7f025cff9640 1 --2- 172.21.15.53:0/1607943978 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f02400662b0 0x7f0240068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:03.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.693+0000 7f025cff9640 1 -- 172.21.15.53:0/1607943978 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f025011dde0 con 0x7f024c003a20 2023-06-10T19:08:03.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.693+0000 7f0257fff640 1 --2- 172.21.15.53:0/1607943978 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f02400662b0 0x7f0240068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:03.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.693+0000 7f0257fff640 1 --2- 172.21.15.53:0/1607943978 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f02400662b0 0x7f0240068760 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f0248001060 tx=0x7f0248009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:03.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.697+0000 7f025cff9640 1 -- 172.21.15.53:0/1607943978 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f02500eed80 con 0x7f024c003a20 2023-06-10T19:08:03.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.853+0000 7f0265d4d640 1 -- 172.21.15.53:0/1607943978 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f026008a200 con 0x7f024c003a20 2023-06-10T19:08:03.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.857+0000 7f025cff9640 1 -- 172.21.15.53:0/1607943978 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v179) v1 ==== 74+0+18298 (secure 0 0 0) 0x7f02500ee910 con 0x7f024c003a20 2023-06-10T19:08:03.859 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:08:03.859 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":179,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:08:03.513946+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2023-06-10T19:08:01.296938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"179","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_data","create_time":"2023-06-10T19:08:02.507633+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"179","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:08:03.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.857+0000 7f0265d4d640 1 -- 172.21.15.53:0/1607943978 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f02400662b0 msgr2=0x7f0240068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:03.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.857+0000 7f0265d4d640 1 --2- 172.21.15.53:0/1607943978 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f02400662b0 0x7f0240068760 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f0248001060 tx=0x7f0248009040 comp rx=0 tx=0).stop 2023-06-10T19:08:03.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.857+0000 7f0265d4d640 1 -- 172.21.15.53:0/1607943978 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f024c003a20 msgr2=0x7f02601545a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:03.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.857+0000 7f0265d4d640 1 --2- 172.21.15.53:0/1607943978 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f024c003a20 0x7f02601545a0 secure :-1 s=READY pgs=2582 cs=0 l=1 rev1=1 crypto rx=0x7f0250001780 tx=0x7f024c005800 comp rx=0 tx=0).stop 2023-06-10T19:08:03.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.857+0000 7f0265d4d640 1 -- 172.21.15.53:0/1607943978 shutdown_connections 2023-06-10T19:08:03.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.857+0000 7f0265d4d640 1 --2- 172.21.15.53:0/1607943978 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f02400662b0 0x7f0240068760 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:03.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.857+0000 7f0265d4d640 1 --2- 172.21.15.53:0/1607943978 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02600b3300 0x7f026015dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:03.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.857+0000 7f0265d4d640 1 --2- 172.21.15.53:0/1607943978 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0260154ae0 0x7f02600b2dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:03.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.857+0000 7f0265d4d640 1 --2- 172.21.15.53:0/1607943978 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f024c003a20 0x7f02601545a0 unknown :-1 s=CLOSED pgs=2582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:03.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.857+0000 7f0265d4d640 1 -- 172.21.15.53:0/1607943978 >> 172.21.15.53:0/1607943978 conn(0x7f0260071790 msgr2=0x7f02600d1840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:03.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.857+0000 7f0265d4d640 1 -- 172.21.15.53:0/1607943978 shutdown_connections 2023-06-10T19:08:03.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.857+0000 7f0265d4d640 1 -- 172.21.15.53:0/1607943978 wait complete. 2023-06-10T19:08:03.878 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:08:03.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.993+0000 7f74f579a640 1 Processor -- start 2023-06-10T19:08:03.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.993+0000 7f74f579a640 1 -- start start 2023-06-10T19:08:03.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.993+0000 7f74f579a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f74f00c9840 0x7f74f00c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:03.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.993+0000 7f74f579a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f74f006b090 0x7f74f006b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:03.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.997+0000 7f74f579a640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74f0159b50 con 0x7f74f0071060 2023-06-10T19:08:03.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.997+0000 7f74f579a640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74f00ca150 con 0x7f74f006b090 2023-06-10T19:08:03.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.997+0000 7f74f579a640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74f00702a0 con 0x7f74f00c9840 2023-06-10T19:08:03.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.997+0000 7f74ef7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f74f006b090 0x7f74f006b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:04.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.997+0000 7f74ef7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f74f006b090 0x7f74f006b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36852/0 (socket says 172.21.15.53:36852) 2023-06-10T19:08:04.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.997+0000 7f74ef7fe640 1 -- 172.21.15.53:0/4258770995 learned_addr learned my addr 172.21.15.53:0/4258770995 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:08:04.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.997+0000 7f74eeffd640 1 --2- 172.21.15.53:0/4258770995 >> v2:172.21.15.117:3300/0 conn(0x7f74f00c9840 0x7f74f00c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:04.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.997+0000 7f74ef7fe640 1 -- 172.21.15.53:0/4258770995 >> v2:172.21.15.117:3300/0 conn(0x7f74f00c9840 msgr2=0x7f74f00c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:04.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.997+0000 7f74ef7fe640 1 --2- 172.21.15.53:0/4258770995 >> v2:172.21.15.117:3300/0 conn(0x7f74f00c9840 0x7f74f00c9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:04.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.997+0000 7f74ef7fe640 1 -- 172.21.15.53:0/4258770995 >> v1:172.21.15.117:6789/0 conn(0x7f74f0071060 legacy=0x7f74f00af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:04.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.997+0000 7f74ef7fe640 1 -- 172.21.15.53:0/4258770995 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74f0070580 con 0x7f74f006b090 2023-06-10T19:08:04.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.997+0000 7f74ef7fe640 1 --2- 172.21.15.53:0/4258770995 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74f006b090 0x7f74f006b510 secure :-1 s=READY pgs=2583 cs=0 l=1 rev1=1 crypto rx=0x7f74f0071d80 tx=0x7f74e001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e147c283574afc15 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:04.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.997+0000 7f74edffb640 1 -- 172.21.15.53:0/4258770995 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e00aa430 con 0x7f74f006b090 2023-06-10T19:08:04.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.997+0000 7f74edffb640 1 -- 172.21.15.53:0/4258770995 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74e00aa590 con 0x7f74f006b090 2023-06-10T19:08:04.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.997+0000 7f74edffb640 1 -- 172.21.15.53:0/4258770995 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e00aa920 con 0x7f74f006b090 2023-06-10T19:08:04.002 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.997+0000 7f74f579a640 1 -- 172.21.15.53:0/4258770995 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74f006b090 msgr2=0x7f74f006b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:04.002 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.997+0000 7f74f579a640 1 --2- 172.21.15.53:0/4258770995 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74f006b090 0x7f74f006b510 secure :-1 s=READY pgs=2583 cs=0 l=1 rev1=1 crypto rx=0x7f74f0071d80 tx=0x7f74e001c4d0 comp rx=0 tx=0).stop 2023-06-10T19:08:04.002 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.997+0000 7f74f579a640 1 -- 172.21.15.53:0/4258770995 shutdown_connections 2023-06-10T19:08:04.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.997+0000 7f74f579a640 1 --2- 172.21.15.53:0/4258770995 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74f006b090 0x7f74f006b510 unknown :-1 s=CLOSED pgs=2583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:04.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.997+0000 7f74f579a640 1 --2- 172.21.15.53:0/4258770995 >> v2:172.21.15.117:3300/0 conn(0x7f74f00c9840 0x7f74f00c9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:04.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.997+0000 7f74f579a640 1 -- 172.21.15.53:0/4258770995 >> 172.21.15.53:0/4258770995 conn(0x7f74f006a0d0 msgr2=0x7f74f00ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:04.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.997+0000 7f74f579a640 1 -- 172.21.15.53:0/4258770995 shutdown_connections 2023-06-10T19:08:04.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:03.997+0000 7f74f579a640 1 -- 172.21.15.53:0/4258770995 wait complete. 2023-06-10T19:08:04.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.001+0000 7f74f579a640 1 Processor -- start 2023-06-10T19:08:04.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.001+0000 7f74f579a640 1 -- start start 2023-06-10T19:08:04.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.001+0000 7f74f579a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f74f006b090 0x7f74f00afba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:04.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.001+0000 7f74f579a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f74f0071060 0x7f74f0155440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:04.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.001+0000 7f74f579a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74f00c9840 0x7f74f014e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:04.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.001+0000 7f74f579a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74f015cfc0 con 0x7f74f00c9840 2023-06-10T19:08:04.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.001+0000 7f74f579a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74f015d2a0 con 0x7f74f0071060 2023-06-10T19:08:04.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.001+0000 7f74f579a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74f015d580 con 0x7f74f006b090 2023-06-10T19:08:04.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.001+0000 7f74ef7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74f00c9840 0x7f74f014e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:04.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.001+0000 7f74ef7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74f00c9840 0x7f74f014e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36866/0 (socket says 172.21.15.53:36866) 2023-06-10T19:08:04.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.001+0000 7f74ef7fe640 1 -- 172.21.15.53:0/640391036 learned_addr learned my addr 172.21.15.53:0/640391036 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:08:04.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.001+0000 7f74ee7fc640 1 --2- 172.21.15.53:0/640391036 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f74f0071060 0x7f74f0155440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:04.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.001+0000 7f74eeffd640 1 --2- 172.21.15.53:0/640391036 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f74f006b090 0x7f74f00afba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:04.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.001+0000 7f74ef7fe640 1 -- 172.21.15.53:0/640391036 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f74f006b090 msgr2=0x7f74f00afba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:04.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.001+0000 7f74ef7fe640 1 --2- 172.21.15.53:0/640391036 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f74f006b090 0x7f74f00afba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:04.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.001+0000 7f74ef7fe640 1 -- 172.21.15.53:0/640391036 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f74f0071060 msgr2=0x7f74f0155440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:04.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.001+0000 7f74ef7fe640 1 --2- 172.21.15.53:0/640391036 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f74f0071060 0x7f74f0155440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:04.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.001+0000 7f74ef7fe640 1 -- 172.21.15.53:0/640391036 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74e00094d0 con 0x7f74f00c9840 2023-06-10T19:08:04.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.001+0000 7f74eeffd640 1 --2- 172.21.15.53:0/640391036 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f74f006b090 0x7f74f00afba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:08:04.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.001+0000 7f74ef7fe640 1 --2- 172.21.15.53:0/640391036 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74f00c9840 0x7f74f014e500 secure :-1 s=READY pgs=2584 cs=0 l=1 rev1=1 crypto rx=0x7f74e00ac040 tx=0x7f74e001ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:04.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.001+0000 7f74e77fe640 1 -- 172.21.15.53:0/640391036 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e00aa430 con 0x7f74f00c9840 2023-06-10T19:08:04.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.001+0000 7f74e77fe640 1 -- 172.21.15.53:0/640391036 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74e00b3820 con 0x7f74f00c9840 2023-06-10T19:08:04.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.001+0000 7f74f579a640 1 -- 172.21.15.53:0/640391036 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74f015d860 con 0x7f74f00c9840 2023-06-10T19:08:04.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.001+0000 7f74e77fe640 1 -- 172.21.15.53:0/640391036 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e00b3bd0 con 0x7f74f00c9840 2023-06-10T19:08:04.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.001+0000 7f74f579a640 1 -- 172.21.15.53:0/640391036 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74f00c17d0 con 0x7f74f00c9840 2023-06-10T19:08:04.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.005+0000 7f74f579a640 1 -- 172.21.15.53:0/640391036 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74f00c19c0 con 0x7f74f00c9840 2023-06-10T19:08:04.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.005+0000 7f74e77fe640 1 -- 172.21.15.53:0/640391036 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f74e00b3d30 con 0x7f74f00c9840 2023-06-10T19:08:04.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.005+0000 7f74e77fe640 1 --2- 172.21.15.53:0/640391036 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f74d0066280 0x7f74d0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:04.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.005+0000 7f74e77fe640 1 -- 172.21.15.53:0/640391036 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f74e011e1c0 con 0x7f74f00c9840 2023-06-10T19:08:04.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.005+0000 7f74eeffd640 1 --2- 172.21.15.53:0/640391036 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f74d0066280 0x7f74d0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:04.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.005+0000 7f74eeffd640 1 --2- 172.21.15.53:0/640391036 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f74d0066280 0x7f74d0068730 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f74e8007440 tx=0x7f74e800b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:04.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.009+0000 7f74e77fe640 1 -- 172.21.15.53:0/640391036 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f74e00eb650 con 0x7f74f00c9840 2023-06-10T19:08:04.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.165+0000 7f74f579a640 1 -- 172.21.15.53:0/640391036 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f74f004d790 con 0x7f74f00c9840 2023-06-10T19:08:04.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.165+0000 7f74e77fe640 1 -- 172.21.15.53:0/640391036 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v179) v1 ==== 74+0+18298 (secure 0 0 0) 0x7f74e00eec70 con 0x7f74f00c9840 2023-06-10T19:08:04.169 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:08:04.170 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":179,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:08:03.513946+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2023-06-10T19:08:01.296938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"179","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_data","create_time":"2023-06-10T19:08:02.507633+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"179","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:08:04.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.169+0000 7f74f579a640 1 -- 172.21.15.53:0/640391036 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f74d0066280 msgr2=0x7f74d0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:04.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.169+0000 7f74f579a640 1 --2- 172.21.15.53:0/640391036 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f74d0066280 0x7f74d0068730 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f74e8007440 tx=0x7f74e800b040 comp rx=0 tx=0).stop 2023-06-10T19:08:04.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.169+0000 7f74f579a640 1 -- 172.21.15.53:0/640391036 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74f00c9840 msgr2=0x7f74f014e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:04.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.169+0000 7f74f579a640 1 --2- 172.21.15.53:0/640391036 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74f00c9840 0x7f74f014e500 secure :-1 s=READY pgs=2584 cs=0 l=1 rev1=1 crypto rx=0x7f74e00ac040 tx=0x7f74e001ad10 comp rx=0 tx=0).stop 2023-06-10T19:08:04.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.169+0000 7f74f579a640 1 -- 172.21.15.53:0/640391036 shutdown_connections 2023-06-10T19:08:04.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.169+0000 7f74f579a640 1 --2- 172.21.15.53:0/640391036 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f74d0066280 0x7f74d0068730 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:04.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.169+0000 7f74f579a640 1 --2- 172.21.15.53:0/640391036 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74f00c9840 0x7f74f014e500 unknown :-1 s=CLOSED pgs=2584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:04.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.169+0000 7f74f579a640 1 --2- 172.21.15.53:0/640391036 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f74f0071060 0x7f74f0155440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:04.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.169+0000 7f74f579a640 1 --2- 172.21.15.53:0/640391036 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f74f006b090 0x7f74f00afba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:04.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.169+0000 7f74f579a640 1 -- 172.21.15.53:0/640391036 >> 172.21.15.53:0/640391036 conn(0x7f74f006a0d0 msgr2=0x7f74f014fd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:04.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.169+0000 7f74f579a640 1 -- 172.21.15.53:0/640391036 shutdown_connections 2023-06-10T19:08:04.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.169+0000 7f74f579a640 1 -- 172.21.15.53:0/640391036 wait complete. 2023-06-10T19:08:04.190 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-06-10T19:08:04.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.313+0000 7fdb64faa640 1 Processor -- start 2023-06-10T19:08:04.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.313+0000 7fdb64faa640 1 -- start start 2023-06-10T19:08:04.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.317+0000 7fdb64faa640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fdb6015cb40 0x7fdb600cc020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:04.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.317+0000 7fdb64faa640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb6015cf40 con 0x7fdb6015c060 2023-06-10T19:08:04.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.317+0000 7fdb64faa640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb600c8d50 con 0x7fdb60070de0 2023-06-10T19:08:04.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.317+0000 7fdb64faa640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb600c9030 con 0x7fdb6015cb40 2023-06-10T19:08:04.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.317+0000 7fdb5e59c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fdb6015c060 0x7fdb6015c430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:45800/0 (socket says 172.21.15.53:45800) 2023-06-10T19:08:04.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.317+0000 7fdb5e59c640 1 -- 172.21.15.53:0/41584088 learned_addr learned my addr 172.21.15.53:0/41584088 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:08:04.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.317+0000 7fdb5d59a640 1 -- 172.21.15.53:0/41584088 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1877165728 0 0) 0x7fdb6015cf40 con 0x7fdb6015c060 2023-06-10T19:08:04.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.317+0000 7fdb5ed9d640 1 --2- 172.21.15.53:0/41584088 >> v2:172.21.15.117:3300/0 conn(0x7fdb6015cb40 0x7fdb600cc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:04.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.317+0000 7fdb5d59a640 1 -- 172.21.15.53:0/41584088 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb48005740 con 0x7fdb6015c060 2023-06-10T19:08:04.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.317+0000 7fdb5d59a640 1 -- 172.21.15.53:0/41584088 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 186131287 0 0) 0x7fdb48005740 con 0x7fdb6015c060 2023-06-10T19:08:04.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.317+0000 7fdb5d59a640 1 -- 172.21.15.53:0/41584088 >> v2:172.21.15.117:3300/0 conn(0x7fdb6015cb40 msgr2=0x7fdb600cc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:04.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.317+0000 7fdb5d59a640 1 --2- 172.21.15.53:0/41584088 >> v2:172.21.15.117:3300/0 conn(0x7fdb6015cb40 0x7fdb600cc020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:04.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.317+0000 7fdb5d59a640 1 -- 172.21.15.53:0/41584088 >> v1:172.21.15.117:6789/0 conn(0x7fdb60070de0 legacy=0x7fdb6006bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:04.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.317+0000 7fdb5d59a640 1 -- 172.21.15.53:0/41584088 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb60070300 con 0x7fdb6015c060 2023-06-10T19:08:04.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.317+0000 7fdb5d59a640 1 -- 172.21.15.53:0/41584088 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fdb54001680 con 0x7fdb6015c060 2023-06-10T19:08:04.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.317+0000 7fdb5d59a640 1 -- 172.21.15.53:0/41584088 >> v1:172.21.15.53:6789/0 conn(0x7fdb6015c060 legacy=0x7fdb6015c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:04.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.317+0000 7fdb5d59a640 1 --2- 172.21.15.53:0/41584088 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb48005b90 0x7fdb48005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:04.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.317+0000 7fdb5d59a640 1 --2- 172.21.15.53:0/41584088 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb480069e0 0x7fdb48006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:04.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.317+0000 7fdb5d59a640 1 --2- 172.21.15.53:0/41584088 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb48007390 0x7fdb4800dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:04.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.317+0000 7fdb5d59a640 1 -- 172.21.15.53:0/41584088 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb600c9030 con 0x7fdb48005b90 2023-06-10T19:08:04.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.317+0000 7fdb5d59a640 1 -- 172.21.15.53:0/41584088 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4800e2a0 con 0x7fdb48007390 2023-06-10T19:08:04.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.317+0000 7fdb5d59a640 1 -- 172.21.15.53:0/41584088 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4800e460 con 0x7fdb480069e0 2023-06-10T19:08:04.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.317+0000 7fdb5e59c640 1 --2- 172.21.15.53:0/41584088 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb48005b90 0x7fdb48005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:04.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.317+0000 7fdb5ed9d640 1 --2- 172.21.15.53:0/41584088 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb48007390 0x7fdb4800dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:04.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.317+0000 7fdb5dd9b640 1 --2- 172.21.15.53:0/41584088 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb480069e0 0x7fdb48006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:04.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.317+0000 7fdb5e59c640 1 -- 172.21.15.53:0/41584088 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb480069e0 msgr2=0x7fdb48006e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:04.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.317+0000 7fdb5e59c640 1 --2- 172.21.15.53:0/41584088 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb480069e0 0x7fdb48006e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:04.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.317+0000 7fdb5e59c640 1 -- 172.21.15.53:0/41584088 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb48007390 msgr2=0x7fdb4800dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:04.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.317+0000 7fdb5e59c640 1 --2- 172.21.15.53:0/41584088 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb48007390 0x7fdb4800dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:04.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.317+0000 7fdb5ed9d640 1 -- 172.21.15.53:0/41584088 reap_dead start 2023-06-10T19:08:04.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.317+0000 7fdb5e59c640 1 -- 172.21.15.53:0/41584088 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb48005740 con 0x7fdb48005b90 2023-06-10T19:08:04.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.317+0000 7fdb5dd9b640 1 --2- 172.21.15.53:0/41584088 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb480069e0 0x7fdb48006e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:08:04.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.321+0000 7fdb5e59c640 1 --2- 172.21.15.53:0/41584088 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb48005b90 0x7fdb48005fa0 secure :-1 s=READY pgs=2586 cs=0 l=1 rev1=1 crypto rx=0x7fdb5400c240 tx=0x7fdb5401cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1dac1b79a604d4a server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:04.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.321+0000 7fdb5d59a640 1 -- 172.21.15.53:0/41584088 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb54005ae0 con 0x7fdb48005b90 2023-06-10T19:08:04.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.321+0000 7fdb5d59a640 1 -- 172.21.15.53:0/41584088 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb54005c40 con 0x7fdb48005b90 2023-06-10T19:08:04.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.321+0000 7fdb5d59a640 1 -- 172.21.15.53:0/41584088 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb540a5a00 con 0x7fdb48005b90 2023-06-10T19:08:04.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.321+0000 7fdb64faa640 1 -- 172.21.15.53:0/41584088 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb48005b90 msgr2=0x7fdb48005fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:04.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.321+0000 7fdb64faa640 1 --2- 172.21.15.53:0/41584088 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb48005b90 0x7fdb48005fa0 secure :-1 s=READY pgs=2586 cs=0 l=1 rev1=1 crypto rx=0x7fdb5400c240 tx=0x7fdb5401cbd0 comp rx=0 tx=0).stop 2023-06-10T19:08:04.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.321+0000 7fdb64faa640 1 -- 172.21.15.53:0/41584088 shutdown_connections 2023-06-10T19:08:04.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.321+0000 7fdb64faa640 1 --2- 172.21.15.53:0/41584088 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb48005b90 0x7fdb48005fa0 unknown :-1 s=CLOSED pgs=2586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:04.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.321+0000 7fdb64faa640 1 -- 172.21.15.53:0/41584088 >> 172.21.15.53:0/41584088 conn(0x7fdb6006a0e0 msgr2=0x7fdb600cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:04.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.321+0000 7fdb64faa640 1 -- 172.21.15.53:0/41584088 shutdown_connections 2023-06-10T19:08:04.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.321+0000 7fdb64faa640 1 -- 172.21.15.53:0/41584088 wait complete. 2023-06-10T19:08:04.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.321+0000 7fdb64faa640 1 Processor -- start 2023-06-10T19:08:04.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.321+0000 7fdb64faa640 1 -- start start 2023-06-10T19:08:04.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.321+0000 7fdb64faa640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb48005b90 0x7fdb600c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:04.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.321+0000 7fdb64faa640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb60153aa0 0x7fdb60153f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:04.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.321+0000 7fdb64faa640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb601587d0 0x7fdb60158c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:04.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.321+0000 7fdb64faa640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb601591b0 con 0x7fdb60153aa0 2023-06-10T19:08:04.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.321+0000 7fdb64faa640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb600c6870 con 0x7fdb48005b90 2023-06-10T19:08:04.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.321+0000 7fdb64faa640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb601595a0 con 0x7fdb601587d0 2023-06-10T19:08:04.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.321+0000 7fdb5dd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb60153aa0 0x7fdb60153f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:04.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.321+0000 7fdb5dd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb60153aa0 0x7fdb60153f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36878/0 (socket says 172.21.15.53:36878) 2023-06-10T19:08:04.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.321+0000 7fdb5dd9b640 1 -- 172.21.15.53:0/3078203078 learned_addr learned my addr 172.21.15.53:0/3078203078 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:08:04.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.321+0000 7fdb5e59c640 1 --2- 172.21.15.53:0/3078203078 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb48005b90 0x7fdb600c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:04.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.321+0000 7fdb5ed9d640 1 --2- 172.21.15.53:0/3078203078 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb601587d0 0x7fdb60158c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:04.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.321+0000 7fdb5dd9b640 1 -- 172.21.15.53:0/3078203078 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb601587d0 msgr2=0x7fdb60158c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:04.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.321+0000 7fdb5dd9b640 1 --2- 172.21.15.53:0/3078203078 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb601587d0 0x7fdb60158c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:04.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.321+0000 7fdb5dd9b640 1 -- 172.21.15.53:0/3078203078 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb48005b90 msgr2=0x7fdb600c75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:04.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.321+0000 7fdb5dd9b640 1 --2- 172.21.15.53:0/3078203078 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb48005b90 0x7fdb600c75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:04.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.321+0000 7fdb5dd9b640 1 -- 172.21.15.53:0/3078203078 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb600c57d0 con 0x7fdb60153aa0 2023-06-10T19:08:04.330 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.321+0000 7fdb5e59c640 1 --2- 172.21.15.53:0/3078203078 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb48005b90 0x7fdb600c75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:08:04.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.321+0000 7fdb5dd9b640 1 --2- 172.21.15.53:0/3078203078 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb60153aa0 0x7fdb60153f10 secure :-1 s=READY pgs=2587 cs=0 l=1 rev1=1 crypto rx=0x7fdb5000d4a0 tx=0x7fdb5000d590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:04.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.325+0000 7fdb4effd640 1 -- 172.21.15.53:0/3078203078 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5000b070 con 0x7fdb60153aa0 2023-06-10T19:08:04.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.325+0000 7fdb4effd640 1 -- 172.21.15.53:0/3078203078 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb500052d0 con 0x7fdb60153aa0 2023-06-10T19:08:04.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.325+0000 7fdb64faa640 1 -- 172.21.15.53:0/3078203078 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb600c5ab0 con 0x7fdb60153aa0 2023-06-10T19:08:04.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.325+0000 7fdb4effd640 1 -- 172.21.15.53:0/3078203078 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb50003860 con 0x7fdb60153aa0 2023-06-10T19:08:04.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.325+0000 7fdb64faa640 1 -- 172.21.15.53:0/3078203078 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb600c6070 con 0x7fdb60153aa0 2023-06-10T19:08:04.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.325+0000 7fdb64faa640 1 -- 172.21.15.53:0/3078203078 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb6004d790 con 0x7fdb60153aa0 2023-06-10T19:08:04.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.325+0000 7fdb4effd640 1 -- 172.21.15.53:0/3078203078 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdb500039c0 con 0x7fdb60153aa0 2023-06-10T19:08:04.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.325+0000 7fdb4effd640 1 --2- 172.21.15.53:0/3078203078 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdb40066280 0x7fdb40068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:04.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.325+0000 7fdb4effd640 1 -- 172.21.15.53:0/3078203078 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdb50083910 con 0x7fdb60153aa0 2023-06-10T19:08:04.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.325+0000 7fdb5e59c640 1 --2- 172.21.15.53:0/3078203078 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdb40066280 0x7fdb40068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:04.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.329+0000 7fdb5e59c640 1 --2- 172.21.15.53:0/3078203078 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdb40066280 0x7fdb40068730 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fdb540ab000 tx=0x7fdb540b1040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:04.333 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.329+0000 7fdb4effd640 1 -- 172.21.15.53:0/3078203078 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdb50050fb0 con 0x7fdb60153aa0 2023-06-10T19:08:04.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:04.521+0000 7fdb64faa640 1 -- 172.21.15.53:0/3078203078 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fdb600b3c60 con 0x7fdb60153aa0 2023-06-10T19:08:05.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:05.533+0000 7fdb4effd640 1 -- 172.21.15.53:0/3078203078 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v103) v1 ==== 118+0+0 (secure 0 0 0) 0x7fdb500545d0 con 0x7fdb60153aa0 2023-06-10T19:08:05.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:05.537+0000 7fdb64faa640 1 -- 172.21.15.53:0/3078203078 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdb40066280 msgr2=0x7fdb40068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:05.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:05.537+0000 7fdb64faa640 1 --2- 172.21.15.53:0/3078203078 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdb40066280 0x7fdb40068730 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fdb540ab000 tx=0x7fdb540b1040 comp rx=0 tx=0).stop 2023-06-10T19:08:05.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:05.537+0000 7fdb64faa640 1 -- 172.21.15.53:0/3078203078 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb60153aa0 msgr2=0x7fdb60153f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:05.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:05.537+0000 7fdb64faa640 1 --2- 172.21.15.53:0/3078203078 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb60153aa0 0x7fdb60153f10 secure :-1 s=READY pgs=2587 cs=0 l=1 rev1=1 crypto rx=0x7fdb5000d4a0 tx=0x7fdb5000d590 comp rx=0 tx=0).stop 2023-06-10T19:08:05.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:05.537+0000 7fdb64faa640 1 -- 172.21.15.53:0/3078203078 shutdown_connections 2023-06-10T19:08:05.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:05.537+0000 7fdb64faa640 1 --2- 172.21.15.53:0/3078203078 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdb40066280 0x7fdb40068730 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:05.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:05.537+0000 7fdb64faa640 1 --2- 172.21.15.53:0/3078203078 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdb601587d0 0x7fdb60158c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:05.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:05.537+0000 7fdb64faa640 1 --2- 172.21.15.53:0/3078203078 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb60153aa0 0x7fdb60153f10 unknown :-1 s=CLOSED pgs=2587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:05.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:05.537+0000 7fdb64faa640 1 --2- 172.21.15.53:0/3078203078 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb48005b90 0x7fdb600c75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:05.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:05.537+0000 7fdb64faa640 1 -- 172.21.15.53:0/3078203078 >> 172.21.15.53:0/3078203078 conn(0x7fdb6006a0e0 msgr2=0x7fdb600cd1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:05.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:05.537+0000 7fdb64faa640 1 -- 172.21.15.53:0/3078203078 shutdown_connections 2023-06-10T19:08:05.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:05.537+0000 7fdb64faa640 1 -- 172.21.15.53:0/3078203078 wait complete. 2023-06-10T19:08:05.564 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-06-10T19:08:05.565 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-06-10T19:08:05.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:05.697+0000 7f02c8324640 1 Processor -- start 2023-06-10T19:08:05.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:05.697+0000 7f02c8324640 1 -- start start 2023-06-10T19:08:05.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:05.697+0000 7f02c8324640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02c015ba40 0x7f02c0069450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:05.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:05.697+0000 7f02c8324640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f02c00adff0 0x7f02c0069990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:05.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:05.697+0000 7f02c8324640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f02c00adaa0 0x7f02c00cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:05.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:05.697+0000 7f02c8324640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02c0160310 con 0x7f02c00adaa0 2023-06-10T19:08:05.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:05.697+0000 7f02c8324640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02c015f700 con 0x7f02c00adff0 2023-06-10T19:08:05.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:05.697+0000 7f02c8324640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02c015f9e0 con 0x7f02c015ba40 2023-06-10T19:08:05.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:05.697+0000 7f02c68c1640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f02c00adaa0 0x7f02c00cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:05.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:05.697+0000 7f02c68c1640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f02c00adaa0 0x7f02c00cdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36884/0 (socket says 172.21.15.53:36884) 2023-06-10T19:08:05.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:05.697+0000 7f02c68c1640 1 -- 172.21.15.53:0/254353617 learned_addr learned my addr 172.21.15.53:0/254353617 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:08:05.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:05.697+0000 7f02c60c0640 1 --2- 172.21.15.53:0/254353617 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02c015ba40 0x7f02c0069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:05.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:05.697+0000 7f02c58bf640 1 --2- 172.21.15.53:0/254353617 >> v2:172.21.15.117:3300/0 conn(0x7f02c00adff0 0x7f02c0069990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:05.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:05.697+0000 7f02c68c1640 1 -- 172.21.15.53:0/254353617 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02c015ba40 msgr2=0x7f02c0069450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:05.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:05.697+0000 7f02c68c1640 1 --2- 172.21.15.53:0/254353617 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02c015ba40 0x7f02c0069450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:05.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:05.697+0000 7f02c68c1640 1 -- 172.21.15.53:0/254353617 >> v2:172.21.15.117:3300/0 conn(0x7f02c00adff0 msgr2=0x7f02c0069990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:05.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:05.697+0000 7f02c68c1640 1 --2- 172.21.15.53:0/254353617 >> v2:172.21.15.117:3300/0 conn(0x7f02c00adff0 0x7f02c0069990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:05.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:05.697+0000 7f02c68c1640 1 -- 172.21.15.53:0/254353617 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02c015fcc0 con 0x7f02c00adaa0 2023-06-10T19:08:05.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:05.701+0000 7f02c68c1640 1 --2- 172.21.15.53:0/254353617 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02c00adaa0 0x7f02c00cdcf0 secure :-1 s=READY pgs=2588 cs=0 l=1 rev1=1 crypto rx=0x7f02c00cc960 tx=0x7f02b801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2028ec023c99e2dd server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:05.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:05.701+0000 7f02c50be640 1 -- 172.21.15.53:0/254353617 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b80a5840 con 0x7f02c00adaa0 2023-06-10T19:08:05.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:05.701+0000 7f02c50be640 1 -- 172.21.15.53:0/254353617 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02b80a59a0 con 0x7f02c00adaa0 2023-06-10T19:08:05.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:05.701+0000 7f02c50be640 1 -- 172.21.15.53:0/254353617 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b80a5d30 con 0x7f02c00adaa0 2023-06-10T19:08:05.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:05.701+0000 7f02c8324640 1 -- 172.21.15.53:0/254353617 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02c00adaa0 msgr2=0x7f02c00cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:05.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:05.701+0000 7f02c8324640 1 --2- 172.21.15.53:0/254353617 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02c00adaa0 0x7f02c00cdcf0 secure :-1 s=READY pgs=2588 cs=0 l=1 rev1=1 crypto rx=0x7f02c00cc960 tx=0x7f02b801c9a0 comp rx=0 tx=0).stop 2023-06-10T19:08:05.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:05.701+0000 7f02c8324640 1 -- 172.21.15.53:0/254353617 shutdown_connections 2023-06-10T19:08:05.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:05.701+0000 7f02c8324640 1 --2- 172.21.15.53:0/254353617 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02c00adaa0 0x7f02c00cdcf0 unknown :-1 s=CLOSED pgs=2588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:05.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:05.701+0000 7f02c8324640 1 --2- 172.21.15.53:0/254353617 >> v2:172.21.15.117:3300/0 conn(0x7f02c00adff0 0x7f02c0069990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:05.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:05.701+0000 7f02c8324640 1 --2- 172.21.15.53:0/254353617 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02c015ba40 0x7f02c0069450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:05.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:05.701+0000 7f02c8324640 1 -- 172.21.15.53:0/254353617 >> 172.21.15.53:0/254353617 conn(0x7f02c006a560 msgr2=0x7f02c006a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:05.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:05.701+0000 7f02c8324640 1 -- 172.21.15.53:0/254353617 shutdown_connections 2023-06-10T19:08:05.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:05.701+0000 7f02c8324640 1 -- 172.21.15.53:0/254353617 wait complete. 2023-06-10T19:08:05.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:05.701+0000 7f02c8324640 1 Processor -- start 2023-06-10T19:08:05.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:05.701+0000 7f02c8324640 1 -- start start 2023-06-10T19:08:05.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:05.701+0000 7f02c8324640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02c00adaa0 0x7f02c0151040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:05.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:05.701+0000 7f02c8324640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02c00adff0 0x7f02c014f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:05.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:05.701+0000 7f02c8324640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02c015ba40 0x7f02c01f7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:05.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:05.701+0000 7f02c8324640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02c0149790 con 0x7f02c015ba40 2023-06-10T19:08:05.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:05.701+0000 7f02c8324640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02c014a630 con 0x7f02c00adaa0 2023-06-10T19:08:05.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:05.701+0000 7f02c8324640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02c01499a0 con 0x7f02c00adff0 2023-06-10T19:08:05.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:05.701+0000 7f02c68c1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02c015ba40 0x7f02c01f7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:05.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:05.701+0000 7f02c68c1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02c015ba40 0x7f02c01f7ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36900/0 (socket says 172.21.15.53:36900) 2023-06-10T19:08:05.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:05.701+0000 7f02c68c1640 1 -- 172.21.15.53:0/4132422501 learned_addr learned my addr 172.21.15.53:0/4132422501 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:08:05.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:05.701+0000 7f02c60c0640 1 --2- 172.21.15.53:0/4132422501 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02c00adaa0 0x7f02c0151040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:05.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:05.701+0000 7f02c58bf640 1 --2- 172.21.15.53:0/4132422501 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02c00adff0 0x7f02c014f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:05.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:05.701+0000 7f02c68c1640 1 -- 172.21.15.53:0/4132422501 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02c00adff0 msgr2=0x7f02c014f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:05.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:05.701+0000 7f02c68c1640 1 --2- 172.21.15.53:0/4132422501 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02c00adff0 0x7f02c014f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:05.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:05.701+0000 7f02c68c1640 1 -- 172.21.15.53:0/4132422501 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02c00adaa0 msgr2=0x7f02c0151040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:05.711 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:05.701+0000 7f02c68c1640 1 --2- 172.21.15.53:0/4132422501 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02c00adaa0 0x7f02c0151040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:05.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:05.701+0000 7f02c68c1640 1 -- 172.21.15.53:0/4132422501 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02b8009b30 con 0x7f02c015ba40 2023-06-10T19:08:05.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:05.701+0000 7f02c60c0640 1 --2- 172.21.15.53:0/4132422501 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02c00adaa0 0x7f02c0151040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:08:05.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:05.701+0000 7f02c58bf640 1 --2- 172.21.15.53:0/4132422501 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02c00adff0 0x7f02c014f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:08:05.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:05.701+0000 7f02c68c1640 1 --2- 172.21.15.53:0/4132422501 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02c015ba40 0x7f02c01f7ee0 secure :-1 s=READY pgs=2589 cs=0 l=1 rev1=1 crypto rx=0x7f02b801b050 tx=0x7f02b8019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:05.712 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:05.705+0000 7f02b6ffd640 1 -- 172.21.15.53:0/4132422501 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b80b8670 con 0x7f02c015ba40 2023-06-10T19:08:05.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:05.705+0000 7f02b6ffd640 1 -- 172.21.15.53:0/4132422501 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02b80b87d0 con 0x7f02c015ba40 2023-06-10T19:08:05.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:05.705+0000 7f02c8324640 1 -- 172.21.15.53:0/4132422501 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02c0149c80 con 0x7f02c015ba40 2023-06-10T19:08:05.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:05.705+0000 7f02b6ffd640 1 -- 172.21.15.53:0/4132422501 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b80b8b80 con 0x7f02c015ba40 2023-06-10T19:08:05.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:05.705+0000 7f02c8324640 1 -- 172.21.15.53:0/4132422501 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02c00b33e0 con 0x7f02c015ba40 2023-06-10T19:08:05.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:05.705+0000 7f02c8324640 1 -- 172.21.15.53:0/4132422501 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02c0066810 con 0x7f02c015ba40 2023-06-10T19:08:05.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:05.705+0000 7f02b6ffd640 1 -- 172.21.15.53:0/4132422501 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f02b80b8ce0 con 0x7f02c015ba40 2023-06-10T19:08:05.713 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:05.705+0000 7f02b6ffd640 1 --2- 172.21.15.53:0/4132422501 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f02a4066280 0x7f02a4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:05.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:05.705+0000 7f02b6ffd640 1 -- 172.21.15.53:0/4132422501 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f02b811f3a0 con 0x7f02c015ba40 2023-06-10T19:08:05.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:05.705+0000 7f02c60c0640 1 --2- 172.21.15.53:0/4132422501 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f02a4066280 0x7f02a4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:05.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:05.705+0000 7f02c60c0640 1 --2- 172.21.15.53:0/4132422501 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f02a4066280 0x7f02a4068730 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f02c014f400 tx=0x7f02bc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:05.714 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:05.709+0000 7f02b6ffd640 1 -- 172.21.15.53:0/4132422501 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f02c0066810 con 0x7f02c015ba40 2023-06-10T19:08:05.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:05.897+0000 7f02c8324640 1 -- 172.21.15.53:0/4132422501 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f02c0066810 con 0x7f02c015ba40 2023-06-10T19:08:06.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.545+0000 7f02b6ffd640 1 -- 172.21.15.53:0/4132422501 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v104) v1 ==== 122+0+0 (secure 0 0 0) 0x7f02c0066810 con 0x7f02c015ba40 2023-06-10T19:08:06.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.549+0000 7f02c8324640 1 -- 172.21.15.53:0/4132422501 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f02a4066280 msgr2=0x7f02a4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:06.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.549+0000 7f02c8324640 1 --2- 172.21.15.53:0/4132422501 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f02a4066280 0x7f02a4068730 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f02c014f400 tx=0x7f02bc008040 comp rx=0 tx=0).stop 2023-06-10T19:08:06.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.549+0000 7f02c8324640 1 -- 172.21.15.53:0/4132422501 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02c015ba40 msgr2=0x7f02c01f7ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:06.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.549+0000 7f02c8324640 1 --2- 172.21.15.53:0/4132422501 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02c015ba40 0x7f02c01f7ee0 secure :-1 s=READY pgs=2589 cs=0 l=1 rev1=1 crypto rx=0x7f02b801b050 tx=0x7f02b8019740 comp rx=0 tx=0).stop 2023-06-10T19:08:06.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.549+0000 7f02c8324640 1 -- 172.21.15.53:0/4132422501 shutdown_connections 2023-06-10T19:08:06.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.549+0000 7f02c8324640 1 --2- 172.21.15.53:0/4132422501 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f02a4066280 0x7f02a4068730 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:06.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.549+0000 7f02c8324640 1 --2- 172.21.15.53:0/4132422501 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02c015ba40 0x7f02c01f7ee0 unknown :-1 s=CLOSED pgs=2589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:06.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.549+0000 7f02c8324640 1 --2- 172.21.15.53:0/4132422501 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f02c00adff0 0x7f02c014f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:06.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.549+0000 7f02c8324640 1 --2- 172.21.15.53:0/4132422501 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02c00adaa0 0x7f02c0151040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:06.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.549+0000 7f02c8324640 1 -- 172.21.15.53:0/4132422501 >> 172.21.15.53:0/4132422501 conn(0x7f02c006a560 msgr2=0x7f02c00c5680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:06.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.549+0000 7f02c8324640 1 -- 172.21.15.53:0/4132422501 shutdown_connections 2023-06-10T19:08:06.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.549+0000 7f02c8324640 1 -- 172.21.15.53:0/4132422501 wait complete. 2023-06-10T19:08:06.572 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-06-10T19:08:06.573 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:08:06.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.689+0000 7f39e6c05640 1 Processor -- start 2023-06-10T19:08:06.694 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.689+0000 7f39e6c05640 1 -- start start 2023-06-10T19:08:06.696 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.693+0000 7f39e6c05640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f39e00c9840 0x7f39e00c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:06.696 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.693+0000 7f39e6c05640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39e0159b50 con 0x7f39e0071060 2023-06-10T19:08:06.696 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.693+0000 7f39e6c05640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39e00ca150 con 0x7f39e006b090 2023-06-10T19:08:06.697 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.693+0000 7f39e6c05640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39e00702a0 con 0x7f39e00c9840 2023-06-10T19:08:06.697 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.693+0000 7f39dffff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f39e0071060 0x7f39e00af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:45814/0 (socket says 172.21.15.53:45814) 2023-06-10T19:08:06.697 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.693+0000 7f39dffff640 1 -- 172.21.15.53:0/2366575125 learned_addr learned my addr 172.21.15.53:0/2366575125 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:08:06.697 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.693+0000 7f39e49a1640 1 --2- 172.21.15.53:0/2366575125 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f39e00c9840 0x7f39e00c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:06.697 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.693+0000 7f39df7fe640 1 -- 172.21.15.53:0/2366575125 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2360981605 0 0) 0x7f39e0159b50 con 0x7f39e0071060 2023-06-10T19:08:06.697 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.693+0000 7f39df7fe640 1 -- 172.21.15.53:0/2366575125 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39c8003530 con 0x7f39e0071060 2023-06-10T19:08:06.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.693+0000 7f39df7fe640 1 -- 172.21.15.53:0/2366575125 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 692730848 0 0) 0x7f39c8003530 con 0x7f39e0071060 2023-06-10T19:08:06.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.693+0000 7f39df7fe640 1 -- 172.21.15.53:0/2366575125 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f39e00c9840 msgr2=0x7f39e00c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:06.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.693+0000 7f39df7fe640 1 --2- 172.21.15.53:0/2366575125 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f39e00c9840 0x7f39e00c9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:06.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.693+0000 7f39df7fe640 1 -- 172.21.15.53:0/2366575125 >> v1:172.21.15.117:6789/0 conn(0x7f39e006b090 legacy=0x7f39e006b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:06.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.693+0000 7f39df7fe640 1 -- 172.21.15.53:0/2366575125 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39e0070580 con 0x7f39e0071060 2023-06-10T19:08:06.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.693+0000 7f39df7fe640 1 -- 172.21.15.53:0/2366575125 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f39d4001680 con 0x7f39e0071060 2023-06-10T19:08:06.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.693+0000 7f39df7fe640 1 -- 172.21.15.53:0/2366575125 >> v1:172.21.15.53:6789/0 conn(0x7f39e0071060 legacy=0x7f39e00af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:06.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.693+0000 7f39df7fe640 1 --2- 172.21.15.53:0/2366575125 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f39c8003a20 0x7f39c8003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:06.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.693+0000 7f39df7fe640 1 --2- 172.21.15.53:0/2366575125 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39c80047d0 0x7f39c8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:06.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.693+0000 7f39df7fe640 1 --2- 172.21.15.53:0/2366575125 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f39e00c9840 0x7f39c8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:06.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.693+0000 7f39df7fe640 1 -- 172.21.15.53:0/2366575125 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e00702a0 con 0x7f39c8003a20 2023-06-10T19:08:06.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.693+0000 7f39df7fe640 1 -- 172.21.15.53:0/2366575125 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c800ba70 con 0x7f39c80047d0 2023-06-10T19:08:06.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.693+0000 7f39df7fe640 1 -- 172.21.15.53:0/2366575125 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39c800bc30 con 0x7f39e00c9840 2023-06-10T19:08:06.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.693+0000 7f39e49a1640 1 --2- 172.21.15.53:0/2366575125 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f39c8003a20 0x7f39c8003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:06.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.693+0000 7f39e51a2640 1 --2- 172.21.15.53:0/2366575125 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f39e00c9840 0x7f39c8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:06.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.693+0000 7f39e49a1640 1 -- 172.21.15.53:0/2366575125 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f39e00c9840 msgr2=0x7f39c8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:06.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.693+0000 7f39e49a1640 1 --2- 172.21.15.53:0/2366575125 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f39e00c9840 0x7f39c8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:06.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.693+0000 7f39e49a1640 1 -- 172.21.15.53:0/2366575125 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39c80047d0 msgr2=0x7f39c8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:06.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.693+0000 7f39dffff640 1 --2- 172.21.15.53:0/2366575125 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39c80047d0 0x7f39c8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:06.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.693+0000 7f39e49a1640 1 --2- 172.21.15.53:0/2366575125 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39c80047d0 0x7f39c8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:06.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.693+0000 7f39e49a1640 1 -- 172.21.15.53:0/2366575125 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39c8003530 con 0x7f39c8003a20 2023-06-10T19:08:06.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.693+0000 7f39dffff640 1 --2- 172.21.15.53:0/2366575125 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39c80047d0 0x7f39c8004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:08:06.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.697+0000 7f39e49a1640 1 --2- 172.21.15.53:0/2366575125 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f39c8003a20 0x7f39c8003e30 secure :-1 s=READY pgs=2591 cs=0 l=1 rev1=1 crypto rx=0x7f39d0009ae0 tx=0x7f39d001ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6981b35f5e496c93 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:06.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.697+0000 7f39df7fe640 1 -- 172.21.15.53:0/2366575125 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d00a5610 con 0x7f39c8003a20 2023-06-10T19:08:06.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.697+0000 7f39df7fe640 1 -- 172.21.15.53:0/2366575125 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39d00a5770 con 0x7f39c8003a20 2023-06-10T19:08:06.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.697+0000 7f39df7fe640 1 -- 172.21.15.53:0/2366575125 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d00a5b20 con 0x7f39c8003a20 2023-06-10T19:08:06.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.697+0000 7f39e6c05640 1 -- 172.21.15.53:0/2366575125 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f39c8003a20 msgr2=0x7f39c8003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:06.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.697+0000 7f39e6c05640 1 --2- 172.21.15.53:0/2366575125 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f39c8003a20 0x7f39c8003e30 secure :-1 s=READY pgs=2591 cs=0 l=1 rev1=1 crypto rx=0x7f39d0009ae0 tx=0x7f39d001ca40 comp rx=0 tx=0).stop 2023-06-10T19:08:06.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.697+0000 7f39e51a2640 1 -- 172.21.15.53:0/2366575125 reap_dead start 2023-06-10T19:08:06.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.697+0000 7f39e6c05640 1 -- 172.21.15.53:0/2366575125 shutdown_connections 2023-06-10T19:08:06.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.697+0000 7f39e6c05640 1 -- 172.21.15.53:0/2366575125 >> 172.21.15.53:0/2366575125 conn(0x7f39e006a0d0 msgr2=0x7f39e00ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:06.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.697+0000 7f39e6c05640 1 -- 172.21.15.53:0/2366575125 shutdown_connections 2023-06-10T19:08:06.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.697+0000 7f39e6c05640 1 -- 172.21.15.53:0/2366575125 wait complete. 2023-06-10T19:08:06.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.697+0000 7f39e6c05640 1 Processor -- start 2023-06-10T19:08:06.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.697+0000 7f39e6c05640 1 -- start start 2023-06-10T19:08:06.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.697+0000 7f39e6c05640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39c8003a20 0x7f39e0154190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:06.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.697+0000 7f39e6c05640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f39e00c4d70 0x7f39e00c51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:06.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.697+0000 7f39e6c05640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f39e00b2a30 0x7f39e00b2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:06.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.697+0000 7f39e6c05640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e00b33e0 con 0x7f39e00b2a30 2023-06-10T19:08:06.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.697+0000 7f39e6c05640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e00c5810 con 0x7f39c8003a20 2023-06-10T19:08:06.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.697+0000 7f39e6c05640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39e00c5af0 con 0x7f39e00c4d70 2023-06-10T19:08:06.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.697+0000 7f39e51a2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f39e00b2a30 0x7f39e00b2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:06.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.701+0000 7f39e51a2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f39e00b2a30 0x7f39e00b2ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36922/0 (socket says 172.21.15.53:36922) 2023-06-10T19:08:06.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.701+0000 7f39e51a2640 1 -- 172.21.15.53:0/3344834784 learned_addr learned my addr 172.21.15.53:0/3344834784 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:08:06.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.701+0000 7f39dffff640 1 --2- 172.21.15.53:0/3344834784 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f39e00c4d70 0x7f39e00c51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:06.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.701+0000 7f39e49a1640 1 --2- 172.21.15.53:0/3344834784 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39c8003a20 0x7f39e0154190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:06.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.701+0000 7f39e51a2640 1 -- 172.21.15.53:0/3344834784 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f39e00c4d70 msgr2=0x7f39e00c51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:06.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.701+0000 7f39e51a2640 1 --2- 172.21.15.53:0/3344834784 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f39e00c4d70 0x7f39e00c51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:06.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.701+0000 7f39e51a2640 1 -- 172.21.15.53:0/3344834784 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39c8003a20 msgr2=0x7f39e0154190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:06.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.701+0000 7f39e51a2640 1 --2- 172.21.15.53:0/3344834784 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39c8003a20 0x7f39e0154190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:06.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.701+0000 7f39e51a2640 1 -- 172.21.15.53:0/3344834784 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39e00c5dd0 con 0x7f39e00b2a30 2023-06-10T19:08:06.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.701+0000 7f39e49a1640 1 --2- 172.21.15.53:0/3344834784 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39c8003a20 0x7f39e0154190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:08:06.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.701+0000 7f39e51a2640 1 --2- 172.21.15.53:0/3344834784 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f39e00b2a30 0x7f39e00b2ea0 secure :-1 s=READY pgs=2592 cs=0 l=1 rev1=1 crypto rx=0x7f39e006ef50 tx=0x7f39d800e5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:06.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.701+0000 7f39dd7fa640 1 -- 172.21.15.53:0/3344834784 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d800ec30 con 0x7f39e00b2a30 2023-06-10T19:08:06.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.701+0000 7f39dd7fa640 1 -- 172.21.15.53:0/3344834784 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39d800ed90 con 0x7f39e00b2a30 2023-06-10T19:08:06.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.701+0000 7f39e6c05640 1 -- 172.21.15.53:0/3344834784 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39e00c60b0 con 0x7f39e00b2a30 2023-06-10T19:08:06.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.701+0000 7f39dd7fa640 1 -- 172.21.15.53:0/3344834784 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d8003bc0 con 0x7f39e00b2a30 2023-06-10T19:08:06.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.701+0000 7f39e6c05640 1 -- 172.21.15.53:0/3344834784 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39e01547a0 con 0x7f39e00b2a30 2023-06-10T19:08:06.709 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.701+0000 7f39e6c05640 1 -- 172.21.15.53:0/3344834784 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39e00c6420 con 0x7f39e00b2a30 2023-06-10T19:08:06.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.701+0000 7f39dd7fa640 1 -- 172.21.15.53:0/3344834784 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f39d8003d20 con 0x7f39e00b2a30 2023-06-10T19:08:06.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.701+0000 7f39dd7fa640 1 --2- 172.21.15.53:0/3344834784 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f39cc066280 0x7f39cc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:06.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.701+0000 7f39dd7fa640 1 -- 172.21.15.53:0/3344834784 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f39d8082ea0 con 0x7f39e00b2a30 2023-06-10T19:08:06.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.701+0000 7f39e49a1640 1 --2- 172.21.15.53:0/3344834784 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f39cc066280 0x7f39cc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:06.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.701+0000 7f39e49a1640 1 --2- 172.21.15.53:0/3344834784 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f39cc066280 0x7f39cc068730 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f39d00af000 tx=0x7f39d00046d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:06.710 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.705+0000 7f39dd7fa640 1 -- 172.21.15.53:0/3344834784 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f39d8050320 con 0x7f39e00b2a30 2023-06-10T19:08:06.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.893+0000 7f39e6c05640 1 -- 172.21.15.53:0/3344834784 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f39e004d790 con 0x7f39e00b2a30 2023-06-10T19:08:06.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.893+0000 7f39dd7fa640 1 -- 172.21.15.53:0/3344834784 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) v1 ==== 95+0+4688 (secure 0 0 0) 0x7f39d8019020 con 0x7f39e00b2a30 2023-06-10T19:08:06.897 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:08:06.897 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":104,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7835,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2641321206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2641321206},{"type":"v1","addr":"172.21.15.117:6835","nonce":2641321206}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":99},{"gid":8956,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1439696554","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1439696554},{"type":"v1","addr":"172.21.15.117:6837","nonce":1439696554}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":99},{"gid":11112,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/3327528087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3327528087},{"type":"v1","addr":"172.21.15.53:6833","nonce":3327528087}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":99}],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:08:03.514484+0000","modified":"2023-06-10T19:08:06.533495+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":11118},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11118":{"gid":11118,"name":"c","rank":0,"incarnation":100,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/3732323283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":3732323283},{"type":"v1","addr":"172.21.15.53:6835","nonce":3732323283}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":12}]} 2023-06-10T19:08:06.897 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 104 2023-06-10T19:08:06.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.897+0000 7f39e6c05640 1 -- 172.21.15.53:0/3344834784 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f39cc066280 msgr2=0x7f39cc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:06.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.897+0000 7f39e6c05640 1 --2- 172.21.15.53:0/3344834784 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f39cc066280 0x7f39cc068730 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f39d00af000 tx=0x7f39d00046d0 comp rx=0 tx=0).stop 2023-06-10T19:08:06.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.897+0000 7f39e6c05640 1 -- 172.21.15.53:0/3344834784 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f39e00b2a30 msgr2=0x7f39e00b2ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:06.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.897+0000 7f39e6c05640 1 --2- 172.21.15.53:0/3344834784 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f39e00b2a30 0x7f39e00b2ea0 secure :-1 s=READY pgs=2592 cs=0 l=1 rev1=1 crypto rx=0x7f39e006ef50 tx=0x7f39d800e5f0 comp rx=0 tx=0).stop 2023-06-10T19:08:06.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.897+0000 7f39e6c05640 1 -- 172.21.15.53:0/3344834784 shutdown_connections 2023-06-10T19:08:06.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.897+0000 7f39e6c05640 1 --2- 172.21.15.53:0/3344834784 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f39cc066280 0x7f39cc068730 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:06.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.897+0000 7f39e6c05640 1 --2- 172.21.15.53:0/3344834784 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f39e00b2a30 0x7f39e00b2ea0 unknown :-1 s=CLOSED pgs=2592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:06.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.897+0000 7f39e6c05640 1 --2- 172.21.15.53:0/3344834784 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f39e00c4d70 0x7f39e00c51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:06.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.897+0000 7f39e6c05640 1 --2- 172.21.15.53:0/3344834784 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39c8003a20 0x7f39e0154190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:06.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.897+0000 7f39e6c05640 1 -- 172.21.15.53:0/3344834784 >> 172.21.15.53:0/3344834784 conn(0x7f39e006a0d0 msgr2=0x7f39e0158a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:06.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.897+0000 7f39e6c05640 1 -- 172.21.15.53:0/3344834784 shutdown_connections 2023-06-10T19:08:06.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:06.897+0000 7f39e6c05640 1 -- 172.21.15.53:0/3344834784 wait complete. 2023-06-10T19:08:06.917 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:08:07.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.041+0000 7f6b31e48640 1 Processor -- start 2023-06-10T19:08:07.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.041+0000 7f6b31e48640 1 -- start start 2023-06-10T19:08:07.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.045+0000 7f6b31e48640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6b2c0c9840 0x7f6b2c0c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:07.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.045+0000 7f6b31e48640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b2c06b090 0x7f6b2c06b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:07.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.045+0000 7f6b31e48640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b2c159b50 con 0x7f6b2c071060 2023-06-10T19:08:07.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.045+0000 7f6b31e48640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b2c0ca150 con 0x7f6b2c0c9840 2023-06-10T19:08:07.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.045+0000 7f6b31e48640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b2c0702a0 con 0x7f6b2c06b090 2023-06-10T19:08:07.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.045+0000 7f6b2b7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6b2c0c9840 0x7f6b2c0c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:07.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.045+0000 7f6b2b7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6b2c0c9840 0x7f6b2c0c9c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36928/0 (socket says 172.21.15.53:36928) 2023-06-10T19:08:07.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.045+0000 7f6b2b7fe640 1 -- 172.21.15.53:0/3952449890 learned_addr learned my addr 172.21.15.53:0/3952449890 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:08:07.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.045+0000 7f6b2bfff640 1 --2- 172.21.15.53:0/3952449890 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b2c06b090 0x7f6b2c06b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:07.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.045+0000 7f6b2b7fe640 1 -- 172.21.15.53:0/3952449890 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b2c06b090 msgr2=0x7f6b2c06b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:07.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.045+0000 7f6b2b7fe640 1 --2- 172.21.15.53:0/3952449890 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b2c06b090 0x7f6b2c06b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:07.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.045+0000 7f6b2b7fe640 1 -- 172.21.15.53:0/3952449890 >> v1:172.21.15.117:6789/0 conn(0x7f6b2c071060 legacy=0x7f6b2c0af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:07.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.045+0000 7f6b2b7fe640 1 -- 172.21.15.53:0/3952449890 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b2c070580 con 0x7f6b2c0c9840 2023-06-10T19:08:07.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.045+0000 7f6b2bfff640 1 --2- 172.21.15.53:0/3952449890 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b2c06b090 0x7f6b2c06b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:08:07.050 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.049+0000 7f6b2b7fe640 1 --2- 172.21.15.53:0/3952449890 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b2c0c9840 0x7f6b2c0c9c10 secure :-1 s=READY pgs=2593 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c009e50 tx=0x7f6b1c01c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce60da43b7b30631 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:07.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.049+0000 7f6b2a7fc640 1 -- 172.21.15.53:0/3952449890 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b1c0a58a0 con 0x7f6b2c0c9840 2023-06-10T19:08:07.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.049+0000 7f6b2a7fc640 1 -- 172.21.15.53:0/3952449890 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b1c0a5a00 con 0x7f6b2c0c9840 2023-06-10T19:08:07.051 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.049+0000 7f6b2a7fc640 1 -- 172.21.15.53:0/3952449890 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b1c0a5d90 con 0x7f6b2c0c9840 2023-06-10T19:08:07.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.049+0000 7f6b31e48640 1 -- 172.21.15.53:0/3952449890 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b2c0c9840 msgr2=0x7f6b2c0c9c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:07.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.049+0000 7f6b31e48640 1 --2- 172.21.15.53:0/3952449890 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b2c0c9840 0x7f6b2c0c9c10 secure :-1 s=READY pgs=2593 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c009e50 tx=0x7f6b1c01c9e0 comp rx=0 tx=0).stop 2023-06-10T19:08:07.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.049+0000 7f6b31e48640 1 -- 172.21.15.53:0/3952449890 shutdown_connections 2023-06-10T19:08:07.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.049+0000 7f6b31e48640 1 --2- 172.21.15.53:0/3952449890 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b2c06b090 0x7f6b2c06b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:07.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.049+0000 7f6b31e48640 1 --2- 172.21.15.53:0/3952449890 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b2c0c9840 0x7f6b2c0c9c10 unknown :-1 s=CLOSED pgs=2593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:07.052 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.049+0000 7f6b31e48640 1 -- 172.21.15.53:0/3952449890 >> 172.21.15.53:0/3952449890 conn(0x7f6b2c06a0d0 msgr2=0x7f6b2c0ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:07.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.049+0000 7f6b31e48640 1 -- 172.21.15.53:0/3952449890 shutdown_connections 2023-06-10T19:08:07.053 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.049+0000 7f6b31e48640 1 -- 172.21.15.53:0/3952449890 wait complete. 2023-06-10T19:08:07.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.049+0000 7f6b31e48640 1 Processor -- start 2023-06-10T19:08:07.054 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.049+0000 7f6b31e48640 1 -- start start 2023-06-10T19:08:07.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.049+0000 7f6b31e48640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b2c06b090 0x7f6b2c14df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:07.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.049+0000 7f6b31e48640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b2c071060 0x7f6b2c15d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:07.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.049+0000 7f6b31e48640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b2c0c9840 0x7f6b2c153600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:07.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.049+0000 7f6b31e48640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b2c152450 con 0x7f6b2c0c9840 2023-06-10T19:08:07.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.049+0000 7f6b31e48640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b2c152730 con 0x7f6b2c071060 2023-06-10T19:08:07.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.049+0000 7f6b31e48640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b2c152a10 con 0x7f6b2c06b090 2023-06-10T19:08:07.055 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.049+0000 7f6b2bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b2c0c9840 0x7f6b2c153600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:07.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.049+0000 7f6b2bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b2c0c9840 0x7f6b2c153600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36944/0 (socket says 172.21.15.53:36944) 2023-06-10T19:08:07.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.049+0000 7f6b2bfff640 1 -- 172.21.15.53:0/96405938 learned_addr learned my addr 172.21.15.53:0/96405938 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:08:07.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.049+0000 7f6b2b7fe640 1 --2- 172.21.15.53:0/96405938 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b2c06b090 0x7f6b2c14df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:07.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.049+0000 7f6b2affd640 1 --2- 172.21.15.53:0/96405938 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b2c071060 0x7f6b2c15d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:07.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.049+0000 7f6b2bfff640 1 -- 172.21.15.53:0/96405938 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b2c06b090 msgr2=0x7f6b2c14df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:07.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.049+0000 7f6b2bfff640 1 --2- 172.21.15.53:0/96405938 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b2c06b090 0x7f6b2c14df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:07.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.049+0000 7f6b2bfff640 1 -- 172.21.15.53:0/96405938 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b2c071060 msgr2=0x7f6b2c15d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:07.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.049+0000 7f6b2bfff640 1 --2- 172.21.15.53:0/96405938 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b2c071060 0x7f6b2c15d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:07.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.049+0000 7f6b2bfff640 1 -- 172.21.15.53:0/96405938 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b1c009b30 con 0x7f6b2c0c9840 2023-06-10T19:08:07.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.049+0000 7f6b2bfff640 1 --2- 172.21.15.53:0/96405938 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b2c0c9840 0x7f6b2c153600 secure :-1 s=READY pgs=2594 cs=0 l=1 rev1=1 crypto rx=0x7f6b1400d800 tx=0x7f6b1400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:07.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.053+0000 7f6b23fff640 1 -- 172.21.15.53:0/96405938 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b140096a0 con 0x7f6b2c0c9840 2023-06-10T19:08:07.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.053+0000 7f6b23fff640 1 -- 172.21.15.53:0/96405938 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b14009800 con 0x7f6b2c0c9840 2023-06-10T19:08:07.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.053+0000 7f6b31e48640 1 -- 172.21.15.53:0/96405938 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b2c152cf0 con 0x7f6b2c0c9840 2023-06-10T19:08:07.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.053+0000 7f6b23fff640 1 -- 172.21.15.53:0/96405938 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b14009bb0 con 0x7f6b2c0c9840 2023-06-10T19:08:07.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.053+0000 7f6b31e48640 1 -- 172.21.15.53:0/96405938 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b2c152000 con 0x7f6b2c0c9840 2023-06-10T19:08:07.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.053+0000 7f6b31e48640 1 -- 172.21.15.53:0/96405938 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b2c152220 con 0x7f6b2c0c9840 2023-06-10T19:08:07.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.053+0000 7f6b23fff640 1 -- 172.21.15.53:0/96405938 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6b14009d10 con 0x7f6b2c0c9840 2023-06-10T19:08:07.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.053+0000 7f6b23fff640 1 --2- 172.21.15.53:0/96405938 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6b100662b0 0x7f6b10068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:07.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.053+0000 7f6b23fff640 1 -- 172.21.15.53:0/96405938 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6b140841b0 con 0x7f6b2c0c9840 2023-06-10T19:08:07.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.053+0000 7f6b2b7fe640 1 --2- 172.21.15.53:0/96405938 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6b100662b0 0x7f6b10068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:07.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.053+0000 7f6b2b7fe640 1 --2- 172.21.15.53:0/96405938 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6b100662b0 0x7f6b10068760 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c0ae000 tx=0x7f6b1c0a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:07.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.057+0000 7f6b23fff640 1 -- 172.21.15.53:0/96405938 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6b140516c0 con 0x7f6b2c0c9840 2023-06-10T19:08:07.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.213+0000 7f6b31e48640 1 -- 172.21.15.53:0/96405938 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6b2c04d790 con 0x7f6b2c0c9840 2023-06-10T19:08:07.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.213+0000 7f6b23fff640 1 -- 172.21.15.53:0/96405938 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v180) v1 ==== 74+0+18285 (secure 0 0 0) 0x7f6b14054ce0 con 0x7f6b2c0c9840 2023-06-10T19:08:07.218 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:08:07.218 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":180,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:08:04.518453+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2023-06-10T19:08:01.296938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"179","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_data","create_time":"2023-06-10T19:08:02.507633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"180","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:08:07.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.217+0000 7f6b31e48640 1 -- 172.21.15.53:0/96405938 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6b100662b0 msgr2=0x7f6b10068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:07.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.217+0000 7f6b31e48640 1 --2- 172.21.15.53:0/96405938 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6b100662b0 0x7f6b10068760 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c0ae000 tx=0x7f6b1c0a7070 comp rx=0 tx=0).stop 2023-06-10T19:08:07.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.217+0000 7f6b31e48640 1 -- 172.21.15.53:0/96405938 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b2c0c9840 msgr2=0x7f6b2c153600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:07.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.217+0000 7f6b31e48640 1 --2- 172.21.15.53:0/96405938 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b2c0c9840 0x7f6b2c153600 secure :-1 s=READY pgs=2594 cs=0 l=1 rev1=1 crypto rx=0x7f6b1400d800 tx=0x7f6b1400dcc0 comp rx=0 tx=0).stop 2023-06-10T19:08:07.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.217+0000 7f6b31e48640 1 -- 172.21.15.53:0/96405938 shutdown_connections 2023-06-10T19:08:07.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.217+0000 7f6b31e48640 1 --2- 172.21.15.53:0/96405938 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6b100662b0 0x7f6b10068760 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:07.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.217+0000 7f6b31e48640 1 --2- 172.21.15.53:0/96405938 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b2c0c9840 0x7f6b2c153600 unknown :-1 s=CLOSED pgs=2594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:07.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.217+0000 7f6b31e48640 1 --2- 172.21.15.53:0/96405938 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b2c071060 0x7f6b2c15d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:07.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.217+0000 7f6b31e48640 1 --2- 172.21.15.53:0/96405938 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b2c06b090 0x7f6b2c14df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:07.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.217+0000 7f6b31e48640 1 -- 172.21.15.53:0/96405938 >> 172.21.15.53:0/96405938 conn(0x7f6b2c06a0d0 msgr2=0x7f6b2c150ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:07.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.217+0000 7f6b31e48640 1 -- 172.21.15.53:0/96405938 shutdown_connections 2023-06-10T19:08:07.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.217+0000 7f6b31e48640 1 -- 172.21.15.53:0/96405938 wait complete. 2023-06-10T19:08:07.236 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-06-10T19:08:07.237 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-10T19:08:07.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.357+0000 7f52c1251640 1 Processor -- start 2023-06-10T19:08:07.359 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.357+0000 7f52c1251640 1 -- start start 2023-06-10T19:08:07.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.357+0000 7f52c1251640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f52bc0c8d00 0x7f52bc06b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:07.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.357+0000 7f52c1251640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f52bc06bc00 0x7f52bc162180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:07.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.357+0000 7f52c1251640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52bc158a90 con 0x7f52bc06b2f0 2023-06-10T19:08:07.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.357+0000 7f52c1251640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52bc06f780 con 0x7f52bc06bc00 2023-06-10T19:08:07.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.357+0000 7f52c1251640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52bc0705d0 con 0x7f52bc0c8d00 2023-06-10T19:08:07.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.357+0000 7f52ba59c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f52bc0c8d00 0x7f52bc06b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:07.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.357+0000 7f52bb59e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f52bc06bc00 0x7f52bc162180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:07.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.357+0000 7f52ba59c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f52bc0c8d00 0x7f52bc06b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.53:44682/0 (socket says 172.21.15.53:44682) 2023-06-10T19:08:07.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.357+0000 7f52ba59c640 1 -- 172.21.15.53:0/2778641737 learned_addr learned my addr 172.21.15.53:0/2778641737 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:08:07.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.357+0000 7f52ba59c640 1 -- 172.21.15.53:0/2778641737 >> v2:172.21.15.117:3300/0 conn(0x7f52bc06bc00 msgr2=0x7f52bc162180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:07.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.357+0000 7f52ba59c640 1 --2- 172.21.15.53:0/2778641737 >> v2:172.21.15.117:3300/0 conn(0x7f52bc06bc00 0x7f52bc162180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:07.362 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.357+0000 7f52ba59c640 1 -- 172.21.15.53:0/2778641737 >> v1:172.21.15.117:6789/0 conn(0x7f52bc06b2f0 legacy=0x7f52bc06f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:07.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.357+0000 7f52ba59c640 1 -- 172.21.15.53:0/2778641737 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52bc0cce10 con 0x7f52bc0c8d00 2023-06-10T19:08:07.363 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.357+0000 7f52bb59e640 1 --2- 172.21.15.53:0/2778641737 >> v2:172.21.15.117:3300/0 conn(0x7f52bc06bc00 0x7f52bc162180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-10T19:08:07.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.361+0000 7f52ba59c640 1 --2- 172.21.15.53:0/2778641737 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f52bc0c8d00 0x7f52bc06b6c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f52b00098a0 tx=0x7f52b001ed10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1b9fa8f0afd646c server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:07.364 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.361+0000 7f52b9d9b640 1 -- 172.21.15.53:0/2778641737 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b00a8a10 con 0x7f52bc0c8d00 2023-06-10T19:08:07.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.361+0000 7f52b9d9b640 1 -- 172.21.15.53:0/2778641737 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52b00a8b70 con 0x7f52bc0c8d00 2023-06-10T19:08:07.365 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.361+0000 7f52b9d9b640 1 -- 172.21.15.53:0/2778641737 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b00b0440 con 0x7f52bc0c8d00 2023-06-10T19:08:07.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.361+0000 7f52c1251640 1 -- 172.21.15.53:0/2778641737 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f52bc0c8d00 msgr2=0x7f52bc06b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:07.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.361+0000 7f52c1251640 1 --2- 172.21.15.53:0/2778641737 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f52bc0c8d00 0x7f52bc06b6c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f52b00098a0 tx=0x7f52b001ed10 comp rx=0 tx=0).stop 2023-06-10T19:08:07.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.361+0000 7f52c1251640 1 -- 172.21.15.53:0/2778641737 shutdown_connections 2023-06-10T19:08:07.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.361+0000 7f52c1251640 1 --2- 172.21.15.53:0/2778641737 >> v2:172.21.15.117:3300/0 conn(0x7f52bc06bc00 0x7f52bc162180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:07.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.361+0000 7f52c1251640 1 --2- 172.21.15.53:0/2778641737 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f52bc0c8d00 0x7f52bc06b6c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:07.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.361+0000 7f52c1251640 1 -- 172.21.15.53:0/2778641737 >> 172.21.15.53:0/2778641737 conn(0x7f52bc06a0d0 msgr2=0x7f52bc0ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:07.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.361+0000 7f52c1251640 1 -- 172.21.15.53:0/2778641737 shutdown_connections 2023-06-10T19:08:07.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.361+0000 7f52c1251640 1 -- 172.21.15.53:0/2778641737 wait complete. 2023-06-10T19:08:07.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.365+0000 7f52c1251640 1 Processor -- start 2023-06-10T19:08:07.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.365+0000 7f52c1251640 1 -- start start 2023-06-10T19:08:07.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.365+0000 7f52c1251640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52bc06b2f0 0x7f52bc1f2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:07.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.365+0000 7f52c1251640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f52bc06bc00 0x7f52bc1ee4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:07.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.365+0000 7f52c1251640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f52bc0c8d00 0x7f52bc0b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:07.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.365+0000 7f52c1251640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52bc0a74e0 con 0x7f52bc06b2f0 2023-06-10T19:08:07.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.365+0000 7f52c1251640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52bc1f3020 con 0x7f52bc06bc00 2023-06-10T19:08:07.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.365+0000 7f52c1251640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52bc1efa90 con 0x7f52bc0c8d00 2023-06-10T19:08:07.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.365+0000 7f52bad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52bc06b2f0 0x7f52bc1f2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:07.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.365+0000 7f52bad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52bc06b2f0 0x7f52bc1f2ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36950/0 (socket says 172.21.15.53:36950) 2023-06-10T19:08:07.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.365+0000 7f52bad9d640 1 -- 172.21.15.53:0/2946298751 learned_addr learned my addr 172.21.15.53:0/2946298751 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:08:07.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.365+0000 7f52bb59e640 1 --2- 172.21.15.53:0/2946298751 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f52bc0c8d00 0x7f52bc0b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:07.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.365+0000 7f52ba59c640 1 --2- 172.21.15.53:0/2946298751 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f52bc06bc00 0x7f52bc1ee4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:07.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.365+0000 7f52bad9d640 1 -- 172.21.15.53:0/2946298751 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f52bc0c8d00 msgr2=0x7f52bc0b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:07.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.365+0000 7f52bad9d640 1 --2- 172.21.15.53:0/2946298751 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f52bc0c8d00 0x7f52bc0b2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:07.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.365+0000 7f52bad9d640 1 -- 172.21.15.53:0/2946298751 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f52bc06bc00 msgr2=0x7f52bc1ee4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:07.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.365+0000 7f52bad9d640 1 --2- 172.21.15.53:0/2946298751 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f52bc06bc00 0x7f52bc1ee4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:07.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.365+0000 7f52bad9d640 1 -- 172.21.15.53:0/2946298751 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52b4009a70 con 0x7f52bc06b2f0 2023-06-10T19:08:07.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.365+0000 7f52bb59e640 1 --2- 172.21.15.53:0/2946298751 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f52bc0c8d00 0x7f52bc0b2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:08:07.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.365+0000 7f52bad9d640 1 --2- 172.21.15.53:0/2946298751 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52bc06b2f0 0x7f52bc1f2ae0 secure :-1 s=READY pgs=2595 cs=0 l=1 rev1=1 crypto rx=0x7f52ac00c500 tx=0x7f52ac00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:07.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.365+0000 7f52a37fe640 1 -- 172.21.15.53:0/2946298751 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ac005220 con 0x7f52bc06b2f0 2023-06-10T19:08:07.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.365+0000 7f52a37fe640 1 -- 172.21.15.53:0/2946298751 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52ac005380 con 0x7f52bc06b2f0 2023-06-10T19:08:07.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.365+0000 7f52c1251640 1 -- 172.21.15.53:0/2946298751 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52b00094d0 con 0x7f52bc06b2f0 2023-06-10T19:08:07.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.365+0000 7f52a37fe640 1 -- 172.21.15.53:0/2946298751 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ac007270 con 0x7f52bc06b2f0 2023-06-10T19:08:07.371 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.365+0000 7f52c1251640 1 -- 172.21.15.53:0/2946298751 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52bc1ef1f0 con 0x7f52bc06b2f0 2023-06-10T19:08:07.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.365+0000 7f52c1251640 1 -- 172.21.15.53:0/2946298751 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52bc04d790 con 0x7f52bc06b2f0 2023-06-10T19:08:07.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.365+0000 7f52a37fe640 1 -- 172.21.15.53:0/2946298751 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f52ac0073d0 con 0x7f52bc06b2f0 2023-06-10T19:08:07.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.369+0000 7f52a37fe640 1 --2- 172.21.15.53:0/2946298751 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f52a8066280 0x7f52a8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:07.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.369+0000 7f52a37fe640 1 -- 172.21.15.53:0/2946298751 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f52ac084240 con 0x7f52bc06b2f0 2023-06-10T19:08:07.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.369+0000 7f52ba59c640 1 --2- 172.21.15.53:0/2946298751 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f52a8066280 0x7f52a8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:07.373 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.369+0000 7f52ba59c640 1 --2- 172.21.15.53:0/2946298751 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f52a8066280 0x7f52a8068730 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f52b00b2000 tx=0x7f52b00aa070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:07.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.369+0000 7f52a37fe640 1 -- 172.21.15.53:0/2946298751 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f52ac051750 con 0x7f52bc06b2f0 2023-06-10T19:08:07.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.521+0000 7f52c1251640 1 -- 172.21.15.53:0/2946298751 --> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f52bc06f9c0 con 0x7f52a8066280 2023-06-10T19:08:07.548 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.545+0000 7f52a37fe640 1 -- 172.21.15.53:0/2946298751 <== mgr.4105 v2:172.21.15.117:6832/3061986771 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+298298 (secure 0 0 0) 0x7f52b00bc450 con 0x7f52a8066280 2023-06-10T19:08:07.551 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:08:07.552 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-06-10T19:08:07.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.549+0000 7f52c1251640 1 -- 172.21.15.53:0/2946298751 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f52a8066280 msgr2=0x7f52a8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:07.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.549+0000 7f52c1251640 1 --2- 172.21.15.53:0/2946298751 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f52a8066280 0x7f52a8068730 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f52b00b2000 tx=0x7f52b00aa070 comp rx=0 tx=0).stop 2023-06-10T19:08:07.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.549+0000 7f52c1251640 1 -- 172.21.15.53:0/2946298751 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52bc06b2f0 msgr2=0x7f52bc1f2ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:07.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.549+0000 7f52c1251640 1 --2- 172.21.15.53:0/2946298751 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52bc06b2f0 0x7f52bc1f2ae0 secure :-1 s=READY pgs=2595 cs=0 l=1 rev1=1 crypto rx=0x7f52ac00c500 tx=0x7f52ac00c9c0 comp rx=0 tx=0).stop 2023-06-10T19:08:07.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.549+0000 7f52c1251640 1 -- 172.21.15.53:0/2946298751 shutdown_connections 2023-06-10T19:08:07.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.549+0000 7f52c1251640 1 --2- 172.21.15.53:0/2946298751 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f52a8066280 0x7f52a8068730 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:07.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.549+0000 7f52c1251640 1 --2- 172.21.15.53:0/2946298751 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f52bc0c8d00 0x7f52bc0b2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:07.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.549+0000 7f52c1251640 1 --2- 172.21.15.53:0/2946298751 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f52bc06bc00 0x7f52bc1ee4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:07.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.549+0000 7f52c1251640 1 --2- 172.21.15.53:0/2946298751 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52bc06b2f0 0x7f52bc1f2ae0 unknown :-1 s=CLOSED pgs=2595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:07.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.549+0000 7f52c1251640 1 -- 172.21.15.53:0/2946298751 >> 172.21.15.53:0/2946298751 conn(0x7f52bc06a0d0 msgr2=0x7f52bc0af900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:07.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.549+0000 7f52c1251640 1 -- 172.21.15.53:0/2946298751 shutdown_connections 2023-06-10T19:08:07.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.549+0000 7f52c1251640 1 -- 172.21.15.53:0/2946298751 wait complete. 2023-06-10T19:08:07.569 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":640,"stamp":"2023-06-10T19:08:05.903326+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":42,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":283244,"kb_used_data":18476,"kb_used_omap":0,"kb_used_meta":264704,"kb_avail":754691476,"statfs":{"total":773094113280,"available":772804071424,"internally_reserved":0,"allocated":18919424,"data_stored":9447215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":271056896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001276"},"pg_stats":[{"pgid":"26.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":1,"reported_epoch":177,"state":"creating+peering","last_fresh":"2023-06-10T19:08:02.133361+0000","last_change":"2023-06-10T19:08:02.133361+0000","last_active":"2023-06-10T19:08:02.118629+0000","last_peered":"2023-06-10T19:08:02.118629+0000","last_clean":"2023-06-10T19:08:02.118629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:02.133361+0000","last_undegraded":"2023-06-10T19:08:02.133361+0000","last_fullsized":"2023-06-10T19:08:02.133361+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":1,"reported_epoch":177,"state":"creating+peering","last_fresh":"2023-06-10T19:08:02.128283+0000","last_change":"2023-06-10T19:08:02.128283+0000","last_active":"2023-06-10T19:08:02.118629+0000","last_peered":"2023-06-10T19:08:02.118629+0000","last_clean":"2023-06-10T19:08:02.118629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:02.128283+0000","last_undegraded":"2023-06-10T19:08:02.128283+0000","last_fullsized":"2023-06-10T19:08:02.128283+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":1,"reported_epoch":177,"state":"creating+peering","last_fresh":"2023-06-10T19:08:02.134297+0000","last_change":"2023-06-10T19:08:02.134297+0000","last_active":"2023-06-10T19:08:02.118629+0000","last_peered":"2023-06-10T19:08:02.118629+0000","last_clean":"2023-06-10T19:08:02.118629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:02.134297+0000","last_undegraded":"2023-06-10T19:08:02.134297+0000","last_fullsized":"2023-06-10T19:08:02.134297+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":1,"reported_epoch":177,"state":"creating+peering","last_fresh":"2023-06-10T19:08:02.128077+0000","last_change":"2023-06-10T19:08:02.128077+0000","last_active":"2023-06-10T19:08:02.118629+0000","last_peered":"2023-06-10T19:08:02.118629+0000","last_clean":"2023-06-10T19:08:02.118629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:02.128077+0000","last_undegraded":"2023-06-10T19:08:02.128077+0000","last_fullsized":"2023-06-10T19:08:02.128077+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":1,"reported_epoch":177,"state":"creating+peering","last_fresh":"2023-06-10T19:08:02.128865+0000","last_change":"2023-06-10T19:08:02.128865+0000","last_active":"2023-06-10T19:08:02.118629+0000","last_peered":"2023-06-10T19:08:02.118629+0000","last_clean":"2023-06-10T19:08:02.118629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:02.128865+0000","last_undegraded":"2023-06-10T19:08:02.128865+0000","last_fullsized":"2023-06-10T19:08:02.128865+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":1,"reported_epoch":177,"state":"creating+peering","last_fresh":"2023-06-10T19:08:02.128288+0000","last_change":"2023-06-10T19:08:02.128288+0000","last_active":"2023-06-10T19:08:02.118629+0000","last_peered":"2023-06-10T19:08:02.118629+0000","last_clean":"2023-06-10T19:08:02.118629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:02.128288+0000","last_undegraded":"2023-06-10T19:08:02.128288+0000","last_fullsized":"2023-06-10T19:08:02.128288+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":1,"reported_epoch":177,"state":"creating+peering","last_fresh":"2023-06-10T19:08:02.133535+0000","last_change":"2023-06-10T19:08:02.133535+0000","last_active":"2023-06-10T19:08:02.118629+0000","last_peered":"2023-06-10T19:08:02.118629+0000","last_clean":"2023-06-10T19:08:02.118629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:02.133535+0000","last_undegraded":"2023-06-10T19:08:02.133535+0000","last_fullsized":"2023-06-10T19:08:02.133535+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":1,"reported_epoch":177,"state":"creating+peering","last_fresh":"2023-06-10T19:08:02.132583+0000","last_change":"2023-06-10T19:08:02.132583+0000","last_active":"2023-06-10T19:08:02.118629+0000","last_peered":"2023-06-10T19:08:02.118629+0000","last_clean":"2023-06-10T19:08:02.118629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:02.132583+0000","last_undegraded":"2023-06-10T19:08:02.132583+0000","last_fullsized":"2023-06-10T19:08:02.132583+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":1,"reported_epoch":177,"state":"creating+peering","last_fresh":"2023-06-10T19:08:02.134043+0000","last_change":"2023-06-10T19:08:02.134043+0000","last_active":"2023-06-10T19:08:02.118629+0000","last_peered":"2023-06-10T19:08:02.118629+0000","last_clean":"2023-06-10T19:08:02.118629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:02.134043+0000","last_undegraded":"2023-06-10T19:08:02.134043+0000","last_fullsized":"2023-06-10T19:08:02.134043+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":1,"reported_epoch":177,"state":"creating+peering","last_fresh":"2023-06-10T19:08:02.134057+0000","last_change":"2023-06-10T19:08:02.134057+0000","last_active":"2023-06-10T19:08:02.118629+0000","last_peered":"2023-06-10T19:08:02.118629+0000","last_clean":"2023-06-10T19:08:02.118629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:02.134057+0000","last_undegraded":"2023-06-10T19:08:02.134057+0000","last_fullsized":"2023-06-10T19:08:02.134057+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":1,"reported_epoch":177,"state":"creating+peering","last_fresh":"2023-06-10T19:08:02.136413+0000","last_change":"2023-06-10T19:08:02.136413+0000","last_active":"2023-06-10T19:08:02.118629+0000","last_peered":"2023-06-10T19:08:02.118629+0000","last_clean":"2023-06-10T19:08:02.118629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:02.136413+0000","last_undegraded":"2023-06-10T19:08:02.136413+0000","last_fullsized":"2023-06-10T19:08:02.136413+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":1,"reported_epoch":177,"state":"creating+peering","last_fresh":"2023-06-10T19:08:02.132572+0000","last_change":"2023-06-10T19:08:02.132572+0000","last_active":"2023-06-10T19:08:02.118629+0000","last_peered":"2023-06-10T19:08:02.118629+0000","last_clean":"2023-06-10T19:08:02.118629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:02.132572+0000","last_undegraded":"2023-06-10T19:08:02.132572+0000","last_fullsized":"2023-06-10T19:08:02.132572+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":1,"reported_epoch":177,"state":"creating+peering","last_fresh":"2023-06-10T19:08:02.127801+0000","last_change":"2023-06-10T19:08:02.127801+0000","last_active":"2023-06-10T19:08:02.118629+0000","last_peered":"2023-06-10T19:08:02.118629+0000","last_clean":"2023-06-10T19:08:02.118629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:02.127801+0000","last_undegraded":"2023-06-10T19:08:02.127801+0000","last_fullsized":"2023-06-10T19:08:02.127801+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":1,"reported_epoch":177,"state":"creating+peering","last_fresh":"2023-06-10T19:08:02.134927+0000","last_change":"2023-06-10T19:08:02.134927+0000","last_active":"2023-06-10T19:08:02.118629+0000","last_peered":"2023-06-10T19:08:02.118629+0000","last_clean":"2023-06-10T19:08:02.118629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:02.134927+0000","last_undegraded":"2023-06-10T19:08:02.134927+0000","last_fullsized":"2023-06-10T19:08:02.134927+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":1,"reported_epoch":177,"state":"creating+peering","last_fresh":"2023-06-10T19:08:02.132945+0000","last_change":"2023-06-10T19:08:02.132945+0000","last_active":"2023-06-10T19:08:02.118629+0000","last_peered":"2023-06-10T19:08:02.118629+0000","last_clean":"2023-06-10T19:08:02.118629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:02.132945+0000","last_undegraded":"2023-06-10T19:08:02.132945+0000","last_fullsized":"2023-06-10T19:08:02.132945+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":1,"reported_epoch":177,"state":"creating+peering","last_fresh":"2023-06-10T19:08:02.139745+0000","last_change":"2023-06-10T19:08:02.139745+0000","last_active":"2023-06-10T19:08:02.118629+0000","last_peered":"2023-06-10T19:08:02.118629+0000","last_clean":"2023-06-10T19:08:02.118629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:02.139745+0000","last_undegraded":"2023-06-10T19:08:02.139745+0000","last_fullsized":"2023-06-10T19:08:02.139745+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":1,"reported_epoch":177,"state":"creating+peering","last_fresh":"2023-06-10T19:08:02.133213+0000","last_change":"2023-06-10T19:08:02.133213+0000","last_active":"2023-06-10T19:08:02.118629+0000","last_peered":"2023-06-10T19:08:02.118629+0000","last_clean":"2023-06-10T19:08:02.118629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:02.133213+0000","last_undegraded":"2023-06-10T19:08:02.133213+0000","last_fullsized":"2023-06-10T19:08:02.133213+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":1,"reported_epoch":177,"state":"creating+peering","last_fresh":"2023-06-10T19:08:02.132038+0000","last_change":"2023-06-10T19:08:02.132038+0000","last_active":"2023-06-10T19:08:02.118629+0000","last_peered":"2023-06-10T19:08:02.118629+0000","last_clean":"2023-06-10T19:08:02.118629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:02.132038+0000","last_undegraded":"2023-06-10T19:08:02.132038+0000","last_fullsized":"2023-06-10T19:08:02.132038+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":1,"reported_epoch":177,"state":"creating+peering","last_fresh":"2023-06-10T19:08:02.133030+0000","last_change":"2023-06-10T19:08:02.133030+0000","last_active":"2023-06-10T19:08:02.118629+0000","last_peered":"2023-06-10T19:08:02.118629+0000","last_clean":"2023-06-10T19:08:02.118629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:02.133030+0000","last_undegraded":"2023-06-10T19:08:02.133030+0000","last_fullsized":"2023-06-10T19:08:02.133030+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":1,"reported_epoch":177,"state":"creating+peering","last_fresh":"2023-06-10T19:08:02.134398+0000","last_change":"2023-06-10T19:08:02.134398+0000","last_active":"2023-06-10T19:08:02.118629+0000","last_peered":"2023-06-10T19:08:02.118629+0000","last_clean":"2023-06-10T19:08:02.118629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:02.134398+0000","last_undegraded":"2023-06-10T19:08:02.134398+0000","last_fullsized":"2023-06-10T19:08:02.134398+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":1,"reported_epoch":177,"state":"creating+peering","last_fresh":"2023-06-10T19:08:02.135411+0000","last_change":"2023-06-10T19:08:02.135411+0000","last_active":"2023-06-10T19:08:02.118629+0000","last_peered":"2023-06-10T19:08:02.118629+0000","last_clean":"2023-06-10T19:08:02.118629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:02.135411+0000","last_undegraded":"2023-06-10T19:08:02.135411+0000","last_fullsized":"2023-06-10T19:08:02.135411+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":1,"reported_epoch":177,"state":"creating+peering","last_fresh":"2023-06-10T19:08:02.133740+0000","last_change":"2023-06-10T19:08:02.133740+0000","last_active":"2023-06-10T19:08:02.118629+0000","last_peered":"2023-06-10T19:08:02.118629+0000","last_clean":"2023-06-10T19:08:02.118629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:02.133740+0000","last_undegraded":"2023-06-10T19:08:02.133740+0000","last_fullsized":"2023-06-10T19:08:02.133740+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":1,"reported_epoch":177,"state":"creating+peering","last_fresh":"2023-06-10T19:08:02.132045+0000","last_change":"2023-06-10T19:08:02.132045+0000","last_active":"2023-06-10T19:08:02.118629+0000","last_peered":"2023-06-10T19:08:02.118629+0000","last_clean":"2023-06-10T19:08:02.118629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:02.132045+0000","last_undegraded":"2023-06-10T19:08:02.132045+0000","last_fullsized":"2023-06-10T19:08:02.132045+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":1,"reported_epoch":177,"state":"creating+peering","last_fresh":"2023-06-10T19:08:02.136426+0000","last_change":"2023-06-10T19:08:02.136426+0000","last_active":"2023-06-10T19:08:02.118629+0000","last_peered":"2023-06-10T19:08:02.118629+0000","last_clean":"2023-06-10T19:08:02.118629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:02.136426+0000","last_undegraded":"2023-06-10T19:08:02.136426+0000","last_fullsized":"2023-06-10T19:08:02.136426+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":1,"reported_epoch":177,"state":"creating+peering","last_fresh":"2023-06-10T19:08:02.134500+0000","last_change":"2023-06-10T19:08:02.134500+0000","last_active":"2023-06-10T19:08:02.118629+0000","last_peered":"2023-06-10T19:08:02.118629+0000","last_clean":"2023-06-10T19:08:02.118629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:02.134500+0000","last_undegraded":"2023-06-10T19:08:02.134500+0000","last_fullsized":"2023-06-10T19:08:02.134500+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":428,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-06-10T19:08:02.138433+0000","last_change":"2023-06-10T18:52:34.951528+0000","last_active":"2023-06-10T19:08:02.138433+0000","last_peered":"2023-06-10T19:08:02.138433+0000","last_clean":"2023-06-10T19:08:02.138433+0000","last_became_active":"2023-06-10T18:52:34.949099+0000","last_became_peered":"2023-06-10T18:52:34.949099+0000","last_unstale":"2023-06-10T19:08:02.138433+0000","last_undegraded":"2023-06-10T19:08:02.138433+0000","last_fullsized":"2023-06-10T19:08:02.138433+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_clean_scrub_stamp":"2023-06-10T18:52:33.633295+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:30:54.669663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":304,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-06-10T19:08:02.136357+0000","last_change":"2023-06-10T18:52:40.506384+0000","last_active":"2023-06-10T19:08:02.136357+0000","last_peered":"2023-06-10T19:08:02.136357+0000","last_clean":"2023-06-10T19:08:02.136357+0000","last_became_active":"2023-06-10T18:52:40.505701+0000","last_became_peered":"2023-06-10T18:52:40.505701+0000","last_unstale":"2023-06-10T19:08:02.136357+0000","last_undegraded":"2023-06-10T19:08:02.136357+0000","last_fullsized":"2023-06-10T19:08:02.136357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:37:54.300849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":1,"reported_epoch":177,"state":"creating+peering","last_fresh":"2023-06-10T19:08:02.134351+0000","last_change":"2023-06-10T19:08:02.134351+0000","last_active":"2023-06-10T19:08:02.118629+0000","last_peered":"2023-06-10T19:08:02.118629+0000","last_clean":"2023-06-10T19:08:02.118629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:02.134351+0000","last_undegraded":"2023-06-10T19:08:02.134351+0000","last_fullsized":"2023-06-10T19:08:02.134351+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":272,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-06-10T19:08:02.133332+0000","last_change":"2023-06-10T18:52:40.512015+0000","last_active":"2023-06-10T19:08:02.133332+0000","last_peered":"2023-06-10T19:08:02.133332+0000","last_clean":"2023-06-10T19:08:02.133332+0000","last_became_active":"2023-06-10T18:52:40.511382+0000","last_became_peered":"2023-06-10T18:52:40.511382+0000","last_unstale":"2023-06-10T19:08:02.133332+0000","last_undegraded":"2023-06-10T19:08:02.133332+0000","last_fullsized":"2023-06-10T19:08:02.133332+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:16:17.779044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":1,"reported_epoch":177,"state":"creating+peering","last_fresh":"2023-06-10T19:08:02.135579+0000","last_change":"2023-06-10T19:08:02.135579+0000","last_active":"2023-06-10T19:08:02.118629+0000","last_peered":"2023-06-10T19:08:02.118629+0000","last_clean":"2023-06-10T19:08:02.118629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:02.135579+0000","last_undegraded":"2023-06-10T19:08:02.135579+0000","last_fullsized":"2023-06-10T19:08:02.135579+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":294,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-06-10T19:08:02.126958+0000","last_change":"2023-06-10T18:52:40.671725+0000","last_active":"2023-06-10T19:08:02.126958+0000","last_peered":"2023-06-10T19:08:02.126958+0000","last_clean":"2023-06-10T19:08:02.126958+0000","last_became_active":"2023-06-10T18:52:40.671442+0000","last_became_peered":"2023-06-10T18:52:40.671442+0000","last_unstale":"2023-06-10T19:08:02.126958+0000","last_undegraded":"2023-06-10T19:08:02.126958+0000","last_fullsized":"2023-06-10T19:08:02.126958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:51:20.027781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":1,"reported_epoch":177,"state":"creating+peering","last_fresh":"2023-06-10T19:08:02.128097+0000","last_change":"2023-06-10T19:08:02.128097+0000","last_active":"2023-06-10T19:08:02.118629+0000","last_peered":"2023-06-10T19:08:02.118629+0000","last_clean":"2023-06-10T19:08:02.118629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:02.128097+0000","last_undegraded":"2023-06-10T19:08:02.128097+0000","last_fullsized":"2023-06-10T19:08:02.128097+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":304,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-06-10T19:08:02.135785+0000","last_change":"2023-06-10T18:52:40.510258+0000","last_active":"2023-06-10T19:08:02.135785+0000","last_peered":"2023-06-10T19:08:02.135785+0000","last_clean":"2023-06-10T19:08:02.135785+0000","last_became_active":"2023-06-10T18:52:40.509560+0000","last_became_peered":"2023-06-10T18:52:40.509560+0000","last_unstale":"2023-06-10T19:08:02.135785+0000","last_undegraded":"2023-06-10T19:08:02.135785+0000","last_fullsized":"2023-06-10T19:08:02.135785+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:38:06.212965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":1,"reported_epoch":177,"state":"creating+peering","last_fresh":"2023-06-10T19:08:02.135525+0000","last_change":"2023-06-10T19:08:02.135525+0000","last_active":"2023-06-10T19:08:02.118629+0000","last_peered":"2023-06-10T19:08:02.118629+0000","last_clean":"2023-06-10T19:08:02.118629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:02.135525+0000","last_undegraded":"2023-06-10T19:08:02.135525+0000","last_fullsized":"2023-06-10T19:08:02.135525+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":274,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-06-10T19:08:02.129444+0000","last_change":"2023-06-10T18:52:40.672266+0000","last_active":"2023-06-10T19:08:02.129444+0000","last_peered":"2023-06-10T19:08:02.129444+0000","last_clean":"2023-06-10T19:08:02.129444+0000","last_became_active":"2023-06-10T18:52:40.671966+0000","last_became_peered":"2023-06-10T18:52:40.671966+0000","last_unstale":"2023-06-10T19:08:02.129444+0000","last_undegraded":"2023-06-10T19:08:02.129444+0000","last_fullsized":"2023-06-10T19:08:02.129444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:35:45.974909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":1,"reported_epoch":177,"state":"creating+peering","last_fresh":"2023-06-10T19:08:02.135049+0000","last_change":"2023-06-10T19:08:02.135049+0000","last_active":"2023-06-10T19:08:02.118629+0000","last_peered":"2023-06-10T19:08:02.118629+0000","last_clean":"2023-06-10T19:08:02.118629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:02.135049+0000","last_undegraded":"2023-06-10T19:08:02.135049+0000","last_fullsized":"2023-06-10T19:08:02.135049+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":272,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-06-10T19:08:02.132961+0000","last_change":"2023-06-10T18:52:40.671084+0000","last_active":"2023-06-10T19:08:02.132961+0000","last_peered":"2023-06-10T19:08:02.132961+0000","last_clean":"2023-06-10T19:08:02.132961+0000","last_became_active":"2023-06-10T18:52:40.670697+0000","last_became_peered":"2023-06-10T18:52:40.670697+0000","last_unstale":"2023-06-10T19:08:02.132961+0000","last_undegraded":"2023-06-10T19:08:02.132961+0000","last_fullsized":"2023-06-10T19:08:02.132961+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:13:13.967154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":1,"reported_epoch":177,"state":"creating+peering","last_fresh":"2023-06-10T19:08:02.132603+0000","last_change":"2023-06-10T19:08:02.132603+0000","last_active":"2023-06-10T19:08:02.118629+0000","last_peered":"2023-06-10T19:08:02.118629+0000","last_clean":"2023-06-10T19:08:02.118629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:02.132603+0000","last_undegraded":"2023-06-10T19:08:02.132603+0000","last_fullsized":"2023-06-10T19:08:02.132603+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":274,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-06-10T19:08:02.129511+0000","last_change":"2023-06-10T18:52:40.514114+0000","last_active":"2023-06-10T19:08:02.129511+0000","last_peered":"2023-06-10T19:08:02.129511+0000","last_clean":"2023-06-10T19:08:02.129511+0000","last_became_active":"2023-06-10T18:52:40.513638+0000","last_became_peered":"2023-06-10T18:52:40.513638+0000","last_unstale":"2023-06-10T19:08:02.129511+0000","last_undegraded":"2023-06-10T19:08:02.129511+0000","last_fullsized":"2023-06-10T19:08:02.129511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:15:21.678932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":1,"reported_epoch":177,"state":"creating+peering","last_fresh":"2023-06-10T19:08:02.129278+0000","last_change":"2023-06-10T19:08:02.129278+0000","last_active":"2023-06-10T19:08:02.118629+0000","last_peered":"2023-06-10T19:08:02.118629+0000","last_clean":"2023-06-10T19:08:02.118629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:02.129278+0000","last_undegraded":"2023-06-10T19:08:02.129278+0000","last_fullsized":"2023-06-10T19:08:02.129278+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":274,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-06-10T19:08:02.136533+0000","last_change":"2023-06-10T18:52:40.515396+0000","last_active":"2023-06-10T19:08:02.136533+0000","last_peered":"2023-06-10T19:08:02.136533+0000","last_clean":"2023-06-10T19:08:02.136533+0000","last_became_active":"2023-06-10T18:52:40.514663+0000","last_became_peered":"2023-06-10T18:52:40.514663+0000","last_unstale":"2023-06-10T19:08:02.136533+0000","last_undegraded":"2023-06-10T19:08:02.136533+0000","last_fullsized":"2023-06-10T19:08:02.136533+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:01:56.219507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":25,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575037,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33788,"kb_used_data":2740,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338052,"statfs":{"total":96636764160,"available":96602165248,"internally_reserved":0,"allocated":2805760,"data_stored":1620975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:07:04 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.93600000000000005,"15min":0.92500000000000004},"min":{"1min":0.443,"5min":0.443,"15min":0.434},"max":{"1min":1.131,"5min":1.522,"15min":1.6220000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.88,"5min":0.90900000000000003,"15min":0.92400000000000004},"min":{"1min":0.63400000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.1379999999999999,"5min":1.3109999999999999,"15min":1.6870000000000001},"last":0.49399999999999999}]},{"osd":1,"last update":"Sat Jun 10 19:07:04 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.88800000000000001,"15min":0.91700000000000004},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.377},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.92300000000000004,"15min":0.94299999999999995},"min":{"1min":0.55000000000000004,"5min":0.51300000000000001,"15min":0.504},"max":{"1min":1.302,"5min":1.3320000000000001,"15min":1.5960000000000001},"last":0.65000000000000002}]},{"osd":2,"last update":"Sat Jun 10 19:07:04 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.86699999999999999,"15min":0.85299999999999998},"min":{"1min":0.41899999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.2370000000000001,"5min":1.2629999999999999,"15min":1.4059999999999999},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.88700000000000001,"15min":0.89600000000000002},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.50600000000000001},"max":{"1min":1.2290000000000001,"5min":1.3100000000000001,"15min":1.448},"last":0.751}]},{"osd":3,"last update":"Sat Jun 10 19:07:04 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.89600000000000002,"15min":0.92000000000000004},"min":{"1min":0.68600000000000005,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.1299999999999999,"5min":1.4490000000000001,"15min":1.502},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.95099999999999996,"15min":0.95599999999999996},"min":{"1min":0.496,"5min":0.432,"15min":0.432},"max":{"1min":1.2,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.97299999999999998}]},{"osd":4,"last update":"Sat Jun 10 19:07:04 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.82799999999999996,"15min":0.84399999999999997},"min":{"1min":0.60299999999999998,"5min":0.307,"15min":0.307},"max":{"1min":1.1639999999999999,"5min":1.2290000000000001,"15min":1.639},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.96699999999999997,"15min":0.96599999999999997},"min":{"1min":0.47299999999999998,"5min":0.41199999999999998,"15min":0.40000000000000002},"max":{"1min":1.1799999999999999,"5min":1.454,"15min":1.4590000000000001},"last":1.079}]},{"osd":5,"last update":"Sat Jun 10 19:07:04 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.99399999999999999,"15min":1.002},"min":{"1min":0.66600000000000004,"5min":0.45100000000000001,"15min":0.38400000000000001},"max":{"1min":1.268,"5min":1.385,"15min":1.806},"last":1.1220000000000001},{"interface":"front","average":{"1min":1.044,"5min":1.0269999999999999,"15min":1.0349999999999999},"min":{"1min":0.78200000000000003,"5min":0.48499999999999999,"15min":0.46500000000000002},"max":{"1min":1.254,"5min":1.665,"15min":1.665},"last":1.155}]},{"osd":6,"last update":"Sat Jun 10 19:07:04 2023","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.014,"15min":1.0089999999999999},"min":{"1min":0.71899999999999997,"5min":0.47699999999999998,"15min":0.35999999999999999},"max":{"1min":2.1120000000000001,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.117,"5min":1.0960000000000001,"15min":1.099},"min":{"1min":0.82499999999999996,"5min":0.504,"15min":0.441},"max":{"1min":1.397,"5min":1.728,"15min":1.728},"last":1.1970000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575038,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33208,"kb_used_data":2160,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338632,"statfs":{"total":96636764160,"available":96602759168,"internally_reserved":0,"allocated":2211840,"data_stored":1030607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:07:58 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.84699999999999998,"15min":0.86599999999999999},"min":{"1min":0.55700000000000005,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.2050000000000001,"5min":1.2450000000000001,"15min":1.498},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.879,"15min":0.88400000000000001},"min":{"1min":0.58199999999999996,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.1359999999999999,"5min":1.3009999999999999,"15min":1.496},"last":0.58199999999999996}]},{"osd":1,"last update":"Sat Jun 10 19:07:58 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.83999999999999997,"15min":0.86099999999999999},"min":{"1min":0.60799999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.1200000000000001,"5min":1.2709999999999999,"15min":1.5229999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.90300000000000002,"15min":0.90700000000000003},"min":{"1min":0.71199999999999997,"5min":0.504,"15min":0.45300000000000001},"max":{"1min":1.248,"5min":1.341,"15min":1.778},"last":0.83699999999999997}]},{"osd":2,"last update":"Sat Jun 10 19:07:58 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.89400000000000002,"15min":0.90200000000000002},"min":{"1min":0.53500000000000003,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.1579999999999999,"5min":1.2929999999999999,"15min":1.3759999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.874,"5min":0.86699999999999999,"15min":0.88200000000000001},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.175,"5min":1.175,"15min":1.246},"last":0.70999999999999996}]},{"osd":3,"last update":"Sat Jun 10 19:07:58 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.91400000000000003,"15min":0.92300000000000004},"min":{"1min":0.67300000000000004,"5min":0.55100000000000005,"15min":0.52700000000000002},"max":{"1min":1.1890000000000001,"5min":1.238,"15min":1.7190000000000001},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.95399999999999996,"15min":0.97899999999999998},"min":{"1min":0.72699999999999998,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.1639999999999999,"5min":1.304,"15min":1.4370000000000001},"last":0.72699999999999998}]},{"osd":4,"last update":"Sat Jun 10 19:07:58 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.93400000000000005,"15min":0.91600000000000004},"min":{"1min":0.58599999999999997,"5min":0.45900000000000002,"15min":0.373},"max":{"1min":1.2130000000000001,"5min":1.4019999999999999,"15min":1.798},"last":1.147},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.999,"15min":0.98399999999999999},"min":{"1min":0.65600000000000003,"5min":0.504,"15min":0.47899999999999998},"max":{"1min":1.276,"5min":1.409,"15min":1.5489999999999999},"last":0.752}]},{"osd":5,"last update":"Sat Jun 10 19:07:58 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.875,"15min":0.90000000000000002},"min":{"1min":0.45300000000000001,"5min":0.437,"15min":0.437},"max":{"1min":1.1020000000000001,"5min":1.2150000000000001,"15min":1.333},"last":0.45300000000000001},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.0189999999999999,"15min":1.024},"min":{"1min":0.64300000000000002,"5min":0.47199999999999998,"15min":0.42699999999999999},"max":{"1min":1.3069999999999999,"5min":1.3520000000000001,"15min":2.536},"last":0.64300000000000002}]},{"osd":7,"last update":"Sat Jun 10 19:07:58 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.04,"15min":1.028},"min":{"1min":0.69399999999999995,"5min":0.59199999999999997,"15min":0.57099999999999995},"max":{"1min":1.1870000000000001,"5min":1.879,"15min":1.917},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.98299999999999998,"15min":0.999},"min":{"1min":0.51700000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.226,"5min":1.345,"15min":1.5569999999999999},"last":0.51700000000000002}]}]},{"osd":5,"up_from":13,"seq":55834575038,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33220,"kb_used_data":2172,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338620,"statfs":{"total":96636764160,"available":96602746880,"internally_reserved":0,"allocated":2224128,"data_stored":1036777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.85399999999999998,"15min":0.874},"min":{"1min":0.53100000000000003,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.2649999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.89200000000000002,"15min":0.90000000000000002},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.49399999999999999},"max":{"1min":1.0860000000000001,"5min":1.2370000000000001,"15min":2.347},"last":0.996}]},{"osd":1,"last update":"Sat Jun 10 19:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.879,"15min":0.90900000000000003},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.153,"5min":1.6739999999999999,"15min":7.0800000000000001},"last":1.0620000000000001},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.90200000000000002,"15min":0.98199999999999998},"min":{"1min":0.56999999999999995,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1619999999999999,"5min":1.2689999999999999,"15min":15.845000000000001},"last":0.85999999999999999}]},{"osd":2,"last update":"Sat Jun 10 19:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.90700000000000003,"15min":0.89600000000000002},"min":{"1min":0.60999999999999999,"5min":0.54300000000000004,"15min":0.48299999999999998},"max":{"1min":1.2150000000000001,"5min":1.6459999999999999,"15min":5.0049999999999999},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.91500000000000004,"15min":0.94599999999999995},"min":{"1min":0.625,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.107,"5min":1.391,"15min":6.851},"last":0.69099999999999995}]},{"osd":3,"last update":"Sat Jun 10 19:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.93600000000000005,"15min":0.94699999999999995},"min":{"1min":0.59099999999999997,"5min":0.58699999999999997,"15min":0.51500000000000001},"max":{"1min":1.508,"5min":1.6910000000000001,"15min":2.544},"last":1.022},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.97699999999999998,"15min":0.98999999999999999},"min":{"1min":0.748,"5min":0.66000000000000003,"15min":0.59799999999999998},"max":{"1min":1.3009999999999999,"5min":1.4870000000000001,"15min":3.0830000000000002},"last":0.79700000000000004}]},{"osd":4,"last update":"Sat Jun 10 19:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.94199999999999995,"15min":0.94799999999999995},"min":{"1min":0.67000000000000004,"5min":0.59799999999999998,"15min":0.58099999999999996},"max":{"1min":1.454,"5min":1.6140000000000001,"15min":6.7290000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":1.0720000000000001,"5min":0.97099999999999997,"15min":0.98699999999999999},"min":{"1min":0.69699999999999995,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":0.66000000000000003}]},{"osd":6,"last update":"Sat Jun 10 19:07:54 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":0.98899999999999999,"15min":0.98699999999999999},"min":{"1min":0.70399999999999996,"5min":0.60499999999999998,"15min":0.54200000000000004},"max":{"1min":1.7190000000000001,"5min":1.8009999999999999,"15min":1.8009999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.0329999999999999,"15min":1.054},"min":{"1min":0.86799999999999999,"5min":0.66200000000000003,"15min":0.57899999999999996},"max":{"1min":1.5620000000000001,"5min":1.8380000000000001,"15min":6.923},"last":0.96299999999999997}]},{"osd":7,"last update":"Sat Jun 10 19:07:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.0640000000000001,"15min":1.0800000000000001},"min":{"1min":0.95899999999999996,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.7549999999999999,"5min":1.7749999999999999,"15min":2.6080000000000001},"last":0.93400000000000005},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1200000000000001,"15min":1.133},"min":{"1min":0.88700000000000001,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":5.4169999999999998},"last":1.0940000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575037,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33220,"kb_used_data":2172,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338620,"statfs":{"total":96636764160,"available":96602746880,"internally_reserved":0,"allocated":2224128,"data_stored":1036777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.83999999999999997,"15min":0.83299999999999996},"min":{"1min":0.53200000000000003,"5min":0.45400000000000001,"15min":0.45100000000000001},"max":{"1min":1.2190000000000001,"5min":1.29,"15min":1.29},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.90000000000000002,"15min":0.90600000000000003},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.375,"5min":1.3979999999999999,"15min":3.7280000000000002},"last":0.86599999999999999}]},{"osd":1,"last update":"Sat Jun 10 19:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.90000000000000002,"15min":0.92800000000000005},"min":{"1min":0.55000000000000004,"5min":0.47799999999999998,"15min":0.47599999999999998},"max":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":3.3969999999999998},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.83199999999999996,"15min":0.86199999999999999},"min":{"1min":0.55700000000000005,"5min":0.47899999999999998,"15min":0.47699999999999998},"max":{"1min":1.212,"5min":1.2430000000000001,"15min":2.496},"last":0.93700000000000006}]},{"osd":2,"last update":"Sat Jun 10 19:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.85899999999999999,"15min":0.879},"min":{"1min":0.52400000000000002,"5min":0.52200000000000002,"15min":0.49299999999999999},"max":{"1min":1.137,"5min":1.236,"15min":1.522},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.95899999999999996,"15min":0.98499999999999999},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.55000000000000004},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":3.5750000000000002},"last":0.98199999999999998}]},{"osd":3,"last update":"Sat Jun 10 19:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.86399999999999999,"15min":0.89300000000000002},"min":{"1min":0.57799999999999996,"5min":0.56200000000000006,"15min":0.53900000000000003},"max":{"1min":1.1200000000000001,"5min":1.46,"15min":2.3809999999999998},"last":1.05},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.94599999999999995,"15min":0.96299999999999997},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.54400000000000004},"max":{"1min":1.2889999999999999,"5min":1.4279999999999999,"15min":1.6479999999999999},"last":0.91500000000000004}]},{"osd":5,"last update":"Sat Jun 10 19:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.95299999999999996,"15min":0.95799999999999996},"min":{"1min":0.66800000000000004,"5min":0.58699999999999997,"15min":0.53100000000000003},"max":{"1min":1.224,"5min":1.3260000000000001,"15min":3.6539999999999999},"last":1.214},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.92000000000000004,"15min":0.93999999999999995},"min":{"1min":0.63400000000000001,"5min":0.495,"15min":0.495},"max":{"1min":1.216,"5min":1.26,"15min":2.6720000000000002},"last":1.133}]},{"osd":6,"last update":"Sat Jun 10 19:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.97599999999999998,"15min":0.96799999999999997},"min":{"1min":0.67000000000000004,"5min":0.443,"15min":0.443},"max":{"1min":1.2869999999999999,"5min":1.413,"15min":2.2639999999999998},"last":0.81499999999999995},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.081,"15min":1.0680000000000001},"min":{"1min":0.76300000000000001,"5min":0.58799999999999997,"15min":0.44400000000000001},"max":{"1min":1.625,"5min":1.625,"15min":3.4980000000000002},"last":1.089}]},{"osd":7,"last update":"Sat Jun 10 19:07:08 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.02,"15min":1.0009999999999999},"min":{"1min":0.82699999999999996,"5min":0.60899999999999999,"15min":0.41399999999999998},"max":{"1min":1.3240000000000001,"5min":1.3919999999999999,"15min":2.5910000000000002},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.071},"min":{"1min":0.81100000000000005,"5min":0.50800000000000001,"15min":0.46300000000000002},"max":{"1min":1.385,"5min":1.635,"15min":1.635},"last":1.02}]}]},{"osd":3,"up_from":13,"seq":55834575036,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37312,"kb_used_data":2168,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334528,"statfs":{"total":96636764160,"available":96598556672,"internally_reserved":0,"allocated":2220032,"data_stored":1035758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.63700000000000001,"15min":0.628},"min":{"1min":0.33800000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.879,"5min":1.0900000000000001,"15min":1.169},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.66600000000000004,"15min":0.66900000000000004},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.251},"max":{"1min":0.91200000000000003,"5min":0.97799999999999998,"15min":1.5269999999999999},"last":0.35499999999999998}]},{"osd":1,"last update":"Sat Jun 10 19:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.68300000000000005,"15min":0.68899999999999995},"min":{"1min":0.33300000000000002,"5min":0.29699999999999999,"15min":0.27500000000000002},"max":{"1min":1.234,"5min":1.234,"15min":2.0699999999999998},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71799999999999997,"15min":0.73399999999999999},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.411},"last":0.30499999999999999}]},{"osd":2,"last update":"Sat Jun 10 19:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.753,"15min":0.77300000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.30299999999999999},"max":{"1min":0.98699999999999999,"5min":1.2829999999999999,"15min":1.9530000000000001},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.80600000000000005,"15min":0.79700000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.29699999999999999},"max":{"1min":1.0800000000000001,"5min":1.2769999999999999,"15min":1.591},"last":0.32800000000000001}]},{"osd":4,"last update":"Sat Jun 10 19:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.94599999999999995,"15min":0.94899999999999995},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.41899999999999998},"max":{"1min":1.294,"5min":1.4239999999999999,"15min":1.8240000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.98499999999999999,"15min":0.99199999999999999},"min":{"1min":0.64600000000000002,"5min":0.57299999999999995,"15min":0.47999999999999998},"max":{"1min":1.417,"5min":1.4330000000000001,"15min":1.873},"last":0.54100000000000004}]},{"osd":5,"last update":"Sat Jun 10 19:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.99399999999999999,"15min":1.0069999999999999},"min":{"1min":0.56899999999999995,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.474,"5min":1.536,"15min":2.024},"last":0.61699999999999999},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.038,"15min":1.0369999999999999},"min":{"1min":0.71499999999999997,"5min":0.59999999999999998,"15min":0.46899999999999997},"max":{"1min":1.3580000000000001,"5min":1.534,"15min":1.9259999999999999},"last":0.87}]},{"osd":6,"last update":"Sat Jun 10 19:07:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":1.048,"15min":1.0629999999999999},"min":{"1min":0.69799999999999995,"5min":0.56999999999999995,"15min":0.55300000000000005},"max":{"1min":1.4359999999999999,"5min":1.617,"15min":1.8500000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.0309999999999999,"15min":1.05},"min":{"1min":0.629,"5min":0.61399999999999999,"15min":0.58799999999999997},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":2.2120000000000002},"last":0.78700000000000003}]},{"osd":7,"last update":"Sat Jun 10 19:07:54 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.0580000000000001,"15min":1.081},"min":{"1min":0.66400000000000003,"5min":0.58199999999999996,"15min":0.56999999999999995},"max":{"1min":1.4139999999999999,"5min":1.5720000000000001,"15min":2.1150000000000002},"last":0.71499999999999997},{"interface":"front","average":{"1min":1.077,"5min":1.089,"15min":1.101},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.4379999999999999,"5min":1.6779999999999999,"15min":1.9850000000000001},"last":0.82699999999999996}]}]},{"osd":2,"up_from":13,"seq":55834575037,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37316,"kb_used_data":2172,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334524,"statfs":{"total":96636764160,"available":96598552576,"internally_reserved":0,"allocated":2224128,"data_stored":1036777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:07:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.63200000000000001,"15min":0.622},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.27300000000000002},"max":{"1min":0.98599999999999999,"5min":2.883,"15min":2.883},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.77600000000000002,"15min":0.74099999999999999},"min":{"1min":0.38300000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.155,"5min":6.5670000000000002,"15min":6.5670000000000002},"last":0.68100000000000005}]},{"osd":1,"last update":"Sat Jun 10 19:07:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.65500000000000003,"15min":0.66400000000000003},"min":{"1min":0.32500000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1950000000000001},"last":0.622},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.81799999999999995,"15min":0.78400000000000003},"min":{"1min":0.32900000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.0669999999999999,"5min":8.4429999999999996,"15min":8.4429999999999996},"last":1.018}]},{"osd":3,"last update":"Sat Jun 10 19:07:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.78000000000000003,"15min":0.77500000000000002},"min":{"1min":0.36299999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.0329999999999999,"5min":1.1899999999999999,"15min":1.2350000000000001},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.77500000000000002,"15min":0.78100000000000003},"min":{"1min":0.40500000000000003,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":1.143,"5min":4.1849999999999996,"15min":4.1849999999999996},"last":1.0620000000000001}]},{"osd":4,"last update":"Sat Jun 10 19:07:02 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.96199999999999997,"15min":0.93999999999999995},"min":{"1min":0.59699999999999998,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.1699999999999999,"5min":3.996,"15min":3.996},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.91900000000000004,"5min":1.1140000000000001,"15min":1.052},"min":{"1min":0.60599999999999998,"5min":0.496,"15min":0.496},"max":{"1min":1.391,"5min":13.254,"15min":13.254},"last":1.2290000000000001}]},{"osd":5,"last update":"Sat Jun 10 19:07:02 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":1.113,"15min":1.05},"min":{"1min":0.60299999999999998,"5min":0.55900000000000005,"15min":0.54100000000000004},"max":{"1min":1.2270000000000001,"5min":6.9189999999999996,"15min":6.9189999999999996},"last":1.169},{"interface":"front","average":{"1min":1.008,"5min":1.246,"15min":1.095},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.609,"5min":15.526,"15min":15.526},"last":0.91400000000000003}]},{"osd":6,"last update":"Sat Jun 10 19:07:02 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":1.1399999999999999,"15min":1.0820000000000001},"min":{"1min":0.71999999999999997,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.5009999999999999,"5min":8.7089999999999996,"15min":8.7089999999999996},"last":0.98499999999999999},{"interface":"front","average":{"1min":0.97399999999999998,"5min":1.075,"15min":1.0589999999999999},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.389,"5min":6.1299999999999999,"15min":6.1299999999999999},"last":1.204}]},{"osd":7,"last update":"Sat Jun 10 19:07:02 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.3169999999999999,"15min":1.1699999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.57199999999999995},"max":{"1min":1.4770000000000001,"5min":12.138,"15min":12.138},"last":1.2769999999999999},{"interface":"front","average":{"1min":1.054,"5min":1.099,"15min":1.109},"min":{"1min":0.65000000000000002,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.5660000000000001,"5min":1.657,"15min":1.752},"last":1.137}]}]},{"osd":1,"up_from":13,"seq":55834575039,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37300,"kb_used_data":2156,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334540,"statfs":{"total":96636764160,"available":96598568960,"internally_reserved":0,"allocated":2207744,"data_stored":1029588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:07:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.64900000000000002,"15min":0.67700000000000005},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":1.0029999999999999,"5min":1.048,"15min":1.288},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.746,"5min":0.73099999999999998,"15min":0.75},"min":{"1min":0.32300000000000001,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.615,"5min":1.615,"15min":1.694},"last":0.53300000000000003}]},{"osd":2,"last update":"Sat Jun 10 19:07:05 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.61499999999999999,"15min":0.63500000000000001},"min":{"1min":0.30099999999999999,"5min":0.29699999999999999,"15min":0.249},"max":{"1min":0.84599999999999997,"5min":1.0900000000000001,"15min":1.21},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.69299999999999995,"15min":0.72199999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.415},"last":0.76800000000000002}]},{"osd":3,"last update":"Sat Jun 10 19:07:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.73899999999999999,"15min":0.77900000000000003},"min":{"1min":0.41499999999999998,"5min":0.34000000000000002,"15min":0.25600000000000001},"max":{"1min":1.008,"5min":1.143,"15min":1.6299999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68400000000000005,"15min":0.73299999999999998},"min":{"1min":0.36099999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.083,"5min":1.2709999999999999,"15min":2.1749999999999998},"last":0.72099999999999997}]},{"osd":4,"last update":"Sat Jun 10 19:07:05 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.85099999999999998,"15min":0.86799999999999999},"min":{"1min":0.58599999999999997,"5min":0.56399999999999995,"15min":0.53000000000000003},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.4930000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.96899999999999997,"15min":1.0289999999999999},"min":{"1min":0.625,"5min":0.47299999999999998,"15min":0.47099999999999997},"max":{"1min":1.575,"5min":1.575,"15min":5.8209999999999997},"last":0.999}]},{"osd":5,"last update":"Sat Jun 10 19:07:05 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.96199999999999997,"15min":0.995},"min":{"1min":0.54800000000000004,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.415,"5min":1.5720000000000001,"15min":1.8620000000000001},"last":1.0800000000000001},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.93100000000000005,"15min":0.97699999999999998},"min":{"1min":0.60399999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.448,"5min":1.448,"15min":3.089},"last":1.0529999999999999}]},{"osd":6,"last update":"Sat Jun 10 19:07:05 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.96499999999999997,"15min":1.0449999999999999},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.292,"5min":1.4950000000000001,"15min":7.2599999999999998},"last":1.0229999999999999},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.97399999999999998,"15min":1.036},"min":{"1min":0.65800000000000003,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.542,"5min":1.6000000000000001,"15min":9.0069999999999997},"last":0.96499999999999997}]},{"osd":7,"last update":"Sat Jun 10 19:07:05 2023","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.0189999999999999,"15min":1.075},"min":{"1min":0.67000000000000004,"5min":0.58799999999999997,"15min":0.495},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":2.105},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0389999999999999,"15min":1.0800000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.526,"5min":1.526,"15min":2.2570000000000001},"last":1.1619999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575038,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37880,"kb_used_data":2736,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94333960,"statfs":{"total":96636764160,"available":96597975040,"internally_reserved":0,"allocated":2801664,"data_stored":1619956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jun 10 19:08:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.61599999999999999,"15min":0.63800000000000001},"min":{"1min":0.255,"5min":0.255,"15min":0.248},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.77400000000000002,"15min":0.80100000000000005},"min":{"1min":0.33000000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.0740000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.94299999999999995}]},{"osd":2,"last update":"Sat Jun 10 19:08:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.69299999999999995,"15min":0.71299999999999997},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.98499999999999999,"5min":1.1970000000000001,"15min":1.2829999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.63500000000000001,"15min":0.65300000000000002},"min":{"1min":0.29999999999999999,"5min":0.28699999999999998,"15min":0.245},"max":{"1min":0.90600000000000003,"5min":1.1779999999999999,"15min":1.371},"last":0.79800000000000004}]},{"osd":3,"last update":"Sat Jun 10 19:08:02 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.67000000000000004,"15min":0.68300000000000005},"min":{"1min":0.309,"5min":0.309,"15min":0.28899999999999998},"max":{"1min":1.1439999999999999,"5min":1.397,"15min":1.397},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.78200000000000003,"15min":0.81399999999999995},"min":{"1min":0.36399999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.1699999999999999,"5min":1.6240000000000001,"15min":1.829},"last":1.1699999999999999}]},{"osd":4,"last update":"Sat Jun 10 19:08:02 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.89300000000000002,"15min":0.91900000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.276,"5min":1.758,"15min":3.0209999999999999},"last":1.1060000000000001},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.997,"15min":1.02},"min":{"1min":0.56200000000000006,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.224,"5min":1.873,"15min":1.9510000000000001},"last":1.0269999999999999}]},{"osd":5,"last update":"Sat Jun 10 19:08:02 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.88300000000000001,"15min":0.92100000000000004},"min":{"1min":0.51300000000000001,"5min":0.51200000000000001,"15min":0.45100000000000001},"max":{"1min":1.226,"5min":1.252,"15min":1.694},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.95899999999999996,"15min":1.0009999999999999},"min":{"1min":0.64800000000000002,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.321,"5min":1.9870000000000001,"15min":4.5620000000000003},"last":1.2769999999999999}]},{"osd":6,"last update":"Sat Jun 10 19:08:02 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.0289999999999999,"15min":1.0700000000000001},"min":{"1min":0.63700000000000001,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.3149999999999999,"5min":1.9330000000000001,"15min":3.5569999999999999},"last":1.3149999999999999},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.98699999999999999,"15min":0.999},"min":{"1min":0.56999999999999995,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.333,"5min":1.6599999999999999,"15min":1.883},"last":1.2450000000000001}]},{"osd":7,"last update":"Sat Jun 10 19:08:02 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.995,"15min":1.024},"min":{"1min":0.627,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.502,"5min":1.804,"15min":1.804},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0369999999999999,"15min":1.0569999999999999},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.58699999999999997},"max":{"1min":1.3720000000000001,"5min":2.1219999999999999,"15min":2.1219999999999999},"last":1.351}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-10T19:08:07.577 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-10T19:08:07.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.733+0000 7fc3c33b1640 1 Processor -- start 2023-06-10T19:08:07.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.733+0000 7fc3c33b1640 1 -- start start 2023-06-10T19:08:07.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.733+0000 7fc3c33b1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3bc06efc0 0x7fc3bc06bb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:07.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.733+0000 7fc3c33b1640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3bc0c9e50 con 0x7fc3bc157e10 2023-06-10T19:08:07.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.733+0000 7fc3c33b1640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3bc06f3e0 con 0x7fc3bc0afe30 2023-06-10T19:08:07.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.733+0000 7fc3c33b1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3bc0c82f0 con 0x7fc3bc06efc0 2023-06-10T19:08:07.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.733+0000 7fc3c114d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fc3bc157e10 0x7fc3bc0af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:45818/0 (socket says 172.21.15.53:45818) 2023-06-10T19:08:07.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.733+0000 7fc3c114d640 1 -- 172.21.15.53:0/297869084 learned_addr learned my addr 172.21.15.53:0/297869084 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:08:07.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.733+0000 7fc3c194e640 1 --2- 172.21.15.53:0/297869084 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3bc06efc0 0x7fc3bc06bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:07.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.733+0000 7fc3b3fff640 1 -- 172.21.15.53:0/297869084 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 60385053 0 0) 0x7fc3bc0c9e50 con 0x7fc3bc157e10 2023-06-10T19:08:07.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.733+0000 7fc3b3fff640 1 -- 172.21.15.53:0/297869084 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3a8003530 con 0x7fc3bc157e10 2023-06-10T19:08:07.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.733+0000 7fc3b3fff640 1 -- 172.21.15.53:0/297869084 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3697520247 0 0) 0x7fc3a8003530 con 0x7fc3bc157e10 2023-06-10T19:08:07.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.733+0000 7fc3b3fff640 1 -- 172.21.15.53:0/297869084 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3bc06efc0 msgr2=0x7fc3bc06bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:07.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.733+0000 7fc3b3fff640 1 --2- 172.21.15.53:0/297869084 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3bc06efc0 0x7fc3bc06bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:07.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.733+0000 7fc3b3fff640 1 -- 172.21.15.53:0/297869084 >> v1:172.21.15.117:6789/0 conn(0x7fc3bc0afe30 legacy=0x7fc3bc15bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:07.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.733+0000 7fc3b3fff640 1 -- 172.21.15.53:0/297869084 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3bc0ca080 con 0x7fc3bc157e10 2023-06-10T19:08:07.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.733+0000 7fc3b3fff640 1 -- 172.21.15.53:0/297869084 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fc3b80016a0 con 0x7fc3bc157e10 2023-06-10T19:08:07.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.733+0000 7fc3b3fff640 1 -- 172.21.15.53:0/297869084 >> v1:172.21.15.53:6789/0 conn(0x7fc3bc157e10 legacy=0x7fc3bc0af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:07.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.733+0000 7fc3b3fff640 1 --2- 172.21.15.53:0/297869084 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3a8003a20 0x7fc3a8003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:07.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.733+0000 7fc3b3fff640 1 --2- 172.21.15.53:0/297869084 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3bc06efc0 0x7fc3a80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:07.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.733+0000 7fc3b3fff640 1 --2- 172.21.15.53:0/297869084 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3a8004d10 0x7fc3a8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:07.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.733+0000 7fc3b3fff640 1 -- 172.21.15.53:0/297869084 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3bc0c82f0 con 0x7fc3a8004d10 2023-06-10T19:08:07.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.733+0000 7fc3b3fff640 1 -- 172.21.15.53:0/297869084 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a800ba70 con 0x7fc3a8003a20 2023-06-10T19:08:07.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.733+0000 7fc3b3fff640 1 -- 172.21.15.53:0/297869084 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a800bc30 con 0x7fc3bc06efc0 2023-06-10T19:08:07.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.733+0000 7fc3c194e640 1 --2- 172.21.15.53:0/297869084 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3a8004d10 0x7fc3a8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:07.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.733+0000 7fc3c114d640 1 --2- 172.21.15.53:0/297869084 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3a8003a20 0x7fc3a8003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:07.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.733+0000 7fc3c094c640 1 --2- 172.21.15.53:0/297869084 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3bc06efc0 0x7fc3a80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:07.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.733+0000 7fc3c194e640 1 -- 172.21.15.53:0/297869084 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3bc06efc0 msgr2=0x7fc3a80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:07.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.733+0000 7fc3c194e640 1 --2- 172.21.15.53:0/297869084 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3bc06efc0 0x7fc3a80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:07.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.733+0000 7fc3c194e640 1 -- 172.21.15.53:0/297869084 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3a8003a20 msgr2=0x7fc3a8003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:07.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.733+0000 7fc3c194e640 1 --2- 172.21.15.53:0/297869084 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3a8003a20 0x7fc3a8003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:07.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.733+0000 7fc3c194e640 1 -- 172.21.15.53:0/297869084 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3a8003530 con 0x7fc3a8004d10 2023-06-10T19:08:07.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.733+0000 7fc3c114d640 1 --2- 172.21.15.53:0/297869084 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3a8003a20 0x7fc3a8003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:08:07.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.733+0000 7fc3c094c640 1 --2- 172.21.15.53:0/297869084 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3bc06efc0 0x7fc3a80047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:08:07.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.737+0000 7fc3c194e640 1 --2- 172.21.15.53:0/297869084 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3a8004d10 0x7fc3a8005180 secure :-1 s=READY pgs=2597 cs=0 l=1 rev1=1 crypto rx=0x7fc3b4009fc0 tx=0x7fc3b401cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ab551f7015b7372 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:07.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.737+0000 7fc3b3fff640 1 -- 172.21.15.53:0/297869084 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b40a5c70 con 0x7fc3a8004d10 2023-06-10T19:08:07.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.737+0000 7fc3b3fff640 1 -- 172.21.15.53:0/297869084 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3b400f040 con 0x7fc3a8004d10 2023-06-10T19:08:07.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.737+0000 7fc3b3fff640 1 -- 172.21.15.53:0/297869084 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b40ad440 con 0x7fc3a8004d10 2023-06-10T19:08:07.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.737+0000 7fc3c33b1640 1 -- 172.21.15.53:0/297869084 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3a8004d10 msgr2=0x7fc3a8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:07.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.737+0000 7fc3c33b1640 1 --2- 172.21.15.53:0/297869084 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3a8004d10 0x7fc3a8005180 secure :-1 s=READY pgs=2597 cs=0 l=1 rev1=1 crypto rx=0x7fc3b4009fc0 tx=0x7fc3b401cc60 comp rx=0 tx=0).stop 2023-06-10T19:08:07.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.737+0000 7fc3c194e640 1 -- 172.21.15.53:0/297869084 reap_dead start 2023-06-10T19:08:07.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.737+0000 7fc3c33b1640 1 -- 172.21.15.53:0/297869084 shutdown_connections 2023-06-10T19:08:07.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.737+0000 7fc3c33b1640 1 -- 172.21.15.53:0/297869084 >> 172.21.15.53:0/297869084 conn(0x7fc3bc06a0d0 msgr2=0x7fc3bc0ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:07.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.737+0000 7fc3c33b1640 1 -- 172.21.15.53:0/297869084 shutdown_connections 2023-06-10T19:08:07.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.737+0000 7fc3c33b1640 1 -- 172.21.15.53:0/297869084 wait complete. 2023-06-10T19:08:07.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.737+0000 7fc3c33b1640 1 Processor -- start 2023-06-10T19:08:07.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.737+0000 7fc3c33b1640 1 -- start start 2023-06-10T19:08:07.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.737+0000 7fc3c33b1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3a8004d10 0x7fc3bc1f1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:07.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.737+0000 7fc3c33b1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3bc14d5b0 0x7fc3bc0c7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:07.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.737+0000 7fc3c33b1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3bc1ed160 0x7fc3bc0b2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:07.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.737+0000 7fc3c33b1640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3bc1f1620 con 0x7fc3bc1ed160 2023-06-10T19:08:07.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.737+0000 7fc3c33b1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3bc0c4d70 con 0x7fc3a8004d10 2023-06-10T19:08:07.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.737+0000 7fc3c33b1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3bc1f0f80 con 0x7fc3bc14d5b0 2023-06-10T19:08:07.747 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.737+0000 7fc3c194e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3bc1ed160 0x7fc3bc0b2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:07.747 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.741+0000 7fc3c194e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3bc1ed160 0x7fc3bc0b2300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36978/0 (socket says 172.21.15.53:36978) 2023-06-10T19:08:07.747 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.741+0000 7fc3c194e640 1 -- 172.21.15.53:0/1356578724 learned_addr learned my addr 172.21.15.53:0/1356578724 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:08:07.747 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.741+0000 7fc3c094c640 1 --2- 172.21.15.53:0/1356578724 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3bc14d5b0 0x7fc3bc0c7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:07.747 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.741+0000 7fc3c114d640 1 --2- 172.21.15.53:0/1356578724 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3a8004d10 0x7fc3bc1f1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:07.747 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.741+0000 7fc3c194e640 1 -- 172.21.15.53:0/1356578724 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3bc14d5b0 msgr2=0x7fc3bc0c7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:07.747 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.741+0000 7fc3c194e640 1 --2- 172.21.15.53:0/1356578724 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3bc14d5b0 0x7fc3bc0c7a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:07.747 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.741+0000 7fc3c194e640 1 -- 172.21.15.53:0/1356578724 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3a8004d10 msgr2=0x7fc3bc1f1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:07.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.741+0000 7fc3c194e640 1 --2- 172.21.15.53:0/1356578724 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3a8004d10 0x7fc3bc1f1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:07.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.741+0000 7fc3c194e640 1 -- 172.21.15.53:0/1356578724 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3bc0c4fc0 con 0x7fc3bc1ed160 2023-06-10T19:08:07.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.741+0000 7fc3c194e640 1 --2- 172.21.15.53:0/1356578724 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3bc1ed160 0x7fc3bc0b2300 secure :-1 s=READY pgs=2598 cs=0 l=1 rev1=1 crypto rx=0x7fc3b4002240 tx=0x7fc3b4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:07.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.741+0000 7fc3b1ffb640 1 -- 172.21.15.53:0/1356578724 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b40bc070 con 0x7fc3bc1ed160 2023-06-10T19:08:07.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.741+0000 7fc3b1ffb640 1 -- 172.21.15.53:0/1356578724 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3b40039a0 con 0x7fc3bc1ed160 2023-06-10T19:08:07.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.741+0000 7fc3c33b1640 1 -- 172.21.15.53:0/1356578724 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3bc0c52a0 con 0x7fc3bc1ed160 2023-06-10T19:08:07.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.741+0000 7fc3b1ffb640 1 -- 172.21.15.53:0/1356578724 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b4003b70 con 0x7fc3bc1ed160 2023-06-10T19:08:07.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.741+0000 7fc3c33b1640 1 -- 172.21.15.53:0/1356578724 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3bc0c7fc0 con 0x7fc3bc1ed160 2023-06-10T19:08:07.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.741+0000 7fc3c33b1640 1 -- 172.21.15.53:0/1356578724 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3bc1f1760 con 0x7fc3bc1ed160 2023-06-10T19:08:07.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.741+0000 7fc3b1ffb640 1 -- 172.21.15.53:0/1356578724 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc3b40b4040 con 0x7fc3bc1ed160 2023-06-10T19:08:07.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.741+0000 7fc3b1ffb640 1 --2- 172.21.15.53:0/1356578724 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc3a0066280 0x7fc3a0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:07.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.741+0000 7fc3b1ffb640 1 -- 172.21.15.53:0/1356578724 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc3b411de60 con 0x7fc3bc1ed160 2023-06-10T19:08:07.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.741+0000 7fc3c114d640 1 --2- 172.21.15.53:0/1356578724 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc3a0066280 0x7fc3a0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:07.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.741+0000 7fc3c114d640 1 --2- 172.21.15.53:0/1356578724 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc3a0066280 0x7fc3a0068730 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fc3b80017d0 tx=0x7fc3b8001c50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:07.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.745+0000 7fc3b1ffb640 1 -- 172.21.15.53:0/1356578724 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc3bc1f1760 con 0x7fc3bc1ed160 2023-06-10T19:08:07.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.897+0000 7fc3c33b1640 1 -- 172.21.15.53:0/1356578724 --> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc3bc0c8590 con 0x7fc3a0066280 2023-06-10T19:08:07.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.921+0000 7fc3b1ffb640 1 -- 172.21.15.53:0/1356578724 <== mgr.4105 v2:172.21.15.117:6832/3061986771 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+298298 (secure 0 0 0) 0x7fc3b800d050 con 0x7fc3a0066280 2023-06-10T19:08:07.923 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:08:07.926 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-06-10T19:08:07.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.925+0000 7fc3c33b1640 1 -- 172.21.15.53:0/1356578724 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc3a0066280 msgr2=0x7fc3a0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:07.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.925+0000 7fc3c33b1640 1 --2- 172.21.15.53:0/1356578724 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc3a0066280 0x7fc3a0068730 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fc3b80017d0 tx=0x7fc3b8001c50 comp rx=0 tx=0).stop 2023-06-10T19:08:07.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.925+0000 7fc3c33b1640 1 -- 172.21.15.53:0/1356578724 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3bc1ed160 msgr2=0x7fc3bc0b2300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:07.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.925+0000 7fc3c33b1640 1 --2- 172.21.15.53:0/1356578724 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3bc1ed160 0x7fc3bc0b2300 secure :-1 s=READY pgs=2598 cs=0 l=1 rev1=1 crypto rx=0x7fc3b4002240 tx=0x7fc3b4009750 comp rx=0 tx=0).stop 2023-06-10T19:08:07.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.925+0000 7fc3c33b1640 1 -- 172.21.15.53:0/1356578724 shutdown_connections 2023-06-10T19:08:07.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.925+0000 7fc3c33b1640 1 --2- 172.21.15.53:0/1356578724 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc3a0066280 0x7fc3a0068730 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:07.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.925+0000 7fc3c33b1640 1 --2- 172.21.15.53:0/1356578724 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3bc1ed160 0x7fc3bc0b2300 unknown :-1 s=CLOSED pgs=2598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:07.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.925+0000 7fc3c33b1640 1 --2- 172.21.15.53:0/1356578724 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc3bc14d5b0 0x7fc3bc0c7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:07.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.925+0000 7fc3c33b1640 1 --2- 172.21.15.53:0/1356578724 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3a8004d10 0x7fc3bc1f1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:07.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.925+0000 7fc3c33b1640 1 -- 172.21.15.53:0/1356578724 >> 172.21.15.53:0/1356578724 conn(0x7fc3bc06a0d0 msgr2=0x7fc3bc0c3d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:07.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.925+0000 7fc3c33b1640 1 -- 172.21.15.53:0/1356578724 shutdown_connections 2023-06-10T19:08:07.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:07.925+0000 7fc3c33b1640 1 -- 172.21.15.53:0/1356578724 wait complete. 2023-06-10T19:08:07.945 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":640,"stamp":"2023-06-10T19:08:05.903326+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":42,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":283244,"kb_used_data":18476,"kb_used_omap":0,"kb_used_meta":264704,"kb_avail":754691476,"statfs":{"total":773094113280,"available":772804071424,"internally_reserved":0,"allocated":18919424,"data_stored":9447215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":271056896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001276"},"pg_stats":[{"pgid":"26.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":1,"reported_epoch":177,"state":"creating+peering","last_fresh":"2023-06-10T19:08:02.133361+0000","last_change":"2023-06-10T19:08:02.133361+0000","last_active":"2023-06-10T19:08:02.118629+0000","last_peered":"2023-06-10T19:08:02.118629+0000","last_clean":"2023-06-10T19:08:02.118629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:02.133361+0000","last_undegraded":"2023-06-10T19:08:02.133361+0000","last_fullsized":"2023-06-10T19:08:02.133361+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":1,"reported_epoch":177,"state":"creating+peering","last_fresh":"2023-06-10T19:08:02.128283+0000","last_change":"2023-06-10T19:08:02.128283+0000","last_active":"2023-06-10T19:08:02.118629+0000","last_peered":"2023-06-10T19:08:02.118629+0000","last_clean":"2023-06-10T19:08:02.118629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:02.128283+0000","last_undegraded":"2023-06-10T19:08:02.128283+0000","last_fullsized":"2023-06-10T19:08:02.128283+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":1,"reported_epoch":177,"state":"creating+peering","last_fresh":"2023-06-10T19:08:02.134297+0000","last_change":"2023-06-10T19:08:02.134297+0000","last_active":"2023-06-10T19:08:02.118629+0000","last_peered":"2023-06-10T19:08:02.118629+0000","last_clean":"2023-06-10T19:08:02.118629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:02.134297+0000","last_undegraded":"2023-06-10T19:08:02.134297+0000","last_fullsized":"2023-06-10T19:08:02.134297+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":1,"reported_epoch":177,"state":"creating+peering","last_fresh":"2023-06-10T19:08:02.128077+0000","last_change":"2023-06-10T19:08:02.128077+0000","last_active":"2023-06-10T19:08:02.118629+0000","last_peered":"2023-06-10T19:08:02.118629+0000","last_clean":"2023-06-10T19:08:02.118629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:02.128077+0000","last_undegraded":"2023-06-10T19:08:02.128077+0000","last_fullsized":"2023-06-10T19:08:02.128077+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":1,"reported_epoch":177,"state":"creating+peering","last_fresh":"2023-06-10T19:08:02.128865+0000","last_change":"2023-06-10T19:08:02.128865+0000","last_active":"2023-06-10T19:08:02.118629+0000","last_peered":"2023-06-10T19:08:02.118629+0000","last_clean":"2023-06-10T19:08:02.118629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:02.128865+0000","last_undegraded":"2023-06-10T19:08:02.128865+0000","last_fullsized":"2023-06-10T19:08:02.128865+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":1,"reported_epoch":177,"state":"creating+peering","last_fresh":"2023-06-10T19:08:02.128288+0000","last_change":"2023-06-10T19:08:02.128288+0000","last_active":"2023-06-10T19:08:02.118629+0000","last_peered":"2023-06-10T19:08:02.118629+0000","last_clean":"2023-06-10T19:08:02.118629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:02.128288+0000","last_undegraded":"2023-06-10T19:08:02.128288+0000","last_fullsized":"2023-06-10T19:08:02.128288+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":1,"reported_epoch":177,"state":"creating+peering","last_fresh":"2023-06-10T19:08:02.133535+0000","last_change":"2023-06-10T19:08:02.133535+0000","last_active":"2023-06-10T19:08:02.118629+0000","last_peered":"2023-06-10T19:08:02.118629+0000","last_clean":"2023-06-10T19:08:02.118629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:02.133535+0000","last_undegraded":"2023-06-10T19:08:02.133535+0000","last_fullsized":"2023-06-10T19:08:02.133535+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":1,"reported_epoch":177,"state":"creating+peering","last_fresh":"2023-06-10T19:08:02.132583+0000","last_change":"2023-06-10T19:08:02.132583+0000","last_active":"2023-06-10T19:08:02.118629+0000","last_peered":"2023-06-10T19:08:02.118629+0000","last_clean":"2023-06-10T19:08:02.118629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:02.132583+0000","last_undegraded":"2023-06-10T19:08:02.132583+0000","last_fullsized":"2023-06-10T19:08:02.132583+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":1,"reported_epoch":177,"state":"creating+peering","last_fresh":"2023-06-10T19:08:02.134043+0000","last_change":"2023-06-10T19:08:02.134043+0000","last_active":"2023-06-10T19:08:02.118629+0000","last_peered":"2023-06-10T19:08:02.118629+0000","last_clean":"2023-06-10T19:08:02.118629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:02.134043+0000","last_undegraded":"2023-06-10T19:08:02.134043+0000","last_fullsized":"2023-06-10T19:08:02.134043+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":1,"reported_epoch":177,"state":"creating+peering","last_fresh":"2023-06-10T19:08:02.134057+0000","last_change":"2023-06-10T19:08:02.134057+0000","last_active":"2023-06-10T19:08:02.118629+0000","last_peered":"2023-06-10T19:08:02.118629+0000","last_clean":"2023-06-10T19:08:02.118629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:02.134057+0000","last_undegraded":"2023-06-10T19:08:02.134057+0000","last_fullsized":"2023-06-10T19:08:02.134057+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":1,"reported_epoch":177,"state":"creating+peering","last_fresh":"2023-06-10T19:08:02.136413+0000","last_change":"2023-06-10T19:08:02.136413+0000","last_active":"2023-06-10T19:08:02.118629+0000","last_peered":"2023-06-10T19:08:02.118629+0000","last_clean":"2023-06-10T19:08:02.118629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:02.136413+0000","last_undegraded":"2023-06-10T19:08:02.136413+0000","last_fullsized":"2023-06-10T19:08:02.136413+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":1,"reported_epoch":177,"state":"creating+peering","last_fresh":"2023-06-10T19:08:02.132572+0000","last_change":"2023-06-10T19:08:02.132572+0000","last_active":"2023-06-10T19:08:02.118629+0000","last_peered":"2023-06-10T19:08:02.118629+0000","last_clean":"2023-06-10T19:08:02.118629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:02.132572+0000","last_undegraded":"2023-06-10T19:08:02.132572+0000","last_fullsized":"2023-06-10T19:08:02.132572+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":1,"reported_epoch":177,"state":"creating+peering","last_fresh":"2023-06-10T19:08:02.127801+0000","last_change":"2023-06-10T19:08:02.127801+0000","last_active":"2023-06-10T19:08:02.118629+0000","last_peered":"2023-06-10T19:08:02.118629+0000","last_clean":"2023-06-10T19:08:02.118629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:02.127801+0000","last_undegraded":"2023-06-10T19:08:02.127801+0000","last_fullsized":"2023-06-10T19:08:02.127801+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":1,"reported_epoch":177,"state":"creating+peering","last_fresh":"2023-06-10T19:08:02.134927+0000","last_change":"2023-06-10T19:08:02.134927+0000","last_active":"2023-06-10T19:08:02.118629+0000","last_peered":"2023-06-10T19:08:02.118629+0000","last_clean":"2023-06-10T19:08:02.118629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:02.134927+0000","last_undegraded":"2023-06-10T19:08:02.134927+0000","last_fullsized":"2023-06-10T19:08:02.134927+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":1,"reported_epoch":177,"state":"creating+peering","last_fresh":"2023-06-10T19:08:02.132945+0000","last_change":"2023-06-10T19:08:02.132945+0000","last_active":"2023-06-10T19:08:02.118629+0000","last_peered":"2023-06-10T19:08:02.118629+0000","last_clean":"2023-06-10T19:08:02.118629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:02.132945+0000","last_undegraded":"2023-06-10T19:08:02.132945+0000","last_fullsized":"2023-06-10T19:08:02.132945+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":1,"reported_epoch":177,"state":"creating+peering","last_fresh":"2023-06-10T19:08:02.139745+0000","last_change":"2023-06-10T19:08:02.139745+0000","last_active":"2023-06-10T19:08:02.118629+0000","last_peered":"2023-06-10T19:08:02.118629+0000","last_clean":"2023-06-10T19:08:02.118629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:02.139745+0000","last_undegraded":"2023-06-10T19:08:02.139745+0000","last_fullsized":"2023-06-10T19:08:02.139745+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":1,"reported_epoch":177,"state":"creating+peering","last_fresh":"2023-06-10T19:08:02.133213+0000","last_change":"2023-06-10T19:08:02.133213+0000","last_active":"2023-06-10T19:08:02.118629+0000","last_peered":"2023-06-10T19:08:02.118629+0000","last_clean":"2023-06-10T19:08:02.118629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:02.133213+0000","last_undegraded":"2023-06-10T19:08:02.133213+0000","last_fullsized":"2023-06-10T19:08:02.133213+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":1,"reported_epoch":177,"state":"creating+peering","last_fresh":"2023-06-10T19:08:02.132038+0000","last_change":"2023-06-10T19:08:02.132038+0000","last_active":"2023-06-10T19:08:02.118629+0000","last_peered":"2023-06-10T19:08:02.118629+0000","last_clean":"2023-06-10T19:08:02.118629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:02.132038+0000","last_undegraded":"2023-06-10T19:08:02.132038+0000","last_fullsized":"2023-06-10T19:08:02.132038+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":1,"reported_epoch":177,"state":"creating+peering","last_fresh":"2023-06-10T19:08:02.133030+0000","last_change":"2023-06-10T19:08:02.133030+0000","last_active":"2023-06-10T19:08:02.118629+0000","last_peered":"2023-06-10T19:08:02.118629+0000","last_clean":"2023-06-10T19:08:02.118629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:02.133030+0000","last_undegraded":"2023-06-10T19:08:02.133030+0000","last_fullsized":"2023-06-10T19:08:02.133030+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":1,"reported_epoch":177,"state":"creating+peering","last_fresh":"2023-06-10T19:08:02.134398+0000","last_change":"2023-06-10T19:08:02.134398+0000","last_active":"2023-06-10T19:08:02.118629+0000","last_peered":"2023-06-10T19:08:02.118629+0000","last_clean":"2023-06-10T19:08:02.118629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:02.134398+0000","last_undegraded":"2023-06-10T19:08:02.134398+0000","last_fullsized":"2023-06-10T19:08:02.134398+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":1,"reported_epoch":177,"state":"creating+peering","last_fresh":"2023-06-10T19:08:02.135411+0000","last_change":"2023-06-10T19:08:02.135411+0000","last_active":"2023-06-10T19:08:02.118629+0000","last_peered":"2023-06-10T19:08:02.118629+0000","last_clean":"2023-06-10T19:08:02.118629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:02.135411+0000","last_undegraded":"2023-06-10T19:08:02.135411+0000","last_fullsized":"2023-06-10T19:08:02.135411+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":1,"reported_epoch":177,"state":"creating+peering","last_fresh":"2023-06-10T19:08:02.133740+0000","last_change":"2023-06-10T19:08:02.133740+0000","last_active":"2023-06-10T19:08:02.118629+0000","last_peered":"2023-06-10T19:08:02.118629+0000","last_clean":"2023-06-10T19:08:02.118629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:02.133740+0000","last_undegraded":"2023-06-10T19:08:02.133740+0000","last_fullsized":"2023-06-10T19:08:02.133740+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":1,"reported_epoch":177,"state":"creating+peering","last_fresh":"2023-06-10T19:08:02.132045+0000","last_change":"2023-06-10T19:08:02.132045+0000","last_active":"2023-06-10T19:08:02.118629+0000","last_peered":"2023-06-10T19:08:02.118629+0000","last_clean":"2023-06-10T19:08:02.118629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:02.132045+0000","last_undegraded":"2023-06-10T19:08:02.132045+0000","last_fullsized":"2023-06-10T19:08:02.132045+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":1,"reported_epoch":177,"state":"creating+peering","last_fresh":"2023-06-10T19:08:02.136426+0000","last_change":"2023-06-10T19:08:02.136426+0000","last_active":"2023-06-10T19:08:02.118629+0000","last_peered":"2023-06-10T19:08:02.118629+0000","last_clean":"2023-06-10T19:08:02.118629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:02.136426+0000","last_undegraded":"2023-06-10T19:08:02.136426+0000","last_fullsized":"2023-06-10T19:08:02.136426+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":1,"reported_epoch":177,"state":"creating+peering","last_fresh":"2023-06-10T19:08:02.134500+0000","last_change":"2023-06-10T19:08:02.134500+0000","last_active":"2023-06-10T19:08:02.118629+0000","last_peered":"2023-06-10T19:08:02.118629+0000","last_clean":"2023-06-10T19:08:02.118629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:02.134500+0000","last_undegraded":"2023-06-10T19:08:02.134500+0000","last_fullsized":"2023-06-10T19:08:02.134500+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":428,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-06-10T19:08:02.138433+0000","last_change":"2023-06-10T18:52:34.951528+0000","last_active":"2023-06-10T19:08:02.138433+0000","last_peered":"2023-06-10T19:08:02.138433+0000","last_clean":"2023-06-10T19:08:02.138433+0000","last_became_active":"2023-06-10T18:52:34.949099+0000","last_became_peered":"2023-06-10T18:52:34.949099+0000","last_unstale":"2023-06-10T19:08:02.138433+0000","last_undegraded":"2023-06-10T19:08:02.138433+0000","last_fullsized":"2023-06-10T19:08:02.138433+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_clean_scrub_stamp":"2023-06-10T18:52:33.633295+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:30:54.669663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":304,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-06-10T19:08:02.136357+0000","last_change":"2023-06-10T18:52:40.506384+0000","last_active":"2023-06-10T19:08:02.136357+0000","last_peered":"2023-06-10T19:08:02.136357+0000","last_clean":"2023-06-10T19:08:02.136357+0000","last_became_active":"2023-06-10T18:52:40.505701+0000","last_became_peered":"2023-06-10T18:52:40.505701+0000","last_unstale":"2023-06-10T19:08:02.136357+0000","last_undegraded":"2023-06-10T19:08:02.136357+0000","last_fullsized":"2023-06-10T19:08:02.136357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:37:54.300849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":1,"reported_epoch":177,"state":"creating+peering","last_fresh":"2023-06-10T19:08:02.134351+0000","last_change":"2023-06-10T19:08:02.134351+0000","last_active":"2023-06-10T19:08:02.118629+0000","last_peered":"2023-06-10T19:08:02.118629+0000","last_clean":"2023-06-10T19:08:02.118629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:02.134351+0000","last_undegraded":"2023-06-10T19:08:02.134351+0000","last_fullsized":"2023-06-10T19:08:02.134351+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":272,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-06-10T19:08:02.133332+0000","last_change":"2023-06-10T18:52:40.512015+0000","last_active":"2023-06-10T19:08:02.133332+0000","last_peered":"2023-06-10T19:08:02.133332+0000","last_clean":"2023-06-10T19:08:02.133332+0000","last_became_active":"2023-06-10T18:52:40.511382+0000","last_became_peered":"2023-06-10T18:52:40.511382+0000","last_unstale":"2023-06-10T19:08:02.133332+0000","last_undegraded":"2023-06-10T19:08:02.133332+0000","last_fullsized":"2023-06-10T19:08:02.133332+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:16:17.779044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":1,"reported_epoch":177,"state":"creating+peering","last_fresh":"2023-06-10T19:08:02.135579+0000","last_change":"2023-06-10T19:08:02.135579+0000","last_active":"2023-06-10T19:08:02.118629+0000","last_peered":"2023-06-10T19:08:02.118629+0000","last_clean":"2023-06-10T19:08:02.118629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:02.135579+0000","last_undegraded":"2023-06-10T19:08:02.135579+0000","last_fullsized":"2023-06-10T19:08:02.135579+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":294,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-06-10T19:08:02.126958+0000","last_change":"2023-06-10T18:52:40.671725+0000","last_active":"2023-06-10T19:08:02.126958+0000","last_peered":"2023-06-10T19:08:02.126958+0000","last_clean":"2023-06-10T19:08:02.126958+0000","last_became_active":"2023-06-10T18:52:40.671442+0000","last_became_peered":"2023-06-10T18:52:40.671442+0000","last_unstale":"2023-06-10T19:08:02.126958+0000","last_undegraded":"2023-06-10T19:08:02.126958+0000","last_fullsized":"2023-06-10T19:08:02.126958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:51:20.027781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":1,"reported_epoch":177,"state":"creating+peering","last_fresh":"2023-06-10T19:08:02.128097+0000","last_change":"2023-06-10T19:08:02.128097+0000","last_active":"2023-06-10T19:08:02.118629+0000","last_peered":"2023-06-10T19:08:02.118629+0000","last_clean":"2023-06-10T19:08:02.118629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:02.128097+0000","last_undegraded":"2023-06-10T19:08:02.128097+0000","last_fullsized":"2023-06-10T19:08:02.128097+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":304,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-06-10T19:08:02.135785+0000","last_change":"2023-06-10T18:52:40.510258+0000","last_active":"2023-06-10T19:08:02.135785+0000","last_peered":"2023-06-10T19:08:02.135785+0000","last_clean":"2023-06-10T19:08:02.135785+0000","last_became_active":"2023-06-10T18:52:40.509560+0000","last_became_peered":"2023-06-10T18:52:40.509560+0000","last_unstale":"2023-06-10T19:08:02.135785+0000","last_undegraded":"2023-06-10T19:08:02.135785+0000","last_fullsized":"2023-06-10T19:08:02.135785+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:38:06.212965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":1,"reported_epoch":177,"state":"creating+peering","last_fresh":"2023-06-10T19:08:02.135525+0000","last_change":"2023-06-10T19:08:02.135525+0000","last_active":"2023-06-10T19:08:02.118629+0000","last_peered":"2023-06-10T19:08:02.118629+0000","last_clean":"2023-06-10T19:08:02.118629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:02.135525+0000","last_undegraded":"2023-06-10T19:08:02.135525+0000","last_fullsized":"2023-06-10T19:08:02.135525+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":274,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-06-10T19:08:02.129444+0000","last_change":"2023-06-10T18:52:40.672266+0000","last_active":"2023-06-10T19:08:02.129444+0000","last_peered":"2023-06-10T19:08:02.129444+0000","last_clean":"2023-06-10T19:08:02.129444+0000","last_became_active":"2023-06-10T18:52:40.671966+0000","last_became_peered":"2023-06-10T18:52:40.671966+0000","last_unstale":"2023-06-10T19:08:02.129444+0000","last_undegraded":"2023-06-10T19:08:02.129444+0000","last_fullsized":"2023-06-10T19:08:02.129444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:35:45.974909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":1,"reported_epoch":177,"state":"creating+peering","last_fresh":"2023-06-10T19:08:02.135049+0000","last_change":"2023-06-10T19:08:02.135049+0000","last_active":"2023-06-10T19:08:02.118629+0000","last_peered":"2023-06-10T19:08:02.118629+0000","last_clean":"2023-06-10T19:08:02.118629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:02.135049+0000","last_undegraded":"2023-06-10T19:08:02.135049+0000","last_fullsized":"2023-06-10T19:08:02.135049+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":272,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-06-10T19:08:02.132961+0000","last_change":"2023-06-10T18:52:40.671084+0000","last_active":"2023-06-10T19:08:02.132961+0000","last_peered":"2023-06-10T19:08:02.132961+0000","last_clean":"2023-06-10T19:08:02.132961+0000","last_became_active":"2023-06-10T18:52:40.670697+0000","last_became_peered":"2023-06-10T18:52:40.670697+0000","last_unstale":"2023-06-10T19:08:02.132961+0000","last_undegraded":"2023-06-10T19:08:02.132961+0000","last_fullsized":"2023-06-10T19:08:02.132961+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:13:13.967154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":1,"reported_epoch":177,"state":"creating+peering","last_fresh":"2023-06-10T19:08:02.132603+0000","last_change":"2023-06-10T19:08:02.132603+0000","last_active":"2023-06-10T19:08:02.118629+0000","last_peered":"2023-06-10T19:08:02.118629+0000","last_clean":"2023-06-10T19:08:02.118629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:02.132603+0000","last_undegraded":"2023-06-10T19:08:02.132603+0000","last_fullsized":"2023-06-10T19:08:02.132603+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":274,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-06-10T19:08:02.129511+0000","last_change":"2023-06-10T18:52:40.514114+0000","last_active":"2023-06-10T19:08:02.129511+0000","last_peered":"2023-06-10T19:08:02.129511+0000","last_clean":"2023-06-10T19:08:02.129511+0000","last_became_active":"2023-06-10T18:52:40.513638+0000","last_became_peered":"2023-06-10T18:52:40.513638+0000","last_unstale":"2023-06-10T19:08:02.129511+0000","last_undegraded":"2023-06-10T19:08:02.129511+0000","last_fullsized":"2023-06-10T19:08:02.129511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:15:21.678932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-10T19:08:03.122254+0000","last_change":"2023-06-10T19:08:03.122254+0000","last_active":"2023-06-10T19:08:03.122254+0000","last_peered":"2023-06-10T19:08:03.122254+0000","last_clean":"2023-06-10T19:08:03.122254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:03.122254+0000","last_undegraded":"2023-06-10T19:08:03.122254+0000","last_fullsized":"2023-06-10T19:08:03.122254+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":1,"reported_epoch":177,"state":"creating+peering","last_fresh":"2023-06-10T19:08:02.129278+0000","last_change":"2023-06-10T19:08:02.129278+0000","last_active":"2023-06-10T19:08:02.118629+0000","last_peered":"2023-06-10T19:08:02.118629+0000","last_clean":"2023-06-10T19:08:02.118629+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-10T19:08:02.129278+0000","last_undegraded":"2023-06-10T19:08:02.129278+0000","last_fullsized":"2023-06-10T19:08:02.129278+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":274,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-06-10T19:08:02.136533+0000","last_change":"2023-06-10T18:52:40.515396+0000","last_active":"2023-06-10T19:08:02.136533+0000","last_peered":"2023-06-10T19:08:02.136533+0000","last_clean":"2023-06-10T19:08:02.136533+0000","last_became_active":"2023-06-10T18:52:40.514663+0000","last_became_peered":"2023-06-10T18:52:40.514663+0000","last_unstale":"2023-06-10T19:08:02.136533+0000","last_undegraded":"2023-06-10T19:08:02.136533+0000","last_fullsized":"2023-06-10T19:08:02.136533+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:01:56.219507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":25,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575037,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33788,"kb_used_data":2740,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338052,"statfs":{"total":96636764160,"available":96602165248,"internally_reserved":0,"allocated":2805760,"data_stored":1620975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:07:04 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.93600000000000005,"15min":0.92500000000000004},"min":{"1min":0.443,"5min":0.443,"15min":0.434},"max":{"1min":1.131,"5min":1.522,"15min":1.6220000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.88,"5min":0.90900000000000003,"15min":0.92400000000000004},"min":{"1min":0.63400000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.1379999999999999,"5min":1.3109999999999999,"15min":1.6870000000000001},"last":0.49399999999999999}]},{"osd":1,"last update":"Sat Jun 10 19:07:04 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.88800000000000001,"15min":0.91700000000000004},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.377},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.92300000000000004,"15min":0.94299999999999995},"min":{"1min":0.55000000000000004,"5min":0.51300000000000001,"15min":0.504},"max":{"1min":1.302,"5min":1.3320000000000001,"15min":1.5960000000000001},"last":0.65000000000000002}]},{"osd":2,"last update":"Sat Jun 10 19:07:04 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.86699999999999999,"15min":0.85299999999999998},"min":{"1min":0.41899999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.2370000000000001,"5min":1.2629999999999999,"15min":1.4059999999999999},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.88700000000000001,"15min":0.89600000000000002},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.50600000000000001},"max":{"1min":1.2290000000000001,"5min":1.3100000000000001,"15min":1.448},"last":0.751}]},{"osd":3,"last update":"Sat Jun 10 19:07:04 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.89600000000000002,"15min":0.92000000000000004},"min":{"1min":0.68600000000000005,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.1299999999999999,"5min":1.4490000000000001,"15min":1.502},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.95099999999999996,"15min":0.95599999999999996},"min":{"1min":0.496,"5min":0.432,"15min":0.432},"max":{"1min":1.2,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.97299999999999998}]},{"osd":4,"last update":"Sat Jun 10 19:07:04 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.82799999999999996,"15min":0.84399999999999997},"min":{"1min":0.60299999999999998,"5min":0.307,"15min":0.307},"max":{"1min":1.1639999999999999,"5min":1.2290000000000001,"15min":1.639},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.96699999999999997,"15min":0.96599999999999997},"min":{"1min":0.47299999999999998,"5min":0.41199999999999998,"15min":0.40000000000000002},"max":{"1min":1.1799999999999999,"5min":1.454,"15min":1.4590000000000001},"last":1.079}]},{"osd":5,"last update":"Sat Jun 10 19:07:04 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.99399999999999999,"15min":1.002},"min":{"1min":0.66600000000000004,"5min":0.45100000000000001,"15min":0.38400000000000001},"max":{"1min":1.268,"5min":1.385,"15min":1.806},"last":1.1220000000000001},{"interface":"front","average":{"1min":1.044,"5min":1.0269999999999999,"15min":1.0349999999999999},"min":{"1min":0.78200000000000003,"5min":0.48499999999999999,"15min":0.46500000000000002},"max":{"1min":1.254,"5min":1.665,"15min":1.665},"last":1.155}]},{"osd":6,"last update":"Sat Jun 10 19:07:04 2023","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.014,"15min":1.0089999999999999},"min":{"1min":0.71899999999999997,"5min":0.47699999999999998,"15min":0.35999999999999999},"max":{"1min":2.1120000000000001,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.117,"5min":1.0960000000000001,"15min":1.099},"min":{"1min":0.82499999999999996,"5min":0.504,"15min":0.441},"max":{"1min":1.397,"5min":1.728,"15min":1.728},"last":1.1970000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575038,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33208,"kb_used_data":2160,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338632,"statfs":{"total":96636764160,"available":96602759168,"internally_reserved":0,"allocated":2211840,"data_stored":1030607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:07:58 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.84699999999999998,"15min":0.86599999999999999},"min":{"1min":0.55700000000000005,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.2050000000000001,"5min":1.2450000000000001,"15min":1.498},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.879,"15min":0.88400000000000001},"min":{"1min":0.58199999999999996,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.1359999999999999,"5min":1.3009999999999999,"15min":1.496},"last":0.58199999999999996}]},{"osd":1,"last update":"Sat Jun 10 19:07:58 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.83999999999999997,"15min":0.86099999999999999},"min":{"1min":0.60799999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.1200000000000001,"5min":1.2709999999999999,"15min":1.5229999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.90300000000000002,"15min":0.90700000000000003},"min":{"1min":0.71199999999999997,"5min":0.504,"15min":0.45300000000000001},"max":{"1min":1.248,"5min":1.341,"15min":1.778},"last":0.83699999999999997}]},{"osd":2,"last update":"Sat Jun 10 19:07:58 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.89400000000000002,"15min":0.90200000000000002},"min":{"1min":0.53500000000000003,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.1579999999999999,"5min":1.2929999999999999,"15min":1.3759999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.874,"5min":0.86699999999999999,"15min":0.88200000000000001},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.175,"5min":1.175,"15min":1.246},"last":0.70999999999999996}]},{"osd":3,"last update":"Sat Jun 10 19:07:58 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.91400000000000003,"15min":0.92300000000000004},"min":{"1min":0.67300000000000004,"5min":0.55100000000000005,"15min":0.52700000000000002},"max":{"1min":1.1890000000000001,"5min":1.238,"15min":1.7190000000000001},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.95399999999999996,"15min":0.97899999999999998},"min":{"1min":0.72699999999999998,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.1639999999999999,"5min":1.304,"15min":1.4370000000000001},"last":0.72699999999999998}]},{"osd":4,"last update":"Sat Jun 10 19:07:58 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.93400000000000005,"15min":0.91600000000000004},"min":{"1min":0.58599999999999997,"5min":0.45900000000000002,"15min":0.373},"max":{"1min":1.2130000000000001,"5min":1.4019999999999999,"15min":1.798},"last":1.147},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.999,"15min":0.98399999999999999},"min":{"1min":0.65600000000000003,"5min":0.504,"15min":0.47899999999999998},"max":{"1min":1.276,"5min":1.409,"15min":1.5489999999999999},"last":0.752}]},{"osd":5,"last update":"Sat Jun 10 19:07:58 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.875,"15min":0.90000000000000002},"min":{"1min":0.45300000000000001,"5min":0.437,"15min":0.437},"max":{"1min":1.1020000000000001,"5min":1.2150000000000001,"15min":1.333},"last":0.45300000000000001},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.0189999999999999,"15min":1.024},"min":{"1min":0.64300000000000002,"5min":0.47199999999999998,"15min":0.42699999999999999},"max":{"1min":1.3069999999999999,"5min":1.3520000000000001,"15min":2.536},"last":0.64300000000000002}]},{"osd":7,"last update":"Sat Jun 10 19:07:58 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.04,"15min":1.028},"min":{"1min":0.69399999999999995,"5min":0.59199999999999997,"15min":0.57099999999999995},"max":{"1min":1.1870000000000001,"5min":1.879,"15min":1.917},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.98299999999999998,"15min":0.999},"min":{"1min":0.51700000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.226,"5min":1.345,"15min":1.5569999999999999},"last":0.51700000000000002}]}]},{"osd":5,"up_from":13,"seq":55834575038,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33220,"kb_used_data":2172,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338620,"statfs":{"total":96636764160,"available":96602746880,"internally_reserved":0,"allocated":2224128,"data_stored":1036777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.85399999999999998,"15min":0.874},"min":{"1min":0.53100000000000003,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.2649999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.89200000000000002,"15min":0.90000000000000002},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.49399999999999999},"max":{"1min":1.0860000000000001,"5min":1.2370000000000001,"15min":2.347},"last":0.996}]},{"osd":1,"last update":"Sat Jun 10 19:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.879,"15min":0.90900000000000003},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.153,"5min":1.6739999999999999,"15min":7.0800000000000001},"last":1.0620000000000001},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.90200000000000002,"15min":0.98199999999999998},"min":{"1min":0.56999999999999995,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1619999999999999,"5min":1.2689999999999999,"15min":15.845000000000001},"last":0.85999999999999999}]},{"osd":2,"last update":"Sat Jun 10 19:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.90700000000000003,"15min":0.89600000000000002},"min":{"1min":0.60999999999999999,"5min":0.54300000000000004,"15min":0.48299999999999998},"max":{"1min":1.2150000000000001,"5min":1.6459999999999999,"15min":5.0049999999999999},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.91500000000000004,"15min":0.94599999999999995},"min":{"1min":0.625,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.107,"5min":1.391,"15min":6.851},"last":0.69099999999999995}]},{"osd":3,"last update":"Sat Jun 10 19:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.93600000000000005,"15min":0.94699999999999995},"min":{"1min":0.59099999999999997,"5min":0.58699999999999997,"15min":0.51500000000000001},"max":{"1min":1.508,"5min":1.6910000000000001,"15min":2.544},"last":1.022},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.97699999999999998,"15min":0.98999999999999999},"min":{"1min":0.748,"5min":0.66000000000000003,"15min":0.59799999999999998},"max":{"1min":1.3009999999999999,"5min":1.4870000000000001,"15min":3.0830000000000002},"last":0.79700000000000004}]},{"osd":4,"last update":"Sat Jun 10 19:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.94199999999999995,"15min":0.94799999999999995},"min":{"1min":0.67000000000000004,"5min":0.59799999999999998,"15min":0.58099999999999996},"max":{"1min":1.454,"5min":1.6140000000000001,"15min":6.7290000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":1.0720000000000001,"5min":0.97099999999999997,"15min":0.98699999999999999},"min":{"1min":0.69699999999999995,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":0.66000000000000003}]},{"osd":6,"last update":"Sat Jun 10 19:07:54 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":0.98899999999999999,"15min":0.98699999999999999},"min":{"1min":0.70399999999999996,"5min":0.60499999999999998,"15min":0.54200000000000004},"max":{"1min":1.7190000000000001,"5min":1.8009999999999999,"15min":1.8009999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.0329999999999999,"15min":1.054},"min":{"1min":0.86799999999999999,"5min":0.66200000000000003,"15min":0.57899999999999996},"max":{"1min":1.5620000000000001,"5min":1.8380000000000001,"15min":6.923},"last":0.96299999999999997}]},{"osd":7,"last update":"Sat Jun 10 19:07:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.0640000000000001,"15min":1.0800000000000001},"min":{"1min":0.95899999999999996,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.7549999999999999,"5min":1.7749999999999999,"15min":2.6080000000000001},"last":0.93400000000000005},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1200000000000001,"15min":1.133},"min":{"1min":0.88700000000000001,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":5.4169999999999998},"last":1.0940000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575037,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33220,"kb_used_data":2172,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338620,"statfs":{"total":96636764160,"available":96602746880,"internally_reserved":0,"allocated":2224128,"data_stored":1036777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.83999999999999997,"15min":0.83299999999999996},"min":{"1min":0.53200000000000003,"5min":0.45400000000000001,"15min":0.45100000000000001},"max":{"1min":1.2190000000000001,"5min":1.29,"15min":1.29},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.90000000000000002,"15min":0.90600000000000003},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.375,"5min":1.3979999999999999,"15min":3.7280000000000002},"last":0.86599999999999999}]},{"osd":1,"last update":"Sat Jun 10 19:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.90000000000000002,"15min":0.92800000000000005},"min":{"1min":0.55000000000000004,"5min":0.47799999999999998,"15min":0.47599999999999998},"max":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":3.3969999999999998},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.83199999999999996,"15min":0.86199999999999999},"min":{"1min":0.55700000000000005,"5min":0.47899999999999998,"15min":0.47699999999999998},"max":{"1min":1.212,"5min":1.2430000000000001,"15min":2.496},"last":0.93700000000000006}]},{"osd":2,"last update":"Sat Jun 10 19:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.85899999999999999,"15min":0.879},"min":{"1min":0.52400000000000002,"5min":0.52200000000000002,"15min":0.49299999999999999},"max":{"1min":1.137,"5min":1.236,"15min":1.522},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.95899999999999996,"15min":0.98499999999999999},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.55000000000000004},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":3.5750000000000002},"last":0.98199999999999998}]},{"osd":3,"last update":"Sat Jun 10 19:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.86399999999999999,"15min":0.89300000000000002},"min":{"1min":0.57799999999999996,"5min":0.56200000000000006,"15min":0.53900000000000003},"max":{"1min":1.1200000000000001,"5min":1.46,"15min":2.3809999999999998},"last":1.05},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.94599999999999995,"15min":0.96299999999999997},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.54400000000000004},"max":{"1min":1.2889999999999999,"5min":1.4279999999999999,"15min":1.6479999999999999},"last":0.91500000000000004}]},{"osd":5,"last update":"Sat Jun 10 19:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.95299999999999996,"15min":0.95799999999999996},"min":{"1min":0.66800000000000004,"5min":0.58699999999999997,"15min":0.53100000000000003},"max":{"1min":1.224,"5min":1.3260000000000001,"15min":3.6539999999999999},"last":1.214},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.92000000000000004,"15min":0.93999999999999995},"min":{"1min":0.63400000000000001,"5min":0.495,"15min":0.495},"max":{"1min":1.216,"5min":1.26,"15min":2.6720000000000002},"last":1.133}]},{"osd":6,"last update":"Sat Jun 10 19:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.97599999999999998,"15min":0.96799999999999997},"min":{"1min":0.67000000000000004,"5min":0.443,"15min":0.443},"max":{"1min":1.2869999999999999,"5min":1.413,"15min":2.2639999999999998},"last":0.81499999999999995},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.081,"15min":1.0680000000000001},"min":{"1min":0.76300000000000001,"5min":0.58799999999999997,"15min":0.44400000000000001},"max":{"1min":1.625,"5min":1.625,"15min":3.4980000000000002},"last":1.089}]},{"osd":7,"last update":"Sat Jun 10 19:07:08 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.02,"15min":1.0009999999999999},"min":{"1min":0.82699999999999996,"5min":0.60899999999999999,"15min":0.41399999999999998},"max":{"1min":1.3240000000000001,"5min":1.3919999999999999,"15min":2.5910000000000002},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.071},"min":{"1min":0.81100000000000005,"5min":0.50800000000000001,"15min":0.46300000000000002},"max":{"1min":1.385,"5min":1.635,"15min":1.635},"last":1.02}]}]},{"osd":3,"up_from":13,"seq":55834575036,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37312,"kb_used_data":2168,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334528,"statfs":{"total":96636764160,"available":96598556672,"internally_reserved":0,"allocated":2220032,"data_stored":1035758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.63700000000000001,"15min":0.628},"min":{"1min":0.33800000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.879,"5min":1.0900000000000001,"15min":1.169},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.66600000000000004,"15min":0.66900000000000004},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.251},"max":{"1min":0.91200000000000003,"5min":0.97799999999999998,"15min":1.5269999999999999},"last":0.35499999999999998}]},{"osd":1,"last update":"Sat Jun 10 19:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.68300000000000005,"15min":0.68899999999999995},"min":{"1min":0.33300000000000002,"5min":0.29699999999999999,"15min":0.27500000000000002},"max":{"1min":1.234,"5min":1.234,"15min":2.0699999999999998},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71799999999999997,"15min":0.73399999999999999},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.411},"last":0.30499999999999999}]},{"osd":2,"last update":"Sat Jun 10 19:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.753,"15min":0.77300000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.30299999999999999},"max":{"1min":0.98699999999999999,"5min":1.2829999999999999,"15min":1.9530000000000001},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.80600000000000005,"15min":0.79700000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.29699999999999999},"max":{"1min":1.0800000000000001,"5min":1.2769999999999999,"15min":1.591},"last":0.32800000000000001}]},{"osd":4,"last update":"Sat Jun 10 19:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.94599999999999995,"15min":0.94899999999999995},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.41899999999999998},"max":{"1min":1.294,"5min":1.4239999999999999,"15min":1.8240000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.98499999999999999,"15min":0.99199999999999999},"min":{"1min":0.64600000000000002,"5min":0.57299999999999995,"15min":0.47999999999999998},"max":{"1min":1.417,"5min":1.4330000000000001,"15min":1.873},"last":0.54100000000000004}]},{"osd":5,"last update":"Sat Jun 10 19:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.99399999999999999,"15min":1.0069999999999999},"min":{"1min":0.56899999999999995,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.474,"5min":1.536,"15min":2.024},"last":0.61699999999999999},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.038,"15min":1.0369999999999999},"min":{"1min":0.71499999999999997,"5min":0.59999999999999998,"15min":0.46899999999999997},"max":{"1min":1.3580000000000001,"5min":1.534,"15min":1.9259999999999999},"last":0.87}]},{"osd":6,"last update":"Sat Jun 10 19:07:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":1.048,"15min":1.0629999999999999},"min":{"1min":0.69799999999999995,"5min":0.56999999999999995,"15min":0.55300000000000005},"max":{"1min":1.4359999999999999,"5min":1.617,"15min":1.8500000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.0309999999999999,"15min":1.05},"min":{"1min":0.629,"5min":0.61399999999999999,"15min":0.58799999999999997},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":2.2120000000000002},"last":0.78700000000000003}]},{"osd":7,"last update":"Sat Jun 10 19:07:54 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.0580000000000001,"15min":1.081},"min":{"1min":0.66400000000000003,"5min":0.58199999999999996,"15min":0.56999999999999995},"max":{"1min":1.4139999999999999,"5min":1.5720000000000001,"15min":2.1150000000000002},"last":0.71499999999999997},{"interface":"front","average":{"1min":1.077,"5min":1.089,"15min":1.101},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.4379999999999999,"5min":1.6779999999999999,"15min":1.9850000000000001},"last":0.82699999999999996}]}]},{"osd":2,"up_from":13,"seq":55834575037,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37316,"kb_used_data":2172,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334524,"statfs":{"total":96636764160,"available":96598552576,"internally_reserved":0,"allocated":2224128,"data_stored":1036777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:07:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.63200000000000001,"15min":0.622},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.27300000000000002},"max":{"1min":0.98599999999999999,"5min":2.883,"15min":2.883},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.77600000000000002,"15min":0.74099999999999999},"min":{"1min":0.38300000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.155,"5min":6.5670000000000002,"15min":6.5670000000000002},"last":0.68100000000000005}]},{"osd":1,"last update":"Sat Jun 10 19:07:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.65500000000000003,"15min":0.66400000000000003},"min":{"1min":0.32500000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1950000000000001},"last":0.622},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.81799999999999995,"15min":0.78400000000000003},"min":{"1min":0.32900000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.0669999999999999,"5min":8.4429999999999996,"15min":8.4429999999999996},"last":1.018}]},{"osd":3,"last update":"Sat Jun 10 19:07:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.78000000000000003,"15min":0.77500000000000002},"min":{"1min":0.36299999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.0329999999999999,"5min":1.1899999999999999,"15min":1.2350000000000001},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.77500000000000002,"15min":0.78100000000000003},"min":{"1min":0.40500000000000003,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":1.143,"5min":4.1849999999999996,"15min":4.1849999999999996},"last":1.0620000000000001}]},{"osd":4,"last update":"Sat Jun 10 19:07:02 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.96199999999999997,"15min":0.93999999999999995},"min":{"1min":0.59699999999999998,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.1699999999999999,"5min":3.996,"15min":3.996},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.91900000000000004,"5min":1.1140000000000001,"15min":1.052},"min":{"1min":0.60599999999999998,"5min":0.496,"15min":0.496},"max":{"1min":1.391,"5min":13.254,"15min":13.254},"last":1.2290000000000001}]},{"osd":5,"last update":"Sat Jun 10 19:07:02 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":1.113,"15min":1.05},"min":{"1min":0.60299999999999998,"5min":0.55900000000000005,"15min":0.54100000000000004},"max":{"1min":1.2270000000000001,"5min":6.9189999999999996,"15min":6.9189999999999996},"last":1.169},{"interface":"front","average":{"1min":1.008,"5min":1.246,"15min":1.095},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.609,"5min":15.526,"15min":15.526},"last":0.91400000000000003}]},{"osd":6,"last update":"Sat Jun 10 19:07:02 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":1.1399999999999999,"15min":1.0820000000000001},"min":{"1min":0.71999999999999997,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.5009999999999999,"5min":8.7089999999999996,"15min":8.7089999999999996},"last":0.98499999999999999},{"interface":"front","average":{"1min":0.97399999999999998,"5min":1.075,"15min":1.0589999999999999},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.389,"5min":6.1299999999999999,"15min":6.1299999999999999},"last":1.204}]},{"osd":7,"last update":"Sat Jun 10 19:07:02 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.3169999999999999,"15min":1.1699999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.57199999999999995},"max":{"1min":1.4770000000000001,"5min":12.138,"15min":12.138},"last":1.2769999999999999},{"interface":"front","average":{"1min":1.054,"5min":1.099,"15min":1.109},"min":{"1min":0.65000000000000002,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.5660000000000001,"5min":1.657,"15min":1.752},"last":1.137}]}]},{"osd":1,"up_from":13,"seq":55834575039,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37300,"kb_used_data":2156,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334540,"statfs":{"total":96636764160,"available":96598568960,"internally_reserved":0,"allocated":2207744,"data_stored":1029588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:07:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.64900000000000002,"15min":0.67700000000000005},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":1.0029999999999999,"5min":1.048,"15min":1.288},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.746,"5min":0.73099999999999998,"15min":0.75},"min":{"1min":0.32300000000000001,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.615,"5min":1.615,"15min":1.694},"last":0.53300000000000003}]},{"osd":2,"last update":"Sat Jun 10 19:07:05 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.61499999999999999,"15min":0.63500000000000001},"min":{"1min":0.30099999999999999,"5min":0.29699999999999999,"15min":0.249},"max":{"1min":0.84599999999999997,"5min":1.0900000000000001,"15min":1.21},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.69299999999999995,"15min":0.72199999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.415},"last":0.76800000000000002}]},{"osd":3,"last update":"Sat Jun 10 19:07:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.73899999999999999,"15min":0.77900000000000003},"min":{"1min":0.41499999999999998,"5min":0.34000000000000002,"15min":0.25600000000000001},"max":{"1min":1.008,"5min":1.143,"15min":1.6299999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68400000000000005,"15min":0.73299999999999998},"min":{"1min":0.36099999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.083,"5min":1.2709999999999999,"15min":2.1749999999999998},"last":0.72099999999999997}]},{"osd":4,"last update":"Sat Jun 10 19:07:05 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.85099999999999998,"15min":0.86799999999999999},"min":{"1min":0.58599999999999997,"5min":0.56399999999999995,"15min":0.53000000000000003},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.4930000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.96899999999999997,"15min":1.0289999999999999},"min":{"1min":0.625,"5min":0.47299999999999998,"15min":0.47099999999999997},"max":{"1min":1.575,"5min":1.575,"15min":5.8209999999999997},"last":0.999}]},{"osd":5,"last update":"Sat Jun 10 19:07:05 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.96199999999999997,"15min":0.995},"min":{"1min":0.54800000000000004,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.415,"5min":1.5720000000000001,"15min":1.8620000000000001},"last":1.0800000000000001},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.93100000000000005,"15min":0.97699999999999998},"min":{"1min":0.60399999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.448,"5min":1.448,"15min":3.089},"last":1.0529999999999999}]},{"osd":6,"last update":"Sat Jun 10 19:07:05 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.96499999999999997,"15min":1.0449999999999999},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.292,"5min":1.4950000000000001,"15min":7.2599999999999998},"last":1.0229999999999999},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.97399999999999998,"15min":1.036},"min":{"1min":0.65800000000000003,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.542,"5min":1.6000000000000001,"15min":9.0069999999999997},"last":0.96499999999999997}]},{"osd":7,"last update":"Sat Jun 10 19:07:05 2023","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.0189999999999999,"15min":1.075},"min":{"1min":0.67000000000000004,"5min":0.58799999999999997,"15min":0.495},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":2.105},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0389999999999999,"15min":1.0800000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.526,"5min":1.526,"15min":2.2570000000000001},"last":1.1619999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575038,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37880,"kb_used_data":2736,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94333960,"statfs":{"total":96636764160,"available":96597975040,"internally_reserved":0,"allocated":2801664,"data_stored":1619956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jun 10 19:08:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.61599999999999999,"15min":0.63800000000000001},"min":{"1min":0.255,"5min":0.255,"15min":0.248},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.77400000000000002,"15min":0.80100000000000005},"min":{"1min":0.33000000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.0740000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.94299999999999995}]},{"osd":2,"last update":"Sat Jun 10 19:08:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.69299999999999995,"15min":0.71299999999999997},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.98499999999999999,"5min":1.1970000000000001,"15min":1.2829999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.63500000000000001,"15min":0.65300000000000002},"min":{"1min":0.29999999999999999,"5min":0.28699999999999998,"15min":0.245},"max":{"1min":0.90600000000000003,"5min":1.1779999999999999,"15min":1.371},"last":0.79800000000000004}]},{"osd":3,"last update":"Sat Jun 10 19:08:02 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.67000000000000004,"15min":0.68300000000000005},"min":{"1min":0.309,"5min":0.309,"15min":0.28899999999999998},"max":{"1min":1.1439999999999999,"5min":1.397,"15min":1.397},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.78200000000000003,"15min":0.81399999999999995},"min":{"1min":0.36399999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.1699999999999999,"5min":1.6240000000000001,"15min":1.829},"last":1.1699999999999999}]},{"osd":4,"last update":"Sat Jun 10 19:08:02 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.89300000000000002,"15min":0.91900000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.276,"5min":1.758,"15min":3.0209999999999999},"last":1.1060000000000001},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.997,"15min":1.02},"min":{"1min":0.56200000000000006,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.224,"5min":1.873,"15min":1.9510000000000001},"last":1.0269999999999999}]},{"osd":5,"last update":"Sat Jun 10 19:08:02 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.88300000000000001,"15min":0.92100000000000004},"min":{"1min":0.51300000000000001,"5min":0.51200000000000001,"15min":0.45100000000000001},"max":{"1min":1.226,"5min":1.252,"15min":1.694},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.95899999999999996,"15min":1.0009999999999999},"min":{"1min":0.64800000000000002,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.321,"5min":1.9870000000000001,"15min":4.5620000000000003},"last":1.2769999999999999}]},{"osd":6,"last update":"Sat Jun 10 19:08:02 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.0289999999999999,"15min":1.0700000000000001},"min":{"1min":0.63700000000000001,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.3149999999999999,"5min":1.9330000000000001,"15min":3.5569999999999999},"last":1.3149999999999999},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.98699999999999999,"15min":0.999},"min":{"1min":0.56999999999999995,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.333,"5min":1.6599999999999999,"15min":1.883},"last":1.2450000000000001}]},{"osd":7,"last update":"Sat Jun 10 19:08:02 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.995,"15min":1.024},"min":{"1min":0.627,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.502,"5min":1.804,"15min":1.804},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0369999999999999,"15min":1.0569999999999999},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.58699999999999997},"max":{"1min":1.3720000000000001,"5min":2.1219999999999999,"15min":2.1219999999999999},"last":1.351}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-10T19:08:07.952 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-10T19:08:08.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.105+0000 7ff8751a6640 1 Processor -- start 2023-06-10T19:08:08.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.105+0000 7ff8751a6640 1 -- start start 2023-06-10T19:08:08.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.105+0000 7ff8751a6640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff8700c8d00 0x7ff87006b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:08.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.105+0000 7ff8751a6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff87006bc00 0x7ff870162180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:08.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.105+0000 7ff8751a6640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff870158a90 con 0x7ff87006b2f0 2023-06-10T19:08:08.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.105+0000 7ff8751a6640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff87006f780 con 0x7ff8700c8d00 2023-06-10T19:08:08.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.105+0000 7ff8751a6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8700705d0 con 0x7ff87006bc00 2023-06-10T19:08:08.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.105+0000 7ff86e59c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff8700c8d00 0x7ff87006b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:08.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.105+0000 7ff86e59c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff8700c8d00 0x7ff87006b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36984/0 (socket says 172.21.15.53:36984) 2023-06-10T19:08:08.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.105+0000 7ff86e59c640 1 -- 172.21.15.53:0/4148457716 learned_addr learned my addr 172.21.15.53:0/4148457716 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:08:08.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.105+0000 7ff86f59e640 1 --2- 172.21.15.53:0/4148457716 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff87006bc00 0x7ff870162180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:08.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.105+0000 7ff86e59c640 1 -- 172.21.15.53:0/4148457716 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff87006bc00 msgr2=0x7ff870162180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:08.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.105+0000 7ff86e59c640 1 --2- 172.21.15.53:0/4148457716 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff87006bc00 0x7ff870162180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:08.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.105+0000 7ff86e59c640 1 -- 172.21.15.53:0/4148457716 >> v1:172.21.15.117:6789/0 conn(0x7ff87006b2f0 legacy=0x7ff87006f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:08.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.105+0000 7ff86e59c640 1 -- 172.21.15.53:0/4148457716 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8700cce10 con 0x7ff8700c8d00 2023-06-10T19:08:08.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.109+0000 7ff86e59c640 1 --2- 172.21.15.53:0/4148457716 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff8700c8d00 0x7ff87006b6c0 secure :-1 s=READY pgs=2599 cs=0 l=1 rev1=1 crypto rx=0x7ff860009870 tx=0x7ff86001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b134525cff4828d7 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:08.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.109+0000 7ff86dd9b640 1 -- 172.21.15.53:0/4148457716 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8600a89b0 con 0x7ff8700c8d00 2023-06-10T19:08:08.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.109+0000 7ff86dd9b640 1 -- 172.21.15.53:0/4148457716 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8600a8b10 con 0x7ff8700c8d00 2023-06-10T19:08:08.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.109+0000 7ff86dd9b640 1 -- 172.21.15.53:0/4148457716 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8600a8ea0 con 0x7ff8700c8d00 2023-06-10T19:08:08.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.109+0000 7ff8751a6640 1 -- 172.21.15.53:0/4148457716 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff8700c8d00 msgr2=0x7ff87006b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:08.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.109+0000 7ff8751a6640 1 --2- 172.21.15.53:0/4148457716 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff8700c8d00 0x7ff87006b6c0 secure :-1 s=READY pgs=2599 cs=0 l=1 rev1=1 crypto rx=0x7ff860009870 tx=0x7ff86001ecf0 comp rx=0 tx=0).stop 2023-06-10T19:08:08.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.109+0000 7ff8751a6640 1 -- 172.21.15.53:0/4148457716 shutdown_connections 2023-06-10T19:08:08.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.109+0000 7ff8751a6640 1 --2- 172.21.15.53:0/4148457716 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff87006bc00 0x7ff870162180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:08.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.109+0000 7ff8751a6640 1 --2- 172.21.15.53:0/4148457716 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff8700c8d00 0x7ff87006b6c0 unknown :-1 s=CLOSED pgs=2599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:08.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.109+0000 7ff8751a6640 1 -- 172.21.15.53:0/4148457716 >> 172.21.15.53:0/4148457716 conn(0x7ff87006a0d0 msgr2=0x7ff8700ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:08.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.109+0000 7ff8751a6640 1 -- 172.21.15.53:0/4148457716 shutdown_connections 2023-06-10T19:08:08.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.109+0000 7ff8751a6640 1 -- 172.21.15.53:0/4148457716 wait complete. 2023-06-10T19:08:08.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.109+0000 7ff8751a6640 1 Processor -- start 2023-06-10T19:08:08.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.109+0000 7ff8751a6640 1 -- start start 2023-06-10T19:08:08.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.109+0000 7ff8751a6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff87006b2f0 0x7ff8701f0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:08.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.109+0000 7ff8751a6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff87006bc00 0x7ff87015b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:08.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.109+0000 7ff8751a6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8700c8d00 0x7ff8700cdc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:08.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.109+0000 7ff8751a6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8700b0c70 con 0x7ff87006b2f0 2023-06-10T19:08:08.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.109+0000 7ff8751a6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8700c4f80 con 0x7ff8700c8d00 2023-06-10T19:08:08.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.109+0000 7ff8751a6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff870151ab0 con 0x7ff87006bc00 2023-06-10T19:08:08.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.109+0000 7ff86ed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff87006b2f0 0x7ff8701f0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:08.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.109+0000 7ff86ed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff87006b2f0 0x7ff8701f0ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:36990/0 (socket says 172.21.15.53:36990) 2023-06-10T19:08:08.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.109+0000 7ff86ed9d640 1 -- 172.21.15.53:0/2288807557 learned_addr learned my addr 172.21.15.53:0/2288807557 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:08:08.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.109+0000 7ff86f59e640 1 --2- 172.21.15.53:0/2288807557 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8700c8d00 0x7ff8700cdc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:08.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.109+0000 7ff86ed9d640 1 -- 172.21.15.53:0/2288807557 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff87006bc00 msgr2=0x7ff87015b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:08.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.109+0000 7ff86e59c640 1 --2- 172.21.15.53:0/2288807557 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff87006bc00 0x7ff87015b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:08.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.109+0000 7ff86ed9d640 1 --2- 172.21.15.53:0/2288807557 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff87006bc00 0x7ff87015b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:08.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.109+0000 7ff86ed9d640 1 -- 172.21.15.53:0/2288807557 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8700c8d00 msgr2=0x7ff8700cdc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:08.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.109+0000 7ff86ed9d640 1 --2- 172.21.15.53:0/2288807557 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8700c8d00 0x7ff8700cdc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:08.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.109+0000 7ff86ed9d640 1 -- 172.21.15.53:0/2288807557 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8600094d0 con 0x7ff87006b2f0 2023-06-10T19:08:08.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.109+0000 7ff86f59e640 1 --2- 172.21.15.53:0/2288807557 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8700c8d00 0x7ff8700cdc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:08:08.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.113+0000 7ff86ed9d640 1 --2- 172.21.15.53:0/2288807557 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff87006b2f0 0x7ff8701f0ce0 secure :-1 s=READY pgs=2600 cs=0 l=1 rev1=1 crypto rx=0x7ff86400c480 tx=0x7ff86400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:08.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.113+0000 7ff8577fe640 1 -- 172.21.15.53:0/2288807557 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff864012830 con 0x7ff87006b2f0 2023-06-10T19:08:08.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.113+0000 7ff8577fe640 1 -- 172.21.15.53:0/2288807557 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8640129b0 con 0x7ff87006b2f0 2023-06-10T19:08:08.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.113+0000 7ff8577fe640 1 -- 172.21.15.53:0/2288807557 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff864012d60 con 0x7ff87006b2f0 2023-06-10T19:08:08.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.113+0000 7ff8751a6640 1 -- 172.21.15.53:0/2288807557 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff870155ca0 con 0x7ff87006b2f0 2023-06-10T19:08:08.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.113+0000 7ff8751a6640 1 -- 172.21.15.53:0/2288807557 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff870155f40 con 0x7ff87006b2f0 2023-06-10T19:08:08.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.113+0000 7ff8751a6640 1 -- 172.21.15.53:0/2288807557 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff87004d790 con 0x7ff87006b2f0 2023-06-10T19:08:08.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.113+0000 7ff8577fe640 1 -- 172.21.15.53:0/2288807557 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff86401c460 con 0x7ff87006b2f0 2023-06-10T19:08:08.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.113+0000 7ff8577fe640 1 --2- 172.21.15.53:0/2288807557 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff85c066280 0x7ff85c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:08.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.113+0000 7ff8577fe640 1 -- 172.21.15.53:0/2288807557 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff864083c20 con 0x7ff87006b2f0 2023-06-10T19:08:08.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.113+0000 7ff86e59c640 1 --2- 172.21.15.53:0/2288807557 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff85c066280 0x7ff85c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:08.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.113+0000 7ff86e59c640 1 --2- 172.21.15.53:0/2288807557 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff85c066280 0x7ff85c068730 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7ff8600b2000 tx=0x7ff8600aa070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:08.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.117+0000 7ff8577fe640 1 -- 172.21.15.53:0/2288807557 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff864054bc0 con 0x7ff87006b2f0 2023-06-10T19:08:08.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.265+0000 7ff8751a6640 1 -- 172.21.15.53:0/2288807557 --> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff87006fca0 con 0x7ff85c066280 2023-06-10T19:08:08.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.285+0000 7ff8577fe640 1 -- 172.21.15.53:0/2288807557 <== mgr.4105 v2:172.21.15.117:6832/3061986771 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310419 (secure 0 0 0) 0x7ff8600a8930 con 0x7ff85c066280 2023-06-10T19:08:08.294 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:08:08.295 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-06-10T19:08:08.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.289+0000 7ff8751a6640 1 -- 172.21.15.53:0/2288807557 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff85c066280 msgr2=0x7ff85c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:08.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.289+0000 7ff8751a6640 1 --2- 172.21.15.53:0/2288807557 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff85c066280 0x7ff85c068730 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7ff8600b2000 tx=0x7ff8600aa070 comp rx=0 tx=0).stop 2023-06-10T19:08:08.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.289+0000 7ff8751a6640 1 -- 172.21.15.53:0/2288807557 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff87006b2f0 msgr2=0x7ff8701f0ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:08.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.289+0000 7ff8751a6640 1 --2- 172.21.15.53:0/2288807557 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff87006b2f0 0x7ff8701f0ce0 secure :-1 s=READY pgs=2600 cs=0 l=1 rev1=1 crypto rx=0x7ff86400c480 tx=0x7ff86400c940 comp rx=0 tx=0).stop 2023-06-10T19:08:08.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.289+0000 7ff8751a6640 1 -- 172.21.15.53:0/2288807557 shutdown_connections 2023-06-10T19:08:08.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.289+0000 7ff8751a6640 1 --2- 172.21.15.53:0/2288807557 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7ff85c066280 0x7ff85c068730 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:08.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.289+0000 7ff8751a6640 1 --2- 172.21.15.53:0/2288807557 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8700c8d00 0x7ff8700cdc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:08.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.289+0000 7ff8751a6640 1 --2- 172.21.15.53:0/2288807557 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff87006bc00 0x7ff87015b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:08.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.289+0000 7ff8751a6640 1 --2- 172.21.15.53:0/2288807557 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff87006b2f0 0x7ff8701f0ce0 unknown :-1 s=CLOSED pgs=2600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:08.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.289+0000 7ff8751a6640 1 -- 172.21.15.53:0/2288807557 >> 172.21.15.53:0/2288807557 conn(0x7ff87006a0d0 msgr2=0x7ff8700b0100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:08.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.289+0000 7ff8751a6640 1 -- 172.21.15.53:0/2288807557 shutdown_connections 2023-06-10T19:08:08.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.293+0000 7ff8751a6640 1 -- 172.21.15.53:0/2288807557 wait complete. 2023-06-10T19:08:08.311 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":641,"stamp":"2023-06-10T19:08:07.921368+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":189,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":283644,"kb_used_data":18876,"kb_used_omap":0,"kb_used_meta":264704,"kb_avail":754691076,"statfs":{"total":773094113280,"available":772803661824,"internally_reserved":0,"allocated":19329024,"data_stored":9639891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":271056896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":70,"apply_latency_ms":70,"commit_latency_ns":70000000,"apply_latency_ns":70000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.796407"},"pg_stats":[{"pgid":"26.3f","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.439690+0000","last_change":"2023-06-10T19:08:03.575556+0000","last_active":"2023-06-10T19:08:05.439690+0000","last_peered":"2023-06-10T19:08:05.439690+0000","last_clean":"2023-06-10T19:08:05.439690+0000","last_became_active":"2023-06-10T19:08:03.575222+0000","last_became_peered":"2023-06-10T19:08:03.575222+0000","last_unstale":"2023-06-10T19:08:05.439690+0000","last_undegraded":"2023-06-10T19:08:05.439690+0000","last_fullsized":"2023-06-10T19:08:05.439690+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:22:30.167111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3e","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.441217+0000","last_change":"2023-06-10T19:08:03.581644+0000","last_active":"2023-06-10T19:08:05.441217+0000","last_peered":"2023-06-10T19:08:05.441217+0000","last_clean":"2023-06-10T19:08:05.441217+0000","last_became_active":"2023-06-10T19:08:03.581353+0000","last_became_peered":"2023-06-10T19:08:03.581353+0000","last_unstale":"2023-06-10T19:08:05.441217+0000","last_undegraded":"2023-06-10T19:08:05.441217+0000","last_fullsized":"2023-06-10T19:08:05.441217+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:34:20.169478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3d","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.244396+0000","last_change":"2023-06-10T19:08:03.557650+0000","last_active":"2023-06-10T19:08:05.244396+0000","last_peered":"2023-06-10T19:08:05.244396+0000","last_clean":"2023-06-10T19:08:05.244396+0000","last_became_active":"2023-06-10T19:08:03.556913+0000","last_became_peered":"2023-06-10T19:08:03.556913+0000","last_unstale":"2023-06-10T19:08:05.244396+0000","last_undegraded":"2023-06-10T19:08:05.244396+0000","last_fullsized":"2023-06-10T19:08:05.244396+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:38:21.683477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.3c","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.440951+0000","last_change":"2023-06-10T19:08:03.572223+0000","last_active":"2023-06-10T19:08:05.440951+0000","last_peered":"2023-06-10T19:08:05.440951+0000","last_clean":"2023-06-10T19:08:05.440951+0000","last_became_active":"2023-06-10T19:08:03.571913+0000","last_became_peered":"2023-06-10T19:08:03.571913+0000","last_unstale":"2023-06-10T19:08:05.440951+0000","last_undegraded":"2023-06-10T19:08:05.440951+0000","last_fullsized":"2023-06-10T19:08:05.440951+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:11:05.679837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.3b","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.439104+0000","last_change":"2023-06-10T19:08:03.555093+0000","last_active":"2023-06-10T19:08:05.439104+0000","last_peered":"2023-06-10T19:08:05.439104+0000","last_clean":"2023-06-10T19:08:05.439104+0000","last_became_active":"2023-06-10T19:08:03.554763+0000","last_became_peered":"2023-06-10T19:08:03.554763+0000","last_unstale":"2023-06-10T19:08:05.439104+0000","last_undegraded":"2023-06-10T19:08:05.439104+0000","last_fullsized":"2023-06-10T19:08:05.439104+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:39:08.089129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.3a","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.438595+0000","last_change":"2023-06-10T19:08:03.543709+0000","last_active":"2023-06-10T19:08:05.438595+0000","last_peered":"2023-06-10T19:08:05.438595+0000","last_clean":"2023-06-10T19:08:05.438595+0000","last_became_active":"2023-06-10T19:08:03.543432+0000","last_became_peered":"2023-06-10T19:08:03.543432+0000","last_unstale":"2023-06-10T19:08:05.438595+0000","last_undegraded":"2023-06-10T19:08:05.438595+0000","last_fullsized":"2023-06-10T19:08:05.438595+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:27:03.026315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.39","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.533417+0000","last_change":"2023-06-10T19:08:03.574642+0000","last_active":"2023-06-10T19:08:04.533417+0000","last_peered":"2023-06-10T19:08:04.533417+0000","last_clean":"2023-06-10T19:08:04.533417+0000","last_became_active":"2023-06-10T19:08:03.574385+0000","last_became_peered":"2023-06-10T19:08:03.574385+0000","last_unstale":"2023-06-10T19:08:04.533417+0000","last_undegraded":"2023-06-10T19:08:04.533417+0000","last_fullsized":"2023-06-10T19:08:04.533417+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:15:50.917829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.38","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.437562+0000","last_change":"2023-06-10T19:08:03.589461+0000","last_active":"2023-06-10T19:08:05.437562+0000","last_peered":"2023-06-10T19:08:05.437562+0000","last_clean":"2023-06-10T19:08:05.437562+0000","last_became_active":"2023-06-10T19:08:03.588966+0000","last_became_peered":"2023-06-10T19:08:03.588966+0000","last_unstale":"2023-06-10T19:08:05.437562+0000","last_undegraded":"2023-06-10T19:08:05.437562+0000","last_fullsized":"2023-06-10T19:08:05.437562+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:51:35.859527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.37","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.440062+0000","last_change":"2023-06-10T19:08:03.568419+0000","last_active":"2023-06-10T19:08:05.440062+0000","last_peered":"2023-06-10T19:08:05.440062+0000","last_clean":"2023-06-10T19:08:05.440062+0000","last_became_active":"2023-06-10T19:08:03.568097+0000","last_became_peered":"2023-06-10T19:08:03.568097+0000","last_unstale":"2023-06-10T19:08:05.440062+0000","last_undegraded":"2023-06-10T19:08:05.440062+0000","last_fullsized":"2023-06-10T19:08:05.440062+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:55:46.751696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.36","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.439403+0000","last_change":"2023-06-10T19:08:03.565351+0000","last_active":"2023-06-10T19:08:05.439403+0000","last_peered":"2023-06-10T19:08:05.439403+0000","last_clean":"2023-06-10T19:08:05.439403+0000","last_became_active":"2023-06-10T19:08:03.565034+0000","last_became_peered":"2023-06-10T19:08:03.565034+0000","last_unstale":"2023-06-10T19:08:05.439403+0000","last_undegraded":"2023-06-10T19:08:05.439403+0000","last_fullsized":"2023-06-10T19:08:05.439403+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:31:39.270453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.35","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.539365+0000","last_change":"2023-06-10T19:08:03.570891+0000","last_active":"2023-06-10T19:08:04.539365+0000","last_peered":"2023-06-10T19:08:04.539365+0000","last_clean":"2023-06-10T19:08:04.539365+0000","last_became_active":"2023-06-10T19:08:03.569883+0000","last_became_peered":"2023-06-10T19:08:03.569883+0000","last_unstale":"2023-06-10T19:08:04.539365+0000","last_undegraded":"2023-06-10T19:08:04.539365+0000","last_fullsized":"2023-06-10T19:08:04.539365+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:12:08.569775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.34","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.441338+0000","last_change":"2023-06-10T19:08:03.574028+0000","last_active":"2023-06-10T19:08:05.441338+0000","last_peered":"2023-06-10T19:08:05.441338+0000","last_clean":"2023-06-10T19:08:05.441338+0000","last_became_active":"2023-06-10T19:08:03.573632+0000","last_became_peered":"2023-06-10T19:08:03.573632+0000","last_unstale":"2023-06-10T19:08:05.441338+0000","last_undegraded":"2023-06-10T19:08:05.441338+0000","last_fullsized":"2023-06-10T19:08:05.441338+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:30:36.830089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.33","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.536731+0000","last_change":"2023-06-10T19:08:03.566388+0000","last_active":"2023-06-10T19:08:04.536731+0000","last_peered":"2023-06-10T19:08:04.536731+0000","last_clean":"2023-06-10T19:08:04.536731+0000","last_became_active":"2023-06-10T19:08:03.565605+0000","last_became_peered":"2023-06-10T19:08:03.565605+0000","last_unstale":"2023-06-10T19:08:04.536731+0000","last_undegraded":"2023-06-10T19:08:04.536731+0000","last_fullsized":"2023-06-10T19:08:04.536731+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:45:00.452073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.32","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.533578+0000","last_change":"2023-06-10T19:08:03.580410+0000","last_active":"2023-06-10T19:08:04.533578+0000","last_peered":"2023-06-10T19:08:04.533578+0000","last_clean":"2023-06-10T19:08:04.533578+0000","last_became_active":"2023-06-10T19:08:03.580054+0000","last_became_peered":"2023-06-10T19:08:03.580054+0000","last_unstale":"2023-06-10T19:08:04.533578+0000","last_undegraded":"2023-06-10T19:08:04.533578+0000","last_fullsized":"2023-06-10T19:08:04.533578+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:30:47.377068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.31","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.442464+0000","last_change":"2023-06-10T19:08:03.580205+0000","last_active":"2023-06-10T19:08:05.442464+0000","last_peered":"2023-06-10T19:08:05.442464+0000","last_clean":"2023-06-10T19:08:05.442464+0000","last_became_active":"2023-06-10T19:08:03.579926+0000","last_became_peered":"2023-06-10T19:08:03.579926+0000","last_unstale":"2023-06-10T19:08:05.442464+0000","last_undegraded":"2023-06-10T19:08:05.442464+0000","last_fullsized":"2023-06-10T19:08:05.442464+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:49:07.876093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.30","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.438171+0000","last_change":"2023-06-10T19:08:03.555133+0000","last_active":"2023-06-10T19:08:05.438171+0000","last_peered":"2023-06-10T19:08:05.438171+0000","last_clean":"2023-06-10T19:08:05.438171+0000","last_became_active":"2023-06-10T19:08:03.554673+0000","last_became_peered":"2023-06-10T19:08:03.554673+0000","last_unstale":"2023-06-10T19:08:05.438171+0000","last_undegraded":"2023-06-10T19:08:05.438171+0000","last_fullsized":"2023-06-10T19:08:05.438171+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:31:28.670042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2f","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.440201+0000","last_change":"2023-06-10T19:08:03.575364+0000","last_active":"2023-06-10T19:08:05.440201+0000","last_peered":"2023-06-10T19:08:05.440201+0000","last_clean":"2023-06-10T19:08:05.440201+0000","last_became_active":"2023-06-10T19:08:03.575031+0000","last_became_peered":"2023-06-10T19:08:03.575031+0000","last_unstale":"2023-06-10T19:08:05.440201+0000","last_undegraded":"2023-06-10T19:08:05.440201+0000","last_fullsized":"2023-06-10T19:08:05.440201+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:47:14.294710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2e","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.538823+0000","last_change":"2023-06-10T19:08:03.564127+0000","last_active":"2023-06-10T19:08:04.538823+0000","last_peered":"2023-06-10T19:08:04.538823+0000","last_clean":"2023-06-10T19:08:04.538823+0000","last_became_active":"2023-06-10T19:08:03.561654+0000","last_became_peered":"2023-06-10T19:08:03.561654+0000","last_unstale":"2023-06-10T19:08:04.538823+0000","last_undegraded":"2023-06-10T19:08:04.538823+0000","last_fullsized":"2023-06-10T19:08:04.538823+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:17:19.866920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.2d","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.538139+0000","last_change":"2023-06-10T19:08:03.559671+0000","last_active":"2023-06-10T19:08:04.538139+0000","last_peered":"2023-06-10T19:08:04.538139+0000","last_clean":"2023-06-10T19:08:04.538139+0000","last_became_active":"2023-06-10T19:08:03.558832+0000","last_became_peered":"2023-06-10T19:08:03.558832+0000","last_unstale":"2023-06-10T19:08:04.538139+0000","last_undegraded":"2023-06-10T19:08:04.538139+0000","last_fullsized":"2023-06-10T19:08:04.538139+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:48:27.658228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.2c","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.438604+0000","last_change":"2023-06-10T19:08:03.573437+0000","last_active":"2023-06-10T19:08:05.438604+0000","last_peered":"2023-06-10T19:08:05.438604+0000","last_clean":"2023-06-10T19:08:05.438604+0000","last_became_active":"2023-06-10T19:08:03.573206+0000","last_became_peered":"2023-06-10T19:08:03.573206+0000","last_unstale":"2023-06-10T19:08:05.438604+0000","last_undegraded":"2023-06-10T19:08:05.438604+0000","last_fullsized":"2023-06-10T19:08:05.438604+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:30:19.348632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2b","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.442485+0000","last_change":"2023-06-10T19:08:03.568604+0000","last_active":"2023-06-10T19:08:05.442485+0000","last_peered":"2023-06-10T19:08:05.442485+0000","last_clean":"2023-06-10T19:08:05.442485+0000","last_became_active":"2023-06-10T19:08:03.568366+0000","last_became_peered":"2023-06-10T19:08:03.568366+0000","last_unstale":"2023-06-10T19:08:05.442485+0000","last_undegraded":"2023-06-10T19:08:05.442485+0000","last_fullsized":"2023-06-10T19:08:05.442485+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:40:21.429277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.2a","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.440306+0000","last_change":"2023-06-10T19:08:03.568151+0000","last_active":"2023-06-10T19:08:05.440306+0000","last_peered":"2023-06-10T19:08:05.440306+0000","last_clean":"2023-06-10T19:08:05.440306+0000","last_became_active":"2023-06-10T19:08:03.567926+0000","last_became_peered":"2023-06-10T19:08:03.567926+0000","last_unstale":"2023-06-10T19:08:05.440306+0000","last_undegraded":"2023-06-10T19:08:05.440306+0000","last_fullsized":"2023-06-10T19:08:05.440306+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:05:36.667178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.29","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.437662+0000","last_change":"2023-06-10T19:08:03.573925+0000","last_active":"2023-06-10T19:08:05.437662+0000","last_peered":"2023-06-10T19:08:05.437662+0000","last_clean":"2023-06-10T19:08:05.437662+0000","last_became_active":"2023-06-10T19:08:03.572886+0000","last_became_peered":"2023-06-10T19:08:03.572886+0000","last_unstale":"2023-06-10T19:08:05.437662+0000","last_undegraded":"2023-06-10T19:08:05.437662+0000","last_fullsized":"2023-06-10T19:08:05.437662+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:28:24.324507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.28","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.440520+0000","last_change":"2023-06-10T19:08:03.561608+0000","last_active":"2023-06-10T19:08:05.440520+0000","last_peered":"2023-06-10T19:08:05.440520+0000","last_clean":"2023-06-10T19:08:05.440520+0000","last_became_active":"2023-06-10T19:08:03.561249+0000","last_became_peered":"2023-06-10T19:08:03.561249+0000","last_unstale":"2023-06-10T19:08:05.440520+0000","last_undegraded":"2023-06-10T19:08:05.440520+0000","last_fullsized":"2023-06-10T19:08:05.440520+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:57:21.820651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.27","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.534214+0000","last_change":"2023-06-10T19:08:03.538974+0000","last_active":"2023-06-10T19:08:04.534214+0000","last_peered":"2023-06-10T19:08:04.534214+0000","last_clean":"2023-06-10T19:08:04.534214+0000","last_became_active":"2023-06-10T19:08:03.538215+0000","last_became_peered":"2023-06-10T19:08:03.538215+0000","last_unstale":"2023-06-10T19:08:04.534214+0000","last_undegraded":"2023-06-10T19:08:04.534214+0000","last_fullsized":"2023-06-10T19:08:04.534214+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:40:29.723633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.26","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.539663+0000","last_change":"2023-06-10T19:08:03.577904+0000","last_active":"2023-06-10T19:08:04.539663+0000","last_peered":"2023-06-10T19:08:04.539663+0000","last_clean":"2023-06-10T19:08:04.539663+0000","last_became_active":"2023-06-10T19:08:03.577155+0000","last_became_peered":"2023-06-10T19:08:03.577155+0000","last_unstale":"2023-06-10T19:08:04.539663+0000","last_undegraded":"2023-06-10T19:08:04.539663+0000","last_fullsized":"2023-06-10T19:08:04.539663+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:34:20.169478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.25","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.437985+0000","last_change":"2023-06-10T19:08:03.573553+0000","last_active":"2023-06-10T19:08:05.437985+0000","last_peered":"2023-06-10T19:08:05.437985+0000","last_clean":"2023-06-10T19:08:05.437985+0000","last_became_active":"2023-06-10T19:08:03.572800+0000","last_became_peered":"2023-06-10T19:08:03.572800+0000","last_unstale":"2023-06-10T19:08:05.437985+0000","last_undegraded":"2023-06-10T19:08:05.437985+0000","last_fullsized":"2023-06-10T19:08:05.437985+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:48:58.816840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.24","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.438977+0000","last_change":"2023-06-10T19:08:03.555667+0000","last_active":"2023-06-10T19:08:05.438977+0000","last_peered":"2023-06-10T19:08:05.438977+0000","last_clean":"2023-06-10T19:08:05.438977+0000","last_became_active":"2023-06-10T19:08:03.555316+0000","last_became_peered":"2023-06-10T19:08:03.555316+0000","last_unstale":"2023-06-10T19:08:05.438977+0000","last_undegraded":"2023-06-10T19:08:05.438977+0000","last_fullsized":"2023-06-10T19:08:05.438977+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:57:21.587517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.23","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.538457+0000","last_change":"2023-06-10T19:08:03.553590+0000","last_active":"2023-06-10T19:08:04.538457+0000","last_peered":"2023-06-10T19:08:04.538457+0000","last_clean":"2023-06-10T19:08:04.538457+0000","last_became_active":"2023-06-10T19:08:03.551783+0000","last_became_peered":"2023-06-10T19:08:03.551783+0000","last_unstale":"2023-06-10T19:08:04.538457+0000","last_undegraded":"2023-06-10T19:08:04.538457+0000","last_fullsized":"2023-06-10T19:08:04.538457+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:38:26.169391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.22","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.537993+0000","last_change":"2023-06-10T19:08:03.569975+0000","last_active":"2023-06-10T19:08:04.537993+0000","last_peered":"2023-06-10T19:08:04.537993+0000","last_clean":"2023-06-10T19:08:04.537993+0000","last_became_active":"2023-06-10T19:08:03.568233+0000","last_became_peered":"2023-06-10T19:08:03.568233+0000","last_unstale":"2023-06-10T19:08:04.537993+0000","last_undegraded":"2023-06-10T19:08:04.537993+0000","last_fullsized":"2023-06-10T19:08:04.537993+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:33:41.215605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.21","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.533437+0000","last_change":"2023-06-10T19:08:03.545664+0000","last_active":"2023-06-10T19:08:04.533437+0000","last_peered":"2023-06-10T19:08:04.533437+0000","last_clean":"2023-06-10T19:08:04.533437+0000","last_became_active":"2023-06-10T19:08:03.545054+0000","last_became_peered":"2023-06-10T19:08:03.545054+0000","last_unstale":"2023-06-10T19:08:04.533437+0000","last_undegraded":"2023-06-10T19:08:04.533437+0000","last_fullsized":"2023-06-10T19:08:04.533437+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:41:32.159172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.20","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.438211+0000","last_change":"2023-06-10T19:08:03.565435+0000","last_active":"2023-06-10T19:08:05.438211+0000","last_peered":"2023-06-10T19:08:05.438211+0000","last_clean":"2023-06-10T19:08:05.438211+0000","last_became_active":"2023-06-10T19:08:03.565058+0000","last_became_peered":"2023-06-10T19:08:03.565058+0000","last_unstale":"2023-06-10T19:08:05.438211+0000","last_undegraded":"2023-06-10T19:08:05.438211+0000","last_fullsized":"2023-06-10T19:08:05.438211+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:55:18.316485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.438484+0000","last_change":"2023-06-10T19:08:03.587092+0000","last_active":"2023-06-10T19:08:05.438484+0000","last_peered":"2023-06-10T19:08:05.438484+0000","last_clean":"2023-06-10T19:08:05.438484+0000","last_became_active":"2023-06-10T19:08:03.586512+0000","last_became_peered":"2023-06-10T19:08:03.586512+0000","last_unstale":"2023-06-10T19:08:05.438484+0000","last_undegraded":"2023-06-10T19:08:05.438484+0000","last_fullsized":"2023-06-10T19:08:05.438484+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:12:33.443180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":13,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.439645+0000","last_change":"2023-06-10T19:08:03.165918+0000","last_active":"2023-06-10T19:08:05.439645+0000","last_peered":"2023-06-10T19:08:05.439645+0000","last_clean":"2023-06-10T19:08:05.439645+0000","last_became_active":"2023-06-10T19:08:03.165648+0000","last_became_peered":"2023-06-10T19:08:03.165648+0000","last_unstale":"2023-06-10T19:08:05.439645+0000","last_undegraded":"2023-06-10T19:08:05.439645+0000","last_fullsized":"2023-06-10T19:08:05.439645+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:14:55.405382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.15","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.439404+0000","last_change":"2023-06-10T19:08:03.541744+0000","last_active":"2023-06-10T19:08:05.439404+0000","last_peered":"2023-06-10T19:08:05.439404+0000","last_clean":"2023-06-10T19:08:05.439404+0000","last_became_active":"2023-06-10T19:08:03.541471+0000","last_became_peered":"2023-06-10T19:08:03.541471+0000","last_unstale":"2023-06-10T19:08:05.439404+0000","last_undegraded":"2023-06-10T19:08:05.439404+0000","last_fullsized":"2023-06-10T19:08:05.439404+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:02:50.763622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":13,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.441547+0000","last_change":"2023-06-10T19:08:03.173587+0000","last_active":"2023-06-10T19:08:05.441547+0000","last_peered":"2023-06-10T19:08:05.441547+0000","last_clean":"2023-06-10T19:08:05.441547+0000","last_became_active":"2023-06-10T19:08:03.172734+0000","last_became_peered":"2023-06-10T19:08:03.172734+0000","last_unstale":"2023-06-10T19:08:05.441547+0000","last_undegraded":"2023-06-10T19:08:05.441547+0000","last_fullsized":"2023-06-10T19:08:05.441547+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:11:48.025518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.538959+0000","last_change":"2023-06-10T19:08:03.563803+0000","last_active":"2023-06-10T19:08:04.538959+0000","last_peered":"2023-06-10T19:08:04.538959+0000","last_clean":"2023-06-10T19:08:04.538959+0000","last_became_active":"2023-06-10T19:08:03.560647+0000","last_became_peered":"2023-06-10T19:08:03.560647+0000","last_unstale":"2023-06-10T19:08:04.538959+0000","last_undegraded":"2023-06-10T19:08:04.538959+0000","last_fullsized":"2023-06-10T19:08:04.538959+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:16:21.139311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.15","version":"179'3","reported_seq":16,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.441891+0000","last_change":"2023-06-10T19:08:03.172100+0000","last_active":"2023-06-10T19:08:05.441891+0000","last_peered":"2023-06-10T19:08:05.441891+0000","last_clean":"2023-06-10T19:08:05.441891+0000","last_became_active":"2023-06-10T19:08:03.171685+0000","last_became_peered":"2023-06-10T19:08:03.171685+0000","last_unstale":"2023-06-10T19:08:05.441891+0000","last_undegraded":"2023-06-10T19:08:05.441891+0000","last_fullsized":"2023-06-10T19:08:05.441891+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:01:47.213952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.440445+0000","last_change":"2023-06-10T19:08:03.589150+0000","last_active":"2023-06-10T19:08:05.440445+0000","last_peered":"2023-06-10T19:08:05.440445+0000","last_clean":"2023-06-10T19:08:05.440445+0000","last_became_active":"2023-06-10T19:08:03.588891+0000","last_became_peered":"2023-06-10T19:08:03.588891+0000","last_unstale":"2023-06-10T19:08:05.440445+0000","last_undegraded":"2023-06-10T19:08:05.440445+0000","last_fullsized":"2023-06-10T19:08:05.440445+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:33:41.215605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.14","version":"179'6","reported_seq":19,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.537765+0000","last_change":"2023-06-10T19:08:03.155402+0000","last_active":"2023-06-10T19:08:04.537765+0000","last_peered":"2023-06-10T19:08:04.537765+0000","last_clean":"2023-06-10T19:08:04.537765+0000","last_became_active":"2023-06-10T19:08:03.154654+0000","last_became_peered":"2023-06-10T19:08:03.154654+0000","last_unstale":"2023-06-10T19:08:04.537765+0000","last_undegraded":"2023-06-10T19:08:04.537765+0000","last_fullsized":"2023-06-10T19:08:04.537765+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:42:56.995551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.10","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.533417+0000","last_change":"2023-06-10T19:08:03.563146+0000","last_active":"2023-06-10T19:08:04.533417+0000","last_peered":"2023-06-10T19:08:04.533417+0000","last_clean":"2023-06-10T19:08:04.533417+0000","last_became_active":"2023-06-10T19:08:03.562731+0000","last_became_peered":"2023-06-10T19:08:03.562731+0000","last_unstale":"2023-06-10T19:08:04.533417+0000","last_undegraded":"2023-06-10T19:08:04.533417+0000","last_fullsized":"2023-06-10T19:08:04.533417+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:33:16.922895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.13","version":"179'2","reported_seq":15,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.537152+0000","last_change":"2023-06-10T19:08:03.159168+0000","last_active":"2023-06-10T19:08:04.537152+0000","last_peered":"2023-06-10T19:08:04.537152+0000","last_clean":"2023-06-10T19:08:04.537152+0000","last_became_active":"2023-06-10T19:08:03.158413+0000","last_became_peered":"2023-06-10T19:08:03.158413+0000","last_unstale":"2023-06-10T19:08:04.537152+0000","last_undegraded":"2023-06-10T19:08:04.537152+0000","last_fullsized":"2023-06-10T19:08:04.537152+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:56:25.089543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.438011+0000","last_change":"2023-06-10T19:08:03.561865+0000","last_active":"2023-06-10T19:08:05.438011+0000","last_peered":"2023-06-10T19:08:05.438011+0000","last_clean":"2023-06-10T19:08:05.438011+0000","last_became_active":"2023-06-10T19:08:03.561538+0000","last_became_peered":"2023-06-10T19:08:03.561538+0000","last_unstale":"2023-06-10T19:08:05.438011+0000","last_undegraded":"2023-06-10T19:08:05.438011+0000","last_fullsized":"2023-06-10T19:08:05.438011+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:58:02.015111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":13,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.440897+0000","last_change":"2023-06-10T19:08:03.176624+0000","last_active":"2023-06-10T19:08:05.440897+0000","last_peered":"2023-06-10T19:08:05.440897+0000","last_clean":"2023-06-10T19:08:05.440897+0000","last_became_active":"2023-06-10T19:08:03.176279+0000","last_became_peered":"2023-06-10T19:08:03.176279+0000","last_unstale":"2023-06-10T19:08:05.440897+0000","last_undegraded":"2023-06-10T19:08:05.440897+0000","last_fullsized":"2023-06-10T19:08:05.440897+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:29:28.946876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.536731+0000","last_change":"2023-06-10T19:08:03.559686+0000","last_active":"2023-06-10T19:08:04.536731+0000","last_peered":"2023-06-10T19:08:04.536731+0000","last_clean":"2023-06-10T19:08:04.536731+0000","last_became_active":"2023-06-10T19:08:03.559011+0000","last_became_peered":"2023-06-10T19:08:03.559011+0000","last_unstale":"2023-06-10T19:08:04.536731+0000","last_undegraded":"2023-06-10T19:08:04.536731+0000","last_fullsized":"2023-06-10T19:08:04.536731+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:12:02.243967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":13,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.440895+0000","last_change":"2023-06-10T19:08:03.167973+0000","last_active":"2023-06-10T19:08:05.440895+0000","last_peered":"2023-06-10T19:08:05.440895+0000","last_clean":"2023-06-10T19:08:05.440895+0000","last_became_active":"2023-06-10T19:08:03.167618+0000","last_became_peered":"2023-06-10T19:08:03.167618+0000","last_unstale":"2023-06-10T19:08:05.440895+0000","last_undegraded":"2023-06-10T19:08:05.440895+0000","last_fullsized":"2023-06-10T19:08:05.440895+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:44:05.276389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.537175+0000","last_change":"2023-06-10T19:08:03.564884+0000","last_active":"2023-06-10T19:08:04.537175+0000","last_peered":"2023-06-10T19:08:04.537175+0000","last_clean":"2023-06-10T19:08:04.537175+0000","last_became_active":"2023-06-10T19:08:03.562409+0000","last_became_peered":"2023-06-10T19:08:03.562409+0000","last_unstale":"2023-06-10T19:08:04.537175+0000","last_undegraded":"2023-06-10T19:08:04.537175+0000","last_fullsized":"2023-06-10T19:08:04.537175+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:19:50.039523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.10","version":"179'8","reported_seq":21,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.537569+0000","last_change":"2023-06-10T19:08:03.162903+0000","last_active":"2023-06-10T19:08:04.537569+0000","last_peered":"2023-06-10T19:08:04.537569+0000","last_clean":"2023-06-10T19:08:04.537569+0000","last_became_active":"2023-06-10T19:08:03.162152+0000","last_became_peered":"2023-06-10T19:08:03.162152+0000","last_unstale":"2023-06-10T19:08:04.537569+0000","last_undegraded":"2023-06-10T19:08:04.537569+0000","last_fullsized":"2023-06-10T19:08:04.537569+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:05:35.663553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.533712+0000","last_change":"2023-06-10T19:08:03.544622+0000","last_active":"2023-06-10T19:08:04.533712+0000","last_peered":"2023-06-10T19:08:04.533712+0000","last_clean":"2023-06-10T19:08:04.533712+0000","last_became_active":"2023-06-10T19:08:03.544279+0000","last_became_peered":"2023-06-10T19:08:03.544279+0000","last_unstale":"2023-06-10T19:08:04.533712+0000","last_undegraded":"2023-06-10T19:08:04.533712+0000","last_fullsized":"2023-06-10T19:08:04.533712+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:54:35.028243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"179'1","reported_seq":14,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.539745+0000","last_change":"2023-06-10T19:08:03.163073+0000","last_active":"2023-06-10T19:08:04.539745+0000","last_peered":"2023-06-10T19:08:04.539745+0000","last_clean":"2023-06-10T19:08:04.539745+0000","last_became_active":"2023-06-10T19:08:03.162247+0000","last_became_peered":"2023-06-10T19:08:03.162247+0000","last_unstale":"2023-06-10T19:08:04.539745+0000","last_undegraded":"2023-06-10T19:08:04.539745+0000","last_fullsized":"2023-06-10T19:08:04.539745+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:11:48.025518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.d","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.438841+0000","last_change":"2023-06-10T19:08:03.565474+0000","last_active":"2023-06-10T19:08:05.438841+0000","last_peered":"2023-06-10T19:08:05.438841+0000","last_clean":"2023-06-10T19:08:05.438841+0000","last_became_active":"2023-06-10T19:08:03.565157+0000","last_became_peered":"2023-06-10T19:08:03.565157+0000","last_unstale":"2023-06-10T19:08:05.438841+0000","last_undegraded":"2023-06-10T19:08:05.438841+0000","last_fullsized":"2023-06-10T19:08:05.438841+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:33:14.902144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.e","version":"179'2","reported_seq":15,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.442076+0000","last_change":"2023-06-10T19:08:03.164758+0000","last_active":"2023-06-10T19:08:05.442076+0000","last_peered":"2023-06-10T19:08:05.442076+0000","last_clean":"2023-06-10T19:08:05.442076+0000","last_became_active":"2023-06-10T19:08:03.164339+0000","last_became_peered":"2023-06-10T19:08:03.164339+0000","last_unstale":"2023-06-10T19:08:05.442076+0000","last_undegraded":"2023-06-10T19:08:05.442076+0000","last_fullsized":"2023-06-10T19:08:05.442076+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T07:01:33.103419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.e","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.539905+0000","last_change":"2023-06-10T19:08:03.567884+0000","last_active":"2023-06-10T19:08:04.539905+0000","last_peered":"2023-06-10T19:08:04.539905+0000","last_clean":"2023-06-10T19:08:04.539905+0000","last_became_active":"2023-06-10T19:08:03.554317+0000","last_became_peered":"2023-06-10T19:08:03.554317+0000","last_unstale":"2023-06-10T19:08:04.539905+0000","last_undegraded":"2023-06-10T19:08:04.539905+0000","last_fullsized":"2023-06-10T19:08:04.539905+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:15:17.054842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.d","version":"179'1","reported_seq":14,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.244375+0000","last_change":"2023-06-10T19:08:03.172642+0000","last_active":"2023-06-10T19:08:05.244375+0000","last_peered":"2023-06-10T19:08:05.244375+0000","last_clean":"2023-06-10T19:08:05.244375+0000","last_became_active":"2023-06-10T19:08:03.171991+0000","last_became_peered":"2023-06-10T19:08:03.171991+0000","last_unstale":"2023-06-10T19:08:05.244375+0000","last_undegraded":"2023-06-10T19:08:05.244375+0000","last_fullsized":"2023-06-10T19:08:05.244375+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:42:19.801565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.f","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.440598+0000","last_change":"2023-06-10T19:08:03.542491+0000","last_active":"2023-06-10T19:08:05.440598+0000","last_peered":"2023-06-10T19:08:05.440598+0000","last_clean":"2023-06-10T19:08:05.440598+0000","last_became_active":"2023-06-10T19:08:03.542164+0000","last_became_peered":"2023-06-10T19:08:03.542164+0000","last_unstale":"2023-06-10T19:08:05.440598+0000","last_undegraded":"2023-06-10T19:08:05.440598+0000","last_fullsized":"2023-06-10T19:08:05.440598+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:44:03.212378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":13,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.539237+0000","last_change":"2023-06-10T19:08:03.169366+0000","last_active":"2023-06-10T19:08:04.539237+0000","last_peered":"2023-06-10T19:08:04.539237+0000","last_clean":"2023-06-10T19:08:04.539237+0000","last_became_active":"2023-06-10T19:08:03.168665+0000","last_became_peered":"2023-06-10T19:08:03.168665+0000","last_unstale":"2023-06-10T19:08:04.539237+0000","last_undegraded":"2023-06-10T19:08:04.539237+0000","last_fullsized":"2023-06-10T19:08:04.539237+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:49:04.339866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.440880+0000","last_change":"2023-06-10T19:08:03.541569+0000","last_active":"2023-06-10T19:08:05.440880+0000","last_peered":"2023-06-10T19:08:05.440880+0000","last_clean":"2023-06-10T19:08:05.440880+0000","last_became_active":"2023-06-10T19:08:03.541227+0000","last_became_peered":"2023-06-10T19:08:03.541227+0000","last_unstale":"2023-06-10T19:08:05.440880+0000","last_undegraded":"2023-06-10T19:08:05.440880+0000","last_fullsized":"2023-06-10T19:08:05.440880+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:12:08.569775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"179'2","reported_seq":15,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.537409+0000","last_change":"2023-06-10T19:08:03.163373+0000","last_active":"2023-06-10T19:08:04.537409+0000","last_peered":"2023-06-10T19:08:04.537409+0000","last_clean":"2023-06-10T19:08:04.537409+0000","last_became_active":"2023-06-10T19:08:03.162483+0000","last_became_peered":"2023-06-10T19:08:03.162483+0000","last_unstale":"2023-06-10T19:08:04.537409+0000","last_undegraded":"2023-06-10T19:08:04.537409+0000","last_fullsized":"2023-06-10T19:08:04.537409+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:32:57.503882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.440954+0000","last_change":"2023-06-10T19:08:03.563884+0000","last_active":"2023-06-10T19:08:05.440954+0000","last_peered":"2023-06-10T19:08:05.440954+0000","last_clean":"2023-06-10T19:08:05.440954+0000","last_became_active":"2023-06-10T19:08:03.563454+0000","last_became_peered":"2023-06-10T19:08:03.563454+0000","last_unstale":"2023-06-10T19:08:05.440954+0000","last_undegraded":"2023-06-10T19:08:05.440954+0000","last_fullsized":"2023-06-10T19:08:05.440954+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:25:02.329031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":13,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.441707+0000","last_change":"2023-06-10T19:08:03.161103+0000","last_active":"2023-06-10T19:08:05.441707+0000","last_peered":"2023-06-10T19:08:05.441707+0000","last_clean":"2023-06-10T19:08:05.441707+0000","last_became_active":"2023-06-10T19:08:03.160619+0000","last_became_peered":"2023-06-10T19:08:03.160619+0000","last_unstale":"2023-06-10T19:08:05.441707+0000","last_undegraded":"2023-06-10T19:08:05.441707+0000","last_fullsized":"2023-06-10T19:08:05.441707+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:55:31.570596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.441467+0000","last_change":"2023-06-10T19:08:03.545518+0000","last_active":"2023-06-10T19:08:05.441467+0000","last_peered":"2023-06-10T19:08:05.441467+0000","last_clean":"2023-06-10T19:08:05.441467+0000","last_became_active":"2023-06-10T19:08:03.545178+0000","last_became_peered":"2023-06-10T19:08:03.545178+0000","last_unstale":"2023-06-10T19:08:05.441467+0000","last_undegraded":"2023-06-10T19:08:05.441467+0000","last_fullsized":"2023-06-10T19:08:05.441467+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:28:38.534049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":13,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.533782+0000","last_change":"2023-06-10T19:08:03.171072+0000","last_active":"2023-06-10T19:08:04.533782+0000","last_peered":"2023-06-10T19:08:04.533782+0000","last_clean":"2023-06-10T19:08:04.533782+0000","last_became_active":"2023-06-10T19:08:03.170735+0000","last_became_peered":"2023-06-10T19:08:03.170735+0000","last_unstale":"2023-06-10T19:08:04.533782+0000","last_undegraded":"2023-06-10T19:08:04.533782+0000","last_fullsized":"2023-06-10T19:08:04.533782+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:30:54.576376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.b","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.441538+0000","last_change":"2023-06-10T19:08:03.540526+0000","last_active":"2023-06-10T19:08:05.441538+0000","last_peered":"2023-06-10T19:08:05.441538+0000","last_clean":"2023-06-10T19:08:05.441538+0000","last_became_active":"2023-06-10T19:08:03.540261+0000","last_became_peered":"2023-06-10T19:08:03.540261+0000","last_unstale":"2023-06-10T19:08:05.441538+0000","last_undegraded":"2023-06-10T19:08:05.441538+0000","last_fullsized":"2023-06-10T19:08:05.441538+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:50:12.757760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":13,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.244074+0000","last_change":"2023-06-10T19:08:03.171194+0000","last_active":"2023-06-10T19:08:05.244074+0000","last_peered":"2023-06-10T19:08:05.244074+0000","last_clean":"2023-06-10T19:08:05.244074+0000","last_became_active":"2023-06-10T19:08:03.170379+0000","last_became_peered":"2023-06-10T19:08:03.170379+0000","last_unstale":"2023-06-10T19:08:05.244074+0000","last_undegraded":"2023-06-10T19:08:05.244074+0000","last_fullsized":"2023-06-10T19:08:05.244074+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:22:56.034087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.534064+0000","last_change":"2023-06-10T19:08:03.581234+0000","last_active":"2023-06-10T19:08:04.534064+0000","last_peered":"2023-06-10T19:08:04.534064+0000","last_clean":"2023-06-10T19:08:04.534064+0000","last_became_active":"2023-06-10T19:08:03.580975+0000","last_became_peered":"2023-06-10T19:08:03.580975+0000","last_unstale":"2023-06-10T19:08:04.534064+0000","last_undegraded":"2023-06-10T19:08:04.534064+0000","last_fullsized":"2023-06-10T19:08:04.534064+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:20:03.303403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.7","version":"179'2","reported_seq":15,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.442669+0000","last_change":"2023-06-10T19:08:03.169137+0000","last_active":"2023-06-10T19:08:05.442669+0000","last_peered":"2023-06-10T19:08:05.442669+0000","last_clean":"2023-06-10T19:08:05.442669+0000","last_became_active":"2023-06-10T19:08:03.168699+0000","last_became_peered":"2023-06-10T19:08:03.168699+0000","last_unstale":"2023-06-10T19:08:05.442669+0000","last_undegraded":"2023-06-10T19:08:05.442669+0000","last_fullsized":"2023-06-10T19:08:05.442669+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:59:46.381568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.442326+0000","last_change":"2023-06-10T19:08:03.546672+0000","last_active":"2023-06-10T19:08:05.442326+0000","last_peered":"2023-06-10T19:08:05.442326+0000","last_clean":"2023-06-10T19:08:05.442326+0000","last_became_active":"2023-06-10T19:08:03.546335+0000","last_became_peered":"2023-06-10T19:08:03.546335+0000","last_unstale":"2023-06-10T19:08:05.442326+0000","last_undegraded":"2023-06-10T19:08:05.442326+0000","last_fullsized":"2023-06-10T19:08:05.442326+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:00:24.679984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":13,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.533784+0000","last_change":"2023-06-10T19:08:03.171145+0000","last_active":"2023-06-10T19:08:04.533784+0000","last_peered":"2023-06-10T19:08:04.533784+0000","last_clean":"2023-06-10T19:08:04.533784+0000","last_became_active":"2023-06-10T19:08:03.170771+0000","last_became_peered":"2023-06-10T19:08:03.170771+0000","last_unstale":"2023-06-10T19:08:04.533784+0000","last_undegraded":"2023-06-10T19:08:04.533784+0000","last_fullsized":"2023-06-10T19:08:04.533784+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:41:25.258785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.438355+0000","last_change":"2023-06-10T19:08:03.575290+0000","last_active":"2023-06-10T19:08:05.438355+0000","last_peered":"2023-06-10T19:08:05.438355+0000","last_clean":"2023-06-10T19:08:05.438355+0000","last_became_active":"2023-06-10T19:08:03.574628+0000","last_became_peered":"2023-06-10T19:08:03.574628+0000","last_unstale":"2023-06-10T19:08:05.438355+0000","last_undegraded":"2023-06-10T19:08:05.438355+0000","last_fullsized":"2023-06-10T19:08:05.438355+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:54:08.024569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":13,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.439628+0000","last_change":"2023-06-10T19:08:03.161120+0000","last_active":"2023-06-10T19:08:05.439628+0000","last_peered":"2023-06-10T19:08:05.439628+0000","last_clean":"2023-06-10T19:08:05.439628+0000","last_became_active":"2023-06-10T19:08:03.160739+0000","last_became_peered":"2023-06-10T19:08:03.160739+0000","last_unstale":"2023-06-10T19:08:05.439628+0000","last_undegraded":"2023-06-10T19:08:05.439628+0000","last_fullsized":"2023-06-10T19:08:05.439628+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:17:42.867012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.7","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.534445+0000","last_change":"2023-06-10T19:08:03.555628+0000","last_active":"2023-06-10T19:08:04.534445+0000","last_peered":"2023-06-10T19:08:04.534445+0000","last_clean":"2023-06-10T19:08:04.534445+0000","last_became_active":"2023-06-10T19:08:03.555125+0000","last_became_peered":"2023-06-10T19:08:03.555125+0000","last_unstale":"2023-06-10T19:08:04.534445+0000","last_undegraded":"2023-06-10T19:08:04.534445+0000","last_fullsized":"2023-06-10T19:08:04.534445+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:19:03.383699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":13,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.439235+0000","last_change":"2023-06-10T19:08:03.170457+0000","last_active":"2023-06-10T19:08:05.439235+0000","last_peered":"2023-06-10T19:08:05.439235+0000","last_clean":"2023-06-10T19:08:05.439235+0000","last_became_active":"2023-06-10T19:08:03.170163+0000","last_became_peered":"2023-06-10T19:08:03.170163+0000","last_unstale":"2023-06-10T19:08:05.439235+0000","last_undegraded":"2023-06-10T19:08:05.439235+0000","last_fullsized":"2023-06-10T19:08:05.439235+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:48:07.813977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.244239+0000","last_change":"2023-06-10T19:08:03.559882+0000","last_active":"2023-06-10T19:08:05.244239+0000","last_peered":"2023-06-10T19:08:05.244239+0000","last_clean":"2023-06-10T19:08:05.244239+0000","last_became_active":"2023-06-10T19:08:03.559081+0000","last_became_peered":"2023-06-10T19:08:03.559081+0000","last_unstale":"2023-06-10T19:08:05.244239+0000","last_undegraded":"2023-06-10T19:08:05.244239+0000","last_fullsized":"2023-06-10T19:08:05.244239+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:45:59.707914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":13,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.437424+0000","last_change":"2023-06-10T19:08:03.160092+0000","last_active":"2023-06-10T19:08:05.437424+0000","last_peered":"2023-06-10T19:08:05.437424+0000","last_clean":"2023-06-10T19:08:05.437424+0000","last_became_active":"2023-06-10T19:08:03.159264+0000","last_became_peered":"2023-06-10T19:08:03.159264+0000","last_unstale":"2023-06-10T19:08:05.437424+0000","last_undegraded":"2023-06-10T19:08:05.437424+0000","last_fullsized":"2023-06-10T19:08:05.437424+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:52:36.401230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.536915+0000","last_change":"2023-06-10T19:08:03.572199+0000","last_active":"2023-06-10T19:08:04.536915+0000","last_peered":"2023-06-10T19:08:04.536915+0000","last_clean":"2023-06-10T19:08:04.536915+0000","last_became_active":"2023-06-10T19:08:03.571532+0000","last_became_peered":"2023-06-10T19:08:03.571532+0000","last_unstale":"2023-06-10T19:08:04.536915+0000","last_undegraded":"2023-06-10T19:08:04.536915+0000","last_fullsized":"2023-06-10T19:08:04.536915+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:22:57.056249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":13,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.437343+0000","last_change":"2023-06-10T19:08:03.160030+0000","last_active":"2023-06-10T19:08:05.437343+0000","last_peered":"2023-06-10T19:08:05.437343+0000","last_clean":"2023-06-10T19:08:05.437343+0000","last_became_active":"2023-06-10T19:08:03.159233+0000","last_became_peered":"2023-06-10T19:08:03.159233+0000","last_unstale":"2023-06-10T19:08:05.437343+0000","last_undegraded":"2023-06-10T19:08:05.437343+0000","last_fullsized":"2023-06-10T19:08:05.437343+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:13:09.541660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.440672+0000","last_change":"2023-06-10T19:08:03.544742+0000","last_active":"2023-06-10T19:08:05.440672+0000","last_peered":"2023-06-10T19:08:05.440672+0000","last_clean":"2023-06-10T19:08:05.440672+0000","last_became_active":"2023-06-10T19:08:03.543098+0000","last_became_peered":"2023-06-10T19:08:03.543098+0000","last_unstale":"2023-06-10T19:08:05.440672+0000","last_undegraded":"2023-06-10T19:08:05.440672+0000","last_fullsized":"2023-06-10T19:08:05.440672+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:49:05.343491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":13,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.533577+0000","last_change":"2023-06-10T19:08:03.155129+0000","last_active":"2023-06-10T19:08:04.533577+0000","last_peered":"2023-06-10T19:08:04.533577+0000","last_clean":"2023-06-10T19:08:04.533577+0000","last_became_active":"2023-06-10T19:08:03.154886+0000","last_became_peered":"2023-06-10T19:08:03.154886+0000","last_unstale":"2023-06-10T19:08:04.533577+0000","last_undegraded":"2023-06-10T19:08:04.533577+0000","last_fullsized":"2023-06-10T19:08:04.533577+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:42:39.488280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.437520+0000","last_change":"2023-06-10T19:08:03.576348+0000","last_active":"2023-06-10T19:08:05.437520+0000","last_peered":"2023-06-10T19:08:05.437520+0000","last_clean":"2023-06-10T19:08:05.437520+0000","last_became_active":"2023-06-10T19:08:03.575613+0000","last_became_peered":"2023-06-10T19:08:03.575613+0000","last_unstale":"2023-06-10T19:08:05.437520+0000","last_undegraded":"2023-06-10T19:08:05.437520+0000","last_fullsized":"2023-06-10T19:08:05.437520+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:40:06.194864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":13,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.244364+0000","last_change":"2023-06-10T19:08:03.175107+0000","last_active":"2023-06-10T19:08:05.244364+0000","last_peered":"2023-06-10T19:08:05.244364+0000","last_clean":"2023-06-10T19:08:05.244364+0000","last_became_active":"2023-06-10T19:08:03.174236+0000","last_became_peered":"2023-06-10T19:08:03.174236+0000","last_unstale":"2023-06-10T19:08:05.244364+0000","last_undegraded":"2023-06-10T19:08:05.244364+0000","last_fullsized":"2023-06-10T19:08:05.244364+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:31:44.793122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.1b","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.244415+0000","last_change":"2023-06-10T19:08:03.561297+0000","last_active":"2023-06-10T19:08:05.244415+0000","last_peered":"2023-06-10T19:08:05.244415+0000","last_clean":"2023-06-10T19:08:05.244415+0000","last_became_active":"2023-06-10T19:08:03.560411+0000","last_became_peered":"2023-06-10T19:08:03.560411+0000","last_unstale":"2023-06-10T19:08:05.244415+0000","last_undegraded":"2023-06-10T19:08:05.244415+0000","last_fullsized":"2023-06-10T19:08:05.244415+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:16:51.862751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":13,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.438084+0000","last_change":"2023-06-10T19:08:03.161563+0000","last_active":"2023-06-10T19:08:05.438084+0000","last_peered":"2023-06-10T19:08:05.438084+0000","last_clean":"2023-06-10T19:08:05.438084+0000","last_became_active":"2023-06-10T19:08:03.161083+0000","last_became_peered":"2023-06-10T19:08:03.161083+0000","last_unstale":"2023-06-10T19:08:05.438084+0000","last_undegraded":"2023-06-10T19:08:05.438084+0000","last_fullsized":"2023-06-10T19:08:05.438084+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:03:20.657974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":434,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.437815+0000","last_change":"2023-06-10T18:52:34.951528+0000","last_active":"2023-06-10T19:08:05.437815+0000","last_peered":"2023-06-10T19:08:05.437815+0000","last_clean":"2023-06-10T19:08:05.437815+0000","last_became_active":"2023-06-10T18:52:34.949099+0000","last_became_peered":"2023-06-10T18:52:34.949099+0000","last_unstale":"2023-06-10T19:08:05.437815+0000","last_undegraded":"2023-06-10T19:08:05.437815+0000","last_fullsized":"2023-06-10T19:08:05.437815+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_clean_scrub_stamp":"2023-06-10T18:52:33.633295+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:00:17.499241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":310,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.538633+0000","last_change":"2023-06-10T18:52:40.506384+0000","last_active":"2023-06-10T19:08:04.538633+0000","last_peered":"2023-06-10T19:08:04.538633+0000","last_clean":"2023-06-10T19:08:04.538633+0000","last_became_active":"2023-06-10T18:52:40.505701+0000","last_became_peered":"2023-06-10T18:52:40.505701+0000","last_unstale":"2023-06-10T19:08:04.538633+0000","last_undegraded":"2023-06-10T19:08:04.538633+0000","last_fullsized":"2023-06-10T19:08:04.538633+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:28:39.564965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.536571+0000","last_change":"2023-06-10T19:08:03.539779+0000","last_active":"2023-06-10T19:08:04.536571+0000","last_peered":"2023-06-10T19:08:04.536571+0000","last_clean":"2023-06-10T19:08:04.536571+0000","last_became_active":"2023-06-10T19:08:03.538931+0000","last_became_peered":"2023-06-10T19:08:03.538931+0000","last_unstale":"2023-06-10T19:08:04.536571+0000","last_undegraded":"2023-06-10T19:08:04.536571+0000","last_fullsized":"2023-06-10T19:08:04.536571+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:18:01.184162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.1b","version":"179'1","reported_seq":14,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.439541+0000","last_change":"2023-06-10T19:08:03.167339+0000","last_active":"2023-06-10T19:08:05.439541+0000","last_peered":"2023-06-10T19:08:05.439541+0000","last_clean":"2023-06-10T19:08:05.439541+0000","last_became_active":"2023-06-10T19:08:03.166946+0000","last_became_peered":"2023-06-10T19:08:03.166946+0000","last_unstale":"2023-06-10T19:08:05.439541+0000","last_undegraded":"2023-06-10T19:08:05.439541+0000","last_fullsized":"2023-06-10T19:08:05.439541+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:05:12.859895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":278,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.437615+0000","last_change":"2023-06-10T18:52:40.512015+0000","last_active":"2023-06-10T19:08:05.437615+0000","last_peered":"2023-06-10T19:08:05.437615+0000","last_clean":"2023-06-10T19:08:05.437615+0000","last_became_active":"2023-06-10T18:52:40.511382+0000","last_became_peered":"2023-06-10T18:52:40.511382+0000","last_unstale":"2023-06-10T19:08:05.437615+0000","last_undegraded":"2023-06-10T19:08:05.437615+0000","last_fullsized":"2023-06-10T19:08:05.437615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:46:31.338645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.440549+0000","last_change":"2023-06-10T19:08:03.544401+0000","last_active":"2023-06-10T19:08:05.440549+0000","last_peered":"2023-06-10T19:08:05.440549+0000","last_clean":"2023-06-10T19:08:05.440549+0000","last_became_active":"2023-06-10T19:08:03.544129+0000","last_became_peered":"2023-06-10T19:08:03.544129+0000","last_unstale":"2023-06-10T19:08:05.440549+0000","last_undegraded":"2023-06-10T19:08:05.440549+0000","last_fullsized":"2023-06-10T19:08:05.440549+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:38:26.169391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1a","version":"179'1","reported_seq":14,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.441420+0000","last_change":"2023-06-10T19:08:03.161776+0000","last_active":"2023-06-10T19:08:05.441420+0000","last_peered":"2023-06-10T19:08:05.441420+0000","last_clean":"2023-06-10T19:08:05.441420+0000","last_became_active":"2023-06-10T19:08:03.161475+0000","last_became_peered":"2023-06-10T19:08:03.161475+0000","last_unstale":"2023-06-10T19:08:05.441420+0000","last_undegraded":"2023-06-10T19:08:05.441420+0000","last_fullsized":"2023-06-10T19:08:05.441420+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:22:58.600090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":300,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.533771+0000","last_change":"2023-06-10T18:52:40.671725+0000","last_active":"2023-06-10T19:08:04.533771+0000","last_peered":"2023-06-10T19:08:04.533771+0000","last_clean":"2023-06-10T19:08:04.533771+0000","last_became_active":"2023-06-10T18:52:40.671442+0000","last_became_peered":"2023-06-10T18:52:40.671442+0000","last_unstale":"2023-06-10T19:08:04.533771+0000","last_undegraded":"2023-06-10T19:08:04.533771+0000","last_fullsized":"2023-06-10T19:08:04.533771+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:08:08.625563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.1a","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.441340+0000","last_change":"2023-06-10T19:08:03.579894+0000","last_active":"2023-06-10T19:08:05.441340+0000","last_peered":"2023-06-10T19:08:05.441340+0000","last_clean":"2023-06-10T19:08:05.441340+0000","last_became_active":"2023-06-10T19:08:03.579634+0000","last_became_peered":"2023-06-10T19:08:03.579634+0000","last_unstale":"2023-06-10T19:08:05.441340+0000","last_undegraded":"2023-06-10T19:08:05.441340+0000","last_fullsized":"2023-06-10T19:08:05.441340+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:21:09.590484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":13,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.536895+0000","last_change":"2023-06-10T19:08:03.160135+0000","last_active":"2023-06-10T19:08:04.536895+0000","last_peered":"2023-06-10T19:08:04.536895+0000","last_clean":"2023-06-10T19:08:04.536895+0000","last_became_active":"2023-06-10T19:08:03.159272+0000","last_became_peered":"2023-06-10T19:08:03.159272+0000","last_unstale":"2023-06-10T19:08:04.536895+0000","last_undegraded":"2023-06-10T19:08:04.536895+0000","last_fullsized":"2023-06-10T19:08:04.536895+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:10:13.249089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":310,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.538194+0000","last_change":"2023-06-10T18:52:40.510258+0000","last_active":"2023-06-10T19:08:04.538194+0000","last_peered":"2023-06-10T19:08:04.538194+0000","last_clean":"2023-06-10T19:08:04.538194+0000","last_became_active":"2023-06-10T18:52:40.509560+0000","last_became_peered":"2023-06-10T18:52:40.509560+0000","last_unstale":"2023-06-10T19:08:04.538194+0000","last_undegraded":"2023-06-10T19:08:04.538194+0000","last_fullsized":"2023-06-10T19:08:04.538194+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:41:58.173239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.438428+0000","last_change":"2023-06-10T19:08:03.573570+0000","last_active":"2023-06-10T19:08:05.438428+0000","last_peered":"2023-06-10T19:08:05.438428+0000","last_clean":"2023-06-10T19:08:05.438428+0000","last_became_active":"2023-06-10T19:08:03.572764+0000","last_became_peered":"2023-06-10T19:08:03.572764+0000","last_unstale":"2023-06-10T19:08:05.438428+0000","last_undegraded":"2023-06-10T19:08:05.438428+0000","last_fullsized":"2023-06-10T19:08:05.438428+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:31:03.507727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1f","version":"179'4","reported_seq":17,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.442415+0000","last_change":"2023-06-10T19:08:03.161456+0000","last_active":"2023-06-10T19:08:05.442415+0000","last_peered":"2023-06-10T19:08:05.442415+0000","last_clean":"2023-06-10T19:08:05.442415+0000","last_became_active":"2023-06-10T19:08:03.160674+0000","last_became_peered":"2023-06-10T19:08:03.160674+0000","last_unstale":"2023-06-10T19:08:05.442415+0000","last_undegraded":"2023-06-10T19:08:05.442415+0000","last_fullsized":"2023-06-10T19:08:05.442415+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:18:09.843711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":280,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.439918+0000","last_change":"2023-06-10T18:52:40.672266+0000","last_active":"2023-06-10T19:08:05.439918+0000","last_peered":"2023-06-10T19:08:05.439918+0000","last_clean":"2023-06-10T19:08:05.439918+0000","last_became_active":"2023-06-10T18:52:40.671966+0000","last_became_peered":"2023-06-10T18:52:40.671966+0000","last_unstale":"2023-06-10T19:08:05.439918+0000","last_undegraded":"2023-06-10T19:08:05.439918+0000","last_fullsized":"2023-06-10T19:08:05.439918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:55:35.364123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1d","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.533975+0000","last_change":"2023-06-10T19:08:03.560173+0000","last_active":"2023-06-10T19:08:04.533975+0000","last_peered":"2023-06-10T19:08:04.533975+0000","last_clean":"2023-06-10T19:08:04.533975+0000","last_became_active":"2023-06-10T19:08:03.559915+0000","last_became_peered":"2023-06-10T19:08:03.559915+0000","last_unstale":"2023-06-10T19:08:04.533975+0000","last_undegraded":"2023-06-10T19:08:04.533975+0000","last_fullsized":"2023-06-10T19:08:04.533975+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:22:12.825894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"179'1","reported_seq":14,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.441942+0000","last_change":"2023-06-10T19:08:03.167039+0000","last_active":"2023-06-10T19:08:05.441942+0000","last_peered":"2023-06-10T19:08:05.441942+0000","last_clean":"2023-06-10T19:08:05.441942+0000","last_became_active":"2023-06-10T19:08:03.166789+0000","last_became_peered":"2023-06-10T19:08:03.166789+0000","last_unstale":"2023-06-10T19:08:05.441942+0000","last_undegraded":"2023-06-10T19:08:05.441942+0000","last_fullsized":"2023-06-10T19:08:05.441942+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:01:55.927670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":278,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.438095+0000","last_change":"2023-06-10T18:52:40.671084+0000","last_active":"2023-06-10T19:08:05.438095+0000","last_peered":"2023-06-10T19:08:05.438095+0000","last_clean":"2023-06-10T19:08:05.438095+0000","last_became_active":"2023-06-10T18:52:40.670697+0000","last_became_peered":"2023-06-10T18:52:40.670697+0000","last_unstale":"2023-06-10T19:08:05.438095+0000","last_undegraded":"2023-06-10T19:08:05.438095+0000","last_fullsized":"2023-06-10T19:08:05.438095+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:10:09.642847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1e","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.539709+0000","last_change":"2023-06-10T19:08:03.579869+0000","last_active":"2023-06-10T19:08:04.539709+0000","last_peered":"2023-06-10T19:08:04.539709+0000","last_clean":"2023-06-10T19:08:04.539709+0000","last_became_active":"2023-06-10T19:08:03.578943+0000","last_became_peered":"2023-06-10T19:08:03.578943+0000","last_unstale":"2023-06-10T19:08:04.539709+0000","last_undegraded":"2023-06-10T19:08:04.539709+0000","last_fullsized":"2023-06-10T19:08:04.539709+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:21:09.590484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1d","version":"179'2","reported_seq":15,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.539290+0000","last_change":"2023-06-10T19:08:03.162026+0000","last_active":"2023-06-10T19:08:04.539290+0000","last_peered":"2023-06-10T19:08:04.539290+0000","last_clean":"2023-06-10T19:08:04.539290+0000","last_became_active":"2023-06-10T19:08:03.160874+0000","last_became_peered":"2023-06-10T19:08:03.160874+0000","last_unstale":"2023-06-10T19:08:04.539290+0000","last_undegraded":"2023-06-10T19:08:04.539290+0000","last_fullsized":"2023-06-10T19:08:04.539290+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:29:28.946876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":280,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.441845+0000","last_change":"2023-06-10T18:52:40.514114+0000","last_active":"2023-06-10T19:08:05.441845+0000","last_peered":"2023-06-10T19:08:05.441845+0000","last_clean":"2023-06-10T19:08:05.441845+0000","last_became_active":"2023-06-10T18:52:40.513638+0000","last_became_peered":"2023-06-10T18:52:40.513638+0000","last_unstale":"2023-06-10T19:08:05.441845+0000","last_undegraded":"2023-06-10T19:08:05.441845+0000","last_fullsized":"2023-06-10T19:08:05.441845+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:59:53.407429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1f","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.244748+0000","last_change":"2023-06-10T19:08:03.589242+0000","last_active":"2023-06-10T19:08:05.244748+0000","last_peered":"2023-06-10T19:08:05.244748+0000","last_clean":"2023-06-10T19:08:05.244748+0000","last_became_active":"2023-06-10T19:08:03.588788+0000","last_became_peered":"2023-06-10T19:08:03.588788+0000","last_unstale":"2023-06-10T19:08:05.244748+0000","last_undegraded":"2023-06-10T19:08:05.244748+0000","last_fullsized":"2023-06-10T19:08:05.244748+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:25:08.168192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1c","version":"179'2","reported_seq":15,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.537418+0000","last_change":"2023-06-10T19:08:03.159361+0000","last_active":"2023-06-10T19:08:04.537418+0000","last_peered":"2023-06-10T19:08:04.537418+0000","last_clean":"2023-06-10T19:08:04.537418+0000","last_became_active":"2023-06-10T19:08:03.158564+0000","last_became_peered":"2023-06-10T19:08:03.158564+0000","last_unstale":"2023-06-10T19:08:04.537418+0000","last_undegraded":"2023-06-10T19:08:04.537418+0000","last_fullsized":"2023-06-10T19:08:04.537418+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:54:26.405549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":280,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.244688+0000","last_change":"2023-06-10T18:52:40.515396+0000","last_active":"2023-06-10T19:08:05.244688+0000","last_peered":"2023-06-10T19:08:05.244688+0000","last_clean":"2023-06-10T19:08:05.244688+0000","last_became_active":"2023-06-10T18:52:40.514663+0000","last_became_peered":"2023-06-10T18:52:40.514663+0000","last_unstale":"2023-06-10T19:08:05.244688+0000","last_undegraded":"2023-06-10T19:08:05.244688+0000","last_fullsized":"2023-06-10T19:08:05.244688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:38:44.075046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":25,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575038,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33836,"kb_used_data":2788,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338004,"statfs":{"total":96636764160,"available":96602116096,"internally_reserved":0,"allocated":2854912,"data_stored":1647554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:07:04 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.93600000000000005,"15min":0.92500000000000004},"min":{"1min":0.443,"5min":0.443,"15min":0.434},"max":{"1min":1.131,"5min":1.522,"15min":1.6220000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.88,"5min":0.90900000000000003,"15min":0.92400000000000004},"min":{"1min":0.63400000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.1379999999999999,"5min":1.3109999999999999,"15min":1.6870000000000001},"last":0.49399999999999999}]},{"osd":1,"last update":"Sat Jun 10 19:07:04 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.88800000000000001,"15min":0.91700000000000004},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.377},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.92300000000000004,"15min":0.94299999999999995},"min":{"1min":0.55000000000000004,"5min":0.51300000000000001,"15min":0.504},"max":{"1min":1.302,"5min":1.3320000000000001,"15min":1.5960000000000001},"last":0.65000000000000002}]},{"osd":2,"last update":"Sat Jun 10 19:07:04 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.86699999999999999,"15min":0.85299999999999998},"min":{"1min":0.41899999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.2370000000000001,"5min":1.2629999999999999,"15min":1.4059999999999999},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.88700000000000001,"15min":0.89600000000000002},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.50600000000000001},"max":{"1min":1.2290000000000001,"5min":1.3100000000000001,"15min":1.448},"last":0.751}]},{"osd":3,"last update":"Sat Jun 10 19:07:04 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.89600000000000002,"15min":0.92000000000000004},"min":{"1min":0.68600000000000005,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.1299999999999999,"5min":1.4490000000000001,"15min":1.502},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.95099999999999996,"15min":0.95599999999999996},"min":{"1min":0.496,"5min":0.432,"15min":0.432},"max":{"1min":1.2,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.97299999999999998}]},{"osd":4,"last update":"Sat Jun 10 19:07:04 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.82799999999999996,"15min":0.84399999999999997},"min":{"1min":0.60299999999999998,"5min":0.307,"15min":0.307},"max":{"1min":1.1639999999999999,"5min":1.2290000000000001,"15min":1.639},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.96699999999999997,"15min":0.96599999999999997},"min":{"1min":0.47299999999999998,"5min":0.41199999999999998,"15min":0.40000000000000002},"max":{"1min":1.1799999999999999,"5min":1.454,"15min":1.4590000000000001},"last":1.079}]},{"osd":5,"last update":"Sat Jun 10 19:07:04 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.99399999999999999,"15min":1.002},"min":{"1min":0.66600000000000004,"5min":0.45100000000000001,"15min":0.38400000000000001},"max":{"1min":1.268,"5min":1.385,"15min":1.806},"last":1.1220000000000001},{"interface":"front","average":{"1min":1.044,"5min":1.0269999999999999,"15min":1.0349999999999999},"min":{"1min":0.78200000000000003,"5min":0.48499999999999999,"15min":0.46500000000000002},"max":{"1min":1.254,"5min":1.665,"15min":1.665},"last":1.155}]},{"osd":6,"last update":"Sat Jun 10 19:07:04 2023","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.014,"15min":1.0089999999999999},"min":{"1min":0.71899999999999997,"5min":0.47699999999999998,"15min":0.35999999999999999},"max":{"1min":2.1120000000000001,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.117,"5min":1.0960000000000001,"15min":1.099},"min":{"1min":0.82499999999999996,"5min":0.504,"15min":0.441},"max":{"1min":1.397,"5min":1.728,"15min":1.728},"last":1.1970000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575039,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33260,"kb_used_data":2212,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338580,"statfs":{"total":96636764160,"available":96602705920,"internally_reserved":0,"allocated":2265088,"data_stored":1057256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:07:58 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.84699999999999998,"15min":0.86599999999999999},"min":{"1min":0.55700000000000005,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.2050000000000001,"5min":1.2450000000000001,"15min":1.498},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.879,"15min":0.88400000000000001},"min":{"1min":0.58199999999999996,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.1359999999999999,"5min":1.3009999999999999,"15min":1.496},"last":0.76700000000000002}]},{"osd":1,"last update":"Sat Jun 10 19:07:58 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.83999999999999997,"15min":0.86099999999999999},"min":{"1min":0.60799999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.1200000000000001,"5min":1.2709999999999999,"15min":1.5229999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.90300000000000002,"15min":0.90700000000000003},"min":{"1min":0.71199999999999997,"5min":0.504,"15min":0.45300000000000001},"max":{"1min":1.248,"5min":1.341,"15min":1.778},"last":0.84299999999999997}]},{"osd":2,"last update":"Sat Jun 10 19:07:58 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.89400000000000002,"15min":0.90200000000000002},"min":{"1min":0.53500000000000003,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.1579999999999999,"5min":1.2929999999999999,"15min":1.3759999999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.874,"5min":0.86699999999999999,"15min":0.88200000000000001},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.175,"5min":1.175,"15min":1.246},"last":0.63100000000000001}]},{"osd":3,"last update":"Sat Jun 10 19:07:58 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.91400000000000003,"15min":0.92300000000000004},"min":{"1min":0.67300000000000004,"5min":0.55100000000000005,"15min":0.52700000000000002},"max":{"1min":1.1890000000000001,"5min":1.238,"15min":1.7190000000000001},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.95399999999999996,"15min":0.97899999999999998},"min":{"1min":0.72699999999999998,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.1639999999999999,"5min":1.304,"15min":1.4370000000000001},"last":0.54600000000000004}]},{"osd":4,"last update":"Sat Jun 10 19:07:58 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.93400000000000005,"15min":0.91600000000000004},"min":{"1min":0.58599999999999997,"5min":0.45900000000000002,"15min":0.373},"max":{"1min":1.2130000000000001,"5min":1.4019999999999999,"15min":1.798},"last":1.0680000000000001},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.999,"15min":0.98399999999999999},"min":{"1min":0.65600000000000003,"5min":0.504,"15min":0.47899999999999998},"max":{"1min":1.276,"5min":1.409,"15min":1.5489999999999999},"last":1.008}]},{"osd":5,"last update":"Sat Jun 10 19:07:58 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.875,"15min":0.90000000000000002},"min":{"1min":0.45300000000000001,"5min":0.437,"15min":0.437},"max":{"1min":1.1020000000000001,"5min":1.2150000000000001,"15min":1.333},"last":0.81399999999999995},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.0189999999999999,"15min":1.024},"min":{"1min":0.64300000000000002,"5min":0.47199999999999998,"15min":0.42699999999999999},"max":{"1min":1.3069999999999999,"5min":1.3520000000000001,"15min":2.536},"last":1.03}]},{"osd":7,"last update":"Sat Jun 10 19:07:58 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.04,"15min":1.028},"min":{"1min":0.69399999999999995,"5min":0.59199999999999997,"15min":0.57099999999999995},"max":{"1min":1.1870000000000001,"5min":1.879,"15min":1.917},"last":1.0529999999999999},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.98299999999999998,"15min":0.999},"min":{"1min":0.51700000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.226,"5min":1.345,"15min":1.5569999999999999},"last":0.95799999999999996}]}]},{"osd":5,"up_from":13,"seq":55834575039,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33272,"kb_used_data":2224,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338568,"statfs":{"total":96636764160,"available":96602693632,"internally_reserved":0,"allocated":2277376,"data_stored":1058772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.85399999999999998,"15min":0.874},"min":{"1min":0.53100000000000003,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.2649999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":1.2350000000000001},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.89200000000000002,"15min":0.90000000000000002},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.49399999999999999},"max":{"1min":1.0860000000000001,"5min":1.2370000000000001,"15min":2.347},"last":0.86399999999999999}]},{"osd":1,"last update":"Sat Jun 10 19:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.879,"15min":0.90900000000000003},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.153,"5min":1.6739999999999999,"15min":7.0800000000000001},"last":1.266},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.90200000000000002,"15min":0.98199999999999998},"min":{"1min":0.56999999999999995,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1619999999999999,"5min":1.2689999999999999,"15min":15.845000000000001},"last":1.0329999999999999}]},{"osd":2,"last update":"Sat Jun 10 19:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.90700000000000003,"15min":0.89600000000000002},"min":{"1min":0.60999999999999999,"5min":0.54300000000000004,"15min":0.48299999999999998},"max":{"1min":1.2150000000000001,"5min":1.6459999999999999,"15min":5.0049999999999999},"last":1.1930000000000001},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.91500000000000004,"15min":0.94599999999999995},"min":{"1min":0.625,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.107,"5min":1.391,"15min":6.851},"last":1.1359999999999999}]},{"osd":3,"last update":"Sat Jun 10 19:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.93600000000000005,"15min":0.94699999999999995},"min":{"1min":0.59099999999999997,"5min":0.58699999999999997,"15min":0.51500000000000001},"max":{"1min":1.508,"5min":1.6910000000000001,"15min":2.544},"last":1.304},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.97699999999999998,"15min":0.98999999999999999},"min":{"1min":0.748,"5min":0.66000000000000003,"15min":0.59799999999999998},"max":{"1min":1.3009999999999999,"5min":1.4870000000000001,"15min":3.0830000000000002},"last":0.95699999999999996}]},{"osd":4,"last update":"Sat Jun 10 19:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.94199999999999995,"15min":0.94799999999999995},"min":{"1min":0.67000000000000004,"5min":0.59799999999999998,"15min":0.58099999999999996},"max":{"1min":1.454,"5min":1.6140000000000001,"15min":6.7290000000000001},"last":0.998},{"interface":"front","average":{"1min":1.0720000000000001,"5min":0.97099999999999997,"15min":0.98699999999999999},"min":{"1min":0.69699999999999995,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":0.93000000000000005}]},{"osd":6,"last update":"Sat Jun 10 19:07:54 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":0.98899999999999999,"15min":0.98699999999999999},"min":{"1min":0.70399999999999996,"5min":0.60499999999999998,"15min":0.54200000000000004},"max":{"1min":1.7190000000000001,"5min":1.8009999999999999,"15min":1.8009999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.0329999999999999,"15min":1.054},"min":{"1min":0.86799999999999999,"5min":0.66200000000000003,"15min":0.57899999999999996},"max":{"1min":1.5620000000000001,"5min":1.8380000000000001,"15min":6.923},"last":0.77600000000000002}]},{"osd":7,"last update":"Sat Jun 10 19:07:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.0640000000000001,"15min":1.0800000000000001},"min":{"1min":0.95899999999999996,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.7549999999999999,"5min":1.7749999999999999,"15min":2.6080000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1200000000000001,"15min":1.133},"min":{"1min":0.88700000000000001,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":5.4169999999999998},"last":1.1040000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575038,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33272,"kb_used_data":2224,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338568,"statfs":{"total":96636764160,"available":96602693632,"internally_reserved":0,"allocated":2277376,"data_stored":1058784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.83999999999999997,"15min":0.83299999999999996},"min":{"1min":0.53200000000000003,"5min":0.45400000000000001,"15min":0.45100000000000001},"max":{"1min":1.2190000000000001,"5min":1.29,"15min":1.29},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.90000000000000002,"15min":0.90600000000000003},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.375,"5min":1.3979999999999999,"15min":3.7280000000000002},"last":1.0860000000000001}]},{"osd":1,"last update":"Sat Jun 10 19:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.90000000000000002,"15min":0.92800000000000005},"min":{"1min":0.55000000000000004,"5min":0.47799999999999998,"15min":0.47599999999999998},"max":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":3.3969999999999998},"last":0.995},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.83199999999999996,"15min":0.86199999999999999},"min":{"1min":0.55700000000000005,"5min":0.47899999999999998,"15min":0.47699999999999998},"max":{"1min":1.212,"5min":1.2430000000000001,"15min":2.496},"last":1.1100000000000001}]},{"osd":2,"last update":"Sat Jun 10 19:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.85899999999999999,"15min":0.879},"min":{"1min":0.52400000000000002,"5min":0.52200000000000002,"15min":0.49299999999999999},"max":{"1min":1.137,"5min":1.236,"15min":1.522},"last":0.88},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.95899999999999996,"15min":0.98499999999999999},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.55000000000000004},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":3.5750000000000002},"last":1.155}]},{"osd":3,"last update":"Sat Jun 10 19:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.86399999999999999,"15min":0.89300000000000002},"min":{"1min":0.57799999999999996,"5min":0.56200000000000006,"15min":0.53900000000000003},"max":{"1min":1.1200000000000001,"5min":1.46,"15min":2.3809999999999998},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.94599999999999995,"15min":0.96299999999999997},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.54400000000000004},"max":{"1min":1.2889999999999999,"5min":1.4279999999999999,"15min":1.6479999999999999},"last":1.0589999999999999}]},{"osd":5,"last update":"Sat Jun 10 19:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.95299999999999996,"15min":0.95799999999999996},"min":{"1min":0.66800000000000004,"5min":0.58699999999999997,"15min":0.53100000000000003},"max":{"1min":1.224,"5min":1.3260000000000001,"15min":3.6539999999999999},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.92000000000000004,"15min":0.93999999999999995},"min":{"1min":0.63400000000000001,"5min":0.495,"15min":0.495},"max":{"1min":1.216,"5min":1.26,"15min":2.6720000000000002},"last":0.84499999999999997}]},{"osd":6,"last update":"Sat Jun 10 19:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.97599999999999998,"15min":0.96799999999999997},"min":{"1min":0.67000000000000004,"5min":0.443,"15min":0.443},"max":{"1min":1.2869999999999999,"5min":1.413,"15min":2.2639999999999998},"last":0.70299999999999996},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.081,"15min":1.0680000000000001},"min":{"1min":0.76300000000000001,"5min":0.58799999999999997,"15min":0.44400000000000001},"max":{"1min":1.625,"5min":1.625,"15min":3.4980000000000002},"last":0.73699999999999999}]},{"osd":7,"last update":"Sat Jun 10 19:07:08 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.02,"15min":1.0009999999999999},"min":{"1min":0.82699999999999996,"5min":0.60899999999999999,"15min":0.41399999999999998},"max":{"1min":1.3240000000000001,"5min":1.3919999999999999,"15min":2.5910000000000002},"last":1.036},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.071},"min":{"1min":0.81100000000000005,"5min":0.50800000000000001,"15min":0.46300000000000002},"max":{"1min":1.385,"5min":1.635,"15min":1.635},"last":1.0189999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575037,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37356,"kb_used_data":2212,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334484,"statfs":{"total":96636764160,"available":96598511616,"internally_reserved":0,"allocated":2265088,"data_stored":1056327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.63700000000000001,"15min":0.628},"min":{"1min":0.33800000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.879,"5min":1.0900000000000001,"15min":1.169},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.66600000000000004,"15min":0.66900000000000004},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.251},"max":{"1min":0.91200000000000003,"5min":0.97799999999999998,"15min":1.5269999999999999},"last":0.33000000000000002}]},{"osd":1,"last update":"Sat Jun 10 19:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.68300000000000005,"15min":0.68899999999999995},"min":{"1min":0.33300000000000002,"5min":0.29699999999999999,"15min":0.27500000000000002},"max":{"1min":1.234,"5min":1.234,"15min":2.0699999999999998},"last":0.376},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71799999999999997,"15min":0.73399999999999999},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.411},"last":0.436}]},{"osd":2,"last update":"Sat Jun 10 19:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.753,"15min":0.77300000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.30299999999999999},"max":{"1min":0.98699999999999999,"5min":1.2829999999999999,"15min":1.9530000000000001},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.80600000000000005,"15min":0.79700000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.29699999999999999},"max":{"1min":1.0800000000000001,"5min":1.2769999999999999,"15min":1.591},"last":0.39700000000000002}]},{"osd":4,"last update":"Sat Jun 10 19:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.94599999999999995,"15min":0.94899999999999995},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.41899999999999998},"max":{"1min":1.294,"5min":1.4239999999999999,"15min":1.8240000000000001},"last":0.629},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.98499999999999999,"15min":0.99199999999999999},"min":{"1min":0.64600000000000002,"5min":0.57299999999999995,"15min":0.47999999999999998},"max":{"1min":1.417,"5min":1.4330000000000001,"15min":1.873},"last":0.748}]},{"osd":5,"last update":"Sat Jun 10 19:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.99399999999999999,"15min":1.0069999999999999},"min":{"1min":0.56899999999999995,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.474,"5min":1.536,"15min":2.024},"last":0.64400000000000002},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.038,"15min":1.0369999999999999},"min":{"1min":0.71499999999999997,"5min":0.59999999999999998,"15min":0.46899999999999997},"max":{"1min":1.3580000000000001,"5min":1.534,"15min":1.9259999999999999},"last":0.57499999999999996}]},{"osd":6,"last update":"Sat Jun 10 19:07:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":1.048,"15min":1.0629999999999999},"min":{"1min":0.69799999999999995,"5min":0.56999999999999995,"15min":0.55300000000000005},"max":{"1min":1.4359999999999999,"5min":1.617,"15min":1.8500000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.0309999999999999,"15min":1.05},"min":{"1min":0.629,"5min":0.61399999999999999,"15min":0.58799999999999997},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":2.2120000000000002},"last":0.76400000000000001}]},{"osd":7,"last update":"Sat Jun 10 19:07:54 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.0580000000000001,"15min":1.081},"min":{"1min":0.66400000000000003,"5min":0.58199999999999996,"15min":0.56999999999999995},"max":{"1min":1.4139999999999999,"5min":1.5720000000000001,"15min":2.1150000000000002},"last":0.55800000000000005},{"interface":"front","average":{"1min":1.077,"5min":1.089,"15min":1.101},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.4379999999999999,"5min":1.6779999999999999,"15min":1.9850000000000001},"last":0.69199999999999995}]}]},{"osd":2,"up_from":13,"seq":55834575038,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37356,"kb_used_data":2212,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334484,"statfs":{"total":96636764160,"available":96598511616,"internally_reserved":0,"allocated":2265088,"data_stored":1057768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.63700000000000001,"15min":0.626},"min":{"1min":0.34499999999999997,"5min":0.28299999999999997,"15min":0.27300000000000002},"max":{"1min":1.4490000000000001,"5min":2.883,"15min":2.883},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.76300000000000001,"15min":0.73699999999999999},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.101,"5min":6.5670000000000002,"15min":6.5670000000000002},"last":0.42599999999999999}]},{"osd":1,"last update":"Sat Jun 10 19:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.64600000000000002,"15min":0.66500000000000004},"min":{"1min":0.36199999999999999,"5min":0.32300000000000001,"15min":0.29199999999999998},"max":{"1min":1.032,"5min":1.1100000000000001,"15min":1.1950000000000001},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.81299999999999994,"15min":0.78800000000000003},"min":{"1min":0.32500000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.133,"5min":8.4429999999999996,"15min":8.4429999999999996},"last":0.51100000000000001}]},{"osd":3,"last update":"Sat Jun 10 19:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.76500000000000001,"15min":0.77900000000000003},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.1359999999999999,"5min":1.1899999999999999,"15min":1.2350000000000001},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.76500000000000001,"15min":0.78000000000000003},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.23499999999999999},"max":{"1min":1.21,"5min":4.1849999999999996,"15min":4.1849999999999996},"last":0.46999999999999997}]},{"osd":4,"last update":"Sat Jun 10 19:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.94599999999999995,"15min":0.93700000000000006},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.54,"5min":3.996,"15min":3.996},"last":0.624},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.109,"15min":1.05},"min":{"1min":0.502,"5min":0.496,"15min":0.496},"max":{"1min":1.488,"5min":13.254,"15min":13.254},"last":0.93899999999999995}]},{"osd":5,"last update":"Sat Jun 10 19:08:04 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.1180000000000001,"15min":1.0509999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.476,"5min":6.9189999999999996,"15min":6.9189999999999996},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.2430000000000001,"15min":1.099},"min":{"1min":0.69999999999999996,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.6359999999999999,"5min":15.526,"15min":15.526},"last":0.95899999999999996}]},{"osd":6,"last update":"Sat Jun 10 19:08:04 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.129,"15min":1.0820000000000001},"min":{"1min":0.624,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.7769999999999999,"5min":8.7089999999999996,"15min":8.7089999999999996},"last":1.0820000000000001},{"interface":"front","average":{"1min":0.95699999999999996,"5min":1.054,"15min":1.054},"min":{"1min":0.58399999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.319,"5min":6.1299999999999999,"15min":6.1299999999999999},"last":0.91300000000000003}]},{"osd":7,"last update":"Sat Jun 10 19:08:04 2023","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.2969999999999999,"15min":1.169},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.57199999999999995},"max":{"1min":1.6890000000000001,"5min":12.138,"15min":12.138},"last":1.022},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0740000000000001,"15min":1.1100000000000001},"min":{"1min":0.66900000000000004,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":0.89000000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575040,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37348,"kb_used_data":2204,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334492,"statfs":{"total":96636764160,"available":96598519808,"internally_reserved":0,"allocated":2256896,"data_stored":1056167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.66400000000000003,"15min":0.67900000000000005},"min":{"1min":0.36699999999999999,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":1.0049999999999999,"5min":1.048,"15min":1.288},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.73499999999999999,"15min":0.749},"min":{"1min":0.44900000000000001,"5min":0.32300000000000001,"15min":0.26900000000000002},"max":{"1min":1.008,"5min":1.615,"15min":1.694},"last":0.44900000000000001}]},{"osd":2,"last update":"Sat Jun 10 19:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.621,"15min":0.63400000000000001},"min":{"1min":0.376,"5min":0.29699999999999999,"15min":0.249},"max":{"1min":0.81999999999999995,"5min":0.94699999999999995,"15min":1.21},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.70399999999999996,"15min":0.72499999999999998},"min":{"1min":0.33000000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.071,"5min":1.2390000000000001,"15min":1.415},"last":0.48999999999999999}]},{"osd":3,"last update":"Sat Jun 10 19:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.748,"15min":0.77800000000000002},"min":{"1min":0.38900000000000001,"5min":0.34000000000000002,"15min":0.25600000000000001},"max":{"1min":0.995,"5min":1.143,"15min":1.6299999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.69499999999999995,"15min":0.72799999999999998},"min":{"1min":0.46500000000000002,"5min":0.36099999999999999,"15min":0.29599999999999999},"max":{"1min":1.0289999999999999,"5min":1.2709999999999999,"15min":2.1749999999999998},"last":0.53400000000000003}]},{"osd":4,"last update":"Sat Jun 10 19:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.87,"15min":0.871},"min":{"1min":0.61899999999999999,"5min":0.58599999999999997,"15min":0.53000000000000003},"max":{"1min":1.3340000000000001,"5min":1.3620000000000001,"15min":1.4930000000000001},"last":1.0129999999999999},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.98799999999999999,"15min":1.024},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.47099999999999997},"max":{"1min":1.373,"5min":1.575,"15min":5.8209999999999997},"last":0.86899999999999999}]},{"osd":5,"last update":"Sat Jun 10 19:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.96999999999999997,"15min":0.98999999999999999},"min":{"1min":0.63900000000000001,"5min":0.54800000000000004,"15min":0.49399999999999999},"max":{"1min":1.1839999999999999,"5min":1.5720000000000001,"15min":1.8620000000000001},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.97699999999999998},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.46300000000000002},"max":{"1min":1.4299999999999999,"5min":1.448,"15min":3.089},"last":1.0760000000000001}]},{"osd":6,"last update":"Sat Jun 10 19:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.97699999999999998,"15min":1.044},"min":{"1min":0.61499999999999999,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.228,"5min":1.4950000000000001,"15min":7.2599999999999998},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.97999999999999998,"15min":1.034},"min":{"1min":0.60299999999999998,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":9.0069999999999997},"last":1.123}]},{"osd":7,"last update":"Sat Jun 10 19:08:07 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.04,"15min":1.073},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.495},"max":{"1min":1.4159999999999999,"5min":1.4890000000000001,"15min":2.105},"last":0.93999999999999995},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.05,"15min":1.0780000000000001},"min":{"1min":0.67400000000000004,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.2829999999999999,"5min":1.526,"15min":2.2570000000000001},"last":1.044}]}]},{"osd":0,"up_from":13,"seq":55834575039,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37944,"kb_used_data":2800,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94333896,"statfs":{"total":96636764160,"available":96597909504,"internally_reserved":0,"allocated":2867200,"data_stored":1647263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jun 10 19:08:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.61599999999999999,"15min":0.63800000000000001},"min":{"1min":0.255,"5min":0.255,"15min":0.248},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.77400000000000002,"15min":0.80100000000000005},"min":{"1min":0.33000000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.0740000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.37}]},{"osd":2,"last update":"Sat Jun 10 19:08:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.69299999999999995,"15min":0.71299999999999997},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.98499999999999999,"5min":1.1970000000000001,"15min":1.2829999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.63500000000000001,"15min":0.65300000000000002},"min":{"1min":0.29999999999999999,"5min":0.28699999999999998,"15min":0.245},"max":{"1min":0.90600000000000003,"5min":1.1779999999999999,"15min":1.371},"last":0.312}]},{"osd":3,"last update":"Sat Jun 10 19:08:02 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.67000000000000004,"15min":0.68300000000000005},"min":{"1min":0.309,"5min":0.309,"15min":0.28899999999999998},"max":{"1min":1.1439999999999999,"5min":1.397,"15min":1.397},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.78200000000000003,"15min":0.81399999999999995},"min":{"1min":0.36399999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.1699999999999999,"5min":1.6240000000000001,"15min":1.829},"last":0.40100000000000002}]},{"osd":4,"last update":"Sat Jun 10 19:08:02 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.89300000000000002,"15min":0.91900000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.276,"5min":1.758,"15min":3.0209999999999999},"last":0.622},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.997,"15min":1.02},"min":{"1min":0.56200000000000006,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.224,"5min":1.873,"15min":1.9510000000000001},"last":0.77000000000000002}]},{"osd":5,"last update":"Sat Jun 10 19:08:02 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.88300000000000001,"15min":0.92100000000000004},"min":{"1min":0.51300000000000001,"5min":0.51200000000000001,"15min":0.45100000000000001},"max":{"1min":1.226,"5min":1.252,"15min":1.694},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.95899999999999996,"15min":1.0009999999999999},"min":{"1min":0.64800000000000002,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.321,"5min":1.9870000000000001,"15min":4.5620000000000003},"last":0.53100000000000003}]},{"osd":6,"last update":"Sat Jun 10 19:08:02 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.0289999999999999,"15min":1.0700000000000001},"min":{"1min":0.63700000000000001,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.3149999999999999,"5min":1.9330000000000001,"15min":3.5569999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.98699999999999999,"15min":0.999},"min":{"1min":0.56999999999999995,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.333,"5min":1.6599999999999999,"15min":1.883},"last":0.61099999999999999}]},{"osd":7,"last update":"Sat Jun 10 19:08:02 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.995,"15min":1.024},"min":{"1min":0.627,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.502,"5min":1.804,"15min":1.804},"last":0.78900000000000003},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0369999999999999,"15min":1.0569999999999999},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.58699999999999997},"max":{"1min":1.3720000000000001,"5min":2.1219999999999999,"15min":2.1219999999999999},"last":0.65200000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-10T19:08:08.319 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-06-10T19:08:08.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.473+0000 7fec9580b640 1 Processor -- start 2023-06-10T19:08:08.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.473+0000 7fec9580b640 1 -- start start 2023-06-10T19:08:08.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.477+0000 7fec9580b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fec900c9840 0x7fec900c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:08.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.477+0000 7fec9580b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fec9006b090 0x7fec9006b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:08.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.477+0000 7fec9580b640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec90159b50 con 0x7fec90071060 2023-06-10T19:08:08.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.477+0000 7fec9580b640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec900ca150 con 0x7fec900c9840 2023-06-10T19:08:08.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.477+0000 7fec9580b640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec900702a0 con 0x7fec9006b090 2023-06-10T19:08:08.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.477+0000 7fec8effd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fec900c9840 0x7fec900c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:08.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.477+0000 7fec8e7fc640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fec90071060 0x7fec900af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:45834/0 (socket says 172.21.15.53:45834) 2023-06-10T19:08:08.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.477+0000 7fec8e7fc640 1 -- 172.21.15.53:0/2776032614 learned_addr learned my addr 172.21.15.53:0/2776032614 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:08:08.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.477+0000 7fec8f7fe640 1 --2- 172.21.15.53:0/2776032614 >> v2:172.21.15.117:3300/0 conn(0x7fec9006b090 0x7fec9006b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:08.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.477+0000 7fec8effd640 1 -- 172.21.15.53:0/2776032614 >> v2:172.21.15.117:3300/0 conn(0x7fec9006b090 msgr2=0x7fec9006b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:08.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.477+0000 7fec8effd640 1 --2- 172.21.15.53:0/2776032614 >> v2:172.21.15.117:3300/0 conn(0x7fec9006b090 0x7fec9006b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:08.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.477+0000 7fec8effd640 1 -- 172.21.15.53:0/2776032614 >> v1:172.21.15.53:6789/0 conn(0x7fec90071060 legacy=0x7fec900af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:08.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.477+0000 7fec8effd640 1 -- 172.21.15.53:0/2776032614 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec90070580 con 0x7fec900c9840 2023-06-10T19:08:08.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.477+0000 7fec8f7fe640 1 --2- 172.21.15.53:0/2776032614 >> v2:172.21.15.117:3300/0 conn(0x7fec9006b090 0x7fec9006b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:08:08.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.477+0000 7fec8effd640 1 --2- 172.21.15.53:0/2776032614 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec900c9840 0x7fec900c9c10 secure :-1 s=READY pgs=2602 cs=0 l=1 rev1=1 crypto rx=0x7fec9015e360 tx=0x7fec8001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d769cbbd67f3adf server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:08.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.477+0000 7fec8dffb640 1 -- 172.21.15.53:0/2776032614 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec800a7070 con 0x7fec900c9840 2023-06-10T19:08:08.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.477+0000 7fec8dffb640 1 -- 172.21.15.53:0/2776032614 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec800ab430 con 0x7fec900c9840 2023-06-10T19:08:08.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.477+0000 7fec8dffb640 1 -- 172.21.15.53:0/2776032614 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec800ab7c0 con 0x7fec900c9840 2023-06-10T19:08:08.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.477+0000 7fec9580b640 1 -- 172.21.15.53:0/2776032614 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec900c9840 msgr2=0x7fec900c9c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:08.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.477+0000 7fec9580b640 1 --2- 172.21.15.53:0/2776032614 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec900c9840 0x7fec900c9c10 secure :-1 s=READY pgs=2602 cs=0 l=1 rev1=1 crypto rx=0x7fec9015e360 tx=0x7fec8001c430 comp rx=0 tx=0).stop 2023-06-10T19:08:08.482 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.477+0000 7fec9580b640 1 -- 172.21.15.53:0/2776032614 shutdown_connections 2023-06-10T19:08:08.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.477+0000 7fec9580b640 1 --2- 172.21.15.53:0/2776032614 >> v2:172.21.15.117:3300/0 conn(0x7fec9006b090 0x7fec9006b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:08.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.477+0000 7fec9580b640 1 --2- 172.21.15.53:0/2776032614 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec900c9840 0x7fec900c9c10 unknown :-1 s=CLOSED pgs=2602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:08.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.477+0000 7fec9580b640 1 -- 172.21.15.53:0/2776032614 >> 172.21.15.53:0/2776032614 conn(0x7fec9006a0d0 msgr2=0x7fec900ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:08.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.477+0000 7fec9580b640 1 -- 172.21.15.53:0/2776032614 shutdown_connections 2023-06-10T19:08:08.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.477+0000 7fec9580b640 1 -- 172.21.15.53:0/2776032614 wait complete. 2023-06-10T19:08:08.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.481+0000 7fec9580b640 1 Processor -- start 2023-06-10T19:08:08.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.481+0000 7fec9580b640 1 -- start start 2023-06-10T19:08:08.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.481+0000 7fec9580b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec9006b090 0x7fec900b35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:08.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.481+0000 7fec9580b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec90071060 0x7fec9015c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:08.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.481+0000 7fec9580b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec900c9840 0x7fec90157480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:08.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.481+0000 7fec9580b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec9015dba0 con 0x7fec900c9840 2023-06-10T19:08:08.485 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.481+0000 7fec9580b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec9015cf90 con 0x7fec9006b090 2023-06-10T19:08:08.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.481+0000 7fec9580b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec9015d270 con 0x7fec90071060 2023-06-10T19:08:08.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.481+0000 7fec8f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec900c9840 0x7fec90157480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:08.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.481+0000 7fec8f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec900c9840 0x7fec90157480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37014/0 (socket says 172.21.15.53:37014) 2023-06-10T19:08:08.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.481+0000 7fec8f7fe640 1 -- 172.21.15.53:0/840332846 learned_addr learned my addr 172.21.15.53:0/840332846 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:08:08.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.481+0000 7fec8e7fc640 1 --2- 172.21.15.53:0/840332846 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec90071060 0x7fec9015c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:08.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.481+0000 7fec8effd640 1 --2- 172.21.15.53:0/840332846 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec9006b090 0x7fec900b35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:08.486 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.481+0000 7fec8f7fe640 1 -- 172.21.15.53:0/840332846 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec90071060 msgr2=0x7fec9015c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:08.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.481+0000 7fec8f7fe640 1 --2- 172.21.15.53:0/840332846 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec90071060 0x7fec9015c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:08.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.481+0000 7fec8f7fe640 1 -- 172.21.15.53:0/840332846 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec9006b090 msgr2=0x7fec900b35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:08.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.481+0000 7fec8f7fe640 1 --2- 172.21.15.53:0/840332846 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec9006b090 0x7fec900b35d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:08.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.481+0000 7fec8f7fe640 1 -- 172.21.15.53:0/840332846 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec80009420 con 0x7fec900c9840 2023-06-10T19:08:08.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.481+0000 7fec8f7fe640 1 --2- 172.21.15.53:0/840332846 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec900c9840 0x7fec90157480 secure :-1 s=READY pgs=2603 cs=0 l=1 rev1=1 crypto rx=0x7fec8800cef0 tx=0x7fec8800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:08.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.481+0000 7fec77fff640 1 -- 172.21.15.53:0/840332846 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec8800d840 con 0x7fec900c9840 2023-06-10T19:08:08.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.481+0000 7fec77fff640 1 -- 172.21.15.53:0/840332846 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec8800d9c0 con 0x7fec900c9840 2023-06-10T19:08:08.487 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.481+0000 7fec9580b640 1 -- 172.21.15.53:0/840332846 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec9015d550 con 0x7fec900c9840 2023-06-10T19:08:08.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.481+0000 7fec77fff640 1 -- 172.21.15.53:0/840332846 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec8800dd70 con 0x7fec900c9840 2023-06-10T19:08:08.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.481+0000 7fec9580b640 1 -- 172.21.15.53:0/840332846 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec900b0b60 con 0x7fec900c9840 2023-06-10T19:08:08.488 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.481+0000 7fec9580b640 1 -- 172.21.15.53:0/840332846 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec9004d790 con 0x7fec900c9840 2023-06-10T19:08:08.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.485+0000 7fec77fff640 1 -- 172.21.15.53:0/840332846 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fec8801d360 con 0x7fec900c9840 2023-06-10T19:08:08.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.485+0000 7fec77fff640 1 --2- 172.21.15.53:0/840332846 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fec7c066280 0x7fec7c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:08.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.485+0000 7fec77fff640 1 -- 172.21.15.53:0/840332846 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fec88084b40 con 0x7fec900c9840 2023-06-10T19:08:08.489 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.485+0000 7fec8effd640 1 --2- 172.21.15.53:0/840332846 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fec7c066280 0x7fec7c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:08.490 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.485+0000 7fec8effd640 1 --2- 172.21.15.53:0/840332846 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fec7c066280 0x7fec7c068730 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7fec800af000 tx=0x7fec800a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:08.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.489+0000 7fec77fff640 1 -- 172.21.15.53:0/840332846 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fec880521f0 con 0x7fec900c9840 2023-06-10T19:08:08.503 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-10T19:08:08.505 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-10T19:08:08.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.701+0000 7fec9580b640 1 -- 172.21.15.53:0/840332846 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fec900cb140 con 0x7fec900c9840 2023-06-10T19:08:08.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.701+0000 7fec77fff640 1 -- 172.21.15.53:0/840332846 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1020 (secure 0 0 0) 0x7fec8801a080 con 0x7fec900c9840 2023-06-10T19:08:08.704 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:08:08.705 INFO:teuthology.orchestra.run.smithi053.stdout:{"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":947,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":180,"num_osds":8,"num_up_osds":8,"osd_up_since":1686423152,"num_in_osds":8,"osd_in_since":1686423143,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":23,"data_bytes":592730,"bytes_used":290451456,"bytes_avail":772803661824,"bytes_total":773094113280,"write_bytes_sec":2473,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":104,"id":12,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":12,"rank":0,"name":"c","status":"up:active","gid":11118}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":17,"modified":"2023-06-10T19:06:05.849274+0000","services":{}},"progress_events":{}} 2023-06-10T19:08:08.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.701+0000 7fec9580b640 1 -- 172.21.15.53:0/840332846 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fec7c066280 msgr2=0x7fec7c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:08.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.701+0000 7fec9580b640 1 --2- 172.21.15.53:0/840332846 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fec7c066280 0x7fec7c068730 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7fec800af000 tx=0x7fec800a7000 comp rx=0 tx=0).stop 2023-06-10T19:08:08.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.701+0000 7fec9580b640 1 -- 172.21.15.53:0/840332846 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec900c9840 msgr2=0x7fec90157480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:08.706 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.701+0000 7fec9580b640 1 --2- 172.21.15.53:0/840332846 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec900c9840 0x7fec90157480 secure :-1 s=READY pgs=2603 cs=0 l=1 rev1=1 crypto rx=0x7fec8800cef0 tx=0x7fec8800a710 comp rx=0 tx=0).stop 2023-06-10T19:08:08.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.705+0000 7fec9580b640 1 -- 172.21.15.53:0/840332846 shutdown_connections 2023-06-10T19:08:08.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.705+0000 7fec9580b640 1 --2- 172.21.15.53:0/840332846 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fec7c066280 0x7fec7c068730 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:08.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.705+0000 7fec9580b640 1 --2- 172.21.15.53:0/840332846 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fec900c9840 0x7fec90157480 unknown :-1 s=CLOSED pgs=2603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:08.707 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.705+0000 7fec9580b640 1 --2- 172.21.15.53:0/840332846 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec90071060 0x7fec9015c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:08.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.705+0000 7fec9580b640 1 --2- 172.21.15.53:0/840332846 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec9006b090 0x7fec900b35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:08.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.705+0000 7fec9580b640 1 -- 172.21.15.53:0/840332846 >> 172.21.15.53:0/840332846 conn(0x7fec9006a0d0 msgr2=0x7fec900c8f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:08.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.705+0000 7fec9580b640 1 -- 172.21.15.53:0/840332846 shutdown_connections 2023-06-10T19:08:08.708 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.705+0000 7fec9580b640 1 -- 172.21.15.53:0/840332846 wait complete. 2023-06-10T19:08:08.723 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-06-10T19:08:08.724 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-10T19:08:08.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.837+0000 7f3fac1a2640 1 Processor -- start 2023-06-10T19:08:08.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.837+0000 7f3fac1a2640 1 -- start start 2023-06-10T19:08:08.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.837+0000 7f3fac1a2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3fa40cb870 0x7f3fa40af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:08.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.837+0000 7f3fac1a2640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3fa40afc60 0x7f3fa40aba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:08.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.837+0000 7f3fac1a2640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fa41600d0 con 0x7f3fa40c9750 2023-06-10T19:08:08.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.837+0000 7f3fac1a2640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fa40cd990 con 0x7f3fa40afc60 2023-06-10T19:08:08.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.837+0000 7f3fac1a2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa40b00e0 con 0x7f3fa40cb870 2023-06-10T19:08:08.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.837+0000 7f3fa9f3e640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f3fa40c9750 0x7f3fa40aced0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:45836/0 (socket says 172.21.15.53:45836) 2023-06-10T19:08:08.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.837+0000 7f3fa9f3e640 1 -- 172.21.15.53:0/2911746236 learned_addr learned my addr 172.21.15.53:0/2911746236 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:08:08.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.837+0000 7f3faa73f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3fa40afc60 0x7f3fa40aba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:08.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.837+0000 7f3fa973d640 1 --2- 172.21.15.53:0/2911746236 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3fa40cb870 0x7f3fa40af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:08.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.837+0000 7f3faa73f640 1 -- 172.21.15.53:0/2911746236 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3fa40cb870 msgr2=0x7f3fa40af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:08.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.837+0000 7f3faa73f640 1 --2- 172.21.15.53:0/2911746236 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3fa40cb870 0x7f3fa40af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:08.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.837+0000 7f3faa73f640 1 -- 172.21.15.53:0/2911746236 >> v1:172.21.15.53:6789/0 conn(0x7f3fa40c9750 legacy=0x7f3fa40aced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:08.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.837+0000 7f3faa73f640 1 -- 172.21.15.53:0/2911746236 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fa4160370 con 0x7f3fa40afc60 2023-06-10T19:08:08.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.837+0000 7f3fa8f3c640 1 -- 172.21.15.53:0/2911746236 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3714923805 0 0) 0x7f3fa41600d0 con 0x7f3fa40c9750 2023-06-10T19:08:08.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.841+0000 7f3faa73f640 1 --2- 172.21.15.53:0/2911746236 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3fa40afc60 0x7f3fa40aba10 secure :-1 s=READY pgs=2605 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c009d90 tx=0x7f3f9c01c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfed6475150a4e97 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:08.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.841+0000 7f3fa8f3c640 1 -- 172.21.15.53:0/2911746236 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c0a5920 con 0x7f3fa40afc60 2023-06-10T19:08:08.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.841+0000 7f3fa8f3c640 1 -- 172.21.15.53:0/2911746236 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f9c0a5a80 con 0x7f3fa40afc60 2023-06-10T19:08:08.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.841+0000 7f3fa8f3c640 1 -- 172.21.15.53:0/2911746236 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c0a5e10 con 0x7f3fa40afc60 2023-06-10T19:08:08.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.841+0000 7f3fac1a2640 1 -- 172.21.15.53:0/2911746236 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3fa40afc60 msgr2=0x7f3fa40aba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:08.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.841+0000 7f3fac1a2640 1 --2- 172.21.15.53:0/2911746236 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3fa40afc60 0x7f3fa40aba10 secure :-1 s=READY pgs=2605 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c009d90 tx=0x7f3f9c01c950 comp rx=0 tx=0).stop 2023-06-10T19:08:08.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.841+0000 7f3fac1a2640 1 -- 172.21.15.53:0/2911746236 shutdown_connections 2023-06-10T19:08:08.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.841+0000 7f3fac1a2640 1 --2- 172.21.15.53:0/2911746236 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3fa40afc60 0x7f3fa40aba10 unknown :-1 s=CLOSED pgs=2605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:08.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.841+0000 7f3fac1a2640 1 --2- 172.21.15.53:0/2911746236 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3fa40cb870 0x7f3fa40af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:08.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.841+0000 7f3fac1a2640 1 -- 172.21.15.53:0/2911746236 >> 172.21.15.53:0/2911746236 conn(0x7f3fa406a0d0 msgr2=0x7f3fa40ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:08.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.841+0000 7f3fac1a2640 1 -- 172.21.15.53:0/2911746236 shutdown_connections 2023-06-10T19:08:08.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.841+0000 7f3fac1a2640 1 -- 172.21.15.53:0/2911746236 wait complete. 2023-06-10T19:08:08.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.841+0000 7f3fac1a2640 1 Processor -- start 2023-06-10T19:08:08.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.841+0000 7f3fac1a2640 1 -- start start 2023-06-10T19:08:08.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.845+0000 7f3fac1a2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3fa40afc60 0x7f3fa41510d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:08.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.845+0000 7f3fac1a2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3fa40c9750 0x7f3fa415e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:08.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.845+0000 7f3fac1a2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3fa40cb870 0x7f3fa415e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:08.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.845+0000 7f3fac1a2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa4152b60 con 0x7f3fa40afc60 2023-06-10T19:08:08.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.845+0000 7f3fac1a2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa415ecf0 con 0x7f3fa40c9750 2023-06-10T19:08:08.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.845+0000 7f3fac1a2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa4152e00 con 0x7f3fa40cb870 2023-06-10T19:08:08.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.845+0000 7f3fa9f3e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3fa40afc60 0x7f3fa41510d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:08.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.845+0000 7f3fa9f3e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3fa40afc60 0x7f3fa41510d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37034/0 (socket says 172.21.15.53:37034) 2023-06-10T19:08:08.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.845+0000 7f3fa9f3e640 1 -- 172.21.15.53:0/1006902321 learned_addr learned my addr 172.21.15.53:0/1006902321 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:08:08.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.845+0000 7f3faa73f640 1 --2- 172.21.15.53:0/1006902321 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3fa40cb870 0x7f3fa415e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:08.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.845+0000 7f3fa973d640 1 --2- 172.21.15.53:0/1006902321 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3fa40c9750 0x7f3fa415e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:08.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.845+0000 7f3fa9f3e640 1 -- 172.21.15.53:0/1006902321 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3fa40cb870 msgr2=0x7f3fa415e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:08.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.845+0000 7f3fa9f3e640 1 --2- 172.21.15.53:0/1006902321 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3fa40cb870 0x7f3fa415e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:08.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.845+0000 7f3fa9f3e640 1 -- 172.21.15.53:0/1006902321 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3fa40c9750 msgr2=0x7f3fa415e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:08.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.845+0000 7f3fa9f3e640 1 --2- 172.21.15.53:0/1006902321 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3fa40c9750 0x7f3fa415e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:08.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.845+0000 7f3fa9f3e640 1 -- 172.21.15.53:0/1006902321 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f9c009a70 con 0x7f3fa40afc60 2023-06-10T19:08:08.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.845+0000 7f3fa9f3e640 1 --2- 172.21.15.53:0/1006902321 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3fa40afc60 0x7f3fa41510d0 secure :-1 s=READY pgs=2606 cs=0 l=1 rev1=1 crypto rx=0x7f3fa00011f0 tx=0x7f3fa000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:08.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.845+0000 7f3f9a7fc640 1 -- 172.21.15.53:0/1006902321 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa00074e0 con 0x7f3fa40afc60 2023-06-10T19:08:08.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.845+0000 7f3f9a7fc640 1 -- 172.21.15.53:0/1006902321 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fa0007640 con 0x7f3fa40afc60 2023-06-10T19:08:08.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.845+0000 7f3fac1a2640 1 -- 172.21.15.53:0/1006902321 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fa41530e0 con 0x7f3fa40afc60 2023-06-10T19:08:08.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.845+0000 7f3f9a7fc640 1 -- 172.21.15.53:0/1006902321 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa0004a10 con 0x7f3fa40afc60 2023-06-10T19:08:08.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.845+0000 7f3fac1a2640 1 -- 172.21.15.53:0/1006902321 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fa415efd0 con 0x7f3fa40afc60 2023-06-10T19:08:08.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.845+0000 7f3fac1a2640 1 -- 172.21.15.53:0/1006902321 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fa404d790 con 0x7f3fa40afc60 2023-06-10T19:08:08.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.845+0000 7f3f9a7fc640 1 -- 172.21.15.53:0/1006902321 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3fa0004b70 con 0x7f3fa40afc60 2023-06-10T19:08:08.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.845+0000 7f3f9a7fc640 1 --2- 172.21.15.53:0/1006902321 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3f88066280 0x7f3f88068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:08.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.845+0000 7f3f9a7fc640 1 -- 172.21.15.53:0/1006902321 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3fa00832a0 con 0x7f3fa40afc60 2023-06-10T19:08:08.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.845+0000 7f3fa973d640 1 --2- 172.21.15.53:0/1006902321 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3f88066280 0x7f3f88068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:08.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.849+0000 7f3fa973d640 1 --2- 172.21.15.53:0/1006902321 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3f88066280 0x7f3f88068730 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f3fa406b590 tx=0x7f3f94008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:08.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.849+0000 7f3f9a7fc640 1 -- 172.21.15.53:0/1006902321 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3fa0050710 con 0x7f3fa40afc60 2023-06-10T19:08:08.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:08.993+0000 7f3fac1a2640 1 -- 172.21.15.53:0/1006902321 --> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3fa40ac760 con 0x7f3f88066280 2023-06-10T19:08:09.019 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:09.017+0000 7f3f9a7fc640 1 -- 172.21.15.53:0/1006902321 <== mgr.4105 v2:172.21.15.117:6832/3061986771 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310419 (secure 0 0 0) 0x7f3f9400e510 con 0x7f3f88066280 2023-06-10T19:08:09.022 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:08:09.023 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-06-10T19:08:09.024 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:09.021+0000 7f3fac1a2640 1 -- 172.21.15.53:0/1006902321 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3f88066280 msgr2=0x7f3f88068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:09.024 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:09.021+0000 7f3fac1a2640 1 --2- 172.21.15.53:0/1006902321 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3f88066280 0x7f3f88068730 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f3fa406b590 tx=0x7f3f94008040 comp rx=0 tx=0).stop 2023-06-10T19:08:09.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:09.021+0000 7f3fac1a2640 1 -- 172.21.15.53:0/1006902321 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3fa40afc60 msgr2=0x7f3fa41510d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:09.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:09.021+0000 7f3fac1a2640 1 --2- 172.21.15.53:0/1006902321 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3fa40afc60 0x7f3fa41510d0 secure :-1 s=READY pgs=2606 cs=0 l=1 rev1=1 crypto rx=0x7f3fa00011f0 tx=0x7f3fa000c9b0 comp rx=0 tx=0).stop 2023-06-10T19:08:09.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:09.021+0000 7f3fac1a2640 1 -- 172.21.15.53:0/1006902321 shutdown_connections 2023-06-10T19:08:09.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:09.021+0000 7f3fac1a2640 1 --2- 172.21.15.53:0/1006902321 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3f88066280 0x7f3f88068730 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:09.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:09.021+0000 7f3fac1a2640 1 --2- 172.21.15.53:0/1006902321 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3fa40cb870 0x7f3fa415e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:09.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:09.021+0000 7f3fac1a2640 1 --2- 172.21.15.53:0/1006902321 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3fa40c9750 0x7f3fa415e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:09.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:09.021+0000 7f3fac1a2640 1 --2- 172.21.15.53:0/1006902321 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3fa40afc60 0x7f3fa41510d0 unknown :-1 s=CLOSED pgs=2606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:09.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:09.021+0000 7f3fac1a2640 1 -- 172.21.15.53:0/1006902321 >> 172.21.15.53:0/1006902321 conn(0x7f3fa406a0d0 msgr2=0x7f3fa40723f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:09.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:09.021+0000 7f3fac1a2640 1 -- 172.21.15.53:0/1006902321 shutdown_connections 2023-06-10T19:08:09.026 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:09.021+0000 7f3fac1a2640 1 -- 172.21.15.53:0/1006902321 wait complete. 2023-06-10T19:08:09.039 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":641,"stamp":"2023-06-10T19:08:07.921368+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":189,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":283644,"kb_used_data":18876,"kb_used_omap":0,"kb_used_meta":264704,"kb_avail":754691076,"statfs":{"total":773094113280,"available":772803661824,"internally_reserved":0,"allocated":19329024,"data_stored":9639891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":271056896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":70,"apply_latency_ms":70,"commit_latency_ns":70000000,"apply_latency_ns":70000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.796407"},"pg_stats":[{"pgid":"26.3f","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.439690+0000","last_change":"2023-06-10T19:08:03.575556+0000","last_active":"2023-06-10T19:08:05.439690+0000","last_peered":"2023-06-10T19:08:05.439690+0000","last_clean":"2023-06-10T19:08:05.439690+0000","last_became_active":"2023-06-10T19:08:03.575222+0000","last_became_peered":"2023-06-10T19:08:03.575222+0000","last_unstale":"2023-06-10T19:08:05.439690+0000","last_undegraded":"2023-06-10T19:08:05.439690+0000","last_fullsized":"2023-06-10T19:08:05.439690+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:22:30.167111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3e","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.441217+0000","last_change":"2023-06-10T19:08:03.581644+0000","last_active":"2023-06-10T19:08:05.441217+0000","last_peered":"2023-06-10T19:08:05.441217+0000","last_clean":"2023-06-10T19:08:05.441217+0000","last_became_active":"2023-06-10T19:08:03.581353+0000","last_became_peered":"2023-06-10T19:08:03.581353+0000","last_unstale":"2023-06-10T19:08:05.441217+0000","last_undegraded":"2023-06-10T19:08:05.441217+0000","last_fullsized":"2023-06-10T19:08:05.441217+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:34:20.169478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3d","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.244396+0000","last_change":"2023-06-10T19:08:03.557650+0000","last_active":"2023-06-10T19:08:05.244396+0000","last_peered":"2023-06-10T19:08:05.244396+0000","last_clean":"2023-06-10T19:08:05.244396+0000","last_became_active":"2023-06-10T19:08:03.556913+0000","last_became_peered":"2023-06-10T19:08:03.556913+0000","last_unstale":"2023-06-10T19:08:05.244396+0000","last_undegraded":"2023-06-10T19:08:05.244396+0000","last_fullsized":"2023-06-10T19:08:05.244396+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:38:21.683477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.3c","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.440951+0000","last_change":"2023-06-10T19:08:03.572223+0000","last_active":"2023-06-10T19:08:05.440951+0000","last_peered":"2023-06-10T19:08:05.440951+0000","last_clean":"2023-06-10T19:08:05.440951+0000","last_became_active":"2023-06-10T19:08:03.571913+0000","last_became_peered":"2023-06-10T19:08:03.571913+0000","last_unstale":"2023-06-10T19:08:05.440951+0000","last_undegraded":"2023-06-10T19:08:05.440951+0000","last_fullsized":"2023-06-10T19:08:05.440951+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:11:05.679837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.3b","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.439104+0000","last_change":"2023-06-10T19:08:03.555093+0000","last_active":"2023-06-10T19:08:05.439104+0000","last_peered":"2023-06-10T19:08:05.439104+0000","last_clean":"2023-06-10T19:08:05.439104+0000","last_became_active":"2023-06-10T19:08:03.554763+0000","last_became_peered":"2023-06-10T19:08:03.554763+0000","last_unstale":"2023-06-10T19:08:05.439104+0000","last_undegraded":"2023-06-10T19:08:05.439104+0000","last_fullsized":"2023-06-10T19:08:05.439104+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:39:08.089129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.3a","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.438595+0000","last_change":"2023-06-10T19:08:03.543709+0000","last_active":"2023-06-10T19:08:05.438595+0000","last_peered":"2023-06-10T19:08:05.438595+0000","last_clean":"2023-06-10T19:08:05.438595+0000","last_became_active":"2023-06-10T19:08:03.543432+0000","last_became_peered":"2023-06-10T19:08:03.543432+0000","last_unstale":"2023-06-10T19:08:05.438595+0000","last_undegraded":"2023-06-10T19:08:05.438595+0000","last_fullsized":"2023-06-10T19:08:05.438595+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:27:03.026315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.39","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.533417+0000","last_change":"2023-06-10T19:08:03.574642+0000","last_active":"2023-06-10T19:08:04.533417+0000","last_peered":"2023-06-10T19:08:04.533417+0000","last_clean":"2023-06-10T19:08:04.533417+0000","last_became_active":"2023-06-10T19:08:03.574385+0000","last_became_peered":"2023-06-10T19:08:03.574385+0000","last_unstale":"2023-06-10T19:08:04.533417+0000","last_undegraded":"2023-06-10T19:08:04.533417+0000","last_fullsized":"2023-06-10T19:08:04.533417+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:15:50.917829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.38","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.437562+0000","last_change":"2023-06-10T19:08:03.589461+0000","last_active":"2023-06-10T19:08:05.437562+0000","last_peered":"2023-06-10T19:08:05.437562+0000","last_clean":"2023-06-10T19:08:05.437562+0000","last_became_active":"2023-06-10T19:08:03.588966+0000","last_became_peered":"2023-06-10T19:08:03.588966+0000","last_unstale":"2023-06-10T19:08:05.437562+0000","last_undegraded":"2023-06-10T19:08:05.437562+0000","last_fullsized":"2023-06-10T19:08:05.437562+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:51:35.859527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.37","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.440062+0000","last_change":"2023-06-10T19:08:03.568419+0000","last_active":"2023-06-10T19:08:05.440062+0000","last_peered":"2023-06-10T19:08:05.440062+0000","last_clean":"2023-06-10T19:08:05.440062+0000","last_became_active":"2023-06-10T19:08:03.568097+0000","last_became_peered":"2023-06-10T19:08:03.568097+0000","last_unstale":"2023-06-10T19:08:05.440062+0000","last_undegraded":"2023-06-10T19:08:05.440062+0000","last_fullsized":"2023-06-10T19:08:05.440062+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:55:46.751696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.36","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.439403+0000","last_change":"2023-06-10T19:08:03.565351+0000","last_active":"2023-06-10T19:08:05.439403+0000","last_peered":"2023-06-10T19:08:05.439403+0000","last_clean":"2023-06-10T19:08:05.439403+0000","last_became_active":"2023-06-10T19:08:03.565034+0000","last_became_peered":"2023-06-10T19:08:03.565034+0000","last_unstale":"2023-06-10T19:08:05.439403+0000","last_undegraded":"2023-06-10T19:08:05.439403+0000","last_fullsized":"2023-06-10T19:08:05.439403+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:31:39.270453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.35","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.539365+0000","last_change":"2023-06-10T19:08:03.570891+0000","last_active":"2023-06-10T19:08:04.539365+0000","last_peered":"2023-06-10T19:08:04.539365+0000","last_clean":"2023-06-10T19:08:04.539365+0000","last_became_active":"2023-06-10T19:08:03.569883+0000","last_became_peered":"2023-06-10T19:08:03.569883+0000","last_unstale":"2023-06-10T19:08:04.539365+0000","last_undegraded":"2023-06-10T19:08:04.539365+0000","last_fullsized":"2023-06-10T19:08:04.539365+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:12:08.569775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.34","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.441338+0000","last_change":"2023-06-10T19:08:03.574028+0000","last_active":"2023-06-10T19:08:05.441338+0000","last_peered":"2023-06-10T19:08:05.441338+0000","last_clean":"2023-06-10T19:08:05.441338+0000","last_became_active":"2023-06-10T19:08:03.573632+0000","last_became_peered":"2023-06-10T19:08:03.573632+0000","last_unstale":"2023-06-10T19:08:05.441338+0000","last_undegraded":"2023-06-10T19:08:05.441338+0000","last_fullsized":"2023-06-10T19:08:05.441338+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:30:36.830089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.33","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.536731+0000","last_change":"2023-06-10T19:08:03.566388+0000","last_active":"2023-06-10T19:08:04.536731+0000","last_peered":"2023-06-10T19:08:04.536731+0000","last_clean":"2023-06-10T19:08:04.536731+0000","last_became_active":"2023-06-10T19:08:03.565605+0000","last_became_peered":"2023-06-10T19:08:03.565605+0000","last_unstale":"2023-06-10T19:08:04.536731+0000","last_undegraded":"2023-06-10T19:08:04.536731+0000","last_fullsized":"2023-06-10T19:08:04.536731+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:45:00.452073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.32","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.533578+0000","last_change":"2023-06-10T19:08:03.580410+0000","last_active":"2023-06-10T19:08:04.533578+0000","last_peered":"2023-06-10T19:08:04.533578+0000","last_clean":"2023-06-10T19:08:04.533578+0000","last_became_active":"2023-06-10T19:08:03.580054+0000","last_became_peered":"2023-06-10T19:08:03.580054+0000","last_unstale":"2023-06-10T19:08:04.533578+0000","last_undegraded":"2023-06-10T19:08:04.533578+0000","last_fullsized":"2023-06-10T19:08:04.533578+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:30:47.377068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.31","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.442464+0000","last_change":"2023-06-10T19:08:03.580205+0000","last_active":"2023-06-10T19:08:05.442464+0000","last_peered":"2023-06-10T19:08:05.442464+0000","last_clean":"2023-06-10T19:08:05.442464+0000","last_became_active":"2023-06-10T19:08:03.579926+0000","last_became_peered":"2023-06-10T19:08:03.579926+0000","last_unstale":"2023-06-10T19:08:05.442464+0000","last_undegraded":"2023-06-10T19:08:05.442464+0000","last_fullsized":"2023-06-10T19:08:05.442464+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:49:07.876093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.30","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.438171+0000","last_change":"2023-06-10T19:08:03.555133+0000","last_active":"2023-06-10T19:08:05.438171+0000","last_peered":"2023-06-10T19:08:05.438171+0000","last_clean":"2023-06-10T19:08:05.438171+0000","last_became_active":"2023-06-10T19:08:03.554673+0000","last_became_peered":"2023-06-10T19:08:03.554673+0000","last_unstale":"2023-06-10T19:08:05.438171+0000","last_undegraded":"2023-06-10T19:08:05.438171+0000","last_fullsized":"2023-06-10T19:08:05.438171+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:31:28.670042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2f","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.440201+0000","last_change":"2023-06-10T19:08:03.575364+0000","last_active":"2023-06-10T19:08:05.440201+0000","last_peered":"2023-06-10T19:08:05.440201+0000","last_clean":"2023-06-10T19:08:05.440201+0000","last_became_active":"2023-06-10T19:08:03.575031+0000","last_became_peered":"2023-06-10T19:08:03.575031+0000","last_unstale":"2023-06-10T19:08:05.440201+0000","last_undegraded":"2023-06-10T19:08:05.440201+0000","last_fullsized":"2023-06-10T19:08:05.440201+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:47:14.294710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2e","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.538823+0000","last_change":"2023-06-10T19:08:03.564127+0000","last_active":"2023-06-10T19:08:04.538823+0000","last_peered":"2023-06-10T19:08:04.538823+0000","last_clean":"2023-06-10T19:08:04.538823+0000","last_became_active":"2023-06-10T19:08:03.561654+0000","last_became_peered":"2023-06-10T19:08:03.561654+0000","last_unstale":"2023-06-10T19:08:04.538823+0000","last_undegraded":"2023-06-10T19:08:04.538823+0000","last_fullsized":"2023-06-10T19:08:04.538823+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:17:19.866920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.2d","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.538139+0000","last_change":"2023-06-10T19:08:03.559671+0000","last_active":"2023-06-10T19:08:04.538139+0000","last_peered":"2023-06-10T19:08:04.538139+0000","last_clean":"2023-06-10T19:08:04.538139+0000","last_became_active":"2023-06-10T19:08:03.558832+0000","last_became_peered":"2023-06-10T19:08:03.558832+0000","last_unstale":"2023-06-10T19:08:04.538139+0000","last_undegraded":"2023-06-10T19:08:04.538139+0000","last_fullsized":"2023-06-10T19:08:04.538139+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:48:27.658228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.2c","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.438604+0000","last_change":"2023-06-10T19:08:03.573437+0000","last_active":"2023-06-10T19:08:05.438604+0000","last_peered":"2023-06-10T19:08:05.438604+0000","last_clean":"2023-06-10T19:08:05.438604+0000","last_became_active":"2023-06-10T19:08:03.573206+0000","last_became_peered":"2023-06-10T19:08:03.573206+0000","last_unstale":"2023-06-10T19:08:05.438604+0000","last_undegraded":"2023-06-10T19:08:05.438604+0000","last_fullsized":"2023-06-10T19:08:05.438604+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:30:19.348632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2b","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.442485+0000","last_change":"2023-06-10T19:08:03.568604+0000","last_active":"2023-06-10T19:08:05.442485+0000","last_peered":"2023-06-10T19:08:05.442485+0000","last_clean":"2023-06-10T19:08:05.442485+0000","last_became_active":"2023-06-10T19:08:03.568366+0000","last_became_peered":"2023-06-10T19:08:03.568366+0000","last_unstale":"2023-06-10T19:08:05.442485+0000","last_undegraded":"2023-06-10T19:08:05.442485+0000","last_fullsized":"2023-06-10T19:08:05.442485+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:40:21.429277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.2a","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.440306+0000","last_change":"2023-06-10T19:08:03.568151+0000","last_active":"2023-06-10T19:08:05.440306+0000","last_peered":"2023-06-10T19:08:05.440306+0000","last_clean":"2023-06-10T19:08:05.440306+0000","last_became_active":"2023-06-10T19:08:03.567926+0000","last_became_peered":"2023-06-10T19:08:03.567926+0000","last_unstale":"2023-06-10T19:08:05.440306+0000","last_undegraded":"2023-06-10T19:08:05.440306+0000","last_fullsized":"2023-06-10T19:08:05.440306+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:05:36.667178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.29","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.437662+0000","last_change":"2023-06-10T19:08:03.573925+0000","last_active":"2023-06-10T19:08:05.437662+0000","last_peered":"2023-06-10T19:08:05.437662+0000","last_clean":"2023-06-10T19:08:05.437662+0000","last_became_active":"2023-06-10T19:08:03.572886+0000","last_became_peered":"2023-06-10T19:08:03.572886+0000","last_unstale":"2023-06-10T19:08:05.437662+0000","last_undegraded":"2023-06-10T19:08:05.437662+0000","last_fullsized":"2023-06-10T19:08:05.437662+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:28:24.324507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.28","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.440520+0000","last_change":"2023-06-10T19:08:03.561608+0000","last_active":"2023-06-10T19:08:05.440520+0000","last_peered":"2023-06-10T19:08:05.440520+0000","last_clean":"2023-06-10T19:08:05.440520+0000","last_became_active":"2023-06-10T19:08:03.561249+0000","last_became_peered":"2023-06-10T19:08:03.561249+0000","last_unstale":"2023-06-10T19:08:05.440520+0000","last_undegraded":"2023-06-10T19:08:05.440520+0000","last_fullsized":"2023-06-10T19:08:05.440520+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:57:21.820651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.27","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.534214+0000","last_change":"2023-06-10T19:08:03.538974+0000","last_active":"2023-06-10T19:08:04.534214+0000","last_peered":"2023-06-10T19:08:04.534214+0000","last_clean":"2023-06-10T19:08:04.534214+0000","last_became_active":"2023-06-10T19:08:03.538215+0000","last_became_peered":"2023-06-10T19:08:03.538215+0000","last_unstale":"2023-06-10T19:08:04.534214+0000","last_undegraded":"2023-06-10T19:08:04.534214+0000","last_fullsized":"2023-06-10T19:08:04.534214+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:40:29.723633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.26","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.539663+0000","last_change":"2023-06-10T19:08:03.577904+0000","last_active":"2023-06-10T19:08:04.539663+0000","last_peered":"2023-06-10T19:08:04.539663+0000","last_clean":"2023-06-10T19:08:04.539663+0000","last_became_active":"2023-06-10T19:08:03.577155+0000","last_became_peered":"2023-06-10T19:08:03.577155+0000","last_unstale":"2023-06-10T19:08:04.539663+0000","last_undegraded":"2023-06-10T19:08:04.539663+0000","last_fullsized":"2023-06-10T19:08:04.539663+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:34:20.169478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.25","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.437985+0000","last_change":"2023-06-10T19:08:03.573553+0000","last_active":"2023-06-10T19:08:05.437985+0000","last_peered":"2023-06-10T19:08:05.437985+0000","last_clean":"2023-06-10T19:08:05.437985+0000","last_became_active":"2023-06-10T19:08:03.572800+0000","last_became_peered":"2023-06-10T19:08:03.572800+0000","last_unstale":"2023-06-10T19:08:05.437985+0000","last_undegraded":"2023-06-10T19:08:05.437985+0000","last_fullsized":"2023-06-10T19:08:05.437985+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:48:58.816840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.24","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.438977+0000","last_change":"2023-06-10T19:08:03.555667+0000","last_active":"2023-06-10T19:08:05.438977+0000","last_peered":"2023-06-10T19:08:05.438977+0000","last_clean":"2023-06-10T19:08:05.438977+0000","last_became_active":"2023-06-10T19:08:03.555316+0000","last_became_peered":"2023-06-10T19:08:03.555316+0000","last_unstale":"2023-06-10T19:08:05.438977+0000","last_undegraded":"2023-06-10T19:08:05.438977+0000","last_fullsized":"2023-06-10T19:08:05.438977+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:57:21.587517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.23","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.538457+0000","last_change":"2023-06-10T19:08:03.553590+0000","last_active":"2023-06-10T19:08:04.538457+0000","last_peered":"2023-06-10T19:08:04.538457+0000","last_clean":"2023-06-10T19:08:04.538457+0000","last_became_active":"2023-06-10T19:08:03.551783+0000","last_became_peered":"2023-06-10T19:08:03.551783+0000","last_unstale":"2023-06-10T19:08:04.538457+0000","last_undegraded":"2023-06-10T19:08:04.538457+0000","last_fullsized":"2023-06-10T19:08:04.538457+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:38:26.169391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.22","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.537993+0000","last_change":"2023-06-10T19:08:03.569975+0000","last_active":"2023-06-10T19:08:04.537993+0000","last_peered":"2023-06-10T19:08:04.537993+0000","last_clean":"2023-06-10T19:08:04.537993+0000","last_became_active":"2023-06-10T19:08:03.568233+0000","last_became_peered":"2023-06-10T19:08:03.568233+0000","last_unstale":"2023-06-10T19:08:04.537993+0000","last_undegraded":"2023-06-10T19:08:04.537993+0000","last_fullsized":"2023-06-10T19:08:04.537993+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:33:41.215605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.21","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.533437+0000","last_change":"2023-06-10T19:08:03.545664+0000","last_active":"2023-06-10T19:08:04.533437+0000","last_peered":"2023-06-10T19:08:04.533437+0000","last_clean":"2023-06-10T19:08:04.533437+0000","last_became_active":"2023-06-10T19:08:03.545054+0000","last_became_peered":"2023-06-10T19:08:03.545054+0000","last_unstale":"2023-06-10T19:08:04.533437+0000","last_undegraded":"2023-06-10T19:08:04.533437+0000","last_fullsized":"2023-06-10T19:08:04.533437+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:41:32.159172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.20","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.438211+0000","last_change":"2023-06-10T19:08:03.565435+0000","last_active":"2023-06-10T19:08:05.438211+0000","last_peered":"2023-06-10T19:08:05.438211+0000","last_clean":"2023-06-10T19:08:05.438211+0000","last_became_active":"2023-06-10T19:08:03.565058+0000","last_became_peered":"2023-06-10T19:08:03.565058+0000","last_unstale":"2023-06-10T19:08:05.438211+0000","last_undegraded":"2023-06-10T19:08:05.438211+0000","last_fullsized":"2023-06-10T19:08:05.438211+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:55:18.316485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.438484+0000","last_change":"2023-06-10T19:08:03.587092+0000","last_active":"2023-06-10T19:08:05.438484+0000","last_peered":"2023-06-10T19:08:05.438484+0000","last_clean":"2023-06-10T19:08:05.438484+0000","last_became_active":"2023-06-10T19:08:03.586512+0000","last_became_peered":"2023-06-10T19:08:03.586512+0000","last_unstale":"2023-06-10T19:08:05.438484+0000","last_undegraded":"2023-06-10T19:08:05.438484+0000","last_fullsized":"2023-06-10T19:08:05.438484+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:12:33.443180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":13,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.439645+0000","last_change":"2023-06-10T19:08:03.165918+0000","last_active":"2023-06-10T19:08:05.439645+0000","last_peered":"2023-06-10T19:08:05.439645+0000","last_clean":"2023-06-10T19:08:05.439645+0000","last_became_active":"2023-06-10T19:08:03.165648+0000","last_became_peered":"2023-06-10T19:08:03.165648+0000","last_unstale":"2023-06-10T19:08:05.439645+0000","last_undegraded":"2023-06-10T19:08:05.439645+0000","last_fullsized":"2023-06-10T19:08:05.439645+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:14:55.405382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.15","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.439404+0000","last_change":"2023-06-10T19:08:03.541744+0000","last_active":"2023-06-10T19:08:05.439404+0000","last_peered":"2023-06-10T19:08:05.439404+0000","last_clean":"2023-06-10T19:08:05.439404+0000","last_became_active":"2023-06-10T19:08:03.541471+0000","last_became_peered":"2023-06-10T19:08:03.541471+0000","last_unstale":"2023-06-10T19:08:05.439404+0000","last_undegraded":"2023-06-10T19:08:05.439404+0000","last_fullsized":"2023-06-10T19:08:05.439404+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:02:50.763622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":13,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.441547+0000","last_change":"2023-06-10T19:08:03.173587+0000","last_active":"2023-06-10T19:08:05.441547+0000","last_peered":"2023-06-10T19:08:05.441547+0000","last_clean":"2023-06-10T19:08:05.441547+0000","last_became_active":"2023-06-10T19:08:03.172734+0000","last_became_peered":"2023-06-10T19:08:03.172734+0000","last_unstale":"2023-06-10T19:08:05.441547+0000","last_undegraded":"2023-06-10T19:08:05.441547+0000","last_fullsized":"2023-06-10T19:08:05.441547+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:11:48.025518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.538959+0000","last_change":"2023-06-10T19:08:03.563803+0000","last_active":"2023-06-10T19:08:04.538959+0000","last_peered":"2023-06-10T19:08:04.538959+0000","last_clean":"2023-06-10T19:08:04.538959+0000","last_became_active":"2023-06-10T19:08:03.560647+0000","last_became_peered":"2023-06-10T19:08:03.560647+0000","last_unstale":"2023-06-10T19:08:04.538959+0000","last_undegraded":"2023-06-10T19:08:04.538959+0000","last_fullsized":"2023-06-10T19:08:04.538959+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:16:21.139311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.15","version":"179'3","reported_seq":16,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.441891+0000","last_change":"2023-06-10T19:08:03.172100+0000","last_active":"2023-06-10T19:08:05.441891+0000","last_peered":"2023-06-10T19:08:05.441891+0000","last_clean":"2023-06-10T19:08:05.441891+0000","last_became_active":"2023-06-10T19:08:03.171685+0000","last_became_peered":"2023-06-10T19:08:03.171685+0000","last_unstale":"2023-06-10T19:08:05.441891+0000","last_undegraded":"2023-06-10T19:08:05.441891+0000","last_fullsized":"2023-06-10T19:08:05.441891+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:01:47.213952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.440445+0000","last_change":"2023-06-10T19:08:03.589150+0000","last_active":"2023-06-10T19:08:05.440445+0000","last_peered":"2023-06-10T19:08:05.440445+0000","last_clean":"2023-06-10T19:08:05.440445+0000","last_became_active":"2023-06-10T19:08:03.588891+0000","last_became_peered":"2023-06-10T19:08:03.588891+0000","last_unstale":"2023-06-10T19:08:05.440445+0000","last_undegraded":"2023-06-10T19:08:05.440445+0000","last_fullsized":"2023-06-10T19:08:05.440445+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:33:41.215605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.14","version":"179'6","reported_seq":19,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.537765+0000","last_change":"2023-06-10T19:08:03.155402+0000","last_active":"2023-06-10T19:08:04.537765+0000","last_peered":"2023-06-10T19:08:04.537765+0000","last_clean":"2023-06-10T19:08:04.537765+0000","last_became_active":"2023-06-10T19:08:03.154654+0000","last_became_peered":"2023-06-10T19:08:03.154654+0000","last_unstale":"2023-06-10T19:08:04.537765+0000","last_undegraded":"2023-06-10T19:08:04.537765+0000","last_fullsized":"2023-06-10T19:08:04.537765+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:42:56.995551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.10","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.533417+0000","last_change":"2023-06-10T19:08:03.563146+0000","last_active":"2023-06-10T19:08:04.533417+0000","last_peered":"2023-06-10T19:08:04.533417+0000","last_clean":"2023-06-10T19:08:04.533417+0000","last_became_active":"2023-06-10T19:08:03.562731+0000","last_became_peered":"2023-06-10T19:08:03.562731+0000","last_unstale":"2023-06-10T19:08:04.533417+0000","last_undegraded":"2023-06-10T19:08:04.533417+0000","last_fullsized":"2023-06-10T19:08:04.533417+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:33:16.922895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.13","version":"179'2","reported_seq":15,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.537152+0000","last_change":"2023-06-10T19:08:03.159168+0000","last_active":"2023-06-10T19:08:04.537152+0000","last_peered":"2023-06-10T19:08:04.537152+0000","last_clean":"2023-06-10T19:08:04.537152+0000","last_became_active":"2023-06-10T19:08:03.158413+0000","last_became_peered":"2023-06-10T19:08:03.158413+0000","last_unstale":"2023-06-10T19:08:04.537152+0000","last_undegraded":"2023-06-10T19:08:04.537152+0000","last_fullsized":"2023-06-10T19:08:04.537152+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:56:25.089543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.438011+0000","last_change":"2023-06-10T19:08:03.561865+0000","last_active":"2023-06-10T19:08:05.438011+0000","last_peered":"2023-06-10T19:08:05.438011+0000","last_clean":"2023-06-10T19:08:05.438011+0000","last_became_active":"2023-06-10T19:08:03.561538+0000","last_became_peered":"2023-06-10T19:08:03.561538+0000","last_unstale":"2023-06-10T19:08:05.438011+0000","last_undegraded":"2023-06-10T19:08:05.438011+0000","last_fullsized":"2023-06-10T19:08:05.438011+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:58:02.015111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":13,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.440897+0000","last_change":"2023-06-10T19:08:03.176624+0000","last_active":"2023-06-10T19:08:05.440897+0000","last_peered":"2023-06-10T19:08:05.440897+0000","last_clean":"2023-06-10T19:08:05.440897+0000","last_became_active":"2023-06-10T19:08:03.176279+0000","last_became_peered":"2023-06-10T19:08:03.176279+0000","last_unstale":"2023-06-10T19:08:05.440897+0000","last_undegraded":"2023-06-10T19:08:05.440897+0000","last_fullsized":"2023-06-10T19:08:05.440897+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:29:28.946876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.536731+0000","last_change":"2023-06-10T19:08:03.559686+0000","last_active":"2023-06-10T19:08:04.536731+0000","last_peered":"2023-06-10T19:08:04.536731+0000","last_clean":"2023-06-10T19:08:04.536731+0000","last_became_active":"2023-06-10T19:08:03.559011+0000","last_became_peered":"2023-06-10T19:08:03.559011+0000","last_unstale":"2023-06-10T19:08:04.536731+0000","last_undegraded":"2023-06-10T19:08:04.536731+0000","last_fullsized":"2023-06-10T19:08:04.536731+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:12:02.243967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":13,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.440895+0000","last_change":"2023-06-10T19:08:03.167973+0000","last_active":"2023-06-10T19:08:05.440895+0000","last_peered":"2023-06-10T19:08:05.440895+0000","last_clean":"2023-06-10T19:08:05.440895+0000","last_became_active":"2023-06-10T19:08:03.167618+0000","last_became_peered":"2023-06-10T19:08:03.167618+0000","last_unstale":"2023-06-10T19:08:05.440895+0000","last_undegraded":"2023-06-10T19:08:05.440895+0000","last_fullsized":"2023-06-10T19:08:05.440895+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:44:05.276389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.537175+0000","last_change":"2023-06-10T19:08:03.564884+0000","last_active":"2023-06-10T19:08:04.537175+0000","last_peered":"2023-06-10T19:08:04.537175+0000","last_clean":"2023-06-10T19:08:04.537175+0000","last_became_active":"2023-06-10T19:08:03.562409+0000","last_became_peered":"2023-06-10T19:08:03.562409+0000","last_unstale":"2023-06-10T19:08:04.537175+0000","last_undegraded":"2023-06-10T19:08:04.537175+0000","last_fullsized":"2023-06-10T19:08:04.537175+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:19:50.039523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.10","version":"179'8","reported_seq":21,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.537569+0000","last_change":"2023-06-10T19:08:03.162903+0000","last_active":"2023-06-10T19:08:04.537569+0000","last_peered":"2023-06-10T19:08:04.537569+0000","last_clean":"2023-06-10T19:08:04.537569+0000","last_became_active":"2023-06-10T19:08:03.162152+0000","last_became_peered":"2023-06-10T19:08:03.162152+0000","last_unstale":"2023-06-10T19:08:04.537569+0000","last_undegraded":"2023-06-10T19:08:04.537569+0000","last_fullsized":"2023-06-10T19:08:04.537569+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:05:35.663553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.533712+0000","last_change":"2023-06-10T19:08:03.544622+0000","last_active":"2023-06-10T19:08:04.533712+0000","last_peered":"2023-06-10T19:08:04.533712+0000","last_clean":"2023-06-10T19:08:04.533712+0000","last_became_active":"2023-06-10T19:08:03.544279+0000","last_became_peered":"2023-06-10T19:08:03.544279+0000","last_unstale":"2023-06-10T19:08:04.533712+0000","last_undegraded":"2023-06-10T19:08:04.533712+0000","last_fullsized":"2023-06-10T19:08:04.533712+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:54:35.028243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"179'1","reported_seq":14,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.539745+0000","last_change":"2023-06-10T19:08:03.163073+0000","last_active":"2023-06-10T19:08:04.539745+0000","last_peered":"2023-06-10T19:08:04.539745+0000","last_clean":"2023-06-10T19:08:04.539745+0000","last_became_active":"2023-06-10T19:08:03.162247+0000","last_became_peered":"2023-06-10T19:08:03.162247+0000","last_unstale":"2023-06-10T19:08:04.539745+0000","last_undegraded":"2023-06-10T19:08:04.539745+0000","last_fullsized":"2023-06-10T19:08:04.539745+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:11:48.025518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.d","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.438841+0000","last_change":"2023-06-10T19:08:03.565474+0000","last_active":"2023-06-10T19:08:05.438841+0000","last_peered":"2023-06-10T19:08:05.438841+0000","last_clean":"2023-06-10T19:08:05.438841+0000","last_became_active":"2023-06-10T19:08:03.565157+0000","last_became_peered":"2023-06-10T19:08:03.565157+0000","last_unstale":"2023-06-10T19:08:05.438841+0000","last_undegraded":"2023-06-10T19:08:05.438841+0000","last_fullsized":"2023-06-10T19:08:05.438841+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:33:14.902144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.e","version":"179'2","reported_seq":15,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.442076+0000","last_change":"2023-06-10T19:08:03.164758+0000","last_active":"2023-06-10T19:08:05.442076+0000","last_peered":"2023-06-10T19:08:05.442076+0000","last_clean":"2023-06-10T19:08:05.442076+0000","last_became_active":"2023-06-10T19:08:03.164339+0000","last_became_peered":"2023-06-10T19:08:03.164339+0000","last_unstale":"2023-06-10T19:08:05.442076+0000","last_undegraded":"2023-06-10T19:08:05.442076+0000","last_fullsized":"2023-06-10T19:08:05.442076+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T07:01:33.103419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.e","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.539905+0000","last_change":"2023-06-10T19:08:03.567884+0000","last_active":"2023-06-10T19:08:04.539905+0000","last_peered":"2023-06-10T19:08:04.539905+0000","last_clean":"2023-06-10T19:08:04.539905+0000","last_became_active":"2023-06-10T19:08:03.554317+0000","last_became_peered":"2023-06-10T19:08:03.554317+0000","last_unstale":"2023-06-10T19:08:04.539905+0000","last_undegraded":"2023-06-10T19:08:04.539905+0000","last_fullsized":"2023-06-10T19:08:04.539905+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:15:17.054842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.d","version":"179'1","reported_seq":14,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.244375+0000","last_change":"2023-06-10T19:08:03.172642+0000","last_active":"2023-06-10T19:08:05.244375+0000","last_peered":"2023-06-10T19:08:05.244375+0000","last_clean":"2023-06-10T19:08:05.244375+0000","last_became_active":"2023-06-10T19:08:03.171991+0000","last_became_peered":"2023-06-10T19:08:03.171991+0000","last_unstale":"2023-06-10T19:08:05.244375+0000","last_undegraded":"2023-06-10T19:08:05.244375+0000","last_fullsized":"2023-06-10T19:08:05.244375+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:42:19.801565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.f","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.440598+0000","last_change":"2023-06-10T19:08:03.542491+0000","last_active":"2023-06-10T19:08:05.440598+0000","last_peered":"2023-06-10T19:08:05.440598+0000","last_clean":"2023-06-10T19:08:05.440598+0000","last_became_active":"2023-06-10T19:08:03.542164+0000","last_became_peered":"2023-06-10T19:08:03.542164+0000","last_unstale":"2023-06-10T19:08:05.440598+0000","last_undegraded":"2023-06-10T19:08:05.440598+0000","last_fullsized":"2023-06-10T19:08:05.440598+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:44:03.212378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":13,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.539237+0000","last_change":"2023-06-10T19:08:03.169366+0000","last_active":"2023-06-10T19:08:04.539237+0000","last_peered":"2023-06-10T19:08:04.539237+0000","last_clean":"2023-06-10T19:08:04.539237+0000","last_became_active":"2023-06-10T19:08:03.168665+0000","last_became_peered":"2023-06-10T19:08:03.168665+0000","last_unstale":"2023-06-10T19:08:04.539237+0000","last_undegraded":"2023-06-10T19:08:04.539237+0000","last_fullsized":"2023-06-10T19:08:04.539237+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:49:04.339866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.440880+0000","last_change":"2023-06-10T19:08:03.541569+0000","last_active":"2023-06-10T19:08:05.440880+0000","last_peered":"2023-06-10T19:08:05.440880+0000","last_clean":"2023-06-10T19:08:05.440880+0000","last_became_active":"2023-06-10T19:08:03.541227+0000","last_became_peered":"2023-06-10T19:08:03.541227+0000","last_unstale":"2023-06-10T19:08:05.440880+0000","last_undegraded":"2023-06-10T19:08:05.440880+0000","last_fullsized":"2023-06-10T19:08:05.440880+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:12:08.569775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"179'2","reported_seq":15,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.537409+0000","last_change":"2023-06-10T19:08:03.163373+0000","last_active":"2023-06-10T19:08:04.537409+0000","last_peered":"2023-06-10T19:08:04.537409+0000","last_clean":"2023-06-10T19:08:04.537409+0000","last_became_active":"2023-06-10T19:08:03.162483+0000","last_became_peered":"2023-06-10T19:08:03.162483+0000","last_unstale":"2023-06-10T19:08:04.537409+0000","last_undegraded":"2023-06-10T19:08:04.537409+0000","last_fullsized":"2023-06-10T19:08:04.537409+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:32:57.503882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.440954+0000","last_change":"2023-06-10T19:08:03.563884+0000","last_active":"2023-06-10T19:08:05.440954+0000","last_peered":"2023-06-10T19:08:05.440954+0000","last_clean":"2023-06-10T19:08:05.440954+0000","last_became_active":"2023-06-10T19:08:03.563454+0000","last_became_peered":"2023-06-10T19:08:03.563454+0000","last_unstale":"2023-06-10T19:08:05.440954+0000","last_undegraded":"2023-06-10T19:08:05.440954+0000","last_fullsized":"2023-06-10T19:08:05.440954+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:25:02.329031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":13,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.441707+0000","last_change":"2023-06-10T19:08:03.161103+0000","last_active":"2023-06-10T19:08:05.441707+0000","last_peered":"2023-06-10T19:08:05.441707+0000","last_clean":"2023-06-10T19:08:05.441707+0000","last_became_active":"2023-06-10T19:08:03.160619+0000","last_became_peered":"2023-06-10T19:08:03.160619+0000","last_unstale":"2023-06-10T19:08:05.441707+0000","last_undegraded":"2023-06-10T19:08:05.441707+0000","last_fullsized":"2023-06-10T19:08:05.441707+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:55:31.570596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.441467+0000","last_change":"2023-06-10T19:08:03.545518+0000","last_active":"2023-06-10T19:08:05.441467+0000","last_peered":"2023-06-10T19:08:05.441467+0000","last_clean":"2023-06-10T19:08:05.441467+0000","last_became_active":"2023-06-10T19:08:03.545178+0000","last_became_peered":"2023-06-10T19:08:03.545178+0000","last_unstale":"2023-06-10T19:08:05.441467+0000","last_undegraded":"2023-06-10T19:08:05.441467+0000","last_fullsized":"2023-06-10T19:08:05.441467+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:28:38.534049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":13,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.533782+0000","last_change":"2023-06-10T19:08:03.171072+0000","last_active":"2023-06-10T19:08:04.533782+0000","last_peered":"2023-06-10T19:08:04.533782+0000","last_clean":"2023-06-10T19:08:04.533782+0000","last_became_active":"2023-06-10T19:08:03.170735+0000","last_became_peered":"2023-06-10T19:08:03.170735+0000","last_unstale":"2023-06-10T19:08:04.533782+0000","last_undegraded":"2023-06-10T19:08:04.533782+0000","last_fullsized":"2023-06-10T19:08:04.533782+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:30:54.576376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.b","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.441538+0000","last_change":"2023-06-10T19:08:03.540526+0000","last_active":"2023-06-10T19:08:05.441538+0000","last_peered":"2023-06-10T19:08:05.441538+0000","last_clean":"2023-06-10T19:08:05.441538+0000","last_became_active":"2023-06-10T19:08:03.540261+0000","last_became_peered":"2023-06-10T19:08:03.540261+0000","last_unstale":"2023-06-10T19:08:05.441538+0000","last_undegraded":"2023-06-10T19:08:05.441538+0000","last_fullsized":"2023-06-10T19:08:05.441538+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:50:12.757760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":13,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.244074+0000","last_change":"2023-06-10T19:08:03.171194+0000","last_active":"2023-06-10T19:08:05.244074+0000","last_peered":"2023-06-10T19:08:05.244074+0000","last_clean":"2023-06-10T19:08:05.244074+0000","last_became_active":"2023-06-10T19:08:03.170379+0000","last_became_peered":"2023-06-10T19:08:03.170379+0000","last_unstale":"2023-06-10T19:08:05.244074+0000","last_undegraded":"2023-06-10T19:08:05.244074+0000","last_fullsized":"2023-06-10T19:08:05.244074+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:22:56.034087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.534064+0000","last_change":"2023-06-10T19:08:03.581234+0000","last_active":"2023-06-10T19:08:04.534064+0000","last_peered":"2023-06-10T19:08:04.534064+0000","last_clean":"2023-06-10T19:08:04.534064+0000","last_became_active":"2023-06-10T19:08:03.580975+0000","last_became_peered":"2023-06-10T19:08:03.580975+0000","last_unstale":"2023-06-10T19:08:04.534064+0000","last_undegraded":"2023-06-10T19:08:04.534064+0000","last_fullsized":"2023-06-10T19:08:04.534064+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:20:03.303403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.7","version":"179'2","reported_seq":15,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.442669+0000","last_change":"2023-06-10T19:08:03.169137+0000","last_active":"2023-06-10T19:08:05.442669+0000","last_peered":"2023-06-10T19:08:05.442669+0000","last_clean":"2023-06-10T19:08:05.442669+0000","last_became_active":"2023-06-10T19:08:03.168699+0000","last_became_peered":"2023-06-10T19:08:03.168699+0000","last_unstale":"2023-06-10T19:08:05.442669+0000","last_undegraded":"2023-06-10T19:08:05.442669+0000","last_fullsized":"2023-06-10T19:08:05.442669+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:59:46.381568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.442326+0000","last_change":"2023-06-10T19:08:03.546672+0000","last_active":"2023-06-10T19:08:05.442326+0000","last_peered":"2023-06-10T19:08:05.442326+0000","last_clean":"2023-06-10T19:08:05.442326+0000","last_became_active":"2023-06-10T19:08:03.546335+0000","last_became_peered":"2023-06-10T19:08:03.546335+0000","last_unstale":"2023-06-10T19:08:05.442326+0000","last_undegraded":"2023-06-10T19:08:05.442326+0000","last_fullsized":"2023-06-10T19:08:05.442326+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:00:24.679984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":13,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.533784+0000","last_change":"2023-06-10T19:08:03.171145+0000","last_active":"2023-06-10T19:08:04.533784+0000","last_peered":"2023-06-10T19:08:04.533784+0000","last_clean":"2023-06-10T19:08:04.533784+0000","last_became_active":"2023-06-10T19:08:03.170771+0000","last_became_peered":"2023-06-10T19:08:03.170771+0000","last_unstale":"2023-06-10T19:08:04.533784+0000","last_undegraded":"2023-06-10T19:08:04.533784+0000","last_fullsized":"2023-06-10T19:08:04.533784+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:41:25.258785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.438355+0000","last_change":"2023-06-10T19:08:03.575290+0000","last_active":"2023-06-10T19:08:05.438355+0000","last_peered":"2023-06-10T19:08:05.438355+0000","last_clean":"2023-06-10T19:08:05.438355+0000","last_became_active":"2023-06-10T19:08:03.574628+0000","last_became_peered":"2023-06-10T19:08:03.574628+0000","last_unstale":"2023-06-10T19:08:05.438355+0000","last_undegraded":"2023-06-10T19:08:05.438355+0000","last_fullsized":"2023-06-10T19:08:05.438355+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:54:08.024569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":13,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.439628+0000","last_change":"2023-06-10T19:08:03.161120+0000","last_active":"2023-06-10T19:08:05.439628+0000","last_peered":"2023-06-10T19:08:05.439628+0000","last_clean":"2023-06-10T19:08:05.439628+0000","last_became_active":"2023-06-10T19:08:03.160739+0000","last_became_peered":"2023-06-10T19:08:03.160739+0000","last_unstale":"2023-06-10T19:08:05.439628+0000","last_undegraded":"2023-06-10T19:08:05.439628+0000","last_fullsized":"2023-06-10T19:08:05.439628+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:17:42.867012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.7","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.534445+0000","last_change":"2023-06-10T19:08:03.555628+0000","last_active":"2023-06-10T19:08:04.534445+0000","last_peered":"2023-06-10T19:08:04.534445+0000","last_clean":"2023-06-10T19:08:04.534445+0000","last_became_active":"2023-06-10T19:08:03.555125+0000","last_became_peered":"2023-06-10T19:08:03.555125+0000","last_unstale":"2023-06-10T19:08:04.534445+0000","last_undegraded":"2023-06-10T19:08:04.534445+0000","last_fullsized":"2023-06-10T19:08:04.534445+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:19:03.383699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":13,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.439235+0000","last_change":"2023-06-10T19:08:03.170457+0000","last_active":"2023-06-10T19:08:05.439235+0000","last_peered":"2023-06-10T19:08:05.439235+0000","last_clean":"2023-06-10T19:08:05.439235+0000","last_became_active":"2023-06-10T19:08:03.170163+0000","last_became_peered":"2023-06-10T19:08:03.170163+0000","last_unstale":"2023-06-10T19:08:05.439235+0000","last_undegraded":"2023-06-10T19:08:05.439235+0000","last_fullsized":"2023-06-10T19:08:05.439235+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:48:07.813977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.244239+0000","last_change":"2023-06-10T19:08:03.559882+0000","last_active":"2023-06-10T19:08:05.244239+0000","last_peered":"2023-06-10T19:08:05.244239+0000","last_clean":"2023-06-10T19:08:05.244239+0000","last_became_active":"2023-06-10T19:08:03.559081+0000","last_became_peered":"2023-06-10T19:08:03.559081+0000","last_unstale":"2023-06-10T19:08:05.244239+0000","last_undegraded":"2023-06-10T19:08:05.244239+0000","last_fullsized":"2023-06-10T19:08:05.244239+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:45:59.707914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":13,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.437424+0000","last_change":"2023-06-10T19:08:03.160092+0000","last_active":"2023-06-10T19:08:05.437424+0000","last_peered":"2023-06-10T19:08:05.437424+0000","last_clean":"2023-06-10T19:08:05.437424+0000","last_became_active":"2023-06-10T19:08:03.159264+0000","last_became_peered":"2023-06-10T19:08:03.159264+0000","last_unstale":"2023-06-10T19:08:05.437424+0000","last_undegraded":"2023-06-10T19:08:05.437424+0000","last_fullsized":"2023-06-10T19:08:05.437424+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:52:36.401230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.536915+0000","last_change":"2023-06-10T19:08:03.572199+0000","last_active":"2023-06-10T19:08:04.536915+0000","last_peered":"2023-06-10T19:08:04.536915+0000","last_clean":"2023-06-10T19:08:04.536915+0000","last_became_active":"2023-06-10T19:08:03.571532+0000","last_became_peered":"2023-06-10T19:08:03.571532+0000","last_unstale":"2023-06-10T19:08:04.536915+0000","last_undegraded":"2023-06-10T19:08:04.536915+0000","last_fullsized":"2023-06-10T19:08:04.536915+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:22:57.056249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":13,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.437343+0000","last_change":"2023-06-10T19:08:03.160030+0000","last_active":"2023-06-10T19:08:05.437343+0000","last_peered":"2023-06-10T19:08:05.437343+0000","last_clean":"2023-06-10T19:08:05.437343+0000","last_became_active":"2023-06-10T19:08:03.159233+0000","last_became_peered":"2023-06-10T19:08:03.159233+0000","last_unstale":"2023-06-10T19:08:05.437343+0000","last_undegraded":"2023-06-10T19:08:05.437343+0000","last_fullsized":"2023-06-10T19:08:05.437343+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:13:09.541660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.440672+0000","last_change":"2023-06-10T19:08:03.544742+0000","last_active":"2023-06-10T19:08:05.440672+0000","last_peered":"2023-06-10T19:08:05.440672+0000","last_clean":"2023-06-10T19:08:05.440672+0000","last_became_active":"2023-06-10T19:08:03.543098+0000","last_became_peered":"2023-06-10T19:08:03.543098+0000","last_unstale":"2023-06-10T19:08:05.440672+0000","last_undegraded":"2023-06-10T19:08:05.440672+0000","last_fullsized":"2023-06-10T19:08:05.440672+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:49:05.343491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":13,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.533577+0000","last_change":"2023-06-10T19:08:03.155129+0000","last_active":"2023-06-10T19:08:04.533577+0000","last_peered":"2023-06-10T19:08:04.533577+0000","last_clean":"2023-06-10T19:08:04.533577+0000","last_became_active":"2023-06-10T19:08:03.154886+0000","last_became_peered":"2023-06-10T19:08:03.154886+0000","last_unstale":"2023-06-10T19:08:04.533577+0000","last_undegraded":"2023-06-10T19:08:04.533577+0000","last_fullsized":"2023-06-10T19:08:04.533577+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:42:39.488280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.437520+0000","last_change":"2023-06-10T19:08:03.576348+0000","last_active":"2023-06-10T19:08:05.437520+0000","last_peered":"2023-06-10T19:08:05.437520+0000","last_clean":"2023-06-10T19:08:05.437520+0000","last_became_active":"2023-06-10T19:08:03.575613+0000","last_became_peered":"2023-06-10T19:08:03.575613+0000","last_unstale":"2023-06-10T19:08:05.437520+0000","last_undegraded":"2023-06-10T19:08:05.437520+0000","last_fullsized":"2023-06-10T19:08:05.437520+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:40:06.194864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":13,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.244364+0000","last_change":"2023-06-10T19:08:03.175107+0000","last_active":"2023-06-10T19:08:05.244364+0000","last_peered":"2023-06-10T19:08:05.244364+0000","last_clean":"2023-06-10T19:08:05.244364+0000","last_became_active":"2023-06-10T19:08:03.174236+0000","last_became_peered":"2023-06-10T19:08:03.174236+0000","last_unstale":"2023-06-10T19:08:05.244364+0000","last_undegraded":"2023-06-10T19:08:05.244364+0000","last_fullsized":"2023-06-10T19:08:05.244364+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:31:44.793122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.1b","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.244415+0000","last_change":"2023-06-10T19:08:03.561297+0000","last_active":"2023-06-10T19:08:05.244415+0000","last_peered":"2023-06-10T19:08:05.244415+0000","last_clean":"2023-06-10T19:08:05.244415+0000","last_became_active":"2023-06-10T19:08:03.560411+0000","last_became_peered":"2023-06-10T19:08:03.560411+0000","last_unstale":"2023-06-10T19:08:05.244415+0000","last_undegraded":"2023-06-10T19:08:05.244415+0000","last_fullsized":"2023-06-10T19:08:05.244415+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:16:51.862751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":13,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.438084+0000","last_change":"2023-06-10T19:08:03.161563+0000","last_active":"2023-06-10T19:08:05.438084+0000","last_peered":"2023-06-10T19:08:05.438084+0000","last_clean":"2023-06-10T19:08:05.438084+0000","last_became_active":"2023-06-10T19:08:03.161083+0000","last_became_peered":"2023-06-10T19:08:03.161083+0000","last_unstale":"2023-06-10T19:08:05.438084+0000","last_undegraded":"2023-06-10T19:08:05.438084+0000","last_fullsized":"2023-06-10T19:08:05.438084+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:03:20.657974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":434,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.437815+0000","last_change":"2023-06-10T18:52:34.951528+0000","last_active":"2023-06-10T19:08:05.437815+0000","last_peered":"2023-06-10T19:08:05.437815+0000","last_clean":"2023-06-10T19:08:05.437815+0000","last_became_active":"2023-06-10T18:52:34.949099+0000","last_became_peered":"2023-06-10T18:52:34.949099+0000","last_unstale":"2023-06-10T19:08:05.437815+0000","last_undegraded":"2023-06-10T19:08:05.437815+0000","last_fullsized":"2023-06-10T19:08:05.437815+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_clean_scrub_stamp":"2023-06-10T18:52:33.633295+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:00:17.499241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":310,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.538633+0000","last_change":"2023-06-10T18:52:40.506384+0000","last_active":"2023-06-10T19:08:04.538633+0000","last_peered":"2023-06-10T19:08:04.538633+0000","last_clean":"2023-06-10T19:08:04.538633+0000","last_became_active":"2023-06-10T18:52:40.505701+0000","last_became_peered":"2023-06-10T18:52:40.505701+0000","last_unstale":"2023-06-10T19:08:04.538633+0000","last_undegraded":"2023-06-10T19:08:04.538633+0000","last_fullsized":"2023-06-10T19:08:04.538633+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:28:39.564965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.536571+0000","last_change":"2023-06-10T19:08:03.539779+0000","last_active":"2023-06-10T19:08:04.536571+0000","last_peered":"2023-06-10T19:08:04.536571+0000","last_clean":"2023-06-10T19:08:04.536571+0000","last_became_active":"2023-06-10T19:08:03.538931+0000","last_became_peered":"2023-06-10T19:08:03.538931+0000","last_unstale":"2023-06-10T19:08:04.536571+0000","last_undegraded":"2023-06-10T19:08:04.536571+0000","last_fullsized":"2023-06-10T19:08:04.536571+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:18:01.184162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.1b","version":"179'1","reported_seq":14,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.439541+0000","last_change":"2023-06-10T19:08:03.167339+0000","last_active":"2023-06-10T19:08:05.439541+0000","last_peered":"2023-06-10T19:08:05.439541+0000","last_clean":"2023-06-10T19:08:05.439541+0000","last_became_active":"2023-06-10T19:08:03.166946+0000","last_became_peered":"2023-06-10T19:08:03.166946+0000","last_unstale":"2023-06-10T19:08:05.439541+0000","last_undegraded":"2023-06-10T19:08:05.439541+0000","last_fullsized":"2023-06-10T19:08:05.439541+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:05:12.859895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":278,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.437615+0000","last_change":"2023-06-10T18:52:40.512015+0000","last_active":"2023-06-10T19:08:05.437615+0000","last_peered":"2023-06-10T19:08:05.437615+0000","last_clean":"2023-06-10T19:08:05.437615+0000","last_became_active":"2023-06-10T18:52:40.511382+0000","last_became_peered":"2023-06-10T18:52:40.511382+0000","last_unstale":"2023-06-10T19:08:05.437615+0000","last_undegraded":"2023-06-10T19:08:05.437615+0000","last_fullsized":"2023-06-10T19:08:05.437615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:46:31.338645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.440549+0000","last_change":"2023-06-10T19:08:03.544401+0000","last_active":"2023-06-10T19:08:05.440549+0000","last_peered":"2023-06-10T19:08:05.440549+0000","last_clean":"2023-06-10T19:08:05.440549+0000","last_became_active":"2023-06-10T19:08:03.544129+0000","last_became_peered":"2023-06-10T19:08:03.544129+0000","last_unstale":"2023-06-10T19:08:05.440549+0000","last_undegraded":"2023-06-10T19:08:05.440549+0000","last_fullsized":"2023-06-10T19:08:05.440549+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:38:26.169391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1a","version":"179'1","reported_seq":14,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.441420+0000","last_change":"2023-06-10T19:08:03.161776+0000","last_active":"2023-06-10T19:08:05.441420+0000","last_peered":"2023-06-10T19:08:05.441420+0000","last_clean":"2023-06-10T19:08:05.441420+0000","last_became_active":"2023-06-10T19:08:03.161475+0000","last_became_peered":"2023-06-10T19:08:03.161475+0000","last_unstale":"2023-06-10T19:08:05.441420+0000","last_undegraded":"2023-06-10T19:08:05.441420+0000","last_fullsized":"2023-06-10T19:08:05.441420+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:22:58.600090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":300,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.533771+0000","last_change":"2023-06-10T18:52:40.671725+0000","last_active":"2023-06-10T19:08:04.533771+0000","last_peered":"2023-06-10T19:08:04.533771+0000","last_clean":"2023-06-10T19:08:04.533771+0000","last_became_active":"2023-06-10T18:52:40.671442+0000","last_became_peered":"2023-06-10T18:52:40.671442+0000","last_unstale":"2023-06-10T19:08:04.533771+0000","last_undegraded":"2023-06-10T19:08:04.533771+0000","last_fullsized":"2023-06-10T19:08:04.533771+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:08:08.625563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.1a","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.441340+0000","last_change":"2023-06-10T19:08:03.579894+0000","last_active":"2023-06-10T19:08:05.441340+0000","last_peered":"2023-06-10T19:08:05.441340+0000","last_clean":"2023-06-10T19:08:05.441340+0000","last_became_active":"2023-06-10T19:08:03.579634+0000","last_became_peered":"2023-06-10T19:08:03.579634+0000","last_unstale":"2023-06-10T19:08:05.441340+0000","last_undegraded":"2023-06-10T19:08:05.441340+0000","last_fullsized":"2023-06-10T19:08:05.441340+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:21:09.590484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":13,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.536895+0000","last_change":"2023-06-10T19:08:03.160135+0000","last_active":"2023-06-10T19:08:04.536895+0000","last_peered":"2023-06-10T19:08:04.536895+0000","last_clean":"2023-06-10T19:08:04.536895+0000","last_became_active":"2023-06-10T19:08:03.159272+0000","last_became_peered":"2023-06-10T19:08:03.159272+0000","last_unstale":"2023-06-10T19:08:04.536895+0000","last_undegraded":"2023-06-10T19:08:04.536895+0000","last_fullsized":"2023-06-10T19:08:04.536895+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:10:13.249089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":310,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.538194+0000","last_change":"2023-06-10T18:52:40.510258+0000","last_active":"2023-06-10T19:08:04.538194+0000","last_peered":"2023-06-10T19:08:04.538194+0000","last_clean":"2023-06-10T19:08:04.538194+0000","last_became_active":"2023-06-10T18:52:40.509560+0000","last_became_peered":"2023-06-10T18:52:40.509560+0000","last_unstale":"2023-06-10T19:08:04.538194+0000","last_undegraded":"2023-06-10T19:08:04.538194+0000","last_fullsized":"2023-06-10T19:08:04.538194+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:41:58.173239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.438428+0000","last_change":"2023-06-10T19:08:03.573570+0000","last_active":"2023-06-10T19:08:05.438428+0000","last_peered":"2023-06-10T19:08:05.438428+0000","last_clean":"2023-06-10T19:08:05.438428+0000","last_became_active":"2023-06-10T19:08:03.572764+0000","last_became_peered":"2023-06-10T19:08:03.572764+0000","last_unstale":"2023-06-10T19:08:05.438428+0000","last_undegraded":"2023-06-10T19:08:05.438428+0000","last_fullsized":"2023-06-10T19:08:05.438428+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:31:03.507727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1f","version":"179'4","reported_seq":17,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.442415+0000","last_change":"2023-06-10T19:08:03.161456+0000","last_active":"2023-06-10T19:08:05.442415+0000","last_peered":"2023-06-10T19:08:05.442415+0000","last_clean":"2023-06-10T19:08:05.442415+0000","last_became_active":"2023-06-10T19:08:03.160674+0000","last_became_peered":"2023-06-10T19:08:03.160674+0000","last_unstale":"2023-06-10T19:08:05.442415+0000","last_undegraded":"2023-06-10T19:08:05.442415+0000","last_fullsized":"2023-06-10T19:08:05.442415+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:18:09.843711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":280,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.439918+0000","last_change":"2023-06-10T18:52:40.672266+0000","last_active":"2023-06-10T19:08:05.439918+0000","last_peered":"2023-06-10T19:08:05.439918+0000","last_clean":"2023-06-10T19:08:05.439918+0000","last_became_active":"2023-06-10T18:52:40.671966+0000","last_became_peered":"2023-06-10T18:52:40.671966+0000","last_unstale":"2023-06-10T19:08:05.439918+0000","last_undegraded":"2023-06-10T19:08:05.439918+0000","last_fullsized":"2023-06-10T19:08:05.439918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:55:35.364123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1d","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.533975+0000","last_change":"2023-06-10T19:08:03.560173+0000","last_active":"2023-06-10T19:08:04.533975+0000","last_peered":"2023-06-10T19:08:04.533975+0000","last_clean":"2023-06-10T19:08:04.533975+0000","last_became_active":"2023-06-10T19:08:03.559915+0000","last_became_peered":"2023-06-10T19:08:03.559915+0000","last_unstale":"2023-06-10T19:08:04.533975+0000","last_undegraded":"2023-06-10T19:08:04.533975+0000","last_fullsized":"2023-06-10T19:08:04.533975+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:22:12.825894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"179'1","reported_seq":14,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.441942+0000","last_change":"2023-06-10T19:08:03.167039+0000","last_active":"2023-06-10T19:08:05.441942+0000","last_peered":"2023-06-10T19:08:05.441942+0000","last_clean":"2023-06-10T19:08:05.441942+0000","last_became_active":"2023-06-10T19:08:03.166789+0000","last_became_peered":"2023-06-10T19:08:03.166789+0000","last_unstale":"2023-06-10T19:08:05.441942+0000","last_undegraded":"2023-06-10T19:08:05.441942+0000","last_fullsized":"2023-06-10T19:08:05.441942+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:01:55.927670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":278,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.438095+0000","last_change":"2023-06-10T18:52:40.671084+0000","last_active":"2023-06-10T19:08:05.438095+0000","last_peered":"2023-06-10T19:08:05.438095+0000","last_clean":"2023-06-10T19:08:05.438095+0000","last_became_active":"2023-06-10T18:52:40.670697+0000","last_became_peered":"2023-06-10T18:52:40.670697+0000","last_unstale":"2023-06-10T19:08:05.438095+0000","last_undegraded":"2023-06-10T19:08:05.438095+0000","last_fullsized":"2023-06-10T19:08:05.438095+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:10:09.642847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1e","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.539709+0000","last_change":"2023-06-10T19:08:03.579869+0000","last_active":"2023-06-10T19:08:04.539709+0000","last_peered":"2023-06-10T19:08:04.539709+0000","last_clean":"2023-06-10T19:08:04.539709+0000","last_became_active":"2023-06-10T19:08:03.578943+0000","last_became_peered":"2023-06-10T19:08:03.578943+0000","last_unstale":"2023-06-10T19:08:04.539709+0000","last_undegraded":"2023-06-10T19:08:04.539709+0000","last_fullsized":"2023-06-10T19:08:04.539709+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:21:09.590484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1d","version":"179'2","reported_seq":15,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.539290+0000","last_change":"2023-06-10T19:08:03.162026+0000","last_active":"2023-06-10T19:08:04.539290+0000","last_peered":"2023-06-10T19:08:04.539290+0000","last_clean":"2023-06-10T19:08:04.539290+0000","last_became_active":"2023-06-10T19:08:03.160874+0000","last_became_peered":"2023-06-10T19:08:03.160874+0000","last_unstale":"2023-06-10T19:08:04.539290+0000","last_undegraded":"2023-06-10T19:08:04.539290+0000","last_fullsized":"2023-06-10T19:08:04.539290+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:29:28.946876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":280,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.441845+0000","last_change":"2023-06-10T18:52:40.514114+0000","last_active":"2023-06-10T19:08:05.441845+0000","last_peered":"2023-06-10T19:08:05.441845+0000","last_clean":"2023-06-10T19:08:05.441845+0000","last_became_active":"2023-06-10T18:52:40.513638+0000","last_became_peered":"2023-06-10T18:52:40.513638+0000","last_unstale":"2023-06-10T19:08:05.441845+0000","last_undegraded":"2023-06-10T19:08:05.441845+0000","last_fullsized":"2023-06-10T19:08:05.441845+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:59:53.407429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1f","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.244748+0000","last_change":"2023-06-10T19:08:03.589242+0000","last_active":"2023-06-10T19:08:05.244748+0000","last_peered":"2023-06-10T19:08:05.244748+0000","last_clean":"2023-06-10T19:08:05.244748+0000","last_became_active":"2023-06-10T19:08:03.588788+0000","last_became_peered":"2023-06-10T19:08:03.588788+0000","last_unstale":"2023-06-10T19:08:05.244748+0000","last_undegraded":"2023-06-10T19:08:05.244748+0000","last_fullsized":"2023-06-10T19:08:05.244748+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:25:08.168192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1c","version":"179'2","reported_seq":15,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.537418+0000","last_change":"2023-06-10T19:08:03.159361+0000","last_active":"2023-06-10T19:08:04.537418+0000","last_peered":"2023-06-10T19:08:04.537418+0000","last_clean":"2023-06-10T19:08:04.537418+0000","last_became_active":"2023-06-10T19:08:03.158564+0000","last_became_peered":"2023-06-10T19:08:03.158564+0000","last_unstale":"2023-06-10T19:08:04.537418+0000","last_undegraded":"2023-06-10T19:08:04.537418+0000","last_fullsized":"2023-06-10T19:08:04.537418+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:54:26.405549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":280,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.244688+0000","last_change":"2023-06-10T18:52:40.515396+0000","last_active":"2023-06-10T19:08:05.244688+0000","last_peered":"2023-06-10T19:08:05.244688+0000","last_clean":"2023-06-10T19:08:05.244688+0000","last_became_active":"2023-06-10T18:52:40.514663+0000","last_became_peered":"2023-06-10T18:52:40.514663+0000","last_unstale":"2023-06-10T19:08:05.244688+0000","last_undegraded":"2023-06-10T19:08:05.244688+0000","last_fullsized":"2023-06-10T19:08:05.244688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:38:44.075046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":25,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575038,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33836,"kb_used_data":2788,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338004,"statfs":{"total":96636764160,"available":96602116096,"internally_reserved":0,"allocated":2854912,"data_stored":1647554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:07:04 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.93600000000000005,"15min":0.92500000000000004},"min":{"1min":0.443,"5min":0.443,"15min":0.434},"max":{"1min":1.131,"5min":1.522,"15min":1.6220000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.88,"5min":0.90900000000000003,"15min":0.92400000000000004},"min":{"1min":0.63400000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.1379999999999999,"5min":1.3109999999999999,"15min":1.6870000000000001},"last":0.49399999999999999}]},{"osd":1,"last update":"Sat Jun 10 19:07:04 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.88800000000000001,"15min":0.91700000000000004},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.377},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.92300000000000004,"15min":0.94299999999999995},"min":{"1min":0.55000000000000004,"5min":0.51300000000000001,"15min":0.504},"max":{"1min":1.302,"5min":1.3320000000000001,"15min":1.5960000000000001},"last":0.65000000000000002}]},{"osd":2,"last update":"Sat Jun 10 19:07:04 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.86699999999999999,"15min":0.85299999999999998},"min":{"1min":0.41899999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.2370000000000001,"5min":1.2629999999999999,"15min":1.4059999999999999},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.88700000000000001,"15min":0.89600000000000002},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.50600000000000001},"max":{"1min":1.2290000000000001,"5min":1.3100000000000001,"15min":1.448},"last":0.751}]},{"osd":3,"last update":"Sat Jun 10 19:07:04 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.89600000000000002,"15min":0.92000000000000004},"min":{"1min":0.68600000000000005,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.1299999999999999,"5min":1.4490000000000001,"15min":1.502},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.95099999999999996,"15min":0.95599999999999996},"min":{"1min":0.496,"5min":0.432,"15min":0.432},"max":{"1min":1.2,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.97299999999999998}]},{"osd":4,"last update":"Sat Jun 10 19:07:04 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.82799999999999996,"15min":0.84399999999999997},"min":{"1min":0.60299999999999998,"5min":0.307,"15min":0.307},"max":{"1min":1.1639999999999999,"5min":1.2290000000000001,"15min":1.639},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.96699999999999997,"15min":0.96599999999999997},"min":{"1min":0.47299999999999998,"5min":0.41199999999999998,"15min":0.40000000000000002},"max":{"1min":1.1799999999999999,"5min":1.454,"15min":1.4590000000000001},"last":1.079}]},{"osd":5,"last update":"Sat Jun 10 19:07:04 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.99399999999999999,"15min":1.002},"min":{"1min":0.66600000000000004,"5min":0.45100000000000001,"15min":0.38400000000000001},"max":{"1min":1.268,"5min":1.385,"15min":1.806},"last":1.1220000000000001},{"interface":"front","average":{"1min":1.044,"5min":1.0269999999999999,"15min":1.0349999999999999},"min":{"1min":0.78200000000000003,"5min":0.48499999999999999,"15min":0.46500000000000002},"max":{"1min":1.254,"5min":1.665,"15min":1.665},"last":1.155}]},{"osd":6,"last update":"Sat Jun 10 19:07:04 2023","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.014,"15min":1.0089999999999999},"min":{"1min":0.71899999999999997,"5min":0.47699999999999998,"15min":0.35999999999999999},"max":{"1min":2.1120000000000001,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.117,"5min":1.0960000000000001,"15min":1.099},"min":{"1min":0.82499999999999996,"5min":0.504,"15min":0.441},"max":{"1min":1.397,"5min":1.728,"15min":1.728},"last":1.1970000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575039,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33260,"kb_used_data":2212,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338580,"statfs":{"total":96636764160,"available":96602705920,"internally_reserved":0,"allocated":2265088,"data_stored":1057256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:07:58 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.84699999999999998,"15min":0.86599999999999999},"min":{"1min":0.55700000000000005,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.2050000000000001,"5min":1.2450000000000001,"15min":1.498},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.879,"15min":0.88400000000000001},"min":{"1min":0.58199999999999996,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.1359999999999999,"5min":1.3009999999999999,"15min":1.496},"last":0.76700000000000002}]},{"osd":1,"last update":"Sat Jun 10 19:07:58 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.83999999999999997,"15min":0.86099999999999999},"min":{"1min":0.60799999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.1200000000000001,"5min":1.2709999999999999,"15min":1.5229999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.90300000000000002,"15min":0.90700000000000003},"min":{"1min":0.71199999999999997,"5min":0.504,"15min":0.45300000000000001},"max":{"1min":1.248,"5min":1.341,"15min":1.778},"last":0.84299999999999997}]},{"osd":2,"last update":"Sat Jun 10 19:07:58 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.89400000000000002,"15min":0.90200000000000002},"min":{"1min":0.53500000000000003,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.1579999999999999,"5min":1.2929999999999999,"15min":1.3759999999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.874,"5min":0.86699999999999999,"15min":0.88200000000000001},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.175,"5min":1.175,"15min":1.246},"last":0.63100000000000001}]},{"osd":3,"last update":"Sat Jun 10 19:07:58 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.91400000000000003,"15min":0.92300000000000004},"min":{"1min":0.67300000000000004,"5min":0.55100000000000005,"15min":0.52700000000000002},"max":{"1min":1.1890000000000001,"5min":1.238,"15min":1.7190000000000001},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.95399999999999996,"15min":0.97899999999999998},"min":{"1min":0.72699999999999998,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.1639999999999999,"5min":1.304,"15min":1.4370000000000001},"last":0.54600000000000004}]},{"osd":4,"last update":"Sat Jun 10 19:07:58 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.93400000000000005,"15min":0.91600000000000004},"min":{"1min":0.58599999999999997,"5min":0.45900000000000002,"15min":0.373},"max":{"1min":1.2130000000000001,"5min":1.4019999999999999,"15min":1.798},"last":1.0680000000000001},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.999,"15min":0.98399999999999999},"min":{"1min":0.65600000000000003,"5min":0.504,"15min":0.47899999999999998},"max":{"1min":1.276,"5min":1.409,"15min":1.5489999999999999},"last":1.008}]},{"osd":5,"last update":"Sat Jun 10 19:07:58 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.875,"15min":0.90000000000000002},"min":{"1min":0.45300000000000001,"5min":0.437,"15min":0.437},"max":{"1min":1.1020000000000001,"5min":1.2150000000000001,"15min":1.333},"last":0.81399999999999995},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.0189999999999999,"15min":1.024},"min":{"1min":0.64300000000000002,"5min":0.47199999999999998,"15min":0.42699999999999999},"max":{"1min":1.3069999999999999,"5min":1.3520000000000001,"15min":2.536},"last":1.03}]},{"osd":7,"last update":"Sat Jun 10 19:07:58 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.04,"15min":1.028},"min":{"1min":0.69399999999999995,"5min":0.59199999999999997,"15min":0.57099999999999995},"max":{"1min":1.1870000000000001,"5min":1.879,"15min":1.917},"last":1.0529999999999999},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.98299999999999998,"15min":0.999},"min":{"1min":0.51700000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.226,"5min":1.345,"15min":1.5569999999999999},"last":0.95799999999999996}]}]},{"osd":5,"up_from":13,"seq":55834575039,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33272,"kb_used_data":2224,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338568,"statfs":{"total":96636764160,"available":96602693632,"internally_reserved":0,"allocated":2277376,"data_stored":1058772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.85399999999999998,"15min":0.874},"min":{"1min":0.53100000000000003,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.2649999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":1.2350000000000001},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.89200000000000002,"15min":0.90000000000000002},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.49399999999999999},"max":{"1min":1.0860000000000001,"5min":1.2370000000000001,"15min":2.347},"last":0.86399999999999999}]},{"osd":1,"last update":"Sat Jun 10 19:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.879,"15min":0.90900000000000003},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.153,"5min":1.6739999999999999,"15min":7.0800000000000001},"last":1.266},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.90200000000000002,"15min":0.98199999999999998},"min":{"1min":0.56999999999999995,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1619999999999999,"5min":1.2689999999999999,"15min":15.845000000000001},"last":1.0329999999999999}]},{"osd":2,"last update":"Sat Jun 10 19:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.90700000000000003,"15min":0.89600000000000002},"min":{"1min":0.60999999999999999,"5min":0.54300000000000004,"15min":0.48299999999999998},"max":{"1min":1.2150000000000001,"5min":1.6459999999999999,"15min":5.0049999999999999},"last":1.1930000000000001},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.91500000000000004,"15min":0.94599999999999995},"min":{"1min":0.625,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.107,"5min":1.391,"15min":6.851},"last":1.1359999999999999}]},{"osd":3,"last update":"Sat Jun 10 19:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.93600000000000005,"15min":0.94699999999999995},"min":{"1min":0.59099999999999997,"5min":0.58699999999999997,"15min":0.51500000000000001},"max":{"1min":1.508,"5min":1.6910000000000001,"15min":2.544},"last":1.304},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.97699999999999998,"15min":0.98999999999999999},"min":{"1min":0.748,"5min":0.66000000000000003,"15min":0.59799999999999998},"max":{"1min":1.3009999999999999,"5min":1.4870000000000001,"15min":3.0830000000000002},"last":0.95699999999999996}]},{"osd":4,"last update":"Sat Jun 10 19:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.94199999999999995,"15min":0.94799999999999995},"min":{"1min":0.67000000000000004,"5min":0.59799999999999998,"15min":0.58099999999999996},"max":{"1min":1.454,"5min":1.6140000000000001,"15min":6.7290000000000001},"last":0.998},{"interface":"front","average":{"1min":1.0720000000000001,"5min":0.97099999999999997,"15min":0.98699999999999999},"min":{"1min":0.69699999999999995,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":0.93000000000000005}]},{"osd":6,"last update":"Sat Jun 10 19:07:54 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":0.98899999999999999,"15min":0.98699999999999999},"min":{"1min":0.70399999999999996,"5min":0.60499999999999998,"15min":0.54200000000000004},"max":{"1min":1.7190000000000001,"5min":1.8009999999999999,"15min":1.8009999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.0329999999999999,"15min":1.054},"min":{"1min":0.86799999999999999,"5min":0.66200000000000003,"15min":0.57899999999999996},"max":{"1min":1.5620000000000001,"5min":1.8380000000000001,"15min":6.923},"last":0.77600000000000002}]},{"osd":7,"last update":"Sat Jun 10 19:07:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.0640000000000001,"15min":1.0800000000000001},"min":{"1min":0.95899999999999996,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.7549999999999999,"5min":1.7749999999999999,"15min":2.6080000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1200000000000001,"15min":1.133},"min":{"1min":0.88700000000000001,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":5.4169999999999998},"last":1.1040000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575038,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33272,"kb_used_data":2224,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338568,"statfs":{"total":96636764160,"available":96602693632,"internally_reserved":0,"allocated":2277376,"data_stored":1058784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.83999999999999997,"15min":0.83299999999999996},"min":{"1min":0.53200000000000003,"5min":0.45400000000000001,"15min":0.45100000000000001},"max":{"1min":1.2190000000000001,"5min":1.29,"15min":1.29},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.90000000000000002,"15min":0.90600000000000003},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.375,"5min":1.3979999999999999,"15min":3.7280000000000002},"last":1.0860000000000001}]},{"osd":1,"last update":"Sat Jun 10 19:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.90000000000000002,"15min":0.92800000000000005},"min":{"1min":0.55000000000000004,"5min":0.47799999999999998,"15min":0.47599999999999998},"max":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":3.3969999999999998},"last":0.995},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.83199999999999996,"15min":0.86199999999999999},"min":{"1min":0.55700000000000005,"5min":0.47899999999999998,"15min":0.47699999999999998},"max":{"1min":1.212,"5min":1.2430000000000001,"15min":2.496},"last":1.1100000000000001}]},{"osd":2,"last update":"Sat Jun 10 19:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.85899999999999999,"15min":0.879},"min":{"1min":0.52400000000000002,"5min":0.52200000000000002,"15min":0.49299999999999999},"max":{"1min":1.137,"5min":1.236,"15min":1.522},"last":0.88},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.95899999999999996,"15min":0.98499999999999999},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.55000000000000004},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":3.5750000000000002},"last":1.155}]},{"osd":3,"last update":"Sat Jun 10 19:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.86399999999999999,"15min":0.89300000000000002},"min":{"1min":0.57799999999999996,"5min":0.56200000000000006,"15min":0.53900000000000003},"max":{"1min":1.1200000000000001,"5min":1.46,"15min":2.3809999999999998},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.94599999999999995,"15min":0.96299999999999997},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.54400000000000004},"max":{"1min":1.2889999999999999,"5min":1.4279999999999999,"15min":1.6479999999999999},"last":1.0589999999999999}]},{"osd":5,"last update":"Sat Jun 10 19:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.95299999999999996,"15min":0.95799999999999996},"min":{"1min":0.66800000000000004,"5min":0.58699999999999997,"15min":0.53100000000000003},"max":{"1min":1.224,"5min":1.3260000000000001,"15min":3.6539999999999999},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.92000000000000004,"15min":0.93999999999999995},"min":{"1min":0.63400000000000001,"5min":0.495,"15min":0.495},"max":{"1min":1.216,"5min":1.26,"15min":2.6720000000000002},"last":0.84499999999999997}]},{"osd":6,"last update":"Sat Jun 10 19:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.97599999999999998,"15min":0.96799999999999997},"min":{"1min":0.67000000000000004,"5min":0.443,"15min":0.443},"max":{"1min":1.2869999999999999,"5min":1.413,"15min":2.2639999999999998},"last":0.70299999999999996},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.081,"15min":1.0680000000000001},"min":{"1min":0.76300000000000001,"5min":0.58799999999999997,"15min":0.44400000000000001},"max":{"1min":1.625,"5min":1.625,"15min":3.4980000000000002},"last":0.73699999999999999}]},{"osd":7,"last update":"Sat Jun 10 19:07:08 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.02,"15min":1.0009999999999999},"min":{"1min":0.82699999999999996,"5min":0.60899999999999999,"15min":0.41399999999999998},"max":{"1min":1.3240000000000001,"5min":1.3919999999999999,"15min":2.5910000000000002},"last":1.036},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.071},"min":{"1min":0.81100000000000005,"5min":0.50800000000000001,"15min":0.46300000000000002},"max":{"1min":1.385,"5min":1.635,"15min":1.635},"last":1.0189999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575037,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37356,"kb_used_data":2212,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334484,"statfs":{"total":96636764160,"available":96598511616,"internally_reserved":0,"allocated":2265088,"data_stored":1056327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.63700000000000001,"15min":0.628},"min":{"1min":0.33800000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.879,"5min":1.0900000000000001,"15min":1.169},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.66600000000000004,"15min":0.66900000000000004},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.251},"max":{"1min":0.91200000000000003,"5min":0.97799999999999998,"15min":1.5269999999999999},"last":0.33000000000000002}]},{"osd":1,"last update":"Sat Jun 10 19:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.68300000000000005,"15min":0.68899999999999995},"min":{"1min":0.33300000000000002,"5min":0.29699999999999999,"15min":0.27500000000000002},"max":{"1min":1.234,"5min":1.234,"15min":2.0699999999999998},"last":0.376},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71799999999999997,"15min":0.73399999999999999},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.411},"last":0.436}]},{"osd":2,"last update":"Sat Jun 10 19:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.753,"15min":0.77300000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.30299999999999999},"max":{"1min":0.98699999999999999,"5min":1.2829999999999999,"15min":1.9530000000000001},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.80600000000000005,"15min":0.79700000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.29699999999999999},"max":{"1min":1.0800000000000001,"5min":1.2769999999999999,"15min":1.591},"last":0.39700000000000002}]},{"osd":4,"last update":"Sat Jun 10 19:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.94599999999999995,"15min":0.94899999999999995},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.41899999999999998},"max":{"1min":1.294,"5min":1.4239999999999999,"15min":1.8240000000000001},"last":0.629},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.98499999999999999,"15min":0.99199999999999999},"min":{"1min":0.64600000000000002,"5min":0.57299999999999995,"15min":0.47999999999999998},"max":{"1min":1.417,"5min":1.4330000000000001,"15min":1.873},"last":0.748}]},{"osd":5,"last update":"Sat Jun 10 19:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.99399999999999999,"15min":1.0069999999999999},"min":{"1min":0.56899999999999995,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.474,"5min":1.536,"15min":2.024},"last":0.64400000000000002},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.038,"15min":1.0369999999999999},"min":{"1min":0.71499999999999997,"5min":0.59999999999999998,"15min":0.46899999999999997},"max":{"1min":1.3580000000000001,"5min":1.534,"15min":1.9259999999999999},"last":0.57499999999999996}]},{"osd":6,"last update":"Sat Jun 10 19:07:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":1.048,"15min":1.0629999999999999},"min":{"1min":0.69799999999999995,"5min":0.56999999999999995,"15min":0.55300000000000005},"max":{"1min":1.4359999999999999,"5min":1.617,"15min":1.8500000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.0309999999999999,"15min":1.05},"min":{"1min":0.629,"5min":0.61399999999999999,"15min":0.58799999999999997},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":2.2120000000000002},"last":0.76400000000000001}]},{"osd":7,"last update":"Sat Jun 10 19:07:54 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.0580000000000001,"15min":1.081},"min":{"1min":0.66400000000000003,"5min":0.58199999999999996,"15min":0.56999999999999995},"max":{"1min":1.4139999999999999,"5min":1.5720000000000001,"15min":2.1150000000000002},"last":0.55800000000000005},{"interface":"front","average":{"1min":1.077,"5min":1.089,"15min":1.101},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.4379999999999999,"5min":1.6779999999999999,"15min":1.9850000000000001},"last":0.69199999999999995}]}]},{"osd":2,"up_from":13,"seq":55834575038,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37356,"kb_used_data":2212,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334484,"statfs":{"total":96636764160,"available":96598511616,"internally_reserved":0,"allocated":2265088,"data_stored":1057768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.63700000000000001,"15min":0.626},"min":{"1min":0.34499999999999997,"5min":0.28299999999999997,"15min":0.27300000000000002},"max":{"1min":1.4490000000000001,"5min":2.883,"15min":2.883},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.76300000000000001,"15min":0.73699999999999999},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.101,"5min":6.5670000000000002,"15min":6.5670000000000002},"last":0.42599999999999999}]},{"osd":1,"last update":"Sat Jun 10 19:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.64600000000000002,"15min":0.66500000000000004},"min":{"1min":0.36199999999999999,"5min":0.32300000000000001,"15min":0.29199999999999998},"max":{"1min":1.032,"5min":1.1100000000000001,"15min":1.1950000000000001},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.81299999999999994,"15min":0.78800000000000003},"min":{"1min":0.32500000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.133,"5min":8.4429999999999996,"15min":8.4429999999999996},"last":0.51100000000000001}]},{"osd":3,"last update":"Sat Jun 10 19:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.76500000000000001,"15min":0.77900000000000003},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.1359999999999999,"5min":1.1899999999999999,"15min":1.2350000000000001},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.76500000000000001,"15min":0.78000000000000003},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.23499999999999999},"max":{"1min":1.21,"5min":4.1849999999999996,"15min":4.1849999999999996},"last":0.46999999999999997}]},{"osd":4,"last update":"Sat Jun 10 19:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.94599999999999995,"15min":0.93700000000000006},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.54,"5min":3.996,"15min":3.996},"last":0.624},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.109,"15min":1.05},"min":{"1min":0.502,"5min":0.496,"15min":0.496},"max":{"1min":1.488,"5min":13.254,"15min":13.254},"last":0.93899999999999995}]},{"osd":5,"last update":"Sat Jun 10 19:08:04 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.1180000000000001,"15min":1.0509999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.476,"5min":6.9189999999999996,"15min":6.9189999999999996},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.2430000000000001,"15min":1.099},"min":{"1min":0.69999999999999996,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.6359999999999999,"5min":15.526,"15min":15.526},"last":0.95899999999999996}]},{"osd":6,"last update":"Sat Jun 10 19:08:04 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.129,"15min":1.0820000000000001},"min":{"1min":0.624,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.7769999999999999,"5min":8.7089999999999996,"15min":8.7089999999999996},"last":1.0820000000000001},{"interface":"front","average":{"1min":0.95699999999999996,"5min":1.054,"15min":1.054},"min":{"1min":0.58399999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.319,"5min":6.1299999999999999,"15min":6.1299999999999999},"last":0.91300000000000003}]},{"osd":7,"last update":"Sat Jun 10 19:08:04 2023","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.2969999999999999,"15min":1.169},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.57199999999999995},"max":{"1min":1.6890000000000001,"5min":12.138,"15min":12.138},"last":1.022},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0740000000000001,"15min":1.1100000000000001},"min":{"1min":0.66900000000000004,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":0.89000000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575040,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37348,"kb_used_data":2204,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334492,"statfs":{"total":96636764160,"available":96598519808,"internally_reserved":0,"allocated":2256896,"data_stored":1056167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.66400000000000003,"15min":0.67900000000000005},"min":{"1min":0.36699999999999999,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":1.0049999999999999,"5min":1.048,"15min":1.288},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.73499999999999999,"15min":0.749},"min":{"1min":0.44900000000000001,"5min":0.32300000000000001,"15min":0.26900000000000002},"max":{"1min":1.008,"5min":1.615,"15min":1.694},"last":0.44900000000000001}]},{"osd":2,"last update":"Sat Jun 10 19:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.621,"15min":0.63400000000000001},"min":{"1min":0.376,"5min":0.29699999999999999,"15min":0.249},"max":{"1min":0.81999999999999995,"5min":0.94699999999999995,"15min":1.21},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.70399999999999996,"15min":0.72499999999999998},"min":{"1min":0.33000000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.071,"5min":1.2390000000000001,"15min":1.415},"last":0.48999999999999999}]},{"osd":3,"last update":"Sat Jun 10 19:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.748,"15min":0.77800000000000002},"min":{"1min":0.38900000000000001,"5min":0.34000000000000002,"15min":0.25600000000000001},"max":{"1min":0.995,"5min":1.143,"15min":1.6299999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.69499999999999995,"15min":0.72799999999999998},"min":{"1min":0.46500000000000002,"5min":0.36099999999999999,"15min":0.29599999999999999},"max":{"1min":1.0289999999999999,"5min":1.2709999999999999,"15min":2.1749999999999998},"last":0.53400000000000003}]},{"osd":4,"last update":"Sat Jun 10 19:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.87,"15min":0.871},"min":{"1min":0.61899999999999999,"5min":0.58599999999999997,"15min":0.53000000000000003},"max":{"1min":1.3340000000000001,"5min":1.3620000000000001,"15min":1.4930000000000001},"last":1.0129999999999999},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.98799999999999999,"15min":1.024},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.47099999999999997},"max":{"1min":1.373,"5min":1.575,"15min":5.8209999999999997},"last":0.86899999999999999}]},{"osd":5,"last update":"Sat Jun 10 19:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.96999999999999997,"15min":0.98999999999999999},"min":{"1min":0.63900000000000001,"5min":0.54800000000000004,"15min":0.49399999999999999},"max":{"1min":1.1839999999999999,"5min":1.5720000000000001,"15min":1.8620000000000001},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.97699999999999998},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.46300000000000002},"max":{"1min":1.4299999999999999,"5min":1.448,"15min":3.089},"last":1.0760000000000001}]},{"osd":6,"last update":"Sat Jun 10 19:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.97699999999999998,"15min":1.044},"min":{"1min":0.61499999999999999,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.228,"5min":1.4950000000000001,"15min":7.2599999999999998},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.97999999999999998,"15min":1.034},"min":{"1min":0.60299999999999998,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":9.0069999999999997},"last":1.123}]},{"osd":7,"last update":"Sat Jun 10 19:08:07 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.04,"15min":1.073},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.495},"max":{"1min":1.4159999999999999,"5min":1.4890000000000001,"15min":2.105},"last":0.93999999999999995},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.05,"15min":1.0780000000000001},"min":{"1min":0.67400000000000004,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.2829999999999999,"5min":1.526,"15min":2.2570000000000001},"last":1.044}]}]},{"osd":0,"up_from":13,"seq":55834575039,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37944,"kb_used_data":2800,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94333896,"statfs":{"total":96636764160,"available":96597909504,"internally_reserved":0,"allocated":2867200,"data_stored":1647263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jun 10 19:08:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.61599999999999999,"15min":0.63800000000000001},"min":{"1min":0.255,"5min":0.255,"15min":0.248},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.77400000000000002,"15min":0.80100000000000005},"min":{"1min":0.33000000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.0740000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.37}]},{"osd":2,"last update":"Sat Jun 10 19:08:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.69299999999999995,"15min":0.71299999999999997},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.98499999999999999,"5min":1.1970000000000001,"15min":1.2829999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.63500000000000001,"15min":0.65300000000000002},"min":{"1min":0.29999999999999999,"5min":0.28699999999999998,"15min":0.245},"max":{"1min":0.90600000000000003,"5min":1.1779999999999999,"15min":1.371},"last":0.312}]},{"osd":3,"last update":"Sat Jun 10 19:08:02 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.67000000000000004,"15min":0.68300000000000005},"min":{"1min":0.309,"5min":0.309,"15min":0.28899999999999998},"max":{"1min":1.1439999999999999,"5min":1.397,"15min":1.397},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.78200000000000003,"15min":0.81399999999999995},"min":{"1min":0.36399999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.1699999999999999,"5min":1.6240000000000001,"15min":1.829},"last":0.40100000000000002}]},{"osd":4,"last update":"Sat Jun 10 19:08:02 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.89300000000000002,"15min":0.91900000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.276,"5min":1.758,"15min":3.0209999999999999},"last":0.622},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.997,"15min":1.02},"min":{"1min":0.56200000000000006,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.224,"5min":1.873,"15min":1.9510000000000001},"last":0.77000000000000002}]},{"osd":5,"last update":"Sat Jun 10 19:08:02 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.88300000000000001,"15min":0.92100000000000004},"min":{"1min":0.51300000000000001,"5min":0.51200000000000001,"15min":0.45100000000000001},"max":{"1min":1.226,"5min":1.252,"15min":1.694},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.95899999999999996,"15min":1.0009999999999999},"min":{"1min":0.64800000000000002,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.321,"5min":1.9870000000000001,"15min":4.5620000000000003},"last":0.53100000000000003}]},{"osd":6,"last update":"Sat Jun 10 19:08:02 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.0289999999999999,"15min":1.0700000000000001},"min":{"1min":0.63700000000000001,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.3149999999999999,"5min":1.9330000000000001,"15min":3.5569999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.98699999999999999,"15min":0.999},"min":{"1min":0.56999999999999995,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.333,"5min":1.6599999999999999,"15min":1.883},"last":0.61099999999999999}]},{"osd":7,"last update":"Sat Jun 10 19:08:02 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.995,"15min":1.024},"min":{"1min":0.627,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.502,"5min":1.804,"15min":1.804},"last":0.78900000000000003},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0369999999999999,"15min":1.0569999999999999},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.58699999999999997},"max":{"1min":1.3720000000000001,"5min":2.1219999999999999,"15min":2.1219999999999999},"last":0.65200000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-10T19:08:09.327 INFO:tasks.ceph.mds.c.smithi053.stderr:2023-06-10T19:08:09.325+0000 7f3c4702d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-06-10T19:08:12.048 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-10T19:08:12.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.181+0000 7f21fb54c640 1 Processor -- start 2023-06-10T19:08:12.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.181+0000 7f21fb54c640 1 -- start start 2023-06-10T19:08:12.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.181+0000 7f21fb54c640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f21f4157e10 0x7f21f406efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:12.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.181+0000 7f21fb54c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21f406bb30 0x7f21f40ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:12.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.181+0000 7f21fb54c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f21f40af720 0x7f21f40afb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:12.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.181+0000 7f21fb54c640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21f40cd520 con 0x7f21f40af720 2023-06-10T19:08:12.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.181+0000 7f21fb54c640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21f40c9e50 con 0x7f21f4157e10 2023-06-10T19:08:12.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.181+0000 7f21fb54c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21f406bf80 con 0x7f21f406bb30 2023-06-10T19:08:12.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.181+0000 7f21f9ae9640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f21f40af720 0x7f21f40afb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:12.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.181+0000 7f21f9ae9640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f21f40af720 0x7f21f40afb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45438/0 (socket says 172.21.15.53:45438) 2023-06-10T19:08:12.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.181+0000 7f21f9ae9640 1 -- 172.21.15.53:0/2188815878 learned_addr learned my addr 172.21.15.53:0/2188815878 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:08:12.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.181+0000 7f21f8ae7640 1 --2- 172.21.15.53:0/2188815878 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21f406bb30 0x7f21f40ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:12.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.181+0000 7f21f92e8640 1 --2- 172.21.15.53:0/2188815878 >> v2:172.21.15.117:3300/0 conn(0x7f21f4157e10 0x7f21f406efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:12.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.181+0000 7f21f9ae9640 1 -- 172.21.15.53:0/2188815878 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21f406bb30 msgr2=0x7f21f40ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:12.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.181+0000 7f21f9ae9640 1 --2- 172.21.15.53:0/2188815878 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21f406bb30 0x7f21f40ccfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:12.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.181+0000 7f21f9ae9640 1 -- 172.21.15.53:0/2188815878 >> v2:172.21.15.117:3300/0 conn(0x7f21f4157e10 msgr2=0x7f21f406efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:12.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.181+0000 7f21f9ae9640 1 --2- 172.21.15.53:0/2188815878 >> v2:172.21.15.117:3300/0 conn(0x7f21f4157e10 0x7f21f406efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:12.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.181+0000 7f21f9ae9640 1 -- 172.21.15.53:0/2188815878 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21f40b00c0 con 0x7f21f40af720 2023-06-10T19:08:12.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.185+0000 7f21f9ae9640 1 --2- 172.21.15.53:0/2188815878 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21f40af720 0x7f21f40afb80 secure :-1 s=READY pgs=2607 cs=0 l=1 rev1=1 crypto rx=0x7f21f406e9d0 tx=0x7f21ec01eb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc72a944c5c65d80 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:12.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.185+0000 7f21ebfff640 1 -- 172.21.15.53:0/2188815878 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ec0a7a40 con 0x7f21f40af720 2023-06-10T19:08:12.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.185+0000 7f21ebfff640 1 -- 172.21.15.53:0/2188815878 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21ec0ab070 con 0x7f21f40af720 2023-06-10T19:08:12.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.185+0000 7f21ebfff640 1 -- 172.21.15.53:0/2188815878 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ec0a7dc0 con 0x7f21f40af720 2023-06-10T19:08:12.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.185+0000 7f21fb54c640 1 -- 172.21.15.53:0/2188815878 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21f40af720 msgr2=0x7f21f40afb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:12.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.185+0000 7f21fb54c640 1 --2- 172.21.15.53:0/2188815878 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21f40af720 0x7f21f40afb80 secure :-1 s=READY pgs=2607 cs=0 l=1 rev1=1 crypto rx=0x7f21f406e9d0 tx=0x7f21ec01eb40 comp rx=0 tx=0).stop 2023-06-10T19:08:12.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.185+0000 7f21fb54c640 1 -- 172.21.15.53:0/2188815878 shutdown_connections 2023-06-10T19:08:12.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.185+0000 7f21fb54c640 1 --2- 172.21.15.53:0/2188815878 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21f40af720 0x7f21f40afb80 unknown :-1 s=CLOSED pgs=2607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:12.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.185+0000 7f21fb54c640 1 --2- 172.21.15.53:0/2188815878 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21f406bb30 0x7f21f40ccfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:12.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.185+0000 7f21fb54c640 1 --2- 172.21.15.53:0/2188815878 >> v2:172.21.15.117:3300/0 conn(0x7f21f4157e10 0x7f21f406efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:12.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.185+0000 7f21fb54c640 1 -- 172.21.15.53:0/2188815878 >> 172.21.15.53:0/2188815878 conn(0x7f21f406a0d0 msgr2=0x7f21f40ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:12.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.185+0000 7f21fb54c640 1 -- 172.21.15.53:0/2188815878 shutdown_connections 2023-06-10T19:08:12.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.185+0000 7f21fb54c640 1 -- 172.21.15.53:0/2188815878 wait complete. 2023-06-10T19:08:12.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.185+0000 7f21fb54c640 1 Processor -- start 2023-06-10T19:08:12.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.185+0000 7f21fb54c640 1 -- start start 2023-06-10T19:08:12.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.185+0000 7f21fb54c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21f406bb30 0x7f21f41482f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:12.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.185+0000 7f21fb54c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21f40af720 0x7f21f40c40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:12.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.185+0000 7f21fb54c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21f4157e10 0x7f21f414d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:12.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.185+0000 7f21fb54c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f40c4630 con 0x7f21f4157e10 2023-06-10T19:08:12.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.185+0000 7f21fb54c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f40abbd0 con 0x7f21f406bb30 2023-06-10T19:08:12.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.185+0000 7f21fb54c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21f40abeb0 con 0x7f21f40af720 2023-06-10T19:08:12.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.185+0000 7f21f9ae9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21f4157e10 0x7f21f414d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:12.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.185+0000 7f21f9ae9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21f4157e10 0x7f21f414d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45452/0 (socket says 172.21.15.53:45452) 2023-06-10T19:08:12.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.185+0000 7f21f9ae9640 1 -- 172.21.15.53:0/2599709127 learned_addr learned my addr 172.21.15.53:0/2599709127 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:08:12.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.189+0000 7f21f92e8640 1 --2- 172.21.15.53:0/2599709127 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21f406bb30 0x7f21f41482f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:12.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.189+0000 7f21f8ae7640 1 --2- 172.21.15.53:0/2599709127 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21f40af720 0x7f21f40c40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:12.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.189+0000 7f21f9ae9640 1 -- 172.21.15.53:0/2599709127 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21f40af720 msgr2=0x7f21f40c40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:12.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.189+0000 7f21f9ae9640 1 --2- 172.21.15.53:0/2599709127 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21f40af720 0x7f21f40c40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:12.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.189+0000 7f21f9ae9640 1 -- 172.21.15.53:0/2599709127 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21f406bb30 msgr2=0x7f21f41482f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:12.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.189+0000 7f21f9ae9640 1 --2- 172.21.15.53:0/2599709127 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21f406bb30 0x7f21f41482f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:12.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.189+0000 7f21f9ae9640 1 -- 172.21.15.53:0/2599709127 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21ec00bd40 con 0x7f21f4157e10 2023-06-10T19:08:12.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.189+0000 7f21f9ae9640 1 --2- 172.21.15.53:0/2599709127 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21f4157e10 0x7f21f414d0d0 secure :-1 s=READY pgs=2608 cs=0 l=1 rev1=1 crypto rx=0x7f21ec0b3040 tx=0x7f21ec01d380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:12.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.189+0000 7f21e9ffb640 1 -- 172.21.15.53:0/2599709127 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ec0bf070 con 0x7f21f4157e10 2023-06-10T19:08:12.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.189+0000 7f21e9ffb640 1 -- 172.21.15.53:0/2599709127 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21ec00b330 con 0x7f21f4157e10 2023-06-10T19:08:12.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.189+0000 7f21fb54c640 1 -- 172.21.15.53:0/2599709127 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21f40ac190 con 0x7f21f4157e10 2023-06-10T19:08:12.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.189+0000 7f21e9ffb640 1 -- 172.21.15.53:0/2599709127 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ec0bb670 con 0x7f21f4157e10 2023-06-10T19:08:12.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.189+0000 7f21fb54c640 1 -- 172.21.15.53:0/2599709127 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21f40ac750 con 0x7f21f4157e10 2023-06-10T19:08:12.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.189+0000 7f21fb54c640 1 -- 172.21.15.53:0/2599709127 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21f40ac940 con 0x7f21f4157e10 2023-06-10T19:08:12.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.189+0000 7f21e9ffb640 1 -- 172.21.15.53:0/2599709127 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f21ec0bb7d0 con 0x7f21f4157e10 2023-06-10T19:08:12.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.189+0000 7f21e9ffb640 1 --2- 172.21.15.53:0/2599709127 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f21d8066280 0x7f21d8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:12.200 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.189+0000 7f21e9ffb640 1 -- 172.21.15.53:0/2599709127 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f21ec11e360 con 0x7f21f4157e10 2023-06-10T19:08:12.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.189+0000 7f21f92e8640 1 --2- 172.21.15.53:0/2599709127 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f21d8066280 0x7f21d8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:12.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.189+0000 7f21f92e8640 1 --2- 172.21.15.53:0/2599709127 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f21d8066280 0x7f21d8068730 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f21e400b9d0 tx=0x7f21e4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:12.201 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.193+0000 7f21e9ffb640 1 -- 172.21.15.53:0/2599709127 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f21ec0eb7e0 con 0x7f21f4157e10 2023-06-10T19:08:12.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.345+0000 7f21fb54c640 1 -- 172.21.15.53:0/2599709127 --> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f21f40ac020 con 0x7f21d8066280 2023-06-10T19:08:12.372 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.369+0000 7f21e9ffb640 1 -- 172.21.15.53:0/2599709127 <== mgr.4105 v2:172.21.15.117:6832/3061986771 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310419 (secure 0 0 0) 0x7f21f40ac020 con 0x7f21d8066280 2023-06-10T19:08:12.375 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:08:12.376 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-06-10T19:08:12.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.373+0000 7f21fb54c640 1 -- 172.21.15.53:0/2599709127 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f21d8066280 msgr2=0x7f21d8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:12.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.373+0000 7f21fb54c640 1 --2- 172.21.15.53:0/2599709127 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f21d8066280 0x7f21d8068730 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f21e400b9d0 tx=0x7f21e4008040 comp rx=0 tx=0).stop 2023-06-10T19:08:12.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.373+0000 7f21fb54c640 1 -- 172.21.15.53:0/2599709127 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21f4157e10 msgr2=0x7f21f414d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:12.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.373+0000 7f21fb54c640 1 --2- 172.21.15.53:0/2599709127 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21f4157e10 0x7f21f414d0d0 secure :-1 s=READY pgs=2608 cs=0 l=1 rev1=1 crypto rx=0x7f21ec0b3040 tx=0x7f21ec01d380 comp rx=0 tx=0).stop 2023-06-10T19:08:12.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.373+0000 7f21fb54c640 1 -- 172.21.15.53:0/2599709127 shutdown_connections 2023-06-10T19:08:12.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.373+0000 7f21fb54c640 1 --2- 172.21.15.53:0/2599709127 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f21d8066280 0x7f21d8068730 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:12.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.373+0000 7f21fb54c640 1 --2- 172.21.15.53:0/2599709127 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21f4157e10 0x7f21f414d0d0 unknown :-1 s=CLOSED pgs=2608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:12.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.373+0000 7f21fb54c640 1 --2- 172.21.15.53:0/2599709127 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f21f40af720 0x7f21f40c40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:12.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.373+0000 7f21fb54c640 1 --2- 172.21.15.53:0/2599709127 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21f406bb30 0x7f21f41482f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:12.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.373+0000 7f21fb54c640 1 -- 172.21.15.53:0/2599709127 >> 172.21.15.53:0/2599709127 conn(0x7f21f406a0d0 msgr2=0x7f21f40add30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:12.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.373+0000 7f21fb54c640 1 -- 172.21.15.53:0/2599709127 shutdown_connections 2023-06-10T19:08:12.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.373+0000 7f21fb54c640 1 -- 172.21.15.53:0/2599709127 wait complete. 2023-06-10T19:08:12.395 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":643,"stamp":"2023-06-10T19:08:11.923008+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":189,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":283644,"kb_used_data":18876,"kb_used_omap":0,"kb_used_meta":264704,"kb_avail":754691076,"statfs":{"total":773094113280,"available":772803661824,"internally_reserved":0,"allocated":19329024,"data_stored":9639891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":271056896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":70,"apply_latency_ms":70,"commit_latency_ns":70000000,"apply_latency_ns":70000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.401738"},"pg_stats":[{"pgid":"26.3f","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.439690+0000","last_change":"2023-06-10T19:08:03.575556+0000","last_active":"2023-06-10T19:08:05.439690+0000","last_peered":"2023-06-10T19:08:05.439690+0000","last_clean":"2023-06-10T19:08:05.439690+0000","last_became_active":"2023-06-10T19:08:03.575222+0000","last_became_peered":"2023-06-10T19:08:03.575222+0000","last_unstale":"2023-06-10T19:08:05.439690+0000","last_undegraded":"2023-06-10T19:08:05.439690+0000","last_fullsized":"2023-06-10T19:08:05.439690+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:22:30.167111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3e","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.441217+0000","last_change":"2023-06-10T19:08:03.581644+0000","last_active":"2023-06-10T19:08:05.441217+0000","last_peered":"2023-06-10T19:08:05.441217+0000","last_clean":"2023-06-10T19:08:05.441217+0000","last_became_active":"2023-06-10T19:08:03.581353+0000","last_became_peered":"2023-06-10T19:08:03.581353+0000","last_unstale":"2023-06-10T19:08:05.441217+0000","last_undegraded":"2023-06-10T19:08:05.441217+0000","last_fullsized":"2023-06-10T19:08:05.441217+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:34:20.169478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3d","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.244396+0000","last_change":"2023-06-10T19:08:03.557650+0000","last_active":"2023-06-10T19:08:05.244396+0000","last_peered":"2023-06-10T19:08:05.244396+0000","last_clean":"2023-06-10T19:08:05.244396+0000","last_became_active":"2023-06-10T19:08:03.556913+0000","last_became_peered":"2023-06-10T19:08:03.556913+0000","last_unstale":"2023-06-10T19:08:05.244396+0000","last_undegraded":"2023-06-10T19:08:05.244396+0000","last_fullsized":"2023-06-10T19:08:05.244396+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:38:21.683477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.3c","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.440951+0000","last_change":"2023-06-10T19:08:03.572223+0000","last_active":"2023-06-10T19:08:05.440951+0000","last_peered":"2023-06-10T19:08:05.440951+0000","last_clean":"2023-06-10T19:08:05.440951+0000","last_became_active":"2023-06-10T19:08:03.571913+0000","last_became_peered":"2023-06-10T19:08:03.571913+0000","last_unstale":"2023-06-10T19:08:05.440951+0000","last_undegraded":"2023-06-10T19:08:05.440951+0000","last_fullsized":"2023-06-10T19:08:05.440951+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:11:05.679837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.3b","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.439104+0000","last_change":"2023-06-10T19:08:03.555093+0000","last_active":"2023-06-10T19:08:05.439104+0000","last_peered":"2023-06-10T19:08:05.439104+0000","last_clean":"2023-06-10T19:08:05.439104+0000","last_became_active":"2023-06-10T19:08:03.554763+0000","last_became_peered":"2023-06-10T19:08:03.554763+0000","last_unstale":"2023-06-10T19:08:05.439104+0000","last_undegraded":"2023-06-10T19:08:05.439104+0000","last_fullsized":"2023-06-10T19:08:05.439104+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:39:08.089129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.3a","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.438595+0000","last_change":"2023-06-10T19:08:03.543709+0000","last_active":"2023-06-10T19:08:05.438595+0000","last_peered":"2023-06-10T19:08:05.438595+0000","last_clean":"2023-06-10T19:08:05.438595+0000","last_became_active":"2023-06-10T19:08:03.543432+0000","last_became_peered":"2023-06-10T19:08:03.543432+0000","last_unstale":"2023-06-10T19:08:05.438595+0000","last_undegraded":"2023-06-10T19:08:05.438595+0000","last_fullsized":"2023-06-10T19:08:05.438595+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:27:03.026315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.39","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.533417+0000","last_change":"2023-06-10T19:08:03.574642+0000","last_active":"2023-06-10T19:08:04.533417+0000","last_peered":"2023-06-10T19:08:04.533417+0000","last_clean":"2023-06-10T19:08:04.533417+0000","last_became_active":"2023-06-10T19:08:03.574385+0000","last_became_peered":"2023-06-10T19:08:03.574385+0000","last_unstale":"2023-06-10T19:08:04.533417+0000","last_undegraded":"2023-06-10T19:08:04.533417+0000","last_fullsized":"2023-06-10T19:08:04.533417+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:15:50.917829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.38","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.437562+0000","last_change":"2023-06-10T19:08:03.589461+0000","last_active":"2023-06-10T19:08:05.437562+0000","last_peered":"2023-06-10T19:08:05.437562+0000","last_clean":"2023-06-10T19:08:05.437562+0000","last_became_active":"2023-06-10T19:08:03.588966+0000","last_became_peered":"2023-06-10T19:08:03.588966+0000","last_unstale":"2023-06-10T19:08:05.437562+0000","last_undegraded":"2023-06-10T19:08:05.437562+0000","last_fullsized":"2023-06-10T19:08:05.437562+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:51:35.859527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.37","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.440062+0000","last_change":"2023-06-10T19:08:03.568419+0000","last_active":"2023-06-10T19:08:05.440062+0000","last_peered":"2023-06-10T19:08:05.440062+0000","last_clean":"2023-06-10T19:08:05.440062+0000","last_became_active":"2023-06-10T19:08:03.568097+0000","last_became_peered":"2023-06-10T19:08:03.568097+0000","last_unstale":"2023-06-10T19:08:05.440062+0000","last_undegraded":"2023-06-10T19:08:05.440062+0000","last_fullsized":"2023-06-10T19:08:05.440062+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:55:46.751696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.36","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.439403+0000","last_change":"2023-06-10T19:08:03.565351+0000","last_active":"2023-06-10T19:08:05.439403+0000","last_peered":"2023-06-10T19:08:05.439403+0000","last_clean":"2023-06-10T19:08:05.439403+0000","last_became_active":"2023-06-10T19:08:03.565034+0000","last_became_peered":"2023-06-10T19:08:03.565034+0000","last_unstale":"2023-06-10T19:08:05.439403+0000","last_undegraded":"2023-06-10T19:08:05.439403+0000","last_fullsized":"2023-06-10T19:08:05.439403+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:31:39.270453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.35","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.539365+0000","last_change":"2023-06-10T19:08:03.570891+0000","last_active":"2023-06-10T19:08:04.539365+0000","last_peered":"2023-06-10T19:08:04.539365+0000","last_clean":"2023-06-10T19:08:04.539365+0000","last_became_active":"2023-06-10T19:08:03.569883+0000","last_became_peered":"2023-06-10T19:08:03.569883+0000","last_unstale":"2023-06-10T19:08:04.539365+0000","last_undegraded":"2023-06-10T19:08:04.539365+0000","last_fullsized":"2023-06-10T19:08:04.539365+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:12:08.569775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.34","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.441338+0000","last_change":"2023-06-10T19:08:03.574028+0000","last_active":"2023-06-10T19:08:05.441338+0000","last_peered":"2023-06-10T19:08:05.441338+0000","last_clean":"2023-06-10T19:08:05.441338+0000","last_became_active":"2023-06-10T19:08:03.573632+0000","last_became_peered":"2023-06-10T19:08:03.573632+0000","last_unstale":"2023-06-10T19:08:05.441338+0000","last_undegraded":"2023-06-10T19:08:05.441338+0000","last_fullsized":"2023-06-10T19:08:05.441338+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:30:36.830089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.33","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.536731+0000","last_change":"2023-06-10T19:08:03.566388+0000","last_active":"2023-06-10T19:08:04.536731+0000","last_peered":"2023-06-10T19:08:04.536731+0000","last_clean":"2023-06-10T19:08:04.536731+0000","last_became_active":"2023-06-10T19:08:03.565605+0000","last_became_peered":"2023-06-10T19:08:03.565605+0000","last_unstale":"2023-06-10T19:08:04.536731+0000","last_undegraded":"2023-06-10T19:08:04.536731+0000","last_fullsized":"2023-06-10T19:08:04.536731+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:45:00.452073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.32","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.533578+0000","last_change":"2023-06-10T19:08:03.580410+0000","last_active":"2023-06-10T19:08:04.533578+0000","last_peered":"2023-06-10T19:08:04.533578+0000","last_clean":"2023-06-10T19:08:04.533578+0000","last_became_active":"2023-06-10T19:08:03.580054+0000","last_became_peered":"2023-06-10T19:08:03.580054+0000","last_unstale":"2023-06-10T19:08:04.533578+0000","last_undegraded":"2023-06-10T19:08:04.533578+0000","last_fullsized":"2023-06-10T19:08:04.533578+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:30:47.377068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.31","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.442464+0000","last_change":"2023-06-10T19:08:03.580205+0000","last_active":"2023-06-10T19:08:05.442464+0000","last_peered":"2023-06-10T19:08:05.442464+0000","last_clean":"2023-06-10T19:08:05.442464+0000","last_became_active":"2023-06-10T19:08:03.579926+0000","last_became_peered":"2023-06-10T19:08:03.579926+0000","last_unstale":"2023-06-10T19:08:05.442464+0000","last_undegraded":"2023-06-10T19:08:05.442464+0000","last_fullsized":"2023-06-10T19:08:05.442464+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:49:07.876093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.30","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.438171+0000","last_change":"2023-06-10T19:08:03.555133+0000","last_active":"2023-06-10T19:08:05.438171+0000","last_peered":"2023-06-10T19:08:05.438171+0000","last_clean":"2023-06-10T19:08:05.438171+0000","last_became_active":"2023-06-10T19:08:03.554673+0000","last_became_peered":"2023-06-10T19:08:03.554673+0000","last_unstale":"2023-06-10T19:08:05.438171+0000","last_undegraded":"2023-06-10T19:08:05.438171+0000","last_fullsized":"2023-06-10T19:08:05.438171+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:31:28.670042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2f","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.440201+0000","last_change":"2023-06-10T19:08:03.575364+0000","last_active":"2023-06-10T19:08:05.440201+0000","last_peered":"2023-06-10T19:08:05.440201+0000","last_clean":"2023-06-10T19:08:05.440201+0000","last_became_active":"2023-06-10T19:08:03.575031+0000","last_became_peered":"2023-06-10T19:08:03.575031+0000","last_unstale":"2023-06-10T19:08:05.440201+0000","last_undegraded":"2023-06-10T19:08:05.440201+0000","last_fullsized":"2023-06-10T19:08:05.440201+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:47:14.294710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2e","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.538823+0000","last_change":"2023-06-10T19:08:03.564127+0000","last_active":"2023-06-10T19:08:04.538823+0000","last_peered":"2023-06-10T19:08:04.538823+0000","last_clean":"2023-06-10T19:08:04.538823+0000","last_became_active":"2023-06-10T19:08:03.561654+0000","last_became_peered":"2023-06-10T19:08:03.561654+0000","last_unstale":"2023-06-10T19:08:04.538823+0000","last_undegraded":"2023-06-10T19:08:04.538823+0000","last_fullsized":"2023-06-10T19:08:04.538823+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:17:19.866920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.2d","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.538139+0000","last_change":"2023-06-10T19:08:03.559671+0000","last_active":"2023-06-10T19:08:04.538139+0000","last_peered":"2023-06-10T19:08:04.538139+0000","last_clean":"2023-06-10T19:08:04.538139+0000","last_became_active":"2023-06-10T19:08:03.558832+0000","last_became_peered":"2023-06-10T19:08:03.558832+0000","last_unstale":"2023-06-10T19:08:04.538139+0000","last_undegraded":"2023-06-10T19:08:04.538139+0000","last_fullsized":"2023-06-10T19:08:04.538139+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:48:27.658228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.2c","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.438604+0000","last_change":"2023-06-10T19:08:03.573437+0000","last_active":"2023-06-10T19:08:05.438604+0000","last_peered":"2023-06-10T19:08:05.438604+0000","last_clean":"2023-06-10T19:08:05.438604+0000","last_became_active":"2023-06-10T19:08:03.573206+0000","last_became_peered":"2023-06-10T19:08:03.573206+0000","last_unstale":"2023-06-10T19:08:05.438604+0000","last_undegraded":"2023-06-10T19:08:05.438604+0000","last_fullsized":"2023-06-10T19:08:05.438604+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:30:19.348632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2b","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.442485+0000","last_change":"2023-06-10T19:08:03.568604+0000","last_active":"2023-06-10T19:08:05.442485+0000","last_peered":"2023-06-10T19:08:05.442485+0000","last_clean":"2023-06-10T19:08:05.442485+0000","last_became_active":"2023-06-10T19:08:03.568366+0000","last_became_peered":"2023-06-10T19:08:03.568366+0000","last_unstale":"2023-06-10T19:08:05.442485+0000","last_undegraded":"2023-06-10T19:08:05.442485+0000","last_fullsized":"2023-06-10T19:08:05.442485+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:40:21.429277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.2a","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.440306+0000","last_change":"2023-06-10T19:08:03.568151+0000","last_active":"2023-06-10T19:08:05.440306+0000","last_peered":"2023-06-10T19:08:05.440306+0000","last_clean":"2023-06-10T19:08:05.440306+0000","last_became_active":"2023-06-10T19:08:03.567926+0000","last_became_peered":"2023-06-10T19:08:03.567926+0000","last_unstale":"2023-06-10T19:08:05.440306+0000","last_undegraded":"2023-06-10T19:08:05.440306+0000","last_fullsized":"2023-06-10T19:08:05.440306+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:05:36.667178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.29","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.437662+0000","last_change":"2023-06-10T19:08:03.573925+0000","last_active":"2023-06-10T19:08:05.437662+0000","last_peered":"2023-06-10T19:08:05.437662+0000","last_clean":"2023-06-10T19:08:05.437662+0000","last_became_active":"2023-06-10T19:08:03.572886+0000","last_became_peered":"2023-06-10T19:08:03.572886+0000","last_unstale":"2023-06-10T19:08:05.437662+0000","last_undegraded":"2023-06-10T19:08:05.437662+0000","last_fullsized":"2023-06-10T19:08:05.437662+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:28:24.324507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.28","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.440520+0000","last_change":"2023-06-10T19:08:03.561608+0000","last_active":"2023-06-10T19:08:05.440520+0000","last_peered":"2023-06-10T19:08:05.440520+0000","last_clean":"2023-06-10T19:08:05.440520+0000","last_became_active":"2023-06-10T19:08:03.561249+0000","last_became_peered":"2023-06-10T19:08:03.561249+0000","last_unstale":"2023-06-10T19:08:05.440520+0000","last_undegraded":"2023-06-10T19:08:05.440520+0000","last_fullsized":"2023-06-10T19:08:05.440520+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:57:21.820651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.27","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.534214+0000","last_change":"2023-06-10T19:08:03.538974+0000","last_active":"2023-06-10T19:08:04.534214+0000","last_peered":"2023-06-10T19:08:04.534214+0000","last_clean":"2023-06-10T19:08:04.534214+0000","last_became_active":"2023-06-10T19:08:03.538215+0000","last_became_peered":"2023-06-10T19:08:03.538215+0000","last_unstale":"2023-06-10T19:08:04.534214+0000","last_undegraded":"2023-06-10T19:08:04.534214+0000","last_fullsized":"2023-06-10T19:08:04.534214+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:40:29.723633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.26","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.539663+0000","last_change":"2023-06-10T19:08:03.577904+0000","last_active":"2023-06-10T19:08:04.539663+0000","last_peered":"2023-06-10T19:08:04.539663+0000","last_clean":"2023-06-10T19:08:04.539663+0000","last_became_active":"2023-06-10T19:08:03.577155+0000","last_became_peered":"2023-06-10T19:08:03.577155+0000","last_unstale":"2023-06-10T19:08:04.539663+0000","last_undegraded":"2023-06-10T19:08:04.539663+0000","last_fullsized":"2023-06-10T19:08:04.539663+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:34:20.169478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.25","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.437985+0000","last_change":"2023-06-10T19:08:03.573553+0000","last_active":"2023-06-10T19:08:05.437985+0000","last_peered":"2023-06-10T19:08:05.437985+0000","last_clean":"2023-06-10T19:08:05.437985+0000","last_became_active":"2023-06-10T19:08:03.572800+0000","last_became_peered":"2023-06-10T19:08:03.572800+0000","last_unstale":"2023-06-10T19:08:05.437985+0000","last_undegraded":"2023-06-10T19:08:05.437985+0000","last_fullsized":"2023-06-10T19:08:05.437985+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:48:58.816840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.24","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.438977+0000","last_change":"2023-06-10T19:08:03.555667+0000","last_active":"2023-06-10T19:08:05.438977+0000","last_peered":"2023-06-10T19:08:05.438977+0000","last_clean":"2023-06-10T19:08:05.438977+0000","last_became_active":"2023-06-10T19:08:03.555316+0000","last_became_peered":"2023-06-10T19:08:03.555316+0000","last_unstale":"2023-06-10T19:08:05.438977+0000","last_undegraded":"2023-06-10T19:08:05.438977+0000","last_fullsized":"2023-06-10T19:08:05.438977+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:57:21.587517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.23","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.538457+0000","last_change":"2023-06-10T19:08:03.553590+0000","last_active":"2023-06-10T19:08:04.538457+0000","last_peered":"2023-06-10T19:08:04.538457+0000","last_clean":"2023-06-10T19:08:04.538457+0000","last_became_active":"2023-06-10T19:08:03.551783+0000","last_became_peered":"2023-06-10T19:08:03.551783+0000","last_unstale":"2023-06-10T19:08:04.538457+0000","last_undegraded":"2023-06-10T19:08:04.538457+0000","last_fullsized":"2023-06-10T19:08:04.538457+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:38:26.169391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.22","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.537993+0000","last_change":"2023-06-10T19:08:03.569975+0000","last_active":"2023-06-10T19:08:04.537993+0000","last_peered":"2023-06-10T19:08:04.537993+0000","last_clean":"2023-06-10T19:08:04.537993+0000","last_became_active":"2023-06-10T19:08:03.568233+0000","last_became_peered":"2023-06-10T19:08:03.568233+0000","last_unstale":"2023-06-10T19:08:04.537993+0000","last_undegraded":"2023-06-10T19:08:04.537993+0000","last_fullsized":"2023-06-10T19:08:04.537993+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:33:41.215605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.21","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.533437+0000","last_change":"2023-06-10T19:08:03.545664+0000","last_active":"2023-06-10T19:08:04.533437+0000","last_peered":"2023-06-10T19:08:04.533437+0000","last_clean":"2023-06-10T19:08:04.533437+0000","last_became_active":"2023-06-10T19:08:03.545054+0000","last_became_peered":"2023-06-10T19:08:03.545054+0000","last_unstale":"2023-06-10T19:08:04.533437+0000","last_undegraded":"2023-06-10T19:08:04.533437+0000","last_fullsized":"2023-06-10T19:08:04.533437+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:41:32.159172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.20","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.438211+0000","last_change":"2023-06-10T19:08:03.565435+0000","last_active":"2023-06-10T19:08:05.438211+0000","last_peered":"2023-06-10T19:08:05.438211+0000","last_clean":"2023-06-10T19:08:05.438211+0000","last_became_active":"2023-06-10T19:08:03.565058+0000","last_became_peered":"2023-06-10T19:08:03.565058+0000","last_unstale":"2023-06-10T19:08:05.438211+0000","last_undegraded":"2023-06-10T19:08:05.438211+0000","last_fullsized":"2023-06-10T19:08:05.438211+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:55:18.316485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.438484+0000","last_change":"2023-06-10T19:08:03.587092+0000","last_active":"2023-06-10T19:08:05.438484+0000","last_peered":"2023-06-10T19:08:05.438484+0000","last_clean":"2023-06-10T19:08:05.438484+0000","last_became_active":"2023-06-10T19:08:03.586512+0000","last_became_peered":"2023-06-10T19:08:03.586512+0000","last_unstale":"2023-06-10T19:08:05.438484+0000","last_undegraded":"2023-06-10T19:08:05.438484+0000","last_fullsized":"2023-06-10T19:08:05.438484+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:12:33.443180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":13,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.439645+0000","last_change":"2023-06-10T19:08:03.165918+0000","last_active":"2023-06-10T19:08:05.439645+0000","last_peered":"2023-06-10T19:08:05.439645+0000","last_clean":"2023-06-10T19:08:05.439645+0000","last_became_active":"2023-06-10T19:08:03.165648+0000","last_became_peered":"2023-06-10T19:08:03.165648+0000","last_unstale":"2023-06-10T19:08:05.439645+0000","last_undegraded":"2023-06-10T19:08:05.439645+0000","last_fullsized":"2023-06-10T19:08:05.439645+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:14:55.405382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.15","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.439404+0000","last_change":"2023-06-10T19:08:03.541744+0000","last_active":"2023-06-10T19:08:05.439404+0000","last_peered":"2023-06-10T19:08:05.439404+0000","last_clean":"2023-06-10T19:08:05.439404+0000","last_became_active":"2023-06-10T19:08:03.541471+0000","last_became_peered":"2023-06-10T19:08:03.541471+0000","last_unstale":"2023-06-10T19:08:05.439404+0000","last_undegraded":"2023-06-10T19:08:05.439404+0000","last_fullsized":"2023-06-10T19:08:05.439404+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:02:50.763622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":13,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.441547+0000","last_change":"2023-06-10T19:08:03.173587+0000","last_active":"2023-06-10T19:08:05.441547+0000","last_peered":"2023-06-10T19:08:05.441547+0000","last_clean":"2023-06-10T19:08:05.441547+0000","last_became_active":"2023-06-10T19:08:03.172734+0000","last_became_peered":"2023-06-10T19:08:03.172734+0000","last_unstale":"2023-06-10T19:08:05.441547+0000","last_undegraded":"2023-06-10T19:08:05.441547+0000","last_fullsized":"2023-06-10T19:08:05.441547+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:11:48.025518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.538959+0000","last_change":"2023-06-10T19:08:03.563803+0000","last_active":"2023-06-10T19:08:04.538959+0000","last_peered":"2023-06-10T19:08:04.538959+0000","last_clean":"2023-06-10T19:08:04.538959+0000","last_became_active":"2023-06-10T19:08:03.560647+0000","last_became_peered":"2023-06-10T19:08:03.560647+0000","last_unstale":"2023-06-10T19:08:04.538959+0000","last_undegraded":"2023-06-10T19:08:04.538959+0000","last_fullsized":"2023-06-10T19:08:04.538959+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:16:21.139311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.15","version":"179'3","reported_seq":16,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.441891+0000","last_change":"2023-06-10T19:08:03.172100+0000","last_active":"2023-06-10T19:08:05.441891+0000","last_peered":"2023-06-10T19:08:05.441891+0000","last_clean":"2023-06-10T19:08:05.441891+0000","last_became_active":"2023-06-10T19:08:03.171685+0000","last_became_peered":"2023-06-10T19:08:03.171685+0000","last_unstale":"2023-06-10T19:08:05.441891+0000","last_undegraded":"2023-06-10T19:08:05.441891+0000","last_fullsized":"2023-06-10T19:08:05.441891+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:01:47.213952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.440445+0000","last_change":"2023-06-10T19:08:03.589150+0000","last_active":"2023-06-10T19:08:05.440445+0000","last_peered":"2023-06-10T19:08:05.440445+0000","last_clean":"2023-06-10T19:08:05.440445+0000","last_became_active":"2023-06-10T19:08:03.588891+0000","last_became_peered":"2023-06-10T19:08:03.588891+0000","last_unstale":"2023-06-10T19:08:05.440445+0000","last_undegraded":"2023-06-10T19:08:05.440445+0000","last_fullsized":"2023-06-10T19:08:05.440445+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:33:41.215605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.14","version":"179'6","reported_seq":19,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.537765+0000","last_change":"2023-06-10T19:08:03.155402+0000","last_active":"2023-06-10T19:08:04.537765+0000","last_peered":"2023-06-10T19:08:04.537765+0000","last_clean":"2023-06-10T19:08:04.537765+0000","last_became_active":"2023-06-10T19:08:03.154654+0000","last_became_peered":"2023-06-10T19:08:03.154654+0000","last_unstale":"2023-06-10T19:08:04.537765+0000","last_undegraded":"2023-06-10T19:08:04.537765+0000","last_fullsized":"2023-06-10T19:08:04.537765+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:42:56.995551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.10","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.533417+0000","last_change":"2023-06-10T19:08:03.563146+0000","last_active":"2023-06-10T19:08:04.533417+0000","last_peered":"2023-06-10T19:08:04.533417+0000","last_clean":"2023-06-10T19:08:04.533417+0000","last_became_active":"2023-06-10T19:08:03.562731+0000","last_became_peered":"2023-06-10T19:08:03.562731+0000","last_unstale":"2023-06-10T19:08:04.533417+0000","last_undegraded":"2023-06-10T19:08:04.533417+0000","last_fullsized":"2023-06-10T19:08:04.533417+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:33:16.922895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.13","version":"179'2","reported_seq":15,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.537152+0000","last_change":"2023-06-10T19:08:03.159168+0000","last_active":"2023-06-10T19:08:04.537152+0000","last_peered":"2023-06-10T19:08:04.537152+0000","last_clean":"2023-06-10T19:08:04.537152+0000","last_became_active":"2023-06-10T19:08:03.158413+0000","last_became_peered":"2023-06-10T19:08:03.158413+0000","last_unstale":"2023-06-10T19:08:04.537152+0000","last_undegraded":"2023-06-10T19:08:04.537152+0000","last_fullsized":"2023-06-10T19:08:04.537152+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:56:25.089543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.438011+0000","last_change":"2023-06-10T19:08:03.561865+0000","last_active":"2023-06-10T19:08:05.438011+0000","last_peered":"2023-06-10T19:08:05.438011+0000","last_clean":"2023-06-10T19:08:05.438011+0000","last_became_active":"2023-06-10T19:08:03.561538+0000","last_became_peered":"2023-06-10T19:08:03.561538+0000","last_unstale":"2023-06-10T19:08:05.438011+0000","last_undegraded":"2023-06-10T19:08:05.438011+0000","last_fullsized":"2023-06-10T19:08:05.438011+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:58:02.015111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":13,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.440897+0000","last_change":"2023-06-10T19:08:03.176624+0000","last_active":"2023-06-10T19:08:05.440897+0000","last_peered":"2023-06-10T19:08:05.440897+0000","last_clean":"2023-06-10T19:08:05.440897+0000","last_became_active":"2023-06-10T19:08:03.176279+0000","last_became_peered":"2023-06-10T19:08:03.176279+0000","last_unstale":"2023-06-10T19:08:05.440897+0000","last_undegraded":"2023-06-10T19:08:05.440897+0000","last_fullsized":"2023-06-10T19:08:05.440897+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:29:28.946876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.536731+0000","last_change":"2023-06-10T19:08:03.559686+0000","last_active":"2023-06-10T19:08:04.536731+0000","last_peered":"2023-06-10T19:08:04.536731+0000","last_clean":"2023-06-10T19:08:04.536731+0000","last_became_active":"2023-06-10T19:08:03.559011+0000","last_became_peered":"2023-06-10T19:08:03.559011+0000","last_unstale":"2023-06-10T19:08:04.536731+0000","last_undegraded":"2023-06-10T19:08:04.536731+0000","last_fullsized":"2023-06-10T19:08:04.536731+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:12:02.243967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":13,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.440895+0000","last_change":"2023-06-10T19:08:03.167973+0000","last_active":"2023-06-10T19:08:05.440895+0000","last_peered":"2023-06-10T19:08:05.440895+0000","last_clean":"2023-06-10T19:08:05.440895+0000","last_became_active":"2023-06-10T19:08:03.167618+0000","last_became_peered":"2023-06-10T19:08:03.167618+0000","last_unstale":"2023-06-10T19:08:05.440895+0000","last_undegraded":"2023-06-10T19:08:05.440895+0000","last_fullsized":"2023-06-10T19:08:05.440895+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:44:05.276389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.537175+0000","last_change":"2023-06-10T19:08:03.564884+0000","last_active":"2023-06-10T19:08:04.537175+0000","last_peered":"2023-06-10T19:08:04.537175+0000","last_clean":"2023-06-10T19:08:04.537175+0000","last_became_active":"2023-06-10T19:08:03.562409+0000","last_became_peered":"2023-06-10T19:08:03.562409+0000","last_unstale":"2023-06-10T19:08:04.537175+0000","last_undegraded":"2023-06-10T19:08:04.537175+0000","last_fullsized":"2023-06-10T19:08:04.537175+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:19:50.039523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.10","version":"179'8","reported_seq":21,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.537569+0000","last_change":"2023-06-10T19:08:03.162903+0000","last_active":"2023-06-10T19:08:04.537569+0000","last_peered":"2023-06-10T19:08:04.537569+0000","last_clean":"2023-06-10T19:08:04.537569+0000","last_became_active":"2023-06-10T19:08:03.162152+0000","last_became_peered":"2023-06-10T19:08:03.162152+0000","last_unstale":"2023-06-10T19:08:04.537569+0000","last_undegraded":"2023-06-10T19:08:04.537569+0000","last_fullsized":"2023-06-10T19:08:04.537569+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:05:35.663553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.533712+0000","last_change":"2023-06-10T19:08:03.544622+0000","last_active":"2023-06-10T19:08:04.533712+0000","last_peered":"2023-06-10T19:08:04.533712+0000","last_clean":"2023-06-10T19:08:04.533712+0000","last_became_active":"2023-06-10T19:08:03.544279+0000","last_became_peered":"2023-06-10T19:08:03.544279+0000","last_unstale":"2023-06-10T19:08:04.533712+0000","last_undegraded":"2023-06-10T19:08:04.533712+0000","last_fullsized":"2023-06-10T19:08:04.533712+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:54:35.028243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"179'1","reported_seq":14,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.539745+0000","last_change":"2023-06-10T19:08:03.163073+0000","last_active":"2023-06-10T19:08:04.539745+0000","last_peered":"2023-06-10T19:08:04.539745+0000","last_clean":"2023-06-10T19:08:04.539745+0000","last_became_active":"2023-06-10T19:08:03.162247+0000","last_became_peered":"2023-06-10T19:08:03.162247+0000","last_unstale":"2023-06-10T19:08:04.539745+0000","last_undegraded":"2023-06-10T19:08:04.539745+0000","last_fullsized":"2023-06-10T19:08:04.539745+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:11:48.025518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.d","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.438841+0000","last_change":"2023-06-10T19:08:03.565474+0000","last_active":"2023-06-10T19:08:05.438841+0000","last_peered":"2023-06-10T19:08:05.438841+0000","last_clean":"2023-06-10T19:08:05.438841+0000","last_became_active":"2023-06-10T19:08:03.565157+0000","last_became_peered":"2023-06-10T19:08:03.565157+0000","last_unstale":"2023-06-10T19:08:05.438841+0000","last_undegraded":"2023-06-10T19:08:05.438841+0000","last_fullsized":"2023-06-10T19:08:05.438841+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:33:14.902144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.e","version":"179'2","reported_seq":15,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.442076+0000","last_change":"2023-06-10T19:08:03.164758+0000","last_active":"2023-06-10T19:08:05.442076+0000","last_peered":"2023-06-10T19:08:05.442076+0000","last_clean":"2023-06-10T19:08:05.442076+0000","last_became_active":"2023-06-10T19:08:03.164339+0000","last_became_peered":"2023-06-10T19:08:03.164339+0000","last_unstale":"2023-06-10T19:08:05.442076+0000","last_undegraded":"2023-06-10T19:08:05.442076+0000","last_fullsized":"2023-06-10T19:08:05.442076+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T07:01:33.103419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.e","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.539905+0000","last_change":"2023-06-10T19:08:03.567884+0000","last_active":"2023-06-10T19:08:04.539905+0000","last_peered":"2023-06-10T19:08:04.539905+0000","last_clean":"2023-06-10T19:08:04.539905+0000","last_became_active":"2023-06-10T19:08:03.554317+0000","last_became_peered":"2023-06-10T19:08:03.554317+0000","last_unstale":"2023-06-10T19:08:04.539905+0000","last_undegraded":"2023-06-10T19:08:04.539905+0000","last_fullsized":"2023-06-10T19:08:04.539905+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:15:17.054842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.d","version":"179'1","reported_seq":14,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.244375+0000","last_change":"2023-06-10T19:08:03.172642+0000","last_active":"2023-06-10T19:08:05.244375+0000","last_peered":"2023-06-10T19:08:05.244375+0000","last_clean":"2023-06-10T19:08:05.244375+0000","last_became_active":"2023-06-10T19:08:03.171991+0000","last_became_peered":"2023-06-10T19:08:03.171991+0000","last_unstale":"2023-06-10T19:08:05.244375+0000","last_undegraded":"2023-06-10T19:08:05.244375+0000","last_fullsized":"2023-06-10T19:08:05.244375+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:42:19.801565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.f","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.440598+0000","last_change":"2023-06-10T19:08:03.542491+0000","last_active":"2023-06-10T19:08:05.440598+0000","last_peered":"2023-06-10T19:08:05.440598+0000","last_clean":"2023-06-10T19:08:05.440598+0000","last_became_active":"2023-06-10T19:08:03.542164+0000","last_became_peered":"2023-06-10T19:08:03.542164+0000","last_unstale":"2023-06-10T19:08:05.440598+0000","last_undegraded":"2023-06-10T19:08:05.440598+0000","last_fullsized":"2023-06-10T19:08:05.440598+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:44:03.212378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":13,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.539237+0000","last_change":"2023-06-10T19:08:03.169366+0000","last_active":"2023-06-10T19:08:04.539237+0000","last_peered":"2023-06-10T19:08:04.539237+0000","last_clean":"2023-06-10T19:08:04.539237+0000","last_became_active":"2023-06-10T19:08:03.168665+0000","last_became_peered":"2023-06-10T19:08:03.168665+0000","last_unstale":"2023-06-10T19:08:04.539237+0000","last_undegraded":"2023-06-10T19:08:04.539237+0000","last_fullsized":"2023-06-10T19:08:04.539237+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:49:04.339866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.440880+0000","last_change":"2023-06-10T19:08:03.541569+0000","last_active":"2023-06-10T19:08:05.440880+0000","last_peered":"2023-06-10T19:08:05.440880+0000","last_clean":"2023-06-10T19:08:05.440880+0000","last_became_active":"2023-06-10T19:08:03.541227+0000","last_became_peered":"2023-06-10T19:08:03.541227+0000","last_unstale":"2023-06-10T19:08:05.440880+0000","last_undegraded":"2023-06-10T19:08:05.440880+0000","last_fullsized":"2023-06-10T19:08:05.440880+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:12:08.569775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"179'2","reported_seq":15,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.537409+0000","last_change":"2023-06-10T19:08:03.163373+0000","last_active":"2023-06-10T19:08:04.537409+0000","last_peered":"2023-06-10T19:08:04.537409+0000","last_clean":"2023-06-10T19:08:04.537409+0000","last_became_active":"2023-06-10T19:08:03.162483+0000","last_became_peered":"2023-06-10T19:08:03.162483+0000","last_unstale":"2023-06-10T19:08:04.537409+0000","last_undegraded":"2023-06-10T19:08:04.537409+0000","last_fullsized":"2023-06-10T19:08:04.537409+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:32:57.503882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.440954+0000","last_change":"2023-06-10T19:08:03.563884+0000","last_active":"2023-06-10T19:08:05.440954+0000","last_peered":"2023-06-10T19:08:05.440954+0000","last_clean":"2023-06-10T19:08:05.440954+0000","last_became_active":"2023-06-10T19:08:03.563454+0000","last_became_peered":"2023-06-10T19:08:03.563454+0000","last_unstale":"2023-06-10T19:08:05.440954+0000","last_undegraded":"2023-06-10T19:08:05.440954+0000","last_fullsized":"2023-06-10T19:08:05.440954+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:25:02.329031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":13,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.441707+0000","last_change":"2023-06-10T19:08:03.161103+0000","last_active":"2023-06-10T19:08:05.441707+0000","last_peered":"2023-06-10T19:08:05.441707+0000","last_clean":"2023-06-10T19:08:05.441707+0000","last_became_active":"2023-06-10T19:08:03.160619+0000","last_became_peered":"2023-06-10T19:08:03.160619+0000","last_unstale":"2023-06-10T19:08:05.441707+0000","last_undegraded":"2023-06-10T19:08:05.441707+0000","last_fullsized":"2023-06-10T19:08:05.441707+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:55:31.570596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.441467+0000","last_change":"2023-06-10T19:08:03.545518+0000","last_active":"2023-06-10T19:08:05.441467+0000","last_peered":"2023-06-10T19:08:05.441467+0000","last_clean":"2023-06-10T19:08:05.441467+0000","last_became_active":"2023-06-10T19:08:03.545178+0000","last_became_peered":"2023-06-10T19:08:03.545178+0000","last_unstale":"2023-06-10T19:08:05.441467+0000","last_undegraded":"2023-06-10T19:08:05.441467+0000","last_fullsized":"2023-06-10T19:08:05.441467+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:28:38.534049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":13,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.533782+0000","last_change":"2023-06-10T19:08:03.171072+0000","last_active":"2023-06-10T19:08:04.533782+0000","last_peered":"2023-06-10T19:08:04.533782+0000","last_clean":"2023-06-10T19:08:04.533782+0000","last_became_active":"2023-06-10T19:08:03.170735+0000","last_became_peered":"2023-06-10T19:08:03.170735+0000","last_unstale":"2023-06-10T19:08:04.533782+0000","last_undegraded":"2023-06-10T19:08:04.533782+0000","last_fullsized":"2023-06-10T19:08:04.533782+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:30:54.576376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.b","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.441538+0000","last_change":"2023-06-10T19:08:03.540526+0000","last_active":"2023-06-10T19:08:05.441538+0000","last_peered":"2023-06-10T19:08:05.441538+0000","last_clean":"2023-06-10T19:08:05.441538+0000","last_became_active":"2023-06-10T19:08:03.540261+0000","last_became_peered":"2023-06-10T19:08:03.540261+0000","last_unstale":"2023-06-10T19:08:05.441538+0000","last_undegraded":"2023-06-10T19:08:05.441538+0000","last_fullsized":"2023-06-10T19:08:05.441538+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:50:12.757760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":13,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.244074+0000","last_change":"2023-06-10T19:08:03.171194+0000","last_active":"2023-06-10T19:08:05.244074+0000","last_peered":"2023-06-10T19:08:05.244074+0000","last_clean":"2023-06-10T19:08:05.244074+0000","last_became_active":"2023-06-10T19:08:03.170379+0000","last_became_peered":"2023-06-10T19:08:03.170379+0000","last_unstale":"2023-06-10T19:08:05.244074+0000","last_undegraded":"2023-06-10T19:08:05.244074+0000","last_fullsized":"2023-06-10T19:08:05.244074+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:22:56.034087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.534064+0000","last_change":"2023-06-10T19:08:03.581234+0000","last_active":"2023-06-10T19:08:04.534064+0000","last_peered":"2023-06-10T19:08:04.534064+0000","last_clean":"2023-06-10T19:08:04.534064+0000","last_became_active":"2023-06-10T19:08:03.580975+0000","last_became_peered":"2023-06-10T19:08:03.580975+0000","last_unstale":"2023-06-10T19:08:04.534064+0000","last_undegraded":"2023-06-10T19:08:04.534064+0000","last_fullsized":"2023-06-10T19:08:04.534064+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:20:03.303403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.7","version":"179'2","reported_seq":15,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.442669+0000","last_change":"2023-06-10T19:08:03.169137+0000","last_active":"2023-06-10T19:08:05.442669+0000","last_peered":"2023-06-10T19:08:05.442669+0000","last_clean":"2023-06-10T19:08:05.442669+0000","last_became_active":"2023-06-10T19:08:03.168699+0000","last_became_peered":"2023-06-10T19:08:03.168699+0000","last_unstale":"2023-06-10T19:08:05.442669+0000","last_undegraded":"2023-06-10T19:08:05.442669+0000","last_fullsized":"2023-06-10T19:08:05.442669+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:59:46.381568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.442326+0000","last_change":"2023-06-10T19:08:03.546672+0000","last_active":"2023-06-10T19:08:05.442326+0000","last_peered":"2023-06-10T19:08:05.442326+0000","last_clean":"2023-06-10T19:08:05.442326+0000","last_became_active":"2023-06-10T19:08:03.546335+0000","last_became_peered":"2023-06-10T19:08:03.546335+0000","last_unstale":"2023-06-10T19:08:05.442326+0000","last_undegraded":"2023-06-10T19:08:05.442326+0000","last_fullsized":"2023-06-10T19:08:05.442326+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:00:24.679984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":13,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.533784+0000","last_change":"2023-06-10T19:08:03.171145+0000","last_active":"2023-06-10T19:08:04.533784+0000","last_peered":"2023-06-10T19:08:04.533784+0000","last_clean":"2023-06-10T19:08:04.533784+0000","last_became_active":"2023-06-10T19:08:03.170771+0000","last_became_peered":"2023-06-10T19:08:03.170771+0000","last_unstale":"2023-06-10T19:08:04.533784+0000","last_undegraded":"2023-06-10T19:08:04.533784+0000","last_fullsized":"2023-06-10T19:08:04.533784+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:41:25.258785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.438355+0000","last_change":"2023-06-10T19:08:03.575290+0000","last_active":"2023-06-10T19:08:05.438355+0000","last_peered":"2023-06-10T19:08:05.438355+0000","last_clean":"2023-06-10T19:08:05.438355+0000","last_became_active":"2023-06-10T19:08:03.574628+0000","last_became_peered":"2023-06-10T19:08:03.574628+0000","last_unstale":"2023-06-10T19:08:05.438355+0000","last_undegraded":"2023-06-10T19:08:05.438355+0000","last_fullsized":"2023-06-10T19:08:05.438355+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:54:08.024569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":13,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.439628+0000","last_change":"2023-06-10T19:08:03.161120+0000","last_active":"2023-06-10T19:08:05.439628+0000","last_peered":"2023-06-10T19:08:05.439628+0000","last_clean":"2023-06-10T19:08:05.439628+0000","last_became_active":"2023-06-10T19:08:03.160739+0000","last_became_peered":"2023-06-10T19:08:03.160739+0000","last_unstale":"2023-06-10T19:08:05.439628+0000","last_undegraded":"2023-06-10T19:08:05.439628+0000","last_fullsized":"2023-06-10T19:08:05.439628+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:17:42.867012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.7","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.534445+0000","last_change":"2023-06-10T19:08:03.555628+0000","last_active":"2023-06-10T19:08:04.534445+0000","last_peered":"2023-06-10T19:08:04.534445+0000","last_clean":"2023-06-10T19:08:04.534445+0000","last_became_active":"2023-06-10T19:08:03.555125+0000","last_became_peered":"2023-06-10T19:08:03.555125+0000","last_unstale":"2023-06-10T19:08:04.534445+0000","last_undegraded":"2023-06-10T19:08:04.534445+0000","last_fullsized":"2023-06-10T19:08:04.534445+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:19:03.383699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":13,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.439235+0000","last_change":"2023-06-10T19:08:03.170457+0000","last_active":"2023-06-10T19:08:05.439235+0000","last_peered":"2023-06-10T19:08:05.439235+0000","last_clean":"2023-06-10T19:08:05.439235+0000","last_became_active":"2023-06-10T19:08:03.170163+0000","last_became_peered":"2023-06-10T19:08:03.170163+0000","last_unstale":"2023-06-10T19:08:05.439235+0000","last_undegraded":"2023-06-10T19:08:05.439235+0000","last_fullsized":"2023-06-10T19:08:05.439235+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:48:07.813977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.244239+0000","last_change":"2023-06-10T19:08:03.559882+0000","last_active":"2023-06-10T19:08:05.244239+0000","last_peered":"2023-06-10T19:08:05.244239+0000","last_clean":"2023-06-10T19:08:05.244239+0000","last_became_active":"2023-06-10T19:08:03.559081+0000","last_became_peered":"2023-06-10T19:08:03.559081+0000","last_unstale":"2023-06-10T19:08:05.244239+0000","last_undegraded":"2023-06-10T19:08:05.244239+0000","last_fullsized":"2023-06-10T19:08:05.244239+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:45:59.707914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":13,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.437424+0000","last_change":"2023-06-10T19:08:03.160092+0000","last_active":"2023-06-10T19:08:05.437424+0000","last_peered":"2023-06-10T19:08:05.437424+0000","last_clean":"2023-06-10T19:08:05.437424+0000","last_became_active":"2023-06-10T19:08:03.159264+0000","last_became_peered":"2023-06-10T19:08:03.159264+0000","last_unstale":"2023-06-10T19:08:05.437424+0000","last_undegraded":"2023-06-10T19:08:05.437424+0000","last_fullsized":"2023-06-10T19:08:05.437424+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:52:36.401230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.536915+0000","last_change":"2023-06-10T19:08:03.572199+0000","last_active":"2023-06-10T19:08:04.536915+0000","last_peered":"2023-06-10T19:08:04.536915+0000","last_clean":"2023-06-10T19:08:04.536915+0000","last_became_active":"2023-06-10T19:08:03.571532+0000","last_became_peered":"2023-06-10T19:08:03.571532+0000","last_unstale":"2023-06-10T19:08:04.536915+0000","last_undegraded":"2023-06-10T19:08:04.536915+0000","last_fullsized":"2023-06-10T19:08:04.536915+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:22:57.056249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":13,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.437343+0000","last_change":"2023-06-10T19:08:03.160030+0000","last_active":"2023-06-10T19:08:05.437343+0000","last_peered":"2023-06-10T19:08:05.437343+0000","last_clean":"2023-06-10T19:08:05.437343+0000","last_became_active":"2023-06-10T19:08:03.159233+0000","last_became_peered":"2023-06-10T19:08:03.159233+0000","last_unstale":"2023-06-10T19:08:05.437343+0000","last_undegraded":"2023-06-10T19:08:05.437343+0000","last_fullsized":"2023-06-10T19:08:05.437343+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:13:09.541660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.440672+0000","last_change":"2023-06-10T19:08:03.544742+0000","last_active":"2023-06-10T19:08:05.440672+0000","last_peered":"2023-06-10T19:08:05.440672+0000","last_clean":"2023-06-10T19:08:05.440672+0000","last_became_active":"2023-06-10T19:08:03.543098+0000","last_became_peered":"2023-06-10T19:08:03.543098+0000","last_unstale":"2023-06-10T19:08:05.440672+0000","last_undegraded":"2023-06-10T19:08:05.440672+0000","last_fullsized":"2023-06-10T19:08:05.440672+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:49:05.343491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":13,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.533577+0000","last_change":"2023-06-10T19:08:03.155129+0000","last_active":"2023-06-10T19:08:04.533577+0000","last_peered":"2023-06-10T19:08:04.533577+0000","last_clean":"2023-06-10T19:08:04.533577+0000","last_became_active":"2023-06-10T19:08:03.154886+0000","last_became_peered":"2023-06-10T19:08:03.154886+0000","last_unstale":"2023-06-10T19:08:04.533577+0000","last_undegraded":"2023-06-10T19:08:04.533577+0000","last_fullsized":"2023-06-10T19:08:04.533577+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:42:39.488280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.437520+0000","last_change":"2023-06-10T19:08:03.576348+0000","last_active":"2023-06-10T19:08:05.437520+0000","last_peered":"2023-06-10T19:08:05.437520+0000","last_clean":"2023-06-10T19:08:05.437520+0000","last_became_active":"2023-06-10T19:08:03.575613+0000","last_became_peered":"2023-06-10T19:08:03.575613+0000","last_unstale":"2023-06-10T19:08:05.437520+0000","last_undegraded":"2023-06-10T19:08:05.437520+0000","last_fullsized":"2023-06-10T19:08:05.437520+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:40:06.194864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":13,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.244364+0000","last_change":"2023-06-10T19:08:03.175107+0000","last_active":"2023-06-10T19:08:05.244364+0000","last_peered":"2023-06-10T19:08:05.244364+0000","last_clean":"2023-06-10T19:08:05.244364+0000","last_became_active":"2023-06-10T19:08:03.174236+0000","last_became_peered":"2023-06-10T19:08:03.174236+0000","last_unstale":"2023-06-10T19:08:05.244364+0000","last_undegraded":"2023-06-10T19:08:05.244364+0000","last_fullsized":"2023-06-10T19:08:05.244364+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:31:44.793122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.1b","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.244415+0000","last_change":"2023-06-10T19:08:03.561297+0000","last_active":"2023-06-10T19:08:05.244415+0000","last_peered":"2023-06-10T19:08:05.244415+0000","last_clean":"2023-06-10T19:08:05.244415+0000","last_became_active":"2023-06-10T19:08:03.560411+0000","last_became_peered":"2023-06-10T19:08:03.560411+0000","last_unstale":"2023-06-10T19:08:05.244415+0000","last_undegraded":"2023-06-10T19:08:05.244415+0000","last_fullsized":"2023-06-10T19:08:05.244415+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:16:51.862751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":13,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.438084+0000","last_change":"2023-06-10T19:08:03.161563+0000","last_active":"2023-06-10T19:08:05.438084+0000","last_peered":"2023-06-10T19:08:05.438084+0000","last_clean":"2023-06-10T19:08:05.438084+0000","last_became_active":"2023-06-10T19:08:03.161083+0000","last_became_peered":"2023-06-10T19:08:03.161083+0000","last_unstale":"2023-06-10T19:08:05.438084+0000","last_undegraded":"2023-06-10T19:08:05.438084+0000","last_fullsized":"2023-06-10T19:08:05.438084+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:03:20.657974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":434,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.437815+0000","last_change":"2023-06-10T18:52:34.951528+0000","last_active":"2023-06-10T19:08:05.437815+0000","last_peered":"2023-06-10T19:08:05.437815+0000","last_clean":"2023-06-10T19:08:05.437815+0000","last_became_active":"2023-06-10T18:52:34.949099+0000","last_became_peered":"2023-06-10T18:52:34.949099+0000","last_unstale":"2023-06-10T19:08:05.437815+0000","last_undegraded":"2023-06-10T19:08:05.437815+0000","last_fullsized":"2023-06-10T19:08:05.437815+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_clean_scrub_stamp":"2023-06-10T18:52:33.633295+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:00:17.499241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":310,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.538633+0000","last_change":"2023-06-10T18:52:40.506384+0000","last_active":"2023-06-10T19:08:04.538633+0000","last_peered":"2023-06-10T19:08:04.538633+0000","last_clean":"2023-06-10T19:08:04.538633+0000","last_became_active":"2023-06-10T18:52:40.505701+0000","last_became_peered":"2023-06-10T18:52:40.505701+0000","last_unstale":"2023-06-10T19:08:04.538633+0000","last_undegraded":"2023-06-10T19:08:04.538633+0000","last_fullsized":"2023-06-10T19:08:04.538633+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:28:39.564965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.536571+0000","last_change":"2023-06-10T19:08:03.539779+0000","last_active":"2023-06-10T19:08:04.536571+0000","last_peered":"2023-06-10T19:08:04.536571+0000","last_clean":"2023-06-10T19:08:04.536571+0000","last_became_active":"2023-06-10T19:08:03.538931+0000","last_became_peered":"2023-06-10T19:08:03.538931+0000","last_unstale":"2023-06-10T19:08:04.536571+0000","last_undegraded":"2023-06-10T19:08:04.536571+0000","last_fullsized":"2023-06-10T19:08:04.536571+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:18:01.184162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.1b","version":"179'1","reported_seq":14,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.439541+0000","last_change":"2023-06-10T19:08:03.167339+0000","last_active":"2023-06-10T19:08:05.439541+0000","last_peered":"2023-06-10T19:08:05.439541+0000","last_clean":"2023-06-10T19:08:05.439541+0000","last_became_active":"2023-06-10T19:08:03.166946+0000","last_became_peered":"2023-06-10T19:08:03.166946+0000","last_unstale":"2023-06-10T19:08:05.439541+0000","last_undegraded":"2023-06-10T19:08:05.439541+0000","last_fullsized":"2023-06-10T19:08:05.439541+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:05:12.859895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":278,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.437615+0000","last_change":"2023-06-10T18:52:40.512015+0000","last_active":"2023-06-10T19:08:05.437615+0000","last_peered":"2023-06-10T19:08:05.437615+0000","last_clean":"2023-06-10T19:08:05.437615+0000","last_became_active":"2023-06-10T18:52:40.511382+0000","last_became_peered":"2023-06-10T18:52:40.511382+0000","last_unstale":"2023-06-10T19:08:05.437615+0000","last_undegraded":"2023-06-10T19:08:05.437615+0000","last_fullsized":"2023-06-10T19:08:05.437615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:46:31.338645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.440549+0000","last_change":"2023-06-10T19:08:03.544401+0000","last_active":"2023-06-10T19:08:05.440549+0000","last_peered":"2023-06-10T19:08:05.440549+0000","last_clean":"2023-06-10T19:08:05.440549+0000","last_became_active":"2023-06-10T19:08:03.544129+0000","last_became_peered":"2023-06-10T19:08:03.544129+0000","last_unstale":"2023-06-10T19:08:05.440549+0000","last_undegraded":"2023-06-10T19:08:05.440549+0000","last_fullsized":"2023-06-10T19:08:05.440549+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:38:26.169391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1a","version":"179'1","reported_seq":14,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.441420+0000","last_change":"2023-06-10T19:08:03.161776+0000","last_active":"2023-06-10T19:08:05.441420+0000","last_peered":"2023-06-10T19:08:05.441420+0000","last_clean":"2023-06-10T19:08:05.441420+0000","last_became_active":"2023-06-10T19:08:03.161475+0000","last_became_peered":"2023-06-10T19:08:03.161475+0000","last_unstale":"2023-06-10T19:08:05.441420+0000","last_undegraded":"2023-06-10T19:08:05.441420+0000","last_fullsized":"2023-06-10T19:08:05.441420+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:22:58.600090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":300,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.533771+0000","last_change":"2023-06-10T18:52:40.671725+0000","last_active":"2023-06-10T19:08:04.533771+0000","last_peered":"2023-06-10T19:08:04.533771+0000","last_clean":"2023-06-10T19:08:04.533771+0000","last_became_active":"2023-06-10T18:52:40.671442+0000","last_became_peered":"2023-06-10T18:52:40.671442+0000","last_unstale":"2023-06-10T19:08:04.533771+0000","last_undegraded":"2023-06-10T19:08:04.533771+0000","last_fullsized":"2023-06-10T19:08:04.533771+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T21:08:08.625563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.1a","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.441340+0000","last_change":"2023-06-10T19:08:03.579894+0000","last_active":"2023-06-10T19:08:05.441340+0000","last_peered":"2023-06-10T19:08:05.441340+0000","last_clean":"2023-06-10T19:08:05.441340+0000","last_became_active":"2023-06-10T19:08:03.579634+0000","last_became_peered":"2023-06-10T19:08:03.579634+0000","last_unstale":"2023-06-10T19:08:05.441340+0000","last_undegraded":"2023-06-10T19:08:05.441340+0000","last_fullsized":"2023-06-10T19:08:05.441340+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:21:09.590484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":13,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.536895+0000","last_change":"2023-06-10T19:08:03.160135+0000","last_active":"2023-06-10T19:08:04.536895+0000","last_peered":"2023-06-10T19:08:04.536895+0000","last_clean":"2023-06-10T19:08:04.536895+0000","last_became_active":"2023-06-10T19:08:03.159272+0000","last_became_peered":"2023-06-10T19:08:03.159272+0000","last_unstale":"2023-06-10T19:08:04.536895+0000","last_undegraded":"2023-06-10T19:08:04.536895+0000","last_fullsized":"2023-06-10T19:08:04.536895+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:10:13.249089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":310,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.538194+0000","last_change":"2023-06-10T18:52:40.510258+0000","last_active":"2023-06-10T19:08:04.538194+0000","last_peered":"2023-06-10T19:08:04.538194+0000","last_clean":"2023-06-10T19:08:04.538194+0000","last_became_active":"2023-06-10T18:52:40.509560+0000","last_became_peered":"2023-06-10T18:52:40.509560+0000","last_unstale":"2023-06-10T19:08:04.538194+0000","last_undegraded":"2023-06-10T19:08:04.538194+0000","last_fullsized":"2023-06-10T19:08:04.538194+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:41:58.173239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.438428+0000","last_change":"2023-06-10T19:08:03.573570+0000","last_active":"2023-06-10T19:08:05.438428+0000","last_peered":"2023-06-10T19:08:05.438428+0000","last_clean":"2023-06-10T19:08:05.438428+0000","last_became_active":"2023-06-10T19:08:03.572764+0000","last_became_peered":"2023-06-10T19:08:03.572764+0000","last_unstale":"2023-06-10T19:08:05.438428+0000","last_undegraded":"2023-06-10T19:08:05.438428+0000","last_fullsized":"2023-06-10T19:08:05.438428+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:31:03.507727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1f","version":"179'4","reported_seq":17,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.442415+0000","last_change":"2023-06-10T19:08:03.161456+0000","last_active":"2023-06-10T19:08:05.442415+0000","last_peered":"2023-06-10T19:08:05.442415+0000","last_clean":"2023-06-10T19:08:05.442415+0000","last_became_active":"2023-06-10T19:08:03.160674+0000","last_became_peered":"2023-06-10T19:08:03.160674+0000","last_unstale":"2023-06-10T19:08:05.442415+0000","last_undegraded":"2023-06-10T19:08:05.442415+0000","last_fullsized":"2023-06-10T19:08:05.442415+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:18:09.843711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":280,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.439918+0000","last_change":"2023-06-10T18:52:40.672266+0000","last_active":"2023-06-10T19:08:05.439918+0000","last_peered":"2023-06-10T19:08:05.439918+0000","last_clean":"2023-06-10T19:08:05.439918+0000","last_became_active":"2023-06-10T18:52:40.671966+0000","last_became_peered":"2023-06-10T18:52:40.671966+0000","last_unstale":"2023-06-10T19:08:05.439918+0000","last_undegraded":"2023-06-10T19:08:05.439918+0000","last_fullsized":"2023-06-10T19:08:05.439918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T05:55:35.364123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1d","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.533975+0000","last_change":"2023-06-10T19:08:03.560173+0000","last_active":"2023-06-10T19:08:04.533975+0000","last_peered":"2023-06-10T19:08:04.533975+0000","last_clean":"2023-06-10T19:08:04.533975+0000","last_became_active":"2023-06-10T19:08:03.559915+0000","last_became_peered":"2023-06-10T19:08:03.559915+0000","last_unstale":"2023-06-10T19:08:04.533975+0000","last_undegraded":"2023-06-10T19:08:04.533975+0000","last_fullsized":"2023-06-10T19:08:04.533975+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:22:12.825894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"179'1","reported_seq":14,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.441942+0000","last_change":"2023-06-10T19:08:03.167039+0000","last_active":"2023-06-10T19:08:05.441942+0000","last_peered":"2023-06-10T19:08:05.441942+0000","last_clean":"2023-06-10T19:08:05.441942+0000","last_became_active":"2023-06-10T19:08:03.166789+0000","last_became_peered":"2023-06-10T19:08:03.166789+0000","last_unstale":"2023-06-10T19:08:05.441942+0000","last_undegraded":"2023-06-10T19:08:05.441942+0000","last_fullsized":"2023-06-10T19:08:05.441942+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:01:55.927670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":278,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.438095+0000","last_change":"2023-06-10T18:52:40.671084+0000","last_active":"2023-06-10T19:08:05.438095+0000","last_peered":"2023-06-10T19:08:05.438095+0000","last_clean":"2023-06-10T19:08:05.438095+0000","last_became_active":"2023-06-10T18:52:40.670697+0000","last_became_peered":"2023-06-10T18:52:40.670697+0000","last_unstale":"2023-06-10T19:08:05.438095+0000","last_undegraded":"2023-06-10T19:08:05.438095+0000","last_fullsized":"2023-06-10T19:08:05.438095+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:10:09.642847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1e","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.539709+0000","last_change":"2023-06-10T19:08:03.579869+0000","last_active":"2023-06-10T19:08:04.539709+0000","last_peered":"2023-06-10T19:08:04.539709+0000","last_clean":"2023-06-10T19:08:04.539709+0000","last_became_active":"2023-06-10T19:08:03.578943+0000","last_became_peered":"2023-06-10T19:08:03.578943+0000","last_unstale":"2023-06-10T19:08:04.539709+0000","last_undegraded":"2023-06-10T19:08:04.539709+0000","last_fullsized":"2023-06-10T19:08:04.539709+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T04:21:09.590484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1d","version":"179'2","reported_seq":15,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.539290+0000","last_change":"2023-06-10T19:08:03.162026+0000","last_active":"2023-06-10T19:08:04.539290+0000","last_peered":"2023-06-10T19:08:04.539290+0000","last_clean":"2023-06-10T19:08:04.539290+0000","last_became_active":"2023-06-10T19:08:03.160874+0000","last_became_peered":"2023-06-10T19:08:03.160874+0000","last_unstale":"2023-06-10T19:08:04.539290+0000","last_undegraded":"2023-06-10T19:08:04.539290+0000","last_fullsized":"2023-06-10T19:08:04.539290+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:29:28.946876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":280,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.441845+0000","last_change":"2023-06-10T18:52:40.514114+0000","last_active":"2023-06-10T19:08:05.441845+0000","last_peered":"2023-06-10T19:08:05.441845+0000","last_clean":"2023-06-10T19:08:05.441845+0000","last_became_active":"2023-06-10T18:52:40.513638+0000","last_became_peered":"2023-06-10T18:52:40.513638+0000","last_unstale":"2023-06-10T19:08:05.441845+0000","last_undegraded":"2023-06-10T19:08:05.441845+0000","last_fullsized":"2023-06-10T19:08:05.441845+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:59:53.407429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1f","version":"0'0","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.244748+0000","last_change":"2023-06-10T19:08:03.589242+0000","last_active":"2023-06-10T19:08:05.244748+0000","last_peered":"2023-06-10T19:08:05.244748+0000","last_clean":"2023-06-10T19:08:05.244748+0000","last_became_active":"2023-06-10T19:08:03.588788+0000","last_became_peered":"2023-06-10T19:08:03.588788+0000","last_unstale":"2023-06-10T19:08:05.244748+0000","last_undegraded":"2023-06-10T19:08:05.244748+0000","last_fullsized":"2023-06-10T19:08:05.244748+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:03.122254+0000","last_clean_scrub_stamp":"2023-06-10T19:08:03.122254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T02:25:08.168192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1c","version":"179'2","reported_seq":15,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:04.537418+0000","last_change":"2023-06-10T19:08:03.159361+0000","last_active":"2023-06-10T19:08:04.537418+0000","last_peered":"2023-06-10T19:08:04.537418+0000","last_clean":"2023-06-10T19:08:04.537418+0000","last_became_active":"2023-06-10T19:08:03.158564+0000","last_became_peered":"2023-06-10T19:08:03.158564+0000","last_unstale":"2023-06-10T19:08:04.537418+0000","last_undegraded":"2023-06-10T19:08:04.537418+0000","last_fullsized":"2023-06-10T19:08:04.537418+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:08:02.118629+0000","last_clean_scrub_stamp":"2023-06-10T19:08:02.118629+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:54:26.405549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":280,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-06-10T19:08:05.244688+0000","last_change":"2023-06-10T18:52:40.515396+0000","last_active":"2023-06-10T19:08:05.244688+0000","last_peered":"2023-06-10T19:08:05.244688+0000","last_clean":"2023-06-10T19:08:05.244688+0000","last_became_active":"2023-06-10T18:52:40.514663+0000","last_became_peered":"2023-06-10T18:52:40.514663+0000","last_unstale":"2023-06-10T19:08:05.244688+0000","last_undegraded":"2023-06-10T19:08:05.244688+0000","last_fullsized":"2023-06-10T19:08:05.244688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:38:44.075046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":25,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575038,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33836,"kb_used_data":2788,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338004,"statfs":{"total":96636764160,"available":96602116096,"internally_reserved":0,"allocated":2854912,"data_stored":1647554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:07:04 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.93600000000000005,"15min":0.92500000000000004},"min":{"1min":0.443,"5min":0.443,"15min":0.434},"max":{"1min":1.131,"5min":1.522,"15min":1.6220000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.88,"5min":0.90900000000000003,"15min":0.92400000000000004},"min":{"1min":0.63400000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.1379999999999999,"5min":1.3109999999999999,"15min":1.6870000000000001},"last":0.49399999999999999}]},{"osd":1,"last update":"Sat Jun 10 19:07:04 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.88800000000000001,"15min":0.91700000000000004},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.377},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.92300000000000004,"15min":0.94299999999999995},"min":{"1min":0.55000000000000004,"5min":0.51300000000000001,"15min":0.504},"max":{"1min":1.302,"5min":1.3320000000000001,"15min":1.5960000000000001},"last":0.65000000000000002}]},{"osd":2,"last update":"Sat Jun 10 19:07:04 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.86699999999999999,"15min":0.85299999999999998},"min":{"1min":0.41899999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.2370000000000001,"5min":1.2629999999999999,"15min":1.4059999999999999},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.88700000000000001,"15min":0.89600000000000002},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.50600000000000001},"max":{"1min":1.2290000000000001,"5min":1.3100000000000001,"15min":1.448},"last":0.751}]},{"osd":3,"last update":"Sat Jun 10 19:07:04 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.89600000000000002,"15min":0.92000000000000004},"min":{"1min":0.68600000000000005,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.1299999999999999,"5min":1.4490000000000001,"15min":1.502},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.95099999999999996,"15min":0.95599999999999996},"min":{"1min":0.496,"5min":0.432,"15min":0.432},"max":{"1min":1.2,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.97299999999999998}]},{"osd":4,"last update":"Sat Jun 10 19:07:04 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.82799999999999996,"15min":0.84399999999999997},"min":{"1min":0.60299999999999998,"5min":0.307,"15min":0.307},"max":{"1min":1.1639999999999999,"5min":1.2290000000000001,"15min":1.639},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.96699999999999997,"15min":0.96599999999999997},"min":{"1min":0.47299999999999998,"5min":0.41199999999999998,"15min":0.40000000000000002},"max":{"1min":1.1799999999999999,"5min":1.454,"15min":1.4590000000000001},"last":1.079}]},{"osd":5,"last update":"Sat Jun 10 19:07:04 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.99399999999999999,"15min":1.002},"min":{"1min":0.66600000000000004,"5min":0.45100000000000001,"15min":0.38400000000000001},"max":{"1min":1.268,"5min":1.385,"15min":1.806},"last":1.1220000000000001},{"interface":"front","average":{"1min":1.044,"5min":1.0269999999999999,"15min":1.0349999999999999},"min":{"1min":0.78200000000000003,"5min":0.48499999999999999,"15min":0.46500000000000002},"max":{"1min":1.254,"5min":1.665,"15min":1.665},"last":1.155}]},{"osd":6,"last update":"Sat Jun 10 19:07:04 2023","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.014,"15min":1.0089999999999999},"min":{"1min":0.71899999999999997,"5min":0.47699999999999998,"15min":0.35999999999999999},"max":{"1min":2.1120000000000001,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.117,"5min":1.0960000000000001,"15min":1.099},"min":{"1min":0.82499999999999996,"5min":0.504,"15min":0.441},"max":{"1min":1.397,"5min":1.728,"15min":1.728},"last":1.1970000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575039,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33260,"kb_used_data":2212,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338580,"statfs":{"total":96636764160,"available":96602705920,"internally_reserved":0,"allocated":2265088,"data_stored":1057256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:07:58 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.84699999999999998,"15min":0.86599999999999999},"min":{"1min":0.55700000000000005,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.2050000000000001,"5min":1.2450000000000001,"15min":1.498},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.879,"15min":0.88400000000000001},"min":{"1min":0.58199999999999996,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.1359999999999999,"5min":1.3009999999999999,"15min":1.496},"last":0.76700000000000002}]},{"osd":1,"last update":"Sat Jun 10 19:07:58 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.83999999999999997,"15min":0.86099999999999999},"min":{"1min":0.60799999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.1200000000000001,"5min":1.2709999999999999,"15min":1.5229999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.90300000000000002,"15min":0.90700000000000003},"min":{"1min":0.71199999999999997,"5min":0.504,"15min":0.45300000000000001},"max":{"1min":1.248,"5min":1.341,"15min":1.778},"last":0.84299999999999997}]},{"osd":2,"last update":"Sat Jun 10 19:07:58 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.89400000000000002,"15min":0.90200000000000002},"min":{"1min":0.53500000000000003,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.1579999999999999,"5min":1.2929999999999999,"15min":1.3759999999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.874,"5min":0.86699999999999999,"15min":0.88200000000000001},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.175,"5min":1.175,"15min":1.246},"last":0.63100000000000001}]},{"osd":3,"last update":"Sat Jun 10 19:07:58 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.91400000000000003,"15min":0.92300000000000004},"min":{"1min":0.67300000000000004,"5min":0.55100000000000005,"15min":0.52700000000000002},"max":{"1min":1.1890000000000001,"5min":1.238,"15min":1.7190000000000001},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.95399999999999996,"15min":0.97899999999999998},"min":{"1min":0.72699999999999998,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.1639999999999999,"5min":1.304,"15min":1.4370000000000001},"last":0.54600000000000004}]},{"osd":4,"last update":"Sat Jun 10 19:07:58 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.93400000000000005,"15min":0.91600000000000004},"min":{"1min":0.58599999999999997,"5min":0.45900000000000002,"15min":0.373},"max":{"1min":1.2130000000000001,"5min":1.4019999999999999,"15min":1.798},"last":1.0680000000000001},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.999,"15min":0.98399999999999999},"min":{"1min":0.65600000000000003,"5min":0.504,"15min":0.47899999999999998},"max":{"1min":1.276,"5min":1.409,"15min":1.5489999999999999},"last":1.008}]},{"osd":5,"last update":"Sat Jun 10 19:07:58 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.875,"15min":0.90000000000000002},"min":{"1min":0.45300000000000001,"5min":0.437,"15min":0.437},"max":{"1min":1.1020000000000001,"5min":1.2150000000000001,"15min":1.333},"last":0.81399999999999995},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.0189999999999999,"15min":1.024},"min":{"1min":0.64300000000000002,"5min":0.47199999999999998,"15min":0.42699999999999999},"max":{"1min":1.3069999999999999,"5min":1.3520000000000001,"15min":2.536},"last":1.03}]},{"osd":7,"last update":"Sat Jun 10 19:07:58 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.04,"15min":1.028},"min":{"1min":0.69399999999999995,"5min":0.59199999999999997,"15min":0.57099999999999995},"max":{"1min":1.1870000000000001,"5min":1.879,"15min":1.917},"last":1.0529999999999999},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.98299999999999998,"15min":0.999},"min":{"1min":0.51700000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.226,"5min":1.345,"15min":1.5569999999999999},"last":0.95799999999999996}]}]},{"osd":5,"up_from":13,"seq":55834575039,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33272,"kb_used_data":2224,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338568,"statfs":{"total":96636764160,"available":96602693632,"internally_reserved":0,"allocated":2277376,"data_stored":1058772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.85399999999999998,"15min":0.874},"min":{"1min":0.53100000000000003,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.2649999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":1.2350000000000001},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.89200000000000002,"15min":0.90000000000000002},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.49399999999999999},"max":{"1min":1.0860000000000001,"5min":1.2370000000000001,"15min":2.347},"last":0.86399999999999999}]},{"osd":1,"last update":"Sat Jun 10 19:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.879,"15min":0.90900000000000003},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.153,"5min":1.6739999999999999,"15min":7.0800000000000001},"last":1.266},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.90200000000000002,"15min":0.98199999999999998},"min":{"1min":0.56999999999999995,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1619999999999999,"5min":1.2689999999999999,"15min":15.845000000000001},"last":1.0329999999999999}]},{"osd":2,"last update":"Sat Jun 10 19:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.90700000000000003,"15min":0.89600000000000002},"min":{"1min":0.60999999999999999,"5min":0.54300000000000004,"15min":0.48299999999999998},"max":{"1min":1.2150000000000001,"5min":1.6459999999999999,"15min":5.0049999999999999},"last":1.1930000000000001},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.91500000000000004,"15min":0.94599999999999995},"min":{"1min":0.625,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.107,"5min":1.391,"15min":6.851},"last":1.1359999999999999}]},{"osd":3,"last update":"Sat Jun 10 19:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.93600000000000005,"15min":0.94699999999999995},"min":{"1min":0.59099999999999997,"5min":0.58699999999999997,"15min":0.51500000000000001},"max":{"1min":1.508,"5min":1.6910000000000001,"15min":2.544},"last":1.304},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.97699999999999998,"15min":0.98999999999999999},"min":{"1min":0.748,"5min":0.66000000000000003,"15min":0.59799999999999998},"max":{"1min":1.3009999999999999,"5min":1.4870000000000001,"15min":3.0830000000000002},"last":0.95699999999999996}]},{"osd":4,"last update":"Sat Jun 10 19:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.94199999999999995,"15min":0.94799999999999995},"min":{"1min":0.67000000000000004,"5min":0.59799999999999998,"15min":0.58099999999999996},"max":{"1min":1.454,"5min":1.6140000000000001,"15min":6.7290000000000001},"last":0.998},{"interface":"front","average":{"1min":1.0720000000000001,"5min":0.97099999999999997,"15min":0.98699999999999999},"min":{"1min":0.69699999999999995,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":0.93000000000000005}]},{"osd":6,"last update":"Sat Jun 10 19:07:54 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":0.98899999999999999,"15min":0.98699999999999999},"min":{"1min":0.70399999999999996,"5min":0.60499999999999998,"15min":0.54200000000000004},"max":{"1min":1.7190000000000001,"5min":1.8009999999999999,"15min":1.8009999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.0329999999999999,"15min":1.054},"min":{"1min":0.86799999999999999,"5min":0.66200000000000003,"15min":0.57899999999999996},"max":{"1min":1.5620000000000001,"5min":1.8380000000000001,"15min":6.923},"last":0.77600000000000002}]},{"osd":7,"last update":"Sat Jun 10 19:07:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.0640000000000001,"15min":1.0800000000000001},"min":{"1min":0.95899999999999996,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.7549999999999999,"5min":1.7749999999999999,"15min":2.6080000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1200000000000001,"15min":1.133},"min":{"1min":0.88700000000000001,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":5.4169999999999998},"last":1.1040000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575038,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33272,"kb_used_data":2224,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338568,"statfs":{"total":96636764160,"available":96602693632,"internally_reserved":0,"allocated":2277376,"data_stored":1058784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.83999999999999997,"15min":0.83299999999999996},"min":{"1min":0.53200000000000003,"5min":0.45400000000000001,"15min":0.45100000000000001},"max":{"1min":1.2190000000000001,"5min":1.29,"15min":1.29},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.90000000000000002,"15min":0.90600000000000003},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.375,"5min":1.3979999999999999,"15min":3.7280000000000002},"last":1.0860000000000001}]},{"osd":1,"last update":"Sat Jun 10 19:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.90000000000000002,"15min":0.92800000000000005},"min":{"1min":0.55000000000000004,"5min":0.47799999999999998,"15min":0.47599999999999998},"max":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":3.3969999999999998},"last":0.995},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.83199999999999996,"15min":0.86199999999999999},"min":{"1min":0.55700000000000005,"5min":0.47899999999999998,"15min":0.47699999999999998},"max":{"1min":1.212,"5min":1.2430000000000001,"15min":2.496},"last":1.1100000000000001}]},{"osd":2,"last update":"Sat Jun 10 19:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.85899999999999999,"15min":0.879},"min":{"1min":0.52400000000000002,"5min":0.52200000000000002,"15min":0.49299999999999999},"max":{"1min":1.137,"5min":1.236,"15min":1.522},"last":0.88},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.95899999999999996,"15min":0.98499999999999999},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.55000000000000004},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":3.5750000000000002},"last":1.155}]},{"osd":3,"last update":"Sat Jun 10 19:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.86399999999999999,"15min":0.89300000000000002},"min":{"1min":0.57799999999999996,"5min":0.56200000000000006,"15min":0.53900000000000003},"max":{"1min":1.1200000000000001,"5min":1.46,"15min":2.3809999999999998},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.94599999999999995,"15min":0.96299999999999997},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.54400000000000004},"max":{"1min":1.2889999999999999,"5min":1.4279999999999999,"15min":1.6479999999999999},"last":1.0589999999999999}]},{"osd":5,"last update":"Sat Jun 10 19:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.95299999999999996,"15min":0.95799999999999996},"min":{"1min":0.66800000000000004,"5min":0.58699999999999997,"15min":0.53100000000000003},"max":{"1min":1.224,"5min":1.3260000000000001,"15min":3.6539999999999999},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.92000000000000004,"15min":0.93999999999999995},"min":{"1min":0.63400000000000001,"5min":0.495,"15min":0.495},"max":{"1min":1.216,"5min":1.26,"15min":2.6720000000000002},"last":0.84499999999999997}]},{"osd":6,"last update":"Sat Jun 10 19:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.97599999999999998,"15min":0.96799999999999997},"min":{"1min":0.67000000000000004,"5min":0.443,"15min":0.443},"max":{"1min":1.2869999999999999,"5min":1.413,"15min":2.2639999999999998},"last":0.70299999999999996},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.081,"15min":1.0680000000000001},"min":{"1min":0.76300000000000001,"5min":0.58799999999999997,"15min":0.44400000000000001},"max":{"1min":1.625,"5min":1.625,"15min":3.4980000000000002},"last":0.73699999999999999}]},{"osd":7,"last update":"Sat Jun 10 19:07:08 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.02,"15min":1.0009999999999999},"min":{"1min":0.82699999999999996,"5min":0.60899999999999999,"15min":0.41399999999999998},"max":{"1min":1.3240000000000001,"5min":1.3919999999999999,"15min":2.5910000000000002},"last":1.036},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.071},"min":{"1min":0.81100000000000005,"5min":0.50800000000000001,"15min":0.46300000000000002},"max":{"1min":1.385,"5min":1.635,"15min":1.635},"last":1.0189999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575037,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37356,"kb_used_data":2212,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334484,"statfs":{"total":96636764160,"available":96598511616,"internally_reserved":0,"allocated":2265088,"data_stored":1056327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.63700000000000001,"15min":0.628},"min":{"1min":0.33800000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.879,"5min":1.0900000000000001,"15min":1.169},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.66600000000000004,"15min":0.66900000000000004},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.251},"max":{"1min":0.91200000000000003,"5min":0.97799999999999998,"15min":1.5269999999999999},"last":0.33000000000000002}]},{"osd":1,"last update":"Sat Jun 10 19:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.68300000000000005,"15min":0.68899999999999995},"min":{"1min":0.33300000000000002,"5min":0.29699999999999999,"15min":0.27500000000000002},"max":{"1min":1.234,"5min":1.234,"15min":2.0699999999999998},"last":0.376},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71799999999999997,"15min":0.73399999999999999},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.411},"last":0.436}]},{"osd":2,"last update":"Sat Jun 10 19:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.753,"15min":0.77300000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.30299999999999999},"max":{"1min":0.98699999999999999,"5min":1.2829999999999999,"15min":1.9530000000000001},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.80600000000000005,"15min":0.79700000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.29699999999999999},"max":{"1min":1.0800000000000001,"5min":1.2769999999999999,"15min":1.591},"last":0.39700000000000002}]},{"osd":4,"last update":"Sat Jun 10 19:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.94599999999999995,"15min":0.94899999999999995},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.41899999999999998},"max":{"1min":1.294,"5min":1.4239999999999999,"15min":1.8240000000000001},"last":0.629},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.98499999999999999,"15min":0.99199999999999999},"min":{"1min":0.64600000000000002,"5min":0.57299999999999995,"15min":0.47999999999999998},"max":{"1min":1.417,"5min":1.4330000000000001,"15min":1.873},"last":0.748}]},{"osd":5,"last update":"Sat Jun 10 19:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.99399999999999999,"15min":1.0069999999999999},"min":{"1min":0.56899999999999995,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.474,"5min":1.536,"15min":2.024},"last":0.64400000000000002},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.038,"15min":1.0369999999999999},"min":{"1min":0.71499999999999997,"5min":0.59999999999999998,"15min":0.46899999999999997},"max":{"1min":1.3580000000000001,"5min":1.534,"15min":1.9259999999999999},"last":0.57499999999999996}]},{"osd":6,"last update":"Sat Jun 10 19:07:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":1.048,"15min":1.0629999999999999},"min":{"1min":0.69799999999999995,"5min":0.56999999999999995,"15min":0.55300000000000005},"max":{"1min":1.4359999999999999,"5min":1.617,"15min":1.8500000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.0309999999999999,"15min":1.05},"min":{"1min":0.629,"5min":0.61399999999999999,"15min":0.58799999999999997},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":2.2120000000000002},"last":0.76400000000000001}]},{"osd":7,"last update":"Sat Jun 10 19:07:54 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.0580000000000001,"15min":1.081},"min":{"1min":0.66400000000000003,"5min":0.58199999999999996,"15min":0.56999999999999995},"max":{"1min":1.4139999999999999,"5min":1.5720000000000001,"15min":2.1150000000000002},"last":0.55800000000000005},{"interface":"front","average":{"1min":1.077,"5min":1.089,"15min":1.101},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.4379999999999999,"5min":1.6779999999999999,"15min":1.9850000000000001},"last":0.69199999999999995}]}]},{"osd":2,"up_from":13,"seq":55834575038,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37356,"kb_used_data":2212,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334484,"statfs":{"total":96636764160,"available":96598511616,"internally_reserved":0,"allocated":2265088,"data_stored":1057768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.63700000000000001,"15min":0.626},"min":{"1min":0.34499999999999997,"5min":0.28299999999999997,"15min":0.27300000000000002},"max":{"1min":1.4490000000000001,"5min":2.883,"15min":2.883},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.76300000000000001,"15min":0.73699999999999999},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.101,"5min":6.5670000000000002,"15min":6.5670000000000002},"last":0.42599999999999999}]},{"osd":1,"last update":"Sat Jun 10 19:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.64600000000000002,"15min":0.66500000000000004},"min":{"1min":0.36199999999999999,"5min":0.32300000000000001,"15min":0.29199999999999998},"max":{"1min":1.032,"5min":1.1100000000000001,"15min":1.1950000000000001},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.81299999999999994,"15min":0.78800000000000003},"min":{"1min":0.32500000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.133,"5min":8.4429999999999996,"15min":8.4429999999999996},"last":0.51100000000000001}]},{"osd":3,"last update":"Sat Jun 10 19:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.76500000000000001,"15min":0.77900000000000003},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.1359999999999999,"5min":1.1899999999999999,"15min":1.2350000000000001},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.76500000000000001,"15min":0.78000000000000003},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.23499999999999999},"max":{"1min":1.21,"5min":4.1849999999999996,"15min":4.1849999999999996},"last":0.46999999999999997}]},{"osd":4,"last update":"Sat Jun 10 19:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.94599999999999995,"15min":0.93700000000000006},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.54,"5min":3.996,"15min":3.996},"last":0.624},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.109,"15min":1.05},"min":{"1min":0.502,"5min":0.496,"15min":0.496},"max":{"1min":1.488,"5min":13.254,"15min":13.254},"last":0.93899999999999995}]},{"osd":5,"last update":"Sat Jun 10 19:08:04 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.1180000000000001,"15min":1.0509999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.476,"5min":6.9189999999999996,"15min":6.9189999999999996},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.2430000000000001,"15min":1.099},"min":{"1min":0.69999999999999996,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.6359999999999999,"5min":15.526,"15min":15.526},"last":0.95899999999999996}]},{"osd":6,"last update":"Sat Jun 10 19:08:04 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.129,"15min":1.0820000000000001},"min":{"1min":0.624,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.7769999999999999,"5min":8.7089999999999996,"15min":8.7089999999999996},"last":1.0820000000000001},{"interface":"front","average":{"1min":0.95699999999999996,"5min":1.054,"15min":1.054},"min":{"1min":0.58399999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.319,"5min":6.1299999999999999,"15min":6.1299999999999999},"last":0.91300000000000003}]},{"osd":7,"last update":"Sat Jun 10 19:08:04 2023","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.2969999999999999,"15min":1.169},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.57199999999999995},"max":{"1min":1.6890000000000001,"5min":12.138,"15min":12.138},"last":1.022},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0740000000000001,"15min":1.1100000000000001},"min":{"1min":0.66900000000000004,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":0.89000000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575040,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37348,"kb_used_data":2204,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334492,"statfs":{"total":96636764160,"available":96598519808,"internally_reserved":0,"allocated":2256896,"data_stored":1056167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.66400000000000003,"15min":0.67900000000000005},"min":{"1min":0.36699999999999999,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":1.0049999999999999,"5min":1.048,"15min":1.288},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.73499999999999999,"15min":0.749},"min":{"1min":0.44900000000000001,"5min":0.32300000000000001,"15min":0.26900000000000002},"max":{"1min":1.008,"5min":1.615,"15min":1.694},"last":0.44900000000000001}]},{"osd":2,"last update":"Sat Jun 10 19:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.621,"15min":0.63400000000000001},"min":{"1min":0.376,"5min":0.29699999999999999,"15min":0.249},"max":{"1min":0.81999999999999995,"5min":0.94699999999999995,"15min":1.21},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.70399999999999996,"15min":0.72499999999999998},"min":{"1min":0.33000000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.071,"5min":1.2390000000000001,"15min":1.415},"last":0.48999999999999999}]},{"osd":3,"last update":"Sat Jun 10 19:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.748,"15min":0.77800000000000002},"min":{"1min":0.38900000000000001,"5min":0.34000000000000002,"15min":0.25600000000000001},"max":{"1min":0.995,"5min":1.143,"15min":1.6299999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.69499999999999995,"15min":0.72799999999999998},"min":{"1min":0.46500000000000002,"5min":0.36099999999999999,"15min":0.29599999999999999},"max":{"1min":1.0289999999999999,"5min":1.2709999999999999,"15min":2.1749999999999998},"last":0.53400000000000003}]},{"osd":4,"last update":"Sat Jun 10 19:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.87,"15min":0.871},"min":{"1min":0.61899999999999999,"5min":0.58599999999999997,"15min":0.53000000000000003},"max":{"1min":1.3340000000000001,"5min":1.3620000000000001,"15min":1.4930000000000001},"last":1.0129999999999999},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.98799999999999999,"15min":1.024},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.47099999999999997},"max":{"1min":1.373,"5min":1.575,"15min":5.8209999999999997},"last":0.86899999999999999}]},{"osd":5,"last update":"Sat Jun 10 19:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.96999999999999997,"15min":0.98999999999999999},"min":{"1min":0.63900000000000001,"5min":0.54800000000000004,"15min":0.49399999999999999},"max":{"1min":1.1839999999999999,"5min":1.5720000000000001,"15min":1.8620000000000001},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.97699999999999998},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.46300000000000002},"max":{"1min":1.4299999999999999,"5min":1.448,"15min":3.089},"last":1.0760000000000001}]},{"osd":6,"last update":"Sat Jun 10 19:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.97699999999999998,"15min":1.044},"min":{"1min":0.61499999999999999,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.228,"5min":1.4950000000000001,"15min":7.2599999999999998},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.97999999999999998,"15min":1.034},"min":{"1min":0.60299999999999998,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":9.0069999999999997},"last":1.123}]},{"osd":7,"last update":"Sat Jun 10 19:08:07 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.04,"15min":1.073},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.495},"max":{"1min":1.4159999999999999,"5min":1.4890000000000001,"15min":2.105},"last":0.93999999999999995},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.05,"15min":1.0780000000000001},"min":{"1min":0.67400000000000004,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.2829999999999999,"5min":1.526,"15min":2.2570000000000001},"last":1.044}]}]},{"osd":0,"up_from":13,"seq":55834575039,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37944,"kb_used_data":2800,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94333896,"statfs":{"total":96636764160,"available":96597909504,"internally_reserved":0,"allocated":2867200,"data_stored":1647263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jun 10 19:08:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.61599999999999999,"15min":0.63800000000000001},"min":{"1min":0.255,"5min":0.255,"15min":0.248},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.77400000000000002,"15min":0.80100000000000005},"min":{"1min":0.33000000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.0740000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.37}]},{"osd":2,"last update":"Sat Jun 10 19:08:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.69299999999999995,"15min":0.71299999999999997},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.98499999999999999,"5min":1.1970000000000001,"15min":1.2829999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.63500000000000001,"15min":0.65300000000000002},"min":{"1min":0.29999999999999999,"5min":0.28699999999999998,"15min":0.245},"max":{"1min":0.90600000000000003,"5min":1.1779999999999999,"15min":1.371},"last":0.312}]},{"osd":3,"last update":"Sat Jun 10 19:08:02 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.67000000000000004,"15min":0.68300000000000005},"min":{"1min":0.309,"5min":0.309,"15min":0.28899999999999998},"max":{"1min":1.1439999999999999,"5min":1.397,"15min":1.397},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.78200000000000003,"15min":0.81399999999999995},"min":{"1min":0.36399999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.1699999999999999,"5min":1.6240000000000001,"15min":1.829},"last":0.40100000000000002}]},{"osd":4,"last update":"Sat Jun 10 19:08:02 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.89300000000000002,"15min":0.91900000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.276,"5min":1.758,"15min":3.0209999999999999},"last":0.622},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.997,"15min":1.02},"min":{"1min":0.56200000000000006,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.224,"5min":1.873,"15min":1.9510000000000001},"last":0.77000000000000002}]},{"osd":5,"last update":"Sat Jun 10 19:08:02 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.88300000000000001,"15min":0.92100000000000004},"min":{"1min":0.51300000000000001,"5min":0.51200000000000001,"15min":0.45100000000000001},"max":{"1min":1.226,"5min":1.252,"15min":1.694},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.95899999999999996,"15min":1.0009999999999999},"min":{"1min":0.64800000000000002,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.321,"5min":1.9870000000000001,"15min":4.5620000000000003},"last":0.53100000000000003}]},{"osd":6,"last update":"Sat Jun 10 19:08:02 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.0289999999999999,"15min":1.0700000000000001},"min":{"1min":0.63700000000000001,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.3149999999999999,"5min":1.9330000000000001,"15min":3.5569999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.98699999999999999,"15min":0.999},"min":{"1min":0.56999999999999995,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.333,"5min":1.6599999999999999,"15min":1.883},"last":0.61099999999999999}]},{"osd":7,"last update":"Sat Jun 10 19:08:02 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.995,"15min":1.024},"min":{"1min":0.627,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.502,"5min":1.804,"15min":1.804},"last":0.78900000000000003},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0369999999999999,"15min":1.0569999999999999},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.58699999999999997},"max":{"1min":1.3720000000000001,"5min":2.1219999999999999,"15min":2.1219999999999999},"last":0.65200000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-10T19:08:12.404 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-06-10T19:08:12.405 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-06-10T19:08:12.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.577+0000 7f63f9d4f640 1 Processor -- start 2023-06-10T19:08:12.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.577+0000 7f63f9d4f640 1 -- start start 2023-06-10T19:08:12.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.577+0000 7f63f9d4f640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f63f415be50 0x7f63f40cc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:12.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.577+0000 7f63f9d4f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f63f415c220 0x7f63f40cccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:12.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.577+0000 7f63f9d4f640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63f40b45c0 con 0x7f63f40cd200 2023-06-10T19:08:12.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.577+0000 7f63f9d4f640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63f40b4af0 con 0x7f63f415c220 2023-06-10T19:08:12.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.577+0000 7f63f9d4f640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63f40cfec0 con 0x7f63f415be50 2023-06-10T19:08:12.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.577+0000 7f63f2ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f63f415c220 0x7f63f40cccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:12.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.577+0000 7f63f2ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f63f415c220 0x7f63f40cccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45454/0 (socket says 172.21.15.53:45454) 2023-06-10T19:08:12.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.577+0000 7f63f2ffd640 1 -- 172.21.15.53:0/372099652 learned_addr learned my addr 172.21.15.53:0/372099652 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:08:12.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.577+0000 7f63f37fe640 1 --2- 172.21.15.53:0/372099652 >> v2:172.21.15.117:3300/0 conn(0x7f63f415be50 0x7f63f40cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:12.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.577+0000 7f63f2ffd640 1 -- 172.21.15.53:0/372099652 >> v2:172.21.15.117:3300/0 conn(0x7f63f415be50 msgr2=0x7f63f40cc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:12.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.577+0000 7f63f2ffd640 1 --2- 172.21.15.53:0/372099652 >> v2:172.21.15.117:3300/0 conn(0x7f63f415be50 0x7f63f40cc780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:12.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.577+0000 7f63f2ffd640 1 -- 172.21.15.53:0/372099652 >> v1:172.21.15.117:6789/0 conn(0x7f63f40cd200 legacy=0x7f63f415fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:12.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.577+0000 7f63f2ffd640 1 -- 172.21.15.53:0/372099652 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63f40b7f00 con 0x7f63f415c220 2023-06-10T19:08:12.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.581+0000 7f63f2ffd640 1 --2- 172.21.15.53:0/372099652 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63f415c220 0x7f63f40cccc0 secure :-1 s=READY pgs=2609 cs=0 l=1 rev1=1 crypto rx=0x7f63f4066f40 tx=0x7f63e801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b24a8c17af3f495d server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:12.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.581+0000 7f63f27fc640 1 -- 172.21.15.53:0/372099652 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e80ab660 con 0x7f63f415c220 2023-06-10T19:08:12.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.581+0000 7f63f27fc640 1 -- 172.21.15.53:0/372099652 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63e80ab7c0 con 0x7f63f415c220 2023-06-10T19:08:12.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.581+0000 7f63f27fc640 1 -- 172.21.15.53:0/372099652 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e80abb50 con 0x7f63f415c220 2023-06-10T19:08:12.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.581+0000 7f63f9d4f640 1 -- 172.21.15.53:0/372099652 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63f415c220 msgr2=0x7f63f40cccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:12.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.581+0000 7f63f9d4f640 1 --2- 172.21.15.53:0/372099652 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63f415c220 0x7f63f40cccc0 secure :-1 s=READY pgs=2609 cs=0 l=1 rev1=1 crypto rx=0x7f63f4066f40 tx=0x7f63e801c440 comp rx=0 tx=0).stop 2023-06-10T19:08:12.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.581+0000 7f63f9d4f640 1 -- 172.21.15.53:0/372099652 shutdown_connections 2023-06-10T19:08:12.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.581+0000 7f63f9d4f640 1 --2- 172.21.15.53:0/372099652 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63f415c220 0x7f63f40cccc0 unknown :-1 s=CLOSED pgs=2609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:12.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.581+0000 7f63f9d4f640 1 --2- 172.21.15.53:0/372099652 >> v2:172.21.15.117:3300/0 conn(0x7f63f415be50 0x7f63f40cc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:12.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.581+0000 7f63f9d4f640 1 -- 172.21.15.53:0/372099652 >> 172.21.15.53:0/372099652 conn(0x7f63f406aa30 msgr2=0x7f63f40cebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:12.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.581+0000 7f63f9d4f640 1 -- 172.21.15.53:0/372099652 shutdown_connections 2023-06-10T19:08:12.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.581+0000 7f63f9d4f640 1 -- 172.21.15.53:0/372099652 wait complete. 2023-06-10T19:08:12.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.581+0000 7f63f9d4f640 1 Processor -- start 2023-06-10T19:08:12.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.581+0000 7f63f9d4f640 1 -- start start 2023-06-10T19:08:12.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.581+0000 7f63f9d4f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63f40cd200 0x7f63f4155740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:12.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.581+0000 7f63f9d4f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63f415be50 0x7f63f4150250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:12.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.581+0000 7f63f9d4f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63f415c220 0x7f63f415df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:12.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.581+0000 7f63f9d4f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63f40c9f70 con 0x7f63f415be50 2023-06-10T19:08:12.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.581+0000 7f63f9d4f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63f40c9330 con 0x7f63f415c220 2023-06-10T19:08:12.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.581+0000 7f63f9d4f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63f40c95d0 con 0x7f63f40cd200 2023-06-10T19:08:12.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.585+0000 7f63f2ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63f415be50 0x7f63f4150250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:12.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.585+0000 7f63f2ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63f415be50 0x7f63f4150250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45458/0 (socket says 172.21.15.53:45458) 2023-06-10T19:08:12.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.585+0000 7f63f2ffd640 1 -- 172.21.15.53:0/3993557722 learned_addr learned my addr 172.21.15.53:0/3993557722 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:08:12.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.585+0000 7f63f37fe640 1 --2- 172.21.15.53:0/3993557722 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63f40cd200 0x7f63f4155740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:12.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.585+0000 7f63f3fff640 1 --2- 172.21.15.53:0/3993557722 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63f415c220 0x7f63f415df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:12.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.585+0000 7f63f2ffd640 1 -- 172.21.15.53:0/3993557722 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63f40cd200 msgr2=0x7f63f4155740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:12.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.585+0000 7f63f2ffd640 1 --2- 172.21.15.53:0/3993557722 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63f40cd200 0x7f63f4155740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:12.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.585+0000 7f63f2ffd640 1 -- 172.21.15.53:0/3993557722 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63f415c220 msgr2=0x7f63f415df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:12.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.585+0000 7f63f2ffd640 1 --2- 172.21.15.53:0/3993557722 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63f415c220 0x7f63f415df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:12.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.585+0000 7f63f2ffd640 1 -- 172.21.15.53:0/3993557722 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e80094d0 con 0x7f63f415be50 2023-06-10T19:08:12.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.585+0000 7f63f2ffd640 1 --2- 172.21.15.53:0/3993557722 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63f415be50 0x7f63f4150250 secure :-1 s=READY pgs=2610 cs=0 l=1 rev1=1 crypto rx=0x7f63e8019050 tx=0x7f63e801ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:12.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.585+0000 7f63dbfff640 1 -- 172.21.15.53:0/3993557722 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e80b4800 con 0x7f63f415be50 2023-06-10T19:08:12.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.585+0000 7f63dbfff640 1 -- 172.21.15.53:0/3993557722 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63e80b4960 con 0x7f63f415be50 2023-06-10T19:08:12.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.585+0000 7f63dbfff640 1 -- 172.21.15.53:0/3993557722 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e80b4cf0 con 0x7f63f415be50 2023-06-10T19:08:12.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.585+0000 7f63f9d4f640 1 -- 172.21.15.53:0/3993557722 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63f40c98b0 con 0x7f63f415be50 2023-06-10T19:08:12.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.585+0000 7f63f9d4f640 1 -- 172.21.15.53:0/3993557722 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63f415f2b0 con 0x7f63f415be50 2023-06-10T19:08:12.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.585+0000 7f63f9d4f640 1 -- 172.21.15.53:0/3993557722 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63f404d790 con 0x7f63f415be50 2023-06-10T19:08:12.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.585+0000 7f63dbfff640 1 -- 172.21.15.53:0/3993557722 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f63e80a9070 con 0x7f63f415be50 2023-06-10T19:08:12.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.585+0000 7f63dbfff640 1 --2- 172.21.15.53:0/3993557722 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f63e0066280 0x7f63e0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:12.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.585+0000 7f63dbfff640 1 -- 172.21.15.53:0/3993557722 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f63e811e740 con 0x7f63f415be50 2023-06-10T19:08:12.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.585+0000 7f63f37fe640 1 --2- 172.21.15.53:0/3993557722 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f63e0066280 0x7f63e0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:12.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.589+0000 7f63f37fe640 1 --2- 172.21.15.53:0/3993557722 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f63e0066280 0x7f63e0068730 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f63e4007a60 tx=0x7f63e4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:12.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.589+0000 7f63dbfff640 1 -- 172.21.15.53:0/3993557722 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f63e80ebd80 con 0x7f63f415be50 2023-06-10T19:08:12.802 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.801+0000 7f63f9d4f640 1 -- 172.21.15.53:0/3993557722 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f63f4166c50 con 0x7f63f415be50 2023-06-10T19:08:12.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.809+0000 7f63dbfff640 1 -- 172.21.15.53:0/3993557722 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v23) v1 ==== 190+0+0 (secure 0 0 0) 0x7f63e80ef3a0 con 0x7f63f415be50 2023-06-10T19:08:12.812 INFO:teuthology.orchestra.run.smithi053.stderr:updated caps for client.0 2023-06-10T19:08:12.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.809+0000 7f63f9d4f640 1 -- 172.21.15.53:0/3993557722 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f63e0066280 msgr2=0x7f63e0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:12.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.809+0000 7f63f9d4f640 1 --2- 172.21.15.53:0/3993557722 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f63e0066280 0x7f63e0068730 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f63e4007a60 tx=0x7f63e4008040 comp rx=0 tx=0).stop 2023-06-10T19:08:12.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.809+0000 7f63f9d4f640 1 -- 172.21.15.53:0/3993557722 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63f415be50 msgr2=0x7f63f4150250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:12.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.809+0000 7f63f9d4f640 1 --2- 172.21.15.53:0/3993557722 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63f415be50 0x7f63f4150250 secure :-1 s=READY pgs=2610 cs=0 l=1 rev1=1 crypto rx=0x7f63e8019050 tx=0x7f63e801ac80 comp rx=0 tx=0).stop 2023-06-10T19:08:12.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.809+0000 7f63f9d4f640 1 -- 172.21.15.53:0/3993557722 shutdown_connections 2023-06-10T19:08:12.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.809+0000 7f63f9d4f640 1 --2- 172.21.15.53:0/3993557722 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f63e0066280 0x7f63e0068730 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:12.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.809+0000 7f63f9d4f640 1 --2- 172.21.15.53:0/3993557722 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63f415c220 0x7f63f415df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:12.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.809+0000 7f63f9d4f640 1 --2- 172.21.15.53:0/3993557722 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63f415be50 0x7f63f4150250 secure :-1 s=CLOSED pgs=2610 cs=0 l=1 rev1=1 crypto rx=0x7f63e8019050 tx=0x7f63e801ac80 comp rx=0 tx=0).stop 2023-06-10T19:08:12.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.809+0000 7f63f9d4f640 1 --2- 172.21.15.53:0/3993557722 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63f40cd200 0x7f63f4155740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:12.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.809+0000 7f63f9d4f640 1 -- 172.21.15.53:0/3993557722 >> 172.21.15.53:0/3993557722 conn(0x7f63f406aa30 msgr2=0x7f63f40c6040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:12.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.813+0000 7f63f9d4f640 1 -- 172.21.15.53:0/3993557722 shutdown_connections 2023-06-10T19:08:12.816 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.813+0000 7f63f9d4f640 1 -- 172.21.15.53:0/3993557722 wait complete. 2023-06-10T19:08:12.832 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:08:12.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.953+0000 7f3cea5dd640 1 Processor -- start 2023-06-10T19:08:12.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.953+0000 7f3cea5dd640 1 -- start start 2023-06-10T19:08:12.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.957+0000 7f3cea5dd640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3ce40b3ac0 0x7f3ce40b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:12.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.957+0000 7f3cea5dd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3ce40d14c0 0x7f3ce415fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:12.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.957+0000 7f3cea5dd640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ce40d0020 con 0x7f3ce40cc690 2023-06-10T19:08:12.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.957+0000 7f3cea5dd640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ce40b43d0 con 0x7f3ce40d14c0 2023-06-10T19:08:12.960 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.957+0000 7f3cea5dd640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ce40cef40 con 0x7f3ce40b3ac0 2023-06-10T19:08:12.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.957+0000 7f3ce8b7a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3ce40d14c0 0x7f3ce415fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:12.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.957+0000 7f3ce8b7a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3ce40d14c0 0x7f3ce415fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45468/0 (socket says 172.21.15.53:45468) 2023-06-10T19:08:12.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.957+0000 7f3ce8b7a640 1 -- 172.21.15.53:0/568505378 learned_addr learned my addr 172.21.15.53:0/568505378 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:08:12.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.957+0000 7f3ce3fff640 1 --2- 172.21.15.53:0/568505378 >> v2:172.21.15.117:3300/0 conn(0x7f3ce40b3ac0 0x7f3ce40b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:12.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.957+0000 7f3ce8b7a640 1 -- 172.21.15.53:0/568505378 >> v2:172.21.15.117:3300/0 conn(0x7f3ce40b3ac0 msgr2=0x7f3ce40b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:12.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.957+0000 7f3ce8b7a640 1 --2- 172.21.15.53:0/568505378 >> v2:172.21.15.117:3300/0 conn(0x7f3ce40b3ac0 0x7f3ce40b3e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:12.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.957+0000 7f3ce8b7a640 1 -- 172.21.15.53:0/568505378 >> v1:172.21.15.117:6789/0 conn(0x7f3ce40cc690 legacy=0x7f3ce415f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:12.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.957+0000 7f3ce8b7a640 1 -- 172.21.15.53:0/568505378 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ce40cf220 con 0x7f3ce40d14c0 2023-06-10T19:08:12.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.957+0000 7f3ce8b7a640 1 --2- 172.21.15.53:0/568505378 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ce40d14c0 0x7f3ce415fa80 secure :-1 s=READY pgs=2611 cs=0 l=1 rev1=1 crypto rx=0x7f3ce40b4ba0 tx=0x7f3cdc01c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37c3be79c90e39c4 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:12.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.957+0000 7f3ce2ffd640 1 -- 172.21.15.53:0/568505378 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cdc0a5840 con 0x7f3ce40d14c0 2023-06-10T19:08:12.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.957+0000 7f3ce2ffd640 1 -- 172.21.15.53:0/568505378 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cdc0a59a0 con 0x7f3ce40d14c0 2023-06-10T19:08:12.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.957+0000 7f3ce2ffd640 1 -- 172.21.15.53:0/568505378 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cdc0a5d30 con 0x7f3ce40d14c0 2023-06-10T19:08:12.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.961+0000 7f3cea5dd640 1 -- 172.21.15.53:0/568505378 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ce40d14c0 msgr2=0x7f3ce415fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:12.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.961+0000 7f3cea5dd640 1 --2- 172.21.15.53:0/568505378 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ce40d14c0 0x7f3ce415fa80 secure :-1 s=READY pgs=2611 cs=0 l=1 rev1=1 crypto rx=0x7f3ce40b4ba0 tx=0x7f3cdc01c960 comp rx=0 tx=0).stop 2023-06-10T19:08:12.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.961+0000 7f3cea5dd640 1 -- 172.21.15.53:0/568505378 shutdown_connections 2023-06-10T19:08:12.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.961+0000 7f3cea5dd640 1 --2- 172.21.15.53:0/568505378 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ce40d14c0 0x7f3ce415fa80 unknown :-1 s=CLOSED pgs=2611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:12.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.961+0000 7f3cea5dd640 1 --2- 172.21.15.53:0/568505378 >> v2:172.21.15.117:3300/0 conn(0x7f3ce40b3ac0 0x7f3ce40b3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:12.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.961+0000 7f3cea5dd640 1 -- 172.21.15.53:0/568505378 >> 172.21.15.53:0/568505378 conn(0x7f3ce4071790 msgr2=0x7f3ce4069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:12.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.961+0000 7f3cea5dd640 1 -- 172.21.15.53:0/568505378 shutdown_connections 2023-06-10T19:08:12.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.961+0000 7f3cea5dd640 1 -- 172.21.15.53:0/568505378 wait complete. 2023-06-10T19:08:12.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.961+0000 7f3cea5dd640 1 Processor -- start 2023-06-10T19:08:12.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.961+0000 7f3cea5dd640 1 -- start start 2023-06-10T19:08:12.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.961+0000 7f3cea5dd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ce40b3ac0 0x7f3ce4153df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:12.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.961+0000 7f3cea5dd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ce40cc690 0x7f3ce415a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:12.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.961+0000 7f3cea5dd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ce40d14c0 0x7f3ce415fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:12.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.961+0000 7f3cea5dd640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce415f630 con 0x7f3ce40b3ac0 2023-06-10T19:08:12.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.961+0000 7f3cea5dd640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce415b180 con 0x7f3ce40d14c0 2023-06-10T19:08:12.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.961+0000 7f3cea5dd640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce415ff90 con 0x7f3ce40cc690 2023-06-10T19:08:12.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.961+0000 7f3ce3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ce40b3ac0 0x7f3ce4153df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:12.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.961+0000 7f3ce3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ce40b3ac0 0x7f3ce4153df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45484/0 (socket says 172.21.15.53:45484) 2023-06-10T19:08:12.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.961+0000 7f3ce3fff640 1 -- 172.21.15.53:0/3821806258 learned_addr learned my addr 172.21.15.53:0/3821806258 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:08:12.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.961+0000 7f3ce37fe640 1 --2- 172.21.15.53:0/3821806258 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ce40cc690 0x7f3ce415a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:12.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.961+0000 7f3ce8b7a640 1 --2- 172.21.15.53:0/3821806258 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ce40d14c0 0x7f3ce415fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:12.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.961+0000 7f3ce3fff640 1 -- 172.21.15.53:0/3821806258 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ce40cc690 msgr2=0x7f3ce415a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:12.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.961+0000 7f3ce3fff640 1 --2- 172.21.15.53:0/3821806258 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ce40cc690 0x7f3ce415a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:12.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.961+0000 7f3ce3fff640 1 -- 172.21.15.53:0/3821806258 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ce40d14c0 msgr2=0x7f3ce415fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:12.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.961+0000 7f3ce3fff640 1 --2- 172.21.15.53:0/3821806258 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ce40d14c0 0x7f3ce415fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:12.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.961+0000 7f3ce3fff640 1 -- 172.21.15.53:0/3821806258 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cdc009b30 con 0x7f3ce40b3ac0 2023-06-10T19:08:12.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.961+0000 7f3ce3fff640 1 --2- 172.21.15.53:0/3821806258 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ce40b3ac0 0x7f3ce4153df0 secure :-1 s=READY pgs=2612 cs=0 l=1 rev1=1 crypto rx=0x7f3cd400c820 tx=0x7f3cd400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:12.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.961+0000 7f3ce0ff9640 1 -- 172.21.15.53:0/3821806258 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd4007a30 con 0x7f3ce40b3ac0 2023-06-10T19:08:12.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.961+0000 7f3ce0ff9640 1 -- 172.21.15.53:0/3821806258 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cd4007b90 con 0x7f3ce40b3ac0 2023-06-10T19:08:12.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.961+0000 7f3cea5dd640 1 -- 172.21.15.53:0/3821806258 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ce415abc0 con 0x7f3ce40b3ac0 2023-06-10T19:08:12.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.961+0000 7f3ce0ff9640 1 -- 172.21.15.53:0/3821806258 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd400ce10 con 0x7f3ce40b3ac0 2023-06-10T19:08:12.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.961+0000 7f3cea5dd640 1 -- 172.21.15.53:0/3821806258 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ce415f250 con 0x7f3ce40b3ac0 2023-06-10T19:08:12.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.965+0000 7f3cea5dd640 1 -- 172.21.15.53:0/3821806258 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ce415f0b0 con 0x7f3ce40b3ac0 2023-06-10T19:08:12.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.965+0000 7f3ce0ff9640 1 -- 172.21.15.53:0/3821806258 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3cd4024480 con 0x7f3ce40b3ac0 2023-06-10T19:08:12.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.965+0000 7f3ce0ff9640 1 --2- 172.21.15.53:0/3821806258 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3cd00662b0 0x7f3cd0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:12.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.965+0000 7f3ce0ff9640 1 -- 172.21.15.53:0/3821806258 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3cd4084000 con 0x7f3ce40b3ac0 2023-06-10T19:08:12.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.965+0000 7f3ce37fe640 1 --2- 172.21.15.53:0/3821806258 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3cd00662b0 0x7f3cd0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:12.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.965+0000 7f3ce37fe640 1 --2- 172.21.15.53:0/3821806258 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3cd00662b0 0x7f3cd0068760 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f3ce4152a10 tx=0x7f3cd8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:12.971 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:12.969+0000 7f3ce0ff9640 1 -- 172.21.15.53:0/3821806258 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3cd40514f0 con 0x7f3ce40b3ac0 2023-06-10T19:08:13.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.157+0000 7f3cea5dd640 1 -- 172.21.15.53:0/3821806258 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3ce415f0b0 con 0x7f3ce40b3ac0 2023-06-10T19:08:13.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.157+0000 7f3ce0ff9640 1 -- 172.21.15.53:0/3821806258 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) v1 ==== 95+0+4688 (secure 0 0 0) 0x7f3ce415f0b0 con 0x7f3ce40b3ac0 2023-06-10T19:08:13.161 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:08:13.161 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":104,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7835,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2641321206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2641321206},{"type":"v1","addr":"172.21.15.117:6835","nonce":2641321206}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":99},{"gid":8956,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1439696554","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1439696554},{"type":"v1","addr":"172.21.15.117:6837","nonce":1439696554}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":99},{"gid":11112,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/3327528087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3327528087},{"type":"v1","addr":"172.21.15.53:6833","nonce":3327528087}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":99}],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:08:03.514484+0000","modified":"2023-06-10T19:08:06.533495+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":11118},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11118":{"gid":11118,"name":"c","rank":0,"incarnation":100,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/3732323283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":3732323283},{"type":"v1","addr":"172.21.15.53:6835","nonce":3732323283}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":12}]} 2023-06-10T19:08:13.162 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 104 2023-06-10T19:08:13.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.161+0000 7f3cea5dd640 1 -- 172.21.15.53:0/3821806258 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3cd00662b0 msgr2=0x7f3cd0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:13.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.161+0000 7f3cea5dd640 1 --2- 172.21.15.53:0/3821806258 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3cd00662b0 0x7f3cd0068760 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f3ce4152a10 tx=0x7f3cd8009040 comp rx=0 tx=0).stop 2023-06-10T19:08:13.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.161+0000 7f3cea5dd640 1 -- 172.21.15.53:0/3821806258 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ce40b3ac0 msgr2=0x7f3ce4153df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:13.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.161+0000 7f3cea5dd640 1 --2- 172.21.15.53:0/3821806258 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ce40b3ac0 0x7f3ce4153df0 secure :-1 s=READY pgs=2612 cs=0 l=1 rev1=1 crypto rx=0x7f3cd400c820 tx=0x7f3cd400cce0 comp rx=0 tx=0).stop 2023-06-10T19:08:13.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.161+0000 7f3cea5dd640 1 -- 172.21.15.53:0/3821806258 shutdown_connections 2023-06-10T19:08:13.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.161+0000 7f3cea5dd640 1 --2- 172.21.15.53:0/3821806258 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3cd00662b0 0x7f3cd0068760 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:13.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.161+0000 7f3cea5dd640 1 --2- 172.21.15.53:0/3821806258 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ce40d14c0 0x7f3ce415fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:13.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.161+0000 7f3cea5dd640 1 --2- 172.21.15.53:0/3821806258 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3ce40cc690 0x7f3ce415a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:13.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.161+0000 7f3cea5dd640 1 --2- 172.21.15.53:0/3821806258 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ce40b3ac0 0x7f3ce4153df0 unknown :-1 s=CLOSED pgs=2612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:13.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.161+0000 7f3cea5dd640 1 -- 172.21.15.53:0/3821806258 >> 172.21.15.53:0/3821806258 conn(0x7f3ce4071790 msgr2=0x7f3ce40b3260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:13.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.161+0000 7f3cea5dd640 1 -- 172.21.15.53:0/3821806258 shutdown_connections 2023-06-10T19:08:13.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.161+0000 7f3cea5dd640 1 -- 172.21.15.53:0/3821806258 wait complete. 2023-06-10T19:08:13.583 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 104, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-06-10T19:08:03.514484+0000', 'modified': '2023-06-10T19:08:06.533495+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 11118}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_11118': {'gid': 11118, 'name': 'c', 'rank': 0, 'incarnation': 100, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.53:6835/3732323283', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.53:6834', 'nonce': 3732323283}, {'type': 'v1', 'addr': '172.21.15.53:6835', 'nonce': 3732323283}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-06-10T19:08:13.584 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-06-10T19:08:13.584 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-06-10T19:08:13.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.717+0000 7f436377d640 1 Processor -- start 2023-06-10T19:08:13.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.717+0000 7f436377d640 1 -- start start 2023-06-10T19:08:13.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.717+0000 7f436377d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f435c15c7f0 0x7f435c15f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:13.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.717+0000 7f436377d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f435c15f860 0x7f435c0ceb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:13.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.717+0000 7f436377d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f435c15cc40 con 0x7f435c06b780 2023-06-10T19:08:13.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.717+0000 7f436377d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f435c15c3d0 con 0x7f435c15f860 2023-06-10T19:08:13.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.717+0000 7f436377d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f435c0af530 con 0x7f435c15c7f0 2023-06-10T19:08:13.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.717+0000 7f4361d1a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f435c15f860 0x7f435c0ceb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:13.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.721+0000 7f4361d1a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f435c15f860 0x7f435c0ceb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45496/0 (socket says 172.21.15.53:45496) 2023-06-10T19:08:13.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.721+0000 7f4361d1a640 1 -- 172.21.15.53:0/192764995 learned_addr learned my addr 172.21.15.53:0/192764995 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:08:13.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.721+0000 7f4360d18640 1 --2- 172.21.15.53:0/192764995 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f435c15c7f0 0x7f435c15f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:13.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.721+0000 7f4361d1a640 1 -- 172.21.15.53:0/192764995 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f435c15c7f0 msgr2=0x7f435c15f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:13.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.721+0000 7f4361d1a640 1 --2- 172.21.15.53:0/192764995 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f435c15c7f0 0x7f435c15f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:13.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.721+0000 7f4361d1a640 1 -- 172.21.15.53:0/192764995 >> v1:172.21.15.117:6789/0 conn(0x7f435c06b780 legacy=0x7f435c06bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:13.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.721+0000 7f4361d1a640 1 -- 172.21.15.53:0/192764995 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f435c15fd70 con 0x7f435c15f860 2023-06-10T19:08:13.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.725+0000 7f4361d1a640 1 --2- 172.21.15.53:0/192764995 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f435c15f860 0x7f435c0ceb20 secure :-1 s=READY pgs=2613 cs=0 l=1 rev1=1 crypto rx=0x7f4354009e50 tx=0x7f435401c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb92316e67919937 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:13.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.725+0000 7f4353fff640 1 -- 172.21.15.53:0/192764995 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43540a5840 con 0x7f435c15f860 2023-06-10T19:08:13.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.725+0000 7f4353fff640 1 -- 172.21.15.53:0/192764995 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43540a59a0 con 0x7f435c15f860 2023-06-10T19:08:13.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.725+0000 7f4353fff640 1 -- 172.21.15.53:0/192764995 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43540a5d30 con 0x7f435c15f860 2023-06-10T19:08:13.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.725+0000 7f436377d640 1 -- 172.21.15.53:0/192764995 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f435c15f860 msgr2=0x7f435c0ceb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:13.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.725+0000 7f436377d640 1 --2- 172.21.15.53:0/192764995 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f435c15f860 0x7f435c0ceb20 secure :-1 s=READY pgs=2613 cs=0 l=1 rev1=1 crypto rx=0x7f4354009e50 tx=0x7f435401c980 comp rx=0 tx=0).stop 2023-06-10T19:08:13.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.725+0000 7f436377d640 1 -- 172.21.15.53:0/192764995 shutdown_connections 2023-06-10T19:08:13.729 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.725+0000 7f436377d640 1 --2- 172.21.15.53:0/192764995 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f435c15f860 0x7f435c0ceb20 unknown :-1 s=CLOSED pgs=2613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:13.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.725+0000 7f436377d640 1 --2- 172.21.15.53:0/192764995 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f435c15c7f0 0x7f435c15f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:13.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.725+0000 7f436377d640 1 -- 172.21.15.53:0/192764995 >> 172.21.15.53:0/192764995 conn(0x7f435c06a0b0 msgr2=0x7f435c06d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:13.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.725+0000 7f436377d640 1 -- 172.21.15.53:0/192764995 shutdown_connections 2023-06-10T19:08:13.730 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.725+0000 7f436377d640 1 -- 172.21.15.53:0/192764995 wait complete. 2023-06-10T19:08:13.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.725+0000 7f436377d640 1 Processor -- start 2023-06-10T19:08:13.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.725+0000 7f436377d640 1 -- start start 2023-06-10T19:08:13.732 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.729+0000 7f436377d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f435c06b780 0x7f435c0c9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:13.732 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.729+0000 7f436377d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f435c15c7f0 0x7f435c0c5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:13.732 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.729+0000 7f436377d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f435c15f860 0x7f435c0c4070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:13.732 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.729+0000 7f436377d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f435c159430 con 0x7f435c06b780 2023-06-10T19:08:13.732 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.729+0000 7f436377d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f435c0cbf80 con 0x7f435c15f860 2023-06-10T19:08:13.732 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.729+0000 7f436377d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f435c0cc260 con 0x7f435c15c7f0 2023-06-10T19:08:13.732 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.729+0000 7f4361519640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f435c06b780 0x7f435c0c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:13.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.729+0000 7f4361519640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f435c06b780 0x7f435c0c9750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45504/0 (socket says 172.21.15.53:45504) 2023-06-10T19:08:13.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.729+0000 7f4361519640 1 -- 172.21.15.53:0/761177881 learned_addr learned my addr 172.21.15.53:0/761177881 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:08:13.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.729+0000 7f4360d18640 1 --2- 172.21.15.53:0/761177881 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f435c15c7f0 0x7f435c0c5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:13.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.729+0000 7f4361d1a640 1 --2- 172.21.15.53:0/761177881 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f435c15f860 0x7f435c0c4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:13.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.729+0000 7f4361519640 1 -- 172.21.15.53:0/761177881 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f435c15c7f0 msgr2=0x7f435c0c5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:13.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.729+0000 7f4361519640 1 --2- 172.21.15.53:0/761177881 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f435c15c7f0 0x7f435c0c5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:13.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.729+0000 7f4361519640 1 -- 172.21.15.53:0/761177881 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f435c15f860 msgr2=0x7f435c0c4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:13.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.729+0000 7f4361519640 1 --2- 172.21.15.53:0/761177881 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f435c15f860 0x7f435c0c4070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:13.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.729+0000 7f4361519640 1 -- 172.21.15.53:0/761177881 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4354009b30 con 0x7f435c06b780 2023-06-10T19:08:13.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.729+0000 7f4361d1a640 1 --2- 172.21.15.53:0/761177881 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f435c15f860 0x7f435c0c4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:08:13.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.729+0000 7f4360d18640 1 --2- 172.21.15.53:0/761177881 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f435c15c7f0 0x7f435c0c5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:08:13.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.729+0000 7f4361519640 1 --2- 172.21.15.53:0/761177881 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f435c06b780 0x7f435c0c9750 secure :-1 s=READY pgs=2614 cs=0 l=1 rev1=1 crypto rx=0x7f435800c370 tx=0x7f435800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:13.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.729+0000 7f4351ffb640 1 -- 172.21.15.53:0/761177881 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43580052d0 con 0x7f435c06b780 2023-06-10T19:08:13.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.729+0000 7f4351ffb640 1 -- 172.21.15.53:0/761177881 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4358005430 con 0x7f435c06b780 2023-06-10T19:08:13.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.729+0000 7f436377d640 1 -- 172.21.15.53:0/761177881 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f435c0cc540 con 0x7f435c06b780 2023-06-10T19:08:13.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.729+0000 7f4351ffb640 1 -- 172.21.15.53:0/761177881 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4358007260 con 0x7f435c06b780 2023-06-10T19:08:13.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.729+0000 7f436377d640 1 -- 172.21.15.53:0/761177881 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f435c0c9c90 con 0x7f435c06b780 2023-06-10T19:08:13.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.729+0000 7f4351ffb640 1 -- 172.21.15.53:0/761177881 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f43580073c0 con 0x7f435c06b780 2023-06-10T19:08:13.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.729+0000 7f4351ffb640 1 --2- 172.21.15.53:0/761177881 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f43400662b0 0x7f4340068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:13.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.729+0000 7f4351ffb640 1 -- 172.21.15.53:0/761177881 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4358083100 con 0x7f435c06b780 2023-06-10T19:08:13.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.733+0000 7f4360d18640 1 --2- 172.21.15.53:0/761177881 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f43400662b0 0x7f4340068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:13.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.733+0000 7f4366899000 1 Processor -- start 2023-06-10T19:08:13.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.733+0000 7f4366899000 1 -- start start 2023-06-10T19:08:13.737 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.733+0000 7f4360d18640 1 --2- 172.21.15.53:0/761177881 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f43400662b0 0x7f4340068760 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f435c1584b0 tx=0x7f434c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:13.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.733+0000 7f4366899000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55715a779740 0x55715a779b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:13.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.733+0000 7f4366899000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55715a77a050 0x55715a72f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:13.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.733+0000 7f4366899000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55715a72fd80 0x55715a730150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:13.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.733+0000 7f4366899000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55715a5f7ac0 con 0x55715a779740 2023-06-10T19:08:13.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.733+0000 7f4366899000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x55715a531840 con 0x55715a77a050 2023-06-10T19:08:13.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.733+0000 7f4366899000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x55715a5852e0 con 0x55715a72fd80 2023-06-10T19:08:13.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.733+0000 7f4361519640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55715a779740 0x55715a779b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:13.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.733+0000 7f4361519640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55715a779740 0x55715a779b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45506/0 (socket says 172.21.15.53:45506) 2023-06-10T19:08:13.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.733+0000 7f4361519640 1 -- 172.21.15.53:0/411514661 learned_addr learned my addr 172.21.15.53:0/411514661 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:08:13.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.733+0000 7f4360d18640 1 --2- 172.21.15.53:0/411514661 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55715a77a050 0x55715a72f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:13.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.733+0000 7f4361d1a640 1 --2- 172.21.15.53:0/411514661 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55715a72fd80 0x55715a730150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:13.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.733+0000 7f4361519640 1 -- 172.21.15.53:0/411514661 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55715a72fd80 msgr2=0x55715a730150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:13.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.733+0000 7f4361519640 1 --2- 172.21.15.53:0/411514661 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55715a72fd80 0x55715a730150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:13.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.733+0000 7f4361519640 1 -- 172.21.15.53:0/411514661 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55715a77a050 msgr2=0x55715a72f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:13.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.733+0000 7f4361519640 1 --2- 172.21.15.53:0/411514661 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55715a77a050 0x55715a72f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:13.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.733+0000 7f4361519640 1 -- 172.21.15.53:0/411514661 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55715a27a890 con 0x55715a779740 2023-06-10T19:08:13.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.733+0000 7f4361519640 1 --2- 172.21.15.53:0/411514661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55715a779740 0x55715a779b10 secure :-1 s=READY pgs=2615 cs=0 l=1 rev1=1 crypto rx=0x7f43580814f0 tx=0x7f4358007670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a89d657ec871cc36 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:13.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.733+0000 7f4346ffd640 1 -- 172.21.15.53:0/411514661 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f435805c590 con 0x55715a779740 2023-06-10T19:08:13.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.733+0000 7f4346ffd640 1 -- 172.21.15.53:0/411514661 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4358052550 con 0x55715a779740 2023-06-10T19:08:13.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.733+0000 7f4346ffd640 1 -- 172.21.15.53:0/411514661 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f435804ffa0 con 0x55715a779740 2023-06-10T19:08:13.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.733+0000 7f4366899000 1 -- 172.21.15.53:0/411514661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55715a779740 msgr2=0x55715a779b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:13.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.733+0000 7f4366899000 1 --2- 172.21.15.53:0/411514661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55715a779740 0x55715a779b10 secure :-1 s=READY pgs=2615 cs=0 l=1 rev1=1 crypto rx=0x7f43580814f0 tx=0x7f4358007670 comp rx=0 tx=0).stop 2023-06-10T19:08:13.743 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.733+0000 7f4366899000 1 -- 172.21.15.53:0/411514661 shutdown_connections 2023-06-10T19:08:13.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.733+0000 7f4366899000 1 --2- 172.21.15.53:0/411514661 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55715a72fd80 0x55715a730150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:13.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.733+0000 7f4366899000 1 --2- 172.21.15.53:0/411514661 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55715a77a050 0x55715a72f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:13.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.733+0000 7f4366899000 1 --2- 172.21.15.53:0/411514661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55715a779740 0x55715a779b10 unknown :-1 s=CLOSED pgs=2615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:13.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.733+0000 7f4366899000 1 -- 172.21.15.53:0/411514661 >> 172.21.15.53:0/411514661 conn(0x55715a727800 msgr2=0x55715a736800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:13.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.733+0000 7f4366899000 1 -- 172.21.15.53:0/411514661 shutdown_connections 2023-06-10T19:08:13.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.733+0000 7f4366899000 1 -- 172.21.15.53:0/411514661 wait complete. 2023-06-10T19:08:13.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.733+0000 7f4366899000 1 -- start start 2023-06-10T19:08:13.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.733+0000 7f4366899000 1 Processor -- start 2023-06-10T19:08:13.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.737+0000 7f4366899000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55715a72fd80 0x55715a735940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:13.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.737+0000 7f4366899000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55715a779740 0x55715a73b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:13.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.737+0000 7f4366899000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55715a77a050 0x55715a73b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:13.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.737+0000 7f4366899000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55715a57e380 con 0x55715a77a050 2023-06-10T19:08:13.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.737+0000 7f4366899000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x55715a53aae0 con 0x55715a72fd80 2023-06-10T19:08:13.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.737+0000 7f4366899000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x55715a53a780 con 0x55715a779740 2023-06-10T19:08:13.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.737+0000 7f4366899000 10 client.0 _ll_register_callbacks cb 0x55715a71be30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-10T19:08:13.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.737+0000 7f4361d1a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55715a77a050 0x55715a73b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:13.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.737+0000 7f4361d1a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55715a77a050 0x55715a73b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45520/0 (socket says 172.21.15.53:45520) 2023-06-10T19:08:13.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.737+0000 7f4361d1a640 1 -- 172.21.15.53:0/1077337219 learned_addr learned my addr 172.21.15.53:0/1077337219 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:08:13.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.737+0000 7f4360d18640 1 --2- 172.21.15.53:0/1077337219 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55715a779740 0x55715a73b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:13.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.737+0000 7f4361519640 1 --2- 172.21.15.53:0/1077337219 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55715a72fd80 0x55715a735940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:13.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.737+0000 7f4361d1a640 1 -- 172.21.15.53:0/1077337219 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55715a779740 msgr2=0x55715a73b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:13.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.737+0000 7f4361d1a640 1 --2- 172.21.15.53:0/1077337219 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55715a779740 0x55715a73b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:13.747 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.737+0000 7f4361d1a640 1 -- 172.21.15.53:0/1077337219 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55715a72fd80 msgr2=0x55715a735940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:13.747 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.737+0000 7f4361d1a640 1 --2- 172.21.15.53:0/1077337219 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55715a72fd80 0x55715a735940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:13.747 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.737+0000 7f4361d1a640 1 -- 172.21.15.53:0/1077337219 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f435c0c9c90 con 0x55715a77a050 2023-06-10T19:08:13.747 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.737+0000 7f4360d18640 1 --2- 172.21.15.53:0/1077337219 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55715a779740 0x55715a73b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:08:13.747 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.737+0000 7f4361d1a640 1 --2- 172.21.15.53:0/1077337219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55715a77a050 0x55715a73b620 secure :-1 s=READY pgs=2616 cs=0 l=1 rev1=1 crypto rx=0x7f4354009040 tx=0x7f435401b1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94a002ec57c241dc server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:13.747 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.737+0000 7f433bfff640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-06-10T19:08:13.747 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.737+0000 7f433bfff640 1 -- 172.21.15.53:0/1077337219 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43540c0410 con 0x55715a77a050 2023-06-10T19:08:13.747 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.737+0000 7f433bfff640 1 -- 172.21.15.53:0/1077337219 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(180..180 src has 1..180) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f43540c1d80 con 0x55715a77a050 2023-06-10T19:08:13.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.737+0000 7f4366899000 1 -- 172.21.15.53:0/1077337219 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55715a545a20 con 0x55715a77a050 2023-06-10T19:08:13.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.737+0000 7f433bfff640 1 -- 172.21.15.53:0/1077337219 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=104) v2 ==== 24+0+0 (secure 0 0 0) 0x7f43540b63f0 con 0x55715a77a050 2023-06-10T19:08:13.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.737+0000 7f4366899000 10 client.11283 fetch_fsmap learned FSMap version 104 2023-06-10T19:08:13.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.737+0000 7f4366899000 1 -- 172.21.15.53:0/1077337219 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=104,monmap=2+}) v3 -- 0x55715a542d10 con 0x55715a77a050 2023-06-10T19:08:13.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.737+0000 7f433bfff640 1 -- 172.21.15.53:0/1077337219 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55715a545a20 con 0x55715a77a050 2023-06-10T19:08:13.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.737+0000 7f433bfff640 1 -- 172.21.15.53:0/1077337219 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 104) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f43540be030 con 0x55715a77a050 2023-06-10T19:08:13.748 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.737+0000 7f4366899000 10 client.11283 fetch_fsmap finished waiting for FSMap version 104 2023-06-10T19:08:13.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.737+0000 7f4366899000 10 client.11283 resolve_mds: resolved name 'c' to daemon mds.c 2023-06-10T19:08:13.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.737+0000 7f4366899000 20 client.11283 populate_metadata read hostname 'smithi053' 2023-06-10T19:08:13.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.737+0000 7f4366899000 1 --2- 172.21.15.53:0/1077337219 >> [v2:172.21.15.53:6834/3732323283,v1:172.21.15.53:6835/3732323283] conn(0x55715a788c80 0x55715a78b060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:13.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.737+0000 7f4366899000 4 client.11283 mds_command: new command op to 11118 tid=0[{"prefix": "get_command_descriptions"}] 2023-06-10T19:08:13.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.737+0000 7f4366899000 1 -- 172.21.15.53:0/1077337219 --> [v2:172.21.15.53:6834/3732323283,v1:172.21.15.53:6835/3732323283] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55715a5ad710 con 0x55715a788c80 2023-06-10T19:08:13.749 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.737+0000 7f4361519640 1 --2- 172.21.15.53:0/1077337219 >> [v2:172.21.15.53:6834/3732323283,v1:172.21.15.53:6835/3732323283] conn(0x55715a788c80 0x55715a78b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:13.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.737+0000 7f433bfff640 10 client.11283 ms_handle_connect on v2:172.21.15.53:6834/3732323283 2023-06-10T19:08:13.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.737+0000 7f4361519640 1 --2- 172.21.15.53:0/1077337219 >> [v2:172.21.15.53:6834/3732323283,v1:172.21.15.53:6835/3732323283] conn(0x55715a788c80 0x55715a78b060 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d54d71a9499002c8 server_cookie=85c5ad8dd2f5e829 in_seq=0 out_seq=0 2023-06-10T19:08:13.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.737+0000 7f433bfff640 1 -- 172.21.15.53:0/1077337219 <== mds.0 v2:172.21.15.53:6834/3732323283 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55715a5ad710 con 0x55715a788c80 2023-06-10T19:08:13.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.737+0000 7f433bfff640 10 client.11283 handle_command_reply: tid=0 2023-06-10T19:08:13.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.737+0000 7f4366899000 1 client.11283 shutdown 2023-06-10T19:08:13.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.737+0000 7f4366899000 1 -- 172.21.15.53:0/1077337219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55715a77a050 msgr2=0x55715a73b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:13.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.737+0000 7f4366899000 1 --2- 172.21.15.53:0/1077337219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55715a77a050 0x55715a73b620 secure :-1 s=READY pgs=2616 cs=0 l=1 rev1=1 crypto rx=0x7f4354009040 tx=0x7f435401b1c0 comp rx=0 tx=0).stop 2023-06-10T19:08:13.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.737+0000 7f4366899000 1 -- 172.21.15.53:0/1077337219 shutdown_connections 2023-06-10T19:08:13.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.737+0000 7f4366899000 1 --2- 172.21.15.53:0/1077337219 >> [v2:172.21.15.53:6834/3732323283,v1:172.21.15.53:6835/3732323283] conn(0x55715a788c80 0x55715a78b060 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:13.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.737+0000 7f4366899000 1 --2- 172.21.15.53:0/1077337219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55715a77a050 0x55715a73b620 unknown :-1 s=CLOSED pgs=2616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:13.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.737+0000 7f4366899000 1 --2- 172.21.15.53:0/1077337219 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55715a779740 0x55715a73b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:13.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.737+0000 7f433bfff640 0 client.11283 ms_handle_reset on v2:172.21.15.53:6834/3732323283 2023-06-10T19:08:13.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.737+0000 7f4366899000 1 --2- 172.21.15.53:0/1077337219 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55715a72fd80 0x55715a735940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:13.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.737+0000 7f4366899000 1 -- 172.21.15.53:0/1077337219 >> 172.21.15.53:0/1077337219 conn(0x55715a727800 msgr2=0x55715a72e830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:13.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.737+0000 7f4366899000 1 -- 172.21.15.53:0/1077337219 shutdown_connections 2023-06-10T19:08:13.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.737+0000 7f4366899000 1 -- 172.21.15.53:0/1077337219 wait complete. 2023-06-10T19:08:13.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.737+0000 7f4366899000 20 client.11283 trim_cache size 0 max 16384 2023-06-10T19:08:13.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.753+0000 7f4366899000 1 Processor -- start 2023-06-10T19:08:13.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.753+0000 7f4366899000 1 -- start start 2023-06-10T19:08:13.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.757+0000 7f4366899000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55715a72fd80 0x55715a78cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:13.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.757+0000 7f4366899000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55715a779740 0x55715a789050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:13.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.757+0000 7f4366899000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55715a77a050 0x55715a789590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:13.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.757+0000 7f4366899000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55715a23b940 con 0x55715a779740 2023-06-10T19:08:13.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.757+0000 7f4366899000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x55715a526450 con 0x55715a72fd80 2023-06-10T19:08:13.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.757+0000 7f4366899000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x55715a57bb90 con 0x55715a77a050 2023-06-10T19:08:13.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.757+0000 7f4360d18640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55715a779740 0x55715a789050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:13.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.757+0000 7f4360d18640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55715a779740 0x55715a789050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45526/0 (socket says 172.21.15.53:45526) 2023-06-10T19:08:13.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.757+0000 7f4360d18640 1 -- 172.21.15.53:0/736183521 learned_addr learned my addr 172.21.15.53:0/736183521 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:08:13.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.757+0000 7f4361d1a640 1 --2- 172.21.15.53:0/736183521 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55715a77a050 0x55715a789590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:13.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.757+0000 7f4361519640 1 --2- 172.21.15.53:0/736183521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55715a72fd80 0x55715a78cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:13.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.757+0000 7f4360d18640 1 -- 172.21.15.53:0/736183521 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55715a77a050 msgr2=0x55715a789590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:13.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.757+0000 7f4360d18640 1 --2- 172.21.15.53:0/736183521 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55715a77a050 0x55715a789590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:13.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.757+0000 7f4360d18640 1 -- 172.21.15.53:0/736183521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55715a72fd80 msgr2=0x55715a78cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:13.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.757+0000 7f4360d18640 1 --2- 172.21.15.53:0/736183521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55715a72fd80 0x55715a78cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:13.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.757+0000 7f4360d18640 1 -- 172.21.15.53:0/736183521 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55715a732450 con 0x55715a779740 2023-06-10T19:08:13.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.757+0000 7f4361519640 1 --2- 172.21.15.53:0/736183521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55715a72fd80 0x55715a78cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:08:13.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.757+0000 7f4360d18640 1 --2- 172.21.15.53:0/736183521 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55715a779740 0x55715a789050 secure :-1 s=READY pgs=2617 cs=0 l=1 rev1=1 crypto rx=0x7f434c00fb60 tx=0x7f434c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f77f898e4e457eb3 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:13.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.757+0000 7f43477fe640 1 -- 172.21.15.53:0/736183521 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f434c014d60 con 0x55715a779740 2023-06-10T19:08:13.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.757+0000 7f43477fe640 1 -- 172.21.15.53:0/736183521 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f434c015410 con 0x55715a779740 2023-06-10T19:08:13.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.757+0000 7f43477fe640 1 -- 172.21.15.53:0/736183521 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f434c0157c0 con 0x55715a779740 2023-06-10T19:08:13.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.757+0000 7f4366899000 1 -- 172.21.15.53:0/736183521 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55715a779740 msgr2=0x55715a789050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:13.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.757+0000 7f4366899000 1 --2- 172.21.15.53:0/736183521 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55715a779740 0x55715a789050 secure :-1 s=READY pgs=2617 cs=0 l=1 rev1=1 crypto rx=0x7f434c00fb60 tx=0x7f434c015000 comp rx=0 tx=0).stop 2023-06-10T19:08:13.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.757+0000 7f4366899000 1 -- 172.21.15.53:0/736183521 shutdown_connections 2023-06-10T19:08:13.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.757+0000 7f4366899000 1 --2- 172.21.15.53:0/736183521 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55715a77a050 0x55715a789590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:13.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.757+0000 7f4366899000 1 --2- 172.21.15.53:0/736183521 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55715a779740 0x55715a789050 unknown :-1 s=CLOSED pgs=2617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:13.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.757+0000 7f4366899000 1 --2- 172.21.15.53:0/736183521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55715a72fd80 0x55715a78cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:13.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.757+0000 7f4366899000 1 -- 172.21.15.53:0/736183521 >> 172.21.15.53:0/736183521 conn(0x55715a727800 msgr2=0x55715a72eeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:13.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.757+0000 7f4366899000 1 -- 172.21.15.53:0/736183521 shutdown_connections 2023-06-10T19:08:13.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.757+0000 7f4366899000 1 -- 172.21.15.53:0/736183521 wait complete. 2023-06-10T19:08:13.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.757+0000 7f4366899000 1 -- start start 2023-06-10T19:08:13.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.757+0000 7f4366899000 1 Processor -- start 2023-06-10T19:08:13.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.757+0000 7f4366899000 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55715a72fd80 0x55715a78c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:13.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.757+0000 7f4366899000 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55715a779740 0x55715a7944c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:13.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.757+0000 7f4366899000 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55715a77a050 0x55715a794a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:13.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.757+0000 7f4366899000 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55715a734340 con 0x55715a779740 2023-06-10T19:08:13.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.757+0000 7f4366899000 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x55715a736a30 con 0x55715a77a050 2023-06-10T19:08:13.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.757+0000 7f4366899000 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x55715a53d800 con 0x55715a72fd80 2023-06-10T19:08:13.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.757+0000 7f4366899000 10 client.0 _ll_register_callbacks cb 0x55715a5427f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-10T19:08:13.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.757+0000 7f4360d18640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55715a779740 0x55715a7944c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:13.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.757+0000 7f4360d18640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55715a779740 0x55715a7944c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45532/0 (socket says 172.21.15.53:45532) 2023-06-10T19:08:13.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.757+0000 7f4360d18640 1 -- 172.21.15.53:0/2246798490 learned_addr learned my addr 172.21.15.53:0/2246798490 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:08:13.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.757+0000 7f4361519640 1 --2- 172.21.15.53:0/2246798490 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55715a72fd80 0x55715a78c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:13.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.757+0000 7f4361d1a640 1 --2- 172.21.15.53:0/2246798490 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55715a77a050 0x55715a794a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:13.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.757+0000 7f4360d18640 1 -- 172.21.15.53:0/2246798490 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55715a72fd80 msgr2=0x55715a78c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:13.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.757+0000 7f4360d18640 1 --2- 172.21.15.53:0/2246798490 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55715a72fd80 0x55715a78c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:13.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.757+0000 7f4360d18640 1 -- 172.21.15.53:0/2246798490 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55715a77a050 msgr2=0x55715a794a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:13.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.757+0000 7f4360d18640 1 --2- 172.21.15.53:0/2246798490 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55715a77a050 0x55715a794a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:13.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.757+0000 7f4360d18640 1 -- 172.21.15.53:0/2246798490 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f434c00e040 con 0x55715a779740 2023-06-10T19:08:13.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.761+0000 7f4360d18640 1 --2- 172.21.15.53:0/2246798490 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55715a779740 0x55715a7944c0 secure :-1 s=READY pgs=2618 cs=0 l=1 rev1=1 crypto rx=0x55715a786480 tx=0x7f434c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1674aaba31172219 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:13.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.761+0000 7f433bfff640 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-06-10T19:08:13.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.761+0000 7f433bfff640 1 -- 172.21.15.53:0/2246798490 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f434c02f070 con 0x55715a779740 2023-06-10T19:08:13.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.761+0000 7f433bfff640 1 -- 172.21.15.53:0/2246798490 <== mon.0 v2:172.21.15.53:3300/0 2 ==== osd_map(180..180 src has 1..180) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f434c015b40 con 0x55715a779740 2023-06-10T19:08:13.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.761+0000 7f4366899000 1 -- 172.21.15.53:0/2246798490 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55715a7336e0 con 0x55715a779740 2023-06-10T19:08:13.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.761+0000 7f433bfff640 1 -- 172.21.15.53:0/2246798490 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=104) v2 ==== 24+0+0 (secure 0 0 0) 0x7f434c015d00 con 0x55715a779740 2023-06-10T19:08:13.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.761+0000 7f4366899000 10 client.11289 fetch_fsmap learned FSMap version 104 2023-06-10T19:08:13.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.761+0000 7f4366899000 1 -- 172.21.15.53:0/2246798490 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=104,monmap=2+}) v3 -- 0x55715a528fa0 con 0x55715a779740 2023-06-10T19:08:13.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.761+0000 7f433bfff640 1 -- 172.21.15.53:0/2246798490 <== mon.0 v2:172.21.15.53:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55715a7336e0 con 0x55715a779740 2023-06-10T19:08:13.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.761+0000 7f433bfff640 1 -- 172.21.15.53:0/2246798490 <== mon.0 v2:172.21.15.53:3300/0 5 ==== fsmap(e 104) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f434c033410 con 0x55715a779740 2023-06-10T19:08:13.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.761+0000 7f4366899000 10 client.11289 fetch_fsmap finished waiting for FSMap version 104 2023-06-10T19:08:13.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.761+0000 7f4366899000 10 client.11289 resolve_mds: resolved name 'c' to daemon mds.c 2023-06-10T19:08:13.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.761+0000 7f4366899000 20 client.11289 populate_metadata read hostname 'smithi053' 2023-06-10T19:08:13.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.761+0000 7f4366899000 1 --2- 172.21.15.53:0/2246798490 >> [v2:172.21.15.53:6834/3732323283,v1:172.21.15.53:6835/3732323283] conn(0x55715a7d7d10 0x55715a7d80e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:13.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.761+0000 7f4366899000 4 client.11289 mds_command: new command op to 11118 tid=0[{"prefix": "status"}] 2023-06-10T19:08:13.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.761+0000 7f4366899000 1 -- 172.21.15.53:0/2246798490 --> [v2:172.21.15.53:6834/3732323283,v1:172.21.15.53:6835/3732323283] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55715a57ccd0 con 0x55715a7d7d10 2023-06-10T19:08:13.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.761+0000 7f4361519640 1 --2- 172.21.15.53:0/2246798490 >> [v2:172.21.15.53:6834/3732323283,v1:172.21.15.53:6835/3732323283] conn(0x55715a7d7d10 0x55715a7d80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:13.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.761+0000 7f4361519640 1 --2- 172.21.15.53:0/2246798490 >> [v2:172.21.15.53:6834/3732323283,v1:172.21.15.53:6835/3732323283] conn(0x55715a7d7d10 0x55715a7d80e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=abf044eba6bb2c21 server_cookie=cce8c352573f1006 in_seq=0 out_seq=0 2023-06-10T19:08:13.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.761+0000 7f433bfff640 10 client.11289 ms_handle_connect on v2:172.21.15.53:6834/3732323283 2023-06-10T19:08:13.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.761+0000 7f433bfff640 1 -- 172.21.15.53:0/2246798490 <== mds.0 v2:172.21.15.53:6834/3732323283 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+329 (crc 0 0 0) 0x55715a57ccd0 con 0x55715a7d7d10 2023-06-10T19:08:13.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.761+0000 7f433bfff640 10 client.11289 handle_command_reply: tid=0 2023-06-10T19:08:13.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.761+0000 7f4366899000 1 client.11289 shutdown 2023-06-10T19:08:13.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.761+0000 7f4366899000 1 -- 172.21.15.53:0/2246798490 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55715a779740 msgr2=0x55715a7944c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:13.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.761+0000 7f4366899000 1 --2- 172.21.15.53:0/2246798490 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55715a779740 0x55715a7944c0 secure :-1 s=READY pgs=2618 cs=0 l=1 rev1=1 crypto rx=0x55715a786480 tx=0x7f434c004740 comp rx=0 tx=0).stop 2023-06-10T19:08:13.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.761+0000 7f4366899000 1 -- 172.21.15.53:0/2246798490 shutdown_connections 2023-06-10T19:08:13.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.761+0000 7f4366899000 1 --2- 172.21.15.53:0/2246798490 >> [v2:172.21.15.53:6834/3732323283,v1:172.21.15.53:6835/3732323283] conn(0x55715a7d7d10 0x55715a7d80e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:13.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.761+0000 7f4366899000 1 --2- 172.21.15.53:0/2246798490 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55715a77a050 0x55715a794a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:13.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.761+0000 7f4366899000 1 --2- 172.21.15.53:0/2246798490 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55715a779740 0x55715a7944c0 unknown :-1 s=CLOSED pgs=2618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:13.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.761+0000 7f4366899000 1 --2- 172.21.15.53:0/2246798490 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x55715a72fd80 0x55715a78c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:13.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.761+0000 7f433bfff640 0 client.11289 ms_handle_reset on v2:172.21.15.53:6834/3732323283 2023-06-10T19:08:13.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.761+0000 7f4366899000 1 -- 172.21.15.53:0/2246798490 >> 172.21.15.53:0/2246798490 conn(0x55715a727800 msgr2=0x55715a7780d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:13.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.761+0000 7f4366899000 1 -- 172.21.15.53:0/2246798490 shutdown_connections 2023-06-10T19:08:13.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.761+0000 7f4366899000 1 -- 172.21.15.53:0/2246798490 wait complete. 2023-06-10T19:08:13.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.761+0000 7f4366899000 20 client.11289 trim_cache size 0 max 16384 2023-06-10T19:08:13.774 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-06-10T19:08:13.774 INFO:teuthology.orchestra.run.smithi053.stdout: "cluster_fsid": "c8c64bed-c406-4936-93f9-d16335f1067d", 2023-06-10T19:08:13.774 INFO:teuthology.orchestra.run.smithi053.stdout: "whoami": 0, 2023-06-10T19:08:13.774 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 11118, 2023-06-10T19:08:13.774 INFO:teuthology.orchestra.run.smithi053.stdout: "want_state": "up:active", 2023-06-10T19:08:13.774 INFO:teuthology.orchestra.run.smithi053.stdout: "state": "up:active", 2023-06-10T19:08:13.774 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs", 2023-06-10T19:08:13.775 INFO:teuthology.orchestra.run.smithi053.stdout: "rank_uptime": 10.246599181000001, 2023-06-10T19:08:13.775 INFO:teuthology.orchestra.run.smithi053.stdout: "mdsmap_epoch": 104, 2023-06-10T19:08:13.775 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch": 180, 2023-06-10T19:08:13.775 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_epoch_barrier": 180, 2023-06-10T19:08:13.775 INFO:teuthology.orchestra.run.smithi053.stdout: "uptime": 15.445710831 2023-06-10T19:08:13.775 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-06-10T19:08:13.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.761+0000 7f436377d640 1 -- 172.21.15.53:0/761177881 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f43400662b0 msgr2=0x7f4340068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:13.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.761+0000 7f436377d640 1 --2- 172.21.15.53:0/761177881 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f43400662b0 0x7f4340068760 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f435c1584b0 tx=0x7f434c008040 comp rx=0 tx=0).stop 2023-06-10T19:08:13.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.761+0000 7f436377d640 1 -- 172.21.15.53:0/761177881 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f435c06b780 msgr2=0x7f435c0c9750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:13.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.761+0000 7f436377d640 1 --2- 172.21.15.53:0/761177881 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f435c06b780 0x7f435c0c9750 secure :-1 s=READY pgs=2614 cs=0 l=1 rev1=1 crypto rx=0x7f435800c370 tx=0x7f435800c830 comp rx=0 tx=0).stop 2023-06-10T19:08:13.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.761+0000 7f436377d640 1 -- 172.21.15.53:0/761177881 shutdown_connections 2023-06-10T19:08:13.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.761+0000 7f436377d640 1 --2- 172.21.15.53:0/761177881 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f43400662b0 0x7f4340068760 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:13.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.761+0000 7f436377d640 1 --2- 172.21.15.53:0/761177881 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f435c15f860 0x7f435c0c4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:13.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.761+0000 7f436377d640 1 --2- 172.21.15.53:0/761177881 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f435c15c7f0 0x7f435c0c5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:13.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.761+0000 7f436377d640 1 --2- 172.21.15.53:0/761177881 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f435c06b780 0x7f435c0c9750 unknown :-1 s=CLOSED pgs=2614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:13.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.761+0000 7f436377d640 1 -- 172.21.15.53:0/761177881 >> 172.21.15.53:0/761177881 conn(0x7f435c06a0b0 msgr2=0x7f435c0b0950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:13.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.761+0000 7f436377d640 1 -- 172.21.15.53:0/761177881 shutdown_connections 2023-06-10T19:08:13.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.761+0000 7f436377d640 1 -- 172.21.15.53:0/761177881 wait complete. 2023-06-10T19:08:13.782 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-10T19:08:13.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.893+0000 7fcbc215d640 1 Processor -- start 2023-06-10T19:08:13.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.893+0000 7fcbc215d640 1 -- start start 2023-06-10T19:08:13.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.897+0000 7fcbc215d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fcbbc0b24c0 0x7fcbbc0c2c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:13.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.897+0000 7fcbc215d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcbbc1642c0 0x7fcbbc0c31a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:13.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.897+0000 7fcbc215d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbbc06c060 con 0x7fcbbc15d5d0 2023-06-10T19:08:13.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.897+0000 7fcbc215d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbbc1637e0 con 0x7fcbbc0b24c0 2023-06-10T19:08:13.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.897+0000 7fcbc215d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbbc163ac0 con 0x7fcbbc1642c0 2023-06-10T19:08:13.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.897+0000 7fcbbaffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fcbbc0b24c0 0x7fcbbc0c2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:13.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.897+0000 7fcbbaffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fcbbc0b24c0 0x7fcbbc0c2c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45536/0 (socket says 172.21.15.53:45536) 2023-06-10T19:08:13.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.897+0000 7fcbbaffd640 1 -- 172.21.15.53:0/2936863680 learned_addr learned my addr 172.21.15.53:0/2936863680 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:08:13.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.897+0000 7fcbbbfff640 1 --2- 172.21.15.53:0/2936863680 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcbbc1642c0 0x7fcbbc0c31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:13.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.897+0000 7fcbbaffd640 1 -- 172.21.15.53:0/2936863680 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcbbc1642c0 msgr2=0x7fcbbc0c31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:13.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.897+0000 7fcbbaffd640 1 --2- 172.21.15.53:0/2936863680 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcbbc1642c0 0x7fcbbc0c31a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:13.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.897+0000 7fcbbaffd640 1 -- 172.21.15.53:0/2936863680 >> v1:172.21.15.117:6789/0 conn(0x7fcbbc15d5d0 legacy=0x7fcbbc06b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:13.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.897+0000 7fcbbaffd640 1 -- 172.21.15.53:0/2936863680 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbbc163da0 con 0x7fcbbc0b24c0 2023-06-10T19:08:13.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.897+0000 7fcbbbfff640 1 --2- 172.21.15.53:0/2936863680 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcbbc1642c0 0x7fcbbc0c31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:08:13.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.901+0000 7fcbbaffd640 1 --2- 172.21.15.53:0/2936863680 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcbbc0b24c0 0x7fcbbc0c2c60 secure :-1 s=READY pgs=2619 cs=0 l=1 rev1=1 crypto rx=0x7fcbb4009e80 tx=0x7fcbb401c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0a3545c63651ebd server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:13.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.901+0000 7fcbba7fc640 1 -- 172.21.15.53:0/2936863680 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb40a56a0 con 0x7fcbbc0b24c0 2023-06-10T19:08:13.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.901+0000 7fcbba7fc640 1 -- 172.21.15.53:0/2936863680 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbb40a5800 con 0x7fcbbc0b24c0 2023-06-10T19:08:13.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.901+0000 7fcbba7fc640 1 -- 172.21.15.53:0/2936863680 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb40a5b90 con 0x7fcbbc0b24c0 2023-06-10T19:08:13.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.901+0000 7fcbc215d640 1 -- 172.21.15.53:0/2936863680 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcbbc0b24c0 msgr2=0x7fcbbc0c2c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:13.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.901+0000 7fcbc215d640 1 --2- 172.21.15.53:0/2936863680 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcbbc0b24c0 0x7fcbbc0c2c60 secure :-1 s=READY pgs=2619 cs=0 l=1 rev1=1 crypto rx=0x7fcbb4009e80 tx=0x7fcbb401c8d0 comp rx=0 tx=0).stop 2023-06-10T19:08:13.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.901+0000 7fcbc215d640 1 -- 172.21.15.53:0/2936863680 shutdown_connections 2023-06-10T19:08:13.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.901+0000 7fcbc215d640 1 --2- 172.21.15.53:0/2936863680 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcbbc1642c0 0x7fcbbc0c31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:13.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.901+0000 7fcbc215d640 1 --2- 172.21.15.53:0/2936863680 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcbbc0b24c0 0x7fcbbc0c2c60 unknown :-1 s=CLOSED pgs=2619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:13.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.901+0000 7fcbc215d640 1 -- 172.21.15.53:0/2936863680 >> 172.21.15.53:0/2936863680 conn(0x7fcbbc06a090 msgr2=0x7fcbbc06d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:13.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.901+0000 7fcbc215d640 1 -- 172.21.15.53:0/2936863680 shutdown_connections 2023-06-10T19:08:13.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.901+0000 7fcbc215d640 1 -- 172.21.15.53:0/2936863680 wait complete. 2023-06-10T19:08:13.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.901+0000 7fcbc215d640 1 Processor -- start 2023-06-10T19:08:13.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.901+0000 7fcbc215d640 1 -- start start 2023-06-10T19:08:13.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.901+0000 7fcbc215d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcbbc0b24c0 0x7fcbbc1625d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:13.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.901+0000 7fcbc215d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcbbc15d5d0 0x7fcbbc14ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:13.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.901+0000 7fcbc215d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcbbc1642c0 0x7fcbbc14f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:13.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.901+0000 7fcbc215d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbbc14d140 con 0x7fcbbc0b24c0 2023-06-10T19:08:13.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.901+0000 7fcbc215d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbbc0c5f80 con 0x7fcbbc1642c0 2023-06-10T19:08:13.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.901+0000 7fcbc215d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbbc0c6260 con 0x7fcbbc15d5d0 2023-06-10T19:08:13.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.905+0000 7fcbbb7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcbbc0b24c0 0x7fcbbc1625d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:13.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.905+0000 7fcbbb7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcbbc0b24c0 0x7fcbbc1625d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45552/0 (socket says 172.21.15.53:45552) 2023-06-10T19:08:13.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.905+0000 7fcbbbfff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcbbc1642c0 0x7fcbbc14f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:13.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.905+0000 7fcbbb7fe640 1 -- 172.21.15.53:0/3989235253 learned_addr learned my addr 172.21.15.53:0/3989235253 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:08:13.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.905+0000 7fcbbaffd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcbbc15d5d0 0x7fcbbc14ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:13.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.905+0000 7fcbbb7fe640 1 -- 172.21.15.53:0/3989235253 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcbbc15d5d0 msgr2=0x7fcbbc14ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:13.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.905+0000 7fcbbb7fe640 1 --2- 172.21.15.53:0/3989235253 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcbbc15d5d0 0x7fcbbc14ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:13.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.905+0000 7fcbbb7fe640 1 -- 172.21.15.53:0/3989235253 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcbbc1642c0 msgr2=0x7fcbbc14f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:13.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.905+0000 7fcbbb7fe640 1 --2- 172.21.15.53:0/3989235253 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcbbc1642c0 0x7fcbbc14f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:13.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.905+0000 7fcbbb7fe640 1 -- 172.21.15.53:0/3989235253 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbb4009b30 con 0x7fcbbc0b24c0 2023-06-10T19:08:13.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.905+0000 7fcbbb7fe640 1 --2- 172.21.15.53:0/3989235253 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcbbc0b24c0 0x7fcbbc1625d0 secure :-1 s=READY pgs=2620 cs=0 l=1 rev1=1 crypto rx=0x7fcbac00c450 tx=0x7fcbac00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:13.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.905+0000 7fcba3fff640 1 -- 172.21.15.53:0/3989235253 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbac0052d0 con 0x7fcbbc0b24c0 2023-06-10T19:08:13.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.905+0000 7fcba3fff640 1 -- 172.21.15.53:0/3989235253 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbac005450 con 0x7fcbbc0b24c0 2023-06-10T19:08:13.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.905+0000 7fcba3fff640 1 -- 172.21.15.53:0/3989235253 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbac012870 con 0x7fcbbc0b24c0 2023-06-10T19:08:13.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.905+0000 7fcbc215d640 1 -- 172.21.15.53:0/3989235253 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbbc0c6540 con 0x7fcbbc0b24c0 2023-06-10T19:08:13.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.905+0000 7fcbc215d640 1 -- 172.21.15.53:0/3989235253 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbbc0c5c80 con 0x7fcbbc0b24c0 2023-06-10T19:08:13.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.905+0000 7fcbc215d640 1 -- 172.21.15.53:0/3989235253 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbbc04d790 con 0x7fcbbc0b24c0 2023-06-10T19:08:13.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.905+0000 7fcba3fff640 1 -- 172.21.15.53:0/3989235253 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcbac0129d0 con 0x7fcbbc0b24c0 2023-06-10T19:08:13.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.905+0000 7fcba3fff640 1 --2- 172.21.15.53:0/3989235253 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcba8066280 0x7fcba8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:13.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.905+0000 7fcba3fff640 1 -- 172.21.15.53:0/3989235253 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcbac0836e0 con 0x7fcbbc0b24c0 2023-06-10T19:08:13.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.905+0000 7fcbbaffd640 1 --2- 172.21.15.53:0/3989235253 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcba8066280 0x7fcba8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:13.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.909+0000 7fcbbaffd640 1 --2- 172.21.15.53:0/3989235253 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcba8066280 0x7fcba8068730 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7fcbb40ae000 tx=0x7fcbb40a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:13.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:13.909+0000 7fcba3fff640 1 -- 172.21.15.53:0/3989235253 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcbac050c00 con 0x7fcbbc0b24c0 2023-06-10T19:08:14.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:14.100+0000 7fcbc215d640 1 -- 172.21.15.53:0/3989235253 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fcbbc16a820 con 0x7fcbbc0b24c0 2023-06-10T19:08:14.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:14.100+0000 7fcba3fff640 1 -- 172.21.15.53:0/3989235253 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v104) v1 ==== 53+0+73 (secure 0 0 0) 0x7fcbac054220 con 0x7fcbbc0b24c0 2023-06-10T19:08:14.105 INFO:teuthology.orchestra.run.smithi053.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-06-10T19:08:14.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:14.100+0000 7fcbc215d640 1 -- 172.21.15.53:0/3989235253 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcba8066280 msgr2=0x7fcba8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:14.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:14.100+0000 7fcbc215d640 1 --2- 172.21.15.53:0/3989235253 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcba8066280 0x7fcba8068730 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7fcbb40ae000 tx=0x7fcbb40a7070 comp rx=0 tx=0).stop 2023-06-10T19:08:14.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:14.100+0000 7fcbc215d640 1 -- 172.21.15.53:0/3989235253 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcbbc0b24c0 msgr2=0x7fcbbc1625d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:14.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:14.100+0000 7fcbc215d640 1 --2- 172.21.15.53:0/3989235253 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcbbc0b24c0 0x7fcbbc1625d0 secure :-1 s=READY pgs=2620 cs=0 l=1 rev1=1 crypto rx=0x7fcbac00c450 tx=0x7fcbac00c910 comp rx=0 tx=0).stop 2023-06-10T19:08:14.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:14.100+0000 7fcbc215d640 1 -- 172.21.15.53:0/3989235253 shutdown_connections 2023-06-10T19:08:14.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:14.100+0000 7fcbc215d640 1 --2- 172.21.15.53:0/3989235253 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcba8066280 0x7fcba8068730 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:14.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:14.100+0000 7fcbc215d640 1 --2- 172.21.15.53:0/3989235253 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcbbc1642c0 0x7fcbbc14f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:14.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:14.100+0000 7fcbc215d640 1 --2- 172.21.15.53:0/3989235253 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcbbc15d5d0 0x7fcbbc14ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:14.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:14.100+0000 7fcbc215d640 1 --2- 172.21.15.53:0/3989235253 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcbbc0b24c0 0x7fcbbc1625d0 unknown :-1 s=CLOSED pgs=2620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:14.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:14.100+0000 7fcbc215d640 1 -- 172.21.15.53:0/3989235253 >> 172.21.15.53:0/3989235253 conn(0x7fcbbc06a090 msgr2=0x7fcbbc1534a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:14.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:14.104+0000 7fcbc215d640 1 -- 172.21.15.53:0/3989235253 shutdown_connections 2023-06-10T19:08:14.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:14.104+0000 7fcbc215d640 1 -- 172.21.15.53:0/3989235253 wait complete. 2023-06-10T19:08:14.124 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-10T19:08:14.125 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-10T19:08:14.126 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi053.front.sepia.ceph.com 2023-06-10T19:08:14.126 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-06-10T19:08:14.127 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-06-10T19:08:14.128 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-10T19:08:14.128 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-10T19:08:14.129 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-10T19:08:14.129 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-06-10T19:08:14.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:08:14.130 DEBUG:teuthology.orchestra.run.smithi053:> ip addr 2023-06-10T19:08:14.137 INFO:teuthology.orchestra.run.smithi053.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-10T19:08:14.137 INFO:teuthology.orchestra.run.smithi053.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-10T19:08:14.137 INFO:teuthology.orchestra.run.smithi053.stdout: inet 127.0.0.1/8 scope host lo 2023-06-10T19:08:14.137 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:08:14.138 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 ::1/128 scope host 2023-06-10T19:08:14.138 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:08:14.138 INFO:teuthology.orchestra.run.smithi053.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T19:08:14.138 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:da brd ff:ff:ff:ff:ff:ff 2023-06-10T19:08:14.138 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f0 2023-06-10T19:08:14.138 INFO:teuthology.orchestra.run.smithi053.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T19:08:14.138 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:db brd ff:ff:ff:ff:ff:ff 2023-06-10T19:08:14.138 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f1 2023-06-10T19:08:14.139 INFO:teuthology.orchestra.run.smithi053.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-10T19:08:14.139 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:18 brd ff:ff:ff:ff:ff:ff 2023-06-10T19:08:14.139 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f0 2023-06-10T19:08:14.139 INFO:teuthology.orchestra.run.smithi053.stdout: inet 172.21.15.53/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-06-10T19:08:14.139 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft 41555sec preferred_lft 41555sec 2023-06-10T19:08:14.139 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::ae1f:6bff:fef8:3718/64 scope link 2023-06-10T19:08:14.139 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:08:14.140 INFO:teuthology.orchestra.run.smithi053.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T19:08:14.140 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:19 brd ff:ff:ff:ff:ff:ff 2023-06-10T19:08:14.140 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f1 2023-06-10T19:08:14.140 INFO:teuthology.orchestra.run.smithi053.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-06-10T19:08:14.140 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 02:42:49:3d:ee:1e brd ff:ff:ff:ff:ff:ff 2023-06-10T19:08:14.140 INFO:teuthology.orchestra.run.smithi053.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-06-10T19:08:14.141 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:08:14.141 INFO:teuthology.orchestra.run.smithi053.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-10T19:08:14.141 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-06-10T19:08:14.141 INFO:teuthology.orchestra.run.smithi053.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-06-10T19:08:14.141 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:08:14.142 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-06-10T19:08:14.142 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:08:14.142 INFO:teuthology.orchestra.run.smithi053.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-10T19:08:14.142 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-06-10T19:08:14.143 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-06-10T19:08:14.143 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:08:14.143 INFO:teuthology.orchestra.run.smithi053.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-10T19:08:14.143 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-06-10T19:08:14.144 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-06-10T19:08:14.144 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:08:14.144 INFO:teuthology.orchestra.run.smithi053.stdout:10: brx.2@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-10T19:08:14.144 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ba:37:dd:38:ed:aa brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-06-10T19:08:14.145 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::b837:ddff:fe38:edaa/64 scope link 2023-06-10T19:08:14.145 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:08:14.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:08:14.146 DEBUG:teuthology.orchestra.run.smithi053:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-10T19:08:14.190 INFO:teuthology.orchestra.run.smithi053.stdout:1 2023-06-10T19:08:14.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:08:14.190 DEBUG:teuthology.orchestra.run.smithi053:> route 2023-06-10T19:08:14.237 INFO:teuthology.orchestra.run.smithi053.stdout:Kernel IP routing table 2023-06-10T19:08:14.237 INFO:teuthology.orchestra.run.smithi053.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-10T19:08:14.238 INFO:teuthology.orchestra.run.smithi053.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-06-10T19:08:14.238 INFO:teuthology.orchestra.run.smithi053.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-06-10T19:08:14.238 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-06-10T19:08:14.238 INFO:teuthology.orchestra.run.smithi053.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-10T19:08:14.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:08:14.239 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec bash -c ' 2023-06-10T19:08:14.240 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2023-06-10T19:08:14.240 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-06-10T19:08:14.240 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-06-10T19:08:14.241 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-06-10T19:08:14.241 DEBUG:teuthology.orchestra.run.smithi053:> ') 2023-06-10T19:08:14.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:08:14.315 DEBUG:teuthology.orchestra.run.smithi053:> ip netns list 2023-06-10T19:08:14.363 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 2) 2023-06-10T19:08:14.364 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-06-10T19:08:14.364 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-06-10T19:08:14.364 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-06-10T19:08:14.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:08:14.365 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link set brx.0 up 2023-06-10T19:08:14.420 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-06-10T19:08:14.420 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-10T19:08:14.421 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-06-10T19:08:14.467 INFO:teuthology.orchestra.run.smithi053.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-06-10T19:08:14.467 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-10T19:08:14.468 DEBUG:teuthology.orchestra.run.smithi053:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-06-10T19:08:14.515 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2023-06-10T19:08:14.572 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T19:08:14.572 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T19:08:14.626 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T19:08:14.627 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T19:08:14.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:08:14.628 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2023-06-10T19:08:14.675 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-06-10T19:08:14.676 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-06-10T19:08:14.720 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2023-06-10T19:08:14.736 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T19:08:14.736 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T19:08:14.791 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T19:08:14.792 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T19:08:14.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:08:14.793 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2023-06-10T19:08:14.808 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:2023-06-10T19:08:14.804+0000 7f8d1a00c580 -1 init, newargv = 0x555598b9ab10 newargc=15 2023-06-10T19:08:14.808 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[70880]: starting ceph client 2023-06-10T19:08:14.814 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[70880]: starting fuse 2023-06-10T19:08:15.912 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2023-06-10T19:08:15.928 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T19:08:15.929 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T19:08:15.983 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T19:08:15.984 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T19:08:15.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:08:15.986 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2023-06-10T19:08:16.031 INFO:teuthology.orchestra.run.smithi053.stdout:45 2023-06-10T19:08:16.031 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-06-10T19:08:16.032 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-06-10T19:08:16.032 DEBUG:teuthology.orchestra.run.smithi053:> import glob 2023-06-10T19:08:16.032 DEBUG:teuthology.orchestra.run.smithi053:> import re 2023-06-10T19:08:16.033 DEBUG:teuthology.orchestra.run.smithi053:> import os 2023-06-10T19:08:16.033 DEBUG:teuthology.orchestra.run.smithi053:> import subprocess 2023-06-10T19:08:16.033 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:08:16.034 DEBUG:teuthology.orchestra.run.smithi053:> def _find_admin_socket(client_name): 2023-06-10T19:08:16.034 DEBUG:teuthology.orchestra.run.smithi053:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-06-10T19:08:16.034 DEBUG:teuthology.orchestra.run.smithi053:> files = glob.glob(asok_path) 2023-06-10T19:08:16.034 DEBUG:teuthology.orchestra.run.smithi053:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-06-10T19:08:16.035 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:08:16.035 DEBUG:teuthology.orchestra.run.smithi053:> # Given a non-glob path, it better be there 2023-06-10T19:08:16.035 DEBUG:teuthology.orchestra.run.smithi053:> if "*" not in asok_path: 2023-06-10T19:08:16.036 DEBUG:teuthology.orchestra.run.smithi053:> assert(len(files) == 1) 2023-06-10T19:08:16.036 DEBUG:teuthology.orchestra.run.smithi053:> return files[0] 2023-06-10T19:08:16.036 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:08:16.037 DEBUG:teuthology.orchestra.run.smithi053:> for f in files: 2023-06-10T19:08:16.037 DEBUG:teuthology.orchestra.run.smithi053:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-06-10T19:08:16.037 DEBUG:teuthology.orchestra.run.smithi053:> if os.path.exists("/proc/{0}".format(pid)): 2023-06-10T19:08:16.037 DEBUG:teuthology.orchestra.run.smithi053:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-06-10T19:08:16.038 DEBUG:teuthology.orchestra.run.smithi053:> contents = proc_f.read() 2023-06-10T19:08:16.039 DEBUG:teuthology.orchestra.run.smithi053:> if mountpoint in contents: 2023-06-10T19:08:16.039 DEBUG:teuthology.orchestra.run.smithi053:> return f 2023-06-10T19:08:16.039 DEBUG:teuthology.orchestra.run.smithi053:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-06-10T19:08:16.040 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:08:16.040 DEBUG:teuthology.orchestra.run.smithi053:> print(_find_admin_socket("client.0")) 2023-06-10T19:08:16.041 DEBUG:teuthology.orchestra.run.smithi053:> ' 2023-06-10T19:08:16.156 INFO:teuthology.orchestra.run.smithi053.stdout:/var/run/ceph/ceph-client.0.70880.asok 2023-06-10T19:08:16.337 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.70880.asok 2023-06-10T19:08:16.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:08:16.338 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.70880.asok status 2023-06-10T19:08:16.502 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-06-10T19:08:16.503 INFO:teuthology.orchestra.run.smithi053.stdout: "metadata": { 2023-06-10T19:08:16.503 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_sha1": "219d315c3a0b2075e570fb1964be2ad33fe7a9c8", 2023-06-10T19:08:16.503 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_version": "ceph version 18.0.0-4359-g219d315c (219d315c3a0b2075e570fb1964be2ad33fe7a9c8) reef (dev)", 2023-06-10T19:08:16.503 INFO:teuthology.orchestra.run.smithi053.stdout: "entity_id": "0", 2023-06-10T19:08:16.503 INFO:teuthology.orchestra.run.smithi053.stdout: "hostname": "smithi053", 2023-06-10T19:08:16.503 INFO:teuthology.orchestra.run.smithi053.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-06-10T19:08:16.504 INFO:teuthology.orchestra.run.smithi053.stdout: "pid": "70880", 2023-06-10T19:08:16.504 INFO:teuthology.orchestra.run.smithi053.stdout: "root": "/" 2023-06-10T19:08:16.504 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:08:16.504 INFO:teuthology.orchestra.run.smithi053.stdout: "dentry_count": 0, 2023-06-10T19:08:16.504 INFO:teuthology.orchestra.run.smithi053.stdout: "dentry_pinned_count": 0, 2023-06-10T19:08:16.504 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 11304, 2023-06-10T19:08:16.505 INFO:teuthology.orchestra.run.smithi053.stdout: "inst": { 2023-06-10T19:08:16.505 INFO:teuthology.orchestra.run.smithi053.stdout: "name": { 2023-06-10T19:08:16.505 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "client", 2023-06-10T19:08:16.505 INFO:teuthology.orchestra.run.smithi053.stdout: "num": 11304 2023-06-10T19:08:16.505 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:08:16.505 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": { 2023-06-10T19:08:16.505 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2023-06-10T19:08:16.505 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "192.168.0.1:0", 2023-06-10T19:08:16.506 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 1503939443 2023-06-10T19:08:16.506 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:08:16.506 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:08:16.506 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": { 2023-06-10T19:08:16.506 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2023-06-10T19:08:16.507 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "192.168.0.1:0", 2023-06-10T19:08:16.507 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 1503939443 2023-06-10T19:08:16.507 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:08:16.507 INFO:teuthology.orchestra.run.smithi053.stdout: "inst_str": "client.11304 192.168.0.1:0/1503939443", 2023-06-10T19:08:16.507 INFO:teuthology.orchestra.run.smithi053.stdout: "addr_str": "192.168.0.1:0/1503939443", 2023-06-10T19:08:16.507 INFO:teuthology.orchestra.run.smithi053.stdout: "inode_count": 1, 2023-06-10T19:08:16.508 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_epoch": 104, 2023-06-10T19:08:16.508 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_epoch": 180, 2023-06-10T19:08:16.508 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_epoch_barrier": 0, 2023-06-10T19:08:16.508 INFO:teuthology.orchestra.run.smithi053.stdout: "blocklisted": false, 2023-06-10T19:08:16.508 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs" 2023-06-10T19:08:16.509 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-06-10T19:08:16.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:08:16.519 DEBUG:teuthology.orchestra.run.smithi053:> stat --file-system '--printf=%T 2023-06-10T19:08:16.519 DEBUG:teuthology.orchestra.run.smithi053:> ' -- /home/ubuntu/cephtest/mnt.0 2023-06-10T19:08:16.526 INFO:teuthology.orchestra.run.smithi053.stdout:fuseblk 2023-06-10T19:08:16.526 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-06-10T19:08:16.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:08:16.527 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-06-10T19:08:16.580 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-10T19:08:16.750 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:16.748+0000 7f419f62d640 1 Processor -- start 2023-06-10T19:08:16.751 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:16.748+0000 7f419f62d640 1 -- start start 2023-06-10T19:08:16.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:16.748+0000 7f419f62d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f419815c7f0 0x7f419815f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:16.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:16.748+0000 7f419f62d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f419815f860 0x7f41980ceb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:16.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:16.748+0000 7f419f62d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f419815cc40 con 0x7f419806b780 2023-06-10T19:08:16.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:16.748+0000 7f419f62d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f419815c3d0 con 0x7f419815f860 2023-06-10T19:08:16.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:16.748+0000 7f419f62d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41980af530 con 0x7f419815c7f0 2023-06-10T19:08:16.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:16.748+0000 7f419dbca640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f419815f860 0x7f41980ceb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:16.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:16.748+0000 7f419dbca640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f419815f860 0x7f41980ceb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45564/0 (socket says 172.21.15.53:45564) 2023-06-10T19:08:16.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:16.748+0000 7f419dbca640 1 -- 172.21.15.53:0/3219659083 learned_addr learned my addr 172.21.15.53:0/3219659083 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:08:16.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:16.748+0000 7f419cbc8640 1 --2- 172.21.15.53:0/3219659083 >> v2:172.21.15.117:3300/0 conn(0x7f419815c7f0 0x7f419815f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:16.754 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:16.748+0000 7f419dbca640 1 -- 172.21.15.53:0/3219659083 >> v2:172.21.15.117:3300/0 conn(0x7f419815c7f0 msgr2=0x7f419815f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:16.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:16.748+0000 7f419dbca640 1 --2- 172.21.15.53:0/3219659083 >> v2:172.21.15.117:3300/0 conn(0x7f419815c7f0 0x7f419815f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:16.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:16.748+0000 7f419dbca640 1 -- 172.21.15.53:0/3219659083 >> v1:172.21.15.117:6789/0 conn(0x7f419806b780 legacy=0x7f419806bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:16.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:16.748+0000 7f419dbca640 1 -- 172.21.15.53:0/3219659083 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f419815fd70 con 0x7f419815f860 2023-06-10T19:08:16.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:16.748+0000 7f419dbca640 1 --2- 172.21.15.53:0/3219659083 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f419815f860 0x7f41980ceb20 secure :-1 s=READY pgs=2624 cs=0 l=1 rev1=1 crypto rx=0x7f41980cdad0 tx=0x7f419001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37b09e38fa05a3e6 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:16.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:16.752+0000 7f418bfff640 1 -- 172.21.15.53:0/3219659083 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41900a7070 con 0x7f419815f860 2023-06-10T19:08:16.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:16.752+0000 7f418bfff640 1 -- 172.21.15.53:0/3219659083 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41900ab430 con 0x7f419815f860 2023-06-10T19:08:16.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:16.752+0000 7f418bfff640 1 -- 172.21.15.53:0/3219659083 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41900ab7c0 con 0x7f419815f860 2023-06-10T19:08:16.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:16.752+0000 7f419f62d640 1 -- 172.21.15.53:0/3219659083 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f419815f860 msgr2=0x7f41980ceb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:16.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:16.752+0000 7f419f62d640 1 --2- 172.21.15.53:0/3219659083 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f419815f860 0x7f41980ceb20 secure :-1 s=READY pgs=2624 cs=0 l=1 rev1=1 crypto rx=0x7f41980cdad0 tx=0x7f419001c430 comp rx=0 tx=0).stop 2023-06-10T19:08:16.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:16.752+0000 7f419f62d640 1 -- 172.21.15.53:0/3219659083 shutdown_connections 2023-06-10T19:08:16.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:16.752+0000 7f419f62d640 1 --2- 172.21.15.53:0/3219659083 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f419815f860 0x7f41980ceb20 unknown :-1 s=CLOSED pgs=2624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:16.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:16.752+0000 7f419f62d640 1 --2- 172.21.15.53:0/3219659083 >> v2:172.21.15.117:3300/0 conn(0x7f419815c7f0 0x7f419815f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:16.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:16.752+0000 7f419f62d640 1 -- 172.21.15.53:0/3219659083 >> 172.21.15.53:0/3219659083 conn(0x7f419806a090 msgr2=0x7f419806d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:16.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:16.752+0000 7f419f62d640 1 -- 172.21.15.53:0/3219659083 shutdown_connections 2023-06-10T19:08:16.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:16.752+0000 7f419f62d640 1 -- 172.21.15.53:0/3219659083 wait complete. 2023-06-10T19:08:16.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:16.752+0000 7f419f62d640 1 Processor -- start 2023-06-10T19:08:16.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:16.752+0000 7f419f62d640 1 -- start start 2023-06-10T19:08:16.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:16.752+0000 7f419f62d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f419806b780 0x7f41980b2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:16.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:16.752+0000 7f419f62d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f419815c7f0 0x7f41980ca480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:16.764 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:16.752+0000 7f419f62d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f419815f860 0x7f41980ca9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:16.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:16.752+0000 7f419f62d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41980caf00 con 0x7f419815f860 2023-06-10T19:08:16.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:16.752+0000 7f419f62d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f419815b950 con 0x7f419815c7f0 2023-06-10T19:08:16.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:16.752+0000 7f419f62d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41981f3c10 con 0x7f419806b780 2023-06-10T19:08:16.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:16.752+0000 7f419dbca640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f419815f860 0x7f41980ca9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:16.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:16.752+0000 7f419dbca640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f419815f860 0x7f41980ca9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45574/0 (socket says 172.21.15.53:45574) 2023-06-10T19:08:16.765 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:16.752+0000 7f419dbca640 1 -- 172.21.15.53:0/3080136653 learned_addr learned my addr 172.21.15.53:0/3080136653 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:08:16.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:16.752+0000 7f419d3c9640 1 --2- 172.21.15.53:0/3080136653 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f419806b780 0x7f41980b2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:16.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:16.756+0000 7f419cbc8640 1 --2- 172.21.15.53:0/3080136653 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f419815c7f0 0x7f41980ca480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:16.766 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:16.756+0000 7f419dbca640 1 -- 172.21.15.53:0/3080136653 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f419806b780 msgr2=0x7f41980b2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:16.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:16.756+0000 7f419dbca640 1 --2- 172.21.15.53:0/3080136653 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f419806b780 0x7f41980b2c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:16.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:16.756+0000 7f419dbca640 1 -- 172.21.15.53:0/3080136653 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f419815c7f0 msgr2=0x7f41980ca480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:16.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:16.756+0000 7f419dbca640 1 --2- 172.21.15.53:0/3080136653 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f419815c7f0 0x7f41980ca480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:16.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:16.756+0000 7f419dbca640 1 -- 172.21.15.53:0/3080136653 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41900094d0 con 0x7f419815f860 2023-06-10T19:08:16.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:16.756+0000 7f419cbc8640 1 --2- 172.21.15.53:0/3080136653 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f419815c7f0 0x7f41980ca480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:08:16.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:16.756+0000 7f419dbca640 1 --2- 172.21.15.53:0/3080136653 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f419815f860 0x7f41980ca9c0 secure :-1 s=READY pgs=2625 cs=0 l=1 rev1=1 crypto rx=0x7f419001aae0 tx=0x7f41900191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:16.767 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:16.756+0000 7f4189ffb640 1 -- 172.21.15.53:0/3080136653 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41900b4830 con 0x7f419815f860 2023-06-10T19:08:16.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:16.756+0000 7f4189ffb640 1 -- 172.21.15.53:0/3080136653 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41900b4990 con 0x7f419815f860 2023-06-10T19:08:16.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:16.756+0000 7f4189ffb640 1 -- 172.21.15.53:0/3080136653 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41900b4d00 con 0x7f419815f860 2023-06-10T19:08:16.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:16.756+0000 7f419f62d640 1 -- 172.21.15.53:0/3080136653 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41980cb0e0 con 0x7f419815f860 2023-06-10T19:08:16.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:16.756+0000 7f419f62d640 1 -- 172.21.15.53:0/3080136653 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41980cb6a0 con 0x7f419815f860 2023-06-10T19:08:16.768 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:16.756+0000 7f419f62d640 1 -- 172.21.15.53:0/3080136653 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f419804d790 con 0x7f419815f860 2023-06-10T19:08:16.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:16.756+0000 7f4189ffb640 1 -- 172.21.15.53:0/3080136653 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f41900c0460 con 0x7f419815f860 2023-06-10T19:08:16.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:16.756+0000 7f4189ffb640 1 --2- 172.21.15.53:0/3080136653 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f417c066280 0x7f417c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:16.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:16.756+0000 7f4189ffb640 1 -- 172.21.15.53:0/3080136653 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f419011e010 con 0x7f419815f860 2023-06-10T19:08:16.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:16.756+0000 7f419d3c9640 1 --2- 172.21.15.53:0/3080136653 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f417c066280 0x7f417c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:16.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:16.756+0000 7f419d3c9640 1 --2- 172.21.15.53:0/3080136653 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f417c066280 0x7f417c068730 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f418c00b810 tx=0x7f418c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:16.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:16.760+0000 7f4189ffb640 1 -- 172.21.15.53:0/3080136653 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f41900eb5b0 con 0x7f419815f860 2023-06-10T19:08:16.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:16.952+0000 7f419f62d640 1 -- 172.21.15.53:0/3080136653 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f419806df70 con 0x7f419815f860 2023-06-10T19:08:16.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:16.956+0000 7f4189ffb640 1 -- 172.21.15.53:0/3080136653 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v104) v1 ==== 53+0+73 (secure 0 0 0) 0x7f41900b4e60 con 0x7f419815f860 2023-06-10T19:08:16.960 INFO:teuthology.orchestra.run.smithi053.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-06-10T19:08:16.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:16.956+0000 7f419f62d640 1 -- 172.21.15.53:0/3080136653 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f417c066280 msgr2=0x7f417c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:16.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:16.956+0000 7f419f62d640 1 --2- 172.21.15.53:0/3080136653 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f417c066280 0x7f417c068730 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f418c00b810 tx=0x7f418c008040 comp rx=0 tx=0).stop 2023-06-10T19:08:16.961 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:16.956+0000 7f419f62d640 1 -- 172.21.15.53:0/3080136653 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f419815f860 msgr2=0x7f41980ca9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:16.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:16.956+0000 7f419f62d640 1 --2- 172.21.15.53:0/3080136653 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f419815f860 0x7f41980ca9c0 secure :-1 s=READY pgs=2625 cs=0 l=1 rev1=1 crypto rx=0x7f419001aae0 tx=0x7f41900191d0 comp rx=0 tx=0).stop 2023-06-10T19:08:16.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:16.956+0000 7f419f62d640 1 -- 172.21.15.53:0/3080136653 shutdown_connections 2023-06-10T19:08:16.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:16.956+0000 7f419f62d640 1 --2- 172.21.15.53:0/3080136653 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f417c066280 0x7f417c068730 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:16.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:16.956+0000 7f419f62d640 1 --2- 172.21.15.53:0/3080136653 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f419815f860 0x7f41980ca9c0 unknown :-1 s=CLOSED pgs=2625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:16.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:16.956+0000 7f419f62d640 1 --2- 172.21.15.53:0/3080136653 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f419815c7f0 0x7f41980ca480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:16.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:16.956+0000 7f419f62d640 1 --2- 172.21.15.53:0/3080136653 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f419806b780 0x7f41980b2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:16.962 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:16.956+0000 7f419f62d640 1 -- 172.21.15.53:0/3080136653 >> 172.21.15.53:0/3080136653 conn(0x7f419806a090 msgr2=0x7f41980afe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:16.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:16.956+0000 7f419f62d640 1 -- 172.21.15.53:0/3080136653 shutdown_connections 2023-06-10T19:08:16.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:16.956+0000 7f419f62d640 1 -- 172.21.15.53:0/3080136653 wait complete. 2023-06-10T19:08:16.978 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-10T19:08:16.978 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-10T19:08:16.978 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi117.front.sepia.ceph.com 2023-06-10T19:08:16.979 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-06-10T19:08:16.979 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-06-10T19:08:16.979 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-10T19:08:16.980 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-10T19:08:16.981 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-10T19:08:16.981 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-06-10T19:08:16.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:08:16.983 DEBUG:teuthology.orchestra.run.smithi117:> ip addr 2023-06-10T19:08:16.992 INFO:teuthology.orchestra.run.smithi117.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-10T19:08:16.993 INFO:teuthology.orchestra.run.smithi117.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-10T19:08:16.993 INFO:teuthology.orchestra.run.smithi117.stdout: inet 127.0.0.1/8 scope host lo 2023-06-10T19:08:16.993 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:08:16.993 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 ::1/128 scope host 2023-06-10T19:08:16.993 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:08:16.993 INFO:teuthology.orchestra.run.smithi117.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T19:08:16.994 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8a brd ff:ff:ff:ff:ff:ff 2023-06-10T19:08:16.994 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f0 2023-06-10T19:08:16.994 INFO:teuthology.orchestra.run.smithi117.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T19:08:16.994 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8b brd ff:ff:ff:ff:ff:ff 2023-06-10T19:08:16.994 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f1 2023-06-10T19:08:16.994 INFO:teuthology.orchestra.run.smithi117.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T19:08:16.994 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:62 brd ff:ff:ff:ff:ff:ff 2023-06-10T19:08:16.995 INFO:teuthology.orchestra.run.smithi117.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-10T19:08:16.995 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:63 brd ff:ff:ff:ff:ff:ff 2023-06-10T19:08:16.995 INFO:teuthology.orchestra.run.smithi117.stdout: inet 172.21.15.117/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-06-10T19:08:16.995 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft 41552sec preferred_lft 41552sec 2023-06-10T19:08:16.995 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::ec4:7aff:fe8f:4463/64 scope link 2023-06-10T19:08:16.995 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:08:16.995 INFO:teuthology.orchestra.run.smithi117.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-06-10T19:08:16.996 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 02:42:f8:40:b2:dc brd ff:ff:ff:ff:ff:ff 2023-06-10T19:08:16.996 INFO:teuthology.orchestra.run.smithi117.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-06-10T19:08:16.996 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:08:16.996 INFO:teuthology.orchestra.run.smithi117.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-10T19:08:16.996 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-06-10T19:08:16.996 INFO:teuthology.orchestra.run.smithi117.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-06-10T19:08:16.996 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:08:16.997 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-06-10T19:08:16.997 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:08:16.997 INFO:teuthology.orchestra.run.smithi117.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-10T19:08:16.997 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-06-10T19:08:16.997 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-06-10T19:08:16.997 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:08:16.998 INFO:teuthology.orchestra.run.smithi117.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-10T19:08:16.998 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-06-10T19:08:16.998 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-06-10T19:08:16.998 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:08:16.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:08:17.001 DEBUG:teuthology.orchestra.run.smithi117:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-10T19:08:17.047 INFO:teuthology.orchestra.run.smithi117.stdout:1 2023-06-10T19:08:17.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:08:17.049 DEBUG:teuthology.orchestra.run.smithi117:> route 2023-06-10T19:08:17.097 INFO:teuthology.orchestra.run.smithi117.stdout:Kernel IP routing table 2023-06-10T19:08:17.098 INFO:teuthology.orchestra.run.smithi117.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-10T19:08:17.098 INFO:teuthology.orchestra.run.smithi117.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-06-10T19:08:17.098 INFO:teuthology.orchestra.run.smithi117.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-06-10T19:08:17.098 INFO:teuthology.orchestra.run.smithi117.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-06-10T19:08:17.098 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-06-10T19:08:17.099 INFO:teuthology.orchestra.run.smithi117.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-10T19:08:17.099 INFO:teuthology.orchestra.run.smithi117.stdout:ns2.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-10T19:08:17.099 INFO:teuthology.orchestra.run.smithi117.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-10T19:08:17.099 INFO:teuthology.orchestra.run.smithi117.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-10T19:08:17.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:08:17.100 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec bash -c ' 2023-06-10T19:08:17.100 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2023-06-10T19:08:17.100 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-06-10T19:08:17.101 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-06-10T19:08:17.101 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-06-10T19:08:17.102 DEBUG:teuthology.orchestra.run.smithi117:> ') 2023-06-10T19:08:17.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:08:17.171 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list 2023-06-10T19:08:17.224 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-06-10T19:08:17.224 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-06-10T19:08:17.224 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-06-10T19:08:17.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:08:17.225 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link set brx.0 up 2023-06-10T19:08:17.280 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-06-10T19:08:17.280 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-10T19:08:17.280 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-06-10T19:08:17.328 INFO:teuthology.orchestra.run.smithi117.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-06-10T19:08:17.328 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-10T19:08:17.329 DEBUG:teuthology.orchestra.run.smithi117:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-06-10T19:08:17.376 DEBUG:teuthology.orchestra.run.smithi117:> sudo modprobe fuse 2023-06-10T19:08:17.437 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T19:08:17.437 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T19:08:17.491 INFO:teuthology.orchestra.run.smithi117.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T19:08:17.492 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T19:08:17.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:08:17.493 DEBUG:teuthology.orchestra.run.smithi117:> ls /sys/fs/fuse/connections 2023-06-10T19:08:17.539 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-06-10T19:08:17.540 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-06-10T19:08:17.585 DEBUG:teuthology.orchestra.run.smithi117:> sudo modprobe fuse 2023-06-10T19:08:17.600 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T19:08:17.600 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T19:08:17.657 INFO:teuthology.orchestra.run.smithi117.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T19:08:17.659 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T19:08:17.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:08:17.661 DEBUG:teuthology.orchestra.run.smithi117:> ls /sys/fs/fuse/connections 2023-06-10T19:08:17.663 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi117.stderr:2023-06-10T19:08:17.659+0000 7fe8cc026580 -1 init, newargv = 0x55ef7879dc80 newargc=15 2023-06-10T19:08:17.664 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi117.stderr:ceph-fuse[45973]: starting ceph client 2023-06-10T19:08:17.671 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi117.stderr:ceph-fuse[45973]: starting fuse 2023-06-10T19:08:18.769 DEBUG:teuthology.orchestra.run.smithi117:> sudo modprobe fuse 2023-06-10T19:08:18.785 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T19:08:18.785 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T19:08:18.839 INFO:teuthology.orchestra.run.smithi117.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T19:08:18.840 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T19:08:18.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:08:18.841 DEBUG:teuthology.orchestra.run.smithi117:> ls /sys/fs/fuse/connections 2023-06-10T19:08:18.888 INFO:teuthology.orchestra.run.smithi117.stdout:45 2023-06-10T19:08:18.889 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-06-10T19:08:18.890 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-06-10T19:08:18.890 DEBUG:teuthology.orchestra.run.smithi117:> import glob 2023-06-10T19:08:18.890 DEBUG:teuthology.orchestra.run.smithi117:> import re 2023-06-10T19:08:18.890 DEBUG:teuthology.orchestra.run.smithi117:> import os 2023-06-10T19:08:18.891 DEBUG:teuthology.orchestra.run.smithi117:> import subprocess 2023-06-10T19:08:18.891 DEBUG:teuthology.orchestra.run.smithi117:> 2023-06-10T19:08:18.891 DEBUG:teuthology.orchestra.run.smithi117:> def _find_admin_socket(client_name): 2023-06-10T19:08:18.892 DEBUG:teuthology.orchestra.run.smithi117:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-06-10T19:08:18.892 DEBUG:teuthology.orchestra.run.smithi117:> files = glob.glob(asok_path) 2023-06-10T19:08:18.892 DEBUG:teuthology.orchestra.run.smithi117:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-06-10T19:08:18.893 DEBUG:teuthology.orchestra.run.smithi117:> 2023-06-10T19:08:18.893 DEBUG:teuthology.orchestra.run.smithi117:> # Given a non-glob path, it better be there 2023-06-10T19:08:18.893 DEBUG:teuthology.orchestra.run.smithi117:> if "*" not in asok_path: 2023-06-10T19:08:18.893 DEBUG:teuthology.orchestra.run.smithi117:> assert(len(files) == 1) 2023-06-10T19:08:18.894 DEBUG:teuthology.orchestra.run.smithi117:> return files[0] 2023-06-10T19:08:18.894 DEBUG:teuthology.orchestra.run.smithi117:> 2023-06-10T19:08:18.894 DEBUG:teuthology.orchestra.run.smithi117:> for f in files: 2023-06-10T19:08:18.895 DEBUG:teuthology.orchestra.run.smithi117:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-06-10T19:08:18.895 DEBUG:teuthology.orchestra.run.smithi117:> if os.path.exists("/proc/{0}".format(pid)): 2023-06-10T19:08:18.895 DEBUG:teuthology.orchestra.run.smithi117:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-06-10T19:08:18.895 DEBUG:teuthology.orchestra.run.smithi117:> contents = proc_f.read() 2023-06-10T19:08:18.896 DEBUG:teuthology.orchestra.run.smithi117:> if mountpoint in contents: 2023-06-10T19:08:18.896 DEBUG:teuthology.orchestra.run.smithi117:> return f 2023-06-10T19:08:18.896 DEBUG:teuthology.orchestra.run.smithi117:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-06-10T19:08:18.897 DEBUG:teuthology.orchestra.run.smithi117:> 2023-06-10T19:08:18.897 DEBUG:teuthology.orchestra.run.smithi117:> print(_find_admin_socket("client.1")) 2023-06-10T19:08:18.897 DEBUG:teuthology.orchestra.run.smithi117:> ' 2023-06-10T19:08:19.009 INFO:teuthology.orchestra.run.smithi117.stdout:/var/run/ceph/ceph-client.1.45973.asok 2023-06-10T19:08:19.191 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.45973.asok 2023-06-10T19:08:19.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:08:19.193 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.45973.asok status 2023-06-10T19:08:19.349 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2023-06-10T19:08:19.350 INFO:teuthology.orchestra.run.smithi117.stdout: "metadata": { 2023-06-10T19:08:19.350 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_sha1": "219d315c3a0b2075e570fb1964be2ad33fe7a9c8", 2023-06-10T19:08:19.350 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_version": "ceph version 18.0.0-4359-g219d315c (219d315c3a0b2075e570fb1964be2ad33fe7a9c8) reef (dev)", 2023-06-10T19:08:19.350 INFO:teuthology.orchestra.run.smithi117.stdout: "entity_id": "1", 2023-06-10T19:08:19.350 INFO:teuthology.orchestra.run.smithi117.stdout: "hostname": "smithi117", 2023-06-10T19:08:19.350 INFO:teuthology.orchestra.run.smithi117.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-06-10T19:08:19.350 INFO:teuthology.orchestra.run.smithi117.stdout: "pid": "45973", 2023-06-10T19:08:19.351 INFO:teuthology.orchestra.run.smithi117.stdout: "root": "/" 2023-06-10T19:08:19.351 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-06-10T19:08:19.351 INFO:teuthology.orchestra.run.smithi117.stdout: "dentry_count": 0, 2023-06-10T19:08:19.351 INFO:teuthology.orchestra.run.smithi117.stdout: "dentry_pinned_count": 0, 2023-06-10T19:08:19.351 INFO:teuthology.orchestra.run.smithi117.stdout: "id": 7967, 2023-06-10T19:08:19.351 INFO:teuthology.orchestra.run.smithi117.stdout: "inst": { 2023-06-10T19:08:19.351 INFO:teuthology.orchestra.run.smithi117.stdout: "name": { 2023-06-10T19:08:19.352 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "client", 2023-06-10T19:08:19.352 INFO:teuthology.orchestra.run.smithi117.stdout: "num": 7967 2023-06-10T19:08:19.352 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-06-10T19:08:19.352 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": { 2023-06-10T19:08:19.352 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "v1", 2023-06-10T19:08:19.352 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": "192.168.0.1:0", 2023-06-10T19:08:19.352 INFO:teuthology.orchestra.run.smithi117.stdout: "nonce": 2316291873 2023-06-10T19:08:19.353 INFO:teuthology.orchestra.run.smithi117.stdout: } 2023-06-10T19:08:19.353 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-06-10T19:08:19.353 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": { 2023-06-10T19:08:19.353 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "v1", 2023-06-10T19:08:19.353 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": "192.168.0.1:0", 2023-06-10T19:08:19.353 INFO:teuthology.orchestra.run.smithi117.stdout: "nonce": 2316291873 2023-06-10T19:08:19.353 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2023-06-10T19:08:19.353 INFO:teuthology.orchestra.run.smithi117.stdout: "inst_str": "client.7967 192.168.0.1:0/2316291873", 2023-06-10T19:08:19.354 INFO:teuthology.orchestra.run.smithi117.stdout: "addr_str": "192.168.0.1:0/2316291873", 2023-06-10T19:08:19.354 INFO:teuthology.orchestra.run.smithi117.stdout: "inode_count": 1, 2023-06-10T19:08:19.354 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_epoch": 104, 2023-06-10T19:08:19.354 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_epoch": 180, 2023-06-10T19:08:19.354 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_epoch_barrier": 0, 2023-06-10T19:08:19.354 INFO:teuthology.orchestra.run.smithi117.stdout: "blocklisted": false, 2023-06-10T19:08:19.354 INFO:teuthology.orchestra.run.smithi117.stdout: "fs_name": "cephfs" 2023-06-10T19:08:19.354 INFO:teuthology.orchestra.run.smithi117.stdout:} 2023-06-10T19:08:19.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:08:19.363 DEBUG:teuthology.orchestra.run.smithi117:> stat --file-system '--printf=%T 2023-06-10T19:08:19.363 DEBUG:teuthology.orchestra.run.smithi117:> ' -- /home/ubuntu/cephtest/mnt.1 2023-06-10T19:08:19.369 INFO:teuthology.orchestra.run.smithi117.stdout:fuseblk 2023-06-10T19:08:19.370 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-06-10T19:08:19.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:08:19.370 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-06-10T19:08:19.423 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config get mds_reconnect_timeout 2023-06-10T19:08:19.572 INFO:teuthology.orchestra.run.smithi053.stdout:{"mds_reconnect_timeout":"45.000000"} 2023-06-10T19:08:19.573 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_reconnect_timeout": "45.000000" } 2023-06-10T19:08:19.573 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config get ms_max_backoff 2023-06-10T19:08:19.710 INFO:teuthology.orchestra.run.smithi053.stdout:{"ms_max_backoff":"15.000000"} 2023-06-10T19:08:19.710 DEBUG:tasks.cephfs.filesystem:_json_asok output { "ms_max_backoff": "15.000000" } 2023-06-10T19:08:19.711 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T19:08:19.711 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:08:19.718 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:08:19.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:19.888+0000 7f275ea6d640 1 Processor -- start 2023-06-10T19:08:19.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:19.888+0000 7f275ea6d640 1 -- start start 2023-06-10T19:08:19.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:19.888+0000 7f275ea6d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2758071060 0x7f27580af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:19.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:19.888+0000 7f275ea6d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f27580afc60 0x7f275806b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:19.895 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:19.888+0000 7f275ea6d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2758159b50 con 0x7f27580c9840 2023-06-10T19:08:19.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:19.888+0000 7f275ea6d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27580702a0 con 0x7f27580afc60 2023-06-10T19:08:19.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:19.888+0000 7f275ea6d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2758070580 con 0x7f2758071060 2023-06-10T19:08:19.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:19.888+0000 7f275d00a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f27580afc60 0x7f275806b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:19.896 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:19.888+0000 7f275d00a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f27580afc60 0x7f275806b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45586/0 (socket says 172.21.15.53:45586) 2023-06-10T19:08:19.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:19.888+0000 7f275d00a640 1 -- 172.21.15.53:0/3560851288 learned_addr learned my addr 172.21.15.53:0/3560851288 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:08:19.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:19.888+0000 7f2757fff640 1 --2- 172.21.15.53:0/3560851288 >> v2:172.21.15.117:3300/0 conn(0x7f2758071060 0x7f27580af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:19.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:19.888+0000 7f275d00a640 1 -- 172.21.15.53:0/3560851288 >> v2:172.21.15.117:3300/0 conn(0x7f2758071060 msgr2=0x7f27580af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:19.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:19.888+0000 7f275d00a640 1 --2- 172.21.15.53:0/3560851288 >> v2:172.21.15.117:3300/0 conn(0x7f2758071060 0x7f27580af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:19.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:19.888+0000 7f275d00a640 1 -- 172.21.15.53:0/3560851288 >> v1:172.21.15.117:6789/0 conn(0x7f27580c9840 legacy=0x7f27580c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:19.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:19.888+0000 7f275d00a640 1 -- 172.21.15.53:0/3560851288 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2758070860 con 0x7f27580afc60 2023-06-10T19:08:19.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:19.888+0000 7f2757fff640 1 --2- 172.21.15.53:0/3560851288 >> v2:172.21.15.117:3300/0 conn(0x7f2758071060 0x7f27580af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:08:19.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:19.892+0000 7f275d00a640 1 --2- 172.21.15.53:0/3560851288 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27580afc60 0x7f275806b090 secure :-1 s=READY pgs=2626 cs=0 l=1 rev1=1 crypto rx=0x7f275806e650 tx=0x7f275001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec8e02b00c709ba8 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:19.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:19.892+0000 7f27577fe640 1 -- 172.21.15.53:0/3560851288 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27500a5880 con 0x7f27580afc60 2023-06-10T19:08:19.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:19.892+0000 7f27577fe640 1 -- 172.21.15.53:0/3560851288 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27500a59e0 con 0x7f27580afc60 2023-06-10T19:08:19.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:19.892+0000 7f27577fe640 1 -- 172.21.15.53:0/3560851288 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27500a5d70 con 0x7f27580afc60 2023-06-10T19:08:19.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:19.892+0000 7f275ea6d640 1 -- 172.21.15.53:0/3560851288 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27580afc60 msgr2=0x7f275806b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:19.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:19.892+0000 7f275ea6d640 1 --2- 172.21.15.53:0/3560851288 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27580afc60 0x7f275806b090 secure :-1 s=READY pgs=2626 cs=0 l=1 rev1=1 crypto rx=0x7f275806e650 tx=0x7f275001c9a0 comp rx=0 tx=0).stop 2023-06-10T19:08:19.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:19.892+0000 7f275ea6d640 1 -- 172.21.15.53:0/3560851288 shutdown_connections 2023-06-10T19:08:19.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:19.892+0000 7f275ea6d640 1 --2- 172.21.15.53:0/3560851288 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27580afc60 0x7f275806b090 unknown :-1 s=CLOSED pgs=2626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:19.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:19.892+0000 7f275ea6d640 1 --2- 172.21.15.53:0/3560851288 >> v2:172.21.15.117:3300/0 conn(0x7f2758071060 0x7f27580af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:19.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:19.892+0000 7f275ea6d640 1 -- 172.21.15.53:0/3560851288 >> 172.21.15.53:0/3560851288 conn(0x7f275806a0d0 msgr2=0x7f27580ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:19.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:19.892+0000 7f275ea6d640 1 -- 172.21.15.53:0/3560851288 shutdown_connections 2023-06-10T19:08:19.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:19.892+0000 7f275ea6d640 1 -- 172.21.15.53:0/3560851288 wait complete. 2023-06-10T19:08:19.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:19.892+0000 7f275ea6d640 1 Processor -- start 2023-06-10T19:08:19.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:19.892+0000 7f275ea6d640 1 -- start start 2023-06-10T19:08:19.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:19.896+0000 7f275ea6d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2758071060 0x7f2758146a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:19.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:19.896+0000 7f275ea6d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27580afc60 0x7f27581584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:19.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:19.896+0000 7f275ea6d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27580c9840 0x7f2758151130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:19.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:19.896+0000 7f275ea6d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2758152320 con 0x7f2758071060 2023-06-10T19:08:19.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:19.896+0000 7f275ea6d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27580b0e40 con 0x7f27580afc60 2023-06-10T19:08:19.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:19.896+0000 7f275ea6d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27580c1870 con 0x7f27580c9840 2023-06-10T19:08:19.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:19.896+0000 7f275c809640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2758071060 0x7f2758146a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:19.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:19.896+0000 7f275c809640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2758071060 0x7f2758146a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45590/0 (socket says 172.21.15.53:45590) 2023-06-10T19:08:19.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:19.896+0000 7f275c809640 1 -- 172.21.15.53:0/433331776 learned_addr learned my addr 172.21.15.53:0/433331776 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:08:19.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:19.896+0000 7f2757fff640 1 --2- 172.21.15.53:0/433331776 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27580afc60 0x7f27581584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:19.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:19.896+0000 7f275d00a640 1 --2- 172.21.15.53:0/433331776 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27580c9840 0x7f2758151130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:19.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:19.896+0000 7f275c809640 1 -- 172.21.15.53:0/433331776 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27580c9840 msgr2=0x7f2758151130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:19.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:19.896+0000 7f275c809640 1 --2- 172.21.15.53:0/433331776 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27580c9840 0x7f2758151130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:19.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:19.896+0000 7f275c809640 1 -- 172.21.15.53:0/433331776 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27580afc60 msgr2=0x7f27581584d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:19.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:19.896+0000 7f275c809640 1 --2- 172.21.15.53:0/433331776 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27580afc60 0x7f27581584d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:19.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:19.896+0000 7f275c809640 1 -- 172.21.15.53:0/433331776 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2750009b30 con 0x7f2758071060 2023-06-10T19:08:19.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:19.896+0000 7f275d00a640 1 --2- 172.21.15.53:0/433331776 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27580c9840 0x7f2758151130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:08:19.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:19.896+0000 7f2757fff640 1 --2- 172.21.15.53:0/433331776 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27580afc60 0x7f27581584d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:08:19.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:19.896+0000 7f275c809640 1 --2- 172.21.15.53:0/433331776 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2758071060 0x7f2758146a40 secure :-1 s=READY pgs=2627 cs=0 l=1 rev1=1 crypto rx=0x7f274800c3c0 tx=0x7f274800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:19.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:19.896+0000 7f27557fa640 1 -- 172.21.15.53:0/433331776 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27480052d0 con 0x7f2758071060 2023-06-10T19:08:19.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:19.896+0000 7f27557fa640 1 -- 172.21.15.53:0/433331776 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2748005430 con 0x7f2758071060 2023-06-10T19:08:19.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:19.896+0000 7f275ea6d640 1 -- 172.21.15.53:0/433331776 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27580c1b50 con 0x7f2758071060 2023-06-10T19:08:19.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:19.896+0000 7f27557fa640 1 -- 172.21.15.53:0/433331776 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2748003840 con 0x7f2758071060 2023-06-10T19:08:19.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:19.896+0000 7f275ea6d640 1 -- 172.21.15.53:0/433331776 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27580b0ad0 con 0x7f2758071060 2023-06-10T19:08:19.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:19.896+0000 7f275ea6d640 1 -- 172.21.15.53:0/433331776 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f275804d790 con 0x7f2758071060 2023-06-10T19:08:19.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:19.896+0000 7f27557fa640 1 -- 172.21.15.53:0/433331776 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f27480039a0 con 0x7f2758071060 2023-06-10T19:08:19.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:19.896+0000 7f27557fa640 1 --2- 172.21.15.53:0/433331776 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2744066280 0x7f2744068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:19.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:19.896+0000 7f27557fa640 1 -- 172.21.15.53:0/433331776 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2748083260 con 0x7f2758071060 2023-06-10T19:08:19.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:19.896+0000 7f2757fff640 1 --2- 172.21.15.53:0/433331776 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2744066280 0x7f2744068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:19.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:19.900+0000 7f2757fff640 1 --2- 172.21.15.53:0/433331776 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2744066280 0x7f2744068730 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f27580adfb0 tx=0x7f274c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:19.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:19.900+0000 7f27557fa640 1 -- 172.21.15.53:0/433331776 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f27480506e0 con 0x7f2758071060 2023-06-10T19:08:20.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.056+0000 7f275ea6d640 1 -- 172.21.15.53:0/433331776 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f27580c2000 con 0x7f2758071060 2023-06-10T19:08:20.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.060+0000 7f27557fa640 1 -- 172.21.15.53:0/433331776 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v180) v1 ==== 74+0+18285 (secure 0 0 0) 0x7f2748053d00 con 0x7f2758071060 2023-06-10T19:08:20.064 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:08:20.064 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":180,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:08:04.518453+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2023-06-10T19:08:01.296938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"179","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_data","create_time":"2023-06-10T19:08:02.507633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"180","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:08:20.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.060+0000 7f275ea6d640 1 -- 172.21.15.53:0/433331776 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2744066280 msgr2=0x7f2744068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:20.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.060+0000 7f275ea6d640 1 --2- 172.21.15.53:0/433331776 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2744066280 0x7f2744068730 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f27580adfb0 tx=0x7f274c008040 comp rx=0 tx=0).stop 2023-06-10T19:08:20.066 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.060+0000 7f275ea6d640 1 -- 172.21.15.53:0/433331776 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2758071060 msgr2=0x7f2758146a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:20.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.060+0000 7f275ea6d640 1 --2- 172.21.15.53:0/433331776 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2758071060 0x7f2758146a40 secure :-1 s=READY pgs=2627 cs=0 l=1 rev1=1 crypto rx=0x7f274800c3c0 tx=0x7f274800c880 comp rx=0 tx=0).stop 2023-06-10T19:08:20.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.060+0000 7f275ea6d640 1 -- 172.21.15.53:0/433331776 shutdown_connections 2023-06-10T19:08:20.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.060+0000 7f275ea6d640 1 --2- 172.21.15.53:0/433331776 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2744066280 0x7f2744068730 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:20.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.060+0000 7f275ea6d640 1 --2- 172.21.15.53:0/433331776 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27580c9840 0x7f2758151130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:20.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.060+0000 7f275ea6d640 1 --2- 172.21.15.53:0/433331776 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27580afc60 0x7f27581584d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:20.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.060+0000 7f275ea6d640 1 --2- 172.21.15.53:0/433331776 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2758071060 0x7f2758146a40 unknown :-1 s=CLOSED pgs=2627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:20.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.060+0000 7f275ea6d640 1 -- 172.21.15.53:0/433331776 >> 172.21.15.53:0/433331776 conn(0x7f275806a0d0 msgr2=0x7f27580ae200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:20.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.060+0000 7f275ea6d640 1 -- 172.21.15.53:0/433331776 shutdown_connections 2023-06-10T19:08:20.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.060+0000 7f275ea6d640 1 -- 172.21.15.53:0/433331776 wait complete. 2023-06-10T19:08:20.083 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-10T18:52:33.633114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-10T18:52:39.171487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 25, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-10T19:08:01.296938+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '179', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 26, 'pool_name': 'cephfs_data', 'create_time': '2023-06-10T19:08:02.507633+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '180', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-10T19:08:20.084 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-10T19:08:20.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.200+0000 7fe0e2aed640 1 Processor -- start 2023-06-10T19:08:20.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.200+0000 7fe0e2aed640 1 -- start start 2023-06-10T19:08:20.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.204+0000 7fe0e2aed640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe0dc1558e0 0x7fe0dc0c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:20.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.204+0000 7fe0e2aed640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe0dc06b6e0 0x7fe0dc06bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:20.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.204+0000 7fe0e2aed640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0dc06c230 con 0x7fe0dc158f40 2023-06-10T19:08:20.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.204+0000 7fe0e2aed640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0dc06c040 con 0x7fe0dc1558e0 2023-06-10T19:08:20.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.204+0000 7fe0e2aed640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0dc06ca40 con 0x7fe0dc06b6e0 2023-06-10T19:08:20.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.204+0000 7fe0e0889640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe0dc1558e0 0x7fe0dc0c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:20.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.204+0000 7fe0e108a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe0dc06b6e0 0x7fe0dc06bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:20.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.204+0000 7fe0e0889640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe0dc1558e0 0x7fe0dc0c82a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.53:36248/0 (socket says 172.21.15.53:36248) 2023-06-10T19:08:20.209 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.204+0000 7fe0e0889640 1 -- 172.21.15.53:0/9666403 learned_addr learned my addr 172.21.15.53:0/9666403 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:08:20.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.204+0000 7fe0e108a640 1 -- 172.21.15.53:0/9666403 >> v2:172.21.15.117:3300/0 conn(0x7fe0dc1558e0 msgr2=0x7fe0dc0c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:20.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.204+0000 7fe0e108a640 1 --2- 172.21.15.53:0/9666403 >> v2:172.21.15.117:3300/0 conn(0x7fe0dc1558e0 0x7fe0dc0c82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:20.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.204+0000 7fe0e108a640 1 -- 172.21.15.53:0/9666403 >> v1:172.21.15.117:6789/0 conn(0x7fe0dc158f40 legacy=0x7fe0dc0cb820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:20.210 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.204+0000 7fe0e108a640 1 -- 172.21.15.53:0/9666403 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0dc155cb0 con 0x7fe0dc06b6e0 2023-06-10T19:08:20.211 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.204+0000 7fe0e0889640 1 --2- 172.21.15.53:0/9666403 >> v2:172.21.15.117:3300/0 conn(0x7fe0dc1558e0 0x7fe0dc0c82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-10T19:08:20.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.204+0000 7fe0e108a640 1 --2- 172.21.15.53:0/9666403 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe0dc06b6e0 0x7fe0dc06bb00 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe0d400a960 tx=0x7fe0d401d700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5283ac303b2df2c2 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:20.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.208+0000 7fe0db7fe640 1 -- 172.21.15.53:0/9666403 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d40a6730 con 0x7fe0dc06b6e0 2023-06-10T19:08:20.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.208+0000 7fe0db7fe640 1 -- 172.21.15.53:0/9666403 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0d40a6890 con 0x7fe0dc06b6e0 2023-06-10T19:08:20.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.208+0000 7fe0db7fe640 1 -- 172.21.15.53:0/9666403 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d40a6c20 con 0x7fe0dc06b6e0 2023-06-10T19:08:20.212 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.208+0000 7fe0e2aed640 1 -- 172.21.15.53:0/9666403 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe0dc06b6e0 msgr2=0x7fe0dc06bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:20.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.208+0000 7fe0e2aed640 1 --2- 172.21.15.53:0/9666403 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe0dc06b6e0 0x7fe0dc06bb00 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe0d400a960 tx=0x7fe0d401d700 comp rx=0 tx=0).stop 2023-06-10T19:08:20.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.208+0000 7fe0e2aed640 1 -- 172.21.15.53:0/9666403 shutdown_connections 2023-06-10T19:08:20.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.208+0000 7fe0e2aed640 1 --2- 172.21.15.53:0/9666403 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe0dc06b6e0 0x7fe0dc06bb00 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:20.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.208+0000 7fe0e2aed640 1 --2- 172.21.15.53:0/9666403 >> v2:172.21.15.117:3300/0 conn(0x7fe0dc1558e0 0x7fe0dc0c82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:20.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.208+0000 7fe0e2aed640 1 -- 172.21.15.53:0/9666403 >> 172.21.15.53:0/9666403 conn(0x7fe0dc06a0e0 msgr2=0x7fe0dc0cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:20.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.208+0000 7fe0e2aed640 1 -- 172.21.15.53:0/9666403 shutdown_connections 2023-06-10T19:08:20.213 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.208+0000 7fe0e2aed640 1 -- 172.21.15.53:0/9666403 wait complete. 2023-06-10T19:08:20.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.208+0000 7fe0e2aed640 1 Processor -- start 2023-06-10T19:08:20.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.208+0000 7fe0e2aed640 1 -- start start 2023-06-10T19:08:20.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.208+0000 7fe0e2aed640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0dc06b6e0 0x7fe0dc14e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:20.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.208+0000 7fe0e2aed640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe0dc1558e0 0x7fe0dc0c3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:20.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.208+0000 7fe0e2aed640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe0dc158f40 0x7fe0dc0c3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:20.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.208+0000 7fe0e2aed640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0dc159810 con 0x7fe0dc06b6e0 2023-06-10T19:08:20.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.208+0000 7fe0e2aed640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0dc0b14d0 con 0x7fe0dc1558e0 2023-06-10T19:08:20.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.208+0000 7fe0e2aed640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0dc0b1770 con 0x7fe0dc158f40 2023-06-10T19:08:20.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.208+0000 7fe0e0889640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0dc06b6e0 0x7fe0dc14e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:20.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.208+0000 7fe0e0889640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0dc06b6e0 0x7fe0dc14e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45596/0 (socket says 172.21.15.53:45596) 2023-06-10T19:08:20.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.208+0000 7fe0e0889640 1 -- 172.21.15.53:0/1664848361 learned_addr learned my addr 172.21.15.53:0/1664848361 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:08:20.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.208+0000 7fe0e108a640 1 --2- 172.21.15.53:0/1664848361 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe0dc158f40 0x7fe0dc0c3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:20.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.208+0000 7fe0dbfff640 1 --2- 172.21.15.53:0/1664848361 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe0dc1558e0 0x7fe0dc0c3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:20.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.208+0000 7fe0e0889640 1 -- 172.21.15.53:0/1664848361 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe0dc158f40 msgr2=0x7fe0dc0c3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:20.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.208+0000 7fe0e0889640 1 --2- 172.21.15.53:0/1664848361 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe0dc158f40 0x7fe0dc0c3ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:20.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.208+0000 7fe0e0889640 1 -- 172.21.15.53:0/1664848361 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe0dc1558e0 msgr2=0x7fe0dc0c3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:20.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.208+0000 7fe0e0889640 1 --2- 172.21.15.53:0/1664848361 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe0dc1558e0 0x7fe0dc0c3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:20.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.208+0000 7fe0e0889640 1 -- 172.21.15.53:0/1664848361 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0cc009b30 con 0x7fe0dc06b6e0 2023-06-10T19:08:20.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.208+0000 7fe0e108a640 1 --2- 172.21.15.53:0/1664848361 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe0dc158f40 0x7fe0dc0c3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:08:20.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.208+0000 7fe0dbfff640 1 --2- 172.21.15.53:0/1664848361 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe0dc1558e0 0x7fe0dc0c3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:08:20.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.212+0000 7fe0e0889640 1 --2- 172.21.15.53:0/1664848361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0dc06b6e0 0x7fe0dc14e7c0 secure :-1 s=READY pgs=2628 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc00efc0 tx=0x7fe0cc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:20.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.212+0000 7fe0d97fa640 1 -- 172.21.15.53:0/1664848361 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0cc00ce60 con 0x7fe0dc06b6e0 2023-06-10T19:08:20.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.212+0000 7fe0d97fa640 1 -- 172.21.15.53:0/1664848361 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0cc00f040 con 0x7fe0dc06b6e0 2023-06-10T19:08:20.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.212+0000 7fe0e2aed640 1 -- 172.21.15.53:0/1664848361 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0d400a5c0 con 0x7fe0dc06b6e0 2023-06-10T19:08:20.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.212+0000 7fe0d97fa640 1 -- 172.21.15.53:0/1664848361 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0cc014680 con 0x7fe0dc06b6e0 2023-06-10T19:08:20.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.212+0000 7fe0e2aed640 1 -- 172.21.15.53:0/1664848361 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0dc0b1d30 con 0x7fe0dc06b6e0 2023-06-10T19:08:20.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.212+0000 7fe0e2aed640 1 -- 172.21.15.53:0/1664848361 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0dc04d790 con 0x7fe0dc06b6e0 2023-06-10T19:08:20.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.212+0000 7fe0d97fa640 1 -- 172.21.15.53:0/1664848361 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe0cc0147e0 con 0x7fe0dc06b6e0 2023-06-10T19:08:20.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.212+0000 7fe0d97fa640 1 --2- 172.21.15.53:0/1664848361 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe0c8066280 0x7fe0c8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:20.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.212+0000 7fe0d97fa640 1 -- 172.21.15.53:0/1664848361 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe0cc084680 con 0x7fe0dc06b6e0 2023-06-10T19:08:20.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.212+0000 7fe0dbfff640 1 --2- 172.21.15.53:0/1664848361 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe0c8066280 0x7fe0c8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:20.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.212+0000 7fe0dbfff640 1 --2- 172.21.15.53:0/1664848361 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe0c8066280 0x7fe0c8068730 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc0b3380 tx=0x7fe0d0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:20.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.216+0000 7fe0d97fa640 1 -- 172.21.15.53:0/1664848361 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe0cc051a70 con 0x7fe0dc06b6e0 2023-06-10T19:08:20.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.372+0000 7fe0e2aed640 1 -- 172.21.15.53:0/1664848361 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe0dc0c87a0 con 0x7fe0dc06b6e0 2023-06-10T19:08:20.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.372+0000 7fe0d97fa640 1 -- 172.21.15.53:0/1664848361 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v180) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe0cc055090 con 0x7fe0dc06b6e0 2023-06-10T19:08:20.376 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-06-10T19:08:20.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.376+0000 7fe0e2aed640 1 -- 172.21.15.53:0/1664848361 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe0c8066280 msgr2=0x7fe0c8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:20.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.376+0000 7fe0e2aed640 1 --2- 172.21.15.53:0/1664848361 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe0c8066280 0x7fe0c8068730 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc0b3380 tx=0x7fe0d0009040 comp rx=0 tx=0).stop 2023-06-10T19:08:20.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.376+0000 7fe0e2aed640 1 -- 172.21.15.53:0/1664848361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0dc06b6e0 msgr2=0x7fe0dc14e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:20.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.376+0000 7fe0e2aed640 1 --2- 172.21.15.53:0/1664848361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0dc06b6e0 0x7fe0dc14e7c0 secure :-1 s=READY pgs=2628 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc00efc0 tx=0x7fe0cc00c490 comp rx=0 tx=0).stop 2023-06-10T19:08:20.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.376+0000 7fe0e2aed640 1 -- 172.21.15.53:0/1664848361 shutdown_connections 2023-06-10T19:08:20.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.376+0000 7fe0e2aed640 1 --2- 172.21.15.53:0/1664848361 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe0c8066280 0x7fe0c8068730 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:20.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.376+0000 7fe0e2aed640 1 --2- 172.21.15.53:0/1664848361 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe0dc158f40 0x7fe0dc0c3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:20.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.376+0000 7fe0e2aed640 1 --2- 172.21.15.53:0/1664848361 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe0dc1558e0 0x7fe0dc0c3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:20.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.376+0000 7fe0e2aed640 1 --2- 172.21.15.53:0/1664848361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0dc06b6e0 0x7fe0dc14e7c0 unknown :-1 s=CLOSED pgs=2628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:20.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.376+0000 7fe0e2aed640 1 -- 172.21.15.53:0/1664848361 >> 172.21.15.53:0/1664848361 conn(0x7fe0dc06a0e0 msgr2=0x7fe0dc1538c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:20.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.376+0000 7fe0e2aed640 1 -- 172.21.15.53:0/1664848361 shutdown_connections 2023-06-10T19:08:20.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.376+0000 7fe0e2aed640 1 -- 172.21.15.53:0/1664848361 wait complete. 2023-06-10T19:08:20.396 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-10T19:08:20.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.524+0000 7efcc6213640 1 Processor -- start 2023-06-10T19:08:20.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.524+0000 7efcc6213640 1 -- start start 2023-06-10T19:08:20.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.524+0000 7efcc6213640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7efcc00b0f30 0x7efcc0070950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:20.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.524+0000 7efcc6213640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcc00cb080 con 0x7efcc0159690 2023-06-10T19:08:20.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.524+0000 7efcc6213640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcc00cb320 con 0x7efcc0159a60 2023-06-10T19:08:20.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.524+0000 7efcc6213640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcc0070e90 con 0x7efcc00b0f30 2023-06-10T19:08:20.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.524+0000 7efcbf7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7efcc0159690 0x7efcc00cbe00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52264/0 (socket says 172.21.15.53:52264) 2023-06-10T19:08:20.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.524+0000 7efcbf7fe640 1 -- 172.21.15.53:0/2574344119 learned_addr learned my addr 172.21.15.53:0/2574344119 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:08:20.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.524+0000 7efcbeffd640 1 --2- 172.21.15.53:0/2574344119 >> v2:172.21.15.117:3300/0 conn(0x7efcc00b0f30 0x7efcc0070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:20.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.524+0000 7efcbe7fc640 1 -- 172.21.15.53:0/2574344119 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1712003007 0 0) 0x7efcc00cb080 con 0x7efcc0159690 2023-06-10T19:08:20.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.524+0000 7efcbe7fc640 1 -- 172.21.15.53:0/2574344119 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efca8003530 con 0x7efcc0159690 2023-06-10T19:08:20.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.524+0000 7efcbe7fc640 1 -- 172.21.15.53:0/2574344119 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1343602559 0 0) 0x7efca8003530 con 0x7efcc0159690 2023-06-10T19:08:20.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.524+0000 7efcbe7fc640 1 -- 172.21.15.53:0/2574344119 >> v2:172.21.15.117:3300/0 conn(0x7efcc00b0f30 msgr2=0x7efcc0070950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:20.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.524+0000 7efcbe7fc640 1 --2- 172.21.15.53:0/2574344119 >> v2:172.21.15.117:3300/0 conn(0x7efcc00b0f30 0x7efcc0070950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:20.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.524+0000 7efcbe7fc640 1 -- 172.21.15.53:0/2574344119 >> v1:172.21.15.117:6789/0 conn(0x7efcc0159a60 legacy=0x7efcc00c2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:20.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.524+0000 7efcbe7fc640 1 -- 172.21.15.53:0/2574344119 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcc00cb600 con 0x7efcc0159690 2023-06-10T19:08:20.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.524+0000 7efcbe7fc640 1 -- 172.21.15.53:0/2574344119 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7efcb8001a00 con 0x7efcc0159690 2023-06-10T19:08:20.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.524+0000 7efcbe7fc640 1 -- 172.21.15.53:0/2574344119 >> v1:172.21.15.53:6789/0 conn(0x7efcc0159690 legacy=0x7efcc00cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:20.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.524+0000 7efcbe7fc640 1 --2- 172.21.15.53:0/2574344119 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efca8003980 0x7efca8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:20.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.524+0000 7efcbe7fc640 1 --2- 172.21.15.53:0/2574344119 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efca80047d0 0x7efca8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:20.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.524+0000 7efcbe7fc640 1 --2- 172.21.15.53:0/2574344119 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efca8005180 0x7efca800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:20.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.524+0000 7efcbe7fc640 1 -- 172.21.15.53:0/2574344119 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcc0070e90 con 0x7efca80047d0 2023-06-10T19:08:20.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.524+0000 7efcbe7fc640 1 -- 172.21.15.53:0/2574344119 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca800c000 con 0x7efca8003980 2023-06-10T19:08:20.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.524+0000 7efcbe7fc640 1 -- 172.21.15.53:0/2574344119 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efca800c1c0 con 0x7efca8005180 2023-06-10T19:08:20.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.524+0000 7efcbeffd640 1 --2- 172.21.15.53:0/2574344119 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efca80047d0 0x7efca8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:20.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.524+0000 7efcbf7fe640 1 --2- 172.21.15.53:0/2574344119 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efca8003980 0x7efca8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:20.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.524+0000 7efcbeffd640 1 -- 172.21.15.53:0/2574344119 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efca8005180 msgr2=0x7efca800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:20.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.524+0000 7efcbffff640 1 --2- 172.21.15.53:0/2574344119 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efca8005180 0x7efca800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:20.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.524+0000 7efcbeffd640 1 --2- 172.21.15.53:0/2574344119 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efca8005180 0x7efca800b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:20.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.524+0000 7efcbeffd640 1 -- 172.21.15.53:0/2574344119 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efca8003980 msgr2=0x7efca8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:20.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.524+0000 7efcbeffd640 1 --2- 172.21.15.53:0/2574344119 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efca8003980 0x7efca8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:20.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.524+0000 7efcbeffd640 1 -- 172.21.15.53:0/2574344119 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efca8003530 con 0x7efca80047d0 2023-06-10T19:08:20.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.524+0000 7efcbffff640 1 -- 172.21.15.53:0/2574344119 reap_dead start 2023-06-10T19:08:20.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.528+0000 7efcbeffd640 1 --2- 172.21.15.53:0/2574344119 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efca80047d0 0x7efca8004c40 secure :-1 s=READY pgs=2630 cs=0 l=1 rev1=1 crypto rx=0x7efcb4009ae0 tx=0x7efcb401ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83da8a22f1de29e9 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:20.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.528+0000 7efcbe7fc640 1 -- 172.21.15.53:0/2574344119 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb40a6460 con 0x7efca80047d0 2023-06-10T19:08:20.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.528+0000 7efcbe7fc640 1 -- 172.21.15.53:0/2574344119 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcb40a65c0 con 0x7efca80047d0 2023-06-10T19:08:20.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.528+0000 7efcbe7fc640 1 -- 172.21.15.53:0/2574344119 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb40a6970 con 0x7efca80047d0 2023-06-10T19:08:20.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.528+0000 7efcc6213640 1 -- 172.21.15.53:0/2574344119 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efca80047d0 msgr2=0x7efca8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:20.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.528+0000 7efcc6213640 1 --2- 172.21.15.53:0/2574344119 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efca80047d0 0x7efca8004c40 secure :-1 s=READY pgs=2630 cs=0 l=1 rev1=1 crypto rx=0x7efcb4009ae0 tx=0x7efcb401ca50 comp rx=0 tx=0).stop 2023-06-10T19:08:20.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.528+0000 7efcc6213640 1 -- 172.21.15.53:0/2574344119 shutdown_connections 2023-06-10T19:08:20.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.528+0000 7efcc6213640 1 --2- 172.21.15.53:0/2574344119 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efca80047d0 0x7efca8004c40 unknown :-1 s=CLOSED pgs=2630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:20.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.528+0000 7efcc6213640 1 -- 172.21.15.53:0/2574344119 >> 172.21.15.53:0/2574344119 conn(0x7efcc006a560 msgr2=0x7efcc006a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:20.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.528+0000 7efcc6213640 1 -- 172.21.15.53:0/2574344119 shutdown_connections 2023-06-10T19:08:20.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.528+0000 7efcc6213640 1 -- 172.21.15.53:0/2574344119 wait complete. 2023-06-10T19:08:20.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.528+0000 7efcc6213640 1 Processor -- start 2023-06-10T19:08:20.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.532+0000 7efcc6213640 1 -- start start 2023-06-10T19:08:20.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.532+0000 7efcc6213640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efca80047d0 0x7efcc00b2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:20.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.532+0000 7efcc6213640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efcc00b43e0 0x7efcc00c8820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:20.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.532+0000 7efcc6213640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efcc00afbf0 0x7efcc01ee470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:20.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.532+0000 7efcc6213640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcc00b2ec0 con 0x7efcc00b43e0 2023-06-10T19:08:20.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.532+0000 7efcc6213640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcc00b48e0 con 0x7efca80047d0 2023-06-10T19:08:20.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.532+0000 7efcc6213640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcc00b1be0 con 0x7efcc00afbf0 2023-06-10T19:08:20.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.532+0000 7efcbeffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efcc00b43e0 0x7efcc00c8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:20.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.532+0000 7efcbeffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efcc00b43e0 0x7efcc00c8820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45622/0 (socket says 172.21.15.53:45622) 2023-06-10T19:08:20.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.532+0000 7efcbeffd640 1 -- 172.21.15.53:0/2600748724 learned_addr learned my addr 172.21.15.53:0/2600748724 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:08:20.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.532+0000 7efcbffff640 1 --2- 172.21.15.53:0/2600748724 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efcc00afbf0 0x7efcc01ee470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:20.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.532+0000 7efcbf7fe640 1 --2- 172.21.15.53:0/2600748724 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efca80047d0 0x7efcc00b2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:20.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.532+0000 7efcbeffd640 1 -- 172.21.15.53:0/2600748724 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efcc00afbf0 msgr2=0x7efcc01ee470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:20.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.532+0000 7efcbeffd640 1 --2- 172.21.15.53:0/2600748724 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efcc00afbf0 0x7efcc01ee470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:20.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.532+0000 7efcbeffd640 1 -- 172.21.15.53:0/2600748724 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efca80047d0 msgr2=0x7efcc00b2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:20.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.532+0000 7efcbeffd640 1 --2- 172.21.15.53:0/2600748724 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efca80047d0 0x7efcc00b2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:20.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.532+0000 7efcbeffd640 1 -- 172.21.15.53:0/2600748724 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcc00b1ec0 con 0x7efcc00b43e0 2023-06-10T19:08:20.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.532+0000 7efcbffff640 1 --2- 172.21.15.53:0/2600748724 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efcc00afbf0 0x7efcc01ee470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:08:20.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.532+0000 7efcbeffd640 1 --2- 172.21.15.53:0/2600748724 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efcc00b43e0 0x7efcc00c8820 secure :-1 s=READY pgs=2631 cs=0 l=1 rev1=1 crypto rx=0x7efcb4009ae0 tx=0x7efcb40197f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:20.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.532+0000 7efca7fff640 1 -- 172.21.15.53:0/2600748724 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb40b9640 con 0x7efcc00b43e0 2023-06-10T19:08:20.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.532+0000 7efca7fff640 1 -- 172.21.15.53:0/2600748724 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcb40b97a0 con 0x7efcc00b43e0 2023-06-10T19:08:20.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.532+0000 7efca7fff640 1 -- 172.21.15.53:0/2600748724 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb40b9b10 con 0x7efcc00b43e0 2023-06-10T19:08:20.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.532+0000 7efcc6213640 1 -- 172.21.15.53:0/2600748724 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcc00b21a0 con 0x7efcc00b43e0 2023-06-10T19:08:20.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.532+0000 7efcc6213640 1 -- 172.21.15.53:0/2600748724 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcc00c8d60 con 0x7efcc00b43e0 2023-06-10T19:08:20.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.532+0000 7efcc6213640 1 -- 172.21.15.53:0/2600748724 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcc00b1d20 con 0x7efcc00b43e0 2023-06-10T19:08:20.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.532+0000 7efca7fff640 1 -- 172.21.15.53:0/2600748724 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7efcb40a7440 con 0x7efcc00b43e0 2023-06-10T19:08:20.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.532+0000 7efca7fff640 1 --2- 172.21.15.53:0/2600748724 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efcac066280 0x7efcac068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:20.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.532+0000 7efca7fff640 1 -- 172.21.15.53:0/2600748724 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efcb411e730 con 0x7efcc00b43e0 2023-06-10T19:08:20.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.536+0000 7efcbf7fe640 1 --2- 172.21.15.53:0/2600748724 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efcac066280 0x7efcac068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:20.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.536+0000 7efcbf7fe640 1 --2- 172.21.15.53:0/2600748724 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efcac066280 0x7efcac068730 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7efcb8005720 tx=0x7efcb8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:20.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.540+0000 7efca7fff640 1 -- 172.21.15.53:0/2600748724 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7efcc00b1d20 con 0x7efcc00b43e0 2023-06-10T19:08:20.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.696+0000 7efcc6213640 1 -- 172.21.15.53:0/2600748724 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7efcc00b1d20 con 0x7efcc00b43e0 2023-06-10T19:08:20.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.696+0000 7efca7fff640 1 -- 172.21.15.53:0/2600748724 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v180) v1 ==== 92+0+10 (secure 0 0 0) 0x7efcc00b1d20 con 0x7efcc00b43e0 2023-06-10T19:08:20.700 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-06-10T19:08:20.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.696+0000 7efcc6213640 1 -- 172.21.15.53:0/2600748724 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efcac066280 msgr2=0x7efcac068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:20.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.696+0000 7efcc6213640 1 --2- 172.21.15.53:0/2600748724 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efcac066280 0x7efcac068730 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7efcb8005720 tx=0x7efcb8009040 comp rx=0 tx=0).stop 2023-06-10T19:08:20.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.696+0000 7efcc6213640 1 -- 172.21.15.53:0/2600748724 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efcc00b43e0 msgr2=0x7efcc00c8820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:20.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.696+0000 7efcc6213640 1 --2- 172.21.15.53:0/2600748724 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efcc00b43e0 0x7efcc00c8820 secure :-1 s=READY pgs=2631 cs=0 l=1 rev1=1 crypto rx=0x7efcb4009ae0 tx=0x7efcb40197f0 comp rx=0 tx=0).stop 2023-06-10T19:08:20.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.696+0000 7efcc6213640 1 -- 172.21.15.53:0/2600748724 shutdown_connections 2023-06-10T19:08:20.703 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.696+0000 7efcc6213640 1 --2- 172.21.15.53:0/2600748724 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efcac066280 0x7efcac068730 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:20.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.696+0000 7efcc6213640 1 --2- 172.21.15.53:0/2600748724 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efcc00afbf0 0x7efcc01ee470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:20.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.696+0000 7efcc6213640 1 --2- 172.21.15.53:0/2600748724 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efcc00b43e0 0x7efcc00c8820 unknown :-1 s=CLOSED pgs=2631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:20.704 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.696+0000 7efcc6213640 1 --2- 172.21.15.53:0/2600748724 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efca80047d0 0x7efcc00b2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:20.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.696+0000 7efcc6213640 1 -- 172.21.15.53:0/2600748724 >> 172.21.15.53:0/2600748724 conn(0x7efcc006a560 msgr2=0x7efcc00cf590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:20.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.696+0000 7efcc6213640 1 -- 172.21.15.53:0/2600748724 shutdown_connections 2023-06-10T19:08:20.705 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.696+0000 7efcc6213640 1 -- 172.21.15.53:0/2600748724 wait complete. 2023-06-10T19:08:20.724 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-10T19:08:20.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.848+0000 7f117f135640 1 Processor -- start 2023-06-10T19:08:20.854 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.848+0000 7f117f135640 1 -- start start 2023-06-10T19:08:20.855 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.852+0000 7f117f135640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11781558e0 0x7f11780c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:20.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.852+0000 7f117f135640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1178158f40 0x7f11780cb820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:20.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.852+0000 7f117f135640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f117806c230 con 0x7f11780cbd60 2023-06-10T19:08:20.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.852+0000 7f117f135640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f117806ca40 con 0x7f1178158f40 2023-06-10T19:08:20.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.852+0000 7f117f135640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1178155cb0 con 0x7f11781558e0 2023-06-10T19:08:20.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.852+0000 7f117d6d2640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f11780cbd60 0x7f117806b6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52274/0 (socket says 172.21.15.53:52274) 2023-06-10T19:08:20.856 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.852+0000 7f117d6d2640 1 -- 172.21.15.53:0/260811109 learned_addr learned my addr 172.21.15.53:0/260811109 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:08:20.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.852+0000 7f1177fff640 1 --2- 172.21.15.53:0/260811109 >> v2:172.21.15.53:3300/0 conn(0x7f1178158f40 0x7f11780cb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:20.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.852+0000 7f117ced1640 1 --2- 172.21.15.53:0/260811109 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11781558e0 0x7f11780c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:20.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.852+0000 7f11777fe640 1 -- 172.21.15.53:0/260811109 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2861695497 0 0) 0x7f117806c230 con 0x7f11780cbd60 2023-06-10T19:08:20.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.852+0000 7f11777fe640 1 -- 172.21.15.53:0/260811109 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1160003530 con 0x7f11780cbd60 2023-06-10T19:08:20.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.852+0000 7f1177fff640 1 -- 172.21.15.53:0/260811109 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11781558e0 msgr2=0x7f11780c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:20.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.852+0000 7f11777fe640 1 -- 172.21.15.53:0/260811109 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4064345496 0 0) 0x7f1160003530 con 0x7f11780cbd60 2023-06-10T19:08:20.857 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.852+0000 7f1177fff640 1 --2- 172.21.15.53:0/260811109 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11781558e0 0x7f11780c82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:20.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.852+0000 7f1177fff640 1 -- 172.21.15.53:0/260811109 >> v1:172.21.15.53:6789/0 conn(0x7f11780cbd60 legacy=0x7f117806b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:20.858 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.852+0000 7f1177fff640 1 -- 172.21.15.53:0/260811109 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f117806c480 con 0x7f1178158f40 2023-06-10T19:08:20.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.852+0000 7f1177fff640 1 --2- 172.21.15.53:0/260811109 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1178158f40 0x7f11780cb820 secure :-1 s=READY pgs=2633 cs=0 l=1 rev1=1 crypto rx=0x7f116c0097c0 tx=0x7f116c01c250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f323456d54c59dc server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:20.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.852+0000 7f11777fe640 1 -- 172.21.15.53:0/260811109 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1170001a00 con 0x7f1178158f40 2023-06-10T19:08:20.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.852+0000 7f11777fe640 1 -- 172.21.15.53:0/260811109 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f116c0a7050 con 0x7f1178158f40 2023-06-10T19:08:20.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.852+0000 7f11777fe640 1 -- 172.21.15.53:0/260811109 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116c0ab620 con 0x7f1178158f40 2023-06-10T19:08:20.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.856+0000 7f117f135640 1 -- 172.21.15.53:0/260811109 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1178158f40 msgr2=0x7f11780cb820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:20.859 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.856+0000 7f117f135640 1 --2- 172.21.15.53:0/260811109 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1178158f40 0x7f11780cb820 secure :-1 s=READY pgs=2633 cs=0 l=1 rev1=1 crypto rx=0x7f116c0097c0 tx=0x7f116c01c250 comp rx=0 tx=0).stop 2023-06-10T19:08:20.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.856+0000 7f117f135640 1 -- 172.21.15.53:0/260811109 shutdown_connections 2023-06-10T19:08:20.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.856+0000 7f117f135640 1 --2- 172.21.15.53:0/260811109 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1178158f40 0x7f11780cb820 unknown :-1 s=CLOSED pgs=2633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:20.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.856+0000 7f117f135640 1 --2- 172.21.15.53:0/260811109 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11781558e0 0x7f11780c82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:20.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.856+0000 7f117f135640 1 -- 172.21.15.53:0/260811109 >> 172.21.15.53:0/260811109 conn(0x7f117806a0e0 msgr2=0x7f11780cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:20.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.856+0000 7f117f135640 1 -- 172.21.15.53:0/260811109 shutdown_connections 2023-06-10T19:08:20.860 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.856+0000 7f117f135640 1 -- 172.21.15.53:0/260811109 wait complete. 2023-06-10T19:08:20.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.856+0000 7f117f135640 1 Processor -- start 2023-06-10T19:08:20.861 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.856+0000 7f117f135640 1 -- start start 2023-06-10T19:08:20.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.856+0000 7f117f135640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f11780cbd60 0x7f1178148aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:20.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.856+0000 7f117f135640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11781558e0 0x7f117814fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:20.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.856+0000 7f117f135640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1178158f40 0x7f117815a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:20.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.856+0000 7f117f135640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f117814c7f0 con 0x7f11780cbd60 2023-06-10T19:08:20.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.856+0000 7f117f135640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1178159480 con 0x7f1178158f40 2023-06-10T19:08:20.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.856+0000 7f117f135640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1178159760 con 0x7f11781558e0 2023-06-10T19:08:20.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.856+0000 7f117ced1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f11780cbd60 0x7f1178148aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:20.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.856+0000 7f117ced1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f11780cbd60 0x7f1178148aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45646/0 (socket says 172.21.15.53:45646) 2023-06-10T19:08:20.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.856+0000 7f117ced1640 1 -- 172.21.15.53:0/1008274548 learned_addr learned my addr 172.21.15.53:0/1008274548 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:08:20.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.856+0000 7f1177fff640 1 --2- 172.21.15.53:0/1008274548 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11781558e0 0x7f117814fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:20.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.856+0000 7f117d6d2640 1 --2- 172.21.15.53:0/1008274548 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1178158f40 0x7f117815a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:20.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.856+0000 7f117ced1640 1 -- 172.21.15.53:0/1008274548 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11781558e0 msgr2=0x7f117814fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:20.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.856+0000 7f117ced1640 1 --2- 172.21.15.53:0/1008274548 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11781558e0 0x7f117814fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:20.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.856+0000 7f117ced1640 1 -- 172.21.15.53:0/1008274548 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1178158f40 msgr2=0x7f117815a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:20.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.856+0000 7f117ced1640 1 --2- 172.21.15.53:0/1008274548 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1178158f40 0x7f117815a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:20.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.856+0000 7f117ced1640 1 -- 172.21.15.53:0/1008274548 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f116c009420 con 0x7f11780cbd60 2023-06-10T19:08:20.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.856+0000 7f1177fff640 1 --2- 172.21.15.53:0/1008274548 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11781558e0 0x7f117814fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:08:20.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.856+0000 7f117ced1640 1 --2- 172.21.15.53:0/1008274548 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f11780cbd60 0x7f1178148aa0 secure :-1 s=READY pgs=2634 cs=0 l=1 rev1=1 crypto rx=0x7f116800e870 tx=0x7f116800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:20.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.856+0000 7f11757fa640 1 -- 172.21.15.53:0/1008274548 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1168009510 con 0x7f11780cbd60 2023-06-10T19:08:20.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.856+0000 7f11757fa640 1 -- 172.21.15.53:0/1008274548 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f116800eec0 con 0x7f11780cbd60 2023-06-10T19:08:20.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.856+0000 7f11757fa640 1 -- 172.21.15.53:0/1008274548 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116800cb40 con 0x7f11780cbd60 2023-06-10T19:08:20.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.860+0000 7f117f135640 1 -- 172.21.15.53:0/1008274548 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1178159a40 con 0x7f11780cbd60 2023-06-10T19:08:20.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.860+0000 7f117f135640 1 -- 172.21.15.53:0/1008274548 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1178150140 con 0x7f11780cbd60 2023-06-10T19:08:20.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.860+0000 7f117f135640 1 -- 172.21.15.53:0/1008274548 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f117804d790 con 0x7f11780cbd60 2023-06-10T19:08:20.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.860+0000 7f11757fa640 1 -- 172.21.15.53:0/1008274548 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f116800cca0 con 0x7f11780cbd60 2023-06-10T19:08:20.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.860+0000 7f11757fa640 1 --2- 172.21.15.53:0/1008274548 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1164066280 0x7f1164068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:20.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.860+0000 7f11757fa640 1 -- 172.21.15.53:0/1008274548 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1168083db0 con 0x7f11780cbd60 2023-06-10T19:08:20.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.860+0000 7f1177fff640 1 --2- 172.21.15.53:0/1008274548 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1164066280 0x7f1164068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:20.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.860+0000 7f1177fff640 1 --2- 172.21.15.53:0/1008274548 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1164066280 0x7f1164068730 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f116c0ad000 tx=0x7f116c0a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:20.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:20.864+0000 7f11757fa640 1 -- 172.21.15.53:0/1008274548 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f11680512c0 con 0x7f11780cbd60 2023-06-10T19:08:21.020 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.016+0000 7f117f135640 1 -- 172.21.15.53:0/1008274548 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f11780b3c60 con 0x7f11780cbd60 2023-06-10T19:08:21.021 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.016+0000 7f11757fa640 1 -- 172.21.15.53:0/1008274548 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v180) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1168017020 con 0x7f11780cbd60 2023-06-10T19:08:21.021 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-06-10T19:08:21.023 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.020+0000 7f117f135640 1 -- 172.21.15.53:0/1008274548 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1164066280 msgr2=0x7f1164068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:21.023 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.020+0000 7f117f135640 1 --2- 172.21.15.53:0/1008274548 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1164066280 0x7f1164068730 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f116c0ad000 tx=0x7f116c0a6000 comp rx=0 tx=0).stop 2023-06-10T19:08:21.024 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.020+0000 7f117f135640 1 -- 172.21.15.53:0/1008274548 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f11780cbd60 msgr2=0x7f1178148aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:21.024 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.020+0000 7f117f135640 1 --2- 172.21.15.53:0/1008274548 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f11780cbd60 0x7f1178148aa0 secure :-1 s=READY pgs=2634 cs=0 l=1 rev1=1 crypto rx=0x7f116800e870 tx=0x7f116800ec70 comp rx=0 tx=0).stop 2023-06-10T19:08:21.024 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.020+0000 7f117f135640 1 -- 172.21.15.53:0/1008274548 shutdown_connections 2023-06-10T19:08:21.024 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.020+0000 7f117f135640 1 --2- 172.21.15.53:0/1008274548 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1164066280 0x7f1164068730 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:21.024 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.020+0000 7f117f135640 1 --2- 172.21.15.53:0/1008274548 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1178158f40 0x7f117815a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:21.024 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.020+0000 7f117f135640 1 --2- 172.21.15.53:0/1008274548 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11781558e0 0x7f117814fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:21.024 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.020+0000 7f117f135640 1 --2- 172.21.15.53:0/1008274548 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f11780cbd60 0x7f1178148aa0 unknown :-1 s=CLOSED pgs=2634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:21.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.020+0000 7f117f135640 1 -- 172.21.15.53:0/1008274548 >> 172.21.15.53:0/1008274548 conn(0x7f117806a0e0 msgr2=0x7f11781532a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:21.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.020+0000 7f117f135640 1 -- 172.21.15.53:0/1008274548 shutdown_connections 2023-06-10T19:08:21.025 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.020+0000 7f117f135640 1 -- 172.21.15.53:0/1008274548 wait complete. 2023-06-10T19:08:21.040 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-10T19:08:21.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.160+0000 7f48b31f6640 1 Processor -- start 2023-06-10T19:08:21.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.160+0000 7f48b31f6640 1 -- start start 2023-06-10T19:08:21.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.160+0000 7f48b31f6640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f48ac15c7f0 0x7f48ac15f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:21.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.160+0000 7f48b31f6640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f48ac15f860 0x7f48ac0ceb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:21.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.160+0000 7f48b31f6640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48ac15cc40 con 0x7f48ac06b780 2023-06-10T19:08:21.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.160+0000 7f48b31f6640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48ac15c3d0 con 0x7f48ac15c7f0 2023-06-10T19:08:21.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.160+0000 7f48b31f6640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48ac0af530 con 0x7f48ac15f860 2023-06-10T19:08:21.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.160+0000 7f48b0f92640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f48ac06b780 0x7f48ac06bb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52286/0 (socket says 172.21.15.53:52286) 2023-06-10T19:08:21.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.160+0000 7f48abfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f48ac15c7f0 0x7f48ac15f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:21.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.160+0000 7f48b0f92640 1 -- 172.21.15.53:0/1736585300 learned_addr learned my addr 172.21.15.53:0/1736585300 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:08:21.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.160+0000 7f48b1793640 1 --2- 172.21.15.53:0/1736585300 >> v2:172.21.15.117:3300/0 conn(0x7f48ac15f860 0x7f48ac0ceb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:21.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.160+0000 7f48abfff640 1 -- 172.21.15.53:0/1736585300 >> v2:172.21.15.117:3300/0 conn(0x7f48ac15f860 msgr2=0x7f48ac0ceb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:21.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.160+0000 7f48abfff640 1 --2- 172.21.15.53:0/1736585300 >> v2:172.21.15.117:3300/0 conn(0x7f48ac15f860 0x7f48ac0ceb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:21.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.160+0000 7f48abfff640 1 -- 172.21.15.53:0/1736585300 >> v1:172.21.15.53:6789/0 conn(0x7f48ac06b780 legacy=0x7f48ac06bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:21.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.160+0000 7f48abfff640 1 -- 172.21.15.53:0/1736585300 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48ac15fd70 con 0x7f48ac15c7f0 2023-06-10T19:08:21.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.164+0000 7f48abfff640 1 --2- 172.21.15.53:0/1736585300 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48ac15c7f0 0x7f48ac15f320 secure :-1 s=READY pgs=2636 cs=0 l=1 rev1=1 crypto rx=0x7f48ac070730 tx=0x7f48a001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6baece3e94135044 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:21.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.164+0000 7f48ab7fe640 1 -- 172.21.15.53:0/1736585300 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a00ac630 con 0x7f48ac15c7f0 2023-06-10T19:08:21.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.164+0000 7f48ab7fe640 1 -- 172.21.15.53:0/1736585300 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48a00ac790 con 0x7f48ac15c7f0 2023-06-10T19:08:21.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.164+0000 7f48ab7fe640 1 -- 172.21.15.53:0/1736585300 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a00acb20 con 0x7f48ac15c7f0 2023-06-10T19:08:21.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.164+0000 7f48b31f6640 1 -- 172.21.15.53:0/1736585300 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48ac15c7f0 msgr2=0x7f48ac15f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:21.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.164+0000 7f48b31f6640 1 --2- 172.21.15.53:0/1736585300 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48ac15c7f0 0x7f48ac15f320 secure :-1 s=READY pgs=2636 cs=0 l=1 rev1=1 crypto rx=0x7f48ac070730 tx=0x7f48a001c3d0 comp rx=0 tx=0).stop 2023-06-10T19:08:21.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.164+0000 7f48b31f6640 1 -- 172.21.15.53:0/1736585300 shutdown_connections 2023-06-10T19:08:21.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.164+0000 7f48b31f6640 1 --2- 172.21.15.53:0/1736585300 >> v2:172.21.15.117:3300/0 conn(0x7f48ac15f860 0x7f48ac0ceb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:21.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.164+0000 7f48b31f6640 1 --2- 172.21.15.53:0/1736585300 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48ac15c7f0 0x7f48ac15f320 unknown :-1 s=CLOSED pgs=2636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:21.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.164+0000 7f48b31f6640 1 -- 172.21.15.53:0/1736585300 >> 172.21.15.53:0/1736585300 conn(0x7f48ac06a090 msgr2=0x7f48ac06d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:21.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.164+0000 7f48b31f6640 1 -- 172.21.15.53:0/1736585300 shutdown_connections 2023-06-10T19:08:21.169 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.164+0000 7f48b31f6640 1 -- 172.21.15.53:0/1736585300 wait complete. 2023-06-10T19:08:21.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.164+0000 7f48b31f6640 1 Processor -- start 2023-06-10T19:08:21.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.164+0000 7f48b31f6640 1 -- start start 2023-06-10T19:08:21.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.164+0000 7f48b31f6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48ac06b780 0x7f48ac0c6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:21.171 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.164+0000 7f48b31f6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48ac15c7f0 0x7f48ac0c49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:21.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.164+0000 7f48b31f6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48ac15f860 0x7f48ac158140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:21.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.164+0000 7f48b31f6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48ac0c5070 con 0x7f48ac15f860 2023-06-10T19:08:21.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.164+0000 7f48b31f6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48ac0c5350 con 0x7f48ac15c7f0 2023-06-10T19:08:21.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.164+0000 7f48b31f6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48ac0c5630 con 0x7f48ac06b780 2023-06-10T19:08:21.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.164+0000 7f48b1793640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48ac15f860 0x7f48ac158140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:21.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.164+0000 7f48b1793640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48ac15f860 0x7f48ac158140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45654/0 (socket says 172.21.15.53:45654) 2023-06-10T19:08:21.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.164+0000 7f48b1793640 1 -- 172.21.15.53:0/1748051469 learned_addr learned my addr 172.21.15.53:0/1748051469 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:08:21.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.168+0000 7f48b0f92640 1 --2- 172.21.15.53:0/1748051469 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48ac06b780 0x7f48ac0c6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:21.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.168+0000 7f48abfff640 1 --2- 172.21.15.53:0/1748051469 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48ac15c7f0 0x7f48ac0c49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:21.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.168+0000 7f48b1793640 1 -- 172.21.15.53:0/1748051469 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48ac06b780 msgr2=0x7f48ac0c6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:21.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.168+0000 7f48b1793640 1 --2- 172.21.15.53:0/1748051469 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48ac06b780 0x7f48ac0c6110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:21.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.168+0000 7f48b1793640 1 -- 172.21.15.53:0/1748051469 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48ac15c7f0 msgr2=0x7f48ac0c49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:21.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.168+0000 7f48b1793640 1 --2- 172.21.15.53:0/1748051469 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48ac15c7f0 0x7f48ac0c49e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:21.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.168+0000 7f48b1793640 1 -- 172.21.15.53:0/1748051469 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a0009420 con 0x7f48ac15f860 2023-06-10T19:08:21.173 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.168+0000 7f48b1793640 1 --2- 172.21.15.53:0/1748051469 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48ac15f860 0x7f48ac158140 secure :-1 s=READY pgs=2637 cs=0 l=1 rev1=1 crypto rx=0x7f489c00d5d0 tx=0x7f489c00da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:21.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.168+0000 7f48a97fa640 1 -- 172.21.15.53:0/1748051469 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489c0125f0 con 0x7f48ac15f860 2023-06-10T19:08:21.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.168+0000 7f48a97fa640 1 -- 172.21.15.53:0/1748051469 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f489c012770 con 0x7f48ac15f860 2023-06-10T19:08:21.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.168+0000 7f48b31f6640 1 -- 172.21.15.53:0/1748051469 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48ac0c5910 con 0x7f48ac15f860 2023-06-10T19:08:21.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.168+0000 7f48a97fa640 1 -- 172.21.15.53:0/1748051469 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489c012b20 con 0x7f48ac15f860 2023-06-10T19:08:21.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.168+0000 7f48b31f6640 1 -- 172.21.15.53:0/1748051469 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48ac158fd0 con 0x7f48ac15f860 2023-06-10T19:08:21.175 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.168+0000 7f48b31f6640 1 -- 172.21.15.53:0/1748051469 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48ac04d790 con 0x7f48ac15f860 2023-06-10T19:08:21.175 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.168+0000 7f48a97fa640 1 -- 172.21.15.53:0/1748051469 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f489c012c80 con 0x7f48ac15f860 2023-06-10T19:08:21.175 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.168+0000 7f48a97fa640 1 --2- 172.21.15.53:0/1748051469 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4898066280 0x7f4898068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:21.175 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.168+0000 7f48a97fa640 1 -- 172.21.15.53:0/1748051469 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f489c084200 con 0x7f48ac15f860 2023-06-10T19:08:21.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.168+0000 7f48b0f92640 1 --2- 172.21.15.53:0/1748051469 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4898066280 0x7f4898068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:21.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.168+0000 7f48b0f92640 1 --2- 172.21.15.53:0/1748051469 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4898066280 0x7f4898068730 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f48a4005c10 tx=0x7f48a4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:21.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.172+0000 7f48a97fa640 1 -- 172.21.15.53:0/1748051469 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f489c051710 con 0x7f48ac15f860 2023-06-10T19:08:21.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.324+0000 7f48b31f6640 1 -- 172.21.15.53:0/1748051469 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f48ac0c5dc0 con 0x7f48ac15f860 2023-06-10T19:08:21.329 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.324+0000 7f48a97fa640 1 -- 172.21.15.53:0/1748051469 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v180) v1 ==== 100+0+11 (secure 0 0 0) 0x7f489c054d30 con 0x7f48ac15f860 2023-06-10T19:08:21.329 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-06-10T19:08:21.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.328+0000 7f48b31f6640 1 -- 172.21.15.53:0/1748051469 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4898066280 msgr2=0x7f4898068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:21.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.328+0000 7f48b31f6640 1 --2- 172.21.15.53:0/1748051469 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4898066280 0x7f4898068730 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f48a4005c10 tx=0x7f48a4009040 comp rx=0 tx=0).stop 2023-06-10T19:08:21.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.328+0000 7f48b31f6640 1 -- 172.21.15.53:0/1748051469 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48ac15f860 msgr2=0x7f48ac158140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:21.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.328+0000 7f48b31f6640 1 --2- 172.21.15.53:0/1748051469 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48ac15f860 0x7f48ac158140 secure :-1 s=READY pgs=2637 cs=0 l=1 rev1=1 crypto rx=0x7f489c00d5d0 tx=0x7f489c00da90 comp rx=0 tx=0).stop 2023-06-10T19:08:21.331 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.328+0000 7f48b31f6640 1 -- 172.21.15.53:0/1748051469 shutdown_connections 2023-06-10T19:08:21.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.328+0000 7f48b31f6640 1 --2- 172.21.15.53:0/1748051469 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4898066280 0x7f4898068730 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:21.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.328+0000 7f48b31f6640 1 --2- 172.21.15.53:0/1748051469 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48ac15f860 0x7f48ac158140 unknown :-1 s=CLOSED pgs=2637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:21.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.328+0000 7f48b31f6640 1 --2- 172.21.15.53:0/1748051469 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48ac15c7f0 0x7f48ac0c49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:21.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.328+0000 7f48b31f6640 1 --2- 172.21.15.53:0/1748051469 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f48ac06b780 0x7f48ac0c6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:21.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.328+0000 7f48b31f6640 1 -- 172.21.15.53:0/1748051469 >> 172.21.15.53:0/1748051469 conn(0x7f48ac06a090 msgr2=0x7f48ac0afbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:21.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.328+0000 7f48b31f6640 1 -- 172.21.15.53:0/1748051469 shutdown_connections 2023-06-10T19:08:21.332 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.328+0000 7f48b31f6640 1 -- 172.21.15.53:0/1748051469 wait complete. 2023-06-10T19:08:21.348 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-10T19:08:21.463 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.460+0000 7f75fd69a640 1 Processor -- start 2023-06-10T19:08:21.464 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.460+0000 7f75fd69a640 1 -- start start 2023-06-10T19:08:21.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.460+0000 7f75fd69a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f75f80d1b00 0x7f75f80d07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:21.466 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.460+0000 7f75fd69a640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75f80ccde0 con 0x7f75f80b3ac0 2023-06-10T19:08:21.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.460+0000 7f75fd69a640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75f80ced00 con 0x7f75f80cc690 2023-06-10T19:08:21.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.460+0000 7f75fd69a640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75f80cfc10 con 0x7f75f80d1b00 2023-06-10T19:08:21.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.460+0000 7f75f77fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f75f80d1b00 0x7f75f80d07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:21.467 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.460+0000 7f75f6ffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f75f80b3ac0 0x7f75f80b3e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:43368/0 (socket says 172.21.15.53:43368) 2023-06-10T19:08:21.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.460+0000 7f75f6ffd640 1 -- 172.21.15.53:0/2591324995 learned_addr learned my addr 172.21.15.53:0/2591324995 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:08:21.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.460+0000 7f75f5ffb640 1 -- 172.21.15.53:0/2591324995 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2686633984 0 0) 0x7f75f80ccde0 con 0x7f75f80b3ac0 2023-06-10T19:08:21.468 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.460+0000 7f75f5ffb640 1 -- 172.21.15.53:0/2591324995 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75e0003530 con 0x7f75f80b3ac0 2023-06-10T19:08:21.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.460+0000 7f75f77fe640 1 -- 172.21.15.53:0/2591324995 >> v1:172.21.15.117:6789/0 conn(0x7f75f80cc690 legacy=0x7f75f80d00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:21.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.460+0000 7f75f77fe640 1 -- 172.21.15.53:0/2591324995 >> v1:172.21.15.53:6789/0 conn(0x7f75f80b3ac0 legacy=0x7f75f80b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:21.469 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.460+0000 7f75f77fe640 1 -- 172.21.15.53:0/2591324995 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75f80b7b50 con 0x7f75f80d1b00 2023-06-10T19:08:21.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.464+0000 7f75f77fe640 1 --2- 172.21.15.53:0/2591324995 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f75f80d1b00 0x7f75f80d07b0 secure :-1 s=READY pgs=2639 cs=0 l=1 rev1=1 crypto rx=0x7f75f0009d90 tx=0x7f75f80d1500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87fd14dad0d62db1 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:21.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.464+0000 7f75f5ffb640 1 -- 172.21.15.53:0/2591324995 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f00a58e0 con 0x7f75f80d1b00 2023-06-10T19:08:21.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.464+0000 7f75f5ffb640 1 -- 172.21.15.53:0/2591324995 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75f00a5a40 con 0x7f75f80d1b00 2023-06-10T19:08:21.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.464+0000 7f75f5ffb640 1 -- 172.21.15.53:0/2591324995 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f00a5dd0 con 0x7f75f80d1b00 2023-06-10T19:08:21.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.464+0000 7f75fd69a640 1 -- 172.21.15.53:0/2591324995 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f75f80d1b00 msgr2=0x7f75f80d07b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:21.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.464+0000 7f75fd69a640 1 --2- 172.21.15.53:0/2591324995 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f75f80d1b00 0x7f75f80d07b0 secure :-1 s=READY pgs=2639 cs=0 l=1 rev1=1 crypto rx=0x7f75f0009d90 tx=0x7f75f80d1500 comp rx=0 tx=0).stop 2023-06-10T19:08:21.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.464+0000 7f75fd69a640 1 -- 172.21.15.53:0/2591324995 shutdown_connections 2023-06-10T19:08:21.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.464+0000 7f75fd69a640 1 --2- 172.21.15.53:0/2591324995 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f75f80d1b00 0x7f75f80d07b0 unknown :-1 s=CLOSED pgs=2639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:21.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.464+0000 7f75fd69a640 1 -- 172.21.15.53:0/2591324995 >> 172.21.15.53:0/2591324995 conn(0x7f75f8069de0 msgr2=0x7f75f806a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:21.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.464+0000 7f75fd69a640 1 -- 172.21.15.53:0/2591324995 shutdown_connections 2023-06-10T19:08:21.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.464+0000 7f75fd69a640 1 -- 172.21.15.53:0/2591324995 wait complete. 2023-06-10T19:08:21.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.464+0000 7f75fd69a640 1 Processor -- start 2023-06-10T19:08:21.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.464+0000 7f75fd69a640 1 -- start start 2023-06-10T19:08:21.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.464+0000 7f75fd69a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75f80b3ac0 0x7f75f815dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:21.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.464+0000 7f75fd69a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75f80cc690 0x7f75f80cbf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:21.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.464+0000 7f75fd69a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f75f80d1b00 0x7f75f8153450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:21.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.464+0000 7f75fd69a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f80cc470 con 0x7f75f80d1b00 2023-06-10T19:08:21.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.464+0000 7f75fd69a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f80caf10 con 0x7f75f80cc690 2023-06-10T19:08:21.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.464+0000 7f75fd69a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75f80cb1b0 con 0x7f75f80b3ac0 2023-06-10T19:08:21.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.464+0000 7f75f77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f75f80d1b00 0x7f75f8153450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:21.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.464+0000 7f75f77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f75f80d1b00 0x7f75f8153450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48210/0 (socket says 172.21.15.53:48210) 2023-06-10T19:08:21.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.464+0000 7f75f77fe640 1 -- 172.21.15.53:0/2631496261 learned_addr learned my addr 172.21.15.53:0/2631496261 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:08:21.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.464+0000 7f75f6ffd640 1 --2- 172.21.15.53:0/2631496261 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75f80b3ac0 0x7f75f815dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:21.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.464+0000 7f75f77fe640 1 -- 172.21.15.53:0/2631496261 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75f80b3ac0 msgr2=0x7f75f815dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:21.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.464+0000 7f75f77fe640 1 --2- 172.21.15.53:0/2631496261 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75f80b3ac0 0x7f75f815dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:21.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.464+0000 7f75f77fe640 1 -- 172.21.15.53:0/2631496261 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75f80cc690 msgr2=0x7f75f80cbf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:21.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.464+0000 7f75f67fc640 1 --2- 172.21.15.53:0/2631496261 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75f80cc690 0x7f75f80cbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:21.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.464+0000 7f75f77fe640 1 --2- 172.21.15.53:0/2631496261 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75f80cc690 0x7f75f80cbf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:21.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.464+0000 7f75f77fe640 1 -- 172.21.15.53:0/2631496261 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75f0009a70 con 0x7f75f80d1b00 2023-06-10T19:08:21.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.468+0000 7f75f77fe640 1 --2- 172.21.15.53:0/2631496261 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f75f80d1b00 0x7f75f8153450 secure :-1 s=READY pgs=2640 cs=0 l=1 rev1=1 crypto rx=0x7f75f0019410 tx=0x7f75f00195a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:21.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.468+0000 7f75df7fe640 1 -- 172.21.15.53:0/2631496261 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f00ad850 con 0x7f75f80d1b00 2023-06-10T19:08:21.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.468+0000 7f75df7fe640 1 -- 172.21.15.53:0/2631496261 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75f00ad9b0 con 0x7f75f80d1b00 2023-06-10T19:08:21.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.468+0000 7f75fd69a640 1 -- 172.21.15.53:0/2631496261 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75f80c9a70 con 0x7f75f80d1b00 2023-06-10T19:08:21.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.468+0000 7f75df7fe640 1 -- 172.21.15.53:0/2631496261 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f00add60 con 0x7f75f80d1b00 2023-06-10T19:08:21.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.468+0000 7f75fd69a640 1 -- 172.21.15.53:0/2631496261 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75f80cb730 con 0x7f75f80d1b00 2023-06-10T19:08:21.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.468+0000 7f75fd69a640 1 -- 172.21.15.53:0/2631496261 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75f804d790 con 0x7f75f80d1b00 2023-06-10T19:08:21.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.468+0000 7f75df7fe640 1 -- 172.21.15.53:0/2631496261 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f75f00b4040 con 0x7f75f80d1b00 2023-06-10T19:08:21.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.468+0000 7f75df7fe640 1 --2- 172.21.15.53:0/2631496261 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f75e4066280 0x7f75e4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:21.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.468+0000 7f75df7fe640 1 -- 172.21.15.53:0/2631496261 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f75f011ec90 con 0x7f75f80d1b00 2023-06-10T19:08:21.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.468+0000 7f75f6ffd640 1 --2- 172.21.15.53:0/2631496261 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f75e4066280 0x7f75e4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:21.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.468+0000 7f75f6ffd640 1 --2- 172.21.15.53:0/2631496261 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f75e4066280 0x7f75e4068730 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f75e80011f0 tx=0x7f75e8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:21.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.472+0000 7f75df7fe640 1 -- 172.21.15.53:0/2631496261 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f75f00ec070 con 0x7f75f80d1b00 2023-06-10T19:08:21.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.636+0000 7f75fd69a640 1 -- 172.21.15.53:0/2631496261 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f75f806ac70 con 0x7f75f80d1b00 2023-06-10T19:08:21.642 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.640+0000 7f75df7fe640 1 -- 172.21.15.53:0/2631496261 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v180) v1 ==== 80+0+0 (secure 0 0 0) 0x7f75f00ef690 con 0x7f75f80d1b00 2023-06-10T19:08:21.642 INFO:teuthology.orchestra.run.smithi053.stderr:listed 0 entries 2023-06-10T19:08:21.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.640+0000 7f75fd69a640 1 -- 172.21.15.53:0/2631496261 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f75e4066280 msgr2=0x7f75e4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:21.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.640+0000 7f75fd69a640 1 --2- 172.21.15.53:0/2631496261 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f75e4066280 0x7f75e4068730 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f75e80011f0 tx=0x7f75e8009040 comp rx=0 tx=0).stop 2023-06-10T19:08:21.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.640+0000 7f75fd69a640 1 -- 172.21.15.53:0/2631496261 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f75f80d1b00 msgr2=0x7f75f8153450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:21.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.640+0000 7f75fd69a640 1 --2- 172.21.15.53:0/2631496261 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f75f80d1b00 0x7f75f8153450 secure :-1 s=READY pgs=2640 cs=0 l=1 rev1=1 crypto rx=0x7f75f0019410 tx=0x7f75f00195a0 comp rx=0 tx=0).stop 2023-06-10T19:08:21.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.640+0000 7f75fd69a640 1 -- 172.21.15.53:0/2631496261 shutdown_connections 2023-06-10T19:08:21.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.640+0000 7f75fd69a640 1 --2- 172.21.15.53:0/2631496261 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f75e4066280 0x7f75e4068730 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:21.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.640+0000 7f75fd69a640 1 --2- 172.21.15.53:0/2631496261 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f75f80d1b00 0x7f75f8153450 unknown :-1 s=CLOSED pgs=2640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:21.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.640+0000 7f75fd69a640 1 --2- 172.21.15.53:0/2631496261 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75f80cc690 0x7f75f80cbf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:21.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.640+0000 7f75fd69a640 1 --2- 172.21.15.53:0/2631496261 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75f80b3ac0 0x7f75f815dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:21.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.640+0000 7f75fd69a640 1 -- 172.21.15.53:0/2631496261 >> 172.21.15.53:0/2631496261 conn(0x7f75f8069de0 msgr2=0x7f75f81540d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:21.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.640+0000 7f75fd69a640 1 -- 172.21.15.53:0/2631496261 shutdown_connections 2023-06-10T19:08:21.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.640+0000 7f75fd69a640 1 -- 172.21.15.53:0/2631496261 wait complete. 2023-06-10T19:08:21.661 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T19:08:21.662 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:08:21.667 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:08:21.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.828+0000 7f456ccb6640 1 Processor -- start 2023-06-10T19:08:21.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.828+0000 7f456ccb6640 1 -- start start 2023-06-10T19:08:21.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.832+0000 7f456ccb6640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f45680cc690 0x7f45680d04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:21.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.832+0000 7f456ccb6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45680ccae0 0x7f45680d09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:21.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.832+0000 7f456ccb6640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45680d0020 con 0x7f45680b3ac0 2023-06-10T19:08:21.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.832+0000 7f456ccb6640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45680cef40 con 0x7f45680cc690 2023-06-10T19:08:21.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.832+0000 7f456ccb6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45680cf220 con 0x7f45680ccae0 2023-06-10T19:08:21.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.832+0000 7f4565d9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f45680cc690 0x7f45680d04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:21.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.832+0000 7f4565d9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f45680cc690 0x7f45680d04b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48226/0 (socket says 172.21.15.53:48226) 2023-06-10T19:08:21.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.832+0000 7f4565d9b640 1 -- 172.21.15.53:0/774625656 learned_addr learned my addr 172.21.15.53:0/774625656 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:08:21.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.832+0000 7f4566d9d640 1 --2- 172.21.15.53:0/774625656 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45680ccae0 0x7f45680d09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:21.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.832+0000 7f4565d9b640 1 -- 172.21.15.53:0/774625656 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45680ccae0 msgr2=0x7f45680d09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:21.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.832+0000 7f4565d9b640 1 --2- 172.21.15.53:0/774625656 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45680ccae0 0x7f45680d09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:21.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.832+0000 7f4565d9b640 1 -- 172.21.15.53:0/774625656 >> v1:172.21.15.117:6789/0 conn(0x7f45680b3ac0 legacy=0x7f45680b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:21.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.832+0000 7f4565d9b640 1 -- 172.21.15.53:0/774625656 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45680cf500 con 0x7f45680cc690 2023-06-10T19:08:21.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.836+0000 7f4565d9b640 1 --2- 172.21.15.53:0/774625656 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45680cc690 0x7f45680d04b0 secure :-1 s=READY pgs=2641 cs=0 l=1 rev1=1 crypto rx=0x7f455c009870 tx=0x7f455c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99bfa70283def779 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:21.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.836+0000 7f456559a640 1 -- 172.21.15.53:0/774625656 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f455c0ac600 con 0x7f45680cc690 2023-06-10T19:08:21.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.836+0000 7f456559a640 1 -- 172.21.15.53:0/774625656 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f455c0a8050 con 0x7f45680cc690 2023-06-10T19:08:21.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.836+0000 7f456559a640 1 -- 172.21.15.53:0/774625656 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f455c0ac980 con 0x7f45680cc690 2023-06-10T19:08:21.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.836+0000 7f456ccb6640 1 -- 172.21.15.53:0/774625656 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45680cc690 msgr2=0x7f45680d04b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:21.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.836+0000 7f456ccb6640 1 --2- 172.21.15.53:0/774625656 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45680cc690 0x7f45680d04b0 secure :-1 s=READY pgs=2641 cs=0 l=1 rev1=1 crypto rx=0x7f455c009870 tx=0x7f455c01c4d0 comp rx=0 tx=0).stop 2023-06-10T19:08:21.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.836+0000 7f456ccb6640 1 -- 172.21.15.53:0/774625656 shutdown_connections 2023-06-10T19:08:21.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.836+0000 7f456ccb6640 1 --2- 172.21.15.53:0/774625656 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45680ccae0 0x7f45680d09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:21.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.836+0000 7f456ccb6640 1 --2- 172.21.15.53:0/774625656 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45680cc690 0x7f45680d04b0 unknown :-1 s=CLOSED pgs=2641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:21.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.836+0000 7f456ccb6640 1 -- 172.21.15.53:0/774625656 >> 172.21.15.53:0/774625656 conn(0x7f4568071790 msgr2=0x7f4568069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:21.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.836+0000 7f456ccb6640 1 -- 172.21.15.53:0/774625656 shutdown_connections 2023-06-10T19:08:21.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.836+0000 7f456ccb6640 1 -- 172.21.15.53:0/774625656 wait complete. 2023-06-10T19:08:21.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.836+0000 7f456ccb6640 1 Processor -- start 2023-06-10T19:08:21.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.836+0000 7f456ccb6640 1 -- start start 2023-06-10T19:08:21.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.836+0000 7f456ccb6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45680b3ac0 0x7f4568153aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:21.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.836+0000 7f456ccb6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45680cc690 0x7f456815b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:21.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.836+0000 7f456ccb6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45680ccae0 0x7f45680c9d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:21.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.836+0000 7f456ccb6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f456815c890 con 0x7f45680b3ac0 2023-06-10T19:08:21.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.836+0000 7f456ccb6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f456815bba0 con 0x7f45680cc690 2023-06-10T19:08:21.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.836+0000 7f456ccb6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45680cbfb0 con 0x7f45680ccae0 2023-06-10T19:08:21.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.836+0000 7f456659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45680b3ac0 0x7f4568153aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:21.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.836+0000 7f456659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45680b3ac0 0x7f4568153aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48234/0 (socket says 172.21.15.53:48234) 2023-06-10T19:08:21.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.836+0000 7f456659c640 1 -- 172.21.15.53:0/3493555721 learned_addr learned my addr 172.21.15.53:0/3493555721 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:08:21.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.836+0000 7f4566d9d640 1 --2- 172.21.15.53:0/3493555721 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45680ccae0 0x7f45680c9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:21.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.836+0000 7f4565d9b640 1 --2- 172.21.15.53:0/3493555721 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45680cc690 0x7f456815b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:21.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.840+0000 7f456659c640 1 -- 172.21.15.53:0/3493555721 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45680ccae0 msgr2=0x7f45680c9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:21.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.840+0000 7f456659c640 1 --2- 172.21.15.53:0/3493555721 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45680ccae0 0x7f45680c9d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:21.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.840+0000 7f456659c640 1 -- 172.21.15.53:0/3493555721 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45680cc690 msgr2=0x7f456815b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:21.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.840+0000 7f456659c640 1 --2- 172.21.15.53:0/3493555721 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45680cc690 0x7f456815b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:21.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.840+0000 7f456659c640 1 -- 172.21.15.53:0/3493555721 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f455c0094d0 con 0x7f45680b3ac0 2023-06-10T19:08:21.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.840+0000 7f456659c640 1 --2- 172.21.15.53:0/3493555721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45680b3ac0 0x7f4568153aa0 secure :-1 s=READY pgs=2642 cs=0 l=1 rev1=1 crypto rx=0x7f455800c7f0 tx=0x7f455800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:21.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.840+0000 7f4556ffd640 1 -- 172.21.15.53:0/3493555721 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f455800aa50 con 0x7f45680b3ac0 2023-06-10T19:08:21.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.840+0000 7f4556ffd640 1 -- 172.21.15.53:0/3493555721 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f455800abb0 con 0x7f45680b3ac0 2023-06-10T19:08:21.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.840+0000 7f4556ffd640 1 -- 172.21.15.53:0/3493555721 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4558012420 con 0x7f45680b3ac0 2023-06-10T19:08:21.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.840+0000 7f456ccb6640 1 -- 172.21.15.53:0/3493555721 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45680cbcd0 con 0x7f45680b3ac0 2023-06-10T19:08:21.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.840+0000 7f456ccb6640 1 -- 172.21.15.53:0/3493555721 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45680c9590 con 0x7f45680b3ac0 2023-06-10T19:08:21.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.840+0000 7f456ccb6640 1 -- 172.21.15.53:0/3493555721 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45680c90f0 con 0x7f45680b3ac0 2023-06-10T19:08:21.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.840+0000 7f4556ffd640 1 -- 172.21.15.53:0/3493555721 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4558012580 con 0x7f45680b3ac0 2023-06-10T19:08:21.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.840+0000 7f4556ffd640 1 --2- 172.21.15.53:0/3493555721 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4548066280 0x7f4548068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:21.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.840+0000 7f4556ffd640 1 -- 172.21.15.53:0/3493555721 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4558083f90 con 0x7f45680b3ac0 2023-06-10T19:08:21.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.840+0000 7f4565d9b640 1 --2- 172.21.15.53:0/3493555721 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4548066280 0x7f4548068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:21.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.840+0000 7f4565d9b640 1 --2- 172.21.15.53:0/3493555721 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4548066280 0x7f4548068730 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f455c0ae000 tx=0x7f455c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:21.853 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:21.844+0000 7f4556ffd640 1 -- 172.21.15.53:0/3493555721 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f45580b4700 con 0x7f45680b3ac0 2023-06-10T19:08:22.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.000+0000 7f456ccb6640 1 -- 172.21.15.53:0/3493555721 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f456804d790 con 0x7f45680b3ac0 2023-06-10T19:08:22.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.004+0000 7f4556ffd640 1 -- 172.21.15.53:0/3493555721 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v180) v1 ==== 74+0+18285 (secure 0 0 0) 0x7f4558016020 con 0x7f45680b3ac0 2023-06-10T19:08:22.008 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:08:22.008 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":180,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:08:04.518453+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2023-06-10T19:08:01.296938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"179","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_data","create_time":"2023-06-10T19:08:02.507633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"180","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:08:22.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.004+0000 7f456ccb6640 1 -- 172.21.15.53:0/3493555721 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4548066280 msgr2=0x7f4548068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:22.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.004+0000 7f456ccb6640 1 --2- 172.21.15.53:0/3493555721 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4548066280 0x7f4548068730 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f455c0ae000 tx=0x7f455c008040 comp rx=0 tx=0).stop 2023-06-10T19:08:22.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.004+0000 7f456ccb6640 1 -- 172.21.15.53:0/3493555721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45680b3ac0 msgr2=0x7f4568153aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:22.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.004+0000 7f456ccb6640 1 --2- 172.21.15.53:0/3493555721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45680b3ac0 0x7f4568153aa0 secure :-1 s=READY pgs=2642 cs=0 l=1 rev1=1 crypto rx=0x7f455800c7f0 tx=0x7f455800ccb0 comp rx=0 tx=0).stop 2023-06-10T19:08:22.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.004+0000 7f456ccb6640 1 -- 172.21.15.53:0/3493555721 shutdown_connections 2023-06-10T19:08:22.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.004+0000 7f456ccb6640 1 --2- 172.21.15.53:0/3493555721 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4548066280 0x7f4548068730 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:22.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.004+0000 7f456ccb6640 1 --2- 172.21.15.53:0/3493555721 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f45680ccae0 0x7f45680c9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:22.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.004+0000 7f456ccb6640 1 --2- 172.21.15.53:0/3493555721 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45680cc690 0x7f456815b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:22.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.004+0000 7f456ccb6640 1 --2- 172.21.15.53:0/3493555721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45680b3ac0 0x7f4568153aa0 unknown :-1 s=CLOSED pgs=2642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:22.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.004+0000 7f456ccb6640 1 -- 172.21.15.53:0/3493555721 >> 172.21.15.53:0/3493555721 conn(0x7f4568071790 msgr2=0x7f4568154e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:22.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.004+0000 7f456ccb6640 1 -- 172.21.15.53:0/3493555721 shutdown_connections 2023-06-10T19:08:22.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.004+0000 7f456ccb6640 1 -- 172.21.15.53:0/3493555721 wait complete. 2023-06-10T19:08:22.027 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-10T18:52:33.633114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-10T18:52:39.171487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 25, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-10T19:08:01.296938+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '179', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 26, 'pool_name': 'cephfs_data', 'create_time': '2023-06-10T19:08:02.507633+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '180', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-10T19:08:22.029 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-10T19:08:22.151 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.148+0000 7fc02dbfe640 1 Processor -- start 2023-06-10T19:08:22.152 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.148+0000 7fc02dbfe640 1 -- start start 2023-06-10T19:08:22.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.148+0000 7fc02dbfe640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc0280cec40 0x7fc0280cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:22.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.148+0000 7fc02dbfe640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0280cbac0 con 0x7fc0280cbf50 2023-06-10T19:08:22.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.148+0000 7fc02dbfe640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc02815dc00 con 0x7fc028159450 2023-06-10T19:08:22.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.148+0000 7fc02dbfe640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0280cf600 con 0x7fc0280cec40 2023-06-10T19:08:22.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.148+0000 7fc027fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fc0280cbf50 0x7fc0280cc390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:43370/0 (socket says 172.21.15.53:43370) 2023-06-10T19:08:22.153 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.148+0000 7fc027fff640 1 -- 172.21.15.53:0/1563191887 learned_addr learned my addr 172.21.15.53:0/1563191887 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:08:22.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.148+0000 7fc026ffd640 1 --2- 172.21.15.53:0/1563191887 >> v2:172.21.15.117:3300/0 conn(0x7fc0280cec40 0x7fc0280cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:22.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.148+0000 7fc0267fc640 1 -- 172.21.15.53:0/1563191887 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1547475539 0 0) 0x7fc0280cbac0 con 0x7fc0280cbf50 2023-06-10T19:08:22.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.148+0000 7fc0267fc640 1 -- 172.21.15.53:0/1563191887 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc010003530 con 0x7fc0280cbf50 2023-06-10T19:08:22.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.148+0000 7fc0267fc640 1 -- 172.21.15.53:0/1563191887 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2985959163 0 0) 0x7fc010003530 con 0x7fc0280cbf50 2023-06-10T19:08:22.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.148+0000 7fc0267fc640 1 -- 172.21.15.53:0/1563191887 >> v2:172.21.15.117:3300/0 conn(0x7fc0280cec40 msgr2=0x7fc0280cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:22.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.148+0000 7fc0267fc640 1 --2- 172.21.15.53:0/1563191887 >> v2:172.21.15.117:3300/0 conn(0x7fc0280cec40 0x7fc0280cf0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:22.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.148+0000 7fc0267fc640 1 -- 172.21.15.53:0/1563191887 >> v1:172.21.15.117:6789/0 conn(0x7fc028159450 legacy=0x7fc02815d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:22.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.148+0000 7fc0267fc640 1 -- 172.21.15.53:0/1563191887 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc02815dee0 con 0x7fc0280cbf50 2023-06-10T19:08:22.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.148+0000 7fc0267fc640 1 -- 172.21.15.53:0/1563191887 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fc020001a00 con 0x7fc0280cbf50 2023-06-10T19:08:22.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.148+0000 7fc0267fc640 1 -- 172.21.15.53:0/1563191887 >> v1:172.21.15.53:6789/0 conn(0x7fc0280cbf50 legacy=0x7fc0280cc390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:22.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.148+0000 7fc0267fc640 1 --2- 172.21.15.53:0/1563191887 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc010003980 0x7fc010003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:22.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.148+0000 7fc0267fc640 1 --2- 172.21.15.53:0/1563191887 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0100047d0 0x7fc010004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:22.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.148+0000 7fc0267fc640 1 --2- 172.21.15.53:0/1563191887 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc010005180 0x7fc01000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:22.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.148+0000 7fc0267fc640 1 -- 172.21.15.53:0/1563191887 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0280cf600 con 0x7fc0100047d0 2023-06-10T19:08:22.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.148+0000 7fc0267fc640 1 -- 172.21.15.53:0/1563191887 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc01000c000 con 0x7fc010003980 2023-06-10T19:08:22.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.148+0000 7fc0267fc640 1 -- 172.21.15.53:0/1563191887 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc01000c1c0 con 0x7fc010005180 2023-06-10T19:08:22.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.148+0000 7fc026ffd640 1 --2- 172.21.15.53:0/1563191887 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0100047d0 0x7fc010004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:22.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.148+0000 7fc0277fe640 1 --2- 172.21.15.53:0/1563191887 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc010003980 0x7fc010003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:22.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.148+0000 7fc027fff640 1 --2- 172.21.15.53:0/1563191887 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc010005180 0x7fc01000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:22.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.148+0000 7fc026ffd640 1 -- 172.21.15.53:0/1563191887 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc010005180 msgr2=0x7fc01000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:22.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.148+0000 7fc026ffd640 1 --2- 172.21.15.53:0/1563191887 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc010005180 0x7fc01000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:22.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.148+0000 7fc026ffd640 1 -- 172.21.15.53:0/1563191887 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc010003980 msgr2=0x7fc010003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:22.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.148+0000 7fc026ffd640 1 --2- 172.21.15.53:0/1563191887 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc010003980 0x7fc010003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:22.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.148+0000 7fc026ffd640 1 -- 172.21.15.53:0/1563191887 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc010003530 con 0x7fc0100047d0 2023-06-10T19:08:22.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.148+0000 7fc027fff640 1 -- 172.21.15.53:0/1563191887 reap_dead start 2023-06-10T19:08:22.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.152+0000 7fc026ffd640 1 --2- 172.21.15.53:0/1563191887 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0100047d0 0x7fc010004c40 secure :-1 s=READY pgs=2644 cs=0 l=1 rev1=1 crypto rx=0x7fc01c009ae0 tx=0x7fc01c01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6919fc6d2db0728f server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:22.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.152+0000 7fc0267fc640 1 -- 172.21.15.53:0/1563191887 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc01c0a6460 con 0x7fc0100047d0 2023-06-10T19:08:22.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.152+0000 7fc0267fc640 1 -- 172.21.15.53:0/1563191887 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc01c0a65c0 con 0x7fc0100047d0 2023-06-10T19:08:22.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.152+0000 7fc0267fc640 1 -- 172.21.15.53:0/1563191887 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc01c0a6970 con 0x7fc0100047d0 2023-06-10T19:08:22.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.152+0000 7fc02dbfe640 1 -- 172.21.15.53:0/1563191887 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0100047d0 msgr2=0x7fc010004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:22.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.152+0000 7fc02dbfe640 1 --2- 172.21.15.53:0/1563191887 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0100047d0 0x7fc010004c40 secure :-1 s=READY pgs=2644 cs=0 l=1 rev1=1 crypto rx=0x7fc01c009ae0 tx=0x7fc01c01ca50 comp rx=0 tx=0).stop 2023-06-10T19:08:22.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.152+0000 7fc02dbfe640 1 -- 172.21.15.53:0/1563191887 shutdown_connections 2023-06-10T19:08:22.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.152+0000 7fc02dbfe640 1 --2- 172.21.15.53:0/1563191887 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0100047d0 0x7fc010004c40 unknown :-1 s=CLOSED pgs=2644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:22.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.152+0000 7fc02dbfe640 1 -- 172.21.15.53:0/1563191887 >> 172.21.15.53:0/1563191887 conn(0x7fc02806a090 msgr2=0x7fc02806d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:22.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.152+0000 7fc02dbfe640 1 -- 172.21.15.53:0/1563191887 shutdown_connections 2023-06-10T19:08:22.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.152+0000 7fc02dbfe640 1 -- 172.21.15.53:0/1563191887 wait complete. 2023-06-10T19:08:22.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.156+0000 7fc02dbfe640 1 Processor -- start 2023-06-10T19:08:22.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.156+0000 7fc02dbfe640 1 -- start start 2023-06-10T19:08:22.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.156+0000 7fc02dbfe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0100047d0 0x7fc028151580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:22.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.156+0000 7fc02dbfe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0280b5840 0x7fc0281532a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:22.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.156+0000 7fc02dbfe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0281537e0 0x7fc0280b35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:22.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.156+0000 7fc02dbfe640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0280b42f0 con 0x7fc0281537e0 2023-06-10T19:08:22.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.156+0000 7fc02dbfe640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc028153c60 con 0x7fc0280b5840 2023-06-10T19:08:22.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.156+0000 7fc02dbfe640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0280b53b0 con 0x7fc0100047d0 2023-06-10T19:08:22.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.156+0000 7fc027fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0281537e0 0x7fc0280b35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:22.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.156+0000 7fc027fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0281537e0 0x7fc0280b35c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48260/0 (socket says 172.21.15.53:48260) 2023-06-10T19:08:22.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.156+0000 7fc027fff640 1 -- 172.21.15.53:0/3546076112 learned_addr learned my addr 172.21.15.53:0/3546076112 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:08:22.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.156+0000 7fc026ffd640 1 --2- 172.21.15.53:0/3546076112 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0280b5840 0x7fc0281532a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:22.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.156+0000 7fc0277fe640 1 --2- 172.21.15.53:0/3546076112 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0100047d0 0x7fc028151580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:22.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.156+0000 7fc027fff640 1 -- 172.21.15.53:0/3546076112 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0100047d0 msgr2=0x7fc028151580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:22.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.156+0000 7fc027fff640 1 --2- 172.21.15.53:0/3546076112 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0100047d0 0x7fc028151580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:22.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.156+0000 7fc027fff640 1 -- 172.21.15.53:0/3546076112 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0280b5840 msgr2=0x7fc0281532a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:22.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.156+0000 7fc027fff640 1 --2- 172.21.15.53:0/3546076112 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0280b5840 0x7fc0281532a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:22.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.156+0000 7fc027fff640 1 -- 172.21.15.53:0/3546076112 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc028151ac0 con 0x7fc0281537e0 2023-06-10T19:08:22.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.156+0000 7fc027fff640 1 --2- 172.21.15.53:0/3546076112 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0281537e0 0x7fc0280b35c0 secure :-1 s=READY pgs=2645 cs=0 l=1 rev1=1 crypto rx=0x7fc020002240 tx=0x7fc020011850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:22.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.156+0000 7fc00ffff640 1 -- 172.21.15.53:0/3546076112 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc020014370 con 0x7fc0281537e0 2023-06-10T19:08:22.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.156+0000 7fc00ffff640 1 -- 172.21.15.53:0/3546076112 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0200144d0 con 0x7fc0281537e0 2023-06-10T19:08:22.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.156+0000 7fc00ffff640 1 -- 172.21.15.53:0/3546076112 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc020014880 con 0x7fc0281537e0 2023-06-10T19:08:22.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.156+0000 7fc02dbfe640 1 -- 172.21.15.53:0/3546076112 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0280b4a80 con 0x7fc0281537e0 2023-06-10T19:08:22.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.156+0000 7fc02dbfe640 1 -- 172.21.15.53:0/3546076112 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0280b5040 con 0x7fc0281537e0 2023-06-10T19:08:22.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.156+0000 7fc02dbfe640 1 -- 172.21.15.53:0/3546076112 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0280b1a70 con 0x7fc0281537e0 2023-06-10T19:08:22.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.156+0000 7fc00ffff640 1 -- 172.21.15.53:0/3546076112 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc0200149e0 con 0x7fc0281537e0 2023-06-10T19:08:22.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.156+0000 7fc00ffff640 1 --2- 172.21.15.53:0/3546076112 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc014066280 0x7fc014068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:22.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.156+0000 7fc00ffff640 1 -- 172.21.15.53:0/3546076112 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc020085eb0 con 0x7fc0281537e0 2023-06-10T19:08:22.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.160+0000 7fc0277fe640 1 --2- 172.21.15.53:0/3546076112 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc014066280 0x7fc014068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:22.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.160+0000 7fc0277fe640 1 --2- 172.21.15.53:0/3546076112 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc014066280 0x7fc014068730 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7fc018005510 tx=0x7fc018009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:22.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.164+0000 7fc00ffff640 1 -- 172.21.15.53:0/3546076112 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc020053330 con 0x7fc0281537e0 2023-06-10T19:08:22.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.316+0000 7fc02dbfe640 1 -- 172.21.15.53:0/3546076112 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc02804d790 con 0x7fc0281537e0 2023-06-10T19:08:22.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.316+0000 7fc00ffff640 1 -- 172.21.15.53:0/3546076112 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v180) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc02001c070 con 0x7fc0281537e0 2023-06-10T19:08:22.359 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-06-10T19:08:22.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.320+0000 7fc02dbfe640 1 -- 172.21.15.53:0/3546076112 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc014066280 msgr2=0x7fc014068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:22.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.320+0000 7fc02dbfe640 1 --2- 172.21.15.53:0/3546076112 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc014066280 0x7fc014068730 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7fc018005510 tx=0x7fc018009040 comp rx=0 tx=0).stop 2023-06-10T19:08:22.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.320+0000 7fc02dbfe640 1 -- 172.21.15.53:0/3546076112 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0281537e0 msgr2=0x7fc0280b35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:22.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.320+0000 7fc02dbfe640 1 --2- 172.21.15.53:0/3546076112 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0281537e0 0x7fc0280b35c0 secure :-1 s=READY pgs=2645 cs=0 l=1 rev1=1 crypto rx=0x7fc020002240 tx=0x7fc020011850 comp rx=0 tx=0).stop 2023-06-10T19:08:22.360 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.320+0000 7fc02dbfe640 1 -- 172.21.15.53:0/3546076112 shutdown_connections 2023-06-10T19:08:22.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.320+0000 7fc02dbfe640 1 --2- 172.21.15.53:0/3546076112 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc014066280 0x7fc014068730 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:22.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.320+0000 7fc02dbfe640 1 --2- 172.21.15.53:0/3546076112 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0281537e0 0x7fc0280b35c0 unknown :-1 s=CLOSED pgs=2645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:22.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.320+0000 7fc02dbfe640 1 --2- 172.21.15.53:0/3546076112 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0280b5840 0x7fc0281532a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:22.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.320+0000 7fc02dbfe640 1 --2- 172.21.15.53:0/3546076112 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc0100047d0 0x7fc028151580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:22.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.320+0000 7fc02dbfe640 1 -- 172.21.15.53:0/3546076112 >> 172.21.15.53:0/3546076112 conn(0x7fc02806a090 msgr2=0x7fc0280b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:22.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.320+0000 7fc02dbfe640 1 -- 172.21.15.53:0/3546076112 shutdown_connections 2023-06-10T19:08:22.361 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.320+0000 7fc02dbfe640 1 -- 172.21.15.53:0/3546076112 wait complete. 2023-06-10T19:08:22.362 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-10T19:08:22.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.488+0000 7fb0c1b9e640 1 Processor -- start 2023-06-10T19:08:22.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.488+0000 7fb0c1b9e640 1 -- start start 2023-06-10T19:08:22.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.488+0000 7fb0c1b9e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb0bc0c9fa0 0x7fb0bc06bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:22.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.488+0000 7fb0c1b9e640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0bc06b090 con 0x7fb0bc06c020 2023-06-10T19:08:22.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.488+0000 7fb0c1b9e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0bc0ca370 con 0x7fb0bc0af760 2023-06-10T19:08:22.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.488+0000 7fb0c1b9e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0bc070d50 con 0x7fb0bc0c9fa0 2023-06-10T19:08:22.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.488+0000 7fb0baffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fb0bc06c020 0x7fb0bc0c82a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:43380/0 (socket says 172.21.15.53:43380) 2023-06-10T19:08:22.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.488+0000 7fb0baffd640 1 -- 172.21.15.53:0/4214082844 learned_addr learned my addr 172.21.15.53:0/4214082844 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:08:22.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.488+0000 7fb0bb7fe640 1 --2- 172.21.15.53:0/4214082844 >> v2:172.21.15.117:3300/0 conn(0x7fb0bc0c9fa0 0x7fb0bc06bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:22.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.488+0000 7fb0ba7fc640 1 -- 172.21.15.53:0/4214082844 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3200874685 0 0) 0x7fb0bc06b090 con 0x7fb0bc06c020 2023-06-10T19:08:22.494 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.488+0000 7fb0ba7fc640 1 -- 172.21.15.53:0/4214082844 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0a4003530 con 0x7fb0bc06c020 2023-06-10T19:08:22.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.488+0000 7fb0ba7fc640 1 -- 172.21.15.53:0/4214082844 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1098787050 0 0) 0x7fb0a4003530 con 0x7fb0bc06c020 2023-06-10T19:08:22.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.488+0000 7fb0ba7fc640 1 -- 172.21.15.53:0/4214082844 >> v2:172.21.15.117:3300/0 conn(0x7fb0bc0c9fa0 msgr2=0x7fb0bc06bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:22.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.488+0000 7fb0ba7fc640 1 --2- 172.21.15.53:0/4214082844 >> v2:172.21.15.117:3300/0 conn(0x7fb0bc0c9fa0 0x7fb0bc06bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:22.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.488+0000 7fb0ba7fc640 1 -- 172.21.15.53:0/4214082844 >> v1:172.21.15.117:6789/0 conn(0x7fb0bc0af760 legacy=0x7fb0bc0700e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:22.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.488+0000 7fb0ba7fc640 1 -- 172.21.15.53:0/4214082844 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0bc071030 con 0x7fb0bc06c020 2023-06-10T19:08:22.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.488+0000 7fb0ba7fc640 1 -- 172.21.15.53:0/4214082844 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fb0ac001680 con 0x7fb0bc06c020 2023-06-10T19:08:22.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.488+0000 7fb0ba7fc640 1 -- 172.21.15.53:0/4214082844 >> v1:172.21.15.53:6789/0 conn(0x7fb0bc06c020 legacy=0x7fb0bc0c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:22.495 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.488+0000 7fb0ba7fc640 1 --2- 172.21.15.53:0/4214082844 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0a4003980 0x7fb0a4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:22.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.488+0000 7fb0ba7fc640 1 --2- 172.21.15.53:0/4214082844 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0a40047d0 0x7fb0a4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:22.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.488+0000 7fb0ba7fc640 1 --2- 172.21.15.53:0/4214082844 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0a4005180 0x7fb0a400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:22.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.488+0000 7fb0ba7fc640 1 -- 172.21.15.53:0/4214082844 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0bc070d50 con 0x7fb0a4005180 2023-06-10T19:08:22.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.488+0000 7fb0ba7fc640 1 -- 172.21.15.53:0/4214082844 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a400c090 con 0x7fb0a4003980 2023-06-10T19:08:22.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.488+0000 7fb0ba7fc640 1 -- 172.21.15.53:0/4214082844 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a400c250 con 0x7fb0a40047d0 2023-06-10T19:08:22.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.488+0000 7fb0bbfff640 1 --2- 172.21.15.53:0/4214082844 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0a4005180 0x7fb0a400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:22.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.488+0000 7fb0bb7fe640 1 --2- 172.21.15.53:0/4214082844 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0a4003980 0x7fb0a4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:22.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.488+0000 7fb0bbfff640 1 -- 172.21.15.53:0/4214082844 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0a40047d0 msgr2=0x7fb0a4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:22.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.488+0000 7fb0bbfff640 1 --2- 172.21.15.53:0/4214082844 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0a40047d0 0x7fb0a4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:22.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.488+0000 7fb0bbfff640 1 -- 172.21.15.53:0/4214082844 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0a4003980 msgr2=0x7fb0a4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:22.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.488+0000 7fb0bbfff640 1 --2- 172.21.15.53:0/4214082844 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0a4003980 0x7fb0a4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:22.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.488+0000 7fb0bbfff640 1 -- 172.21.15.53:0/4214082844 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0a4003530 con 0x7fb0a4005180 2023-06-10T19:08:22.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.492+0000 7fb0bbfff640 1 -- 172.21.15.53:0/4214082844 reap_dead start 2023-06-10T19:08:22.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.492+0000 7fb0bbfff640 1 --2- 172.21.15.53:0/4214082844 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0a4005180 0x7fb0a400b990 secure :-1 s=READY pgs=2647 cs=0 l=1 rev1=1 crypto rx=0x7fb0b4001e70 tx=0x7fb0b401c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c3f87b22ccffcea server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:22.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.492+0000 7fb0ba7fc640 1 -- 172.21.15.53:0/4214082844 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0b4003b80 con 0x7fb0a4005180 2023-06-10T19:08:22.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.492+0000 7fb0ba7fc640 1 -- 172.21.15.53:0/4214082844 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0b4003d20 con 0x7fb0a4005180 2023-06-10T19:08:22.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.492+0000 7fb0ba7fc640 1 -- 172.21.15.53:0/4214082844 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0b4005260 con 0x7fb0a4005180 2023-06-10T19:08:22.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.492+0000 7fb0c1b9e640 1 -- 172.21.15.53:0/4214082844 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0a4005180 msgr2=0x7fb0a400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:22.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.492+0000 7fb0c1b9e640 1 --2- 172.21.15.53:0/4214082844 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0a4005180 0x7fb0a400b990 secure :-1 s=READY pgs=2647 cs=0 l=1 rev1=1 crypto rx=0x7fb0b4001e70 tx=0x7fb0b401c760 comp rx=0 tx=0).stop 2023-06-10T19:08:22.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.492+0000 7fb0c1b9e640 1 -- 172.21.15.53:0/4214082844 shutdown_connections 2023-06-10T19:08:22.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.492+0000 7fb0c1b9e640 1 --2- 172.21.15.53:0/4214082844 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0a4005180 0x7fb0a400b990 unknown :-1 s=CLOSED pgs=2647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:22.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.492+0000 7fb0c1b9e640 1 -- 172.21.15.53:0/4214082844 >> 172.21.15.53:0/4214082844 conn(0x7fb0bc06a0e0 msgr2=0x7fb0bc0cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:22.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.492+0000 7fb0c1b9e640 1 -- 172.21.15.53:0/4214082844 shutdown_connections 2023-06-10T19:08:22.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.492+0000 7fb0c1b9e640 1 -- 172.21.15.53:0/4214082844 wait complete. 2023-06-10T19:08:22.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.492+0000 7fb0c1b9e640 1 Processor -- start 2023-06-10T19:08:22.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.492+0000 7fb0c1b9e640 1 -- start start 2023-06-10T19:08:22.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.496+0000 7fb0c1b9e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0a4005180 0x7fb0bc158370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:22.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.496+0000 7fb0c1b9e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0bc0c73b0 0x7fb0bc0b2a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:22.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.496+0000 7fb0c1b9e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0bc0c7820 0x7fb0bc0b2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:22.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.496+0000 7fb0c1b9e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0bc0cd820 con 0x7fb0a4005180 2023-06-10T19:08:22.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.496+0000 7fb0c1b9e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0bc0ccc10 con 0x7fb0bc0c73b0 2023-06-10T19:08:22.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.496+0000 7fb0c1b9e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0bc0ccef0 con 0x7fb0bc0c7820 2023-06-10T19:08:22.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.496+0000 7fb0bb7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0a4005180 0x7fb0bc158370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:22.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.496+0000 7fb0bb7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0a4005180 0x7fb0bc158370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48268/0 (socket says 172.21.15.53:48268) 2023-06-10T19:08:22.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.496+0000 7fb0bb7fe640 1 -- 172.21.15.53:0/3501881018 learned_addr learned my addr 172.21.15.53:0/3501881018 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:08:22.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.496+0000 7fb0bbfff640 1 --2- 172.21.15.53:0/3501881018 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0bc0c7820 0x7fb0bc0b2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:22.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.496+0000 7fb0baffd640 1 --2- 172.21.15.53:0/3501881018 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0bc0c73b0 0x7fb0bc0b2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:22.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.496+0000 7fb0bb7fe640 1 -- 172.21.15.53:0/3501881018 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0bc0c7820 msgr2=0x7fb0bc0b2fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:22.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.496+0000 7fb0bb7fe640 1 --2- 172.21.15.53:0/3501881018 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0bc0c7820 0x7fb0bc0b2fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:22.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.496+0000 7fb0bb7fe640 1 -- 172.21.15.53:0/3501881018 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0bc0c73b0 msgr2=0x7fb0bc0b2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:22.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.496+0000 7fb0bb7fe640 1 --2- 172.21.15.53:0/3501881018 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0bc0c73b0 0x7fb0bc0b2a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:22.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.496+0000 7fb0bb7fe640 1 -- 172.21.15.53:0/3501881018 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0bc0cd1d0 con 0x7fb0a4005180 2023-06-10T19:08:22.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.496+0000 7fb0bb7fe640 1 --2- 172.21.15.53:0/3501881018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0a4005180 0x7fb0bc158370 secure :-1 s=READY pgs=2648 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0011560 tx=0x7fb0b0011a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:22.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.496+0000 7fb0a3fff640 1 -- 172.21.15.53:0/3501881018 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0b0015930 con 0x7fb0a4005180 2023-06-10T19:08:22.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.496+0000 7fb0a3fff640 1 -- 172.21.15.53:0/3501881018 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0b0015a90 con 0x7fb0a4005180 2023-06-10T19:08:22.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.496+0000 7fb0c1b9e640 1 -- 172.21.15.53:0/3501881018 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0bc0cd4b0 con 0x7fb0a4005180 2023-06-10T19:08:22.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.496+0000 7fb0c1b9e640 1 -- 172.21.15.53:0/3501881018 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0bc0cb9f0 con 0x7fb0a4005180 2023-06-10T19:08:22.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.496+0000 7fb0a3fff640 1 -- 172.21.15.53:0/3501881018 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0b0015e60 con 0x7fb0a4005180 2023-06-10T19:08:22.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.496+0000 7fb0c1b9e640 1 -- 172.21.15.53:0/3501881018 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb09c005260 con 0x7fb0a4005180 2023-06-10T19:08:22.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.496+0000 7fb0a3fff640 1 -- 172.21.15.53:0/3501881018 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb0b000f460 con 0x7fb0a4005180 2023-06-10T19:08:22.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.496+0000 7fb0a3fff640 1 --2- 172.21.15.53:0/3501881018 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb0a8066280 0x7fb0a8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:22.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.496+0000 7fb0a3fff640 1 -- 172.21.15.53:0/3501881018 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb0b0084540 con 0x7fb0a4005180 2023-06-10T19:08:22.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.496+0000 7fb0baffd640 1 --2- 172.21.15.53:0/3501881018 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb0a8066280 0x7fb0a8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:22.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.500+0000 7fb0baffd640 1 --2- 172.21.15.53:0/3501881018 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb0a8066280 0x7fb0a8068730 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7fb0ac001830 tx=0x7fb0ac0015a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:22.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.500+0000 7fb0a3fff640 1 -- 172.21.15.53:0/3501881018 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb0b0055450 con 0x7fb0a4005180 2023-06-10T19:08:22.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.648+0000 7fb0c1b9e640 1 -- 172.21.15.53:0/3501881018 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb09c005a90 con 0x7fb0a4005180 2023-06-10T19:08:22.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.652+0000 7fb0a3fff640 1 -- 172.21.15.53:0/3501881018 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v180) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb0b0054fe0 con 0x7fb0a4005180 2023-06-10T19:08:22.656 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-06-10T19:08:22.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.652+0000 7fb0c1b9e640 1 -- 172.21.15.53:0/3501881018 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb0a8066280 msgr2=0x7fb0a8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:22.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.652+0000 7fb0c1b9e640 1 --2- 172.21.15.53:0/3501881018 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb0a8066280 0x7fb0a8068730 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7fb0ac001830 tx=0x7fb0ac0015a0 comp rx=0 tx=0).stop 2023-06-10T19:08:22.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.652+0000 7fb0c1b9e640 1 -- 172.21.15.53:0/3501881018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0a4005180 msgr2=0x7fb0bc158370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:22.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.652+0000 7fb0c1b9e640 1 --2- 172.21.15.53:0/3501881018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0a4005180 0x7fb0bc158370 secure :-1 s=READY pgs=2648 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0011560 tx=0x7fb0b0011a20 comp rx=0 tx=0).stop 2023-06-10T19:08:22.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.652+0000 7fb0c1b9e640 1 -- 172.21.15.53:0/3501881018 shutdown_connections 2023-06-10T19:08:22.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.652+0000 7fb0c1b9e640 1 --2- 172.21.15.53:0/3501881018 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb0a8066280 0x7fb0a8068730 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:22.658 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.652+0000 7fb0c1b9e640 1 --2- 172.21.15.53:0/3501881018 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb0bc0c7820 0x7fb0bc0b2fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:22.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.652+0000 7fb0c1b9e640 1 --2- 172.21.15.53:0/3501881018 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0bc0c73b0 0x7fb0bc0b2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:22.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.652+0000 7fb0c1b9e640 1 --2- 172.21.15.53:0/3501881018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb0a4005180 0x7fb0bc158370 unknown :-1 s=CLOSED pgs=2648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:22.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.652+0000 7fb0c1b9e640 1 -- 172.21.15.53:0/3501881018 >> 172.21.15.53:0/3501881018 conn(0x7fb0bc06a0e0 msgr2=0x7fb0bc0b0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:22.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.652+0000 7fb0c1b9e640 1 -- 172.21.15.53:0/3501881018 shutdown_connections 2023-06-10T19:08:22.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.652+0000 7fb0c1b9e640 1 -- 172.21.15.53:0/3501881018 wait complete. 2023-06-10T19:08:22.672 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-10T19:08:22.799 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.796+0000 7fa2adb5a640 1 Processor -- start 2023-06-10T19:08:22.799 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.796+0000 7fa2adb5a640 1 -- start start 2023-06-10T19:08:22.800 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.796+0000 7fa2adb5a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa2a80c9fa0 0x7fa2a806bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:22.801 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.796+0000 7fa2adb5a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2a806c020 0x7fa2a80c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:22.801 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.796+0000 7fa2adb5a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa2a80c87e0 0x7fa2a80af760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:22.801 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.796+0000 7fa2adb5a640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2a806b090 con 0x7fa2a80c87e0 2023-06-10T19:08:22.801 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.796+0000 7fa2adb5a640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2a80ca370 con 0x7fa2a80c9fa0 2023-06-10T19:08:22.801 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.796+0000 7fa2adb5a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a8070d50 con 0x7fa2a806c020 2023-06-10T19:08:22.802 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.796+0000 7fa2a7fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa2a80c87e0 0x7fa2a80af760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:22.802 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.796+0000 7fa2a7fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa2a80c87e0 0x7fa2a80af760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48274/0 (socket says 172.21.15.53:48274) 2023-06-10T19:08:22.802 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.796+0000 7fa2a7fff640 1 -- 172.21.15.53:0/2199111202 learned_addr learned my addr 172.21.15.53:0/2199111202 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:08:22.802 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.796+0000 7fa2a77fe640 1 --2- 172.21.15.53:0/2199111202 >> v2:172.21.15.117:3300/0 conn(0x7fa2a80c9fa0 0x7fa2a806bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:22.802 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.796+0000 7fa2a6ffd640 1 --2- 172.21.15.53:0/2199111202 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2a806c020 0x7fa2a80c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:22.802 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.796+0000 7fa2a7fff640 1 -- 172.21.15.53:0/2199111202 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2a806c020 msgr2=0x7fa2a80c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:22.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.796+0000 7fa2a7fff640 1 --2- 172.21.15.53:0/2199111202 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2a806c020 0x7fa2a80c82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:22.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.796+0000 7fa2a7fff640 1 -- 172.21.15.53:0/2199111202 >> v2:172.21.15.117:3300/0 conn(0x7fa2a80c9fa0 msgr2=0x7fa2a806bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:22.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.796+0000 7fa2a7fff640 1 --2- 172.21.15.53:0/2199111202 >> v2:172.21.15.117:3300/0 conn(0x7fa2a80c9fa0 0x7fa2a806bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:22.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.796+0000 7fa2a7fff640 1 -- 172.21.15.53:0/2199111202 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2a8071030 con 0x7fa2a80c87e0 2023-06-10T19:08:22.804 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.800+0000 7fa2a7fff640 1 --2- 172.21.15.53:0/2199111202 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2a80c87e0 0x7fa2a80af760 secure :-1 s=READY pgs=2649 cs=0 l=1 rev1=1 crypto rx=0x7fa2a806e9d0 tx=0x7fa2a001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9412739cbe8125d0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:22.804 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.800+0000 7fa2a67fc640 1 -- 172.21.15.53:0/2199111202 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a00a56a0 con 0x7fa2a80c87e0 2023-06-10T19:08:22.804 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.800+0000 7fa2a67fc640 1 -- 172.21.15.53:0/2199111202 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2a00a5800 con 0x7fa2a80c87e0 2023-06-10T19:08:22.805 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.800+0000 7fa2a67fc640 1 -- 172.21.15.53:0/2199111202 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a00a5b90 con 0x7fa2a80c87e0 2023-06-10T19:08:22.805 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.800+0000 7fa2adb5a640 1 -- 172.21.15.53:0/2199111202 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2a80c87e0 msgr2=0x7fa2a80af760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:22.805 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.800+0000 7fa2adb5a640 1 --2- 172.21.15.53:0/2199111202 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2a80c87e0 0x7fa2a80af760 secure :-1 s=READY pgs=2649 cs=0 l=1 rev1=1 crypto rx=0x7fa2a806e9d0 tx=0x7fa2a001c910 comp rx=0 tx=0).stop 2023-06-10T19:08:22.805 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.800+0000 7fa2adb5a640 1 -- 172.21.15.53:0/2199111202 shutdown_connections 2023-06-10T19:08:22.805 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.800+0000 7fa2adb5a640 1 --2- 172.21.15.53:0/2199111202 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2a80c87e0 0x7fa2a80af760 unknown :-1 s=CLOSED pgs=2649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:22.805 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.800+0000 7fa2adb5a640 1 --2- 172.21.15.53:0/2199111202 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2a806c020 0x7fa2a80c82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:22.805 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.800+0000 7fa2adb5a640 1 --2- 172.21.15.53:0/2199111202 >> v2:172.21.15.117:3300/0 conn(0x7fa2a80c9fa0 0x7fa2a806bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:22.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.800+0000 7fa2adb5a640 1 -- 172.21.15.53:0/2199111202 >> 172.21.15.53:0/2199111202 conn(0x7fa2a806a0e0 msgr2=0x7fa2a80cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:22.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.800+0000 7fa2adb5a640 1 -- 172.21.15.53:0/2199111202 shutdown_connections 2023-06-10T19:08:22.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.800+0000 7fa2adb5a640 1 -- 172.21.15.53:0/2199111202 wait complete. 2023-06-10T19:08:22.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.800+0000 7fa2adb5a640 1 Processor -- start 2023-06-10T19:08:22.808 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.800+0000 7fa2adb5a640 1 -- start start 2023-06-10T19:08:22.808 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.800+0000 7fa2adb5a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2a806c020 0x7fa2a8156b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:22.808 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.800+0000 7fa2adb5a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2a80c87e0 0x7fa2a8144a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:22.808 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.800+0000 7fa2adb5a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2a80c9fa0 0x7fa2a8161df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:22.808 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.800+0000 7fa2adb5a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a8163190 con 0x7fa2a806c020 2023-06-10T19:08:22.808 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.800+0000 7fa2adb5a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a8162330 con 0x7fa2a80c9fa0 2023-06-10T19:08:22.809 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.800+0000 7fa2adb5a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a8162580 con 0x7fa2a80c87e0 2023-06-10T19:08:22.809 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.800+0000 7fa2a77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2a806c020 0x7fa2a8156b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:22.809 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.800+0000 7fa2a77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2a806c020 0x7fa2a8156b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48284/0 (socket says 172.21.15.53:48284) 2023-06-10T19:08:22.809 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.800+0000 7fa2a77fe640 1 -- 172.21.15.53:0/3857492385 learned_addr learned my addr 172.21.15.53:0/3857492385 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:08:22.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.800+0000 7fa2a6ffd640 1 --2- 172.21.15.53:0/3857492385 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2a80c87e0 0x7fa2a8144a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:22.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.800+0000 7fa2a77fe640 1 -- 172.21.15.53:0/3857492385 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2a80c87e0 msgr2=0x7fa2a8144a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:22.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.800+0000 7fa2a77fe640 1 --2- 172.21.15.53:0/3857492385 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2a80c87e0 0x7fa2a8144a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:22.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.800+0000 7fa2a7fff640 1 --2- 172.21.15.53:0/3857492385 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2a80c9fa0 0x7fa2a8161df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:22.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.800+0000 7fa2a77fe640 1 -- 172.21.15.53:0/3857492385 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2a80c9fa0 msgr2=0x7fa2a8161df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:22.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.800+0000 7fa2a77fe640 1 --2- 172.21.15.53:0/3857492385 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2a80c9fa0 0x7fa2a8161df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:22.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.800+0000 7fa2a77fe640 1 -- 172.21.15.53:0/3857492385 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2a0009b30 con 0x7fa2a806c020 2023-06-10T19:08:22.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.804+0000 7fa2a77fe640 1 --2- 172.21.15.53:0/3857492385 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2a806c020 0x7fa2a8156b40 secure :-1 s=READY pgs=2650 cs=0 l=1 rev1=1 crypto rx=0x7fa29c00d620 tx=0x7fa29c00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:22.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.804+0000 7fa28ffff640 1 -- 172.21.15.53:0/3857492385 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29c00b620 con 0x7fa2a806c020 2023-06-10T19:08:22.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.804+0000 7fa28ffff640 1 -- 172.21.15.53:0/3857492385 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa29c00b780 con 0x7fa2a806c020 2023-06-10T19:08:22.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.804+0000 7fa2adb5a640 1 -- 172.21.15.53:0/3857492385 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2a8162860 con 0x7fa2a806c020 2023-06-10T19:08:22.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.804+0000 7fa28ffff640 1 -- 172.21.15.53:0/3857492385 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29c00bb10 con 0x7fa2a806c020 2023-06-10T19:08:22.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.804+0000 7fa2adb5a640 1 -- 172.21.15.53:0/3857492385 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2a8162e20 con 0x7fa2a806c020 2023-06-10T19:08:22.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.804+0000 7fa2adb5a640 1 -- 172.21.15.53:0/3857492385 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2a804d790 con 0x7fa2a806c020 2023-06-10T19:08:22.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.804+0000 7fa28ffff640 1 -- 172.21.15.53:0/3857492385 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa29c00bc70 con 0x7fa2a806c020 2023-06-10T19:08:22.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.804+0000 7fa28ffff640 1 --2- 172.21.15.53:0/3857492385 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa294066280 0x7fa294068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:22.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.804+0000 7fa28ffff640 1 -- 172.21.15.53:0/3857492385 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa29c084310 con 0x7fa2a806c020 2023-06-10T19:08:22.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.804+0000 7fa2a6ffd640 1 --2- 172.21.15.53:0/3857492385 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa294066280 0x7fa294068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:22.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.804+0000 7fa2a6ffd640 1 --2- 172.21.15.53:0/3857492385 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa294066280 0x7fa294068730 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7fa2a81578b0 tx=0x7fa298008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:22.815 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.808+0000 7fa28ffff640 1 -- 172.21.15.53:0/3857492385 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa29c0516f0 con 0x7fa2a806c020 2023-06-10T19:08:22.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.960+0000 7fa2adb5a640 1 -- 172.21.15.53:0/3857492385 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa2a80ce670 con 0x7fa2a806c020 2023-06-10T19:08:22.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.960+0000 7fa28ffff640 1 -- 172.21.15.53:0/3857492385 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v180) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa29c007380 con 0x7fa2a806c020 2023-06-10T19:08:22.964 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-06-10T19:08:22.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.964+0000 7fa2adb5a640 1 -- 172.21.15.53:0/3857492385 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa294066280 msgr2=0x7fa294068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:22.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.964+0000 7fa2adb5a640 1 --2- 172.21.15.53:0/3857492385 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa294066280 0x7fa294068730 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7fa2a81578b0 tx=0x7fa298008040 comp rx=0 tx=0).stop 2023-06-10T19:08:22.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.964+0000 7fa2adb5a640 1 -- 172.21.15.53:0/3857492385 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2a806c020 msgr2=0x7fa2a8156b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:22.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.964+0000 7fa2adb5a640 1 --2- 172.21.15.53:0/3857492385 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2a806c020 0x7fa2a8156b40 secure :-1 s=READY pgs=2650 cs=0 l=1 rev1=1 crypto rx=0x7fa29c00d620 tx=0x7fa29c00dae0 comp rx=0 tx=0).stop 2023-06-10T19:08:22.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.964+0000 7fa2adb5a640 1 -- 172.21.15.53:0/3857492385 shutdown_connections 2023-06-10T19:08:22.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.964+0000 7fa2adb5a640 1 --2- 172.21.15.53:0/3857492385 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa294066280 0x7fa294068730 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:22.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.964+0000 7fa2adb5a640 1 --2- 172.21.15.53:0/3857492385 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2a80c9fa0 0x7fa2a8161df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:22.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.964+0000 7fa2adb5a640 1 --2- 172.21.15.53:0/3857492385 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2a80c87e0 0x7fa2a8144a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:22.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.964+0000 7fa2adb5a640 1 --2- 172.21.15.53:0/3857492385 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2a806c020 0x7fa2a8156b40 unknown :-1 s=CLOSED pgs=2650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:22.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.964+0000 7fa2adb5a640 1 -- 172.21.15.53:0/3857492385 >> 172.21.15.53:0/3857492385 conn(0x7fa2a806a0e0 msgr2=0x7fa2a806c500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:22.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.964+0000 7fa2adb5a640 1 -- 172.21.15.53:0/3857492385 shutdown_connections 2023-06-10T19:08:22.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:22.964+0000 7fa2adb5a640 1 -- 172.21.15.53:0/3857492385 wait complete. 2023-06-10T19:08:22.983 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-10T19:08:23.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.108+0000 7f65a73b8640 1 Processor -- start 2023-06-10T19:08:23.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.108+0000 7f65a73b8640 1 -- start start 2023-06-10T19:08:23.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.108+0000 7f65a73b8640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f65a015c090 0x7f65a00b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:23.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.108+0000 7f65a73b8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f65a00b0b90 0x7f65a00b7720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:23.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.108+0000 7f65a73b8640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65a00b7c60 0x7f65a00b3b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:23.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.108+0000 7f65a73b8640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65a00b80e0 con 0x7f65a00b0b90 2023-06-10T19:08:23.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.108+0000 7f65a73b8640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65a00cc7c0 con 0x7f65a015c090 2023-06-10T19:08:23.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.108+0000 7f65a73b8640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65a00ccaa0 con 0x7f65a00b7c60 2023-06-10T19:08:23.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.108+0000 7f65a4953640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f65a00b0b90 0x7f65a00b7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:23.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.108+0000 7f65a4953640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f65a00b0b90 0x7f65a00b7720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48290/0 (socket says 172.21.15.53:48290) 2023-06-10T19:08:23.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.108+0000 7f65a4953640 1 -- 172.21.15.53:0/3475096177 learned_addr learned my addr 172.21.15.53:0/3475096177 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:08:23.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.108+0000 7f65a5955640 1 --2- 172.21.15.53:0/3475096177 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65a00b7c60 0x7f65a00b3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:23.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.108+0000 7f65a5154640 1 --2- 172.21.15.53:0/3475096177 >> v2:172.21.15.117:3300/0 conn(0x7f65a015c090 0x7f65a00b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:23.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.108+0000 7f65a4953640 1 -- 172.21.15.53:0/3475096177 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65a00b7c60 msgr2=0x7f65a00b3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:23.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.108+0000 7f65a4953640 1 --2- 172.21.15.53:0/3475096177 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65a00b7c60 0x7f65a00b3b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:23.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.108+0000 7f65a4953640 1 -- 172.21.15.53:0/3475096177 >> v2:172.21.15.117:3300/0 conn(0x7f65a015c090 msgr2=0x7f65a00b10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:23.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.108+0000 7f65a4953640 1 --2- 172.21.15.53:0/3475096177 >> v2:172.21.15.117:3300/0 conn(0x7f65a015c090 0x7f65a00b10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:23.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.108+0000 7f65a4953640 1 -- 172.21.15.53:0/3475096177 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65a00ccd80 con 0x7f65a00b0b90 2023-06-10T19:08:23.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.112+0000 7f65a4953640 1 --2- 172.21.15.53:0/3475096177 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65a00b0b90 0x7f65a00b7720 secure :-1 s=READY pgs=2651 cs=0 l=1 rev1=1 crypto rx=0x7f65a008a080 tx=0x7f659c01c180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfa42b9a07c7cdfe server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:23.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.112+0000 7f6597fff640 1 -- 172.21.15.53:0/3475096177 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f659c0ab600 con 0x7f65a00b0b90 2023-06-10T19:08:23.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.112+0000 7f6597fff640 1 -- 172.21.15.53:0/3475096177 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f659c0a7050 con 0x7f65a00b0b90 2023-06-10T19:08:23.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.112+0000 7f6597fff640 1 -- 172.21.15.53:0/3475096177 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f659c0ab980 con 0x7f65a00b0b90 2023-06-10T19:08:23.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.112+0000 7f65a73b8640 1 -- 172.21.15.53:0/3475096177 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65a00b0b90 msgr2=0x7f65a00b7720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:23.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.112+0000 7f65a73b8640 1 --2- 172.21.15.53:0/3475096177 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65a00b0b90 0x7f65a00b7720 secure :-1 s=READY pgs=2651 cs=0 l=1 rev1=1 crypto rx=0x7f65a008a080 tx=0x7f659c01c180 comp rx=0 tx=0).stop 2023-06-10T19:08:23.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.112+0000 7f65a73b8640 1 -- 172.21.15.53:0/3475096177 shutdown_connections 2023-06-10T19:08:23.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.112+0000 7f65a73b8640 1 --2- 172.21.15.53:0/3475096177 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65a00b7c60 0x7f65a00b3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:23.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.112+0000 7f65a73b8640 1 --2- 172.21.15.53:0/3475096177 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65a00b0b90 0x7f65a00b7720 unknown :-1 s=CLOSED pgs=2651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:23.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.112+0000 7f65a73b8640 1 --2- 172.21.15.53:0/3475096177 >> v2:172.21.15.117:3300/0 conn(0x7f65a015c090 0x7f65a00b10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:23.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.112+0000 7f65a73b8640 1 -- 172.21.15.53:0/3475096177 >> 172.21.15.53:0/3475096177 conn(0x7f65a0069e20 msgr2=0x7f65a006a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:23.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.112+0000 7f65a73b8640 1 -- 172.21.15.53:0/3475096177 shutdown_connections 2023-06-10T19:08:23.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.112+0000 7f65a73b8640 1 -- 172.21.15.53:0/3475096177 wait complete. 2023-06-10T19:08:23.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.112+0000 7f65a73b8640 1 Processor -- start 2023-06-10T19:08:23.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.112+0000 7f65a73b8640 1 -- start start 2023-06-10T19:08:23.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.116+0000 7f65a73b8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65a00b0b90 0x7f65a00b2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:23.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.116+0000 7f65a73b8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65a00b7c60 0x7f65a00b68c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:23.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.116+0000 7f65a73b8640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65a015c090 0x7f65a014b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:23.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.116+0000 7f65a73b8640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65a0150b10 con 0x7f65a00b0b90 2023-06-10T19:08:23.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.116+0000 7f65a73b8640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65a00b2ae0 con 0x7f65a00b7c60 2023-06-10T19:08:23.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.116+0000 7f65a73b8640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65a00b5de0 con 0x7f65a015c090 2023-06-10T19:08:23.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.116+0000 7f65a5154640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65a00b0b90 0x7f65a00b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:23.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.116+0000 7f65a5154640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65a00b0b90 0x7f65a00b2500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48304/0 (socket says 172.21.15.53:48304) 2023-06-10T19:08:23.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.116+0000 7f65a5154640 1 -- 172.21.15.53:0/3509435525 learned_addr learned my addr 172.21.15.53:0/3509435525 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:08:23.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.116+0000 7f65a4953640 1 --2- 172.21.15.53:0/3509435525 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65a00b7c60 0x7f65a00b68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:23.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.116+0000 7f65a5154640 1 -- 172.21.15.53:0/3509435525 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65a015c090 msgr2=0x7f65a014b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:23.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.116+0000 7f65a5154640 1 --2- 172.21.15.53:0/3509435525 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65a015c090 0x7f65a014b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:23.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.116+0000 7f65a5154640 1 -- 172.21.15.53:0/3509435525 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65a00b7c60 msgr2=0x7f65a00b68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:23.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.116+0000 7f65a5154640 1 --2- 172.21.15.53:0/3509435525 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65a00b7c60 0x7f65a00b68c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:23.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.116+0000 7f65a5154640 1 -- 172.21.15.53:0/3509435525 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f659c0094d0 con 0x7f65a00b0b90 2023-06-10T19:08:23.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.116+0000 7f65a5154640 1 --2- 172.21.15.53:0/3509435525 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65a00b0b90 0x7f65a00b2500 secure :-1 s=READY pgs=2652 cs=0 l=1 rev1=1 crypto rx=0x7f659800efc0 tx=0x7f659800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:23.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.116+0000 7f6595ffb640 1 -- 172.21.15.53:0/3509435525 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6598009b80 con 0x7f65a00b0b90 2023-06-10T19:08:23.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.116+0000 7f6595ffb640 1 -- 172.21.15.53:0/3509435525 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f659800f040 con 0x7f65a00b0b90 2023-06-10T19:08:23.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.116+0000 7f65a73b8640 1 -- 172.21.15.53:0/3509435525 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65a00b60c0 con 0x7f65a00b0b90 2023-06-10T19:08:23.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.116+0000 7f6595ffb640 1 -- 172.21.15.53:0/3509435525 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65980146a0 con 0x7f65a00b0b90 2023-06-10T19:08:23.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.116+0000 7f65a73b8640 1 -- 172.21.15.53:0/3509435525 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65a00b2dc0 con 0x7f65a00b0b90 2023-06-10T19:08:23.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.116+0000 7f65a73b8640 1 -- 172.21.15.53:0/3509435525 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65a004d790 con 0x7f65a00b0b90 2023-06-10T19:08:23.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.116+0000 7f6595ffb640 1 -- 172.21.15.53:0/3509435525 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6598014800 con 0x7f65a00b0b90 2023-06-10T19:08:23.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.116+0000 7f6595ffb640 1 --2- 172.21.15.53:0/3509435525 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6584066280 0x7f6584068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:23.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.116+0000 7f6595ffb640 1 -- 172.21.15.53:0/3509435525 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6598084860 con 0x7f65a00b0b90 2023-06-10T19:08:23.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.116+0000 7f65a4953640 1 --2- 172.21.15.53:0/3509435525 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6584066280 0x7f6584068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:23.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.120+0000 7f65a4953640 1 --2- 172.21.15.53:0/3509435525 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6584066280 0x7f6584068730 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f659c0ad000 tx=0x7f659c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:23.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.120+0000 7f6595ffb640 1 -- 172.21.15.53:0/3509435525 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6598055770 con 0x7f65a00b0b90 2023-06-10T19:08:23.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.276+0000 7f65a73b8640 1 -- 172.21.15.53:0/3509435525 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f65a0153d70 con 0x7f65a00b0b90 2023-06-10T19:08:23.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.276+0000 7f6595ffb640 1 -- 172.21.15.53:0/3509435525 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v180) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6598055300 con 0x7f65a00b0b90 2023-06-10T19:08:23.281 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-06-10T19:08:23.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.280+0000 7f65a73b8640 1 -- 172.21.15.53:0/3509435525 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6584066280 msgr2=0x7f6584068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:23.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.280+0000 7f65a73b8640 1 --2- 172.21.15.53:0/3509435525 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6584066280 0x7f6584068730 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f659c0ad000 tx=0x7f659c008040 comp rx=0 tx=0).stop 2023-06-10T19:08:23.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.280+0000 7f65a73b8640 1 -- 172.21.15.53:0/3509435525 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65a00b0b90 msgr2=0x7f65a00b2500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:23.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.280+0000 7f65a73b8640 1 --2- 172.21.15.53:0/3509435525 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65a00b0b90 0x7f65a00b2500 secure :-1 s=READY pgs=2652 cs=0 l=1 rev1=1 crypto rx=0x7f659800efc0 tx=0x7f659800c490 comp rx=0 tx=0).stop 2023-06-10T19:08:23.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.280+0000 7f65a73b8640 1 -- 172.21.15.53:0/3509435525 shutdown_connections 2023-06-10T19:08:23.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.280+0000 7f65a73b8640 1 --2- 172.21.15.53:0/3509435525 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6584066280 0x7f6584068730 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:23.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.280+0000 7f65a73b8640 1 --2- 172.21.15.53:0/3509435525 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f65a015c090 0x7f65a014b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:23.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.280+0000 7f65a73b8640 1 --2- 172.21.15.53:0/3509435525 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65a00b7c60 0x7f65a00b68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:23.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.280+0000 7f65a73b8640 1 --2- 172.21.15.53:0/3509435525 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65a00b0b90 0x7f65a00b2500 unknown :-1 s=CLOSED pgs=2652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:23.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.280+0000 7f65a73b8640 1 -- 172.21.15.53:0/3509435525 >> 172.21.15.53:0/3509435525 conn(0x7f65a0069e20 msgr2=0x7f65a0153580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:23.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.280+0000 7f65a73b8640 1 -- 172.21.15.53:0/3509435525 shutdown_connections 2023-06-10T19:08:23.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.280+0000 7f65a73b8640 1 -- 172.21.15.53:0/3509435525 wait complete. 2023-06-10T19:08:23.300 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-10T19:08:23.412 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.408+0000 7f98874dc640 1 Processor -- start 2023-06-10T19:08:23.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.408+0000 7f98874dc640 1 -- start start 2023-06-10T19:08:23.414 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.408+0000 7f98874dc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9880070100 0x7f98800af7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:23.415 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.408+0000 7f98874dc640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f98800afd10 0x7f98800c83f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:23.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.408+0000 7f98874dc640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9880071190 con 0x7f98801571a0 2023-06-10T19:08:23.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.408+0000 7f98874dc640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98800b01b0 con 0x7f9880070100 2023-06-10T19:08:23.416 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.408+0000 7f98874dc640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9880070580 con 0x7f98800afd10 2023-06-10T19:08:23.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.408+0000 7f9885278640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f98801571a0 0x7f98800c9f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:43386/0 (socket says 172.21.15.53:43386) 2023-06-10T19:08:23.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.408+0000 7f9885278640 1 -- 172.21.15.53:0/3900292850 learned_addr learned my addr 172.21.15.53:0/3900292850 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:08:23.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.408+0000 7f9884a77640 1 --2- 172.21.15.53:0/3900292850 >> v2:172.21.15.53:3300/0 conn(0x7f9880070100 0x7f98800af7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:23.417 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.408+0000 7f9877fff640 1 -- 172.21.15.53:0/3900292850 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3806354752 0 0) 0x7f9880071190 con 0x7f98801571a0 2023-06-10T19:08:23.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.408+0000 7f9885a79640 1 --2- 172.21.15.53:0/3900292850 >> v2:172.21.15.117:3300/0 conn(0x7f98800afd10 0x7f98800c83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:23.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.408+0000 7f9877fff640 1 -- 172.21.15.53:0/3900292850 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f986c003530 con 0x7f98801571a0 2023-06-10T19:08:23.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.408+0000 7f9884a77640 1 -- 172.21.15.53:0/3900292850 >> v2:172.21.15.117:3300/0 conn(0x7f98800afd10 msgr2=0x7f98800c83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:23.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.408+0000 7f9884a77640 1 --2- 172.21.15.53:0/3900292850 >> v2:172.21.15.117:3300/0 conn(0x7f98800afd10 0x7f98800c83f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:23.418 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.408+0000 7f9884a77640 1 -- 172.21.15.53:0/3900292850 >> v1:172.21.15.53:6789/0 conn(0x7f98801571a0 legacy=0x7f98800c9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:23.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.408+0000 7f9884a77640 1 -- 172.21.15.53:0/3900292850 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9880070860 con 0x7f9880070100 2023-06-10T19:08:23.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.412+0000 7f9884a77640 1 --2- 172.21.15.53:0/3900292850 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9880070100 0x7f98800af7d0 secure :-1 s=READY pgs=2654 cs=0 l=1 rev1=1 crypto rx=0x7f98700097c0 tx=0x7f987001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=219a3b92a311d59d server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:23.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.412+0000 7f9877fff640 1 -- 172.21.15.53:0/3900292850 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98700ab610 con 0x7f9880070100 2023-06-10T19:08:23.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.412+0000 7f9877fff640 1 -- 172.21.15.53:0/3900292850 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98700ab770 con 0x7f9880070100 2023-06-10T19:08:23.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.412+0000 7f9877fff640 1 -- 172.21.15.53:0/3900292850 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98700abb00 con 0x7f9880070100 2023-06-10T19:08:23.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.412+0000 7f98874dc640 1 -- 172.21.15.53:0/3900292850 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9880070100 msgr2=0x7f98800af7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:23.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.412+0000 7f98874dc640 1 --2- 172.21.15.53:0/3900292850 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9880070100 0x7f98800af7d0 secure :-1 s=READY pgs=2654 cs=0 l=1 rev1=1 crypto rx=0x7f98700097c0 tx=0x7f987001c410 comp rx=0 tx=0).stop 2023-06-10T19:08:23.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.412+0000 7f98874dc640 1 -- 172.21.15.53:0/3900292850 shutdown_connections 2023-06-10T19:08:23.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.412+0000 7f98874dc640 1 --2- 172.21.15.53:0/3900292850 >> v2:172.21.15.117:3300/0 conn(0x7f98800afd10 0x7f98800c83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:23.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.412+0000 7f98874dc640 1 --2- 172.21.15.53:0/3900292850 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9880070100 0x7f98800af7d0 secure :-1 s=CLOSED pgs=2654 cs=0 l=1 rev1=1 crypto rx=0x7f98700097c0 tx=0x7f987001c410 comp rx=0 tx=0).stop 2023-06-10T19:08:23.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.412+0000 7f98874dc640 1 -- 172.21.15.53:0/3900292850 >> 172.21.15.53:0/3900292850 conn(0x7f98800ce9e0 msgr2=0x7f98800ca7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:23.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.412+0000 7f98874dc640 1 -- 172.21.15.53:0/3900292850 shutdown_connections 2023-06-10T19:08:23.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.412+0000 7f98874dc640 1 -- 172.21.15.53:0/3900292850 wait complete. 2023-06-10T19:08:23.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.412+0000 7f98874dc640 1 Processor -- start 2023-06-10T19:08:23.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.412+0000 7f98874dc640 1 -- start start 2023-06-10T19:08:23.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.416+0000 7f98874dc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98800afd10 0x7f9880155440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:23.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.416+0000 7f98874dc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98801571a0 0x7f9880156240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:23.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.416+0000 7f98874dc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9880156780 0x7f988014d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:23.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.416+0000 7f98874dc640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f988014e650 con 0x7f9880156780 2023-06-10T19:08:23.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.416+0000 7f98874dc640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98801509a0 con 0x7f98801571a0 2023-06-10T19:08:23.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.416+0000 7f98874dc640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98800c3720 con 0x7f98800afd10 2023-06-10T19:08:23.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.416+0000 7f9885a79640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9880156780 0x7f988014d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:23.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.416+0000 7f9885a79640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9880156780 0x7f988014d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48318/0 (socket says 172.21.15.53:48318) 2023-06-10T19:08:23.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.416+0000 7f9885a79640 1 -- 172.21.15.53:0/3198782659 learned_addr learned my addr 172.21.15.53:0/3198782659 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:08:23.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.416+0000 7f9885a79640 1 -- 172.21.15.53:0/3198782659 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98800afd10 msgr2=0x7f9880155440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:23.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.416+0000 7f9885a79640 1 --2- 172.21.15.53:0/3198782659 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98800afd10 0x7f9880155440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:23.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.416+0000 7f9885a79640 1 -- 172.21.15.53:0/3198782659 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98801571a0 msgr2=0x7f9880156240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:23.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.416+0000 7f9884a77640 1 --2- 172.21.15.53:0/3198782659 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98801571a0 0x7f9880156240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:23.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.416+0000 7f9885a79640 1 --2- 172.21.15.53:0/3198782659 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98801571a0 0x7f9880156240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:23.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.416+0000 7f9885a79640 1 -- 172.21.15.53:0/3198782659 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9870009420 con 0x7f9880156780 2023-06-10T19:08:23.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.416+0000 7f9885a79640 1 --2- 172.21.15.53:0/3198782659 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9880156780 0x7f988014d900 secure :-1 s=READY pgs=2655 cs=0 l=1 rev1=1 crypto rx=0x7f9878007e40 tx=0x7f987800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:23.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.416+0000 7f9875ffb640 1 -- 172.21.15.53:0/3198782659 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9878014620 con 0x7f9880156780 2023-06-10T19:08:23.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.416+0000 7f9875ffb640 1 -- 172.21.15.53:0/3198782659 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f987800ee90 con 0x7f9880156780 2023-06-10T19:08:23.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.416+0000 7f9875ffb640 1 -- 172.21.15.53:0/3198782659 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98780149e0 con 0x7f9880156780 2023-06-10T19:08:23.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.416+0000 7f98874dc640 1 -- 172.21.15.53:0/3198782659 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98800c3a00 con 0x7f9880156780 2023-06-10T19:08:23.428 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.416+0000 7f98874dc640 1 -- 172.21.15.53:0/3198782659 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98800c3fc0 con 0x7f9880156780 2023-06-10T19:08:23.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.416+0000 7f98874dc640 1 -- 172.21.15.53:0/3198782659 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f988014e7c0 con 0x7f9880156780 2023-06-10T19:08:23.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.416+0000 7f9875ffb640 1 -- 172.21.15.53:0/3198782659 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9878014b40 con 0x7f9880156780 2023-06-10T19:08:23.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.416+0000 7f9875ffb640 1 --2- 172.21.15.53:0/3198782659 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9864066280 0x7f9864068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:23.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.416+0000 7f9875ffb640 1 -- 172.21.15.53:0/3198782659 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f98780846d0 con 0x7f9880156780 2023-06-10T19:08:23.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.416+0000 7f9885278640 1 --2- 172.21.15.53:0/3198782659 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9864066280 0x7f9864068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:23.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.420+0000 7f9885278640 1 --2- 172.21.15.53:0/3198782659 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9864066280 0x7f9864068730 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f987c001370 tx=0x7f987c0077d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:23.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.420+0000 7f9875ffb640 1 -- 172.21.15.53:0/3198782659 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f988014e7c0 con 0x7f9880156780 2023-06-10T19:08:23.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.580+0000 7f98874dc640 1 -- 172.21.15.53:0/3198782659 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f98800c41b0 con 0x7f9880156780 2023-06-10T19:08:23.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.580+0000 7f9875ffb640 1 -- 172.21.15.53:0/3198782659 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v180) v1 ==== 80+0+0 (secure 0 0 0) 0x7f98780555e0 con 0x7f9880156780 2023-06-10T19:08:23.586 INFO:teuthology.orchestra.run.smithi053.stderr:listed 0 entries 2023-06-10T19:08:23.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.584+0000 7f98874dc640 1 -- 172.21.15.53:0/3198782659 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9864066280 msgr2=0x7f9864068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:23.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.584+0000 7f98874dc640 1 --2- 172.21.15.53:0/3198782659 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9864066280 0x7f9864068730 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f987c001370 tx=0x7f987c0077d0 comp rx=0 tx=0).stop 2023-06-10T19:08:23.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.584+0000 7f98874dc640 1 -- 172.21.15.53:0/3198782659 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9880156780 msgr2=0x7f988014d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:23.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.584+0000 7f98874dc640 1 --2- 172.21.15.53:0/3198782659 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9880156780 0x7f988014d900 secure :-1 s=READY pgs=2655 cs=0 l=1 rev1=1 crypto rx=0x7f9878007e40 tx=0x7f987800e4b0 comp rx=0 tx=0).stop 2023-06-10T19:08:23.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.584+0000 7f98874dc640 1 -- 172.21.15.53:0/3198782659 shutdown_connections 2023-06-10T19:08:23.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.584+0000 7f98874dc640 1 --2- 172.21.15.53:0/3198782659 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9864066280 0x7f9864068730 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:23.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.584+0000 7f98874dc640 1 --2- 172.21.15.53:0/3198782659 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9880156780 0x7f988014d900 unknown :-1 s=CLOSED pgs=2655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:23.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.584+0000 7f98874dc640 1 --2- 172.21.15.53:0/3198782659 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98801571a0 0x7f9880156240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:23.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.584+0000 7f98874dc640 1 --2- 172.21.15.53:0/3198782659 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98800afd10 0x7f9880155440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:23.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.584+0000 7f98874dc640 1 -- 172.21.15.53:0/3198782659 >> 172.21.15.53:0/3198782659 conn(0x7f98800ce9e0 msgr2=0x7f98800cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:23.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.584+0000 7f98874dc640 1 -- 172.21.15.53:0/3198782659 shutdown_connections 2023-06-10T19:08:23.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:23.584+0000 7f98874dc640 1 -- 172.21.15.53:0/3198782659 wait complete. 2023-06-10T19:08:23.603 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi053.front.sepia.ceph.com... 2023-06-10T19:08:23.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:08:23.604 DEBUG:teuthology.orchestra.run.smithi053:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-06-10T19:08:23.612 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[70880]: fuse finished with error 0 and tester_r 0 2023-06-10T19:08:23.614 INFO:teuthology.orchestra.run:waiting for 300 2023-06-10T19:08:29.715 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi053.front.sepia.ceph.com 2023-06-10T19:08:29.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:08:29.716 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-06-10T19:08:29.723 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-10T19:08:29.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:29.896+0000 7fdd7ed5f640 1 Processor -- start 2023-06-10T19:08:29.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:29.896+0000 7fdd7ed5f640 1 -- start start 2023-06-10T19:08:29.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:29.896+0000 7fdd7ed5f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fdd780b3ac0 0x7fdd780b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:29.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:29.896+0000 7fdd7ed5f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd780cc690 0x7fdd7815f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:29.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:29.896+0000 7fdd7ed5f640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd780d0020 con 0x7fdd780ccae0 2023-06-10T19:08:29.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:29.896+0000 7fdd7ed5f640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd780b43d0 con 0x7fdd780b3ac0 2023-06-10T19:08:29.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:29.896+0000 7fdd7ed5f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd780cef40 con 0x7fdd780cc690 2023-06-10T19:08:29.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:29.896+0000 7fdd7d2fc640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fdd780ccae0 0x7fdd7815f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:43400/0 (socket says 172.21.15.53:43400) 2023-06-10T19:08:29.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:29.896+0000 7fdd7d2fc640 1 -- 172.21.15.53:0/1263758376 learned_addr learned my addr 172.21.15.53:0/1263758376 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:08:29.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:29.896+0000 7fdd7cafb640 1 --2- 172.21.15.53:0/1263758376 >> v2:172.21.15.53:3300/0 conn(0x7fdd780b3ac0 0x7fdd780b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:29.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:29.896+0000 7fdd77fff640 1 --2- 172.21.15.53:0/1263758376 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd780cc690 0x7fdd7815f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:29.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:29.896+0000 7fdd777fe640 1 -- 172.21.15.53:0/1263758376 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2145950439 0 0) 0x7fdd780d0020 con 0x7fdd780ccae0 2023-06-10T19:08:29.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:29.896+0000 7fdd777fe640 1 -- 172.21.15.53:0/1263758376 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd60003530 con 0x7fdd780ccae0 2023-06-10T19:08:29.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:29.896+0000 7fdd7cafb640 1 -- 172.21.15.53:0/1263758376 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd780cc690 msgr2=0x7fdd7815f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:29.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:29.896+0000 7fdd7cafb640 1 --2- 172.21.15.53:0/1263758376 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd780cc690 0x7fdd7815f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:29.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:29.896+0000 7fdd7cafb640 1 -- 172.21.15.53:0/1263758376 >> v1:172.21.15.53:6789/0 conn(0x7fdd780ccae0 legacy=0x7fdd7815f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:29.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:29.896+0000 7fdd7cafb640 1 -- 172.21.15.53:0/1263758376 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd780cf220 con 0x7fdd780b3ac0 2023-06-10T19:08:29.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:29.896+0000 7fdd7cafb640 1 --2- 172.21.15.53:0/1263758376 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd780b3ac0 0x7fdd780b3e90 secure :-1 s=READY pgs=2657 cs=0 l=1 rev1=1 crypto rx=0x7fdd680097c0 tx=0x7fdd6801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=540b9096b6566d75 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:29.904 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:29.900+0000 7fdd777fe640 1 -- 172.21.15.53:0/1263758376 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd680ad660 con 0x7fdd780b3ac0 2023-06-10T19:08:29.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:29.900+0000 7fdd777fe640 1 -- 172.21.15.53:0/1263758376 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd680ad7c0 con 0x7fdd780b3ac0 2023-06-10T19:08:29.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:29.900+0000 7fdd777fe640 1 -- 172.21.15.53:0/1263758376 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd680adb50 con 0x7fdd780b3ac0 2023-06-10T19:08:29.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:29.900+0000 7fdd7ed5f640 1 -- 172.21.15.53:0/1263758376 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd780b3ac0 msgr2=0x7fdd780b3e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:29.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:29.900+0000 7fdd7ed5f640 1 --2- 172.21.15.53:0/1263758376 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd780b3ac0 0x7fdd780b3e90 secure :-1 s=READY pgs=2657 cs=0 l=1 rev1=1 crypto rx=0x7fdd680097c0 tx=0x7fdd6801c450 comp rx=0 tx=0).stop 2023-06-10T19:08:29.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:29.900+0000 7fdd7ed5f640 1 -- 172.21.15.53:0/1263758376 shutdown_connections 2023-06-10T19:08:29.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:29.900+0000 7fdd7ed5f640 1 --2- 172.21.15.53:0/1263758376 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd780cc690 0x7fdd7815f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:29.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:29.900+0000 7fdd7ed5f640 1 --2- 172.21.15.53:0/1263758376 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd780b3ac0 0x7fdd780b3e90 unknown :-1 s=CLOSED pgs=2657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:29.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:29.900+0000 7fdd7ed5f640 1 -- 172.21.15.53:0/1263758376 >> 172.21.15.53:0/1263758376 conn(0x7fdd78071790 msgr2=0x7fdd78069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:29.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:29.900+0000 7fdd7ed5f640 1 -- 172.21.15.53:0/1263758376 shutdown_connections 2023-06-10T19:08:29.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:29.900+0000 7fdd7ed5f640 1 -- 172.21.15.53:0/1263758376 wait complete. 2023-06-10T19:08:29.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:29.900+0000 7fdd7ed5f640 1 Processor -- start 2023-06-10T19:08:29.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:29.900+0000 7fdd7ed5f640 1 -- start start 2023-06-10T19:08:29.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:29.900+0000 7fdd7ed5f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd780b3ac0 0x7fdd781f7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:29.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:29.900+0000 7fdd7ed5f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd780cc690 0x7fdd7815b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:29.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:29.900+0000 7fdd7ed5f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd780ccae0 0x7fdd7815f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:29.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:29.900+0000 7fdd7ed5f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd78152470 con 0x7fdd780cc690 2023-06-10T19:08:29.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:29.900+0000 7fdd7ed5f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd7815bac0 con 0x7fdd780b3ac0 2023-06-10T19:08:29.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:29.900+0000 7fdd7ed5f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd781f80f0 con 0x7fdd780ccae0 2023-06-10T19:08:29.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:29.900+0000 7fdd77fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd780cc690 0x7fdd7815b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:29.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:29.900+0000 7fdd77fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd780cc690 0x7fdd7815b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:48328/0 (socket says 172.21.15.53:48328) 2023-06-10T19:08:29.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:29.900+0000 7fdd77fff640 1 -- 172.21.15.53:0/1159796047 learned_addr learned my addr 172.21.15.53:0/1159796047 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:08:29.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:29.900+0000 7fdd7cafb640 1 --2- 172.21.15.53:0/1159796047 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd780b3ac0 0x7fdd781f7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:29.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:29.900+0000 7fdd77fff640 1 -- 172.21.15.53:0/1159796047 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd780ccae0 msgr2=0x7fdd7815f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:29.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:29.900+0000 7fdd77fff640 1 --2- 172.21.15.53:0/1159796047 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd780ccae0 0x7fdd7815f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:29.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:29.900+0000 7fdd77fff640 1 -- 172.21.15.53:0/1159796047 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd780b3ac0 msgr2=0x7fdd781f7b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:29.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:29.900+0000 7fdd77fff640 1 --2- 172.21.15.53:0/1159796047 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd780b3ac0 0x7fdd781f7b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:29.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:29.900+0000 7fdd77fff640 1 -- 172.21.15.53:0/1159796047 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd68009420 con 0x7fdd780cc690 2023-06-10T19:08:29.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:29.900+0000 7fdd77fff640 1 --2- 172.21.15.53:0/1159796047 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd780cc690 0x7fdd7815b580 secure :-1 s=READY pgs=2658 cs=0 l=1 rev1=1 crypto rx=0x7fdd6c00d800 tx=0x7fdd6c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:29.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:29.900+0000 7fdd757fa640 1 -- 172.21.15.53:0/1159796047 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd6c00b6c0 con 0x7fdd780cc690 2023-06-10T19:08:29.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:29.900+0000 7fdd757fa640 1 -- 172.21.15.53:0/1159796047 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd6c00b820 con 0x7fdd780cc690 2023-06-10T19:08:29.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:29.900+0000 7fdd7ed5f640 1 -- 172.21.15.53:0/1159796047 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd781f83d0 con 0x7fdd780cc690 2023-06-10T19:08:29.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:29.900+0000 7fdd757fa640 1 -- 172.21.15.53:0/1159796047 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd6c00bb90 con 0x7fdd780cc690 2023-06-10T19:08:29.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:29.900+0000 7fdd7ed5f640 1 -- 172.21.15.53:0/1159796047 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd781f8990 con 0x7fdd780cc690 2023-06-10T19:08:29.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:29.904+0000 7fdd7ed5f640 1 -- 172.21.15.53:0/1159796047 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd7804d790 con 0x7fdd780cc690 2023-06-10T19:08:29.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:29.904+0000 7fdd757fa640 1 -- 172.21.15.53:0/1159796047 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdd6c00bcf0 con 0x7fdd780cc690 2023-06-10T19:08:29.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:29.904+0000 7fdd757fa640 1 --2- 172.21.15.53:0/1159796047 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdd640662b0 0x7fdd64068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:29.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:29.904+0000 7fdd757fa640 1 -- 172.21.15.53:0/1159796047 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 6149+0+0 (secure 0 0 0) 0x7fdd6c084290 con 0x7fdd780cc690 2023-06-10T19:08:29.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:29.904+0000 7fdd7cafb640 1 --2- 172.21.15.53:0/1159796047 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdd640662b0 0x7fdd64068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:29.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:29.904+0000 7fdd7cafb640 1 --2- 172.21.15.53:0/1159796047 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdd640662b0 0x7fdd64068760 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7fdd680af000 tx=0x7fdd68008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:29.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:29.908+0000 7fdd757fa640 1 -- 172.21.15.53:0/1159796047 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdd6c051740 con 0x7fdd780cc690 2023-06-10T19:08:30.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:30.096+0000 7fdd7ed5f640 1 -- 172.21.15.53:0/1159796047 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fdd780cc1d0 con 0x7fdd780cc690 2023-06-10T19:08:30.101 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:30.096+0000 7fdd757fa640 1 -- 172.21.15.53:0/1159796047 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v104) v1 ==== 53+0+73 (secure 0 0 0) 0x7fdd6c054d60 con 0x7fdd780cc690 2023-06-10T19:08:30.101 INFO:teuthology.orchestra.run.smithi053.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-06-10T19:08:30.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:30.100+0000 7fdd7ed5f640 1 -- 172.21.15.53:0/1159796047 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdd640662b0 msgr2=0x7fdd64068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:30.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:30.100+0000 7fdd7ed5f640 1 --2- 172.21.15.53:0/1159796047 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdd640662b0 0x7fdd64068760 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7fdd680af000 tx=0x7fdd68008040 comp rx=0 tx=0).stop 2023-06-10T19:08:30.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:30.100+0000 7fdd7ed5f640 1 -- 172.21.15.53:0/1159796047 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd780cc690 msgr2=0x7fdd7815b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:30.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:30.100+0000 7fdd7ed5f640 1 --2- 172.21.15.53:0/1159796047 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd780cc690 0x7fdd7815b580 secure :-1 s=READY pgs=2658 cs=0 l=1 rev1=1 crypto rx=0x7fdd6c00d800 tx=0x7fdd6c00dcc0 comp rx=0 tx=0).stop 2023-06-10T19:08:30.103 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:30.100+0000 7fdd7ed5f640 1 -- 172.21.15.53:0/1159796047 shutdown_connections 2023-06-10T19:08:30.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:30.100+0000 7fdd7ed5f640 1 --2- 172.21.15.53:0/1159796047 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdd640662b0 0x7fdd64068760 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:30.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:30.100+0000 7fdd7ed5f640 1 --2- 172.21.15.53:0/1159796047 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd780ccae0 0x7fdd7815f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:30.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:30.100+0000 7fdd7ed5f640 1 --2- 172.21.15.53:0/1159796047 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd780cc690 0x7fdd7815b580 unknown :-1 s=CLOSED pgs=2658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:30.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:30.100+0000 7fdd7ed5f640 1 --2- 172.21.15.53:0/1159796047 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd780b3ac0 0x7fdd781f7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:30.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:30.100+0000 7fdd7ed5f640 1 -- 172.21.15.53:0/1159796047 >> 172.21.15.53:0/1159796047 conn(0x7fdd78071790 msgr2=0x7fdd78158610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:30.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:30.100+0000 7fdd7ed5f640 1 -- 172.21.15.53:0/1159796047 shutdown_connections 2023-06-10T19:08:30.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:30.100+0000 7fdd7ed5f640 1 -- 172.21.15.53:0/1159796047 wait complete. 2023-06-10T19:08:30.121 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-10T19:08:30.121 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-10T19:08:30.121 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi053.front.sepia.ceph.com 2023-06-10T19:08:30.122 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-06-10T19:08:30.122 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-06-10T19:08:30.122 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-10T19:08:30.122 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-10T19:08:30.123 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-10T19:08:30.123 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-06-10T19:08:30.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:08:30.124 DEBUG:teuthology.orchestra.run.smithi053:> ip addr 2023-06-10T19:08:30.130 INFO:teuthology.orchestra.run.smithi053.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-10T19:08:30.131 INFO:teuthology.orchestra.run.smithi053.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-10T19:08:30.131 INFO:teuthology.orchestra.run.smithi053.stdout: inet 127.0.0.1/8 scope host lo 2023-06-10T19:08:30.131 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:08:30.131 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 ::1/128 scope host 2023-06-10T19:08:30.131 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:08:30.131 INFO:teuthology.orchestra.run.smithi053.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T19:08:30.132 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:da brd ff:ff:ff:ff:ff:ff 2023-06-10T19:08:30.132 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f0 2023-06-10T19:08:30.132 INFO:teuthology.orchestra.run.smithi053.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T19:08:30.132 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0c:c4:7a:6b:fd:db brd ff:ff:ff:ff:ff:ff 2023-06-10T19:08:30.132 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp7s0f1 2023-06-10T19:08:30.132 INFO:teuthology.orchestra.run.smithi053.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-10T19:08:30.132 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:18 brd ff:ff:ff:ff:ff:ff 2023-06-10T19:08:30.133 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f0 2023-06-10T19:08:30.133 INFO:teuthology.orchestra.run.smithi053.stdout: inet 172.21.15.53/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-06-10T19:08:30.133 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft 41539sec preferred_lft 41539sec 2023-06-10T19:08:30.133 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::ae1f:6bff:fef8:3718/64 scope link 2023-06-10T19:08:30.133 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:08:30.133 INFO:teuthology.orchestra.run.smithi053.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-10T19:08:30.133 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ac:1f:6b:f8:37:19 brd ff:ff:ff:ff:ff:ff 2023-06-10T19:08:30.134 INFO:teuthology.orchestra.run.smithi053.stdout: altname enp1s0f1 2023-06-10T19:08:30.134 INFO:teuthology.orchestra.run.smithi053.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-06-10T19:08:30.134 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 02:42:49:3d:ee:1e brd ff:ff:ff:ff:ff:ff 2023-06-10T19:08:30.134 INFO:teuthology.orchestra.run.smithi053.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-06-10T19:08:30.134 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:08:30.134 INFO:teuthology.orchestra.run.smithi053.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-10T19:08:30.135 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-06-10T19:08:30.135 INFO:teuthology.orchestra.run.smithi053.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-06-10T19:08:30.135 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:08:30.135 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-06-10T19:08:30.135 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:08:30.136 INFO:teuthology.orchestra.run.smithi053.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-10T19:08:30.136 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-06-10T19:08:30.136 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-06-10T19:08:30.136 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:08:30.137 INFO:teuthology.orchestra.run.smithi053.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-10T19:08:30.137 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-06-10T19:08:30.137 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-06-10T19:08:30.137 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:08:30.137 INFO:teuthology.orchestra.run.smithi053.stdout:10: brx.2@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-10T19:08:30.137 INFO:teuthology.orchestra.run.smithi053.stdout: link/ether ba:37:dd:38:ed:aa brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-06-10T19:08:30.138 INFO:teuthology.orchestra.run.smithi053.stdout: inet6 fe80::b837:ddff:fe38:edaa/64 scope link 2023-06-10T19:08:30.138 INFO:teuthology.orchestra.run.smithi053.stdout: valid_lft forever preferred_lft forever 2023-06-10T19:08:30.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:08:30.139 DEBUG:teuthology.orchestra.run.smithi053:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-10T19:08:30.184 INFO:teuthology.orchestra.run.smithi053.stdout:1 2023-06-10T19:08:30.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:08:30.186 DEBUG:teuthology.orchestra.run.smithi053:> route 2023-06-10T19:08:30.233 INFO:teuthology.orchestra.run.smithi053.stdout:Kernel IP routing table 2023-06-10T19:08:30.234 INFO:teuthology.orchestra.run.smithi053.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-10T19:08:30.234 INFO:teuthology.orchestra.run.smithi053.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-06-10T19:08:30.234 INFO:teuthology.orchestra.run.smithi053.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-06-10T19:08:30.234 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-06-10T19:08:30.234 INFO:teuthology.orchestra.run.smithi053.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-10T19:08:30.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:08:30.235 DEBUG:teuthology.orchestra.run.smithi053:> (cd / && exec bash -c ' 2023-06-10T19:08:30.235 DEBUG:teuthology.orchestra.run.smithi053:> set -e 2023-06-10T19:08:30.235 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-06-10T19:08:30.236 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-06-10T19:08:30.236 DEBUG:teuthology.orchestra.run.smithi053:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-06-10T19:08:30.236 DEBUG:teuthology.orchestra.run.smithi053:> ') 2023-06-10T19:08:30.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:08:30.308 DEBUG:teuthology.orchestra.run.smithi053:> ip netns list 2023-06-10T19:08:30.356 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 2) 2023-06-10T19:08:30.356 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-06-10T19:08:30.356 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-06-10T19:08:30.356 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-06-10T19:08:30.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:08:30.357 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link set brx.0 up 2023-06-10T19:08:30.412 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-06-10T19:08:30.412 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-10T19:08:30.413 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-06-10T19:08:30.460 INFO:teuthology.orchestra.run.smithi053.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-06-10T19:08:30.460 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-10T19:08:30.460 DEBUG:teuthology.orchestra.run.smithi053:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-06-10T19:08:30.507 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2023-06-10T19:08:30.564 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T19:08:30.565 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T19:08:30.619 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T19:08:30.620 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T19:08:30.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:08:30.621 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2023-06-10T19:08:30.667 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-06-10T19:08:30.668 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 --client_reconnect_stale=1 --fuse_disable_pagecache=1) 2023-06-10T19:08:30.716 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2023-06-10T19:08:30.730 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T19:08:30.730 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T19:08:30.786 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T19:08:30.787 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T19:08:30.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:08:30.788 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2023-06-10T19:08:30.801 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:2023-06-10T19:08:30.796+0000 7f0a1bd96580 -1 init, newargv = 0x5576b4d46f70 newargc=15 2023-06-10T19:08:30.801 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[71340]: starting ceph client 2023-06-10T19:08:30.808 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[71340]: starting fuse 2023-06-10T19:08:31.905 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe fuse 2023-06-10T19:08:31.923 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-10T19:08:31.924 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-10T19:08:31.979 INFO:teuthology.orchestra.run.smithi053.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-10T19:08:31.980 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-10T19:08:31.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:08:31.981 DEBUG:teuthology.orchestra.run.smithi053:> ls /sys/fs/fuse/connections 2023-06-10T19:08:32.027 INFO:teuthology.orchestra.run.smithi053.stdout:45 2023-06-10T19:08:32.028 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-06-10T19:08:32.028 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-06-10T19:08:32.028 DEBUG:teuthology.orchestra.run.smithi053:> import glob 2023-06-10T19:08:32.029 DEBUG:teuthology.orchestra.run.smithi053:> import re 2023-06-10T19:08:32.029 DEBUG:teuthology.orchestra.run.smithi053:> import os 2023-06-10T19:08:32.029 DEBUG:teuthology.orchestra.run.smithi053:> import subprocess 2023-06-10T19:08:32.030 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:08:32.030 DEBUG:teuthology.orchestra.run.smithi053:> def _find_admin_socket(client_name): 2023-06-10T19:08:32.030 DEBUG:teuthology.orchestra.run.smithi053:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-06-10T19:08:32.030 DEBUG:teuthology.orchestra.run.smithi053:> files = glob.glob(asok_path) 2023-06-10T19:08:32.031 DEBUG:teuthology.orchestra.run.smithi053:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-06-10T19:08:32.031 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:08:32.031 DEBUG:teuthology.orchestra.run.smithi053:> # Given a non-glob path, it better be there 2023-06-10T19:08:32.032 DEBUG:teuthology.orchestra.run.smithi053:> if "*" not in asok_path: 2023-06-10T19:08:32.032 DEBUG:teuthology.orchestra.run.smithi053:> assert(len(files) == 1) 2023-06-10T19:08:32.032 DEBUG:teuthology.orchestra.run.smithi053:> return files[0] 2023-06-10T19:08:32.033 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:08:32.033 DEBUG:teuthology.orchestra.run.smithi053:> for f in files: 2023-06-10T19:08:32.033 DEBUG:teuthology.orchestra.run.smithi053:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-06-10T19:08:32.033 DEBUG:teuthology.orchestra.run.smithi053:> if os.path.exists("/proc/{0}".format(pid)): 2023-06-10T19:08:32.034 DEBUG:teuthology.orchestra.run.smithi053:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-06-10T19:08:32.034 DEBUG:teuthology.orchestra.run.smithi053:> contents = proc_f.read() 2023-06-10T19:08:32.034 DEBUG:teuthology.orchestra.run.smithi053:> if mountpoint in contents: 2023-06-10T19:08:32.035 DEBUG:teuthology.orchestra.run.smithi053:> return f 2023-06-10T19:08:32.035 DEBUG:teuthology.orchestra.run.smithi053:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-06-10T19:08:32.035 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:08:32.035 DEBUG:teuthology.orchestra.run.smithi053:> print(_find_admin_socket("client.0")) 2023-06-10T19:08:32.036 DEBUG:teuthology.orchestra.run.smithi053:> ' 2023-06-10T19:08:32.151 INFO:teuthology.orchestra.run.smithi053.stdout:/var/run/ceph/ceph-client.0.71340.asok 2023-06-10T19:08:32.334 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.71340.asok 2023-06-10T19:08:32.334 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:08:32.335 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.71340.asok status 2023-06-10T19:08:32.497 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-06-10T19:08:32.498 INFO:teuthology.orchestra.run.smithi053.stdout: "metadata": { 2023-06-10T19:08:32.498 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_sha1": "219d315c3a0b2075e570fb1964be2ad33fe7a9c8", 2023-06-10T19:08:32.498 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_version": "ceph version 18.0.0-4359-g219d315c (219d315c3a0b2075e570fb1964be2ad33fe7a9c8) reef (dev)", 2023-06-10T19:08:32.498 INFO:teuthology.orchestra.run.smithi053.stdout: "entity_id": "0", 2023-06-10T19:08:32.498 INFO:teuthology.orchestra.run.smithi053.stdout: "hostname": "smithi053", 2023-06-10T19:08:32.498 INFO:teuthology.orchestra.run.smithi053.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-06-10T19:08:32.498 INFO:teuthology.orchestra.run.smithi053.stdout: "pid": "71340", 2023-06-10T19:08:32.499 INFO:teuthology.orchestra.run.smithi053.stdout: "root": "/" 2023-06-10T19:08:32.499 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:08:32.499 INFO:teuthology.orchestra.run.smithi053.stdout: "dentry_count": 0, 2023-06-10T19:08:32.499 INFO:teuthology.orchestra.run.smithi053.stdout: "dentry_pinned_count": 0, 2023-06-10T19:08:32.499 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 11412, 2023-06-10T19:08:32.499 INFO:teuthology.orchestra.run.smithi053.stdout: "inst": { 2023-06-10T19:08:32.500 INFO:teuthology.orchestra.run.smithi053.stdout: "name": { 2023-06-10T19:08:32.500 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "client", 2023-06-10T19:08:32.500 INFO:teuthology.orchestra.run.smithi053.stdout: "num": 11412 2023-06-10T19:08:32.500 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:08:32.500 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": { 2023-06-10T19:08:32.501 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2023-06-10T19:08:32.501 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "192.168.0.1:0", 2023-06-10T19:08:32.502 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 3824904337 2023-06-10T19:08:32.502 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:08:32.502 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:08:32.503 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": { 2023-06-10T19:08:32.503 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2023-06-10T19:08:32.503 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "192.168.0.1:0", 2023-06-10T19:08:32.503 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 3824904337 2023-06-10T19:08:32.503 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:08:32.503 INFO:teuthology.orchestra.run.smithi053.stdout: "inst_str": "client.11412 192.168.0.1:0/3824904337", 2023-06-10T19:08:32.503 INFO:teuthology.orchestra.run.smithi053.stdout: "addr_str": "192.168.0.1:0/3824904337", 2023-06-10T19:08:32.504 INFO:teuthology.orchestra.run.smithi053.stdout: "inode_count": 1, 2023-06-10T19:08:32.504 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_epoch": 104, 2023-06-10T19:08:32.504 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_epoch": 182, 2023-06-10T19:08:32.504 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_epoch_barrier": 0, 2023-06-10T19:08:32.504 INFO:teuthology.orchestra.run.smithi053.stdout: "blocklisted": false, 2023-06-10T19:08:32.504 INFO:teuthology.orchestra.run.smithi053.stdout: "fs_name": "cephfs" 2023-06-10T19:08:32.504 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-06-10T19:08:32.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:08:32.511 DEBUG:teuthology.orchestra.run.smithi053:> stat --file-system '--printf=%T 2023-06-10T19:08:32.512 DEBUG:teuthology.orchestra.run.smithi053:> ' -- /home/ubuntu/cephtest/mnt.0 2023-06-10T19:08:32.517 INFO:teuthology.orchestra.run.smithi053.stdout:fuseblk 2023-06-10T19:08:32.518 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-06-10T19:08:32.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:08:32.518 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-06-10T19:08:32.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:08:32.571 DEBUG:teuthology.orchestra.run.smithi053:> stat --file-system '--printf=%T 2023-06-10T19:08:32.571 DEBUG:teuthology.orchestra.run.smithi053:> ' -- /home/ubuntu/cephtest/mnt.0 2023-06-10T19:08:32.620 INFO:teuthology.orchestra.run.smithi053.stdout:fuseblk 2023-06-10T19:08:32.620 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-06-10T19:08:32.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:08:32.621 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-06-10T19:08:32.676 DEBUG:teuthology.orchestra.run.smithi053:> python3 -c ' 2023-06-10T19:08:32.677 DEBUG:teuthology.orchestra.run.smithi053:> import os 2023-06-10T19:08:32.678 DEBUG:teuthology.orchestra.run.smithi053:> import sys 2023-06-10T19:08:32.678 DEBUG:teuthology.orchestra.run.smithi053:> import fcntl 2023-06-10T19:08:32.679 DEBUG:teuthology.orchestra.run.smithi053:> import errno 2023-06-10T19:08:32.679 DEBUG:teuthology.orchestra.run.smithi053:> import time 2023-06-10T19:08:32.680 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:08:32.681 DEBUG:teuthology.orchestra.run.smithi053:> fd1 = os.open("/home/ubuntu/cephtest/mnt.0/testfile_reconnect_after_blocklisted.1", os.O_RDWR | os.O_CREAT, 0O666) 2023-06-10T19:08:32.681 DEBUG:teuthology.orchestra.run.smithi053:> fd2 = os.open("/home/ubuntu/cephtest/mnt.0/testfile_reconnect_after_blocklisted.1", os.O_RDONLY) 2023-06-10T19:08:32.682 DEBUG:teuthology.orchestra.run.smithi053:> fd3 = os.open("/home/ubuntu/cephtest/mnt.0/testfile_reconnect_after_blocklisted.2", os.O_RDWR | os.O_CREAT, 0O666) 2023-06-10T19:08:32.682 DEBUG:teuthology.orchestra.run.smithi053:> fd4 = os.open("/home/ubuntu/cephtest/mnt.0/testfile_reconnect_after_blocklisted.2", os.O_RDONLY) 2023-06-10T19:08:32.683 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:08:32.683 DEBUG:teuthology.orchestra.run.smithi053:> os.write(fd1, b'"'"'content'"'"') 2023-06-10T19:08:32.683 DEBUG:teuthology.orchestra.run.smithi053:> os.read(fd2, 1); 2023-06-10T19:08:32.684 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:08:32.684 DEBUG:teuthology.orchestra.run.smithi053:> os.write(fd3, b'"'"'content'"'"') 2023-06-10T19:08:32.684 DEBUG:teuthology.orchestra.run.smithi053:> os.read(fd4, 1); 2023-06-10T19:08:32.685 DEBUG:teuthology.orchestra.run.smithi053:> fcntl.flock(fd4, fcntl.LOCK_SH | fcntl.LOCK_NB) 2023-06-10T19:08:32.685 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:08:32.685 DEBUG:teuthology.orchestra.run.smithi053:> print("blocklist") 2023-06-10T19:08:32.686 DEBUG:teuthology.orchestra.run.smithi053:> sys.stdout.flush() 2023-06-10T19:08:32.686 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:08:32.686 DEBUG:teuthology.orchestra.run.smithi053:> sys.stdin.readline() 2023-06-10T19:08:32.686 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:08:32.687 DEBUG:teuthology.orchestra.run.smithi053:> # wait for mds to close session 2023-06-10T19:08:32.687 DEBUG:teuthology.orchestra.run.smithi053:> time.sleep(10); 2023-06-10T19:08:32.687 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:08:32.688 DEBUG:teuthology.orchestra.run.smithi053:> # trigger '"'"'open session'"'"' message. kclient relies on '"'"'session reject'"'"' message 2023-06-10T19:08:32.688 DEBUG:teuthology.orchestra.run.smithi053:> # to detect if itself is blocklisted 2023-06-10T19:08:32.688 DEBUG:teuthology.orchestra.run.smithi053:> try: 2023-06-10T19:08:32.689 DEBUG:teuthology.orchestra.run.smithi053:> os.stat("/home/ubuntu/cephtest/mnt.0/testfile_reconnect_after_blocklisted.1") 2023-06-10T19:08:32.689 DEBUG:teuthology.orchestra.run.smithi053:> except: 2023-06-10T19:08:32.690 DEBUG:teuthology.orchestra.run.smithi053:> pass 2023-06-10T19:08:32.690 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:08:32.690 DEBUG:teuthology.orchestra.run.smithi053:> # wait for auto reconnect 2023-06-10T19:08:32.690 DEBUG:teuthology.orchestra.run.smithi053:> time.sleep(10); 2023-06-10T19:08:32.691 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:08:32.691 DEBUG:teuthology.orchestra.run.smithi053:> try: 2023-06-10T19:08:32.691 DEBUG:teuthology.orchestra.run.smithi053:> os.write(fd1, b'"'"'content'"'"') 2023-06-10T19:08:32.691 DEBUG:teuthology.orchestra.run.smithi053:> except OSError as e: 2023-06-10T19:08:32.692 DEBUG:teuthology.orchestra.run.smithi053:> if e.errno != errno.EBADF: 2023-06-10T19:08:32.692 DEBUG:teuthology.orchestra.run.smithi053:> raise 2023-06-10T19:08:32.692 DEBUG:teuthology.orchestra.run.smithi053:> else: 2023-06-10T19:08:32.693 DEBUG:teuthology.orchestra.run.smithi053:> raise RuntimeError("write() failed to raise error") 2023-06-10T19:08:32.693 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:08:32.693 DEBUG:teuthology.orchestra.run.smithi053:> os.read(fd2, 1); 2023-06-10T19:08:32.693 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:08:32.694 DEBUG:teuthology.orchestra.run.smithi053:> try: 2023-06-10T19:08:32.694 DEBUG:teuthology.orchestra.run.smithi053:> os.read(fd4, 1) 2023-06-10T19:08:32.694 DEBUG:teuthology.orchestra.run.smithi053:> except OSError as e: 2023-06-10T19:08:32.694 DEBUG:teuthology.orchestra.run.smithi053:> if e.errno != errno.EIO: 2023-06-10T19:08:32.695 DEBUG:teuthology.orchestra.run.smithi053:> raise 2023-06-10T19:08:32.695 DEBUG:teuthology.orchestra.run.smithi053:> else: 2023-06-10T19:08:32.695 DEBUG:teuthology.orchestra.run.smithi053:> raise RuntimeError("read() failed to raise error") 2023-06-10T19:08:32.695 DEBUG:teuthology.orchestra.run.smithi053:> ' 2023-06-10T19:08:32.760 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-06-10T19:08:32.761 DEBUG:teuthology.orchestra.run.smithi053:> import glob 2023-06-10T19:08:32.761 DEBUG:teuthology.orchestra.run.smithi053:> import re 2023-06-10T19:08:32.761 DEBUG:teuthology.orchestra.run.smithi053:> import os 2023-06-10T19:08:32.762 DEBUG:teuthology.orchestra.run.smithi053:> import subprocess 2023-06-10T19:08:32.762 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:08:32.763 DEBUG:teuthology.orchestra.run.smithi053:> def _find_admin_socket(client_name): 2023-06-10T19:08:32.763 DEBUG:teuthology.orchestra.run.smithi053:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-06-10T19:08:32.764 DEBUG:teuthology.orchestra.run.smithi053:> files = glob.glob(asok_path) 2023-06-10T19:08:32.764 DEBUG:teuthology.orchestra.run.smithi053:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-06-10T19:08:32.765 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:08:32.765 DEBUG:teuthology.orchestra.run.smithi053:> # Given a non-glob path, it better be there 2023-06-10T19:08:32.766 DEBUG:teuthology.orchestra.run.smithi053:> if "*" not in asok_path: 2023-06-10T19:08:32.766 DEBUG:teuthology.orchestra.run.smithi053:> assert(len(files) == 1) 2023-06-10T19:08:32.767 DEBUG:teuthology.orchestra.run.smithi053:> return files[0] 2023-06-10T19:08:32.767 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:08:32.767 DEBUG:teuthology.orchestra.run.smithi053:> for f in files: 2023-06-10T19:08:32.767 DEBUG:teuthology.orchestra.run.smithi053:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-06-10T19:08:32.768 DEBUG:teuthology.orchestra.run.smithi053:> if os.path.exists("/proc/{0}".format(pid)): 2023-06-10T19:08:32.768 DEBUG:teuthology.orchestra.run.smithi053:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-06-10T19:08:32.768 DEBUG:teuthology.orchestra.run.smithi053:> contents = proc_f.read() 2023-06-10T19:08:32.769 DEBUG:teuthology.orchestra.run.smithi053:> if mountpoint in contents: 2023-06-10T19:08:32.769 DEBUG:teuthology.orchestra.run.smithi053:> return f 2023-06-10T19:08:32.769 DEBUG:teuthology.orchestra.run.smithi053:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-06-10T19:08:32.769 DEBUG:teuthology.orchestra.run.smithi053:> 2023-06-10T19:08:32.770 DEBUG:teuthology.orchestra.run.smithi053:> print(_find_admin_socket("client.0")) 2023-06-10T19:08:32.770 DEBUG:teuthology.orchestra.run.smithi053:> ' 2023-06-10T19:08:32.849 INFO:teuthology.orchestra.run.smithi053.stdout:/var/run/ceph/ceph-client.0.71340.asok 2023-06-10T19:08:33.031 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.71340.asok 2023-06-10T19:08:33.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:08:33.033 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.71340.asok mds_sessions 2023-06-10T19:08:33.197 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-06-10T19:08:33.197 INFO:teuthology.orchestra.run.smithi053.stdout: "id": 11412, 2023-06-10T19:08:33.197 INFO:teuthology.orchestra.run.smithi053.stdout: "inst": { 2023-06-10T19:08:33.198 INFO:teuthology.orchestra.run.smithi053.stdout: "name": { 2023-06-10T19:08:33.198 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "client", 2023-06-10T19:08:33.198 INFO:teuthology.orchestra.run.smithi053.stdout: "num": 11412 2023-06-10T19:08:33.198 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:08:33.198 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": { 2023-06-10T19:08:33.198 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2023-06-10T19:08:33.198 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "192.168.0.1:0", 2023-06-10T19:08:33.199 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 3824904337 2023-06-10T19:08:33.199 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:08:33.199 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:08:33.199 INFO:teuthology.orchestra.run.smithi053.stdout: "inst_str": "client.11412 v1:192.168.0.1:0/3824904337", 2023-06-10T19:08:33.200 INFO:teuthology.orchestra.run.smithi053.stdout: "addr_str": "v1:192.168.0.1:0/3824904337", 2023-06-10T19:08:33.200 INFO:teuthology.orchestra.run.smithi053.stdout: "sessions": [ 2023-06-10T19:08:33.200 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:08:33.200 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": 0, 2023-06-10T19:08:33.201 INFO:teuthology.orchestra.run.smithi053.stdout: "addrs": { 2023-06-10T19:08:33.201 INFO:teuthology.orchestra.run.smithi053.stdout: "addrvec": [ 2023-06-10T19:08:33.201 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:08:33.201 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v2", 2023-06-10T19:08:33.201 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.53:6834", 2023-06-10T19:08:33.202 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 3732323283 2023-06-10T19:08:33.202 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:08:33.202 INFO:teuthology.orchestra.run.smithi053.stdout: { 2023-06-10T19:08:33.202 INFO:teuthology.orchestra.run.smithi053.stdout: "type": "v1", 2023-06-10T19:08:33.202 INFO:teuthology.orchestra.run.smithi053.stdout: "addr": "172.21.15.53:6835", 2023-06-10T19:08:33.202 INFO:teuthology.orchestra.run.smithi053.stdout: "nonce": 3732323283 2023-06-10T19:08:33.202 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:08:33.202 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2023-06-10T19:08:33.203 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-06-10T19:08:33.203 INFO:teuthology.orchestra.run.smithi053.stdout: "seq": 0, 2023-06-10T19:08:33.203 INFO:teuthology.orchestra.run.smithi053.stdout: "cap_gen": 0, 2023-06-10T19:08:33.203 INFO:teuthology.orchestra.run.smithi053.stdout: "cap_ttl": "2023-06-10T19:09:31.803885+0000", 2023-06-10T19:08:33.203 INFO:teuthology.orchestra.run.smithi053.stdout: "last_cap_renew_request": "2023-06-10T19:08:31.803885+0000", 2023-06-10T19:08:33.204 INFO:teuthology.orchestra.run.smithi053.stdout: "cap_renew_seq": 2, 2023-06-10T19:08:33.204 INFO:teuthology.orchestra.run.smithi053.stdout: "num_caps": 3, 2023-06-10T19:08:33.204 INFO:teuthology.orchestra.run.smithi053.stdout: "state": "open" 2023-06-10T19:08:33.204 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-06-10T19:08:33.204 INFO:teuthology.orchestra.run.smithi053.stdout: ], 2023-06-10T19:08:33.204 INFO:teuthology.orchestra.run.smithi053.stdout: "mdsmap_epoch": 104 2023-06-10T19:08:33.204 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-06-10T19:08:33.210 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:08:33.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.332+0000 7f63d9276640 1 Processor -- start 2023-06-10T19:08:33.335 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.332+0000 7f63d9276640 1 -- start start 2023-06-10T19:08:33.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.332+0000 7f63d9276640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f63d415b870 0x7f63d406a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:33.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.332+0000 7f63d9276640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63d40b03f0 0x7f63d4069b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:33.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.332+0000 7f63d9276640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63d406ae70 con 0x7f63d40affc0 2023-06-10T19:08:33.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.332+0000 7f63d9276640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63d40655c0 con 0x7f63d415b870 2023-06-10T19:08:33.336 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.332+0000 7f63d9276640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63d40cc110 con 0x7f63d40b03f0 2023-06-10T19:08:33.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.332+0000 7f63ca7fc640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f63d40affc0 0x7f63d4069450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:51348/0 (socket says 172.21.15.53:51348) 2023-06-10T19:08:33.337 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.332+0000 7f63ca7fc640 1 -- 172.21.15.53:0/1678836774 learned_addr learned my addr 172.21.15.53:0/1678836774 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:08:33.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.332+0000 7f63d37fe640 1 --2- 172.21.15.53:0/1678836774 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63d40b03f0 0x7f63d4069b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:33.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.332+0000 7f63d2ffd640 1 --2- 172.21.15.53:0/1678836774 >> v2:172.21.15.117:3300/0 conn(0x7f63d415b870 0x7f63d406a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:33.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.332+0000 7f63d27fc640 1 -- 172.21.15.53:0/1678836774 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2600506830 0 0) 0x7f63bc001120 con 0x7f63d40affc0 2023-06-10T19:08:33.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.332+0000 7f63d27fc640 1 -- 172.21.15.53:0/1678836774 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63c0003530 con 0x7f63d40affc0 2023-06-10T19:08:33.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.332+0000 7f63d27fc640 1 -- 172.21.15.53:0/1678836774 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3706712590 0 0) 0x7f63c0003530 con 0x7f63d40affc0 2023-06-10T19:08:33.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.332+0000 7f63d27fc640 1 -- 172.21.15.53:0/1678836774 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63d40b03f0 msgr2=0x7f63d4069b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:33.339 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.332+0000 7f63d27fc640 1 --2- 172.21.15.53:0/1678836774 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63d40b03f0 0x7f63d4069b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:33.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.332+0000 7f63d27fc640 1 -- 172.21.15.53:0/1678836774 >> v2:172.21.15.117:3300/0 conn(0x7f63d415b870 msgr2=0x7f63d406a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:33.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.332+0000 7f63d27fc640 1 --2- 172.21.15.53:0/1678836774 >> v2:172.21.15.117:3300/0 conn(0x7f63d415b870 0x7f63d406a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:33.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.332+0000 7f63d27fc640 1 -- 172.21.15.53:0/1678836774 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63d40cc3f0 con 0x7f63d40affc0 2023-06-10T19:08:33.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.332+0000 7f63d27fc640 1 -- 172.21.15.53:0/1678836774 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f63bc001810 con 0x7f63d40affc0 2023-06-10T19:08:33.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.332+0000 7f63d27fc640 1 -- 172.21.15.53:0/1678836774 >> v1:172.21.15.53:6789/0 conn(0x7f63d40affc0 legacy=0x7f63d4069450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:33.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.332+0000 7f63d27fc640 1 --2- 172.21.15.53:0/1678836774 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63c00039f0 0x7f63c0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:33.340 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.332+0000 7f63d27fc640 1 --2- 172.21.15.53:0/1678836774 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63d40b03f0 0x7f63c00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:33.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.332+0000 7f63d27fc640 1 --2- 172.21.15.53:0/1678836774 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63c0004d10 0x7f63c0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:33.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.332+0000 7f63d27fc640 1 -- 172.21.15.53:0/1678836774 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d40655c0 con 0x7f63c0004d10 2023-06-10T19:08:33.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.332+0000 7f63d27fc640 1 -- 172.21.15.53:0/1678836774 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d40cc110 con 0x7f63c00039f0 2023-06-10T19:08:33.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.332+0000 7f63d27fc640 1 -- 172.21.15.53:0/1678836774 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63c000b9e0 con 0x7f63d40b03f0 2023-06-10T19:08:33.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.332+0000 7f63d37fe640 1 --2- 172.21.15.53:0/1678836774 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63c0004d10 0x7f63c0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:33.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.332+0000 7f63ca7fc640 1 --2- 172.21.15.53:0/1678836774 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63d40b03f0 0x7f63c00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:33.341 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.332+0000 7f63d2ffd640 1 --2- 172.21.15.53:0/1678836774 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63c00039f0 0x7f63c0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:33.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.332+0000 7f63d37fe640 1 -- 172.21.15.53:0/1678836774 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63d40b03f0 msgr2=0x7f63c00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:33.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.332+0000 7f63d37fe640 1 --2- 172.21.15.53:0/1678836774 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63d40b03f0 0x7f63c00047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:33.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.332+0000 7f63d37fe640 1 -- 172.21.15.53:0/1678836774 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63c00039f0 msgr2=0x7f63c0003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:33.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.332+0000 7f63d37fe640 1 --2- 172.21.15.53:0/1678836774 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63c00039f0 0x7f63c0003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:33.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.332+0000 7f63d37fe640 1 -- 172.21.15.53:0/1678836774 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63c0003530 con 0x7f63c0004d10 2023-06-10T19:08:33.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.332+0000 7f63d2ffd640 1 --2- 172.21.15.53:0/1678836774 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63c00039f0 0x7f63c0003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:08:33.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.336+0000 7f63d37fe640 1 --2- 172.21.15.53:0/1678836774 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63c0004d10 0x7f63c0005180 secure :-1 s=READY pgs=2663 cs=0 l=1 rev1=1 crypto rx=0x7f63cc009b10 tx=0x7f63cc01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1316ea863eca718 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:33.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.336+0000 7f63d27fc640 1 -- 172.21.15.53:0/1678836774 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63cc0a55e0 con 0x7f63c0004d10 2023-06-10T19:08:33.349 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.336+0000 7f63d27fc640 1 -- 172.21.15.53:0/1678836774 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63cc0a5740 con 0x7f63c0004d10 2023-06-10T19:08:33.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.336+0000 7f63d27fc640 1 -- 172.21.15.53:0/1678836774 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63cc0a5af0 con 0x7f63c0004d10 2023-06-10T19:08:33.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.336+0000 7f63d9276640 1 -- 172.21.15.53:0/1678836774 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63c0004d10 msgr2=0x7f63c0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:33.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.336+0000 7f63d9276640 1 --2- 172.21.15.53:0/1678836774 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63c0004d10 0x7f63c0005180 secure :-1 s=READY pgs=2663 cs=0 l=1 rev1=1 crypto rx=0x7f63cc009b10 tx=0x7f63cc01c9f0 comp rx=0 tx=0).stop 2023-06-10T19:08:33.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.336+0000 7f63d37fe640 1 -- 172.21.15.53:0/1678836774 reap_dead start 2023-06-10T19:08:33.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.336+0000 7f63d9276640 1 -- 172.21.15.53:0/1678836774 shutdown_connections 2023-06-10T19:08:33.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.336+0000 7f63d9276640 1 -- 172.21.15.53:0/1678836774 >> 172.21.15.53:0/1678836774 conn(0x7f63d40cafc0 msgr2=0x7f63d40cb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:33.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.336+0000 7f63d9276640 1 -- 172.21.15.53:0/1678836774 shutdown_connections 2023-06-10T19:08:33.350 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.336+0000 7f63d9276640 1 -- 172.21.15.53:0/1678836774 wait complete. 2023-06-10T19:08:33.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.336+0000 7f63d9276640 1 Processor -- start 2023-06-10T19:08:33.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.336+0000 7f63d9276640 1 -- start start 2023-06-10T19:08:33.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.340+0000 7f63d9276640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63d4157910 0x7f63d41f2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:33.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.340+0000 7f63d9276640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63d40c6a50 0x7f63d40c4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:33.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.340+0000 7f63d9276640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63d40c4950 0x7f63d40c5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:33.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.340+0000 7f63d9276640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d40c4dc0 con 0x7f63d40c4950 2023-06-10T19:08:33.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.340+0000 7f63d9276640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d4157ce0 con 0x7f63d4157910 2023-06-10T19:08:33.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.340+0000 7f63d9276640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63d40c7210 con 0x7f63d40c6a50 2023-06-10T19:08:33.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.340+0000 7f63d37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63d40c4950 0x7f63d40c5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:33.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.340+0000 7f63d37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63d40c4950 0x7f63d40c5610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55668/0 (socket says 172.21.15.53:55668) 2023-06-10T19:08:33.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.340+0000 7f63d37fe640 1 -- 172.21.15.53:0/2618816885 learned_addr learned my addr 172.21.15.53:0/2618816885 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:08:33.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.340+0000 7f63d2ffd640 1 --2- 172.21.15.53:0/2618816885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63d4157910 0x7f63d41f2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:33.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.340+0000 7f63ca7fc640 1 --2- 172.21.15.53:0/2618816885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63d40c6a50 0x7f63d40c4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:33.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.340+0000 7f63d37fe640 1 -- 172.21.15.53:0/2618816885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63d40c6a50 msgr2=0x7f63d40c4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:33.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.340+0000 7f63d37fe640 1 --2- 172.21.15.53:0/2618816885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63d40c6a50 0x7f63d40c4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:33.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.340+0000 7f63d37fe640 1 -- 172.21.15.53:0/2618816885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63d4157910 msgr2=0x7f63d41f2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:33.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.340+0000 7f63d37fe640 1 --2- 172.21.15.53:0/2618816885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63d4157910 0x7f63d41f2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:33.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.340+0000 7f63d37fe640 1 -- 172.21.15.53:0/2618816885 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63d40c74f0 con 0x7f63d40c4950 2023-06-10T19:08:33.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.340+0000 7f63d2ffd640 1 --2- 172.21.15.53:0/2618816885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63d4157910 0x7f63d41f2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:08:33.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.340+0000 7f63ca7fc640 1 --2- 172.21.15.53:0/2618816885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63d40c6a50 0x7f63d40c4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:08:33.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.340+0000 7f63d37fe640 1 --2- 172.21.15.53:0/2618816885 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63d40c4950 0x7f63d40c5610 secure :-1 s=READY pgs=2664 cs=0 l=1 rev1=1 crypto rx=0x7f63cc009b10 tx=0x7f63c0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:33.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.340+0000 7f63cbfff640 1 -- 172.21.15.53:0/2618816885 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63cc0a55e0 con 0x7f63d40c4950 2023-06-10T19:08:33.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.340+0000 7f63cbfff640 1 -- 172.21.15.53:0/2618816885 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63cc004030 con 0x7f63d40c4950 2023-06-10T19:08:33.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.340+0000 7f63d9276640 1 -- 172.21.15.53:0/2618816885 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63d40c77d0 con 0x7f63d40c4950 2023-06-10T19:08:33.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.340+0000 7f63cbfff640 1 -- 172.21.15.53:0/2618816885 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63cc0043a0 con 0x7f63d40c4950 2023-06-10T19:08:33.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.340+0000 7f63d9276640 1 -- 172.21.15.53:0/2618816885 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63d40c7d90 con 0x7f63d40c4950 2023-06-10T19:08:33.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.340+0000 7f63d9276640 1 -- 172.21.15.53:0/2618816885 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63d40c7f80 con 0x7f63d40c4950 2023-06-10T19:08:33.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.340+0000 7f63cbfff640 1 -- 172.21.15.53:0/2618816885 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f63cc0b4040 con 0x7f63d40c4950 2023-06-10T19:08:33.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.340+0000 7f63cbfff640 1 --2- 172.21.15.53:0/2618816885 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f63b40662b0 0x7f63b4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:33.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.340+0000 7f63cbfff640 1 -- 172.21.15.53:0/2618816885 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 6149+0+0 (secure 0 0 0) 0x7f63cc11d300 con 0x7f63d40c4950 2023-06-10T19:08:33.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.340+0000 7f63d2ffd640 1 --2- 172.21.15.53:0/2618816885 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f63b40662b0 0x7f63b4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:33.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.344+0000 7f63d2ffd640 1 --2- 172.21.15.53:0/2618816885 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f63b40662b0 0x7f63b4068760 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f63c4007520 tx=0x7f63c400b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:33.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.344+0000 7f63cbfff640 1 -- 172.21.15.53:0/2618816885 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f63d40c7f80 con 0x7f63d40c4950 2023-06-10T19:08:33.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.536+0000 7f63d9276640 1 -- 172.21.15.53:0/2618816885 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f63d40c7f80 con 0x7f63d40c4950 2023-06-10T19:08:33.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.536+0000 7f63cbfff640 1 -- 172.21.15.53:0/2618816885 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) v1 ==== 95+0+4688 (secure 0 0 0) 0x7f63d40c7f80 con 0x7f63d40c4950 2023-06-10T19:08:33.540 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:08:33.540 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":104,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7835,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2641321206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2641321206},{"type":"v1","addr":"172.21.15.117:6835","nonce":2641321206}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":99},{"gid":8956,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1439696554","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1439696554},{"type":"v1","addr":"172.21.15.117:6837","nonce":1439696554}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":99},{"gid":11112,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/3327528087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3327528087},{"type":"v1","addr":"172.21.15.53:6833","nonce":3327528087}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":99}],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:08:03.514484+0000","modified":"2023-06-10T19:08:06.533495+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":11118},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11118":{"gid":11118,"name":"c","rank":0,"incarnation":100,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/3732323283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":3732323283},{"type":"v1","addr":"172.21.15.53:6835","nonce":3732323283}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":12}]} 2023-06-10T19:08:33.540 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 104 2023-06-10T19:08:33.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.536+0000 7f63d9276640 1 -- 172.21.15.53:0/2618816885 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f63b40662b0 msgr2=0x7f63b4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:33.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.536+0000 7f63d9276640 1 --2- 172.21.15.53:0/2618816885 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f63b40662b0 0x7f63b4068760 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f63c4007520 tx=0x7f63c400b040 comp rx=0 tx=0).stop 2023-06-10T19:08:33.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.536+0000 7f63d9276640 1 -- 172.21.15.53:0/2618816885 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63d40c4950 msgr2=0x7f63d40c5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:33.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.536+0000 7f63d9276640 1 --2- 172.21.15.53:0/2618816885 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63d40c4950 0x7f63d40c5610 secure :-1 s=READY pgs=2664 cs=0 l=1 rev1=1 crypto rx=0x7f63cc009b10 tx=0x7f63c0005800 comp rx=0 tx=0).stop 2023-06-10T19:08:33.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.536+0000 7f63d9276640 1 -- 172.21.15.53:0/2618816885 shutdown_connections 2023-06-10T19:08:33.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.536+0000 7f63d9276640 1 --2- 172.21.15.53:0/2618816885 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f63b40662b0 0x7f63b4068760 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:33.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.536+0000 7f63d9276640 1 --2- 172.21.15.53:0/2618816885 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63d40c4950 0x7f63d40c5610 unknown :-1 s=CLOSED pgs=2664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:33.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.536+0000 7f63d9276640 1 --2- 172.21.15.53:0/2618816885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f63d40c6a50 0x7f63d40c4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:33.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.536+0000 7f63d9276640 1 --2- 172.21.15.53:0/2618816885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63d4157910 0x7f63d41f2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:33.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.536+0000 7f63d9276640 1 -- 172.21.15.53:0/2618816885 >> 172.21.15.53:0/2618816885 conn(0x7f63d40cafc0 msgr2=0x7f63d406f940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:33.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.536+0000 7f63d9276640 1 -- 172.21.15.53:0/2618816885 shutdown_connections 2023-06-10T19:08:33.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:33.536+0000 7f63d9276640 1 -- 172.21.15.53:0/2618816885 wait complete. 2023-06-10T19:08:33.559 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session evict 11412 2023-06-10T19:08:34.338 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:2023-06-10T19:08:34.332+0000 7f0a017fa640 -1 client.11412 remove_session_caps still has dirty|flushing caps on 0x10000000000.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={4=0,1024=1,2048=0,4096=0,8192=1} open={1=1,3=1} mode=100664 size=7/4194304 nlink=1 btime=2023-06-10T19:08:32.745344+0000 mtime=2023-06-10T19:08:32.759885+0000 ctime=2023-06-10T19:08:32.759885+0000 change_attr=1 caps=- dirty_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 7] parents=0x1.head["testfile_reconnect_after_blocklisted.1"] 0x7f09f800d8b0) 2023-06-10T19:08:34.338 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:2023-06-10T19:08:34.332+0000 7f0a017fa640 -1 client.11412 remove_session_caps still has dirty|flushing caps on 0x10000000001.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={4=0,1024=1,2048=0,4096=0,8192=1} open={1=1,3=1} mode=100664 size=7/4194304 nlink=1 btime=2023-06-10T19:08:32.753846+0000 mtime=2023-06-10T19:08:32.760202+0000 ctime=2023-06-10T19:08:32.760202+0000 change_attr=1 caps=- dirty_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 7] parents=0x1.head["testfile_reconnect_after_blocklisted.2"] 0x7f09f800e070) 2023-06-10T19:08:34.338 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:2023-06-10T19:08:34.332+0000 7f0a017fa640 -1 client.11412 I was blocklisted at osd epoch 183 2023-06-10T19:08:34.368 DEBUG:tasks.cephfs.filesystem:_json_asok output empty 2023-06-10T19:08:38.613 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-10T19:08:38.616 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-10T19:08:54.388 INFO:teuthology.orchestra.run.smithi053.stderr:Traceback (most recent call last): 2023-06-10T19:08:54.389 INFO:teuthology.orchestra.run.smithi053.stderr: File "", line 39, in 2023-06-10T19:08:54.389 INFO:teuthology.orchestra.run.smithi053.stderr:BrokenPipeError: [Errno 108] Cannot send after transport endpoint shutdown 2023-06-10T19:08:54.396 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-10T19:08:54.396 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-06-10T19:08:54.397 DEBUG:teuthology.orchestra.run.smithi053:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-06-10T19:08:54.436 DEBUG:teuthology.orchestra.run.smithi117:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-06-10T19:08:54.485 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-06-10T19:08:54.486 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T19:08:54.486 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:08:54.492 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:08:54.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.659+0000 7f9aaf743640 1 Processor -- start 2023-06-10T19:08:54.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.659+0000 7f9aaf743640 1 -- start start 2023-06-10T19:08:54.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.663+0000 7f9aaf743640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9aa80c9840 0x7f9aa80c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:54.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.663+0000 7f9aaf743640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9aa806b090 0x7f9aa806b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:54.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.663+0000 7f9aaf743640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9aa8159b50 con 0x7f9aa8071060 2023-06-10T19:08:54.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.663+0000 7f9aaf743640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9aa80ca150 con 0x7f9aa80c9840 2023-06-10T19:08:54.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.663+0000 7f9aaf743640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa80702a0 con 0x7f9aa806b090 2023-06-10T19:08:54.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.663+0000 7f9aaccde640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f9aa8071060 0x7f9aa80af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56758/0 (socket says 172.21.15.53:56758) 2023-06-10T19:08:54.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.663+0000 7f9aaccde640 1 -- 172.21.15.53:0/1153589481 learned_addr learned my addr 172.21.15.53:0/1153589481 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:08:54.670 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.663+0000 7f9aadce0640 1 --2- 172.21.15.53:0/1153589481 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9aa806b090 0x7f9aa806b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:54.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.663+0000 7f9aad4df640 1 --2- 172.21.15.53:0/1153589481 >> v2:172.21.15.117:3300/0 conn(0x7f9aa80c9840 0x7f9aa80c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:54.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.663+0000 7f9a9ffff640 1 -- 172.21.15.53:0/1153589481 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1437261124 0 0) 0x7f9aa8159b50 con 0x7f9aa8071060 2023-06-10T19:08:54.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.663+0000 7f9a9ffff640 1 -- 172.21.15.53:0/1153589481 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a94003530 con 0x7f9aa8071060 2023-06-10T19:08:54.671 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.663+0000 7f9a9ffff640 1 -- 172.21.15.53:0/1153589481 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2972713523 0 0) 0x7f9a94003530 con 0x7f9aa8071060 2023-06-10T19:08:54.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.663+0000 7f9a9ffff640 1 -- 172.21.15.53:0/1153589481 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9aa806b090 msgr2=0x7f9aa806b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:54.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.663+0000 7f9a9ffff640 1 --2- 172.21.15.53:0/1153589481 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9aa806b090 0x7f9aa806b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:54.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.663+0000 7f9a9ffff640 1 -- 172.21.15.53:0/1153589481 >> v2:172.21.15.117:3300/0 conn(0x7f9aa80c9840 msgr2=0x7f9aa80c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:54.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.663+0000 7f9a9ffff640 1 --2- 172.21.15.53:0/1153589481 >> v2:172.21.15.117:3300/0 conn(0x7f9aa80c9840 0x7f9aa80c9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:54.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.663+0000 7f9a9ffff640 1 -- 172.21.15.53:0/1153589481 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aa8070580 con 0x7f9aa8071060 2023-06-10T19:08:54.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.663+0000 7f9a9ffff640 1 -- 172.21.15.53:0/1153589481 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f9a98001680 con 0x7f9aa8071060 2023-06-10T19:08:54.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.663+0000 7f9a9ffff640 1 -- 172.21.15.53:0/1153589481 >> v1:172.21.15.53:6789/0 conn(0x7f9aa8071060 legacy=0x7f9aa80af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:54.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.663+0000 7f9a9ffff640 1 --2- 172.21.15.53:0/1153589481 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9aa806b090 0x7f9a940039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:54.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.663+0000 7f9a9ffff640 1 --2- 172.21.15.53:0/1153589481 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a94003f70 0x7f9a940047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:54.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.663+0000 7f9a9ffff640 1 --2- 172.21.15.53:0/1153589481 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a94004d10 0x7f9a94005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:54.674 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.663+0000 7f9a9ffff640 1 -- 172.21.15.53:0/1153589481 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa80ca150 con 0x7f9a94003f70 2023-06-10T19:08:54.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.663+0000 7f9a9ffff640 1 -- 172.21.15.53:0/1153589481 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa80702a0 con 0x7f9a94004d10 2023-06-10T19:08:54.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.663+0000 7f9a9ffff640 1 -- 172.21.15.53:0/1153589481 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a9400b990 con 0x7f9aa806b090 2023-06-10T19:08:54.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.663+0000 7f9aaccde640 1 --2- 172.21.15.53:0/1153589481 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a94003f70 0x7f9a940047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:54.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.663+0000 7f9aad4df640 1 --2- 172.21.15.53:0/1153589481 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9aa806b090 0x7f9a940039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:54.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.663+0000 7f9aadce0640 1 --2- 172.21.15.53:0/1153589481 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a94004d10 0x7f9a94005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:54.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.663+0000 7f9aaccde640 1 -- 172.21.15.53:0/1153589481 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9aa806b090 msgr2=0x7f9a940039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:54.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.663+0000 7f9aaccde640 1 --2- 172.21.15.53:0/1153589481 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9aa806b090 0x7f9a940039f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:54.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.663+0000 7f9aaccde640 1 -- 172.21.15.53:0/1153589481 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a94004d10 msgr2=0x7f9a94005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:54.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.663+0000 7f9aaccde640 1 --2- 172.21.15.53:0/1153589481 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a94004d10 0x7f9a94005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:54.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.663+0000 7f9aaccde640 1 -- 172.21.15.53:0/1153589481 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a94003530 con 0x7f9a94003f70 2023-06-10T19:08:54.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.663+0000 7f9aadce0640 1 --2- 172.21.15.53:0/1153589481 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a94004d10 0x7f9a94005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:08:54.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.667+0000 7f9aaccde640 1 --2- 172.21.15.53:0/1153589481 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a94003f70 0x7f9a940047d0 secure :-1 s=READY pgs=2666 cs=0 l=1 rev1=1 crypto rx=0x7f9a9800c240 tx=0x7f9a9801f390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=449d001a2c70a27e server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:54.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.667+0000 7f9a9ffff640 1 -- 172.21.15.53:0/1153589481 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a98005ae0 con 0x7f9a94003f70 2023-06-10T19:08:54.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.667+0000 7f9a9ffff640 1 -- 172.21.15.53:0/1153589481 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a980ab070 con 0x7f9a94003f70 2023-06-10T19:08:54.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.667+0000 7f9a9ffff640 1 -- 172.21.15.53:0/1153589481 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a98007070 con 0x7f9a94003f70 2023-06-10T19:08:54.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.667+0000 7f9aaf743640 1 -- 172.21.15.53:0/1153589481 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a94003f70 msgr2=0x7f9a940047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:54.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.667+0000 7f9aaf743640 1 --2- 172.21.15.53:0/1153589481 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a94003f70 0x7f9a940047d0 secure :-1 s=READY pgs=2666 cs=0 l=1 rev1=1 crypto rx=0x7f9a9800c240 tx=0x7f9a9801f390 comp rx=0 tx=0).stop 2023-06-10T19:08:54.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.667+0000 7f9aadce0640 1 -- 172.21.15.53:0/1153589481 reap_dead start 2023-06-10T19:08:54.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.667+0000 7f9aaf743640 1 -- 172.21.15.53:0/1153589481 shutdown_connections 2023-06-10T19:08:54.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.667+0000 7f9aaf743640 1 -- 172.21.15.53:0/1153589481 >> 172.21.15.53:0/1153589481 conn(0x7f9aa806a0d0 msgr2=0x7f9aa80ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:54.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.667+0000 7f9aaf743640 1 -- 172.21.15.53:0/1153589481 shutdown_connections 2023-06-10T19:08:54.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.667+0000 7f9aaf743640 1 -- 172.21.15.53:0/1153589481 wait complete. 2023-06-10T19:08:54.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.667+0000 7f9aaf743640 1 Processor -- start 2023-06-10T19:08:54.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.667+0000 7f9aaf743640 1 -- start start 2023-06-10T19:08:54.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.667+0000 7f9aaf743640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a94003f70 0x7f9aa80b31d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:54.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.667+0000 7f9aaf743640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9aa80c7780 0x7f9aa8155110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:54.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.667+0000 7f9aaf743640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9aa80c53d0 0x7f9aa80c5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:54.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.667+0000 7f9aaf743640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa80c5d80 con 0x7f9aa80c53d0 2023-06-10T19:08:54.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.667+0000 7f9aaf743640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa80b2130 con 0x7f9a94003f70 2023-06-10T19:08:54.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.667+0000 7f9aaf743640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa80b2410 con 0x7f9aa80c7780 2023-06-10T19:08:54.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.667+0000 7f9aadce0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9aa80c53d0 0x7f9aa80c5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:54.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.667+0000 7f9aadce0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9aa80c53d0 0x7f9aa80c5840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42078/0 (socket says 172.21.15.53:42078) 2023-06-10T19:08:54.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.667+0000 7f9aadce0640 1 -- 172.21.15.53:0/4065898760 learned_addr learned my addr 172.21.15.53:0/4065898760 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:08:54.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.667+0000 7f9aad4df640 1 --2- 172.21.15.53:0/4065898760 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a94003f70 0x7f9aa80b31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:54.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.667+0000 7f9aaccde640 1 --2- 172.21.15.53:0/4065898760 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9aa80c7780 0x7f9aa8155110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:54.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.667+0000 7f9aadce0640 1 -- 172.21.15.53:0/4065898760 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9aa80c7780 msgr2=0x7f9aa8155110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:54.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.667+0000 7f9aadce0640 1 --2- 172.21.15.53:0/4065898760 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9aa80c7780 0x7f9aa8155110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:54.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.667+0000 7f9aadce0640 1 -- 172.21.15.53:0/4065898760 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a94003f70 msgr2=0x7f9aa80b31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:54.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.667+0000 7f9aadce0640 1 --2- 172.21.15.53:0/4065898760 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a94003f70 0x7f9aa80b31d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:54.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.667+0000 7f9aadce0640 1 -- 172.21.15.53:0/4065898760 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aa80b26f0 con 0x7f9aa80c53d0 2023-06-10T19:08:54.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.667+0000 7f9aadce0640 1 --2- 172.21.15.53:0/4065898760 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9aa80c53d0 0x7f9aa80c5840 secure :-1 s=READY pgs=2667 cs=0 l=1 rev1=1 crypto rx=0x7f9aa806e4e0 tx=0x7f9aa0010850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:54.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.671+0000 7f9a9dffb640 1 -- 172.21.15.53:0/4065898760 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa0004020 con 0x7f9aa80c53d0 2023-06-10T19:08:54.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.671+0000 7f9a9dffb640 1 -- 172.21.15.53:0/4065898760 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aa00041a0 con 0x7f9aa80c53d0 2023-06-10T19:08:54.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.671+0000 7f9aaf743640 1 -- 172.21.15.53:0/4065898760 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9aa80b29d0 con 0x7f9aa80c53d0 2023-06-10T19:08:54.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.671+0000 7f9a9dffb640 1 -- 172.21.15.53:0/4065898760 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa0003620 con 0x7f9aa80c53d0 2023-06-10T19:08:54.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.671+0000 7f9aaf743640 1 -- 172.21.15.53:0/4065898760 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9aa80c7bf0 con 0x7f9aa80c53d0 2023-06-10T19:08:54.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.671+0000 7f9aaf743640 1 -- 172.21.15.53:0/4065898760 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9aa804d790 con 0x7f9aa80c53d0 2023-06-10T19:08:54.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.671+0000 7f9a9dffb640 1 -- 172.21.15.53:0/4065898760 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9aa0003780 con 0x7f9aa80c53d0 2023-06-10T19:08:54.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.671+0000 7f9a9dffb640 1 --2- 172.21.15.53:0/4065898760 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9a8c066280 0x7f9a8c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:54.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.671+0000 7f9a9dffb640 1 -- 172.21.15.53:0/4065898760 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6192+0+0 (secure 0 0 0) 0x7f9aa0082f50 con 0x7f9aa80c53d0 2023-06-10T19:08:54.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.671+0000 7f9aad4df640 1 --2- 172.21.15.53:0/4065898760 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9a8c066280 0x7f9a8c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:54.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.671+0000 7f9aad4df640 1 --2- 172.21.15.53:0/4065898760 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9a8c066280 0x7f9a8c068730 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f9aa40074a0 tx=0x7f9aa400b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:54.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.675+0000 7f9a9dffb640 1 -- 172.21.15.53:0/4065898760 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9aa00503e0 con 0x7f9aa80c53d0 2023-06-10T19:08:54.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.831+0000 7f9aaf743640 1 -- 172.21.15.53:0/4065898760 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9aa80b2e80 con 0x7f9aa80c53d0 2023-06-10T19:08:54.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.835+0000 7f9a9dffb640 1 -- 172.21.15.53:0/4065898760 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v183) v1 ==== 74+0+18487 (secure 0 0 0) 0x7f9aa0021090 con 0x7f9aa80c53d0 2023-06-10T19:08:54.840 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:08:54.840 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":183,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:08:34.235084+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2023-06-10T19:08:01.296938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"179","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_data","create_time":"2023-06-10T19:08:02.507633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"180","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"26.2a","mappings":[{"from":1,"to":0}]},{"pgid":"26.37","mappings":[{"from":1,"to":0}]},{"pgid":"26.3a","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.0.1:0/3824904337":"2023-06-10T20:08:33.687127+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:08:54.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.835+0000 7f9aaf743640 1 -- 172.21.15.53:0/4065898760 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9a8c066280 msgr2=0x7f9a8c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:54.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.835+0000 7f9aaf743640 1 --2- 172.21.15.53:0/4065898760 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9a8c066280 0x7f9a8c068730 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f9aa40074a0 tx=0x7f9aa400b040 comp rx=0 tx=0).stop 2023-06-10T19:08:54.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.835+0000 7f9aaf743640 1 -- 172.21.15.53:0/4065898760 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9aa80c53d0 msgr2=0x7f9aa80c5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:54.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.835+0000 7f9aaf743640 1 --2- 172.21.15.53:0/4065898760 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9aa80c53d0 0x7f9aa80c5840 secure :-1 s=READY pgs=2667 cs=0 l=1 rev1=1 crypto rx=0x7f9aa806e4e0 tx=0x7f9aa0010850 comp rx=0 tx=0).stop 2023-06-10T19:08:54.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.835+0000 7f9aaf743640 1 -- 172.21.15.53:0/4065898760 shutdown_connections 2023-06-10T19:08:54.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.835+0000 7f9aaf743640 1 --2- 172.21.15.53:0/4065898760 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9a8c066280 0x7f9a8c068730 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:54.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.835+0000 7f9aaf743640 1 --2- 172.21.15.53:0/4065898760 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9aa80c53d0 0x7f9aa80c5840 unknown :-1 s=CLOSED pgs=2667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:54.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.835+0000 7f9aaf743640 1 --2- 172.21.15.53:0/4065898760 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9aa80c7780 0x7f9aa8155110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:54.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.835+0000 7f9aaf743640 1 --2- 172.21.15.53:0/4065898760 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a94003f70 0x7f9aa80b31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:54.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.835+0000 7f9aaf743640 1 -- 172.21.15.53:0/4065898760 >> 172.21.15.53:0/4065898760 conn(0x7f9aa806a0d0 msgr2=0x7f9aa80c82d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:54.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.835+0000 7f9aaf743640 1 -- 172.21.15.53:0/4065898760 shutdown_connections 2023-06-10T19:08:54.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.835+0000 7f9aaf743640 1 -- 172.21.15.53:0/4065898760 wait complete. 2023-06-10T19:08:54.858 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-10T18:52:33.633114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-10T18:52:39.171487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 25, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-10T19:08:01.296938+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '179', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 26, 'pool_name': 'cephfs_data', 'create_time': '2023-06-10T19:08:02.507633+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '180', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-10T19:08:54.859 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-10T19:08:54.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.983+0000 7fba49408640 1 Processor -- start 2023-06-10T19:08:54.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.983+0000 7fba49408640 1 -- start start 2023-06-10T19:08:54.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.983+0000 7fba49408640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fba440afe70 0x7fba440c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:54.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.983+0000 7fba49408640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba4406b090 con 0x7fba440c82a0 2023-06-10T19:08:54.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.983+0000 7fba49408640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba440ca370 con 0x7fba440c9fa0 2023-06-10T19:08:54.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.983+0000 7fba49408640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba44070d50 con 0x7fba440afe70 2023-06-10T19:08:54.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.983+0000 7fba427fc640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fba440c82a0 0x7fba440af760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56766/0 (socket says 172.21.15.53:56766) 2023-06-10T19:08:54.994 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.983+0000 7fba427fc640 1 -- 172.21.15.53:0/3317951444 learned_addr learned my addr 172.21.15.53:0/3317951444 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:08:54.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.983+0000 7fba437fe640 1 --2- 172.21.15.53:0/3317951444 >> v2:172.21.15.117:3300/0 conn(0x7fba440afe70 0x7fba440c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:54.995 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.983+0000 7fba41ffb640 1 -- 172.21.15.53:0/3317951444 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 663969380 0 0) 0x7fba4406b090 con 0x7fba440c82a0 2023-06-10T19:08:54.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.983+0000 7fba41ffb640 1 -- 172.21.15.53:0/3317951444 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba30003530 con 0x7fba440c82a0 2023-06-10T19:08:54.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.983+0000 7fba41ffb640 1 -- 172.21.15.53:0/3317951444 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2377812660 0 0) 0x7fba30003530 con 0x7fba440c82a0 2023-06-10T19:08:54.996 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.983+0000 7fba41ffb640 1 -- 172.21.15.53:0/3317951444 >> v2:172.21.15.117:3300/0 conn(0x7fba440afe70 msgr2=0x7fba440c86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:54.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.983+0000 7fba41ffb640 1 --2- 172.21.15.53:0/3317951444 >> v2:172.21.15.117:3300/0 conn(0x7fba440afe70 0x7fba440c86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:54.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.983+0000 7fba41ffb640 1 -- 172.21.15.53:0/3317951444 >> v1:172.21.15.117:6789/0 conn(0x7fba440c9fa0 legacy=0x7fba4406bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:54.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.983+0000 7fba41ffb640 1 -- 172.21.15.53:0/3317951444 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba44071030 con 0x7fba440c82a0 2023-06-10T19:08:54.997 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.983+0000 7fba41ffb640 1 -- 172.21.15.53:0/3317951444 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fba2c001680 con 0x7fba440c82a0 2023-06-10T19:08:54.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.983+0000 7fba41ffb640 1 -- 172.21.15.53:0/3317951444 >> v1:172.21.15.53:6789/0 conn(0x7fba440c82a0 legacy=0x7fba440af760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:54.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.983+0000 7fba41ffb640 1 --2- 172.21.15.53:0/3317951444 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba30003980 0x7fba30003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:54.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.983+0000 7fba41ffb640 1 --2- 172.21.15.53:0/3317951444 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba300047d0 0x7fba30004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:54.998 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.983+0000 7fba41ffb640 1 --2- 172.21.15.53:0/3317951444 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba30005180 0x7fba3000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:54.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.983+0000 7fba41ffb640 1 -- 172.21.15.53:0/3317951444 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba44070d50 con 0x7fba300047d0 2023-06-10T19:08:54.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.983+0000 7fba41ffb640 1 -- 172.21.15.53:0/3317951444 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba3000c090 con 0x7fba30003980 2023-06-10T19:08:54.999 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.983+0000 7fba41ffb640 1 -- 172.21.15.53:0/3317951444 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba3000c250 con 0x7fba30005180 2023-06-10T19:08:55.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.983+0000 7fba427fc640 1 --2- 172.21.15.53:0/3317951444 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba300047d0 0x7fba30004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:55.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.983+0000 7fba42ffd640 1 --2- 172.21.15.53:0/3317951444 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba30003980 0x7fba30003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:55.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.983+0000 7fba437fe640 1 --2- 172.21.15.53:0/3317951444 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba30005180 0x7fba3000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:55.000 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.983+0000 7fba427fc640 1 -- 172.21.15.53:0/3317951444 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba30005180 msgr2=0x7fba3000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:55.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.983+0000 7fba427fc640 1 --2- 172.21.15.53:0/3317951444 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba30005180 0x7fba3000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:55.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.983+0000 7fba427fc640 1 -- 172.21.15.53:0/3317951444 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba30003980 msgr2=0x7fba30003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:55.001 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.983+0000 7fba427fc640 1 --2- 172.21.15.53:0/3317951444 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba30003980 0x7fba30003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:55.002 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.983+0000 7fba427fc640 1 -- 172.21.15.53:0/3317951444 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba30003530 con 0x7fba300047d0 2023-06-10T19:08:55.002 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.983+0000 7fba437fe640 1 -- 172.21.15.53:0/3317951444 reap_dead start 2023-06-10T19:08:55.002 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.987+0000 7fba427fc640 1 --2- 172.21.15.53:0/3317951444 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba300047d0 0x7fba30004c40 secure :-1 s=READY pgs=2669 cs=0 l=1 rev1=1 crypto rx=0x7fba2c00c240 tx=0x7fba2c01cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95c6de380f35495d server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:55.002 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.987+0000 7fba41ffb640 1 -- 172.21.15.53:0/3317951444 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba2c0a5b20 con 0x7fba300047d0 2023-06-10T19:08:55.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.987+0000 7fba41ffb640 1 -- 172.21.15.53:0/3317951444 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba2c0a5c80 con 0x7fba300047d0 2023-06-10T19:08:55.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.987+0000 7fba41ffb640 1 -- 172.21.15.53:0/3317951444 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba2c005b00 con 0x7fba300047d0 2023-06-10T19:08:55.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.987+0000 7fba49408640 1 -- 172.21.15.53:0/3317951444 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba300047d0 msgr2=0x7fba30004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:55.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.987+0000 7fba49408640 1 --2- 172.21.15.53:0/3317951444 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba300047d0 0x7fba30004c40 secure :-1 s=READY pgs=2669 cs=0 l=1 rev1=1 crypto rx=0x7fba2c00c240 tx=0x7fba2c01cb90 comp rx=0 tx=0).stop 2023-06-10T19:08:55.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.987+0000 7fba49408640 1 -- 172.21.15.53:0/3317951444 shutdown_connections 2023-06-10T19:08:55.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.987+0000 7fba49408640 1 --2- 172.21.15.53:0/3317951444 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba300047d0 0x7fba30004c40 unknown :-1 s=CLOSED pgs=2669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:55.004 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.987+0000 7fba49408640 1 -- 172.21.15.53:0/3317951444 >> 172.21.15.53:0/3317951444 conn(0x7fba4406a0e0 msgr2=0x7fba440cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:55.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.987+0000 7fba49408640 1 -- 172.21.15.53:0/3317951444 shutdown_connections 2023-06-10T19:08:55.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.987+0000 7fba49408640 1 -- 172.21.15.53:0/3317951444 wait complete. 2023-06-10T19:08:55.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.987+0000 7fba49408640 1 Processor -- start 2023-06-10T19:08:55.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.987+0000 7fba49408640 1 -- start start 2023-06-10T19:08:55.009 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.991+0000 7fba49408640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba300047d0 0x7fba440a82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:55.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.991+0000 7fba49408640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba440a87e0 0x7fba44158370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:55.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.991+0000 7fba49408640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba441588b0 0x7fba440c3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:55.010 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.991+0000 7fba49408640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba440c8020 con 0x7fba441588b0 2023-06-10T19:08:55.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.991+0000 7fba49408640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba440c7b90 con 0x7fba440a87e0 2023-06-10T19:08:55.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.991+0000 7fba49408640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba440c6f80 con 0x7fba300047d0 2023-06-10T19:08:55.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.991+0000 7fba437fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba441588b0 0x7fba440c3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:55.011 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.991+0000 7fba437fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba441588b0 0x7fba440c3930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42090/0 (socket says 172.21.15.53:42090) 2023-06-10T19:08:55.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.991+0000 7fba437fe640 1 -- 172.21.15.53:0/2775882979 learned_addr learned my addr 172.21.15.53:0/2775882979 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:08:55.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.991+0000 7fba427fc640 1 --2- 172.21.15.53:0/2775882979 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba440a87e0 0x7fba44158370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:55.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.991+0000 7fba42ffd640 1 --2- 172.21.15.53:0/2775882979 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba300047d0 0x7fba440a82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:55.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.991+0000 7fba437fe640 1 -- 172.21.15.53:0/2775882979 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba300047d0 msgr2=0x7fba440a82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:55.012 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.991+0000 7fba437fe640 1 --2- 172.21.15.53:0/2775882979 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba300047d0 0x7fba440a82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:55.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.991+0000 7fba437fe640 1 -- 172.21.15.53:0/2775882979 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba440a87e0 msgr2=0x7fba44158370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:55.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.991+0000 7fba437fe640 1 --2- 172.21.15.53:0/2775882979 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba440a87e0 0x7fba44158370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:55.013 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.991+0000 7fba437fe640 1 -- 172.21.15.53:0/2775882979 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba440c7260 con 0x7fba441588b0 2023-06-10T19:08:55.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.991+0000 7fba42ffd640 1 --2- 172.21.15.53:0/2775882979 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba300047d0 0x7fba440a82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:08:55.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.991+0000 7fba437fe640 1 --2- 172.21.15.53:0/2775882979 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba441588b0 0x7fba440c3930 secure :-1 s=READY pgs=2670 cs=0 l=1 rev1=1 crypto rx=0x7fba4406d4d0 tx=0x7fba3c007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:55.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.991+0000 7fba3b7fe640 1 -- 172.21.15.53:0/2775882979 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba3c00e070 con 0x7fba441588b0 2023-06-10T19:08:55.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.991+0000 7fba3b7fe640 1 -- 172.21.15.53:0/2775882979 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba3c003c70 con 0x7fba441588b0 2023-06-10T19:08:55.014 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.991+0000 7fba49408640 1 -- 172.21.15.53:0/2775882979 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba440c7540 con 0x7fba441588b0 2023-06-10T19:08:55.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.991+0000 7fba3b7fe640 1 -- 172.21.15.53:0/2775882979 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba3c003e20 con 0x7fba441588b0 2023-06-10T19:08:55.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.991+0000 7fba49408640 1 -- 172.21.15.53:0/2775882979 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba440c6aa0 con 0x7fba441588b0 2023-06-10T19:08:55.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.991+0000 7fba49408640 1 -- 172.21.15.53:0/2775882979 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba440c7d00 con 0x7fba441588b0 2023-06-10T19:08:55.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.991+0000 7fba3b7fe640 1 -- 172.21.15.53:0/2775882979 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fba3c004030 con 0x7fba441588b0 2023-06-10T19:08:55.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.991+0000 7fba3b7fe640 1 --2- 172.21.15.53:0/2775882979 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fba24066280 0x7fba24068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:55.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.991+0000 7fba3b7fe640 1 -- 172.21.15.53:0/2775882979 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6192+0+0 (secure 0 0 0) 0x7fba3c083d50 con 0x7fba441588b0 2023-06-10T19:08:55.015 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.991+0000 7fba42ffd640 1 --2- 172.21.15.53:0/2775882979 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fba24066280 0x7fba24068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:55.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.995+0000 7fba42ffd640 1 --2- 172.21.15.53:0/2775882979 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fba24066280 0x7fba24068730 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7fba440c9a10 tx=0x7fba34009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:55.016 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:54.995+0000 7fba3b7fe640 1 -- 172.21.15.53:0/2775882979 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fba3c087030 con 0x7fba441588b0 2023-06-10T19:08:55.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.151+0000 7fba49408640 1 -- 172.21.15.53:0/2775882979 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fba4406b590 con 0x7fba441588b0 2023-06-10T19:08:55.158 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.151+0000 7fba3b7fe640 1 -- 172.21.15.53:0/2775882979 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v183) v1 ==== 93+0+10 (secure 0 0 0) 0x7fba3c054be0 con 0x7fba441588b0 2023-06-10T19:08:55.159 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-06-10T19:08:55.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.151+0000 7fba49408640 1 -- 172.21.15.53:0/2775882979 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fba24066280 msgr2=0x7fba24068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:55.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.151+0000 7fba49408640 1 --2- 172.21.15.53:0/2775882979 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fba24066280 0x7fba24068730 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7fba440c9a10 tx=0x7fba34009040 comp rx=0 tx=0).stop 2023-06-10T19:08:55.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.151+0000 7fba49408640 1 -- 172.21.15.53:0/2775882979 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba441588b0 msgr2=0x7fba440c3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:55.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.151+0000 7fba49408640 1 --2- 172.21.15.53:0/2775882979 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba441588b0 0x7fba440c3930 secure :-1 s=READY pgs=2670 cs=0 l=1 rev1=1 crypto rx=0x7fba4406d4d0 tx=0x7fba3c007dd0 comp rx=0 tx=0).stop 2023-06-10T19:08:55.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.151+0000 7fba49408640 1 -- 172.21.15.53:0/2775882979 shutdown_connections 2023-06-10T19:08:55.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.151+0000 7fba49408640 1 --2- 172.21.15.53:0/2775882979 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fba24066280 0x7fba24068730 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:55.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.151+0000 7fba49408640 1 --2- 172.21.15.53:0/2775882979 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fba441588b0 0x7fba440c3930 unknown :-1 s=CLOSED pgs=2670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:55.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.151+0000 7fba49408640 1 --2- 172.21.15.53:0/2775882979 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba440a87e0 0x7fba44158370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:55.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.151+0000 7fba49408640 1 --2- 172.21.15.53:0/2775882979 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba300047d0 0x7fba440a82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:55.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.151+0000 7fba49408640 1 -- 172.21.15.53:0/2775882979 >> 172.21.15.53:0/2775882979 conn(0x7fba4406a0e0 msgr2=0x7fba440b0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:55.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.151+0000 7fba49408640 1 -- 172.21.15.53:0/2775882979 shutdown_connections 2023-06-10T19:08:55.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.155+0000 7fba49408640 1 -- 172.21.15.53:0/2775882979 wait complete. 2023-06-10T19:08:55.175 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-10T19:08:55.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.299+0000 7f85b0c1d640 1 Processor -- start 2023-06-10T19:08:55.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.299+0000 7f85b0c1d640 1 -- start start 2023-06-10T19:08:55.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.299+0000 7f85b0c1d640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f85ac0c9fa0 0x7f85ac06bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:55.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.299+0000 7f85b0c1d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f85ac0af760 0x7f85ac0afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:55.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.299+0000 7f85b0c1d640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85ac06b090 con 0x7f85ac06c020 2023-06-10T19:08:55.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.299+0000 7f85b0c1d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85ac0b0120 con 0x7f85ac0af760 2023-06-10T19:08:55.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.299+0000 7f85b0c1d640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85ac0ca370 con 0x7f85ac0c9fa0 2023-06-10T19:08:55.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.299+0000 7f85aad9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f85ac0af760 0x7f85ac0afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:55.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.299+0000 7f85aad9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f85ac0af760 0x7f85ac0afbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42094/0 (socket says 172.21.15.53:42094) 2023-06-10T19:08:55.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.299+0000 7f85aad9d640 1 -- 172.21.15.53:0/2625476143 learned_addr learned my addr 172.21.15.53:0/2625476143 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:08:55.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.299+0000 7f85aa59c640 1 --2- 172.21.15.53:0/2625476143 >> v2:172.21.15.117:3300/0 conn(0x7f85ac0c9fa0 0x7f85ac06bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:55.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.299+0000 7f85aad9d640 1 -- 172.21.15.53:0/2625476143 >> v2:172.21.15.117:3300/0 conn(0x7f85ac0c9fa0 msgr2=0x7f85ac06bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:55.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.299+0000 7f85aad9d640 1 --2- 172.21.15.53:0/2625476143 >> v2:172.21.15.117:3300/0 conn(0x7f85ac0c9fa0 0x7f85ac06bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:55.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.299+0000 7f85aad9d640 1 -- 172.21.15.53:0/2625476143 >> v1:172.21.15.117:6789/0 conn(0x7f85ac06c020 legacy=0x7f85ac0c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:55.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.299+0000 7f85aad9d640 1 -- 172.21.15.53:0/2625476143 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85ac070d50 con 0x7f85ac0af760 2023-06-10T19:08:55.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.303+0000 7f85aad9d640 1 --2- 172.21.15.53:0/2625476143 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85ac0af760 0x7f85ac0afbe0 secure :-1 s=READY pgs=2671 cs=0 l=1 rev1=1 crypto rx=0x7f85ac06e9d0 tx=0x7f85a401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55f0b7aa059273e4 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:55.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.307+0000 7f85a959a640 1 -- 172.21.15.53:0/2625476143 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a4004230 con 0x7f85ac0af760 2023-06-10T19:08:55.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.307+0000 7f85a959a640 1 -- 172.21.15.53:0/2625476143 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85a40a7050 con 0x7f85ac0af760 2023-06-10T19:08:55.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.307+0000 7f85a959a640 1 -- 172.21.15.53:0/2625476143 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a4003620 con 0x7f85ac0af760 2023-06-10T19:08:55.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.307+0000 7f85b0c1d640 1 -- 172.21.15.53:0/2625476143 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85ac0af760 msgr2=0x7f85ac0afbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:55.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.307+0000 7f85b0c1d640 1 --2- 172.21.15.53:0/2625476143 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85ac0af760 0x7f85ac0afbe0 secure :-1 s=READY pgs=2671 cs=0 l=1 rev1=1 crypto rx=0x7f85ac06e9d0 tx=0x7f85a401c440 comp rx=0 tx=0).stop 2023-06-10T19:08:55.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.307+0000 7f85b0c1d640 1 -- 172.21.15.53:0/2625476143 shutdown_connections 2023-06-10T19:08:55.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.307+0000 7f85b0c1d640 1 --2- 172.21.15.53:0/2625476143 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85ac0af760 0x7f85ac0afbe0 unknown :-1 s=CLOSED pgs=2671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:55.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.307+0000 7f85b0c1d640 1 --2- 172.21.15.53:0/2625476143 >> v2:172.21.15.117:3300/0 conn(0x7f85ac0c9fa0 0x7f85ac06bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:55.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.307+0000 7f85b0c1d640 1 -- 172.21.15.53:0/2625476143 >> 172.21.15.53:0/2625476143 conn(0x7f85ac06a0e0 msgr2=0x7f85ac0cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:55.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.307+0000 7f85b0c1d640 1 -- 172.21.15.53:0/2625476143 shutdown_connections 2023-06-10T19:08:55.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.307+0000 7f85b0c1d640 1 -- 172.21.15.53:0/2625476143 wait complete. 2023-06-10T19:08:55.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.307+0000 7f85b0c1d640 1 Processor -- start 2023-06-10T19:08:55.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.307+0000 7f85b0c1d640 1 -- start start 2023-06-10T19:08:55.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.307+0000 7f85b0c1d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85ac06c020 0x7f85ac0c7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:55.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.307+0000 7f85b0c1d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85ac0af760 0x7f85ac155030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:55.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.307+0000 7f85b0c1d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85ac0c9fa0 0x7f85ac0c5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:55.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.307+0000 7f85b0c1d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85ac157130 con 0x7f85ac0c9fa0 2023-06-10T19:08:55.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.307+0000 7f85b0c1d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85ac0c7c40 con 0x7f85ac0af760 2023-06-10T19:08:55.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.307+0000 7f85b0c1d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85ac0c4650 con 0x7f85ac06c020 2023-06-10T19:08:55.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.307+0000 7f85aad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85ac0c9fa0 0x7f85ac0c5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:55.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.307+0000 7f85aad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85ac0c9fa0 0x7f85ac0c5730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42110/0 (socket says 172.21.15.53:42110) 2023-06-10T19:08:55.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.307+0000 7f85aad9d640 1 -- 172.21.15.53:0/1364145160 learned_addr learned my addr 172.21.15.53:0/1364145160 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:08:55.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.307+0000 7f85a9d9b640 1 --2- 172.21.15.53:0/1364145160 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85ac0af760 0x7f85ac155030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:55.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.307+0000 7f85aa59c640 1 --2- 172.21.15.53:0/1364145160 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85ac06c020 0x7f85ac0c7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:55.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.307+0000 7f85aad9d640 1 -- 172.21.15.53:0/1364145160 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85ac06c020 msgr2=0x7f85ac0c7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:55.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.307+0000 7f85aad9d640 1 --2- 172.21.15.53:0/1364145160 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85ac06c020 0x7f85ac0c7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:55.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.307+0000 7f85aad9d640 1 -- 172.21.15.53:0/1364145160 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85ac0af760 msgr2=0x7f85ac155030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:55.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.307+0000 7f85aad9d640 1 --2- 172.21.15.53:0/1364145160 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85ac0af760 0x7f85ac155030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:55.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.307+0000 7f85aad9d640 1 -- 172.21.15.53:0/1364145160 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85a40094d0 con 0x7f85ac0c9fa0 2023-06-10T19:08:55.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.307+0000 7f85a9d9b640 1 --2- 172.21.15.53:0/1364145160 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85ac0af760 0x7f85ac155030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:08:55.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.311+0000 7f85aad9d640 1 --2- 172.21.15.53:0/1364145160 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85ac0c9fa0 0x7f85ac0c5730 secure :-1 s=READY pgs=2672 cs=0 l=1 rev1=1 crypto rx=0x7f85a401c920 tx=0x7f85a40191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:55.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.311+0000 7f859affd640 1 -- 172.21.15.53:0/1364145160 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a4003a30 con 0x7f85ac0c9fa0 2023-06-10T19:08:55.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.311+0000 7f859affd640 1 -- 172.21.15.53:0/1364145160 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85a4003b90 con 0x7f85ac0c9fa0 2023-06-10T19:08:55.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.311+0000 7f859affd640 1 -- 172.21.15.53:0/1364145160 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a40ab440 con 0x7f85ac0c9fa0 2023-06-10T19:08:55.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.311+0000 7f85b0c1d640 1 -- 172.21.15.53:0/1364145160 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85ac0c1900 con 0x7f85ac0c9fa0 2023-06-10T19:08:55.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.311+0000 7f85b0c1d640 1 -- 172.21.15.53:0/1364145160 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85ac0c42e0 con 0x7f85ac0c9fa0 2023-06-10T19:08:55.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.311+0000 7f85b0c1d640 1 -- 172.21.15.53:0/1364145160 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85ac06b5a0 con 0x7f85ac0c9fa0 2023-06-10T19:08:55.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.311+0000 7f859affd640 1 -- 172.21.15.53:0/1364145160 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f85a40b2050 con 0x7f85ac0c9fa0 2023-06-10T19:08:55.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.311+0000 7f859affd640 1 --2- 172.21.15.53:0/1364145160 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f858c066280 0x7f858c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:55.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.311+0000 7f859affd640 1 -- 172.21.15.53:0/1364145160 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6192+0+0 (secure 0 0 0) 0x7f85a411e030 con 0x7f85ac0c9fa0 2023-06-10T19:08:55.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.311+0000 7f85aa59c640 1 --2- 172.21.15.53:0/1364145160 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f858c066280 0x7f858c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:55.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.311+0000 7f85aa59c640 1 --2- 172.21.15.53:0/1364145160 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f858c066280 0x7f858c068730 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f859c0073f0 tx=0x7f859c00b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:55.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.315+0000 7f859affd640 1 -- 172.21.15.53:0/1364145160 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f85ac06b5a0 con 0x7f85ac0c9fa0 2023-06-10T19:08:55.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.463+0000 7f85b0c1d640 1 -- 172.21.15.53:0/1364145160 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f85ac06b5a0 con 0x7f85ac0c9fa0 2023-06-10T19:08:55.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.467+0000 7f859affd640 1 -- 172.21.15.53:0/1364145160 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v183) v1 ==== 92+0+10 (secure 0 0 0) 0x7f85ac06b5a0 con 0x7f85ac0c9fa0 2023-06-10T19:08:55.471 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-06-10T19:08:55.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.467+0000 7f85b0c1d640 1 -- 172.21.15.53:0/1364145160 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f858c066280 msgr2=0x7f858c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:55.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.467+0000 7f85b0c1d640 1 --2- 172.21.15.53:0/1364145160 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f858c066280 0x7f858c068730 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f859c0073f0 tx=0x7f859c00b040 comp rx=0 tx=0).stop 2023-06-10T19:08:55.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.467+0000 7f85b0c1d640 1 -- 172.21.15.53:0/1364145160 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85ac0c9fa0 msgr2=0x7f85ac0c5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:55.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.467+0000 7f85b0c1d640 1 --2- 172.21.15.53:0/1364145160 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85ac0c9fa0 0x7f85ac0c5730 secure :-1 s=READY pgs=2672 cs=0 l=1 rev1=1 crypto rx=0x7f85a401c920 tx=0x7f85a40191e0 comp rx=0 tx=0).stop 2023-06-10T19:08:55.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.467+0000 7f85b0c1d640 1 -- 172.21.15.53:0/1364145160 shutdown_connections 2023-06-10T19:08:55.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.467+0000 7f85b0c1d640 1 --2- 172.21.15.53:0/1364145160 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f858c066280 0x7f858c068730 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:55.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.467+0000 7f85b0c1d640 1 --2- 172.21.15.53:0/1364145160 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85ac0c9fa0 0x7f85ac0c5730 unknown :-1 s=CLOSED pgs=2672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:55.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.467+0000 7f85b0c1d640 1 --2- 172.21.15.53:0/1364145160 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85ac0af760 0x7f85ac155030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:55.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.467+0000 7f85b0c1d640 1 --2- 172.21.15.53:0/1364145160 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f85ac06c020 0x7f85ac0c7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:55.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.467+0000 7f85b0c1d640 1 -- 172.21.15.53:0/1364145160 >> 172.21.15.53:0/1364145160 conn(0x7f85ac06a0e0 msgr2=0x7f85ac0ac550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:55.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.467+0000 7f85b0c1d640 1 -- 172.21.15.53:0/1364145160 shutdown_connections 2023-06-10T19:08:55.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.467+0000 7f85b0c1d640 1 -- 172.21.15.53:0/1364145160 wait complete. 2023-06-10T19:08:55.489 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-10T19:08:55.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.611+0000 7f09e8565640 1 Processor -- start 2023-06-10T19:08:55.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.611+0000 7f09e8565640 1 -- start start 2023-06-10T19:08:55.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.615+0000 7f09e8565640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09e00cec40 0x7f09e00cf090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:55.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.615+0000 7f09e8565640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f09e00cbf50 0x7f09e00cc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:55.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.615+0000 7f09e8565640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09e00cf5d0 con 0x7f09e0159450 2023-06-10T19:08:55.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.615+0000 7f09e8565640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09e00cbac0 con 0x7f09e00cbf50 2023-06-10T19:08:55.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.615+0000 7f09e8565640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09e015dc00 con 0x7f09e00cec40 2023-06-10T19:08:55.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.615+0000 7f09e6b02640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f09e00cbf50 0x7f09e00cc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:55.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.615+0000 7f09e6b02640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f09e00cbf50 0x7f09e00cc3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42120/0 (socket says 172.21.15.53:42120) 2023-06-10T19:08:55.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.615+0000 7f09e6b02640 1 -- 172.21.15.53:0/4015344034 learned_addr learned my addr 172.21.15.53:0/4015344034 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:08:55.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.615+0000 7f09e5b00640 1 --2- 172.21.15.53:0/4015344034 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09e00cec40 0x7f09e00cf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:55.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.615+0000 7f09e6b02640 1 -- 172.21.15.53:0/4015344034 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09e00cec40 msgr2=0x7f09e00cf090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:55.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.615+0000 7f09e6b02640 1 --2- 172.21.15.53:0/4015344034 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09e00cec40 0x7f09e00cf090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:55.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.615+0000 7f09e6b02640 1 -- 172.21.15.53:0/4015344034 >> v1:172.21.15.117:6789/0 conn(0x7f09e0159450 legacy=0x7f09e015d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:55.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.615+0000 7f09e6b02640 1 -- 172.21.15.53:0/4015344034 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09e015dee0 con 0x7f09e00cbf50 2023-06-10T19:08:55.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.615+0000 7f09e6b02640 1 --2- 172.21.15.53:0/4015344034 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09e00cbf50 0x7f09e00cc3d0 secure :-1 s=READY pgs=2673 cs=0 l=1 rev1=1 crypto rx=0x7f09d8009e50 tx=0x7f09d801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59ca3e77726e97be server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:55.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.615+0000 7f09e52ff640 1 -- 172.21.15.53:0/4015344034 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d80a57e0 con 0x7f09e00cbf50 2023-06-10T19:08:55.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.615+0000 7f09e52ff640 1 -- 172.21.15.53:0/4015344034 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09d80a5940 con 0x7f09e00cbf50 2023-06-10T19:08:55.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.615+0000 7f09e52ff640 1 -- 172.21.15.53:0/4015344034 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d80a5cd0 con 0x7f09e00cbf50 2023-06-10T19:08:55.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.615+0000 7f09e8565640 1 -- 172.21.15.53:0/4015344034 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09e00cbf50 msgr2=0x7f09e00cc3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:55.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.615+0000 7f09e8565640 1 --2- 172.21.15.53:0/4015344034 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09e00cbf50 0x7f09e00cc3d0 secure :-1 s=READY pgs=2673 cs=0 l=1 rev1=1 crypto rx=0x7f09d8009e50 tx=0x7f09d801c9a0 comp rx=0 tx=0).stop 2023-06-10T19:08:55.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.615+0000 7f09e8565640 1 -- 172.21.15.53:0/4015344034 shutdown_connections 2023-06-10T19:08:55.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.615+0000 7f09e8565640 1 --2- 172.21.15.53:0/4015344034 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09e00cbf50 0x7f09e00cc3d0 unknown :-1 s=CLOSED pgs=2673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:55.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.615+0000 7f09e8565640 1 --2- 172.21.15.53:0/4015344034 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09e00cec40 0x7f09e00cf090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:55.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.615+0000 7f09e8565640 1 -- 172.21.15.53:0/4015344034 >> 172.21.15.53:0/4015344034 conn(0x7f09e006a090 msgr2=0x7f09e006d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:55.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.615+0000 7f09e8565640 1 -- 172.21.15.53:0/4015344034 shutdown_connections 2023-06-10T19:08:55.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.615+0000 7f09e8565640 1 -- 172.21.15.53:0/4015344034 wait complete. 2023-06-10T19:08:55.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.619+0000 7f09e8565640 1 Processor -- start 2023-06-10T19:08:55.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.619+0000 7f09e8565640 1 -- start start 2023-06-10T19:08:55.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.619+0000 7f09e8565640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09e00cbf50 0x7f09e00c9d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:55.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.619+0000 7f09e8565640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09e00cec40 0x7f09e00c5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:55.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.619+0000 7f09e8565640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09e0159450 0x7f09e0156030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:55.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.619+0000 7f09e8565640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e0152540 con 0x7f09e00cbf50 2023-06-10T19:08:55.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.619+0000 7f09e8565640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e0155b50 con 0x7f09e00cec40 2023-06-10T19:08:55.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.619+0000 7f09e8565640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09e0153180 con 0x7f09e0159450 2023-06-10T19:08:55.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.619+0000 7f09e6301640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09e00cbf50 0x7f09e00c9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:55.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.619+0000 7f09e6301640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09e00cbf50 0x7f09e00c9d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42130/0 (socket says 172.21.15.53:42130) 2023-06-10T19:08:55.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.619+0000 7f09e6301640 1 -- 172.21.15.53:0/2052994253 learned_addr learned my addr 172.21.15.53:0/2052994253 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:08:55.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.619+0000 7f09e5b00640 1 --2- 172.21.15.53:0/2052994253 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09e00cec40 0x7f09e00c5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:55.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.619+0000 7f09e6b02640 1 --2- 172.21.15.53:0/2052994253 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09e0159450 0x7f09e0156030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:55.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.619+0000 7f09e6301640 1 -- 172.21.15.53:0/2052994253 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09e0159450 msgr2=0x7f09e0156030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:55.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.619+0000 7f09e6301640 1 --2- 172.21.15.53:0/2052994253 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09e0159450 0x7f09e0156030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:55.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.619+0000 7f09e6301640 1 -- 172.21.15.53:0/2052994253 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09e00cec40 msgr2=0x7f09e00c5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:55.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.619+0000 7f09e6301640 1 --2- 172.21.15.53:0/2052994253 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09e00cec40 0x7f09e00c5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:55.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.619+0000 7f09e6301640 1 -- 172.21.15.53:0/2052994253 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09d8009b30 con 0x7f09e00cbf50 2023-06-10T19:08:55.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.619+0000 7f09e6301640 1 --2- 172.21.15.53:0/2052994253 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09e00cbf50 0x7f09e00c9d90 secure :-1 s=READY pgs=2674 cs=0 l=1 rev1=1 crypto rx=0x7f09dc00c450 tx=0x7f09dc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:55.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.619+0000 7f09d6ffd640 1 -- 172.21.15.53:0/2052994253 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09dc012830 con 0x7f09e00cbf50 2023-06-10T19:08:55.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.619+0000 7f09d6ffd640 1 -- 172.21.15.53:0/2052994253 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09dc0129b0 con 0x7f09e00cbf50 2023-06-10T19:08:55.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.619+0000 7f09d6ffd640 1 -- 172.21.15.53:0/2052994253 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09dc012d60 con 0x7f09e00cbf50 2023-06-10T19:08:55.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.619+0000 7f09e8565640 1 -- 172.21.15.53:0/2052994253 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09e015d9d0 con 0x7f09e00cbf50 2023-06-10T19:08:55.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.619+0000 7f09e8565640 1 -- 172.21.15.53:0/2052994253 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09e0153440 con 0x7f09e00cbf50 2023-06-10T19:08:55.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.619+0000 7f09e8565640 1 -- 172.21.15.53:0/2052994253 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09e01559b0 con 0x7f09e00cbf50 2023-06-10T19:08:55.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.623+0000 7f09d6ffd640 1 -- 172.21.15.53:0/2052994253 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f09dc01c460 con 0x7f09e00cbf50 2023-06-10T19:08:55.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.623+0000 7f09d6ffd640 1 --2- 172.21.15.53:0/2052994253 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f09c4066280 0x7f09c4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:55.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.623+0000 7f09d6ffd640 1 -- 172.21.15.53:0/2052994253 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6192+0+0 (secure 0 0 0) 0x7f09dc083c40 con 0x7f09e00cbf50 2023-06-10T19:08:55.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.623+0000 7f09e5b00640 1 --2- 172.21.15.53:0/2052994253 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f09c4066280 0x7f09c4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:55.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.623+0000 7f09e5b00640 1 --2- 172.21.15.53:0/2052994253 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f09c4066280 0x7f09c4068730 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f09e00b10a0 tx=0x7f09d0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:55.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.627+0000 7f09d6ffd640 1 -- 172.21.15.53:0/2052994253 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f09e01559b0 con 0x7f09e00cbf50 2023-06-10T19:08:55.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.779+0000 7f09e8565640 1 -- 172.21.15.53:0/2052994253 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f09e01559b0 con 0x7f09e00cbf50 2023-06-10T19:08:55.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.779+0000 7f09d6ffd640 1 -- 172.21.15.53:0/2052994253 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v183) v1 ==== 104+0+11 (secure 0 0 0) 0x7f09e01559b0 con 0x7f09e00cbf50 2023-06-10T19:08:55.786 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-06-10T19:08:55.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.783+0000 7f09e8565640 1 -- 172.21.15.53:0/2052994253 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f09c4066280 msgr2=0x7f09c4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:55.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.783+0000 7f09e8565640 1 --2- 172.21.15.53:0/2052994253 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f09c4066280 0x7f09c4068730 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f09e00b10a0 tx=0x7f09d0008040 comp rx=0 tx=0).stop 2023-06-10T19:08:55.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.783+0000 7f09e8565640 1 -- 172.21.15.53:0/2052994253 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09e00cbf50 msgr2=0x7f09e00c9d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:55.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.783+0000 7f09e8565640 1 --2- 172.21.15.53:0/2052994253 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09e00cbf50 0x7f09e00c9d90 secure :-1 s=READY pgs=2674 cs=0 l=1 rev1=1 crypto rx=0x7f09dc00c450 tx=0x7f09dc00c910 comp rx=0 tx=0).stop 2023-06-10T19:08:55.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.783+0000 7f09e8565640 1 -- 172.21.15.53:0/2052994253 shutdown_connections 2023-06-10T19:08:55.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.783+0000 7f09e8565640 1 --2- 172.21.15.53:0/2052994253 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f09c4066280 0x7f09c4068730 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:55.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.783+0000 7f09e8565640 1 --2- 172.21.15.53:0/2052994253 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09e0159450 0x7f09e0156030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:55.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.783+0000 7f09e8565640 1 --2- 172.21.15.53:0/2052994253 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09e00cec40 0x7f09e00c5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:55.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.783+0000 7f09e8565640 1 --2- 172.21.15.53:0/2052994253 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09e00cbf50 0x7f09e00c9d90 unknown :-1 s=CLOSED pgs=2674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:55.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.783+0000 7f09e8565640 1 -- 172.21.15.53:0/2052994253 >> 172.21.15.53:0/2052994253 conn(0x7f09e006a090 msgr2=0x7f09e00b3020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:55.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.783+0000 7f09e8565640 1 -- 172.21.15.53:0/2052994253 shutdown_connections 2023-06-10T19:08:55.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.783+0000 7f09e8565640 1 -- 172.21.15.53:0/2052994253 wait complete. 2023-06-10T19:08:55.805 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-10T19:08:55.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.919+0000 7f61040d7640 1 Processor -- start 2023-06-10T19:08:55.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.919+0000 7f61040d7640 1 -- start start 2023-06-10T19:08:55.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.923+0000 7f61040d7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60fc070de0 0x7f60fc15cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:55.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.923+0000 7f61040d7640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60fc0cc460 con 0x7f60fc15c060 2023-06-10T19:08:55.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.923+0000 7f61040d7640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60fc0c8d50 con 0x7f60fc0cc020 2023-06-10T19:08:55.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.923+0000 7f61040d7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60fc0c9030 con 0x7f60fc070de0 2023-06-10T19:08:55.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.923+0000 7f6101e73640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f60fc15c060 0x7f60fc15c430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56768/0 (socket says 172.21.15.53:56768) 2023-06-10T19:08:55.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.923+0000 7f6101e73640 1 -- 172.21.15.53:0/3713926487 learned_addr learned my addr 172.21.15.53:0/3713926487 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:08:55.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.923+0000 7f6101672640 1 --2- 172.21.15.53:0/3713926487 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60fc070de0 0x7f60fc15cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:55.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.923+0000 7f6100e71640 1 -- 172.21.15.53:0/3713926487 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2537528123 0 0) 0x7f60fc0cc460 con 0x7f60fc15c060 2023-06-10T19:08:55.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.923+0000 7f6100e71640 1 -- 172.21.15.53:0/3713926487 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60e4003530 con 0x7f60fc15c060 2023-06-10T19:08:55.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.923+0000 7f6100e71640 1 -- 172.21.15.53:0/3713926487 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 256470106 0 0) 0x7f60e4003530 con 0x7f60fc15c060 2023-06-10T19:08:55.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.923+0000 7f6100e71640 1 -- 172.21.15.53:0/3713926487 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60fc070de0 msgr2=0x7f60fc15cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:55.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.923+0000 7f6100e71640 1 --2- 172.21.15.53:0/3713926487 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60fc070de0 0x7f60fc15cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:55.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.923+0000 7f6100e71640 1 -- 172.21.15.53:0/3713926487 >> v1:172.21.15.117:6789/0 conn(0x7f60fc0cc020 legacy=0x7f60fc06bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:55.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.923+0000 7f6100e71640 1 -- 172.21.15.53:0/3713926487 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60fc070300 con 0x7f60fc15c060 2023-06-10T19:08:55.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.923+0000 7f6100e71640 1 -- 172.21.15.53:0/3713926487 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f60ec001680 con 0x7f60fc15c060 2023-06-10T19:08:55.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.923+0000 7f6100e71640 1 -- 172.21.15.53:0/3713926487 >> v1:172.21.15.53:6789/0 conn(0x7f60fc15c060 legacy=0x7f60fc15c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:55.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.923+0000 7f6100e71640 1 --2- 172.21.15.53:0/3713926487 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60e40039b0 0x7f60e4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:55.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.923+0000 7f6100e71640 1 --2- 172.21.15.53:0/3713926487 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60e40047d0 0x7f60e4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:55.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.923+0000 7f6100e71640 1 --2- 172.21.15.53:0/3713926487 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60fc070de0 0x7f60e40051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:55.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.923+0000 7f6100e71640 1 -- 172.21.15.53:0/3713926487 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60fc0c9030 con 0x7f60e40039b0 2023-06-10T19:08:55.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.923+0000 7f6100e71640 1 -- 172.21.15.53:0/3713926487 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e400ba90 con 0x7f60e40047d0 2023-06-10T19:08:55.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.923+0000 7f6100e71640 1 -- 172.21.15.53:0/3713926487 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60e400bc50 con 0x7f60fc070de0 2023-06-10T19:08:55.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.923+0000 7f6101e73640 1 --2- 172.21.15.53:0/3713926487 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60e40039b0 0x7f60e4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:55.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.923+0000 7f6101672640 1 --2- 172.21.15.53:0/3713926487 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60e40047d0 0x7f60e4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:55.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.923+0000 7f6102674640 1 --2- 172.21.15.53:0/3713926487 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60fc070de0 0x7f60e40051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:55.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.923+0000 7f6101e73640 1 -- 172.21.15.53:0/3713926487 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60fc070de0 msgr2=0x7f60e40051a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:55.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.923+0000 7f6101e73640 1 --2- 172.21.15.53:0/3713926487 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60fc070de0 0x7f60e40051a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:55.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.923+0000 7f6101e73640 1 -- 172.21.15.53:0/3713926487 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60e40047d0 msgr2=0x7f60e4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:55.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.923+0000 7f6101e73640 1 --2- 172.21.15.53:0/3713926487 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60e40047d0 0x7f60e4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:55.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.923+0000 7f6101e73640 1 -- 172.21.15.53:0/3713926487 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e4003530 con 0x7f60e40039b0 2023-06-10T19:08:55.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.927+0000 7f6101e73640 1 --2- 172.21.15.53:0/3713926487 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60e40039b0 0x7f60e4003dc0 secure :-1 s=READY pgs=2676 cs=0 l=1 rev1=1 crypto rx=0x7f60ec00c240 tx=0x7f60ec01cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=440d09ced7cacd97 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:55.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.927+0000 7f6100e71640 1 -- 172.21.15.53:0/3713926487 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ec005ae0 con 0x7f60e40039b0 2023-06-10T19:08:55.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.927+0000 7f6100e71640 1 -- 172.21.15.53:0/3713926487 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60ec005c40 con 0x7f60e40039b0 2023-06-10T19:08:55.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.927+0000 7f6100e71640 1 -- 172.21.15.53:0/3713926487 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ec0a5800 con 0x7f60e40039b0 2023-06-10T19:08:55.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.927+0000 7f61040d7640 1 -- 172.21.15.53:0/3713926487 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60e40039b0 msgr2=0x7f60e4003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:55.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.927+0000 7f61040d7640 1 --2- 172.21.15.53:0/3713926487 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60e40039b0 0x7f60e4003dc0 secure :-1 s=READY pgs=2676 cs=0 l=1 rev1=1 crypto rx=0x7f60ec00c240 tx=0x7f60ec01cc10 comp rx=0 tx=0).stop 2023-06-10T19:08:55.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.927+0000 7f6102674640 1 -- 172.21.15.53:0/3713926487 reap_dead start 2023-06-10T19:08:55.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.927+0000 7f61040d7640 1 -- 172.21.15.53:0/3713926487 shutdown_connections 2023-06-10T19:08:55.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.927+0000 7f61040d7640 1 -- 172.21.15.53:0/3713926487 >> 172.21.15.53:0/3713926487 conn(0x7f60fc06a0e0 msgr2=0x7f60fc0cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:55.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.927+0000 7f61040d7640 1 -- 172.21.15.53:0/3713926487 shutdown_connections 2023-06-10T19:08:55.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.927+0000 7f61040d7640 1 -- 172.21.15.53:0/3713926487 wait complete. 2023-06-10T19:08:55.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.927+0000 7f61040d7640 1 Processor -- start 2023-06-10T19:08:55.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.927+0000 7f61040d7640 1 -- start start 2023-06-10T19:08:55.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.927+0000 7f61040d7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60e40039b0 0x7f60fc0c3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:55.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.927+0000 7f61040d7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60fc149f50 0x7f60fc166920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:55.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.927+0000 7f61040d7640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60fc14a3c0 0x7f60fc0cd4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:55.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.927+0000 7f61040d7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60fc0c3600 con 0x7f60e40039b0 2023-06-10T19:08:55.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.927+0000 7f61040d7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60fc167370 con 0x7f60fc149f50 2023-06-10T19:08:55.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.927+0000 7f61040d7640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60fc0c2cd0 con 0x7f60fc14a3c0 2023-06-10T19:08:55.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.927+0000 7f6101e73640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60e40039b0 0x7f60fc0c3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:55.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.927+0000 7f6101e73640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60e40039b0 0x7f60fc0c3a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42146/0 (socket says 172.21.15.53:42146) 2023-06-10T19:08:55.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.927+0000 7f6101e73640 1 -- 172.21.15.53:0/3235494080 learned_addr learned my addr 172.21.15.53:0/3235494080 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:08:55.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.927+0000 7f6102674640 1 --2- 172.21.15.53:0/3235494080 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60fc14a3c0 0x7f60fc0cd4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:55.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.927+0000 7f6101672640 1 --2- 172.21.15.53:0/3235494080 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60fc149f50 0x7f60fc166920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:55.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.927+0000 7f6101e73640 1 -- 172.21.15.53:0/3235494080 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60fc14a3c0 msgr2=0x7f60fc0cd4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:55.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.927+0000 7f6101e73640 1 --2- 172.21.15.53:0/3235494080 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60fc14a3c0 0x7f60fc0cd4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:55.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.927+0000 7f6101e73640 1 -- 172.21.15.53:0/3235494080 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60fc149f50 msgr2=0x7f60fc166920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:55.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.927+0000 7f6101e73640 1 --2- 172.21.15.53:0/3235494080 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60fc149f50 0x7f60fc166920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:55.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.927+0000 7f6101e73640 1 -- 172.21.15.53:0/3235494080 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60fc0c2fb0 con 0x7f60e40039b0 2023-06-10T19:08:55.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.927+0000 7f6101e73640 1 --2- 172.21.15.53:0/3235494080 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60e40039b0 0x7f60fc0c3a90 secure :-1 s=READY pgs=2677 cs=0 l=1 rev1=1 crypto rx=0x7f60ec001940 tx=0x7f60e4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:55.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.931+0000 7f60fa7fc640 1 -- 172.21.15.53:0/3235494080 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ec0b4070 con 0x7f60e40039b0 2023-06-10T19:08:55.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.931+0000 7f60fa7fc640 1 -- 172.21.15.53:0/3235494080 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60ec005db0 con 0x7f60e40039b0 2023-06-10T19:08:55.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.931+0000 7f61040d7640 1 -- 172.21.15.53:0/3235494080 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60fc0c3290 con 0x7f60e40039b0 2023-06-10T19:08:55.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.931+0000 7f60fa7fc640 1 -- 172.21.15.53:0/3235494080 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ec001680 con 0x7f60e40039b0 2023-06-10T19:08:55.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.931+0000 7f61040d7640 1 -- 172.21.15.53:0/3235494080 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60fc166540 con 0x7f60e40039b0 2023-06-10T19:08:55.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.931+0000 7f61040d7640 1 -- 172.21.15.53:0/3235494080 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60fc04d790 con 0x7f60e40039b0 2023-06-10T19:08:55.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.931+0000 7f60fa7fc640 1 -- 172.21.15.53:0/3235494080 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f60ec0a5800 con 0x7f60e40039b0 2023-06-10T19:08:55.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.931+0000 7f60fa7fc640 1 --2- 172.21.15.53:0/3235494080 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f60e8066280 0x7f60e8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:55.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.931+0000 7f60fa7fc640 1 -- 172.21.15.53:0/3235494080 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6192+0+0 (secure 0 0 0) 0x7f60ec11c870 con 0x7f60e40039b0 2023-06-10T19:08:55.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.931+0000 7f6101672640 1 --2- 172.21.15.53:0/3235494080 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f60e8066280 0x7f60e8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:55.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.931+0000 7f6101672640 1 --2- 172.21.15.53:0/3235494080 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f60e8066280 0x7f60e8068730 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f60fc150350 tx=0x7f60f000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:55.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:55.935+0000 7f60fa7fc640 1 -- 172.21.15.53:0/3235494080 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f60ec0e9bf0 con 0x7f60e40039b0 2023-06-10T19:08:56.094 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.087+0000 7f61040d7640 1 -- 172.21.15.53:0/3235494080 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f60fc0b3c60 con 0x7f60e40039b0 2023-06-10T19:08:56.095 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.091+0000 7f60fa7fc640 1 -- 172.21.15.53:0/3235494080 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v183) v1 ==== 100+0+11 (secure 0 0 0) 0x7f60ec0ed210 con 0x7f60e40039b0 2023-06-10T19:08:56.095 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-06-10T19:08:56.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.091+0000 7f61040d7640 1 -- 172.21.15.53:0/3235494080 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f60e8066280 msgr2=0x7f60e8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:56.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.091+0000 7f61040d7640 1 --2- 172.21.15.53:0/3235494080 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f60e8066280 0x7f60e8068730 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f60fc150350 tx=0x7f60f000b040 comp rx=0 tx=0).stop 2023-06-10T19:08:56.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.091+0000 7f61040d7640 1 -- 172.21.15.53:0/3235494080 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60e40039b0 msgr2=0x7f60fc0c3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:56.097 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.091+0000 7f61040d7640 1 --2- 172.21.15.53:0/3235494080 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60e40039b0 0x7f60fc0c3a90 secure :-1 s=READY pgs=2677 cs=0 l=1 rev1=1 crypto rx=0x7f60ec001940 tx=0x7f60e4005800 comp rx=0 tx=0).stop 2023-06-10T19:08:56.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.091+0000 7f61040d7640 1 -- 172.21.15.53:0/3235494080 shutdown_connections 2023-06-10T19:08:56.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.091+0000 7f61040d7640 1 --2- 172.21.15.53:0/3235494080 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f60e8066280 0x7f60e8068730 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:56.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.091+0000 7f61040d7640 1 --2- 172.21.15.53:0/3235494080 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f60fc14a3c0 0x7f60fc0cd4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:56.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.091+0000 7f61040d7640 1 --2- 172.21.15.53:0/3235494080 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60fc149f50 0x7f60fc166920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:56.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.091+0000 7f61040d7640 1 --2- 172.21.15.53:0/3235494080 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60e40039b0 0x7f60fc0c3a90 unknown :-1 s=CLOSED pgs=2677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:56.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.091+0000 7f61040d7640 1 -- 172.21.15.53:0/3235494080 >> 172.21.15.53:0/3235494080 conn(0x7f60fc06a0e0 msgr2=0x7f60fc163a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:56.098 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.091+0000 7f61040d7640 1 -- 172.21.15.53:0/3235494080 shutdown_connections 2023-06-10T19:08:56.099 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.091+0000 7f61040d7640 1 -- 172.21.15.53:0/3235494080 wait complete. 2023-06-10T19:08:56.115 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-10T19:08:56.235 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.231+0000 7f8abe7e3640 1 Processor -- start 2023-06-10T19:08:56.235 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.231+0000 7f8abe7e3640 1 -- start start 2023-06-10T19:08:56.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.231+0000 7f8abe7e3640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8ab80aca00 0x7f8ab80ac320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:56.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.231+0000 7f8abe7e3640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ab80ad0e0 con 0x7f8ab80afee0 2023-06-10T19:08:56.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.231+0000 7f8abe7e3640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ab80cd400 con 0x7f8ab815b870 2023-06-10T19:08:56.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.231+0000 7f8abe7e3640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ab80ccd40 con 0x7f8ab80aca00 2023-06-10T19:08:56.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.231+0000 7f8ab77fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f8ab80afee0 0x7f8ab80c8760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56770/0 (socket says 172.21.15.53:56770) 2023-06-10T19:08:56.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.231+0000 7f8ab77fe640 1 -- 172.21.15.53:0/3542638589 learned_addr learned my addr 172.21.15.53:0/3542638589 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:08:56.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.231+0000 7f8abcd80640 1 --2- 172.21.15.53:0/3542638589 >> v2:172.21.15.117:3300/0 conn(0x7f8ab80aca00 0x7f8ab80ac320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:56.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.231+0000 7f8ab6ffd640 1 -- 172.21.15.53:0/3542638589 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4248384138 0 0) 0x7f8ab80ad0e0 con 0x7f8ab80afee0 2023-06-10T19:08:56.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.231+0000 7f8ab6ffd640 1 -- 172.21.15.53:0/3542638589 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8aa0003530 con 0x7f8ab80afee0 2023-06-10T19:08:56.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.231+0000 7f8ab6ffd640 1 -- 172.21.15.53:0/3542638589 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3901005457 0 0) 0x7f8aa0003530 con 0x7f8ab80afee0 2023-06-10T19:08:56.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.231+0000 7f8ab6ffd640 1 -- 172.21.15.53:0/3542638589 >> v2:172.21.15.117:3300/0 conn(0x7f8ab80aca00 msgr2=0x7f8ab80ac320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:56.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.231+0000 7f8ab6ffd640 1 --2- 172.21.15.53:0/3542638589 >> v2:172.21.15.117:3300/0 conn(0x7f8ab80aca00 0x7f8ab80ac320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:56.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.231+0000 7f8ab6ffd640 1 -- 172.21.15.53:0/3542638589 >> v1:172.21.15.117:6789/0 conn(0x7f8ab815b870 legacy=0x7f8ab80af7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:56.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.231+0000 7f8ab6ffd640 1 -- 172.21.15.53:0/3542638589 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ab80cd6e0 con 0x7f8ab80afee0 2023-06-10T19:08:56.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.231+0000 7f8ab6ffd640 1 -- 172.21.15.53:0/3542638589 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f8aa8001680 con 0x7f8ab80afee0 2023-06-10T19:08:56.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.231+0000 7f8ab6ffd640 1 -- 172.21.15.53:0/3542638589 >> v1:172.21.15.53:6789/0 conn(0x7f8ab80afee0 legacy=0x7f8ab80c8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:56.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.231+0000 7f8ab6ffd640 1 --2- 172.21.15.53:0/3542638589 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8aa0003980 0x7f8aa0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:56.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.231+0000 7f8ab6ffd640 1 --2- 172.21.15.53:0/3542638589 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8aa00047d0 0x7f8aa0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:56.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.231+0000 7f8ab6ffd640 1 --2- 172.21.15.53:0/3542638589 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8aa0005180 0x7f8aa000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:56.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.231+0000 7f8ab6ffd640 1 -- 172.21.15.53:0/3542638589 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa000bfd0 con 0x7f8aa00047d0 2023-06-10T19:08:56.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.231+0000 7f8ab6ffd640 1 -- 172.21.15.53:0/3542638589 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa000c140 con 0x7f8aa0005180 2023-06-10T19:08:56.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.231+0000 7f8ab6ffd640 1 -- 172.21.15.53:0/3542638589 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa000c300 con 0x7f8aa0003980 2023-06-10T19:08:56.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.231+0000 7f8ab77fe640 1 --2- 172.21.15.53:0/3542638589 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8aa00047d0 0x7f8aa0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:56.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.231+0000 7f8abcd80640 1 --2- 172.21.15.53:0/3542638589 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8aa0005180 0x7f8aa000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:56.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.231+0000 7f8ab7fff640 1 --2- 172.21.15.53:0/3542638589 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8aa0003980 0x7f8aa0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:56.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.231+0000 7f8ab77fe640 1 -- 172.21.15.53:0/3542638589 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8aa0003980 msgr2=0x7f8aa0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:56.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.231+0000 7f8ab77fe640 1 --2- 172.21.15.53:0/3542638589 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8aa0003980 0x7f8aa0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:56.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.231+0000 7f8ab77fe640 1 -- 172.21.15.53:0/3542638589 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8aa0005180 msgr2=0x7f8aa000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:56.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.231+0000 7f8ab77fe640 1 --2- 172.21.15.53:0/3542638589 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8aa0005180 0x7f8aa000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:56.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.231+0000 7f8ab77fe640 1 -- 172.21.15.53:0/3542638589 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aa0003530 con 0x7f8aa00047d0 2023-06-10T19:08:56.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.231+0000 7f8abcd80640 1 -- 172.21.15.53:0/3542638589 reap_dead start 2023-06-10T19:08:56.243 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.235+0000 7f8ab77fe640 1 --2- 172.21.15.53:0/3542638589 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8aa00047d0 0x7f8aa0004c40 secure :-1 s=READY pgs=2679 cs=0 l=1 rev1=1 crypto rx=0x7f8aa800c210 tx=0x7f8aa801f2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62bb493060986564 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:56.244 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.235+0000 7f8ab6ffd640 1 -- 172.21.15.53:0/3542638589 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa80a8e10 con 0x7f8aa00047d0 2023-06-10T19:08:56.244 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.235+0000 7f8ab6ffd640 1 -- 172.21.15.53:0/3542638589 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aa80058e0 con 0x7f8aa00047d0 2023-06-10T19:08:56.244 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.235+0000 7f8ab6ffd640 1 -- 172.21.15.53:0/3542638589 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa8005cb0 con 0x7f8aa00047d0 2023-06-10T19:08:56.244 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.235+0000 7f8abe7e3640 1 -- 172.21.15.53:0/3542638589 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8aa00047d0 msgr2=0x7f8aa0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:56.244 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.235+0000 7f8abe7e3640 1 --2- 172.21.15.53:0/3542638589 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8aa00047d0 0x7f8aa0004c40 secure :-1 s=READY pgs=2679 cs=0 l=1 rev1=1 crypto rx=0x7f8aa800c210 tx=0x7f8aa801f2f0 comp rx=0 tx=0).stop 2023-06-10T19:08:56.244 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.235+0000 7f8abe7e3640 1 -- 172.21.15.53:0/3542638589 shutdown_connections 2023-06-10T19:08:56.244 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.235+0000 7f8abe7e3640 1 --2- 172.21.15.53:0/3542638589 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8aa00047d0 0x7f8aa0004c40 unknown :-1 s=CLOSED pgs=2679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:56.245 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.235+0000 7f8abe7e3640 1 -- 172.21.15.53:0/3542638589 >> 172.21.15.53:0/3542638589 conn(0x7f8ab80ce9e0 msgr2=0x7f8ab80ca7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:56.245 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.235+0000 7f8abe7e3640 1 -- 172.21.15.53:0/3542638589 shutdown_connections 2023-06-10T19:08:56.245 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.235+0000 7f8abe7e3640 1 -- 172.21.15.53:0/3542638589 wait complete. 2023-06-10T19:08:56.245 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.235+0000 7f8abe7e3640 1 Processor -- start 2023-06-10T19:08:56.245 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.235+0000 7f8abe7e3640 1 -- start start 2023-06-10T19:08:56.245 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.235+0000 7f8abe7e3640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8aa00047d0 0x7f8ab80c6770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:56.245 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.235+0000 7f8abe7e3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ab8154120 0x7f8ab80c33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:56.245 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.235+0000 7f8abe7e3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ab8153810 0x7f8ab80af320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:56.246 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.235+0000 7f8abe7e3640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab80c62e0 con 0x7f8ab8153810 2023-06-10T19:08:56.246 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.235+0000 7f8abe7e3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab80c5750 con 0x7f8ab8154120 2023-06-10T19:08:56.246 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.235+0000 7f8abe7e3640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab80c59b0 con 0x7f8aa00047d0 2023-06-10T19:08:56.246 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.239+0000 7f8abcd80640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ab8153810 0x7f8ab80af320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:56.246 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.239+0000 7f8abcd80640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ab8153810 0x7f8ab80af320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42160/0 (socket says 172.21.15.53:42160) 2023-06-10T19:08:56.246 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.239+0000 7f8abcd80640 1 -- 172.21.15.53:0/2518280294 learned_addr learned my addr 172.21.15.53:0/2518280294 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:08:56.246 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.239+0000 7f8ab7fff640 1 --2- 172.21.15.53:0/2518280294 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8aa00047d0 0x7f8ab80c6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:56.246 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.239+0000 7f8ab77fe640 1 --2- 172.21.15.53:0/2518280294 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ab8154120 0x7f8ab80c33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:56.247 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.239+0000 7f8abcd80640 1 -- 172.21.15.53:0/2518280294 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8aa00047d0 msgr2=0x7f8ab80c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:56.247 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.239+0000 7f8abcd80640 1 --2- 172.21.15.53:0/2518280294 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8aa00047d0 0x7f8ab80c6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:56.247 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.239+0000 7f8abcd80640 1 -- 172.21.15.53:0/2518280294 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ab8154120 msgr2=0x7f8ab80c33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:56.247 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.239+0000 7f8abcd80640 1 --2- 172.21.15.53:0/2518280294 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ab8154120 0x7f8ab80c33c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:56.247 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.239+0000 7f8abcd80640 1 -- 172.21.15.53:0/2518280294 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ab80c5c90 con 0x7f8ab8153810 2023-06-10T19:08:56.247 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.239+0000 7f8abcd80640 1 --2- 172.21.15.53:0/2518280294 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ab8153810 0x7f8ab80af320 secure :-1 s=READY pgs=2680 cs=0 l=1 rev1=1 crypto rx=0x7f8ab80c16d0 tx=0x7f8ab0011cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:56.247 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.239+0000 7f8ab4ff9640 1 -- 172.21.15.53:0/2518280294 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab000e040 con 0x7f8ab8153810 2023-06-10T19:08:56.247 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.239+0000 7f8ab4ff9640 1 -- 172.21.15.53:0/2518280294 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ab000f040 con 0x7f8ab8153810 2023-06-10T19:08:56.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.239+0000 7f8abe7e3640 1 -- 172.21.15.53:0/2518280294 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ab80c5f70 con 0x7f8ab8153810 2023-06-10T19:08:56.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.239+0000 7f8ab4ff9640 1 -- 172.21.15.53:0/2518280294 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab0015a80 con 0x7f8ab8153810 2023-06-10T19:08:56.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.239+0000 7f8abe7e3640 1 -- 172.21.15.53:0/2518280294 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ab80c3900 con 0x7f8ab8153810 2023-06-10T19:08:56.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.239+0000 7f8abe7e3640 1 -- 172.21.15.53:0/2518280294 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ab80c6450 con 0x7f8ab8153810 2023-06-10T19:08:56.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.239+0000 7f8ab4ff9640 1 -- 172.21.15.53:0/2518280294 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8ab0015be0 con 0x7f8ab8153810 2023-06-10T19:08:56.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.239+0000 7f8ab4ff9640 1 --2- 172.21.15.53:0/2518280294 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8aa40662b0 0x7f8aa4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:56.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.239+0000 7f8ab4ff9640 1 -- 172.21.15.53:0/2518280294 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6192+0+0 (secure 0 0 0) 0x7f8ab0083f50 con 0x7f8ab8153810 2023-06-10T19:08:56.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.239+0000 7f8ab7fff640 1 --2- 172.21.15.53:0/2518280294 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8aa40662b0 0x7f8aa4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:56.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.243+0000 7f8ab7fff640 1 --2- 172.21.15.53:0/2518280294 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8aa40662b0 0x7f8aa4068760 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f8ab80ca5a0 tx=0x7f8aac009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:56.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.243+0000 7f8ab4ff9640 1 -- 172.21.15.53:0/2518280294 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8ab0054d60 con 0x7f8ab8153810 2023-06-10T19:08:56.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.415+0000 7f8abe7e3640 1 -- 172.21.15.53:0/2518280294 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f8ab804d790 con 0x7f8ab8153810 2023-06-10T19:08:56.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.415+0000 7f8ab4ff9640 1 -- 172.21.15.53:0/2518280294 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 1 entries v183) v1 ==== 80+0+57 (secure 0 0 0) 0x7f8ab00548f0 con 0x7f8ab8153810 2023-06-10T19:08:56.421 INFO:teuthology.orchestra.run.smithi053.stdout:192.168.0.1:0/3824904337 2023-06-10T20:08:33.687127+0000 2023-06-10T19:08:56.421 INFO:teuthology.orchestra.run.smithi053.stderr:listed 1 entries 2023-06-10T19:08:56.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.415+0000 7f8abe7e3640 1 -- 172.21.15.53:0/2518280294 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8aa40662b0 msgr2=0x7f8aa4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:56.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.415+0000 7f8abe7e3640 1 --2- 172.21.15.53:0/2518280294 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8aa40662b0 0x7f8aa4068760 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f8ab80ca5a0 tx=0x7f8aac009040 comp rx=0 tx=0).stop 2023-06-10T19:08:56.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.415+0000 7f8abe7e3640 1 -- 172.21.15.53:0/2518280294 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ab8153810 msgr2=0x7f8ab80af320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:56.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.415+0000 7f8abe7e3640 1 --2- 172.21.15.53:0/2518280294 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ab8153810 0x7f8ab80af320 secure :-1 s=READY pgs=2680 cs=0 l=1 rev1=1 crypto rx=0x7f8ab80c16d0 tx=0x7f8ab0011cb0 comp rx=0 tx=0).stop 2023-06-10T19:08:56.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.415+0000 7f8abe7e3640 1 -- 172.21.15.53:0/2518280294 shutdown_connections 2023-06-10T19:08:56.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.415+0000 7f8abe7e3640 1 --2- 172.21.15.53:0/2518280294 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f8aa40662b0 0x7f8aa4068760 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:56.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.415+0000 7f8abe7e3640 1 --2- 172.21.15.53:0/2518280294 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ab8153810 0x7f8ab80af320 unknown :-1 s=CLOSED pgs=2680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:56.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.415+0000 7f8abe7e3640 1 --2- 172.21.15.53:0/2518280294 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ab8154120 0x7f8ab80c33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:56.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.415+0000 7f8abe7e3640 1 --2- 172.21.15.53:0/2518280294 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8aa00047d0 0x7f8ab80c6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:56.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.415+0000 7f8abe7e3640 1 -- 172.21.15.53:0/2518280294 >> 172.21.15.53:0/2518280294 conn(0x7f8ab80ce9e0 msgr2=0x7f8ab806a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:56.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.415+0000 7f8abe7e3640 1 -- 172.21.15.53:0/2518280294 shutdown_connections 2023-06-10T19:08:56.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.415+0000 7f8abe7e3640 1 -- 172.21.15.53:0/2518280294 wait complete. 2023-06-10T19:08:56.439 DEBUG:tasks.cephfs.mount:Force/lazy unmounting on client.0 2023-06-10T19:08:56.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:08:56.440 DEBUG:teuthology.orchestra.run.smithi053:> sudo umount --lazy --force /home/ubuntu/cephtest/mnt.0 2023-06-10T19:08:56.452 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi053.stderr:ceph-fuse[71340]: fuse finished with error 0 and tester_r 0 2023-06-10T19:08:56.453 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi053.front.sepia.ceph.com 2023-06-10T19:08:56.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:08:56.454 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-06-10T19:08:56.622 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T19:08:56.623 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:08:56.630 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:08:56.799 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.795+0000 7f1c37730640 1 Processor -- start 2023-06-10T19:08:56.799 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.795+0000 7f1c37730640 1 -- start start 2023-06-10T19:08:56.800 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.795+0000 7f1c37730640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1c3015b870 0x7f1c3006a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:56.800 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.795+0000 7f1c37730640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1c300b03f0 0x7f1c30069b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:56.801 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.795+0000 7f1c37730640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c3006ae70 con 0x7f1c300affc0 2023-06-10T19:08:56.801 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.795+0000 7f1c37730640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c300655c0 con 0x7f1c3015b870 2023-06-10T19:08:56.801 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.795+0000 7f1c37730640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c300cc110 con 0x7f1c300b03f0 2023-06-10T19:08:56.801 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.795+0000 7f1c354cc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1c3015b870 0x7f1c3006a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:56.801 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.795+0000 7f1c34ccb640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f1c300affc0 0x7f1c30069450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56776/0 (socket says 172.21.15.53:56776) 2023-06-10T19:08:56.801 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.795+0000 7f1c34ccb640 1 -- 172.21.15.53:0/427590685 learned_addr learned my addr 172.21.15.53:0/427590685 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:08:56.802 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.795+0000 7f1c35ccd640 1 --2- 172.21.15.53:0/427590685 >> v2:172.21.15.117:3300/0 conn(0x7f1c300b03f0 0x7f1c30069b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:56.802 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.795+0000 7f1c354cc640 1 -- 172.21.15.53:0/427590685 >> v2:172.21.15.117:3300/0 conn(0x7f1c300b03f0 msgr2=0x7f1c30069b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:56.802 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.795+0000 7f1c354cc640 1 --2- 172.21.15.53:0/427590685 >> v2:172.21.15.117:3300/0 conn(0x7f1c300b03f0 0x7f1c30069b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:56.802 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.795+0000 7f1c354cc640 1 -- 172.21.15.53:0/427590685 >> v1:172.21.15.53:6789/0 conn(0x7f1c300affc0 legacy=0x7f1c30069450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:56.802 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.795+0000 7f1c354cc640 1 -- 172.21.15.53:0/427590685 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c300cc3f0 con 0x7f1c3015b870 2023-06-10T19:08:56.803 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.795+0000 7f1c27fff640 1 -- 172.21.15.53:0/427590685 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2982788286 0 0) 0x7f1c20001120 con 0x7f1c300affc0 2023-06-10T19:08:56.804 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.799+0000 7f1c354cc640 1 --2- 172.21.15.53:0/427590685 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c3015b870 0x7f1c3006a930 secure :-1 s=READY pgs=2682 cs=0 l=1 rev1=1 crypto rx=0x7f1c3006f850 tx=0x7f1c2c01c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79f4af2b7660b11 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:56.804 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.799+0000 7f1c27fff640 1 -- 172.21.15.53:0/427590685 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c2c0ab600 con 0x7f1c3015b870 2023-06-10T19:08:56.804 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.799+0000 7f1c27fff640 1 -- 172.21.15.53:0/427590685 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c2c0a7050 con 0x7f1c3015b870 2023-06-10T19:08:56.804 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.799+0000 7f1c27fff640 1 -- 172.21.15.53:0/427590685 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c2c0ab980 con 0x7f1c3015b870 2023-06-10T19:08:56.805 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.799+0000 7f1c37730640 1 -- 172.21.15.53:0/427590685 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c3015b870 msgr2=0x7f1c3006a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:56.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.799+0000 7f1c37730640 1 --2- 172.21.15.53:0/427590685 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c3015b870 0x7f1c3006a930 secure :-1 s=READY pgs=2682 cs=0 l=1 rev1=1 crypto rx=0x7f1c3006f850 tx=0x7f1c2c01c3a0 comp rx=0 tx=0).stop 2023-06-10T19:08:56.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.799+0000 7f1c37730640 1 -- 172.21.15.53:0/427590685 shutdown_connections 2023-06-10T19:08:56.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.799+0000 7f1c37730640 1 --2- 172.21.15.53:0/427590685 >> v2:172.21.15.117:3300/0 conn(0x7f1c300b03f0 0x7f1c30069b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:56.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.799+0000 7f1c37730640 1 --2- 172.21.15.53:0/427590685 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c3015b870 0x7f1c3006a930 unknown :-1 s=CLOSED pgs=2682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:56.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.799+0000 7f1c37730640 1 -- 172.21.15.53:0/427590685 >> 172.21.15.53:0/427590685 conn(0x7f1c300cafc0 msgr2=0x7f1c300cb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:56.806 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.799+0000 7f1c37730640 1 -- 172.21.15.53:0/427590685 shutdown_connections 2023-06-10T19:08:56.807 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.799+0000 7f1c37730640 1 -- 172.21.15.53:0/427590685 wait complete. 2023-06-10T19:08:56.808 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.799+0000 7f1c37730640 1 Processor -- start 2023-06-10T19:08:56.809 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.799+0000 7f1c37730640 1 -- start start 2023-06-10T19:08:56.809 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.803+0000 7f1c37730640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c300affc0 0x7f1c3015d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:56.809 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.803+0000 7f1c37730640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c300b03f0 0x7f1c30150560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:56.809 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.803+0000 7f1c37730640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c3015b870 0x7f1c30150aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:56.809 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.803+0000 7f1c37730640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c300c5490 con 0x7f1c300b03f0 2023-06-10T19:08:56.809 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.803+0000 7f1c37730640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3015ce20 con 0x7f1c3015b870 2023-06-10T19:08:56.809 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.803+0000 7f1c37730640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c300c8240 con 0x7f1c300affc0 2023-06-10T19:08:56.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.803+0000 7f1c34ccb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c300b03f0 0x7f1c30150560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:56.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.803+0000 7f1c34ccb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c300b03f0 0x7f1c30150560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42174/0 (socket says 172.21.15.53:42174) 2023-06-10T19:08:56.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.803+0000 7f1c34ccb640 1 -- 172.21.15.53:0/1564539450 learned_addr learned my addr 172.21.15.53:0/1564539450 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:08:56.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.803+0000 7f1c35ccd640 1 --2- 172.21.15.53:0/1564539450 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c3015b870 0x7f1c30150aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:56.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.803+0000 7f1c354cc640 1 --2- 172.21.15.53:0/1564539450 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c300affc0 0x7f1c3015d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:56.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.803+0000 7f1c34ccb640 1 -- 172.21.15.53:0/1564539450 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c300affc0 msgr2=0x7f1c3015d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:56.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.803+0000 7f1c34ccb640 1 --2- 172.21.15.53:0/1564539450 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c300affc0 0x7f1c3015d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:56.810 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.803+0000 7f1c34ccb640 1 -- 172.21.15.53:0/1564539450 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c3015b870 msgr2=0x7f1c30150aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:56.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.803+0000 7f1c34ccb640 1 --2- 172.21.15.53:0/1564539450 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c3015b870 0x7f1c30150aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:56.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.803+0000 7f1c34ccb640 1 -- 172.21.15.53:0/1564539450 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c2c009420 con 0x7f1c300b03f0 2023-06-10T19:08:56.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.803+0000 7f1c354cc640 1 --2- 172.21.15.53:0/1564539450 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c300affc0 0x7f1c3015d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:08:56.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.803+0000 7f1c34ccb640 1 --2- 172.21.15.53:0/1564539450 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c300b03f0 0x7f1c30150560 secure :-1 s=READY pgs=2683 cs=0 l=1 rev1=1 crypto rx=0x7f1c2000c480 tx=0x7f1c2000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:56.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.803+0000 7f1c25ffb640 1 -- 172.21.15.53:0/1564539450 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c200074e0 con 0x7f1c300b03f0 2023-06-10T19:08:56.811 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.803+0000 7f1c25ffb640 1 -- 172.21.15.53:0/1564539450 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c20007660 con 0x7f1c300b03f0 2023-06-10T19:08:56.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.803+0000 7f1c25ffb640 1 -- 172.21.15.53:0/1564539450 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c20004a30 con 0x7f1c300b03f0 2023-06-10T19:08:56.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.803+0000 7f1c37730640 1 -- 172.21.15.53:0/1564539450 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c3015c7d0 con 0x7f1c300b03f0 2023-06-10T19:08:56.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.803+0000 7f1c37730640 1 -- 172.21.15.53:0/1564539450 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c3015d7f0 con 0x7f1c300b03f0 2023-06-10T19:08:56.812 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.803+0000 7f1c37730640 1 -- 172.21.15.53:0/1564539450 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c3015cf90 con 0x7f1c300b03f0 2023-06-10T19:08:56.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.803+0000 7f1c25ffb640 1 -- 172.21.15.53:0/1564539450 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1c20004b90 con 0x7f1c300b03f0 2023-06-10T19:08:56.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.803+0000 7f1c25ffb640 1 --2- 172.21.15.53:0/1564539450 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1c140662b0 0x7f1c14068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:56.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.803+0000 7f1c25ffb640 1 -- 172.21.15.53:0/1564539450 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6192+0+0 (secure 0 0 0) 0x7f1c20082d80 con 0x7f1c300b03f0 2023-06-10T19:08:56.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.803+0000 7f1c354cc640 1 --2- 172.21.15.53:0/1564539450 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1c140662b0 0x7f1c14068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:56.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.807+0000 7f1c354cc640 1 --2- 172.21.15.53:0/1564539450 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1c140662b0 0x7f1c14068760 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c0ad000 tx=0x7f1c2c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:56.814 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.807+0000 7f1c25ffb640 1 -- 172.21.15.53:0/1564539450 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1c20050190 con 0x7f1c300b03f0 2023-06-10T19:08:56.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.963+0000 7f1c37730640 1 -- 172.21.15.53:0/1564539450 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1c3006ae70 con 0x7f1c300b03f0 2023-06-10T19:08:56.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.963+0000 7f1c25ffb640 1 -- 172.21.15.53:0/1564539450 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v183) v1 ==== 74+0+18487 (secure 0 0 0) 0x7f1c3006ae70 con 0x7f1c300b03f0 2023-06-10T19:08:56.971 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:08:56.972 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":183,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:08:34.235084+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2023-06-10T19:08:01.296938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"179","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_data","create_time":"2023-06-10T19:08:02.507633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"180","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"26.2a","mappings":[{"from":1,"to":0}]},{"pgid":"26.37","mappings":[{"from":1,"to":0}]},{"pgid":"26.3a","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.0.1:0/3824904337":"2023-06-10T20:08:33.687127+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:08:56.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.967+0000 7f1c37730640 1 -- 172.21.15.53:0/1564539450 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1c140662b0 msgr2=0x7f1c14068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:56.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.967+0000 7f1c37730640 1 --2- 172.21.15.53:0/1564539450 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1c140662b0 0x7f1c14068760 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c0ad000 tx=0x7f1c2c008040 comp rx=0 tx=0).stop 2023-06-10T19:08:56.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.967+0000 7f1c37730640 1 -- 172.21.15.53:0/1564539450 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c300b03f0 msgr2=0x7f1c30150560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:56.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.967+0000 7f1c37730640 1 --2- 172.21.15.53:0/1564539450 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c300b03f0 0x7f1c30150560 secure :-1 s=READY pgs=2683 cs=0 l=1 rev1=1 crypto rx=0x7f1c2000c480 tx=0x7f1c2000c940 comp rx=0 tx=0).stop 2023-06-10T19:08:56.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.971+0000 7f1c37730640 1 -- 172.21.15.53:0/1564539450 shutdown_connections 2023-06-10T19:08:56.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.971+0000 7f1c37730640 1 --2- 172.21.15.53:0/1564539450 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1c140662b0 0x7f1c14068760 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:56.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.971+0000 7f1c37730640 1 --2- 172.21.15.53:0/1564539450 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c3015b870 0x7f1c30150aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:56.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.971+0000 7f1c37730640 1 --2- 172.21.15.53:0/1564539450 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c300b03f0 0x7f1c30150560 unknown :-1 s=CLOSED pgs=2683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:56.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.971+0000 7f1c37730640 1 --2- 172.21.15.53:0/1564539450 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c300affc0 0x7f1c3015d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:56.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.971+0000 7f1c37730640 1 -- 172.21.15.53:0/1564539450 >> 172.21.15.53:0/1564539450 conn(0x7f1c300cafc0 msgr2=0x7f1c30153b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:56.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.971+0000 7f1c37730640 1 -- 172.21.15.53:0/1564539450 shutdown_connections 2023-06-10T19:08:56.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:56.971+0000 7f1c37730640 1 -- 172.21.15.53:0/1564539450 wait complete. 2023-06-10T19:08:56.992 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-10T18:52:33.633114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-10T18:52:39.171487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 25, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-10T19:08:01.296938+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '179', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 26, 'pool_name': 'cephfs_data', 'create_time': '2023-06-10T19:08:02.507633+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '180', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-10T19:08:56.993 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-10T19:08:57.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.115+0000 7faba963e640 1 Processor -- start 2023-06-10T19:08:57.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.115+0000 7faba963e640 1 -- start start 2023-06-10T19:08:57.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.115+0000 7faba963e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faba40c9fa0 0x7faba406bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:57.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.115+0000 7faba963e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7faba40af760 0x7faba40afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:57.120 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.115+0000 7faba963e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faba406b090 con 0x7faba406c020 2023-06-10T19:08:57.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.115+0000 7faba963e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faba40b0120 con 0x7faba40af760 2023-06-10T19:08:57.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.115+0000 7faba963e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faba40ca370 con 0x7faba40c9fa0 2023-06-10T19:08:57.121 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.115+0000 7faba37fe640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7faba40af760 0x7faba40afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:57.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.115+0000 7faba2ffd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faba40c9fa0 0x7faba406bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:57.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.115+0000 7faba27fc640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7faba406c020 0x7faba40c82a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.53:39320/0 (socket says 172.21.15.53:39320) 2023-06-10T19:08:57.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.115+0000 7faba27fc640 1 -- 172.21.15.53:0/1041315499 learned_addr learned my addr 172.21.15.53:0/1041315499 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:08:57.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.115+0000 7faba2ffd640 1 -- 172.21.15.53:0/1041315499 >> v2:172.21.15.117:3300/0 conn(0x7faba40af760 msgr2=0x7faba40afbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:57.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.115+0000 7faba2ffd640 1 --2- 172.21.15.53:0/1041315499 >> v2:172.21.15.117:3300/0 conn(0x7faba40af760 0x7faba40afbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:57.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.115+0000 7faba2ffd640 1 -- 172.21.15.53:0/1041315499 >> v1:172.21.15.117:6789/0 conn(0x7faba406c020 legacy=0x7faba40c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:57.122 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.115+0000 7faba2ffd640 1 -- 172.21.15.53:0/1041315499 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faba4070d50 con 0x7faba40c9fa0 2023-06-10T19:08:57.123 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.119+0000 7faba2ffd640 1 --2- 172.21.15.53:0/1041315499 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faba40c9fa0 0x7faba406bae0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fab9c009d90 tx=0x7fab9c01c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a8e0f10dec877fe server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:57.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.119+0000 7faba1ffb640 1 -- 172.21.15.53:0/1041315499 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab9c0a5860 con 0x7faba40c9fa0 2023-06-10T19:08:57.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.119+0000 7faba1ffb640 1 -- 172.21.15.53:0/1041315499 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab9c0a59c0 con 0x7faba40c9fa0 2023-06-10T19:08:57.124 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.119+0000 7faba1ffb640 1 -- 172.21.15.53:0/1041315499 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab9c0a5d50 con 0x7faba40c9fa0 2023-06-10T19:08:57.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.119+0000 7faba963e640 1 -- 172.21.15.53:0/1041315499 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faba40c9fa0 msgr2=0x7faba406bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:57.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.119+0000 7faba963e640 1 --2- 172.21.15.53:0/1041315499 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faba40c9fa0 0x7faba406bae0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fab9c009d90 tx=0x7fab9c01c890 comp rx=0 tx=0).stop 2023-06-10T19:08:57.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.119+0000 7faba963e640 1 -- 172.21.15.53:0/1041315499 shutdown_connections 2023-06-10T19:08:57.125 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.119+0000 7faba963e640 1 --2- 172.21.15.53:0/1041315499 >> v2:172.21.15.117:3300/0 conn(0x7faba40af760 0x7faba40afbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:57.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.119+0000 7faba963e640 1 --2- 172.21.15.53:0/1041315499 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faba40c9fa0 0x7faba406bae0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:57.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.119+0000 7faba963e640 1 -- 172.21.15.53:0/1041315499 >> 172.21.15.53:0/1041315499 conn(0x7faba406a0e0 msgr2=0x7faba40cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:57.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.119+0000 7faba963e640 1 -- 172.21.15.53:0/1041315499 shutdown_connections 2023-06-10T19:08:57.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.119+0000 7faba963e640 1 -- 172.21.15.53:0/1041315499 wait complete. 2023-06-10T19:08:57.126 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.119+0000 7faba963e640 1 Processor -- start 2023-06-10T19:08:57.127 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.123+0000 7faba963e640 1 -- start start 2023-06-10T19:08:57.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.123+0000 7faba963e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faba406c020 0x7faba415c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:57.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.123+0000 7faba963e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faba40af760 0x7faba4157880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:57.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.123+0000 7faba963e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faba40c9fa0 0x7faba4156a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:57.128 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.123+0000 7faba963e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba415b190 con 0x7faba406c020 2023-06-10T19:08:57.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.123+0000 7faba963e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba415b5b0 con 0x7faba40c9fa0 2023-06-10T19:08:57.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.123+0000 7faba963e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faba415bdf0 con 0x7faba40af760 2023-06-10T19:08:57.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.123+0000 7faba2ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faba406c020 0x7faba415c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:57.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.123+0000 7faba2ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faba406c020 0x7faba415c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42186/0 (socket says 172.21.15.53:42186) 2023-06-10T19:08:57.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.123+0000 7faba2ffd640 1 -- 172.21.15.53:0/1229485036 learned_addr learned my addr 172.21.15.53:0/1229485036 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:08:57.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.123+0000 7faba27fc640 1 --2- 172.21.15.53:0/1229485036 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faba40af760 0x7faba4157880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:57.129 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.123+0000 7faba37fe640 1 --2- 172.21.15.53:0/1229485036 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faba40c9fa0 0x7faba4156a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:57.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.123+0000 7faba2ffd640 1 -- 172.21.15.53:0/1229485036 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faba40af760 msgr2=0x7faba4157880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:57.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.123+0000 7faba2ffd640 1 --2- 172.21.15.53:0/1229485036 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faba40af760 0x7faba4157880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:57.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.123+0000 7faba2ffd640 1 -- 172.21.15.53:0/1229485036 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faba40c9fa0 msgr2=0x7faba4156a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:57.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.123+0000 7faba2ffd640 1 --2- 172.21.15.53:0/1229485036 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faba40c9fa0 0x7faba4156a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:57.130 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.123+0000 7faba2ffd640 1 -- 172.21.15.53:0/1229485036 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab9c009a70 con 0x7faba406c020 2023-06-10T19:08:57.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.123+0000 7faba2ffd640 1 --2- 172.21.15.53:0/1229485036 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faba406c020 0x7faba415c8a0 secure :-1 s=READY pgs=2684 cs=0 l=1 rev1=1 crypto rx=0x7fab9c0b0040 tx=0x7fab9c019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:57.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.123+0000 7fab8b7fe640 1 -- 172.21.15.53:0/1229485036 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab9c0a5860 con 0x7faba406c020 2023-06-10T19:08:57.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.123+0000 7fab8b7fe640 1 -- 172.21.15.53:0/1229485036 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab9c0ad850 con 0x7faba406c020 2023-06-10T19:08:57.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.123+0000 7faba963e640 1 -- 172.21.15.53:0/1229485036 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faba415aad0 con 0x7faba406c020 2023-06-10T19:08:57.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.123+0000 7fab8b7fe640 1 -- 172.21.15.53:0/1229485036 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab9c0adc00 con 0x7faba406c020 2023-06-10T19:08:57.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.123+0000 7faba963e640 1 -- 172.21.15.53:0/1229485036 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faba415c0d0 con 0x7faba406c020 2023-06-10T19:08:57.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.123+0000 7faba963e640 1 -- 172.21.15.53:0/1229485036 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faba404d790 con 0x7faba406c020 2023-06-10T19:08:57.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.123+0000 7fab8b7fe640 1 -- 172.21.15.53:0/1229485036 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fab9c0b4050 con 0x7faba406c020 2023-06-10T19:08:57.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.127+0000 7fab8b7fe640 1 --2- 172.21.15.53:0/1229485036 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fab90066280 0x7fab90068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:57.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.127+0000 7fab8b7fe640 1 -- 172.21.15.53:0/1229485036 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6192+0+0 (secure 0 0 0) 0x7fab9c11eff0 con 0x7faba406c020 2023-06-10T19:08:57.133 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.127+0000 7faba27fc640 1 --2- 172.21.15.53:0/1229485036 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fab90066280 0x7fab90068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:57.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.127+0000 7faba27fc640 1 --2- 172.21.15.53:0/1229485036 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fab90066280 0x7fab90068730 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7faba40c48a0 tx=0x7fab98009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:57.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.131+0000 7fab8b7fe640 1 -- 172.21.15.53:0/1229485036 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fab9c14f700 con 0x7faba406c020 2023-06-10T19:08:57.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.279+0000 7faba963e640 1 -- 172.21.15.53:0/1229485036 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7faba40ce670 con 0x7faba406c020 2023-06-10T19:08:57.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.283+0000 7fab8b7fe640 1 -- 172.21.15.53:0/1229485036 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v183) v1 ==== 93+0+10 (secure 0 0 0) 0x7fab9c0c70a0 con 0x7faba406c020 2023-06-10T19:08:57.288 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-06-10T19:08:57.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.283+0000 7faba963e640 1 -- 172.21.15.53:0/1229485036 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fab90066280 msgr2=0x7fab90068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:57.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.283+0000 7faba963e640 1 --2- 172.21.15.53:0/1229485036 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fab90066280 0x7fab90068730 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7faba40c48a0 tx=0x7fab98009040 comp rx=0 tx=0).stop 2023-06-10T19:08:57.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.283+0000 7faba963e640 1 -- 172.21.15.53:0/1229485036 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faba406c020 msgr2=0x7faba415c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:57.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.283+0000 7faba963e640 1 --2- 172.21.15.53:0/1229485036 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faba406c020 0x7faba415c8a0 secure :-1 s=READY pgs=2684 cs=0 l=1 rev1=1 crypto rx=0x7fab9c0b0040 tx=0x7fab9c019630 comp rx=0 tx=0).stop 2023-06-10T19:08:57.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.283+0000 7faba963e640 1 -- 172.21.15.53:0/1229485036 shutdown_connections 2023-06-10T19:08:57.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.283+0000 7faba963e640 1 --2- 172.21.15.53:0/1229485036 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fab90066280 0x7fab90068730 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:57.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.283+0000 7faba963e640 1 --2- 172.21.15.53:0/1229485036 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faba40c9fa0 0x7faba4156a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:57.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.283+0000 7faba963e640 1 --2- 172.21.15.53:0/1229485036 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faba40af760 0x7faba4157880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:57.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.283+0000 7faba963e640 1 --2- 172.21.15.53:0/1229485036 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faba406c020 0x7faba415c8a0 unknown :-1 s=CLOSED pgs=2684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:57.292 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.283+0000 7faba963e640 1 -- 172.21.15.53:0/1229485036 >> 172.21.15.53:0/1229485036 conn(0x7faba406a0e0 msgr2=0x7faba40b32e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:57.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.283+0000 7faba963e640 1 -- 172.21.15.53:0/1229485036 shutdown_connections 2023-06-10T19:08:57.293 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.283+0000 7faba963e640 1 -- 172.21.15.53:0/1229485036 wait complete. 2023-06-10T19:08:57.305 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-10T19:08:57.419 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.415+0000 7f7599ec4640 1 Processor -- start 2023-06-10T19:08:57.420 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.415+0000 7f7599ec4640 1 -- start start 2023-06-10T19:08:57.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.415+0000 7f7599ec4640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f75940b0f30 0x7f7594070950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:57.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.415+0000 7f7599ec4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7594159a60 0x7f75940c2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:57.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.415+0000 7f7599ec4640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75940cb080 con 0x7f7594159690 2023-06-10T19:08:57.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.415+0000 7f7599ec4640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7594070e90 con 0x7f75940b0f30 2023-06-10T19:08:57.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.415+0000 7f7599ec4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f759406d450 con 0x7f7594159a60 2023-06-10T19:08:57.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.415+0000 7f7592ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f75940b0f30 0x7f7594070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:57.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.415+0000 7f75937fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f7594159690 0x7f75940cbe00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56788/0 (socket says 172.21.15.53:56788) 2023-06-10T19:08:57.422 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.415+0000 7f75937fe640 1 -- 172.21.15.53:0/2051643118 learned_addr learned my addr 172.21.15.53:0/2051643118 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:08:57.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.415+0000 7f7592ffd640 1 -- 172.21.15.53:0/2051643118 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7594159a60 msgr2=0x7f75940c2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:57.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.415+0000 7f7593fff640 1 --2- 172.21.15.53:0/2051643118 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7594159a60 0x7f75940c2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:57.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.415+0000 7f7592ffd640 1 --2- 172.21.15.53:0/2051643118 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7594159a60 0x7f75940c2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:57.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.415+0000 7f75927fc640 1 -- 172.21.15.53:0/2051643118 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3590089489 0 0) 0x7f75940cb080 con 0x7f7594159690 2023-06-10T19:08:57.423 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.415+0000 7f7592ffd640 1 -- 172.21.15.53:0/2051643118 >> v1:172.21.15.53:6789/0 conn(0x7f7594159690 legacy=0x7f75940cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:57.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.415+0000 7f7592ffd640 1 -- 172.21.15.53:0/2051643118 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75940cb320 con 0x7f75940b0f30 2023-06-10T19:08:57.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.415+0000 7f7593fff640 1 --2- 172.21.15.53:0/2051643118 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7594159a60 0x7f75940c2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:08:57.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.419+0000 7f7592ffd640 1 --2- 172.21.15.53:0/2051643118 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f75940b0f30 0x7f7594070950 secure :-1 s=READY pgs=2686 cs=0 l=1 rev1=1 crypto rx=0x7f757c0097c0 tx=0x7f757c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb947063ce6ec892 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:57.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.419+0000 7f75927fc640 1 -- 172.21.15.53:0/2051643118 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757c0ad660 con 0x7f75940b0f30 2023-06-10T19:08:57.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.419+0000 7f75927fc640 1 -- 172.21.15.53:0/2051643118 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f757c0ad7c0 con 0x7f75940b0f30 2023-06-10T19:08:57.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.419+0000 7f75927fc640 1 -- 172.21.15.53:0/2051643118 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757c0adb50 con 0x7f75940b0f30 2023-06-10T19:08:57.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.419+0000 7f7599ec4640 1 -- 172.21.15.53:0/2051643118 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f75940b0f30 msgr2=0x7f7594070950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:57.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.419+0000 7f7599ec4640 1 --2- 172.21.15.53:0/2051643118 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f75940b0f30 0x7f7594070950 secure :-1 s=READY pgs=2686 cs=0 l=1 rev1=1 crypto rx=0x7f757c0097c0 tx=0x7f757c01c450 comp rx=0 tx=0).stop 2023-06-10T19:08:57.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.419+0000 7f7599ec4640 1 -- 172.21.15.53:0/2051643118 shutdown_connections 2023-06-10T19:08:57.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.419+0000 7f7599ec4640 1 --2- 172.21.15.53:0/2051643118 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f75940b0f30 0x7f7594070950 unknown :-1 s=CLOSED pgs=2686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:57.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.419+0000 7f7599ec4640 1 --2- 172.21.15.53:0/2051643118 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7594159a60 0x7f75940c2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:57.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.419+0000 7f7599ec4640 1 -- 172.21.15.53:0/2051643118 >> 172.21.15.53:0/2051643118 conn(0x7f759406a560 msgr2=0x7f759406a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:57.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.419+0000 7f7599ec4640 1 -- 172.21.15.53:0/2051643118 shutdown_connections 2023-06-10T19:08:57.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.419+0000 7f7599ec4640 1 -- 172.21.15.53:0/2051643118 wait complete. 2023-06-10T19:08:57.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.419+0000 7f7599ec4640 1 Processor -- start 2023-06-10T19:08:57.427 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.419+0000 7f7599ec4640 1 -- start start 2023-06-10T19:08:57.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.419+0000 7f7599ec4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75940b0f30 0x7f7594154fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:57.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.419+0000 7f7599ec4640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7594159690 0x7f7594152cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:57.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.419+0000 7f7599ec4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7594159a60 0x7f759414d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:57.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.419+0000 7f7599ec4640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7594159f90 con 0x7f7594159a60 2023-06-10T19:08:57.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.419+0000 7f7599ec4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75941555f0 con 0x7f75940b0f30 2023-06-10T19:08:57.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.419+0000 7f7599ec4640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75941558d0 con 0x7f7594159690 2023-06-10T19:08:57.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.419+0000 7f7593fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7594159a60 0x7f759414d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:57.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.419+0000 7f7593fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7594159a60 0x7f759414d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42202/0 (socket says 172.21.15.53:42202) 2023-06-10T19:08:57.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.419+0000 7f7593fff640 1 -- 172.21.15.53:0/4115384671 learned_addr learned my addr 172.21.15.53:0/4115384671 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:08:57.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.419+0000 7f7592ffd640 1 --2- 172.21.15.53:0/4115384671 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7594159690 0x7f7594152cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:57.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.419+0000 7f75937fe640 1 --2- 172.21.15.53:0/4115384671 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75940b0f30 0x7f7594154fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:57.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.419+0000 7f7593fff640 1 -- 172.21.15.53:0/4115384671 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7594159690 msgr2=0x7f7594152cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:57.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.419+0000 7f7593fff640 1 --2- 172.21.15.53:0/4115384671 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7594159690 0x7f7594152cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:57.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.419+0000 7f7593fff640 1 -- 172.21.15.53:0/4115384671 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75940b0f30 msgr2=0x7f7594154fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:57.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.419+0000 7f7593fff640 1 --2- 172.21.15.53:0/4115384671 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75940b0f30 0x7f7594154fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:57.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.419+0000 7f7593fff640 1 -- 172.21.15.53:0/4115384671 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f757c009420 con 0x7f7594159a60 2023-06-10T19:08:57.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.423+0000 7f7593fff640 1 --2- 172.21.15.53:0/4115384671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7594159a60 0x7f759414d220 secure :-1 s=READY pgs=2687 cs=0 l=1 rev1=1 crypto rx=0x7f758c00c7f0 tx=0x7f758c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:57.431 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.423+0000 7f758bfff640 1 -- 172.21.15.53:0/4115384671 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758c004230 con 0x7f7594159a60 2023-06-10T19:08:57.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.423+0000 7f758bfff640 1 -- 172.21.15.53:0/4115384671 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f758c0043b0 con 0x7f7594159a60 2023-06-10T19:08:57.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.423+0000 7f7599ec4640 1 -- 172.21.15.53:0/4115384671 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7594155bb0 con 0x7f7594159a60 2023-06-10T19:08:57.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.423+0000 7f758bfff640 1 -- 172.21.15.53:0/4115384671 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758c003860 con 0x7f7594159a60 2023-06-10T19:08:57.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.423+0000 7f7599ec4640 1 -- 172.21.15.53:0/4115384671 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7594155e90 con 0x7f7594159a60 2023-06-10T19:08:57.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.423+0000 7f7599ec4640 1 -- 172.21.15.53:0/4115384671 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f759415a160 con 0x7f7594159a60 2023-06-10T19:08:57.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.423+0000 7f758bfff640 1 -- 172.21.15.53:0/4115384671 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f758c003bd0 con 0x7f7594159a60 2023-06-10T19:08:57.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.423+0000 7f758bfff640 1 --2- 172.21.15.53:0/4115384671 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7574066280 0x7f7574068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:57.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.423+0000 7f758bfff640 1 -- 172.21.15.53:0/4115384671 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6192+0+0 (secure 0 0 0) 0x7f758c084250 con 0x7f7594159a60 2023-06-10T19:08:57.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.423+0000 7f75937fe640 1 --2- 172.21.15.53:0/4115384671 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7574066280 0x7f7574068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:57.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.423+0000 7f75937fe640 1 --2- 172.21.15.53:0/4115384671 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7574066280 0x7f7574068730 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f75840012f0 tx=0x7f7584009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:57.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.427+0000 7f758bfff640 1 -- 172.21.15.53:0/4115384671 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f759415a160 con 0x7f7594159a60 2023-06-10T19:08:57.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.579+0000 7f7599ec4640 1 -- 172.21.15.53:0/4115384671 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f759404d790 con 0x7f7594159a60 2023-06-10T19:08:57.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.579+0000 7f758bfff640 1 -- 172.21.15.53:0/4115384671 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v183) v1 ==== 92+0+10 (secure 0 0 0) 0x7f758c0516e0 con 0x7f7594159a60 2023-06-10T19:08:57.586 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-06-10T19:08:57.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.583+0000 7f7599ec4640 1 -- 172.21.15.53:0/4115384671 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7574066280 msgr2=0x7f7574068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:57.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.583+0000 7f7599ec4640 1 --2- 172.21.15.53:0/4115384671 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7574066280 0x7f7574068730 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f75840012f0 tx=0x7f7584009040 comp rx=0 tx=0).stop 2023-06-10T19:08:57.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.583+0000 7f7599ec4640 1 -- 172.21.15.53:0/4115384671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7594159a60 msgr2=0x7f759414d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:57.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.583+0000 7f7599ec4640 1 --2- 172.21.15.53:0/4115384671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7594159a60 0x7f759414d220 secure :-1 s=READY pgs=2687 cs=0 l=1 rev1=1 crypto rx=0x7f758c00c7f0 tx=0x7f758c00ccb0 comp rx=0 tx=0).stop 2023-06-10T19:08:57.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.583+0000 7f7599ec4640 1 -- 172.21.15.53:0/4115384671 shutdown_connections 2023-06-10T19:08:57.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.583+0000 7f7599ec4640 1 --2- 172.21.15.53:0/4115384671 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7574066280 0x7f7574068730 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:57.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.583+0000 7f7599ec4640 1 --2- 172.21.15.53:0/4115384671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7594159a60 0x7f759414d220 unknown :-1 s=CLOSED pgs=2687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:57.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.583+0000 7f7599ec4640 1 --2- 172.21.15.53:0/4115384671 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7594159690 0x7f7594152cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:57.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.583+0000 7f7599ec4640 1 --2- 172.21.15.53:0/4115384671 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75940b0f30 0x7f7594154fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:57.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.583+0000 7f7599ec4640 1 -- 172.21.15.53:0/4115384671 >> 172.21.15.53:0/4115384671 conn(0x7f759406a560 msgr2=0x7f759406a930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:57.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.583+0000 7f7599ec4640 1 -- 172.21.15.53:0/4115384671 shutdown_connections 2023-06-10T19:08:57.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.583+0000 7f7599ec4640 1 -- 172.21.15.53:0/4115384671 wait complete. 2023-06-10T19:08:57.604 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-10T19:08:57.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.715+0000 7f64262ba640 1 Processor -- start 2023-06-10T19:08:57.721 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.715+0000 7f64262ba640 1 -- start start 2023-06-10T19:08:57.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.715+0000 7f64262ba640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6420159690 0x7f6420070950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:57.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.715+0000 7f64262ba640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64200cb080 con 0x7f6420159a60 2023-06-10T19:08:57.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.715+0000 7f64262ba640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64200cb320 con 0x7f64200b0f30 2023-06-10T19:08:57.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.715+0000 7f64262ba640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6420070e90 con 0x7f6420159690 2023-06-10T19:08:57.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.715+0000 7f641ffff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6420159690 0x7f6420070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:57.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.715+0000 7f6424857640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f6420159a60 0x7f64200c2900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56796/0 (socket says 172.21.15.53:56796) 2023-06-10T19:08:57.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.715+0000 7f6424857640 1 -- 172.21.15.53:0/3800430830 learned_addr learned my addr 172.21.15.53:0/3800430830 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:08:57.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.715+0000 7f641ffff640 1 -- 172.21.15.53:0/3800430830 >> v1:172.21.15.117:6789/0 conn(0x7f64200b0f30 legacy=0x7f64200cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:57.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.715+0000 7f641ffff640 1 -- 172.21.15.53:0/3800430830 >> v1:172.21.15.53:6789/0 conn(0x7f6420159a60 legacy=0x7f64200c2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:57.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.715+0000 7f641effd640 1 -- 172.21.15.53:0/3800430830 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2007746892 0 0) 0x7f64200cb080 con 0x7f6420159a60 2023-06-10T19:08:57.724 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.715+0000 7f641ffff640 1 -- 172.21.15.53:0/3800430830 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64200cb600 con 0x7f6420159690 2023-06-10T19:08:57.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.719+0000 7f641ffff640 1 --2- 172.21.15.53:0/3800430830 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6420159690 0x7f6420070950 secure :-1 s=READY pgs=2689 cs=0 l=1 rev1=1 crypto rx=0x7f6410009d90 tx=0x7f641001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bacd4b2b0cedbd9 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:57.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.719+0000 7f641effd640 1 -- 172.21.15.53:0/3800430830 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64100a5860 con 0x7f6420159690 2023-06-10T19:08:57.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.719+0000 7f641effd640 1 -- 172.21.15.53:0/3800430830 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64100a59c0 con 0x7f6420159690 2023-06-10T19:08:57.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.719+0000 7f641effd640 1 -- 172.21.15.53:0/3800430830 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64100a5d50 con 0x7f6420159690 2023-06-10T19:08:57.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.719+0000 7f64262ba640 1 -- 172.21.15.53:0/3800430830 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6420159690 msgr2=0x7f6420070950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:57.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.719+0000 7f64262ba640 1 --2- 172.21.15.53:0/3800430830 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6420159690 0x7f6420070950 secure :-1 s=READY pgs=2689 cs=0 l=1 rev1=1 crypto rx=0x7f6410009d90 tx=0x7f641001c910 comp rx=0 tx=0).stop 2023-06-10T19:08:57.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.719+0000 7f64262ba640 1 -- 172.21.15.53:0/3800430830 shutdown_connections 2023-06-10T19:08:57.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.719+0000 7f64262ba640 1 --2- 172.21.15.53:0/3800430830 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6420159690 0x7f6420070950 unknown :-1 s=CLOSED pgs=2689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:57.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.719+0000 7f64262ba640 1 -- 172.21.15.53:0/3800430830 >> 172.21.15.53:0/3800430830 conn(0x7f642006a560 msgr2=0x7f642006a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:57.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.719+0000 7f64262ba640 1 -- 172.21.15.53:0/3800430830 shutdown_connections 2023-06-10T19:08:57.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.719+0000 7f64262ba640 1 -- 172.21.15.53:0/3800430830 wait complete. 2023-06-10T19:08:57.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.723+0000 7f64262ba640 1 Processor -- start 2023-06-10T19:08:57.728 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.723+0000 7f64262ba640 1 -- start start 2023-06-10T19:08:57.731 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.723+0000 7f64262ba640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64200b0f30 0x7f64201569b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:57.732 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.723+0000 7f64262ba640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6420159690 0x7f642014fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:57.732 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.723+0000 7f64262ba640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6420159a60 0x7f64200b3790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:57.732 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.723+0000 7f64262ba640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6420156ef0 con 0x7f64200b0f30 2023-06-10T19:08:57.732 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.723+0000 7f64262ba640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64201500b0 con 0x7f6420159690 2023-06-10T19:08:57.732 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.723+0000 7f64262ba640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64201502e0 con 0x7f6420159a60 2023-06-10T19:08:57.732 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.723+0000 7f641ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64200b0f30 0x7f64201569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:57.732 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.723+0000 7f641ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64200b0f30 0x7f64201569b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42216/0 (socket says 172.21.15.53:42216) 2023-06-10T19:08:57.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.723+0000 7f641ffff640 1 -- 172.21.15.53:0/3038040212 learned_addr learned my addr 172.21.15.53:0/3038040212 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:08:57.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.723+0000 7f641f7fe640 1 --2- 172.21.15.53:0/3038040212 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6420159690 0x7f642014fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:57.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.723+0000 7f6424857640 1 --2- 172.21.15.53:0/3038040212 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6420159a60 0x7f64200b3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:57.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.723+0000 7f641ffff640 1 -- 172.21.15.53:0/3038040212 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6420159a60 msgr2=0x7f64200b3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:57.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.723+0000 7f641ffff640 1 --2- 172.21.15.53:0/3038040212 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6420159a60 0x7f64200b3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:57.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.723+0000 7f641ffff640 1 -- 172.21.15.53:0/3038040212 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6420159690 msgr2=0x7f642014fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:57.733 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.723+0000 7f641ffff640 1 --2- 172.21.15.53:0/3038040212 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6420159690 0x7f642014fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:57.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.723+0000 7f641ffff640 1 -- 172.21.15.53:0/3038040212 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6410009a70 con 0x7f64200b0f30 2023-06-10T19:08:57.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.723+0000 7f6424857640 1 --2- 172.21.15.53:0/3038040212 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6420159a60 0x7f64200b3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:08:57.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.723+0000 7f641f7fe640 1 --2- 172.21.15.53:0/3038040212 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6420159690 0x7f642014fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:08:57.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.723+0000 7f641ffff640 1 --2- 172.21.15.53:0/3038040212 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64200b0f30 0x7f64201569b0 secure :-1 s=READY pgs=2690 cs=0 l=1 rev1=1 crypto rx=0x7f6410000f90 tx=0x7f64100196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:57.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.723+0000 7f641cff9640 1 -- 172.21.15.53:0/3038040212 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6410003ba0 con 0x7f64200b0f30 2023-06-10T19:08:57.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.723+0000 7f641cff9640 1 -- 172.21.15.53:0/3038040212 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6410003d00 con 0x7f64200b0f30 2023-06-10T19:08:57.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.723+0000 7f641cff9640 1 -- 172.21.15.53:0/3038040212 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64100ad850 con 0x7f64200b0f30 2023-06-10T19:08:57.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.723+0000 7f64262ba640 1 -- 172.21.15.53:0/3038040212 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64201505c0 con 0x7f64200b0f30 2023-06-10T19:08:57.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.723+0000 7f64262ba640 1 -- 172.21.15.53:0/3038040212 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6420150b80 con 0x7f64200b0f30 2023-06-10T19:08:57.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.723+0000 7f64262ba640 1 -- 172.21.15.53:0/3038040212 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f642004d790 con 0x7f64200b0f30 2023-06-10T19:08:57.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.723+0000 7f641cff9640 1 -- 172.21.15.53:0/3038040212 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f64100ad9b0 con 0x7f64200b0f30 2023-06-10T19:08:57.735 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.727+0000 7f641cff9640 1 --2- 172.21.15.53:0/3038040212 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f640c0662b0 0x7f640c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:57.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.727+0000 7f641cff9640 1 -- 172.21.15.53:0/3038040212 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6192+0+0 (secure 0 0 0) 0x7f641011ef00 con 0x7f64200b0f30 2023-06-10T19:08:57.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.727+0000 7f641f7fe640 1 --2- 172.21.15.53:0/3038040212 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f640c0662b0 0x7f640c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:57.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.727+0000 7f641f7fe640 1 --2- 172.21.15.53:0/3038040212 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f640c0662b0 0x7f640c068760 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f64200cf920 tx=0x7f6414009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:57.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.731+0000 7f641cff9640 1 -- 172.21.15.53:0/3038040212 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f64100ec300 con 0x7f64200b0f30 2023-06-10T19:08:57.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.879+0000 7f64262ba640 1 -- 172.21.15.53:0/3038040212 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6420070bc0 con 0x7f64200b0f30 2023-06-10T19:08:57.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.879+0000 7f641cff9640 1 -- 172.21.15.53:0/3038040212 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v183) v1 ==== 104+0+11 (secure 0 0 0) 0x7f64100c50a0 con 0x7f64200b0f30 2023-06-10T19:08:57.886 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-06-10T19:08:57.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.883+0000 7f64262ba640 1 -- 172.21.15.53:0/3038040212 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f640c0662b0 msgr2=0x7f640c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:57.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.883+0000 7f64262ba640 1 --2- 172.21.15.53:0/3038040212 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f640c0662b0 0x7f640c068760 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f64200cf920 tx=0x7f6414009040 comp rx=0 tx=0).stop 2023-06-10T19:08:57.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.883+0000 7f64262ba640 1 -- 172.21.15.53:0/3038040212 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64200b0f30 msgr2=0x7f64201569b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:57.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.883+0000 7f64262ba640 1 --2- 172.21.15.53:0/3038040212 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64200b0f30 0x7f64201569b0 secure :-1 s=READY pgs=2690 cs=0 l=1 rev1=1 crypto rx=0x7f6410000f90 tx=0x7f64100196b0 comp rx=0 tx=0).stop 2023-06-10T19:08:57.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.883+0000 7f64262ba640 1 -- 172.21.15.53:0/3038040212 shutdown_connections 2023-06-10T19:08:57.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.883+0000 7f64262ba640 1 --2- 172.21.15.53:0/3038040212 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f640c0662b0 0x7f640c068760 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:57.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.883+0000 7f64262ba640 1 --2- 172.21.15.53:0/3038040212 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6420159a60 0x7f64200b3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:57.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.883+0000 7f64262ba640 1 --2- 172.21.15.53:0/3038040212 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6420159690 0x7f642014fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:57.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.883+0000 7f64262ba640 1 --2- 172.21.15.53:0/3038040212 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f64200b0f30 0x7f64201569b0 unknown :-1 s=CLOSED pgs=2690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:57.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.883+0000 7f64262ba640 1 -- 172.21.15.53:0/3038040212 >> 172.21.15.53:0/3038040212 conn(0x7f642006a560 msgr2=0x7f64200ced90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:57.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.883+0000 7f64262ba640 1 -- 172.21.15.53:0/3038040212 shutdown_connections 2023-06-10T19:08:57.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:57.883+0000 7f64262ba640 1 -- 172.21.15.53:0/3038040212 wait complete. 2023-06-10T19:08:57.906 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-10T19:08:58.031 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.023+0000 7f3e363b8640 1 Processor -- start 2023-06-10T19:08:58.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.023+0000 7f3e363b8640 1 -- start start 2023-06-10T19:08:58.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.027+0000 7f3e363b8640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3e30070de0 0x7f3e3015cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:58.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.027+0000 7f3e363b8640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3e300cc020 0x7f3e3006bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:58.032 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.027+0000 7f3e363b8640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e300c8d50 con 0x7f3e3015c060 2023-06-10T19:08:58.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.027+0000 7f3e363b8640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e300c9030 con 0x7f3e30070de0 2023-06-10T19:08:58.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.027+0000 7f3e363b8640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e30070300 con 0x7f3e300cc020 2023-06-10T19:08:58.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.027+0000 7f3e2ffff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f3e3015c060 0x7f3e3015c430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56798/0 (socket says 172.21.15.53:56798) 2023-06-10T19:08:58.033 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.027+0000 7f3e2ffff640 1 -- 172.21.15.53:0/1406253409 learned_addr learned my addr 172.21.15.53:0/1406253409 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:08:58.035 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.027+0000 7f3e34955640 1 --2- 172.21.15.53:0/1406253409 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3e300cc020 0x7f3e3006bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:58.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.027+0000 7f3e2f7fe640 1 --2- 172.21.15.53:0/1406253409 >> v2:172.21.15.117:3300/0 conn(0x7f3e30070de0 0x7f3e3015cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:58.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.027+0000 7f3e2effd640 1 -- 172.21.15.53:0/1406253409 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2620934874 0 0) 0x7f3e300c8d50 con 0x7f3e3015c060 2023-06-10T19:08:58.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.027+0000 7f3e2effd640 1 -- 172.21.15.53:0/1406253409 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e18003530 con 0x7f3e3015c060 2023-06-10T19:08:58.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.027+0000 7f3e2effd640 1 -- 172.21.15.53:0/1406253409 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4211601291 0 0) 0x7f3e18003530 con 0x7f3e3015c060 2023-06-10T19:08:58.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.027+0000 7f3e2effd640 1 -- 172.21.15.53:0/1406253409 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3e300cc020 msgr2=0x7f3e3006bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:58.036 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.027+0000 7f3e2effd640 1 --2- 172.21.15.53:0/1406253409 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3e300cc020 0x7f3e3006bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:58.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.027+0000 7f3e2effd640 1 -- 172.21.15.53:0/1406253409 >> v2:172.21.15.117:3300/0 conn(0x7f3e30070de0 msgr2=0x7f3e3015cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:58.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.027+0000 7f3e2effd640 1 --2- 172.21.15.53:0/1406253409 >> v2:172.21.15.117:3300/0 conn(0x7f3e30070de0 0x7f3e3015cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:58.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.027+0000 7f3e2effd640 1 -- 172.21.15.53:0/1406253409 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e300705e0 con 0x7f3e3015c060 2023-06-10T19:08:58.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.027+0000 7f3e2effd640 1 -- 172.21.15.53:0/1406253409 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f3e20001680 con 0x7f3e3015c060 2023-06-10T19:08:58.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.027+0000 7f3e2effd640 1 -- 172.21.15.53:0/1406253409 >> v1:172.21.15.53:6789/0 conn(0x7f3e3015c060 legacy=0x7f3e3015c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:58.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.027+0000 7f3e2effd640 1 --2- 172.21.15.53:0/1406253409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3e18003980 0x7f3e18003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:58.037 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.027+0000 7f3e2effd640 1 --2- 172.21.15.53:0/1406253409 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e180043b0 0x7f3e18004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:58.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.027+0000 7f3e2effd640 1 --2- 172.21.15.53:0/1406253409 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3e300cc020 0x7f3e18004fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:58.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.027+0000 7f3e2effd640 1 -- 172.21.15.53:0/1406253409 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e300c9030 con 0x7f3e180043b0 2023-06-10T19:08:58.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.027+0000 7f3e2effd640 1 -- 172.21.15.53:0/1406253409 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e30070300 con 0x7f3e18003980 2023-06-10T19:08:58.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.027+0000 7f3e2effd640 1 -- 172.21.15.53:0/1406253409 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1800b990 con 0x7f3e300cc020 2023-06-10T19:08:58.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.027+0000 7f3e2f7fe640 1 --2- 172.21.15.53:0/1406253409 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e180043b0 0x7f3e18004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:58.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.027+0000 7f3e34955640 1 --2- 172.21.15.53:0/1406253409 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3e300cc020 0x7f3e18004fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:58.038 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.027+0000 7f3e2ffff640 1 --2- 172.21.15.53:0/1406253409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3e18003980 0x7f3e18003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:58.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.027+0000 7f3e2f7fe640 1 -- 172.21.15.53:0/1406253409 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3e300cc020 msgr2=0x7f3e18004fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:58.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.027+0000 7f3e2f7fe640 1 --2- 172.21.15.53:0/1406253409 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3e300cc020 0x7f3e18004fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:58.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.027+0000 7f3e2f7fe640 1 -- 172.21.15.53:0/1406253409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3e18003980 msgr2=0x7f3e18003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:58.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.027+0000 7f3e2f7fe640 1 --2- 172.21.15.53:0/1406253409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3e18003980 0x7f3e18003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:58.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.027+0000 7f3e2f7fe640 1 -- 172.21.15.53:0/1406253409 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e18003530 con 0x7f3e180043b0 2023-06-10T19:08:58.039 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.027+0000 7f3e2ffff640 1 --2- 172.21.15.53:0/1406253409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3e18003980 0x7f3e18003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:08:58.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.031+0000 7f3e2f7fe640 1 --2- 172.21.15.53:0/1406253409 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e180043b0 0x7f3e18004870 secure :-1 s=READY pgs=2692 cs=0 l=1 rev1=1 crypto rx=0x7f3e2400bdb0 tx=0x7f3e2401f390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87c66b8fc867dccb server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:58.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.031+0000 7f3e2effd640 1 -- 172.21.15.53:0/1406253409 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e240ae600 con 0x7f3e180043b0 2023-06-10T19:08:58.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.031+0000 7f3e2effd640 1 -- 172.21.15.53:0/1406253409 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e240aa050 con 0x7f3e180043b0 2023-06-10T19:08:58.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.031+0000 7f3e2effd640 1 -- 172.21.15.53:0/1406253409 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e240ae9a0 con 0x7f3e180043b0 2023-06-10T19:08:58.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.031+0000 7f3e363b8640 1 -- 172.21.15.53:0/1406253409 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e180043b0 msgr2=0x7f3e18004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:58.040 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.031+0000 7f3e363b8640 1 --2- 172.21.15.53:0/1406253409 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e180043b0 0x7f3e18004870 secure :-1 s=READY pgs=2692 cs=0 l=1 rev1=1 crypto rx=0x7f3e2400bdb0 tx=0x7f3e2401f390 comp rx=0 tx=0).stop 2023-06-10T19:08:58.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.031+0000 7f3e34955640 1 -- 172.21.15.53:0/1406253409 reap_dead start 2023-06-10T19:08:58.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.031+0000 7f3e363b8640 1 -- 172.21.15.53:0/1406253409 shutdown_connections 2023-06-10T19:08:58.041 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.031+0000 7f3e363b8640 1 -- 172.21.15.53:0/1406253409 >> 172.21.15.53:0/1406253409 conn(0x7f3e3006a0e0 msgr2=0x7f3e300cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:58.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.031+0000 7f3e363b8640 1 -- 172.21.15.53:0/1406253409 shutdown_connections 2023-06-10T19:08:58.042 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.031+0000 7f3e363b8640 1 -- 172.21.15.53:0/1406253409 wait complete. 2023-06-10T19:08:58.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.031+0000 7f3e363b8640 1 Processor -- start 2023-06-10T19:08:58.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.031+0000 7f3e363b8640 1 -- start start 2023-06-10T19:08:58.044 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.031+0000 7f3e363b8640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3e180043b0 0x7f3e3006f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:58.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.031+0000 7f3e363b8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3e300ab860 0x7f3e300c0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:58.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.031+0000 7f3e363b8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e300ad0a0 0x7f3e301530c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:58.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.031+0000 7f3e363b8640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e300ac000 con 0x7f3e300ad0a0 2023-06-10T19:08:58.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.031+0000 7f3e363b8640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e300ac2e0 con 0x7f3e300ab860 2023-06-10T19:08:58.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.031+0000 7f3e363b8640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e300ac5c0 con 0x7f3e180043b0 2023-06-10T19:08:58.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.031+0000 7f3e34955640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e300ad0a0 0x7f3e301530c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:58.045 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.031+0000 7f3e34955640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e300ad0a0 0x7f3e301530c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42238/0 (socket says 172.21.15.53:42238) 2023-06-10T19:08:58.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.031+0000 7f3e34955640 1 -- 172.21.15.53:0/1469089691 learned_addr learned my addr 172.21.15.53:0/1469089691 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:08:58.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.031+0000 7f3e2ffff640 1 --2- 172.21.15.53:0/1469089691 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3e180043b0 0x7f3e3006f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:58.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.031+0000 7f3e2f7fe640 1 --2- 172.21.15.53:0/1469089691 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3e300ab860 0x7f3e300c0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:58.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.031+0000 7f3e34955640 1 -- 172.21.15.53:0/1469089691 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3e180043b0 msgr2=0x7f3e3006f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:58.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.031+0000 7f3e34955640 1 --2- 172.21.15.53:0/1469089691 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3e180043b0 0x7f3e3006f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:58.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.031+0000 7f3e34955640 1 -- 172.21.15.53:0/1469089691 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3e300ab860 msgr2=0x7f3e300c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:58.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.031+0000 7f3e34955640 1 --2- 172.21.15.53:0/1469089691 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3e300ab860 0x7f3e300c0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:58.046 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.031+0000 7f3e34955640 1 -- 172.21.15.53:0/1469089691 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e300ac8a0 con 0x7f3e300ad0a0 2023-06-10T19:08:58.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.031+0000 7f3e34955640 1 --2- 172.21.15.53:0/1469089691 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e300ad0a0 0x7f3e301530c0 secure :-1 s=READY pgs=2693 cs=0 l=1 rev1=1 crypto rx=0x7f3e3015bfc0 tx=0x7f3e28009f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:58.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.035+0000 7f3e2cff9640 1 -- 172.21.15.53:0/1469089691 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2800e070 con 0x7f3e300ad0a0 2023-06-10T19:08:58.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.035+0000 7f3e2cff9640 1 -- 172.21.15.53:0/1469089691 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e28003c70 con 0x7f3e300ad0a0 2023-06-10T19:08:58.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.035+0000 7f3e363b8640 1 -- 172.21.15.53:0/1469089691 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e300acb80 con 0x7f3e300ad0a0 2023-06-10T19:08:58.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.035+0000 7f3e2cff9640 1 -- 172.21.15.53:0/1469089691 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e28003e20 con 0x7f3e300ad0a0 2023-06-10T19:08:58.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.035+0000 7f3e363b8640 1 -- 172.21.15.53:0/1469089691 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e300c0e40 con 0x7f3e300ad0a0 2023-06-10T19:08:58.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.035+0000 7f3e363b8640 1 -- 172.21.15.53:0/1469089691 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e300acd70 con 0x7f3e300ad0a0 2023-06-10T19:08:58.047 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.035+0000 7f3e2cff9640 1 -- 172.21.15.53:0/1469089691 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3e28004030 con 0x7f3e300ad0a0 2023-06-10T19:08:58.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.035+0000 7f3e2cff9640 1 --2- 172.21.15.53:0/1469089691 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3e1c066280 0x7f3e1c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:58.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.035+0000 7f3e2cff9640 1 -- 172.21.15.53:0/1469089691 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6192+0+0 (secure 0 0 0) 0x7f3e28083bc0 con 0x7f3e300ad0a0 2023-06-10T19:08:58.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.035+0000 7f3e2ffff640 1 --2- 172.21.15.53:0/1469089691 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3e1c066280 0x7f3e1c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:58.048 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.035+0000 7f3e2ffff640 1 --2- 172.21.15.53:0/1469089691 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3e1c066280 0x7f3e1c068730 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f3e20000f70 tx=0x7f3e20009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:58.049 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.039+0000 7f3e2cff9640 1 -- 172.21.15.53:0/1469089691 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3e28050fc0 con 0x7f3e300ad0a0 2023-06-10T19:08:58.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.187+0000 7f3e363b8640 1 -- 172.21.15.53:0/1469089691 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3e3004d790 con 0x7f3e300ad0a0 2023-06-10T19:08:58.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.187+0000 7f3e2cff9640 1 -- 172.21.15.53:0/1469089691 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v183) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3e280545e0 con 0x7f3e300ad0a0 2023-06-10T19:08:58.194 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-06-10T19:08:58.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.191+0000 7f3e363b8640 1 -- 172.21.15.53:0/1469089691 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3e1c066280 msgr2=0x7f3e1c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:58.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.191+0000 7f3e363b8640 1 --2- 172.21.15.53:0/1469089691 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3e1c066280 0x7f3e1c068730 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f3e20000f70 tx=0x7f3e20009040 comp rx=0 tx=0).stop 2023-06-10T19:08:58.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.191+0000 7f3e363b8640 1 -- 172.21.15.53:0/1469089691 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e300ad0a0 msgr2=0x7f3e301530c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:58.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.191+0000 7f3e363b8640 1 --2- 172.21.15.53:0/1469089691 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e300ad0a0 0x7f3e301530c0 secure :-1 s=READY pgs=2693 cs=0 l=1 rev1=1 crypto rx=0x7f3e3015bfc0 tx=0x7f3e28009f50 comp rx=0 tx=0).stop 2023-06-10T19:08:58.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.191+0000 7f3e363b8640 1 -- 172.21.15.53:0/1469089691 shutdown_connections 2023-06-10T19:08:58.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.191+0000 7f3e363b8640 1 --2- 172.21.15.53:0/1469089691 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3e1c066280 0x7f3e1c068730 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:58.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.191+0000 7f3e363b8640 1 --2- 172.21.15.53:0/1469089691 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e300ad0a0 0x7f3e301530c0 unknown :-1 s=CLOSED pgs=2693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:58.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.191+0000 7f3e363b8640 1 --2- 172.21.15.53:0/1469089691 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3e300ab860 0x7f3e300c0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:58.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.191+0000 7f3e363b8640 1 --2- 172.21.15.53:0/1469089691 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3e180043b0 0x7f3e3006f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:58.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.191+0000 7f3e363b8640 1 -- 172.21.15.53:0/1469089691 >> 172.21.15.53:0/1469089691 conn(0x7f3e3006a0e0 msgr2=0x7f3e3014ea10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:58.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.191+0000 7f3e363b8640 1 -- 172.21.15.53:0/1469089691 shutdown_connections 2023-06-10T19:08:58.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.191+0000 7f3e363b8640 1 -- 172.21.15.53:0/1469089691 wait complete. 2023-06-10T19:08:58.211 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-10T19:08:58.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.331+0000 7f9a84c45640 1 Processor -- start 2023-06-10T19:08:58.338 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.331+0000 7f9a84c45640 1 -- start start 2023-06-10T19:08:58.342 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.335+0000 7f9a84c45640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9a800ca3a0 0x7f9a80159840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:58.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.335+0000 7f9a84c45640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a8015cb40 con 0x7f9a800723f0 2023-06-10T19:08:58.343 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.335+0000 7f9a84c45640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a8015d070 con 0x7f9a800b0d80 2023-06-10T19:08:58.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.335+0000 7f9a84c45640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a80159420 con 0x7f9a800ca3a0 2023-06-10T19:08:58.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.335+0000 7f9a7dd9b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f9a800723f0 0x7f9a800b2470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56812/0 (socket says 172.21.15.53:56812) 2023-06-10T19:08:58.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.335+0000 7f9a7dd9b640 1 -- 172.21.15.53:0/3150175011 learned_addr learned my addr 172.21.15.53:0/3150175011 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:08:58.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.335+0000 7f9a7ed9d640 1 --2- 172.21.15.53:0/3150175011 >> v2:172.21.15.117:3300/0 conn(0x7f9a800ca3a0 0x7f9a80159840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:58.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.335+0000 7f9a7d59a640 1 -- 172.21.15.53:0/3150175011 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1885396532 0 0) 0x7f9a8015cb40 con 0x7f9a800723f0 2023-06-10T19:08:58.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.335+0000 7f9a7d59a640 1 -- 172.21.15.53:0/3150175011 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a68005740 con 0x7f9a800723f0 2023-06-10T19:08:58.344 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.335+0000 7f9a7d59a640 1 -- 172.21.15.53:0/3150175011 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3091907929 0 0) 0x7f9a68005740 con 0x7f9a800723f0 2023-06-10T19:08:58.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.335+0000 7f9a7d59a640 1 -- 172.21.15.53:0/3150175011 >> v2:172.21.15.117:3300/0 conn(0x7f9a800ca3a0 msgr2=0x7f9a80159840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:58.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.335+0000 7f9a7d59a640 1 --2- 172.21.15.53:0/3150175011 >> v2:172.21.15.117:3300/0 conn(0x7f9a800ca3a0 0x7f9a80159840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:58.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.335+0000 7f9a7d59a640 1 -- 172.21.15.53:0/3150175011 >> v1:172.21.15.117:6789/0 conn(0x7f9a800b0d80 legacy=0x7f9a800c9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:58.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.335+0000 7f9a7d59a640 1 -- 172.21.15.53:0/3150175011 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a80072a10 con 0x7f9a800723f0 2023-06-10T19:08:58.345 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.335+0000 7f9a7d59a640 1 -- 172.21.15.53:0/3150175011 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f9a74001680 con 0x7f9a800723f0 2023-06-10T19:08:58.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.335+0000 7f9a7d59a640 1 -- 172.21.15.53:0/3150175011 >> v1:172.21.15.53:6789/0 conn(0x7f9a800723f0 legacy=0x7f9a800b2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:58.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.335+0000 7f9a7d59a640 1 --2- 172.21.15.53:0/3150175011 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a68005b90 0x7f9a68005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:58.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.335+0000 7f9a7d59a640 1 --2- 172.21.15.53:0/3150175011 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a680069e0 0x7f9a68006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:58.346 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.335+0000 7f9a7d59a640 1 --2- 172.21.15.53:0/3150175011 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a680074b0 0x7f9a6800dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:58.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.335+0000 7f9a7d59a640 1 -- 172.21.15.53:0/3150175011 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a80159420 con 0x7f9a680074b0 2023-06-10T19:08:58.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.335+0000 7f9a7d59a640 1 -- 172.21.15.53:0/3150175011 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6800e370 con 0x7f9a680069e0 2023-06-10T19:08:58.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.335+0000 7f9a7d59a640 1 -- 172.21.15.53:0/3150175011 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6800e530 con 0x7f9a68005b90 2023-06-10T19:08:58.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.335+0000 7f9a7ed9d640 1 --2- 172.21.15.53:0/3150175011 >> v2:172.21.15.117:3300/0 conn(0x7f9a800ca3a0 0x7f9a80159840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:08:58.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.335+0000 7f9a7ed9d640 1 --2- 172.21.15.53:0/3150175011 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a680074b0 0x7f9a6800dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:58.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.335+0000 7f9a7e59c640 1 --2- 172.21.15.53:0/3150175011 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a68005b90 0x7f9a68005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:58.347 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.335+0000 7f9a7dd9b640 1 --2- 172.21.15.53:0/3150175011 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a680069e0 0x7f9a68006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:58.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.335+0000 7f9a7ed9d640 1 -- 172.21.15.53:0/3150175011 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a68005b90 msgr2=0x7f9a68005fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:58.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.335+0000 7f9a7ed9d640 1 --2- 172.21.15.53:0/3150175011 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a68005b90 0x7f9a68005fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:58.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.335+0000 7f9a7ed9d640 1 -- 172.21.15.53:0/3150175011 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a680069e0 msgr2=0x7f9a68006e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:58.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.335+0000 7f9a7ed9d640 1 --2- 172.21.15.53:0/3150175011 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a680069e0 0x7f9a68006e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:58.348 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.335+0000 7f9a7ed9d640 1 -- 172.21.15.53:0/3150175011 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a68005740 con 0x7f9a680074b0 2023-06-10T19:08:58.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.339+0000 7f9a7ed9d640 1 -- 172.21.15.53:0/3150175011 reap_dead start 2023-06-10T19:08:58.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.339+0000 7f9a7ed9d640 1 --2- 172.21.15.53:0/3150175011 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a680074b0 0x7f9a6800dba0 secure :-1 s=READY pgs=2695 cs=0 l=1 rev1=1 crypto rx=0x7f9a780073b0 tx=0x7f9a7801cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbad823929ce30e3 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:58.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.339+0000 7f9a7d59a640 1 -- 172.21.15.53:0/3150175011 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a780a5d00 con 0x7f9a680074b0 2023-06-10T19:08:58.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.339+0000 7f9a7d59a640 1 -- 172.21.15.53:0/3150175011 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a780a5e60 con 0x7f9a680074b0 2023-06-10T19:08:58.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.339+0000 7f9a7d59a640 1 -- 172.21.15.53:0/3150175011 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a780ad660 con 0x7f9a680074b0 2023-06-10T19:08:58.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.339+0000 7f9a84c45640 1 -- 172.21.15.53:0/3150175011 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a680074b0 msgr2=0x7f9a6800dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:58.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.339+0000 7f9a84c45640 1 --2- 172.21.15.53:0/3150175011 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a680074b0 0x7f9a6800dba0 secure :-1 s=READY pgs=2695 cs=0 l=1 rev1=1 crypto rx=0x7f9a780073b0 tx=0x7f9a7801cf00 comp rx=0 tx=0).stop 2023-06-10T19:08:58.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.339+0000 7f9a84c45640 1 -- 172.21.15.53:0/3150175011 shutdown_connections 2023-06-10T19:08:58.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.339+0000 7f9a84c45640 1 --2- 172.21.15.53:0/3150175011 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a680074b0 0x7f9a6800dba0 unknown :-1 s=CLOSED pgs=2695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:58.352 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.339+0000 7f9a84c45640 1 -- 172.21.15.53:0/3150175011 >> 172.21.15.53:0/3150175011 conn(0x7f9a800caf30 msgr2=0x7f9a800cb330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:58.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.339+0000 7f9a84c45640 1 -- 172.21.15.53:0/3150175011 shutdown_connections 2023-06-10T19:08:58.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.339+0000 7f9a84c45640 1 -- 172.21.15.53:0/3150175011 wait complete. 2023-06-10T19:08:58.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.339+0000 7f9a84c45640 1 Processor -- start 2023-06-10T19:08:58.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.339+0000 7f9a84c45640 1 -- start start 2023-06-10T19:08:58.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.343+0000 7f9a84c45640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a680074b0 0x7f9a800c33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:58.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.343+0000 7f9a84c45640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a80145ed0 0x7f9a800c7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:58.353 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.343+0000 7f9a84c45640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a800c7f80 0x7f9a80070160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:58.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.343+0000 7f9a84c45640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a801f0ec0 con 0x7f9a80145ed0 2023-06-10T19:08:58.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.343+0000 7f9a84c45640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a801ec970 con 0x7f9a800c7f80 2023-06-10T19:08:58.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.343+0000 7f9a84c45640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a801f0340 con 0x7f9a680074b0 2023-06-10T19:08:58.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.343+0000 7f9a7dd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a80145ed0 0x7f9a800c7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:58.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.343+0000 7f9a7dd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a80145ed0 0x7f9a800c7a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42258/0 (socket says 172.21.15.53:42258) 2023-06-10T19:08:58.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.343+0000 7f9a7dd9b640 1 -- 172.21.15.53:0/4059992587 learned_addr learned my addr 172.21.15.53:0/4059992587 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:08:58.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.343+0000 7f9a7ed9d640 1 --2- 172.21.15.53:0/4059992587 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a800c7f80 0x7f9a80070160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:58.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.343+0000 7f9a7e59c640 1 --2- 172.21.15.53:0/4059992587 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a680074b0 0x7f9a800c33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:58.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.343+0000 7f9a7dd9b640 1 -- 172.21.15.53:0/4059992587 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a680074b0 msgr2=0x7f9a800c33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:58.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.343+0000 7f9a7dd9b640 1 --2- 172.21.15.53:0/4059992587 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a680074b0 0x7f9a800c33d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:58.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.343+0000 7f9a7dd9b640 1 -- 172.21.15.53:0/4059992587 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a800c7f80 msgr2=0x7f9a80070160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:58.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.343+0000 7f9a7dd9b640 1 --2- 172.21.15.53:0/4059992587 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a800c7f80 0x7f9a80070160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:58.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.343+0000 7f9a7dd9b640 1 -- 172.21.15.53:0/4059992587 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a801f0620 con 0x7f9a80145ed0 2023-06-10T19:08:58.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.343+0000 7f9a7ed9d640 1 --2- 172.21.15.53:0/4059992587 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a800c7f80 0x7f9a80070160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:08:58.355 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.343+0000 7f9a7dd9b640 1 --2- 172.21.15.53:0/4059992587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a80145ed0 0x7f9a800c7a40 secure :-1 s=READY pgs=2696 cs=0 l=1 rev1=1 crypto rx=0x7f9a74012470 tx=0x7f9a74012930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:58.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.343+0000 7f9a6effd640 1 -- 172.21.15.53:0/4059992587 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a7401b070 con 0x7f9a80145ed0 2023-06-10T19:08:58.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.343+0000 7f9a6effd640 1 -- 172.21.15.53:0/4059992587 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a74014550 con 0x7f9a80145ed0 2023-06-10T19:08:58.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.343+0000 7f9a6effd640 1 -- 172.21.15.53:0/4059992587 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a740148e0 con 0x7f9a80145ed0 2023-06-10T19:08:58.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.343+0000 7f9a84c45640 1 -- 172.21.15.53:0/4059992587 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a801f0900 con 0x7f9a80145ed0 2023-06-10T19:08:58.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.343+0000 7f9a84c45640 1 -- 172.21.15.53:0/4059992587 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a800c3910 con 0x7f9a80145ed0 2023-06-10T19:08:58.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.343+0000 7f9a84c45640 1 -- 172.21.15.53:0/4059992587 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a80071130 con 0x7f9a80145ed0 2023-06-10T19:08:58.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.343+0000 7f9a6effd640 1 -- 172.21.15.53:0/4059992587 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9a74014a40 con 0x7f9a80145ed0 2023-06-10T19:08:58.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.343+0000 7f9a6effd640 1 --2- 172.21.15.53:0/4059992587 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9a60066280 0x7f9a60068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:58.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.343+0000 7f9a6effd640 1 -- 172.21.15.53:0/4059992587 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6192+0+0 (secure 0 0 0) 0x7f9a74086cb0 con 0x7f9a80145ed0 2023-06-10T19:08:58.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.343+0000 7f9a7e59c640 1 --2- 172.21.15.53:0/4059992587 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9a60066280 0x7f9a60068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:58.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.343+0000 7f9a7e59c640 1 --2- 172.21.15.53:0/4059992587 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9a60066280 0x7f9a60068730 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f9a8006d900 tx=0x7f9a70009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:58.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.347+0000 7f9a6effd640 1 -- 172.21.15.53:0/4059992587 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9a74054140 con 0x7f9a80145ed0 2023-06-10T19:08:58.517 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.511+0000 7f9a84c45640 1 -- 172.21.15.53:0/4059992587 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9a801ecae0 con 0x7f9a80145ed0 2023-06-10T19:08:58.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.511+0000 7f9a6effd640 1 -- 172.21.15.53:0/4059992587 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 1 entries v183) v1 ==== 80+0+57 (secure 0 0 0) 0x7f9a74057760 con 0x7f9a80145ed0 2023-06-10T19:08:58.518 INFO:teuthology.orchestra.run.smithi053.stdout:192.168.0.1:0/3824904337 2023-06-10T20:08:33.687127+0000 2023-06-10T19:08:58.519 INFO:teuthology.orchestra.run.smithi053.stderr:listed 1 entries 2023-06-10T19:08:58.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.515+0000 7f9a84c45640 1 -- 172.21.15.53:0/4059992587 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9a60066280 msgr2=0x7f9a60068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:58.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.515+0000 7f9a84c45640 1 --2- 172.21.15.53:0/4059992587 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9a60066280 0x7f9a60068730 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f9a8006d900 tx=0x7f9a70009040 comp rx=0 tx=0).stop 2023-06-10T19:08:58.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.515+0000 7f9a84c45640 1 -- 172.21.15.53:0/4059992587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a80145ed0 msgr2=0x7f9a800c7a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:58.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.515+0000 7f9a84c45640 1 --2- 172.21.15.53:0/4059992587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a80145ed0 0x7f9a800c7a40 secure :-1 s=READY pgs=2696 cs=0 l=1 rev1=1 crypto rx=0x7f9a74012470 tx=0x7f9a74012930 comp rx=0 tx=0).stop 2023-06-10T19:08:58.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.515+0000 7f9a84c45640 1 -- 172.21.15.53:0/4059992587 shutdown_connections 2023-06-10T19:08:58.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.515+0000 7f9a84c45640 1 --2- 172.21.15.53:0/4059992587 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9a60066280 0x7f9a60068730 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:58.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.515+0000 7f9a84c45640 1 --2- 172.21.15.53:0/4059992587 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a800c7f80 0x7f9a80070160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:58.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.515+0000 7f9a84c45640 1 --2- 172.21.15.53:0/4059992587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a80145ed0 0x7f9a800c7a40 unknown :-1 s=CLOSED pgs=2696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:58.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.515+0000 7f9a84c45640 1 --2- 172.21.15.53:0/4059992587 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9a680074b0 0x7f9a800c33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:58.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.515+0000 7f9a84c45640 1 -- 172.21.15.53:0/4059992587 >> 172.21.15.53:0/4059992587 conn(0x7f9a800caf30 msgr2=0x7f9a800b33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:58.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.515+0000 7f9a84c45640 1 -- 172.21.15.53:0/4059992587 shutdown_connections 2023-06-10T19:08:58.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.515+0000 7f9a84c45640 1 -- 172.21.15.53:0/4059992587 wait complete. 2023-06-10T19:08:58.538 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi117.front.sepia.ceph.com... 2023-06-10T19:08:58.538 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:08:58.539 DEBUG:teuthology.orchestra.run.smithi117:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-06-10T19:08:58.553 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi117.stderr:ceph-fuse[45973]: fuse finished with error 0 and tester_r 0 2023-06-10T19:08:58.556 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi117.front.sepia.ceph.com 2023-06-10T19:08:58.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:08:58.559 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-06-10T19:08:58.717 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T19:08:58.717 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:08:58.724 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16345192k,nr_inodes=4086298,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276544k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=407 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276540k,nr_inodes=819135,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276544k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-06-10T19:08:58.724 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi053.front.sepia.ceph.com 2023-06-10T19:08:58.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:08:58.725 DEBUG:teuthology.orchestra.run.smithi053:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-06-10T19:08:58.772 INFO:teuthology.orchestra.run.smithi053.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-06-10T19:08:58.773 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-10T19:08:58.774 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T19:08:58.774 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:08:58.780 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16342088k,nr_inodes=4085522,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275924k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18845 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275920k,nr_inodes=818980,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275924k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-06-10T19:08:58.781 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi117.front.sepia.ceph.com 2023-06-10T19:08:58.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:08:58.781 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-06-10T19:08:58.827 INFO:teuthology.orchestra.run.smithi117.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-06-10T19:08:58.828 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-10T19:08:58.829 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:08:58.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.955+0000 7fe80c051640 1 Processor -- start 2023-06-10T19:08:58.963 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.955+0000 7fe80c051640 1 -- start start 2023-06-10T19:08:58.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.959+0000 7fe80c051640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe8040c9840 0x7fe8040c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:58.964 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.959+0000 7fe80c051640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe80406b090 0x7fe80406b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:58.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.959+0000 7fe80c051640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe804159b50 con 0x7fe804071060 2023-06-10T19:08:58.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.959+0000 7fe80c051640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8040ca150 con 0x7fe80406b090 2023-06-10T19:08:58.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.959+0000 7fe80c051640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8040702a0 con 0x7fe8040c9840 2023-06-10T19:08:58.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.959+0000 7fe80a5ee640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe80406b090 0x7fe80406b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:58.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.959+0000 7fe8095ec640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fe804071060 0x7fe8040af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56826/0 (socket says 172.21.15.53:56826) 2023-06-10T19:08:58.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.959+0000 7fe8095ec640 1 -- 172.21.15.53:0/1050137832 learned_addr learned my addr 172.21.15.53:0/1050137832 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:08:58.965 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.959+0000 7fe809ded640 1 --2- 172.21.15.53:0/1050137832 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe8040c9840 0x7fe8040c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:58.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.959+0000 7fe80a5ee640 1 -- 172.21.15.53:0/1050137832 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe8040c9840 msgr2=0x7fe8040c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:58.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.959+0000 7fe80a5ee640 1 --2- 172.21.15.53:0/1050137832 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe8040c9840 0x7fe8040c9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:58.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.959+0000 7fe80a5ee640 1 -- 172.21.15.53:0/1050137832 >> v1:172.21.15.53:6789/0 conn(0x7fe804071060 legacy=0x7fe8040af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:58.966 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.959+0000 7fe80a5ee640 1 -- 172.21.15.53:0/1050137832 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe804070580 con 0x7fe80406b090 2023-06-10T19:08:58.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.959+0000 7fe80a5ee640 1 --2- 172.21.15.53:0/1050137832 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe80406b090 0x7fe80406b530 secure :-1 s=READY pgs=2698 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc009d90 tx=0x7fe7fc01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=588d09494486ad2d server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:58.967 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.959+0000 7fe808deb640 1 -- 172.21.15.53:0/1050137832 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7fc0a59e0 con 0x7fe80406b090 2023-06-10T19:08:58.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.959+0000 7fe808deb640 1 -- 172.21.15.53:0/1050137832 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7fc0a5b40 con 0x7fe80406b090 2023-06-10T19:08:58.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.959+0000 7fe808deb640 1 -- 172.21.15.53:0/1050137832 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7fc0ad440 con 0x7fe80406b090 2023-06-10T19:08:58.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.963+0000 7fe80c051640 1 -- 172.21.15.53:0/1050137832 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe80406b090 msgr2=0x7fe80406b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:58.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.963+0000 7fe80c051640 1 --2- 172.21.15.53:0/1050137832 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe80406b090 0x7fe80406b530 secure :-1 s=READY pgs=2698 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc009d90 tx=0x7fe7fc01c920 comp rx=0 tx=0).stop 2023-06-10T19:08:58.968 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.963+0000 7fe80c051640 1 -- 172.21.15.53:0/1050137832 shutdown_connections 2023-06-10T19:08:58.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.963+0000 7fe80c051640 1 --2- 172.21.15.53:0/1050137832 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe80406b090 0x7fe80406b530 unknown :-1 s=CLOSED pgs=2698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:58.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.963+0000 7fe80c051640 1 --2- 172.21.15.53:0/1050137832 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe8040c9840 0x7fe8040c9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:58.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.963+0000 7fe80c051640 1 -- 172.21.15.53:0/1050137832 >> 172.21.15.53:0/1050137832 conn(0x7fe80406a0d0 msgr2=0x7fe8040ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:58.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.963+0000 7fe80c051640 1 -- 172.21.15.53:0/1050137832 shutdown_connections 2023-06-10T19:08:58.969 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.963+0000 7fe80c051640 1 -- 172.21.15.53:0/1050137832 wait complete. 2023-06-10T19:08:58.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.963+0000 7fe80c051640 1 Processor -- start 2023-06-10T19:08:58.970 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.963+0000 7fe80c051640 1 -- start start 2023-06-10T19:08:58.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.963+0000 7fe80c051640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe80406b090 0x7fe80415ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:58.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.963+0000 7fe80c051640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe804071060 0x7fe8040ac770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:58.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.963+0000 7fe80c051640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8040c9840 0x7fe8040ccc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:58.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.963+0000 7fe80c051640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8040aecd0 con 0x7fe804071060 2023-06-10T19:08:58.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.963+0000 7fe80c051640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8040ad700 con 0x7fe8040c9840 2023-06-10T19:08:58.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.963+0000 7fe80c051640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8040accb0 con 0x7fe80406b090 2023-06-10T19:08:58.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.963+0000 7fe8095ec640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe804071060 0x7fe8040ac770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:58.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.963+0000 7fe8095ec640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe804071060 0x7fe8040ac770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42270/0 (socket says 172.21.15.53:42270) 2023-06-10T19:08:58.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.963+0000 7fe8095ec640 1 -- 172.21.15.53:0/2977148996 learned_addr learned my addr 172.21.15.53:0/2977148996 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:08:58.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.967+0000 7fe809ded640 1 --2- 172.21.15.53:0/2977148996 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe80406b090 0x7fe80415ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:58.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.967+0000 7fe8095ec640 1 -- 172.21.15.53:0/2977148996 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe80406b090 msgr2=0x7fe80415ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:58.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.967+0000 7fe8095ec640 1 --2- 172.21.15.53:0/2977148996 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe80406b090 0x7fe80415ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:58.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.967+0000 7fe8095ec640 1 -- 172.21.15.53:0/2977148996 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8040c9840 msgr2=0x7fe8040ccc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:58.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.967+0000 7fe80a5ee640 1 --2- 172.21.15.53:0/2977148996 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8040c9840 0x7fe8040ccc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:58.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.967+0000 7fe8095ec640 1 --2- 172.21.15.53:0/2977148996 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8040c9840 0x7fe8040ccc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:58.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.967+0000 7fe8095ec640 1 -- 172.21.15.53:0/2977148996 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7fc009a70 con 0x7fe804071060 2023-06-10T19:08:58.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.967+0000 7fe809ded640 1 --2- 172.21.15.53:0/2977148996 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe80406b090 0x7fe80415ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:08:58.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.967+0000 7fe8095ec640 1 --2- 172.21.15.53:0/2977148996 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe804071060 0x7fe8040ac770 secure :-1 s=READY pgs=2699 cs=0 l=1 rev1=1 crypto rx=0x7fe7f400c4d0 tx=0x7fe7f400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:58.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.967+0000 7fe7fa7fc640 1 -- 172.21.15.53:0/2977148996 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f4005cf0 con 0x7fe804071060 2023-06-10T19:08:58.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.967+0000 7fe7fa7fc640 1 -- 172.21.15.53:0/2977148996 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7f4005e50 con 0x7fe804071060 2023-06-10T19:08:58.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.967+0000 7fe80c051640 1 -- 172.21.15.53:0/2977148996 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8040ad950 con 0x7fe804071060 2023-06-10T19:08:58.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.967+0000 7fe7fa7fc640 1 -- 172.21.15.53:0/2977148996 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f4007270 con 0x7fe804071060 2023-06-10T19:08:58.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.967+0000 7fe80c051640 1 -- 172.21.15.53:0/2977148996 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8040af650 con 0x7fe804071060 2023-06-10T19:08:58.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.967+0000 7fe80c051640 1 -- 172.21.15.53:0/2977148996 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe80404d790 con 0x7fe804071060 2023-06-10T19:08:58.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.967+0000 7fe7fa7fc640 1 -- 172.21.15.53:0/2977148996 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe7f40073d0 con 0x7fe804071060 2023-06-10T19:08:58.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.967+0000 7fe7fa7fc640 1 --2- 172.21.15.53:0/2977148996 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe7e8066280 0x7fe7e8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:58.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.967+0000 7fe7fa7fc640 1 -- 172.21.15.53:0/2977148996 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6192+0+0 (secure 0 0 0) 0x7fe7f4083200 con 0x7fe804071060 2023-06-10T19:08:58.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.967+0000 7fe809ded640 1 --2- 172.21.15.53:0/2977148996 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe7e8066280 0x7fe7e8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:58.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.967+0000 7fe809ded640 1 --2- 172.21.15.53:0/2977148996 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe7e8066280 0x7fe7e8068730 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fe8000097a0 tx=0x7fe800008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:58.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:58.971+0000 7fe7fa7fc640 1 -- 172.21.15.53:0/2977148996 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe7f40506b0 con 0x7fe804071060 2023-06-10T19:08:59.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.167+0000 7fe80c051640 1 -- 172.21.15.53:0/2977148996 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe8040cb140 con 0x7fe804071060 2023-06-10T19:08:59.172 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.167+0000 7fe7fa7fc640 1 -- 172.21.15.53:0/2977148996 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) v1 ==== 95+0+4688 (secure 0 0 0) 0x7fe7f4053cd0 con 0x7fe804071060 2023-06-10T19:08:59.173 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:08:59.173 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":104,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7835,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2641321206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2641321206},{"type":"v1","addr":"172.21.15.117:6835","nonce":2641321206}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":99},{"gid":8956,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1439696554","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1439696554},{"type":"v1","addr":"172.21.15.117:6837","nonce":1439696554}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":99},{"gid":11112,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/3327528087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3327528087},{"type":"v1","addr":"172.21.15.53:6833","nonce":3327528087}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":99}],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:08:03.514484+0000","modified":"2023-06-10T19:08:06.533495+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":11118},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11118":{"gid":11118,"name":"c","rank":0,"incarnation":100,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/3732323283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":3732323283},{"type":"v1","addr":"172.21.15.53:6835","nonce":3732323283}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":12}]} 2023-06-10T19:08:59.173 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 104 2023-06-10T19:08:59.175 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.167+0000 7fe80c051640 1 -- 172.21.15.53:0/2977148996 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe7e8066280 msgr2=0x7fe7e8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:59.175 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.167+0000 7fe80c051640 1 --2- 172.21.15.53:0/2977148996 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe7e8066280 0x7fe7e8068730 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fe8000097a0 tx=0x7fe800008040 comp rx=0 tx=0).stop 2023-06-10T19:08:59.175 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.167+0000 7fe80c051640 1 -- 172.21.15.53:0/2977148996 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe804071060 msgr2=0x7fe8040ac770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:59.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.167+0000 7fe80c051640 1 --2- 172.21.15.53:0/2977148996 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe804071060 0x7fe8040ac770 secure :-1 s=READY pgs=2699 cs=0 l=1 rev1=1 crypto rx=0x7fe7f400c4d0 tx=0x7fe7f400c990 comp rx=0 tx=0).stop 2023-06-10T19:08:59.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.167+0000 7fe80c051640 1 -- 172.21.15.53:0/2977148996 shutdown_connections 2023-06-10T19:08:59.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.167+0000 7fe80c051640 1 --2- 172.21.15.53:0/2977148996 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe7e8066280 0x7fe7e8068730 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:59.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.167+0000 7fe80c051640 1 --2- 172.21.15.53:0/2977148996 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8040c9840 0x7fe8040ccc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:59.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.167+0000 7fe80c051640 1 --2- 172.21.15.53:0/2977148996 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe804071060 0x7fe8040ac770 unknown :-1 s=CLOSED pgs=2699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:59.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.167+0000 7fe80c051640 1 --2- 172.21.15.53:0/2977148996 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe80406b090 0x7fe80415ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:59.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.167+0000 7fe80c051640 1 -- 172.21.15.53:0/2977148996 >> 172.21.15.53:0/2977148996 conn(0x7fe80406a0d0 msgr2=0x7fe8040c8b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:59.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.171+0000 7fe80c051640 1 -- 172.21.15.53:0/2977148996 shutdown_connections 2023-06-10T19:08:59.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.171+0000 7fe80c051640 1 -- 172.21.15.53:0/2977148996 wait complete. 2023-06-10T19:08:59.192 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:08:59.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.307+0000 7f149a7e6640 1 Processor -- start 2023-06-10T19:08:59.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.307+0000 7f149a7e6640 1 -- start start 2023-06-10T19:08:59.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.311+0000 7f149a7e6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14940cb870 0x7f14940af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:59.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.311+0000 7f149a7e6640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f14940afc60 0x7f14940aba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:59.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.311+0000 7f149a7e6640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14941600d0 con 0x7f14940c9750 2023-06-10T19:08:59.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.311+0000 7f149a7e6640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14940cd990 con 0x7f14940afc60 2023-06-10T19:08:59.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.311+0000 7f149a7e6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14940b00e0 con 0x7f14940cb870 2023-06-10T19:08:59.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.311+0000 7f14937fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14940cb870 0x7f14940af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:59.316 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.311+0000 7f1498d83640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f14940afc60 0x7f14940aba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:59.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.311+0000 7f14937fe640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14940cb870 0x7f14940af720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.53:37534/0 (socket says 172.21.15.53:37534) 2023-06-10T19:08:59.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.311+0000 7f14937fe640 1 -- 172.21.15.53:0/4264736405 learned_addr learned my addr 172.21.15.53:0/4264736405 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:08:59.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.311+0000 7f14937fe640 1 -- 172.21.15.53:0/4264736405 >> v2:172.21.15.117:3300/0 conn(0x7f14940afc60 msgr2=0x7f14940aba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:59.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.311+0000 7f14937fe640 1 --2- 172.21.15.53:0/4264736405 >> v2:172.21.15.117:3300/0 conn(0x7f14940afc60 0x7f14940aba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:59.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.311+0000 7f14937fe640 1 -- 172.21.15.53:0/4264736405 >> v1:172.21.15.117:6789/0 conn(0x7f14940c9750 legacy=0x7f14940aced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:59.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.311+0000 7f14937fe640 1 -- 172.21.15.53:0/4264736405 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1494160370 con 0x7f14940cb870 2023-06-10T19:08:59.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.311+0000 7f14937fe640 1 --2- 172.21.15.53:0/4264736405 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14940cb870 0x7f14940af720 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f147c009e50 tx=0x7f147c01ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf826966b7a55078 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:59.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.311+0000 7f1492ffd640 1 -- 172.21.15.53:0/4264736405 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f147c0a5900 con 0x7f14940cb870 2023-06-10T19:08:59.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.315+0000 7f1492ffd640 1 -- 172.21.15.53:0/4264736405 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f147c0a5a60 con 0x7f14940cb870 2023-06-10T19:08:59.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.315+0000 7f1492ffd640 1 -- 172.21.15.53:0/4264736405 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f147c0a5df0 con 0x7f14940cb870 2023-06-10T19:08:59.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.315+0000 7f149a7e6640 1 -- 172.21.15.53:0/4264736405 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14940cb870 msgr2=0x7f14940af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:59.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.315+0000 7f149a7e6640 1 --2- 172.21.15.53:0/4264736405 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14940cb870 0x7f14940af720 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f147c009e50 tx=0x7f147c01ca10 comp rx=0 tx=0).stop 2023-06-10T19:08:59.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.315+0000 7f149a7e6640 1 -- 172.21.15.53:0/4264736405 shutdown_connections 2023-06-10T19:08:59.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.315+0000 7f149a7e6640 1 --2- 172.21.15.53:0/4264736405 >> v2:172.21.15.117:3300/0 conn(0x7f14940afc60 0x7f14940aba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:59.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.315+0000 7f149a7e6640 1 --2- 172.21.15.53:0/4264736405 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14940cb870 0x7f14940af720 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:59.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.315+0000 7f149a7e6640 1 -- 172.21.15.53:0/4264736405 >> 172.21.15.53:0/4264736405 conn(0x7f149406a0d0 msgr2=0x7f14940ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:59.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.315+0000 7f149a7e6640 1 -- 172.21.15.53:0/4264736405 shutdown_connections 2023-06-10T19:08:59.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.315+0000 7f149a7e6640 1 -- 172.21.15.53:0/4264736405 wait complete. 2023-06-10T19:08:59.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.315+0000 7f149a7e6640 1 Processor -- start 2023-06-10T19:08:59.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.315+0000 7f149a7e6640 1 -- start start 2023-06-10T19:08:59.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.315+0000 7f149a7e6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f14940afc60 0x7f1494152210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:59.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.315+0000 7f149a7e6640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14940c9750 0x7f14941527f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:59.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.315+0000 7f149a7e6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14940cb870 0x7f149414c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:59.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.315+0000 7f149a7e6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1494158cb0 con 0x7f14940afc60 2023-06-10T19:08:59.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.315+0000 7f149a7e6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1494152d30 con 0x7f14940cb870 2023-06-10T19:08:59.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.315+0000 7f149a7e6640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14941553c0 con 0x7f14940c9750 2023-06-10T19:08:59.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.315+0000 7f1493fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f14940afc60 0x7f1494152210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:59.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.315+0000 7f1493fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f14940afc60 0x7f1494152210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42286/0 (socket says 172.21.15.53:42286) 2023-06-10T19:08:59.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.315+0000 7f1493fff640 1 -- 172.21.15.53:0/2702995295 learned_addr learned my addr 172.21.15.53:0/2702995295 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:08:59.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.315+0000 7f1498d83640 1 --2- 172.21.15.53:0/2702995295 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14940cb870 0x7f149414c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:59.324 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.315+0000 7f14937fe640 1 --2- 172.21.15.53:0/2702995295 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14940c9750 0x7f14941527f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:59.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.315+0000 7f1493fff640 1 -- 172.21.15.53:0/2702995295 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14940c9750 msgr2=0x7f14941527f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:59.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.315+0000 7f1493fff640 1 --2- 172.21.15.53:0/2702995295 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14940c9750 0x7f14941527f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:59.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.315+0000 7f1493fff640 1 -- 172.21.15.53:0/2702995295 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14940cb870 msgr2=0x7f149414c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:59.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.315+0000 7f1493fff640 1 --2- 172.21.15.53:0/2702995295 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14940cb870 0x7f149414c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:59.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.315+0000 7f1493fff640 1 -- 172.21.15.53:0/2702995295 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f147c009b30 con 0x7f14940afc60 2023-06-10T19:08:59.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.315+0000 7f1498d83640 1 --2- 172.21.15.53:0/2702995295 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14940cb870 0x7f149414c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:08:59.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.315+0000 7f1493fff640 1 --2- 172.21.15.53:0/2702995295 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f14940afc60 0x7f1494152210 secure :-1 s=READY pgs=2700 cs=0 l=1 rev1=1 crypto rx=0x7f148c00c420 tx=0x7f148c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:59.325 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.315+0000 7f1490ff9640 1 -- 172.21.15.53:0/2702995295 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148c0052d0 con 0x7f14940afc60 2023-06-10T19:08:59.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.315+0000 7f1490ff9640 1 -- 172.21.15.53:0/2702995295 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f148c005430 con 0x7f14940afc60 2023-06-10T19:08:59.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.315+0000 7f1490ff9640 1 -- 172.21.15.53:0/2702995295 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148c007260 con 0x7f14940afc60 2023-06-10T19:08:59.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.315+0000 7f149a7e6640 1 -- 172.21.15.53:0/2702995295 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1494152f60 con 0x7f14940afc60 2023-06-10T19:08:59.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.315+0000 7f149a7e6640 1 -- 172.21.15.53:0/2702995295 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f149414d740 con 0x7f14940afc60 2023-06-10T19:08:59.326 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.319+0000 7f149a7e6640 1 -- 172.21.15.53:0/2702995295 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1494155530 con 0x7f14940afc60 2023-06-10T19:08:59.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.319+0000 7f1490ff9640 1 -- 172.21.15.53:0/2702995295 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f148c0073c0 con 0x7f14940afc60 2023-06-10T19:08:59.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.319+0000 7f1490ff9640 1 --2- 172.21.15.53:0/2702995295 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1474066280 0x7f1474068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:59.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.319+0000 7f1490ff9640 1 -- 172.21.15.53:0/2702995295 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6192+0+0 (secure 0 0 0) 0x7f148c083210 con 0x7f14940afc60 2023-06-10T19:08:59.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.319+0000 7f14937fe640 1 --2- 172.21.15.53:0/2702995295 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1474066280 0x7f1474068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:59.327 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.319+0000 7f14937fe640 1 --2- 172.21.15.53:0/2702995295 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1474066280 0x7f1474068730 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f147c0ae000 tx=0x7f147c0a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:59.328 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.323+0000 7f1490ff9640 1 -- 172.21.15.53:0/2702995295 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f148c0505b0 con 0x7f14940afc60 2023-06-10T19:08:59.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.471+0000 7f149a7e6640 1 -- 172.21.15.53:0/2702995295 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f149404d790 con 0x7f14940afc60 2023-06-10T19:08:59.481 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.475+0000 7f1490ff9640 1 -- 172.21.15.53:0/2702995295 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v183) v1 ==== 74+0+18487 (secure 0 0 0) 0x7f148c053bd0 con 0x7f14940afc60 2023-06-10T19:08:59.481 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:08:59.481 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":183,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:08:34.235084+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2023-06-10T19:08:01.296938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"179","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_data","create_time":"2023-06-10T19:08:02.507633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"180","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"26.2a","mappings":[{"from":1,"to":0}]},{"pgid":"26.37","mappings":[{"from":1,"to":0}]},{"pgid":"26.3a","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.0.1:0/3824904337":"2023-06-10T20:08:33.687127+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:08:59.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.475+0000 7f149a7e6640 1 -- 172.21.15.53:0/2702995295 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1474066280 msgr2=0x7f1474068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:59.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.475+0000 7f149a7e6640 1 --2- 172.21.15.53:0/2702995295 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1474066280 0x7f1474068730 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f147c0ae000 tx=0x7f147c0a7070 comp rx=0 tx=0).stop 2023-06-10T19:08:59.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.475+0000 7f149a7e6640 1 -- 172.21.15.53:0/2702995295 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f14940afc60 msgr2=0x7f1494152210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:59.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.475+0000 7f149a7e6640 1 --2- 172.21.15.53:0/2702995295 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f14940afc60 0x7f1494152210 secure :-1 s=READY pgs=2700 cs=0 l=1 rev1=1 crypto rx=0x7f148c00c420 tx=0x7f148c00c8e0 comp rx=0 tx=0).stop 2023-06-10T19:08:59.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.475+0000 7f149a7e6640 1 -- 172.21.15.53:0/2702995295 shutdown_connections 2023-06-10T19:08:59.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.475+0000 7f149a7e6640 1 --2- 172.21.15.53:0/2702995295 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f1474066280 0x7f1474068730 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:59.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.475+0000 7f149a7e6640 1 --2- 172.21.15.53:0/2702995295 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14940cb870 0x7f149414c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:59.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.475+0000 7f149a7e6640 1 --2- 172.21.15.53:0/2702995295 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f14940c9750 0x7f14941527f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:59.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.475+0000 7f149a7e6640 1 --2- 172.21.15.53:0/2702995295 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f14940afc60 0x7f1494152210 unknown :-1 s=CLOSED pgs=2700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:59.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.479+0000 7f149a7e6640 1 -- 172.21.15.53:0/2702995295 >> 172.21.15.53:0/2702995295 conn(0x7f149406a0d0 msgr2=0x7f14940c82b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:59.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.479+0000 7f149a7e6640 1 -- 172.21.15.53:0/2702995295 shutdown_connections 2023-06-10T19:08:59.484 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.479+0000 7f149a7e6640 1 -- 172.21.15.53:0/2702995295 wait complete. 2023-06-10T19:08:59.500 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-10T18:52:33.633114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-10T18:52:39.171487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 25, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-10T19:08:01.296938+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '179', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 26, 'pool_name': 'cephfs_data', 'create_time': '2023-06-10T19:08:02.507633+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '180', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-10T19:08:59.501 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-10T19:08:59.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.615+0000 7f6b739b0640 1 Processor -- start 2023-06-10T19:08:59.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.615+0000 7f6b739b0640 1 -- start start 2023-06-10T19:08:59.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.619+0000 7f6b739b0640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6b6c157cf0 0x7f6b6c0ca6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:59.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.619+0000 7f6b739b0640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6b6c071510 0x7f6b6c0b0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:59.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.619+0000 7f6b739b0640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b6c06fa60 con 0x7f6b6c0affc0 2023-06-10T19:08:59.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.619+0000 7f6b739b0640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b6c0b0980 con 0x7f6b6c071510 2023-06-10T19:08:59.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.619+0000 7f6b739b0640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b6c06a340 con 0x7f6b6c157cf0 2023-06-10T19:08:59.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.619+0000 7f6b71f4d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6b6c071510 0x7f6b6c0b0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:59.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.619+0000 7f6b70f4b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f6b6c0affc0 0x7f6b6c15b8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56838/0 (socket says 172.21.15.53:56838) 2023-06-10T19:08:59.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.619+0000 7f6b70f4b640 1 -- 172.21.15.53:0/2491894854 learned_addr learned my addr 172.21.15.53:0/2491894854 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:08:59.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.619+0000 7f6b7174c640 1 --2- 172.21.15.53:0/2491894854 >> v2:172.21.15.117:3300/0 conn(0x7f6b6c157cf0 0x7f6b6c0ca6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:59.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.619+0000 7f6b71f4d640 1 -- 172.21.15.53:0/2491894854 >> v2:172.21.15.117:3300/0 conn(0x7f6b6c157cf0 msgr2=0x7f6b6c0ca6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:08:59.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.619+0000 7f6b71f4d640 1 --2- 172.21.15.53:0/2491894854 >> v2:172.21.15.117:3300/0 conn(0x7f6b6c157cf0 0x7f6b6c0ca6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:59.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.619+0000 7f6b71f4d640 1 -- 172.21.15.53:0/2491894854 >> v1:172.21.15.53:6789/0 conn(0x7f6b6c0affc0 legacy=0x7f6b6c15b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:59.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.619+0000 7f6b71f4d640 1 -- 172.21.15.53:0/2491894854 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b6c0c9250 con 0x7f6b6c071510 2023-06-10T19:08:59.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.619+0000 7f6b71f4d640 1 --2- 172.21.15.53:0/2491894854 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b6c071510 0x7f6b6c0b0440 secure :-1 s=READY pgs=2702 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c0b1130 tx=0x7f6b6401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9e407e32bf72241 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:59.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.619+0000 7f6b63fff640 1 -- 172.21.15.53:0/2491894854 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b640a5920 con 0x7f6b6c071510 2023-06-10T19:08:59.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.619+0000 7f6b63fff640 1 -- 172.21.15.53:0/2491894854 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b640a5a80 con 0x7f6b6c071510 2023-06-10T19:08:59.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.619+0000 7f6b63fff640 1 -- 172.21.15.53:0/2491894854 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b640a5e10 con 0x7f6b6c071510 2023-06-10T19:08:59.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.619+0000 7f6b739b0640 1 -- 172.21.15.53:0/2491894854 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b6c071510 msgr2=0x7f6b6c0b0440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:59.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.619+0000 7f6b739b0640 1 --2- 172.21.15.53:0/2491894854 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b6c071510 0x7f6b6c0b0440 secure :-1 s=READY pgs=2702 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c0b1130 tx=0x7f6b6401c8e0 comp rx=0 tx=0).stop 2023-06-10T19:08:59.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.619+0000 7f6b739b0640 1 -- 172.21.15.53:0/2491894854 shutdown_connections 2023-06-10T19:08:59.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.619+0000 7f6b739b0640 1 --2- 172.21.15.53:0/2491894854 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b6c071510 0x7f6b6c0b0440 unknown :-1 s=CLOSED pgs=2702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:59.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.619+0000 7f6b739b0640 1 --2- 172.21.15.53:0/2491894854 >> v2:172.21.15.117:3300/0 conn(0x7f6b6c157cf0 0x7f6b6c0ca6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:59.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.619+0000 7f6b739b0640 1 -- 172.21.15.53:0/2491894854 >> 172.21.15.53:0/2491894854 conn(0x7f6b6c0cafc0 msgr2=0x7f6b6c0cb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:59.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.619+0000 7f6b739b0640 1 -- 172.21.15.53:0/2491894854 shutdown_connections 2023-06-10T19:08:59.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.619+0000 7f6b739b0640 1 -- 172.21.15.53:0/2491894854 wait complete. 2023-06-10T19:08:59.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.623+0000 7f6b739b0640 1 Processor -- start 2023-06-10T19:08:59.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.623+0000 7f6b739b0640 1 -- start start 2023-06-10T19:08:59.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.623+0000 7f6b739b0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b6c071510 0x7f6b6c0c6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:59.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.623+0000 7f6b739b0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b6c0affc0 0x7f6b6c147080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:59.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.623+0000 7f6b739b0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b6c157cf0 0x7f6b6c0cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:59.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.623+0000 7f6b739b0640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6c0c5610 con 0x7f6b6c157cf0 2023-06-10T19:08:59.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.623+0000 7f6b739b0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6c148690 con 0x7f6b6c071510 2023-06-10T19:08:59.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.623+0000 7f6b739b0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6c14fad0 con 0x7f6b6c0affc0 2023-06-10T19:08:59.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.623+0000 7f6b71f4d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b6c157cf0 0x7f6b6c0cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:59.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.623+0000 7f6b71f4d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b6c157cf0 0x7f6b6c0cd7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42314/0 (socket says 172.21.15.53:42314) 2023-06-10T19:08:59.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.623+0000 7f6b71f4d640 1 -- 172.21.15.53:0/3171322379 learned_addr learned my addr 172.21.15.53:0/3171322379 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:08:59.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.623+0000 7f6b70f4b640 1 --2- 172.21.15.53:0/3171322379 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b6c0affc0 0x7f6b6c147080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:59.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.623+0000 7f6b7174c640 1 --2- 172.21.15.53:0/3171322379 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b6c071510 0x7f6b6c0c6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:59.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.623+0000 7f6b71f4d640 1 -- 172.21.15.53:0/3171322379 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b6c0affc0 msgr2=0x7f6b6c147080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:59.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.623+0000 7f6b71f4d640 1 --2- 172.21.15.53:0/3171322379 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b6c0affc0 0x7f6b6c147080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:59.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.623+0000 7f6b71f4d640 1 -- 172.21.15.53:0/3171322379 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b6c071510 msgr2=0x7f6b6c0c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:59.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.623+0000 7f6b71f4d640 1 --2- 172.21.15.53:0/3171322379 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b6c071510 0x7f6b6c0c6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:59.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.623+0000 7f6b71f4d640 1 -- 172.21.15.53:0/3171322379 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b64009a70 con 0x7f6b6c157cf0 2023-06-10T19:08:59.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.623+0000 7f6b71f4d640 1 --2- 172.21.15.53:0/3171322379 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b6c157cf0 0x7f6b6c0cd7d0 secure :-1 s=READY pgs=2703 cs=0 l=1 rev1=1 crypto rx=0x7f6b6401a510 tx=0x7f6b64019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:59.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.623+0000 7f6b61ffb640 1 -- 172.21.15.53:0/3171322379 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b640aee10 con 0x7f6b6c157cf0 2023-06-10T19:08:59.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.623+0000 7f6b61ffb640 1 -- 172.21.15.53:0/3171322379 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b64009450 con 0x7f6b6c157cf0 2023-06-10T19:08:59.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.623+0000 7f6b61ffb640 1 -- 172.21.15.53:0/3171322379 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b640b7630 con 0x7f6b6c157cf0 2023-06-10T19:08:59.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.623+0000 7f6b739b0640 1 -- 172.21.15.53:0/3171322379 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b6c0cadb0 con 0x7f6b6c157cf0 2023-06-10T19:08:59.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.623+0000 7f6b739b0640 1 -- 172.21.15.53:0/3171322379 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b6c0c5b00 con 0x7f6b6c157cf0 2023-06-10T19:08:59.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.627+0000 7f6b739b0640 1 -- 172.21.15.53:0/3171322379 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b6c04d790 con 0x7f6b6c157cf0 2023-06-10T19:08:59.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.627+0000 7f6b61ffb640 1 -- 172.21.15.53:0/3171322379 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6b640b4050 con 0x7f6b6c157cf0 2023-06-10T19:08:59.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.627+0000 7f6b61ffb640 1 --2- 172.21.15.53:0/3171322379 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6b50066280 0x7f6b50068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:59.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.627+0000 7f6b61ffb640 1 -- 172.21.15.53:0/3171322379 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6192+0+0 (secure 0 0 0) 0x7f6b6411f000 con 0x7f6b6c157cf0 2023-06-10T19:08:59.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.627+0000 7f6b7174c640 1 --2- 172.21.15.53:0/3171322379 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6b50066280 0x7f6b50068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:59.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.627+0000 7f6b7174c640 1 --2- 172.21.15.53:0/3171322379 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6b50066280 0x7f6b50068730 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c070e70 tx=0x7f6b68008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:59.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.631+0000 7f6b61ffb640 1 -- 172.21.15.53:0/3171322379 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6b640ec400 con 0x7f6b6c157cf0 2023-06-10T19:08:59.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.783+0000 7f6b739b0640 1 -- 172.21.15.53:0/3171322379 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6b6c0b44c0 con 0x7f6b6c157cf0 2023-06-10T19:08:59.791 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.783+0000 7f6b61ffb640 1 -- 172.21.15.53:0/3171322379 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v183) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6b640b20a0 con 0x7f6b6c157cf0 2023-06-10T19:08:59.791 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2023-06-10T19:08:59.793 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.787+0000 7f6b739b0640 1 -- 172.21.15.53:0/3171322379 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6b50066280 msgr2=0x7f6b50068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:59.793 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.787+0000 7f6b739b0640 1 --2- 172.21.15.53:0/3171322379 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6b50066280 0x7f6b50068730 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c070e70 tx=0x7f6b68008040 comp rx=0 tx=0).stop 2023-06-10T19:08:59.794 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.787+0000 7f6b739b0640 1 -- 172.21.15.53:0/3171322379 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b6c157cf0 msgr2=0x7f6b6c0cd7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:59.794 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.787+0000 7f6b739b0640 1 --2- 172.21.15.53:0/3171322379 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b6c157cf0 0x7f6b6c0cd7d0 secure :-1 s=READY pgs=2703 cs=0 l=1 rev1=1 crypto rx=0x7f6b6401a510 tx=0x7f6b64019680 comp rx=0 tx=0).stop 2023-06-10T19:08:59.794 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.787+0000 7f6b739b0640 1 -- 172.21.15.53:0/3171322379 shutdown_connections 2023-06-10T19:08:59.795 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.787+0000 7f6b739b0640 1 --2- 172.21.15.53:0/3171322379 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6b50066280 0x7f6b50068730 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:59.795 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.787+0000 7f6b739b0640 1 --2- 172.21.15.53:0/3171322379 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b6c157cf0 0x7f6b6c0cd7d0 unknown :-1 s=CLOSED pgs=2703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:59.795 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.787+0000 7f6b739b0640 1 --2- 172.21.15.53:0/3171322379 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b6c0affc0 0x7f6b6c147080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:59.795 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.787+0000 7f6b739b0640 1 --2- 172.21.15.53:0/3171322379 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b6c071510 0x7f6b6c0c6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:59.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.787+0000 7f6b739b0640 1 -- 172.21.15.53:0/3171322379 >> 172.21.15.53:0/3171322379 conn(0x7f6b6c0cafc0 msgr2=0x7f6b6c0cb390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:59.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.787+0000 7f6b739b0640 1 -- 172.21.15.53:0/3171322379 shutdown_connections 2023-06-10T19:08:59.796 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.787+0000 7f6b739b0640 1 -- 172.21.15.53:0/3171322379 wait complete. 2023-06-10T19:08:59.810 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-10T19:08:59.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.931+0000 7f7134e4e640 1 Processor -- start 2023-06-10T19:08:59.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.931+0000 7f7134e4e640 1 -- start start 2023-06-10T19:08:59.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.935+0000 7f7134e4e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f71300afe70 0x7f71300c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:59.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.935+0000 7f7134e4e640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f713006b090 con 0x7f71300c9fa0 2023-06-10T19:08:59.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.935+0000 7f7134e4e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71300ca370 con 0x7f71300c82a0 2023-06-10T19:08:59.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.935+0000 7f7134e4e640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7130070d50 con 0x7f71300afe70 2023-06-10T19:08:59.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.935+0000 7f712e59c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f71300c9fa0 0x7f713006bae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56854/0 (socket says 172.21.15.53:56854) 2023-06-10T19:08:59.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.935+0000 7f712e59c640 1 -- 172.21.15.53:0/978877391 learned_addr learned my addr 172.21.15.53:0/978877391 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:08:59.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.935+0000 7f712ed9d640 1 --2- 172.21.15.53:0/978877391 >> v2:172.21.15.53:3300/0 conn(0x7f71300afe70 0x7f71300c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:59.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.935+0000 7f712d59a640 1 -- 172.21.15.53:0/978877391 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2659326780 0 0) 0x7f713006b090 con 0x7f71300c9fa0 2023-06-10T19:08:59.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.935+0000 7f712d59a640 1 -- 172.21.15.53:0/978877391 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7118003530 con 0x7f71300c9fa0 2023-06-10T19:08:59.944 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.935+0000 7f712ed9d640 1 -- 172.21.15.53:0/978877391 >> v1:172.21.15.117:6789/0 conn(0x7f71300c82a0 legacy=0x7f71300af760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:59.944 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.935+0000 7f712ed9d640 1 -- 172.21.15.53:0/978877391 >> v1:172.21.15.53:6789/0 conn(0x7f71300c9fa0 legacy=0x7f713006bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:59.944 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.935+0000 7f712ed9d640 1 -- 172.21.15.53:0/978877391 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7130071030 con 0x7f71300afe70 2023-06-10T19:08:59.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.935+0000 7f712ed9d640 1 --2- 172.21.15.53:0/978877391 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71300afe70 0x7f71300c86f0 secure :-1 s=READY pgs=2705 cs=0 l=1 rev1=1 crypto rx=0x7f7128009d90 tx=0x7f712801c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68e0c49fd598286d server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:59.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.939+0000 7f712d59a640 1 -- 172.21.15.53:0/978877391 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71280a5950 con 0x7f71300afe70 2023-06-10T19:08:59.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.939+0000 7f712d59a640 1 -- 172.21.15.53:0/978877391 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71280a5ab0 con 0x7f71300afe70 2023-06-10T19:08:59.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.939+0000 7f712d59a640 1 -- 172.21.15.53:0/978877391 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71280a5e40 con 0x7f71300afe70 2023-06-10T19:08:59.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.939+0000 7f7134e4e640 1 -- 172.21.15.53:0/978877391 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71300afe70 msgr2=0x7f71300c86f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:59.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.939+0000 7f7134e4e640 1 --2- 172.21.15.53:0/978877391 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71300afe70 0x7f71300c86f0 secure :-1 s=READY pgs=2705 cs=0 l=1 rev1=1 crypto rx=0x7f7128009d90 tx=0x7f712801c890 comp rx=0 tx=0).stop 2023-06-10T19:08:59.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.939+0000 7f7134e4e640 1 -- 172.21.15.53:0/978877391 shutdown_connections 2023-06-10T19:08:59.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.939+0000 7f7134e4e640 1 --2- 172.21.15.53:0/978877391 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71300afe70 0x7f71300c86f0 unknown :-1 s=CLOSED pgs=2705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:59.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.939+0000 7f7134e4e640 1 -- 172.21.15.53:0/978877391 >> 172.21.15.53:0/978877391 conn(0x7f713006a0e0 msgr2=0x7f71300cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:08:59.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.939+0000 7f7134e4e640 1 -- 172.21.15.53:0/978877391 shutdown_connections 2023-06-10T19:08:59.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.939+0000 7f7134e4e640 1 -- 172.21.15.53:0/978877391 wait complete. 2023-06-10T19:08:59.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.939+0000 7f7134e4e640 1 Processor -- start 2023-06-10T19:08:59.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.939+0000 7f7134e4e640 1 -- start start 2023-06-10T19:08:59.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.939+0000 7f7134e4e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f71300afe70 0x7f71301421d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:59.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.939+0000 7f7134e4e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71300c82a0 0x7f71300bf140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:59.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.939+0000 7f7134e4e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71300c9fa0 0x7f713014ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:59.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.939+0000 7f7134e4e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7130142710 con 0x7f71300c82a0 2023-06-10T19:08:59.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.939+0000 7f7134e4e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71300c0530 con 0x7f71300c9fa0 2023-06-10T19:08:59.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.939+0000 7f7134e4e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71300bf680 con 0x7f71300afe70 2023-06-10T19:08:59.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.939+0000 7f712dd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71300c82a0 0x7f71300bf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:59.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.939+0000 7f712dd9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71300c82a0 0x7f71300bf140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42334/0 (socket says 172.21.15.53:42334) 2023-06-10T19:08:59.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.939+0000 7f712dd9b640 1 -- 172.21.15.53:0/2467829278 learned_addr learned my addr 172.21.15.53:0/2467829278 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:08:59.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.939+0000 7f712ed9d640 1 --2- 172.21.15.53:0/2467829278 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71300c9fa0 0x7f713014ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:59.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.939+0000 7f712e59c640 1 --2- 172.21.15.53:0/2467829278 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f71300afe70 0x7f71301421d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:59.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.939+0000 7f712dd9b640 1 -- 172.21.15.53:0/2467829278 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f71300afe70 msgr2=0x7f71301421d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:59.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.939+0000 7f712dd9b640 1 --2- 172.21.15.53:0/2467829278 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f71300afe70 0x7f71301421d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:59.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.939+0000 7f712dd9b640 1 -- 172.21.15.53:0/2467829278 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71300c9fa0 msgr2=0x7f713014ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:08:59.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.939+0000 7f712dd9b640 1 --2- 172.21.15.53:0/2467829278 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71300c9fa0 0x7f713014ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:08:59.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.939+0000 7f712dd9b640 1 -- 172.21.15.53:0/2467829278 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7128009a70 con 0x7f71300c82a0 2023-06-10T19:08:59.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.939+0000 7f712ed9d640 1 --2- 172.21.15.53:0/2467829278 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71300c9fa0 0x7f713014ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:08:59.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.939+0000 7f712dd9b640 1 --2- 172.21.15.53:0/2467829278 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71300c82a0 0x7f71300bf140 secure :-1 s=READY pgs=2706 cs=0 l=1 rev1=1 crypto rx=0x7f712400c530 tx=0x7f712400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:59.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.939+0000 7f711effd640 1 -- 172.21.15.53:0/2467829278 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7124005220 con 0x7f71300c82a0 2023-06-10T19:08:59.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.939+0000 7f711effd640 1 -- 172.21.15.53:0/2467829278 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7124005380 con 0x7f71300c82a0 2023-06-10T19:08:59.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.939+0000 7f711effd640 1 -- 172.21.15.53:0/2467829278 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7124007270 con 0x7f71300c82a0 2023-06-10T19:08:59.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.943+0000 7f7134e4e640 1 -- 172.21.15.53:0/2467829278 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71300bf920 con 0x7f71300c82a0 2023-06-10T19:08:59.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.943+0000 7f7134e4e640 1 -- 172.21.15.53:0/2467829278 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71300bfee0 con 0x7f71300c82a0 2023-06-10T19:08:59.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.943+0000 7f7134e4e640 1 -- 172.21.15.53:0/2467829278 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7130155dd0 con 0x7f71300c82a0 2023-06-10T19:08:59.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.943+0000 7f711effd640 1 -- 172.21.15.53:0/2467829278 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f71240073d0 con 0x7f71300c82a0 2023-06-10T19:08:59.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.943+0000 7f711effd640 1 --2- 172.21.15.53:0/2467829278 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7110066280 0x7f7110068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:08:59.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.943+0000 7f711effd640 1 -- 172.21.15.53:0/2467829278 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6192+0+0 (secure 0 0 0) 0x7f7124083660 con 0x7f71300c82a0 2023-06-10T19:08:59.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.943+0000 7f712e59c640 1 --2- 172.21.15.53:0/2467829278 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7110066280 0x7f7110068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:08:59.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.943+0000 7f712e59c640 1 --2- 172.21.15.53:0/2467829278 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7110066280 0x7f7110068730 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f71200011f0 tx=0x7f7120009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:08:59.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:08:59.947+0000 7f711effd640 1 -- 172.21.15.53:0/2467829278 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7124050a70 con 0x7f71300c82a0 2023-06-10T19:09:00.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.103+0000 7f7134e4e640 1 -- 172.21.15.53:0/2467829278 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f71300b3ad0 con 0x7f71300c82a0 2023-06-10T19:09:00.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.103+0000 7f711effd640 1 -- 172.21.15.53:0/2467829278 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v183) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7124054090 con 0x7f71300c82a0 2023-06-10T19:09:00.111 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 8 2023-06-10T19:09:00.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.107+0000 7f7134e4e640 1 -- 172.21.15.53:0/2467829278 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7110066280 msgr2=0x7f7110068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:00.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.107+0000 7f7134e4e640 1 --2- 172.21.15.53:0/2467829278 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7110066280 0x7f7110068730 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f71200011f0 tx=0x7f7120009040 comp rx=0 tx=0).stop 2023-06-10T19:09:00.112 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.107+0000 7f7134e4e640 1 -- 172.21.15.53:0/2467829278 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71300c82a0 msgr2=0x7f71300bf140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:00.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.107+0000 7f7134e4e640 1 --2- 172.21.15.53:0/2467829278 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71300c82a0 0x7f71300bf140 secure :-1 s=READY pgs=2706 cs=0 l=1 rev1=1 crypto rx=0x7f712400c530 tx=0x7f712400c9f0 comp rx=0 tx=0).stop 2023-06-10T19:09:00.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.107+0000 7f7134e4e640 1 -- 172.21.15.53:0/2467829278 shutdown_connections 2023-06-10T19:09:00.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.107+0000 7f7134e4e640 1 --2- 172.21.15.53:0/2467829278 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f7110066280 0x7f7110068730 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:00.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.107+0000 7f7134e4e640 1 --2- 172.21.15.53:0/2467829278 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f71300c9fa0 0x7f713014ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:00.113 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.107+0000 7f7134e4e640 1 --2- 172.21.15.53:0/2467829278 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f71300c82a0 0x7f71300bf140 unknown :-1 s=CLOSED pgs=2706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:00.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.107+0000 7f7134e4e640 1 --2- 172.21.15.53:0/2467829278 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f71300afe70 0x7f71301421d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:00.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.107+0000 7f7134e4e640 1 -- 172.21.15.53:0/2467829278 >> 172.21.15.53:0/2467829278 conn(0x7f713006a0e0 msgr2=0x7f7130154e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:09:00.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.107+0000 7f7134e4e640 1 -- 172.21.15.53:0/2467829278 shutdown_connections 2023-06-10T19:09:00.114 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.107+0000 7f7134e4e640 1 -- 172.21.15.53:0/2467829278 wait complete. 2023-06-10T19:09:00.129 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-10T19:09:00.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.255+0000 7f2e98015640 1 Processor -- start 2023-06-10T19:09:00.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.255+0000 7f2e98015640 1 -- start start 2023-06-10T19:09:00.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.255+0000 7f2e98015640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e900affc0 0x7f2e900b0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:00.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.255+0000 7f2e98015640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f2e90070500 0x7f2e90070940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:00.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.255+0000 7f2e98015640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e9006fa60 con 0x7f2e90157cf0 2023-06-10T19:09:00.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.255+0000 7f2e98015640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e900cae00 con 0x7f2e90070500 2023-06-10T19:09:00.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.255+0000 7f2e98015640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e900b0980 con 0x7f2e900affc0 2023-06-10T19:09:00.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.255+0000 7f2e95db1640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f2e90157cf0 0x7f2e900ca6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.53:39352/0 (socket says 172.21.15.53:39352) 2023-06-10T19:09:00.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.255+0000 7f2e95db1640 1 -- 172.21.15.53:0/1962337805 learned_addr learned my addr 172.21.15.53:0/1962337805 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:09:00.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.255+0000 7f2e955b0640 1 --2- 172.21.15.53:0/1962337805 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e900affc0 0x7f2e900b0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:00.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.255+0000 7f2e965b2640 1 --2- 172.21.15.53:0/1962337805 >> v2:172.21.15.117:3300/0 conn(0x7f2e90070500 0x7f2e90070940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:00.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.255+0000 7f2e94daf640 1 -- 172.21.15.53:0/1962337805 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 856049311 0 0) 0x7f2e9006fa60 con 0x7f2e90157cf0 2023-06-10T19:09:00.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.255+0000 7f2e94daf640 1 -- 172.21.15.53:0/1962337805 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e7c003530 con 0x7f2e90157cf0 2023-06-10T19:09:00.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.255+0000 7f2e965b2640 1 -- 172.21.15.53:0/1962337805 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e900affc0 msgr2=0x7f2e900b0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:09:00.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.255+0000 7f2e965b2640 1 --2- 172.21.15.53:0/1962337805 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e900affc0 0x7f2e900b0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:00.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.255+0000 7f2e965b2640 1 -- 172.21.15.53:0/1962337805 >> v1:172.21.15.117:6789/0 conn(0x7f2e90157cf0 legacy=0x7f2e900ca6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:00.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.255+0000 7f2e965b2640 1 -- 172.21.15.53:0/1962337805 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e9006a340 con 0x7f2e90070500 2023-06-10T19:09:00.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.255+0000 7f2e955b0640 1 --2- 172.21.15.53:0/1962337805 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e900affc0 0x7f2e900b0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-10T19:09:00.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.259+0000 7f2e965b2640 1 --2- 172.21.15.53:0/1962337805 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e90070500 0x7f2e90070940 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c0097c0 tx=0x7f2e8c01c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=467a361e69068f35 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:00.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.259+0000 7f2e94daf640 1 -- 172.21.15.53:0/1962337805 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c0ab600 con 0x7f2e90070500 2023-06-10T19:09:00.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.259+0000 7f2e94daf640 1 -- 172.21.15.53:0/1962337805 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e8c0ab760 con 0x7f2e90070500 2023-06-10T19:09:00.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.259+0000 7f2e94daf640 1 -- 172.21.15.53:0/1962337805 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c0abad0 con 0x7f2e90070500 2023-06-10T19:09:00.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.259+0000 7f2e98015640 1 -- 172.21.15.53:0/1962337805 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e90070500 msgr2=0x7f2e90070940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:00.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.259+0000 7f2e98015640 1 --2- 172.21.15.53:0/1962337805 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e90070500 0x7f2e90070940 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c0097c0 tx=0x7f2e8c01c480 comp rx=0 tx=0).stop 2023-06-10T19:09:00.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.259+0000 7f2e98015640 1 -- 172.21.15.53:0/1962337805 shutdown_connections 2023-06-10T19:09:00.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.259+0000 7f2e98015640 1 --2- 172.21.15.53:0/1962337805 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e90070500 0x7f2e90070940 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:00.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.259+0000 7f2e98015640 1 --2- 172.21.15.53:0/1962337805 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e900affc0 0x7f2e900b0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:00.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.259+0000 7f2e98015640 1 -- 172.21.15.53:0/1962337805 >> 172.21.15.53:0/1962337805 conn(0x7f2e900cafc0 msgr2=0x7f2e900cb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:09:00.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.259+0000 7f2e98015640 1 -- 172.21.15.53:0/1962337805 shutdown_connections 2023-06-10T19:09:00.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.259+0000 7f2e98015640 1 -- 172.21.15.53:0/1962337805 wait complete. 2023-06-10T19:09:00.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.263+0000 7f2e98015640 1 Processor -- start 2023-06-10T19:09:00.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.263+0000 7f2e98015640 1 -- start start 2023-06-10T19:09:00.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.263+0000 7f2e98015640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e90070500 0x7f2e900b1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:00.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.263+0000 7f2e98015640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e900affc0 0x7f2e900c7c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:00.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.263+0000 7f2e98015640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e90157cf0 0x7f2e90140910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:00.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.263+0000 7f2e98015640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e900c45a0 con 0x7f2e900affc0 2023-06-10T19:09:00.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.263+0000 7f2e98015640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e900c49c0 con 0x7f2e90157cf0 2023-06-10T19:09:00.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.263+0000 7f2e98015640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e900c3c00 con 0x7f2e90070500 2023-06-10T19:09:00.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.263+0000 7f2e955b0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e900affc0 0x7f2e900c7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:00.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.263+0000 7f2e955b0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e900affc0 0x7f2e900c7c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42342/0 (socket says 172.21.15.53:42342) 2023-06-10T19:09:00.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.263+0000 7f2e955b0640 1 -- 172.21.15.53:0/3823742183 learned_addr learned my addr 172.21.15.53:0/3823742183 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:09:00.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.263+0000 7f2e95db1640 1 --2- 172.21.15.53:0/3823742183 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e90070500 0x7f2e900b1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:00.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.263+0000 7f2e965b2640 1 --2- 172.21.15.53:0/3823742183 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e90157cf0 0x7f2e90140910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:00.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.263+0000 7f2e955b0640 1 -- 172.21.15.53:0/3823742183 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e90070500 msgr2=0x7f2e900b1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:00.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.263+0000 7f2e955b0640 1 --2- 172.21.15.53:0/3823742183 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e90070500 0x7f2e900b1390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:00.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.263+0000 7f2e955b0640 1 -- 172.21.15.53:0/3823742183 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e90157cf0 msgr2=0x7f2e90140910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:00.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.263+0000 7f2e955b0640 1 --2- 172.21.15.53:0/3823742183 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e90157cf0 0x7f2e90140910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:00.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.263+0000 7f2e955b0640 1 -- 172.21.15.53:0/3823742183 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e84009420 con 0x7f2e900affc0 2023-06-10T19:09:00.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.263+0000 7f2e965b2640 1 --2- 172.21.15.53:0/3823742183 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e90157cf0 0x7f2e90140910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:09:00.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.263+0000 7f2e955b0640 1 --2- 172.21.15.53:0/3823742183 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e900affc0 0x7f2e900c7c80 secure :-1 s=READY pgs=2707 cs=0 l=1 rev1=1 crypto rx=0x7f2e8400ebe0 tx=0x7f2e8400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:00.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.263+0000 7f2e827fc640 1 -- 172.21.15.53:0/3823742183 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8400eee0 con 0x7f2e900affc0 2023-06-10T19:09:00.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.263+0000 7f2e827fc640 1 -- 172.21.15.53:0/3823742183 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e8400cc30 con 0x7f2e900affc0 2023-06-10T19:09:00.272 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.263+0000 7f2e98015640 1 -- 172.21.15.53:0/3823742183 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e8c009420 con 0x7f2e900affc0 2023-06-10T19:09:00.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.263+0000 7f2e827fc640 1 -- 172.21.15.53:0/3823742183 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e84013470 con 0x7f2e900affc0 2023-06-10T19:09:00.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.263+0000 7f2e98015640 1 -- 172.21.15.53:0/3823742183 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e900c41c0 con 0x7f2e900affc0 2023-06-10T19:09:00.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.263+0000 7f2e98015640 1 -- 172.21.15.53:0/3823742183 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e9004d790 con 0x7f2e900affc0 2023-06-10T19:09:00.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.267+0000 7f2e827fc640 1 -- 172.21.15.53:0/3823742183 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2e840135d0 con 0x7f2e900affc0 2023-06-10T19:09:00.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.267+0000 7f2e827fc640 1 --2- 172.21.15.53:0/3823742183 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2e74066280 0x7f2e74068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:00.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.267+0000 7f2e827fc640 1 -- 172.21.15.53:0/3823742183 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6192+0+0 (secure 0 0 0) 0x7f2e84083f90 con 0x7f2e900affc0 2023-06-10T19:09:00.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.267+0000 7f2e95db1640 1 --2- 172.21.15.53:0/3823742183 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2e74066280 0x7f2e74068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:00.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.267+0000 7f2e95db1640 1 --2- 172.21.15.53:0/3823742183 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2e74066280 0x7f2e74068730 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f2e88001570 tx=0x7f2e88001a00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:00.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.271+0000 7f2e827fc640 1 -- 172.21.15.53:0/3823742183 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2e840b4700 con 0x7f2e900affc0 2023-06-10T19:09:00.429 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.423+0000 7f2e98015640 1 -- 172.21.15.53:0/3823742183 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2e900b44c0 con 0x7f2e900affc0 2023-06-10T19:09:00.430 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.423+0000 7f2e827fc640 1 -- 172.21.15.53:0/3823742183 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v183) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2e84017020 con 0x7f2e900affc0 2023-06-10T19:09:00.431 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 32 2023-06-10T19:09:00.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.427+0000 7f2e98015640 1 -- 172.21.15.53:0/3823742183 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2e74066280 msgr2=0x7f2e74068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:00.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.427+0000 7f2e98015640 1 --2- 172.21.15.53:0/3823742183 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2e74066280 0x7f2e74068730 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f2e88001570 tx=0x7f2e88001a00 comp rx=0 tx=0).stop 2023-06-10T19:09:00.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.427+0000 7f2e98015640 1 -- 172.21.15.53:0/3823742183 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e900affc0 msgr2=0x7f2e900c7c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:00.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.427+0000 7f2e98015640 1 --2- 172.21.15.53:0/3823742183 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e900affc0 0x7f2e900c7c80 secure :-1 s=READY pgs=2707 cs=0 l=1 rev1=1 crypto rx=0x7f2e8400ebe0 tx=0x7f2e8400c520 comp rx=0 tx=0).stop 2023-06-10T19:09:00.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.427+0000 7f2e98015640 1 -- 172.21.15.53:0/3823742183 shutdown_connections 2023-06-10T19:09:00.433 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.427+0000 7f2e98015640 1 --2- 172.21.15.53:0/3823742183 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2e74066280 0x7f2e74068730 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:00.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.427+0000 7f2e98015640 1 --2- 172.21.15.53:0/3823742183 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e90157cf0 0x7f2e90140910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:00.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.427+0000 7f2e98015640 1 --2- 172.21.15.53:0/3823742183 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e900affc0 0x7f2e900c7c80 unknown :-1 s=CLOSED pgs=2707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:00.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.427+0000 7f2e98015640 1 --2- 172.21.15.53:0/3823742183 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e90070500 0x7f2e900b1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:00.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.427+0000 7f2e98015640 1 -- 172.21.15.53:0/3823742183 >> 172.21.15.53:0/3823742183 conn(0x7f2e900cafc0 msgr2=0x7f2e90153670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:09:00.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.427+0000 7f2e98015640 1 -- 172.21.15.53:0/3823742183 shutdown_connections 2023-06-10T19:09:00.434 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.427+0000 7f2e98015640 1 -- 172.21.15.53:0/3823742183 wait complete. 2023-06-10T19:09:00.450 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-10T19:09:00.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.571+0000 7fc6ec263640 1 Processor -- start 2023-06-10T19:09:00.575 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.571+0000 7fc6ec263640 1 -- start start 2023-06-10T19:09:00.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.571+0000 7fc6ec263640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc6e41558e0 0x7fc6e40c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:00.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.571+0000 7fc6ec263640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc6e4158f40 0x7fc6e40cb820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:00.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.571+0000 7fc6ec263640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6e40cbd60 0x7fc6e406b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:00.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.571+0000 7fc6ec263640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6e406c230 con 0x7fc6e41558e0 2023-06-10T19:09:00.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.571+0000 7fc6ec263640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6e406ca40 con 0x7fc6e4158f40 2023-06-10T19:09:00.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.571+0000 7fc6ec263640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e4155cb0 con 0x7fc6e40cbd60 2023-06-10T19:09:00.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.571+0000 7fc6e9fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc6e41558e0 0x7fc6e40c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:00.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.571+0000 7fc6e9fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc6e41558e0 0x7fc6e40c82a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42346/0 (socket says 172.21.15.53:42346) 2023-06-10T19:09:00.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.571+0000 7fc6e9fff640 1 -- 172.21.15.53:0/655776639 learned_addr learned my addr 172.21.15.53:0/655776639 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:09:00.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.571+0000 7fc6ea800640 1 --2- 172.21.15.53:0/655776639 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6e40cbd60 0x7fc6e406b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:00.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.571+0000 7fc6e97fe640 1 --2- 172.21.15.53:0/655776639 >> v2:172.21.15.117:3300/0 conn(0x7fc6e4158f40 0x7fc6e40cb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:00.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.571+0000 7fc6e9fff640 1 -- 172.21.15.53:0/655776639 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6e40cbd60 msgr2=0x7fc6e406b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:09:00.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.571+0000 7fc6e9fff640 1 --2- 172.21.15.53:0/655776639 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6e40cbd60 0x7fc6e406b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:00.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.571+0000 7fc6e9fff640 1 -- 172.21.15.53:0/655776639 >> v2:172.21.15.117:3300/0 conn(0x7fc6e4158f40 msgr2=0x7fc6e40cb820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:09:00.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.571+0000 7fc6e9fff640 1 --2- 172.21.15.53:0/655776639 >> v2:172.21.15.117:3300/0 conn(0x7fc6e4158f40 0x7fc6e40cb820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:00.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.571+0000 7fc6e9fff640 1 -- 172.21.15.53:0/655776639 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6e406c480 con 0x7fc6e41558e0 2023-06-10T19:09:00.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.575+0000 7fc6e9fff640 1 --2- 172.21.15.53:0/655776639 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6e41558e0 0x7fc6e40c82a0 secure :-1 s=READY pgs=2708 cs=0 l=1 rev1=1 crypto rx=0x7fc6e40b3c10 tx=0x7fc6e001c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a4862b8a37297af server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:00.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.575+0000 7fc6e8ffd640 1 -- 172.21.15.53:0/655776639 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e00ac640 con 0x7fc6e41558e0 2023-06-10T19:09:00.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.575+0000 7fc6e8ffd640 1 -- 172.21.15.53:0/655776639 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6e00ac7a0 con 0x7fc6e41558e0 2023-06-10T19:09:00.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.575+0000 7fc6e8ffd640 1 -- 172.21.15.53:0/655776639 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e00acb30 con 0x7fc6e41558e0 2023-06-10T19:09:00.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.575+0000 7fc6ec263640 1 -- 172.21.15.53:0/655776639 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6e41558e0 msgr2=0x7fc6e40c82a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:00.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.575+0000 7fc6ec263640 1 --2- 172.21.15.53:0/655776639 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6e41558e0 0x7fc6e40c82a0 secure :-1 s=READY pgs=2708 cs=0 l=1 rev1=1 crypto rx=0x7fc6e40b3c10 tx=0x7fc6e001c3b0 comp rx=0 tx=0).stop 2023-06-10T19:09:00.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.575+0000 7fc6ec263640 1 -- 172.21.15.53:0/655776639 shutdown_connections 2023-06-10T19:09:00.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.575+0000 7fc6ec263640 1 --2- 172.21.15.53:0/655776639 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6e40cbd60 0x7fc6e406b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:00.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.575+0000 7fc6ec263640 1 --2- 172.21.15.53:0/655776639 >> v2:172.21.15.117:3300/0 conn(0x7fc6e4158f40 0x7fc6e40cb820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:00.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.575+0000 7fc6ec263640 1 --2- 172.21.15.53:0/655776639 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6e41558e0 0x7fc6e40c82a0 unknown :-1 s=CLOSED pgs=2708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:00.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.575+0000 7fc6ec263640 1 -- 172.21.15.53:0/655776639 >> 172.21.15.53:0/655776639 conn(0x7fc6e406a0e0 msgr2=0x7fc6e40cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:09:00.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.575+0000 7fc6ec263640 1 -- 172.21.15.53:0/655776639 shutdown_connections 2023-06-10T19:09:00.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.575+0000 7fc6ec263640 1 -- 172.21.15.53:0/655776639 wait complete. 2023-06-10T19:09:00.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.575+0000 7fc6ec263640 1 Processor -- start 2023-06-10T19:09:00.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.575+0000 7fc6ec263640 1 -- start start 2023-06-10T19:09:00.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.575+0000 7fc6ec263640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6e40cbd60 0x7fc6e4160df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:00.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.575+0000 7fc6ec263640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6e41558e0 0x7fc6e4147b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:00.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.575+0000 7fc6ec263640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6e4158f40 0x7fc6e4146d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:00.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.575+0000 7fc6ec263640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e406f4a0 con 0x7fc6e40cbd60 2023-06-10T19:09:00.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.575+0000 7fc6ec263640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e41616f0 con 0x7fc6e4158f40 2023-06-10T19:09:00.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.575+0000 7fc6ec263640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e41619d0 con 0x7fc6e41558e0 2023-06-10T19:09:00.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.575+0000 7fc6e9fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6e40cbd60 0x7fc6e4160df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:00.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.575+0000 7fc6e9fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6e40cbd60 0x7fc6e4160df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42352/0 (socket says 172.21.15.53:42352) 2023-06-10T19:09:00.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.575+0000 7fc6e9fff640 1 -- 172.21.15.53:0/2337236059 learned_addr learned my addr 172.21.15.53:0/2337236059 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:09:00.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.575+0000 7fc6e97fe640 1 --2- 172.21.15.53:0/2337236059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6e41558e0 0x7fc6e4147b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:00.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.575+0000 7fc6ea800640 1 --2- 172.21.15.53:0/2337236059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6e4158f40 0x7fc6e4146d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:00.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.575+0000 7fc6e9fff640 1 -- 172.21.15.53:0/2337236059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6e41558e0 msgr2=0x7fc6e4147b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:00.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.575+0000 7fc6e9fff640 1 --2- 172.21.15.53:0/2337236059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6e41558e0 0x7fc6e4147b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:00.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.575+0000 7fc6e9fff640 1 -- 172.21.15.53:0/2337236059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6e4158f40 msgr2=0x7fc6e4146d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:00.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.575+0000 7fc6e9fff640 1 --2- 172.21.15.53:0/2337236059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6e4158f40 0x7fc6e4146d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:00.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.575+0000 7fc6e9fff640 1 -- 172.21.15.53:0/2337236059 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6e00094d0 con 0x7fc6e40cbd60 2023-06-10T19:09:00.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.575+0000 7fc6ea800640 1 --2- 172.21.15.53:0/2337236059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6e4158f40 0x7fc6e4146d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:09:00.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.575+0000 7fc6e9fff640 1 --2- 172.21.15.53:0/2337236059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6e40cbd60 0x7fc6e4160df0 secure :-1 s=READY pgs=2709 cs=0 l=1 rev1=1 crypto rx=0x7fc6e00af040 tx=0x7fc6e0019150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:00.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.575+0000 7fc6d67fc640 1 -- 172.21.15.53:0/2337236059 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e00b5640 con 0x7fc6e40cbd60 2023-06-10T19:09:00.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.575+0000 7fc6d67fc640 1 -- 172.21.15.53:0/2337236059 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6e00b57a0 con 0x7fc6e40cbd60 2023-06-10T19:09:00.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.575+0000 7fc6ec263640 1 -- 172.21.15.53:0/2337236059 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6e4161cb0 con 0x7fc6e40cbd60 2023-06-10T19:09:00.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.579+0000 7fc6d67fc640 1 -- 172.21.15.53:0/2337236059 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e00b5b30 con 0x7fc6e40cbd60 2023-06-10T19:09:00.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.579+0000 7fc6ec263640 1 -- 172.21.15.53:0/2337236059 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6e4161330 con 0x7fc6e40cbd60 2023-06-10T19:09:00.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.579+0000 7fc6ec263640 1 -- 172.21.15.53:0/2337236059 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6e41614c0 con 0x7fc6e40cbd60 2023-06-10T19:09:00.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.579+0000 7fc6d67fc640 1 -- 172.21.15.53:0/2337236059 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc6e00b3070 con 0x7fc6e40cbd60 2023-06-10T19:09:00.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.579+0000 7fc6d67fc640 1 --2- 172.21.15.53:0/2337236059 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc6c8066280 0x7fc6c8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:00.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.579+0000 7fc6d67fc640 1 -- 172.21.15.53:0/2337236059 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6192+0+0 (secure 0 0 0) 0x7fc6e011df40 con 0x7fc6e40cbd60 2023-06-10T19:09:00.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.579+0000 7fc6e97fe640 1 --2- 172.21.15.53:0/2337236059 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc6c8066280 0x7fc6c8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:00.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.579+0000 7fc6e97fe640 1 --2- 172.21.15.53:0/2337236059 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc6c8066280 0x7fc6c8068730 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7fc6e415b110 tx=0x7fc6d8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:00.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.583+0000 7fc6d67fc640 1 -- 172.21.15.53:0/2337236059 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc6e00eb460 con 0x7fc6e40cbd60 2023-06-10T19:09:00.741 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.735+0000 7fc6ec263640 1 -- 172.21.15.53:0/2337236059 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc6e404d790 con 0x7fc6e40cbd60 2023-06-10T19:09:00.742 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.735+0000 7fc6d67fc640 1 -- 172.21.15.53:0/2337236059 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v183) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc6e00b9020 con 0x7fc6e40cbd60 2023-06-10T19:09:00.742 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 64 2023-06-10T19:09:00.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.739+0000 7fc6ec263640 1 -- 172.21.15.53:0/2337236059 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc6c8066280 msgr2=0x7fc6c8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:00.744 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.739+0000 7fc6ec263640 1 --2- 172.21.15.53:0/2337236059 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc6c8066280 0x7fc6c8068730 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7fc6e415b110 tx=0x7fc6d8008040 comp rx=0 tx=0).stop 2023-06-10T19:09:00.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.739+0000 7fc6ec263640 1 -- 172.21.15.53:0/2337236059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6e40cbd60 msgr2=0x7fc6e4160df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:00.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.739+0000 7fc6ec263640 1 --2- 172.21.15.53:0/2337236059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6e40cbd60 0x7fc6e4160df0 secure :-1 s=READY pgs=2709 cs=0 l=1 rev1=1 crypto rx=0x7fc6e00af040 tx=0x7fc6e0019150 comp rx=0 tx=0).stop 2023-06-10T19:09:00.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.739+0000 7fc6ec263640 1 -- 172.21.15.53:0/2337236059 shutdown_connections 2023-06-10T19:09:00.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.739+0000 7fc6ec263640 1 --2- 172.21.15.53:0/2337236059 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc6c8066280 0x7fc6c8068730 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:00.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.739+0000 7fc6ec263640 1 --2- 172.21.15.53:0/2337236059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6e4158f40 0x7fc6e4146d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:00.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.739+0000 7fc6ec263640 1 --2- 172.21.15.53:0/2337236059 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc6e41558e0 0x7fc6e4147b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:00.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.739+0000 7fc6ec263640 1 --2- 172.21.15.53:0/2337236059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6e40cbd60 0x7fc6e4160df0 unknown :-1 s=CLOSED pgs=2709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:00.745 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.739+0000 7fc6ec263640 1 -- 172.21.15.53:0/2337236059 >> 172.21.15.53:0/2337236059 conn(0x7fc6e406a0e0 msgr2=0x7fc6e414afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:09:00.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.739+0000 7fc6ec263640 1 -- 172.21.15.53:0/2337236059 shutdown_connections 2023-06-10T19:09:00.746 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.739+0000 7fc6ec263640 1 -- 172.21.15.53:0/2337236059 wait complete. 2023-06-10T19:09:00.761 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:09:00.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.867+0000 7f04f6cda640 1 Processor -- start 2023-06-10T19:09:00.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.867+0000 7f04f6cda640 1 -- start start 2023-06-10T19:09:00.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.871+0000 7f04f6cda640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f04f00c9840 0x7f04f00c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:00.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.871+0000 7f04f6cda640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04f006b090 0x7f04f006b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:00.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.871+0000 7f04f6cda640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04f0159b50 con 0x7f04f0071060 2023-06-10T19:09:00.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.871+0000 7f04f6cda640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04f00ca150 con 0x7f04f00c9840 2023-06-10T19:09:00.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.871+0000 7f04f6cda640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04f00702a0 con 0x7f04f006b090 2023-06-10T19:09:00.876 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.871+0000 7f04effff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f04f0071060 0x7f04f00af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56862/0 (socket says 172.21.15.53:56862) 2023-06-10T19:09:00.877 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.871+0000 7f04effff640 1 -- 172.21.15.53:0/1830426962 learned_addr learned my addr 172.21.15.53:0/1830426962 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:09:00.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.871+0000 7f04f5277640 1 --2- 172.21.15.53:0/1830426962 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04f006b090 0x7f04f006b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:00.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.871+0000 7f04f4a76640 1 --2- 172.21.15.53:0/1830426962 >> v2:172.21.15.117:3300/0 conn(0x7f04f00c9840 0x7f04f00c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:00.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.871+0000 7f04ef7fe640 1 -- 172.21.15.53:0/1830426962 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1416971531 0 0) 0x7f04f0159b50 con 0x7f04f0071060 2023-06-10T19:09:00.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.871+0000 7f04ef7fe640 1 -- 172.21.15.53:0/1830426962 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04d8003530 con 0x7f04f0071060 2023-06-10T19:09:00.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.871+0000 7f04ef7fe640 1 -- 172.21.15.53:0/1830426962 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4208751697 0 0) 0x7f04d8003530 con 0x7f04f0071060 2023-06-10T19:09:00.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.871+0000 7f04ef7fe640 1 -- 172.21.15.53:0/1830426962 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04f006b090 msgr2=0x7f04f006b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:09:00.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.871+0000 7f04ef7fe640 1 --2- 172.21.15.53:0/1830426962 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04f006b090 0x7f04f006b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:00.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.871+0000 7f04ef7fe640 1 -- 172.21.15.53:0/1830426962 >> v2:172.21.15.117:3300/0 conn(0x7f04f00c9840 msgr2=0x7f04f00c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:09:00.879 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.871+0000 7f04ef7fe640 1 --2- 172.21.15.53:0/1830426962 >> v2:172.21.15.117:3300/0 conn(0x7f04f00c9840 0x7f04f00c9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:00.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.871+0000 7f04ef7fe640 1 -- 172.21.15.53:0/1830426962 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f0070580 con 0x7f04f0071060 2023-06-10T19:09:00.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.871+0000 7f04ef7fe640 1 -- 172.21.15.53:0/1830426962 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f04e4001680 con 0x7f04f0071060 2023-06-10T19:09:00.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.871+0000 7f04ef7fe640 1 -- 172.21.15.53:0/1830426962 >> v1:172.21.15.53:6789/0 conn(0x7f04f0071060 legacy=0x7f04f00af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:00.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.871+0000 7f04ef7fe640 1 --2- 172.21.15.53:0/1830426962 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04d80039f0 0x7f04d8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:00.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.871+0000 7f04ef7fe640 1 --2- 172.21.15.53:0/1830426962 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04d80047d0 0x7f04d8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:00.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.871+0000 7f04ef7fe640 1 --2- 172.21.15.53:0/1830426962 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04f006b090 0x7f04d8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:00.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.871+0000 7f04ef7fe640 1 -- 172.21.15.53:0/1830426962 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f00ca150 con 0x7f04d80047d0 2023-06-10T19:09:00.880 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.871+0000 7f04ef7fe640 1 -- 172.21.15.53:0/1830426962 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f00702a0 con 0x7f04d80039f0 2023-06-10T19:09:00.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.871+0000 7f04ef7fe640 1 -- 172.21.15.53:0/1830426962 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04d800b990 con 0x7f04f006b090 2023-06-10T19:09:00.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.871+0000 7f04effff640 1 --2- 172.21.15.53:0/1830426962 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04d80047d0 0x7f04d8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:00.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.871+0000 7f04f4a76640 1 --2- 172.21.15.53:0/1830426962 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04d80039f0 0x7f04d8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:00.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.871+0000 7f04f5277640 1 --2- 172.21.15.53:0/1830426962 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04f006b090 0x7f04d8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:00.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.871+0000 7f04effff640 1 -- 172.21.15.53:0/1830426962 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04f006b090 msgr2=0x7f04d8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:09:00.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.871+0000 7f04effff640 1 --2- 172.21.15.53:0/1830426962 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04f006b090 0x7f04d8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:00.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.871+0000 7f04effff640 1 -- 172.21.15.53:0/1830426962 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04d80039f0 msgr2=0x7f04d8003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:09:00.881 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.871+0000 7f04effff640 1 --2- 172.21.15.53:0/1830426962 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04d80039f0 0x7f04d8003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:00.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.871+0000 7f04effff640 1 -- 172.21.15.53:0/1830426962 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04d8003530 con 0x7f04d80047d0 2023-06-10T19:09:00.882 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.871+0000 7f04f5277640 1 --2- 172.21.15.53:0/1830426962 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04f006b090 0x7f04d8005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:09:00.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.875+0000 7f04effff640 1 --2- 172.21.15.53:0/1830426962 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04d80047d0 0x7f04d8004c40 secure :-1 s=READY pgs=2711 cs=0 l=1 rev1=1 crypto rx=0x7f04e400c210 tx=0x7f04e401f390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2256beb450ab6c8 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:00.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.875+0000 7f04ef7fe640 1 -- 172.21.15.53:0/1830426962 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e4005ae0 con 0x7f04d80047d0 2023-06-10T19:09:00.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.875+0000 7f04ef7fe640 1 -- 172.21.15.53:0/1830426962 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04e40ab070 con 0x7f04d80047d0 2023-06-10T19:09:00.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.875+0000 7f04ef7fe640 1 -- 172.21.15.53:0/1830426962 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e4007070 con 0x7f04d80047d0 2023-06-10T19:09:00.884 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.875+0000 7f04f6cda640 1 -- 172.21.15.53:0/1830426962 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04d80047d0 msgr2=0x7f04d8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:00.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.875+0000 7f04f6cda640 1 --2- 172.21.15.53:0/1830426962 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04d80047d0 0x7f04d8004c40 secure :-1 s=READY pgs=2711 cs=0 l=1 rev1=1 crypto rx=0x7f04e400c210 tx=0x7f04e401f390 comp rx=0 tx=0).stop 2023-06-10T19:09:00.885 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.875+0000 7f04f5277640 1 -- 172.21.15.53:0/1830426962 reap_dead start 2023-06-10T19:09:00.886 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.875+0000 7f04f6cda640 1 -- 172.21.15.53:0/1830426962 shutdown_connections 2023-06-10T19:09:00.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.875+0000 7f04f6cda640 1 -- 172.21.15.53:0/1830426962 >> 172.21.15.53:0/1830426962 conn(0x7f04f006a0d0 msgr2=0x7f04f00ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:09:00.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.875+0000 7f04f6cda640 1 -- 172.21.15.53:0/1830426962 shutdown_connections 2023-06-10T19:09:00.887 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.875+0000 7f04f6cda640 1 -- 172.21.15.53:0/1830426962 wait complete. 2023-06-10T19:09:00.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.875+0000 7f04f6cda640 1 Processor -- start 2023-06-10T19:09:00.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.875+0000 7f04f6cda640 1 -- start start 2023-06-10T19:09:00.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.875+0000 7f04f6cda640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04d80047d0 0x7f04f00c7670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:00.888 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.875+0000 7f04f6cda640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04f00b0d80 0x7f04f00ac2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:00.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.875+0000 7f04f6cda640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04f00b11d0 0x7f04f00ac820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:00.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.875+0000 7f04f6cda640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f00c7bb0 con 0x7f04f00b11d0 2023-06-10T19:09:00.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.875+0000 7f04f6cda640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f01459c0 con 0x7f04f00b0d80 2023-06-10T19:09:00.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.875+0000 7f04f6cda640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04f0144db0 con 0x7f04d80047d0 2023-06-10T19:09:00.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.875+0000 7f04f5277640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04f00b11d0 0x7f04f00ac820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:00.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.875+0000 7f04f5277640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04f00b11d0 0x7f04f00ac820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:42380/0 (socket says 172.21.15.53:42380) 2023-06-10T19:09:00.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.875+0000 7f04f5277640 1 -- 172.21.15.53:0/3909349288 learned_addr learned my addr 172.21.15.53:0/3909349288 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:09:00.889 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.875+0000 7f04f4a76640 1 --2- 172.21.15.53:0/3909349288 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04d80047d0 0x7f04f00c7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:00.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.875+0000 7f04effff640 1 --2- 172.21.15.53:0/3909349288 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04f00b0d80 0x7f04f00ac2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:00.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.879+0000 7f04f5277640 1 -- 172.21.15.53:0/3909349288 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04d80047d0 msgr2=0x7f04f00c7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:00.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.879+0000 7f04f5277640 1 --2- 172.21.15.53:0/3909349288 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04d80047d0 0x7f04f00c7670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:00.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.879+0000 7f04f5277640 1 -- 172.21.15.53:0/3909349288 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04f00b0d80 msgr2=0x7f04f00ac2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:00.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.879+0000 7f04f5277640 1 --2- 172.21.15.53:0/3909349288 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04f00b0d80 0x7f04f00ac2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:00.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.879+0000 7f04f5277640 1 -- 172.21.15.53:0/3909349288 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f0145090 con 0x7f04f00b11d0 2023-06-10T19:09:00.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.879+0000 7f04effff640 1 --2- 172.21.15.53:0/3909349288 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04f00b0d80 0x7f04f00ac2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:09:00.890 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.879+0000 7f04f5277640 1 --2- 172.21.15.53:0/3909349288 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04f00b11d0 0x7f04f00ac820 secure :-1 s=READY pgs=2712 cs=0 l=1 rev1=1 crypto rx=0x7f04f00cb600 tx=0x7f04e800f0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:00.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.879+0000 7f04ed7fa640 1 -- 172.21.15.53:0/3909349288 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e800f7b0 con 0x7f04f00b11d0 2023-06-10T19:09:00.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.879+0000 7f04ed7fa640 1 -- 172.21.15.53:0/3909349288 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04e8011040 con 0x7f04f00b11d0 2023-06-10T19:09:00.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.879+0000 7f04f6cda640 1 -- 172.21.15.53:0/3909349288 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04f0145370 con 0x7f04f00b11d0 2023-06-10T19:09:00.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.879+0000 7f04ed7fa640 1 -- 172.21.15.53:0/3909349288 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e800fb30 con 0x7f04f00b11d0 2023-06-10T19:09:00.891 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.879+0000 7f04f6cda640 1 -- 172.21.15.53:0/3909349288 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04f01479f0 con 0x7f04f00b11d0 2023-06-10T19:09:00.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.879+0000 7f04f6cda640 1 -- 172.21.15.53:0/3909349288 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04f004d790 con 0x7f04f00b11d0 2023-06-10T19:09:00.892 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.879+0000 7f04ed7fa640 1 -- 172.21.15.53:0/3909349288 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f04e800fc90 con 0x7f04f00b11d0 2023-06-10T19:09:00.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.879+0000 7f04ed7fa640 1 --2- 172.21.15.53:0/3909349288 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f04dc066280 0x7f04dc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:00.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.879+0000 7f04ed7fa640 1 -- 172.21.15.53:0/3909349288 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6192+0+0 (secure 0 0 0) 0x7f04e8083740 con 0x7f04f00b11d0 2023-06-10T19:09:00.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.879+0000 7f04f4a76640 1 --2- 172.21.15.53:0/3909349288 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f04dc066280 0x7f04dc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:00.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.879+0000 7f04f4a76640 1 --2- 172.21.15.53:0/3909349288 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f04dc066280 0x7f04dc068730 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f04e0009ae0 tx=0x7f04e0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:00.893 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:00.883+0000 7f04ed7fa640 1 -- 172.21.15.53:0/3909349288 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f04e8050b60 con 0x7f04f00b11d0 2023-06-10T19:09:01.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.071+0000 7f04f6cda640 1 -- 172.21.15.53:0/3909349288 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f04f0145b00 con 0x7f04f00b11d0 2023-06-10T19:09:01.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.071+0000 7f04ed7fa640 1 -- 172.21.15.53:0/3909349288 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) v1 ==== 95+0+4688 (secure 0 0 0) 0x7f04e8054180 con 0x7f04f00b11d0 2023-06-10T19:09:01.078 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:09:01.079 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":104,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7835,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2641321206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2641321206},{"type":"v1","addr":"172.21.15.117:6835","nonce":2641321206}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":99},{"gid":8956,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1439696554","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1439696554},{"type":"v1","addr":"172.21.15.117:6837","nonce":1439696554}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":99},{"gid":11112,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/3327528087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3327528087},{"type":"v1","addr":"172.21.15.53:6833","nonce":3327528087}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":99}],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:08:03.514484+0000","modified":"2023-06-10T19:08:06.533495+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":11118},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11118":{"gid":11118,"name":"c","rank":0,"incarnation":100,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/3732323283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":3732323283},{"type":"v1","addr":"172.21.15.53:6835","nonce":3732323283}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":12}]} 2023-06-10T19:09:01.079 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 104 2023-06-10T19:09:01.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.075+0000 7f04f6cda640 1 -- 172.21.15.53:0/3909349288 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f04dc066280 msgr2=0x7f04dc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:01.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.075+0000 7f04f6cda640 1 --2- 172.21.15.53:0/3909349288 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f04dc066280 0x7f04dc068730 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f04e0009ae0 tx=0x7f04e0008040 comp rx=0 tx=0).stop 2023-06-10T19:09:01.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.075+0000 7f04f6cda640 1 -- 172.21.15.53:0/3909349288 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04f00b11d0 msgr2=0x7f04f00ac820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:01.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.075+0000 7f04f6cda640 1 --2- 172.21.15.53:0/3909349288 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04f00b11d0 0x7f04f00ac820 secure :-1 s=READY pgs=2712 cs=0 l=1 rev1=1 crypto rx=0x7f04f00cb600 tx=0x7f04e800f0d0 comp rx=0 tx=0).stop 2023-06-10T19:09:01.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.075+0000 7f04f6cda640 1 -- 172.21.15.53:0/3909349288 shutdown_connections 2023-06-10T19:09:01.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.075+0000 7f04f6cda640 1 --2- 172.21.15.53:0/3909349288 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f04dc066280 0x7f04dc068730 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:01.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.075+0000 7f04f6cda640 1 --2- 172.21.15.53:0/3909349288 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04f00b11d0 0x7f04f00ac820 unknown :-1 s=CLOSED pgs=2712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:01.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.075+0000 7f04f6cda640 1 --2- 172.21.15.53:0/3909349288 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04f00b0d80 0x7f04f00ac2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:01.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.075+0000 7f04f6cda640 1 --2- 172.21.15.53:0/3909349288 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04d80047d0 0x7f04f00c7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:01.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.075+0000 7f04f6cda640 1 -- 172.21.15.53:0/3909349288 >> 172.21.15.53:0/3909349288 conn(0x7f04f006a0d0 msgr2=0x7f04f0157480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:09:01.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.075+0000 7f04f6cda640 1 -- 172.21.15.53:0/3909349288 shutdown_connections 2023-06-10T19:09:01.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.075+0000 7f04f6cda640 1 -- 172.21.15.53:0/3909349288 wait complete. 2023-06-10T19:09:01.098 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:09:01.215 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.211+0000 7fbaf97ea640 1 Processor -- start 2023-06-10T19:09:01.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.211+0000 7fbaf97ea640 1 -- start start 2023-06-10T19:09:01.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.211+0000 7fbaf97ea640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbaf4070f80 0x7fbaf40ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:01.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.211+0000 7fbaf97ea640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbaf40ce990 0x7fbaf4069450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:01.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.211+0000 7fbaf97ea640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaf415f2c0 con 0x7fbaf415eef0 2023-06-10T19:09:01.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.211+0000 7fbaf97ea640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaf415fdc0 con 0x7fbaf4070f80 2023-06-10T19:09:01.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.211+0000 7fbaf97ea640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaf41600a0 con 0x7fbaf40ce990 2023-06-10T19:09:01.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.211+0000 7fbaf2ffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fbaf415eef0 0x7fbaf415f570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56700/0 (socket says 172.21.15.53:56700) 2023-06-10T19:09:01.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.211+0000 7fbaf2ffd640 1 -- 172.21.15.53:0/1408249923 learned_addr learned my addr 172.21.15.53:0/1408249923 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:09:01.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.211+0000 7fbaebfff640 1 --2- 172.21.15.53:0/1408249923 >> v2:172.21.15.53:3300/0 conn(0x7fbaf4070f80 0x7fbaf40ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:01.218 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.211+0000 7fbaf27fc640 1 -- 172.21.15.53:0/1408249923 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2784397888 0 0) 0x7fbaf415f2c0 con 0x7fbaf415eef0 2023-06-10T19:09:01.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.211+0000 7fbaf27fc640 1 -- 172.21.15.53:0/1408249923 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbae0003530 con 0x7fbaf415eef0 2023-06-10T19:09:01.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.211+0000 7fbaf37fe640 1 --2- 172.21.15.53:0/1408249923 >> v2:172.21.15.117:3300/0 conn(0x7fbaf40ce990 0x7fbaf4069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:01.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.211+0000 7fbaebfff640 1 -- 172.21.15.53:0/1408249923 >> v2:172.21.15.117:3300/0 conn(0x7fbaf40ce990 msgr2=0x7fbaf4069450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:09:01.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.211+0000 7fbaebfff640 1 --2- 172.21.15.53:0/1408249923 >> v2:172.21.15.117:3300/0 conn(0x7fbaf40ce990 0x7fbaf4069450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:01.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.211+0000 7fbaebfff640 1 -- 172.21.15.53:0/1408249923 >> v1:172.21.15.53:6789/0 conn(0x7fbaf415eef0 legacy=0x7fbaf415f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:01.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.211+0000 7fbaebfff640 1 -- 172.21.15.53:0/1408249923 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaf4160380 con 0x7fbaf4070f80 2023-06-10T19:09:01.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.211+0000 7fbaf37fe640 1 --2- 172.21.15.53:0/1408249923 >> v2:172.21.15.117:3300/0 conn(0x7fbaf40ce990 0x7fbaf4069450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:09:01.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.215+0000 7fbaebfff640 1 --2- 172.21.15.53:0/1408249923 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbaf4070f80 0x7fbaf40ce450 secure :-1 s=READY pgs=2714 cs=0 l=1 rev1=1 crypto rx=0x7fbaf40c9390 tx=0x7fbadc01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82fb372769d9382b server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:01.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.215+0000 7fbaf27fc640 1 -- 172.21.15.53:0/1408249923 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbadc0ab600 con 0x7fbaf4070f80 2023-06-10T19:09:01.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.215+0000 7fbaf27fc640 1 -- 172.21.15.53:0/1408249923 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbadc0a7050 con 0x7fbaf4070f80 2023-06-10T19:09:01.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.215+0000 7fbaf27fc640 1 -- 172.21.15.53:0/1408249923 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbadc0ab980 con 0x7fbaf4070f80 2023-06-10T19:09:01.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.215+0000 7fbaf97ea640 1 -- 172.21.15.53:0/1408249923 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbaf4070f80 msgr2=0x7fbaf40ce450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:01.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.215+0000 7fbaf97ea640 1 --2- 172.21.15.53:0/1408249923 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbaf4070f80 0x7fbaf40ce450 secure :-1 s=READY pgs=2714 cs=0 l=1 rev1=1 crypto rx=0x7fbaf40c9390 tx=0x7fbadc01c460 comp rx=0 tx=0).stop 2023-06-10T19:09:01.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.215+0000 7fbaf97ea640 1 -- 172.21.15.53:0/1408249923 shutdown_connections 2023-06-10T19:09:01.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.215+0000 7fbaf97ea640 1 --2- 172.21.15.53:0/1408249923 >> v2:172.21.15.117:3300/0 conn(0x7fbaf40ce990 0x7fbaf4069450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:01.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.215+0000 7fbaf97ea640 1 --2- 172.21.15.53:0/1408249923 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbaf4070f80 0x7fbaf40ce450 unknown :-1 s=CLOSED pgs=2714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:01.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.215+0000 7fbaf97ea640 1 -- 172.21.15.53:0/1408249923 >> 172.21.15.53:0/1408249923 conn(0x7fbaf406a560 msgr2=0x7fbaf406a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:09:01.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.215+0000 7fbaf97ea640 1 -- 172.21.15.53:0/1408249923 shutdown_connections 2023-06-10T19:09:01.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.215+0000 7fbaf97ea640 1 -- 172.21.15.53:0/1408249923 wait complete. 2023-06-10T19:09:01.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.215+0000 7fbaf97ea640 1 Processor -- start 2023-06-10T19:09:01.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.215+0000 7fbaf97ea640 1 -- start start 2023-06-10T19:09:01.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.215+0000 7fbaf97ea640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbaf4070f80 0x7fbaf40c8950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:01.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.215+0000 7fbaf97ea640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbaf40ce990 0x7fbaf41583e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:01.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.215+0000 7fbaf97ea640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbaf415eef0 0x7fbaf4159c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:01.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.215+0000 7fbaf97ea640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf4158920 con 0x7fbaf415eef0 2023-06-10T19:09:01.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.215+0000 7fbaf97ea640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf4158bd0 con 0x7fbaf4070f80 2023-06-10T19:09:01.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.215+0000 7fbaf97ea640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf4158eb0 con 0x7fbaf40ce990 2023-06-10T19:09:01.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.215+0000 7fbaf37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbaf415eef0 0x7fbaf4159c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:01.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.215+0000 7fbaf37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbaf415eef0 0x7fbaf4159c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54844/0 (socket says 172.21.15.53:54844) 2023-06-10T19:09:01.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.215+0000 7fbaf37fe640 1 -- 172.21.15.53:0/3444281810 learned_addr learned my addr 172.21.15.53:0/3444281810 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:09:01.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.215+0000 7fbaebfff640 1 --2- 172.21.15.53:0/3444281810 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbaf40ce990 0x7fbaf41583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:01.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.219+0000 7fbaf2ffd640 1 --2- 172.21.15.53:0/3444281810 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbaf4070f80 0x7fbaf40c8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:01.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.219+0000 7fbaf37fe640 1 -- 172.21.15.53:0/3444281810 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbaf40ce990 msgr2=0x7fbaf41583e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:01.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.219+0000 7fbaf37fe640 1 --2- 172.21.15.53:0/3444281810 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbaf40ce990 0x7fbaf41583e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:01.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.219+0000 7fbaf37fe640 1 -- 172.21.15.53:0/3444281810 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbaf4070f80 msgr2=0x7fbaf40c8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:01.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.219+0000 7fbaf37fe640 1 --2- 172.21.15.53:0/3444281810 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbaf4070f80 0x7fbaf40c8950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:01.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.219+0000 7fbaf37fe640 1 -- 172.21.15.53:0/3444281810 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbadc009420 con 0x7fbaf415eef0 2023-06-10T19:09:01.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.219+0000 7fbaf2ffd640 1 --2- 172.21.15.53:0/3444281810 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbaf4070f80 0x7fbaf40c8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:09:01.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.219+0000 7fbaf37fe640 1 --2- 172.21.15.53:0/3444281810 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbaf415eef0 0x7fbaf4159c70 secure :-1 s=READY pgs=2715 cs=0 l=1 rev1=1 crypto rx=0x7fbaec00cef0 tx=0x7fbaec00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:01.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.219+0000 7fbaeb7fe640 1 -- 172.21.15.53:0/3444281810 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaec00d840 con 0x7fbaf415eef0 2023-06-10T19:09:01.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.219+0000 7fbaeb7fe640 1 -- 172.21.15.53:0/3444281810 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaec00d9c0 con 0x7fbaf415eef0 2023-06-10T19:09:01.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.219+0000 7fbaf97ea640 1 -- 172.21.15.53:0/3444281810 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaf4159190 con 0x7fbaf415eef0 2023-06-10T19:09:01.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.219+0000 7fbaeb7fe640 1 -- 172.21.15.53:0/3444281810 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaec00dd70 con 0x7fbaf415eef0 2023-06-10T19:09:01.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.219+0000 7fbaf97ea640 1 -- 172.21.15.53:0/3444281810 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaf4159750 con 0x7fbaf415eef0 2023-06-10T19:09:01.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.219+0000 7fbaf97ea640 1 -- 172.21.15.53:0/3444281810 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbaf4159940 con 0x7fbaf415eef0 2023-06-10T19:09:01.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.219+0000 7fbaeb7fe640 1 -- 172.21.15.53:0/3444281810 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbaec01e3b0 con 0x7fbaf415eef0 2023-06-10T19:09:01.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.219+0000 7fbaeb7fe640 1 --2- 172.21.15.53:0/3444281810 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbad4066280 0x7fbad4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:01.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.219+0000 7fbaeb7fe640 1 -- 172.21.15.53:0/3444281810 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6192+0+0 (secure 0 0 0) 0x7fbaec0847a0 con 0x7fbaf415eef0 2023-06-10T19:09:01.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.219+0000 7fbaf2ffd640 1 --2- 172.21.15.53:0/3444281810 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbad4066280 0x7fbad4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:01.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.219+0000 7fbaf2ffd640 1 --2- 172.21.15.53:0/3444281810 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbad4066280 0x7fbad4068730 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7fbae40011f0 tx=0x7fbae4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:01.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.223+0000 7fbaeb7fe640 1 -- 172.21.15.53:0/3444281810 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbaec051d10 con 0x7fbaf415eef0 2023-06-10T19:09:01.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.375+0000 7fbaf97ea640 1 -- 172.21.15.53:0/3444281810 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbaf404d790 con 0x7fbaf415eef0 2023-06-10T19:09:01.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.375+0000 7fbaeb7fe640 1 -- 172.21.15.53:0/3444281810 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v183) v1 ==== 74+0+18487 (secure 0 0 0) 0x7fbaec055330 con 0x7fbaf415eef0 2023-06-10T19:09:01.383 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:09:01.383 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":183,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:08:34.235084+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2023-06-10T19:08:01.296938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"179","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_data","create_time":"2023-06-10T19:08:02.507633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"180","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"26.2a","mappings":[{"from":1,"to":0}]},{"pgid":"26.37","mappings":[{"from":1,"to":0}]},{"pgid":"26.3a","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.0.1:0/3824904337":"2023-06-10T20:08:33.687127+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:09:01.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.379+0000 7fbaf97ea640 1 -- 172.21.15.53:0/3444281810 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbad4066280 msgr2=0x7fbad4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:01.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.379+0000 7fbaf97ea640 1 --2- 172.21.15.53:0/3444281810 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbad4066280 0x7fbad4068730 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7fbae40011f0 tx=0x7fbae4009040 comp rx=0 tx=0).stop 2023-06-10T19:09:01.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.379+0000 7fbaf97ea640 1 -- 172.21.15.53:0/3444281810 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbaf415eef0 msgr2=0x7fbaf4159c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:01.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.379+0000 7fbaf97ea640 1 --2- 172.21.15.53:0/3444281810 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbaf415eef0 0x7fbaf4159c70 secure :-1 s=READY pgs=2715 cs=0 l=1 rev1=1 crypto rx=0x7fbaec00cef0 tx=0x7fbaec00a710 comp rx=0 tx=0).stop 2023-06-10T19:09:01.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.379+0000 7fbaf97ea640 1 -- 172.21.15.53:0/3444281810 shutdown_connections 2023-06-10T19:09:01.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.379+0000 7fbaf97ea640 1 --2- 172.21.15.53:0/3444281810 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fbad4066280 0x7fbad4068730 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:01.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.379+0000 7fbaf97ea640 1 --2- 172.21.15.53:0/3444281810 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbaf415eef0 0x7fbaf4159c70 unknown :-1 s=CLOSED pgs=2715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:01.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.379+0000 7fbaf97ea640 1 --2- 172.21.15.53:0/3444281810 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbaf40ce990 0x7fbaf41583e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:01.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.379+0000 7fbaf97ea640 1 --2- 172.21.15.53:0/3444281810 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbaf4070f80 0x7fbaf40c8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:01.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.379+0000 7fbaf97ea640 1 -- 172.21.15.53:0/3444281810 >> 172.21.15.53:0/3444281810 conn(0x7fbaf406a560 msgr2=0x7fbaf40ab8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:09:01.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.379+0000 7fbaf97ea640 1 -- 172.21.15.53:0/3444281810 shutdown_connections 2023-06-10T19:09:01.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.379+0000 7fbaf97ea640 1 -- 172.21.15.53:0/3444281810 wait complete. 2023-06-10T19:09:01.401 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-06-10T19:09:01.403 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:09:01.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.519+0000 7f4641ad1640 1 Processor -- start 2023-06-10T19:09:01.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.519+0000 7f4641ad1640 1 -- start start 2023-06-10T19:09:01.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.519+0000 7f4641ad1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f463c0b3ac0 0x7f463c0b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:01.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.519+0000 7f4641ad1640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f463c0cc690 0x7f463c15f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:01.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.519+0000 7f4641ad1640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f463c0ccae0 0x7f463c15f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:01.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.519+0000 7f4641ad1640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f463c0d0020 con 0x7f463c0cc690 2023-06-10T19:09:01.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.519+0000 7f4641ad1640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f463c0b43d0 con 0x7f463c0ccae0 2023-06-10T19:09:01.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.519+0000 7f4641ad1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f463c0cef40 con 0x7f463c0b3ac0 2023-06-10T19:09:01.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.519+0000 7f4633fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f463c0cc690 0x7f463c15f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:01.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.519+0000 7f4633fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f463c0cc690 0x7f463c15f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54858/0 (socket says 172.21.15.53:54858) 2023-06-10T19:09:01.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.519+0000 7f4633fff640 1 -- 172.21.15.53:0/1578475609 learned_addr learned my addr 172.21.15.53:0/1578475609 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:09:01.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.519+0000 7f463b7fe640 1 --2- 172.21.15.53:0/1578475609 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f463c0b3ac0 0x7f463c0b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:01.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.519+0000 7f463bfff640 1 --2- 172.21.15.53:0/1578475609 >> v2:172.21.15.117:3300/0 conn(0x7f463c0ccae0 0x7f463c15f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:01.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.519+0000 7f4633fff640 1 -- 172.21.15.53:0/1578475609 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f463c0b3ac0 msgr2=0x7f463c0b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:09:01.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.519+0000 7f4633fff640 1 --2- 172.21.15.53:0/1578475609 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f463c0b3ac0 0x7f463c0b3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:01.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.519+0000 7f4633fff640 1 -- 172.21.15.53:0/1578475609 >> v2:172.21.15.117:3300/0 conn(0x7f463c0ccae0 msgr2=0x7f463c15f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:09:01.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.519+0000 7f4633fff640 1 --2- 172.21.15.53:0/1578475609 >> v2:172.21.15.117:3300/0 conn(0x7f463c0ccae0 0x7f463c15f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:01.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.519+0000 7f4633fff640 1 -- 172.21.15.53:0/1578475609 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f463c0cf220 con 0x7f463c0cc690 2023-06-10T19:09:01.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.519+0000 7f463b7fe640 1 --2- 172.21.15.53:0/1578475609 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f463c0b3ac0 0x7f463c0b3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:09:01.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.519+0000 7f4633fff640 1 --2- 172.21.15.53:0/1578475609 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f463c0cc690 0x7f463c15f370 secure :-1 s=READY pgs=2716 cs=0 l=1 rev1=1 crypto rx=0x7f463c0b14a0 tx=0x7f462401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68cb506fd4f00277 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:01.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.523+0000 7f463affd640 1 -- 172.21.15.53:0/1578475609 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46240ac600 con 0x7f463c0cc690 2023-06-10T19:09:01.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.523+0000 7f463affd640 1 -- 172.21.15.53:0/1578475609 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46240a8050 con 0x7f463c0cc690 2023-06-10T19:09:01.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.523+0000 7f463affd640 1 -- 172.21.15.53:0/1578475609 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46240ac980 con 0x7f463c0cc690 2023-06-10T19:09:01.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.523+0000 7f4641ad1640 1 -- 172.21.15.53:0/1578475609 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f463c0cc690 msgr2=0x7f463c15f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:01.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.523+0000 7f4641ad1640 1 --2- 172.21.15.53:0/1578475609 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f463c0cc690 0x7f463c15f370 secure :-1 s=READY pgs=2716 cs=0 l=1 rev1=1 crypto rx=0x7f463c0b14a0 tx=0x7f462401c4d0 comp rx=0 tx=0).stop 2023-06-10T19:09:01.528 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.523+0000 7f4641ad1640 1 -- 172.21.15.53:0/1578475609 shutdown_connections 2023-06-10T19:09:01.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.523+0000 7f4641ad1640 1 --2- 172.21.15.53:0/1578475609 >> v2:172.21.15.117:3300/0 conn(0x7f463c0ccae0 0x7f463c15f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:01.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.523+0000 7f4641ad1640 1 --2- 172.21.15.53:0/1578475609 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f463c0cc690 0x7f463c15f370 unknown :-1 s=CLOSED pgs=2716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:01.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.523+0000 7f4641ad1640 1 --2- 172.21.15.53:0/1578475609 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f463c0b3ac0 0x7f463c0b3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:01.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.523+0000 7f4641ad1640 1 -- 172.21.15.53:0/1578475609 >> 172.21.15.53:0/1578475609 conn(0x7f463c071790 msgr2=0x7f463c069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:09:01.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.523+0000 7f4641ad1640 1 -- 172.21.15.53:0/1578475609 shutdown_connections 2023-06-10T19:09:01.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.523+0000 7f4641ad1640 1 -- 172.21.15.53:0/1578475609 wait complete. 2023-06-10T19:09:01.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.523+0000 7f4641ad1640 1 Processor -- start 2023-06-10T19:09:01.531 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.523+0000 7f4641ad1640 1 -- start start 2023-06-10T19:09:01.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.523+0000 7f4641ad1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f463c0b3ac0 0x7f463c154200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:01.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.523+0000 7f4641ad1640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f463c0cc690 0x7f463c154740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:01.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.523+0000 7f4641ad1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f463c0ccae0 0x7f463c0ca9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:01.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.523+0000 7f4641ad1640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f463c15ea60 con 0x7f463c0ccae0 2023-06-10T19:09:01.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.523+0000 7f4641ad1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f463c15de50 con 0x7f463c0b3ac0 2023-06-10T19:09:01.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.523+0000 7f4641ad1640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f463c15e130 con 0x7f463c0cc690 2023-06-10T19:09:01.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.523+0000 7f463bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f463c0ccae0 0x7f463c0ca9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:01.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.523+0000 7f463bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f463c0ccae0 0x7f463c0ca9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54872/0 (socket says 172.21.15.53:54872) 2023-06-10T19:09:01.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.523+0000 7f463bfff640 1 -- 172.21.15.53:0/1249436822 learned_addr learned my addr 172.21.15.53:0/1249436822 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:09:01.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.523+0000 7f4633fff640 1 --2- 172.21.15.53:0/1249436822 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f463c0cc690 0x7f463c154740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:01.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.523+0000 7f463b7fe640 1 --2- 172.21.15.53:0/1249436822 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f463c0b3ac0 0x7f463c154200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:01.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.523+0000 7f463bfff640 1 -- 172.21.15.53:0/1249436822 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f463c0cc690 msgr2=0x7f463c154740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:01.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.523+0000 7f463bfff640 1 --2- 172.21.15.53:0/1249436822 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f463c0cc690 0x7f463c154740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:01.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.523+0000 7f463bfff640 1 -- 172.21.15.53:0/1249436822 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f463c0b3ac0 msgr2=0x7f463c154200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:01.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.523+0000 7f463bfff640 1 --2- 172.21.15.53:0/1249436822 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f463c0b3ac0 0x7f463c154200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:01.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.523+0000 7f463bfff640 1 -- 172.21.15.53:0/1249436822 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46240094d0 con 0x7f463c0ccae0 2023-06-10T19:09:01.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.523+0000 7f463bfff640 1 --2- 172.21.15.53:0/1249436822 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f463c0ccae0 0x7f463c0ca9c0 secure :-1 s=READY pgs=2717 cs=0 l=1 rev1=1 crypto rx=0x7f4634007e60 tx=0x7f463400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:01.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.523+0000 7f4638ff9640 1 -- 172.21.15.53:0/1249436822 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4634014420 con 0x7f463c0ccae0 2023-06-10T19:09:01.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.523+0000 7f4638ff9640 1 -- 172.21.15.53:0/1249436822 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46340145a0 con 0x7f463c0ccae0 2023-06-10T19:09:01.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.523+0000 7f4638ff9640 1 -- 172.21.15.53:0/1249436822 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4634014950 con 0x7f463c0ccae0 2023-06-10T19:09:01.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.523+0000 7f4641ad1640 1 -- 172.21.15.53:0/1249436822 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f463c15e410 con 0x7f463c0ccae0 2023-06-10T19:09:01.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.523+0000 7f4641ad1640 1 -- 172.21.15.53:0/1249436822 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f463c14dad0 con 0x7f463c0ccae0 2023-06-10T19:09:01.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.527+0000 7f4641ad1640 1 -- 172.21.15.53:0/1249436822 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f463c04d790 con 0x7f463c0ccae0 2023-06-10T19:09:01.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.527+0000 7f4638ff9640 1 -- 172.21.15.53:0/1249436822 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4634014ab0 con 0x7f463c0ccae0 2023-06-10T19:09:01.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.527+0000 7f4638ff9640 1 --2- 172.21.15.53:0/1249436822 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f461c066280 0x7f461c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:01.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.527+0000 7f4638ff9640 1 -- 172.21.15.53:0/1249436822 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6192+0+0 (secure 0 0 0) 0x7f46340846f0 con 0x7f463c0ccae0 2023-06-10T19:09:01.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.527+0000 7f463b7fe640 1 --2- 172.21.15.53:0/1249436822 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f461c066280 0x7f461c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:01.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.527+0000 7f463b7fe640 1 --2- 172.21.15.53:0/1249436822 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f461c066280 0x7f461c068730 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f462c00c880 tx=0x7f462c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:01.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.531+0000 7f4638ff9640 1 -- 172.21.15.53:0/1249436822 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4634055580 con 0x7f463c0ccae0 2023-06-10T19:09:01.722 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.715+0000 7f4641ad1640 1 -- 172.21.15.53:0/1249436822 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f463c15eba0 con 0x7f463c0ccae0 2023-06-10T19:09:01.723 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.719+0000 7f4638ff9640 1 -- 172.21.15.53:0/1249436822 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) v1 ==== 95+0+4688 (secure 0 0 0) 0x7f4634082e60 con 0x7f463c0ccae0 2023-06-10T19:09:01.724 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:09:01.724 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":104,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7835,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2641321206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2641321206},{"type":"v1","addr":"172.21.15.117:6835","nonce":2641321206}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":99},{"gid":8956,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1439696554","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1439696554},{"type":"v1","addr":"172.21.15.117:6837","nonce":1439696554}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":99},{"gid":11112,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/3327528087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3327528087},{"type":"v1","addr":"172.21.15.53:6833","nonce":3327528087}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":99}],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:08:03.514484+0000","modified":"2023-06-10T19:08:06.533495+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":11118},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11118":{"gid":11118,"name":"c","rank":0,"incarnation":100,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/3732323283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":3732323283},{"type":"v1","addr":"172.21.15.53:6835","nonce":3732323283}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":12}]} 2023-06-10T19:09:01.724 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 104 2023-06-10T19:09:01.725 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.719+0000 7f4641ad1640 1 -- 172.21.15.53:0/1249436822 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f461c066280 msgr2=0x7f461c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:01.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.719+0000 7f4641ad1640 1 --2- 172.21.15.53:0/1249436822 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f461c066280 0x7f461c068730 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f462c00c880 tx=0x7f462c008040 comp rx=0 tx=0).stop 2023-06-10T19:09:01.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.719+0000 7f4641ad1640 1 -- 172.21.15.53:0/1249436822 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f463c0ccae0 msgr2=0x7f463c0ca9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:01.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.719+0000 7f4641ad1640 1 --2- 172.21.15.53:0/1249436822 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f463c0ccae0 0x7f463c0ca9c0 secure :-1 s=READY pgs=2717 cs=0 l=1 rev1=1 crypto rx=0x7f4634007e60 tx=0x7f463400e4b0 comp rx=0 tx=0).stop 2023-06-10T19:09:01.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.719+0000 7f4641ad1640 1 -- 172.21.15.53:0/1249436822 shutdown_connections 2023-06-10T19:09:01.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.719+0000 7f4641ad1640 1 --2- 172.21.15.53:0/1249436822 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f461c066280 0x7f461c068730 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:01.726 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.719+0000 7f4641ad1640 1 --2- 172.21.15.53:0/1249436822 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f463c0ccae0 0x7f463c0ca9c0 unknown :-1 s=CLOSED pgs=2717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:01.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.719+0000 7f4641ad1640 1 --2- 172.21.15.53:0/1249436822 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f463c0cc690 0x7f463c154740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:01.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.719+0000 7f4641ad1640 1 --2- 172.21.15.53:0/1249436822 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f463c0b3ac0 0x7f463c154200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:01.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.719+0000 7f4641ad1640 1 -- 172.21.15.53:0/1249436822 >> 172.21.15.53:0/1249436822 conn(0x7f463c071790 msgr2=0x7f463c15f0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:09:01.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.719+0000 7f4641ad1640 1 -- 172.21.15.53:0/1249436822 shutdown_connections 2023-06-10T19:09:01.727 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.719+0000 7f4641ad1640 1 -- 172.21.15.53:0/1249436822 wait complete. 2023-06-10T19:09:01.742 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:09:01.862 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.855+0000 7f6e3042f640 1 Processor -- start 2023-06-10T19:09:01.863 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.855+0000 7f6e3042f640 1 -- start start 2023-06-10T19:09:01.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.859+0000 7f6e3042f640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6e2806b2f0 0x7f6e2806f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:01.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.859+0000 7f6e3042f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6e28160170 0x7f6e28162550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:01.864 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.859+0000 7f6e3042f640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e28158a90 con 0x7f6e280c8d00 2023-06-10T19:09:01.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.859+0000 7f6e3042f640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e280705d0 con 0x7f6e2806b2f0 2023-06-10T19:09:01.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.859+0000 7f6e3042f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e280cce10 con 0x7f6e28160170 2023-06-10T19:09:01.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.859+0000 7f6e2e9cc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6e28160170 0x7f6e28162550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:01.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.859+0000 7f6e2e1cb640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6e2806b2f0 0x7f6e2806f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:01.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.859+0000 7f6e2e9cc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6e28160170 0x7f6e28162550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.53:60226/0 (socket says 172.21.15.53:60226) 2023-06-10T19:09:01.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.859+0000 7f6e2e9cc640 1 -- 172.21.15.53:0/3866636095 learned_addr learned my addr 172.21.15.53:0/3866636095 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:09:01.865 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.859+0000 7f6e2e1cb640 1 -- 172.21.15.53:0/3866636095 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6e28160170 msgr2=0x7f6e28162550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:09:01.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.859+0000 7f6e2e1cb640 1 --2- 172.21.15.53:0/3866636095 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6e28160170 0x7f6e28162550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:01.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.859+0000 7f6e2e1cb640 1 -- 172.21.15.53:0/3866636095 >> v1:172.21.15.117:6789/0 conn(0x7f6e280c8d00 legacy=0x7f6e2806b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:01.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.859+0000 7f6e2e1cb640 1 -- 172.21.15.53:0/3866636095 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e2806f9c0 con 0x7f6e2806b2f0 2023-06-10T19:09:01.866 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.859+0000 7f6e2e9cc640 1 --2- 172.21.15.53:0/3866636095 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6e28160170 0x7f6e28162550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-10T19:09:01.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.859+0000 7f6e2e1cb640 1 --2- 172.21.15.53:0/3866636095 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6e2806b2f0 0x7f6e2806f070 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c0097c0 tx=0x7f6e1c01ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7466bcf33864f888 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:01.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.859+0000 7f6e2d1c9640 1 -- 172.21.15.53:0/3866636095 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1c0a8970 con 0x7f6e2806b2f0 2023-06-10T19:09:01.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.859+0000 7f6e2d1c9640 1 -- 172.21.15.53:0/3866636095 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e1c0a8ad0 con 0x7f6e2806b2f0 2023-06-10T19:09:01.867 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.859+0000 7f6e2d1c9640 1 -- 172.21.15.53:0/3866636095 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1c0a8e60 con 0x7f6e2806b2f0 2023-06-10T19:09:01.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.863+0000 7f6e3042f640 1 -- 172.21.15.53:0/3866636095 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6e2806b2f0 msgr2=0x7f6e2806f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:01.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.863+0000 7f6e3042f640 1 --2- 172.21.15.53:0/3866636095 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6e2806b2f0 0x7f6e2806f070 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c0097c0 tx=0x7f6e1c01ec70 comp rx=0 tx=0).stop 2023-06-10T19:09:01.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.863+0000 7f6e3042f640 1 -- 172.21.15.53:0/3866636095 shutdown_connections 2023-06-10T19:09:01.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.863+0000 7f6e3042f640 1 --2- 172.21.15.53:0/3866636095 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6e28160170 0x7f6e28162550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:01.868 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.863+0000 7f6e3042f640 1 --2- 172.21.15.53:0/3866636095 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6e2806b2f0 0x7f6e2806f070 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:01.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.863+0000 7f6e3042f640 1 -- 172.21.15.53:0/3866636095 >> 172.21.15.53:0/3866636095 conn(0x7f6e2806a0d0 msgr2=0x7f6e280ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:09:01.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.863+0000 7f6e3042f640 1 -- 172.21.15.53:0/3866636095 shutdown_connections 2023-06-10T19:09:01.869 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.863+0000 7f6e3042f640 1 -- 172.21.15.53:0/3866636095 wait complete. 2023-06-10T19:09:01.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.863+0000 7f6e3042f640 1 Processor -- start 2023-06-10T19:09:01.870 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.863+0000 7f6e3042f640 1 -- start start 2023-06-10T19:09:01.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.863+0000 7f6e3042f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6e2806b2f0 0x7f6e28151e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:01.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.863+0000 7f6e3042f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e280c8d00 0x7f6e280c72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:01.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.863+0000 7f6e3042f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6e28160170 0x7f6e281f4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:01.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.863+0000 7f6e3042f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e280acd30 con 0x7f6e280c8d00 2023-06-10T19:09:01.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.863+0000 7f6e3042f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e280ad280 con 0x7f6e28160170 2023-06-10T19:09:01.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.863+0000 7f6e3042f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e280acfa0 con 0x7f6e2806b2f0 2023-06-10T19:09:01.871 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.863+0000 7f6e2d9ca640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e280c8d00 0x7f6e280c72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:01.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.863+0000 7f6e2d9ca640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e280c8d00 0x7f6e280c72b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54880/0 (socket says 172.21.15.53:54880) 2023-06-10T19:09:01.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.863+0000 7f6e2d9ca640 1 -- 172.21.15.53:0/2756799825 learned_addr learned my addr 172.21.15.53:0/2756799825 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:09:01.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.863+0000 7f6e2e9cc640 1 --2- 172.21.15.53:0/2756799825 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6e28160170 0x7f6e281f4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:01.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.863+0000 7f6e2e1cb640 1 --2- 172.21.15.53:0/2756799825 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6e2806b2f0 0x7f6e28151e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:01.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.863+0000 7f6e2d9ca640 1 -- 172.21.15.53:0/2756799825 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6e2806b2f0 msgr2=0x7f6e28151e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:01.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.863+0000 7f6e2d9ca640 1 --2- 172.21.15.53:0/2756799825 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6e2806b2f0 0x7f6e28151e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:01.872 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.863+0000 7f6e2d9ca640 1 -- 172.21.15.53:0/2756799825 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6e28160170 msgr2=0x7f6e281f4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:01.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.863+0000 7f6e2d9ca640 1 --2- 172.21.15.53:0/2756799825 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6e28160170 0x7f6e281f4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:01.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.863+0000 7f6e2d9ca640 1 -- 172.21.15.53:0/2756799825 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e20009b30 con 0x7f6e280c8d00 2023-06-10T19:09:01.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.863+0000 7f6e2d9ca640 1 --2- 172.21.15.53:0/2756799825 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e280c8d00 0x7f6e280c72b0 secure :-1 s=READY pgs=2718 cs=0 l=1 rev1=1 crypto rx=0x7f6e2400c500 tx=0x7f6e2400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:01.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.863+0000 7f6e1affd640 1 -- 172.21.15.53:0/2756799825 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e24005220 con 0x7f6e280c8d00 2023-06-10T19:09:01.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.863+0000 7f6e1affd640 1 -- 172.21.15.53:0/2756799825 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e24005380 con 0x7f6e280c8d00 2023-06-10T19:09:01.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.863+0000 7f6e3042f640 1 -- 172.21.15.53:0/2756799825 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e1c009420 con 0x7f6e280c8d00 2023-06-10T19:09:01.873 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.863+0000 7f6e1affd640 1 -- 172.21.15.53:0/2756799825 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e24007270 con 0x7f6e280c8d00 2023-06-10T19:09:01.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.863+0000 7f6e3042f640 1 -- 172.21.15.53:0/2756799825 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e280b3900 con 0x7f6e280c8d00 2023-06-10T19:09:01.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.867+0000 7f6e3042f640 1 -- 172.21.15.53:0/2756799825 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e2804d790 con 0x7f6e280c8d00 2023-06-10T19:09:01.874 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.867+0000 7f6e1affd640 1 -- 172.21.15.53:0/2756799825 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6e240073d0 con 0x7f6e280c8d00 2023-06-10T19:09:01.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.867+0000 7f6e1affd640 1 --2- 172.21.15.53:0/2756799825 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6e0c066280 0x7f6e0c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:01.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.867+0000 7f6e1affd640 1 -- 172.21.15.53:0/2756799825 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6192+0+0 (secure 0 0 0) 0x7f6e240833c0 con 0x7f6e280c8d00 2023-06-10T19:09:01.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.867+0000 7f6e2e1cb640 1 --2- 172.21.15.53:0/2756799825 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6e0c066280 0x7f6e0c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:01.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.867+0000 7f6e2e1cb640 1 --2- 172.21.15.53:0/2756799825 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6e0c066280 0x7f6e0c068730 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c0b2000 tx=0x7f6e1c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:01.875 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:01.871+0000 7f6e1affd640 1 -- 172.21.15.53:0/2756799825 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6e24050880 con 0x7f6e280c8d00 2023-06-10T19:09:02.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.051+0000 7f6e3042f640 1 -- 172.21.15.53:0/2756799825 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6e28070230 con 0x7f6e280c8d00 2023-06-10T19:09:02.059 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.055+0000 7f6e1affd640 1 -- 172.21.15.53:0/2756799825 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) v1 ==== 95+0+4688 (secure 0 0 0) 0x7f6e24053ea0 con 0x7f6e280c8d00 2023-06-10T19:09:02.059 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:09:02.059 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":104,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7835,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2641321206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2641321206},{"type":"v1","addr":"172.21.15.117:6835","nonce":2641321206}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":99},{"gid":8956,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1439696554","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1439696554},{"type":"v1","addr":"172.21.15.117:6837","nonce":1439696554}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":99},{"gid":11112,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/3327528087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3327528087},{"type":"v1","addr":"172.21.15.53:6833","nonce":3327528087}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":99}],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-10T19:08:03.514484+0000","modified":"2023-06-10T19:08:06.533495+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":11118},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11118":{"gid":11118,"name":"c","rank":0,"incarnation":100,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6835/3732323283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":3732323283},{"type":"v1","addr":"172.21.15.53:6835","nonce":3732323283}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":12}]} 2023-06-10T19:09:02.060 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 104 2023-06-10T19:09:02.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.055+0000 7f6e3042f640 1 -- 172.21.15.53:0/2756799825 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6e0c066280 msgr2=0x7f6e0c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:02.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.055+0000 7f6e3042f640 1 --2- 172.21.15.53:0/2756799825 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6e0c066280 0x7f6e0c068730 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c0b2000 tx=0x7f6e1c008040 comp rx=0 tx=0).stop 2023-06-10T19:09:02.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.055+0000 7f6e3042f640 1 -- 172.21.15.53:0/2756799825 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e280c8d00 msgr2=0x7f6e280c72b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:02.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.055+0000 7f6e3042f640 1 --2- 172.21.15.53:0/2756799825 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e280c8d00 0x7f6e280c72b0 secure :-1 s=READY pgs=2718 cs=0 l=1 rev1=1 crypto rx=0x7f6e2400c500 tx=0x7f6e2400c9c0 comp rx=0 tx=0).stop 2023-06-10T19:09:02.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.055+0000 7f6e3042f640 1 -- 172.21.15.53:0/2756799825 shutdown_connections 2023-06-10T19:09:02.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.055+0000 7f6e3042f640 1 --2- 172.21.15.53:0/2756799825 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f6e0c066280 0x7f6e0c068730 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:02.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.055+0000 7f6e3042f640 1 --2- 172.21.15.53:0/2756799825 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6e28160170 0x7f6e281f4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:02.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.055+0000 7f6e3042f640 1 --2- 172.21.15.53:0/2756799825 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e280c8d00 0x7f6e280c72b0 unknown :-1 s=CLOSED pgs=2718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:02.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.055+0000 7f6e3042f640 1 --2- 172.21.15.53:0/2756799825 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6e2806b2f0 0x7f6e28151e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:02.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.055+0000 7f6e3042f640 1 -- 172.21.15.53:0/2756799825 >> 172.21.15.53:0/2756799825 conn(0x7f6e2806a0d0 msgr2=0x7f6e280ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:09:02.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.055+0000 7f6e3042f640 1 -- 172.21.15.53:0/2756799825 shutdown_connections 2023-06-10T19:09:02.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.055+0000 7f6e3042f640 1 -- 172.21.15.53:0/2756799825 wait complete. 2023-06-10T19:09:02.077 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:09:02.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.179+0000 7fe0d384b640 1 Processor -- start 2023-06-10T19:09:02.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.183+0000 7fe0d384b640 1 -- start start 2023-06-10T19:09:02.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.183+0000 7fe0d384b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe0cc0c9840 0x7fe0cc0c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:02.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.183+0000 7fe0d384b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe0cc071060 0x7fe0cc0af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:02.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.183+0000 7fe0d384b640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0cc159b50 con 0x7fe0cc0afc60 2023-06-10T19:09:02.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.183+0000 7fe0d384b640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0cc0ca150 con 0x7fe0cc0c9840 2023-06-10T19:09:02.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.183+0000 7fe0d384b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0cc0702a0 con 0x7fe0cc071060 2023-06-10T19:09:02.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.183+0000 7fe0d1de8640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fe0cc0afc60 0x7fe0cc15d2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56702/0 (socket says 172.21.15.53:56702) 2023-06-10T19:09:02.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.183+0000 7fe0d1de8640 1 -- 172.21.15.53:0/4005076721 learned_addr learned my addr 172.21.15.53:0/4005076721 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:09:02.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.183+0000 7fe0d0de6640 1 --2- 172.21.15.53:0/4005076721 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe0cc071060 0x7fe0cc0af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:02.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.183+0000 7fe0d15e7640 1 --2- 172.21.15.53:0/4005076721 >> v2:172.21.15.117:3300/0 conn(0x7fe0cc0c9840 0x7fe0cc0c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:02.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.183+0000 7fe0c3fff640 1 -- 172.21.15.53:0/4005076721 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2190831094 0 0) 0x7fe0cc159b50 con 0x7fe0cc0afc60 2023-06-10T19:09:02.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.183+0000 7fe0c3fff640 1 -- 172.21.15.53:0/4005076721 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0b8003530 con 0x7fe0cc0afc60 2023-06-10T19:09:02.194 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.183+0000 7fe0c3fff640 1 -- 172.21.15.53:0/4005076721 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2804840463 0 0) 0x7fe0b8003530 con 0x7fe0cc0afc60 2023-06-10T19:09:02.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.183+0000 7fe0c3fff640 1 -- 172.21.15.53:0/4005076721 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe0cc071060 msgr2=0x7fe0cc0af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:09:02.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.183+0000 7fe0c3fff640 1 --2- 172.21.15.53:0/4005076721 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe0cc071060 0x7fe0cc0af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:02.195 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.183+0000 7fe0c3fff640 1 -- 172.21.15.53:0/4005076721 >> v2:172.21.15.117:3300/0 conn(0x7fe0cc0c9840 msgr2=0x7fe0cc0c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:09:02.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.183+0000 7fe0c3fff640 1 --2- 172.21.15.53:0/4005076721 >> v2:172.21.15.117:3300/0 conn(0x7fe0cc0c9840 0x7fe0cc0c9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:02.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.183+0000 7fe0c3fff640 1 -- 172.21.15.53:0/4005076721 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0cc070580 con 0x7fe0cc0afc60 2023-06-10T19:09:02.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.183+0000 7fe0c3fff640 1 -- 172.21.15.53:0/4005076721 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fe0c4001a00 con 0x7fe0cc0afc60 2023-06-10T19:09:02.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.183+0000 7fe0c3fff640 1 -- 172.21.15.53:0/4005076721 >> v1:172.21.15.53:6789/0 conn(0x7fe0cc0afc60 legacy=0x7fe0cc15d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:02.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.183+0000 7fe0c3fff640 1 --2- 172.21.15.53:0/4005076721 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe0b80039f0 0x7fe0b8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:02.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.183+0000 7fe0c3fff640 1 --2- 172.21.15.53:0/4005076721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0b80047d0 0x7fe0b8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:02.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.183+0000 7fe0c3fff640 1 --2- 172.21.15.53:0/4005076721 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe0cc071060 0x7fe0b8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:02.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.183+0000 7fe0c3fff640 1 -- 172.21.15.53:0/4005076721 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0cc0ca150 con 0x7fe0b80047d0 2023-06-10T19:09:02.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.183+0000 7fe0c3fff640 1 -- 172.21.15.53:0/4005076721 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0cc0702a0 con 0x7fe0b80039f0 2023-06-10T19:09:02.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.183+0000 7fe0c3fff640 1 -- 172.21.15.53:0/4005076721 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b800b990 con 0x7fe0cc071060 2023-06-10T19:09:02.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.183+0000 7fe0d0de6640 1 --2- 172.21.15.53:0/4005076721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0b80047d0 0x7fe0b8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:02.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.183+0000 7fe0d1de8640 1 --2- 172.21.15.53:0/4005076721 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe0cc071060 0x7fe0b8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:02.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.183+0000 7fe0d15e7640 1 --2- 172.21.15.53:0/4005076721 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe0b80039f0 0x7fe0b8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:02.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.183+0000 7fe0d0de6640 1 -- 172.21.15.53:0/4005076721 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe0cc071060 msgr2=0x7fe0b8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:09:02.198 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.183+0000 7fe0d0de6640 1 --2- 172.21.15.53:0/4005076721 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe0cc071060 0x7fe0b8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:02.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.183+0000 7fe0d0de6640 1 -- 172.21.15.53:0/4005076721 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe0b80039f0 msgr2=0x7fe0b8003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:09:02.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.183+0000 7fe0d0de6640 1 --2- 172.21.15.53:0/4005076721 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe0b80039f0 0x7fe0b8003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:02.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.183+0000 7fe0d0de6640 1 -- 172.21.15.53:0/4005076721 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0b8003530 con 0x7fe0b80047d0 2023-06-10T19:09:02.199 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.183+0000 7fe0d1de8640 1 --2- 172.21.15.53:0/4005076721 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe0cc071060 0x7fe0b8005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:09:02.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.187+0000 7fe0d0de6640 1 --2- 172.21.15.53:0/4005076721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0b80047d0 0x7fe0b8004c40 secure :-1 s=READY pgs=2720 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc009ab0 tx=0x7fe0bc01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcf34b949e04edac server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:02.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.187+0000 7fe0c3fff640 1 -- 172.21.15.53:0/4005076721 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0bc0a5510 con 0x7fe0b80047d0 2023-06-10T19:09:02.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.187+0000 7fe0c3fff640 1 -- 172.21.15.53:0/4005076721 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0bc0a5670 con 0x7fe0b80047d0 2023-06-10T19:09:02.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.187+0000 7fe0c3fff640 1 -- 172.21.15.53:0/4005076721 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0bc0a5a20 con 0x7fe0b80047d0 2023-06-10T19:09:02.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.187+0000 7fe0d384b640 1 -- 172.21.15.53:0/4005076721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0b80047d0 msgr2=0x7fe0b8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:02.203 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.187+0000 7fe0d384b640 1 --2- 172.21.15.53:0/4005076721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0b80047d0 0x7fe0b8004c40 secure :-1 s=READY pgs=2720 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc009ab0 tx=0x7fe0bc01ca30 comp rx=0 tx=0).stop 2023-06-10T19:09:02.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.187+0000 7fe0d1de8640 1 -- 172.21.15.53:0/4005076721 reap_dead start 2023-06-10T19:09:02.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.187+0000 7fe0d384b640 1 -- 172.21.15.53:0/4005076721 shutdown_connections 2023-06-10T19:09:02.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.187+0000 7fe0d384b640 1 -- 172.21.15.53:0/4005076721 >> 172.21.15.53:0/4005076721 conn(0x7fe0cc06a0d0 msgr2=0x7fe0cc0ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:09:02.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.187+0000 7fe0d384b640 1 -- 172.21.15.53:0/4005076721 shutdown_connections 2023-06-10T19:09:02.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.187+0000 7fe0d384b640 1 -- 172.21.15.53:0/4005076721 wait complete. 2023-06-10T19:09:02.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.187+0000 7fe0d384b640 1 Processor -- start 2023-06-10T19:09:02.204 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.187+0000 7fe0d384b640 1 -- start start 2023-06-10T19:09:02.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.191+0000 7fe0d384b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe0b80047d0 0x7fe0cc1f4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:02.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.191+0000 7fe0d384b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe0cc0cb870 0x7fe0cc15ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:02.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.191+0000 7fe0d384b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0cc15b090 0x7fe0cc14f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:02.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.191+0000 7fe0d384b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0cc15b610 con 0x7fe0cc15b090 2023-06-10T19:09:02.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.191+0000 7fe0d384b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0cc15b8f0 con 0x7fe0b80047d0 2023-06-10T19:09:02.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.191+0000 7fe0d384b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0cc15bbd0 con 0x7fe0cc0cb870 2023-06-10T19:09:02.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.191+0000 7fe0d1de8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0cc15b090 0x7fe0cc14f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:02.205 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.191+0000 7fe0d1de8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0cc15b090 0x7fe0cc14f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54896/0 (socket says 172.21.15.53:54896) 2023-06-10T19:09:02.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.191+0000 7fe0d1de8640 1 -- 172.21.15.53:0/4123632964 learned_addr learned my addr 172.21.15.53:0/4123632964 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:09:02.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.191+0000 7fe0d0de6640 1 --2- 172.21.15.53:0/4123632964 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe0cc0cb870 0x7fe0cc15ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:02.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.191+0000 7fe0d15e7640 1 --2- 172.21.15.53:0/4123632964 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe0b80047d0 0x7fe0cc1f4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:02.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.191+0000 7fe0d1de8640 1 -- 172.21.15.53:0/4123632964 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe0cc0cb870 msgr2=0x7fe0cc15ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:02.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.191+0000 7fe0d1de8640 1 --2- 172.21.15.53:0/4123632964 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe0cc0cb870 0x7fe0cc15ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:02.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.191+0000 7fe0d1de8640 1 -- 172.21.15.53:0/4123632964 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe0b80047d0 msgr2=0x7fe0cc1f4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:02.206 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.191+0000 7fe0d1de8640 1 --2- 172.21.15.53:0/4123632964 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe0b80047d0 0x7fe0cc1f4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:02.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.191+0000 7fe0d1de8640 1 -- 172.21.15.53:0/4123632964 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0cc1e3f60 con 0x7fe0cc15b090 2023-06-10T19:09:02.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.191+0000 7fe0d0de6640 1 --2- 172.21.15.53:0/4123632964 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe0cc0cb870 0x7fe0cc15ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:09:02.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.191+0000 7fe0d1de8640 1 --2- 172.21.15.53:0/4123632964 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0cc15b090 0x7fe0cc14f170 secure :-1 s=READY pgs=2721 cs=0 l=1 rev1=1 crypto rx=0x7fe0c4004c00 tx=0x7fe0c4011850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:02.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.191+0000 7fe0c1ffb640 1 -- 172.21.15.53:0/4123632964 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c4014370 con 0x7fe0cc15b090 2023-06-10T19:09:02.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.191+0000 7fe0c1ffb640 1 -- 172.21.15.53:0/4123632964 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0c40144d0 con 0x7fe0cc15b090 2023-06-10T19:09:02.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.191+0000 7fe0d384b640 1 -- 172.21.15.53:0/4123632964 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0cc1e4240 con 0x7fe0cc15b090 2023-06-10T19:09:02.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.191+0000 7fe0c1ffb640 1 -- 172.21.15.53:0/4123632964 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c4014840 con 0x7fe0cc15b090 2023-06-10T19:09:02.207 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.191+0000 7fe0d384b640 1 -- 172.21.15.53:0/4123632964 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0cc1f5010 con 0x7fe0cc15b090 2023-06-10T19:09:02.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.191+0000 7fe0d384b640 1 -- 172.21.15.53:0/4123632964 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0cc04d790 con 0x7fe0cc15b090 2023-06-10T19:09:02.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.191+0000 7fe0c1ffb640 1 -- 172.21.15.53:0/4123632964 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe0c40149a0 con 0x7fe0cc15b090 2023-06-10T19:09:02.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.191+0000 7fe0c1ffb640 1 --2- 172.21.15.53:0/4123632964 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe0b00662b0 0x7fe0b0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:02.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.191+0000 7fe0c1ffb640 1 -- 172.21.15.53:0/4123632964 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6192+0+0 (secure 0 0 0) 0x7fe0c4085e70 con 0x7fe0cc15b090 2023-06-10T19:09:02.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.191+0000 7fe0d15e7640 1 --2- 172.21.15.53:0/4123632964 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe0b00662b0 0x7fe0b0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:02.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.195+0000 7fe0d15e7640 1 --2- 172.21.15.53:0/4123632964 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe0b00662b0 0x7fe0b0068760 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7fe0c8009ab0 tx=0x7fe0c8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:02.208 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.195+0000 7fe0c1ffb640 1 -- 172.21.15.53:0/4123632964 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe0c4053300 con 0x7fe0cc15b090 2023-06-10T19:09:02.351 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.343+0000 7fe0d384b640 1 -- 172.21.15.53:0/4123632964 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe0cc0cb140 con 0x7fe0cc15b090 2023-06-10T19:09:02.354 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.347+0000 7fe0c1ffb640 1 -- 172.21.15.53:0/4123632964 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v183) v1 ==== 74+0+18487 (secure 0 0 0) 0x7fe0c401c020 con 0x7fe0cc15b090 2023-06-10T19:09:02.355 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:09:02.355 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":183,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:08:34.235084+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2023-06-10T19:08:01.296938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"179","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_data","create_time":"2023-06-10T19:08:02.507633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"180","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"26.2a","mappings":[{"from":1,"to":0}]},{"pgid":"26.37","mappings":[{"from":1,"to":0}]},{"pgid":"26.3a","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.0.1:0/3824904337":"2023-06-10T20:08:33.687127+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:09:02.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.347+0000 7fe0d384b640 1 -- 172.21.15.53:0/4123632964 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe0b00662b0 msgr2=0x7fe0b0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:02.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.347+0000 7fe0d384b640 1 --2- 172.21.15.53:0/4123632964 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe0b00662b0 0x7fe0b0068760 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7fe0c8009ab0 tx=0x7fe0c8008040 comp rx=0 tx=0).stop 2023-06-10T19:09:02.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.347+0000 7fe0d384b640 1 -- 172.21.15.53:0/4123632964 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0cc15b090 msgr2=0x7fe0cc14f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:02.356 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.347+0000 7fe0d384b640 1 --2- 172.21.15.53:0/4123632964 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0cc15b090 0x7fe0cc14f170 secure :-1 s=READY pgs=2721 cs=0 l=1 rev1=1 crypto rx=0x7fe0c4004c00 tx=0x7fe0c4011850 comp rx=0 tx=0).stop 2023-06-10T19:09:02.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.347+0000 7fe0d384b640 1 -- 172.21.15.53:0/4123632964 shutdown_connections 2023-06-10T19:09:02.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.347+0000 7fe0d384b640 1 --2- 172.21.15.53:0/4123632964 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe0b00662b0 0x7fe0b0068760 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:02.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.347+0000 7fe0d384b640 1 --2- 172.21.15.53:0/4123632964 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe0cc15b090 0x7fe0cc14f170 unknown :-1 s=CLOSED pgs=2721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:02.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.347+0000 7fe0d384b640 1 --2- 172.21.15.53:0/4123632964 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe0cc0cb870 0x7fe0cc15ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:02.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.347+0000 7fe0d384b640 1 --2- 172.21.15.53:0/4123632964 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe0b80047d0 0x7fe0cc1f4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:02.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.347+0000 7fe0d384b640 1 -- 172.21.15.53:0/4123632964 >> 172.21.15.53:0/4123632964 conn(0x7fe0cc06a0d0 msgr2=0x7fe0cc155bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:09:02.357 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.351+0000 7fe0d384b640 1 -- 172.21.15.53:0/4123632964 shutdown_connections 2023-06-10T19:09:02.358 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.351+0000 7fe0d384b640 1 -- 172.21.15.53:0/4123632964 wait complete. 2023-06-10T19:09:02.371 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-06-10T19:09:02.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.491+0000 7f58ac6d2640 1 Processor -- start 2023-06-10T19:09:02.496 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.491+0000 7f58ac6d2640 1 -- start start 2023-06-10T19:09:02.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.491+0000 7f58ac6d2640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f58a40cc690 0x7f58a40d00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:02.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.491+0000 7f58ac6d2640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f58a40d1b00 0x7f58a40d05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:02.497 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.491+0000 7f58ac6d2640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58a40ccde0 con 0x7f58a40b3ac0 2023-06-10T19:09:02.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.491+0000 7f58ac6d2640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58a40ced00 con 0x7f58a40cc690 2023-06-10T19:09:02.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.491+0000 7f58ac6d2640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58a40cfc10 con 0x7f58a40d1b00 2023-06-10T19:09:02.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.491+0000 7f58a9c6d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f58a40cc690 0x7f58a40d00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:02.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.491+0000 7f58a9c6d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f58a40cc690 0x7f58a40d00a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54912/0 (socket says 172.21.15.53:54912) 2023-06-10T19:09:02.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.491+0000 7f58a9c6d640 1 -- 172.21.15.53:0/3941576208 learned_addr learned my addr 172.21.15.53:0/3941576208 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:09:02.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.491+0000 7f58aac6f640 1 --2- 172.21.15.53:0/3941576208 >> v2:172.21.15.117:3300/0 conn(0x7f58a40d1b00 0x7f58a40d05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:02.498 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.491+0000 7f58a9c6d640 1 -- 172.21.15.53:0/3941576208 >> v2:172.21.15.117:3300/0 conn(0x7f58a40d1b00 msgr2=0x7f58a40d05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:09:02.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.491+0000 7f58a9c6d640 1 --2- 172.21.15.53:0/3941576208 >> v2:172.21.15.117:3300/0 conn(0x7f58a40d1b00 0x7f58a40d05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:02.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.491+0000 7f58a9c6d640 1 -- 172.21.15.53:0/3941576208 >> v1:172.21.15.117:6789/0 conn(0x7f58a40b3ac0 legacy=0x7f58a40b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:09:02.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.491+0000 7f58a9c6d640 1 -- 172.21.15.53:0/3941576208 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58a40b7b50 con 0x7f58a40cc690 2023-06-10T19:09:02.499 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.491+0000 7f58aac6f640 1 --2- 172.21.15.53:0/3941576208 >> v2:172.21.15.117:3300/0 conn(0x7f58a40d1b00 0x7f58a40d05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:09:02.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.495+0000 7f58a9c6d640 1 --2- 172.21.15.53:0/3941576208 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f58a40cc690 0x7f58a40d00a0 secure :-1 s=READY pgs=2722 cs=0 l=1 rev1=1 crypto rx=0x7f58a40b8110 tx=0x7f589401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eea7dd7ce2f3ffc server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:02.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.495+0000 7f58a946c640 1 -- 172.21.15.53:0/3941576208 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58940ad640 con 0x7f58a40cc690 2023-06-10T19:09:02.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.495+0000 7f58a946c640 1 -- 172.21.15.53:0/3941576208 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58940ad7a0 con 0x7f58a40cc690 2023-06-10T19:09:02.500 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.495+0000 7f58a946c640 1 -- 172.21.15.53:0/3941576208 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58940adb30 con 0x7f58a40cc690 2023-06-10T19:09:02.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.495+0000 7f58ac6d2640 1 -- 172.21.15.53:0/3941576208 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f58a40cc690 msgr2=0x7f58a40d00a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:02.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.495+0000 7f58ac6d2640 1 --2- 172.21.15.53:0/3941576208 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f58a40cc690 0x7f58a40d00a0 secure :-1 s=READY pgs=2722 cs=0 l=1 rev1=1 crypto rx=0x7f58a40b8110 tx=0x7f589401c370 comp rx=0 tx=0).stop 2023-06-10T19:09:02.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.495+0000 7f58ac6d2640 1 -- 172.21.15.53:0/3941576208 shutdown_connections 2023-06-10T19:09:02.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.495+0000 7f58ac6d2640 1 --2- 172.21.15.53:0/3941576208 >> v2:172.21.15.117:3300/0 conn(0x7f58a40d1b00 0x7f58a40d05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:02.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.495+0000 7f58ac6d2640 1 --2- 172.21.15.53:0/3941576208 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f58a40cc690 0x7f58a40d00a0 unknown :-1 s=CLOSED pgs=2722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:02.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.495+0000 7f58ac6d2640 1 -- 172.21.15.53:0/3941576208 >> 172.21.15.53:0/3941576208 conn(0x7f58a4069de0 msgr2=0x7f58a406a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:09:02.501 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.495+0000 7f58ac6d2640 1 -- 172.21.15.53:0/3941576208 shutdown_connections 2023-06-10T19:09:02.502 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.495+0000 7f58ac6d2640 1 -- 172.21.15.53:0/3941576208 wait complete. 2023-06-10T19:09:02.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.495+0000 7f58ac6d2640 1 Processor -- start 2023-06-10T19:09:02.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.495+0000 7f58ac6d2640 1 -- start start 2023-06-10T19:09:02.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.495+0000 7f58ac6d2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58a40b3ac0 0x7f58a4157d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:02.503 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.495+0000 7f58ac6d2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f58a40cc690 0x7f58a40c6f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:02.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.495+0000 7f58ac6d2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58a40d1b00 0x7f58a415ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:02.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.495+0000 7f58ac6d2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a40c94f0 con 0x7f58a40cc690 2023-06-10T19:09:02.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.495+0000 7f58ac6d2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a40c97d0 con 0x7f58a40b3ac0 2023-06-10T19:09:02.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.495+0000 7f58ac6d2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58a40c9ab0 con 0x7f58a40d1b00 2023-06-10T19:09:02.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.495+0000 7f58a9c6d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f58a40cc690 0x7f58a40c6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:02.504 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.495+0000 7f58a9c6d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f58a40cc690 0x7f58a40c6f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54926/0 (socket says 172.21.15.53:54926) 2023-06-10T19:09:02.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.495+0000 7f58a9c6d640 1 -- 172.21.15.53:0/2771239090 learned_addr learned my addr 172.21.15.53:0/2771239090 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:09:02.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.495+0000 7f58aac6f640 1 --2- 172.21.15.53:0/2771239090 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58a40d1b00 0x7f58a415ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:02.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.499+0000 7f58aa46e640 1 --2- 172.21.15.53:0/2771239090 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58a40b3ac0 0x7f58a4157d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:02.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.499+0000 7f58a9c6d640 1 -- 172.21.15.53:0/2771239090 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58a40d1b00 msgr2=0x7f58a415ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:02.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.499+0000 7f58a9c6d640 1 --2- 172.21.15.53:0/2771239090 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58a40d1b00 0x7f58a415ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:02.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.499+0000 7f58a9c6d640 1 -- 172.21.15.53:0/2771239090 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58a40b3ac0 msgr2=0x7f58a4157d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:02.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.499+0000 7f58a9c6d640 1 --2- 172.21.15.53:0/2771239090 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58a40b3ac0 0x7f58a4157d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:02.505 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.499+0000 7f58a9c6d640 1 -- 172.21.15.53:0/2771239090 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58940094d0 con 0x7f58a40cc690 2023-06-10T19:09:02.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.499+0000 7f58aa46e640 1 --2- 172.21.15.53:0/2771239090 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58a40b3ac0 0x7f58a4157d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:09:02.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.499+0000 7f58a9c6d640 1 --2- 172.21.15.53:0/2771239090 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f58a40cc690 0x7f58a40c6f30 secure :-1 s=READY pgs=2723 cs=0 l=1 rev1=1 crypto rx=0x7f5894019fa0 tx=0x7f5894019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:02.506 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.499+0000 7f589affd640 1 -- 172.21.15.53:0/2771239090 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58940b77f0 con 0x7f58a40cc690 2023-06-10T19:09:02.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.499+0000 7f589affd640 1 -- 172.21.15.53:0/2771239090 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58940a6040 con 0x7f58a40cc690 2023-06-10T19:09:02.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.499+0000 7f58ac6d2640 1 -- 172.21.15.53:0/2771239090 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58a40c9d90 con 0x7f58a40cc690 2023-06-10T19:09:02.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.499+0000 7f589affd640 1 -- 172.21.15.53:0/2771239090 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58940b7bb0 con 0x7f58a40cc690 2023-06-10T19:09:02.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.499+0000 7f58ac6d2640 1 -- 172.21.15.53:0/2771239090 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58a40c9110 con 0x7f58a40cc690 2023-06-10T19:09:02.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.499+0000 7f58ac6d2640 1 -- 172.21.15.53:0/2771239090 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58a404d790 con 0x7f58a40cc690 2023-06-10T19:09:02.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.499+0000 7f589affd640 1 -- 172.21.15.53:0/2771239090 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f58940b7d10 con 0x7f58a40cc690 2023-06-10T19:09:02.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.499+0000 7f589affd640 1 --2- 172.21.15.53:0/2771239090 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f58880662b0 0x7f5888068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:02.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.499+0000 7f589affd640 1 -- 172.21.15.53:0/2771239090 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6192+0+0 (secure 0 0 0) 0x7f589411e9c0 con 0x7f58a40cc690 2023-06-10T19:09:02.508 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.499+0000 7f58aa46e640 1 --2- 172.21.15.53:0/2771239090 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f58880662b0 0x7f5888068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:02.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.499+0000 7f58aa46e640 1 --2- 172.21.15.53:0/2771239090 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f58880662b0 0x7f5888068760 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f58a0004530 tx=0x7f58a0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:02.509 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.503+0000 7f589affd640 1 -- 172.21.15.53:0/2771239090 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f58940ebdc0 con 0x7f58a40cc690 2023-06-10T19:09:02.695 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:02.687+0000 7f58ac6d2640 1 -- 172.21.15.53:0/2771239090 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f58a404d790 con 0x7f58a40cc690 2023-06-10T19:09:03.365 INFO:tasks.ceph.mon.a.smithi053.stderr:2023-06-10T19:09:03.363+0000 7f74752c1640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-06-10T19:09:03.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.375+0000 7f589affd640 1 -- 172.21.15.53:0/2771239090 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v105) v1 ==== 161+0+0 (secure 0 0 0) 0x7f58940b2090 con 0x7f58a40cc690 2023-06-10T19:09:03.381 INFO:teuthology.orchestra.run.smithi053.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-06-10T19:09:03.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.379+0000 7f58ac6d2640 1 -- 172.21.15.53:0/2771239090 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f58880662b0 msgr2=0x7f5888068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:03.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.379+0000 7f58ac6d2640 1 --2- 172.21.15.53:0/2771239090 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f58880662b0 0x7f5888068760 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f58a0004530 tx=0x7f58a0009040 comp rx=0 tx=0).stop 2023-06-10T19:09:03.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.379+0000 7f58ac6d2640 1 -- 172.21.15.53:0/2771239090 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f58a40cc690 msgr2=0x7f58a40c6f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:03.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.379+0000 7f58ac6d2640 1 --2- 172.21.15.53:0/2771239090 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f58a40cc690 0x7f58a40c6f30 secure :-1 s=READY pgs=2723 cs=0 l=1 rev1=1 crypto rx=0x7f5894019fa0 tx=0x7f5894019110 comp rx=0 tx=0).stop 2023-06-10T19:09:03.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.379+0000 7f58ac6d2640 1 -- 172.21.15.53:0/2771239090 shutdown_connections 2023-06-10T19:09:03.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.379+0000 7f58ac6d2640 1 --2- 172.21.15.53:0/2771239090 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f58880662b0 0x7f5888068760 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:03.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.379+0000 7f58ac6d2640 1 --2- 172.21.15.53:0/2771239090 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f58a40d1b00 0x7f58a415ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:03.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.379+0000 7f58ac6d2640 1 --2- 172.21.15.53:0/2771239090 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f58a40cc690 0x7f58a40c6f30 unknown :-1 s=CLOSED pgs=2723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:03.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.379+0000 7f58ac6d2640 1 --2- 172.21.15.53:0/2771239090 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58a40b3ac0 0x7f58a4157d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:03.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.379+0000 7f58ac6d2640 1 -- 172.21.15.53:0/2771239090 >> 172.21.15.53:0/2771239090 conn(0x7f58a4069de0 msgr2=0x7f58a415f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:09:03.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.379+0000 7f58ac6d2640 1 -- 172.21.15.53:0/2771239090 shutdown_connections 2023-06-10T19:09:03.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.379+0000 7f58ac6d2640 1 -- 172.21.15.53:0/2771239090 wait complete. 2023-06-10T19:09:03.386 INFO:tasks.ceph.mds.c.smithi053.stderr: -4430> 2023-06-10T19:08:09.325+0000 7f3c4702d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-06-10T19:09:03.408 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-06-10T19:09:03.429 INFO:tasks.ceph.mds.c.smithi053.stdout:starting mds.c at 2023-06-10T19:09:03.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.531+0000 7f075fe7f640 1 Processor -- start 2023-06-10T19:09:03.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.531+0000 7f075fe7f640 1 -- start start 2023-06-10T19:09:03.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.531+0000 7f075fe7f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f075815c4f0 0x7f075806bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:03.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.531+0000 7f075fe7f640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f075806b090 con 0x7f075815c070 2023-06-10T19:09:03.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.531+0000 7f075fe7f640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f075806efa0 con 0x7f0758156180 2023-06-10T19:09:03.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.531+0000 7f075fe7f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07580cc720 con 0x7f075815c4f0 2023-06-10T19:09:03.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.531+0000 7f075d41a640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f075815c070 0x7f075806b800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56728/0 (socket says 172.21.15.53:56728) 2023-06-10T19:09:03.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.531+0000 7f075d41a640 1 -- 172.21.15.53:0/2682747070 learned_addr learned my addr 172.21.15.53:0/2682747070 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:09:03.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.531+0000 7f075cc19640 1 -- 172.21.15.53:0/2682747070 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3303601577 0 0) 0x7f075806b090 con 0x7f075815c070 2023-06-10T19:09:03.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.531+0000 7f075e41c640 1 --2- 172.21.15.53:0/2682747070 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f075815c4f0 0x7f075806bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:03.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.531+0000 7f075cc19640 1 -- 172.21.15.53:0/2682747070 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0744005740 con 0x7f075815c070 2023-06-10T19:09:03.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.531+0000 7f075cc19640 1 -- 172.21.15.53:0/2682747070 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1504810370 0 0) 0x7f0744005740 con 0x7f075815c070 2023-06-10T19:09:03.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.531+0000 7f075cc19640 1 -- 172.21.15.53:0/2682747070 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f075815c4f0 msgr2=0x7f075806bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:09:03.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.531+0000 7f075cc19640 1 --2- 172.21.15.53:0/2682747070 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f075815c4f0 0x7f075806bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:03.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.531+0000 7f075cc19640 1 -- 172.21.15.53:0/2682747070 >> v1:172.21.15.117:6789/0 conn(0x7f0758156180 legacy=0x7f07580cd4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:03.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.531+0000 7f075cc19640 1 -- 172.21.15.53:0/2682747070 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07580cc9a0 con 0x7f075815c070 2023-06-10T19:09:03.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.531+0000 7f075cc19640 1 -- 172.21.15.53:0/2682747070 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f0748001680 con 0x7f075815c070 2023-06-10T19:09:03.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.531+0000 7f075cc19640 1 -- 172.21.15.53:0/2682747070 >> v1:172.21.15.53:6789/0 conn(0x7f075815c070 legacy=0x7f075806b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:03.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.531+0000 7f075cc19640 1 --2- 172.21.15.53:0/2682747070 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0744005bc0 0x7f0744005fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:03.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.531+0000 7f075cc19640 1 --2- 172.21.15.53:0/2682747070 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f075815c4f0 0x7f07440069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:03.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.531+0000 7f075cc19640 1 --2- 172.21.15.53:0/2682747070 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0744006f20 0x7f0744007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:03.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.531+0000 7f075cc19640 1 -- 172.21.15.53:0/2682747070 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07580cc720 con 0x7f0744005bc0 2023-06-10T19:09:03.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.531+0000 7f075cc19640 1 -- 172.21.15.53:0/2682747070 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f074400dc50 con 0x7f0744006f20 2023-06-10T19:09:03.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.531+0000 7f075cc19640 1 -- 172.21.15.53:0/2682747070 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f074400dde0 con 0x7f075815c4f0 2023-06-10T19:09:03.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.531+0000 7f075dc1b640 1 --2- 172.21.15.53:0/2682747070 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0744005bc0 0x7f0744005fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:03.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.531+0000 7f075d41a640 1 --2- 172.21.15.53:0/2682747070 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f075815c4f0 0x7f07440069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:03.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.531+0000 7f075e41c640 1 --2- 172.21.15.53:0/2682747070 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0744006f20 0x7f0744007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:03.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.531+0000 7f075dc1b640 1 -- 172.21.15.53:0/2682747070 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f075815c4f0 msgr2=0x7f07440069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:09:03.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.531+0000 7f075dc1b640 1 --2- 172.21.15.53:0/2682747070 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f075815c4f0 0x7f07440069e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:03.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.531+0000 7f075dc1b640 1 -- 172.21.15.53:0/2682747070 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0744006f20 msgr2=0x7f0744007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:09:03.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.531+0000 7f075dc1b640 1 --2- 172.21.15.53:0/2682747070 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0744006f20 0x7f0744007390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:03.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.531+0000 7f075dc1b640 1 -- 172.21.15.53:0/2682747070 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0744005740 con 0x7f0744005bc0 2023-06-10T19:09:03.547 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.531+0000 7f075d41a640 1 --2- 172.21.15.53:0/2682747070 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f075815c4f0 0x7f07440069e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:09:03.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.535+0000 7f075dc1b640 1 --2- 172.21.15.53:0/2682747070 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0744005bc0 0x7f0744005fd0 secure :-1 s=READY pgs=2728 cs=0 l=1 rev1=1 crypto rx=0x7f0754001750 tx=0x7f075401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d5e07be7b27151e server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:03.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.535+0000 7f075cc19640 1 -- 172.21.15.53:0/2682747070 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07540052d0 con 0x7f0744005bc0 2023-06-10T19:09:03.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.535+0000 7f075cc19640 1 -- 172.21.15.53:0/2682747070 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07540a7050 con 0x7f0744005bc0 2023-06-10T19:09:03.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.535+0000 7f075cc19640 1 -- 172.21.15.53:0/2682747070 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0754003600 con 0x7f0744005bc0 2023-06-10T19:09:03.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.535+0000 7f075fe7f640 1 -- 172.21.15.53:0/2682747070 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0744005bc0 msgr2=0x7f0744005fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:03.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.535+0000 7f075fe7f640 1 --2- 172.21.15.53:0/2682747070 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0744005bc0 0x7f0744005fd0 secure :-1 s=READY pgs=2728 cs=0 l=1 rev1=1 crypto rx=0x7f0754001750 tx=0x7f075401c3c0 comp rx=0 tx=0).stop 2023-06-10T19:09:03.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.535+0000 7f075e41c640 1 -- 172.21.15.53:0/2682747070 reap_dead start 2023-06-10T19:09:03.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.535+0000 7f075fe7f640 1 -- 172.21.15.53:0/2682747070 shutdown_connections 2023-06-10T19:09:03.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.535+0000 7f075fe7f640 1 -- 172.21.15.53:0/2682747070 >> 172.21.15.53:0/2682747070 conn(0x7f075806a0e0 msgr2=0x7f07580cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:09:03.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.535+0000 7f075fe7f640 1 -- 172.21.15.53:0/2682747070 shutdown_connections 2023-06-10T19:09:03.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.535+0000 7f075fe7f640 1 -- 172.21.15.53:0/2682747070 wait complete. 2023-06-10T19:09:03.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.535+0000 7f075fe7f640 1 Processor -- start 2023-06-10T19:09:03.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.535+0000 7f075fe7f640 1 -- start start 2023-06-10T19:09:03.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.539+0000 7f075fe7f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0744005bc0 0x7f0758151100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:03.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.539+0000 7f075fe7f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f075814bad0 0x7f075815a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:03.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.539+0000 7f075fe7f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f075815a570 0x7f0758161540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:03.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.539+0000 7f075fe7f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f075814c4b0 con 0x7f075814bad0 2023-06-10T19:09:03.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.539+0000 7f075fe7f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f075815b490 con 0x7f0744005bc0 2023-06-10T19:09:03.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.539+0000 7f075fe7f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f075815a9e0 con 0x7f075815a570 2023-06-10T19:09:03.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.539+0000 7f075d41a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f075814bad0 0x7f075815a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:03.555 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.539+0000 7f075d41a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f075814bad0 0x7f075815a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54964/0 (socket says 172.21.15.53:54964) 2023-06-10T19:09:03.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.539+0000 7f075dc1b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0744005bc0 0x7f0758151100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:03.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.539+0000 7f075d41a640 1 -- 172.21.15.53:0/1504849248 learned_addr learned my addr 172.21.15.53:0/1504849248 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:09:03.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.539+0000 7f075e41c640 1 --2- 172.21.15.53:0/1504849248 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f075815a570 0x7f0758161540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:03.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.539+0000 7f075d41a640 1 -- 172.21.15.53:0/1504849248 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f075815a570 msgr2=0x7f0758161540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:03.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.539+0000 7f075d41a640 1 --2- 172.21.15.53:0/1504849248 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f075815a570 0x7f0758161540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:03.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.539+0000 7f075d41a640 1 -- 172.21.15.53:0/1504849248 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0744005bc0 msgr2=0x7f0758151100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:03.556 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.539+0000 7f075d41a640 1 --2- 172.21.15.53:0/1504849248 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0744005bc0 0x7f0758151100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:03.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.539+0000 7f075d41a640 1 -- 172.21.15.53:0/1504849248 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f075814ed70 con 0x7f075814bad0 2023-06-10T19:09:03.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.539+0000 7f075dc1b640 1 --2- 172.21.15.53:0/1504849248 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0744005bc0 0x7f0758151100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:09:03.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.539+0000 7f075d41a640 1 --2- 172.21.15.53:0/1504849248 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f075814bad0 0x7f075815a030 secure :-1 s=READY pgs=2729 cs=0 l=1 rev1=1 crypto rx=0x7f0748007fd0 tx=0x7f074800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:03.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.539+0000 7f074e7fc640 1 -- 172.21.15.53:0/1504849248 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07480074e0 con 0x7f075814bad0 2023-06-10T19:09:03.557 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.539+0000 7f074e7fc640 1 -- 172.21.15.53:0/1504849248 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0748007640 con 0x7f075814bad0 2023-06-10T19:09:03.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.539+0000 7f075fe7f640 1 -- 172.21.15.53:0/1504849248 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f075815abf0 con 0x7f075814bad0 2023-06-10T19:09:03.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.539+0000 7f074e7fc640 1 -- 172.21.15.53:0/1504849248 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07480049f0 con 0x7f075814bad0 2023-06-10T19:09:03.558 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.539+0000 7f075fe7f640 1 -- 172.21.15.53:0/1504849248 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f075815b1b0 con 0x7f075814bad0 2023-06-10T19:09:03.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.539+0000 7f075fe7f640 1 -- 172.21.15.53:0/1504849248 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f075804d790 con 0x7f075814bad0 2023-06-10T19:09:03.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.539+0000 7f074e7fc640 1 -- 172.21.15.53:0/1504849248 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0748004b50 con 0x7f075814bad0 2023-06-10T19:09:03.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.539+0000 7f074e7fc640 1 --2- 172.21.15.53:0/1504849248 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f073c0662b0 0x7f073c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:03.559 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.539+0000 7f074e7fc640 1 -- 172.21.15.53:0/1504849248 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 6278+0+0 (secure 0 0 0) 0x7f0748083a60 con 0x7f075814bad0 2023-06-10T19:09:03.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.543+0000 7f075dc1b640 1 --2- 172.21.15.53:0/1504849248 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f073c0662b0 0x7f073c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:03.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.543+0000 7f075dc1b640 1 --2- 172.21.15.53:0/1504849248 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f073c0662b0 0x7f073c068760 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f075806f130 tx=0x7f07540011a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:03.560 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.547+0000 7f074e7fc640 1 -- 172.21.15.53:0/1504849248 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0748050e00 con 0x7f075814bad0 2023-06-10T19:09:03.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:03.727+0000 7f075fe7f640 1 -- 172.21.15.53:0/1504849248 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f07580b3c60 con 0x7f075814bad0 2023-06-10T19:09:04.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:04.383+0000 7f074e7fc640 1 -- 172.21.15.53:0/1504849248 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v106) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0748083030 con 0x7f075814bad0 2023-06-10T19:09:04.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:04.387+0000 7f075fe7f640 1 -- 172.21.15.53:0/1504849248 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f073c0662b0 msgr2=0x7f073c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:04.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:04.387+0000 7f075fe7f640 1 --2- 172.21.15.53:0/1504849248 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f073c0662b0 0x7f073c068760 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f075806f130 tx=0x7f07540011a0 comp rx=0 tx=0).stop 2023-06-10T19:09:04.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:04.387+0000 7f075fe7f640 1 -- 172.21.15.53:0/1504849248 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f075814bad0 msgr2=0x7f075815a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:04.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:04.387+0000 7f075fe7f640 1 --2- 172.21.15.53:0/1504849248 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f075814bad0 0x7f075815a030 secure :-1 s=READY pgs=2729 cs=0 l=1 rev1=1 crypto rx=0x7f0748007fd0 tx=0x7f074800dc00 comp rx=0 tx=0).stop 2023-06-10T19:09:04.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:04.387+0000 7f075fe7f640 1 -- 172.21.15.53:0/1504849248 shutdown_connections 2023-06-10T19:09:04.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:04.387+0000 7f075fe7f640 1 --2- 172.21.15.53:0/1504849248 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f073c0662b0 0x7f073c068760 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:04.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:04.387+0000 7f075fe7f640 1 --2- 172.21.15.53:0/1504849248 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f075815a570 0x7f0758161540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:04.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:04.387+0000 7f075fe7f640 1 --2- 172.21.15.53:0/1504849248 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f075814bad0 0x7f075815a030 unknown :-1 s=CLOSED pgs=2729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:04.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:04.387+0000 7f075fe7f640 1 --2- 172.21.15.53:0/1504849248 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0744005bc0 0x7f0758151100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:04.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:04.387+0000 7f075fe7f640 1 -- 172.21.15.53:0/1504849248 >> 172.21.15.53:0/1504849248 conn(0x7f075806a0e0 msgr2=0x7f07580aede0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:09:04.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:04.387+0000 7f075fe7f640 1 -- 172.21.15.53:0/1504849248 shutdown_connections 2023-06-10T19:09:04.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:04.387+0000 7f075fe7f640 1 -- 172.21.15.53:0/1504849248 wait complete. 2023-06-10T19:09:04.412 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-06-10T19:09:04.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:04.579+0000 7efd4201e640 1 Processor -- start 2023-06-10T19:09:04.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:04.579+0000 7efd4201e640 1 -- start start 2023-06-10T19:09:04.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:04.579+0000 7efd4201e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7efd3c15d0b0 0x7efd3c0c8e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:04.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:04.579+0000 7efd4201e640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7efd3c158bc0 0x7efd3c0cbe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:04.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:04.579+0000 7efd4201e640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd3c159120 con 0x7efd3c06c210 2023-06-10T19:09:04.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:04.579+0000 7efd4201e640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd3c159400 con 0x7efd3c15d0b0 2023-06-10T19:09:04.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:04.579+0000 7efd4201e640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd3c1596e0 con 0x7efd3c158bc0 2023-06-10T19:09:04.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:04.579+0000 7efd3affd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7efd3c15d0b0 0x7efd3c0c8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:04.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:04.579+0000 7efd3affd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7efd3c15d0b0 0x7efd3c0c8e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54968/0 (socket says 172.21.15.53:54968) 2023-06-10T19:09:04.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:04.579+0000 7efd3affd640 1 -- 172.21.15.53:0/1944698495 learned_addr learned my addr 172.21.15.53:0/1944698495 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:09:04.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:04.579+0000 7efd3affd640 1 -- 172.21.15.53:0/1944698495 >> v2:172.21.15.117:3300/0 conn(0x7efd3c158bc0 msgr2=0x7efd3c0cbe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:09:04.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:04.579+0000 7efd3affd640 1 --2- 172.21.15.53:0/1944698495 >> v2:172.21.15.117:3300/0 conn(0x7efd3c158bc0 0x7efd3c0cbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:04.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:04.579+0000 7efd3affd640 1 -- 172.21.15.53:0/1944698495 >> v1:172.21.15.117:6789/0 conn(0x7efd3c06c210 legacy=0x7efd3c06c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:09:04.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:04.579+0000 7efd3affd640 1 -- 172.21.15.53:0/1944698495 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd3c1599c0 con 0x7efd3c15d0b0 2023-06-10T19:09:04.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:04.583+0000 7efd3affd640 1 --2- 172.21.15.53:0/1944698495 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd3c15d0b0 0x7efd3c0c8e10 secure :-1 s=READY pgs=2730 cs=0 l=1 rev1=1 crypto rx=0x7efd3c06eb80 tx=0x7efd2401eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba8a9e20daff6513 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:04.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:04.583+0000 7efd3a7fc640 1 -- 172.21.15.53:0/1944698495 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd240a7c80 con 0x7efd3c15d0b0 2023-06-10T19:09:04.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:04.583+0000 7efd3a7fc640 1 -- 172.21.15.53:0/1944698495 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd240a7de0 con 0x7efd3c15d0b0 2023-06-10T19:09:04.589 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:04.583+0000 7efd3a7fc640 1 -- 172.21.15.53:0/1944698495 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd240af660 con 0x7efd3c15d0b0 2023-06-10T19:09:04.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:04.583+0000 7efd4201e640 1 -- 172.21.15.53:0/1944698495 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd3c15d0b0 msgr2=0x7efd3c0c8e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:04.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:04.583+0000 7efd4201e640 1 --2- 172.21.15.53:0/1944698495 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd3c15d0b0 0x7efd3c0c8e10 secure :-1 s=READY pgs=2730 cs=0 l=1 rev1=1 crypto rx=0x7efd3c06eb80 tx=0x7efd2401eb90 comp rx=0 tx=0).stop 2023-06-10T19:09:04.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:04.583+0000 7efd4201e640 1 -- 172.21.15.53:0/1944698495 shutdown_connections 2023-06-10T19:09:04.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:04.583+0000 7efd4201e640 1 --2- 172.21.15.53:0/1944698495 >> v2:172.21.15.117:3300/0 conn(0x7efd3c158bc0 0x7efd3c0cbe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:04.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:04.583+0000 7efd4201e640 1 --2- 172.21.15.53:0/1944698495 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd3c15d0b0 0x7efd3c0c8e10 unknown :-1 s=CLOSED pgs=2730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:04.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:04.583+0000 7efd4201e640 1 -- 172.21.15.53:0/1944698495 >> 172.21.15.53:0/1944698495 conn(0x7efd3c0ca830 msgr2=0x7efd3c0cac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:09:04.590 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:04.583+0000 7efd4201e640 1 -- 172.21.15.53:0/1944698495 shutdown_connections 2023-06-10T19:09:04.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:04.583+0000 7efd4201e640 1 -- 172.21.15.53:0/1944698495 wait complete. 2023-06-10T19:09:04.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:04.583+0000 7efd4201e640 1 Processor -- start 2023-06-10T19:09:04.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:04.583+0000 7efd4201e640 1 -- start start 2023-06-10T19:09:04.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:04.587+0000 7efd4201e640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efd3c06c210 0x7efd3c1517b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:04.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:04.587+0000 7efd4201e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd3c158bc0 0x7efd3c14e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:04.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:04.587+0000 7efd4201e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efd3c15d0b0 0x7efd3c156c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:04.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:04.587+0000 7efd4201e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd3c1561c0 con 0x7efd3c158bc0 2023-06-10T19:09:04.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:04.587+0000 7efd4201e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd3c152000 con 0x7efd3c15d0b0 2023-06-10T19:09:04.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:04.587+0000 7efd4201e640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd3c1522e0 con 0x7efd3c06c210 2023-06-10T19:09:04.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:04.587+0000 7efd3affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd3c158bc0 0x7efd3c14e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:04.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:04.587+0000 7efd3affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd3c158bc0 0x7efd3c14e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54984/0 (socket says 172.21.15.53:54984) 2023-06-10T19:09:04.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:04.587+0000 7efd3affd640 1 -- 172.21.15.53:0/1186680955 learned_addr learned my addr 172.21.15.53:0/1186680955 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:09:04.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:04.587+0000 7efd3bfff640 1 --2- 172.21.15.53:0/1186680955 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efd3c15d0b0 0x7efd3c156c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:04.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:04.587+0000 7efd3b7fe640 1 --2- 172.21.15.53:0/1186680955 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efd3c06c210 0x7efd3c1517b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:04.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:04.587+0000 7efd3affd640 1 -- 172.21.15.53:0/1186680955 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efd3c06c210 msgr2=0x7efd3c1517b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:04.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:04.587+0000 7efd3affd640 1 --2- 172.21.15.53:0/1186680955 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efd3c06c210 0x7efd3c1517b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:04.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:04.587+0000 7efd3affd640 1 -- 172.21.15.53:0/1186680955 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efd3c15d0b0 msgr2=0x7efd3c156c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:04.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:04.587+0000 7efd3affd640 1 --2- 172.21.15.53:0/1186680955 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efd3c15d0b0 0x7efd3c156c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:04.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:04.587+0000 7efd3affd640 1 -- 172.21.15.53:0/1186680955 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd2400b770 con 0x7efd3c158bc0 2023-06-10T19:09:04.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:04.587+0000 7efd3affd640 1 --2- 172.21.15.53:0/1186680955 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd3c158bc0 0x7efd3c14e970 secure :-1 s=READY pgs=2731 cs=0 l=1 rev1=1 crypto rx=0x7efd2400b2c0 tx=0x7efd2401d3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:04.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:04.587+0000 7efd33fff640 1 -- 172.21.15.53:0/1186680955 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd240ba480 con 0x7efd3c158bc0 2023-06-10T19:09:04.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:04.587+0000 7efd33fff640 1 -- 172.21.15.53:0/1186680955 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd240ba5e0 con 0x7efd3c158bc0 2023-06-10T19:09:04.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:04.587+0000 7efd4201e640 1 -- 172.21.15.53:0/1186680955 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd3c156410 con 0x7efd3c158bc0 2023-06-10T19:09:04.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:04.587+0000 7efd33fff640 1 -- 172.21.15.53:0/1186680955 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd240ba990 con 0x7efd3c158bc0 2023-06-10T19:09:04.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:04.587+0000 7efd4201e640 1 -- 172.21.15.53:0/1186680955 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd3c151cf0 con 0x7efd3c158bc0 2023-06-10T19:09:04.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:04.587+0000 7efd4201e640 1 -- 172.21.15.53:0/1186680955 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd3c152470 con 0x7efd3c158bc0 2023-06-10T19:09:04.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:04.587+0000 7efd33fff640 1 -- 172.21.15.53:0/1186680955 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7efd240baaf0 con 0x7efd3c158bc0 2023-06-10T19:09:04.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:04.587+0000 7efd33fff640 1 --2- 172.21.15.53:0/1186680955 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efd1c066280 0x7efd1c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:04.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:04.587+0000 7efd33fff640 1 -- 172.21.15.53:0/1186680955 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 6278+0+0 (secure 0 0 0) 0x7efd2411f7b0 con 0x7efd3c158bc0 2023-06-10T19:09:04.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:04.587+0000 7efd3b7fe640 1 --2- 172.21.15.53:0/1186680955 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efd1c066280 0x7efd1c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:04.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:04.591+0000 7efd3b7fe640 1 --2- 172.21.15.53:0/1186680955 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efd1c066280 0x7efd1c068730 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7efd34007dc0 tx=0x7efd340072f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:04.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:04.591+0000 7efd33fff640 1 -- 172.21.15.53:0/1186680955 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7efd240ecb50 con 0x7efd3c158bc0 2023-06-10T19:09:04.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:04.751+0000 7efd4201e640 1 -- 172.21.15.53:0/1186680955 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7efd3c152470 con 0x7efd3c158bc0 2023-06-10T19:09:05.471 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:05.463+0000 7efd33fff640 1 -- 172.21.15.53:0/1186680955 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v185) v1 ==== 181+0+0 (secure 0 0 0) 0x7efd240f0170 con 0x7efd3c158bc0 2023-06-10T19:09:05.471 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_metadata' removed 2023-06-10T19:09:05.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:05.467+0000 7efd4201e640 1 -- 172.21.15.53:0/1186680955 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efd1c066280 msgr2=0x7efd1c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:05.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:05.467+0000 7efd4201e640 1 --2- 172.21.15.53:0/1186680955 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efd1c066280 0x7efd1c068730 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7efd34007dc0 tx=0x7efd340072f0 comp rx=0 tx=0).stop 2023-06-10T19:09:05.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:05.467+0000 7efd4201e640 1 -- 172.21.15.53:0/1186680955 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd3c158bc0 msgr2=0x7efd3c14e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:05.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:05.467+0000 7efd4201e640 1 --2- 172.21.15.53:0/1186680955 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd3c158bc0 0x7efd3c14e970 secure :-1 s=READY pgs=2731 cs=0 l=1 rev1=1 crypto rx=0x7efd2400b2c0 tx=0x7efd2401d3d0 comp rx=0 tx=0).stop 2023-06-10T19:09:05.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:05.467+0000 7efd4201e640 1 -- 172.21.15.53:0/1186680955 shutdown_connections 2023-06-10T19:09:05.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:05.467+0000 7efd4201e640 1 --2- 172.21.15.53:0/1186680955 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7efd1c066280 0x7efd1c068730 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:05.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:05.467+0000 7efd4201e640 1 --2- 172.21.15.53:0/1186680955 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efd3c15d0b0 0x7efd3c156c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:05.475 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:05.467+0000 7efd4201e640 1 --2- 172.21.15.53:0/1186680955 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efd3c158bc0 0x7efd3c14e970 unknown :-1 s=CLOSED pgs=2731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:05.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:05.467+0000 7efd4201e640 1 --2- 172.21.15.53:0/1186680955 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efd3c06c210 0x7efd3c1517b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:05.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:05.467+0000 7efd4201e640 1 -- 172.21.15.53:0/1186680955 >> 172.21.15.53:0/1186680955 conn(0x7efd3c0ca830 msgr2=0x7efd3c06b100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:09:05.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:05.467+0000 7efd4201e640 1 -- 172.21.15.53:0/1186680955 shutdown_connections 2023-06-10T19:09:05.476 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:05.467+0000 7efd4201e640 1 -- 172.21.15.53:0/1186680955 wait complete. 2023-06-10T19:09:05.496 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-06-10T19:09:05.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:05.623+0000 7fdd0ee18640 1 Processor -- start 2023-06-10T19:09:05.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:05.623+0000 7fdd0ee18640 1 -- start start 2023-06-10T19:09:05.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:05.623+0000 7fdd0ee18640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fdd0815b9a0 0x7fdd080acdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:05.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:05.623+0000 7fdd0ee18640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd080c9f40 0x7fdd080ad330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:05.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:05.623+0000 7fdd0ee18640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fdd080ca400 0x7fdd0806b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:05.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:05.623+0000 7fdd0ee18640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd080cde50 con 0x7fdd080ca400 2023-06-10T19:09:05.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:05.623+0000 7fdd0ee18640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd080cb3b0 con 0x7fdd0815b9a0 2023-06-10T19:09:05.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:05.623+0000 7fdd0ee18640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd080caa80 con 0x7fdd080c9f40 2023-06-10T19:09:05.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:05.623+0000 7fdd0d3b5640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fdd080ca400 0x7fdd0806b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:05.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:05.623+0000 7fdd0d3b5640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fdd080ca400 0x7fdd0806b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:54990/0 (socket says 172.21.15.53:54990) 2023-06-10T19:09:05.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:05.623+0000 7fdd0d3b5640 1 -- 172.21.15.53:0/1933119013 learned_addr learned my addr 172.21.15.53:0/1933119013 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:09:05.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:05.623+0000 7fdd07fff640 1 --2- 172.21.15.53:0/1933119013 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd080c9f40 0x7fdd080ad330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:05.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:05.623+0000 7fdd0cbb4640 1 --2- 172.21.15.53:0/1933119013 >> v2:172.21.15.117:3300/0 conn(0x7fdd0815b9a0 0x7fdd080acdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:05.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:05.623+0000 7fdd0d3b5640 1 -- 172.21.15.53:0/1933119013 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd080c9f40 msgr2=0x7fdd080ad330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:09:05.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:05.623+0000 7fdd0d3b5640 1 --2- 172.21.15.53:0/1933119013 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd080c9f40 0x7fdd080ad330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:05.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:05.623+0000 7fdd0d3b5640 1 -- 172.21.15.53:0/1933119013 >> v2:172.21.15.117:3300/0 conn(0x7fdd0815b9a0 msgr2=0x7fdd080acdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:09:05.631 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:05.623+0000 7fdd0d3b5640 1 --2- 172.21.15.53:0/1933119013 >> v2:172.21.15.117:3300/0 conn(0x7fdd0815b9a0 0x7fdd080acdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:05.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:05.623+0000 7fdd0d3b5640 1 -- 172.21.15.53:0/1933119013 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd080cad60 con 0x7fdd080ca400 2023-06-10T19:09:05.632 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:05.627+0000 7fdd0d3b5640 1 --2- 172.21.15.53:0/1933119013 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd080ca400 0x7fdd0806b3b0 secure :-1 s=READY pgs=2732 cs=0 l=1 rev1=1 crypto rx=0x7fdd080b0990 tx=0x7fdd0001c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a86a2f8505104aa server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:05.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:05.627+0000 7fdd077fe640 1 -- 172.21.15.53:0/1933119013 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd000a55e0 con 0x7fdd080ca400 2023-06-10T19:09:05.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:05.627+0000 7fdd077fe640 1 -- 172.21.15.53:0/1933119013 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd000a5740 con 0x7fdd080ca400 2023-06-10T19:09:05.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:05.627+0000 7fdd077fe640 1 -- 172.21.15.53:0/1933119013 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd000a5ad0 con 0x7fdd080ca400 2023-06-10T19:09:05.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:05.627+0000 7fdd0ee18640 1 -- 172.21.15.53:0/1933119013 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd080ca400 msgr2=0x7fdd0806b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:05.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:05.627+0000 7fdd0ee18640 1 --2- 172.21.15.53:0/1933119013 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd080ca400 0x7fdd0806b3b0 secure :-1 s=READY pgs=2732 cs=0 l=1 rev1=1 crypto rx=0x7fdd080b0990 tx=0x7fdd0001c940 comp rx=0 tx=0).stop 2023-06-10T19:09:05.633 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:05.627+0000 7fdd0ee18640 1 -- 172.21.15.53:0/1933119013 shutdown_connections 2023-06-10T19:09:05.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:05.627+0000 7fdd0ee18640 1 --2- 172.21.15.53:0/1933119013 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd080ca400 0x7fdd0806b3b0 unknown :-1 s=CLOSED pgs=2732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:05.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:05.627+0000 7fdd0ee18640 1 --2- 172.21.15.53:0/1933119013 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd080c9f40 0x7fdd080ad330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:05.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:05.627+0000 7fdd0ee18640 1 --2- 172.21.15.53:0/1933119013 >> v2:172.21.15.117:3300/0 conn(0x7fdd0815b9a0 0x7fdd080acdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:05.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:05.627+0000 7fdd0ee18640 1 -- 172.21.15.53:0/1933119013 >> 172.21.15.53:0/1933119013 conn(0x7fdd080afc40 msgr2=0x7fdd080b0040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:09:05.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:05.627+0000 7fdd0ee18640 1 -- 172.21.15.53:0/1933119013 shutdown_connections 2023-06-10T19:09:05.634 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:05.627+0000 7fdd0ee18640 1 -- 172.21.15.53:0/1933119013 wait complete. 2023-06-10T19:09:05.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:05.627+0000 7fdd0ee18640 1 Processor -- start 2023-06-10T19:09:05.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:05.627+0000 7fdd0ee18640 1 -- start start 2023-06-10T19:09:05.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:05.627+0000 7fdd0ee18640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd080c9f40 0x7fdd080ae1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:05.636 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:05.627+0000 7fdd0ee18640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd080ca400 0x7fdd080ae710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:05.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:05.627+0000 7fdd0ee18640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd0815b9a0 0x7fdd0806f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:05.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:05.627+0000 7fdd0ee18640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd080c7580 con 0x7fdd0815b9a0 2023-06-10T19:09:05.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:05.627+0000 7fdd0ee18640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd080c6f50 con 0x7fdd080ca400 2023-06-10T19:09:05.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:05.627+0000 7fdd0ee18640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd080711e0 con 0x7fdd080c9f40 2023-06-10T19:09:05.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:05.627+0000 7fdd0d3b5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd0815b9a0 0x7fdd0806f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:05.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:05.627+0000 7fdd0d3b5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd0815b9a0 0x7fdd0806f3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55006/0 (socket says 172.21.15.53:55006) 2023-06-10T19:09:05.637 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:05.627+0000 7fdd0d3b5640 1 -- 172.21.15.53:0/2369010348 learned_addr learned my addr 172.21.15.53:0/2369010348 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:09:05.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:05.631+0000 7fdd0cbb4640 1 --2- 172.21.15.53:0/2369010348 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd080c9f40 0x7fdd080ae1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:05.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:05.631+0000 7fdd07fff640 1 --2- 172.21.15.53:0/2369010348 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd080ca400 0x7fdd080ae710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:05.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:05.631+0000 7fdd0d3b5640 1 -- 172.21.15.53:0/2369010348 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd080c9f40 msgr2=0x7fdd080ae1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:05.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:05.631+0000 7fdd0d3b5640 1 --2- 172.21.15.53:0/2369010348 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd080c9f40 0x7fdd080ae1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:05.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:05.631+0000 7fdd0d3b5640 1 -- 172.21.15.53:0/2369010348 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd080ca400 msgr2=0x7fdd080ae710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:05.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:05.631+0000 7fdd0d3b5640 1 --2- 172.21.15.53:0/2369010348 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd080ca400 0x7fdd080ae710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:05.638 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:05.631+0000 7fdd0d3b5640 1 -- 172.21.15.53:0/2369010348 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd00009b30 con 0x7fdd0815b9a0 2023-06-10T19:09:05.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:05.631+0000 7fdd0cbb4640 1 --2- 172.21.15.53:0/2369010348 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd080c9f40 0x7fdd080ae1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:09:05.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:05.631+0000 7fdd0d3b5640 1 --2- 172.21.15.53:0/2369010348 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd0815b9a0 0x7fdd0806f3a0 secure :-1 s=READY pgs=2733 cs=0 l=1 rev1=1 crypto rx=0x7fdd000af040 tx=0x7fdd000196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:05.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:05.631+0000 7fdd057fa640 1 -- 172.21.15.53:0/2369010348 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd000b8670 con 0x7fdd0815b9a0 2023-06-10T19:09:05.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:05.631+0000 7fdd057fa640 1 -- 172.21.15.53:0/2369010348 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd000b87d0 con 0x7fdd0815b9a0 2023-06-10T19:09:05.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:05.631+0000 7fdd0ee18640 1 -- 172.21.15.53:0/2369010348 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd080c7210 con 0x7fdd0815b9a0 2023-06-10T19:09:05.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:05.631+0000 7fdd057fa640 1 -- 172.21.15.53:0/2369010348 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd000b8b80 con 0x7fdd0815b9a0 2023-06-10T19:09:05.639 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:05.631+0000 7fdd0ee18640 1 -- 172.21.15.53:0/2369010348 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd08070d70 con 0x7fdd0815b9a0 2023-06-10T19:09:05.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:05.631+0000 7fdd0ee18640 1 -- 172.21.15.53:0/2369010348 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd080c73a0 con 0x7fdd0815b9a0 2023-06-10T19:09:05.640 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:05.631+0000 7fdd057fa640 1 -- 172.21.15.53:0/2369010348 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdd000b8ce0 con 0x7fdd0815b9a0 2023-06-10T19:09:05.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:05.631+0000 7fdd057fa640 1 --2- 172.21.15.53:0/2369010348 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdcf40662b0 0x7fdcf4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:05.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:05.631+0000 7fdd057fa640 1 -- 172.21.15.53:0/2369010348 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 5840+0+0 (secure 0 0 0) 0x7fdd0011f0e0 con 0x7fdd0815b9a0 2023-06-10T19:09:05.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:05.631+0000 7fdd0cbb4640 1 --2- 172.21.15.53:0/2369010348 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdcf40662b0 0x7fdcf4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:05.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:05.631+0000 7fdd0cbb4640 1 --2- 172.21.15.53:0/2369010348 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdcf40662b0 0x7fdcf4068760 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fdcf8009720 tx=0x7fdcf8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:05.641 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:05.635+0000 7fdd057fa640 1 -- 172.21.15.53:0/2369010348 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdd000ec7b0 con 0x7fdd0815b9a0 2023-06-10T19:09:05.795 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:05.791+0000 7fdd0ee18640 1 -- 172.21.15.53:0/2369010348 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fdd0804d790 con 0x7fdd0815b9a0 2023-06-10T19:09:06.483 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.479+0000 7fdd057fa640 1 -- 172.21.15.53:0/2369010348 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v186) v1 ==== 169+0+0 (secure 0 0 0) 0x7fdd00009510 con 0x7fdd0815b9a0 2023-06-10T19:09:06.486 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'cephfs_data' removed 2023-06-10T19:09:06.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.483+0000 7fdd0ee18640 1 -- 172.21.15.53:0/2369010348 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdcf40662b0 msgr2=0x7fdcf4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:06.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.483+0000 7fdd0ee18640 1 --2- 172.21.15.53:0/2369010348 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdcf40662b0 0x7fdcf4068760 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fdcf8009720 tx=0x7fdcf8008040 comp rx=0 tx=0).stop 2023-06-10T19:09:06.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.483+0000 7fdd0ee18640 1 -- 172.21.15.53:0/2369010348 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd0815b9a0 msgr2=0x7fdd0806f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:06.491 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.483+0000 7fdd0ee18640 1 --2- 172.21.15.53:0/2369010348 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd0815b9a0 0x7fdd0806f3a0 secure :-1 s=READY pgs=2733 cs=0 l=1 rev1=1 crypto rx=0x7fdd000af040 tx=0x7fdd000196e0 comp rx=0 tx=0).stop 2023-06-10T19:09:06.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.487+0000 7fdd0ee18640 1 -- 172.21.15.53:0/2369010348 shutdown_connections 2023-06-10T19:09:06.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.487+0000 7fdd0ee18640 1 --2- 172.21.15.53:0/2369010348 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdcf40662b0 0x7fdcf4068760 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:06.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.487+0000 7fdd0ee18640 1 --2- 172.21.15.53:0/2369010348 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd0815b9a0 0x7fdd0806f3a0 unknown :-1 s=CLOSED pgs=2733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:06.492 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.487+0000 7fdd0ee18640 1 --2- 172.21.15.53:0/2369010348 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd080ca400 0x7fdd080ae710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:06.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.487+0000 7fdd0ee18640 1 --2- 172.21.15.53:0/2369010348 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdd080c9f40 0x7fdd080ae1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:06.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.487+0000 7fdd0ee18640 1 -- 172.21.15.53:0/2369010348 >> 172.21.15.53:0/2369010348 conn(0x7fdd080afc40 msgr2=0x7fdd080c8890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:09:06.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.487+0000 7fdd0ee18640 1 -- 172.21.15.53:0/2369010348 shutdown_connections 2023-06-10T19:09:06.493 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.487+0000 7fdd0ee18640 1 -- 172.21.15.53:0/2369010348 wait complete. 2023-06-10T19:09:06.520 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-06-10T19:09:06.645 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.639+0000 7f2cc9a76640 1 Processor -- start 2023-06-10T19:09:06.646 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.639+0000 7f2cc9a76640 1 -- start start 2023-06-10T19:09:06.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.639+0000 7f2cc9a76640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2cc415c060 0x7f2cc40cc020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:06.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.639+0000 7f2cc9a76640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2cc4070de0 0x7f2cc415c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:06.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.639+0000 7f2cc9a76640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cc40c8d50 con 0x7f2cc415c970 2023-06-10T19:09:06.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.639+0000 7f2cc9a76640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cc40c9030 con 0x7f2cc4070de0 2023-06-10T19:09:06.647 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.639+0000 7f2cc9a76640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc4070300 con 0x7f2cc415c060 2023-06-10T19:09:06.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.639+0000 7f2cc2ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2cc4070de0 0x7f2cc415c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:06.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.639+0000 7f2cc2ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2cc4070de0 0x7f2cc415c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55014/0 (socket says 172.21.15.53:55014) 2023-06-10T19:09:06.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.639+0000 7f2cc2ffd640 1 -- 172.21.15.53:0/781898174 learned_addr learned my addr 172.21.15.53:0/781898174 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:09:06.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.643+0000 7f2cc37fe640 1 --2- 172.21.15.53:0/781898174 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2cc415c060 0x7f2cc40cc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:06.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.643+0000 7f2cc2ffd640 1 -- 172.21.15.53:0/781898174 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2cc415c060 msgr2=0x7f2cc40cc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:09:06.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.643+0000 7f2cc2ffd640 1 --2- 172.21.15.53:0/781898174 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2cc415c060 0x7f2cc40cc020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:06.648 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.643+0000 7f2cc2ffd640 1 -- 172.21.15.53:0/781898174 >> v1:172.21.15.117:6789/0 conn(0x7f2cc415c970 legacy=0x7f2cc406bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:09:06.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.643+0000 7f2cc2ffd640 1 -- 172.21.15.53:0/781898174 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc40705e0 con 0x7f2cc4070de0 2023-06-10T19:09:06.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.643+0000 7f2cc2ffd640 1 --2- 172.21.15.53:0/781898174 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2cc4070de0 0x7f2cc415c430 secure :-1 s=READY pgs=2734 cs=0 l=1 rev1=1 crypto rx=0x7f2cb8009870 tx=0x7f2cb801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62af2455a639eeaf server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:06.649 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.643+0000 7f2cc27fc640 1 -- 172.21.15.53:0/781898174 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb80ad660 con 0x7f2cc4070de0 2023-06-10T19:09:06.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.643+0000 7f2cc27fc640 1 -- 172.21.15.53:0/781898174 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cb80ad7c0 con 0x7f2cc4070de0 2023-06-10T19:09:06.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.643+0000 7f2cc27fc640 1 -- 172.21.15.53:0/781898174 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb80adb50 con 0x7f2cc4070de0 2023-06-10T19:09:06.650 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.643+0000 7f2cc9a76640 1 -- 172.21.15.53:0/781898174 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2cc4070de0 msgr2=0x7f2cc415c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:06.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.643+0000 7f2cc9a76640 1 --2- 172.21.15.53:0/781898174 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2cc4070de0 0x7f2cc415c430 secure :-1 s=READY pgs=2734 cs=0 l=1 rev1=1 crypto rx=0x7f2cb8009870 tx=0x7f2cb801c470 comp rx=0 tx=0).stop 2023-06-10T19:09:06.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.643+0000 7f2cc9a76640 1 -- 172.21.15.53:0/781898174 shutdown_connections 2023-06-10T19:09:06.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.643+0000 7f2cc9a76640 1 --2- 172.21.15.53:0/781898174 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2cc4070de0 0x7f2cc415c430 unknown :-1 s=CLOSED pgs=2734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:06.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.643+0000 7f2cc9a76640 1 --2- 172.21.15.53:0/781898174 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2cc415c060 0x7f2cc40cc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:06.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.643+0000 7f2cc9a76640 1 -- 172.21.15.53:0/781898174 >> 172.21.15.53:0/781898174 conn(0x7f2cc406a0e0 msgr2=0x7f2cc40cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:09:06.651 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.643+0000 7f2cc9a76640 1 -- 172.21.15.53:0/781898174 shutdown_connections 2023-06-10T19:09:06.652 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.643+0000 7f2cc9a76640 1 -- 172.21.15.53:0/781898174 wait complete. 2023-06-10T19:09:06.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.647+0000 7f2cc9a76640 1 Processor -- start 2023-06-10T19:09:06.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.647+0000 7f2cc9a76640 1 -- start start 2023-06-10T19:09:06.653 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.647+0000 7f2cc9a76640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2cc4070de0 0x7f2cc40c5e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:06.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.647+0000 7f2cc9a76640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2cc415c060 0x7f2cc4145390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:06.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.647+0000 7f2cc9a76640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2cc415c970 0x7f2cc40add70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:06.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.647+0000 7f2cc9a76640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc40b0e20 con 0x7f2cc415c060 2023-06-10T19:09:06.654 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.647+0000 7f2cc9a76640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc40b38e0 con 0x7f2cc415c970 2023-06-10T19:09:06.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.647+0000 7f2cc9a76640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc40b0b10 con 0x7f2cc4070de0 2023-06-10T19:09:06.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.647+0000 7f2cc2ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2cc415c060 0x7f2cc4145390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:06.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.647+0000 7f2cc2ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2cc415c060 0x7f2cc4145390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55020/0 (socket says 172.21.15.53:55020) 2023-06-10T19:09:06.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.647+0000 7f2cc2ffd640 1 -- 172.21.15.53:0/4055587842 learned_addr learned my addr 172.21.15.53:0/4055587842 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:09:06.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.647+0000 7f2cc37fe640 1 --2- 172.21.15.53:0/4055587842 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2cc4070de0 0x7f2cc40c5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:06.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.647+0000 7f2cc3fff640 1 --2- 172.21.15.53:0/4055587842 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2cc415c970 0x7f2cc40add70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:06.655 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.647+0000 7f2cc2ffd640 1 -- 172.21.15.53:0/4055587842 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2cc4070de0 msgr2=0x7f2cc40c5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:06.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.647+0000 7f2cc2ffd640 1 --2- 172.21.15.53:0/4055587842 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2cc4070de0 0x7f2cc40c5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:06.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.647+0000 7f2cc2ffd640 1 -- 172.21.15.53:0/4055587842 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2cc415c970 msgr2=0x7f2cc40add70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:06.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.647+0000 7f2cc2ffd640 1 --2- 172.21.15.53:0/4055587842 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2cc415c970 0x7f2cc40add70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:06.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.647+0000 7f2cc2ffd640 1 -- 172.21.15.53:0/4055587842 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cb80094d0 con 0x7f2cc415c060 2023-06-10T19:09:06.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.647+0000 7f2cc2ffd640 1 --2- 172.21.15.53:0/4055587842 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2cc415c060 0x7f2cc4145390 secure :-1 s=READY pgs=2735 cs=0 l=1 rev1=1 crypto rx=0x7f2cb80b0040 tx=0x7f2cb8019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:06.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.647+0000 7f2cabfff640 1 -- 172.21.15.53:0/4055587842 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb80b6640 con 0x7f2cc415c060 2023-06-10T19:09:06.656 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.647+0000 7f2cabfff640 1 -- 172.21.15.53:0/4055587842 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cb80b67c0 con 0x7f2cc415c060 2023-06-10T19:09:06.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.647+0000 7f2cabfff640 1 -- 172.21.15.53:0/4055587842 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb80b6b70 con 0x7f2cc415c060 2023-06-10T19:09:06.657 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.647+0000 7f2cc9a76640 1 -- 172.21.15.53:0/4055587842 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cc4158950 con 0x7f2cc415c060 2023-06-10T19:09:06.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.647+0000 7f2cc9a76640 1 -- 172.21.15.53:0/4055587842 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cc415b610 con 0x7f2cc415c060 2023-06-10T19:09:06.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.647+0000 7f2cc9a76640 1 -- 172.21.15.53:0/4055587842 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cc40b0f60 con 0x7f2cc415c060 2023-06-10T19:09:06.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.651+0000 7f2cabfff640 1 -- 172.21.15.53:0/4055587842 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2cb80b4070 con 0x7f2cc415c060 2023-06-10T19:09:06.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.651+0000 7f2cabfff640 1 --2- 172.21.15.53:0/4055587842 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2cb0066280 0x7f2cb0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:06.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.651+0000 7f2cabfff640 1 -- 172.21.15.53:0/4055587842 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f2cb811dc10 con 0x7f2cc415c060 2023-06-10T19:09:06.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.651+0000 7f2cc37fe640 1 --2- 172.21.15.53:0/4055587842 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2cb0066280 0x7f2cb0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:06.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.651+0000 7f2cc37fe640 1 --2- 172.21.15.53:0/4055587842 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2cb0066280 0x7f2cb0068730 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f2cb400b930 tx=0x7f2cb4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:06.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.655+0000 7f2cabfff640 1 -- 172.21.15.53:0/4055587842 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2cc40b0f60 con 0x7f2cc415c060 2023-06-10T19:09:06.813 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.807+0000 7f2cc9a76640 1 -- 172.21.15.53:0/4055587842 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f2cc40b0f60 con 0x7f2cc415c060 2023-06-10T19:09:06.821 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.815+0000 7f2cabfff640 1 -- 172.21.15.53:0/4055587842 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v31) v1 ==== 104+0+0 (secure 0 0 0) 0x7f2cc40b0f60 con 0x7f2cc415c060 2023-06-10T19:09:06.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.819+0000 7f2cc9a76640 1 -- 172.21.15.53:0/4055587842 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2cb0066280 msgr2=0x7f2cb0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:06.823 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.819+0000 7f2cc9a76640 1 --2- 172.21.15.53:0/4055587842 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2cb0066280 0x7f2cb0068730 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f2cb400b930 tx=0x7f2cb4008040 comp rx=0 tx=0).stop 2023-06-10T19:09:06.824 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.819+0000 7f2cc9a76640 1 -- 172.21.15.53:0/4055587842 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2cc415c060 msgr2=0x7f2cc4145390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:06.824 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.819+0000 7f2cc9a76640 1 --2- 172.21.15.53:0/4055587842 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2cc415c060 0x7f2cc4145390 secure :-1 s=READY pgs=2735 cs=0 l=1 rev1=1 crypto rx=0x7f2cb80b0040 tx=0x7f2cb8019210 comp rx=0 tx=0).stop 2023-06-10T19:09:06.824 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.819+0000 7f2cc9a76640 1 -- 172.21.15.53:0/4055587842 shutdown_connections 2023-06-10T19:09:06.824 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.819+0000 7f2cc9a76640 1 --2- 172.21.15.53:0/4055587842 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f2cb0066280 0x7f2cb0068730 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:06.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.819+0000 7f2cc9a76640 1 --2- 172.21.15.53:0/4055587842 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2cc415c970 0x7f2cc40add70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:06.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.819+0000 7f2cc9a76640 1 --2- 172.21.15.53:0/4055587842 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2cc415c060 0x7f2cc4145390 unknown :-1 s=CLOSED pgs=2735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:06.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.819+0000 7f2cc9a76640 1 --2- 172.21.15.53:0/4055587842 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2cc4070de0 0x7f2cc40c5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:06.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.819+0000 7f2cc9a76640 1 -- 172.21.15.53:0/4055587842 >> 172.21.15.53:0/4055587842 conn(0x7f2cc406a0e0 msgr2=0x7f2cc40af7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:09:06.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.819+0000 7f2cc9a76640 1 -- 172.21.15.53:0/4055587842 shutdown_connections 2023-06-10T19:09:06.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.819+0000 7f2cc9a76640 1 -- 172.21.15.53:0/4055587842 wait complete. 2023-06-10T19:09:06.841 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_reconnect_after_blocklisted' 2023-06-10T19:09:06.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.967+0000 7f5edafa5640 1 Processor -- start 2023-06-10T19:09:06.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.967+0000 7f5edafa5640 1 -- start start 2023-06-10T19:09:06.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.967+0000 7f5edafa5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ed40cc690 0x7f5ed40d04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:06.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.967+0000 7f5edafa5640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5ed40ccae0 0x7f5ed40d09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:06.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.967+0000 7f5edafa5640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ed40d0020 con 0x7f5ed40b3ac0 2023-06-10T19:09:06.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.967+0000 7f5edafa5640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ed40cef40 con 0x7f5ed40ccae0 2023-06-10T19:09:06.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.967+0000 7f5edafa5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed40cf220 con 0x7f5ed40cc690 2023-06-10T19:09:06.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.967+0000 7f5ed3fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ed40cc690 0x7f5ed40d04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:06.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.967+0000 7f5ed9542640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5ed40ccae0 0x7f5ed40d09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:06.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.967+0000 7f5ed3fff640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ed40cc690 0x7f5ed40d04b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.53:60414/0 (socket says 172.21.15.53:60414) 2023-06-10T19:09:06.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.967+0000 7f5ed3fff640 1 -- 172.21.15.53:0/3310354203 learned_addr learned my addr 172.21.15.53:0/3310354203 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:09:06.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.967+0000 7f5ed3fff640 1 -- 172.21.15.53:0/3310354203 >> v2:172.21.15.117:3300/0 conn(0x7f5ed40ccae0 msgr2=0x7f5ed40d09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:09:06.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.967+0000 7f5ed3fff640 1 --2- 172.21.15.53:0/3310354203 >> v2:172.21.15.117:3300/0 conn(0x7f5ed40ccae0 0x7f5ed40d09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:06.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.967+0000 7f5ed3fff640 1 -- 172.21.15.53:0/3310354203 >> v1:172.21.15.117:6789/0 conn(0x7f5ed40b3ac0 legacy=0x7f5ed40b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:06.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.967+0000 7f5ed3fff640 1 -- 172.21.15.53:0/3310354203 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed40cf500 con 0x7f5ed40cc690 2023-06-10T19:09:06.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.967+0000 7f5ed9542640 1 --2- 172.21.15.53:0/3310354203 >> v2:172.21.15.117:3300/0 conn(0x7f5ed40ccae0 0x7f5ed40d09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-10T19:09:06.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.971+0000 7f5ed3fff640 1 --2- 172.21.15.53:0/3310354203 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ed40cc690 0x7f5ed40d04b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc009870 tx=0x7f5ebc01c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21c0b5d2debfec44 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:06.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.971+0000 7f5ed37fe640 1 -- 172.21.15.53:0/3310354203 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ebc0ab620 con 0x7f5ed40cc690 2023-06-10T19:09:06.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.971+0000 7f5ed37fe640 1 -- 172.21.15.53:0/3310354203 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ebc0ab780 con 0x7f5ed40cc690 2023-06-10T19:09:06.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.971+0000 7f5ed37fe640 1 -- 172.21.15.53:0/3310354203 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ebc0abb10 con 0x7f5ed40cc690 2023-06-10T19:09:06.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.971+0000 7f5edafa5640 1 -- 172.21.15.53:0/3310354203 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ed40cc690 msgr2=0x7f5ed40d04b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:06.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.971+0000 7f5edafa5640 1 --2- 172.21.15.53:0/3310354203 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ed40cc690 0x7f5ed40d04b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc009870 tx=0x7f5ebc01c510 comp rx=0 tx=0).stop 2023-06-10T19:09:06.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.971+0000 7f5edafa5640 1 -- 172.21.15.53:0/3310354203 shutdown_connections 2023-06-10T19:09:06.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.971+0000 7f5edafa5640 1 --2- 172.21.15.53:0/3310354203 >> v2:172.21.15.117:3300/0 conn(0x7f5ed40ccae0 0x7f5ed40d09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:06.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.971+0000 7f5edafa5640 1 --2- 172.21.15.53:0/3310354203 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ed40cc690 0x7f5ed40d04b0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:06.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.971+0000 7f5edafa5640 1 -- 172.21.15.53:0/3310354203 >> 172.21.15.53:0/3310354203 conn(0x7f5ed4071790 msgr2=0x7f5ed4069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:09:06.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.971+0000 7f5edafa5640 1 -- 172.21.15.53:0/3310354203 shutdown_connections 2023-06-10T19:09:06.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.971+0000 7f5edafa5640 1 -- 172.21.15.53:0/3310354203 wait complete. 2023-06-10T19:09:06.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.971+0000 7f5edafa5640 1 Processor -- start 2023-06-10T19:09:06.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.971+0000 7f5edafa5640 1 -- start start 2023-06-10T19:09:06.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.975+0000 7f5edafa5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ed40b3ac0 0x7f5ed414c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:06.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.975+0000 7f5edafa5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ed40cc690 0x7f5ed40b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:06.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.975+0000 7f5edafa5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ed40ccae0 0x7f5ed414a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:06.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.975+0000 7f5edafa5640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed414aa70 con 0x7f5ed40b3ac0 2023-06-10T19:09:06.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.975+0000 7f5edafa5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed415bb60 con 0x7f5ed40ccae0 2023-06-10T19:09:06.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.975+0000 7f5edafa5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed415b320 con 0x7f5ed40cc690 2023-06-10T19:09:06.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.975+0000 7f5ed8d41640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ed40b3ac0 0x7f5ed414c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:06.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.975+0000 7f5ed8d41640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ed40b3ac0 0x7f5ed414c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55024/0 (socket says 172.21.15.53:55024) 2023-06-10T19:09:06.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.975+0000 7f5ed8d41640 1 -- 172.21.15.53:0/3969108502 learned_addr learned my addr 172.21.15.53:0/3969108502 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:09:06.981 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.975+0000 7f5ed3fff640 1 --2- 172.21.15.53:0/3969108502 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ed40cc690 0x7f5ed40b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:06.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.975+0000 7f5ed9542640 1 --2- 172.21.15.53:0/3969108502 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ed40ccae0 0x7f5ed414a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:06.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.975+0000 7f5ed8d41640 1 -- 172.21.15.53:0/3969108502 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ed40cc690 msgr2=0x7f5ed40b6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:06.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.975+0000 7f5ed8d41640 1 --2- 172.21.15.53:0/3969108502 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ed40cc690 0x7f5ed40b6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:06.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.975+0000 7f5ed8d41640 1 -- 172.21.15.53:0/3969108502 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ed40ccae0 msgr2=0x7f5ed414a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:06.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.975+0000 7f5ed8d41640 1 --2- 172.21.15.53:0/3969108502 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ed40ccae0 0x7f5ed414a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:06.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.975+0000 7f5ed8d41640 1 -- 172.21.15.53:0/3969108502 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ec4009420 con 0x7f5ed40b3ac0 2023-06-10T19:09:06.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.975+0000 7f5ed3fff640 1 --2- 172.21.15.53:0/3969108502 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ed40cc690 0x7f5ed40b6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:09:06.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.975+0000 7f5ed8d41640 1 --2- 172.21.15.53:0/3969108502 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ed40b3ac0 0x7f5ed414c130 secure :-1 s=READY pgs=2736 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc00c820 tx=0x7f5ecc00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:06.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.975+0000 7f5ed17fa640 1 -- 172.21.15.53:0/3969108502 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ecc003b80 con 0x7f5ed40b3ac0 2023-06-10T19:09:06.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.975+0000 7f5ed17fa640 1 -- 172.21.15.53:0/3969108502 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ecc003ce0 con 0x7f5ed40b3ac0 2023-06-10T19:09:06.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.975+0000 7f5edafa5640 1 -- 172.21.15.53:0/3969108502 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ebc0094d0 con 0x7f5ed40b3ac0 2023-06-10T19:09:06.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.975+0000 7f5ed17fa640 1 -- 172.21.15.53:0/3969108502 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ecc00aa30 con 0x7f5ed40b3ac0 2023-06-10T19:09:06.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.975+0000 7f5edafa5640 1 -- 172.21.15.53:0/3969108502 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ed414efe0 con 0x7f5ed40b3ac0 2023-06-10T19:09:06.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.975+0000 7f5edafa5640 1 -- 172.21.15.53:0/3969108502 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ed404d790 con 0x7f5ed40b3ac0 2023-06-10T19:09:06.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.975+0000 7f5ed17fa640 1 -- 172.21.15.53:0/3969108502 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5ecc00ab90 con 0x7f5ed40b3ac0 2023-06-10T19:09:06.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.975+0000 7f5ed17fa640 1 --2- 172.21.15.53:0/3969108502 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5eb4066280 0x7f5eb4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:06.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.975+0000 7f5ed17fa640 1 -- 172.21.15.53:0/3969108502 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f5ecc083a10 con 0x7f5ed40b3ac0 2023-06-10T19:09:06.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.979+0000 7f5ed3fff640 1 --2- 172.21.15.53:0/3969108502 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5eb4066280 0x7f5eb4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:06.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.979+0000 7f5ed3fff640 1 --2- 172.21.15.53:0/3969108502 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5eb4066280 0x7f5eb4068730 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc0af000 tx=0x7f5ebc0a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:06.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:06.983+0000 7f5ed17fa640 1 -- 172.21.15.53:0/3969108502 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5ecc0510e0 con 0x7f5ed40b3ac0 2023-06-10T19:09:07.197 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:07.191+0000 7f5edafa5640 1 -- 172.21.15.53:0/3969108502 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_reconnect_after_blocklisted"]} v 0) v1 -- 0x7f5ed40b75a0 con 0x7f5ed40b3ac0 2023-06-10T19:09:07.507 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:07.503+0000 7f5ed17fa640 1 -- 172.21.15.53:0/3969108502 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientRecovery.test_reconnect_after_blocklisted"]}]=0 v777) v1 ==== 164+0+0 (secure 0 0 0) 0x7f5ecc054700 con 0x7f5ed40b3ac0 2023-06-10T19:09:07.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:07.507+0000 7f5edafa5640 1 -- 172.21.15.53:0/3969108502 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5eb4066280 msgr2=0x7f5eb4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:07.511 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:07.507+0000 7f5edafa5640 1 --2- 172.21.15.53:0/3969108502 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5eb4066280 0x7f5eb4068730 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc0af000 tx=0x7f5ebc0a7000 comp rx=0 tx=0).stop 2023-06-10T19:09:07.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:07.507+0000 7f5edafa5640 1 -- 172.21.15.53:0/3969108502 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ed40b3ac0 msgr2=0x7f5ed414c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:07.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:07.507+0000 7f5edafa5640 1 --2- 172.21.15.53:0/3969108502 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ed40b3ac0 0x7f5ed414c130 secure :-1 s=READY pgs=2736 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc00c820 tx=0x7f5ecc00cce0 comp rx=0 tx=0).stop 2023-06-10T19:09:07.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:07.507+0000 7f5edafa5640 1 -- 172.21.15.53:0/3969108502 shutdown_connections 2023-06-10T19:09:07.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:07.507+0000 7f5edafa5640 1 --2- 172.21.15.53:0/3969108502 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f5eb4066280 0x7f5eb4068730 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:07.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:07.507+0000 7f5edafa5640 1 --2- 172.21.15.53:0/3969108502 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ed40ccae0 0x7f5ed414a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:07.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:07.507+0000 7f5edafa5640 1 --2- 172.21.15.53:0/3969108502 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5ed40cc690 0x7f5ed40b6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:07.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:07.507+0000 7f5edafa5640 1 --2- 172.21.15.53:0/3969108502 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ed40b3ac0 0x7f5ed414c130 unknown :-1 s=CLOSED pgs=2736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:07.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:07.507+0000 7f5edafa5640 1 -- 172.21.15.53:0/3969108502 >> 172.21.15.53:0/3969108502 conn(0x7f5ed4071790 msgr2=0x7f5ed41583a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:09:07.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:07.507+0000 7f5edafa5640 1 -- 172.21.15.53:0/3969108502 shutdown_connections 2023-06-10T19:09:07.513 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:07.507+0000 7f5edafa5640 1 -- 172.21.15.53:0/3969108502 wait complete. 2023-06-10T19:09:07.536 INFO:tasks.cephfs_test_runner:test_reconnect_after_blocklisted (tasks.cephfs.test_client_recovery.TestClientRecovery) ... ERROR 2023-06-10T19:09:07.536 INFO:tasks.cephfs_test_runner: 2023-06-10T19:09:07.537 INFO:tasks.cephfs_test_runner:====================================================================== 2023-06-10T19:09:07.537 INFO:tasks.cephfs_test_runner:ERROR: test_reconnect_after_blocklisted (tasks.cephfs.test_client_recovery.TestClientRecovery) 2023-06-10T19:09:07.537 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-06-10T19:09:07.537 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-06-10T19:09:07.537 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_3486dd872ffd89042ca079d680841ce3ef6f4b6f/qa/tasks/cephfs/test_client_recovery.py", line 725, in test_reconnect_after_blocklisted 2023-06-10T19:09:07.538 INFO:tasks.cephfs_test_runner: rproc.wait() 2023-06-10T19:09:07.538 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_2ef0dcdee569e9851c9d2ffb6acfd4b80d031e61/teuthology/orchestra/run.py", line 161, in wait 2023-06-10T19:09:07.538 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-06-10T19:09:07.538 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_2ef0dcdee569e9851c9d2ffb6acfd4b80d031e61/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-06-10T19:09:07.538 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-06-10T19:09:07.539 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi053 with status 1: 'python3 -c \'\nimport os\nimport sys\nimport fcntl\nimport errno\nimport time\n\nfd1 = os.open("/home/ubuntu/cephtest/mnt.0/testfile_reconnect_after_blocklisted.1", os.O_RDWR | os.O_CREAT, 0O666)\nfd2 = os.open("/home/ubuntu/cephtest/mnt.0/testfile_reconnect_after_blocklisted.1", os.O_RDONLY)\nfd3 = os.open("/home/ubuntu/cephtest/mnt.0/testfile_reconnect_after_blocklisted.2", os.O_RDWR | os.O_CREAT, 0O666)\nfd4 = os.open("/home/ubuntu/cephtest/mnt.0/testfile_reconnect_after_blocklisted.2", os.O_RDONLY)\n\nos.write(fd1, b\'"\'"\'content\'"\'"\')\nos.read(fd2, 1);\n\nos.write(fd3, b\'"\'"\'content\'"\'"\')\nos.read(fd4, 1);\nfcntl.flock(fd4, fcntl.LOCK_SH | fcntl.LOCK_NB)\n\nprint("blocklist")\nsys.stdout.flush()\n\nsys.stdin.readline()\n\n# wait for mds to close session\ntime.sleep(10);\n\n# trigger \'"\'"\'open session\'"\'"\' message. kclient relies on \'"\'"\'session reject\'"\'"\' message\n# to detect if itself is blocklisted\ntry:\n os.stat("/home/ubuntu/cephtest/mnt.0/testfile_reconnect_after_blocklisted.1")\nexcept:\n pass\n\n# wait for auto reconnect\ntime.sleep(10);\n\ntry:\n os.write(fd1, b\'"\'"\'content\'"\'"\')\nexcept OSError as e:\n if e.errno != errno.EBADF:\n raise\nelse:\n raise RuntimeError("write() failed to raise error")\n\nos.read(fd2, 1);\n\ntry:\n os.read(fd4, 1)\nexcept OSError as e:\n if e.errno != errno.EIO:\n raise\nelse:\n raise RuntimeError("read() failed to raise error")\n\'' 2023-06-10T19:09:07.539 INFO:tasks.cephfs_test_runner: 2023-06-10T19:09:07.539 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-06-10T19:09:07.539 INFO:tasks.cephfs_test_runner:Ran 12 tests in 945.173s 2023-06-10T19:09:07.539 INFO:tasks.cephfs_test_runner: 2023-06-10T19:09:07.540 INFO:tasks.cephfs_test_runner:FAILED (errors=1, skipped=1) 2023-06-10T19:09:07.540 INFO:tasks.cephfs_test_runner: 2023-06-10T19:09:07.540 INFO:tasks.cephfs_test_runner:====================================================================== 2023-06-10T19:09:07.540 INFO:tasks.cephfs_test_runner:ERROR: test_reconnect_after_blocklisted (tasks.cephfs.test_client_recovery.TestClientRecovery) 2023-06-10T19:09:07.540 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-06-10T19:09:07.541 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-06-10T19:09:07.541 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_3486dd872ffd89042ca079d680841ce3ef6f4b6f/qa/tasks/cephfs/test_client_recovery.py", line 725, in test_reconnect_after_blocklisted 2023-06-10T19:09:07.541 INFO:tasks.cephfs_test_runner: rproc.wait() 2023-06-10T19:09:07.541 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_2ef0dcdee569e9851c9d2ffb6acfd4b80d031e61/teuthology/orchestra/run.py", line 161, in wait 2023-06-10T19:09:07.541 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-06-10T19:09:07.542 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_2ef0dcdee569e9851c9d2ffb6acfd4b80d031e61/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-06-10T19:09:07.542 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-06-10T19:09:07.542 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi053 with status 1: 'python3 -c \'\nimport os\nimport sys\nimport fcntl\nimport errno\nimport time\n\nfd1 = os.open("/home/ubuntu/cephtest/mnt.0/testfile_reconnect_after_blocklisted.1", os.O_RDWR | os.O_CREAT, 0O666)\nfd2 = os.open("/home/ubuntu/cephtest/mnt.0/testfile_reconnect_after_blocklisted.1", os.O_RDONLY)\nfd3 = os.open("/home/ubuntu/cephtest/mnt.0/testfile_reconnect_after_blocklisted.2", os.O_RDWR | os.O_CREAT, 0O666)\nfd4 = os.open("/home/ubuntu/cephtest/mnt.0/testfile_reconnect_after_blocklisted.2", os.O_RDONLY)\n\nos.write(fd1, b\'"\'"\'content\'"\'"\')\nos.read(fd2, 1);\n\nos.write(fd3, b\'"\'"\'content\'"\'"\')\nos.read(fd4, 1);\nfcntl.flock(fd4, fcntl.LOCK_SH | fcntl.LOCK_NB)\n\nprint("blocklist")\nsys.stdout.flush()\n\nsys.stdin.readline()\n\n# wait for mds to close session\ntime.sleep(10);\n\n# trigger \'"\'"\'open session\'"\'"\' message. kclient relies on \'"\'"\'session reject\'"\'"\' message\n# to detect if itself is blocklisted\ntry:\n os.stat("/home/ubuntu/cephtest/mnt.0/testfile_reconnect_after_blocklisted.1")\nexcept:\n pass\n\n# wait for auto reconnect\ntime.sleep(10);\n\ntry:\n os.write(fd1, b\'"\'"\'content\'"\'"\')\nexcept OSError as e:\n if e.errno != errno.EBADF:\n raise\nelse:\n raise RuntimeError("write() failed to raise error")\n\nos.read(fd2, 1);\n\ntry:\n os.read(fd4, 1)\nexcept OSError as e:\n if e.errno != errno.EIO:\n raise\nelse:\n raise RuntimeError("read() failed to raise error")\n\'' 2023-06-10T19:09:07.542 INFO:tasks.cephfs_test_runner: 2023-06-10T19:09:07.542 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_2ef0dcdee569e9851c9d2ffb6acfd4b80d031e61/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_batrick_ceph_3486dd872ffd89042ca079d680841ce3ef6f4b6f/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_reconnect_after_blocklisted (tasks.cephfs.test_client_recovery.TestClientRecovery) 2023-06-10T19:09:07.605 ERROR:teuthology.run_tasks: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=07d2664c072e4b76980f34cb04343faa Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_2ef0dcdee569e9851c9d2ffb6acfd4b80d031e61/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_batrick_ceph_3486dd872ffd89042ca079d680841ce3ef6f4b6f/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_reconnect_after_blocklisted (tasks.cephfs.test_client_recovery.TestClientRecovery) 2023-06-10T19:09:07.607 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-06-10T19:09:07.617 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-06-10T19:09:07.640 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-06-10T19:09:07.641 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T19:09:07.641 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:09:07.655 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16345192k,nr_inodes=4086298,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276544k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=407 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276540k,nr_inodes=819135,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276544k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-06-10T19:09:07.655 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-06-10T19:09:07.656 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:09:07.700 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16345192k,nr_inodes=4086298,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276544k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=407 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276540k,nr_inodes=819135,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276544k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-06-10T19:09:07.700 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T19:09:07.701 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:09:07.707 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16342088k,nr_inodes=4085522,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275924k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18845 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275920k,nr_inodes=818980,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275924k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-06-10T19:09:07.707 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2023-06-10T19:09:07.708 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-10T19:09:07.756 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16342088k,nr_inodes=4085522,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275924k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18845 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275920k,nr_inodes=818980,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275924k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-06-10T19:09:07.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:09:07.757 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list 2023-06-10T19:09:07.804 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-06-10T19:09:07.804 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-06-10T19:09:07.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:09:07.805 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-06-10T19:09:07.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:09:07.860 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-06-10T19:09:07.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:09:07.918 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link delete ceph-brx 2023-06-10T19:09:08.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:09:08.089 DEBUG:teuthology.orchestra.run.smithi053:> ip netns list 2023-06-10T19:09:08.096 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 2) 2023-06-10T19:09:08.096 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-06-10T19:09:08.096 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-06-10T19:09:08.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:09:08.097 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-06-10T19:09:08.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:09:08.155 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-06-10T19:09:08.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:09:08.253 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-06-10T19:09:08.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-10T19:09:08.267 DEBUG:teuthology.orchestra.run.smithi053:> sudo ip link delete ceph-brx 2023-06-10T19:09:08.456 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-06-10T19:09:08.472 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-06-10T19:09:08.472 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-10T19:09:08.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.595+0000 7fd56193a640 1 Processor -- start 2023-06-10T19:09:08.602 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.595+0000 7fd56193a640 1 -- start start 2023-06-10T19:09:08.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.595+0000 7fd56193a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd55c06b2f0 0x7fd55c06f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:08.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.595+0000 7fd56193a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd55c0c8d00 0x7fd55c06b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:08.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.595+0000 7fd56193a640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd55c158a90 con 0x7fd55c06bc00 2023-06-10T19:09:08.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.595+0000 7fd56193a640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd55c0705d0 con 0x7fd55c0c8d00 2023-06-10T19:09:08.603 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.595+0000 7fd56193a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd55c06f9c0 con 0x7fd55c06b2f0 2023-06-10T19:09:08.604 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.599+0000 7fd55affd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd55c06b2f0 0x7fd55c06f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:08.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.599+0000 7fd55a7fc640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd55c0c8d00 0x7fd55c06b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:08.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.599+0000 7fd55affd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd55c06b2f0 0x7fd55c06f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.53:60430/0 (socket says 172.21.15.53:60430) 2023-06-10T19:09:08.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.599+0000 7fd55affd640 1 -- 172.21.15.53:0/2648494822 learned_addr learned my addr 172.21.15.53:0/2648494822 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:09:08.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.599+0000 7fd55b7fe640 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fd55c06bc00 0x7fd55c0cbe00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.53:57838/0 (socket says 172.21.15.53:57838) 2023-06-10T19:09:08.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.599+0000 7fd55affd640 1 -- 172.21.15.53:0/2648494822 >> v2:172.21.15.117:3300/0 conn(0x7fd55c0c8d00 msgr2=0x7fd55c06b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:09:08.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.599+0000 7fd55affd640 1 --2- 172.21.15.53:0/2648494822 >> v2:172.21.15.117:3300/0 conn(0x7fd55c0c8d00 0x7fd55c06b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:08.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.599+0000 7fd55affd640 1 -- 172.21.15.53:0/2648494822 >> v1:172.21.15.117:6789/0 conn(0x7fd55c06bc00 legacy=0x7fd55c0cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:08.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.599+0000 7fd55affd640 1 -- 172.21.15.53:0/2648494822 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd55c06fca0 con 0x7fd55c06b2f0 2023-06-10T19:09:08.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.599+0000 7fd55a7fc640 1 --2- 172.21.15.53:0/2648494822 >> v2:172.21.15.117:3300/0 conn(0x7fd55c0c8d00 0x7fd55c06b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-10T19:09:08.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.599+0000 7fd55affd640 1 --2- 172.21.15.53:0/2648494822 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd55c06b2f0 0x7fd55c06f070 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd54c00bb40 tx=0x7fd54c0213e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e97046986e98332b server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:08.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.599+0000 7fd559ffb640 1 -- 172.21.15.53:0/2648494822 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54c0b1600 con 0x7fd55c06b2f0 2023-06-10T19:09:08.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.599+0000 7fd559ffb640 1 -- 172.21.15.53:0/2648494822 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd54c0ad050 con 0x7fd55c06b2f0 2023-06-10T19:09:08.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.599+0000 7fd559ffb640 1 -- 172.21.15.53:0/2648494822 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54c0b1980 con 0x7fd55c06b2f0 2023-06-10T19:09:08.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.603+0000 7fd56193a640 1 -- 172.21.15.53:0/2648494822 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd55c06b2f0 msgr2=0x7fd55c06f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:08.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.603+0000 7fd56193a640 1 --2- 172.21.15.53:0/2648494822 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd55c06b2f0 0x7fd55c06f070 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd54c00bb40 tx=0x7fd54c0213e0 comp rx=0 tx=0).stop 2023-06-10T19:09:08.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.603+0000 7fd56193a640 1 -- 172.21.15.53:0/2648494822 shutdown_connections 2023-06-10T19:09:08.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.603+0000 7fd56193a640 1 --2- 172.21.15.53:0/2648494822 >> v2:172.21.15.117:3300/0 conn(0x7fd55c0c8d00 0x7fd55c06b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:08.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.603+0000 7fd56193a640 1 --2- 172.21.15.53:0/2648494822 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd55c06b2f0 0x7fd55c06f070 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:08.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.603+0000 7fd56193a640 1 -- 172.21.15.53:0/2648494822 >> 172.21.15.53:0/2648494822 conn(0x7fd55c06a0d0 msgr2=0x7fd55c0ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:09:08.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.603+0000 7fd56193a640 1 -- 172.21.15.53:0/2648494822 shutdown_connections 2023-06-10T19:09:08.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.603+0000 7fd56193a640 1 -- 172.21.15.53:0/2648494822 wait complete. 2023-06-10T19:09:08.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.603+0000 7fd56193a640 1 Processor -- start 2023-06-10T19:09:08.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.603+0000 7fd56193a640 1 -- start start 2023-06-10T19:09:08.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.603+0000 7fd56193a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd55c06b2f0 0x7fd55c0c2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:08.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.603+0000 7fd56193a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd55c06bc00 0x7fd55c153fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:08.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.603+0000 7fd56193a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd55c0c8d00 0x7fd55c0c4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:08.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.603+0000 7fd56193a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd55c15a600 con 0x7fd55c06bc00 2023-06-10T19:09:08.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.603+0000 7fd56193a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd55c154510 con 0x7fd55c06b2f0 2023-06-10T19:09:08.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.603+0000 7fd56193a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd55c15a7f0 con 0x7fd55c0c8d00 2023-06-10T19:09:08.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.603+0000 7fd55a7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd55c06bc00 0x7fd55c153fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:08.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.603+0000 7fd55a7fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd55c06bc00 0x7fd55c153fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55034/0 (socket says 172.21.15.53:55034) 2023-06-10T19:09:08.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.603+0000 7fd55a7fc640 1 -- 172.21.15.53:0/340662927 learned_addr learned my addr 172.21.15.53:0/340662927 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:09:08.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.603+0000 7fd55b7fe640 1 --2- 172.21.15.53:0/340662927 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd55c0c8d00 0x7fd55c0c4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:08.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.603+0000 7fd55affd640 1 --2- 172.21.15.53:0/340662927 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd55c06b2f0 0x7fd55c0c2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:08.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.603+0000 7fd55a7fc640 1 -- 172.21.15.53:0/340662927 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd55c0c8d00 msgr2=0x7fd55c0c4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:08.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.603+0000 7fd55a7fc640 1 --2- 172.21.15.53:0/340662927 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd55c0c8d00 0x7fd55c0c4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:08.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.603+0000 7fd55a7fc640 1 -- 172.21.15.53:0/340662927 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd55c06b2f0 msgr2=0x7fd55c0c2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:08.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.603+0000 7fd55a7fc640 1 --2- 172.21.15.53:0/340662927 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd55c06b2f0 0x7fd55c0c2b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:08.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.603+0000 7fd55a7fc640 1 -- 172.21.15.53:0/340662927 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd550009420 con 0x7fd55c06bc00 2023-06-10T19:09:08.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.603+0000 7fd55a7fc640 1 --2- 172.21.15.53:0/340662927 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd55c06bc00 0x7fd55c153fd0 secure :-1 s=READY pgs=2737 cs=0 l=1 rev1=1 crypto rx=0x7fd55000e980 tx=0x7fd55000ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:08.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.607+0000 7fd543fff640 1 -- 172.21.15.53:0/340662927 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd55000ca00 con 0x7fd55c06bc00 2023-06-10T19:09:08.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.607+0000 7fd543fff640 1 -- 172.21.15.53:0/340662927 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd55000cb60 con 0x7fd55c06bc00 2023-06-10T19:09:08.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.607+0000 7fd56193a640 1 -- 172.21.15.53:0/340662927 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd54c00b770 con 0x7fd55c06bc00 2023-06-10T19:09:08.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.607+0000 7fd543fff640 1 -- 172.21.15.53:0/340662927 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd550013470 con 0x7fd55c06bc00 2023-06-10T19:09:08.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.607+0000 7fd56193a640 1 -- 172.21.15.53:0/340662927 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd55c15adb0 con 0x7fd55c06bc00 2023-06-10T19:09:08.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.607+0000 7fd56193a640 1 -- 172.21.15.53:0/340662927 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd55c070a40 con 0x7fd55c06bc00 2023-06-10T19:09:08.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.607+0000 7fd543fff640 1 -- 172.21.15.53:0/340662927 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd5500135d0 con 0x7fd55c06bc00 2023-06-10T19:09:08.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.607+0000 7fd543fff640 1 --2- 172.21.15.53:0/340662927 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd548066280 0x7fd548068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:08.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.607+0000 7fd543fff640 1 -- 172.21.15.53:0/340662927 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fd550083c00 con 0x7fd55c06bc00 2023-06-10T19:09:08.617 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.607+0000 7fd55affd640 1 --2- 172.21.15.53:0/340662927 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd548066280 0x7fd548068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:08.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.607+0000 7fd55affd640 1 --2- 172.21.15.53:0/340662927 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd548066280 0x7fd548068730 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fd54c0b3000 tx=0x7fd54c0ac000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:08.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.611+0000 7fd543fff640 1 -- 172.21.15.53:0/340662927 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd55c070a40 con 0x7fd55c06bc00 2023-06-10T19:09:08.668 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-10T19:09:08.670 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-10T19:09:08.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.767+0000 7fd56193a640 1 -- 172.21.15.53:0/340662927 --> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd55c070260 con 0x7fd548066280 2023-06-10T19:09:08.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.775+0000 7fd543fff640 1 -- 172.21.15.53:0/340662927 <== mgr.4105 v2:172.21.15.117:6832/3061986771 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71614 (secure 0 0 0) 0x7fd54c0c0070 con 0x7fd548066280 2023-06-10T19:09:08.781 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:09:08.781 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-06-10T19:09:08.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.775+0000 7fd56193a640 1 -- 172.21.15.53:0/340662927 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd548066280 msgr2=0x7fd548068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:08.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.775+0000 7fd56193a640 1 --2- 172.21.15.53:0/340662927 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd548066280 0x7fd548068730 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fd54c0b3000 tx=0x7fd54c0ac000 comp rx=0 tx=0).stop 2023-06-10T19:09:08.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.775+0000 7fd56193a640 1 -- 172.21.15.53:0/340662927 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd55c06bc00 msgr2=0x7fd55c153fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:08.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.775+0000 7fd56193a640 1 --2- 172.21.15.53:0/340662927 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd55c06bc00 0x7fd55c153fd0 secure :-1 s=READY pgs=2737 cs=0 l=1 rev1=1 crypto rx=0x7fd55000e980 tx=0x7fd55000ee40 comp rx=0 tx=0).stop 2023-06-10T19:09:08.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.775+0000 7fd56193a640 1 -- 172.21.15.53:0/340662927 shutdown_connections 2023-06-10T19:09:08.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.775+0000 7fd56193a640 1 --2- 172.21.15.53:0/340662927 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd548066280 0x7fd548068730 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:08.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.775+0000 7fd56193a640 1 --2- 172.21.15.53:0/340662927 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd55c0c8d00 0x7fd55c0c4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:08.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.775+0000 7fd56193a640 1 --2- 172.21.15.53:0/340662927 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd55c06bc00 0x7fd55c153fd0 unknown :-1 s=CLOSED pgs=2737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:08.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.775+0000 7fd56193a640 1 --2- 172.21.15.53:0/340662927 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd55c06b2f0 0x7fd55c0c2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:08.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.775+0000 7fd56193a640 1 -- 172.21.15.53:0/340662927 >> 172.21.15.53:0/340662927 conn(0x7fd55c06a0d0 msgr2=0x7fd55c0ccbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:09:08.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.775+0000 7fd56193a640 1 -- 172.21.15.53:0/340662927 shutdown_connections 2023-06-10T19:09:08.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.775+0000 7fd56193a640 1 -- 172.21.15.53:0/340662927 wait complete. 2023-06-10T19:09:08.800 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":677,"stamp":"2023-06-10T19:09:07.943982+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":145,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":284188,"kb_used_data":19420,"kb_used_omap":0,"kb_used_meta":264704,"kb_avail":754690532,"statfs":{"total":773094113280,"available":772803104768,"internally_reserved":0,"allocated":19886080,"data_stored":9932247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":271056896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12801,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-1,"num_read_kb":0,"num_write":-58,"num_write_kb":-31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001748"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":447,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-06-10T19:09:06.884796+0000","last_change":"2023-06-10T18:52:34.951528+0000","last_active":"2023-06-10T19:09:06.884796+0000","last_peered":"2023-06-10T19:09:06.884796+0000","last_clean":"2023-06-10T19:09:06.884796+0000","last_became_active":"2023-06-10T18:52:34.949099+0000","last_became_peered":"2023-06-10T18:52:34.949099+0000","last_unstale":"2023-06-10T19:09:06.884796+0000","last_undegraded":"2023-06-10T19:09:06.884796+0000","last_fullsized":"2023-06-10T19:09:06.884796+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_clean_scrub_stamp":"2023-06-10T18:52:33.633295+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:11:24.585790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":322,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-06-10T19:09:06.483312+0000","last_change":"2023-06-10T18:52:40.506384+0000","last_active":"2023-06-10T19:09:06.483312+0000","last_peered":"2023-06-10T19:09:06.483312+0000","last_clean":"2023-06-10T19:09:06.483312+0000","last_became_active":"2023-06-10T18:52:40.505701+0000","last_became_peered":"2023-06-10T18:52:40.505701+0000","last_unstale":"2023-06-10T19:09:06.483312+0000","last_undegraded":"2023-06-10T19:09:06.483312+0000","last_fullsized":"2023-06-10T19:09:06.483312+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:57:46.897873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":291,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-06-10T19:09:06.884465+0000","last_change":"2023-06-10T18:52:40.512015+0000","last_active":"2023-06-10T19:09:06.884465+0000","last_peered":"2023-06-10T19:09:06.884465+0000","last_clean":"2023-06-10T19:09:06.884465+0000","last_became_active":"2023-06-10T18:52:40.511382+0000","last_became_peered":"2023-06-10T18:52:40.511382+0000","last_unstale":"2023-06-10T19:09:06.884465+0000","last_undegraded":"2023-06-10T19:09:06.884465+0000","last_fullsized":"2023-06-10T19:09:06.884465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:59:38.520388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":312,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-06-10T19:09:06.889031+0000","last_change":"2023-06-10T18:52:40.671725+0000","last_active":"2023-06-10T19:09:06.889031+0000","last_peered":"2023-06-10T19:09:06.889031+0000","last_clean":"2023-06-10T19:09:06.889031+0000","last_became_active":"2023-06-10T18:52:40.671442+0000","last_became_peered":"2023-06-10T18:52:40.671442+0000","last_unstale":"2023-06-10T19:09:06.889031+0000","last_undegraded":"2023-06-10T19:09:06.889031+0000","last_fullsized":"2023-06-10T19:09:06.889031+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:27:02.125401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":322,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-06-10T19:09:06.481773+0000","last_change":"2023-06-10T18:52:40.510258+0000","last_active":"2023-06-10T19:09:06.481773+0000","last_peered":"2023-06-10T19:09:06.481773+0000","last_clean":"2023-06-10T19:09:06.481773+0000","last_became_active":"2023-06-10T18:52:40.509560+0000","last_became_peered":"2023-06-10T18:52:40.509560+0000","last_unstale":"2023-06-10T19:09:06.481773+0000","last_undegraded":"2023-06-10T19:09:06.481773+0000","last_fullsized":"2023-06-10T19:09:06.481773+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:32:31.108716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":292,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-06-10T19:09:06.884271+0000","last_change":"2023-06-10T18:52:40.672266+0000","last_active":"2023-06-10T19:09:06.884271+0000","last_peered":"2023-06-10T19:09:06.884271+0000","last_clean":"2023-06-10T19:09:06.884271+0000","last_became_active":"2023-06-10T18:52:40.671966+0000","last_became_peered":"2023-06-10T18:52:40.671966+0000","last_unstale":"2023-06-10T19:09:06.884271+0000","last_undegraded":"2023-06-10T19:09:06.884271+0000","last_fullsized":"2023-06-10T19:09:06.884271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:12:45.261471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":290,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-06-10T19:09:06.883364+0000","last_change":"2023-06-10T18:52:40.671084+0000","last_active":"2023-06-10T19:09:06.883364+0000","last_peered":"2023-06-10T19:09:06.883364+0000","last_clean":"2023-06-10T19:09:06.883364+0000","last_became_active":"2023-06-10T18:52:40.670697+0000","last_became_peered":"2023-06-10T18:52:40.670697+0000","last_unstale":"2023-06-10T19:09:06.883364+0000","last_undegraded":"2023-06-10T19:09:06.883364+0000","last_fullsized":"2023-06-10T19:09:06.883364+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:13:40.272077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":292,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-06-10T19:09:06.882941+0000","last_change":"2023-06-10T18:52:40.514114+0000","last_active":"2023-06-10T19:09:06.882941+0000","last_peered":"2023-06-10T19:09:06.882941+0000","last_clean":"2023-06-10T19:09:06.882941+0000","last_became_active":"2023-06-10T18:52:40.513638+0000","last_became_peered":"2023-06-10T18:52:40.513638+0000","last_unstale":"2023-06-10T19:09:06.882941+0000","last_undegraded":"2023-06-10T19:09:06.882941+0000","last_fullsized":"2023-06-10T19:09:06.882941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:49:19.455984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":292,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-06-10T19:09:06.885144+0000","last_change":"2023-06-10T18:52:40.515396+0000","last_active":"2023-06-10T19:09:06.885144+0000","last_peered":"2023-06-10T19:09:06.885144+0000","last_clean":"2023-06-10T19:09:06.885144+0000","last_became_active":"2023-06-10T18:52:40.514663+0000","last_became_peered":"2023-06-10T18:52:40.514663+0000","last_unstale":"2023-06-10T19:09:06.885144+0000","last_undegraded":"2023-06-10T19:09:06.885144+0000","last_fullsized":"2023-06-10T19:09:06.885144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:30:54.158485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575050,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33916,"kb_used_data":2868,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94337924,"statfs":{"total":96636764160,"available":96602034176,"internally_reserved":0,"allocated":2936832,"data_stored":1686192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.92300000000000004,"15min":0.92700000000000005},"min":{"1min":0.55700000000000005,"5min":0.443,"15min":0.434},"max":{"1min":1.256,"5min":1.522,"15min":1.6220000000000001},"last":1.1040000000000001},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.89700000000000002,"15min":0.92000000000000004},"min":{"1min":0.49399999999999999,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.202,"5min":1.3109999999999999,"15min":1.6870000000000001},"last":0.998}]},{"osd":1,"last update":"Sat Jun 10 19:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.89600000000000002,"15min":0.91900000000000004},"min":{"1min":0.53500000000000003,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.365,"5min":1.365,"15min":1.377},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.92000000000000004,"15min":0.94599999999999995},"min":{"1min":0.65000000000000002,"5min":0.51300000000000001,"15min":0.504},"max":{"1min":1.2949999999999999,"5min":1.3320000000000001,"15min":1.5960000000000001},"last":1.05}]},{"osd":2,"last update":"Sat Jun 10 19:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.88400000000000001,"15min":0.85999999999999999},"min":{"1min":0.68600000000000005,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.113,"5min":1.2629999999999999,"15min":1.4059999999999999},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.872,"15min":0.89000000000000001},"min":{"1min":0.54000000000000004,"5min":0.53300000000000003,"15min":0.50600000000000001},"max":{"1min":1.093,"5min":1.3100000000000001,"15min":1.448},"last":1.179}]},{"osd":3,"last update":"Sat Jun 10 19:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.89000000000000001,"15min":0.92300000000000004},"min":{"1min":0.60599999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.236,"5min":1.4490000000000001,"15min":1.502},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.95699999999999996,"15min":0.95899999999999996},"min":{"1min":0.67400000000000004,"5min":0.432,"15min":0.432},"max":{"1min":1.208,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":1.0289999999999999}]},{"osd":4,"last update":"Sat Jun 10 19:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.83499999999999996,"15min":0.84199999999999997},"min":{"1min":0.61099999999999999,"5min":0.307,"15min":0.307},"max":{"1min":1.109,"5min":1.2290000000000001,"15min":1.639},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.96499999999999997,"15min":0.96599999999999997},"min":{"1min":0.70899999999999996,"5min":0.41199999999999998,"15min":0.40000000000000002},"max":{"1min":1.3320000000000001,"5min":1.3540000000000001,"15min":1.4590000000000001},"last":0.76200000000000001}]},{"osd":5,"last update":"Sat Jun 10 19:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.96899999999999997,"15min":0.99099999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.1519999999999999,"5min":1.385,"15min":1.806},"last":1.224},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0329999999999999,"15min":1.036},"min":{"1min":0.627,"5min":0.48499999999999999,"15min":0.46500000000000002},"max":{"1min":1.4159999999999999,"5min":1.665,"15min":1.665},"last":1.075}]},{"osd":6,"last update":"Sat Jun 10 19:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.98699999999999999,"15min":1.0029999999999999},"min":{"1min":0.56200000000000006,"5min":0.47699999999999998,"15min":0.35999999999999999},"max":{"1min":1.282,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":0.89900000000000002},{"interface":"front","average":{"1min":1.081,"5min":1.085,"15min":1.0980000000000001},"min":{"1min":0.69899999999999995,"5min":0.504,"15min":0.441},"max":{"1min":1.2749999999999999,"5min":1.728,"15min":1.728},"last":1.1459999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575051,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33320,"kb_used_data":2272,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338520,"statfs":{"total":96636764160,"available":96602644480,"internally_reserved":0,"allocated":2326528,"data_stored":1089812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:09:01 2023","interfaces":[{"interface":"back","average":{"1min":1.575,"5min":0.98999999999999999,"15min":0.91800000000000004},"min":{"1min":0.56899999999999995,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":12.345000000000001,"5min":12.345000000000001,"15min":12.345000000000001},"last":1},{"interface":"front","average":{"1min":1.51,"5min":1.008,"15min":0.92900000000000005},"min":{"1min":0.65000000000000002,"5min":0.57099999999999995,"15min":0.40699999999999997},"max":{"1min":10.475,"5min":10.475,"15min":10.475},"last":0.71199999999999997}]},{"osd":1,"last update":"Sat Jun 10 19:09:01 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.83399999999999996,"15min":0.86199999999999999},"min":{"1min":0.68500000000000005,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.0780000000000001,"5min":1.2709999999999999,"15min":1.5229999999999999},"last":1.089},{"interface":"front","average":{"1min":1.5940000000000001,"5min":1.0489999999999999,"15min":0.95599999999999996},"min":{"1min":0.58999999999999997,"5min":0.504,"15min":0.45300000000000001},"max":{"1min":12.467000000000001,"5min":12.467000000000001,"15min":12.467000000000001},"last":0.877}]},{"osd":2,"last update":"Sat Jun 10 19:09:01 2023","interfaces":[{"interface":"back","average":{"1min":1.5149999999999999,"5min":1.0189999999999999,"15min":0.94599999999999995},"min":{"1min":0.63200000000000001,"5min":0.51200000000000001,"15min":0.48799999999999999},"max":{"1min":10.566000000000001,"5min":10.566000000000001,"15min":10.566000000000001},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.85999999999999999,"15min":0.88},"min":{"1min":0.626,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.94999999999999996}]},{"osd":3,"last update":"Sat Jun 10 19:09:01 2023","interfaces":[{"interface":"back","average":{"1min":1.6439999999999999,"5min":1.0569999999999999,"15min":0.97699999999999998},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":12.411,"5min":12.411,"15min":12.411},"last":1.0660000000000001},{"interface":"front","average":{"1min":1.5569999999999999,"5min":1.0640000000000001,"15min":1.0169999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.52900000000000003},"max":{"1min":10.695,"5min":10.695,"15min":10.695},"last":1.1240000000000001}]},{"osd":4,"last update":"Sat Jun 10 19:09:01 2023","interfaces":[{"interface":"back","average":{"1min":1.629,"5min":1.0760000000000001,"15min":0.95999999999999996},"min":{"1min":0.65200000000000002,"5min":0.45900000000000002,"15min":0.373},"max":{"1min":13.308999999999999,"5min":13.308999999999999,"15min":13.308999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":1.853,"5min":1.1619999999999999,"15min":1.0389999999999999},"min":{"1min":0.73299999999999998,"5min":0.504,"15min":0.47899999999999998},"max":{"1min":15.680999999999999,"5min":15.680999999999999,"15min":15.680999999999999},"last":0.91300000000000003}]},{"osd":5,"last update":"Sat Jun 10 19:09:01 2023","interfaces":[{"interface":"back","average":{"1min":1.7869999999999999,"5min":1.0489999999999999,"15min":0.95399999999999996},"min":{"1min":0.68200000000000005,"5min":0.437,"15min":0.437},"max":{"1min":15.074999999999999,"5min":15.074999999999999,"15min":15.074999999999999},"last":1.151},{"interface":"front","average":{"1min":1.903,"5min":1.1970000000000001,"15min":1.0820000000000001},"min":{"1min":0.69799999999999995,"5min":0.47199999999999998,"15min":0.42699999999999999},"max":{"1min":15.189,"5min":15.189,"15min":15.189},"last":1.1699999999999999}]},{"osd":7,"last update":"Sat Jun 10 19:09:01 2023","interfaces":[{"interface":"back","average":{"1min":1.6279999999999999,"5min":1.1419999999999999,"15min":1.0660000000000001},"min":{"1min":0.64600000000000002,"5min":0.59199999999999997,"15min":0.57099999999999995},"max":{"1min":10.813000000000001,"5min":10.813000000000001,"15min":10.813000000000001},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.133,"5min":1.0069999999999999,"15min":1.0029999999999999},"min":{"1min":0.76900000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":2.4870000000000001,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":1.1970000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575051,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33336,"kb_used_data":2288,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338504,"statfs":{"total":96636764160,"available":96602628096,"internally_reserved":0,"allocated":2342912,"data_stored":1095824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.85199999999999998,"15min":0.873},"min":{"1min":0.51900000000000002,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.2350000000000001,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":1.0149999999999999},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.88400000000000001,"15min":0.89700000000000002},"min":{"1min":0.64200000000000002,"5min":0.50800000000000001,"15min":0.49399999999999999},"max":{"1min":1.1779999999999999,"5min":1.2370000000000001,"15min":2.347},"last":0.78300000000000003}]},{"osd":1,"last update":"Sat Jun 10 19:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.89100000000000001,"15min":0.91000000000000003},"min":{"1min":0.51800000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.3180000000000001,"5min":1.6739999999999999,"15min":7.0800000000000001},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.89600000000000002,"15min":0.98099999999999998},"min":{"1min":0.67200000000000004,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.117,"5min":1.244,"15min":15.845000000000001},"last":1.2809999999999999}]},{"osd":2,"last update":"Sat Jun 10 19:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.90400000000000003,"15min":0.90000000000000002},"min":{"1min":0.66200000000000003,"5min":0.59899999999999998,"15min":0.48299999999999998},"max":{"1min":1.1930000000000001,"5min":1.6459999999999999,"15min":5.0049999999999999},"last":1.0549999999999999},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.92700000000000005,"15min":0.94899999999999995},"min":{"1min":0.69099999999999995,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.163,"5min":1.391,"15min":6.851},"last":0.83099999999999996}]},{"osd":3,"last update":"Sat Jun 10 19:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.93100000000000005,"15min":0.94699999999999995},"min":{"1min":0.71799999999999997,"5min":0.58699999999999997,"15min":0.51500000000000001},"max":{"1min":1.304,"5min":1.6910000000000001,"15min":2.544},"last":0.871},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.98399999999999999,"15min":0.98499999999999999},"min":{"1min":0.77600000000000002,"5min":0.66000000000000003,"15min":0.59799999999999998},"max":{"1min":1.1619999999999999,"5min":1.4870000000000001,"15min":3.0830000000000002},"last":0.98299999999999998}]},{"osd":4,"last update":"Sat Jun 10 19:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.93500000000000005,"15min":0.93999999999999995},"min":{"1min":0.64300000000000002,"5min":0.59799999999999998,"15min":0.58099999999999996},"max":{"1min":1.246,"5min":1.6140000000000001,"15min":6.7290000000000001},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.97899999999999998,"15min":0.97999999999999998},"min":{"1min":0.61699999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.278,"5min":1.677,"15min":1.677},"last":1.1279999999999999}]},{"osd":6,"last update":"Sat Jun 10 19:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.98199999999999998,"15min":0.97599999999999998},"min":{"1min":0.64100000000000001,"5min":0.60499999999999998,"15min":0.54200000000000004},"max":{"1min":1.2110000000000001,"5min":1.8009999999999999,"15min":1.8009999999999999},"last":0.93000000000000005},{"interface":"front","average":{"1min":1.012,"5min":1.04,"15min":1.0489999999999999},"min":{"1min":0.77600000000000002,"5min":0.66200000000000003,"15min":0.57899999999999996},"max":{"1min":1.504,"5min":1.8380000000000001,"15min":6.923},"last":0.95799999999999996}]},{"osd":7,"last update":"Sat Jun 10 19:08:58 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.0780000000000001,"15min":1.073},"min":{"1min":0.70699999999999996,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.4419999999999999,"5min":1.7749999999999999,"15min":2.6080000000000001},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.125,"5min":1.1200000000000001,"15min":1.1279999999999999},"min":{"1min":0.74099999999999999,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.351,"5min":1.8049999999999999,"15min":5.4169999999999998},"last":1.1040000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575050,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33336,"kb_used_data":2288,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338504,"statfs":{"total":96636764160,"available":96602628096,"internally_reserved":0,"allocated":2342912,"data_stored":1095824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:08:09 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82399999999999995,"15min":0.83899999999999997},"min":{"1min":0.621,"5min":0.45400000000000001,"15min":0.45100000000000001},"max":{"1min":1.1699999999999999,"5min":1.29,"15min":1.29},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.90400000000000003,"15min":0.90800000000000003},"min":{"1min":0.57399999999999995,"5min":0.439,"15min":0.439},"max":{"1min":1.242,"5min":1.3979999999999999,"15min":3.7280000000000002},"last":0.60899999999999999}]},{"osd":1,"last update":"Sat Jun 10 19:08:09 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.88600000000000001,"15min":0.92100000000000004},"min":{"1min":0.51300000000000001,"5min":0.47799999999999998,"15min":0.47599999999999998},"max":{"1min":1.3560000000000001,"5min":1.5429999999999999,"15min":3.3969999999999998},"last":1.149},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84099999999999997,"15min":0.86299999999999999},"min":{"1min":0.53200000000000003,"5min":0.47899999999999998,"15min":0.47699999999999998},"max":{"1min":1.1339999999999999,"5min":1.2430000000000001,"15min":2.496},"last":0.86399999999999999}]},{"osd":2,"last update":"Sat Jun 10 19:08:09 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.85199999999999998,"15min":0.875},"min":{"1min":0.53600000000000003,"5min":0.52400000000000002,"15min":0.49299999999999999},"max":{"1min":1.0740000000000001,"5min":1.2070000000000001,"15min":1.522},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.94399999999999995,"15min":0.97699999999999998},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.155,"5min":1.4670000000000001,"15min":3.5750000000000002},"last":0.95999999999999996}]},{"osd":3,"last update":"Sat Jun 10 19:08:09 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85399999999999998,"15min":0.89300000000000002},"min":{"1min":0.65100000000000002,"5min":0.56200000000000006,"15min":0.53900000000000003},"max":{"1min":1.1080000000000001,"5min":1.28,"15min":2.3809999999999998},"last":1.101},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.95499999999999996,"15min":0.96499999999999997},"min":{"1min":0.65000000000000002,"5min":0.58199999999999996,"15min":0.54400000000000004},"max":{"1min":1.274,"5min":1.4279999999999999,"15min":1.6479999999999999},"last":1.224}]},{"osd":5,"last update":"Sat Jun 10 19:08:09 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":0.97399999999999998,"15min":0.95799999999999996},"min":{"1min":0.69299999999999995,"5min":0.58699999999999997,"15min":0.53100000000000003},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":3.6539999999999999},"last":1.069},{"interface":"front","average":{"1min":0.998,"5min":0.94499999999999995,"15min":0.93999999999999995},"min":{"1min":0.61899999999999999,"5min":0.495,"15min":0.495},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":2.6720000000000002},"last":1.1819999999999999}]},{"osd":6,"last update":"Sat Jun 10 19:08:09 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.97399999999999998,"15min":0.96499999999999997},"min":{"1min":0.69899999999999995,"5min":0.443,"15min":0.443},"max":{"1min":1.3400000000000001,"5min":1.413,"15min":2.2639999999999998},"last":1.3540000000000001},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.091,"15min":1.0680000000000001},"min":{"1min":0.73699999999999999,"5min":0.58799999999999997,"15min":0.44400000000000001},"max":{"1min":1.5269999999999999,"5min":1.625,"15min":3.4980000000000002},"last":1.298}]},{"osd":7,"last update":"Sat Jun 10 19:08:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.034,"15min":1.0049999999999999},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.41399999999999998},"max":{"1min":1.506,"5min":1.506,"15min":2.5910000000000002},"last":1.3799999999999999},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.095,"15min":1.073},"min":{"1min":0.60399999999999998,"5min":0.50800000000000001,"15min":0.46300000000000002},"max":{"1min":1.3799999999999999,"5min":1.635,"15min":1.635},"last":1.4510000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575049,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37428,"kb_used_data":2284,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334412,"statfs":{"total":96636764160,"available":96598437888,"internally_reserved":0,"allocated":2338816,"data_stored":1094805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.626,"15min":0.626},"min":{"1min":0.26000000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.91800000000000004,"5min":1.0900000000000001,"15min":1.169},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.64800000000000002,"15min":0.66800000000000004},"min":{"1min":0.32000000000000001,"5min":0.29299999999999998,"15min":0.251},"max":{"1min":0.93999999999999995,"5min":0.97799999999999998,"15min":1.5269999999999999},"last":0.378}]},{"osd":1,"last update":"Sat Jun 10 19:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.67700000000000005,"15min":0.68899999999999995},"min":{"1min":0.308,"5min":0.29699999999999999,"15min":0.27800000000000002},"max":{"1min":1.03,"5min":1.234,"15min":2.0699999999999998},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.70299999999999996,"15min":0.73199999999999998},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.0129999999999999,"5min":1.1659999999999999,"15min":1.296},"last":0.41299999999999998}]},{"osd":2,"last update":"Sat Jun 10 19:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.73699999999999999,"15min":0.76800000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.1359999999999999,"5min":1.1950000000000001,"15min":1.3899999999999999},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.78000000000000003,"15min":0.79200000000000004},"min":{"1min":0.314,"5min":0.314,"15min":0.29699999999999999},"max":{"1min":1.119,"5min":1.2769999999999999,"15min":1.591},"last":0.36899999999999999}]},{"osd":4,"last update":"Sat Jun 10 19:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.92000000000000004,"15min":0.94099999999999995},"min":{"1min":0.57899999999999996,"5min":0.55800000000000005,"15min":0.41899999999999998},"max":{"1min":1.2729999999999999,"5min":1.333,"15min":1.8240000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.98199999999999998,"15min":0.98699999999999999},"min":{"1min":0.502,"5min":0.502,"15min":0.47999999999999998},"max":{"1min":1.3720000000000001,"5min":1.4330000000000001,"15min":1.873},"last":0.63900000000000001}]},{"osd":5,"last update":"Sat Jun 10 19:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.98899999999999999,"15min":0.998},"min":{"1min":0.61699999999999999,"5min":0.55900000000000005,"15min":0.55200000000000005},"max":{"1min":1.371,"5min":1.536,"15min":1.752},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.94499999999999995,"5min":1.022,"15min":1.0329999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.46899999999999997},"max":{"1min":1.399,"5min":1.534,"15min":1.9259999999999999},"last":0.71099999999999997}]},{"osd":6,"last update":"Sat Jun 10 19:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":1.0329999999999999,"15min":1.0569999999999999},"min":{"1min":0.60599999999999998,"5min":0.56999999999999995,"15min":0.55300000000000005},"max":{"1min":1.4570000000000001,"5min":1.617,"15min":1.786},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.96399999999999997,"5min":1.0149999999999999,"15min":1.042},"min":{"1min":0.68700000000000006,"5min":0.61399999999999999,"15min":0.58799999999999997},"max":{"1min":1.375,"5min":1.4530000000000001,"15min":2.2120000000000002},"last":0.73799999999999999}]},{"osd":7,"last update":"Sat Jun 10 19:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":1.046,"15min":1.0700000000000001},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.4570000000000001,"5min":1.5720000000000001,"15min":2.1150000000000002},"last":0.58199999999999996},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.083,"15min":1.099},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.764,"5min":1.764,"15min":1.9850000000000001},"last":0.69599999999999995}]}]},{"osd":2,"up_from":13,"seq":55834575050,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37432,"kb_used_data":2288,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334408,"statfs":{"total":96636764160,"available":96598433792,"internally_reserved":0,"allocated":2342912,"data_stored":1095824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.63700000000000001,"15min":0.628},"min":{"1min":0.28899999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.2330000000000001,"5min":2.883,"15min":2.883},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.78800000000000003,"15min":0.746},"min":{"1min":0.42599999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":3.528,"5min":6.5670000000000002,"15min":6.5670000000000002},"last":0.45200000000000001}]},{"osd":1,"last update":"Sat Jun 10 19:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.63900000000000001,"15min":0.66100000000000003},"min":{"1min":0.34699999999999998,"5min":0.32300000000000001,"15min":0.29199999999999998},"max":{"1min":0.95399999999999996,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.82599999999999996,"15min":0.79300000000000004},"min":{"1min":0.38100000000000001,"5min":0.32500000000000001,"15min":0.27400000000000002},"max":{"1min":1.948,"5min":8.4429999999999996,"15min":8.4429999999999996},"last":0.38100000000000001}]},{"osd":3,"last update":"Sat Jun 10 19:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.76800000000000002,"15min":0.78500000000000003},"min":{"1min":0.38700000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":2.4969999999999999,"5min":2.4969999999999999,"15min":2.4969999999999999},"last":0.504},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.77600000000000002,"15min":0.78000000000000003},"min":{"1min":0.36799999999999999,"5min":0.33600000000000002,"15min":0.23499999999999999},"max":{"1min":2.3719999999999999,"5min":4.1849999999999996,"15min":4.1849999999999996},"last":0.47399999999999998}]},{"osd":4,"last update":"Sat Jun 10 19:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.94399999999999995,"15min":0.93400000000000005},"min":{"1min":0.624,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.3089999999999999,"5min":3.996,"15min":3.996},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.93999999999999995,"5min":1.119,"15min":1.044},"min":{"1min":0.61699999999999999,"5min":0.502,"15min":0.496},"max":{"1min":1.369,"5min":13.254,"15min":13.254},"last":0.752}]},{"osd":5,"last update":"Sat Jun 10 19:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":1.131,"15min":1.048},"min":{"1min":0.62,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.2749999999999999,"5min":6.9189999999999996,"15min":6.9189999999999996},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.91700000000000004,"5min":1.2390000000000001,"15min":1.0960000000000001},"min":{"1min":0.57199999999999995,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.161,"5min":15.526,"15min":15.526},"last":0.57199999999999995}]},{"osd":6,"last update":"Sat Jun 10 19:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":1.1220000000000001,"15min":1.0760000000000001},"min":{"1min":0.69299999999999995,"5min":0.624,"15min":0.52700000000000002},"max":{"1min":1.226,"5min":8.7089999999999996,"15min":8.7089999999999996},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.96099999999999997,"5min":1.048,"15min":1.0489999999999999},"min":{"1min":0.58599999999999997,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.417,"5min":6.1299999999999999,"15min":6.1299999999999999},"last":0.60499999999999998}]},{"osd":7,"last update":"Sat Jun 10 19:09:05 2023","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.286,"15min":1.1639999999999999},"min":{"1min":0.66600000000000004,"5min":0.60299999999999998,"15min":0.57199999999999995},"max":{"1min":1.4650000000000001,"5min":12.138,"15min":12.138},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.96499999999999997,"5min":1.0569999999999999,"15min":1.1040000000000001},"min":{"1min":0.63500000000000001,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.278,"5min":1.883,"15min":1.883},"last":0.67200000000000004}]}]},{"osd":1,"up_from":13,"seq":55834575052,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37412,"kb_used_data":2268,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334428,"statfs":{"total":96636764160,"available":96598454272,"internally_reserved":0,"allocated":2322432,"data_stored":1088793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.66900000000000004,"15min":0.68000000000000005},"min":{"1min":0.28199999999999997,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.288},"last":0.64200000000000002},{"interface":"front","average":{"1min":1.0309999999999999,"5min":0.78700000000000003,"15min":0.77300000000000002},"min":{"1min":0.34100000000000003,"5min":0.32300000000000001,"15min":0.26900000000000002},"max":{"1min":5.625,"5min":5.625,"15min":5.625},"last":0.495}]},{"osd":2,"last update":"Sat Jun 10 19:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.624,"15min":0.63900000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.249},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.21},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.71499999999999997,"15min":0.73099999999999998},"min":{"1min":0.36499999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.98399999999999999,"5min":1.2390000000000001,"15min":1.415},"last":0.79500000000000004}]},{"osd":3,"last update":"Sat Jun 10 19:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.753,"15min":0.78400000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.25600000000000001},"max":{"1min":1.177,"5min":1.177,"15min":1.6299999999999999},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.099,"5min":0.77600000000000002,"15min":0.752},"min":{"1min":0.42199999999999999,"5min":0.36099999999999999,"15min":0.29599999999999999},"max":{"1min":6.8200000000000003,"5min":6.8200000000000003,"15min":6.8200000000000003},"last":0.83399999999999996}]},{"osd":4,"last update":"Sat Jun 10 19:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.879,"15min":0.875},"min":{"1min":0.59999999999999998,"5min":0.58599999999999997,"15min":0.56399999999999995},"max":{"1min":1.1950000000000001,"5min":1.3620000000000001,"15min":1.4930000000000001},"last":0.74299999999999999},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.0029999999999999,"15min":1.024},"min":{"1min":0.65900000000000003,"5min":0.58899999999999997,"15min":0.47099999999999997},"max":{"1min":1.385,"5min":1.575,"15min":5.8209999999999997},"last":1.111}]},{"osd":5,"last update":"Sat Jun 10 19:09:07 2023","interfaces":[{"interface":"back","average":{"1min":1.331,"5min":1.0369999999999999,"15min":1.0109999999999999},"min":{"1min":0.75,"5min":0.54800000000000004,"15min":0.49399999999999999},"max":{"1min":6.7030000000000003,"5min":6.7030000000000003,"15min":6.7030000000000003},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.95999999999999996,"15min":0.97999999999999998},"min":{"1min":0.63400000000000001,"5min":0.55000000000000004,"15min":0.46300000000000002},"max":{"1min":1.409,"5min":1.448,"15min":3.089},"last":0.95199999999999996}]},{"osd":6,"last update":"Sat Jun 10 19:09:07 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.0529999999999999,"15min":1.0700000000000001},"min":{"1min":0.79100000000000004,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":6.7450000000000001,"5min":6.7450000000000001,"15min":7.2599999999999998},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.0109999999999999,"5min":0.99099999999999999,"15min":1.0349999999999999},"min":{"1min":0.65600000000000003,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.343,"5min":1.5469999999999999,"15min":9.0069999999999997},"last":0.875}]},{"osd":7,"last update":"Sat Jun 10 19:09:07 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.0629999999999999,"15min":1.0780000000000001},"min":{"1min":0.74299999999999999,"5min":0.54300000000000004,"15min":0.495},"max":{"1min":1.444,"5min":1.4890000000000001,"15min":1.6879999999999999},"last":1.026},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.125,"15min":1.1020000000000001},"min":{"1min":0.621,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":6.782,"5min":6.782,"15min":6.782},"last":1.163}]}]},{"osd":0,"up_from":13,"seq":55834575051,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38008,"kb_used_data":2864,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94333832,"statfs":{"total":96636764160,"available":96597843968,"internally_reserved":0,"allocated":2932736,"data_stored":1685173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jun 10 19:09:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.624,"15min":0.64000000000000001},"min":{"1min":0.26000000000000001,"5min":0.255,"15min":0.248},"max":{"1min":0.91100000000000003,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.78000000000000003,"15min":0.80600000000000005},"min":{"1min":0.37,"5min":0.33000000000000002,"15min":0.32700000000000001},"max":{"1min":1.141,"5min":1.3080000000000001,"15min":1.5780000000000001},"last":1.1120000000000001}]},{"osd":2,"last update":"Sat Jun 10 19:09:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.69299999999999995,"15min":0.71499999999999997},"min":{"1min":0.45600000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.101,"5min":1.1970000000000001,"15min":1.2490000000000001},"last":1.3069999999999999},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64500000000000002,"15min":0.65400000000000003},"min":{"1min":0.28899999999999998,"5min":0.28699999999999998,"15min":0.245},"max":{"1min":0.92100000000000004,"5min":1.1779999999999999,"15min":1.371},"last":0.73199999999999998}]},{"osd":3,"last update":"Sat Jun 10 19:09:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.68400000000000005,"15min":0.68500000000000005},"min":{"1min":0.35099999999999998,"5min":0.309,"15min":0.28899999999999998},"max":{"1min":1.173,"5min":1.397,"15min":1.397},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77700000000000002,"15min":0.81200000000000006},"min":{"1min":0.40100000000000002,"5min":0.36399999999999999,"15min":0.29199999999999998},"max":{"1min":1.2410000000000001,"5min":1.6240000000000001,"15min":1.742},"last":0.872}]},{"osd":4,"last update":"Sat Jun 10 19:09:04 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.89400000000000002,"15min":0.92100000000000004},"min":{"1min":0.47399999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.5580000000000001,"5min":1.758,"15min":3.0209999999999999},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.995,"15min":1.0169999999999999},"min":{"1min":0.56799999999999995,"5min":0.56200000000000006,"15min":0.48599999999999999},"max":{"1min":1.2909999999999999,"5min":1.7250000000000001,"15min":1.873},"last":1.5009999999999999}]},{"osd":5,"last update":"Sat Jun 10 19:09:04 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.88500000000000001,"15min":0.91700000000000004},"min":{"1min":0.55500000000000005,"5min":0.51300000000000001,"15min":0.45100000000000001},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.004,"5min":0.97499999999999998,"15min":1.0009999999999999},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.51400000000000001},"max":{"1min":1.6879999999999999,"5min":1.9870000000000001,"15min":4.5620000000000003},"last":1.2410000000000001}]},{"osd":6,"last update":"Sat Jun 10 19:09:04 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.038,"15min":1.073},"min":{"1min":0.76200000000000001,"5min":0.58699999999999997,"15min":0.52600000000000002},"max":{"1min":1.5129999999999999,"5min":1.9330000000000001,"15min":3.5569999999999999},"last":1.417},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.98899999999999999,"15min":0.998},"min":{"1min":0.61099999999999999,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.333,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":1.161}]},{"osd":7,"last update":"Sat Jun 10 19:09:04 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.0069999999999999,"15min":1.0249999999999999},"min":{"1min":0.58399999999999996,"5min":0.54700000000000004,"15min":0.54600000000000004},"max":{"1min":1.506,"5min":1.804,"15min":1.804},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.98699999999999999,"5min":1.036,"15min":1.0529999999999999},"min":{"1min":0.65200000000000002,"5min":0.61299999999999999,"15min":0.61099999999999999},"max":{"1min":1.3180000000000001,"5min":2.1219999999999999,"15min":2.1219999999999999},"last":1.349}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-10T19:09:08.805 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-10T19:09:08.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.919+0000 7f67dc4e2640 1 Processor -- start 2023-06-10T19:09:08.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.919+0000 7f67dc4e2640 1 -- start start 2023-06-10T19:09:08.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.919+0000 7f67dc4e2640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f67d415c7f0 0x7f67d415f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:08.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.919+0000 7f67dc4e2640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f67d415f860 0x7f67d40ceb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:08.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.919+0000 7f67dc4e2640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67d415cc40 con 0x7f67d406b780 2023-06-10T19:09:08.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.919+0000 7f67dc4e2640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67d415c3d0 con 0x7f67d415f860 2023-06-10T19:09:08.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.919+0000 7f67dc4e2640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67d40af530 con 0x7f67d415c7f0 2023-06-10T19:09:08.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.919+0000 7f67daa7f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f67d415f860 0x7f67d40ceb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:08.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.919+0000 7f67daa7f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f67d415f860 0x7f67d40ceb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55044/0 (socket says 172.21.15.53:55044) 2023-06-10T19:09:08.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.919+0000 7f67daa7f640 1 -- 172.21.15.53:0/2005430751 learned_addr learned my addr 172.21.15.53:0/2005430751 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:09:08.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.919+0000 7f67d9a7d640 1 --2- 172.21.15.53:0/2005430751 >> v2:172.21.15.117:3300/0 conn(0x7f67d415c7f0 0x7f67d415f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:08.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.919+0000 7f67daa7f640 1 -- 172.21.15.53:0/2005430751 >> v2:172.21.15.117:3300/0 conn(0x7f67d415c7f0 msgr2=0x7f67d415f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:09:08.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.919+0000 7f67daa7f640 1 --2- 172.21.15.53:0/2005430751 >> v2:172.21.15.117:3300/0 conn(0x7f67d415c7f0 0x7f67d415f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:08.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.919+0000 7f67daa7f640 1 -- 172.21.15.53:0/2005430751 >> v1:172.21.15.117:6789/0 conn(0x7f67d406b780 legacy=0x7f67d406bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:09:08.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.919+0000 7f67daa7f640 1 -- 172.21.15.53:0/2005430751 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67d415fd70 con 0x7f67d415f860 2023-06-10T19:09:08.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.923+0000 7f67daa7f640 1 --2- 172.21.15.53:0/2005430751 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67d415f860 0x7f67d40ceb20 secure :-1 s=READY pgs=2738 cs=0 l=1 rev1=1 crypto rx=0x7f67d40cdad0 tx=0x7f67cc01c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f795f3794cf3e11 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:08.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.923+0000 7f67d927c640 1 -- 172.21.15.53:0/2005430751 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67cc0a57c0 con 0x7f67d415f860 2023-06-10T19:09:08.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.923+0000 7f67d927c640 1 -- 172.21.15.53:0/2005430751 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67cc0a5920 con 0x7f67d415f860 2023-06-10T19:09:08.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.923+0000 7f67d927c640 1 -- 172.21.15.53:0/2005430751 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67cc0a5cb0 con 0x7f67d415f860 2023-06-10T19:09:08.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.923+0000 7f67dc4e2640 1 -- 172.21.15.53:0/2005430751 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67d415f860 msgr2=0x7f67d40ceb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:08.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.923+0000 7f67dc4e2640 1 --2- 172.21.15.53:0/2005430751 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67d415f860 0x7f67d40ceb20 secure :-1 s=READY pgs=2738 cs=0 l=1 rev1=1 crypto rx=0x7f67d40cdad0 tx=0x7f67cc01c900 comp rx=0 tx=0).stop 2023-06-10T19:09:08.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.923+0000 7f67dc4e2640 1 -- 172.21.15.53:0/2005430751 shutdown_connections 2023-06-10T19:09:08.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.923+0000 7f67dc4e2640 1 --2- 172.21.15.53:0/2005430751 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67d415f860 0x7f67d40ceb20 unknown :-1 s=CLOSED pgs=2738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:08.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.923+0000 7f67dc4e2640 1 --2- 172.21.15.53:0/2005430751 >> v2:172.21.15.117:3300/0 conn(0x7f67d415c7f0 0x7f67d415f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:08.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.923+0000 7f67dc4e2640 1 -- 172.21.15.53:0/2005430751 >> 172.21.15.53:0/2005430751 conn(0x7f67d406a090 msgr2=0x7f67d406d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:09:08.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.923+0000 7f67dc4e2640 1 -- 172.21.15.53:0/2005430751 shutdown_connections 2023-06-10T19:09:08.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.923+0000 7f67dc4e2640 1 -- 172.21.15.53:0/2005430751 wait complete. 2023-06-10T19:09:08.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.923+0000 7f67dc4e2640 1 Processor -- start 2023-06-10T19:09:08.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.923+0000 7f67dc4e2640 1 -- start start 2023-06-10T19:09:08.934 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.923+0000 7f67dc4e2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67d406b780 0x7f67d415b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:08.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.923+0000 7f67dc4e2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67d415c7f0 0x7f67d4154290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:08.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.923+0000 7f67dc4e2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67d415f860 0x7f67d415e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:08.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.923+0000 7f67dc4e2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67d40c5370 con 0x7f67d415f860 2023-06-10T19:09:08.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.923+0000 7f67dc4e2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67d40cb290 con 0x7f67d406b780 2023-06-10T19:09:08.935 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.923+0000 7f67dc4e2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67d40ca9f0 con 0x7f67d415c7f0 2023-06-10T19:09:08.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.927+0000 7f67daa7f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67d415f860 0x7f67d415e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:08.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.927+0000 7f67daa7f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67d415f860 0x7f67d415e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55054/0 (socket says 172.21.15.53:55054) 2023-06-10T19:09:08.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.927+0000 7f67daa7f640 1 -- 172.21.15.53:0/2610374870 learned_addr learned my addr 172.21.15.53:0/2610374870 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:09:08.936 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.927+0000 7f67da27e640 1 --2- 172.21.15.53:0/2610374870 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67d406b780 0x7f67d415b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:08.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.927+0000 7f67daa7f640 1 -- 172.21.15.53:0/2610374870 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67d415c7f0 msgr2=0x7f67d4154290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:08.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.927+0000 7f67d9a7d640 1 --2- 172.21.15.53:0/2610374870 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67d415c7f0 0x7f67d4154290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:08.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.927+0000 7f67daa7f640 1 --2- 172.21.15.53:0/2610374870 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67d415c7f0 0x7f67d4154290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:08.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.927+0000 7f67daa7f640 1 -- 172.21.15.53:0/2610374870 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67d406b780 msgr2=0x7f67d415b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:08.937 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.927+0000 7f67daa7f640 1 --2- 172.21.15.53:0/2610374870 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67d406b780 0x7f67d415b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:08.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.927+0000 7f67daa7f640 1 -- 172.21.15.53:0/2610374870 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67cc009b30 con 0x7f67d415f860 2023-06-10T19:09:08.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.927+0000 7f67da27e640 1 --2- 172.21.15.53:0/2610374870 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67d406b780 0x7f67d415b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:09:08.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.927+0000 7f67d9a7d640 1 --2- 172.21.15.53:0/2610374870 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67d415c7f0 0x7f67d4154290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:09:08.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.927+0000 7f67daa7f640 1 --2- 172.21.15.53:0/2610374870 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67d415f860 0x7f67d415e280 secure :-1 s=READY pgs=2739 cs=0 l=1 rev1=1 crypto rx=0x7f67cc0af040 tx=0x7f67cc0196a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:08.938 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.927+0000 7f67caffd640 1 -- 172.21.15.53:0/2610374870 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67cc0b8670 con 0x7f67d415f860 2023-06-10T19:09:08.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.927+0000 7f67caffd640 1 -- 172.21.15.53:0/2610374870 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67cc0b87d0 con 0x7f67d415f860 2023-06-10T19:09:08.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.927+0000 7f67dc4e2640 1 -- 172.21.15.53:0/2610374870 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67d40cacd0 con 0x7f67d415f860 2023-06-10T19:09:08.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.927+0000 7f67caffd640 1 -- 172.21.15.53:0/2610374870 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67cc0b8b80 con 0x7f67d415f860 2023-06-10T19:09:08.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.927+0000 7f67dc4e2640 1 -- 172.21.15.53:0/2610374870 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67d415b870 con 0x7f67d415f860 2023-06-10T19:09:08.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.927+0000 7f67dc4e2640 1 -- 172.21.15.53:0/2610374870 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67d40c54b0 con 0x7f67d415f860 2023-06-10T19:09:08.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.927+0000 7f67caffd640 1 -- 172.21.15.53:0/2610374870 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f67cc0b8ce0 con 0x7f67d415f860 2023-06-10T19:09:08.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.927+0000 7f67caffd640 1 --2- 172.21.15.53:0/2610374870 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f67b80662b0 0x7f67b8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:08.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.927+0000 7f67caffd640 1 -- 172.21.15.53:0/2610374870 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f67cc11f120 con 0x7f67d415f860 2023-06-10T19:09:08.940 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.927+0000 7f67da27e640 1 --2- 172.21.15.53:0/2610374870 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f67b80662b0 0x7f67b8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:08.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.931+0000 7f67da27e640 1 --2- 172.21.15.53:0/2610374870 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f67b80662b0 0x7f67b8068760 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f67d40cc140 tx=0x7f67d0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:08.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:08.935+0000 7f67caffd640 1 -- 172.21.15.53:0/2610374870 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f67cc0ec900 con 0x7f67d415f860 2023-06-10T19:09:09.092 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.087+0000 7f67dc4e2640 1 -- 172.21.15.53:0/2610374870 --> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f67d40b1a90 con 0x7f67b80662b0 2023-06-10T19:09:09.100 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.095+0000 7f67caffd640 1 -- 172.21.15.53:0/2610374870 <== mgr.4105 v2:172.21.15.117:6832/3061986771 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71614 (secure 0 0 0) 0x7f67d00094c0 con 0x7f67b80662b0 2023-06-10T19:09:09.103 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:09:09.104 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-06-10T19:09:09.105 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.095+0000 7f67dc4e2640 1 -- 172.21.15.53:0/2610374870 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f67b80662b0 msgr2=0x7f67b8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:09.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.095+0000 7f67dc4e2640 1 --2- 172.21.15.53:0/2610374870 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f67b80662b0 0x7f67b8068760 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f67d40cc140 tx=0x7f67d0008040 comp rx=0 tx=0).stop 2023-06-10T19:09:09.106 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.095+0000 7f67dc4e2640 1 -- 172.21.15.53:0/2610374870 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67d415f860 msgr2=0x7f67d415e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:09.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.095+0000 7f67dc4e2640 1 --2- 172.21.15.53:0/2610374870 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67d415f860 0x7f67d415e280 secure :-1 s=READY pgs=2739 cs=0 l=1 rev1=1 crypto rx=0x7f67cc0af040 tx=0x7f67cc0196a0 comp rx=0 tx=0).stop 2023-06-10T19:09:09.107 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.099+0000 7f67dc4e2640 1 -- 172.21.15.53:0/2610374870 shutdown_connections 2023-06-10T19:09:09.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.099+0000 7f67dc4e2640 1 --2- 172.21.15.53:0/2610374870 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f67b80662b0 0x7f67b8068760 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:09.108 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.099+0000 7f67dc4e2640 1 --2- 172.21.15.53:0/2610374870 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f67d415f860 0x7f67d415e280 unknown :-1 s=CLOSED pgs=2739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:09.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.099+0000 7f67dc4e2640 1 --2- 172.21.15.53:0/2610374870 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f67d415c7f0 0x7f67d4154290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:09.109 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.099+0000 7f67dc4e2640 1 --2- 172.21.15.53:0/2610374870 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67d406b780 0x7f67d415b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:09.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.099+0000 7f67dc4e2640 1 -- 172.21.15.53:0/2610374870 >> 172.21.15.53:0/2610374870 conn(0x7f67d406a090 msgr2=0x7f67d40afb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:09:09.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.099+0000 7f67dc4e2640 1 -- 172.21.15.53:0/2610374870 shutdown_connections 2023-06-10T19:09:09.110 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.099+0000 7f67dc4e2640 1 -- 172.21.15.53:0/2610374870 wait complete. 2023-06-10T19:09:09.121 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":677,"stamp":"2023-06-10T19:09:07.943982+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":145,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":284188,"kb_used_data":19420,"kb_used_omap":0,"kb_used_meta":264704,"kb_avail":754690532,"statfs":{"total":773094113280,"available":772803104768,"internally_reserved":0,"allocated":19886080,"data_stored":9932247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":271056896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12801,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-1,"num_read_kb":0,"num_write":-58,"num_write_kb":-31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001748"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":447,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-06-10T19:09:06.884796+0000","last_change":"2023-06-10T18:52:34.951528+0000","last_active":"2023-06-10T19:09:06.884796+0000","last_peered":"2023-06-10T19:09:06.884796+0000","last_clean":"2023-06-10T19:09:06.884796+0000","last_became_active":"2023-06-10T18:52:34.949099+0000","last_became_peered":"2023-06-10T18:52:34.949099+0000","last_unstale":"2023-06-10T19:09:06.884796+0000","last_undegraded":"2023-06-10T19:09:06.884796+0000","last_fullsized":"2023-06-10T19:09:06.884796+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_clean_scrub_stamp":"2023-06-10T18:52:33.633295+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:11:24.585790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":322,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-06-10T19:09:06.483312+0000","last_change":"2023-06-10T18:52:40.506384+0000","last_active":"2023-06-10T19:09:06.483312+0000","last_peered":"2023-06-10T19:09:06.483312+0000","last_clean":"2023-06-10T19:09:06.483312+0000","last_became_active":"2023-06-10T18:52:40.505701+0000","last_became_peered":"2023-06-10T18:52:40.505701+0000","last_unstale":"2023-06-10T19:09:06.483312+0000","last_undegraded":"2023-06-10T19:09:06.483312+0000","last_fullsized":"2023-06-10T19:09:06.483312+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:57:46.897873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":291,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-06-10T19:09:06.884465+0000","last_change":"2023-06-10T18:52:40.512015+0000","last_active":"2023-06-10T19:09:06.884465+0000","last_peered":"2023-06-10T19:09:06.884465+0000","last_clean":"2023-06-10T19:09:06.884465+0000","last_became_active":"2023-06-10T18:52:40.511382+0000","last_became_peered":"2023-06-10T18:52:40.511382+0000","last_unstale":"2023-06-10T19:09:06.884465+0000","last_undegraded":"2023-06-10T19:09:06.884465+0000","last_fullsized":"2023-06-10T19:09:06.884465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:59:38.520388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":312,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-06-10T19:09:06.889031+0000","last_change":"2023-06-10T18:52:40.671725+0000","last_active":"2023-06-10T19:09:06.889031+0000","last_peered":"2023-06-10T19:09:06.889031+0000","last_clean":"2023-06-10T19:09:06.889031+0000","last_became_active":"2023-06-10T18:52:40.671442+0000","last_became_peered":"2023-06-10T18:52:40.671442+0000","last_unstale":"2023-06-10T19:09:06.889031+0000","last_undegraded":"2023-06-10T19:09:06.889031+0000","last_fullsized":"2023-06-10T19:09:06.889031+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:27:02.125401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":322,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-06-10T19:09:06.481773+0000","last_change":"2023-06-10T18:52:40.510258+0000","last_active":"2023-06-10T19:09:06.481773+0000","last_peered":"2023-06-10T19:09:06.481773+0000","last_clean":"2023-06-10T19:09:06.481773+0000","last_became_active":"2023-06-10T18:52:40.509560+0000","last_became_peered":"2023-06-10T18:52:40.509560+0000","last_unstale":"2023-06-10T19:09:06.481773+0000","last_undegraded":"2023-06-10T19:09:06.481773+0000","last_fullsized":"2023-06-10T19:09:06.481773+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:32:31.108716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":292,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-06-10T19:09:06.884271+0000","last_change":"2023-06-10T18:52:40.672266+0000","last_active":"2023-06-10T19:09:06.884271+0000","last_peered":"2023-06-10T19:09:06.884271+0000","last_clean":"2023-06-10T19:09:06.884271+0000","last_became_active":"2023-06-10T18:52:40.671966+0000","last_became_peered":"2023-06-10T18:52:40.671966+0000","last_unstale":"2023-06-10T19:09:06.884271+0000","last_undegraded":"2023-06-10T19:09:06.884271+0000","last_fullsized":"2023-06-10T19:09:06.884271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:12:45.261471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":290,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-06-10T19:09:06.883364+0000","last_change":"2023-06-10T18:52:40.671084+0000","last_active":"2023-06-10T19:09:06.883364+0000","last_peered":"2023-06-10T19:09:06.883364+0000","last_clean":"2023-06-10T19:09:06.883364+0000","last_became_active":"2023-06-10T18:52:40.670697+0000","last_became_peered":"2023-06-10T18:52:40.670697+0000","last_unstale":"2023-06-10T19:09:06.883364+0000","last_undegraded":"2023-06-10T19:09:06.883364+0000","last_fullsized":"2023-06-10T19:09:06.883364+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:13:40.272077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":292,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-06-10T19:09:06.882941+0000","last_change":"2023-06-10T18:52:40.514114+0000","last_active":"2023-06-10T19:09:06.882941+0000","last_peered":"2023-06-10T19:09:06.882941+0000","last_clean":"2023-06-10T19:09:06.882941+0000","last_became_active":"2023-06-10T18:52:40.513638+0000","last_became_peered":"2023-06-10T18:52:40.513638+0000","last_unstale":"2023-06-10T19:09:06.882941+0000","last_undegraded":"2023-06-10T19:09:06.882941+0000","last_fullsized":"2023-06-10T19:09:06.882941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:49:19.455984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":292,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-06-10T19:09:06.885144+0000","last_change":"2023-06-10T18:52:40.515396+0000","last_active":"2023-06-10T19:09:06.885144+0000","last_peered":"2023-06-10T19:09:06.885144+0000","last_clean":"2023-06-10T19:09:06.885144+0000","last_became_active":"2023-06-10T18:52:40.514663+0000","last_became_peered":"2023-06-10T18:52:40.514663+0000","last_unstale":"2023-06-10T19:09:06.885144+0000","last_undegraded":"2023-06-10T19:09:06.885144+0000","last_fullsized":"2023-06-10T19:09:06.885144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:30:54.158485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575050,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33916,"kb_used_data":2868,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94337924,"statfs":{"total":96636764160,"available":96602034176,"internally_reserved":0,"allocated":2936832,"data_stored":1686192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.92300000000000004,"15min":0.92700000000000005},"min":{"1min":0.55700000000000005,"5min":0.443,"15min":0.434},"max":{"1min":1.256,"5min":1.522,"15min":1.6220000000000001},"last":1.1040000000000001},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.89700000000000002,"15min":0.92000000000000004},"min":{"1min":0.49399999999999999,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.202,"5min":1.3109999999999999,"15min":1.6870000000000001},"last":0.998}]},{"osd":1,"last update":"Sat Jun 10 19:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.89600000000000002,"15min":0.91900000000000004},"min":{"1min":0.53500000000000003,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.365,"5min":1.365,"15min":1.377},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.92000000000000004,"15min":0.94599999999999995},"min":{"1min":0.65000000000000002,"5min":0.51300000000000001,"15min":0.504},"max":{"1min":1.2949999999999999,"5min":1.3320000000000001,"15min":1.5960000000000001},"last":1.05}]},{"osd":2,"last update":"Sat Jun 10 19:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.88400000000000001,"15min":0.85999999999999999},"min":{"1min":0.68600000000000005,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.113,"5min":1.2629999999999999,"15min":1.4059999999999999},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.872,"15min":0.89000000000000001},"min":{"1min":0.54000000000000004,"5min":0.53300000000000003,"15min":0.50600000000000001},"max":{"1min":1.093,"5min":1.3100000000000001,"15min":1.448},"last":1.179}]},{"osd":3,"last update":"Sat Jun 10 19:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.89000000000000001,"15min":0.92300000000000004},"min":{"1min":0.60599999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.236,"5min":1.4490000000000001,"15min":1.502},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.95699999999999996,"15min":0.95899999999999996},"min":{"1min":0.67400000000000004,"5min":0.432,"15min":0.432},"max":{"1min":1.208,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":1.0289999999999999}]},{"osd":4,"last update":"Sat Jun 10 19:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.83499999999999996,"15min":0.84199999999999997},"min":{"1min":0.61099999999999999,"5min":0.307,"15min":0.307},"max":{"1min":1.109,"5min":1.2290000000000001,"15min":1.639},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.96499999999999997,"15min":0.96599999999999997},"min":{"1min":0.70899999999999996,"5min":0.41199999999999998,"15min":0.40000000000000002},"max":{"1min":1.3320000000000001,"5min":1.3540000000000001,"15min":1.4590000000000001},"last":0.76200000000000001}]},{"osd":5,"last update":"Sat Jun 10 19:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.96899999999999997,"15min":0.99099999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.1519999999999999,"5min":1.385,"15min":1.806},"last":1.224},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0329999999999999,"15min":1.036},"min":{"1min":0.627,"5min":0.48499999999999999,"15min":0.46500000000000002},"max":{"1min":1.4159999999999999,"5min":1.665,"15min":1.665},"last":1.075}]},{"osd":6,"last update":"Sat Jun 10 19:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.98699999999999999,"15min":1.0029999999999999},"min":{"1min":0.56200000000000006,"5min":0.47699999999999998,"15min":0.35999999999999999},"max":{"1min":1.282,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":0.89900000000000002},{"interface":"front","average":{"1min":1.081,"5min":1.085,"15min":1.0980000000000001},"min":{"1min":0.69899999999999995,"5min":0.504,"15min":0.441},"max":{"1min":1.2749999999999999,"5min":1.728,"15min":1.728},"last":1.1459999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575051,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33320,"kb_used_data":2272,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338520,"statfs":{"total":96636764160,"available":96602644480,"internally_reserved":0,"allocated":2326528,"data_stored":1089812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:09:01 2023","interfaces":[{"interface":"back","average":{"1min":1.575,"5min":0.98999999999999999,"15min":0.91800000000000004},"min":{"1min":0.56899999999999995,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":12.345000000000001,"5min":12.345000000000001,"15min":12.345000000000001},"last":1},{"interface":"front","average":{"1min":1.51,"5min":1.008,"15min":0.92900000000000005},"min":{"1min":0.65000000000000002,"5min":0.57099999999999995,"15min":0.40699999999999997},"max":{"1min":10.475,"5min":10.475,"15min":10.475},"last":0.71199999999999997}]},{"osd":1,"last update":"Sat Jun 10 19:09:01 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.83399999999999996,"15min":0.86199999999999999},"min":{"1min":0.68500000000000005,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.0780000000000001,"5min":1.2709999999999999,"15min":1.5229999999999999},"last":1.089},{"interface":"front","average":{"1min":1.5940000000000001,"5min":1.0489999999999999,"15min":0.95599999999999996},"min":{"1min":0.58999999999999997,"5min":0.504,"15min":0.45300000000000001},"max":{"1min":12.467000000000001,"5min":12.467000000000001,"15min":12.467000000000001},"last":0.877}]},{"osd":2,"last update":"Sat Jun 10 19:09:01 2023","interfaces":[{"interface":"back","average":{"1min":1.5149999999999999,"5min":1.0189999999999999,"15min":0.94599999999999995},"min":{"1min":0.63200000000000001,"5min":0.51200000000000001,"15min":0.48799999999999999},"max":{"1min":10.566000000000001,"5min":10.566000000000001,"15min":10.566000000000001},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.85999999999999999,"15min":0.88},"min":{"1min":0.626,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.94999999999999996}]},{"osd":3,"last update":"Sat Jun 10 19:09:01 2023","interfaces":[{"interface":"back","average":{"1min":1.6439999999999999,"5min":1.0569999999999999,"15min":0.97699999999999998},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":12.411,"5min":12.411,"15min":12.411},"last":1.0660000000000001},{"interface":"front","average":{"1min":1.5569999999999999,"5min":1.0640000000000001,"15min":1.0169999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.52900000000000003},"max":{"1min":10.695,"5min":10.695,"15min":10.695},"last":1.1240000000000001}]},{"osd":4,"last update":"Sat Jun 10 19:09:01 2023","interfaces":[{"interface":"back","average":{"1min":1.629,"5min":1.0760000000000001,"15min":0.95999999999999996},"min":{"1min":0.65200000000000002,"5min":0.45900000000000002,"15min":0.373},"max":{"1min":13.308999999999999,"5min":13.308999999999999,"15min":13.308999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":1.853,"5min":1.1619999999999999,"15min":1.0389999999999999},"min":{"1min":0.73299999999999998,"5min":0.504,"15min":0.47899999999999998},"max":{"1min":15.680999999999999,"5min":15.680999999999999,"15min":15.680999999999999},"last":0.91300000000000003}]},{"osd":5,"last update":"Sat Jun 10 19:09:01 2023","interfaces":[{"interface":"back","average":{"1min":1.7869999999999999,"5min":1.0489999999999999,"15min":0.95399999999999996},"min":{"1min":0.68200000000000005,"5min":0.437,"15min":0.437},"max":{"1min":15.074999999999999,"5min":15.074999999999999,"15min":15.074999999999999},"last":1.151},{"interface":"front","average":{"1min":1.903,"5min":1.1970000000000001,"15min":1.0820000000000001},"min":{"1min":0.69799999999999995,"5min":0.47199999999999998,"15min":0.42699999999999999},"max":{"1min":15.189,"5min":15.189,"15min":15.189},"last":1.1699999999999999}]},{"osd":7,"last update":"Sat Jun 10 19:09:01 2023","interfaces":[{"interface":"back","average":{"1min":1.6279999999999999,"5min":1.1419999999999999,"15min":1.0660000000000001},"min":{"1min":0.64600000000000002,"5min":0.59199999999999997,"15min":0.57099999999999995},"max":{"1min":10.813000000000001,"5min":10.813000000000001,"15min":10.813000000000001},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.133,"5min":1.0069999999999999,"15min":1.0029999999999999},"min":{"1min":0.76900000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":2.4870000000000001,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":1.1970000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575051,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33336,"kb_used_data":2288,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338504,"statfs":{"total":96636764160,"available":96602628096,"internally_reserved":0,"allocated":2342912,"data_stored":1095824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.85199999999999998,"15min":0.873},"min":{"1min":0.51900000000000002,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.2350000000000001,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":1.0149999999999999},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.88400000000000001,"15min":0.89700000000000002},"min":{"1min":0.64200000000000002,"5min":0.50800000000000001,"15min":0.49399999999999999},"max":{"1min":1.1779999999999999,"5min":1.2370000000000001,"15min":2.347},"last":0.78300000000000003}]},{"osd":1,"last update":"Sat Jun 10 19:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.89100000000000001,"15min":0.91000000000000003},"min":{"1min":0.51800000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.3180000000000001,"5min":1.6739999999999999,"15min":7.0800000000000001},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.89600000000000002,"15min":0.98099999999999998},"min":{"1min":0.67200000000000004,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.117,"5min":1.244,"15min":15.845000000000001},"last":1.2809999999999999}]},{"osd":2,"last update":"Sat Jun 10 19:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.90400000000000003,"15min":0.90000000000000002},"min":{"1min":0.66200000000000003,"5min":0.59899999999999998,"15min":0.48299999999999998},"max":{"1min":1.1930000000000001,"5min":1.6459999999999999,"15min":5.0049999999999999},"last":1.0549999999999999},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.92700000000000005,"15min":0.94899999999999995},"min":{"1min":0.69099999999999995,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.163,"5min":1.391,"15min":6.851},"last":0.83099999999999996}]},{"osd":3,"last update":"Sat Jun 10 19:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.93100000000000005,"15min":0.94699999999999995},"min":{"1min":0.71799999999999997,"5min":0.58699999999999997,"15min":0.51500000000000001},"max":{"1min":1.304,"5min":1.6910000000000001,"15min":2.544},"last":0.871},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.98399999999999999,"15min":0.98499999999999999},"min":{"1min":0.77600000000000002,"5min":0.66000000000000003,"15min":0.59799999999999998},"max":{"1min":1.1619999999999999,"5min":1.4870000000000001,"15min":3.0830000000000002},"last":0.98299999999999998}]},{"osd":4,"last update":"Sat Jun 10 19:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.93500000000000005,"15min":0.93999999999999995},"min":{"1min":0.64300000000000002,"5min":0.59799999999999998,"15min":0.58099999999999996},"max":{"1min":1.246,"5min":1.6140000000000001,"15min":6.7290000000000001},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.97899999999999998,"15min":0.97999999999999998},"min":{"1min":0.61699999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.278,"5min":1.677,"15min":1.677},"last":1.1279999999999999}]},{"osd":6,"last update":"Sat Jun 10 19:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.98199999999999998,"15min":0.97599999999999998},"min":{"1min":0.64100000000000001,"5min":0.60499999999999998,"15min":0.54200000000000004},"max":{"1min":1.2110000000000001,"5min":1.8009999999999999,"15min":1.8009999999999999},"last":0.93000000000000005},{"interface":"front","average":{"1min":1.012,"5min":1.04,"15min":1.0489999999999999},"min":{"1min":0.77600000000000002,"5min":0.66200000000000003,"15min":0.57899999999999996},"max":{"1min":1.504,"5min":1.8380000000000001,"15min":6.923},"last":0.95799999999999996}]},{"osd":7,"last update":"Sat Jun 10 19:08:58 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.0780000000000001,"15min":1.073},"min":{"1min":0.70699999999999996,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.4419999999999999,"5min":1.7749999999999999,"15min":2.6080000000000001},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.125,"5min":1.1200000000000001,"15min":1.1279999999999999},"min":{"1min":0.74099999999999999,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.351,"5min":1.8049999999999999,"15min":5.4169999999999998},"last":1.1040000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575050,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33336,"kb_used_data":2288,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338504,"statfs":{"total":96636764160,"available":96602628096,"internally_reserved":0,"allocated":2342912,"data_stored":1095824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:08:09 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82399999999999995,"15min":0.83899999999999997},"min":{"1min":0.621,"5min":0.45400000000000001,"15min":0.45100000000000001},"max":{"1min":1.1699999999999999,"5min":1.29,"15min":1.29},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.90400000000000003,"15min":0.90800000000000003},"min":{"1min":0.57399999999999995,"5min":0.439,"15min":0.439},"max":{"1min":1.242,"5min":1.3979999999999999,"15min":3.7280000000000002},"last":0.60899999999999999}]},{"osd":1,"last update":"Sat Jun 10 19:08:09 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.88600000000000001,"15min":0.92100000000000004},"min":{"1min":0.51300000000000001,"5min":0.47799999999999998,"15min":0.47599999999999998},"max":{"1min":1.3560000000000001,"5min":1.5429999999999999,"15min":3.3969999999999998},"last":1.149},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84099999999999997,"15min":0.86299999999999999},"min":{"1min":0.53200000000000003,"5min":0.47899999999999998,"15min":0.47699999999999998},"max":{"1min":1.1339999999999999,"5min":1.2430000000000001,"15min":2.496},"last":0.86399999999999999}]},{"osd":2,"last update":"Sat Jun 10 19:08:09 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.85199999999999998,"15min":0.875},"min":{"1min":0.53600000000000003,"5min":0.52400000000000002,"15min":0.49299999999999999},"max":{"1min":1.0740000000000001,"5min":1.2070000000000001,"15min":1.522},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.94399999999999995,"15min":0.97699999999999998},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.155,"5min":1.4670000000000001,"15min":3.5750000000000002},"last":0.95999999999999996}]},{"osd":3,"last update":"Sat Jun 10 19:08:09 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85399999999999998,"15min":0.89300000000000002},"min":{"1min":0.65100000000000002,"5min":0.56200000000000006,"15min":0.53900000000000003},"max":{"1min":1.1080000000000001,"5min":1.28,"15min":2.3809999999999998},"last":1.101},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.95499999999999996,"15min":0.96499999999999997},"min":{"1min":0.65000000000000002,"5min":0.58199999999999996,"15min":0.54400000000000004},"max":{"1min":1.274,"5min":1.4279999999999999,"15min":1.6479999999999999},"last":1.224}]},{"osd":5,"last update":"Sat Jun 10 19:08:09 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":0.97399999999999998,"15min":0.95799999999999996},"min":{"1min":0.69299999999999995,"5min":0.58699999999999997,"15min":0.53100000000000003},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":3.6539999999999999},"last":1.069},{"interface":"front","average":{"1min":0.998,"5min":0.94499999999999995,"15min":0.93999999999999995},"min":{"1min":0.61899999999999999,"5min":0.495,"15min":0.495},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":2.6720000000000002},"last":1.1819999999999999}]},{"osd":6,"last update":"Sat Jun 10 19:08:09 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.97399999999999998,"15min":0.96499999999999997},"min":{"1min":0.69899999999999995,"5min":0.443,"15min":0.443},"max":{"1min":1.3400000000000001,"5min":1.413,"15min":2.2639999999999998},"last":1.3540000000000001},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.091,"15min":1.0680000000000001},"min":{"1min":0.73699999999999999,"5min":0.58799999999999997,"15min":0.44400000000000001},"max":{"1min":1.5269999999999999,"5min":1.625,"15min":3.4980000000000002},"last":1.298}]},{"osd":7,"last update":"Sat Jun 10 19:08:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.034,"15min":1.0049999999999999},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.41399999999999998},"max":{"1min":1.506,"5min":1.506,"15min":2.5910000000000002},"last":1.3799999999999999},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.095,"15min":1.073},"min":{"1min":0.60399999999999998,"5min":0.50800000000000001,"15min":0.46300000000000002},"max":{"1min":1.3799999999999999,"5min":1.635,"15min":1.635},"last":1.4510000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575049,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37428,"kb_used_data":2284,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334412,"statfs":{"total":96636764160,"available":96598437888,"internally_reserved":0,"allocated":2338816,"data_stored":1094805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.626,"15min":0.626},"min":{"1min":0.26000000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.91800000000000004,"5min":1.0900000000000001,"15min":1.169},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.64800000000000002,"15min":0.66800000000000004},"min":{"1min":0.32000000000000001,"5min":0.29299999999999998,"15min":0.251},"max":{"1min":0.93999999999999995,"5min":0.97799999999999998,"15min":1.5269999999999999},"last":0.378}]},{"osd":1,"last update":"Sat Jun 10 19:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.67700000000000005,"15min":0.68899999999999995},"min":{"1min":0.308,"5min":0.29699999999999999,"15min":0.27800000000000002},"max":{"1min":1.03,"5min":1.234,"15min":2.0699999999999998},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.70299999999999996,"15min":0.73199999999999998},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.0129999999999999,"5min":1.1659999999999999,"15min":1.296},"last":0.41299999999999998}]},{"osd":2,"last update":"Sat Jun 10 19:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.73699999999999999,"15min":0.76800000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.1359999999999999,"5min":1.1950000000000001,"15min":1.3899999999999999},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.78000000000000003,"15min":0.79200000000000004},"min":{"1min":0.314,"5min":0.314,"15min":0.29699999999999999},"max":{"1min":1.119,"5min":1.2769999999999999,"15min":1.591},"last":0.36899999999999999}]},{"osd":4,"last update":"Sat Jun 10 19:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.92000000000000004,"15min":0.94099999999999995},"min":{"1min":0.57899999999999996,"5min":0.55800000000000005,"15min":0.41899999999999998},"max":{"1min":1.2729999999999999,"5min":1.333,"15min":1.8240000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.98199999999999998,"15min":0.98699999999999999},"min":{"1min":0.502,"5min":0.502,"15min":0.47999999999999998},"max":{"1min":1.3720000000000001,"5min":1.4330000000000001,"15min":1.873},"last":0.63900000000000001}]},{"osd":5,"last update":"Sat Jun 10 19:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.98899999999999999,"15min":0.998},"min":{"1min":0.61699999999999999,"5min":0.55900000000000005,"15min":0.55200000000000005},"max":{"1min":1.371,"5min":1.536,"15min":1.752},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.94499999999999995,"5min":1.022,"15min":1.0329999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.46899999999999997},"max":{"1min":1.399,"5min":1.534,"15min":1.9259999999999999},"last":0.71099999999999997}]},{"osd":6,"last update":"Sat Jun 10 19:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":1.0329999999999999,"15min":1.0569999999999999},"min":{"1min":0.60599999999999998,"5min":0.56999999999999995,"15min":0.55300000000000005},"max":{"1min":1.4570000000000001,"5min":1.617,"15min":1.786},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.96399999999999997,"5min":1.0149999999999999,"15min":1.042},"min":{"1min":0.68700000000000006,"5min":0.61399999999999999,"15min":0.58799999999999997},"max":{"1min":1.375,"5min":1.4530000000000001,"15min":2.2120000000000002},"last":0.73799999999999999}]},{"osd":7,"last update":"Sat Jun 10 19:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":1.046,"15min":1.0700000000000001},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.4570000000000001,"5min":1.5720000000000001,"15min":2.1150000000000002},"last":0.58199999999999996},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.083,"15min":1.099},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.764,"5min":1.764,"15min":1.9850000000000001},"last":0.69599999999999995}]}]},{"osd":2,"up_from":13,"seq":55834575050,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37432,"kb_used_data":2288,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334408,"statfs":{"total":96636764160,"available":96598433792,"internally_reserved":0,"allocated":2342912,"data_stored":1095824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.63700000000000001,"15min":0.628},"min":{"1min":0.28899999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.2330000000000001,"5min":2.883,"15min":2.883},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.78800000000000003,"15min":0.746},"min":{"1min":0.42599999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":3.528,"5min":6.5670000000000002,"15min":6.5670000000000002},"last":0.45200000000000001}]},{"osd":1,"last update":"Sat Jun 10 19:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.63900000000000001,"15min":0.66100000000000003},"min":{"1min":0.34699999999999998,"5min":0.32300000000000001,"15min":0.29199999999999998},"max":{"1min":0.95399999999999996,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.82599999999999996,"15min":0.79300000000000004},"min":{"1min":0.38100000000000001,"5min":0.32500000000000001,"15min":0.27400000000000002},"max":{"1min":1.948,"5min":8.4429999999999996,"15min":8.4429999999999996},"last":0.38100000000000001}]},{"osd":3,"last update":"Sat Jun 10 19:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.76800000000000002,"15min":0.78500000000000003},"min":{"1min":0.38700000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":2.4969999999999999,"5min":2.4969999999999999,"15min":2.4969999999999999},"last":0.504},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.77600000000000002,"15min":0.78000000000000003},"min":{"1min":0.36799999999999999,"5min":0.33600000000000002,"15min":0.23499999999999999},"max":{"1min":2.3719999999999999,"5min":4.1849999999999996,"15min":4.1849999999999996},"last":0.47399999999999998}]},{"osd":4,"last update":"Sat Jun 10 19:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.94399999999999995,"15min":0.93400000000000005},"min":{"1min":0.624,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.3089999999999999,"5min":3.996,"15min":3.996},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.93999999999999995,"5min":1.119,"15min":1.044},"min":{"1min":0.61699999999999999,"5min":0.502,"15min":0.496},"max":{"1min":1.369,"5min":13.254,"15min":13.254},"last":0.752}]},{"osd":5,"last update":"Sat Jun 10 19:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":1.131,"15min":1.048},"min":{"1min":0.62,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.2749999999999999,"5min":6.9189999999999996,"15min":6.9189999999999996},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.91700000000000004,"5min":1.2390000000000001,"15min":1.0960000000000001},"min":{"1min":0.57199999999999995,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.161,"5min":15.526,"15min":15.526},"last":0.57199999999999995}]},{"osd":6,"last update":"Sat Jun 10 19:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":1.1220000000000001,"15min":1.0760000000000001},"min":{"1min":0.69299999999999995,"5min":0.624,"15min":0.52700000000000002},"max":{"1min":1.226,"5min":8.7089999999999996,"15min":8.7089999999999996},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.96099999999999997,"5min":1.048,"15min":1.0489999999999999},"min":{"1min":0.58599999999999997,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.417,"5min":6.1299999999999999,"15min":6.1299999999999999},"last":0.60499999999999998}]},{"osd":7,"last update":"Sat Jun 10 19:09:05 2023","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.286,"15min":1.1639999999999999},"min":{"1min":0.66600000000000004,"5min":0.60299999999999998,"15min":0.57199999999999995},"max":{"1min":1.4650000000000001,"5min":12.138,"15min":12.138},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.96499999999999997,"5min":1.0569999999999999,"15min":1.1040000000000001},"min":{"1min":0.63500000000000001,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.278,"5min":1.883,"15min":1.883},"last":0.67200000000000004}]}]},{"osd":1,"up_from":13,"seq":55834575052,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37412,"kb_used_data":2268,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334428,"statfs":{"total":96636764160,"available":96598454272,"internally_reserved":0,"allocated":2322432,"data_stored":1088793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.66900000000000004,"15min":0.68000000000000005},"min":{"1min":0.28199999999999997,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.288},"last":0.64200000000000002},{"interface":"front","average":{"1min":1.0309999999999999,"5min":0.78700000000000003,"15min":0.77300000000000002},"min":{"1min":0.34100000000000003,"5min":0.32300000000000001,"15min":0.26900000000000002},"max":{"1min":5.625,"5min":5.625,"15min":5.625},"last":0.495}]},{"osd":2,"last update":"Sat Jun 10 19:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.624,"15min":0.63900000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.249},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.21},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.71499999999999997,"15min":0.73099999999999998},"min":{"1min":0.36499999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.98399999999999999,"5min":1.2390000000000001,"15min":1.415},"last":0.79500000000000004}]},{"osd":3,"last update":"Sat Jun 10 19:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.753,"15min":0.78400000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.25600000000000001},"max":{"1min":1.177,"5min":1.177,"15min":1.6299999999999999},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.099,"5min":0.77600000000000002,"15min":0.752},"min":{"1min":0.42199999999999999,"5min":0.36099999999999999,"15min":0.29599999999999999},"max":{"1min":6.8200000000000003,"5min":6.8200000000000003,"15min":6.8200000000000003},"last":0.83399999999999996}]},{"osd":4,"last update":"Sat Jun 10 19:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.879,"15min":0.875},"min":{"1min":0.59999999999999998,"5min":0.58599999999999997,"15min":0.56399999999999995},"max":{"1min":1.1950000000000001,"5min":1.3620000000000001,"15min":1.4930000000000001},"last":0.74299999999999999},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.0029999999999999,"15min":1.024},"min":{"1min":0.65900000000000003,"5min":0.58899999999999997,"15min":0.47099999999999997},"max":{"1min":1.385,"5min":1.575,"15min":5.8209999999999997},"last":1.111}]},{"osd":5,"last update":"Sat Jun 10 19:09:07 2023","interfaces":[{"interface":"back","average":{"1min":1.331,"5min":1.0369999999999999,"15min":1.0109999999999999},"min":{"1min":0.75,"5min":0.54800000000000004,"15min":0.49399999999999999},"max":{"1min":6.7030000000000003,"5min":6.7030000000000003,"15min":6.7030000000000003},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.95999999999999996,"15min":0.97999999999999998},"min":{"1min":0.63400000000000001,"5min":0.55000000000000004,"15min":0.46300000000000002},"max":{"1min":1.409,"5min":1.448,"15min":3.089},"last":0.95199999999999996}]},{"osd":6,"last update":"Sat Jun 10 19:09:07 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.0529999999999999,"15min":1.0700000000000001},"min":{"1min":0.79100000000000004,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":6.7450000000000001,"5min":6.7450000000000001,"15min":7.2599999999999998},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.0109999999999999,"5min":0.99099999999999999,"15min":1.0349999999999999},"min":{"1min":0.65600000000000003,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.343,"5min":1.5469999999999999,"15min":9.0069999999999997},"last":0.875}]},{"osd":7,"last update":"Sat Jun 10 19:09:07 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.0629999999999999,"15min":1.0780000000000001},"min":{"1min":0.74299999999999999,"5min":0.54300000000000004,"15min":0.495},"max":{"1min":1.444,"5min":1.4890000000000001,"15min":1.6879999999999999},"last":1.026},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.125,"15min":1.1020000000000001},"min":{"1min":0.621,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":6.782,"5min":6.782,"15min":6.782},"last":1.163}]}]},{"osd":0,"up_from":13,"seq":55834575051,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38008,"kb_used_data":2864,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94333832,"statfs":{"total":96636764160,"available":96597843968,"internally_reserved":0,"allocated":2932736,"data_stored":1685173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jun 10 19:09:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.624,"15min":0.64000000000000001},"min":{"1min":0.26000000000000001,"5min":0.255,"15min":0.248},"max":{"1min":0.91100000000000003,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.78000000000000003,"15min":0.80600000000000005},"min":{"1min":0.37,"5min":0.33000000000000002,"15min":0.32700000000000001},"max":{"1min":1.141,"5min":1.3080000000000001,"15min":1.5780000000000001},"last":1.1120000000000001}]},{"osd":2,"last update":"Sat Jun 10 19:09:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.69299999999999995,"15min":0.71499999999999997},"min":{"1min":0.45600000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.101,"5min":1.1970000000000001,"15min":1.2490000000000001},"last":1.3069999999999999},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64500000000000002,"15min":0.65400000000000003},"min":{"1min":0.28899999999999998,"5min":0.28699999999999998,"15min":0.245},"max":{"1min":0.92100000000000004,"5min":1.1779999999999999,"15min":1.371},"last":0.73199999999999998}]},{"osd":3,"last update":"Sat Jun 10 19:09:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.68400000000000005,"15min":0.68500000000000005},"min":{"1min":0.35099999999999998,"5min":0.309,"15min":0.28899999999999998},"max":{"1min":1.173,"5min":1.397,"15min":1.397},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77700000000000002,"15min":0.81200000000000006},"min":{"1min":0.40100000000000002,"5min":0.36399999999999999,"15min":0.29199999999999998},"max":{"1min":1.2410000000000001,"5min":1.6240000000000001,"15min":1.742},"last":0.872}]},{"osd":4,"last update":"Sat Jun 10 19:09:04 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.89400000000000002,"15min":0.92100000000000004},"min":{"1min":0.47399999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.5580000000000001,"5min":1.758,"15min":3.0209999999999999},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.995,"15min":1.0169999999999999},"min":{"1min":0.56799999999999995,"5min":0.56200000000000006,"15min":0.48599999999999999},"max":{"1min":1.2909999999999999,"5min":1.7250000000000001,"15min":1.873},"last":1.5009999999999999}]},{"osd":5,"last update":"Sat Jun 10 19:09:04 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.88500000000000001,"15min":0.91700000000000004},"min":{"1min":0.55500000000000005,"5min":0.51300000000000001,"15min":0.45100000000000001},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.004,"5min":0.97499999999999998,"15min":1.0009999999999999},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.51400000000000001},"max":{"1min":1.6879999999999999,"5min":1.9870000000000001,"15min":4.5620000000000003},"last":1.2410000000000001}]},{"osd":6,"last update":"Sat Jun 10 19:09:04 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.038,"15min":1.073},"min":{"1min":0.76200000000000001,"5min":0.58699999999999997,"15min":0.52600000000000002},"max":{"1min":1.5129999999999999,"5min":1.9330000000000001,"15min":3.5569999999999999},"last":1.417},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.98899999999999999,"15min":0.998},"min":{"1min":0.61099999999999999,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.333,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":1.161}]},{"osd":7,"last update":"Sat Jun 10 19:09:04 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.0069999999999999,"15min":1.0249999999999999},"min":{"1min":0.58399999999999996,"5min":0.54700000000000004,"15min":0.54600000000000004},"max":{"1min":1.506,"5min":1.804,"15min":1.804},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.98699999999999999,"5min":1.036,"15min":1.0529999999999999},"min":{"1min":0.65200000000000002,"5min":0.61299999999999999,"15min":0.61099999999999999},"max":{"1min":1.3180000000000001,"5min":2.1219999999999999,"15min":2.1219999999999999},"last":1.349}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-10T19:09:09.124 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-06-10T19:09:09.124 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-10T19:09:09.247 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.243+0000 7f47f743d640 1 Processor -- start 2023-06-10T19:09:09.248 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.243+0000 7f47f743d640 1 -- start start 2023-06-10T19:09:09.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.243+0000 7f47f743d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f47f0159690 0x7f47f0070950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:09.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.243+0000 7f47f743d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47f00b0f30 0x7f47f00cbe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:09.249 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.243+0000 7f47f743d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47f00cb080 con 0x7f47f0159a60 2023-06-10T19:09:09.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.243+0000 7f47f743d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47f0070e90 con 0x7f47f0159690 2023-06-10T19:09:09.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.243+0000 7f47f743d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47f006d450 con 0x7f47f00b0f30 2023-06-10T19:09:09.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.243+0000 7f47f51d9640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f47f0159690 0x7f47f0070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:09.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.243+0000 7f47f59da640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f47f0159a60 0x7f47f00c2900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56740/0 (socket says 172.21.15.53:56740) 2023-06-10T19:09:09.250 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.243+0000 7f47f59da640 1 -- 172.21.15.53:0/3139746994 learned_addr learned my addr 172.21.15.53:0/3139746994 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:09:09.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.243+0000 7f47f49d8640 1 --2- 172.21.15.53:0/3139746994 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47f00b0f30 0x7f47f00cbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:09.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.243+0000 7f47e7fff640 1 -- 172.21.15.53:0/3139746994 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3939656066 0 0) 0x7f47f00cb080 con 0x7f47f0159a60 2023-06-10T19:09:09.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.243+0000 7f47e7fff640 1 -- 172.21.15.53:0/3139746994 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47dc003530 con 0x7f47f0159a60 2023-06-10T19:09:09.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.243+0000 7f47f51d9640 1 -- 172.21.15.53:0/3139746994 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47f00b0f30 msgr2=0x7f47f00cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:09:09.251 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.243+0000 7f47f51d9640 1 --2- 172.21.15.53:0/3139746994 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47f00b0f30 0x7f47f00cbe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:09.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.243+0000 7f47f51d9640 1 -- 172.21.15.53:0/3139746994 >> v1:172.21.15.53:6789/0 conn(0x7f47f0159a60 legacy=0x7f47f00c2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:09.252 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.243+0000 7f47f51d9640 1 -- 172.21.15.53:0/3139746994 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47f00cb320 con 0x7f47f0159690 2023-06-10T19:09:09.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.247+0000 7f47f51d9640 1 --2- 172.21.15.53:0/3139746994 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47f0159690 0x7f47f0070950 secure :-1 s=READY pgs=2741 cs=0 l=1 rev1=1 crypto rx=0x7f47ec009d90 tx=0x7f47ec01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31ea89b9f246b444 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:09.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.247+0000 7f47e7fff640 1 -- 172.21.15.53:0/3139746994 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ec0a58f0 con 0x7f47f0159690 2023-06-10T19:09:09.253 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.247+0000 7f47e7fff640 1 -- 172.21.15.53:0/3139746994 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47ec0a5a50 con 0x7f47f0159690 2023-06-10T19:09:09.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.247+0000 7f47e7fff640 1 -- 172.21.15.53:0/3139746994 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ec0a5de0 con 0x7f47f0159690 2023-06-10T19:09:09.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.247+0000 7f47f743d640 1 -- 172.21.15.53:0/3139746994 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47f0159690 msgr2=0x7f47f0070950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:09.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.247+0000 7f47f743d640 1 --2- 172.21.15.53:0/3139746994 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47f0159690 0x7f47f0070950 secure :-1 s=READY pgs=2741 cs=0 l=1 rev1=1 crypto rx=0x7f47ec009d90 tx=0x7f47ec01c920 comp rx=0 tx=0).stop 2023-06-10T19:09:09.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.247+0000 7f47f743d640 1 -- 172.21.15.53:0/3139746994 shutdown_connections 2023-06-10T19:09:09.254 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.247+0000 7f47f743d640 1 --2- 172.21.15.53:0/3139746994 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47f00b0f30 0x7f47f00cbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:09.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.247+0000 7f47f743d640 1 --2- 172.21.15.53:0/3139746994 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47f0159690 0x7f47f0070950 unknown :-1 s=CLOSED pgs=2741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:09.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.247+0000 7f47f743d640 1 -- 172.21.15.53:0/3139746994 >> 172.21.15.53:0/3139746994 conn(0x7f47f006a560 msgr2=0x7f47f006a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:09:09.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.247+0000 7f47f743d640 1 -- 172.21.15.53:0/3139746994 shutdown_connections 2023-06-10T19:09:09.255 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.247+0000 7f47f743d640 1 -- 172.21.15.53:0/3139746994 wait complete. 2023-06-10T19:09:09.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.247+0000 7f47f743d640 1 Processor -- start 2023-06-10T19:09:09.257 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.247+0000 7f47f743d640 1 -- start start 2023-06-10T19:09:09.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.247+0000 7f47f743d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47f00b0f30 0x7f47f0156320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:09.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.247+0000 7f47f743d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47f0159690 0x7f47f00adb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:09.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.247+0000 7f47f743d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47f0159a60 0x7f47f0159ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:09.258 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.247+0000 7f47f743d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47f0156860 con 0x7f47f0159a60 2023-06-10T19:09:09.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.247+0000 7f47f743d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47f015bbc0 con 0x7f47f0159690 2023-06-10T19:09:09.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.247+0000 7f47f743d640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47f015be60 con 0x7f47f00b0f30 2023-06-10T19:09:09.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.247+0000 7f47f59da640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47f0159a60 0x7f47f0159ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:09.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.247+0000 7f47f59da640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47f0159a60 0x7f47f0159ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55074/0 (socket says 172.21.15.53:55074) 2023-06-10T19:09:09.259 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.247+0000 7f47f59da640 1 -- 172.21.15.53:0/3748306201 learned_addr learned my addr 172.21.15.53:0/3748306201 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:09:09.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.251+0000 7f47f51d9640 1 --2- 172.21.15.53:0/3748306201 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47f00b0f30 0x7f47f0156320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:09.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.251+0000 7f47f49d8640 1 --2- 172.21.15.53:0/3748306201 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47f0159690 0x7f47f00adb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:09.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.251+0000 7f47f59da640 1 -- 172.21.15.53:0/3748306201 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47f00b0f30 msgr2=0x7f47f0156320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:09.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.251+0000 7f47f59da640 1 --2- 172.21.15.53:0/3748306201 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47f00b0f30 0x7f47f0156320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:09.260 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.251+0000 7f47f59da640 1 -- 172.21.15.53:0/3748306201 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47f0159690 msgr2=0x7f47f00adb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:09.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.251+0000 7f47f59da640 1 --2- 172.21.15.53:0/3748306201 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47f0159690 0x7f47f00adb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:09.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.251+0000 7f47f59da640 1 -- 172.21.15.53:0/3748306201 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47ec009a70 con 0x7f47f0159a60 2023-06-10T19:09:09.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.251+0000 7f47f59da640 1 --2- 172.21.15.53:0/3748306201 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47f0159a60 0x7f47f0159ef0 secure :-1 s=READY pgs=2742 cs=0 l=1 rev1=1 crypto rx=0x7f47e800c3c0 tx=0x7f47e800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:09.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.251+0000 7f47e5ffb640 1 -- 172.21.15.53:0/3748306201 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e8005cf0 con 0x7f47f0159a60 2023-06-10T19:09:09.261 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.251+0000 7f47e5ffb640 1 -- 172.21.15.53:0/3748306201 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47e8005e50 con 0x7f47f0159a60 2023-06-10T19:09:09.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.251+0000 7f47f743d640 1 -- 172.21.15.53:0/3748306201 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47f015c140 con 0x7f47f0159a60 2023-06-10T19:09:09.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.251+0000 7f47e5ffb640 1 -- 172.21.15.53:0/3748306201 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e8007310 con 0x7f47f0159a60 2023-06-10T19:09:09.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.251+0000 7f47f743d640 1 -- 172.21.15.53:0/3748306201 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47f015c700 con 0x7f47f0159a60 2023-06-10T19:09:09.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.251+0000 7f47f743d640 1 -- 172.21.15.53:0/3748306201 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47f004d790 con 0x7f47f0159a60 2023-06-10T19:09:09.262 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.251+0000 7f47e5ffb640 1 -- 172.21.15.53:0/3748306201 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f47e8007470 con 0x7f47f0159a60 2023-06-10T19:09:09.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.251+0000 7f47e5ffb640 1 --2- 172.21.15.53:0/3748306201 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f47d40662b0 0x7f47d4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:09.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.251+0000 7f47e5ffb640 1 -- 172.21.15.53:0/3748306201 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f47e8082e50 con 0x7f47f0159a60 2023-06-10T19:09:09.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.251+0000 7f47f51d9640 1 --2- 172.21.15.53:0/3748306201 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f47d40662b0 0x7f47d4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:09.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.251+0000 7f47f51d9640 1 --2- 172.21.15.53:0/3748306201 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f47d40662b0 0x7f47d4068760 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f47ec0af000 tx=0x7f47ec0a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:09.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.255+0000 7f47e5ffb640 1 -- 172.21.15.53:0/3748306201 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f47e8050630 con 0x7f47f0159a60 2023-06-10T19:09:09.413 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.407+0000 7f47f743d640 1 -- 172.21.15.53:0/3748306201 --> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f47f00710a0 con 0x7f47d40662b0 2023-06-10T19:09:09.421 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.415+0000 7f47e5ffb640 1 -- 172.21.15.53:0/3748306201 <== mgr.4105 v2:172.21.15.117:6832/3061986771 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71614 (secure 0 0 0) 0x7f47ec009450 con 0x7f47d40662b0 2023-06-10T19:09:09.422 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:09:09.423 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-06-10T19:09:09.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.419+0000 7f47f743d640 1 -- 172.21.15.53:0/3748306201 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f47d40662b0 msgr2=0x7f47d4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:09.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.419+0000 7f47f743d640 1 --2- 172.21.15.53:0/3748306201 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f47d40662b0 0x7f47d4068760 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f47ec0af000 tx=0x7f47ec0a7070 comp rx=0 tx=0).stop 2023-06-10T19:09:09.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.419+0000 7f47f743d640 1 -- 172.21.15.53:0/3748306201 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47f0159a60 msgr2=0x7f47f0159ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:09.424 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.419+0000 7f47f743d640 1 --2- 172.21.15.53:0/3748306201 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47f0159a60 0x7f47f0159ef0 secure :-1 s=READY pgs=2742 cs=0 l=1 rev1=1 crypto rx=0x7f47e800c3c0 tx=0x7f47e800c880 comp rx=0 tx=0).stop 2023-06-10T19:09:09.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.419+0000 7f47f743d640 1 -- 172.21.15.53:0/3748306201 shutdown_connections 2023-06-10T19:09:09.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.419+0000 7f47f743d640 1 --2- 172.21.15.53:0/3748306201 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f47d40662b0 0x7f47d4068760 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:09.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.419+0000 7f47f743d640 1 --2- 172.21.15.53:0/3748306201 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47f0159a60 0x7f47f0159ef0 unknown :-1 s=CLOSED pgs=2742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:09.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.419+0000 7f47f743d640 1 --2- 172.21.15.53:0/3748306201 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47f0159690 0x7f47f00adb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:09.425 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.419+0000 7f47f743d640 1 --2- 172.21.15.53:0/3748306201 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47f00b0f30 0x7f47f0156320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:09.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.419+0000 7f47f743d640 1 -- 172.21.15.53:0/3748306201 >> 172.21.15.53:0/3748306201 conn(0x7f47f006a560 msgr2=0x7f47f006cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:09:09.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.419+0000 7f47f743d640 1 -- 172.21.15.53:0/3748306201 shutdown_connections 2023-06-10T19:09:09.426 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.419+0000 7f47f743d640 1 -- 172.21.15.53:0/3748306201 wait complete. 2023-06-10T19:09:09.441 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":677,"stamp":"2023-06-10T19:09:07.943982+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":145,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":284188,"kb_used_data":19420,"kb_used_omap":0,"kb_used_meta":264704,"kb_avail":754690532,"statfs":{"total":773094113280,"available":772803104768,"internally_reserved":0,"allocated":19886080,"data_stored":9932247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":271056896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12801,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-1,"num_read_kb":0,"num_write":-58,"num_write_kb":-31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001748"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":447,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-06-10T19:09:06.884796+0000","last_change":"2023-06-10T18:52:34.951528+0000","last_active":"2023-06-10T19:09:06.884796+0000","last_peered":"2023-06-10T19:09:06.884796+0000","last_clean":"2023-06-10T19:09:06.884796+0000","last_became_active":"2023-06-10T18:52:34.949099+0000","last_became_peered":"2023-06-10T18:52:34.949099+0000","last_unstale":"2023-06-10T19:09:06.884796+0000","last_undegraded":"2023-06-10T19:09:06.884796+0000","last_fullsized":"2023-06-10T19:09:06.884796+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_clean_scrub_stamp":"2023-06-10T18:52:33.633295+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:11:24.585790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":322,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-06-10T19:09:06.483312+0000","last_change":"2023-06-10T18:52:40.506384+0000","last_active":"2023-06-10T19:09:06.483312+0000","last_peered":"2023-06-10T19:09:06.483312+0000","last_clean":"2023-06-10T19:09:06.483312+0000","last_became_active":"2023-06-10T18:52:40.505701+0000","last_became_peered":"2023-06-10T18:52:40.505701+0000","last_unstale":"2023-06-10T19:09:06.483312+0000","last_undegraded":"2023-06-10T19:09:06.483312+0000","last_fullsized":"2023-06-10T19:09:06.483312+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:57:46.897873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":291,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-06-10T19:09:06.884465+0000","last_change":"2023-06-10T18:52:40.512015+0000","last_active":"2023-06-10T19:09:06.884465+0000","last_peered":"2023-06-10T19:09:06.884465+0000","last_clean":"2023-06-10T19:09:06.884465+0000","last_became_active":"2023-06-10T18:52:40.511382+0000","last_became_peered":"2023-06-10T18:52:40.511382+0000","last_unstale":"2023-06-10T19:09:06.884465+0000","last_undegraded":"2023-06-10T19:09:06.884465+0000","last_fullsized":"2023-06-10T19:09:06.884465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:59:38.520388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":312,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-06-10T19:09:06.889031+0000","last_change":"2023-06-10T18:52:40.671725+0000","last_active":"2023-06-10T19:09:06.889031+0000","last_peered":"2023-06-10T19:09:06.889031+0000","last_clean":"2023-06-10T19:09:06.889031+0000","last_became_active":"2023-06-10T18:52:40.671442+0000","last_became_peered":"2023-06-10T18:52:40.671442+0000","last_unstale":"2023-06-10T19:09:06.889031+0000","last_undegraded":"2023-06-10T19:09:06.889031+0000","last_fullsized":"2023-06-10T19:09:06.889031+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:27:02.125401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":322,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-06-10T19:09:06.481773+0000","last_change":"2023-06-10T18:52:40.510258+0000","last_active":"2023-06-10T19:09:06.481773+0000","last_peered":"2023-06-10T19:09:06.481773+0000","last_clean":"2023-06-10T19:09:06.481773+0000","last_became_active":"2023-06-10T18:52:40.509560+0000","last_became_peered":"2023-06-10T18:52:40.509560+0000","last_unstale":"2023-06-10T19:09:06.481773+0000","last_undegraded":"2023-06-10T19:09:06.481773+0000","last_fullsized":"2023-06-10T19:09:06.481773+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:32:31.108716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":292,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-06-10T19:09:06.884271+0000","last_change":"2023-06-10T18:52:40.672266+0000","last_active":"2023-06-10T19:09:06.884271+0000","last_peered":"2023-06-10T19:09:06.884271+0000","last_clean":"2023-06-10T19:09:06.884271+0000","last_became_active":"2023-06-10T18:52:40.671966+0000","last_became_peered":"2023-06-10T18:52:40.671966+0000","last_unstale":"2023-06-10T19:09:06.884271+0000","last_undegraded":"2023-06-10T19:09:06.884271+0000","last_fullsized":"2023-06-10T19:09:06.884271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:12:45.261471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":290,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-06-10T19:09:06.883364+0000","last_change":"2023-06-10T18:52:40.671084+0000","last_active":"2023-06-10T19:09:06.883364+0000","last_peered":"2023-06-10T19:09:06.883364+0000","last_clean":"2023-06-10T19:09:06.883364+0000","last_became_active":"2023-06-10T18:52:40.670697+0000","last_became_peered":"2023-06-10T18:52:40.670697+0000","last_unstale":"2023-06-10T19:09:06.883364+0000","last_undegraded":"2023-06-10T19:09:06.883364+0000","last_fullsized":"2023-06-10T19:09:06.883364+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:13:40.272077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":292,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-06-10T19:09:06.882941+0000","last_change":"2023-06-10T18:52:40.514114+0000","last_active":"2023-06-10T19:09:06.882941+0000","last_peered":"2023-06-10T19:09:06.882941+0000","last_clean":"2023-06-10T19:09:06.882941+0000","last_became_active":"2023-06-10T18:52:40.513638+0000","last_became_peered":"2023-06-10T18:52:40.513638+0000","last_unstale":"2023-06-10T19:09:06.882941+0000","last_undegraded":"2023-06-10T19:09:06.882941+0000","last_fullsized":"2023-06-10T19:09:06.882941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:49:19.455984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":292,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-06-10T19:09:06.885144+0000","last_change":"2023-06-10T18:52:40.515396+0000","last_active":"2023-06-10T19:09:06.885144+0000","last_peered":"2023-06-10T19:09:06.885144+0000","last_clean":"2023-06-10T19:09:06.885144+0000","last_became_active":"2023-06-10T18:52:40.514663+0000","last_became_peered":"2023-06-10T18:52:40.514663+0000","last_unstale":"2023-06-10T19:09:06.885144+0000","last_undegraded":"2023-06-10T19:09:06.885144+0000","last_fullsized":"2023-06-10T19:09:06.885144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:30:54.158485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575050,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33916,"kb_used_data":2868,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94337924,"statfs":{"total":96636764160,"available":96602034176,"internally_reserved":0,"allocated":2936832,"data_stored":1686192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.92300000000000004,"15min":0.92700000000000005},"min":{"1min":0.55700000000000005,"5min":0.443,"15min":0.434},"max":{"1min":1.256,"5min":1.522,"15min":1.6220000000000001},"last":1.1040000000000001},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.89700000000000002,"15min":0.92000000000000004},"min":{"1min":0.49399999999999999,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.202,"5min":1.3109999999999999,"15min":1.6870000000000001},"last":0.998}]},{"osd":1,"last update":"Sat Jun 10 19:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.89600000000000002,"15min":0.91900000000000004},"min":{"1min":0.53500000000000003,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.365,"5min":1.365,"15min":1.377},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.92000000000000004,"15min":0.94599999999999995},"min":{"1min":0.65000000000000002,"5min":0.51300000000000001,"15min":0.504},"max":{"1min":1.2949999999999999,"5min":1.3320000000000001,"15min":1.5960000000000001},"last":1.05}]},{"osd":2,"last update":"Sat Jun 10 19:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.88400000000000001,"15min":0.85999999999999999},"min":{"1min":0.68600000000000005,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.113,"5min":1.2629999999999999,"15min":1.4059999999999999},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.872,"15min":0.89000000000000001},"min":{"1min":0.54000000000000004,"5min":0.53300000000000003,"15min":0.50600000000000001},"max":{"1min":1.093,"5min":1.3100000000000001,"15min":1.448},"last":1.179}]},{"osd":3,"last update":"Sat Jun 10 19:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.89000000000000001,"15min":0.92300000000000004},"min":{"1min":0.60599999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.236,"5min":1.4490000000000001,"15min":1.502},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.95699999999999996,"15min":0.95899999999999996},"min":{"1min":0.67400000000000004,"5min":0.432,"15min":0.432},"max":{"1min":1.208,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":1.0289999999999999}]},{"osd":4,"last update":"Sat Jun 10 19:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.83499999999999996,"15min":0.84199999999999997},"min":{"1min":0.61099999999999999,"5min":0.307,"15min":0.307},"max":{"1min":1.109,"5min":1.2290000000000001,"15min":1.639},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.96499999999999997,"15min":0.96599999999999997},"min":{"1min":0.70899999999999996,"5min":0.41199999999999998,"15min":0.40000000000000002},"max":{"1min":1.3320000000000001,"5min":1.3540000000000001,"15min":1.4590000000000001},"last":0.76200000000000001}]},{"osd":5,"last update":"Sat Jun 10 19:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.96899999999999997,"15min":0.99099999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.1519999999999999,"5min":1.385,"15min":1.806},"last":1.224},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0329999999999999,"15min":1.036},"min":{"1min":0.627,"5min":0.48499999999999999,"15min":0.46500000000000002},"max":{"1min":1.4159999999999999,"5min":1.665,"15min":1.665},"last":1.075}]},{"osd":6,"last update":"Sat Jun 10 19:08:07 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.98699999999999999,"15min":1.0029999999999999},"min":{"1min":0.56200000000000006,"5min":0.47699999999999998,"15min":0.35999999999999999},"max":{"1min":1.282,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":0.89900000000000002},{"interface":"front","average":{"1min":1.081,"5min":1.085,"15min":1.0980000000000001},"min":{"1min":0.69899999999999995,"5min":0.504,"15min":0.441},"max":{"1min":1.2749999999999999,"5min":1.728,"15min":1.728},"last":1.1459999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575051,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33320,"kb_used_data":2272,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338520,"statfs":{"total":96636764160,"available":96602644480,"internally_reserved":0,"allocated":2326528,"data_stored":1089812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:09:01 2023","interfaces":[{"interface":"back","average":{"1min":1.575,"5min":0.98999999999999999,"15min":0.91800000000000004},"min":{"1min":0.56899999999999995,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":12.345000000000001,"5min":12.345000000000001,"15min":12.345000000000001},"last":1},{"interface":"front","average":{"1min":1.51,"5min":1.008,"15min":0.92900000000000005},"min":{"1min":0.65000000000000002,"5min":0.57099999999999995,"15min":0.40699999999999997},"max":{"1min":10.475,"5min":10.475,"15min":10.475},"last":0.71199999999999997}]},{"osd":1,"last update":"Sat Jun 10 19:09:01 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.83399999999999996,"15min":0.86199999999999999},"min":{"1min":0.68500000000000005,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.0780000000000001,"5min":1.2709999999999999,"15min":1.5229999999999999},"last":1.089},{"interface":"front","average":{"1min":1.5940000000000001,"5min":1.0489999999999999,"15min":0.95599999999999996},"min":{"1min":0.58999999999999997,"5min":0.504,"15min":0.45300000000000001},"max":{"1min":12.467000000000001,"5min":12.467000000000001,"15min":12.467000000000001},"last":0.877}]},{"osd":2,"last update":"Sat Jun 10 19:09:01 2023","interfaces":[{"interface":"back","average":{"1min":1.5149999999999999,"5min":1.0189999999999999,"15min":0.94599999999999995},"min":{"1min":0.63200000000000001,"5min":0.51200000000000001,"15min":0.48799999999999999},"max":{"1min":10.566000000000001,"5min":10.566000000000001,"15min":10.566000000000001},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.85999999999999999,"15min":0.88},"min":{"1min":0.626,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.94999999999999996}]},{"osd":3,"last update":"Sat Jun 10 19:09:01 2023","interfaces":[{"interface":"back","average":{"1min":1.6439999999999999,"5min":1.0569999999999999,"15min":0.97699999999999998},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":12.411,"5min":12.411,"15min":12.411},"last":1.0660000000000001},{"interface":"front","average":{"1min":1.5569999999999999,"5min":1.0640000000000001,"15min":1.0169999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.52900000000000003},"max":{"1min":10.695,"5min":10.695,"15min":10.695},"last":1.1240000000000001}]},{"osd":4,"last update":"Sat Jun 10 19:09:01 2023","interfaces":[{"interface":"back","average":{"1min":1.629,"5min":1.0760000000000001,"15min":0.95999999999999996},"min":{"1min":0.65200000000000002,"5min":0.45900000000000002,"15min":0.373},"max":{"1min":13.308999999999999,"5min":13.308999999999999,"15min":13.308999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":1.853,"5min":1.1619999999999999,"15min":1.0389999999999999},"min":{"1min":0.73299999999999998,"5min":0.504,"15min":0.47899999999999998},"max":{"1min":15.680999999999999,"5min":15.680999999999999,"15min":15.680999999999999},"last":0.91300000000000003}]},{"osd":5,"last update":"Sat Jun 10 19:09:01 2023","interfaces":[{"interface":"back","average":{"1min":1.7869999999999999,"5min":1.0489999999999999,"15min":0.95399999999999996},"min":{"1min":0.68200000000000005,"5min":0.437,"15min":0.437},"max":{"1min":15.074999999999999,"5min":15.074999999999999,"15min":15.074999999999999},"last":1.151},{"interface":"front","average":{"1min":1.903,"5min":1.1970000000000001,"15min":1.0820000000000001},"min":{"1min":0.69799999999999995,"5min":0.47199999999999998,"15min":0.42699999999999999},"max":{"1min":15.189,"5min":15.189,"15min":15.189},"last":1.1699999999999999}]},{"osd":7,"last update":"Sat Jun 10 19:09:01 2023","interfaces":[{"interface":"back","average":{"1min":1.6279999999999999,"5min":1.1419999999999999,"15min":1.0660000000000001},"min":{"1min":0.64600000000000002,"5min":0.59199999999999997,"15min":0.57099999999999995},"max":{"1min":10.813000000000001,"5min":10.813000000000001,"15min":10.813000000000001},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.133,"5min":1.0069999999999999,"15min":1.0029999999999999},"min":{"1min":0.76900000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":2.4870000000000001,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":1.1970000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575051,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33336,"kb_used_data":2288,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338504,"statfs":{"total":96636764160,"available":96602628096,"internally_reserved":0,"allocated":2342912,"data_stored":1095824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.85199999999999998,"15min":0.873},"min":{"1min":0.51900000000000002,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.2350000000000001,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":1.0149999999999999},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.88400000000000001,"15min":0.89700000000000002},"min":{"1min":0.64200000000000002,"5min":0.50800000000000001,"15min":0.49399999999999999},"max":{"1min":1.1779999999999999,"5min":1.2370000000000001,"15min":2.347},"last":0.78300000000000003}]},{"osd":1,"last update":"Sat Jun 10 19:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.89100000000000001,"15min":0.91000000000000003},"min":{"1min":0.51800000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.3180000000000001,"5min":1.6739999999999999,"15min":7.0800000000000001},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.89600000000000002,"15min":0.98099999999999998},"min":{"1min":0.67200000000000004,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.117,"5min":1.244,"15min":15.845000000000001},"last":1.2809999999999999}]},{"osd":2,"last update":"Sat Jun 10 19:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.90400000000000003,"15min":0.90000000000000002},"min":{"1min":0.66200000000000003,"5min":0.59899999999999998,"15min":0.48299999999999998},"max":{"1min":1.1930000000000001,"5min":1.6459999999999999,"15min":5.0049999999999999},"last":1.0549999999999999},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.92700000000000005,"15min":0.94899999999999995},"min":{"1min":0.69099999999999995,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.163,"5min":1.391,"15min":6.851},"last":0.83099999999999996}]},{"osd":3,"last update":"Sat Jun 10 19:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.93100000000000005,"15min":0.94699999999999995},"min":{"1min":0.71799999999999997,"5min":0.58699999999999997,"15min":0.51500000000000001},"max":{"1min":1.304,"5min":1.6910000000000001,"15min":2.544},"last":0.871},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.98399999999999999,"15min":0.98499999999999999},"min":{"1min":0.77600000000000002,"5min":0.66000000000000003,"15min":0.59799999999999998},"max":{"1min":1.1619999999999999,"5min":1.4870000000000001,"15min":3.0830000000000002},"last":0.98299999999999998}]},{"osd":4,"last update":"Sat Jun 10 19:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.93500000000000005,"15min":0.93999999999999995},"min":{"1min":0.64300000000000002,"5min":0.59799999999999998,"15min":0.58099999999999996},"max":{"1min":1.246,"5min":1.6140000000000001,"15min":6.7290000000000001},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.97899999999999998,"15min":0.97999999999999998},"min":{"1min":0.61699999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.278,"5min":1.677,"15min":1.677},"last":1.1279999999999999}]},{"osd":6,"last update":"Sat Jun 10 19:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.98199999999999998,"15min":0.97599999999999998},"min":{"1min":0.64100000000000001,"5min":0.60499999999999998,"15min":0.54200000000000004},"max":{"1min":1.2110000000000001,"5min":1.8009999999999999,"15min":1.8009999999999999},"last":0.93000000000000005},{"interface":"front","average":{"1min":1.012,"5min":1.04,"15min":1.0489999999999999},"min":{"1min":0.77600000000000002,"5min":0.66200000000000003,"15min":0.57899999999999996},"max":{"1min":1.504,"5min":1.8380000000000001,"15min":6.923},"last":0.95799999999999996}]},{"osd":7,"last update":"Sat Jun 10 19:08:58 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.0780000000000001,"15min":1.073},"min":{"1min":0.70699999999999996,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.4419999999999999,"5min":1.7749999999999999,"15min":2.6080000000000001},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.125,"5min":1.1200000000000001,"15min":1.1279999999999999},"min":{"1min":0.74099999999999999,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.351,"5min":1.8049999999999999,"15min":5.4169999999999998},"last":1.1040000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575050,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33336,"kb_used_data":2288,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338504,"statfs":{"total":96636764160,"available":96602628096,"internally_reserved":0,"allocated":2342912,"data_stored":1095824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:08:09 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82399999999999995,"15min":0.83899999999999997},"min":{"1min":0.621,"5min":0.45400000000000001,"15min":0.45100000000000001},"max":{"1min":1.1699999999999999,"5min":1.29,"15min":1.29},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.90400000000000003,"15min":0.90800000000000003},"min":{"1min":0.57399999999999995,"5min":0.439,"15min":0.439},"max":{"1min":1.242,"5min":1.3979999999999999,"15min":3.7280000000000002},"last":0.60899999999999999}]},{"osd":1,"last update":"Sat Jun 10 19:08:09 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.88600000000000001,"15min":0.92100000000000004},"min":{"1min":0.51300000000000001,"5min":0.47799999999999998,"15min":0.47599999999999998},"max":{"1min":1.3560000000000001,"5min":1.5429999999999999,"15min":3.3969999999999998},"last":1.149},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84099999999999997,"15min":0.86299999999999999},"min":{"1min":0.53200000000000003,"5min":0.47899999999999998,"15min":0.47699999999999998},"max":{"1min":1.1339999999999999,"5min":1.2430000000000001,"15min":2.496},"last":0.86399999999999999}]},{"osd":2,"last update":"Sat Jun 10 19:08:09 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.85199999999999998,"15min":0.875},"min":{"1min":0.53600000000000003,"5min":0.52400000000000002,"15min":0.49299999999999999},"max":{"1min":1.0740000000000001,"5min":1.2070000000000001,"15min":1.522},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.94399999999999995,"15min":0.97699999999999998},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.155,"5min":1.4670000000000001,"15min":3.5750000000000002},"last":0.95999999999999996}]},{"osd":3,"last update":"Sat Jun 10 19:08:09 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85399999999999998,"15min":0.89300000000000002},"min":{"1min":0.65100000000000002,"5min":0.56200000000000006,"15min":0.53900000000000003},"max":{"1min":1.1080000000000001,"5min":1.28,"15min":2.3809999999999998},"last":1.101},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.95499999999999996,"15min":0.96499999999999997},"min":{"1min":0.65000000000000002,"5min":0.58199999999999996,"15min":0.54400000000000004},"max":{"1min":1.274,"5min":1.4279999999999999,"15min":1.6479999999999999},"last":1.224}]},{"osd":5,"last update":"Sat Jun 10 19:08:09 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":0.97399999999999998,"15min":0.95799999999999996},"min":{"1min":0.69299999999999995,"5min":0.58699999999999997,"15min":0.53100000000000003},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":3.6539999999999999},"last":1.069},{"interface":"front","average":{"1min":0.998,"5min":0.94499999999999995,"15min":0.93999999999999995},"min":{"1min":0.61899999999999999,"5min":0.495,"15min":0.495},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":2.6720000000000002},"last":1.1819999999999999}]},{"osd":6,"last update":"Sat Jun 10 19:08:09 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.97399999999999998,"15min":0.96499999999999997},"min":{"1min":0.69899999999999995,"5min":0.443,"15min":0.443},"max":{"1min":1.3400000000000001,"5min":1.413,"15min":2.2639999999999998},"last":1.3540000000000001},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.091,"15min":1.0680000000000001},"min":{"1min":0.73699999999999999,"5min":0.58799999999999997,"15min":0.44400000000000001},"max":{"1min":1.5269999999999999,"5min":1.625,"15min":3.4980000000000002},"last":1.298}]},{"osd":7,"last update":"Sat Jun 10 19:08:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.034,"15min":1.0049999999999999},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.41399999999999998},"max":{"1min":1.506,"5min":1.506,"15min":2.5910000000000002},"last":1.3799999999999999},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.095,"15min":1.073},"min":{"1min":0.60399999999999998,"5min":0.50800000000000001,"15min":0.46300000000000002},"max":{"1min":1.3799999999999999,"5min":1.635,"15min":1.635},"last":1.4510000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575049,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37428,"kb_used_data":2284,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334412,"statfs":{"total":96636764160,"available":96598437888,"internally_reserved":0,"allocated":2338816,"data_stored":1094805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.626,"15min":0.626},"min":{"1min":0.26000000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.91800000000000004,"5min":1.0900000000000001,"15min":1.169},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.64800000000000002,"15min":0.66800000000000004},"min":{"1min":0.32000000000000001,"5min":0.29299999999999998,"15min":0.251},"max":{"1min":0.93999999999999995,"5min":0.97799999999999998,"15min":1.5269999999999999},"last":0.378}]},{"osd":1,"last update":"Sat Jun 10 19:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.67700000000000005,"15min":0.68899999999999995},"min":{"1min":0.308,"5min":0.29699999999999999,"15min":0.27800000000000002},"max":{"1min":1.03,"5min":1.234,"15min":2.0699999999999998},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.70299999999999996,"15min":0.73199999999999998},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.0129999999999999,"5min":1.1659999999999999,"15min":1.296},"last":0.41299999999999998}]},{"osd":2,"last update":"Sat Jun 10 19:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.73699999999999999,"15min":0.76800000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.1359999999999999,"5min":1.1950000000000001,"15min":1.3899999999999999},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.78000000000000003,"15min":0.79200000000000004},"min":{"1min":0.314,"5min":0.314,"15min":0.29699999999999999},"max":{"1min":1.119,"5min":1.2769999999999999,"15min":1.591},"last":0.36899999999999999}]},{"osd":4,"last update":"Sat Jun 10 19:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.92000000000000004,"15min":0.94099999999999995},"min":{"1min":0.57899999999999996,"5min":0.55800000000000005,"15min":0.41899999999999998},"max":{"1min":1.2729999999999999,"5min":1.333,"15min":1.8240000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.98199999999999998,"15min":0.98699999999999999},"min":{"1min":0.502,"5min":0.502,"15min":0.47999999999999998},"max":{"1min":1.3720000000000001,"5min":1.4330000000000001,"15min":1.873},"last":0.63900000000000001}]},{"osd":5,"last update":"Sat Jun 10 19:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.98899999999999999,"15min":0.998},"min":{"1min":0.61699999999999999,"5min":0.55900000000000005,"15min":0.55200000000000005},"max":{"1min":1.371,"5min":1.536,"15min":1.752},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.94499999999999995,"5min":1.022,"15min":1.0329999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.46899999999999997},"max":{"1min":1.399,"5min":1.534,"15min":1.9259999999999999},"last":0.71099999999999997}]},{"osd":6,"last update":"Sat Jun 10 19:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":1.0329999999999999,"15min":1.0569999999999999},"min":{"1min":0.60599999999999998,"5min":0.56999999999999995,"15min":0.55300000000000005},"max":{"1min":1.4570000000000001,"5min":1.617,"15min":1.786},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.96399999999999997,"5min":1.0149999999999999,"15min":1.042},"min":{"1min":0.68700000000000006,"5min":0.61399999999999999,"15min":0.58799999999999997},"max":{"1min":1.375,"5min":1.4530000000000001,"15min":2.2120000000000002},"last":0.73799999999999999}]},{"osd":7,"last update":"Sat Jun 10 19:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":1.046,"15min":1.0700000000000001},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.4570000000000001,"5min":1.5720000000000001,"15min":2.1150000000000002},"last":0.58199999999999996},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.083,"15min":1.099},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.764,"5min":1.764,"15min":1.9850000000000001},"last":0.69599999999999995}]}]},{"osd":2,"up_from":13,"seq":55834575050,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37432,"kb_used_data":2288,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334408,"statfs":{"total":96636764160,"available":96598433792,"internally_reserved":0,"allocated":2342912,"data_stored":1095824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.63700000000000001,"15min":0.628},"min":{"1min":0.28899999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.2330000000000001,"5min":2.883,"15min":2.883},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.78800000000000003,"15min":0.746},"min":{"1min":0.42599999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":3.528,"5min":6.5670000000000002,"15min":6.5670000000000002},"last":0.45200000000000001}]},{"osd":1,"last update":"Sat Jun 10 19:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.63900000000000001,"15min":0.66100000000000003},"min":{"1min":0.34699999999999998,"5min":0.32300000000000001,"15min":0.29199999999999998},"max":{"1min":0.95399999999999996,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.82599999999999996,"15min":0.79300000000000004},"min":{"1min":0.38100000000000001,"5min":0.32500000000000001,"15min":0.27400000000000002},"max":{"1min":1.948,"5min":8.4429999999999996,"15min":8.4429999999999996},"last":0.38100000000000001}]},{"osd":3,"last update":"Sat Jun 10 19:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.76800000000000002,"15min":0.78500000000000003},"min":{"1min":0.38700000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":2.4969999999999999,"5min":2.4969999999999999,"15min":2.4969999999999999},"last":0.504},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.77600000000000002,"15min":0.78000000000000003},"min":{"1min":0.36799999999999999,"5min":0.33600000000000002,"15min":0.23499999999999999},"max":{"1min":2.3719999999999999,"5min":4.1849999999999996,"15min":4.1849999999999996},"last":0.47399999999999998}]},{"osd":4,"last update":"Sat Jun 10 19:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.94399999999999995,"15min":0.93400000000000005},"min":{"1min":0.624,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.3089999999999999,"5min":3.996,"15min":3.996},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.93999999999999995,"5min":1.119,"15min":1.044},"min":{"1min":0.61699999999999999,"5min":0.502,"15min":0.496},"max":{"1min":1.369,"5min":13.254,"15min":13.254},"last":0.752}]},{"osd":5,"last update":"Sat Jun 10 19:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":1.131,"15min":1.048},"min":{"1min":0.62,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.2749999999999999,"5min":6.9189999999999996,"15min":6.9189999999999996},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.91700000000000004,"5min":1.2390000000000001,"15min":1.0960000000000001},"min":{"1min":0.57199999999999995,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.161,"5min":15.526,"15min":15.526},"last":0.57199999999999995}]},{"osd":6,"last update":"Sat Jun 10 19:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":1.1220000000000001,"15min":1.0760000000000001},"min":{"1min":0.69299999999999995,"5min":0.624,"15min":0.52700000000000002},"max":{"1min":1.226,"5min":8.7089999999999996,"15min":8.7089999999999996},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.96099999999999997,"5min":1.048,"15min":1.0489999999999999},"min":{"1min":0.58599999999999997,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.417,"5min":6.1299999999999999,"15min":6.1299999999999999},"last":0.60499999999999998}]},{"osd":7,"last update":"Sat Jun 10 19:09:05 2023","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.286,"15min":1.1639999999999999},"min":{"1min":0.66600000000000004,"5min":0.60299999999999998,"15min":0.57199999999999995},"max":{"1min":1.4650000000000001,"5min":12.138,"15min":12.138},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.96499999999999997,"5min":1.0569999999999999,"15min":1.1040000000000001},"min":{"1min":0.63500000000000001,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.278,"5min":1.883,"15min":1.883},"last":0.67200000000000004}]}]},{"osd":1,"up_from":13,"seq":55834575052,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37412,"kb_used_data":2268,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334428,"statfs":{"total":96636764160,"available":96598454272,"internally_reserved":0,"allocated":2322432,"data_stored":1088793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.66900000000000004,"15min":0.68000000000000005},"min":{"1min":0.28199999999999997,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.288},"last":0.64200000000000002},{"interface":"front","average":{"1min":1.0309999999999999,"5min":0.78700000000000003,"15min":0.77300000000000002},"min":{"1min":0.34100000000000003,"5min":0.32300000000000001,"15min":0.26900000000000002},"max":{"1min":5.625,"5min":5.625,"15min":5.625},"last":0.495}]},{"osd":2,"last update":"Sat Jun 10 19:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.624,"15min":0.63900000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.249},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.21},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.71499999999999997,"15min":0.73099999999999998},"min":{"1min":0.36499999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.98399999999999999,"5min":1.2390000000000001,"15min":1.415},"last":0.79500000000000004}]},{"osd":3,"last update":"Sat Jun 10 19:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.753,"15min":0.78400000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.25600000000000001},"max":{"1min":1.177,"5min":1.177,"15min":1.6299999999999999},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.099,"5min":0.77600000000000002,"15min":0.752},"min":{"1min":0.42199999999999999,"5min":0.36099999999999999,"15min":0.29599999999999999},"max":{"1min":6.8200000000000003,"5min":6.8200000000000003,"15min":6.8200000000000003},"last":0.83399999999999996}]},{"osd":4,"last update":"Sat Jun 10 19:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.879,"15min":0.875},"min":{"1min":0.59999999999999998,"5min":0.58599999999999997,"15min":0.56399999999999995},"max":{"1min":1.1950000000000001,"5min":1.3620000000000001,"15min":1.4930000000000001},"last":0.74299999999999999},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.0029999999999999,"15min":1.024},"min":{"1min":0.65900000000000003,"5min":0.58899999999999997,"15min":0.47099999999999997},"max":{"1min":1.385,"5min":1.575,"15min":5.8209999999999997},"last":1.111}]},{"osd":5,"last update":"Sat Jun 10 19:09:07 2023","interfaces":[{"interface":"back","average":{"1min":1.331,"5min":1.0369999999999999,"15min":1.0109999999999999},"min":{"1min":0.75,"5min":0.54800000000000004,"15min":0.49399999999999999},"max":{"1min":6.7030000000000003,"5min":6.7030000000000003,"15min":6.7030000000000003},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.95999999999999996,"15min":0.97999999999999998},"min":{"1min":0.63400000000000001,"5min":0.55000000000000004,"15min":0.46300000000000002},"max":{"1min":1.409,"5min":1.448,"15min":3.089},"last":0.95199999999999996}]},{"osd":6,"last update":"Sat Jun 10 19:09:07 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.0529999999999999,"15min":1.0700000000000001},"min":{"1min":0.79100000000000004,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":6.7450000000000001,"5min":6.7450000000000001,"15min":7.2599999999999998},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.0109999999999999,"5min":0.99099999999999999,"15min":1.0349999999999999},"min":{"1min":0.65600000000000003,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.343,"5min":1.5469999999999999,"15min":9.0069999999999997},"last":0.875}]},{"osd":7,"last update":"Sat Jun 10 19:09:07 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.0629999999999999,"15min":1.0780000000000001},"min":{"1min":0.74299999999999999,"5min":0.54300000000000004,"15min":0.495},"max":{"1min":1.444,"5min":1.4890000000000001,"15min":1.6879999999999999},"last":1.026},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.125,"15min":1.1020000000000001},"min":{"1min":0.621,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":6.782,"5min":6.782,"15min":6.782},"last":1.163}]}]},{"osd":0,"up_from":13,"seq":55834575051,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38008,"kb_used_data":2864,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94333832,"statfs":{"total":96636764160,"available":96597843968,"internally_reserved":0,"allocated":2932736,"data_stored":1685173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jun 10 19:09:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.624,"15min":0.64000000000000001},"min":{"1min":0.26000000000000001,"5min":0.255,"15min":0.248},"max":{"1min":0.91100000000000003,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.78000000000000003,"15min":0.80600000000000005},"min":{"1min":0.37,"5min":0.33000000000000002,"15min":0.32700000000000001},"max":{"1min":1.141,"5min":1.3080000000000001,"15min":1.5780000000000001},"last":1.1120000000000001}]},{"osd":2,"last update":"Sat Jun 10 19:09:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.69299999999999995,"15min":0.71499999999999997},"min":{"1min":0.45600000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.101,"5min":1.1970000000000001,"15min":1.2490000000000001},"last":1.3069999999999999},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64500000000000002,"15min":0.65400000000000003},"min":{"1min":0.28899999999999998,"5min":0.28699999999999998,"15min":0.245},"max":{"1min":0.92100000000000004,"5min":1.1779999999999999,"15min":1.371},"last":0.73199999999999998}]},{"osd":3,"last update":"Sat Jun 10 19:09:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.68400000000000005,"15min":0.68500000000000005},"min":{"1min":0.35099999999999998,"5min":0.309,"15min":0.28899999999999998},"max":{"1min":1.173,"5min":1.397,"15min":1.397},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77700000000000002,"15min":0.81200000000000006},"min":{"1min":0.40100000000000002,"5min":0.36399999999999999,"15min":0.29199999999999998},"max":{"1min":1.2410000000000001,"5min":1.6240000000000001,"15min":1.742},"last":0.872}]},{"osd":4,"last update":"Sat Jun 10 19:09:04 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.89400000000000002,"15min":0.92100000000000004},"min":{"1min":0.47399999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.5580000000000001,"5min":1.758,"15min":3.0209999999999999},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.995,"15min":1.0169999999999999},"min":{"1min":0.56799999999999995,"5min":0.56200000000000006,"15min":0.48599999999999999},"max":{"1min":1.2909999999999999,"5min":1.7250000000000001,"15min":1.873},"last":1.5009999999999999}]},{"osd":5,"last update":"Sat Jun 10 19:09:04 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.88500000000000001,"15min":0.91700000000000004},"min":{"1min":0.55500000000000005,"5min":0.51300000000000001,"15min":0.45100000000000001},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.004,"5min":0.97499999999999998,"15min":1.0009999999999999},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.51400000000000001},"max":{"1min":1.6879999999999999,"5min":1.9870000000000001,"15min":4.5620000000000003},"last":1.2410000000000001}]},{"osd":6,"last update":"Sat Jun 10 19:09:04 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.038,"15min":1.073},"min":{"1min":0.76200000000000001,"5min":0.58699999999999997,"15min":0.52600000000000002},"max":{"1min":1.5129999999999999,"5min":1.9330000000000001,"15min":3.5569999999999999},"last":1.417},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.98899999999999999,"15min":0.998},"min":{"1min":0.61099999999999999,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.333,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":1.161}]},{"osd":7,"last update":"Sat Jun 10 19:09:04 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.0069999999999999,"15min":1.0249999999999999},"min":{"1min":0.58399999999999996,"5min":0.54700000000000004,"15min":0.54600000000000004},"max":{"1min":1.506,"5min":1.804,"15min":1.804},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.98699999999999999,"5min":1.036,"15min":1.0529999999999999},"min":{"1min":0.65200000000000002,"5min":0.61299999999999999,"15min":0.61099999999999999},"max":{"1min":1.3180000000000001,"5min":2.1219999999999999,"15min":2.1219999999999999},"last":1.349}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-10T19:09:09.444 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-10T19:09:09.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.559+0000 7f99f37a0640 1 Processor -- start 2023-06-10T19:09:09.565 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.559+0000 7f99f37a0640 1 -- start start 2023-06-10T19:09:09.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.559+0000 7f99f37a0640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f99ec0afe30 0x7f99ec163980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:09.567 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.559+0000 7f99f37a0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99ec0cb870 0x7f99ec0c10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:09.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.559+0000 7f99f37a0640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99ec1648e0 con 0x7f99ec15fe00 2023-06-10T19:09:09.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.559+0000 7f99f37a0640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99ec06b2c0 con 0x7f99ec0afe30 2023-06-10T19:09:09.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.559+0000 7f99f37a0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99ec0c1620 con 0x7f99ec0cb870 2023-06-10T19:09:09.568 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.559+0000 7f99f153c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f99ec15fe00 0x7f99ec0af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56756/0 (socket says 172.21.15.53:56756) 2023-06-10T19:09:09.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.559+0000 7f99f153c640 1 -- 172.21.15.53:0/1333427478 learned_addr learned my addr 172.21.15.53:0/1333427478 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:09:09.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.559+0000 7f99f1d3d640 1 --2- 172.21.15.53:0/1333427478 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99ec0cb870 0x7f99ec0c10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:09.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.559+0000 7f99f0d3b640 1 --2- 172.21.15.53:0/1333427478 >> v2:172.21.15.117:3300/0 conn(0x7f99ec0afe30 0x7f99ec163980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:09.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.559+0000 7f99ebfff640 1 -- 172.21.15.53:0/1333427478 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1641654735 0 0) 0x7f99ec1648e0 con 0x7f99ec15fe00 2023-06-10T19:09:09.569 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.559+0000 7f99ebfff640 1 -- 172.21.15.53:0/1333427478 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99d4003530 con 0x7f99ec15fe00 2023-06-10T19:09:09.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.563+0000 7f99ebfff640 1 -- 172.21.15.53:0/1333427478 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 759185336 0 0) 0x7f99d4003530 con 0x7f99ec15fe00 2023-06-10T19:09:09.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.563+0000 7f99ebfff640 1 -- 172.21.15.53:0/1333427478 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99ec0cb870 msgr2=0x7f99ec0c10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:09:09.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.563+0000 7f99ebfff640 1 --2- 172.21.15.53:0/1333427478 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99ec0cb870 0x7f99ec0c10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:09.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.563+0000 7f99ebfff640 1 -- 172.21.15.53:0/1333427478 >> v2:172.21.15.117:3300/0 conn(0x7f99ec0afe30 msgr2=0x7f99ec163980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:09:09.570 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.563+0000 7f99ebfff640 1 --2- 172.21.15.53:0/1333427478 >> v2:172.21.15.117:3300/0 conn(0x7f99ec0afe30 0x7f99ec163980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:09.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.563+0000 7f99ebfff640 1 -- 172.21.15.53:0/1333427478 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99ec0cbcf0 con 0x7f99ec15fe00 2023-06-10T19:09:09.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.563+0000 7f99ebfff640 1 -- 172.21.15.53:0/1333427478 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f99dc001680 con 0x7f99ec15fe00 2023-06-10T19:09:09.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.563+0000 7f99ebfff640 1 -- 172.21.15.53:0/1333427478 >> v1:172.21.15.53:6789/0 conn(0x7f99ec15fe00 legacy=0x7f99ec0af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:09.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.563+0000 7f99ebfff640 1 --2- 172.21.15.53:0/1333427478 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99d40039f0 0x7f99d4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:09.571 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.563+0000 7f99ebfff640 1 --2- 172.21.15.53:0/1333427478 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99d40047d0 0x7f99d4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:09.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.563+0000 7f99ebfff640 1 --2- 172.21.15.53:0/1333427478 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99ec0cb870 0x7f99d4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:09.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.563+0000 7f99ebfff640 1 -- 172.21.15.53:0/1333427478 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99ec06b2c0 con 0x7f99d40047d0 2023-06-10T19:09:09.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.563+0000 7f99ebfff640 1 -- 172.21.15.53:0/1333427478 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99ec0c1620 con 0x7f99d40039f0 2023-06-10T19:09:09.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.563+0000 7f99ebfff640 1 -- 172.21.15.53:0/1333427478 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99d400b990 con 0x7f99ec0cb870 2023-06-10T19:09:09.572 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.563+0000 7f99f0d3b640 1 --2- 172.21.15.53:0/1333427478 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99d40047d0 0x7f99d4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:09.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.563+0000 7f99f153c640 1 --2- 172.21.15.53:0/1333427478 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99d40039f0 0x7f99d4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:09.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.563+0000 7f99f1d3d640 1 --2- 172.21.15.53:0/1333427478 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99ec0cb870 0x7f99d4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:09.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.563+0000 7f99f0d3b640 1 -- 172.21.15.53:0/1333427478 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99ec0cb870 msgr2=0x7f99d4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:09:09.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.563+0000 7f99f0d3b640 1 --2- 172.21.15.53:0/1333427478 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99ec0cb870 0x7f99d4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:09.573 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.563+0000 7f99f0d3b640 1 -- 172.21.15.53:0/1333427478 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99d40039f0 msgr2=0x7f99d4003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:09:09.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.563+0000 7f99f0d3b640 1 --2- 172.21.15.53:0/1333427478 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99d40039f0 0x7f99d4003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:09.574 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.563+0000 7f99f0d3b640 1 -- 172.21.15.53:0/1333427478 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99d4003530 con 0x7f99d40047d0 2023-06-10T19:09:09.576 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.563+0000 7f99f0d3b640 1 --2- 172.21.15.53:0/1333427478 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99d40047d0 0x7f99d4004c40 secure :-1 s=READY pgs=2744 cs=0 l=1 rev1=1 crypto rx=0x7f99e0009f90 tx=0x7f99e001cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2cb5140995d38ea server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:09.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.563+0000 7f99ebfff640 1 -- 172.21.15.53:0/1333427478 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e00a5b60 con 0x7f99d40047d0 2023-06-10T19:09:09.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.563+0000 7f99ebfff640 1 -- 172.21.15.53:0/1333427478 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99e000f040 con 0x7f99d40047d0 2023-06-10T19:09:09.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.563+0000 7f99ebfff640 1 -- 172.21.15.53:0/1333427478 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e00ad440 con 0x7f99d40047d0 2023-06-10T19:09:09.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.563+0000 7f99f37a0640 1 -- 172.21.15.53:0/1333427478 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99d40047d0 msgr2=0x7f99d4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:09.577 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.563+0000 7f99f37a0640 1 --2- 172.21.15.53:0/1333427478 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99d40047d0 0x7f99d4004c40 secure :-1 s=READY pgs=2744 cs=0 l=1 rev1=1 crypto rx=0x7f99e0009f90 tx=0x7f99e001cc60 comp rx=0 tx=0).stop 2023-06-10T19:09:09.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.563+0000 7f99f1d3d640 1 -- 172.21.15.53:0/1333427478 reap_dead start 2023-06-10T19:09:09.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.563+0000 7f99f37a0640 1 -- 172.21.15.53:0/1333427478 shutdown_connections 2023-06-10T19:09:09.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.563+0000 7f99f37a0640 1 -- 172.21.15.53:0/1333427478 >> 172.21.15.53:0/1333427478 conn(0x7f99ec06a0d0 msgr2=0x7f99ec0ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:09:09.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.563+0000 7f99f37a0640 1 -- 172.21.15.53:0/1333427478 shutdown_connections 2023-06-10T19:09:09.578 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.563+0000 7f99f37a0640 1 -- 172.21.15.53:0/1333427478 wait complete. 2023-06-10T19:09:09.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.567+0000 7f99f37a0640 1 Processor -- start 2023-06-10T19:09:09.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.567+0000 7f99f37a0640 1 -- start start 2023-06-10T19:09:09.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.567+0000 7f99f37a0640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99d40047d0 0x7f99ec162aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:09.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.567+0000 7f99f37a0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99ec0b14b0 0x7f99ec158900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:09.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.567+0000 7f99f37a0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99ec0c2a30 0x7f99ec0b2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:09.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.567+0000 7f99f37a0640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99ec1601d0 con 0x7f99ec0c2a30 2023-06-10T19:09:09.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.567+0000 7f99f37a0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99ec0b37d0 con 0x7f99ec0b14b0 2023-06-10T19:09:09.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.567+0000 7f99f37a0640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99ec162fe0 con 0x7f99d40047d0 2023-06-10T19:09:09.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.567+0000 7f99f1d3d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99ec0c2a30 0x7f99ec0b2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:09.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.567+0000 7f99f1d3d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99ec0c2a30 0x7f99ec0b2970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55106/0 (socket says 172.21.15.53:55106) 2023-06-10T19:09:09.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.567+0000 7f99f1d3d640 1 -- 172.21.15.53:0/3348841993 learned_addr learned my addr 172.21.15.53:0/3348841993 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:09:09.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.567+0000 7f99f153c640 1 --2- 172.21.15.53:0/3348841993 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99d40047d0 0x7f99ec162aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:09.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.567+0000 7f99f0d3b640 1 --2- 172.21.15.53:0/3348841993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99ec0b14b0 0x7f99ec158900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:09.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.567+0000 7f99f1d3d640 1 -- 172.21.15.53:0/3348841993 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99d40047d0 msgr2=0x7f99ec162aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:09.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.567+0000 7f99f1d3d640 1 --2- 172.21.15.53:0/3348841993 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99d40047d0 0x7f99ec162aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:09.581 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.567+0000 7f99f1d3d640 1 -- 172.21.15.53:0/3348841993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99ec0b14b0 msgr2=0x7f99ec158900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:09.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.567+0000 7f99f1d3d640 1 --2- 172.21.15.53:0/3348841993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99ec0b14b0 0x7f99ec158900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:09.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.567+0000 7f99f1d3d640 1 -- 172.21.15.53:0/3348841993 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99ec0b1970 con 0x7f99ec0c2a30 2023-06-10T19:09:09.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.567+0000 7f99f1d3d640 1 --2- 172.21.15.53:0/3348841993 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99ec0c2a30 0x7f99ec0b2970 secure :-1 s=READY pgs=2745 cs=0 l=1 rev1=1 crypto rx=0x7f99ec0c9340 tx=0x7f99e4011490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:09.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.567+0000 7f99e9ffb640 1 -- 172.21.15.53:0/3348841993 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e4004500 con 0x7f99ec0c2a30 2023-06-10T19:09:09.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.567+0000 7f99e9ffb640 1 -- 172.21.15.53:0/3348841993 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99e4011810 con 0x7f99ec0c2a30 2023-06-10T19:09:09.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.567+0000 7f99f37a0640 1 -- 172.21.15.53:0/3348841993 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99ec0b1c50 con 0x7f99ec0c2a30 2023-06-10T19:09:09.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.567+0000 7f99e9ffb640 1 -- 172.21.15.53:0/3348841993 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e4011c00 con 0x7f99ec0c2a30 2023-06-10T19:09:09.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.567+0000 7f99f37a0640 1 -- 172.21.15.53:0/3348841993 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99ec160700 con 0x7f99ec0c2a30 2023-06-10T19:09:09.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.567+0000 7f99f37a0640 1 -- 172.21.15.53:0/3348841993 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99ec1608f0 con 0x7f99ec0c2a30 2023-06-10T19:09:09.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.571+0000 7f99e9ffb640 1 -- 172.21.15.53:0/3348841993 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f99e4011d60 con 0x7f99ec0c2a30 2023-06-10T19:09:09.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.571+0000 7f99e9ffb640 1 --2- 172.21.15.53:0/3348841993 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f99d8066280 0x7f99d8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:09.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.571+0000 7f99e9ffb640 1 -- 172.21.15.53:0/3348841993 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f99e40831d0 con 0x7f99ec0c2a30 2023-06-10T19:09:09.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.571+0000 7f99f153c640 1 --2- 172.21.15.53:0/3348841993 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f99d8066280 0x7f99d8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:09.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.571+0000 7f99f153c640 1 --2- 172.21.15.53:0/3348841993 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f99d8066280 0x7f99d8068730 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f99dc005420 tx=0x7f99dc0014c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:09.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.575+0000 7f99e9ffb640 1 -- 172.21.15.53:0/3348841993 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f99e40509b0 con 0x7f99ec0c2a30 2023-06-10T19:09:09.734 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.727+0000 7f99f37a0640 1 -- 172.21.15.53:0/3348841993 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f99ec04d790 con 0x7f99ec0c2a30 2023-06-10T19:09:09.736 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.731+0000 7f99e9ffb640 1 -- 172.21.15.53:0/3348841993 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v186) v1 ==== 74+0+14827 (secure 0 0 0) 0x7f99e4053fd0 con 0x7f99ec0c2a30 2023-06-10T19:09:09.736 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:09:09.737 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":186,"fsid":"c8c64bed-c406-4936-93f9-d16335f1067d","created":"2023-06-10T18:52:21.048349+0000","modified":"2023-06-10T19:09:06.461270+0000","last_up_change":"2023-06-10T18:52:32.266275+0000","last_in_change":"2023-06-10T18:52:23.319802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-10T18:52:33.633114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-10T18:52:39.171487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96556046-db90-4d65-9ada-e415ee0a0990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6817","nonce":1931565522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6819","nonce":1931565522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6823","nonce":1931565522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1931565522},{"type":"v1","addr":"172.21.15.53:6821","nonce":1931565522}]},"public_addr":"172.21.15.53:6817/1931565522","cluster_addr":"172.21.15.53:6819/1931565522","heartbeat_back_addr":"172.21.15.53:6823/1931565522","heartbeat_front_addr":"172.21.15.53:6821/1931565522","state":["exists","up"]},{"osd":1,"uuid":"09f1ac84-a357-41c6-b200-7a300b2e0650","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6809","nonce":1927955833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6811","nonce":1927955833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6815","nonce":1927955833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":1927955833},{"type":"v1","addr":"172.21.15.53:6813","nonce":1927955833}]},"public_addr":"172.21.15.53:6809/1927955833","cluster_addr":"172.21.15.53:6811/1927955833","heartbeat_back_addr":"172.21.15.53:6815/1927955833","heartbeat_front_addr":"172.21.15.53:6813/1927955833","state":["exists","up"]},{"osd":2,"uuid":"42d95fe8-549b-40d4-bdd3-4a17a6fbb729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6801","nonce":3437315773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6803","nonce":3437315773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6807","nonce":3437315773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3437315773},{"type":"v1","addr":"172.21.15.53:6805","nonce":3437315773}]},"public_addr":"172.21.15.53:6801/3437315773","cluster_addr":"172.21.15.53:6803/3437315773","heartbeat_back_addr":"172.21.15.53:6807/3437315773","heartbeat_front_addr":"172.21.15.53:6805/3437315773","state":["exists","up"]},{"osd":3,"uuid":"74802362-5157-494d-a04a-661be6f4a802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6825","nonce":1444622980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6827","nonce":1444622980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6831","nonce":1444622980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":1444622980},{"type":"v1","addr":"172.21.15.53:6829","nonce":1444622980}]},"public_addr":"172.21.15.53:6825/1444622980","cluster_addr":"172.21.15.53:6827/1444622980","heartbeat_back_addr":"172.21.15.53:6831/1444622980","heartbeat_front_addr":"172.21.15.53:6829/1444622980","state":["exists","up"]},{"osd":4,"uuid":"21e7d693-ea15-42f4-8047-fa5bd40de030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6825","nonce":86798558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6827","nonce":86798558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6831","nonce":86798558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":86798558},{"type":"v1","addr":"172.21.15.117:6829","nonce":86798558}]},"public_addr":"172.21.15.117:6825/86798558","cluster_addr":"172.21.15.117:6827/86798558","heartbeat_back_addr":"172.21.15.117:6831/86798558","heartbeat_front_addr":"172.21.15.117:6829/86798558","state":["exists","up"]},{"osd":5,"uuid":"222cc807-6586-4c9f-b77b-c50f39939699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6809","nonce":1805352380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6811","nonce":1805352380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6815","nonce":1805352380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1805352380},{"type":"v1","addr":"172.21.15.117:6813","nonce":1805352380}]},"public_addr":"172.21.15.117:6809/1805352380","cluster_addr":"172.21.15.117:6811/1805352380","heartbeat_back_addr":"172.21.15.117:6815/1805352380","heartbeat_front_addr":"172.21.15.117:6813/1805352380","state":["exists","up"]},{"osd":6,"uuid":"c1e3a10b-f324-4e66-85ae-a97ba498c5fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6801","nonce":2391250751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6803","nonce":2391250751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6807","nonce":2391250751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2391250751},{"type":"v1","addr":"172.21.15.117:6805","nonce":2391250751}]},"public_addr":"172.21.15.117:6801/2391250751","cluster_addr":"172.21.15.117:6803/2391250751","heartbeat_back_addr":"172.21.15.117:6807/2391250751","heartbeat_front_addr":"172.21.15.117:6805/2391250751","state":["exists","up"]},{"osd":7,"uuid":"14525ac7-f008-4749-aeb5-23e979497b78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6817","nonce":4204353710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6819","nonce":4204353710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6823","nonce":4204353710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4204353710},{"type":"v1","addr":"172.21.15.117:6821","nonce":4204353710}]},"public_addr":"172.21.15.117:6817/4204353710","cluster_addr":"172.21.15.117:6819/4204353710","heartbeat_back_addr":"172.21.15.117:6823/4204353710","heartbeat_front_addr":"172.21.15.117:6821/4204353710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.869945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.845788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.764047+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.940358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.889301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.744420+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.618240+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-10T18:52:28.831624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.53:6835/3732323283":"2023-06-11T19:09:02.695561+0000","172.21.15.53:6834/3732323283":"2023-06-11T19:09:02.695561+0000","192.168.0.1:0/3824904337":"2023-06-10T20:08:33.687127+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-10T19:09:09.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.731+0000 7f99f37a0640 1 -- 172.21.15.53:0/3348841993 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f99d8066280 msgr2=0x7f99d8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:09.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.731+0000 7f99f37a0640 1 --2- 172.21.15.53:0/3348841993 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f99d8066280 0x7f99d8068730 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f99dc005420 tx=0x7f99dc0014c0 comp rx=0 tx=0).stop 2023-06-10T19:09:09.738 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.731+0000 7f99f37a0640 1 -- 172.21.15.53:0/3348841993 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99ec0c2a30 msgr2=0x7f99ec0b2970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:09.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.731+0000 7f99f37a0640 1 --2- 172.21.15.53:0/3348841993 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99ec0c2a30 0x7f99ec0b2970 secure :-1 s=READY pgs=2745 cs=0 l=1 rev1=1 crypto rx=0x7f99ec0c9340 tx=0x7f99e4011490 comp rx=0 tx=0).stop 2023-06-10T19:09:09.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.731+0000 7f99f37a0640 1 -- 172.21.15.53:0/3348841993 shutdown_connections 2023-06-10T19:09:09.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.731+0000 7f99f37a0640 1 --2- 172.21.15.53:0/3348841993 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f99d8066280 0x7f99d8068730 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:09.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.731+0000 7f99f37a0640 1 --2- 172.21.15.53:0/3348841993 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99ec0c2a30 0x7f99ec0b2970 unknown :-1 s=CLOSED pgs=2745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:09.739 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.731+0000 7f99f37a0640 1 --2- 172.21.15.53:0/3348841993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99ec0b14b0 0x7f99ec158900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:09.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.731+0000 7f99f37a0640 1 --2- 172.21.15.53:0/3348841993 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99d40047d0 0x7f99ec162aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:09.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.731+0000 7f99f37a0640 1 -- 172.21.15.53:0/3348841993 >> 172.21.15.53:0/3348841993 conn(0x7f99ec06a0d0 msgr2=0x7f99ec070110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:09:09.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.731+0000 7f99f37a0640 1 -- 172.21.15.53:0/3348841993 shutdown_connections 2023-06-10T19:09:09.740 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:09.731+0000 7f99f37a0640 1 -- 172.21.15.53:0/3348841993 wait complete. 2023-06-10T19:09:10.758 INFO:tasks.ceph:Scrubbing osd.0 2023-06-10T19:09:10.759 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-06-10T19:09:10.897 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:10.891+0000 7fb7424a5640 1 Processor -- start 2023-06-10T19:09:10.898 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:10.891+0000 7fb7424a5640 1 -- start start 2023-06-10T19:09:10.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:10.891+0000 7fb7424a5640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb73c159760 0x7fb73c0cec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:10.899 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:10.891+0000 7fb7424a5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb73c0cf1a0 0x7fb73c0cbf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:10.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:10.891+0000 7fb7424a5640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb73c0cf5f0 con 0x7fb73c159390 2023-06-10T19:09:10.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:10.891+0000 7fb7424a5640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb73c15e1b0 con 0x7fb73c159760 2023-06-10T19:09:10.900 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:10.891+0000 7fb7424a5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb73c0cb460 con 0x7fb73c0cf1a0 2023-06-10T19:09:10.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:10.895+0000 7fb73b7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb73c159760 0x7fb73c0cec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:10.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:10.895+0000 7fb73bfff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fb73c159390 0x7fb73c15d1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56764/0 (socket says 172.21.15.53:56764) 2023-06-10T19:09:10.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:10.895+0000 7fb73bfff640 1 -- 172.21.15.53:0/1933082140 learned_addr learned my addr 172.21.15.53:0/1933082140 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:09:10.901 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:10.895+0000 7fb740a42640 1 --2- 172.21.15.53:0/1933082140 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb73c0cf1a0 0x7fb73c0cbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:10.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:10.895+0000 7fb73b7fe640 1 -- 172.21.15.53:0/1933082140 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb73c0cf1a0 msgr2=0x7fb73c0cbf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:09:10.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:10.895+0000 7fb73b7fe640 1 --2- 172.21.15.53:0/1933082140 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb73c0cf1a0 0x7fb73c0cbf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:10.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:10.895+0000 7fb73b7fe640 1 -- 172.21.15.53:0/1933082140 >> v1:172.21.15.53:6789/0 conn(0x7fb73c159390 legacy=0x7fb73c15d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:10.902 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:10.895+0000 7fb73affd640 1 -- 172.21.15.53:0/1933082140 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1933755023 0 0) 0x7fb72c001120 con 0x7fb73c159390 2023-06-10T19:09:10.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:10.895+0000 7fb73b7fe640 1 -- 172.21.15.53:0/1933082140 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb73c15dbf0 con 0x7fb73c159760 2023-06-10T19:09:10.903 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:10.895+0000 7fb740a42640 1 --2- 172.21.15.53:0/1933082140 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb73c0cf1a0 0x7fb73c0cbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:09:10.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:10.895+0000 7fb73b7fe640 1 --2- 172.21.15.53:0/1933082140 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb73c159760 0x7fb73c0cec60 secure :-1 s=READY pgs=2747 cs=0 l=1 rev1=1 crypto rx=0x7fb7240097c0 tx=0x7fb72401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72345ad34d9e3907 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:10.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:10.895+0000 7fb73affd640 1 -- 172.21.15.53:0/1933082140 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7240ab650 con 0x7fb73c159760 2023-06-10T19:09:10.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:10.895+0000 7fb73affd640 1 -- 172.21.15.53:0/1933082140 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7240ab7b0 con 0x7fb73c159760 2023-06-10T19:09:10.905 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:10.895+0000 7fb73affd640 1 -- 172.21.15.53:0/1933082140 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7240abb40 con 0x7fb73c159760 2023-06-10T19:09:10.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:10.895+0000 7fb7424a5640 1 -- 172.21.15.53:0/1933082140 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb73c159760 msgr2=0x7fb73c0cec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:10.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:10.895+0000 7fb7424a5640 1 --2- 172.21.15.53:0/1933082140 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb73c159760 0x7fb73c0cec60 secure :-1 s=READY pgs=2747 cs=0 l=1 rev1=1 crypto rx=0x7fb7240097c0 tx=0x7fb72401c450 comp rx=0 tx=0).stop 2023-06-10T19:09:10.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:10.895+0000 7fb7424a5640 1 -- 172.21.15.53:0/1933082140 shutdown_connections 2023-06-10T19:09:10.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:10.895+0000 7fb7424a5640 1 --2- 172.21.15.53:0/1933082140 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb73c159760 0x7fb73c0cec60 unknown :-1 s=CLOSED pgs=2747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:10.906 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:10.895+0000 7fb7424a5640 1 --2- 172.21.15.53:0/1933082140 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb73c0cf1a0 0x7fb73c0cbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:10.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:10.895+0000 7fb7424a5640 1 -- 172.21.15.53:0/1933082140 >> 172.21.15.53:0/1933082140 conn(0x7fb73c06a0b0 msgr2=0x7fb73c06d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:09:10.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:10.895+0000 7fb7424a5640 1 -- 172.21.15.53:0/1933082140 shutdown_connections 2023-06-10T19:09:10.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:10.895+0000 7fb7424a5640 1 -- 172.21.15.53:0/1933082140 wait complete. 2023-06-10T19:09:10.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:10.899+0000 7fb7424a5640 1 Processor -- start 2023-06-10T19:09:10.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:10.899+0000 7fb7424a5640 1 -- start start 2023-06-10T19:09:10.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:10.899+0000 7fb7424a5640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb73c0cf1a0 0x7fb73c1548d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:10.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:10.899+0000 7fb7424a5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb73c159390 0x7fb73c155fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:10.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:10.899+0000 7fb7424a5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb73c159760 0x7fb73c14c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:10.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:10.899+0000 7fb7424a5640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb73c156510 con 0x7fb73c159390 2023-06-10T19:09:10.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:10.899+0000 7fb7424a5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb73c1567e0 con 0x7fb73c159760 2023-06-10T19:09:10.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:10.899+0000 7fb7424a5640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb73c156ac0 con 0x7fb73c0cf1a0 2023-06-10T19:09:10.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:10.899+0000 7fb73b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb73c159390 0x7fb73c155fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:10.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:10.899+0000 7fb73b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb73c159390 0x7fb73c155fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55114/0 (socket says 172.21.15.53:55114) 2023-06-10T19:09:10.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:10.899+0000 7fb73b7fe640 1 -- 172.21.15.53:0/2055889957 learned_addr learned my addr 172.21.15.53:0/2055889957 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:09:10.909 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:10.899+0000 7fb73bfff640 1 --2- 172.21.15.53:0/2055889957 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb73c0cf1a0 0x7fb73c1548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:10.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:10.899+0000 7fb740a42640 1 --2- 172.21.15.53:0/2055889957 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb73c159760 0x7fb73c14c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:10.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:10.899+0000 7fb73b7fe640 1 -- 172.21.15.53:0/2055889957 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb73c0cf1a0 msgr2=0x7fb73c1548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:10.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:10.899+0000 7fb73b7fe640 1 --2- 172.21.15.53:0/2055889957 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb73c0cf1a0 0x7fb73c1548d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:10.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:10.899+0000 7fb73b7fe640 1 -- 172.21.15.53:0/2055889957 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb73c159760 msgr2=0x7fb73c14c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:10.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:10.899+0000 7fb73b7fe640 1 --2- 172.21.15.53:0/2055889957 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb73c159760 0x7fb73c14c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:10.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:10.899+0000 7fb73b7fe640 1 -- 172.21.15.53:0/2055889957 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb724009420 con 0x7fb73c159390 2023-06-10T19:09:10.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:10.899+0000 7fb73b7fe640 1 --2- 172.21.15.53:0/2055889957 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb73c159390 0x7fb73c155fd0 secure :-1 s=READY pgs=2748 cs=0 l=1 rev1=1 crypto rx=0x7fb72401ab00 tx=0x7fb7240191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:10.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:10.899+0000 7fb738ff9640 1 -- 172.21.15.53:0/2055889957 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7240bf450 con 0x7fb73c159390 2023-06-10T19:09:10.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:10.899+0000 7fb738ff9640 1 -- 172.21.15.53:0/2055889957 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7240bf5d0 con 0x7fb73c159390 2023-06-10T19:09:10.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:10.899+0000 7fb7424a5640 1 -- 172.21.15.53:0/2055889957 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb73c156da0 con 0x7fb73c159390 2023-06-10T19:09:10.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:10.899+0000 7fb738ff9640 1 -- 172.21.15.53:0/2055889957 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7240bf980 con 0x7fb73c159390 2023-06-10T19:09:10.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:10.899+0000 7fb7424a5640 1 -- 172.21.15.53:0/2055889957 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb73c157360 con 0x7fb73c159390 2023-06-10T19:09:10.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:10.899+0000 7fb7424a5640 1 -- 172.21.15.53:0/2055889957 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb73c15d8b0 con 0x7fb73c159390 2023-06-10T19:09:10.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:10.903+0000 7fb738ff9640 1 -- 172.21.15.53:0/2055889957 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb7240c83f0 con 0x7fb73c159390 2023-06-10T19:09:10.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:10.903+0000 7fb738ff9640 1 --2- 172.21.15.53:0/2055889957 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb71c066280 0x7fb71c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:10.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:10.903+0000 7fb738ff9640 1 -- 172.21.15.53:0/2055889957 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fb72411eea0 con 0x7fb73c159390 2023-06-10T19:09:10.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:10.903+0000 7fb738ff9640 1 --2- 172.21.15.53:0/2055889957 >> [v2:172.21.15.53:6816/1931565522,v1:172.21.15.53:6817/1931565522] conn(0x7fb71c06c740 0x7fb71c06eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:10.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:10.903+0000 7fb738ff9640 1 -- 172.21.15.53:0/2055889957 --> [v2:172.21.15.53:6816/1931565522,v1:172.21.15.53:6817/1931565522] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb71c06f200 con 0x7fb71c06c740 2023-06-10T19:09:10.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:10.903+0000 7fb738ff9640 1 -- 172.21.15.53:0/2055889957 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=186) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb72411f2f0 con 0x7fb73c159390 2023-06-10T19:09:10.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:10.903+0000 7fb740a42640 1 --2- 172.21.15.53:0/2055889957 >> [v2:172.21.15.53:6816/1931565522,v1:172.21.15.53:6817/1931565522] conn(0x7fb71c06c740 0x7fb71c06eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:10.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:10.903+0000 7fb73bfff640 1 --2- 172.21.15.53:0/2055889957 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb71c066280 0x7fb71c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:10.915 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:10.903+0000 7fb740a42640 1 --2- 172.21.15.53:0/2055889957 >> [v2:172.21.15.53:6816/1931565522,v1:172.21.15.53:6817/1931565522] conn(0x7fb71c06c740 0x7fb71c06eb50 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:10.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:10.903+0000 7fb73bfff640 1 --2- 172.21.15.53:0/2055889957 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb71c066280 0x7fb71c068730 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fb72c000f70 tx=0x7fb72c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:10.916 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:10.903+0000 7fb738ff9640 1 -- 172.21.15.53:0/2055889957 <== osd.0 v2:172.21.15.53:6816/1931565522 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fb71c06f200 con 0x7fb71c06c740 2023-06-10T19:09:10.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:10.915+0000 7fb7424a5640 1 -- 172.21.15.53:0/2055889957 --> [v2:172.21.15.53:6816/1931565522,v1:172.21.15.53:6817/1931565522] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb73c0cb9e0 con 0x7fb71c06c740 2023-06-10T19:09:10.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:10.915+0000 7fb738ff9640 1 -- 172.21.15.53:0/2055889957 <== osd.0 v2:172.21.15.53:6816/1931565522 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fb73400d490 con 0x7fb71c06c740 2023-06-10T19:09:10.922 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-06-10T19:09:10.923 INFO:teuthology.orchestra.run.smithi053.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-06-10T19:09:10.923 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-06-10T19:09:10.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:10.915+0000 7fb7424a5640 1 -- 172.21.15.53:0/2055889957 >> [v2:172.21.15.53:6816/1931565522,v1:172.21.15.53:6817/1931565522] conn(0x7fb71c06c740 msgr2=0x7fb71c06eb50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:10.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:10.915+0000 7fb7424a5640 1 --2- 172.21.15.53:0/2055889957 >> [v2:172.21.15.53:6816/1931565522,v1:172.21.15.53:6817/1931565522] conn(0x7fb71c06c740 0x7fb71c06eb50 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:10.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:10.915+0000 7fb7424a5640 1 -- 172.21.15.53:0/2055889957 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb71c066280 msgr2=0x7fb71c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:10.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:10.915+0000 7fb7424a5640 1 --2- 172.21.15.53:0/2055889957 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fb71c066280 0x7fb71c068730 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fb72c000f70 tx=0x7fb72c009040 comp rx=0 tx=0).stop 2023-06-10T19:09:10.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:10.915+0000 7fb7424a5640 1 -- 172.21.15.53:0/2055889957 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb73c159390 msgr2=0x7fb73c155fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:10.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:10.915+0000 7fb7424a5640 1 --2- 172.21.15.53:0/2055889957 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb73c159390 0x7fb73c155fd0 secure :-1 s=READY pgs=2748 cs=0 l=1 rev1=1 crypto rx=0x7fb72401ab00 tx=0x7fb7240191f0 comp rx=0 tx=0).stop 2023-06-10T19:09:10.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:10.915+0000 7fb740a42640 1 -- 172.21.15.53:0/2055889957 reap_dead start 2023-06-10T19:09:10.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:10.915+0000 7fb7424a5640 1 -- 172.21.15.53:0/2055889957 shutdown_connections 2023-06-10T19:09:10.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:10.915+0000 7fb7424a5640 1 -- 172.21.15.53:0/2055889957 >> 172.21.15.53:0/2055889957 conn(0x7fb73c06a0b0 msgr2=0x7fb73c06f310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:09:10.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:10.915+0000 7fb7424a5640 1 -- 172.21.15.53:0/2055889957 shutdown_connections 2023-06-10T19:09:10.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:10.915+0000 7fb7424a5640 1 -- 172.21.15.53:0/2055889957 wait complete. 2023-06-10T19:09:10.939 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-06-10T19:09:11.056 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.051+0000 7f9df4997640 1 Processor -- start 2023-06-10T19:09:11.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.051+0000 7f9df4997640 1 -- start start 2023-06-10T19:09:11.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.051+0000 7f9df4997640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9df015fc50 0x7f9df00af7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:11.057 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.051+0000 7f9df4997640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9df0160020 0x7f9df00afd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:11.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.051+0000 7f9df4997640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9df006a8b0 con 0x7f9df00cd010 2023-06-10T19:09:11.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.051+0000 7f9df4997640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9df006ab00 con 0x7f9df015fc50 2023-06-10T19:09:11.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.051+0000 7f9df4997640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9df006ade0 con 0x7f9df0160020 2023-06-10T19:09:11.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.051+0000 7f9deed9d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f9df00cd010 0x7f9df00cd450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56772/0 (socket says 172.21.15.53:56772) 2023-06-10T19:09:11.058 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.051+0000 7f9deed9d640 1 -- 172.21.15.53:0/1460295305 learned_addr learned my addr 172.21.15.53:0/1460295305 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:09:11.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.051+0000 7f9dedd9b640 1 --2- 172.21.15.53:0/1460295305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9df0160020 0x7f9df00afd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:11.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.051+0000 7f9dee59c640 1 --2- 172.21.15.53:0/1460295305 >> v2:172.21.15.117:3300/0 conn(0x7f9df015fc50 0x7f9df00af7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:11.060 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.051+0000 7f9ded59a640 1 -- 172.21.15.53:0/1460295305 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4107945381 0 0) 0x7f9df006a8b0 con 0x7f9df00cd010 2023-06-10T19:09:11.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.051+0000 7f9ded59a640 1 -- 172.21.15.53:0/1460295305 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ddc003530 con 0x7f9df00cd010 2023-06-10T19:09:11.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.051+0000 7f9ded59a640 1 -- 172.21.15.53:0/1460295305 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2378273686 0 0) 0x7f9ddc003530 con 0x7f9df00cd010 2023-06-10T19:09:11.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.051+0000 7f9ded59a640 1 -- 172.21.15.53:0/1460295305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9df0160020 msgr2=0x7f9df00afd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:09:11.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.051+0000 7f9ded59a640 1 --2- 172.21.15.53:0/1460295305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9df0160020 0x7f9df00afd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:11.061 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.051+0000 7f9ded59a640 1 -- 172.21.15.53:0/1460295305 >> v2:172.21.15.117:3300/0 conn(0x7f9df015fc50 msgr2=0x7f9df00af7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:09:11.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.051+0000 7f9ded59a640 1 --2- 172.21.15.53:0/1460295305 >> v2:172.21.15.117:3300/0 conn(0x7f9df015fc50 0x7f9df00af7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:11.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.051+0000 7f9ded59a640 1 -- 172.21.15.53:0/1460295305 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9df006b0c0 con 0x7f9df00cd010 2023-06-10T19:09:11.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.051+0000 7f9ded59a640 1 -- 172.21.15.53:0/1460295305 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f9de8001680 con 0x7f9df00cd010 2023-06-10T19:09:11.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.051+0000 7f9ded59a640 1 -- 172.21.15.53:0/1460295305 >> v1:172.21.15.53:6789/0 conn(0x7f9df00cd010 legacy=0x7f9df00cd450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:11.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.051+0000 7f9ded59a640 1 --2- 172.21.15.53:0/1460295305 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9ddc003980 0x7f9ddc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:11.062 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.051+0000 7f9ded59a640 1 --2- 172.21.15.53:0/1460295305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9df0160020 0x7f9ddc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:11.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.051+0000 7f9ded59a640 1 --2- 172.21.15.53:0/1460295305 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ddc004d10 0x7f9ddc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:11.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.051+0000 7f9ded59a640 1 -- 172.21.15.53:0/1460295305 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9df006ab00 con 0x7f9ddc003980 2023-06-10T19:09:11.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.051+0000 7f9ded59a640 1 -- 172.21.15.53:0/1460295305 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9df006ade0 con 0x7f9ddc004d10 2023-06-10T19:09:11.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.051+0000 7f9ded59a640 1 -- 172.21.15.53:0/1460295305 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ddc00b990 con 0x7f9df0160020 2023-06-10T19:09:11.063 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.051+0000 7f9dee59c640 1 --2- 172.21.15.53:0/1460295305 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9ddc003980 0x7f9ddc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:11.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.051+0000 7f9deed9d640 1 --2- 172.21.15.53:0/1460295305 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ddc004d10 0x7f9ddc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:11.064 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.051+0000 7f9dedd9b640 1 --2- 172.21.15.53:0/1460295305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9df0160020 0x7f9ddc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:11.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.055+0000 7f9dee59c640 1 -- 172.21.15.53:0/1460295305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9df0160020 msgr2=0x7f9ddc0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:09:11.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.055+0000 7f9dee59c640 1 --2- 172.21.15.53:0/1460295305 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9df0160020 0x7f9ddc0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:11.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.055+0000 7f9dee59c640 1 -- 172.21.15.53:0/1460295305 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ddc004d10 msgr2=0x7f9ddc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:09:11.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.055+0000 7f9dee59c640 1 --2- 172.21.15.53:0/1460295305 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ddc004d10 0x7f9ddc005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:11.065 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.055+0000 7f9dee59c640 1 -- 172.21.15.53:0/1460295305 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ddc003530 con 0x7f9ddc003980 2023-06-10T19:09:11.068 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.055+0000 7f9dee59c640 1 --2- 172.21.15.53:0/1460295305 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9ddc003980 0x7f9ddc003d90 secure :-1 s=READY pgs=2750 cs=0 l=1 rev1=1 crypto rx=0x7f9de000e170 tx=0x7f9de001cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=939d68dc382b884 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:11.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.055+0000 7f9ded59a640 1 -- 172.21.15.53:0/1460295305 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de00a5ae0 con 0x7f9ddc003980 2023-06-10T19:09:11.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.055+0000 7f9ded59a640 1 -- 172.21.15.53:0/1460295305 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9de000f040 con 0x7f9ddc003980 2023-06-10T19:09:11.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.055+0000 7f9ded59a640 1 -- 172.21.15.53:0/1460295305 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de00a5e80 con 0x7f9ddc003980 2023-06-10T19:09:11.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.055+0000 7f9df4997640 1 -- 172.21.15.53:0/1460295305 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9ddc003980 msgr2=0x7f9ddc003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:11.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.055+0000 7f9df4997640 1 --2- 172.21.15.53:0/1460295305 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9ddc003980 0x7f9ddc003d90 secure :-1 s=READY pgs=2750 cs=0 l=1 rev1=1 crypto rx=0x7f9de000e170 tx=0x7f9de001cc80 comp rx=0 tx=0).stop 2023-06-10T19:09:11.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.055+0000 7f9deed9d640 1 -- 172.21.15.53:0/1460295305 reap_dead start 2023-06-10T19:09:11.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.055+0000 7f9df4997640 1 -- 172.21.15.53:0/1460295305 shutdown_connections 2023-06-10T19:09:11.071 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.055+0000 7f9df4997640 1 -- 172.21.15.53:0/1460295305 >> 172.21.15.53:0/1460295305 conn(0x7f9df00ce9e0 msgr2=0x7f9df00ca7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:09:11.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.055+0000 7f9df4997640 1 -- 172.21.15.53:0/1460295305 shutdown_connections 2023-06-10T19:09:11.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.055+0000 7f9df4997640 1 -- 172.21.15.53:0/1460295305 wait complete. 2023-06-10T19:09:11.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.059+0000 7f9df4997640 1 Processor -- start 2023-06-10T19:09:11.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.059+0000 7f9df4997640 1 -- start start 2023-06-10T19:09:11.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.059+0000 7f9df4997640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ddc003980 0x7f9df01f8f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:11.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.059+0000 7f9df4997640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9df015b4f0 0x7f9df00c42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:11.075 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.059+0000 7f9df4997640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9df0150170 0x7f9df015cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:11.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.059+0000 7f9df4997640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9df00c6ed0 con 0x7f9df0150170 2023-06-10T19:09:11.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.059+0000 7f9df4997640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9df00c4bb0 con 0x7f9ddc003980 2023-06-10T19:09:11.076 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.059+0000 7f9df4997640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9df00c6530 con 0x7f9df015b4f0 2023-06-10T19:09:11.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.059+0000 7f9deed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9df0150170 0x7f9df015cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:11.077 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.059+0000 7f9deed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9df0150170 0x7f9df015cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55132/0 (socket says 172.21.15.53:55132) 2023-06-10T19:09:11.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.059+0000 7f9deed9d640 1 -- 172.21.15.53:0/1934426189 learned_addr learned my addr 172.21.15.53:0/1934426189 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:09:11.078 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.059+0000 7f9dedd9b640 1 --2- 172.21.15.53:0/1934426189 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9df015b4f0 0x7f9df00c42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:11.079 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.059+0000 7f9dee59c640 1 --2- 172.21.15.53:0/1934426189 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ddc003980 0x7f9df01f8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:11.079 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.059+0000 7f9deed9d640 1 -- 172.21.15.53:0/1934426189 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9df015b4f0 msgr2=0x7f9df00c42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:11.079 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.059+0000 7f9deed9d640 1 --2- 172.21.15.53:0/1934426189 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9df015b4f0 0x7f9df00c42d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:11.079 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.059+0000 7f9deed9d640 1 -- 172.21.15.53:0/1934426189 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ddc003980 msgr2=0x7f9df01f8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:11.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.059+0000 7f9deed9d640 1 --2- 172.21.15.53:0/1934426189 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ddc003980 0x7f9df01f8f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:11.080 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.059+0000 7f9deed9d640 1 -- 172.21.15.53:0/1934426189 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9df00c6810 con 0x7f9df0150170 2023-06-10T19:09:11.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.059+0000 7f9dee59c640 1 --2- 172.21.15.53:0/1934426189 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ddc003980 0x7f9df01f8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:09:11.081 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.059+0000 7f9dedd9b640 1 --2- 172.21.15.53:0/1934426189 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9df015b4f0 0x7f9df00c42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:09:11.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.059+0000 7f9deed9d640 1 --2- 172.21.15.53:0/1934426189 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9df0150170 0x7f9df015cf40 secure :-1 s=READY pgs=2751 cs=0 l=1 rev1=1 crypto rx=0x7f9de8001060 tx=0x7f9de800e7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:11.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.059+0000 7f9de6ffd640 1 -- 172.21.15.53:0/1934426189 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de800eda0 con 0x7f9df0150170 2023-06-10T19:09:11.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.059+0000 7f9de6ffd640 1 -- 172.21.15.53:0/1934426189 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9de8014480 con 0x7f9df0150170 2023-06-10T19:09:11.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.059+0000 7f9df4997640 1 -- 172.21.15.53:0/1934426189 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9df00c6af0 con 0x7f9df0150170 2023-06-10T19:09:11.082 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.059+0000 7f9de6ffd640 1 -- 172.21.15.53:0/1934426189 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de8014830 con 0x7f9df0150170 2023-06-10T19:09:11.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.059+0000 7f9df4997640 1 -- 172.21.15.53:0/1934426189 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9df01505e0 con 0x7f9df0150170 2023-06-10T19:09:11.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.059+0000 7f9df4997640 1 -- 172.21.15.53:0/1934426189 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9df004d790 con 0x7f9df0150170 2023-06-10T19:09:11.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.063+0000 7f9de6ffd640 1 -- 172.21.15.53:0/1934426189 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9de801d3b0 con 0x7f9df0150170 2023-06-10T19:09:11.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.063+0000 7f9de6ffd640 1 --2- 172.21.15.53:0/1934426189 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9dd0066280 0x7f9dd0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:11.083 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.063+0000 7f9de6ffd640 1 -- 172.21.15.53:0/1934426189 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f9de8082a10 con 0x7f9df0150170 2023-06-10T19:09:11.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.063+0000 7f9dee59c640 1 --2- 172.21.15.53:0/1934426189 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9dd0066280 0x7f9dd0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:11.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.063+0000 7f9dee59c640 1 --2- 172.21.15.53:0/1934426189 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9dd0066280 0x7f9dd0068730 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f9de00af000 tx=0x7f9de00a7040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:11.084 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.067+0000 7f9de6ffd640 1 -- 172.21.15.53:0/1934426189 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9de80501f0 con 0x7f9df0150170 2023-06-10T19:09:11.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.219+0000 7f9df4997640 1 -- 172.21.15.53:0/1934426189 --> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f9df0150860 con 0x7f9dd0066280 2023-06-10T19:09:11.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.219+0000 7f9de6ffd640 1 -- 172.21.15.53:0/1934426189 <== mgr.4105 v2:172.21.15.117:6832/3061986771 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f9de00bd090 con 0x7f9dd0066280 2023-06-10T19:09:11.227 INFO:teuthology.orchestra.run.smithi053.stderr:instructed osd(s) 0 to deep-scrub 2023-06-10T19:09:11.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.223+0000 7f9df4997640 1 -- 172.21.15.53:0/1934426189 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9dd0066280 msgr2=0x7f9dd0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:11.228 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.223+0000 7f9df4997640 1 --2- 172.21.15.53:0/1934426189 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9dd0066280 0x7f9dd0068730 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f9de00af000 tx=0x7f9de00a7040 comp rx=0 tx=0).stop 2023-06-10T19:09:11.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.223+0000 7f9df4997640 1 -- 172.21.15.53:0/1934426189 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9df0150170 msgr2=0x7f9df015cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:11.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.223+0000 7f9df4997640 1 --2- 172.21.15.53:0/1934426189 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9df0150170 0x7f9df015cf40 secure :-1 s=READY pgs=2751 cs=0 l=1 rev1=1 crypto rx=0x7f9de8001060 tx=0x7f9de800e7c0 comp rx=0 tx=0).stop 2023-06-10T19:09:11.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.223+0000 7f9df4997640 1 -- 172.21.15.53:0/1934426189 shutdown_connections 2023-06-10T19:09:11.229 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.223+0000 7f9df4997640 1 --2- 172.21.15.53:0/1934426189 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9dd0066280 0x7f9dd0068730 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:11.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.223+0000 7f9df4997640 1 --2- 172.21.15.53:0/1934426189 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9df0150170 0x7f9df015cf40 unknown :-1 s=CLOSED pgs=2751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:11.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.223+0000 7f9df4997640 1 --2- 172.21.15.53:0/1934426189 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9df015b4f0 0x7f9df00c42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:11.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.223+0000 7f9df4997640 1 --2- 172.21.15.53:0/1934426189 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ddc003980 0x7f9df01f8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:11.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.223+0000 7f9df4997640 1 -- 172.21.15.53:0/1934426189 >> 172.21.15.53:0/1934426189 conn(0x7f9df00ce9e0 msgr2=0x7f9df00723f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:09:11.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.223+0000 7f9df4997640 1 -- 172.21.15.53:0/1934426189 shutdown_connections 2023-06-10T19:09:11.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.223+0000 7f9df4997640 1 -- 172.21.15.53:0/1934426189 wait complete. 2023-06-10T19:09:11.245 INFO:tasks.ceph:Scrubbing osd.1 2023-06-10T19:09:11.245 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-06-10T19:09:11.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.359+0000 7fc2b611c640 1 Processor -- start 2023-06-10T19:09:11.366 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.359+0000 7fc2b611c640 1 -- start start 2023-06-10T19:09:11.367 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.359+0000 7fc2b611c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc2b0157fb0 0x7fc2b006f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:11.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.359+0000 7fc2b611c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2b015c2c0 0x7fc2b006bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:11.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.359+0000 7fc2b611c640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2b006b8f0 con 0x7fc2b00b0250 2023-06-10T19:09:11.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.359+0000 7fc2b611c640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2b00cdbc0 con 0x7fc2b0157fb0 2023-06-10T19:09:11.368 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.359+0000 7fc2b611c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b00cd600 con 0x7fc2b015c2c0 2023-06-10T19:09:11.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.359+0000 7fc2af7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc2b0157fb0 0x7fc2b006f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:11.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.363+0000 7fc2af7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc2b0157fb0 0x7fc2b006f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57090/0 (socket says 172.21.15.53:57090) 2023-06-10T19:09:11.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.363+0000 7fc2af7fe640 1 -- 172.21.15.53:0/260573913 learned_addr learned my addr 172.21.15.53:0/260573913 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:09:11.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.363+0000 7fc2affff640 1 --2- 172.21.15.53:0/260573913 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2b015c2c0 0x7fc2b006bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:11.369 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.363+0000 7fc2af7fe640 1 -- 172.21.15.53:0/260573913 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2b015c2c0 msgr2=0x7fc2b006bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:09:11.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.363+0000 7fc2af7fe640 1 --2- 172.21.15.53:0/260573913 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2b015c2c0 0x7fc2b006bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:11.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.363+0000 7fc2af7fe640 1 -- 172.21.15.53:0/260573913 >> v1:172.21.15.117:6789/0 conn(0x7fc2b00b0250 legacy=0x7fc2b015bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:11.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.363+0000 7fc2af7fe640 1 -- 172.21.15.53:0/260573913 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2b00cd8e0 con 0x7fc2b0157fb0 2023-06-10T19:09:11.370 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.363+0000 7fc2affff640 1 --2- 172.21.15.53:0/260573913 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2b015c2c0 0x7fc2b006bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:09:11.374 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.363+0000 7fc2af7fe640 1 --2- 172.21.15.53:0/260573913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2b0157fb0 0x7fc2b006f0a0 secure :-1 s=READY pgs=2752 cs=0 l=1 rev1=1 crypto rx=0x7fc2a0009870 tx=0x7fc2a001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eabbeaee838db75b server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:11.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.363+0000 7fc2aeffd640 1 -- 172.21.15.53:0/260573913 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a00aa610 con 0x7fc2b0157fb0 2023-06-10T19:09:11.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.363+0000 7fc2aeffd640 1 -- 172.21.15.53:0/260573913 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2a00a6040 con 0x7fc2b0157fb0 2023-06-10T19:09:11.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.363+0000 7fc2aeffd640 1 -- 172.21.15.53:0/260573913 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a00aa990 con 0x7fc2b0157fb0 2023-06-10T19:09:11.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.363+0000 7fc2b611c640 1 -- 172.21.15.53:0/260573913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2b0157fb0 msgr2=0x7fc2b006f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:11.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.363+0000 7fc2b611c640 1 --2- 172.21.15.53:0/260573913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2b0157fb0 0x7fc2b006f0a0 secure :-1 s=READY pgs=2752 cs=0 l=1 rev1=1 crypto rx=0x7fc2a0009870 tx=0x7fc2a001c4b0 comp rx=0 tx=0).stop 2023-06-10T19:09:11.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.363+0000 7fc2b611c640 1 -- 172.21.15.53:0/260573913 shutdown_connections 2023-06-10T19:09:11.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.363+0000 7fc2b611c640 1 --2- 172.21.15.53:0/260573913 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2b015c2c0 0x7fc2b006bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:11.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.363+0000 7fc2b611c640 1 --2- 172.21.15.53:0/260573913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2b0157fb0 0x7fc2b006f0a0 unknown :-1 s=CLOSED pgs=2752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:11.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.363+0000 7fc2b611c640 1 -- 172.21.15.53:0/260573913 >> 172.21.15.53:0/260573913 conn(0x7fc2b00ca830 msgr2=0x7fc2b00cac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:09:11.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.363+0000 7fc2b611c640 1 -- 172.21.15.53:0/260573913 shutdown_connections 2023-06-10T19:09:11.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.363+0000 7fc2b611c640 1 -- 172.21.15.53:0/260573913 wait complete. 2023-06-10T19:09:11.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.367+0000 7fc2b611c640 1 Processor -- start 2023-06-10T19:09:11.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.367+0000 7fc2b611c640 1 -- start start 2023-06-10T19:09:11.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.367+0000 7fc2b611c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2b00b0250 0x7fc2b014ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:11.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.367+0000 7fc2b611c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2b0157fb0 0x7fc2b0154920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:11.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.367+0000 7fc2b611c640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2b015c2c0 0x7fc2b006f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:11.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.367+0000 7fc2b611c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b0154e60 con 0x7fc2b00b0250 2023-06-10T19:09:11.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.367+0000 7fc2b611c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b0155070 con 0x7fc2b0157fb0 2023-06-10T19:09:11.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.367+0000 7fc2b611c640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b0155350 con 0x7fc2b015c2c0 2023-06-10T19:09:11.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.367+0000 7fc2af7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2b00b0250 0x7fc2b014ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:11.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.367+0000 7fc2af7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2b00b0250 0x7fc2b014ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57104/0 (socket says 172.21.15.53:57104) 2023-06-10T19:09:11.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.367+0000 7fc2af7fe640 1 -- 172.21.15.53:0/2001309453 learned_addr learned my addr 172.21.15.53:0/2001309453 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:09:11.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.367+0000 7fc2affff640 1 --2- 172.21.15.53:0/2001309453 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2b015c2c0 0x7fc2b006f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:11.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.367+0000 7fc2a7fff640 1 --2- 172.21.15.53:0/2001309453 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2b0157fb0 0x7fc2b0154920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:11.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.367+0000 7fc2af7fe640 1 -- 172.21.15.53:0/2001309453 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2b015c2c0 msgr2=0x7fc2b006f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:11.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.367+0000 7fc2af7fe640 1 --2- 172.21.15.53:0/2001309453 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2b015c2c0 0x7fc2b006f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:11.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.367+0000 7fc2af7fe640 1 -- 172.21.15.53:0/2001309453 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2b0157fb0 msgr2=0x7fc2b0154920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:11.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.367+0000 7fc2af7fe640 1 --2- 172.21.15.53:0/2001309453 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2b0157fb0 0x7fc2b0154920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:11.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.367+0000 7fc2af7fe640 1 -- 172.21.15.53:0/2001309453 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a00094d0 con 0x7fc2b00b0250 2023-06-10T19:09:11.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.367+0000 7fc2affff640 1 --2- 172.21.15.53:0/2001309453 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc2b015c2c0 0x7fc2b006f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:09:11.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.367+0000 7fc2af7fe640 1 --2- 172.21.15.53:0/2001309453 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2b00b0250 0x7fc2b014ab90 secure :-1 s=READY pgs=2753 cs=0 l=1 rev1=1 crypto rx=0x7fc2a00ac040 tx=0x7fc2a001acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:11.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.367+0000 7fc2acff9640 1 -- 172.21.15.53:0/2001309453 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a00bd5f0 con 0x7fc2b00b0250 2023-06-10T19:09:11.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.367+0000 7fc2acff9640 1 -- 172.21.15.53:0/2001309453 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2b006cad0 con 0x7fc2b00b0250 2023-06-10T19:09:11.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.367+0000 7fc2acff9640 1 -- 172.21.15.53:0/2001309453 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a00bd990 con 0x7fc2b00b0250 2023-06-10T19:09:11.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.367+0000 7fc2b611c640 1 -- 172.21.15.53:0/2001309453 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2b0155630 con 0x7fc2b00b0250 2023-06-10T19:09:11.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.367+0000 7fc2b611c640 1 -- 172.21.15.53:0/2001309453 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2b00b1c20 con 0x7fc2b00b0250 2023-06-10T19:09:11.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.367+0000 7fc2b611c640 1 -- 172.21.15.53:0/2001309453 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc2b0158380 con 0x7fc2b00b0250 2023-06-10T19:09:11.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.367+0000 7fc2acff9640 1 -- 172.21.15.53:0/2001309453 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc2a00c8480 con 0x7fc2b00b0250 2023-06-10T19:09:11.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.367+0000 7fc2acff9640 1 --2- 172.21.15.53:0/2001309453 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc290066280 0x7fc290068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:11.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.371+0000 7fc2acff9640 1 -- 172.21.15.53:0/2001309453 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fc2a011e190 con 0x7fc2b00b0250 2023-06-10T19:09:11.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.371+0000 7fc2acff9640 1 --2- 172.21.15.53:0/2001309453 >> [v2:172.21.15.53:6808/1927955833,v1:172.21.15.53:6809/1927955833] conn(0x7fc29006c740 0x7fc29006eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:11.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.371+0000 7fc2acff9640 1 -- 172.21.15.53:0/2001309453 --> [v2:172.21.15.53:6808/1927955833,v1:172.21.15.53:6809/1927955833] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc29006f200 con 0x7fc29006c740 2023-06-10T19:09:11.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.371+0000 7fc2acff9640 1 -- 172.21.15.53:0/2001309453 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=186) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc2a011e5e0 con 0x7fc2b00b0250 2023-06-10T19:09:11.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.371+0000 7fc2affff640 1 --2- 172.21.15.53:0/2001309453 >> [v2:172.21.15.53:6808/1927955833,v1:172.21.15.53:6809/1927955833] conn(0x7fc29006c740 0x7fc29006eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:11.391 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.371+0000 7fc2a7fff640 1 --2- 172.21.15.53:0/2001309453 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc290066280 0x7fc290068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:11.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.371+0000 7fc2affff640 1 --2- 172.21.15.53:0/2001309453 >> [v2:172.21.15.53:6808/1927955833,v1:172.21.15.53:6809/1927955833] conn(0x7fc29006c740 0x7fc29006eb50 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:11.392 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.371+0000 7fc2a7fff640 1 --2- 172.21.15.53:0/2001309453 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc290066280 0x7fc290068730 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fc2b00b1820 tx=0x7fc298009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:11.393 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.371+0000 7fc2acff9640 1 -- 172.21.15.53:0/2001309453 <== osd.1 v2:172.21.15.53:6808/1927955833 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fc29006f200 con 0x7fc29006c740 2023-06-10T19:09:11.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.383+0000 7fc2b611c640 1 -- 172.21.15.53:0/2001309453 --> [v2:172.21.15.53:6808/1927955833,v1:172.21.15.53:6809/1927955833] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc2b004d790 con 0x7fc29006c740 2023-06-10T19:09:11.394 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.383+0000 7fc2acff9640 1 -- 172.21.15.53:0/2001309453 <== osd.1 v2:172.21.15.53:6808/1927955833 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fc2b004d790 con 0x7fc29006c740 2023-06-10T19:09:11.395 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-06-10T19:09:11.395 INFO:teuthology.orchestra.run.smithi053.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-06-10T19:09:11.396 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-06-10T19:09:11.397 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.383+0000 7fc2b611c640 1 -- 172.21.15.53:0/2001309453 >> [v2:172.21.15.53:6808/1927955833,v1:172.21.15.53:6809/1927955833] conn(0x7fc29006c740 msgr2=0x7fc29006eb50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:11.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.383+0000 7fc2b611c640 1 --2- 172.21.15.53:0/2001309453 >> [v2:172.21.15.53:6808/1927955833,v1:172.21.15.53:6809/1927955833] conn(0x7fc29006c740 0x7fc29006eb50 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:11.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.383+0000 7fc2b611c640 1 -- 172.21.15.53:0/2001309453 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc290066280 msgr2=0x7fc290068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:11.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.383+0000 7fc2b611c640 1 --2- 172.21.15.53:0/2001309453 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fc290066280 0x7fc290068730 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fc2b00b1820 tx=0x7fc298009040 comp rx=0 tx=0).stop 2023-06-10T19:09:11.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.383+0000 7fc2b611c640 1 -- 172.21.15.53:0/2001309453 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2b00b0250 msgr2=0x7fc2b014ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:11.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.383+0000 7fc2b611c640 1 --2- 172.21.15.53:0/2001309453 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2b00b0250 0x7fc2b014ab90 secure :-1 s=READY pgs=2753 cs=0 l=1 rev1=1 crypto rx=0x7fc2a00ac040 tx=0x7fc2a001acf0 comp rx=0 tx=0).stop 2023-06-10T19:09:11.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.383+0000 7fc2affff640 1 -- 172.21.15.53:0/2001309453 reap_dead start 2023-06-10T19:09:11.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.383+0000 7fc2b611c640 1 -- 172.21.15.53:0/2001309453 shutdown_connections 2023-06-10T19:09:11.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.383+0000 7fc2b611c640 1 -- 172.21.15.53:0/2001309453 >> 172.21.15.53:0/2001309453 conn(0x7fc2b00ca830 msgr2=0x7fc2b00706f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:09:11.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.383+0000 7fc2b611c640 1 -- 172.21.15.53:0/2001309453 shutdown_connections 2023-06-10T19:09:11.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.383+0000 7fc2b611c640 1 -- 172.21.15.53:0/2001309453 wait complete. 2023-06-10T19:09:11.405 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-06-10T19:09:11.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.511+0000 7fcb3c514640 1 Processor -- start 2023-06-10T19:09:11.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.511+0000 7fcb3c514640 1 -- start start 2023-06-10T19:09:11.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.515+0000 7fcb3c514640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb3415b900 0x7fcb340af7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:11.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.515+0000 7fcb3c514640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb3415bd70 con 0x7fcb340afd10 2023-06-10T19:09:11.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.515+0000 7fcb3c514640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb3406b7a0 con 0x7fcb340cd6d0 2023-06-10T19:09:11.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.515+0000 7fcb3c514640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb340b0190 con 0x7fcb3415b900 2023-06-10T19:09:11.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.515+0000 7fcb3aab1640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fcb340afd10 0x7fcb34158660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:49616/0 (socket says 172.21.15.53:49616) 2023-06-10T19:09:11.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.515+0000 7fcb3aab1640 1 -- 172.21.15.53:0/1102075619 learned_addr learned my addr 172.21.15.53:0/1102075619 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:09:11.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.515+0000 7fcb39aaf640 1 --2- 172.21.15.53:0/1102075619 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb3415b900 0x7fcb340af7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:11.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.515+0000 7fcb392ae640 1 -- 172.21.15.53:0/1102075619 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2253931202 0 0) 0x7fcb3415bd70 con 0x7fcb340afd10 2023-06-10T19:09:11.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.515+0000 7fcb392ae640 1 -- 172.21.15.53:0/1102075619 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb20003530 con 0x7fcb340afd10 2023-06-10T19:09:11.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.515+0000 7fcb392ae640 1 -- 172.21.15.53:0/1102075619 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1009044525 0 0) 0x7fcb20003530 con 0x7fcb340afd10 2023-06-10T19:09:11.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.515+0000 7fcb392ae640 1 -- 172.21.15.53:0/1102075619 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb3415b900 msgr2=0x7fcb340af7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:09:11.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.515+0000 7fcb392ae640 1 --2- 172.21.15.53:0/1102075619 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb3415b900 0x7fcb340af7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:11.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.515+0000 7fcb392ae640 1 -- 172.21.15.53:0/1102075619 >> v1:172.21.15.117:6789/0 conn(0x7fcb340cd6d0 legacy=0x7fcb340c83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:11.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.515+0000 7fcb392ae640 1 -- 172.21.15.53:0/1102075619 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb3406a8b0 con 0x7fcb340afd10 2023-06-10T19:09:11.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.515+0000 7fcb392ae640 1 -- 172.21.15.53:0/1102075619 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fcb2c001a00 con 0x7fcb340afd10 2023-06-10T19:09:11.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.515+0000 7fcb392ae640 1 -- 172.21.15.53:0/1102075619 >> v1:172.21.15.53:6789/0 conn(0x7fcb340afd10 legacy=0x7fcb34158660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:11.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.515+0000 7fcb392ae640 1 --2- 172.21.15.53:0/1102075619 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb200039b0 0x7fcb20003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:11.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.515+0000 7fcb392ae640 1 --2- 172.21.15.53:0/1102075619 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb200047d0 0x7fcb20004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:11.524 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.515+0000 7fcb392ae640 1 --2- 172.21.15.53:0/1102075619 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb3415b900 0x7fcb20005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:11.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.515+0000 7fcb392ae640 1 -- 172.21.15.53:0/1102075619 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb340b0190 con 0x7fcb200039b0 2023-06-10T19:09:11.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.515+0000 7fcb392ae640 1 -- 172.21.15.53:0/1102075619 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb2000ba40 con 0x7fcb200047d0 2023-06-10T19:09:11.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.515+0000 7fcb392ae640 1 -- 172.21.15.53:0/1102075619 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb2000dde0 con 0x7fcb3415b900 2023-06-10T19:09:11.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.515+0000 7fcb3a2b0640 1 --2- 172.21.15.53:0/1102075619 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb200039b0 0x7fcb20003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:11.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.515+0000 7fcb3aab1640 1 --2- 172.21.15.53:0/1102075619 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb3415b900 0x7fcb20005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:11.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.515+0000 7fcb39aaf640 1 --2- 172.21.15.53:0/1102075619 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb200047d0 0x7fcb20004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:11.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.515+0000 7fcb3a2b0640 1 -- 172.21.15.53:0/1102075619 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb3415b900 msgr2=0x7fcb20005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:09:11.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.515+0000 7fcb3a2b0640 1 --2- 172.21.15.53:0/1102075619 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb3415b900 0x7fcb20005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:11.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.515+0000 7fcb3a2b0640 1 -- 172.21.15.53:0/1102075619 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb200047d0 msgr2=0x7fcb20004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:09:11.526 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.515+0000 7fcb3a2b0640 1 --2- 172.21.15.53:0/1102075619 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb200047d0 0x7fcb20004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:11.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.515+0000 7fcb3a2b0640 1 -- 172.21.15.53:0/1102075619 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb20003530 con 0x7fcb200039b0 2023-06-10T19:09:11.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.515+0000 7fcb3aab1640 1 --2- 172.21.15.53:0/1102075619 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb3415b900 0x7fcb20005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:09:11.527 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.515+0000 7fcb39aaf640 1 --2- 172.21.15.53:0/1102075619 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb200047d0 0x7fcb20004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:09:11.529 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.515+0000 7fcb3a2b0640 1 --2- 172.21.15.53:0/1102075619 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb200039b0 0x7fcb20003dc0 secure :-1 s=READY pgs=2755 cs=0 l=1 rev1=1 crypto rx=0x7fcb240017b0 tx=0x7fcb2401c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=212ef8f220f8714a server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:11.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.515+0000 7fcb392ae640 1 -- 172.21.15.53:0/1102075619 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb240052d0 con 0x7fcb200039b0 2023-06-10T19:09:11.530 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.515+0000 7fcb392ae640 1 -- 172.21.15.53:0/1102075619 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb240a7050 con 0x7fcb200039b0 2023-06-10T19:09:11.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.515+0000 7fcb392ae640 1 -- 172.21.15.53:0/1102075619 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb24003650 con 0x7fcb200039b0 2023-06-10T19:09:11.532 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.519+0000 7fcb3c514640 1 -- 172.21.15.53:0/1102075619 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb200039b0 msgr2=0x7fcb20003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:11.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.519+0000 7fcb3c514640 1 --2- 172.21.15.53:0/1102075619 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb200039b0 0x7fcb20003dc0 secure :-1 s=READY pgs=2755 cs=0 l=1 rev1=1 crypto rx=0x7fcb240017b0 tx=0x7fcb2401c3b0 comp rx=0 tx=0).stop 2023-06-10T19:09:11.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.519+0000 7fcb3aab1640 1 -- 172.21.15.53:0/1102075619 reap_dead start 2023-06-10T19:09:11.533 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.519+0000 7fcb3c514640 1 -- 172.21.15.53:0/1102075619 shutdown_connections 2023-06-10T19:09:11.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.519+0000 7fcb3c514640 1 -- 172.21.15.53:0/1102075619 >> 172.21.15.53:0/1102075619 conn(0x7fcb340ce9e0 msgr2=0x7fcb340ca7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:09:11.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.519+0000 7fcb3c514640 1 -- 172.21.15.53:0/1102075619 shutdown_connections 2023-06-10T19:09:11.534 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.519+0000 7fcb3c514640 1 -- 172.21.15.53:0/1102075619 wait complete. 2023-06-10T19:09:11.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.519+0000 7fcb3c514640 1 Processor -- start 2023-06-10T19:09:11.535 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.519+0000 7fcb3c514640 1 -- start start 2023-06-10T19:09:11.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.519+0000 7fcb3c514640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb200039b0 0x7fcb3414db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:11.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.519+0000 7fcb3c514640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb341f8a60 0x7fcb341f4af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:11.536 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.519+0000 7fcb3c514640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb341f5030 0x7fcb340add20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:11.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.519+0000 7fcb3c514640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb341f5ae0 con 0x7fcb341f5030 2023-06-10T19:09:11.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.519+0000 7fcb3c514640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb3414e070 con 0x7fcb341f8a60 2023-06-10T19:09:11.537 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.519+0000 7fcb3c514640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb34150380 con 0x7fcb200039b0 2023-06-10T19:09:11.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.519+0000 7fcb3aab1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb341f5030 0x7fcb340add20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:11.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.519+0000 7fcb3aab1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb341f5030 0x7fcb340add20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57134/0 (socket says 172.21.15.53:57134) 2023-06-10T19:09:11.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.519+0000 7fcb3aab1640 1 -- 172.21.15.53:0/1335160306 learned_addr learned my addr 172.21.15.53:0/1335160306 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:09:11.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.519+0000 7fcb3a2b0640 1 --2- 172.21.15.53:0/1335160306 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb200039b0 0x7fcb3414db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:11.539 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.519+0000 7fcb39aaf640 1 --2- 172.21.15.53:0/1335160306 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb341f8a60 0x7fcb341f4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:11.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.519+0000 7fcb3aab1640 1 -- 172.21.15.53:0/1335160306 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb200039b0 msgr2=0x7fcb3414db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:11.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.519+0000 7fcb3aab1640 1 --2- 172.21.15.53:0/1335160306 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb200039b0 0x7fcb3414db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:11.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.519+0000 7fcb3aab1640 1 -- 172.21.15.53:0/1335160306 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb341f8a60 msgr2=0x7fcb341f4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:11.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.519+0000 7fcb3aab1640 1 --2- 172.21.15.53:0/1335160306 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb341f8a60 0x7fcb341f4af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:11.541 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.519+0000 7fcb3aab1640 1 -- 172.21.15.53:0/1335160306 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb341f5520 con 0x7fcb341f5030 2023-06-10T19:09:11.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.519+0000 7fcb3aab1640 1 --2- 172.21.15.53:0/1335160306 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb341f5030 0x7fcb340add20 secure :-1 s=READY pgs=2756 cs=0 l=1 rev1=1 crypto rx=0x7fcb3406ee70 tx=0x7fcb2c00dd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:11.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.519+0000 7fcb2affd640 1 -- 172.21.15.53:0/1335160306 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb2c007070 con 0x7fcb341f5030 2023-06-10T19:09:11.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.519+0000 7fcb2affd640 1 -- 172.21.15.53:0/1335160306 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb2c0071d0 con 0x7fcb341f5030 2023-06-10T19:09:11.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.519+0000 7fcb3c514640 1 -- 172.21.15.53:0/1335160306 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb341f5800 con 0x7fcb341f5030 2023-06-10T19:09:11.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.519+0000 7fcb2affd640 1 -- 172.21.15.53:0/1335160306 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb2c007580 con 0x7fcb341f5030 2023-06-10T19:09:11.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.519+0000 7fcb3c514640 1 -- 172.21.15.53:0/1335160306 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb341f8540 con 0x7fcb341f5030 2023-06-10T19:09:11.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.523+0000 7fcb3c514640 1 -- 172.21.15.53:0/1335160306 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb341f80c0 con 0x7fcb341f5030 2023-06-10T19:09:11.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.523+0000 7fcb2affd640 1 -- 172.21.15.53:0/1335160306 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcb2c0076e0 con 0x7fcb341f5030 2023-06-10T19:09:11.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.523+0000 7fcb2affd640 1 --2- 172.21.15.53:0/1335160306 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcb18066280 0x7fcb18068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:11.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.523+0000 7fcb2affd640 1 -- 172.21.15.53:0/1335160306 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fcb2c083c70 con 0x7fcb341f5030 2023-06-10T19:09:11.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.523+0000 7fcb3a2b0640 1 --2- 172.21.15.53:0/1335160306 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcb18066280 0x7fcb18068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:11.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.523+0000 7fcb3a2b0640 1 --2- 172.21.15.53:0/1335160306 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcb18066280 0x7fcb18068730 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7fcb240ac000 tx=0x7fcb240011f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:11.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.527+0000 7fcb2affd640 1 -- 172.21.15.53:0/1335160306 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcb2c0513a0 con 0x7fcb341f5030 2023-06-10T19:09:11.682 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.675+0000 7fcb3c514640 1 -- 172.21.15.53:0/1335160306 --> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fcb3406b430 con 0x7fcb18066280 2023-06-10T19:09:11.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.679+0000 7fcb2affd640 1 -- 172.21.15.53:0/1335160306 <== mgr.4105 v2:172.21.15.117:6832/3061986771 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fcb24005370 con 0x7fcb18066280 2023-06-10T19:09:11.683 INFO:teuthology.orchestra.run.smithi053.stderr:instructed osd(s) 1 to deep-scrub 2023-06-10T19:09:11.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.679+0000 7fcb3c514640 1 -- 172.21.15.53:0/1335160306 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcb18066280 msgr2=0x7fcb18068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:11.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.679+0000 7fcb3c514640 1 --2- 172.21.15.53:0/1335160306 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcb18066280 0x7fcb18068730 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7fcb240ac000 tx=0x7fcb240011f0 comp rx=0 tx=0).stop 2023-06-10T19:09:11.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.679+0000 7fcb3c514640 1 -- 172.21.15.53:0/1335160306 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb341f5030 msgr2=0x7fcb340add20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:11.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.679+0000 7fcb3c514640 1 --2- 172.21.15.53:0/1335160306 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb341f5030 0x7fcb340add20 secure :-1 s=READY pgs=2756 cs=0 l=1 rev1=1 crypto rx=0x7fcb3406ee70 tx=0x7fcb2c00dd70 comp rx=0 tx=0).stop 2023-06-10T19:09:11.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.679+0000 7fcb3c514640 1 -- 172.21.15.53:0/1335160306 shutdown_connections 2023-06-10T19:09:11.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.679+0000 7fcb3c514640 1 --2- 172.21.15.53:0/1335160306 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fcb18066280 0x7fcb18068730 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:11.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.679+0000 7fcb3c514640 1 --2- 172.21.15.53:0/1335160306 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb341f5030 0x7fcb340add20 unknown :-1 s=CLOSED pgs=2756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:11.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.679+0000 7fcb3c514640 1 --2- 172.21.15.53:0/1335160306 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb341f8a60 0x7fcb341f4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:11.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.679+0000 7fcb3c514640 1 --2- 172.21.15.53:0/1335160306 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb200039b0 0x7fcb3414db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:11.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.679+0000 7fcb3c514640 1 -- 172.21.15.53:0/1335160306 >> 172.21.15.53:0/1335160306 conn(0x7fcb340ce9e0 msgr2=0x7fcb34152470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:09:11.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.679+0000 7fcb3c514640 1 -- 172.21.15.53:0/1335160306 shutdown_connections 2023-06-10T19:09:11.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.679+0000 7fcb3c514640 1 -- 172.21.15.53:0/1335160306 wait complete. 2023-06-10T19:09:11.701 INFO:tasks.ceph:Scrubbing osd.2 2023-06-10T19:09:11.701 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-06-10T19:09:11.825 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.819+0000 7f9b80330640 1 Processor -- start 2023-06-10T19:09:11.826 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.819+0000 7f9b80330640 1 -- start start 2023-06-10T19:09:11.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.819+0000 7f9b80330640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b78159390 0x7f9b7815d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:11.827 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.819+0000 7f9b80330640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9b7815d6e0 0x7f9b780cec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:11.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.819+0000 7f9b80330640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9b78159760 0x7f9b780cf1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:11.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.819+0000 7f9b80330640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b7815e1b0 con 0x7f9b78159760 2023-06-10T19:09:11.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.819+0000 7f9b80330640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b780cb460 con 0x7f9b7815d6e0 2023-06-10T19:09:11.828 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.819+0000 7f9b80330640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b7815dbf0 con 0x7f9b78159390 2023-06-10T19:09:11.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.819+0000 7f9b7e8cd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9b78159760 0x7f9b780cf1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:11.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.819+0000 7f9b7e8cd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9b78159760 0x7f9b780cf1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57136/0 (socket says 172.21.15.53:57136) 2023-06-10T19:09:11.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.819+0000 7f9b7e8cd640 1 -- 172.21.15.53:0/2994007974 learned_addr learned my addr 172.21.15.53:0/2994007974 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:09:11.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.823+0000 7f9b7e0cc640 1 --2- 172.21.15.53:0/2994007974 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b78159390 0x7f9b7815d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:11.829 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.823+0000 7f9b7d8cb640 1 --2- 172.21.15.53:0/2994007974 >> v2:172.21.15.117:3300/0 conn(0x7f9b7815d6e0 0x7f9b780cec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:11.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.823+0000 7f9b7e8cd640 1 -- 172.21.15.53:0/2994007974 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b78159390 msgr2=0x7f9b7815d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:09:11.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.823+0000 7f9b7e8cd640 1 --2- 172.21.15.53:0/2994007974 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b78159390 0x7f9b7815d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:11.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.823+0000 7f9b7e8cd640 1 -- 172.21.15.53:0/2994007974 >> v2:172.21.15.117:3300/0 conn(0x7f9b7815d6e0 msgr2=0x7f9b780cec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:09:11.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.823+0000 7f9b7e8cd640 1 --2- 172.21.15.53:0/2994007974 >> v2:172.21.15.117:3300/0 conn(0x7f9b7815d6e0 0x7f9b780cec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:11.830 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.823+0000 7f9b7e8cd640 1 -- 172.21.15.53:0/2994007974 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b7815ded0 con 0x7f9b78159760 2023-06-10T19:09:11.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.823+0000 7f9b7e8cd640 1 --2- 172.21.15.53:0/2994007974 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b78159760 0x7f9b780cf1a0 secure :-1 s=READY pgs=2757 cs=0 l=1 rev1=1 crypto rx=0x7f9b780b2a60 tx=0x7f9b7001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47f92a10ce8deab1 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:11.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.823+0000 7f9b7d0ca640 1 -- 172.21.15.53:0/2994007974 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b700a5820 con 0x7f9b78159760 2023-06-10T19:09:11.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.823+0000 7f9b7d0ca640 1 -- 172.21.15.53:0/2994007974 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b700a5980 con 0x7f9b78159760 2023-06-10T19:09:11.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.823+0000 7f9b7d0ca640 1 -- 172.21.15.53:0/2994007974 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b700a5d10 con 0x7f9b78159760 2023-06-10T19:09:11.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.823+0000 7f9b80330640 1 -- 172.21.15.53:0/2994007974 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b78159760 msgr2=0x7f9b780cf1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:11.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.823+0000 7f9b80330640 1 --2- 172.21.15.53:0/2994007974 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b78159760 0x7f9b780cf1a0 secure :-1 s=READY pgs=2757 cs=0 l=1 rev1=1 crypto rx=0x7f9b780b2a60 tx=0x7f9b7001c9a0 comp rx=0 tx=0).stop 2023-06-10T19:09:11.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.823+0000 7f9b80330640 1 -- 172.21.15.53:0/2994007974 shutdown_connections 2023-06-10T19:09:11.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.823+0000 7f9b80330640 1 --2- 172.21.15.53:0/2994007974 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b78159760 0x7f9b780cf1a0 unknown :-1 s=CLOSED pgs=2757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:11.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.823+0000 7f9b80330640 1 --2- 172.21.15.53:0/2994007974 >> v2:172.21.15.117:3300/0 conn(0x7f9b7815d6e0 0x7f9b780cec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:11.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.823+0000 7f9b80330640 1 --2- 172.21.15.53:0/2994007974 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b78159390 0x7f9b7815d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:11.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.823+0000 7f9b80330640 1 -- 172.21.15.53:0/2994007974 >> 172.21.15.53:0/2994007974 conn(0x7f9b7806a0b0 msgr2=0x7f9b7806d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:09:11.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.823+0000 7f9b80330640 1 -- 172.21.15.53:0/2994007974 shutdown_connections 2023-06-10T19:09:11.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.823+0000 7f9b80330640 1 -- 172.21.15.53:0/2994007974 wait complete. 2023-06-10T19:09:11.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.827+0000 7f9b80330640 1 Processor -- start 2023-06-10T19:09:11.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.827+0000 7f9b80330640 1 -- start start 2023-06-10T19:09:11.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.827+0000 7f9b80330640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b78159390 0x7f9b780b5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:11.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.827+0000 7f9b80330640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b78159760 0x7f9b78163240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:11.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.827+0000 7f9b80330640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b7815d6e0 0x7f9b7806b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:11.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.827+0000 7f9b80330640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b781627a0 con 0x7f9b78159760 2023-06-10T19:09:11.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.827+0000 7f9b80330640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b781f3a40 con 0x7f9b78159390 2023-06-10T19:09:11.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.827+0000 7f9b80330640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b7806c200 con 0x7f9b7815d6e0 2023-06-10T19:09:11.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.827+0000 7f9b7d8cb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b78159760 0x7f9b78163240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:11.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.827+0000 7f9b7d8cb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b78159760 0x7f9b78163240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57138/0 (socket says 172.21.15.53:57138) 2023-06-10T19:09:11.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.827+0000 7f9b7d8cb640 1 -- 172.21.15.53:0/3300918860 learned_addr learned my addr 172.21.15.53:0/3300918860 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:09:11.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.827+0000 7f9b7e0cc640 1 --2- 172.21.15.53:0/3300918860 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b78159390 0x7f9b780b5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:11.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.827+0000 7f9b7e8cd640 1 --2- 172.21.15.53:0/3300918860 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b7815d6e0 0x7f9b7806b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:11.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.827+0000 7f9b7d8cb640 1 -- 172.21.15.53:0/3300918860 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b7815d6e0 msgr2=0x7f9b7806b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:11.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.827+0000 7f9b7d8cb640 1 --2- 172.21.15.53:0/3300918860 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b7815d6e0 0x7f9b7806b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:11.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.827+0000 7f9b7d8cb640 1 -- 172.21.15.53:0/3300918860 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b78159390 msgr2=0x7f9b780b5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:11.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.827+0000 7f9b7d8cb640 1 --2- 172.21.15.53:0/3300918860 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b78159390 0x7f9b780b5830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:11.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.827+0000 7f9b7d8cb640 1 -- 172.21.15.53:0/3300918860 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b70009b30 con 0x7f9b78159760 2023-06-10T19:09:11.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.827+0000 7f9b7e8cd640 1 --2- 172.21.15.53:0/3300918860 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b7815d6e0 0x7f9b7806b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:09:11.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.827+0000 7f9b7d8cb640 1 --2- 172.21.15.53:0/3300918860 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b78159760 0x7f9b78163240 secure :-1 s=READY pgs=2758 cs=0 l=1 rev1=1 crypto rx=0x7f9b6800d5f0 tx=0x7f9b6800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:11.839 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.827+0000 7f9b6effd640 1 -- 172.21.15.53:0/3300918860 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b680125f0 con 0x7f9b78159760 2023-06-10T19:09:11.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.827+0000 7f9b6effd640 1 -- 172.21.15.53:0/3300918860 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b68012750 con 0x7f9b78159760 2023-06-10T19:09:11.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.827+0000 7f9b80330640 1 -- 172.21.15.53:0/3300918860 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b78162a40 con 0x7f9b78159760 2023-06-10T19:09:11.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.827+0000 7f9b6effd640 1 -- 172.21.15.53:0/3300918860 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b68012ae0 con 0x7f9b78159760 2023-06-10T19:09:11.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.827+0000 7f9b80330640 1 -- 172.21.15.53:0/3300918860 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b7806c4e0 con 0x7f9b78159760 2023-06-10T19:09:11.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.827+0000 7f9b80330640 1 -- 172.21.15.53:0/3300918860 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9b780ce250 con 0x7f9b78159760 2023-06-10T19:09:11.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.827+0000 7f9b6effd640 1 -- 172.21.15.53:0/3300918860 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9b68012c40 con 0x7f9b78159760 2023-06-10T19:09:11.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.827+0000 7f9b6effd640 1 --2- 172.21.15.53:0/3300918860 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9b5c066280 0x7f9b5c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:11.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.827+0000 7f9b6effd640 1 -- 172.21.15.53:0/3300918860 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f9b680848e0 con 0x7f9b78159760 2023-06-10T19:09:11.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.827+0000 7f9b6effd640 1 --2- 172.21.15.53:0/3300918860 >> [v2:172.21.15.53:6800/3437315773,v1:172.21.15.53:6801/3437315773] conn(0x7f9b5c06c740 0x7f9b5c06eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:11.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.827+0000 7f9b6effd640 1 -- 172.21.15.53:0/3300918860 --> [v2:172.21.15.53:6800/3437315773,v1:172.21.15.53:6801/3437315773] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9b5c06f200 con 0x7f9b5c06c740 2023-06-10T19:09:11.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.827+0000 7f9b6effd640 1 -- 172.21.15.53:0/3300918860 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=186) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9b68084d30 con 0x7f9b78159760 2023-06-10T19:09:11.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.827+0000 7f9b7e8cd640 1 --2- 172.21.15.53:0/3300918860 >> [v2:172.21.15.53:6800/3437315773,v1:172.21.15.53:6801/3437315773] conn(0x7f9b5c06c740 0x7f9b5c06eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:11.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.827+0000 7f9b7e0cc640 1 --2- 172.21.15.53:0/3300918860 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9b5c066280 0x7f9b5c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:11.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.831+0000 7f9b7e8cd640 1 --2- 172.21.15.53:0/3300918860 >> [v2:172.21.15.53:6800/3437315773,v1:172.21.15.53:6801/3437315773] conn(0x7f9b5c06c740 0x7f9b5c06eb50 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:11.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.831+0000 7f9b7e0cc640 1 --2- 172.21.15.53:0/3300918860 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9b5c066280 0x7f9b5c068730 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f9b7400b9d0 tx=0x7f9b74008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:11.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.831+0000 7f9b6effd640 1 -- 172.21.15.53:0/3300918860 <== osd.2 v2:172.21.15.53:6800/3437315773 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f9b5c06f200 con 0x7f9b5c06c740 2023-06-10T19:09:11.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.843+0000 7f9b80330640 1 -- 172.21.15.53:0/3300918860 --> [v2:172.21.15.53:6800/3437315773,v1:172.21.15.53:6801/3437315773] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9b78162ef0 con 0x7f9b5c06c740 2023-06-10T19:09:11.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.843+0000 7f9b6effd640 1 -- 172.21.15.53:0/3300918860 <== osd.2 v2:172.21.15.53:6800/3437315773 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f9b70009270 con 0x7f9b5c06c740 2023-06-10T19:09:11.848 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-06-10T19:09:11.849 INFO:teuthology.orchestra.run.smithi053.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-06-10T19:09:11.849 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-06-10T19:09:11.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.843+0000 7f9b80330640 1 -- 172.21.15.53:0/3300918860 >> [v2:172.21.15.53:6800/3437315773,v1:172.21.15.53:6801/3437315773] conn(0x7f9b5c06c740 msgr2=0x7f9b5c06eb50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:11.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.843+0000 7f9b80330640 1 --2- 172.21.15.53:0/3300918860 >> [v2:172.21.15.53:6800/3437315773,v1:172.21.15.53:6801/3437315773] conn(0x7f9b5c06c740 0x7f9b5c06eb50 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:11.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.843+0000 7f9b80330640 1 -- 172.21.15.53:0/3300918860 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9b5c066280 msgr2=0x7f9b5c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:11.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.843+0000 7f9b80330640 1 --2- 172.21.15.53:0/3300918860 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f9b5c066280 0x7f9b5c068730 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f9b7400b9d0 tx=0x7f9b74008040 comp rx=0 tx=0).stop 2023-06-10T19:09:11.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.843+0000 7f9b80330640 1 -- 172.21.15.53:0/3300918860 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b78159760 msgr2=0x7f9b78163240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:11.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.843+0000 7f9b80330640 1 --2- 172.21.15.53:0/3300918860 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b78159760 0x7f9b78163240 secure :-1 s=READY pgs=2758 cs=0 l=1 rev1=1 crypto rx=0x7f9b6800d5f0 tx=0x7f9b6800dab0 comp rx=0 tx=0).stop 2023-06-10T19:09:11.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.843+0000 7f9b7e8cd640 1 -- 172.21.15.53:0/3300918860 reap_dead start 2023-06-10T19:09:11.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.843+0000 7f9b80330640 1 -- 172.21.15.53:0/3300918860 shutdown_connections 2023-06-10T19:09:11.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.843+0000 7f9b80330640 1 -- 172.21.15.53:0/3300918860 >> 172.21.15.53:0/3300918860 conn(0x7f9b7806a0b0 msgr2=0x7f9b780b0850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:09:11.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.843+0000 7f9b80330640 1 -- 172.21.15.53:0/3300918860 shutdown_connections 2023-06-10T19:09:11.852 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.843+0000 7f9b80330640 1 -- 172.21.15.53:0/3300918860 wait complete. 2023-06-10T19:09:11.863 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-06-10T19:09:11.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.967+0000 7f3a44ffc640 1 Processor -- start 2023-06-10T19:09:11.972 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.967+0000 7f3a44ffc640 1 -- start start 2023-06-10T19:09:11.973 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.967+0000 7f3a44ffc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3a4015fc50 0x7f3a400af7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:11.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.967+0000 7f3a44ffc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3a40160020 0x7f3a400afd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:11.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.967+0000 7f3a44ffc640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a4006a8b0 con 0x7f3a400cd010 2023-06-10T19:09:11.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.967+0000 7f3a44ffc640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a4006ab00 con 0x7f3a40160020 2023-06-10T19:09:11.974 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.967+0000 7f3a44ffc640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4006ade0 con 0x7f3a4015fc50 2023-06-10T19:09:11.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.967+0000 7f3a3dd9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3a40160020 0x7f3a400afd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:11.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.967+0000 7f3a3dd9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3a40160020 0x7f3a400afd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57140/0 (socket says 172.21.15.53:57140) 2023-06-10T19:09:11.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.967+0000 7f3a3dd9b640 1 -- 172.21.15.53:0/1769877663 learned_addr learned my addr 172.21.15.53:0/1769877663 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:09:11.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.967+0000 7f3a3e59c640 1 --2- 172.21.15.53:0/1769877663 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3a4015fc50 0x7f3a400af7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:11.975 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.967+0000 7f3a3dd9b640 1 -- 172.21.15.53:0/1769877663 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3a4015fc50 msgr2=0x7f3a400af7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:09:11.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.967+0000 7f3a3dd9b640 1 --2- 172.21.15.53:0/1769877663 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3a4015fc50 0x7f3a400af7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:11.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.967+0000 7f3a3dd9b640 1 -- 172.21.15.53:0/1769877663 >> v1:172.21.15.53:6789/0 conn(0x7f3a400cd010 legacy=0x7f3a400cd450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:11.976 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.967+0000 7f3a3dd9b640 1 -- 172.21.15.53:0/1769877663 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a4006b0c0 con 0x7f3a40160020 2023-06-10T19:09:11.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.971+0000 7f3a3dd9b640 1 --2- 172.21.15.53:0/1769877663 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a40160020 0x7f3a400afd10 secure :-1 s=READY pgs=2760 cs=0 l=1 rev1=1 crypto rx=0x7f3a28009870 tx=0x7f3a2801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d56f3f039f7573d server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:11.977 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.971+0000 7f3a3d59a640 1 -- 172.21.15.53:0/1769877663 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a280ab660 con 0x7f3a40160020 2023-06-10T19:09:11.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.971+0000 7f3a3d59a640 1 -- 172.21.15.53:0/1769877663 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a280ab7c0 con 0x7f3a40160020 2023-06-10T19:09:11.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.971+0000 7f3a3d59a640 1 -- 172.21.15.53:0/1769877663 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a280abb50 con 0x7f3a40160020 2023-06-10T19:09:11.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.971+0000 7f3a44ffc640 1 -- 172.21.15.53:0/1769877663 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a40160020 msgr2=0x7f3a400afd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:11.978 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.971+0000 7f3a44ffc640 1 --2- 172.21.15.53:0/1769877663 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a40160020 0x7f3a400afd10 secure :-1 s=READY pgs=2760 cs=0 l=1 rev1=1 crypto rx=0x7f3a28009870 tx=0x7f3a2801c540 comp rx=0 tx=0).stop 2023-06-10T19:09:11.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.971+0000 7f3a44ffc640 1 -- 172.21.15.53:0/1769877663 shutdown_connections 2023-06-10T19:09:11.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.971+0000 7f3a44ffc640 1 --2- 172.21.15.53:0/1769877663 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a40160020 0x7f3a400afd10 unknown :-1 s=CLOSED pgs=2760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:11.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.971+0000 7f3a44ffc640 1 --2- 172.21.15.53:0/1769877663 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3a4015fc50 0x7f3a400af7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:11.979 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.971+0000 7f3a44ffc640 1 -- 172.21.15.53:0/1769877663 >> 172.21.15.53:0/1769877663 conn(0x7f3a400ce9e0 msgr2=0x7f3a400ca7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:09:11.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.971+0000 7f3a44ffc640 1 -- 172.21.15.53:0/1769877663 shutdown_connections 2023-06-10T19:09:11.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.971+0000 7f3a44ffc640 1 -- 172.21.15.53:0/1769877663 wait complete. 2023-06-10T19:09:11.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.971+0000 7f3a44ffc640 1 Processor -- start 2023-06-10T19:09:11.980 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.971+0000 7f3a44ffc640 1 -- start start 2023-06-10T19:09:11.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.971+0000 7f3a44ffc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a400cd010 0x7f3a40145150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:11.982 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.971+0000 7f3a44ffc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a4015fc50 0x7f3a400ad770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:11.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.971+0000 7f3a44ffc640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3a40160020 0x7f3a400b22c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:11.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.971+0000 7f3a44ffc640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a40156bc0 con 0x7f3a400cd010 2023-06-10T19:09:11.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.971+0000 7f3a44ffc640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a40157ec0 con 0x7f3a4015fc50 2023-06-10T19:09:11.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.971+0000 7f3a44ffc640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a40145690 con 0x7f3a40160020 2023-06-10T19:09:11.983 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.971+0000 7f3a3e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a400cd010 0x7f3a40145150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:11.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.971+0000 7f3a3e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a400cd010 0x7f3a40145150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57156/0 (socket says 172.21.15.53:57156) 2023-06-10T19:09:11.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.971+0000 7f3a3e59c640 1 -- 172.21.15.53:0/18214431 learned_addr learned my addr 172.21.15.53:0/18214431 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:09:11.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.971+0000 7f3a3ed9d640 1 --2- 172.21.15.53:0/18214431 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3a40160020 0x7f3a400b22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:11.984 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.971+0000 7f3a3dd9b640 1 --2- 172.21.15.53:0/18214431 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a4015fc50 0x7f3a400ad770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:11.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.971+0000 7f3a3e59c640 1 -- 172.21.15.53:0/18214431 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3a40160020 msgr2=0x7f3a400b22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:11.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.971+0000 7f3a3e59c640 1 --2- 172.21.15.53:0/18214431 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3a40160020 0x7f3a400b22c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:11.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.971+0000 7f3a3e59c640 1 -- 172.21.15.53:0/18214431 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a4015fc50 msgr2=0x7f3a400ad770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:11.985 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.971+0000 7f3a3e59c640 1 --2- 172.21.15.53:0/18214431 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a4015fc50 0x7f3a400ad770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:11.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.971+0000 7f3a3e59c640 1 -- 172.21.15.53:0/18214431 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a280094d0 con 0x7f3a400cd010 2023-06-10T19:09:11.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.975+0000 7f3a3e59c640 1 --2- 172.21.15.53:0/18214431 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a400cd010 0x7f3a40145150 secure :-1 s=READY pgs=2761 cs=0 l=1 rev1=1 crypto rx=0x7f3a38009fc0 tx=0x7f3a3800e570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:11.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.975+0000 7f3a36ffd640 1 -- 172.21.15.53:0/18214431 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a38014620 con 0x7f3a400cd010 2023-06-10T19:09:11.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.975+0000 7f3a36ffd640 1 -- 172.21.15.53:0/18214431 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a38014780 con 0x7f3a400cd010 2023-06-10T19:09:11.986 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.975+0000 7f3a44ffc640 1 -- 172.21.15.53:0/18214431 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a400c4260 con 0x7f3a400cd010 2023-06-10T19:09:11.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.975+0000 7f3a36ffd640 1 -- 172.21.15.53:0/18214431 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a38014b30 con 0x7f3a400cd010 2023-06-10T19:09:11.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.975+0000 7f3a44ffc640 1 -- 172.21.15.53:0/18214431 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a401567e0 con 0x7f3a400cd010 2023-06-10T19:09:11.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.975+0000 7f3a44ffc640 1 -- 172.21.15.53:0/18214431 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a400c4780 con 0x7f3a400cd010 2023-06-10T19:09:11.987 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.975+0000 7f3a36ffd640 1 -- 172.21.15.53:0/18214431 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3a38006d50 con 0x7f3a400cd010 2023-06-10T19:09:11.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.975+0000 7f3a36ffd640 1 --2- 172.21.15.53:0/18214431 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3a200662b0 0x7f3a20068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:11.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.975+0000 7f3a36ffd640 1 -- 172.21.15.53:0/18214431 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f3a38084230 con 0x7f3a400cd010 2023-06-10T19:09:11.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.975+0000 7f3a3dd9b640 1 --2- 172.21.15.53:0/18214431 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3a200662b0 0x7f3a20068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:11.988 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.975+0000 7f3a3dd9b640 1 --2- 172.21.15.53:0/18214431 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3a200662b0 0x7f3a20068760 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f3a280af000 tx=0x7f3a280a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:11.989 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:11.979+0000 7f3a36ffd640 1 -- 172.21.15.53:0/18214431 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3a400c4780 con 0x7f3a400cd010 2023-06-10T19:09:12.131 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.127+0000 7f3a44ffc640 1 -- 172.21.15.53:0/18214431 --> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f3a40156660 con 0x7f3a200662b0 2023-06-10T19:09:12.132 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.127+0000 7f3a36ffd640 1 -- 172.21.15.53:0/18214431 <== mgr.4105 v2:172.21.15.117:6832/3061986771 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3a280ab930 con 0x7f3a200662b0 2023-06-10T19:09:12.132 INFO:teuthology.orchestra.run.smithi053.stderr:instructed osd(s) 2 to deep-scrub 2023-06-10T19:09:12.134 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.127+0000 7f3a44ffc640 1 -- 172.21.15.53:0/18214431 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3a200662b0 msgr2=0x7f3a20068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:12.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.127+0000 7f3a44ffc640 1 --2- 172.21.15.53:0/18214431 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3a200662b0 0x7f3a20068760 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f3a280af000 tx=0x7f3a280a7000 comp rx=0 tx=0).stop 2023-06-10T19:09:12.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.127+0000 7f3a44ffc640 1 -- 172.21.15.53:0/18214431 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a400cd010 msgr2=0x7f3a40145150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:12.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.127+0000 7f3a44ffc640 1 --2- 172.21.15.53:0/18214431 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a400cd010 0x7f3a40145150 secure :-1 s=READY pgs=2761 cs=0 l=1 rev1=1 crypto rx=0x7f3a38009fc0 tx=0x7f3a3800e570 comp rx=0 tx=0).stop 2023-06-10T19:09:12.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.127+0000 7f3a44ffc640 1 -- 172.21.15.53:0/18214431 shutdown_connections 2023-06-10T19:09:12.135 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.127+0000 7f3a44ffc640 1 --2- 172.21.15.53:0/18214431 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3a200662b0 0x7f3a20068760 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:12.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.127+0000 7f3a44ffc640 1 --2- 172.21.15.53:0/18214431 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3a40160020 0x7f3a400b22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:12.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.127+0000 7f3a44ffc640 1 --2- 172.21.15.53:0/18214431 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a4015fc50 0x7f3a400ad770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:12.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.127+0000 7f3a44ffc640 1 --2- 172.21.15.53:0/18214431 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3a400cd010 0x7f3a40145150 unknown :-1 s=CLOSED pgs=2761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:12.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.127+0000 7f3a44ffc640 1 -- 172.21.15.53:0/18214431 >> 172.21.15.53:0/18214431 conn(0x7f3a400ce9e0 msgr2=0x7f3a4015bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:09:12.136 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.127+0000 7f3a44ffc640 1 -- 172.21.15.53:0/18214431 shutdown_connections 2023-06-10T19:09:12.137 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.127+0000 7f3a44ffc640 1 -- 172.21.15.53:0/18214431 wait complete. 2023-06-10T19:09:12.150 INFO:tasks.ceph:Scrubbing osd.3 2023-06-10T19:09:12.151 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-06-10T19:09:12.280 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.275+0000 7f3f24824640 1 Processor -- start 2023-06-10T19:09:12.281 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.275+0000 7f3f24824640 1 -- start start 2023-06-10T19:09:12.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.275+0000 7f3f24824640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3f200ca220 0x7f3f200af830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:12.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.275+0000 7f3f24824640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3f200afd70 0x7f3f200c8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:12.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.275+0000 7f3f24824640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f20159d10 con 0x7f3f20159940 2023-06-10T19:09:12.282 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.275+0000 7f3f24824640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f2006b100 con 0x7f3f200afd70 2023-06-10T19:09:12.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.275+0000 7f3f24824640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2006bc80 con 0x7f3f200ca220 2023-06-10T19:09:12.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.275+0000 7f3f1ed9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3f200afd70 0x7f3f200c8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:12.283 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.275+0000 7f3f1ed9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3f200afd70 0x7f3f200c8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57170/0 (socket says 172.21.15.53:57170) 2023-06-10T19:09:12.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.275+0000 7f3f1ed9d640 1 -- 172.21.15.53:0/2525766677 learned_addr learned my addr 172.21.15.53:0/2525766677 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:09:12.284 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.275+0000 7f3f1dd9b640 1 --2- 172.21.15.53:0/2525766677 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3f200ca220 0x7f3f200af830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:12.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.275+0000 7f3f1ed9d640 1 -- 172.21.15.53:0/2525766677 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3f200ca220 msgr2=0x7f3f200af830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:09:12.286 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.275+0000 7f3f1ed9d640 1 --2- 172.21.15.53:0/2525766677 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3f200ca220 0x7f3f200af830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:12.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.275+0000 7f3f1ed9d640 1 -- 172.21.15.53:0/2525766677 >> v1:172.21.15.117:6789/0 conn(0x7f3f20159940 legacy=0x7f3f200c9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:12.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.275+0000 7f3f1ed9d640 1 -- 172.21.15.53:0/2525766677 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f2006c110 con 0x7f3f200afd70 2023-06-10T19:09:12.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.275+0000 7f3f1dd9b640 1 --2- 172.21.15.53:0/2525766677 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3f200ca220 0x7f3f200af830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:09:12.287 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.279+0000 7f3f1ed9d640 1 --2- 172.21.15.53:0/2525766677 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f200afd70 0x7f3f200c8400 secure :-1 s=READY pgs=2762 cs=0 l=1 rev1=1 crypto rx=0x7f3f18009e50 tx=0x7f3f1801c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8d874893236d70b server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:12.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.279+0000 7f3f1d59a640 1 -- 172.21.15.53:0/2525766677 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f180a5810 con 0x7f3f200afd70 2023-06-10T19:09:12.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.279+0000 7f3f1d59a640 1 -- 172.21.15.53:0/2525766677 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f180a5970 con 0x7f3f200afd70 2023-06-10T19:09:12.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.279+0000 7f3f1d59a640 1 -- 172.21.15.53:0/2525766677 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f180a5d00 con 0x7f3f200afd70 2023-06-10T19:09:12.288 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.279+0000 7f3f24824640 1 -- 172.21.15.53:0/2525766677 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f200afd70 msgr2=0x7f3f200c8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:12.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.279+0000 7f3f24824640 1 --2- 172.21.15.53:0/2525766677 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f200afd70 0x7f3f200c8400 secure :-1 s=READY pgs=2762 cs=0 l=1 rev1=1 crypto rx=0x7f3f18009e50 tx=0x7f3f1801c950 comp rx=0 tx=0).stop 2023-06-10T19:09:12.289 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.279+0000 7f3f24824640 1 -- 172.21.15.53:0/2525766677 shutdown_connections 2023-06-10T19:09:12.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.279+0000 7f3f24824640 1 --2- 172.21.15.53:0/2525766677 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f200afd70 0x7f3f200c8400 unknown :-1 s=CLOSED pgs=2762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:12.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.279+0000 7f3f24824640 1 --2- 172.21.15.53:0/2525766677 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3f200ca220 0x7f3f200af830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:12.290 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.279+0000 7f3f24824640 1 -- 172.21.15.53:0/2525766677 >> 172.21.15.53:0/2525766677 conn(0x7f3f200ca830 msgr2=0x7f3f200cac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:09:12.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.279+0000 7f3f24824640 1 -- 172.21.15.53:0/2525766677 shutdown_connections 2023-06-10T19:09:12.291 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.279+0000 7f3f24824640 1 -- 172.21.15.53:0/2525766677 wait complete. 2023-06-10T19:09:12.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.283+0000 7f3f24824640 1 Processor -- start 2023-06-10T19:09:12.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.283+0000 7f3f24824640 1 -- start start 2023-06-10T19:09:12.297 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.283+0000 7f3f24824640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f200afd70 0x7f3f2015e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:12.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.283+0000 7f3f24824640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3f200ca220 0x7f3f20152b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:12.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.283+0000 7f3f24824640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f20159940 0x7f3f20155d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:12.298 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.283+0000 7f3f24824640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f200c6020 con 0x7f3f20159940 2023-06-10T19:09:12.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.283+0000 7f3f24824640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f200c6230 con 0x7f3f200afd70 2023-06-10T19:09:12.299 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.283+0000 7f3f24824640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f200c6510 con 0x7f3f200ca220 2023-06-10T19:09:12.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.283+0000 7f3f1ed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f20159940 0x7f3f20155d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:12.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.283+0000 7f3f1ed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f20159940 0x7f3f20155d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57180/0 (socket says 172.21.15.53:57180) 2023-06-10T19:09:12.300 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.283+0000 7f3f1ed9d640 1 -- 172.21.15.53:0/542997206 learned_addr learned my addr 172.21.15.53:0/542997206 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:09:12.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.283+0000 7f3f1dd9b640 1 --2- 172.21.15.53:0/542997206 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3f200ca220 0x7f3f20152b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:12.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.283+0000 7f3f1e59c640 1 --2- 172.21.15.53:0/542997206 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f200afd70 0x7f3f2015e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:12.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.283+0000 7f3f1ed9d640 1 -- 172.21.15.53:0/542997206 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3f200ca220 msgr2=0x7f3f20152b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:12.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.283+0000 7f3f1ed9d640 1 --2- 172.21.15.53:0/542997206 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3f200ca220 0x7f3f20152b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:12.301 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.283+0000 7f3f1ed9d640 1 -- 172.21.15.53:0/542997206 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f200afd70 msgr2=0x7f3f2015e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:12.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.283+0000 7f3f1ed9d640 1 --2- 172.21.15.53:0/542997206 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f200afd70 0x7f3f2015e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:12.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.283+0000 7f3f1ed9d640 1 -- 172.21.15.53:0/542997206 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f18009b30 con 0x7f3f20159940 2023-06-10T19:09:12.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.283+0000 7f3f1dd9b640 1 --2- 172.21.15.53:0/542997206 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3f200ca220 0x7f3f20152b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:09:12.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.283+0000 7f3f1ed9d640 1 --2- 172.21.15.53:0/542997206 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f20159940 0x7f3f20155d50 secure :-1 s=READY pgs=2763 cs=0 l=1 rev1=1 crypto rx=0x7f3f180af040 tx=0x7f3f180196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:12.302 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.283+0000 7f3f0effd640 1 -- 172.21.15.53:0/542997206 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f180b8670 con 0x7f3f20159940 2023-06-10T19:09:12.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.283+0000 7f3f0effd640 1 -- 172.21.15.53:0/542997206 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f180b87d0 con 0x7f3f20159940 2023-06-10T19:09:12.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.283+0000 7f3f24824640 1 -- 172.21.15.53:0/542997206 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f200c67f0 con 0x7f3f20159940 2023-06-10T19:09:12.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.283+0000 7f3f0effd640 1 -- 172.21.15.53:0/542997206 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f180b8b60 con 0x7f3f20159940 2023-06-10T19:09:12.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.283+0000 7f3f24824640 1 -- 172.21.15.53:0/542997206 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f200c6db0 con 0x7f3f20159940 2023-06-10T19:09:12.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.283+0000 7f3f24824640 1 -- 172.21.15.53:0/542997206 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3f200b01f0 con 0x7f3f20159940 2023-06-10T19:09:12.303 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.287+0000 7f3f0effd640 1 -- 172.21.15.53:0/542997206 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3f180b8cc0 con 0x7f3f20159940 2023-06-10T19:09:12.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.287+0000 7f3f0effd640 1 --2- 172.21.15.53:0/542997206 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3f000662b0 0x7f3f00068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:12.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.287+0000 7f3f0effd640 1 -- 172.21.15.53:0/542997206 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f3f1811f850 con 0x7f3f20159940 2023-06-10T19:09:12.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.287+0000 7f3f0effd640 1 --2- 172.21.15.53:0/542997206 >> [v2:172.21.15.53:6824/1444622980,v1:172.21.15.53:6825/1444622980] conn(0x7f3f0006c770 0x7f3f0006eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:12.304 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.287+0000 7f3f0effd640 1 -- 172.21.15.53:0/542997206 --> [v2:172.21.15.53:6824/1444622980,v1:172.21.15.53:6825/1444622980] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3f0006f230 con 0x7f3f0006c770 2023-06-10T19:09:12.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.287+0000 7f3f0effd640 1 -- 172.21.15.53:0/542997206 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=186) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3f1811fca0 con 0x7f3f20159940 2023-06-10T19:09:12.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.287+0000 7f3f1e59c640 1 --2- 172.21.15.53:0/542997206 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3f000662b0 0x7f3f00068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:12.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.287+0000 7f3f1dd9b640 1 --2- 172.21.15.53:0/542997206 >> [v2:172.21.15.53:6824/1444622980,v1:172.21.15.53:6825/1444622980] conn(0x7f3f0006c770 0x7f3f0006eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:12.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.287+0000 7f3f1dd9b640 1 --2- 172.21.15.53:0/542997206 >> [v2:172.21.15.53:6824/1444622980,v1:172.21.15.53:6825/1444622980] conn(0x7f3f0006c770 0x7f3f0006eb80 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:12.305 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.287+0000 7f3f1e59c640 1 --2- 172.21.15.53:0/542997206 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3f000662b0 0x7f3f00068760 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f3f14007fd0 tx=0x7f3f14009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:12.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.287+0000 7f3f0effd640 1 -- 172.21.15.53:0/542997206 <== osd.3 v2:172.21.15.53:6824/1444622980 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f3f0006f230 con 0x7f3f0006c770 2023-06-10T19:09:12.306 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.299+0000 7f3f24824640 1 -- 172.21.15.53:0/542997206 --> [v2:172.21.15.53:6824/1444622980,v1:172.21.15.53:6825/1444622980] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f3f2006b910 con 0x7f3f0006c770 2023-06-10T19:09:12.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.299+0000 7f3f0effd640 1 -- 172.21.15.53:0/542997206 <== osd.3 v2:172.21.15.53:6824/1444622980 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f3f10009aa0 con 0x7f3f0006c770 2023-06-10T19:09:12.307 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-06-10T19:09:12.307 INFO:teuthology.orchestra.run.smithi053.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-06-10T19:09:12.308 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-06-10T19:09:12.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.299+0000 7f3f24824640 1 -- 172.21.15.53:0/542997206 >> [v2:172.21.15.53:6824/1444622980,v1:172.21.15.53:6825/1444622980] conn(0x7f3f0006c770 msgr2=0x7f3f0006eb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:12.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.299+0000 7f3f24824640 1 --2- 172.21.15.53:0/542997206 >> [v2:172.21.15.53:6824/1444622980,v1:172.21.15.53:6825/1444622980] conn(0x7f3f0006c770 0x7f3f0006eb80 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:12.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.299+0000 7f3f24824640 1 -- 172.21.15.53:0/542997206 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3f000662b0 msgr2=0x7f3f00068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:12.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.299+0000 7f3f24824640 1 --2- 172.21.15.53:0/542997206 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f3f000662b0 0x7f3f00068760 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f3f14007fd0 tx=0x7f3f14009040 comp rx=0 tx=0).stop 2023-06-10T19:09:12.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.299+0000 7f3f24824640 1 -- 172.21.15.53:0/542997206 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f20159940 msgr2=0x7f3f20155d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:12.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.299+0000 7f3f24824640 1 --2- 172.21.15.53:0/542997206 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f20159940 0x7f3f20155d50 secure :-1 s=READY pgs=2763 cs=0 l=1 rev1=1 crypto rx=0x7f3f180af040 tx=0x7f3f180196f0 comp rx=0 tx=0).stop 2023-06-10T19:09:12.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.299+0000 7f3f1ed9d640 1 -- 172.21.15.53:0/542997206 reap_dead start 2023-06-10T19:09:12.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.299+0000 7f3f24824640 1 -- 172.21.15.53:0/542997206 shutdown_connections 2023-06-10T19:09:12.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.299+0000 7f3f24824640 1 -- 172.21.15.53:0/542997206 >> 172.21.15.53:0/542997206 conn(0x7f3f200ca830 msgr2=0x7f3f2015a630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:09:12.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.299+0000 7f3f24824640 1 -- 172.21.15.53:0/542997206 shutdown_connections 2023-06-10T19:09:12.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.299+0000 7f3f24824640 1 -- 172.21.15.53:0/542997206 wait complete. 2023-06-10T19:09:12.322 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-06-10T19:09:12.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.431+0000 7fd91f9d2640 1 Processor -- start 2023-06-10T19:09:12.437 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.431+0000 7fd91f9d2640 1 -- start start 2023-06-10T19:09:12.438 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.431+0000 7fd91f9d2640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd9181571a0 0x7fd9180c9f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:12.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.431+0000 7fd91f9d2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd918070100 0x7fd9180af7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:12.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.431+0000 7fd91f9d2640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd918071190 con 0x7fd9180afd10 2023-06-10T19:09:12.439 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.431+0000 7fd91f9d2640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9180b0180 con 0x7fd9181571a0 2023-06-10T19:09:12.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.431+0000 7fd91f9d2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9180ca440 con 0x7fd918070100 2023-06-10T19:09:12.440 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.431+0000 7fd91cf6d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd918070100 0x7fd9180af7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:12.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.431+0000 7fd91cf6d640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd918070100 0x7fd9180af7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.53:51790/0 (socket says 172.21.15.53:51790) 2023-06-10T19:09:12.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.431+0000 7fd91cf6d640 1 -- 172.21.15.53:0/2268826339 learned_addr learned my addr 172.21.15.53:0/2268826339 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:09:12.441 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.431+0000 7fd91d76e640 1 --2- 172.21.15.53:0/2268826339 >> v2:172.21.15.117:3300/0 conn(0x7fd9181571a0 0x7fd9180c9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:12.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.435+0000 7fd91cf6d640 1 -- 172.21.15.53:0/2268826339 >> v2:172.21.15.117:3300/0 conn(0x7fd9181571a0 msgr2=0x7fd9180c9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:09:12.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.435+0000 7fd91cf6d640 1 --2- 172.21.15.53:0/2268826339 >> v2:172.21.15.117:3300/0 conn(0x7fd9181571a0 0x7fd9180c9f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:12.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.435+0000 7fd91cf6d640 1 -- 172.21.15.53:0/2268826339 >> v1:172.21.15.117:6789/0 conn(0x7fd9180afd10 legacy=0x7fd91815d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:12.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.435+0000 7fd91cf6d640 1 -- 172.21.15.53:0/2268826339 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd918070580 con 0x7fd918070100 2023-06-10T19:09:12.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.435+0000 7fd91cf6d640 1 --2- 172.21.15.53:0/2268826339 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd918070100 0x7fd9180af7d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd908009870 tx=0x7fd90801c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=768b7a3923de4151 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:12.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.435+0000 7fd90ffff640 1 -- 172.21.15.53:0/2268826339 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9080aa670 con 0x7fd918070100 2023-06-10T19:09:12.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.435+0000 7fd90ffff640 1 -- 172.21.15.53:0/2268826339 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9080aa7d0 con 0x7fd918070100 2023-06-10T19:09:12.444 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.435+0000 7fd90ffff640 1 -- 172.21.15.53:0/2268826339 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9080aab60 con 0x7fd918070100 2023-06-10T19:09:12.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.435+0000 7fd91f9d2640 1 -- 172.21.15.53:0/2268826339 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd918070100 msgr2=0x7fd9180af7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:12.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.435+0000 7fd91f9d2640 1 --2- 172.21.15.53:0/2268826339 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd918070100 0x7fd9180af7d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd908009870 tx=0x7fd90801c510 comp rx=0 tx=0).stop 2023-06-10T19:09:12.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.435+0000 7fd91f9d2640 1 -- 172.21.15.53:0/2268826339 shutdown_connections 2023-06-10T19:09:12.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.439+0000 7fd91f9d2640 1 --2- 172.21.15.53:0/2268826339 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd918070100 0x7fd9180af7d0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:12.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.439+0000 7fd91f9d2640 1 --2- 172.21.15.53:0/2268826339 >> v2:172.21.15.117:3300/0 conn(0x7fd9181571a0 0x7fd9180c9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:12.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.439+0000 7fd91f9d2640 1 -- 172.21.15.53:0/2268826339 >> 172.21.15.53:0/2268826339 conn(0x7fd9180ce9e0 msgr2=0x7fd9180ca7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:09:12.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.439+0000 7fd91f9d2640 1 -- 172.21.15.53:0/2268826339 shutdown_connections 2023-06-10T19:09:12.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.439+0000 7fd91f9d2640 1 -- 172.21.15.53:0/2268826339 wait complete. 2023-06-10T19:09:12.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.439+0000 7fd91f9d2640 1 Processor -- start 2023-06-10T19:09:12.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.439+0000 7fd91f9d2640 1 -- start start 2023-06-10T19:09:12.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.439+0000 7fd91f9d2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9180afd10 0x7fd91806c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:12.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.439+0000 7fd91f9d2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd9181571a0 0x7fd9180c74a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:12.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.439+0000 7fd91f9d2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd91814e250 0x7fd918155190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:12.449 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.439+0000 7fd91f9d2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9180c7010 con 0x7fd9180afd10 2023-06-10T19:09:12.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.439+0000 7fd91f9d2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9180c6400 con 0x7fd9181571a0 2023-06-10T19:09:12.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.439+0000 7fd91f9d2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9180c66e0 con 0x7fd91814e250 2023-06-10T19:09:12.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.439+0000 7fd91d76e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9180afd10 0x7fd91806c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:12.450 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.439+0000 7fd91d76e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9180afd10 0x7fd91806c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57192/0 (socket says 172.21.15.53:57192) 2023-06-10T19:09:12.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.439+0000 7fd91d76e640 1 -- 172.21.15.53:0/705704920 learned_addr learned my addr 172.21.15.53:0/705704920 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:09:12.451 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.439+0000 7fd91df6f640 1 --2- 172.21.15.53:0/705704920 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd91814e250 0x7fd918155190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:12.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.439+0000 7fd91cf6d640 1 --2- 172.21.15.53:0/705704920 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd9181571a0 0x7fd9180c74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:12.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.439+0000 7fd91d76e640 1 -- 172.21.15.53:0/705704920 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd91814e250 msgr2=0x7fd918155190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:12.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.439+0000 7fd91d76e640 1 --2- 172.21.15.53:0/705704920 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd91814e250 0x7fd918155190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:12.452 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.439+0000 7fd91d76e640 1 -- 172.21.15.53:0/705704920 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd9181571a0 msgr2=0x7fd9180c74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:12.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.439+0000 7fd91d76e640 1 --2- 172.21.15.53:0/705704920 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd9181571a0 0x7fd9180c74a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:12.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.439+0000 7fd91d76e640 1 -- 172.21.15.53:0/705704920 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9080094d0 con 0x7fd9180afd10 2023-06-10T19:09:12.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.439+0000 7fd91cf6d640 1 --2- 172.21.15.53:0/705704920 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd9181571a0 0x7fd9180c74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:09:12.453 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.439+0000 7fd91d76e640 1 --2- 172.21.15.53:0/705704920 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9180afd10 0x7fd91806c340 secure :-1 s=READY pgs=2764 cs=0 l=1 rev1=1 crypto rx=0x7fd91400e870 tx=0x7fd91400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:12.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.439+0000 7fd90dffb640 1 -- 172.21.15.53:0/705704920 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9140095d0 con 0x7fd9180afd10 2023-06-10T19:09:12.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.439+0000 7fd90dffb640 1 -- 172.21.15.53:0/705704920 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd91400c940 con 0x7fd9180afd10 2023-06-10T19:09:12.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.439+0000 7fd91f9d2640 1 -- 172.21.15.53:0/705704920 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9180c69c0 con 0x7fd9180afd10 2023-06-10T19:09:12.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.439+0000 7fd90dffb640 1 -- 172.21.15.53:0/705704920 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd91400ccb0 con 0x7fd9180afd10 2023-06-10T19:09:12.454 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.439+0000 7fd91f9d2640 1 -- 172.21.15.53:0/705704920 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd91806c880 con 0x7fd9180afd10 2023-06-10T19:09:12.455 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.443+0000 7fd91f9d2640 1 -- 172.21.15.53:0/705704920 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd91804d790 con 0x7fd9180afd10 2023-06-10T19:09:12.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.443+0000 7fd90dffb640 1 -- 172.21.15.53:0/705704920 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd914013470 con 0x7fd9180afd10 2023-06-10T19:09:12.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.443+0000 7fd90dffb640 1 --2- 172.21.15.53:0/705704920 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd8fc0662b0 0x7fd8fc068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:12.456 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.443+0000 7fd90dffb640 1 -- 172.21.15.53:0/705704920 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fd914083f20 con 0x7fd9180afd10 2023-06-10T19:09:12.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.443+0000 7fd91cf6d640 1 --2- 172.21.15.53:0/705704920 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd8fc0662b0 0x7fd8fc068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:12.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.443+0000 7fd91cf6d640 1 --2- 172.21.15.53:0/705704920 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd8fc0662b0 0x7fd8fc068760 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7fd9080ae000 tx=0x7fd9080a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:12.457 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.447+0000 7fd90dffb640 1 -- 172.21.15.53:0/705704920 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd914055270 con 0x7fd9180afd10 2023-06-10T19:09:12.605 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.599+0000 7fd91f9d2640 1 -- 172.21.15.53:0/705704920 --> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fd918157570 con 0x7fd8fc0662b0 2023-06-10T19:09:12.606 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.599+0000 7fd90dffb640 1 -- 172.21.15.53:0/705704920 <== mgr.4105 v2:172.21.15.117:6832/3061986771 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd9080aa940 con 0x7fd8fc0662b0 2023-06-10T19:09:12.606 INFO:teuthology.orchestra.run.smithi053.stderr:instructed osd(s) 3 to deep-scrub 2023-06-10T19:09:12.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.603+0000 7fd91f9d2640 1 -- 172.21.15.53:0/705704920 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd8fc0662b0 msgr2=0x7fd8fc068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:12.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.603+0000 7fd91f9d2640 1 --2- 172.21.15.53:0/705704920 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd8fc0662b0 0x7fd8fc068760 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7fd9080ae000 tx=0x7fd9080a7000 comp rx=0 tx=0).stop 2023-06-10T19:09:12.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.603+0000 7fd91f9d2640 1 -- 172.21.15.53:0/705704920 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9180afd10 msgr2=0x7fd91806c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:12.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.603+0000 7fd91f9d2640 1 --2- 172.21.15.53:0/705704920 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9180afd10 0x7fd91806c340 secure :-1 s=READY pgs=2764 cs=0 l=1 rev1=1 crypto rx=0x7fd91400e870 tx=0x7fd91400ed30 comp rx=0 tx=0).stop 2023-06-10T19:09:12.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.603+0000 7fd91f9d2640 1 -- 172.21.15.53:0/705704920 shutdown_connections 2023-06-10T19:09:12.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.603+0000 7fd91f9d2640 1 --2- 172.21.15.53:0/705704920 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fd8fc0662b0 0x7fd8fc068760 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:12.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.603+0000 7fd91f9d2640 1 --2- 172.21.15.53:0/705704920 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd91814e250 0x7fd918155190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:12.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.603+0000 7fd91f9d2640 1 --2- 172.21.15.53:0/705704920 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd9181571a0 0x7fd9180c74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:12.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.603+0000 7fd91f9d2640 1 --2- 172.21.15.53:0/705704920 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd9180afd10 0x7fd91806c340 unknown :-1 s=CLOSED pgs=2764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:12.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.603+0000 7fd91f9d2640 1 -- 172.21.15.53:0/705704920 >> 172.21.15.53:0/705704920 conn(0x7fd9180ce9e0 msgr2=0x7fd91815cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:09:12.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.603+0000 7fd91f9d2640 1 -- 172.21.15.53:0/705704920 shutdown_connections 2023-06-10T19:09:12.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.603+0000 7fd91f9d2640 1 -- 172.21.15.53:0/705704920 wait complete. 2023-06-10T19:09:12.626 INFO:tasks.ceph:Scrubbing osd.4 2023-06-10T19:09:12.627 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-06-10T19:09:12.752 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.747+0000 7f4a191ce640 1 Processor -- start 2023-06-10T19:09:12.753 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.747+0000 7f4a191ce640 1 -- start start 2023-06-10T19:09:12.755 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.747+0000 7f4a191ce640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4a1414f670 0x7f4a140cb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:12.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.747+0000 7f4a191ce640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a140b2c80 con 0x7f4a140cb5c0 2023-06-10T19:09:12.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.747+0000 7f4a191ce640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a1414fa40 con 0x7f4a140b1130 2023-06-10T19:09:12.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.747+0000 7f4a191ce640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a14070120 con 0x7f4a1414f670 2023-06-10T19:09:12.756 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.747+0000 7f4a1259c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f4a140cb5c0 0x7f4a140b0a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:49624/0 (socket says 172.21.15.53:49624) 2023-06-10T19:09:12.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.747+0000 7f4a1259c640 1 -- 172.21.15.53:0/1822298793 learned_addr learned my addr 172.21.15.53:0/1822298793 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:09:12.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.747+0000 7f4a12d9d640 1 --2- 172.21.15.53:0/1822298793 >> v2:172.21.15.117:3300/0 conn(0x7f4a1414f670 0x7f4a140cb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:12.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.747+0000 7f4a11d9b640 1 -- 172.21.15.53:0/1822298793 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1774024175 0 0) 0x7f4a140b2c80 con 0x7f4a140cb5c0 2023-06-10T19:09:12.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.747+0000 7f4a11d9b640 1 -- 172.21.15.53:0/1822298793 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49f4003530 con 0x7f4a140cb5c0 2023-06-10T19:09:12.757 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.747+0000 7f4a11d9b640 1 -- 172.21.15.53:0/1822298793 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1390174176 0 0) 0x7f49f4003530 con 0x7f4a140cb5c0 2023-06-10T19:09:12.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.747+0000 7f4a11d9b640 1 -- 172.21.15.53:0/1822298793 >> v2:172.21.15.117:3300/0 conn(0x7f4a1414f670 msgr2=0x7f4a140cb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:09:12.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.747+0000 7f4a11d9b640 1 --2- 172.21.15.53:0/1822298793 >> v2:172.21.15.117:3300/0 conn(0x7f4a1414f670 0x7f4a140cb080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:12.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.747+0000 7f4a11d9b640 1 -- 172.21.15.53:0/1822298793 >> v1:172.21.15.117:6789/0 conn(0x7f4a140b1130 legacy=0x7f4a140cec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:12.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.747+0000 7f4a11d9b640 1 -- 172.21.15.53:0/1822298793 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a140b1d90 con 0x7f4a140cb5c0 2023-06-10T19:09:12.758 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.747+0000 7f4a11d9b640 1 -- 172.21.15.53:0/1822298793 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f4a0c001b80 con 0x7f4a140cb5c0 2023-06-10T19:09:12.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.747+0000 7f4a11d9b640 1 -- 172.21.15.53:0/1822298793 >> v1:172.21.15.53:6789/0 conn(0x7f4a140cb5c0 legacy=0x7f4a140b0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:12.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.747+0000 7f4a11d9b640 1 --2- 172.21.15.53:0/1822298793 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49f4003980 0x7f49f4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:12.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.747+0000 7f4a11d9b640 1 --2- 172.21.15.53:0/1822298793 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f49f40047d0 0x7f49f4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:12.759 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.747+0000 7f4a11d9b640 1 --2- 172.21.15.53:0/1822298793 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49f4005180 0x7f49f400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:12.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.747+0000 7f4a11d9b640 1 -- 172.21.15.53:0/1822298793 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f400bfd0 con 0x7f49f40047d0 2023-06-10T19:09:12.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.747+0000 7f4a11d9b640 1 -- 172.21.15.53:0/1822298793 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f400c140 con 0x7f49f4003980 2023-06-10T19:09:12.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.747+0000 7f4a11d9b640 1 -- 172.21.15.53:0/1822298793 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49f400c300 con 0x7f49f4005180 2023-06-10T19:09:12.760 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.747+0000 7f4a1259c640 1 --2- 172.21.15.53:0/1822298793 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f49f40047d0 0x7f49f4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:12.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.747+0000 7f4a12d9d640 1 --2- 172.21.15.53:0/1822298793 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49f4003980 0x7f49f4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:12.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.747+0000 7f4a1359e640 1 --2- 172.21.15.53:0/1822298793 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49f4005180 0x7f49f400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:12.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.747+0000 7f4a1259c640 1 -- 172.21.15.53:0/1822298793 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49f4005180 msgr2=0x7f49f400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:09:12.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.747+0000 7f4a1259c640 1 --2- 172.21.15.53:0/1822298793 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f49f4005180 0x7f49f400b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:12.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.747+0000 7f4a1259c640 1 -- 172.21.15.53:0/1822298793 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49f4003980 msgr2=0x7f49f4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:09:12.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.747+0000 7f4a1259c640 1 --2- 172.21.15.53:0/1822298793 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49f4003980 0x7f49f4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:12.762 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.747+0000 7f4a1259c640 1 -- 172.21.15.53:0/1822298793 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49f4003530 con 0x7f49f40047d0 2023-06-10T19:09:12.763 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.747+0000 7f4a1359e640 1 -- 172.21.15.53:0/1822298793 reap_dead start 2023-06-10T19:09:12.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.751+0000 7f4a1259c640 1 --2- 172.21.15.53:0/1822298793 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f49f40047d0 0x7f49f4004c40 secure :-1 s=READY pgs=2766 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c00c100 tx=0x7f4a0c021930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a5936090470f8c0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:12.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.751+0000 7f4a11d9b640 1 -- 172.21.15.53:0/1822298793 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a0c005d30 con 0x7f49f40047d0 2023-06-10T19:09:12.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.751+0000 7f4a11d9b640 1 -- 172.21.15.53:0/1822298793 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a0c0ac040 con 0x7f49f40047d0 2023-06-10T19:09:12.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.751+0000 7f4a11d9b640 1 -- 172.21.15.53:0/1822298793 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a0c007290 con 0x7f49f40047d0 2023-06-10T19:09:12.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.751+0000 7f4a191ce640 1 -- 172.21.15.53:0/1822298793 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f49f40047d0 msgr2=0x7f49f4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:12.770 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.751+0000 7f4a191ce640 1 --2- 172.21.15.53:0/1822298793 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f49f40047d0 0x7f49f4004c40 secure :-1 s=READY pgs=2766 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c00c100 tx=0x7f4a0c021930 comp rx=0 tx=0).stop 2023-06-10T19:09:12.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.751+0000 7f4a191ce640 1 -- 172.21.15.53:0/1822298793 shutdown_connections 2023-06-10T19:09:12.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.751+0000 7f4a191ce640 1 --2- 172.21.15.53:0/1822298793 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f49f40047d0 0x7f49f4004c40 unknown :-1 s=CLOSED pgs=2766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:12.771 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.751+0000 7f4a191ce640 1 -- 172.21.15.53:0/1822298793 >> 172.21.15.53:0/1822298793 conn(0x7f4a140b42b0 msgr2=0x7f4a140b46b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:09:12.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.751+0000 7f4a191ce640 1 -- 172.21.15.53:0/1822298793 shutdown_connections 2023-06-10T19:09:12.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.751+0000 7f4a191ce640 1 -- 172.21.15.53:0/1822298793 wait complete. 2023-06-10T19:09:12.772 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.751+0000 7f4a191ce640 1 Processor -- start 2023-06-10T19:09:12.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.751+0000 7f4a191ce640 1 -- start start 2023-06-10T19:09:12.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.755+0000 7f4a191ce640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49f40047d0 0x7f4a14156740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:12.773 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.755+0000 7f4a191ce640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a141501f0 0x7f4a141f0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:12.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.755+0000 7f4a191ce640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a140c8110 0x7f4a141553d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:12.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.755+0000 7f4a191ce640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a140c8a10 con 0x7f4a140c8110 2023-06-10T19:09:12.774 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.755+0000 7f4a191ce640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a140c8cf0 con 0x7f49f40047d0 2023-06-10T19:09:12.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.755+0000 7f4a191ce640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a140c8fd0 con 0x7f4a141501f0 2023-06-10T19:09:12.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.755+0000 7f4a1359e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a140c8110 0x7f4a141553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:12.775 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.755+0000 7f4a1359e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a140c8110 0x7f4a141553d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57218/0 (socket says 172.21.15.53:57218) 2023-06-10T19:09:12.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.755+0000 7f4a1359e640 1 -- 172.21.15.53:0/2285635435 learned_addr learned my addr 172.21.15.53:0/2285635435 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:09:12.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.755+0000 7f4a1259c640 1 --2- 172.21.15.53:0/2285635435 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a141501f0 0x7f4a141f0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:12.776 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.755+0000 7f4a12d9d640 1 --2- 172.21.15.53:0/2285635435 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49f40047d0 0x7f4a14156740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:12.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.755+0000 7f4a1359e640 1 -- 172.21.15.53:0/2285635435 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a141501f0 msgr2=0x7f4a141f0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:12.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.755+0000 7f4a1359e640 1 --2- 172.21.15.53:0/2285635435 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4a141501f0 0x7f4a141f0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:12.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.755+0000 7f4a1359e640 1 -- 172.21.15.53:0/2285635435 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49f40047d0 msgr2=0x7f4a14156740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:12.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.755+0000 7f4a1359e640 1 --2- 172.21.15.53:0/2285635435 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49f40047d0 0x7f4a14156740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:12.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.755+0000 7f4a1359e640 1 -- 172.21.15.53:0/2285635435 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a140c92b0 con 0x7f4a140c8110 2023-06-10T19:09:12.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.755+0000 7f4a1359e640 1 --2- 172.21.15.53:0/2285635435 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a140c8110 0x7f4a141553d0 secure :-1 s=READY pgs=2767 cs=0 l=1 rev1=1 crypto rx=0x7f4a1406fef0 tx=0x7f49fc00d4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:12.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.755+0000 7f4a0b7fe640 1 -- 172.21.15.53:0/2285635435 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49fc00b070 con 0x7f4a140c8110 2023-06-10T19:09:12.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.755+0000 7f4a0b7fe640 1 -- 172.21.15.53:0/2285635435 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49fc0054e0 con 0x7f4a140c8110 2023-06-10T19:09:12.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.755+0000 7f4a0b7fe640 1 -- 172.21.15.53:0/2285635435 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49fc00d9f0 con 0x7f4a140c8110 2023-06-10T19:09:12.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.755+0000 7f4a191ce640 1 -- 172.21.15.53:0/2285635435 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a140c9590 con 0x7f4a140c8110 2023-06-10T19:09:12.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.755+0000 7f4a191ce640 1 -- 172.21.15.53:0/2285635435 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a140c8580 con 0x7f4a140c8110 2023-06-10T19:09:12.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.755+0000 7f4a191ce640 1 -- 172.21.15.53:0/2285635435 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4a140c8e60 con 0x7f4a140c8110 2023-06-10T19:09:12.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.755+0000 7f4a0b7fe640 1 -- 172.21.15.53:0/2285635435 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f49fc00db50 con 0x7f4a140c8110 2023-06-10T19:09:12.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.755+0000 7f4a0b7fe640 1 --2- 172.21.15.53:0/2285635435 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f49f80662b0 0x7f49f8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:12.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.755+0000 7f4a0b7fe640 1 -- 172.21.15.53:0/2285635435 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f49fc082ee0 con 0x7f4a140c8110 2023-06-10T19:09:12.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.755+0000 7f4a0b7fe640 1 --2- 172.21.15.53:0/2285635435 >> [v2:172.21.15.117:6824/86798558,v1:172.21.15.117:6825/86798558] conn(0x7f49f806c770 0x7f49f806eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:12.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.755+0000 7f4a0b7fe640 1 -- 172.21.15.53:0/2285635435 --> [v2:172.21.15.117:6824/86798558,v1:172.21.15.117:6825/86798558] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f49f806f230 con 0x7f49f806c770 2023-06-10T19:09:12.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.755+0000 7f4a0b7fe640 1 -- 172.21.15.53:0/2285635435 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=186) v2 ==== 24+0+0 (secure 0 0 0) 0x7f49fc083330 con 0x7f4a140c8110 2023-06-10T19:09:12.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.755+0000 7f4a12d9d640 1 --2- 172.21.15.53:0/2285635435 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f49f80662b0 0x7f49f8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:12.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.759+0000 7f4a1259c640 1 --2- 172.21.15.53:0/2285635435 >> [v2:172.21.15.117:6824/86798558,v1:172.21.15.117:6825/86798558] conn(0x7f49f806c770 0x7f49f806eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:12.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.759+0000 7f4a12d9d640 1 --2- 172.21.15.53:0/2285635435 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f49f80662b0 0x7f49f8068760 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f4a04009ab0 tx=0x7f4a04008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:12.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.759+0000 7f4a1259c640 1 --2- 172.21.15.53:0/2285635435 >> [v2:172.21.15.117:6824/86798558,v1:172.21.15.117:6825/86798558] conn(0x7f49f806c770 0x7f49f806eb80 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:12.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.759+0000 7f4a0b7fe640 1 -- 172.21.15.53:0/2285635435 <== osd.4 v2:172.21.15.117:6824/86798558 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f49f806f230 con 0x7f49f806c770 2023-06-10T19:09:12.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.771+0000 7f4a191ce640 1 -- 172.21.15.53:0/2285635435 --> [v2:172.21.15.117:6824/86798558,v1:172.21.15.117:6825/86798558] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f4a140c9140 con 0x7f49f806c770 2023-06-10T19:09:12.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.771+0000 7f4a0b7fe640 1 -- 172.21.15.53:0/2285635435 <== osd.4 v2:172.21.15.117:6824/86798558 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f4a140c9140 con 0x7f49f806c770 2023-06-10T19:09:12.784 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-06-10T19:09:12.785 INFO:teuthology.orchestra.run.smithi053.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-06-10T19:09:12.785 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-06-10T19:09:12.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.775+0000 7f4a191ce640 1 -- 172.21.15.53:0/2285635435 >> [v2:172.21.15.117:6824/86798558,v1:172.21.15.117:6825/86798558] conn(0x7f49f806c770 msgr2=0x7f49f806eb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:12.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.775+0000 7f4a191ce640 1 --2- 172.21.15.53:0/2285635435 >> [v2:172.21.15.117:6824/86798558,v1:172.21.15.117:6825/86798558] conn(0x7f49f806c770 0x7f49f806eb80 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:12.787 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.775+0000 7f4a191ce640 1 -- 172.21.15.53:0/2285635435 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f49f80662b0 msgr2=0x7f49f8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:12.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.775+0000 7f4a191ce640 1 --2- 172.21.15.53:0/2285635435 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f49f80662b0 0x7f49f8068760 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f4a04009ab0 tx=0x7f4a04008040 comp rx=0 tx=0).stop 2023-06-10T19:09:12.788 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.775+0000 7f4a191ce640 1 -- 172.21.15.53:0/2285635435 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a140c8110 msgr2=0x7f4a141553d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:12.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.775+0000 7f4a191ce640 1 --2- 172.21.15.53:0/2285635435 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a140c8110 0x7f4a141553d0 secure :-1 s=READY pgs=2767 cs=0 l=1 rev1=1 crypto rx=0x7f4a1406fef0 tx=0x7f49fc00d4c0 comp rx=0 tx=0).stop 2023-06-10T19:09:12.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.775+0000 7f4a1359e640 1 -- 172.21.15.53:0/2285635435 reap_dead start 2023-06-10T19:09:12.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.775+0000 7f4a191ce640 1 -- 172.21.15.53:0/2285635435 shutdown_connections 2023-06-10T19:09:12.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.775+0000 7f4a191ce640 1 -- 172.21.15.53:0/2285635435 >> 172.21.15.53:0/2285635435 conn(0x7f4a140b42b0 msgr2=0x7f4a140ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:09:12.789 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.775+0000 7f4a191ce640 1 -- 172.21.15.53:0/2285635435 shutdown_connections 2023-06-10T19:09:12.790 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.775+0000 7f4a191ce640 1 -- 172.21.15.53:0/2285635435 wait complete. 2023-06-10T19:09:12.796 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-06-10T19:09:12.907 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.903+0000 7f4d4b76f640 1 Processor -- start 2023-06-10T19:09:12.908 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.903+0000 7f4d4b76f640 1 -- start start 2023-06-10T19:09:12.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.903+0000 7f4d4b76f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4d441571a0 0x7f4d440c9f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:12.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.903+0000 7f4d4b76f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4d440afee0 0x7f4d440c83f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:12.910 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.903+0000 7f4d4b76f640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d44071190 con 0x7f4d44070100 2023-06-10T19:09:12.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.903+0000 7f4d4b76f640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d440ca440 con 0x7f4d441571a0 2023-06-10T19:09:12.911 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.903+0000 7f4d4b76f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d44070580 con 0x7f4d440afee0 2023-06-10T19:09:12.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.903+0000 7f4d4950b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4d441571a0 0x7f4d440c9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:12.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.903+0000 7f4d4950b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4d441571a0 0x7f4d440c9f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57232/0 (socket says 172.21.15.53:57232) 2023-06-10T19:09:12.912 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.903+0000 7f4d4950b640 1 -- 172.21.15.53:0/552479747 learned_addr learned my addr 172.21.15.53:0/552479747 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:09:12.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.903+0000 7f4d49d0c640 1 --2- 172.21.15.53:0/552479747 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4d440afee0 0x7f4d440c83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:12.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.903+0000 7f4d4950b640 1 -- 172.21.15.53:0/552479747 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4d440afee0 msgr2=0x7f4d440c83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:09:12.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.903+0000 7f4d4950b640 1 --2- 172.21.15.53:0/552479747 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4d440afee0 0x7f4d440c83f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:12.913 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.903+0000 7f4d4950b640 1 -- 172.21.15.53:0/552479747 >> v1:172.21.15.53:6789/0 conn(0x7f4d44070100 legacy=0x7f4d440af7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:12.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.903+0000 7f4d3bfff640 1 -- 172.21.15.53:0/552479747 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 87858442 0 0) 0x7f4d44071190 con 0x7f4d44070100 2023-06-10T19:09:12.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.903+0000 7f4d4950b640 1 -- 172.21.15.53:0/552479747 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d44070860 con 0x7f4d441571a0 2023-06-10T19:09:12.914 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.903+0000 7f4d49d0c640 1 --2- 172.21.15.53:0/552479747 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4d440afee0 0x7f4d440c83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:09:12.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.907+0000 7f4d4950b640 1 --2- 172.21.15.53:0/552479747 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d441571a0 0x7f4d440c9f00 secure :-1 s=READY pgs=2769 cs=0 l=1 rev1=1 crypto rx=0x7f4d40006fd0 tx=0x7f4d4001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbd48ce54f906f0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:12.917 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.907+0000 7f4d3bfff640 1 -- 172.21.15.53:0/552479747 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d400aa650 con 0x7f4d441571a0 2023-06-10T19:09:12.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.907+0000 7f4d3bfff640 1 -- 172.21.15.53:0/552479747 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d400aa7b0 con 0x7f4d441571a0 2023-06-10T19:09:12.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.907+0000 7f4d3bfff640 1 -- 172.21.15.53:0/552479747 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d400aab40 con 0x7f4d441571a0 2023-06-10T19:09:12.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.907+0000 7f4d4b76f640 1 -- 172.21.15.53:0/552479747 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d441571a0 msgr2=0x7f4d440c9f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:12.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.907+0000 7f4d4b76f640 1 --2- 172.21.15.53:0/552479747 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d441571a0 0x7f4d440c9f00 secure :-1 s=READY pgs=2769 cs=0 l=1 rev1=1 crypto rx=0x7f4d40006fd0 tx=0x7f4d4001c4f0 comp rx=0 tx=0).stop 2023-06-10T19:09:12.918 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.907+0000 7f4d4b76f640 1 -- 172.21.15.53:0/552479747 shutdown_connections 2023-06-10T19:09:12.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.907+0000 7f4d4b76f640 1 --2- 172.21.15.53:0/552479747 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4d440afee0 0x7f4d440c83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:12.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.907+0000 7f4d4b76f640 1 --2- 172.21.15.53:0/552479747 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d441571a0 0x7f4d440c9f00 unknown :-1 s=CLOSED pgs=2769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:12.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.907+0000 7f4d4b76f640 1 -- 172.21.15.53:0/552479747 >> 172.21.15.53:0/552479747 conn(0x7f4d440ce9e0 msgr2=0x7f4d440ca7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:09:12.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.907+0000 7f4d4b76f640 1 -- 172.21.15.53:0/552479747 shutdown_connections 2023-06-10T19:09:12.919 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.907+0000 7f4d4b76f640 1 -- 172.21.15.53:0/552479747 wait complete. 2023-06-10T19:09:12.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.907+0000 7f4d4b76f640 1 Processor -- start 2023-06-10T19:09:12.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.907+0000 7f4d4b76f640 1 -- start start 2023-06-10T19:09:12.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.907+0000 7f4d4b76f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d440afee0 0x7f4d4415cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:12.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.907+0000 7f4d4b76f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d441571a0 0x7f4d4415d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:12.920 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.907+0000 7f4d4b76f640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4d440b1bc0 0x7f4d440b2010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:12.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.907+0000 7f4d4b76f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d441474c0 con 0x7f4d441571a0 2023-06-10T19:09:12.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.907+0000 7f4d4b76f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4414b9b0 con 0x7f4d440afee0 2023-06-10T19:09:12.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.907+0000 7f4d4b76f640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4414bc90 con 0x7f4d440b1bc0 2023-06-10T19:09:12.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.907+0000 7f4d48d0a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d441571a0 0x7f4d4415d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:12.921 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.907+0000 7f4d48d0a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d441571a0 0x7f4d4415d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57242/0 (socket says 172.21.15.53:57242) 2023-06-10T19:09:12.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.907+0000 7f4d48d0a640 1 -- 172.21.15.53:0/3660457847 learned_addr learned my addr 172.21.15.53:0/3660457847 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:09:12.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.907+0000 7f4d49d0c640 1 --2- 172.21.15.53:0/3660457847 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4d440b1bc0 0x7f4d440b2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:12.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.907+0000 7f4d4950b640 1 --2- 172.21.15.53:0/3660457847 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d440afee0 0x7f4d4415cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:12.922 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.907+0000 7f4d48d0a640 1 -- 172.21.15.53:0/3660457847 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4d440b1bc0 msgr2=0x7f4d440b2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:12.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.907+0000 7f4d48d0a640 1 --2- 172.21.15.53:0/3660457847 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4d440b1bc0 0x7f4d440b2010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:12.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.907+0000 7f4d48d0a640 1 -- 172.21.15.53:0/3660457847 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d440afee0 msgr2=0x7f4d4415cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:12.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.907+0000 7f4d48d0a640 1 --2- 172.21.15.53:0/3660457847 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d440afee0 0x7f4d4415cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:12.923 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.907+0000 7f4d48d0a640 1 -- 172.21.15.53:0/3660457847 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d40009480 con 0x7f4d441571a0 2023-06-10T19:09:12.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.907+0000 7f4d49d0c640 1 --2- 172.21.15.53:0/3660457847 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4d440b1bc0 0x7f4d440b2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:09:12.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.907+0000 7f4d48d0a640 1 --2- 172.21.15.53:0/3660457847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d441571a0 0x7f4d4415d530 secure :-1 s=READY pgs=2770 cs=0 l=1 rev1=1 crypto rx=0x7f4d3400c520 tx=0x7f4d3400c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:12.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.907+0000 7f4d39ffb640 1 -- 172.21.15.53:0/3660457847 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d34003600 con 0x7f4d441571a0 2023-06-10T19:09:12.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.907+0000 7f4d39ffb640 1 -- 172.21.15.53:0/3660457847 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d34003780 con 0x7f4d441571a0 2023-06-10T19:09:12.924 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.907+0000 7f4d4b76f640 1 -- 172.21.15.53:0/3660457847 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d44146e70 con 0x7f4d441571a0 2023-06-10T19:09:12.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.907+0000 7f4d39ffb640 1 -- 172.21.15.53:0/3660457847 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d34003b30 con 0x7f4d441571a0 2023-06-10T19:09:12.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.911+0000 7f4d4b76f640 1 -- 172.21.15.53:0/3660457847 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d440b2550 con 0x7f4d441571a0 2023-06-10T19:09:12.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.911+0000 7f4d4b76f640 1 -- 172.21.15.53:0/3660457847 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d44147670 con 0x7f4d441571a0 2023-06-10T19:09:12.925 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.911+0000 7f4d39ffb640 1 -- 172.21.15.53:0/3660457847 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4d34003c90 con 0x7f4d441571a0 2023-06-10T19:09:12.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.911+0000 7f4d39ffb640 1 --2- 172.21.15.53:0/3660457847 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4d28066280 0x7f4d28068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:12.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.911+0000 7f4d39ffb640 1 -- 172.21.15.53:0/3660457847 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f4d34083000 con 0x7f4d441571a0 2023-06-10T19:09:12.926 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.911+0000 7f4d4950b640 1 --2- 172.21.15.53:0/3660457847 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4d28066280 0x7f4d28068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:12.927 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.911+0000 7f4d4950b640 1 --2- 172.21.15.53:0/3660457847 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4d28066280 0x7f4d28068730 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f4d400ae000 tx=0x7f4d400a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:12.928 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:12.915+0000 7f4d39ffb640 1 -- 172.21.15.53:0/3660457847 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4d44147670 con 0x7f4d441571a0 2023-06-10T19:09:13.069 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.063+0000 7f4d4b76f640 1 -- 172.21.15.53:0/3660457847 --> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f4d44157570 con 0x7f4d28066280 2023-06-10T19:09:13.070 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.063+0000 7f4d39ffb640 1 -- 172.21.15.53:0/3660457847 <== mgr.4105 v2:172.21.15.117:6832/3061986771 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4d400b8070 con 0x7f4d28066280 2023-06-10T19:09:13.071 INFO:teuthology.orchestra.run.smithi053.stderr:instructed osd(s) 4 to deep-scrub 2023-06-10T19:09:13.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.067+0000 7f4d4b76f640 1 -- 172.21.15.53:0/3660457847 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4d28066280 msgr2=0x7f4d28068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:13.072 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.067+0000 7f4d4b76f640 1 --2- 172.21.15.53:0/3660457847 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4d28066280 0x7f4d28068730 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f4d400ae000 tx=0x7f4d400a7000 comp rx=0 tx=0).stop 2023-06-10T19:09:13.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.067+0000 7f4d4b76f640 1 -- 172.21.15.53:0/3660457847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d441571a0 msgr2=0x7f4d4415d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:13.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.067+0000 7f4d4b76f640 1 --2- 172.21.15.53:0/3660457847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d441571a0 0x7f4d4415d530 secure :-1 s=READY pgs=2770 cs=0 l=1 rev1=1 crypto rx=0x7f4d3400c520 tx=0x7f4d3400c9e0 comp rx=0 tx=0).stop 2023-06-10T19:09:13.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.067+0000 7f4d4b76f640 1 -- 172.21.15.53:0/3660457847 shutdown_connections 2023-06-10T19:09:13.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.067+0000 7f4d4b76f640 1 --2- 172.21.15.53:0/3660457847 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4d28066280 0x7f4d28068730 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:13.073 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.067+0000 7f4d4b76f640 1 --2- 172.21.15.53:0/3660457847 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4d440b1bc0 0x7f4d440b2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:13.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.067+0000 7f4d4b76f640 1 --2- 172.21.15.53:0/3660457847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d441571a0 0x7f4d4415d530 unknown :-1 s=CLOSED pgs=2770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:13.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.067+0000 7f4d4b76f640 1 --2- 172.21.15.53:0/3660457847 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d440afee0 0x7f4d4415cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:13.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.067+0000 7f4d4b76f640 1 -- 172.21.15.53:0/3660457847 >> 172.21.15.53:0/3660457847 conn(0x7f4d440ce9e0 msgr2=0x7f4d4414f5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:09:13.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.067+0000 7f4d4b76f640 1 -- 172.21.15.53:0/3660457847 shutdown_connections 2023-06-10T19:09:13.074 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.067+0000 7f4d4b76f640 1 -- 172.21.15.53:0/3660457847 wait complete. 2023-06-10T19:09:13.088 INFO:tasks.ceph:Scrubbing osd.5 2023-06-10T19:09:13.088 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-06-10T19:09:13.216 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.211+0000 7f9964966640 1 Processor -- start 2023-06-10T19:09:13.217 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.211+0000 7f9964966640 1 -- start start 2023-06-10T19:09:13.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.211+0000 7f9964966640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f996015ba00 0x7f99600cf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:13.219 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.211+0000 7f9964966640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f996015f370 0x7f996015f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:13.220 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.211+0000 7f9964966640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f996015fd50 con 0x7f996006b840 2023-06-10T19:09:13.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.211+0000 7f9964966640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99600ceb40 con 0x7f996015ba00 2023-06-10T19:09:13.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.211+0000 7f9964966640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f996015c1c0 con 0x7f996015f370 2023-06-10T19:09:13.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.211+0000 7f995e59c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f996006b840 0x7f996006bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:49650/0 (socket says 172.21.15.53:49650) 2023-06-10T19:09:13.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.211+0000 7f995e59c640 1 -- 172.21.15.53:0/2824921106 learned_addr learned my addr 172.21.15.53:0/2824921106 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:09:13.221 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.211+0000 7f995ed9d640 1 --2- 172.21.15.53:0/2824921106 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f996015f370 0x7f996015f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:13.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.211+0000 7f995dd9b640 1 --2- 172.21.15.53:0/2824921106 >> v2:172.21.15.117:3300/0 conn(0x7f996015ba00 0x7f99600cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:13.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.211+0000 7f995d59a640 1 -- 172.21.15.53:0/2824921106 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3160807552 0 0) 0x7f996015fd50 con 0x7f996006b840 2023-06-10T19:09:13.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.211+0000 7f995d59a640 1 -- 172.21.15.53:0/2824921106 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f994c003530 con 0x7f996006b840 2023-06-10T19:09:13.222 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.211+0000 7f995d59a640 1 -- 172.21.15.53:0/2824921106 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3689307697 0 0) 0x7f994c003530 con 0x7f996006b840 2023-06-10T19:09:13.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.211+0000 7f995d59a640 1 -- 172.21.15.53:0/2824921106 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f996015f370 msgr2=0x7f996015f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:09:13.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.211+0000 7f995d59a640 1 --2- 172.21.15.53:0/2824921106 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f996015f370 0x7f996015f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:13.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.211+0000 7f995d59a640 1 -- 172.21.15.53:0/2824921106 >> v2:172.21.15.117:3300/0 conn(0x7f996015ba00 msgr2=0x7f99600cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:09:13.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.211+0000 7f995d59a640 1 --2- 172.21.15.53:0/2824921106 >> v2:172.21.15.117:3300/0 conn(0x7f996015ba00 0x7f99600cf810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:13.223 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.211+0000 7f995d59a640 1 -- 172.21.15.53:0/2824921106 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99600cf380 con 0x7f996006b840 2023-06-10T19:09:13.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.211+0000 7f995d59a640 1 -- 172.21.15.53:0/2824921106 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f9950001680 con 0x7f996006b840 2023-06-10T19:09:13.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.211+0000 7f995d59a640 1 -- 172.21.15.53:0/2824921106 >> v1:172.21.15.53:6789/0 conn(0x7f996006b840 legacy=0x7f996006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:13.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.211+0000 7f995d59a640 1 --2- 172.21.15.53:0/2824921106 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f996015f370 0x7f994c003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:13.224 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.211+0000 7f995d59a640 1 --2- 172.21.15.53:0/2824921106 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f994c003f00 0x7f994c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:13.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.211+0000 7f995d59a640 1 --2- 172.21.15.53:0/2824921106 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f994c004d10 0x7f994c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:13.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.211+0000 7f995d59a640 1 -- 172.21.15.53:0/2824921106 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f996015c1c0 con 0x7f994c003f00 2023-06-10T19:09:13.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.211+0000 7f995d59a640 1 -- 172.21.15.53:0/2824921106 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f994c00b990 con 0x7f994c004d10 2023-06-10T19:09:13.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.211+0000 7f995d59a640 1 -- 172.21.15.53:0/2824921106 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f994c00bad0 con 0x7f996015f370 2023-06-10T19:09:13.225 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.211+0000 7f995dd9b640 1 --2- 172.21.15.53:0/2824921106 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f994c003f00 0x7f994c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:13.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.211+0000 7f995e59c640 1 --2- 172.21.15.53:0/2824921106 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f996015f370 0x7f994c003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:13.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.211+0000 7f995ed9d640 1 --2- 172.21.15.53:0/2824921106 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f994c004d10 0x7f994c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:13.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.215+0000 7f995dd9b640 1 -- 172.21.15.53:0/2824921106 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f996015f370 msgr2=0x7f994c003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:09:13.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.215+0000 7f995dd9b640 1 --2- 172.21.15.53:0/2824921106 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f996015f370 0x7f994c003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:13.226 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.215+0000 7f995dd9b640 1 -- 172.21.15.53:0/2824921106 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f994c004d10 msgr2=0x7f994c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:09:13.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.215+0000 7f995dd9b640 1 --2- 172.21.15.53:0/2824921106 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f994c004d10 0x7f994c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:13.227 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.215+0000 7f995dd9b640 1 -- 172.21.15.53:0/2824921106 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f994c003530 con 0x7f994c003f00 2023-06-10T19:09:13.230 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.215+0000 7f995dd9b640 1 --2- 172.21.15.53:0/2824921106 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f994c003f00 0x7f994c0047d0 secure :-1 s=READY pgs=2772 cs=0 l=1 rev1=1 crypto rx=0x7f9948009ae0 tx=0x7f994801ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19b6a32d644bcfae server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:13.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.215+0000 7f995d59a640 1 -- 172.21.15.53:0/2824921106 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99480a5680 con 0x7f994c003f00 2023-06-10T19:09:13.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.215+0000 7f995d59a640 1 -- 172.21.15.53:0/2824921106 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99480a57e0 con 0x7f994c003f00 2023-06-10T19:09:13.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.215+0000 7f995d59a640 1 -- 172.21.15.53:0/2824921106 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99480a5b90 con 0x7f994c003f00 2023-06-10T19:09:13.231 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.215+0000 7f9964966640 1 -- 172.21.15.53:0/2824921106 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f994c003f00 msgr2=0x7f994c0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:13.232 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.215+0000 7f9964966640 1 --2- 172.21.15.53:0/2824921106 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f994c003f00 0x7f994c0047d0 secure :-1 s=READY pgs=2772 cs=0 l=1 rev1=1 crypto rx=0x7f9948009ae0 tx=0x7f994801ca90 comp rx=0 tx=0).stop 2023-06-10T19:09:13.232 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.215+0000 7f995ed9d640 1 -- 172.21.15.53:0/2824921106 reap_dead start 2023-06-10T19:09:13.232 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.215+0000 7f9964966640 1 -- 172.21.15.53:0/2824921106 shutdown_connections 2023-06-10T19:09:13.232 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.215+0000 7f9964966640 1 -- 172.21.15.53:0/2824921106 >> 172.21.15.53:0/2824921106 conn(0x7f996006a0b0 msgr2=0x7f996006d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:09:13.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.215+0000 7f9964966640 1 -- 172.21.15.53:0/2824921106 shutdown_connections 2023-06-10T19:09:13.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.215+0000 7f9964966640 1 -- 172.21.15.53:0/2824921106 wait complete. 2023-06-10T19:09:13.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.219+0000 7f9964966640 1 Processor -- start 2023-06-10T19:09:13.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.219+0000 7f9964966640 1 -- start start 2023-06-10T19:09:13.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.219+0000 7f9964966640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f994c003f00 0x7f996014c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:13.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.219+0000 7f9964966640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f996006a560 0x7f996006a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:13.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.219+0000 7f9964966640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f996014e8e0 0x7f996014ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:13.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.219+0000 7f9964966640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9960150b10 con 0x7f994c003f00 2023-06-10T19:09:13.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.219+0000 7f9964966640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f996015ae70 con 0x7f996006a560 2023-06-10T19:09:13.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.219+0000 7f9964966640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99600c3820 con 0x7f996014e8e0 2023-06-10T19:09:13.235 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.219+0000 7f995e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f994c003f00 0x7f996014c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:13.235 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.219+0000 7f995e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f994c003f00 0x7f996014c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57266/0 (socket says 172.21.15.53:57266) 2023-06-10T19:09:13.235 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.219+0000 7f995e59c640 1 -- 172.21.15.53:0/350085091 learned_addr learned my addr 172.21.15.53:0/350085091 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:09:13.235 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.219+0000 7f995dd9b640 1 --2- 172.21.15.53:0/350085091 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f996006a560 0x7f996006a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:13.235 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.219+0000 7f995ed9d640 1 --2- 172.21.15.53:0/350085091 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f996014e8e0 0x7f996014ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:13.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.219+0000 7f995e59c640 1 -- 172.21.15.53:0/350085091 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f996014e8e0 msgr2=0x7f996014ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:13.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.219+0000 7f995e59c640 1 --2- 172.21.15.53:0/350085091 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f996014e8e0 0x7f996014ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:13.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.219+0000 7f995e59c640 1 -- 172.21.15.53:0/350085091 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f996006a560 msgr2=0x7f996006a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:13.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.219+0000 7f995e59c640 1 --2- 172.21.15.53:0/350085091 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f996006a560 0x7f996006a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:13.236 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.219+0000 7f995e59c640 1 -- 172.21.15.53:0/350085091 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f996014f290 con 0x7f994c003f00 2023-06-10T19:09:13.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.219+0000 7f995ed9d640 1 --2- 172.21.15.53:0/350085091 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f996014e8e0 0x7f996014ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:09:13.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.219+0000 7f995e59c640 1 --2- 172.21.15.53:0/350085091 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f994c003f00 0x7f996014c4e0 secure :-1 s=READY pgs=2773 cs=0 l=1 rev1=1 crypto rx=0x7f9950012570 tx=0x7f9950012a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:13.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.219+0000 7f9956ffd640 1 -- 172.21.15.53:0/350085091 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9950014810 con 0x7f994c003f00 2023-06-10T19:09:13.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.219+0000 7f9956ffd640 1 -- 172.21.15.53:0/350085091 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9950014970 con 0x7f994c003f00 2023-06-10T19:09:13.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.219+0000 7f9964966640 1 -- 172.21.15.53:0/350085091 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f996014f540 con 0x7f994c003f00 2023-06-10T19:09:13.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.219+0000 7f9956ffd640 1 -- 172.21.15.53:0/350085091 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9950014d00 con 0x7f994c003f00 2023-06-10T19:09:13.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.219+0000 7f9964966640 1 -- 172.21.15.53:0/350085091 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9960150450 con 0x7f994c003f00 2023-06-10T19:09:13.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.219+0000 7f9964966640 1 -- 172.21.15.53:0/350085091 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f996006af10 con 0x7f994c003f00 2023-06-10T19:09:13.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.219+0000 7f9956ffd640 1 -- 172.21.15.53:0/350085091 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9950016480 con 0x7f994c003f00 2023-06-10T19:09:13.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.219+0000 7f9956ffd640 1 --2- 172.21.15.53:0/350085091 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f99400662b0 0x7f9940068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:13.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.219+0000 7f9956ffd640 1 -- 172.21.15.53:0/350085091 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f9950087900 con 0x7f994c003f00 2023-06-10T19:09:13.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.219+0000 7f9956ffd640 1 --2- 172.21.15.53:0/350085091 >> [v2:172.21.15.117:6808/1805352380,v1:172.21.15.117:6809/1805352380] conn(0x7f994006c770 0x7f994006eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:13.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.219+0000 7f9956ffd640 1 -- 172.21.15.53:0/350085091 --> [v2:172.21.15.117:6808/1805352380,v1:172.21.15.117:6809/1805352380] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f994006f230 con 0x7f994006c770 2023-06-10T19:09:13.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.219+0000 7f9956ffd640 1 -- 172.21.15.53:0/350085091 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=186) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9950087d50 con 0x7f994c003f00 2023-06-10T19:09:13.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.223+0000 7f995dd9b640 1 --2- 172.21.15.53:0/350085091 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f99400662b0 0x7f9940068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:13.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.223+0000 7f995ed9d640 1 --2- 172.21.15.53:0/350085091 >> [v2:172.21.15.117:6808/1805352380,v1:172.21.15.117:6809/1805352380] conn(0x7f994006c770 0x7f994006eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:13.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.223+0000 7f995ed9d640 1 --2- 172.21.15.53:0/350085091 >> [v2:172.21.15.117:6808/1805352380,v1:172.21.15.117:6809/1805352380] conn(0x7f994006c770 0x7f994006eb80 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:13.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.223+0000 7f995dd9b640 1 --2- 172.21.15.53:0/350085091 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f99400662b0 0x7f9940068760 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f99480af000 tx=0x7f99480046d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:13.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.223+0000 7f9956ffd640 1 -- 172.21.15.53:0/350085091 <== osd.5 v2:172.21.15.117:6808/1805352380 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f994006f230 con 0x7f994006c770 2023-06-10T19:09:13.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.235+0000 7f9964966640 1 -- 172.21.15.53:0/350085091 --> [v2:172.21.15.117:6808/1805352380,v1:172.21.15.117:6809/1805352380] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f996015ff80 con 0x7f994006c770 2023-06-10T19:09:13.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.235+0000 7f9956ffd640 1 -- 172.21.15.53:0/350085091 <== osd.5 v2:172.21.15.117:6808/1805352380 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f995800f040 con 0x7f994006c770 2023-06-10T19:09:13.243 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-06-10T19:09:13.243 INFO:teuthology.orchestra.run.smithi053.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-06-10T19:09:13.243 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-06-10T19:09:13.244 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.239+0000 7f9964966640 1 -- 172.21.15.53:0/350085091 >> [v2:172.21.15.117:6808/1805352380,v1:172.21.15.117:6809/1805352380] conn(0x7f994006c770 msgr2=0x7f994006eb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:13.245 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.239+0000 7f9964966640 1 --2- 172.21.15.53:0/350085091 >> [v2:172.21.15.117:6808/1805352380,v1:172.21.15.117:6809/1805352380] conn(0x7f994006c770 0x7f994006eb80 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:13.245 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.239+0000 7f9964966640 1 -- 172.21.15.53:0/350085091 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f99400662b0 msgr2=0x7f9940068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:13.245 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.239+0000 7f9964966640 1 --2- 172.21.15.53:0/350085091 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f99400662b0 0x7f9940068760 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f99480af000 tx=0x7f99480046d0 comp rx=0 tx=0).stop 2023-06-10T19:09:13.245 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.239+0000 7f9964966640 1 -- 172.21.15.53:0/350085091 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f994c003f00 msgr2=0x7f996014c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:13.245 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.239+0000 7f9964966640 1 --2- 172.21.15.53:0/350085091 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f994c003f00 0x7f996014c4e0 secure :-1 s=READY pgs=2773 cs=0 l=1 rev1=1 crypto rx=0x7f9950012570 tx=0x7f9950012a30 comp rx=0 tx=0).stop 2023-06-10T19:09:13.246 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.239+0000 7f995ed9d640 1 -- 172.21.15.53:0/350085091 reap_dead start 2023-06-10T19:09:13.246 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.239+0000 7f9964966640 1 -- 172.21.15.53:0/350085091 shutdown_connections 2023-06-10T19:09:13.246 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.239+0000 7f9964966640 1 -- 172.21.15.53:0/350085091 >> 172.21.15.53:0/350085091 conn(0x7f996006a0b0 msgr2=0x7f99600b2e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:09:13.246 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.239+0000 7f9964966640 1 -- 172.21.15.53:0/350085091 shutdown_connections 2023-06-10T19:09:13.246 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.239+0000 7f9964966640 1 -- 172.21.15.53:0/350085091 wait complete. 2023-06-10T19:09:13.259 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-06-10T19:09:13.375 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.371+0000 7f1964011640 1 Processor -- start 2023-06-10T19:09:13.376 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.371+0000 7f1964011640 1 -- start start 2023-06-10T19:09:13.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.371+0000 7f1964011640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f195c15fc50 0x7f195c0af7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:13.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.371+0000 7f1964011640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f195c0cd720 0x7f195c0afd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:13.377 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.371+0000 7f1964011640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f195c06a8b0 con 0x7f195c160020 2023-06-10T19:09:13.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.371+0000 7f1964011640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f195c06ab00 con 0x7f195c0cd720 2023-06-10T19:09:13.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.371+0000 7f1964011640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f195c06ade0 con 0x7f195c15fc50 2023-06-10T19:09:13.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.371+0000 7f19625ae640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f195c0cd720 0x7f195c0afd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:13.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.371+0000 7f19625ae640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f195c0cd720 0x7f195c0afd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57272/0 (socket says 172.21.15.53:57272) 2023-06-10T19:09:13.378 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.371+0000 7f19625ae640 1 -- 172.21.15.53:0/4152185 learned_addr learned my addr 172.21.15.53:0/4152185 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:09:13.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.371+0000 7f1961dad640 1 --2- 172.21.15.53:0/4152185 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f195c15fc50 0x7f195c0af7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:13.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.371+0000 7f19625ae640 1 -- 172.21.15.53:0/4152185 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f195c15fc50 msgr2=0x7f195c0af7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:09:13.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.371+0000 7f19625ae640 1 --2- 172.21.15.53:0/4152185 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f195c15fc50 0x7f195c0af7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:13.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.371+0000 7f19625ae640 1 -- 172.21.15.53:0/4152185 >> v1:172.21.15.117:6789/0 conn(0x7f195c160020 legacy=0x7f195c0cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:13.379 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.371+0000 7f19625ae640 1 -- 172.21.15.53:0/4152185 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f195c06b0c0 con 0x7f195c0cd720 2023-06-10T19:09:13.380 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.375+0000 7f19625ae640 1 --2- 172.21.15.53:0/4152185 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f195c0cd720 0x7f195c0afd10 secure :-1 s=READY pgs=2774 cs=0 l=1 rev1=1 crypto rx=0x7f1954009870 tx=0x7f195401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e4b57e98fc4ead7 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:13.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.375+0000 7f1960dab640 1 -- 172.21.15.53:0/4152185 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19540ab660 con 0x7f195c0cd720 2023-06-10T19:09:13.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.375+0000 7f1960dab640 1 -- 172.21.15.53:0/4152185 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19540ab7c0 con 0x7f195c0cd720 2023-06-10T19:09:13.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.375+0000 7f1960dab640 1 -- 172.21.15.53:0/4152185 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19540abb50 con 0x7f195c0cd720 2023-06-10T19:09:13.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.375+0000 7f1964011640 1 -- 172.21.15.53:0/4152185 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f195c0cd720 msgr2=0x7f195c0afd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:13.381 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.375+0000 7f1964011640 1 --2- 172.21.15.53:0/4152185 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f195c0cd720 0x7f195c0afd10 secure :-1 s=READY pgs=2774 cs=0 l=1 rev1=1 crypto rx=0x7f1954009870 tx=0x7f195401c540 comp rx=0 tx=0).stop 2023-06-10T19:09:13.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.375+0000 7f1964011640 1 -- 172.21.15.53:0/4152185 shutdown_connections 2023-06-10T19:09:13.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.375+0000 7f1964011640 1 --2- 172.21.15.53:0/4152185 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f195c0cd720 0x7f195c0afd10 unknown :-1 s=CLOSED pgs=2774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:13.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.375+0000 7f1964011640 1 --2- 172.21.15.53:0/4152185 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f195c15fc50 0x7f195c0af7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:13.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.375+0000 7f1964011640 1 -- 172.21.15.53:0/4152185 >> 172.21.15.53:0/4152185 conn(0x7f195c0ce9e0 msgr2=0x7f195c0ca7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:09:13.382 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.375+0000 7f1964011640 1 -- 172.21.15.53:0/4152185 shutdown_connections 2023-06-10T19:09:13.383 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.375+0000 7f1964011640 1 -- 172.21.15.53:0/4152185 wait complete. 2023-06-10T19:09:13.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.375+0000 7f1964011640 1 Processor -- start 2023-06-10T19:09:13.384 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.375+0000 7f1964011640 1 -- start start 2023-06-10T19:09:13.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.375+0000 7f1964011640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f195c0cd720 0x7f195c0ad770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:13.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.375+0000 7f1964011640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f195c15fc50 0x7f195c156240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:13.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.375+0000 7f1964011640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f195c160020 0x7f195c0c3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:13.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.375+0000 7f1964011640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f195c0c46c0 con 0x7f195c160020 2023-06-10T19:09:13.385 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.375+0000 7f1964011640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f195c0c40b0 con 0x7f195c0cd720 2023-06-10T19:09:13.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.375+0000 7f1964011640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f195c0c1b60 con 0x7f195c15fc50 2023-06-10T19:09:13.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.375+0000 7f19625ae640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f195c160020 0x7f195c0c3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:13.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.375+0000 7f19625ae640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f195c160020 0x7f195c0c3350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57284/0 (socket says 172.21.15.53:57284) 2023-06-10T19:09:13.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.375+0000 7f19625ae640 1 -- 172.21.15.53:0/1183492098 learned_addr learned my addr 172.21.15.53:0/1183492098 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:09:13.386 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.375+0000 7f19625ae640 1 -- 172.21.15.53:0/1183492098 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f195c15fc50 msgr2=0x7f195c156240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:13.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.375+0000 7f19625ae640 1 --2- 172.21.15.53:0/1183492098 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f195c15fc50 0x7f195c156240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:13.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.375+0000 7f19625ae640 1 -- 172.21.15.53:0/1183492098 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f195c0cd720 msgr2=0x7f195c0ad770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:13.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.375+0000 7f19625ae640 1 --2- 172.21.15.53:0/1183492098 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f195c0cd720 0x7f195c0ad770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:13.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.375+0000 7f19625ae640 1 -- 172.21.15.53:0/1183492098 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19540094d0 con 0x7f195c160020 2023-06-10T19:09:13.387 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.379+0000 7f19625ae640 1 --2- 172.21.15.53:0/1183492098 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f195c160020 0x7f195c0c3350 secure :-1 s=READY pgs=2775 cs=0 l=1 rev1=1 crypto rx=0x7f19540ad040 tx=0x7f195401ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:13.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.379+0000 7f194e7fc640 1 -- 172.21.15.53:0/1183492098 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19540b4800 con 0x7f195c160020 2023-06-10T19:09:13.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.379+0000 7f194e7fc640 1 -- 172.21.15.53:0/1183492098 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19540b4980 con 0x7f195c160020 2023-06-10T19:09:13.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.379+0000 7f1964011640 1 -- 172.21.15.53:0/1183492098 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f195c0c4350 con 0x7f195c160020 2023-06-10T19:09:13.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.379+0000 7f194e7fc640 1 -- 172.21.15.53:0/1183492098 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19540b4d30 con 0x7f195c160020 2023-06-10T19:09:13.388 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.379+0000 7f1964011640 1 -- 172.21.15.53:0/1183492098 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f195c0c1e40 con 0x7f195c160020 2023-06-10T19:09:13.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.379+0000 7f1964011640 1 -- 172.21.15.53:0/1183492098 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f195c070150 con 0x7f195c160020 2023-06-10T19:09:13.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.379+0000 7f194e7fc640 1 -- 172.21.15.53:0/1183492098 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f19540a9070 con 0x7f195c160020 2023-06-10T19:09:13.389 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.379+0000 7f194e7fc640 1 --2- 172.21.15.53:0/1183492098 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f19400662b0 0x7f1940068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:13.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.379+0000 7f194e7fc640 1 -- 172.21.15.53:0/1183492098 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f195411dcf0 con 0x7f195c160020 2023-06-10T19:09:13.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.379+0000 7f1961dad640 1 --2- 172.21.15.53:0/1183492098 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f19400662b0 0x7f1940068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:13.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.379+0000 7f1961dad640 1 --2- 172.21.15.53:0/1183492098 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f19400662b0 0x7f1940068760 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f1958006a40 tx=0x7f19580069d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:13.390 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.383+0000 7f194e7fc640 1 -- 172.21.15.53:0/1183492098 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1954122070 con 0x7f195c160020 2023-06-10T19:09:13.538 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.531+0000 7f1964011640 1 -- 172.21.15.53:0/1183492098 --> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f195c04d790 con 0x7f19400662b0 2023-06-10T19:09:13.540 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.531+0000 7f194e7fc640 1 -- 172.21.15.53:0/1183492098 <== mgr.4105 v2:172.21.15.117:6832/3061986771 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f195c04d790 con 0x7f19400662b0 2023-06-10T19:09:13.540 INFO:teuthology.orchestra.run.smithi053.stderr:instructed osd(s) 5 to deep-scrub 2023-06-10T19:09:13.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.535+0000 7f1964011640 1 -- 172.21.15.53:0/1183492098 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f19400662b0 msgr2=0x7f1940068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:13.542 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.535+0000 7f1964011640 1 --2- 172.21.15.53:0/1183492098 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f19400662b0 0x7f1940068760 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f1958006a40 tx=0x7f19580069d0 comp rx=0 tx=0).stop 2023-06-10T19:09:13.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.535+0000 7f1964011640 1 -- 172.21.15.53:0/1183492098 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f195c160020 msgr2=0x7f195c0c3350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:13.543 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.535+0000 7f1964011640 1 --2- 172.21.15.53:0/1183492098 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f195c160020 0x7f195c0c3350 secure :-1 s=READY pgs=2775 cs=0 l=1 rev1=1 crypto rx=0x7f19540ad040 tx=0x7f195401ad80 comp rx=0 tx=0).stop 2023-06-10T19:09:13.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.535+0000 7f1964011640 1 -- 172.21.15.53:0/1183492098 shutdown_connections 2023-06-10T19:09:13.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.535+0000 7f1964011640 1 --2- 172.21.15.53:0/1183492098 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f19400662b0 0x7f1940068760 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:13.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.535+0000 7f1964011640 1 --2- 172.21.15.53:0/1183492098 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f195c160020 0x7f195c0c3350 unknown :-1 s=CLOSED pgs=2775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:13.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.535+0000 7f1964011640 1 --2- 172.21.15.53:0/1183492098 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f195c15fc50 0x7f195c156240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:13.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.535+0000 7f1964011640 1 --2- 172.21.15.53:0/1183492098 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f195c0cd720 0x7f195c0ad770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:13.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.535+0000 7f1964011640 1 -- 172.21.15.53:0/1183492098 >> 172.21.15.53:0/1183492098 conn(0x7f195c0ce9e0 msgr2=0x7f195c0723f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:09:13.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.535+0000 7f1964011640 1 -- 172.21.15.53:0/1183492098 shutdown_connections 2023-06-10T19:09:13.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.535+0000 7f1964011640 1 -- 172.21.15.53:0/1183492098 wait complete. 2023-06-10T19:09:13.556 INFO:tasks.ceph:Scrubbing osd.6 2023-06-10T19:09:13.557 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-06-10T19:09:13.672 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.667+0000 7f4d21f22640 1 Processor -- start 2023-06-10T19:09:13.673 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.667+0000 7f4d21f22640 1 -- start start 2023-06-10T19:09:13.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.667+0000 7f4d21f22640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4d1c0cce30 0x7f4d1c163770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:13.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.667+0000 7f4d21f22640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d1c159120 con 0x7f4d1c06c210 2023-06-10T19:09:13.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.667+0000 7f4d21f22640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d1c159400 con 0x7f4d1c15d0b0 2023-06-10T19:09:13.675 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.667+0000 7f4d21f22640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1c0c9520 con 0x7f4d1c0cce30 2023-06-10T19:09:13.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.667+0000 7f4d1b7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f4d1c06c210 0x7f4d1c06c5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:49656/0 (socket says 172.21.15.53:49656) 2023-06-10T19:09:13.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.667+0000 7f4d1b7fe640 1 -- 172.21.15.53:0/1120580731 learned_addr learned my addr 172.21.15.53:0/1120580731 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:09:13.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.667+0000 7f4d1bfff640 1 --2- 172.21.15.53:0/1120580731 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4d1c0cce30 0x7f4d1c163770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:13.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.667+0000 7f4d1a7fc640 1 -- 172.21.15.53:0/1120580731 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 289955844 0 0) 0x7f4d1c159120 con 0x7f4d1c06c210 2023-06-10T19:09:13.676 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.667+0000 7f4d1a7fc640 1 -- 172.21.15.53:0/1120580731 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d04003530 con 0x7f4d1c06c210 2023-06-10T19:09:13.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.667+0000 7f4d1a7fc640 1 -- 172.21.15.53:0/1120580731 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1247968430 0 0) 0x7f4d04003530 con 0x7f4d1c06c210 2023-06-10T19:09:13.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.667+0000 7f4d1a7fc640 1 -- 172.21.15.53:0/1120580731 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4d1c0cce30 msgr2=0x7f4d1c163770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:09:13.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.667+0000 7f4d1a7fc640 1 --2- 172.21.15.53:0/1120580731 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4d1c0cce30 0x7f4d1c163770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:13.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.667+0000 7f4d1a7fc640 1 -- 172.21.15.53:0/1120580731 >> v1:172.21.15.117:6789/0 conn(0x7f4d1c15d0b0 legacy=0x7f4d1c0c8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:13.677 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.667+0000 7f4d1a7fc640 1 -- 172.21.15.53:0/1120580731 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d1c1596e0 con 0x7f4d1c06c210 2023-06-10T19:09:13.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.667+0000 7f4d1a7fc640 1 -- 172.21.15.53:0/1120580731 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f4d0c001680 con 0x7f4d1c06c210 2023-06-10T19:09:13.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.667+0000 7f4d1a7fc640 1 -- 172.21.15.53:0/1120580731 >> v1:172.21.15.53:6789/0 conn(0x7f4d1c06c210 legacy=0x7f4d1c06c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:13.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.667+0000 7f4d1a7fc640 1 --2- 172.21.15.53:0/1120580731 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d040039b0 0x7f4d04003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:13.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.667+0000 7f4d1a7fc640 1 --2- 172.21.15.53:0/1120580731 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4d1c0cce30 0x7f4d040047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:13.678 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.667+0000 7f4d1a7fc640 1 --2- 172.21.15.53:0/1120580731 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d04004d10 0x7f4d04005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:13.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.667+0000 7f4d1a7fc640 1 -- 172.21.15.53:0/1120580731 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1c0c9520 con 0x7f4d040039b0 2023-06-10T19:09:13.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.667+0000 7f4d1a7fc640 1 -- 172.21.15.53:0/1120580731 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0400ba40 con 0x7f4d04004d10 2023-06-10T19:09:13.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.667+0000 7f4d1a7fc640 1 -- 172.21.15.53:0/1120580731 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0400bbd0 con 0x7f4d1c0cce30 2023-06-10T19:09:13.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.667+0000 7f4d1b7fe640 1 --2- 172.21.15.53:0/1120580731 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d040039b0 0x7f4d04003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:13.679 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.667+0000 7f4d1affd640 1 --2- 172.21.15.53:0/1120580731 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4d1c0cce30 0x7f4d040047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:13.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.667+0000 7f4d1bfff640 1 --2- 172.21.15.53:0/1120580731 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d04004d10 0x7f4d04005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:13.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.667+0000 7f4d1b7fe640 1 -- 172.21.15.53:0/1120580731 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4d1c0cce30 msgr2=0x7f4d040047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:09:13.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.667+0000 7f4d1b7fe640 1 --2- 172.21.15.53:0/1120580731 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4d1c0cce30 0x7f4d040047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:13.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.667+0000 7f4d1b7fe640 1 -- 172.21.15.53:0/1120580731 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d04004d10 msgr2=0x7f4d04005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:09:13.680 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.667+0000 7f4d1b7fe640 1 --2- 172.21.15.53:0/1120580731 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d04004d10 0x7f4d04005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:13.681 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.667+0000 7f4d1b7fe640 1 -- 172.21.15.53:0/1120580731 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d04003530 con 0x7f4d040039b0 2023-06-10T19:09:13.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.671+0000 7f4d1b7fe640 1 --2- 172.21.15.53:0/1120580731 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d040039b0 0x7f4d04003dc0 secure :-1 s=READY pgs=2777 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c00c240 tx=0x7f4d0c01cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9c4c203a22b9106 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:13.683 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.671+0000 7f4d1a7fc640 1 -- 172.21.15.53:0/1120580731 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c0a5b10 con 0x7f4d040039b0 2023-06-10T19:09:13.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.671+0000 7f4d1a7fc640 1 -- 172.21.15.53:0/1120580731 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d0c0a5c70 con 0x7f4d040039b0 2023-06-10T19:09:13.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.671+0000 7f4d1a7fc640 1 -- 172.21.15.53:0/1120580731 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c005b20 con 0x7f4d040039b0 2023-06-10T19:09:13.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.671+0000 7f4d21f22640 1 -- 172.21.15.53:0/1120580731 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d040039b0 msgr2=0x7f4d04003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:13.684 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.671+0000 7f4d21f22640 1 --2- 172.21.15.53:0/1120580731 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d040039b0 0x7f4d04003dc0 secure :-1 s=READY pgs=2777 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c00c240 tx=0x7f4d0c01cc10 comp rx=0 tx=0).stop 2023-06-10T19:09:13.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.671+0000 7f4d1bfff640 1 -- 172.21.15.53:0/1120580731 reap_dead start 2023-06-10T19:09:13.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.671+0000 7f4d21f22640 1 -- 172.21.15.53:0/1120580731 shutdown_connections 2023-06-10T19:09:13.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.671+0000 7f4d21f22640 1 -- 172.21.15.53:0/1120580731 >> 172.21.15.53:0/1120580731 conn(0x7f4d1c0ca830 msgr2=0x7f4d1c0cac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:09:13.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.671+0000 7f4d21f22640 1 -- 172.21.15.53:0/1120580731 shutdown_connections 2023-06-10T19:09:13.685 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.671+0000 7f4d21f22640 1 -- 172.21.15.53:0/1120580731 wait complete. 2023-06-10T19:09:13.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.675+0000 7f4d21f22640 1 Processor -- start 2023-06-10T19:09:13.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.675+0000 7f4d21f22640 1 -- start start 2023-06-10T19:09:13.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.675+0000 7f4d21f22640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d040039b0 0x7f4d1c0b3790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:13.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.675+0000 7f4d21f22640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4d1c0c7590 0x7f4d1c15a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:13.686 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.675+0000 7f4d21f22640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d1c0b0df0 0x7f4d1c0b1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:13.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.675+0000 7f4d21f22640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1c0c25d0 con 0x7f4d040039b0 2023-06-10T19:09:13.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.675+0000 7f4d21f22640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1c15ae90 con 0x7f4d1c0b0df0 2023-06-10T19:09:13.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.675+0000 7f4d21f22640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1c15b130 con 0x7f4d1c0c7590 2023-06-10T19:09:13.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.675+0000 7f4d1b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d040039b0 0x7f4d1c0b3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:13.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.675+0000 7f4d1b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d040039b0 0x7f4d1c0b3790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57292/0 (socket says 172.21.15.53:57292) 2023-06-10T19:09:13.687 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.675+0000 7f4d1b7fe640 1 -- 172.21.15.53:0/3777786502 learned_addr learned my addr 172.21.15.53:0/3777786502 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:09:13.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.675+0000 7f4d1bfff640 1 --2- 172.21.15.53:0/3777786502 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d1c0b0df0 0x7f4d1c0b1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:13.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.675+0000 7f4d1affd640 1 --2- 172.21.15.53:0/3777786502 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4d1c0c7590 0x7f4d1c15a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:13.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.675+0000 7f4d1b7fe640 1 -- 172.21.15.53:0/3777786502 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4d1c0c7590 msgr2=0x7f4d1c15a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:13.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.675+0000 7f4d1b7fe640 1 --2- 172.21.15.53:0/3777786502 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4d1c0c7590 0x7f4d1c15a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:13.688 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.675+0000 7f4d1b7fe640 1 -- 172.21.15.53:0/3777786502 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d1c0b0df0 msgr2=0x7f4d1c0b1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:13.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.675+0000 7f4d1b7fe640 1 --2- 172.21.15.53:0/3777786502 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d1c0b0df0 0x7f4d1c0b1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:13.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.675+0000 7f4d1b7fe640 1 -- 172.21.15.53:0/3777786502 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d1c15b410 con 0x7f4d040039b0 2023-06-10T19:09:13.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.675+0000 7f4d1b7fe640 1 --2- 172.21.15.53:0/3777786502 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d040039b0 0x7f4d1c0b3790 secure :-1 s=READY pgs=2778 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c00c240 tx=0x7f4d04005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:13.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.675+0000 7f4d03fff640 1 -- 172.21.15.53:0/3777786502 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c0b4070 con 0x7f4d040039b0 2023-06-10T19:09:13.689 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.675+0000 7f4d03fff640 1 -- 172.21.15.53:0/3777786502 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d0c001440 con 0x7f4d040039b0 2023-06-10T19:09:13.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.675+0000 7f4d03fff640 1 -- 172.21.15.53:0/3777786502 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c0047f0 con 0x7f4d040039b0 2023-06-10T19:09:13.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.675+0000 7f4d21f22640 1 -- 172.21.15.53:0/3777786502 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d1c15b6f0 con 0x7f4d040039b0 2023-06-10T19:09:13.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.675+0000 7f4d21f22640 1 -- 172.21.15.53:0/3777786502 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d1c0b1780 con 0x7f4d040039b0 2023-06-10T19:09:13.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.675+0000 7f4d21f22640 1 -- 172.21.15.53:0/3777786502 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4d1c15b8e0 con 0x7f4d040039b0 2023-06-10T19:09:13.690 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.675+0000 7f4d03fff640 1 -- 172.21.15.53:0/3777786502 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4d0c004950 con 0x7f4d040039b0 2023-06-10T19:09:13.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.675+0000 7f4d03fff640 1 --2- 172.21.15.53:0/3777786502 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4d08066280 0x7f4d08068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:13.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.675+0000 7f4d03fff640 1 -- 172.21.15.53:0/3777786502 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f4d0c11d890 con 0x7f4d040039b0 2023-06-10T19:09:13.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.675+0000 7f4d03fff640 1 --2- 172.21.15.53:0/3777786502 >> [v2:172.21.15.117:6800/2391250751,v1:172.21.15.117:6801/2391250751] conn(0x7f4d0806c740 0x7f4d0806eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:13.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.675+0000 7f4d03fff640 1 -- 172.21.15.53:0/3777786502 --> [v2:172.21.15.117:6800/2391250751,v1:172.21.15.117:6801/2391250751] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4d0806f200 con 0x7f4d0806c740 2023-06-10T19:09:13.691 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.675+0000 7f4d03fff640 1 -- 172.21.15.53:0/3777786502 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=186) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4d0c11dce0 con 0x7f4d040039b0 2023-06-10T19:09:13.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.675+0000 7f4d1affd640 1 --2- 172.21.15.53:0/3777786502 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4d08066280 0x7f4d08068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:13.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.679+0000 7f4d1bfff640 1 --2- 172.21.15.53:0/3777786502 >> [v2:172.21.15.117:6800/2391250751,v1:172.21.15.117:6801/2391250751] conn(0x7f4d0806c740 0x7f4d0806eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:13.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.679+0000 7f4d1bfff640 1 --2- 172.21.15.53:0/3777786502 >> [v2:172.21.15.117:6800/2391250751,v1:172.21.15.117:6801/2391250751] conn(0x7f4d0806c740 0x7f4d0806eb50 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:13.692 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.679+0000 7f4d1affd640 1 --2- 172.21.15.53:0/3777786502 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4d08066280 0x7f4d08068730 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c1558b0 tx=0x7f4d10009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:13.693 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.679+0000 7f4d03fff640 1 -- 172.21.15.53:0/3777786502 <== osd.6 v2:172.21.15.117:6800/2391250751 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f4d0806f200 con 0x7f4d0806c740 2023-06-10T19:09:13.697 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.691+0000 7f4d21f22640 1 -- 172.21.15.53:0/3777786502 --> [v2:172.21.15.117:6800/2391250751,v1:172.21.15.117:6801/2391250751] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f4d1c0c29b0 con 0x7f4d0806c740 2023-06-10T19:09:13.698 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.691+0000 7f4d03fff640 1 -- 172.21.15.53:0/3777786502 <== osd.6 v2:172.21.15.117:6800/2391250751 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f4d140163a0 con 0x7f4d0806c740 2023-06-10T19:09:13.698 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-06-10T19:09:13.698 INFO:teuthology.orchestra.run.smithi053.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-06-10T19:09:13.699 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-06-10T19:09:13.699 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.691+0000 7f4d21f22640 1 -- 172.21.15.53:0/3777786502 >> [v2:172.21.15.117:6800/2391250751,v1:172.21.15.117:6801/2391250751] conn(0x7f4d0806c740 msgr2=0x7f4d0806eb50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:13.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.691+0000 7f4d21f22640 1 --2- 172.21.15.53:0/3777786502 >> [v2:172.21.15.117:6800/2391250751,v1:172.21.15.117:6801/2391250751] conn(0x7f4d0806c740 0x7f4d0806eb50 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:13.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.691+0000 7f4d21f22640 1 -- 172.21.15.53:0/3777786502 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4d08066280 msgr2=0x7f4d08068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:13.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.691+0000 7f4d21f22640 1 --2- 172.21.15.53:0/3777786502 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f4d08066280 0x7f4d08068730 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c1558b0 tx=0x7f4d10009040 comp rx=0 tx=0).stop 2023-06-10T19:09:13.700 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.691+0000 7f4d21f22640 1 -- 172.21.15.53:0/3777786502 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d040039b0 msgr2=0x7f4d1c0b3790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:13.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.691+0000 7f4d21f22640 1 --2- 172.21.15.53:0/3777786502 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d040039b0 0x7f4d1c0b3790 secure :-1 s=READY pgs=2778 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c00c240 tx=0x7f4d04005800 comp rx=0 tx=0).stop 2023-06-10T19:09:13.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.691+0000 7f4d1bfff640 1 -- 172.21.15.53:0/3777786502 reap_dead start 2023-06-10T19:09:13.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.691+0000 7f4d21f22640 1 -- 172.21.15.53:0/3777786502 shutdown_connections 2023-06-10T19:09:13.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.691+0000 7f4d21f22640 1 -- 172.21.15.53:0/3777786502 >> 172.21.15.53:0/3777786502 conn(0x7f4d1c0ca830 msgr2=0x7f4d1c06b100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:09:13.701 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.691+0000 7f4d21f22640 1 -- 172.21.15.53:0/3777786502 shutdown_connections 2023-06-10T19:09:13.702 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.691+0000 7f4d21f22640 1 -- 172.21.15.53:0/3777786502 wait complete. 2023-06-10T19:09:13.713 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-06-10T19:09:13.833 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.827+0000 7fa6e3abd640 1 Processor -- start 2023-06-10T19:09:13.834 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.827+0000 7fa6e3abd640 1 -- start start 2023-06-10T19:09:13.835 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.827+0000 7fa6e3abd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa6dc15b900 0x7fa6dc0af7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:13.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.827+0000 7fa6e3abd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6dc0afd10 0x7fa6dc158660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:13.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.827+0000 7fa6e3abd640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6dc0b0170 con 0x7fa6dc0cd6d0 2023-06-10T19:09:13.836 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.827+0000 7fa6e3abd640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6dc15bd70 con 0x7fa6dc15b900 2023-06-10T19:09:13.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.827+0000 7fa6e3abd640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6dc06b7a0 con 0x7fa6dc0afd10 2023-06-10T19:09:13.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.831+0000 7fa6e1058640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa6dc15b900 0x7fa6dc0af7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:13.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.831+0000 7fa6e1058640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa6dc15b900 0x7fa6dc0af7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57304/0 (socket says 172.21.15.53:57304) 2023-06-10T19:09:13.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.831+0000 7fa6e1058640 1 -- 172.21.15.53:0/3749557565 learned_addr learned my addr 172.21.15.53:0/3749557565 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:09:13.837 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.831+0000 7fa6e205a640 1 --2- 172.21.15.53:0/3749557565 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6dc0afd10 0x7fa6dc158660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:13.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.831+0000 7fa6e1058640 1 -- 172.21.15.53:0/3749557565 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6dc0afd10 msgr2=0x7fa6dc158660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:09:13.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.831+0000 7fa6e1058640 1 --2- 172.21.15.53:0/3749557565 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6dc0afd10 0x7fa6dc158660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:13.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.831+0000 7fa6e1058640 1 -- 172.21.15.53:0/3749557565 >> v1:172.21.15.117:6789/0 conn(0x7fa6dc0cd6d0 legacy=0x7fa6dc0c83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:13.838 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.831+0000 7fa6e1058640 1 -- 172.21.15.53:0/3749557565 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6dc06a8b0 con 0x7fa6dc15b900 2023-06-10T19:09:13.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.831+0000 7fa6e1058640 1 --2- 172.21.15.53:0/3749557565 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6dc15b900 0x7fa6dc0af7d0 secure :-1 s=READY pgs=2779 cs=0 l=1 rev1=1 crypto rx=0x7fa6d0009870 tx=0x7fa6d001d620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a03a59d9acdaf6ea server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:13.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.831+0000 7fa6e0857640 1 -- 172.21.15.53:0/3749557565 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d00aa650 con 0x7fa6dc15b900 2023-06-10T19:09:13.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.831+0000 7fa6e0857640 1 -- 172.21.15.53:0/3749557565 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6d00aa7b0 con 0x7fa6dc15b900 2023-06-10T19:09:13.840 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.831+0000 7fa6e0857640 1 -- 172.21.15.53:0/3749557565 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d00aab40 con 0x7fa6dc15b900 2023-06-10T19:09:13.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.831+0000 7fa6e3abd640 1 -- 172.21.15.53:0/3749557565 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6dc15b900 msgr2=0x7fa6dc0af7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:13.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.831+0000 7fa6e3abd640 1 --2- 172.21.15.53:0/3749557565 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6dc15b900 0x7fa6dc0af7d0 secure :-1 s=READY pgs=2779 cs=0 l=1 rev1=1 crypto rx=0x7fa6d0009870 tx=0x7fa6d001d620 comp rx=0 tx=0).stop 2023-06-10T19:09:13.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.831+0000 7fa6e3abd640 1 -- 172.21.15.53:0/3749557565 shutdown_connections 2023-06-10T19:09:13.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.831+0000 7fa6e3abd640 1 --2- 172.21.15.53:0/3749557565 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6dc0afd10 0x7fa6dc158660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:13.841 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.831+0000 7fa6e3abd640 1 --2- 172.21.15.53:0/3749557565 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6dc15b900 0x7fa6dc0af7d0 unknown :-1 s=CLOSED pgs=2779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:13.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.831+0000 7fa6e3abd640 1 -- 172.21.15.53:0/3749557565 >> 172.21.15.53:0/3749557565 conn(0x7fa6dc0ce9e0 msgr2=0x7fa6dc0ca7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:09:13.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.831+0000 7fa6e3abd640 1 -- 172.21.15.53:0/3749557565 shutdown_connections 2023-06-10T19:09:13.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.831+0000 7fa6e3abd640 1 -- 172.21.15.53:0/3749557565 wait complete. 2023-06-10T19:09:13.842 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.835+0000 7fa6e3abd640 1 Processor -- start 2023-06-10T19:09:13.843 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.835+0000 7fa6e3abd640 1 -- start start 2023-06-10T19:09:13.844 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.835+0000 7fa6e3abd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6dc0afd10 0x7fa6dc152b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:13.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.835+0000 7fa6e3abd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6dc0cd6d0 0x7fa6dc14bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:13.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.835+0000 7fa6e3abd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6dc15b900 0x7fa6dc0af140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:13.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.835+0000 7fa6e3abd640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6dc153fb0 con 0x7fa6dc15b900 2023-06-10T19:09:13.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.835+0000 7fa6e3abd640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6dc1533a0 con 0x7fa6dc0afd10 2023-06-10T19:09:13.845 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.835+0000 7fa6e3abd640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6dc153680 con 0x7fa6dc0cd6d0 2023-06-10T19:09:13.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.835+0000 7fa6e205a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6dc15b900 0x7fa6dc0af140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:13.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.835+0000 7fa6e205a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6dc15b900 0x7fa6dc0af140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57314/0 (socket says 172.21.15.53:57314) 2023-06-10T19:09:13.846 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.835+0000 7fa6e205a640 1 -- 172.21.15.53:0/2031104361 learned_addr learned my addr 172.21.15.53:0/2031104361 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:09:13.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.835+0000 7fa6e1058640 1 --2- 172.21.15.53:0/2031104361 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6dc0cd6d0 0x7fa6dc14bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:13.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.835+0000 7fa6e1859640 1 --2- 172.21.15.53:0/2031104361 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6dc0afd10 0x7fa6dc152b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:13.847 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.835+0000 7fa6e205a640 1 -- 172.21.15.53:0/2031104361 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6dc0cd6d0 msgr2=0x7fa6dc14bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:13.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.835+0000 7fa6e205a640 1 --2- 172.21.15.53:0/2031104361 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6dc0cd6d0 0x7fa6dc14bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:13.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.835+0000 7fa6e205a640 1 -- 172.21.15.53:0/2031104361 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6dc0afd10 msgr2=0x7fa6dc152b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:13.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.835+0000 7fa6e205a640 1 --2- 172.21.15.53:0/2031104361 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6dc0afd10 0x7fa6dc152b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:13.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.835+0000 7fa6e205a640 1 -- 172.21.15.53:0/2031104361 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6d00094d0 con 0x7fa6dc15b900 2023-06-10T19:09:13.848 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.835+0000 7fa6e1859640 1 --2- 172.21.15.53:0/2031104361 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6dc0afd10 0x7fa6dc152b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:09:13.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.835+0000 7fa6e205a640 1 --2- 172.21.15.53:0/2031104361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6dc15b900 0x7fa6dc0af140 secure :-1 s=READY pgs=2780 cs=0 l=1 rev1=1 crypto rx=0x7fa6d400efc0 tx=0x7fa6d400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:13.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.835+0000 7fa6ce7fc640 1 -- 172.21.15.53:0/2031104361 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d4009ba0 con 0x7fa6dc15b900 2023-06-10T19:09:13.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.835+0000 7fa6ce7fc640 1 -- 172.21.15.53:0/2031104361 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6d400f040 con 0x7fa6dc15b900 2023-06-10T19:09:13.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.835+0000 7fa6e3abd640 1 -- 172.21.15.53:0/2031104361 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6dc153960 con 0x7fa6dc15b900 2023-06-10T19:09:13.849 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.835+0000 7fa6ce7fc640 1 -- 172.21.15.53:0/2031104361 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d40146c0 con 0x7fa6dc15b900 2023-06-10T19:09:13.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.835+0000 7fa6e3abd640 1 -- 172.21.15.53:0/2031104361 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6dc1530b0 con 0x7fa6dc15b900 2023-06-10T19:09:13.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.835+0000 7fa6e3abd640 1 -- 172.21.15.53:0/2031104361 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6dc162ac0 con 0x7fa6dc15b900 2023-06-10T19:09:13.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.839+0000 7fa6ce7fc640 1 -- 172.21.15.53:0/2031104361 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa6d4014820 con 0x7fa6dc15b900 2023-06-10T19:09:13.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.839+0000 7fa6ce7fc640 1 --2- 172.21.15.53:0/2031104361 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa6c00662b0 0x7fa6c0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:13.850 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.839+0000 7fa6ce7fc640 1 -- 172.21.15.53:0/2031104361 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fa6d4084580 con 0x7fa6dc15b900 2023-06-10T19:09:13.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.839+0000 7fa6e1859640 1 --2- 172.21.15.53:0/2031104361 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa6c00662b0 0x7fa6c0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:13.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.839+0000 7fa6e1859640 1 --2- 172.21.15.53:0/2031104361 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa6c00662b0 0x7fa6c0068760 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7fa6d8000fc0 tx=0x7fa6d8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:13.851 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.843+0000 7fa6ce7fc640 1 -- 172.21.15.53:0/2031104361 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa6d4051cd0 con 0x7fa6dc15b900 2023-06-10T19:09:14.002 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.995+0000 7fa6e3abd640 1 -- 172.21.15.53:0/2031104361 --> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fa6dc06b150 con 0x7fa6c00662b0 2023-06-10T19:09:14.003 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.995+0000 7fa6ce7fc640 1 -- 172.21.15.53:0/2031104361 <== mgr.4105 v2:172.21.15.117:6832/3061986771 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa6d8001cf0 con 0x7fa6c00662b0 2023-06-10T19:09:14.003 INFO:teuthology.orchestra.run.smithi053.stderr:instructed osd(s) 6 to deep-scrub 2023-06-10T19:09:14.005 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.999+0000 7fa6e3abd640 1 -- 172.21.15.53:0/2031104361 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa6c00662b0 msgr2=0x7fa6c0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:14.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.999+0000 7fa6e3abd640 1 --2- 172.21.15.53:0/2031104361 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa6c00662b0 0x7fa6c0068760 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7fa6d8000fc0 tx=0x7fa6d8009040 comp rx=0 tx=0).stop 2023-06-10T19:09:14.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.999+0000 7fa6e3abd640 1 -- 172.21.15.53:0/2031104361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6dc15b900 msgr2=0x7fa6dc0af140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:14.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.999+0000 7fa6e3abd640 1 --2- 172.21.15.53:0/2031104361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6dc15b900 0x7fa6dc0af140 secure :-1 s=READY pgs=2780 cs=0 l=1 rev1=1 crypto rx=0x7fa6d400efc0 tx=0x7fa6d400c490 comp rx=0 tx=0).stop 2023-06-10T19:09:14.006 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.999+0000 7fa6e3abd640 1 -- 172.21.15.53:0/2031104361 shutdown_connections 2023-06-10T19:09:14.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.999+0000 7fa6e3abd640 1 --2- 172.21.15.53:0/2031104361 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa6c00662b0 0x7fa6c0068760 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:14.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.999+0000 7fa6e3abd640 1 --2- 172.21.15.53:0/2031104361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6dc15b900 0x7fa6dc0af140 unknown :-1 s=CLOSED pgs=2780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:14.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.999+0000 7fa6e3abd640 1 --2- 172.21.15.53:0/2031104361 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6dc0cd6d0 0x7fa6dc14bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:14.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.999+0000 7fa6e3abd640 1 --2- 172.21.15.53:0/2031104361 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6dc0afd10 0x7fa6dc152b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:14.007 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.999+0000 7fa6e3abd640 1 -- 172.21.15.53:0/2031104361 >> 172.21.15.53:0/2031104361 conn(0x7fa6dc0ce9e0 msgr2=0x7fa6dc156940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:09:14.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.999+0000 7fa6e3abd640 1 -- 172.21.15.53:0/2031104361 shutdown_connections 2023-06-10T19:09:14.008 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:13.999+0000 7fa6e3abd640 1 -- 172.21.15.53:0/2031104361 wait complete. 2023-06-10T19:09:14.023 INFO:tasks.ceph:Scrubbing osd.7 2023-06-10T19:09:14.024 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-06-10T19:09:14.154 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.147+0000 7fe4c2e1a640 1 Processor -- start 2023-06-10T19:09:14.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.147+0000 7fe4c2e1a640 1 -- start start 2023-06-10T19:09:14.155 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.151+0000 7fe4c2e1a640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe4bc06b840 0x7fe4bc0cf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:14.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.151+0000 7fe4c2e1a640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4bc0cf380 con 0x7fe4bc15ba00 2023-06-10T19:09:14.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.151+0000 7fe4c2e1a640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4bc160260 con 0x7fe4bc15f370 2023-06-10T19:09:14.156 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.151+0000 7fe4c2e1a640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4bc0ceb40 con 0x7fe4bc06b840 2023-06-10T19:09:14.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.151+0000 7fe4bbfff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fe4bc15ba00 0x7fe4bc06bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:49660/0 (socket says 172.21.15.53:49660) 2023-06-10T19:09:14.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.151+0000 7fe4bbfff640 1 -- 172.21.15.53:0/897935926 learned_addr learned my addr 172.21.15.53:0/897935926 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:09:14.157 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.151+0000 7fe4c0bb6640 1 --2- 172.21.15.53:0/897935926 >> v2:172.21.15.117:3300/0 conn(0x7fe4bc06b840 0x7fe4bc0cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:14.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.151+0000 7fe4bb7fe640 1 -- 172.21.15.53:0/897935926 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2156149397 0 0) 0x7fe4bc0cf380 con 0x7fe4bc15ba00 2023-06-10T19:09:14.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.151+0000 7fe4bb7fe640 1 -- 172.21.15.53:0/897935926 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4a4003530 con 0x7fe4bc15ba00 2023-06-10T19:09:14.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.151+0000 7fe4bb7fe640 1 -- 172.21.15.53:0/897935926 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4172715052 0 0) 0x7fe4a4003530 con 0x7fe4bc15ba00 2023-06-10T19:09:14.159 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.151+0000 7fe4bb7fe640 1 -- 172.21.15.53:0/897935926 >> v2:172.21.15.117:3300/0 conn(0x7fe4bc06b840 msgr2=0x7fe4bc0cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:09:14.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.151+0000 7fe4bb7fe640 1 --2- 172.21.15.53:0/897935926 >> v2:172.21.15.117:3300/0 conn(0x7fe4bc06b840 0x7fe4bc0cf810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:14.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.151+0000 7fe4bb7fe640 1 -- 172.21.15.53:0/897935926 >> v1:172.21.15.117:6789/0 conn(0x7fe4bc15f370 legacy=0x7fe4bc06a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:14.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.151+0000 7fe4bb7fe640 1 -- 172.21.15.53:0/897935926 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4bc15ff80 con 0x7fe4bc15ba00 2023-06-10T19:09:14.160 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.151+0000 7fe4bb7fe640 1 -- 172.21.15.53:0/897935926 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7fe4b0001680 con 0x7fe4bc15ba00 2023-06-10T19:09:14.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.151+0000 7fe4bb7fe640 1 -- 172.21.15.53:0/897935926 >> v1:172.21.15.53:6789/0 conn(0x7fe4bc15ba00 legacy=0x7fe4bc06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:14.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.151+0000 7fe4bb7fe640 1 --2- 172.21.15.53:0/897935926 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4a4003980 0x7fe4a4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:14.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.151+0000 7fe4bb7fe640 1 --2- 172.21.15.53:0/897935926 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4a40047d0 0x7fe4a4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:14.161 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.151+0000 7fe4bb7fe640 1 --2- 172.21.15.53:0/897935926 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4a4005180 0x7fe4a400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:14.162 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.151+0000 7fe4bb7fe640 1 -- 172.21.15.53:0/897935926 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a400bfd0 con 0x7fe4a40047d0 2023-06-10T19:09:14.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.151+0000 7fe4bb7fe640 1 -- 172.21.15.53:0/897935926 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a400c140 con 0x7fe4a4003980 2023-06-10T19:09:14.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.151+0000 7fe4bb7fe640 1 -- 172.21.15.53:0/897935926 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a400c300 con 0x7fe4a4005180 2023-06-10T19:09:14.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.151+0000 7fe4bbfff640 1 --2- 172.21.15.53:0/897935926 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4a40047d0 0x7fe4a4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:14.164 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.151+0000 7fe4c0bb6640 1 --2- 172.21.15.53:0/897935926 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4a4003980 0x7fe4a4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:14.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.151+0000 7fe4c13b7640 1 --2- 172.21.15.53:0/897935926 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4a4005180 0x7fe4a400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:14.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.151+0000 7fe4bbfff640 1 -- 172.21.15.53:0/897935926 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4a4005180 msgr2=0x7fe4a400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:09:14.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.151+0000 7fe4bbfff640 1 --2- 172.21.15.53:0/897935926 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4a4005180 0x7fe4a400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:14.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.151+0000 7fe4bbfff640 1 -- 172.21.15.53:0/897935926 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4a4003980 msgr2=0x7fe4a4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:09:14.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.151+0000 7fe4bbfff640 1 --2- 172.21.15.53:0/897935926 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4a4003980 0x7fe4a4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:14.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.151+0000 7fe4bbfff640 1 -- 172.21.15.53:0/897935926 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a4003530 con 0x7fe4a40047d0 2023-06-10T19:09:14.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.151+0000 7fe4c13b7640 1 --2- 172.21.15.53:0/897935926 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4a4005180 0x7fe4a400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:09:14.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.151+0000 7fe4c13b7640 1 -- 172.21.15.53:0/897935926 reap_dead start 2023-06-10T19:09:14.174 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.155+0000 7fe4bbfff640 1 --2- 172.21.15.53:0/897935926 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4a40047d0 0x7fe4a4004c40 secure :-1 s=READY pgs=2782 cs=0 l=1 rev1=1 crypto rx=0x7fe4b000c240 tx=0x7fe4b001f3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97b499afc4dbe408 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:14.175 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.155+0000 7fe4bb7fe640 1 -- 172.21.15.53:0/897935926 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b00058e0 con 0x7fe4a40047d0 2023-06-10T19:09:14.175 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.155+0000 7fe4bb7fe640 1 -- 172.21.15.53:0/897935926 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4b0005a40 con 0x7fe4a40047d0 2023-06-10T19:09:14.175 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.155+0000 7fe4bb7fe640 1 -- 172.21.15.53:0/897935926 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b0005e70 con 0x7fe4a40047d0 2023-06-10T19:09:14.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.155+0000 7fe4c2e1a640 1 -- 172.21.15.53:0/897935926 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4a40047d0 msgr2=0x7fe4a4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:14.176 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.155+0000 7fe4c2e1a640 1 --2- 172.21.15.53:0/897935926 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4a40047d0 0x7fe4a4004c40 secure :-1 s=READY pgs=2782 cs=0 l=1 rev1=1 crypto rx=0x7fe4b000c240 tx=0x7fe4b001f3b0 comp rx=0 tx=0).stop 2023-06-10T19:09:14.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.155+0000 7fe4c2e1a640 1 -- 172.21.15.53:0/897935926 shutdown_connections 2023-06-10T19:09:14.177 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.155+0000 7fe4c2e1a640 1 --2- 172.21.15.53:0/897935926 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4a40047d0 0x7fe4a4004c40 unknown :-1 s=CLOSED pgs=2782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:14.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.155+0000 7fe4c2e1a640 1 -- 172.21.15.53:0/897935926 >> 172.21.15.53:0/897935926 conn(0x7fe4bc06a0b0 msgr2=0x7fe4bc06d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:09:14.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.155+0000 7fe4c2e1a640 1 -- 172.21.15.53:0/897935926 shutdown_connections 2023-06-10T19:09:14.178 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.155+0000 7fe4c2e1a640 1 -- 172.21.15.53:0/897935926 wait complete. 2023-06-10T19:09:14.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.155+0000 7fe4c2e1a640 1 Processor -- start 2023-06-10T19:09:14.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.155+0000 7fe4c2e1a640 1 -- start start 2023-06-10T19:09:14.179 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.159+0000 7fe4c2e1a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4a40047d0 0x7fe4bc148150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:14.180 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.159+0000 7fe4c2e1a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4bc06f100 0x7fe4bc06f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:14.180 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.159+0000 7fe4c2e1a640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4bc158180 0x7fe4bc1585f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:14.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.159+0000 7fe4c2e1a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4bc0c3960 con 0x7fe4bc06f100 2023-06-10T19:09:14.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.159+0000 7fe4c2e1a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4bc0c4900 con 0x7fe4a40047d0 2023-06-10T19:09:14.181 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.159+0000 7fe4c2e1a640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4bc06fab0 con 0x7fe4bc158180 2023-06-10T19:09:14.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.159+0000 7fe4bbfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4bc06f100 0x7fe4bc06f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:14.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.159+0000 7fe4bbfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4bc06f100 0x7fe4bc06f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57320/0 (socket says 172.21.15.53:57320) 2023-06-10T19:09:14.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.159+0000 7fe4bbfff640 1 -- 172.21.15.53:0/2977460877 learned_addr learned my addr 172.21.15.53:0/2977460877 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:09:14.182 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.159+0000 7fe4c13b7640 1 --2- 172.21.15.53:0/2977460877 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4bc158180 0x7fe4bc1585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:14.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.159+0000 7fe4c0bb6640 1 --2- 172.21.15.53:0/2977460877 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4a40047d0 0x7fe4bc148150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:14.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.159+0000 7fe4bbfff640 1 -- 172.21.15.53:0/2977460877 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4bc158180 msgr2=0x7fe4bc1585f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:14.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.159+0000 7fe4bbfff640 1 --2- 172.21.15.53:0/2977460877 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe4bc158180 0x7fe4bc1585f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:14.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.159+0000 7fe4bbfff640 1 -- 172.21.15.53:0/2977460877 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4a40047d0 msgr2=0x7fe4bc148150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:14.183 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.159+0000 7fe4bbfff640 1 --2- 172.21.15.53:0/2977460877 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4a40047d0 0x7fe4bc148150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:14.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.159+0000 7fe4bbfff640 1 -- 172.21.15.53:0/2977460877 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4bc158ef0 con 0x7fe4bc06f100 2023-06-10T19:09:14.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.159+0000 7fe4c0bb6640 1 --2- 172.21.15.53:0/2977460877 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4a40047d0 0x7fe4bc148150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:09:14.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.159+0000 7fe4bbfff640 1 --2- 172.21.15.53:0/2977460877 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4bc06f100 0x7fe4bc06f570 secure :-1 s=READY pgs=2783 cs=0 l=1 rev1=1 crypto rx=0x7fe4b0001940 tx=0x7fe4a4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:14.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.159+0000 7fe4b97fa640 1 -- 172.21.15.53:0/2977460877 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b00b7070 con 0x7fe4bc06f100 2023-06-10T19:09:14.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.159+0000 7fe4b97fa640 1 -- 172.21.15.53:0/2977460877 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4b0005bb0 con 0x7fe4bc06f100 2023-06-10T19:09:14.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.159+0000 7fe4c2e1a640 1 -- 172.21.15.53:0/2977460877 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4bc0c3b40 con 0x7fe4bc06f100 2023-06-10T19:09:14.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.159+0000 7fe4b97fa640 1 -- 172.21.15.53:0/2977460877 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b0007030 con 0x7fe4bc06f100 2023-06-10T19:09:14.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.159+0000 7fe4c2e1a640 1 -- 172.21.15.53:0/2977460877 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4bc0c4100 con 0x7fe4bc06f100 2023-06-10T19:09:14.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.159+0000 7fe4c2e1a640 1 -- 172.21.15.53:0/2977460877 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe4bc0cf010 con 0x7fe4bc06f100 2023-06-10T19:09:14.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.159+0000 7fe4b97fa640 1 -- 172.21.15.53:0/2977460877 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe4b0007190 con 0x7fe4bc06f100 2023-06-10T19:09:14.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.159+0000 7fe4b97fa640 1 --2- 172.21.15.53:0/2977460877 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe4a8066280 0x7fe4a8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:14.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.159+0000 7fe4b97fa640 1 -- 172.21.15.53:0/2977460877 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fe4b0120e60 con 0x7fe4bc06f100 2023-06-10T19:09:14.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.159+0000 7fe4b97fa640 1 --2- 172.21.15.53:0/2977460877 >> [v2:172.21.15.117:6816/4204353710,v1:172.21.15.117:6817/4204353710] conn(0x7fe4a806c740 0x7fe4a806eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:14.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.159+0000 7fe4b97fa640 1 -- 172.21.15.53:0/2977460877 --> [v2:172.21.15.117:6816/4204353710,v1:172.21.15.117:6817/4204353710] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe4a806f200 con 0x7fe4a806c740 2023-06-10T19:09:14.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.159+0000 7fe4b97fa640 1 -- 172.21.15.53:0/2977460877 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=186) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe4b01212b0 con 0x7fe4bc06f100 2023-06-10T19:09:14.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.159+0000 7fe4c0bb6640 1 --2- 172.21.15.53:0/2977460877 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe4a8066280 0x7fe4a8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:14.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.159+0000 7fe4c13b7640 1 --2- 172.21.15.53:0/2977460877 >> [v2:172.21.15.117:6816/4204353710,v1:172.21.15.117:6817/4204353710] conn(0x7fe4a806c740 0x7fe4a806eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:14.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.163+0000 7fe4c13b7640 1 --2- 172.21.15.53:0/2977460877 >> [v2:172.21.15.117:6816/4204353710,v1:172.21.15.117:6817/4204353710] conn(0x7fe4a806c740 0x7fe4a806eb50 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:14.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.163+0000 7fe4c0bb6640 1 --2- 172.21.15.53:0/2977460877 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe4a8066280 0x7fe4a8068730 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac007440 tx=0x7fe4ac00b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:14.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.163+0000 7fe4b97fa640 1 -- 172.21.15.53:0/2977460877 <== osd.7 v2:172.21.15.117:6816/4204353710 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fe4a806f200 con 0x7fe4a806c740 2023-06-10T19:09:14.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.175+0000 7fe4c2e1a640 1 -- 172.21.15.53:0/2977460877 --> [v2:172.21.15.117:6816/4204353710,v1:172.21.15.117:6817/4204353710] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe4bc0ced30 con 0x7fe4a806c740 2023-06-10T19:09:14.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.175+0000 7fe4b97fa640 1 -- 172.21.15.53:0/2977460877 <== osd.7 v2:172.21.15.117:6816/4204353710 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fe4b4005330 con 0x7fe4a806c740 2023-06-10T19:09:14.189 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-06-10T19:09:14.189 INFO:teuthology.orchestra.run.smithi053.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-06-10T19:09:14.189 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-06-10T19:09:14.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.175+0000 7fe4c2e1a640 1 -- 172.21.15.53:0/2977460877 >> [v2:172.21.15.117:6816/4204353710,v1:172.21.15.117:6817/4204353710] conn(0x7fe4a806c740 msgr2=0x7fe4a806eb50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:14.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.175+0000 7fe4c2e1a640 1 --2- 172.21.15.53:0/2977460877 >> [v2:172.21.15.117:6816/4204353710,v1:172.21.15.117:6817/4204353710] conn(0x7fe4a806c740 0x7fe4a806eb50 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:14.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.175+0000 7fe4c2e1a640 1 -- 172.21.15.53:0/2977460877 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe4a8066280 msgr2=0x7fe4a8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:14.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.175+0000 7fe4c2e1a640 1 --2- 172.21.15.53:0/2977460877 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe4a8066280 0x7fe4a8068730 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac007440 tx=0x7fe4ac00b040 comp rx=0 tx=0).stop 2023-06-10T19:09:14.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.175+0000 7fe4c2e1a640 1 -- 172.21.15.53:0/2977460877 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4bc06f100 msgr2=0x7fe4bc06f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:14.191 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.175+0000 7fe4c2e1a640 1 --2- 172.21.15.53:0/2977460877 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4bc06f100 0x7fe4bc06f570 secure :-1 s=READY pgs=2783 cs=0 l=1 rev1=1 crypto rx=0x7fe4b0001940 tx=0x7fe4a4005800 comp rx=0 tx=0).stop 2023-06-10T19:09:14.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.175+0000 7fe4c13b7640 1 -- 172.21.15.53:0/2977460877 reap_dead start 2023-06-10T19:09:14.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.175+0000 7fe4c2e1a640 1 -- 172.21.15.53:0/2977460877 shutdown_connections 2023-06-10T19:09:14.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.175+0000 7fe4c2e1a640 1 -- 172.21.15.53:0/2977460877 >> 172.21.15.53:0/2977460877 conn(0x7fe4bc06a0b0 msgr2=0x7fe4bc06bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:09:14.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.175+0000 7fe4c2e1a640 1 -- 172.21.15.53:0/2977460877 shutdown_connections 2023-06-10T19:09:14.196 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.175+0000 7fe4c2e1a640 1 -- 172.21.15.53:0/2977460877 wait complete. 2023-06-10T19:09:14.198 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-06-10T19:09:14.307 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.303+0000 7fa385cc2640 1 Processor -- start 2023-06-10T19:09:14.308 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.303+0000 7fa385cc2640 1 -- start start 2023-06-10T19:09:14.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.303+0000 7fa385cc2640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa3800b3ac0 0x7fa3800b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:14.309 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.303+0000 7fa385cc2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3800d1b00 0x7fa3800b43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:14.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.303+0000 7fa385cc2640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3800ccde0 con 0x7fa3800cc690 2023-06-10T19:09:14.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.303+0000 7fa385cc2640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3800ced00 con 0x7fa3800b3ac0 2023-06-10T19:09:14.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.303+0000 7fa385cc2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3800cfc10 con 0x7fa3800d1b00 2023-06-10T19:09:14.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.303+0000 7fa37f7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa3800b3ac0 0x7fa3800b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:14.310 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.303+0000 7fa37effd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fa3800cc690 0x7fa38015f3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:49668/0 (socket says 172.21.15.53:49668) 2023-06-10T19:09:14.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.303+0000 7fa37effd640 1 -- 172.21.15.53:0/3080723472 learned_addr learned my addr 172.21.15.53:0/3080723472 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:09:14.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.303+0000 7fa37ffff640 1 --2- 172.21.15.53:0/3080723472 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3800d1b00 0x7fa3800b43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:14.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.303+0000 7fa37f7fe640 1 -- 172.21.15.53:0/3080723472 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3800d1b00 msgr2=0x7fa3800b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:09:14.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.303+0000 7fa37f7fe640 1 --2- 172.21.15.53:0/3080723472 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3800d1b00 0x7fa3800b43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:14.311 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.303+0000 7fa37f7fe640 1 -- 172.21.15.53:0/3080723472 >> v1:172.21.15.53:6789/0 conn(0x7fa3800cc690 legacy=0x7fa38015f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:14.312 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.303+0000 7fa37f7fe640 1 -- 172.21.15.53:0/3080723472 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3800b4910 con 0x7fa3800b3ac0 2023-06-10T19:09:14.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.307+0000 7fa37f7fe640 1 --2- 172.21.15.53:0/3080723472 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3800b3ac0 0x7fa3800b3e90 secure :-1 s=READY pgs=2785 cs=0 l=1 rev1=1 crypto rx=0x7fa3700097c0 tx=0x7fa37001c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8464e575e6c8811 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:14.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.307+0000 7fa37e7fc640 1 -- 172.21.15.53:0/3080723472 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3700ab600 con 0x7fa3800b3ac0 2023-06-10T19:09:14.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.307+0000 7fa37e7fc640 1 -- 172.21.15.53:0/3080723472 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3700a7050 con 0x7fa3800b3ac0 2023-06-10T19:09:14.313 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.307+0000 7fa37e7fc640 1 -- 172.21.15.53:0/3080723472 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3700ab980 con 0x7fa3800b3ac0 2023-06-10T19:09:14.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.307+0000 7fa385cc2640 1 -- 172.21.15.53:0/3080723472 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3800b3ac0 msgr2=0x7fa3800b3e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:14.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.307+0000 7fa385cc2640 1 --2- 172.21.15.53:0/3080723472 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3800b3ac0 0x7fa3800b3e90 secure :-1 s=READY pgs=2785 cs=0 l=1 rev1=1 crypto rx=0x7fa3700097c0 tx=0x7fa37001c360 comp rx=0 tx=0).stop 2023-06-10T19:09:14.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.307+0000 7fa385cc2640 1 -- 172.21.15.53:0/3080723472 shutdown_connections 2023-06-10T19:09:14.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.307+0000 7fa385cc2640 1 --2- 172.21.15.53:0/3080723472 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3800d1b00 0x7fa3800b43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:14.314 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.307+0000 7fa385cc2640 1 --2- 172.21.15.53:0/3080723472 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3800b3ac0 0x7fa3800b3e90 unknown :-1 s=CLOSED pgs=2785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:14.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.307+0000 7fa385cc2640 1 -- 172.21.15.53:0/3080723472 >> 172.21.15.53:0/3080723472 conn(0x7fa380069de0 msgr2=0x7fa38006a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:09:14.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.307+0000 7fa385cc2640 1 -- 172.21.15.53:0/3080723472 shutdown_connections 2023-06-10T19:09:14.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.307+0000 7fa385cc2640 1 -- 172.21.15.53:0/3080723472 wait complete. 2023-06-10T19:09:14.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.307+0000 7fa385cc2640 1 Processor -- start 2023-06-10T19:09:14.315 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.307+0000 7fa385cc2640 1 -- start start 2023-06-10T19:09:14.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.307+0000 7fa385cc2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3800b3ac0 0x7fa380159170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:14.317 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.307+0000 7fa385cc2640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3800cc690 0x7fa3800cb030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:14.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.307+0000 7fa385cc2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3800d1b00 0x7fa3800b2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:14.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.307+0000 7fa385cc2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3800c95a0 con 0x7fa3800b3ac0 2023-06-10T19:09:14.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.307+0000 7fa385cc2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3800c9880 con 0x7fa3800d1b00 2023-06-10T19:09:14.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.307+0000 7fa385cc2640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3800c9b60 con 0x7fa3800cc690 2023-06-10T19:09:14.318 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.307+0000 7fa37f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3800b3ac0 0x7fa380159170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:14.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.307+0000 7fa37f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3800b3ac0 0x7fa380159170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57328/0 (socket says 172.21.15.53:57328) 2023-06-10T19:09:14.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.307+0000 7fa37f7fe640 1 -- 172.21.15.53:0/162965921 learned_addr learned my addr 172.21.15.53:0/162965921 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:09:14.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.307+0000 7fa37effd640 1 --2- 172.21.15.53:0/162965921 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3800cc690 0x7fa3800cb030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:14.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.307+0000 7fa37ffff640 1 --2- 172.21.15.53:0/162965921 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3800d1b00 0x7fa3800b2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:14.319 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.307+0000 7fa37f7fe640 1 -- 172.21.15.53:0/162965921 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3800cc690 msgr2=0x7fa3800cb030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:14.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.307+0000 7fa37f7fe640 1 --2- 172.21.15.53:0/162965921 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3800cc690 0x7fa3800cb030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:14.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.307+0000 7fa37f7fe640 1 -- 172.21.15.53:0/162965921 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3800d1b00 msgr2=0x7fa3800b2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:14.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.307+0000 7fa37f7fe640 1 --2- 172.21.15.53:0/162965921 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3800d1b00 0x7fa3800b2300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:14.320 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.307+0000 7fa37f7fe640 1 -- 172.21.15.53:0/162965921 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa370009420 con 0x7fa3800b3ac0 2023-06-10T19:09:14.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.307+0000 7fa37f7fe640 1 --2- 172.21.15.53:0/162965921 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3800b3ac0 0x7fa380159170 secure :-1 s=READY pgs=2786 cs=0 l=1 rev1=1 crypto rx=0x7fa370019f90 tx=0x7fa370019100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:14.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.307+0000 7fa367fff640 1 -- 172.21.15.53:0/162965921 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3700b4610 con 0x7fa3800b3ac0 2023-06-10T19:09:14.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.307+0000 7fa367fff640 1 -- 172.21.15.53:0/162965921 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3700abe90 con 0x7fa3800b3ac0 2023-06-10T19:09:14.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.307+0000 7fa385cc2640 1 -- 172.21.15.53:0/162965921 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3800c9e40 con 0x7fa3800b3ac0 2023-06-10T19:09:14.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.307+0000 7fa367fff640 1 -- 172.21.15.53:0/162965921 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3700b49d0 con 0x7fa3800b3ac0 2023-06-10T19:09:14.321 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.307+0000 7fa385cc2640 1 -- 172.21.15.53:0/162965921 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3800cb570 con 0x7fa3800b3ac0 2023-06-10T19:09:14.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.311+0000 7fa385cc2640 1 -- 172.21.15.53:0/162965921 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa38004d790 con 0x7fa3800b3ac0 2023-06-10T19:09:14.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.311+0000 7fa367fff640 1 -- 172.21.15.53:0/162965921 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa3700b2040 con 0x7fa3800b3ac0 2023-06-10T19:09:14.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.311+0000 7fa367fff640 1 --2- 172.21.15.53:0/162965921 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa36c066280 0x7fa36c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:14.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.311+0000 7fa367fff640 1 -- 172.21.15.53:0/162965921 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fa37011da70 con 0x7fa3800b3ac0 2023-06-10T19:09:14.322 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.311+0000 7fa37effd640 1 --2- 172.21.15.53:0/162965921 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa36c066280 0x7fa36c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:14.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.311+0000 7fa37effd640 1 --2- 172.21.15.53:0/162965921 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa36c066280 0x7fa36c068730 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7fa3800c6cd0 tx=0x7fa374009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:14.323 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.315+0000 7fa367fff640 1 -- 172.21.15.53:0/162965921 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa3700eb250 con 0x7fa3800b3ac0 2023-06-10T19:09:14.473 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.467+0000 7fa385cc2640 1 -- 172.21.15.53:0/162965921 --> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fa3800cf230 con 0x7fa36c066280 2023-06-10T19:09:14.474 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.467+0000 7fa367fff640 1 -- 172.21.15.53:0/162965921 <== mgr.4105 v2:172.21.15.117:6832/3061986771 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa374001c80 con 0x7fa36c066280 2023-06-10T19:09:14.474 INFO:teuthology.orchestra.run.smithi053.stderr:instructed osd(s) 7 to deep-scrub 2023-06-10T19:09:14.477 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.471+0000 7fa385cc2640 1 -- 172.21.15.53:0/162965921 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa36c066280 msgr2=0x7fa36c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:14.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.471+0000 7fa385cc2640 1 --2- 172.21.15.53:0/162965921 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa36c066280 0x7fa36c068730 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7fa3800c6cd0 tx=0x7fa374009040 comp rx=0 tx=0).stop 2023-06-10T19:09:14.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.471+0000 7fa385cc2640 1 -- 172.21.15.53:0/162965921 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3800b3ac0 msgr2=0x7fa380159170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:14.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.471+0000 7fa385cc2640 1 --2- 172.21.15.53:0/162965921 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3800b3ac0 0x7fa380159170 secure :-1 s=READY pgs=2786 cs=0 l=1 rev1=1 crypto rx=0x7fa370019f90 tx=0x7fa370019100 comp rx=0 tx=0).stop 2023-06-10T19:09:14.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.471+0000 7fa385cc2640 1 -- 172.21.15.53:0/162965921 shutdown_connections 2023-06-10T19:09:14.478 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.471+0000 7fa385cc2640 1 --2- 172.21.15.53:0/162965921 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fa36c066280 0x7fa36c068730 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:14.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.471+0000 7fa385cc2640 1 --2- 172.21.15.53:0/162965921 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3800d1b00 0x7fa3800b2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:14.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.471+0000 7fa385cc2640 1 --2- 172.21.15.53:0/162965921 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3800cc690 0x7fa3800cb030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:14.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.471+0000 7fa385cc2640 1 --2- 172.21.15.53:0/162965921 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3800b3ac0 0x7fa380159170 unknown :-1 s=CLOSED pgs=2786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:14.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.471+0000 7fa385cc2640 1 -- 172.21.15.53:0/162965921 >> 172.21.15.53:0/162965921 conn(0x7fa380069de0 msgr2=0x7fa3800b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:09:14.479 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.471+0000 7fa385cc2640 1 -- 172.21.15.53:0/162965921 shutdown_connections 2023-06-10T19:09:14.480 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.471+0000 7fa385cc2640 1 -- 172.21.15.53:0/162965921 wait complete. 2023-06-10T19:09:14.493 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-10T19:09:14.607 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.607+0000 7f24c981b640 1 Processor -- start 2023-06-10T19:09:14.608 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.607+0000 7f24c981b640 1 -- start start 2023-06-10T19:09:14.609 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.607+0000 7f24c981b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24c415d5d0 0x7f24c406b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:14.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.607+0000 7f24c981b640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f24c40b24c0 0x7f24c40c2c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:14.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.607+0000 7f24c981b640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24c406c060 con 0x7f24c41642c0 2023-06-10T19:09:14.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.607+0000 7f24c981b640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24c41637e0 con 0x7f24c40b24c0 2023-06-10T19:09:14.610 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.607+0000 7f24c981b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24c4163ac0 con 0x7f24c415d5d0 2023-06-10T19:09:14.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.607+0000 7f24c2ffd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24c415d5d0 0x7f24c406b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:14.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.607+0000 7f24bbfff640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f24c40b24c0 0x7f24c40c2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:14.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.607+0000 7f24c2ffd640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24c415d5d0 0x7f24c406b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.53:51978/0 (socket says 172.21.15.53:51978) 2023-06-10T19:09:14.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.607+0000 7f24c2ffd640 1 -- 172.21.15.53:0/1823478359 learned_addr learned my addr 172.21.15.53:0/1823478359 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:09:14.611 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.607+0000 7f24c37fe640 1 --1- 172.21.15.53:0/1823478359 >> v1:172.21.15.117:6789/0 conn(0x7f24c41642c0 0x7f24c406a560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.53:60306/0 (socket says 172.21.15.53:60306) 2023-06-10T19:09:14.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.607+0000 7f24c2ffd640 1 -- 172.21.15.53:0/1823478359 >> v2:172.21.15.117:3300/0 conn(0x7f24c40b24c0 msgr2=0x7f24c40c2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:09:14.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.607+0000 7f24c2ffd640 1 --2- 172.21.15.53:0/1823478359 >> v2:172.21.15.117:3300/0 conn(0x7f24c40b24c0 0x7f24c40c2c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:14.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.607+0000 7f24c2ffd640 1 -- 172.21.15.53:0/1823478359 >> v1:172.21.15.117:6789/0 conn(0x7f24c41642c0 legacy=0x7f24c406a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:14.612 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.607+0000 7f24c2ffd640 1 -- 172.21.15.53:0/1823478359 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24c4163da0 con 0x7f24c415d5d0 2023-06-10T19:09:14.613 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.611+0000 7f24c2ffd640 1 --2- 172.21.15.53:0/1823478359 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24c415d5d0 0x7f24c406b780 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f24ac009870 tx=0x7f24ac01c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dab4988ea248b72a server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:14.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.611+0000 7f24c27fc640 1 -- 172.21.15.53:0/1823478359 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ac0ac620 con 0x7f24c415d5d0 2023-06-10T19:09:14.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.611+0000 7f24c27fc640 1 -- 172.21.15.53:0/1823478359 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24ac0ac780 con 0x7f24c415d5d0 2023-06-10T19:09:14.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.611+0000 7f24c27fc640 1 -- 172.21.15.53:0/1823478359 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ac0acb10 con 0x7f24c415d5d0 2023-06-10T19:09:14.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.611+0000 7f24c981b640 1 -- 172.21.15.53:0/1823478359 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24c415d5d0 msgr2=0x7f24c406b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:14.614 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.611+0000 7f24c981b640 1 --2- 172.21.15.53:0/1823478359 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24c415d5d0 0x7f24c406b780 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f24ac009870 tx=0x7f24ac01c4b0 comp rx=0 tx=0).stop 2023-06-10T19:09:14.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.611+0000 7f24c981b640 1 -- 172.21.15.53:0/1823478359 shutdown_connections 2023-06-10T19:09:14.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.611+0000 7f24c981b640 1 --2- 172.21.15.53:0/1823478359 >> v2:172.21.15.117:3300/0 conn(0x7f24c40b24c0 0x7f24c40c2c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:14.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.611+0000 7f24c981b640 1 --2- 172.21.15.53:0/1823478359 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24c415d5d0 0x7f24c406b780 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:14.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.611+0000 7f24c981b640 1 -- 172.21.15.53:0/1823478359 >> 172.21.15.53:0/1823478359 conn(0x7f24c406a090 msgr2=0x7f24c406d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:09:14.615 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.611+0000 7f24c981b640 1 -- 172.21.15.53:0/1823478359 shutdown_connections 2023-06-10T19:09:14.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.611+0000 7f24c981b640 1 -- 172.21.15.53:0/1823478359 wait complete. 2023-06-10T19:09:14.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.611+0000 7f24c981b640 1 Processor -- start 2023-06-10T19:09:14.616 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.611+0000 7f24c981b640 1 -- start start 2023-06-10T19:09:14.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.611+0000 7f24c981b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24c40b24c0 0x7f24c4156590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:14.618 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.611+0000 7f24c981b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24c415d5d0 0x7f24c40cff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:14.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.611+0000 7f24c981b640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24c41642c0 0x7f24c40c3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:14.619 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.611+0000 7f24c981b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24c4161ea0 con 0x7f24c40b24c0 2023-06-10T19:09:14.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.611+0000 7f24c981b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24c4161290 con 0x7f24c415d5d0 2023-06-10T19:09:14.620 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.611+0000 7f24c981b640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24c4161570 con 0x7f24c41642c0 2023-06-10T19:09:14.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.611+0000 7f24c2ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24c40b24c0 0x7f24c4156590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:14.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.611+0000 7f24c2ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24c40b24c0 0x7f24c4156590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57340/0 (socket says 172.21.15.53:57340) 2023-06-10T19:09:14.621 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.611+0000 7f24c2ffd640 1 -- 172.21.15.53:0/2983694368 learned_addr learned my addr 172.21.15.53:0/2983694368 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:09:14.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.611+0000 7f24bbfff640 1 --2- 172.21.15.53:0/2983694368 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24c415d5d0 0x7f24c40cff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:14.622 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.611+0000 7f24c37fe640 1 --2- 172.21.15.53:0/2983694368 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24c41642c0 0x7f24c40c3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:14.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.611+0000 7f24c2ffd640 1 -- 172.21.15.53:0/2983694368 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24c41642c0 msgr2=0x7f24c40c3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:14.623 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.611+0000 7f24c2ffd640 1 --2- 172.21.15.53:0/2983694368 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24c41642c0 0x7f24c40c3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:14.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.611+0000 7f24c2ffd640 1 -- 172.21.15.53:0/2983694368 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24c415d5d0 msgr2=0x7f24c40cff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:14.624 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.611+0000 7f24c2ffd640 1 --2- 172.21.15.53:0/2983694368 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24c415d5d0 0x7f24c40cff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:14.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.611+0000 7f24c2ffd640 1 -- 172.21.15.53:0/2983694368 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24ac0094d0 con 0x7f24c40b24c0 2023-06-10T19:09:14.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.611+0000 7f24c37fe640 1 --2- 172.21.15.53:0/2983694368 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24c41642c0 0x7f24c40c3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:09:14.625 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.611+0000 7f24c2ffd640 1 --2- 172.21.15.53:0/2983694368 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24c40b24c0 0x7f24c4156590 secure :-1 s=READY pgs=2787 cs=0 l=1 rev1=1 crypto rx=0x7f24ac0af040 tx=0x7f24ac019250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:14.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.611+0000 7f24c0ff9640 1 -- 172.21.15.53:0/2983694368 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ac0b7470 con 0x7f24c40b24c0 2023-06-10T19:09:14.626 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.611+0000 7f24c0ff9640 1 -- 172.21.15.53:0/2983694368 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24ac0b75f0 con 0x7f24c40b24c0 2023-06-10T19:09:14.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.611+0000 7f24c981b640 1 -- 172.21.15.53:0/2983694368 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24c4161850 con 0x7f24c40b24c0 2023-06-10T19:09:14.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.611+0000 7f24c0ff9640 1 -- 172.21.15.53:0/2983694368 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ac0b79a0 con 0x7f24c40b24c0 2023-06-10T19:09:14.627 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.611+0000 7f24c981b640 1 -- 172.21.15.53:0/2983694368 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24c41581f0 con 0x7f24c40b24c0 2023-06-10T19:09:14.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.611+0000 7f24c981b640 1 -- 172.21.15.53:0/2983694368 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24c406ee90 con 0x7f24c40b24c0 2023-06-10T19:09:14.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.611+0000 7f24c0ff9640 1 -- 172.21.15.53:0/2983694368 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f24ac0b3070 con 0x7f24c40b24c0 2023-06-10T19:09:14.628 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.611+0000 7f24c0ff9640 1 --2- 172.21.15.53:0/2983694368 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f24a4066280 0x7f24a4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:14.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.611+0000 7f24c0ff9640 1 -- 172.21.15.53:0/2983694368 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f24ac11dfd0 con 0x7f24c40b24c0 2023-06-10T19:09:14.629 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.611+0000 7f24bbfff640 1 --2- 172.21.15.53:0/2983694368 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f24a4066280 0x7f24a4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:14.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.611+0000 7f24bbfff640 1 --2- 172.21.15.53:0/2983694368 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f24a4066280 0x7f24a4068730 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f24c40b3090 tx=0x7f24b4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:14.630 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.615+0000 7f24c0ff9640 1 -- 172.21.15.53:0/2983694368 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f24ac0eb7c0 con 0x7f24c40b24c0 2023-06-10T19:09:14.769 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.763+0000 7f24c981b640 1 -- 172.21.15.53:0/2983694368 --> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f24c416ca50 con 0x7f24a4066280 2023-06-10T19:09:14.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.775+0000 7f24c0ff9640 1 -- 172.21.15.53:0/2983694368 <== mgr.4105 v2:172.21.15.117:6832/3061986771 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71407 (secure 0 0 0) 0x7f24b40118b0 con 0x7f24a4066280 2023-06-10T19:09:14.778 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:09:14.778 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-06-10T19:09:14.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.775+0000 7f24c981b640 1 -- 172.21.15.53:0/2983694368 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f24a4066280 msgr2=0x7f24a4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:14.779 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.775+0000 7f24c981b640 1 --2- 172.21.15.53:0/2983694368 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f24a4066280 0x7f24a4068730 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f24c40b3090 tx=0x7f24b4008040 comp rx=0 tx=0).stop 2023-06-10T19:09:14.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.775+0000 7f24c981b640 1 -- 172.21.15.53:0/2983694368 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24c40b24c0 msgr2=0x7f24c4156590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:14.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.775+0000 7f24c981b640 1 --2- 172.21.15.53:0/2983694368 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24c40b24c0 0x7f24c4156590 secure :-1 s=READY pgs=2787 cs=0 l=1 rev1=1 crypto rx=0x7f24ac0af040 tx=0x7f24ac019250 comp rx=0 tx=0).stop 2023-06-10T19:09:14.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.775+0000 7f24c981b640 1 -- 172.21.15.53:0/2983694368 shutdown_connections 2023-06-10T19:09:14.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.775+0000 7f24c981b640 1 --2- 172.21.15.53:0/2983694368 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f24a4066280 0x7f24a4068730 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:14.780 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.775+0000 7f24c981b640 1 --2- 172.21.15.53:0/2983694368 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f24c41642c0 0x7f24c40c3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:14.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.775+0000 7f24c981b640 1 --2- 172.21.15.53:0/2983694368 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24c415d5d0 0x7f24c40cff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:14.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.775+0000 7f24c981b640 1 --2- 172.21.15.53:0/2983694368 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24c40b24c0 0x7f24c4156590 unknown :-1 s=CLOSED pgs=2787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:14.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.775+0000 7f24c981b640 1 -- 172.21.15.53:0/2983694368 >> 172.21.15.53:0/2983694368 conn(0x7f24c406a090 msgr2=0x7f24c40afaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:09:14.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.775+0000 7f24c981b640 1 -- 172.21.15.53:0/2983694368 shutdown_connections 2023-06-10T19:09:14.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:14.775+0000 7f24c981b640 1 -- 172.21.15.53:0/2983694368 wait complete. 2023-06-10T19:09:14.795 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":680,"stamp":"2023-06-10T19:09:13.945485+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":284220,"kb_used_data":19452,"kb_used_omap":0,"kb_used_meta":264704,"kb_avail":754690500,"statfs":{"total":773094113280,"available":772803072000,"internally_reserved":0,"allocated":19918848,"data_stored":9944271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":271056896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":-1,"num_object_clones":0,"num_object_copies":-2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1,"num_whiteouts":0,"num_read":-1,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.478972"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":447,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-06-10T19:09:06.884796+0000","last_change":"2023-06-10T18:52:34.951528+0000","last_active":"2023-06-10T19:09:06.884796+0000","last_peered":"2023-06-10T19:09:06.884796+0000","last_clean":"2023-06-10T19:09:06.884796+0000","last_became_active":"2023-06-10T18:52:34.949099+0000","last_became_peered":"2023-06-10T18:52:34.949099+0000","last_unstale":"2023-06-10T19:09:06.884796+0000","last_undegraded":"2023-06-10T19:09:06.884796+0000","last_fullsized":"2023-06-10T19:09:06.884796+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:33.633295+0000","last_clean_scrub_stamp":"2023-06-10T18:52:33.633295+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:11:24.585790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":322,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-06-10T19:09:06.483312+0000","last_change":"2023-06-10T18:52:40.506384+0000","last_active":"2023-06-10T19:09:06.483312+0000","last_peered":"2023-06-10T19:09:06.483312+0000","last_clean":"2023-06-10T19:09:06.483312+0000","last_became_active":"2023-06-10T18:52:40.505701+0000","last_became_peered":"2023-06-10T18:52:40.505701+0000","last_unstale":"2023-06-10T19:09:06.483312+0000","last_undegraded":"2023-06-10T19:09:06.483312+0000","last_fullsized":"2023-06-10T19:09:06.483312+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:57:46.897873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":291,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-06-10T19:09:06.884465+0000","last_change":"2023-06-10T18:52:40.512015+0000","last_active":"2023-06-10T19:09:06.884465+0000","last_peered":"2023-06-10T19:09:06.884465+0000","last_clean":"2023-06-10T19:09:06.884465+0000","last_became_active":"2023-06-10T18:52:40.511382+0000","last_became_peered":"2023-06-10T18:52:40.511382+0000","last_unstale":"2023-06-10T19:09:06.884465+0000","last_undegraded":"2023-06-10T19:09:06.884465+0000","last_fullsized":"2023-06-10T19:09:06.884465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:59:38.520388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":313,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-06-10T19:09:06.889083+0000","last_change":"2023-06-10T18:52:40.671725+0000","last_active":"2023-06-10T19:09:06.889083+0000","last_peered":"2023-06-10T19:09:06.889083+0000","last_clean":"2023-06-10T19:09:06.889083+0000","last_became_active":"2023-06-10T18:52:40.671442+0000","last_became_peered":"2023-06-10T18:52:40.671442+0000","last_unstale":"2023-06-10T19:09:06.889083+0000","last_undegraded":"2023-06-10T19:09:06.889083+0000","last_fullsized":"2023-06-10T19:09:06.889083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":322,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-06-10T19:09:06.481773+0000","last_change":"2023-06-10T18:52:40.510258+0000","last_active":"2023-06-10T19:09:06.481773+0000","last_peered":"2023-06-10T19:09:06.481773+0000","last_clean":"2023-06-10T19:09:06.481773+0000","last_became_active":"2023-06-10T18:52:40.509560+0000","last_became_peered":"2023-06-10T18:52:40.509560+0000","last_unstale":"2023-06-10T19:09:06.481773+0000","last_undegraded":"2023-06-10T19:09:06.481773+0000","last_fullsized":"2023-06-10T19:09:06.481773+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T23:32:31.108716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":293,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-06-10T19:09:06.884372+0000","last_change":"2023-06-10T18:52:40.672266+0000","last_active":"2023-06-10T19:09:06.884372+0000","last_peered":"2023-06-10T19:09:06.884372+0000","last_clean":"2023-06-10T19:09:06.884372+0000","last_became_active":"2023-06-10T18:52:40.671966+0000","last_became_peered":"2023-06-10T18:52:40.671966+0000","last_unstale":"2023-06-10T19:09:06.884372+0000","last_undegraded":"2023-06-10T19:09:06.884372+0000","last_fullsized":"2023-06-10T19:09:06.884372+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":290,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-06-10T19:09:06.883364+0000","last_change":"2023-06-10T18:52:40.671084+0000","last_active":"2023-06-10T19:09:06.883364+0000","last_peered":"2023-06-10T19:09:06.883364+0000","last_clean":"2023-06-10T19:09:06.883364+0000","last_became_active":"2023-06-10T18:52:40.670697+0000","last_became_peered":"2023-06-10T18:52:40.670697+0000","last_unstale":"2023-06-10T19:09:06.883364+0000","last_undegraded":"2023-06-10T19:09:06.883364+0000","last_fullsized":"2023-06-10T19:09:06.883364+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:13:40.272077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":293,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-06-10T19:09:06.883004+0000","last_change":"2023-06-10T18:52:40.514114+0000","last_active":"2023-06-10T19:09:06.883004+0000","last_peered":"2023-06-10T19:09:06.883004+0000","last_clean":"2023-06-10T19:09:06.883004+0000","last_became_active":"2023-06-10T18:52:40.513638+0000","last_became_peered":"2023-06-10T18:52:40.513638+0000","last_unstale":"2023-06-10T19:09:06.883004+0000","last_undegraded":"2023-06-10T19:09:06.883004+0000","last_fullsized":"2023-06-10T19:09:06.883004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":292,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-06-10T19:09:06.885144+0000","last_change":"2023-06-10T18:52:40.515396+0000","last_active":"2023-06-10T19:09:06.885144+0000","last_peered":"2023-06-10T19:09:06.885144+0000","last_clean":"2023-06-10T19:09:06.885144+0000","last_became_active":"2023-06-10T18:52:40.514663+0000","last_became_peered":"2023-06-10T18:52:40.514663+0000","last_unstale":"2023-06-10T19:09:06.885144+0000","last_undegraded":"2023-06-10T19:09:06.885144+0000","last_fullsized":"2023-06-10T19:09:06.885144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T18:52:39.474842+0000","last_clean_scrub_stamp":"2023-06-10T18:52:39.474842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:30:54.158485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575051,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33916,"kb_used_data":2868,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94337924,"statfs":{"total":96636764160,"available":96602034176,"internally_reserved":0,"allocated":2936832,"data_stored":1686192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.93300000000000005,"15min":0.93400000000000005},"min":{"1min":0.52300000000000002,"5min":0.443,"15min":0.434},"max":{"1min":1.1100000000000001,"5min":1.522,"15min":1.522},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.90600000000000003,"15min":0.92100000000000004},"min":{"1min":0.55300000000000005,"5min":0.49399999999999999,"15min":0.45200000000000001},"max":{"1min":1.1910000000000001,"5min":1.3109999999999999,"15min":1.5389999999999999},"last":0.58199999999999996}]},{"osd":1,"last update":"Sat Jun 10 19:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.91300000000000003,"15min":0.92200000000000004},"min":{"1min":0.52500000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.2929999999999999,"5min":1.365,"15min":1.377},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.92800000000000005,"15min":0.94899999999999995},"min":{"1min":0.65400000000000003,"5min":0.55000000000000004,"15min":0.51300000000000001},"max":{"1min":1.216,"5min":1.3320000000000001,"15min":1.4630000000000001},"last":0.68300000000000005}]},{"osd":2,"last update":"Sat Jun 10 19:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.90300000000000002,"15min":0.86899999999999999},"min":{"1min":0.55400000000000005,"5min":0.41899999999999998,"15min":0.35699999999999998},"max":{"1min":1.1579999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.88900000000000001,"15min":0.89300000000000002},"min":{"1min":0.69199999999999995,"5min":0.53300000000000003,"15min":0.50600000000000001},"max":{"1min":1.24,"5min":1.3100000000000001,"15min":1.448},"last":0.63100000000000001}]},{"osd":3,"last update":"Sat Jun 10 19:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.91700000000000004,"15min":0.92700000000000005},"min":{"1min":0.65200000000000002,"5min":0.60599999999999998,"15min":0.46300000000000002},"max":{"1min":1.1899999999999999,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.85399999999999998},{"interface":"front","average":{"1min":1.002,"5min":0.97599999999999998,"15min":0.96399999999999997},"min":{"1min":0.77200000000000002,"5min":0.496,"15min":0.432},"max":{"1min":1.335,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.78000000000000003}]},{"osd":4,"last update":"Sat Jun 10 19:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.83699999999999997,"15min":0.83999999999999997},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.307},"max":{"1min":1.268,"5min":1.268,"15min":1.639},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.97499999999999998,"15min":0.96199999999999997},"min":{"1min":0.67700000000000005,"5min":0.47299999999999998,"15min":0.40000000000000002},"max":{"1min":1.159,"5min":1.3540000000000001,"15min":1.4590000000000001},"last":1.0840000000000001}]},{"osd":5,"last update":"Sat Jun 10 19:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.97299999999999998,"15min":0.98599999999999999},"min":{"1min":0.67100000000000004,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.262,"5min":1.385,"15min":1.5569999999999999},"last":1.0609999999999999},{"interface":"front","average":{"1min":0.98699999999999999,"5min":1.04,"15min":1.0309999999999999},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.46500000000000002},"max":{"1min":1.218,"5min":1.665,"15min":1.665},"last":0.95599999999999996}]},{"osd":6,"last update":"Sat Jun 10 19:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.99099999999999999,"15min":1},"min":{"1min":0.65100000000000002,"5min":0.56200000000000006,"15min":0.35999999999999999},"max":{"1min":1.3149999999999999,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":0.92300000000000004},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.1020000000000001,"15min":1.0960000000000001},"min":{"1min":0.81899999999999995,"5min":0.69899999999999995,"15min":0.441},"max":{"1min":1.2629999999999999,"5min":1.728,"15min":1.728},"last":1.0189999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575052,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33336,"kb_used_data":2288,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338504,"statfs":{"total":96636764160,"available":96602628096,"internally_reserved":0,"allocated":2342912,"data_stored":1095824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:09:01 2023","interfaces":[{"interface":"back","average":{"1min":1.575,"5min":0.98999999999999999,"15min":0.91800000000000004},"min":{"1min":0.56899999999999995,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":12.345000000000001,"5min":12.345000000000001,"15min":12.345000000000001},"last":1.004},{"interface":"front","average":{"1min":1.51,"5min":1.008,"15min":0.92900000000000005},"min":{"1min":0.65000000000000002,"5min":0.57099999999999995,"15min":0.40699999999999997},"max":{"1min":10.475,"5min":10.475,"15min":10.475},"last":0.79000000000000004}]},{"osd":1,"last update":"Sat Jun 10 19:09:01 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.83399999999999996,"15min":0.86199999999999999},"min":{"1min":0.68500000000000005,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.0780000000000001,"5min":1.2709999999999999,"15min":1.5229999999999999},"last":0.84599999999999997},{"interface":"front","average":{"1min":1.5940000000000001,"5min":1.0489999999999999,"15min":0.95599999999999996},"min":{"1min":0.58999999999999997,"5min":0.504,"15min":0.45300000000000001},"max":{"1min":12.467000000000001,"5min":12.467000000000001,"15min":12.467000000000001},"last":1.046}]},{"osd":2,"last update":"Sat Jun 10 19:09:01 2023","interfaces":[{"interface":"back","average":{"1min":1.5149999999999999,"5min":1.0189999999999999,"15min":0.94599999999999995},"min":{"1min":0.63200000000000001,"5min":0.51200000000000001,"15min":0.48799999999999999},"max":{"1min":10.566000000000001,"5min":10.566000000000001,"15min":10.566000000000001},"last":0.876},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.85999999999999999,"15min":0.88},"min":{"1min":0.626,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":1.022}]},{"osd":3,"last update":"Sat Jun 10 19:09:01 2023","interfaces":[{"interface":"back","average":{"1min":1.6439999999999999,"5min":1.0569999999999999,"15min":0.97699999999999998},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":12.411,"5min":12.411,"15min":12.411},"last":0.746},{"interface":"front","average":{"1min":1.5569999999999999,"5min":1.0640000000000001,"15min":1.0169999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.52900000000000003},"max":{"1min":10.695,"5min":10.695,"15min":10.695},"last":1.2609999999999999}]},{"osd":4,"last update":"Sat Jun 10 19:09:01 2023","interfaces":[{"interface":"back","average":{"1min":1.629,"5min":1.0760000000000001,"15min":0.95999999999999996},"min":{"1min":0.65200000000000002,"5min":0.45900000000000002,"15min":0.373},"max":{"1min":13.308999999999999,"5min":13.308999999999999,"15min":13.308999999999999},"last":0.90500000000000003},{"interface":"front","average":{"1min":1.853,"5min":1.1619999999999999,"15min":1.0389999999999999},"min":{"1min":0.73299999999999998,"5min":0.504,"15min":0.47899999999999998},"max":{"1min":15.680999999999999,"5min":15.680999999999999,"15min":15.680999999999999},"last":1.165}]},{"osd":5,"last update":"Sat Jun 10 19:09:01 2023","interfaces":[{"interface":"back","average":{"1min":1.7869999999999999,"5min":1.0489999999999999,"15min":0.95399999999999996},"min":{"1min":0.68200000000000005,"5min":0.437,"15min":0.437},"max":{"1min":15.074999999999999,"5min":15.074999999999999,"15min":15.074999999999999},"last":0.93000000000000005},{"interface":"front","average":{"1min":1.903,"5min":1.1970000000000001,"15min":1.0820000000000001},"min":{"1min":0.69799999999999995,"5min":0.47199999999999998,"15min":0.42699999999999999},"max":{"1min":15.189,"5min":15.189,"15min":15.189},"last":0.95499999999999996}]},{"osd":7,"last update":"Sat Jun 10 19:09:01 2023","interfaces":[{"interface":"back","average":{"1min":1.6279999999999999,"5min":1.1419999999999999,"15min":1.0660000000000001},"min":{"1min":0.64600000000000002,"5min":0.59199999999999997,"15min":0.57099999999999995},"max":{"1min":10.813000000000001,"5min":10.813000000000001,"15min":10.813000000000001},"last":1.3640000000000001},{"interface":"front","average":{"1min":1.133,"5min":1.0069999999999999,"15min":1.0029999999999999},"min":{"1min":0.76900000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":2.4870000000000001,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":0.98199999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575052,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33336,"kb_used_data":2288,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338504,"statfs":{"total":96636764160,"available":96602628096,"internally_reserved":0,"allocated":2342912,"data_stored":1095824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.85199999999999998,"15min":0.873},"min":{"1min":0.51900000000000002,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.2350000000000001,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":1.157},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.88400000000000001,"15min":0.89700000000000002},"min":{"1min":0.64200000000000002,"5min":0.50800000000000001,"15min":0.49399999999999999},"max":{"1min":1.1779999999999999,"5min":1.2370000000000001,"15min":2.347},"last":0.92100000000000004}]},{"osd":1,"last update":"Sat Jun 10 19:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.89100000000000001,"15min":0.91000000000000003},"min":{"1min":0.51800000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.3180000000000001,"5min":1.6739999999999999,"15min":7.0800000000000001},"last":1.1899999999999999},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.89600000000000002,"15min":0.98099999999999998},"min":{"1min":0.67200000000000004,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.117,"5min":1.244,"15min":15.845000000000001},"last":0.80300000000000005}]},{"osd":2,"last update":"Sat Jun 10 19:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.90400000000000003,"15min":0.90000000000000002},"min":{"1min":0.66200000000000003,"5min":0.59899999999999998,"15min":0.48299999999999998},"max":{"1min":1.1930000000000001,"5min":1.6459999999999999,"15min":5.0049999999999999},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.92700000000000005,"15min":0.94899999999999995},"min":{"1min":0.69099999999999995,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.163,"5min":1.391,"15min":6.851},"last":0.83399999999999996}]},{"osd":3,"last update":"Sat Jun 10 19:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.93100000000000005,"15min":0.94699999999999995},"min":{"1min":0.71799999999999997,"5min":0.58699999999999997,"15min":0.51500000000000001},"max":{"1min":1.304,"5min":1.6910000000000001,"15min":2.544},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.98399999999999999,"15min":0.98499999999999999},"min":{"1min":0.77600000000000002,"5min":0.66000000000000003,"15min":0.59799999999999998},"max":{"1min":1.1619999999999999,"5min":1.4870000000000001,"15min":3.0830000000000002},"last":0.59499999999999997}]},{"osd":4,"last update":"Sat Jun 10 19:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.93500000000000005,"15min":0.93999999999999995},"min":{"1min":0.64300000000000002,"5min":0.59799999999999998,"15min":0.58099999999999996},"max":{"1min":1.246,"5min":1.6140000000000001,"15min":6.7290000000000001},"last":1.0980000000000001},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.97899999999999998,"15min":0.97999999999999998},"min":{"1min":0.61699999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.278,"5min":1.677,"15min":1.677},"last":0.94999999999999996}]},{"osd":6,"last update":"Sat Jun 10 19:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.98199999999999998,"15min":0.97599999999999998},"min":{"1min":0.64100000000000001,"5min":0.60499999999999998,"15min":0.54200000000000004},"max":{"1min":1.2110000000000001,"5min":1.8009999999999999,"15min":1.8009999999999999},"last":0.752},{"interface":"front","average":{"1min":1.012,"5min":1.04,"15min":1.0489999999999999},"min":{"1min":0.77600000000000002,"5min":0.66200000000000003,"15min":0.57899999999999996},"max":{"1min":1.504,"5min":1.8380000000000001,"15min":6.923},"last":0.98399999999999999}]},{"osd":7,"last update":"Sat Jun 10 19:08:58 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.0780000000000001,"15min":1.073},"min":{"1min":0.70699999999999996,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.4419999999999999,"5min":1.7749999999999999,"15min":2.6080000000000001},"last":1.056},{"interface":"front","average":{"1min":1.125,"5min":1.1200000000000001,"15min":1.1279999999999999},"min":{"1min":0.74099999999999999,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.351,"5min":1.8049999999999999,"15min":5.4169999999999998},"last":1.1319999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575051,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33336,"kb_used_data":2288,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338504,"statfs":{"total":96636764160,"available":96602628096,"internally_reserved":0,"allocated":2342912,"data_stored":1095824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.82699999999999996,"15min":0.84399999999999997},"min":{"1min":0.498,"5min":0.498,"15min":0.45100000000000001},"max":{"1min":1.0720000000000001,"5min":1.29,"15min":1.29},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.91400000000000003,"15min":0.91300000000000003},"min":{"1min":0.60899999999999999,"5min":0.439,"15min":0.439},"max":{"1min":1.593,"5min":1.593,"15min":3.7280000000000002},"last":0.90300000000000002}]},{"osd":1,"last update":"Sat Jun 10 19:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.89300000000000002,"15min":0.91700000000000004},"min":{"1min":0.60499999999999998,"5min":0.47799999999999998,"15min":0.47599999999999998},"max":{"1min":1.4259999999999999,"5min":1.5429999999999999,"15min":3.3969999999999998},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.85399999999999998,"15min":0.86399999999999999},"min":{"1min":0.58199999999999996,"5min":0.47899999999999998,"15min":0.47699999999999998},"max":{"1min":1.089,"5min":1.2430000000000001,"15min":2.496},"last":0.97099999999999997}]},{"osd":2,"last update":"Sat Jun 10 19:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.86499999999999999,"15min":0.877},"min":{"1min":0.629,"5min":0.52400000000000002,"15min":0.49299999999999999},"max":{"1min":1.472,"5min":1.472,"15min":1.522},"last":1.0409999999999999},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.94199999999999995,"15min":0.97299999999999998},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.169,"5min":1.4670000000000001,"15min":3.5750000000000002},"last":0.83499999999999996}]},{"osd":3,"last update":"Sat Jun 10 19:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.86099999999999999,"15min":0.89300000000000002},"min":{"1min":0.64300000000000002,"5min":0.57799999999999996,"15min":0.53900000000000003},"max":{"1min":1.2090000000000001,"5min":1.28,"15min":2.3809999999999998},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.65300000000000002,"5min":0.58199999999999996,"15min":0.56799999999999995},"max":{"1min":1.2889999999999999,"5min":1.4279999999999999,"15min":1.4490000000000001},"last":0.80200000000000005}]},{"osd":5,"last update":"Sat Jun 10 19:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.97799999999999998,"15min":0.95599999999999996},"min":{"1min":0.79500000000000004,"5min":0.58699999999999997,"15min":0.53100000000000003},"max":{"1min":1.208,"5min":1.4159999999999999,"15min":3.6539999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.93999999999999995,"15min":0.93899999999999995},"min":{"1min":0.70899999999999996,"5min":0.54600000000000004,"15min":0.495},"max":{"1min":1.492,"5min":1.492,"15min":2.6720000000000002},"last":0.86599999999999999}]},{"osd":6,"last update":"Sat Jun 10 19:09:12 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":0.97099999999999997,"15min":0.96299999999999997},"min":{"1min":0.71799999999999997,"5min":0.443,"15min":0.443},"max":{"1min":1.3540000000000001,"5min":1.413,"15min":1.5720000000000001},"last":0.93700000000000006},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.085,"15min":1.0700000000000001},"min":{"1min":0.86499999999999999,"5min":0.58799999999999997,"15min":0.44400000000000001},"max":{"1min":1.298,"5min":1.625,"15min":3.4980000000000002},"last":1.006}]},{"osd":7,"last update":"Sat Jun 10 19:09:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.038,"15min":1.0089999999999999},"min":{"1min":0.83999999999999997,"5min":0.58599999999999997,"15min":0.41399999999999998},"max":{"1min":1.3799999999999999,"5min":1.506,"15min":2.5910000000000002},"last":1.075},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.097,"15min":1.0760000000000001},"min":{"1min":0.80100000000000005,"5min":0.50800000000000001,"15min":0.46300000000000002},"max":{"1min":1.456,"5min":1.635,"15min":1.635},"last":1.1279999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575050,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37428,"kb_used_data":2284,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334412,"statfs":{"total":96636764160,"available":96598437888,"internally_reserved":0,"allocated":2338816,"data_stored":1094805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.626,"15min":0.626},"min":{"1min":0.26000000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.91800000000000004,"5min":1.0900000000000001,"15min":1.169},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.64800000000000002,"15min":0.66800000000000004},"min":{"1min":0.32000000000000001,"5min":0.29299999999999998,"15min":0.251},"max":{"1min":0.93999999999999995,"5min":0.97799999999999998,"15min":1.5269999999999999},"last":0.83399999999999996}]},{"osd":1,"last update":"Sat Jun 10 19:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.67700000000000005,"15min":0.68899999999999995},"min":{"1min":0.308,"5min":0.29699999999999999,"15min":0.27800000000000002},"max":{"1min":1.03,"5min":1.234,"15min":2.0699999999999998},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.70299999999999996,"15min":0.73199999999999998},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.0129999999999999,"5min":1.1659999999999999,"15min":1.296},"last":1.228}]},{"osd":2,"last update":"Sat Jun 10 19:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.73699999999999999,"15min":0.76800000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.1359999999999999,"5min":1.1950000000000001,"15min":1.3899999999999999},"last":1.347},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.78000000000000003,"15min":0.79200000000000004},"min":{"1min":0.314,"5min":0.314,"15min":0.29699999999999999},"max":{"1min":1.119,"5min":1.2769999999999999,"15min":1.591},"last":0.78600000000000003}]},{"osd":4,"last update":"Sat Jun 10 19:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.92000000000000004,"15min":0.94099999999999995},"min":{"1min":0.57899999999999996,"5min":0.55800000000000005,"15min":0.41899999999999998},"max":{"1min":1.2729999999999999,"5min":1.333,"15min":1.8240000000000001},"last":1.3080000000000001},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.98199999999999998,"15min":0.98699999999999999},"min":{"1min":0.502,"5min":0.502,"15min":0.47999999999999998},"max":{"1min":1.3720000000000001,"5min":1.4330000000000001,"15min":1.873},"last":1.177}]},{"osd":5,"last update":"Sat Jun 10 19:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.98899999999999999,"15min":0.998},"min":{"1min":0.61699999999999999,"5min":0.55900000000000005,"15min":0.55200000000000005},"max":{"1min":1.371,"5min":1.536,"15min":1.752},"last":0.999},{"interface":"front","average":{"1min":0.94499999999999995,"5min":1.022,"15min":1.0329999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.46899999999999997},"max":{"1min":1.399,"5min":1.534,"15min":1.9259999999999999},"last":1.3999999999999999}]},{"osd":6,"last update":"Sat Jun 10 19:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":1.0329999999999999,"15min":1.0569999999999999},"min":{"1min":0.60599999999999998,"5min":0.56999999999999995,"15min":0.55300000000000005},"max":{"1min":1.4570000000000001,"5min":1.617,"15min":1.786},"last":1.492},{"interface":"front","average":{"1min":0.96399999999999997,"5min":1.0149999999999999,"15min":1.042},"min":{"1min":0.68700000000000006,"5min":0.61399999999999999,"15min":0.58799999999999997},"max":{"1min":1.375,"5min":1.4530000000000001,"15min":2.2120000000000002},"last":1.137}]},{"osd":7,"last update":"Sat Jun 10 19:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":1.046,"15min":1.0700000000000001},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.4570000000000001,"5min":1.5720000000000001,"15min":2.1150000000000002},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.083,"15min":1.099},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.764,"5min":1.764,"15min":1.9850000000000001},"last":1.4570000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575051,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37432,"kb_used_data":2288,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334408,"statfs":{"total":96636764160,"available":96598433792,"internally_reserved":0,"allocated":2342912,"data_stored":1095824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.63700000000000001,"15min":0.628},"min":{"1min":0.28899999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.2330000000000001,"5min":2.883,"15min":2.883},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.78800000000000003,"15min":0.746},"min":{"1min":0.42599999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":3.528,"5min":6.5670000000000002,"15min":6.5670000000000002},"last":0.436}]},{"osd":1,"last update":"Sat Jun 10 19:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.63900000000000001,"15min":0.66100000000000003},"min":{"1min":0.34699999999999998,"5min":0.32300000000000001,"15min":0.29199999999999998},"max":{"1min":0.95399999999999996,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.82599999999999996,"15min":0.79300000000000004},"min":{"1min":0.38100000000000001,"5min":0.32500000000000001,"15min":0.27400000000000002},"max":{"1min":1.948,"5min":8.4429999999999996,"15min":8.4429999999999996},"last":0.46700000000000003}]},{"osd":3,"last update":"Sat Jun 10 19:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.76800000000000002,"15min":0.78500000000000003},"min":{"1min":0.38700000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":2.4969999999999999,"5min":2.4969999999999999,"15min":2.4969999999999999},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.77600000000000002,"15min":0.78000000000000003},"min":{"1min":0.36799999999999999,"5min":0.33600000000000002,"15min":0.23499999999999999},"max":{"1min":2.3719999999999999,"5min":4.1849999999999996,"15min":4.1849999999999996},"last":0.35699999999999998}]},{"osd":4,"last update":"Sat Jun 10 19:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.94399999999999995,"15min":0.93400000000000005},"min":{"1min":0.624,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.3089999999999999,"5min":3.996,"15min":3.996},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.93999999999999995,"5min":1.119,"15min":1.044},"min":{"1min":0.61699999999999999,"5min":0.502,"15min":0.496},"max":{"1min":1.369,"5min":13.254,"15min":13.254},"last":0.59299999999999997}]},{"osd":5,"last update":"Sat Jun 10 19:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":1.131,"15min":1.048},"min":{"1min":0.62,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.2749999999999999,"5min":6.9189999999999996,"15min":6.9189999999999996},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.91700000000000004,"5min":1.2390000000000001,"15min":1.0960000000000001},"min":{"1min":0.57199999999999995,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.161,"5min":15.526,"15min":15.526},"last":0.61299999999999999}]},{"osd":6,"last update":"Sat Jun 10 19:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":1.1220000000000001,"15min":1.0760000000000001},"min":{"1min":0.69299999999999995,"5min":0.624,"15min":0.52700000000000002},"max":{"1min":1.226,"5min":8.7089999999999996,"15min":8.7089999999999996},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.96099999999999997,"5min":1.048,"15min":1.0489999999999999},"min":{"1min":0.58599999999999997,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.417,"5min":6.1299999999999999,"15min":6.1299999999999999},"last":0.80800000000000005}]},{"osd":7,"last update":"Sat Jun 10 19:09:05 2023","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.286,"15min":1.1639999999999999},"min":{"1min":0.66600000000000004,"5min":0.60299999999999998,"15min":0.57199999999999995},"max":{"1min":1.4650000000000001,"5min":12.138,"15min":12.138},"last":0.622},{"interface":"front","average":{"1min":0.96499999999999997,"5min":1.0569999999999999,"15min":1.1040000000000001},"min":{"1min":0.63500000000000001,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.278,"5min":1.883,"15min":1.883},"last":0.751}]}]},{"osd":1,"up_from":13,"seq":55834575053,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37428,"kb_used_data":2284,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334412,"statfs":{"total":96636764160,"available":96598437888,"internally_reserved":0,"allocated":2338816,"data_stored":1094805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.66900000000000004,"15min":0.68000000000000005},"min":{"1min":0.28199999999999997,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.288},"last":0.46999999999999997},{"interface":"front","average":{"1min":1.0309999999999999,"5min":0.78700000000000003,"15min":0.77300000000000002},"min":{"1min":0.34100000000000003,"5min":0.32300000000000001,"15min":0.26900000000000002},"max":{"1min":5.625,"5min":5.625,"15min":5.625},"last":0.51400000000000001}]},{"osd":2,"last update":"Sat Jun 10 19:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.624,"15min":0.63900000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.249},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.21},"last":0.629},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.71499999999999997,"15min":0.73099999999999998},"min":{"1min":0.36499999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.98399999999999999,"5min":1.2390000000000001,"15min":1.415},"last":0.68100000000000005}]},{"osd":3,"last update":"Sat Jun 10 19:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.753,"15min":0.78400000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.25600000000000001},"max":{"1min":1.177,"5min":1.177,"15min":1.6299999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":1.099,"5min":0.77600000000000002,"15min":0.752},"min":{"1min":0.42199999999999999,"5min":0.36099999999999999,"15min":0.29599999999999999},"max":{"1min":6.8200000000000003,"5min":6.8200000000000003,"15min":6.8200000000000003},"last":0.81000000000000005}]},{"osd":4,"last update":"Sat Jun 10 19:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.879,"15min":0.875},"min":{"1min":0.59999999999999998,"5min":0.58599999999999997,"15min":0.56399999999999995},"max":{"1min":1.1950000000000001,"5min":1.3620000000000001,"15min":1.4930000000000001},"last":0.83799999999999997},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.0029999999999999,"15min":1.024},"min":{"1min":0.65900000000000003,"5min":0.58899999999999997,"15min":0.47099999999999997},"max":{"1min":1.385,"5min":1.575,"15min":5.8209999999999997},"last":0.98199999999999998}]},{"osd":5,"last update":"Sat Jun 10 19:09:07 2023","interfaces":[{"interface":"back","average":{"1min":1.331,"5min":1.0369999999999999,"15min":1.0109999999999999},"min":{"1min":0.75,"5min":0.54800000000000004,"15min":0.49399999999999999},"max":{"1min":6.7030000000000003,"5min":6.7030000000000003,"15min":6.7030000000000003},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.95999999999999996,"15min":0.97999999999999998},"min":{"1min":0.63400000000000001,"5min":0.55000000000000004,"15min":0.46300000000000002},"max":{"1min":1.409,"5min":1.448,"15min":3.089},"last":0.90200000000000002}]},{"osd":6,"last update":"Sat Jun 10 19:09:07 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.0529999999999999,"15min":1.0700000000000001},"min":{"1min":0.79100000000000004,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":6.7450000000000001,"5min":6.7450000000000001,"15min":7.2599999999999998},"last":0.95999999999999996},{"interface":"front","average":{"1min":1.0109999999999999,"5min":0.99099999999999999,"15min":1.0349999999999999},"min":{"1min":0.65600000000000003,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.343,"5min":1.5469999999999999,"15min":9.0069999999999997},"last":1.0609999999999999}]},{"osd":7,"last update":"Sat Jun 10 19:09:07 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.0629999999999999,"15min":1.0780000000000001},"min":{"1min":0.74299999999999999,"5min":0.54300000000000004,"15min":0.495},"max":{"1min":1.444,"5min":1.4890000000000001,"15min":1.6879999999999999},"last":1.115},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.125,"15min":1.1020000000000001},"min":{"1min":0.621,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":6.782,"5min":6.782,"15min":6.782},"last":1.1459999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575052,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38008,"kb_used_data":2864,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94333832,"statfs":{"total":96636764160,"available":96597843968,"internally_reserved":0,"allocated":2932736,"data_stored":1685173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jun 10 19:09:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.624,"15min":0.64000000000000001},"min":{"1min":0.26000000000000001,"5min":0.255,"15min":0.248},"max":{"1min":0.91100000000000003,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.78000000000000003,"15min":0.80600000000000005},"min":{"1min":0.37,"5min":0.33000000000000002,"15min":0.32700000000000001},"max":{"1min":1.141,"5min":1.3080000000000001,"15min":1.5780000000000001},"last":1.1879999999999999}]},{"osd":2,"last update":"Sat Jun 10 19:09:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.69299999999999995,"15min":0.71499999999999997},"min":{"1min":0.45600000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.101,"5min":1.1970000000000001,"15min":1.2490000000000001},"last":1.093},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64500000000000002,"15min":0.65400000000000003},"min":{"1min":0.28899999999999998,"5min":0.28699999999999998,"15min":0.245},"max":{"1min":0.92100000000000004,"5min":1.1779999999999999,"15min":1.371},"last":0.59199999999999997}]},{"osd":3,"last update":"Sat Jun 10 19:09:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.68400000000000005,"15min":0.68500000000000005},"min":{"1min":0.35099999999999998,"5min":0.309,"15min":0.28899999999999998},"max":{"1min":1.173,"5min":1.397,"15min":1.397},"last":0.997},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77700000000000002,"15min":0.81200000000000006},"min":{"1min":0.40100000000000002,"5min":0.36399999999999999,"15min":0.29199999999999998},"max":{"1min":1.2410000000000001,"5min":1.6240000000000001,"15min":1.742},"last":0.94899999999999995}]},{"osd":4,"last update":"Sat Jun 10 19:09:04 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.89400000000000002,"15min":0.92100000000000004},"min":{"1min":0.47399999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.5580000000000001,"5min":1.758,"15min":3.0209999999999999},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.995,"15min":1.0169999999999999},"min":{"1min":0.56799999999999995,"5min":0.56200000000000006,"15min":0.48599999999999999},"max":{"1min":1.2909999999999999,"5min":1.7250000000000001,"15min":1.873},"last":1.2549999999999999}]},{"osd":5,"last update":"Sat Jun 10 19:09:04 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.88500000000000001,"15min":0.91700000000000004},"min":{"1min":0.55500000000000005,"5min":0.51300000000000001,"15min":0.45100000000000001},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":1.004,"5min":0.97499999999999998,"15min":1.0009999999999999},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.51400000000000001},"max":{"1min":1.6879999999999999,"5min":1.9870000000000001,"15min":4.5620000000000003},"last":1.0600000000000001}]},{"osd":6,"last update":"Sat Jun 10 19:09:04 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.038,"15min":1.073},"min":{"1min":0.76200000000000001,"5min":0.58699999999999997,"15min":0.52600000000000002},"max":{"1min":1.5129999999999999,"5min":1.9330000000000001,"15min":3.5569999999999999},"last":1.302},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.98899999999999999,"15min":0.998},"min":{"1min":0.61099999999999999,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.333,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.85899999999999999}]},{"osd":7,"last update":"Sat Jun 10 19:09:04 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.0069999999999999,"15min":1.0249999999999999},"min":{"1min":0.58399999999999996,"5min":0.54700000000000004,"15min":0.54600000000000004},"max":{"1min":1.506,"5min":1.804,"15min":1.804},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.98699999999999999,"5min":1.036,"15min":1.0529999999999999},"min":{"1min":0.65200000000000002,"5min":0.61299999999999999,"15min":0.61099999999999999},"max":{"1min":1.3180000000000001,"5min":2.1219999999999999,"15min":2.1219999999999999},"last":1.139}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-10T19:09:14.800 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-06-10T18:52:33.633295+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=10, tm_hour=18, tm_min=52, tm_sec=33, tm_wday=5, tm_yday=161, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=10, tm_hour=19, tm_min=9, tm_sec=9, tm_wday=5, tm_yday=161, tm_isdst=0) 2023-06-10T19:09:14.800 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-06-10T18:52:39.474842+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=10, tm_hour=18, tm_min=52, tm_sec=39, tm_wday=5, tm_yday=161, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=10, tm_hour=19, tm_min=9, tm_sec=9, tm_wday=5, tm_yday=161, tm_isdst=0) 2023-06-10T19:09:14.801 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-06-10T18:52:39.474842+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=10, tm_hour=18, tm_min=52, tm_sec=39, tm_wday=5, tm_yday=161, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=10, tm_hour=19, tm_min=9, tm_sec=9, tm_wday=5, tm_yday=161, tm_isdst=0) 2023-06-10T19:09:14.801 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-06-10T18:52:39.474842+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=10, tm_hour=18, tm_min=52, tm_sec=39, tm_wday=5, tm_yday=161, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=10, tm_hour=19, tm_min=9, tm_sec=9, tm_wday=5, tm_yday=161, tm_isdst=0) 2023-06-10T19:09:14.801 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-06-10T18:52:39.474842+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=10, tm_hour=18, tm_min=52, tm_sec=39, tm_wday=5, tm_yday=161, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=10, tm_hour=19, tm_min=9, tm_sec=9, tm_wday=5, tm_yday=161, tm_isdst=0) 2023-06-10T19:09:14.801 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-06-10T18:52:39.474842+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=10, tm_hour=18, tm_min=52, tm_sec=39, tm_wday=5, tm_yday=161, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=10, tm_hour=19, tm_min=9, tm_sec=9, tm_wday=5, tm_yday=161, tm_isdst=0) 2023-06-10T19:09:14.802 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-06-10T18:52:39.474842+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=10, tm_hour=18, tm_min=52, tm_sec=39, tm_wday=5, tm_yday=161, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=10, tm_hour=19, tm_min=9, tm_sec=9, tm_wday=5, tm_yday=161, tm_isdst=0) 2023-06-10T19:09:14.802 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-06-10T18:52:39.474842+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=10, tm_hour=18, tm_min=52, tm_sec=39, tm_wday=5, tm_yday=161, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=10, tm_hour=19, tm_min=9, tm_sec=9, tm_wday=5, tm_yday=161, tm_isdst=0) 2023-06-10T19:09:14.802 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-06-10T18:52:39.474842+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=10, tm_hour=18, tm_min=52, tm_sec=39, tm_wday=5, tm_yday=161, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=10, tm_hour=19, tm_min=9, tm_sec=9, tm_wday=5, tm_yday=161, tm_isdst=0) 2023-06-10T19:09:14.803 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-06-10T19:09:34.803 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-10T19:09:34.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:34.934+0000 7fddc6640640 1 Processor -- start 2023-06-10T19:09:34.939 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:34.934+0000 7fddc6640640 1 -- start start 2023-06-10T19:09:34.941 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:34.938+0000 7fddc6640640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fddc00c8d00 0x7fddc006b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:34.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:34.938+0000 7fddc6640640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fddc006bc00 0x7fddc0162180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:34.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:34.938+0000 7fddc6640640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddc0158a90 con 0x7fddc006b2f0 2023-06-10T19:09:34.942 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:34.938+0000 7fddc6640640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddc006f780 con 0x7fddc00c8d00 2023-06-10T19:09:34.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:34.938+0000 7fddc6640640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddc00705d0 con 0x7fddc006bc00 2023-06-10T19:09:34.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:34.938+0000 7fddbf7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fddc00c8d00 0x7fddc006b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:34.943 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:34.938+0000 7fddbf7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fddc00c8d00 0x7fddc006b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55626/0 (socket says 172.21.15.53:55626) 2023-06-10T19:09:34.944 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:34.938+0000 7fddbf7fe640 1 -- 172.21.15.53:0/908726444 learned_addr learned my addr 172.21.15.53:0/908726444 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:09:34.944 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:34.938+0000 7fddc4bdd640 1 --2- 172.21.15.53:0/908726444 >> v2:172.21.15.117:3300/0 conn(0x7fddc006bc00 0x7fddc0162180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:34.944 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:34.938+0000 7fddbf7fe640 1 -- 172.21.15.53:0/908726444 >> v2:172.21.15.117:3300/0 conn(0x7fddc006bc00 msgr2=0x7fddc0162180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:09:34.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:34.938+0000 7fddbf7fe640 1 --2- 172.21.15.53:0/908726444 >> v2:172.21.15.117:3300/0 conn(0x7fddc006bc00 0x7fddc0162180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:34.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:34.938+0000 7fddbf7fe640 1 -- 172.21.15.53:0/908726444 >> v1:172.21.15.117:6789/0 conn(0x7fddc006b2f0 legacy=0x7fddc006f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:09:34.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:34.938+0000 7fddbf7fe640 1 -- 172.21.15.53:0/908726444 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddc00cce10 con 0x7fddc00c8d00 2023-06-10T19:09:34.945 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:34.938+0000 7fddc4bdd640 1 --2- 172.21.15.53:0/908726444 >> v2:172.21.15.117:3300/0 conn(0x7fddc006bc00 0x7fddc0162180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-10T19:09:34.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:34.938+0000 7fddbf7fe640 1 --2- 172.21.15.53:0/908726444 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fddc00c8d00 0x7fddc006b6c0 secure :-1 s=READY pgs=2788 cs=0 l=1 rev1=1 crypto rx=0x7fddc00c87f0 tx=0x7fdda801ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab36ae60790c8635 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:34.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:34.938+0000 7fddbeffd640 1 -- 172.21.15.53:0/908726444 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda80a89b0 con 0x7fddc00c8d00 2023-06-10T19:09:34.948 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:34.938+0000 7fddbeffd640 1 -- 172.21.15.53:0/908726444 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdda80a8b10 con 0x7fddc00c8d00 2023-06-10T19:09:34.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:34.938+0000 7fddbeffd640 1 -- 172.21.15.53:0/908726444 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda80a8ea0 con 0x7fddc00c8d00 2023-06-10T19:09:34.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:34.942+0000 7fddc6640640 1 -- 172.21.15.53:0/908726444 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fddc00c8d00 msgr2=0x7fddc006b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:34.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:34.942+0000 7fddc6640640 1 --2- 172.21.15.53:0/908726444 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fddc00c8d00 0x7fddc006b6c0 secure :-1 s=READY pgs=2788 cs=0 l=1 rev1=1 crypto rx=0x7fddc00c87f0 tx=0x7fdda801ecb0 comp rx=0 tx=0).stop 2023-06-10T19:09:34.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:34.942+0000 7fddc6640640 1 -- 172.21.15.53:0/908726444 shutdown_connections 2023-06-10T19:09:34.949 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:34.942+0000 7fddc6640640 1 --2- 172.21.15.53:0/908726444 >> v2:172.21.15.117:3300/0 conn(0x7fddc006bc00 0x7fddc0162180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:34.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:34.942+0000 7fddc6640640 1 --2- 172.21.15.53:0/908726444 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fddc00c8d00 0x7fddc006b6c0 unknown :-1 s=CLOSED pgs=2788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:34.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:34.942+0000 7fddc6640640 1 -- 172.21.15.53:0/908726444 >> 172.21.15.53:0/908726444 conn(0x7fddc006a0d0 msgr2=0x7fddc00ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:09:34.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:34.942+0000 7fddc6640640 1 -- 172.21.15.53:0/908726444 shutdown_connections 2023-06-10T19:09:34.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:34.942+0000 7fddc6640640 1 -- 172.21.15.53:0/908726444 wait complete. 2023-06-10T19:09:34.950 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:34.942+0000 7fddc6640640 1 Processor -- start 2023-06-10T19:09:34.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:34.942+0000 7fddc6640640 1 -- start start 2023-06-10T19:09:34.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:34.942+0000 7fddc6640640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fddc006b2f0 0x7fddc01f16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:34.951 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:34.942+0000 7fddc6640640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fddc006bc00 0x7fddc01531f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:34.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:34.942+0000 7fddc6640640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fddc00c8d00 0x7fddc00acb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:34.952 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:34.942+0000 7fddc6640640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddc00ab860 con 0x7fddc00c8d00 2023-06-10T19:09:34.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:34.942+0000 7fddc6640640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddc01f1c00 con 0x7fddc006b2f0 2023-06-10T19:09:34.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:34.942+0000 7fddc6640640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddc00abab0 con 0x7fddc006bc00 2023-06-10T19:09:34.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:34.942+0000 7fddc4bdd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fddc00c8d00 0x7fddc00acb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:34.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:34.942+0000 7fddc4bdd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fddc00c8d00 0x7fddc00acb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55634/0 (socket says 172.21.15.53:55634) 2023-06-10T19:09:34.953 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:34.942+0000 7fddc4bdd640 1 -- 172.21.15.53:0/2135793136 learned_addr learned my addr 172.21.15.53:0/2135793136 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:09:34.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:34.942+0000 7fddbf7fe640 1 --2- 172.21.15.53:0/2135793136 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fddc006bc00 0x7fddc01531f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:34.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:34.942+0000 7fddbffff640 1 --2- 172.21.15.53:0/2135793136 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fddc006b2f0 0x7fddc01f16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:34.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:34.942+0000 7fddc4bdd640 1 -- 172.21.15.53:0/2135793136 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fddc006bc00 msgr2=0x7fddc01531f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:34.954 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:34.942+0000 7fddc4bdd640 1 --2- 172.21.15.53:0/2135793136 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fddc006bc00 0x7fddc01531f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:34.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:34.942+0000 7fddc4bdd640 1 -- 172.21.15.53:0/2135793136 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fddc006b2f0 msgr2=0x7fddc01f16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:34.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:34.942+0000 7fddc4bdd640 1 --2- 172.21.15.53:0/2135793136 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fddc006b2f0 0x7fddc01f16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:34.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:34.942+0000 7fddc4bdd640 1 -- 172.21.15.53:0/2135793136 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdda80094d0 con 0x7fddc00c8d00 2023-06-10T19:09:34.955 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:34.946+0000 7fddc4bdd640 1 --2- 172.21.15.53:0/2135793136 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fddc00c8d00 0x7fddc00acb50 secure :-1 s=READY pgs=2789 cs=0 l=1 rev1=1 crypto rx=0x7fddb000c7f0 tx=0x7fddb000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:34.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:34.946+0000 7fddbcff9640 1 -- 172.21.15.53:0/2135793136 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb0007820 con 0x7fddc00c8d00 2023-06-10T19:09:34.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:34.946+0000 7fddbcff9640 1 -- 172.21.15.53:0/2135793136 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddb00079c0 con 0x7fddc00c8d00 2023-06-10T19:09:34.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:34.946+0000 7fddc6640640 1 -- 172.21.15.53:0/2135793136 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddc00abd90 con 0x7fddc00c8d00 2023-06-10T19:09:34.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:34.946+0000 7fddbcff9640 1 -- 172.21.15.53:0/2135793136 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb0007d70 con 0x7fddc00c8d00 2023-06-10T19:09:34.956 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:34.946+0000 7fddc6640640 1 -- 172.21.15.53:0/2135793136 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddc00ac350 con 0x7fddc00c8d00 2023-06-10T19:09:34.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:34.946+0000 7fddc6640640 1 -- 172.21.15.53:0/2135793136 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddc004d790 con 0x7fddc00c8d00 2023-06-10T19:09:34.957 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:34.946+0000 7fddbcff9640 1 -- 172.21.15.53:0/2135793136 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fddb00113f0 con 0x7fddc00c8d00 2023-06-10T19:09:34.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:34.946+0000 7fddbcff9640 1 --2- 172.21.15.53:0/2135793136 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdda0066280 0x7fdda0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:34.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:34.946+0000 7fddbcff9640 1 -- 172.21.15.53:0/2135793136 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fddb0083e30 con 0x7fddc00c8d00 2023-06-10T19:09:34.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:34.946+0000 7fddbffff640 1 --2- 172.21.15.53:0/2135793136 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdda0066280 0x7fdda0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:34.958 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:34.946+0000 7fddbffff640 1 --2- 172.21.15.53:0/2135793136 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdda0066280 0x7fdda0068730 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7fddb8009f20 tx=0x7fddb80094d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:34.959 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:34.950+0000 7fddbcff9640 1 -- 172.21.15.53:0/2135793136 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fddb0051580 con 0x7fddc00c8d00 2023-06-10T19:09:35.104 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.102+0000 7fddc6640640 1 -- 172.21.15.53:0/2135793136 --> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fddc006fca0 con 0x7fdda0066280 2023-06-10T19:09:35.111 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.110+0000 7fddbcff9640 1 -- 172.21.15.53:0/2135793136 <== mgr.4105 v2:172.21.15.117:6832/3061986771 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71576 (secure 0 0 0) 0x7fddb8009680 con 0x7fdda0066280 2023-06-10T19:09:35.113 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:09:35.114 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2023-06-10T19:09:35.115 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.110+0000 7fddc6640640 1 -- 172.21.15.53:0/2135793136 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdda0066280 msgr2=0x7fdda0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:35.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.110+0000 7fddc6640640 1 --2- 172.21.15.53:0/2135793136 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdda0066280 0x7fdda0068730 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7fddb8009f20 tx=0x7fddb80094d0 comp rx=0 tx=0).stop 2023-06-10T19:09:35.116 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.110+0000 7fddc6640640 1 -- 172.21.15.53:0/2135793136 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fddc00c8d00 msgr2=0x7fddc00acb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:35.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.110+0000 7fddc6640640 1 --2- 172.21.15.53:0/2135793136 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fddc00c8d00 0x7fddc00acb50 secure :-1 s=READY pgs=2789 cs=0 l=1 rev1=1 crypto rx=0x7fddb000c7f0 tx=0x7fddb000ccb0 comp rx=0 tx=0).stop 2023-06-10T19:09:35.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.110+0000 7fddc6640640 1 -- 172.21.15.53:0/2135793136 shutdown_connections 2023-06-10T19:09:35.117 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.110+0000 7fddc6640640 1 --2- 172.21.15.53:0/2135793136 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fdda0066280 0x7fdda0068730 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:35.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.110+0000 7fddc6640640 1 --2- 172.21.15.53:0/2135793136 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fddc00c8d00 0x7fddc00acb50 unknown :-1 s=CLOSED pgs=2789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:35.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.110+0000 7fddc6640640 1 --2- 172.21.15.53:0/2135793136 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fddc006bc00 0x7fddc01531f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:35.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.110+0000 7fddc6640640 1 --2- 172.21.15.53:0/2135793136 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fddc006b2f0 0x7fddc01f16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:35.118 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.110+0000 7fddc6640640 1 -- 172.21.15.53:0/2135793136 >> 172.21.15.53:0/2135793136 conn(0x7fddc006a0d0 msgr2=0x7fddc00ad6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:09:35.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.110+0000 7fddc6640640 1 -- 172.21.15.53:0/2135793136 shutdown_connections 2023-06-10T19:09:35.119 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.110+0000 7fddc6640640 1 -- 172.21.15.53:0/2135793136 wait complete. 2023-06-10T19:09:35.131 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":690,"stamp":"2023-06-10T19:09:33.951738+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":284220,"kb_used_data":19452,"kb_used_omap":0,"kb_used_meta":264704,"kb_avail":754690500,"statfs":{"total":773094113280,"available":772803072000,"internally_reserved":0,"allocated":19918848,"data_stored":9944271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":271056896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003901"},"pg_stats":[{"pgid":"1.0","version":"186'119","reported_seq":458,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-06-10T19:09:14.959275+0000","last_change":"2023-06-10T19:09:14.959386+0000","last_active":"2023-06-10T19:09:14.959275+0000","last_peered":"2023-06-10T19:09:14.959275+0000","last_clean":"2023-06-10T19:09:14.959275+0000","last_became_active":"2023-06-10T18:52:34.949099+0000","last_became_peered":"2023-06-10T18:52:34.949099+0000","last_unstale":"2023-06-10T19:09:14.959275+0000","last_undegraded":"2023-06-10T19:09:14.959275+0000","last_fullsized":"2023-06-10T19:09:14.959275+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"186'119","last_scrub_stamp":"2023-06-10T19:09:14.959064+0000","last_deep_scrub":"186'119","last_deep_scrub_stamp":"2023-06-10T19:09:14.959064+0000","last_clean_scrub_stamp":"2023-06-10T19:09:14.959064+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T22:38:25.085063+0000","scrub_duration":0.011889424000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":332,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-06-10T19:09:21.388513+0000","last_change":"2023-06-10T19:09:21.388513+0000","last_active":"2023-06-10T19:09:21.388513+0000","last_peered":"2023-06-10T19:09:21.388513+0000","last_clean":"2023-06-10T19:09:21.388513+0000","last_became_active":"2023-06-10T18:52:40.505701+0000","last_became_peered":"2023-06-10T18:52:40.505701+0000","last_unstale":"2023-06-10T19:09:21.388513+0000","last_undegraded":"2023-06-10T19:09:21.388513+0000","last_fullsized":"2023-06-10T19:09:21.388513+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:09:21.388212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:09:21.388212+0000","last_clean_scrub_stamp":"2023-06-10T19:09:21.388212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:22:47.806922+0000","scrub_duration":0.0066266729999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":300,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-06-10T19:09:20.045081+0000","last_change":"2023-06-10T19:09:20.045179+0000","last_active":"2023-06-10T19:09:20.045081+0000","last_peered":"2023-06-10T19:09:20.045081+0000","last_clean":"2023-06-10T19:09:20.045081+0000","last_became_active":"2023-06-10T18:52:40.511382+0000","last_became_peered":"2023-06-10T18:52:40.511382+0000","last_unstale":"2023-06-10T19:09:20.045081+0000","last_undegraded":"2023-06-10T19:09:20.045081+0000","last_fullsized":"2023-06-10T19:09:20.045081+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:09:20.044860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:09:20.044860+0000","last_clean_scrub_stamp":"2023-06-10T19:09:20.044860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T03:37:48.758230+0000","scrub_duration":0.0064634820000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":322,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-06-10T19:09:14.020918+0000","last_change":"2023-06-10T19:09:14.020918+0000","last_active":"2023-06-10T19:09:14.020918+0000","last_peered":"2023-06-10T19:09:14.020918+0000","last_clean":"2023-06-10T19:09:14.020918+0000","last_became_active":"2023-06-10T18:52:40.671442+0000","last_became_peered":"2023-06-10T18:52:40.671442+0000","last_unstale":"2023-06-10T19:09:14.020918+0000","last_undegraded":"2023-06-10T19:09:14.020918+0000","last_fullsized":"2023-06-10T19:09:14.020918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:09:14.020731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:09:14.020731+0000","last_clean_scrub_stamp":"2023-06-10T19:09:14.020731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:14:33.549384+0000","scrub_duration":0.004558983,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":332,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-06-10T19:09:18.266028+0000","last_change":"2023-06-10T19:09:18.266028+0000","last_active":"2023-06-10T19:09:18.266028+0000","last_peered":"2023-06-10T19:09:18.266028+0000","last_clean":"2023-06-10T19:09:18.266028+0000","last_became_active":"2023-06-10T18:52:40.509560+0000","last_became_peered":"2023-06-10T18:52:40.509560+0000","last_unstale":"2023-06-10T19:09:18.266028+0000","last_undegraded":"2023-06-10T19:09:18.266028+0000","last_fullsized":"2023-06-10T19:09:18.266028+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:09:18.265694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:09:18.265694+0000","last_clean_scrub_stamp":"2023-06-10T19:09:18.265694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T19:21:43.770905+0000","scrub_duration":0.0069931220000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":302,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-06-10T19:09:17.813350+0000","last_change":"2023-06-10T19:09:17.813350+0000","last_active":"2023-06-10T19:09:17.813350+0000","last_peered":"2023-06-10T19:09:17.813350+0000","last_clean":"2023-06-10T19:09:17.813350+0000","last_became_active":"2023-06-10T18:52:40.671966+0000","last_became_peered":"2023-06-10T18:52:40.671966+0000","last_unstale":"2023-06-10T19:09:17.813350+0000","last_undegraded":"2023-06-10T19:09:17.813350+0000","last_fullsized":"2023-06-10T19:09:17.813350+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:09:17.812901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:09:17.812901+0000","last_clean_scrub_stamp":"2023-06-10T19:09:17.812901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T06:50:04.215798+0000","scrub_duration":0.0068224339999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":300,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-06-10T19:09:26.083518+0000","last_change":"2023-06-10T19:09:26.083518+0000","last_active":"2023-06-10T19:09:26.083518+0000","last_peered":"2023-06-10T19:09:26.083518+0000","last_clean":"2023-06-10T19:09:26.083518+0000","last_became_active":"2023-06-10T18:52:40.670697+0000","last_became_peered":"2023-06-10T18:52:40.670697+0000","last_unstale":"2023-06-10T19:09:26.083518+0000","last_undegraded":"2023-06-10T19:09:26.083518+0000","last_fullsized":"2023-06-10T19:09:26.083518+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:09:26.083149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:09:26.083149+0000","last_clean_scrub_stamp":"2023-06-10T19:09:26.083149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T01:08:52.134601+0000","scrub_duration":0.0073721530000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":301,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-06-10T19:09:15.826550+0000","last_change":"2023-06-10T19:09:15.826644+0000","last_active":"2023-06-10T19:09:15.826550+0000","last_peered":"2023-06-10T19:09:15.826550+0000","last_clean":"2023-06-10T19:09:15.826550+0000","last_became_active":"2023-06-10T18:52:40.513638+0000","last_became_peered":"2023-06-10T18:52:40.513638+0000","last_unstale":"2023-06-10T19:09:15.826550+0000","last_undegraded":"2023-06-10T19:09:15.826550+0000","last_fullsized":"2023-06-10T19:09:15.826550+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:09:15.826327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:09:15.826327+0000","last_clean_scrub_stamp":"2023-06-10T19:09:15.826327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-11T20:20:35.397987+0000","scrub_duration":0.0070269579999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":301,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-06-10T19:09:17.827713+0000","last_change":"2023-06-10T19:09:17.827803+0000","last_active":"2023-06-10T19:09:17.827713+0000","last_peered":"2023-06-10T19:09:17.827713+0000","last_clean":"2023-06-10T19:09:17.827713+0000","last_became_active":"2023-06-10T18:52:40.514663+0000","last_became_peered":"2023-06-10T18:52:40.514663+0000","last_unstale":"2023-06-10T19:09:17.827713+0000","last_undegraded":"2023-06-10T19:09:17.827713+0000","last_fullsized":"2023-06-10T19:09:17.827713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-10T19:09:17.827481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-10T19:09:17.827481+0000","last_clean_scrub_stamp":"2023-06-10T19:09:17.827481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-12T00:49:20.212039+0000","scrub_duration":0.0067155640000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575055,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33916,"kb_used_data":2868,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94337924,"statfs":{"total":96636764160,"available":96602034176,"internally_reserved":0,"allocated":2936832,"data_stored":1686192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.93300000000000005,"15min":0.93400000000000005},"min":{"1min":0.52300000000000002,"5min":0.443,"15min":0.434},"max":{"1min":1.1100000000000001,"5min":1.522,"15min":1.522},"last":1.2729999999999999},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.90600000000000003,"15min":0.92100000000000004},"min":{"1min":0.55300000000000005,"5min":0.49399999999999999,"15min":0.45200000000000001},"max":{"1min":1.1910000000000001,"5min":1.3109999999999999,"15min":1.5389999999999999},"last":1.044}]},{"osd":1,"last update":"Sat Jun 10 19:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.91300000000000003,"15min":0.92200000000000004},"min":{"1min":0.52500000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.2929999999999999,"5min":1.365,"15min":1.377},"last":1.3220000000000001},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.92800000000000005,"15min":0.94899999999999995},"min":{"1min":0.65400000000000003,"5min":0.55000000000000004,"15min":0.51300000000000001},"max":{"1min":1.216,"5min":1.3320000000000001,"15min":1.4630000000000001},"last":1.21}]},{"osd":2,"last update":"Sat Jun 10 19:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.90300000000000002,"15min":0.86899999999999999},"min":{"1min":0.55400000000000005,"5min":0.41899999999999998,"15min":0.35699999999999998},"max":{"1min":1.1579999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":1.1000000000000001},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.88900000000000001,"15min":0.89300000000000002},"min":{"1min":0.69199999999999995,"5min":0.53300000000000003,"15min":0.50600000000000001},"max":{"1min":1.24,"5min":1.3100000000000001,"15min":1.448},"last":1.008}]},{"osd":3,"last update":"Sat Jun 10 19:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.91700000000000004,"15min":0.92700000000000005},"min":{"1min":0.65200000000000002,"5min":0.60599999999999998,"15min":0.46300000000000002},"max":{"1min":1.1899999999999999,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.95499999999999996},{"interface":"front","average":{"1min":1.002,"5min":0.97599999999999998,"15min":0.96399999999999997},"min":{"1min":0.77200000000000002,"5min":0.496,"15min":0.432},"max":{"1min":1.335,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":1.071}]},{"osd":4,"last update":"Sat Jun 10 19:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.83699999999999997,"15min":0.83999999999999997},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.307},"max":{"1min":1.268,"5min":1.268,"15min":1.639},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.97499999999999998,"15min":0.96199999999999997},"min":{"1min":0.67700000000000005,"5min":0.47299999999999998,"15min":0.40000000000000002},"max":{"1min":1.159,"5min":1.3540000000000001,"15min":1.4590000000000001},"last":0.85899999999999999}]},{"osd":5,"last update":"Sat Jun 10 19:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.97299999999999998,"15min":0.98599999999999999},"min":{"1min":0.67100000000000004,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.262,"5min":1.385,"15min":1.5569999999999999},"last":1.1890000000000001},{"interface":"front","average":{"1min":0.98699999999999999,"5min":1.04,"15min":1.0309999999999999},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.46500000000000002},"max":{"1min":1.218,"5min":1.665,"15min":1.665},"last":1.2330000000000001}]},{"osd":6,"last update":"Sat Jun 10 19:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.99099999999999999,"15min":1},"min":{"1min":0.65100000000000002,"5min":0.56200000000000006,"15min":0.35999999999999999},"max":{"1min":1.3149999999999999,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":1.161},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.1020000000000001,"15min":1.0960000000000001},"min":{"1min":0.81899999999999995,"5min":0.69899999999999995,"15min":0.441},"max":{"1min":1.2629999999999999,"5min":1.728,"15min":1.728},"last":1.3420000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575056,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33336,"kb_used_data":2288,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338504,"statfs":{"total":96636764160,"available":96602628096,"internally_reserved":0,"allocated":2342912,"data_stored":1095824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:09:01 2023","interfaces":[{"interface":"back","average":{"1min":1.575,"5min":0.98999999999999999,"15min":0.91800000000000004},"min":{"1min":0.56899999999999995,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":12.345000000000001,"5min":12.345000000000001,"15min":12.345000000000001},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.51,"5min":1.008,"15min":0.92900000000000005},"min":{"1min":0.65000000000000002,"5min":0.57099999999999995,"15min":0.40699999999999997},"max":{"1min":10.475,"5min":10.475,"15min":10.475},"last":0.82399999999999995}]},{"osd":1,"last update":"Sat Jun 10 19:09:01 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.83399999999999996,"15min":0.86199999999999999},"min":{"1min":0.68500000000000005,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.0780000000000001,"5min":1.2709999999999999,"15min":1.5229999999999999},"last":0.87},{"interface":"front","average":{"1min":1.5940000000000001,"5min":1.0489999999999999,"15min":0.95599999999999996},"min":{"1min":0.58999999999999997,"5min":0.504,"15min":0.45300000000000001},"max":{"1min":12.467000000000001,"5min":12.467000000000001,"15min":12.467000000000001},"last":1.1479999999999999}]},{"osd":2,"last update":"Sat Jun 10 19:09:01 2023","interfaces":[{"interface":"back","average":{"1min":1.5149999999999999,"5min":1.0189999999999999,"15min":0.94599999999999995},"min":{"1min":0.63200000000000001,"5min":0.51200000000000001,"15min":0.48799999999999999},"max":{"1min":10.566000000000001,"5min":10.566000000000001,"15min":10.566000000000001},"last":1.242},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.85999999999999999,"15min":0.88},"min":{"1min":0.626,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.72299999999999998}]},{"osd":3,"last update":"Sat Jun 10 19:09:01 2023","interfaces":[{"interface":"back","average":{"1min":1.6439999999999999,"5min":1.0569999999999999,"15min":0.97699999999999998},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":12.411,"5min":12.411,"15min":12.411},"last":1.083},{"interface":"front","average":{"1min":1.5569999999999999,"5min":1.0640000000000001,"15min":1.0169999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.52900000000000003},"max":{"1min":10.695,"5min":10.695,"15min":10.695},"last":1.1799999999999999}]},{"osd":4,"last update":"Sat Jun 10 19:09:01 2023","interfaces":[{"interface":"back","average":{"1min":1.629,"5min":1.0760000000000001,"15min":0.95999999999999996},"min":{"1min":0.65200000000000002,"5min":0.45900000000000002,"15min":0.373},"max":{"1min":13.308999999999999,"5min":13.308999999999999,"15min":13.308999999999999},"last":0.96699999999999997},{"interface":"front","average":{"1min":1.853,"5min":1.1619999999999999,"15min":1.0389999999999999},"min":{"1min":0.73299999999999998,"5min":0.504,"15min":0.47899999999999998},"max":{"1min":15.680999999999999,"5min":15.680999999999999,"15min":15.680999999999999},"last":1.036}]},{"osd":5,"last update":"Sat Jun 10 19:09:01 2023","interfaces":[{"interface":"back","average":{"1min":1.7869999999999999,"5min":1.0489999999999999,"15min":0.95399999999999996},"min":{"1min":0.68200000000000005,"5min":0.437,"15min":0.437},"max":{"1min":15.074999999999999,"5min":15.074999999999999,"15min":15.074999999999999},"last":0.996},{"interface":"front","average":{"1min":1.903,"5min":1.1970000000000001,"15min":1.0820000000000001},"min":{"1min":0.69799999999999995,"5min":0.47199999999999998,"15min":0.42699999999999999},"max":{"1min":15.189,"5min":15.189,"15min":15.189},"last":1.2649999999999999}]},{"osd":7,"last update":"Sat Jun 10 19:09:01 2023","interfaces":[{"interface":"back","average":{"1min":1.6279999999999999,"5min":1.1419999999999999,"15min":1.0660000000000001},"min":{"1min":0.64600000000000002,"5min":0.59199999999999997,"15min":0.57099999999999995},"max":{"1min":10.813000000000001,"5min":10.813000000000001,"15min":10.813000000000001},"last":0.92500000000000004},{"interface":"front","average":{"1min":1.133,"5min":1.0069999999999999,"15min":1.0029999999999999},"min":{"1min":0.76900000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":2.4870000000000001,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":1.109}]}]},{"osd":5,"up_from":13,"seq":55834575056,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33336,"kb_used_data":2288,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338504,"statfs":{"total":96636764160,"available":96602628096,"internally_reserved":0,"allocated":2342912,"data_stored":1095824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.85199999999999998,"15min":0.873},"min":{"1min":0.51900000000000002,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.2350000000000001,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.88400000000000001,"15min":0.89700000000000002},"min":{"1min":0.64200000000000002,"5min":0.50800000000000001,"15min":0.49399999999999999},"max":{"1min":1.1779999999999999,"5min":1.2370000000000001,"15min":2.347},"last":0.73999999999999999}]},{"osd":1,"last update":"Sat Jun 10 19:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.89100000000000001,"15min":0.91000000000000003},"min":{"1min":0.51800000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.3180000000000001,"5min":1.6739999999999999,"15min":7.0800000000000001},"last":1.093},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.89600000000000002,"15min":0.98099999999999998},"min":{"1min":0.67200000000000004,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.117,"5min":1.244,"15min":15.845000000000001},"last":0.78800000000000003}]},{"osd":2,"last update":"Sat Jun 10 19:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.90400000000000003,"15min":0.90000000000000002},"min":{"1min":0.66200000000000003,"5min":0.59899999999999998,"15min":0.48299999999999998},"max":{"1min":1.1930000000000001,"5min":1.6459999999999999,"15min":5.0049999999999999},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.92700000000000005,"15min":0.94899999999999995},"min":{"1min":0.69099999999999995,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.163,"5min":1.391,"15min":6.851},"last":0.97499999999999998}]},{"osd":3,"last update":"Sat Jun 10 19:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.93100000000000005,"15min":0.94699999999999995},"min":{"1min":0.71799999999999997,"5min":0.58699999999999997,"15min":0.51500000000000001},"max":{"1min":1.304,"5min":1.6910000000000001,"15min":2.544},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.98399999999999999,"15min":0.98499999999999999},"min":{"1min":0.77600000000000002,"5min":0.66000000000000003,"15min":0.59799999999999998},"max":{"1min":1.1619999999999999,"5min":1.4870000000000001,"15min":3.0830000000000002},"last":1.0529999999999999}]},{"osd":4,"last update":"Sat Jun 10 19:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.93500000000000005,"15min":0.93999999999999995},"min":{"1min":0.64300000000000002,"5min":0.59799999999999998,"15min":0.58099999999999996},"max":{"1min":1.246,"5min":1.6140000000000001,"15min":6.7290000000000001},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.97899999999999998,"15min":0.97999999999999998},"min":{"1min":0.61699999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.278,"5min":1.677,"15min":1.677},"last":1.0209999999999999}]},{"osd":6,"last update":"Sat Jun 10 19:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.98199999999999998,"15min":0.97599999999999998},"min":{"1min":0.64100000000000001,"5min":0.60499999999999998,"15min":0.54200000000000004},"max":{"1min":1.2110000000000001,"5min":1.8009999999999999,"15min":1.8009999999999999},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.012,"5min":1.04,"15min":1.0489999999999999},"min":{"1min":0.77600000000000002,"5min":0.66200000000000003,"15min":0.57899999999999996},"max":{"1min":1.504,"5min":1.8380000000000001,"15min":6.923},"last":1.177}]},{"osd":7,"last update":"Sat Jun 10 19:08:58 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.0780000000000001,"15min":1.073},"min":{"1min":0.70699999999999996,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.4419999999999999,"5min":1.7749999999999999,"15min":2.6080000000000001},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.125,"5min":1.1200000000000001,"15min":1.1279999999999999},"min":{"1min":0.74099999999999999,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.351,"5min":1.8049999999999999,"15min":5.4169999999999998},"last":1.2050000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575055,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33336,"kb_used_data":2288,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338504,"statfs":{"total":96636764160,"available":96602628096,"internally_reserved":0,"allocated":2342912,"data_stored":1095824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.82699999999999996,"15min":0.84399999999999997},"min":{"1min":0.498,"5min":0.498,"15min":0.45100000000000001},"max":{"1min":1.0720000000000001,"5min":1.29,"15min":1.29},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.91400000000000003,"15min":0.91300000000000003},"min":{"1min":0.60899999999999999,"5min":0.439,"15min":0.439},"max":{"1min":1.593,"5min":1.593,"15min":3.7280000000000002},"last":1.329}]},{"osd":1,"last update":"Sat Jun 10 19:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.89300000000000002,"15min":0.91700000000000004},"min":{"1min":0.60499999999999998,"5min":0.47799999999999998,"15min":0.47599999999999998},"max":{"1min":1.4259999999999999,"5min":1.5429999999999999,"15min":3.3969999999999998},"last":1.03},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.85399999999999998,"15min":0.86399999999999999},"min":{"1min":0.58199999999999996,"5min":0.47899999999999998,"15min":0.47699999999999998},"max":{"1min":1.089,"5min":1.2430000000000001,"15min":2.496},"last":0.85799999999999998}]},{"osd":2,"last update":"Sat Jun 10 19:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.86499999999999999,"15min":0.877},"min":{"1min":0.629,"5min":0.52400000000000002,"15min":0.49299999999999999},"max":{"1min":1.472,"5min":1.472,"15min":1.522},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.94199999999999995,"15min":0.97299999999999998},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.169,"5min":1.4670000000000001,"15min":3.5750000000000002},"last":1.425}]},{"osd":3,"last update":"Sat Jun 10 19:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.86099999999999999,"15min":0.89300000000000002},"min":{"1min":0.64300000000000002,"5min":0.57799999999999996,"15min":0.53900000000000003},"max":{"1min":1.2090000000000001,"5min":1.28,"15min":2.3809999999999998},"last":1.0649999999999999},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.65300000000000002,"5min":0.58199999999999996,"15min":0.56799999999999995},"max":{"1min":1.2889999999999999,"5min":1.4279999999999999,"15min":1.4490000000000001},"last":0.90200000000000002}]},{"osd":5,"last update":"Sat Jun 10 19:09:12 2023","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.97799999999999998,"15min":0.95599999999999996},"min":{"1min":0.79500000000000004,"5min":0.58699999999999997,"15min":0.53100000000000003},"max":{"1min":1.208,"5min":1.4159999999999999,"15min":3.6539999999999999},"last":1.1890000000000001},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.93999999999999995,"15min":0.93899999999999995},"min":{"1min":0.70899999999999996,"5min":0.54600000000000004,"15min":0.495},"max":{"1min":1.492,"5min":1.492,"15min":2.6720000000000002},"last":0.95999999999999996}]},{"osd":6,"last update":"Sat Jun 10 19:09:12 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":0.97099999999999997,"15min":0.96299999999999997},"min":{"1min":0.71799999999999997,"5min":0.443,"15min":0.443},"max":{"1min":1.3540000000000001,"5min":1.413,"15min":1.5720000000000001},"last":1.101},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.085,"15min":1.0700000000000001},"min":{"1min":0.86499999999999999,"5min":0.58799999999999997,"15min":0.44400000000000001},"max":{"1min":1.298,"5min":1.625,"15min":3.4980000000000002},"last":1.5}]},{"osd":7,"last update":"Sat Jun 10 19:09:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.038,"15min":1.0089999999999999},"min":{"1min":0.83999999999999997,"5min":0.58599999999999997,"15min":0.41399999999999998},"max":{"1min":1.3799999999999999,"5min":1.506,"15min":2.5910000000000002},"last":1.149},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.097,"15min":1.0760000000000001},"min":{"1min":0.80100000000000005,"5min":0.50800000000000001,"15min":0.46300000000000002},"max":{"1min":1.456,"5min":1.635,"15min":1.635},"last":1.282}]}]},{"osd":3,"up_from":13,"seq":55834575054,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37428,"kb_used_data":2284,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334412,"statfs":{"total":96636764160,"available":96598437888,"internally_reserved":0,"allocated":2338816,"data_stored":1094805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.626,"15min":0.626},"min":{"1min":0.26000000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.91800000000000004,"5min":1.0900000000000001,"15min":1.169},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.64800000000000002,"15min":0.66800000000000004},"min":{"1min":0.32000000000000001,"5min":0.29299999999999998,"15min":0.251},"max":{"1min":0.93999999999999995,"5min":0.97799999999999998,"15min":1.5269999999999999},"last":0.68799999999999994}]},{"osd":1,"last update":"Sat Jun 10 19:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.67700000000000005,"15min":0.68899999999999995},"min":{"1min":0.308,"5min":0.29699999999999999,"15min":0.27800000000000002},"max":{"1min":1.03,"5min":1.234,"15min":2.0699999999999998},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.70299999999999996,"15min":0.73199999999999998},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.0129999999999999,"5min":1.1659999999999999,"15min":1.296},"last":0.74399999999999999}]},{"osd":2,"last update":"Sat Jun 10 19:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.73699999999999999,"15min":0.76800000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.1359999999999999,"5min":1.1950000000000001,"15min":1.3899999999999999},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.78000000000000003,"15min":0.79200000000000004},"min":{"1min":0.314,"5min":0.314,"15min":0.29699999999999999},"max":{"1min":1.119,"5min":1.2769999999999999,"15min":1.591},"last":0.81499999999999995}]},{"osd":4,"last update":"Sat Jun 10 19:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.92000000000000004,"15min":0.94099999999999995},"min":{"1min":0.57899999999999996,"5min":0.55800000000000005,"15min":0.41899999999999998},"max":{"1min":1.2729999999999999,"5min":1.333,"15min":1.8240000000000001},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.98199999999999998,"15min":0.98699999999999999},"min":{"1min":0.502,"5min":0.502,"15min":0.47999999999999998},"max":{"1min":1.3720000000000001,"5min":1.4330000000000001,"15min":1.873},"last":1.0640000000000001}]},{"osd":5,"last update":"Sat Jun 10 19:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.98899999999999999,"15min":0.998},"min":{"1min":0.61699999999999999,"5min":0.55900000000000005,"15min":0.55200000000000005},"max":{"1min":1.371,"5min":1.536,"15min":1.752},"last":1.0269999999999999},{"interface":"front","average":{"1min":0.94499999999999995,"5min":1.022,"15min":1.0329999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.46899999999999997},"max":{"1min":1.399,"5min":1.534,"15min":1.9259999999999999},"last":1.093}]},{"osd":6,"last update":"Sat Jun 10 19:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":1.0329999999999999,"15min":1.0569999999999999},"min":{"1min":0.60599999999999998,"5min":0.56999999999999995,"15min":0.55300000000000005},"max":{"1min":1.4570000000000001,"5min":1.617,"15min":1.786},"last":1.0449999999999999},{"interface":"front","average":{"1min":0.96399999999999997,"5min":1.0149999999999999,"15min":1.042},"min":{"1min":0.68700000000000006,"5min":0.61399999999999999,"15min":0.58799999999999997},"max":{"1min":1.375,"5min":1.4530000000000001,"15min":2.2120000000000002},"last":1.149}]},{"osd":7,"last update":"Sat Jun 10 19:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":1.046,"15min":1.0700000000000001},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.4570000000000001,"5min":1.5720000000000001,"15min":2.1150000000000002},"last":1.206},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.083,"15min":1.099},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.764,"5min":1.764,"15min":1.9850000000000001},"last":1.1799999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575055,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37432,"kb_used_data":2288,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334408,"statfs":{"total":96636764160,"available":96598433792,"internally_reserved":0,"allocated":2342912,"data_stored":1095824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.63700000000000001,"15min":0.628},"min":{"1min":0.28899999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.2330000000000001,"5min":2.883,"15min":2.883},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.78800000000000003,"15min":0.746},"min":{"1min":0.42599999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":3.528,"5min":6.5670000000000002,"15min":6.5670000000000002},"last":0.753}]},{"osd":1,"last update":"Sat Jun 10 19:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.63900000000000001,"15min":0.66100000000000003},"min":{"1min":0.34699999999999998,"5min":0.32300000000000001,"15min":0.29199999999999998},"max":{"1min":0.95399999999999996,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.82599999999999996,"15min":0.79300000000000004},"min":{"1min":0.38100000000000001,"5min":0.32500000000000001,"15min":0.27400000000000002},"max":{"1min":1.948,"5min":8.4429999999999996,"15min":8.4429999999999996},"last":0.64600000000000002}]},{"osd":3,"last update":"Sat Jun 10 19:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.76800000000000002,"15min":0.78500000000000003},"min":{"1min":0.38700000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":2.4969999999999999,"5min":2.4969999999999999,"15min":2.4969999999999999},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.77600000000000002,"15min":0.78000000000000003},"min":{"1min":0.36799999999999999,"5min":0.33600000000000002,"15min":0.23499999999999999},"max":{"1min":2.3719999999999999,"5min":4.1849999999999996,"15min":4.1849999999999996},"last":0.80600000000000005}]},{"osd":4,"last update":"Sat Jun 10 19:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.94399999999999995,"15min":0.93400000000000005},"min":{"1min":0.624,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.3089999999999999,"5min":3.996,"15min":3.996},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.93999999999999995,"5min":1.119,"15min":1.044},"min":{"1min":0.61699999999999999,"5min":0.502,"15min":0.496},"max":{"1min":1.369,"5min":13.254,"15min":13.254},"last":0.97499999999999998}]},{"osd":5,"last update":"Sat Jun 10 19:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":1.131,"15min":1.048},"min":{"1min":0.62,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.2749999999999999,"5min":6.9189999999999996,"15min":6.9189999999999996},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.91700000000000004,"5min":1.2390000000000001,"15min":1.0960000000000001},"min":{"1min":0.57199999999999995,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.161,"5min":15.526,"15min":15.526},"last":1.278}]},{"osd":6,"last update":"Sat Jun 10 19:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":1.1220000000000001,"15min":1.0760000000000001},"min":{"1min":0.69299999999999995,"5min":0.624,"15min":0.52700000000000002},"max":{"1min":1.226,"5min":8.7089999999999996,"15min":8.7089999999999996},"last":1.4059999999999999},{"interface":"front","average":{"1min":0.96099999999999997,"5min":1.048,"15min":1.0489999999999999},"min":{"1min":0.58599999999999997,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.417,"5min":6.1299999999999999,"15min":6.1299999999999999},"last":1.0069999999999999}]},{"osd":7,"last update":"Sat Jun 10 19:09:05 2023","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.286,"15min":1.1639999999999999},"min":{"1min":0.66600000000000004,"5min":0.60299999999999998,"15min":0.57199999999999995},"max":{"1min":1.4650000000000001,"5min":12.138,"15min":12.138},"last":1.091},{"interface":"front","average":{"1min":0.96499999999999997,"5min":1.0569999999999999,"15min":1.1040000000000001},"min":{"1min":0.63500000000000001,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.278,"5min":1.883,"15min":1.883},"last":1.355}]}]},{"osd":1,"up_from":13,"seq":55834575057,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37428,"kb_used_data":2284,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334412,"statfs":{"total":96636764160,"available":96598437888,"internally_reserved":0,"allocated":2338816,"data_stored":1094805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jun 10 19:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.66900000000000004,"15min":0.68000000000000005},"min":{"1min":0.28199999999999997,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.288},"last":0.71199999999999997},{"interface":"front","average":{"1min":1.0309999999999999,"5min":0.78700000000000003,"15min":0.77300000000000002},"min":{"1min":0.34100000000000003,"5min":0.32300000000000001,"15min":0.26900000000000002},"max":{"1min":5.625,"5min":5.625,"15min":5.625},"last":0.91800000000000004}]},{"osd":2,"last update":"Sat Jun 10 19:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.624,"15min":0.63900000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.249},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.21},"last":0.621},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.71499999999999997,"15min":0.73099999999999998},"min":{"1min":0.36499999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.98399999999999999,"5min":1.2390000000000001,"15min":1.415},"last":0.81200000000000006}]},{"osd":3,"last update":"Sat Jun 10 19:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.753,"15min":0.78400000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.25600000000000001},"max":{"1min":1.177,"5min":1.177,"15min":1.6299999999999999},"last":1.0629999999999999},{"interface":"front","average":{"1min":1.099,"5min":0.77600000000000002,"15min":0.752},"min":{"1min":0.42199999999999999,"5min":0.36099999999999999,"15min":0.29599999999999999},"max":{"1min":6.8200000000000003,"5min":6.8200000000000003,"15min":6.8200000000000003},"last":0.77000000000000002}]},{"osd":4,"last update":"Sat Jun 10 19:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.879,"15min":0.875},"min":{"1min":0.59999999999999998,"5min":0.58599999999999997,"15min":0.56399999999999995},"max":{"1min":1.1950000000000001,"5min":1.3620000000000001,"15min":1.4930000000000001},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.0029999999999999,"15min":1.024},"min":{"1min":0.65900000000000003,"5min":0.58899999999999997,"15min":0.47099999999999997},"max":{"1min":1.385,"5min":1.575,"15min":5.8209999999999997},"last":1.2829999999999999}]},{"osd":5,"last update":"Sat Jun 10 19:09:07 2023","interfaces":[{"interface":"back","average":{"1min":1.331,"5min":1.0369999999999999,"15min":1.0109999999999999},"min":{"1min":0.75,"5min":0.54800000000000004,"15min":0.49399999999999999},"max":{"1min":6.7030000000000003,"5min":6.7030000000000003,"15min":6.7030000000000003},"last":1.1479999999999999},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.95999999999999996,"15min":0.97999999999999998},"min":{"1min":0.63400000000000001,"5min":0.55000000000000004,"15min":0.46300000000000002},"max":{"1min":1.409,"5min":1.448,"15min":3.089},"last":1.109}]},{"osd":6,"last update":"Sat Jun 10 19:09:07 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.0529999999999999,"15min":1.0700000000000001},"min":{"1min":0.79100000000000004,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":6.7450000000000001,"5min":6.7450000000000001,"15min":7.2599999999999998},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.0109999999999999,"5min":0.99099999999999999,"15min":1.0349999999999999},"min":{"1min":0.65600000000000003,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.343,"5min":1.5469999999999999,"15min":9.0069999999999997},"last":1.181}]},{"osd":7,"last update":"Sat Jun 10 19:09:07 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.0629999999999999,"15min":1.0780000000000001},"min":{"1min":0.74299999999999999,"5min":0.54300000000000004,"15min":0.495},"max":{"1min":1.444,"5min":1.4890000000000001,"15min":1.6879999999999999},"last":1.3420000000000001},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.125,"15min":1.1020000000000001},"min":{"1min":0.621,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":6.782,"5min":6.782,"15min":6.782},"last":1.2569999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575056,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38008,"kb_used_data":2864,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94333832,"statfs":{"total":96636764160,"available":96597843968,"internally_reserved":0,"allocated":2932736,"data_stored":1685173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jun 10 19:09:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.624,"15min":0.64000000000000001},"min":{"1min":0.26000000000000001,"5min":0.255,"15min":0.248},"max":{"1min":0.91100000000000003,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.78000000000000003,"15min":0.80600000000000005},"min":{"1min":0.37,"5min":0.33000000000000002,"15min":0.32700000000000001},"max":{"1min":1.141,"5min":1.3080000000000001,"15min":1.5780000000000001},"last":0.85199999999999998}]},{"osd":2,"last update":"Sat Jun 10 19:09:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.69299999999999995,"15min":0.71499999999999997},"min":{"1min":0.45600000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.101,"5min":1.1970000000000001,"15min":1.2490000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64500000000000002,"15min":0.65400000000000003},"min":{"1min":0.28899999999999998,"5min":0.28699999999999998,"15min":0.245},"max":{"1min":0.92100000000000004,"5min":1.1779999999999999,"15min":1.371},"last":1.038}]},{"osd":3,"last update":"Sat Jun 10 19:09:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.68400000000000005,"15min":0.68500000000000005},"min":{"1min":0.35099999999999998,"5min":0.309,"15min":0.28899999999999998},"max":{"1min":1.173,"5min":1.397,"15min":1.397},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77700000000000002,"15min":0.81200000000000006},"min":{"1min":0.40100000000000002,"5min":0.36399999999999999,"15min":0.29199999999999998},"max":{"1min":1.2410000000000001,"5min":1.6240000000000001,"15min":1.742},"last":0.79000000000000004}]},{"osd":4,"last update":"Sat Jun 10 19:09:04 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.89400000000000002,"15min":0.92100000000000004},"min":{"1min":0.47399999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.5580000000000001,"5min":1.758,"15min":3.0209999999999999},"last":0.96899999999999997},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.995,"15min":1.0169999999999999},"min":{"1min":0.56799999999999995,"5min":0.56200000000000006,"15min":0.48599999999999999},"max":{"1min":1.2909999999999999,"5min":1.7250000000000001,"15min":1.873},"last":1.0009999999999999}]},{"osd":5,"last update":"Sat Jun 10 19:09:04 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.88500000000000001,"15min":0.91700000000000004},"min":{"1min":0.55500000000000005,"5min":0.51300000000000001,"15min":0.45100000000000001},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":1.173},{"interface":"front","average":{"1min":1.004,"5min":0.97499999999999998,"15min":1.0009999999999999},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.51400000000000001},"max":{"1min":1.6879999999999999,"5min":1.9870000000000001,"15min":4.5620000000000003},"last":1.1539999999999999}]},{"osd":6,"last update":"Sat Jun 10 19:09:04 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.038,"15min":1.073},"min":{"1min":0.76200000000000001,"5min":0.58699999999999997,"15min":0.52600000000000002},"max":{"1min":1.5129999999999999,"5min":1.9330000000000001,"15min":3.5569999999999999},"last":1.0860000000000001},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.98899999999999999,"15min":0.998},"min":{"1min":0.61099999999999999,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.333,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":1.3400000000000001}]},{"osd":7,"last update":"Sat Jun 10 19:09:04 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.0069999999999999,"15min":1.0249999999999999},"min":{"1min":0.58399999999999996,"5min":0.54700000000000004,"15min":0.54600000000000004},"max":{"1min":1.506,"5min":1.804,"15min":1.804},"last":1.2589999999999999},{"interface":"front","average":{"1min":0.98699999999999999,"5min":1.036,"15min":1.0529999999999999},"min":{"1min":0.65200000000000002,"5min":0.61299999999999999,"15min":0.61099999999999999},"max":{"1min":1.3180000000000001,"5min":2.1219999999999999,"15min":2.1219999999999999},"last":1.206}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-10T19:09:35.134 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-06-10T19:09:35.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.262+0000 7fe662506640 1 Processor -- start 2023-06-10T19:09:35.263 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.262+0000 7fe662506640 1 -- start start 2023-06-10T19:09:35.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.262+0000 7fe662506640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe65c159700 0x7fe65c0ab860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:35.264 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.262+0000 7fe662506640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe65c0abda0 0x7fe65c0c9380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:35.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.262+0000 7fe662506640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe65c0c82e0 con 0x7fe65c159330 2023-06-10T19:09:35.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.262+0000 7fe662506640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe65c0c85c0 con 0x7fe65c0abda0 2023-06-10T19:09:35.265 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.262+0000 7fe662506640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe65c0c88a0 con 0x7fe65c159700 2023-06-10T19:09:35.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.262+0000 7fe65b7fe640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe65c159700 0x7fe65c0ab860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:35.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.262+0000 7fe660aa3640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe65c0abda0 0x7fe65c0c9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:35.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.262+0000 7fe65b7fe640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe65c159700 0x7fe65c0ab860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.53:36686/0 (socket says 172.21.15.53:36686) 2023-06-10T19:09:35.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.262+0000 7fe65b7fe640 1 -- 172.21.15.53:0/365972360 learned_addr learned my addr 172.21.15.53:0/365972360 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:09:35.266 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.262+0000 7fe660aa3640 1 -- 172.21.15.53:0/365972360 >> v2:172.21.15.117:3300/0 conn(0x7fe65c159700 msgr2=0x7fe65c0ab860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:09:35.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.262+0000 7fe660aa3640 1 --2- 172.21.15.53:0/365972360 >> v2:172.21.15.117:3300/0 conn(0x7fe65c159700 0x7fe65c0ab860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:35.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.262+0000 7fe660aa3640 1 -- 172.21.15.53:0/365972360 >> v1:172.21.15.117:6789/0 conn(0x7fe65c159330 legacy=0x7fe65c0cd2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:35.267 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.262+0000 7fe660aa3640 1 -- 172.21.15.53:0/365972360 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe65c0c8b80 con 0x7fe65c0abda0 2023-06-10T19:09:35.268 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.266+0000 7fe660aa3640 1 --2- 172.21.15.53:0/365972360 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe65c0abda0 0x7fe65c0c9380 secure :-1 s=READY pgs=2790 cs=0 l=1 rev1=1 crypto rx=0x7fe65c0b05b0 tx=0x7fe65401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d67ba11ac330cf4d server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:35.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.266+0000 7fe65affd640 1 -- 172.21.15.53:0/365972360 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6540a5930 con 0x7fe65c0abda0 2023-06-10T19:09:35.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.266+0000 7fe65affd640 1 -- 172.21.15.53:0/365972360 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6540a5a90 con 0x7fe65c0abda0 2023-06-10T19:09:35.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.266+0000 7fe65affd640 1 -- 172.21.15.53:0/365972360 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6540a5e20 con 0x7fe65c0abda0 2023-06-10T19:09:35.269 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.266+0000 7fe662506640 1 -- 172.21.15.53:0/365972360 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe65c0abda0 msgr2=0x7fe65c0c9380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:35.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.266+0000 7fe662506640 1 --2- 172.21.15.53:0/365972360 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe65c0abda0 0x7fe65c0c9380 secure :-1 s=READY pgs=2790 cs=0 l=1 rev1=1 crypto rx=0x7fe65c0b05b0 tx=0x7fe65401c8e0 comp rx=0 tx=0).stop 2023-06-10T19:09:35.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.266+0000 7fe662506640 1 -- 172.21.15.53:0/365972360 shutdown_connections 2023-06-10T19:09:35.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.266+0000 7fe662506640 1 --2- 172.21.15.53:0/365972360 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe65c0abda0 0x7fe65c0c9380 unknown :-1 s=CLOSED pgs=2790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:35.270 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.266+0000 7fe662506640 1 --2- 172.21.15.53:0/365972360 >> v2:172.21.15.117:3300/0 conn(0x7fe65c159700 0x7fe65c0ab860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:35.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.266+0000 7fe662506640 1 -- 172.21.15.53:0/365972360 >> 172.21.15.53:0/365972360 conn(0x7fe65c0cdc80 msgr2=0x7fe65c0ce080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:09:35.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.266+0000 7fe662506640 1 -- 172.21.15.53:0/365972360 shutdown_connections 2023-06-10T19:09:35.271 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.266+0000 7fe662506640 1 -- 172.21.15.53:0/365972360 wait complete. 2023-06-10T19:09:35.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.266+0000 7fe662506640 1 Processor -- start 2023-06-10T19:09:35.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.266+0000 7fe662506640 1 -- start start 2023-06-10T19:09:35.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.270+0000 7fe662506640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe65c0abda0 0x7fe65c14bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:35.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.270+0000 7fe662506640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe65c159330 0x7fe65c06b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:35.273 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.270+0000 7fe662506640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe65c159700 0x7fe65c06b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:35.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.270+0000 7fe662506640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe65c156930 con 0x7fe65c159330 2023-06-10T19:09:35.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.270+0000 7fe662506640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe65c1574b0 con 0x7fe65c0abda0 2023-06-10T19:09:35.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.270+0000 7fe662506640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe65c156b80 con 0x7fe65c159700 2023-06-10T19:09:35.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.270+0000 7fe65b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe65c159330 0x7fe65c06b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:35.274 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.270+0000 7fe65b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe65c159330 0x7fe65c06b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55654/0 (socket says 172.21.15.53:55654) 2023-06-10T19:09:35.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.270+0000 7fe65b7fe640 1 -- 172.21.15.53:0/363799849 learned_addr learned my addr 172.21.15.53:0/363799849 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:09:35.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.270+0000 7fe65bfff640 1 --2- 172.21.15.53:0/363799849 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe65c0abda0 0x7fe65c14bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:35.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.270+0000 7fe660aa3640 1 --2- 172.21.15.53:0/363799849 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe65c159700 0x7fe65c06b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:35.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.270+0000 7fe65b7fe640 1 -- 172.21.15.53:0/363799849 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe65c159700 msgr2=0x7fe65c06b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:35.275 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.270+0000 7fe65b7fe640 1 --2- 172.21.15.53:0/363799849 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe65c159700 0x7fe65c06b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:35.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.270+0000 7fe65b7fe640 1 -- 172.21.15.53:0/363799849 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe65c0abda0 msgr2=0x7fe65c14bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:35.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.270+0000 7fe65b7fe640 1 --2- 172.21.15.53:0/363799849 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe65c0abda0 0x7fe65c14bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:35.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.270+0000 7fe65b7fe640 1 -- 172.21.15.53:0/363799849 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe654009a70 con 0x7fe65c159330 2023-06-10T19:09:35.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.270+0000 7fe65b7fe640 1 --2- 172.21.15.53:0/363799849 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe65c159330 0x7fe65c06b150 secure :-1 s=READY pgs=2791 cs=0 l=1 rev1=1 crypto rx=0x7fe65000e7f0 tx=0x7fe65000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:35.276 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.270+0000 7fe658ff9640 1 -- 172.21.15.53:0/363799849 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe650009580 con 0x7fe65c159330 2023-06-10T19:09:35.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.270+0000 7fe658ff9640 1 -- 172.21.15.53:0/363799849 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe65000c940 con 0x7fe65c159330 2023-06-10T19:09:35.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.270+0000 7fe662506640 1 -- 172.21.15.53:0/363799849 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe65c156e60 con 0x7fe65c159330 2023-06-10T19:09:35.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.270+0000 7fe658ff9640 1 -- 172.21.15.53:0/363799849 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe65000ccf0 con 0x7fe65c159330 2023-06-10T19:09:35.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.270+0000 7fe662506640 1 -- 172.21.15.53:0/363799849 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe65c14c430 con 0x7fe65c159330 2023-06-10T19:09:35.277 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.270+0000 7fe662506640 1 -- 172.21.15.53:0/363799849 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe65c157620 con 0x7fe65c159330 2023-06-10T19:09:35.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.270+0000 7fe658ff9640 1 -- 172.21.15.53:0/363799849 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe650013470 con 0x7fe65c159330 2023-06-10T19:09:35.278 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.270+0000 7fe658ff9640 1 --2- 172.21.15.53:0/363799849 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe648066280 0x7fe648068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:35.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.270+0000 7fe658ff9640 1 -- 172.21.15.53:0/363799849 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fe650083a80 con 0x7fe65c159330 2023-06-10T19:09:35.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.270+0000 7fe65bfff640 1 --2- 172.21.15.53:0/363799849 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe648066280 0x7fe648068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:35.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.274+0000 7fe65bfff640 1 --2- 172.21.15.53:0/363799849 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe648066280 0x7fe648068730 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7fe64c000f70 tx=0x7fe64c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:35.279 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.274+0000 7fe658ff9640 1 -- 172.21.15.53:0/363799849 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe650051260 con 0x7fe65c159330 2023-06-10T19:09:35.432 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.430+0000 7fe662506640 1 -- 172.21.15.53:0/363799849 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fe65c04dfe0 con 0x7fe65c159330 2023-06-10T19:09:35.442 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.438+0000 7fe658ff9640 1 -- 172.21.15.53:0/363799849 <== mon.0 v2:172.21.15.53:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fe65005a020 con 0x7fe65c159330 2023-06-10T19:09:35.443 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.438+0000 7fe658ff9640 1 -- 172.21.15.53:0/363799849 <== mon.0 v2:172.21.15.53:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v32)=0 v32) v1 ==== 123+0+0 (secure 0 0 0) 0x7fe6500170c0 con 0x7fe65c159330 2023-06-10T19:09:35.445 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.442+0000 7fe662506640 1 -- 172.21.15.53:0/363799849 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe648066280 msgr2=0x7fe648068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:35.445 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.442+0000 7fe662506640 1 --2- 172.21.15.53:0/363799849 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe648066280 0x7fe648068730 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7fe64c000f70 tx=0x7fe64c009040 comp rx=0 tx=0).stop 2023-06-10T19:09:35.445 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.442+0000 7fe662506640 1 -- 172.21.15.53:0/363799849 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe65c159330 msgr2=0x7fe65c06b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:35.445 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.442+0000 7fe662506640 1 --2- 172.21.15.53:0/363799849 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe65c159330 0x7fe65c06b150 secure :-1 s=READY pgs=2791 cs=0 l=1 rev1=1 crypto rx=0x7fe65000e7f0 tx=0x7fe65000ecb0 comp rx=0 tx=0).stop 2023-06-10T19:09:35.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.442+0000 7fe662506640 1 -- 172.21.15.53:0/363799849 shutdown_connections 2023-06-10T19:09:35.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.442+0000 7fe662506640 1 --2- 172.21.15.53:0/363799849 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7fe648066280 0x7fe648068730 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:35.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.442+0000 7fe662506640 1 --2- 172.21.15.53:0/363799849 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe65c159700 0x7fe65c06b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:35.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.442+0000 7fe662506640 1 --2- 172.21.15.53:0/363799849 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe65c159330 0x7fe65c06b150 unknown :-1 s=CLOSED pgs=2791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:35.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.442+0000 7fe662506640 1 --2- 172.21.15.53:0/363799849 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe65c0abda0 0x7fe65c14bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:35.446 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.442+0000 7fe662506640 1 -- 172.21.15.53:0/363799849 >> 172.21.15.53:0/363799849 conn(0x7fe65c0cdc80 msgr2=0x7fe65c0ca670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:09:35.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.442+0000 7fe662506640 1 -- 172.21.15.53:0/363799849 shutdown_connections 2023-06-10T19:09:35.447 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.442+0000 7fe662506640 1 -- 172.21.15.53:0/363799849 wait complete. 2023-06-10T19:09:35.462 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-06-10T19:09:35.463 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-10T19:09:35.579 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.578+0000 7f994df00640 1 Processor -- start 2023-06-10T19:09:35.580 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.578+0000 7f994df00640 1 -- start start 2023-06-10T19:09:35.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.578+0000 7f994df00640 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9948070f80 0x7f99480ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:35.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.578+0000 7f994df00640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f994815f2c0 con 0x7f99480ce990 2023-06-10T19:09:35.582 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.578+0000 7f994df00640 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f994815fdc0 con 0x7f994815eef0 2023-06-10T19:09:35.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.578+0000 7f994df00640 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99481600a0 con 0x7f9948070f80 2023-06-10T19:09:35.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.578+0000 7f9947fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f99480ce990 0x7f9948069450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:47110/0 (socket says 172.21.15.53:47110) 2023-06-10T19:09:35.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.578+0000 7f9947fff640 1 -- 172.21.15.53:0/2749196199 learned_addr learned my addr 172.21.15.53:0/2749196199 (peer_addr_for_me v1:172.21.15.53:0/0) 2023-06-10T19:09:35.583 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.578+0000 7f9946ffd640 1 --2- 172.21.15.53:0/2749196199 >> v2:172.21.15.117:3300/0 conn(0x7f9948070f80 0x7f99480ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:35.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.578+0000 7f99467fc640 1 -- 172.21.15.53:0/2749196199 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2487905360 0 0) 0x7f994815f2c0 con 0x7f99480ce990 2023-06-10T19:09:35.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.578+0000 7f99467fc640 1 -- 172.21.15.53:0/2749196199 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9930003530 con 0x7f99480ce990 2023-06-10T19:09:35.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.578+0000 7f99467fc640 1 -- 172.21.15.53:0/2749196199 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3561521295 0 0) 0x7f9930003530 con 0x7f99480ce990 2023-06-10T19:09:35.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.578+0000 7f99467fc640 1 -- 172.21.15.53:0/2749196199 >> v2:172.21.15.117:3300/0 conn(0x7f9948070f80 msgr2=0x7f99480ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:09:35.584 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.578+0000 7f99467fc640 1 --2- 172.21.15.53:0/2749196199 >> v2:172.21.15.117:3300/0 conn(0x7f9948070f80 0x7f99480ce450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:35.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.578+0000 7f99467fc640 1 -- 172.21.15.53:0/2749196199 >> v1:172.21.15.117:6789/0 conn(0x7f994815eef0 legacy=0x7f994815f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:35.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.578+0000 7f99467fc640 1 -- 172.21.15.53:0/2749196199 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9948160380 con 0x7f99480ce990 2023-06-10T19:09:35.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.578+0000 7f99467fc640 1 -- 172.21.15.53:0/2749196199 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1041782042 0 0) 0x7f9940001a00 con 0x7f99480ce990 2023-06-10T19:09:35.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.578+0000 7f99467fc640 1 -- 172.21.15.53:0/2749196199 >> v1:172.21.15.53:6789/0 conn(0x7f99480ce990 legacy=0x7f9948069450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:35.585 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.578+0000 7f99467fc640 1 --2- 172.21.15.53:0/2749196199 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99300039f0 0x7f9930003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:35.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.578+0000 7f99467fc640 1 --2- 172.21.15.53:0/2749196199 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99300047d0 0x7f9930004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:35.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.578+0000 7f99467fc640 1 --2- 172.21.15.53:0/2749196199 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9930005180 0x7f993000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:35.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.578+0000 7f99467fc640 1 -- 172.21.15.53:0/2749196199 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99481600a0 con 0x7f9930005180 2023-06-10T19:09:35.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.578+0000 7f99467fc640 1 -- 172.21.15.53:0/2749196199 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f993000c060 con 0x7f99300039f0 2023-06-10T19:09:35.586 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.578+0000 7f99467fc640 1 -- 172.21.15.53:0/2749196199 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f993000c220 con 0x7f99300047d0 2023-06-10T19:09:35.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.578+0000 7f9947fff640 1 --2- 172.21.15.53:0/2749196199 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9930005180 0x7f993000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:35.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.578+0000 7f99477fe640 1 --2- 172.21.15.53:0/2749196199 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99300039f0 0x7f9930003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:35.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.578+0000 7f9947fff640 1 -- 172.21.15.53:0/2749196199 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99300047d0 msgr2=0x7f9930004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:09:35.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.578+0000 7f9947fff640 1 --2- 172.21.15.53:0/2749196199 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99300047d0 0x7f9930004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:35.587 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.578+0000 7f9947fff640 1 -- 172.21.15.53:0/2749196199 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99300039f0 msgr2=0x7f9930003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-10T19:09:35.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.578+0000 7f9947fff640 1 --2- 172.21.15.53:0/2749196199 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99300039f0 0x7f9930003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:35.588 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.578+0000 7f9947fff640 1 -- 172.21.15.53:0/2749196199 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9930003530 con 0x7f9930005180 2023-06-10T19:09:35.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.582+0000 7f9947fff640 1 -- 172.21.15.53:0/2749196199 reap_dead start 2023-06-10T19:09:35.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.582+0000 7f9947fff640 1 --2- 172.21.15.53:0/2749196199 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9930005180 0x7f993000b990 secure :-1 s=READY pgs=2793 cs=0 l=1 rev1=1 crypto rx=0x7f994000a830 tx=0x7f994001d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6789ddc1fa561287 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:35.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.582+0000 7f99467fc640 1 -- 172.21.15.53:0/2749196199 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99400072d0 con 0x7f9930005180 2023-06-10T19:09:35.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.582+0000 7f99467fc640 1 -- 172.21.15.53:0/2749196199 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f99400a8070 con 0x7f9930005180 2023-06-10T19:09:35.591 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.582+0000 7f99467fc640 1 -- 172.21.15.53:0/2749196199 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99400076d0 con 0x7f9930005180 2023-06-10T19:09:35.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.582+0000 7f994df00640 1 -- 172.21.15.53:0/2749196199 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9930005180 msgr2=0x7f993000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:35.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.582+0000 7f994df00640 1 --2- 172.21.15.53:0/2749196199 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9930005180 0x7f993000b990 secure :-1 s=READY pgs=2793 cs=0 l=1 rev1=1 crypto rx=0x7f994000a830 tx=0x7f994001d340 comp rx=0 tx=0).stop 2023-06-10T19:09:35.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.582+0000 7f994df00640 1 -- 172.21.15.53:0/2749196199 shutdown_connections 2023-06-10T19:09:35.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.582+0000 7f994df00640 1 --2- 172.21.15.53:0/2749196199 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9930005180 0x7f993000b990 unknown :-1 s=CLOSED pgs=2793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:35.592 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.582+0000 7f994df00640 1 -- 172.21.15.53:0/2749196199 >> 172.21.15.53:0/2749196199 conn(0x7f994806a560 msgr2=0x7f994806a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:09:35.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.582+0000 7f994df00640 1 -- 172.21.15.53:0/2749196199 shutdown_connections 2023-06-10T19:09:35.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.582+0000 7f994df00640 1 -- 172.21.15.53:0/2749196199 wait complete. 2023-06-10T19:09:35.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.582+0000 7f994df00640 1 Processor -- start 2023-06-10T19:09:35.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.582+0000 7f994df00640 1 -- start start 2023-06-10T19:09:35.593 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.582+0000 7f994df00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9930005180 0x7f99481f46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:35.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.582+0000 7f994df00640 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99480c6810 0x7f99481f1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:35.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.582+0000 7f994df00640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99481f1ca0 0x7f9948151ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:35.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.582+0000 7f994df00640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99480c70e0 con 0x7f99481f1ca0 2023-06-10T19:09:35.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.582+0000 7f994df00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99481f4c80 con 0x7f9930005180 2023-06-10T19:09:35.594 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.582+0000 7f994df00640 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99481f4f60 con 0x7f99480c6810 2023-06-10T19:09:35.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.586+0000 7f9947fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99481f1ca0 0x7f9948151ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:35.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.586+0000 7f9947fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99481f1ca0 0x7f9948151ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55684/0 (socket says 172.21.15.53:55684) 2023-06-10T19:09:35.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.586+0000 7f9947fff640 1 -- 172.21.15.53:0/3126606743 learned_addr learned my addr 172.21.15.53:0/3126606743 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-06-10T19:09:35.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.586+0000 7f99477fe640 1 --2- 172.21.15.53:0/3126606743 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9930005180 0x7f99481f46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:35.595 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.586+0000 7f9946ffd640 1 --2- 172.21.15.53:0/3126606743 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99480c6810 0x7f99481f1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:35.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.586+0000 7f9947fff640 1 -- 172.21.15.53:0/3126606743 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99480c6810 msgr2=0x7f99481f1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:35.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.586+0000 7f9947fff640 1 --2- 172.21.15.53:0/3126606743 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99480c6810 0x7f99481f1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:35.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.586+0000 7f9947fff640 1 -- 172.21.15.53:0/3126606743 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9930005180 msgr2=0x7f99481f46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:35.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.586+0000 7f9947fff640 1 --2- 172.21.15.53:0/3126606743 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9930005180 0x7f99481f46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:35.596 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.586+0000 7f9947fff640 1 -- 172.21.15.53:0/3126606743 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99481f5240 con 0x7f99481f1ca0 2023-06-10T19:09:35.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.586+0000 7f99477fe640 1 --2- 172.21.15.53:0/3126606743 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9930005180 0x7f99481f46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-10T19:09:35.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.586+0000 7f9947fff640 1 --2- 172.21.15.53:0/3126606743 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99481f1ca0 0x7f9948151ee0 secure :-1 s=READY pgs=2794 cs=0 l=1 rev1=1 crypto rx=0x7f9940007040 tx=0x7f9930005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:35.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.586+0000 7f992ffff640 1 -- 172.21.15.53:0/3126606743 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99400019c0 con 0x7f99481f1ca0 2023-06-10T19:09:35.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.586+0000 7f992ffff640 1 -- 172.21.15.53:0/3126606743 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f9940007450 con 0x7f99481f1ca0 2023-06-10T19:09:35.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.586+0000 7f992ffff640 1 -- 172.21.15.53:0/3126606743 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9940007840 con 0x7f99481f1ca0 2023-06-10T19:09:35.597 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.586+0000 7f994df00640 1 -- 172.21.15.53:0/3126606743 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99481f5520 con 0x7f99481f1ca0 2023-06-10T19:09:35.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.586+0000 7f994df00640 1 -- 172.21.15.53:0/3126606743 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9948152420 con 0x7f99481f1ca0 2023-06-10T19:09:35.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.586+0000 7f994df00640 1 -- 172.21.15.53:0/3126606743 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f994804d790 con 0x7f99481f1ca0 2023-06-10T19:09:35.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.586+0000 7f992ffff640 1 -- 172.21.15.53:0/3126606743 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f99400aa070 con 0x7f99481f1ca0 2023-06-10T19:09:35.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.586+0000 7f992ffff640 1 --2- 172.21.15.53:0/3126606743 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f99340662b0 0x7f9934068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-10T19:09:35.598 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.586+0000 7f992ffff640 1 -- 172.21.15.53:0/3126606743 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f994011d7c0 con 0x7f99481f1ca0 2023-06-10T19:09:35.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.586+0000 7f99477fe640 1 --2- 172.21.15.53:0/3126606743 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f99340662b0 0x7f9934068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-10T19:09:35.599 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.590+0000 7f99477fe640 1 --2- 172.21.15.53:0/3126606743 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f99340662b0 0x7f9934068760 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f9938000c10 tx=0x7f9938009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-10T19:09:35.600 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.590+0000 7f992ffff640 1 -- 172.21.15.53:0/3126606743 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f99400eae80 con 0x7f99481f1ca0 2023-06-10T19:09:35.777 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.774+0000 7f994df00640 1 -- 172.21.15.53:0/3126606743 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f99480cf410 con 0x7f99481f1ca0 2023-06-10T19:09:35.778 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.774+0000 7f992ffff640 1 -- 172.21.15.53:0/3126606743 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 106 v106) v1 ==== 95+0+3539 (secure 0 0 0) 0x7f99400ee4a0 con 0x7f99481f1ca0 2023-06-10T19:09:35.779 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-10T19:09:35.779 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":106,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7835,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/2641321206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":2641321206},{"type":"v1","addr":"172.21.15.117:6835","nonce":2641321206}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":99},{"gid":8956,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1439696554","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1439696554},{"type":"v1","addr":"172.21.15.117:6837","nonce":1439696554}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":99},{"gid":11112,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/3327528087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":3327528087},{"type":"v1","addr":"172.21.15.53:6833","nonce":3327528087}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":99},{"gid":11577,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/3842246240","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":3842246240},{"type":"v1","addr":"172.21.15.53:6835","nonce":3842246240}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":106}],"filesystems":[]} 2023-06-10T19:09:35.779 INFO:teuthology.orchestra.run.smithi053.stderr:dumped fsmap epoch 106 2023-06-10T19:09:35.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.778+0000 7f994df00640 1 -- 172.21.15.53:0/3126606743 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f99340662b0 msgr2=0x7f9934068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:35.781 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.778+0000 7f994df00640 1 --2- 172.21.15.53:0/3126606743 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f99340662b0 0x7f9934068760 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f9938000c10 tx=0x7f9938009040 comp rx=0 tx=0).stop 2023-06-10T19:09:35.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.778+0000 7f994df00640 1 -- 172.21.15.53:0/3126606743 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99481f1ca0 msgr2=0x7f9948151ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-10T19:09:35.782 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.778+0000 7f994df00640 1 --2- 172.21.15.53:0/3126606743 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99481f1ca0 0x7f9948151ee0 secure :-1 s=READY pgs=2794 cs=0 l=1 rev1=1 crypto rx=0x7f9940007040 tx=0x7f9930005800 comp rx=0 tx=0).stop 2023-06-10T19:09:35.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.778+0000 7f994df00640 1 -- 172.21.15.53:0/3126606743 shutdown_connections 2023-06-10T19:09:35.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.778+0000 7f994df00640 1 --2- 172.21.15.53:0/3126606743 >> [v2:172.21.15.117:6832/3061986771,v1:172.21.15.117:6833/3061986771] conn(0x7f99340662b0 0x7f9934068760 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:35.783 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.778+0000 7f994df00640 1 --2- 172.21.15.53:0/3126606743 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99481f1ca0 0x7f9948151ee0 unknown :-1 s=CLOSED pgs=2794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:35.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.778+0000 7f994df00640 1 --2- 172.21.15.53:0/3126606743 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f99480c6810 0x7f99481f1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:35.784 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.778+0000 7f994df00640 1 --2- 172.21.15.53:0/3126606743 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9930005180 0x7f99481f46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-10T19:09:35.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.778+0000 7f994df00640 1 -- 172.21.15.53:0/3126606743 >> 172.21.15.53:0/3126606743 conn(0x7f994806a560 msgr2=0x7f99480c96d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-10T19:09:35.785 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.778+0000 7f994df00640 1 -- 172.21.15.53:0/3126606743 shutdown_connections 2023-06-10T19:09:35.786 INFO:teuthology.orchestra.run.smithi053.stderr:2023-06-10T19:09:35.778+0000 7f994df00640 1 -- 172.21.15.53:0/3126606743 wait complete. 2023-06-10T19:09:35.797 DEBUG:tasks.cephfs.filesystem:already dead... 2023-06-10T19:09:35.797 INFO:teuthology.misc:Shutting down mds daemons... 2023-06-10T19:09:35.798 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-06-10T19:09:35.798 INFO:teuthology.orchestra.run:waiting for 300 2023-06-10T19:09:35.807 INFO:tasks.ceph.mds.a:Stopped 2023-06-10T19:09:35.807 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-06-10T19:09:35.808 INFO:teuthology.orchestra.run:waiting for 300 2023-06-10T19:09:35.864 INFO:tasks.ceph.mds.c:Stopped 2023-06-10T19:09:35.865 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-06-10T19:09:35.865 INFO:teuthology.orchestra.run:waiting for 300 2023-06-10T19:09:35.884 INFO:tasks.ceph.mds.b:Stopped 2023-06-10T19:09:35.884 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-06-10T19:09:35.884 INFO:teuthology.orchestra.run:waiting for 300 2023-06-10T19:09:35.942 INFO:tasks.ceph.mds.d:Stopped 2023-06-10T19:09:35.943 INFO:teuthology.misc:Shutting down osd daemons... 2023-06-10T19:09:35.943 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-06-10T19:09:35.944 INFO:teuthology.orchestra.run:waiting for 300 2023-06-10T19:09:36.017 INFO:tasks.ceph.osd.0:Stopped 2023-06-10T19:09:36.017 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-06-10T19:09:36.018 INFO:teuthology.orchestra.run:waiting for 300 2023-06-10T19:09:36.113 INFO:tasks.ceph.osd.1:Stopped 2023-06-10T19:09:36.114 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-06-10T19:09:36.114 INFO:teuthology.orchestra.run:waiting for 300 2023-06-10T19:09:36.196 INFO:tasks.ceph.osd.2:Stopped 2023-06-10T19:09:36.197 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-06-10T19:09:36.197 INFO:teuthology.orchestra.run:waiting for 300 2023-06-10T19:09:36.253 INFO:tasks.ceph.osd.3:Stopped 2023-06-10T19:09:36.254 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-06-10T19:09:36.254 INFO:teuthology.orchestra.run:waiting for 300 2023-06-10T19:09:38.780 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-10T19:09:38.782 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-10T19:09:41.710 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2023-06-10T19:09:42.356 INFO:tasks.ceph.osd.4:Stopped 2023-06-10T19:09:42.357 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-06-10T19:09:42.358 INFO:teuthology.orchestra.run:waiting for 300 2023-06-10T19:09:42.427 INFO:tasks.ceph.osd.5:Stopped 2023-06-10T19:09:42.428 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-06-10T19:09:42.428 INFO:teuthology.orchestra.run:waiting for 300 2023-06-10T19:09:47.316 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2023-06-10T19:09:47.316 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2023-06-10T19:09:48.531 INFO:tasks.ceph.osd.6:Stopped 2023-06-10T19:09:48.532 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-06-10T19:09:48.532 INFO:teuthology.orchestra.run:waiting for 300 2023-06-10T19:09:48.588 INFO:tasks.ceph.osd.7:Stopped 2023-06-10T19:09:48.589 INFO:teuthology.misc:Shutting down mgr daemons... 2023-06-10T19:09:48.590 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-06-10T19:09:48.591 INFO:teuthology.orchestra.run:waiting for 300 2023-06-10T19:09:48.619 INFO:tasks.ceph.mgr.y:Stopped 2023-06-10T19:09:48.620 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-06-10T19:09:48.620 INFO:teuthology.orchestra.run:waiting for 300 2023-06-10T19:09:48.649 INFO:tasks.ceph.mgr.x:Stopped 2023-06-10T19:09:48.650 INFO:teuthology.misc:Shutting down mon daemons... 2023-06-10T19:09:48.650 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-06-10T19:09:48.650 INFO:teuthology.orchestra.run:waiting for 300 2023-06-10T19:09:48.678 INFO:tasks.ceph.mon.a:Stopped 2023-06-10T19:09:48.678 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-06-10T19:09:48.679 INFO:teuthology.orchestra.run:waiting for 300 2023-06-10T19:09:48.707 INFO:tasks.ceph.mon.b:Stopped 2023-06-10T19:09:48.708 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-06-10T19:09:48.708 INFO:teuthology.orchestra.run:waiting for 300 2023-06-10T19:09:48.769 INFO:tasks.ceph.mon.c:Stopped 2023-06-10T19:09:48.769 INFO:tasks.ceph:Checking cluster log for badness... 2023-06-10T19:09:48.770 DEBUG:teuthology.orchestra.run.smithi053:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'evicting unresponsive client' | egrep -v 'but it is still running' | egrep -v 'slow request' | egrep -v MDS_CLIENT_LATE_RELEASE | egrep -v 't responding to mclientcaps' | egrep -v 'file system flag refuse_client_session is set' | head -n 1 2023-06-10T19:09:48.789 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi053.front.sepia.ceph.com 2023-06-10T19:09:48.789 DEBUG:teuthology.orchestra.run.smithi053:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-06-10T19:09:49.068 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi053.front.sepia.ceph.com 2023-06-10T19:09:49.069 DEBUG:teuthology.orchestra.run.smithi053:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-06-10T19:09:49.290 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi053.front.sepia.ceph.com 2023-06-10T19:09:49.291 DEBUG:teuthology.orchestra.run.smithi053:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-06-10T19:09:49.447 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi053.front.sepia.ceph.com 2023-06-10T19:09:49.447 DEBUG:teuthology.orchestra.run.smithi053:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-06-10T19:09:49.606 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi117.front.sepia.ceph.com 2023-06-10T19:09:49.607 DEBUG:teuthology.orchestra.run.smithi117:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-06-10T19:09:49.835 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi117.front.sepia.ceph.com 2023-06-10T19:09:49.836 DEBUG:teuthology.orchestra.run.smithi117:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-06-10T19:09:50.067 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi117.front.sepia.ceph.com 2023-06-10T19:09:50.068 DEBUG:teuthology.orchestra.run.smithi117:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-06-10T19:09:50.303 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi117.front.sepia.ceph.com 2023-06-10T19:09:50.303 DEBUG:teuthology.orchestra.run.smithi117:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-06-10T19:09:50.495 INFO:tasks.ceph:Archiving mon data... 2023-06-10T19:09:50.497 DEBUG:teuthology.misc:Transferring archived files from smithi053:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2023-06-10_18:20:34-fs:functional-main-distro-default-smithi/7301169/data/mon.a.tgz 2023-06-10T19:09:50.498 DEBUG:teuthology.orchestra.run.smithi053:> mktemp 2023-06-10T19:09:50.505 INFO:teuthology.orchestra.run.smithi053.stdout:/tmp/tmp.kfoiiGCYOz 2023-06-10T19:09:50.506 DEBUG:teuthology.orchestra.run.smithi053:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.kfoiiGCYOz 2023-06-10T19:09:50.648 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 0666 /tmp/tmp.kfoiiGCYOz 2023-06-10T19:09:50.717 DEBUG:teuthology.orchestra.remote:smithi053:/tmp/tmp.kfoiiGCYOz is 442KB 2023-06-10T19:09:50.777 DEBUG:teuthology.orchestra.run.smithi053:> rm -fr /tmp/tmp.kfoiiGCYOz 2023-06-10T19:09:50.783 DEBUG:teuthology.misc:Transferring archived files from smithi117:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2023-06-10_18:20:34-fs:functional-main-distro-default-smithi/7301169/data/mon.b.tgz 2023-06-10T19:09:50.784 DEBUG:teuthology.orchestra.run.smithi117:> mktemp 2023-06-10T19:09:50.791 INFO:teuthology.orchestra.run.smithi117.stdout:/tmp/tmp.2kfp7GIl3J 2023-06-10T19:09:50.792 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.2kfp7GIl3J 2023-06-10T19:09:50.942 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 0666 /tmp/tmp.2kfp7GIl3J 2023-06-10T19:09:51.003 DEBUG:teuthology.orchestra.remote:smithi117:/tmp/tmp.2kfp7GIl3J is 445KB 2023-06-10T19:09:51.064 DEBUG:teuthology.orchestra.run.smithi117:> rm -fr /tmp/tmp.2kfp7GIl3J 2023-06-10T19:09:51.069 DEBUG:teuthology.misc:Transferring archived files from smithi117:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2023-06-10_18:20:34-fs:functional-main-distro-default-smithi/7301169/data/mon.c.tgz 2023-06-10T19:09:51.070 DEBUG:teuthology.orchestra.run.smithi117:> mktemp 2023-06-10T19:09:51.116 INFO:teuthology.orchestra.run.smithi117.stdout:/tmp/tmp.LkRgDl3SjA 2023-06-10T19:09:51.116 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.LkRgDl3SjA 2023-06-10T19:09:51.263 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 0666 /tmp/tmp.LkRgDl3SjA 2023-06-10T19:09:51.323 DEBUG:teuthology.orchestra.remote:smithi117:/tmp/tmp.LkRgDl3SjA is 444KB 2023-06-10T19:09:51.386 DEBUG:teuthology.orchestra.run.smithi117:> rm -fr /tmp/tmp.LkRgDl3SjA 2023-06-10T19:09:51.391 INFO:tasks.ceph:Cleaning ceph cluster... 2023-06-10T19:09:51.392 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-06-10T19:09:51.394 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-06-10T19:09:51.448 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-06-10T19:09:51.449 DEBUG:teuthology.orchestra.run.smithi053:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-06-10T19:09:51.452 DEBUG:teuthology.orchestra.run.smithi117:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-06-10T19:09:51.475 INFO:teuthology.orchestra.run.smithi053.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-06-10T19:09:51.515 INFO:teuthology.orchestra.run.smithi117.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-06-10T19:09:51.519 INFO:tasks.ceph:Archiving crash dumps... 2023-06-10T19:09:51.521 DEBUG:teuthology.misc:Transferring archived files from smithi053:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2023-06-10_18:20:34-fs:functional-main-distro-default-smithi/7301169/remote/smithi053/crash 2023-06-10T19:09:51.522 DEBUG:teuthology.orchestra.run.smithi053:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-06-10T19:09:51.536 DEBUG:teuthology.misc:Transferring archived files from smithi117:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2023-06-10_18:20:34-fs:functional-main-distro-default-smithi/7301169/remote/smithi117/crash 2023-06-10T19:09:51.538 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-06-10T19:09:51.572 INFO:tasks.ceph:Shutting down logrotate 2023-06-10T19:09:51.573 DEBUG:teuthology.orchestra.run.smithi053:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-10T19:09:51.584 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-10T19:09:51.658 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-06-10T19:09:51.676 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-06-10T19:09:51.709 INFO:tasks.ceph:Compressing logs... 2023-06-10T19:09:51.710 DEBUG:teuthology.orchestra.run.smithi053:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-06-10T19:09:51.724 DEBUG:teuthology.orchestra.run.smithi117:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-06-10T19:09:51.746 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42880.log 2023-06-10T19:09:51.747 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66669.log 2023-06-10T19:09:51.748 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.42880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64633.log 2023-06-10T19:09:51.749 INFO:teuthology.orchestra.run.smithi053.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42880.log.gz 2023-06-10T19:09:51.749 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.66669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48849.log 2023-06-10T19:09:51.749 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.64633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45602.log 2023-06-10T19:09:51.749 INFO:teuthology.orchestra.run.smithi053.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.66669.log.gz 2023-06-10T19:09:51.749 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.48849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69854.log 2023-06-10T19:09:51.750 INFO:teuthology.orchestra.run.smithi053.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.64633.log.gz 2023-06-10T19:09:51.751 INFO:teuthology.orchestra.run.smithi053.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48849.log.gz 2023-06-10T19:09:51.751 INFO:teuthology.orchestra.run.smithi053.stderr:gzip/var/log/ceph/ceph-client.admin.45602.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.66942.log 2023-06-10T19:09:51.751 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.69854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54786.log 2023-06-10T19:09:51.752 INFO:teuthology.orchestra.run.smithi053.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45602.log.gz 2023-06-10T19:09:51.752 INFO:teuthology.orchestra.run.smithi053.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.69854.log.gz 2023-06-10T19:09:51.752 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.66942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61359.log 2023-06-10T19:09:51.752 INFO:teuthology.orchestra.run.smithi053.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.66942.log.gz 2023-06-10T19:09:51.752 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63640.log 2023-06-10T19:09:51.753 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.54786.log: /var/log/ceph/ceph-client.admin.61359.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54786.log.gz 2023-06-10T19:09:51.755 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48242.log 2023-06-10T19:09:51.755 INFO:teuthology.orchestra.run.smithi053.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.61359.log.gz 2023-06-10T19:09:51.756 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.63640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45633.log 2023-06-10T19:09:51.756 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.48242.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.63640.log.gz 2023-06-10T19:09:51.756 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51636.log 2023-06-10T19:09:51.756 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.45633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49495.log 2023-06-10T19:09:51.757 INFO:teuthology.orchestra.run.smithi053.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.48242.log.gz 2023-06-10T19:09:51.757 INFO:teuthology.orchestra.run.smithi053.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45633.log.gz 2023-06-10T19:09:51.757 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.51636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37333.log 2023-06-10T19:09:51.757 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.49495.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51636.log.gz 2023-06-10T19:09:51.757 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68904.log 2023-06-10T19:09:51.758 INFO:teuthology.orchestra.run.smithi053.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49495.log.gz 2023-06-10T19:09:51.758 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.37333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67618.log 2023-06-10T19:09:51.758 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.68904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57380.log 2023-06-10T19:09:51.758 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.67618.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.68904.log.gz 2023-06-10T19:09:51.758 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50519.log 2023-06-10T19:09:51.759 INFO:teuthology.orchestra.run.smithi053.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.37333.log.gz 2023-06-10T19:09:51.759 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.57380.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.67618.log.gz 2023-06-10T19:09:51.759 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47383.log 2023-06-10T19:09:51.759 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.50519.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.57380.log.gz 2023-06-10T19:09:51.759 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46293.log 2023-06-10T19:09:51.765 INFO:teuthology.orchestra.run.smithi053.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50519.log.gz 2023-06-10T19:09:51.765 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71763.log 2023-06-10T19:09:51.765 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.47383.log: /var/log/ceph/ceph-client.admin.46293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49717.log 2023-06-10T19:09:51.766 INFO:teuthology.orchestra.run.smithi053.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46293.log.gz 2023-06-10T19:09:51.766 INFO:teuthology.orchestra.run.smithi053.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47383.log.gz 2023-06-10T19:09:51.766 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.71763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70458.log 2023-06-10T19:09:51.766 INFO:teuthology.orchestra.run.smithi053.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.71763.log.gz 2023-06-10T19:09:51.766 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.49717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57302.log 2023-06-10T19:09:51.767 INFO:teuthology.orchestra.run.smithi053.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49717.log.gz 2023-06-10T19:09:51.767 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.70458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68259.log 2023-06-10T19:09:51.767 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.57302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54891.log 2023-06-10T19:09:51.767 INFO:teuthology.orchestra.run.smithi053.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.70458.log.gz 2023-06-10T19:09:51.767 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.68259.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.57302.log.gz 2023-06-10T19:09:51.768 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53125.log 2023-06-10T19:09:51.768 INFO:teuthology.orchestra.run.smithi053.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.68259.log.gz 2023-06-10T19:09:51.768 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.54891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57274.log 2023-06-10T19:09:51.768 INFO:teuthology.orchestra.run.smithi053.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54891.log.gz 2023-06-10T19:09:51.768 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.53125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43972.log 2023-06-10T19:09:51.769 INFO:teuthology.orchestra.run.smithi053.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53125.log.gz 2023-06-10T19:09:51.769 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49549.log 2023-06-10T19:09:51.769 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.57274.log: /var/log/ceph/ceph-client.admin.43972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70029.log 2023-06-10T19:09:51.769 INFO:teuthology.orchestra.run.smithi053.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.57274.log.gz 2023-06-10T19:09:51.769 INFO:teuthology.orchestra.run.smithi053.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43972.log.gz 2023-06-10T19:09:51.770 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.49549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42616.log 2023-06-10T19:09:51.770 INFO:teuthology.orchestra.run.smithi053.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49549.log.gz 2023-06-10T19:09:51.770 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.70029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55614.log 2023-06-10T19:09:51.770 INFO:teuthology.orchestra.run.smithi053.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.70029.log.gz 2023-06-10T19:09:51.770 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.42616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43643.log 2023-06-10T19:09:51.771 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.55614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61437.log 2023-06-10T19:09:51.771 INFO:teuthology.orchestra.run.smithi053.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42616.log.gz 2023-06-10T19:09:51.771 INFO:teuthology.orchestra.run.smithi053.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55614.log.gz 2023-06-10T19:09:51.771 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46527.log 2023-06-10T19:09:51.771 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.43643.log: /var/log/ceph/ceph-client.admin.61437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42802.log 2023-06-10T19:09:51.772 INFO:teuthology.orchestra.run.smithi053.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43643.log.gz 2023-06-10T19:09:51.772 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.46527.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.61437.log.gz 2023-06-10T19:09:51.772 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59873.log 2023-06-10T19:09:51.772 INFO:teuthology.orchestra.run.smithi053.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46527.log.gz 2023-06-10T19:09:51.772 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61198.log 2023-06-10T19:09:51.773 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.42802.log: /var/log/ceph/ceph-client.admin.59873.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-06-10T19:09:51.773 INFO:teuthology.orchestra.run.smithi053.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42802.log.gz 2023-06-10T19:09:51.773 INFO:teuthology.orchestra.run.smithi053.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.59873.log.gz 2023-06-10T19:09:51.773 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.61198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69594.log 2023-06-10T19:09:51.773 INFO:teuthology.orchestra.run.smithi053.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.61198.log.gz 2023-06-10T19:09:51.774 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53205.log 2023-06-10T19:09:51.774 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.69594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53458.log 2023-06-10T19:09:51.774 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.53205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72076.log 2023-06-10T19:09:51.774 INFO:teuthology.orchestra.run.smithi053.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.69594.log.gz 2023-06-10T19:09:51.784 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37683.log 2023-06-10T19:09:51.784 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37539.log 2023-06-10T19:09:51.784 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.37683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.43946.log 2023-06-10T19:09:51.784 INFO:teuthology.orchestra.run.smithi117.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37683.log.gz 2023-06-10T19:09:51.785 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.37539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44719.log 2023-06-10T19:09:51.785 INFO:teuthology.orchestra.run.smithi117.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37539.log.gz 2023-06-10T19:09:51.785 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.3.43946.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-06-10T19:09:51.785 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.1.44719.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-06-10T19:09:51.785 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.45973.log 2023-06-10T19:09:51.786 INFO:teuthology.orchestra.run.smithi117.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.3.43946.log.gz 2023-06-10T19:09:51.786 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44872.log 2023-06-10T19:09:51.786 INFO:teuthology.orchestra.run.smithi117.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.1.44719.log.gz 2023-06-10T19:09:51.786 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.1.45973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37563.log 2023-06-10T19:09:51.786 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.1.44872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.43833.log 2023-06-10T19:09:51.787 INFO:teuthology.orchestra.run.smithi117.stderr:gzip/var/log/ceph/ceph-client.admin.37563.log: -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-06-10T19:09:51.787 INFO:teuthology.orchestra.run.smithi117.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.1.45973.log.gz 2023-06-10T19:09:51.787 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.1.43833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.45655.log 2023-06-10T19:09:51.787 INFO:teuthology.orchestra.run.smithi117.stderr: 87.0% 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37563.log.gz -- replaced with /var/log/ceph/ceph-client.1.44872.log.gz 2023-06-10T19:09:51.787 INFO:teuthology.orchestra.run.smithi117.stderr: 2023-06-10T19:09:51.788 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44967.log 2023-06-10T19:09:51.788 INFO:teuthology.orchestra.run.smithi117.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.1.43833.log.gz 2023-06-10T19:09:51.788 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.1.45655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.45121.log 2023-06-10T19:09:51.788 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.1.44967.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-06-10T19:09:51.788 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.1.45121.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-06-10T19:09:51.789 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44622.log 2023-06-10T19:09:51.789 INFO:teuthology.orchestra.run.smithi117.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.1.44967.log.gz 2023-06-10T19:09:51.789 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph.log: 92.6% -- replaced with /var/log/ceph/ceph-client.1.45121.log.gz 2023-06-10T19:09:51.789 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37611.log 2023-06-10T19:09:51.789 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.1.44622.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-06-10T19:09:51.790 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.37611.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.37611.log.gz 88.8% -- replaced with /var/log/ceph/ceph-client.1.44622.log.gz 2023-06-10T19:09:51.790 INFO:teuthology.orchestra.run.smithi117.stderr: 2023-06-10T19:09:51.790 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44292.log 2023-06-10T19:09:51.790 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44120.log 2023-06-10T19:09:51.790 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.1.44292.log: 93.1% -- replaced with /var/log/ceph/ceph-client.1.45655.log.gz 2023-06-10T19:09:51.791 INFO:teuthology.orchestra.run.smithi117.stderr: 92.9% -- replaced with /var/log/ceph/ceph.log.gz 2023-06-10T19:09:51.791 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.45442.log 2023-06-10T19:09:51.795 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.1.44120.log: 92.3% -- replaced with /var/log/ceph/ceph-client.1.44292.log.gz 2023-06-10T19:09:51.796 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-06-10T19:09:51.796 INFO:teuthology.orchestra.run.smithi117.stderr: 90.6%/var/log/ceph/ceph-client.1.45442.log: -- replaced with /var/log/ceph/ceph-client.1.44120.log.gz 2023-06-10T19:09:51.796 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37659.log 2023-06-10T19:09:51.796 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37587.log 2023-06-10T19:09:51.797 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.37659.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37659.log.gz 2023-06-10T19:09:51.797 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-06-10T19:09:51.797 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.37587.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37587.log.gz 2023-06-10T19:09:51.797 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.45285.log 2023-06-10T19:09:51.797 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-mds.d.log: 92.9% -- replaced with /var/log/ceph/ceph-client.1.45442.log.gz 2023-06-10T19:09:51.798 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37635.log 2023-06-10T19:09:51.798 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.1.45285.log: 91.8% -- replaced with /var/log/ceph/ceph-client.1.45285.log.gz 2023-06-10T19:09:51.798 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37707.log 2023-06-10T19:09:51.798 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.37635.log: 93.5% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-06-10T19:09:51.798 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-06-10T19:09:51.799 INFO:teuthology.orchestra.run.smithi117.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37635.log.gz 2023-06-10T19:09:51.801 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-06-10T19:09:51.801 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.admin.37707.log: /var/log/ceph/ceph-mds.b.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37707.log.gz 2023-06-10T19:09:51.801 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44452.log 2023-06-10T19:09:51.806 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-mon.b.log: 92.7% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-06-10T19:09:51.806 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-06-10T19:09:51.811 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.1.44452.log: 95.7% -- replaced with /var/log/ceph/ceph-client.1.44452.log.gz 2023-06-10T19:09:51.811 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.45815.log 2023-06-10T19:09:51.828 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-osd.4.log: /var/log/ceph/ceph-client.1.45815.log: 88.6% -- replaced with /var/log/ceph/ceph-client.1.45815.log.gz 2023-06-10T19:09:51.829 INFO:teuthology.orchestra.run.smithi117.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-06-10T19:09:51.833 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.53458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58583.log 2023-06-10T19:09:51.833 INFO:teuthology.orchestra.run.smithi053.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.53205.log.gz 2023-06-10T19:09:51.833 INFO:teuthology.orchestra.run.smithi053.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.53458.log.gz 2023-06-10T19:09:51.833 INFO:teuthology.orchestra.run.smithi053.stderr:gzip/var/log/ceph/ceph-client.admin.72076.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.58869.log 2023-06-10T19:09:51.834 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70932.log 2023-06-10T19:09:51.834 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.58583.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.72076.log.gz 2023-06-10T19:09:51.834 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.58869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54679.log 2023-06-10T19:09:51.834 INFO:teuthology.orchestra.run.smithi053.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.58583.log.gz 2023-06-10T19:09:51.835 INFO:teuthology.orchestra.run.smithi053.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.58869.log.gz 2023-06-10T19:09:51.835 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.70932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61520.log 2023-06-10T19:09:51.835 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.54679.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.70932.log.gz 2023-06-10T19:09:51.835 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50572.log 2023-06-10T19:09:51.835 INFO:teuthology.orchestra.run.smithi053.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.54679.log.gz 2023-06-10T19:09:51.835 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48823.log 2023-06-10T19:09:51.836 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.61520.log: /var/log/ceph/ceph-client.admin.50572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65066.log 2023-06-10T19:09:51.836 INFO:teuthology.orchestra.run.smithi053.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.61520.log.gz 2023-06-10T19:09:51.836 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.48823.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50572.log.gzgzip 2023-06-10T19:09:51.836 INFO:teuthology.orchestra.run.smithi053.stderr: -5 --verbose -- /var/log/ceph/ceph-client.2.44576.log 2023-06-10T19:09:51.837 INFO:teuthology.orchestra.run.smithi053.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48823.log.gz 2023-06-10T19:09:51.837 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.65066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53361.log 2023-06-10T19:09:51.837 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60232.log 2023-06-10T19:09:51.837 INFO:teuthology.orchestra.run.smithi053.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.65066.log.gz 2023-06-10T19:09:51.837 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.2.44576.log: /var/log/ceph/ceph-client.admin.53361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45841.log 2023-06-10T19:09:51.837 INFO:teuthology.orchestra.run.smithi053.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53361.log.gz 2023-06-10T19:09:51.838 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.60232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45947.log 2023-06-10T19:09:51.838 INFO:teuthology.orchestra.run.smithi053.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.60232.log.gz 2023-06-10T19:09:51.838 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69290.log 2023-06-10T19:09:51.838 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.45841.log: /var/log/ceph/ceph-client.admin.45947.log: 91.8% -- replaced with /var/log/ceph/ceph-client.2.44576.log.gz 2023-06-10T19:09:51.838 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63219.log 2023-06-10T19:09:51.839 INFO:teuthology.orchestra.run.smithi053.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45841.log.gz 2023-06-10T19:09:51.839 INFO:teuthology.orchestra.run.smithi053.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45947.log.gz 2023-06-10T19:09:51.839 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.69290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53151.log 2023-06-10T19:09:51.839 INFO:teuthology.orchestra.run.smithi053.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.69290.log.gz 2023-06-10T19:09:51.839 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.63219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54445.log 2023-06-10T19:09:51.840 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.53151.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.63219.log.gz 2023-06-10T19:09:51.840 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49577.log 2023-06-10T19:09:51.840 INFO:teuthology.orchestra.run.smithi053.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53151.log.gz 2023-06-10T19:09:51.841 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.54445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60265.log 2023-06-10T19:09:51.841 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.49577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53621.log 2023-06-10T19:09:51.841 INFO:teuthology.orchestra.run.smithi053.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.54445.log.gz 2023-06-10T19:09:51.841 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.60265.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49577.log.gz 2023-06-10T19:09:51.841 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65092.log 2023-06-10T19:09:51.842 INFO:teuthology.orchestra.run.smithi053.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.60265.log.gz 2023-06-10T19:09:51.842 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.53621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57885.log 2023-06-10T19:09:51.842 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.65092.log: gzip 88.1% -5 --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.53621.log.gz /var/log/ceph/ceph-client.admin.69405.log 2023-06-10T19:09:51.842 INFO:teuthology.orchestra.run.smithi053.stderr: 2023-06-10T19:09:51.842 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.57885.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.65092.log.gz 2023-06-10T19:09:51.843 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69509.log 2023-06-10T19:09:51.843 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.69405.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.57885.log.gz 2023-06-10T19:09:51.843 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58765.log 2023-06-10T19:09:51.843 INFO:teuthology.orchestra.run.smithi053.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.69405.log.gz 2023-06-10T19:09:51.843 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.69509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53719.log 2023-06-10T19:09:51.844 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.58765.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.69509.log.gz 2023-06-10T19:09:51.844 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66635.log 2023-06-10T19:09:51.844 INFO:teuthology.orchestra.run.smithi053.stderr: 94.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-06-10T19:09:51.844 INFO:teuthology.orchestra.run.smithi053.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.58765.log.gz 2023-06-10T19:09:51.844 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.53719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54071.log 2023-06-10T19:09:51.845 INFO:teuthology.orchestra.run.smithi053.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.53719.log.gz 2023-06-10T19:09:51.845 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.66635.log: /var/log/ceph/ceph-client.admin.66116.log 2023-06-10T19:09:51.845 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.54071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52303.log 2023-06-10T19:09:51.845 INFO:teuthology.orchestra.run.smithi053.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.66635.log.gz 2023-06-10T19:09:51.845 INFO:teuthology.orchestra.run.smithi053.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.54071.log.gz 2023-06-10T19:09:51.846 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.66116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64298.log 2023-06-10T19:09:51.846 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.52303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63614.log 2023-06-10T19:09:51.846 INFO:teuthology.orchestra.run.smithi053.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.66116.log.gz 2023-06-10T19:09:51.846 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.64298.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.52303.log.gz 2023-06-10T19:09:51.846 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62352.log 2023-06-10T19:09:51.847 INFO:teuthology.orchestra.run.smithi053.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.64298.log.gz 2023-06-10T19:09:51.847 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.63614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54175.log 2023-06-10T19:09:51.847 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.62352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49130.log 2023-06-10T19:09:51.847 INFO:teuthology.orchestra.run.smithi053.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.63614.log.gz 2023-06-10T19:09:51.847 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.54175.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.62352.log.gz 2023-06-10T19:09:51.848 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62654.log 2023-06-10T19:09:51.848 INFO:teuthology.orchestra.run.smithi053.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.54175.log.gz 2023-06-10T19:09:51.848 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.49130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64376.log 2023-06-10T19:09:51.848 INFO:teuthology.orchestra.run.smithi053.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49130.log.gz 2023-06-10T19:09:51.848 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48294.log 2023-06-10T19:09:51.849 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.62654.log: /var/log/ceph/ceph-client.admin.64376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52966.log 2023-06-10T19:09:51.849 INFO:teuthology.orchestra.run.smithi053.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.62654.log.gz 2023-06-10T19:09:51.849 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.48294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67232.log 2023-06-10T19:09:51.849 INFO:teuthology.orchestra.run.smithi053.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.64376.log.gz 2023-06-10T19:09:51.849 INFO:teuthology.orchestra.run.smithi053.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48294.log.gz 2023-06-10T19:09:51.850 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.52966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46813.log 2023-06-10T19:09:51.850 INFO:teuthology.orchestra.run.smithi053.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.52966.log.gz 2023-06-10T19:09:51.850 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.67232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67573.log 2023-06-10T19:09:51.850 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.46813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37442.log 2023-06-10T19:09:51.850 INFO:teuthology.orchestra.run.smithi053.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.67232.log.gz 2023-06-10T19:09:51.851 INFO:teuthology.orchestra.run.smithi053.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46813.log.gz 2023-06-10T19:09:51.851 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64050.log 2023-06-10T19:09:51.851 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.67573.log: /var/log/ceph/ceph-client.admin.37442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52251.log 2023-06-10T19:09:51.851 INFO:teuthology.orchestra.run.smithi053.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.67573.log.gz 2023-06-10T19:09:51.851 INFO:teuthology.orchestra.run.smithi053.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.37442.log.gz 2023-06-10T19:09:51.851 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47549.log 2023-06-10T19:09:51.852 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.64050.log: /var/log/ceph/ceph-client.admin.52251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68841.log 2023-06-10T19:09:51.852 INFO:teuthology.orchestra.run.smithi053.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.64050.log.gz 2023-06-10T19:09:51.852 INFO:teuthology.orchestra.run.smithi053.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52251.log.gz 2023-06-10T19:09:51.852 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57354.log 2023-06-10T19:09:51.853 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.47549.log: /var/log/ceph/ceph-client.admin.68841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68039.log 2023-06-10T19:09:51.853 INFO:teuthology.orchestra.run.smithi053.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47549.log.gz 2023-06-10T19:09:51.853 INFO:teuthology.orchestra.run.smithi053.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.68841.log.gz 2023-06-10T19:09:51.853 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.57354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49443.log 2023-06-10T19:09:51.853 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.68039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51584.log 2023-06-10T19:09:51.854 INFO:teuthology.orchestra.run.smithi053.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.57354.log.gz 2023-06-10T19:09:51.854 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.49443.log: 87.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.68039.log.gz 2023-06-10T19:09:51.854 INFO:teuthology.orchestra.run.smithi053.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.48687.log 2023-06-10T19:09:51.854 INFO:teuthology.orchestra.run.smithi053.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49443.log.gz 2023-06-10T19:09:51.854 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.51584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61627.log 2023-06-10T19:09:51.855 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.48687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59235.log 2023-06-10T19:09:51.855 INFO:teuthology.orchestra.run.smithi053.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.51584.log.gz 2023-06-10T19:09:51.855 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.61627.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48687.log.gz 2023-06-10T19:09:51.855 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44865.log 2023-06-10T19:09:51.855 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.59235.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.61627.log.gz 2023-06-10T19:09:51.856 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-06-10T19:09:51.856 INFO:teuthology.orchestra.run.smithi053.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.59235.log.gz 2023-06-10T19:09:51.856 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.44865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65660.log 2023-06-10T19:09:51.856 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58041.log 2023-06-10T19:09:51.856 INFO:teuthology.orchestra.run.smithi053.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44865.log.gz 2023-06-10T19:09:51.857 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.65660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56670.log 2023-06-10T19:09:51.857 INFO:teuthology.orchestra.run.smithi053.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.65660.log.gz 2023-06-10T19:09:51.857 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.58041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71789.log 2023-06-10T19:09:51.857 INFO:teuthology.orchestra.run.smithi053.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.58041.log.gz 2023-06-10T19:09:51.857 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47119.log 2023-06-10T19:09:51.857 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.56670.log: /var/log/ceph/ceph-client.admin.71789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44024.log 2023-06-10T19:09:51.858 INFO:teuthology.orchestra.run.smithi053.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.56670.log.gz 2023-06-10T19:09:51.858 INFO:teuthology.orchestra.run.smithi053.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.71789.log.gz 2023-06-10T19:09:51.858 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.47119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59636.log 2023-06-10T19:09:51.858 INFO:teuthology.orchestra.run.smithi053.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47119.log.gz 2023-06-10T19:09:51.858 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.44024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49182.log 2023-06-10T19:09:51.859 INFO:teuthology.orchestra.run.smithi053.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44024.log.gz 2023-06-10T19:09:51.859 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51925.log 2023-06-10T19:09:51.859 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.59636.log: /var/log/ceph/ceph-client.admin.49182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69107.log 2023-06-10T19:09:51.859 INFO:teuthology.orchestra.run.smithi053.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.59636.log.gz 2023-06-10T19:09:51.859 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.51925.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49182.log.gz 2023-06-10T19:09:51.860 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71521.log 2023-06-10T19:09:51.860 INFO:teuthology.orchestra.run.smithi053.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51925.log.gz 2023-06-10T19:09:51.860 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49900.log 2023-06-10T19:09:51.860 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.69107.log: /var/log/ceph/ceph-client.admin.71521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67985.log 2023-06-10T19:09:51.860 INFO:teuthology.orchestra.run.smithi053.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.69107.log.gz 2023-06-10T19:09:51.861 INFO:teuthology.orchestra.run.smithi053.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.71521.log.gz 2023-06-10T19:09:51.861 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.49900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46709.log 2023-06-10T19:09:51.861 INFO:teuthology.orchestra.run.smithi053.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49900.log.gz 2023-06-10T19:09:51.861 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43632.log 2023-06-10T19:09:51.861 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.67985.log: /var/log/ceph/ceph-client.admin.46709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56644.log 2023-06-10T19:09:51.862 INFO:teuthology.orchestra.run.smithi053.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.67985.log.gz 2023-06-10T19:09:51.862 INFO:teuthology.orchestra.run.smithi053.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46709.log.gz 2023-06-10T19:09:51.862 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.43632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46553.log 2023-06-10T19:09:51.862 INFO:teuthology.orchestra.run.smithi053.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43632.log.gz 2023-06-10T19:09:51.862 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.56644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46236.log 2023-06-10T19:09:51.863 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.46553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45737.log 2023-06-10T19:09:51.863 INFO:teuthology.orchestra.run.smithi053.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56644.log.gz 2023-06-10T19:09:51.863 INFO:teuthology.orchestra.run.smithi053.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46553.log.gz 2023-06-10T19:09:51.863 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.46236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46631.log 2023-06-10T19:09:51.863 INFO:teuthology.orchestra.run.smithi053.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.46236.log.gz 2023-06-10T19:09:51.864 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54812.log 2023-06-10T19:09:51.864 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.45737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59313.log 2023-06-10T19:09:51.864 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.46631.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45737.log.gz 2023-06-10T19:09:51.864 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.54812.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46631.log.gz 2023-06-10T19:09:51.864 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54523.log 2023-06-10T19:09:51.865 INFO:teuthology.orchestra.run.smithi053.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.54812.log.gz 2023-06-10T19:09:51.865 INFO:teuthology.orchestra.run.smithi053.stderr:gzip/var/log/ceph/ceph-client.admin.59313.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.62406.log 2023-06-10T19:09:51.865 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.54523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53309.log 2023-06-10T19:09:51.865 INFO:teuthology.orchestra.run.smithi053.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.59313.log.gz 2023-06-10T19:09:51.865 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.62406.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54523.log.gz 2023-06-10T19:09:51.865 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71045.log 2023-06-10T19:09:51.866 INFO:teuthology.orchestra.run.smithi053.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.62406.log.gz 2023-06-10T19:09:51.866 INFO:teuthology.orchestra.run.smithi053.stderr:gzip/var/log/ceph/ceph-client.admin.53309.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.59025.log 2023-06-10T19:09:51.866 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.71045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63972.log 2023-06-10T19:09:51.866 INFO:teuthology.orchestra.run.smithi053.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53309.log.gz 2023-06-10T19:09:51.866 INFO:teuthology.orchestra.run.smithi053.stderr: 88.1%/var/log/ceph/ceph-client.admin.59025.log: -- replaced with /var/log/ceph/ceph-client.admin.71045.log.gz 2023-06-10T19:09:51.867 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51558.log 2023-06-10T19:09:51.867 INFO:teuthology.orchestra.run.smithi053.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.59025.log.gz 2023-06-10T19:09:51.867 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55770.log 2023-06-10T19:09:51.867 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.63972.log: /var/log/ceph/ceph-client.admin.51558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53771.log 2023-06-10T19:09:51.867 INFO:teuthology.orchestra.run.smithi053.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.63972.log.gz 2023-06-10T19:09:51.868 INFO:teuthology.orchestra.run.smithi053.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51558.log.gz/var/log/ceph/ceph-client.admin.55770.log: 2023-06-10T19:09:51.868 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49057.log 2023-06-10T19:09:51.868 INFO:teuthology.orchestra.run.smithi053.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.55770.log.gz 2023-06-10T19:09:51.868 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68685.log 2023-06-10T19:09:51.868 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.53771.log: /var/log/ceph/ceph-client.admin.49057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52485.log 2023-06-10T19:09:51.869 INFO:teuthology.orchestra.run.smithi053.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53771.log.gz 2023-06-10T19:09:51.869 INFO:teuthology.orchestra.run.smithi053.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49057.log.gz 2023-06-10T19:09:51.869 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.68685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72146.log 2023-06-10T19:09:51.869 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70993.log 2023-06-10T19:09:51.869 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.0.52485.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.68685.log.gz 2023-06-10T19:09:51.869 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51821.log 2023-06-10T19:09:51.870 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.72146.log: /var/log/ceph/ceph-client.admin.70993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66352.log 2023-06-10T19:09:51.870 INFO:teuthology.orchestra.run.smithi053.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.72146.log.gz 2023-06-10T19:09:51.870 INFO:teuthology.orchestra.run.smithi053.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.70993.log.gz 2023-06-10T19:09:51.870 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.51821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60741.log 2023-06-10T19:09:51.870 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46182.log 2023-06-10T19:09:51.871 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.66352.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51821.log.gz 2023-06-10T19:09:51.871 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.60741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46683.log 2023-06-10T19:09:51.871 INFO:teuthology.orchestra.run.smithi053.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.66352.log.gz 2023-06-10T19:09:51.871 INFO:teuthology.orchestra.run.smithi053.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.60741.log.gz 2023-06-10T19:09:51.871 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.46182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53797.log 2023-06-10T19:09:51.872 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67180.log 2023-06-10T19:09:51.872 INFO:teuthology.orchestra.run.smithi053.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46182.log.gz 2023-06-10T19:09:51.872 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.46683.log: /var/log/ceph/ceph-client.admin.53797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70824.log 2023-06-10T19:09:51.872 INFO:teuthology.orchestra.run.smithi053.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46683.log.gz 2023-06-10T19:09:51.872 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.67180.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.53797.log.gz 2023-06-10T19:09:51.873 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60297.log 2023-06-10T19:09:51.873 INFO:teuthology.orchestra.run.smithi053.stderr: 95.4% -- replaced with /var/log/ceph/ceph-client.0.52485.log.gz 2023-06-10T19:09:51.873 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.70824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55272.log 2023-06-10T19:09:51.873 INFO:teuthology.orchestra.run.smithi053.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.67180.log.gz 2023-06-10T19:09:51.873 INFO:teuthology.orchestra.run.smithi053.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.70824.log.gz 2023-06-10T19:09:51.874 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.60297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60441.log 2023-06-10T19:09:51.874 INFO:teuthology.orchestra.run.smithi053.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.60297.log.gz 2023-06-10T19:09:51.874 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65196.log 2023-06-10T19:09:51.874 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.55272.log: /var/log/ceph/ceph-client.admin.60441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71202.log 2023-06-10T19:09:51.874 INFO:teuthology.orchestra.run.smithi053.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.55272.log.gz 2023-06-10T19:09:51.875 INFO:teuthology.orchestra.run.smithi053.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.60441.log.gz 2023-06-10T19:09:51.875 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.65196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48979.log 2023-06-10T19:09:51.875 INFO:teuthology.orchestra.run.smithi053.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.65196.log.gz 2023-06-10T19:09:51.875 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.71202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56251.log 2023-06-10T19:09:51.875 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.48979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61913.log 2023-06-10T19:09:51.876 INFO:teuthology.orchestra.run.smithi053.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.71202.log.gz 2023-06-10T19:09:51.876 INFO:teuthology.orchestra.run.smithi053.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48979.log.gz 2023-06-10T19:09:51.876 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.56251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64478.log 2023-06-10T19:09:51.876 INFO:teuthology.orchestra.run.smithi053.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.56251.log.gz 2023-06-10T19:09:51.876 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.61913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61411.log 2023-06-10T19:09:51.877 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.64478.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.61913.log.gz 2023-06-10T19:09:51.877 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59417.log 2023-06-10T19:09:51.877 INFO:teuthology.orchestra.run.smithi053.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.64478.log.gz 2023-06-10T19:09:51.877 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58100.log 2023-06-10T19:09:51.877 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.61411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62036.log 2023-06-10T19:09:51.877 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.59417.log: /var/log/ceph/ceph-client.admin.58100.log: gzip -5 --verbose -- 88.9% /var/log/ceph/ceph-client.admin.61238.log 2023-06-10T19:09:51.878 INFO:teuthology.orchestra.run.smithi053.stderr: -- replaced with /var/log/ceph/ceph-client.admin.61411.log.gz 2023-06-10T19:09:51.878 INFO:teuthology.orchestra.run.smithi053.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.59417.log.gz 2023-06-10T19:09:51.878 INFO:teuthology.orchestra.run.smithi053.stderr: 88.0%/var/log/ceph/ceph-client.admin.62036.log: -- replaced with /var/log/ceph/ceph-client.admin.58100.log.gz 2023-06-10T19:09:51.878 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68633.log 2023-06-10T19:09:51.878 INFO:teuthology.orchestra.run.smithi053.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.62036.log.gz 2023-06-10T19:09:51.879 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.61238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71150.log 2023-06-10T19:09:51.879 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.68633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59103.log 2023-06-10T19:09:51.879 INFO:teuthology.orchestra.run.smithi053.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.61238.log.gz 2023-06-10T19:09:51.879 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.71150.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.68633.log.gz 2023-06-10T19:09:51.879 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42776.log 2023-06-10T19:09:51.880 INFO:teuthology.orchestra.run.smithi053.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.71150.log.gz 2023-06-10T19:09:51.880 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.59103.log: -- /var/log/ceph/ceph-client.admin.50467.log 2023-06-10T19:09:51.880 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.42776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61757.log 2023-06-10T19:09:51.880 INFO:teuthology.orchestra.run.smithi053.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.59103.log.gz 2023-06-10T19:09:51.880 INFO:teuthology.orchestra.run.smithi053.stderr: 89.4%/var/log/ceph/ceph-client.admin.50467.log: -- replaced with /var/log/ceph/ceph-client.admin.42776.log.gz 2023-06-10T19:09:51.881 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58148.log 2023-06-10T19:09:51.881 INFO:teuthology.orchestra.run.smithi053.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50467.log.gz 2023-06-10T19:09:51.881 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.61757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45472.log 2023-06-10T19:09:51.881 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.58148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64634.log 2023-06-10T19:09:51.881 INFO:teuthology.orchestra.run.smithi053.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.61757.log.gz 2023-06-10T19:09:51.882 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.45472.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.58148.log.gz 2023-06-10T19:09:51.882 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49391.log 2023-06-10T19:09:51.882 INFO:teuthology.orchestra.run.smithi053.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45472.log.gz 2023-06-10T19:09:51.882 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48111.log 2023-06-10T19:09:51.882 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.64634.log: /var/log/ceph/ceph-client.admin.49391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44076.log 2023-06-10T19:09:51.883 INFO:teuthology.orchestra.run.smithi053.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.64634.log.gz 2023-06-10T19:09:51.883 INFO:teuthology.orchestra.run.smithi053.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49391.log.gz 2023-06-10T19:09:51.883 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.48111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47275.log 2023-06-10T19:09:51.883 INFO:teuthology.orchestra.run.smithi053.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48111.log.gz 2023-06-10T19:09:51.883 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52015.log 2023-06-10T19:09:51.884 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.44076.log: /var/log/ceph/ceph-client.admin.47275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60206.log 2023-06-10T19:09:51.884 INFO:teuthology.orchestra.run.smithi053.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44076.log.gz 2023-06-10T19:09:51.884 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.52015.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47275.log.gz 2023-06-10T19:09:51.884 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72381.log 2023-06-10T19:09:51.884 INFO:teuthology.orchestra.run.smithi053.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52015.log.gz 2023-06-10T19:09:51.885 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42642.log 2023-06-10T19:09:51.885 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.60206.log: /var/log/ceph/ceph-client.admin.72381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71708.log 2023-06-10T19:09:51.885 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.42642.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.60206.log.gz 2023-06-10T19:09:51.885 INFO:teuthology.orchestra.run.smithi053.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.72381.log.gz 2023-06-10T19:09:51.885 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58661.log 2023-06-10T19:09:51.886 INFO:teuthology.orchestra.run.smithi053.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.42642.log.gz 2023-06-10T19:09:51.886 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46104.log 2023-06-10T19:09:51.886 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.71708.log: /var/log/ceph/ceph-client.admin.58661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42331.log 2023-06-10T19:09:51.886 INFO:teuthology.orchestra.run.smithi053.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.71708.log.gz 2023-06-10T19:09:51.886 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.46104.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.58661.log.gz 2023-06-10T19:09:51.886 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48507.log 2023-06-10T19:09:51.887 INFO:teuthology.orchestra.run.smithi053.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46104.log.gz 2023-06-10T19:09:51.887 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50345.log 2023-06-10T19:09:51.887 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.42331.log: /var/log/ceph/ceph-client.admin.48507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59769.log 2023-06-10T19:09:51.887 INFO:teuthology.orchestra.run.smithi053.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42331.log.gz 2023-06-10T19:09:51.887 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.50345.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48507.log.gz 2023-06-10T19:09:51.888 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45763.log 2023-06-10T19:09:51.888 INFO:teuthology.orchestra.run.smithi053.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.50345.log.gz 2023-06-10T19:09:51.888 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.59769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62494.log 2023-06-10T19:09:51.888 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.45763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55430.log 2023-06-10T19:09:51.888 INFO:teuthology.orchestra.run.smithi053.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.59769.log.gz 2023-06-10T19:09:51.889 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.62494.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.45763.log.gz 2023-06-10T19:09:51.889 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56191.log 2023-06-10T19:09:51.889 INFO:teuthology.orchestra.run.smithi053.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.62494.log.gz 2023-06-10T19:09:51.889 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.55430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69951.log 2023-06-10T19:09:51.890 INFO:teuthology.orchestra.run.smithi053.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.55430.log.gz 2023-06-10T19:09:51.890 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.56191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57222.log 2023-06-10T19:09:51.890 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.69951.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.56191.log.gz 2023-06-10T19:09:51.890 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53849.log 2023-06-10T19:09:51.890 INFO:teuthology.orchestra.run.smithi053.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.69951.log.gz 2023-06-10T19:09:51.891 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.57222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63508.log 2023-06-10T19:09:51.891 INFO:teuthology.orchestra.run.smithi053.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.57222.log.gz 2023-06-10T19:09:51.891 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59443.log 2023-06-10T19:09:51.891 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.53849.log: /var/log/ceph/ceph-client.admin.63508.log: 88.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.53849.log.gz -5 2023-06-10T19:09:51.891 INFO:teuthology.orchestra.run.smithi053.stderr: --verbose -- /var/log/ceph/ceph-client.admin.47093.log 2023-06-10T19:09:51.891 INFO:teuthology.orchestra.run.smithi053.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.63508.log.gz 2023-06-10T19:09:51.892 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.59443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67722.log 2023-06-10T19:09:51.892 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.47093.log: gzip -5 --verbose -- 88.3% /var/log/ceph/ceph-client.admin.64905.log 2023-06-10T19:09:51.892 INFO:teuthology.orchestra.run.smithi053.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59443.log.gz 2023-06-10T19:09:51.892 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.67722.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47093.log.gz 2023-06-10T19:09:51.892 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52740.log 2023-06-10T19:09:51.893 INFO:teuthology.orchestra.run.smithi053.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.67722.log.gz 2023-06-10T19:09:51.893 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.64905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54944.log 2023-06-10T19:09:51.893 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.52740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45073.log 2023-06-10T19:09:51.893 INFO:teuthology.orchestra.run.smithi053.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.64905.log.gz 2023-06-10T19:09:51.893 INFO:teuthology.orchestra.run.smithi053.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52740.log.gz 2023-06-10T19:09:51.894 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.54944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50676.log 2023-06-10T19:09:51.894 INFO:teuthology.orchestra.run.smithi053.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54944.log.gz 2023-06-10T19:09:51.894 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45867.log 2023-06-10T19:09:51.894 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.45073.log: /var/log/ceph/ceph-client.admin.50676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55168.log 2023-06-10T19:09:51.894 INFO:teuthology.orchestra.run.smithi053.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45073.log.gz 2023-06-10T19:09:51.895 INFO:teuthology.orchestra.run.smithi053.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.50676.log.gz 2023-06-10T19:09:51.895 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.45867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44917.log 2023-06-10T19:09:51.895 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.55168.log: 88.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.45867.log.gz 2023-06-10T19:09:51.895 INFO:teuthology.orchestra.run.smithi053.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.58227.log 2023-06-10T19:09:51.895 INFO:teuthology.orchestra.run.smithi053.stderr:gzip 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55168.log.gz -5 2023-06-10T19:09:51.896 INFO:teuthology.orchestra.run.smithi053.stderr: --verbose -- /var/log/ceph/ceph-client.admin.50855.log/var/log/ceph/ceph-client.admin.44917.log: 2023-06-10T19:09:51.896 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.58227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56767.log 2023-06-10T19:09:51.896 INFO:teuthology.orchestra.run.smithi053.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44917.log.gz 2023-06-10T19:09:51.896 INFO:teuthology.orchestra.run.smithi053.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.58227.log.gz 2023-06-10T19:09:51.896 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70774.log 2023-06-10T19:09:51.897 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.50855.log: /var/log/ceph/ceph-client.admin.56767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56871.log 2023-06-10T19:09:51.897 INFO:teuthology.orchestra.run.smithi053.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50855.log.gz 2023-06-10T19:09:51.897 INFO:teuthology.orchestra.run.smithi053.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.56767.log.gz 2023-06-10T19:09:51.897 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.70774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72198.log 2023-06-10T19:09:51.897 INFO:teuthology.orchestra.run.smithi053.stderr:gzip/var/log/ceph/ceph-client.admin.56871.log: -5 --verbose -- /var/log/ceph/ceph-client.0.66536.log 2023-06-10T19:09:51.898 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.72198.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.70774.log.gz 2023-06-10T19:09:51.898 INFO:teuthology.orchestra.run.smithi053.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.56871.log.gz 2023-06-10T19:09:51.898 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68181.log 2023-06-10T19:09:51.898 INFO:teuthology.orchestra.run.smithi053.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.72198.log.gz 2023-06-10T19:09:51.898 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.0.66536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45973.log 2023-06-10T19:09:51.898 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.68181.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-06-10T19:09:51.899 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.45973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60635.log 2023-06-10T19:09:51.899 INFO:teuthology.orchestra.run.smithi053.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.68181.log.gz 2023-06-10T19:09:51.899 INFO:teuthology.orchestra.run.smithi053.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.45973.log.gz 2023-06-10T19:09:51.899 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64024.log 2023-06-10T19:09:51.899 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69081.log 2023-06-10T19:09:51.900 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.60635.log: /var/log/ceph/ceph-client.admin.64024.log: gzip -5 --verbose -- 88.7% /var/log/ceph/ceph-client.admin.59287.log 2023-06-10T19:09:51.900 INFO:teuthology.orchestra.run.smithi053.stderr: -- replaced with /var/log/ceph/ceph-client.admin.60635.log.gz 2023-06-10T19:09:51.900 INFO:teuthology.orchestra.run.smithi053.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.64024.log.gz 2023-06-10T19:09:51.900 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46761.log 2023-06-10T19:09:51.900 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.69081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69698.log 2023-06-10T19:09:51.901 INFO:teuthology.orchestra.run.smithi053.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.0.66536.log.gz 2023-06-10T19:09:51.901 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.59287.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.69081.log.gz 2023-06-10T19:09:51.901 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.46761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58174.log 2023-06-10T19:09:51.901 INFO:teuthology.orchestra.run.smithi053.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.59287.log.gz 2023-06-10T19:09:51.901 INFO:teuthology.orchestra.run.smithi053.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46761.log.gz 2023-06-10T19:09:51.902 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.69698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49691.log 2023-06-10T19:09:51.902 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.58174.log: gzip 88.7% -5 --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.69698.log.gz /var/log/ceph/ceph-client.admin.59522.log 2023-06-10T19:09:51.902 INFO:teuthology.orchestra.run.smithi053.stderr: 2023-06-10T19:09:51.902 INFO:teuthology.orchestra.run.smithi053.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.58174.log.gz 2023-06-10T19:09:51.902 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.49691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58921.log 2023-06-10T19:09:51.903 INFO:teuthology.orchestra.run.smithi053.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.49691.log.gz 2023-06-10T19:09:51.903 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70264.log 2023-06-10T19:09:51.903 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.59522.log: /var/log/ceph/ceph-client.admin.58921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71228.log 2023-06-10T19:09:51.903 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.70264.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.59522.log.gz 2023-06-10T19:09:51.903 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69646.log 2023-06-10T19:09:51.904 INFO:teuthology.orchestra.run.smithi053.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.58921.log.gz 2023-06-10T19:09:51.904 INFO:teuthology.orchestra.run.smithi053.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.70264.log.gz 2023-06-10T19:09:51.904 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.71228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44709.log 2023-06-10T19:09:51.904 INFO:teuthology.orchestra.run.smithi053.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.71228.log.gz 2023-06-10T19:09:51.904 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48875.log 2023-06-10T19:09:51.905 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.69646.log: /var/log/ceph/ceph-client.admin.44709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46943.log 2023-06-10T19:09:51.905 INFO:teuthology.orchestra.run.smithi053.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.69646.log.gz 2023-06-10T19:09:51.905 INFO:teuthology.orchestra.run.smithi053.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44709.log.gz 2023-06-10T19:09:51.905 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.48875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62010.log 2023-06-10T19:09:51.905 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55350.log 2023-06-10T19:09:51.905 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.46943.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48875.log.gz 2023-06-10T19:09:51.906 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.62010.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46943.log.gz 2023-06-10T19:09:51.906 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69483.log 2023-06-10T19:09:51.955 INFO:teuthology.orchestra.run.smithi117.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-06-10T19:09:51.987 INFO:teuthology.orchestra.run.smithi053.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.62010.log.gz 2023-06-10T19:09:51.988 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44206.log 2023-06-10T19:09:51.988 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.55350.log: /var/log/ceph/ceph-client.admin.69483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43202.log 2023-06-10T19:09:51.988 INFO:teuthology.orchestra.run.smithi053.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.69483.log.gz 2023-06-10T19:09:51.988 INFO:teuthology.orchestra.run.smithi053.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.55350.log.gz 2023-06-10T19:09:51.989 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.44206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62680.log 2023-06-10T19:09:51.989 INFO:teuthology.orchestra.run.smithi053.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44206.log.gz 2023-06-10T19:09:51.989 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.43202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47249.log 2023-06-10T19:09:51.989 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44995.log 2023-06-10T19:09:51.990 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.62680.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43202.log.gz 2023-06-10T19:09:51.990 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.47249.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.62680.log.gz 2023-06-10T19:09:51.990 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44735.log 2023-06-10T19:09:51.990 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53283.log 2023-06-10T19:09:51.990 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.44995.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47249.log.gz 2023-06-10T19:09:51.991 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.44735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70486.log 2023-06-10T19:09:51.991 INFO:teuthology.orchestra.run.smithi053.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44995.log.gz 2023-06-10T19:09:51.991 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56165.log 2023-06-10T19:09:51.991 INFO:teuthology.orchestra.run.smithi053.stderr: 89.4%/var/log/ceph/ceph-client.admin.53283.log: -- replaced with /var/log/ceph/ceph-client.admin.44735.log.gz 2023-06-10T19:09:51.991 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.70486.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.53283.log.gz 2023-06-10T19:09:51.992 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53413.log 2023-06-10T19:09:51.992 INFO:teuthology.orchestra.run.smithi053.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.70486.log.gz 2023-06-10T19:09:51.992 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51953.log 2023-06-10T19:09:51.992 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.56165.log: /var/log/ceph/ceph-client.admin.53413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69750.log 2023-06-10T19:09:51.992 INFO:teuthology.orchestra.run.smithi053.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53413.log.gz 2023-06-10T19:09:51.993 INFO:teuthology.orchestra.run.smithi053.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.56165.log.gz 2023-06-10T19:09:51.993 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.51953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72719.log 2023-06-10T19:09:51.993 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53993.log 2023-06-10T19:09:51.993 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.69750.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51953.log.gz 2023-06-10T19:09:51.993 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.72719.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.69750.log.gz 2023-06-10T19:09:51.994 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58817.log 2023-06-10T19:09:51.994 INFO:teuthology.orchestra.run.smithi053.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.72719.log.gz 2023-06-10T19:09:51.994 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64841.log 2023-06-10T19:09:51.994 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.53993.log: /var/log/ceph/ceph-client.admin.58817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43631.log 2023-06-10T19:09:51.994 INFO:teuthology.orchestra.run.smithi053.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.58817.log.gz 2023-06-10T19:09:51.995 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60999.log 2023-06-10T19:09:51.995 INFO:teuthology.orchestra.run.smithi053.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53993.log.gz 2023-06-10T19:09:51.995 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.64841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72303.log 2023-06-10T19:09:51.995 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.43631.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.64841.log.gz 2023-06-10T19:09:51.995 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.60999.log: gzip 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43631.log.gz -5 2023-06-10T19:09:51.996 INFO:teuthology.orchestra.run.smithi053.stderr: --verbose -- /var/log/ceph/ceph-client.admin.56936.log 2023-06-10T19:09:51.996 INFO:teuthology.orchestra.run.smithi053.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.60999.log.gz 2023-06-10T19:09:51.996 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55324.log 2023-06-10T19:09:51.996 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.72303.log: /var/log/ceph/ceph-client.admin.56936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61307.log 2023-06-10T19:09:51.996 INFO:teuthology.orchestra.run.smithi053.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.56936.log.gz 2023-06-10T19:09:51.997 INFO:teuthology.orchestra.run.smithi053.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.72303.log.gz 2023-06-10T19:09:51.997 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.55324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59847.log 2023-06-10T19:09:51.997 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-06-10T19:09:51.997 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.61307.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.55324.log.gz 2023-06-10T19:09:51.997 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.59847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47653.log 2023-06-10T19:09:51.998 INFO:teuthology.orchestra.run.smithi053.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.61307.log.gz 2023-06-10T19:09:51.998 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50493.log 2023-06-10T19:09:51.998 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-mon.a.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.59847.log.gz 2023-06-10T19:09:51.998 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.47653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71097.log 2023-06-10T19:09:51.998 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.50493.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47653.log.gz 2023-06-10T19:09:51.999 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69238.log 2023-06-10T19:09:51.999 INFO:teuthology.orchestra.run.smithi053.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50493.log.gz 2023-06-10T19:09:51.999 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68874.log 2023-06-10T19:09:51.999 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.71097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57132.log 2023-06-10T19:09:51.999 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.69238.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.71097.log.gz 2023-06-10T19:09:52.000 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.68874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67907.log 2023-06-10T19:09:52.000 INFO:teuthology.orchestra.run.smithi053.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.69238.log.gz 2023-06-10T19:09:52.000 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.57132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51201.log 2023-06-10T19:09:52.000 INFO:teuthology.orchestra.run.smithi053.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.68874.log.gz 2023-06-10T19:09:52.001 INFO:teuthology.orchestra.run.smithi053.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.57132.log.gz 2023-06-10T19:09:52.001 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.67907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71124.log 2023-06-10T19:09:52.001 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55927.log 2023-06-10T19:09:52.001 INFO:teuthology.orchestra.run.smithi053.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.67907.log.gz 2023-06-10T19:09:52.001 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.51201.log: /var/log/ceph/ceph-client.admin.71124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71867.log 2023-06-10T19:09:52.002 INFO:teuthology.orchestra.run.smithi053.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51201.log.gz 2023-06-10T19:09:52.002 INFO:teuthology.orchestra.run.smithi053.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.71124.log.gz 2023-06-10T19:09:52.002 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.55927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58999.log 2023-06-10T19:09:52.002 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.71867.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.55927.log.gz 2023-06-10T19:09:52.002 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63110.log 2023-06-10T19:09:52.003 INFO:teuthology.orchestra.run.smithi053.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.71867.log.gz 2023-06-10T19:09:52.003 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65686.log 2023-06-10T19:09:52.003 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.58999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51697.log 2023-06-10T19:09:52.003 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.63110.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.58999.log.gz 2023-06-10T19:09:52.003 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.65686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50907.log 2023-06-10T19:09:52.004 INFO:teuthology.orchestra.run.smithi053.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.63110.log.gz 2023-06-10T19:09:52.004 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.51697.log: gzip -5 --verbose -- 87.7% /var/log/ceph/ceph-client.admin.48268.log 2023-06-10T19:09:52.004 INFO:teuthology.orchestra.run.smithi053.stderr: -- replaced with /var/log/ceph/ceph-client.admin.65686.log.gz 2023-06-10T19:09:52.004 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.50907.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51697.log.gz 2023-06-10T19:09:52.004 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62468.log 2023-06-10T19:09:52.005 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72433.log 2023-06-10T19:09:52.005 INFO:teuthology.orchestra.run.smithi053.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50907.log.gz 2023-06-10T19:09:52.005 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.48268.log: /var/log/ceph/ceph-client.admin.62468.log: 88.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.48268.log.gz 2023-06-10T19:09:52.005 INFO:teuthology.orchestra.run.smithi053.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.71403.log 2023-06-10T19:09:52.005 INFO:teuthology.orchestra.run.smithi053.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.62468.log.gz 2023-06-10T19:09:52.006 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56384.log 2023-06-10T19:09:52.006 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.72433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46208.log 2023-06-10T19:09:52.006 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.71403.log: /var/log/ceph/ceph-client.admin.56384.log: gzip 88.9% -5 --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.72433.log.gz 2023-06-10T19:09:52.006 INFO:teuthology.orchestra.run.smithi053.stderr: /var/log/ceph/ceph-client.admin.70003.log 2023-06-10T19:09:52.006 INFO:teuthology.orchestra.run.smithi053.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.71403.log.gz 2023-06-10T19:09:52.007 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.46208.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.56384.log.gz 2023-06-10T19:09:52.007 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57248.log 2023-06-10T19:09:52.007 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.70003.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46208.log.gz 2023-06-10T19:09:52.007 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62378.log 2023-06-10T19:09:52.007 INFO:teuthology.orchestra.run.smithi053.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.70003.log.gz 2023-06-10T19:09:52.008 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.57248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54575.log 2023-06-10T19:09:52.008 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.62378.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.57248.log.gz 2023-06-10T19:09:52.008 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64166.log 2023-06-10T19:09:52.008 INFO:teuthology.orchestra.run.smithi053.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.62378.log.gz 2023-06-10T19:09:52.008 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.54575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49847.log 2023-06-10T19:09:52.009 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47443.log 2023-06-10T19:09:52.009 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.64166.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54575.log.gz 2023-06-10T19:09:52.009 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.49847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54970.log 2023-06-10T19:09:52.009 INFO:teuthology.orchestra.run.smithi053.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.64166.log.gz 2023-06-10T19:09:52.009 INFO:teuthology.orchestra.run.smithi053.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49847.log.gz 2023-06-10T19:09:52.010 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.47443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49611.log 2023-06-10T19:09:52.010 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52067.log 2023-06-10T19:09:52.010 INFO:teuthology.orchestra.run.smithi053.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47443.log.gz 2023-06-10T19:09:52.010 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.54970.log: /var/log/ceph/ceph-client.admin.49611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70406.log 2023-06-10T19:09:52.010 INFO:teuthology.orchestra.run.smithi053.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.54970.log.gz 2023-06-10T19:09:52.011 INFO:teuthology.orchestra.run.smithi053.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.49611.log.gz 2023-06-10T19:09:52.011 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.52067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63084.log 2023-06-10T19:09:52.011 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.70406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42563.log 2023-06-10T19:09:52.011 INFO:teuthology.orchestra.run.smithi053.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52067.log.gz 2023-06-10T19:09:52.011 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.63084.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.70406.log.gz 2023-06-10T19:09:52.012 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58687.log 2023-06-10T19:09:52.012 INFO:teuthology.orchestra.run.smithi053.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.63084.log.gz 2023-06-10T19:09:52.012 INFO:teuthology.orchestra.run.smithi053.stderr:gzip/var/log/ceph/ceph-client.admin.42563.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.42472.log 2023-06-10T19:09:52.012 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.58687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71997.log 2023-06-10T19:09:52.012 INFO:teuthology.orchestra.run.smithi053.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.42563.log.gz 2023-06-10T19:09:52.013 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.42472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47976.log 2023-06-10T19:09:52.013 INFO:teuthology.orchestra.run.smithi053.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.58687.log.gz 2023-06-10T19:09:52.013 INFO:teuthology.orchestra.run.smithi053.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42472.log.gz 2023-06-10T19:09:52.013 INFO:teuthology.orchestra.run.smithi053.stderr:gzip/var/log/ceph/ceph-client.admin.71997.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.72277.log 2023-06-10T19:09:52.013 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68763.log 2023-06-10T19:09:52.014 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.47976.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.71997.log.gz 2023-06-10T19:09:52.014 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.72277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46449.log 2023-06-10T19:09:52.014 INFO:teuthology.orchestra.run.smithi053.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47976.log.gz 2023-06-10T19:09:52.014 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.68763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47355.log 88.5% 2023-06-10T19:09:52.014 INFO:teuthology.orchestra.run.smithi053.stderr: -- replaced with /var/log/ceph/ceph-client.admin.72277.log.gz 2023-06-10T19:09:52.015 INFO:teuthology.orchestra.run.smithi053.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.68763.log.gz 2023-06-10T19:09:52.015 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.46449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53231.log 2023-06-10T19:09:52.015 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55048.log 2023-06-10T19:09:52.015 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.47355.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46449.log.gz 2023-06-10T19:09:52.015 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.53231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50056.log 2023-06-10T19:09:52.016 INFO:teuthology.orchestra.run.smithi053.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47355.log.gz 2023-06-10T19:09:52.016 INFO:teuthology.orchestra.run.smithi053.stderr: 88.7%/var/log/ceph/ceph-client.admin.55048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68467.log 2023-06-10T19:09:52.016 INFO:teuthology.orchestra.run.smithi053.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53231.log.gz 2023-06-10T19:09:52.016 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.50056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64132.log 2023-06-10T19:09:52.016 INFO:teuthology.orchestra.run.smithi053.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55048.log.gz 2023-06-10T19:09:52.017 INFO:teuthology.orchestra.run.smithi053.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50056.log.gz 2023-06-10T19:09:52.017 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.0.68467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42694.log 2023-06-10T19:09:52.017 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56303.log 2023-06-10T19:09:52.017 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.64132.log: /var/log/ceph/ceph-client.admin.42694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47731.log 2023-06-10T19:09:52.017 INFO:teuthology.orchestra.run.smithi053.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.64132.log.gz 2023-06-10T19:09:52.018 INFO:teuthology.orchestra.run.smithi053.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42694.log.gz/var/log/ceph/ceph-client.admin.56303.log: 2023-06-10T19:09:52.018 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45815.log 2023-06-10T19:09:52.018 INFO:teuthology.orchestra.run.smithi053.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.0.68467.log.gz 2023-06-10T19:09:52.018 INFO:teuthology.orchestra.run.smithi053.stderr: 88.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70372.log 2023-06-10T19:09:52.018 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.47731.log: -- replaced with /var/log/ceph/ceph-client.admin.56303.log.gz 2023-06-10T19:09:52.019 INFO:teuthology.orchestra.run.smithi053.stderr:gzip/var/log/ceph/ceph-client.admin.45815.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.62326.log 2023-06-10T19:09:52.019 INFO:teuthology.orchestra.run.smithi053.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47731.log.gz 2023-06-10T19:09:52.019 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.70372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64585.log 2023-06-10T19:09:52.019 INFO:teuthology.orchestra.run.smithi053.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45815.log.gz 2023-06-10T19:09:52.019 INFO:teuthology.orchestra.run.smithi053.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.70372.log.gz 2023-06-10T19:09:52.020 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.62326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46025.log 2023-06-10T19:09:52.020 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.64585.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.62326.log.gz 2023-06-10T19:09:52.020 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43088.log 2023-06-10T19:09:52.020 INFO:teuthology.orchestra.run.smithi053.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.64585.log.gz 2023-06-10T19:09:52.020 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.46025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60583.log 2023-06-10T19:09:52.020 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.43088.log: 88.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.46025.log.gz -5 2023-06-10T19:09:52.021 INFO:teuthology.orchestra.run.smithi053.stderr: --verbose -- /var/log/ceph/ceph-client.admin.45281.log 2023-06-10T19:09:52.021 INFO:teuthology.orchestra.run.smithi053.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43088.log.gz/var/log/ceph/ceph-client.admin.60583.log: 2023-06-10T19:09:52.021 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56592.log 2023-06-10T19:09:52.021 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.45281.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.60583.log.gz 2023-06-10T19:09:52.021 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44258.log 2023-06-10T19:09:52.022 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.56592.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45281.log.gz 2023-06-10T19:09:52.022 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60029.log 2023-06-10T19:09:52.022 INFO:teuthology.orchestra.run.smithi053.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.56592.log.gz 2023-06-10T19:09:52.022 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5/var/log/ceph/ceph-client.admin.44258.log: --verbose -- /var/log/ceph/ceph-client.admin.45021.log 2023-06-10T19:09:52.022 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.60029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60521.log 2023-06-10T19:09:52.023 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.45021.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.60029.log.gz 2023-06-10T19:09:52.023 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68101.log 2023-06-10T19:09:52.023 INFO:teuthology.orchestra.run.smithi053.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.44258.log.gz 2023-06-10T19:09:52.023 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.60521.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45021.log.gz 2023-06-10T19:09:52.023 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43630.log 2023-06-10T19:09:52.024 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68520.log 2023-06-10T19:09:52.024 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.68101.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.60521.log.gz 2023-06-10T19:09:52.024 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.43630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60055.log 2023-06-10T19:09:52.024 INFO:teuthology.orchestra.run.smithi053.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.68101.log.gz 2023-06-10T19:09:52.024 INFO:teuthology.orchestra.run.smithi053.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43630.log.gz 2023-06-10T19:09:52.025 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.68520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55194.log 2023-06-10T19:09:52.025 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48927.log 2023-06-10T19:09:52.025 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.60055.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.68520.log.gz 2023-06-10T19:09:52.025 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.55194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63789.log 2023-06-10T19:09:52.025 INFO:teuthology.orchestra.run.smithi053.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.60055.log.gz 2023-06-10T19:09:52.026 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.48927.log: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51042.log 2023-06-10T19:09:52.026 INFO:teuthology.orchestra.run.smithi053.stderr: -- replaced with /var/log/ceph/ceph-client.admin.55194.log.gz 2023-06-10T19:09:52.026 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.63789.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48927.log.gz 2023-06-10T19:09:52.026 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54359.log 2023-06-10T19:09:52.026 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46345.log 2023-06-10T19:09:52.027 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.51042.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.63789.log.gz 2023-06-10T19:09:52.027 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.54359.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51042.log.gz 2023-06-10T19:09:52.027 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72049.log 2023-06-10T19:09:52.027 INFO:teuthology.orchestra.run.smithi053.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54359.log.gz 2023-06-10T19:09:52.027 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.46345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71682.log 2023-06-10T19:09:52.028 INFO:teuthology.orchestra.run.smithi053.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46345.log.gz 2023-06-10T19:09:52.028 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.72049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48006.log 2023-06-10T19:09:52.028 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.71682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59951.log 2023-06-10T19:09:52.028 INFO:teuthology.orchestra.run.smithi053.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.72049.log.gz 2023-06-10T19:09:52.029 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.48006.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.71682.log.gz 2023-06-10T19:09:52.029 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43627.log 2023-06-10T19:09:52.029 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.59951.log: gzip 89.4% -5 -- replaced with /var/log/ceph/ceph-client.admin.48006.log.gz --verbose 2023-06-10T19:09:52.029 INFO:teuthology.orchestra.run.smithi053.stderr: -- /var/log/ceph/ceph-client.admin.52121.log 2023-06-10T19:09:52.029 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.43627.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.59951.log.gz 2023-06-10T19:09:52.029 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67933.log 2023-06-10T19:09:52.030 INFO:teuthology.orchestra.run.smithi053.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43627.log.gz 2023-06-10T19:09:52.030 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.52121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43894.log 2023-06-10T19:09:52.030 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.67933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51610.log 2023-06-10T19:09:52.030 INFO:teuthology.orchestra.run.smithi053.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52121.log.gz 2023-06-10T19:09:52.030 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.43894.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.67933.log.gz 2023-06-10T19:09:52.031 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53877.log 2023-06-10T19:09:52.031 INFO:teuthology.orchestra.run.smithi053.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43894.log.gz 2023-06-10T19:09:52.031 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.51610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44050.log 2023-06-10T19:09:52.031 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64931.log 2023-06-10T19:09:52.031 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.53877.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51610.log.gz 2023-06-10T19:09:52.032 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.44050.log: gzip 87.2% -5 -- replaced with /var/log/ceph/ceph-client.admin.53877.log.gz 2023-06-10T19:09:52.032 INFO:teuthology.orchestra.run.smithi053.stderr: --verbose -- /var/log/ceph/ceph-client.admin.58739.log 2023-06-10T19:09:52.032 INFO:teuthology.orchestra.run.smithi053.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.44050.log.gz 2023-06-10T19:09:52.032 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.64931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64272.log 2023-06-10T19:09:52.032 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.58739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42854.log 2023-06-10T19:09:52.033 INFO:teuthology.orchestra.run.smithi053.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.64931.log.gz 2023-06-10T19:09:52.033 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.64272.log: gzip 89.1% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.58739.log.gz -- 2023-06-10T19:09:52.033 INFO:teuthology.orchestra.run.smithi053.stderr: /var/log/ceph/ceph-client.admin.47067.log 2023-06-10T19:09:52.033 INFO:teuthology.orchestra.run.smithi053.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.64272.log.gz 2023-06-10T19:09:52.033 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.42854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47417.log 2023-06-10T19:09:52.034 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50136.log 2023-06-10T19:09:52.034 INFO:teuthology.orchestra.run.smithi053.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42854.log.gz 2023-06-10T19:09:52.034 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.47067.log: /var/log/ceph/ceph-client.admin.47417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51331.log 2023-06-10T19:09:52.034 INFO:teuthology.orchestra.run.smithi053.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47067.log.gz 2023-06-10T19:09:52.034 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.50136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58843.log 2023-06-10T19:09:52.035 INFO:teuthology.orchestra.run.smithi053.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.47417.log.gz 2023-06-10T19:09:52.035 INFO:teuthology.orchestra.run.smithi053.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50136.log.gz 2023-06-10T19:09:52.035 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.51331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54019.log 2023-06-10T19:09:52.035 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61572.log 2023-06-10T19:09:52.035 INFO:teuthology.orchestra.run.smithi053.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51331.log.gz 2023-06-10T19:09:52.036 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.58843.log: /var/log/ceph/ceph-client.admin.54019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60663.log 2023-06-10T19:09:52.036 INFO:teuthology.orchestra.run.smithi053.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.58843.log.gz 2023-06-10T19:09:52.036 INFO:teuthology.orchestra.run.smithi053.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54019.log.gz 2023-06-10T19:09:52.036 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.61572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48351.log 2023-06-10T19:09:52.036 INFO:teuthology.orchestra.run.smithi053.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.61572.log.gz 2023-06-10T19:09:52.037 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60154.log 2023-06-10T19:09:52.037 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.60663.log: /var/log/ceph/ceph-client.admin.48351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62626.log 2023-06-10T19:09:52.037 INFO:teuthology.orchestra.run.smithi053.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.60663.log.gz 2023-06-10T19:09:52.037 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.60154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48033.log 2023-06-10T19:09:52.037 INFO:teuthology.orchestra.run.smithi053.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48351.log.gz 2023-06-10T19:09:52.038 INFO:teuthology.orchestra.run.smithi053.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.60154.log.gz 2023-06-10T19:09:52.038 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.62626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52173.log 2023-06-10T19:09:52.038 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55901.log 2023-06-10T19:09:52.038 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.48033.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.62626.log.gz 2023-06-10T19:09:52.038 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.52173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45789.log 2023-06-10T19:09:52.038 INFO:teuthology.orchestra.run.smithi053.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48033.log.gz 2023-06-10T19:09:52.039 INFO:teuthology.orchestra.run.smithi053.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52173.log.gz 2023-06-10T19:09:52.039 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.55901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70616.log 2023-06-10T19:09:52.039 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53335.log 2023-06-10T19:09:52.039 INFO:teuthology.orchestra.run.smithi053.stderr: 88.7%/var/log/ceph/ceph-client.admin.45789.log: -- replaced with /var/log/ceph/ceph-client.admin.55901.log.gz 2023-06-10T19:09:52.039 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.70616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56819.log 2023-06-10T19:09:52.040 INFO:teuthology.orchestra.run.smithi053.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45789.log.gz 2023-06-10T19:09:52.040 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.53335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70120.log 2023-06-10T19:09:52.040 INFO:teuthology.orchestra.run.smithi053.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.70616.log.gz 2023-06-10T19:09:52.040 INFO:teuthology.orchestra.run.smithi053.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53335.log.gz 2023-06-10T19:09:52.040 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66274.log 2023-06-10T19:09:52.041 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.56819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60767.log 2023-06-10T19:09:52.041 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.70120.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.56819.log.gz 2023-06-10T19:09:52.041 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.66274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57328.log 2023-06-10T19:09:52.041 INFO:teuthology.orchestra.run.smithi053.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.70120.log.gz 2023-06-10T19:09:52.041 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.60767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54710.log 2023-06-10T19:09:52.042 INFO:teuthology.orchestra.run.smithi053.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.66274.log.gz 2023-06-10T19:09:52.042 INFO:teuthology.orchestra.run.smithi053.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.60767.log.gz 2023-06-10T19:09:52.042 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.57328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55744.log 2023-06-10T19:09:52.042 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55456.log 2023-06-10T19:09:52.042 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.54710.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.57328.log.gz 2023-06-10T19:09:52.043 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.55744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70670.log 2023-06-10T19:09:52.043 INFO:teuthology.orchestra.run.smithi053.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.54710.log.gz 2023-06-10T19:09:52.043 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.55456.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.55744.log.gz 2023-06-10T19:09:52.043 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46475.log 2023-06-10T19:09:52.043 INFO:teuthology.orchestra.run.smithi053.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.55456.log.gz 2023-06-10T19:09:52.044 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.70670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67206.log 2023-06-10T19:09:52.044 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43428.log 2023-06-10T19:09:52.044 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.46475.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.70670.log.gz 2023-06-10T19:09:52.044 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.67206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52199.log 2023-06-10T19:09:52.044 INFO:teuthology.orchestra.run.smithi053.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46475.log.gz 2023-06-10T19:09:52.045 INFO:teuthology.orchestra.run.smithi053.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.67206.log.gz/var/log/ceph/ceph-client.admin.43428.log: 2023-06-10T19:09:52.045 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71893.log 2023-06-10T19:09:52.045 INFO:teuthology.orchestra.run.smithi053.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43428.log.gz 2023-06-10T19:09:52.045 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.52199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50624.log 2023-06-10T19:09:52.045 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71019.log 2023-06-10T19:09:52.046 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.71893.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52199.log.gz 2023-06-10T19:09:52.046 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.50624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62782.log 2023-06-10T19:09:52.046 INFO:teuthology.orchestra.run.smithi053.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.71893.log.gz 2023-06-10T19:09:52.046 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.71019.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.50624.log.gz 2023-06-10T19:09:52.046 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72120.log 2023-06-10T19:09:52.047 INFO:teuthology.orchestra.run.smithi053.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.71019.log.gz 2023-06-10T19:09:52.047 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.62782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61598.log 2023-06-10T19:09:52.047 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53939.log 2023-06-10T19:09:52.047 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.72120.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.62782.log.gz 2023-06-10T19:09:52.047 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.61598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60493.log 2023-06-10T19:09:52.048 INFO:teuthology.orchestra.run.smithi053.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.72120.log.gz 2023-06-10T19:09:52.048 INFO:teuthology.orchestra.run.smithi053.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.61598.log.gz 2023-06-10T19:09:52.048 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.53939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54149.log 2023-06-10T19:09:52.048 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71573.log 2023-06-10T19:09:52.048 INFO:teuthology.orchestra.run.smithi053.stderr: 88.1%/var/log/ceph/ceph-client.admin.60493.log: -- replaced with /var/log/ceph/ceph-client.admin.53939.log.gz 2023-06-10T19:09:52.049 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.54149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67154.log 2023-06-10T19:09:52.049 INFO:teuthology.orchestra.run.smithi053.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.60493.log.gz 2023-06-10T19:09:52.049 INFO:teuthology.orchestra.run.smithi053.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54149.log.gz 2023-06-10T19:09:52.049 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.71573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44969.log 2023-06-10T19:09:52.049 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68413.log 2023-06-10T19:09:52.049 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.67154.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.71573.log.gz 2023-06-10T19:09:52.050 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.44969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68155.log 2023-06-10T19:09:52.050 INFO:teuthology.orchestra.run.smithi053.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.67154.log.gz 2023-06-10T19:09:52.050 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.68413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45685.log 2023-06-10T19:09:52.050 INFO:teuthology.orchestra.run.smithi053.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44969.log.gz 2023-06-10T19:09:52.050 INFO:teuthology.orchestra.run.smithi053.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.68413.log.gz 2023-06-10T19:09:52.051 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.68155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72615.log 2023-06-10T19:09:52.051 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69776.log 2023-06-10T19:09:52.051 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.45685.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.68155.log.gz 2023-06-10T19:09:52.051 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.72615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59051.log 2023-06-10T19:09:52.051 INFO:teuthology.orchestra.run.smithi053.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45685.log.gz 2023-06-10T19:09:52.052 INFO:teuthology.orchestra.run.smithi053.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.72615.log.gz 2023-06-10T19:09:52.052 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61984.log 2023-06-10T19:09:52.052 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.69776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71734.log 2023-06-10T19:09:52.052 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.59051.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.69776.log.gz 2023-06-10T19:09:52.052 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.61984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43424.log 2023-06-10T19:09:52.053 INFO:teuthology.orchestra.run.smithi053.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.59051.log.gz 2023-06-10T19:09:52.053 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.71734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52667.log 2023-06-10T19:09:52.053 INFO:teuthology.orchestra.run.smithi053.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.61984.log.gz 2023-06-10T19:09:52.053 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.43424.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.71734.log.gz 2023-06-10T19:09:52.053 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49031.log 2023-06-10T19:09:52.054 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52573.log 2023-06-10T19:09:52.054 INFO:teuthology.orchestra.run.smithi053.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43424.log.gz 2023-06-10T19:09:52.054 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.52667.log: /var/log/ceph/ceph-client.admin.49031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37568.log 2023-06-10T19:09:52.054 INFO:teuthology.orchestra.run.smithi053.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52667.log.gz 2023-06-10T19:09:52.054 INFO:teuthology.orchestra.run.smithi053.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49031.log.gz 2023-06-10T19:09:52.055 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48481.log 2023-06-10T19:09:52.055 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.52573.log: /var/log/ceph/ceph-client.admin.37568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52635.log 2023-06-10T19:09:52.055 INFO:teuthology.orchestra.run.smithi053.stderr: 88.3% 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37568.log.gz 2023-06-10T19:09:52.055 INFO:teuthology.orchestra.run.smithi053.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52573.log.gz 2023-06-10T19:09:52.055 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.48481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47497.log 2023-06-10T19:09:52.055 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51487.log 2023-06-10T19:09:52.056 INFO:teuthology.orchestra.run.smithi053.stderr: 88.4%/var/log/ceph/ceph-client.admin.52635.log: -- replaced with /var/log/ceph/ceph-client.admin.48481.log.gz 2023-06-10T19:09:52.056 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.47497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46787.log 2023-06-10T19:09:52.056 INFO:teuthology.orchestra.run.smithi053.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.52635.log.gz 2023-06-10T19:09:52.056 INFO:teuthology.orchestra.run.smithi053.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47497.log.gz 2023-06-10T19:09:52.056 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.51487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64639.log 2023-06-10T19:09:52.057 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67495.log 2023-06-10T19:09:52.057 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.46787.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51487.log.gz 2023-06-10T19:09:52.057 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.64639.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.32480.log 2023-06-10T19:09:52.057 INFO:teuthology.orchestra.run.smithi053.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46787.log.gz 2023-06-10T19:09:52.057 INFO:teuthology.orchestra.run.smithi053.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.64639.log.gz 2023-06-10T19:09:52.058 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.67495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51795.log 2023-06-10T19:09:52.058 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57564.log 2023-06-10T19:09:52.058 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph.tmp-client.admin.32480.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.67495.log.gz 2023-06-10T19:09:52.058 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.32480.log.gz 2023-06-10T19:09:52.058 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.51795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65277.log 2023-06-10T19:09:52.059 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.57564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43422.log 2023-06-10T19:09:52.059 INFO:teuthology.orchestra.run.smithi053.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51795.log.gz 2023-06-10T19:09:52.059 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.65277.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.57564.log.gz 2023-06-10T19:09:52.059 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52875.log 2023-06-10T19:09:52.059 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.43422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56137.log 2023-06-10T19:09:52.059 INFO:teuthology.orchestra.run.smithi053.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.65277.log.gz 2023-06-10T19:09:52.060 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.52875.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43422.log.gz 2023-06-10T19:09:52.060 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46501.log 2023-06-10T19:09:52.060 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.56137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44154.log 2023-06-10T19:09:52.060 INFO:teuthology.orchestra.run.smithi053.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52875.log.gz 2023-06-10T19:09:52.060 INFO:teuthology.orchestra.run.smithi053.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.56137.log.gz 2023-06-10T19:09:52.061 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.46501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61053.log 2023-06-10T19:09:52.061 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-06-10T19:09:52.061 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.44154.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46501.log.gz 2023-06-10T19:09:52.061 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.0.61053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45229.log 2023-06-10T19:09:52.061 INFO:teuthology.orchestra.run.smithi053.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44154.log.gz 2023-06-10T19:09:52.062 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51461.log 2023-06-10T19:09:52.062 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.45229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50650.log 2023-06-10T19:09:52.062 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.51461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51899.log 2023-06-10T19:09:52.062 INFO:teuthology.orchestra.run.smithi053.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45229.log.gz 2023-06-10T19:09:52.062 INFO:teuthology.orchestra.run.smithi053.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51461.log.gz 2023-06-10T19:09:52.063 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.50650.log: 90.6% -- replaced with /var/log/ceph/ceph-client.0.61053.log.gz 2023-06-10T19:09:52.063 INFO:teuthology.orchestra.run.smithi053.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50650.log.gz 2023-06-10T19:09:52.063 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65433.log 2023-06-10T19:09:52.063 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50813.log 2023-06-10T19:09:52.063 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.51899.log: /var/log/ceph/ceph-client.admin.65433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43816.log 2023-06-10T19:09:52.064 INFO:teuthology.orchestra.run.smithi053.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51899.log.gz 2023-06-10T19:09:52.064 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.50813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67547.log 2023-06-10T19:09:52.064 INFO:teuthology.orchestra.run.smithi053.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.65433.log.gz 2023-06-10T19:09:52.064 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53905.log 2023-06-10T19:09:52.064 INFO:teuthology.orchestra.run.smithi053.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50813.log.gz 2023-06-10T19:09:52.065 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.43816.log: /var/log/ceph/ceph-client.admin.67547.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43816.log.gz 2023-06-10T19:09:52.065 INFO:teuthology.orchestra.run.smithi053.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.67547.log.gz 2023-06-10T19:09:52.065 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59662.log 2023-06-10T19:09:52.065 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60897.log 2023-06-10T19:09:52.065 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.53905.log: /var/log/ceph/ceph-client.admin.59662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58503.log 2023-06-10T19:09:52.066 INFO:teuthology.orchestra.run.smithi053.stderr: 88.5%/var/log/ceph/ceph-client.admin.60897.log: gzip -5 89.5% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.59662.log.gz /var/log/ceph/ceph-client.admin.50108.log 2023-06-10T19:09:52.066 INFO:teuthology.orchestra.run.smithi053.stderr: 2023-06-10T19:09:52.066 INFO:teuthology.orchestra.run.smithi053.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53905.log.gz 2023-06-10T19:09:52.066 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.58503.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.60897.log.gz 2023-06-10T19:09:52.066 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59469.log 2023-06-10T19:09:52.067 INFO:teuthology.orchestra.run.smithi053.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.58503.log.gz 2023-06-10T19:09:52.067 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68285.log 2023-06-10T19:09:52.067 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.50108.log: /var/log/ceph/ceph-client.admin.59469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66378.log 2023-06-10T19:09:52.067 INFO:teuthology.orchestra.run.smithi053.stderr: 88.3%/var/log/ceph/ceph-client.admin.68285.log: -- replaced with /var/log/ceph/ceph-client.admin.50108.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58410.log 2023-06-10T19:09:52.067 INFO:teuthology.orchestra.run.smithi053.stderr: 2023-06-10T19:09:52.068 INFO:teuthology.orchestra.run.smithi053.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.59469.log.gz 2023-06-10T19:09:52.068 INFO:teuthology.orchestra.run.smithi053.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.68285.log.gz 2023-06-10T19:09:52.068 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.66378.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.66378.log.gz 2023-06-10T19:09:52.068 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48663.log 2023-06-10T19:09:52.068 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.58410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63032.log 2023-06-10T19:09:52.069 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.48663.log: gzip -5 --verbose -- 88.0% /var/log/ceph/ceph-client.admin.53588.log 2023-06-10T19:09:52.069 INFO:teuthology.orchestra.run.smithi053.stderr: -- replaced with /var/log/ceph/ceph-client.admin.58410.log.gz 2023-06-10T19:09:52.069 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.63032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48059.log 2023-06-10T19:09:52.069 INFO:teuthology.orchestra.run.smithi053.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48663.log.gz 2023-06-10T19:09:52.069 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.53588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61783.log 2023-06-10T19:09:52.069 INFO:teuthology.orchestra.run.smithi053.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.63032.log.gz 2023-06-10T19:09:52.070 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46579.log 2023-06-10T19:09:52.070 INFO:teuthology.orchestra.run.smithi053.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53588.log.gz 2023-06-10T19:09:52.070 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.48059.log: /var/log/ceph/ceph-client.admin.61783.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48059.log.gz 2023-06-10T19:09:52.070 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65921.log 2023-06-10T19:09:52.070 INFO:teuthology.orchestra.run.smithi053.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.61783.log.gz 2023-06-10T19:09:52.071 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.46579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71945.log 2023-06-10T19:09:52.071 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.65921.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.46579.log.gz 2023-06-10T19:09:52.071 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50959.log 2023-06-10T19:09:52.071 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.71945.log: 88.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57406.log 2023-06-10T19:09:52.071 INFO:teuthology.orchestra.run.smithi053.stderr: -- replaced with /var/log/ceph/ceph-client.admin.65921.log.gz 2023-06-10T19:09:52.072 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.50959.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.71945.log.gz 2023-06-10T19:09:52.072 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66432.log 2023-06-10T19:09:52.072 INFO:teuthology.orchestra.run.smithi053.stderr: 88.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58467.log 2023-06-10T19:09:52.072 INFO:teuthology.orchestra.run.smithi053.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50959.log.gz/var/log/ceph/ceph-client.admin.57406.log: 2023-06-10T19:09:52.072 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.66432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55979.log 2023-06-10T19:09:52.073 INFO:teuthology.orchestra.run.smithi053.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.57406.log.gz 2023-06-10T19:09:52.073 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54653.log 2023-06-10T19:09:52.073 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.58467.log: /var/log/ceph/ceph-client.admin.55979.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.66432.log.gz 2023-06-10T19:09:52.073 INFO:teuthology.orchestra.run.smithi053.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.58467.log.gz 2023-06-10T19:09:52.073 INFO:teuthology.orchestra.run.smithi053.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.55979.log.gz 2023-06-10T19:09:52.074 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65843.log 2023-06-10T19:09:52.074 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.54653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45314.log 2023-06-10T19:09:52.074 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.65843.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54653.log.gz 2023-06-10T19:09:52.074 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46423.log 2023-06-10T19:09:52.074 INFO:teuthology.orchestra.run.smithi053.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.65843.log.gz 2023-06-10T19:09:52.074 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.45314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65745.log 2023-06-10T19:09:52.075 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.46423.log: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69724.log 2023-06-10T19:09:52.075 INFO:teuthology.orchestra.run.smithi053.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45314.log.gz 2023-06-10T19:09:52.075 INFO:teuthology.orchestra.run.smithi053.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46423.log.gz 2023-06-10T19:09:52.075 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.65745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55666.log 2023-06-10T19:09:52.075 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45893.log 2023-06-10T19:09:52.076 INFO:teuthology.orchestra.run.smithi053.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.65745.log.gz 2023-06-10T19:09:52.076 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.69724.log: /var/log/ceph/ceph-client.admin.55666.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.69724.log.gz 2023-06-10T19:09:52.076 INFO:teuthology.orchestra.run.smithi053.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55666.log.gz 2023-06-10T19:09:52.076 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55796.log 2023-06-10T19:09:52.076 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.45893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65777.log 2023-06-10T19:09:52.077 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.55796.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45893.log.gz 2023-06-10T19:09:52.077 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68555.log 2023-06-10T19:09:52.077 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.65777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55376.log 2023-06-10T19:09:52.077 INFO:teuthology.orchestra.run.smithi053.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.55796.log.gz 2023-06-10T19:09:52.077 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58973.log 2023-06-10T19:09:52.078 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.68555.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.65777.log.gz 2023-06-10T19:09:52.078 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.55376.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.68555.log.gz 2023-06-10T19:09:52.078 INFO:teuthology.orchestra.run.smithi053.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.55376.log.gz 2023-06-10T19:09:52.078 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56488.log 2023-06-10T19:09:52.078 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55692.log 2023-06-10T19:09:52.079 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.58973.log: /var/log/ceph/ceph-client.admin.56488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46371.log 2023-06-10T19:09:52.079 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.55692.log: gzip -5 --verbose 87.9% -- /var/log/ceph/ceph-client.admin.42958.log -- replaced with /var/log/ceph/ceph-client.admin.56488.log.gz 2023-06-10T19:09:52.079 INFO:teuthology.orchestra.run.smithi053.stderr: 2023-06-10T19:09:52.079 INFO:teuthology.orchestra.run.smithi053.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.58973.log.gz 2023-06-10T19:09:52.079 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.46371.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.55692.log.gz 2023-06-10T19:09:52.080 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66406.log 2023-06-10T19:09:52.080 INFO:teuthology.orchestra.run.smithi053.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46371.log.gz 2023-06-10T19:09:52.080 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56845.log 2023-06-10T19:09:52.080 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.42958.log: /var/log/ceph/ceph-client.admin.66406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44102.log 2023-06-10T19:09:52.080 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.56845.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.66406.log.gz 2023-06-10T19:09:52.081 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60128.log 2023-06-10T19:09:52.081 INFO:teuthology.orchestra.run.smithi053.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42958.log.gz 2023-06-10T19:09:52.081 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.44102.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.56845.log.gz 2023-06-10T19:09:52.081 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67365.log 2023-06-10T19:09:52.081 INFO:teuthology.orchestra.run.smithi053.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44102.log.gz 2023-06-10T19:09:52.082 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55142.log 2023-06-10T19:09:52.082 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.60128.log: /var/log/ceph/ceph-client.admin.67365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70564.log 2023-06-10T19:09:52.082 INFO:teuthology.orchestra.run.smithi053.stderr: 87.5%/var/log/ceph/ceph-client.admin.55142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49663.log 2023-06-10T19:09:52.082 INFO:teuthology.orchestra.run.smithi053.stderr: -- replaced with /var/log/ceph/ceph-client.admin.67365.log.gz 2023-06-10T19:09:52.083 INFO:teuthology.orchestra.run.smithi053.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.60128.log.gz 2023-06-10T19:09:52.083 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.70564.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.55142.log.gz 2023-06-10T19:09:52.083 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61106.log 2023-06-10T19:09:52.083 INFO:teuthology.orchestra.run.smithi053.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.70564.log.gz 2023-06-10T19:09:52.083 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44813.log 2023-06-10T19:09:52.084 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.49663.log: /var/log/ceph/ceph-client.admin.61106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55848.log 2023-06-10T19:09:52.084 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.44813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68129.log 2023-06-10T19:09:52.084 INFO:teuthology.orchestra.run.smithi053.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.61106.log.gz 89.7% 2023-06-10T19:09:52.084 INFO:teuthology.orchestra.run.smithi053.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49663.log.gz 2023-06-10T19:09:52.084 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.55848.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44813.log.gz 2023-06-10T19:09:52.085 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53536.log 2023-06-10T19:09:52.085 INFO:teuthology.orchestra.run.smithi053.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55848.log.gz 2023-06-10T19:09:52.085 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48320.log 2023-06-10T19:09:52.085 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.68129.log: /var/log/ceph/ceph-client.admin.53536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52277.log 2023-06-10T19:09:52.086 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.48320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71841.log 2023-06-10T19:09:52.086 INFO:teuthology.orchestra.run.smithi053.stderr: 89.0% 89.2% -- replaced with /var/log/ceph/ceph-client.admin.68129.log.gz 2023-06-10T19:09:52.086 INFO:teuthology.orchestra.run.smithi053.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53536.log.gz 2023-06-10T19:09:52.086 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.52277.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48320.log.gz 2023-06-10T19:09:52.086 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55562.log 2023-06-10T19:09:52.087 INFO:teuthology.orchestra.run.smithi053.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52277.log.gz 2023-06-10T19:09:52.087 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71176.log 2023-06-10T19:09:52.087 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.71841.log: /var/log/ceph/ceph-client.admin.55562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43211.log 2023-06-10T19:09:52.087 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.71176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52225.log 2023-06-10T19:09:52.087 INFO:teuthology.orchestra.run.smithi053.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.71841.log.gz 2023-06-10T19:09:52.088 INFO:teuthology.orchestra.run.smithi053.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.55562.log.gz 2023-06-10T19:09:52.088 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.43211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60845.log 2023-06-10T19:09:52.088 INFO:teuthology.orchestra.run.smithi053.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.71176.log.gz 2023-06-10T19:09:52.088 INFO:teuthology.orchestra.run.smithi053.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43211.log.gz 2023-06-10T19:09:52.088 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55536.log 2023-06-10T19:09:52.089 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.52225.log: /var/log/ceph/ceph-client.admin.60845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71469.log 2023-06-10T19:09:52.089 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.55536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61731.log 2023-06-10T19:09:52.089 INFO:teuthology.orchestra.run.smithi053.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.60845.log.gz 2023-06-10T19:09:52.089 INFO:teuthology.orchestra.run.smithi053.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52225.log.gz 2023-06-10T19:09:52.089 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.71469.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.55536.log.gz 2023-06-10T19:09:52.090 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63848.log 2023-06-10T19:09:52.090 INFO:teuthology.orchestra.run.smithi053.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.71469.log.gz 2023-06-10T19:09:52.090 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65251.log 2023-06-10T19:09:52.090 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.61731.log: /var/log/ceph/ceph-client.admin.63848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64957.log 2023-06-10T19:09:52.090 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.65251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67417.log 2023-06-10T19:09:52.091 INFO:teuthology.orchestra.run.smithi053.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.63848.log.gz 2023-06-10T19:09:52.091 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.64957.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.65251.log.gz 2023-06-10T19:09:52.091 INFO:teuthology.orchestra.run.smithi053.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.61731.log.gz 2023-06-10T19:09:52.091 INFO:teuthology.orchestra.run.smithi053.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.64957.log.gz 2023-06-10T19:09:52.091 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60389.log 2023-06-10T19:09:52.092 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46891.log 2023-06-10T19:09:52.092 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.67417.log: /var/log/ceph/ceph-client.admin.60389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71547.log 2023-06-10T19:09:52.092 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.46891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50881.log 2023-06-10T19:09:52.092 INFO:teuthology.orchestra.run.smithi053.stderr: 89.4% 89.2% -- replaced with /var/log/ceph/ceph-client.admin.67417.log.gz -- replaced with /var/log/ceph/ceph-client.admin.60389.log.gz 2023-06-10T19:09:52.092 INFO:teuthology.orchestra.run.smithi053.stderr: 2023-06-10T19:09:52.093 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.71547.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46891.log.gz 2023-06-10T19:09:52.093 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47197.log 2023-06-10T19:09:52.093 INFO:teuthology.orchestra.run.smithi053.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.71547.log.gz 2023-06-10T19:09:52.093 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63560.log 2023-06-10T19:09:52.093 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.47197.log: /var/log/ceph/ceph-client.admin.50881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67391.log 2023-06-10T19:09:52.094 INFO:teuthology.orchestra.run.smithi053.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47197.log.gz 2023-06-10T19:09:52.094 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.63560.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50881.log.gz 2023-06-10T19:09:52.094 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55718.log 2023-06-10T19:09:52.094 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.67391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47523.log 2023-06-10T19:09:52.094 INFO:teuthology.orchestra.run.smithi053.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.63560.log.gz 2023-06-10T19:09:52.095 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.55718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55953.log 2023-06-10T19:09:52.095 INFO:teuthology.orchestra.run.smithi053.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.67391.log.gz 2023-06-10T19:09:52.095 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47679.log 2023-06-10T19:09:52.095 INFO:teuthology.orchestra.run.smithi053.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.55718.log.gz/var/log/ceph/ceph-client.admin.47523.log: 2023-06-10T19:09:52.095 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.55953.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-06-10T19:09:52.096 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.47679.log: 89.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69672.log 2023-06-10T19:09:52.096 INFO:teuthology.orchestra.run.smithi053.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47523.log.gz 2023-06-10T19:09:52.096 INFO:teuthology.orchestra.run.smithi053.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.55953.log.gz 2023-06-10T19:09:52.096 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50162.log 2023-06-10T19:09:52.096 INFO:teuthology.orchestra.run.smithi053.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47679.log.gz 2023-06-10T19:09:52.096 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53484.log 2023-06-10T19:09:52.097 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.69672.log: /var/log/ceph/ceph-client.admin.50162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70432.log 2023-06-10T19:09:52.097 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.53484.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.69672.log.gz 2023-06-10T19:09:52.097 INFO:teuthology.orchestra.run.smithi053.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50162.log.gz 2023-06-10T19:09:52.097 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63006.log 2023-06-10T19:09:52.097 INFO:teuthology.orchestra.run.smithi053.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53484.log.gz 2023-06-10T19:09:52.098 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57781.log 2023-06-10T19:09:52.098 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.70432.log: /var/log/ceph/ceph-client.admin.63006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51094.log 2023-06-10T19:09:52.098 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.57781.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.70432.log.gz 2023-06-10T19:09:52.098 INFO:teuthology.orchestra.run.smithi053.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.63006.log.gz 2023-06-10T19:09:52.098 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61861.log 2023-06-10T19:09:52.099 INFO:teuthology.orchestra.run.smithi053.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.57781.log.gz 2023-06-10T19:09:52.099 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.51094.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51094.log.gz 2023-06-10T19:09:52.099 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68711.log 2023-06-10T19:09:52.099 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51305.log 2023-06-10T19:09:52.099 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.61861.log: /var/log/ceph/ceph-client.admin.68711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57807.log 2023-06-10T19:09:52.100 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.51305.log: 88.9% 88.8% -- replaced with /var/log/ceph/ceph-client.admin.61861.log.gz 2023-06-10T19:09:52.100 INFO:teuthology.orchestra.run.smithi053.stderr: -- replaced with /var/log/ceph/ceph-client.admin.68711.log.gz 2023-06-10T19:09:52.100 INFO:teuthology.orchestra.run.smithi053.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51305.log.gz 2023-06-10T19:09:52.100 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49952.log 2023-06-10T19:09:52.100 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54497.log 2023-06-10T19:09:52.101 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.57807.log: /var/log/ceph/ceph-client.admin.49952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66747.log 2023-06-10T19:09:52.101 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.54497.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.57807.log.gz 2023-06-10T19:09:52.101 INFO:teuthology.orchestra.run.smithi053.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49952.log.gz 2023-06-10T19:09:52.101 INFO:teuthology.orchestra.run.smithi053.stderr: 88.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65948.log 2023-06-10T19:09:52.101 INFO:teuthology.orchestra.run.smithi053.stderr: -- replaced with /var/log/ceph/ceph-client.admin.54497.log.gz 2023-06-10T19:09:52.102 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66090.log 2023-06-10T19:09:52.102 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.66747.log: /var/log/ceph/ceph-client.admin.65948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44943.log 2023-06-10T19:09:52.102 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.66090.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.66747.log.gz 2023-06-10T19:09:52.102 INFO:teuthology.orchestra.run.smithi053.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.65948.log.gz 2023-06-10T19:09:52.102 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66002.log 2023-06-10T19:09:52.103 INFO:teuthology.orchestra.run.smithi053.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.66090.log.gz 2023-06-10T19:09:52.103 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.44943.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44943.log.gz 2023-06-10T19:09:52.103 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56436.log 2023-06-10T19:09:52.103 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.66002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66695.log 2023-06-10T19:09:52.103 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.56436.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.66002.log.gz 2023-06-10T19:09:52.103 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45524.log 2023-06-10T19:09:52.104 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46839.log 2023-06-10T19:09:52.104 INFO:teuthology.orchestra.run.smithi053.stderr: 89.4%/var/log/ceph/ceph-client.admin.66695.log: -- replaced with /var/log/ceph/ceph-client.admin.56436.log.gz 2023-06-10T19:09:52.104 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.45524.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.66695.log.gz 2023-06-10T19:09:52.104 INFO:teuthology.orchestra.run.smithi053.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45524.log.gz 2023-06-10T19:09:52.104 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68737.log 2023-06-10T19:09:52.105 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58791.log 2023-06-10T19:09:52.105 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.46839.log: /var/log/ceph/ceph-client.admin.68737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60689.log 2023-06-10T19:09:52.105 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.58791.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46839.log.gz 2023-06-10T19:09:52.105 INFO:teuthology.orchestra.run.smithi053.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.68737.log.gz 2023-06-10T19:09:52.105 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66830.log 2023-06-10T19:09:52.106 INFO:teuthology.orchestra.run.smithi053.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.58791.log.gz 2023-06-10T19:09:52.106 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59391.log 2023-06-10T19:09:52.106 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.60689.log: /var/log/ceph/ceph-client.admin.66830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65170.log 2023-06-10T19:09:52.106 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.59391.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.60689.log.gz 2023-06-10T19:09:52.106 INFO:teuthology.orchestra.run.smithi053.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.66830.log.gz 2023-06-10T19:09:52.107 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58609.log 2023-06-10T19:09:52.107 INFO:teuthology.orchestra.run.smithi053.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.59391.log.gz 2023-06-10T19:09:52.107 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57432.log 2023-06-10T19:09:52.107 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.65170.log: /var/log/ceph/ceph-client.admin.58609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62520.log 2023-06-10T19:09:52.107 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.57432.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.65170.log.gz 2023-06-10T19:09:52.108 INFO:teuthology.orchestra.run.smithi053.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.58609.log.gz 2023-06-10T19:09:52.108 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69457.log 2023-06-10T19:09:52.108 INFO:teuthology.orchestra.run.smithi053.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.57432.log.gz 2023-06-10T19:09:52.108 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59365.log 2023-06-10T19:09:52.108 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.62520.log: /var/log/ceph/ceph-client.admin.69457.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.62520.log.gz 2023-06-10T19:09:52.109 INFO:teuthology.orchestra.run.smithi053.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.69457.log.gz 2023-06-10T19:09:52.109 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56566.log 2023-06-10T19:09:52.109 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63815.log 2023-06-10T19:09:52.109 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.59365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58529.log 2023-06-10T19:09:52.109 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.56566.log: /var/log/ceph/ceph-client.admin.63815.log: 87.9% 88.1% -- replaced with /var/log/ceph/ceph-client.admin.59365.log.gz 2023-06-10T19:09:52.109 INFO:teuthology.orchestra.run.smithi053.stderr: -- replaced with /var/log/ceph/ceph-client.admin.56566.log.gz 2023-06-10T19:09:52.110 INFO:teuthology.orchestra.run.smithi053.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.63815.log.gz 2023-06-10T19:09:52.110 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57590.log 2023-06-10T19:09:52.110 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66300.log 2023-06-10T19:09:52.110 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.58529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64983.log 2023-06-10T19:09:52.110 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.57590.log: /var/log/ceph/ceph-client.admin.66300.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.58529.log.gz 2023-06-10T19:09:52.111 INFO:teuthology.orchestra.run.smithi053.stderr: 88.8% 91.1% -- replaced with /var/log/ceph/ceph-client.admin.57590.log.gz 2023-06-10T19:09:52.111 INFO:teuthology.orchestra.run.smithi053.stderr: -- replaced with /var/log/ceph/ceph-client.admin.66300.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70538.log 2023-06-10T19:09:52.111 INFO:teuthology.orchestra.run.smithi053.stderr: 2023-06-10T19:09:52.111 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.64983.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.64983.log.gz 2023-06-10T19:09:52.111 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63271.log 2023-06-10T19:09:52.112 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52355.log 2023-06-10T19:09:52.112 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.70538.log: /var/log/ceph/ceph-client.admin.63271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48163.log 2023-06-10T19:09:52.112 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.52355.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.70538.log.gz 2023-06-10T19:09:52.112 INFO:teuthology.orchestra.run.smithi053.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.63271.log.gz 2023-06-10T19:09:52.112 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50389.log 2023-06-10T19:09:52.113 INFO:teuthology.orchestra.run.smithi053.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52355.log.gz 2023-06-10T19:09:52.113 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.48163.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48163.log.gz 2023-06-10T19:09:52.113 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55022.log 2023-06-10T19:09:52.113 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45151.log 2023-06-10T19:09:52.113 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.50389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59610.log 2023-06-10T19:09:52.114 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.55022.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50389.log.gz/var/log/ceph/ceph-client.admin.45151.log: 2023-06-10T19:09:52.114 INFO:teuthology.orchestra.run.smithi053.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.55022.log.gz 2023-06-10T19:09:52.114 INFO:teuthology.orchestra.run.smithi053.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45151.log.gz 2023-06-10T19:09:52.114 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57694.log 2023-06-10T19:09:52.114 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.59610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60949.log 2023-06-10T19:09:52.115 INFO:teuthology.orchestra.run.smithi053.stderr: 87.8%/var/log/ceph/ceph-client.0.57694.log: -- replaced with /var/log/ceph/ceph-client.admin.59610.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61939.log 2023-06-10T19:09:52.115 INFO:teuthology.orchestra.run.smithi053.stderr: 2023-06-10T19:09:52.115 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.60949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43425.log 2023-06-10T19:09:52.115 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.61939.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.61939.log.gz 2023-06-10T19:09:52.115 INFO:teuthology.orchestra.run.smithi053.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.60949.log.gz 2023-06-10T19:09:52.116 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56514.log 2023-06-10T19:09:52.116 INFO:teuthology.orchestra.run.smithi053.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.57694.log.gz 2023-06-10T19:09:52.116 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.43425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65329.log 2023-06-10T19:09:52.116 INFO:teuthology.orchestra.run.smithi053.stderr: 87.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57911.log 2023-06-10T19:09:52.116 INFO:teuthology.orchestra.run.smithi053.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43425.log.gz 2023-06-10T19:09:52.117 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.56514.log: /var/log/ceph/ceph-client.admin.65329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72355.log 2023-06-10T19:09:52.117 INFO:teuthology.orchestra.run.smithi053.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.56514.log.gz 2023-06-10T19:09:52.117 INFO:teuthology.orchestra.run.smithi053.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.65329.log.gz 2023-06-10T19:09:52.117 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.57911.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.57911.log.gz 2023-06-10T19:09:52.117 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59077.log 2023-06-10T19:09:52.118 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.72355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64635.log 2023-06-10T19:09:52.118 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.59077.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.72355.log.gz 2023-06-10T19:09:52.118 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52041.log 2023-06-10T19:09:52.118 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.64635.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.59077.log.gz 2023-06-10T19:09:52.118 INFO:teuthology.orchestra.run.smithi053.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.64635.log.gz 2023-06-10T19:09:52.119 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61494.log 2023-06-10T19:09:52.119 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64324.log 2023-06-10T19:09:52.119 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.52041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43217.log 2023-06-10T19:09:52.119 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.61494.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.61494.log.gz 2023-06-10T19:09:52.119 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.64324.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52041.log.gz 2023-06-10T19:09:52.120 INFO:teuthology.orchestra.run.smithi053.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.64324.log.gz 2023-06-10T19:09:52.120 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63685.log 2023-06-10T19:09:52.120 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.43217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56005.log 2023-06-10T19:09:52.120 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.63685.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43217.log.gz 2023-06-10T19:09:52.120 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57512.log 2023-06-10T19:09:52.121 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59183.log 2023-06-10T19:09:52.121 INFO:teuthology.orchestra.run.smithi053.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.63685.log.gz 2023-06-10T19:09:52.121 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.56005.log: /var/log/ceph/ceph-client.admin.57512.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56005.log.gz 2023-06-10T19:09:52.121 INFO:teuthology.orchestra.run.smithi053.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.57512.log.gz 2023-06-10T19:09:52.121 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54045.log 2023-06-10T19:09:52.122 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51279.log 2023-06-10T19:09:52.122 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.59183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69316.log 2023-06-10T19:09:52.122 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.54045.log: /var/log/ceph/ceph-client.admin.51279.log: 88.4% 88.1% -- replaced with /var/log/ceph/ceph-client.admin.59183.log.gz 2023-06-10T19:09:52.122 INFO:teuthology.orchestra.run.smithi053.stderr: -- replaced with /var/log/ceph/ceph-client.admin.54045.log.gz 2023-06-10T19:09:52.122 INFO:teuthology.orchestra.run.smithi053.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51279.log.gz 2023-06-10T19:09:52.123 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51409.log 2023-06-10T19:09:52.123 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70642.log 2023-06-10T19:09:52.123 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.69316.log: /var/log/ceph/ceph-client.admin.51409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48190.log 2023-06-10T19:09:52.123 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.70642.log: 88.3% 87.8% -- replaced with /var/log/ceph/ceph-client.admin.69316.log.gz 2023-06-10T19:09:52.123 INFO:teuthology.orchestra.run.smithi053.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51409.log.gz 2023-06-10T19:09:52.123 INFO:teuthology.orchestra.run.smithi053.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.70642.log.gz 2023-06-10T19:09:52.124 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51068.log 2023-06-10T19:09:52.124 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49521.log 2023-06-10T19:09:52.124 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.48190.log: /var/log/ceph/ceph-client.admin.51068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65303.log 2023-06-10T19:09:52.124 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.49521.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.48190.log.gz 2023-06-10T19:09:52.124 INFO:teuthology.orchestra.run.smithi053.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51068.log.gz 2023-06-10T19:09:52.125 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56355.log 2023-06-10T19:09:52.125 INFO:teuthology.orchestra.run.smithi053.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49521.log.gz 2023-06-10T19:09:52.125 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63136.log 2023-06-10T19:09:52.125 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.65303.log: /var/log/ceph/ceph-client.admin.56355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71971.log 2023-06-10T19:09:52.125 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.63136.log: 88.9% 88.3% -- replaced with /var/log/ceph/ceph-client.admin.65303.log.gz 2023-06-10T19:09:52.126 INFO:teuthology.orchestra.run.smithi053.stderr: -- replaced with /var/log/ceph/ceph-client.admin.56355.log.gz 2023-06-10T19:09:52.126 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53562.log 2023-06-10T19:09:52.126 INFO:teuthology.orchestra.run.smithi053.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.63136.log.gz 2023-06-10T19:09:52.126 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.71971.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.71971.log.gz 2023-06-10T19:09:52.126 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66968.log 2023-06-10T19:09:52.127 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61385.log 2023-06-10T19:09:52.127 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.53562.log: /var/log/ceph/ceph-client.admin.66968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63534.log 2023-06-10T19:09:52.127 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.61385.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53562.log.gz 2023-06-10T19:09:52.127 INFO:teuthology.orchestra.run.smithi053.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.66968.log.gz 2023-06-10T19:09:52.127 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46397.log 2023-06-10T19:09:52.128 INFO:teuthology.orchestra.run.smithi053.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.61385.log.gz 2023-06-10T19:09:52.128 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54627.log 2023-06-10T19:09:52.128 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.63534.log: /var/log/ceph/ceph-client.admin.46397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46735.log 2023-06-10T19:09:52.128 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.54627.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.46397.log.gz 2023-06-10T19:09:52.128 INFO:teuthology.orchestra.run.smithi053.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.63534.log.gz 2023-06-10T19:09:52.129 INFO:teuthology.orchestra.run.smithi053.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.54627.log.gz 2023-06-10T19:09:52.129 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53745.log 2023-06-10T19:09:52.129 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72667.log 2023-06-10T19:09:52.129 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.46735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48403.log 2023-06-10T19:09:52.129 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.53745.log: /var/log/ceph/ceph-client.admin.72667.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53745.log.gz 2023-06-10T19:09:52.129 INFO:teuthology.orchestra.run.smithi053.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46735.log.gz 2023-06-10T19:09:52.130 INFO:teuthology.orchestra.run.smithi053.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.72667.log.gz 2023-06-10T19:09:52.130 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46051.log 2023-06-10T19:09:52.130 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.48403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48771.log 2023-06-10T19:09:52.130 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.46051.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48403.log.gz 2023-06-10T19:09:52.130 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42984.log 2023-06-10T19:09:52.131 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51873.log 2023-06-10T19:09:52.131 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.48771.log: /var/log/ceph/ceph-client.admin.42984.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46051.log.gz 2023-06-10T19:09:52.131 INFO:teuthology.orchestra.run.smithi053.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48771.log.gz 2023-06-10T19:09:52.131 INFO:teuthology.orchestra.run.smithi053.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42984.log.gz 2023-06-10T19:09:52.131 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47145.log 2023-06-10T19:09:52.132 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67881.log 2023-06-10T19:09:52.132 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.51873.log: /var/log/ceph/ceph-client.admin.47145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53018.log 2023-06-10T19:09:52.132 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.67881.log: 88.2% 89.4% -- replaced with /var/log/ceph/ceph-client.admin.51873.log.gz 2023-06-10T19:09:52.132 INFO:teuthology.orchestra.run.smithi053.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47145.log.gz 2023-06-10T19:09:52.132 INFO:teuthology.orchestra.run.smithi053.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.67881.log.gz 2023-06-10T19:09:52.133 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52329.log 2023-06-10T19:09:52.133 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52940.log 2023-06-10T19:09:52.133 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.53018.log: /var/log/ceph/ceph-client.admin.52329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43215.log 2023-06-10T19:09:52.133 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.52940.log: 88.5% 89.4% -- replaced with /var/log/ceph/ceph-client.admin.53018.log.gz 2023-06-10T19:09:52.133 INFO:teuthology.orchestra.run.smithi053.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52329.log.gz 2023-06-10T19:09:52.134 INFO:teuthology.orchestra.run.smithi053.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.52940.log.gz 2023-06-10T19:09:52.134 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68363.log 2023-06-10T19:09:52.134 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48216.log 2023-06-10T19:09:52.204 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.68363.log: /var/log/ceph/ceph-client.admin.43215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44128.log 2023-06-10T19:09:52.204 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.48216.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43215.log.gz 2023-06-10T19:09:52.205 INFO:teuthology.orchestra.run.smithi053.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.68363.log.gz 2023-06-10T19:09:52.205 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 89.1% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.48216.log.gz /var/log/ceph/ceph-client.admin.69568.log 2023-06-10T19:09:52.205 INFO:teuthology.orchestra.run.smithi053.stderr: 2023-06-10T19:09:52.205 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54549.log 2023-06-10T19:09:52.205 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.44128.log: /var/log/ceph/ceph-client.admin.69568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58253.log 2023-06-10T19:09:52.206 INFO:teuthology.orchestra.run.smithi053.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44128.log.gz 2023-06-10T19:09:52.206 INFO:teuthology.orchestra.run.smithi053.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.69568.log.gz 2023-06-10T19:09:52.206 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.54549.log: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47171.log 2023-06-10T19:09:52.206 INFO:teuthology.orchestra.run.smithi053.stderr: -- replaced with /var/log/ceph/ceph-client.admin.54549.log.gz 2023-06-10T19:09:52.206 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.58253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70088.log 2023-06-10T19:09:52.207 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.47171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67046.log 2023-06-10T19:09:52.207 INFO:teuthology.orchestra.run.smithi053.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.58253.log.gz 2023-06-10T19:09:52.207 INFO:teuthology.orchestra.run.smithi053.stderr: 87.8%/var/log/ceph/ceph-client.admin.70088.log: -- replaced with /var/log/ceph/ceph-client.admin.47171.log.gz 2023-06-10T19:09:52.207 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67521.log 2023-06-10T19:09:52.207 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.67046.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.70088.log.gz 2023-06-10T19:09:52.208 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71340.log 2023-06-10T19:09:52.208 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.67521.log: 88.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45711.log 2023-06-10T19:09:52.208 INFO:teuthology.orchestra.run.smithi053.stderr: -- replaced with /var/log/ceph/ceph-client.admin.67046.log.gz 2023-06-10T19:09:52.208 INFO:teuthology.orchestra.run.smithi053.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.67521.log.gz 2023-06-10T19:09:52.208 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.0.71340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60715.log 2023-06-10T19:09:52.209 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.45711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72589.log 2023-06-10T19:09:52.209 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.60715.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45711.log.gz 2023-06-10T19:09:52.209 INFO:teuthology.orchestra.run.smithi053.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.60715.log.gz 2023-06-10T19:09:52.209 INFO:teuthology.orchestra.run.smithi053.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.0.71340.log.gz 2023-06-10T19:09:52.209 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57054.log 2023-06-10T19:09:52.210 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.72589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47783.log 2023-06-10T19:09:52.210 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.57054.log: 88.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46605.log 2023-06-10T19:09:52.210 INFO:teuthology.orchestra.run.smithi053.stderr: -- replaced with /var/log/ceph/ceph-client.admin.72589.log.gz 2023-06-10T19:09:52.210 INFO:teuthology.orchestra.run.smithi053.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.57054.log.gz 2023-06-10T19:09:52.210 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.47783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59339.log 2023-06-10T19:09:52.211 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.46605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57002.log 2023-06-10T19:09:52.211 INFO:teuthology.orchestra.run.smithi053.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.47783.log.gz 2023-06-10T19:09:52.211 INFO:teuthology.orchestra.run.smithi053.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46605.log.gz 2023-06-10T19:09:52.211 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71286.log 2023-06-10T19:09:52.211 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.59339.log: /var/log/ceph/ceph-client.admin.57002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55482.log 2023-06-10T19:09:52.212 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.71286.log: 89.3% 89.2% -- replaced with /var/log/ceph/ceph-client.admin.59339.log.gz 2023-06-10T19:09:52.212 INFO:teuthology.orchestra.run.smithi053.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57002.log.gz 2023-06-10T19:09:52.212 INFO:teuthology.orchestra.run.smithi053.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.71286.log.gz 2023-06-10T19:09:52.212 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45550.log 2023-06-10T19:09:52.212 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42932.log 2023-06-10T19:09:52.213 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.55482.log: /var/log/ceph/ceph-client.admin.45550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71630.log 2023-06-10T19:09:52.213 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.42932.log: 88.2% 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45550.log.gz -- replaced with /var/log/ceph/ceph-client.admin.55482.log.gz 2023-06-10T19:09:52.213 INFO:teuthology.orchestra.run.smithi053.stderr: 2023-06-10T19:09:52.213 INFO:teuthology.orchestra.run.smithi053.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42932.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62574.log 2023-06-10T19:09:52.213 INFO:teuthology.orchestra.run.smithi053.stderr: 2023-06-10T19:09:52.214 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.71630.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-06-10T19:09:52.214 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 88.3% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.71630.log.gz /var/log/ceph/ceph-client.admin.49873.log 2023-06-10T19:09:52.214 INFO:teuthology.orchestra.run.smithi053.stderr: 2023-06-10T19:09:52.214 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.62574.log: /var/log/ceph/ceph.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.62574.log.gz 2023-06-10T19:09:52.214 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68233.log 2023-06-10T19:09:52.215 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61705.log 2023-06-10T19:09:52.215 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.68233.log: /var/log/ceph/ceph-client.admin.49873.log: 87.6% 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49873.log.gz 2023-06-10T19:09:52.215 INFO:teuthology.orchestra.run.smithi053.stderr: -- replaced with /var/log/ceph/ceph-client.admin.68233.log.gz 2023-06-10T19:09:52.215 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62837.log 2023-06-10T19:09:52.215 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58279.log 2023-06-10T19:09:52.216 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.61705.log: /var/log/ceph/ceph-client.0.62837.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.61705.log.gz 2023-06-10T19:09:52.216 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47887.log 2023-06-10T19:09:52.216 INFO:teuthology.orchestra.run.smithi053.stderr: 87.5% -- replaced with /var/log/ceph/ceph.log.gz 2023-06-10T19:09:52.216 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.58279.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.58279.log.gz 2023-06-10T19:09:52.216 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60609.log 2023-06-10T19:09:52.217 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44683.log 2023-06-10T19:09:52.217 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.0.47887.log: /var/log/ceph/ceph-client.admin.60609.log: 91.8% -- replaced with /var/log/ceph/ceph-client.0.62837.log.gz 2023-06-10T19:09:52.217 INFO:teuthology.orchestra.run.smithi053.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.60609.log.gz 2023-06-10T19:09:52.217 INFO:teuthology.orchestra.run.smithi053.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.0.47887.log.gz 2023-06-10T19:09:52.217 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52431.log 2023-06-10T19:09:52.218 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57989.log 2023-06-10T19:09:52.218 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.44683.log: /var/log/ceph/ceph-client.admin.52431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56057.log 2023-06-10T19:09:52.218 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.57989.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44683.log.gz 2023-06-10T19:09:52.218 INFO:teuthology.orchestra.run.smithi053.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.52431.log.gz 2023-06-10T19:09:52.218 INFO:teuthology.orchestra.run.smithi053.stderr: 89.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.57989.log.gz 2023-06-10T19:09:52.219 INFO:teuthology.orchestra.run.smithi053.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.57963.log 2023-06-10T19:09:52.219 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72693.log 2023-06-10T19:09:52.219 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.56057.log: /var/log/ceph/ceph-client.admin.57963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65895.log 2023-06-10T19:09:52.219 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.72693.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.56057.log.gz 2023-06-10T19:09:52.219 INFO:teuthology.orchestra.run.smithi053.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.57963.log.gz 2023-06-10T19:09:52.220 INFO:teuthology.orchestra.run.smithi053.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.72693.log.gz 2023-06-10T19:09:52.220 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48637.log 2023-06-10T19:09:52.220 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60467.log 2023-06-10T19:09:52.220 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.65895.log: /var/log/ceph/ceph-client.admin.48637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62548.log 2023-06-10T19:09:52.220 INFO:teuthology.orchestra.run.smithi053.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.65895.log.gz 2023-06-10T19:09:52.221 INFO:teuthology.orchestra.run.smithi053.stderr: 88.6%/var/log/ceph/ceph-client.admin.60467.log: -- replaced with /var/log/ceph/ceph-client.admin.48637.log.gz 2023-06-10T19:09:52.221 INFO:teuthology.orchestra.run.smithi053.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.60467.log.gz 2023-06-10T19:09:52.221 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52538.log 2023-06-10T19:09:52.221 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.62548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69368.log 2023-06-10T19:09:52.221 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.52538.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.62548.log.gz 2023-06-10T19:09:52.222 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55246.log 2023-06-10T19:09:52.222 INFO:teuthology.orchestra.run.smithi053.stderr: 88.7%/var/log/ceph/ceph-client.admin.69368.log: -- replaced with /var/log/ceph/ceph-client.admin.52538.log.gz 2023-06-10T19:09:52.222 INFO:teuthology.orchestra.run.smithi053.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.69368.log.gz 2023-06-10T19:09:52.222 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72329.log 2023-06-10T19:09:52.222 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46975.log 2023-06-10T19:09:52.223 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.55246.log: gzip/var/log/ceph/ceph-client.admin.72329.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.56793.log 2023-06-10T19:09:52.223 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.46975.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.55246.log.gz 2023-06-10T19:09:52.223 INFO:teuthology.orchestra.run.smithi053.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.72329.log.gz 2023-06-10T19:09:52.223 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66799.log 2023-06-10T19:09:52.223 INFO:teuthology.orchestra.run.smithi053.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46975.log.gz 2023-06-10T19:09:52.224 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54097.log 2023-06-10T19:09:52.224 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.56793.log: /var/log/ceph/ceph-client.admin.66799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70212.log 2023-06-10T19:09:52.224 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.54097.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.56793.log.gz 2023-06-10T19:09:52.224 INFO:teuthology.orchestra.run.smithi053.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.66799.log.gz 2023-06-10T19:09:52.224 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56277.log 2023-06-10T19:09:52.225 INFO:teuthology.orchestra.run.smithi053.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54097.log.gz 2023-06-10T19:09:52.225 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.70212.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.70212.log.gz 2023-06-10T19:09:52.225 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59550.log 2023-06-10T19:09:52.225 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62245.log 2023-06-10T19:09:52.225 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.56277.log: gzip/var/log/ceph/ceph-client.admin.59550.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.54393.log 2023-06-10T19:09:52.226 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.62245.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.59550.log.gz 2023-06-10T19:09:52.226 INFO:teuthology.orchestra.run.smithi053.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.56277.log.gz 2023-06-10T19:09:52.226 INFO:teuthology.orchestra.run.smithi053.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.62245.log.gz 2023-06-10T19:09:52.226 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58332.log 2023-06-10T19:09:52.226 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45919.log 2023-06-10T19:09:52.227 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.54393.log: gzip/var/log/ceph/ceph-client.admin.58332.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.71815.log 2023-06-10T19:09:52.227 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.45919.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54393.log.gz 2023-06-10T19:09:52.227 INFO:teuthology.orchestra.run.smithi053.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.58332.log.gz 2023-06-10T19:09:52.227 INFO:teuthology.orchestra.run.smithi053.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45919.log.gz 2023-06-10T19:09:52.227 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63245.log 2023-06-10T19:09:52.228 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63167.log 2023-06-10T19:09:52.228 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.71815.log: /var/log/ceph/ceph-client.admin.63245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51981.log 2023-06-10T19:09:52.228 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.63167.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.71815.log.gz 2023-06-10T19:09:52.228 INFO:teuthology.orchestra.run.smithi053.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.63245.log.gz 2023-06-10T19:09:52.228 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49085.log 2023-06-10T19:09:52.229 INFO:teuthology.orchestra.run.smithi053.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.63167.log.gz 2023-06-10T19:09:52.229 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67339.log 2023-06-10T19:09:52.229 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.51981.log: /var/log/ceph/ceph-client.admin.49085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64532.log 2023-06-10T19:09:52.229 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.67339.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51981.log.gz 2023-06-10T19:09:52.229 INFO:teuthology.orchestra.run.smithi053.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49085.log.gz 2023-06-10T19:09:52.230 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62923.log 2023-06-10T19:09:52.230 INFO:teuthology.orchestra.run.smithi053.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.67339.log.gz 2023-06-10T19:09:52.230 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58713.log 2023-06-10T19:09:52.230 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.0.64532.log: /var/log/ceph/ceph-client.admin.62923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58200.log 2023-06-10T19:09:52.230 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.58713.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.62923.log.gz 2023-06-10T19:09:52.231 INFO:teuthology.orchestra.run.smithi053.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.58713.log.gz 2023-06-10T19:09:52.231 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65511.log 2023-06-10T19:09:52.231 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50238.log 2023-06-10T19:09:52.231 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.58200.log: /var/log/ceph/ceph-client.admin.65511.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.58200.log.gz 2023-06-10T19:09:52.231 INFO:teuthology.orchestra.run.smithi053.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.65511.log.gz 2023-06-10T19:09:52.232 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59899.log 2023-06-10T19:09:52.232 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.50238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72511.log 2023-06-10T19:09:52.232 INFO:teuthology.orchestra.run.smithi053.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.0.64532.log.gz 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50238.log.gz 2023-06-10T19:09:52.232 INFO:teuthology.orchestra.run.smithi053.stderr: 2023-06-10T19:09:52.232 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.59899.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.59899.log.gz 2023-06-10T19:09:52.233 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51383.log 2023-06-10T19:09:52.233 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.72511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61653.log 2023-06-10T19:09:52.233 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.51383.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.72511.log.gz 2023-06-10T19:09:52.233 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50441.log 2023-06-10T19:09:52.233 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65035.log 2023-06-10T19:09:52.234 INFO:teuthology.orchestra.run.smithi053.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.51383.log.gz 2023-06-10T19:09:52.234 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.61653.log: /var/log/ceph/ceph-client.admin.50441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56031.log 2023-06-10T19:09:52.234 INFO:teuthology.orchestra.run.smithi053.stderr: 89.5%/var/log/ceph/ceph-client.admin.65035.log: -- replaced with /var/log/ceph/ceph-client.admin.50441.log.gz 2023-06-10T19:09:52.234 INFO:teuthology.orchestra.run.smithi053.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.61653.log.gz 2023-06-10T19:09:52.234 INFO:teuthology.orchestra.run.smithi053.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.65035.log.gz 2023-06-10T19:09:52.235 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43140.log 2023-06-10T19:09:52.235 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50188.log 2023-06-10T19:09:52.235 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.56031.log: /var/log/ceph/ceph-client.admin.43140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56618.log 2023-06-10T19:09:52.235 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.50188.log: 88.8% 88.8% -- replaced with /var/log/ceph/ceph-client.admin.56031.log.gz 2023-06-10T19:09:52.235 INFO:teuthology.orchestra.run.smithi053.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43140.log.gz 2023-06-10T19:09:52.235 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59795.log 2023-06-10T19:09:52.236 INFO:teuthology.orchestra.run.smithi053.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.50188.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61835.log 2023-06-10T19:09:52.236 INFO:teuthology.orchestra.run.smithi053.stderr: 2023-06-10T19:09:52.236 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.56618.log: /var/log/ceph/ceph-client.admin.59795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55298.log 2023-06-10T19:09:52.236 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.61835.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.56618.log.gz 2023-06-10T19:09:52.237 INFO:teuthology.orchestra.run.smithi053.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.59795.log.gz 2023-06-10T19:09:52.237 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51146.log 2023-06-10T19:09:52.237 INFO:teuthology.orchestra.run.smithi053.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.61835.log.gz 2023-06-10T19:09:52.237 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.55298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65712.log 2023-06-10T19:09:52.237 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.51146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47223.log 2023-06-10T19:09:52.238 INFO:teuthology.orchestra.run.smithi053.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.55298.log.gz 2023-06-10T19:09:52.238 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.65712.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51146.log.gz 2023-06-10T19:09:52.238 INFO:teuthology.orchestra.run.smithi053.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.65712.log.gz 2023-06-10T19:09:52.238 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44891.log 2023-06-10T19:09:52.238 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62088.log 2023-06-10T19:09:52.238 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.47223.log: /var/log/ceph/ceph-client.admin.44891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43629.log 2023-06-10T19:09:52.239 INFO:teuthology.orchestra.run.smithi053.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47223.log.gz 2023-06-10T19:09:52.239 INFO:teuthology.orchestra.run.smithi053.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44891.log.gz 2023-06-10T19:09:52.239 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.62088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61333.log 2023-06-10T19:09:52.239 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.43629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52381.log 2023-06-10T19:09:52.239 INFO:teuthology.orchestra.run.smithi053.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.62088.log.gz 2023-06-10T19:09:52.240 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.61333.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43629.log.gz 2023-06-10T19:09:52.240 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57833.log 2023-06-10T19:09:52.240 INFO:teuthology.orchestra.run.smithi053.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.61333.log.gz 2023-06-10T19:09:52.240 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56741.log 2023-06-10T19:09:52.240 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.52381.log: /var/log/ceph/ceph-client.admin.57833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72563.log 2023-06-10T19:09:52.241 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.56741.log: 90.8% 89.2% -- replaced with /var/log/ceph/ceph-client.admin.57833.log.gz 2023-06-10T19:09:52.241 INFO:teuthology.orchestra.run.smithi053.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52381.log.gz 2023-06-10T19:09:52.241 INFO:teuthology.orchestra.run.smithi053.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.56741.log.gz 2023-06-10T19:09:52.241 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69977.log 2023-06-10T19:09:52.241 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.72563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43868.log 2023-06-10T19:09:52.242 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.69977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72172.log 2023-06-10T19:09:52.242 INFO:teuthology.orchestra.run.smithi053.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.72563.log.gz 2023-06-10T19:09:52.242 INFO:teuthology.orchestra.run.smithi053.stderr: 88.5%/var/log/ceph/ceph-client.admin.43868.log: -- replaced with /var/log/ceph/ceph-client.admin.69977.log.gz 2023-06-10T19:09:52.242 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69535.log 2023-06-10T19:09:52.243 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.72172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71254.log 2023-06-10T19:09:52.243 INFO:teuthology.orchestra.run.smithi053.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43868.log.gz 2023-06-10T19:09:52.243 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.69535.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.72172.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43062.log 2023-06-10T19:09:52.243 INFO:teuthology.orchestra.run.smithi053.stderr: 2023-06-10T19:09:52.243 INFO:teuthology.orchestra.run.smithi053.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.69535.log.gz 2023-06-10T19:09:52.243 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.71254.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.71254.log.gz 2023-06-10T19:09:52.244 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62600.log 2023-06-10T19:09:52.244 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57028.log 2023-06-10T19:09:52.244 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.43062.log: /var/log/ceph/ceph-client.admin.62600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68607.log 2023-06-10T19:09:52.244 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.57028.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43062.log.gz 2023-06-10T19:09:52.244 INFO:teuthology.orchestra.run.smithi053.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.62600.log.gz 2023-06-10T19:09:52.245 INFO:teuthology.orchestra.run.smithi053.stderr: 88.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45255.log 2023-06-10T19:09:52.245 INFO:teuthology.orchestra.run.smithi053.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57028.log.gz 2023-06-10T19:09:52.245 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48455.log 2023-06-10T19:09:52.245 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.68607.log: /var/log/ceph/ceph-client.admin.45255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49795.log 2023-06-10T19:09:52.245 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.48455.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.68607.log.gz 2023-06-10T19:09:52.246 INFO:teuthology.orchestra.run.smithi053.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45255.log.gz 2023-06-10T19:09:52.246 INFO:teuthology.orchestra.run.smithi053.stderr:gzip 87.7% -5 --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.48455.log.gz 2023-06-10T19:09:52.246 INFO:teuthology.orchestra.run.smithi053.stderr: /var/log/ceph/ceph-client.admin.49743.log 2023-06-10T19:09:52.246 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69925.log 2023-06-10T19:09:52.246 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.49795.log: /var/log/ceph/ceph-client.admin.49743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43114.log 2023-06-10T19:09:52.247 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.69925.log: 89.0% 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49795.log.gz 2023-06-10T19:09:52.247 INFO:teuthology.orchestra.run.smithi053.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49743.log.gz 2023-06-10T19:09:52.247 INFO:teuthology.orchestra.run.smithi053.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.69925.log.gz 2023-06-10T19:09:52.247 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44651.log 2023-06-10T19:09:52.247 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72798.log 2023-06-10T19:09:52.248 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.43114.log: /var/log/ceph/ceph-client.admin.44651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43010.log 2023-06-10T19:09:52.248 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.72798.log: 88.9% 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43114.log.gz -- replaced with /var/log/ceph/ceph-client.admin.44651.log.gz 2023-06-10T19:09:52.248 INFO:teuthology.orchestra.run.smithi053.stderr: 2023-06-10T19:09:52.248 INFO:teuthology.orchestra.run.smithi053.stderr: 88.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58384.log 2023-06-10T19:09:52.248 INFO:teuthology.orchestra.run.smithi053.stderr: -- replaced with /var/log/ceph/ceph-client.admin.72798.log.gz 2023-06-10T19:09:52.249 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47833.log 2023-06-10T19:09:52.249 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.43010.log: /var/log/ceph/ceph-client.admin.58384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55115.log 2023-06-10T19:09:52.249 INFO:teuthology.orchestra.run.smithi053.stderr: 88.4%/var/log/ceph/ceph-client.admin.47833.log: -- replaced with /var/log/ceph/ceph-client.admin.58384.log.gz 2023-06-10T19:09:52.249 INFO:teuthology.orchestra.run.smithi053.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43010.log.gz 2023-06-10T19:09:52.249 INFO:teuthology.orchestra.run.smithi053.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47833.log.gz 2023-06-10T19:09:52.250 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71919.log 2023-06-10T19:09:52.250 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60549.log 2023-06-10T19:09:52.250 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.55115.log: /var/log/ceph/ceph-client.admin.71919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50546.log 2023-06-10T19:09:52.250 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.60549.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.55115.log.gz 2023-06-10T19:09:52.250 INFO:teuthology.orchestra.run.smithi053.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.71919.log.gz 2023-06-10T19:09:52.251 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43946.log 2023-06-10T19:09:52.251 INFO:teuthology.orchestra.run.smithi053.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.60549.log.gz 2023-06-10T19:09:52.251 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72459.log 2023-06-10T19:09:52.251 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.50546.log: /var/log/ceph/ceph-client.admin.43946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60793.log 2023-06-10T19:09:52.251 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.72459.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50546.log.gz 2023-06-10T19:09:52.252 INFO:teuthology.orchestra.run.smithi053.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43946.log.gz 2023-06-10T19:09:52.252 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56225.log 2023-06-10T19:09:52.252 INFO:teuthology.orchestra.run.smithi053.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.72459.log.gz 2023-06-10T19:09:52.252 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.60793.log: 87.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59925.log 2023-06-10T19:09:52.252 INFO:teuthology.orchestra.run.smithi053.stderr: -- replaced with /var/log/ceph/ceph-client.admin.60793.log.gz 2023-06-10T19:09:52.253 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68311.log 2023-06-10T19:09:52.253 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.56225.log: /var/log/ceph/ceph-client.admin.59925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71604.log 2023-06-10T19:09:52.253 INFO:teuthology.orchestra.run.smithi053.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.56225.log.gz 2023-06-10T19:09:52.253 INFO:teuthology.orchestra.run.smithi053.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.59925.log.gz 2023-06-10T19:09:52.253 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.68311.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.68311.log.gz 2023-06-10T19:09:52.254 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68011.log 2023-06-10T19:09:52.254 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59129.log 2023-06-10T19:09:52.254 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.71604.log: /var/log/ceph/ceph-client.admin.68011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66482.log 2023-06-10T19:09:52.254 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.59129.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.71604.log.gz 2023-06-10T19:09:52.254 INFO:teuthology.orchestra.run.smithi053.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.68011.log.gz 2023-06-10T19:09:52.255 INFO:teuthology.orchestra.run.smithi053.stderr: 89.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70722.log 2023-06-10T19:09:52.255 INFO:teuthology.orchestra.run.smithi053.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59129.log.gz 2023-06-10T19:09:52.255 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58436.log 2023-06-10T19:09:52.255 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.66482.log: /var/log/ceph/ceph-client.admin.70722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58947.log 2023-06-10T19:09:52.255 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.58436.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.70722.log.gz 2023-06-10T19:09:52.255 INFO:teuthology.orchestra.run.smithi053.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.66482.log.gz 2023-06-10T19:09:52.256 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53967.log 2023-06-10T19:09:52.256 INFO:teuthology.orchestra.run.smithi053.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.58436.log.gz 2023-06-10T19:09:52.256 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66222.log 2023-06-10T19:09:52.256 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.58947.log: /var/log/ceph/ceph-client.admin.53967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50707.log 2023-06-10T19:09:52.256 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.66222.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.58947.log.gz 2023-06-10T19:09:52.257 INFO:teuthology.orchestra.run.smithi053.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53967.log.gz 2023-06-10T19:09:52.257 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67128.log 2023-06-10T19:09:52.257 INFO:teuthology.orchestra.run.smithi053.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.66222.log.gz 2023-06-10T19:09:52.257 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56410.log 2023-06-10T19:09:52.257 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.50707.log: /var/log/ceph/ceph-client.admin.67128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55079.log 2023-06-10T19:09:52.258 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.56410.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50707.log.gz 2023-06-10T19:09:52.258 INFO:teuthology.orchestra.run.smithi053.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.67128.log.gz 2023-06-10T19:09:52.258 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66196.log 2023-06-10T19:09:52.258 INFO:teuthology.orchestra.run.smithi053.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.56410.log.gz 2023-06-10T19:09:52.258 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52823.log 2023-06-10T19:09:52.259 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.55079.log: /var/log/ceph/ceph-client.admin.66196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63193.log 2023-06-10T19:09:52.259 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.52823.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.66196.log.gz 88.6% -- replaced with /var/log/ceph/ceph-client.admin.55079.log.gz 2023-06-10T19:09:52.259 INFO:teuthology.orchestra.run.smithi053.stderr: 2023-06-10T19:09:52.259 INFO:teuthology.orchestra.run.smithi053.stderr: 89.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.52823.log.gz 2023-06-10T19:09:52.259 INFO:teuthology.orchestra.run.smithi053.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.68067.log 2023-06-10T19:09:52.260 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67313.log 2023-06-10T19:09:52.260 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.63193.log: gzip/var/log/ceph/ceph-client.admin.68067.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.56111.log 2023-06-10T19:09:52.260 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.67313.log: 88.5% 88.7% -- replaced with /var/log/ceph/ceph-client.admin.63193.log.gz 2023-06-10T19:09:52.260 INFO:teuthology.orchestra.run.smithi053.stderr: -- replaced with /var/log/ceph/ceph-client.admin.68067.log.gz 2023-06-10T19:09:52.260 INFO:teuthology.orchestra.run.smithi053.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.67313.log.gz 2023-06-10T19:09:52.261 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49156.log 2023-06-10T19:09:52.261 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53653.log 2023-06-10T19:09:52.261 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.56111.log: /var/log/ceph/ceph-client.admin.49156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63737.log 2023-06-10T19:09:52.261 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.53653.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.56111.log.gz 2023-06-10T19:09:52.261 INFO:teuthology.orchestra.run.smithi053.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49156.log.gz 2023-06-10T19:09:52.262 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50598.log 2023-06-10T19:09:52.262 INFO:teuthology.orchestra.run.smithi053.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53653.log.gz 2023-06-10T19:09:52.262 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50761.log 2023-06-10T19:09:52.262 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.63737.log: /var/log/ceph/ceph-client.admin.50598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65608.log 2023-06-10T19:09:52.262 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.0.50761.log: 89.2% 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50598.log.gz -- replaced with /var/log/ceph/ceph-client.admin.63737.log.gz 2023-06-10T19:09:52.263 INFO:teuthology.orchestra.run.smithi053.stderr: 2023-06-10T19:09:52.263 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63998.log 2023-06-10T19:09:52.263 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56540.log 2023-06-10T19:09:52.263 INFO:teuthology.orchestra.run.smithi053.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.0.50761.log.gz 2023-06-10T19:09:52.263 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.65608.log: /var/log/ceph/ceph-client.admin.63998.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.65608.log.gz 2023-06-10T19:09:52.264 INFO:teuthology.orchestra.run.smithi053.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.63998.log.gz 2023-06-10T19:09:52.264 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56083.log 2023-06-10T19:09:52.264 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51357.log 2023-06-10T19:09:52.264 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.56540.log: /var/log/ceph/ceph-client.admin.56083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48585.log 2023-06-10T19:09:52.264 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.51357.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.56083.log.gz 2023-06-10T19:09:52.265 INFO:teuthology.orchestra.run.smithi053.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.56540.log.gz 2023-06-10T19:09:52.265 INFO:teuthology.orchestra.run.smithi053.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.51357.log.gz 2023-06-10T19:09:52.265 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57747.log 2023-06-10T19:09:52.265 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68207.log 2023-06-10T19:09:52.265 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.48585.log: /var/log/ceph/ceph-client.admin.57747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42668.log 2023-06-10T19:09:52.266 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.68207.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48585.log.gz 2023-06-10T19:09:52.266 INFO:teuthology.orchestra.run.smithi053.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.57747.log.gz 2023-06-10T19:09:52.266 INFO:teuthology.orchestra.run.smithi053.stderr:gzip 88.8% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.68207.log.gz -- 2023-06-10T19:09:52.266 INFO:teuthology.orchestra.run.smithi053.stderr: /var/log/ceph/ceph-client.admin.69159.log 2023-06-10T19:09:52.266 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67261.log 2023-06-10T19:09:52.267 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.42668.log: /var/log/ceph/ceph-client.admin.69159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54123.log 2023-06-10T19:09:52.267 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.67261.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.69159.log.gz 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42668.log.gz 2023-06-10T19:09:52.267 INFO:teuthology.orchestra.run.smithi053.stderr: 2023-06-10T19:09:52.267 INFO:teuthology.orchestra.run.smithi053.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.67261.log.gz 2023-06-10T19:09:52.267 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65485.log 2023-06-10T19:09:52.268 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50030.log 2023-06-10T19:09:52.268 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.65485.log: /var/log/ceph/ceph-client.admin.54123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56696.log 2023-06-10T19:09:52.268 INFO:teuthology.orchestra.run.smithi053.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.65485.log.gz 2023-06-10T19:09:52.268 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.50030.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54123.log.gz 2023-06-10T19:09:52.268 INFO:teuthology.orchestra.run.smithi053.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50030.log.gz 2023-06-10T19:09:52.269 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43220.log 2023-06-10T19:09:52.269 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.56696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70238.log 2023-06-10T19:09:52.269 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.43220.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56696.log.gz 2023-06-10T19:09:52.269 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54839.log 2023-06-10T19:09:52.269 INFO:teuthology.orchestra.run.smithi053.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43220.log.gz/var/log/ceph/ceph-client.admin.70238.log: 2023-06-10T19:09:52.270 INFO:teuthology.orchestra.run.smithi053.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.70238.log.gz 2023-06-10T19:09:52.270 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59688.log 2023-06-10T19:09:52.270 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72822.log 2023-06-10T19:09:52.270 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.54839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53387.log 2023-06-10T19:09:52.270 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.59688.log: /var/log/ceph/ceph-client.admin.72822.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54839.log.gz 2023-06-10T19:09:52.270 INFO:teuthology.orchestra.run.smithi053.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.59688.log.gz 2023-06-10T19:09:52.271 INFO:teuthology.orchestra.run.smithi053.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.72822.log.gz 2023-06-10T19:09:52.271 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44232.log 2023-06-10T19:09:52.271 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55588.log 2023-06-10T19:09:52.271 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.53387.log: /var/log/ceph/ceph-client.admin.44232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59209.log 2023-06-10T19:09:52.271 INFO:teuthology.orchestra.run.smithi053.stderr: 88.7%/var/log/ceph/ceph-client.admin.55588.log: -- replaced with /var/log/ceph/ceph-client.admin.44232.log.gz 2023-06-10T19:09:52.272 INFO:teuthology.orchestra.run.smithi053.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53387.log.gz 2023-06-10T19:09:52.272 INFO:teuthology.orchestra.run.smithi053.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.55588.log.gz 2023-06-10T19:09:52.272 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58067.log 2023-06-10T19:09:52.272 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46130.log 2023-06-10T19:09:52.272 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.59209.log: /var/log/ceph/ceph-client.admin.58067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65407.log 2023-06-10T19:09:52.273 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.46130.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.59209.log.gz 2023-06-10T19:09:52.273 INFO:teuthology.orchestra.run.smithi053.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.58067.log.gz 2023-06-10T19:09:52.273 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65144.log 2023-06-10T19:09:52.273 INFO:teuthology.orchestra.run.smithi053.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46130.log.gz 2023-06-10T19:09:52.273 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63378.log 2023-06-10T19:09:52.274 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.65407.log: /var/log/ceph/ceph-client.admin.65144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69828.log 2023-06-10T19:09:52.274 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.63378.log: 88.8% 88.4% -- replaced with /var/log/ceph/ceph-client.admin.65407.log.gz 2023-06-10T19:09:52.274 INFO:teuthology.orchestra.run.smithi053.stderr: -- replaced with /var/log/ceph/ceph-client.admin.65144.log.gz 2023-06-10T19:09:52.274 INFO:teuthology.orchestra.run.smithi053.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.63378.log.gz 2023-06-10T19:09:52.274 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48085.log 2023-06-10T19:09:52.275 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71656.log 2023-06-10T19:09:52.275 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.69828.log: /var/log/ceph/ceph-client.admin.48085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44436.log 2023-06-10T19:09:52.275 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.71656.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48085.log.gz 89.4% 2023-06-10T19:09:52.275 INFO:teuthology.orchestra.run.smithi053.stderr: -- replaced with /var/log/ceph/ceph-client.admin.69828.log.gz 2023-06-10T19:09:52.275 INFO:teuthology.orchestra.run.smithi053.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.71656.log.gz 2023-06-10T19:09:52.275 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63946.log 2023-06-10T19:09:52.276 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63404.log 2023-06-10T19:09:52.276 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.0.44436.log: /var/log/ceph/ceph-client.admin.63946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66326.log 2023-06-10T19:09:52.276 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.63404.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.63946.log.gz 2023-06-10T19:09:52.276 INFO:teuthology.orchestra.run.smithi053.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.63404.log.gz 2023-06-10T19:09:52.276 INFO:teuthology.orchestra.run.smithi053.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.44436.log.gz 2023-06-10T19:09:52.277 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49325.log 2023-06-10T19:09:52.277 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49005.log 2023-06-10T19:09:52.277 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.66326.log: /var/log/ceph/ceph-client.admin.49325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48953.log 2023-06-10T19:09:52.277 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.49005.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49325.log.gz 88.3% -- replaced with /var/log/ceph/ceph-client.admin.66326.log.gz 2023-06-10T19:09:52.277 INFO:teuthology.orchestra.run.smithi053.stderr: 2023-06-10T19:09:52.278 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66248.log 2023-06-10T19:09:52.278 INFO:teuthology.orchestra.run.smithi053.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49005.log.gz 2023-06-10T19:09:52.278 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55220.log 2023-06-10T19:09:52.278 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.48953.log: /var/log/ceph/ceph-client.admin.66248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70290.log 2023-06-10T19:09:52.278 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.55220.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48953.log.gz 2023-06-10T19:09:52.279 INFO:teuthology.orchestra.run.smithi053.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.66248.log.gz 2023-06-10T19:09:52.279 INFO:teuthology.orchestra.run.smithi053.stderr: 88.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.55220.log.gz -5 2023-06-10T19:09:52.279 INFO:teuthology.orchestra.run.smithi053.stderr: --verbose -- /var/log/ceph/ceph-client.admin.50985.log 2023-06-10T19:09:52.279 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51175.log 2023-06-10T19:09:52.279 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.70290.log: /var/log/ceph/ceph-client.admin.50985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67469.log 2023-06-10T19:09:52.280 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.51175.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.70290.log.gz 2023-06-10T19:09:52.280 INFO:teuthology.orchestra.run.smithi053.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50985.log.gz 2023-06-10T19:09:52.280 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52797.log 2023-06-10T19:09:52.280 INFO:teuthology.orchestra.run.smithi053.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51175.log.gz 2023-06-10T19:09:52.280 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.67469.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.67469.log.gz 2023-06-10T19:09:52.281 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47041.log 2023-06-10T19:09:52.281 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43166.log 2023-06-10T19:09:52.281 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.52797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63711.log/var/log/ceph/ceph-client.admin.47041.log: 2023-06-10T19:09:52.281 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.43166.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47041.log.gz 89.0% -- replaced with /var/log/ceph/ceph-client.admin.52797.log.gz 2023-06-10T19:09:52.281 INFO:teuthology.orchestra.run.smithi053.stderr: 2023-06-10T19:09:52.282 INFO:teuthology.orchestra.run.smithi053.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43166.log.gz 2023-06-10T19:09:52.282 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43608.log 2023-06-10T19:09:52.282 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60102.log 2023-06-10T19:09:52.282 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.63711.log: /var/log/ceph/ceph-client.admin.43608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52147.log 2023-06-10T19:09:52.282 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.60102.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43608.log.gz 89.2% -- replaced with /var/log/ceph/ceph-client.admin.63711.log.gz 2023-06-10T19:09:52.283 INFO:teuthology.orchestra.run.smithi053.stderr: 2023-06-10T19:09:52.283 INFO:teuthology.orchestra.run.smithi053.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.60102.log.gz 2023-06-10T19:09:52.283 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43612.log 2023-06-10T19:09:52.283 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70696.log 2023-06-10T19:09:52.283 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.52147.log: /var/log/ceph/ceph-client.admin.43612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52901.log 2023-06-10T19:09:52.283 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.70696.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52147.log.gz 2023-06-10T19:09:52.284 INFO:teuthology.orchestra.run.smithi053.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43612.log.gz 2023-06-10T19:09:52.284 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-06-10T19:09:52.284 INFO:teuthology.orchestra.run.smithi053.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.70696.log.gz 2023-06-10T19:09:52.284 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-06-10T19:09:52.285 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.52901.log: /var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46657.log 2023-06-10T19:09:52.285 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-mds.c.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52901.log.gz 2023-06-10T19:09:52.285 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67443.log 2023-06-10T19:09:52.285 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.46657.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.46657.log.gz 2023-06-10T19:09:52.285 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67072.log 2023-06-10T19:09:52.285 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.67443.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.67443.log.gz 2023-06-10T19:09:52.286 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45659.log 2023-06-10T19:09:52.286 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.67072.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.67072.log.gz 2023-06-10T19:09:52.286 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59714.log 2023-06-10T19:09:52.286 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.45659.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45659.log.gz 2023-06-10T19:09:52.286 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61679.log 2023-06-10T19:09:52.287 INFO:teuthology.orchestra.run.smithi053.stderr: 89.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-06-10T19:09:52.287 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.59714.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.59714.log.gz 2023-06-10T19:09:52.287 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65582.log 2023-06-10T19:09:52.287 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-06-10T19:09:52.287 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.61679.log: /var/log/ceph/ceph-client.admin.65582.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.61679.log.gz 2023-06-10T19:09:52.288 INFO:teuthology.orchestra.run.smithi053.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.65582.log.gz 2023-06-10T19:09:52.288 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65381.log 2023-06-10T19:09:52.288 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51729.log 2023-06-10T19:09:52.288 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-mds.a.log: /var/log/ceph/ceph-client.admin.65381.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.65381.log.gz 2023-06-10T19:09:52.288 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57538.log 2023-06-10T19:09:52.289 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.51729.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.51729.log.gz 2023-06-10T19:09:52.289 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43427.log 2023-06-10T19:09:52.289 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.57538.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.57538.log.gz 2023-06-10T19:09:52.289 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43426.log 2023-06-10T19:09:52.289 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.43427.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43427.log.gz 2023-06-10T19:09:52.290 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68659.log 2023-06-10T19:09:52.290 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.43426.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43426.log.gz 2023-06-10T19:09:52.290 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62297.log 2023-06-10T19:09:52.290 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.68659.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.68659.log.gz 2023-06-10T19:09:52.290 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69185.log 2023-06-10T19:09:52.290 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.62297.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.62297.log.gz 2023-06-10T19:09:52.291 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48611.log 2023-06-10T19:09:52.291 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.69185.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.69185.log.gz 2023-06-10T19:09:52.291 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42389.log 2023-06-10T19:09:52.291 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.48611.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48611.log.gz 2023-06-10T19:09:52.291 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49234.log 2023-06-10T19:09:52.292 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.42389.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42389.log.gz 2023-06-10T19:09:52.292 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52095.log 2023-06-10T19:09:52.292 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.49234.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49234.log.gz 2023-06-10T19:09:52.292 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65869.log 2023-06-10T19:09:52.292 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.52095.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.52095.log.gz 2023-06-10T19:09:52.293 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50082.log 2023-06-10T19:09:52.293 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.65869.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.65869.log.gz 2023-06-10T19:09:52.293 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47575.log 2023-06-10T19:09:52.293 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.50082.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50082.log.gz 2023-06-10T19:09:52.293 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61887.log 2023-06-10T19:09:52.294 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.47575.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47575.log.gz 2023-06-10T19:09:52.294 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48559.log 2023-06-10T19:09:52.294 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.61887.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.61887.log.gz 2023-06-10T19:09:52.294 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42537.log 2023-06-10T19:09:52.294 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.48559.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48559.log.gz 2023-06-10T19:09:52.295 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65537.log 2023-06-10T19:09:52.295 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.42537.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.42537.log.gz 2023-06-10T19:09:52.295 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64428.log 2023-06-10T19:09:52.295 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.65537.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.65537.log.gz 2023-06-10T19:09:52.295 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47601.log 2023-06-10T19:09:52.295 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.64428.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.64428.log.gz 2023-06-10T19:09:52.296 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70967.log 2023-06-10T19:09:52.296 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.47601.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47601.log.gz 2023-06-10T19:09:52.296 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42720.log 2023-06-10T19:09:52.296 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.70967.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.70967.log.gz 2023-06-10T19:09:52.296 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45366.log 2023-06-10T19:09:52.297 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.42720.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42720.log.gz 2023-06-10T19:09:52.297 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57486.log 2023-06-10T19:09:52.297 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.45366.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45366.log.gz 2023-06-10T19:09:52.297 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42440.log 2023-06-10T19:09:52.298 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.57486.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.57486.log.gz 2023-06-10T19:09:52.298 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42589.log 2023-06-10T19:09:52.298 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.42440.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42440.log.gz 2023-06-10T19:09:52.298 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47757.log 2023-06-10T19:09:52.298 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.42589.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42589.log.gz 2023-06-10T19:09:52.299 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50004.log 2023-06-10T19:09:52.299 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.47757.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47757.log.gz 2023-06-10T19:09:52.299 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71443.log 2023-06-10T19:09:52.299 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.50004.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50004.log.gz 2023-06-10T19:09:52.299 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64220.log 2023-06-10T19:09:52.299 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.71443.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.71443.log.gz 2023-06-10T19:09:52.300 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49926.log 2023-06-10T19:09:52.300 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.64220.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.64220.log.gz 2023-06-10T19:09:52.300 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63456.log 2023-06-10T19:09:52.300 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.49926.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49926.log.gz 2023-06-10T19:09:52.300 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64815.log 2023-06-10T19:09:52.301 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.63456.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.63456.log.gz 2023-06-10T19:09:52.301 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49769.log 2023-06-10T19:09:52.301 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.64815.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.64815.log.gz 2023-06-10T19:09:52.301 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46156.log 2023-06-10T19:09:52.301 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.49769.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49769.log.gz 2023-06-10T19:09:52.302 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45177.log 2023-06-10T19:09:52.302 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.46156.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46156.log.gz 2023-06-10T19:09:52.302 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46077.log 2023-06-10T19:09:52.302 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.45177.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45177.log.gz 2023-06-10T19:09:52.302 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67815.log 2023-06-10T19:09:52.303 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.46077.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46077.log.gz 2023-06-10T19:09:52.303 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56904.log 2023-06-10T19:09:52.303 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.67815.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.67815.log.gz 2023-06-10T19:09:52.303 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59977.log 2023-06-10T19:09:52.303 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.56904.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.56904.log.gz 2023-06-10T19:09:52.304 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58555.log 2023-06-10T19:09:52.304 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.59977.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.59977.log.gz 2023-06-10T19:09:52.304 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56462.log 2023-06-10T19:09:52.304 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.58555.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.58555.log.gz 2023-06-10T19:09:52.304 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54601.log 2023-06-10T19:09:52.305 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.56462.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56462.log.gz 2023-06-10T19:09:52.305 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53257.log 2023-06-10T19:09:52.305 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.54601.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.54601.log.gz 2023-06-10T19:09:52.305 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68789.log 2023-06-10T19:09:52.305 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.53257.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53257.log.gz 2023-06-10T19:09:52.306 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60180.log 2023-06-10T19:09:52.306 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.68789.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.68789.log.gz 2023-06-10T19:09:52.306 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69431.log 2023-06-10T19:09:52.306 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.60180.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.60180.log.gz 2023-06-10T19:09:52.306 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69620.log 2023-06-10T19:09:52.306 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.69431.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.69431.log.gz 2023-06-10T19:09:52.307 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42906.log 2023-06-10T19:09:52.307 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.69620.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.69620.log.gz 2023-06-10T19:09:52.307 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43219.log 2023-06-10T19:09:52.307 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.42906.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42906.log.gz 2023-06-10T19:09:52.307 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70880.log 2023-06-10T19:09:52.308 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.43219.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43219.log.gz 2023-06-10T19:09:52.308 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52771.log 2023-06-10T19:09:52.308 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.0.70880.log: 89.5% -- replaced with /var/log/ceph/ceph-client.0.70880.log.gz 2023-06-10T19:09:52.308 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54918.log 2023-06-10T19:09:52.308 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.52771.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52771.log.gz 2023-06-10T19:09:52.309 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53044.log 2023-06-10T19:09:52.309 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.54918.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54918.log.gz 2023-06-10T19:09:52.309 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60363.log 2023-06-10T19:09:52.309 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.53044.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.53044.log.gz 2023-06-10T19:09:52.309 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67696.log 2023-06-10T19:09:52.310 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.60363.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.60363.log.gz 2023-06-10T19:09:52.310 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52849.log 2023-06-10T19:09:52.310 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.67696.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.67696.log.gz 2023-06-10T19:09:52.310 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48730.log 2023-06-10T19:09:52.310 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.52849.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52849.log.gz 2023-06-10T19:09:52.311 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57080.log 2023-06-10T19:09:52.311 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.48730.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48730.log.gz 2023-06-10T19:09:52.311 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63297.log 2023-06-10T19:09:52.311 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.57080.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.57080.log.gz 2023-06-10T19:09:52.311 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43218.log 2023-06-10T19:09:52.311 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.63297.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.63297.log.gz 2023-06-10T19:09:52.312 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59743.log 2023-06-10T19:09:52.312 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.43218.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43218.log.gz 2023-06-10T19:09:52.312 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45047.log 2023-06-10T19:09:52.312 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.59743.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.59743.log.gz 2023-06-10T19:09:52.312 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64194.log 2023-06-10T19:09:52.313 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.45047.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45047.log.gz 2023-06-10T19:09:52.313 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45125.log 2023-06-10T19:09:52.313 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.64194.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.64194.log.gz 2023-06-10T19:09:52.313 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51664.log 2023-06-10T19:09:52.313 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.45125.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45125.log.gz 2023-06-10T19:09:52.314 INFO:teuthology.orchestra.run.smithi117.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-06-10T19:09:52.319 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2023-06-10T19:09:52.351 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49208.log 2023-06-10T19:09:52.351 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.51664.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51664.log.gz 2023-06-10T19:09:52.352 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43413.log 2023-06-10T19:09:52.352 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.49208.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49208.log.gz 2023-06-10T19:09:52.352 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66773.log 2023-06-10T19:09:52.352 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.43413.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43413.log.gz 2023-06-10T19:09:52.352 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49821.log 2023-06-10T19:09:52.353 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.66773.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.66773.log.gz 2023-06-10T19:09:52.353 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48797.log 2023-06-10T19:09:52.353 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.49821.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49821.log.gz 2023-06-10T19:09:52.353 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57160.log 2023-06-10T19:09:52.353 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.48797.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48797.log.gz 2023-06-10T19:09:52.354 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51847.log 2023-06-10T19:09:52.354 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.57160.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.57160.log.gz 2023-06-10T19:09:52.354 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61268.log 2023-06-10T19:09:52.354 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.51847.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51847.log.gz 2023-06-10T19:09:52.354 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66170.log 2023-06-10T19:09:52.355 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.61268.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.61268.log.gz 2023-06-10T19:09:52.355 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49417.log 2023-06-10T19:09:52.355 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.66170.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.66170.log.gz 2023-06-10T19:09:52.355 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64350.log 2023-06-10T19:09:52.356 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.49417.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.49417.log.gz 2023-06-10T19:09:52.356 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71071.log 2023-06-10T19:09:52.356 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.64350.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.64350.log.gz 2023-06-10T19:09:52.356 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52992.log 2023-06-10T19:09:52.356 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.71071.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.71071.log.gz 2023-06-10T19:09:52.357 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64746.log 2023-06-10T19:09:52.357 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.52992.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52992.log.gz 2023-06-10T19:09:52.357 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59157.log 2023-06-10T19:09:52.357 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.64746.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.64746.log.gz 2023-06-10T19:09:52.357 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70590.log 2023-06-10T19:09:52.358 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.59157.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.59157.log.gz 2023-06-10T19:09:52.358 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61146.log 2023-06-10T19:09:52.358 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.70590.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.70590.log.gz 2023-06-10T19:09:52.358 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63763.log 2023-06-10T19:09:52.358 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.61146.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.61146.log.gz 2023-06-10T19:09:52.359 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70512.log 2023-06-10T19:09:52.359 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.63763.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.63763.log.gz 2023-06-10T19:09:52.359 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69264.log 2023-06-10T19:09:52.359 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.70512.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.70512.log.gz 2023-06-10T19:09:52.359 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44625.log 2023-06-10T19:09:52.360 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.69264.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.69264.log.gz 2023-06-10T19:09:52.360 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56329.log 2023-06-10T19:09:52.360 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.44625.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44625.log.gz 2023-06-10T19:09:52.360 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54471.log 2023-06-10T19:09:52.360 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.56329.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.56329.log.gz 2023-06-10T19:09:52.361 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51253.log 2023-06-10T19:09:52.361 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.54471.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.54471.log.gz 2023-06-10T19:09:52.361 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55508.log 2023-06-10T19:09:52.361 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.51253.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51253.log.gz 2023-06-10T19:09:52.361 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62147.log 2023-06-10T19:09:52.362 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.55508.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.55508.log.gz 2023-06-10T19:09:52.362 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63058.log 2023-06-10T19:09:52.362 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.62147.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.62147.log.gz 2023-06-10T19:09:52.362 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48429.log 2023-06-10T19:09:52.362 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.63058.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.63058.log.gz 2023-06-10T19:09:52.363 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72407.log 2023-06-10T19:09:52.363 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.48429.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48429.log.gz 2023-06-10T19:09:52.363 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57458.log 2023-06-10T19:09:52.363 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.72407.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.72407.log.gz 2023-06-10T19:09:52.363 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62434.log 2023-06-10T19:09:52.364 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.57458.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.57458.log.gz 2023-06-10T19:09:52.364 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53099.log 2023-06-10T19:09:52.364 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.62434.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.62434.log.gz 2023-06-10T19:09:52.364 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70748.log 2023-06-10T19:09:52.364 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.53099.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.53099.log.gz 2023-06-10T19:09:52.365 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44313.log 2023-06-10T19:09:52.365 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.70748.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.70748.log.gz 2023-06-10T19:09:52.365 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63352.log 2023-06-10T19:09:52.365 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.44313.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.44313.log.gz 2023-06-10T19:09:52.365 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46267.log 2023-06-10T19:09:52.366 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.63352.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.63352.log.gz 2023-06-10T19:09:52.366 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53179.log 2023-06-10T19:09:52.366 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.46267.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46267.log.gz 2023-06-10T19:09:52.366 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50415.log 2023-06-10T19:09:52.366 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.53179.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53179.log.gz 2023-06-10T19:09:52.367 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59261.log 2023-06-10T19:09:52.367 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.50415.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50415.log.gz 2023-06-10T19:09:52.367 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62179.log 2023-06-10T19:09:52.367 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.59261.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.59261.log.gz 2023-06-10T19:09:52.367 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66884.log 2023-06-10T19:09:52.368 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.62179.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.62179.log.gz 2023-06-10T19:09:52.368 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60923.log 2023-06-10T19:09:52.368 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.0.66884.log: 88.3% -- replaced with /var/log/ceph/ceph-client.0.66884.log.gz 2023-06-10T19:09:52.368 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47942.log 2023-06-10T19:09:52.368 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.60923.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.60923.log.gz 2023-06-10T19:09:52.369 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57106.log 2023-06-10T19:09:52.369 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.47942.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47942.log.gz 2023-06-10T19:09:52.369 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65459.log 2023-06-10T19:09:52.369 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.57106.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.57106.log.gz 2023-06-10T19:09:52.369 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70186.log 2023-06-10T19:09:52.370 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.65459.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.65459.log.gz 2023-06-10T19:09:52.370 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49260.log 2023-06-10T19:09:52.370 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.70186.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.70186.log.gz 2023-06-10T19:09:52.370 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67750.log 2023-06-10T19:09:52.370 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.49260.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49260.log.gz 2023-06-10T19:09:52.371 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61546.log 2023-06-10T19:09:52.371 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.67750.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.67750.log.gz 2023-06-10T19:09:52.371 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72537.log 2023-06-10T19:09:52.371 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.61546.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.61546.log.gz 2023-06-10T19:09:52.371 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62732.log 2023-06-10T19:09:52.372 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.72537.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.72537.log.gz 2023-06-10T19:09:52.372 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51016.log 2023-06-10T19:09:52.372 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.62732.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.62732.log.gz 2023-06-10T19:09:52.372 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53823.log 2023-06-10T19:09:52.372 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.51016.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51016.log.gz 2023-06-10T19:09:52.373 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65355.log 2023-06-10T19:09:52.373 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.53823.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53823.log.gz 2023-06-10T19:09:52.373 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45999.log 2023-06-10T19:09:52.373 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.65355.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.65355.log.gz 2023-06-10T19:09:52.373 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50933.log 2023-06-10T19:09:52.374 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.45999.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45999.log.gz 2023-06-10T19:09:52.374 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64076.log 2023-06-10T19:09:52.374 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.50933.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50933.log.gz 2023-06-10T19:09:52.374 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54760.log 2023-06-10T19:09:52.374 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.64076.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.64076.log.gz 2023-06-10T19:09:52.375 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46319.log 2023-06-10T19:09:52.375 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.54760.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.54760.log.gz 2023-06-10T19:09:52.375 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48377.log 2023-06-10T19:09:52.375 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.46319.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46319.log.gz 2023-06-10T19:09:52.375 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65009.log 2023-06-10T19:09:52.376 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.48377.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48377.log.gz 2023-06-10T19:09:52.376 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60871.log 2023-06-10T19:09:52.376 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.65009.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.65009.log.gz 2023-06-10T19:09:52.376 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47327.log 2023-06-10T19:09:52.376 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.60871.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.60871.log.gz 2023-06-10T19:09:52.377 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54419.log 2023-06-10T19:09:52.377 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.47327.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47327.log.gz 2023-06-10T19:09:52.377 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70344.log 2023-06-10T19:09:52.377 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.54419.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.54419.log.gz 2023-06-10T19:09:52.377 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58895.log 2023-06-10T19:09:52.378 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.70344.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.70344.log.gz 2023-06-10T19:09:52.378 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67287.log 2023-06-10T19:09:52.378 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.58895.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.58895.log.gz 2023-06-10T19:09:52.378 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67020.log 2023-06-10T19:09:52.378 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.67287.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.67287.log.gz 2023-06-10T19:09:52.379 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67783.log 2023-06-10T19:09:52.379 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.67020.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.67020.log.gz 2023-06-10T19:09:52.379 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44839.log 2023-06-10T19:09:52.379 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.67783.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.67783.log.gz 2023-06-10T19:09:52.379 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64104.log 2023-06-10T19:09:52.379 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.44839.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44839.log.gz 2023-06-10T19:09:52.380 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43998.log 2023-06-10T19:09:52.380 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.64104.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.64104.log.gz 2023-06-10T19:09:52.380 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66994.log 2023-06-10T19:09:52.380 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.43998.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43998.log.gz 2023-06-10T19:09:52.380 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72244.log 2023-06-10T19:09:52.381 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.66994.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.66994.log.gz 2023-06-10T19:09:52.381 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70055.log 2023-06-10T19:09:52.381 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.72244.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.72244.log.gz 2023-06-10T19:09:52.381 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58306.log 2023-06-10T19:09:52.381 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.70055.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.70055.log.gz 2023-06-10T19:09:52.382 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55404.log 2023-06-10T19:09:52.382 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.58306.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.58306.log.gz 2023-06-10T19:09:52.382 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63482.log 2023-06-10T19:09:52.382 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.55404.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55404.log.gz 2023-06-10T19:09:52.382 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66721.log 2023-06-10T19:09:52.383 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.63482.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.63482.log.gz 2023-06-10T19:09:52.383 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66030.log 2023-06-10T19:09:52.383 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.66721.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.66721.log.gz 2023-06-10T19:09:52.383 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63326.log 2023-06-10T19:09:52.383 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.66030.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.66030.log.gz 2023-06-10T19:09:52.384 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72848.log 2023-06-10T19:09:52.384 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.63326.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.63326.log.gz 2023-06-10T19:09:52.384 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65225.log 2023-06-10T19:09:52.384 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.72848.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.72848.log.gz 2023-06-10T19:09:52.385 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52704.log 2023-06-10T19:09:52.385 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.65225.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.65225.log.gz 2023-06-10T19:09:52.385 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54202.log 2023-06-10T19:09:52.385 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.52704.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52704.log.gz 2023-06-10T19:09:52.385 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54306.log 2023-06-10T19:09:52.385 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.54202.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.54202.log.gz 2023-06-10T19:09:52.386 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53510.log 2023-06-10T19:09:52.386 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.0.54306.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.54306.log.gz 2023-06-10T19:09:52.386 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66144.log 2023-06-10T19:09:52.386 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.53510.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53510.log.gz 2023-06-10T19:09:52.386 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45576.log 2023-06-10T19:09:52.387 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.66144.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.66144.log.gz 2023-06-10T19:09:52.387 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45419.log 2023-06-10T19:09:52.387 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.45576.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45576.log.gz 2023-06-10T19:09:52.387 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55640.log 2023-06-10T19:09:52.387 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.45419.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45419.log.gz 2023-06-10T19:09:52.388 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51227.log 2023-06-10T19:09:52.388 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.55640.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.55640.log.gz 2023-06-10T19:09:52.388 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61172.log 2023-06-10T19:09:52.388 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.51227.log: 91.7% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-06-10T19:09:52.388 INFO:teuthology.orchestra.run.smithi053.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51227.log.gz 2023-06-10T19:09:52.389 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72745.log 2023-06-10T19:09:52.389 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43409.log 2023-06-10T19:09:52.389 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.61172.log: /var/log/ceph/ceph-client.admin.72745.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.61172.log.gz 2023-06-10T19:09:52.389 INFO:teuthology.orchestra.run.smithi053.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.72745.log.gz 2023-06-10T19:09:52.389 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62114.log 2023-06-10T19:09:52.390 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45445.log 2023-06-10T19:09:52.390 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.43409.log: /var/log/ceph/ceph-client.admin.62114.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43409.log.gz 2023-06-10T19:09:52.390 INFO:teuthology.orchestra.run.smithi053.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.62114.log.gz 2023-06-10T19:09:52.390 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44180.log 2023-06-10T19:09:52.390 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68815.log 2023-06-10T19:09:52.391 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.45445.log: /var/log/ceph/ceph-client.admin.44180.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45445.log.gz 2023-06-10T19:09:52.391 INFO:teuthology.orchestra.run.smithi053.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44180.log.gz 2023-06-10T19:09:52.391 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72771.log 2023-06-10T19:09:52.391 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.68815.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.68815.log.gz 2023-06-10T19:09:52.391 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60819.log 2023-06-10T19:09:52.392 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43842.log 2023-06-10T19:09:52.392 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.72771.log: /var/log/ceph/ceph-client.admin.60819.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.72771.log.gz 2023-06-10T19:09:52.392 INFO:teuthology.orchestra.run.smithi053.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.60819.log.gz 2023-06-10T19:09:52.392 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68337.log 2023-06-10T19:09:52.392 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57640.log 2023-06-10T19:09:52.393 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.43842.log: /var/log/ceph/ceph-client.admin.68337.log: 92.2% 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43842.log.gz 2023-06-10T19:09:52.393 INFO:teuthology.orchestra.run.smithi053.stderr: -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-06-10T19:09:52.393 INFO:teuthology.orchestra.run.smithi053.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.68337.log.gz 2023-06-10T19:09:52.393 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58358.log 2023-06-10T19:09:52.393 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69802.log 2023-06-10T19:09:52.394 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.57640.log: /var/log/ceph/ceph-client.admin.58358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62062.log 2023-06-10T19:09:52.394 INFO:teuthology.orchestra.run.smithi053.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.57640.log.gz 2023-06-10T19:09:52.394 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.69802.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.58358.log.gz 2023-06-10T19:09:52.394 INFO:teuthology.orchestra.run.smithi053.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.69802.log.gz 2023-06-10T19:09:52.394 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42414.log 2023-06-10T19:09:52.395 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.62062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64873.log 2023-06-10T19:09:52.395 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.42414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50293.log 2023-06-10T19:09:52.395 INFO:teuthology.orchestra.run.smithi053.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.62062.log.gz 2023-06-10T19:09:52.395 INFO:teuthology.orchestra.run.smithi053.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42414.log.gz 2023-06-10T19:09:52.395 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.64873.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.64873.log.gz 2023-06-10T19:09:52.396 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67644.log 2023-06-10T19:09:52.396 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57937.log 2023-06-10T19:09:52.396 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.0.50293.log: /var/log/ceph/ceph-client.admin.67644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66589.log 2023-06-10T19:09:52.396 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.57937.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.67644.log.gz 2023-06-10T19:09:52.396 INFO:teuthology.orchestra.run.smithi053.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.57937.log.gz 2023-06-10T19:09:52.397 INFO:teuthology.orchestra.run.smithi053.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.0.50293.log.gz 2023-06-10T19:09:52.397 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61468.log 2023-06-10T19:09:52.397 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.66589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69880.log 2023-06-10T19:09:52.397 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.61468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55875.log 2023-06-10T19:09:52.397 INFO:teuthology.orchestra.run.smithi053.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.66589.log.gz 2023-06-10T19:09:52.398 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67670.log 2023-06-10T19:09:52.398 INFO:teuthology.orchestra.run.smithi053.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.61468.log.gz 2023-06-10T19:09:52.398 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.69880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52603.log 2023-06-10T19:09:52.398 INFO:teuthology.orchestra.run.smithi053.stderr: 88.7%/var/log/ceph/ceph-client.admin.55875.log: -- replaced with /var/log/ceph/ceph-client.admin.69880.log.gz 2023-06-10T19:09:52.398 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.67670.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.55875.log.gz 2023-06-10T19:09:52.399 INFO:teuthology.orchestra.run.smithi053.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.67670.log.gz 2023-06-10T19:09:52.399 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69133.log 2023-06-10T19:09:52.399 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.52603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65974.log 2023-06-10T19:09:52.399 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.69133.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52603.log.gz 2023-06-10T19:09:52.399 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64246.log 2023-06-10T19:09:52.400 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59584.log 2023-06-10T19:09:52.400 INFO:teuthology.orchestra.run.smithi053.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.69133.log.gz 2023-06-10T19:09:52.400 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.65974.log: /var/log/ceph/ceph-client.admin.64246.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.65974.log.gz 2023-06-10T19:09:52.400 INFO:teuthology.orchestra.run.smithi053.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.64246.log.gz 2023-06-10T19:09:52.400 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45099.log 2023-06-10T19:09:52.401 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.59584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45340.log 2023-06-10T19:09:52.401 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.45099.log: 89.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64402.log 2023-06-10T19:09:52.401 INFO:teuthology.orchestra.run.smithi053.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59584.log.gz 2023-06-10T19:09:52.401 INFO:teuthology.orchestra.run.smithi053.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45099.log.gz/var/log/ceph/ceph-client.admin.45340.log: 2023-06-10T19:09:52.401 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48901.log 2023-06-10T19:09:52.402 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.64402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66064.log 2023-06-10T19:09:52.402 INFO:teuthology.orchestra.run.smithi053.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45340.log.gz 2023-06-10T19:09:52.402 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.48901.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.64402.log.gz 2023-06-10T19:09:52.402 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59821.log 2023-06-10T19:09:52.402 INFO:teuthology.orchestra.run.smithi053.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48901.log.gz 2023-06-10T19:09:52.403 INFO:teuthology.orchestra.run.smithi117.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-06-10T19:09:52.418 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.66064.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.66064.log.gz 2023-06-10T19:09:52.419 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60415.log 2023-06-10T19:09:52.419 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71495.log 2023-06-10T19:09:52.419 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.59821.log: /var/log/ceph/ceph-client.admin.60415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63588.log 2023-06-10T19:09:52.419 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.71495.log: 88.9% 88.7% -- replaced with /var/log/ceph/ceph-client.admin.59821.log.gz 2023-06-10T19:09:52.419 INFO:teuthology.orchestra.run.smithi053.stderr: -- replaced with /var/log/ceph/ceph-client.admin.60415.log.gz 2023-06-10T19:09:52.420 INFO:teuthology.orchestra.run.smithi053.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.71495.log.gz 2023-06-10T19:09:52.420 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49469.log 2023-06-10T19:09:52.420 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68581.log 2023-06-10T19:09:52.420 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.63588.log: /var/log/ceph/ceph-client.admin.49469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62889.log 2023-06-10T19:09:52.420 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.68581.log: 89.2% 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49469.log.gz -- replaced with /var/log/ceph/ceph-client.admin.63588.log.gz 2023-06-10T19:09:52.421 INFO:teuthology.orchestra.run.smithi053.stderr: 2023-06-10T19:09:52.421 INFO:teuthology.orchestra.run.smithi053.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.68581.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44486.log 2023-06-10T19:09:52.421 INFO:teuthology.orchestra.run.smithi053.stderr: 2023-06-10T19:09:52.421 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43036.log 2023-06-10T19:09:52.421 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.62889.log: /var/log/ceph/ceph-client.admin.44486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69019.log 2023-06-10T19:09:52.422 INFO:teuthology.orchestra.run.smithi053.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.62889.log.gz 2023-06-10T19:09:52.422 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.43036.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44486.log.gz 2023-06-10T19:09:52.422 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47627.log 2023-06-10T19:09:52.422 INFO:teuthology.orchestra.run.smithi053.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43036.log.gz 2023-06-10T19:09:52.422 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.0.69019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55822.log 2023-06-10T19:09:52.423 INFO:teuthology.orchestra.run.smithi053.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.0.69019.log.gz 2023-06-10T19:09:52.423 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.47627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70316.log 2023-06-10T19:09:52.423 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.55822.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47627.log.gz 2023-06-10T19:09:52.423 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44787.log 2023-06-10T19:09:52.424 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47301.log 2023-06-10T19:09:52.424 INFO:teuthology.orchestra.run.smithi053.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.55822.log.gz/var/log/ceph/ceph-client.admin.70316.log: 2023-06-10T19:09:52.424 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.44787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57188.log 2023-06-10T19:09:52.424 INFO:teuthology.orchestra.run.smithi053.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.70316.log.gz 2023-06-10T19:09:52.424 INFO:teuthology.orchestra.run.smithi053.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44787.log.gz 2023-06-10T19:09:52.425 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.47301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49978.log 2023-06-10T19:09:52.425 INFO:teuthology.orchestra.run.smithi053.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47301.log.gz 2023-06-10T19:09:52.425 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59495.log 2023-06-10T19:09:52.425 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.57188.log: /var/log/ceph/ceph-client.admin.49978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67959.log 2023-06-10T19:09:52.425 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.59495.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49978.log.gz 88.5% 2023-06-10T19:09:52.425 INFO:teuthology.orchestra.run.smithi053.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57188.log.gz 2023-06-10T19:09:52.426 INFO:teuthology.orchestra.run.smithi053.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.59495.log.gz 2023-06-10T19:09:52.426 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69211.log 2023-06-10T19:09:52.426 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54252.log 2023-06-10T19:09:52.426 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.67959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45392.log 2023-06-10T19:09:52.426 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.69211.log: /var/log/ceph/ceph-client.admin.54252.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.69211.log.gz 2023-06-10T19:09:52.427 INFO:teuthology.orchestra.run.smithi053.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.67959.log.gz 2023-06-10T19:09:52.427 INFO:teuthology.orchestra.run.smithi053.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.54252.log.gz 2023-06-10T19:09:52.427 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51532.log 2023-06-10T19:09:52.427 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65634.log 2023-06-10T19:09:52.427 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.45392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72485.log 2023-06-10T19:09:52.428 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.51532.log: /var/log/ceph/ceph-client.admin.65634.log: 88.0% 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45392.log.gz 2023-06-10T19:09:52.428 INFO:teuthology.orchestra.run.smithi053.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51532.log.gz 2023-06-10T19:09:52.428 INFO:teuthology.orchestra.run.smithi053.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.65634.log.gz 2023-06-10T19:09:52.428 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67102.log 2023-06-10T19:09:52.428 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47469.log 2023-06-10T19:09:52.429 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.72485.log: /var/log/ceph/ceph-client.admin.67102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43207.log 2023-06-10T19:09:52.429 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.47469.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.72485.log.gz 2023-06-10T19:09:52.429 INFO:teuthology.orchestra.run.smithi053.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.67102.log.gz 2023-06-10T19:09:52.429 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48533.log 2023-06-10T19:09:52.429 INFO:teuthology.orchestra.run.smithi053.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47469.log.gz 2023-06-10T19:09:52.430 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45203.log 2023-06-10T19:09:52.430 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.43207.log: /var/log/ceph/ceph-client.admin.48533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51435.log 2023-06-10T19:09:52.430 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.45203.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48533.log.gz 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43207.log.gz 2023-06-10T19:09:52.430 INFO:teuthology.orchestra.run.smithi053.stderr: 2023-06-10T19:09:52.430 INFO:teuthology.orchestra.run.smithi053.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45203.log.gz 2023-06-10T19:09:52.431 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72641.log 2023-06-10T19:09:52.431 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44761.log 2023-06-10T19:09:52.431 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.51435.log: /var/log/ceph/ceph-client.admin.72641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48137.log 2023-06-10T19:09:52.431 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.44761.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51435.log.gz 2023-06-10T19:09:52.431 INFO:teuthology.orchestra.run.smithi053.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.72641.log.gz 2023-06-10T19:09:52.432 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62271.log 2023-06-10T19:09:52.432 INFO:teuthology.orchestra.run.smithi053.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44761.log.gz 2023-06-10T19:09:52.432 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46865.log 2023-06-10T19:09:52.432 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.48137.log: /var/log/ceph/ceph-client.admin.62271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63430.log 2023-06-10T19:09:52.432 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.46865.log: 89.0% 89.2% -- replaced with /var/log/ceph/ceph-client.admin.62271.log.gz -- replaced with /var/log/ceph/ceph-client.admin.48137.log.gz 2023-06-10T19:09:52.433 INFO:teuthology.orchestra.run.smithi053.stderr: 2023-06-10T19:09:52.433 INFO:teuthology.orchestra.run.smithi053.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46865.log.gz 2023-06-10T19:09:52.433 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62967.log 2023-06-10T19:09:52.433 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47705.log 2023-06-10T19:09:52.433 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.63430.log: /var/log/ceph/ceph-client.admin.62967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63880.log 2023-06-10T19:09:52.433 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.47705.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.63430.log.gz 2023-06-10T19:09:52.434 INFO:teuthology.orchestra.run.smithi053.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.62967.log.gz 2023-06-10T19:09:52.434 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49637.log 2023-06-10T19:09:52.434 INFO:teuthology.orchestra.run.smithi053.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47705.log.gz 2023-06-10T19:09:52.434 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54865.log 2023-06-10T19:09:52.434 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.63880.log: gzip -5 --verbose --/var/log/ceph/ceph-client.admin.49637.log: /var/log/ceph/ceph-client.admin.45498.log 2023-06-10T19:09:52.435 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.54865.log: 89.6% 88.6% -- replaced with /var/log/ceph/ceph-client.admin.63880.log.gz 2023-06-10T19:09:52.435 INFO:teuthology.orchestra.run.smithi053.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49637.log.gz 2023-06-10T19:09:52.435 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65118.log 2023-06-10T19:09:52.435 INFO:teuthology.orchestra.run.smithi053.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.54865.log.gz 2023-06-10T19:09:52.435 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61809.log 2023-06-10T19:09:52.436 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.45498.log: gzip/var/log/ceph/ceph-client.admin.65118.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.69342.log 2023-06-10T19:09:52.436 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.61809.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.65118.log.gz 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45498.log.gz 2023-06-10T19:09:52.436 INFO:teuthology.orchestra.run.smithi053.stderr: 2023-06-10T19:09:52.436 INFO:teuthology.orchestra.run.smithi053.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.61809.log.gz 2023-06-10T19:09:52.436 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53070.log 2023-06-10T19:09:52.437 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62706.log 2023-06-10T19:09:52.437 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.69342.log: gzip -5 --verbose --/var/log/ceph/ceph-client.admin.53070.log: /var/log/ceph/ceph-client.admin.49293.log 2023-06-10T19:09:52.437 INFO:teuthology.orchestra.run.smithi053.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.69342.log.gz/var/log/ceph/ceph-client.admin.62706.log: 2023-06-10T19:09:52.437 INFO:teuthology.orchestra.run.smithi053.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53070.log.gz 2023-06-10T19:09:52.437 INFO:teuthology.orchestra.run.smithi053.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.62706.log.gz 2023-06-10T19:09:52.438 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60003.log 2023-06-10T19:09:52.438 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.49293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42828.log 2023-06-10T19:09:52.438 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.60003.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49293.log.gz 2023-06-10T19:09:52.438 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54996.log 2023-06-10T19:09:52.438 INFO:teuthology.orchestra.run.smithi053.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.60003.log.gz/var/log/ceph/ceph-client.admin.42828.log: 2023-06-10T19:09:52.439 INFO:teuthology.orchestra.run.smithi053.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42828.log.gz 2023-06-10T19:09:52.439 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57859.log 2023-06-10T19:09:52.439 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51120.log 2023-06-10T19:09:52.439 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.54996.log: /var/log/ceph/ceph-client.admin.57859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58635.log 2023-06-10T19:09:52.439 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.51120.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.57859.log.gz 2023-06-10T19:09:52.440 INFO:teuthology.orchestra.run.smithi053.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54996.log.gz 2023-06-10T19:09:52.440 INFO:teuthology.orchestra.run.smithi053.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51120.log.gz 2023-06-10T19:09:52.440 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43920.log 2023-06-10T19:09:52.440 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58015.log 2023-06-10T19:09:52.440 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.58635.log: /var/log/ceph/ceph-client.admin.43920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46917.log 2023-06-10T19:09:52.441 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.58015.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43920.log.gz 2023-06-10T19:09:52.441 INFO:teuthology.orchestra.run.smithi053.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.58635.log.gz 2023-06-10T19:09:52.441 INFO:teuthology.orchestra.run.smithi053.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.58015.log.gz 2023-06-10T19:09:52.441 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72023.log 2023-06-10T19:09:52.441 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42748.log 2023-06-10T19:09:52.442 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.46917.log: /var/log/ceph/ceph-client.admin.72023.log: /var/log/ceph/ceph-client.admin.42748.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46917.log.gz 2023-06-10T19:09:52.442 INFO:teuthology.orchestra.run.smithi053.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.72023.log.gz 2023-06-10T19:09:52.442 INFO:teuthology.orchestra.run.smithi053.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42748.log.gz 2023-06-10T19:09:52.534 INFO:teuthology.orchestra.run.smithi117.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-06-10T19:09:52.635 INFO:teuthology.orchestra.run.smithi117.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-06-10T19:09:52.649 INFO:teuthology.orchestra.run.smithi117.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-06-10T19:09:52.667 INFO:teuthology.orchestra.run.smithi053.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-06-10T19:09:52.731 INFO:teuthology.orchestra.run.smithi117.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-06-10T19:09:52.732 INFO:teuthology.orchestra.run.smithi053.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-06-10T19:09:52.733 INFO:teuthology.orchestra.run.smithi117.stderr: 2023-06-10T19:09:52.733 INFO:teuthology.orchestra.run.smithi117.stderr:real 0m0.975s 2023-06-10T19:09:52.733 INFO:teuthology.orchestra.run.smithi117.stderr:user 0m4.591s 2023-06-10T19:09:52.733 INFO:teuthology.orchestra.run.smithi117.stderr:sys 0m0.194s 2023-06-10T19:09:52.933 INFO:teuthology.orchestra.run.smithi053.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-06-10T19:09:52.986 INFO:teuthology.orchestra.run.smithi053.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-06-10T19:09:53.015 INFO:teuthology.orchestra.run.smithi053.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-06-10T19:09:53.016 INFO:teuthology.orchestra.run.smithi053.stderr: 2023-06-10T19:09:53.016 INFO:teuthology.orchestra.run.smithi053.stderr:real 0m1.289s 2023-06-10T19:09:53.016 INFO:teuthology.orchestra.run.smithi053.stderr:user 0m6.397s 2023-06-10T19:09:53.016 INFO:teuthology.orchestra.run.smithi053.stderr:sys 0m0.434s 2023-06-10T19:09:53.018 INFO:tasks.ceph:Archiving logs... 2023-06-10T19:09:53.019 DEBUG:teuthology.misc:Transferring archived files from smithi053:/var/log/ceph to /home/teuthworker/archive/pdonnell-2023-06-10_18:20:34-fs:functional-main-distro-default-smithi/7301169/remote/smithi053/log 2023-06-10T19:09:53.020 DEBUG:teuthology.orchestra.run.smithi053:> sudo tar c -f - -C /var/log/ceph -- . 2023-06-10T19:09:54.575 DEBUG:teuthology.misc:Transferring archived files from smithi117:/var/log/ceph to /home/teuthworker/archive/pdonnell-2023-06-10_18:20:34-fs:functional-main-distro-default-smithi/7301169/remote/smithi117/log 2023-06-10T19:09:54.578 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar c -f - -C /var/log/ceph -- . 2023-06-10T19:09:55.198 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-06-10T19:09:55.207 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-06-10T19:09:55.207 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-06-10T19:09:55.210 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-06-10T19:09:55.298 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-06-10T19:09:55.307 INFO:teuthology.task.clock:Checking final clock skew... 2023-06-10T19:09:55.308 DEBUG:teuthology.orchestra.run.smithi053:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-06-10T19:09:55.311 DEBUG:teuthology.orchestra.run.smithi117:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-06-10T19:09:55.320 INFO:teuthology.orchestra.run.smithi053.stdout: remote refid st t when poll reach delay offset jitter 2023-06-10T19:09:55.320 INFO:teuthology.orchestra.run.smithi053.stdout:============================================================================== 2023-06-10T19:09:55.321 INFO:teuthology.orchestra.run.smithi053.stdout:*hv01.front.sepi 44.4.53.2 2 u 3 64 377 0.102 -3.816 0.830 2023-06-10T19:09:55.321 INFO:teuthology.orchestra.run.smithi053.stdout:+hv02.front.sepi 63.231.80.2 3 u - 64 377 0.086 -5.388 1.195 2023-06-10T19:09:55.321 INFO:teuthology.orchestra.run.smithi053.stdout:+hv03.front.sepi 74.6.168.72 3 u 4 64 377 0.094 -8.709 0.909 2023-06-10T19:09:55.321 INFO:teuthology.orchestra.run.smithi053.stdout: hv04.front.sepi .INIT. 16 u - 512 0 0.000 +0.000 0.000 2023-06-10T19:09:55.324 INFO:teuthology.orchestra.run.smithi117.stdout: remote refid st t when poll reach delay offset jitter 2023-06-10T19:09:55.325 INFO:teuthology.orchestra.run.smithi117.stdout:============================================================================== 2023-06-10T19:09:55.325 INFO:teuthology.orchestra.run.smithi117.stdout:*hv01.front.sepi 44.4.53.2 2 u 14 64 377 0.103 -5.158 1.057 2023-06-10T19:09:55.325 INFO:teuthology.orchestra.run.smithi117.stdout:+hv02.front.sepi 63.231.80.2 3 u 66 64 377 0.077 -3.732 1.163 2023-06-10T19:09:55.325 INFO:teuthology.orchestra.run.smithi117.stdout:+hv03.front.sepi 74.6.168.72 3 u 5 64 377 0.123 -7.784 0.622 2023-06-10T19:09:55.325 INFO:teuthology.orchestra.run.smithi117.stdout: hv04.front.sepi .INIT. 16 u - 512 0 0.000 +0.000 0.000 2023-06-10T19:09:55.326 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-06-10T19:09:55.343 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-06-10T19:09:55.344 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-06-10T19:09:55.362 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-06-10T19:09:55.395 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-06-10T19:09:55.429 INFO:teuthology.task.internal:Duration was 1715.153043 seconds 2023-06-10T19:09:55.430 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-06-10T19:09:55.469 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-06-10T19:09:55.469 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-06-10T19:09:55.471 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-06-10T19:09:55.547 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-06-10T19:09:55.547 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi053.front.sepia.ceph.com 2023-06-10T19:09:55.548 DEBUG:teuthology.orchestra.run.smithi053:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-06-10T19:09:55.557 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi117.front.sepia.ceph.com 2023-06-10T19:09:55.558 DEBUG:teuthology.orchestra.run.smithi117:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-06-10T19:09:55.568 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-06-10T19:09:55.569 DEBUG:teuthology.orchestra.run.smithi053:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-06-10T19:09:55.600 DEBUG:teuthology.orchestra.run.smithi117:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-06-10T19:09:55.633 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-06-10T19:09:55.633 DEBUG:teuthology.orchestra.run.smithi053:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-06-10T19:09:55.672 DEBUG:teuthology.orchestra.run.smithi117:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-06-10T19:09:55.779 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-06-10T19:09:55.789 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-06-10T19:09:55.789 DEBUG:teuthology.orchestra.run.smithi053:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-06-10T19:09:55.800 DEBUG:teuthology.orchestra.run.smithi117:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-06-10T19:09:55.814 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-06-10T19:09:55.832 DEBUG:teuthology.orchestra.run.smithi053:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-06-10T19:09:55.844 DEBUG:teuthology.orchestra.run.smithi117:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-06-10T19:09:55.851 INFO:teuthology.orchestra.run.smithi053.stdout:kernel.core_pattern = core 2023-06-10T19:09:55.865 INFO:teuthology.orchestra.run.smithi117.stdout:kernel.core_pattern = core 2023-06-10T19:09:55.878 DEBUG:teuthology.orchestra.run.smithi053:> test -e /home/ubuntu/cephtest/archive/coredump 2023-06-10T19:09:55.910 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-10T19:09:55.911 DEBUG:teuthology.orchestra.run.smithi117:> test -e /home/ubuntu/cephtest/archive/coredump 2023-06-10T19:09:55.922 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-10T19:09:55.923 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-06-10T19:09:55.933 INFO:teuthology.task.internal:Transferring archived files... 2023-06-10T19:09:55.934 DEBUG:teuthology.misc:Transferring archived files from smithi053:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2023-06-10_18:20:34-fs:functional-main-distro-default-smithi/7301169/remote/smithi053 2023-06-10T19:09:55.934 DEBUG:teuthology.orchestra.run.smithi053:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-06-10T19:09:55.974 DEBUG:teuthology.misc:Transferring archived files from smithi117:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2023-06-10_18:20:34-fs:functional-main-distro-default-smithi/7301169/remote/smithi117 2023-06-10T19:09:55.975 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-06-10T19:09:55.998 INFO:teuthology.task.internal:Removing archive directory... 2023-06-10T19:09:55.999 DEBUG:teuthology.orchestra.run.smithi053:> rm -rf -- /home/ubuntu/cephtest/archive 2023-06-10T19:09:56.012 DEBUG:teuthology.orchestra.run.smithi117:> rm -rf -- /home/ubuntu/cephtest/archive 2023-06-10T19:09:56.039 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-06-10T19:09:56.051 INFO:teuthology.task.internal:Not uploading archives. 2023-06-10T19:09:56.051 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-06-10T19:09:56.072 INFO:teuthology.task.internal:Tidying up after the test... 2023-06-10T19:09:56.073 DEBUG:teuthology.orchestra.run.smithi053:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-06-10T19:09:56.075 DEBUG:teuthology.orchestra.run.smithi117:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-06-10T19:09:56.079 INFO:teuthology.orchestra.run.smithi053.stdout: 655472 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 10 19:09 /home/ubuntu/cephtest 2023-06-10T19:09:56.087 INFO:teuthology.orchestra.run.smithi117.stdout: 655472 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 10 19:09 /home/ubuntu/cephtest 2023-06-10T19:09:56.089 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-06-10T19:09:56.105 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-06-10T19:09:56.172 INFO:teuthology.nuke:Checking targets against current locks 2023-06-10T19:09:56.207 DEBUG:teuthology.nuke:shortname: smithi053 2023-06-10T19:09:56.208 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-10T19:09:56.238 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi053.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-06-10_18:20:34-fs:functional-main-distro-default-smithi/7301169', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-10 18:32:28.327238', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHz4PxkQkTGV6jwRgxFhPAgth/TCBaJB3bBrMbuw6PzG5yhit1j1UVyscUib1Yka9nD5My81qLIgHIXI+nLH7+o='} 2023-06-10T19:09:56.242 DEBUG:teuthology.nuke:shortname: smithi117 2023-06-10T19:09:56.243 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-10T19:09:56.270 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi117.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-06-10_18:20:34-fs:functional-main-distro-default-smithi/7301169', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-10 18:32:28.329155', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMFGdcnpx7UyasrmBsPuKd1gCTau9Ir5lsSaADej0mNv7LfREvUcqD+KHP7YdcDf/eteIdQLCeea67ezwjp63Hc='} 2023-06-10T19:09:56.301 INFO:teuthology.orchestra.console:Power off smithi053 2023-06-10T19:09:56.302 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-10T19:09:56.328 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-10T19:09:56.353 INFO:teuthology.orchestra.console:Power off smithi117 2023-06-10T19:09:56.353 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-10T19:09:56.379 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-10T19:10:00.367 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-10T19:10:00.409 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-10T19:10:04.482 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-10T19:10:04.525 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-10T19:10:04.703 INFO:teuthology.orchestra.console:Power off for smithi053 completed 2023-06-10T19:10:04.740 INFO:teuthology.orchestra.console:Power off for smithi117 completed 2023-06-10T19:10:04.845 INFO:teuthology.run:Summary data: description: fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client-recovery} duration: 1715.1530425548553 failure_reason: 'Test failure: test_reconnect_after_blocklisted (tasks.cephfs.test_client_recovery.TestClientRecovery)' flavor: default owner: scheduled_pdonnell@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=07d2664c072e4b76980f34cb04343faa status: fail success: false 2023-06-10T19:10:04.846 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-10T19:10:04.943 INFO:teuthology.run:FAIL